-- Logs begin at Thu 2022-07-28 07:32:10 UTC, end at Thu 2022-07-28 09:29:52 UTC. -- Jul 28 07:57:48.862610 dv-cinder-851351-1-smb systemd[1]: Starting Devstack devstack@keystone.service... Jul 28 07:57:48.873453 dv-cinder-851351-1-smb devstack@keystone.service[80335]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Jul 28 07:57:48.875512 dv-cinder-851351-1-smb devstack@keystone.service[80335]: *** Starting uWSGI 2.0.18-debian (64bit) on [Thu Jul 28 07:57:48 2022] *** Jul 28 07:57:48.875512 dv-cinder-851351-1-smb devstack@keystone.service[80335]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jul 28 07:57:48.875512 dv-cinder-851351-1-smb devstack@keystone.service[80335]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jul 28 07:57:48.875512 dv-cinder-851351-1-smb devstack@keystone.service[80335]: nodename: dv-cinder-851351-1-smb Jul 28 07:57:48.875512 dv-cinder-851351-1-smb devstack@keystone.service[80335]: machine: x86_64 Jul 28 07:57:48.875512 dv-cinder-851351-1-smb devstack@keystone.service[80335]: clock source: unix Jul 28 07:57:48.875512 dv-cinder-851351-1-smb devstack@keystone.service[80335]: pcre jit disabled Jul 28 07:57:48.875512 dv-cinder-851351-1-smb devstack@keystone.service[80335]: detected number of CPU cores: 4 Jul 28 07:57:48.875512 dv-cinder-851351-1-smb devstack@keystone.service[80335]: current working directory: / Jul 28 07:57:48.875512 dv-cinder-851351-1-smb devstack@keystone.service[80335]: detected binary path: /usr/bin/uwsgi-core Jul 28 07:57:48.876021 dv-cinder-851351-1-smb devstack@keystone.service[80335]: your processes number limit is 47680 Jul 28 07:57:48.876021 dv-cinder-851351-1-smb devstack@keystone.service[80335]: your memory page size is 4096 bytes Jul 28 07:57:48.876021 dv-cinder-851351-1-smb devstack@keystone.service[80335]: detected max file descriptor number: 2048 Jul 28 07:57:48.876021 dv-cinder-851351-1-smb devstack@keystone.service[80335]: lock engine: pthread robust mutexes Jul 28 07:57:48.876021 dv-cinder-851351-1-smb devstack@keystone.service[80335]: thunder lock: enabled Jul 28 07:57:48.876021 dv-cinder-851351-1-smb devstack@keystone.service[80335]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Jul 28 07:57:48.876021 dv-cinder-851351-1-smb devstack@keystone.service[80335]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Jul 28 07:57:48.914566 dv-cinder-851351-1-smb devstack@keystone.service[80335]: Python main interpreter initialized at 0x562d65c639c0 Jul 28 07:57:48.914566 dv-cinder-851351-1-smb devstack@keystone.service[80335]: python threads support enabled Jul 28 07:57:48.914566 dv-cinder-851351-1-smb devstack@keystone.service[80335]: your server socket listen backlog is limited to 100 connections Jul 28 07:57:48.914566 dv-cinder-851351-1-smb devstack@keystone.service[80335]: your mercy for graceful operations on workers is 90 seconds Jul 28 07:57:48.914912 dv-cinder-851351-1-smb devstack@keystone.service[80335]: mapped 403077 bytes (393 KB) for 2 cores Jul 28 07:57:48.915018 dv-cinder-851351-1-smb devstack@keystone.service[80335]: *** Operational MODE: preforking *** Jul 28 07:57:48.915286 dv-cinder-851351-1-smb devstack@keystone.service[80335]: *** uWSGI is running in multiple interpreter mode *** Jul 28 07:57:48.915286 dv-cinder-851351-1-smb devstack@keystone.service[80335]: spawned uWSGI master process (pid: 80335) Jul 28 07:57:48.915536 dv-cinder-851351-1-smb systemd[1]: Started Devstack devstack@keystone.service. Jul 28 07:57:48.916070 dv-cinder-851351-1-smb devstack@keystone.service[80335]: spawned uWSGI worker 1 (pid: 80347, cores: 1) Jul 28 07:57:48.916402 dv-cinder-851351-1-smb devstack@keystone.service[80335]: spawned uWSGI worker 2 (pid: 80348, cores: 1) Jul 28 07:57:48.920655 dv-cinder-851351-1-smb devstack@keystone.service[80335]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jul 28 07:57:54.323277 dv-cinder-851351-1-smb devstack@keystone.service[80348]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 28 07:57:54.323277 dv-cinder-851351-1-smb devstack@keystone.service[80348]: from cryptography.utils import int_from_bytes Jul 28 07:57:54.324103 dv-cinder-851351-1-smb devstack@keystone.service[80347]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 28 07:57:54.324103 dv-cinder-851351-1-smb devstack@keystone.service[80347]: from cryptography.utils import int_from_bytes Jul 28 07:57:54.324502 dv-cinder-851351-1-smb devstack@keystone.service[80348]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 28 07:57:54.324502 dv-cinder-851351-1-smb devstack@keystone.service[80348]: from cryptography.utils import int_from_bytes Jul 28 07:57:54.324606 dv-cinder-851351-1-smb devstack@keystone.service[80347]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 28 07:57:54.324606 dv-cinder-851351-1-smb devstack@keystone.service[80347]: from cryptography.utils import int_from_bytes Jul 28 07:57:54.373413 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 28 07:57:54.373639 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=80348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 28 07:57:54.373720 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 28 07:57:54.373800 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG uwsgi [-] command line args: [] {{(pid=80348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 28 07:57:54.373865 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 28 07:57:54.374007 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=80348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 28 07:57:54.374086 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG uwsgi [-] command line args: [] {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 28 07:57:54.374144 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG uwsgi [-] ================================================================================ {{(pid=80348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 28 07:57:54.374355 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 28 07:57:54.374488 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG uwsgi [-] admin_token = **** {{(pid=80348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 07:57:54.374563 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG uwsgi [-] ================================================================================ {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 28 07:57:54.374636 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG uwsgi [-] config_dir = [] {{(pid=80348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 07:57:54.374778 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG uwsgi [-] admin_token = **** {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 07:57:54.374907 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=80348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 07:57:54.374995 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG uwsgi [-] config_source = [] {{(pid=80348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 07:57:54.375070 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG uwsgi [-] config_dir = [] {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 07:57:54.375147 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG uwsgi [-] debug = True {{(pid=80348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 07:57:54.375238 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 07:57:54.375309 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=80348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 07:57:54.375643 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG uwsgi [-] config_source = [] {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 07:57:54.375643 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG uwsgi [-] debug = True {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 07:57:54.375763 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=80348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 07:57:54.375822 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 07:57:54.375908 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG uwsgi [-] insecure_debug = False {{(pid=80348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 07:57:54.375966 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 07:57:54.376177 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=80348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 07:57:54.376269 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG uwsgi [-] insecure_debug = False {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 07:57:54.376331 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=80348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 07:57:54.376391 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 07:57:54.377580 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG uwsgi [-] list_limit = None {{(pid=80348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 07:57:54.377668 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 07:57:54.377743 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG uwsgi [-] log_config_append = None {{(pid=80348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 07:57:54.377813 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG uwsgi [-] list_limit = None {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 07:57:54.377872 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=80348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 07:57:54.377932 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG uwsgi [-] log_config_append = None {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 07:57:54.377989 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG uwsgi [-] log_dir = None {{(pid=80348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 07:57:54.378049 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 07:57:54.378111 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG uwsgi [-] log_file = None {{(pid=80348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 07:57:54.378178 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG uwsgi [-] log_dir = None {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 07:57:54.378240 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=80348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 07:57:54.378296 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG uwsgi [-] log_file = None {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 07:57:54.378352 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=80348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 07:57:54.378406 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 07:57:54.378460 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=80348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 07:57:54.378525 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 07:57:54.378583 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=80348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 07:57:54.378646 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 07:57:54.378708 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=80348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 07:57:54.378767 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 07:57:54.378824 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=80348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 07:57:54.378888 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 07:57:54.378955 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=80348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 07:57:54.379014 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 07:57:54.379071 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=80348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 07:57:54.379128 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 07:57:54.379192 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=80348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 07:57:54.379255 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 07:57:54.379460 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=80348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 07:57:54.379532 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 07:57:54.379589 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=80348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 07:57:54.379651 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 07:57:54.379783 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=80348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 07:57:54.379873 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 07:57:54.380054 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=80348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 07:57:54.380175 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 07:57:54.380251 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG uwsgi [-] notification_format = cadf {{(pid=80348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 07:57:54.380319 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 07:57:54.380556 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=80348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 07:57:54.380693 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG uwsgi [-] notification_format = cadf {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 07:57:54.380867 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 07:57:54.381071 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.42/identity {{(pid=80348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 07:57:54.381243 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG uwsgi [-] publish_errors = False {{(pid=80348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 07:57:54.381376 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.42/identity {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 07:57:54.381463 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=80348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 07:57:54.381526 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG uwsgi [-] publish_errors = False {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 07:57:54.381742 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=80348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 07:57:54.381879 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 07:57:54.382009 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=80348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 07:57:54.382086 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 07:57:54.382154 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=80348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 07:57:54.382268 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 07:57:54.382376 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=80348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 07:57:54.382460 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 07:57:54.382531 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG uwsgi [-] standard_threads = False {{(pid=80348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 07:57:54.382642 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 07:57:54.382740 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG uwsgi [-] strict_password_check = False {{(pid=80348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 07:57:54.382889 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG uwsgi [-] standard_threads = False {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 07:57:54.382963 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=80348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 07:57:54.383032 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG uwsgi [-] strict_password_check = False {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 07:57:54.383149 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG uwsgi [-] use_eventlog = False {{(pid=80348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 07:57:54.383233 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 07:57:54.383346 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG uwsgi [-] use_journal = False {{(pid=80348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 07:57:54.383432 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG uwsgi [-] use_eventlog = False {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 07:57:54.383503 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG uwsgi [-] use_json = False {{(pid=80348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 07:57:54.383577 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG uwsgi [-] use_journal = False {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 07:57:54.383646 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG uwsgi [-] use_stderr = False {{(pid=80348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 07:57:54.383779 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG uwsgi [-] use_json = False {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 07:57:54.383914 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG uwsgi [-] use_syslog = False {{(pid=80348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 07:57:54.384001 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG uwsgi [-] use_stderr = False {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 07:57:54.384079 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG uwsgi [-] watch_log_file = False {{(pid=80348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 07:57:54.384149 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG uwsgi [-] use_syslog = False {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 07:57:54.384223 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=80348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 07:57:54.384298 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG uwsgi [-] watch_log_file = False {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 07:57:54.384484 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=80348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 07:57:54.384614 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 07:57:54.384717 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=80348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 07:57:54.384792 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 07:57:54.384987 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=80348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 07:57:54.385124 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 07:57:54.385215 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=80348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 07:57:54.385294 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 07:57:54.385448 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=80348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 07:57:54.385579 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 07:57:54.385664 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=80348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 07:57:54.385741 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 07:57:54.385905 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=80348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 07:57:54.386039 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 07:57:54.386119 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=80348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 07:57:54.386196 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 07:57:54.386361 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=80348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 07:57:54.386448 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 07:57:54.386606 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=80348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 07:57:54.386686 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 07:57:54.386837 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=80348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 07:57:54.386916 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 07:57:54.387068 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=80348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 07:57:54.387223 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 07:57:54.387309 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=80348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 07:57:54.387381 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 07:57:54.387536 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=80348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 07:57:54.387621 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 07:57:54.387771 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=80348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 07:57:54.387851 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 07:57:54.388002 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=80348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 07:57:54.388081 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 07:57:54.388242 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=80348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 07:57:54.388328 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 07:57:54.388491 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=80348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 07:57:54.388576 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 07:57:54.388752 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=80348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 07:57:54.388834 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 07:57:54.388986 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=80348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 07:57:54.389065 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 07:57:54.389233 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=80348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 07:57:54.389332 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 07:57:54.389486 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=80348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 07:57:54.389565 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 07:57:54.389732 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=80348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 07:57:54.389811 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 07:57:54.389974 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=80348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 07:57:54.390054 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 07:57:54.390200 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=80348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 07:57:54.390279 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 07:57:54.390423 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=80348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 07:57:54.390502 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 07:57:54.390649 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=80348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 07:57:54.390728 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 07:57:54.390865 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 07:57:54.390940 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=80348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 07:57:54.391103 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 07:57:54.391184 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=80348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 07:57:54.391342 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=80348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 07:57:54.391422 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 07:57:54.391575 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=80348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 07:57:54.391656 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 07:57:54.391792 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=80348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 07:57:54.391866 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 07:57:54.392089 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 07:57:54.392180 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=80348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 07:57:54.392336 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=80348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 07:57:54.392410 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 07:57:54.392569 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=80348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 07:57:54.392649 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 07:57:54.392835 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 07:57:54.392929 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=80348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 07:57:54.393062 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=80348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 07:57:54.393142 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 07:57:54.393292 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=80348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 07:57:54.393366 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 07:57:54.393522 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=80348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 07:57:54.393675 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 07:57:54.393755 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=80348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 07:57:54.393824 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 07:57:54.393966 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=80348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 07:57:54.394047 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 07:57:54.394193 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=80348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 07:57:54.394275 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 07:57:54.394420 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=80348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 07:57:54.394495 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 07:57:54.394650 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 07:57:54.394730 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=80348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 07:57:54.394886 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 07:57:54.394969 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=80348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 07:57:54.395111 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=80348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 07:57:54.395184 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 07:57:54.395343 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=80348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 07:57:54.395417 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 07:57:54.395569 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=80348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 07:57:54.395651 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 07:57:54.395797 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 07:57:54.395871 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=80348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 07:57:54.396024 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=80348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 07:57:54.396096 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 07:57:54.396257 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 07:57:54.396342 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=80348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 07:57:54.396484 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=80348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 07:57:54.396617 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 07:57:54.396746 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 07:57:54.396841 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=80348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 07:57:54.396980 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=80348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 07:57:54.397099 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 07:57:54.397215 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 07:57:54.397315 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=80348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 07:57:54.397444 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=80348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 07:57:54.397544 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 07:57:54.397675 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=80348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 07:57:54.397788 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 07:57:54.397903 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=80348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 07:57:54.398004 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 07:57:54.398130 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 07:57:54.398207 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=80348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 07:57:54.398369 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=80348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 07:57:54.398490 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 07:57:54.398603 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 07:57:54.398679 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=80348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 07:57:54.398828 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=80348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 07:57:54.398913 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 07:57:54.399058 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 07:57:54.399204 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=80348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 07:57:54.399339 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=80348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 07:57:54.399432 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 07:57:54.399531 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=80348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 07:57:54.399609 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 07:57:54.399764 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 07:57:54.399842 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=80348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 07:57:54.399994 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=80348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 07:57:54.400080 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 07:57:54.400228 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 07:57:54.400303 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=80348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 07:57:54.400479 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=80348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 07:57:54.400562 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 07:57:54.400745 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=80348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 07:57:54.400857 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 07:57:54.400987 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=80348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 07:57:54.401064 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 07:57:54.401221 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=80348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 07:57:54.401296 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 07:57:54.401452 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=80348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 07:57:54.401565 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 07:57:54.401681 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=80348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 07:57:54.401762 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 07:57:54.401900 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG uwsgi [-] cache.enabled = True {{(pid=80348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 07:57:54.402021 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 07:57:54.402139 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=80348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 07:57:54.402222 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG uwsgi [-] cache.enabled = True {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 07:57:54.402370 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=80348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 07:57:54.402446 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 07:57:54.402607 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 07:57:54.402684 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=80348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 07:57:54.402836 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=80348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 07:57:54.402915 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 07:57:54.403068 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=80348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 07:57:54.403153 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 07:57:54.403299 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=80348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 07:57:54.403414 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 07:57:54.403545 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=80348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 07:57:54.403695 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 07:57:54.403773 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=80348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 07:57:54.403850 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 07:57:54.403989 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 07:57:54.404064 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=80348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 07:57:54.404227 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=80348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 07:57:54.404312 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 07:57:54.404466 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=80348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 07:57:54.404542 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 07:57:54.404726 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=80348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 07:57:54.404806 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 07:57:54.404959 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 07:57:54.405032 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=80348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 07:57:54.405179 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=80348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 07:57:54.405261 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 07:57:54.405411 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=80348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 07:57:54.405486 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 07:57:54.405642 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=80348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 07:57:54.405728 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 07:57:54.405869 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=80348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 07:57:54.405946 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 07:57:54.406098 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=80348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 07:57:54.406174 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 07:57:54.406322 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=80348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 07:57:54.406404 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 07:57:54.406552 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 07:57:54.406628 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=80348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 07:57:54.406777 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=80348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 07:57:54.406857 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 07:57:54.407006 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 07:57:54.407081 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=80348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 07:57:54.407236 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=80348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 07:57:54.407311 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 07:57:54.407474 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 07:57:54.407548 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=80348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 07:57:54.407733 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=80348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 07:57:54.407809 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 07:57:54.407988 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=80348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 07:57:54.408106 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 07:57:54.408247 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=80348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 07:57:54.408323 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 07:57:54.408485 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=80348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 07:57:54.408561 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 07:57:54.408736 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG uwsgi [-] auth.external = None {{(pid=80348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 07:57:54.408815 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 07:57:54.408967 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG uwsgi [-] auth.mapped = None {{(pid=80348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 07:57:54.409044 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG uwsgi [-] auth.external = None {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 07:57:54.409204 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG uwsgi [-] auth.mapped = None {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 07:57:54.409286 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=80348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 07:57:54.409471 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=80348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 07:57:54.409556 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 07:57:54.409697 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG uwsgi [-] auth.password = None {{(pid=80348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 07:57:54.409779 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 07:57:54.409921 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG uwsgi [-] auth.token = None {{(pid=80348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 07:57:54.409997 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG uwsgi [-] auth.password = None {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 07:57:54.410155 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=80348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 07:57:54.410240 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG uwsgi [-] auth.token = None {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 07:57:54.410385 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG uwsgi [-] catalog.caching = True {{(pid=80348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 07:57:54.410467 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 07:57:54.410623 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG uwsgi [-] catalog.caching = True {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 07:57:54.410698 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=80348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 07:57:54.410847 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=80348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 07:57:54.410930 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 07:57:54.411090 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=80348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 07:57:54.411168 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 07:57:54.411333 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=80348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 07:57:54.411409 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 07:57:54.411561 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=80348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 07:57:54.411647 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 07:57:54.411792 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG uwsgi [-] credential.caching = True {{(pid=80348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 07:57:54.411876 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 07:57:54.412029 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG uwsgi [-] credential.caching = True {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 07:57:54.412103 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG uwsgi [-] credential.driver = sql {{(pid=80348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 07:57:54.412270 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=80348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 07:57:54.412352 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG uwsgi [-] credential.driver = sql {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 07:57:54.412514 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=80348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 07:57:54.412597 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 07:57:54.412785 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 07:57:54.412863 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=80348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 07:57:54.413026 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=80348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 07:57:54.413112 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 07:57:54.413259 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=80348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 07:57:54.413378 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 07:57:54.413500 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 07:57:54.413582 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=80348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 07:57:54.413762 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=80348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 07:57:54.413845 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 07:57:54.413995 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=80348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 07:57:54.414071 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 07:57:54.414239 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 07:57:54.414313 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=80348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 07:57:54.414494 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 07:57:54.414579 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=80348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 07:57:54.414746 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=80348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 07:57:54.414821 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 07:57:54.415003 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=80348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 07:57:54.415079 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 07:57:54.415241 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=80348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 07:57:54.415324 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 07:57:54.415496 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 07:57:54.415571 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=80348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 07:57:54.415726 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG uwsgi [-] federation.caching = True {{(pid=80348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 07:57:54.415808 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 07:57:54.415959 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=80348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 07:57:54.416042 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG uwsgi [-] federation.caching = True {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 07:57:54.416201 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG uwsgi [-] federation.driver = sql {{(pid=80348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 07:57:54.416278 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 07:57:54.416444 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=80348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 07:57:54.416521 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG uwsgi [-] federation.driver = sql {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 07:57:54.416762 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=80348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 07:57:54.416856 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 07:57:54.416930 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 07:57:54.416998 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=80348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 07:57:54.417164 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 07:57:54.417242 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=80348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 07:57:54.417403 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 07:57:54.417491 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=80348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 07:57:54.417634 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=80348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 07:57:54.417751 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 07:57:54.417881 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 07:57:54.417957 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=80348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 07:57:54.418112 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=80348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 07:57:54.418200 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 07:57:54.418367 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 07:57:54.418442 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=80348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 07:57:54.418597 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG uwsgi [-] identity.caching = True {{(pid=80348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 07:57:54.418671 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 07:57:54.418841 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG uwsgi [-] identity.caching = True {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 07:57:54.418995 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=80348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 07:57:54.419070 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=80348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 07:57:54.419139 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 07:57:54.419303 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=80348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 07:57:54.419380 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 07:57:54.419534 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=80348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 07:57:54.419612 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 07:57:54.419770 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 07:57:54.419846 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG uwsgi [-] identity.driver = sql {{(pid=80348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 07:57:54.419998 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=80348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 07:57:54.420073 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG uwsgi [-] identity.driver = sql {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 07:57:54.420231 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=80348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 07:57:54.420309 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 07:57:54.420469 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 07:57:54.420544 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=80348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 07:57:54.420737 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=80348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 07:57:54.420817 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 07:57:54.420969 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=80348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 07:57:54.421048 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 07:57:54.421196 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=80348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 07:57:54.421272 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 07:57:54.421424 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=80348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 07:57:54.421500 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 07:57:54.421655 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 07:57:54.421732 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=80348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 07:57:54.421895 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=80348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 07:57:54.421970 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 07:57:54.422141 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 07:57:54.422215 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=80348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 07:57:54.422387 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 07:57:54.422465 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=80348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 07:57:54.422626 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=80348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 07:57:54.422701 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 07:57:54.422878 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 07:57:54.422954 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=80348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 07:57:54.423111 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=80348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 07:57:54.423188 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 07:57:54.423394 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=80348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 07:57:54.423472 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 07:57:54.423622 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=80348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 07:57:54.423698 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 07:57:54.423854 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=80348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 07:57:54.423933 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 07:57:54.424080 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=80348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 07:57:54.424156 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 07:57:54.424315 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=80348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 07:57:54.424428 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 07:57:54.424551 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=80348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 07:57:54.424655 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 07:57:54.424809 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=80348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 07:57:54.424886 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 07:57:54.425051 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 07:57:54.425128 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=80348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 07:57:54.425276 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=80348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 07:57:54.425352 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 07:57:54.425519 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 07:57:54.425594 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=80348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 07:57:54.425760 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=80348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 07:57:54.425835 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 07:57:54.425990 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=80348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 07:57:54.426068 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 07:57:54.426226 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 07:57:54.426300 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=80348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 07:57:54.426466 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=80348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 07:57:54.426542 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 07:57:54.426694 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=80348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 07:57:54.426772 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 07:57:54.426927 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=80348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 07:57:54.427003 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 07:57:54.427152 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG uwsgi [-] ldap.password = **** {{(pid=80348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 07:57:54.427227 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 07:57:54.427383 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG uwsgi [-] ldap.password = **** {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 07:57:54.427498 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=80348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 07:57:54.427613 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=80348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 07:57:54.427690 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 07:57:54.427850 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 07:57:54.427932 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=80348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 07:57:54.428080 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=80348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 07:57:54.428158 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 07:57:54.428312 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=80348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 07:57:54.428388 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 07:57:54.428547 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 07:57:54.428622 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=80348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 07:57:54.428810 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=80348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 07:57:54.428889 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 07:57:54.429037 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=80348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 07:57:54.429113 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 07:57:54.429262 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=80348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 07:57:54.429344 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 07:57:54.429493 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 07:57:54.429575 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=80348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 07:57:54.429734 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=80348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 07:57:54.429809 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 07:57:54.429963 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=80348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 07:57:54.430039 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 07:57:54.430194 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=80348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 07:57:54.430278 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 07:57:54.430424 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=80348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 07:57:54.430502 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 07:57:54.430650 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG uwsgi [-] ldap.user = None {{(pid=80348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 07:57:54.430727 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 07:57:54.430880 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG uwsgi [-] ldap.user = None {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 07:57:54.430963 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=80348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 07:57:54.431121 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 07:57:54.431197 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=80348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 07:57:54.431346 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=80348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 07:57:54.431428 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 07:57:54.431587 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=80348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 07:57:54.431663 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 07:57:54.431828 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=80348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 07:57:54.431905 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 07:57:54.432075 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 07:57:54.432158 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=80348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 07:57:54.432303 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=80348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 07:57:54.432379 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 07:57:54.432527 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=80348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 07:57:54.432603 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 07:57:54.432786 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 07:57:54.432875 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=80348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 07:57:54.433017 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=80348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 07:57:54.433092 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 07:57:54.433249 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 07:57:54.433324 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=80348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 07:57:54.433473 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=80348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 07:57:54.433555 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 07:57:54.433712 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 07:57:54.433787 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=80348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 07:57:54.433950 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=80348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 07:57:54.434024 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 07:57:54.434190 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=80348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 07:57:54.434274 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 07:57:54.434436 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 07:57:54.434566 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=80348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 07:57:54.434813 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 07:57:54.434889 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=80348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 07:57:54.435043 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=80348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 07:57:54.435126 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 07:57:54.435283 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 07:57:54.435358 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=80348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 07:57:54.435518 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=80348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 07:57:54.435594 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 07:57:54.435754 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=80348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 07:57:54.435837 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 07:57:54.435990 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 07:57:54.436066 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=80348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 07:57:54.436220 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=80348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 07:57:54.436296 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 07:57:54.436454 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 07:57:54.436537 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=80348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 07:57:54.436720 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=80348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 07:57:54.436801 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 07:57:54.436955 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=80348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 07:57:54.437031 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 07:57:54.437191 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 07:57:54.437278 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG uwsgi [-] policy.driver = sql {{(pid=80348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 07:57:54.437419 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=80348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 07:57:54.437494 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG uwsgi [-] policy.driver = sql {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 07:57:54.437660 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=80348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 07:57:54.437736 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 07:57:54.437893 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=80348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 07:57:54.437977 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 07:57:54.438124 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG uwsgi [-] receipt.caching = True {{(pid=80348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 07:57:54.438201 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 07:57:54.438358 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG uwsgi [-] receipt.caching = True {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 07:57:54.438433 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=80348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 07:57:54.438597 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 07:57:54.438682 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=80348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 07:57:54.438859 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=80348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 07:57:54.438936 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 07:57:54.439090 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=80348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 07:57:54.439166 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 07:57:54.439323 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 07:57:54.439406 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=80348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 07:57:54.439558 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG uwsgi [-] resource.caching = True {{(pid=80348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 07:57:54.439633 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 07:57:54.439798 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG uwsgi [-] resource.caching = True {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 07:57:54.439872 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=80348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 07:57:54.440040 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG uwsgi [-] resource.driver = sql {{(pid=80348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 07:57:54.440123 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 07:57:54.440271 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=80348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 07:57:54.440348 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG uwsgi [-] resource.driver = sql {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 07:57:54.440510 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 07:57:54.440584 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=80348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 07:57:54.440786 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=80348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 07:57:54.440875 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 07:57:54.441019 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG uwsgi [-] revoke.caching = True {{(pid=80348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 07:57:54.441096 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 07:57:54.441262 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=80348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 07:57:54.441338 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG uwsgi [-] revoke.caching = True {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 07:57:54.441495 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=80348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 07:57:54.441649 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 07:57:54.441725 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG uwsgi [-] role.cache_time = None {{(pid=80348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 07:57:54.441795 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 07:57:54.441955 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG uwsgi [-] role.caching = True {{(pid=80348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 07:57:54.442032 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG uwsgi [-] role.cache_time = None {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 07:57:54.442195 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG uwsgi [-] role.driver = sql {{(pid=80348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 07:57:54.442280 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG uwsgi [-] role.caching = True {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 07:57:54.442422 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG uwsgi [-] role.list_limit = None {{(pid=80348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 07:57:54.442498 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG uwsgi [-] role.driver = sql {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 07:57:54.442659 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG uwsgi [-] role.list_limit = None {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 07:57:54.442735 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=80348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 07:57:54.442900 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=80348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 07:57:54.442984 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 07:57:54.443141 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=80348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 07:57:54.443217 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 07:57:54.443382 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=80348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 07:57:54.443459 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 07:57:54.443623 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=80348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 07:57:54.443708 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 07:57:54.443864 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=80348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 07:57:54.443941 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 07:57:54.444107 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=80348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 07:57:54.444183 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 07:57:54.444348 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=80348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 07:57:54.444426 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 07:57:54.444578 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=80348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 07:57:54.444654 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 07:57:54.444838 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 07:57:54.444914 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=80348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 07:57:54.445091 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 07:57:54.445170 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=80348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 07:57:54.445339 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 07:57:54.445415 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=80348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 07:57:54.445589 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 07:57:54.445665 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=80348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 07:57:54.445837 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 07:57:54.446012 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=80348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 07:57:54.446243 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=80348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 07:57:54.446318 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 07:57:54.446479 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 07:57:54.446554 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=80348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 07:57:54.446722 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=80348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 07:57:54.446798 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 07:57:54.446964 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=80348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 07:57:54.447041 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 07:57:54.447209 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=80348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 07:57:54.447285 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 07:57:54.447439 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=80348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 07:57:54.447518 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 07:57:54.447678 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 07:57:54.447753 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=80348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 07:57:54.447923 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=80348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 07:57:54.447998 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 07:57:54.448157 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=80348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 07:57:54.448235 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 07:57:54.448384 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=80348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 07:57:54.448461 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 07:57:54.448612 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=80348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 07:57:54.448705 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 07:57:54.448866 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=80348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 07:57:54.448945 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 07:57:54.449098 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 07:57:54.449174 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=80348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 07:57:54.449349 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=80348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 07:57:54.449432 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 07:57:54.449592 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=80348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 07:57:54.449668 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 07:57:54.449826 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=80348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 07:57:54.449902 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 07:57:54.450058 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=80348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 07:57:54.450142 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 07:57:54.450285 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG uwsgi [-] token.cache_time = None {{(pid=80348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 07:57:54.450362 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 07:57:54.450546 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG uwsgi [-] token.cache_time = None {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 07:57:54.450627 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG uwsgi [-] token.caching = True {{(pid=80348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 07:57:54.450748 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=80348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 07:57:54.450832 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG uwsgi [-] token.caching = True {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 07:57:54.450986 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 07:57:54.451065 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG uwsgi [-] token.provider = fernet {{(pid=80348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 07:57:54.451215 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=80348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 07:57:54.451291 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG uwsgi [-] token.provider = fernet {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 07:57:54.451458 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 07:57:54.451542 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=80348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 07:57:54.451698 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=80348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 07:57:54.451773 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 07:57:54.451935 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=80348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 07:57:54.452011 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 07:57:54.452176 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 07:57:54.452259 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=80348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 07:57:54.452412 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=80348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 07:57:54.452488 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 07:57:54.452653 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 07:57:54.452798 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG uwsgi [-] trust.driver = sql {{(pid=80348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 07:57:54.452906 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=80348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 07:57:54.452994 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG uwsgi [-] trust.driver = sql {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 07:57:54.453141 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=80348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 07:57:54.453218 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 07:57:54.453371 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=80348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 07:57:54.453446 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 07:57:54.453604 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 07:57:54.453687 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=80348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 07:57:54.453842 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=80348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 07:57:54.453918 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 07:57:54.454066 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=80348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 07:57:54.454142 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 07:57:54.454305 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=80348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 07:57:54.454392 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 07:57:54.454598 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 07:57:54.454680 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=80348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 07:57:54.454897 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 07:57:54.454984 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG uwsgi [-] database.connection = **** {{(pid=80348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 07:57:54.455133 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=80348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 07:57:54.455219 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG uwsgi [-] database.connection = **** {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 07:57:54.455375 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=80348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 07:57:54.455462 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 07:57:54.455608 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=80348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 07:57:54.455738 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 07:57:54.455844 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=80348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 07:57:54.455921 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 07:57:54.456074 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=80348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 07:57:54.456150 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 07:57:54.456304 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=80348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 07:57:54.456383 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 07:57:54.456535 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=80348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 07:57:54.456614 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 07:57:54.456792 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 07:57:54.456870 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=80348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 07:57:54.457031 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=80348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 07:57:54.457109 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 07:57:54.457260 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=80348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 07:57:54.457337 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 07:57:54.457498 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 07:57:54.457573 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=80348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 07:57:54.457724 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=80348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 07:57:54.457802 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 07:57:54.457965 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 07:57:54.458041 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=80348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 07:57:54.458556 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=80348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 07:57:54.458632 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 07:57:54.458797 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=80348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 07:57:54.458876 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 07:57:54.459023 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=80348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 07:57:54.459100 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 07:57:54.459258 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 07:57:54.459334 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=80348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 07:57:54.459485 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=80348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 07:57:54.459562 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 07:57:54.459652 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80348) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 28 07:57:54.459729 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 07:57:54.459890 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80347) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 28 07:57:54.489741 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=80348) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 07:57:54.489961 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=80347) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 07:57:54.489961 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=80347) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 07:57:54.490077 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=80348) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 07:57:54.490175 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=80348) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 07:57:54.490256 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=80347) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 07:57:54.498637 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=80348) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 07:57:54.498731 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=80347) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 07:57:54.529037 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=80348) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 07:57:54.529356 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=80348) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 07:57:54.529491 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=80347) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 07:57:54.529641 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=80347) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 07:57:54.582036 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=80348) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 07:57:54.582680 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=80347) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 07:57:54.631993 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=80348) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 07:57:54.632275 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=80348) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 07:57:54.633220 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=80347) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 07:57:54.633473 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=80347) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 07:57:54.695640 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80348) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 07:57:54.695807 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=80348) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 07:57:54.695995 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=80348) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 07:57:54.696119 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80347) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 07:57:54.696210 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=80348) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 07:57:54.696290 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=80347) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 07:57:54.696386 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=80348) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 07:57:54.696463 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=80347) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 07:57:54.696613 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=80348) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 07:57:54.696784 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=80347) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 07:57:54.696889 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=80347) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 07:57:54.697130 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=80347) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 07:57:54.720958 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80347) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 07:57:54.721122 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80348) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 07:57:54.721230 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=80347) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 07:57:54.721351 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=80348) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 07:57:54.721437 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=80347) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 07:57:54.721606 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=80348) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 07:57:54.721741 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=80347) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 07:57:54.721826 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=80348) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 07:57:54.721905 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=80347) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 07:57:54.721985 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=80347) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 07:57:54.722057 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=80348) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 07:57:54.722204 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=80348) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 07:57:54.722327 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80347) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 07:57:54.722412 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80348) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 07:57:54.733504 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=80348) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 07:57:54.733634 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=80347) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 07:57:54.746403 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80348) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 07:57:54.746544 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80347) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 07:57:54.746636 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=80348) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 07:57:54.746850 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=80347) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 07:57:54.746977 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=80348) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 07:57:54.747113 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=80347) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 07:57:54.747242 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=80348) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 07:57:54.747336 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=80347) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 07:57:54.747460 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=80348) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 07:57:54.747601 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=80347) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 07:57:54.747682 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=80348) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 07:57:54.747801 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=80347) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 07:57:54.747882 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80348) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 07:57:54.748010 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80347) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 07:57:54.764554 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=80348) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 07:57:54.764788 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=80348) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jul 28 07:57:54.765113 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=80347) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 07:57:54.765239 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=80348) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 07:57:54.765397 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=80348) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jul 28 07:57:54.765532 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=80347) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jul 28 07:57:54.765670 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=80348) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 07:57:54.765752 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=80347) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 07:57:54.765872 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=80348) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 07:57:54.765953 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=80347) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jul 28 07:57:54.766078 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=80348) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 07:57:54.766161 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=80347) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 07:57:54.766279 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=80348) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 07:57:54.766359 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=80347) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 07:57:54.766582 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=80347) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 07:57:54.766816 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=80347) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 07:57:54.775854 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=80348) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 07:57:54.776096 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=80348) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 07:57:54.776385 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=80348) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 07:57:54.776509 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=80347) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 07:57:54.776654 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=80348) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 07:57:54.776825 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=80347) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 07:57:54.777092 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=80347) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 07:57:54.777368 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=80347) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 07:57:54.783563 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=80348) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 28 07:57:54.784383 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=80347) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 28 07:57:54.788321 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=80348) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 28 07:57:54.788604 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=80348) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 07:57:54.788907 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=80348) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 07:57:54.789174 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=80348) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 07:57:54.789366 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=80347) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 28 07:57:54.789475 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=80348) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 07:57:54.789604 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=80347) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 07:57:54.789733 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=80348) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 07:57:54.789817 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=80347) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 07:57:54.789937 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=80348) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 07:57:54.790029 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=80347) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 07:57:54.790155 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=80348) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 07:57:54.790234 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=80347) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 07:57:54.790411 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=80348) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 07:57:54.790502 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=80347) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 07:57:54.790692 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=80348) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 07:57:54.790884 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=80347) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 07:57:54.791024 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=80348) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 07:57:54.791151 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=80347) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 07:57:54.791274 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=80347) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 07:57:54.791527 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=80347) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 07:57:54.791794 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=80347) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 07:57:54.813610 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=80348) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 07:57:54.814809 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=80347) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 07:57:54.815138 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=80348) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 28 07:57:54.815415 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=80348) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 07:57:54.816291 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=80347) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 28 07:57:54.816576 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=80347) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 07:57:54.819976 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=80348) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 28 07:57:54.820250 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=80348) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 07:57:54.820526 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=80348) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 07:57:54.821284 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=80347) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 28 07:57:54.821563 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=80347) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 07:57:54.821844 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=80347) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 07:57:54.827067 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=80348) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 28 07:57:54.827322 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=80348) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 07:57:54.828439 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=80347) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 28 07:57:54.828720 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=80347) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 07:57:54.831504 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=80348) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 28 07:57:54.831792 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=80348) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 07:57:54.832077 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=80348) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 07:57:54.832352 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=80348) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 07:57:54.832620 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=80348) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 07:57:54.832920 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=80348) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 07:57:54.833385 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=80347) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 28 07:57:54.833535 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=80348) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 07:57:54.833677 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=80347) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 07:57:54.833799 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=80348) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 07:57:54.833935 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=80347) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 07:57:54.834177 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=80347) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 07:57:54.834395 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=80347) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 07:57:54.834664 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=80347) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 07:57:54.834941 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=80347) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 07:57:54.835224 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=80347) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 07:57:54.849676 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=80348) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 07:57:54.849676 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=80348) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 07:57:54.851330 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=80347) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 07:57:54.851603 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=80347) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 07:57:54.853857 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=80348) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 28 07:57:54.855599 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=80347) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 28 07:57:54.857015 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=80348) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 07:57:54.857279 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=80348) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 07:57:54.859362 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=80347) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 07:57:54.859642 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=80347) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 07:57:54.861791 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=80348) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 28 07:57:54.864133 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=80347) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 28 07:57:54.864958 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=80348) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 28 07:57:54.867344 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=80347) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 28 07:57:54.868088 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=80348) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 07:57:54.868383 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=80348) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 07:57:54.868694 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=80348) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 07:57:54.868989 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=80348) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 07:57:54.869272 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=80348) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 07:57:54.869548 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=80348) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 07:57:54.870538 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=80347) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 07:57:54.870839 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=80347) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 07:57:54.871121 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=80347) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 07:57:54.871420 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=80347) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 07:57:54.871692 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=80347) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 07:57:54.871980 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=80347) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 07:57:54.885510 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=80348) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 28 07:57:54.885791 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=80348) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 07:57:54.886056 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=80348) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 07:57:54.886308 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=80348) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 07:57:54.888067 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=80347) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 28 07:57:54.888351 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=80347) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 07:57:54.888626 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=80347) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 07:57:54.888905 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=80347) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 07:57:54.893263 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=80348) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 07:57:54.894810 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=80348) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 07:57:54.895082 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=80348) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 07:57:54.895839 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=80347) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 07:57:54.897404 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=80347) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 07:57:54.897678 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=80347) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 07:57:54.897894 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=80348) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 28 07:57:54.898165 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=80348) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 07:57:54.898457 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=80348) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 07:57:54.898743 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=80348) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 07:57:54.899025 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=80348) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 07:57:54.900491 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=80347) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 28 07:57:54.900800 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=80347) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 07:57:54.901101 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=80347) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 07:57:54.901381 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=80347) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 07:57:54.901676 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=80347) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 07:57:54.910407 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=80348) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 28 07:57:54.910685 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=80348) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 07:57:54.910957 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=80348) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 07:57:54.911228 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=80348) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 07:57:54.911501 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=80348) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 07:57:54.911772 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=80348) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 07:57:54.912040 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=80348) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 07:57:54.913147 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=80347) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 28 07:57:54.913442 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=80347) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 07:57:54.913727 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=80347) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 07:57:54.913991 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=80347) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 07:57:54.914271 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=80347) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 07:57:54.914547 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=80347) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 07:57:54.914819 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=80347) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 07:57:54.927469 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=80348) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 28 07:57:54.930410 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=80347) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 28 07:57:54.930559 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=80348) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 28 07:57:54.933349 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=80348) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 07:57:54.933477 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=80347) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 28 07:57:54.935947 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=80348) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 07:57:54.936351 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=80347) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 07:57:54.937468 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=80348) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 28 07:57:54.937749 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=80348) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 07:57:54.938018 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=80348) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 07:57:54.939059 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=80347) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 07:57:54.940611 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=80347) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 28 07:57:54.940925 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=80347) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 07:57:54.941206 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=80347) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 07:57:54.944479 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=80348) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 07:57:54.946151 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=80348) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 28 07:57:54.947667 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=80347) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 07:57:54.949002 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=80348) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 07:57:54.949285 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=80348) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 07:57:54.949411 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=80347) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 28 07:57:54.949611 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=80348) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 07:57:54.949792 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=80348) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 07:57:54.952206 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=80347) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 07:57:54.952495 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=80347) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 07:57:54.952805 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=80347) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 07:57:54.953056 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=80347) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 07:57:54.957847 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=80348) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 28 07:57:54.958500 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=80348) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 07:57:54.958777 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=80348) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 07:57:54.961550 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=80347) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 28 07:57:54.961840 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=80347) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 07:57:54.962120 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=80347) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 07:57:54.965587 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=80348) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 28 07:57:54.965864 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=80348) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 07:57:54.966138 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=80348) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 07:57:54.966419 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=80348) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 07:57:54.966700 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=80348) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 07:57:54.966970 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=80348) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 07:57:54.967231 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=80348) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 07:57:54.967496 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=80348) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 07:57:54.967867 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=80348) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 07:57:54.968144 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=80348) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 07:57:54.968417 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=80348) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 07:57:54.971136 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=80348) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 07:57:54.971136 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=80348) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 07:57:54.971322 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=80347) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 28 07:57:54.971407 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=80348) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 07:57:54.971470 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=80347) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 07:57:54.971470 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=80347) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 07:57:54.971470 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=80347) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 07:57:54.971470 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=80347) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 07:57:54.971470 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=80347) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 07:57:54.971470 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=80347) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 07:57:54.971470 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=80347) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 07:57:54.972017 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=80347) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 07:57:54.972017 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=80347) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 07:57:54.972017 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=80347) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 07:57:54.972017 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=80347) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 07:57:54.972353 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=80347) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 07:57:54.972496 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=80347) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 07:57:55.002314 dv-cinder-851351-1-smb devstack@keystone.service[80348]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x562d65c639c0 pid: 80348 (default app) Jul 28 07:57:55.005770 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab951913-c5c4-4b2d-b59c-7210829bcb43 None None] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 07:57:55.006054 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab951913-c5c4-4b2d-b59c-7210829bcb43 None None] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 07:57:55.006324 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab951913-c5c4-4b2d-b59c-7210829bcb43 None None] PATH_INFO: `/v3` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 07:57:55.007897 dv-cinder-851351-1-smb devstack@keystone.service[80347]: WSGI app 0 (mountpoint='') ready in 7 seconds on interpreter 0x562d65c639c0 pid: 80347 (default app) Jul 28 07:57:55.010655 dv-cinder-851351-1-smb devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 1/1] 10.222.0.42 () {50 vars in 791 bytes} [Thu Jul 28 07:57:55 2022] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 07:58:02.573915 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f760a9c0-a262-4a11-9ffe-a23ebd492e28 None None] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 07:58:02.574475 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f760a9c0-a262-4a11-9ffe-a23ebd492e28 None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 07:58:02.574475 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f760a9c0-a262-4a11-9ffe-a23ebd492e28 None None] PATH_INFO: `/` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 07:58:02.578914 dv-cinder-851351-1-smb devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 1/2] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 07:58:02 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 28 07:58:02.584640 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22757284-9f94-482e-aa52-84d019003ad7 None None] REQUEST_METHOD: `POST` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 07:58:02.585103 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22757284-9f94-482e-aa52-84d019003ad7 None None] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 07:58:02.585194 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22757284-9f94-482e-aa52-84d019003ad7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 07:58:02.654861 dv-cinder-851351-1-smb devstack@keystone.service[80348]: INFO dbcounter [None req-22757284-9f94-482e-aa52-84d019003ad7 None None] Registered counter for database keystone Jul 28 07:58:02.676132 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG oslo_db.sqlalchemy.engines [None req-22757284-9f94-482e-aa52-84d019003ad7 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80348) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 28 07:58:02.683613 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writer thread running {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 28 07:58:02.863630 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG passlib.handlers.bcrypt [None req-22757284-9f94-482e-aa52-84d019003ad7 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=80348) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Jul 28 07:58:02.863949 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG passlib.handlers.bcrypt [None req-22757284-9f94-482e-aa52-84d019003ad7 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=80348) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Jul 28 07:58:02.917569 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.auth.core [None req-22757284-9f94-482e-aa52-84d019003ad7 None None] MFA Rules not processed for user `f0666d3a50644a7097367331c1ee1a68`. Rule list: `[]` (Enabled: `True`). {{(pid=80348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 07:58:02.919182 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.fernet_utils [None req-22757284-9f94-482e-aa52-84d019003ad7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 07:58:03.045315 dv-cinder-851351-1-smb devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 2/3] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 07:58:02 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 462 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jul 28 07:58:03.179308 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f760a9c0-a262-4a11-9ffe-a23ebd492e28 None None] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 07:58:03.249034 dv-cinder-851351-1-smb devstack@keystone.service[80347]: INFO dbcounter [None req-f760a9c0-a262-4a11-9ffe-a23ebd492e28 None None] Registered counter for database keystone Jul 28 07:58:03.268421 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG oslo_db.sqlalchemy.engines [None req-f760a9c0-a262-4a11-9ffe-a23ebd492e28 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80347) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 28 07:58:03.275137 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writer thread running {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 28 07:58:03.397754 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f760a9c0-a262-4a11-9ffe-a23ebd492e28 None None] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 07:58:03.402346 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae30b3a-e044-4876-b716-20fb045fd2d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd51c90075a0545959e2ede68845ae91b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 07:58:03.403015 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae30b3a-e044-4876-b716-20fb045fd2d1 admin admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 07:58:03.403293 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae30b3a-e044-4876-b716-20fb045fd2d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 07:58:03.403571 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae30b3a-e044-4876-b716-20fb045fd2d1 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 07:58:03.412407 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ae30b3a-e044-4876-b716-20fb045fd2d1 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 07:58:03.464643 dv-cinder-851351-1-smb devstack@keystone.service[80347]: WARNING keystone.common.rbac_enforcer.enforcer [None req-3ae30b3a-e044-4876-b716-20fb045fd2d1 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Jul 28 07:58:03.464960 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ae30b3a-e044-4876-b716-20fb045fd2d1 admin admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 07:58:03.475556 dv-cinder-851351-1-smb devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 2/4] 10.222.0.42 () {58 vars in 1324 bytes} [Thu Jul 28 07:58:03 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 297 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 28 07:58:03.482400 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22757284-9f94-482e-aa52-84d019003ad7 None None] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 07:58:03.498616 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22757284-9f94-482e-aa52-84d019003ad7 None None] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 07:58:03.504923 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e501f7-4fa3-4b1c-a4ea-718e7bc2cea4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd51c90075a0545959e2ede68845ae91b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 07:58:03.506140 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e501f7-4fa3-4b1c-a4ea-718e7bc2cea4 admin admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 07:58:03.506434 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e501f7-4fa3-4b1c-a4ea-718e7bc2cea4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 07:58:03.506743 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e501f7-4fa3-4b1c-a4ea-718e7bc2cea4 admin admin] PATH_INFO: `/v3/projects/d51c90075a0545959e2ede68845ae91b` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 07:58:03.508500 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e501f7-4fa3-4b1c-a4ea-718e7bc2cea4 admin admin] RBAC: Authorizing `identity:get_project(project_id=d51c90075a0545959e2ede68845ae91b)` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 07:58:03.562395 dv-cinder-851351-1-smb devstack@keystone.service[80348]: WARNING keystone.common.rbac_enforcer.enforcer [None req-55e501f7-4fa3-4b1c-a4ea-718e7bc2cea4 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Jul 28 07:58:03.562720 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e501f7-4fa3-4b1c-a4ea-718e7bc2cea4 admin admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 07:58:03.567714 dv-cinder-851351-1-smb devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 3/5] 10.222.0.42 () {56 vars in 1207 bytes} [Thu Jul 28 07:58:03 2022] GET /identity/v3/projects/d51c90075a0545959e2ede68845ae91b => generated 344 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 07:58:05.506717 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e3f821-0fc4-4871-bf7e-215462ec96e3 None None] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 07:58:05.507245 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e3f821-0fc4-4871-bf7e-215462ec96e3 None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 07:58:05.507245 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e3f821-0fc4-4871-bf7e-215462ec96e3 None None] PATH_INFO: `/` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 07:58:05.511347 dv-cinder-851351-1-smb devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 3/6] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 07:58:05 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 07:58:05.516991 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b62cd9-fc21-4d8d-be50-3316da1810c1 None None] REQUEST_METHOD: `POST` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 07:58:05.517436 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b62cd9-fc21-4d8d-be50-3316da1810c1 None None] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 07:58:05.517539 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b62cd9-fc21-4d8d-be50-3316da1810c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 07:58:05.538635 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.auth.core [None req-91b62cd9-fc21-4d8d-be50-3316da1810c1 None None] MFA Rules not processed for user `f0666d3a50644a7097367331c1ee1a68`. Rule list: `[]` (Enabled: `True`). {{(pid=80348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 07:58:05.540176 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.fernet_utils [None req-91b62cd9-fc21-4d8d-be50-3316da1810c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 07:58:05.549426 dv-cinder-851351-1-smb devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 4/7] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 07:58:05 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jul 28 07:58:05.571174 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e3f821-0fc4-4871-bf7e-215462ec96e3 None None] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 07:58:05.586032 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e3f821-0fc4-4871-bf7e-215462ec96e3 None None] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 07:58:05.591059 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94bdedab-731d-44f2-b0e9-3d3f5d662228 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd51c90075a0545959e2ede68845ae91b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 07:58:05.591692 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94bdedab-731d-44f2-b0e9-3d3f5d662228 admin admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 07:58:05.591978 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94bdedab-731d-44f2-b0e9-3d3f5d662228 admin admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 07:58:05.592253 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94bdedab-731d-44f2-b0e9-3d3f5d662228 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 07:58:05.600478 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94bdedab-731d-44f2-b0e9-3d3f5d662228 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 07:58:05.602314 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94bdedab-731d-44f2-b0e9-3d3f5d662228 admin admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 07:58:05.611492 dv-cinder-851351-1-smb devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 4/8] 10.222.0.42 () {58 vars in 1324 bytes} [Thu Jul 28 07:58:05 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 28 07:58:05.617424 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b62cd9-fc21-4d8d-be50-3316da1810c1 None None] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 07:58:05.627043 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b62cd9-fc21-4d8d-be50-3316da1810c1 None None] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 07:58:05.631834 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb1a72b5-443d-431f-8c04-03269a062a00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd51c90075a0545959e2ede68845ae91b', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 07:58:05.632483 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1a72b5-443d-431f-8c04-03269a062a00 admin admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 07:58:05.632798 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1a72b5-443d-431f-8c04-03269a062a00 admin admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 07:58:05.633077 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1a72b5-443d-431f-8c04-03269a062a00 admin admin] PATH_INFO: `/v3/users/f0666d3a50644a7097367331c1ee1a68` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 07:58:05.634553 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb1a72b5-443d-431f-8c04-03269a062a00 admin admin] RBAC: Authorizing `identity:get_user(user_id=f0666d3a50644a7097367331c1ee1a68)` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 07:58:05.636432 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb1a72b5-443d-431f-8c04-03269a062a00 admin admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 07:58:05.638053 dv-cinder-851351-1-smb devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 5/9] 10.222.0.42 () {56 vars in 1198 bytes} [Thu Jul 28 07:58:05 2022] GET /identity/v3/users/f0666d3a50644a7097367331c1ee1a68 => generated 247 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 07:58:07.651002 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb534d4b-0cb5-43f6-81b1-413958c6a7fa None None] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 07:58:07.651583 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb534d4b-0cb5-43f6-81b1-413958c6a7fa None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 07:58:07.651583 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb534d4b-0cb5-43f6-81b1-413958c6a7fa None None] PATH_INFO: `/` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 07:58:07.652936 dv-cinder-851351-1-smb devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 5/10] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 07:58:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 07:58:07.658717 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6584d85f-0975-40ed-a43b-2ca1770ba5b8 None None] REQUEST_METHOD: `POST` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 07:58:07.659190 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6584d85f-0975-40ed-a43b-2ca1770ba5b8 None None] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 07:58:07.659281 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6584d85f-0975-40ed-a43b-2ca1770ba5b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 07:58:07.680110 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.auth.core [None req-6584d85f-0975-40ed-a43b-2ca1770ba5b8 None None] MFA Rules not processed for user `f0666d3a50644a7097367331c1ee1a68`. Rule list: `[]` (Enabled: `True`). {{(pid=80348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 07:58:07.681365 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.fernet_utils [None req-6584d85f-0975-40ed-a43b-2ca1770ba5b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 07:58:07.712251 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542892d6-0a4f-4af7-aa1d-8063941181d1 None None] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 07:58:07.712494 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542892d6-0a4f-4af7-aa1d-8063941181d1 None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 07:58:07.712819 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542892d6-0a4f-4af7-aa1d-8063941181d1 None None] PATH_INFO: `/` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 07:58:07.714220 dv-cinder-851351-1-smb devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 6/11] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 07:58:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 07:58:07.720046 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b831d3-9dc6-4371-a4cf-836226d2e480 None None] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 07:58:07.720304 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b831d3-9dc6-4371-a4cf-836226d2e480 None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 07:58:07.720571 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b831d3-9dc6-4371-a4cf-836226d2e480 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 07:58:07.763637 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG passlib.handlers.bcrypt [None req-17b831d3-9dc6-4371-a4cf-836226d2e480 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=80347) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Jul 28 07:58:07.764030 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG passlib.handlers.bcrypt [None req-17b831d3-9dc6-4371-a4cf-836226d2e480 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=80347) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Jul 28 07:58:07.766588 dv-cinder-851351-1-smb devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 6/12] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 07:58:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 07:58:07.789769 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6584d85f-0975-40ed-a43b-2ca1770ba5b8 None None] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 07:58:07.809600 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.auth.core [None req-17b831d3-9dc6-4371-a4cf-836226d2e480 None None] MFA Rules not processed for user `f0666d3a50644a7097367331c1ee1a68`. Rule list: `[]` (Enabled: `True`). {{(pid=80347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 07:58:07.811264 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-17b831d3-9dc6-4371-a4cf-836226d2e480 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 07:58:07.818686 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=100 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 07:58:07.914742 dv-cinder-851351-1-smb devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 7/13] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 07:58:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 07:58:07.916227 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6584d85f-0975-40ed-a43b-2ca1770ba5b8 None None] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 07:58:07.936006 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b831d3-9dc6-4371-a4cf-836226d2e480 None None] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 07:58:07.951166 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf00fbf-2a26-4aad-b4c5-7f4a5da24fe8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 07:58:07.951824 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf00fbf-2a26-4aad-b4c5-7f4a5da24fe8 None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 07:58:07.952107 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf00fbf-2a26-4aad-b4c5-7f4a5da24fe8 None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 07:58:07.952384 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf00fbf-2a26-4aad-b4c5-7f4a5da24fe8 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 07:58:07.964736 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbf00fbf-2a26-4aad-b4c5-7f4a5da24fe8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 07:58:07.973652 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application [None req-fbf00fbf-2a26-4aad-b4c5-7f4a5da24fe8 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 07:58:07.973652 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 07:58:07.973652 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 07:58:07.973652 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 07:58:07.973652 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 07:58:07.973652 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 07:58:07.973652 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 07:58:07.973652 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 07:58:07.973652 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 07:58:07.973652 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 07:58:07.973652 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 07:58:07.973652 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 07:58:07.973652 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 07:58:07.973652 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 07:58:07.973652 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 07:58:07.973652 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 07:58:07.974758 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 07:58:07.974758 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 07:58:07.974758 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 07:58:07.974758 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 07:58:07.974758 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 07:58:07.974758 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 07:58:07.974758 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 07:58:07.974758 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 07:58:07.974758 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 07:58:07.974758 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 07:58:07.974758 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 07:58:07.974758 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application with Lock( Jul 28 07:58:07.974758 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 07:58:07.974758 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self._enter() Jul 28 07:58:07.974758 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 07:58:07.974758 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 07:58:07.975792 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 07:58:07.975792 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.creator() Jul 28 07:58:07.975792 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 07:58:07.975792 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application created_value = creator( Jul 28 07:58:07.975792 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 07:58:07.975792 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 07:58:07.975792 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 07:58:07.975792 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 07:58:07.975792 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 07:58:07.975792 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 07:58:07.975792 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 07:58:07.975792 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application Jul 28 07:58:07.975792 dv-cinder-851351-1-smb devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 7/14] 10.222.0.42 () {56 vars in 1096 bytes} [Thu Jul 28 07:58:07 2022] GET /identity/v3/roles/admin => generated 83 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 07:58:07.982818 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf00fbf-2a26-4aad-b4c5-7f4a5da24fe8 None admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 07:58:08.039098 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b831d3-9dc6-4371-a4cf-836226d2e480 None None] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 07:58:08.041407 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 07:58:08.066966 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=100 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 07:58:08.077290 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-153e95c8-1a22-4f87-baec-0af57b1c4262 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 07:58:08.078206 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153e95c8-1a22-4f87-baec-0af57b1c4262 None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 07:58:08.078523 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153e95c8-1a22-4f87-baec-0af57b1c4262 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 07:58:08.078824 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153e95c8-1a22-4f87-baec-0af57b1c4262 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 07:58:08.086176 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf00fbf-2a26-4aad-b4c5-7f4a5da24fe8 None admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 07:58:08.122876 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d7c9c2-3e76-447c-b56a-4314ef1c7a13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 07:58:08.123510 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d7c9c2-3e76-447c-b56a-4314ef1c7a13 None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 07:58:08.123788 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d7c9c2-3e76-447c-b56a-4314ef1c7a13 None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 07:58:08.124060 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d7c9c2-3e76-447c-b56a-4314ef1c7a13 None admin] PATH_INFO: `/v3/roles` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 07:58:08.124835 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3d7c9c2-3e76-447c-b56a-4314ef1c7a13 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80348) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 07:58:08.125141 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3d7c9c2-3e76-447c-b56a-4314ef1c7a13 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 07:58:08.126689 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3d7c9c2-3e76-447c-b56a-4314ef1c7a13 None admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 07:58:08.138892 dv-cinder-851351-1-smb devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 8/15] 10.222.0.42 () {56 vars in 1099 bytes} [Thu Jul 28 07:58:07 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 07:58:08.149048 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d7c9c2-3e76-447c-b56a-4314ef1c7a13 None admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 07:58:08.150417 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-153e95c8-1a22-4f87-baec-0af57b1c4262 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 07:58:08.151948 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-153e95c8-1a22-4f87-baec-0af57b1c4262 None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 07:58:08.252347 dv-cinder-851351-1-smb devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 8/16] 10.222.0.42 () {58 vars in 1282 bytes} [Thu Jul 28 07:58:07 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 28 07:58:08.258066 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-153e95c8-1a22-4f87-baec-0af57b1c4262 None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 07:58:08.259308 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d7c9c2-3e76-447c-b56a-4314ef1c7a13 None admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 07:58:08.260919 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 07:58:08.371546 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-153e95c8-1a22-4f87-baec-0af57b1c4262 None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 07:58:08.409295 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-817d3632-feed-4c49-904b-e92b258c8f32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 07:58:08.409936 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817d3632-feed-4c49-904b-e92b258c8f32 None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 07:58:08.410234 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817d3632-feed-4c49-904b-e92b258c8f32 None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 07:58:08.410506 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817d3632-feed-4c49-904b-e92b258c8f32 None admin] PATH_INFO: `/v3/users/f0666d3a50644a7097367331c1ee1a68` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 07:58:08.410741 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37018910-575b-4a7a-b1b8-38ccb3796ea5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 07:58:08.411621 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37018910-575b-4a7a-b1b8-38ccb3796ea5 None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 07:58:08.411771 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-817d3632-feed-4c49-904b-e92b258c8f32 None admin] RBAC: Authorizing `identity:get_user(user_id=f0666d3a50644a7097367331c1ee1a68)` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 07:58:08.411897 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37018910-575b-4a7a-b1b8-38ccb3796ea5 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 07:58:08.412158 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37018910-575b-4a7a-b1b8-38ccb3796ea5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 07:58:08.413316 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-817d3632-feed-4c49-904b-e92b258c8f32 None admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 07:58:08.415179 dv-cinder-851351-1-smb devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 9/17] 10.222.0.42 () {56 vars in 1177 bytes} [Thu Jul 28 07:58:08 2022] GET /identity/v3/users/f0666d3a50644a7097367331c1ee1a68 => generated 247 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 07:58:08.420789 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-817d3632-feed-4c49-904b-e92b258c8f32 None admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 07:58:08.432034 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37018910-575b-4a7a-b1b8-38ccb3796ea5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 07:58:08.433527 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37018910-575b-4a7a-b1b8-38ccb3796ea5 None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 07:58:08.436322 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=100 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 07:58:08.452634 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application [None req-37018910-575b-4a7a-b1b8-38ccb3796ea5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 07:58:08.452634 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 07:58:08.452634 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 07:58:08.452634 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 07:58:08.452634 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 07:58:08.452634 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 07:58:08.452634 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 07:58:08.452634 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 07:58:08.452634 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 07:58:08.452634 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 07:58:08.452634 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 07:58:08.452634 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 07:58:08.452634 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 07:58:08.452634 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 07:58:08.452634 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 07:58:08.453571 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 07:58:08.453571 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 07:58:08.453571 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 07:58:08.453571 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 07:58:08.453571 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 07:58:08.453571 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 07:58:08.453571 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 07:58:08.453571 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 07:58:08.453571 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application with Lock( Jul 28 07:58:08.453571 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 07:58:08.453571 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._enter() Jul 28 07:58:08.453571 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 07:58:08.453571 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 07:58:08.453571 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 07:58:08.453571 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.creator() Jul 28 07:58:08.453571 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 07:58:08.453571 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application created_value = creator( Jul 28 07:58:08.454567 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 07:58:08.454567 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 07:58:08.454567 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 07:58:08.454567 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application Jul 28 07:58:08.454567 dv-cinder-851351-1-smb devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 9/18] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 07:58:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 07:58:08.460171 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37018910-575b-4a7a-b1b8-38ccb3796ea5 None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 07:58:08.519146 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 07:58:08.526010 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-817d3632-feed-4c49-904b-e92b258c8f32 None admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 07:58:08.561067 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7389cf-df92-4d48-bb97-ff4cbb6a2bb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 07:58:08.561726 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7389cf-df92-4d48-bb97-ff4cbb6a2bb2 None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 07:58:08.562006 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7389cf-df92-4d48-bb97-ff4cbb6a2bb2 None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 07:58:08.562277 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7389cf-df92-4d48-bb97-ff4cbb6a2bb2 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 07:58:08.562583 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37018910-575b-4a7a-b1b8-38ccb3796ea5 None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 07:58:08.563491 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef7389cf-df92-4d48-bb97-ff4cbb6a2bb2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 07:58:08.564993 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef7389cf-df92-4d48-bb97-ff4cbb6a2bb2 None admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 07:58:08.566621 dv-cinder-851351-1-smb devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 10/19] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 07:58:08 2022] GET /identity/v3/domains/default => generated 199 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 07:58:08.572744 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7389cf-df92-4d48-bb97-ff4cbb6a2bb2 None admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 07:58:08.597863 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012a229b-5a19-41d6-bbc0-886c3e44dabb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 07:58:08.598492 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012a229b-5a19-41d6-bbc0-886c3e44dabb None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 07:58:08.598772 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012a229b-5a19-41d6-bbc0-886c3e44dabb None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 07:58:08.599047 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012a229b-5a19-41d6-bbc0-886c3e44dabb None admin] PATH_INFO: `/v3/domains` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 07:58:08.599743 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-012a229b-5a19-41d6-bbc0-886c3e44dabb None admin] RBAC: Adding query filter params (name=Default) {{(pid=80347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 07:58:08.600041 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-012a229b-5a19-41d6-bbc0-886c3e44dabb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 07:58:08.601486 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-012a229b-5a19-41d6-bbc0-886c3e44dabb None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 07:58:08.619456 dv-cinder-851351-1-smb devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 10/20] 10.222.0.42 () {56 vars in 1109 bytes} [Thu Jul 28 07:58:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 07:58:08.657521 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=100 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 07:58:08.680278 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7389cf-df92-4d48-bb97-ff4cbb6a2bb2 None admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 07:58:08.719173 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468586b2-0c3b-42e2-b2da-14cb64e0a7ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 07:58:08.719816 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468586b2-0c3b-42e2-b2da-14cb64e0a7ef None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 07:58:08.720093 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468586b2-0c3b-42e2-b2da-14cb64e0a7ef None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 07:58:08.720363 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468586b2-0c3b-42e2-b2da-14cb64e0a7ef None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 07:58:08.721203 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-468586b2-0c3b-42e2-b2da-14cb64e0a7ef None admin] RBAC: Adding query filter params (role.id=362bd71ac01249fb8fa635381993eec1, scope.domain.id=default, user.id=f0666d3a50644a7097367331c1ee1a68) {{(pid=80348) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 07:58:08.721525 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-468586b2-0c3b-42e2-b2da-14cb64e0a7ef None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 07:58:08.723001 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-468586b2-0c3b-42e2-b2da-14cb64e0a7ef None admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 07:58:08.731057 dv-cinder-851351-1-smb devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 11/21] 10.222.0.42 () {56 vars in 1322 bytes} [Thu Jul 28 07:58:08 2022] GET /identity/v3/role_assignments?user.id=f0666d3a50644a7097367331c1ee1a68&scope.domain.id=default&role.id=362bd71ac01249fb8fa635381993eec1 => generated 233 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 07:58:10.817725 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a0e3e6-50fa-4fd9-91ac-95553e4ee973 None None] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 07:58:10.818759 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a0e3e6-50fa-4fd9-91ac-95553e4ee973 None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 07:58:10.819234 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a0e3e6-50fa-4fd9-91ac-95553e4ee973 None None] PATH_INFO: `/` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 07:58:10.820933 dv-cinder-851351-1-smb devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 11/22] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 07:58:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 07:58:10.826617 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485be660-7d40-4cf8-a42f-183d6e4ad170 None None] REQUEST_METHOD: `POST` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 07:58:10.827463 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485be660-7d40-4cf8-a42f-183d6e4ad170 None None] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 07:58:10.827951 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485be660-7d40-4cf8-a42f-183d6e4ad170 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 07:58:10.847656 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.auth.core [None req-485be660-7d40-4cf8-a42f-183d6e4ad170 None None] MFA Rules not processed for user `f0666d3a50644a7097367331c1ee1a68`. Rule list: `[]` (Enabled: `True`). {{(pid=80348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 07:58:10.849246 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.fernet_utils [None req-485be660-7d40-4cf8-a42f-183d6e4ad170 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 07:58:10.920786 dv-cinder-851351-1-smb devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 12/23] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 07:58:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 07:58:10.966210 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a0e3e6-50fa-4fd9-91ac-95553e4ee973 None None] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 07:58:11.091090 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a0e3e6-50fa-4fd9-91ac-95553e4ee973 None None] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 07:58:11.112421 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48184c56-92bb-4d0d-94ed-f5ea3d7d4357 None None] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 07:58:11.113080 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48184c56-92bb-4d0d-94ed-f5ea3d7d4357 None None] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 07:58:11.113549 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48184c56-92bb-4d0d-94ed-f5ea3d7d4357 None None] PATH_INFO: `/` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 07:58:11.115454 dv-cinder-851351-1-smb devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 13/24] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 07:58:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 07:58:11.120288 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e6ce15-c414-497e-b3da-e641249749d0 None None] REQUEST_METHOD: `POST` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 07:58:11.120578 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e6ce15-c414-497e-b3da-e641249749d0 None None] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 07:58:11.120892 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e6ce15-c414-497e-b3da-e641249749d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 07:58:11.126798 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 07:58:11.146495 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.auth.core [None req-93e6ce15-c414-497e-b3da-e641249749d0 None None] MFA Rules not processed for user `f0666d3a50644a7097367331c1ee1a68`. Rule list: `[]` (Enabled: `True`). {{(pid=80348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 07:58:11.148465 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.fernet_utils [None req-93e6ce15-c414-497e-b3da-e641249749d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 07:58:11.155113 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43af74f2-6e74-43ea-8210-7b369ee9bf51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 07:58:11.156137 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43af74f2-6e74-43ea-8210-7b369ee9bf51 None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 07:58:11.156710 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43af74f2-6e74-43ea-8210-7b369ee9bf51 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 07:58:11.157191 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43af74f2-6e74-43ea-8210-7b369ee9bf51 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 07:58:11.177262 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43af74f2-6e74-43ea-8210-7b369ee9bf51 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 07:58:11.178974 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43af74f2-6e74-43ea-8210-7b369ee9bf51 None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 07:58:11.208503 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application [None req-43af74f2-6e74-43ea-8210-7b369ee9bf51 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 07:58:11.208503 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 07:58:11.208503 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 07:58:11.208503 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 07:58:11.208503 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 07:58:11.208503 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 07:58:11.208503 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 07:58:11.208503 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 07:58:11.208503 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 07:58:11.208503 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 07:58:11.208503 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 07:58:11.208503 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 07:58:11.208503 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 07:58:11.208503 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 07:58:11.208503 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 07:58:11.209495 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 07:58:11.209495 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 07:58:11.209495 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 07:58:11.209495 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 07:58:11.209495 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 07:58:11.209495 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 07:58:11.209495 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 07:58:11.209495 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 07:58:11.209495 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application with Lock( Jul 28 07:58:11.209495 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 07:58:11.209495 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._enter() Jul 28 07:58:11.209495 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 07:58:11.209495 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 07:58:11.209495 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 07:58:11.209495 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.creator() Jul 28 07:58:11.209495 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 07:58:11.209495 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application created_value = creator( Jul 28 07:58:11.210352 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 07:58:11.210352 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 07:58:11.210352 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 07:58:11.210352 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application Jul 28 07:58:11.212039 dv-cinder-851351-1-smb devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 12/25] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 07:58:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 246 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 07:58:11.218344 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43af74f2-6e74-43ea-8210-7b369ee9bf51 None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 07:58:11.323224 dv-cinder-851351-1-smb devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 14/26] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 07:58:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 28 07:58:11.397243 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e6ce15-c414-497e-b3da-e641249749d0 None None] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 07:58:11.407142 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=100 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 07:58:11.465601 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43af74f2-6e74-43ea-8210-7b369ee9bf51 None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 07:58:11.565831 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35914391-8d9d-427d-ba64-2e111e849b78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 07:58:11.566868 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35914391-8d9d-427d-ba64-2e111e849b78 None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 07:58:11.567348 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35914391-8d9d-427d-ba64-2e111e849b78 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 07:58:11.567828 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35914391-8d9d-427d-ba64-2e111e849b78 None admin] PATH_INFO: `/v3/domains` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 07:58:11.567980 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e6ce15-c414-497e-b3da-e641249749d0 None None] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 07:58:11.569124 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35914391-8d9d-427d-ba64-2e111e849b78 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 07:58:11.569661 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35914391-8d9d-427d-ba64-2e111e849b78 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 07:58:11.572204 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35914391-8d9d-427d-ba64-2e111e849b78 None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 07:58:11.604104 dv-cinder-851351-1-smb devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 13/27] 10.222.0.42 () {56 vars in 1109 bytes} [Thu Jul 28 07:58:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 386 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 07:58:11.605435 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3af1c0-3e4a-402d-8efd-b00dc07ca7f9 None None] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 07:58:11.605723 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3af1c0-3e4a-402d-8efd-b00dc07ca7f9 None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 07:58:11.605998 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3af1c0-3e4a-402d-8efd-b00dc07ca7f9 None None] PATH_INFO: `/` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 07:58:11.607208 dv-cinder-851351-1-smb devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 14/28] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 07:58:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 07:58:11.612292 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d109d1b-956d-4c7c-9606-fbeeaba19556 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 07:58:11.613059 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d109d1b-956d-4c7c-9606-fbeeaba19556 None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 07:58:11.613422 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d109d1b-956d-4c7c-9606-fbeeaba19556 None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 07:58:11.613704 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d109d1b-956d-4c7c-9606-fbeeaba19556 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 07:58:11.617747 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6395c8-c5d2-4946-8cdf-7fa7194c083d None None] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 07:58:11.618031 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6395c8-c5d2-4946-8cdf-7fa7194c083d None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 07:58:11.618303 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6395c8-c5d2-4946-8cdf-7fa7194c083d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 07:58:11.633964 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d109d1b-956d-4c7c-9606-fbeeaba19556 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 07:58:11.639793 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application [None req-7d109d1b-956d-4c7c-9606-fbeeaba19556 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 07:58:11.639793 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 07:58:11.639793 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 07:58:11.639793 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 07:58:11.639793 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 07:58:11.639793 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 07:58:11.639793 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 07:58:11.639793 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 07:58:11.639793 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 07:58:11.639793 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 07:58:11.639793 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 07:58:11.639793 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 07:58:11.639793 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 07:58:11.639793 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 07:58:11.639793 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 07:58:11.639793 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 07:58:11.641368 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 07:58:11.641368 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 07:58:11.641368 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 07:58:11.641368 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 07:58:11.641368 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 07:58:11.641368 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 07:58:11.641368 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 07:58:11.641368 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 07:58:11.641368 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 07:58:11.641368 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 07:58:11.641368 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 07:58:11.641368 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application with Lock( Jul 28 07:58:11.641368 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 07:58:11.641368 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self._enter() Jul 28 07:58:11.641368 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 07:58:11.641368 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 07:58:11.643678 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 07:58:11.643678 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.creator() Jul 28 07:58:11.643678 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 07:58:11.643678 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application created_value = creator( Jul 28 07:58:11.643678 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 07:58:11.643678 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 07:58:11.643678 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 07:58:11.643678 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 07:58:11.643678 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 07:58:11.643678 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 07:58:11.643678 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 07:58:11.643678 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application Jul 28 07:58:11.643678 dv-cinder-851351-1-smb devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 15/29] 10.222.0.42 () {56 vars in 1096 bytes} [Thu Jul 28 07:58:11 2022] GET /identity/v3/roles/admin => generated 83 bytes in 245 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 07:58:11.643678 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d109d1b-956d-4c7c-9606-fbeeaba19556 None admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 07:58:11.801935 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.auth.core [None req-fc6395c8-c5d2-4946-8cdf-7fa7194c083d None None] MFA Rules not processed for user `f0666d3a50644a7097367331c1ee1a68`. Rule list: `[]` (Enabled: `True`). {{(pid=80347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 07:58:11.809220 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-fc6395c8-c5d2-4946-8cdf-7fa7194c083d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 07:58:11.852512 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=100 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 07:58:11.854139 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 07:58:11.973312 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d109d1b-956d-4c7c-9606-fbeeaba19556 None admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 07:58:11.990842 dv-cinder-851351-1-smb devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 15/30] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 07:58:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 375 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 07:58:11.991483 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6395c8-c5d2-4946-8cdf-7fa7194c083d None None] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 07:58:12.050580 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64aaccec-534e-47f8-ab9f-8fc154bcb802 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 07:58:12.051222 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64aaccec-534e-47f8-ab9f-8fc154bcb802 None admin] REQUEST_METHOD: `POST` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 07:58:12.051505 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64aaccec-534e-47f8-ab9f-8fc154bcb802 None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 07:58:12.051783 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64aaccec-534e-47f8-ab9f-8fc154bcb802 None admin] PATH_INFO: `/v3/projects` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 07:58:12.052537 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64aaccec-534e-47f8-ab9f-8fc154bcb802 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 07:58:12.054007 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64aaccec-534e-47f8-ab9f-8fc154bcb802 None admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 07:58:12.147155 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6395c8-c5d2-4946-8cdf-7fa7194c083d None None] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 07:58:12.191824 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8ba52a-8ac4-4456-b27a-aa71015c138a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 07:58:12.192875 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8ba52a-8ac4-4456-b27a-aa71015c138a None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 07:58:12.193398 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8ba52a-8ac4-4456-b27a-aa71015c138a None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 07:58:12.193877 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8ba52a-8ac4-4456-b27a-aa71015c138a None admin] PATH_INFO: `/v3/roles` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 07:58:12.194837 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c8ba52a-8ac4-4456-b27a-aa71015c138a None admin] RBAC: Adding query filter params (name=admin) {{(pid=80347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 07:58:12.195326 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c8ba52a-8ac4-4456-b27a-aa71015c138a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 07:58:12.197063 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c8ba52a-8ac4-4456-b27a-aa71015c138a None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 07:58:12.213387 dv-cinder-851351-1-smb devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 16/31] 10.222.0.42 () {56 vars in 1099 bytes} [Thu Jul 28 07:58:11 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 07:58:12.214515 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8ba52a-8ac4-4456-b27a-aa71015c138a None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 07:58:12.225607 dv-cinder-851351-1-smb devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 16/32] 10.222.0.42 () {60 vars in 1141 bytes} [Thu Jul 28 07:58:11 2022] POST /identity/v3/projects => generated 301 bytes in 584 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 07:58:12.226924 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a0609c-445b-4cf4-8f34-72fea52d353f None None] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 07:58:12.227242 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a0609c-445b-4cf4-8f34-72fea52d353f None None] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 07:58:12.227983 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a0609c-445b-4cf4-8f34-72fea52d353f None None] PATH_INFO: `/` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 07:58:12.229438 dv-cinder-851351-1-smb devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 17/33] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 07:58:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 07:58:12.233752 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a0609c-445b-4cf4-8f34-72fea52d353f None None] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 07:58:12.246818 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 07:58:12.345475 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8ba52a-8ac4-4456-b27a-aa71015c138a None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 07:58:12.383872 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a0609c-445b-4cf4-8f34-72fea52d353f None None] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 07:58:12.389642 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9042757-882d-42b8-a42c-f31b6a882179 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 07:58:12.390280 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9042757-882d-42b8-a42c-f31b6a882179 None admin] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 07:58:12.390599 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9042757-882d-42b8-a42c-f31b6a882179 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 07:58:12.390961 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9042757-882d-42b8-a42c-f31b6a882179 None admin] PATH_INFO: `/v3/roles` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 07:58:12.391686 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9042757-882d-42b8-a42c-f31b6a882179 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 07:58:12.393108 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9042757-882d-42b8-a42c-f31b6a882179 None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 07:58:12.406794 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 07:58:12.432996 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ce69ce-0932-444a-a0dd-b7ac4967ab19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 07:58:12.434163 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ce69ce-0932-444a-a0dd-b7ac4967ab19 None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 07:58:12.434711 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ce69ce-0932-444a-a0dd-b7ac4967ab19 None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 07:58:12.435216 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ce69ce-0932-444a-a0dd-b7ac4967ab19 None admin] PATH_INFO: `/v3/users/f0666d3a50644a7097367331c1ee1a68` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 07:58:12.437058 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68ce69ce-0932-444a-a0dd-b7ac4967ab19 None admin] RBAC: Authorizing `identity:get_user(user_id=f0666d3a50644a7097367331c1ee1a68)` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 07:58:12.439948 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68ce69ce-0932-444a-a0dd-b7ac4967ab19 None admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 07:58:12.443100 dv-cinder-851351-1-smb devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 18/34] 10.222.0.42 () {56 vars in 1177 bytes} [Thu Jul 28 07:58:12 2022] GET /identity/v3/users/f0666d3a50644a7097367331c1ee1a68 => generated 247 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 07:58:12.444941 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0eaec60-0a42-43e5-8adc-d9290db808fc None None] REQUEST_METHOD: `POST` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 07:58:12.445532 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0eaec60-0a42-43e5-8adc-d9290db808fc None None] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 07:58:12.446020 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0eaec60-0a42-43e5-8adc-d9290db808fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 07:58:12.468088 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.auth.core [None req-b0eaec60-0a42-43e5-8adc-d9290db808fc None None] MFA Rules not processed for user `f0666d3a50644a7097367331c1ee1a68`. Rule list: `[]` (Enabled: `True`). {{(pid=80348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 07:58:12.470067 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.fernet_utils [None req-b0eaec60-0a42-43e5-8adc-d9290db808fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 07:58:12.545881 dv-cinder-851351-1-smb devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 19/35] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 07:58:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 07:58:12.547186 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0eaec60-0a42-43e5-8adc-d9290db808fc None None] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 07:58:12.605384 dv-cinder-851351-1-smb devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 17/36] 10.222.0.42 () {60 vars in 1131 bytes} [Thu Jul 28 07:58:12 2022] POST /identity/v3/roles => generated 219 bytes in 391 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 07:58:12.609403 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c0af53-08e1-474b-8098-add0fd612be9 None None] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 07:58:12.609403 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c0af53-08e1-474b-8098-add0fd612be9 None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 07:58:12.609403 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c0af53-08e1-474b-8098-add0fd612be9 None None] PATH_INFO: `/` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 07:58:12.609403 dv-cinder-851351-1-smb devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 18/37] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 07:58:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 07:58:12.609403 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c0af53-08e1-474b-8098-add0fd612be9 None None] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 07:58:12.698044 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0eaec60-0a42-43e5-8adc-d9290db808fc None None] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 07:58:12.729795 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=100 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 07:58:12.752541 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 07:58:12.764514 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd36a934-8fd0-4dc5-8bad-5eaf5b93afa3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 07:58:12.765252 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd36a934-8fd0-4dc5-8bad-5eaf5b93afa3 None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 07:58:12.765536 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd36a934-8fd0-4dc5-8bad-5eaf5b93afa3 None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 07:58:12.765815 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd36a934-8fd0-4dc5-8bad-5eaf5b93afa3 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 07:58:12.767427 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd36a934-8fd0-4dc5-8bad-5eaf5b93afa3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 07:58:12.768578 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd36a934-8fd0-4dc5-8bad-5eaf5b93afa3 None admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 07:58:12.770379 dv-cinder-851351-1-smb devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 20/38] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 07:58:12 2022] GET /identity/v3/domains/default => generated 199 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 07:58:12.775301 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b40d768-0728-458c-9950-72bd705b8c17 None None] REQUEST_METHOD: `POST` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 07:58:12.775700 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b40d768-0728-458c-9950-72bd705b8c17 None None] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 07:58:12.775867 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b40d768-0728-458c-9950-72bd705b8c17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 07:58:12.777614 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c0af53-08e1-474b-8098-add0fd612be9 None None] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 07:58:12.798731 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.auth.core [None req-5b40d768-0728-458c-9950-72bd705b8c17 None None] MFA Rules not processed for user `f0666d3a50644a7097367331c1ee1a68`. Rule list: `[]` (Enabled: `True`). {{(pid=80348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 07:58:12.800090 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.fernet_utils [None req-5b40d768-0728-458c-9950-72bd705b8c17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 07:58:12.825537 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d4fd6c-a43b-4257-9b5a-ad7de1fec143 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 07:58:12.826189 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d4fd6c-a43b-4257-9b5a-ad7de1fec143 None admin] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 07:58:12.826477 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d4fd6c-a43b-4257-9b5a-ad7de1fec143 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 07:58:12.826762 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d4fd6c-a43b-4257-9b5a-ad7de1fec143 None admin] PATH_INFO: `/v3/roles` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 07:58:12.827502 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8d4fd6c-a43b-4257-9b5a-ad7de1fec143 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 07:58:12.829270 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8d4fd6c-a43b-4257-9b5a-ad7de1fec143 None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 07:58:12.850204 dv-cinder-851351-1-smb devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 19/39] 10.222.0.42 () {60 vars in 1131 bytes} [Thu Jul 28 07:58:12 2022] POST /identity/v3/roles => generated 225 bytes in 241 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 07:58:12.851130 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d4fd6c-a43b-4257-9b5a-ad7de1fec143 None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 07:58:12.909318 dv-cinder-851351-1-smb devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 21/40] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 07:58:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 07:58:12.943258 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b40d768-0728-458c-9950-72bd705b8c17 None None] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 07:58:12.994813 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d4fd6c-a43b-4257-9b5a-ad7de1fec143 None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 07:58:13.035887 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-432b82df-74cb-446a-b821-65383971fa4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 07:58:13.036950 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432b82df-74cb-446a-b821-65383971fa4b None admin] REQUEST_METHOD: `PUT` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 07:58:13.037233 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432b82df-74cb-446a-b821-65383971fa4b None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 07:58:13.037513 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432b82df-74cb-446a-b821-65383971fa4b None admin] PATH_INFO: `/v3/domains/default/users/f0666d3a50644a7097367331c1ee1a68/roles/362bd71ac01249fb8fa635381993eec1` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 07:58:13.040252 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-432b82df-74cb-446a-b821-65383971fa4b None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=f0666d3a50644a7097367331c1ee1a68, role_id=362bd71ac01249fb8fa635381993eec1)` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 07:58:13.041866 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-432b82df-74cb-446a-b821-65383971fa4b None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 07:58:13.058576 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 07:58:13.069919 dv-cinder-851351-1-smb devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 20/41] 10.222.0.42 () {58 vars in 1361 bytes} [Thu Jul 28 07:58:12 2022] PUT /identity/v3/domains/default/users/f0666d3a50644a7097367331c1ee1a68/roles/362bd71ac01249fb8fa635381993eec1 => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 07:58:13.106702 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b40d768-0728-458c-9950-72bd705b8c17 None None] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 07:58:13.124606 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=100 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 07:58:13.129215 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa15c6fd-a721-454d-b344-e5e1fdc40b7a None None] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 07:58:13.129507 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa15c6fd-a721-454d-b344-e5e1fdc40b7a None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 07:58:13.129817 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa15c6fd-a721-454d-b344-e5e1fdc40b7a None None] PATH_INFO: `/` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 07:58:13.131412 dv-cinder-851351-1-smb devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 21/42] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 07:58:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 07:58:13.140541 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd91d289-fb31-48d3-9e40-96082835e947 None None] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 07:58:13.140541 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd91d289-fb31-48d3-9e40-96082835e947 None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 07:58:13.140541 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd91d289-fb31-48d3-9e40-96082835e947 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 07:58:13.170547 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa841d6-b445-46be-98b2-3f145f7c6420 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 07:58:13.171375 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa841d6-b445-46be-98b2-3f145f7c6420 None admin] REQUEST_METHOD: `POST` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 07:58:13.171692 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.auth.core [None req-cd91d289-fb31-48d3-9e40-96082835e947 None None] MFA Rules not processed for user `f0666d3a50644a7097367331c1ee1a68`. Rule list: `[]` (Enabled: `True`). {{(pid=80347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 07:58:13.171891 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa841d6-b445-46be-98b2-3f145f7c6420 None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 07:58:13.172269 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa841d6-b445-46be-98b2-3f145f7c6420 None admin] PATH_INFO: `/v3/roles` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 07:58:13.173168 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfa841d6-b445-46be-98b2-3f145f7c6420 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 07:58:13.175931 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-cd91d289-fb31-48d3-9e40-96082835e947 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 07:58:13.176096 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfa841d6-b445-46be-98b2-3f145f7c6420 None admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 07:58:13.203327 dv-cinder-851351-1-smb devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 22/43] 10.222.0.42 () {60 vars in 1131 bytes} [Thu Jul 28 07:58:12 2022] POST /identity/v3/roles => generated 223 bytes in 261 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 07:58:13.284945 dv-cinder-851351-1-smb devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 22/44] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 07:58:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 28 07:58:13.307946 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa841d6-b445-46be-98b2-3f145f7c6420 None admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 07:58:13.429999 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa841d6-b445-46be-98b2-3f145f7c6420 None admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 07:58:13.466097 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a682ee4-d168-48d0-b6c3-888f666e1244 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 07:58:13.466764 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a682ee4-d168-48d0-b6c3-888f666e1244 None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 07:58:13.467110 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a682ee4-d168-48d0-b6c3-888f666e1244 None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 07:58:13.467300 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a682ee4-d168-48d0-b6c3-888f666e1244 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 07:58:13.469332 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a682ee4-d168-48d0-b6c3-888f666e1244 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 07:58:13.470491 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a682ee4-d168-48d0-b6c3-888f666e1244 None admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 07:58:13.472349 dv-cinder-851351-1-smb devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 23/45] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 07:58:13 2022] GET /identity/v3/domains/default => generated 199 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 07:58:13.477996 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd91d289-fb31-48d3-9e40-96082835e947 None None] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 07:58:13.587254 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd91d289-fb31-48d3-9e40-96082835e947 None None] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 07:58:13.621036 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 07:58:13.627997 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6765cf13-78f2-4b76-9d12-24c305fdbbc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 07:58:13.629027 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6765cf13-78f2-4b76-9d12-24c305fdbbc0 None admin] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 07:58:13.629027 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6765cf13-78f2-4b76-9d12-24c305fdbbc0 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 07:58:13.629322 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6765cf13-78f2-4b76-9d12-24c305fdbbc0 None admin] PATH_INFO: `/v3/projects` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 07:58:13.630127 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6765cf13-78f2-4b76-9d12-24c305fdbbc0 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 07:58:13.631475 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6765cf13-78f2-4b76-9d12-24c305fdbbc0 None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 07:58:13.662714 dv-cinder-851351-1-smb devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 23/46] 10.222.0.42 () {60 vars in 1141 bytes} [Thu Jul 28 07:58:13 2022] POST /identity/v3/projects => generated 312 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 07:58:15.107156 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b164d468-728e-4b82-b27a-b02fa8c0b2d4 None None] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 07:58:15.107703 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b164d468-728e-4b82-b27a-b02fa8c0b2d4 None None] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 07:58:15.107703 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b164d468-728e-4b82-b27a-b02fa8c0b2d4 None None] PATH_INFO: `/` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 07:58:15.109110 dv-cinder-851351-1-smb devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 24/47] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 07:58:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 07:58:15.114842 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbbec60-14f0-4a8e-9c96-2073940d252e None None] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 07:58:15.115315 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbbec60-14f0-4a8e-9c96-2073940d252e None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 07:58:15.115397 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbbec60-14f0-4a8e-9c96-2073940d252e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 07:58:15.135849 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.auth.core [None req-9fbbec60-14f0-4a8e-9c96-2073940d252e None None] MFA Rules not processed for user `f0666d3a50644a7097367331c1ee1a68`. Rule list: `[]` (Enabled: `True`). {{(pid=80347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 07:58:15.137122 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-9fbbec60-14f0-4a8e-9c96-2073940d252e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 07:58:15.223173 dv-cinder-851351-1-smb devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 24/48] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 07:58:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 07:58:15.245455 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b164d468-728e-4b82-b27a-b02fa8c0b2d4 None None] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 07:58:15.293659 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 07:58:15.361346 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b164d468-728e-4b82-b27a-b02fa8c0b2d4 None None] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 07:58:15.398227 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6413c3e-c77f-47d4-bd8c-0ca5a6e01bcb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 07:58:15.398882 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6413c3e-c77f-47d4-bd8c-0ca5a6e01bcb None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 07:58:15.399162 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6413c3e-c77f-47d4-bd8c-0ca5a6e01bcb None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 07:58:15.399428 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6413c3e-c77f-47d4-bd8c-0ca5a6e01bcb None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 07:58:15.410521 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6413c3e-c77f-47d4-bd8c-0ca5a6e01bcb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 07:58:15.415473 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application [None req-f6413c3e-c77f-47d4-bd8c-0ca5a6e01bcb None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 07:58:15.415473 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 07:58:15.415473 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 07:58:15.415473 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 07:58:15.415473 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 07:58:15.415473 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 07:58:15.415473 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 07:58:15.415473 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 07:58:15.415473 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 07:58:15.415473 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 07:58:15.415473 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 07:58:15.415473 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 07:58:15.415473 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 07:58:15.415473 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 07:58:15.415473 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 07:58:15.415473 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 07:58:15.416317 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 07:58:15.416317 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 07:58:15.416317 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 07:58:15.416317 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 07:58:15.416317 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 07:58:15.416317 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 07:58:15.416317 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 07:58:15.416317 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 07:58:15.416317 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 07:58:15.416317 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 07:58:15.416317 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 07:58:15.416317 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application with Lock( Jul 28 07:58:15.416317 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 07:58:15.416317 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self._enter() Jul 28 07:58:15.416317 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 07:58:15.416317 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 07:58:15.417165 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 07:58:15.417165 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.creator() Jul 28 07:58:15.417165 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 07:58:15.417165 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application created_value = creator( Jul 28 07:58:15.417165 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 07:58:15.417165 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 07:58:15.417165 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 07:58:15.417165 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 07:58:15.417165 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 07:58:15.417165 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 07:58:15.417165 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 07:58:15.417165 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application Jul 28 07:58:15.417165 dv-cinder-851351-1-smb devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 25/49] 10.222.0.42 () {56 vars in 1096 bytes} [Thu Jul 28 07:58:15 2022] GET /identity/v3/roles/admin => generated 83 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 07:58:15.422781 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fbbec60-14f0-4a8e-9c96-2073940d252e None None] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 07:58:15.536637 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fbbec60-14f0-4a8e-9c96-2073940d252e None None] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 07:58:15.551975 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 07:58:15.573514 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981dd0f4-74b1-41ba-af14-62117b11c3fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 07:58:15.574145 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981dd0f4-74b1-41ba-af14-62117b11c3fd None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 07:58:15.574424 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981dd0f4-74b1-41ba-af14-62117b11c3fd None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 07:58:15.574697 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981dd0f4-74b1-41ba-af14-62117b11c3fd None admin] PATH_INFO: `/v3/roles` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 07:58:15.575430 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-981dd0f4-74b1-41ba-af14-62117b11c3fd None admin] RBAC: Adding query filter params (name=admin) {{(pid=80347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 07:58:15.575734 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-981dd0f4-74b1-41ba-af14-62117b11c3fd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 07:58:15.577157 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-981dd0f4-74b1-41ba-af14-62117b11c3fd None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 07:58:15.586561 dv-cinder-851351-1-smb devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 25/50] 10.222.0.42 () {56 vars in 1099 bytes} [Thu Jul 28 07:58:15 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 07:58:15.592253 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6413c3e-c77f-47d4-bd8c-0ca5a6e01bcb None admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 07:58:15.659036 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e0705b-c717-455c-a002-28dbc4b716e8 None None] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 07:58:15.659300 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e0705b-c717-455c-a002-28dbc4b716e8 None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 07:58:15.659429 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e0705b-c717-455c-a002-28dbc4b716e8 None None] PATH_INFO: `/` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 07:58:15.660880 dv-cinder-851351-1-smb devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 26/51] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 07:58:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 28 07:58:15.668676 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb70dc71-c193-4eef-92ae-e861546b42c0 None None] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 07:58:15.668969 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb70dc71-c193-4eef-92ae-e861546b42c0 None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 07:58:15.669243 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb70dc71-c193-4eef-92ae-e861546b42c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 07:58:15.687775 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.auth.core [None req-cb70dc71-c193-4eef-92ae-e861546b42c0 None None] MFA Rules not processed for user `f0666d3a50644a7097367331c1ee1a68`. Rule list: `[]` (Enabled: `True`). {{(pid=80347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 07:58:15.689030 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-cb70dc71-c193-4eef-92ae-e861546b42c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 07:58:15.701654 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=100 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 07:58:15.705233 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6413c3e-c77f-47d4-bd8c-0ca5a6e01bcb None admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 07:58:15.744691 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715fbe4f-f03e-4b84-bf8f-705b2f498bad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 07:58:15.745368 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715fbe4f-f03e-4b84-bf8f-705b2f498bad None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 07:58:15.745653 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715fbe4f-f03e-4b84-bf8f-705b2f498bad None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 07:58:15.745930 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715fbe4f-f03e-4b84-bf8f-705b2f498bad None admin] PATH_INFO: `/v3/users/f0666d3a50644a7097367331c1ee1a68` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 07:58:15.747148 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-715fbe4f-f03e-4b84-bf8f-705b2f498bad None admin] RBAC: Authorizing `identity:get_user(user_id=f0666d3a50644a7097367331c1ee1a68)` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 07:58:15.748642 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-715fbe4f-f03e-4b84-bf8f-705b2f498bad None admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 07:58:15.750346 dv-cinder-851351-1-smb devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 26/52] 10.222.0.42 () {56 vars in 1177 bytes} [Thu Jul 28 07:58:15 2022] GET /identity/v3/users/f0666d3a50644a7097367331c1ee1a68 => generated 247 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 07:58:15.755774 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715fbe4f-f03e-4b84-bf8f-705b2f498bad None admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 07:58:15.756891 dv-cinder-851351-1-smb devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 27/53] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 07:58:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 28 07:58:15.779517 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb70dc71-c193-4eef-92ae-e861546b42c0 None None] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 07:58:15.876621 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715fbe4f-f03e-4b84-bf8f-705b2f498bad None admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 07:58:15.900585 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb70dc71-c193-4eef-92ae-e861546b42c0 None None] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 07:58:15.904561 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 07:58:15.913252 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c5201c-03e1-4180-8a00-b95e10ca59e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 07:58:15.913838 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c5201c-03e1-4180-8a00-b95e10ca59e4 None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 07:58:15.914118 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c5201c-03e1-4180-8a00-b95e10ca59e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 07:58:15.914396 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c5201c-03e1-4180-8a00-b95e10ca59e4 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 07:58:15.915559 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18c5201c-03e1-4180-8a00-b95e10ca59e4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 07:58:15.917041 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18c5201c-03e1-4180-8a00-b95e10ca59e4 None admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 07:58:15.918642 dv-cinder-851351-1-smb devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 27/54] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 07:58:15 2022] GET /identity/v3/domains/default => generated 199 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 07:58:15.924546 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c5201c-03e1-4180-8a00-b95e10ca59e4 None admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 07:58:15.936979 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4f985c-c235-4fa3-a5d4-cb31974735d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 07:58:15.937770 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4f985c-c235-4fa3-a5d4-cb31974735d5 None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 07:58:15.938055 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4f985c-c235-4fa3-a5d4-cb31974735d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 07:58:15.938358 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4f985c-c235-4fa3-a5d4-cb31974735d5 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 07:58:15.939607 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a4f985c-c235-4fa3-a5d4-cb31974735d5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 07:58:15.941104 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a4f985c-c235-4fa3-a5d4-cb31974735d5 None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 07:58:15.943166 dv-cinder-851351-1-smb devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 28/55] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 07:58:15 2022] GET /identity/v3/domains/default => generated 199 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 07:58:15.949383 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4f985c-c235-4fa3-a5d4-cb31974735d5 None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 07:58:15.970380 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=100 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 07:58:16.040630 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c5201c-03e1-4180-8a00-b95e10ca59e4 None admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 07:58:16.076900 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb441412-c9df-4c9a-be61-05bf2f7ce6a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 07:58:16.077496 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4f985c-c235-4fa3-a5d4-cb31974735d5 None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 07:58:16.077596 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb441412-c9df-4c9a-be61-05bf2f7ce6a3 None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 07:58:16.077800 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb441412-c9df-4c9a-be61-05bf2f7ce6a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 07:58:16.078153 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb441412-c9df-4c9a-be61-05bf2f7ce6a3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 07:58:16.078965 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb441412-c9df-4c9a-be61-05bf2f7ce6a3 None admin] RBAC: Adding query filter params (role.id=362bd71ac01249fb8fa635381993eec1, scope.domain.id=default, user.id=f0666d3a50644a7097367331c1ee1a68) {{(pid=80348) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 07:58:16.079277 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb441412-c9df-4c9a-be61-05bf2f7ce6a3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 07:58:16.080771 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb441412-c9df-4c9a-be61-05bf2f7ce6a3 None admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 07:58:16.088341 dv-cinder-851351-1-smb devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 28/56] 10.222.0.42 () {56 vars in 1322 bytes} [Thu Jul 28 07:58:15 2022] GET /identity/v3/role_assignments?user.id=f0666d3a50644a7097367331c1ee1a68&scope.domain.id=default&role.id=362bd71ac01249fb8fa635381993eec1 => generated 530 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 07:58:16.117823 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd13ee5-aabe-4897-8713-0dd00918e07e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 07:58:16.118501 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd13ee5-aabe-4897-8713-0dd00918e07e None admin] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 07:58:16.118751 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd13ee5-aabe-4897-8713-0dd00918e07e None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 07:58:16.119021 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd13ee5-aabe-4897-8713-0dd00918e07e None admin] PATH_INFO: `/v3/projects` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 07:58:16.119726 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abd13ee5-aabe-4897-8713-0dd00918e07e None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 07:58:16.121273 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abd13ee5-aabe-4897-8713-0dd00918e07e None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 07:58:16.164795 dv-cinder-851351-1-smb devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 29/57] 10.222.0.42 () {60 vars in 1140 bytes} [Thu Jul 28 07:58:15 2022] POST /identity/v3/projects => generated 298 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 28 07:58:18.149229 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ccd360a-f1dc-4c6f-8bca-75b330dde0b8 None None] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 07:58:18.149778 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ccd360a-f1dc-4c6f-8bca-75b330dde0b8 None None] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 07:58:18.149778 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ccd360a-f1dc-4c6f-8bca-75b330dde0b8 None None] PATH_INFO: `/` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 07:58:18.151138 dv-cinder-851351-1-smb devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 29/58] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 07:58:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 07:58:18.157147 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9732473-e6bb-41a1-b032-f1352ca37142 None None] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 07:58:18.157621 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9732473-e6bb-41a1-b032-f1352ca37142 None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 07:58:18.157705 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9732473-e6bb-41a1-b032-f1352ca37142 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 07:58:18.184003 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.auth.core [None req-c9732473-e6bb-41a1-b032-f1352ca37142 None None] MFA Rules not processed for user `f0666d3a50644a7097367331c1ee1a68`. Rule list: `[]` (Enabled: `True`). {{(pid=80347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 07:58:18.185756 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-c9732473-e6bb-41a1-b032-f1352ca37142 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 07:58:18.204285 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 07:58:18.259548 dv-cinder-851351-1-smb devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 30/59] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 07:58:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 07:58:18.283307 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ccd360a-f1dc-4c6f-8bca-75b330dde0b8 None None] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 07:58:18.383698 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=100 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 07:58:18.389088 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ccd360a-f1dc-4c6f-8bca-75b330dde0b8 None None] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 07:58:18.424016 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba3d09e-f9ba-428d-8437-294c68718ced None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 07:58:18.424573 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba3d09e-f9ba-428d-8437-294c68718ced None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 07:58:18.424882 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba3d09e-f9ba-428d-8437-294c68718ced None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 07:58:18.425129 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba3d09e-f9ba-428d-8437-294c68718ced None admin] PATH_INFO: `/v3/domains/default` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 07:58:18.426352 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ba3d09e-f9ba-428d-8437-294c68718ced None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 07:58:18.427836 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ba3d09e-f9ba-428d-8437-294c68718ced None admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 07:58:18.429510 dv-cinder-851351-1-smb devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 30/60] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 07:58:18 2022] GET /identity/v3/domains/default => generated 199 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 07:58:18.435485 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9732473-e6bb-41a1-b032-f1352ca37142 None None] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 07:58:18.543995 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9732473-e6bb-41a1-b032-f1352ca37142 None None] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 07:58:18.584880 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd7244d8-531f-4116-a86e-1a8c8d903cf7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 07:58:18.585488 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7244d8-531f-4116-a86e-1a8c8d903cf7 None admin] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 07:58:18.585793 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7244d8-531f-4116-a86e-1a8c8d903cf7 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 07:58:18.586065 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7244d8-531f-4116-a86e-1a8c8d903cf7 None admin] PATH_INFO: `/v3/users` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 07:58:18.586751 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd7244d8-531f-4116-a86e-1a8c8d903cf7 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 07:58:18.588198 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd7244d8-531f-4116-a86e-1a8c8d903cf7 None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 07:58:18.616489 dv-cinder-851351-1-smb devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 31/61] 10.222.0.42 () {60 vars in 1132 bytes} [Thu Jul 28 07:58:18 2022] POST /identity/v3/users => generated 275 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 07:58:21.796268 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d06c247-b78c-452b-a18c-394daf4a06de None None] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 07:58:21.797362 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d06c247-b78c-452b-a18c-394daf4a06de None None] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 07:58:21.797836 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d06c247-b78c-452b-a18c-394daf4a06de None None] PATH_INFO: `/` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 07:58:21.799412 dv-cinder-851351-1-smb devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 31/62] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 07:58:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 07:58:21.805123 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1942378b-be86-4815-80ea-3b8306b5d726 None None] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 07:58:21.806018 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1942378b-be86-4815-80ea-3b8306b5d726 None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 07:58:21.806526 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1942378b-be86-4815-80ea-3b8306b5d726 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 07:58:21.833829 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.auth.core [None req-1942378b-be86-4815-80ea-3b8306b5d726 None None] MFA Rules not processed for user `f0666d3a50644a7097367331c1ee1a68`. Rule list: `[]` (Enabled: `True`). {{(pid=80347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 07:58:21.835476 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-1942378b-be86-4815-80ea-3b8306b5d726 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 07:58:21.839018 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 07:58:21.925469 dv-cinder-851351-1-smb devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 32/63] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 07:58:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 07:58:21.960505 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d06c247-b78c-452b-a18c-394daf4a06de None None] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 07:58:22.080639 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e343e4af-0976-4e1a-9b44-d766cd5367fa None None] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 07:58:22.081015 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e343e4af-0976-4e1a-9b44-d766cd5367fa None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 07:58:22.081225 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e343e4af-0976-4e1a-9b44-d766cd5367fa None None] PATH_INFO: `/` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 07:58:22.083149 dv-cinder-851351-1-smb devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 33/64] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 07:58:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 28 07:58:22.092024 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd196051-f62a-4e5f-a27e-8f1bc24a5c51 None None] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 07:58:22.092360 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd196051-f62a-4e5f-a27e-8f1bc24a5c51 None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 07:58:22.092571 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd196051-f62a-4e5f-a27e-8f1bc24a5c51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 07:58:22.118641 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.auth.core [None req-bd196051-f62a-4e5f-a27e-8f1bc24a5c51 None None] MFA Rules not processed for user `f0666d3a50644a7097367331c1ee1a68`. Rule list: `[]` (Enabled: `True`). {{(pid=80347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 07:58:22.119895 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-bd196051-f62a-4e5f-a27e-8f1bc24a5c51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 07:58:22.122869 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d06c247-b78c-452b-a18c-394daf4a06de None None] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 07:58:22.187733 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c81590-ba54-4491-b090-d9f87ae0e56c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 07:58:22.188406 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c81590-ba54-4491-b090-d9f87ae0e56c None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 07:58:22.188705 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c81590-ba54-4491-b090-d9f87ae0e56c None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 07:58:22.188983 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c81590-ba54-4491-b090-d9f87ae0e56c None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 07:58:22.213932 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41c81590-ba54-4491-b090-d9f87ae0e56c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 07:58:22.219574 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application [None req-41c81590-ba54-4491-b090-d9f87ae0e56c None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 28 07:58:22.219574 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 07:58:22.219574 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 07:58:22.219574 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 07:58:22.219574 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 07:58:22.219574 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 07:58:22.219574 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 07:58:22.219574 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 07:58:22.219574 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 07:58:22.219574 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 07:58:22.219574 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 07:58:22.219574 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 07:58:22.219574 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 07:58:22.219574 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 07:58:22.219574 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 07:58:22.219574 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 07:58:22.220440 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 07:58:22.220440 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 07:58:22.220440 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 07:58:22.220440 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 07:58:22.220440 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 07:58:22.220440 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 07:58:22.220440 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 07:58:22.220440 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 07:58:22.220440 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 07:58:22.220440 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 07:58:22.220440 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 07:58:22.220440 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application with Lock( Jul 28 07:58:22.220440 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 07:58:22.220440 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self._enter() Jul 28 07:58:22.220440 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 07:58:22.220440 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 07:58:22.221289 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 07:58:22.221289 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.creator() Jul 28 07:58:22.221289 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 07:58:22.221289 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application created_value = creator( Jul 28 07:58:22.221289 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 07:58:22.221289 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 07:58:22.221289 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 07:58:22.221289 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 07:58:22.221289 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 07:58:22.221289 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 07:58:22.221289 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 28 07:58:22.221289 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application Jul 28 07:58:22.223818 dv-cinder-851351-1-smb devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 32/65] 10.222.0.42 () {56 vars in 1114 bytes} [Thu Jul 28 07:58:21 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 264 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 07:58:22.230872 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c81590-ba54-4491-b090-d9f87ae0e56c None admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 07:58:22.269096 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=100 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 07:58:22.293523 dv-cinder-851351-1-smb devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 34/66] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 07:58:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 28 07:58:22.303497 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83dec7e0-c23e-4027-a408-a234488ad263 None None] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 07:58:22.303839 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83dec7e0-c23e-4027-a408-a234488ad263 None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 07:58:22.304017 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83dec7e0-c23e-4027-a408-a234488ad263 None None] PATH_INFO: `/` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 07:58:22.305758 dv-cinder-851351-1-smb devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 35/67] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 07:58:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 28 07:58:22.311824 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936fc1a0-f2bf-498d-802e-fdf2ef4f1be9 None None] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 07:58:22.312446 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936fc1a0-f2bf-498d-802e-fdf2ef4f1be9 None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 07:58:22.312937 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936fc1a0-f2bf-498d-802e-fdf2ef4f1be9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 07:58:22.341467 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.auth.core [None req-936fc1a0-f2bf-498d-802e-fdf2ef4f1be9 None None] MFA Rules not processed for user `f0666d3a50644a7097367331c1ee1a68`. Rule list: `[]` (Enabled: `True`). {{(pid=80347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 07:58:22.343070 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-936fc1a0-f2bf-498d-802e-fdf2ef4f1be9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 07:58:22.357458 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c81590-ba54-4491-b090-d9f87ae0e56c None admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 07:58:22.402507 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a084e932-7078-4f7f-ae61-44502283ffc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 07:58:22.403448 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a084e932-7078-4f7f-ae61-44502283ffc6 None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 07:58:22.403727 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a084e932-7078-4f7f-ae61-44502283ffc6 None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 07:58:22.404081 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a084e932-7078-4f7f-ae61-44502283ffc6 None admin] PATH_INFO: `/v3/roles` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 07:58:22.404884 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a084e932-7078-4f7f-ae61-44502283ffc6 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80348) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 07:58:22.405185 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a084e932-7078-4f7f-ae61-44502283ffc6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 07:58:22.406770 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a084e932-7078-4f7f-ae61-44502283ffc6 None admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 07:58:22.412687 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 07:58:22.417160 dv-cinder-851351-1-smb devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 33/68] 10.222.0.42 () {56 vars in 1111 bytes} [Thu Jul 28 07:58:22 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 07:58:22.418025 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a084e932-7078-4f7f-ae61-44502283ffc6 None admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 07:58:22.418817 dv-cinder-851351-1-smb devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 36/69] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 07:58:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 07:58:22.420289 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c59ec5-d153-4491-858b-25f40870df52 None None] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 07:58:22.420645 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c59ec5-d153-4491-858b-25f40870df52 None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 07:58:22.421033 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c59ec5-d153-4491-858b-25f40870df52 None None] PATH_INFO: `/` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 07:58:22.422615 dv-cinder-851351-1-smb devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 37/70] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 07:58:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 07:58:22.424400 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d588e4c-c8fc-4e4b-b443-8799841819d5 None None] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 07:58:22.424885 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d588e4c-c8fc-4e4b-b443-8799841819d5 None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 07:58:22.425729 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d588e4c-c8fc-4e4b-b443-8799841819d5 None None] PATH_INFO: `/` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 07:58:22.428392 dv-cinder-851351-1-smb devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 38/71] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 07:58:22 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 07:58:22.430176 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d588e4c-c8fc-4e4b-b443-8799841819d5 None None] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 07:58:22.533218 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=100 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 07:58:22.543758 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a084e932-7078-4f7f-ae61-44502283ffc6 None admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 07:58:22.549660 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d588e4c-c8fc-4e4b-b443-8799841819d5 None None] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 07:58:22.577479 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aad0929-41bb-4071-a629-d811a095363b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 07:58:22.578075 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aad0929-41bb-4071-a629-d811a095363b None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 07:58:22.578386 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aad0929-41bb-4071-a629-d811a095363b None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 07:58:22.578657 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aad0929-41bb-4071-a629-d811a095363b None admin] PATH_INFO: `/v3/roles/member` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 07:58:22.583613 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aede75e-ad39-44a2-aead-ab2934c30fd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 07:58:22.584269 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aede75e-ad39-44a2-aead-ab2934c30fd7 None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 07:58:22.584549 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aede75e-ad39-44a2-aead-ab2934c30fd7 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 07:58:22.584856 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aede75e-ad39-44a2-aead-ab2934c30fd7 None admin] PATH_INFO: `/v3/users/3e40f59d19f54db3bf0031b56994797a` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 07:58:22.589456 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aad0929-41bb-4071-a629-d811a095363b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 07:58:22.594985 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application [None req-1aad0929-41bb-4071-a629-d811a095363b None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 28 07:58:22.594985 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 07:58:22.594985 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 07:58:22.594985 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 07:58:22.594985 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 07:58:22.594985 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 07:58:22.594985 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 07:58:22.594985 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 07:58:22.594985 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 07:58:22.594985 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 07:58:22.594985 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 07:58:22.594985 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 07:58:22.594985 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 07:58:22.594985 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 07:58:22.594985 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 07:58:22.594985 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 07:58:22.595803 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 07:58:22.595803 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 07:58:22.595803 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 07:58:22.595803 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 07:58:22.595803 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 07:58:22.595803 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 07:58:22.595803 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 07:58:22.595803 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 07:58:22.595803 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 07:58:22.595803 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 07:58:22.595803 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 07:58:22.595803 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application with Lock( Jul 28 07:58:22.595803 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 07:58:22.595803 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self._enter() Jul 28 07:58:22.595803 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 07:58:22.595803 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 07:58:22.596539 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 07:58:22.596539 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.creator() Jul 28 07:58:22.596539 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 07:58:22.596539 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application created_value = creator( Jul 28 07:58:22.596539 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 07:58:22.596539 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 07:58:22.596539 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 07:58:22.596539 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 07:58:22.596539 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 07:58:22.596539 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 07:58:22.596539 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 28 07:58:22.596539 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application Jul 28 07:58:22.596539 dv-cinder-851351-1-smb devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 34/72] 10.222.0.42 () {56 vars in 1099 bytes} [Thu Jul 28 07:58:22 2022] GET /identity/v3/roles/member => generated 84 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 07:58:22.597595 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07990a12-7f91-4ba9-9be4-324ada7cd82e None None] REQUEST_METHOD: `POST` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 07:58:22.597595 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07990a12-7f91-4ba9-9be4-324ada7cd82e None None] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 07:58:22.597814 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07990a12-7f91-4ba9-9be4-324ada7cd82e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 07:58:22.603896 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aede75e-ad39-44a2-aead-ab2934c30fd7 None admin] RBAC: Authorizing `identity:get_user(user_id=3e40f59d19f54db3bf0031b56994797a)` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 07:58:22.605387 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aede75e-ad39-44a2-aead-ab2934c30fd7 None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 07:58:22.607099 dv-cinder-851351-1-smb devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 39/73] 10.222.0.42 () {56 vars in 1177 bytes} [Thu Jul 28 07:58:22 2022] GET /identity/v3/users/3e40f59d19f54db3bf0031b56994797a => generated 275 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 07:58:22.608263 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6396415-fb64-4d1a-901b-e4c31735fc91 None None] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 07:58:22.608546 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6396415-fb64-4d1a-901b-e4c31735fc91 None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 07:58:22.608851 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6396415-fb64-4d1a-901b-e4c31735fc91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 07:58:22.617100 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.auth.core [None req-07990a12-7f91-4ba9-9be4-324ada7cd82e None None] MFA Rules not processed for user `f0666d3a50644a7097367331c1ee1a68`. Rule list: `[]` (Enabled: `True`). {{(pid=80348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 07:58:22.618312 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.fernet_utils [None req-07990a12-7f91-4ba9-9be4-324ada7cd82e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 07:58:22.627118 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.auth.core [None req-c6396415-fb64-4d1a-901b-e4c31735fc91 None None] MFA Rules not processed for user `f0666d3a50644a7097367331c1ee1a68`. Rule list: `[]` (Enabled: `True`). {{(pid=80347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 07:58:22.628282 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-c6396415-fb64-4d1a-901b-e4c31735fc91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 07:58:22.680857 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 07:58:22.682858 dv-cinder-851351-1-smb devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 35/74] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 07:58:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 07:58:22.689547 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07990a12-7f91-4ba9-9be4-324ada7cd82e None None] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 07:58:22.695950 dv-cinder-851351-1-smb devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 40/75] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 07:58:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 07:58:22.697840 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6396415-fb64-4d1a-901b-e4c31735fc91 None None] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 07:58:22.779056 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=100 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 07:58:22.795092 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6396415-fb64-4d1a-901b-e4c31735fc91 None None] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 07:58:22.798016 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07990a12-7f91-4ba9-9be4-324ada7cd82e None None] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 07:58:22.828481 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c0edf54-6d3a-4427-9f6a-051b37d4aa1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 07:58:22.829210 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0edf54-6d3a-4427-9f6a-051b37d4aa1a None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 07:58:22.829485 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0edf54-6d3a-4427-9f6a-051b37d4aa1a None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 07:58:22.829762 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0edf54-6d3a-4427-9f6a-051b37d4aa1a None admin] PATH_INFO: `/v3/roles` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 07:58:22.830488 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c0edf54-6d3a-4427-9f6a-051b37d4aa1a None admin] RBAC: Adding query filter params (name=member) {{(pid=80347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 07:58:22.830795 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c0edf54-6d3a-4427-9f6a-051b37d4aa1a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 07:58:22.832287 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0cdbe9e-9d2f-4ef5-b5ec-68c7fb23ead1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 07:58:22.832532 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c0edf54-6d3a-4427-9f6a-051b37d4aa1a None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 07:58:22.832964 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0cdbe9e-9d2f-4ef5-b5ec-68c7fb23ead1 None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 07:58:22.833240 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0cdbe9e-9d2f-4ef5-b5ec-68c7fb23ead1 None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 07:58:22.833506 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0cdbe9e-9d2f-4ef5-b5ec-68c7fb23ead1 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 07:58:22.840461 dv-cinder-851351-1-smb devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 41/76] 10.222.0.42 () {56 vars in 1101 bytes} [Thu Jul 28 07:58:22 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 07:58:22.841410 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c0edf54-6d3a-4427-9f6a-051b37d4aa1a None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 07:58:22.848819 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0cdbe9e-9d2f-4ef5-b5ec-68c7fb23ead1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 07:58:22.854008 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application [None req-f0cdbe9e-9d2f-4ef5-b5ec-68c7fb23ead1 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 07:58:22.854008 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 07:58:22.854008 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 07:58:22.854008 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 07:58:22.854008 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 07:58:22.854008 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 07:58:22.854008 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 07:58:22.854008 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 07:58:22.854008 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 07:58:22.854008 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 07:58:22.854008 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 07:58:22.854008 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 07:58:22.854008 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 07:58:22.854008 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 07:58:22.854008 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 07:58:22.854008 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 07:58:22.854986 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 07:58:22.854986 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 07:58:22.854986 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 07:58:22.854986 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 07:58:22.854986 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 07:58:22.854986 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 07:58:22.854986 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 07:58:22.854986 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 07:58:22.854986 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 07:58:22.854986 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 07:58:22.854986 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 07:58:22.854986 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application with Lock( Jul 28 07:58:22.854986 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 07:58:22.854986 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self._enter() Jul 28 07:58:22.854986 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 07:58:22.854986 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 07:58:22.855773 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 07:58:22.855773 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.creator() Jul 28 07:58:22.855773 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 07:58:22.855773 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application created_value = creator( Jul 28 07:58:22.855773 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 07:58:22.855773 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 07:58:22.855773 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 07:58:22.855773 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 07:58:22.855773 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 07:58:22.855773 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 07:58:22.855773 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 07:58:22.855773 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application Jul 28 07:58:22.855773 dv-cinder-851351-1-smb devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 36/77] 10.222.0.42 () {56 vars in 1096 bytes} [Thu Jul 28 07:58:22 2022] GET /identity/v3/roles/admin => generated 83 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 07:58:22.856412 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0cdbe9e-9d2f-4ef5-b5ec-68c7fb23ead1 None admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 07:58:22.892651 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 07:58:22.942936 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c0edf54-6d3a-4427-9f6a-051b37d4aa1a None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 07:58:22.958649 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0cdbe9e-9d2f-4ef5-b5ec-68c7fb23ead1 None admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 07:58:22.976532 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af33ba30-4c43-455f-9ac1-6a673265ba73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 07:58:22.977186 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af33ba30-4c43-455f-9ac1-6a673265ba73 None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 07:58:22.977466 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af33ba30-4c43-455f-9ac1-6a673265ba73 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 07:58:22.977738 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af33ba30-4c43-455f-9ac1-6a673265ba73 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 07:58:22.992310 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa83028-00aa-44ab-8e2d-bd9ab73c8003 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 07:58:22.992992 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa83028-00aa-44ab-8e2d-bd9ab73c8003 None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 07:58:22.993273 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa83028-00aa-44ab-8e2d-bd9ab73c8003 None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 07:58:22.993536 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa83028-00aa-44ab-8e2d-bd9ab73c8003 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 07:58:23.000972 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=100 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 07:58:23.004875 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaa83028-00aa-44ab-8e2d-bd9ab73c8003 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 07:58:23.009873 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application [None req-aaa83028-00aa-44ab-8e2d-bd9ab73c8003 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 28 07:58:23.009873 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 07:58:23.009873 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 07:58:23.009873 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 07:58:23.009873 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 07:58:23.009873 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 07:58:23.009873 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 07:58:23.009873 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 07:58:23.009873 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 07:58:23.009873 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 07:58:23.009873 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 07:58:23.009873 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 07:58:23.009873 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 07:58:23.009873 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 07:58:23.009873 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 07:58:23.009873 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 07:58:23.010881 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 07:58:23.010881 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 07:58:23.010881 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 07:58:23.010881 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 07:58:23.010881 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 07:58:23.010881 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 07:58:23.010881 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 07:58:23.010881 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 07:58:23.010881 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 07:58:23.010881 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 07:58:23.010881 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 07:58:23.010881 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application with Lock( Jul 28 07:58:23.010881 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 07:58:23.010881 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self._enter() Jul 28 07:58:23.010881 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 07:58:23.010881 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 07:58:23.011672 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 07:58:23.011672 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.creator() Jul 28 07:58:23.011672 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 07:58:23.011672 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application created_value = creator( Jul 28 07:58:23.011672 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 07:58:23.011672 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 07:58:23.011672 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 07:58:23.011672 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 07:58:23.011672 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 07:58:23.011672 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 07:58:23.011672 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 28 07:58:23.011672 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application Jul 28 07:58:23.011672 dv-cinder-851351-1-smb devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 37/78] 10.222.0.42 () {56 vars in 1099 bytes} [Thu Jul 28 07:58:22 2022] GET /identity/v3/roles/member => generated 84 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 07:58:23.012297 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa83028-00aa-44ab-8e2d-bd9ab73c8003 None admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 07:58:23.047798 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af33ba30-4c43-455f-9ac1-6a673265ba73 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 07:58:23.049319 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af33ba30-4c43-455f-9ac1-6a673265ba73 None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 07:58:23.096309 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 07:58:23.116955 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa83028-00aa-44ab-8e2d-bd9ab73c8003 None admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 07:58:23.147079 dv-cinder-851351-1-smb devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 42/79] 10.222.0.42 () {58 vars in 1282 bytes} [Thu Jul 28 07:58:22 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 28 07:58:23.148024 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af33ba30-4c43-455f-9ac1-6a673265ba73 None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 07:58:23.150269 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c8c4e1-5872-4375-87e6-4ab1ac4cdf40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 07:58:23.151032 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c8c4e1-5872-4375-87e6-4ab1ac4cdf40 None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 07:58:23.151330 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c8c4e1-5872-4375-87e6-4ab1ac4cdf40 None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 07:58:23.152013 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c8c4e1-5872-4375-87e6-4ab1ac4cdf40 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 07:58:23.153288 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c8c4e1-5872-4375-87e6-4ab1ac4cdf40 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 07:58:23.154713 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c8c4e1-5872-4375-87e6-4ab1ac4cdf40 None admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 07:58:23.156780 dv-cinder-851351-1-smb devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 38/80] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 07:58:23 2022] GET /identity/v3/domains/default => generated 199 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 07:58:23.157553 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c8c4e1-5872-4375-87e6-4ab1ac4cdf40 None admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 07:58:23.230930 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=100 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 07:58:23.252475 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af33ba30-4c43-455f-9ac1-6a673265ba73 None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 07:58:23.265557 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c8c4e1-5872-4375-87e6-4ab1ac4cdf40 None admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 07:58:23.287744 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b90efa1-4375-4106-9bb3-6ecabd3f5ef4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 07:58:23.288400 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b90efa1-4375-4106-9bb3-6ecabd3f5ef4 None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 07:58:23.288688 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b90efa1-4375-4106-9bb3-6ecabd3f5ef4 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 07:58:23.288992 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b90efa1-4375-4106-9bb3-6ecabd3f5ef4 None admin] PATH_INFO: `/v3/users/3e40f59d19f54db3bf0031b56994797a` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 07:58:23.290227 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b90efa1-4375-4106-9bb3-6ecabd3f5ef4 None admin] RBAC: Authorizing `identity:get_user(user_id=3e40f59d19f54db3bf0031b56994797a)` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 07:58:23.291699 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b90efa1-4375-4106-9bb3-6ecabd3f5ef4 None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 07:58:23.293379 dv-cinder-851351-1-smb devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 43/81] 10.222.0.42 () {56 vars in 1177 bytes} [Thu Jul 28 07:58:23 2022] GET /identity/v3/users/3e40f59d19f54db3bf0031b56994797a => generated 275 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 07:58:23.298163 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b90efa1-4375-4106-9bb3-6ecabd3f5ef4 None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 07:58:23.303337 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e4520d-d05f-4308-b514-008d9e2c29d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 07:58:23.304063 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e4520d-d05f-4308-b514-008d9e2c29d3 None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 07:58:23.304360 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e4520d-d05f-4308-b514-008d9e2c29d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 07:58:23.304631 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e4520d-d05f-4308-b514-008d9e2c29d3 None admin] PATH_INFO: `/v3/roles` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 07:58:23.305392 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e4520d-d05f-4308-b514-008d9e2c29d3 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80348) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 07:58:23.305696 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e4520d-d05f-4308-b514-008d9e2c29d3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 07:58:23.307066 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e4520d-d05f-4308-b514-008d9e2c29d3 None admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 07:58:23.315213 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 07:58:23.319965 dv-cinder-851351-1-smb devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 39/82] 10.222.0.42 () {56 vars in 1099 bytes} [Thu Jul 28 07:58:23 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 07:58:23.319965 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e4520d-d05f-4308-b514-008d9e2c29d3 None admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 07:58:23.397571 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b90efa1-4375-4106-9bb3-6ecabd3f5ef4 None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 07:58:23.417837 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e4520d-d05f-4308-b514-008d9e2c29d3 None admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 07:58:23.433565 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f52e6941-8135-46b5-b5ec-2b742cc15551 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 07:58:23.434194 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52e6941-8135-46b5-b5ec-2b742cc15551 None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 07:58:23.434472 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52e6941-8135-46b5-b5ec-2b742cc15551 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 07:58:23.434737 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52e6941-8135-46b5-b5ec-2b742cc15551 None admin] PATH_INFO: `/v3/roles` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 07:58:23.435459 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f52e6941-8135-46b5-b5ec-2b742cc15551 None admin] RBAC: Adding query filter params (name=member) {{(pid=80347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 07:58:23.435787 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f52e6941-8135-46b5-b5ec-2b742cc15551 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 07:58:23.437310 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f52e6941-8135-46b5-b5ec-2b742cc15551 None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 07:58:23.445983 dv-cinder-851351-1-smb devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 44/83] 10.222.0.42 () {56 vars in 1101 bytes} [Thu Jul 28 07:58:23 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 07:58:23.447221 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=100 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 07:58:23.447982 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f52e6941-8135-46b5-b5ec-2b742cc15551 None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 07:58:23.454981 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee5c9a6-7c3f-448d-b32f-ae647b732b23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 07:58:23.455648 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee5c9a6-7c3f-448d-b32f-ae647b732b23 None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 07:58:23.455975 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee5c9a6-7c3f-448d-b32f-ae647b732b23 None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 07:58:23.456255 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee5c9a6-7c3f-448d-b32f-ae647b732b23 None admin] PATH_INFO: `/v3/projects/cdfa7c2638114a968f5357dc098b441b` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 07:58:23.457935 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bee5c9a6-7c3f-448d-b32f-ae647b732b23 None admin] RBAC: Authorizing `identity:get_project(project_id=cdfa7c2638114a968f5357dc098b441b)` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 07:58:23.459389 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bee5c9a6-7c3f-448d-b32f-ae647b732b23 None admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 07:58:23.461129 dv-cinder-851351-1-smb devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 40/84] 10.222.0.42 () {56 vars in 1186 bytes} [Thu Jul 28 07:58:23 2022] GET /identity/v3/projects/cdfa7c2638114a968f5357dc098b441b => generated 298 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 07:58:23.461904 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee5c9a6-7c3f-448d-b32f-ae647b732b23 None admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 07:58:23.532260 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 07:58:23.553540 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f52e6941-8135-46b5-b5ec-2b742cc15551 None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 07:58:23.565240 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee5c9a6-7c3f-448d-b32f-ae647b732b23 None admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 07:58:23.589436 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb73c50-500b-40a9-8a84-ecb0e27b57f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 07:58:23.590070 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb73c50-500b-40a9-8a84-ecb0e27b57f8 None admin] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 07:58:23.590353 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb73c50-500b-40a9-8a84-ecb0e27b57f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 07:58:23.590631 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb73c50-500b-40a9-8a84-ecb0e27b57f8 None admin] PATH_INFO: `/v3/users` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 07:58:23.591328 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecb73c50-500b-40a9-8a84-ecb0e27b57f8 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 07:58:23.592823 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecb73c50-500b-40a9-8a84-ecb0e27b57f8 None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 07:58:23.598851 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e397b494-d6b6-44cb-b0e3-553bd7fab57a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 07:58:23.599480 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e397b494-d6b6-44cb-b0e3-553bd7fab57a None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 07:58:23.599761 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e397b494-d6b6-44cb-b0e3-553bd7fab57a None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 07:58:23.600037 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e397b494-d6b6-44cb-b0e3-553bd7fab57a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 07:58:23.615616 dv-cinder-851351-1-smb devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 45/85] 10.222.0.42 () {60 vars in 1132 bytes} [Thu Jul 28 07:58:23 2022] POST /identity/v3/users => generated 289 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 07:58:23.621737 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb73c50-500b-40a9-8a84-ecb0e27b57f8 None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 07:58:23.685179 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=100 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 07:58:23.689843 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e397b494-d6b6-44cb-b0e3-553bd7fab57a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 07:58:23.691959 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e397b494-d6b6-44cb-b0e3-553bd7fab57a None admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 07:58:23.743842 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb73c50-500b-40a9-8a84-ecb0e27b57f8 None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 07:58:23.784369 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e0a5bc-5e3d-46fb-a214-df5cce50cf1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 07:58:23.785431 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e0a5bc-5e3d-46fb-a214-df5cce50cf1d None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 07:58:23.785719 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e0a5bc-5e3d-46fb-a214-df5cce50cf1d None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 07:58:23.785998 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e0a5bc-5e3d-46fb-a214-df5cce50cf1d None admin] PATH_INFO: `/v3/users/f0666d3a50644a7097367331c1ee1a68` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 07:58:23.787717 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e0a5bc-5e3d-46fb-a214-df5cce50cf1d None admin] RBAC: Authorizing `identity:get_user(user_id=f0666d3a50644a7097367331c1ee1a68)` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 07:58:23.789338 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e0a5bc-5e3d-46fb-a214-df5cce50cf1d None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 07:58:23.791597 dv-cinder-851351-1-smb devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 46/86] 10.222.0.42 () {56 vars in 1177 bytes} [Thu Jul 28 07:58:23 2022] GET /identity/v3/users/f0666d3a50644a7097367331c1ee1a68 => generated 247 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 07:58:23.791871 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e0a5bc-5e3d-46fb-a214-df5cce50cf1d None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 07:58:23.797120 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 07:58:23.820013 dv-cinder-851351-1-smb devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 41/87] 10.222.0.42 () {58 vars in 1282 bytes} [Thu Jul 28 07:58:23 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 354 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 28 07:58:23.820013 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e397b494-d6b6-44cb-b0e3-553bd7fab57a None admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 07:58:23.930667 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e0a5bc-5e3d-46fb-a214-df5cce50cf1d None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 07:58:23.948538 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=100 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 07:58:23.954018 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e397b494-d6b6-44cb-b0e3-553bd7fab57a None admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 07:58:23.985999 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff9bb2f-9c12-4927-9b7a-efa090e6449c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 07:58:23.986680 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff9bb2f-9c12-4927-9b7a-efa090e6449c None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 07:58:23.986984 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff9bb2f-9c12-4927-9b7a-efa090e6449c None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 07:58:23.987479 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff9bb2f-9c12-4927-9b7a-efa090e6449c None admin] PATH_INFO: `/v3/users/3e40f59d19f54db3bf0031b56994797a` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 07:58:23.993481 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ff9bb2f-9c12-4927-9b7a-efa090e6449c None admin] RBAC: Authorizing `identity:get_user(user_id=3e40f59d19f54db3bf0031b56994797a)` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 07:58:23.994967 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ff9bb2f-9c12-4927-9b7a-efa090e6449c None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 07:58:23.996744 dv-cinder-851351-1-smb devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 47/88] 10.222.0.42 () {56 vars in 1177 bytes} [Thu Jul 28 07:58:23 2022] GET /identity/v3/users/3e40f59d19f54db3bf0031b56994797a => generated 275 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 07:58:24.000271 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff9bb2f-9c12-4927-9b7a-efa090e6449c None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 07:58:24.005850 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58423471-e9e3-4c93-9353-34bb7cd7a7fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 07:58:24.005850 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58423471-e9e3-4c93-9353-34bb7cd7a7fe None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 07:58:24.005850 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58423471-e9e3-4c93-9353-34bb7cd7a7fe None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 07:58:24.006124 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58423471-e9e3-4c93-9353-34bb7cd7a7fe None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 07:58:24.006990 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58423471-e9e3-4c93-9353-34bb7cd7a7fe None admin] RBAC: Adding query filter params (role.id=f28d669937b942878bcf6a9103012af9, scope.project.id=cdfa7c2638114a968f5357dc098b441b, user.id=3e40f59d19f54db3bf0031b56994797a) {{(pid=80348) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 07:58:24.007308 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58423471-e9e3-4c93-9353-34bb7cd7a7fe None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 07:58:24.008973 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58423471-e9e3-4c93-9353-34bb7cd7a7fe None admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 07:58:24.016159 dv-cinder-851351-1-smb devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 42/89] 10.222.0.42 () {56 vars in 1374 bytes} [Thu Jul 28 07:58:23 2022] GET /identity/v3/role_assignments?user.id=3e40f59d19f54db3bf0031b56994797a&scope.project.id=cdfa7c2638114a968f5357dc098b441b&role.id=f28d669937b942878bcf6a9103012af9 => generated 259 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 07:58:24.017279 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58423471-e9e3-4c93-9353-34bb7cd7a7fe None admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 07:58:24.129710 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff9bb2f-9c12-4927-9b7a-efa090e6449c None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 07:58:24.138636 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58423471-e9e3-4c93-9353-34bb7cd7a7fe None admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 07:58:24.149155 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 07:58:24.181210 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57a43f1-17a9-46c2-9115-e0c77c93eee0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 07:58:24.181861 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57a43f1-17a9-46c2-9115-e0c77c93eee0 None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 07:58:24.182141 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57a43f1-17a9-46c2-9115-e0c77c93eee0 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 07:58:24.182417 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57a43f1-17a9-46c2-9115-e0c77c93eee0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 07:58:24.183861 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9471ec3-a1e8-4b33-903e-55515a3e88db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 07:58:24.184795 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9471ec3-a1e8-4b33-903e-55515a3e88db None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 07:58:24.185272 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9471ec3-a1e8-4b33-903e-55515a3e88db None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 07:58:24.185761 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9471ec3-a1e8-4b33-903e-55515a3e88db None admin] PATH_INFO: `/v3/projects/cdfa7c2638114a968f5357dc098b441b` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 07:58:24.187458 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9471ec3-a1e8-4b33-903e-55515a3e88db None admin] RBAC: Authorizing `identity:get_project(project_id=cdfa7c2638114a968f5357dc098b441b)` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 07:58:24.189192 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9471ec3-a1e8-4b33-903e-55515a3e88db None admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 07:58:24.191156 dv-cinder-851351-1-smb devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 43/90] 10.222.0.42 () {56 vars in 1186 bytes} [Thu Jul 28 07:58:24 2022] GET /identity/v3/projects/cdfa7c2638114a968f5357dc098b441b => generated 298 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 07:58:24.192167 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9471ec3-a1e8-4b33-903e-55515a3e88db None admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 07:58:24.245697 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=100 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 07:58:24.260010 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e57a43f1-17a9-46c2-9115-e0c77c93eee0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 07:58:24.261548 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e57a43f1-17a9-46c2-9115-e0c77c93eee0 None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 07:58:24.355689 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 07:58:24.371078 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9471ec3-a1e8-4b33-903e-55515a3e88db None admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 07:58:24.410816 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c87c5b6-e8a8-4689-a793-106fcad55d59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 07:58:24.411454 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c87c5b6-e8a8-4689-a793-106fcad55d59 None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 07:58:24.411732 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c87c5b6-e8a8-4689-a793-106fcad55d59 None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 07:58:24.412000 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c87c5b6-e8a8-4689-a793-106fcad55d59 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 07:58:24.431862 dv-cinder-851351-1-smb devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 48/91] 10.222.0.42 () {58 vars in 1282 bytes} [Thu Jul 28 07:58:23 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 434 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 28 07:58:24.432779 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57a43f1-17a9-46c2-9115-e0c77c93eee0 None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 07:58:24.495475 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c87c5b6-e8a8-4689-a793-106fcad55d59 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 07:58:24.497035 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c87c5b6-e8a8-4689-a793-106fcad55d59 None admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 07:58:24.528610 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=100 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 07:58:24.585013 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57a43f1-17a9-46c2-9115-e0c77c93eee0 None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 07:58:24.609096 dv-cinder-851351-1-smb devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 44/92] 10.222.0.42 () {58 vars in 1282 bytes} [Thu Jul 28 07:58:24 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 417 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 28 07:58:24.610063 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c87c5b6-e8a8-4689-a793-106fcad55d59 None admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 07:58:24.630935 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef94a936-4e03-4d53-a976-d514d0d5d07b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 07:58:24.631715 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef94a936-4e03-4d53-a976-d514d0d5d07b None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 07:58:24.631996 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef94a936-4e03-4d53-a976-d514d0d5d07b None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 07:58:24.632367 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef94a936-4e03-4d53-a976-d514d0d5d07b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 07:58:24.633401 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef94a936-4e03-4d53-a976-d514d0d5d07b None admin] RBAC: Adding query filter params (role.id=0317c30d81ff44eea2fd4a7215c60eac, scope.project.id=cdfa7c2638114a968f5357dc098b441b, user.id=3e40f59d19f54db3bf0031b56994797a) {{(pid=80347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 07:58:24.633715 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef94a936-4e03-4d53-a976-d514d0d5d07b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 07:58:24.635210 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef94a936-4e03-4d53-a976-d514d0d5d07b None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 07:58:24.645695 dv-cinder-851351-1-smb devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 49/93] 10.222.0.42 () {56 vars in 1374 bytes} [Thu Jul 28 07:58:24 2022] GET /identity/v3/role_assignments?user.id=3e40f59d19f54db3bf0031b56994797a&scope.project.id=cdfa7c2638114a968f5357dc098b441b&role.id=0317c30d81ff44eea2fd4a7215c60eac => generated 259 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 07:58:24.646676 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef94a936-4e03-4d53-a976-d514d0d5d07b None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 07:58:24.720014 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c87c5b6-e8a8-4689-a793-106fcad55d59 None admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 07:58:24.726304 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 07:58:24.769244 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=100 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 07:58:24.788087 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb82144-1c3d-4971-a977-c1ce51238ca3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 07:58:24.788804 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb82144-1c3d-4971-a977-c1ce51238ca3 None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 07:58:24.789088 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb82144-1c3d-4971-a977-c1ce51238ca3 None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 07:58:24.789361 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb82144-1c3d-4971-a977-c1ce51238ca3 None admin] PATH_INFO: `/v3/projects/cdfa7c2638114a968f5357dc098b441b` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 07:58:24.793710 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cb82144-1c3d-4971-a977-c1ce51238ca3 None admin] RBAC: Authorizing `identity:get_project(project_id=cdfa7c2638114a968f5357dc098b441b)` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 07:58:24.795305 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cb82144-1c3d-4971-a977-c1ce51238ca3 None admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 07:58:24.797213 dv-cinder-851351-1-smb devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 45/94] 10.222.0.42 () {56 vars in 1186 bytes} [Thu Jul 28 07:58:24 2022] GET /identity/v3/projects/cdfa7c2638114a968f5357dc098b441b => generated 298 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 07:58:24.804574 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb82144-1c3d-4971-a977-c1ce51238ca3 None admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 07:58:24.824290 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef94a936-4e03-4d53-a976-d514d0d5d07b None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 07:58:24.958050 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f0ad35-5f8c-4893-a255-85da7d86d75a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 07:58:24.959621 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f0ad35-5f8c-4893-a255-85da7d86d75a None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 07:58:24.960101 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f0ad35-5f8c-4893-a255-85da7d86d75a None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 07:58:24.960571 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f0ad35-5f8c-4893-a255-85da7d86d75a None admin] PATH_INFO: `/v3/projects/1537f5accf6246559f3312e9445eb40c` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 07:58:24.973509 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1f0ad35-5f8c-4893-a255-85da7d86d75a None admin] RBAC: Authorizing `identity:get_project(project_id=1537f5accf6246559f3312e9445eb40c)` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 07:58:24.975401 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1f0ad35-5f8c-4893-a255-85da7d86d75a None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 07:58:24.983636 dv-cinder-851351-1-smb devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 50/95] 10.222.0.42 () {56 vars in 1186 bytes} [Thu Jul 28 07:58:24 2022] GET /identity/v3/projects/1537f5accf6246559f3312e9445eb40c => generated 312 bytes in 337 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 07:58:24.991467 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f0ad35-5f8c-4893-a255-85da7d86d75a None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 07:58:25.068139 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb82144-1c3d-4971-a977-c1ce51238ca3 None admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 07:58:25.130944 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610ad489-5c04-470d-a2e2-75607c0dbc93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 07:58:25.131974 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610ad489-5c04-470d-a2e2-75607c0dbc93 None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 07:58:25.132446 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610ad489-5c04-470d-a2e2-75607c0dbc93 None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 07:58:25.132935 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610ad489-5c04-470d-a2e2-75607c0dbc93 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 07:58:25.134863 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-610ad489-5c04-470d-a2e2-75607c0dbc93 None admin] RBAC: Adding query filter params (role.id=362bd71ac01249fb8fa635381993eec1, scope.project.id=cdfa7c2638114a968f5357dc098b441b, user.id=f0666d3a50644a7097367331c1ee1a68) {{(pid=80348) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 07:58:25.135408 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-610ad489-5c04-470d-a2e2-75607c0dbc93 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 07:58:25.137369 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-610ad489-5c04-470d-a2e2-75607c0dbc93 None admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 07:58:25.162363 dv-cinder-851351-1-smb devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 46/96] 10.222.0.42 () {56 vars in 1374 bytes} [Thu Jul 28 07:58:24 2022] GET /identity/v3/role_assignments?user.id=f0666d3a50644a7097367331c1ee1a68&scope.project.id=cdfa7c2638114a968f5357dc098b441b&role.id=362bd71ac01249fb8fa635381993eec1 => generated 259 bytes in 359 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 07:58:25.347478 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f0ad35-5f8c-4893-a255-85da7d86d75a None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 07:58:25.354307 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 07:58:25.443346 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9273e481-a035-46ba-9e7e-fea0d2a40fa3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 07:58:25.448091 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9273e481-a035-46ba-9e7e-fea0d2a40fa3 None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 07:58:25.448091 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9273e481-a035-46ba-9e7e-fea0d2a40fa3 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 07:58:25.448091 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9273e481-a035-46ba-9e7e-fea0d2a40fa3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 07:58:25.448091 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9273e481-a035-46ba-9e7e-fea0d2a40fa3 None admin] RBAC: Adding query filter params (role.id=0317c30d81ff44eea2fd4a7215c60eac, scope.project.id=1537f5accf6246559f3312e9445eb40c, user.id=3e40f59d19f54db3bf0031b56994797a) {{(pid=80347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 07:58:25.448091 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9273e481-a035-46ba-9e7e-fea0d2a40fa3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 07:58:25.448091 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9273e481-a035-46ba-9e7e-fea0d2a40fa3 None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 07:58:25.457877 dv-cinder-851351-1-smb devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 51/97] 10.222.0.42 () {56 vars in 1374 bytes} [Thu Jul 28 07:58:24 2022] GET /identity/v3/role_assignments?user.id=3e40f59d19f54db3bf0031b56994797a&scope.project.id=1537f5accf6246559f3312e9445eb40c&role.id=0317c30d81ff44eea2fd4a7215c60eac => generated 259 bytes in 467 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 07:58:26.290804 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9ee5ee-e57a-4e75-ab06-49e862f7a367 None None] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 07:58:26.291822 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9ee5ee-e57a-4e75-ab06-49e862f7a367 None None] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 07:58:26.292307 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9ee5ee-e57a-4e75-ab06-49e862f7a367 None None] PATH_INFO: `/` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 07:58:26.293948 dv-cinder-851351-1-smb devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 47/98] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 07:58:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 07:58:26.299818 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2bdbbae-c302-447f-bb62-8450f5bc27fe None None] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 07:58:26.300402 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2bdbbae-c302-447f-bb62-8450f5bc27fe None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 07:58:26.300402 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2bdbbae-c302-447f-bb62-8450f5bc27fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 07:58:26.328646 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.auth.core [None req-e2bdbbae-c302-447f-bb62-8450f5bc27fe None None] MFA Rules not processed for user `f0666d3a50644a7097367331c1ee1a68`. Rule list: `[]` (Enabled: `True`). {{(pid=80347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 07:58:26.329888 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-e2bdbbae-c302-447f-bb62-8450f5bc27fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 07:58:26.415215 dv-cinder-851351-1-smb devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 52/99] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 07:58:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 07:58:26.451305 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f9ee5ee-e57a-4e75-ab06-49e862f7a367 None None] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 07:58:26.474066 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a93e167-1aeb-4f8b-80a4-0a1413de2240 None None] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 07:58:26.474372 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a93e167-1aeb-4f8b-80a4-0a1413de2240 None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 07:58:26.474618 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a93e167-1aeb-4f8b-80a4-0a1413de2240 None None] PATH_INFO: `/` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 07:58:26.476132 dv-cinder-851351-1-smb devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 53/100] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 07:58:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 07:58:26.490141 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743f3d1a-0bd1-4b88-9980-6dc0037f50f5 None None] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 07:58:26.490420 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743f3d1a-0bd1-4b88-9980-6dc0037f50f5 None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 07:58:26.490851 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743f3d1a-0bd1-4b88-9980-6dc0037f50f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 07:58:26.517760 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.auth.core [None req-743f3d1a-0bd1-4b88-9980-6dc0037f50f5 None None] MFA Rules not processed for user `f0666d3a50644a7097367331c1ee1a68`. Rule list: `[]` (Enabled: `True`). {{(pid=80347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 07:58:26.519201 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-743f3d1a-0bd1-4b88-9980-6dc0037f50f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 07:58:26.568467 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=100 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 07:58:26.642402 dv-cinder-851351-1-smb devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 54/101] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 07:58:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 07:58:26.682857 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743f3d1a-0bd1-4b88-9980-6dc0037f50f5 None None] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 07:58:26.697232 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f9ee5ee-e57a-4e75-ab06-49e862f7a367 None None] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 07:58:26.733405 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 07:58:26.763941 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ce2a8f-4675-4450-8246-4e5aef40575b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 07:58:26.765630 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ce2a8f-4675-4450-8246-4e5aef40575b None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 07:58:26.766388 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ce2a8f-4675-4450-8246-4e5aef40575b None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 07:58:26.767099 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ce2a8f-4675-4450-8246-4e5aef40575b None admin] PATH_INFO: `/v3/domains/default` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 07:58:26.769452 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3ce2a8f-4675-4450-8246-4e5aef40575b None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 07:58:26.772494 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3ce2a8f-4675-4450-8246-4e5aef40575b None admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 07:58:26.775933 dv-cinder-851351-1-smb devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 48/102] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 07:58:26 2022] GET /identity/v3/domains/default => generated 199 bytes in 325 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 07:58:26.782835 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ce2a8f-4675-4450-8246-4e5aef40575b None admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 07:58:26.885086 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743f3d1a-0bd1-4b88-9980-6dc0037f50f5 None None] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 07:58:26.954325 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab3403b-7fb6-4036-b0c7-a4fa5696c237 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 07:58:26.955869 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab3403b-7fb6-4036-b0c7-a4fa5696c237 None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 07:58:26.957131 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab3403b-7fb6-4036-b0c7-a4fa5696c237 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 07:58:26.957862 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab3403b-7fb6-4036-b0c7-a4fa5696c237 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 07:58:26.981367 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab3403b-7fb6-4036-b0c7-a4fa5696c237 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 07:58:27.000757 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application [None req-eab3403b-7fb6-4036-b0c7-a4fa5696c237 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 28 07:58:27.000757 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 07:58:27.000757 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 07:58:27.000757 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 07:58:27.000757 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 07:58:27.000757 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 07:58:27.000757 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 07:58:27.000757 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 07:58:27.000757 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 07:58:27.000757 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 07:58:27.000757 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 07:58:27.000757 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 07:58:27.000757 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 07:58:27.000757 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 07:58:27.000757 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 07:58:27.000757 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 07:58:27.002327 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 07:58:27.002327 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 07:58:27.002327 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 07:58:27.002327 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 07:58:27.002327 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 07:58:27.002327 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 07:58:27.002327 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 07:58:27.002327 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 07:58:27.002327 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 07:58:27.002327 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 07:58:27.002327 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 07:58:27.002327 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application with Lock( Jul 28 07:58:27.002327 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 07:58:27.002327 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._enter() Jul 28 07:58:27.002327 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 07:58:27.002327 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 07:58:27.003750 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 07:58:27.003750 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.creator() Jul 28 07:58:27.003750 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 07:58:27.003750 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application created_value = creator( Jul 28 07:58:27.003750 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 07:58:27.003750 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 07:58:27.003750 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 07:58:27.003750 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 07:58:27.003750 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 07:58:27.003750 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 07:58:27.003750 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 28 07:58:27.003750 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application Jul 28 07:58:27.010510 dv-cinder-851351-1-smb devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 55/103] 10.222.0.42 () {56 vars in 1099 bytes} [Thu Jul 28 07:58:26 2022] GET /identity/v3/roles/reader => generated 84 bytes in 328 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 07:58:27.017216 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab3403b-7fb6-4036-b0c7-a4fa5696c237 None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 07:58:27.143008 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ce2a8f-4675-4450-8246-4e5aef40575b None admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 07:58:27.181048 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 07:58:27.184192 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab3403b-7fb6-4036-b0c7-a4fa5696c237 None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 07:58:27.195105 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=100 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 07:58:27.211538 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79fcee2-b2c6-49bb-9158-f85bda2743ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 07:58:27.212181 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79fcee2-b2c6-49bb-9158-f85bda2743ca None admin] REQUEST_METHOD: `POST` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 07:58:27.212608 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79fcee2-b2c6-49bb-9158-f85bda2743ca None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 07:58:27.213048 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79fcee2-b2c6-49bb-9158-f85bda2743ca None admin] PATH_INFO: `/v3/projects` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 07:58:27.213916 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b79fcee2-b2c6-49bb-9158-f85bda2743ca None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 07:58:27.215523 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b79fcee2-b2c6-49bb-9158-f85bda2743ca None admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 07:58:27.225740 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e05de5-4f05-48fe-b975-6f95ae620a7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 07:58:27.226694 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e05de5-4f05-48fe-b975-6f95ae620a7c None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 07:58:27.227271 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e05de5-4f05-48fe-b975-6f95ae620a7c None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 07:58:27.227842 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e05de5-4f05-48fe-b975-6f95ae620a7c None admin] PATH_INFO: `/v3/roles` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 07:58:27.228822 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e05de5-4f05-48fe-b975-6f95ae620a7c None admin] RBAC: Adding query filter params (name=reader) {{(pid=80347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 07:58:27.229340 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e05de5-4f05-48fe-b975-6f95ae620a7c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 07:58:27.230924 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e05de5-4f05-48fe-b975-6f95ae620a7c None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 07:58:27.241059 dv-cinder-851351-1-smb devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 56/104] 10.222.0.42 () {56 vars in 1101 bytes} [Thu Jul 28 07:58:27 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 07:58:27.242705 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e846937b-1d3b-4b97-ab2d-3d3c32d483f4 None None] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 07:58:27.243282 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e846937b-1d3b-4b97-ab2d-3d3c32d483f4 None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 07:58:27.243750 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e846937b-1d3b-4b97-ab2d-3d3c32d483f4 None None] PATH_INFO: `/` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 07:58:27.245450 dv-cinder-851351-1-smb devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 57/105] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 07:58:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 28 07:58:27.246676 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e846937b-1d3b-4b97-ab2d-3d3c32d483f4 None None] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 07:58:27.280590 dv-cinder-851351-1-smb devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 49/106] 10.222.0.42 () {60 vars in 1141 bytes} [Thu Jul 28 07:58:26 2022] POST /identity/v3/projects => generated 302 bytes in 499 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 28 07:58:27.281970 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55af4c7-0efe-4110-b4b9-44b6ae27a3e8 None None] REQUEST_METHOD: `POST` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 07:58:27.282422 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55af4c7-0efe-4110-b4b9-44b6ae27a3e8 None None] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 07:58:27.282831 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55af4c7-0efe-4110-b4b9-44b6ae27a3e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 07:58:27.317951 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.auth.core [None req-e55af4c7-0efe-4110-b4b9-44b6ae27a3e8 None None] MFA Rules not processed for user `f0666d3a50644a7097367331c1ee1a68`. Rule list: `[]` (Enabled: `True`). {{(pid=80348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 07:58:27.319984 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.fernet_utils [None req-e55af4c7-0efe-4110-b4b9-44b6ae27a3e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 07:58:27.382306 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e846937b-1d3b-4b97-ab2d-3d3c32d483f4 None None] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 07:58:27.427949 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c2dea9-de4f-4760-8e2e-17823eca1fa9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 07:58:27.428639 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c2dea9-de4f-4760-8e2e-17823eca1fa9 None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 07:58:27.428971 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c2dea9-de4f-4760-8e2e-17823eca1fa9 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 07:58:27.429243 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c2dea9-de4f-4760-8e2e-17823eca1fa9 None admin] PATH_INFO: `/v3/users/ac2c507b345b453baa8d65b44b216574` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 07:58:27.444839 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00c2dea9-de4f-4760-8e2e-17823eca1fa9 None admin] RBAC: Authorizing `identity:get_user(user_id=ac2c507b345b453baa8d65b44b216574)` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 07:58:27.446373 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00c2dea9-de4f-4760-8e2e-17823eca1fa9 None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 07:58:27.448251 dv-cinder-851351-1-smb devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 58/107] 10.222.0.42 () {56 vars in 1177 bytes} [Thu Jul 28 07:58:27 2022] GET /identity/v3/users/ac2c507b345b453baa8d65b44b216574 => generated 289 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 07:58:27.454333 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c2dea9-de4f-4760-8e2e-17823eca1fa9 None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 07:58:27.468086 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 07:58:27.469871 dv-cinder-851351-1-smb devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 50/108] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 07:58:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 07:58:27.513673 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55af4c7-0efe-4110-b4b9-44b6ae27a3e8 None None] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 07:58:27.564769 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c2dea9-de4f-4760-8e2e-17823eca1fa9 None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 07:58:27.606485 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e76fbe-e652-4fe1-b3cc-7c131fcb181b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 07:58:27.607198 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e76fbe-e652-4fe1-b3cc-7c131fcb181b None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 07:58:27.607486 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e76fbe-e652-4fe1-b3cc-7c131fcb181b None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 07:58:27.607764 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e76fbe-e652-4fe1-b3cc-7c131fcb181b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 07:58:27.692653 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e76fbe-e652-4fe1-b3cc-7c131fcb181b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 07:58:27.694349 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e76fbe-e652-4fe1-b3cc-7c131fcb181b None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 07:58:27.705134 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 07:58:27.742713 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55af4c7-0efe-4110-b4b9-44b6ae27a3e8 None None] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 07:58:27.767472 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 07:58:27.806839 dv-cinder-851351-1-smb devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 59/109] 10.222.0.42 () {58 vars in 1282 bytes} [Thu Jul 28 07:58:27 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 353 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 28 07:58:27.812640 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e76fbe-e652-4fe1-b3cc-7c131fcb181b None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 07:58:27.838179 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668d2795-d7f4-41c9-9532-1c396bfc4754 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 07:58:27.839311 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668d2795-d7f4-41c9-9532-1c396bfc4754 None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 07:58:27.839311 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668d2795-d7f4-41c9-9532-1c396bfc4754 None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 07:58:27.839471 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668d2795-d7f4-41c9-9532-1c396bfc4754 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 07:58:27.868339 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-668d2795-d7f4-41c9-9532-1c396bfc4754 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 07:58:27.873443 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application [None req-668d2795-d7f4-41c9-9532-1c396bfc4754 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 28 07:58:27.873443 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 07:58:27.873443 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 07:58:27.873443 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 07:58:27.873443 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 07:58:27.873443 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 07:58:27.873443 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 07:58:27.873443 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 07:58:27.873443 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 07:58:27.873443 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 07:58:27.873443 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 07:58:27.873443 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 07:58:27.873443 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 07:58:27.873443 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 07:58:27.873443 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 07:58:27.873443 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 07:58:27.874499 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 07:58:27.874499 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 07:58:27.874499 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 07:58:27.874499 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 07:58:27.874499 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 07:58:27.874499 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 07:58:27.874499 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 07:58:27.874499 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 07:58:27.874499 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 07:58:27.874499 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 07:58:27.874499 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 07:58:27.874499 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application with Lock( Jul 28 07:58:27.874499 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 07:58:27.874499 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self._enter() Jul 28 07:58:27.874499 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 07:58:27.874499 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 07:58:27.875677 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 07:58:27.875677 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.creator() Jul 28 07:58:27.875677 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 07:58:27.875677 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application created_value = creator( Jul 28 07:58:27.875677 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 07:58:27.875677 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 07:58:27.875677 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 07:58:27.875677 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 07:58:27.875677 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 07:58:27.875677 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 07:58:27.875677 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 28 07:58:27.875677 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application Jul 28 07:58:27.875677 dv-cinder-851351-1-smb devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 51/110] 10.222.0.42 () {56 vars in 1114 bytes} [Thu Jul 28 07:58:27 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 362 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 07:58:27.882047 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668d2795-d7f4-41c9-9532-1c396bfc4754 None admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 07:58:27.985266 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e76fbe-e652-4fe1-b3cc-7c131fcb181b None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 07:58:27.997165 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 07:58:28.026989 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a07c2896-a854-4fcc-b6b8-3e9a9fe26f58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 07:58:28.027705 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07c2896-a854-4fcc-b6b8-3e9a9fe26f58 None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 07:58:28.027987 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07c2896-a854-4fcc-b6b8-3e9a9fe26f58 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 07:58:28.028260 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07c2896-a854-4fcc-b6b8-3e9a9fe26f58 None admin] PATH_INFO: `/v3/projects/cdfa7c2638114a968f5357dc098b441b` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 07:58:28.029497 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a07c2896-a854-4fcc-b6b8-3e9a9fe26f58 None admin] RBAC: Authorizing `identity:get_project(project_id=cdfa7c2638114a968f5357dc098b441b)` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 07:58:28.031017 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a07c2896-a854-4fcc-b6b8-3e9a9fe26f58 None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 07:58:28.032835 dv-cinder-851351-1-smb devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 60/111] 10.222.0.42 () {56 vars in 1186 bytes} [Thu Jul 28 07:58:27 2022] GET /identity/v3/projects/cdfa7c2638114a968f5357dc098b441b => generated 298 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 07:58:28.039112 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a07c2896-a854-4fcc-b6b8-3e9a9fe26f58 None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 07:58:28.074863 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668d2795-d7f4-41c9-9532-1c396bfc4754 None admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 07:58:28.134995 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-563c492a-d500-496e-bae8-7ff7aaddef32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 07:58:28.135563 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563c492a-d500-496e-bae8-7ff7aaddef32 None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 07:58:28.135848 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563c492a-d500-496e-bae8-7ff7aaddef32 None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 07:58:28.136126 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563c492a-d500-496e-bae8-7ff7aaddef32 None admin] PATH_INFO: `/v3/roles` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 07:58:28.136919 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-563c492a-d500-496e-bae8-7ff7aaddef32 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80348) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 07:58:28.137234 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-563c492a-d500-496e-bae8-7ff7aaddef32 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 07:58:28.138694 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-563c492a-d500-496e-bae8-7ff7aaddef32 None admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 07:58:28.155348 dv-cinder-851351-1-smb devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 52/112] 10.222.0.42 () {56 vars in 1111 bytes} [Thu Jul 28 07:58:27 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 07:58:28.165777 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-563c492a-d500-496e-bae8-7ff7aaddef32 None admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 07:58:28.187784 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a07c2896-a854-4fcc-b6b8-3e9a9fe26f58 None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 07:58:28.240927 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0128af45-6fec-4465-95fb-114140342e8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 07:58:28.241932 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0128af45-6fec-4465-95fb-114140342e8c None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 07:58:28.242419 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0128af45-6fec-4465-95fb-114140342e8c None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 07:58:28.242910 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0128af45-6fec-4465-95fb-114140342e8c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 07:58:28.243917 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0128af45-6fec-4465-95fb-114140342e8c None admin] RBAC: Adding query filter params (role.id=21c3f6dd315a425a98d00fcf994f3a36, scope.project.id=cdfa7c2638114a968f5357dc098b441b, user.id=ac2c507b345b453baa8d65b44b216574) {{(pid=80347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 07:58:28.244440 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0128af45-6fec-4465-95fb-114140342e8c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 07:58:28.245907 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=100 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 07:58:28.247548 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0128af45-6fec-4465-95fb-114140342e8c None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 07:58:28.254655 dv-cinder-851351-1-smb devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 61/113] 10.222.0.42 () {56 vars in 1374 bytes} [Thu Jul 28 07:58:28 2022] GET /identity/v3/role_assignments?user.id=ac2c507b345b453baa8d65b44b216574&scope.project.id=cdfa7c2638114a968f5357dc098b441b&role.id=21c3f6dd315a425a98d00fcf994f3a36 => generated 259 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 07:58:28.302468 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eca92c0-c1be-428c-9881-bc91b48da42d None None] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 07:58:28.303135 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eca92c0-c1be-428c-9881-bc91b48da42d None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 07:58:28.303618 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eca92c0-c1be-428c-9881-bc91b48da42d None None] PATH_INFO: `/` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 07:58:28.309521 dv-cinder-851351-1-smb devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 62/114] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 07:58:28 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 28 07:58:28.330903 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1cffba0-d3b0-46ba-90bf-615e73018fc9 None None] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 07:58:28.333204 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1cffba0-d3b0-46ba-90bf-615e73018fc9 None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 07:58:28.333712 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1cffba0-d3b0-46ba-90bf-615e73018fc9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 07:58:28.360595 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-563c492a-d500-496e-bae8-7ff7aaddef32 None admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 07:58:28.368037 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.auth.core [None req-d1cffba0-d3b0-46ba-90bf-615e73018fc9 None None] MFA Rules not processed for user `f0666d3a50644a7097367331c1ee1a68`. Rule list: `[]` (Enabled: `True`). {{(pid=80347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 07:58:28.369727 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-d1cffba0-d3b0-46ba-90bf-615e73018fc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 07:58:28.425000 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b48f792-6077-4abf-ba5f-2e70bfbfd93c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 07:58:28.425000 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b48f792-6077-4abf-ba5f-2e70bfbfd93c None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 07:58:28.425000 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b48f792-6077-4abf-ba5f-2e70bfbfd93c None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 07:58:28.425000 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b48f792-6077-4abf-ba5f-2e70bfbfd93c None admin] PATH_INFO: `/v3/users/3e40f59d19f54db3bf0031b56994797a` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 07:58:28.429627 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b48f792-6077-4abf-ba5f-2e70bfbfd93c None admin] RBAC: Authorizing `identity:get_user(user_id=3e40f59d19f54db3bf0031b56994797a)` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 07:58:28.431155 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b48f792-6077-4abf-ba5f-2e70bfbfd93c None admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 07:58:28.432773 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 07:58:28.433324 dv-cinder-851351-1-smb devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 53/115] 10.222.0.42 () {56 vars in 1177 bytes} [Thu Jul 28 07:58:28 2022] GET /identity/v3/users/3e40f59d19f54db3bf0031b56994797a => generated 275 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 07:58:28.442403 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b48f792-6077-4abf-ba5f-2e70bfbfd93c None admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 07:58:28.517639 dv-cinder-851351-1-smb devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 63/116] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 07:58:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 28 07:58:28.545822 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23df6ac7-0535-4437-ad53-0eecc5b3f16c None None] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 07:58:28.546154 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23df6ac7-0535-4437-ad53-0eecc5b3f16c None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 07:58:28.546387 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23df6ac7-0535-4437-ad53-0eecc5b3f16c None None] PATH_INFO: `/` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 07:58:28.547832 dv-cinder-851351-1-smb devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 64/117] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 07:58:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 28 07:58:28.554256 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95dc5e6-42ac-4216-ab83-4b2bffb451df None None] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 07:58:28.554256 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95dc5e6-42ac-4216-ab83-4b2bffb451df None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 07:58:28.554256 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95dc5e6-42ac-4216-ab83-4b2bffb451df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 07:58:28.590222 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.auth.core [None req-f95dc5e6-42ac-4216-ab83-4b2bffb451df None None] MFA Rules not processed for user `f0666d3a50644a7097367331c1ee1a68`. Rule list: `[]` (Enabled: `True`). {{(pid=80347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 07:58:28.592002 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-f95dc5e6-42ac-4216-ab83-4b2bffb451df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 07:58:28.673422 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b48f792-6077-4abf-ba5f-2e70bfbfd93c None admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 07:58:28.677082 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=100 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 07:58:28.724975 dv-cinder-851351-1-smb devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 65/118] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 07:58:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 28 07:58:28.725561 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6e3379-8d2e-4f03-a169-9a540c365598 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 07:58:28.726511 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6e3379-8d2e-4f03-a169-9a540c365598 None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 07:58:28.726997 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6e3379-8d2e-4f03-a169-9a540c365598 None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 07:58:28.727471 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6e3379-8d2e-4f03-a169-9a540c365598 None admin] PATH_INFO: `/v3/projects/cdfa7c2638114a968f5357dc098b441b` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 07:58:28.732687 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95dc5e6-42ac-4216-ab83-4b2bffb451df None None] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 07:58:28.733798 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff6e3379-8d2e-4f03-a169-9a540c365598 None admin] RBAC: Authorizing `identity:get_project(project_id=cdfa7c2638114a968f5357dc098b441b)` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 07:58:28.735515 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff6e3379-8d2e-4f03-a169-9a540c365598 None admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 07:58:28.737845 dv-cinder-851351-1-smb devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 54/119] 10.222.0.42 () {56 vars in 1186 bytes} [Thu Jul 28 07:58:28 2022] GET /identity/v3/projects/cdfa7c2638114a968f5357dc098b441b => generated 298 bytes in 296 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 07:58:28.743134 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6e3379-8d2e-4f03-a169-9a540c365598 None admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 07:58:28.841961 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 07:58:28.845138 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95dc5e6-42ac-4216-ab83-4b2bffb451df None None] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 07:58:28.867232 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6e3379-8d2e-4f03-a169-9a540c365598 None admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 07:58:28.880920 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ca52df-8c27-4918-a6da-32f2f84f8d14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 07:58:28.881582 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ca52df-8c27-4918-a6da-32f2f84f8d14 None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 07:58:28.881862 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ca52df-8c27-4918-a6da-32f2f84f8d14 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 07:58:28.882132 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ca52df-8c27-4918-a6da-32f2f84f8d14 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 07:58:28.893653 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ca52df-8c27-4918-a6da-32f2f84f8d14 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 07:58:28.898693 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application [None req-e1ca52df-8c27-4918-a6da-32f2f84f8d14 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 28 07:58:28.898693 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 07:58:28.898693 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 07:58:28.898693 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 07:58:28.898693 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 07:58:28.898693 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 07:58:28.898693 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 07:58:28.898693 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 07:58:28.898693 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 07:58:28.898693 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 07:58:28.898693 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 07:58:28.898693 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 07:58:28.898693 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 07:58:28.898693 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 07:58:28.898693 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 07:58:28.898693 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 07:58:28.899520 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 07:58:28.899520 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 07:58:28.899520 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 07:58:28.899520 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 07:58:28.899520 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 07:58:28.899520 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 07:58:28.899520 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 07:58:28.899520 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 07:58:28.899520 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 07:58:28.899520 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 07:58:28.899520 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 07:58:28.899520 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application with Lock( Jul 28 07:58:28.899520 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 07:58:28.899520 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._enter() Jul 28 07:58:28.899520 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 07:58:28.899520 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 07:58:28.900254 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 07:58:28.900254 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.creator() Jul 28 07:58:28.900254 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 07:58:28.900254 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application created_value = creator( Jul 28 07:58:28.900254 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 07:58:28.900254 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 07:58:28.900254 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 07:58:28.900254 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 07:58:28.900254 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 07:58:28.900254 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 07:58:28.900254 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 28 07:58:28.900254 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application Jul 28 07:58:28.900254 dv-cinder-851351-1-smb devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 66/120] 10.222.0.42 () {56 vars in 1099 bytes} [Thu Jul 28 07:58:28 2022] GET /identity/v3/roles/member => generated 84 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 07:58:28.901675 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff4e228-f54a-426b-b1d0-19f5569f6206 None None] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 07:58:28.901675 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff4e228-f54a-426b-b1d0-19f5569f6206 None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 07:58:28.901845 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff4e228-f54a-426b-b1d0-19f5569f6206 None None] PATH_INFO: `/` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 07:58:28.903259 dv-cinder-851351-1-smb devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 67/121] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 07:58:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 07:58:28.903893 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff4e228-f54a-426b-b1d0-19f5569f6206 None None] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 07:58:28.913068 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca49f539-4f7e-4a3b-8201-19f2f885030c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 07:58:28.913833 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca49f539-4f7e-4a3b-8201-19f2f885030c None admin] REQUEST_METHOD: `PUT` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 07:58:28.914556 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca49f539-4f7e-4a3b-8201-19f2f885030c None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 07:58:28.914556 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca49f539-4f7e-4a3b-8201-19f2f885030c None admin] PATH_INFO: `/v3/projects/cdfa7c2638114a968f5357dc098b441b/users/3e40f59d19f54db3bf0031b56994797a/roles/f28d669937b942878bcf6a9103012af9` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 07:58:28.917043 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca49f539-4f7e-4a3b-8201-19f2f885030c None admin] RBAC: Authorizing `identity:create_grant(project_id=cdfa7c2638114a968f5357dc098b441b, user_id=3e40f59d19f54db3bf0031b56994797a, role_id=f28d669937b942878bcf6a9103012af9)` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 07:58:28.918207 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca49f539-4f7e-4a3b-8201-19f2f885030c None admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 07:58:28.939444 dv-cinder-851351-1-smb devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 55/122] 10.222.0.42 () {58 vars in 1439 bytes} [Thu Jul 28 07:58:28 2022] PUT /identity/v3/projects/cdfa7c2638114a968f5357dc098b441b/users/3e40f59d19f54db3bf0031b56994797a/roles/f28d669937b942878bcf6a9103012af9 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 28 07:58:28.940015 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca49f539-4f7e-4a3b-8201-19f2f885030c None admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 07:58:29.011300 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 07:58:29.097771 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff4e228-f54a-426b-b1d0-19f5569f6206 None None] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 07:58:29.151398 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca49f539-4f7e-4a3b-8201-19f2f885030c None admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 07:58:29.171049 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23376242-616d-4aee-92ac-1485f09f1bc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 07:58:29.171196 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23376242-616d-4aee-92ac-1485f09f1bc4 None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 07:58:29.171377 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23376242-616d-4aee-92ac-1485f09f1bc4 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 07:58:29.171721 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23376242-616d-4aee-92ac-1485f09f1bc4 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 07:58:29.184379 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23376242-616d-4aee-92ac-1485f09f1bc4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 07:58:29.190573 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application [None req-23376242-616d-4aee-92ac-1485f09f1bc4 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 07:58:29.190573 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 07:58:29.190573 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 07:58:29.190573 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 07:58:29.190573 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 07:58:29.190573 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 07:58:29.190573 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 07:58:29.190573 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 07:58:29.190573 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 07:58:29.190573 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 07:58:29.190573 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 07:58:29.190573 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 07:58:29.190573 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 07:58:29.190573 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 07:58:29.190573 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 07:58:29.190573 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 07:58:29.191438 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 07:58:29.191438 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 07:58:29.191438 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 07:58:29.191438 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 07:58:29.191438 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 07:58:29.191438 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 07:58:29.191438 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 07:58:29.191438 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 07:58:29.191438 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 07:58:29.191438 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 07:58:29.191438 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 07:58:29.191438 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application with Lock( Jul 28 07:58:29.191438 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 07:58:29.191438 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._enter() Jul 28 07:58:29.191438 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 07:58:29.191438 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 07:58:29.192186 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 07:58:29.192186 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.creator() Jul 28 07:58:29.192186 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 07:58:29.192186 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application created_value = creator( Jul 28 07:58:29.192186 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 07:58:29.192186 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 07:58:29.192186 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 07:58:29.192186 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 07:58:29.192186 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 07:58:29.192186 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 07:58:29.192186 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 07:58:29.192186 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application Jul 28 07:58:29.192186 dv-cinder-851351-1-smb devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 68/123] 10.222.0.42 () {56 vars in 1096 bytes} [Thu Jul 28 07:58:28 2022] GET /identity/v3/roles/admin => generated 83 bytes in 288 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 07:58:29.194928 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84129f7-ae1a-4777-a4b1-26c3bf7c87bd None None] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 07:58:29.195220 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84129f7-ae1a-4777-a4b1-26c3bf7c87bd None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 07:58:29.195501 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84129f7-ae1a-4777-a4b1-26c3bf7c87bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 07:58:29.213977 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d6e01a-9235-4065-83ee-8ced9f3865ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 07:58:29.215053 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d6e01a-9235-4065-83ee-8ced9f3865ef None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 07:58:29.215522 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d6e01a-9235-4065-83ee-8ced9f3865ef None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 07:58:29.215983 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.auth.core [None req-c84129f7-ae1a-4777-a4b1-26c3bf7c87bd None None] MFA Rules not processed for user `f0666d3a50644a7097367331c1ee1a68`. Rule list: `[]` (Enabled: `True`). {{(pid=80347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 07:58:29.216190 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d6e01a-9235-4065-83ee-8ced9f3865ef None admin] PATH_INFO: `/v3/roles` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 07:58:29.217159 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80d6e01a-9235-4065-83ee-8ced9f3865ef None admin] RBAC: Adding query filter params (name=member) {{(pid=80348) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 07:58:29.217373 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-c84129f7-ae1a-4777-a4b1-26c3bf7c87bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 07:58:29.217920 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80d6e01a-9235-4065-83ee-8ced9f3865ef None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 07:58:29.219691 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80d6e01a-9235-4065-83ee-8ced9f3865ef None admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 07:58:29.236241 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 07:58:29.236895 dv-cinder-851351-1-smb devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 56/124] 10.222.0.42 () {56 vars in 1101 bytes} [Thu Jul 28 07:58:28 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 297 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 07:58:29.238411 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d6e01a-9235-4065-83ee-8ced9f3865ef None admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 07:58:29.296269 dv-cinder-851351-1-smb devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 69/125] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 07:58:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 07:58:29.297266 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c84129f7-ae1a-4777-a4b1-26c3bf7c87bd None None] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 07:58:29.345409 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=100 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 07:58:29.352627 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d6e01a-9235-4065-83ee-8ced9f3865ef None admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 07:58:29.389776 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a452c821-94f5-4f83-a8d1-f08580133970 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 07:58:29.391211 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a452c821-94f5-4f83-a8d1-f08580133970 None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 07:58:29.391748 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a452c821-94f5-4f83-a8d1-f08580133970 None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 07:58:29.392298 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a452c821-94f5-4f83-a8d1-f08580133970 None admin] PATH_INFO: `/v3/roles` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 07:58:29.393367 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a452c821-94f5-4f83-a8d1-f08580133970 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80348) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 07:58:29.393878 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a452c821-94f5-4f83-a8d1-f08580133970 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 07:58:29.395579 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a452c821-94f5-4f83-a8d1-f08580133970 None admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 07:58:29.405632 dv-cinder-851351-1-smb devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 57/126] 10.222.0.42 () {56 vars in 1099 bytes} [Thu Jul 28 07:58:29 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 07:58:29.406929 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a452c821-94f5-4f83-a8d1-f08580133970 None admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 07:58:29.427528 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c84129f7-ae1a-4777-a4b1-26c3bf7c87bd None None] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 07:58:29.463827 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183197e5-400b-4ed7-8ab2-02af5639af4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 07:58:29.464450 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183197e5-400b-4ed7-8ab2-02af5639af4c None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 07:58:29.464711 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183197e5-400b-4ed7-8ab2-02af5639af4c None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 07:58:29.464969 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183197e5-400b-4ed7-8ab2-02af5639af4c None admin] PATH_INFO: `/v3/users/3e40f59d19f54db3bf0031b56994797a` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 07:58:29.466185 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-183197e5-400b-4ed7-8ab2-02af5639af4c None admin] RBAC: Authorizing `identity:get_user(user_id=3e40f59d19f54db3bf0031b56994797a)` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 07:58:29.467711 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-183197e5-400b-4ed7-8ab2-02af5639af4c None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 07:58:29.469382 dv-cinder-851351-1-smb devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 70/127] 10.222.0.42 () {56 vars in 1177 bytes} [Thu Jul 28 07:58:29 2022] GET /identity/v3/users/3e40f59d19f54db3bf0031b56994797a => generated 275 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 07:58:29.470165 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183197e5-400b-4ed7-8ab2-02af5639af4c None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 07:58:29.507650 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 07:58:29.581972 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a452c821-94f5-4f83-a8d1-f08580133970 None admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 07:58:29.635895 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922135e2-ed3b-4095-b090-bc6d0ecec31b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 07:58:29.636578 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922135e2-ed3b-4095-b090-bc6d0ecec31b None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 07:58:29.636888 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922135e2-ed3b-4095-b090-bc6d0ecec31b None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 07:58:29.637168 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922135e2-ed3b-4095-b090-bc6d0ecec31b None admin] PATH_INFO: `/v3/roles/member` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 07:58:29.667805 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-922135e2-ed3b-4095-b090-bc6d0ecec31b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 07:58:29.676130 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183197e5-400b-4ed7-8ab2-02af5639af4c None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 07:58:29.683785 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application [None req-922135e2-ed3b-4095-b090-bc6d0ecec31b None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 28 07:58:29.683785 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 07:58:29.683785 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 07:58:29.683785 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 07:58:29.683785 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 07:58:29.683785 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 07:58:29.683785 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 07:58:29.683785 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 07:58:29.683785 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 07:58:29.683785 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 07:58:29.683785 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 07:58:29.683785 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 07:58:29.683785 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 07:58:29.683785 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 07:58:29.683785 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 07:58:29.683785 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 07:58:29.684690 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 07:58:29.684690 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 07:58:29.684690 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 07:58:29.684690 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 07:58:29.684690 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 07:58:29.684690 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 07:58:29.684690 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 07:58:29.684690 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 07:58:29.684690 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 07:58:29.684690 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 07:58:29.684690 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 07:58:29.684690 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application with Lock( Jul 28 07:58:29.684690 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 07:58:29.684690 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self._enter() Jul 28 07:58:29.684690 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 07:58:29.684690 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 07:58:29.685458 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 07:58:29.685458 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.creator() Jul 28 07:58:29.685458 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 07:58:29.685458 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application created_value = creator( Jul 28 07:58:29.685458 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 07:58:29.685458 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 07:58:29.685458 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 07:58:29.685458 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 07:58:29.685458 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 07:58:29.685458 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 07:58:29.685458 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 28 07:58:29.685458 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application Jul 28 07:58:29.687159 dv-cinder-851351-1-smb devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 58/128] 10.222.0.42 () {56 vars in 1099 bytes} [Thu Jul 28 07:58:29 2022] GET /identity/v3/roles/member => generated 84 bytes in 280 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 07:58:29.688719 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922135e2-ed3b-4095-b090-bc6d0ecec31b None admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 07:58:29.718068 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=100 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 07:58:29.721245 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c37e31-62ea-4b4f-a39d-b53100309e72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 07:58:29.721918 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c37e31-62ea-4b4f-a39d-b53100309e72 None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 07:58:29.722212 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c37e31-62ea-4b4f-a39d-b53100309e72 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 07:58:29.722528 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c37e31-62ea-4b4f-a39d-b53100309e72 None admin] PATH_INFO: `/v3/users/f0666d3a50644a7097367331c1ee1a68` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 07:58:29.724710 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c37e31-62ea-4b4f-a39d-b53100309e72 None admin] RBAC: Authorizing `identity:get_user(user_id=f0666d3a50644a7097367331c1ee1a68)` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 07:58:29.725369 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c37e31-62ea-4b4f-a39d-b53100309e72 None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 07:58:29.727425 dv-cinder-851351-1-smb devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 71/129] 10.222.0.42 () {56 vars in 1177 bytes} [Thu Jul 28 07:58:29 2022] GET /identity/v3/users/f0666d3a50644a7097367331c1ee1a68 => generated 247 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 07:58:29.728252 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c37e31-62ea-4b4f-a39d-b53100309e72 None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 07:58:29.824962 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 07:58:29.842684 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c37e31-62ea-4b4f-a39d-b53100309e72 None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 07:58:29.878754 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546f2dc5-d15b-47fe-9866-092312d5dcad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 07:58:29.879413 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546f2dc5-d15b-47fe-9866-092312d5dcad None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 07:58:29.879702 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546f2dc5-d15b-47fe-9866-092312d5dcad None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 07:58:29.879980 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546f2dc5-d15b-47fe-9866-092312d5dcad None admin] PATH_INFO: `/v3/roles` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 07:58:29.880745 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-546f2dc5-d15b-47fe-9866-092312d5dcad None admin] RBAC: Adding query filter params (name=member) {{(pid=80347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 07:58:29.881061 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-546f2dc5-d15b-47fe-9866-092312d5dcad None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 07:58:29.882459 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-546f2dc5-d15b-47fe-9866-092312d5dcad None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 07:58:29.891750 dv-cinder-851351-1-smb devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 72/130] 10.222.0.42 () {56 vars in 1101 bytes} [Thu Jul 28 07:58:29 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 07:58:29.892591 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546f2dc5-d15b-47fe-9866-092312d5dcad None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 07:58:29.909162 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922135e2-ed3b-4095-b090-bc6d0ecec31b None admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 07:58:29.982513 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4fe1b8d-0fbc-4e14-b5f5-6a60c53695db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 07:58:29.983709 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4fe1b8d-0fbc-4e14-b5f5-6a60c53695db None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 07:58:29.984378 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4fe1b8d-0fbc-4e14-b5f5-6a60c53695db None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 07:58:29.985094 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4fe1b8d-0fbc-4e14-b5f5-6a60c53695db None admin] PATH_INFO: `/v3/projects/cdfa7c2638114a968f5357dc098b441b` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 07:58:29.988782 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4fe1b8d-0fbc-4e14-b5f5-6a60c53695db None admin] RBAC: Authorizing `identity:get_project(project_id=cdfa7c2638114a968f5357dc098b441b)` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 07:58:29.990500 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4fe1b8d-0fbc-4e14-b5f5-6a60c53695db None admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 07:58:29.992441 dv-cinder-851351-1-smb devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 59/131] 10.222.0.42 () {56 vars in 1186 bytes} [Thu Jul 28 07:58:29 2022] GET /identity/v3/projects/cdfa7c2638114a968f5357dc098b441b => generated 298 bytes in 305 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 07:58:29.996769 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4fe1b8d-0fbc-4e14-b5f5-6a60c53695db None admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 07:58:30.017695 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546f2dc5-d15b-47fe-9866-092312d5dcad None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 07:58:30.086209 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf9e7fe-aae6-4778-bcdf-ca85579642f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 07:58:30.087256 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf9e7fe-aae6-4778-bcdf-ca85579642f4 None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 07:58:30.087678 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf9e7fe-aae6-4778-bcdf-ca85579642f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 07:58:30.088182 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf9e7fe-aae6-4778-bcdf-ca85579642f4 None admin] PATH_INFO: `/v3/projects/cdfa7c2638114a968f5357dc098b441b` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 07:58:30.090743 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf9e7fe-aae6-4778-bcdf-ca85579642f4 None admin] RBAC: Authorizing `identity:get_project(project_id=cdfa7c2638114a968f5357dc098b441b)` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 07:58:30.093422 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf9e7fe-aae6-4778-bcdf-ca85579642f4 None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 07:58:30.095605 dv-cinder-851351-1-smb devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 73/132] 10.222.0.42 () {56 vars in 1186 bytes} [Thu Jul 28 07:58:29 2022] GET /identity/v3/projects/cdfa7c2638114a968f5357dc098b441b => generated 298 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 07:58:30.097999 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf9e7fe-aae6-4778-bcdf-ca85579642f4 None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 07:58:30.136332 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 07:58:30.171917 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=100 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 07:58:30.208717 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4fe1b8d-0fbc-4e14-b5f5-6a60c53695db None admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 07:58:30.266578 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9637a964-5131-446f-adbd-59d4136d7bd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 07:58:30.267165 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9637a964-5131-446f-adbd-59d4136d7bd9 None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 07:58:30.267452 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9637a964-5131-446f-adbd-59d4136d7bd9 None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 07:58:30.267729 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9637a964-5131-446f-adbd-59d4136d7bd9 None admin] PATH_INFO: `/v3/users/3e40f59d19f54db3bf0031b56994797a` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 07:58:30.268987 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9637a964-5131-446f-adbd-59d4136d7bd9 None admin] RBAC: Authorizing `identity:get_user(user_id=3e40f59d19f54db3bf0031b56994797a)` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 07:58:30.271024 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9637a964-5131-446f-adbd-59d4136d7bd9 None admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 07:58:30.272934 dv-cinder-851351-1-smb devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 60/133] 10.222.0.42 () {56 vars in 1177 bytes} [Thu Jul 28 07:58:29 2022] GET /identity/v3/users/3e40f59d19f54db3bf0031b56994797a => generated 275 bytes in 280 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 07:58:30.273955 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9637a964-5131-446f-adbd-59d4136d7bd9 None admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 07:58:30.305428 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf9e7fe-aae6-4778-bcdf-ca85579642f4 None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 07:58:30.348607 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eacb2a7-d9a8-4be2-a411-0e24d498b043 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 07:58:30.350654 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eacb2a7-d9a8-4be2-a411-0e24d498b043 None admin] REQUEST_METHOD: `PUT` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 07:58:30.350743 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eacb2a7-d9a8-4be2-a411-0e24d498b043 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 07:58:30.350974 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eacb2a7-d9a8-4be2-a411-0e24d498b043 None admin] PATH_INFO: `/v3/projects/cdfa7c2638114a968f5357dc098b441b/users/3e40f59d19f54db3bf0031b56994797a/roles/0317c30d81ff44eea2fd4a7215c60eac` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 07:58:30.352987 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eacb2a7-d9a8-4be2-a411-0e24d498b043 None admin] RBAC: Authorizing `identity:create_grant(project_id=cdfa7c2638114a968f5357dc098b441b, user_id=3e40f59d19f54db3bf0031b56994797a, role_id=0317c30d81ff44eea2fd4a7215c60eac)` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 07:58:30.354580 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eacb2a7-d9a8-4be2-a411-0e24d498b043 None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 07:58:30.376115 dv-cinder-851351-1-smb devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 74/134] 10.222.0.42 () {58 vars in 1439 bytes} [Thu Jul 28 07:58:30 2022] PUT /identity/v3/projects/cdfa7c2638114a968f5357dc098b441b/users/3e40f59d19f54db3bf0031b56994797a/roles/0317c30d81ff44eea2fd4a7215c60eac => generated 0 bytes in 278 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 07:58:30.381177 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eacb2a7-d9a8-4be2-a411-0e24d498b043 None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 07:58:30.448244 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9637a964-5131-446f-adbd-59d4136d7bd9 None admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 07:58:30.487630 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e96bb08-a6f4-4040-b0c7-d4be0d54a74a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 07:58:30.488342 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e96bb08-a6f4-4040-b0c7-d4be0d54a74a None admin] REQUEST_METHOD: `PUT` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 07:58:30.488626 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e96bb08-a6f4-4040-b0c7-d4be0d54a74a None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 07:58:30.488933 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e96bb08-a6f4-4040-b0c7-d4be0d54a74a None admin] PATH_INFO: `/v3/projects/cdfa7c2638114a968f5357dc098b441b/users/f0666d3a50644a7097367331c1ee1a68/roles/362bd71ac01249fb8fa635381993eec1` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 07:58:30.490970 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e96bb08-a6f4-4040-b0c7-d4be0d54a74a None admin] RBAC: Authorizing `identity:create_grant(project_id=cdfa7c2638114a968f5357dc098b441b, user_id=f0666d3a50644a7097367331c1ee1a68, role_id=362bd71ac01249fb8fa635381993eec1)` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 07:58:30.492465 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e96bb08-a6f4-4040-b0c7-d4be0d54a74a None admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 07:58:30.512704 dv-cinder-851351-1-smb devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 61/135] 10.222.0.42 () {58 vars in 1439 bytes} [Thu Jul 28 07:58:30 2022] PUT /identity/v3/projects/cdfa7c2638114a968f5357dc098b441b/users/f0666d3a50644a7097367331c1ee1a68/roles/362bd71ac01249fb8fa635381993eec1 => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 07:58:30.514070 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739843a0-0bda-40cb-a1e9-0bbff29c92db None None] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 07:58:30.514516 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739843a0-0bda-40cb-a1e9-0bbff29c92db None None] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 07:58:30.514738 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739843a0-0bda-40cb-a1e9-0bbff29c92db None None] PATH_INFO: `/` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 07:58:30.516242 dv-cinder-851351-1-smb devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 62/136] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 07:58:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 07:58:30.530438 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3caa10b1-8277-40d4-b1eb-0e4e64c983e3 None None] REQUEST_METHOD: `POST` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 07:58:30.530637 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3caa10b1-8277-40d4-b1eb-0e4e64c983e3 None None] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 07:58:30.530898 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3caa10b1-8277-40d4-b1eb-0e4e64c983e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 07:58:30.534105 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 07:58:30.563711 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eacb2a7-d9a8-4be2-a411-0e24d498b043 None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 07:58:30.569962 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.auth.core [None req-3caa10b1-8277-40d4-b1eb-0e4e64c983e3 None None] MFA Rules not processed for user `f0666d3a50644a7097367331c1ee1a68`. Rule list: `[]` (Enabled: `True`). {{(pid=80348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 07:58:30.571255 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.fernet_utils [None req-3caa10b1-8277-40d4-b1eb-0e4e64c983e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 07:58:30.580627 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 07:58:30.608487 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d715f8d-ea15-4642-a9b4-5313e795dafa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 07:58:30.609390 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d715f8d-ea15-4642-a9b4-5313e795dafa None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 07:58:30.609780 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d715f8d-ea15-4642-a9b4-5313e795dafa None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 07:58:30.612694 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d715f8d-ea15-4642-a9b4-5313e795dafa None admin] PATH_INFO: `/v3/projects/1537f5accf6246559f3312e9445eb40c` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 07:58:30.612694 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d715f8d-ea15-4642-a9b4-5313e795dafa None admin] RBAC: Authorizing `identity:get_project(project_id=1537f5accf6246559f3312e9445eb40c)` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 07:58:30.614963 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d715f8d-ea15-4642-a9b4-5313e795dafa None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 07:58:30.618116 dv-cinder-851351-1-smb devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 75/137] 10.222.0.42 () {56 vars in 1186 bytes} [Thu Jul 28 07:58:30 2022] GET /identity/v3/projects/1537f5accf6246559f3312e9445eb40c => generated 312 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 07:58:30.623629 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d715f8d-ea15-4642-a9b4-5313e795dafa None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 07:58:30.739671 dv-cinder-851351-1-smb devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 63/138] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 07:58:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 07:58:30.784508 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3caa10b1-8277-40d4-b1eb-0e4e64c983e3 None None] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 07:58:30.828723 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d715f8d-ea15-4642-a9b4-5313e795dafa None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 07:58:30.879138 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5bbe70e-3716-46b4-9e8b-a6dfbe4cc21f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 07:58:30.879842 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5bbe70e-3716-46b4-9e8b-a6dfbe4cc21f None admin] REQUEST_METHOD: `PUT` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 07:58:30.880134 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5bbe70e-3716-46b4-9e8b-a6dfbe4cc21f None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 07:58:30.880411 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5bbe70e-3716-46b4-9e8b-a6dfbe4cc21f None admin] PATH_INFO: `/v3/projects/1537f5accf6246559f3312e9445eb40c/users/3e40f59d19f54db3bf0031b56994797a/roles/0317c30d81ff44eea2fd4a7215c60eac` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 07:58:30.882424 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5bbe70e-3716-46b4-9e8b-a6dfbe4cc21f None admin] RBAC: Authorizing `identity:create_grant(project_id=1537f5accf6246559f3312e9445eb40c, user_id=3e40f59d19f54db3bf0031b56994797a, role_id=0317c30d81ff44eea2fd4a7215c60eac)` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 07:58:30.883872 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5bbe70e-3716-46b4-9e8b-a6dfbe4cc21f None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 07:58:30.906914 dv-cinder-851351-1-smb devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 76/139] 10.222.0.42 () {58 vars in 1439 bytes} [Thu Jul 28 07:58:30 2022] PUT /identity/v3/projects/1537f5accf6246559f3312e9445eb40c/users/3e40f59d19f54db3bf0031b56994797a/roles/0317c30d81ff44eea2fd4a7215c60eac => generated 0 bytes in 283 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 28 07:58:30.907726 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36727acb-8fdf-4e98-bb87-eae0bbe78f35 None None] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 07:58:30.908011 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36727acb-8fdf-4e98-bb87-eae0bbe78f35 None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 07:58:30.908282 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36727acb-8fdf-4e98-bb87-eae0bbe78f35 None None] PATH_INFO: `/` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 07:58:30.910894 dv-cinder-851351-1-smb devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 77/140] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 07:58:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 07:58:30.922761 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4d4a6a-b23d-4193-bfe9-d436ce176d74 None None] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 07:58:30.923103 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4d4a6a-b23d-4193-bfe9-d436ce176d74 None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 07:58:30.923309 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4d4a6a-b23d-4193-bfe9-d436ce176d74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 07:58:30.935943 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 07:58:30.956174 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.auth.core [None req-6b4d4a6a-b23d-4193-bfe9-d436ce176d74 None None] MFA Rules not processed for user `f0666d3a50644a7097367331c1ee1a68`. Rule list: `[]` (Enabled: `True`). {{(pid=80347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 07:58:30.957871 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-6b4d4a6a-b23d-4193-bfe9-d436ce176d74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 07:58:30.971190 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3caa10b1-8277-40d4-b1eb-0e4e64c983e3 None None] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 07:58:31.030385 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a266b1aa-4185-4987-a904-4615f2734f4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 07:58:31.031168 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a266b1aa-4185-4987-a904-4615f2734f4f None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 07:58:31.031460 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a266b1aa-4185-4987-a904-4615f2734f4f None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 07:58:31.031872 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a266b1aa-4185-4987-a904-4615f2734f4f None admin] PATH_INFO: `/v3/domains/default` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 07:58:31.033794 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a266b1aa-4185-4987-a904-4615f2734f4f None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 07:58:31.035573 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a266b1aa-4185-4987-a904-4615f2734f4f None admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 07:58:31.039350 dv-cinder-851351-1-smb devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 78/141] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 07:58:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 28 07:58:31.041412 dv-cinder-851351-1-smb devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 64/142] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 07:58:30 2022] GET /identity/v3/domains/default => generated 199 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 07:58:31.047736 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4d4a6a-b23d-4193-bfe9-d436ce176d74 None None] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 07:58:31.105903 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a266b1aa-4185-4987-a904-4615f2734f4f None admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 07:58:31.132345 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=100 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 07:58:31.171037 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4d4a6a-b23d-4193-bfe9-d436ce176d74 None None] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 07:58:31.208170 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b60e6393-0edb-4309-b286-629b4513e42d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 07:58:31.208870 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60e6393-0edb-4309-b286-629b4513e42d None admin] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 07:58:31.209156 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60e6393-0edb-4309-b286-629b4513e42d None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 07:58:31.209428 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60e6393-0edb-4309-b286-629b4513e42d None admin] PATH_INFO: `/v3/users` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 07:58:31.210141 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b60e6393-0edb-4309-b286-629b4513e42d None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 07:58:31.211642 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b60e6393-0edb-4309-b286-629b4513e42d None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 07:58:31.222702 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 07:58:31.250985 dv-cinder-851351-1-smb devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 79/143] 10.222.0.42 () {60 vars in 1132 bytes} [Thu Jul 28 07:58:31 2022] POST /identity/v3/users => generated 283 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 07:58:31.298934 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a266b1aa-4185-4987-a904-4615f2734f4f None admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 07:58:31.344111 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af3bec76-ad93-4f0d-a3b7-eb24464c01ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 07:58:31.344818 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3bec76-ad93-4f0d-a3b7-eb24464c01ce None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 07:58:31.345101 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3bec76-ad93-4f0d-a3b7-eb24464c01ce None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 07:58:31.345376 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3bec76-ad93-4f0d-a3b7-eb24464c01ce None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 07:58:31.359229 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af3bec76-ad93-4f0d-a3b7-eb24464c01ce None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 07:58:31.364513 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application [None req-af3bec76-ad93-4f0d-a3b7-eb24464c01ce None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 28 07:58:31.364513 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 07:58:31.364513 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 07:58:31.364513 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 07:58:31.364513 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 07:58:31.364513 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 07:58:31.364513 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 07:58:31.364513 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 07:58:31.364513 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 07:58:31.364513 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 07:58:31.364513 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 07:58:31.364513 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 07:58:31.364513 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 07:58:31.364513 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 07:58:31.364513 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 07:58:31.364513 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 07:58:31.365516 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 07:58:31.365516 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 07:58:31.365516 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 07:58:31.365516 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 07:58:31.365516 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 07:58:31.365516 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 07:58:31.365516 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 07:58:31.365516 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 07:58:31.365516 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 07:58:31.365516 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 07:58:31.365516 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 07:58:31.365516 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application with Lock( Jul 28 07:58:31.365516 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 07:58:31.365516 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self._enter() Jul 28 07:58:31.365516 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 07:58:31.365516 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 07:58:31.366265 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 07:58:31.366265 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.creator() Jul 28 07:58:31.366265 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 07:58:31.366265 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application created_value = creator( Jul 28 07:58:31.366265 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 07:58:31.366265 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 07:58:31.366265 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 07:58:31.366265 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 07:58:31.366265 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 07:58:31.366265 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 07:58:31.366265 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 28 07:58:31.366265 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application Jul 28 07:58:31.366265 dv-cinder-851351-1-smb devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 65/144] 10.222.0.42 () {56 vars in 1099 bytes} [Thu Jul 28 07:58:31 2022] GET /identity/v3/roles/reader => generated 84 bytes in 261 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 07:58:31.373955 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b60e6393-0edb-4309-b286-629b4513e42d None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 07:58:31.529725 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b60e6393-0edb-4309-b286-629b4513e42d None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 07:58:31.569878 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e470547d-da2e-4209-95d7-37ce339ea0f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 07:58:31.570489 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e470547d-da2e-4209-95d7-37ce339ea0f2 None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 07:58:31.570712 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e470547d-da2e-4209-95d7-37ce339ea0f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 07:58:31.570992 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e470547d-da2e-4209-95d7-37ce339ea0f2 None admin] PATH_INFO: `/v3/roles` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 07:58:31.571775 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e470547d-da2e-4209-95d7-37ce339ea0f2 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 07:58:31.572078 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e470547d-da2e-4209-95d7-37ce339ea0f2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 07:58:31.573592 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e470547d-da2e-4209-95d7-37ce339ea0f2 None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 07:58:31.583810 dv-cinder-851351-1-smb devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 80/145] 10.222.0.42 () {56 vars in 1101 bytes} [Thu Jul 28 07:58:31 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 07:58:31.589556 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af3bec76-ad93-4f0d-a3b7-eb24464c01ce None admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 07:58:31.663336 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=100 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 07:58:31.705918 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af3bec76-ad93-4f0d-a3b7-eb24464c01ce None admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 07:58:31.754147 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294e9f99-d38f-49eb-b141-dc08e2753f70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 07:58:31.754813 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294e9f99-d38f-49eb-b141-dc08e2753f70 None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 07:58:31.755093 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294e9f99-d38f-49eb-b141-dc08e2753f70 None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 07:58:31.755368 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294e9f99-d38f-49eb-b141-dc08e2753f70 None admin] PATH_INFO: `/v3/users/ac2c507b345b453baa8d65b44b216574` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 07:58:31.759203 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-294e9f99-d38f-49eb-b141-dc08e2753f70 None admin] RBAC: Authorizing `identity:get_user(user_id=ac2c507b345b453baa8d65b44b216574)` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 07:58:31.761544 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-294e9f99-d38f-49eb-b141-dc08e2753f70 None admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 07:58:31.766324 dv-cinder-851351-1-smb devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 66/146] 10.222.0.42 () {56 vars in 1177 bytes} [Thu Jul 28 07:58:31 2022] GET /identity/v3/users/ac2c507b345b453baa8d65b44b216574 => generated 289 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 07:58:31.774777 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e470547d-da2e-4209-95d7-37ce339ea0f2 None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 07:58:31.836989 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 07:58:31.905433 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e470547d-da2e-4209-95d7-37ce339ea0f2 None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 07:58:31.947491 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f26e6ef-0236-447f-bc02-f56319aafe7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 07:58:31.948526 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f26e6ef-0236-447f-bc02-f56319aafe7f None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 07:58:31.949022 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f26e6ef-0236-447f-bc02-f56319aafe7f None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 07:58:31.949518 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f26e6ef-0236-447f-bc02-f56319aafe7f None admin] PATH_INFO: `/v3/projects/cdfa7c2638114a968f5357dc098b441b` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 07:58:31.952051 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f26e6ef-0236-447f-bc02-f56319aafe7f None admin] RBAC: Authorizing `identity:get_project(project_id=cdfa7c2638114a968f5357dc098b441b)` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 07:58:31.953819 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f26e6ef-0236-447f-bc02-f56319aafe7f None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 07:58:31.956066 dv-cinder-851351-1-smb devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 81/147] 10.222.0.42 () {56 vars in 1186 bytes} [Thu Jul 28 07:58:31 2022] GET /identity/v3/projects/cdfa7c2638114a968f5357dc098b441b => generated 298 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 07:58:31.962006 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294e9f99-d38f-49eb-b141-dc08e2753f70 None admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 07:58:31.963054 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a669d6-bfcb-4a5a-a1b1-cbf6b67ff295 None None] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 07:58:31.963540 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a669d6-bfcb-4a5a-a1b1-cbf6b67ff295 None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 07:58:31.964005 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a669d6-bfcb-4a5a-a1b1-cbf6b67ff295 None None] PATH_INFO: `/` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 07:58:31.965892 dv-cinder-851351-1-smb devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 82/148] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 07:58:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 07:58:31.970987 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6942e87d-dba6-492d-9088-d7eb8efaabe3 None None] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 07:58:31.971561 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6942e87d-dba6-492d-9088-d7eb8efaabe3 None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 07:58:31.972019 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6942e87d-dba6-492d-9088-d7eb8efaabe3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 07:58:31.994375 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.auth.core [None req-6942e87d-dba6-492d-9088-d7eb8efaabe3 None None] MFA Rules not processed for user `f0666d3a50644a7097367331c1ee1a68`. Rule list: `[]` (Enabled: `True`). {{(pid=80347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 07:58:31.996193 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-6942e87d-dba6-492d-9088-d7eb8efaabe3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 07:58:32.085998 dv-cinder-851351-1-smb devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 83/149] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 07:58:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 07:58:32.122603 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6942e87d-dba6-492d-9088-d7eb8efaabe3 None None] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 07:58:32.176953 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294e9f99-d38f-49eb-b141-dc08e2753f70 None admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 07:58:32.257758 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 07:58:32.257955 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d909ccd-47e0-47df-bad9-79eb8d0345a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 07:58:32.258939 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d909ccd-47e0-47df-bad9-79eb8d0345a4 None admin] REQUEST_METHOD: `PUT` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 07:58:32.259473 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d909ccd-47e0-47df-bad9-79eb8d0345a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 07:58:32.259965 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d909ccd-47e0-47df-bad9-79eb8d0345a4 None admin] PATH_INFO: `/v3/projects/cdfa7c2638114a968f5357dc098b441b/users/ac2c507b345b453baa8d65b44b216574/roles/21c3f6dd315a425a98d00fcf994f3a36` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 07:58:32.270157 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d909ccd-47e0-47df-bad9-79eb8d0345a4 None admin] RBAC: Authorizing `identity:create_grant(project_id=cdfa7c2638114a968f5357dc098b441b, user_id=ac2c507b345b453baa8d65b44b216574, role_id=21c3f6dd315a425a98d00fcf994f3a36)` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 07:58:32.272739 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d909ccd-47e0-47df-bad9-79eb8d0345a4 None admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 07:58:32.285556 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 07:58:32.307283 dv-cinder-851351-1-smb devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 67/150] 10.222.0.42 () {58 vars in 1439 bytes} [Thu Jul 28 07:58:31 2022] PUT /identity/v3/projects/cdfa7c2638114a968f5357dc098b441b/users/ac2c507b345b453baa8d65b44b216574/roles/21c3f6dd315a425a98d00fcf994f3a36 => generated 0 bytes in 346 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 07:58:32.354665 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6942e87d-dba6-492d-9088-d7eb8efaabe3 None None] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 07:58:32.406906 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac9c121-5f0f-4c3d-b435-5478c54fb8a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 07:58:32.407507 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac9c121-5f0f-4c3d-b435-5478c54fb8a7 None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 07:58:32.407784 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac9c121-5f0f-4c3d-b435-5478c54fb8a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 07:58:32.408049 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac9c121-5f0f-4c3d-b435-5478c54fb8a7 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 07:58:32.423227 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ac9c121-5f0f-4c3d-b435-5478c54fb8a7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 07:58:32.428506 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application [None req-3ac9c121-5f0f-4c3d-b435-5478c54fb8a7 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 28 07:58:32.428506 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 07:58:32.428506 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 07:58:32.428506 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 07:58:32.428506 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 07:58:32.428506 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 07:58:32.428506 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 07:58:32.428506 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 07:58:32.428506 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 07:58:32.428506 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 07:58:32.428506 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 07:58:32.428506 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 07:58:32.428506 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 07:58:32.428506 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 07:58:32.428506 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 07:58:32.428506 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 07:58:32.429466 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 07:58:32.429466 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 07:58:32.429466 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 07:58:32.429466 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 07:58:32.429466 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 07:58:32.429466 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 07:58:32.429466 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 07:58:32.429466 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 07:58:32.429466 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 07:58:32.429466 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 07:58:32.429466 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 07:58:32.429466 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application with Lock( Jul 28 07:58:32.429466 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 07:58:32.429466 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._enter() Jul 28 07:58:32.429466 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 07:58:32.429466 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 07:58:32.430212 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 07:58:32.430212 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.creator() Jul 28 07:58:32.430212 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 07:58:32.430212 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application created_value = creator( Jul 28 07:58:32.430212 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 07:58:32.430212 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 07:58:32.430212 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 07:58:32.430212 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 07:58:32.430212 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 07:58:32.430212 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 07:58:32.430212 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 28 07:58:32.430212 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application Jul 28 07:58:32.430212 dv-cinder-851351-1-smb devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 84/151] 10.222.0.42 () {56 vars in 1114 bytes} [Thu Jul 28 07:58:32 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 308 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 07:58:32.436645 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d909ccd-47e0-47df-bad9-79eb8d0345a4 None admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 07:58:32.569830 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d909ccd-47e0-47df-bad9-79eb8d0345a4 None admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 07:58:32.607541 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35baad39-1ef0-4518-9bec-694d5ddb9a9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 07:58:32.608302 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35baad39-1ef0-4518-9bec-694d5ddb9a9f None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 07:58:32.608577 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35baad39-1ef0-4518-9bec-694d5ddb9a9f None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 07:58:32.608928 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35baad39-1ef0-4518-9bec-694d5ddb9a9f None admin] PATH_INFO: `/v3/roles` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 07:58:32.609678 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35baad39-1ef0-4518-9bec-694d5ddb9a9f None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80348) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 07:58:32.609974 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35baad39-1ef0-4518-9bec-694d5ddb9a9f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 07:58:32.611366 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35baad39-1ef0-4518-9bec-694d5ddb9a9f None admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 07:58:32.625864 dv-cinder-851351-1-smb devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 68/152] 10.222.0.42 () {56 vars in 1111 bytes} [Thu Jul 28 07:58:32 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 07:58:32.631451 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac9c121-5f0f-4c3d-b435-5478c54fb8a7 None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 07:58:32.768679 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac9c121-5f0f-4c3d-b435-5478c54fb8a7 None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 07:58:32.795599 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 07:58:32.814785 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0b9c8d-b817-42a1-9cc0-46dccb4819bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 07:58:32.815451 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0b9c8d-b817-42a1-9cc0-46dccb4819bb None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 07:58:32.815724 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0b9c8d-b817-42a1-9cc0-46dccb4819bb None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 07:58:32.815995 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0b9c8d-b817-42a1-9cc0-46dccb4819bb None admin] PATH_INFO: `/v3/users/3e40f59d19f54db3bf0031b56994797a` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 07:58:32.817372 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a0b9c8d-b817-42a1-9cc0-46dccb4819bb None admin] RBAC: Authorizing `identity:get_user(user_id=3e40f59d19f54db3bf0031b56994797a)` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 07:58:32.818850 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a0b9c8d-b817-42a1-9cc0-46dccb4819bb None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 07:58:32.820793 dv-cinder-851351-1-smb devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 85/153] 10.222.0.42 () {56 vars in 1177 bytes} [Thu Jul 28 07:58:32 2022] GET /identity/v3/users/3e40f59d19f54db3bf0031b56994797a => generated 275 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 07:58:32.826377 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35baad39-1ef0-4518-9bec-694d5ddb9a9f None admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 07:58:32.925158 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=100 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 07:58:32.984093 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35baad39-1ef0-4518-9bec-694d5ddb9a9f None admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 07:58:33.043165 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7ae40b-5d19-4d3e-8d7c-d18690a632ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 07:58:33.043727 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7ae40b-5d19-4d3e-8d7c-d18690a632ea None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 07:58:33.044053 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7ae40b-5d19-4d3e-8d7c-d18690a632ea None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 07:58:33.044326 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7ae40b-5d19-4d3e-8d7c-d18690a632ea None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 07:58:33.125253 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b7ae40b-5d19-4d3e-8d7c-d18690a632ea None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 07:58:33.126774 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b7ae40b-5d19-4d3e-8d7c-d18690a632ea None admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 07:58:33.234551 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=100 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 07:58:33.298627 dv-cinder-851351-1-smb devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 69/154] 10.222.0.42 () {58 vars in 1282 bytes} [Thu Jul 28 07:58:32 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 473 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 28 07:58:33.303815 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0b9c8d-b817-42a1-9cc0-46dccb4819bb None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 07:58:33.463710 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0b9c8d-b817-42a1-9cc0-46dccb4819bb None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 07:58:33.494446 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c46555-f349-48b2-88ed-2451b881e52c None None] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 07:58:33.494767 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c46555-f349-48b2-88ed-2451b881e52c None None] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 07:58:33.494990 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c46555-f349-48b2-88ed-2451b881e52c None None] PATH_INFO: `/` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 07:58:33.496647 dv-cinder-851351-1-smb devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 70/155] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 07:58:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 07:58:33.503936 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6e4d48-550c-42c6-bbee-4afb66a3d608 None None] REQUEST_METHOD: `POST` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 07:58:33.504214 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6e4d48-550c-42c6-bbee-4afb66a3d608 None None] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 07:58:33.504484 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6e4d48-550c-42c6-bbee-4afb66a3d608 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 07:58:33.527586 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a179d9-3f13-4f6b-b6dc-2a9c41395140 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 07:58:33.528259 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a179d9-3f13-4f6b-b6dc-2a9c41395140 None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 07:58:33.528534 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a179d9-3f13-4f6b-b6dc-2a9c41395140 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 07:58:33.528832 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a179d9-3f13-4f6b-b6dc-2a9c41395140 None admin] PATH_INFO: `/v3/projects/cdfa7c2638114a968f5357dc098b441b` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 07:58:33.530090 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4a179d9-3f13-4f6b-b6dc-2a9c41395140 None admin] RBAC: Authorizing `identity:get_project(project_id=cdfa7c2638114a968f5357dc098b441b)` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 07:58:33.531576 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4a179d9-3f13-4f6b-b6dc-2a9c41395140 None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 07:58:33.542128 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.auth.core [None req-4c6e4d48-550c-42c6-bbee-4afb66a3d608 None None] MFA Rules not processed for user `f0666d3a50644a7097367331c1ee1a68`. Rule list: `[]` (Enabled: `True`). {{(pid=80348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 07:58:33.543618 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.fernet_utils [None req-4c6e4d48-550c-42c6-bbee-4afb66a3d608 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 07:58:33.546864 dv-cinder-851351-1-smb devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 86/156] 10.222.0.42 () {56 vars in 1186 bytes} [Thu Jul 28 07:58:33 2022] GET /identity/v3/projects/cdfa7c2638114a968f5357dc098b441b => generated 298 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 07:58:33.558770 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a179d9-3f13-4f6b-b6dc-2a9c41395140 None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 07:58:33.642283 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 07:58:33.726107 dv-cinder-851351-1-smb devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 71/157] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 07:58:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 28 07:58:33.729771 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a179d9-3f13-4f6b-b6dc-2a9c41395140 None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 07:58:33.781099 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7fa3d2d-95a2-42cd-9a7c-b253e993c513 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 07:58:33.781745 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7fa3d2d-95a2-42cd-9a7c-b253e993c513 None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 07:58:33.782002 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7fa3d2d-95a2-42cd-9a7c-b253e993c513 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 07:58:33.782287 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7fa3d2d-95a2-42cd-9a7c-b253e993c513 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 07:58:33.783093 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7fa3d2d-95a2-42cd-9a7c-b253e993c513 None admin] RBAC: Adding query filter params (role.id=f28d669937b942878bcf6a9103012af9, scope.project.id=cdfa7c2638114a968f5357dc098b441b, user.id=3e40f59d19f54db3bf0031b56994797a) {{(pid=80347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 07:58:33.783398 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7fa3d2d-95a2-42cd-9a7c-b253e993c513 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 07:58:33.784893 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7fa3d2d-95a2-42cd-9a7c-b253e993c513 None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 07:58:33.797378 dv-cinder-851351-1-smb devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 87/158] 10.222.0.42 () {56 vars in 1374 bytes} [Thu Jul 28 07:58:33 2022] GET /identity/v3/role_assignments?user.id=3e40f59d19f54db3bf0031b56994797a&scope.project.id=cdfa7c2638114a968f5357dc098b441b&role.id=f28d669937b942878bcf6a9103012af9 => generated 608 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 07:58:33.798190 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6e4d48-550c-42c6-bbee-4afb66a3d608 None None] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 07:58:33.953638 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5736f81-4e4f-4732-bc62-9e78eb4a878b None None] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 07:58:33.954001 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5736f81-4e4f-4732-bc62-9e78eb4a878b None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 07:58:33.954199 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5736f81-4e4f-4732-bc62-9e78eb4a878b None None] PATH_INFO: `/` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 07:58:33.955885 dv-cinder-851351-1-smb devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 88/159] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 07:58:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 07:58:33.960012 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=100 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 07:58:33.961889 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6f5ae6-1cbd-4215-87b9-c3cd717e5b7c None None] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 07:58:33.962172 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6f5ae6-1cbd-4215-87b9-c3cd717e5b7c None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 07:58:33.962453 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6f5ae6-1cbd-4215-87b9-c3cd717e5b7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 07:58:33.976178 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6e4d48-550c-42c6-bbee-4afb66a3d608 None None] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 07:58:34.000724 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.auth.core [None req-0a6f5ae6-1cbd-4215-87b9-c3cd717e5b7c None None] MFA Rules not processed for user `f0666d3a50644a7097367331c1ee1a68`. Rule list: `[]` (Enabled: `True`). {{(pid=80347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 07:58:34.001959 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-0a6f5ae6-1cbd-4215-87b9-c3cd717e5b7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 07:58:34.057394 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b75902-99bd-45b5-8d30-6959c0d007e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 07:58:34.058097 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b75902-99bd-45b5-8d30-6959c0d007e3 None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 07:58:34.058380 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b75902-99bd-45b5-8d30-6959c0d007e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 07:58:34.058656 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b75902-99bd-45b5-8d30-6959c0d007e3 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 07:58:34.089748 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3b75902-99bd-45b5-8d30-6959c0d007e3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 07:58:34.095020 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application [None req-c3b75902-99bd-45b5-8d30-6959c0d007e3 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 28 07:58:34.095020 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 07:58:34.095020 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 07:58:34.095020 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 07:58:34.095020 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 07:58:34.095020 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 07:58:34.095020 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 07:58:34.095020 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 07:58:34.095020 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 07:58:34.095020 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 07:58:34.095020 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 07:58:34.095020 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 07:58:34.095020 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 07:58:34.095020 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 07:58:34.095020 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 07:58:34.095020 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 07:58:34.096003 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 07:58:34.096003 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 07:58:34.096003 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 07:58:34.096003 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 07:58:34.096003 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 07:58:34.096003 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 07:58:34.096003 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 07:58:34.096003 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 07:58:34.096003 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 07:58:34.096003 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 07:58:34.096003 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 07:58:34.096003 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application with Lock( Jul 28 07:58:34.096003 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 07:58:34.096003 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self._enter() Jul 28 07:58:34.096003 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 07:58:34.096003 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 07:58:34.096776 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 07:58:34.096776 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.creator() Jul 28 07:58:34.096776 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 07:58:34.096776 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application created_value = creator( Jul 28 07:58:34.096776 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 07:58:34.096776 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 07:58:34.096776 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 07:58:34.096776 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 07:58:34.096776 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 07:58:34.096776 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 07:58:34.096776 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 28 07:58:34.096776 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application Jul 28 07:58:34.096776 dv-cinder-851351-1-smb devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 72/160] 10.222.0.42 () {56 vars in 1099 bytes} [Thu Jul 28 07:58:33 2022] GET /identity/v3/roles/member => generated 84 bytes in 299 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 07:58:34.103797 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b75902-99bd-45b5-8d30-6959c0d007e3 None admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 07:58:34.136519 dv-cinder-851351-1-smb devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 89/161] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 07:58:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 28 07:58:34.183693 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6f5ae6-1cbd-4215-87b9-c3cd717e5b7c None None] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 07:58:34.281139 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 07:58:34.350978 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b75902-99bd-45b5-8d30-6959c0d007e3 None admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 07:58:34.419446 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6f5ae6-1cbd-4215-87b9-c3cd717e5b7c None None] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 07:58:34.441984 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b337a98d-2dd4-4aa9-b079-5c7f784c2786 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 07:58:34.442915 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b337a98d-2dd4-4aa9-b079-5c7f784c2786 None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 07:58:34.443337 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b337a98d-2dd4-4aa9-b079-5c7f784c2786 None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 07:58:34.443756 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b337a98d-2dd4-4aa9-b079-5c7f784c2786 None admin] PATH_INFO: `/v3/roles` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 07:58:34.444635 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b337a98d-2dd4-4aa9-b079-5c7f784c2786 None admin] RBAC: Adding query filter params (name=member) {{(pid=80348) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 07:58:34.445091 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b337a98d-2dd4-4aa9-b079-5c7f784c2786 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 07:58:34.446623 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b337a98d-2dd4-4aa9-b079-5c7f784c2786 None admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 07:58:34.471282 dv-cinder-851351-1-smb devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 73/162] 10.222.0.42 () {56 vars in 1101 bytes} [Thu Jul 28 07:58:34 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 368 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 07:58:34.472526 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d2ccfb-5200-4eed-9098-ccdafb6d134f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 07:58:34.473339 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d2ccfb-5200-4eed-9098-ccdafb6d134f None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 07:58:34.473708 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d2ccfb-5200-4eed-9098-ccdafb6d134f None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 07:58:34.474084 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d2ccfb-5200-4eed-9098-ccdafb6d134f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 07:58:34.489993 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28d2ccfb-5200-4eed-9098-ccdafb6d134f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 07:58:34.491270 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b337a98d-2dd4-4aa9-b079-5c7f784c2786 None admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 07:58:34.495561 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application [None req-28d2ccfb-5200-4eed-9098-ccdafb6d134f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 07:58:34.495561 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 07:58:34.495561 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 07:58:34.495561 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 07:58:34.495561 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 07:58:34.495561 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 07:58:34.495561 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 07:58:34.495561 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 07:58:34.495561 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 07:58:34.495561 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 07:58:34.495561 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 07:58:34.495561 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 07:58:34.495561 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 07:58:34.495561 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 07:58:34.495561 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 07:58:34.495561 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 07:58:34.496436 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 07:58:34.496436 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 07:58:34.496436 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 07:58:34.496436 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 07:58:34.496436 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 07:58:34.496436 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 07:58:34.496436 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 07:58:34.496436 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 07:58:34.496436 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 07:58:34.496436 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 07:58:34.496436 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 07:58:34.496436 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application with Lock( Jul 28 07:58:34.496436 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 07:58:34.496436 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._enter() Jul 28 07:58:34.496436 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 07:58:34.496436 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 07:58:34.497230 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 07:58:34.497230 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.creator() Jul 28 07:58:34.497230 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 07:58:34.497230 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application created_value = creator( Jul 28 07:58:34.497230 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 07:58:34.497230 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 07:58:34.497230 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 07:58:34.497230 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 07:58:34.497230 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 07:58:34.497230 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 07:58:34.497230 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 07:58:34.497230 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application Jul 28 07:58:34.504632 dv-cinder-851351-1-smb devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 90/163] 10.222.0.42 () {56 vars in 1096 bytes} [Thu Jul 28 07:58:34 2022] GET /identity/v3/roles/admin => generated 83 bytes in 321 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 07:58:34.505841 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d2ccfb-5200-4eed-9098-ccdafb6d134f None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 07:58:34.522547 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=100 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 07:58:34.654597 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 07:58:34.658555 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d2ccfb-5200-4eed-9098-ccdafb6d134f None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 07:58:34.677512 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b337a98d-2dd4-4aa9-b079-5c7f784c2786 None admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 07:58:34.709813 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a772532-316c-444f-a59b-840efbe6fcbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 07:58:34.710716 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a772532-316c-444f-a59b-840efbe6fcbd None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 07:58:34.711141 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a772532-316c-444f-a59b-840efbe6fcbd None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 07:58:34.711579 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a772532-316c-444f-a59b-840efbe6fcbd None admin] PATH_INFO: `/v3/roles` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 07:58:34.712464 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a772532-316c-444f-a59b-840efbe6fcbd None admin] RBAC: Adding query filter params (name=admin) {{(pid=80347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 07:58:34.712941 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a772532-316c-444f-a59b-840efbe6fcbd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 07:58:34.714587 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a772532-316c-444f-a59b-840efbe6fcbd None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 07:58:34.728418 dv-cinder-851351-1-smb devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 91/164] 10.222.0.42 () {56 vars in 1099 bytes} [Thu Jul 28 07:58:34 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 07:58:34.734739 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a772532-316c-444f-a59b-840efbe6fcbd None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 07:58:34.738774 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d701fa-2344-4ea6-b9ab-96ed5d08aa92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 07:58:34.740017 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d701fa-2344-4ea6-b9ab-96ed5d08aa92 None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 07:58:34.740456 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d701fa-2344-4ea6-b9ab-96ed5d08aa92 None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 07:58:34.740894 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d701fa-2344-4ea6-b9ab-96ed5d08aa92 None admin] PATH_INFO: `/v3/users/3e40f59d19f54db3bf0031b56994797a` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 07:58:34.745510 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5d701fa-2344-4ea6-b9ab-96ed5d08aa92 None admin] RBAC: Authorizing `identity:get_user(user_id=3e40f59d19f54db3bf0031b56994797a)` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 07:58:34.747207 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5d701fa-2344-4ea6-b9ab-96ed5d08aa92 None admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 07:58:34.749215 dv-cinder-851351-1-smb devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 74/165] 10.222.0.42 () {56 vars in 1177 bytes} [Thu Jul 28 07:58:34 2022] GET /identity/v3/users/3e40f59d19f54db3bf0031b56994797a => generated 275 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 07:58:34.765770 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d701fa-2344-4ea6-b9ab-96ed5d08aa92 None admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 07:58:34.897312 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a772532-316c-444f-a59b-840efbe6fcbd None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 07:58:34.906573 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=100 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 07:58:34.957504 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d701fa-2344-4ea6-b9ab-96ed5d08aa92 None admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 07:58:34.970018 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3f7fbd-09fa-4158-a82a-dd01c0b7b6f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 07:58:34.970697 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3f7fbd-09fa-4158-a82a-dd01c0b7b6f9 None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 07:58:34.970975 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3f7fbd-09fa-4158-a82a-dd01c0b7b6f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 07:58:34.971248 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3f7fbd-09fa-4158-a82a-dd01c0b7b6f9 None admin] PATH_INFO: `/v3/users/f0666d3a50644a7097367331c1ee1a68` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 07:58:34.974881 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc3f7fbd-09fa-4158-a82a-dd01c0b7b6f9 None admin] RBAC: Authorizing `identity:get_user(user_id=f0666d3a50644a7097367331c1ee1a68)` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 07:58:34.976395 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc3f7fbd-09fa-4158-a82a-dd01c0b7b6f9 None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 07:58:34.980364 dv-cinder-851351-1-smb devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 92/166] 10.222.0.42 () {56 vars in 1177 bytes} [Thu Jul 28 07:58:34 2022] GET /identity/v3/users/f0666d3a50644a7097367331c1ee1a68 => generated 247 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 07:58:34.987663 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2283d6c7-ab87-4f2e-a6d8-efe8ba136bfa None None] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 07:58:34.989227 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2283d6c7-ab87-4f2e-a6d8-efe8ba136bfa None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 07:58:34.989510 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2283d6c7-ab87-4f2e-a6d8-efe8ba136bfa None None] PATH_INFO: `/` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 07:58:34.991023 dv-cinder-851351-1-smb devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 93/167] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 07:58:34 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 07:58:34.993251 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2283d6c7-ab87-4f2e-a6d8-efe8ba136bfa None None] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 07:58:35.053020 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 07:58:35.053454 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe8cab7-1579-40f5-b883-53a8af2cf86b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 07:58:35.054227 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe8cab7-1579-40f5-b883-53a8af2cf86b None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 07:58:35.054400 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe8cab7-1579-40f5-b883-53a8af2cf86b None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 07:58:35.054628 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe8cab7-1579-40f5-b883-53a8af2cf86b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 07:58:35.224252 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe8cab7-1579-40f5-b883-53a8af2cf86b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 07:58:35.225802 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe8cab7-1579-40f5-b883-53a8af2cf86b None admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 07:58:35.230153 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2283d6c7-ab87-4f2e-a6d8-efe8ba136bfa None None] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 07:58:35.317385 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d831421c-c6c2-4510-ab58-c7295d29b5b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 07:58:35.318028 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d831421c-c6c2-4510-ab58-c7295d29b5b2 None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 07:58:35.318300 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d831421c-c6c2-4510-ab58-c7295d29b5b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 07:58:35.318561 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d831421c-c6c2-4510-ab58-c7295d29b5b2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 07:58:35.417063 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=100 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 07:58:35.439638 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d831421c-c6c2-4510-ab58-c7295d29b5b2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 07:58:35.441101 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d831421c-c6c2-4510-ab58-c7295d29b5b2 None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 07:58:35.469993 dv-cinder-851351-1-smb devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 75/168] 10.222.0.42 () {58 vars in 1282 bytes} [Thu Jul 28 07:58:34 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 705 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 28 07:58:35.471301 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6a0edb-a167-471d-9997-740897b2afe9 None None] REQUEST_METHOD: `POST` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 07:58:35.471589 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6a0edb-a167-471d-9997-740897b2afe9 None None] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 07:58:35.471861 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6a0edb-a167-471d-9997-740897b2afe9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 07:58:35.517046 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 07:58:35.525754 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.auth.core [None req-5b6a0edb-a167-471d-9997-740897b2afe9 None None] MFA Rules not processed for user `f0666d3a50644a7097367331c1ee1a68`. Rule list: `[]` (Enabled: `True`). {{(pid=80348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 07:58:35.527002 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.fernet_utils [None req-5b6a0edb-a167-471d-9997-740897b2afe9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 07:58:35.619832 dv-cinder-851351-1-smb devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 94/169] 10.222.0.42 () {58 vars in 1282 bytes} [Thu Jul 28 07:58:34 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 627 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 28 07:58:35.620750 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d831421c-c6c2-4510-ab58-c7295d29b5b2 None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 07:58:35.673483 dv-cinder-851351-1-smb devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 76/170] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 07:58:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 07:58:35.675082 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2c3e41-9507-4067-8a40-3b275edebe95 None None] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 07:58:35.676197 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2c3e41-9507-4067-8a40-3b275edebe95 None None] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 07:58:35.676798 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2c3e41-9507-4067-8a40-3b275edebe95 None None] PATH_INFO: `/` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 07:58:35.679502 dv-cinder-851351-1-smb devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 77/171] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 07:58:35 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 07:58:35.685221 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa2c3e41-9507-4067-8a40-3b275edebe95 None None] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 07:58:35.836136 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d831421c-c6c2-4510-ab58-c7295d29b5b2 None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 07:58:35.880177 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa2c3e41-9507-4067-8a40-3b275edebe95 None None] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 07:58:35.897052 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=100 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 07:58:35.900331 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 07:58:35.912518 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce32c9d1-9f1f-49e0-b788-3a60f72a4b3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 07:58:35.913242 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce32c9d1-9f1f-49e0-b788-3a60f72a4b3b None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 07:58:35.913518 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce32c9d1-9f1f-49e0-b788-3a60f72a4b3b None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 07:58:35.914561 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce32c9d1-9f1f-49e0-b788-3a60f72a4b3b None admin] PATH_INFO: `/v3/projects/cdfa7c2638114a968f5357dc098b441b` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 07:58:35.916011 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce32c9d1-9f1f-49e0-b788-3a60f72a4b3b None admin] RBAC: Authorizing `identity:get_project(project_id=cdfa7c2638114a968f5357dc098b441b)` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 07:58:35.918068 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce32c9d1-9f1f-49e0-b788-3a60f72a4b3b None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 07:58:35.919824 dv-cinder-851351-1-smb devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 95/172] 10.222.0.42 () {56 vars in 1186 bytes} [Thu Jul 28 07:58:35 2022] GET /identity/v3/projects/cdfa7c2638114a968f5357dc098b441b => generated 298 bytes in 299 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 07:58:35.921208 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c2be8d-6f2a-4d1f-ad1c-225f48c894f9 None None] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 07:58:35.921501 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c2be8d-6f2a-4d1f-ad1c-225f48c894f9 None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 07:58:35.921775 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c2be8d-6f2a-4d1f-ad1c-225f48c894f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 07:58:35.943401 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.auth.core [None req-52c2be8d-6f2a-4d1f-ad1c-225f48c894f9 None None] MFA Rules not processed for user `f0666d3a50644a7097367331c1ee1a68`. Rule list: `[]` (Enabled: `True`). {{(pid=80347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 07:58:35.944827 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-52c2be8d-6f2a-4d1f-ad1c-225f48c894f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 07:58:35.958275 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7cb8a22-5d69-4382-88a2-0977ff68888b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 07:58:35.959218 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7cb8a22-5d69-4382-88a2-0977ff68888b None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 07:58:35.959491 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7cb8a22-5d69-4382-88a2-0977ff68888b None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 07:58:35.959760 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7cb8a22-5d69-4382-88a2-0977ff68888b None admin] PATH_INFO: `/v3/projects/cdfa7c2638114a968f5357dc098b441b` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 07:58:35.965456 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7cb8a22-5d69-4382-88a2-0977ff68888b None admin] RBAC: Authorizing `identity:get_project(project_id=cdfa7c2638114a968f5357dc098b441b)` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 07:58:35.966940 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7cb8a22-5d69-4382-88a2-0977ff68888b None admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 07:58:35.968817 dv-cinder-851351-1-smb devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 78/173] 10.222.0.42 () {56 vars in 1186 bytes} [Thu Jul 28 07:58:35 2022] GET /identity/v3/projects/cdfa7c2638114a968f5357dc098b441b => generated 298 bytes in 288 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 07:58:35.972075 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7cb8a22-5d69-4382-88a2-0977ff68888b None admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 07:58:36.061243 dv-cinder-851351-1-smb devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 96/174] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 07:58:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 07:58:36.062034 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c2be8d-6f2a-4d1f-ad1c-225f48c894f9 None None] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 07:58:36.116132 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7cb8a22-5d69-4382-88a2-0977ff68888b None admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 07:58:36.156916 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685f9ca5-f385-4e2a-8cbf-0ba162f0ff0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 07:58:36.157661 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685f9ca5-f385-4e2a-8cbf-0ba162f0ff0d None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 07:58:36.157990 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685f9ca5-f385-4e2a-8cbf-0ba162f0ff0d None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 07:58:36.158264 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685f9ca5-f385-4e2a-8cbf-0ba162f0ff0d None admin] PATH_INFO: `/v3/roles/member` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 07:58:36.171232 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-685f9ca5-f385-4e2a-8cbf-0ba162f0ff0d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 07:58:36.176520 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application [None req-685f9ca5-f385-4e2a-8cbf-0ba162f0ff0d None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 28 07:58:36.176520 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 07:58:36.176520 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 07:58:36.176520 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 07:58:36.176520 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 07:58:36.176520 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 07:58:36.176520 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 07:58:36.176520 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 07:58:36.176520 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 07:58:36.176520 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 07:58:36.176520 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 07:58:36.176520 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 07:58:36.176520 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 07:58:36.176520 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 07:58:36.176520 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 07:58:36.176520 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 07:58:36.177612 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 07:58:36.177612 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 07:58:36.177612 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 07:58:36.177612 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 07:58:36.177612 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 07:58:36.177612 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 07:58:36.177612 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 07:58:36.177612 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 07:58:36.177612 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 07:58:36.177612 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 07:58:36.177612 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 07:58:36.177612 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application with Lock( Jul 28 07:58:36.177612 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 07:58:36.177612 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self._enter() Jul 28 07:58:36.177612 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 07:58:36.177612 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 07:58:36.178475 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 07:58:36.178475 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.creator() Jul 28 07:58:36.178475 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 07:58:36.178475 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application created_value = creator( Jul 28 07:58:36.178475 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 07:58:36.178475 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 07:58:36.178475 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 07:58:36.178475 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 07:58:36.178475 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 07:58:36.178475 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 07:58:36.178475 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 28 07:58:36.178475 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application Jul 28 07:58:36.178475 dv-cinder-851351-1-smb devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 79/175] 10.222.0.42 () {56 vars in 1099 bytes} [Thu Jul 28 07:58:35 2022] GET /identity/v3/roles/member => generated 84 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 07:58:36.179119 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685f9ca5-f385-4e2a-8cbf-0ba162f0ff0d None admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 07:58:36.189608 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c2be8d-6f2a-4d1f-ad1c-225f48c894f9 None None] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 07:58:36.216605 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 07:58:36.221366 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=100 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 07:58:36.224945 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5b0426-8373-45eb-902a-678cb14014dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 07:58:36.225565 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5b0426-8373-45eb-902a-678cb14014dc None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 07:58:36.225839 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5b0426-8373-45eb-902a-678cb14014dc None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 07:58:36.226102 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5b0426-8373-45eb-902a-678cb14014dc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 07:58:36.226894 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a5b0426-8373-45eb-902a-678cb14014dc None admin] RBAC: Adding query filter params (role.id=0317c30d81ff44eea2fd4a7215c60eac, scope.project.id=cdfa7c2638114a968f5357dc098b441b, user.id=3e40f59d19f54db3bf0031b56994797a) {{(pid=80347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 07:58:36.227194 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a5b0426-8373-45eb-902a-678cb14014dc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 07:58:36.228629 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a5b0426-8373-45eb-902a-678cb14014dc None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 07:58:36.234464 dv-cinder-851351-1-smb devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 97/176] 10.222.0.42 () {56 vars in 1374 bytes} [Thu Jul 28 07:58:36 2022] GET /identity/v3/role_assignments?user.id=3e40f59d19f54db3bf0031b56994797a&scope.project.id=cdfa7c2638114a968f5357dc098b441b&role.id=0317c30d81ff44eea2fd4a7215c60eac => generated 608 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 07:58:36.235688 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3bfa87-5781-4dca-bc4a-87253b35ed22 None None] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 07:58:36.235971 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3bfa87-5781-4dca-bc4a-87253b35ed22 None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 07:58:36.236253 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3bfa87-5781-4dca-bc4a-87253b35ed22 None None] PATH_INFO: `/` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 07:58:36.237482 dv-cinder-851351-1-smb devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 98/177] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 07:58:36 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 07:58:36.242817 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3bfa87-5781-4dca-bc4a-87253b35ed22 None None] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 07:58:36.295472 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685f9ca5-f385-4e2a-8cbf-0ba162f0ff0d None admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 07:58:36.336231 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d0d0ca-ec21-49d2-91f4-9eb0e2b9113c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 07:58:36.336866 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d0d0ca-ec21-49d2-91f4-9eb0e2b9113c None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 07:58:36.337162 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d0d0ca-ec21-49d2-91f4-9eb0e2b9113c None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 07:58:36.337414 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d0d0ca-ec21-49d2-91f4-9eb0e2b9113c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 07:58:36.338235 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75d0d0ca-ec21-49d2-91f4-9eb0e2b9113c None admin] RBAC: Adding query filter params (role.id=362bd71ac01249fb8fa635381993eec1, scope.project.id=cdfa7c2638114a968f5357dc098b441b, user.id=f0666d3a50644a7097367331c1ee1a68) {{(pid=80348) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 07:58:36.338519 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75d0d0ca-ec21-49d2-91f4-9eb0e2b9113c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 07:58:36.340041 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75d0d0ca-ec21-49d2-91f4-9eb0e2b9113c None admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 07:58:36.346768 dv-cinder-851351-1-smb devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 80/178] 10.222.0.42 () {56 vars in 1374 bytes} [Thu Jul 28 07:58:36 2022] GET /identity/v3/role_assignments?user.id=f0666d3a50644a7097367331c1ee1a68&scope.project.id=cdfa7c2638114a968f5357dc098b441b&role.id=362bd71ac01249fb8fa635381993eec1 => generated 608 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 07:58:36.354065 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d0d0ca-ec21-49d2-91f4-9eb0e2b9113c None admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 07:58:36.370905 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3bfa87-5781-4dca-bc4a-87253b35ed22 None None] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 07:58:36.422619 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4fdcd0d-0d9e-45ff-9b1a-1aad6f2a7e06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 07:58:36.423602 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4fdcd0d-0d9e-45ff-9b1a-1aad6f2a7e06 None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 07:58:36.423880 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4fdcd0d-0d9e-45ff-9b1a-1aad6f2a7e06 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 07:58:36.424158 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4fdcd0d-0d9e-45ff-9b1a-1aad6f2a7e06 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 07:58:36.438851 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4fdcd0d-0d9e-45ff-9b1a-1aad6f2a7e06 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 07:58:36.446919 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application [None req-d4fdcd0d-0d9e-45ff-9b1a-1aad6f2a7e06 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 07:58:36.446919 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 07:58:36.446919 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 07:58:36.446919 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 07:58:36.446919 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 07:58:36.446919 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 07:58:36.446919 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 07:58:36.446919 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 07:58:36.446919 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 07:58:36.446919 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 07:58:36.446919 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 07:58:36.446919 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 07:58:36.446919 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 07:58:36.446919 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 07:58:36.446919 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 07:58:36.446919 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 07:58:36.447869 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 07:58:36.447869 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 07:58:36.447869 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 07:58:36.447869 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 07:58:36.447869 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 07:58:36.447869 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 07:58:36.447869 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 07:58:36.447869 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 07:58:36.447869 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 07:58:36.447869 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 07:58:36.447869 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 07:58:36.447869 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application with Lock( Jul 28 07:58:36.447869 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 07:58:36.447869 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._enter() Jul 28 07:58:36.447869 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 07:58:36.447869 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 07:58:36.448636 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 07:58:36.448636 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.creator() Jul 28 07:58:36.448636 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 07:58:36.448636 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application created_value = creator( Jul 28 07:58:36.448636 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 07:58:36.448636 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 07:58:36.448636 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 07:58:36.448636 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 07:58:36.448636 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 07:58:36.448636 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 07:58:36.448636 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 07:58:36.448636 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application Jul 28 07:58:36.448636 dv-cinder-851351-1-smb devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 99/179] 10.222.0.42 () {56 vars in 1096 bytes} [Thu Jul 28 07:58:36 2022] GET /identity/v3/roles/admin => generated 83 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 07:58:36.449858 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9795314-ea07-4f26-8eab-88af4447c95a None None] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 07:58:36.450018 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9795314-ea07-4f26-8eab-88af4447c95a None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 07:58:36.450292 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9795314-ea07-4f26-8eab-88af4447c95a None None] PATH_INFO: `/` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 07:58:36.451704 dv-cinder-851351-1-smb devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 100/180] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 07:58:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 07:58:36.455614 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aff73b3-a1f8-47be-8d5f-b4b995b9a93e None None] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 07:58:36.455614 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aff73b3-a1f8-47be-8d5f-b4b995b9a93e None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 07:58:36.455614 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aff73b3-a1f8-47be-8d5f-b4b995b9a93e None None] PATH_INFO: `/` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 07:58:36.456949 dv-cinder-851351-1-smb devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 101/181] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 07:58:36 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 07:58:36.458755 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ca9ef2-96dc-4454-b2a3-3ca2a30c95da None None] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 07:58:36.459257 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ca9ef2-96dc-4454-b2a3-3ca2a30c95da None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 07:58:36.459705 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ca9ef2-96dc-4454-b2a3-3ca2a30c95da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 07:58:36.483100 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.auth.core [None req-b4ca9ef2-96dc-4454-b2a3-3ca2a30c95da None None] MFA Rules not processed for user `f0666d3a50644a7097367331c1ee1a68`. Rule list: `[]` (Enabled: `True`). {{(pid=80347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 07:58:36.484343 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-b4ca9ef2-96dc-4454-b2a3-3ca2a30c95da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 07:58:36.500046 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=100 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 07:58:36.505091 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d0d0ca-ec21-49d2-91f4-9eb0e2b9113c None admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 07:58:36.546756 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 07:58:36.546950 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5163eb2-1de2-45c6-9432-0e5a508732a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 07:58:36.546950 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5163eb2-1de2-45c6-9432-0e5a508732a2 None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 07:58:36.546950 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5163eb2-1de2-45c6-9432-0e5a508732a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 07:58:36.547543 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5163eb2-1de2-45c6-9432-0e5a508732a2 None admin] PATH_INFO: `/v3/roles` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 07:58:36.547967 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5163eb2-1de2-45c6-9432-0e5a508732a2 None admin] RBAC: Adding query filter params (name=member) {{(pid=80348) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 07:58:36.548230 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5163eb2-1de2-45c6-9432-0e5a508732a2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 07:58:36.549670 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5163eb2-1de2-45c6-9432-0e5a508732a2 None admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 07:58:36.559563 dv-cinder-851351-1-smb devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 81/182] 10.222.0.42 () {56 vars in 1101 bytes} [Thu Jul 28 07:58:36 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 07:58:36.560408 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5163eb2-1de2-45c6-9432-0e5a508732a2 None admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 07:58:36.572876 dv-cinder-851351-1-smb devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 102/183] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 07:58:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 07:58:36.574785 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75836de-786b-4b28-98a6-b7a0a07abb65 None None] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 07:58:36.575137 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75836de-786b-4b28-98a6-b7a0a07abb65 None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 07:58:36.575417 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75836de-786b-4b28-98a6-b7a0a07abb65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 07:58:36.601976 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.auth.core [None req-e75836de-786b-4b28-98a6-b7a0a07abb65 None None] MFA Rules not processed for user `f0666d3a50644a7097367331c1ee1a68`. Rule list: `[]` (Enabled: `True`). {{(pid=80347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 07:58:36.603168 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-e75836de-786b-4b28-98a6-b7a0a07abb65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 07:58:36.670490 dv-cinder-851351-1-smb devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 103/184] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 07:58:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 07:58:36.671684 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863162ac-6210-4493-87b6-bf9d845d7d68 None None] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 07:58:36.671965 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863162ac-6210-4493-87b6-bf9d845d7d68 None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 07:58:36.672236 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863162ac-6210-4493-87b6-bf9d845d7d68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 07:58:36.673380 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5163eb2-1de2-45c6-9432-0e5a508732a2 None admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 07:58:36.689386 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.auth.core [None req-863162ac-6210-4493-87b6-bf9d845d7d68 None None] MFA Rules not processed for user `f0666d3a50644a7097367331c1ee1a68`. Rule list: `[]` (Enabled: `True`). {{(pid=80347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 07:58:36.690582 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-863162ac-6210-4493-87b6-bf9d845d7d68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 07:58:36.708489 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f7ae4a-a46e-4e12-a3af-1f1d42007eb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 07:58:36.709147 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f7ae4a-a46e-4e12-a3af-1f1d42007eb2 None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 07:58:36.709420 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f7ae4a-a46e-4e12-a3af-1f1d42007eb2 None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 07:58:36.709687 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f7ae4a-a46e-4e12-a3af-1f1d42007eb2 None admin] PATH_INFO: `/v3/roles` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 07:58:36.710438 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f7ae4a-a46e-4e12-a3af-1f1d42007eb2 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80348) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 07:58:36.710729 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f7ae4a-a46e-4e12-a3af-1f1d42007eb2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 07:58:36.712124 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f7ae4a-a46e-4e12-a3af-1f1d42007eb2 None admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 07:58:36.721052 dv-cinder-851351-1-smb devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 82/185] 10.222.0.42 () {56 vars in 1099 bytes} [Thu Jul 28 07:58:36 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 07:58:36.721921 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f7ae4a-a46e-4e12-a3af-1f1d42007eb2 None admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 07:58:36.746650 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=100 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 07:58:36.758536 dv-cinder-851351-1-smb devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 104/186] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 07:58:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 07:58:36.759185 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-863162ac-6210-4493-87b6-bf9d845d7d68 None None] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 07:58:36.810107 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 07:58:36.822359 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f7ae4a-a46e-4e12-a3af-1f1d42007eb2 None admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 07:58:36.855227 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa22842-5e33-4193-bf68-9ef721418e04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 07:58:36.855865 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa22842-5e33-4193-bf68-9ef721418e04 None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 07:58:36.856139 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa22842-5e33-4193-bf68-9ef721418e04 None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 07:58:36.856402 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa22842-5e33-4193-bf68-9ef721418e04 None admin] PATH_INFO: `/v3/users/3e40f59d19f54db3bf0031b56994797a` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 07:58:36.857684 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffa22842-5e33-4193-bf68-9ef721418e04 None admin] RBAC: Authorizing `identity:get_user(user_id=3e40f59d19f54db3bf0031b56994797a)` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 07:58:36.859062 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffa22842-5e33-4193-bf68-9ef721418e04 None admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 07:58:36.860685 dv-cinder-851351-1-smb devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 83/187] 10.222.0.42 () {56 vars in 1177 bytes} [Thu Jul 28 07:58:36 2022] GET /identity/v3/users/3e40f59d19f54db3bf0031b56994797a => generated 275 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 07:58:36.866158 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa22842-5e33-4193-bf68-9ef721418e04 None admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 07:58:36.866670 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-863162ac-6210-4493-87b6-bf9d845d7d68 None None] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 07:58:36.899358 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e307d38-d8b7-4e10-b180-fa3a566d37b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 07:58:36.900000 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e307d38-d8b7-4e10-b180-fa3a566d37b9 None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 07:58:36.900273 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e307d38-d8b7-4e10-b180-fa3a566d37b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 07:58:36.900538 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e307d38-d8b7-4e10-b180-fa3a566d37b9 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 07:58:36.910888 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e307d38-d8b7-4e10-b180-fa3a566d37b9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 07:58:36.915837 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application [None req-3e307d38-d8b7-4e10-b180-fa3a566d37b9 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 28 07:58:36.915837 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 07:58:36.915837 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 07:58:36.915837 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 07:58:36.915837 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 07:58:36.915837 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 07:58:36.915837 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 07:58:36.915837 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 07:58:36.915837 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 07:58:36.915837 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 07:58:36.915837 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 07:58:36.915837 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 07:58:36.915837 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 07:58:36.915837 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 07:58:36.915837 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 07:58:36.915837 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 07:58:36.916848 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 07:58:36.916848 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 07:58:36.916848 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 07:58:36.916848 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 07:58:36.916848 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 07:58:36.916848 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 07:58:36.916848 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 07:58:36.916848 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 07:58:36.916848 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 07:58:36.916848 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 07:58:36.916848 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 07:58:36.916848 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application with Lock( Jul 28 07:58:36.916848 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 07:58:36.916848 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._enter() Jul 28 07:58:36.916848 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 07:58:36.916848 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 07:58:36.917740 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 07:58:36.917740 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.creator() Jul 28 07:58:36.917740 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 07:58:36.917740 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application created_value = creator( Jul 28 07:58:36.917740 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 07:58:36.917740 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 07:58:36.917740 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 07:58:36.917740 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 07:58:36.917740 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 07:58:36.917740 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 07:58:36.917740 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 28 07:58:36.917740 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application Jul 28 07:58:36.917740 dv-cinder-851351-1-smb devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 105/188] 10.222.0.42 () {56 vars in 1099 bytes} [Thu Jul 28 07:58:36 2022] GET /identity/v3/roles/reader => generated 84 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 07:58:36.921898 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e307d38-d8b7-4e10-b180-fa3a566d37b9 None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 07:58:36.955699 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=100 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 07:58:36.966628 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa22842-5e33-4193-bf68-9ef721418e04 None admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 07:58:37.000851 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d5e9f7-74a9-4e17-9d13-8c0e601d0327 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 07:58:37.001484 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d5e9f7-74a9-4e17-9d13-8c0e601d0327 None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 07:58:37.001766 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d5e9f7-74a9-4e17-9d13-8c0e601d0327 None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 07:58:37.002040 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d5e9f7-74a9-4e17-9d13-8c0e601d0327 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 07:58:37.003223 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1d5e9f7-74a9-4e17-9d13-8c0e601d0327 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 07:58:37.004721 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1d5e9f7-74a9-4e17-9d13-8c0e601d0327 None admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 07:58:37.006345 dv-cinder-851351-1-smb devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 84/189] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 07:58:36 2022] GET /identity/v3/domains/default => generated 199 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 07:58:37.008091 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d5e9f7-74a9-4e17-9d13-8c0e601d0327 None admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 07:58:37.026959 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e307d38-d8b7-4e10-b180-fa3a566d37b9 None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 07:58:37.028497 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 07:58:37.063215 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20fb3d33-8ca5-49fb-9171-dc9a0273e0ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 07:58:37.063867 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20fb3d33-8ca5-49fb-9171-dc9a0273e0ee None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 07:58:37.064143 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20fb3d33-8ca5-49fb-9171-dc9a0273e0ee None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 07:58:37.064414 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20fb3d33-8ca5-49fb-9171-dc9a0273e0ee None admin] PATH_INFO: `/v3/users/de2d55af03cf485a9034cf3e0357ced9` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 07:58:37.077851 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20fb3d33-8ca5-49fb-9171-dc9a0273e0ee None admin] RBAC: Authorizing `identity:get_user(user_id=de2d55af03cf485a9034cf3e0357ced9)` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 07:58:37.079506 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20fb3d33-8ca5-49fb-9171-dc9a0273e0ee None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 07:58:37.081602 dv-cinder-851351-1-smb devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 106/190] 10.222.0.42 () {56 vars in 1177 bytes} [Thu Jul 28 07:58:36 2022] GET /identity/v3/users/de2d55af03cf485a9034cf3e0357ced9 => generated 283 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 07:58:37.086327 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20fb3d33-8ca5-49fb-9171-dc9a0273e0ee None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 07:58:37.105365 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d5e9f7-74a9-4e17-9d13-8c0e601d0327 None admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 07:58:37.138544 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc41dca3-ec1b-4661-94c2-596193c57548 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 07:58:37.139245 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc41dca3-ec1b-4661-94c2-596193c57548 None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 07:58:37.139521 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc41dca3-ec1b-4661-94c2-596193c57548 None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 07:58:37.139791 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc41dca3-ec1b-4661-94c2-596193c57548 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 07:58:37.149937 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc41dca3-ec1b-4661-94c2-596193c57548 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 07:58:37.155463 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application [None req-dc41dca3-ec1b-4661-94c2-596193c57548 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 28 07:58:37.155463 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 07:58:37.155463 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 07:58:37.155463 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 07:58:37.155463 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 07:58:37.155463 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 07:58:37.155463 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 07:58:37.155463 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 07:58:37.155463 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 07:58:37.155463 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 07:58:37.155463 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 07:58:37.155463 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 07:58:37.155463 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 07:58:37.155463 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 07:58:37.155463 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 07:58:37.155463 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 07:58:37.156329 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 07:58:37.156329 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 07:58:37.156329 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 07:58:37.156329 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 07:58:37.156329 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 07:58:37.156329 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 07:58:37.156329 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 07:58:37.156329 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 07:58:37.156329 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 07:58:37.156329 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 07:58:37.156329 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 07:58:37.156329 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application with Lock( Jul 28 07:58:37.156329 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 07:58:37.156329 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self._enter() Jul 28 07:58:37.156329 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 07:58:37.156329 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 07:58:37.158044 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 07:58:37.158044 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.creator() Jul 28 07:58:37.158044 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 07:58:37.158044 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application created_value = creator( Jul 28 07:58:37.158044 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 07:58:37.158044 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 07:58:37.158044 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 07:58:37.158044 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 07:58:37.158044 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 07:58:37.158044 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 07:58:37.158044 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 28 07:58:37.158044 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application Jul 28 07:58:37.158044 dv-cinder-851351-1-smb devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 85/191] 10.222.0.42 () {56 vars in 1114 bytes} [Thu Jul 28 07:58:37 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 07:58:37.158044 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc41dca3-ec1b-4661-94c2-596193c57548 None admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 07:58:37.180605 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20fb3d33-8ca5-49fb-9171-dc9a0273e0ee None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 07:58:37.182621 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=100 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 07:58:37.215055 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb188ee-0545-47d1-8d3f-0ba2b3fadc95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 07:58:37.215680 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb188ee-0545-47d1-8d3f-0ba2b3fadc95 None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 07:58:37.215954 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb188ee-0545-47d1-8d3f-0ba2b3fadc95 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 07:58:37.216222 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb188ee-0545-47d1-8d3f-0ba2b3fadc95 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 07:58:37.243516 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 07:58:37.262419 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc41dca3-ec1b-4661-94c2-596193c57548 None admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 07:58:37.283420 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb188ee-0545-47d1-8d3f-0ba2b3fadc95 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 07:58:37.284972 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb188ee-0545-47d1-8d3f-0ba2b3fadc95 None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 07:58:37.295089 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4479ac83-6149-4c7a-b1b9-84c570ddde5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 07:58:37.295770 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4479ac83-6149-4c7a-b1b9-84c570ddde5c None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 07:58:37.296074 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4479ac83-6149-4c7a-b1b9-84c570ddde5c None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 07:58:37.296337 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4479ac83-6149-4c7a-b1b9-84c570ddde5c None admin] PATH_INFO: `/v3/roles` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 07:58:37.297091 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4479ac83-6149-4c7a-b1b9-84c570ddde5c None admin] RBAC: Adding query filter params (name=reader) {{(pid=80348) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 07:58:37.297385 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4479ac83-6149-4c7a-b1b9-84c570ddde5c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 07:58:37.298766 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4479ac83-6149-4c7a-b1b9-84c570ddde5c None admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 07:58:37.306700 dv-cinder-851351-1-smb devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 86/192] 10.222.0.42 () {56 vars in 1101 bytes} [Thu Jul 28 07:58:37 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 07:58:37.307477 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4479ac83-6149-4c7a-b1b9-84c570ddde5c None admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 07:58:37.384072 dv-cinder-851351-1-smb devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 107/193] 10.222.0.42 () {58 vars in 1282 bytes} [Thu Jul 28 07:58:37 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 28 07:58:37.384952 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb188ee-0545-47d1-8d3f-0ba2b3fadc95 None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 07:58:37.387916 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=100 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 07:58:37.407388 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4479ac83-6149-4c7a-b1b9-84c570ddde5c None admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 07:58:37.441988 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2625ca30-088b-407e-a78d-8f3cd3fe85ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 07:58:37.442559 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2625ca30-088b-407e-a78d-8f3cd3fe85ec None admin] REQUEST_METHOD: `POST` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 07:58:37.442842 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2625ca30-088b-407e-a78d-8f3cd3fe85ec None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 07:58:37.443100 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2625ca30-088b-407e-a78d-8f3cd3fe85ec None admin] PATH_INFO: `/v3/users` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 07:58:37.443775 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2625ca30-088b-407e-a78d-8f3cd3fe85ec None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 07:58:37.444521 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 07:58:37.445292 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2625ca30-088b-407e-a78d-8f3cd3fe85ec None admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 07:58:37.473161 dv-cinder-851351-1-smb devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 87/194] 10.222.0.42 () {60 vars in 1132 bytes} [Thu Jul 28 07:58:37 2022] POST /identity/v3/users => generated 297 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 07:58:37.473998 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2625ca30-088b-407e-a78d-8f3cd3fe85ec None admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 07:58:37.489111 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb188ee-0545-47d1-8d3f-0ba2b3fadc95 None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 07:58:37.540405 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-856df275-2a82-4fda-9a5b-1612fb05caf0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 07:58:37.541748 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856df275-2a82-4fda-9a5b-1612fb05caf0 None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 07:58:37.542035 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856df275-2a82-4fda-9a5b-1612fb05caf0 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 07:58:37.542311 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856df275-2a82-4fda-9a5b-1612fb05caf0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 07:58:37.589697 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2625ca30-088b-407e-a78d-8f3cd3fe85ec None admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 07:58:37.621266 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-856df275-2a82-4fda-9a5b-1612fb05caf0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 07:58:37.622838 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-856df275-2a82-4fda-9a5b-1612fb05caf0 None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 07:58:37.627407 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0dfa695-9960-4f7d-9437-00e6524360a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 07:58:37.628047 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0dfa695-9960-4f7d-9437-00e6524360a3 None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 07:58:37.628322 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0dfa695-9960-4f7d-9437-00e6524360a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 07:58:37.628590 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0dfa695-9960-4f7d-9437-00e6524360a3 None admin] PATH_INFO: `/v3/roles` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 07:58:37.629351 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0dfa695-9960-4f7d-9437-00e6524360a3 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80348) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 07:58:37.629650 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0dfa695-9960-4f7d-9437-00e6524360a3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 07:58:37.631042 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0dfa695-9960-4f7d-9437-00e6524360a3 None admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 07:58:37.637391 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 07:58:37.640803 dv-cinder-851351-1-smb devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 88/195] 10.222.0.42 () {56 vars in 1111 bytes} [Thu Jul 28 07:58:37 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 07:58:37.642194 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0dfa695-9960-4f7d-9437-00e6524360a3 None admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 07:58:37.697166 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 07:58:37.750808 dv-cinder-851351-1-smb devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 108/196] 10.222.0.42 () {58 vars in 1282 bytes} [Thu Jul 28 07:58:37 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 366 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 28 07:58:37.751476 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-856df275-2a82-4fda-9a5b-1612fb05caf0 None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 07:58:37.775953 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0dfa695-9960-4f7d-9437-00e6524360a3 None admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 07:58:37.820423 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a19578c-555c-4e05-914b-956036fab0f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 07:58:37.821111 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a19578c-555c-4e05-914b-956036fab0f1 None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 07:58:37.822277 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a19578c-555c-4e05-914b-956036fab0f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 07:58:37.822277 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a19578c-555c-4e05-914b-956036fab0f1 None admin] PATH_INFO: `/v3/users/ac2c507b345b453baa8d65b44b216574` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 07:58:37.822850 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a19578c-555c-4e05-914b-956036fab0f1 None admin] RBAC: Authorizing `identity:get_user(user_id=ac2c507b345b453baa8d65b44b216574)` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 07:58:37.824315 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a19578c-555c-4e05-914b-956036fab0f1 None admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 07:58:37.826169 dv-cinder-851351-1-smb devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 89/197] 10.222.0.42 () {56 vars in 1177 bytes} [Thu Jul 28 07:58:37 2022] GET /identity/v3/users/ac2c507b345b453baa8d65b44b216574 => generated 289 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 07:58:37.826896 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a19578c-555c-4e05-914b-956036fab0f1 None admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 07:58:37.872587 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-856df275-2a82-4fda-9a5b-1612fb05caf0 None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 07:58:37.907209 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=100 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 07:58:37.913212 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e15f34b2-abab-47f7-9f93-88f01e9cbd9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 07:58:37.914188 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15f34b2-abab-47f7-9f93-88f01e9cbd9d None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 07:58:37.914657 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15f34b2-abab-47f7-9f93-88f01e9cbd9d None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 07:58:37.915112 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15f34b2-abab-47f7-9f93-88f01e9cbd9d None admin] PATH_INFO: `/v3/projects/1537f5accf6246559f3312e9445eb40c` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 07:58:37.916528 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e15f34b2-abab-47f7-9f93-88f01e9cbd9d None admin] RBAC: Authorizing `identity:get_project(project_id=1537f5accf6246559f3312e9445eb40c)` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 07:58:37.918702 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e15f34b2-abab-47f7-9f93-88f01e9cbd9d None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 07:58:37.926319 dv-cinder-851351-1-smb devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 109/198] 10.222.0.42 () {56 vars in 1186 bytes} [Thu Jul 28 07:58:37 2022] GET /identity/v3/projects/1537f5accf6246559f3312e9445eb40c => generated 312 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 07:58:37.927738 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e15f34b2-abab-47f7-9f93-88f01e9cbd9d None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 07:58:37.950529 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a19578c-555c-4e05-914b-956036fab0f1 None admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 07:58:37.964803 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 07:58:37.987740 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea74f4d7-2584-485a-8c20-c8fe63fac623 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 07:58:37.988401 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea74f4d7-2584-485a-8c20-c8fe63fac623 None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 07:58:37.988752 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea74f4d7-2584-485a-8c20-c8fe63fac623 None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 07:58:37.989031 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea74f4d7-2584-485a-8c20-c8fe63fac623 None admin] PATH_INFO: `/v3/users/de2d55af03cf485a9034cf3e0357ced9` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 07:58:37.990228 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea74f4d7-2584-485a-8c20-c8fe63fac623 None admin] RBAC: Authorizing `identity:get_user(user_id=de2d55af03cf485a9034cf3e0357ced9)` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 07:58:37.991823 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea74f4d7-2584-485a-8c20-c8fe63fac623 None admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 07:58:37.993450 dv-cinder-851351-1-smb devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 90/199] 10.222.0.42 () {56 vars in 1177 bytes} [Thu Jul 28 07:58:37 2022] GET /identity/v3/users/de2d55af03cf485a9034cf3e0357ced9 => generated 283 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 07:58:37.994219 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea74f4d7-2584-485a-8c20-c8fe63fac623 None admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 07:58:38.062990 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e15f34b2-abab-47f7-9f93-88f01e9cbd9d None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 07:58:38.100071 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9731bad1-a82f-418e-b92e-9f2bd768a205 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 07:58:38.101164 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9731bad1-a82f-418e-b92e-9f2bd768a205 None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 07:58:38.101648 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9731bad1-a82f-418e-b92e-9f2bd768a205 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 07:58:38.102100 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9731bad1-a82f-418e-b92e-9f2bd768a205 None admin] PATH_INFO: `/v3/projects/0f988f0c81614261ae36a6896770b2d0` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 07:58:38.103490 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9731bad1-a82f-418e-b92e-9f2bd768a205 None admin] RBAC: Authorizing `identity:get_project(project_id=0f988f0c81614261ae36a6896770b2d0)` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 07:58:38.105221 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9731bad1-a82f-418e-b92e-9f2bd768a205 None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 07:58:38.107128 dv-cinder-851351-1-smb devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 110/200] 10.222.0.42 () {56 vars in 1186 bytes} [Thu Jul 28 07:58:37 2022] GET /identity/v3/projects/0f988f0c81614261ae36a6896770b2d0 => generated 302 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 07:58:38.108070 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea74f4d7-2584-485a-8c20-c8fe63fac623 None admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 07:58:38.108515 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9731bad1-a82f-418e-b92e-9f2bd768a205 None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 07:58:38.156202 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f977a243-e76e-4f75-a978-6dd5bf86f429 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 07:58:38.156873 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f977a243-e76e-4f75-a978-6dd5bf86f429 None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 07:58:38.157155 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f977a243-e76e-4f75-a978-6dd5bf86f429 None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 07:58:38.157425 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f977a243-e76e-4f75-a978-6dd5bf86f429 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 07:58:38.170800 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=100 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 07:58:38.231817 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f977a243-e76e-4f75-a978-6dd5bf86f429 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 07:58:38.233445 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f977a243-e76e-4f75-a978-6dd5bf86f429 None admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 07:58:38.234160 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9731bad1-a82f-418e-b92e-9f2bd768a205 None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 07:58:38.238096 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 07:58:38.289391 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-529fa3c7-3b50-4637-809f-a25e850b1598 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 07:58:38.290778 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529fa3c7-3b50-4637-809f-a25e850b1598 None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 07:58:38.291541 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529fa3c7-3b50-4637-809f-a25e850b1598 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 07:58:38.292033 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529fa3c7-3b50-4637-809f-a25e850b1598 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 07:58:38.293206 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-529fa3c7-3b50-4637-809f-a25e850b1598 None admin] RBAC: Adding query filter params (role.id=0317c30d81ff44eea2fd4a7215c60eac, scope.project.id=1537f5accf6246559f3312e9445eb40c, user.id=3e40f59d19f54db3bf0031b56994797a) {{(pid=80347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 07:58:38.293973 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-529fa3c7-3b50-4637-809f-a25e850b1598 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 07:58:38.295676 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-529fa3c7-3b50-4637-809f-a25e850b1598 None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 07:58:38.304876 dv-cinder-851351-1-smb devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 111/201] 10.222.0.42 () {56 vars in 1374 bytes} [Thu Jul 28 07:58:38 2022] GET /identity/v3/role_assignments?user.id=3e40f59d19f54db3bf0031b56994797a&scope.project.id=1537f5accf6246559f3312e9445eb40c&role.id=0317c30d81ff44eea2fd4a7215c60eac => generated 608 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 07:58:38.306576 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-529fa3c7-3b50-4637-809f-a25e850b1598 None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 07:58:38.351542 dv-cinder-851351-1-smb devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 91/202] 10.222.0.42 () {58 vars in 1282 bytes} [Thu Jul 28 07:58:37 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 358 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 28 07:58:38.352405 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f977a243-e76e-4f75-a978-6dd5bf86f429 None admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 07:58:38.399372 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=100 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 07:58:38.445700 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-529fa3c7-3b50-4637-809f-a25e850b1598 None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 07:58:38.483851 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2dab29-7362-479d-9663-144677346cbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 07:58:38.484424 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2dab29-7362-479d-9663-144677346cbc None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 07:58:38.484735 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2dab29-7362-479d-9663-144677346cbc None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 07:58:38.485048 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2dab29-7362-479d-9663-144677346cbc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 07:58:38.494202 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f977a243-e76e-4f75-a978-6dd5bf86f429 None admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 07:58:38.516460 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 07:58:38.555251 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f95cc1e-f82d-40e3-b73a-ebc2a1dddfca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 07:58:38.555894 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f95cc1e-f82d-40e3-b73a-ebc2a1dddfca None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 07:58:38.556164 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f95cc1e-f82d-40e3-b73a-ebc2a1dddfca None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 07:58:38.556432 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f95cc1e-f82d-40e3-b73a-ebc2a1dddfca None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 07:58:38.557291 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f95cc1e-f82d-40e3-b73a-ebc2a1dddfca None admin] RBAC: Adding query filter params (role.id=362bd71ac01249fb8fa635381993eec1, scope.project.id=0f988f0c81614261ae36a6896770b2d0, user.id=de2d55af03cf485a9034cf3e0357ced9) {{(pid=80348) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 07:58:38.557597 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f95cc1e-f82d-40e3-b73a-ebc2a1dddfca None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 07:58:38.561158 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f95cc1e-f82d-40e3-b73a-ebc2a1dddfca None admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 07:58:38.575871 dv-cinder-851351-1-smb devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 92/203] 10.222.0.42 () {56 vars in 1374 bytes} [Thu Jul 28 07:58:38 2022] GET /identity/v3/role_assignments?user.id=de2d55af03cf485a9034cf3e0357ced9&scope.project.id=0f988f0c81614261ae36a6896770b2d0&role.id=362bd71ac01249fb8fa635381993eec1 => generated 259 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 07:58:38.576650 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f95cc1e-f82d-40e3-b73a-ebc2a1dddfca None admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 07:58:38.603560 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee2dab29-7362-479d-9663-144677346cbc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 07:58:38.603758 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee2dab29-7362-479d-9663-144677346cbc None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 07:58:38.788410 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=100 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 07:58:38.792856 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f95cc1e-f82d-40e3-b73a-ebc2a1dddfca None admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 07:58:38.809946 dv-cinder-851351-1-smb devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 112/204] 10.222.0.42 () {58 vars in 1282 bytes} [Thu Jul 28 07:58:38 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 501 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 28 07:58:38.815194 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2dab29-7362-479d-9663-144677346cbc None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 07:58:38.847206 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b387e2fa-4b72-47ee-aeaf-9c452304c782 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 07:58:38.847880 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b387e2fa-4b72-47ee-aeaf-9c452304c782 None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 07:58:38.848159 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b387e2fa-4b72-47ee-aeaf-9c452304c782 None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 07:58:38.848432 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b387e2fa-4b72-47ee-aeaf-9c452304c782 None admin] PATH_INFO: `/v3/projects/cdfa7c2638114a968f5357dc098b441b` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 07:58:38.849775 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b387e2fa-4b72-47ee-aeaf-9c452304c782 None admin] RBAC: Authorizing `identity:get_project(project_id=cdfa7c2638114a968f5357dc098b441b)` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 07:58:38.851127 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b387e2fa-4b72-47ee-aeaf-9c452304c782 None admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 07:58:38.856882 dv-cinder-851351-1-smb devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 93/205] 10.222.0.42 () {56 vars in 1186 bytes} [Thu Jul 28 07:58:38 2022] GET /identity/v3/projects/cdfa7c2638114a968f5357dc098b441b => generated 298 bytes in 277 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 07:58:38.862789 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b387e2fa-4b72-47ee-aeaf-9c452304c782 None admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 07:58:38.930379 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 07:58:39.010748 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2dab29-7362-479d-9663-144677346cbc None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 07:58:39.052354 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b387e2fa-4b72-47ee-aeaf-9c452304c782 None admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 07:58:39.077035 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23dbdeb-8d96-4b9e-a9f8-d587026705f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 07:58:39.077743 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23dbdeb-8d96-4b9e-a9f8-d587026705f5 None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 07:58:39.078020 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23dbdeb-8d96-4b9e-a9f8-d587026705f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 07:58:39.078291 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23dbdeb-8d96-4b9e-a9f8-d587026705f5 None admin] PATH_INFO: `/v3/projects/0f988f0c81614261ae36a6896770b2d0` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 07:58:39.080436 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a23dbdeb-8d96-4b9e-a9f8-d587026705f5 None admin] RBAC: Authorizing `identity:get_project(project_id=0f988f0c81614261ae36a6896770b2d0)` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 07:58:39.082313 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a23dbdeb-8d96-4b9e-a9f8-d587026705f5 None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 07:58:39.084198 dv-cinder-851351-1-smb devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 113/206] 10.222.0.42 () {56 vars in 1186 bytes} [Thu Jul 28 07:58:38 2022] GET /identity/v3/projects/0f988f0c81614261ae36a6896770b2d0 => generated 302 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 07:58:39.092236 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23dbdeb-8d96-4b9e-a9f8-d587026705f5 None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 07:58:39.118265 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c301ef47-13c1-4d70-8f3e-79c1b5854edb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 07:58:39.118898 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c301ef47-13c1-4d70-8f3e-79c1b5854edb None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 07:58:39.119177 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c301ef47-13c1-4d70-8f3e-79c1b5854edb None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 07:58:39.119447 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c301ef47-13c1-4d70-8f3e-79c1b5854edb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 07:58:39.120245 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c301ef47-13c1-4d70-8f3e-79c1b5854edb None admin] RBAC: Adding query filter params (role.id=21c3f6dd315a425a98d00fcf994f3a36, scope.project.id=cdfa7c2638114a968f5357dc098b441b, user.id=ac2c507b345b453baa8d65b44b216574) {{(pid=80348) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 07:58:39.120554 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c301ef47-13c1-4d70-8f3e-79c1b5854edb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 07:58:39.122034 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c301ef47-13c1-4d70-8f3e-79c1b5854edb None admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 07:58:39.142959 dv-cinder-851351-1-smb devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 94/207] 10.222.0.42 () {56 vars in 1374 bytes} [Thu Jul 28 07:58:38 2022] GET /identity/v3/role_assignments?user.id=ac2c507b345b453baa8d65b44b216574&scope.project.id=cdfa7c2638114a968f5357dc098b441b&role.id=21c3f6dd315a425a98d00fcf994f3a36 => generated 608 bytes in 281 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 07:58:39.205907 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23dbdeb-8d96-4b9e-a9f8-d587026705f5 None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 07:58:39.236803 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 07:58:39.247405 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9cf964-f9d7-4ba5-8d91-0995534dee9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 07:58:39.248064 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9cf964-f9d7-4ba5-8d91-0995534dee9f None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 07:58:39.248416 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9cf964-f9d7-4ba5-8d91-0995534dee9f None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 07:58:39.248718 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9cf964-f9d7-4ba5-8d91-0995534dee9f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 07:58:39.249534 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b9cf964-f9d7-4ba5-8d91-0995534dee9f None admin] RBAC: Adding query filter params (role.id=f28d669937b942878bcf6a9103012af9, scope.project.id=0f988f0c81614261ae36a6896770b2d0, user.id=de2d55af03cf485a9034cf3e0357ced9) {{(pid=80347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 07:58:39.249848 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b9cf964-f9d7-4ba5-8d91-0995534dee9f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 07:58:39.251326 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b9cf964-f9d7-4ba5-8d91-0995534dee9f None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 07:58:39.257808 dv-cinder-851351-1-smb devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 114/208] 10.222.0.42 () {56 vars in 1374 bytes} [Thu Jul 28 07:58:39 2022] GET /identity/v3/role_assignments?user.id=de2d55af03cf485a9034cf3e0357ced9&scope.project.id=0f988f0c81614261ae36a6896770b2d0&role.id=f28d669937b942878bcf6a9103012af9 => generated 259 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 07:58:39.776911 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84366ad0-0616-4937-9e89-0eee479dac63 None None] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 07:58:39.777311 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84366ad0-0616-4937-9e89-0eee479dac63 None None] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 07:58:39.777498 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84366ad0-0616-4937-9e89-0eee479dac63 None None] PATH_INFO: `/` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 07:58:39.779161 dv-cinder-851351-1-smb devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 95/209] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 07:58:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 07:58:39.785051 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c214a44-2c88-40d4-b557-d5249b539c59 None None] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 07:58:39.785334 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c214a44-2c88-40d4-b557-d5249b539c59 None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 07:58:39.785609 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c214a44-2c88-40d4-b557-d5249b539c59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 07:58:39.807700 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.auth.core [None req-0c214a44-2c88-40d4-b557-d5249b539c59 None None] MFA Rules not processed for user `f0666d3a50644a7097367331c1ee1a68`. Rule list: `[]` (Enabled: `True`). {{(pid=80347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 07:58:39.808958 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-0c214a44-2c88-40d4-b557-d5249b539c59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 07:58:39.902486 dv-cinder-851351-1-smb devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 115/210] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 07:58:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 07:58:39.920429 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818482e3-627b-4c47-bfb5-5182cc4a8d55 None None] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 07:58:39.920779 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818482e3-627b-4c47-bfb5-5182cc4a8d55 None None] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 07:58:39.920999 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818482e3-627b-4c47-bfb5-5182cc4a8d55 None None] PATH_INFO: `/` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 07:58:39.922535 dv-cinder-851351-1-smb devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 96/211] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 07:58:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 07:58:39.927909 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818482e3-627b-4c47-bfb5-5182cc4a8d55 None None] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 07:58:39.928323 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e206a70-8387-4be1-a0a1-5a906b5e2da0 None None] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 07:58:39.928609 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e206a70-8387-4be1-a0a1-5a906b5e2da0 None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 07:58:39.928911 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e206a70-8387-4be1-a0a1-5a906b5e2da0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 07:58:39.947696 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.auth.core [None req-3e206a70-8387-4be1-a0a1-5a906b5e2da0 None None] MFA Rules not processed for user `f0666d3a50644a7097367331c1ee1a68`. Rule list: `[]` (Enabled: `True`). {{(pid=80347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 07:58:39.949198 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-3e206a70-8387-4be1-a0a1-5a906b5e2da0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 07:58:39.963454 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=100 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 07:58:40.024079 dv-cinder-851351-1-smb devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 116/212] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 07:58:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 07:58:40.041592 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818482e3-627b-4c47-bfb5-5182cc4a8d55 None None] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 07:58:40.048304 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e206a70-8387-4be1-a0a1-5a906b5e2da0 None None] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 07:58:40.076748 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e904b6a8-f343-46c4-b4dc-2557a1f5d0eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 07:58:40.077428 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e904b6a8-f343-46c4-b4dc-2557a1f5d0eb None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 07:58:40.077672 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e904b6a8-f343-46c4-b4dc-2557a1f5d0eb None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 07:58:40.077943 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e904b6a8-f343-46c4-b4dc-2557a1f5d0eb None admin] PATH_INFO: `/v3/roles/member` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 07:58:40.088836 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e904b6a8-f343-46c4-b4dc-2557a1f5d0eb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 07:58:40.094242 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application [None req-e904b6a8-f343-46c4-b4dc-2557a1f5d0eb None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 28 07:58:40.094242 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 07:58:40.094242 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 07:58:40.094242 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 07:58:40.094242 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 07:58:40.094242 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 07:58:40.094242 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 07:58:40.094242 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 07:58:40.094242 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 07:58:40.094242 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 07:58:40.094242 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 07:58:40.094242 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 07:58:40.094242 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 07:58:40.094242 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 07:58:40.094242 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 07:58:40.094242 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 07:58:40.095114 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 07:58:40.095114 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 07:58:40.095114 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 07:58:40.095114 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 07:58:40.095114 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 07:58:40.095114 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 07:58:40.095114 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 07:58:40.095114 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 07:58:40.095114 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 07:58:40.095114 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 07:58:40.095114 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 07:58:40.095114 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application with Lock( Jul 28 07:58:40.095114 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 07:58:40.095114 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self._enter() Jul 28 07:58:40.095114 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 07:58:40.095114 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 07:58:40.095967 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 07:58:40.095967 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.creator() Jul 28 07:58:40.095967 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 07:58:40.095967 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application created_value = creator( Jul 28 07:58:40.095967 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 07:58:40.095967 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 07:58:40.095967 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 07:58:40.095967 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 07:58:40.095967 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 07:58:40.095967 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 07:58:40.095967 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 28 07:58:40.095967 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application Jul 28 07:58:40.095967 dv-cinder-851351-1-smb devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 97/213] 10.222.0.42 () {56 vars in 1099 bytes} [Thu Jul 28 07:58:39 2022] GET /identity/v3/roles/member => generated 84 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 07:58:40.101642 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e904b6a8-f343-46c4-b4dc-2557a1f5d0eb None admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 07:58:40.103323 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 07:58:40.156599 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e206a70-8387-4be1-a0a1-5a906b5e2da0 None None] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 07:58:40.195229 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86878c38-909f-4f82-9195-9707d3f7dc13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 07:58:40.196177 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86878c38-909f-4f82-9195-9707d3f7dc13 None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 07:58:40.196635 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86878c38-909f-4f82-9195-9707d3f7dc13 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 07:58:40.197114 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86878c38-909f-4f82-9195-9707d3f7dc13 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 07:58:40.198450 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86878c38-909f-4f82-9195-9707d3f7dc13 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 07:58:40.200073 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86878c38-909f-4f82-9195-9707d3f7dc13 None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 07:58:40.201990 dv-cinder-851351-1-smb devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 117/214] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 07:58:40 2022] GET /identity/v3/domains/default => generated 199 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 07:58:40.211838 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86878c38-909f-4f82-9195-9707d3f7dc13 None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 07:58:40.215111 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=100 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 07:58:40.227487 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e904b6a8-f343-46c4-b4dc-2557a1f5d0eb None admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 07:58:40.274475 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f46996-82c0-414d-ae76-790fed2a4b0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 07:58:40.275416 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f46996-82c0-414d-ae76-790fed2a4b0e None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 07:58:40.276413 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f46996-82c0-414d-ae76-790fed2a4b0e None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 07:58:40.276907 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f46996-82c0-414d-ae76-790fed2a4b0e None admin] PATH_INFO: `/v3/roles` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 07:58:40.278477 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f46996-82c0-414d-ae76-790fed2a4b0e None admin] RBAC: Adding query filter params (name=member) {{(pid=80348) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 07:58:40.279469 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f46996-82c0-414d-ae76-790fed2a4b0e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 07:58:40.283002 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f46996-82c0-414d-ae76-790fed2a4b0e None admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 07:58:40.301716 dv-cinder-851351-1-smb devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 98/215] 10.222.0.42 () {56 vars in 1101 bytes} [Thu Jul 28 07:58:40 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 07:58:40.304837 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f46996-82c0-414d-ae76-790fed2a4b0e None admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 07:58:40.334294 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86878c38-909f-4f82-9195-9707d3f7dc13 None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 07:58:40.356884 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 07:58:40.376752 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e0804f-bd65-4b87-b41d-b2c799f63e11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 07:58:40.377640 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e0804f-bd65-4b87-b41d-b2c799f63e11 None admin] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 07:58:40.378051 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e0804f-bd65-4b87-b41d-b2c799f63e11 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 07:58:40.378455 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e0804f-bd65-4b87-b41d-b2c799f63e11 None admin] PATH_INFO: `/v3/users` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 07:58:40.379310 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50e0804f-bd65-4b87-b41d-b2c799f63e11 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 07:58:40.381141 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50e0804f-bd65-4b87-b41d-b2c799f63e11 None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 07:58:40.407412 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f46996-82c0-414d-ae76-790fed2a4b0e None admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 07:58:40.408528 dv-cinder-851351-1-smb devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 118/216] 10.222.0.42 () {60 vars in 1132 bytes} [Thu Jul 28 07:58:40 2022] POST /identity/v3/users => generated 297 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 28 07:58:40.459465 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-244781aa-5674-4a1a-af3e-7c54ad1f7d69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 07:58:40.460253 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244781aa-5674-4a1a-af3e-7c54ad1f7d69 None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 07:58:40.460532 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244781aa-5674-4a1a-af3e-7c54ad1f7d69 None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 07:58:40.460901 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244781aa-5674-4a1a-af3e-7c54ad1f7d69 None admin] PATH_INFO: `/v3/users/e9b221388e024aceac3955820b6d91b3` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 07:58:40.478136 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-244781aa-5674-4a1a-af3e-7c54ad1f7d69 None admin] RBAC: Authorizing `identity:get_user(user_id=e9b221388e024aceac3955820b6d91b3)` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 07:58:40.479915 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-244781aa-5674-4a1a-af3e-7c54ad1f7d69 None admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 07:58:40.481995 dv-cinder-851351-1-smb devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 99/217] 10.222.0.42 () {56 vars in 1177 bytes} [Thu Jul 28 07:58:40 2022] GET /identity/v3/users/e9b221388e024aceac3955820b6d91b3 => generated 297 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 07:58:40.488218 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e0804f-bd65-4b87-b41d-b2c799f63e11 None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 07:58:40.607304 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e0804f-bd65-4b87-b41d-b2c799f63e11 None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 07:58:40.643898 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-747f894d-e707-4abe-94da-016be2486747 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 07:58:40.644792 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747f894d-e707-4abe-94da-016be2486747 None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 07:58:40.645207 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747f894d-e707-4abe-94da-016be2486747 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 07:58:40.645613 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747f894d-e707-4abe-94da-016be2486747 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 07:58:40.697627 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 07:58:40.728953 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-747f894d-e707-4abe-94da-016be2486747 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 07:58:40.730698 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-747f894d-e707-4abe-94da-016be2486747 None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 07:58:40.848172 dv-cinder-851351-1-smb devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 119/218] 10.222.0.42 () {58 vars in 1282 bytes} [Thu Jul 28 07:58:40 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 360 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 28 07:58:40.853924 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-244781aa-5674-4a1a-af3e-7c54ad1f7d69 None admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 07:58:40.871583 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=100 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 07:58:40.960312 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-244781aa-5674-4a1a-af3e-7c54ad1f7d69 None admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 07:58:40.985972 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56547d5-08fc-49be-92a2-b63dc9a55d00 None None] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 07:58:40.986485 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56547d5-08fc-49be-92a2-b63dc9a55d00 None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 07:58:40.986485 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56547d5-08fc-49be-92a2-b63dc9a55d00 None None] PATH_INFO: `/` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 07:58:40.988053 dv-cinder-851351-1-smb devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 120/219] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 07:58:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 28 07:58:40.995041 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e722081f-3cd6-4a3d-a9c0-2768349f707b None None] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 07:58:40.995324 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e722081f-3cd6-4a3d-a9c0-2768349f707b None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 07:58:40.995776 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e722081f-3cd6-4a3d-a9c0-2768349f707b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 07:58:41.002108 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9fde0d1-eaf3-49d9-a83e-f97d247c0d34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 07:58:41.003117 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9fde0d1-eaf3-49d9-a83e-f97d247c0d34 None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 07:58:41.003597 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9fde0d1-eaf3-49d9-a83e-f97d247c0d34 None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 07:58:41.004055 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9fde0d1-eaf3-49d9-a83e-f97d247c0d34 None admin] PATH_INFO: `/v3/projects/0f988f0c81614261ae36a6896770b2d0` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 07:58:41.005518 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9fde0d1-eaf3-49d9-a83e-f97d247c0d34 None admin] RBAC: Authorizing `identity:get_project(project_id=0f988f0c81614261ae36a6896770b2d0)` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 07:58:41.007263 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9fde0d1-eaf3-49d9-a83e-f97d247c0d34 None admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 07:58:41.009743 dv-cinder-851351-1-smb devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 100/220] 10.222.0.42 () {56 vars in 1186 bytes} [Thu Jul 28 07:58:40 2022] GET /identity/v3/projects/0f988f0c81614261ae36a6896770b2d0 => generated 302 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 07:58:41.017456 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9fde0d1-eaf3-49d9-a83e-f97d247c0d34 None admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 07:58:41.034913 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.auth.core [None req-e722081f-3cd6-4a3d-a9c0-2768349f707b None None] MFA Rules not processed for user `f0666d3a50644a7097367331c1ee1a68`. Rule list: `[]` (Enabled: `True`). {{(pid=80347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 07:58:41.036120 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-e722081f-3cd6-4a3d-a9c0-2768349f707b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 07:58:41.109912 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=100 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 07:58:41.134304 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9fde0d1-eaf3-49d9-a83e-f97d247c0d34 None admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 07:58:41.193251 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca650ef-30cf-4c6b-817f-ae28e35317cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 07:58:41.193892 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca650ef-30cf-4c6b-817f-ae28e35317cd None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 07:58:41.194170 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca650ef-30cf-4c6b-817f-ae28e35317cd None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 07:58:41.194441 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca650ef-30cf-4c6b-817f-ae28e35317cd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 07:58:41.195253 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ca650ef-30cf-4c6b-817f-ae28e35317cd None admin] RBAC: Adding query filter params (role.id=0317c30d81ff44eea2fd4a7215c60eac, scope.project.id=0f988f0c81614261ae36a6896770b2d0, user.id=e9b221388e024aceac3955820b6d91b3) {{(pid=80348) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 07:58:41.195558 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ca650ef-30cf-4c6b-817f-ae28e35317cd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 07:58:41.198811 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ca650ef-30cf-4c6b-817f-ae28e35317cd None admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 07:58:41.198943 dv-cinder-851351-1-smb devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 121/221] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 07:58:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 07:58:41.209273 dv-cinder-851351-1-smb devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 101/222] 10.222.0.42 () {56 vars in 1374 bytes} [Thu Jul 28 07:58:41 2022] GET /identity/v3/role_assignments?user.id=e9b221388e024aceac3955820b6d91b3&scope.project.id=0f988f0c81614261ae36a6896770b2d0&role.id=0317c30d81ff44eea2fd4a7215c60eac => generated 259 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 07:58:41.228478 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e722081f-3cd6-4a3d-a9c0-2768349f707b None None] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 07:58:41.241671 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 07:58:41.397723 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e722081f-3cd6-4a3d-a9c0-2768349f707b None None] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 07:58:41.446014 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185c36e3-2a5e-4975-b891-d186beca597d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 07:58:41.447028 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185c36e3-2a5e-4975-b891-d186beca597d None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 07:58:41.447494 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185c36e3-2a5e-4975-b891-d186beca597d None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 07:58:41.447973 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185c36e3-2a5e-4975-b891-d186beca597d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 07:58:41.462156 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-185c36e3-2a5e-4975-b891-d186beca597d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 07:58:41.467543 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application [None req-185c36e3-2a5e-4975-b891-d186beca597d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 07:58:41.467543 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 07:58:41.467543 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 07:58:41.467543 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 07:58:41.467543 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 07:58:41.467543 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 07:58:41.467543 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 07:58:41.467543 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 07:58:41.467543 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 07:58:41.467543 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 07:58:41.467543 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 07:58:41.467543 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 07:58:41.467543 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 07:58:41.467543 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 07:58:41.467543 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 07:58:41.467543 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 07:58:41.468394 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 07:58:41.468394 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 07:58:41.468394 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 07:58:41.468394 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 07:58:41.468394 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 07:58:41.468394 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 07:58:41.468394 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 07:58:41.468394 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 07:58:41.468394 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 07:58:41.468394 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 07:58:41.468394 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 07:58:41.468394 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application with Lock( Jul 28 07:58:41.468394 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 07:58:41.468394 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._enter() Jul 28 07:58:41.468394 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 07:58:41.468394 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 07:58:41.469180 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 07:58:41.469180 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.creator() Jul 28 07:58:41.469180 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 07:58:41.469180 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application created_value = creator( Jul 28 07:58:41.469180 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 07:58:41.469180 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 07:58:41.469180 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 07:58:41.469180 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 07:58:41.469180 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 07:58:41.469180 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 07:58:41.469180 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 07:58:41.469180 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application Jul 28 07:58:41.471484 dv-cinder-851351-1-smb devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 122/223] 10.222.0.42 () {56 vars in 1096 bytes} [Thu Jul 28 07:58:41 2022] GET /identity/v3/roles/admin => generated 83 bytes in 244 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 07:58:41.477514 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185c36e3-2a5e-4975-b891-d186beca597d None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 07:58:41.478166 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09acb478-53c2-4cc8-8b67-27abe7aee2a0 None None] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 07:58:41.478456 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09acb478-53c2-4cc8-8b67-27abe7aee2a0 None None] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 07:58:41.478733 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09acb478-53c2-4cc8-8b67-27abe7aee2a0 None None] PATH_INFO: `/` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 07:58:41.480104 dv-cinder-851351-1-smb devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 102/224] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 07:58:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 07:58:41.485478 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d4613d-b735-4894-ac65-fe81969bbc96 None None] REQUEST_METHOD: `POST` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 07:58:41.485759 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d4613d-b735-4894-ac65-fe81969bbc96 None None] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 07:58:41.486031 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d4613d-b735-4894-ac65-fe81969bbc96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 07:58:41.524448 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.auth.core [None req-e2d4613d-b735-4894-ac65-fe81969bbc96 None None] MFA Rules not processed for user `f0666d3a50644a7097367331c1ee1a68`. Rule list: `[]` (Enabled: `True`). {{(pid=80348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 07:58:41.525715 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.fernet_utils [None req-e2d4613d-b735-4894-ac65-fe81969bbc96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 07:58:41.621493 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 07:58:41.657220 dv-cinder-851351-1-smb devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 103/225] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 07:58:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 07:58:41.669238 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185c36e3-2a5e-4975-b891-d186beca597d None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 07:58:41.718269 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5409a5-8cf0-47eb-aa4d-0e41883047c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 07:58:41.719240 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5409a5-8cf0-47eb-aa4d-0e41883047c9 None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 07:58:41.719736 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5409a5-8cf0-47eb-aa4d-0e41883047c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 07:58:41.720205 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5409a5-8cf0-47eb-aa4d-0e41883047c9 None admin] PATH_INFO: `/v3/roles` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 07:58:41.720760 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d4613d-b735-4894-ac65-fe81969bbc96 None None] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 07:58:41.721341 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c5409a5-8cf0-47eb-aa4d-0e41883047c9 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 07:58:41.721852 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c5409a5-8cf0-47eb-aa4d-0e41883047c9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 07:58:41.723582 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c5409a5-8cf0-47eb-aa4d-0e41883047c9 None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 07:58:41.738373 dv-cinder-851351-1-smb devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 123/226] 10.222.0.42 () {56 vars in 1099 bytes} [Thu Jul 28 07:58:41 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 07:58:41.741597 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5409a5-8cf0-47eb-aa4d-0e41883047c9 None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 07:58:41.845634 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=100 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 07:58:41.865690 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5409a5-8cf0-47eb-aa4d-0e41883047c9 None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 07:58:41.894536 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 07:58:41.897478 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d4613d-b735-4894-ac65-fe81969bbc96 None None] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 07:58:41.909972 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e700cc-1ddd-4b56-8000-c0de54f9926f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 07:58:41.910556 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e700cc-1ddd-4b56-8000-c0de54f9926f None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 07:58:41.910830 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e700cc-1ddd-4b56-8000-c0de54f9926f None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 07:58:41.911095 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e700cc-1ddd-4b56-8000-c0de54f9926f None admin] PATH_INFO: `/v3/users/de2d55af03cf485a9034cf3e0357ced9` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 07:58:41.912274 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26e700cc-1ddd-4b56-8000-c0de54f9926f None admin] RBAC: Authorizing `identity:get_user(user_id=de2d55af03cf485a9034cf3e0357ced9)` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 07:58:41.913743 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26e700cc-1ddd-4b56-8000-c0de54f9926f None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 07:58:41.915375 dv-cinder-851351-1-smb devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 124/227] 10.222.0.42 () {56 vars in 1177 bytes} [Thu Jul 28 07:58:41 2022] GET /identity/v3/users/de2d55af03cf485a9034cf3e0357ced9 => generated 283 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 07:58:41.929684 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e700cc-1ddd-4b56-8000-c0de54f9926f None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 07:58:41.954209 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b543395-04ff-4f3f-87c8-97953feb16a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 07:58:41.954867 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b543395-04ff-4f3f-87c8-97953feb16a0 None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 07:58:41.955136 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b543395-04ff-4f3f-87c8-97953feb16a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 07:58:41.955400 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b543395-04ff-4f3f-87c8-97953feb16a0 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 07:58:41.976739 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b543395-04ff-4f3f-87c8-97953feb16a0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 07:58:41.981769 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application [None req-7b543395-04ff-4f3f-87c8-97953feb16a0 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 28 07:58:41.981769 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 07:58:41.981769 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 07:58:41.981769 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 07:58:41.981769 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 07:58:41.981769 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 07:58:41.981769 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 07:58:41.981769 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 07:58:41.981769 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 07:58:41.981769 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 07:58:41.981769 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 07:58:41.981769 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 07:58:41.981769 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 07:58:41.981769 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 07:58:41.981769 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 07:58:41.981769 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 07:58:41.982677 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 07:58:41.982677 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 07:58:41.982677 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 07:58:41.982677 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 07:58:41.982677 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 07:58:41.982677 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 07:58:41.982677 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 07:58:41.982677 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 07:58:41.982677 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 07:58:41.982677 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 07:58:41.982677 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 07:58:41.982677 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application with Lock( Jul 28 07:58:41.982677 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 07:58:41.982677 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self._enter() Jul 28 07:58:41.982677 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 07:58:41.982677 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 07:58:41.983459 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 07:58:41.983459 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.creator() Jul 28 07:58:41.983459 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 07:58:41.983459 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application created_value = creator( Jul 28 07:58:41.983459 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 07:58:41.983459 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 07:58:41.983459 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 07:58:41.983459 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 07:58:41.983459 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 07:58:41.983459 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 07:58:41.983459 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 28 07:58:41.983459 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application Jul 28 07:58:41.983459 dv-cinder-851351-1-smb devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 104/228] 10.222.0.42 () {56 vars in 1114 bytes} [Thu Jul 28 07:58:41 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 263 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 07:58:41.992082 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b543395-04ff-4f3f-87c8-97953feb16a0 None admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 07:58:42.108747 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e700cc-1ddd-4b56-8000-c0de54f9926f None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 07:58:42.178801 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b543395-04ff-4f3f-87c8-97953feb16a0 None admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 07:58:42.181864 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-281d4a63-7c74-4677-8710-d328c5d5902e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 07:58:42.182522 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281d4a63-7c74-4677-8710-d328c5d5902e None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 07:58:42.182802 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281d4a63-7c74-4677-8710-d328c5d5902e None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 07:58:42.183067 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281d4a63-7c74-4677-8710-d328c5d5902e None admin] PATH_INFO: `/v3/projects/0f988f0c81614261ae36a6896770b2d0` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 07:58:42.184987 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-281d4a63-7c74-4677-8710-d328c5d5902e None admin] RBAC: Authorizing `identity:get_project(project_id=0f988f0c81614261ae36a6896770b2d0)` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 07:58:42.186510 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-281d4a63-7c74-4677-8710-d328c5d5902e None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 07:58:42.192860 dv-cinder-851351-1-smb devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 125/229] 10.222.0.42 () {56 vars in 1186 bytes} [Thu Jul 28 07:58:41 2022] GET /identity/v3/projects/0f988f0c81614261ae36a6896770b2d0 => generated 302 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 07:58:42.197938 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-281d4a63-7c74-4677-8710-d328c5d5902e None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 07:58:42.243394 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c381171d-5ce7-447b-87fc-f13bbcd4ed69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 07:58:42.244025 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c381171d-5ce7-447b-87fc-f13bbcd4ed69 None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 07:58:42.244305 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c381171d-5ce7-447b-87fc-f13bbcd4ed69 None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 07:58:42.244574 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c381171d-5ce7-447b-87fc-f13bbcd4ed69 None admin] PATH_INFO: `/v3/roles` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 07:58:42.245377 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c381171d-5ce7-447b-87fc-f13bbcd4ed69 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80348) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 07:58:42.245681 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c381171d-5ce7-447b-87fc-f13bbcd4ed69 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 07:58:42.247353 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c381171d-5ce7-447b-87fc-f13bbcd4ed69 None admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 07:58:42.249779 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=100 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 07:58:42.263111 dv-cinder-851351-1-smb devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 105/230] 10.222.0.42 () {56 vars in 1111 bytes} [Thu Jul 28 07:58:41 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 07:58:42.268099 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c381171d-5ce7-447b-87fc-f13bbcd4ed69 None admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 07:58:42.317019 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 07:58:42.374890 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-281d4a63-7c74-4677-8710-d328c5d5902e None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 07:58:42.417998 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2529f734-b3b2-4f65-81b8-4038c23578dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 07:58:42.418593 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2529f734-b3b2-4f65-81b8-4038c23578dd None admin] REQUEST_METHOD: `PUT` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 07:58:42.418875 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2529f734-b3b2-4f65-81b8-4038c23578dd None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 07:58:42.419149 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2529f734-b3b2-4f65-81b8-4038c23578dd None admin] PATH_INFO: `/v3/projects/0f988f0c81614261ae36a6896770b2d0/users/de2d55af03cf485a9034cf3e0357ced9/roles/362bd71ac01249fb8fa635381993eec1` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 07:58:42.421188 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2529f734-b3b2-4f65-81b8-4038c23578dd None admin] RBAC: Authorizing `identity:create_grant(project_id=0f988f0c81614261ae36a6896770b2d0, user_id=de2d55af03cf485a9034cf3e0357ced9, role_id=362bd71ac01249fb8fa635381993eec1)` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 07:58:42.422817 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2529f734-b3b2-4f65-81b8-4038c23578dd None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 07:58:42.434629 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c381171d-5ce7-447b-87fc-f13bbcd4ed69 None admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 07:58:42.438598 dv-cinder-851351-1-smb devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 126/231] 10.222.0.42 () {58 vars in 1439 bytes} [Thu Jul 28 07:58:42 2022] PUT /identity/v3/projects/0f988f0c81614261ae36a6896770b2d0/users/de2d55af03cf485a9034cf3e0357ced9/roles/362bd71ac01249fb8fa635381993eec1 => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 28 07:58:42.474990 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35cecadd-8a5c-4bc0-95b5-7ee958dc0edc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 07:58:42.475659 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35cecadd-8a5c-4bc0-95b5-7ee958dc0edc None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 07:58:42.475934 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35cecadd-8a5c-4bc0-95b5-7ee958dc0edc None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 07:58:42.476205 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35cecadd-8a5c-4bc0-95b5-7ee958dc0edc None admin] PATH_INFO: `/v3/users/de2d55af03cf485a9034cf3e0357ced9` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 07:58:42.477555 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35cecadd-8a5c-4bc0-95b5-7ee958dc0edc None admin] RBAC: Authorizing `identity:get_user(user_id=de2d55af03cf485a9034cf3e0357ced9)` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 07:58:42.479041 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35cecadd-8a5c-4bc0-95b5-7ee958dc0edc None admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 07:58:42.481125 dv-cinder-851351-1-smb devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 106/232] 10.222.0.42 () {56 vars in 1177 bytes} [Thu Jul 28 07:58:42 2022] GET /identity/v3/users/de2d55af03cf485a9034cf3e0357ced9 => generated 283 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 07:58:42.486610 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2529f734-b3b2-4f65-81b8-4038c23578dd None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 07:58:42.648026 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2529f734-b3b2-4f65-81b8-4038c23578dd None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 07:58:42.675027 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 07:58:42.688249 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b494aad-7304-4c7d-b4b3-14d15b4a84b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 07:58:42.689396 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b494aad-7304-4c7d-b4b3-14d15b4a84b5 None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 07:58:42.690117 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b494aad-7304-4c7d-b4b3-14d15b4a84b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 07:58:42.690389 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b494aad-7304-4c7d-b4b3-14d15b4a84b5 None admin] PATH_INFO: `/v3/projects/0f988f0c81614261ae36a6896770b2d0` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 07:58:42.691588 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b494aad-7304-4c7d-b4b3-14d15b4a84b5 None admin] RBAC: Authorizing `identity:get_project(project_id=0f988f0c81614261ae36a6896770b2d0)` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 07:58:42.693077 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b494aad-7304-4c7d-b4b3-14d15b4a84b5 None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 07:58:42.694960 dv-cinder-851351-1-smb devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 127/233] 10.222.0.42 () {56 vars in 1186 bytes} [Thu Jul 28 07:58:42 2022] GET /identity/v3/projects/0f988f0c81614261ae36a6896770b2d0 => generated 302 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 07:58:42.700645 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35cecadd-8a5c-4bc0-95b5-7ee958dc0edc None admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 07:58:42.770204 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=100 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 07:58:42.821366 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35cecadd-8a5c-4bc0-95b5-7ee958dc0edc None admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 07:58:42.861045 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f455677e-ff8a-45a3-9a11-ef7aa99eaecc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 07:58:42.861808 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f455677e-ff8a-45a3-9a11-ef7aa99eaecc None admin] REQUEST_METHOD: `PUT` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 07:58:42.862087 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f455677e-ff8a-45a3-9a11-ef7aa99eaecc None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 07:58:42.862353 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f455677e-ff8a-45a3-9a11-ef7aa99eaecc None admin] PATH_INFO: `/v3/projects/0f988f0c81614261ae36a6896770b2d0/users/de2d55af03cf485a9034cf3e0357ced9/roles/f28d669937b942878bcf6a9103012af9` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 07:58:42.864687 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f455677e-ff8a-45a3-9a11-ef7aa99eaecc None admin] RBAC: Authorizing `identity:create_grant(project_id=0f988f0c81614261ae36a6896770b2d0, user_id=de2d55af03cf485a9034cf3e0357ced9, role_id=f28d669937b942878bcf6a9103012af9)` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 07:58:42.866164 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f455677e-ff8a-45a3-9a11-ef7aa99eaecc None admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 07:58:42.887134 dv-cinder-851351-1-smb devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 107/234] 10.222.0.42 () {58 vars in 1439 bytes} [Thu Jul 28 07:58:42 2022] PUT /identity/v3/projects/0f988f0c81614261ae36a6896770b2d0/users/de2d55af03cf485a9034cf3e0357ced9/roles/f28d669937b942878bcf6a9103012af9 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 28 07:58:42.951507 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91db4f6-7868-4c9f-bbe5-66caf5b64bcf None None] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 07:58:42.951802 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91db4f6-7868-4c9f-bbe5-66caf5b64bcf None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 07:58:42.951978 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91db4f6-7868-4c9f-bbe5-66caf5b64bcf None None] PATH_INFO: `/` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 07:58:42.953758 dv-cinder-851351-1-smb devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 128/235] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 07:58:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 07:58:42.959828 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b5052f-3abc-4848-bbc6-0dcfd0cd45eb None None] REQUEST_METHOD: `POST` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 07:58:42.960150 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b5052f-3abc-4848-bbc6-0dcfd0cd45eb None None] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 07:58:42.960382 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b5052f-3abc-4848-bbc6-0dcfd0cd45eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 07:58:42.989972 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.auth.core [None req-e3b5052f-3abc-4848-bbc6-0dcfd0cd45eb None None] MFA Rules not processed for user `f0666d3a50644a7097367331c1ee1a68`. Rule list: `[]` (Enabled: `True`). {{(pid=80348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 07:58:42.991221 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.fernet_utils [None req-e3b5052f-3abc-4848-bbc6-0dcfd0cd45eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 07:58:43.086676 dv-cinder-851351-1-smb devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 108/236] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 07:58:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 07:58:43.110934 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91db4f6-7868-4c9f-bbe5-66caf5b64bcf None None] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 07:58:43.210479 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29527c9-9369-4629-abc1-17453b331b47 None None] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 07:58:43.210977 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29527c9-9369-4629-abc1-17453b331b47 None None] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 07:58:43.210977 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29527c9-9369-4629-abc1-17453b331b47 None None] PATH_INFO: `/` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 07:58:43.212303 dv-cinder-851351-1-smb devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 109/237] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 07:58:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 28 07:58:43.218386 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32620b00-9aca-45df-9381-3869d4db1f83 None None] REQUEST_METHOD: `POST` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 07:58:43.218386 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32620b00-9aca-45df-9381-3869d4db1f83 None None] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 07:58:43.218638 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32620b00-9aca-45df-9381-3869d4db1f83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 07:58:43.239069 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91db4f6-7868-4c9f-bbe5-66caf5b64bcf None None] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 07:58:43.239273 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.auth.core [None req-32620b00-9aca-45df-9381-3869d4db1f83 None None] MFA Rules not processed for user `f0666d3a50644a7097367331c1ee1a68`. Rule list: `[]` (Enabled: `True`). {{(pid=80348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 07:58:43.240397 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.fernet_utils [None req-32620b00-9aca-45df-9381-3869d4db1f83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 07:58:43.302103 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 07:58:43.303073 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-597d1c0c-9e5e-43f2-bf85-08fc69575c7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 07:58:43.303732 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597d1c0c-9e5e-43f2-bf85-08fc69575c7b None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 07:58:43.304004 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597d1c0c-9e5e-43f2-bf85-08fc69575c7b None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 07:58:43.304272 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597d1c0c-9e5e-43f2-bf85-08fc69575c7b None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 07:58:43.313760 dv-cinder-851351-1-smb devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 110/238] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 07:58:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 07:58:43.328693 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-597d1c0c-9e5e-43f2-bf85-08fc69575c7b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 07:58:43.334508 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application [None req-597d1c0c-9e5e-43f2-bf85-08fc69575c7b None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 28 07:58:43.334508 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 07:58:43.334508 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 07:58:43.334508 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 07:58:43.334508 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 07:58:43.334508 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 07:58:43.334508 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 07:58:43.334508 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 07:58:43.334508 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 07:58:43.334508 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 07:58:43.334508 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 07:58:43.334508 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 07:58:43.334508 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 07:58:43.334508 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 07:58:43.334508 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 07:58:43.334508 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 07:58:43.335362 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 07:58:43.335362 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 07:58:43.335362 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 07:58:43.335362 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 07:58:43.335362 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 07:58:43.335362 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 07:58:43.335362 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 07:58:43.335362 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 07:58:43.335362 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 07:58:43.335362 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 07:58:43.335362 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 07:58:43.335362 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application with Lock( Jul 28 07:58:43.335362 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 07:58:43.335362 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._enter() Jul 28 07:58:43.335362 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 07:58:43.335362 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 07:58:43.336135 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 07:58:43.336135 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.creator() Jul 28 07:58:43.336135 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 07:58:43.336135 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application created_value = creator( Jul 28 07:58:43.336135 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 07:58:43.336135 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 07:58:43.336135 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 07:58:43.336135 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 07:58:43.336135 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 07:58:43.336135 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 07:58:43.336135 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 28 07:58:43.336135 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application Jul 28 07:58:43.336135 dv-cinder-851351-1-smb devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 129/239] 10.222.0.42 () {56 vars in 1099 bytes} [Thu Jul 28 07:58:43 2022] GET /identity/v3/roles/reader => generated 84 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 07:58:43.338380 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32620b00-9aca-45df-9381-3869d4db1f83 None None] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 07:58:43.342221 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-597d1c0c-9e5e-43f2-bf85-08fc69575c7b None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 07:58:43.457997 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 07:58:43.468978 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32620b00-9aca-45df-9381-3869d4db1f83 None None] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 07:58:43.507665 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3e8c78-9d3e-4567-ada0-454fb7a7cc7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 07:58:43.508329 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3e8c78-9d3e-4567-ada0-454fb7a7cc7b None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 07:58:43.508606 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3e8c78-9d3e-4567-ada0-454fb7a7cc7b None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 07:58:43.508924 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3e8c78-9d3e-4567-ada0-454fb7a7cc7b None admin] PATH_INFO: `/v3/domains/default` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 07:58:43.510076 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf3e8c78-9d3e-4567-ada0-454fb7a7cc7b None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 07:58:43.511554 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf3e8c78-9d3e-4567-ada0-454fb7a7cc7b None admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 07:58:43.513645 dv-cinder-851351-1-smb devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 111/240] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 07:58:43 2022] GET /identity/v3/domains/default => generated 199 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 07:58:43.518982 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3e8c78-9d3e-4567-ada0-454fb7a7cc7b None admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 07:58:43.562857 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-597d1c0c-9e5e-43f2-bf85-08fc69575c7b None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 07:58:43.580704 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=100 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 07:58:43.620347 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3e8c78-9d3e-4567-ada0-454fb7a7cc7b None admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 07:58:43.655232 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f30acac-d45a-4f21-8427-1e6130ba6bda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 07:58:43.656002 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f30acac-d45a-4f21-8427-1e6130ba6bda None admin] REQUEST_METHOD: `POST` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 07:58:43.656494 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f30acac-d45a-4f21-8427-1e6130ba6bda None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 07:58:43.656823 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f30acac-d45a-4f21-8427-1e6130ba6bda None admin] PATH_INFO: `/v3/users` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 07:58:43.657531 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f30acac-d45a-4f21-8427-1e6130ba6bda None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 07:58:43.659204 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f30acac-d45a-4f21-8427-1e6130ba6bda None admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 07:58:43.659313 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a52c4978-f772-4f99-8aef-6b1a03ea4bf8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 07:58:43.659891 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52c4978-f772-4f99-8aef-6b1a03ea4bf8 None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 07:58:43.660168 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52c4978-f772-4f99-8aef-6b1a03ea4bf8 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 07:58:43.660439 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52c4978-f772-4f99-8aef-6b1a03ea4bf8 None admin] PATH_INFO: `/v3/roles` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 07:58:43.661208 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a52c4978-f772-4f99-8aef-6b1a03ea4bf8 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 07:58:43.661513 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a52c4978-f772-4f99-8aef-6b1a03ea4bf8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 07:58:43.662882 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a52c4978-f772-4f99-8aef-6b1a03ea4bf8 None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 07:58:43.671875 dv-cinder-851351-1-smb devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 130/241] 10.222.0.42 () {56 vars in 1101 bytes} [Thu Jul 28 07:58:43 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 330 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 07:58:43.674144 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5389a0-3049-410e-ac91-9bc47c289433 None None] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 07:58:43.674478 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5389a0-3049-410e-ac91-9bc47c289433 None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 07:58:43.674754 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5389a0-3049-410e-ac91-9bc47c289433 None None] PATH_INFO: `/` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 07:58:43.676297 dv-cinder-851351-1-smb devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 131/242] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 07:58:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 07:58:43.677573 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d5389a0-3049-410e-ac91-9bc47c289433 None None] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 07:58:43.689655 dv-cinder-851351-1-smb devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 112/243] 10.222.0.42 () {60 vars in 1132 bytes} [Thu Jul 28 07:58:43 2022] POST /identity/v3/users => generated 293 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 28 07:58:43.690767 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eec77a7-232e-4bec-9e00-c4b37fb137bd None None] REQUEST_METHOD: `POST` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 07:58:43.691051 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eec77a7-232e-4bec-9e00-c4b37fb137bd None None] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 07:58:43.691323 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eec77a7-232e-4bec-9e00-c4b37fb137bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 07:58:43.753875 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.auth.core [None req-9eec77a7-232e-4bec-9e00-c4b37fb137bd None None] MFA Rules not processed for user `f0666d3a50644a7097367331c1ee1a68`. Rule list: `[]` (Enabled: `True`). {{(pid=80348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 07:58:43.755007 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.fernet_utils [None req-9eec77a7-232e-4bec-9e00-c4b37fb137bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 07:58:43.807042 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d5389a0-3049-410e-ac91-9bc47c289433 None None] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 07:58:43.838563 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 07:58:43.850485 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cddd3790-1fe4-456a-8b85-c0b07e2d2fbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 07:58:43.851161 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cddd3790-1fe4-456a-8b85-c0b07e2d2fbe None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 07:58:43.851448 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cddd3790-1fe4-456a-8b85-c0b07e2d2fbe None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 07:58:43.851729 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cddd3790-1fe4-456a-8b85-c0b07e2d2fbe None admin] PATH_INFO: `/v3/users/24750ef6d6e646208a4d86eb0e2e3757` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 07:58:43.871335 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cddd3790-1fe4-456a-8b85-c0b07e2d2fbe None admin] RBAC: Authorizing `identity:get_user(user_id=24750ef6d6e646208a4d86eb0e2e3757)` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 07:58:43.872988 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cddd3790-1fe4-456a-8b85-c0b07e2d2fbe None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 07:58:43.875205 dv-cinder-851351-1-smb devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 132/244] 10.222.0.42 () {56 vars in 1177 bytes} [Thu Jul 28 07:58:43 2022] GET /identity/v3/users/24750ef6d6e646208a4d86eb0e2e3757 => generated 297 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 07:58:43.880977 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cddd3790-1fe4-456a-8b85-c0b07e2d2fbe None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 07:58:43.946735 dv-cinder-851351-1-smb devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 113/245] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 07:58:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 257 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 07:58:43.979299 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eec77a7-232e-4bec-9e00-c4b37fb137bd None None] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 07:58:44.002448 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cddd3790-1fe4-456a-8b85-c0b07e2d2fbe None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 07:58:44.026318 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 07:58:44.040473 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b99f5bc-3b59-41f8-be4d-18cffb97cb15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 07:58:44.041456 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b99f5bc-3b59-41f8-be4d-18cffb97cb15 None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 07:58:44.041957 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b99f5bc-3b59-41f8-be4d-18cffb97cb15 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 07:58:44.042433 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b99f5bc-3b59-41f8-be4d-18cffb97cb15 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 07:58:44.094551 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eec77a7-232e-4bec-9e00-c4b37fb137bd None None] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 07:58:44.097066 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 07:58:44.115925 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b99f5bc-3b59-41f8-be4d-18cffb97cb15 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 07:58:44.117564 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b99f5bc-3b59-41f8-be4d-18cffb97cb15 None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 07:58:44.137867 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f1bbfd-930e-47a8-ac4b-2fd2760720c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 07:58:44.138702 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f1bbfd-930e-47a8-ac4b-2fd2760720c3 None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 07:58:44.139115 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f1bbfd-930e-47a8-ac4b-2fd2760720c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 07:58:44.139391 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f1bbfd-930e-47a8-ac4b-2fd2760720c3 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 07:58:44.156508 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f1bbfd-930e-47a8-ac4b-2fd2760720c3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 07:58:44.161721 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application [None req-b9f1bbfd-930e-47a8-ac4b-2fd2760720c3 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 28 07:58:44.161721 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 07:58:44.161721 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 07:58:44.161721 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 07:58:44.161721 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 07:58:44.161721 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 07:58:44.161721 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 07:58:44.161721 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 07:58:44.161721 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 07:58:44.161721 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 07:58:44.161721 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 07:58:44.161721 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 07:58:44.161721 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 07:58:44.161721 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 07:58:44.161721 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 07:58:44.161721 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 07:58:44.162558 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 07:58:44.162558 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 07:58:44.162558 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 07:58:44.162558 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 07:58:44.162558 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 07:58:44.162558 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 07:58:44.162558 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 07:58:44.162558 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 07:58:44.162558 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 07:58:44.162558 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 07:58:44.162558 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 07:58:44.162558 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application with Lock( Jul 28 07:58:44.162558 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 07:58:44.162558 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self._enter() Jul 28 07:58:44.162558 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 07:58:44.162558 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 07:58:44.163750 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 07:58:44.163750 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.creator() Jul 28 07:58:44.163750 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 07:58:44.163750 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application created_value = creator( Jul 28 07:58:44.163750 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 07:58:44.163750 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 07:58:44.163750 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 07:58:44.163750 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 07:58:44.163750 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 07:58:44.163750 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 07:58:44.163750 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 28 07:58:44.163750 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application Jul 28 07:58:44.163750 dv-cinder-851351-1-smb devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 114/246] 10.222.0.42 () {56 vars in 1099 bytes} [Thu Jul 28 07:58:43 2022] GET /identity/v3/roles/member => generated 84 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 07:58:44.169153 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f1bbfd-930e-47a8-ac4b-2fd2760720c3 None admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 07:58:44.258258 dv-cinder-851351-1-smb devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 133/247] 10.222.0.42 () {58 vars in 1282 bytes} [Thu Jul 28 07:58:43 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 378 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 28 07:58:44.267613 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b99f5bc-3b59-41f8-be4d-18cffb97cb15 None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 07:58:44.293123 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=100 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 07:58:44.299819 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f1bbfd-930e-47a8-ac4b-2fd2760720c3 None admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 07:58:44.347940 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335f4e36-6918-429b-b69f-af58db05b738 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 07:58:44.348583 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335f4e36-6918-429b-b69f-af58db05b738 None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 07:58:44.348895 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335f4e36-6918-429b-b69f-af58db05b738 None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 07:58:44.349415 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335f4e36-6918-429b-b69f-af58db05b738 None admin] PATH_INFO: `/v3/roles` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 07:58:44.350909 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 07:58:44.352263 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-335f4e36-6918-429b-b69f-af58db05b738 None admin] RBAC: Adding query filter params (name=member) {{(pid=80348) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 07:58:44.352579 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-335f4e36-6918-429b-b69f-af58db05b738 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 07:58:44.356242 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-335f4e36-6918-429b-b69f-af58db05b738 None admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 07:58:44.372006 dv-cinder-851351-1-smb devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 115/248] 10.222.0.42 () {56 vars in 1101 bytes} [Thu Jul 28 07:58:44 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 07:58:44.373791 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335f4e36-6918-429b-b69f-af58db05b738 None admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 07:58:44.397623 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b99f5bc-3b59-41f8-be4d-18cffb97cb15 None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 07:58:44.441958 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d5ca23-b1ee-4648-9111-5f8997b1c5bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 07:58:44.442878 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d5ca23-b1ee-4648-9111-5f8997b1c5bc None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 07:58:44.443163 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d5ca23-b1ee-4648-9111-5f8997b1c5bc None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 07:58:44.443434 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d5ca23-b1ee-4648-9111-5f8997b1c5bc None admin] PATH_INFO: `/v3/projects/0f988f0c81614261ae36a6896770b2d0` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 07:58:44.444807 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d5ca23-b1ee-4648-9111-5f8997b1c5bc None admin] RBAC: Authorizing `identity:get_project(project_id=0f988f0c81614261ae36a6896770b2d0)` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 07:58:44.446896 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d5ca23-b1ee-4648-9111-5f8997b1c5bc None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 07:58:44.448642 dv-cinder-851351-1-smb devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 134/249] 10.222.0.42 () {56 vars in 1186 bytes} [Thu Jul 28 07:58:44 2022] GET /identity/v3/projects/0f988f0c81614261ae36a6896770b2d0 => generated 302 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 07:58:44.455304 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d5ca23-b1ee-4648-9111-5f8997b1c5bc None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 07:58:44.492747 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335f4e36-6918-429b-b69f-af58db05b738 None admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 07:58:44.532961 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f96b379-6f0d-4201-8b87-532d6b936ed2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 07:58:44.534636 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f96b379-6f0d-4201-8b87-532d6b936ed2 None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 07:58:44.535150 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f96b379-6f0d-4201-8b87-532d6b936ed2 None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 07:58:44.535626 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f96b379-6f0d-4201-8b87-532d6b936ed2 None admin] PATH_INFO: `/v3/users/e9b221388e024aceac3955820b6d91b3` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 07:58:44.537486 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f96b379-6f0d-4201-8b87-532d6b936ed2 None admin] RBAC: Authorizing `identity:get_user(user_id=e9b221388e024aceac3955820b6d91b3)` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 07:58:44.539503 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f96b379-6f0d-4201-8b87-532d6b936ed2 None admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 07:58:44.541923 dv-cinder-851351-1-smb devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 116/250] 10.222.0.42 () {56 vars in 1177 bytes} [Thu Jul 28 07:58:44 2022] GET /identity/v3/users/e9b221388e024aceac3955820b6d91b3 => generated 297 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 07:58:44.547592 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f96b379-6f0d-4201-8b87-532d6b936ed2 None admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 07:58:44.581387 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=100 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 07:58:44.591484 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d5ca23-b1ee-4648-9111-5f8997b1c5bc None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 07:58:44.642417 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5e1dd1-28ae-4c3c-96a9-6a3fa7a108c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 07:58:44.643056 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5e1dd1-28ae-4c3c-96a9-6a3fa7a108c7 None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 07:58:44.643333 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5e1dd1-28ae-4c3c-96a9-6a3fa7a108c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 07:58:44.643607 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5e1dd1-28ae-4c3c-96a9-6a3fa7a108c7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 07:58:44.644416 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b5e1dd1-28ae-4c3c-96a9-6a3fa7a108c7 None admin] RBAC: Adding query filter params (role.id=21c3f6dd315a425a98d00fcf994f3a36, scope.project.id=0f988f0c81614261ae36a6896770b2d0, user.id=24750ef6d6e646208a4d86eb0e2e3757) {{(pid=80347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 07:58:44.644746 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b5e1dd1-28ae-4c3c-96a9-6a3fa7a108c7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 07:58:44.646195 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b5e1dd1-28ae-4c3c-96a9-6a3fa7a108c7 None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 07:58:44.662777 dv-cinder-851351-1-smb devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 135/251] 10.222.0.42 () {56 vars in 1374 bytes} [Thu Jul 28 07:58:44 2022] GET /identity/v3/role_assignments?user.id=24750ef6d6e646208a4d86eb0e2e3757&scope.project.id=0f988f0c81614261ae36a6896770b2d0&role.id=21c3f6dd315a425a98d00fcf994f3a36 => generated 259 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 07:58:44.679617 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f96b379-6f0d-4201-8b87-532d6b936ed2 None admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 07:58:44.732470 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baecca68-5e97-4d5d-9a76-19920789cec1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 07:58:44.733178 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baecca68-5e97-4d5d-9a76-19920789cec1 None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 07:58:44.733507 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baecca68-5e97-4d5d-9a76-19920789cec1 None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 07:58:44.734003 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baecca68-5e97-4d5d-9a76-19920789cec1 None admin] PATH_INFO: `/v3/projects/0f988f0c81614261ae36a6896770b2d0` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 07:58:44.736022 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baecca68-5e97-4d5d-9a76-19920789cec1 None admin] RBAC: Authorizing `identity:get_project(project_id=0f988f0c81614261ae36a6896770b2d0)` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 07:58:44.737837 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baecca68-5e97-4d5d-9a76-19920789cec1 None admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 07:58:44.739891 dv-cinder-851351-1-smb devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 117/252] 10.222.0.42 () {56 vars in 1186 bytes} [Thu Jul 28 07:58:44 2022] GET /identity/v3/projects/0f988f0c81614261ae36a6896770b2d0 => generated 302 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 07:58:44.745888 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5e1dd1-28ae-4c3c-96a9-6a3fa7a108c7 None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 07:58:44.759215 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 07:58:44.919219 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5e1dd1-28ae-4c3c-96a9-6a3fa7a108c7 None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 07:58:44.954530 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890ef57a-bef3-4037-9292-87d7f2643df1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 07:58:44.955217 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890ef57a-bef3-4037-9292-87d7f2643df1 None admin] REQUEST_METHOD: `PUT` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 07:58:44.955489 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890ef57a-bef3-4037-9292-87d7f2643df1 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 07:58:44.956115 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890ef57a-bef3-4037-9292-87d7f2643df1 None admin] PATH_INFO: `/v3/projects/0f988f0c81614261ae36a6896770b2d0/users/e9b221388e024aceac3955820b6d91b3/roles/0317c30d81ff44eea2fd4a7215c60eac` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 07:58:44.958074 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-890ef57a-bef3-4037-9292-87d7f2643df1 None admin] RBAC: Authorizing `identity:create_grant(project_id=0f988f0c81614261ae36a6896770b2d0, user_id=e9b221388e024aceac3955820b6d91b3, role_id=0317c30d81ff44eea2fd4a7215c60eac)` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 07:58:44.959528 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-890ef57a-bef3-4037-9292-87d7f2643df1 None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 07:58:45.006184 dv-cinder-851351-1-smb devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 136/253] 10.222.0.42 () {58 vars in 1439 bytes} [Thu Jul 28 07:58:44 2022] PUT /identity/v3/projects/0f988f0c81614261ae36a6896770b2d0/users/e9b221388e024aceac3955820b6d91b3/roles/0317c30d81ff44eea2fd4a7215c60eac => generated 0 bytes in 261 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 28 07:58:45.286738 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a2b758-9dde-45ff-97a8-3c0130213760 None None] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 07:58:45.286913 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a2b758-9dde-45ff-97a8-3c0130213760 None None] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 07:58:45.287215 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a2b758-9dde-45ff-97a8-3c0130213760 None None] PATH_INFO: `/` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 07:58:45.288859 dv-cinder-851351-1-smb devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 118/254] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 07:58:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 07:58:45.294307 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43628d23-4864-4e34-8a99-bfa923ef8d7a None None] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 07:58:45.294857 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43628d23-4864-4e34-8a99-bfa923ef8d7a None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 07:58:45.295034 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43628d23-4864-4e34-8a99-bfa923ef8d7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 07:58:45.318640 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.auth.core [None req-43628d23-4864-4e34-8a99-bfa923ef8d7a None None] MFA Rules not processed for user `f0666d3a50644a7097367331c1ee1a68`. Rule list: `[]` (Enabled: `True`). {{(pid=80347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 07:58:45.319109 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-43628d23-4864-4e34-8a99-bfa923ef8d7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 07:58:45.383731 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 07:58:45.396430 dv-cinder-851351-1-smb devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 137/255] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 07:58:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 07:58:45.420159 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a2b758-9dde-45ff-97a8-3c0130213760 None None] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 07:58:45.426433 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57bfb434-26d0-4a98-8668-550713d19df8 None None] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 07:58:45.426723 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57bfb434-26d0-4a98-8668-550713d19df8 None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 07:58:45.427007 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57bfb434-26d0-4a98-8668-550713d19df8 None None] PATH_INFO: `/` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 07:58:45.428521 dv-cinder-851351-1-smb devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 138/256] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 07:58:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 28 07:58:45.433871 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c1f67b-39c2-4110-8217-c8242904d375 None None] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 07:58:45.434150 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c1f67b-39c2-4110-8217-c8242904d375 None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 07:58:45.434421 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c1f67b-39c2-4110-8217-c8242904d375 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 07:58:45.452840 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.auth.core [None req-95c1f67b-39c2-4110-8217-c8242904d375 None None] MFA Rules not processed for user `f0666d3a50644a7097367331c1ee1a68`. Rule list: `[]` (Enabled: `True`). {{(pid=80347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 07:58:45.454030 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-95c1f67b-39c2-4110-8217-c8242904d375 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 07:58:45.535461 dv-cinder-851351-1-smb devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 139/257] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 07:58:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 28 07:58:45.560217 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c1f67b-39c2-4110-8217-c8242904d375 None None] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 07:58:45.566078 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=100 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 07:58:45.586354 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a2b758-9dde-45ff-97a8-3c0130213760 None None] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 07:58:45.675044 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c1f67b-39c2-4110-8217-c8242904d375 None None] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 07:58:45.676063 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640f0003-e565-4263-833f-0a077cd42262 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 07:58:45.676789 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640f0003-e565-4263-833f-0a077cd42262 None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 07:58:45.677074 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640f0003-e565-4263-833f-0a077cd42262 None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 07:58:45.677351 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640f0003-e565-4263-833f-0a077cd42262 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 07:58:45.701262 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 07:58:45.705341 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-640f0003-e565-4263-833f-0a077cd42262 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 07:58:45.712997 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e763556-d4bb-44d3-8914-ba51afcf5ee5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 07:58:45.713265 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application [None req-640f0003-e565-4263-833f-0a077cd42262 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 07:58:45.713265 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 07:58:45.713265 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 07:58:45.713265 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 07:58:45.713265 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 07:58:45.713265 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 07:58:45.713265 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 07:58:45.713265 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 07:58:45.713265 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 07:58:45.713265 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 07:58:45.713265 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 07:58:45.713265 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 07:58:45.713265 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 07:58:45.713265 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 07:58:45.713265 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 07:58:45.713265 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 07:58:45.714103 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 07:58:45.714103 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 07:58:45.714103 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 07:58:45.714103 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 07:58:45.714103 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 07:58:45.714103 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 07:58:45.714103 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 07:58:45.714103 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 07:58:45.714103 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 07:58:45.714103 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 07:58:45.714103 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 07:58:45.714103 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application with Lock( Jul 28 07:58:45.714103 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 07:58:45.714103 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self._enter() Jul 28 07:58:45.714103 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 07:58:45.714103 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 07:58:45.714877 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 07:58:45.714877 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.creator() Jul 28 07:58:45.714877 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 07:58:45.714877 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application created_value = creator( Jul 28 07:58:45.714877 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 07:58:45.714877 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 07:58:45.714877 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 07:58:45.714877 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 07:58:45.714877 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 07:58:45.714877 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 07:58:45.714877 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 07:58:45.714877 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application Jul 28 07:58:45.715462 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e763556-d4bb-44d3-8914-ba51afcf5ee5 None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 07:58:45.715462 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e763556-d4bb-44d3-8914-ba51afcf5ee5 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 07:58:45.715462 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e763556-d4bb-44d3-8914-ba51afcf5ee5 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 07:58:45.715635 dv-cinder-851351-1-smb devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 119/258] 10.222.0.42 () {56 vars in 1096 bytes} [Thu Jul 28 07:58:45 2022] GET /identity/v3/roles/admin => generated 83 bytes in 295 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 07:58:45.721635 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640f0003-e565-4263-833f-0a077cd42262 None admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 07:58:45.725845 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e763556-d4bb-44d3-8914-ba51afcf5ee5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 07:58:45.731380 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application [None req-7e763556-d4bb-44d3-8914-ba51afcf5ee5 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 28 07:58:45.731380 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 07:58:45.731380 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 07:58:45.731380 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 07:58:45.731380 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 07:58:45.731380 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 07:58:45.731380 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 07:58:45.731380 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 07:58:45.731380 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 07:58:45.731380 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 07:58:45.731380 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 07:58:45.731380 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 07:58:45.731380 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 07:58:45.731380 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 07:58:45.731380 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 07:58:45.731380 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 07:58:45.732298 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 07:58:45.732298 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 07:58:45.732298 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 07:58:45.732298 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 07:58:45.732298 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 07:58:45.732298 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 07:58:45.732298 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 07:58:45.732298 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 07:58:45.732298 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 07:58:45.732298 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 07:58:45.732298 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 07:58:45.732298 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application with Lock( Jul 28 07:58:45.732298 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 07:58:45.732298 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._enter() Jul 28 07:58:45.732298 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 07:58:45.732298 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 07:58:45.733111 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 07:58:45.733111 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.creator() Jul 28 07:58:45.733111 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 07:58:45.733111 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application created_value = creator( Jul 28 07:58:45.733111 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 07:58:45.733111 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 07:58:45.733111 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 07:58:45.733111 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 07:58:45.733111 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 07:58:45.733111 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 07:58:45.733111 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 28 07:58:45.733111 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application Jul 28 07:58:45.733111 dv-cinder-851351-1-smb devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 140/259] 10.222.0.42 () {56 vars in 1114 bytes} [Thu Jul 28 07:58:45 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 07:58:45.739751 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e763556-d4bb-44d3-8914-ba51afcf5ee5 None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 07:58:45.852611 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e763556-d4bb-44d3-8914-ba51afcf5ee5 None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 07:58:45.890855 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27575b64-22da-4c29-ad49-36468d139fe7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 07:58:45.891487 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27575b64-22da-4c29-ad49-36468d139fe7 None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 07:58:45.891766 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27575b64-22da-4c29-ad49-36468d139fe7 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 07:58:45.892040 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27575b64-22da-4c29-ad49-36468d139fe7 None admin] PATH_INFO: `/v3/roles` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 07:58:45.892791 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27575b64-22da-4c29-ad49-36468d139fe7 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 07:58:45.893232 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27575b64-22da-4c29-ad49-36468d139fe7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 07:58:45.894888 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27575b64-22da-4c29-ad49-36468d139fe7 None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 07:58:45.908968 dv-cinder-851351-1-smb devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 141/260] 10.222.0.42 () {56 vars in 1111 bytes} [Thu Jul 28 07:58:45 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 07:58:45.910605 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27575b64-22da-4c29-ad49-36468d139fe7 None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 07:58:45.986740 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 07:58:46.012885 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640f0003-e565-4263-833f-0a077cd42262 None admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 07:58:46.023347 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27575b64-22da-4c29-ad49-36468d139fe7 None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 07:58:46.058166 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ea7235-1d5e-4ddb-acb2-c16c2b0ef6d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 07:58:46.058827 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ea7235-1d5e-4ddb-acb2-c16c2b0ef6d9 None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 07:58:46.059204 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ea7235-1d5e-4ddb-acb2-c16c2b0ef6d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 07:58:46.059492 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ea7235-1d5e-4ddb-acb2-c16c2b0ef6d9 None admin] PATH_INFO: `/v3/users/de2d55af03cf485a9034cf3e0357ced9` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 07:58:46.060886 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85ea7235-1d5e-4ddb-acb2-c16c2b0ef6d9 None admin] RBAC: Authorizing `identity:get_user(user_id=de2d55af03cf485a9034cf3e0357ced9)` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 07:58:46.062446 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85ea7235-1d5e-4ddb-acb2-c16c2b0ef6d9 None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 07:58:46.064089 dv-cinder-851351-1-smb devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 142/261] 10.222.0.42 () {56 vars in 1177 bytes} [Thu Jul 28 07:58:45 2022] GET /identity/v3/users/de2d55af03cf485a9034cf3e0357ced9 => generated 283 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 07:58:46.073798 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ea7235-1d5e-4ddb-acb2-c16c2b0ef6d9 None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 07:58:46.078675 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3c4d80-00cb-4346-84c2-ce64ce091c32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 07:58:46.079318 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3c4d80-00cb-4346-84c2-ce64ce091c32 None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 07:58:46.079598 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3c4d80-00cb-4346-84c2-ce64ce091c32 None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 07:58:46.079873 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3c4d80-00cb-4346-84c2-ce64ce091c32 None admin] PATH_INFO: `/v3/roles` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 07:58:46.080606 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b3c4d80-00cb-4346-84c2-ce64ce091c32 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80348) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 07:58:46.081341 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b3c4d80-00cb-4346-84c2-ce64ce091c32 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 07:58:46.082797 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b3c4d80-00cb-4346-84c2-ce64ce091c32 None admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 07:58:46.100557 dv-cinder-851351-1-smb devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 120/262] 10.222.0.42 () {56 vars in 1099 bytes} [Thu Jul 28 07:58:45 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 379 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 07:58:46.105903 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3c4d80-00cb-4346-84c2-ce64ce091c32 None admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 07:58:46.141777 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=100 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 07:58:46.293535 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ea7235-1d5e-4ddb-acb2-c16c2b0ef6d9 None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 07:58:46.325031 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 07:58:46.333091 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f832863-776a-46b2-a7ef-b575fb5573b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 07:58:46.333783 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f832863-776a-46b2-a7ef-b575fb5573b1 None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 07:58:46.334062 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f832863-776a-46b2-a7ef-b575fb5573b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 07:58:46.334332 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f832863-776a-46b2-a7ef-b575fb5573b1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 07:58:46.378792 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3c4d80-00cb-4346-84c2-ce64ce091c32 None admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 07:58:46.444082 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f832863-776a-46b2-a7ef-b575fb5573b1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 07:58:46.446099 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f832863-776a-46b2-a7ef-b575fb5573b1 None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 07:58:46.494693 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f61d0b-73f3-4f20-b14b-c8d0bdcceb22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 07:58:46.495406 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f61d0b-73f3-4f20-b14b-c8d0bdcceb22 None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 07:58:46.495625 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f61d0b-73f3-4f20-b14b-c8d0bdcceb22 None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 07:58:46.495900 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f61d0b-73f3-4f20-b14b-c8d0bdcceb22 None admin] PATH_INFO: `/v3/users/de2d55af03cf485a9034cf3e0357ced9` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 07:58:46.501382 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35f61d0b-73f3-4f20-b14b-c8d0bdcceb22 None admin] RBAC: Authorizing `identity:get_user(user_id=de2d55af03cf485a9034cf3e0357ced9)` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 07:58:46.502881 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35f61d0b-73f3-4f20-b14b-c8d0bdcceb22 None admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 07:58:46.504883 dv-cinder-851351-1-smb devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 121/263] 10.222.0.42 () {56 vars in 1177 bytes} [Thu Jul 28 07:58:46 2022] GET /identity/v3/users/de2d55af03cf485a9034cf3e0357ced9 => generated 283 bytes in 399 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 07:58:46.510086 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f61d0b-73f3-4f20-b14b-c8d0bdcceb22 None admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 07:58:46.637539 dv-cinder-851351-1-smb devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 143/264] 10.222.0.42 () {58 vars in 1282 bytes} [Thu Jul 28 07:58:46 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 564 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 28 07:58:46.645765 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f832863-776a-46b2-a7ef-b575fb5573b1 None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 07:58:46.685064 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 07:58:46.729802 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=100 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 07:58:46.783256 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f61d0b-73f3-4f20-b14b-c8d0bdcceb22 None admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 07:58:46.804384 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f832863-776a-46b2-a7ef-b575fb5573b1 None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 07:58:46.857469 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b99282-bc4f-4ef7-8bec-f8d885ac9ae8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 07:58:46.858119 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b99282-bc4f-4ef7-8bec-f8d885ac9ae8 None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 07:58:46.858405 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b99282-bc4f-4ef7-8bec-f8d885ac9ae8 None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 07:58:46.858682 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b99282-bc4f-4ef7-8bec-f8d885ac9ae8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 07:58:46.886996 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-326567ce-690d-41b6-9718-c816b256376f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 07:58:46.887716 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326567ce-690d-41b6-9718-c816b256376f None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 07:58:46.887943 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326567ce-690d-41b6-9718-c816b256376f None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 07:58:46.888218 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326567ce-690d-41b6-9718-c816b256376f None admin] PATH_INFO: `/v3/projects/0f988f0c81614261ae36a6896770b2d0` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 07:58:46.890438 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-326567ce-690d-41b6-9718-c816b256376f None admin] RBAC: Authorizing `identity:get_project(project_id=0f988f0c81614261ae36a6896770b2d0)` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 07:58:46.891994 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-326567ce-690d-41b6-9718-c816b256376f None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 07:58:46.894239 dv-cinder-851351-1-smb devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 144/265] 10.222.0.42 () {56 vars in 1186 bytes} [Thu Jul 28 07:58:46 2022] GET /identity/v3/projects/0f988f0c81614261ae36a6896770b2d0 => generated 302 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 07:58:46.895388 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a6aae2-9338-4a51-87cb-20429e62f4e5 None None] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 07:58:46.895769 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a6aae2-9338-4a51-87cb-20429e62f4e5 None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 07:58:46.896046 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a6aae2-9338-4a51-87cb-20429e62f4e5 None None] PATH_INFO: `/` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 07:58:46.904432 dv-cinder-851351-1-smb devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 145/266] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 07:58:46 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 07:58:46.910131 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fac8787-0d50-41f3-8ecd-87bb27bddbd6 None None] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 07:58:46.910420 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fac8787-0d50-41f3-8ecd-87bb27bddbd6 None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 07:58:46.910694 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fac8787-0d50-41f3-8ecd-87bb27bddbd6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 07:58:46.939910 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47b99282-bc4f-4ef7-8bec-f8d885ac9ae8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 07:58:46.941460 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47b99282-bc4f-4ef7-8bec-f8d885ac9ae8 None admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 07:58:46.950650 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.auth.core [None req-3fac8787-0d50-41f3-8ecd-87bb27bddbd6 None None] MFA Rules not processed for user `f0666d3a50644a7097367331c1ee1a68`. Rule list: `[]` (Enabled: `True`). {{(pid=80347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 07:58:46.952169 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-3fac8787-0d50-41f3-8ecd-87bb27bddbd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 07:58:47.043342 dv-cinder-851351-1-smb devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 122/267] 10.222.0.42 () {58 vars in 1282 bytes} [Thu Jul 28 07:58:46 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 533 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 28 07:58:47.044274 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b99282-bc4f-4ef7-8bec-f8d885ac9ae8 None admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 07:58:47.053200 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=100 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 07:58:47.090465 dv-cinder-851351-1-smb devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 146/268] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 07:58:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 07:58:47.091460 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fac8787-0d50-41f3-8ecd-87bb27bddbd6 None None] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 07:58:47.111213 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 07:58:47.155628 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b99282-bc4f-4ef7-8bec-f8d885ac9ae8 None admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 07:58:47.223159 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947ab4d1-67ce-445f-9b82-7022af54c699 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 07:58:47.223789 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947ab4d1-67ce-445f-9b82-7022af54c699 None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 07:58:47.224067 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947ab4d1-67ce-445f-9b82-7022af54c699 None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 07:58:47.224338 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947ab4d1-67ce-445f-9b82-7022af54c699 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 07:58:47.225168 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-947ab4d1-67ce-445f-9b82-7022af54c699 None admin] RBAC: Adding query filter params (role.id=f28d669937b942878bcf6a9103012af9, scope.project.id=0f988f0c81614261ae36a6896770b2d0, user.id=de2d55af03cf485a9034cf3e0357ced9) {{(pid=80348) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 07:58:47.225476 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-947ab4d1-67ce-445f-9b82-7022af54c699 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 07:58:47.226948 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-947ab4d1-67ce-445f-9b82-7022af54c699 None admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 07:58:47.237272 dv-cinder-851351-1-smb devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 123/269] 10.222.0.42 () {56 vars in 1374 bytes} [Thu Jul 28 07:58:47 2022] GET /identity/v3/role_assignments?user.id=de2d55af03cf485a9034cf3e0357ced9&scope.project.id=0f988f0c81614261ae36a6896770b2d0&role.id=f28d669937b942878bcf6a9103012af9 => generated 608 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 07:58:47.238096 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947ab4d1-67ce-445f-9b82-7022af54c699 None admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 07:58:47.278265 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fac8787-0d50-41f3-8ecd-87bb27bddbd6 None None] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 07:58:47.320827 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60031ea1-3aeb-439d-bb01-1346135ebd29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 07:58:47.322020 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60031ea1-3aeb-439d-bb01-1346135ebd29 None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 07:58:47.322462 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60031ea1-3aeb-439d-bb01-1346135ebd29 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 07:58:47.323448 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60031ea1-3aeb-439d-bb01-1346135ebd29 None admin] PATH_INFO: `/v3/projects/0f988f0c81614261ae36a6896770b2d0` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 07:58:47.324914 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60031ea1-3aeb-439d-bb01-1346135ebd29 None admin] RBAC: Authorizing `identity:get_project(project_id=0f988f0c81614261ae36a6896770b2d0)` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 07:58:47.327148 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60031ea1-3aeb-439d-bb01-1346135ebd29 None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 07:58:47.329667 dv-cinder-851351-1-smb devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 147/270] 10.222.0.42 () {56 vars in 1186 bytes} [Thu Jul 28 07:58:47 2022] GET /identity/v3/projects/0f988f0c81614261ae36a6896770b2d0 => generated 302 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 07:58:47.332166 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b801088-4378-4dad-8596-e5d4b2e17fb6 None None] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 07:58:47.332606 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b801088-4378-4dad-8596-e5d4b2e17fb6 None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 07:58:47.333039 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b801088-4378-4dad-8596-e5d4b2e17fb6 None None] PATH_INFO: `/` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 07:58:47.334923 dv-cinder-851351-1-smb devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 148/271] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 07:58:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 07:58:47.340141 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b801088-4378-4dad-8596-e5d4b2e17fb6 None None] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 07:58:47.354271 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=100 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 07:58:47.451304 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947ab4d1-67ce-445f-9b82-7022af54c699 None admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 07:58:47.495230 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 07:58:47.512325 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8401c9-cfde-401b-b92c-92f4a52210dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 07:58:47.513062 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8401c9-cfde-401b-b92c-92f4a52210dc None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 07:58:47.513344 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8401c9-cfde-401b-b92c-92f4a52210dc None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 07:58:47.513652 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8401c9-cfde-401b-b92c-92f4a52210dc None admin] PATH_INFO: `/v3/domains/default` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 07:58:47.515593 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e8401c9-cfde-401b-b92c-92f4a52210dc None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 07:58:47.517102 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e8401c9-cfde-401b-b92c-92f4a52210dc None admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 07:58:47.519493 dv-cinder-851351-1-smb devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 124/272] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 07:58:47 2022] GET /identity/v3/domains/default => generated 199 bytes in 281 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 07:58:47.520512 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53adb532-ac48-4496-a1f5-fd98a429ec92 None None] REQUEST_METHOD: `POST` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 07:58:47.520821 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53adb532-ac48-4496-a1f5-fd98a429ec92 None None] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 07:58:47.522069 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53adb532-ac48-4496-a1f5-fd98a429ec92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 07:58:47.526159 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b801088-4378-4dad-8596-e5d4b2e17fb6 None None] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 07:58:47.541927 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.auth.core [None req-53adb532-ac48-4496-a1f5-fd98a429ec92 None None] MFA Rules not processed for user `f0666d3a50644a7097367331c1ee1a68`. Rule list: `[]` (Enabled: `True`). {{(pid=80348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 07:58:47.543140 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.fernet_utils [None req-53adb532-ac48-4496-a1f5-fd98a429ec92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 07:58:47.572611 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a55807-2268-4467-a2b4-16605d83774a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 07:58:47.573940 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a55807-2268-4467-a2b4-16605d83774a None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 07:58:47.574703 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a55807-2268-4467-a2b4-16605d83774a None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 07:58:47.575175 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a55807-2268-4467-a2b4-16605d83774a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 07:58:47.576960 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a55807-2268-4467-a2b4-16605d83774a None admin] RBAC: Adding query filter params (role.id=362bd71ac01249fb8fa635381993eec1, scope.project.id=0f988f0c81614261ae36a6896770b2d0, user.id=de2d55af03cf485a9034cf3e0357ced9) {{(pid=80347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 07:58:47.577481 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a55807-2268-4467-a2b4-16605d83774a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 07:58:47.580081 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a55807-2268-4467-a2b4-16605d83774a None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 07:58:47.590646 dv-cinder-851351-1-smb devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 149/273] 10.222.0.42 () {56 vars in 1374 bytes} [Thu Jul 28 07:58:47 2022] GET /identity/v3/role_assignments?user.id=de2d55af03cf485a9034cf3e0357ced9&scope.project.id=0f988f0c81614261ae36a6896770b2d0&role.id=362bd71ac01249fb8fa635381993eec1 => generated 608 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 07:58:47.592025 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a55807-2268-4467-a2b4-16605d83774a None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 07:58:47.666879 dv-cinder-851351-1-smb devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 125/274] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 07:58:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 07:58:47.692779 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53adb532-ac48-4496-a1f5-fd98a429ec92 None None] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 07:58:47.790221 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=100 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 07:58:47.813507 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a55807-2268-4467-a2b4-16605d83774a None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 07:58:47.862185 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-312d69e5-49af-4e83-8d84-f3012bdefa48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 07:58:47.862824 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312d69e5-49af-4e83-8d84-f3012bdefa48 None admin] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 07:58:47.863096 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312d69e5-49af-4e83-8d84-f3012bdefa48 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 07:58:47.863363 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312d69e5-49af-4e83-8d84-f3012bdefa48 None admin] PATH_INFO: `/v3/users` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 07:58:47.864360 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-312d69e5-49af-4e83-8d84-f3012bdefa48 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 07:58:47.865518 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-312d69e5-49af-4e83-8d84-f3012bdefa48 None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 07:58:47.878602 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53adb532-ac48-4496-a1f5-fd98a429ec92 None None] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 07:58:47.885064 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 07:58:47.896873 dv-cinder-851351-1-smb devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 150/275] 10.222.0.42 () {60 vars in 1132 bytes} [Thu Jul 28 07:58:47 2022] POST /identity/v3/users => generated 293 bytes in 305 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 07:58:47.900383 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb5dbe2-54a0-4d33-9eb5-c1bcfa2ddfdd None None] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 07:58:47.900790 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb5dbe2-54a0-4d33-9eb5-c1bcfa2ddfdd None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 07:58:47.900951 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb5dbe2-54a0-4d33-9eb5-c1bcfa2ddfdd None None] PATH_INFO: `/` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 07:58:47.902543 dv-cinder-851351-1-smb devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 151/276] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 07:58:47 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 07:58:47.908751 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a183d61e-49e1-4e52-b463-589abadca54a None None] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 07:58:47.908949 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a183d61e-49e1-4e52-b463-589abadca54a None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 07:58:47.909154 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a183d61e-49e1-4e52-b463-589abadca54a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 07:58:47.929439 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.auth.core [None req-a183d61e-49e1-4e52-b463-589abadca54a None None] MFA Rules not processed for user `f0666d3a50644a7097367331c1ee1a68`. Rule list: `[]` (Enabled: `True`). {{(pid=80347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 07:58:47.930698 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-a183d61e-49e1-4e52-b463-589abadca54a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 07:58:47.932505 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc07ae2-a09f-45c8-b682-7077bbeab937 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 07:58:47.933684 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc07ae2-a09f-45c8-b682-7077bbeab937 None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 07:58:47.934356 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc07ae2-a09f-45c8-b682-7077bbeab937 None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 07:58:47.935882 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc07ae2-a09f-45c8-b682-7077bbeab937 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 07:58:47.956441 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bc07ae2-a09f-45c8-b682-7077bbeab937 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 07:58:47.964178 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application [None req-8bc07ae2-a09f-45c8-b682-7077bbeab937 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 28 07:58:47.964178 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 07:58:47.964178 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 07:58:47.964178 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 07:58:47.964178 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 07:58:47.964178 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 07:58:47.964178 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 07:58:47.964178 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 07:58:47.964178 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 07:58:47.964178 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 07:58:47.964178 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 07:58:47.964178 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 07:58:47.964178 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 07:58:47.964178 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 07:58:47.964178 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 07:58:47.964178 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 07:58:47.965279 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 07:58:47.965279 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 07:58:47.965279 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 07:58:47.965279 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 07:58:47.965279 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 07:58:47.965279 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 07:58:47.965279 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 07:58:47.965279 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 07:58:47.965279 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 07:58:47.965279 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 07:58:47.965279 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 07:58:47.965279 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application with Lock( Jul 28 07:58:47.965279 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 07:58:47.965279 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self._enter() Jul 28 07:58:47.965279 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 07:58:47.965279 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 07:58:47.966092 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 07:58:47.966092 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.creator() Jul 28 07:58:47.966092 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 07:58:47.966092 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application created_value = creator( Jul 28 07:58:47.966092 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 07:58:47.966092 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 07:58:47.966092 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 07:58:47.966092 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 07:58:47.966092 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 07:58:47.966092 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 07:58:47.966092 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 28 07:58:47.966092 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application Jul 28 07:58:47.969222 dv-cinder-851351-1-smb devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 126/277] 10.222.0.42 () {56 vars in 1099 bytes} [Thu Jul 28 07:58:47 2022] GET /identity/v3/roles/member => generated 84 bytes in 277 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 07:58:47.975786 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc07ae2-a09f-45c8-b682-7077bbeab937 None admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 07:58:48.022799 dv-cinder-851351-1-smb devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 152/278] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 07:58:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 28 07:58:48.042189 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a183d61e-49e1-4e52-b463-589abadca54a None None] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 07:58:48.101587 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc07ae2-a09f-45c8-b682-7077bbeab937 None admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 07:58:48.112235 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=100 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 07:58:48.143093 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2741a0-ece0-44a0-8e78-d8742ca2cb39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 07:58:48.143724 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2741a0-ece0-44a0-8e78-d8742ca2cb39 None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 07:58:48.144002 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2741a0-ece0-44a0-8e78-d8742ca2cb39 None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 07:58:48.144275 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2741a0-ece0-44a0-8e78-d8742ca2cb39 None admin] PATH_INFO: `/v3/roles` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 07:58:48.145075 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b2741a0-ece0-44a0-8e78-d8742ca2cb39 None admin] RBAC: Adding query filter params (name=member) {{(pid=80348) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 07:58:48.145380 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b2741a0-ece0-44a0-8e78-d8742ca2cb39 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 07:58:48.146778 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b2741a0-ece0-44a0-8e78-d8742ca2cb39 None admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 07:58:48.157825 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a183d61e-49e1-4e52-b463-589abadca54a None None] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 07:58:48.158002 dv-cinder-851351-1-smb devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 127/279] 10.222.0.42 () {56 vars in 1101 bytes} [Thu Jul 28 07:58:47 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 07:58:48.158002 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7acafa-cf99-4fb8-87eb-3423a33023c2 None None] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 07:58:48.158002 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7acafa-cf99-4fb8-87eb-3423a33023c2 None None] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 07:58:48.158212 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7acafa-cf99-4fb8-87eb-3423a33023c2 None None] PATH_INFO: `/` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 07:58:48.163646 dv-cinder-851351-1-smb devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 128/280] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 07:58:48 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 07:58:48.167225 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7acafa-cf99-4fb8-87eb-3423a33023c2 None None] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 07:58:48.196202 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 07:58:48.206917 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04cce272-661b-4c39-91a5-991182adc2b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 07:58:48.206917 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04cce272-661b-4c39-91a5-991182adc2b0 None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 07:58:48.207314 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04cce272-661b-4c39-91a5-991182adc2b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 07:58:48.207507 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04cce272-661b-4c39-91a5-991182adc2b0 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 07:58:48.225243 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04cce272-661b-4c39-91a5-991182adc2b0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 07:58:48.230440 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application [None req-04cce272-661b-4c39-91a5-991182adc2b0 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 28 07:58:48.230440 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 07:58:48.230440 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 07:58:48.230440 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 07:58:48.230440 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 07:58:48.230440 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 07:58:48.230440 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 07:58:48.230440 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 07:58:48.230440 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 07:58:48.230440 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 07:58:48.230440 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 07:58:48.230440 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 07:58:48.230440 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 07:58:48.230440 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 07:58:48.230440 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 07:58:48.230440 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 07:58:48.231350 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 07:58:48.231350 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 07:58:48.231350 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 07:58:48.231350 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 07:58:48.231350 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 07:58:48.231350 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 07:58:48.231350 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 07:58:48.231350 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 07:58:48.231350 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 07:58:48.231350 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 07:58:48.231350 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 07:58:48.231350 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application with Lock( Jul 28 07:58:48.231350 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 07:58:48.231350 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._enter() Jul 28 07:58:48.231350 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 07:58:48.231350 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 07:58:48.232155 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 07:58:48.232155 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.creator() Jul 28 07:58:48.232155 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 07:58:48.232155 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application created_value = creator( Jul 28 07:58:48.232155 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 07:58:48.232155 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 07:58:48.232155 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 07:58:48.232155 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 07:58:48.232155 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 07:58:48.232155 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 07:58:48.232155 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 28 07:58:48.232155 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application Jul 28 07:58:48.232155 dv-cinder-851351-1-smb devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 153/281] 10.222.0.42 () {56 vars in 1099 bytes} [Thu Jul 28 07:58:48 2022] GET /identity/v3/roles/reader => generated 84 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 07:58:48.232962 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22aa7bf3-0910-401f-b729-ecdfacd1b1c9 None None] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 07:58:48.233307 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22aa7bf3-0910-401f-b729-ecdfacd1b1c9 None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 07:58:48.233583 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22aa7bf3-0910-401f-b729-ecdfacd1b1c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 07:58:48.255704 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.auth.core [None req-22aa7bf3-0910-401f-b729-ecdfacd1b1c9 None None] MFA Rules not processed for user `f0666d3a50644a7097367331c1ee1a68`. Rule list: `[]` (Enabled: `True`). {{(pid=80347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 07:58:48.256925 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-22aa7bf3-0910-401f-b729-ecdfacd1b1c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 07:58:48.293632 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7acafa-cf99-4fb8-87eb-3423a33023c2 None None] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 07:58:48.340923 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226ae9e2-be9a-4331-93f1-d4ce1ae23ba2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 07:58:48.342300 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226ae9e2-be9a-4331-93f1-d4ce1ae23ba2 None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 07:58:48.342804 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226ae9e2-be9a-4331-93f1-d4ce1ae23ba2 None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 07:58:48.343279 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226ae9e2-be9a-4331-93f1-d4ce1ae23ba2 None admin] PATH_INFO: `/v3/users/9d91f17a57e44b8a8d599c47cd575d0e` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 07:58:48.347469 dv-cinder-851351-1-smb devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 154/282] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 07:58:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 07:58:48.348315 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22aa7bf3-0910-401f-b729-ecdfacd1b1c9 None None] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 07:58:48.359525 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-226ae9e2-be9a-4331-93f1-d4ce1ae23ba2 None admin] RBAC: Authorizing `identity:get_user(user_id=9d91f17a57e44b8a8d599c47cd575d0e)` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 07:58:48.362287 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-226ae9e2-be9a-4331-93f1-d4ce1ae23ba2 None admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 07:58:48.364315 dv-cinder-851351-1-smb devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 129/283] 10.222.0.42 () {56 vars in 1177 bytes} [Thu Jul 28 07:58:48 2022] GET /identity/v3/users/9d91f17a57e44b8a8d599c47cd575d0e => generated 293 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 07:58:48.370126 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226ae9e2-be9a-4331-93f1-d4ce1ae23ba2 None admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 07:58:48.407412 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=100 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 07:58:48.482698 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22aa7bf3-0910-401f-b729-ecdfacd1b1c9 None None] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 07:58:48.505105 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 07:58:48.517696 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226ae9e2-be9a-4331-93f1-d4ce1ae23ba2 None admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 07:58:48.522389 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e5c17e-ade7-4e7d-a6af-a1869a0790d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 07:58:48.523192 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e5c17e-ade7-4e7d-a6af-a1869a0790d7 None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 07:58:48.523561 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e5c17e-ade7-4e7d-a6af-a1869a0790d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 07:58:48.523917 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e5c17e-ade7-4e7d-a6af-a1869a0790d7 None admin] PATH_INFO: `/v3/roles` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 07:58:48.524768 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23e5c17e-ade7-4e7d-a6af-a1869a0790d7 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 07:58:48.525165 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23e5c17e-ade7-4e7d-a6af-a1869a0790d7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 07:58:48.526635 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23e5c17e-ade7-4e7d-a6af-a1869a0790d7 None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 07:58:48.536383 dv-cinder-851351-1-smb devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 155/284] 10.222.0.42 () {56 vars in 1101 bytes} [Thu Jul 28 07:58:48 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 07:58:48.537358 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e5c17e-ade7-4e7d-a6af-a1869a0790d7 None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 07:58:48.564828 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-204a6081-be7f-4a92-8014-828d25d4c5a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 07:58:48.565927 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204a6081-be7f-4a92-8014-828d25d4c5a2 None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 07:58:48.566849 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204a6081-be7f-4a92-8014-828d25d4c5a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 07:58:48.567321 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204a6081-be7f-4a92-8014-828d25d4c5a2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 07:58:48.568532 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-204a6081-be7f-4a92-8014-828d25d4c5a2 None admin] RBAC: Adding query filter params (role.id=0317c30d81ff44eea2fd4a7215c60eac, user.id=9d91f17a57e44b8a8d599c47cd575d0e, scope.system=all) {{(pid=80348) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 07:58:48.569022 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-204a6081-be7f-4a92-8014-828d25d4c5a2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 07:58:48.571595 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-204a6081-be7f-4a92-8014-828d25d4c5a2 None admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 07:58:48.578894 dv-cinder-851351-1-smb devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 130/285] 10.222.0.42 () {56 vars in 1308 bytes} [Thu Jul 28 07:58:48 2022] GET /identity/v3/role_assignments?user.id=9d91f17a57e44b8a8d599c47cd575d0e&scope.system=all&role.id=0317c30d81ff44eea2fd4a7215c60eac => generated 226 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 07:58:48.580433 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-204a6081-be7f-4a92-8014-828d25d4c5a2 None admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 07:58:48.654284 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e5c17e-ade7-4e7d-a6af-a1869a0790d7 None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 07:58:48.703146 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02bb086e-7ae7-4c01-9f12-a13339661f00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 07:58:48.704093 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02bb086e-7ae7-4c01-9f12-a13339661f00 None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 07:58:48.705101 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02bb086e-7ae7-4c01-9f12-a13339661f00 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 07:58:48.705562 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02bb086e-7ae7-4c01-9f12-a13339661f00 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 07:58:48.720063 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02bb086e-7ae7-4c01-9f12-a13339661f00 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 07:58:48.721832 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=100 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 07:58:48.728805 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application [None req-02bb086e-7ae7-4c01-9f12-a13339661f00 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 28 07:58:48.728805 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 07:58:48.728805 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 07:58:48.728805 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 07:58:48.728805 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 07:58:48.728805 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 07:58:48.728805 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 07:58:48.728805 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 07:58:48.728805 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 07:58:48.728805 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 07:58:48.728805 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 07:58:48.728805 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 07:58:48.728805 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 07:58:48.728805 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 07:58:48.728805 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 07:58:48.728805 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 07:58:48.729757 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 07:58:48.729757 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 07:58:48.729757 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 07:58:48.729757 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 07:58:48.729757 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 07:58:48.729757 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 07:58:48.729757 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 07:58:48.729757 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 07:58:48.729757 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 07:58:48.729757 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 07:58:48.729757 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 07:58:48.729757 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application with Lock( Jul 28 07:58:48.729757 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 07:58:48.729757 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._enter() Jul 28 07:58:48.729757 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 07:58:48.729757 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 07:58:48.730526 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 07:58:48.730526 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.creator() Jul 28 07:58:48.730526 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 07:58:48.730526 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application created_value = creator( Jul 28 07:58:48.730526 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 07:58:48.730526 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 07:58:48.730526 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 07:58:48.730526 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 07:58:48.730526 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 07:58:48.730526 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 07:58:48.730526 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 28 07:58:48.730526 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application Jul 28 07:58:48.733235 dv-cinder-851351-1-smb devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 156/286] 10.222.0.42 () {56 vars in 1099 bytes} [Thu Jul 28 07:58:48 2022] GET /identity/v3/roles/member => generated 84 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 07:58:48.740838 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02bb086e-7ae7-4c01-9f12-a13339661f00 None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 07:58:48.750106 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-204a6081-be7f-4a92-8014-828d25d4c5a2 None admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 07:58:48.812703 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 07:58:48.817229 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47d4950-490b-4eea-8594-ab9ae2a742f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 07:58:48.818197 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47d4950-490b-4eea-8594-ab9ae2a742f6 None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 07:58:48.818691 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47d4950-490b-4eea-8594-ab9ae2a742f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 07:58:48.819148 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47d4950-490b-4eea-8594-ab9ae2a742f6 None admin] PATH_INFO: `/v3/users/24750ef6d6e646208a4d86eb0e2e3757` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 07:58:48.820519 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c47d4950-490b-4eea-8594-ab9ae2a742f6 None admin] RBAC: Authorizing `identity:get_user(user_id=24750ef6d6e646208a4d86eb0e2e3757)` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 07:58:48.822187 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c47d4950-490b-4eea-8594-ab9ae2a742f6 None admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 07:58:48.824106 dv-cinder-851351-1-smb devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 131/287] 10.222.0.42 () {56 vars in 1177 bytes} [Thu Jul 28 07:58:48 2022] GET /identity/v3/users/24750ef6d6e646208a4d86eb0e2e3757 => generated 297 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 07:58:48.830041 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47d4950-490b-4eea-8594-ab9ae2a742f6 None admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 07:58:48.943999 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47d4950-490b-4eea-8594-ab9ae2a742f6 None admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 07:58:48.975632 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02bb086e-7ae7-4c01-9f12-a13339661f00 None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 07:58:48.984562 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a06e63-47b2-463d-9664-52edad0dfaa1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 07:58:48.985490 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a06e63-47b2-463d-9664-52edad0dfaa1 None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 07:58:48.985986 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a06e63-47b2-463d-9664-52edad0dfaa1 None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 07:58:48.986443 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a06e63-47b2-463d-9664-52edad0dfaa1 None admin] PATH_INFO: `/v3/projects/0f988f0c81614261ae36a6896770b2d0` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 07:58:48.988297 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5a06e63-47b2-463d-9664-52edad0dfaa1 None admin] RBAC: Authorizing `identity:get_project(project_id=0f988f0c81614261ae36a6896770b2d0)` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 07:58:48.990061 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5a06e63-47b2-463d-9664-52edad0dfaa1 None admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 07:58:48.992080 dv-cinder-851351-1-smb devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 132/288] 10.222.0.42 () {56 vars in 1186 bytes} [Thu Jul 28 07:58:48 2022] GET /identity/v3/projects/0f988f0c81614261ae36a6896770b2d0 => generated 302 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 07:58:48.999501 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a06e63-47b2-463d-9664-52edad0dfaa1 None admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 07:58:49.040597 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b597f4eb-d7dd-4085-9900-50c33a362a7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 07:58:49.041250 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b597f4eb-d7dd-4085-9900-50c33a362a7a None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 07:58:49.041536 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b597f4eb-d7dd-4085-9900-50c33a362a7a None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 07:58:49.041807 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b597f4eb-d7dd-4085-9900-50c33a362a7a None admin] PATH_INFO: `/v3/roles` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 07:58:49.042536 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b597f4eb-d7dd-4085-9900-50c33a362a7a None admin] RBAC: Adding query filter params (name=member) {{(pid=80347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 07:58:49.042834 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b597f4eb-d7dd-4085-9900-50c33a362a7a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 07:58:49.045731 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b597f4eb-d7dd-4085-9900-50c33a362a7a None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 07:58:49.056334 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=100 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 07:58:49.062672 dv-cinder-851351-1-smb devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 157/289] 10.222.0.42 () {56 vars in 1101 bytes} [Thu Jul 28 07:58:48 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 323 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 07:58:49.068656 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b597f4eb-d7dd-4085-9900-50c33a362a7a None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 07:58:49.198255 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a06e63-47b2-463d-9664-52edad0dfaa1 None admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 07:58:49.240641 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b597f4eb-d7dd-4085-9900-50c33a362a7a None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 07:58:49.245616 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 07:58:49.274450 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b172cf-90e4-4ae1-bbf6-8c3b497dea57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 07:58:49.275194 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b172cf-90e4-4ae1-bbf6-8c3b497dea57 None admin] REQUEST_METHOD: `PUT` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 07:58:49.275477 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b172cf-90e4-4ae1-bbf6-8c3b497dea57 None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 07:58:49.275752 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b172cf-90e4-4ae1-bbf6-8c3b497dea57 None admin] PATH_INFO: `/v3/projects/0f988f0c81614261ae36a6896770b2d0/users/24750ef6d6e646208a4d86eb0e2e3757/roles/21c3f6dd315a425a98d00fcf994f3a36` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 07:58:49.278427 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51b172cf-90e4-4ae1-bbf6-8c3b497dea57 None admin] RBAC: Authorizing `identity:create_grant(project_id=0f988f0c81614261ae36a6896770b2d0, user_id=24750ef6d6e646208a4d86eb0e2e3757, role_id=21c3f6dd315a425a98d00fcf994f3a36)` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 07:58:49.279944 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51b172cf-90e4-4ae1-bbf6-8c3b497dea57 None admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 07:58:49.299540 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c4978f1-bcdd-483b-abab-7ba518c073cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 07:58:49.302710 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4978f1-bcdd-483b-abab-7ba518c073cf None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 07:58:49.303038 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4978f1-bcdd-483b-abab-7ba518c073cf None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 07:58:49.303264 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4978f1-bcdd-483b-abab-7ba518c073cf None admin] PATH_INFO: `/v3/users/e9b221388e024aceac3955820b6d91b3` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 07:58:49.304011 dv-cinder-851351-1-smb devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 133/290] 10.222.0.42 () {58 vars in 1439 bytes} [Thu Jul 28 07:58:48 2022] PUT /identity/v3/projects/0f988f0c81614261ae36a6896770b2d0/users/24750ef6d6e646208a4d86eb0e2e3757/roles/21c3f6dd315a425a98d00fcf994f3a36 => generated 0 bytes in 305 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 28 07:58:49.304862 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c4978f1-bcdd-483b-abab-7ba518c073cf None admin] RBAC: Authorizing `identity:get_user(user_id=e9b221388e024aceac3955820b6d91b3)` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 07:58:49.306470 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c4978f1-bcdd-483b-abab-7ba518c073cf None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 07:58:49.308301 dv-cinder-851351-1-smb devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 158/291] 10.222.0.42 () {56 vars in 1177 bytes} [Thu Jul 28 07:58:49 2022] GET /identity/v3/users/e9b221388e024aceac3955820b6d91b3 => generated 297 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 07:58:49.314507 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b172cf-90e4-4ae1-bbf6-8c3b497dea57 None admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 07:58:49.425286 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 07:58:49.442292 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b172cf-90e4-4ae1-bbf6-8c3b497dea57 None admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 07:58:49.487351 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9fff374-7626-409f-b29d-43d263dc2393 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 07:58:49.487990 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fff374-7626-409f-b29d-43d263dc2393 None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 07:58:49.488312 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fff374-7626-409f-b29d-43d263dc2393 None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 07:58:49.488590 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fff374-7626-409f-b29d-43d263dc2393 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 07:58:49.568251 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9fff374-7626-409f-b29d-43d263dc2393 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 07:58:49.569900 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9fff374-7626-409f-b29d-43d263dc2393 None admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 07:58:49.667088 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=100 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 07:58:49.685202 dv-cinder-851351-1-smb devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 134/292] 10.222.0.42 () {58 vars in 1282 bytes} [Thu Jul 28 07:58:49 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 371 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 28 07:58:49.687428 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c4978f1-bcdd-483b-abab-7ba518c073cf None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 07:58:49.820759 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c4978f1-bcdd-483b-abab-7ba518c073cf None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 07:58:49.866534 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f509342f-1f9c-4d95-aa1a-d10d72c3588a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 07:58:49.867192 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f509342f-1f9c-4d95-aa1a-d10d72c3588a None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 07:58:49.867475 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f509342f-1f9c-4d95-aa1a-d10d72c3588a None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 07:58:49.867749 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f509342f-1f9c-4d95-aa1a-d10d72c3588a None admin] PATH_INFO: `/v3/projects/0f988f0c81614261ae36a6896770b2d0` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 07:58:49.869018 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f509342f-1f9c-4d95-aa1a-d10d72c3588a None admin] RBAC: Authorizing `identity:get_project(project_id=0f988f0c81614261ae36a6896770b2d0)` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 07:58:49.870466 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f509342f-1f9c-4d95-aa1a-d10d72c3588a None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 07:58:49.872172 dv-cinder-851351-1-smb devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 159/293] 10.222.0.42 () {56 vars in 1186 bytes} [Thu Jul 28 07:58:49 2022] GET /identity/v3/projects/0f988f0c81614261ae36a6896770b2d0 => generated 302 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 07:58:49.880339 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9fff374-7626-409f-b29d-43d263dc2393 None admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 07:58:49.998144 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9fff374-7626-409f-b29d-43d263dc2393 None admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 07:58:50.041965 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef44b4b5-19e5-4e86-b56d-cadeeade1be7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 07:58:50.043022 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef44b4b5-19e5-4e86-b56d-cadeeade1be7 None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 07:58:50.043487 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef44b4b5-19e5-4e86-b56d-cadeeade1be7 None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 07:58:50.043940 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef44b4b5-19e5-4e86-b56d-cadeeade1be7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 07:58:50.045085 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef44b4b5-19e5-4e86-b56d-cadeeade1be7 None admin] RBAC: Adding query filter params (role.id=0317c30d81ff44eea2fd4a7215c60eac, scope.project.id=0f988f0c81614261ae36a6896770b2d0, user.id=e9b221388e024aceac3955820b6d91b3) {{(pid=80348) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 07:58:50.045602 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef44b4b5-19e5-4e86-b56d-cadeeade1be7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 07:58:50.047246 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef44b4b5-19e5-4e86-b56d-cadeeade1be7 None admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 07:58:50.054434 dv-cinder-851351-1-smb devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 135/294] 10.222.0.42 () {56 vars in 1374 bytes} [Thu Jul 28 07:58:49 2022] GET /identity/v3/role_assignments?user.id=e9b221388e024aceac3955820b6d91b3&scope.project.id=0f988f0c81614261ae36a6896770b2d0&role.id=0317c30d81ff44eea2fd4a7215c60eac => generated 608 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 07:58:50.370651 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0138f6b4-e440-49e6-a575-26b25f71e403 None None] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 07:58:50.371071 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0138f6b4-e440-49e6-a575-26b25f71e403 None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 07:58:50.371249 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0138f6b4-e440-49e6-a575-26b25f71e403 None None] PATH_INFO: `/` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 07:58:50.372971 dv-cinder-851351-1-smb devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 160/295] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 07:58:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 07:58:50.378596 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a254ab7-2473-471b-8832-157ca0d4c09c None None] REQUEST_METHOD: `POST` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 07:58:50.378891 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a254ab7-2473-471b-8832-157ca0d4c09c None None] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 07:58:50.379230 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a254ab7-2473-471b-8832-157ca0d4c09c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 07:58:50.380579 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb2c8f3-8e3f-46e4-98c6-08dbd62618f7 None None] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 07:58:50.380877 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb2c8f3-8e3f-46e4-98c6-08dbd62618f7 None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 07:58:50.381149 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb2c8f3-8e3f-46e4-98c6-08dbd62618f7 None None] PATH_INFO: `/` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 07:58:50.382450 dv-cinder-851351-1-smb devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 161/296] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 07:58:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 07:58:50.388969 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c791098-9315-4f72-85ea-99b48bc09752 None None] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 07:58:50.389376 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c791098-9315-4f72-85ea-99b48bc09752 None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 07:58:50.389744 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c791098-9315-4f72-85ea-99b48bc09752 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 07:58:50.402716 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.auth.core [None req-6a254ab7-2473-471b-8832-157ca0d4c09c None None] MFA Rules not processed for user `f0666d3a50644a7097367331c1ee1a68`. Rule list: `[]` (Enabled: `True`). {{(pid=80348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 07:58:50.404369 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.fernet_utils [None req-6a254ab7-2473-471b-8832-157ca0d4c09c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 07:58:50.409335 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.auth.core [None req-8c791098-9315-4f72-85ea-99b48bc09752 None None] MFA Rules not processed for user `f0666d3a50644a7097367331c1ee1a68`. Rule list: `[]` (Enabled: `True`). {{(pid=80347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 07:58:50.410501 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-8c791098-9315-4f72-85ea-99b48bc09752 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 07:58:50.454660 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 07:58:50.466854 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=100 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 07:58:50.500530 dv-cinder-851351-1-smb devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 162/297] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 07:58:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 28 07:58:50.503110 dv-cinder-851351-1-smb devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 136/298] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 07:58:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 28 07:58:50.526189 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c791098-9315-4f72-85ea-99b48bc09752 None None] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 07:58:50.527288 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a254ab7-2473-471b-8832-157ca0d4c09c None None] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 07:58:50.638498 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c791098-9315-4f72-85ea-99b48bc09752 None None] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 07:58:50.653421 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a254ab7-2473-471b-8832-157ca0d4c09c None None] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 07:58:50.680583 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38cbac2-843a-49c1-bc7a-526ec5110bdc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 07:58:50.681402 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38cbac2-843a-49c1-bc7a-526ec5110bdc None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 07:58:50.681678 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38cbac2-843a-49c1-bc7a-526ec5110bdc None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 07:58:50.682037 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38cbac2-843a-49c1-bc7a-526ec5110bdc None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 07:58:50.693416 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c38cbac2-843a-49c1-bc7a-526ec5110bdc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 07:58:50.694736 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe8cd86-edf6-40f6-b3df-66ce2e4e43f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 07:58:50.695455 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe8cd86-edf6-40f6-b3df-66ce2e4e43f4 None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 07:58:50.695798 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe8cd86-edf6-40f6-b3df-66ce2e4e43f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 07:58:50.696136 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe8cd86-edf6-40f6-b3df-66ce2e4e43f4 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 07:58:50.697403 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fe8cd86-edf6-40f6-b3df-66ce2e4e43f4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 07:58:50.698411 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application [None req-c38cbac2-843a-49c1-bc7a-526ec5110bdc None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 28 07:58:50.698411 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 07:58:50.698411 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 07:58:50.698411 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 07:58:50.698411 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 07:58:50.698411 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 07:58:50.698411 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 07:58:50.698411 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 07:58:50.698411 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 07:58:50.698411 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 07:58:50.698411 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 07:58:50.698411 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 07:58:50.698411 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 07:58:50.698411 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 07:58:50.698411 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 07:58:50.698411 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 07:58:50.699427 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 07:58:50.699427 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 07:58:50.699427 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 07:58:50.699427 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 07:58:50.699427 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 07:58:50.699427 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 07:58:50.699427 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 07:58:50.699427 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 07:58:50.699427 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 07:58:50.699427 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 07:58:50.699427 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 07:58:50.699427 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application with Lock( Jul 28 07:58:50.699427 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 07:58:50.699427 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._enter() Jul 28 07:58:50.699427 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 07:58:50.699427 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 07:58:50.700413 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 07:58:50.700413 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.creator() Jul 28 07:58:50.700413 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 07:58:50.700413 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application created_value = creator( Jul 28 07:58:50.700413 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 07:58:50.700413 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 07:58:50.700413 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 07:58:50.700413 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 07:58:50.700413 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 07:58:50.700413 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 07:58:50.700413 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 28 07:58:50.700413 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application Jul 28 07:58:50.701381 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fe8cd86-edf6-40f6-b3df-66ce2e4e43f4 None admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 07:58:50.704775 dv-cinder-851351-1-smb devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 137/300] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 07:58:50 2022] GET /identity/v3/domains/default => generated 199 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 07:58:50.704885 dv-cinder-851351-1-smb devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 163/300] 10.222.0.42 () {56 vars in 1099 bytes} [Thu Jul 28 07:58:50 2022] GET /identity/v3/roles/reader => generated 84 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 07:58:50.708271 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe8cd86-edf6-40f6-b3df-66ce2e4e43f4 None admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 07:58:50.708441 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38cbac2-843a-49c1-bc7a-526ec5110bdc None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 07:58:50.750488 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 07:58:50.763921 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=100 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 07:58:50.818403 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe8cd86-edf6-40f6-b3df-66ce2e4e43f4 None admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 07:58:50.827336 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38cbac2-843a-49c1-bc7a-526ec5110bdc None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 07:58:50.857061 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda2e3a4-e89a-4ca9-bf86-2a95e3961c40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 07:58:50.857748 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda2e3a4-e89a-4ca9-bf86-2a95e3961c40 None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 07:58:50.858071 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda2e3a4-e89a-4ca9-bf86-2a95e3961c40 None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 07:58:50.858342 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda2e3a4-e89a-4ca9-bf86-2a95e3961c40 None admin] PATH_INFO: `/v3/roles` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 07:58:50.859180 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dda2e3a4-e89a-4ca9-bf86-2a95e3961c40 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80348) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 07:58:50.859482 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dda2e3a4-e89a-4ca9-bf86-2a95e3961c40 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 07:58:50.860904 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dda2e3a4-e89a-4ca9-bf86-2a95e3961c40 None admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 07:58:50.870109 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8bdb871-5817-4604-9a29-4cc4c5839cfc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 07:58:50.870741 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8bdb871-5817-4604-9a29-4cc4c5839cfc None admin] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 07:58:50.871017 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8bdb871-5817-4604-9a29-4cc4c5839cfc None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 07:58:50.871287 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8bdb871-5817-4604-9a29-4cc4c5839cfc None admin] PATH_INFO: `/v3/groups` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 07:58:50.871957 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8bdb871-5817-4604-9a29-4cc4c5839cfc None admin] RBAC: Authorizing `identity:create_group()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 07:58:50.873507 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8bdb871-5817-4604-9a29-4cc4c5839cfc None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 07:58:50.875399 dv-cinder-851351-1-smb devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 138/301] 10.222.0.42 () {56 vars in 1101 bytes} [Thu Jul 28 07:58:50 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 07:58:50.876781 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda2e3a4-e89a-4ca9-bf86-2a95e3961c40 None admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 07:58:50.891508 dv-cinder-851351-1-smb devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 164/302] 10.222.0.42 () {60 vars in 1134 bytes} [Thu Jul 28 07:58:50 2022] POST /identity/v3/groups => generated 229 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 07:58:50.987641 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f809d338-84a8-45cb-be28-1e4631f4334a None None] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 07:58:50.988005 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f809d338-84a8-45cb-be28-1e4631f4334a None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 07:58:50.988245 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f809d338-84a8-45cb-be28-1e4631f4334a None None] PATH_INFO: `/` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 07:58:50.990282 dv-cinder-851351-1-smb devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 165/303] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 07:58:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 07:58:50.992455 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda2e3a4-e89a-4ca9-bf86-2a95e3961c40 None admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 07:58:50.995657 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d57cc3-99b0-4eb5-8104-56784863f86d None None] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 07:58:50.995982 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d57cc3-99b0-4eb5-8104-56784863f86d None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 07:58:50.996262 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d57cc3-99b0-4eb5-8104-56784863f86d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 07:58:51.008568 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=100 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 07:58:51.017323 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.auth.core [None req-b1d57cc3-99b0-4eb5-8104-56784863f86d None None] MFA Rules not processed for user `f0666d3a50644a7097367331c1ee1a68`. Rule list: `[]` (Enabled: `True`). {{(pid=80347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 07:58:51.018588 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-b1d57cc3-99b0-4eb5-8104-56784863f86d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 07:58:51.037475 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccbd6d8e-e453-4df1-b7d2-dbbdde58ac4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 07:58:51.038670 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccbd6d8e-e453-4df1-b7d2-dbbdde58ac4b None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 07:58:51.039140 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccbd6d8e-e453-4df1-b7d2-dbbdde58ac4b None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 07:58:51.039900 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccbd6d8e-e453-4df1-b7d2-dbbdde58ac4b None admin] PATH_INFO: `/v3/users/edaa956f2de14c85adfd260924029d57` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 07:58:51.057880 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccbd6d8e-e453-4df1-b7d2-dbbdde58ac4b None admin] RBAC: Authorizing `identity:get_user(user_id=edaa956f2de14c85adfd260924029d57)` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 07:58:51.061069 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccbd6d8e-e453-4df1-b7d2-dbbdde58ac4b None admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 07:58:51.063016 dv-cinder-851351-1-smb devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 139/304] 10.222.0.42 () {56 vars in 1177 bytes} [Thu Jul 28 07:58:50 2022] GET /identity/v3/users/edaa956f2de14c85adfd260924029d57 => generated 293 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 07:58:51.069647 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccbd6d8e-e453-4df1-b7d2-dbbdde58ac4b None admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 07:58:51.108687 dv-cinder-851351-1-smb devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 166/305] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 07:58:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 28 07:58:51.124020 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d57cc3-99b0-4eb5-8104-56784863f86d None None] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 07:58:51.150093 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 07:58:51.198378 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccbd6d8e-e453-4df1-b7d2-dbbdde58ac4b None admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 07:58:51.241322 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e384c2-c2ed-4fbc-b8d3-2a645d8f9855 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 07:58:51.242325 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e384c2-c2ed-4fbc-b8d3-2a645d8f9855 None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 07:58:51.242803 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e384c2-c2ed-4fbc-b8d3-2a645d8f9855 None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 07:58:51.243295 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e384c2-c2ed-4fbc-b8d3-2a645d8f9855 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 07:58:51.243750 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d57cc3-99b0-4eb5-8104-56784863f86d None None] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 07:58:51.244506 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e384c2-c2ed-4fbc-b8d3-2a645d8f9855 None admin] RBAC: Adding query filter params (role.id=21c3f6dd315a425a98d00fcf994f3a36, user.id=edaa956f2de14c85adfd260924029d57, scope.system=all) {{(pid=80348) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 07:58:51.245206 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e384c2-c2ed-4fbc-b8d3-2a645d8f9855 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 07:58:51.246950 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e384c2-c2ed-4fbc-b8d3-2a645d8f9855 None admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 07:58:51.253021 dv-cinder-851351-1-smb devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 140/306] 10.222.0.42 () {56 vars in 1308 bytes} [Thu Jul 28 07:58:51 2022] GET /identity/v3/role_assignments?user.id=edaa956f2de14c85adfd260924029d57&scope.system=all&role.id=21c3f6dd315a425a98d00fcf994f3a36 => generated 226 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 07:58:51.286191 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbacf838-d8e4-4dce-b13a-83249a14df2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 07:58:51.286867 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbacf838-d8e4-4dce-b13a-83249a14df2c None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 07:58:51.287144 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbacf838-d8e4-4dce-b13a-83249a14df2c None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 07:58:51.287408 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbacf838-d8e4-4dce-b13a-83249a14df2c None admin] PATH_INFO: `/v3/roles/member` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 07:58:51.300355 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbacf838-d8e4-4dce-b13a-83249a14df2c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 07:58:51.305644 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application [None req-fbacf838-d8e4-4dce-b13a-83249a14df2c None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 28 07:58:51.305644 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 07:58:51.305644 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 07:58:51.305644 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 07:58:51.305644 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 07:58:51.305644 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 07:58:51.305644 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 07:58:51.305644 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 07:58:51.305644 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 07:58:51.305644 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 07:58:51.305644 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 07:58:51.305644 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 07:58:51.305644 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 07:58:51.305644 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 07:58:51.305644 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 07:58:51.305644 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 07:58:51.306581 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 07:58:51.306581 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 07:58:51.306581 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 07:58:51.306581 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 07:58:51.306581 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 07:58:51.306581 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 07:58:51.306581 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 07:58:51.306581 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 07:58:51.306581 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 07:58:51.306581 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 07:58:51.306581 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 07:58:51.306581 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application with Lock( Jul 28 07:58:51.306581 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 07:58:51.306581 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._enter() Jul 28 07:58:51.306581 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 07:58:51.306581 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 07:58:51.307367 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 07:58:51.307367 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.creator() Jul 28 07:58:51.307367 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 07:58:51.307367 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application created_value = creator( Jul 28 07:58:51.307367 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 07:58:51.307367 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 07:58:51.307367 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 07:58:51.307367 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 07:58:51.307367 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 07:58:51.307367 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 07:58:51.307367 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 28 07:58:51.307367 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application Jul 28 07:58:51.307367 dv-cinder-851351-1-smb devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 167/307] 10.222.0.42 () {56 vars in 1099 bytes} [Thu Jul 28 07:58:51 2022] GET /identity/v3/roles/member => generated 84 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 07:58:51.314969 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e384c2-c2ed-4fbc-b8d3-2a645d8f9855 None admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 07:58:51.353573 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=100 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 07:58:51.428205 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e384c2-c2ed-4fbc-b8d3-2a645d8f9855 None admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 07:58:51.464550 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f579388a-1a6c-4580-92ea-ec9c460dd58b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 07:58:51.465605 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f579388a-1a6c-4580-92ea-ec9c460dd58b None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 07:58:51.466082 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f579388a-1a6c-4580-92ea-ec9c460dd58b None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 07:58:51.466890 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f579388a-1a6c-4580-92ea-ec9c460dd58b None admin] PATH_INFO: `/v3/roles` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 07:58:51.467818 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f579388a-1a6c-4580-92ea-ec9c460dd58b None admin] RBAC: Adding query filter params (name=member) {{(pid=80348) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 07:58:51.468322 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f579388a-1a6c-4580-92ea-ec9c460dd58b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 07:58:51.469932 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f579388a-1a6c-4580-92ea-ec9c460dd58b None admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 07:58:51.480044 dv-cinder-851351-1-smb devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 141/308] 10.222.0.42 () {56 vars in 1101 bytes} [Thu Jul 28 07:58:51 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 07:58:51.486146 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbacf838-d8e4-4dce-b13a-83249a14df2c None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 07:58:51.574348 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 07:58:51.595674 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbacf838-d8e4-4dce-b13a-83249a14df2c None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 07:58:51.630170 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-778d6cc1-473d-4779-b707-1c0cc71d0a7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 07:58:51.630821 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778d6cc1-473d-4779-b707-1c0cc71d0a7b None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 07:58:51.631100 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778d6cc1-473d-4779-b707-1c0cc71d0a7b None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 07:58:51.631380 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778d6cc1-473d-4779-b707-1c0cc71d0a7b None admin] PATH_INFO: `/v3/users/9d91f17a57e44b8a8d599c47cd575d0e` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 07:58:51.632558 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-778d6cc1-473d-4779-b707-1c0cc71d0a7b None admin] RBAC: Authorizing `identity:get_user(user_id=9d91f17a57e44b8a8d599c47cd575d0e)` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 07:58:51.634197 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-778d6cc1-473d-4779-b707-1c0cc71d0a7b None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 07:58:51.636265 dv-cinder-851351-1-smb devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 168/309] 10.222.0.42 () {56 vars in 1177 bytes} [Thu Jul 28 07:58:51 2022] GET /identity/v3/users/9d91f17a57e44b8a8d599c47cd575d0e => generated 293 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 07:58:51.641970 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f579388a-1a6c-4580-92ea-ec9c460dd58b None admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 07:58:51.741598 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=100 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 07:58:51.747198 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f579388a-1a6c-4580-92ea-ec9c460dd58b None admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 07:58:51.784697 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9be115f-1cd3-458f-8ec0-de99b2583370 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 07:58:51.785389 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9be115f-1cd3-458f-8ec0-de99b2583370 None admin] REQUEST_METHOD: `PUT` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 07:58:51.785670 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9be115f-1cd3-458f-8ec0-de99b2583370 None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 07:58:51.785946 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9be115f-1cd3-458f-8ec0-de99b2583370 None admin] PATH_INFO: `/v3/system/users/9d91f17a57e44b8a8d599c47cd575d0e/roles/0317c30d81ff44eea2fd4a7215c60eac` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 07:58:51.787561 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9be115f-1cd3-458f-8ec0-de99b2583370 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=9d91f17a57e44b8a8d599c47cd575d0e, role_id=0317c30d81ff44eea2fd4a7215c60eac)` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 07:58:51.789082 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9be115f-1cd3-458f-8ec0-de99b2583370 None admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 07:58:51.800548 dv-cinder-851351-1-smb devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 142/310] 10.222.0.42 () {58 vars in 1334 bytes} [Thu Jul 28 07:58:51 2022] PUT /identity/v3/system/users/9d91f17a57e44b8a8d599c47cd575d0e/roles/0317c30d81ff44eea2fd4a7215c60eac => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 07:58:51.820035 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0b6a78-f91f-4de4-a379-eccc4a09ded3 None None] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 07:58:51.820576 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0b6a78-f91f-4de4-a379-eccc4a09ded3 None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 07:58:51.820576 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0b6a78-f91f-4de4-a379-eccc4a09ded3 None None] PATH_INFO: `/` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 07:58:51.822217 dv-cinder-851351-1-smb devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 169/311] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 07:58:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 07:58:51.828429 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2866317a-be7f-447f-ae40-ea5aaa5d758c None None] REQUEST_METHOD: `POST` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 07:58:51.829121 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2866317a-be7f-447f-ae40-ea5aaa5d758c None None] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 07:58:51.829638 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2866317a-be7f-447f-ae40-ea5aaa5d758c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 07:58:51.850650 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.auth.core [None req-2866317a-be7f-447f-ae40-ea5aaa5d758c None None] MFA Rules not processed for user `f0666d3a50644a7097367331c1ee1a68`. Rule list: `[]` (Enabled: `True`). {{(pid=80348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 07:58:51.852265 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.fernet_utils [None req-2866317a-be7f-447f-ae40-ea5aaa5d758c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 07:58:51.937855 dv-cinder-851351-1-smb devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 143/312] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 07:58:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 07:58:51.962233 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0b6a78-f91f-4de4-a379-eccc4a09ded3 None None] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 07:58:52.070027 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0b6a78-f91f-4de4-a379-eccc4a09ded3 None None] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 07:58:52.105233 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eed75b1-4083-447d-8d81-7a73d3f774cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 07:58:52.106259 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eed75b1-4083-447d-8d81-7a73d3f774cf None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 07:58:52.106762 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eed75b1-4083-447d-8d81-7a73d3f774cf None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 07:58:52.107278 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eed75b1-4083-447d-8d81-7a73d3f774cf None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 07:58:52.119897 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eed75b1-4083-447d-8d81-7a73d3f774cf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 07:58:52.125474 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application [None req-8eed75b1-4083-447d-8d81-7a73d3f774cf None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 28 07:58:52.125474 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 07:58:52.125474 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 07:58:52.125474 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 07:58:52.125474 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 07:58:52.125474 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 07:58:52.125474 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 07:58:52.125474 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 07:58:52.125474 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 07:58:52.125474 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 07:58:52.125474 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 07:58:52.125474 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 07:58:52.125474 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 07:58:52.125474 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 07:58:52.125474 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 07:58:52.125474 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 07:58:52.126373 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 07:58:52.126373 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 07:58:52.126373 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 07:58:52.126373 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 07:58:52.126373 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 07:58:52.126373 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 07:58:52.126373 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 07:58:52.126373 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 07:58:52.126373 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 07:58:52.126373 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 07:58:52.126373 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 07:58:52.126373 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application with Lock( Jul 28 07:58:52.126373 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 07:58:52.126373 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._enter() Jul 28 07:58:52.126373 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 07:58:52.126373 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 07:58:52.127131 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 07:58:52.127131 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.creator() Jul 28 07:58:52.127131 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 07:58:52.127131 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application created_value = creator( Jul 28 07:58:52.127131 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 07:58:52.127131 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 07:58:52.127131 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 07:58:52.127131 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 07:58:52.127131 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 07:58:52.127131 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 07:58:52.127131 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 28 07:58:52.127131 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application Jul 28 07:58:52.134407 dv-cinder-851351-1-smb devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 170/313] 10.222.0.42 () {56 vars in 1099 bytes} [Thu Jul 28 07:58:51 2022] GET /identity/v3/roles/reader => generated 84 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 07:58:52.136008 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2866317a-be7f-447f-ae40-ea5aaa5d758c None None] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 07:58:52.234956 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 07:58:52.244594 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2866317a-be7f-447f-ae40-ea5aaa5d758c None None] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 07:58:52.279564 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c4e755-b842-4f6b-81de-719824c4f52d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 07:58:52.280186 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c4e755-b842-4f6b-81de-719824c4f52d None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 07:58:52.280464 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c4e755-b842-4f6b-81de-719824c4f52d None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 07:58:52.280767 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c4e755-b842-4f6b-81de-719824c4f52d None admin] PATH_INFO: `/v3/roles` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 07:58:52.281495 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56c4e755-b842-4f6b-81de-719824c4f52d None admin] RBAC: Adding query filter params (name=reader) {{(pid=80348) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 07:58:52.281793 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56c4e755-b842-4f6b-81de-719824c4f52d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 07:58:52.283172 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56c4e755-b842-4f6b-81de-719824c4f52d None admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 07:58:52.291790 dv-cinder-851351-1-smb devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 144/314] 10.222.0.42 () {56 vars in 1101 bytes} [Thu Jul 28 07:58:52 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 07:58:52.297730 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eed75b1-4083-447d-8d81-7a73d3f774cf None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 07:58:52.309413 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 07:58:52.403785 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eed75b1-4083-447d-8d81-7a73d3f774cf None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 07:58:52.438517 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d35177-03bc-4efa-b66b-ac3ceee4ebe8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 07:58:52.439304 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d35177-03bc-4efa-b66b-ac3ceee4ebe8 None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 07:58:52.439582 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d35177-03bc-4efa-b66b-ac3ceee4ebe8 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 07:58:52.439898 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d35177-03bc-4efa-b66b-ac3ceee4ebe8 None admin] PATH_INFO: `/v3/users/24750ef6d6e646208a4d86eb0e2e3757` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 07:58:52.441098 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90d35177-03bc-4efa-b66b-ac3ceee4ebe8 None admin] RBAC: Authorizing `identity:get_user(user_id=24750ef6d6e646208a4d86eb0e2e3757)` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 07:58:52.442546 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90d35177-03bc-4efa-b66b-ac3ceee4ebe8 None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 07:58:52.448814 dv-cinder-851351-1-smb devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 171/315] 10.222.0.42 () {56 vars in 1177 bytes} [Thu Jul 28 07:58:52 2022] GET /identity/v3/users/24750ef6d6e646208a4d86eb0e2e3757 => generated 297 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 07:58:52.450204 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c4e755-b842-4f6b-81de-719824c4f52d None admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 07:58:52.551459 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c4e755-b842-4f6b-81de-719824c4f52d None admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 07:58:52.585595 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65944b9-b159-4a93-bdf8-258ea8d93763 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 07:58:52.586227 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65944b9-b159-4a93-bdf8-258ea8d93763 None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 07:58:52.586505 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65944b9-b159-4a93-bdf8-258ea8d93763 None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 07:58:52.586776 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65944b9-b159-4a93-bdf8-258ea8d93763 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 07:58:52.617074 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=100 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 07:58:52.655682 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b65944b9-b159-4a93-bdf8-258ea8d93763 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 07:58:52.657112 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b65944b9-b159-4a93-bdf8-258ea8d93763 None admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 07:58:52.759961 dv-cinder-851351-1-smb devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 145/316] 10.222.0.42 () {58 vars in 1282 bytes} [Thu Jul 28 07:58:52 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 28 07:58:52.761894 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d35177-03bc-4efa-b66b-ac3ceee4ebe8 None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 07:58:52.843936 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 07:58:52.869050 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d35177-03bc-4efa-b66b-ac3ceee4ebe8 None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 07:58:52.904605 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b8582f-39aa-49c2-801a-3adce9500487 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 07:58:52.905292 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b8582f-39aa-49c2-801a-3adce9500487 None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 07:58:52.905566 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b8582f-39aa-49c2-801a-3adce9500487 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 07:58:52.905884 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b8582f-39aa-49c2-801a-3adce9500487 None admin] PATH_INFO: `/v3/projects/0f988f0c81614261ae36a6896770b2d0` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 07:58:52.907009 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09b8582f-39aa-49c2-801a-3adce9500487 None admin] RBAC: Authorizing `identity:get_project(project_id=0f988f0c81614261ae36a6896770b2d0)` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 07:58:52.908442 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09b8582f-39aa-49c2-801a-3adce9500487 None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 07:58:52.914431 dv-cinder-851351-1-smb devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 172/317] 10.222.0.42 () {56 vars in 1186 bytes} [Thu Jul 28 07:58:52 2022] GET /identity/v3/projects/0f988f0c81614261ae36a6896770b2d0 => generated 302 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 07:58:52.916686 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65944b9-b159-4a93-bdf8-258ea8d93763 None admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 07:58:52.973482 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=100 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 07:58:53.022348 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65944b9-b159-4a93-bdf8-258ea8d93763 None admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 07:58:53.039358 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe93ee4-97d8-46a4-bcd3-48ad0011f796 None None] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 07:58:53.039636 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe93ee4-97d8-46a4-bcd3-48ad0011f796 None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 07:58:53.040309 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe93ee4-97d8-46a4-bcd3-48ad0011f796 None None] PATH_INFO: `/` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 07:58:53.042107 dv-cinder-851351-1-smb devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 173/318] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 07:58:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 28 07:58:53.050556 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6df766-3749-4647-a5c5-47b56964e0c6 None None] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 07:58:53.051103 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6df766-3749-4647-a5c5-47b56964e0c6 None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 07:58:53.051706 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6df766-3749-4647-a5c5-47b56964e0c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 07:58:53.062698 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01ed0fd-a489-40e8-9ddf-f110080fcf08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 07:58:53.063326 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01ed0fd-a489-40e8-9ddf-f110080fcf08 None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 07:58:53.063604 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01ed0fd-a489-40e8-9ddf-f110080fcf08 None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 07:58:53.063875 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01ed0fd-a489-40e8-9ddf-f110080fcf08 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 07:58:53.064719 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e01ed0fd-a489-40e8-9ddf-f110080fcf08 None admin] RBAC: Adding query filter params (role.id=21c3f6dd315a425a98d00fcf994f3a36, scope.project.id=0f988f0c81614261ae36a6896770b2d0, user.id=24750ef6d6e646208a4d86eb0e2e3757) {{(pid=80348) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 07:58:53.065042 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e01ed0fd-a489-40e8-9ddf-f110080fcf08 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 07:58:53.066494 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e01ed0fd-a489-40e8-9ddf-f110080fcf08 None admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 07:58:53.073649 dv-cinder-851351-1-smb devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 146/319] 10.222.0.42 () {56 vars in 1374 bytes} [Thu Jul 28 07:58:52 2022] GET /identity/v3/role_assignments?user.id=24750ef6d6e646208a4d86eb0e2e3757&scope.project.id=0f988f0c81614261ae36a6896770b2d0&role.id=21c3f6dd315a425a98d00fcf994f3a36 => generated 608 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 07:58:53.075776 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.auth.core [None req-ca6df766-3749-4647-a5c5-47b56964e0c6 None None] MFA Rules not processed for user `f0666d3a50644a7097367331c1ee1a68`. Rule list: `[]` (Enabled: `True`). {{(pid=80347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 07:58:53.077209 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-ca6df766-3749-4647-a5c5-47b56964e0c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 07:58:53.158551 dv-cinder-851351-1-smb devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 174/320] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 07:58:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 07:58:53.180865 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01ed0fd-a489-40e8-9ddf-f110080fcf08 None admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 07:58:53.293936 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01ed0fd-a489-40e8-9ddf-f110080fcf08 None admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 07:58:53.308362 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f813a9-5c36-49b0-8571-206080b82e01 None None] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 07:58:53.308950 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f813a9-5c36-49b0-8571-206080b82e01 None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 07:58:53.309678 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f813a9-5c36-49b0-8571-206080b82e01 None None] PATH_INFO: `/` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 07:58:53.311642 dv-cinder-851351-1-smb devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 175/321] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 07:58:53 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 07:58:53.316217 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=100 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 07:58:53.317002 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06a529b-c13b-4364-921c-c5c9114e7e60 None None] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 07:58:53.317479 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06a529b-c13b-4364-921c-c5c9114e7e60 None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 07:58:53.318127 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06a529b-c13b-4364-921c-c5c9114e7e60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 07:58:53.337209 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ce4631-9125-49c5-ad9b-7409bea17555 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 07:58:53.337875 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ce4631-9125-49c5-ad9b-7409bea17555 None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 07:58:53.338158 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ce4631-9125-49c5-ad9b-7409bea17555 None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 07:58:53.338435 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ce4631-9125-49c5-ad9b-7409bea17555 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 07:58:53.339869 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9ce4631-9125-49c5-ad9b-7409bea17555 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 07:58:53.340966 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.auth.core [None req-c06a529b-c13b-4364-921c-c5c9114e7e60 None None] MFA Rules not processed for user `f0666d3a50644a7097367331c1ee1a68`. Rule list: `[]` (Enabled: `True`). {{(pid=80347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 07:58:53.341447 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9ce4631-9125-49c5-ad9b-7409bea17555 None admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 07:58:53.342219 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-c06a529b-c13b-4364-921c-c5c9114e7e60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 07:58:53.343385 dv-cinder-851351-1-smb devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 147/322] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 07:58:53 2022] GET /identity/v3/domains/default => generated 199 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 07:58:53.350255 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ce4631-9125-49c5-ad9b-7409bea17555 None admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 07:58:53.415431 dv-cinder-851351-1-smb devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 176/323] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 07:58:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 28 07:58:53.437065 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06a529b-c13b-4364-921c-c5c9114e7e60 None None] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 07:58:53.440913 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 07:58:53.461033 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ce4631-9125-49c5-ad9b-7409bea17555 None admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 07:58:53.496288 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7adb6d-5125-4826-8eff-310e8616cd5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 07:58:53.496947 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7adb6d-5125-4826-8eff-310e8616cd5b None admin] REQUEST_METHOD: `POST` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 07:58:53.497227 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7adb6d-5125-4826-8eff-310e8616cd5b None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 07:58:53.497572 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7adb6d-5125-4826-8eff-310e8616cd5b None admin] PATH_INFO: `/v3/groups` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 07:58:53.498244 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e7adb6d-5125-4826-8eff-310e8616cd5b None admin] RBAC: Authorizing `identity:create_group()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 07:58:53.500175 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e7adb6d-5125-4826-8eff-310e8616cd5b None admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 07:58:53.519442 dv-cinder-851351-1-smb devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 148/324] 10.222.0.42 () {60 vars in 1134 bytes} [Thu Jul 28 07:58:53 2022] POST /identity/v3/groups => generated 226 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 28 07:58:53.554309 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06a529b-c13b-4364-921c-c5c9114e7e60 None None] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 07:58:53.594285 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bffe134d-f3c8-418f-84b0-a85020819f1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 07:58:53.594946 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bffe134d-f3c8-418f-84b0-a85020819f1e None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 07:58:53.595213 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bffe134d-f3c8-418f-84b0-a85020819f1e None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 07:58:53.595547 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bffe134d-f3c8-418f-84b0-a85020819f1e None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 07:58:53.608063 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bffe134d-f3c8-418f-84b0-a85020819f1e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 07:58:53.613139 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application [None req-bffe134d-f3c8-418f-84b0-a85020819f1e None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 28 07:58:53.613139 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 07:58:53.613139 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 07:58:53.613139 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 07:58:53.613139 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 07:58:53.613139 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 07:58:53.613139 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 07:58:53.613139 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 07:58:53.613139 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 07:58:53.613139 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 07:58:53.613139 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 07:58:53.613139 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 07:58:53.613139 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 07:58:53.613139 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 07:58:53.613139 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 07:58:53.613139 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 07:58:53.614029 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 07:58:53.614029 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 07:58:53.614029 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 07:58:53.614029 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 07:58:53.614029 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 07:58:53.614029 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 07:58:53.614029 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 07:58:53.614029 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 07:58:53.614029 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 07:58:53.614029 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 07:58:53.614029 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 07:58:53.614029 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application with Lock( Jul 28 07:58:53.614029 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 07:58:53.614029 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._enter() Jul 28 07:58:53.614029 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 07:58:53.614029 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 07:58:53.614836 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 07:58:53.614836 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.creator() Jul 28 07:58:53.614836 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 07:58:53.614836 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application created_value = creator( Jul 28 07:58:53.614836 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 07:58:53.614836 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 07:58:53.614836 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 07:58:53.614836 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 07:58:53.614836 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 07:58:53.614836 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 07:58:53.614836 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 28 07:58:53.614836 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application Jul 28 07:58:53.619431 dv-cinder-851351-1-smb devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 177/325] 10.222.0.42 () {56 vars in 1099 bytes} [Thu Jul 28 07:58:53 2022] GET /identity/v3/roles/reader => generated 84 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 07:58:53.620777 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7adb6d-5125-4826-8eff-310e8616cd5b None admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 07:58:53.676617 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 07:58:53.733951 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7adb6d-5125-4826-8eff-310e8616cd5b None admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 07:58:53.775526 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77315c0-5dc3-4690-8010-a3d36a637c0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 07:58:53.776263 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77315c0-5dc3-4690-8010-a3d36a637c0d None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 07:58:53.776493 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77315c0-5dc3-4690-8010-a3d36a637c0d None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 07:58:53.776800 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77315c0-5dc3-4690-8010-a3d36a637c0d None admin] PATH_INFO: `/v3/roles` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 07:58:53.777533 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b77315c0-5dc3-4690-8010-a3d36a637c0d None admin] RBAC: Adding query filter params (name=reader) {{(pid=80348) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 07:58:53.777842 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b77315c0-5dc3-4690-8010-a3d36a637c0d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 07:58:53.779231 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b77315c0-5dc3-4690-8010-a3d36a637c0d None admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 07:58:53.788437 dv-cinder-851351-1-smb devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 149/326] 10.222.0.42 () {56 vars in 1101 bytes} [Thu Jul 28 07:58:53 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 07:58:53.794068 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bffe134d-f3c8-418f-84b0-a85020819f1e None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 07:58:53.868712 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 07:58:53.912267 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bffe134d-f3c8-418f-84b0-a85020819f1e None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 07:58:53.951182 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1624135d-e960-4e66-9b60-47743999fc44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 07:58:53.952069 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1624135d-e960-4e66-9b60-47743999fc44 None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 07:58:53.952501 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1624135d-e960-4e66-9b60-47743999fc44 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 07:58:53.952929 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1624135d-e960-4e66-9b60-47743999fc44 None admin] PATH_INFO: `/v3/users/edaa956f2de14c85adfd260924029d57` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 07:58:53.954358 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1624135d-e960-4e66-9b60-47743999fc44 None admin] RBAC: Authorizing `identity:get_user(user_id=edaa956f2de14c85adfd260924029d57)` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 07:58:53.956376 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1624135d-e960-4e66-9b60-47743999fc44 None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 07:58:53.958502 dv-cinder-851351-1-smb devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 178/327] 10.222.0.42 () {56 vars in 1177 bytes} [Thu Jul 28 07:58:53 2022] GET /identity/v3/users/edaa956f2de14c85adfd260924029d57 => generated 293 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 07:58:53.964355 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77315c0-5dc3-4690-8010-a3d36a637c0d None admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 07:58:54.071340 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77315c0-5dc3-4690-8010-a3d36a637c0d None admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 07:58:54.084725 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=100 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 07:58:54.116882 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0acbd834-dbdf-4672-9341-eb88305257b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 07:58:54.117804 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0acbd834-dbdf-4672-9341-eb88305257b0 None admin] REQUEST_METHOD: `PUT` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 07:58:54.118249 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0acbd834-dbdf-4672-9341-eb88305257b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 07:58:54.118663 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0acbd834-dbdf-4672-9341-eb88305257b0 None admin] PATH_INFO: `/v3/system/users/edaa956f2de14c85adfd260924029d57/roles/21c3f6dd315a425a98d00fcf994f3a36` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 07:58:54.120310 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0acbd834-dbdf-4672-9341-eb88305257b0 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=edaa956f2de14c85adfd260924029d57, role_id=21c3f6dd315a425a98d00fcf994f3a36)` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 07:58:54.121875 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0acbd834-dbdf-4672-9341-eb88305257b0 None admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 07:58:54.130560 dv-cinder-851351-1-smb devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 150/328] 10.222.0.42 () {58 vars in 1334 bytes} [Thu Jul 28 07:58:53 2022] PUT /identity/v3/system/users/edaa956f2de14c85adfd260924029d57/roles/21c3f6dd315a425a98d00fcf994f3a36 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 28 07:58:54.156207 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede46297-e9ed-455d-99ce-bd01e2781350 None None] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 07:58:54.156847 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede46297-e9ed-455d-99ce-bd01e2781350 None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 07:58:54.157291 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede46297-e9ed-455d-99ce-bd01e2781350 None None] PATH_INFO: `/` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 07:58:54.158891 dv-cinder-851351-1-smb devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 179/329] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 07:58:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 07:58:54.170422 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb4ca5a-a477-43b1-a64d-6f470f8d091b None None] REQUEST_METHOD: `POST` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 07:58:54.170708 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb4ca5a-a477-43b1-a64d-6f470f8d091b None None] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 07:58:54.170978 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb4ca5a-a477-43b1-a64d-6f470f8d091b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 07:58:54.192506 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.auth.core [None req-9bb4ca5a-a477-43b1-a64d-6f470f8d091b None None] MFA Rules not processed for user `f0666d3a50644a7097367331c1ee1a68`. Rule list: `[]` (Enabled: `True`). {{(pid=80348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 07:58:54.193764 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.fernet_utils [None req-9bb4ca5a-a477-43b1-a64d-6f470f8d091b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 07:58:54.278194 dv-cinder-851351-1-smb devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 151/330] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 07:58:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 07:58:54.301785 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede46297-e9ed-455d-99ce-bd01e2781350 None None] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 07:58:54.434402 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede46297-e9ed-455d-99ce-bd01e2781350 None None] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 07:58:54.467046 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 07:58:54.476724 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fcd8d6b-6587-4f54-966b-32b95124124c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 07:58:54.477396 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fcd8d6b-6587-4f54-966b-32b95124124c None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 07:58:54.478122 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fcd8d6b-6587-4f54-966b-32b95124124c None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 07:58:54.478781 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fcd8d6b-6587-4f54-966b-32b95124124c None admin] PATH_INFO: `/v3/roles/member` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 07:58:54.493938 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fcd8d6b-6587-4f54-966b-32b95124124c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 07:58:54.499090 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application [None req-3fcd8d6b-6587-4f54-966b-32b95124124c None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 28 07:58:54.499090 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 07:58:54.499090 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 07:58:54.499090 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 07:58:54.499090 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 07:58:54.499090 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 07:58:54.499090 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 07:58:54.499090 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 07:58:54.499090 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 07:58:54.499090 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 07:58:54.499090 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 07:58:54.499090 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 07:58:54.499090 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 07:58:54.499090 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 07:58:54.499090 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 07:58:54.499090 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 07:58:54.499943 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 07:58:54.499943 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 07:58:54.499943 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 07:58:54.499943 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 07:58:54.499943 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 07:58:54.499943 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 07:58:54.499943 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 07:58:54.499943 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 07:58:54.499943 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 07:58:54.499943 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 07:58:54.499943 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 07:58:54.499943 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application with Lock( Jul 28 07:58:54.499943 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 07:58:54.499943 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._enter() Jul 28 07:58:54.499943 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 07:58:54.499943 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 07:58:54.500747 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 07:58:54.500747 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.creator() Jul 28 07:58:54.500747 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 07:58:54.500747 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application created_value = creator( Jul 28 07:58:54.500747 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 07:58:54.500747 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 07:58:54.500747 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 07:58:54.500747 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 07:58:54.500747 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 07:58:54.500747 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 07:58:54.500747 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 28 07:58:54.500747 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application Jul 28 07:58:54.500747 dv-cinder-851351-1-smb devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 180/331] 10.222.0.42 () {56 vars in 1099 bytes} [Thu Jul 28 07:58:54 2022] GET /identity/v3/roles/member => generated 84 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 07:58:54.507843 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb4ca5a-a477-43b1-a64d-6f470f8d091b None None] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 07:58:54.646583 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 07:58:54.653408 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb4ca5a-a477-43b1-a64d-6f470f8d091b None None] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 07:58:54.695781 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a30e3e5-e8de-48f9-8e9a-6412827b4014 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 07:58:54.696418 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a30e3e5-e8de-48f9-8e9a-6412827b4014 None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 07:58:54.696719 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a30e3e5-e8de-48f9-8e9a-6412827b4014 None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 07:58:54.697118 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a30e3e5-e8de-48f9-8e9a-6412827b4014 None admin] PATH_INFO: `/v3/roles` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 07:58:54.697897 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a30e3e5-e8de-48f9-8e9a-6412827b4014 None admin] RBAC: Adding query filter params (name=member) {{(pid=80348) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 07:58:54.698200 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a30e3e5-e8de-48f9-8e9a-6412827b4014 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 07:58:54.699602 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a30e3e5-e8de-48f9-8e9a-6412827b4014 None admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 07:58:54.712742 dv-cinder-851351-1-smb devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 152/332] 10.222.0.42 () {56 vars in 1101 bytes} [Thu Jul 28 07:58:54 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 07:58:54.718745 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fcd8d6b-6587-4f54-966b-32b95124124c None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 07:58:54.877043 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fcd8d6b-6587-4f54-966b-32b95124124c None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 07:58:54.921424 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88cd6894-2f33-4ebd-9e36-0e09dddcd58f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 07:58:54.922441 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88cd6894-2f33-4ebd-9e36-0e09dddcd58f None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 07:58:54.922912 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88cd6894-2f33-4ebd-9e36-0e09dddcd58f None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 07:58:54.923375 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88cd6894-2f33-4ebd-9e36-0e09dddcd58f None admin] PATH_INFO: `/v3/users/9d91f17a57e44b8a8d599c47cd575d0e` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 07:58:54.924803 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88cd6894-2f33-4ebd-9e36-0e09dddcd58f None admin] RBAC: Authorizing `identity:get_user(user_id=9d91f17a57e44b8a8d599c47cd575d0e)` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 07:58:54.926456 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88cd6894-2f33-4ebd-9e36-0e09dddcd58f None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 07:58:54.928706 dv-cinder-851351-1-smb devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 181/333] 10.222.0.42 () {56 vars in 1177 bytes} [Thu Jul 28 07:58:54 2022] GET /identity/v3/users/9d91f17a57e44b8a8d599c47cd575d0e => generated 293 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 07:58:54.934824 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a30e3e5-e8de-48f9-8e9a-6412827b4014 None admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 07:58:55.092682 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a30e3e5-e8de-48f9-8e9a-6412827b4014 None admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 07:58:55.138897 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2ed0c5-12bb-4913-9060-595e1dc32045 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 07:58:55.139536 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2ed0c5-12bb-4913-9060-595e1dc32045 None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 07:58:55.139804 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2ed0c5-12bb-4913-9060-595e1dc32045 None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 07:58:55.140072 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2ed0c5-12bb-4913-9060-595e1dc32045 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 07:58:55.140908 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a2ed0c5-12bb-4913-9060-595e1dc32045 None admin] RBAC: Adding query filter params (role.id=0317c30d81ff44eea2fd4a7215c60eac, user.id=9d91f17a57e44b8a8d599c47cd575d0e, scope.system=all) {{(pid=80348) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 07:58:55.141221 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a2ed0c5-12bb-4913-9060-595e1dc32045 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 07:58:55.142668 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a2ed0c5-12bb-4913-9060-595e1dc32045 None admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 07:58:55.161155 dv-cinder-851351-1-smb devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 153/334] 10.222.0.42 () {56 vars in 1308 bytes} [Thu Jul 28 07:58:54 2022] GET /identity/v3/role_assignments?user.id=9d91f17a57e44b8a8d599c47cd575d0e&scope.system=all&role.id=0317c30d81ff44eea2fd4a7215c60eac => generated 510 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 07:58:55.875192 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ecba153-2db3-4fec-ba0e-085c5747aae6 None None] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 07:58:55.875464 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ecba153-2db3-4fec-ba0e-085c5747aae6 None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 07:58:55.875990 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ecba153-2db3-4fec-ba0e-085c5747aae6 None None] PATH_INFO: `/` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 07:58:55.877862 dv-cinder-851351-1-smb devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 182/335] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 07:58:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 07:58:55.884141 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82c37cc-d4ad-42e5-b21c-52ae3731530d None None] REQUEST_METHOD: `POST` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 07:58:55.884718 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82c37cc-d4ad-42e5-b21c-52ae3731530d None None] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 07:58:55.885179 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82c37cc-d4ad-42e5-b21c-52ae3731530d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 07:58:55.917720 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.auth.core [None req-a82c37cc-d4ad-42e5-b21c-52ae3731530d None None] MFA Rules not processed for user `f0666d3a50644a7097367331c1ee1a68`. Rule list: `[]` (Enabled: `True`). {{(pid=80348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 07:58:55.919356 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.fernet_utils [None req-a82c37cc-d4ad-42e5-b21c-52ae3731530d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 07:58:55.935199 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=100 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 07:58:56.007235 dv-cinder-851351-1-smb devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 154/336] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 07:58:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 28 07:58:56.050277 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ecba153-2db3-4fec-ba0e-085c5747aae6 None None] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 07:58:56.126395 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 07:58:56.176358 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ecba153-2db3-4fec-ba0e-085c5747aae6 None None] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 07:58:56.223967 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328ded0b-2fca-43d3-b5b4-5c036601adc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 07:58:56.225021 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328ded0b-2fca-43d3-b5b4-5c036601adc7 None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 07:58:56.225516 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328ded0b-2fca-43d3-b5b4-5c036601adc7 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 07:58:56.225979 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328ded0b-2fca-43d3-b5b4-5c036601adc7 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 07:58:56.246654 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-328ded0b-2fca-43d3-b5b4-5c036601adc7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 07:58:56.252147 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application [None req-328ded0b-2fca-43d3-b5b4-5c036601adc7 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 28 07:58:56.252147 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 07:58:56.252147 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 07:58:56.252147 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 07:58:56.252147 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 07:58:56.252147 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 07:58:56.252147 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 07:58:56.252147 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 07:58:56.252147 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 07:58:56.252147 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 07:58:56.252147 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 07:58:56.252147 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 07:58:56.252147 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 07:58:56.252147 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 07:58:56.252147 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 07:58:56.252147 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 07:58:56.253077 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 07:58:56.253077 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 07:58:56.253077 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 07:58:56.253077 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 07:58:56.253077 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 07:58:56.253077 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 07:58:56.253077 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 07:58:56.253077 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 07:58:56.253077 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 07:58:56.253077 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 07:58:56.253077 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 07:58:56.253077 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application with Lock( Jul 28 07:58:56.253077 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 07:58:56.253077 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._enter() Jul 28 07:58:56.253077 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 07:58:56.253077 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 07:58:56.253870 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 07:58:56.253870 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.creator() Jul 28 07:58:56.253870 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 07:58:56.253870 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application created_value = creator( Jul 28 07:58:56.253870 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 07:58:56.253870 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 07:58:56.253870 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 07:58:56.253870 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 07:58:56.253870 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 07:58:56.253870 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 07:58:56.253870 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 28 07:58:56.253870 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application Jul 28 07:58:56.256717 dv-cinder-851351-1-smb devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 183/337] 10.222.0.42 () {56 vars in 1099 bytes} [Thu Jul 28 07:58:56 2022] GET /identity/v3/roles/member => generated 84 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 07:58:56.262316 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a82c37cc-d4ad-42e5-b21c-52ae3731530d None None] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 07:58:56.398273 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a82c37cc-d4ad-42e5-b21c-52ae3731530d None None] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 07:58:56.435076 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f1b7eb-3e1f-4384-8557-bc2483ef6a57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 07:58:56.435722 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f1b7eb-3e1f-4384-8557-bc2483ef6a57 None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 07:58:56.436056 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f1b7eb-3e1f-4384-8557-bc2483ef6a57 None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 07:58:56.436331 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f1b7eb-3e1f-4384-8557-bc2483ef6a57 None admin] PATH_INFO: `/v3/roles` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 07:58:56.437128 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f1b7eb-3e1f-4384-8557-bc2483ef6a57 None admin] RBAC: Adding query filter params (name=member) {{(pid=80348) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 07:58:56.437430 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f1b7eb-3e1f-4384-8557-bc2483ef6a57 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 07:58:56.438833 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f1b7eb-3e1f-4384-8557-bc2483ef6a57 None admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 07:58:56.448618 dv-cinder-851351-1-smb devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 155/338] 10.222.0.42 () {56 vars in 1101 bytes} [Thu Jul 28 07:58:56 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 07:58:56.454195 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328ded0b-2fca-43d3-b5b4-5c036601adc7 None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 07:58:56.585353 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328ded0b-2fca-43d3-b5b4-5c036601adc7 None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 07:58:56.608072 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 07:58:56.626647 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3d59df-86be-421b-b201-add6891a1c16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 07:58:56.627286 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3d59df-86be-421b-b201-add6891a1c16 None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 07:58:56.627557 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3d59df-86be-421b-b201-add6891a1c16 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 07:58:56.627825 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3d59df-86be-421b-b201-add6891a1c16 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 07:58:56.716502 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d3d59df-86be-421b-b201-add6891a1c16 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 07:58:56.718029 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d3d59df-86be-421b-b201-add6891a1c16 None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 07:58:56.846225 dv-cinder-851351-1-smb devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 184/339] 10.222.0.42 () {58 vars in 1282 bytes} [Thu Jul 28 07:58:56 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 392 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 28 07:58:56.853703 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f1b7eb-3e1f-4384-8557-bc2483ef6a57 None admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 07:58:56.870848 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=100 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 07:58:56.976575 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f1b7eb-3e1f-4384-8557-bc2483ef6a57 None admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 07:58:57.016400 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a5b44f-460f-4446-a656-953435d3a229 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 07:58:57.017461 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a5b44f-460f-4446-a656-953435d3a229 None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 07:58:57.017940 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a5b44f-460f-4446-a656-953435d3a229 None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 07:58:57.018405 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a5b44f-460f-4446-a656-953435d3a229 None admin] PATH_INFO: `/v3/projects/cdfa7c2638114a968f5357dc098b441b` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 07:58:57.019835 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5a5b44f-460f-4446-a656-953435d3a229 None admin] RBAC: Authorizing `identity:get_project(project_id=cdfa7c2638114a968f5357dc098b441b)` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 07:58:57.022219 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5a5b44f-460f-4446-a656-953435d3a229 None admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 07:58:57.024487 dv-cinder-851351-1-smb devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 156/340] 10.222.0.42 () {56 vars in 1186 bytes} [Thu Jul 28 07:58:56 2022] GET /identity/v3/projects/cdfa7c2638114a968f5357dc098b441b => generated 298 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 07:58:57.033861 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3d59df-86be-421b-b201-add6891a1c16 None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 07:58:57.059987 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 07:58:57.078608 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb5b29c-0ba4-447f-b1e0-cd254d0451cd None None] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 07:58:57.079255 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb5b29c-0ba4-447f-b1e0-cd254d0451cd None None] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 07:58:57.079725 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb5b29c-0ba4-447f-b1e0-cd254d0451cd None None] PATH_INFO: `/` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 07:58:57.082265 dv-cinder-851351-1-smb devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 157/341] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 07:58:57 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 28 07:58:57.092636 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8cf43d2-11ff-4066-9f06-0704772c275c None None] REQUEST_METHOD: `POST` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 07:58:57.093245 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8cf43d2-11ff-4066-9f06-0704772c275c None None] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 07:58:57.093740 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8cf43d2-11ff-4066-9f06-0704772c275c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 07:58:57.119855 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.auth.core [None req-b8cf43d2-11ff-4066-9f06-0704772c275c None None] MFA Rules not processed for user `f0666d3a50644a7097367331c1ee1a68`. Rule list: `[]` (Enabled: `True`). {{(pid=80348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 07:58:57.121500 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.fernet_utils [None req-b8cf43d2-11ff-4066-9f06-0704772c275c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 07:58:57.217237 dv-cinder-851351-1-smb devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 158/342] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 07:58:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 28 07:58:57.218868 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4fdee7-eff1-4f83-820a-0c9d29b4df72 None None] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 07:58:57.219823 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4fdee7-eff1-4f83-820a-0c9d29b4df72 None None] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 07:58:57.220248 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4fdee7-eff1-4f83-820a-0c9d29b4df72 None None] PATH_INFO: `/` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 07:58:57.222149 dv-cinder-851351-1-smb devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 159/343] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 07:58:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 07:58:57.228281 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3e2109-647c-4868-847d-9f4780008285 None None] REQUEST_METHOD: `POST` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 07:58:57.228777 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3e2109-647c-4868-847d-9f4780008285 None None] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 07:58:57.229323 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3e2109-647c-4868-847d-9f4780008285 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 07:58:57.254617 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.auth.core [None req-5b3e2109-647c-4868-847d-9f4780008285 None None] MFA Rules not processed for user `f0666d3a50644a7097367331c1ee1a68`. Rule list: `[]` (Enabled: `True`). {{(pid=80348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 07:58:57.256204 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.fernet_utils [None req-5b3e2109-647c-4868-847d-9f4780008285 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 07:58:57.263848 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=100 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 07:58:57.268158 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3d59df-86be-421b-b201-add6891a1c16 None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 07:58:57.326521 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a9508b4-db95-4d59-bc47-57c310bfab72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 07:58:57.327433 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9508b4-db95-4d59-bc47-57c310bfab72 None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 07:58:57.327844 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9508b4-db95-4d59-bc47-57c310bfab72 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 07:58:57.328244 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9508b4-db95-4d59-bc47-57c310bfab72 None admin] PATH_INFO: `/v3/groups/62a03a5df2bb4784abc8a0bd5def0e79` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 07:58:57.341388 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a9508b4-db95-4d59-bc47-57c310bfab72 None admin] RBAC: Authorizing `identity:get_group(group_id=62a03a5df2bb4784abc8a0bd5def0e79)` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 07:58:57.343189 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a9508b4-db95-4d59-bc47-57c310bfab72 None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 07:58:57.345126 dv-cinder-851351-1-smb devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 185/344] 10.222.0.42 () {56 vars in 1180 bytes} [Thu Jul 28 07:58:57 2022] GET /identity/v3/groups/62a03a5df2bb4784abc8a0bd5def0e79 => generated 226 bytes in 312 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 07:58:57.346107 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a9508b4-db95-4d59-bc47-57c310bfab72 None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 07:58:57.354399 dv-cinder-851351-1-smb devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 160/345] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 07:58:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 07:58:57.356107 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b3e2109-647c-4868-847d-9f4780008285 None None] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 07:58:57.480056 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b3e2109-647c-4868-847d-9f4780008285 None None] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 07:58:57.489260 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 07:58:57.499400 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a9508b4-db95-4d59-bc47-57c310bfab72 None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 07:58:57.520570 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f1692e9-6733-47e6-b756-ce882284d2dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 07:58:57.521278 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1692e9-6733-47e6-b756-ce882284d2dc None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 07:58:57.521559 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1692e9-6733-47e6-b756-ce882284d2dc None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 07:58:57.521835 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1692e9-6733-47e6-b756-ce882284d2dc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 07:58:57.522642 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f1692e9-6733-47e6-b756-ce882284d2dc None admin] RBAC: Adding query filter params (group.id=62a03a5df2bb4784abc8a0bd5def0e79, role.id=0317c30d81ff44eea2fd4a7215c60eac, scope.project.id=cdfa7c2638114a968f5357dc098b441b) {{(pid=80348) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 07:58:57.522951 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f1692e9-6733-47e6-b756-ce882284d2dc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 07:58:57.525059 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f1692e9-6733-47e6-b756-ce882284d2dc None admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 07:58:57.532068 dv-cinder-851351-1-smb devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 161/346] 10.222.0.42 () {56 vars in 1376 bytes} [Thu Jul 28 07:58:57 2022] GET /identity/v3/role_assignments?group.id=62a03a5df2bb4784abc8a0bd5def0e79&scope.project.id=cdfa7c2638114a968f5357dc098b441b&role.id=0317c30d81ff44eea2fd4a7215c60eac => generated 260 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 07:58:57.537156 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f1692e9-6733-47e6-b756-ce882284d2dc None admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 07:58:57.547245 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=100 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 07:58:57.560278 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1486a5-1d6f-48f2-9ce3-2d8cb1ee453d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 07:58:57.561042 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1486a5-1d6f-48f2-9ce3-2d8cb1ee453d None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 07:58:57.561322 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1486a5-1d6f-48f2-9ce3-2d8cb1ee453d None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 07:58:57.561593 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1486a5-1d6f-48f2-9ce3-2d8cb1ee453d None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 07:58:57.586463 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd1486a5-1d6f-48f2-9ce3-2d8cb1ee453d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 07:58:57.593624 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application [None req-cd1486a5-1d6f-48f2-9ce3-2d8cb1ee453d None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 28 07:58:57.593624 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 07:58:57.593624 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 07:58:57.593624 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 07:58:57.593624 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 07:58:57.593624 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 07:58:57.593624 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 07:58:57.593624 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 07:58:57.593624 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 07:58:57.593624 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 07:58:57.593624 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 07:58:57.593624 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 07:58:57.593624 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 07:58:57.593624 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 07:58:57.593624 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 07:58:57.593624 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 07:58:57.594580 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 07:58:57.594580 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 07:58:57.594580 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 07:58:57.594580 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 07:58:57.594580 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 07:58:57.594580 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 07:58:57.594580 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 07:58:57.594580 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 07:58:57.594580 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 07:58:57.594580 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 07:58:57.594580 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 07:58:57.594580 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application with Lock( Jul 28 07:58:57.594580 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 07:58:57.594580 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._enter() Jul 28 07:58:57.594580 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 07:58:57.594580 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 07:58:57.595354 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 07:58:57.595354 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.creator() Jul 28 07:58:57.595354 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 07:58:57.595354 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application created_value = creator( Jul 28 07:58:57.595354 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 07:58:57.595354 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 07:58:57.595354 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 07:58:57.595354 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 07:58:57.595354 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 07:58:57.595354 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 07:58:57.595354 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 28 07:58:57.595354 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application Jul 28 07:58:57.595354 dv-cinder-851351-1-smb devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 186/347] 10.222.0.42 () {56 vars in 1114 bytes} [Thu Jul 28 07:58:57 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 249 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 07:58:57.596878 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9192a557-e899-486d-ad5e-f05f12f282f9 None None] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 07:58:57.596878 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9192a557-e899-486d-ad5e-f05f12f282f9 None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 07:58:57.596878 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9192a557-e899-486d-ad5e-f05f12f282f9 None None] PATH_INFO: `/` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 07:58:57.604694 dv-cinder-851351-1-smb devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 187/348] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 07:58:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 07:58:57.604694 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86e20ec-cdc6-4ee3-89b6-f20c70176fb8 None None] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 07:58:57.604976 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86e20ec-cdc6-4ee3-89b6-f20c70176fb8 None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 07:58:57.605251 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86e20ec-cdc6-4ee3-89b6-f20c70176fb8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 07:58:57.651241 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.auth.core [None req-b86e20ec-cdc6-4ee3-89b6-f20c70176fb8 None None] MFA Rules not processed for user `f0666d3a50644a7097367331c1ee1a68`. Rule list: `[]` (Enabled: `True`). {{(pid=80347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 07:58:57.652485 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-b86e20ec-cdc6-4ee3-89b6-f20c70176fb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 07:58:57.758293 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f1692e9-6733-47e6-b756-ce882284d2dc None admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 07:58:57.777499 dv-cinder-851351-1-smb devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 188/349] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 07:58:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 07:58:57.778821 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86e20ec-cdc6-4ee3-89b6-f20c70176fb8 None None] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 07:58:57.800169 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d1478c8-caa6-4209-94ff-6d7fe6efec3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 07:58:57.800862 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1478c8-caa6-4209-94ff-6d7fe6efec3b None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 07:58:57.801142 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1478c8-caa6-4209-94ff-6d7fe6efec3b None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 07:58:57.801419 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1478c8-caa6-4209-94ff-6d7fe6efec3b None admin] PATH_INFO: `/v3/roles/member` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 07:58:57.821900 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d1478c8-caa6-4209-94ff-6d7fe6efec3b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 07:58:57.827436 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application [None req-2d1478c8-caa6-4209-94ff-6d7fe6efec3b None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 28 07:58:57.827436 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 07:58:57.827436 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 07:58:57.827436 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 07:58:57.827436 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 07:58:57.827436 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 07:58:57.827436 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 07:58:57.827436 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 07:58:57.827436 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 07:58:57.827436 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 07:58:57.827436 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 07:58:57.827436 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 07:58:57.827436 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 07:58:57.827436 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 07:58:57.827436 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 07:58:57.827436 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 07:58:57.828328 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 07:58:57.828328 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 07:58:57.828328 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 07:58:57.828328 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 07:58:57.828328 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 07:58:57.828328 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 07:58:57.828328 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 07:58:57.828328 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 07:58:57.828328 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 07:58:57.828328 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 07:58:57.828328 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 07:58:57.828328 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application with Lock( Jul 28 07:58:57.828328 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 07:58:57.828328 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self._enter() Jul 28 07:58:57.828328 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 07:58:57.828328 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 07:58:57.829173 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 07:58:57.829173 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.creator() Jul 28 07:58:57.829173 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 07:58:57.829173 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application created_value = creator( Jul 28 07:58:57.829173 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 07:58:57.829173 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 07:58:57.829173 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 07:58:57.829173 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 07:58:57.829173 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 07:58:57.829173 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 07:58:57.829173 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 28 07:58:57.829173 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application Jul 28 07:58:57.829173 dv-cinder-851351-1-smb devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 162/350] 10.222.0.42 () {56 vars in 1099 bytes} [Thu Jul 28 07:58:57 2022] GET /identity/v3/roles/member => generated 84 bytes in 296 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 07:58:57.837561 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d1478c8-caa6-4209-94ff-6d7fe6efec3b None admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 07:58:57.892871 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 07:58:57.924345 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=100 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 07:58:57.936342 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86e20ec-cdc6-4ee3-89b6-f20c70176fb8 None None] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 07:58:57.969401 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d1478c8-caa6-4209-94ff-6d7fe6efec3b None admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 07:58:57.989263 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d0aaef-0736-4f9b-bf4f-ebfc8e3ea4be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 07:58:57.990316 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d0aaef-0736-4f9b-bf4f-ebfc8e3ea4be None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 07:58:57.990794 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d0aaef-0736-4f9b-bf4f-ebfc8e3ea4be None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 07:58:57.991330 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d0aaef-0736-4f9b-bf4f-ebfc8e3ea4be None admin] PATH_INFO: `/v3/roles` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 07:58:57.992252 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4d0aaef-0736-4f9b-bf4f-ebfc8e3ea4be None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 07:58:57.992800 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4d0aaef-0736-4f9b-bf4f-ebfc8e3ea4be None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 07:58:57.994390 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4d0aaef-0736-4f9b-bf4f-ebfc8e3ea4be None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 07:58:58.008584 dv-cinder-851351-1-smb devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 189/351] 10.222.0.42 () {56 vars in 1111 bytes} [Thu Jul 28 07:58:57 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 07:58:58.009521 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d0aaef-0736-4f9b-bf4f-ebfc8e3ea4be None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 07:58:58.011115 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2324825a-c287-40fa-83fd-c511385468c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 07:58:58.012269 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2324825a-c287-40fa-83fd-c511385468c5 None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 07:58:58.012785 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2324825a-c287-40fa-83fd-c511385468c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 07:58:58.013190 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2324825a-c287-40fa-83fd-c511385468c5 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 07:58:58.031345 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2324825a-c287-40fa-83fd-c511385468c5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 07:58:58.037000 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application [None req-2324825a-c287-40fa-83fd-c511385468c5 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 28 07:58:58.037000 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 07:58:58.037000 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 07:58:58.037000 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 07:58:58.037000 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 07:58:58.037000 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 07:58:58.037000 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 07:58:58.037000 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 07:58:58.037000 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 07:58:58.037000 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 07:58:58.037000 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 07:58:58.037000 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 07:58:58.037000 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 07:58:58.037000 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 07:58:58.037000 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 07:58:58.037000 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 07:58:58.037833 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 07:58:58.037833 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 07:58:58.037833 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 07:58:58.037833 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 07:58:58.037833 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 07:58:58.037833 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 07:58:58.037833 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 07:58:58.037833 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 07:58:58.037833 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 07:58:58.037833 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 07:58:58.037833 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 07:58:58.037833 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application with Lock( Jul 28 07:58:58.037833 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 07:58:58.037833 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self._enter() Jul 28 07:58:58.037833 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 07:58:58.037833 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 07:58:58.038607 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 07:58:58.038607 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.creator() Jul 28 07:58:58.038607 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 07:58:58.038607 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application created_value = creator( Jul 28 07:58:58.038607 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 07:58:58.038607 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 07:58:58.038607 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 07:58:58.038607 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 07:58:58.038607 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 07:58:58.038607 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 07:58:58.038607 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 28 07:58:58.038607 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application Jul 28 07:58:58.041287 dv-cinder-851351-1-smb devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 163/352] 10.222.0.42 () {56 vars in 1099 bytes} [Thu Jul 28 07:58:57 2022] GET /identity/v3/roles/reader => generated 84 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 07:58:58.042784 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a079faa-32ef-4d90-aa59-46faacec5e2e None None] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 07:58:58.043255 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a079faa-32ef-4d90-aa59-46faacec5e2e None None] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 07:58:58.043732 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a079faa-32ef-4d90-aa59-46faacec5e2e None None] PATH_INFO: `/` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 07:58:58.050404 dv-cinder-851351-1-smb devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 164/353] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 07:58:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 07:58:58.050404 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a079faa-32ef-4d90-aa59-46faacec5e2e None None] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 07:58:58.147711 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d0aaef-0736-4f9b-bf4f-ebfc8e3ea4be None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 07:58:58.185091 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a079faa-32ef-4d90-aa59-46faacec5e2e None None] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 07:58:58.189606 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b42027-f66f-4d33-a992-313275c048f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 07:58:58.190256 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b42027-f66f-4d33-a992-313275c048f7 None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 07:58:58.190535 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b42027-f66f-4d33-a992-313275c048f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 07:58:58.190812 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b42027-f66f-4d33-a992-313275c048f7 None admin] PATH_INFO: `/v3/roles` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 07:58:58.191546 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14b42027-f66f-4d33-a992-313275c048f7 None admin] RBAC: Adding query filter params (name=member) {{(pid=80347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 07:58:58.191852 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14b42027-f66f-4d33-a992-313275c048f7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 07:58:58.197547 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14b42027-f66f-4d33-a992-313275c048f7 None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 07:58:58.201859 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 07:58:58.212805 dv-cinder-851351-1-smb devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 190/354] 10.222.0.42 () {56 vars in 1101 bytes} [Thu Jul 28 07:58:58 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 07:58:58.217671 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b42027-f66f-4d33-a992-313275c048f7 None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 07:58:58.219615 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=100 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 07:58:58.232545 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6671d637-21e6-40cd-89e8-c151f0145269 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 07:58:58.233604 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6671d637-21e6-40cd-89e8-c151f0145269 None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 07:58:58.234100 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6671d637-21e6-40cd-89e8-c151f0145269 None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 07:58:58.234534 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6671d637-21e6-40cd-89e8-c151f0145269 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 07:58:58.325284 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6671d637-21e6-40cd-89e8-c151f0145269 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 07:58:58.327038 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6671d637-21e6-40cd-89e8-c151f0145269 None admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 07:58:58.351875 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b42027-f66f-4d33-a992-313275c048f7 None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 07:58:58.399295 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-418e69fd-9d8d-46c9-a3f0-4b3376e42a8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 07:58:58.400397 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418e69fd-9d8d-46c9-a3f0-4b3376e42a8b None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 07:58:58.400916 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418e69fd-9d8d-46c9-a3f0-4b3376e42a8b None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 07:58:58.402416 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418e69fd-9d8d-46c9-a3f0-4b3376e42a8b None admin] PATH_INFO: `/v3/roles` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 07:58:58.403591 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-418e69fd-9d8d-46c9-a3f0-4b3376e42a8b None admin] RBAC: Adding query filter params (name=reader) {{(pid=80347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 07:58:58.404124 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-418e69fd-9d8d-46c9-a3f0-4b3376e42a8b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 07:58:58.405732 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-418e69fd-9d8d-46c9-a3f0-4b3376e42a8b None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 07:58:58.416889 dv-cinder-851351-1-smb devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 191/355] 10.222.0.42 () {56 vars in 1101 bytes} [Thu Jul 28 07:58:58 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 07:58:58.422927 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5200960-8b5d-44bd-8977-3d0c7f443c03 None None] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 07:58:58.423619 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5200960-8b5d-44bd-8977-3d0c7f443c03 None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 07:58:58.424185 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5200960-8b5d-44bd-8977-3d0c7f443c03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 07:58:58.445258 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.auth.core [None req-c5200960-8b5d-44bd-8977-3d0c7f443c03 None None] MFA Rules not processed for user `f0666d3a50644a7097367331c1ee1a68`. Rule list: `[]` (Enabled: `True`). {{(pid=80347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 07:58:58.446719 dv-cinder-851351-1-smb devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 165/356] 10.222.0.42 () {58 vars in 1282 bytes} [Thu Jul 28 07:58:58 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 397 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 28 07:58:58.447380 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-c5200960-8b5d-44bd-8977-3d0c7f443c03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 07:58:58.447650 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6671d637-21e6-40cd-89e8-c151f0145269 None admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 07:58:58.480091 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=100 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 07:58:58.532148 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 07:58:58.547279 dv-cinder-851351-1-smb devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 192/357] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 07:58:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 07:58:58.548472 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5200960-8b5d-44bd-8977-3d0c7f443c03 None None] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 07:58:58.596893 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6671d637-21e6-40cd-89e8-c151f0145269 None admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 07:58:58.642593 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e32ecc-cb46-41e4-a1b1-f83f487eb5c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 07:58:58.644262 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e32ecc-cb46-41e4-a1b1-f83f487eb5c7 None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 07:58:58.644903 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e32ecc-cb46-41e4-a1b1-f83f487eb5c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 07:58:58.645378 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e32ecc-cb46-41e4-a1b1-f83f487eb5c7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 07:58:58.688363 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5200960-8b5d-44bd-8977-3d0c7f443c03 None None] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 07:58:58.723381 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00e32ecc-cb46-41e4-a1b1-f83f487eb5c7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 07:58:58.725265 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00e32ecc-cb46-41e4-a1b1-f83f487eb5c7 None admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 07:58:58.729525 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f887691e-8120-4860-94b3-2c45de584676 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 07:58:58.730185 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f887691e-8120-4860-94b3-2c45de584676 None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 07:58:58.730461 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f887691e-8120-4860-94b3-2c45de584676 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 07:58:58.730729 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f887691e-8120-4860-94b3-2c45de584676 None admin] PATH_INFO: `/v3/users/edaa956f2de14c85adfd260924029d57` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 07:58:58.731989 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f887691e-8120-4860-94b3-2c45de584676 None admin] RBAC: Authorizing `identity:get_user(user_id=edaa956f2de14c85adfd260924029d57)` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 07:58:58.733467 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f887691e-8120-4860-94b3-2c45de584676 None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 07:58:58.735951 dv-cinder-851351-1-smb devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 193/358] 10.222.0.42 () {56 vars in 1177 bytes} [Thu Jul 28 07:58:58 2022] GET /identity/v3/users/edaa956f2de14c85adfd260924029d57 => generated 293 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 07:58:58.736365 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f887691e-8120-4860-94b3-2c45de584676 None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 07:58:58.760397 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=100 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 07:58:58.810163 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 07:58:58.846046 dv-cinder-851351-1-smb devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 166/359] 10.222.0.42 () {58 vars in 1282 bytes} [Thu Jul 28 07:58:58 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 399 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 28 07:58:58.848450 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e32ecc-cb46-41e4-a1b1-f83f487eb5c7 None admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 07:58:58.859737 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f887691e-8120-4860-94b3-2c45de584676 None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 07:58:58.901328 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276309e2-aa11-4898-aa7b-5d0ce26294cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 07:58:58.902098 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276309e2-aa11-4898-aa7b-5d0ce26294cf None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 07:58:58.902343 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276309e2-aa11-4898-aa7b-5d0ce26294cf None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 07:58:58.902611 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276309e2-aa11-4898-aa7b-5d0ce26294cf None admin] PATH_INFO: `/v3/projects/cdfa7c2638114a968f5357dc098b441b` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 07:58:58.903828 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-276309e2-aa11-4898-aa7b-5d0ce26294cf None admin] RBAC: Authorizing `identity:get_project(project_id=cdfa7c2638114a968f5357dc098b441b)` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 07:58:58.905300 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-276309e2-aa11-4898-aa7b-5d0ce26294cf None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 07:58:58.907482 dv-cinder-851351-1-smb devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 194/360] 10.222.0.42 () {56 vars in 1186 bytes} [Thu Jul 28 07:58:58 2022] GET /identity/v3/projects/cdfa7c2638114a968f5357dc098b441b => generated 298 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 07:58:58.908321 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276309e2-aa11-4898-aa7b-5d0ce26294cf None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 07:58:58.971742 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e32ecc-cb46-41e4-a1b1-f83f487eb5c7 None admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 07:58:59.002285 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=100 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 07:58:59.014811 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6310e93f-0955-42ec-970a-b172b2901c49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 07:58:59.016299 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6310e93f-0955-42ec-970a-b172b2901c49 None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 07:58:59.016811 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6310e93f-0955-42ec-970a-b172b2901c49 None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 07:58:59.017283 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6310e93f-0955-42ec-970a-b172b2901c49 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 07:58:59.023822 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276309e2-aa11-4898-aa7b-5d0ce26294cf None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 07:58:59.030065 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6310e93f-0955-42ec-970a-b172b2901c49 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 07:58:59.036704 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application [None req-6310e93f-0955-42ec-970a-b172b2901c49 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 28 07:58:59.036704 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 07:58:59.036704 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 07:58:59.036704 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 07:58:59.036704 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 07:58:59.036704 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 07:58:59.036704 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 07:58:59.036704 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 07:58:59.036704 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 07:58:59.036704 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 07:58:59.036704 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 07:58:59.036704 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 07:58:59.036704 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 07:58:59.036704 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 07:58:59.036704 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 07:58:59.036704 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 07:58:59.037689 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 07:58:59.037689 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 07:58:59.037689 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 07:58:59.037689 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 07:58:59.037689 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 07:58:59.037689 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 07:58:59.037689 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 07:58:59.037689 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 07:58:59.037689 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 07:58:59.037689 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 07:58:59.037689 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 07:58:59.037689 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application with Lock( Jul 28 07:58:59.037689 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 07:58:59.037689 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self._enter() Jul 28 07:58:59.037689 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 07:58:59.037689 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 07:58:59.038508 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 07:58:59.038508 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.creator() Jul 28 07:58:59.038508 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 07:58:59.038508 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application created_value = creator( Jul 28 07:58:59.038508 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 07:58:59.038508 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 07:58:59.038508 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 07:58:59.038508 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 07:58:59.038508 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 07:58:59.038508 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 07:58:59.038508 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 28 07:58:59.038508 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application Jul 28 07:58:59.039923 dv-cinder-851351-1-smb devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 167/361] 10.222.0.42 () {56 vars in 1114 bytes} [Thu Jul 28 07:58:58 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 07:58:59.044584 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6310e93f-0955-42ec-970a-b172b2901c49 None admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 07:58:59.052955 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 07:58:59.067321 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800e46bc-d341-4630-b463-eeaec9bd9e71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 07:58:59.068385 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800e46bc-d341-4630-b463-eeaec9bd9e71 None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 07:58:59.068995 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800e46bc-d341-4630-b463-eeaec9bd9e71 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 07:58:59.069466 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800e46bc-d341-4630-b463-eeaec9bd9e71 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 07:58:59.070466 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-800e46bc-d341-4630-b463-eeaec9bd9e71 None admin] RBAC: Adding query filter params (role.id=21c3f6dd315a425a98d00fcf994f3a36, user.id=edaa956f2de14c85adfd260924029d57, scope.system=all) {{(pid=80347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 07:58:59.071021 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-800e46bc-d341-4630-b463-eeaec9bd9e71 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 07:58:59.072697 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-800e46bc-d341-4630-b463-eeaec9bd9e71 None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 07:58:59.087423 dv-cinder-851351-1-smb devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 195/362] 10.222.0.42 () {56 vars in 1308 bytes} [Thu Jul 28 07:58:58 2022] GET /identity/v3/role_assignments?user.id=edaa956f2de14c85adfd260924029d57&scope.system=all&role.id=21c3f6dd315a425a98d00fcf994f3a36 => generated 510 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 07:58:59.088046 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800e46bc-d341-4630-b463-eeaec9bd9e71 None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 07:58:59.223559 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800e46bc-d341-4630-b463-eeaec9bd9e71 None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 07:58:59.227913 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6310e93f-0955-42ec-970a-b172b2901c49 None admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 07:58:59.266543 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201f32b9-09d6-455a-b570-0e05c599a86a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 07:58:59.267584 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201f32b9-09d6-455a-b570-0e05c599a86a None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 07:58:59.268063 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201f32b9-09d6-455a-b570-0e05c599a86a None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 07:58:59.268532 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201f32b9-09d6-455a-b570-0e05c599a86a None admin] PATH_INFO: `/v3/groups/62a03a5df2bb4784abc8a0bd5def0e79` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 07:58:59.270037 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-201f32b9-09d6-455a-b570-0e05c599a86a None admin] RBAC: Authorizing `identity:get_group(group_id=62a03a5df2bb4784abc8a0bd5def0e79)` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 07:58:59.271808 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-201f32b9-09d6-455a-b570-0e05c599a86a None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 07:58:59.273815 dv-cinder-851351-1-smb devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 196/363] 10.222.0.42 () {56 vars in 1180 bytes} [Thu Jul 28 07:58:59 2022] GET /identity/v3/groups/62a03a5df2bb4784abc8a0bd5def0e79 => generated 226 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 07:58:59.275419 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3dacab8-1af7-4d67-9346-a8d149718380 None None] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 07:58:59.275919 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3dacab8-1af7-4d67-9346-a8d149718380 None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 07:58:59.276430 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3dacab8-1af7-4d67-9346-a8d149718380 None None] PATH_INFO: `/` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 07:58:59.278469 dv-cinder-851351-1-smb devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 197/364] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 07:58:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 07:58:59.279730 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3dacab8-1af7-4d67-9346-a8d149718380 None None] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 07:58:59.305483 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47da716-c261-44ee-9f16-e9e057528de7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 07:58:59.306600 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47da716-c261-44ee-9f16-e9e057528de7 None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 07:58:59.307128 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47da716-c261-44ee-9f16-e9e057528de7 None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 07:58:59.307595 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47da716-c261-44ee-9f16-e9e057528de7 None admin] PATH_INFO: `/v3/projects/0f988f0c81614261ae36a6896770b2d0` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 07:58:59.309904 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f47da716-c261-44ee-9f16-e9e057528de7 None admin] RBAC: Authorizing `identity:get_project(project_id=0f988f0c81614261ae36a6896770b2d0)` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 07:58:59.312747 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f47da716-c261-44ee-9f16-e9e057528de7 None admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 07:58:59.315969 dv-cinder-851351-1-smb devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 168/365] 10.222.0.42 () {56 vars in 1186 bytes} [Thu Jul 28 07:58:59 2022] GET /identity/v3/projects/0f988f0c81614261ae36a6896770b2d0 => generated 302 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 07:58:59.317450 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47da716-c261-44ee-9f16-e9e057528de7 None admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 07:58:59.369999 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 07:58:59.391005 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=100 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 07:58:59.432280 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3dacab8-1af7-4d67-9346-a8d149718380 None None] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 07:58:59.451226 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47da716-c261-44ee-9f16-e9e057528de7 None admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 07:58:59.483174 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6accf3c-8485-466a-a95d-6feba52e14a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 07:58:59.484526 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6accf3c-8485-466a-a95d-6feba52e14a4 None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 07:58:59.484847 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6accf3c-8485-466a-a95d-6feba52e14a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 07:58:59.485175 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6accf3c-8485-466a-a95d-6feba52e14a4 None admin] PATH_INFO: `/v3/roles` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 07:58:59.485917 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6accf3c-8485-466a-a95d-6feba52e14a4 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 07:58:59.486218 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6accf3c-8485-466a-a95d-6feba52e14a4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 07:58:59.487732 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6accf3c-8485-466a-a95d-6feba52e14a4 None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 07:58:59.495250 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad243031-d836-4d22-9b45-e9781fc85286 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 07:58:59.496151 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad243031-d836-4d22-9b45-e9781fc85286 None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 07:58:59.496612 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad243031-d836-4d22-9b45-e9781fc85286 None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 07:58:59.497185 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad243031-d836-4d22-9b45-e9781fc85286 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 07:58:59.498137 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad243031-d836-4d22-9b45-e9781fc85286 None admin] RBAC: Adding query filter params (group.id=62a03a5df2bb4784abc8a0bd5def0e79, role.id=f28d669937b942878bcf6a9103012af9, scope.project.id=cdfa7c2638114a968f5357dc098b441b) {{(pid=80348) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 07:58:59.498633 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad243031-d836-4d22-9b45-e9781fc85286 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 07:58:59.499933 dv-cinder-851351-1-smb devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 198/366] 10.222.0.42 () {56 vars in 1111 bytes} [Thu Jul 28 07:58:59 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 07:58:59.500336 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad243031-d836-4d22-9b45-e9781fc85286 None admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 07:58:59.501568 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9700558-e41c-4149-8eff-c1281e4e0768 None None] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 07:58:59.501995 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9700558-e41c-4149-8eff-c1281e4e0768 None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 07:58:59.502631 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9700558-e41c-4149-8eff-c1281e4e0768 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 07:58:59.507278 dv-cinder-851351-1-smb devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 169/367] 10.222.0.42 () {56 vars in 1376 bytes} [Thu Jul 28 07:58:59 2022] GET /identity/v3/role_assignments?group.id=62a03a5df2bb4784abc8a0bd5def0e79&scope.project.id=cdfa7c2638114a968f5357dc098b441b&role.id=f28d669937b942878bcf6a9103012af9 => generated 260 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 07:58:59.508179 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad243031-d836-4d22-9b45-e9781fc85286 None admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 07:58:59.530285 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.auth.core [None req-a9700558-e41c-4149-8eff-c1281e4e0768 None None] MFA Rules not processed for user `f0666d3a50644a7097367331c1ee1a68`. Rule list: `[]` (Enabled: `True`). {{(pid=80347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 07:58:59.532299 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-a9700558-e41c-4149-8eff-c1281e4e0768 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 07:58:59.636184 dv-cinder-851351-1-smb devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 199/368] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 07:58:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 07:58:59.636585 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad243031-d836-4d22-9b45-e9781fc85286 None admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 07:58:59.640559 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9700558-e41c-4149-8eff-c1281e4e0768 None None] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 07:58:59.664988 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=100 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 07:58:59.701030 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd27c08-75c5-4529-b8ea-8ce1ffb3ba2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 07:58:59.701875 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd27c08-75c5-4529-b8ea-8ce1ffb3ba2f None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 07:58:59.703145 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd27c08-75c5-4529-b8ea-8ce1ffb3ba2f None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 07:58:59.703431 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd27c08-75c5-4529-b8ea-8ce1ffb3ba2f None admin] PATH_INFO: `/v3/groups/62a03a5df2bb4784abc8a0bd5def0e79` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 07:58:59.706113 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cd27c08-75c5-4529-b8ea-8ce1ffb3ba2f None admin] RBAC: Authorizing `identity:get_group(group_id=62a03a5df2bb4784abc8a0bd5def0e79)` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 07:58:59.707608 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cd27c08-75c5-4529-b8ea-8ce1ffb3ba2f None admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 07:58:59.710011 dv-cinder-851351-1-smb devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 170/369] 10.222.0.42 () {56 vars in 1180 bytes} [Thu Jul 28 07:58:59 2022] GET /identity/v3/groups/62a03a5df2bb4784abc8a0bd5def0e79 => generated 226 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 07:58:59.710807 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd27c08-75c5-4529-b8ea-8ce1ffb3ba2f None admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 07:58:59.715940 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 07:58:59.780174 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9700558-e41c-4149-8eff-c1281e4e0768 None None] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 07:58:59.825473 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd684702-42b9-4bba-90b7-68b9198d58ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 07:58:59.826119 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd684702-42b9-4bba-90b7-68b9198d58ee None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 07:58:59.826397 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd684702-42b9-4bba-90b7-68b9198d58ee None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 07:58:59.826662 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd684702-42b9-4bba-90b7-68b9198d58ee None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 07:58:59.848531 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd27c08-75c5-4529-b8ea-8ce1ffb3ba2f None admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 07:58:59.893682 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7d8f53-bd93-4e52-a905-88f76cbd2c04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 07:58:59.894620 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7d8f53-bd93-4e52-a905-88f76cbd2c04 None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 07:58:59.894898 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7d8f53-bd93-4e52-a905-88f76cbd2c04 None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 07:58:59.895166 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7d8f53-bd93-4e52-a905-88f76cbd2c04 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 07:58:59.910131 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd684702-42b9-4bba-90b7-68b9198d58ee None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 07:58:59.910568 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b7d8f53-bd93-4e52-a905-88f76cbd2c04 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 07:58:59.911583 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd684702-42b9-4bba-90b7-68b9198d58ee None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 07:58:59.917281 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application [None req-6b7d8f53-bd93-4e52-a905-88f76cbd2c04 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 07:58:59.917281 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 07:58:59.917281 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 07:58:59.917281 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 07:58:59.917281 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 07:58:59.917281 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 07:58:59.917281 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 07:58:59.917281 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 07:58:59.917281 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 07:58:59.917281 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 07:58:59.917281 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 07:58:59.917281 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 07:58:59.917281 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 07:58:59.917281 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 07:58:59.917281 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 07:58:59.917281 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 07:58:59.918166 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 07:58:59.918166 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 07:58:59.918166 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 07:58:59.918166 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 07:58:59.918166 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 07:58:59.918166 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 07:58:59.918166 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 07:58:59.918166 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 07:58:59.918166 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 07:58:59.918166 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 07:58:59.918166 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 07:58:59.918166 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application with Lock( Jul 28 07:58:59.918166 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 07:58:59.918166 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self._enter() Jul 28 07:58:59.918166 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 07:58:59.918166 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 07:58:59.919015 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 07:58:59.919015 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.creator() Jul 28 07:58:59.919015 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 07:58:59.919015 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application created_value = creator( Jul 28 07:58:59.919015 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 07:58:59.919015 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 07:58:59.919015 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 07:58:59.919015 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 07:58:59.919015 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 07:58:59.919015 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 07:58:59.919015 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 07:58:59.919015 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application Jul 28 07:58:59.919015 dv-cinder-851351-1-smb devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 171/370] 10.222.0.42 () {56 vars in 1096 bytes} [Thu Jul 28 07:58:59 2022] GET /identity/v3/roles/admin => generated 83 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 07:58:59.920209 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7d8f53-bd93-4e52-a905-88f76cbd2c04 None admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 07:58:59.967011 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 07:58:59.980902 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=100 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 07:59:00.034995 dv-cinder-851351-1-smb devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 200/371] 10.222.0.42 () {58 vars in 1282 bytes} [Thu Jul 28 07:58:59 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 398 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 28 07:59:00.036228 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd684702-42b9-4bba-90b7-68b9198d58ee None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 07:59:00.056824 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7d8f53-bd93-4e52-a905-88f76cbd2c04 None admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 07:59:00.098153 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94ff0e4-96e7-412d-916f-a3771db6183c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 07:59:00.098784 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94ff0e4-96e7-412d-916f-a3771db6183c None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 07:59:00.099056 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94ff0e4-96e7-412d-916f-a3771db6183c None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 07:59:00.099321 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94ff0e4-96e7-412d-916f-a3771db6183c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 07:59:00.100217 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c94ff0e4-96e7-412d-916f-a3771db6183c None admin] RBAC: Adding query filter params (group.id=62a03a5df2bb4784abc8a0bd5def0e79, role.id=0317c30d81ff44eea2fd4a7215c60eac, scope.project.id=0f988f0c81614261ae36a6896770b2d0) {{(pid=80348) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 07:59:00.100644 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c94ff0e4-96e7-412d-916f-a3771db6183c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 07:59:00.102096 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c94ff0e4-96e7-412d-916f-a3771db6183c None admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 07:59:00.113112 dv-cinder-851351-1-smb devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 172/372] 10.222.0.42 () {56 vars in 1376 bytes} [Thu Jul 28 07:58:59 2022] GET /identity/v3/role_assignments?group.id=62a03a5df2bb4784abc8a0bd5def0e79&scope.project.id=0f988f0c81614261ae36a6896770b2d0&role.id=0317c30d81ff44eea2fd4a7215c60eac => generated 260 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 07:59:00.115126 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94ff0e4-96e7-412d-916f-a3771db6183c None admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 07:59:00.182451 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd684702-42b9-4bba-90b7-68b9198d58ee None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 07:59:00.225904 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad8eef11-837d-4834-b9b8-6f11663ad7a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 07:59:00.227347 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8eef11-837d-4834-b9b8-6f11663ad7a9 None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 07:59:00.227826 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8eef11-837d-4834-b9b8-6f11663ad7a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 07:59:00.228308 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8eef11-837d-4834-b9b8-6f11663ad7a9 None admin] PATH_INFO: `/v3/roles` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 07:59:00.229307 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad8eef11-837d-4834-b9b8-6f11663ad7a9 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 07:59:00.229842 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad8eef11-837d-4834-b9b8-6f11663ad7a9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 07:59:00.231509 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad8eef11-837d-4834-b9b8-6f11663ad7a9 None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 07:59:00.241549 dv-cinder-851351-1-smb devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 201/373] 10.222.0.42 () {56 vars in 1099 bytes} [Thu Jul 28 07:59:00 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 07:59:00.242397 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94ff0e4-96e7-412d-916f-a3771db6183c None admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 07:59:00.243516 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43fe1387-2545-4d4b-81de-6eab9387f29d None None] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 07:59:00.244015 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43fe1387-2545-4d4b-81de-6eab9387f29d None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 07:59:00.244486 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43fe1387-2545-4d4b-81de-6eab9387f29d None None] PATH_INFO: `/` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 07:59:00.246001 dv-cinder-851351-1-smb devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 202/374] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 07:59:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 07:59:00.247067 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43fe1387-2545-4d4b-81de-6eab9387f29d None None] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 07:59:00.253121 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=100 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 07:59:00.260141 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 07:59:00.284879 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe4cbcd2-3967-41a5-b650-36ed83574f31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 07:59:00.285874 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4cbcd2-3967-41a5-b650-36ed83574f31 None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 07:59:00.286432 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4cbcd2-3967-41a5-b650-36ed83574f31 None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 07:59:00.286844 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4cbcd2-3967-41a5-b650-36ed83574f31 None admin] PATH_INFO: `/v3/projects/0f988f0c81614261ae36a6896770b2d0` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 07:59:00.288456 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe4cbcd2-3967-41a5-b650-36ed83574f31 None admin] RBAC: Authorizing `identity:get_project(project_id=0f988f0c81614261ae36a6896770b2d0)` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 07:59:00.290192 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe4cbcd2-3967-41a5-b650-36ed83574f31 None admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 07:59:00.292178 dv-cinder-851351-1-smb devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 173/375] 10.222.0.42 () {56 vars in 1186 bytes} [Thu Jul 28 07:59:00 2022] GET /identity/v3/projects/0f988f0c81614261ae36a6896770b2d0 => generated 302 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 07:59:00.293904 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852168eb-b705-42e7-9d73-fc71970857f4 None None] REQUEST_METHOD: `POST` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 07:59:00.294438 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852168eb-b705-42e7-9d73-fc71970857f4 None None] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 07:59:00.294917 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852168eb-b705-42e7-9d73-fc71970857f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 07:59:00.315150 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.auth.core [None req-852168eb-b705-42e7-9d73-fc71970857f4 None None] MFA Rules not processed for user `f0666d3a50644a7097367331c1ee1a68`. Rule list: `[]` (Enabled: `True`). {{(pid=80348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 07:59:00.316702 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.fernet_utils [None req-852168eb-b705-42e7-9d73-fc71970857f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 07:59:00.368881 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43fe1387-2545-4d4b-81de-6eab9387f29d None None] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 07:59:00.399722 dv-cinder-851351-1-smb devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 174/376] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 07:59:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 07:59:00.404913 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852168eb-b705-42e7-9d73-fc71970857f4 None None] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 07:59:00.418323 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d786116-2a8c-446b-801c-2fd3b802c982 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 07:59:00.419123 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d786116-2a8c-446b-801c-2fd3b802c982 None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 07:59:00.419449 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d786116-2a8c-446b-801c-2fd3b802c982 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 07:59:00.419721 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d786116-2a8c-446b-801c-2fd3b802c982 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 07:59:00.511879 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d786116-2a8c-446b-801c-2fd3b802c982 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 07:59:00.515075 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d786116-2a8c-446b-801c-2fd3b802c982 None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 07:59:00.523838 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 07:59:00.554112 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852168eb-b705-42e7-9d73-fc71970857f4 None None] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 07:59:00.575762 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=100 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 07:59:00.600568 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8516972-c0a2-4f2f-9df4-0e325f63b039 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 07:59:00.601903 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8516972-c0a2-4f2f-9df4-0e325f63b039 None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 07:59:00.602413 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8516972-c0a2-4f2f-9df4-0e325f63b039 None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 07:59:00.602879 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8516972-c0a2-4f2f-9df4-0e325f63b039 None admin] PATH_INFO: `/v3/groups/62a03a5df2bb4784abc8a0bd5def0e79` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 07:59:00.605438 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8516972-c0a2-4f2f-9df4-0e325f63b039 None admin] RBAC: Authorizing `identity:get_group(group_id=62a03a5df2bb4784abc8a0bd5def0e79)` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 07:59:00.607348 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8516972-c0a2-4f2f-9df4-0e325f63b039 None admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 07:59:00.609611 dv-cinder-851351-1-smb devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 175/377] 10.222.0.42 () {56 vars in 1180 bytes} [Thu Jul 28 07:59:00 2022] GET /identity/v3/groups/62a03a5df2bb4784abc8a0bd5def0e79 => generated 226 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 07:59:00.610614 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8516972-c0a2-4f2f-9df4-0e325f63b039 None admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 07:59:00.646019 dv-cinder-851351-1-smb devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 203/378] 10.222.0.42 () {58 vars in 1282 bytes} [Thu Jul 28 07:59:00 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 399 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 28 07:59:00.647267 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d786116-2a8c-446b-801c-2fd3b802c982 None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 07:59:00.739244 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8516972-c0a2-4f2f-9df4-0e325f63b039 None admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 07:59:00.770145 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d786116-2a8c-446b-801c-2fd3b802c982 None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 07:59:00.779849 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0faea955-31f9-44df-8420-487d62b40044 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 07:59:00.780633 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0faea955-31f9-44df-8420-487d62b40044 None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 07:59:00.781032 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0faea955-31f9-44df-8420-487d62b40044 None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 07:59:00.781370 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0faea955-31f9-44df-8420-487d62b40044 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 07:59:00.783925 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 07:59:00.797326 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0faea955-31f9-44df-8420-487d62b40044 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 07:59:00.802476 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application [None req-0faea955-31f9-44df-8420-487d62b40044 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 28 07:59:00.802476 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 07:59:00.802476 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 07:59:00.802476 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 07:59:00.802476 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 07:59:00.802476 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 07:59:00.802476 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 07:59:00.802476 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 07:59:00.802476 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 07:59:00.802476 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 07:59:00.802476 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 07:59:00.802476 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 07:59:00.802476 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 07:59:00.802476 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 07:59:00.802476 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 07:59:00.802476 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 07:59:00.803333 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 07:59:00.803333 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 07:59:00.803333 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 07:59:00.803333 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 07:59:00.803333 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 07:59:00.803333 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 07:59:00.803333 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 07:59:00.803333 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 07:59:00.803333 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 07:59:00.803333 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 07:59:00.803333 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 07:59:00.803333 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application with Lock( Jul 28 07:59:00.803333 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 07:59:00.803333 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self._enter() Jul 28 07:59:00.803333 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 07:59:00.803333 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 07:59:00.804112 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 07:59:00.804112 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.creator() Jul 28 07:59:00.804112 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 07:59:00.804112 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application created_value = creator( Jul 28 07:59:00.804112 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 07:59:00.804112 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 07:59:00.804112 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 07:59:00.804112 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 07:59:00.804112 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 07:59:00.804112 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 07:59:00.804112 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 28 07:59:00.804112 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application Jul 28 07:59:00.804112 dv-cinder-851351-1-smb devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 176/379] 10.222.0.42 () {56 vars in 1099 bytes} [Thu Jul 28 07:59:00 2022] GET /identity/v3/roles/member => generated 84 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 07:59:00.804821 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0faea955-31f9-44df-8420-487d62b40044 None admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 07:59:00.825103 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aacbc10d-5ca8-4d5d-98b9-ecb9cdf3a17d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 07:59:00.825856 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aacbc10d-5ca8-4d5d-98b9-ecb9cdf3a17d None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 07:59:00.826231 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aacbc10d-5ca8-4d5d-98b9-ecb9cdf3a17d None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 07:59:00.826604 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aacbc10d-5ca8-4d5d-98b9-ecb9cdf3a17d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 07:59:00.827491 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aacbc10d-5ca8-4d5d-98b9-ecb9cdf3a17d None admin] RBAC: Adding query filter params (group.id=62a03a5df2bb4784abc8a0bd5def0e79, role.id=f28d669937b942878bcf6a9103012af9, scope.project.id=0f988f0c81614261ae36a6896770b2d0) {{(pid=80347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 07:59:00.827893 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aacbc10d-5ca8-4d5d-98b9-ecb9cdf3a17d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 07:59:00.829470 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aacbc10d-5ca8-4d5d-98b9-ecb9cdf3a17d None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 07:59:00.835928 dv-cinder-851351-1-smb devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 204/380] 10.222.0.42 () {56 vars in 1376 bytes} [Thu Jul 28 07:59:00 2022] GET /identity/v3/role_assignments?group.id=62a03a5df2bb4784abc8a0bd5def0e79&scope.project.id=0f988f0c81614261ae36a6896770b2d0&role.id=f28d669937b942878bcf6a9103012af9 => generated 260 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 07:59:00.836885 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aacbc10d-5ca8-4d5d-98b9-ecb9cdf3a17d None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 07:59:00.853721 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=100 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 07:59:00.938283 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0faea955-31f9-44df-8420-487d62b40044 None admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 07:59:00.976280 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aacbc10d-5ca8-4d5d-98b9-ecb9cdf3a17d None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 07:59:01.006051 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60abc9a3-fc01-4dbc-8326-1246a410301c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 07:59:01.006718 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60abc9a3-fc01-4dbc-8326-1246a410301c None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 07:59:01.006996 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60abc9a3-fc01-4dbc-8326-1246a410301c None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 07:59:01.007265 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60abc9a3-fc01-4dbc-8326-1246a410301c None admin] PATH_INFO: `/v3/projects/d51c90075a0545959e2ede68845ae91b` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 07:59:01.008516 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60abc9a3-fc01-4dbc-8326-1246a410301c None admin] RBAC: Authorizing `identity:get_project(project_id=d51c90075a0545959e2ede68845ae91b)` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 07:59:01.010047 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60abc9a3-fc01-4dbc-8326-1246a410301c None admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 07:59:01.012138 dv-cinder-851351-1-smb devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 177/381] 10.222.0.42 () {56 vars in 1186 bytes} [Thu Jul 28 07:59:00 2022] GET /identity/v3/projects/d51c90075a0545959e2ede68845ae91b => generated 344 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 07:59:01.021837 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60abc9a3-fc01-4dbc-8326-1246a410301c None admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 07:59:01.042328 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74bd46d8-cf9a-4486-920a-1be6e6012abf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 07:59:01.042980 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74bd46d8-cf9a-4486-920a-1be6e6012abf None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 07:59:01.043254 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74bd46d8-cf9a-4486-920a-1be6e6012abf None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 07:59:01.043525 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74bd46d8-cf9a-4486-920a-1be6e6012abf None admin] PATH_INFO: `/v3/roles` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 07:59:01.044344 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74bd46d8-cf9a-4486-920a-1be6e6012abf None admin] RBAC: Adding query filter params (name=member) {{(pid=80347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 07:59:01.044723 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74bd46d8-cf9a-4486-920a-1be6e6012abf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 07:59:01.046173 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74bd46d8-cf9a-4486-920a-1be6e6012abf None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 07:59:01.063397 dv-cinder-851351-1-smb devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 205/382] 10.222.0.42 () {56 vars in 1101 bytes} [Thu Jul 28 07:59:00 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 07:59:01.070281 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74bd46d8-cf9a-4486-920a-1be6e6012abf None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 07:59:01.154853 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 07:59:01.166479 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60abc9a3-fc01-4dbc-8326-1246a410301c None admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 07:59:01.168074 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=100 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 07:59:01.225360 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2fddc1-a76e-4f4f-a831-09cadbd47c0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 07:59:01.226452 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2fddc1-a76e-4f4f-a831-09cadbd47c0e None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 07:59:01.226916 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2fddc1-a76e-4f4f-a831-09cadbd47c0e None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 07:59:01.227408 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2fddc1-a76e-4f4f-a831-09cadbd47c0e None admin] PATH_INFO: `/v3/groups/9bf400d464c14a2c9216639cecb87c66` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 07:59:01.232331 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74bd46d8-cf9a-4486-920a-1be6e6012abf None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 07:59:01.244573 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f2fddc1-a76e-4f4f-a831-09cadbd47c0e None admin] RBAC: Authorizing `identity:get_group(group_id=9bf400d464c14a2c9216639cecb87c66)` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 07:59:01.246406 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f2fddc1-a76e-4f4f-a831-09cadbd47c0e None admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 07:59:01.248384 dv-cinder-851351-1-smb devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 178/383] 10.222.0.42 () {56 vars in 1180 bytes} [Thu Jul 28 07:59:01 2022] GET /identity/v3/groups/9bf400d464c14a2c9216639cecb87c66 => generated 229 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 07:59:01.254663 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2fddc1-a76e-4f4f-a831-09cadbd47c0e None admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 07:59:01.309904 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a80d5008-ab05-4f97-a1b9-48b0c1673833 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 07:59:01.310892 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80d5008-ab05-4f97-a1b9-48b0c1673833 None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 07:59:01.311404 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80d5008-ab05-4f97-a1b9-48b0c1673833 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 07:59:01.311872 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80d5008-ab05-4f97-a1b9-48b0c1673833 None admin] PATH_INFO: `/v3/groups/62a03a5df2bb4784abc8a0bd5def0e79` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 07:59:01.313381 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a80d5008-ab05-4f97-a1b9-48b0c1673833 None admin] RBAC: Authorizing `identity:get_group(group_id=62a03a5df2bb4784abc8a0bd5def0e79)` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 07:59:01.316095 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a80d5008-ab05-4f97-a1b9-48b0c1673833 None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 07:59:01.318680 dv-cinder-851351-1-smb devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 206/384] 10.222.0.42 () {56 vars in 1180 bytes} [Thu Jul 28 07:59:01 2022] GET /identity/v3/groups/62a03a5df2bb4784abc8a0bd5def0e79 => generated 226 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 07:59:01.326885 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a80d5008-ab05-4f97-a1b9-48b0c1673833 None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 07:59:01.454652 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2fddc1-a76e-4f4f-a831-09cadbd47c0e None admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 07:59:01.475512 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 07:59:01.478597 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a80d5008-ab05-4f97-a1b9-48b0c1673833 None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 07:59:01.515466 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809e74a9-f8d0-4239-b51d-28d5d16ed0b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 07:59:01.516509 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809e74a9-f8d0-4239-b51d-28d5d16ed0b0 None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 07:59:01.517001 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809e74a9-f8d0-4239-b51d-28d5d16ed0b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 07:59:01.517477 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809e74a9-f8d0-4239-b51d-28d5d16ed0b0 None admin] PATH_INFO: `/v3/projects/cdfa7c2638114a968f5357dc098b441b` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 07:59:01.518852 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-809e74a9-f8d0-4239-b51d-28d5d16ed0b0 None admin] RBAC: Authorizing `identity:get_project(project_id=cdfa7c2638114a968f5357dc098b441b)` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 07:59:01.520487 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-809e74a9-f8d0-4239-b51d-28d5d16ed0b0 None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 07:59:01.522398 dv-cinder-851351-1-smb devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 207/385] 10.222.0.42 () {56 vars in 1186 bytes} [Thu Jul 28 07:59:01 2022] GET /identity/v3/projects/cdfa7c2638114a968f5357dc098b441b => generated 298 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 07:59:01.523356 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e28be13-b7bc-451b-90a2-2f34d27431c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 07:59:01.524228 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e28be13-b7bc-451b-90a2-2f34d27431c0 None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 07:59:01.524741 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e28be13-b7bc-451b-90a2-2f34d27431c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 07:59:01.525210 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e28be13-b7bc-451b-90a2-2f34d27431c0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 07:59:01.526246 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e28be13-b7bc-451b-90a2-2f34d27431c0 None admin] RBAC: Adding query filter params (group.id=9bf400d464c14a2c9216639cecb87c66, role.id=362bd71ac01249fb8fa635381993eec1, scope.project.id=d51c90075a0545959e2ede68845ae91b) {{(pid=80348) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 07:59:01.526756 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e28be13-b7bc-451b-90a2-2f34d27431c0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 07:59:01.528427 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809e74a9-f8d0-4239-b51d-28d5d16ed0b0 None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 07:59:01.530039 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e28be13-b7bc-451b-90a2-2f34d27431c0 None admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 07:59:01.553540 dv-cinder-851351-1-smb devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 179/386] 10.222.0.42 () {56 vars in 1376 bytes} [Thu Jul 28 07:59:01 2022] GET /identity/v3/role_assignments?group.id=9bf400d464c14a2c9216639cecb87c66&scope.project.id=d51c90075a0545959e2ede68845ae91b&role.id=362bd71ac01249fb8fa635381993eec1 => generated 260 bytes in 299 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 07:59:01.665262 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809e74a9-f8d0-4239-b51d-28d5d16ed0b0 None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 07:59:01.702981 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0dfa1e5-77bd-498e-aa8a-c329f7e6fcba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 07:59:01.704086 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0dfa1e5-77bd-498e-aa8a-c329f7e6fcba None admin] REQUEST_METHOD: `PUT` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 07:59:01.704606 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0dfa1e5-77bd-498e-aa8a-c329f7e6fcba None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 07:59:01.705117 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0dfa1e5-77bd-498e-aa8a-c329f7e6fcba None admin] PATH_INFO: `/v3/projects/cdfa7c2638114a968f5357dc098b441b/groups/62a03a5df2bb4784abc8a0bd5def0e79/roles/0317c30d81ff44eea2fd4a7215c60eac` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 07:59:01.707809 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0dfa1e5-77bd-498e-aa8a-c329f7e6fcba None admin] RBAC: Authorizing `identity:create_grant(project_id=cdfa7c2638114a968f5357dc098b441b, group_id=62a03a5df2bb4784abc8a0bd5def0e79, role_id=0317c30d81ff44eea2fd4a7215c60eac)` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 07:59:01.709531 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0dfa1e5-77bd-498e-aa8a-c329f7e6fcba None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 07:59:01.739969 dv-cinder-851351-1-smb devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 208/387] 10.222.0.42 () {58 vars in 1442 bytes} [Thu Jul 28 07:59:01 2022] PUT /identity/v3/projects/cdfa7c2638114a968f5357dc098b441b/groups/62a03a5df2bb4784abc8a0bd5def0e79/roles/0317c30d81ff44eea2fd4a7215c60eac => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 28 07:59:02.026406 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef27da4f-71d7-4840-a974-c3788b665d0d None None] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 07:59:02.027062 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef27da4f-71d7-4840-a974-c3788b665d0d None None] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 07:59:02.027554 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef27da4f-71d7-4840-a974-c3788b665d0d None None] PATH_INFO: `/` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 07:59:02.029552 dv-cinder-851351-1-smb devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 180/388] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 07:59:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 07:59:02.034696 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2825ce73-3932-4031-8c02-a1fd0ce90238 None None] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 07:59:02.035219 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2825ce73-3932-4031-8c02-a1fd0ce90238 None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 07:59:02.036056 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2825ce73-3932-4031-8c02-a1fd0ce90238 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 07:59:02.058513 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.auth.core [None req-2825ce73-3932-4031-8c02-a1fd0ce90238 None None] MFA Rules not processed for user `f0666d3a50644a7097367331c1ee1a68`. Rule list: `[]` (Enabled: `True`). {{(pid=80347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 07:59:02.060201 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-2825ce73-3932-4031-8c02-a1fd0ce90238 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 07:59:02.087703 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 07:59:02.137710 dv-cinder-851351-1-smb devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 209/389] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 07:59:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 07:59:02.171503 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef27da4f-71d7-4840-a974-c3788b665d0d None None] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 07:59:02.209809 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=100 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 07:59:02.318448 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef27da4f-71d7-4840-a974-c3788b665d0d None None] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 07:59:02.372284 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73d4e08-b9a7-433e-ac61-ea04f1423bca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 07:59:02.372964 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73d4e08-b9a7-433e-ac61-ea04f1423bca None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 07:59:02.373239 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73d4e08-b9a7-433e-ac61-ea04f1423bca None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 07:59:02.373506 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73d4e08-b9a7-433e-ac61-ea04f1423bca None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 07:59:02.389299 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f73d4e08-b9a7-433e-ac61-ea04f1423bca None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 07:59:02.394860 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application [None req-f73d4e08-b9a7-433e-ac61-ea04f1423bca None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 28 07:59:02.394860 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 07:59:02.394860 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 07:59:02.394860 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 07:59:02.394860 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 07:59:02.394860 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 07:59:02.394860 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 07:59:02.394860 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 07:59:02.394860 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 07:59:02.394860 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 07:59:02.394860 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 07:59:02.394860 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 07:59:02.394860 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 07:59:02.394860 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 07:59:02.394860 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 07:59:02.394860 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 07:59:02.395715 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 07:59:02.395715 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 07:59:02.395715 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 07:59:02.395715 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 07:59:02.395715 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 07:59:02.395715 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 07:59:02.395715 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 07:59:02.395715 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 07:59:02.395715 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 07:59:02.395715 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 07:59:02.395715 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 07:59:02.395715 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application with Lock( Jul 28 07:59:02.395715 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 07:59:02.395715 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self._enter() Jul 28 07:59:02.395715 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 07:59:02.395715 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 07:59:02.396510 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 07:59:02.396510 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.creator() Jul 28 07:59:02.396510 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 07:59:02.396510 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application created_value = creator( Jul 28 07:59:02.396510 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 07:59:02.396510 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 07:59:02.396510 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 07:59:02.396510 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 07:59:02.396510 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 07:59:02.396510 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 07:59:02.396510 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 28 07:59:02.396510 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application Jul 28 07:59:02.396510 dv-cinder-851351-1-smb devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 181/390] 10.222.0.42 () {56 vars in 1114 bytes} [Thu Jul 28 07:59:02 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 07:59:02.402125 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2825ce73-3932-4031-8c02-a1fd0ce90238 None None] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 07:59:02.469634 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a51f50-faeb-4a59-a86a-c4cb3992d1cb None None] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 07:59:02.470297 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a51f50-faeb-4a59-a86a-c4cb3992d1cb None None] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 07:59:02.470861 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a51f50-faeb-4a59-a86a-c4cb3992d1cb None None] PATH_INFO: `/` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 07:59:02.473511 dv-cinder-851351-1-smb devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 182/391] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 07:59:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 28 07:59:02.477939 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6339033-1de5-4551-9930-be05978b0334 None None] REQUEST_METHOD: `POST` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 07:59:02.478216 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6339033-1de5-4551-9930-be05978b0334 None None] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 07:59:02.478490 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6339033-1de5-4551-9930-be05978b0334 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 07:59:02.512922 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.auth.core [None req-b6339033-1de5-4551-9930-be05978b0334 None None] MFA Rules not processed for user `f0666d3a50644a7097367331c1ee1a68`. Rule list: `[]` (Enabled: `True`). {{(pid=80348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 07:59:02.514143 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.fernet_utils [None req-b6339033-1de5-4551-9930-be05978b0334 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 07:59:02.520054 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2825ce73-3932-4031-8c02-a1fd0ce90238 None None] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 07:59:02.562603 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751fe556-6ac1-409e-ae1d-0de4bc131950 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 07:59:02.563232 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751fe556-6ac1-409e-ae1d-0de4bc131950 None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 07:59:02.563503 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751fe556-6ac1-409e-ae1d-0de4bc131950 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 07:59:02.563768 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751fe556-6ac1-409e-ae1d-0de4bc131950 None admin] PATH_INFO: `/v3/roles` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 07:59:02.564491 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-751fe556-6ac1-409e-ae1d-0de4bc131950 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 07:59:02.564814 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-751fe556-6ac1-409e-ae1d-0de4bc131950 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 07:59:02.566965 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-751fe556-6ac1-409e-ae1d-0de4bc131950 None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 07:59:02.583902 dv-cinder-851351-1-smb devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 210/392] 10.222.0.42 () {56 vars in 1111 bytes} [Thu Jul 28 07:59:02 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 07:59:02.592868 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751fe556-6ac1-409e-ae1d-0de4bc131950 None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 07:59:02.637109 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 07:59:02.663539 dv-cinder-851351-1-smb devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 183/393] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 07:59:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 28 07:59:02.698226 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6339033-1de5-4551-9930-be05978b0334 None None] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 07:59:02.727762 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751fe556-6ac1-409e-ae1d-0de4bc131950 None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 07:59:02.759821 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=100 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 07:59:02.765538 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acaa75bd-d6c5-4393-98f8-1cead56950c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 07:59:02.766359 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acaa75bd-d6c5-4393-98f8-1cead56950c6 None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 07:59:02.766639 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acaa75bd-d6c5-4393-98f8-1cead56950c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 07:59:02.766907 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acaa75bd-d6c5-4393-98f8-1cead56950c6 None admin] PATH_INFO: `/v3/groups/62a03a5df2bb4784abc8a0bd5def0e79` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 07:59:02.768087 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acaa75bd-d6c5-4393-98f8-1cead56950c6 None admin] RBAC: Authorizing `identity:get_group(group_id=62a03a5df2bb4784abc8a0bd5def0e79)` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 07:59:02.769765 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acaa75bd-d6c5-4393-98f8-1cead56950c6 None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 07:59:02.771742 dv-cinder-851351-1-smb devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 211/394] 10.222.0.42 () {56 vars in 1180 bytes} [Thu Jul 28 07:59:02 2022] GET /identity/v3/groups/62a03a5df2bb4784abc8a0bd5def0e79 => generated 226 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 07:59:02.778041 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acaa75bd-d6c5-4393-98f8-1cead56950c6 None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 07:59:02.899118 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6339033-1de5-4551-9930-be05978b0334 None None] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 07:59:02.942076 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 07:59:02.949445 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737a7abc-845d-4ec7-b415-3521c57f5291 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 07:59:02.950322 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737a7abc-845d-4ec7-b415-3521c57f5291 None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 07:59:02.950602 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737a7abc-845d-4ec7-b415-3521c57f5291 None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 07:59:02.950874 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737a7abc-845d-4ec7-b415-3521c57f5291 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 07:59:02.954467 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acaa75bd-d6c5-4393-98f8-1cead56950c6 None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 07:59:02.971682 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-737a7abc-845d-4ec7-b415-3521c57f5291 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 07:59:02.979188 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application [None req-737a7abc-845d-4ec7-b415-3521c57f5291 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 28 07:59:02.979188 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 07:59:02.979188 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 07:59:02.979188 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 07:59:02.979188 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 07:59:02.979188 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 07:59:02.979188 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 07:59:02.979188 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 07:59:02.979188 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 07:59:02.979188 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 07:59:02.979188 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 07:59:02.979188 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 07:59:02.979188 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 07:59:02.979188 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 07:59:02.979188 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 07:59:02.979188 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 07:59:02.980226 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 07:59:02.980226 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 07:59:02.980226 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 07:59:02.980226 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 07:59:02.980226 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 07:59:02.980226 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 07:59:02.980226 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 07:59:02.980226 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 07:59:02.980226 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 07:59:02.980226 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 07:59:02.980226 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 07:59:02.980226 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application with Lock( Jul 28 07:59:02.980226 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 07:59:02.980226 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self._enter() Jul 28 07:59:02.980226 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 07:59:02.980226 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 07:59:02.981068 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 07:59:02.981068 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.creator() Jul 28 07:59:02.981068 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 07:59:02.981068 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application created_value = creator( Jul 28 07:59:02.981068 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 07:59:02.981068 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 07:59:02.981068 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 07:59:02.981068 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 07:59:02.981068 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 07:59:02.981068 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 07:59:02.981068 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 28 07:59:02.981068 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application Jul 28 07:59:02.981068 dv-cinder-851351-1-smb devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 184/395] 10.222.0.42 () {56 vars in 1099 bytes} [Thu Jul 28 07:59:02 2022] GET /identity/v3/roles/member => generated 84 bytes in 283 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 07:59:02.987329 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737a7abc-845d-4ec7-b415-3521c57f5291 None admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 07:59:03.029012 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002bbd67-950e-4abe-b137-198fcd108feb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 07:59:03.029678 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002bbd67-950e-4abe-b137-198fcd108feb None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 07:59:03.029951 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002bbd67-950e-4abe-b137-198fcd108feb None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 07:59:03.030220 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002bbd67-950e-4abe-b137-198fcd108feb None admin] PATH_INFO: `/v3/projects/cdfa7c2638114a968f5357dc098b441b` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 07:59:03.031393 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-002bbd67-950e-4abe-b137-198fcd108feb None admin] RBAC: Authorizing `identity:get_project(project_id=cdfa7c2638114a968f5357dc098b441b)` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 07:59:03.032865 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-002bbd67-950e-4abe-b137-198fcd108feb None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 07:59:03.034587 dv-cinder-851351-1-smb devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 212/396] 10.222.0.42 () {56 vars in 1186 bytes} [Thu Jul 28 07:59:02 2022] GET /identity/v3/projects/cdfa7c2638114a968f5357dc098b441b => generated 298 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 07:59:03.040484 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002bbd67-950e-4abe-b137-198fcd108feb None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 07:59:03.142222 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=100 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 07:59:03.172087 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737a7abc-845d-4ec7-b415-3521c57f5291 None admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 07:59:03.231247 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb598fe-663e-4324-8409-e16d74b888d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 07:59:03.231900 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb598fe-663e-4324-8409-e16d74b888d4 None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 07:59:03.232175 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb598fe-663e-4324-8409-e16d74b888d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 07:59:03.232449 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb598fe-663e-4324-8409-e16d74b888d4 None admin] PATH_INFO: `/v3/roles` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 07:59:03.233230 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eb598fe-663e-4324-8409-e16d74b888d4 None admin] RBAC: Adding query filter params (name=member) {{(pid=80348) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 07:59:03.233532 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eb598fe-663e-4324-8409-e16d74b888d4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 07:59:03.234961 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eb598fe-663e-4324-8409-e16d74b888d4 None admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 07:59:03.246661 dv-cinder-851351-1-smb devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 185/397] 10.222.0.42 () {56 vars in 1101 bytes} [Thu Jul 28 07:59:02 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 07:59:03.248541 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002bbd67-950e-4abe-b137-198fcd108feb None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 07:59:03.263304 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb598fe-663e-4324-8409-e16d74b888d4 None admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 07:59:03.313070 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41aebe9-c404-487c-8361-7c8ba8823af3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 07:59:03.313754 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41aebe9-c404-487c-8361-7c8ba8823af3 None admin] REQUEST_METHOD: `PUT` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 07:59:03.314027 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41aebe9-c404-487c-8361-7c8ba8823af3 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 07:59:03.314295 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41aebe9-c404-487c-8361-7c8ba8823af3 None admin] PATH_INFO: `/v3/projects/cdfa7c2638114a968f5357dc098b441b/groups/62a03a5df2bb4784abc8a0bd5def0e79/roles/f28d669937b942878bcf6a9103012af9` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 07:59:03.317940 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c41aebe9-c404-487c-8361-7c8ba8823af3 None admin] RBAC: Authorizing `identity:create_grant(project_id=cdfa7c2638114a968f5357dc098b441b, group_id=62a03a5df2bb4784abc8a0bd5def0e79, role_id=f28d669937b942878bcf6a9103012af9)` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 07:59:03.319405 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c41aebe9-c404-487c-8361-7c8ba8823af3 None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 07:59:03.348590 dv-cinder-851351-1-smb devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 213/398] 10.222.0.42 () {58 vars in 1442 bytes} [Thu Jul 28 07:59:03 2022] PUT /identity/v3/projects/cdfa7c2638114a968f5357dc098b441b/groups/62a03a5df2bb4784abc8a0bd5def0e79/roles/f28d669937b942878bcf6a9103012af9 => generated 0 bytes in 308 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 07:59:03.420340 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb598fe-663e-4324-8409-e16d74b888d4 None admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 07:59:03.464345 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3458a795-168a-4dee-a42b-9a4bb79fd6de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 07:59:03.465096 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3458a795-168a-4dee-a42b-9a4bb79fd6de None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 07:59:03.465357 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3458a795-168a-4dee-a42b-9a4bb79fd6de None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 07:59:03.465828 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3458a795-168a-4dee-a42b-9a4bb79fd6de None admin] PATH_INFO: `/v3/groups/62a03a5df2bb4784abc8a0bd5def0e79` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 07:59:03.467112 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3458a795-168a-4dee-a42b-9a4bb79fd6de None admin] RBAC: Authorizing `identity:get_group(group_id=62a03a5df2bb4784abc8a0bd5def0e79)` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 07:59:03.468581 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce75f1fd-c7da-4cbe-ac34-696510273936 None None] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 07:59:03.469058 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3458a795-168a-4dee-a42b-9a4bb79fd6de None admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 07:59:03.469141 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce75f1fd-c7da-4cbe-ac34-696510273936 None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 07:59:03.469211 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce75f1fd-c7da-4cbe-ac34-696510273936 None None] PATH_INFO: `/` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 07:59:03.470625 dv-cinder-851351-1-smb devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 186/399] 10.222.0.42 () {56 vars in 1180 bytes} [Thu Jul 28 07:59:03 2022] GET /identity/v3/groups/62a03a5df2bb4784abc8a0bd5def0e79 => generated 226 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 07:59:03.470793 dv-cinder-851351-1-smb devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 214/400] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 07:59:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 07:59:03.476253 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5b3f4d-37da-454b-8c07-ae665e783d9d None None] REQUEST_METHOD: `POST` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 07:59:03.476416 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce75f1fd-c7da-4cbe-ac34-696510273936 None None] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 07:59:03.476598 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5b3f4d-37da-454b-8c07-ae665e783d9d None None] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 07:59:03.476899 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5b3f4d-37da-454b-8c07-ae665e783d9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 07:59:03.522825 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 07:59:03.523423 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.auth.core [None req-6f5b3f4d-37da-454b-8c07-ae665e783d9d None None] MFA Rules not processed for user `f0666d3a50644a7097367331c1ee1a68`. Rule list: `[]` (Enabled: `True`). {{(pid=80348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 07:59:03.525731 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.fernet_utils [None req-6f5b3f4d-37da-454b-8c07-ae665e783d9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 07:59:03.535828 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=100 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 07:59:03.635157 dv-cinder-851351-1-smb devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 187/401] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 07:59:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 28 07:59:03.656899 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce75f1fd-c7da-4cbe-ac34-696510273936 None None] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 07:59:03.658862 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5b3f4d-37da-454b-8c07-ae665e783d9d None None] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 07:59:03.703754 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd2003c-7362-4240-bed5-d49ee4fa111a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 07:59:03.704326 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd2003c-7362-4240-bed5-d49ee4fa111a None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 07:59:03.704603 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd2003c-7362-4240-bed5-d49ee4fa111a None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 07:59:03.704923 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd2003c-7362-4240-bed5-d49ee4fa111a None admin] PATH_INFO: `/v3/projects/0f988f0c81614261ae36a6896770b2d0` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 07:59:03.707327 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecd2003c-7362-4240-bed5-d49ee4fa111a None admin] RBAC: Authorizing `identity:get_project(project_id=0f988f0c81614261ae36a6896770b2d0)` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 07:59:03.709121 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecd2003c-7362-4240-bed5-d49ee4fa111a None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 07:59:03.711272 dv-cinder-851351-1-smb devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 215/402] 10.222.0.42 () {56 vars in 1186 bytes} [Thu Jul 28 07:59:03 2022] GET /identity/v3/projects/0f988f0c81614261ae36a6896770b2d0 => generated 302 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 07:59:03.717543 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd2003c-7362-4240-bed5-d49ee4fa111a None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 07:59:03.787302 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5b3f4d-37da-454b-8c07-ae665e783d9d None None] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 07:59:03.814667 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 07:59:03.832740 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64339dc7-0573-443f-a863-8ba3f66f03f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 07:59:03.833658 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64339dc7-0573-443f-a863-8ba3f66f03f5 None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 07:59:03.833938 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64339dc7-0573-443f-a863-8ba3f66f03f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 07:59:03.834207 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64339dc7-0573-443f-a863-8ba3f66f03f5 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 07:59:03.835860 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd2003c-7362-4240-bed5-d49ee4fa111a None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 07:59:03.844249 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=100 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 07:59:03.848931 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64339dc7-0573-443f-a863-8ba3f66f03f5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 07:59:03.856547 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application [None req-64339dc7-0573-443f-a863-8ba3f66f03f5 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 28 07:59:03.856547 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 07:59:03.856547 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 07:59:03.856547 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 07:59:03.856547 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 07:59:03.856547 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 07:59:03.856547 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 07:59:03.856547 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 07:59:03.856547 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 07:59:03.856547 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 07:59:03.856547 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 07:59:03.856547 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 07:59:03.856547 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 07:59:03.856547 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 07:59:03.856547 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 07:59:03.856547 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 07:59:03.857679 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 07:59:03.857679 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 07:59:03.857679 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 07:59:03.857679 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 07:59:03.857679 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 07:59:03.857679 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 07:59:03.857679 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 07:59:03.857679 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 07:59:03.857679 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 07:59:03.857679 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 07:59:03.857679 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 07:59:03.857679 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application with Lock( Jul 28 07:59:03.857679 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 07:59:03.857679 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self._enter() Jul 28 07:59:03.857679 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 07:59:03.857679 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 07:59:03.858627 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 07:59:03.858627 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.creator() Jul 28 07:59:03.858627 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 07:59:03.858627 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application created_value = creator( Jul 28 07:59:03.858627 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 07:59:03.858627 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 07:59:03.858627 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 07:59:03.858627 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 07:59:03.858627 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 07:59:03.858627 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 07:59:03.858627 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 28 07:59:03.858627 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application Jul 28 07:59:03.861432 dv-cinder-851351-1-smb devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 188/403] 10.222.0.42 () {56 vars in 1114 bytes} [Thu Jul 28 07:59:03 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 07:59:03.869179 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64339dc7-0573-443f-a863-8ba3f66f03f5 None admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 07:59:03.881684 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7659ea17-a39b-4fff-b06e-1cab72ce1e20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 07:59:03.883048 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7659ea17-a39b-4fff-b06e-1cab72ce1e20 None admin] REQUEST_METHOD: `PUT` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 07:59:03.883483 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7659ea17-a39b-4fff-b06e-1cab72ce1e20 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 07:59:03.883905 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7659ea17-a39b-4fff-b06e-1cab72ce1e20 None admin] PATH_INFO: `/v3/projects/0f988f0c81614261ae36a6896770b2d0/groups/62a03a5df2bb4784abc8a0bd5def0e79/roles/0317c30d81ff44eea2fd4a7215c60eac` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 07:59:03.886754 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7659ea17-a39b-4fff-b06e-1cab72ce1e20 None admin] RBAC: Authorizing `identity:create_grant(project_id=0f988f0c81614261ae36a6896770b2d0, group_id=62a03a5df2bb4784abc8a0bd5def0e79, role_id=0317c30d81ff44eea2fd4a7215c60eac)` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 07:59:03.889125 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7659ea17-a39b-4fff-b06e-1cab72ce1e20 None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 07:59:03.909349 dv-cinder-851351-1-smb devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 216/404] 10.222.0.42 () {58 vars in 1442 bytes} [Thu Jul 28 07:59:03 2022] PUT /identity/v3/projects/0f988f0c81614261ae36a6896770b2d0/groups/62a03a5df2bb4784abc8a0bd5def0e79/roles/0317c30d81ff44eea2fd4a7215c60eac => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 28 07:59:03.995439 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64339dc7-0573-443f-a863-8ba3f66f03f5 None admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 07:59:04.034771 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14847a5d-9677-4d5b-9a79-23615e936cbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 07:59:04.035416 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14847a5d-9677-4d5b-9a79-23615e936cbd None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 07:59:04.035699 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14847a5d-9677-4d5b-9a79-23615e936cbd None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 07:59:04.035972 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14847a5d-9677-4d5b-9a79-23615e936cbd None admin] PATH_INFO: `/v3/roles` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 07:59:04.036833 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14847a5d-9677-4d5b-9a79-23615e936cbd None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80348) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 07:59:04.037143 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14847a5d-9677-4d5b-9a79-23615e936cbd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 07:59:04.038567 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14847a5d-9677-4d5b-9a79-23615e936cbd None admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 07:59:04.049699 dv-cinder-851351-1-smb devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 189/405] 10.222.0.42 () {56 vars in 1111 bytes} [Thu Jul 28 07:59:03 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 07:59:04.055592 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7659ea17-a39b-4fff-b06e-1cab72ce1e20 None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 07:59:04.188966 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7659ea17-a39b-4fff-b06e-1cab72ce1e20 None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 07:59:04.227014 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31dbb6ad-ca19-42ae-838e-398e4ca7d76b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 07:59:04.227716 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31dbb6ad-ca19-42ae-838e-398e4ca7d76b None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 07:59:04.227992 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31dbb6ad-ca19-42ae-838e-398e4ca7d76b None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 07:59:04.228261 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31dbb6ad-ca19-42ae-838e-398e4ca7d76b None admin] PATH_INFO: `/v3/groups/62a03a5df2bb4784abc8a0bd5def0e79` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 07:59:04.229484 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31dbb6ad-ca19-42ae-838e-398e4ca7d76b None admin] RBAC: Authorizing `identity:get_group(group_id=62a03a5df2bb4784abc8a0bd5def0e79)` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 07:59:04.230922 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31dbb6ad-ca19-42ae-838e-398e4ca7d76b None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 07:59:04.233011 dv-cinder-851351-1-smb devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 217/406] 10.222.0.42 () {56 vars in 1180 bytes} [Thu Jul 28 07:59:04 2022] GET /identity/v3/groups/62a03a5df2bb4784abc8a0bd5def0e79 => generated 226 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 07:59:04.238706 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14847a5d-9677-4d5b-9a79-23615e936cbd None admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 07:59:04.304548 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=100 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 07:59:04.344587 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14847a5d-9677-4d5b-9a79-23615e936cbd None admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 07:59:04.380691 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f369c00-51ed-4422-8469-92b76b346006 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 07:59:04.381350 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f369c00-51ed-4422-8469-92b76b346006 None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 07:59:04.381667 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f369c00-51ed-4422-8469-92b76b346006 None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 07:59:04.381939 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f369c00-51ed-4422-8469-92b76b346006 None admin] PATH_INFO: `/v3/projects/0f988f0c81614261ae36a6896770b2d0` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 07:59:04.383100 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f369c00-51ed-4422-8469-92b76b346006 None admin] RBAC: Authorizing `identity:get_project(project_id=0f988f0c81614261ae36a6896770b2d0)` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 07:59:04.384531 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f369c00-51ed-4422-8469-92b76b346006 None admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 07:59:04.386517 dv-cinder-851351-1-smb devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 190/407] 10.222.0.42 () {56 vars in 1186 bytes} [Thu Jul 28 07:59:04 2022] GET /identity/v3/projects/0f988f0c81614261ae36a6896770b2d0 => generated 302 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 07:59:04.392306 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31dbb6ad-ca19-42ae-838e-398e4ca7d76b None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 07:59:04.413442 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d783b48-0686-40c8-b596-3dc9a6dbb323 None None] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 07:59:04.414008 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d783b48-0686-40c8-b596-3dc9a6dbb323 None None] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 07:59:04.414536 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d783b48-0686-40c8-b596-3dc9a6dbb323 None None] PATH_INFO: `/` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 07:59:04.416122 dv-cinder-851351-1-smb devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 191/408] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 07:59:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 07:59:04.419268 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 07:59:04.423372 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32cbd3d-bc39-4db1-aedd-fefac35aa87d None None] REQUEST_METHOD: `POST` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 07:59:04.423869 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32cbd3d-bc39-4db1-aedd-fefac35aa87d None None] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 07:59:04.424314 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32cbd3d-bc39-4db1-aedd-fefac35aa87d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 07:59:04.443545 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.auth.core [None req-d32cbd3d-bc39-4db1-aedd-fefac35aa87d None None] MFA Rules not processed for user `f0666d3a50644a7097367331c1ee1a68`. Rule list: `[]` (Enabled: `True`). {{(pid=80348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 07:59:04.445168 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.fernet_utils [None req-d32cbd3d-bc39-4db1-aedd-fefac35aa87d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 07:59:04.514792 dv-cinder-851351-1-smb devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 192/409] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 07:59:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 07:59:04.561867 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32cbd3d-bc39-4db1-aedd-fefac35aa87d None None] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 07:59:04.601812 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31dbb6ad-ca19-42ae-838e-398e4ca7d76b None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 07:59:04.632454 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=100 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 07:59:04.656691 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-177b28fb-b07c-4fdc-ad8f-2d20a35a5ffe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 07:59:04.657633 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177b28fb-b07c-4fdc-ad8f-2d20a35a5ffe None admin] REQUEST_METHOD: `PUT` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 07:59:04.658104 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177b28fb-b07c-4fdc-ad8f-2d20a35a5ffe None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 07:59:04.658519 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177b28fb-b07c-4fdc-ad8f-2d20a35a5ffe None admin] PATH_INFO: `/v3/projects/0f988f0c81614261ae36a6896770b2d0/groups/62a03a5df2bb4784abc8a0bd5def0e79/roles/f28d669937b942878bcf6a9103012af9` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 07:59:04.660960 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-177b28fb-b07c-4fdc-ad8f-2d20a35a5ffe None admin] RBAC: Authorizing `identity:create_grant(project_id=0f988f0c81614261ae36a6896770b2d0, group_id=62a03a5df2bb4784abc8a0bd5def0e79, role_id=f28d669937b942878bcf6a9103012af9)` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 07:59:04.662545 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-177b28fb-b07c-4fdc-ad8f-2d20a35a5ffe None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 07:59:04.677437 dv-cinder-851351-1-smb devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 218/410] 10.222.0.42 () {58 vars in 1442 bytes} [Thu Jul 28 07:59:04 2022] PUT /identity/v3/projects/0f988f0c81614261ae36a6896770b2d0/groups/62a03a5df2bb4784abc8a0bd5def0e79/roles/f28d669937b942878bcf6a9103012af9 => generated 0 bytes in 285 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 28 07:59:04.679153 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8b3550-5674-45eb-a6c4-730d7806d23d None None] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 07:59:04.679715 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8b3550-5674-45eb-a6c4-730d7806d23d None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 07:59:04.680186 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8b3550-5674-45eb-a6c4-730d7806d23d None None] PATH_INFO: `/` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 07:59:04.681905 dv-cinder-851351-1-smb devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 219/411] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 07:59:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 07:59:04.683255 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32cbd3d-bc39-4db1-aedd-fefac35aa87d None None] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 07:59:04.694341 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69b9efc-909b-40df-ae32-2cd4a1b516bb None None] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 07:59:04.695026 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69b9efc-909b-40df-ae32-2cd4a1b516bb None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 07:59:04.695498 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69b9efc-909b-40df-ae32-2cd4a1b516bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 07:59:04.735613 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.auth.core [None req-b69b9efc-909b-40df-ae32-2cd4a1b516bb None None] MFA Rules not processed for user `f0666d3a50644a7097367331c1ee1a68`. Rule list: `[]` (Enabled: `True`). {{(pid=80347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 07:59:04.737567 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-b69b9efc-909b-40df-ae32-2cd4a1b516bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 07:59:04.745454 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7a39d8-480a-4545-a034-3c96625df6e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 07:59:04.746148 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7a39d8-480a-4545-a034-3c96625df6e3 None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 07:59:04.746429 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7a39d8-480a-4545-a034-3c96625df6e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 07:59:04.746776 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7a39d8-480a-4545-a034-3c96625df6e3 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 07:59:04.777706 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d7a39d8-480a-4545-a034-3c96625df6e3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 07:59:04.782833 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application [None req-5d7a39d8-480a-4545-a034-3c96625df6e3 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 07:59:04.782833 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 07:59:04.782833 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 07:59:04.782833 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 07:59:04.782833 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 07:59:04.782833 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 07:59:04.782833 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 07:59:04.782833 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 07:59:04.782833 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 07:59:04.782833 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 07:59:04.782833 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 07:59:04.782833 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 07:59:04.782833 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 07:59:04.782833 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 07:59:04.782833 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 07:59:04.782833 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 07:59:04.784014 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 07:59:04.784014 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 07:59:04.784014 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 07:59:04.784014 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 07:59:04.784014 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 07:59:04.784014 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 07:59:04.784014 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 07:59:04.784014 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 07:59:04.784014 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 07:59:04.784014 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 07:59:04.784014 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 07:59:04.784014 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application with Lock( Jul 28 07:59:04.784014 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 07:59:04.784014 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self._enter() Jul 28 07:59:04.784014 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 07:59:04.784014 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 07:59:04.784825 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 07:59:04.784825 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.creator() Jul 28 07:59:04.784825 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 07:59:04.784825 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application created_value = creator( Jul 28 07:59:04.784825 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 07:59:04.784825 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 07:59:04.784825 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 07:59:04.784825 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 07:59:04.784825 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 07:59:04.784825 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 07:59:04.784825 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 07:59:04.784825 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application Jul 28 07:59:04.793274 dv-cinder-851351-1-smb devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 193/412] 10.222.0.42 () {56 vars in 1096 bytes} [Thu Jul 28 07:59:04 2022] GET /identity/v3/roles/admin => generated 83 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 07:59:04.798840 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7a39d8-480a-4545-a034-3c96625df6e3 None admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 07:59:04.839671 dv-cinder-851351-1-smb devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 220/413] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 07:59:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 07:59:04.868913 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b69b9efc-909b-40df-ae32-2cd4a1b516bb None None] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 07:59:04.873451 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 07:59:04.943830 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7a39d8-480a-4545-a034-3c96625df6e3 None admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 07:59:04.975064 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=100 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 07:59:04.998587 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a7006b-88f3-4960-a739-0f2769e69190 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 07:59:04.999226 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a7006b-88f3-4960-a739-0f2769e69190 None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 07:59:04.999504 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a7006b-88f3-4960-a739-0f2769e69190 None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 07:59:04.999772 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a7006b-88f3-4960-a739-0f2769e69190 None admin] PATH_INFO: `/v3/roles` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 07:59:05.000502 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56a7006b-88f3-4960-a739-0f2769e69190 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80348) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 07:59:05.000830 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56a7006b-88f3-4960-a739-0f2769e69190 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 07:59:05.002223 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56a7006b-88f3-4960-a739-0f2769e69190 None admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 07:59:05.022363 dv-cinder-851351-1-smb devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 194/414] 10.222.0.42 () {56 vars in 1099 bytes} [Thu Jul 28 07:59:04 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 07:59:05.028557 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a7006b-88f3-4960-a739-0f2769e69190 None admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 07:59:05.040694 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b69b9efc-909b-40df-ae32-2cd4a1b516bb None None] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 07:59:05.108710 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa81a87-8f93-4fa8-8647-7279c5f0c0e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 07:59:05.109269 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa81a87-8f93-4fa8-8647-7279c5f0c0e2 None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 07:59:05.109545 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa81a87-8f93-4fa8-8647-7279c5f0c0e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 07:59:05.109815 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa81a87-8f93-4fa8-8647-7279c5f0c0e2 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 07:59:05.132459 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa81a87-8f93-4fa8-8647-7279c5f0c0e2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 07:59:05.137754 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application [None req-7aa81a87-8f93-4fa8-8647-7279c5f0c0e2 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 28 07:59:05.137754 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 07:59:05.137754 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 07:59:05.137754 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 07:59:05.137754 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 07:59:05.137754 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 07:59:05.137754 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 07:59:05.137754 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 07:59:05.137754 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 07:59:05.137754 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 07:59:05.137754 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 07:59:05.137754 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 07:59:05.137754 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 07:59:05.137754 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 07:59:05.137754 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 07:59:05.137754 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 07:59:05.138723 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 07:59:05.138723 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 07:59:05.138723 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 07:59:05.138723 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 07:59:05.138723 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 07:59:05.138723 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 07:59:05.138723 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 07:59:05.138723 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 07:59:05.138723 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 07:59:05.138723 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 07:59:05.138723 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 07:59:05.138723 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application with Lock( Jul 28 07:59:05.138723 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 07:59:05.138723 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._enter() Jul 28 07:59:05.138723 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 07:59:05.138723 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 07:59:05.139506 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 07:59:05.139506 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.creator() Jul 28 07:59:05.139506 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 07:59:05.139506 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application created_value = creator( Jul 28 07:59:05.139506 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 07:59:05.139506 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 07:59:05.139506 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 07:59:05.139506 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 07:59:05.139506 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 07:59:05.139506 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 07:59:05.139506 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 28 07:59:05.139506 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application Jul 28 07:59:05.139506 dv-cinder-851351-1-smb devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 221/415] 10.222.0.42 () {56 vars in 1099 bytes} [Thu Jul 28 07:59:04 2022] GET /identity/v3/roles/member => generated 84 bytes in 271 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 07:59:05.145045 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa81a87-8f93-4fa8-8647-7279c5f0c0e2 None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 07:59:05.236408 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a7006b-88f3-4960-a739-0f2769e69190 None admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 07:59:05.267450 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 07:59:05.304453 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64942094-e26a-4726-9937-8b959cd0d548 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 07:59:05.307837 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64942094-e26a-4726-9937-8b959cd0d548 None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 07:59:05.308114 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64942094-e26a-4726-9937-8b959cd0d548 None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 07:59:05.308379 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64942094-e26a-4726-9937-8b959cd0d548 None admin] PATH_INFO: `/v3/groups/9bf400d464c14a2c9216639cecb87c66` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 07:59:05.310635 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64942094-e26a-4726-9937-8b959cd0d548 None admin] RBAC: Authorizing `identity:get_group(group_id=9bf400d464c14a2c9216639cecb87c66)` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 07:59:05.312083 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64942094-e26a-4726-9937-8b959cd0d548 None admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 07:59:05.315148 dv-cinder-851351-1-smb devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 195/416] 10.222.0.42 () {56 vars in 1180 bytes} [Thu Jul 28 07:59:05 2022] GET /identity/v3/groups/9bf400d464c14a2c9216639cecb87c66 => generated 229 bytes in 287 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 07:59:05.320948 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64942094-e26a-4726-9937-8b959cd0d548 None admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 07:59:05.329186 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa81a87-8f93-4fa8-8647-7279c5f0c0e2 None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 07:59:05.392760 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0937e5-0a15-44e0-a2b5-0035800d9426 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 07:59:05.393328 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0937e5-0a15-44e0-a2b5-0035800d9426 None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 07:59:05.393598 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0937e5-0a15-44e0-a2b5-0035800d9426 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 07:59:05.393863 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0937e5-0a15-44e0-a2b5-0035800d9426 None admin] PATH_INFO: `/v3/roles` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 07:59:05.394589 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca0937e5-0a15-44e0-a2b5-0035800d9426 None admin] RBAC: Adding query filter params (name=member) {{(pid=80347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 07:59:05.394887 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca0937e5-0a15-44e0-a2b5-0035800d9426 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 07:59:05.396961 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca0937e5-0a15-44e0-a2b5-0035800d9426 None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 07:59:05.407155 dv-cinder-851351-1-smb devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 222/417] 10.222.0.42 () {56 vars in 1101 bytes} [Thu Jul 28 07:59:05 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 07:59:05.413942 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0937e5-0a15-44e0-a2b5-0035800d9426 None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 07:59:05.422231 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=100 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 07:59:05.509042 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64942094-e26a-4726-9937-8b959cd0d548 None admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 07:59:05.534733 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3e88e6-a908-4a39-9064-bb6a56ac77ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 07:59:05.535390 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3e88e6-a908-4a39-9064-bb6a56ac77ac None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 07:59:05.535668 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3e88e6-a908-4a39-9064-bb6a56ac77ac None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 07:59:05.535939 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3e88e6-a908-4a39-9064-bb6a56ac77ac None admin] PATH_INFO: `/v3/projects/d51c90075a0545959e2ede68845ae91b` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 07:59:05.537268 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df3e88e6-a908-4a39-9064-bb6a56ac77ac None admin] RBAC: Authorizing `identity:get_project(project_id=d51c90075a0545959e2ede68845ae91b)` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 07:59:05.539096 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df3e88e6-a908-4a39-9064-bb6a56ac77ac None admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 07:59:05.546172 dv-cinder-851351-1-smb devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 196/418] 10.222.0.42 () {56 vars in 1186 bytes} [Thu Jul 28 07:59:05 2022] GET /identity/v3/projects/d51c90075a0545959e2ede68845ae91b => generated 344 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 07:59:05.547868 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3e88e6-a908-4a39-9064-bb6a56ac77ac None admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 07:59:05.663101 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0937e5-0a15-44e0-a2b5-0035800d9426 None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 07:59:05.697493 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3e88e6-a908-4a39-9064-bb6a56ac77ac None admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 07:59:05.698807 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c97311-7e66-45ea-ad3c-e75cd9185a80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 07:59:05.699849 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c97311-7e66-45ea-ad3c-e75cd9185a80 None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 07:59:05.700185 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c97311-7e66-45ea-ad3c-e75cd9185a80 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 07:59:05.700518 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c97311-7e66-45ea-ad3c-e75cd9185a80 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 07:59:05.722053 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 07:59:05.750347 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=100 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 07:59:05.784358 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c97311-7e66-45ea-ad3c-e75cd9185a80 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 07:59:05.786384 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c97311-7e66-45ea-ad3c-e75cd9185a80 None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 07:59:05.810167 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad5b27d-1a86-45b4-b785-7b9b3cb3cca7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 07:59:05.810893 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad5b27d-1a86-45b4-b785-7b9b3cb3cca7 None admin] REQUEST_METHOD: `PUT` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 07:59:05.811175 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad5b27d-1a86-45b4-b785-7b9b3cb3cca7 None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 07:59:05.811449 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad5b27d-1a86-45b4-b785-7b9b3cb3cca7 None admin] PATH_INFO: `/v3/projects/d51c90075a0545959e2ede68845ae91b/groups/9bf400d464c14a2c9216639cecb87c66/roles/362bd71ac01249fb8fa635381993eec1` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 07:59:05.813550 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ad5b27d-1a86-45b4-b785-7b9b3cb3cca7 None admin] RBAC: Authorizing `identity:create_grant(project_id=d51c90075a0545959e2ede68845ae91b, group_id=9bf400d464c14a2c9216639cecb87c66, role_id=362bd71ac01249fb8fa635381993eec1)` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 07:59:05.815053 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ad5b27d-1a86-45b4-b785-7b9b3cb3cca7 None admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 07:59:05.847214 dv-cinder-851351-1-smb devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 197/419] 10.222.0.42 () {58 vars in 1442 bytes} [Thu Jul 28 07:59:05 2022] PUT /identity/v3/projects/d51c90075a0545959e2ede68845ae91b/groups/9bf400d464c14a2c9216639cecb87c66/roles/362bd71ac01249fb8fa635381993eec1 => generated 0 bytes in 300 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 28 07:59:05.872390 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6095e2d1-308f-4eef-8f4c-b9d6e349b5d4 None None] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 07:59:05.872720 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6095e2d1-308f-4eef-8f4c-b9d6e349b5d4 None None] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 07:59:05.872981 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6095e2d1-308f-4eef-8f4c-b9d6e349b5d4 None None] PATH_INFO: `/` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 07:59:05.874747 dv-cinder-851351-1-smb devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 198/420] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 07:59:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 07:59:05.881677 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7e6882-51da-43c4-8f48-50c2edd83d8a None None] REQUEST_METHOD: `POST` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 07:59:05.881873 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7e6882-51da-43c4-8f48-50c2edd83d8a None None] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 07:59:05.882134 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7e6882-51da-43c4-8f48-50c2edd83d8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 07:59:05.914810 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.auth.core [None req-7f7e6882-51da-43c4-8f48-50c2edd83d8a None None] MFA Rules not processed for user `f0666d3a50644a7097367331c1ee1a68`. Rule list: `[]` (Enabled: `True`). {{(pid=80348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 07:59:05.921763 dv-cinder-851351-1-smb devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 223/421] 10.222.0.42 () {58 vars in 1282 bytes} [Thu Jul 28 07:59:05 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 508 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 28 07:59:05.921958 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.fernet_utils [None req-7f7e6882-51da-43c4-8f48-50c2edd83d8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 07:59:05.927202 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c97311-7e66-45ea-ad3c-e75cd9185a80 None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 07:59:05.970676 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 07:59:06.061817 dv-cinder-851351-1-smb devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 199/422] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 07:59:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 07:59:06.091684 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f7e6882-51da-43c4-8f48-50c2edd83d8a None None] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 07:59:06.107932 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c97311-7e66-45ea-ad3c-e75cd9185a80 None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 07:59:06.160551 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-029d6b7c-07ee-404c-9aca-1a346d126537 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 07:59:06.161421 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029d6b7c-07ee-404c-9aca-1a346d126537 None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 07:59:06.161793 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029d6b7c-07ee-404c-9aca-1a346d126537 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 07:59:06.162158 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029d6b7c-07ee-404c-9aca-1a346d126537 None admin] PATH_INFO: `/v3/projects/cdfa7c2638114a968f5357dc098b441b` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 07:59:06.165771 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-029d6b7c-07ee-404c-9aca-1a346d126537 None admin] RBAC: Authorizing `identity:get_project(project_id=cdfa7c2638114a968f5357dc098b441b)` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 07:59:06.165771 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-029d6b7c-07ee-404c-9aca-1a346d126537 None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 07:59:06.167645 dv-cinder-851351-1-smb devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 224/423] 10.222.0.42 () {56 vars in 1186 bytes} [Thu Jul 28 07:59:05 2022] GET /identity/v3/projects/cdfa7c2638114a968f5357dc098b441b => generated 298 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 07:59:06.172990 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-029d6b7c-07ee-404c-9aca-1a346d126537 None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 07:59:06.250292 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f7e6882-51da-43c4-8f48-50c2edd83d8a None None] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 07:59:06.271141 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 07:59:06.281123 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 07:59:06.285175 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-029d6b7c-07ee-404c-9aca-1a346d126537 None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 07:59:06.323350 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e415adc1-2a0f-4dc4-91a0-7885af7eda77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 07:59:06.324024 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e415adc1-2a0f-4dc4-91a0-7885af7eda77 None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 07:59:06.324300 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e415adc1-2a0f-4dc4-91a0-7885af7eda77 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 07:59:06.324570 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e415adc1-2a0f-4dc4-91a0-7885af7eda77 None admin] PATH_INFO: `/v3/groups/62a03a5df2bb4784abc8a0bd5def0e79` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 07:59:06.325879 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e415adc1-2a0f-4dc4-91a0-7885af7eda77 None admin] RBAC: Authorizing `identity:get_group(group_id=62a03a5df2bb4784abc8a0bd5def0e79)` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 07:59:06.327325 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e415adc1-2a0f-4dc4-91a0-7885af7eda77 None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 07:59:06.329357 dv-cinder-851351-1-smb devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 225/424] 10.222.0.42 () {56 vars in 1180 bytes} [Thu Jul 28 07:59:06 2022] GET /identity/v3/groups/62a03a5df2bb4784abc8a0bd5def0e79 => generated 226 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 07:59:06.337406 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e415adc1-2a0f-4dc4-91a0-7885af7eda77 None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 07:59:06.353462 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61efc63b-a0aa-445a-8ff9-e6bf0b3969c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 07:59:06.354175 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61efc63b-a0aa-445a-8ff9-e6bf0b3969c2 None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 07:59:06.354392 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61efc63b-a0aa-445a-8ff9-e6bf0b3969c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 07:59:06.354662 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61efc63b-a0aa-445a-8ff9-e6bf0b3969c2 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 07:59:06.373927 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61efc63b-a0aa-445a-8ff9-e6bf0b3969c2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 07:59:06.378996 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application [None req-61efc63b-a0aa-445a-8ff9-e6bf0b3969c2 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 28 07:59:06.378996 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 07:59:06.378996 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 07:59:06.378996 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 07:59:06.378996 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 07:59:06.378996 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 07:59:06.378996 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 07:59:06.378996 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 07:59:06.378996 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 07:59:06.378996 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 07:59:06.378996 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 07:59:06.378996 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 07:59:06.378996 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 07:59:06.378996 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 07:59:06.378996 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 07:59:06.378996 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 07:59:06.379885 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 07:59:06.379885 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 07:59:06.379885 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 07:59:06.379885 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 07:59:06.379885 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 07:59:06.379885 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 07:59:06.379885 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 07:59:06.379885 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 07:59:06.379885 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 07:59:06.379885 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 07:59:06.379885 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 07:59:06.379885 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application with Lock( Jul 28 07:59:06.379885 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 07:59:06.379885 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self._enter() Jul 28 07:59:06.379885 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 07:59:06.379885 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 07:59:06.381326 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 07:59:06.381326 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.creator() Jul 28 07:59:06.381326 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 07:59:06.381326 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application created_value = creator( Jul 28 07:59:06.381326 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 07:59:06.381326 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 07:59:06.381326 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 07:59:06.381326 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 07:59:06.381326 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 07:59:06.381326 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 07:59:06.381326 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 28 07:59:06.381326 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application Jul 28 07:59:06.381326 dv-cinder-851351-1-smb devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 200/425] 10.222.0.42 () {56 vars in 1114 bytes} [Thu Jul 28 07:59:06 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 289 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 07:59:06.392717 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61efc63b-a0aa-445a-8ff9-e6bf0b3969c2 None admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 07:59:06.507223 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61efc63b-a0aa-445a-8ff9-e6bf0b3969c2 None admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 07:59:06.553435 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e415adc1-2a0f-4dc4-91a0-7885af7eda77 None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 07:59:06.554466 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa0ac6cf-d720-4923-acbd-b5b381db8b68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 07:59:06.555119 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0ac6cf-d720-4923-acbd-b5b381db8b68 None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 07:59:06.555402 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0ac6cf-d720-4923-acbd-b5b381db8b68 None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 07:59:06.555673 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0ac6cf-d720-4923-acbd-b5b381db8b68 None admin] PATH_INFO: `/v3/roles` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 07:59:06.556424 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa0ac6cf-d720-4923-acbd-b5b381db8b68 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80348) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 07:59:06.556752 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa0ac6cf-d720-4923-acbd-b5b381db8b68 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 07:59:06.558177 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa0ac6cf-d720-4923-acbd-b5b381db8b68 None admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 07:59:06.579323 dv-cinder-851351-1-smb devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 201/426] 10.222.0.42 () {56 vars in 1111 bytes} [Thu Jul 28 07:59:06 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 07:59:06.585282 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa0ac6cf-d720-4923-acbd-b5b381db8b68 None admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 07:59:06.612757 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36998ec-f07a-4efa-a064-2998867626cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 07:59:06.613701 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36998ec-f07a-4efa-a064-2998867626cb None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 07:59:06.613974 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36998ec-f07a-4efa-a064-2998867626cb None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 07:59:06.614242 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36998ec-f07a-4efa-a064-2998867626cb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 07:59:06.615059 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b36998ec-f07a-4efa-a064-2998867626cb None admin] RBAC: Adding query filter params (group.id=62a03a5df2bb4784abc8a0bd5def0e79, role.id=0317c30d81ff44eea2fd4a7215c60eac, scope.project.id=cdfa7c2638114a968f5357dc098b441b) {{(pid=80347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 07:59:06.615364 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b36998ec-f07a-4efa-a064-2998867626cb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 07:59:06.616903 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b36998ec-f07a-4efa-a064-2998867626cb None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 07:59:06.632621 dv-cinder-851351-1-smb devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 226/427] 10.222.0.42 () {56 vars in 1376 bytes} [Thu Jul 28 07:59:06 2022] GET /identity/v3/role_assignments?group.id=62a03a5df2bb4784abc8a0bd5def0e79&scope.project.id=cdfa7c2638114a968f5357dc098b441b&role.id=0317c30d81ff44eea2fd4a7215c60eac => generated 611 bytes in 294 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 07:59:06.649126 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=100 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 07:59:06.765117 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa0ac6cf-d720-4923-acbd-b5b381db8b68 None admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 07:59:06.773394 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e1564b-a93f-4f26-b44e-284d5f5a0e97 None None] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 07:59:06.773956 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e1564b-a93f-4f26-b44e-284d5f5a0e97 None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 07:59:06.773956 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e1564b-a93f-4f26-b44e-284d5f5a0e97 None None] PATH_INFO: `/` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 07:59:06.775367 dv-cinder-851351-1-smb devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 227/428] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 07:59:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 28 07:59:06.781266 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa5862a-ef7d-4085-8973-bcd38a2cb525 None None] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 07:59:06.781659 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa5862a-ef7d-4085-8973-bcd38a2cb525 None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 07:59:06.782037 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa5862a-ef7d-4085-8973-bcd38a2cb525 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 07:59:06.805666 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.auth.core [None req-9aa5862a-ef7d-4085-8973-bcd38a2cb525 None None] MFA Rules not processed for user `f0666d3a50644a7097367331c1ee1a68`. Rule list: `[]` (Enabled: `True`). {{(pid=80347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 07:59:06.808487 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-9aa5862a-ef7d-4085-8973-bcd38a2cb525 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 07:59:06.833184 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-484fee22-2f92-46d8-92db-5bb8f47214fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 07:59:06.833836 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484fee22-2f92-46d8-92db-5bb8f47214fc None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 07:59:06.834110 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484fee22-2f92-46d8-92db-5bb8f47214fc None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 07:59:06.834383 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484fee22-2f92-46d8-92db-5bb8f47214fc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 07:59:06.841943 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 07:59:06.908874 dv-cinder-851351-1-smb devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 228/429] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 07:59:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 28 07:59:06.912708 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-484fee22-2f92-46d8-92db-5bb8f47214fc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 07:59:06.914325 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-484fee22-2f92-46d8-92db-5bb8f47214fc None admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 07:59:06.935747 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa5862a-ef7d-4085-8973-bcd38a2cb525 None None] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 07:59:06.946449 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=100 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 07:59:07.022952 dv-cinder-851351-1-smb devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 202/430] 10.222.0.42 () {58 vars in 1282 bytes} [Thu Jul 28 07:59:06 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 438 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 28 07:59:07.028592 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-484fee22-2f92-46d8-92db-5bb8f47214fc None admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 07:59:07.068142 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa5862a-ef7d-4085-8973-bcd38a2cb525 None None] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 07:59:07.112220 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e1dad8-7345-45c0-93e2-313e293b8b6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 07:59:07.113015 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e1dad8-7345-45c0-93e2-313e293b8b6e None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 07:59:07.113363 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e1dad8-7345-45c0-93e2-313e293b8b6e None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 07:59:07.113838 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e1dad8-7345-45c0-93e2-313e293b8b6e None admin] PATH_INFO: `/v3/roles/member` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 07:59:07.133623 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-484fee22-2f92-46d8-92db-5bb8f47214fc None admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 07:59:07.133935 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6e1dad8-7345-45c0-93e2-313e293b8b6e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 07:59:07.139733 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application [None req-e6e1dad8-7345-45c0-93e2-313e293b8b6e None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 28 07:59:07.139733 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 07:59:07.139733 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 07:59:07.139733 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 07:59:07.139733 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 07:59:07.139733 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 07:59:07.139733 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 07:59:07.139733 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 07:59:07.139733 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 07:59:07.139733 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 07:59:07.139733 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 07:59:07.139733 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 07:59:07.139733 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 07:59:07.139733 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 07:59:07.139733 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 07:59:07.139733 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 07:59:07.140893 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 07:59:07.140893 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 07:59:07.140893 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 07:59:07.140893 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 07:59:07.140893 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 07:59:07.140893 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 07:59:07.140893 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 07:59:07.140893 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 07:59:07.140893 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 07:59:07.140893 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 07:59:07.140893 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 07:59:07.140893 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application with Lock( Jul 28 07:59:07.140893 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 07:59:07.140893 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._enter() Jul 28 07:59:07.140893 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 07:59:07.140893 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 07:59:07.141882 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 07:59:07.141882 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.creator() Jul 28 07:59:07.141882 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 07:59:07.141882 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application created_value = creator( Jul 28 07:59:07.141882 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 07:59:07.141882 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 07:59:07.141882 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 07:59:07.141882 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 07:59:07.141882 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 07:59:07.141882 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 07:59:07.141882 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 28 07:59:07.141882 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application Jul 28 07:59:07.144651 dv-cinder-851351-1-smb devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 229/431] 10.222.0.42 () {56 vars in 1099 bytes} [Thu Jul 28 07:59:06 2022] GET /identity/v3/roles/member => generated 84 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 07:59:07.148687 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe39578-cf7e-4e78-9eba-d0b37a941f64 None None] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 07:59:07.148687 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe39578-cf7e-4e78-9eba-d0b37a941f64 None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 07:59:07.148687 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe39578-cf7e-4e78-9eba-d0b37a941f64 None None] PATH_INFO: `/` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 07:59:07.150850 dv-cinder-851351-1-smb devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 230/432] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 07:59:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 07:59:07.151924 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe39578-cf7e-4e78-9eba-d0b37a941f64 None None] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 07:59:07.166567 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=100 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 07:59:07.170494 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 07:59:07.172965 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d3de2d-50d5-402e-912e-b88407ee97fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 07:59:07.173833 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d3de2d-50d5-402e-912e-b88407ee97fb None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 07:59:07.174252 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d3de2d-50d5-402e-912e-b88407ee97fb None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 07:59:07.174665 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d3de2d-50d5-402e-912e-b88407ee97fb None admin] PATH_INFO: `/v3/projects/cdfa7c2638114a968f5357dc098b441b` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 07:59:07.176086 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7d3de2d-50d5-402e-912e-b88407ee97fb None admin] RBAC: Authorizing `identity:get_project(project_id=cdfa7c2638114a968f5357dc098b441b)` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 07:59:07.177890 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7d3de2d-50d5-402e-912e-b88407ee97fb None admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 07:59:07.180135 dv-cinder-851351-1-smb devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 203/433] 10.222.0.42 () {56 vars in 1186 bytes} [Thu Jul 28 07:59:07 2022] GET /identity/v3/projects/cdfa7c2638114a968f5357dc098b441b => generated 298 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 07:59:07.185160 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e767722-779c-4f4f-9800-9b1511005a7f None None] REQUEST_METHOD: `POST` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 07:59:07.185623 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e767722-779c-4f4f-9800-9b1511005a7f None None] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 07:59:07.185902 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e767722-779c-4f4f-9800-9b1511005a7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 07:59:07.215922 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.auth.core [None req-5e767722-779c-4f4f-9800-9b1511005a7f None None] MFA Rules not processed for user `f0666d3a50644a7097367331c1ee1a68`. Rule list: `[]` (Enabled: `True`). {{(pid=80348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 07:59:07.217189 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.fernet_utils [None req-5e767722-779c-4f4f-9800-9b1511005a7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 07:59:07.279777 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe39578-cf7e-4e78-9eba-d0b37a941f64 None None] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 07:59:07.300771 dv-cinder-851351-1-smb devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 204/434] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 07:59:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 07:59:07.301687 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e767722-779c-4f4f-9800-9b1511005a7f None None] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 07:59:07.337014 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-963ace69-2310-4e03-b8aa-b74ad6d6bf73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 07:59:07.337876 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963ace69-2310-4e03-b8aa-b74ad6d6bf73 None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 07:59:07.337876 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963ace69-2310-4e03-b8aa-b74ad6d6bf73 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 07:59:07.338054 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963ace69-2310-4e03-b8aa-b74ad6d6bf73 None admin] PATH_INFO: `/v3/roles` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 07:59:07.338719 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-963ace69-2310-4e03-b8aa-b74ad6d6bf73 None admin] RBAC: Adding query filter params (name=member) {{(pid=80347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 07:59:07.339132 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-963ace69-2310-4e03-b8aa-b74ad6d6bf73 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 07:59:07.340708 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-963ace69-2310-4e03-b8aa-b74ad6d6bf73 None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 07:59:07.350626 dv-cinder-851351-1-smb devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 231/435] 10.222.0.42 () {56 vars in 1101 bytes} [Thu Jul 28 07:59:07 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 07:59:07.353241 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-963ace69-2310-4e03-b8aa-b74ad6d6bf73 None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 07:59:07.420335 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e767722-779c-4f4f-9800-9b1511005a7f None None] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 07:59:07.450470 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=100 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 07:59:07.455443 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 07:59:07.463194 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b51682-bc88-4d8a-9043-ebbdb466d4d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 07:59:07.463890 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b51682-bc88-4d8a-9043-ebbdb466d4d1 None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 07:59:07.464298 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b51682-bc88-4d8a-9043-ebbdb466d4d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 07:59:07.464443 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b51682-bc88-4d8a-9043-ebbdb466d4d1 None admin] PATH_INFO: `/v3/groups/62a03a5df2bb4784abc8a0bd5def0e79` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 07:59:07.465874 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b51682-bc88-4d8a-9043-ebbdb466d4d1 None admin] RBAC: Authorizing `identity:get_group(group_id=62a03a5df2bb4784abc8a0bd5def0e79)` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 07:59:07.467415 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b51682-bc88-4d8a-9043-ebbdb466d4d1 None admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 07:59:07.469476 dv-cinder-851351-1-smb devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 205/436] 10.222.0.42 () {56 vars in 1180 bytes} [Thu Jul 28 07:59:07 2022] GET /identity/v3/groups/62a03a5df2bb4784abc8a0bd5def0e79 => generated 226 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 07:59:07.470171 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b51682-bc88-4d8a-9043-ebbdb466d4d1 None admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 07:59:07.490990 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-963ace69-2310-4e03-b8aa-b74ad6d6bf73 None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 07:59:07.529627 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-555818c8-90de-4b19-9cb2-a0def35cad2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 07:59:07.530360 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555818c8-90de-4b19-9cb2-a0def35cad2f None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 07:59:07.530563 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555818c8-90de-4b19-9cb2-a0def35cad2f None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 07:59:07.530828 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555818c8-90de-4b19-9cb2-a0def35cad2f None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 07:59:07.543190 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-555818c8-90de-4b19-9cb2-a0def35cad2f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 07:59:07.549453 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application [None req-555818c8-90de-4b19-9cb2-a0def35cad2f None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 28 07:59:07.549453 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 07:59:07.549453 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 07:59:07.549453 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 07:59:07.549453 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 07:59:07.549453 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 07:59:07.549453 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 07:59:07.549453 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 07:59:07.549453 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 07:59:07.549453 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 07:59:07.549453 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 07:59:07.549453 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 07:59:07.549453 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 07:59:07.549453 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 07:59:07.549453 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 07:59:07.549453 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 07:59:07.550393 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 07:59:07.550393 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 07:59:07.550393 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 07:59:07.550393 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 07:59:07.550393 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 07:59:07.550393 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 07:59:07.550393 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 07:59:07.550393 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 07:59:07.550393 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 07:59:07.550393 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 07:59:07.550393 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 07:59:07.550393 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application with Lock( Jul 28 07:59:07.550393 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 07:59:07.550393 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._enter() Jul 28 07:59:07.550393 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 07:59:07.550393 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 07:59:07.551184 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 07:59:07.551184 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.creator() Jul 28 07:59:07.551184 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 07:59:07.551184 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application created_value = creator( Jul 28 07:59:07.551184 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 07:59:07.551184 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 07:59:07.551184 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 07:59:07.551184 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 07:59:07.551184 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 07:59:07.551184 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 07:59:07.551184 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 28 07:59:07.551184 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application Jul 28 07:59:07.551184 dv-cinder-851351-1-smb devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 232/437] 10.222.0.42 () {56 vars in 1114 bytes} [Thu Jul 28 07:59:07 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 07:59:07.551832 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-555818c8-90de-4b19-9cb2-a0def35cad2f None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 07:59:07.623931 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b51682-bc88-4d8a-9043-ebbdb466d4d1 None admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 07:59:07.666089 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9753f873-f991-4d5a-a918-a0ccd652a8f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 07:59:07.666743 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9753f873-f991-4d5a-a918-a0ccd652a8f8 None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 07:59:07.667008 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9753f873-f991-4d5a-a918-a0ccd652a8f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 07:59:07.667289 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9753f873-f991-4d5a-a918-a0ccd652a8f8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 07:59:07.668906 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-555818c8-90de-4b19-9cb2-a0def35cad2f None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 07:59:07.707508 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e5edf9-6b91-4fa5-91b3-6c375bf130d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 07:59:07.708121 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e5edf9-6b91-4fa5-91b3-6c375bf130d2 None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 07:59:07.708398 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e5edf9-6b91-4fa5-91b3-6c375bf130d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 07:59:07.708718 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e5edf9-6b91-4fa5-91b3-6c375bf130d2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 07:59:07.709480 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5e5edf9-6b91-4fa5-91b3-6c375bf130d2 None admin] RBAC: Adding query filter params (group.id=62a03a5df2bb4784abc8a0bd5def0e79, role.id=f28d669937b942878bcf6a9103012af9, scope.project.id=cdfa7c2638114a968f5357dc098b441b) {{(pid=80347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 07:59:07.709780 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5e5edf9-6b91-4fa5-91b3-6c375bf130d2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 07:59:07.711428 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5e5edf9-6b91-4fa5-91b3-6c375bf130d2 None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 07:59:07.714531 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 07:59:07.721617 dv-cinder-851351-1-smb devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 233/438] 10.222.0.42 () {56 vars in 1376 bytes} [Thu Jul 28 07:59:07 2022] GET /identity/v3/role_assignments?group.id=62a03a5df2bb4784abc8a0bd5def0e79&scope.project.id=cdfa7c2638114a968f5357dc098b441b&role.id=f28d669937b942878bcf6a9103012af9 => generated 611 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 07:59:07.722266 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e5edf9-6b91-4fa5-91b3-6c375bf130d2 None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 07:59:07.755668 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=100 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 07:59:07.765985 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9753f873-f991-4d5a-a918-a0ccd652a8f8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 07:59:07.767601 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9753f873-f991-4d5a-a918-a0ccd652a8f8 None admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 07:59:07.864122 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e5edf9-6b91-4fa5-91b3-6c375bf130d2 None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 07:59:07.911912 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df81cdb4-db06-43eb-8742-8fb0c8000e2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 07:59:07.912647 dv-cinder-851351-1-smb devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 206/439] 10.222.0.42 () {58 vars in 1282 bytes} [Thu Jul 28 07:59:07 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 443 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 28 07:59:07.912779 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df81cdb4-db06-43eb-8742-8fb0c8000e2b None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 07:59:07.912867 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df81cdb4-db06-43eb-8742-8fb0c8000e2b None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 07:59:07.913076 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df81cdb4-db06-43eb-8742-8fb0c8000e2b None admin] PATH_INFO: `/v3/roles` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 07:59:07.913795 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df81cdb4-db06-43eb-8742-8fb0c8000e2b None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 07:59:07.914094 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df81cdb4-db06-43eb-8742-8fb0c8000e2b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 07:59:07.915572 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df81cdb4-db06-43eb-8742-8fb0c8000e2b None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 07:59:07.918186 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9753f873-f991-4d5a-a918-a0ccd652a8f8 None admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 07:59:07.927229 dv-cinder-851351-1-smb devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 234/440] 10.222.0.42 () {56 vars in 1111 bytes} [Thu Jul 28 07:59:07 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 07:59:07.935155 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df81cdb4-db06-43eb-8742-8fb0c8000e2b None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 07:59:08.024084 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 07:59:08.045112 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=100 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 07:59:08.054864 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9753f873-f991-4d5a-a918-a0ccd652a8f8 None admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 07:59:08.083742 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df81cdb4-db06-43eb-8742-8fb0c8000e2b None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 07:59:08.100855 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4afa5be-a7f2-453e-9bac-91ff96ac8055 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 07:59:08.101518 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4afa5be-a7f2-453e-9bac-91ff96ac8055 None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 07:59:08.101799 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4afa5be-a7f2-453e-9bac-91ff96ac8055 None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 07:59:08.102075 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4afa5be-a7f2-453e-9bac-91ff96ac8055 None admin] PATH_INFO: `/v3/projects/0f988f0c81614261ae36a6896770b2d0` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 07:59:08.103989 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4afa5be-a7f2-453e-9bac-91ff96ac8055 None admin] RBAC: Authorizing `identity:get_project(project_id=0f988f0c81614261ae36a6896770b2d0)` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 07:59:08.105545 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4afa5be-a7f2-453e-9bac-91ff96ac8055 None admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 07:59:08.107511 dv-cinder-851351-1-smb devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 207/441] 10.222.0.42 () {56 vars in 1186 bytes} [Thu Jul 28 07:59:07 2022] GET /identity/v3/projects/0f988f0c81614261ae36a6896770b2d0 => generated 302 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 07:59:08.113363 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4afa5be-a7f2-453e-9bac-91ff96ac8055 None admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 07:59:08.136703 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfdd34e9-610e-4271-8bd7-f57f08859c31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 07:59:08.137730 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfdd34e9-610e-4271-8bd7-f57f08859c31 None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 07:59:08.138009 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfdd34e9-610e-4271-8bd7-f57f08859c31 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 07:59:08.138280 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfdd34e9-610e-4271-8bd7-f57f08859c31 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 07:59:08.247283 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfdd34e9-610e-4271-8bd7-f57f08859c31 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 07:59:08.249936 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfdd34e9-610e-4271-8bd7-f57f08859c31 None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 07:59:08.262396 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4afa5be-a7f2-453e-9bac-91ff96ac8055 None admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 07:59:08.303315 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6a3d92-6db2-41f2-abd2-6dcd5470b93e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 07:59:08.303972 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6a3d92-6db2-41f2-abd2-6dcd5470b93e None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 07:59:08.304240 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6a3d92-6db2-41f2-abd2-6dcd5470b93e None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 07:59:08.304508 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6a3d92-6db2-41f2-abd2-6dcd5470b93e None admin] PATH_INFO: `/v3/groups/62a03a5df2bb4784abc8a0bd5def0e79` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 07:59:08.305737 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b6a3d92-6db2-41f2-abd2-6dcd5470b93e None admin] RBAC: Authorizing `identity:get_group(group_id=62a03a5df2bb4784abc8a0bd5def0e79)` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 07:59:08.307186 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b6a3d92-6db2-41f2-abd2-6dcd5470b93e None admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 07:59:08.309300 dv-cinder-851351-1-smb devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 208/442] 10.222.0.42 () {56 vars in 1180 bytes} [Thu Jul 28 07:59:08 2022] GET /identity/v3/groups/62a03a5df2bb4784abc8a0bd5def0e79 => generated 226 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 07:59:08.314898 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6a3d92-6db2-41f2-abd2-6dcd5470b93e None admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 07:59:08.327285 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 07:59:08.348857 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=100 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 07:59:08.375243 dv-cinder-851351-1-smb devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 235/443] 10.222.0.42 () {58 vars in 1282 bytes} [Thu Jul 28 07:59:07 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 441 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 28 07:59:08.376570 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dafe52ca-d156-4ba9-82b2-175e1a42db6d None None] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 07:59:08.376843 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dafe52ca-d156-4ba9-82b2-175e1a42db6d None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 07:59:08.377109 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dafe52ca-d156-4ba9-82b2-175e1a42db6d None None] PATH_INFO: `/` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 07:59:08.378559 dv-cinder-851351-1-smb devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 236/444] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 07:59:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 07:59:08.381298 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dafe52ca-d156-4ba9-82b2-175e1a42db6d None None] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 07:59:08.418950 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6a3d92-6db2-41f2-abd2-6dcd5470b93e None admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 07:59:08.452541 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6988a9d-5ec2-4df3-9162-d57c91616330 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 07:59:08.453273 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6988a9d-5ec2-4df3-9162-d57c91616330 None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 07:59:08.453441 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6988a9d-5ec2-4df3-9162-d57c91616330 None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 07:59:08.453713 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6988a9d-5ec2-4df3-9162-d57c91616330 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 07:59:08.454508 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6988a9d-5ec2-4df3-9162-d57c91616330 None admin] RBAC: Adding query filter params (group.id=62a03a5df2bb4784abc8a0bd5def0e79, role.id=0317c30d81ff44eea2fd4a7215c60eac, scope.project.id=0f988f0c81614261ae36a6896770b2d0) {{(pid=80348) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 07:59:08.454816 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6988a9d-5ec2-4df3-9162-d57c91616330 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 07:59:08.456630 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6988a9d-5ec2-4df3-9162-d57c91616330 None admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 07:59:08.462769 dv-cinder-851351-1-smb devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 209/445] 10.222.0.42 () {56 vars in 1376 bytes} [Thu Jul 28 07:59:08 2022] GET /identity/v3/role_assignments?group.id=62a03a5df2bb4784abc8a0bd5def0e79&scope.project.id=0f988f0c81614261ae36a6896770b2d0&role.id=0317c30d81ff44eea2fd4a7215c60eac => generated 611 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 07:59:08.463967 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720f8226-23df-4df0-aaa5-729309adac00 None None] REQUEST_METHOD: `POST` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 07:59:08.464250 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720f8226-23df-4df0-aaa5-729309adac00 None None] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 07:59:08.464522 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720f8226-23df-4df0-aaa5-729309adac00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 07:59:08.491440 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dafe52ca-d156-4ba9-82b2-175e1a42db6d None None] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 07:59:08.499063 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.auth.core [None req-720f8226-23df-4df0-aaa5-729309adac00 None None] MFA Rules not processed for user `f0666d3a50644a7097367331c1ee1a68`. Rule list: `[]` (Enabled: `True`). {{(pid=80348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 07:59:08.501470 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.fernet_utils [None req-720f8226-23df-4df0-aaa5-729309adac00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 07:59:08.536864 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05d8c25-283c-4037-af4b-32e6da4b47ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 07:59:08.537628 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05d8c25-283c-4037-af4b-32e6da4b47ae None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 07:59:08.537802 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05d8c25-283c-4037-af4b-32e6da4b47ae None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 07:59:08.538077 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05d8c25-283c-4037-af4b-32e6da4b47ae None admin] PATH_INFO: `/v3/projects/0f988f0c81614261ae36a6896770b2d0` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 07:59:08.539489 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b05d8c25-283c-4037-af4b-32e6da4b47ae None admin] RBAC: Authorizing `identity:get_project(project_id=0f988f0c81614261ae36a6896770b2d0)` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 07:59:08.541001 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b05d8c25-283c-4037-af4b-32e6da4b47ae None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 07:59:08.543043 dv-cinder-851351-1-smb devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 237/446] 10.222.0.42 () {56 vars in 1186 bytes} [Thu Jul 28 07:59:08 2022] GET /identity/v3/projects/0f988f0c81614261ae36a6896770b2d0 => generated 302 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 07:59:08.549040 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05d8c25-283c-4037-af4b-32e6da4b47ae None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 07:59:08.585076 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 07:59:08.588007 dv-cinder-851351-1-smb devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 210/447] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 07:59:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 07:59:08.611722 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720f8226-23df-4df0-aaa5-729309adac00 None None] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 07:59:08.642828 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=100 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 07:59:08.682201 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05d8c25-283c-4037-af4b-32e6da4b47ae None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 07:59:08.731033 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6548bdec-6f7e-45aa-9d75-e17f633ac09d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 07:59:08.732356 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6548bdec-6f7e-45aa-9d75-e17f633ac09d None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 07:59:08.732761 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6548bdec-6f7e-45aa-9d75-e17f633ac09d None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 07:59:08.733207 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6548bdec-6f7e-45aa-9d75-e17f633ac09d None admin] PATH_INFO: `/v3/groups/62a03a5df2bb4784abc8a0bd5def0e79` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 07:59:08.735755 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6548bdec-6f7e-45aa-9d75-e17f633ac09d None admin] RBAC: Authorizing `identity:get_group(group_id=62a03a5df2bb4784abc8a0bd5def0e79)` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 07:59:08.736957 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6548bdec-6f7e-45aa-9d75-e17f633ac09d None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 07:59:08.739670 dv-cinder-851351-1-smb devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 238/448] 10.222.0.42 () {56 vars in 1180 bytes} [Thu Jul 28 07:59:08 2022] GET /identity/v3/groups/62a03a5df2bb4784abc8a0bd5def0e79 => generated 226 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 07:59:08.741177 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720f8226-23df-4df0-aaa5-729309adac00 None None] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 07:59:08.746919 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6548bdec-6f7e-45aa-9d75-e17f633ac09d None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 07:59:08.786385 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db442b5-699f-4013-a151-f9cb911b13e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 07:59:08.787151 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db442b5-699f-4013-a151-f9cb911b13e3 None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 07:59:08.787327 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db442b5-699f-4013-a151-f9cb911b13e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 07:59:08.787586 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db442b5-699f-4013-a151-f9cb911b13e3 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 07:59:08.799441 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8db442b5-699f-4013-a151-f9cb911b13e3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 07:59:08.804423 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application [None req-8db442b5-699f-4013-a151-f9cb911b13e3 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 07:59:08.804423 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 07:59:08.804423 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 07:59:08.804423 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 07:59:08.804423 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 07:59:08.804423 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 07:59:08.804423 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 07:59:08.804423 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 07:59:08.804423 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 07:59:08.804423 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 07:59:08.804423 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 07:59:08.804423 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 07:59:08.804423 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 07:59:08.804423 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 07:59:08.804423 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 07:59:08.804423 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 07:59:08.805343 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 07:59:08.805343 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 07:59:08.805343 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 07:59:08.805343 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 07:59:08.805343 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 07:59:08.805343 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 07:59:08.805343 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 07:59:08.805343 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 07:59:08.805343 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 07:59:08.805343 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 07:59:08.805343 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 07:59:08.805343 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application with Lock( Jul 28 07:59:08.805343 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 07:59:08.805343 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self._enter() Jul 28 07:59:08.805343 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 07:59:08.805343 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 07:59:08.809555 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 07:59:08.809555 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.creator() Jul 28 07:59:08.809555 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 07:59:08.809555 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application created_value = creator( Jul 28 07:59:08.809555 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 07:59:08.809555 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 07:59:08.809555 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 07:59:08.809555 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 07:59:08.809555 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 07:59:08.809555 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 07:59:08.809555 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 07:59:08.809555 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application Jul 28 07:59:08.809555 dv-cinder-851351-1-smb devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 211/449] 10.222.0.42 () {56 vars in 1096 bytes} [Thu Jul 28 07:59:08 2022] GET /identity/v3/roles/admin => generated 83 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 07:59:08.812282 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db442b5-699f-4013-a151-f9cb911b13e3 None admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 07:59:08.871945 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 07:59:08.876564 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6548bdec-6f7e-45aa-9d75-e17f633ac09d None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 07:59:08.904000 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=100 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 07:59:08.912466 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eda8718-6780-4ba8-8416-fb5848ab2ecb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 07:59:08.913133 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eda8718-6780-4ba8-8416-fb5848ab2ecb None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 07:59:08.913405 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eda8718-6780-4ba8-8416-fb5848ab2ecb None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 07:59:08.913678 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eda8718-6780-4ba8-8416-fb5848ab2ecb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 07:59:08.914467 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eda8718-6780-4ba8-8416-fb5848ab2ecb None admin] RBAC: Adding query filter params (group.id=62a03a5df2bb4784abc8a0bd5def0e79, role.id=f28d669937b942878bcf6a9103012af9, scope.project.id=0f988f0c81614261ae36a6896770b2d0) {{(pid=80347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 07:59:08.914774 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eda8718-6780-4ba8-8416-fb5848ab2ecb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 07:59:08.916197 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eda8718-6780-4ba8-8416-fb5848ab2ecb None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 07:59:08.919196 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db442b5-699f-4013-a151-f9cb911b13e3 None admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 07:59:08.922181 dv-cinder-851351-1-smb devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 239/450] 10.222.0.42 () {56 vars in 1376 bytes} [Thu Jul 28 07:59:08 2022] GET /identity/v3/role_assignments?group.id=62a03a5df2bb4784abc8a0bd5def0e79&scope.project.id=0f988f0c81614261ae36a6896770b2d0&role.id=f28d669937b942878bcf6a9103012af9 => generated 611 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 07:59:08.963169 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a17a28a-d470-4657-8af6-205d013bf1cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 07:59:08.963722 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a17a28a-d470-4657-8af6-205d013bf1cc None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 07:59:08.963999 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a17a28a-d470-4657-8af6-205d013bf1cc None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 07:59:08.964268 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a17a28a-d470-4657-8af6-205d013bf1cc None admin] PATH_INFO: `/v3/roles` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 07:59:08.965050 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a17a28a-d470-4657-8af6-205d013bf1cc None admin] RBAC: Adding query filter params (name=admin) {{(pid=80348) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 07:59:08.965490 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a17a28a-d470-4657-8af6-205d013bf1cc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 07:59:08.966908 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a17a28a-d470-4657-8af6-205d013bf1cc None admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 07:59:08.976590 dv-cinder-851351-1-smb devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 212/451] 10.222.0.42 () {56 vars in 1099 bytes} [Thu Jul 28 07:59:08 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 07:59:08.982888 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eda8718-6780-4ba8-8416-fb5848ab2ecb None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 07:59:09.098362 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eda8718-6780-4ba8-8416-fb5848ab2ecb None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 07:59:09.136233 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b2d165-cfcb-4b70-861a-509085cf5544 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 07:59:09.136901 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b2d165-cfcb-4b70-861a-509085cf5544 None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 07:59:09.137220 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b2d165-cfcb-4b70-861a-509085cf5544 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 07:59:09.137489 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b2d165-cfcb-4b70-861a-509085cf5544 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 07:59:09.172329 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 07:59:09.213121 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49b2d165-cfcb-4b70-861a-509085cf5544 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 07:59:09.214700 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49b2d165-cfcb-4b70-861a-509085cf5544 None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 07:59:09.319869 dv-cinder-851351-1-smb devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 240/452] 10.222.0.42 () {58 vars in 1282 bytes} [Thu Jul 28 07:59:08 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 338 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 28 07:59:09.325810 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a17a28a-d470-4657-8af6-205d013bf1cc None admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 07:59:09.429118 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a17a28a-d470-4657-8af6-205d013bf1cc None admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 07:59:09.465096 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eed04f4-b5e9-40cc-aec6-deac7f12453d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 07:59:09.465803 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eed04f4-b5e9-40cc-aec6-deac7f12453d None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 07:59:09.465969 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eed04f4-b5e9-40cc-aec6-deac7f12453d None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 07:59:09.466242 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eed04f4-b5e9-40cc-aec6-deac7f12453d None admin] PATH_INFO: `/v3/projects/d51c90075a0545959e2ede68845ae91b` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 07:59:09.467482 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eed04f4-b5e9-40cc-aec6-deac7f12453d None admin] RBAC: Authorizing `identity:get_project(project_id=d51c90075a0545959e2ede68845ae91b)` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 07:59:09.468964 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eed04f4-b5e9-40cc-aec6-deac7f12453d None admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 07:59:09.470671 dv-cinder-851351-1-smb devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 213/453] 10.222.0.42 () {56 vars in 1186 bytes} [Thu Jul 28 07:59:09 2022] GET /identity/v3/projects/d51c90075a0545959e2ede68845ae91b => generated 344 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 07:59:09.476650 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b2d165-cfcb-4b70-861a-509085cf5544 None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 07:59:09.548397 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 07:59:09.588218 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b2d165-cfcb-4b70-861a-509085cf5544 None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 07:59:09.622602 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4853a7-989e-44b9-be1f-80809f3de066 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 07:59:09.623237 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4853a7-989e-44b9-be1f-80809f3de066 None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 07:59:09.623509 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4853a7-989e-44b9-be1f-80809f3de066 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 07:59:09.623776 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4853a7-989e-44b9-be1f-80809f3de066 None admin] PATH_INFO: `/v3/groups/9bf400d464c14a2c9216639cecb87c66` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 07:59:09.624988 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da4853a7-989e-44b9-be1f-80809f3de066 None admin] RBAC: Authorizing `identity:get_group(group_id=9bf400d464c14a2c9216639cecb87c66)` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 07:59:09.626414 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da4853a7-989e-44b9-be1f-80809f3de066 None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 07:59:09.628013 dv-cinder-851351-1-smb devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 241/454] 10.222.0.42 () {56 vars in 1180 bytes} [Thu Jul 28 07:59:09 2022] GET /identity/v3/groups/9bf400d464c14a2c9216639cecb87c66 => generated 229 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 07:59:09.634126 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eed04f4-b5e9-40cc-aec6-deac7f12453d None admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 07:59:09.653251 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=100 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 07:59:09.734989 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eed04f4-b5e9-40cc-aec6-deac7f12453d None admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 07:59:09.768674 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb19ec79-3137-4f4b-94d0-69ca113f6542 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 07:59:09.769304 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb19ec79-3137-4f4b-94d0-69ca113f6542 None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 07:59:09.769576 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb19ec79-3137-4f4b-94d0-69ca113f6542 None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 07:59:09.769839 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb19ec79-3137-4f4b-94d0-69ca113f6542 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 07:59:09.770628 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb19ec79-3137-4f4b-94d0-69ca113f6542 None admin] RBAC: Adding query filter params (group.id=9bf400d464c14a2c9216639cecb87c66, role.id=362bd71ac01249fb8fa635381993eec1, scope.project.id=d51c90075a0545959e2ede68845ae91b) {{(pid=80348) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 07:59:09.770923 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb19ec79-3137-4f4b-94d0-69ca113f6542 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 07:59:09.772340 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb19ec79-3137-4f4b-94d0-69ca113f6542 None admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 07:59:09.778331 dv-cinder-851351-1-smb devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 214/455] 10.222.0.42 () {56 vars in 1376 bytes} [Thu Jul 28 07:59:09 2022] GET /identity/v3/role_assignments?group.id=9bf400d464c14a2c9216639cecb87c66&scope.project.id=d51c90075a0545959e2ede68845ae91b&role.id=362bd71ac01249fb8fa635381993eec1 => generated 611 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 07:59:12.548879 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c230a52b-964a-4051-a0f5-0fea47314be6 None None] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 07:59:12.549649 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c230a52b-964a-4051-a0f5-0fea47314be6 None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 07:59:12.549649 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c230a52b-964a-4051-a0f5-0fea47314be6 None None] PATH_INFO: `/` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 07:59:12.550935 dv-cinder-851351-1-smb devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 242/456] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 07:59:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 07:59:12.555960 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4495a660-b035-42ac-bc14-d52856f5d7fd None None] REQUEST_METHOD: `POST` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 07:59:12.556802 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4495a660-b035-42ac-bc14-d52856f5d7fd None None] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 07:59:12.557284 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4495a660-b035-42ac-bc14-d52856f5d7fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 07:59:12.585679 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.auth.core [None req-4495a660-b035-42ac-bc14-d52856f5d7fd None None] MFA Rules not processed for user `f0666d3a50644a7097367331c1ee1a68`. Rule list: `[]` (Enabled: `True`). {{(pid=80348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 07:59:12.587300 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.fernet_utils [None req-4495a660-b035-42ac-bc14-d52856f5d7fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 07:59:12.681092 dv-cinder-851351-1-smb devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 215/457] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 07:59:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 28 07:59:12.705638 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c230a52b-964a-4051-a0f5-0fea47314be6 None None] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 07:59:12.761023 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581c5bcc-75af-43f4-8901-22577e843ddb None None] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 07:59:12.761651 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581c5bcc-75af-43f4-8901-22577e843ddb None None] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 07:59:12.762158 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581c5bcc-75af-43f4-8901-22577e843ddb None None] PATH_INFO: `/` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 07:59:12.763740 dv-cinder-851351-1-smb devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 216/458] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 07:59:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 28 07:59:12.768699 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2b74b0-23ae-4687-a998-c72f412b752a None None] REQUEST_METHOD: `POST` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 07:59:12.769254 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2b74b0-23ae-4687-a998-c72f412b752a None None] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 07:59:12.769718 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2b74b0-23ae-4687-a998-c72f412b752a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 07:59:12.801154 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.auth.core [None req-9e2b74b0-23ae-4687-a998-c72f412b752a None None] MFA Rules not processed for user `f0666d3a50644a7097367331c1ee1a68`. Rule list: `[]` (Enabled: `True`). {{(pid=80348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 07:59:12.805017 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.fernet_utils [None req-9e2b74b0-23ae-4687-a998-c72f412b752a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 07:59:12.813316 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=100 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 07:59:12.871659 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c230a52b-964a-4051-a0f5-0fea47314be6 None None] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 07:59:12.930988 dv-cinder-851351-1-smb devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 217/459] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 07:59:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 07:59:12.960560 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2b74b0-23ae-4687-a998-c72f412b752a None None] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 07:59:12.978591 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 07:59:12.987631 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f816ef18-e218-4cad-8719-1fadf448bbf4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 07:59:12.988796 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f816ef18-e218-4cad-8719-1fadf448bbf4 None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 07:59:12.989298 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f816ef18-e218-4cad-8719-1fadf448bbf4 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 07:59:12.989942 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f816ef18-e218-4cad-8719-1fadf448bbf4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 07:59:13.014994 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f816ef18-e218-4cad-8719-1fadf448bbf4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 07:59:13.019194 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f816ef18-e218-4cad-8719-1fadf448bbf4 None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 07:59:13.052439 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application [None req-f816ef18-e218-4cad-8719-1fadf448bbf4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 07:59:13.052439 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 07:59:13.052439 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 07:59:13.052439 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 07:59:13.052439 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 07:59:13.052439 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 07:59:13.052439 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 07:59:13.052439 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 07:59:13.052439 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 07:59:13.052439 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 07:59:13.052439 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 07:59:13.052439 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 07:59:13.052439 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 07:59:13.052439 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 07:59:13.052439 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 07:59:13.053509 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 07:59:13.053509 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 07:59:13.053509 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 07:59:13.053509 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 07:59:13.053509 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 07:59:13.053509 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 07:59:13.053509 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 07:59:13.053509 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 07:59:13.053509 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application with Lock( Jul 28 07:59:13.053509 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 07:59:13.053509 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._enter() Jul 28 07:59:13.053509 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 07:59:13.053509 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 07:59:13.053509 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 07:59:13.053509 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.creator() Jul 28 07:59:13.053509 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 07:59:13.053509 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application created_value = creator( Jul 28 07:59:13.054350 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 07:59:13.054350 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 07:59:13.054350 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 07:59:13.054350 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application Jul 28 07:59:13.056135 dv-cinder-851351-1-smb devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 243/460] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 07:59:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 351 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 07:59:13.057530 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1350c5aa-403c-4132-afc8-506e517522b1 None None] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 07:59:13.057969 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1350c5aa-403c-4132-afc8-506e517522b1 None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 07:59:13.058383 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1350c5aa-403c-4132-afc8-506e517522b1 None None] PATH_INFO: `/` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 07:59:13.060079 dv-cinder-851351-1-smb devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 244/461] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 07:59:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 07:59:13.064740 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1350c5aa-403c-4132-afc8-506e517522b1 None None] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 07:59:13.097077 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2b74b0-23ae-4687-a998-c72f412b752a None None] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 07:59:13.135003 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0a5506-979b-40b7-bd5d-3be315a89e74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 07:59:13.135661 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0a5506-979b-40b7-bd5d-3be315a89e74 None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 07:59:13.135952 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0a5506-979b-40b7-bd5d-3be315a89e74 None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 07:59:13.136227 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0a5506-979b-40b7-bd5d-3be315a89e74 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 07:59:13.145154 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=100 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 07:59:13.147554 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed0a5506-979b-40b7-bd5d-3be315a89e74 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 07:59:13.149115 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed0a5506-979b-40b7-bd5d-3be315a89e74 None admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 07:59:13.167550 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application [None req-ed0a5506-979b-40b7-bd5d-3be315a89e74 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 07:59:13.167550 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 07:59:13.167550 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 07:59:13.167550 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 07:59:13.167550 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 07:59:13.167550 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 07:59:13.167550 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 07:59:13.167550 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 07:59:13.167550 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 07:59:13.167550 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 07:59:13.167550 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 07:59:13.167550 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 07:59:13.167550 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 07:59:13.167550 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 07:59:13.167550 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 07:59:13.168742 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 07:59:13.168742 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 07:59:13.168742 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 07:59:13.168742 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 07:59:13.168742 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 07:59:13.168742 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 07:59:13.168742 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 07:59:13.168742 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 07:59:13.168742 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application with Lock( Jul 28 07:59:13.168742 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 07:59:13.168742 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self._enter() Jul 28 07:59:13.168742 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 07:59:13.168742 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 07:59:13.168742 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 07:59:13.168742 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.creator() Jul 28 07:59:13.168742 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 07:59:13.168742 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application created_value = creator( Jul 28 07:59:13.169779 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 07:59:13.169779 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 07:59:13.169779 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 07:59:13.169779 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application Jul 28 07:59:13.171884 dv-cinder-851351-1-smb devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 218/462] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 07:59:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 07:59:13.173430 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e64aed-e0d6-4218-b19d-c6cf3c76ea59 None None] REQUEST_METHOD: `POST` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 07:59:13.173901 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e64aed-e0d6-4218-b19d-c6cf3c76ea59 None None] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 07:59:13.174343 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e64aed-e0d6-4218-b19d-c6cf3c76ea59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 07:59:13.193133 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.auth.core [None req-b7e64aed-e0d6-4218-b19d-c6cf3c76ea59 None None] MFA Rules not processed for user `f0666d3a50644a7097367331c1ee1a68`. Rule list: `[]` (Enabled: `True`). {{(pid=80348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 07:59:13.193694 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1350c5aa-403c-4132-afc8-506e517522b1 None None] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 07:59:13.194991 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.fernet_utils [None req-b7e64aed-e0d6-4218-b19d-c6cf3c76ea59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 07:59:13.230556 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6850f6ef-ad62-4de8-b874-c76435bdabe7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 07:59:13.231247 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6850f6ef-ad62-4de8-b874-c76435bdabe7 None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 07:59:13.231528 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6850f6ef-ad62-4de8-b874-c76435bdabe7 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 07:59:13.231802 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6850f6ef-ad62-4de8-b874-c76435bdabe7 None admin] PATH_INFO: `/v3/domains` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 07:59:13.232499 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6850f6ef-ad62-4de8-b874-c76435bdabe7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 07:59:13.232843 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6850f6ef-ad62-4de8-b874-c76435bdabe7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 07:59:13.234213 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6850f6ef-ad62-4de8-b874-c76435bdabe7 None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 07:59:13.246547 dv-cinder-851351-1-smb devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 245/463] 10.222.0.42 () {56 vars in 1109 bytes} [Thu Jul 28 07:59:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 07:59:13.247659 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1493bc01-4ddc-45ca-b8ff-5099d339ee41 None None] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 07:59:13.247966 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1493bc01-4ddc-45ca-b8ff-5099d339ee41 None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 07:59:13.248234 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1493bc01-4ddc-45ca-b8ff-5099d339ee41 None None] PATH_INFO: `/` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 07:59:13.249971 dv-cinder-851351-1-smb devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 246/464] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 07:59:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 07:59:13.250845 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1493bc01-4ddc-45ca-b8ff-5099d339ee41 None None] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 07:59:13.271755 dv-cinder-851351-1-smb devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 219/465] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 07:59:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 07:59:13.272891 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e64aed-e0d6-4218-b19d-c6cf3c76ea59 None None] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 07:59:13.312962 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 07:59:13.375644 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1493bc01-4ddc-45ca-b8ff-5099d339ee41 None None] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 07:59:13.388162 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e64aed-e0d6-4218-b19d-c6cf3c76ea59 None None] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 07:59:13.410126 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a52297-ffff-4d04-953a-b74013bcb176 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 07:59:13.410758 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a52297-ffff-4d04-953a-b74013bcb176 None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 07:59:13.411037 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a52297-ffff-4d04-953a-b74013bcb176 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 07:59:13.411306 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a52297-ffff-4d04-953a-b74013bcb176 None admin] PATH_INFO: `/v3/domains` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 07:59:13.412003 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88a52297-ffff-4d04-953a-b74013bcb176 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 07:59:13.412305 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88a52297-ffff-4d04-953a-b74013bcb176 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 07:59:13.413621 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=100 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 07:59:13.413735 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88a52297-ffff-4d04-953a-b74013bcb176 None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 07:59:13.430901 dv-cinder-851351-1-smb devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 247/466] 10.222.0.42 () {56 vars in 1109 bytes} [Thu Jul 28 07:59:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 07:59:13.431095 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c358c27b-2cac-45c3-909c-2c4e05f8bec2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 07:59:13.431256 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6aeb7df-a280-4d8f-8256-0e48a27dc66a None None] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 07:59:13.431346 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c358c27b-2cac-45c3-909c-2c4e05f8bec2 None admin] REQUEST_METHOD: `POST` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 07:59:13.431427 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6aeb7df-a280-4d8f-8256-0e48a27dc66a None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 07:59:13.431506 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c358c27b-2cac-45c3-909c-2c4e05f8bec2 None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 07:59:13.431593 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6aeb7df-a280-4d8f-8256-0e48a27dc66a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 07:59:13.431683 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c358c27b-2cac-45c3-909c-2c4e05f8bec2 None admin] PATH_INFO: `/v3/users` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 07:59:13.431683 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c358c27b-2cac-45c3-909c-2c4e05f8bec2 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 07:59:13.431683 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c358c27b-2cac-45c3-909c-2c4e05f8bec2 None admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 07:59:13.449878 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.auth.core [None req-f6aeb7df-a280-4d8f-8256-0e48a27dc66a None None] MFA Rules not processed for user `f0666d3a50644a7097367331c1ee1a68`. Rule list: `[]` (Enabled: `True`). {{(pid=80347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 07:59:13.451081 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-f6aeb7df-a280-4d8f-8256-0e48a27dc66a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 07:59:13.456066 dv-cinder-851351-1-smb devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 220/467] 10.222.0.42 () {60 vars in 1132 bytes} [Thu Jul 28 07:59:13 2022] POST /identity/v3/users => generated 248 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 07:59:13.456901 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c358c27b-2cac-45c3-909c-2c4e05f8bec2 None admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 07:59:13.545283 dv-cinder-851351-1-smb devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 248/468] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 07:59:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 07:59:13.546463 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6aeb7df-a280-4d8f-8256-0e48a27dc66a None None] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 07:59:13.582917 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 07:59:13.603070 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c358c27b-2cac-45c3-909c-2c4e05f8bec2 None admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 07:59:13.650055 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc137cd-3ceb-4923-8818-fe0361c9f282 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 07:59:13.651010 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc137cd-3ceb-4923-8818-fe0361c9f282 None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 07:59:13.651583 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc137cd-3ceb-4923-8818-fe0361c9f282 None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 07:59:13.652021 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc137cd-3ceb-4923-8818-fe0361c9f282 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 07:59:13.667437 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdc137cd-3ceb-4923-8818-fe0361c9f282 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 07:59:13.669670 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdc137cd-3ceb-4923-8818-fe0361c9f282 None admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 07:59:13.680615 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6aeb7df-a280-4d8f-8256-0e48a27dc66a None None] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 07:59:13.687622 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application [None req-fdc137cd-3ceb-4923-8818-fe0361c9f282 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 07:59:13.687622 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 07:59:13.687622 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 07:59:13.687622 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 07:59:13.687622 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 07:59:13.687622 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 07:59:13.687622 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 07:59:13.687622 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 07:59:13.687622 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 07:59:13.687622 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 07:59:13.687622 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 07:59:13.687622 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 07:59:13.687622 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 07:59:13.687622 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 07:59:13.687622 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 07:59:13.688522 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 07:59:13.688522 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 07:59:13.688522 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 07:59:13.688522 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 07:59:13.688522 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 07:59:13.688522 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 07:59:13.688522 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 07:59:13.688522 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 07:59:13.688522 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application with Lock( Jul 28 07:59:13.688522 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 07:59:13.688522 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self._enter() Jul 28 07:59:13.688522 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 07:59:13.688522 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 07:59:13.688522 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 07:59:13.688522 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.creator() Jul 28 07:59:13.688522 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 07:59:13.688522 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application created_value = creator( Jul 28 07:59:13.689387 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 07:59:13.689387 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 07:59:13.689387 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 07:59:13.689387 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application Jul 28 07:59:13.689387 dv-cinder-851351-1-smb devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 221/469] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 07:59:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 07:59:13.690527 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc137cd-3ceb-4923-8818-fe0361c9f282 None admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 07:59:13.729250 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64fba5d9-9bcb-4e62-98c6-5d261fece6d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 07:59:13.729900 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64fba5d9-9bcb-4e62-98c6-5d261fece6d1 None admin] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 07:59:13.730160 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64fba5d9-9bcb-4e62-98c6-5d261fece6d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 07:59:13.730436 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64fba5d9-9bcb-4e62-98c6-5d261fece6d1 None admin] PATH_INFO: `/v3/users` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 07:59:13.731228 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64fba5d9-9bcb-4e62-98c6-5d261fece6d1 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 07:59:13.732749 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64fba5d9-9bcb-4e62-98c6-5d261fece6d1 None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 07:59:13.736312 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 07:59:13.759243 dv-cinder-851351-1-smb devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 249/470] 10.222.0.42 () {60 vars in 1132 bytes} [Thu Jul 28 07:59:13 2022] POST /identity/v3/users => generated 248 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 07:59:13.760056 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64fba5d9-9bcb-4e62-98c6-5d261fece6d1 None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 07:59:13.833325 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc137cd-3ceb-4923-8818-fe0361c9f282 None admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 07:59:13.890600 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 07:59:13.892581 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f53521c-6af1-429c-84be-e1117e59d3ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 07:59:13.893570 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f53521c-6af1-429c-84be-e1117e59d3ee None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 07:59:13.894323 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f53521c-6af1-429c-84be-e1117e59d3ee None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 07:59:13.895317 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f53521c-6af1-429c-84be-e1117e59d3ee None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 07:59:13.907512 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64fba5d9-9bcb-4e62-98c6-5d261fece6d1 None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 07:59:13.914389 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f53521c-6af1-429c-84be-e1117e59d3ee None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 07:59:13.916970 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f53521c-6af1-429c-84be-e1117e59d3ee None admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 07:59:13.937558 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application [None req-1f53521c-6af1-429c-84be-e1117e59d3ee None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 07:59:13.937558 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 07:59:13.937558 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 07:59:13.937558 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 07:59:13.937558 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 07:59:13.937558 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 07:59:13.937558 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 07:59:13.937558 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 07:59:13.937558 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 07:59:13.937558 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 07:59:13.937558 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 07:59:13.937558 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 07:59:13.937558 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 07:59:13.937558 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 07:59:13.937558 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 07:59:13.938480 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 07:59:13.938480 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 07:59:13.938480 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 07:59:13.938480 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 07:59:13.938480 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 07:59:13.938480 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 07:59:13.938480 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 07:59:13.938480 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 07:59:13.938480 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application with Lock( Jul 28 07:59:13.938480 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 07:59:13.938480 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self._enter() Jul 28 07:59:13.938480 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 07:59:13.938480 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 07:59:13.938480 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 07:59:13.938480 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.creator() Jul 28 07:59:13.938480 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 07:59:13.938480 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application created_value = creator( Jul 28 07:59:13.939414 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 07:59:13.939414 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 07:59:13.939414 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 07:59:13.939414 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application Jul 28 07:59:13.939414 dv-cinder-851351-1-smb devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 222/471] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 07:59:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 249 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 07:59:13.945348 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea5a5fd-e259-467b-9544-d9e4ba5ea30a None None] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 07:59:13.945629 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea5a5fd-e259-467b-9544-d9e4ba5ea30a None None] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 07:59:13.945909 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea5a5fd-e259-467b-9544-d9e4ba5ea30a None None] PATH_INFO: `/` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 07:59:13.947611 dv-cinder-851351-1-smb devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 223/472] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 07:59:13 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 07:59:13.948361 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea5a5fd-e259-467b-9544-d9e4ba5ea30a None None] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 07:59:13.959806 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3451ff4d-8089-44ce-b704-067115eefd4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 07:59:13.960451 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3451ff4d-8089-44ce-b704-067115eefd4c None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 07:59:13.961139 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3451ff4d-8089-44ce-b704-067115eefd4c None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 07:59:13.961415 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3451ff4d-8089-44ce-b704-067115eefd4c None admin] PATH_INFO: `/v3/domains` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 07:59:13.962436 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3451ff4d-8089-44ce-b704-067115eefd4c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 07:59:13.962746 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3451ff4d-8089-44ce-b704-067115eefd4c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 07:59:13.964295 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3451ff4d-8089-44ce-b704-067115eefd4c None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 07:59:13.977964 dv-cinder-851351-1-smb devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 250/473] 10.222.0.42 () {56 vars in 1109 bytes} [Thu Jul 28 07:59:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 07:59:13.978960 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4586851-24c9-4472-aac8-08844091c357 None None] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 07:59:13.979243 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4586851-24c9-4472-aac8-08844091c357 None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 07:59:13.979518 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4586851-24c9-4472-aac8-08844091c357 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 07:59:13.999949 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.auth.core [None req-d4586851-24c9-4472-aac8-08844091c357 None None] MFA Rules not processed for user `f0666d3a50644a7097367331c1ee1a68`. Rule list: `[]` (Enabled: `True`). {{(pid=80347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 07:59:14.001227 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-d4586851-24c9-4472-aac8-08844091c357 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 07:59:14.062802 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=100 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 07:59:14.080869 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea5a5fd-e259-467b-9544-d9e4ba5ea30a None None] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 07:59:14.091651 dv-cinder-851351-1-smb devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 251/474] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 07:59:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 07:59:14.092918 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4586851-24c9-4472-aac8-08844091c357 None None] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 07:59:14.144697 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcafa639-13f9-4237-a285-68e98b92d73a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 07:59:14.145387 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcafa639-13f9-4237-a285-68e98b92d73a None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 07:59:14.145669 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcafa639-13f9-4237-a285-68e98b92d73a None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 07:59:14.145995 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcafa639-13f9-4237-a285-68e98b92d73a None admin] PATH_INFO: `/v3/domains` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 07:59:14.146800 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcafa639-13f9-4237-a285-68e98b92d73a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80348) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 07:59:14.147111 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcafa639-13f9-4237-a285-68e98b92d73a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 07:59:14.149336 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcafa639-13f9-4237-a285-68e98b92d73a None admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 07:59:14.175455 dv-cinder-851351-1-smb devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 224/475] 10.222.0.42 () {56 vars in 1109 bytes} [Thu Jul 28 07:59:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 07:59:14.176310 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcafa639-13f9-4237-a285-68e98b92d73a None admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 07:59:14.210091 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 07:59:14.239796 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4586851-24c9-4472-aac8-08844091c357 None None] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 07:59:14.284907 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24016df-8cfd-4f37-b876-1e512f408e28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 07:59:14.285678 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24016df-8cfd-4f37-b876-1e512f408e28 None admin] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 07:59:14.285786 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24016df-8cfd-4f37-b876-1e512f408e28 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 07:59:14.286061 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24016df-8cfd-4f37-b876-1e512f408e28 None admin] PATH_INFO: `/v3/users` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 07:59:14.286748 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a24016df-8cfd-4f37-b876-1e512f408e28 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 07:59:14.288197 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a24016df-8cfd-4f37-b876-1e512f408e28 None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 07:59:14.303891 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcafa639-13f9-4237-a285-68e98b92d73a None admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 07:59:14.315502 dv-cinder-851351-1-smb devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 252/476] 10.222.0.42 () {60 vars in 1132 bytes} [Thu Jul 28 07:59:14 2022] POST /identity/v3/users => generated 246 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 07:59:14.316710 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24016df-8cfd-4f37-b876-1e512f408e28 None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 07:59:14.345271 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-588fb3dc-9f10-4ede-9ab9-11916189dd68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 07:59:14.345862 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588fb3dc-9f10-4ede-9ab9-11916189dd68 None admin] REQUEST_METHOD: `POST` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 07:59:14.346223 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588fb3dc-9f10-4ede-9ab9-11916189dd68 None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 07:59:14.346593 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588fb3dc-9f10-4ede-9ab9-11916189dd68 None admin] PATH_INFO: `/v3/roles` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 07:59:14.347505 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-588fb3dc-9f10-4ede-9ab9-11916189dd68 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 07:59:14.349348 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-588fb3dc-9f10-4ede-9ab9-11916189dd68 None admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 07:59:14.360213 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.sql.core [None req-588fb3dc-9f10-4ede-9ab9-11916189dd68 None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jul 28 07:59:14.360213 dv-cinder-851351-1-smb devstack@keystone.service[80348]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Jul 28 07:59:14.360213 dv-cinder-851351-1-smb devstack@keystone.service[80348]: [parameters: {'id': 'b4585518d663411181015ba2fc5f3731', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Jul 28 07:59:14.360213 dv-cinder-851351-1-smb devstack@keystone.service[80348]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80348) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jul 28 07:59:14.378294 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application [None req-588fb3dc-9f10-4ede-9ab9-11916189dd68 None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Jul 28 07:59:14.378294 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 07:59:14.378294 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 28 07:59:14.378294 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 28 07:59:14.378294 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 28 07:59:14.378294 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 28 07:59:14.378294 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 28 07:59:14.378294 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application result = self._query(query) Jul 28 07:59:14.378294 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 28 07:59:14.378294 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application conn.query(q) Jul 28 07:59:14.378294 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 28 07:59:14.378294 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 28 07:59:14.378294 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 28 07:59:14.378294 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application result.read() Jul 28 07:59:14.378294 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 28 07:59:14.379422 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 28 07:59:14.379422 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 28 07:59:14.379422 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 28 07:59:14.379422 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 28 07:59:14.379422 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 28 07:59:14.379422 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 28 07:59:14.379422 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 28 07:59:14.379422 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jul 28 07:59:14.379422 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application Jul 28 07:59:14.379422 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jul 28 07:59:14.379422 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application Jul 28 07:59:14.379422 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 07:59:14.379422 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jul 28 07:59:14.379422 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jul 28 07:59:14.379422 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role Jul 28 07:59:14.379422 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return ref.to_dict() Jul 28 07:59:14.379422 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 28 07:59:14.379422 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application next(self.gen) Jul 28 07:59:14.380492 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jul 28 07:59:14.380492 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application yield resource Jul 28 07:59:14.380492 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 28 07:59:14.380492 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application next(self.gen) Jul 28 07:59:14.380492 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jul 28 07:59:14.380492 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application self.session.rollback() Jul 28 07:59:14.380492 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 28 07:59:14.380492 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application self.force_reraise() Jul 28 07:59:14.380492 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 28 07:59:14.380492 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application raise self.value Jul 28 07:59:14.380492 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jul 28 07:59:14.380492 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jul 28 07:59:14.380492 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jul 28 07:59:14.380492 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application session.commit() Jul 28 07:59:14.380492 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jul 28 07:59:14.380492 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jul 28 07:59:14.380492 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jul 28 07:59:14.381568 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application self._prepare_impl() Jul 28 07:59:14.381568 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jul 28 07:59:14.381568 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application self.session.flush() Jul 28 07:59:14.381568 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jul 28 07:59:14.381568 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application self._flush(objects) Jul 28 07:59:14.381568 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jul 28 07:59:14.381568 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jul 28 07:59:14.381568 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jul 28 07:59:14.381568 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application compat.raise_( Jul 28 07:59:14.381568 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 28 07:59:14.381568 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application raise exception Jul 28 07:59:14.381568 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jul 28 07:59:14.381568 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application flush_context.execute() Jul 28 07:59:14.381568 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jul 28 07:59:14.381568 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application rec.execute(self) Jul 28 07:59:14.381568 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jul 28 07:59:14.381568 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jul 28 07:59:14.382599 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jul 28 07:59:14.382599 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application _emit_insert_statements( Jul 28 07:59:14.382599 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Jul 28 07:59:14.382599 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application c = connection._execute_20( Jul 28 07:59:14.382599 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jul 28 07:59:14.382599 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jul 28 07:59:14.382599 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Jul 28 07:59:14.382599 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jul 28 07:59:14.382599 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jul 28 07:59:14.382599 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application ret = self._execute_context( Jul 28 07:59:14.382599 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jul 28 07:59:14.382599 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jul 28 07:59:14.382599 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jul 28 07:59:14.382599 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jul 28 07:59:14.382599 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 28 07:59:14.382599 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application raise exception Jul 28 07:59:14.383642 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 28 07:59:14.383642 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 28 07:59:14.383642 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 28 07:59:14.383642 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 28 07:59:14.383642 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 28 07:59:14.383642 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application result = self._query(query) Jul 28 07:59:14.383642 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 28 07:59:14.383642 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application conn.query(q) Jul 28 07:59:14.383642 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 28 07:59:14.383642 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 28 07:59:14.383642 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 28 07:59:14.383642 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application result.read() Jul 28 07:59:14.383642 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 28 07:59:14.383642 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 28 07:59:14.383642 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 28 07:59:14.383642 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 28 07:59:14.384580 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 28 07:59:14.384580 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 28 07:59:14.384580 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 28 07:59:14.384580 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 28 07:59:14.384580 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jul 28 07:59:14.384580 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Jul 28 07:59:14.384580 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application [parameters: {'id': 'b4585518d663411181015ba2fc5f3731', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Jul 28 07:59:14.384580 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jul 28 07:59:14.384580 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application Jul 28 07:59:14.384580 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 28 07:59:14.384580 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application Jul 28 07:59:14.384580 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 07:59:14.384580 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 07:59:14.384580 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 07:59:14.384580 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 07:59:14.384580 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 07:59:14.385550 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 07:59:14.385550 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 07:59:14.385550 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 07:59:14.385550 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 07:59:14.385550 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 07:59:14.385550 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 07:59:14.385550 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post Jul 28 07:59:14.385550 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( Jul 28 07:59:14.385550 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 07:59:14.385550 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 07:59:14.385550 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role Jul 28 07:59:14.385550 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) Jul 28 07:59:14.385550 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jul 28 07:59:14.385550 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jul 28 07:59:14.385550 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Jul 28 07:59:14.385550 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application Jul 28 07:59:14.388083 dv-cinder-851351-1-smb devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 225/477] 10.222.0.42 () {60 vars in 1131 bytes} [Thu Jul 28 07:59:14 2022] POST /identity/v3/roles => generated 144 bytes in 212 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Jul 28 07:59:14.397957 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-588fb3dc-9f10-4ede-9ab9-11916189dd68 None admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 07:59:14.411449 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 07:59:14.469639 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24016df-8cfd-4f37-b876-1e512f408e28 None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 07:59:14.553337 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9174aa43-62bf-4618-940d-bc020f7a41cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 07:59:14.555524 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9174aa43-62bf-4618-940d-bc020f7a41cd None admin] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 07:59:14.556249 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9174aa43-62bf-4618-940d-bc020f7a41cd None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 07:59:14.558147 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9174aa43-62bf-4618-940d-bc020f7a41cd None admin] PATH_INFO: `/v3/users` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 07:59:14.559152 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9174aa43-62bf-4618-940d-bc020f7a41cd None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 07:59:14.561111 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9174aa43-62bf-4618-940d-bc020f7a41cd None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 07:59:14.575675 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 07:59:14.581874 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-588fb3dc-9f10-4ede-9ab9-11916189dd68 None admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 07:59:14.602748 dv-cinder-851351-1-smb devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 253/478] 10.222.0.42 () {60 vars in 1132 bytes} [Thu Jul 28 07:59:14 2022] POST /identity/v3/users => generated 249 bytes in 286 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 07:59:14.627791 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b83404-8061-4ff8-90b4-3d57ebb81e3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 07:59:14.629268 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b83404-8061-4ff8-90b4-3d57ebb81e3c None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 07:59:14.629778 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b83404-8061-4ff8-90b4-3d57ebb81e3c None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 07:59:14.630293 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b83404-8061-4ff8-90b4-3d57ebb81e3c None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 07:59:14.643957 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59b83404-8061-4ff8-90b4-3d57ebb81e3c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 07:59:14.650035 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application [None req-59b83404-8061-4ff8-90b4-3d57ebb81e3c None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 28 07:59:14.650035 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 07:59:14.650035 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 07:59:14.650035 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 07:59:14.650035 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 07:59:14.650035 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 07:59:14.650035 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 07:59:14.650035 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 07:59:14.650035 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 07:59:14.650035 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 07:59:14.650035 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 07:59:14.650035 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 07:59:14.650035 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 07:59:14.650035 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 07:59:14.650035 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 07:59:14.650035 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 07:59:14.650968 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 07:59:14.650968 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 07:59:14.650968 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 07:59:14.650968 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 07:59:14.650968 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 07:59:14.650968 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 07:59:14.650968 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 07:59:14.650968 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 07:59:14.650968 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 07:59:14.650968 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 07:59:14.650968 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 07:59:14.650968 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application with Lock( Jul 28 07:59:14.650968 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 07:59:14.650968 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self._enter() Jul 28 07:59:14.650968 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 07:59:14.650968 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 07:59:14.651735 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 07:59:14.651735 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.creator() Jul 28 07:59:14.651735 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 07:59:14.651735 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application created_value = creator( Jul 28 07:59:14.651735 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 07:59:14.651735 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 07:59:14.651735 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 07:59:14.651735 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 07:59:14.651735 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 07:59:14.651735 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 07:59:14.651735 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 28 07:59:14.651735 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application Jul 28 07:59:14.654563 dv-cinder-851351-1-smb devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 226/479] 10.222.0.42 () {56 vars in 1114 bytes} [Thu Jul 28 07:59:14 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 257 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 07:59:14.660786 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9174aa43-62bf-4618-940d-bc020f7a41cd None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 07:59:14.802674 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9174aa43-62bf-4618-940d-bc020f7a41cd None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 07:59:14.844399 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-417c9fc8-4f66-4089-b4c3-b267e8db6cc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 07:59:14.845423 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417c9fc8-4f66-4089-b4c3-b267e8db6cc6 None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 07:59:14.845873 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417c9fc8-4f66-4089-b4c3-b267e8db6cc6 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 07:59:14.846336 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417c9fc8-4f66-4089-b4c3-b267e8db6cc6 None admin] PATH_INFO: `/v3/roles` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 07:59:14.847236 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-417c9fc8-4f66-4089-b4c3-b267e8db6cc6 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 07:59:14.847707 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-417c9fc8-4f66-4089-b4c3-b267e8db6cc6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 07:59:14.849311 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-417c9fc8-4f66-4089-b4c3-b267e8db6cc6 None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 07:59:14.859988 dv-cinder-851351-1-smb devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 254/480] 10.222.0.42 () {56 vars in 1111 bytes} [Thu Jul 28 07:59:14 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 07:59:15.822105 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abee132e-c9e0-4c58-8842-d71a7adcc909 None None] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 07:59:15.823366 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abee132e-c9e0-4c58-8842-d71a7adcc909 None None] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 07:59:15.823897 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abee132e-c9e0-4c58-8842-d71a7adcc909 None None] PATH_INFO: `/` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 07:59:15.825848 dv-cinder-851351-1-smb devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 227/481] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 07:59:15 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 07:59:15.832707 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed36cbc-7f78-43a9-bb2b-a2d5584046d7 None None] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 07:59:15.833661 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed36cbc-7f78-43a9-bb2b-a2d5584046d7 None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 07:59:15.834124 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed36cbc-7f78-43a9-bb2b-a2d5584046d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 07:59:15.860484 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.auth.core [None req-6ed36cbc-7f78-43a9-bb2b-a2d5584046d7 None None] MFA Rules not processed for user `f0666d3a50644a7097367331c1ee1a68`. Rule list: `[]` (Enabled: `True`). {{(pid=80347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 07:59:15.862037 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-6ed36cbc-7f78-43a9-bb2b-a2d5584046d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 07:59:15.928035 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 07:59:15.958518 dv-cinder-851351-1-smb devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 255/482] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 07:59:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 28 07:59:15.993494 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abee132e-c9e0-4c58-8842-d71a7adcc909 None None] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 07:59:16.090759 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=100 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 07:59:16.137476 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d791987-eb2f-4601-a5d5-cfdc3329702d None None] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 07:59:16.137819 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d791987-eb2f-4601-a5d5-cfdc3329702d None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 07:59:16.138018 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d791987-eb2f-4601-a5d5-cfdc3329702d None None] PATH_INFO: `/` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 07:59:16.139423 dv-cinder-851351-1-smb devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 256/483] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 07:59:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 07:59:16.145317 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642fddcc-09a3-4608-8a4f-cb5040a76373 None None] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 07:59:16.145623 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642fddcc-09a3-4608-8a4f-cb5040a76373 None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 07:59:16.145872 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642fddcc-09a3-4608-8a4f-cb5040a76373 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 07:59:16.148926 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abee132e-c9e0-4c58-8842-d71a7adcc909 None None] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 07:59:16.177523 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.auth.core [None req-642fddcc-09a3-4608-8a4f-cb5040a76373 None None] MFA Rules not processed for user `f0666d3a50644a7097367331c1ee1a68`. Rule list: `[]` (Enabled: `True`). {{(pid=80347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 07:59:16.178721 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-642fddcc-09a3-4608-8a4f-cb5040a76373 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 07:59:16.215196 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4761efe-d894-42e0-a4e0-7c582a5207d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 07:59:16.215869 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4761efe-d894-42e0-a4e0-7c582a5207d1 None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 07:59:16.216142 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4761efe-d894-42e0-a4e0-7c582a5207d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 07:59:16.216411 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4761efe-d894-42e0-a4e0-7c582a5207d1 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 07:59:16.236706 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4761efe-d894-42e0-a4e0-7c582a5207d1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 07:59:16.242097 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application [None req-f4761efe-d894-42e0-a4e0-7c582a5207d1 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 28 07:59:16.242097 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 07:59:16.242097 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 07:59:16.242097 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 07:59:16.242097 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 07:59:16.242097 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 07:59:16.242097 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 07:59:16.242097 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 07:59:16.242097 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 07:59:16.242097 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 07:59:16.242097 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 07:59:16.242097 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 07:59:16.242097 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 07:59:16.242097 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 07:59:16.242097 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 07:59:16.242097 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 07:59:16.242948 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 07:59:16.242948 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 07:59:16.242948 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 07:59:16.242948 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 07:59:16.242948 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 07:59:16.242948 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 07:59:16.242948 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 07:59:16.242948 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 07:59:16.242948 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 07:59:16.242948 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 07:59:16.242948 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 07:59:16.242948 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application with Lock( Jul 28 07:59:16.242948 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 07:59:16.242948 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self._enter() Jul 28 07:59:16.242948 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 07:59:16.242948 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 07:59:16.243720 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 07:59:16.243720 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.creator() Jul 28 07:59:16.243720 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 07:59:16.243720 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application created_value = creator( Jul 28 07:59:16.243720 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 07:59:16.243720 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 07:59:16.243720 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 07:59:16.243720 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 07:59:16.243720 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 07:59:16.243720 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 07:59:16.243720 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 28 07:59:16.243720 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application Jul 28 07:59:16.244330 dv-cinder-851351-1-smb devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 228/484] 10.222.0.42 () {56 vars in 1102 bytes} [Thu Jul 28 07:59:15 2022] GET /identity/v3/roles/service => generated 85 bytes in 251 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 07:59:16.251953 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4761efe-d894-42e0-a4e0-7c582a5207d1 None admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 07:59:16.322294 dv-cinder-851351-1-smb devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 257/485] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 07:59:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 28 07:59:16.345981 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642fddcc-09a3-4608-8a4f-cb5040a76373 None None] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 07:59:16.459087 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4761efe-d894-42e0-a4e0-7c582a5207d1 None admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 07:59:16.517308 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=100 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 07:59:16.533759 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd12fac-7065-4c93-bc6f-0c858162b05d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 07:59:16.534394 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd12fac-7065-4c93-bc6f-0c858162b05d None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 07:59:16.534676 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd12fac-7065-4c93-bc6f-0c858162b05d None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 07:59:16.534954 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd12fac-7065-4c93-bc6f-0c858162b05d None admin] PATH_INFO: `/v3/roles` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 07:59:16.535725 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efd12fac-7065-4c93-bc6f-0c858162b05d None admin] RBAC: Adding query filter params (name=service) {{(pid=80348) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 07:59:16.536038 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efd12fac-7065-4c93-bc6f-0c858162b05d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 07:59:16.537481 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efd12fac-7065-4c93-bc6f-0c858162b05d None admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 07:59:16.548333 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642fddcc-09a3-4608-8a4f-cb5040a76373 None None] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 07:59:16.562047 dv-cinder-851351-1-smb devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 229/486] 10.222.0.42 () {56 vars in 1103 bytes} [Thu Jul 28 07:59:16 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 313 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 07:59:16.567698 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd12fac-7065-4c93-bc6f-0c858162b05d None admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 07:59:16.578730 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 07:59:16.621636 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5929c066-b595-4fe8-840f-e7e99892762f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 07:59:16.622232 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5929c066-b595-4fe8-840f-e7e99892762f None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 07:59:16.622598 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5929c066-b595-4fe8-840f-e7e99892762f None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 07:59:16.622874 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5929c066-b595-4fe8-840f-e7e99892762f None admin] PATH_INFO: `/v3/roles/service` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 07:59:16.652932 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5929c066-b595-4fe8-840f-e7e99892762f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 07:59:16.670660 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application [None req-5929c066-b595-4fe8-840f-e7e99892762f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 28 07:59:16.670660 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 07:59:16.670660 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 07:59:16.670660 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 07:59:16.670660 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 07:59:16.670660 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 07:59:16.670660 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 07:59:16.670660 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 07:59:16.670660 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 07:59:16.670660 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 07:59:16.670660 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 07:59:16.670660 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 07:59:16.670660 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 07:59:16.670660 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 07:59:16.670660 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 07:59:16.670660 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 07:59:16.671644 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 07:59:16.671644 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 07:59:16.671644 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 07:59:16.671644 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 07:59:16.671644 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 07:59:16.671644 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 07:59:16.671644 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 07:59:16.671644 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 07:59:16.671644 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 07:59:16.671644 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 07:59:16.671644 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 07:59:16.671644 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application with Lock( Jul 28 07:59:16.671644 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 07:59:16.671644 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._enter() Jul 28 07:59:16.671644 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 07:59:16.671644 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 07:59:16.672426 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 07:59:16.672426 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.creator() Jul 28 07:59:16.672426 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 07:59:16.672426 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application created_value = creator( Jul 28 07:59:16.672426 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 07:59:16.672426 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 07:59:16.672426 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 07:59:16.672426 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 07:59:16.672426 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 07:59:16.672426 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 07:59:16.672426 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 28 07:59:16.672426 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application Jul 28 07:59:16.683658 dv-cinder-851351-1-smb devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 258/487] 10.222.0.42 () {56 vars in 1102 bytes} [Thu Jul 28 07:59:16 2022] GET /identity/v3/roles/service => generated 85 bytes in 338 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 07:59:16.690064 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5929c066-b595-4fe8-840f-e7e99892762f None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 07:59:16.814932 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd12fac-7065-4c93-bc6f-0c858162b05d None admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 07:59:16.883311 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5929c066-b595-4fe8-840f-e7e99892762f None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 07:59:16.884650 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f1c2f2-befb-4e2a-a860-23c510f60dd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 07:59:16.885394 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f1c2f2-befb-4e2a-a860-23c510f60dd7 None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 07:59:16.885734 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f1c2f2-befb-4e2a-a860-23c510f60dd7 None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 07:59:16.886066 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f1c2f2-befb-4e2a-a860-23c510f60dd7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 07:59:16.906608 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97f1c2f2-befb-4e2a-a860-23c510f60dd7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 07:59:16.908930 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97f1c2f2-befb-4e2a-a860-23c510f60dd7 None admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 07:59:16.936743 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application [None req-97f1c2f2-befb-4e2a-a860-23c510f60dd7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 07:59:16.936743 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 07:59:16.936743 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 07:59:16.936743 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 07:59:16.936743 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 07:59:16.936743 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 07:59:16.936743 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 07:59:16.936743 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 07:59:16.936743 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 07:59:16.936743 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 07:59:16.936743 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 07:59:16.936743 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 07:59:16.936743 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 07:59:16.936743 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 07:59:16.936743 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 07:59:16.937635 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 07:59:16.937635 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 07:59:16.937635 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 07:59:16.937635 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 07:59:16.937635 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 07:59:16.937635 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 07:59:16.937635 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 07:59:16.937635 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 07:59:16.937635 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application with Lock( Jul 28 07:59:16.937635 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 07:59:16.937635 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self._enter() Jul 28 07:59:16.937635 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 07:59:16.937635 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 07:59:16.937635 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 07:59:16.937635 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.creator() Jul 28 07:59:16.937635 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 07:59:16.937635 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application created_value = creator( Jul 28 07:59:16.938472 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 07:59:16.938472 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 07:59:16.938472 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 07:59:16.938472 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application Jul 28 07:59:16.939120 dv-cinder-851351-1-smb devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 230/488] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 07:59:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 372 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 07:59:16.943488 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f1c2f2-befb-4e2a-a860-23c510f60dd7 None admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 07:59:16.951444 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eff4063-110c-4e24-b967-0aed979bd708 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 07:59:16.952072 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eff4063-110c-4e24-b967-0aed979bd708 None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 07:59:16.952344 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eff4063-110c-4e24-b967-0aed979bd708 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 07:59:16.952606 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eff4063-110c-4e24-b967-0aed979bd708 None admin] PATH_INFO: `/v3/roles` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 07:59:16.953366 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eff4063-110c-4e24-b967-0aed979bd708 None admin] RBAC: Adding query filter params (name=service) {{(pid=80347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 07:59:16.953681 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eff4063-110c-4e24-b967-0aed979bd708 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 07:59:16.955411 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eff4063-110c-4e24-b967-0aed979bd708 None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 07:59:16.974364 dv-cinder-851351-1-smb devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 259/489] 10.222.0.42 () {56 vars in 1103 bytes} [Thu Jul 28 07:59:16 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 285 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 07:59:16.980804 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eff4063-110c-4e24-b967-0aed979bd708 None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 07:59:17.022424 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=100 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 07:59:17.026368 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 07:59:17.096003 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f1c2f2-befb-4e2a-a860-23c510f60dd7 None admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 07:59:17.114006 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eff4063-110c-4e24-b967-0aed979bd708 None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 07:59:17.132530 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30cd4415-68c7-4925-a2c6-692e65c75e73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 07:59:17.133471 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30cd4415-68c7-4925-a2c6-692e65c75e73 None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 07:59:17.133784 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30cd4415-68c7-4925-a2c6-692e65c75e73 None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 07:59:17.134158 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30cd4415-68c7-4925-a2c6-692e65c75e73 None admin] PATH_INFO: `/v3/domains` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 07:59:17.134975 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30cd4415-68c7-4925-a2c6-692e65c75e73 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80348) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 07:59:17.135377 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30cd4415-68c7-4925-a2c6-692e65c75e73 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 07:59:17.136958 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30cd4415-68c7-4925-a2c6-692e65c75e73 None admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 07:59:17.154567 dv-cinder-851351-1-smb devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 231/490] 10.222.0.42 () {56 vars in 1109 bytes} [Thu Jul 28 07:59:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 07:59:17.156182 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfbff42a-8123-4f9e-8b2e-74cf5995d6ad None None] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 07:59:17.156544 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfbff42a-8123-4f9e-8b2e-74cf5995d6ad None None] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 07:59:17.156915 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfbff42a-8123-4f9e-8b2e-74cf5995d6ad None None] PATH_INFO: `/` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 07:59:17.160033 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbafee8e-121c-48c9-83a6-2e26d81b2966 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 07:59:17.160922 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbafee8e-121c-48c9-83a6-2e26d81b2966 None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 07:59:17.161377 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbafee8e-121c-48c9-83a6-2e26d81b2966 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 07:59:17.161797 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbafee8e-121c-48c9-83a6-2e26d81b2966 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 07:59:17.163002 dv-cinder-851351-1-smb devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 232/491] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 07:59:17 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 07:59:17.163897 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfbff42a-8123-4f9e-8b2e-74cf5995d6ad None None] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 07:59:17.176168 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbafee8e-121c-48c9-83a6-2e26d81b2966 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 07:59:17.177770 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbafee8e-121c-48c9-83a6-2e26d81b2966 None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 07:59:17.194308 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application [None req-dbafee8e-121c-48c9-83a6-2e26d81b2966 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 07:59:17.194308 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 07:59:17.194308 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 07:59:17.194308 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 07:59:17.194308 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 07:59:17.194308 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 07:59:17.194308 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 07:59:17.194308 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 07:59:17.194308 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 07:59:17.194308 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 07:59:17.194308 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 07:59:17.194308 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 07:59:17.194308 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 07:59:17.194308 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 07:59:17.194308 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 07:59:17.195353 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 07:59:17.195353 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 07:59:17.195353 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 07:59:17.195353 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 07:59:17.195353 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 07:59:17.195353 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 07:59:17.195353 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 07:59:17.195353 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 07:59:17.195353 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application with Lock( Jul 28 07:59:17.195353 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 07:59:17.195353 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._enter() Jul 28 07:59:17.195353 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 07:59:17.195353 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 07:59:17.195353 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 07:59:17.195353 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.creator() Jul 28 07:59:17.195353 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 07:59:17.195353 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application created_value = creator( Jul 28 07:59:17.196372 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 07:59:17.196372 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 07:59:17.196372 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 07:59:17.196372 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application Jul 28 07:59:17.198650 dv-cinder-851351-1-smb devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 260/492] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 07:59:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 07:59:17.200564 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d819a59-746c-415b-a2f9-d91c0528dc6f None None] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 07:59:17.200951 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d819a59-746c-415b-a2f9-d91c0528dc6f None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 07:59:17.201295 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d819a59-746c-415b-a2f9-d91c0528dc6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 07:59:17.221332 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.auth.core [None req-1d819a59-746c-415b-a2f9-d91c0528dc6f None None] MFA Rules not processed for user `f0666d3a50644a7097367331c1ee1a68`. Rule list: `[]` (Enabled: `True`). {{(pid=80347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 07:59:17.222637 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-1d819a59-746c-415b-a2f9-d91c0528dc6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 07:59:17.295524 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=100 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 07:59:17.302104 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfbff42a-8123-4f9e-8b2e-74cf5995d6ad None None] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 07:59:17.308800 dv-cinder-851351-1-smb devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 261/493] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 07:59:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 07:59:17.310032 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d819a59-746c-415b-a2f9-d91c0528dc6f None None] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 07:59:17.347241 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 07:59:17.349985 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c2d4a1-d489-4308-a567-452a3e4cf518 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 07:59:17.350909 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c2d4a1-d489-4308-a567-452a3e4cf518 None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 07:59:17.351358 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c2d4a1-d489-4308-a567-452a3e4cf518 None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 07:59:17.351907 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c2d4a1-d489-4308-a567-452a3e4cf518 None admin] PATH_INFO: `/v3/users/glance` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 07:59:17.362777 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c2d4a1-d489-4308-a567-452a3e4cf518 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 07:59:17.365371 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c2d4a1-d489-4308-a567-452a3e4cf518 None admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 07:59:17.387792 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application [None req-58c2d4a1-d489-4308-a567-452a3e4cf518 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jul 28 07:59:17.387792 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 07:59:17.387792 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 07:59:17.387792 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 07:59:17.387792 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 07:59:17.387792 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 07:59:17.387792 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 07:59:17.387792 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 07:59:17.387792 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 07:59:17.387792 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 07:59:17.387792 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 07:59:17.387792 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 07:59:17.387792 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 28 07:59:17.387792 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 28 07:59:17.387792 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 28 07:59:17.387792 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 28 07:59:17.388772 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 07:59:17.388772 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 07:59:17.388772 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 28 07:59:17.388772 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 07:59:17.388772 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 28 07:59:17.388772 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 07:59:17.388772 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 07:59:17.388772 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 07:59:17.388772 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 07:59:17.388772 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 07:59:17.388772 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 07:59:17.388772 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application with Lock( Jul 28 07:59:17.388772 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 07:59:17.388772 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self._enter() Jul 28 07:59:17.388772 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 07:59:17.388772 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 07:59:17.388772 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 07:59:17.388772 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.creator() Jul 28 07:59:17.389657 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 07:59:17.389657 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application created_value = creator( Jul 28 07:59:17.389657 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 28 07:59:17.389657 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 28 07:59:17.389657 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 28 07:59:17.389657 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 28 07:59:17.389657 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 28 07:59:17.389657 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 28 07:59:17.389657 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jul 28 07:59:17.389657 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application Jul 28 07:59:17.389657 dv-cinder-851351-1-smb devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 233/494] 10.222.0.42 () {56 vars in 1099 bytes} [Thu Jul 28 07:59:17 2022] GET /identity/v3/users/glance => generated 84 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 07:59:17.390246 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c2d4a1-d489-4308-a567-452a3e4cf518 None admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 07:59:17.458878 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d819a59-746c-415b-a2f9-d91c0528dc6f None None] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 07:59:17.499251 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e277981e-f245-45bf-b4dd-8d49eef26098 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 07:59:17.499899 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e277981e-f245-45bf-b4dd-8d49eef26098 None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 07:59:17.500177 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e277981e-f245-45bf-b4dd-8d49eef26098 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 07:59:17.500475 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e277981e-f245-45bf-b4dd-8d49eef26098 None admin] PATH_INFO: `/v3/domains` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 07:59:17.501222 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e277981e-f245-45bf-b4dd-8d49eef26098 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 07:59:17.501521 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e277981e-f245-45bf-b4dd-8d49eef26098 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 07:59:17.502914 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e277981e-f245-45bf-b4dd-8d49eef26098 None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 07:59:17.506513 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c2d4a1-d489-4308-a567-452a3e4cf518 None admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 07:59:17.520346 dv-cinder-851351-1-smb devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 262/495] 10.222.0.42 () {56 vars in 1109 bytes} [Thu Jul 28 07:59:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 07:59:17.521920 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b62bcd4-72df-4b08-834a-c5f557f754c7 None None] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 07:59:17.522205 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b62bcd4-72df-4b08-834a-c5f557f754c7 None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 07:59:17.523260 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b62bcd4-72df-4b08-834a-c5f557f754c7 None None] PATH_INFO: `/` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 07:59:17.523817 dv-cinder-851351-1-smb devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 263/496] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 07:59:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 07:59:17.529818 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b62bcd4-72df-4b08-834a-c5f557f754c7 None None] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 07:59:17.545518 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ddafd7-eabf-438f-ac63-42c8ea8933d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 07:59:17.546166 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ddafd7-eabf-438f-ac63-42c8ea8933d5 None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 07:59:17.546424 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ddafd7-eabf-438f-ac63-42c8ea8933d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 07:59:17.546695 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ddafd7-eabf-438f-ac63-42c8ea8933d5 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 07:59:17.557731 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ddafd7-eabf-438f-ac63-42c8ea8933d5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 07:59:17.563215 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application [None req-20ddafd7-eabf-438f-ac63-42c8ea8933d5 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 28 07:59:17.563215 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 07:59:17.563215 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 07:59:17.563215 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 07:59:17.563215 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 07:59:17.563215 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 07:59:17.563215 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 07:59:17.563215 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 07:59:17.563215 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 07:59:17.563215 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 07:59:17.563215 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 07:59:17.563215 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 07:59:17.563215 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 07:59:17.563215 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 07:59:17.563215 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 07:59:17.563215 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 07:59:17.564111 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 07:59:17.564111 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 07:59:17.564111 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 07:59:17.564111 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 07:59:17.564111 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 07:59:17.564111 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 07:59:17.564111 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 07:59:17.564111 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 07:59:17.564111 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 07:59:17.564111 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 07:59:17.564111 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 07:59:17.564111 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application with Lock( Jul 28 07:59:17.564111 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 07:59:17.564111 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self._enter() Jul 28 07:59:17.564111 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 07:59:17.564111 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 07:59:17.564920 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 07:59:17.564920 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.creator() Jul 28 07:59:17.564920 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 07:59:17.564920 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application created_value = creator( Jul 28 07:59:17.564920 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 07:59:17.564920 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 07:59:17.564920 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 07:59:17.564920 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 07:59:17.564920 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 07:59:17.564920 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 07:59:17.564920 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 28 07:59:17.564920 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application Jul 28 07:59:17.564920 dv-cinder-851351-1-smb devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 234/497] 10.222.0.42 () {56 vars in 1102 bytes} [Thu Jul 28 07:59:17 2022] GET /identity/v3/roles/service => generated 85 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 07:59:17.565576 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ddafd7-eabf-438f-ac63-42c8ea8933d5 None admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 07:59:17.603587 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=100 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 07:59:17.643874 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 07:59:17.672337 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b62bcd4-72df-4b08-834a-c5f557f754c7 None None] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 07:59:17.710002 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ddafd7-eabf-438f-ac63-42c8ea8933d5 None admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 07:59:17.711787 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5ad8e4-21b7-49c0-a667-f6b084af30d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 07:59:17.712416 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5ad8e4-21b7-49c0-a667-f6b084af30d5 None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 07:59:17.712716 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5ad8e4-21b7-49c0-a667-f6b084af30d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 07:59:17.712986 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5ad8e4-21b7-49c0-a667-f6b084af30d5 None admin] PATH_INFO: `/v3/users` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 07:59:17.713784 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb5ad8e4-21b7-49c0-a667-f6b084af30d5 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 07:59:17.714084 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb5ad8e4-21b7-49c0-a667-f6b084af30d5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 07:59:17.715550 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb5ad8e4-21b7-49c0-a667-f6b084af30d5 None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 07:59:17.744883 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f05af4-b589-42e5-83df-d5733f639bcb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 07:59:17.745547 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f05af4-b589-42e5-83df-d5733f639bcb None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 07:59:17.745821 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f05af4-b589-42e5-83df-d5733f639bcb None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 07:59:17.746099 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f05af4-b589-42e5-83df-d5733f639bcb None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 07:59:17.753419 dv-cinder-851351-1-smb devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 264/498] 10.222.0.42 () {56 vars in 1137 bytes} [Thu Jul 28 07:59:17 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 07:59:17.753861 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f05af4-b589-42e5-83df-d5733f639bcb None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 07:59:17.754707 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93491a61-aa89-4c12-b6c3-3921e9fe89d5 None None] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 07:59:17.754992 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93491a61-aa89-4c12-b6c3-3921e9fe89d5 None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 07:59:17.755261 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93491a61-aa89-4c12-b6c3-3921e9fe89d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 07:59:17.755361 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f05af4-b589-42e5-83df-d5733f639bcb None admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 07:59:17.767514 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application [None req-16f05af4-b589-42e5-83df-d5733f639bcb None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jul 28 07:59:17.767514 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 07:59:17.767514 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 07:59:17.767514 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 07:59:17.767514 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 07:59:17.767514 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 07:59:17.767514 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 07:59:17.767514 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 07:59:17.767514 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 07:59:17.767514 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 07:59:17.767514 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 07:59:17.767514 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 07:59:17.767514 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 28 07:59:17.767514 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 28 07:59:17.767514 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 28 07:59:17.767514 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 28 07:59:17.768509 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 07:59:17.768509 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 07:59:17.768509 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 28 07:59:17.768509 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 07:59:17.768509 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 28 07:59:17.768509 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 07:59:17.768509 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 07:59:17.768509 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 07:59:17.768509 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 07:59:17.768509 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 07:59:17.768509 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 07:59:17.768509 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application with Lock( Jul 28 07:59:17.768509 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 07:59:17.768509 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self._enter() Jul 28 07:59:17.768509 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 07:59:17.768509 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 07:59:17.768509 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 07:59:17.768509 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.creator() Jul 28 07:59:17.769564 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 07:59:17.769564 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application created_value = creator( Jul 28 07:59:17.769564 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 28 07:59:17.769564 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 28 07:59:17.769564 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 28 07:59:17.769564 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 28 07:59:17.769564 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 28 07:59:17.769564 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 28 07:59:17.769564 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jul 28 07:59:17.769564 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application Jul 28 07:59:17.769564 dv-cinder-851351-1-smb devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 235/499] 10.222.0.42 () {56 vars in 1099 bytes} [Thu Jul 28 07:59:17 2022] GET /identity/v3/users/cinder => generated 84 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 07:59:17.769564 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f05af4-b589-42e5-83df-d5733f639bcb None admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 07:59:17.775539 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.auth.core [None req-93491a61-aa89-4c12-b6c3-3921e9fe89d5 None None] MFA Rules not processed for user `f0666d3a50644a7097367331c1ee1a68`. Rule list: `[]` (Enabled: `True`). {{(pid=80347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 07:59:17.776795 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-93491a61-aa89-4c12-b6c3-3921e9fe89d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 07:59:17.845282 dv-cinder-851351-1-smb devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 265/500] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 07:59:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 07:59:17.846735 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2fdbff-3418-47fd-9f26-2e056bcf913c None None] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 07:59:17.847023 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2fdbff-3418-47fd-9f26-2e056bcf913c None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 07:59:17.847277 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2fdbff-3418-47fd-9f26-2e056bcf913c None None] PATH_INFO: `/` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 07:59:17.848584 dv-cinder-851351-1-smb devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 266/501] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 07:59:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 07:59:17.849292 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2fdbff-3418-47fd-9f26-2e056bcf913c None None] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 07:59:17.858710 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=100 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 07:59:17.880164 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f05af4-b589-42e5-83df-d5733f639bcb None admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 07:59:17.913414 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ea2c6a-0390-49a7-a332-7a69be8171b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 07:59:17.914052 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 07:59:17.914424 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ea2c6a-0390-49a7-a332-7a69be8171b0 None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 07:59:17.914424 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ea2c6a-0390-49a7-a332-7a69be8171b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 07:59:17.914424 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ea2c6a-0390-49a7-a332-7a69be8171b0 None admin] PATH_INFO: `/v3/roles` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 07:59:17.915168 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87ea2c6a-0390-49a7-a332-7a69be8171b0 None admin] RBAC: Adding query filter params (name=service) {{(pid=80348) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 07:59:17.915470 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87ea2c6a-0390-49a7-a332-7a69be8171b0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 07:59:17.916888 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87ea2c6a-0390-49a7-a332-7a69be8171b0 None admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 07:59:17.926285 dv-cinder-851351-1-smb devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 236/502] 10.222.0.42 () {56 vars in 1103 bytes} [Thu Jul 28 07:59:17 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 07:59:17.927102 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ea2c6a-0390-49a7-a332-7a69be8171b0 None admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 07:59:17.954572 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2fdbff-3418-47fd-9f26-2e056bcf913c None None] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 07:59:17.987889 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a6480eb-8028-44a2-9ae0-3824ef2fcc06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 07:59:17.988503 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6480eb-8028-44a2-9ae0-3824ef2fcc06 None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 07:59:17.988809 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6480eb-8028-44a2-9ae0-3824ef2fcc06 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 07:59:17.989074 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6480eb-8028-44a2-9ae0-3824ef2fcc06 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 07:59:18.027716 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ea2c6a-0390-49a7-a332-7a69be8171b0 None admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 07:59:18.056213 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a6480eb-8028-44a2-9ae0-3824ef2fcc06 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 07:59:18.057758 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a6480eb-8028-44a2-9ae0-3824ef2fcc06 None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 07:59:18.065973 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8494a9da-0df3-4a22-9835-2f22594719dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 07:59:18.066615 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8494a9da-0df3-4a22-9835-2f22594719dd None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 07:59:18.066890 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8494a9da-0df3-4a22-9835-2f22594719dd None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 07:59:18.067160 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8494a9da-0df3-4a22-9835-2f22594719dd None admin] PATH_INFO: `/v3/users` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 07:59:18.067988 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8494a9da-0df3-4a22-9835-2f22594719dd None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80348) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 07:59:18.068286 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8494a9da-0df3-4a22-9835-2f22594719dd None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 07:59:18.069802 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8494a9da-0df3-4a22-9835-2f22594719dd None admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 07:59:18.104043 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=100 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 07:59:18.108935 dv-cinder-851351-1-smb devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 237/503] 10.222.0.42 () {56 vars in 1137 bytes} [Thu Jul 28 07:59:17 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 07:59:18.110911 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3fa5e8-5f52-4666-bcd7-eadd5489f312 None None] REQUEST_METHOD: `POST` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 07:59:18.111429 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3fa5e8-5f52-4666-bcd7-eadd5489f312 None None] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 07:59:18.111946 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3fa5e8-5f52-4666-bcd7-eadd5489f312 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 07:59:18.126045 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 07:59:18.136735 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.auth.core [None req-6f3fa5e8-5f52-4666-bcd7-eadd5489f312 None None] MFA Rules not processed for user `f0666d3a50644a7097367331c1ee1a68`. Rule list: `[]` (Enabled: `True`). {{(pid=80348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 07:59:18.138012 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.fernet_utils [None req-6f3fa5e8-5f52-4666-bcd7-eadd5489f312 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 07:59:18.195024 dv-cinder-851351-1-smb devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 267/504] 10.222.0.42 () {58 vars in 1282 bytes} [Thu Jul 28 07:59:17 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 346 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 28 07:59:18.196404 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a6480eb-8028-44a2-9ae0-3824ef2fcc06 None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 07:59:18.237554 dv-cinder-851351-1-smb devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 238/505] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 07:59:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 07:59:18.238869 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3fa5e8-5f52-4666-bcd7-eadd5489f312 None None] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 07:59:18.346407 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a6480eb-8028-44a2-9ae0-3824ef2fcc06 None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 07:59:18.368244 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3fa5e8-5f52-4666-bcd7-eadd5489f312 None None] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 07:59:18.386064 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a786d4-0726-402d-9e58-815206337c57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 07:59:18.386919 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a786d4-0726-402d-9e58-815206337c57 None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 07:59:18.387257 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a786d4-0726-402d-9e58-815206337c57 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 07:59:18.387630 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a786d4-0726-402d-9e58-815206337c57 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 07:59:18.399669 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55a786d4-0726-402d-9e58-815206337c57 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 07:59:18.402134 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55a786d4-0726-402d-9e58-815206337c57 None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 07:59:18.403410 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=100 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 07:59:18.411358 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff31399-c7dc-4f84-aac0-56705586e821 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 07:59:18.412459 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff31399-c7dc-4f84-aac0-56705586e821 None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 07:59:18.412869 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff31399-c7dc-4f84-aac0-56705586e821 None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 07:59:18.413245 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff31399-c7dc-4f84-aac0-56705586e821 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 07:59:18.423765 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application [None req-55a786d4-0726-402d-9e58-815206337c57 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 07:59:18.423765 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 07:59:18.423765 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 07:59:18.423765 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 07:59:18.423765 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 07:59:18.423765 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 07:59:18.423765 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 07:59:18.423765 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 07:59:18.423765 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 07:59:18.423765 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 07:59:18.423765 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 07:59:18.423765 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 07:59:18.423765 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 07:59:18.423765 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 07:59:18.423765 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 07:59:18.425577 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 07:59:18.425577 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 07:59:18.425577 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 07:59:18.425577 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 07:59:18.425577 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 07:59:18.425577 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 07:59:18.425577 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 07:59:18.425577 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 07:59:18.425577 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application with Lock( Jul 28 07:59:18.425577 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 07:59:18.425577 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._enter() Jul 28 07:59:18.425577 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 07:59:18.425577 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 07:59:18.425577 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 07:59:18.425577 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.creator() Jul 28 07:59:18.425577 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 07:59:18.425577 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application created_value = creator( Jul 28 07:59:18.428084 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 07:59:18.428084 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 07:59:18.428084 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 07:59:18.428084 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application Jul 28 07:59:18.428084 dv-cinder-851351-1-smb devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 268/506] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 07:59:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 07:59:18.429212 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff31399-c7dc-4f84-aac0-56705586e821 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 07:59:18.429473 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a786d4-0726-402d-9e58-815206337c57 None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 07:59:18.429685 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff31399-c7dc-4f84-aac0-56705586e821 None admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 07:59:18.446976 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 07:59:18.450917 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application [None req-bff31399-c7dc-4f84-aac0-56705586e821 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 07:59:18.450917 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 07:59:18.450917 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 07:59:18.450917 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 07:59:18.450917 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 07:59:18.450917 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 07:59:18.450917 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 07:59:18.450917 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 07:59:18.450917 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 07:59:18.450917 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 07:59:18.450917 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 07:59:18.450917 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 07:59:18.450917 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 07:59:18.450917 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 07:59:18.450917 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 07:59:18.451893 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 07:59:18.451893 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 07:59:18.451893 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 07:59:18.451893 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 07:59:18.451893 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 07:59:18.451893 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 07:59:18.451893 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 07:59:18.451893 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 07:59:18.451893 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application with Lock( Jul 28 07:59:18.451893 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 07:59:18.451893 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self._enter() Jul 28 07:59:18.451893 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 07:59:18.451893 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 07:59:18.451893 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 07:59:18.451893 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.creator() Jul 28 07:59:18.451893 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 07:59:18.451893 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application created_value = creator( Jul 28 07:59:18.453556 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 07:59:18.453556 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 07:59:18.453556 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 07:59:18.453556 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application Jul 28 07:59:18.453556 dv-cinder-851351-1-smb devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 239/507] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 07:59:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 07:59:18.453556 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff31399-c7dc-4f84-aac0-56705586e821 None admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 07:59:18.563506 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff31399-c7dc-4f84-aac0-56705586e821 None admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 07:59:18.573591 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a786d4-0726-402d-9e58-815206337c57 None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 07:59:18.613499 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddcbbb1d-b046-4691-b373-22c8b49e7055 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 07:59:18.614266 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddcbbb1d-b046-4691-b373-22c8b49e7055 None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 07:59:18.614635 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddcbbb1d-b046-4691-b373-22c8b49e7055 None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 07:59:18.614984 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddcbbb1d-b046-4691-b373-22c8b49e7055 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 07:59:18.618987 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60996447-dfee-4c19-b2ce-daddf1502fc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 07:59:18.619618 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60996447-dfee-4c19-b2ce-daddf1502fc9 None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 07:59:18.619893 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60996447-dfee-4c19-b2ce-daddf1502fc9 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 07:59:18.620163 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60996447-dfee-4c19-b2ce-daddf1502fc9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 07:59:18.631369 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddcbbb1d-b046-4691-b373-22c8b49e7055 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 07:59:18.634201 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddcbbb1d-b046-4691-b373-22c8b49e7055 None admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 07:59:18.660124 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application [None req-ddcbbb1d-b046-4691-b373-22c8b49e7055 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 07:59:18.660124 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 07:59:18.660124 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 07:59:18.660124 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 07:59:18.660124 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 07:59:18.660124 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 07:59:18.660124 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 07:59:18.660124 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 07:59:18.660124 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 07:59:18.660124 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 07:59:18.660124 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 07:59:18.660124 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 07:59:18.660124 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 07:59:18.660124 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 07:59:18.660124 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 07:59:18.661270 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 07:59:18.661270 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 07:59:18.661270 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 07:59:18.661270 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 07:59:18.661270 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 07:59:18.661270 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 07:59:18.661270 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 07:59:18.661270 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 07:59:18.661270 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application with Lock( Jul 28 07:59:18.661270 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 07:59:18.661270 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self._enter() Jul 28 07:59:18.661270 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 07:59:18.661270 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 07:59:18.661270 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 07:59:18.661270 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.creator() Jul 28 07:59:18.661270 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 07:59:18.661270 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application created_value = creator( Jul 28 07:59:18.662179 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 07:59:18.662179 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 07:59:18.662179 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 07:59:18.662179 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application Jul 28 07:59:18.662521 dv-cinder-851351-1-smb devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 240/508] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 07:59:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 07:59:18.663776 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddcbbb1d-b046-4691-b373-22c8b49e7055 None admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 07:59:18.699356 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60996447-dfee-4c19-b2ce-daddf1502fc9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 07:59:18.700718 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60996447-dfee-4c19-b2ce-daddf1502fc9 None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 07:59:18.719944 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 07:59:18.721559 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=100 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 07:59:18.811700 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddcbbb1d-b046-4691-b373-22c8b49e7055 None admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 07:59:18.830558 dv-cinder-851351-1-smb devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 269/509] 10.222.0.42 () {58 vars in 1282 bytes} [Thu Jul 28 07:59:18 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 404 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 28 07:59:18.832005 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60996447-dfee-4c19-b2ce-daddf1502fc9 None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 07:59:18.860959 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0a3f9b-7a78-4961-ac22-8531745a9da2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 07:59:18.861729 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0a3f9b-7a78-4961-ac22-8531745a9da2 None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 07:59:18.862067 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0a3f9b-7a78-4961-ac22-8531745a9da2 None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 07:59:18.862440 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0a3f9b-7a78-4961-ac22-8531745a9da2 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 07:59:18.878925 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e0a3f9b-7a78-4961-ac22-8531745a9da2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 07:59:18.890166 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application [None req-3e0a3f9b-7a78-4961-ac22-8531745a9da2 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 28 07:59:18.890166 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 07:59:18.890166 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 07:59:18.890166 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 07:59:18.890166 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 07:59:18.890166 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 07:59:18.890166 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 07:59:18.890166 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 07:59:18.890166 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 07:59:18.890166 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 07:59:18.890166 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 07:59:18.890166 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 07:59:18.890166 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 07:59:18.890166 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 07:59:18.890166 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 07:59:18.890166 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 07:59:18.891899 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 07:59:18.891899 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 07:59:18.891899 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 07:59:18.891899 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 07:59:18.891899 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 07:59:18.891899 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 07:59:18.891899 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 07:59:18.891899 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 07:59:18.891899 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 07:59:18.891899 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 07:59:18.891899 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 07:59:18.891899 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application with Lock( Jul 28 07:59:18.891899 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 07:59:18.891899 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self._enter() Jul 28 07:59:18.891899 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 07:59:18.891899 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 07:59:18.893375 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 07:59:18.893375 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.creator() Jul 28 07:59:18.893375 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 07:59:18.893375 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application created_value = creator( Jul 28 07:59:18.893375 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 07:59:18.893375 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 07:59:18.893375 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 07:59:18.893375 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 07:59:18.893375 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 07:59:18.893375 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 07:59:18.893375 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 28 07:59:18.893375 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application Jul 28 07:59:18.893375 dv-cinder-851351-1-smb devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 241/510] 10.222.0.42 () {56 vars in 1102 bytes} [Thu Jul 28 07:59:18 2022] GET /identity/v3/roles/service => generated 85 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 07:59:18.893375 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0a3f9b-7a78-4961-ac22-8531745a9da2 None admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 07:59:18.967613 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60996447-dfee-4c19-b2ce-daddf1502fc9 None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 07:59:18.986491 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 07:59:19.015975 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a71348d-61d3-4b72-af92-7c7e822eee80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 07:59:19.016810 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a71348d-61d3-4b72-af92-7c7e822eee80 None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 07:59:19.017152 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a71348d-61d3-4b72-af92-7c7e822eee80 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 07:59:19.017455 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a71348d-61d3-4b72-af92-7c7e822eee80 None admin] PATH_INFO: `/v3/domains` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 07:59:19.018463 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a71348d-61d3-4b72-af92-7c7e822eee80 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 07:59:19.018806 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a71348d-61d3-4b72-af92-7c7e822eee80 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 07:59:19.020457 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a71348d-61d3-4b72-af92-7c7e822eee80 None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 07:59:19.033852 dv-cinder-851351-1-smb devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 270/511] 10.222.0.42 () {56 vars in 1109 bytes} [Thu Jul 28 07:59:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 07:59:19.034745 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a71348d-61d3-4b72-af92-7c7e822eee80 None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 07:59:19.045202 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=100 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 07:59:19.054256 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0a3f9b-7a78-4961-ac22-8531745a9da2 None admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 07:59:19.102062 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26aa1461-f33a-487d-a697-a4d0ca194f8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 07:59:19.103057 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26aa1461-f33a-487d-a697-a4d0ca194f8e None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 07:59:19.103392 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26aa1461-f33a-487d-a697-a4d0ca194f8e None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 07:59:19.103824 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26aa1461-f33a-487d-a697-a4d0ca194f8e None admin] PATH_INFO: `/v3/domains` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 07:59:19.104690 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26aa1461-f33a-487d-a697-a4d0ca194f8e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80348) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 07:59:19.105076 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26aa1461-f33a-487d-a697-a4d0ca194f8e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 07:59:19.106680 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26aa1461-f33a-487d-a697-a4d0ca194f8e None admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 07:59:19.122625 dv-cinder-851351-1-smb devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 242/512] 10.222.0.42 () {56 vars in 1109 bytes} [Thu Jul 28 07:59:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 07:59:19.123868 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26aa1461-f33a-487d-a697-a4d0ca194f8e None admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 07:59:19.175555 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a71348d-61d3-4b72-af92-7c7e822eee80 None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 07:59:19.223010 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff849f37-849b-43fc-81f2-30ee604ea888 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 07:59:19.223788 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff849f37-849b-43fc-81f2-30ee604ea888 None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 07:59:19.224183 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff849f37-849b-43fc-81f2-30ee604ea888 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 07:59:19.224655 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff849f37-849b-43fc-81f2-30ee604ea888 None admin] PATH_INFO: `/v3/domains` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 07:59:19.225905 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff849f37-849b-43fc-81f2-30ee604ea888 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 07:59:19.226353 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff849f37-849b-43fc-81f2-30ee604ea888 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 07:59:19.228755 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff849f37-849b-43fc-81f2-30ee604ea888 None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 07:59:19.244494 dv-cinder-851351-1-smb devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 271/513] 10.222.0.42 () {56 vars in 1109 bytes} [Thu Jul 28 07:59:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 07:59:19.246355 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff849f37-849b-43fc-81f2-30ee604ea888 None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 07:59:19.276758 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26aa1461-f33a-487d-a697-a4d0ca194f8e None admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 07:59:19.294022 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 07:59:19.327442 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c26b742-f3ea-453f-8c27-b24848af04b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 07:59:19.328586 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c26b742-f3ea-453f-8c27-b24848af04b4 None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 07:59:19.329056 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c26b742-f3ea-453f-8c27-b24848af04b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 07:59:19.329495 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c26b742-f3ea-453f-8c27-b24848af04b4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 07:59:19.346685 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c26b742-f3ea-453f-8c27-b24848af04b4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 07:59:19.348341 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c26b742-f3ea-453f-8c27-b24848af04b4 None admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 07:59:19.370007 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application [None req-4c26b742-f3ea-453f-8c27-b24848af04b4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 07:59:19.370007 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 07:59:19.370007 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 07:59:19.370007 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 07:59:19.370007 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 07:59:19.370007 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 07:59:19.370007 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 07:59:19.370007 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 07:59:19.370007 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 07:59:19.370007 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 07:59:19.370007 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 07:59:19.370007 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 07:59:19.370007 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 07:59:19.370007 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 07:59:19.370007 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 07:59:19.371571 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 07:59:19.371571 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 07:59:19.371571 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 07:59:19.371571 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 07:59:19.371571 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 07:59:19.371571 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 07:59:19.371571 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 07:59:19.371571 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 07:59:19.371571 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application with Lock( Jul 28 07:59:19.371571 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 07:59:19.371571 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self._enter() Jul 28 07:59:19.371571 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 07:59:19.371571 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 07:59:19.371571 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 07:59:19.371571 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.creator() Jul 28 07:59:19.371571 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 07:59:19.371571 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application created_value = creator( Jul 28 07:59:19.372463 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 07:59:19.372463 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 07:59:19.372463 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 07:59:19.372463 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application Jul 28 07:59:19.380611 dv-cinder-851351-1-smb devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 243/514] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 07:59:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 252 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 07:59:19.380611 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c26b742-f3ea-453f-8c27-b24848af04b4 None admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 07:59:19.389683 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=100 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 07:59:19.402972 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff849f37-849b-43fc-81f2-30ee604ea888 None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 07:59:19.452263 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adce8450-0b7d-43b2-b8d9-5b55cf40fb6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 07:59:19.453384 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adce8450-0b7d-43b2-b8d9-5b55cf40fb6a None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 07:59:19.453868 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adce8450-0b7d-43b2-b8d9-5b55cf40fb6a None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 07:59:19.454326 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adce8450-0b7d-43b2-b8d9-5b55cf40fb6a None admin] PATH_INFO: `/v3/roles` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 07:59:19.456082 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adce8450-0b7d-43b2-b8d9-5b55cf40fb6a None admin] RBAC: Adding query filter params (name=service) {{(pid=80347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 07:59:19.456603 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adce8450-0b7d-43b2-b8d9-5b55cf40fb6a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 07:59:19.458303 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adce8450-0b7d-43b2-b8d9-5b55cf40fb6a None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 07:59:19.470839 dv-cinder-851351-1-smb devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 272/515] 10.222.0.42 () {56 vars in 1103 bytes} [Thu Jul 28 07:59:19 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 07:59:19.472939 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adce8450-0b7d-43b2-b8d9-5b55cf40fb6a None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 07:59:19.528859 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c26b742-f3ea-453f-8c27-b24848af04b4 None admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 07:59:19.575663 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee7b56a-b717-45eb-92ea-f5f56b20eec3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 07:59:19.576540 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee7b56a-b717-45eb-92ea-f5f56b20eec3 None admin] REQUEST_METHOD: `POST` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 07:59:19.577026 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee7b56a-b717-45eb-92ea-f5f56b20eec3 None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 07:59:19.577348 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee7b56a-b717-45eb-92ea-f5f56b20eec3 None admin] PATH_INFO: `/v3/users` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 07:59:19.578095 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fee7b56a-b717-45eb-92ea-f5f56b20eec3 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 07:59:19.580261 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fee7b56a-b717-45eb-92ea-f5f56b20eec3 None admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 07:59:19.607419 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 07:59:19.619657 dv-cinder-851351-1-smb devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 244/516] 10.222.0.42 () {60 vars in 1132 bytes} [Thu Jul 28 07:59:19 2022] POST /identity/v3/users => generated 247 bytes in 233 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 07:59:19.619657 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee7b56a-b717-45eb-92ea-f5f56b20eec3 None admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 07:59:19.625163 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adce8450-0b7d-43b2-b8d9-5b55cf40fb6a None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 07:59:19.678478 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa779519-5a18-4a7e-b4eb-1fc5cd9ca9f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 07:59:19.679500 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa779519-5a18-4a7e-b4eb-1fc5cd9ca9f5 None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 07:59:19.679904 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa779519-5a18-4a7e-b4eb-1fc5cd9ca9f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 07:59:19.680329 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa779519-5a18-4a7e-b4eb-1fc5cd9ca9f5 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 07:59:19.691158 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa779519-5a18-4a7e-b4eb-1fc5cd9ca9f5 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 07:59:19.693123 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa779519-5a18-4a7e-b4eb-1fc5cd9ca9f5 None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 07:59:19.709620 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application [None req-aa779519-5a18-4a7e-b4eb-1fc5cd9ca9f5 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 28 07:59:19.709620 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 07:59:19.709620 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 07:59:19.709620 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 07:59:19.709620 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 07:59:19.709620 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 07:59:19.709620 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 07:59:19.709620 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 07:59:19.709620 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 07:59:19.709620 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 07:59:19.709620 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 07:59:19.709620 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 07:59:19.709620 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 28 07:59:19.709620 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 28 07:59:19.709620 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 28 07:59:19.709620 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 28 07:59:19.711327 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 07:59:19.711327 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 07:59:19.711327 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 28 07:59:19.711327 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 07:59:19.711327 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 28 07:59:19.711327 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 07:59:19.711327 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 07:59:19.711327 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 07:59:19.711327 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 07:59:19.711327 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 07:59:19.711327 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 07:59:19.711327 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application with Lock( Jul 28 07:59:19.711327 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 07:59:19.711327 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._enter() Jul 28 07:59:19.711327 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 07:59:19.711327 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 07:59:19.711327 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 07:59:19.711327 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.creator() Jul 28 07:59:19.713048 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 07:59:19.713048 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application created_value = creator( Jul 28 07:59:19.713048 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 28 07:59:19.713048 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 28 07:59:19.713048 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 28 07:59:19.713048 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 28 07:59:19.713048 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 28 07:59:19.713048 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 28 07:59:19.713048 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 28 07:59:19.713048 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application Jul 28 07:59:19.713048 dv-cinder-851351-1-smb devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 273/517] 10.222.0.42 () {56 vars in 1093 bytes} [Thu Jul 28 07:59:19 2022] GET /identity/v3/users/nova => generated 82 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 07:59:19.714105 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa779519-5a18-4a7e-b4eb-1fc5cd9ca9f5 None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 07:59:19.724080 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 07:59:19.803241 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee7b56a-b717-45eb-92ea-f5f56b20eec3 None admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 07:59:19.880023 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed141542-3f59-49c1-bb7a-341d28f1f097 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 07:59:19.881218 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed141542-3f59-49c1-bb7a-341d28f1f097 None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 07:59:19.881651 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed141542-3f59-49c1-bb7a-341d28f1f097 None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 07:59:19.882108 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed141542-3f59-49c1-bb7a-341d28f1f097 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 07:59:19.894871 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed141542-3f59-49c1-bb7a-341d28f1f097 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 07:59:19.894871 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed141542-3f59-49c1-bb7a-341d28f1f097 None admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 07:59:19.913356 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa779519-5a18-4a7e-b4eb-1fc5cd9ca9f5 None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 07:59:19.914946 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application [None req-ed141542-3f59-49c1-bb7a-341d28f1f097 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 07:59:19.914946 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 07:59:19.914946 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 07:59:19.914946 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 07:59:19.914946 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 07:59:19.914946 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 07:59:19.914946 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 07:59:19.914946 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 07:59:19.914946 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 07:59:19.914946 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 07:59:19.914946 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 07:59:19.914946 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 07:59:19.914946 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 28 07:59:19.914946 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 28 07:59:19.914946 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 28 07:59:19.916147 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 28 07:59:19.916147 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 07:59:19.916147 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 07:59:19.916147 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 07:59:19.916147 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 07:59:19.916147 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 07:59:19.916147 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 07:59:19.916147 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 07:59:19.916147 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application with Lock( Jul 28 07:59:19.916147 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 07:59:19.916147 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self._enter() Jul 28 07:59:19.916147 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 07:59:19.916147 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 07:59:19.916147 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 07:59:19.916147 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.creator() Jul 28 07:59:19.916147 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 07:59:19.916147 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application created_value = creator( Jul 28 07:59:19.917684 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 28 07:59:19.917684 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 28 07:59:19.917684 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 28 07:59:19.917684 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 28 07:59:19.917684 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 28 07:59:19.917684 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 28 07:59:19.917684 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 07:59:19.917684 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application Jul 28 07:59:19.917684 dv-cinder-851351-1-smb devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 245/518] 10.222.0.42 () {56 vars in 1111 bytes} [Thu Jul 28 07:59:19 2022] GET /identity/v3/projects/service => generated 88 bytes in 308 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 07:59:19.918586 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed141542-3f59-49c1-bb7a-341d28f1f097 None admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 07:59:19.964873 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b162f632-4172-4acd-9ee1-9ef1cae041e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 07:59:19.965627 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b162f632-4172-4acd-9ee1-9ef1cae041e6 None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 07:59:19.965949 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b162f632-4172-4acd-9ee1-9ef1cae041e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 07:59:19.966251 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b162f632-4172-4acd-9ee1-9ef1cae041e6 None admin] PATH_INFO: `/v3/domains` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 07:59:19.967014 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b162f632-4172-4acd-9ee1-9ef1cae041e6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 07:59:19.967372 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b162f632-4172-4acd-9ee1-9ef1cae041e6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 07:59:19.969189 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b162f632-4172-4acd-9ee1-9ef1cae041e6 None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 07:59:19.991672 dv-cinder-851351-1-smb devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 274/519] 10.222.0.42 () {56 vars in 1109 bytes} [Thu Jul 28 07:59:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 07:59:19.991672 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b162f632-4172-4acd-9ee1-9ef1cae041e6 None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 07:59:20.009771 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 07:59:20.115691 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed141542-3f59-49c1-bb7a-341d28f1f097 None admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 07:59:20.125931 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b162f632-4172-4acd-9ee1-9ef1cae041e6 None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 07:59:20.144410 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=100 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 07:59:20.163559 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa313c26-9dcf-49eb-8093-21464b158a51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 07:59:20.164388 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa313c26-9dcf-49eb-8093-21464b158a51 None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 07:59:20.164847 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa313c26-9dcf-49eb-8093-21464b158a51 None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 07:59:20.165244 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa313c26-9dcf-49eb-8093-21464b158a51 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 07:59:20.181101 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa313c26-9dcf-49eb-8093-21464b158a51 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 07:59:20.183286 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa313c26-9dcf-49eb-8093-21464b158a51 None admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 07:59:20.201690 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application [None req-fa313c26-9dcf-49eb-8093-21464b158a51 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 07:59:20.201690 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 07:59:20.201690 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 07:59:20.201690 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 07:59:20.201690 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 07:59:20.201690 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 07:59:20.201690 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 07:59:20.201690 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 07:59:20.201690 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 07:59:20.201690 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 07:59:20.201690 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 07:59:20.201690 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 07:59:20.201690 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 07:59:20.201690 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 07:59:20.201690 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 07:59:20.203335 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 07:59:20.203335 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 07:59:20.203335 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 07:59:20.203335 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 07:59:20.203335 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 07:59:20.203335 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 07:59:20.203335 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 07:59:20.203335 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 07:59:20.203335 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application with Lock( Jul 28 07:59:20.203335 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 07:59:20.203335 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self._enter() Jul 28 07:59:20.203335 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 07:59:20.203335 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 07:59:20.203335 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 07:59:20.203335 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.creator() Jul 28 07:59:20.203335 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 07:59:20.203335 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application created_value = creator( Jul 28 07:59:20.206069 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 07:59:20.206069 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 07:59:20.206069 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 07:59:20.206069 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application Jul 28 07:59:20.206069 dv-cinder-851351-1-smb devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 246/520] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 07:59:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 286 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 07:59:20.206069 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa313c26-9dcf-49eb-8093-21464b158a51 None admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 07:59:20.207349 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11377921-697e-475f-b9fb-503c95578cb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 07:59:20.208892 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11377921-697e-475f-b9fb-503c95578cb6 None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 07:59:20.209721 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11377921-697e-475f-b9fb-503c95578cb6 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 07:59:20.210871 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11377921-697e-475f-b9fb-503c95578cb6 None admin] PATH_INFO: `/v3/users` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 07:59:20.212831 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11377921-697e-475f-b9fb-503c95578cb6 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 07:59:20.213465 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11377921-697e-475f-b9fb-503c95578cb6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 07:59:20.216482 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11377921-697e-475f-b9fb-503c95578cb6 None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 07:59:20.253677 dv-cinder-851351-1-smb devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 275/521] 10.222.0.42 () {56 vars in 1133 bytes} [Thu Jul 28 07:59:19 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 07:59:20.255148 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11377921-697e-475f-b9fb-503c95578cb6 None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 07:59:20.338129 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa313c26-9dcf-49eb-8093-21464b158a51 None admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 07:59:20.378315 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a64691-bb02-4677-b773-bf4c0f88df56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 07:59:20.378845 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a64691-bb02-4677-b773-bf4c0f88df56 None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 07:59:20.379120 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a64691-bb02-4677-b773-bf4c0f88df56 None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 07:59:20.379383 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a64691-bb02-4677-b773-bf4c0f88df56 None admin] PATH_INFO: `/v3/projects` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 07:59:20.380152 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a64691-bb02-4677-b773-bf4c0f88df56 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80348) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 07:59:20.380454 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a64691-bb02-4677-b773-bf4c0f88df56 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 07:59:20.381963 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a64691-bb02-4677-b773-bf4c0f88df56 None admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 07:59:20.401458 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 07:59:20.407236 dv-cinder-851351-1-smb devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 247/522] 10.222.0.42 () {56 vars in 1148 bytes} [Thu Jul 28 07:59:20 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 07:59:20.412196 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a64691-bb02-4677-b773-bf4c0f88df56 None admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 07:59:20.442631 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11377921-697e-475f-b9fb-503c95578cb6 None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 07:59:20.467401 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=100 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 07:59:20.491909 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-406a320a-6795-49fb-b453-616591f1a173 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 07:59:20.492804 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406a320a-6795-49fb-b453-616591f1a173 None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 07:59:20.493218 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406a320a-6795-49fb-b453-616591f1a173 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 07:59:20.494052 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406a320a-6795-49fb-b453-616591f1a173 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 07:59:20.502666 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-406a320a-6795-49fb-b453-616591f1a173 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 07:59:20.504318 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-406a320a-6795-49fb-b453-616591f1a173 None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 07:59:20.526005 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application [None req-406a320a-6795-49fb-b453-616591f1a173 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 07:59:20.526005 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 07:59:20.526005 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 07:59:20.526005 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 07:59:20.526005 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 07:59:20.526005 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 07:59:20.526005 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 07:59:20.526005 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 07:59:20.526005 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 07:59:20.526005 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 07:59:20.526005 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 07:59:20.526005 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 07:59:20.526005 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 28 07:59:20.526005 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 28 07:59:20.526005 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 28 07:59:20.527684 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 28 07:59:20.527684 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 07:59:20.527684 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 07:59:20.527684 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 07:59:20.527684 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 07:59:20.527684 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 07:59:20.527684 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 07:59:20.527684 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 07:59:20.527684 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application with Lock( Jul 28 07:59:20.527684 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 07:59:20.527684 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._enter() Jul 28 07:59:20.527684 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 07:59:20.527684 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 07:59:20.527684 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 07:59:20.527684 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.creator() Jul 28 07:59:20.527684 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 07:59:20.527684 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application created_value = creator( Jul 28 07:59:20.530313 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 28 07:59:20.530313 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 28 07:59:20.530313 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 28 07:59:20.530313 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 28 07:59:20.530313 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 28 07:59:20.530313 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 28 07:59:20.530313 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 07:59:20.530313 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application Jul 28 07:59:20.530313 dv-cinder-851351-1-smb devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 276/523] 10.222.0.42 () {56 vars in 1111 bytes} [Thu Jul 28 07:59:20 2022] GET /identity/v3/projects/service => generated 88 bytes in 274 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 07:59:20.530313 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-406a320a-6795-49fb-b453-616591f1a173 None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 07:59:20.597031 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a64691-bb02-4677-b773-bf4c0f88df56 None admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 07:59:20.657134 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e8732c-0be1-48a7-b3b5-3ea838c51f45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 07:59:20.658030 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e8732c-0be1-48a7-b3b5-3ea838c51f45 None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 07:59:20.658492 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e8732c-0be1-48a7-b3b5-3ea838c51f45 None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 07:59:20.658950 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e8732c-0be1-48a7-b3b5-3ea838c51f45 None admin] PATH_INFO: `/v3/domains` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 07:59:20.660181 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e8732c-0be1-48a7-b3b5-3ea838c51f45 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80348) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 07:59:20.660699 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e8732c-0be1-48a7-b3b5-3ea838c51f45 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 07:59:20.662759 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e8732c-0be1-48a7-b3b5-3ea838c51f45 None admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 07:59:20.682269 dv-cinder-851351-1-smb devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 248/524] 10.222.0.42 () {56 vars in 1109 bytes} [Thu Jul 28 07:59:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 07:59:20.683755 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e8732c-0be1-48a7-b3b5-3ea838c51f45 None admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 07:59:20.710308 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-406a320a-6795-49fb-b453-616591f1a173 None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 07:59:20.758433 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc98c15f-70cb-4cf0-b2a3-139a8aa901e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 07:59:20.759414 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc98c15f-70cb-4cf0-b2a3-139a8aa901e7 None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 07:59:20.759853 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc98c15f-70cb-4cf0-b2a3-139a8aa901e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 07:59:20.760284 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc98c15f-70cb-4cf0-b2a3-139a8aa901e7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 07:59:20.766984 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 07:59:20.844755 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=100 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 07:59:20.855959 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e8732c-0be1-48a7-b3b5-3ea838c51f45 None admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 07:59:20.890507 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc98c15f-70cb-4cf0-b2a3-139a8aa901e7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 07:59:20.893363 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc98c15f-70cb-4cf0-b2a3-139a8aa901e7 None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 07:59:20.904415 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c8cf0b-6ed4-4e74-9d2b-5e3972df9642 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 07:59:20.905251 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c8cf0b-6ed4-4e74-9d2b-5e3972df9642 None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 07:59:20.905667 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c8cf0b-6ed4-4e74-9d2b-5e3972df9642 None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 07:59:20.906055 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c8cf0b-6ed4-4e74-9d2b-5e3972df9642 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 07:59:20.906969 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0c8cf0b-6ed4-4e74-9d2b-5e3972df9642 None admin] RBAC: Adding query filter params (role.id=a2d02bc3295c4a33b1fc0775a17a79e6, scope.project.id=139349507026497c98f360774dee737e, user.id=0973def3ea2b4b43ac0e855eff7fcc77) {{(pid=80348) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 07:59:20.907516 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0c8cf0b-6ed4-4e74-9d2b-5e3972df9642 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 07:59:20.909663 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0c8cf0b-6ed4-4e74-9d2b-5e3972df9642 None admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 07:59:20.928728 dv-cinder-851351-1-smb devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 249/525] 10.222.0.42 () {56 vars in 1374 bytes} [Thu Jul 28 07:59:20 2022] GET /identity/v3/role_assignments?user.id=0973def3ea2b4b43ac0e855eff7fcc77&scope.project.id=139349507026497c98f360774dee737e&role.id=a2d02bc3295c4a33b1fc0775a17a79e6 => generated 259 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 07:59:20.928728 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c8cf0b-6ed4-4e74-9d2b-5e3972df9642 None admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 07:59:21.127643 dv-cinder-851351-1-smb devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 277/526] 10.222.0.42 () {58 vars in 1282 bytes} [Thu Jul 28 07:59:20 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 598 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 28 07:59:21.129720 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc98c15f-70cb-4cf0-b2a3-139a8aa901e7 None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 07:59:21.145254 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c8cf0b-6ed4-4e74-9d2b-5e3972df9642 None admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 07:59:21.209980 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 07:59:21.228907 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b40bf8a5-fd95-4b83-adf8-724100750c57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 07:59:21.229707 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40bf8a5-fd95-4b83-adf8-724100750c57 None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 07:59:21.230095 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40bf8a5-fd95-4b83-adf8-724100750c57 None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 07:59:21.230536 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40bf8a5-fd95-4b83-adf8-724100750c57 None admin] PATH_INFO: `/v3/projects` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 07:59:21.231483 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b40bf8a5-fd95-4b83-adf8-724100750c57 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80348) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 07:59:21.231903 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b40bf8a5-fd95-4b83-adf8-724100750c57 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 07:59:21.234215 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b40bf8a5-fd95-4b83-adf8-724100750c57 None admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 07:59:21.265087 dv-cinder-851351-1-smb devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 250/527] 10.222.0.42 () {56 vars in 1148 bytes} [Thu Jul 28 07:59:20 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 339 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 07:59:21.266632 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b40bf8a5-fd95-4b83-adf8-724100750c57 None admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 07:59:21.299359 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=100 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 07:59:21.343387 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc98c15f-70cb-4cf0-b2a3-139a8aa901e7 None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 07:59:21.407216 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ed5be9-6438-4dea-ab98-46d30c5da5cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 07:59:21.408784 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ed5be9-6438-4dea-ab98-46d30c5da5cf None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 07:59:21.409725 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ed5be9-6438-4dea-ab98-46d30c5da5cf None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 07:59:21.410450 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ed5be9-6438-4dea-ab98-46d30c5da5cf None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 07:59:21.425066 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80ed5be9-6438-4dea-ab98-46d30c5da5cf None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 07:59:21.428087 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80ed5be9-6438-4dea-ab98-46d30c5da5cf None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 07:59:21.447321 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b40bf8a5-fd95-4b83-adf8-724100750c57 None admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 07:59:21.452862 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application [None req-80ed5be9-6438-4dea-ab98-46d30c5da5cf None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jul 28 07:59:21.452862 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 07:59:21.452862 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 07:59:21.452862 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 07:59:21.452862 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 07:59:21.452862 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 07:59:21.452862 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 07:59:21.452862 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 07:59:21.452862 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 07:59:21.452862 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 07:59:21.452862 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 07:59:21.452862 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 07:59:21.452862 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 28 07:59:21.452862 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 28 07:59:21.452862 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 28 07:59:21.452862 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 28 07:59:21.454903 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 07:59:21.454903 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 07:59:21.454903 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 28 07:59:21.454903 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 07:59:21.454903 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 28 07:59:21.454903 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 07:59:21.454903 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 07:59:21.454903 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 07:59:21.454903 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 07:59:21.454903 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 07:59:21.454903 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 07:59:21.454903 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application with Lock( Jul 28 07:59:21.454903 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 07:59:21.454903 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._enter() Jul 28 07:59:21.454903 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 07:59:21.454903 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 07:59:21.454903 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 07:59:21.454903 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.creator() Jul 28 07:59:21.456700 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 07:59:21.456700 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application created_value = creator( Jul 28 07:59:21.456700 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 28 07:59:21.456700 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 28 07:59:21.456700 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 28 07:59:21.456700 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 28 07:59:21.456700 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 28 07:59:21.456700 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 28 07:59:21.456700 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jul 28 07:59:21.456700 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application Jul 28 07:59:21.461097 dv-cinder-851351-1-smb devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 278/528] 10.222.0.42 () {56 vars in 1102 bytes} [Thu Jul 28 07:59:21 2022] GET /identity/v3/users/neutron => generated 85 bytes in 333 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 07:59:21.463050 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ed5be9-6438-4dea-ab98-46d30c5da5cf None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 07:59:21.509239 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd27bf2-eca4-40b5-a283-8571ca1359ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 07:59:21.510279 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd27bf2-eca4-40b5-a283-8571ca1359ca None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 07:59:21.510739 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd27bf2-eca4-40b5-a283-8571ca1359ca None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 07:59:21.511198 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd27bf2-eca4-40b5-a283-8571ca1359ca None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 07:59:21.530551 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbd27bf2-eca4-40b5-a283-8571ca1359ca None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 07:59:21.533217 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbd27bf2-eca4-40b5-a283-8571ca1359ca None admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 07:59:21.560110 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application [None req-cbd27bf2-eca4-40b5-a283-8571ca1359ca None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 07:59:21.560110 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 07:59:21.560110 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 07:59:21.560110 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 07:59:21.560110 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 07:59:21.560110 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 07:59:21.560110 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 07:59:21.560110 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 07:59:21.560110 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 07:59:21.560110 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 07:59:21.560110 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 07:59:21.560110 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 07:59:21.560110 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 07:59:21.560110 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 07:59:21.560110 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 07:59:21.561751 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 07:59:21.561751 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 07:59:21.561751 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 07:59:21.561751 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 07:59:21.561751 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 07:59:21.561751 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 07:59:21.561751 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 07:59:21.561751 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 07:59:21.561751 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application with Lock( Jul 28 07:59:21.561751 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 07:59:21.561751 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self._enter() Jul 28 07:59:21.561751 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 07:59:21.561751 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 07:59:21.561751 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 07:59:21.561751 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.creator() Jul 28 07:59:21.561751 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 07:59:21.561751 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application created_value = creator( Jul 28 07:59:21.563310 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 07:59:21.563310 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 07:59:21.563310 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 07:59:21.563310 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application Jul 28 07:59:21.569065 dv-cinder-851351-1-smb devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 251/529] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 07:59:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 297 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 07:59:21.570642 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd27bf2-eca4-40b5-a283-8571ca1359ca None admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 07:59:21.657385 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 07:59:21.670743 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ed5be9-6438-4dea-ab98-46d30c5da5cf None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 07:59:21.698617 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=100 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 07:59:21.740047 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77383624-52dc-4ccf-bb9d-4d6ec7157996 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 07:59:21.741611 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77383624-52dc-4ccf-bb9d-4d6ec7157996 None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 07:59:21.742369 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77383624-52dc-4ccf-bb9d-4d6ec7157996 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 07:59:21.743311 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77383624-52dc-4ccf-bb9d-4d6ec7157996 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 07:59:21.745176 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77383624-52dc-4ccf-bb9d-4d6ec7157996 None admin] RBAC: Adding query filter params (role.id=a2d02bc3295c4a33b1fc0775a17a79e6, scope.project.id=139349507026497c98f360774dee737e, user.id=009cfabce8d64f9b894a6a0979d2a213) {{(pid=80347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 07:59:21.746133 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77383624-52dc-4ccf-bb9d-4d6ec7157996 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 07:59:21.749217 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77383624-52dc-4ccf-bb9d-4d6ec7157996 None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 07:59:21.754132 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd27bf2-eca4-40b5-a283-8571ca1359ca None admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 07:59:21.760745 dv-cinder-851351-1-smb devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 279/530] 10.222.0.42 () {56 vars in 1374 bytes} [Thu Jul 28 07:59:21 2022] GET /identity/v3/role_assignments?user.id=009cfabce8d64f9b894a6a0979d2a213&scope.project.id=139349507026497c98f360774dee737e&role.id=a2d02bc3295c4a33b1fc0775a17a79e6 => generated 259 bytes in 298 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 07:59:21.762709 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77383624-52dc-4ccf-bb9d-4d6ec7157996 None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 07:59:21.878083 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a3c67d-db5f-4338-b81e-5bcde1140521 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 07:59:21.879167 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a3c67d-db5f-4338-b81e-5bcde1140521 None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 07:59:21.879663 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a3c67d-db5f-4338-b81e-5bcde1140521 None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 07:59:21.880158 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a3c67d-db5f-4338-b81e-5bcde1140521 None admin] PATH_INFO: `/v3/users` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 07:59:21.881761 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9a3c67d-db5f-4338-b81e-5bcde1140521 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80348) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 07:59:21.882313 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9a3c67d-db5f-4338-b81e-5bcde1140521 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 07:59:21.885104 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9a3c67d-db5f-4338-b81e-5bcde1140521 None admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 07:59:21.943474 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77383624-52dc-4ccf-bb9d-4d6ec7157996 None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 07:59:21.949350 dv-cinder-851351-1-smb devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 252/531] 10.222.0.42 () {56 vars in 1139 bytes} [Thu Jul 28 07:59:21 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 379 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 07:59:21.958721 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a3c67d-db5f-4338-b81e-5bcde1140521 None admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 07:59:22.016697 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2efc50-7545-49da-9a5f-485ea6d74117 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 07:59:22.016697 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2efc50-7545-49da-9a5f-485ea6d74117 None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 07:59:22.016697 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2efc50-7545-49da-9a5f-485ea6d74117 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 07:59:22.016697 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2efc50-7545-49da-9a5f-485ea6d74117 None admin] PATH_INFO: `/v3/domains` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 07:59:22.017133 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd2efc50-7545-49da-9a5f-485ea6d74117 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 07:59:22.017133 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd2efc50-7545-49da-9a5f-485ea6d74117 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 07:59:22.017740 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd2efc50-7545-49da-9a5f-485ea6d74117 None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 07:59:22.060716 dv-cinder-851351-1-smb devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 280/532] 10.222.0.42 () {56 vars in 1109 bytes} [Thu Jul 28 07:59:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 299 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 07:59:22.065505 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2efc50-7545-49da-9a5f-485ea6d74117 None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 07:59:22.118949 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 07:59:22.217771 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a3c67d-db5f-4338-b81e-5bcde1140521 None admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 07:59:22.283325 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=100 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 07:59:22.296439 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2efc50-7545-49da-9a5f-485ea6d74117 None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 07:59:22.309149 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-982b42c4-607d-4509-ba3d-75aa99b3e285 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 07:59:22.309800 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982b42c4-607d-4509-ba3d-75aa99b3e285 None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 07:59:22.310075 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982b42c4-607d-4509-ba3d-75aa99b3e285 None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 07:59:22.310335 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982b42c4-607d-4509-ba3d-75aa99b3e285 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 07:59:22.395577 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f09df8d9-2eb8-463e-aa8c-3b1624522112 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 07:59:22.396250 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09df8d9-2eb8-463e-aa8c-3b1624522112 None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 07:59:22.396518 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09df8d9-2eb8-463e-aa8c-3b1624522112 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 07:59:22.396821 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09df8d9-2eb8-463e-aa8c-3b1624522112 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 07:59:22.411642 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f09df8d9-2eb8-463e-aa8c-3b1624522112 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 07:59:22.414300 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f09df8d9-2eb8-463e-aa8c-3b1624522112 None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 07:59:22.441234 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application [None req-f09df8d9-2eb8-463e-aa8c-3b1624522112 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 07:59:22.441234 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 07:59:22.441234 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 07:59:22.441234 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 07:59:22.441234 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 07:59:22.441234 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 07:59:22.441234 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 07:59:22.441234 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 07:59:22.441234 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 07:59:22.441234 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 07:59:22.441234 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 07:59:22.441234 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 07:59:22.441234 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 28 07:59:22.441234 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 28 07:59:22.441234 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 28 07:59:22.444761 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 28 07:59:22.444761 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 07:59:22.444761 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 07:59:22.444761 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 07:59:22.444761 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 07:59:22.444761 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 07:59:22.444761 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 07:59:22.444761 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 07:59:22.444761 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application with Lock( Jul 28 07:59:22.444761 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 07:59:22.444761 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._enter() Jul 28 07:59:22.444761 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 07:59:22.444761 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 07:59:22.444761 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 07:59:22.444761 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.creator() Jul 28 07:59:22.444761 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 07:59:22.444761 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application created_value = creator( Jul 28 07:59:22.447756 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 28 07:59:22.447756 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 28 07:59:22.447756 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 28 07:59:22.447756 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 28 07:59:22.447756 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 28 07:59:22.447756 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 28 07:59:22.447756 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 07:59:22.447756 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application Jul 28 07:59:22.447756 dv-cinder-851351-1-smb devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 281/533] 10.222.0.42 () {56 vars in 1111 bytes} [Thu Jul 28 07:59:22 2022] GET /identity/v3/projects/service => generated 88 bytes in 378 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 07:59:22.449522 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-982b42c4-607d-4509-ba3d-75aa99b3e285 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 07:59:22.449760 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-982b42c4-607d-4509-ba3d-75aa99b3e285 None admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 07:59:22.457600 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f09df8d9-2eb8-463e-aa8c-3b1624522112 None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 07:59:22.625255 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 07:59:22.650430 dv-cinder-851351-1-smb devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 253/534] 10.222.0.42 () {58 vars in 1282 bytes} [Thu Jul 28 07:59:21 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 693 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 28 07:59:22.662373 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-982b42c4-607d-4509-ba3d-75aa99b3e285 None admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 07:59:22.665483 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f09df8d9-2eb8-463e-aa8c-3b1624522112 None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 07:59:22.727252 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=100 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 07:59:22.750812 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e18b6d-ecd6-43ef-a5a6-845a959e85e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 07:59:22.751475 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e18b6d-ecd6-43ef-a5a6-845a959e85e5 None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 07:59:22.751823 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e18b6d-ecd6-43ef-a5a6-845a959e85e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 07:59:22.752280 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e18b6d-ecd6-43ef-a5a6-845a959e85e5 None admin] PATH_INFO: `/v3/projects` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 07:59:22.753707 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e18b6d-ecd6-43ef-a5a6-845a959e85e5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 07:59:22.754261 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e18b6d-ecd6-43ef-a5a6-845a959e85e5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 07:59:22.757149 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e18b6d-ecd6-43ef-a5a6-845a959e85e5 None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 07:59:22.798492 dv-cinder-851351-1-smb devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 282/535] 10.222.0.42 () {56 vars in 1148 bytes} [Thu Jul 28 07:59:22 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 341 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 07:59:22.801399 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85f0134-8a9b-460d-a394-1d99036de29b None None] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 07:59:22.801895 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85f0134-8a9b-460d-a394-1d99036de29b None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 07:59:22.802344 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85f0134-8a9b-460d-a394-1d99036de29b None None] PATH_INFO: `/` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 07:59:22.811607 dv-cinder-851351-1-smb devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 283/536] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 07:59:22 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 07:59:22.811607 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85f0134-8a9b-460d-a394-1d99036de29b None None] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 07:59:22.912529 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-982b42c4-607d-4509-ba3d-75aa99b3e285 None admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 07:59:22.991234 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-626d02e6-bf12-4caf-9595-637f4b321191 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 07:59:22.993235 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626d02e6-bf12-4caf-9595-637f4b321191 None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 07:59:22.994003 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626d02e6-bf12-4caf-9595-637f4b321191 None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 07:59:22.995114 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626d02e6-bf12-4caf-9595-637f4b321191 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 07:59:23.019440 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-626d02e6-bf12-4caf-9595-637f4b321191 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 07:59:23.023132 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-626d02e6-bf12-4caf-9595-637f4b321191 None admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 07:59:23.028861 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85f0134-8a9b-460d-a394-1d99036de29b None None] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 07:59:23.047973 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application [None req-626d02e6-bf12-4caf-9595-637f4b321191 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 07:59:23.047973 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 07:59:23.047973 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 07:59:23.047973 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 07:59:23.047973 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 07:59:23.047973 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 07:59:23.047973 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 07:59:23.047973 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 07:59:23.047973 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 07:59:23.047973 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 07:59:23.047973 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 07:59:23.047973 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 07:59:23.047973 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 07:59:23.047973 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 07:59:23.047973 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 07:59:23.049622 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 07:59:23.049622 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 07:59:23.049622 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 07:59:23.049622 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 07:59:23.049622 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 07:59:23.049622 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 07:59:23.049622 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 07:59:23.049622 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 07:59:23.049622 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application with Lock( Jul 28 07:59:23.049622 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 07:59:23.049622 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self._enter() Jul 28 07:59:23.049622 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 07:59:23.049622 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 07:59:23.049622 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 07:59:23.049622 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.creator() Jul 28 07:59:23.049622 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 07:59:23.049622 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application created_value = creator( Jul 28 07:59:23.051250 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 07:59:23.051250 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 07:59:23.051250 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 07:59:23.051250 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application Jul 28 07:59:23.051250 dv-cinder-851351-1-smb devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 254/537] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 07:59:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 387 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 07:59:23.051763 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665fafbd-233b-4013-ab8a-07e39b45503a None None] REQUEST_METHOD: `POST` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 07:59:23.052709 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665fafbd-233b-4013-ab8a-07e39b45503a None None] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 07:59:23.052709 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665fafbd-233b-4013-ab8a-07e39b45503a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 07:59:23.072595 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.auth.core [None req-665fafbd-233b-4013-ab8a-07e39b45503a None None] MFA Rules not processed for user `f0666d3a50644a7097367331c1ee1a68`. Rule list: `[]` (Enabled: `True`). {{(pid=80348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 07:59:23.073715 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.fernet_utils [None req-665fafbd-233b-4013-ab8a-07e39b45503a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 07:59:23.100050 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0699f5e4-e817-495e-8f5b-f91d75f77e77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 07:59:23.101615 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0699f5e4-e817-495e-8f5b-f91d75f77e77 None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 07:59:23.102437 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0699f5e4-e817-495e-8f5b-f91d75f77e77 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 07:59:23.103246 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0699f5e4-e817-495e-8f5b-f91d75f77e77 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 07:59:23.105163 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0699f5e4-e817-495e-8f5b-f91d75f77e77 None admin] RBAC: Adding query filter params (role.id=a2d02bc3295c4a33b1fc0775a17a79e6, scope.project.id=139349507026497c98f360774dee737e, user.id=02f10880691d4fd180f96f3e40e1d25f) {{(pid=80347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 07:59:23.106131 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0699f5e4-e817-495e-8f5b-f91d75f77e77 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 07:59:23.109356 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0699f5e4-e817-495e-8f5b-f91d75f77e77 None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 07:59:23.121547 dv-cinder-851351-1-smb devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 284/538] 10.222.0.42 () {56 vars in 1374 bytes} [Thu Jul 28 07:59:22 2022] GET /identity/v3/role_assignments?user.id=02f10880691d4fd180f96f3e40e1d25f&scope.project.id=139349507026497c98f360774dee737e&role.id=a2d02bc3295c4a33b1fc0775a17a79e6 => generated 259 bytes in 315 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 07:59:23.123682 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0699f5e4-e817-495e-8f5b-f91d75f77e77 None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 07:59:23.138708 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 07:59:23.184799 dv-cinder-851351-1-smb devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 255/539] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 07:59:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 07:59:23.223083 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-665fafbd-233b-4013-ab8a-07e39b45503a None None] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 07:59:23.260730 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=100 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 07:59:23.431617 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0699f5e4-e817-495e-8f5b-f91d75f77e77 None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 07:59:23.496825 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-665fafbd-233b-4013-ab8a-07e39b45503a None None] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 07:59:23.502556 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e27ca5cc-43ca-44e7-993d-9ca7321476dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 07:59:23.503206 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27ca5cc-43ca-44e7-993d-9ca7321476dd None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 07:59:23.503484 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27ca5cc-43ca-44e7-993d-9ca7321476dd None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 07:59:23.503758 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27ca5cc-43ca-44e7-993d-9ca7321476dd None admin] PATH_INFO: `/v3/domains` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 07:59:23.504468 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e27ca5cc-43ca-44e7-993d-9ca7321476dd None admin] RBAC: Adding query filter params (name=Default) {{(pid=80347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 07:59:23.504800 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e27ca5cc-43ca-44e7-993d-9ca7321476dd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 07:59:23.506237 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e27ca5cc-43ca-44e7-993d-9ca7321476dd None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 07:59:23.524867 dv-cinder-851351-1-smb devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 285/540] 10.222.0.42 () {56 vars in 1109 bytes} [Thu Jul 28 07:59:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 398 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 07:59:23.526255 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e27ca5cc-43ca-44e7-993d-9ca7321476dd None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 07:59:23.566144 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f017d26a-0f0d-4df8-b2fd-976158b119f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 07:59:23.566889 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f017d26a-0f0d-4df8-b2fd-976158b119f2 None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 07:59:23.567171 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f017d26a-0f0d-4df8-b2fd-976158b119f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 07:59:23.567480 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f017d26a-0f0d-4df8-b2fd-976158b119f2 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 07:59:23.602521 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f017d26a-0f0d-4df8-b2fd-976158b119f2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 07:59:23.612327 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application [None req-f017d26a-0f0d-4df8-b2fd-976158b119f2 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 28 07:59:23.612327 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 07:59:23.612327 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 07:59:23.612327 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 07:59:23.612327 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 07:59:23.612327 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 07:59:23.612327 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 07:59:23.612327 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 07:59:23.612327 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 07:59:23.612327 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 07:59:23.612327 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 07:59:23.612327 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 07:59:23.612327 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 07:59:23.612327 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 07:59:23.612327 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 07:59:23.612327 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 07:59:23.614098 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 07:59:23.614098 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 07:59:23.614098 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 07:59:23.614098 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 07:59:23.614098 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 07:59:23.614098 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 07:59:23.614098 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 07:59:23.614098 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 07:59:23.614098 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 07:59:23.614098 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 07:59:23.614098 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 07:59:23.614098 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application with Lock( Jul 28 07:59:23.614098 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 07:59:23.614098 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self._enter() Jul 28 07:59:23.614098 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 07:59:23.614098 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 07:59:23.615599 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 07:59:23.615599 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.creator() Jul 28 07:59:23.615599 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 07:59:23.615599 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application created_value = creator( Jul 28 07:59:23.615599 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 07:59:23.615599 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 07:59:23.615599 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 07:59:23.615599 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 07:59:23.615599 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 07:59:23.615599 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 07:59:23.615599 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 28 07:59:23.615599 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application Jul 28 07:59:23.615599 dv-cinder-851351-1-smb devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 256/541] 10.222.0.42 () {56 vars in 1102 bytes} [Thu Jul 28 07:59:23 2022] GET /identity/v3/roles/service => generated 85 bytes in 393 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 07:59:23.624583 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f017d26a-0f0d-4df8-b2fd-976158b119f2 None admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 07:59:23.685071 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 07:59:23.694513 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e27ca5cc-43ca-44e7-993d-9ca7321476dd None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 07:59:23.746774 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c48fd7d-becb-41a0-8996-0216eca25fd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 07:59:23.747522 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c48fd7d-becb-41a0-8996-0216eca25fd2 None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 07:59:23.747766 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c48fd7d-becb-41a0-8996-0216eca25fd2 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 07:59:23.748000 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c48fd7d-becb-41a0-8996-0216eca25fd2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 07:59:23.758472 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c48fd7d-becb-41a0-8996-0216eca25fd2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 07:59:23.760021 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c48fd7d-becb-41a0-8996-0216eca25fd2 None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 07:59:23.781891 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application [None req-1c48fd7d-becb-41a0-8996-0216eca25fd2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 07:59:23.781891 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 07:59:23.781891 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 07:59:23.781891 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 07:59:23.781891 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 07:59:23.781891 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 07:59:23.781891 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 07:59:23.781891 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 07:59:23.781891 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 07:59:23.781891 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 07:59:23.781891 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 07:59:23.781891 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 07:59:23.781891 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 28 07:59:23.781891 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 28 07:59:23.781891 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 28 07:59:23.783520 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 28 07:59:23.783520 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 07:59:23.783520 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 07:59:23.783520 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 07:59:23.783520 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 07:59:23.783520 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 07:59:23.783520 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 07:59:23.783520 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 07:59:23.783520 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application with Lock( Jul 28 07:59:23.783520 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 07:59:23.783520 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._enter() Jul 28 07:59:23.783520 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 07:59:23.783520 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 07:59:23.783520 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 07:59:23.783520 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.creator() Jul 28 07:59:23.783520 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 07:59:23.783520 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application created_value = creator( Jul 28 07:59:23.785153 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 28 07:59:23.785153 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 28 07:59:23.785153 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 28 07:59:23.785153 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 28 07:59:23.785153 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 28 07:59:23.785153 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 28 07:59:23.785153 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 07:59:23.785153 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application Jul 28 07:59:23.785153 dv-cinder-851351-1-smb devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 286/542] 10.222.0.42 () {56 vars in 1111 bytes} [Thu Jul 28 07:59:23 2022] GET /identity/v3/projects/service => generated 88 bytes in 259 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 07:59:23.792248 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c48fd7d-becb-41a0-8996-0216eca25fd2 None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 07:59:23.814203 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=100 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 07:59:23.898642 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f017d26a-0f0d-4df8-b2fd-976158b119f2 None admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 07:59:23.919869 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c48fd7d-becb-41a0-8996-0216eca25fd2 None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 07:59:23.948126 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 07:59:23.962108 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-530b7944-fb24-4ae2-93c2-fd08a85aee54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 07:59:23.962544 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530b7944-fb24-4ae2-93c2-fd08a85aee54 None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 07:59:23.962683 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530b7944-fb24-4ae2-93c2-fd08a85aee54 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 07:59:23.962930 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530b7944-fb24-4ae2-93c2-fd08a85aee54 None admin] PATH_INFO: `/v3/projects` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 07:59:23.963690 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-530b7944-fb24-4ae2-93c2-fd08a85aee54 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 07:59:23.963990 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-530b7944-fb24-4ae2-93c2-fd08a85aee54 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 07:59:23.965601 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-530b7944-fb24-4ae2-93c2-fd08a85aee54 None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 07:59:23.972271 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a07880de-3666-4617-aaef-da36fac3a93f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 07:59:23.974013 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07880de-3666-4617-aaef-da36fac3a93f None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 07:59:23.974777 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07880de-3666-4617-aaef-da36fac3a93f None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 07:59:23.975646 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07880de-3666-4617-aaef-da36fac3a93f None admin] PATH_INFO: `/v3/roles` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 07:59:23.977291 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a07880de-3666-4617-aaef-da36fac3a93f None admin] RBAC: Adding query filter params (name=service) {{(pid=80348) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 07:59:23.978134 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a07880de-3666-4617-aaef-da36fac3a93f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 07:59:23.979207 dv-cinder-851351-1-smb devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 287/543] 10.222.0.42 () {56 vars in 1148 bytes} [Thu Jul 28 07:59:23 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 07:59:23.980718 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc5c169-fdae-48ae-bd4e-87f25edd6c01 None None] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 07:59:23.981001 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc5c169-fdae-48ae-bd4e-87f25edd6c01 None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 07:59:23.981274 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc5c169-fdae-48ae-bd4e-87f25edd6c01 None None] PATH_INFO: `/` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 07:59:23.982266 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a07880de-3666-4617-aaef-da36fac3a93f None admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 07:59:23.982881 dv-cinder-851351-1-smb devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 288/544] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 07:59:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 07:59:23.989800 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac241635-69c9-44bb-ba6f-18418b5276f6 None None] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 07:59:23.990209 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac241635-69c9-44bb-ba6f-18418b5276f6 None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 07:59:23.990378 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac241635-69c9-44bb-ba6f-18418b5276f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 07:59:24.000774 dv-cinder-851351-1-smb devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 257/545] 10.222.0.42 () {56 vars in 1103 bytes} [Thu Jul 28 07:59:23 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 377 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 07:59:24.002665 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a07880de-3666-4617-aaef-da36fac3a93f None admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 07:59:24.018600 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.auth.core [None req-ac241635-69c9-44bb-ba6f-18418b5276f6 None None] MFA Rules not processed for user `f0666d3a50644a7097367331c1ee1a68`. Rule list: `[]` (Enabled: `True`). {{(pid=80347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 07:59:24.021444 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-ac241635-69c9-44bb-ba6f-18418b5276f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 07:59:24.156694 dv-cinder-851351-1-smb devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 289/546] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 07:59:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 07:59:24.156694 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac241635-69c9-44bb-ba6f-18418b5276f6 None None] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 07:59:24.211413 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a07880de-3666-4617-aaef-da36fac3a93f None admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 07:59:24.266666 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=100 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 07:59:24.277385 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35030e3a-5bcf-4738-b32f-61470346fafe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 07:59:24.279446 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35030e3a-5bcf-4738-b32f-61470346fafe None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 07:59:24.280159 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35030e3a-5bcf-4738-b32f-61470346fafe None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 07:59:24.280923 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35030e3a-5bcf-4738-b32f-61470346fafe None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 07:59:24.285096 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35030e3a-5bcf-4738-b32f-61470346fafe None admin] RBAC: Adding query filter params (role.id=a2d02bc3295c4a33b1fc0775a17a79e6, scope.project.id=139349507026497c98f360774dee737e, user.id=0f1b1394d91540aaa0bb3f07c78fc812) {{(pid=80348) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 07:59:24.287197 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35030e3a-5bcf-4738-b32f-61470346fafe None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 07:59:24.293359 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35030e3a-5bcf-4738-b32f-61470346fafe None admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 07:59:24.309496 dv-cinder-851351-1-smb devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 258/547] 10.222.0.42 () {56 vars in 1374 bytes} [Thu Jul 28 07:59:24 2022] GET /identity/v3/role_assignments?user.id=0f1b1394d91540aaa0bb3f07c78fc812&scope.project.id=139349507026497c98f360774dee737e&role.id=a2d02bc3295c4a33b1fc0775a17a79e6 => generated 259 bytes in 308 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 07:59:24.311361 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35030e3a-5bcf-4738-b32f-61470346fafe None admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 07:59:24.437479 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac241635-69c9-44bb-ba6f-18418b5276f6 None None] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 07:59:24.455432 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 07:59:24.479089 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e072b7d4-293c-4f51-8a1a-5f45bb729591 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 07:59:24.480349 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e072b7d4-293c-4f51-8a1a-5f45bb729591 None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 07:59:24.480874 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e072b7d4-293c-4f51-8a1a-5f45bb729591 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 07:59:24.481390 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e072b7d4-293c-4f51-8a1a-5f45bb729591 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 07:59:24.517816 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e072b7d4-293c-4f51-8a1a-5f45bb729591 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 07:59:24.519269 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e072b7d4-293c-4f51-8a1a-5f45bb729591 None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 07:59:24.548737 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35030e3a-5bcf-4738-b32f-61470346fafe None admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 07:59:24.556768 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application [None req-e072b7d4-293c-4f51-8a1a-5f45bb729591 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 07:59:24.556768 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 07:59:24.556768 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 07:59:24.556768 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 07:59:24.556768 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 07:59:24.556768 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 07:59:24.556768 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 07:59:24.556768 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 07:59:24.556768 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 07:59:24.556768 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 07:59:24.556768 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 07:59:24.556768 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 07:59:24.556768 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 07:59:24.556768 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 07:59:24.556768 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 07:59:24.557667 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 07:59:24.557667 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 07:59:24.557667 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 07:59:24.557667 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 07:59:24.557667 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 07:59:24.557667 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 07:59:24.557667 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 07:59:24.557667 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 07:59:24.557667 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application with Lock( Jul 28 07:59:24.557667 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 07:59:24.557667 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._enter() Jul 28 07:59:24.557667 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 07:59:24.557667 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 07:59:24.557667 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 07:59:24.557667 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.creator() Jul 28 07:59:24.557667 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 07:59:24.557667 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application created_value = creator( Jul 28 07:59:24.559010 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 07:59:24.559010 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 07:59:24.559010 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 07:59:24.559010 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application Jul 28 07:59:24.559010 dv-cinder-851351-1-smb devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 290/548] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 07:59:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 408 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 07:59:24.569487 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e072b7d4-293c-4f51-8a1a-5f45bb729591 None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 07:59:24.607529 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a2c0eb2-8197-488e-9d1a-c0bc5714f610 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 07:59:24.608616 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2c0eb2-8197-488e-9d1a-c0bc5714f610 None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 07:59:24.609126 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2c0eb2-8197-488e-9d1a-c0bc5714f610 None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 07:59:24.609593 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2c0eb2-8197-488e-9d1a-c0bc5714f610 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 07:59:24.645402 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a2c0eb2-8197-488e-9d1a-c0bc5714f610 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 07:59:24.650965 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application [None req-8a2c0eb2-8197-488e-9d1a-c0bc5714f610 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 28 07:59:24.650965 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 07:59:24.650965 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 07:59:24.650965 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 07:59:24.650965 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 07:59:24.650965 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 07:59:24.650965 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 07:59:24.650965 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 07:59:24.650965 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 07:59:24.650965 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 07:59:24.650965 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 07:59:24.650965 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 07:59:24.650965 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 07:59:24.650965 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 07:59:24.650965 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 07:59:24.650965 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 07:59:24.652070 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 07:59:24.652070 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 07:59:24.652070 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 07:59:24.652070 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 07:59:24.652070 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 07:59:24.652070 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 07:59:24.652070 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 07:59:24.652070 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 07:59:24.652070 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 07:59:24.652070 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 07:59:24.652070 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 07:59:24.652070 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application with Lock( Jul 28 07:59:24.652070 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 07:59:24.652070 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self._enter() Jul 28 07:59:24.652070 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 07:59:24.652070 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 07:59:24.653985 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 07:59:24.653985 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.creator() Jul 28 07:59:24.653985 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 07:59:24.653985 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application created_value = creator( Jul 28 07:59:24.653985 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 07:59:24.653985 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 07:59:24.653985 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 07:59:24.653985 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 07:59:24.653985 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 07:59:24.653985 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 07:59:24.653985 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 28 07:59:24.653985 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application Jul 28 07:59:24.653985 dv-cinder-851351-1-smb devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 259/549] 10.222.0.42 () {56 vars in 1102 bytes} [Thu Jul 28 07:59:24 2022] GET /identity/v3/roles/service => generated 85 bytes in 342 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 07:59:24.661801 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a2c0eb2-8197-488e-9d1a-c0bc5714f610 None admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 07:59:24.723395 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e072b7d4-293c-4f51-8a1a-5f45bb729591 None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 07:59:24.763296 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcbd6635-9269-4b5e-9f46-75203ab7dc12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 07:59:24.768951 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbd6635-9269-4b5e-9f46-75203ab7dc12 None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 07:59:24.769547 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbd6635-9269-4b5e-9f46-75203ab7dc12 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 07:59:24.770020 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbd6635-9269-4b5e-9f46-75203ab7dc12 None admin] PATH_INFO: `/v3/domains` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 07:59:24.771024 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcbd6635-9269-4b5e-9f46-75203ab7dc12 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 07:59:24.771675 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcbd6635-9269-4b5e-9f46-75203ab7dc12 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 07:59:24.773691 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcbd6635-9269-4b5e-9f46-75203ab7dc12 None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 07:59:24.803632 dv-cinder-851351-1-smb devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 291/550] 10.222.0.42 () {56 vars in 1109 bytes} [Thu Jul 28 07:59:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 07:59:24.813243 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcbd6635-9269-4b5e-9f46-75203ab7dc12 None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 07:59:24.819739 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=100 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 07:59:24.875137 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 07:59:24.905379 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a2c0eb2-8197-488e-9d1a-c0bc5714f610 None admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 07:59:24.945182 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e520ae6f-5870-4fe3-abdd-6366d87d4116 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 07:59:24.946146 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e520ae6f-5870-4fe3-abdd-6366d87d4116 None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 07:59:24.946596 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e520ae6f-5870-4fe3-abdd-6366d87d4116 None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 07:59:24.947081 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e520ae6f-5870-4fe3-abdd-6366d87d4116 None admin] PATH_INFO: `/v3/roles` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 07:59:24.948124 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e520ae6f-5870-4fe3-abdd-6366d87d4116 None admin] RBAC: Adding query filter params (name=service) {{(pid=80348) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 07:59:24.948779 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e520ae6f-5870-4fe3-abdd-6366d87d4116 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 07:59:24.950398 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e520ae6f-5870-4fe3-abdd-6366d87d4116 None admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 07:59:24.958417 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcbd6635-9269-4b5e-9f46-75203ab7dc12 None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 07:59:24.962062 dv-cinder-851351-1-smb devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 260/551] 10.222.0.42 () {56 vars in 1103 bytes} [Thu Jul 28 07:59:24 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 301 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 07:59:24.964105 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68152d8f-bc4a-4255-a210-d40c8d319474 None None] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 07:59:24.964676 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68152d8f-bc4a-4255-a210-d40c8d319474 None None] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 07:59:24.965172 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68152d8f-bc4a-4255-a210-d40c8d319474 None None] PATH_INFO: `/` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 07:59:24.967022 dv-cinder-851351-1-smb devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 261/552] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 07:59:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 07:59:24.967987 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68152d8f-bc4a-4255-a210-d40c8d319474 None None] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 07:59:25.000091 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5574b8bb-f028-414c-9fc5-8e1161c79e22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 07:59:25.000901 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5574b8bb-f028-414c-9fc5-8e1161c79e22 None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 07:59:25.001218 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5574b8bb-f028-414c-9fc5-8e1161c79e22 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 07:59:25.001552 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5574b8bb-f028-414c-9fc5-8e1161c79e22 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 07:59:25.009554 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5574b8bb-f028-414c-9fc5-8e1161c79e22 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 07:59:25.010792 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5574b8bb-f028-414c-9fc5-8e1161c79e22 None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 07:59:25.023591 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application [None req-5574b8bb-f028-414c-9fc5-8e1161c79e22 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 28 07:59:25.023591 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 07:59:25.023591 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 07:59:25.023591 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 07:59:25.023591 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 07:59:25.023591 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 07:59:25.023591 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 07:59:25.023591 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 07:59:25.023591 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 07:59:25.023591 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 07:59:25.023591 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 07:59:25.023591 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 07:59:25.023591 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 28 07:59:25.023591 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 28 07:59:25.023591 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 28 07:59:25.023591 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 28 07:59:25.024554 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 07:59:25.024554 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 07:59:25.024554 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 28 07:59:25.024554 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 07:59:25.024554 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 28 07:59:25.024554 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 07:59:25.024554 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 07:59:25.024554 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 07:59:25.024554 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 07:59:25.024554 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 07:59:25.024554 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 07:59:25.024554 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application with Lock( Jul 28 07:59:25.024554 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 07:59:25.024554 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._enter() Jul 28 07:59:25.024554 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 07:59:25.024554 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 07:59:25.024554 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 07:59:25.024554 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.creator() Jul 28 07:59:25.025851 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 07:59:25.025851 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application created_value = creator( Jul 28 07:59:25.025851 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 28 07:59:25.025851 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 28 07:59:25.025851 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 28 07:59:25.025851 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 28 07:59:25.025851 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 28 07:59:25.025851 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 28 07:59:25.025851 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 28 07:59:25.025851 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application Jul 28 07:59:25.025851 dv-cinder-851351-1-smb devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 292/553] 10.222.0.42 () {56 vars in 1096 bytes} [Thu Jul 28 07:59:24 2022] GET /identity/v3/users/swift => generated 83 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 07:59:25.026901 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d604f291-2505-4fe0-9205-c7982fb0d291 None None] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 07:59:25.027247 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d604f291-2505-4fe0-9205-c7982fb0d291 None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 07:59:25.027579 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d604f291-2505-4fe0-9205-c7982fb0d291 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 07:59:25.046448 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.auth.core [None req-d604f291-2505-4fe0-9205-c7982fb0d291 None None] MFA Rules not processed for user `f0666d3a50644a7097367331c1ee1a68`. Rule list: `[]` (Enabled: `True`). {{(pid=80347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 07:59:25.048119 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-d604f291-2505-4fe0-9205-c7982fb0d291 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 07:59:25.087770 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68152d8f-bc4a-4255-a210-d40c8d319474 None None] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 07:59:25.117244 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=100 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 07:59:25.124308 dv-cinder-851351-1-smb devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 293/554] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 07:59:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 07:59:25.126195 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d604f291-2505-4fe0-9205-c7982fb0d291 None None] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 07:59:25.127723 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab4a8f6-771b-4f0b-bebf-12858835a7a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 07:59:25.128862 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab4a8f6-771b-4f0b-bebf-12858835a7a7 None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 07:59:25.129480 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab4a8f6-771b-4f0b-bebf-12858835a7a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 07:59:25.130035 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab4a8f6-771b-4f0b-bebf-12858835a7a7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 07:59:25.143379 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ab4a8f6-771b-4f0b-bebf-12858835a7a7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 07:59:25.145384 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ab4a8f6-771b-4f0b-bebf-12858835a7a7 None admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 07:59:25.159738 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 07:59:25.163402 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application [None req-7ab4a8f6-771b-4f0b-bebf-12858835a7a7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 07:59:25.163402 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 07:59:25.163402 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 07:59:25.163402 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 07:59:25.163402 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 07:59:25.163402 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 07:59:25.163402 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 07:59:25.163402 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 07:59:25.163402 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 07:59:25.163402 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 07:59:25.163402 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 07:59:25.163402 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 07:59:25.163402 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 07:59:25.163402 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 07:59:25.163402 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 07:59:25.164254 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 07:59:25.164254 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 07:59:25.164254 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 07:59:25.164254 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 07:59:25.164254 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 07:59:25.164254 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 07:59:25.164254 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 07:59:25.164254 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 07:59:25.164254 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application with Lock( Jul 28 07:59:25.164254 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 07:59:25.164254 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self._enter() Jul 28 07:59:25.164254 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 07:59:25.164254 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 07:59:25.164254 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 07:59:25.164254 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.creator() Jul 28 07:59:25.164254 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 07:59:25.164254 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application created_value = creator( Jul 28 07:59:25.165342 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 07:59:25.165342 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 07:59:25.165342 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 07:59:25.165342 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application Jul 28 07:59:25.167579 dv-cinder-851351-1-smb devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 262/555] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 07:59:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 07:59:25.168749 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab4a8f6-771b-4f0b-bebf-12858835a7a7 None admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 07:59:25.255228 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d604f291-2505-4fe0-9205-c7982fb0d291 None None] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 07:59:25.287704 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab4a8f6-771b-4f0b-bebf-12858835a7a7 None admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 07:59:25.292794 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba8c6c1-af79-45b0-afde-fd0b7bc8f29a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 07:59:25.293536 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba8c6c1-af79-45b0-afde-fd0b7bc8f29a None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 07:59:25.293881 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba8c6c1-af79-45b0-afde-fd0b7bc8f29a None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 07:59:25.294217 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba8c6c1-af79-45b0-afde-fd0b7bc8f29a None admin] PATH_INFO: `/v3/users` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 07:59:25.295094 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ba8c6c1-af79-45b0-afde-fd0b7bc8f29a None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 07:59:25.295460 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ba8c6c1-af79-45b0-afde-fd0b7bc8f29a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 07:59:25.297024 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ba8c6c1-af79-45b0-afde-fd0b7bc8f29a None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 07:59:25.318630 dv-cinder-851351-1-smb devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 294/556] 10.222.0.42 () {56 vars in 1135 bytes} [Thu Jul 28 07:59:25 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 07:59:25.319595 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba8c6c1-af79-45b0-afde-fd0b7bc8f29a None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 07:59:25.330278 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-822abd9e-2dee-4841-8892-8d67864f918c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 07:59:25.331263 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822abd9e-2dee-4841-8892-8d67864f918c None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 07:59:25.331719 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822abd9e-2dee-4841-8892-8d67864f918c None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 07:59:25.332293 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822abd9e-2dee-4841-8892-8d67864f918c None admin] PATH_INFO: `/v3/roles/service` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 07:59:25.345612 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-822abd9e-2dee-4841-8892-8d67864f918c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 07:59:25.352033 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application [None req-822abd9e-2dee-4841-8892-8d67864f918c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 28 07:59:25.352033 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 07:59:25.352033 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 07:59:25.352033 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 07:59:25.352033 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 07:59:25.352033 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 07:59:25.352033 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 07:59:25.352033 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 07:59:25.352033 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 07:59:25.352033 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 07:59:25.352033 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 07:59:25.352033 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 07:59:25.352033 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 07:59:25.352033 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 07:59:25.352033 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 07:59:25.352033 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 07:59:25.353232 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 07:59:25.353232 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 07:59:25.353232 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 07:59:25.353232 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 07:59:25.353232 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 07:59:25.353232 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 07:59:25.353232 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 07:59:25.353232 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 07:59:25.353232 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 07:59:25.353232 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 07:59:25.353232 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 07:59:25.353232 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application with Lock( Jul 28 07:59:25.353232 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 07:59:25.353232 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self._enter() Jul 28 07:59:25.353232 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 07:59:25.353232 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 07:59:25.354590 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 07:59:25.354590 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.creator() Jul 28 07:59:25.354590 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 07:59:25.354590 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application created_value = creator( Jul 28 07:59:25.354590 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 07:59:25.354590 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 07:59:25.354590 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 07:59:25.354590 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 07:59:25.354590 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 07:59:25.354590 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 07:59:25.354590 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 28 07:59:25.354590 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application Jul 28 07:59:25.357717 dv-cinder-851351-1-smb devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 263/557] 10.222.0.42 () {56 vars in 1102 bytes} [Thu Jul 28 07:59:25 2022] GET /identity/v3/roles/service => generated 85 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 07:59:25.358942 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-822abd9e-2dee-4841-8892-8d67864f918c None admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 07:59:25.394549 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=100 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 07:59:25.410555 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 07:59:25.441350 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba8c6c1-af79-45b0-afde-fd0b7bc8f29a None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 07:59:25.477198 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-822abd9e-2dee-4841-8892-8d67864f918c None admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 07:59:25.480291 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-550e9aac-2e33-40cb-a3c3-9b36d57d8ec9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 07:59:25.481561 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550e9aac-2e33-40cb-a3c3-9b36d57d8ec9 None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 07:59:25.481561 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550e9aac-2e33-40cb-a3c3-9b36d57d8ec9 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 07:59:25.481763 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550e9aac-2e33-40cb-a3c3-9b36d57d8ec9 None admin] PATH_INFO: `/v3/domains` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 07:59:25.482407 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-550e9aac-2e33-40cb-a3c3-9b36d57d8ec9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 07:59:25.482793 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-550e9aac-2e33-40cb-a3c3-9b36d57d8ec9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 07:59:25.484249 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-550e9aac-2e33-40cb-a3c3-9b36d57d8ec9 None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 07:59:25.498081 dv-cinder-851351-1-smb devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 295/558] 10.222.0.42 () {56 vars in 1109 bytes} [Thu Jul 28 07:59:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 07:59:25.499206 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-550e9aac-2e33-40cb-a3c3-9b36d57d8ec9 None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 07:59:25.520164 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f4275e8-5259-4ea0-8455-e98536c00d01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 07:59:25.521328 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4275e8-5259-4ea0-8455-e98536c00d01 None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 07:59:25.521795 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4275e8-5259-4ea0-8455-e98536c00d01 None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 07:59:25.522250 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4275e8-5259-4ea0-8455-e98536c00d01 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 07:59:25.624564 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-550e9aac-2e33-40cb-a3c3-9b36d57d8ec9 None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 07:59:25.642031 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f4275e8-5259-4ea0-8455-e98536c00d01 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 07:59:25.644239 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f4275e8-5259-4ea0-8455-e98536c00d01 None admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 07:59:25.663312 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f231c0c2-591d-4e80-af4a-f7cb5f63b8c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 07:59:25.663993 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f231c0c2-591d-4e80-af4a-f7cb5f63b8c3 None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 07:59:25.664333 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f231c0c2-591d-4e80-af4a-f7cb5f63b8c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 07:59:25.664692 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f231c0c2-591d-4e80-af4a-f7cb5f63b8c3 None admin] PATH_INFO: `/v3/roles` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 07:59:25.665576 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f231c0c2-591d-4e80-af4a-f7cb5f63b8c3 None admin] RBAC: Adding query filter params (name=service) {{(pid=80347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 07:59:25.666118 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f231c0c2-591d-4e80-af4a-f7cb5f63b8c3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 07:59:25.667525 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f231c0c2-591d-4e80-af4a-f7cb5f63b8c3 None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 07:59:25.669302 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 07:59:25.684755 dv-cinder-851351-1-smb devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 296/559] 10.222.0.42 () {56 vars in 1103 bytes} [Thu Jul 28 07:59:25 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 07:59:25.685893 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f231c0c2-591d-4e80-af4a-f7cb5f63b8c3 None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 07:59:25.699992 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=100 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 07:59:25.793276 dv-cinder-851351-1-smb devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 264/560] 10.222.0.42 () {58 vars in 1282 bytes} [Thu Jul 28 07:59:25 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 435 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 28 07:59:25.794520 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f4275e8-5259-4ea0-8455-e98536c00d01 None admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 07:59:25.811009 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f231c0c2-591d-4e80-af4a-f7cb5f63b8c3 None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 07:59:25.874788 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c51527-4ca6-49cc-98b3-106976471e53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 07:59:25.875380 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c51527-4ca6-49cc-98b3-106976471e53 None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 07:59:25.875654 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c51527-4ca6-49cc-98b3-106976471e53 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 07:59:25.875925 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c51527-4ca6-49cc-98b3-106976471e53 None admin] PATH_INFO: `/v3/users/glance` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 07:59:25.885749 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c51527-4ca6-49cc-98b3-106976471e53 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 07:59:25.888128 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c51527-4ca6-49cc-98b3-106976471e53 None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 07:59:25.903584 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application [None req-34c51527-4ca6-49cc-98b3-106976471e53 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jul 28 07:59:25.903584 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 07:59:25.903584 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 07:59:25.903584 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 07:59:25.903584 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 07:59:25.903584 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 07:59:25.903584 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 07:59:25.903584 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 07:59:25.903584 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 07:59:25.903584 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 07:59:25.903584 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 07:59:25.903584 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 07:59:25.903584 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 28 07:59:25.903584 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 28 07:59:25.903584 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 28 07:59:25.903584 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 28 07:59:25.904592 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 07:59:25.904592 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 07:59:25.904592 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 28 07:59:25.904592 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 07:59:25.904592 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 28 07:59:25.904592 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 07:59:25.904592 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 07:59:25.904592 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 07:59:25.904592 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 07:59:25.904592 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 07:59:25.904592 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 07:59:25.904592 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application with Lock( Jul 28 07:59:25.904592 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 07:59:25.904592 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._enter() Jul 28 07:59:25.904592 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 07:59:25.904592 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 07:59:25.904592 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 07:59:25.904592 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.creator() Jul 28 07:59:25.905556 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 07:59:25.905556 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application created_value = creator( Jul 28 07:59:25.905556 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 28 07:59:25.905556 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 28 07:59:25.905556 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 28 07:59:25.905556 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 28 07:59:25.905556 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 28 07:59:25.905556 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 28 07:59:25.905556 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jul 28 07:59:25.905556 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application Jul 28 07:59:25.909967 dv-cinder-851351-1-smb devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 297/561] 10.222.0.42 () {56 vars in 1099 bytes} [Thu Jul 28 07:59:25 2022] GET /identity/v3/users/glance => generated 84 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 07:59:25.911445 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e29ad3-f666-47c7-8af3-6b1d5f6d58bc None None] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 07:59:25.911748 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e29ad3-f666-47c7-8af3-6b1d5f6d58bc None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 07:59:25.912006 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e29ad3-f666-47c7-8af3-6b1d5f6d58bc None None] PATH_INFO: `/` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 07:59:25.918163 dv-cinder-851351-1-smb devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 298/562] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 07:59:25 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 07:59:25.919131 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e29ad3-f666-47c7-8af3-6b1d5f6d58bc None None] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 07:59:25.921444 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f4275e8-5259-4ea0-8455-e98536c00d01 None admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 07:59:25.960033 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=100 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 07:59:25.972002 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18bde574-010b-425b-b8e4-861a884594fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 07:59:25.973391 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18bde574-010b-425b-b8e4-861a884594fa None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 07:59:25.973909 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18bde574-010b-425b-b8e4-861a884594fa None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 07:59:25.974902 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18bde574-010b-425b-b8e4-861a884594fa None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 07:59:25.988611 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18bde574-010b-425b-b8e4-861a884594fa None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 07:59:25.990119 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18bde574-010b-425b-b8e4-861a884594fa None admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 07:59:26.007977 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application [None req-18bde574-010b-425b-b8e4-861a884594fa None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 07:59:26.007977 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 07:59:26.007977 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 07:59:26.007977 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 07:59:26.007977 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 07:59:26.007977 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 07:59:26.007977 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 07:59:26.007977 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 07:59:26.007977 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 07:59:26.007977 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 07:59:26.007977 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 07:59:26.007977 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 07:59:26.007977 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 07:59:26.007977 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 07:59:26.007977 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 07:59:26.009708 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 07:59:26.009708 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 07:59:26.009708 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 07:59:26.009708 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 07:59:26.009708 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 07:59:26.009708 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 07:59:26.009708 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 07:59:26.009708 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 07:59:26.009708 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application with Lock( Jul 28 07:59:26.009708 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 07:59:26.009708 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self._enter() Jul 28 07:59:26.009708 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 07:59:26.009708 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 07:59:26.009708 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 07:59:26.009708 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.creator() Jul 28 07:59:26.009708 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 07:59:26.009708 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application created_value = creator( Jul 28 07:59:26.012047 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 07:59:26.012047 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 07:59:26.012047 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 07:59:26.012047 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application Jul 28 07:59:26.014510 dv-cinder-851351-1-smb devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 265/563] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 07:59:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 07:59:26.015516 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18bde574-010b-425b-b8e4-861a884594fa None admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 07:59:26.047431 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 07:59:26.144703 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e29ad3-f666-47c7-8af3-6b1d5f6d58bc None None] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 07:59:26.220497 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb32c66-09d6-42ef-b7fa-357cc211f78d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 07:59:26.221524 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb32c66-09d6-42ef-b7fa-357cc211f78d None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 07:59:26.221945 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb32c66-09d6-42ef-b7fa-357cc211f78d None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 07:59:26.222328 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb32c66-09d6-42ef-b7fa-357cc211f78d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 07:59:26.237373 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fb32c66-09d6-42ef-b7fa-357cc211f78d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 07:59:26.239124 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fb32c66-09d6-42ef-b7fa-357cc211f78d None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 07:59:26.239499 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18bde574-010b-425b-b8e4-861a884594fa None admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 07:59:26.260846 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application [None req-4fb32c66-09d6-42ef-b7fa-357cc211f78d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 07:59:26.260846 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 07:59:26.260846 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 07:59:26.260846 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 07:59:26.260846 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 07:59:26.260846 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 07:59:26.260846 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 07:59:26.260846 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 07:59:26.260846 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 07:59:26.260846 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 07:59:26.260846 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 07:59:26.260846 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 07:59:26.260846 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 07:59:26.260846 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 07:59:26.260846 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 07:59:26.262605 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 07:59:26.262605 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 07:59:26.262605 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 07:59:26.262605 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 07:59:26.262605 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 07:59:26.262605 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 07:59:26.262605 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 07:59:26.262605 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 07:59:26.262605 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application with Lock( Jul 28 07:59:26.262605 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 07:59:26.262605 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._enter() Jul 28 07:59:26.262605 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 07:59:26.262605 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 07:59:26.262605 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 07:59:26.262605 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.creator() Jul 28 07:59:26.262605 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 07:59:26.262605 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application created_value = creator( Jul 28 07:59:26.264340 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 07:59:26.264340 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 07:59:26.264340 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 07:59:26.264340 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application Jul 28 07:59:26.264340 dv-cinder-851351-1-smb devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 299/564] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 07:59:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 344 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 07:59:26.265889 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386b753b-58f7-4ad5-a1d9-ce9ce102138d None None] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 07:59:26.265889 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386b753b-58f7-4ad5-a1d9-ce9ce102138d None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 07:59:26.266416 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386b753b-58f7-4ad5-a1d9-ce9ce102138d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 07:59:26.297267 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.auth.core [None req-386b753b-58f7-4ad5-a1d9-ce9ce102138d None None] MFA Rules not processed for user `f0666d3a50644a7097367331c1ee1a68`. Rule list: `[]` (Enabled: `True`). {{(pid=80347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 07:59:26.299092 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-386b753b-58f7-4ad5-a1d9-ce9ce102138d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 07:59:26.306646 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d631a3cc-1648-4e74-bbd7-007d730401ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 07:59:26.307659 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d631a3cc-1648-4e74-bbd7-007d730401ac None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 07:59:26.308129 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d631a3cc-1648-4e74-bbd7-007d730401ac None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 07:59:26.308568 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d631a3cc-1648-4e74-bbd7-007d730401ac None admin] PATH_INFO: `/v3/users` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 07:59:26.309993 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d631a3cc-1648-4e74-bbd7-007d730401ac None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80348) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 07:59:26.310478 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d631a3cc-1648-4e74-bbd7-007d730401ac None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 07:59:26.313058 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d631a3cc-1648-4e74-bbd7-007d730401ac None admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 07:59:26.348168 dv-cinder-851351-1-smb devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 266/565] 10.222.0.42 () {56 vars in 1137 bytes} [Thu Jul 28 07:59:26 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 333 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 07:59:26.349648 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d631a3cc-1648-4e74-bbd7-007d730401ac None admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 07:59:26.413820 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=100 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 07:59:26.420727 dv-cinder-851351-1-smb devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 300/566] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 07:59:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 07:59:26.420727 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-386b753b-58f7-4ad5-a1d9-ce9ce102138d None None] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 07:59:26.482911 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 07:59:26.524089 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d631a3cc-1648-4e74-bbd7-007d730401ac None admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 07:59:26.574087 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be78a03-164e-46d7-b0e9-311c6ceedbba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 07:59:26.575464 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be78a03-164e-46d7-b0e9-311c6ceedbba None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 07:59:26.575912 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be78a03-164e-46d7-b0e9-311c6ceedbba None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 07:59:26.576341 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be78a03-164e-46d7-b0e9-311c6ceedbba None admin] PATH_INFO: `/v3/domains` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 07:59:26.577597 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3be78a03-164e-46d7-b0e9-311c6ceedbba None admin] RBAC: Adding query filter params (name=Default) {{(pid=80348) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 07:59:26.578121 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3be78a03-164e-46d7-b0e9-311c6ceedbba None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 07:59:26.580994 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3be78a03-164e-46d7-b0e9-311c6ceedbba None admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 07:59:26.581444 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-386b753b-58f7-4ad5-a1d9-ce9ce102138d None None] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 07:59:26.602110 dv-cinder-851351-1-smb devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 267/567] 10.222.0.42 () {56 vars in 1109 bytes} [Thu Jul 28 07:59:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 07:59:26.603617 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be78a03-164e-46d7-b0e9-311c6ceedbba None admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 07:59:26.635037 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9aa94f3-d370-4d16-b7b7-13bfc2c2e837 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 07:59:26.636122 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9aa94f3-d370-4d16-b7b7-13bfc2c2e837 None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 07:59:26.636551 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9aa94f3-d370-4d16-b7b7-13bfc2c2e837 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 07:59:26.636927 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9aa94f3-d370-4d16-b7b7-13bfc2c2e837 None admin] PATH_INFO: `/v3/domains` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 07:59:26.637656 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9aa94f3-d370-4d16-b7b7-13bfc2c2e837 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 07:59:26.638086 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9aa94f3-d370-4d16-b7b7-13bfc2c2e837 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 07:59:26.639497 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9aa94f3-d370-4d16-b7b7-13bfc2c2e837 None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 07:59:26.660145 dv-cinder-851351-1-smb devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 301/568] 10.222.0.42 () {56 vars in 1109 bytes} [Thu Jul 28 07:59:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 07:59:26.660145 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9aa94f3-d370-4d16-b7b7-13bfc2c2e837 None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 07:59:26.764354 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=100 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 07:59:26.769012 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be78a03-164e-46d7-b0e9-311c6ceedbba None admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 07:59:26.787245 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 07:59:26.794050 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9aa94f3-d370-4d16-b7b7-13bfc2c2e837 None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 07:59:26.813125 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d16917-9969-4d4a-9ad5-132e63d4bc5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 07:59:26.813781 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d16917-9969-4d4a-9ad5-132e63d4bc5a None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 07:59:26.814065 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d16917-9969-4d4a-9ad5-132e63d4bc5a None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 07:59:26.814299 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d16917-9969-4d4a-9ad5-132e63d4bc5a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 07:59:26.825985 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1d16917-9969-4d4a-9ad5-132e63d4bc5a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 07:59:26.827437 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1d16917-9969-4d4a-9ad5-132e63d4bc5a None admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 07:59:26.843090 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application [None req-c1d16917-9969-4d4a-9ad5-132e63d4bc5a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 07:59:26.843090 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 07:59:26.843090 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 07:59:26.843090 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 07:59:26.843090 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 07:59:26.843090 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 07:59:26.843090 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 07:59:26.843090 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 07:59:26.843090 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 07:59:26.843090 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 07:59:26.843090 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 07:59:26.843090 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 07:59:26.843090 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 07:59:26.843090 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 07:59:26.843090 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 07:59:26.845190 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 07:59:26.845190 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 07:59:26.845190 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 07:59:26.845190 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 07:59:26.845190 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 07:59:26.845190 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 07:59:26.845190 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 07:59:26.845190 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 07:59:26.845190 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application with Lock( Jul 28 07:59:26.845190 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 07:59:26.845190 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self._enter() Jul 28 07:59:26.845190 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 07:59:26.845190 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 07:59:26.845190 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 07:59:26.845190 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.creator() Jul 28 07:59:26.845190 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 07:59:26.845190 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application created_value = creator( Jul 28 07:59:26.846969 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 07:59:26.846969 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 07:59:26.846969 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 07:59:26.846969 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application Jul 28 07:59:26.846969 dv-cinder-851351-1-smb devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 268/569] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 07:59:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 242 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 07:59:26.846969 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d16917-9969-4d4a-9ad5-132e63d4bc5a None admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 07:59:26.860375 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460af185-4eca-4248-be5a-fa7afbc1b9c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 07:59:26.861452 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460af185-4eca-4248-be5a-fa7afbc1b9c4 None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 07:59:26.861927 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460af185-4eca-4248-be5a-fa7afbc1b9c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 07:59:26.862385 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460af185-4eca-4248-be5a-fa7afbc1b9c4 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 07:59:26.881211 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-460af185-4eca-4248-be5a-fa7afbc1b9c4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 07:59:26.891250 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application [None req-460af185-4eca-4248-be5a-fa7afbc1b9c4 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 28 07:59:26.891250 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 07:59:26.891250 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 07:59:26.891250 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 07:59:26.891250 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 07:59:26.891250 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 07:59:26.891250 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 07:59:26.891250 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 07:59:26.891250 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 07:59:26.891250 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 07:59:26.891250 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 07:59:26.891250 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 07:59:26.891250 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 07:59:26.891250 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 07:59:26.891250 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 07:59:26.891250 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 07:59:26.892219 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 07:59:26.892219 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 07:59:26.892219 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 07:59:26.892219 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 07:59:26.892219 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 07:59:26.892219 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 07:59:26.892219 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 07:59:26.892219 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 07:59:26.892219 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 07:59:26.892219 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 07:59:26.892219 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 07:59:26.892219 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application with Lock( Jul 28 07:59:26.892219 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 07:59:26.892219 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._enter() Jul 28 07:59:26.892219 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 07:59:26.892219 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 07:59:26.893187 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 07:59:26.893187 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.creator() Jul 28 07:59:26.893187 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 07:59:26.893187 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application created_value = creator( Jul 28 07:59:26.893187 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 07:59:26.893187 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 07:59:26.893187 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 07:59:26.893187 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 07:59:26.893187 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 07:59:26.893187 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 07:59:26.893187 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 28 07:59:26.893187 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application Jul 28 07:59:26.893915 dv-cinder-851351-1-smb devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 302/570] 10.222.0.42 () {56 vars in 1102 bytes} [Thu Jul 28 07:59:26 2022] GET /identity/v3/roles/service => generated 85 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 07:59:26.894958 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460af185-4eca-4248-be5a-fa7afbc1b9c4 None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 07:59:26.991618 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d16917-9969-4d4a-9ad5-132e63d4bc5a None admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 07:59:27.032840 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58256b54-afa3-4da7-a5d4-d8d20fad675d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 07:59:27.033417 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58256b54-afa3-4da7-a5d4-d8d20fad675d None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 07:59:27.033692 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58256b54-afa3-4da7-a5d4-d8d20fad675d None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 07:59:27.033958 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58256b54-afa3-4da7-a5d4-d8d20fad675d None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 07:59:27.042607 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58256b54-afa3-4da7-a5d4-d8d20fad675d None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 07:59:27.044083 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58256b54-afa3-4da7-a5d4-d8d20fad675d None admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 07:59:27.054389 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460af185-4eca-4248-be5a-fa7afbc1b9c4 None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 07:59:27.056406 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application [None req-58256b54-afa3-4da7-a5d4-d8d20fad675d None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jul 28 07:59:27.056406 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 07:59:27.056406 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 07:59:27.056406 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 07:59:27.056406 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 07:59:27.056406 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 07:59:27.056406 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 07:59:27.056406 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 07:59:27.056406 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 07:59:27.056406 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 07:59:27.056406 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 07:59:27.056406 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 07:59:27.056406 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 28 07:59:27.056406 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 28 07:59:27.056406 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 28 07:59:27.056406 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 28 07:59:27.058819 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 07:59:27.058819 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 07:59:27.058819 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 28 07:59:27.058819 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 07:59:27.058819 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 28 07:59:27.058819 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 07:59:27.058819 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 07:59:27.058819 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 07:59:27.058819 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 07:59:27.058819 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 07:59:27.058819 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 07:59:27.058819 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application with Lock( Jul 28 07:59:27.058819 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 07:59:27.058819 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self._enter() Jul 28 07:59:27.058819 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 07:59:27.058819 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 07:59:27.058819 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 07:59:27.058819 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.creator() Jul 28 07:59:27.061180 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 07:59:27.061180 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application created_value = creator( Jul 28 07:59:27.061180 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 28 07:59:27.061180 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 28 07:59:27.061180 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 28 07:59:27.061180 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 28 07:59:27.061180 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 28 07:59:27.061180 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 28 07:59:27.061180 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jul 28 07:59:27.061180 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application Jul 28 07:59:27.061180 dv-cinder-851351-1-smb devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 269/571] 10.222.0.42 () {56 vars in 1099 bytes} [Thu Jul 28 07:59:26 2022] GET /identity/v3/users/cinder => generated 84 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 07:59:27.061180 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58256b54-afa3-4da7-a5d4-d8d20fad675d None admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 07:59:27.079766 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=100 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 07:59:27.111877 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5169da16-30c3-419d-8dd2-cf8c0fcb4d82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 07:59:27.113025 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5169da16-30c3-419d-8dd2-cf8c0fcb4d82 None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 07:59:27.113520 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5169da16-30c3-419d-8dd2-cf8c0fcb4d82 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 07:59:27.113999 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5169da16-30c3-419d-8dd2-cf8c0fcb4d82 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 07:59:27.126660 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5169da16-30c3-419d-8dd2-cf8c0fcb4d82 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 07:59:27.127753 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5169da16-30c3-419d-8dd2-cf8c0fcb4d82 None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 07:59:27.140791 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application [None req-5169da16-30c3-419d-8dd2-cf8c0fcb4d82 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 07:59:27.140791 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 07:59:27.140791 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 07:59:27.140791 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 07:59:27.140791 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 07:59:27.140791 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 07:59:27.140791 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 07:59:27.140791 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 07:59:27.140791 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 07:59:27.140791 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 07:59:27.140791 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 07:59:27.140791 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 07:59:27.140791 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 28 07:59:27.140791 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 28 07:59:27.140791 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 28 07:59:27.142668 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 28 07:59:27.142668 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 07:59:27.142668 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 07:59:27.142668 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 07:59:27.142668 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 07:59:27.142668 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 07:59:27.142668 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 07:59:27.142668 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 07:59:27.142668 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application with Lock( Jul 28 07:59:27.142668 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 07:59:27.142668 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._enter() Jul 28 07:59:27.142668 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 07:59:27.142668 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 07:59:27.142668 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 07:59:27.142668 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.creator() Jul 28 07:59:27.142668 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 07:59:27.142668 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application created_value = creator( Jul 28 07:59:27.144483 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 28 07:59:27.144483 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 28 07:59:27.144483 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 28 07:59:27.144483 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 28 07:59:27.144483 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 28 07:59:27.144483 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 28 07:59:27.144483 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 07:59:27.144483 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application Jul 28 07:59:27.144483 dv-cinder-851351-1-smb devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 303/572] 10.222.0.42 () {56 vars in 1111 bytes} [Thu Jul 28 07:59:26 2022] GET /identity/v3/projects/service => generated 88 bytes in 248 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 07:59:27.144483 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5169da16-30c3-419d-8dd2-cf8c0fcb4d82 None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 07:59:27.170820 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 07:59:27.185785 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58256b54-afa3-4da7-a5d4-d8d20fad675d None admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 07:59:27.231298 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94407c1d-379f-4813-80c7-56bfdfcedf0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 07:59:27.232272 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94407c1d-379f-4813-80c7-56bfdfcedf0e None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 07:59:27.232737 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94407c1d-379f-4813-80c7-56bfdfcedf0e None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 07:59:27.233184 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94407c1d-379f-4813-80c7-56bfdfcedf0e None admin] PATH_INFO: `/v3/domains` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 07:59:27.234319 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94407c1d-379f-4813-80c7-56bfdfcedf0e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80348) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 07:59:27.234801 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94407c1d-379f-4813-80c7-56bfdfcedf0e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 07:59:27.236974 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94407c1d-379f-4813-80c7-56bfdfcedf0e None admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 07:59:27.255204 dv-cinder-851351-1-smb devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 270/573] 10.222.0.42 () {56 vars in 1109 bytes} [Thu Jul 28 07:59:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 07:59:27.257350 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56fa27d-6d83-4676-a7f3-4f396ab4a4bb None None] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 07:59:27.257840 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56fa27d-6d83-4676-a7f3-4f396ab4a4bb None None] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 07:59:27.258304 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56fa27d-6d83-4676-a7f3-4f396ab4a4bb None None] PATH_INFO: `/` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 07:59:27.260652 dv-cinder-851351-1-smb devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 271/574] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 07:59:27 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 07:59:27.262029 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e56fa27d-6d83-4676-a7f3-4f396ab4a4bb None None] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 07:59:27.294170 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5169da16-30c3-419d-8dd2-cf8c0fcb4d82 None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 07:59:27.339050 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94ed00e-c54b-437e-8c77-acbcd35db9f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 07:59:27.339807 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94ed00e-c54b-437e-8c77-acbcd35db9f8 None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 07:59:27.340207 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94ed00e-c54b-437e-8c77-acbcd35db9f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 07:59:27.340641 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94ed00e-c54b-437e-8c77-acbcd35db9f8 None admin] PATH_INFO: `/v3/roles` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 07:59:27.341574 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c94ed00e-c54b-437e-8c77-acbcd35db9f8 None admin] RBAC: Adding query filter params (name=service) {{(pid=80347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 07:59:27.341966 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c94ed00e-c54b-437e-8c77-acbcd35db9f8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 07:59:27.343462 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c94ed00e-c54b-437e-8c77-acbcd35db9f8 None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 07:59:27.353524 dv-cinder-851351-1-smb devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 304/575] 10.222.0.42 () {56 vars in 1103 bytes} [Thu Jul 28 07:59:27 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 07:59:27.354425 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94ed00e-c54b-437e-8c77-acbcd35db9f8 None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 07:59:27.363159 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=100 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 07:59:27.413051 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e56fa27d-6d83-4676-a7f3-4f396ab4a4bb None None] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 07:59:27.460917 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 07:59:27.461225 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c210e9a-0543-4ac4-aeca-028195f900e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 07:59:27.462084 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c210e9a-0543-4ac4-aeca-028195f900e4 None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 07:59:27.462540 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c210e9a-0543-4ac4-aeca-028195f900e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 07:59:27.462992 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c210e9a-0543-4ac4-aeca-028195f900e4 None admin] PATH_INFO: `/v3/users` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 07:59:27.464603 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c210e9a-0543-4ac4-aeca-028195f900e4 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80348) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 07:59:27.464976 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c210e9a-0543-4ac4-aeca-028195f900e4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 07:59:27.466860 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c210e9a-0543-4ac4-aeca-028195f900e4 None admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 07:59:27.483642 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94ed00e-c54b-437e-8c77-acbcd35db9f8 None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 07:59:27.488722 dv-cinder-851351-1-smb devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 272/576] 10.222.0.42 () {56 vars in 1137 bytes} [Thu Jul 28 07:59:27 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 07:59:27.489807 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c210e9a-0543-4ac4-aeca-028195f900e4 None admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 07:59:27.541470 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f8045ea-44b9-43cb-8334-56091e074de3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 07:59:27.542552 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8045ea-44b9-43cb-8334-56091e074de3 None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 07:59:27.543008 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8045ea-44b9-43cb-8334-56091e074de3 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 07:59:27.543464 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8045ea-44b9-43cb-8334-56091e074de3 None admin] PATH_INFO: `/v3/projects` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 07:59:27.544898 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f8045ea-44b9-43cb-8334-56091e074de3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 07:59:27.545363 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f8045ea-44b9-43cb-8334-56091e074de3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 07:59:27.547940 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f8045ea-44b9-43cb-8334-56091e074de3 None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 07:59:27.566735 dv-cinder-851351-1-smb devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 305/577] 10.222.0.42 () {56 vars in 1148 bytes} [Thu Jul 28 07:59:27 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 07:59:27.568010 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93b1484-5e0d-4dca-95b9-9e0d48e8f418 None None] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 07:59:27.568341 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93b1484-5e0d-4dca-95b9-9e0d48e8f418 None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 07:59:27.568562 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93b1484-5e0d-4dca-95b9-9e0d48e8f418 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 07:59:27.587819 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.auth.core [None req-f93b1484-5e0d-4dca-95b9-9e0d48e8f418 None None] MFA Rules not processed for user `f0666d3a50644a7097367331c1ee1a68`. Rule list: `[]` (Enabled: `True`). {{(pid=80347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 07:59:27.589085 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-f93b1484-5e0d-4dca-95b9-9e0d48e8f418 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 07:59:27.611383 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c210e9a-0543-4ac4-aeca-028195f900e4 None admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 07:59:27.662700 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=100 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 07:59:27.664713 dv-cinder-851351-1-smb devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 306/578] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 07:59:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 07:59:27.665937 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93b1484-5e0d-4dca-95b9-9e0d48e8f418 None None] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 07:59:27.676116 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa2e3ec8-7530-4f21-a1c6-80058ea62ad9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 07:59:27.677208 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2e3ec8-7530-4f21-a1c6-80058ea62ad9 None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 07:59:27.677650 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2e3ec8-7530-4f21-a1c6-80058ea62ad9 None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 07:59:27.678097 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2e3ec8-7530-4f21-a1c6-80058ea62ad9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 07:59:27.690348 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa2e3ec8-7530-4f21-a1c6-80058ea62ad9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 07:59:27.693040 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa2e3ec8-7530-4f21-a1c6-80058ea62ad9 None admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 07:59:27.714063 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application [None req-aa2e3ec8-7530-4f21-a1c6-80058ea62ad9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 07:59:27.714063 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 07:59:27.714063 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 07:59:27.714063 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 07:59:27.714063 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 07:59:27.714063 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 07:59:27.714063 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 07:59:27.714063 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 07:59:27.714063 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 07:59:27.714063 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 07:59:27.714063 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 07:59:27.714063 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 07:59:27.714063 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 28 07:59:27.714063 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 28 07:59:27.714063 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 28 07:59:27.715627 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 28 07:59:27.715627 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 07:59:27.715627 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 07:59:27.715627 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 07:59:27.715627 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 07:59:27.715627 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 07:59:27.715627 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 07:59:27.715627 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 07:59:27.715627 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application with Lock( Jul 28 07:59:27.715627 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 07:59:27.715627 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self._enter() Jul 28 07:59:27.715627 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 07:59:27.715627 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 07:59:27.715627 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 07:59:27.715627 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.creator() Jul 28 07:59:27.715627 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 07:59:27.715627 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application created_value = creator( Jul 28 07:59:27.716989 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 28 07:59:27.716989 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 28 07:59:27.716989 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 28 07:59:27.716989 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 28 07:59:27.716989 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 28 07:59:27.716989 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 28 07:59:27.716989 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 07:59:27.716989 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application Jul 28 07:59:27.716989 dv-cinder-851351-1-smb devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 273/579] 10.222.0.42 () {56 vars in 1111 bytes} [Thu Jul 28 07:59:27 2022] GET /identity/v3/projects/service => generated 88 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 07:59:27.718773 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa2e3ec8-7530-4f21-a1c6-80058ea62ad9 None admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 07:59:27.775300 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 07:59:27.814981 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93b1484-5e0d-4dca-95b9-9e0d48e8f418 None None] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 07:59:27.837120 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa2e3ec8-7530-4f21-a1c6-80058ea62ad9 None admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 07:59:27.860291 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cba69ad-2c32-4f23-b956-b0209ad51427 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 07:59:27.861444 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cba69ad-2c32-4f23-b956-b0209ad51427 None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 07:59:27.861974 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cba69ad-2c32-4f23-b956-b0209ad51427 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 07:59:27.862475 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cba69ad-2c32-4f23-b956-b0209ad51427 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 07:59:27.873797 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff478ce-2dc7-4e55-9635-706c9e8f68f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 07:59:27.874445 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff478ce-2dc7-4e55-9635-706c9e8f68f1 None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 07:59:27.874724 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff478ce-2dc7-4e55-9635-706c9e8f68f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 07:59:27.874997 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff478ce-2dc7-4e55-9635-706c9e8f68f1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 07:59:27.881333 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cba69ad-2c32-4f23-b956-b0209ad51427 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 07:59:27.884108 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cba69ad-2c32-4f23-b956-b0209ad51427 None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 07:59:27.885633 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dff478ce-2dc7-4e55-9635-706c9e8f68f1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 07:59:27.887141 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dff478ce-2dc7-4e55-9635-706c9e8f68f1 None admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 07:59:27.902669 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application [None req-dff478ce-2dc7-4e55-9635-706c9e8f68f1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 07:59:27.902669 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 07:59:27.902669 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 07:59:27.902669 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 07:59:27.902669 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 07:59:27.902669 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 07:59:27.902669 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 07:59:27.902669 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 07:59:27.902669 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 07:59:27.902669 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 07:59:27.902669 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 07:59:27.902669 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 07:59:27.902669 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 07:59:27.902669 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 07:59:27.902669 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 07:59:27.904441 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 07:59:27.904441 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 07:59:27.904441 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 07:59:27.904441 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 07:59:27.904441 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 07:59:27.904441 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 07:59:27.904441 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 07:59:27.904441 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 07:59:27.904441 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application with Lock( Jul 28 07:59:27.904441 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 07:59:27.904441 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self._enter() Jul 28 07:59:27.904441 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 07:59:27.904441 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 07:59:27.904441 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 07:59:27.904441 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.creator() Jul 28 07:59:27.904441 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 07:59:27.904441 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application created_value = creator( Jul 28 07:59:27.906360 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 07:59:27.906360 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 07:59:27.906360 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 07:59:27.906360 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application Jul 28 07:59:27.906360 dv-cinder-851351-1-smb devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 274/580] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 07:59:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 07:59:27.906360 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff478ce-2dc7-4e55-9635-706c9e8f68f1 None admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 07:59:27.912878 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application [None req-5cba69ad-2c32-4f23-b956-b0209ad51427 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 07:59:27.912878 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 07:59:27.912878 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 07:59:27.912878 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 07:59:27.912878 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 07:59:27.912878 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 07:59:27.912878 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 07:59:27.912878 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 07:59:27.912878 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 07:59:27.912878 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 07:59:27.912878 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 07:59:27.912878 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 07:59:27.912878 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 07:59:27.912878 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 07:59:27.912878 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 07:59:27.914566 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 07:59:27.914566 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 07:59:27.914566 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 07:59:27.914566 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 07:59:27.914566 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 07:59:27.914566 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 07:59:27.914566 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 07:59:27.914566 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 07:59:27.914566 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application with Lock( Jul 28 07:59:27.914566 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 07:59:27.914566 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._enter() Jul 28 07:59:27.914566 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 07:59:27.914566 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 07:59:27.914566 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 07:59:27.914566 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.creator() Jul 28 07:59:27.914566 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 07:59:27.914566 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application created_value = creator( Jul 28 07:59:27.916323 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 07:59:27.916323 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 07:59:27.916323 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 07:59:27.916323 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application Jul 28 07:59:27.916323 dv-cinder-851351-1-smb devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 307/581] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 07:59:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 250 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 07:59:27.916901 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cba69ad-2c32-4f23-b956-b0209ad51427 None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 07:59:27.963005 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=100 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 07:59:28.034428 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cba69ad-2c32-4f23-b956-b0209ad51427 None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 07:59:28.058833 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff478ce-2dc7-4e55-9635-706c9e8f68f1 None admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 07:59:28.059639 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 07:59:28.077578 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e214644-ac61-4cf5-b4fe-3e062ef0b75c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 07:59:28.078584 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e214644-ac61-4cf5-b4fe-3e062ef0b75c None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 07:59:28.079008 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e214644-ac61-4cf5-b4fe-3e062ef0b75c None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 07:59:28.079804 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e214644-ac61-4cf5-b4fe-3e062ef0b75c None admin] PATH_INFO: `/v3/roles/service` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 07:59:28.096591 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e214644-ac61-4cf5-b4fe-3e062ef0b75c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 07:59:28.106168 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application [None req-3e214644-ac61-4cf5-b4fe-3e062ef0b75c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 28 07:59:28.106168 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 07:59:28.106168 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 07:59:28.106168 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 07:59:28.106168 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 07:59:28.106168 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 07:59:28.106168 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 07:59:28.106168 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 07:59:28.106168 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 07:59:28.106168 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 07:59:28.106168 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 07:59:28.106168 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 07:59:28.106168 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 07:59:28.106168 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 07:59:28.106168 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 07:59:28.106168 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 07:59:28.108088 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 07:59:28.108088 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 07:59:28.108088 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 07:59:28.108088 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 07:59:28.108088 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 07:59:28.108088 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 07:59:28.108088 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 07:59:28.108088 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 07:59:28.108088 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 07:59:28.108088 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 07:59:28.108088 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 07:59:28.108088 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application with Lock( Jul 28 07:59:28.108088 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 07:59:28.108088 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._enter() Jul 28 07:59:28.108088 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 07:59:28.108088 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 07:59:28.109682 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 07:59:28.109682 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.creator() Jul 28 07:59:28.109682 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 07:59:28.109682 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application created_value = creator( Jul 28 07:59:28.109682 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 07:59:28.109682 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 07:59:28.109682 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 07:59:28.109682 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 07:59:28.109682 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 07:59:28.109682 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 07:59:28.109682 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 28 07:59:28.109682 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application Jul 28 07:59:28.109682 dv-cinder-851351-1-smb devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 308/582] 10.222.0.42 () {56 vars in 1102 bytes} [Thu Jul 28 07:59:27 2022] GET /identity/v3/roles/service => generated 85 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 07:59:28.109682 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e214644-ac61-4cf5-b4fe-3e062ef0b75c None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 07:59:28.113528 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0cf243-5b04-4cff-b1eb-c2e4c03006ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 07:59:28.114166 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0cf243-5b04-4cff-b1eb-c2e4c03006ff None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 07:59:28.114442 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0cf243-5b04-4cff-b1eb-c2e4c03006ff None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 07:59:28.114716 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0cf243-5b04-4cff-b1eb-c2e4c03006ff None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 07:59:28.115554 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef0cf243-5b04-4cff-b1eb-c2e4c03006ff None admin] RBAC: Adding query filter params (role.id=a2d02bc3295c4a33b1fc0775a17a79e6, scope.project.id=139349507026497c98f360774dee737e, user.id=fe8c81659f704e14b8f0e00856a5a9a5) {{(pid=80348) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 07:59:28.115863 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef0cf243-5b04-4cff-b1eb-c2e4c03006ff None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 07:59:28.117357 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef0cf243-5b04-4cff-b1eb-c2e4c03006ff None admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 07:59:28.123514 dv-cinder-851351-1-smb devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 275/583] 10.222.0.42 () {56 vars in 1374 bytes} [Thu Jul 28 07:59:27 2022] GET /identity/v3/role_assignments?user.id=fe8c81659f704e14b8f0e00856a5a9a5&scope.project.id=139349507026497c98f360774dee737e&role.id=a2d02bc3295c4a33b1fc0775a17a79e6 => generated 259 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 07:59:28.124336 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0cf243-5b04-4cff-b1eb-c2e4c03006ff None admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 07:59:28.243471 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e214644-ac61-4cf5-b4fe-3e062ef0b75c None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 07:59:28.293378 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d7cf53-7e86-41f7-b213-7e8505dca39f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 07:59:28.294498 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d7cf53-7e86-41f7-b213-7e8505dca39f None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 07:59:28.295006 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d7cf53-7e86-41f7-b213-7e8505dca39f None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 07:59:28.295496 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d7cf53-7e86-41f7-b213-7e8505dca39f None admin] PATH_INFO: `/v3/projects` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 07:59:28.297047 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d7cf53-7e86-41f7-b213-7e8505dca39f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 07:59:28.297609 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d7cf53-7e86-41f7-b213-7e8505dca39f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 07:59:28.298687 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0cf243-5b04-4cff-b1eb-c2e4c03006ff None admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 07:59:28.300385 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d7cf53-7e86-41f7-b213-7e8505dca39f None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 07:59:28.308850 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=100 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 07:59:28.323076 dv-cinder-851351-1-smb devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 309/584] 10.222.0.42 () {56 vars in 1148 bytes} [Thu Jul 28 07:59:28 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 07:59:28.324805 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d7cf53-7e86-41f7-b213-7e8505dca39f None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 07:59:28.360044 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a0d1b6-a51e-4626-b73f-56e8f41e9790 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 07:59:28.361177 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a0d1b6-a51e-4626-b73f-56e8f41e9790 None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 07:59:28.361678 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a0d1b6-a51e-4626-b73f-56e8f41e9790 None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 07:59:28.362175 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a0d1b6-a51e-4626-b73f-56e8f41e9790 None admin] PATH_INFO: `/v3/domains` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 07:59:28.363497 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a0d1b6-a51e-4626-b73f-56e8f41e9790 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80348) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 07:59:28.364414 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a0d1b6-a51e-4626-b73f-56e8f41e9790 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 07:59:28.366641 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a0d1b6-a51e-4626-b73f-56e8f41e9790 None admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 07:59:28.386840 dv-cinder-851351-1-smb devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 276/585] 10.222.0.42 () {56 vars in 1109 bytes} [Thu Jul 28 07:59:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 07:59:28.388285 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a0d1b6-a51e-4626-b73f-56e8f41e9790 None admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 07:59:28.397223 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 07:59:28.479123 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d7cf53-7e86-41f7-b213-7e8505dca39f None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 07:59:28.540934 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84bcd3c-f285-4d17-b5bb-0049a60cee33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 07:59:28.542150 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84bcd3c-f285-4d17-b5bb-0049a60cee33 None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 07:59:28.542696 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84bcd3c-f285-4d17-b5bb-0049a60cee33 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 07:59:28.543366 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84bcd3c-f285-4d17-b5bb-0049a60cee33 None admin] PATH_INFO: `/v3/domains` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 07:59:28.544496 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f84bcd3c-f285-4d17-b5bb-0049a60cee33 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 07:59:28.545080 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f84bcd3c-f285-4d17-b5bb-0049a60cee33 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 07:59:28.547794 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f84bcd3c-f285-4d17-b5bb-0049a60cee33 None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 07:59:28.549701 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a0d1b6-a51e-4626-b73f-56e8f41e9790 None admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 07:59:28.563586 dv-cinder-851351-1-smb devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 310/586] 10.222.0.42 () {56 vars in 1109 bytes} [Thu Jul 28 07:59:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 07:59:28.564452 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84bcd3c-f285-4d17-b5bb-0049a60cee33 None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 07:59:28.623349 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a766d4-2415-4d62-8dff-909e2ffe9857 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 07:59:28.624727 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a766d4-2415-4d62-8dff-909e2ffe9857 None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 07:59:28.625436 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a766d4-2415-4d62-8dff-909e2ffe9857 None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 07:59:28.625890 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a766d4-2415-4d62-8dff-909e2ffe9857 None admin] PATH_INFO: `/v3/roles` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 07:59:28.627198 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72a766d4-2415-4d62-8dff-909e2ffe9857 None admin] RBAC: Adding query filter params (name=service) {{(pid=80348) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 07:59:28.627729 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72a766d4-2415-4d62-8dff-909e2ffe9857 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 07:59:28.630319 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72a766d4-2415-4d62-8dff-909e2ffe9857 None admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 07:59:28.648709 dv-cinder-851351-1-smb devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 277/587] 10.222.0.42 () {56 vars in 1103 bytes} [Thu Jul 28 07:59:28 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 07:59:28.650148 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a766d4-2415-4d62-8dff-909e2ffe9857 None admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 07:59:28.696807 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=100 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 07:59:28.716500 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84bcd3c-f285-4d17-b5bb-0049a60cee33 None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 07:59:28.719246 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 07:59:28.778926 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd57e66-a057-42b6-8392-b24b43cc19bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 07:59:28.779966 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd57e66-a057-42b6-8392-b24b43cc19bf None admin] REQUEST_METHOD: `PUT` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 07:59:28.780378 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd57e66-a057-42b6-8392-b24b43cc19bf None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 07:59:28.780840 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd57e66-a057-42b6-8392-b24b43cc19bf None admin] PATH_INFO: `/v3/projects/139349507026497c98f360774dee737e/users/0973def3ea2b4b43ac0e855eff7fcc77/roles/a2d02bc3295c4a33b1fc0775a17a79e6` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 07:59:28.799784 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdd57e66-a057-42b6-8392-b24b43cc19bf None admin] RBAC: Authorizing `identity:create_grant(project_id=139349507026497c98f360774dee737e, user_id=0973def3ea2b4b43ac0e855eff7fcc77, role_id=a2d02bc3295c4a33b1fc0775a17a79e6)` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 07:59:28.801707 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdd57e66-a057-42b6-8392-b24b43cc19bf None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 07:59:28.818417 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a766d4-2415-4d62-8dff-909e2ffe9857 None admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 07:59:28.829020 dv-cinder-851351-1-smb devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 311/588] 10.222.0.42 () {58 vars in 1439 bytes} [Thu Jul 28 07:59:28 2022] PUT /identity/v3/projects/139349507026497c98f360774dee737e/users/0973def3ea2b4b43ac0e855eff7fcc77/roles/a2d02bc3295c4a33b1fc0775a17a79e6 => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 07:59:28.829020 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd57e66-a057-42b6-8392-b24b43cc19bf None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 07:59:28.881433 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a821327-1326-4c20-a80e-1ecb7c73c84d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 07:59:28.882357 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a821327-1326-4c20-a80e-1ecb7c73c84d None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 07:59:28.882809 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a821327-1326-4c20-a80e-1ecb7c73c84d None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 07:59:28.883312 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a821327-1326-4c20-a80e-1ecb7c73c84d None admin] PATH_INFO: `/v3/projects/service` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 07:59:28.897164 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a821327-1326-4c20-a80e-1ecb7c73c84d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 07:59:28.899731 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a821327-1326-4c20-a80e-1ecb7c73c84d None admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 07:59:28.921175 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application [None req-3a821327-1326-4c20-a80e-1ecb7c73c84d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 07:59:28.921175 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 07:59:28.921175 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 07:59:28.921175 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 07:59:28.921175 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 07:59:28.921175 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 07:59:28.921175 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 07:59:28.921175 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 07:59:28.921175 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 07:59:28.921175 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 07:59:28.921175 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 07:59:28.921175 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 07:59:28.921175 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 28 07:59:28.921175 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 28 07:59:28.921175 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 28 07:59:28.922908 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 28 07:59:28.922908 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 07:59:28.922908 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 07:59:28.922908 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 07:59:28.922908 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 07:59:28.922908 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 07:59:28.922908 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 07:59:28.922908 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 07:59:28.922908 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application with Lock( Jul 28 07:59:28.922908 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 07:59:28.922908 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self._enter() Jul 28 07:59:28.922908 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 07:59:28.922908 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 07:59:28.922908 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 07:59:28.922908 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.creator() Jul 28 07:59:28.922908 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 07:59:28.922908 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application created_value = creator( Jul 28 07:59:28.924624 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 28 07:59:28.924624 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 28 07:59:28.924624 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 28 07:59:28.924624 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 28 07:59:28.924624 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 28 07:59:28.924624 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 28 07:59:28.924624 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 07:59:28.924624 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application Jul 28 07:59:28.924624 dv-cinder-851351-1-smb devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 278/589] 10.222.0.42 () {56 vars in 1111 bytes} [Thu Jul 28 07:59:28 2022] GET /identity/v3/projects/service => generated 88 bytes in 274 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 07:59:28.927186 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a821327-1326-4c20-a80e-1ecb7c73c84d None admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 07:59:29.041502 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd57e66-a057-42b6-8392-b24b43cc19bf None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 07:59:29.101420 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dabb792b-53a1-4957-a3e2-cac329a65e13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 07:59:29.102543 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabb792b-53a1-4957-a3e2-cac329a65e13 None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 07:59:29.103018 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabb792b-53a1-4957-a3e2-cac329a65e13 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 07:59:29.103491 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabb792b-53a1-4957-a3e2-cac329a65e13 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 07:59:29.118369 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dabb792b-53a1-4957-a3e2-cac329a65e13 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 07:59:29.122739 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dabb792b-53a1-4957-a3e2-cac329a65e13 None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 07:59:29.129733 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=100 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 07:59:29.149173 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a821327-1326-4c20-a80e-1ecb7c73c84d None admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 07:59:29.152887 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application [None req-dabb792b-53a1-4957-a3e2-cac329a65e13 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 28 07:59:29.152887 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 07:59:29.152887 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 07:59:29.152887 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 07:59:29.152887 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 07:59:29.152887 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 07:59:29.152887 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 07:59:29.152887 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 07:59:29.152887 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 07:59:29.152887 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 07:59:29.152887 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 07:59:29.152887 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 07:59:29.152887 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 28 07:59:29.152887 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 28 07:59:29.152887 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 28 07:59:29.152887 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 28 07:59:29.154728 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 07:59:29.154728 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 07:59:29.154728 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 28 07:59:29.154728 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 07:59:29.154728 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 28 07:59:29.154728 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 07:59:29.154728 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 07:59:29.154728 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 07:59:29.154728 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 07:59:29.154728 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 07:59:29.154728 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 07:59:29.154728 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application with Lock( Jul 28 07:59:29.154728 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 07:59:29.154728 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._enter() Jul 28 07:59:29.154728 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 07:59:29.154728 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 07:59:29.154728 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 07:59:29.154728 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.creator() Jul 28 07:59:29.156606 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 07:59:29.156606 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application created_value = creator( Jul 28 07:59:29.156606 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 28 07:59:29.156606 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 28 07:59:29.156606 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 28 07:59:29.156606 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 28 07:59:29.156606 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 28 07:59:29.156606 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 28 07:59:29.156606 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 28 07:59:29.156606 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application Jul 28 07:59:29.156606 dv-cinder-851351-1-smb devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 312/590] 10.222.0.42 () {56 vars in 1093 bytes} [Thu Jul 28 07:59:28 2022] GET /identity/v3/users/nova => generated 82 bytes in 331 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 07:59:29.156606 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dabb792b-53a1-4957-a3e2-cac329a65e13 None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 07:59:29.200516 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f2b8f4-90af-4909-b1c7-bb5d0125d8f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 07:59:29.201560 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f2b8f4-90af-4909-b1c7-bb5d0125d8f4 None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 07:59:29.201983 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 07:59:29.202199 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f2b8f4-90af-4909-b1c7-bb5d0125d8f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 07:59:29.202641 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f2b8f4-90af-4909-b1c7-bb5d0125d8f4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 07:59:29.215538 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f2b8f4-90af-4909-b1c7-bb5d0125d8f4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 07:59:29.217384 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f2b8f4-90af-4909-b1c7-bb5d0125d8f4 None admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 07:59:29.233281 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application [None req-02f2b8f4-90af-4909-b1c7-bb5d0125d8f4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 07:59:29.233281 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 07:59:29.233281 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 07:59:29.233281 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 07:59:29.233281 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 07:59:29.233281 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 07:59:29.233281 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 07:59:29.233281 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 07:59:29.233281 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 07:59:29.233281 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 07:59:29.233281 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 07:59:29.233281 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 07:59:29.233281 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 07:59:29.233281 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 07:59:29.233281 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 07:59:29.234235 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 07:59:29.234235 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 07:59:29.234235 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 07:59:29.234235 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 07:59:29.234235 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 07:59:29.234235 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 07:59:29.234235 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 07:59:29.234235 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 07:59:29.234235 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application with Lock( Jul 28 07:59:29.234235 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 07:59:29.234235 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self._enter() Jul 28 07:59:29.234235 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 07:59:29.234235 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 07:59:29.234235 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 07:59:29.234235 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.creator() Jul 28 07:59:29.234235 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 07:59:29.234235 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application created_value = creator( Jul 28 07:59:29.235112 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 07:59:29.235112 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 07:59:29.235112 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 07:59:29.235112 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application Jul 28 07:59:29.237393 dv-cinder-851351-1-smb devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 279/591] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 07:59:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 313 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 07:59:29.238436 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f2b8f4-90af-4909-b1c7-bb5d0125d8f4 None admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 07:59:29.349018 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f2b8f4-90af-4909-b1c7-bb5d0125d8f4 None admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 07:59:29.383115 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dabb792b-53a1-4957-a3e2-cac329a65e13 None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 07:59:29.385903 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79789a8c-ff4a-45e3-84b0-4301d8d84744 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 07:59:29.387165 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79789a8c-ff4a-45e3-84b0-4301d8d84744 None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 07:59:29.387621 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79789a8c-ff4a-45e3-84b0-4301d8d84744 None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 07:59:29.388069 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79789a8c-ff4a-45e3-84b0-4301d8d84744 None admin] PATH_INFO: `/v3/users` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 07:59:29.389085 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79789a8c-ff4a-45e3-84b0-4301d8d84744 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80348) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 07:59:29.389583 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79789a8c-ff4a-45e3-84b0-4301d8d84744 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 07:59:29.391217 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79789a8c-ff4a-45e3-84b0-4301d8d84744 None admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 07:59:29.401894 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=100 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 07:59:29.411590 dv-cinder-851351-1-smb devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 280/592] 10.222.0.42 () {56 vars in 1133 bytes} [Thu Jul 28 07:59:29 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 07:59:29.412642 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79789a8c-ff4a-45e3-84b0-4301d8d84744 None admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 07:59:29.459292 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-658bf410-382f-4ad7-9e26-d7630b53fabb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 07:59:29.460924 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658bf410-382f-4ad7-9e26-d7630b53fabb None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 07:59:29.461633 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658bf410-382f-4ad7-9e26-d7630b53fabb None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 07:59:29.462314 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658bf410-382f-4ad7-9e26-d7630b53fabb None admin] PATH_INFO: `/v3/projects` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 07:59:29.464103 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-658bf410-382f-4ad7-9e26-d7630b53fabb None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 07:59:29.465062 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-658bf410-382f-4ad7-9e26-d7630b53fabb None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 07:59:29.468206 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-658bf410-382f-4ad7-9e26-d7630b53fabb None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 07:59:29.497257 dv-cinder-851351-1-smb devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 313/593] 10.222.0.42 () {56 vars in 1148 bytes} [Thu Jul 28 07:59:29 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 342 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 07:59:29.499431 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-658bf410-382f-4ad7-9e26-d7630b53fabb None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 07:59:29.536405 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79789a8c-ff4a-45e3-84b0-4301d8d84744 None admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 07:59:29.572087 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99cb036-9a96-49bf-9f31-7219b805e15c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 07:59:29.572733 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99cb036-9a96-49bf-9f31-7219b805e15c None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 07:59:29.573011 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99cb036-9a96-49bf-9f31-7219b805e15c None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 07:59:29.573278 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99cb036-9a96-49bf-9f31-7219b805e15c None admin] PATH_INFO: `/v3/domains` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 07:59:29.574114 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c99cb036-9a96-49bf-9f31-7219b805e15c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80348) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 07:59:29.574412 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c99cb036-9a96-49bf-9f31-7219b805e15c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 07:59:29.575809 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c99cb036-9a96-49bf-9f31-7219b805e15c None admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 07:59:29.593388 dv-cinder-851351-1-smb devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 281/594] 10.222.0.42 () {56 vars in 1109 bytes} [Thu Jul 28 07:59:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 07:59:29.594590 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99cb036-9a96-49bf-9f31-7219b805e15c None admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 07:59:29.637928 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 07:59:29.659437 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=100 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 07:59:29.698362 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-658bf410-382f-4ad7-9e26-d7630b53fabb None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 07:59:29.709815 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99cb036-9a96-49bf-9f31-7219b805e15c None admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 07:59:29.754781 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b127acde-7df5-4789-8f81-9b8f81587ec3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 07:59:29.756217 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b127acde-7df5-4789-8f81-9b8f81587ec3 None admin] REQUEST_METHOD: `PUT` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 07:59:29.757017 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b127acde-7df5-4789-8f81-9b8f81587ec3 None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 07:59:29.757709 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b127acde-7df5-4789-8f81-9b8f81587ec3 None admin] PATH_INFO: `/v3/projects/139349507026497c98f360774dee737e/users/009cfabce8d64f9b894a6a0979d2a213/roles/a2d02bc3295c4a33b1fc0775a17a79e6` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 07:59:29.769398 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3f4122-05c9-4a37-beb6-5c0a2ca3eea1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 07:59:29.770493 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3f4122-05c9-4a37-beb6-5c0a2ca3eea1 None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 07:59:29.770973 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3f4122-05c9-4a37-beb6-5c0a2ca3eea1 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 07:59:29.771453 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3f4122-05c9-4a37-beb6-5c0a2ca3eea1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 07:59:29.786141 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b127acde-7df5-4789-8f81-9b8f81587ec3 None admin] RBAC: Authorizing `identity:create_grant(project_id=139349507026497c98f360774dee737e, user_id=009cfabce8d64f9b894a6a0979d2a213, role_id=a2d02bc3295c4a33b1fc0775a17a79e6)` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 07:59:29.789394 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b127acde-7df5-4789-8f81-9b8f81587ec3 None admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 07:59:29.790445 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc3f4122-05c9-4a37-beb6-5c0a2ca3eea1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 07:59:29.793351 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc3f4122-05c9-4a37-beb6-5c0a2ca3eea1 None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 07:59:29.823462 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application [None req-bc3f4122-05c9-4a37-beb6-5c0a2ca3eea1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 07:59:29.823462 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 07:59:29.823462 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 07:59:29.823462 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 07:59:29.823462 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 07:59:29.823462 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 07:59:29.823462 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 07:59:29.823462 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 07:59:29.823462 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 07:59:29.823462 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 07:59:29.823462 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 07:59:29.823462 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 07:59:29.823462 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 07:59:29.823462 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 07:59:29.823462 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 07:59:29.825885 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 07:59:29.825885 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 07:59:29.825885 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 07:59:29.825885 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 07:59:29.825885 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 07:59:29.825885 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 07:59:29.825885 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 07:59:29.825885 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 07:59:29.825885 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application with Lock( Jul 28 07:59:29.825885 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 07:59:29.825885 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._enter() Jul 28 07:59:29.825885 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 07:59:29.825885 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 07:59:29.825885 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 07:59:29.825885 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.creator() Jul 28 07:59:29.825885 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 07:59:29.825885 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application created_value = creator( Jul 28 07:59:29.827800 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 07:59:29.827800 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 07:59:29.827800 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 07:59:29.827800 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application Jul 28 07:59:29.827800 dv-cinder-851351-1-smb devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 314/596] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 07:59:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 328 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 07:59:29.827800 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3f4122-05c9-4a37-beb6-5c0a2ca3eea1 None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 07:59:29.828583 dv-cinder-851351-1-smb devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 282/596] 10.222.0.42 () {58 vars in 1439 bytes} [Thu Jul 28 07:59:29 2022] PUT /identity/v3/projects/139349507026497c98f360774dee737e/users/009cfabce8d64f9b894a6a0979d2a213/roles/a2d02bc3295c4a33b1fc0775a17a79e6 => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 07:59:29.832824 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b127acde-7df5-4789-8f81-9b8f81587ec3 None admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 07:59:30.026078 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3f4122-05c9-4a37-beb6-5c0a2ca3eea1 None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 07:59:30.060852 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b127acde-7df5-4789-8f81-9b8f81587ec3 None admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 07:59:30.071177 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 07:59:30.086998 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 07:59:30.105583 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ae4f7c-1deb-4db7-be6b-6fdf01cb0c0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 07:59:30.107999 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ae4f7c-1deb-4db7-be6b-6fdf01cb0c0e None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 07:59:30.108431 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ae4f7c-1deb-4db7-be6b-6fdf01cb0c0e None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 07:59:30.108913 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ae4f7c-1deb-4db7-be6b-6fdf01cb0c0e None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 07:59:30.124344 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0ae4f7c-1deb-4db7-be6b-6fdf01cb0c0e None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 07:59:30.126388 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0ae4f7c-1deb-4db7-be6b-6fdf01cb0c0e None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 07:59:30.139926 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29baf080-0c22-49ce-8d65-e9b2453eace5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 07:59:30.141625 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29baf080-0c22-49ce-8d65-e9b2453eace5 None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 07:59:30.142353 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29baf080-0c22-49ce-8d65-e9b2453eace5 None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 07:59:30.143041 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29baf080-0c22-49ce-8d65-e9b2453eace5 None admin] PATH_INFO: `/v3/domains` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 07:59:30.144483 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29baf080-0c22-49ce-8d65-e9b2453eace5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80348) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 07:59:30.145335 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29baf080-0c22-49ce-8d65-e9b2453eace5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 07:59:30.147977 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application [None req-b0ae4f7c-1deb-4db7-be6b-6fdf01cb0c0e None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jul 28 07:59:30.147977 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 07:59:30.147977 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 07:59:30.147977 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 07:59:30.147977 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 07:59:30.147977 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 07:59:30.147977 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 07:59:30.147977 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 07:59:30.147977 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 07:59:30.147977 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 07:59:30.147977 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 07:59:30.147977 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 07:59:30.147977 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 28 07:59:30.147977 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 28 07:59:30.147977 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 28 07:59:30.147977 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 28 07:59:30.149796 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 07:59:30.149796 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 07:59:30.149796 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 28 07:59:30.149796 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 07:59:30.149796 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 28 07:59:30.149796 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 07:59:30.149796 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 07:59:30.149796 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 07:59:30.149796 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 07:59:30.149796 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 07:59:30.149796 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 07:59:30.149796 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application with Lock( Jul 28 07:59:30.149796 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 07:59:30.149796 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._enter() Jul 28 07:59:30.149796 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 07:59:30.149796 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 07:59:30.149796 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 07:59:30.149796 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.creator() Jul 28 07:59:30.151726 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 07:59:30.151726 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application created_value = creator( Jul 28 07:59:30.151726 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 28 07:59:30.151726 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 28 07:59:30.151726 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 28 07:59:30.151726 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 28 07:59:30.151726 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 28 07:59:30.151726 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 28 07:59:30.151726 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jul 28 07:59:30.151726 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application Jul 28 07:59:30.151726 dv-cinder-851351-1-smb devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 315/597] 10.222.0.42 () {56 vars in 1102 bytes} [Thu Jul 28 07:59:29 2022] GET /identity/v3/users/neutron => generated 85 bytes in 324 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 07:59:30.155169 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29baf080-0c22-49ce-8d65-e9b2453eace5 None admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 07:59:30.159653 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ae4f7c-1deb-4db7-be6b-6fdf01cb0c0e None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 07:59:30.191125 dv-cinder-851351-1-smb devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 283/598] 10.222.0.42 () {56 vars in 1109 bytes} [Thu Jul 28 07:59:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 360 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 07:59:30.200363 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29baf080-0c22-49ce-8d65-e9b2453eace5 None admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 07:59:30.314286 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29baf080-0c22-49ce-8d65-e9b2453eace5 None admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 07:59:30.385700 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ae4f7c-1deb-4db7-be6b-6fdf01cb0c0e None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 07:59:30.386894 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e019b6e6-4281-4a9a-8bef-397efbaa5e7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 07:59:30.388183 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e019b6e6-4281-4a9a-8bef-397efbaa5e7f None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 07:59:30.388703 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e019b6e6-4281-4a9a-8bef-397efbaa5e7f None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 07:59:30.389176 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e019b6e6-4281-4a9a-8bef-397efbaa5e7f None admin] PATH_INFO: `/v3/projects/service` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 07:59:30.403888 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e019b6e6-4281-4a9a-8bef-397efbaa5e7f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 07:59:30.406995 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e019b6e6-4281-4a9a-8bef-397efbaa5e7f None admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 07:59:30.451139 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application [None req-e019b6e6-4281-4a9a-8bef-397efbaa5e7f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 07:59:30.451139 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 07:59:30.451139 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 07:59:30.451139 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 07:59:30.451139 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 07:59:30.451139 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 07:59:30.451139 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 07:59:30.451139 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 07:59:30.451139 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 07:59:30.451139 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 07:59:30.451139 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 07:59:30.451139 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 07:59:30.451139 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 28 07:59:30.451139 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 28 07:59:30.451139 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 28 07:59:30.453225 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 28 07:59:30.453225 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 07:59:30.453225 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 07:59:30.453225 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 07:59:30.453225 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 07:59:30.453225 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 07:59:30.453225 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 07:59:30.453225 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 07:59:30.453225 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application with Lock( Jul 28 07:59:30.453225 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 07:59:30.453225 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self._enter() Jul 28 07:59:30.453225 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 07:59:30.453225 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 07:59:30.453225 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 07:59:30.453225 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.creator() Jul 28 07:59:30.453225 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 07:59:30.453225 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application created_value = creator( Jul 28 07:59:30.455291 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 28 07:59:30.455291 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 28 07:59:30.455291 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 28 07:59:30.455291 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 28 07:59:30.455291 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 28 07:59:30.455291 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 28 07:59:30.455291 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 07:59:30.455291 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application Jul 28 07:59:30.455291 dv-cinder-851351-1-smb devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 284/599] 10.222.0.42 () {56 vars in 1111 bytes} [Thu Jul 28 07:59:30 2022] GET /identity/v3/projects/service => generated 88 bytes in 251 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 07:59:30.464783 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e019b6e6-4281-4a9a-8bef-397efbaa5e7f None admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 07:59:30.466019 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48192b74-b396-4d3c-9710-c091aa85121e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 07:59:30.466890 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48192b74-b396-4d3c-9710-c091aa85121e None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 07:59:30.467388 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48192b74-b396-4d3c-9710-c091aa85121e None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 07:59:30.468289 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48192b74-b396-4d3c-9710-c091aa85121e None admin] PATH_INFO: `/v3/users` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 07:59:30.469305 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48192b74-b396-4d3c-9710-c091aa85121e None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 07:59:30.471605 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48192b74-b396-4d3c-9710-c091aa85121e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 07:59:30.473372 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48192b74-b396-4d3c-9710-c091aa85121e None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 07:59:30.516764 dv-cinder-851351-1-smb devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 316/600] 10.222.0.42 () {56 vars in 1139 bytes} [Thu Jul 28 07:59:30 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 358 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 07:59:30.521277 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48192b74-b396-4d3c-9710-c091aa85121e None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 07:59:30.541539 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=100 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 07:59:30.605954 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 07:59:30.666978 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e019b6e6-4281-4a9a-8bef-397efbaa5e7f None admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 07:59:30.687691 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48192b74-b396-4d3c-9710-c091aa85121e None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 07:59:30.722815 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1adc8d-0d7f-4cf1-836f-42ceb5c17025 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 07:59:30.723991 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1adc8d-0d7f-4cf1-836f-42ceb5c17025 None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 07:59:30.724454 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1adc8d-0d7f-4cf1-836f-42ceb5c17025 None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 07:59:30.724949 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1adc8d-0d7f-4cf1-836f-42ceb5c17025 None admin] PATH_INFO: `/v3/projects` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 07:59:30.726164 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed1adc8d-0d7f-4cf1-836f-42ceb5c17025 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80348) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 07:59:30.726662 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed1adc8d-0d7f-4cf1-836f-42ceb5c17025 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 07:59:30.727259 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83e2ccf-aff8-4fa8-b250-89805f733729 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 07:59:30.728003 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83e2ccf-aff8-4fa8-b250-89805f733729 None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 07:59:30.728357 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83e2ccf-aff8-4fa8-b250-89805f733729 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 07:59:30.728721 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83e2ccf-aff8-4fa8-b250-89805f733729 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 07:59:30.729174 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed1adc8d-0d7f-4cf1-836f-42ceb5c17025 None admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 07:59:30.740200 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a83e2ccf-aff8-4fa8-b250-89805f733729 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 07:59:30.741773 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a83e2ccf-aff8-4fa8-b250-89805f733729 None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 07:59:30.745979 dv-cinder-851351-1-smb devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 285/601] 10.222.0.42 () {56 vars in 1148 bytes} [Thu Jul 28 07:59:30 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 287 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 07:59:30.747501 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f37e549-57ba-43d1-9081-6cc9744de342 None None] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 07:59:30.747964 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f37e549-57ba-43d1-9081-6cc9744de342 None None] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 07:59:30.748403 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f37e549-57ba-43d1-9081-6cc9744de342 None None] PATH_INFO: `/` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 07:59:30.754043 dv-cinder-851351-1-smb devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 286/602] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 07:59:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 07:59:30.755173 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f37e549-57ba-43d1-9081-6cc9744de342 None None] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 07:59:30.764717 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application [None req-a83e2ccf-aff8-4fa8-b250-89805f733729 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 07:59:30.764717 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 07:59:30.764717 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 07:59:30.764717 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 07:59:30.764717 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 07:59:30.764717 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 07:59:30.764717 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 07:59:30.764717 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 07:59:30.764717 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 07:59:30.764717 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 07:59:30.764717 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 07:59:30.764717 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 07:59:30.764717 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 07:59:30.764717 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 07:59:30.764717 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 07:59:30.765698 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 07:59:30.765698 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 07:59:30.765698 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 07:59:30.765698 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 07:59:30.765698 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 07:59:30.765698 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 07:59:30.765698 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 07:59:30.765698 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 07:59:30.765698 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application with Lock( Jul 28 07:59:30.765698 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 07:59:30.765698 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._enter() Jul 28 07:59:30.765698 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 07:59:30.765698 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 07:59:30.765698 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 07:59:30.765698 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.creator() Jul 28 07:59:30.765698 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 07:59:30.765698 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application created_value = creator( Jul 28 07:59:30.766582 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 07:59:30.766582 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 07:59:30.766582 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 07:59:30.766582 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application Jul 28 07:59:30.766582 dv-cinder-851351-1-smb devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 317/603] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 07:59:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 246 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 07:59:30.768287 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b423638-9f8a-497c-a663-be1fba1f4b5f None None] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 07:59:30.768691 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b423638-9f8a-497c-a663-be1fba1f4b5f None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 07:59:30.769182 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b423638-9f8a-497c-a663-be1fba1f4b5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 07:59:30.788743 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.auth.core [None req-1b423638-9f8a-497c-a663-be1fba1f4b5f None None] MFA Rules not processed for user `f0666d3a50644a7097367331c1ee1a68`. Rule list: `[]` (Enabled: `True`). {{(pid=80347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 07:59:30.790194 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-1b423638-9f8a-497c-a663-be1fba1f4b5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 07:59:30.876791 dv-cinder-851351-1-smb devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 318/604] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 07:59:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 07:59:30.876791 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b423638-9f8a-497c-a663-be1fba1f4b5f None None] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 07:59:30.891236 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=100 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 07:59:30.914434 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 07:59:30.925729 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f37e549-57ba-43d1-9081-6cc9744de342 None None] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 07:59:30.971566 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-017ffd2e-30a6-40a6-8e17-0fff0fad2bc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 07:59:30.972635 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017ffd2e-30a6-40a6-8e17-0fff0fad2bc1 None admin] REQUEST_METHOD: `PUT` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 07:59:30.973146 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017ffd2e-30a6-40a6-8e17-0fff0fad2bc1 None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 07:59:30.973644 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017ffd2e-30a6-40a6-8e17-0fff0fad2bc1 None admin] PATH_INFO: `/v3/projects/139349507026497c98f360774dee737e/users/02f10880691d4fd180f96f3e40e1d25f/roles/a2d02bc3295c4a33b1fc0775a17a79e6` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 07:59:30.992617 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-017ffd2e-30a6-40a6-8e17-0fff0fad2bc1 None admin] RBAC: Authorizing `identity:create_grant(project_id=139349507026497c98f360774dee737e, user_id=02f10880691d4fd180f96f3e40e1d25f, role_id=a2d02bc3295c4a33b1fc0775a17a79e6)` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 07:59:30.994509 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-017ffd2e-30a6-40a6-8e17-0fff0fad2bc1 None admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 07:59:31.014697 dv-cinder-851351-1-smb devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 287/605] 10.222.0.42 () {58 vars in 1439 bytes} [Thu Jul 28 07:59:30 2022] PUT /identity/v3/projects/139349507026497c98f360774dee737e/users/02f10880691d4fd180f96f3e40e1d25f/roles/a2d02bc3295c4a33b1fc0775a17a79e6 => generated 0 bytes in 260 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 07:59:31.016209 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-017ffd2e-30a6-40a6-8e17-0fff0fad2bc1 None admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 07:59:31.109687 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b423638-9f8a-497c-a663-be1fba1f4b5f None None] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 07:59:31.194955 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-017ffd2e-30a6-40a6-8e17-0fff0fad2bc1 None admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 07:59:31.199576 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e3922e-f1c6-49a8-97c1-d5fdbd9596eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 07:59:31.199978 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e3922e-f1c6-49a8-97c1-d5fdbd9596eb None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 07:59:31.200254 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e3922e-f1c6-49a8-97c1-d5fdbd9596eb None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 07:59:31.200524 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e3922e-f1c6-49a8-97c1-d5fdbd9596eb None admin] PATH_INFO: `/v3/domains` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 07:59:31.201262 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0e3922e-f1c6-49a8-97c1-d5fdbd9596eb None admin] RBAC: Adding query filter params (name=Default) {{(pid=80347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 07:59:31.201562 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0e3922e-f1c6-49a8-97c1-d5fdbd9596eb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 07:59:31.202941 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0e3922e-f1c6-49a8-97c1-d5fdbd9596eb None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 07:59:31.217333 dv-cinder-851351-1-smb devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 319/606] 10.222.0.42 () {56 vars in 1109 bytes} [Thu Jul 28 07:59:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 347 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 07:59:31.223573 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e3922e-f1c6-49a8-97c1-d5fdbd9596eb None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 07:59:31.242526 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c527b83-2dfa-444f-aab6-1427135fb643 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 07:59:31.243196 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c527b83-2dfa-444f-aab6-1427135fb643 None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 07:59:31.243477 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c527b83-2dfa-444f-aab6-1427135fb643 None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 07:59:31.243744 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c527b83-2dfa-444f-aab6-1427135fb643 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 07:59:31.252142 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 07:59:31.260015 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c527b83-2dfa-444f-aab6-1427135fb643 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 07:59:31.266850 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application [None req-7c527b83-2dfa-444f-aab6-1427135fb643 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 28 07:59:31.266850 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 07:59:31.266850 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 07:59:31.266850 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 07:59:31.266850 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 07:59:31.266850 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 07:59:31.266850 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 07:59:31.266850 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 07:59:31.266850 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 07:59:31.266850 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 07:59:31.266850 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 07:59:31.266850 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 07:59:31.266850 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 07:59:31.266850 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 07:59:31.266850 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 07:59:31.266850 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 07:59:31.267836 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 07:59:31.267836 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 07:59:31.267836 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 07:59:31.267836 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 07:59:31.267836 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 07:59:31.267836 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 07:59:31.267836 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 07:59:31.267836 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 07:59:31.267836 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 07:59:31.267836 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 07:59:31.267836 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 07:59:31.267836 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application with Lock( Jul 28 07:59:31.267836 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 07:59:31.267836 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self._enter() Jul 28 07:59:31.267836 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 07:59:31.267836 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 07:59:31.268690 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 07:59:31.268690 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.creator() Jul 28 07:59:31.268690 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 07:59:31.268690 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application created_value = creator( Jul 28 07:59:31.268690 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 07:59:31.268690 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 07:59:31.268690 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 07:59:31.268690 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 07:59:31.268690 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 07:59:31.268690 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 07:59:31.268690 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 28 07:59:31.268690 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application Jul 28 07:59:31.271559 dv-cinder-851351-1-smb devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 288/607] 10.222.0.42 () {56 vars in 1102 bytes} [Thu Jul 28 07:59:31 2022] GET /identity/v3/roles/service => generated 85 bytes in 256 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 07:59:31.280904 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c527b83-2dfa-444f-aab6-1427135fb643 None admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 07:59:31.340001 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 07:59:31.400151 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e3922e-f1c6-49a8-97c1-d5fdbd9596eb None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 07:59:31.468711 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b5cc85-6c3a-4774-9598-f02e730e18c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 07:59:31.469328 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b5cc85-6c3a-4774-9598-f02e730e18c9 None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 07:59:31.469597 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b5cc85-6c3a-4774-9598-f02e730e18c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 07:59:31.469864 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b5cc85-6c3a-4774-9598-f02e730e18c9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 07:59:31.478836 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5b5cc85-6c3a-4774-9598-f02e730e18c9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 07:59:31.483565 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5b5cc85-6c3a-4774-9598-f02e730e18c9 None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 07:59:31.501378 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application [None req-d5b5cc85-6c3a-4774-9598-f02e730e18c9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 07:59:31.501378 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 07:59:31.501378 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 07:59:31.501378 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 07:59:31.501378 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 07:59:31.501378 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 07:59:31.501378 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 07:59:31.501378 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 07:59:31.501378 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 07:59:31.501378 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 07:59:31.501378 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 07:59:31.501378 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 07:59:31.501378 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 28 07:59:31.501378 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 28 07:59:31.501378 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 28 07:59:31.502516 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 28 07:59:31.502516 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 07:59:31.502516 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 07:59:31.502516 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 07:59:31.502516 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 07:59:31.502516 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 07:59:31.502516 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 07:59:31.502516 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 07:59:31.502516 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application with Lock( Jul 28 07:59:31.502516 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 07:59:31.502516 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._enter() Jul 28 07:59:31.502516 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 07:59:31.502516 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 07:59:31.502516 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 07:59:31.502516 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.creator() Jul 28 07:59:31.502516 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 07:59:31.502516 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application created_value = creator( Jul 28 07:59:31.503605 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 28 07:59:31.503605 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 28 07:59:31.503605 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 28 07:59:31.503605 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 28 07:59:31.503605 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 28 07:59:31.503605 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 28 07:59:31.503605 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 07:59:31.503605 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application Jul 28 07:59:31.504834 dv-cinder-851351-1-smb devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 320/608] 10.222.0.42 () {56 vars in 1111 bytes} [Thu Jul 28 07:59:31 2022] GET /identity/v3/projects/service => generated 88 bytes in 281 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 07:59:31.506383 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae59e3b-bd3f-43e0-bbf5-cc09d26ea6b7 None None] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 07:59:31.506568 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae59e3b-bd3f-43e0-bbf5-cc09d26ea6b7 None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 07:59:31.507461 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae59e3b-bd3f-43e0-bbf5-cc09d26ea6b7 None None] PATH_INFO: `/` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 07:59:31.508619 dv-cinder-851351-1-smb devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 321/609] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 07:59:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 07:59:31.517772 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae59e3b-bd3f-43e0-bbf5-cc09d26ea6b7 None None] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 07:59:31.528329 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c527b83-2dfa-444f-aab6-1427135fb643 None admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 07:59:31.574795 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0085f2-99e1-4ce5-b49b-84f4fbd211a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 07:59:31.575436 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0085f2-99e1-4ce5-b49b-84f4fbd211a3 None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 07:59:31.575713 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0085f2-99e1-4ce5-b49b-84f4fbd211a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 07:59:31.575984 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0085f2-99e1-4ce5-b49b-84f4fbd211a3 None admin] PATH_INFO: `/v3/roles` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 07:59:31.576930 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd0085f2-99e1-4ce5-b49b-84f4fbd211a3 None admin] RBAC: Adding query filter params (name=service) {{(pid=80348) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 07:59:31.577536 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd0085f2-99e1-4ce5-b49b-84f4fbd211a3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 07:59:31.578943 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd0085f2-99e1-4ce5-b49b-84f4fbd211a3 None admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 07:59:31.591004 dv-cinder-851351-1-smb devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 289/610] 10.222.0.42 () {56 vars in 1103 bytes} [Thu Jul 28 07:59:31 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 310 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 07:59:31.592495 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ccfdeb-7e45-447a-b26b-99069ccc2125 None None] REQUEST_METHOD: `POST` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 07:59:31.592827 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ccfdeb-7e45-447a-b26b-99069ccc2125 None None] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 07:59:31.593108 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ccfdeb-7e45-447a-b26b-99069ccc2125 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 07:59:31.616164 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.auth.core [None req-72ccfdeb-7e45-447a-b26b-99069ccc2125 None None] MFA Rules not processed for user `f0666d3a50644a7097367331c1ee1a68`. Rule list: `[]` (Enabled: `True`). {{(pid=80348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 07:59:31.617867 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.fernet_utils [None req-72ccfdeb-7e45-447a-b26b-99069ccc2125 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 07:59:31.642338 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae59e3b-bd3f-43e0-bbf5-cc09d26ea6b7 None None] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 07:59:31.682518 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cfebfbd-4bf2-44a6-8ed5-94a164cd286f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 07:59:31.683814 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cfebfbd-4bf2-44a6-8ed5-94a164cd286f None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 07:59:31.684386 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cfebfbd-4bf2-44a6-8ed5-94a164cd286f None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 07:59:31.684890 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cfebfbd-4bf2-44a6-8ed5-94a164cd286f None admin] PATH_INFO: `/v3/projects` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 07:59:31.685947 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cfebfbd-4bf2-44a6-8ed5-94a164cd286f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 07:59:31.686467 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cfebfbd-4bf2-44a6-8ed5-94a164cd286f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 07:59:31.689481 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cfebfbd-4bf2-44a6-8ed5-94a164cd286f None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 07:59:31.690818 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=100 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 07:59:31.707820 dv-cinder-851351-1-smb devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 322/611] 10.222.0.42 () {56 vars in 1148 bytes} [Thu Jul 28 07:59:31 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 07:59:31.708206 dv-cinder-851351-1-smb devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 290/612] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 07:59:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 07:59:31.709452 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cfebfbd-4bf2-44a6-8ed5-94a164cd286f None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 07:59:31.714271 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 07:59:31.724579 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ccfdeb-7e45-447a-b26b-99069ccc2125 None None] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 07:59:31.832452 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cfebfbd-4bf2-44a6-8ed5-94a164cd286f None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 07:59:31.850563 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ccfdeb-7e45-447a-b26b-99069ccc2125 None None] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 07:59:31.873034 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f1f522-5d8e-4fcc-95d9-729e4f02b625 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 07:59:31.874046 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f1f522-5d8e-4fcc-95d9-729e4f02b625 None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 07:59:31.874496 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f1f522-5d8e-4fcc-95d9-729e4f02b625 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 07:59:31.875017 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f1f522-5d8e-4fcc-95d9-729e4f02b625 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 07:59:31.886989 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f1f522-5d8e-4fcc-95d9-729e4f02b625 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 07:59:31.889108 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f1f522-5d8e-4fcc-95d9-729e4f02b625 None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 07:59:31.906023 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application [None req-82f1f522-5d8e-4fcc-95d9-729e4f02b625 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 07:59:31.906023 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 07:59:31.906023 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 07:59:31.906023 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 07:59:31.906023 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 07:59:31.906023 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 07:59:31.906023 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 07:59:31.906023 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 07:59:31.906023 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 07:59:31.906023 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 07:59:31.906023 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 07:59:31.906023 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 07:59:31.906023 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 07:59:31.906023 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 07:59:31.906023 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 07:59:31.906965 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 07:59:31.906965 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 07:59:31.906965 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 07:59:31.906965 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 07:59:31.906965 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 07:59:31.906965 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 07:59:31.906965 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 07:59:31.906965 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 07:59:31.906965 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application with Lock( Jul 28 07:59:31.906965 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 07:59:31.906965 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._enter() Jul 28 07:59:31.906965 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 07:59:31.906965 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 07:59:31.906965 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 07:59:31.906965 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.creator() Jul 28 07:59:31.906965 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 07:59:31.906965 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application created_value = creator( Jul 28 07:59:31.907842 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 07:59:31.907842 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 07:59:31.907842 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 07:59:31.907842 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application Jul 28 07:59:31.909906 dv-cinder-851351-1-smb devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 323/613] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 07:59:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 07:59:31.910956 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f1f522-5d8e-4fcc-95d9-729e4f02b625 None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 07:59:31.914201 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3b8d6a-97ed-4484-8e82-6f86559f1a2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 07:59:31.915493 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3b8d6a-97ed-4484-8e82-6f86559f1a2f None admin] REQUEST_METHOD: `PUT` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 07:59:31.916653 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3b8d6a-97ed-4484-8e82-6f86559f1a2f None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 07:59:31.916653 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3b8d6a-97ed-4484-8e82-6f86559f1a2f None admin] PATH_INFO: `/v3/projects/139349507026497c98f360774dee737e/users/0f1b1394d91540aaa0bb3f07c78fc812/roles/a2d02bc3295c4a33b1fc0775a17a79e6` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 07:59:31.943336 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f3b8d6a-97ed-4484-8e82-6f86559f1a2f None admin] RBAC: Authorizing `identity:create_grant(project_id=139349507026497c98f360774dee737e, user_id=0f1b1394d91540aaa0bb3f07c78fc812, role_id=a2d02bc3295c4a33b1fc0775a17a79e6)` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 07:59:31.946173 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f3b8d6a-97ed-4484-8e82-6f86559f1a2f None admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 07:59:31.975358 dv-cinder-851351-1-smb devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 291/614] 10.222.0.42 () {58 vars in 1439 bytes} [Thu Jul 28 07:59:31 2022] PUT /identity/v3/projects/139349507026497c98f360774dee737e/users/0f1b1394d91540aaa0bb3f07c78fc812/roles/a2d02bc3295c4a33b1fc0775a17a79e6 => generated 0 bytes in 251 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 28 07:59:31.977468 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3b8d6a-97ed-4484-8e82-6f86559f1a2f None admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 07:59:31.990389 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 07:59:32.032694 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 07:59:32.062589 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f1f522-5d8e-4fcc-95d9-729e4f02b625 None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 07:59:32.103892 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f621c278-cd3a-450c-9f69-994b4f7a69db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 07:59:32.104932 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f621c278-cd3a-450c-9f69-994b4f7a69db None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 07:59:32.105353 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f621c278-cd3a-450c-9f69-994b4f7a69db None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 07:59:32.105815 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f621c278-cd3a-450c-9f69-994b4f7a69db None admin] PATH_INFO: `/v3/roles/service` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 07:59:32.118932 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f621c278-cd3a-450c-9f69-994b4f7a69db None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 07:59:32.125056 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application [None req-f621c278-cd3a-450c-9f69-994b4f7a69db None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 28 07:59:32.125056 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 07:59:32.125056 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 07:59:32.125056 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 07:59:32.125056 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 07:59:32.125056 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 07:59:32.125056 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 07:59:32.125056 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 07:59:32.125056 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 07:59:32.125056 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 07:59:32.125056 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 07:59:32.125056 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 07:59:32.125056 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 07:59:32.125056 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 07:59:32.125056 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 07:59:32.125056 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 07:59:32.126215 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 07:59:32.126215 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 07:59:32.126215 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 07:59:32.126215 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 07:59:32.126215 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 07:59:32.126215 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 07:59:32.126215 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 07:59:32.126215 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 07:59:32.126215 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 07:59:32.126215 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 07:59:32.126215 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 07:59:32.126215 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application with Lock( Jul 28 07:59:32.126215 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 07:59:32.126215 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._enter() Jul 28 07:59:32.126215 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 07:59:32.126215 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 07:59:32.127198 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 07:59:32.127198 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.creator() Jul 28 07:59:32.127198 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 07:59:32.127198 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application created_value = creator( Jul 28 07:59:32.127198 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 07:59:32.127198 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 07:59:32.127198 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 07:59:32.127198 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 07:59:32.127198 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 07:59:32.127198 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 07:59:32.127198 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 28 07:59:32.127198 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application Jul 28 07:59:32.129868 dv-cinder-851351-1-smb devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 324/615] 10.222.0.42 () {56 vars in 1102 bytes} [Thu Jul 28 07:59:31 2022] GET /identity/v3/roles/service => generated 85 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 07:59:32.136693 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f621c278-cd3a-450c-9f69-994b4f7a69db None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 07:59:32.180188 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3b8d6a-97ed-4484-8e82-6f86559f1a2f None admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 07:59:32.280373 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35fee0d3-2a50-4739-848d-1a988a7ad69a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 07:59:32.283173 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35fee0d3-2a50-4739-848d-1a988a7ad69a None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 07:59:32.283805 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35fee0d3-2a50-4739-848d-1a988a7ad69a None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 07:59:32.284831 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35fee0d3-2a50-4739-848d-1a988a7ad69a None admin] PATH_INFO: `/v3/domains` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 07:59:32.287891 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35fee0d3-2a50-4739-848d-1a988a7ad69a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80348) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 07:59:32.288590 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35fee0d3-2a50-4739-848d-1a988a7ad69a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 07:59:32.291363 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35fee0d3-2a50-4739-848d-1a988a7ad69a None admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 07:59:32.307311 dv-cinder-851351-1-smb devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 292/616] 10.222.0.42 () {56 vars in 1109 bytes} [Thu Jul 28 07:59:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 331 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 07:59:32.313435 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35fee0d3-2a50-4739-848d-1a988a7ad69a None admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 07:59:32.331384 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f621c278-cd3a-450c-9f69-994b4f7a69db None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 07:59:32.352246 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 07:59:32.374499 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2208b6a4-7cf4-4977-85ff-0932c12af1cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 07:59:32.375437 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2208b6a4-7cf4-4977-85ff-0932c12af1cf None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 07:59:32.375816 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2208b6a4-7cf4-4977-85ff-0932c12af1cf None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 07:59:32.376191 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2208b6a4-7cf4-4977-85ff-0932c12af1cf None admin] PATH_INFO: `/v3/roles` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 07:59:32.377085 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2208b6a4-7cf4-4977-85ff-0932c12af1cf None admin] RBAC: Adding query filter params (name=service) {{(pid=80347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 07:59:32.377576 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2208b6a4-7cf4-4977-85ff-0932c12af1cf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 07:59:32.379199 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2208b6a4-7cf4-4977-85ff-0932c12af1cf None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 07:59:32.389792 dv-cinder-851351-1-smb devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 325/617] 10.222.0.42 () {56 vars in 1103 bytes} [Thu Jul 28 07:59:32 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 07:59:32.395886 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2208b6a4-7cf4-4977-85ff-0932c12af1cf None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 07:59:32.496587 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=100 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 07:59:32.500912 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35fee0d3-2a50-4739-848d-1a988a7ad69a None admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 07:59:32.521803 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2208b6a4-7cf4-4977-85ff-0932c12af1cf None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 07:59:32.544129 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb8d1ab-2326-473e-9e32-bb0305cf9632 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 07:59:32.545545 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb8d1ab-2326-473e-9e32-bb0305cf9632 None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 07:59:32.546025 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb8d1ab-2326-473e-9e32-bb0305cf9632 None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 07:59:32.546489 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb8d1ab-2326-473e-9e32-bb0305cf9632 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 07:59:32.555301 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cb8d1ab-2326-473e-9e32-bb0305cf9632 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 07:59:32.557284 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cb8d1ab-2326-473e-9e32-bb0305cf9632 None admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 07:59:32.560074 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7082ce0f-ca33-44ec-a62c-b95749136e02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 07:59:32.560932 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7082ce0f-ca33-44ec-a62c-b95749136e02 None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 07:59:32.561863 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7082ce0f-ca33-44ec-a62c-b95749136e02 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 07:59:32.561863 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7082ce0f-ca33-44ec-a62c-b95749136e02 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 07:59:32.571730 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application [None req-9cb8d1ab-2326-473e-9e32-bb0305cf9632 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 28 07:59:32.571730 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 07:59:32.571730 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 07:59:32.571730 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 07:59:32.571730 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 07:59:32.571730 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 07:59:32.571730 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 07:59:32.571730 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 07:59:32.571730 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 07:59:32.571730 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 07:59:32.571730 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 07:59:32.571730 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 07:59:32.571730 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 28 07:59:32.571730 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 28 07:59:32.571730 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 28 07:59:32.571730 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 28 07:59:32.572788 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 07:59:32.572788 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 07:59:32.572788 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 28 07:59:32.572788 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 07:59:32.572788 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 28 07:59:32.572788 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 07:59:32.572788 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 07:59:32.572788 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 07:59:32.572788 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 07:59:32.572788 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 07:59:32.572788 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 07:59:32.572788 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application with Lock( Jul 28 07:59:32.572788 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 07:59:32.572788 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self._enter() Jul 28 07:59:32.572788 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 07:59:32.572788 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 07:59:32.572788 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 07:59:32.572788 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.creator() Jul 28 07:59:32.573934 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 07:59:32.573934 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application created_value = creator( Jul 28 07:59:32.573934 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 28 07:59:32.573934 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 28 07:59:32.573934 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 28 07:59:32.573934 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 28 07:59:32.573934 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 28 07:59:32.573934 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 28 07:59:32.573934 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 28 07:59:32.573934 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application Jul 28 07:59:32.574507 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7082ce0f-ca33-44ec-a62c-b95749136e02 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 07:59:32.575833 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7082ce0f-ca33-44ec-a62c-b95749136e02 None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 07:59:32.577371 dv-cinder-851351-1-smb devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 293/618] 10.222.0.42 () {56 vars in 1096 bytes} [Thu Jul 28 07:59:32 2022] GET /identity/v3/users/swift => generated 83 bytes in 264 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 07:59:32.579044 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24ebe9c-e3c9-42cd-a448-325f8e78f2ef None None] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 07:59:32.579888 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24ebe9c-e3c9-42cd-a448-325f8e78f2ef None None] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 07:59:32.580350 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24ebe9c-e3c9-42cd-a448-325f8e78f2ef None None] PATH_INFO: `/` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 07:59:32.582255 dv-cinder-851351-1-smb devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 294/619] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 07:59:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 07:59:32.583264 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e24ebe9c-e3c9-42cd-a448-325f8e78f2ef None None] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 07:59:32.597971 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application [None req-7082ce0f-ca33-44ec-a62c-b95749136e02 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 07:59:32.597971 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 07:59:32.597971 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 07:59:32.597971 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 07:59:32.597971 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 07:59:32.597971 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 07:59:32.597971 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 07:59:32.597971 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 07:59:32.597971 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 07:59:32.597971 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 07:59:32.597971 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 07:59:32.597971 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 07:59:32.597971 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 07:59:32.597971 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 07:59:32.597971 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 07:59:32.599105 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 07:59:32.599105 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 07:59:32.599105 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 07:59:32.599105 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 07:59:32.599105 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 07:59:32.599105 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 07:59:32.599105 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 07:59:32.599105 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 07:59:32.599105 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application with Lock( Jul 28 07:59:32.599105 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 07:59:32.599105 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._enter() Jul 28 07:59:32.599105 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 07:59:32.599105 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 07:59:32.599105 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 07:59:32.599105 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.creator() Jul 28 07:59:32.599105 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 07:59:32.599105 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application created_value = creator( Jul 28 07:59:32.600626 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 07:59:32.600626 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 07:59:32.600626 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 07:59:32.600626 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application Jul 28 07:59:32.600626 dv-cinder-851351-1-smb devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 326/620] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 07:59:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 07:59:32.601086 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd10d301-e791-477e-b730-0b707de37901 None None] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 07:59:32.601155 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd10d301-e791-477e-b730-0b707de37901 None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 07:59:32.601431 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd10d301-e791-477e-b730-0b707de37901 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 07:59:32.620374 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.auth.core [None req-fd10d301-e791-477e-b730-0b707de37901 None None] MFA Rules not processed for user `f0666d3a50644a7097367331c1ee1a68`. Rule list: `[]` (Enabled: `True`). {{(pid=80347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 07:59:32.621716 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-fd10d301-e791-477e-b730-0b707de37901 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 07:59:32.647923 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 07:59:32.704801 dv-cinder-851351-1-smb devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 327/621] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 07:59:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 07:59:32.705682 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e24ebe9c-e3c9-42cd-a448-325f8e78f2ef None None] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 07:59:32.705871 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd10d301-e791-477e-b730-0b707de37901 None None] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 07:59:32.754709 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff48614-66e9-4106-8b0a-e662df48f417 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 07:59:32.755428 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff48614-66e9-4106-8b0a-e662df48f417 None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 07:59:32.755711 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff48614-66e9-4106-8b0a-e662df48f417 None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 07:59:32.755983 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff48614-66e9-4106-8b0a-e662df48f417 None admin] PATH_INFO: `/v3/users` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 07:59:32.757101 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ff48614-66e9-4106-8b0a-e662df48f417 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80348) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 07:59:32.757414 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ff48614-66e9-4106-8b0a-e662df48f417 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 07:59:32.759669 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ff48614-66e9-4106-8b0a-e662df48f417 None admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 07:59:32.786693 dv-cinder-851351-1-smb devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 295/622] 10.222.0.42 () {56 vars in 1135 bytes} [Thu Jul 28 07:59:32 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 07:59:32.789382 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff48614-66e9-4106-8b0a-e662df48f417 None admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 07:59:32.812318 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=100 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 07:59:32.858870 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd10d301-e791-477e-b730-0b707de37901 None None] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 07:59:32.910200 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e0462c-f392-440e-9a41-c28cb8d042c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 07:59:32.910856 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e0462c-f392-440e-9a41-c28cb8d042c3 None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 07:59:32.911138 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e0462c-f392-440e-9a41-c28cb8d042c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 07:59:32.911459 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e0462c-f392-440e-9a41-c28cb8d042c3 None admin] PATH_INFO: `/v3/domains` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 07:59:32.912177 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e0462c-f392-440e-9a41-c28cb8d042c3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 07:59:32.912484 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e0462c-f392-440e-9a41-c28cb8d042c3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 07:59:32.913916 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e0462c-f392-440e-9a41-c28cb8d042c3 None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 07:59:32.933233 dv-cinder-851351-1-smb devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 328/623] 10.222.0.42 () {56 vars in 1109 bytes} [Thu Jul 28 07:59:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 07:59:32.934187 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e0462c-f392-440e-9a41-c28cb8d042c3 None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 07:59:32.961854 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 07:59:32.972483 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff48614-66e9-4106-8b0a-e662df48f417 None admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 07:59:33.048005 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11fb23d0-d45a-42aa-9ad9-9839b7b95060 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 07:59:33.049572 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11fb23d0-d45a-42aa-9ad9-9839b7b95060 None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 07:59:33.049982 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11fb23d0-d45a-42aa-9ad9-9839b7b95060 None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 07:59:33.050634 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11fb23d0-d45a-42aa-9ad9-9839b7b95060 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 07:59:33.056465 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e0462c-f392-440e-9a41-c28cb8d042c3 None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 07:59:33.072578 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11fb23d0-d45a-42aa-9ad9-9839b7b95060 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 07:59:33.083400 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application [None req-11fb23d0-d45a-42aa-9ad9-9839b7b95060 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 28 07:59:33.083400 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 07:59:33.083400 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 07:59:33.083400 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 07:59:33.083400 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 07:59:33.083400 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 07:59:33.083400 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 07:59:33.083400 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 07:59:33.083400 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 07:59:33.083400 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 07:59:33.083400 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 07:59:33.083400 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 07:59:33.083400 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 07:59:33.083400 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 07:59:33.083400 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 07:59:33.083400 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 07:59:33.084422 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 07:59:33.084422 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 07:59:33.084422 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 07:59:33.084422 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 07:59:33.084422 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 07:59:33.084422 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 07:59:33.084422 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 07:59:33.084422 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 07:59:33.084422 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 07:59:33.084422 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 07:59:33.084422 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 07:59:33.084422 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application with Lock( Jul 28 07:59:33.084422 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 07:59:33.084422 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self._enter() Jul 28 07:59:33.084422 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 07:59:33.084422 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 07:59:33.085294 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 07:59:33.085294 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.creator() Jul 28 07:59:33.085294 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 07:59:33.085294 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application created_value = creator( Jul 28 07:59:33.085294 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 07:59:33.085294 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 07:59:33.085294 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 07:59:33.085294 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 07:59:33.085294 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 07:59:33.085294 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 07:59:33.085294 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 28 07:59:33.085294 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application Jul 28 07:59:33.086564 dv-cinder-851351-1-smb devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 296/624] 10.222.0.42 () {56 vars in 1102 bytes} [Thu Jul 28 07:59:32 2022] GET /identity/v3/roles/service => generated 85 bytes in 299 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 07:59:33.088413 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11fb23d0-d45a-42aa-9ad9-9839b7b95060 None admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 07:59:33.101908 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b0a1d6-6a22-49c0-8d17-2bb745bc48e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 07:59:33.102925 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b0a1d6-6a22-49c0-8d17-2bb745bc48e5 None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 07:59:33.103530 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b0a1d6-6a22-49c0-8d17-2bb745bc48e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 07:59:33.103984 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b0a1d6-6a22-49c0-8d17-2bb745bc48e5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 07:59:33.116487 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b0a1d6-6a22-49c0-8d17-2bb745bc48e5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 07:59:33.118428 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b0a1d6-6a22-49c0-8d17-2bb745bc48e5 None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 07:59:33.136164 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application [None req-57b0a1d6-6a22-49c0-8d17-2bb745bc48e5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 07:59:33.136164 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 07:59:33.136164 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 07:59:33.136164 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 07:59:33.136164 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 07:59:33.136164 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 07:59:33.136164 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 07:59:33.136164 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 07:59:33.136164 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 07:59:33.136164 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 07:59:33.136164 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 07:59:33.136164 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 07:59:33.136164 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 07:59:33.136164 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 07:59:33.136164 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 07:59:33.137167 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 07:59:33.137167 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 07:59:33.137167 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 07:59:33.137167 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 07:59:33.137167 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 07:59:33.137167 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 07:59:33.137167 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 07:59:33.137167 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 07:59:33.137167 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application with Lock( Jul 28 07:59:33.137167 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 07:59:33.137167 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._enter() Jul 28 07:59:33.137167 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 07:59:33.137167 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 07:59:33.137167 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 07:59:33.137167 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.creator() Jul 28 07:59:33.137167 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 07:59:33.137167 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application created_value = creator( Jul 28 07:59:33.138066 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 07:59:33.138066 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 07:59:33.138066 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 07:59:33.138066 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application Jul 28 07:59:33.144886 dv-cinder-851351-1-smb devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 329/625] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 07:59:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 07:59:33.146239 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b0a1d6-6a22-49c0-8d17-2bb745bc48e5 None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 07:59:33.227195 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 07:59:33.263814 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=100 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 07:59:33.265790 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b0a1d6-6a22-49c0-8d17-2bb745bc48e5 None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 07:59:33.308555 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ded8e3-4da3-4344-8da1-7252aa3e195e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 07:59:33.309635 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ded8e3-4da3-4344-8da1-7252aa3e195e None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 07:59:33.310144 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ded8e3-4da3-4344-8da1-7252aa3e195e None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 07:59:33.310638 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ded8e3-4da3-4344-8da1-7252aa3e195e None admin] PATH_INFO: `/v3/roles` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 07:59:33.311593 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0ded8e3-4da3-4344-8da1-7252aa3e195e None admin] RBAC: Adding query filter params (name=service) {{(pid=80347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 07:59:33.312106 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0ded8e3-4da3-4344-8da1-7252aa3e195e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 07:59:33.312556 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11fb23d0-d45a-42aa-9ad9-9839b7b95060 None admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 07:59:33.313979 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0ded8e3-4da3-4344-8da1-7252aa3e195e None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 07:59:33.324237 dv-cinder-851351-1-smb devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 330/626] 10.222.0.42 () {56 vars in 1103 bytes} [Thu Jul 28 07:59:33 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 07:59:33.325564 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ded8e3-4da3-4344-8da1-7252aa3e195e None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 07:59:33.383155 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24d211a-2b22-4efa-953c-d37b04392fdc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 07:59:33.384104 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24d211a-2b22-4efa-953c-d37b04392fdc None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 07:59:33.384601 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24d211a-2b22-4efa-953c-d37b04392fdc None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 07:59:33.385129 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24d211a-2b22-4efa-953c-d37b04392fdc None admin] PATH_INFO: `/v3/users/glance` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 07:59:33.400681 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f24d211a-2b22-4efa-953c-d37b04392fdc None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 07:59:33.403731 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f24d211a-2b22-4efa-953c-d37b04392fdc None admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 07:59:33.428141 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application [None req-f24d211a-2b22-4efa-953c-d37b04392fdc None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jul 28 07:59:33.428141 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 07:59:33.428141 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 07:59:33.428141 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 07:59:33.428141 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 07:59:33.428141 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 07:59:33.428141 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 07:59:33.428141 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 07:59:33.428141 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 07:59:33.428141 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 07:59:33.428141 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 07:59:33.428141 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 07:59:33.428141 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 28 07:59:33.428141 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 28 07:59:33.428141 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 28 07:59:33.428141 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 28 07:59:33.429401 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 07:59:33.429401 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 07:59:33.429401 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 28 07:59:33.429401 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 07:59:33.429401 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 28 07:59:33.429401 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 07:59:33.429401 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 07:59:33.429401 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 07:59:33.429401 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 07:59:33.429401 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 07:59:33.429401 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 07:59:33.429401 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application with Lock( Jul 28 07:59:33.429401 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 07:59:33.429401 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self._enter() Jul 28 07:59:33.429401 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 07:59:33.429401 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 07:59:33.429401 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 07:59:33.429401 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.creator() Jul 28 07:59:33.433007 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 07:59:33.433007 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application created_value = creator( Jul 28 07:59:33.433007 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 28 07:59:33.433007 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 28 07:59:33.433007 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 28 07:59:33.433007 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 28 07:59:33.433007 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 28 07:59:33.433007 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 28 07:59:33.433007 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jul 28 07:59:33.433007 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application Jul 28 07:59:33.433007 dv-cinder-851351-1-smb devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 297/627] 10.222.0.42 () {56 vars in 1099 bytes} [Thu Jul 28 07:59:33 2022] GET /identity/v3/users/glance => generated 84 bytes in 343 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 07:59:33.433007 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24d211a-2b22-4efa-953c-d37b04392fdc None admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 07:59:33.452491 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ded8e3-4da3-4344-8da1-7252aa3e195e None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 07:59:33.500488 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc504c6-6632-4fb7-8657-f9966273b64c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 07:59:33.501565 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc504c6-6632-4fb7-8657-f9966273b64c None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 07:59:33.502034 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc504c6-6632-4fb7-8657-f9966273b64c None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 07:59:33.503456 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc504c6-6632-4fb7-8657-f9966273b64c None admin] PATH_INFO: `/v3/domains` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 07:59:33.503817 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc504c6-6632-4fb7-8657-f9966273b64c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 07:59:33.504344 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc504c6-6632-4fb7-8657-f9966273b64c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 07:59:33.507311 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc504c6-6632-4fb7-8657-f9966273b64c None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 07:59:33.509892 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 07:59:33.526638 dv-cinder-851351-1-smb devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 331/628] 10.222.0.42 () {56 vars in 1109 bytes} [Thu Jul 28 07:59:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 07:59:33.528388 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae6035c-b297-40d0-920f-5d969c248d28 None None] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 07:59:33.528705 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae6035c-b297-40d0-920f-5d969c248d28 None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 07:59:33.528985 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae6035c-b297-40d0-920f-5d969c248d28 None None] PATH_INFO: `/` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 07:59:33.530471 dv-cinder-851351-1-smb devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 332/629] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 07:59:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 07:59:33.535481 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae6035c-b297-40d0-920f-5d969c248d28 None None] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 07:59:33.594118 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24d211a-2b22-4efa-953c-d37b04392fdc None admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 07:59:33.652590 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d90eb20-e009-4e5a-bcba-a03267f418af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 07:59:33.653741 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d90eb20-e009-4e5a-bcba-a03267f418af None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 07:59:33.654267 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d90eb20-e009-4e5a-bcba-a03267f418af None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 07:59:33.654707 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d90eb20-e009-4e5a-bcba-a03267f418af None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 07:59:33.664860 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae6035c-b297-40d0-920f-5d969c248d28 None None] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 07:59:33.672217 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=100 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 07:59:33.676387 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d90eb20-e009-4e5a-bcba-a03267f418af None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 07:59:33.679876 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d90eb20-e009-4e5a-bcba-a03267f418af None admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 07:59:33.697194 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application [None req-8d90eb20-e009-4e5a-bcba-a03267f418af None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 07:59:33.697194 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 07:59:33.697194 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 07:59:33.697194 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 07:59:33.697194 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 07:59:33.697194 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 07:59:33.697194 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 07:59:33.697194 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 07:59:33.697194 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 07:59:33.697194 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 07:59:33.697194 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 07:59:33.697194 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 07:59:33.697194 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 07:59:33.697194 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 07:59:33.697194 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 07:59:33.699173 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 07:59:33.699173 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 07:59:33.699173 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 07:59:33.699173 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 07:59:33.699173 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 07:59:33.699173 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 07:59:33.699173 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 07:59:33.699173 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 07:59:33.699173 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application with Lock( Jul 28 07:59:33.699173 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 07:59:33.699173 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self._enter() Jul 28 07:59:33.699173 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 07:59:33.699173 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 07:59:33.699173 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 07:59:33.699173 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.creator() Jul 28 07:59:33.699173 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 07:59:33.699173 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application created_value = creator( Jul 28 07:59:33.701982 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 07:59:33.701982 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 07:59:33.701982 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 07:59:33.701982 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application Jul 28 07:59:33.701982 dv-cinder-851351-1-smb devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 298/630] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 07:59:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 267 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 07:59:33.701982 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d90eb20-e009-4e5a-bcba-a03267f418af None admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 07:59:33.714789 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390a802e-8589-4992-9c91-d285e59c7625 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 07:59:33.715766 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390a802e-8589-4992-9c91-d285e59c7625 None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 07:59:33.715766 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390a802e-8589-4992-9c91-d285e59c7625 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 07:59:33.716178 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390a802e-8589-4992-9c91-d285e59c7625 None admin] PATH_INFO: `/v3/users` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 07:59:33.716771 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-390a802e-8589-4992-9c91-d285e59c7625 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 07:59:33.717073 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-390a802e-8589-4992-9c91-d285e59c7625 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 07:59:33.718541 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-390a802e-8589-4992-9c91-d285e59c7625 None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 07:59:33.751548 dv-cinder-851351-1-smb devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 333/631] 10.222.0.42 () {56 vars in 1137 bytes} [Thu Jul 28 07:59:33 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 07:59:33.751548 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f86f3c-aecd-40f3-8038-6cf4cedcb4ff None None] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 07:59:33.751548 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f86f3c-aecd-40f3-8038-6cf4cedcb4ff None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 07:59:33.751548 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f86f3c-aecd-40f3-8038-6cf4cedcb4ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 07:59:33.773698 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.auth.core [None req-60f86f3c-aecd-40f3-8038-6cf4cedcb4ff None None] MFA Rules not processed for user `f0666d3a50644a7097367331c1ee1a68`. Rule list: `[]` (Enabled: `True`). {{(pid=80347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 07:59:33.775069 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-60f86f3c-aecd-40f3-8038-6cf4cedcb4ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 07:59:33.838686 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d90eb20-e009-4e5a-bcba-a03267f418af None admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 07:59:33.850174 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 07:59:33.887573 dv-cinder-851351-1-smb devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 334/632] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 07:59:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 07:59:33.890962 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f428197a-78b8-44ca-833b-1cb1d3782a65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 07:59:33.892142 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f428197a-78b8-44ca-833b-1cb1d3782a65 None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 07:59:33.892766 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f428197a-78b8-44ca-833b-1cb1d3782a65 None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 07:59:33.893341 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f428197a-78b8-44ca-833b-1cb1d3782a65 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 07:59:33.899273 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f86f3c-aecd-40f3-8038-6cf4cedcb4ff None None] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 07:59:33.907081 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f428197a-78b8-44ca-833b-1cb1d3782a65 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 07:59:33.910204 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f428197a-78b8-44ca-833b-1cb1d3782a65 None admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 07:59:33.933882 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application [None req-f428197a-78b8-44ca-833b-1cb1d3782a65 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 07:59:33.933882 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 07:59:33.933882 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 07:59:33.933882 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 07:59:33.933882 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 07:59:33.933882 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 07:59:33.933882 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 07:59:33.933882 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 07:59:33.933882 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 07:59:33.933882 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 07:59:33.933882 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 07:59:33.933882 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 07:59:33.933882 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 28 07:59:33.933882 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 28 07:59:33.933882 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 28 07:59:33.935068 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 28 07:59:33.935068 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 07:59:33.935068 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 07:59:33.935068 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 07:59:33.935068 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 07:59:33.935068 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 07:59:33.935068 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 07:59:33.935068 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 07:59:33.935068 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application with Lock( Jul 28 07:59:33.935068 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 07:59:33.935068 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self._enter() Jul 28 07:59:33.935068 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 07:59:33.935068 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 07:59:33.935068 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 07:59:33.935068 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.creator() Jul 28 07:59:33.935068 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 07:59:33.935068 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application created_value = creator( Jul 28 07:59:33.936155 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 28 07:59:33.936155 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 28 07:59:33.936155 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 28 07:59:33.936155 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 28 07:59:33.936155 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 28 07:59:33.936155 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 28 07:59:33.936155 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 07:59:33.936155 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application Jul 28 07:59:33.944230 dv-cinder-851351-1-smb devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 299/633] 10.222.0.42 () {56 vars in 1111 bytes} [Thu Jul 28 07:59:33 2022] GET /identity/v3/projects/service => generated 88 bytes in 245 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 07:59:33.945772 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f428197a-78b8-44ca-833b-1cb1d3782a65 None admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 07:59:34.020251 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f86f3c-aecd-40f3-8038-6cf4cedcb4ff None None] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 07:59:34.039171 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=100 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 07:59:34.072495 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba86f1ba-ccf2-4ed0-a1c7-a8a148ce67bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 07:59:34.073726 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba86f1ba-ccf2-4ed0-a1c7-a8a148ce67bb None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 07:59:34.074222 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba86f1ba-ccf2-4ed0-a1c7-a8a148ce67bb None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 07:59:34.074717 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba86f1ba-ccf2-4ed0-a1c7-a8a148ce67bb None admin] PATH_INFO: `/v3/domains` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 07:59:34.076051 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba86f1ba-ccf2-4ed0-a1c7-a8a148ce67bb None admin] RBAC: Adding query filter params (name=Default) {{(pid=80347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 07:59:34.076602 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba86f1ba-ccf2-4ed0-a1c7-a8a148ce67bb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 07:59:34.079598 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba86f1ba-ccf2-4ed0-a1c7-a8a148ce67bb None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 07:59:34.095323 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f428197a-78b8-44ca-833b-1cb1d3782a65 None admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 07:59:34.106525 dv-cinder-851351-1-smb devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 335/634] 10.222.0.42 () {56 vars in 1109 bytes} [Thu Jul 28 07:59:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 07:59:34.106525 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba86f1ba-ccf2-4ed0-a1c7-a8a148ce67bb None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 07:59:34.149111 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9bff5a1-dde3-4c9f-a699-bfd26f288b79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 07:59:34.150023 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9bff5a1-dde3-4c9f-a699-bfd26f288b79 None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 07:59:34.150302 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9bff5a1-dde3-4c9f-a699-bfd26f288b79 None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 07:59:34.150583 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9bff5a1-dde3-4c9f-a699-bfd26f288b79 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 07:59:34.160633 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 07:59:34.236141 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9bff5a1-dde3-4c9f-a699-bfd26f288b79 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 07:59:34.237685 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9bff5a1-dde3-4c9f-a699-bfd26f288b79 None admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 07:59:34.249819 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba86f1ba-ccf2-4ed0-a1c7-a8a148ce67bb None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 07:59:34.291921 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9101dc6-20fa-4c1e-b39d-b0600d1f86b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 07:59:34.293020 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9101dc6-20fa-4c1e-b39d-b0600d1f86b8 None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 07:59:34.293453 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9101dc6-20fa-4c1e-b39d-b0600d1f86b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 07:59:34.293882 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9101dc6-20fa-4c1e-b39d-b0600d1f86b8 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 07:59:34.309673 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9101dc6-20fa-4c1e-b39d-b0600d1f86b8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 07:59:34.309878 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=100 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 07:59:34.319019 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application [None req-b9101dc6-20fa-4c1e-b39d-b0600d1f86b8 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 28 07:59:34.319019 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 07:59:34.319019 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 07:59:34.319019 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 07:59:34.319019 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 07:59:34.319019 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 07:59:34.319019 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 07:59:34.319019 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 07:59:34.319019 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 07:59:34.319019 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 07:59:34.319019 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 07:59:34.319019 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 07:59:34.319019 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 07:59:34.319019 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 07:59:34.319019 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 07:59:34.319019 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 07:59:34.320062 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 07:59:34.320062 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 07:59:34.320062 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 07:59:34.320062 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 07:59:34.320062 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 07:59:34.320062 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 07:59:34.320062 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 07:59:34.320062 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 07:59:34.320062 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 07:59:34.320062 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 07:59:34.320062 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 07:59:34.320062 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application with Lock( Jul 28 07:59:34.320062 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 07:59:34.320062 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._enter() Jul 28 07:59:34.320062 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 07:59:34.320062 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 07:59:34.320912 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 07:59:34.320912 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.creator() Jul 28 07:59:34.320912 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 07:59:34.320912 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application created_value = creator( Jul 28 07:59:34.320912 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 07:59:34.320912 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 07:59:34.320912 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 07:59:34.320912 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 07:59:34.320912 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 07:59:34.320912 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 07:59:34.320912 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 28 07:59:34.320912 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application Jul 28 07:59:34.321560 dv-cinder-851351-1-smb devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 336/635] 10.222.0.42 () {56 vars in 1102 bytes} [Thu Jul 28 07:59:34 2022] GET /identity/v3/roles/service => generated 85 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 07:59:34.322332 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9101dc6-20fa-4c1e-b39d-b0600d1f86b8 None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 07:59:34.377838 dv-cinder-851351-1-smb devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 300/636] 10.222.0.42 () {58 vars in 1282 bytes} [Thu Jul 28 07:59:33 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 433 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 28 07:59:34.378830 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9bff5a1-dde3-4c9f-a699-bfd26f288b79 None admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 07:59:34.429184 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9101dc6-20fa-4c1e-b39d-b0600d1f86b8 None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 07:59:34.430755 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 07:59:34.473962 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b59098c-9063-477b-b3ef-1004ac1ef2cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 07:59:34.474727 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b59098c-9063-477b-b3ef-1004ac1ef2cb None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 07:59:34.475007 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b59098c-9063-477b-b3ef-1004ac1ef2cb None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 07:59:34.475302 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b59098c-9063-477b-b3ef-1004ac1ef2cb None admin] PATH_INFO: `/v3/projects` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 07:59:34.476159 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b59098c-9063-477b-b3ef-1004ac1ef2cb None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 07:59:34.476443 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b59098c-9063-477b-b3ef-1004ac1ef2cb None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 07:59:34.477924 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b59098c-9063-477b-b3ef-1004ac1ef2cb None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 07:59:34.490713 dv-cinder-851351-1-smb devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 337/637] 10.222.0.42 () {56 vars in 1148 bytes} [Thu Jul 28 07:59:34 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 07:59:34.492006 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888cac07-273e-4ef7-b613-74849018cd26 None None] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 07:59:34.492294 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888cac07-273e-4ef7-b613-74849018cd26 None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 07:59:34.492563 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888cac07-273e-4ef7-b613-74849018cd26 None None] PATH_INFO: `/` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 07:59:34.493912 dv-cinder-851351-1-smb devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 338/638] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 07:59:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 07:59:34.494644 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-888cac07-273e-4ef7-b613-74849018cd26 None None] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 07:59:34.502607 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9bff5a1-dde3-4c9f-a699-bfd26f288b79 None admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 07:59:34.540448 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b358448-41af-4c4c-b2df-98c7a8de1656 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 07:59:34.541191 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b358448-41af-4c4c-b2df-98c7a8de1656 None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 07:59:34.541502 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b358448-41af-4c4c-b2df-98c7a8de1656 None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 07:59:34.541706 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b358448-41af-4c4c-b2df-98c7a8de1656 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 07:59:34.549816 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b358448-41af-4c4c-b2df-98c7a8de1656 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 07:59:34.551345 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b358448-41af-4c4c-b2df-98c7a8de1656 None admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 07:59:34.563905 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application [None req-5b358448-41af-4c4c-b2df-98c7a8de1656 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jul 28 07:59:34.563905 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 07:59:34.563905 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 07:59:34.563905 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 07:59:34.563905 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 07:59:34.563905 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 07:59:34.563905 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 07:59:34.563905 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 07:59:34.563905 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 07:59:34.563905 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 07:59:34.563905 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 07:59:34.563905 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 07:59:34.563905 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 28 07:59:34.563905 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 28 07:59:34.563905 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 28 07:59:34.563905 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 28 07:59:34.565610 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 07:59:34.565610 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 07:59:34.565610 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 28 07:59:34.565610 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 07:59:34.565610 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 28 07:59:34.565610 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 07:59:34.565610 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 07:59:34.565610 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 07:59:34.565610 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 07:59:34.565610 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 07:59:34.565610 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 07:59:34.565610 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application with Lock( Jul 28 07:59:34.565610 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 07:59:34.565610 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self._enter() Jul 28 07:59:34.565610 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 07:59:34.565610 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 07:59:34.565610 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 07:59:34.565610 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.creator() Jul 28 07:59:34.566658 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 07:59:34.566658 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application created_value = creator( Jul 28 07:59:34.566658 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 28 07:59:34.566658 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 28 07:59:34.566658 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 28 07:59:34.566658 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 28 07:59:34.566658 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 28 07:59:34.566658 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 28 07:59:34.566658 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jul 28 07:59:34.566658 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application Jul 28 07:59:34.566658 dv-cinder-851351-1-smb devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 301/639] 10.222.0.42 () {56 vars in 1099 bytes} [Thu Jul 28 07:59:34 2022] GET /identity/v3/users/cinder => generated 84 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 07:59:34.566658 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b358448-41af-4c4c-b2df-98c7a8de1656 None admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 07:59:34.580170 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=100 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 07:59:34.607217 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-888cac07-273e-4ef7-b613-74849018cd26 None None] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 07:59:34.646243 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6115ef9-dbfe-41f3-a0e2-d68afb6c3f27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 07:59:34.646794 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6115ef9-dbfe-41f3-a0e2-d68afb6c3f27 None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 07:59:34.647073 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6115ef9-dbfe-41f3-a0e2-d68afb6c3f27 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 07:59:34.647344 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6115ef9-dbfe-41f3-a0e2-d68afb6c3f27 None admin] PATH_INFO: `/v3/roles` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 07:59:34.648100 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6115ef9-dbfe-41f3-a0e2-d68afb6c3f27 None admin] RBAC: Adding query filter params (name=service) {{(pid=80347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 07:59:34.648471 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6115ef9-dbfe-41f3-a0e2-d68afb6c3f27 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 07:59:34.649915 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6115ef9-dbfe-41f3-a0e2-d68afb6c3f27 None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 07:59:34.658897 dv-cinder-851351-1-smb devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 339/640] 10.222.0.42 () {56 vars in 1103 bytes} [Thu Jul 28 07:59:34 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 07:59:34.659742 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6115ef9-dbfe-41f3-a0e2-d68afb6c3f27 None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 07:59:34.694189 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 07:59:34.700634 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b358448-41af-4c4c-b2df-98c7a8de1656 None admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 07:59:34.735987 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a754e1-caaa-499c-aa9c-01ee29674d92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 07:59:34.736631 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a754e1-caaa-499c-aa9c-01ee29674d92 None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 07:59:34.736934 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a754e1-caaa-499c-aa9c-01ee29674d92 None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 07:59:34.737199 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a754e1-caaa-499c-aa9c-01ee29674d92 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 07:59:34.748208 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a754e1-caaa-499c-aa9c-01ee29674d92 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 07:59:34.749722 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a754e1-caaa-499c-aa9c-01ee29674d92 None admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 07:59:34.765010 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application [None req-e1a754e1-caaa-499c-aa9c-01ee29674d92 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 07:59:34.765010 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 07:59:34.765010 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 07:59:34.765010 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 07:59:34.765010 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 07:59:34.765010 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 07:59:34.765010 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 07:59:34.765010 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 07:59:34.765010 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 07:59:34.765010 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 07:59:34.765010 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 07:59:34.765010 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 07:59:34.765010 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 07:59:34.765010 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 07:59:34.765010 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 07:59:34.766727 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 07:59:34.766727 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 07:59:34.766727 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 07:59:34.766727 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 07:59:34.766727 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 07:59:34.766727 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 07:59:34.766727 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 07:59:34.766727 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 07:59:34.766727 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application with Lock( Jul 28 07:59:34.766727 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 07:59:34.766727 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self._enter() Jul 28 07:59:34.766727 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 07:59:34.766727 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 07:59:34.766727 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 07:59:34.766727 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.creator() Jul 28 07:59:34.766727 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 07:59:34.766727 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application created_value = creator( Jul 28 07:59:34.767707 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 07:59:34.767707 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 07:59:34.767707 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 07:59:34.767707 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application Jul 28 07:59:34.767707 dv-cinder-851351-1-smb devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 302/641] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 07:59:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 07:59:34.767707 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7946c6cd-63cb-4235-a533-e87d4564ab9c None None] REQUEST_METHOD: `POST` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 07:59:34.767707 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7946c6cd-63cb-4235-a533-e87d4564ab9c None None] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 07:59:34.768122 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7946c6cd-63cb-4235-a533-e87d4564ab9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 07:59:34.778320 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6115ef9-dbfe-41f3-a0e2-d68afb6c3f27 None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 07:59:34.788512 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.auth.core [None req-7946c6cd-63cb-4235-a533-e87d4564ab9c None None] MFA Rules not processed for user `f0666d3a50644a7097367331c1ee1a68`. Rule list: `[]` (Enabled: `True`). {{(pid=80348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 07:59:34.789773 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.fernet_utils [None req-7946c6cd-63cb-4235-a533-e87d4564ab9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 07:59:34.816499 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea2f0a9-65a2-42af-a976-abdd8e2fb387 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 07:59:34.817212 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea2f0a9-65a2-42af-a976-abdd8e2fb387 None admin] REQUEST_METHOD: `PUT` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 07:59:34.817491 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea2f0a9-65a2-42af-a976-abdd8e2fb387 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 07:59:34.817755 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea2f0a9-65a2-42af-a976-abdd8e2fb387 None admin] PATH_INFO: `/v3/projects/139349507026497c98f360774dee737e/users/fe8c81659f704e14b8f0e00856a5a9a5/roles/a2d02bc3295c4a33b1fc0775a17a79e6` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 07:59:34.834498 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cea2f0a9-65a2-42af-a976-abdd8e2fb387 None admin] RBAC: Authorizing `identity:create_grant(project_id=139349507026497c98f360774dee737e, user_id=fe8c81659f704e14b8f0e00856a5a9a5, role_id=a2d02bc3295c4a33b1fc0775a17a79e6)` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 07:59:34.835964 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cea2f0a9-65a2-42af-a976-abdd8e2fb387 None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 07:59:34.851955 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=100 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 07:59:34.853326 dv-cinder-851351-1-smb devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 340/642] 10.222.0.42 () {58 vars in 1439 bytes} [Thu Jul 28 07:59:34 2022] PUT /identity/v3/projects/139349507026497c98f360774dee737e/users/fe8c81659f704e14b8f0e00856a5a9a5/roles/a2d02bc3295c4a33b1fc0775a17a79e6 => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 07:59:34.854791 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea2f0a9-65a2-42af-a976-abdd8e2fb387 None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 07:59:34.882702 dv-cinder-851351-1-smb devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 303/643] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 07:59:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 07:59:34.882702 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7946c6cd-63cb-4235-a533-e87d4564ab9c None None] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 07:59:34.985136 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 07:59:35.017454 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea2f0a9-65a2-42af-a976-abdd8e2fb387 None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 07:59:35.055553 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7946c6cd-63cb-4235-a533-e87d4564ab9c None None] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 07:59:35.060251 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d7d3dc-f109-40a4-bd4d-0673d2db35d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 07:59:35.060928 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d7d3dc-f109-40a4-bd4d-0673d2db35d3 None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 07:59:35.061203 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d7d3dc-f109-40a4-bd4d-0673d2db35d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 07:59:35.061471 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d7d3dc-f109-40a4-bd4d-0673d2db35d3 None admin] PATH_INFO: `/v3/users` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 07:59:35.062279 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85d7d3dc-f109-40a4-bd4d-0673d2db35d3 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 07:59:35.062579 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85d7d3dc-f109-40a4-bd4d-0673d2db35d3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 07:59:35.064000 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85d7d3dc-f109-40a4-bd4d-0673d2db35d3 None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 07:59:35.083883 dv-cinder-851351-1-smb devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 341/644] 10.222.0.42 () {56 vars in 1137 bytes} [Thu Jul 28 07:59:34 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 07:59:35.084775 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d7d3dc-f109-40a4-bd4d-0673d2db35d3 None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 07:59:35.095537 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a09a2c1-1a44-46dc-8566-84979d07b3d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 07:59:35.096201 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a09a2c1-1a44-46dc-8566-84979d07b3d1 None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 07:59:35.096481 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a09a2c1-1a44-46dc-8566-84979d07b3d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 07:59:35.096783 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a09a2c1-1a44-46dc-8566-84979d07b3d1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 07:59:35.109078 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a09a2c1-1a44-46dc-8566-84979d07b3d1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 07:59:35.110586 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a09a2c1-1a44-46dc-8566-84979d07b3d1 None admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 07:59:35.126615 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application [None req-5a09a2c1-1a44-46dc-8566-84979d07b3d1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 07:59:35.126615 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 07:59:35.126615 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 07:59:35.126615 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 07:59:35.126615 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 07:59:35.126615 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 07:59:35.126615 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 07:59:35.126615 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 07:59:35.126615 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 07:59:35.126615 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 07:59:35.126615 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 07:59:35.126615 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 07:59:35.126615 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 07:59:35.126615 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 07:59:35.126615 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 07:59:35.127602 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 07:59:35.127602 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 07:59:35.127602 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 07:59:35.127602 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 07:59:35.127602 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 07:59:35.127602 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 07:59:35.127602 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 07:59:35.127602 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 07:59:35.127602 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application with Lock( Jul 28 07:59:35.127602 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 07:59:35.127602 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self._enter() Jul 28 07:59:35.127602 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 07:59:35.127602 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 07:59:35.127602 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 07:59:35.127602 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.creator() Jul 28 07:59:35.127602 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 07:59:35.127602 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application created_value = creator( Jul 28 07:59:35.128655 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 07:59:35.128655 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 07:59:35.128655 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 07:59:35.128655 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application Jul 28 07:59:35.128655 dv-cinder-851351-1-smb devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 304/645] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 07:59:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 252 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 07:59:35.134182 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a09a2c1-1a44-46dc-8566-84979d07b3d1 None admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 07:59:35.187909 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=100 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 07:59:35.207391 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d7d3dc-f109-40a4-bd4d-0673d2db35d3 None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 07:59:35.239686 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 07:59:35.246046 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43317fb-56eb-49a2-93c4-dc738469e7b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 07:59:35.246681 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43317fb-56eb-49a2-93c4-dc738469e7b6 None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 07:59:35.247277 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a09a2c1-1a44-46dc-8566-84979d07b3d1 None admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 07:59:35.247494 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43317fb-56eb-49a2-93c4-dc738469e7b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 07:59:35.247786 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43317fb-56eb-49a2-93c4-dc738469e7b6 None admin] PATH_INFO: `/v3/domains` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 07:59:35.248490 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f43317fb-56eb-49a2-93c4-dc738469e7b6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 07:59:35.248834 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f43317fb-56eb-49a2-93c4-dc738469e7b6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 07:59:35.250310 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f43317fb-56eb-49a2-93c4-dc738469e7b6 None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 07:59:35.262416 dv-cinder-851351-1-smb devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 342/646] 10.222.0.42 () {56 vars in 1109 bytes} [Thu Jul 28 07:59:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 07:59:35.263346 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43317fb-56eb-49a2-93c4-dc738469e7b6 None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 07:59:35.287816 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33be7b21-2410-47c5-b3b8-b433bf797126 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 07:59:35.288477 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33be7b21-2410-47c5-b3b8-b433bf797126 None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 07:59:35.288796 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33be7b21-2410-47c5-b3b8-b433bf797126 None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 07:59:35.289071 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33be7b21-2410-47c5-b3b8-b433bf797126 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 07:59:35.299552 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33be7b21-2410-47c5-b3b8-b433bf797126 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 07:59:35.305035 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application [None req-33be7b21-2410-47c5-b3b8-b433bf797126 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 28 07:59:35.305035 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 07:59:35.305035 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 07:59:35.305035 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 07:59:35.305035 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 07:59:35.305035 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 07:59:35.305035 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 07:59:35.305035 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 07:59:35.305035 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 07:59:35.305035 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 07:59:35.305035 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 07:59:35.305035 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 07:59:35.305035 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 07:59:35.305035 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 07:59:35.305035 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 07:59:35.305035 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 07:59:35.305985 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 07:59:35.305985 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 07:59:35.305985 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 07:59:35.305985 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 07:59:35.305985 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 07:59:35.305985 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 07:59:35.305985 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 07:59:35.305985 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 07:59:35.305985 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 07:59:35.305985 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 07:59:35.305985 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 07:59:35.305985 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application with Lock( Jul 28 07:59:35.305985 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 07:59:35.305985 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self._enter() Jul 28 07:59:35.305985 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 07:59:35.305985 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 07:59:35.306853 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 07:59:35.306853 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.creator() Jul 28 07:59:35.306853 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 07:59:35.306853 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application created_value = creator( Jul 28 07:59:35.306853 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 07:59:35.306853 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 07:59:35.306853 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 07:59:35.306853 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 07:59:35.306853 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 07:59:35.306853 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 07:59:35.306853 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 28 07:59:35.306853 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application Jul 28 07:59:35.306853 dv-cinder-851351-1-smb devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 305/647] 10.222.0.42 () {56 vars in 1102 bytes} [Thu Jul 28 07:59:35 2022] GET /identity/v3/roles/service => generated 85 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 07:59:35.307566 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33be7b21-2410-47c5-b3b8-b433bf797126 None admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 07:59:35.378772 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43317fb-56eb-49a2-93c4-dc738469e7b6 None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 07:59:35.421397 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33be7b21-2410-47c5-b3b8-b433bf797126 None admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 07:59:35.432124 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=100 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 07:59:35.438338 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be3b493-f61a-4915-8b9c-6bbf31cb808d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 07:59:35.438637 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be3b493-f61a-4915-8b9c-6bbf31cb808d None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 07:59:35.438918 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be3b493-f61a-4915-8b9c-6bbf31cb808d None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 07:59:35.439183 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be3b493-f61a-4915-8b9c-6bbf31cb808d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 07:59:35.474003 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1438f01-4054-464d-a67a-8112ad3ef05a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 07:59:35.474928 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1438f01-4054-464d-a67a-8112ad3ef05a None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 07:59:35.475346 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1438f01-4054-464d-a67a-8112ad3ef05a None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 07:59:35.475801 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1438f01-4054-464d-a67a-8112ad3ef05a None admin] PATH_INFO: `/v3/domains` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 07:59:35.476863 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1438f01-4054-464d-a67a-8112ad3ef05a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80348) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 07:59:35.477285 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1438f01-4054-464d-a67a-8112ad3ef05a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 07:59:35.479039 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1438f01-4054-464d-a67a-8112ad3ef05a None admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 07:59:35.495751 dv-cinder-851351-1-smb devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 306/648] 10.222.0.42 () {56 vars in 1109 bytes} [Thu Jul 28 07:59:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 07:59:35.497206 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1438f01-4054-464d-a67a-8112ad3ef05a None admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 07:59:35.519541 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 07:59:35.533795 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8be3b493-f61a-4915-8b9c-6bbf31cb808d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 07:59:35.535306 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8be3b493-f61a-4915-8b9c-6bbf31cb808d None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 07:59:35.628378 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1438f01-4054-464d-a67a-8112ad3ef05a None admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 07:59:35.670949 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f1745a-c2ea-46fd-b8f1-409e2ca8271c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 07:59:35.681772 dv-cinder-851351-1-smb devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 343/649] 10.222.0.42 () {58 vars in 1282 bytes} [Thu Jul 28 07:59:35 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 411 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 28 07:59:35.682016 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f1745a-c2ea-46fd-b8f1-409e2ca8271c None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 07:59:35.682016 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f1745a-c2ea-46fd-b8f1-409e2ca8271c None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 07:59:35.682016 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f1745a-c2ea-46fd-b8f1-409e2ca8271c None admin] PATH_INFO: `/v3/projects/service` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 07:59:35.682385 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be3b493-f61a-4915-8b9c-6bbf31cb808d None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 07:59:35.689839 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f1745a-c2ea-46fd-b8f1-409e2ca8271c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 07:59:35.691343 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f1745a-c2ea-46fd-b8f1-409e2ca8271c None admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 07:59:35.703756 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application [None req-83f1745a-c2ea-46fd-b8f1-409e2ca8271c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 07:59:35.703756 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 07:59:35.703756 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 07:59:35.703756 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 07:59:35.703756 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 07:59:35.703756 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 07:59:35.703756 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 07:59:35.703756 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 07:59:35.703756 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 07:59:35.703756 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 07:59:35.703756 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 07:59:35.703756 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 07:59:35.703756 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 28 07:59:35.703756 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 28 07:59:35.703756 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 28 07:59:35.706627 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 28 07:59:35.706627 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 07:59:35.706627 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 07:59:35.706627 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 07:59:35.706627 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 07:59:35.706627 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 07:59:35.706627 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 07:59:35.706627 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 07:59:35.706627 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application with Lock( Jul 28 07:59:35.706627 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 07:59:35.706627 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self._enter() Jul 28 07:59:35.706627 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 07:59:35.706627 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 07:59:35.706627 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 07:59:35.706627 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.creator() Jul 28 07:59:35.706627 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 07:59:35.706627 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application created_value = creator( Jul 28 07:59:35.708384 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 28 07:59:35.708384 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 28 07:59:35.708384 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 28 07:59:35.708384 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 28 07:59:35.708384 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 28 07:59:35.708384 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 28 07:59:35.708384 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 07:59:35.708384 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application Jul 28 07:59:35.708384 dv-cinder-851351-1-smb devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 307/650] 10.222.0.42 () {56 vars in 1111 bytes} [Thu Jul 28 07:59:35 2022] GET /identity/v3/projects/service => generated 88 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 07:59:35.708384 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f1745a-c2ea-46fd-b8f1-409e2ca8271c None admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 07:59:35.739293 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=100 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 07:59:35.805999 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 07:59:35.818255 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be3b493-f61a-4915-8b9c-6bbf31cb808d None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 07:59:35.840298 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f1745a-c2ea-46fd-b8f1-409e2ca8271c None admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 07:59:35.879314 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e873ed5-5230-4627-acd6-2408fe6c2e0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 07:59:35.880285 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e873ed5-5230-4627-acd6-2408fe6c2e0b None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 07:59:35.880889 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e873ed5-5230-4627-acd6-2408fe6c2e0b None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 07:59:35.881332 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e873ed5-5230-4627-acd6-2408fe6c2e0b None admin] PATH_INFO: `/v3/roles` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 07:59:35.882615 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e873ed5-5230-4627-acd6-2408fe6c2e0b None admin] RBAC: Adding query filter params (name=service) {{(pid=80347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 07:59:35.883168 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e873ed5-5230-4627-acd6-2408fe6c2e0b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 07:59:35.885668 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e873ed5-5230-4627-acd6-2408fe6c2e0b None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 07:59:35.892787 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6c7b7c-726b-4047-8310-2e5fbaf534ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 07:59:35.893770 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6c7b7c-726b-4047-8310-2e5fbaf534ab None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 07:59:35.894214 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6c7b7c-726b-4047-8310-2e5fbaf534ab None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 07:59:35.894649 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6c7b7c-726b-4047-8310-2e5fbaf534ab None admin] PATH_INFO: `/v3/users/nova` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 07:59:35.898971 dv-cinder-851351-1-smb devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 344/651] 10.222.0.42 () {56 vars in 1103 bytes} [Thu Jul 28 07:59:35 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 07:59:35.899777 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e873ed5-5230-4627-acd6-2408fe6c2e0b None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 07:59:35.906200 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d6c7b7c-726b-4047-8310-2e5fbaf534ab None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 07:59:35.907665 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d6c7b7c-726b-4047-8310-2e5fbaf534ab None admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 07:59:35.919731 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application [None req-9d6c7b7c-726b-4047-8310-2e5fbaf534ab None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 28 07:59:35.919731 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 07:59:35.919731 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 07:59:35.919731 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 07:59:35.919731 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 07:59:35.919731 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 07:59:35.919731 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 07:59:35.919731 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 07:59:35.919731 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 07:59:35.919731 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 07:59:35.919731 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 07:59:35.919731 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 07:59:35.919731 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 28 07:59:35.919731 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 28 07:59:35.919731 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 28 07:59:35.919731 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 28 07:59:35.920747 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 07:59:35.920747 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 07:59:35.920747 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 28 07:59:35.920747 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 07:59:35.920747 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 28 07:59:35.920747 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 07:59:35.920747 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 07:59:35.920747 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 07:59:35.920747 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 07:59:35.920747 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 07:59:35.920747 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 07:59:35.920747 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application with Lock( Jul 28 07:59:35.920747 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 07:59:35.920747 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self._enter() Jul 28 07:59:35.920747 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 07:59:35.920747 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 07:59:35.920747 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 07:59:35.920747 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.creator() Jul 28 07:59:35.921711 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 07:59:35.921711 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application created_value = creator( Jul 28 07:59:35.921711 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 28 07:59:35.921711 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 28 07:59:35.921711 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 28 07:59:35.921711 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 28 07:59:35.921711 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 28 07:59:35.921711 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 28 07:59:35.921711 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 28 07:59:35.921711 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application Jul 28 07:59:35.925708 dv-cinder-851351-1-smb devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 308/652] 10.222.0.42 () {56 vars in 1093 bytes} [Thu Jul 28 07:59:35 2022] GET /identity/v3/users/nova => generated 82 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 07:59:35.926392 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6c7b7c-726b-4047-8310-2e5fbaf534ab None admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 07:59:36.021536 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e873ed5-5230-4627-acd6-2408fe6c2e0b None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 07:59:36.021745 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=100 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 07:59:36.040136 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6c7b7c-726b-4047-8310-2e5fbaf534ab None admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 07:59:36.076973 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-662b3f4c-7901-4b7f-a288-5347c8bb5ef7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 07:59:36.077292 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d3a082e-2803-4490-a086-a1f446e1d5ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 07:59:36.077608 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662b3f4c-7901-4b7f-a288-5347c8bb5ef7 None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 07:59:36.077884 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662b3f4c-7901-4b7f-a288-5347c8bb5ef7 None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 07:59:36.078135 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3a082e-2803-4490-a086-a1f446e1d5ad None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 07:59:36.078231 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662b3f4c-7901-4b7f-a288-5347c8bb5ef7 None admin] PATH_INFO: `/v3/projects` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 07:59:36.078602 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3a082e-2803-4490-a086-a1f446e1d5ad None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 07:59:36.078936 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-662b3f4c-7901-4b7f-a288-5347c8bb5ef7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80348) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 07:59:36.079121 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3a082e-2803-4490-a086-a1f446e1d5ad None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 07:59:36.079573 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-662b3f4c-7901-4b7f-a288-5347c8bb5ef7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 07:59:36.081034 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-662b3f4c-7901-4b7f-a288-5347c8bb5ef7 None admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 07:59:36.098855 dv-cinder-851351-1-smb devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 309/653] 10.222.0.42 () {56 vars in 1148 bytes} [Thu Jul 28 07:59:35 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 07:59:36.098855 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-662b3f4c-7901-4b7f-a288-5347c8bb5ef7 None admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 07:59:36.106265 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d3a082e-2803-4490-a086-a1f446e1d5ad None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 07:59:36.108121 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d3a082e-2803-4490-a086-a1f446e1d5ad None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 07:59:36.124741 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application [None req-3d3a082e-2803-4490-a086-a1f446e1d5ad None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 07:59:36.124741 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 07:59:36.124741 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 07:59:36.124741 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 07:59:36.124741 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 07:59:36.124741 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 07:59:36.124741 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 07:59:36.124741 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 07:59:36.124741 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 07:59:36.124741 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 07:59:36.124741 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 07:59:36.124741 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 07:59:36.124741 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 07:59:36.124741 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 07:59:36.124741 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 07:59:36.125698 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 07:59:36.125698 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 07:59:36.125698 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 07:59:36.125698 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 07:59:36.125698 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 07:59:36.125698 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 07:59:36.125698 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 07:59:36.125698 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 07:59:36.125698 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application with Lock( Jul 28 07:59:36.125698 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 07:59:36.125698 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._enter() Jul 28 07:59:36.125698 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 07:59:36.125698 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 07:59:36.125698 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 07:59:36.125698 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.creator() Jul 28 07:59:36.125698 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 07:59:36.125698 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application created_value = creator( Jul 28 07:59:36.126660 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 07:59:36.126660 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 07:59:36.126660 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 07:59:36.126660 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application Jul 28 07:59:36.126660 dv-cinder-851351-1-smb devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 345/654] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 07:59:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 07:59:36.126936 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d3a082e-2803-4490-a086-a1f446e1d5ad None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 07:59:36.137231 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 07:59:36.220814 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-662b3f4c-7901-4b7f-a288-5347c8bb5ef7 None admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 07:59:36.239760 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d3a082e-2803-4490-a086-a1f446e1d5ad None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 07:59:36.258841 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e20ab8e2-af50-4618-8a15-14a9686ee649 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 07:59:36.259487 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20ab8e2-af50-4618-8a15-14a9686ee649 None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 07:59:36.259759 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20ab8e2-af50-4618-8a15-14a9686ee649 None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 07:59:36.260024 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20ab8e2-af50-4618-8a15-14a9686ee649 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 07:59:36.271611 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e20ab8e2-af50-4618-8a15-14a9686ee649 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 07:59:36.273118 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e20ab8e2-af50-4618-8a15-14a9686ee649 None admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 07:59:36.275851 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=100 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 07:59:36.277454 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bbc538d-e94a-41de-abbd-3ae1d0859e03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 07:59:36.278198 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbc538d-e94a-41de-abbd-3ae1d0859e03 None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 07:59:36.278470 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbc538d-e94a-41de-abbd-3ae1d0859e03 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 07:59:36.278758 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbc538d-e94a-41de-abbd-3ae1d0859e03 None admin] PATH_INFO: `/v3/users` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 07:59:36.279570 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bbc538d-e94a-41de-abbd-3ae1d0859e03 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 07:59:36.279870 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bbc538d-e94a-41de-abbd-3ae1d0859e03 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 07:59:36.281794 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bbc538d-e94a-41de-abbd-3ae1d0859e03 None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 07:59:36.289175 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application [None req-e20ab8e2-af50-4618-8a15-14a9686ee649 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 07:59:36.289175 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 07:59:36.289175 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 07:59:36.289175 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 07:59:36.289175 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 07:59:36.289175 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 07:59:36.289175 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 07:59:36.289175 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 07:59:36.289175 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 07:59:36.289175 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 07:59:36.289175 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 07:59:36.289175 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 07:59:36.289175 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 07:59:36.289175 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 07:59:36.289175 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 07:59:36.290066 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 07:59:36.290066 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 07:59:36.290066 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 07:59:36.290066 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 07:59:36.290066 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 07:59:36.290066 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 07:59:36.290066 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 07:59:36.290066 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 07:59:36.290066 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application with Lock( Jul 28 07:59:36.290066 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 07:59:36.290066 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self._enter() Jul 28 07:59:36.290066 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 07:59:36.290066 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 07:59:36.290066 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 07:59:36.290066 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.creator() Jul 28 07:59:36.290066 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 07:59:36.290066 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application created_value = creator( Jul 28 07:59:36.290947 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 07:59:36.290947 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 07:59:36.290947 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 07:59:36.290947 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application Jul 28 07:59:36.290947 dv-cinder-851351-1-smb devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 310/655] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 07:59:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 07:59:36.291269 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e20ab8e2-af50-4618-8a15-14a9686ee649 None admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 07:59:36.307399 dv-cinder-851351-1-smb devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 346/656] 10.222.0.42 () {56 vars in 1133 bytes} [Thu Jul 28 07:59:36 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 07:59:36.313038 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bbc538d-e94a-41de-abbd-3ae1d0859e03 None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 07:59:36.385409 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 07:59:36.399248 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e20ab8e2-af50-4618-8a15-14a9686ee649 None admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 07:59:36.426300 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bbc538d-e94a-41de-abbd-3ae1d0859e03 None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 07:59:36.436978 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13be36d4-7683-46d0-a428-83ce55f774bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 07:59:36.438152 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13be36d4-7683-46d0-a428-83ce55f774bd None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 07:59:36.438880 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13be36d4-7683-46d0-a428-83ce55f774bd None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 07:59:36.439330 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13be36d4-7683-46d0-a428-83ce55f774bd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 07:59:36.440453 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13be36d4-7683-46d0-a428-83ce55f774bd None admin] RBAC: Adding query filter params (role.id=a2d02bc3295c4a33b1fc0775a17a79e6, scope.project.id=139349507026497c98f360774dee737e, user.id=0973def3ea2b4b43ac0e855eff7fcc77) {{(pid=80348) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 07:59:36.441339 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13be36d4-7683-46d0-a428-83ce55f774bd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 07:59:36.443394 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13be36d4-7683-46d0-a428-83ce55f774bd None admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 07:59:36.451914 dv-cinder-851351-1-smb devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 311/657] 10.222.0.42 () {56 vars in 1374 bytes} [Thu Jul 28 07:59:36 2022] GET /identity/v3/role_assignments?user.id=0973def3ea2b4b43ac0e855eff7fcc77&scope.project.id=139349507026497c98f360774dee737e&role.id=a2d02bc3295c4a33b1fc0775a17a79e6 => generated 608 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 07:59:36.453396 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13be36d4-7683-46d0-a428-83ce55f774bd None admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 07:59:36.461014 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e3fe325-f8a0-4c23-9cae-bac49c03685e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 07:59:36.461784 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3fe325-f8a0-4c23-9cae-bac49c03685e None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 07:59:36.462255 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3fe325-f8a0-4c23-9cae-bac49c03685e None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 07:59:36.462589 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3fe325-f8a0-4c23-9cae-bac49c03685e None admin] PATH_INFO: `/v3/domains` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 07:59:36.463302 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e3fe325-f8a0-4c23-9cae-bac49c03685e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 07:59:36.463598 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e3fe325-f8a0-4c23-9cae-bac49c03685e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 07:59:36.465166 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e3fe325-f8a0-4c23-9cae-bac49c03685e None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 07:59:36.483605 dv-cinder-851351-1-smb devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 347/658] 10.222.0.42 () {56 vars in 1109 bytes} [Thu Jul 28 07:59:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 07:59:36.483605 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e3fe325-f8a0-4c23-9cae-bac49c03685e None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 07:59:36.585133 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=100 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 07:59:36.615142 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e3fe325-f8a0-4c23-9cae-bac49c03685e None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 07:59:36.615819 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13be36d4-7683-46d0-a428-83ce55f774bd None admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 07:59:36.645947 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 07:59:36.660153 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ae16b0-c3fb-49b7-9410-6cdc8ab7f01d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 07:59:36.660838 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ae16b0-c3fb-49b7-9410-6cdc8ab7f01d None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 07:59:36.661456 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ae16b0-c3fb-49b7-9410-6cdc8ab7f01d None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 07:59:36.661456 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ae16b0-c3fb-49b7-9410-6cdc8ab7f01d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 07:59:36.666080 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da7dc51-dc0e-4130-9c6b-68f0bc9fe13f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 07:59:36.667088 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da7dc51-dc0e-4130-9c6b-68f0bc9fe13f None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 07:59:36.667367 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da7dc51-dc0e-4130-9c6b-68f0bc9fe13f None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 07:59:36.667641 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da7dc51-dc0e-4130-9c6b-68f0bc9fe13f None admin] PATH_INFO: `/v3/domains` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 07:59:36.668354 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1da7dc51-dc0e-4130-9c6b-68f0bc9fe13f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80348) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 07:59:36.668698 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1da7dc51-dc0e-4130-9c6b-68f0bc9fe13f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 07:59:36.670092 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1da7dc51-dc0e-4130-9c6b-68f0bc9fe13f None admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 07:59:36.686645 dv-cinder-851351-1-smb devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 312/659] 10.222.0.42 () {56 vars in 1109 bytes} [Thu Jul 28 07:59:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 07:59:36.687532 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da7dc51-dc0e-4130-9c6b-68f0bc9fe13f None admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 07:59:36.768864 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63ae16b0-c3fb-49b7-9410-6cdc8ab7f01d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 07:59:36.770707 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63ae16b0-c3fb-49b7-9410-6cdc8ab7f01d None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 07:59:36.819132 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da7dc51-dc0e-4130-9c6b-68f0bc9fe13f None admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 07:59:36.846933 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=100 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 07:59:36.868902 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d34e3d-7cf7-48b3-90aa-4329ed55c840 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 07:59:36.869568 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d34e3d-7cf7-48b3-90aa-4329ed55c840 None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 07:59:36.869847 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d34e3d-7cf7-48b3-90aa-4329ed55c840 None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 07:59:36.870191 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d34e3d-7cf7-48b3-90aa-4329ed55c840 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 07:59:36.880023 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d34e3d-7cf7-48b3-90aa-4329ed55c840 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 07:59:36.883656 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d34e3d-7cf7-48b3-90aa-4329ed55c840 None admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 07:59:36.890085 dv-cinder-851351-1-smb devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 348/660] 10.222.0.42 () {58 vars in 1282 bytes} [Thu Jul 28 07:59:36 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 410 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 28 07:59:36.891566 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ae16b0-c3fb-49b7-9410-6cdc8ab7f01d None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 07:59:36.898370 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application [None req-e4d34e3d-7cf7-48b3-90aa-4329ed55c840 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 07:59:36.898370 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 07:59:36.898370 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 07:59:36.898370 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 07:59:36.898370 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 07:59:36.898370 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 07:59:36.898370 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 07:59:36.898370 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 07:59:36.898370 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 07:59:36.898370 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 07:59:36.898370 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 07:59:36.898370 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 07:59:36.898370 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 28 07:59:36.898370 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 28 07:59:36.898370 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 28 07:59:36.899390 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 28 07:59:36.899390 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 07:59:36.899390 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 07:59:36.899390 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 07:59:36.899390 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 07:59:36.899390 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 07:59:36.899390 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 07:59:36.899390 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 07:59:36.899390 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application with Lock( Jul 28 07:59:36.899390 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 07:59:36.899390 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self._enter() Jul 28 07:59:36.899390 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 07:59:36.899390 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 07:59:36.899390 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 07:59:36.899390 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.creator() Jul 28 07:59:36.899390 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 07:59:36.899390 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application created_value = creator( Jul 28 07:59:36.900279 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 28 07:59:36.900279 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 28 07:59:36.900279 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 28 07:59:36.900279 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 28 07:59:36.900279 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 28 07:59:36.900279 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 28 07:59:36.900279 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 07:59:36.900279 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application Jul 28 07:59:36.904750 dv-cinder-851351-1-smb devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 313/661] 10.222.0.42 () {56 vars in 1111 bytes} [Thu Jul 28 07:59:36 2022] GET /identity/v3/projects/service => generated 88 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 07:59:36.905863 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d34e3d-7cf7-48b3-90aa-4329ed55c840 None admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 07:59:36.924191 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 07:59:37.017092 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ae16b0-c3fb-49b7-9410-6cdc8ab7f01d None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 07:59:37.060284 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e6211c9-e421-4ef9-9ecc-2edb7c55843e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 07:59:37.061676 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6211c9-e421-4ef9-9ecc-2edb7c55843e None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 07:59:37.062146 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6211c9-e421-4ef9-9ecc-2edb7c55843e None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 07:59:37.062578 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6211c9-e421-4ef9-9ecc-2edb7c55843e None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 07:59:37.071966 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d34e3d-7cf7-48b3-90aa-4329ed55c840 None admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 07:59:37.073494 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e6211c9-e421-4ef9-9ecc-2edb7c55843e None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 07:59:37.075340 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e6211c9-e421-4ef9-9ecc-2edb7c55843e None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 07:59:37.090165 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application [None req-1e6211c9-e421-4ef9-9ecc-2edb7c55843e None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jul 28 07:59:37.090165 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 07:59:37.090165 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 07:59:37.090165 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 07:59:37.090165 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 07:59:37.090165 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 07:59:37.090165 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 07:59:37.090165 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 07:59:37.090165 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 07:59:37.090165 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 07:59:37.090165 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 07:59:37.090165 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 07:59:37.090165 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 28 07:59:37.090165 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 28 07:59:37.090165 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 28 07:59:37.090165 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 28 07:59:37.091271 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 07:59:37.091271 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 07:59:37.091271 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 28 07:59:37.091271 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 07:59:37.091271 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 28 07:59:37.091271 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 07:59:37.091271 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 07:59:37.091271 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 07:59:37.091271 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 07:59:37.091271 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 07:59:37.091271 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 07:59:37.091271 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application with Lock( Jul 28 07:59:37.091271 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 07:59:37.091271 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._enter() Jul 28 07:59:37.091271 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 07:59:37.091271 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 07:59:37.091271 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 07:59:37.091271 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.creator() Jul 28 07:59:37.092266 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 07:59:37.092266 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application created_value = creator( Jul 28 07:59:37.092266 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 28 07:59:37.092266 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 28 07:59:37.092266 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 28 07:59:37.092266 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 28 07:59:37.092266 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 28 07:59:37.092266 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 28 07:59:37.092266 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jul 28 07:59:37.092266 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application Jul 28 07:59:37.092266 dv-cinder-851351-1-smb devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 349/662] 10.222.0.42 () {56 vars in 1102 bytes} [Thu Jul 28 07:59:36 2022] GET /identity/v3/users/neutron => generated 85 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 07:59:37.092995 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e6211c9-e421-4ef9-9ecc-2edb7c55843e None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 07:59:37.124633 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1cfe2c-000a-4218-ad0e-aeb92e473ad8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 07:59:37.125314 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1cfe2c-000a-4218-ad0e-aeb92e473ad8 None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 07:59:37.125591 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1cfe2c-000a-4218-ad0e-aeb92e473ad8 None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 07:59:37.125867 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1cfe2c-000a-4218-ad0e-aeb92e473ad8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 07:59:37.136724 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae1cfe2c-000a-4218-ad0e-aeb92e473ad8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 07:59:37.138219 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae1cfe2c-000a-4218-ad0e-aeb92e473ad8 None admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 07:59:37.153917 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application [None req-ae1cfe2c-000a-4218-ad0e-aeb92e473ad8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 07:59:37.153917 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 07:59:37.153917 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 07:59:37.153917 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 07:59:37.153917 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 07:59:37.153917 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 07:59:37.153917 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 07:59:37.153917 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 07:59:37.153917 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 07:59:37.153917 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 07:59:37.153917 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 07:59:37.153917 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 07:59:37.153917 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 07:59:37.153917 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 07:59:37.153917 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 07:59:37.154881 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 07:59:37.154881 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 07:59:37.154881 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 07:59:37.154881 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 07:59:37.154881 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 07:59:37.154881 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 07:59:37.154881 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 07:59:37.154881 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 07:59:37.154881 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application with Lock( Jul 28 07:59:37.154881 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 07:59:37.154881 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self._enter() Jul 28 07:59:37.154881 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 07:59:37.154881 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 07:59:37.154881 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 07:59:37.154881 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.creator() Jul 28 07:59:37.154881 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 07:59:37.154881 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application created_value = creator( Jul 28 07:59:37.155814 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 07:59:37.155814 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 07:59:37.155814 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 07:59:37.155814 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application Jul 28 07:59:37.159510 dv-cinder-851351-1-smb devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 314/663] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 07:59:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 254 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 07:59:37.161259 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc778958-aa38-4218-b60e-6844a126ecb7 None None] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 07:59:37.161546 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc778958-aa38-4218-b60e-6844a126ecb7 None None] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 07:59:37.161818 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc778958-aa38-4218-b60e-6844a126ecb7 None None] PATH_INFO: `/` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 07:59:37.164706 dv-cinder-851351-1-smb devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 315/664] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 07:59:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 07:59:37.164706 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc778958-aa38-4218-b60e-6844a126ecb7 None None] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 07:59:37.201063 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=100 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 07:59:37.207155 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 07:59:37.226590 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e6211c9-e421-4ef9-9ecc-2edb7c55843e None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 07:59:37.264072 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3622e4cd-fc05-4970-821c-e188eb0bc3ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 07:59:37.264682 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3622e4cd-fc05-4970-821c-e188eb0bc3ab None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 07:59:37.264986 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3622e4cd-fc05-4970-821c-e188eb0bc3ab None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 07:59:37.265261 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3622e4cd-fc05-4970-821c-e188eb0bc3ab None admin] PATH_INFO: `/v3/projects` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 07:59:37.266019 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3622e4cd-fc05-4970-821c-e188eb0bc3ab None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 07:59:37.266324 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3622e4cd-fc05-4970-821c-e188eb0bc3ab None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 07:59:37.267875 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3622e4cd-fc05-4970-821c-e188eb0bc3ab None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 07:59:37.277998 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc778958-aa38-4218-b60e-6844a126ecb7 None None] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 07:59:37.284737 dv-cinder-851351-1-smb devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 350/665] 10.222.0.42 () {56 vars in 1148 bytes} [Thu Jul 28 07:59:37 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 07:59:37.284737 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3622e4cd-fc05-4970-821c-e188eb0bc3ab None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 07:59:37.319344 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a0e2da-a0cd-4e3d-9f4e-18b6c4db4449 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 07:59:37.319971 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a0e2da-a0cd-4e3d-9f4e-18b6c4db4449 None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 07:59:37.320251 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a0e2da-a0cd-4e3d-9f4e-18b6c4db4449 None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 07:59:37.320519 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a0e2da-a0cd-4e3d-9f4e-18b6c4db4449 None admin] PATH_INFO: `/v3/users` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 07:59:37.321363 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93a0e2da-a0cd-4e3d-9f4e-18b6c4db4449 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80348) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 07:59:37.321676 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93a0e2da-a0cd-4e3d-9f4e-18b6c4db4449 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 07:59:37.323130 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93a0e2da-a0cd-4e3d-9f4e-18b6c4db4449 None admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 07:59:37.347500 dv-cinder-851351-1-smb devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 316/666] 10.222.0.42 () {56 vars in 1139 bytes} [Thu Jul 28 07:59:37 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 07:59:37.347500 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c23d5a-6a59-46a0-accd-331c87906536 None None] REQUEST_METHOD: `POST` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 07:59:37.347500 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c23d5a-6a59-46a0-accd-331c87906536 None None] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 07:59:37.347500 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c23d5a-6a59-46a0-accd-331c87906536 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 07:59:37.364000 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.auth.core [None req-09c23d5a-6a59-46a0-accd-331c87906536 None None] MFA Rules not processed for user `f0666d3a50644a7097367331c1ee1a68`. Rule list: `[]` (Enabled: `True`). {{(pid=80348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 07:59:37.365253 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.fernet_utils [None req-09c23d5a-6a59-46a0-accd-331c87906536 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 07:59:37.394673 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3622e4cd-fc05-4970-821c-e188eb0bc3ab None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 07:59:37.430353 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b3aa22-48d8-40bb-8035-d28003e53689 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 07:59:37.430995 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b3aa22-48d8-40bb-8035-d28003e53689 None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 07:59:37.431271 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b3aa22-48d8-40bb-8035-d28003e53689 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 07:59:37.431648 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b3aa22-48d8-40bb-8035-d28003e53689 None admin] PATH_INFO: `/v3/domains` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 07:59:37.432349 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b3aa22-48d8-40bb-8035-d28003e53689 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 07:59:37.432774 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b3aa22-48d8-40bb-8035-d28003e53689 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 07:59:37.434158 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b3aa22-48d8-40bb-8035-d28003e53689 None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 07:59:37.436710 dv-cinder-851351-1-smb devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 317/667] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 07:59:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 07:59:37.437305 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c23d5a-6a59-46a0-accd-331c87906536 None None] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 07:59:37.456427 dv-cinder-851351-1-smb devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 351/668] 10.222.0.42 () {56 vars in 1109 bytes} [Thu Jul 28 07:59:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 07:59:37.457539 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b3aa22-48d8-40bb-8035-d28003e53689 None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 07:59:37.461814 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 07:59:37.472536 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=100 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 07:59:37.561912 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c23d5a-6a59-46a0-accd-331c87906536 None None] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 07:59:37.571200 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b3aa22-48d8-40bb-8035-d28003e53689 None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 07:59:37.604202 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb6afab-0507-4230-92fc-6ec8e4c47080 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 07:59:37.604873 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb6afab-0507-4230-92fc-6ec8e4c47080 None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 07:59:37.605152 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb6afab-0507-4230-92fc-6ec8e4c47080 None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 07:59:37.605426 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb6afab-0507-4230-92fc-6ec8e4c47080 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 07:59:37.606228 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffb6afab-0507-4230-92fc-6ec8e4c47080 None admin] RBAC: Adding query filter params (role.id=a2d02bc3295c4a33b1fc0775a17a79e6, scope.project.id=139349507026497c98f360774dee737e, user.id=009cfabce8d64f9b894a6a0979d2a213) {{(pid=80348) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 07:59:37.606538 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffb6afab-0507-4230-92fc-6ec8e4c47080 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 07:59:37.608040 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffb6afab-0507-4230-92fc-6ec8e4c47080 None admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 07:59:37.612127 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3353baa-4eec-4340-a3d7-c83c864f87fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 07:59:37.613345 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3353baa-4eec-4340-a3d7-c83c864f87fb None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 07:59:37.613826 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3353baa-4eec-4340-a3d7-c83c864f87fb None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 07:59:37.614316 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3353baa-4eec-4340-a3d7-c83c864f87fb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 07:59:37.614553 dv-cinder-851351-1-smb devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 318/669] 10.222.0.42 () {56 vars in 1374 bytes} [Thu Jul 28 07:59:37 2022] GET /identity/v3/role_assignments?user.id=009cfabce8d64f9b894a6a0979d2a213&scope.project.id=139349507026497c98f360774dee737e&role.id=a2d02bc3295c4a33b1fc0775a17a79e6 => generated 608 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 07:59:37.615389 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb6afab-0507-4230-92fc-6ec8e4c47080 None admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 07:59:37.717828 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3353baa-4eec-4340-a3d7-c83c864f87fb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 07:59:37.720795 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3353baa-4eec-4340-a3d7-c83c864f87fb None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 07:59:37.723457 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=100 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 07:59:37.726650 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 07:59:37.746720 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb6afab-0507-4230-92fc-6ec8e4c47080 None admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 07:59:37.786554 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34dcbe2e-e30d-4233-a651-7cb783e13df2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 07:59:37.787462 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34dcbe2e-e30d-4233-a651-7cb783e13df2 None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 07:59:37.787739 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34dcbe2e-e30d-4233-a651-7cb783e13df2 None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 07:59:37.788055 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34dcbe2e-e30d-4233-a651-7cb783e13df2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 07:59:37.795955 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34dcbe2e-e30d-4233-a651-7cb783e13df2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 07:59:37.797474 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34dcbe2e-e30d-4233-a651-7cb783e13df2 None admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 07:59:37.810832 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application [None req-34dcbe2e-e30d-4233-a651-7cb783e13df2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 07:59:37.810832 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 07:59:37.810832 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 07:59:37.810832 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 07:59:37.810832 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 07:59:37.810832 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 07:59:37.810832 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 07:59:37.810832 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 07:59:37.810832 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 07:59:37.810832 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 07:59:37.810832 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 07:59:37.810832 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 07:59:37.810832 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 28 07:59:37.810832 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 28 07:59:37.810832 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 28 07:59:37.811785 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 28 07:59:37.811785 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 07:59:37.811785 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 07:59:37.811785 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 07:59:37.811785 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 07:59:37.811785 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 07:59:37.811785 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 07:59:37.811785 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 07:59:37.811785 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application with Lock( Jul 28 07:59:37.811785 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 07:59:37.811785 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self._enter() Jul 28 07:59:37.811785 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 07:59:37.811785 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 07:59:37.811785 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 07:59:37.811785 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.creator() Jul 28 07:59:37.811785 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 07:59:37.811785 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application created_value = creator( Jul 28 07:59:37.812641 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 28 07:59:37.812641 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 28 07:59:37.812641 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 28 07:59:37.812641 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 28 07:59:37.812641 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 28 07:59:37.812641 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 28 07:59:37.812641 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 07:59:37.812641 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application Jul 28 07:59:37.815243 dv-cinder-851351-1-smb devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 319/670] 10.222.0.42 () {56 vars in 1111 bytes} [Thu Jul 28 07:59:37 2022] GET /identity/v3/projects/service => generated 88 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 07:59:37.816298 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34dcbe2e-e30d-4233-a651-7cb783e13df2 None admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 07:59:37.869703 dv-cinder-851351-1-smb devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 352/671] 10.222.0.42 () {58 vars in 1282 bytes} [Thu Jul 28 07:59:37 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 412 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 28 07:59:37.870470 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3353baa-4eec-4340-a3d7-c83c864f87fb None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 07:59:37.939943 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34dcbe2e-e30d-4233-a651-7cb783e13df2 None admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 07:59:37.976130 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5311d468-3e8f-4e34-a28a-a66cd3c69788 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 07:59:37.977176 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5311d468-3e8f-4e34-a28a-a66cd3c69788 None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 07:59:37.977649 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5311d468-3e8f-4e34-a28a-a66cd3c69788 None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 07:59:37.978108 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5311d468-3e8f-4e34-a28a-a66cd3c69788 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 07:59:37.989438 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5311d468-3e8f-4e34-a28a-a66cd3c69788 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 07:59:37.992809 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3353baa-4eec-4340-a3d7-c83c864f87fb None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 07:59:37.995277 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 07:59:37.996125 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application [None req-5311d468-3e8f-4e34-a28a-a66cd3c69788 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 28 07:59:37.996125 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 07:59:37.996125 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 07:59:37.996125 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 07:59:37.996125 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 07:59:37.996125 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 07:59:37.996125 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 07:59:37.996125 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 07:59:37.996125 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 07:59:37.996125 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 07:59:37.996125 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 07:59:37.996125 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 07:59:37.996125 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 07:59:37.996125 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 07:59:37.996125 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 07:59:37.996125 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 07:59:37.998138 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 07:59:37.998138 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 07:59:37.998138 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 07:59:37.998138 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 07:59:37.998138 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 07:59:37.998138 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 07:59:37.998138 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 07:59:37.998138 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 07:59:37.998138 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 07:59:37.998138 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 07:59:37.998138 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 07:59:37.998138 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application with Lock( Jul 28 07:59:37.998138 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 07:59:37.998138 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self._enter() Jul 28 07:59:37.998138 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 07:59:37.998138 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 07:59:37.999157 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 07:59:37.999157 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.creator() Jul 28 07:59:37.999157 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 07:59:37.999157 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application created_value = creator( Jul 28 07:59:37.999157 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 07:59:37.999157 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 07:59:37.999157 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 07:59:37.999157 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 07:59:37.999157 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 07:59:37.999157 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 07:59:37.999157 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 28 07:59:37.999157 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application Jul 28 07:59:38.001043 dv-cinder-851351-1-smb devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 320/672] 10.222.0.42 () {56 vars in 1102 bytes} [Thu Jul 28 07:59:37 2022] GET /identity/v3/roles/service => generated 85 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 07:59:38.002083 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5311d468-3e8f-4e34-a28a-a66cd3c69788 None admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 07:59:38.007049 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=100 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 07:59:38.037757 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2040af4f-b8d9-4363-b9b3-3a4da46321aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 07:59:38.038388 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2040af4f-b8d9-4363-b9b3-3a4da46321aa None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 07:59:38.038662 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2040af4f-b8d9-4363-b9b3-3a4da46321aa None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 07:59:38.038930 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2040af4f-b8d9-4363-b9b3-3a4da46321aa None admin] PATH_INFO: `/v3/projects` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 07:59:38.039782 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2040af4f-b8d9-4363-b9b3-3a4da46321aa None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 07:59:38.040094 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2040af4f-b8d9-4363-b9b3-3a4da46321aa None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 07:59:38.041679 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2040af4f-b8d9-4363-b9b3-3a4da46321aa None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 07:59:38.055533 dv-cinder-851351-1-smb devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 353/673] 10.222.0.42 () {56 vars in 1148 bytes} [Thu Jul 28 07:59:37 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 07:59:38.061401 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2040af4f-b8d9-4363-b9b3-3a4da46321aa None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 07:59:38.109196 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5311d468-3e8f-4e34-a28a-a66cd3c69788 None admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 07:59:38.143520 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d2b0ed6-0e46-4cc9-9a2b-9d62abdebc75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 07:59:38.144594 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2b0ed6-0e46-4cc9-9a2b-9d62abdebc75 None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 07:59:38.145105 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2b0ed6-0e46-4cc9-9a2b-9d62abdebc75 None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 07:59:38.145567 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2b0ed6-0e46-4cc9-9a2b-9d62abdebc75 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 07:59:38.157195 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d2b0ed6-0e46-4cc9-9a2b-9d62abdebc75 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 07:59:38.159045 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d2b0ed6-0e46-4cc9-9a2b-9d62abdebc75 None admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 07:59:38.172953 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2040af4f-b8d9-4363-b9b3-3a4da46321aa None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 07:59:38.175567 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application [None req-9d2b0ed6-0e46-4cc9-9a2b-9d62abdebc75 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 07:59:38.175567 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 07:59:38.175567 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 07:59:38.175567 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 07:59:38.175567 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 07:59:38.175567 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 07:59:38.175567 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 07:59:38.175567 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 07:59:38.175567 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 07:59:38.175567 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 07:59:38.175567 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 07:59:38.175567 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 07:59:38.175567 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 07:59:38.175567 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 07:59:38.175567 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 07:59:38.176414 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 07:59:38.176414 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 07:59:38.176414 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 07:59:38.176414 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 07:59:38.176414 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 07:59:38.176414 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 07:59:38.176414 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 07:59:38.176414 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 07:59:38.176414 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application with Lock( Jul 28 07:59:38.176414 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 07:59:38.176414 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self._enter() Jul 28 07:59:38.176414 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 07:59:38.176414 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 07:59:38.176414 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 07:59:38.176414 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.creator() Jul 28 07:59:38.176414 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 07:59:38.176414 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application created_value = creator( Jul 28 07:59:38.177389 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 07:59:38.177389 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 07:59:38.177389 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 07:59:38.177389 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application Jul 28 07:59:38.179254 dv-cinder-851351-1-smb devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 321/674] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 07:59:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 07:59:38.180290 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d2b0ed6-0e46-4cc9-9a2b-9d62abdebc75 None admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 07:59:38.211681 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36fbb4de-d701-4a8f-bcd5-da60be30076f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 07:59:38.212310 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fbb4de-d701-4a8f-bcd5-da60be30076f None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 07:59:38.212584 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fbb4de-d701-4a8f-bcd5-da60be30076f None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 07:59:38.212975 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fbb4de-d701-4a8f-bcd5-da60be30076f None admin] PATH_INFO: `/v3/roles` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 07:59:38.213878 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36fbb4de-d701-4a8f-bcd5-da60be30076f None admin] RBAC: Adding query filter params (name=service) {{(pid=80347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 07:59:38.214190 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36fbb4de-d701-4a8f-bcd5-da60be30076f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 07:59:38.215622 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36fbb4de-d701-4a8f-bcd5-da60be30076f None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 07:59:38.229678 dv-cinder-851351-1-smb devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 354/675] 10.222.0.42 () {56 vars in 1103 bytes} [Thu Jul 28 07:59:38 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 07:59:38.230612 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36fbb4de-d701-4a8f-bcd5-da60be30076f None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 07:59:38.247710 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=100 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 07:59:38.272203 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 07:59:38.303973 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d2b0ed6-0e46-4cc9-9a2b-9d62abdebc75 None admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 07:59:38.343015 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea9205d-1ff5-44cf-ad82-95bce739b8fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 07:59:38.343664 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea9205d-1ff5-44cf-ad82-95bce739b8fe None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 07:59:38.343941 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea9205d-1ff5-44cf-ad82-95bce739b8fe None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 07:59:38.344208 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea9205d-1ff5-44cf-ad82-95bce739b8fe None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 07:59:38.345097 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ea9205d-1ff5-44cf-ad82-95bce739b8fe None admin] RBAC: Adding query filter params (role.id=a2d02bc3295c4a33b1fc0775a17a79e6, scope.project.id=139349507026497c98f360774dee737e, user.id=02f10880691d4fd180f96f3e40e1d25f) {{(pid=80348) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 07:59:38.345403 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ea9205d-1ff5-44cf-ad82-95bce739b8fe None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 07:59:38.347109 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ea9205d-1ff5-44cf-ad82-95bce739b8fe None admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 07:59:38.356038 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36fbb4de-d701-4a8f-bcd5-da60be30076f None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 07:59:38.361468 dv-cinder-851351-1-smb devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 322/676] 10.222.0.42 () {56 vars in 1374 bytes} [Thu Jul 28 07:59:38 2022] GET /identity/v3/role_assignments?user.id=02f10880691d4fd180f96f3e40e1d25f&scope.project.id=139349507026497c98f360774dee737e&role.id=a2d02bc3295c4a33b1fc0775a17a79e6 => generated 608 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 07:59:38.362501 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea9205d-1ff5-44cf-ad82-95bce739b8fe None admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 07:59:38.395609 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2047f108-c65c-4075-9915-8e7c8397d33e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 07:59:38.396705 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2047f108-c65c-4075-9915-8e7c8397d33e None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 07:59:38.397214 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2047f108-c65c-4075-9915-8e7c8397d33e None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 07:59:38.397708 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2047f108-c65c-4075-9915-8e7c8397d33e None admin] PATH_INFO: `/v3/domains` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 07:59:38.398653 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2047f108-c65c-4075-9915-8e7c8397d33e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 07:59:38.399168 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2047f108-c65c-4075-9915-8e7c8397d33e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 07:59:38.400889 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2047f108-c65c-4075-9915-8e7c8397d33e None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 07:59:38.414541 dv-cinder-851351-1-smb devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 355/677] 10.222.0.42 () {56 vars in 1109 bytes} [Thu Jul 28 07:59:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 07:59:38.420711 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2047f108-c65c-4075-9915-8e7c8397d33e None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 07:59:38.517540 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 07:59:38.531301 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2047f108-c65c-4075-9915-8e7c8397d33e None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 07:59:38.550894 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea9205d-1ff5-44cf-ad82-95bce739b8fe None admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 07:59:38.573273 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=100 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 07:59:38.589154 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f7caf3-3cf6-4bbc-8326-f80dfe4e4e57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 07:59:38.590145 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f7caf3-3cf6-4bbc-8326-f80dfe4e4e57 None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 07:59:38.590523 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f7caf3-3cf6-4bbc-8326-f80dfe4e4e57 None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 07:59:38.590888 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f7caf3-3cf6-4bbc-8326-f80dfe4e4e57 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 07:59:38.604622 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f7caf3-3cf6-4bbc-8326-f80dfe4e4e57 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 07:59:38.606397 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f7caf3-3cf6-4bbc-8326-f80dfe4e4e57 None admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 07:59:38.610173 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cada15c3-1088-41bc-aa9c-79062c66d603 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 07:59:38.610869 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cada15c3-1088-41bc-aa9c-79062c66d603 None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 07:59:38.611147 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cada15c3-1088-41bc-aa9c-79062c66d603 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 07:59:38.611417 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cada15c3-1088-41bc-aa9c-79062c66d603 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 07:59:38.620007 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cada15c3-1088-41bc-aa9c-79062c66d603 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 07:59:38.621523 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cada15c3-1088-41bc-aa9c-79062c66d603 None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 07:59:38.632278 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application [None req-c2f7caf3-3cf6-4bbc-8326-f80dfe4e4e57 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 07:59:38.632278 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 07:59:38.632278 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 07:59:38.632278 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 07:59:38.632278 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 07:59:38.632278 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 07:59:38.632278 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 07:59:38.632278 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 07:59:38.632278 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 07:59:38.632278 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 07:59:38.632278 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 07:59:38.632278 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 07:59:38.632278 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 07:59:38.632278 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 07:59:38.632278 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 07:59:38.633284 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 07:59:38.633284 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 07:59:38.633284 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 07:59:38.633284 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 07:59:38.633284 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 07:59:38.633284 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 07:59:38.633284 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 07:59:38.633284 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 07:59:38.633284 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application with Lock( Jul 28 07:59:38.633284 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 07:59:38.633284 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self._enter() Jul 28 07:59:38.633284 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 07:59:38.633284 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 07:59:38.633284 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 07:59:38.633284 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.creator() Jul 28 07:59:38.633284 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 07:59:38.633284 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application created_value = creator( Jul 28 07:59:38.634150 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 07:59:38.634150 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 07:59:38.634150 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 07:59:38.634150 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application Jul 28 07:59:38.634378 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application [None req-cada15c3-1088-41bc-aa9c-79062c66d603 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 07:59:38.634378 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 07:59:38.634378 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 07:59:38.634378 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 07:59:38.634378 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 07:59:38.634378 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 07:59:38.634378 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 07:59:38.634378 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 07:59:38.634378 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 07:59:38.634378 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 07:59:38.634378 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 07:59:38.634378 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 07:59:38.634378 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 28 07:59:38.634378 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 28 07:59:38.634378 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 28 07:59:38.635210 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 28 07:59:38.635210 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 07:59:38.635210 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 07:59:38.635210 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 07:59:38.635210 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 07:59:38.635210 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 07:59:38.635210 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 07:59:38.635210 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 07:59:38.635210 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application with Lock( Jul 28 07:59:38.635210 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 07:59:38.635210 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._enter() Jul 28 07:59:38.635210 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 07:59:38.635210 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 07:59:38.635210 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 07:59:38.635210 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.creator() Jul 28 07:59:38.635210 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 07:59:38.635210 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application created_value = creator( Jul 28 07:59:38.636167 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 28 07:59:38.636167 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 28 07:59:38.636167 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 28 07:59:38.636167 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 28 07:59:38.636167 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 28 07:59:38.636167 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 28 07:59:38.636167 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 07:59:38.636167 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application Jul 28 07:59:38.636587 dv-cinder-851351-1-smb devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 323/678] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 07:59:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 272 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 07:59:38.637623 dv-cinder-851351-1-smb devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 356/679] 10.222.0.42 () {56 vars in 1111 bytes} [Thu Jul 28 07:59:38 2022] GET /identity/v3/projects/service => generated 88 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 07:59:38.640931 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f7caf3-3cf6-4bbc-8326-f80dfe4e4e57 None admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 07:59:38.643240 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cada15c3-1088-41bc-aa9c-79062c66d603 None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 07:59:38.774802 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f7caf3-3cf6-4bbc-8326-f80dfe4e4e57 None admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 07:59:38.781725 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cada15c3-1088-41bc-aa9c-79062c66d603 None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 07:59:38.817880 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f458e334-49f0-4994-b197-e7a3ea7e617c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 07:59:38.818519 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f458e334-49f0-4994-b197-e7a3ea7e617c None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 07:59:38.818798 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f458e334-49f0-4994-b197-e7a3ea7e617c None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 07:59:38.819089 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f458e334-49f0-4994-b197-e7a3ea7e617c None admin] PATH_INFO: `/v3/domains` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 07:59:38.819794 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f458e334-49f0-4994-b197-e7a3ea7e617c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 07:59:38.820094 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f458e334-49f0-4994-b197-e7a3ea7e617c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 07:59:38.820490 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8957cabf-e9d7-46cc-8902-35088b5ff9e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 07:59:38.821370 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8957cabf-e9d7-46cc-8902-35088b5ff9e2 None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 07:59:38.821544 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f458e334-49f0-4994-b197-e7a3ea7e617c None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 07:59:38.822030 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8957cabf-e9d7-46cc-8902-35088b5ff9e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 07:59:38.822502 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8957cabf-e9d7-46cc-8902-35088b5ff9e2 None admin] PATH_INFO: `/v3/projects` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 07:59:38.823881 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8957cabf-e9d7-46cc-8902-35088b5ff9e2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80348) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 07:59:38.828513 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8957cabf-e9d7-46cc-8902-35088b5ff9e2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 07:59:38.831583 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8957cabf-e9d7-46cc-8902-35088b5ff9e2 None admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 07:59:38.835893 dv-cinder-851351-1-smb devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 357/680] 10.222.0.42 () {56 vars in 1109 bytes} [Thu Jul 28 07:59:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 07:59:38.837446 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6412b216-ffd7-4aac-91c9-31b52939eb0b None None] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 07:59:38.837730 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6412b216-ffd7-4aac-91c9-31b52939eb0b None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 07:59:38.838002 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6412b216-ffd7-4aac-91c9-31b52939eb0b None None] PATH_INFO: `/` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 07:59:38.843625 dv-cinder-851351-1-smb devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 358/681] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 07:59:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 07:59:38.844712 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6412b216-ffd7-4aac-91c9-31b52939eb0b None None] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 07:59:38.852985 dv-cinder-851351-1-smb devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 324/682] 10.222.0.42 () {56 vars in 1148 bytes} [Thu Jul 28 07:59:38 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 07:59:38.855041 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65a957f-6fb4-4efc-bb5f-73e9b7f8a239 None None] REQUEST_METHOD: `POST` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 07:59:38.855041 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65a957f-6fb4-4efc-bb5f-73e9b7f8a239 None None] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 07:59:38.855870 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65a957f-6fb4-4efc-bb5f-73e9b7f8a239 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 07:59:38.860597 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 07:59:38.881028 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.auth.core [None req-d65a957f-6fb4-4efc-bb5f-73e9b7f8a239 None None] MFA Rules not processed for user `f0666d3a50644a7097367331c1ee1a68`. Rule list: `[]` (Enabled: `True`). {{(pid=80348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 07:59:38.882662 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.fernet_utils [None req-d65a957f-6fb4-4efc-bb5f-73e9b7f8a239 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 07:59:38.918673 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=100 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 07:59:38.977199 dv-cinder-851351-1-smb devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 325/683] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 07:59:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 07:59:38.978945 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d65a957f-6fb4-4efc-bb5f-73e9b7f8a239 None None] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 07:59:39.034742 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6412b216-ffd7-4aac-91c9-31b52939eb0b None None] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 07:59:39.081170 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b09e354-c795-49fd-8edf-4e4a850f3ab0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 07:59:39.082308 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b09e354-c795-49fd-8edf-4e4a850f3ab0 None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 07:59:39.082807 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b09e354-c795-49fd-8edf-4e4a850f3ab0 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 07:59:39.083297 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b09e354-c795-49fd-8edf-4e4a850f3ab0 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 07:59:39.097778 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b09e354-c795-49fd-8edf-4e4a850f3ab0 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 07:59:39.100537 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b09e354-c795-49fd-8edf-4e4a850f3ab0 None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 07:59:39.120445 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d65a957f-6fb4-4efc-bb5f-73e9b7f8a239 None None] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 07:59:39.130031 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application [None req-8b09e354-c795-49fd-8edf-4e4a850f3ab0 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 28 07:59:39.130031 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 07:59:39.130031 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 07:59:39.130031 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 07:59:39.130031 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 07:59:39.130031 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 07:59:39.130031 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 07:59:39.130031 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 07:59:39.130031 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 07:59:39.130031 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 07:59:39.130031 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 07:59:39.130031 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 07:59:39.130031 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 28 07:59:39.130031 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 28 07:59:39.130031 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 28 07:59:39.130031 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 28 07:59:39.131010 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 07:59:39.131010 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 07:59:39.131010 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 28 07:59:39.131010 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 07:59:39.131010 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 28 07:59:39.131010 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 07:59:39.131010 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 07:59:39.131010 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 07:59:39.131010 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 07:59:39.131010 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 07:59:39.131010 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 07:59:39.131010 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application with Lock( Jul 28 07:59:39.131010 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 07:59:39.131010 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._enter() Jul 28 07:59:39.131010 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 07:59:39.131010 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 07:59:39.131010 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 07:59:39.131010 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.creator() Jul 28 07:59:39.131939 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 07:59:39.131939 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application created_value = creator( Jul 28 07:59:39.131939 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 28 07:59:39.131939 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 28 07:59:39.131939 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 28 07:59:39.131939 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 28 07:59:39.131939 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 28 07:59:39.131939 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 28 07:59:39.131939 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 28 07:59:39.131939 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application Jul 28 07:59:39.133001 dv-cinder-851351-1-smb devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 359/684] 10.222.0.42 () {56 vars in 1096 bytes} [Thu Jul 28 07:59:38 2022] GET /identity/v3/users/swift => generated 83 bytes in 288 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 07:59:39.134367 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b09e354-c795-49fd-8edf-4e4a850f3ab0 None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 07:59:39.176656 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8784e87-9937-44e0-8feb-6de313e940bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 07:59:39.177676 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8784e87-9937-44e0-8feb-6de313e940bc None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 07:59:39.178183 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8784e87-9937-44e0-8feb-6de313e940bc None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 07:59:39.178667 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8784e87-9937-44e0-8feb-6de313e940bc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 07:59:39.179780 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8784e87-9937-44e0-8feb-6de313e940bc None admin] RBAC: Adding query filter params (role.id=a2d02bc3295c4a33b1fc0775a17a79e6, scope.project.id=139349507026497c98f360774dee737e, user.id=0f1b1394d91540aaa0bb3f07c78fc812) {{(pid=80348) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 07:59:39.180379 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8784e87-9937-44e0-8feb-6de313e940bc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 07:59:39.182057 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8784e87-9937-44e0-8feb-6de313e940bc None admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 07:59:39.196988 dv-cinder-851351-1-smb devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 326/685] 10.222.0.42 () {56 vars in 1374 bytes} [Thu Jul 28 07:59:38 2022] GET /identity/v3/role_assignments?user.id=0f1b1394d91540aaa0bb3f07c78fc812&scope.project.id=139349507026497c98f360774dee737e&role.id=a2d02bc3295c4a33b1fc0775a17a79e6 => generated 608 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 07:59:39.198612 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8784e87-9937-44e0-8feb-6de313e940bc None admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 07:59:39.226769 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 07:59:39.252167 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=100 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 07:59:39.272269 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b09e354-c795-49fd-8edf-4e4a850f3ab0 None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 07:59:39.313632 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ee2ee8-c9ec-440b-910f-b9282194d965 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 07:59:39.314282 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ee2ee8-c9ec-440b-910f-b9282194d965 None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 07:59:39.314557 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ee2ee8-c9ec-440b-910f-b9282194d965 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 07:59:39.314869 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ee2ee8-c9ec-440b-910f-b9282194d965 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 07:59:39.329469 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6ee2ee8-c9ec-440b-910f-b9282194d965 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 07:59:39.331495 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6ee2ee8-c9ec-440b-910f-b9282194d965 None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 07:59:39.348736 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application [None req-f6ee2ee8-c9ec-440b-910f-b9282194d965 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 07:59:39.348736 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 07:59:39.348736 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 07:59:39.348736 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 07:59:39.348736 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 07:59:39.348736 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 07:59:39.348736 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 07:59:39.348736 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 07:59:39.348736 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 07:59:39.348736 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 07:59:39.348736 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 07:59:39.348736 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 07:59:39.348736 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 07:59:39.348736 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 07:59:39.348736 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 07:59:39.349702 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 07:59:39.349702 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 07:59:39.349702 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 07:59:39.349702 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 07:59:39.349702 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 07:59:39.349702 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 07:59:39.349702 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 07:59:39.349702 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 07:59:39.349702 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application with Lock( Jul 28 07:59:39.349702 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 07:59:39.349702 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._enter() Jul 28 07:59:39.349702 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 07:59:39.349702 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 07:59:39.349702 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 07:59:39.349702 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.creator() Jul 28 07:59:39.349702 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 07:59:39.349702 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application created_value = creator( Jul 28 07:59:39.350580 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 07:59:39.350580 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 07:59:39.350580 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 07:59:39.350580 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application Jul 28 07:59:39.356096 dv-cinder-851351-1-smb devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 360/686] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 07:59:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 07:59:39.357678 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ee2ee8-c9ec-440b-910f-b9282194d965 None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 07:59:39.443011 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8784e87-9937-44e0-8feb-6de313e940bc None admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 07:59:39.480280 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ee2ee8-c9ec-440b-910f-b9282194d965 None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 07:59:39.495910 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe1a7ef-3397-4c6b-9fb9-f04ef9b48949 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 07:59:39.497091 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe1a7ef-3397-4c6b-9fb9-f04ef9b48949 None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 07:59:39.497576 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe1a7ef-3397-4c6b-9fb9-f04ef9b48949 None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 07:59:39.498096 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe1a7ef-3397-4c6b-9fb9-f04ef9b48949 None admin] PATH_INFO: `/v3/users` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 07:59:39.499235 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebe1a7ef-3397-4c6b-9fb9-f04ef9b48949 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80348) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 07:59:39.499743 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebe1a7ef-3397-4c6b-9fb9-f04ef9b48949 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 07:59:39.501341 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 07:59:39.502533 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebe1a7ef-3397-4c6b-9fb9-f04ef9b48949 None admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 07:59:39.523384 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a35fdcd-17d2-42c3-a912-a43201d6a7ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 07:59:39.523766 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a35fdcd-17d2-42c3-a912-a43201d6a7ec None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 07:59:39.524043 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a35fdcd-17d2-42c3-a912-a43201d6a7ec None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 07:59:39.524443 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a35fdcd-17d2-42c3-a912-a43201d6a7ec None admin] PATH_INFO: `/v3/domains` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 07:59:39.525204 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a35fdcd-17d2-42c3-a912-a43201d6a7ec None admin] RBAC: Adding query filter params (name=Default) {{(pid=80347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 07:59:39.525507 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a35fdcd-17d2-42c3-a912-a43201d6a7ec None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 07:59:39.526927 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a35fdcd-17d2-42c3-a912-a43201d6a7ec None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 07:59:39.527598 dv-cinder-851351-1-smb devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 327/687] 10.222.0.42 () {56 vars in 1135 bytes} [Thu Jul 28 07:59:39 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 330 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 07:59:39.533055 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe1a7ef-3397-4c6b-9fb9-f04ef9b48949 None admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 07:59:39.544749 dv-cinder-851351-1-smb devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 361/688] 10.222.0.42 () {56 vars in 1109 bytes} [Thu Jul 28 07:59:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 07:59:39.548328 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a35fdcd-17d2-42c3-a912-a43201d6a7ec None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 07:59:39.647109 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=100 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 07:59:39.667354 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe1a7ef-3397-4c6b-9fb9-f04ef9b48949 None admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 07:59:39.679738 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a35fdcd-17d2-42c3-a912-a43201d6a7ec None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 07:59:39.708915 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfbb6555-9805-4567-ae45-ac70953f3686 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 07:59:39.709654 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbb6555-9805-4567-ae45-ac70953f3686 None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 07:59:39.710077 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbb6555-9805-4567-ae45-ac70953f3686 None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 07:59:39.710420 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbb6555-9805-4567-ae45-ac70953f3686 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 07:59:39.726731 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e518d9-e8d4-4719-be17-3139a03a9b70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 07:59:39.727609 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e518d9-e8d4-4719-be17-3139a03a9b70 None admin] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 07:59:39.727958 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e518d9-e8d4-4719-be17-3139a03a9b70 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 07:59:39.728351 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e518d9-e8d4-4719-be17-3139a03a9b70 None admin] PATH_INFO: `/v3/users` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 07:59:39.729150 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16e518d9-e8d4-4719-be17-3139a03a9b70 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 07:59:39.730717 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16e518d9-e8d4-4719-be17-3139a03a9b70 None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 07:59:39.785369 dv-cinder-851351-1-smb devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 362/689] 10.222.0.42 () {60 vars in 1132 bytes} [Thu Jul 28 07:59:39 2022] POST /identity/v3/users => generated 254 bytes in 237 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 07:59:39.808782 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfbb6555-9805-4567-ae45-ac70953f3686 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 07:59:39.810353 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfbb6555-9805-4567-ae45-ac70953f3686 None admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 07:59:39.933882 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=100 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 07:59:39.956615 dv-cinder-851351-1-smb devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 328/690] 10.222.0.42 () {58 vars in 1282 bytes} [Thu Jul 28 07:59:39 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 424 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 28 07:59:39.962429 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e518d9-e8d4-4719-be17-3139a03a9b70 None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 07:59:39.997258 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c08982-80fa-4210-be61-3c1749ae4c27 None None] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 07:59:39.997778 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c08982-80fa-4210-be61-3c1749ae4c27 None None] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 07:59:39.997778 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c08982-80fa-4210-be61-3c1749ae4c27 None None] PATH_INFO: `/` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 07:59:39.999545 dv-cinder-851351-1-smb devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 329/691] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 07:59:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 07:59:40.005146 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e3da53-eb96-4179-9bce-c046e2643178 None None] REQUEST_METHOD: `POST` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 07:59:40.005441 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e3da53-eb96-4179-9bce-c046e2643178 None None] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 07:59:40.005702 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e3da53-eb96-4179-9bce-c046e2643178 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 07:59:40.007009 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 07:59:40.041418 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.auth.core [None req-45e3da53-eb96-4179-9bce-c046e2643178 None None] MFA Rules not processed for user `f0666d3a50644a7097367331c1ee1a68`. Rule list: `[]` (Enabled: `True`). {{(pid=80348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 07:59:40.042719 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.fernet_utils [None req-45e3da53-eb96-4179-9bce-c046e2643178 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 07:59:40.083897 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e518d9-e8d4-4719-be17-3139a03a9b70 None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 07:59:40.123362 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef862f6-af13-448d-aa7a-da77e32b45db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 07:59:40.124296 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef862f6-af13-448d-aa7a-da77e32b45db None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 07:59:40.124781 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef862f6-af13-448d-aa7a-da77e32b45db None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 07:59:40.125212 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef862f6-af13-448d-aa7a-da77e32b45db None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 07:59:40.140629 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ef862f6-af13-448d-aa7a-da77e32b45db None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 07:59:40.142583 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ef862f6-af13-448d-aa7a-da77e32b45db None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 07:59:40.149830 dv-cinder-851351-1-smb devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 330/692] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 07:59:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 28 07:59:40.172614 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application [None req-3ef862f6-af13-448d-aa7a-da77e32b45db None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 07:59:40.172614 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 07:59:40.172614 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 07:59:40.172614 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 07:59:40.172614 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 07:59:40.172614 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 07:59:40.172614 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 07:59:40.172614 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 07:59:40.172614 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 07:59:40.172614 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 07:59:40.172614 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 07:59:40.172614 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 07:59:40.172614 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 07:59:40.172614 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 07:59:40.172614 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 07:59:40.173785 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 07:59:40.173785 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 07:59:40.173785 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 07:59:40.173785 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 07:59:40.173785 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 07:59:40.173785 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 07:59:40.173785 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 07:59:40.173785 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 07:59:40.173785 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application with Lock( Jul 28 07:59:40.173785 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 07:59:40.173785 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._enter() Jul 28 07:59:40.173785 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 07:59:40.173785 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 07:59:40.173785 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 07:59:40.173785 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.creator() Jul 28 07:59:40.173785 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 07:59:40.173785 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application created_value = creator( Jul 28 07:59:40.174935 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 07:59:40.174935 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 07:59:40.174935 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 07:59:40.174935 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application Jul 28 07:59:40.176691 dv-cinder-851351-1-smb devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 363/693] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 07:59:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 07:59:40.177178 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e3da53-eb96-4179-9bce-c046e2643178 None None] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 07:59:40.186167 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef862f6-af13-448d-aa7a-da77e32b45db None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 07:59:40.305716 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e3da53-eb96-4179-9bce-c046e2643178 None None] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 07:59:40.305959 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef862f6-af13-448d-aa7a-da77e32b45db None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 07:59:40.309041 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 07:59:40.322917 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=100 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 07:59:40.348884 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3d9818-71e5-4035-8c3c-e96a9f62b8bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 07:59:40.349519 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3d9818-71e5-4035-8c3c-e96a9f62b8bf None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 07:59:40.349800 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3d9818-71e5-4035-8c3c-e96a9f62b8bf None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 07:59:40.350047 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3d9818-71e5-4035-8c3c-e96a9f62b8bf None admin] PATH_INFO: `/v3/domains` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 07:59:40.350742 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb3d9818-71e5-4035-8c3c-e96a9f62b8bf None admin] RBAC: Adding query filter params (name=Default) {{(pid=80347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 07:59:40.351037 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb3d9818-71e5-4035-8c3c-e96a9f62b8bf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 07:59:40.352477 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb3d9818-71e5-4035-8c3c-e96a9f62b8bf None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 07:59:40.366143 dv-cinder-851351-1-smb devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 364/694] 10.222.0.42 () {56 vars in 1109 bytes} [Thu Jul 28 07:59:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 07:59:40.367956 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9685c48-2c4c-4473-980b-1e499ca0d3e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 07:59:40.368648 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9685c48-2c4c-4473-980b-1e499ca0d3e9 None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 07:59:40.368963 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9685c48-2c4c-4473-980b-1e499ca0d3e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 07:59:40.369233 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9685c48-2c4c-4473-980b-1e499ca0d3e9 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 07:59:40.369950 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9685c48-2c4c-4473-980b-1e499ca0d3e9 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 07:59:40.371446 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9685c48-2c4c-4473-980b-1e499ca0d3e9 None admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 07:59:40.373612 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3d9818-71e5-4035-8c3c-e96a9f62b8bf None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 07:59:40.394839 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application [None req-f9685c48-2c4c-4473-980b-1e499ca0d3e9 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 28 07:59:40.394839 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 07:59:40.394839 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 28 07:59:40.394839 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 28 07:59:40.394839 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 28 07:59:40.394839 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 28 07:59:40.394839 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 28 07:59:40.394839 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 07:59:40.394839 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 28 07:59:40.394839 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application Jul 28 07:59:40.394839 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 28 07:59:40.394839 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application Jul 28 07:59:40.394839 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 07:59:40.394839 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 07:59:40.394839 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 07:59:40.394839 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 07:59:40.395879 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 07:59:40.395879 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 07:59:40.395879 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 07:59:40.395879 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 07:59:40.395879 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 07:59:40.395879 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 07:59:40.395879 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 07:59:40.395879 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 28 07:59:40.395879 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 28 07:59:40.395879 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 28 07:59:40.395879 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 28 07:59:40.395879 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 07:59:40.395879 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 07:59:40.395879 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 07:59:40.395879 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 07:59:40.395879 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 07:59:40.396725 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 07:59:40.396725 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 07:59:40.396725 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application with Lock( Jul 28 07:59:40.396725 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 07:59:40.396725 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self._enter() Jul 28 07:59:40.396725 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 07:59:40.396725 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 07:59:40.396725 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 07:59:40.396725 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.creator() Jul 28 07:59:40.396725 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 07:59:40.396725 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application created_value = creator( Jul 28 07:59:40.396725 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 28 07:59:40.396725 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 07:59:40.396725 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 28 07:59:40.396725 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application Jul 28 07:59:40.396725 dv-cinder-851351-1-smb devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 331/695] 10.222.0.42 () {56 vars in 1129 bytes} [Thu Jul 28 07:59:40 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 07:59:40.405953 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9685c48-2c4c-4473-980b-1e499ca0d3e9 None admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 07:59:40.483735 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3d9818-71e5-4035-8c3c-e96a9f62b8bf None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 07:59:40.520011 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e667b78e-15d7-47e0-a560-e0029131a0f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 07:59:40.521055 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e667b78e-15d7-47e0-a560-e0029131a0f9 None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 07:59:40.521555 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e667b78e-15d7-47e0-a560-e0029131a0f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 07:59:40.522087 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e667b78e-15d7-47e0-a560-e0029131a0f9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 07:59:40.529727 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e667b78e-15d7-47e0-a560-e0029131a0f9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 07:59:40.531572 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e667b78e-15d7-47e0-a560-e0029131a0f9 None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 07:59:40.543945 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application [None req-e667b78e-15d7-47e0-a560-e0029131a0f9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 07:59:40.543945 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 07:59:40.543945 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 07:59:40.543945 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 07:59:40.543945 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 07:59:40.543945 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 07:59:40.543945 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 07:59:40.543945 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 07:59:40.543945 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 07:59:40.543945 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 07:59:40.543945 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 07:59:40.543945 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 07:59:40.543945 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 28 07:59:40.543945 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 28 07:59:40.543945 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 28 07:59:40.545152 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 28 07:59:40.545152 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 07:59:40.545152 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 07:59:40.545152 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 07:59:40.545152 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 07:59:40.545152 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 07:59:40.545152 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 07:59:40.545152 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 07:59:40.545152 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application with Lock( Jul 28 07:59:40.545152 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 07:59:40.545152 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._enter() Jul 28 07:59:40.545152 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 07:59:40.545152 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 07:59:40.545152 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 07:59:40.545152 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.creator() Jul 28 07:59:40.545152 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 07:59:40.545152 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application created_value = creator( Jul 28 07:59:40.546032 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 28 07:59:40.546032 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 28 07:59:40.546032 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 28 07:59:40.546032 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 28 07:59:40.546032 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 28 07:59:40.546032 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 28 07:59:40.546032 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 07:59:40.546032 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application Jul 28 07:59:40.548431 dv-cinder-851351-1-smb devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 365/696] 10.222.0.42 () {56 vars in 1111 bytes} [Thu Jul 28 07:59:40 2022] GET /identity/v3/projects/service => generated 88 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 07:59:40.564177 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e667b78e-15d7-47e0-a560-e0029131a0f9 None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 07:59:40.584078 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 07:59:40.601112 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9685c48-2c4c-4473-980b-1e499ca0d3e9 None admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 07:59:40.671324 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4bf867-1583-410d-9dea-5e7f42b4f2af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 07:59:40.672015 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4bf867-1583-410d-9dea-5e7f42b4f2af None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 07:59:40.672298 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4bf867-1583-410d-9dea-5e7f42b4f2af None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 07:59:40.672686 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4bf867-1583-410d-9dea-5e7f42b4f2af None admin] PATH_INFO: `/v3/services` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 07:59:40.673991 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c4bf867-1583-410d-9dea-5e7f42b4f2af None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80348) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 07:59:40.674727 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c4bf867-1583-410d-9dea-5e7f42b4f2af None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 07:59:40.677524 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c4bf867-1583-410d-9dea-5e7f42b4f2af None admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 07:59:40.690643 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e667b78e-15d7-47e0-a560-e0029131a0f9 None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 07:59:40.695528 dv-cinder-851351-1-smb devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 332/697] 10.222.0.42 () {56 vars in 1124 bytes} [Thu Jul 28 07:59:40 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 290 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 07:59:40.701625 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4bf867-1583-410d-9dea-5e7f42b4f2af None admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 07:59:40.743689 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a298341-2a64-4a7a-befb-d3c1e8d3958b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 07:59:40.745474 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a298341-2a64-4a7a-befb-d3c1e8d3958b None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 07:59:40.745758 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a298341-2a64-4a7a-befb-d3c1e8d3958b None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 07:59:40.746034 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a298341-2a64-4a7a-befb-d3c1e8d3958b None admin] PATH_INFO: `/v3/projects` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 07:59:40.746818 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a298341-2a64-4a7a-befb-d3c1e8d3958b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 07:59:40.747125 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a298341-2a64-4a7a-befb-d3c1e8d3958b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 07:59:40.748607 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a298341-2a64-4a7a-befb-d3c1e8d3958b None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 07:59:40.771049 dv-cinder-851351-1-smb devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 366/698] 10.222.0.42 () {56 vars in 1148 bytes} [Thu Jul 28 07:59:40 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 07:59:40.777068 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a298341-2a64-4a7a-befb-d3c1e8d3958b None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 07:59:40.797324 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=100 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 07:59:40.887315 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4bf867-1583-410d-9dea-5e7f42b4f2af None admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 07:59:40.889822 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 07:59:40.928407 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19faea6d-ac84-4948-8608-9c987770535a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 07:59:40.929098 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19faea6d-ac84-4948-8608-9c987770535a None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 07:59:40.929380 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19faea6d-ac84-4948-8608-9c987770535a None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 07:59:40.929656 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19faea6d-ac84-4948-8608-9c987770535a None admin] PATH_INFO: `/v3/services` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 07:59:40.930361 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19faea6d-ac84-4948-8608-9c987770535a None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80348) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 07:59:40.930667 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19faea6d-ac84-4948-8608-9c987770535a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 07:59:40.931626 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a298341-2a64-4a7a-befb-d3c1e8d3958b None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 07:59:40.932089 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19faea6d-ac84-4948-8608-9c987770535a None admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 07:59:40.940059 dv-cinder-851351-1-smb devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 333/699] 10.222.0.42 () {56 vars in 1124 bytes} [Thu Jul 28 07:59:40 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 07:59:40.942115 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397c3e02-2abe-4d08-a786-097b3b0bf808 None None] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 07:59:40.942403 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397c3e02-2abe-4d08-a786-097b3b0bf808 None None] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 07:59:40.942683 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397c3e02-2abe-4d08-a786-097b3b0bf808 None None] PATH_INFO: `/` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 07:59:40.948801 dv-cinder-851351-1-smb devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 334/700] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 07:59:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 07:59:40.958270 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c3371d-197d-41d9-aa75-d96229ebe5c6 None None] REQUEST_METHOD: `POST` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 07:59:40.959055 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c3371d-197d-41d9-aa75-d96229ebe5c6 None None] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 07:59:40.959595 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c3371d-197d-41d9-aa75-d96229ebe5c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 07:59:40.984289 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86591da9-1cfb-4d85-bc3f-610dad67ad33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 07:59:40.984977 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86591da9-1cfb-4d85-bc3f-610dad67ad33 None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 07:59:40.985258 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86591da9-1cfb-4d85-bc3f-610dad67ad33 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 07:59:40.985535 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86591da9-1cfb-4d85-bc3f-610dad67ad33 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 07:59:40.986435 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86591da9-1cfb-4d85-bc3f-610dad67ad33 None admin] RBAC: Adding query filter params (role.id=a2d02bc3295c4a33b1fc0775a17a79e6, scope.project.id=139349507026497c98f360774dee737e, user.id=fe8c81659f704e14b8f0e00856a5a9a5) {{(pid=80347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 07:59:40.986747 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86591da9-1cfb-4d85-bc3f-610dad67ad33 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 07:59:40.988433 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86591da9-1cfb-4d85-bc3f-610dad67ad33 None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 07:59:40.996526 dv-cinder-851351-1-smb devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 367/701] 10.222.0.42 () {56 vars in 1374 bytes} [Thu Jul 28 07:59:40 2022] GET /identity/v3/role_assignments?user.id=fe8c81659f704e14b8f0e00856a5a9a5&scope.project.id=139349507026497c98f360774dee737e&role.id=a2d02bc3295c4a33b1fc0775a17a79e6 => generated 608 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 07:59:41.002884 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.auth.core [None req-f1c3371d-197d-41d9-aa75-d96229ebe5c6 None None] MFA Rules not processed for user `f0666d3a50644a7097367331c1ee1a68`. Rule list: `[]` (Enabled: `True`). {{(pid=80348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 07:59:41.005074 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.fernet_utils [None req-f1c3371d-197d-41d9-aa75-d96229ebe5c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 07:59:41.105613 dv-cinder-851351-1-smb devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 335/702] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 07:59:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 07:59:41.130850 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86591da9-1cfb-4d85-bc3f-610dad67ad33 None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 07:59:41.267212 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86591da9-1cfb-4d85-bc3f-610dad67ad33 None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 07:59:41.300757 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 07:59:41.309208 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a359df51-5835-4816-9f63-eef326c45401 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 07:59:41.309860 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a359df51-5835-4816-9f63-eef326c45401 None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 07:59:41.310140 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a359df51-5835-4816-9f63-eef326c45401 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 07:59:41.310411 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a359df51-5835-4816-9f63-eef326c45401 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 07:59:41.322290 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a359df51-5835-4816-9f63-eef326c45401 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 07:59:41.327961 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application [None req-a359df51-5835-4816-9f63-eef326c45401 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 07:59:41.327961 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 07:59:41.327961 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 07:59:41.327961 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 07:59:41.327961 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 07:59:41.327961 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 07:59:41.327961 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 07:59:41.327961 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 07:59:41.327961 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 07:59:41.327961 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 07:59:41.327961 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 07:59:41.327961 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 07:59:41.327961 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 07:59:41.327961 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 07:59:41.327961 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 07:59:41.327961 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 07:59:41.328956 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 07:59:41.328956 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 07:59:41.328956 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 07:59:41.328956 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 07:59:41.328956 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 07:59:41.328956 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 07:59:41.328956 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 07:59:41.328956 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 07:59:41.328956 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 07:59:41.328956 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 07:59:41.328956 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 07:59:41.328956 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application with Lock( Jul 28 07:59:41.328956 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 07:59:41.328956 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._enter() Jul 28 07:59:41.328956 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 07:59:41.328956 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 07:59:41.330169 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 07:59:41.330169 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.creator() Jul 28 07:59:41.330169 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 07:59:41.330169 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application created_value = creator( Jul 28 07:59:41.330169 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 07:59:41.330169 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 07:59:41.330169 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 07:59:41.330169 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 07:59:41.330169 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 07:59:41.330169 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 07:59:41.330169 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 07:59:41.330169 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application Jul 28 07:59:41.330169 dv-cinder-851351-1-smb devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 368/703] 10.222.0.42 () {56 vars in 1096 bytes} [Thu Jul 28 07:59:41 2022] GET /identity/v3/roles/admin => generated 83 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 07:59:41.336013 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c3371d-197d-41d9-aa75-d96229ebe5c6 None None] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 07:59:41.375659 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=100 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 07:59:41.446868 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c3371d-197d-41d9-aa75-d96229ebe5c6 None None] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 07:59:41.486182 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c378b7d-7ff5-47b3-a0e7-ec1f75ecc24e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 07:59:41.486837 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c378b7d-7ff5-47b3-a0e7-ec1f75ecc24e None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 07:59:41.487211 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c378b7d-7ff5-47b3-a0e7-ec1f75ecc24e None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 07:59:41.487498 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c378b7d-7ff5-47b3-a0e7-ec1f75ecc24e None admin] PATH_INFO: `/v3/roles` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 07:59:41.488233 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c378b7d-7ff5-47b3-a0e7-ec1f75ecc24e None admin] RBAC: Adding query filter params (name=admin) {{(pid=80348) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 07:59:41.488538 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c378b7d-7ff5-47b3-a0e7-ec1f75ecc24e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 07:59:41.490075 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c378b7d-7ff5-47b3-a0e7-ec1f75ecc24e None admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 07:59:41.500264 dv-cinder-851351-1-smb devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 336/704] 10.222.0.42 () {56 vars in 1099 bytes} [Thu Jul 28 07:59:41 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 07:59:41.506210 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a359df51-5835-4816-9f63-eef326c45401 None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 07:59:41.624777 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a359df51-5835-4816-9f63-eef326c45401 None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 07:59:41.661659 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40258128-96f3-4675-b279-91dd04546fc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 07:59:41.662324 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40258128-96f3-4675-b279-91dd04546fc7 None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 07:59:41.662593 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40258128-96f3-4675-b279-91dd04546fc7 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 07:59:41.662872 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40258128-96f3-4675-b279-91dd04546fc7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 07:59:41.675233 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40258128-96f3-4675-b279-91dd04546fc7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 07:59:41.676893 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40258128-96f3-4675-b279-91dd04546fc7 None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 07:59:41.695361 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application [None req-40258128-96f3-4675-b279-91dd04546fc7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 07:59:41.695361 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 07:59:41.695361 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 07:59:41.695361 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 07:59:41.695361 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 07:59:41.695361 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 07:59:41.695361 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 07:59:41.695361 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 07:59:41.695361 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 07:59:41.695361 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 07:59:41.695361 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 07:59:41.695361 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 07:59:41.695361 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 07:59:41.695361 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 07:59:41.695361 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 07:59:41.696311 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 07:59:41.696311 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 07:59:41.696311 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 07:59:41.696311 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 07:59:41.696311 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 07:59:41.696311 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 07:59:41.696311 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 07:59:41.696311 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 07:59:41.696311 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application with Lock( Jul 28 07:59:41.696311 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 07:59:41.696311 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._enter() Jul 28 07:59:41.696311 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 07:59:41.696311 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 07:59:41.696311 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 07:59:41.696311 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.creator() Jul 28 07:59:41.696311 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 07:59:41.696311 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application created_value = creator( Jul 28 07:59:41.697219 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 07:59:41.697219 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 07:59:41.697219 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 07:59:41.697219 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application Jul 28 07:59:41.697219 dv-cinder-851351-1-smb devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 369/705] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 07:59:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 07:59:41.702846 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c378b7d-7ff5-47b3-a0e7-ec1f75ecc24e None admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 07:59:41.819206 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f403cdbe-2053-4fa3-a61f-1994dd3ceae6 None None] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 07:59:41.819554 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f403cdbe-2053-4fa3-a61f-1994dd3ceae6 None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 07:59:41.819762 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f403cdbe-2053-4fa3-a61f-1994dd3ceae6 None None] PATH_INFO: `/` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 07:59:41.822573 dv-cinder-851351-1-smb devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 370/706] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 07:59:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 07:59:41.827057 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe3a534-3fea-4d9c-9ec4-50524a08380d None None] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 07:59:41.827339 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe3a534-3fea-4d9c-9ec4-50524a08380d None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 07:59:41.827613 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe3a534-3fea-4d9c-9ec4-50524a08380d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 07:59:41.853437 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.auth.core [None req-9fe3a534-3fea-4d9c-9ec4-50524a08380d None None] MFA Rules not processed for user `f0666d3a50644a7097367331c1ee1a68`. Rule list: `[]` (Enabled: `True`). {{(pid=80347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 07:59:41.854695 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-9fe3a534-3fea-4d9c-9ec4-50524a08380d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 07:59:41.856235 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=100 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 07:59:41.859717 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c378b7d-7ff5-47b3-a0e7-ec1f75ecc24e None admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 07:59:41.917921 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 07:59:41.923439 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84edb35c-2b85-48f0-952a-161543ef7022 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 07:59:41.924092 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84edb35c-2b85-48f0-952a-161543ef7022 None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 07:59:41.924401 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84edb35c-2b85-48f0-952a-161543ef7022 None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 07:59:41.924689 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84edb35c-2b85-48f0-952a-161543ef7022 None admin] PATH_INFO: `/v3/domains` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 07:59:41.925406 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84edb35c-2b85-48f0-952a-161543ef7022 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80348) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 07:59:41.925709 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84edb35c-2b85-48f0-952a-161543ef7022 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 07:59:41.927121 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84edb35c-2b85-48f0-952a-161543ef7022 None admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 07:59:41.949116 dv-cinder-851351-1-smb devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 337/707] 10.222.0.42 () {56 vars in 1109 bytes} [Thu Jul 28 07:59:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 07:59:41.954777 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84edb35c-2b85-48f0-952a-161543ef7022 None admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 07:59:41.976783 dv-cinder-851351-1-smb devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 371/708] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 07:59:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 28 07:59:41.995159 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe3a534-3fea-4d9c-9ec4-50524a08380d None None] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 07:59:42.100648 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84edb35c-2b85-48f0-952a-161543ef7022 None admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 07:59:42.182866 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dffe4bc-fb73-48fb-96d1-3ce370db1fee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 07:59:42.183472 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dffe4bc-fb73-48fb-96d1-3ce370db1fee None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 07:59:42.183753 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dffe4bc-fb73-48fb-96d1-3ce370db1fee None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 07:59:42.184024 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dffe4bc-fb73-48fb-96d1-3ce370db1fee None admin] PATH_INFO: `/v3/users/nova` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 07:59:42.198761 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dffe4bc-fb73-48fb-96d1-3ce370db1fee None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 07:59:42.200259 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dffe4bc-fb73-48fb-96d1-3ce370db1fee None admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 07:59:42.204955 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe3a534-3fea-4d9c-9ec4-50524a08380d None None] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 07:59:42.225615 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application [None req-2dffe4bc-fb73-48fb-96d1-3ce370db1fee None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 28 07:59:42.225615 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 07:59:42.225615 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 07:59:42.225615 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 07:59:42.225615 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 07:59:42.225615 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 07:59:42.225615 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 07:59:42.225615 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 07:59:42.225615 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 07:59:42.225615 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 07:59:42.225615 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 07:59:42.225615 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 07:59:42.225615 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 28 07:59:42.225615 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 28 07:59:42.225615 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 28 07:59:42.225615 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 28 07:59:42.226638 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 07:59:42.226638 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 07:59:42.226638 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 28 07:59:42.226638 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 07:59:42.226638 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 28 07:59:42.226638 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 07:59:42.226638 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 07:59:42.226638 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 07:59:42.226638 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 07:59:42.226638 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 07:59:42.226638 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 07:59:42.226638 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application with Lock( Jul 28 07:59:42.226638 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 07:59:42.226638 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self._enter() Jul 28 07:59:42.226638 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 07:59:42.226638 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 07:59:42.226638 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 07:59:42.226638 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.creator() Jul 28 07:59:42.227605 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 07:59:42.227605 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application created_value = creator( Jul 28 07:59:42.227605 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 28 07:59:42.227605 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 28 07:59:42.227605 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 28 07:59:42.227605 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 28 07:59:42.227605 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 28 07:59:42.227605 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 28 07:59:42.227605 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 28 07:59:42.227605 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application Jul 28 07:59:42.227605 dv-cinder-851351-1-smb devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 338/709] 10.222.0.42 () {56 vars in 1093 bytes} [Thu Jul 28 07:59:41 2022] GET /identity/v3/users/nova => generated 82 bytes in 273 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 07:59:42.233140 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dffe4bc-fb73-48fb-96d1-3ce370db1fee None admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 07:59:42.259713 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=100 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 07:59:42.262319 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796dcfa4-045f-42fd-86e5-ae36d19920dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 07:59:42.263157 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796dcfa4-045f-42fd-86e5-ae36d19920dc None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 07:59:42.263599 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796dcfa4-045f-42fd-86e5-ae36d19920dc None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 07:59:42.264005 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796dcfa4-045f-42fd-86e5-ae36d19920dc None admin] PATH_INFO: `/v3/services/network` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 07:59:42.264853 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-796dcfa4-045f-42fd-86e5-ae36d19920dc None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 07:59:42.266374 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-796dcfa4-045f-42fd-86e5-ae36d19920dc None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 07:59:42.277800 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application [None req-796dcfa4-045f-42fd-86e5-ae36d19920dc None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jul 28 07:59:42.277800 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 07:59:42.277800 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 28 07:59:42.277800 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 28 07:59:42.277800 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 28 07:59:42.277800 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 28 07:59:42.277800 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 28 07:59:42.277800 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 07:59:42.277800 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 28 07:59:42.277800 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application Jul 28 07:59:42.277800 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 28 07:59:42.277800 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application Jul 28 07:59:42.277800 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 07:59:42.277800 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 07:59:42.277800 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 07:59:42.277800 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 07:59:42.277800 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 07:59:42.278853 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 07:59:42.278853 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 07:59:42.278853 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 07:59:42.278853 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 07:59:42.278853 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 07:59:42.278853 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 07:59:42.278853 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 28 07:59:42.278853 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 28 07:59:42.278853 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 28 07:59:42.278853 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 28 07:59:42.278853 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 07:59:42.278853 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 07:59:42.278853 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 07:59:42.278853 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 07:59:42.278853 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 07:59:42.278853 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 07:59:42.279673 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 07:59:42.279673 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application with Lock( Jul 28 07:59:42.279673 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 07:59:42.279673 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._enter() Jul 28 07:59:42.279673 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 07:59:42.279673 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 07:59:42.279673 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 07:59:42.279673 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.creator() Jul 28 07:59:42.279673 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 07:59:42.279673 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application created_value = creator( Jul 28 07:59:42.279673 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 28 07:59:42.279673 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 07:59:42.279673 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 28 07:59:42.279673 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application Jul 28 07:59:42.282391 dv-cinder-851351-1-smb devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 372/710] 10.222.0.42 () {56 vars in 1111 bytes} [Thu Jul 28 07:59:41 2022] GET /identity/v3/services/network => generated 88 bytes in 288 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 07:59:42.289696 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796dcfa4-045f-42fd-86e5-ae36d19920dc None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 07:59:42.352850 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 07:59:42.379146 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dffe4bc-fb73-48fb-96d1-3ce370db1fee None admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 07:59:42.450353 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796dcfa4-045f-42fd-86e5-ae36d19920dc None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 07:59:42.489187 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-644fe951-01a1-4cc9-a11e-5c0bc5d60ba0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 07:59:42.489407 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5cc5b90-f37e-433f-a002-d539fd5e3e49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 07:59:42.489813 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644fe951-01a1-4cc9-a11e-5c0bc5d60ba0 None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 07:59:42.490091 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644fe951-01a1-4cc9-a11e-5c0bc5d60ba0 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 07:59:42.490364 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644fe951-01a1-4cc9-a11e-5c0bc5d60ba0 None admin] PATH_INFO: `/v3/services` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 07:59:42.490931 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5cc5b90-f37e-433f-a002-d539fd5e3e49 None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 07:59:42.491116 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-644fe951-01a1-4cc9-a11e-5c0bc5d60ba0 None admin] RBAC: Adding query filter params (name=network) {{(pid=80347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 07:59:42.491375 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-644fe951-01a1-4cc9-a11e-5c0bc5d60ba0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 07:59:42.491767 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5cc5b90-f37e-433f-a002-d539fd5e3e49 None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 07:59:42.492219 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5cc5b90-f37e-433f-a002-d539fd5e3e49 None admin] PATH_INFO: `/v3/users` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 07:59:42.492887 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-644fe951-01a1-4cc9-a11e-5c0bc5d60ba0 None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 07:59:42.493443 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5cc5b90-f37e-433f-a002-d539fd5e3e49 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80348) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 07:59:42.493953 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5cc5b90-f37e-433f-a002-d539fd5e3e49 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 07:59:42.495652 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5cc5b90-f37e-433f-a002-d539fd5e3e49 None admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 07:59:42.502386 dv-cinder-851351-1-smb devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 373/711] 10.222.0.42 () {56 vars in 1112 bytes} [Thu Jul 28 07:59:42 2022] GET /identity/v3/services?name=network => generated 124 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 07:59:42.503771 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-644fe951-01a1-4cc9-a11e-5c0bc5d60ba0 None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 07:59:42.547067 dv-cinder-851351-1-smb devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 339/712] 10.222.0.42 () {56 vars in 1133 bytes} [Thu Jul 28 07:59:42 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 314 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 07:59:42.552680 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5cc5b90-f37e-433f-a002-d539fd5e3e49 None admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 07:59:42.615558 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-644fe951-01a1-4cc9-a11e-5c0bc5d60ba0 None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 07:59:42.633112 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 07:59:42.660092 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-868bb259-109f-41b9-b243-2e9eb0899a17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 07:59:42.660825 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868bb259-109f-41b9-b243-2e9eb0899a17 None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 07:59:42.661106 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868bb259-109f-41b9-b243-2e9eb0899a17 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 07:59:42.661555 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868bb259-109f-41b9-b243-2e9eb0899a17 None admin] PATH_INFO: `/v3/services` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 07:59:42.662397 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-868bb259-109f-41b9-b243-2e9eb0899a17 None admin] RBAC: Adding query filter params (type=network) {{(pid=80347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 07:59:42.662704 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-868bb259-109f-41b9-b243-2e9eb0899a17 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 07:59:42.664131 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-868bb259-109f-41b9-b243-2e9eb0899a17 None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 07:59:42.670721 dv-cinder-851351-1-smb devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 374/713] 10.222.0.42 () {56 vars in 1112 bytes} [Thu Jul 28 07:59:42 2022] GET /identity/v3/services?type=network => generated 124 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 07:59:42.692057 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=100 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 07:59:42.722548 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5cc5b90-f37e-433f-a002-d539fd5e3e49 None admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 07:59:42.786219 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c4ce36-a125-4e62-b40f-604589b49f7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 07:59:42.786850 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c4ce36-a125-4e62-b40f-604589b49f7e None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 07:59:42.787160 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c4ce36-a125-4e62-b40f-604589b49f7e None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 07:59:42.787431 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c4ce36-a125-4e62-b40f-604589b49f7e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 07:59:42.797129 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f57298-5b18-471d-aa1f-dd8af5cef420 None None] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 07:59:42.798218 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f57298-5b18-471d-aa1f-dd8af5cef420 None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 07:59:42.799000 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f57298-5b18-471d-aa1f-dd8af5cef420 None None] PATH_INFO: `/` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 07:59:42.802575 dv-cinder-851351-1-smb devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 375/714] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 07:59:42 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 07:59:42.811607 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0719917a-0a8c-43c8-9b43-8d8d92d44a36 None None] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 07:59:42.812243 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0719917a-0a8c-43c8-9b43-8d8d92d44a36 None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 07:59:42.812779 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0719917a-0a8c-43c8-9b43-8d8d92d44a36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 07:59:42.835457 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.auth.core [None req-0719917a-0a8c-43c8-9b43-8d8d92d44a36 None None] MFA Rules not processed for user `f0666d3a50644a7097367331c1ee1a68`. Rule list: `[]` (Enabled: `True`). {{(pid=80347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 07:59:42.837133 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-0719917a-0a8c-43c8-9b43-8d8d92d44a36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 07:59:42.871311 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c4ce36-a125-4e62-b40f-604589b49f7e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 07:59:42.872849 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c4ce36-a125-4e62-b40f-604589b49f7e None admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 07:59:43.022724 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=100 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 07:59:43.053375 dv-cinder-851351-1-smb devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 340/715] 10.222.0.42 () {58 vars in 1282 bytes} [Thu Jul 28 07:59:42 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 501 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 28 07:59:43.059040 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c4ce36-a125-4e62-b40f-604589b49f7e None admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 07:59:43.068376 dv-cinder-851351-1-smb devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 376/716] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 07:59:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 258 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 07:59:43.094116 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0719917a-0a8c-43c8-9b43-8d8d92d44a36 None None] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 07:59:43.222264 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 07:59:43.223990 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c4ce36-a125-4e62-b40f-604589b49f7e None admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 07:59:43.231217 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0719917a-0a8c-43c8-9b43-8d8d92d44a36 None None] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 07:59:43.273762 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ca7f83-6b54-4f5a-a536-49b0533d0e62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 07:59:43.274327 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ca7f83-6b54-4f5a-a536-49b0533d0e62 None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 07:59:43.274602 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ca7f83-6b54-4f5a-a536-49b0533d0e62 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 07:59:43.274882 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ca7f83-6b54-4f5a-a536-49b0533d0e62 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 07:59:43.287583 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82ca7f83-6b54-4f5a-a536-49b0533d0e62 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 07:59:43.293651 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application [None req-82ca7f83-6b54-4f5a-a536-49b0533d0e62 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 28 07:59:43.293651 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 07:59:43.293651 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 07:59:43.293651 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 07:59:43.293651 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 07:59:43.293651 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 07:59:43.293651 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 07:59:43.293651 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 07:59:43.293651 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 07:59:43.293651 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 07:59:43.293651 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 07:59:43.293651 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 07:59:43.293651 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 07:59:43.293651 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 07:59:43.293651 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 07:59:43.293651 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 07:59:43.294637 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 07:59:43.294637 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 07:59:43.294637 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 07:59:43.294637 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 07:59:43.294637 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 07:59:43.294637 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 07:59:43.294637 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 07:59:43.294637 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 07:59:43.294637 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 07:59:43.294637 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 07:59:43.294637 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 07:59:43.294637 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application with Lock( Jul 28 07:59:43.294637 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 07:59:43.294637 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._enter() Jul 28 07:59:43.294637 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 07:59:43.294637 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 07:59:43.295487 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 07:59:43.295487 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.creator() Jul 28 07:59:43.295487 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 07:59:43.295487 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application created_value = creator( Jul 28 07:59:43.295487 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 07:59:43.295487 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 07:59:43.295487 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 07:59:43.295487 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 07:59:43.295487 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 07:59:43.295487 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 07:59:43.295487 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 28 07:59:43.295487 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application Jul 28 07:59:43.296118 dv-cinder-851351-1-smb devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 377/717] 10.222.0.42 () {56 vars in 1102 bytes} [Thu Jul 28 07:59:43 2022] GET /identity/v3/roles/service => generated 85 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 07:59:43.301788 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ca7f83-6b54-4f5a-a536-49b0533d0e62 None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 07:59:43.349449 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdcc5f54-3f4e-4d47-80d2-0002a5671d5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 07:59:43.350128 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdcc5f54-3f4e-4d47-80d2-0002a5671d5c None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 07:59:43.350407 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdcc5f54-3f4e-4d47-80d2-0002a5671d5c None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 07:59:43.350682 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdcc5f54-3f4e-4d47-80d2-0002a5671d5c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 07:59:43.376617 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdcc5f54-3f4e-4d47-80d2-0002a5671d5c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 07:59:43.378243 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdcc5f54-3f4e-4d47-80d2-0002a5671d5c None admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 07:59:43.408495 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application [None req-cdcc5f54-3f4e-4d47-80d2-0002a5671d5c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 07:59:43.408495 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 07:59:43.408495 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 07:59:43.408495 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 07:59:43.408495 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 07:59:43.408495 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 07:59:43.408495 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 07:59:43.408495 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 07:59:43.408495 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 07:59:43.408495 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 07:59:43.408495 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 07:59:43.408495 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 07:59:43.408495 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 07:59:43.408495 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 07:59:43.408495 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 07:59:43.409687 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 07:59:43.409687 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 07:59:43.409687 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 07:59:43.409687 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 07:59:43.409687 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 07:59:43.409687 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 07:59:43.409687 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 07:59:43.409687 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 07:59:43.409687 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application with Lock( Jul 28 07:59:43.409687 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 07:59:43.409687 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self._enter() Jul 28 07:59:43.409687 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 07:59:43.409687 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 07:59:43.409687 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 07:59:43.409687 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.creator() Jul 28 07:59:43.409687 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 07:59:43.409687 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application created_value = creator( Jul 28 07:59:43.410726 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 07:59:43.410726 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 07:59:43.410726 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 07:59:43.410726 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application Jul 28 07:59:43.417079 dv-cinder-851351-1-smb devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 341/718] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 07:59:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 359 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 07:59:43.417356 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ca7f83-6b54-4f5a-a536-49b0533d0e62 None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 07:59:43.418030 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdcc5f54-3f4e-4d47-80d2-0002a5671d5c None admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 07:59:43.457063 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=100 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 07:59:43.481433 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed2d76f-255a-4744-946d-4b6ec1d1fb82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 07:59:43.482416 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed2d76f-255a-4744-946d-4b6ec1d1fb82 None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 07:59:43.482964 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed2d76f-255a-4744-946d-4b6ec1d1fb82 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 07:59:43.483438 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed2d76f-255a-4744-946d-4b6ec1d1fb82 None admin] PATH_INFO: `/v3/roles` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 07:59:43.484309 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bed2d76f-255a-4744-946d-4b6ec1d1fb82 None admin] RBAC: Adding query filter params (name=service) {{(pid=80347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 07:59:43.484908 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bed2d76f-255a-4744-946d-4b6ec1d1fb82 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 07:59:43.486578 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bed2d76f-255a-4744-946d-4b6ec1d1fb82 None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 07:59:43.503397 dv-cinder-851351-1-smb devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 378/719] 10.222.0.42 () {56 vars in 1103 bytes} [Thu Jul 28 07:59:43 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 07:59:43.509319 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed2d76f-255a-4744-946d-4b6ec1d1fb82 None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 07:59:43.525260 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdcc5f54-3f4e-4d47-80d2-0002a5671d5c None admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 07:59:43.541088 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 07:59:43.560877 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8daeb063-6e8e-40bf-b3bc-497b3cf0a4d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 07:59:43.561516 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8daeb063-6e8e-40bf-b3bc-497b3cf0a4d5 None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 07:59:43.561794 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8daeb063-6e8e-40bf-b3bc-497b3cf0a4d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 07:59:43.562063 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8daeb063-6e8e-40bf-b3bc-497b3cf0a4d5 None admin] PATH_INFO: `/v3/domains` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 07:59:43.562883 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8daeb063-6e8e-40bf-b3bc-497b3cf0a4d5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80348) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 07:59:43.563097 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8daeb063-6e8e-40bf-b3bc-497b3cf0a4d5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 07:59:43.564506 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8daeb063-6e8e-40bf-b3bc-497b3cf0a4d5 None admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 07:59:43.584454 dv-cinder-851351-1-smb devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 342/720] 10.222.0.42 () {56 vars in 1109 bytes} [Thu Jul 28 07:59:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 07:59:43.585814 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8daeb063-6e8e-40bf-b3bc-497b3cf0a4d5 None admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 07:59:43.675876 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=100 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 07:59:43.688986 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8daeb063-6e8e-40bf-b3bc-497b3cf0a4d5 None admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 07:59:43.710795 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed2d76f-255a-4744-946d-4b6ec1d1fb82 None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 07:59:43.724533 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc74b355-3975-48c8-8ab9-eda98b52fb8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 07:59:43.725230 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc74b355-3975-48c8-8ab9-eda98b52fb8c None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 07:59:43.725511 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc74b355-3975-48c8-8ab9-eda98b52fb8c None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 07:59:43.725784 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc74b355-3975-48c8-8ab9-eda98b52fb8c None admin] PATH_INFO: `/v3/projects/service` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 07:59:43.733296 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc74b355-3975-48c8-8ab9-eda98b52fb8c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 07:59:43.734764 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc74b355-3975-48c8-8ab9-eda98b52fb8c None admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 07:59:43.746782 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application [None req-fc74b355-3975-48c8-8ab9-eda98b52fb8c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 07:59:43.746782 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 07:59:43.746782 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 07:59:43.746782 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 07:59:43.746782 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 07:59:43.746782 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 07:59:43.746782 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 07:59:43.746782 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 07:59:43.746782 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 07:59:43.746782 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 07:59:43.746782 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 07:59:43.746782 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 07:59:43.746782 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 28 07:59:43.746782 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 28 07:59:43.746782 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 28 07:59:43.747864 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 28 07:59:43.747864 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 07:59:43.747864 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 07:59:43.747864 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 07:59:43.747864 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 07:59:43.747864 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 07:59:43.747864 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 07:59:43.747864 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 07:59:43.747864 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application with Lock( Jul 28 07:59:43.747864 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 07:59:43.747864 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self._enter() Jul 28 07:59:43.747864 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 07:59:43.747864 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 07:59:43.747864 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 07:59:43.747864 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.creator() Jul 28 07:59:43.747864 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 07:59:43.747864 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application created_value = creator( Jul 28 07:59:43.748917 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 28 07:59:43.748917 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 28 07:59:43.748917 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 28 07:59:43.748917 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 28 07:59:43.748917 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 28 07:59:43.748917 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 28 07:59:43.748917 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 07:59:43.748917 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application Jul 28 07:59:43.752726 dv-cinder-851351-1-smb devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 343/721] 10.222.0.42 () {56 vars in 1111 bytes} [Thu Jul 28 07:59:43 2022] GET /identity/v3/projects/service => generated 88 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 07:59:43.753258 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d97317-b6e9-4b1c-adb4-5ad983d3a604 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 07:59:43.754075 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d97317-b6e9-4b1c-adb4-5ad983d3a604 None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 07:59:43.754189 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9ccf80-b8f5-4e52-a681-d0e4d6cca976 None None] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 07:59:43.754362 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9ccf80-b8f5-4e52-a681-d0e4d6cca976 None None] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 07:59:43.754635 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9ccf80-b8f5-4e52-a681-d0e4d6cca976 None None] PATH_INFO: `/` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 07:59:43.754896 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d97317-b6e9-4b1c-adb4-5ad983d3a604 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 07:59:43.755331 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d97317-b6e9-4b1c-adb4-5ad983d3a604 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 07:59:43.759978 dv-cinder-851351-1-smb devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 344/722] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 07:59:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 07:59:43.759978 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c9ccf80-b8f5-4e52-a681-d0e4d6cca976 None None] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 07:59:43.772111 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0d97317-b6e9-4b1c-adb4-5ad983d3a604 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 07:59:43.774387 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0d97317-b6e9-4b1c-adb4-5ad983d3a604 None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 07:59:43.795463 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application [None req-a0d97317-b6e9-4b1c-adb4-5ad983d3a604 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 07:59:43.795463 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 07:59:43.795463 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 07:59:43.795463 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 07:59:43.795463 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 07:59:43.795463 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 07:59:43.795463 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 07:59:43.795463 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 07:59:43.795463 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 07:59:43.795463 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 07:59:43.795463 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 07:59:43.795463 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 07:59:43.795463 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 07:59:43.795463 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 07:59:43.795463 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 07:59:43.796539 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 07:59:43.796539 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 07:59:43.796539 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 07:59:43.796539 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 07:59:43.796539 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 07:59:43.796539 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 07:59:43.796539 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 07:59:43.796539 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 07:59:43.796539 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application with Lock( Jul 28 07:59:43.796539 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 07:59:43.796539 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._enter() Jul 28 07:59:43.796539 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 07:59:43.796539 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 07:59:43.796539 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 07:59:43.796539 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.creator() Jul 28 07:59:43.796539 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 07:59:43.796539 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application created_value = creator( Jul 28 07:59:43.797642 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 07:59:43.797642 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 07:59:43.797642 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 07:59:43.797642 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application Jul 28 07:59:43.805591 dv-cinder-851351-1-smb devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 379/723] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 07:59:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 292 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 07:59:43.807166 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34578dc-3d23-425b-b73a-3f3ab5f3e291 None None] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 07:59:43.808073 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34578dc-3d23-425b-b73a-3f3ab5f3e291 None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 07:59:43.808488 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34578dc-3d23-425b-b73a-3f3ab5f3e291 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 07:59:43.833423 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.auth.core [None req-c34578dc-3d23-425b-b73a-3f3ab5f3e291 None None] MFA Rules not processed for user `f0666d3a50644a7097367331c1ee1a68`. Rule list: `[]` (Enabled: `True`). {{(pid=80347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 07:59:43.835694 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-c34578dc-3d23-425b-b73a-3f3ab5f3e291 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 07:59:43.874688 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c9ccf80-b8f5-4e52-a681-d0e4d6cca976 None None] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 07:59:43.911362 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9080b73-47b1-49f9-8d1c-c3e7bf52a7e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 07:59:43.912190 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9080b73-47b1-49f9-8d1c-c3e7bf52a7e4 None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 07:59:43.912572 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9080b73-47b1-49f9-8d1c-c3e7bf52a7e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 07:59:43.913028 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9080b73-47b1-49f9-8d1c-c3e7bf52a7e4 None admin] PATH_INFO: `/v3/projects` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 07:59:43.914080 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9080b73-47b1-49f9-8d1c-c3e7bf52a7e4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80348) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 07:59:43.914322 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9080b73-47b1-49f9-8d1c-c3e7bf52a7e4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 07:59:43.916002 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9080b73-47b1-49f9-8d1c-c3e7bf52a7e4 None admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 07:59:43.924736 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 07:59:43.936809 dv-cinder-851351-1-smb devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 380/725] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 07:59:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 07:59:43.936809 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34578dc-3d23-425b-b73a-3f3ab5f3e291 None None] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 07:59:43.937110 dv-cinder-851351-1-smb devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 345/725] 10.222.0.42 () {56 vars in 1148 bytes} [Thu Jul 28 07:59:43 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 07:59:43.938704 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9080b73-47b1-49f9-8d1c-c3e7bf52a7e4 None admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 07:59:43.957079 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=100 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 07:59:44.056016 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9080b73-47b1-49f9-8d1c-c3e7bf52a7e4 None admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 07:59:44.060958 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34578dc-3d23-425b-b73a-3f3ab5f3e291 None None] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 07:59:44.093344 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2eaa4e2-9680-4b93-a343-d9c85d70a092 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 07:59:44.093975 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2eaa4e2-9680-4b93-a343-d9c85d70a092 None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 07:59:44.094460 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2eaa4e2-9680-4b93-a343-d9c85d70a092 None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 07:59:44.094572 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2eaa4e2-9680-4b93-a343-d9c85d70a092 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 07:59:44.095290 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2eaa4e2-9680-4b93-a343-d9c85d70a092 None admin] RBAC: Adding query filter params (role.id=362bd71ac01249fb8fa635381993eec1, scope.project.id=139349507026497c98f360774dee737e, user.id=02f10880691d4fd180f96f3e40e1d25f) {{(pid=80348) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 07:59:44.095598 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2eaa4e2-9680-4b93-a343-d9c85d70a092 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 07:59:44.097058 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2eaa4e2-9680-4b93-a343-d9c85d70a092 None admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 07:59:44.100118 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e36365-f0a8-4600-b402-6518f6ffc5c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 07:59:44.104781 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e36365-f0a8-4600-b402-6518f6ffc5c9 None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 07:59:44.104781 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e36365-f0a8-4600-b402-6518f6ffc5c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 07:59:44.104781 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e36365-f0a8-4600-b402-6518f6ffc5c9 None admin] PATH_INFO: `/v3/domains` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 07:59:44.104781 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6e36365-f0a8-4600-b402-6518f6ffc5c9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 07:59:44.104781 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6e36365-f0a8-4600-b402-6518f6ffc5c9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 07:59:44.105202 dv-cinder-851351-1-smb devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 346/726] 10.222.0.42 () {56 vars in 1374 bytes} [Thu Jul 28 07:59:43 2022] GET /identity/v3/role_assignments?user.id=02f10880691d4fd180f96f3e40e1d25f&scope.project.id=139349507026497c98f360774dee737e&role.id=362bd71ac01249fb8fa635381993eec1 => generated 259 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 07:59:44.105287 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6e36365-f0a8-4600-b402-6518f6ffc5c9 None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 07:59:44.105368 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2eaa4e2-9680-4b93-a343-d9c85d70a092 None admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 07:59:44.123300 dv-cinder-851351-1-smb devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 381/727] 10.222.0.42 () {56 vars in 1109 bytes} [Thu Jul 28 07:59:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 07:59:44.125157 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae564f3-501a-43e0-ab98-10c0237f7dc8 None None] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 07:59:44.125833 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae564f3-501a-43e0-ab98-10c0237f7dc8 None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 07:59:44.126344 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae564f3-501a-43e0-ab98-10c0237f7dc8 None None] PATH_INFO: `/` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 07:59:44.128870 dv-cinder-851351-1-smb devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 382/728] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 07:59:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 07:59:44.130088 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae564f3-501a-43e0-ab98-10c0237f7dc8 None None] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 07:59:44.209532 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=100 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 07:59:44.226793 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 07:59:44.248901 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2eaa4e2-9680-4b93-a343-d9c85d70a092 None admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 07:59:44.284544 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae564f3-501a-43e0-ab98-10c0237f7dc8 None None] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 07:59:44.301888 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f15e20-4be8-4a6e-9a6c-d882768d820d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 07:59:44.302613 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f15e20-4be8-4a6e-9a6c-d882768d820d None admin] REQUEST_METHOD: `POST` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 07:59:44.302907 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f15e20-4be8-4a6e-9a6c-d882768d820d None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 07:59:44.303178 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f15e20-4be8-4a6e-9a6c-d882768d820d None admin] PATH_INFO: `/v3/services` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 07:59:44.303991 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53f15e20-4be8-4a6e-9a6c-d882768d820d None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 07:59:44.305827 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53f15e20-4be8-4a6e-9a6c-d882768d820d None admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 07:59:44.328188 dv-cinder-851351-1-smb devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 347/729] 10.222.0.42 () {60 vars in 1141 bytes} [Thu Jul 28 07:59:44 2022] POST /identity/v3/services => generated 251 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 07:59:44.329827 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1746de0a-f32d-4acd-8b45-0820ea691bdb None None] REQUEST_METHOD: `POST` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 07:59:44.330108 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1746de0a-f32d-4acd-8b45-0820ea691bdb None None] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 07:59:44.330380 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1746de0a-f32d-4acd-8b45-0820ea691bdb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 07:59:44.368112 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0ee23d-9e40-46be-89f9-cf6c079c34a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 07:59:44.368961 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0ee23d-9e40-46be-89f9-cf6c079c34a2 None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 07:59:44.369241 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0ee23d-9e40-46be-89f9-cf6c079c34a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 07:59:44.369509 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0ee23d-9e40-46be-89f9-cf6c079c34a2 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 07:59:44.370000 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.auth.core [None req-1746de0a-f32d-4acd-8b45-0820ea691bdb None None] MFA Rules not processed for user `f0666d3a50644a7097367331c1ee1a68`. Rule list: `[]` (Enabled: `True`). {{(pid=80348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 07:59:44.371640 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.fernet_utils [None req-1746de0a-f32d-4acd-8b45-0820ea691bdb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 07:59:44.378789 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e0ee23d-9e40-46be-89f9-cf6c079c34a2 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 07:59:44.381367 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e0ee23d-9e40-46be-89f9-cf6c079c34a2 None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 07:59:44.414014 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application [None req-6e0ee23d-9e40-46be-89f9-cf6c079c34a2 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 28 07:59:44.414014 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 07:59:44.414014 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 07:59:44.414014 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 07:59:44.414014 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 07:59:44.414014 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 07:59:44.414014 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 07:59:44.414014 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 07:59:44.414014 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 07:59:44.414014 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 07:59:44.414014 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 07:59:44.414014 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 07:59:44.414014 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 28 07:59:44.414014 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 28 07:59:44.414014 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 28 07:59:44.414014 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 28 07:59:44.415035 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 07:59:44.415035 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 07:59:44.415035 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 28 07:59:44.415035 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 07:59:44.415035 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 28 07:59:44.415035 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 07:59:44.415035 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 07:59:44.415035 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 07:59:44.415035 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 07:59:44.415035 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 07:59:44.415035 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 07:59:44.415035 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application with Lock( Jul 28 07:59:44.415035 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 07:59:44.415035 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._enter() Jul 28 07:59:44.415035 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 07:59:44.415035 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 07:59:44.415035 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 07:59:44.415035 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.creator() Jul 28 07:59:44.416014 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 07:59:44.416014 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application created_value = creator( Jul 28 07:59:44.416014 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 28 07:59:44.416014 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 28 07:59:44.416014 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 28 07:59:44.416014 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 28 07:59:44.416014 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 28 07:59:44.416014 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 28 07:59:44.416014 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 28 07:59:44.416014 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application Jul 28 07:59:44.420079 dv-cinder-851351-1-smb devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 383/730] 10.222.0.42 () {56 vars in 1117 bytes} [Thu Jul 28 07:59:44 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 290 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 07:59:44.424652 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0ee23d-9e40-46be-89f9-cf6c079c34a2 None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 07:59:44.535291 dv-cinder-851351-1-smb devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 348/731] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 07:59:44 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 07:59:44.558209 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1746de0a-f32d-4acd-8b45-0820ea691bdb None None] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 07:59:44.636386 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 07:59:44.647380 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0ee23d-9e40-46be-89f9-cf6c079c34a2 None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 07:59:44.665032 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 07:59:44.684148 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1746de0a-f32d-4acd-8b45-0820ea691bdb None None] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 07:59:44.688977 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f8003a-c08c-4a98-89b8-8835020def16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 07:59:44.689725 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f8003a-c08c-4a98-89b8-8835020def16 None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 07:59:44.690071 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f8003a-c08c-4a98-89b8-8835020def16 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 07:59:44.690438 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f8003a-c08c-4a98-89b8-8835020def16 None admin] PATH_INFO: `/v3/users` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 07:59:44.691357 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f8003a-c08c-4a98-89b8-8835020def16 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 07:59:44.691745 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f8003a-c08c-4a98-89b8-8835020def16 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 07:59:44.693566 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f8003a-c08c-4a98-89b8-8835020def16 None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 07:59:44.716344 dv-cinder-851351-1-smb devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 384/732] 10.222.0.42 () {56 vars in 1149 bytes} [Thu Jul 28 07:59:44 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 292 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 07:59:44.722563 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f8003a-c08c-4a98-89b8-8835020def16 None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 07:59:44.837488 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f8003a-c08c-4a98-89b8-8835020def16 None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 07:59:44.847062 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e17db4-6197-441c-91c4-ecd1a1ec97da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 07:59:44.847725 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e17db4-6197-441c-91c4-ecd1a1ec97da None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 07:59:44.848001 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e17db4-6197-441c-91c4-ecd1a1ec97da None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 07:59:44.848269 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e17db4-6197-441c-91c4-ecd1a1ec97da None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 07:59:44.860688 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e17db4-6197-441c-91c4-ecd1a1ec97da None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 07:59:44.866059 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application [None req-11e17db4-6197-441c-91c4-ecd1a1ec97da None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 07:59:44.866059 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 07:59:44.866059 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 07:59:44.866059 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 07:59:44.866059 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 07:59:44.866059 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 07:59:44.866059 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 07:59:44.866059 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 07:59:44.866059 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 07:59:44.866059 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 07:59:44.866059 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 07:59:44.866059 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 07:59:44.866059 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 07:59:44.866059 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 07:59:44.866059 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 07:59:44.866059 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 07:59:44.867139 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 07:59:44.867139 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 07:59:44.867139 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 07:59:44.867139 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 07:59:44.867139 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 07:59:44.867139 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 07:59:44.867139 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 07:59:44.867139 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 07:59:44.867139 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 07:59:44.867139 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 07:59:44.867139 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 07:59:44.867139 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application with Lock( Jul 28 07:59:44.867139 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 07:59:44.867139 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self._enter() Jul 28 07:59:44.867139 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 07:59:44.867139 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 07:59:44.867991 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 07:59:44.867991 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.creator() Jul 28 07:59:44.867991 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 07:59:44.867991 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application created_value = creator( Jul 28 07:59:44.867991 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 07:59:44.867991 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 07:59:44.867991 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 07:59:44.867991 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 07:59:44.867991 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 07:59:44.867991 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 07:59:44.867991 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 07:59:44.867991 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application Jul 28 07:59:44.872396 dv-cinder-851351-1-smb devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 349/733] 10.222.0.42 () {56 vars in 1096 bytes} [Thu Jul 28 07:59:44 2022] GET /identity/v3/roles/admin => generated 83 bytes in 310 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 07:59:44.873785 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e17db4-6197-441c-91c4-ecd1a1ec97da None admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 07:59:44.910691 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-587cd3eb-6cd9-4ecb-902d-e669e55253aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 07:59:44.911318 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587cd3eb-6cd9-4ecb-902d-e669e55253aa None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 07:59:44.911601 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587cd3eb-6cd9-4ecb-902d-e669e55253aa None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 07:59:44.911873 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587cd3eb-6cd9-4ecb-902d-e669e55253aa None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 07:59:44.986916 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e17db4-6197-441c-91c4-ecd1a1ec97da None admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 07:59:45.008463 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 07:59:45.011875 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=100 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 07:59:45.032165 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0196fa03-dd9f-44ba-951b-fc5aee6a87fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 07:59:45.032919 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0196fa03-dd9f-44ba-951b-fc5aee6a87fe None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 07:59:45.033264 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0196fa03-dd9f-44ba-951b-fc5aee6a87fe None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 07:59:45.033602 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0196fa03-dd9f-44ba-951b-fc5aee6a87fe None admin] PATH_INFO: `/v3/roles` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 07:59:45.034413 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0196fa03-dd9f-44ba-951b-fc5aee6a87fe None admin] RBAC: Adding query filter params (name=admin) {{(pid=80348) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 07:59:45.034785 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0196fa03-dd9f-44ba-951b-fc5aee6a87fe None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 07:59:45.036243 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0196fa03-dd9f-44ba-951b-fc5aee6a87fe None admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 07:59:45.048804 dv-cinder-851351-1-smb devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 350/734] 10.222.0.42 () {56 vars in 1099 bytes} [Thu Jul 28 07:59:44 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 07:59:45.051534 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0196fa03-dd9f-44ba-951b-fc5aee6a87fe None admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 07:59:45.073893 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-587cd3eb-6cd9-4ecb-902d-e669e55253aa None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 07:59:45.075665 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-587cd3eb-6cd9-4ecb-902d-e669e55253aa None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 07:59:45.154186 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0196fa03-dd9f-44ba-951b-fc5aee6a87fe None admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 07:59:45.193132 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02655a0b-cc92-4365-a097-55b9fd07ea89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 07:59:45.193909 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02655a0b-cc92-4365-a097-55b9fd07ea89 None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 07:59:45.194252 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02655a0b-cc92-4365-a097-55b9fd07ea89 None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 07:59:45.194591 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02655a0b-cc92-4365-a097-55b9fd07ea89 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 07:59:45.208262 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02655a0b-cc92-4365-a097-55b9fd07ea89 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 07:59:45.210678 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02655a0b-cc92-4365-a097-55b9fd07ea89 None admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 07:59:45.227613 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application [None req-02655a0b-cc92-4365-a097-55b9fd07ea89 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 07:59:45.227613 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 07:59:45.227613 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 07:59:45.227613 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 07:59:45.227613 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 07:59:45.227613 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 07:59:45.227613 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 07:59:45.227613 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 07:59:45.227613 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 07:59:45.227613 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 07:59:45.227613 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 07:59:45.227613 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 07:59:45.227613 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 07:59:45.227613 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 07:59:45.227613 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 07:59:45.229578 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 07:59:45.229578 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 07:59:45.229578 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 07:59:45.229578 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 07:59:45.229578 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 07:59:45.229578 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 07:59:45.229578 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 07:59:45.229578 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 07:59:45.229578 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application with Lock( Jul 28 07:59:45.229578 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 07:59:45.229578 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self._enter() Jul 28 07:59:45.229578 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 07:59:45.229578 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 07:59:45.229578 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 07:59:45.229578 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.creator() Jul 28 07:59:45.229578 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 07:59:45.229578 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application created_value = creator( Jul 28 07:59:45.231560 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 07:59:45.231560 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 07:59:45.231560 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 07:59:45.231560 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application Jul 28 07:59:45.236696 dv-cinder-851351-1-smb devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 351/735] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 07:59:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 07:59:45.236696 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a607a5-b706-46d0-9bac-1f32ecc9d3c3 None None] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 07:59:45.236696 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a607a5-b706-46d0-9bac-1f32ecc9d3c3 None None] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 07:59:45.236696 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a607a5-b706-46d0-9bac-1f32ecc9d3c3 None None] PATH_INFO: `/` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 07:59:45.241491 dv-cinder-851351-1-smb devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 352/736] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 07:59:45 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 07:59:45.242392 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a607a5-b706-46d0-9bac-1f32ecc9d3c3 None None] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 07:59:45.271648 dv-cinder-851351-1-smb devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 385/737] 10.222.0.42 () {58 vars in 1282 bytes} [Thu Jul 28 07:59:44 2022] GET /identity/v3/auth/tokens => generated 903 bytes in 550 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 28 07:59:45.277840 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a106d116-dfbd-4b29-b62d-49649adb5a6d None None] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 07:59:45.278299 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a106d116-dfbd-4b29-b62d-49649adb5a6d None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 07:59:45.278734 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a106d116-dfbd-4b29-b62d-49649adb5a6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 07:59:45.280955 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=100 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 07:59:45.301907 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.auth.core [None req-a106d116-dfbd-4b29-b62d-49649adb5a6d None None] MFA Rules not processed for user `f0666d3a50644a7097367331c1ee1a68`. Rule list: `[]` (Enabled: `True`). {{(pid=80347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 07:59:45.303214 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-a106d116-dfbd-4b29-b62d-49649adb5a6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 07:59:45.358082 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a607a5-b706-46d0-9bac-1f32ecc9d3c3 None None] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 07:59:45.394902 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e464d389-4637-462d-af1f-b87b1837c216 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 07:59:45.395904 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e464d389-4637-462d-af1f-b87b1837c216 None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 07:59:45.396378 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e464d389-4637-462d-af1f-b87b1837c216 None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 07:59:45.396778 dv-cinder-851351-1-smb devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 386/738] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 07:59:45 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 07:59:45.397092 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e464d389-4637-462d-af1f-b87b1837c216 None admin] PATH_INFO: `/v3/domains` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 07:59:45.397777 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a106d116-dfbd-4b29-b62d-49649adb5a6d None None] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 07:59:45.398206 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e464d389-4637-462d-af1f-b87b1837c216 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80348) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 07:59:45.398698 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e464d389-4637-462d-af1f-b87b1837c216 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 07:59:45.400356 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 07:59:45.401545 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e464d389-4637-462d-af1f-b87b1837c216 None admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 07:59:45.427266 dv-cinder-851351-1-smb devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 353/739] 10.222.0.42 () {56 vars in 1109 bytes} [Thu Jul 28 07:59:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 07:59:45.428438 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e464d389-4637-462d-af1f-b87b1837c216 None admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 07:59:45.530809 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=100 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 07:59:45.539114 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e464d389-4637-462d-af1f-b87b1837c216 None admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 07:59:45.544799 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a106d116-dfbd-4b29-b62d-49649adb5a6d None None] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 07:59:45.582196 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc3fdf9-a0b3-42e2-aa21-238d5ef693f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 07:59:45.582919 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc3fdf9-a0b3-42e2-aa21-238d5ef693f9 None admin] REQUEST_METHOD: `POST` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 07:59:45.583202 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc3fdf9-a0b3-42e2-aa21-238d5ef693f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 07:59:45.583475 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc3fdf9-a0b3-42e2-aa21-238d5ef693f9 None admin] PATH_INFO: `/v3/services` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 07:59:45.584281 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cc3fdf9-a0b3-42e2-aa21-238d5ef693f9 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 07:59:45.585712 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cc3fdf9-a0b3-42e2-aa21-238d5ef693f9 None admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 07:59:45.594178 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0ad3c4-7cd0-4e9f-8201-79f887ea4cb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 07:59:45.595016 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0ad3c4-7cd0-4e9f-8201-79f887ea4cb1 None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 07:59:45.595309 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0ad3c4-7cd0-4e9f-8201-79f887ea4cb1 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 07:59:45.595643 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0ad3c4-7cd0-4e9f-8201-79f887ea4cb1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 07:59:45.604726 dv-cinder-851351-1-smb devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 354/740] 10.222.0.42 () {60 vars in 1141 bytes} [Thu Jul 28 07:59:45 2022] POST /identity/v3/services => generated 240 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 07:59:45.605994 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc3fdf9-a0b3-42e2-aa21-238d5ef693f9 None admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 07:59:45.615779 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab0ad3c4-7cd0-4e9f-8201-79f887ea4cb1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 07:59:45.617281 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab0ad3c4-7cd0-4e9f-8201-79f887ea4cb1 None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 07:59:45.644923 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application [None req-ab0ad3c4-7cd0-4e9f-8201-79f887ea4cb1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 07:59:45.644923 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 07:59:45.644923 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 07:59:45.644923 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 07:59:45.644923 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 07:59:45.644923 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 07:59:45.644923 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 07:59:45.644923 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 07:59:45.644923 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 07:59:45.644923 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 07:59:45.644923 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 07:59:45.644923 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 07:59:45.644923 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 07:59:45.644923 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 07:59:45.644923 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 07:59:45.645907 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 07:59:45.645907 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 07:59:45.645907 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 07:59:45.645907 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 07:59:45.645907 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 07:59:45.645907 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 07:59:45.645907 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 07:59:45.645907 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 07:59:45.645907 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application with Lock( Jul 28 07:59:45.645907 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 07:59:45.645907 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._enter() Jul 28 07:59:45.645907 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 07:59:45.645907 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 07:59:45.645907 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 07:59:45.645907 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.creator() Jul 28 07:59:45.645907 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 07:59:45.645907 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application created_value = creator( Jul 28 07:59:45.646805 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 07:59:45.646805 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 07:59:45.646805 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 07:59:45.646805 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application Jul 28 07:59:45.646805 dv-cinder-851351-1-smb devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 387/741] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 07:59:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 249 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 07:59:45.652602 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0ad3c4-7cd0-4e9f-8201-79f887ea4cb1 None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 07:59:45.732898 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc3fdf9-a0b3-42e2-aa21-238d5ef693f9 None admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 07:59:45.771829 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc32cecb-7e47-4afe-9d24-aabbf363efb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 07:59:45.772920 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc32cecb-7e47-4afe-9d24-aabbf363efb6 None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 07:59:45.773383 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc32cecb-7e47-4afe-9d24-aabbf363efb6 None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 07:59:45.773834 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc32cecb-7e47-4afe-9d24-aabbf363efb6 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 07:59:45.783421 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc32cecb-7e47-4afe-9d24-aabbf363efb6 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 07:59:45.785276 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc32cecb-7e47-4afe-9d24-aabbf363efb6 None admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 07:59:45.787925 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 07:59:45.800059 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application [None req-dc32cecb-7e47-4afe-9d24-aabbf363efb6 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 28 07:59:45.800059 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 07:59:45.800059 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 07:59:45.800059 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 07:59:45.800059 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 07:59:45.800059 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 07:59:45.800059 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 07:59:45.800059 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 07:59:45.800059 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 07:59:45.800059 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 07:59:45.800059 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 07:59:45.800059 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 07:59:45.800059 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 28 07:59:45.800059 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 28 07:59:45.800059 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 28 07:59:45.800059 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 28 07:59:45.801123 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 07:59:45.801123 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 07:59:45.801123 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 28 07:59:45.801123 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 07:59:45.801123 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 28 07:59:45.801123 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 07:59:45.801123 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 07:59:45.801123 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 07:59:45.801123 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 07:59:45.801123 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 07:59:45.801123 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 07:59:45.801123 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application with Lock( Jul 28 07:59:45.801123 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 07:59:45.801123 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self._enter() Jul 28 07:59:45.801123 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 07:59:45.801123 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 07:59:45.801123 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 07:59:45.801123 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.creator() Jul 28 07:59:45.802068 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 07:59:45.802068 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application created_value = creator( Jul 28 07:59:45.802068 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 28 07:59:45.802068 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 28 07:59:45.802068 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 28 07:59:45.802068 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 28 07:59:45.802068 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 28 07:59:45.802068 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 28 07:59:45.802068 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 28 07:59:45.802068 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application Jul 28 07:59:45.804541 dv-cinder-851351-1-smb devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 355/742] 10.222.0.42 () {56 vars in 1096 bytes} [Thu Jul 28 07:59:45 2022] GET /identity/v3/users/swift => generated 83 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 07:59:45.812828 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc32cecb-7e47-4afe-9d24-aabbf363efb6 None admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 07:59:45.851303 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 07:59:45.902402 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0ad3c4-7cd0-4e9f-8201-79f887ea4cb1 None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 07:59:45.941877 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2390006b-cc46-4b87-be2a-fe56fe4dda3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 07:59:45.942534 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2390006b-cc46-4b87-be2a-fe56fe4dda3c None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 07:59:45.942815 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2390006b-cc46-4b87-be2a-fe56fe4dda3c None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 07:59:45.943080 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2390006b-cc46-4b87-be2a-fe56fe4dda3c None admin] PATH_INFO: `/v3/domains` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 07:59:45.943813 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2390006b-cc46-4b87-be2a-fe56fe4dda3c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 07:59:45.944121 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2390006b-cc46-4b87-be2a-fe56fe4dda3c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 07:59:45.945658 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2390006b-cc46-4b87-be2a-fe56fe4dda3c None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 07:59:45.962566 dv-cinder-851351-1-smb devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 388/743] 10.222.0.42 () {56 vars in 1109 bytes} [Thu Jul 28 07:59:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 311 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 07:59:45.968808 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2390006b-cc46-4b87-be2a-fe56fe4dda3c None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 07:59:45.984703 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc32cecb-7e47-4afe-9d24-aabbf363efb6 None admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 07:59:46.032036 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d069839f-81f4-48d1-9d4d-3eff261a8a27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 07:59:46.032678 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d069839f-81f4-48d1-9d4d-3eff261a8a27 None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 07:59:46.033544 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d069839f-81f4-48d1-9d4d-3eff261a8a27 None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 07:59:46.033817 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d069839f-81f4-48d1-9d4d-3eff261a8a27 None admin] PATH_INFO: `/v3/users` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 07:59:46.034920 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d069839f-81f4-48d1-9d4d-3eff261a8a27 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80348) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 07:59:46.035224 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d069839f-81f4-48d1-9d4d-3eff261a8a27 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 07:59:46.037419 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d069839f-81f4-48d1-9d4d-3eff261a8a27 None admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 07:59:46.060142 dv-cinder-851351-1-smb devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 356/744] 10.222.0.42 () {56 vars in 1135 bytes} [Thu Jul 28 07:59:45 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 07:59:46.065779 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d069839f-81f4-48d1-9d4d-3eff261a8a27 None admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 07:59:46.084072 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2390006b-cc46-4b87-be2a-fe56fe4dda3c None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 07:59:46.103364 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 07:59:46.126857 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-befd59dc-6595-43e8-bf96-cdd2994e2bff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 07:59:46.127513 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befd59dc-6595-43e8-bf96-cdd2994e2bff None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 07:59:46.127840 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befd59dc-6595-43e8-bf96-cdd2994e2bff None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 07:59:46.128118 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befd59dc-6595-43e8-bf96-cdd2994e2bff None admin] PATH_INFO: `/v3/projects/service` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 07:59:46.135282 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-befd59dc-6595-43e8-bf96-cdd2994e2bff None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 07:59:46.136852 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-befd59dc-6595-43e8-bf96-cdd2994e2bff None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 07:59:46.141280 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=100 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 07:59:46.149609 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application [None req-befd59dc-6595-43e8-bf96-cdd2994e2bff None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 07:59:46.149609 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 07:59:46.149609 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 07:59:46.149609 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 07:59:46.149609 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 07:59:46.149609 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 07:59:46.149609 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 07:59:46.149609 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 07:59:46.149609 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 07:59:46.149609 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 07:59:46.149609 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 07:59:46.149609 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 07:59:46.149609 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 28 07:59:46.149609 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 28 07:59:46.149609 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 28 07:59:46.150560 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 28 07:59:46.150560 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 07:59:46.150560 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 07:59:46.150560 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 07:59:46.150560 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 07:59:46.150560 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 07:59:46.150560 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 07:59:46.150560 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 07:59:46.150560 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application with Lock( Jul 28 07:59:46.150560 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 07:59:46.150560 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._enter() Jul 28 07:59:46.150560 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 07:59:46.150560 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 07:59:46.150560 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 07:59:46.150560 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.creator() Jul 28 07:59:46.150560 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 07:59:46.150560 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application created_value = creator( Jul 28 07:59:46.152264 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 28 07:59:46.152264 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 28 07:59:46.152264 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 28 07:59:46.152264 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 28 07:59:46.152264 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 28 07:59:46.152264 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 28 07:59:46.152264 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 07:59:46.152264 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application Jul 28 07:59:46.152264 dv-cinder-851351-1-smb devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 389/745] 10.222.0.42 () {56 vars in 1111 bytes} [Thu Jul 28 07:59:45 2022] GET /identity/v3/projects/service => generated 88 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 07:59:46.156907 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-befd59dc-6595-43e8-bf96-cdd2994e2bff None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 07:59:46.185135 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d069839f-81f4-48d1-9d4d-3eff261a8a27 None admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 07:59:46.248124 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee57b53e-9fa6-45f0-9434-c5cca5a76f80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 07:59:46.248690 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee57b53e-9fa6-45f0-9434-c5cca5a76f80 None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 07:59:46.248969 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee57b53e-9fa6-45f0-9434-c5cca5a76f80 None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 07:59:46.249245 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee57b53e-9fa6-45f0-9434-c5cca5a76f80 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 07:59:46.344338 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-befd59dc-6595-43e8-bf96-cdd2994e2bff None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 07:59:46.373871 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee57b53e-9fa6-45f0-9434-c5cca5a76f80 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 07:59:46.375358 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee57b53e-9fa6-45f0-9434-c5cca5a76f80 None admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 07:59:46.415218 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f72c856e-70b8-4ab0-9d5e-8a27fbce9bc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 07:59:46.415853 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72c856e-70b8-4ab0-9d5e-8a27fbce9bc7 None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 07:59:46.416176 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72c856e-70b8-4ab0-9d5e-8a27fbce9bc7 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 07:59:46.416444 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72c856e-70b8-4ab0-9d5e-8a27fbce9bc7 None admin] PATH_INFO: `/v3/projects` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 07:59:46.417275 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f72c856e-70b8-4ab0-9d5e-8a27fbce9bc7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 07:59:46.417572 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f72c856e-70b8-4ab0-9d5e-8a27fbce9bc7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 07:59:46.419000 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f72c856e-70b8-4ab0-9d5e-8a27fbce9bc7 None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 07:59:46.444810 dv-cinder-851351-1-smb devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 390/746] 10.222.0.42 () {56 vars in 1148 bytes} [Thu Jul 28 07:59:46 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 288 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 07:59:46.451153 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f72c856e-70b8-4ab0-9d5e-8a27fbce9bc7 None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 07:59:46.494491 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=100 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 07:59:46.521444 dv-cinder-851351-1-smb devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 357/747] 10.222.0.42 () {58 vars in 1282 bytes} [Thu Jul 28 07:59:46 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 456 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 28 07:59:46.529807 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee57b53e-9fa6-45f0-9434-c5cca5a76f80 None admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 07:59:46.545521 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 07:59:46.657333 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee57b53e-9fa6-45f0-9434-c5cca5a76f80 None admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 07:59:46.693587 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe414ed-ac20-4023-9209-1b63ad0cdfb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 07:59:46.694390 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe414ed-ac20-4023-9209-1b63ad0cdfb9 None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 07:59:46.694759 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe414ed-ac20-4023-9209-1b63ad0cdfb9 None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 07:59:46.695145 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe414ed-ac20-4023-9209-1b63ad0cdfb9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 07:59:46.706738 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fe414ed-ac20-4023-9209-1b63ad0cdfb9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 07:59:46.708340 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fe414ed-ac20-4023-9209-1b63ad0cdfb9 None admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 07:59:46.724483 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application [None req-8fe414ed-ac20-4023-9209-1b63ad0cdfb9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 07:59:46.724483 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 07:59:46.724483 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 07:59:46.724483 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 07:59:46.724483 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 07:59:46.724483 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 07:59:46.724483 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 07:59:46.724483 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 07:59:46.724483 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 07:59:46.724483 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 07:59:46.724483 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 07:59:46.724483 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 07:59:46.724483 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 07:59:46.724483 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 07:59:46.724483 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 07:59:46.726359 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 07:59:46.726359 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 07:59:46.726359 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 07:59:46.726359 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 07:59:46.726359 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 07:59:46.726359 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 07:59:46.726359 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 07:59:46.726359 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 07:59:46.726359 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application with Lock( Jul 28 07:59:46.726359 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 07:59:46.726359 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self._enter() Jul 28 07:59:46.726359 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 07:59:46.726359 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 07:59:46.726359 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 07:59:46.726359 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.creator() Jul 28 07:59:46.726359 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 07:59:46.726359 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application created_value = creator( Jul 28 07:59:46.728110 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 07:59:46.728110 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 07:59:46.728110 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 07:59:46.728110 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application Jul 28 07:59:46.728110 dv-cinder-851351-1-smb devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 358/748] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 07:59:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 07:59:46.735475 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe414ed-ac20-4023-9209-1b63ad0cdfb9 None admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 07:59:46.738520 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f72c856e-70b8-4ab0-9d5e-8a27fbce9bc7 None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 07:59:46.782220 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21cc88a5-eda4-4df3-b884-858b37bea4ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 07:59:46.785050 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21cc88a5-eda4-4df3-b884-858b37bea4ad None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 07:59:46.785616 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21cc88a5-eda4-4df3-b884-858b37bea4ad None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 07:59:46.786260 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=100 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 07:59:46.789073 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21cc88a5-eda4-4df3-b884-858b37bea4ad None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 07:59:46.790545 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21cc88a5-eda4-4df3-b884-858b37bea4ad None admin] RBAC: Adding query filter params (role.id=a2d02bc3295c4a33b1fc0775a17a79e6, scope.project.id=139349507026497c98f360774dee737e, user.id=4a92b0d2802e46f4beffaaf39ed6723c) {{(pid=80347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 07:59:46.793598 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21cc88a5-eda4-4df3-b884-858b37bea4ad None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 07:59:46.797343 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21cc88a5-eda4-4df3-b884-858b37bea4ad None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 07:59:46.813262 dv-cinder-851351-1-smb devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 391/749] 10.222.0.42 () {56 vars in 1374 bytes} [Thu Jul 28 07:59:46 2022] GET /identity/v3/role_assignments?user.id=4a92b0d2802e46f4beffaaf39ed6723c&scope.project.id=139349507026497c98f360774dee737e&role.id=a2d02bc3295c4a33b1fc0775a17a79e6 => generated 259 bytes in 363 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 07:59:46.897529 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe414ed-ac20-4023-9209-1b63ad0cdfb9 None admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 07:59:46.940497 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6939c6-a50f-422b-9198-f59ff624d4c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 07:59:46.941735 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6939c6-a50f-422b-9198-f59ff624d4c7 None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 07:59:46.942210 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6939c6-a50f-422b-9198-f59ff624d4c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 07:59:46.942671 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6939c6-a50f-422b-9198-f59ff624d4c7 None admin] PATH_INFO: `/v3/domains` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 07:59:46.943566 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb6939c6-a50f-422b-9198-f59ff624d4c7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80348) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 07:59:46.944076 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb6939c6-a50f-422b-9198-f59ff624d4c7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 07:59:46.945713 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb6939c6-a50f-422b-9198-f59ff624d4c7 None admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 07:59:46.964898 dv-cinder-851351-1-smb devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 359/750] 10.222.0.42 () {56 vars in 1109 bytes} [Thu Jul 28 07:59:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 07:59:46.970237 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21cc88a5-eda4-4df3-b884-858b37bea4ad None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 07:59:47.017194 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130874a4-09e8-408d-b1b3-bf065145f557 None None] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 07:59:47.017816 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130874a4-09e8-408d-b1b3-bf065145f557 None None] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 07:59:47.018278 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130874a4-09e8-408d-b1b3-bf065145f557 None None] PATH_INFO: `/` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 07:59:47.020211 dv-cinder-851351-1-smb devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 360/751] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 07:59:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 07:59:47.025884 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dffdf86-788c-4146-9ca2-ec38927a9774 None None] REQUEST_METHOD: `POST` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 07:59:47.026531 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dffdf86-788c-4146-9ca2-ec38927a9774 None None] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 07:59:47.027046 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dffdf86-788c-4146-9ca2-ec38927a9774 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 07:59:47.069874 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.auth.core [None req-4dffdf86-788c-4146-9ca2-ec38927a9774 None None] MFA Rules not processed for user `f0666d3a50644a7097367331c1ee1a68`. Rule list: `[]` (Enabled: `True`). {{(pid=80348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 07:59:47.071625 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.fernet_utils [None req-4dffdf86-788c-4146-9ca2-ec38927a9774 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 07:59:47.088771 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21cc88a5-eda4-4df3-b884-858b37bea4ad None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 07:59:47.092013 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 07:59:47.121653 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6b27cf-f50a-4e7d-ba91-7b3f5f2a7edc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 07:59:47.122313 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6b27cf-f50a-4e7d-ba91-7b3f5f2a7edc None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 07:59:47.122584 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6b27cf-f50a-4e7d-ba91-7b3f5f2a7edc None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 07:59:47.122884 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6b27cf-f50a-4e7d-ba91-7b3f5f2a7edc None admin] PATH_INFO: `/v3/projects/service` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 07:59:47.130429 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b6b27cf-f50a-4e7d-ba91-7b3f5f2a7edc None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 07:59:47.131905 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b6b27cf-f50a-4e7d-ba91-7b3f5f2a7edc None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 07:59:47.144841 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application [None req-2b6b27cf-f50a-4e7d-ba91-7b3f5f2a7edc None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 07:59:47.144841 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 07:59:47.144841 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 07:59:47.144841 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 07:59:47.144841 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 07:59:47.144841 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 07:59:47.144841 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 07:59:47.144841 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 07:59:47.144841 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 07:59:47.144841 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 07:59:47.144841 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 07:59:47.144841 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 07:59:47.144841 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 28 07:59:47.144841 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 28 07:59:47.144841 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 28 07:59:47.145787 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 28 07:59:47.145787 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 07:59:47.145787 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 07:59:47.145787 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 07:59:47.145787 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 07:59:47.145787 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 07:59:47.145787 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 07:59:47.145787 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 07:59:47.145787 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application with Lock( Jul 28 07:59:47.145787 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 07:59:47.145787 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._enter() Jul 28 07:59:47.145787 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 07:59:47.145787 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 07:59:47.145787 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 07:59:47.145787 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.creator() Jul 28 07:59:47.145787 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 07:59:47.145787 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application created_value = creator( Jul 28 07:59:47.146650 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 28 07:59:47.146650 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 28 07:59:47.146650 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 28 07:59:47.146650 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 28 07:59:47.146650 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 28 07:59:47.146650 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 28 07:59:47.146650 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 07:59:47.146650 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application Jul 28 07:59:47.146650 dv-cinder-851351-1-smb devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 392/752] 10.222.0.42 () {56 vars in 1111 bytes} [Thu Jul 28 07:59:46 2022] GET /identity/v3/projects/service => generated 88 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 07:59:47.147597 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3d8bd8-97f8-435c-ab74-b7ae1d736f2a None None] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 07:59:47.147875 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3d8bd8-97f8-435c-ab74-b7ae1d736f2a None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 07:59:47.148146 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3d8bd8-97f8-435c-ab74-b7ae1d736f2a None None] PATH_INFO: `/` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 07:59:47.153669 dv-cinder-851351-1-smb devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 393/753] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 07:59:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 07:59:47.157167 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3d8bd8-97f8-435c-ab74-b7ae1d736f2a None None] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 07:59:47.185229 dv-cinder-851351-1-smb devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 361/754] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 07:59:47 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 07:59:47.187113 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eeb7d8a-a428-4dc0-92e7-95873068573e None None] REQUEST_METHOD: `POST` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 07:59:47.187683 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eeb7d8a-a428-4dc0-92e7-95873068573e None None] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 07:59:47.188266 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eeb7d8a-a428-4dc0-92e7-95873068573e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 07:59:47.220892 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.auth.core [None req-2eeb7d8a-a428-4dc0-92e7-95873068573e None None] MFA Rules not processed for user `f0666d3a50644a7097367331c1ee1a68`. Rule list: `[]` (Enabled: `True`). {{(pid=80348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 07:59:47.222533 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.fernet_utils [None req-2eeb7d8a-a428-4dc0-92e7-95873068573e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 07:59:47.233437 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=100 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 07:59:47.275724 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3d8bd8-97f8-435c-ab74-b7ae1d736f2a None None] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 07:59:47.309114 dv-cinder-851351-1-smb devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 362/755] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 07:59:47 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 07:59:47.310346 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eeb7d8a-a428-4dc0-92e7-95873068573e None None] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 07:59:47.312571 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa82d37e-4d8a-4973-9ab9-adf549dd0bf7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 07:59:47.313339 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa82d37e-4d8a-4973-9ab9-adf549dd0bf7 None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 07:59:47.313616 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa82d37e-4d8a-4973-9ab9-adf549dd0bf7 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 07:59:47.313977 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa82d37e-4d8a-4973-9ab9-adf549dd0bf7 None admin] PATH_INFO: `/v3/projects` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 07:59:47.314743 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa82d37e-4d8a-4973-9ab9-adf549dd0bf7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 07:59:47.315063 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa82d37e-4d8a-4973-9ab9-adf549dd0bf7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 07:59:47.316488 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa82d37e-4d8a-4973-9ab9-adf549dd0bf7 None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 07:59:47.330546 dv-cinder-851351-1-smb devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 394/756] 10.222.0.42 () {56 vars in 1148 bytes} [Thu Jul 28 07:59:47 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 07:59:47.342202 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa82d37e-4d8a-4973-9ab9-adf549dd0bf7 None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 07:59:47.366448 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 07:59:47.425114 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eeb7d8a-a428-4dc0-92e7-95873068573e None None] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 07:59:47.464840 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f711f376-a54c-44ad-a1c4-62fc522e98cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 07:59:47.465892 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f711f376-a54c-44ad-a1c4-62fc522e98cf None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 07:59:47.466364 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f711f376-a54c-44ad-a1c4-62fc522e98cf None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 07:59:47.466847 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f711f376-a54c-44ad-a1c4-62fc522e98cf None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 07:59:47.475695 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa82d37e-4d8a-4973-9ab9-adf549dd0bf7 None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 07:59:47.478210 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f711f376-a54c-44ad-a1c4-62fc522e98cf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 07:59:47.483391 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application [None req-f711f376-a54c-44ad-a1c4-62fc522e98cf None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 07:59:47.483391 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 07:59:47.483391 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 07:59:47.483391 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 07:59:47.483391 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 07:59:47.483391 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 07:59:47.483391 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 07:59:47.483391 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 07:59:47.483391 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 07:59:47.483391 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 07:59:47.483391 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 07:59:47.483391 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 07:59:47.483391 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 07:59:47.483391 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 07:59:47.483391 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 07:59:47.483391 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 07:59:47.484516 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 07:59:47.484516 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 07:59:47.484516 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 07:59:47.484516 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 07:59:47.484516 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 07:59:47.484516 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 07:59:47.484516 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 07:59:47.484516 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 07:59:47.484516 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 07:59:47.484516 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 07:59:47.484516 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 07:59:47.484516 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application with Lock( Jul 28 07:59:47.484516 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 07:59:47.484516 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self._enter() Jul 28 07:59:47.484516 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 07:59:47.484516 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 07:59:47.485563 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 07:59:47.485563 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.creator() Jul 28 07:59:47.485563 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 07:59:47.485563 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application created_value = creator( Jul 28 07:59:47.485563 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 07:59:47.485563 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 07:59:47.485563 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 07:59:47.485563 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 07:59:47.485563 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 07:59:47.485563 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 07:59:47.485563 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 07:59:47.485563 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application Jul 28 07:59:47.492851 dv-cinder-851351-1-smb devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 363/757] 10.222.0.42 () {56 vars in 1096 bytes} [Thu Jul 28 07:59:47 2022] GET /identity/v3/roles/admin => generated 83 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 07:59:47.493942 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f711f376-a54c-44ad-a1c4-62fc522e98cf None admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 07:59:47.498725 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=100 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 07:59:47.518253 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a29061-b230-454e-9a92-cd64b8b96deb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 07:59:47.519094 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a29061-b230-454e-9a92-cd64b8b96deb None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 07:59:47.519498 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a29061-b230-454e-9a92-cd64b8b96deb None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 07:59:47.519866 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a29061-b230-454e-9a92-cd64b8b96deb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 07:59:47.521248 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60a29061-b230-454e-9a92-cd64b8b96deb None admin] RBAC: Adding query filter params (role.id=362bd71ac01249fb8fa635381993eec1, scope.project.id=139349507026497c98f360774dee737e, user.id=fe8c81659f704e14b8f0e00856a5a9a5) {{(pid=80347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 07:59:47.521659 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60a29061-b230-454e-9a92-cd64b8b96deb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 07:59:47.523618 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60a29061-b230-454e-9a92-cd64b8b96deb None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 07:59:47.531792 dv-cinder-851351-1-smb devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 395/758] 10.222.0.42 () {56 vars in 1374 bytes} [Thu Jul 28 07:59:47 2022] GET /identity/v3/role_assignments?user.id=fe8c81659f704e14b8f0e00856a5a9a5&scope.project.id=139349507026497c98f360774dee737e&role.id=362bd71ac01249fb8fa635381993eec1 => generated 259 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 07:59:47.533223 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a29061-b230-454e-9a92-cd64b8b96deb None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 07:59:47.680552 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f711f376-a54c-44ad-a1c4-62fc522e98cf None admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 07:59:47.722311 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 07:59:47.751621 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a29061-b230-454e-9a92-cd64b8b96deb None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 07:59:47.756057 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb94a8e-3ecb-43ce-bfc3-79fd6fe3ba0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 07:59:47.756778 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb94a8e-3ecb-43ce-bfc3-79fd6fe3ba0a None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 07:59:47.757056 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb94a8e-3ecb-43ce-bfc3-79fd6fe3ba0a None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 07:59:47.757318 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb94a8e-3ecb-43ce-bfc3-79fd6fe3ba0a None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 07:59:47.757964 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb94a8e-3ecb-43ce-bfc3-79fd6fe3ba0a None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 07:59:47.759377 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb94a8e-3ecb-43ce-bfc3-79fd6fe3ba0a None admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 07:59:47.770165 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application [None req-4eb94a8e-3ecb-43ce-bfc3-79fd6fe3ba0a None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 28 07:59:47.770165 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 07:59:47.770165 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 28 07:59:47.770165 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 28 07:59:47.770165 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 28 07:59:47.770165 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 28 07:59:47.770165 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 28 07:59:47.770165 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 07:59:47.770165 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 28 07:59:47.770165 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application Jul 28 07:59:47.770165 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 28 07:59:47.770165 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application Jul 28 07:59:47.770165 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 07:59:47.770165 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 07:59:47.770165 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 07:59:47.770165 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 07:59:47.771174 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 07:59:47.771174 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 07:59:47.771174 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 07:59:47.771174 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 07:59:47.771174 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 07:59:47.771174 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 07:59:47.771174 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 07:59:47.771174 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 28 07:59:47.771174 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 28 07:59:47.771174 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 28 07:59:47.771174 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 28 07:59:47.771174 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 07:59:47.771174 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 07:59:47.771174 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 07:59:47.771174 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 07:59:47.771174 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 07:59:47.772004 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 07:59:47.772004 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 07:59:47.772004 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application with Lock( Jul 28 07:59:47.772004 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 07:59:47.772004 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self._enter() Jul 28 07:59:47.772004 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 07:59:47.772004 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 07:59:47.772004 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 07:59:47.772004 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.creator() Jul 28 07:59:47.772004 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 07:59:47.772004 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application created_value = creator( Jul 28 07:59:47.772004 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 28 07:59:47.772004 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 07:59:47.772004 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 28 07:59:47.772004 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application Jul 28 07:59:47.772004 dv-cinder-851351-1-smb devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 364/759] 10.222.0.42 () {56 vars in 1129 bytes} [Thu Jul 28 07:59:47 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 278 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 07:59:47.777955 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb94a8e-3ecb-43ce-bfc3-79fd6fe3ba0a None admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 07:59:47.829620 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71926e37-6962-4aa1-ac5d-631d5c335384 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 07:59:47.830269 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71926e37-6962-4aa1-ac5d-631d5c335384 None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 07:59:47.830551 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71926e37-6962-4aa1-ac5d-631d5c335384 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 07:59:47.830824 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71926e37-6962-4aa1-ac5d-631d5c335384 None admin] PATH_INFO: `/v3/roles` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 07:59:47.831561 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71926e37-6962-4aa1-ac5d-631d5c335384 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 07:59:47.831860 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71926e37-6962-4aa1-ac5d-631d5c335384 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 07:59:47.833280 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71926e37-6962-4aa1-ac5d-631d5c335384 None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 07:59:47.852883 dv-cinder-851351-1-smb devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 396/760] 10.222.0.42 () {56 vars in 1099 bytes} [Thu Jul 28 07:59:47 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 317 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 07:59:47.855766 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71926e37-6962-4aa1-ac5d-631d5c335384 None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 07:59:47.874708 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=100 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 07:59:47.916812 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb94a8e-3ecb-43ce-bfc3-79fd6fe3ba0a None admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 07:59:47.955813 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c22883a-9b49-45b9-bbb9-c7af8b996503 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 07:59:47.956795 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c22883a-9b49-45b9-bbb9-c7af8b996503 None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 07:59:47.957380 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c22883a-9b49-45b9-bbb9-c7af8b996503 None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 07:59:47.957878 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c22883a-9b49-45b9-bbb9-c7af8b996503 None admin] PATH_INFO: `/v3/services` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 07:59:47.958750 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c22883a-9b49-45b9-bbb9-c7af8b996503 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80348) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 07:59:47.959317 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c22883a-9b49-45b9-bbb9-c7af8b996503 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 07:59:47.960900 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c22883a-9b49-45b9-bbb9-c7af8b996503 None admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 07:59:47.967641 dv-cinder-851351-1-smb devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 365/761] 10.222.0.42 () {56 vars in 1124 bytes} [Thu Jul 28 07:59:47 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 07:59:47.973630 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c22883a-9b49-45b9-bbb9-c7af8b996503 None admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 07:59:48.089699 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c22883a-9b49-45b9-bbb9-c7af8b996503 None admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 07:59:48.110338 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71926e37-6962-4aa1-ac5d-631d5c335384 None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 07:59:48.123087 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=100 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 07:59:48.131636 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda2faf2-93c4-49ff-8c11-7404a736bbd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 07:59:48.132643 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda2faf2-93c4-49ff-8c11-7404a736bbd8 None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 07:59:48.133233 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda2faf2-93c4-49ff-8c11-7404a736bbd8 None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 07:59:48.133711 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda2faf2-93c4-49ff-8c11-7404a736bbd8 None admin] PATH_INFO: `/v3/services` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 07:59:48.134849 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda2faf2-93c4-49ff-8c11-7404a736bbd8 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80348) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 07:59:48.135418 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda2faf2-93c4-49ff-8c11-7404a736bbd8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 07:59:48.137180 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda2faf2-93c4-49ff-8c11-7404a736bbd8 None admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 07:59:48.143554 dv-cinder-851351-1-smb devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 366/762] 10.222.0.42 () {56 vars in 1124 bytes} [Thu Jul 28 07:59:47 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 07:59:48.149507 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda2faf2-93c4-49ff-8c11-7404a736bbd8 None admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 07:59:48.174577 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98808062-bd95-48ff-bcb6-9eb1cc331c02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 07:59:48.174975 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98808062-bd95-48ff-bcb6-9eb1cc331c02 None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 07:59:48.175244 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98808062-bd95-48ff-bcb6-9eb1cc331c02 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 07:59:48.175515 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98808062-bd95-48ff-bcb6-9eb1cc331c02 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 07:59:48.187397 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98808062-bd95-48ff-bcb6-9eb1cc331c02 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 07:59:48.188874 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98808062-bd95-48ff-bcb6-9eb1cc331c02 None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 07:59:48.203512 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application [None req-98808062-bd95-48ff-bcb6-9eb1cc331c02 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 07:59:48.203512 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 07:59:48.203512 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 07:59:48.203512 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 07:59:48.203512 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 07:59:48.203512 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 07:59:48.203512 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 07:59:48.203512 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 07:59:48.203512 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 07:59:48.203512 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 07:59:48.203512 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 07:59:48.203512 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 07:59:48.203512 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 07:59:48.203512 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 07:59:48.203512 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 07:59:48.205133 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 07:59:48.205133 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 07:59:48.205133 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 07:59:48.205133 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 07:59:48.205133 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 07:59:48.205133 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 07:59:48.205133 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 07:59:48.205133 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 07:59:48.205133 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application with Lock( Jul 28 07:59:48.205133 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 07:59:48.205133 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._enter() Jul 28 07:59:48.205133 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 07:59:48.205133 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 07:59:48.205133 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 07:59:48.205133 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.creator() Jul 28 07:59:48.205133 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 07:59:48.205133 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application created_value = creator( Jul 28 07:59:48.206057 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 07:59:48.206057 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 07:59:48.206057 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 07:59:48.206057 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application Jul 28 07:59:48.207651 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 07:59:48.209268 dv-cinder-851351-1-smb devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 397/763] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 07:59:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 350 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 07:59:48.212776 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db513a2c-f334-4f17-b1ae-ec520a7fa697 None None] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 07:59:48.212776 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db513a2c-f334-4f17-b1ae-ec520a7fa697 None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 07:59:48.212776 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db513a2c-f334-4f17-b1ae-ec520a7fa697 None None] PATH_INFO: `/` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 07:59:48.212776 dv-cinder-851351-1-smb devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 398/764] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 07:59:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 07:59:48.214913 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db513a2c-f334-4f17-b1ae-ec520a7fa697 None None] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 07:59:48.293105 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda2faf2-93c4-49ff-8c11-7404a736bbd8 None admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 07:59:48.330338 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76667762-45b7-4afb-bfc8-1fec5dadafe8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 07:59:48.330967 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76667762-45b7-4afb-bfc8-1fec5dadafe8 None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 07:59:48.331243 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76667762-45b7-4afb-bfc8-1fec5dadafe8 None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 07:59:48.331582 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76667762-45b7-4afb-bfc8-1fec5dadafe8 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 07:59:48.332369 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76667762-45b7-4afb-bfc8-1fec5dadafe8 None admin] RBAC: Adding query filter params (interface=public, service_id=44f3e5a10a384013bbcc15707bcf2959, region_id=RegionOne) {{(pid=80348) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 07:59:48.332560 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76667762-45b7-4afb-bfc8-1fec5dadafe8 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 07:59:48.334152 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76667762-45b7-4afb-bfc8-1fec5dadafe8 None admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 07:59:48.346872 dv-cinder-851351-1-smb devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 367/765] 10.222.0.42 () {56 vars in 1251 bytes} [Thu Jul 28 07:59:48 2022] GET /identity/v3/endpoints?service_id=44f3e5a10a384013bbcc15707bcf2959&interface=public®ion_id=RegionOne => generated 194 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 07:59:48.346872 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2676f9-f25b-4426-aa46-dba66ef2d0d2 None None] REQUEST_METHOD: `POST` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 07:59:48.346872 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2676f9-f25b-4426-aa46-dba66ef2d0d2 None None] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 07:59:48.346872 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2676f9-f25b-4426-aa46-dba66ef2d0d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 07:59:48.353485 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db513a2c-f334-4f17-b1ae-ec520a7fa697 None None] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 07:59:48.364375 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.auth.core [None req-2f2676f9-f25b-4426-aa46-dba66ef2d0d2 None None] MFA Rules not processed for user `f0666d3a50644a7097367331c1ee1a68`. Rule list: `[]` (Enabled: `True`). {{(pid=80348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 07:59:48.365626 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.fernet_utils [None req-2f2676f9-f25b-4426-aa46-dba66ef2d0d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 07:59:48.398983 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43679da-eaa0-44be-bd93-e268451557b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 07:59:48.400325 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43679da-eaa0-44be-bd93-e268451557b2 None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 07:59:48.400885 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43679da-eaa0-44be-bd93-e268451557b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 07:59:48.401370 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43679da-eaa0-44be-bd93-e268451557b2 None admin] PATH_INFO: `/v3/domains` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 07:59:48.402267 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d43679da-eaa0-44be-bd93-e268451557b2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 07:59:48.402877 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d43679da-eaa0-44be-bd93-e268451557b2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 07:59:48.405277 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d43679da-eaa0-44be-bd93-e268451557b2 None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 07:59:48.420309 dv-cinder-851351-1-smb devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 399/766] 10.222.0.42 () {56 vars in 1109 bytes} [Thu Jul 28 07:59:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 07:59:48.421472 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43679da-eaa0-44be-bd93-e268451557b2 None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 07:59:48.427115 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=100 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 07:59:48.443388 dv-cinder-851351-1-smb devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 368/767] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 07:59:48 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 07:59:48.444146 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f2676f9-f25b-4426-aa46-dba66ef2d0d2 None None] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 07:59:48.493977 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 07:59:48.540253 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43679da-eaa0-44be-bd93-e268451557b2 None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 07:59:48.551159 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f2676f9-f25b-4426-aa46-dba66ef2d0d2 None None] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 07:59:48.576303 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb19e41-01ac-488a-b22c-027c33bf65ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 07:59:48.577279 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb19e41-01ac-488a-b22c-027c33bf65ed None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 07:59:48.577775 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb19e41-01ac-488a-b22c-027c33bf65ed None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 07:59:48.578243 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb19e41-01ac-488a-b22c-027c33bf65ed None admin] PATH_INFO: `/v3/services` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 07:59:48.579460 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cb19e41-01ac-488a-b22c-027c33bf65ed None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 07:59:48.581059 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cb19e41-01ac-488a-b22c-027c33bf65ed None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 07:59:48.592689 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3998a788-90ea-4025-8ac3-95726c984d23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 07:59:48.592689 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3998a788-90ea-4025-8ac3-95726c984d23 None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 07:59:48.592689 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3998a788-90ea-4025-8ac3-95726c984d23 None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 07:59:48.592689 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3998a788-90ea-4025-8ac3-95726c984d23 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 07:59:48.593384 dv-cinder-851351-1-smb devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 400/768] 10.222.0.42 () {56 vars in 1087 bytes} [Thu Jul 28 07:59:48 2022] GET /identity/v3/services => generated 772 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 07:59:48.594581 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb19e41-01ac-488a-b22c-027c33bf65ed None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 07:59:48.599024 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3998a788-90ea-4025-8ac3-95726c984d23 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 07:59:48.600570 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3998a788-90ea-4025-8ac3-95726c984d23 None admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 07:59:48.621219 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application [None req-3998a788-90ea-4025-8ac3-95726c984d23 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 28 07:59:48.621219 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 07:59:48.621219 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 07:59:48.621219 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 07:59:48.621219 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 07:59:48.621219 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 07:59:48.621219 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 07:59:48.621219 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 07:59:48.621219 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 07:59:48.621219 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 07:59:48.621219 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 07:59:48.621219 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 07:59:48.621219 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 28 07:59:48.621219 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 28 07:59:48.621219 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 28 07:59:48.621219 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 28 07:59:48.622206 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 07:59:48.622206 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 07:59:48.622206 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 28 07:59:48.622206 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 07:59:48.622206 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 28 07:59:48.622206 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 07:59:48.622206 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 07:59:48.622206 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 07:59:48.622206 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 07:59:48.622206 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 07:59:48.622206 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 07:59:48.622206 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application with Lock( Jul 28 07:59:48.622206 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 07:59:48.622206 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self._enter() Jul 28 07:59:48.622206 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 07:59:48.622206 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 07:59:48.622206 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 07:59:48.622206 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.creator() Jul 28 07:59:48.623206 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 07:59:48.623206 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application created_value = creator( Jul 28 07:59:48.623206 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 28 07:59:48.623206 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 28 07:59:48.623206 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 28 07:59:48.623206 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 28 07:59:48.623206 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 28 07:59:48.623206 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 28 07:59:48.623206 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 28 07:59:48.623206 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application Jul 28 07:59:48.623206 dv-cinder-851351-1-smb devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 369/769] 10.222.0.42 () {56 vars in 1093 bytes} [Thu Jul 28 07:59:48 2022] GET /identity/v3/users/nova => generated 82 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 07:59:48.623206 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3998a788-90ea-4025-8ac3-95726c984d23 None admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 07:59:48.678397 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=100 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 07:59:48.738522 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3998a788-90ea-4025-8ac3-95726c984d23 None admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 07:59:48.762510 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb19e41-01ac-488a-b22c-027c33bf65ed None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 07:59:48.786176 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 07:59:48.792035 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db20fc9-41b9-44d9-88f6-acbee78e446e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 07:59:48.800135 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db20fc9-41b9-44d9-88f6-acbee78e446e None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 07:59:48.800562 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db20fc9-41b9-44d9-88f6-acbee78e446e None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 07:59:48.800863 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db20fc9-41b9-44d9-88f6-acbee78e446e None admin] PATH_INFO: `/v3/users` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 07:59:48.801963 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0db20fc9-41b9-44d9-88f6-acbee78e446e None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80348) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 07:59:48.802274 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0db20fc9-41b9-44d9-88f6-acbee78e446e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 07:59:48.804169 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0db20fc9-41b9-44d9-88f6-acbee78e446e None admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 07:59:48.804868 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea50509-0b2f-4a54-9a99-5beea8f4e25b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 07:59:48.805781 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea50509-0b2f-4a54-9a99-5beea8f4e25b None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 07:59:48.806248 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea50509-0b2f-4a54-9a99-5beea8f4e25b None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 07:59:48.806703 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea50509-0b2f-4a54-9a99-5beea8f4e25b None admin] PATH_INFO: `/v3/services/network` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 07:59:48.807669 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ea50509-0b2f-4a54-9a99-5beea8f4e25b None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 07:59:48.809305 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ea50509-0b2f-4a54-9a99-5beea8f4e25b None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 07:59:48.819270 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application [None req-9ea50509-0b2f-4a54-9a99-5beea8f4e25b None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jul 28 07:59:48.819270 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 07:59:48.819270 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 28 07:59:48.819270 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 28 07:59:48.819270 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 28 07:59:48.819270 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 28 07:59:48.819270 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 28 07:59:48.819270 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 07:59:48.819270 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 28 07:59:48.819270 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application Jul 28 07:59:48.819270 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 28 07:59:48.819270 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application Jul 28 07:59:48.819270 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 07:59:48.819270 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 07:59:48.819270 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 07:59:48.819270 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 07:59:48.819270 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 07:59:48.820297 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 07:59:48.820297 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 07:59:48.820297 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 07:59:48.820297 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 07:59:48.820297 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 07:59:48.820297 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 07:59:48.820297 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 28 07:59:48.820297 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 28 07:59:48.820297 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 28 07:59:48.820297 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 28 07:59:48.820297 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 07:59:48.820297 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 07:59:48.820297 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 07:59:48.820297 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 07:59:48.820297 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 07:59:48.820297 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 07:59:48.821146 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 07:59:48.821146 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application with Lock( Jul 28 07:59:48.821146 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 07:59:48.821146 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._enter() Jul 28 07:59:48.821146 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 07:59:48.821146 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 07:59:48.821146 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 07:59:48.821146 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.creator() Jul 28 07:59:48.821146 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 07:59:48.821146 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application created_value = creator( Jul 28 07:59:48.821146 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 28 07:59:48.821146 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 07:59:48.821146 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 28 07:59:48.821146 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application Jul 28 07:59:48.824130 dv-cinder-851351-1-smb devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 401/770] 10.222.0.42 () {56 vars in 1111 bytes} [Thu Jul 28 07:59:48 2022] GET /identity/v3/services/network => generated 88 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 07:59:48.832139 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea50509-0b2f-4a54-9a99-5beea8f4e25b None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 07:59:48.840753 dv-cinder-851351-1-smb devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 370/771] 10.222.0.42 () {56 vars in 1133 bytes} [Thu Jul 28 07:59:48 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 07:59:48.848720 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db20fc9-41b9-44d9-88f6-acbee78e446e None admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 07:59:48.953090 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db20fc9-41b9-44d9-88f6-acbee78e446e None admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 07:59:48.961628 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=100 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 07:59:48.974282 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea50509-0b2f-4a54-9a99-5beea8f4e25b None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 07:59:48.991223 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13dc0d6-b0a2-4461-95c5-69ceeefa9fbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 07:59:48.991882 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13dc0d6-b0a2-4461-95c5-69ceeefa9fbe None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 07:59:48.992158 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13dc0d6-b0a2-4461-95c5-69ceeefa9fbe None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 07:59:48.992433 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13dc0d6-b0a2-4461-95c5-69ceeefa9fbe None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 07:59:49.003617 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f13dc0d6-b0a2-4461-95c5-69ceeefa9fbe None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 07:59:49.005245 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f13dc0d6-b0a2-4461-95c5-69ceeefa9fbe None admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 07:59:49.014340 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a533ceb6-5174-4084-8e9c-9fda06ccf3f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 07:59:49.015070 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a533ceb6-5174-4084-8e9c-9fda06ccf3f1 None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 07:59:49.015354 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a533ceb6-5174-4084-8e9c-9fda06ccf3f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 07:59:49.015622 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a533ceb6-5174-4084-8e9c-9fda06ccf3f1 None admin] PATH_INFO: `/v3/services` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 07:59:49.016309 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a533ceb6-5174-4084-8e9c-9fda06ccf3f1 None admin] RBAC: Adding query filter params (name=network) {{(pid=80347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 07:59:49.016611 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a533ceb6-5174-4084-8e9c-9fda06ccf3f1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 07:59:49.017999 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a533ceb6-5174-4084-8e9c-9fda06ccf3f1 None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 07:59:49.021764 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application [None req-f13dc0d6-b0a2-4461-95c5-69ceeefa9fbe None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 07:59:49.021764 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 07:59:49.021764 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 07:59:49.021764 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 07:59:49.021764 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 07:59:49.021764 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 07:59:49.021764 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 07:59:49.021764 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 07:59:49.021764 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 07:59:49.021764 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 07:59:49.021764 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 07:59:49.021764 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 07:59:49.021764 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 07:59:49.021764 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 07:59:49.021764 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 07:59:49.022610 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 07:59:49.022610 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 07:59:49.022610 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 07:59:49.022610 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 07:59:49.022610 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 07:59:49.022610 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 07:59:49.022610 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 07:59:49.022610 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 07:59:49.022610 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application with Lock( Jul 28 07:59:49.022610 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 07:59:49.022610 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self._enter() Jul 28 07:59:49.022610 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 07:59:49.022610 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 07:59:49.022610 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 07:59:49.022610 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.creator() Jul 28 07:59:49.022610 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 07:59:49.022610 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application created_value = creator( Jul 28 07:59:49.023461 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 07:59:49.023461 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 07:59:49.023461 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 07:59:49.023461 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application Jul 28 07:59:49.023686 dv-cinder-851351-1-smb devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 402/772] 10.222.0.42 () {56 vars in 1112 bytes} [Thu Jul 28 07:59:48 2022] GET /identity/v3/services?name=network => generated 124 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 07:59:49.027397 dv-cinder-851351-1-smb devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 371/773] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 07:59:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 07:59:49.028589 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a533ceb6-5174-4084-8e9c-9fda06ccf3f1 None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 07:59:49.028845 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13dc0d6-b0a2-4461-95c5-69ceeefa9fbe None admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 07:59:49.085134 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 07:59:49.170297 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a533ceb6-5174-4084-8e9c-9fda06ccf3f1 None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 07:59:49.217835 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13dc0d6-b0a2-4461-95c5-69ceeefa9fbe None admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 07:59:49.234862 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24601b2-8d35-43e7-96d3-e0e0accb3f4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 07:59:49.235510 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24601b2-8d35-43e7-96d3-e0e0accb3f4c None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 07:59:49.235877 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24601b2-8d35-43e7-96d3-e0e0accb3f4c None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 07:59:49.236148 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24601b2-8d35-43e7-96d3-e0e0accb3f4c None admin] PATH_INFO: `/v3/services` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 07:59:49.236875 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b24601b2-8d35-43e7-96d3-e0e0accb3f4c None admin] RBAC: Adding query filter params (type=network) {{(pid=80347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 07:59:49.237174 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b24601b2-8d35-43e7-96d3-e0e0accb3f4c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 07:59:49.238567 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b24601b2-8d35-43e7-96d3-e0e0accb3f4c None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 07:59:49.249847 dv-cinder-851351-1-smb devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 403/774] 10.222.0.42 () {56 vars in 1112 bytes} [Thu Jul 28 07:59:49 2022] GET /identity/v3/services?type=network => generated 350 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 07:59:49.257893 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24601b2-8d35-43e7-96d3-e0e0accb3f4c None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 07:59:49.295746 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a068b42-b9bd-4bfc-95d9-3ded057b317d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 07:59:49.296414 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a068b42-b9bd-4bfc-95d9-3ded057b317d None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 07:59:49.296751 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a068b42-b9bd-4bfc-95d9-3ded057b317d None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 07:59:49.297033 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a068b42-b9bd-4bfc-95d9-3ded057b317d None admin] PATH_INFO: `/v3/domains` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 07:59:49.297754 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a068b42-b9bd-4bfc-95d9-3ded057b317d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80348) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 07:59:49.298047 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a068b42-b9bd-4bfc-95d9-3ded057b317d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 07:59:49.299437 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a068b42-b9bd-4bfc-95d9-3ded057b317d None admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 07:59:49.329659 dv-cinder-851351-1-smb devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 372/775] 10.222.0.42 () {56 vars in 1109 bytes} [Thu Jul 28 07:59:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 301 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 07:59:49.335340 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a068b42-b9bd-4bfc-95d9-3ded057b317d None admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 07:59:49.366173 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=100 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 07:59:49.398394 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24601b2-8d35-43e7-96d3-e0e0accb3f4c None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 07:59:49.418298 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 07:59:49.447461 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24331961-4863-427a-8dcc-41ec0d8488f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 07:59:49.448144 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24331961-4863-427a-8dcc-41ec0d8488f4 None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 07:59:49.448420 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24331961-4863-427a-8dcc-41ec0d8488f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 07:59:49.448852 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24331961-4863-427a-8dcc-41ec0d8488f4 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 07:59:49.449644 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24331961-4863-427a-8dcc-41ec0d8488f4 None admin] RBAC: Adding query filter params (interface=public, service_id=049e0de192e44472af9a04c08a66e21f, region_id=RegionOne) {{(pid=80347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 07:59:49.450358 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24331961-4863-427a-8dcc-41ec0d8488f4 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 07:59:49.452087 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24331961-4863-427a-8dcc-41ec0d8488f4 None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 07:59:49.468859 dv-cinder-851351-1-smb devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 404/776] 10.222.0.42 () {56 vars in 1251 bytes} [Thu Jul 28 07:59:49 2022] GET /identity/v3/endpoints?service_id=049e0de192e44472af9a04c08a66e21f&interface=public®ion_id=RegionOne => generated 194 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 07:59:49.468859 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf551f5-5144-495b-bd18-6d1f40ecf429 None None] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 07:59:49.468859 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf551f5-5144-495b-bd18-6d1f40ecf429 None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 07:59:49.468859 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf551f5-5144-495b-bd18-6d1f40ecf429 None None] PATH_INFO: `/` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 07:59:49.468859 dv-cinder-851351-1-smb devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 405/777] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 07:59:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 07:59:49.471461 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21bbc837-1a04-40b5-ab27-9cde28e5e963 None None] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 07:59:49.471815 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21bbc837-1a04-40b5-ab27-9cde28e5e963 None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 07:59:49.472192 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21bbc837-1a04-40b5-ab27-9cde28e5e963 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 07:59:49.485224 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a068b42-b9bd-4bfc-95d9-3ded057b317d None admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 07:59:49.494031 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.auth.core [None req-21bbc837-1a04-40b5-ab27-9cde28e5e963 None None] MFA Rules not processed for user `f0666d3a50644a7097367331c1ee1a68`. Rule list: `[]` (Enabled: `True`). {{(pid=80347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 07:59:49.495863 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-21bbc837-1a04-40b5-ab27-9cde28e5e963 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 07:59:49.529528 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a035449a-cb13-4bd2-9566-c6373b2590c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 07:59:49.530834 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a035449a-cb13-4bd2-9566-c6373b2590c1 None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 07:59:49.531557 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a035449a-cb13-4bd2-9566-c6373b2590c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 07:59:49.532422 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a035449a-cb13-4bd2-9566-c6373b2590c1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 07:59:49.541371 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a035449a-cb13-4bd2-9566-c6373b2590c1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 07:59:49.543203 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a035449a-cb13-4bd2-9566-c6373b2590c1 None admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 07:59:49.560992 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application [None req-a035449a-cb13-4bd2-9566-c6373b2590c1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 07:59:49.560992 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 07:59:49.560992 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 07:59:49.560992 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 07:59:49.560992 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 07:59:49.560992 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 07:59:49.560992 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 07:59:49.560992 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 07:59:49.560992 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 07:59:49.560992 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 07:59:49.560992 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 07:59:49.560992 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 07:59:49.560992 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 28 07:59:49.560992 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 28 07:59:49.560992 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 28 07:59:49.561913 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 28 07:59:49.561913 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 07:59:49.561913 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 07:59:49.561913 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 07:59:49.561913 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 07:59:49.561913 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 07:59:49.561913 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 07:59:49.561913 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 07:59:49.561913 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application with Lock( Jul 28 07:59:49.561913 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 07:59:49.561913 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self._enter() Jul 28 07:59:49.561913 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 07:59:49.561913 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 07:59:49.561913 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 07:59:49.561913 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.creator() Jul 28 07:59:49.561913 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 07:59:49.561913 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application created_value = creator( Jul 28 07:59:49.562775 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 28 07:59:49.562775 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 28 07:59:49.562775 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 28 07:59:49.562775 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 28 07:59:49.562775 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 28 07:59:49.562775 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 28 07:59:49.562775 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 07:59:49.562775 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application Jul 28 07:59:49.562775 dv-cinder-851351-1-smb devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 373/778] 10.222.0.42 () {56 vars in 1111 bytes} [Thu Jul 28 07:59:49 2022] GET /identity/v3/projects/service => generated 88 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 07:59:49.563253 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a035449a-cb13-4bd2-9566-c6373b2590c1 None admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 07:59:49.576718 dv-cinder-851351-1-smb devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 406/779] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 07:59:49 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 28 07:59:49.578107 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21bbc837-1a04-40b5-ab27-9cde28e5e963 None None] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 07:59:49.681434 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=100 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 07:59:49.707273 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21bbc837-1a04-40b5-ab27-9cde28e5e963 None None] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 07:59:49.709733 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a035449a-cb13-4bd2-9566-c6373b2590c1 None admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 07:59:49.716583 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 07:59:49.747239 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-424f4a6c-f02a-41bf-9c2d-acd32d0763a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 07:59:49.747513 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0bde130-3b50-4a8b-8d33-35f49f046208 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 07:59:49.747869 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0bde130-3b50-4a8b-8d33-35f49f046208 None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 07:59:49.747970 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424f4a6c-f02a-41bf-9c2d-acd32d0763a1 None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 07:59:49.748146 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424f4a6c-f02a-41bf-9c2d-acd32d0763a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 07:59:49.748249 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0bde130-3b50-4a8b-8d33-35f49f046208 None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 07:59:49.748393 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424f4a6c-f02a-41bf-9c2d-acd32d0763a1 None admin] PATH_INFO: `/v3/projects` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 07:59:49.748482 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0bde130-3b50-4a8b-8d33-35f49f046208 None admin] PATH_INFO: `/v3/services` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 07:59:49.749088 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0bde130-3b50-4a8b-8d33-35f49f046208 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 07:59:49.749182 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-424f4a6c-f02a-41bf-9c2d-acd32d0763a1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 07:59:49.749478 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-424f4a6c-f02a-41bf-9c2d-acd32d0763a1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 07:59:49.750475 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0bde130-3b50-4a8b-8d33-35f49f046208 None admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 07:59:49.750897 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-424f4a6c-f02a-41bf-9c2d-acd32d0763a1 None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 07:59:49.764954 dv-cinder-851351-1-smb devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 374/780] 10.222.0.42 () {56 vars in 1087 bytes} [Thu Jul 28 07:59:49 2022] GET /identity/v3/services => generated 772 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 07:59:49.764954 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0bde130-3b50-4a8b-8d33-35f49f046208 None admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 07:59:49.765246 dv-cinder-851351-1-smb devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 407/781] 10.222.0.42 () {56 vars in 1148 bytes} [Thu Jul 28 07:59:49 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 07:59:49.765246 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7115b7d-1194-4ebd-bda5-05e08d48f1a9 None None] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 07:59:49.765246 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7115b7d-1194-4ebd-bda5-05e08d48f1a9 None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 07:59:49.765246 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7115b7d-1194-4ebd-bda5-05e08d48f1a9 None None] PATH_INFO: `/` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 07:59:49.770883 dv-cinder-851351-1-smb devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 408/782] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 07:59:49 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 07:59:49.771872 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7115b7d-1194-4ebd-bda5-05e08d48f1a9 None None] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 07:59:49.902418 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7115b7d-1194-4ebd-bda5-05e08d48f1a9 None None] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 07:59:49.923561 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0bde130-3b50-4a8b-8d33-35f49f046208 None admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 07:59:49.946385 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07e5fed-36fa-491a-a9af-cd62c253a4e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 07:59:49.947757 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07e5fed-36fa-491a-a9af-cd62c253a4e0 None admin] REQUEST_METHOD: `PUT` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 07:59:49.947956 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07e5fed-36fa-491a-a9af-cd62c253a4e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 07:59:49.948232 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07e5fed-36fa-491a-a9af-cd62c253a4e0 None admin] PATH_INFO: `/v3/projects/139349507026497c98f360774dee737e/users/02f10880691d4fd180f96f3e40e1d25f/roles/362bd71ac01249fb8fa635381993eec1` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 07:59:49.950446 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e07e5fed-36fa-491a-a9af-cd62c253a4e0 None admin] RBAC: Authorizing `identity:create_grant(project_id=139349507026497c98f360774dee737e, user_id=02f10880691d4fd180f96f3e40e1d25f, role_id=362bd71ac01249fb8fa635381993eec1)` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 07:59:49.951893 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e07e5fed-36fa-491a-a9af-cd62c253a4e0 None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 07:59:49.969809 dv-cinder-851351-1-smb devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 409/783] 10.222.0.42 () {58 vars in 1439 bytes} [Thu Jul 28 07:59:49 2022] PUT /identity/v3/projects/139349507026497c98f360774dee737e/users/02f10880691d4fd180f96f3e40e1d25f/roles/362bd71ac01249fb8fa635381993eec1 => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 07:59:49.970970 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77802b23-594a-4d17-906b-9c89da1c4de8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 07:59:49.971684 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1948253-1504-420b-bacd-db2f6578d7e5 None None] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 07:59:49.971791 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77802b23-594a-4d17-906b-9c89da1c4de8 None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 07:59:49.971984 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77802b23-594a-4d17-906b-9c89da1c4de8 None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 07:59:49.972291 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77802b23-594a-4d17-906b-9c89da1c4de8 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 07:59:49.972652 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1948253-1504-420b-bacd-db2f6578d7e5 None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 07:59:49.973163 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1948253-1504-420b-bacd-db2f6578d7e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 07:59:49.993148 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77802b23-594a-4d17-906b-9c89da1c4de8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 07:59:49.999702 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application [None req-77802b23-594a-4d17-906b-9c89da1c4de8 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 28 07:59:49.999702 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 07:59:49.999702 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 07:59:49.999702 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 07:59:49.999702 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 07:59:49.999702 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 07:59:49.999702 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 07:59:49.999702 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 07:59:49.999702 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 07:59:49.999702 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 07:59:49.999702 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 07:59:49.999702 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 07:59:49.999702 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 07:59:49.999702 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 07:59:49.999702 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 07:59:49.999702 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 07:59:50.001042 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 07:59:50.001042 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 07:59:50.001042 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 07:59:50.001042 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 07:59:50.001042 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 07:59:50.001042 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 07:59:50.001042 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 07:59:50.001042 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 07:59:50.001042 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 07:59:50.001042 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 07:59:50.001042 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 07:59:50.001042 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application with Lock( Jul 28 07:59:50.001042 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 07:59:50.001042 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self._enter() Jul 28 07:59:50.001042 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 07:59:50.001042 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 07:59:50.001876 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 07:59:50.001876 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.creator() Jul 28 07:59:50.001876 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 07:59:50.001876 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application created_value = creator( Jul 28 07:59:50.001876 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 07:59:50.001876 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 07:59:50.001876 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 07:59:50.001876 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 07:59:50.001876 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 07:59:50.001876 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 07:59:50.001876 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 28 07:59:50.001876 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application Jul 28 07:59:50.002520 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.auth.core [None req-a1948253-1504-420b-bacd-db2f6578d7e5 None None] MFA Rules not processed for user `f0666d3a50644a7097367331c1ee1a68`. Rule list: `[]` (Enabled: `True`). {{(pid=80347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 07:59:50.002943 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-a1948253-1504-420b-bacd-db2f6578d7e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 07:59:50.004936 dv-cinder-851351-1-smb devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 375/784] 10.222.0.42 () {56 vars in 1102 bytes} [Thu Jul 28 07:59:49 2022] GET /identity/v3/roles/service => generated 85 bytes in 247 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 07:59:50.012258 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77802b23-594a-4d17-906b-9c89da1c4de8 None admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 07:59:50.017407 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=100 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 07:59:50.036622 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 07:59:50.105421 dv-cinder-851351-1-smb devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 410/785] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 07:59:49 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 07:59:50.134861 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1948253-1504-420b-bacd-db2f6578d7e5 None None] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 07:59:50.178193 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77802b23-594a-4d17-906b-9c89da1c4de8 None admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 07:59:50.253195 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8503b1b-e367-4ad0-b798-1207fa7088be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 07:59:50.253853 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8503b1b-e367-4ad0-b798-1207fa7088be None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 07:59:50.254130 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8503b1b-e367-4ad0-b798-1207fa7088be None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 07:59:50.254400 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8503b1b-e367-4ad0-b798-1207fa7088be None admin] PATH_INFO: `/v3/roles` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 07:59:50.255158 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8503b1b-e367-4ad0-b798-1207fa7088be None admin] RBAC: Adding query filter params (name=service) {{(pid=80348) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 07:59:50.255604 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8503b1b-e367-4ad0-b798-1207fa7088be None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 07:59:50.257188 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8503b1b-e367-4ad0-b798-1207fa7088be None admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 07:59:50.280019 dv-cinder-851351-1-smb devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 376/786] 10.222.0.42 () {56 vars in 1103 bytes} [Thu Jul 28 07:59:50 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 07:59:50.286629 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8503b1b-e367-4ad0-b798-1207fa7088be None admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 07:59:50.309314 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1948253-1504-420b-bacd-db2f6578d7e5 None None] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 07:59:50.351626 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccecc63b-6911-42d6-8c6e-025d97b74ffa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 07:59:50.352292 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccecc63b-6911-42d6-8c6e-025d97b74ffa None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 07:59:50.352567 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccecc63b-6911-42d6-8c6e-025d97b74ffa None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 07:59:50.352866 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccecc63b-6911-42d6-8c6e-025d97b74ffa None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 07:59:50.366951 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=100 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 07:59:50.368094 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccecc63b-6911-42d6-8c6e-025d97b74ffa None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 07:59:50.373986 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application [None req-ccecc63b-6911-42d6-8c6e-025d97b74ffa None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 07:59:50.373986 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 07:59:50.373986 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 07:59:50.373986 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 07:59:50.373986 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 07:59:50.373986 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 07:59:50.373986 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 07:59:50.373986 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 07:59:50.373986 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 07:59:50.373986 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 07:59:50.373986 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 07:59:50.373986 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 07:59:50.373986 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 07:59:50.373986 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 07:59:50.373986 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 07:59:50.373986 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 07:59:50.374963 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 07:59:50.374963 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 07:59:50.374963 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 07:59:50.374963 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 07:59:50.374963 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 07:59:50.374963 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 07:59:50.374963 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 07:59:50.374963 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 07:59:50.374963 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 07:59:50.374963 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 07:59:50.374963 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 07:59:50.374963 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application with Lock( Jul 28 07:59:50.374963 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 07:59:50.374963 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._enter() Jul 28 07:59:50.374963 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 07:59:50.374963 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 07:59:50.375782 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 07:59:50.375782 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.creator() Jul 28 07:59:50.375782 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 07:59:50.375782 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application created_value = creator( Jul 28 07:59:50.375782 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 07:59:50.375782 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 07:59:50.375782 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 07:59:50.375782 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 07:59:50.375782 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 07:59:50.375782 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 07:59:50.375782 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 07:59:50.375782 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application Jul 28 07:59:50.375782 dv-cinder-851351-1-smb devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 411/787] 10.222.0.42 () {56 vars in 1096 bytes} [Thu Jul 28 07:59:50 2022] GET /identity/v3/roles/admin => generated 83 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 07:59:50.382064 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccecc63b-6911-42d6-8c6e-025d97b74ffa None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 07:59:50.408937 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 07:59:50.422445 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8503b1b-e367-4ad0-b798-1207fa7088be None admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 07:59:50.475798 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-407e5954-6868-403f-bb6a-cba27cedae31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 07:59:50.476885 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407e5954-6868-403f-bb6a-cba27cedae31 None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 07:59:50.477330 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407e5954-6868-403f-bb6a-cba27cedae31 None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 07:59:50.477790 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407e5954-6868-403f-bb6a-cba27cedae31 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 07:59:50.504648 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-407e5954-6868-403f-bb6a-cba27cedae31 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 07:59:50.507332 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-407e5954-6868-403f-bb6a-cba27cedae31 None admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 07:59:50.511910 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccecc63b-6911-42d6-8c6e-025d97b74ffa None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 07:59:50.535178 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application [None req-407e5954-6868-403f-bb6a-cba27cedae31 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 07:59:50.535178 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 07:59:50.535178 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 07:59:50.535178 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 07:59:50.535178 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 07:59:50.535178 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 07:59:50.535178 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 07:59:50.535178 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 07:59:50.535178 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 07:59:50.535178 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 07:59:50.535178 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 07:59:50.535178 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 07:59:50.535178 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 07:59:50.535178 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 07:59:50.535178 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 07:59:50.536166 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 07:59:50.536166 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 07:59:50.536166 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 07:59:50.536166 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 07:59:50.536166 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 07:59:50.536166 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 07:59:50.536166 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 07:59:50.536166 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 07:59:50.536166 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application with Lock( Jul 28 07:59:50.536166 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 07:59:50.536166 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self._enter() Jul 28 07:59:50.536166 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 07:59:50.536166 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 07:59:50.536166 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 07:59:50.536166 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.creator() Jul 28 07:59:50.536166 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 07:59:50.536166 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application created_value = creator( Jul 28 07:59:50.537071 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 07:59:50.537071 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 07:59:50.537071 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 07:59:50.537071 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application Jul 28 07:59:50.546970 dv-cinder-851351-1-smb devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 377/788] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 07:59:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 261 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 07:59:50.548372 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-407e5954-6868-403f-bb6a-cba27cedae31 None admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 07:59:50.555248 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91da3f1a-ec2e-47ee-8a7f-a4f8af67299e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 07:59:50.555893 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91da3f1a-ec2e-47ee-8a7f-a4f8af67299e None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 07:59:50.556167 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91da3f1a-ec2e-47ee-8a7f-a4f8af67299e None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 07:59:50.556434 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91da3f1a-ec2e-47ee-8a7f-a4f8af67299e None admin] PATH_INFO: `/v3/roles` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 07:59:50.557237 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91da3f1a-ec2e-47ee-8a7f-a4f8af67299e None admin] RBAC: Adding query filter params (name=admin) {{(pid=80347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 07:59:50.557542 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91da3f1a-ec2e-47ee-8a7f-a4f8af67299e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 07:59:50.558934 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91da3f1a-ec2e-47ee-8a7f-a4f8af67299e None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 07:59:50.583531 dv-cinder-851351-1-smb devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 412/789] 10.222.0.42 () {56 vars in 1099 bytes} [Thu Jul 28 07:59:50 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 07:59:50.589687 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91da3f1a-ec2e-47ee-8a7f-a4f8af67299e None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 07:59:50.689150 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 07:59:50.711429 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91da3f1a-ec2e-47ee-8a7f-a4f8af67299e None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 07:59:50.749040 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-632e1743-9093-460d-9599-8bb48c06be28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 07:59:50.750343 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632e1743-9093-460d-9599-8bb48c06be28 None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 07:59:50.750631 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632e1743-9093-460d-9599-8bb48c06be28 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 07:59:50.750908 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632e1743-9093-460d-9599-8bb48c06be28 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 07:59:50.764149 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-632e1743-9093-460d-9599-8bb48c06be28 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 07:59:50.766693 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-632e1743-9093-460d-9599-8bb48c06be28 None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 07:59:50.784486 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application [None req-632e1743-9093-460d-9599-8bb48c06be28 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 07:59:50.784486 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 07:59:50.784486 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 07:59:50.784486 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 07:59:50.784486 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 07:59:50.784486 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 07:59:50.784486 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 07:59:50.784486 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 07:59:50.784486 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 07:59:50.784486 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 07:59:50.784486 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 07:59:50.784486 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 07:59:50.784486 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 07:59:50.784486 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 07:59:50.784486 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 07:59:50.786096 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 07:59:50.786096 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 07:59:50.786096 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 07:59:50.786096 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 07:59:50.786096 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 07:59:50.786096 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 07:59:50.786096 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 07:59:50.786096 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 07:59:50.786096 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application with Lock( Jul 28 07:59:50.786096 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 07:59:50.786096 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._enter() Jul 28 07:59:50.786096 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 07:59:50.786096 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 07:59:50.786096 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 07:59:50.786096 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.creator() Jul 28 07:59:50.786096 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 07:59:50.786096 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application created_value = creator( Jul 28 07:59:50.787469 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 07:59:50.787469 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 07:59:50.787469 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 07:59:50.787469 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application Jul 28 07:59:50.787469 dv-cinder-851351-1-smb devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 413/790] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 07:59:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 07:59:50.794168 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-632e1743-9093-460d-9599-8bb48c06be28 None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 07:59:50.803418 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-407e5954-6868-403f-bb6a-cba27cedae31 None admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 07:59:50.826700 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=100 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 07:59:50.854395 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4054e0c3-4fce-4e03-a8ae-2d4b24c5d3a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 07:59:50.855496 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4054e0c3-4fce-4e03-a8ae-2d4b24c5d3a8 None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 07:59:50.856246 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4054e0c3-4fce-4e03-a8ae-2d4b24c5d3a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 07:59:50.857126 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4054e0c3-4fce-4e03-a8ae-2d4b24c5d3a8 None admin] PATH_INFO: `/v3/domains` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 07:59:50.860276 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4054e0c3-4fce-4e03-a8ae-2d4b24c5d3a8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80348) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 07:59:50.860896 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4054e0c3-4fce-4e03-a8ae-2d4b24c5d3a8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 07:59:50.864059 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4054e0c3-4fce-4e03-a8ae-2d4b24c5d3a8 None admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 07:59:50.899328 dv-cinder-851351-1-smb devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 378/791] 10.222.0.42 () {56 vars in 1109 bytes} [Thu Jul 28 07:59:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 351 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 07:59:50.907594 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4054e0c3-4fce-4e03-a8ae-2d4b24c5d3a8 None admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 07:59:50.978833 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-632e1743-9093-460d-9599-8bb48c06be28 None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 07:59:51.023891 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 07:59:51.036383 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef24ef51-a64c-4de4-bdc2-7b3024e550c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 07:59:51.038512 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef24ef51-a64c-4de4-bdc2-7b3024e550c8 None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 07:59:51.040111 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef24ef51-a64c-4de4-bdc2-7b3024e550c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 07:59:51.045567 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef24ef51-a64c-4de4-bdc2-7b3024e550c8 None admin] PATH_INFO: `/v3/domains` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 07:59:51.046746 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef24ef51-a64c-4de4-bdc2-7b3024e550c8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 07:59:51.047291 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef24ef51-a64c-4de4-bdc2-7b3024e550c8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 07:59:51.048905 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef24ef51-a64c-4de4-bdc2-7b3024e550c8 None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 07:59:51.071264 dv-cinder-851351-1-smb devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 414/792] 10.222.0.42 () {56 vars in 1109 bytes} [Thu Jul 28 07:59:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 07:59:51.076715 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef24ef51-a64c-4de4-bdc2-7b3024e550c8 None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 07:59:51.185150 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4054e0c3-4fce-4e03-a8ae-2d4b24c5d3a8 None admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 07:59:51.221159 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef24ef51-a64c-4de4-bdc2-7b3024e550c8 None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 07:59:51.223045 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ee46aa-3eb6-48fe-8cbe-b56af2a1fe02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 07:59:51.223783 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ee46aa-3eb6-48fe-8cbe-b56af2a1fe02 None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 07:59:51.224124 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ee46aa-3eb6-48fe-8cbe-b56af2a1fe02 None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 07:59:51.224462 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ee46aa-3eb6-48fe-8cbe-b56af2a1fe02 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 07:59:51.232625 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82ee46aa-3eb6-48fe-8cbe-b56af2a1fe02 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 07:59:51.234228 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82ee46aa-3eb6-48fe-8cbe-b56af2a1fe02 None admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 07:59:51.249831 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application [None req-82ee46aa-3eb6-48fe-8cbe-b56af2a1fe02 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 28 07:59:51.249831 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 07:59:51.249831 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 07:59:51.249831 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 07:59:51.249831 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 07:59:51.249831 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 07:59:51.249831 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 07:59:51.249831 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 07:59:51.249831 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 07:59:51.249831 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 07:59:51.249831 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 07:59:51.249831 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 07:59:51.249831 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 28 07:59:51.249831 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 28 07:59:51.249831 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 28 07:59:51.249831 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 28 07:59:51.250850 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 07:59:51.250850 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 07:59:51.250850 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 28 07:59:51.250850 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 07:59:51.250850 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 28 07:59:51.250850 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 07:59:51.250850 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 07:59:51.250850 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 07:59:51.250850 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 07:59:51.250850 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 07:59:51.250850 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 07:59:51.250850 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application with Lock( Jul 28 07:59:51.250850 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 07:59:51.250850 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self._enter() Jul 28 07:59:51.250850 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 07:59:51.250850 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 07:59:51.250850 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 07:59:51.250850 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.creator() Jul 28 07:59:51.251770 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 07:59:51.251770 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application created_value = creator( Jul 28 07:59:51.251770 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 28 07:59:51.251770 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 28 07:59:51.251770 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 28 07:59:51.251770 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 28 07:59:51.251770 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 28 07:59:51.251770 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 28 07:59:51.251770 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 28 07:59:51.251770 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application Jul 28 07:59:51.251770 dv-cinder-851351-1-smb devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 379/793] 10.222.0.42 () {56 vars in 1117 bytes} [Thu Jul 28 07:59:50 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 344 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 07:59:51.257268 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9cdb73-2563-4611-b5f1-6bb1fcfd1973 None None] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 07:59:51.257268 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9cdb73-2563-4611-b5f1-6bb1fcfd1973 None None] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 07:59:51.257268 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9cdb73-2563-4611-b5f1-6bb1fcfd1973 None None] PATH_INFO: `/` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 07:59:51.259880 dv-cinder-851351-1-smb devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 380/794] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 07:59:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 07:59:51.261566 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9cdb73-2563-4611-b5f1-6bb1fcfd1973 None None] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 07:59:51.278206 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6276f6-71a8-4708-813d-cf6d9a4d250f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 07:59:51.279220 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6276f6-71a8-4708-813d-cf6d9a4d250f None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 07:59:51.279668 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6276f6-71a8-4708-813d-cf6d9a4d250f None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 07:59:51.280147 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6276f6-71a8-4708-813d-cf6d9a4d250f None admin] PATH_INFO: `/v3/users/swift` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 07:59:51.290868 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d6276f6-71a8-4708-813d-cf6d9a4d250f None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 07:59:51.294484 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d6276f6-71a8-4708-813d-cf6d9a4d250f None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 07:59:51.310829 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=100 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 07:59:51.318058 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application [None req-2d6276f6-71a8-4708-813d-cf6d9a4d250f None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 28 07:59:51.318058 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 07:59:51.318058 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 07:59:51.318058 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 07:59:51.318058 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 07:59:51.318058 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 07:59:51.318058 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 07:59:51.318058 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 07:59:51.318058 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 07:59:51.318058 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 07:59:51.318058 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 07:59:51.318058 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 07:59:51.318058 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 28 07:59:51.318058 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 28 07:59:51.318058 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 28 07:59:51.318058 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 28 07:59:51.319057 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 07:59:51.319057 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 07:59:51.319057 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 28 07:59:51.319057 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 07:59:51.319057 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 28 07:59:51.319057 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 07:59:51.319057 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 07:59:51.319057 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 07:59:51.319057 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 07:59:51.319057 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 07:59:51.319057 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 07:59:51.319057 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application with Lock( Jul 28 07:59:51.319057 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 07:59:51.319057 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._enter() Jul 28 07:59:51.319057 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 07:59:51.319057 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 07:59:51.319057 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 07:59:51.319057 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.creator() Jul 28 07:59:51.319970 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 07:59:51.319970 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application created_value = creator( Jul 28 07:59:51.319970 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 28 07:59:51.319970 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 28 07:59:51.319970 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 28 07:59:51.319970 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 28 07:59:51.319970 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 28 07:59:51.319970 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 28 07:59:51.319970 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 28 07:59:51.319970 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application Jul 28 07:59:51.322918 dv-cinder-851351-1-smb devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 415/795] 10.222.0.42 () {56 vars in 1096 bytes} [Thu Jul 28 07:59:51 2022] GET /identity/v3/users/swift => generated 83 bytes in 247 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 07:59:51.324315 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fffe81bf-a47a-452d-b518-6b9ba9dbfddd None None] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 07:59:51.324763 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fffe81bf-a47a-452d-b518-6b9ba9dbfddd None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 07:59:51.325154 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fffe81bf-a47a-452d-b518-6b9ba9dbfddd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 07:59:51.347612 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.auth.core [None req-fffe81bf-a47a-452d-b518-6b9ba9dbfddd None None] MFA Rules not processed for user `f0666d3a50644a7097367331c1ee1a68`. Rule list: `[]` (Enabled: `True`). {{(pid=80347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 07:59:51.349433 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-fffe81bf-a47a-452d-b518-6b9ba9dbfddd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 07:59:51.418522 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 07:59:51.431570 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9cdb73-2563-4611-b5f1-6bb1fcfd1973 None None] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 07:59:51.452923 dv-cinder-851351-1-smb devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 416/796] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 07:59:51 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 07:59:51.454366 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fffe81bf-a47a-452d-b518-6b9ba9dbfddd None None] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 07:59:51.494322 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52aea08e-c137-4f90-94a0-0712d01224f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 07:59:51.495109 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52aea08e-c137-4f90-94a0-0712d01224f5 None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 07:59:51.495495 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52aea08e-c137-4f90-94a0-0712d01224f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 07:59:51.495870 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52aea08e-c137-4f90-94a0-0712d01224f5 None admin] PATH_INFO: `/v3/users` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 07:59:51.496894 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52aea08e-c137-4f90-94a0-0712d01224f5 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80348) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 07:59:51.497476 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52aea08e-c137-4f90-94a0-0712d01224f5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 07:59:51.499111 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52aea08e-c137-4f90-94a0-0712d01224f5 None admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 07:59:51.531949 dv-cinder-851351-1-smb devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 381/797] 10.222.0.42 () {56 vars in 1149 bytes} [Thu Jul 28 07:59:51 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 07:59:51.534672 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52aea08e-c137-4f90-94a0-0712d01224f5 None admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 07:59:51.607541 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fffe81bf-a47a-452d-b518-6b9ba9dbfddd None None] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 07:59:51.648336 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8050c214-4a8e-4abf-8dd9-f2805e5973a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 07:59:51.648999 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8050c214-4a8e-4abf-8dd9-f2805e5973a1 None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 07:59:51.649276 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8050c214-4a8e-4abf-8dd9-f2805e5973a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 07:59:51.649548 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8050c214-4a8e-4abf-8dd9-f2805e5973a1 None admin] PATH_INFO: `/v3/users` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 07:59:51.650478 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8050c214-4a8e-4abf-8dd9-f2805e5973a1 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 07:59:51.650895 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8050c214-4a8e-4abf-8dd9-f2805e5973a1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 07:59:51.652462 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8050c214-4a8e-4abf-8dd9-f2805e5973a1 None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 07:59:51.669618 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=100 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 07:59:51.675155 dv-cinder-851351-1-smb devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 417/798] 10.222.0.42 () {56 vars in 1135 bytes} [Thu Jul 28 07:59:51 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 07:59:51.676259 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8050c214-4a8e-4abf-8dd9-f2805e5973a1 None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 07:59:51.677988 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52aea08e-c137-4f90-94a0-0712d01224f5 None admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 07:59:51.718796 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db380f7c-91dd-4caf-bf7f-865f5bb8ebdd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 07:59:51.719904 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db380f7c-91dd-4caf-bf7f-865f5bb8ebdd None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 07:59:51.720380 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db380f7c-91dd-4caf-bf7f-865f5bb8ebdd None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 07:59:51.720899 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db380f7c-91dd-4caf-bf7f-865f5bb8ebdd None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 07:59:51.721760 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db380f7c-91dd-4caf-bf7f-865f5bb8ebdd None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 07:59:51.723361 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db380f7c-91dd-4caf-bf7f-865f5bb8ebdd None admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 07:59:51.725202 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 07:59:51.735801 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application [None req-db380f7c-91dd-4caf-bf7f-865f5bb8ebdd None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 28 07:59:51.735801 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 07:59:51.735801 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 28 07:59:51.735801 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 28 07:59:51.735801 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 28 07:59:51.735801 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 28 07:59:51.735801 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 28 07:59:51.735801 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 07:59:51.735801 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 28 07:59:51.735801 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application Jul 28 07:59:51.735801 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 28 07:59:51.735801 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application Jul 28 07:59:51.735801 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 07:59:51.735801 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 07:59:51.735801 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 07:59:51.735801 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 07:59:51.736852 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 07:59:51.736852 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 07:59:51.736852 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 07:59:51.736852 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 07:59:51.736852 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 07:59:51.736852 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 07:59:51.736852 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 07:59:51.736852 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 28 07:59:51.736852 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 28 07:59:51.736852 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 28 07:59:51.736852 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 28 07:59:51.736852 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 07:59:51.736852 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 07:59:51.736852 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 07:59:51.736852 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 07:59:51.736852 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 07:59:51.737664 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 07:59:51.737664 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 07:59:51.737664 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application with Lock( Jul 28 07:59:51.737664 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 07:59:51.737664 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self._enter() Jul 28 07:59:51.737664 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 07:59:51.737664 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 07:59:51.737664 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 07:59:51.737664 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.creator() Jul 28 07:59:51.737664 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 07:59:51.737664 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application created_value = creator( Jul 28 07:59:51.737664 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 28 07:59:51.737664 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 07:59:51.737664 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 28 07:59:51.737664 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application Jul 28 07:59:51.740790 dv-cinder-851351-1-smb devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 382/799] 10.222.0.42 () {56 vars in 1129 bytes} [Thu Jul 28 07:59:51 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 07:59:51.742020 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db380f7c-91dd-4caf-bf7f-865f5bb8ebdd None admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 07:59:51.798797 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8050c214-4a8e-4abf-8dd9-f2805e5973a1 None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 07:59:51.854394 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec8406f-cf08-4bf6-8e4a-4e8dc2e84ea5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 07:59:51.855679 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec8406f-cf08-4bf6-8e4a-4e8dc2e84ea5 None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 07:59:51.856158 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec8406f-cf08-4bf6-8e4a-4e8dc2e84ea5 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 07:59:51.856766 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db380f7c-91dd-4caf-bf7f-865f5bb8ebdd None admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 07:59:51.856879 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec8406f-cf08-4bf6-8e4a-4e8dc2e84ea5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 07:59:51.879078 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bec8406f-cf08-4bf6-8e4a-4e8dc2e84ea5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 07:59:51.881954 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bec8406f-cf08-4bf6-8e4a-4e8dc2e84ea5 None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 07:59:51.895125 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6edd661d-6d38-4b20-897a-8df515c152ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 07:59:51.896157 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6edd661d-6d38-4b20-897a-8df515c152ec None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 07:59:51.896793 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6edd661d-6d38-4b20-897a-8df515c152ec None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 07:59:51.897268 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6edd661d-6d38-4b20-897a-8df515c152ec None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 07:59:51.907567 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application [None req-bec8406f-cf08-4bf6-8e4a-4e8dc2e84ea5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 07:59:51.907567 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 07:59:51.907567 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 07:59:51.907567 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 07:59:51.907567 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 07:59:51.907567 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 07:59:51.907567 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 07:59:51.907567 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 07:59:51.907567 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 07:59:51.907567 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 07:59:51.907567 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 07:59:51.907567 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 07:59:51.907567 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 07:59:51.907567 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 07:59:51.907567 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 07:59:51.909216 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 07:59:51.909216 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 07:59:51.909216 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 07:59:51.909216 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 07:59:51.909216 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 07:59:51.909216 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 07:59:51.909216 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 07:59:51.909216 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 07:59:51.909216 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application with Lock( Jul 28 07:59:51.909216 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 07:59:51.909216 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._enter() Jul 28 07:59:51.909216 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 07:59:51.909216 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 07:59:51.909216 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 07:59:51.909216 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.creator() Jul 28 07:59:51.909216 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 07:59:51.909216 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application created_value = creator( Jul 28 07:59:51.910223 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 07:59:51.910223 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 07:59:51.910223 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 07:59:51.910223 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application Jul 28 07:59:51.910223 dv-cinder-851351-1-smb devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 418/800] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 07:59:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 07:59:51.910223 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec8406f-cf08-4bf6-8e4a-4e8dc2e84ea5 None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 07:59:51.916716 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6edd661d-6d38-4b20-897a-8df515c152ec None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 07:59:51.919807 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6edd661d-6d38-4b20-897a-8df515c152ec None admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 07:59:51.952874 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application [None req-6edd661d-6d38-4b20-897a-8df515c152ec None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 07:59:51.952874 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 07:59:51.952874 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 07:59:51.952874 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 07:59:51.952874 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 07:59:51.952874 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 07:59:51.952874 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 07:59:51.952874 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 07:59:51.952874 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 07:59:51.952874 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 07:59:51.952874 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 07:59:51.952874 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 07:59:51.952874 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 07:59:51.952874 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 07:59:51.952874 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 07:59:51.954981 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 07:59:51.954981 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 07:59:51.954981 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 07:59:51.954981 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 07:59:51.954981 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 07:59:51.954981 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 07:59:51.954981 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 07:59:51.954981 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 07:59:51.954981 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application with Lock( Jul 28 07:59:51.954981 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 07:59:51.954981 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self._enter() Jul 28 07:59:51.954981 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 07:59:51.954981 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 07:59:51.954981 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 07:59:51.954981 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.creator() Jul 28 07:59:51.954981 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 07:59:51.954981 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application created_value = creator( Jul 28 07:59:51.956703 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 07:59:51.956703 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 07:59:51.956703 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 07:59:51.956703 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application Jul 28 07:59:51.961363 dv-cinder-851351-1-smb devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 383/801] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 07:59:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 07:59:51.963874 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6edd661d-6d38-4b20-897a-8df515c152ec None admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 07:59:51.996206 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=100 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 07:59:52.044681 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 07:59:52.058184 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec8406f-cf08-4bf6-8e4a-4e8dc2e84ea5 None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 07:59:52.111865 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6edd661d-6d38-4b20-897a-8df515c152ec None admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 07:59:52.122249 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f40f35-6b4b-45e3-89e1-51d227a66c1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 07:59:52.123331 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f40f35-6b4b-45e3-89e1-51d227a66c1a None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 07:59:52.123818 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f40f35-6b4b-45e3-89e1-51d227a66c1a None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 07:59:52.124310 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f40f35-6b4b-45e3-89e1-51d227a66c1a None admin] PATH_INFO: `/v3/services` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 07:59:52.125622 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f40f35-6b4b-45e3-89e1-51d227a66c1a None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 07:59:52.126245 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f40f35-6b4b-45e3-89e1-51d227a66c1a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 07:59:52.128983 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f40f35-6b4b-45e3-89e1-51d227a66c1a None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 07:59:52.145655 dv-cinder-851351-1-smb devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 419/802] 10.222.0.42 () {56 vars in 1124 bytes} [Thu Jul 28 07:59:51 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 07:59:52.147316 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f40f35-6b4b-45e3-89e1-51d227a66c1a None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 07:59:52.148718 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a61857-8393-47c5-88d0-600e7c904b3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 07:59:52.149964 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a61857-8393-47c5-88d0-600e7c904b3e None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 07:59:52.150580 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a61857-8393-47c5-88d0-600e7c904b3e None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 07:59:52.150998 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a61857-8393-47c5-88d0-600e7c904b3e None admin] PATH_INFO: `/v3/domains` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 07:59:52.152089 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5a61857-8393-47c5-88d0-600e7c904b3e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80348) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 07:59:52.152594 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5a61857-8393-47c5-88d0-600e7c904b3e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 07:59:52.154186 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5a61857-8393-47c5-88d0-600e7c904b3e None admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 07:59:52.175204 dv-cinder-851351-1-smb devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 384/803] 10.222.0.42 () {56 vars in 1109 bytes} [Thu Jul 28 07:59:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 07:59:52.176784 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9747bd-63e5-4206-ac7f-c9d83cd1dff1 None None] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 07:59:52.177128 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9747bd-63e5-4206-ac7f-c9d83cd1dff1 None None] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 07:59:52.177463 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9747bd-63e5-4206-ac7f-c9d83cd1dff1 None None] PATH_INFO: `/` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 07:59:52.178914 dv-cinder-851351-1-smb devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 385/804] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 07:59:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 07:59:52.183053 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9747bd-63e5-4206-ac7f-c9d83cd1dff1 None None] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 07:59:52.290214 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f40f35-6b4b-45e3-89e1-51d227a66c1a None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 07:59:52.291681 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=100 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 07:59:52.342197 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9747bd-63e5-4206-ac7f-c9d83cd1dff1 None None] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 07:59:52.343072 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba76212-e80d-4fec-9e7b-cefebb96152d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 07:59:52.344042 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba76212-e80d-4fec-9e7b-cefebb96152d None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 07:59:52.344475 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba76212-e80d-4fec-9e7b-cefebb96152d None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 07:59:52.344943 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba76212-e80d-4fec-9e7b-cefebb96152d None admin] PATH_INFO: `/v3/domains` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 07:59:52.346130 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba76212-e80d-4fec-9e7b-cefebb96152d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 07:59:52.346639 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba76212-e80d-4fec-9e7b-cefebb96152d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 07:59:52.349045 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba76212-e80d-4fec-9e7b-cefebb96152d None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 07:59:52.368879 dv-cinder-851351-1-smb devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 420/805] 10.222.0.42 () {56 vars in 1109 bytes} [Thu Jul 28 07:59:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 07:59:52.370257 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba76212-e80d-4fec-9e7b-cefebb96152d None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 07:59:52.391615 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 07:59:52.397186 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d90b64-6659-419a-8b44-15110a47cd10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 07:59:52.397850 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d90b64-6659-419a-8b44-15110a47cd10 None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 07:59:52.398128 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d90b64-6659-419a-8b44-15110a47cd10 None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 07:59:52.398400 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d90b64-6659-419a-8b44-15110a47cd10 None admin] PATH_INFO: `/v3/services` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 07:59:52.399108 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d90b64-6659-419a-8b44-15110a47cd10 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80348) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 07:59:52.399406 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d90b64-6659-419a-8b44-15110a47cd10 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 07:59:52.401623 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d90b64-6659-419a-8b44-15110a47cd10 None admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 07:59:52.416769 dv-cinder-851351-1-smb devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 386/806] 10.222.0.42 () {56 vars in 1124 bytes} [Thu Jul 28 07:59:52 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 07:59:52.416769 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04b20fb-7ced-4da9-9e73-7f119392c098 None None] REQUEST_METHOD: `POST` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 07:59:52.416769 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04b20fb-7ced-4da9-9e73-7f119392c098 None None] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 07:59:52.416769 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04b20fb-7ced-4da9-9e73-7f119392c098 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 07:59:52.432573 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.auth.core [None req-a04b20fb-7ced-4da9-9e73-7f119392c098 None None] MFA Rules not processed for user `f0666d3a50644a7097367331c1ee1a68`. Rule list: `[]` (Enabled: `True`). {{(pid=80348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 07:59:52.433844 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.fernet_utils [None req-a04b20fb-7ced-4da9-9e73-7f119392c098 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 07:59:52.504893 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba76212-e80d-4fec-9e7b-cefebb96152d None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 07:59:52.522496 dv-cinder-851351-1-smb devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 387/807] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 07:59:52 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 07:59:52.526779 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a04b20fb-7ced-4da9-9e73-7f119392c098 None None] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 07:59:52.551624 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb108fef-fe5c-457f-b800-3c94d248d633 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 07:59:52.552610 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb108fef-fe5c-457f-b800-3c94d248d633 None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 07:59:52.553084 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb108fef-fe5c-457f-b800-3c94d248d633 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 07:59:52.553530 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb108fef-fe5c-457f-b800-3c94d248d633 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 07:59:52.564617 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb108fef-fe5c-457f-b800-3c94d248d633 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 07:59:52.566877 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb108fef-fe5c-457f-b800-3c94d248d633 None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 07:59:52.587916 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application [None req-cb108fef-fe5c-457f-b800-3c94d248d633 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 07:59:52.587916 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 07:59:52.587916 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 07:59:52.587916 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 07:59:52.587916 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 07:59:52.587916 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 07:59:52.587916 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 07:59:52.587916 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 07:59:52.587916 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 07:59:52.587916 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 07:59:52.587916 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 07:59:52.587916 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 07:59:52.587916 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 28 07:59:52.587916 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 28 07:59:52.587916 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 28 07:59:52.589981 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 28 07:59:52.589981 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 07:59:52.589981 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 07:59:52.589981 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 07:59:52.589981 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 07:59:52.589981 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 07:59:52.589981 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 07:59:52.589981 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 07:59:52.589981 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application with Lock( Jul 28 07:59:52.589981 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 07:59:52.589981 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._enter() Jul 28 07:59:52.589981 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 07:59:52.589981 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 07:59:52.589981 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 07:59:52.589981 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.creator() Jul 28 07:59:52.589981 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 07:59:52.589981 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application created_value = creator( Jul 28 07:59:52.592029 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 28 07:59:52.592029 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 28 07:59:52.592029 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 28 07:59:52.592029 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 28 07:59:52.592029 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 28 07:59:52.592029 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 28 07:59:52.592029 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 07:59:52.592029 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application Jul 28 07:59:52.596505 dv-cinder-851351-1-smb devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 421/808] 10.222.0.42 () {56 vars in 1111 bytes} [Thu Jul 28 07:59:52 2022] GET /identity/v3/projects/service => generated 88 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 07:59:52.597247 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb108fef-fe5c-457f-b800-3c94d248d633 None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 07:59:52.628136 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=100 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 07:59:52.673158 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a04b20fb-7ced-4da9-9e73-7f119392c098 None None] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 07:59:52.693594 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 07:59:52.719284 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d66b477-225e-4dde-be0f-7da813c9d4fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 07:59:52.719967 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d66b477-225e-4dde-be0f-7da813c9d4fe None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 07:59:52.720233 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d66b477-225e-4dde-be0f-7da813c9d4fe None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 07:59:52.720498 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d66b477-225e-4dde-be0f-7da813c9d4fe None admin] PATH_INFO: `/v3/projects/service` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 07:59:52.722540 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb108fef-fe5c-457f-b800-3c94d248d633 None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 07:59:52.728156 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d66b477-225e-4dde-be0f-7da813c9d4fe None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 07:59:52.729730 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d66b477-225e-4dde-be0f-7da813c9d4fe None admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 07:59:52.744017 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application [None req-0d66b477-225e-4dde-be0f-7da813c9d4fe None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 07:59:52.744017 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 07:59:52.744017 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 07:59:52.744017 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 07:59:52.744017 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 07:59:52.744017 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 07:59:52.744017 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 07:59:52.744017 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 07:59:52.744017 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 07:59:52.744017 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 07:59:52.744017 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 07:59:52.744017 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 07:59:52.744017 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 28 07:59:52.744017 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 28 07:59:52.744017 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 28 07:59:52.745806 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 28 07:59:52.745806 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 07:59:52.745806 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 07:59:52.745806 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 07:59:52.745806 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 07:59:52.745806 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 07:59:52.745806 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 07:59:52.745806 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 07:59:52.745806 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application with Lock( Jul 28 07:59:52.745806 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 07:59:52.745806 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self._enter() Jul 28 07:59:52.745806 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 07:59:52.745806 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 07:59:52.745806 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 07:59:52.745806 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.creator() Jul 28 07:59:52.745806 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 07:59:52.745806 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application created_value = creator( Jul 28 07:59:52.746854 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 28 07:59:52.746854 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 28 07:59:52.746854 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 28 07:59:52.746854 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 28 07:59:52.746854 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 28 07:59:52.746854 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 28 07:59:52.746854 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 07:59:52.746854 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application Jul 28 07:59:52.746854 dv-cinder-851351-1-smb devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 388/809] 10.222.0.42 () {56 vars in 1111 bytes} [Thu Jul 28 07:59:52 2022] GET /identity/v3/projects/service => generated 88 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 07:59:52.746854 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a3af3a-374f-4d68-aa39-2d43cc535a90 None None] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 07:59:52.747406 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a3af3a-374f-4d68-aa39-2d43cc535a90 None None] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 07:59:52.747406 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a3af3a-374f-4d68-aa39-2d43cc535a90 None None] PATH_INFO: `/` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 07:59:52.748690 dv-cinder-851351-1-smb devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 389/810] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 07:59:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 07:59:52.749415 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a3af3a-374f-4d68-aa39-2d43cc535a90 None None] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 07:59:52.764723 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b5240a1-4892-4afa-b11b-c999639f3d99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 07:59:52.765353 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5240a1-4892-4afa-b11b-c999639f3d99 None admin] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 07:59:52.765624 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5240a1-4892-4afa-b11b-c999639f3d99 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 07:59:52.765899 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5240a1-4892-4afa-b11b-c999639f3d99 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 07:59:52.766617 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b5240a1-4892-4afa-b11b-c999639f3d99 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 07:59:52.767996 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b5240a1-4892-4afa-b11b-c999639f3d99 None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 07:59:52.792987 dv-cinder-851351-1-smb devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 422/811] 10.222.0.42 () {60 vars in 1144 bytes} [Thu Jul 28 07:59:52 2022] POST /identity/v3/endpoints => generated 346 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 07:59:52.793863 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b5240a1-4892-4afa-b11b-c999639f3d99 None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 07:59:52.917957 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a3af3a-374f-4d68-aa39-2d43cc535a90 None None] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 07:59:52.929390 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b5240a1-4892-4afa-b11b-c999639f3d99 None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 07:59:52.944317 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=100 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 07:59:52.963689 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b5b98c-8814-43bd-9886-3f7947aec485 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 07:59:52.964365 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b5b98c-8814-43bd-9886-3f7947aec485 None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 07:59:52.964641 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b5b98c-8814-43bd-9886-3f7947aec485 None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 07:59:52.964937 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b5b98c-8814-43bd-9886-3f7947aec485 None admin] PATH_INFO: `/v3/services/network` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 07:59:52.965579 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76b5b98c-8814-43bd-9886-3f7947aec485 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 07:59:52.966968 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76b5b98c-8814-43bd-9886-3f7947aec485 None admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 07:59:52.976092 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 07:59:52.979399 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application [None req-76b5b98c-8814-43bd-9886-3f7947aec485 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jul 28 07:59:52.979399 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 07:59:52.979399 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 28 07:59:52.979399 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 28 07:59:52.979399 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 28 07:59:52.979399 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 28 07:59:52.979399 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 28 07:59:52.979399 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 07:59:52.979399 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 28 07:59:52.979399 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application Jul 28 07:59:52.979399 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 28 07:59:52.979399 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application Jul 28 07:59:52.979399 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 07:59:52.979399 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 07:59:52.979399 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 07:59:52.979399 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 07:59:52.979399 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 07:59:52.981364 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 07:59:52.981364 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 07:59:52.981364 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 07:59:52.981364 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 07:59:52.981364 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 07:59:52.981364 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 07:59:52.981364 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 28 07:59:52.981364 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 28 07:59:52.981364 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 28 07:59:52.981364 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 28 07:59:52.981364 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 07:59:52.981364 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 07:59:52.981364 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 07:59:52.981364 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 07:59:52.981364 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 07:59:52.981364 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 07:59:52.983618 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 07:59:52.983618 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application with Lock( Jul 28 07:59:52.983618 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 07:59:52.983618 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self._enter() Jul 28 07:59:52.983618 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 07:59:52.983618 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 07:59:52.983618 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 07:59:52.983618 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.creator() Jul 28 07:59:52.983618 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 07:59:52.983618 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application created_value = creator( Jul 28 07:59:52.983618 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 28 07:59:52.983618 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 07:59:52.983618 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 28 07:59:52.983618 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application Jul 28 07:59:52.983618 dv-cinder-851351-1-smb devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 390/812] 10.222.0.42 () {56 vars in 1111 bytes} [Thu Jul 28 07:59:52 2022] GET /identity/v3/services/network => generated 88 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 07:59:52.984421 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b5b98c-8814-43bd-9886-3f7947aec485 None admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 07:59:52.993883 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38fbc288-77a6-49ab-aa9d-3d82d60c8b71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 07:59:52.996514 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38fbc288-77a6-49ab-aa9d-3d82d60c8b71 None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 07:59:52.996514 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38fbc288-77a6-49ab-aa9d-3d82d60c8b71 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 07:59:52.996514 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38fbc288-77a6-49ab-aa9d-3d82d60c8b71 None admin] PATH_INFO: `/v3/projects` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 07:59:52.996918 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38fbc288-77a6-49ab-aa9d-3d82d60c8b71 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 07:59:52.997229 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38fbc288-77a6-49ab-aa9d-3d82d60c8b71 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 07:59:52.998705 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38fbc288-77a6-49ab-aa9d-3d82d60c8b71 None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 07:59:53.016313 dv-cinder-851351-1-smb devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 423/813] 10.222.0.42 () {56 vars in 1148 bytes} [Thu Jul 28 07:59:52 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 07:59:53.017779 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a362d474-b3ef-4232-b619-1c4127d0e415 None None] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 07:59:53.018065 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a362d474-b3ef-4232-b619-1c4127d0e415 None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 07:59:53.018366 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a362d474-b3ef-4232-b619-1c4127d0e415 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 07:59:53.048909 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.auth.core [None req-a362d474-b3ef-4232-b619-1c4127d0e415 None None] MFA Rules not processed for user `f0666d3a50644a7097367331c1ee1a68`. Rule list: `[]` (Enabled: `True`). {{(pid=80347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 07:59:53.050123 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-a362d474-b3ef-4232-b619-1c4127d0e415 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 07:59:53.114054 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b5b98c-8814-43bd-9886-3f7947aec485 None admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 07:59:53.124621 dv-cinder-851351-1-smb devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 424/814] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 07:59:53 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 07:59:53.125523 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a362d474-b3ef-4232-b619-1c4127d0e415 None None] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 07:59:53.178812 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3607642f-c0cd-4c45-b132-7e71b73089b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 07:59:53.179448 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3607642f-c0cd-4c45-b132-7e71b73089b3 None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 07:59:53.179726 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3607642f-c0cd-4c45-b132-7e71b73089b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 07:59:53.179993 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3607642f-c0cd-4c45-b132-7e71b73089b3 None admin] PATH_INFO: `/v3/projects` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 07:59:53.180904 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3607642f-c0cd-4c45-b132-7e71b73089b3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80348) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 07:59:53.181663 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3607642f-c0cd-4c45-b132-7e71b73089b3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 07:59:53.184230 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3607642f-c0cd-4c45-b132-7e71b73089b3 None admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 07:59:53.198806 dv-cinder-851351-1-smb devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 391/815] 10.222.0.42 () {56 vars in 1148 bytes} [Thu Jul 28 07:59:52 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 07:59:53.199475 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3607642f-c0cd-4c45-b132-7e71b73089b3 None admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 07:59:53.252262 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=100 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 07:59:53.252477 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a362d474-b3ef-4232-b619-1c4127d0e415 None None] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 07:59:53.277450 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 07:59:53.294331 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f0aea2-225e-4477-8cd7-71da5fe828fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 07:59:53.294974 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f0aea2-225e-4477-8cd7-71da5fe828fc None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 07:59:53.295255 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f0aea2-225e-4477-8cd7-71da5fe828fc None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 07:59:53.295529 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f0aea2-225e-4477-8cd7-71da5fe828fc None admin] PATH_INFO: `/v3/services` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 07:59:53.296231 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6f0aea2-225e-4477-8cd7-71da5fe828fc None admin] RBAC: Adding query filter params (name=network) {{(pid=80347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 07:59:53.296533 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6f0aea2-225e-4477-8cd7-71da5fe828fc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 07:59:53.297978 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6f0aea2-225e-4477-8cd7-71da5fe828fc None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 07:59:53.309112 dv-cinder-851351-1-smb devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 425/816] 10.222.0.42 () {56 vars in 1112 bytes} [Thu Jul 28 07:59:53 2022] GET /identity/v3/services?name=network => generated 124 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 07:59:53.309112 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f0aea2-225e-4477-8cd7-71da5fe828fc None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 07:59:53.351909 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3607642f-c0cd-4c45-b132-7e71b73089b3 None admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 07:59:53.390536 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da41780-8ac6-4d25-805e-a9f5a8f5e3f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 07:59:53.391229 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da41780-8ac6-4d25-805e-a9f5a8f5e3f1 None admin] REQUEST_METHOD: `PUT` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 07:59:53.391506 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da41780-8ac6-4d25-805e-a9f5a8f5e3f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 07:59:53.391779 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da41780-8ac6-4d25-805e-a9f5a8f5e3f1 None admin] PATH_INFO: `/v3/projects/139349507026497c98f360774dee737e/users/4a92b0d2802e46f4beffaaf39ed6723c/roles/a2d02bc3295c4a33b1fc0775a17a79e6` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 07:59:53.407608 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4da41780-8ac6-4d25-805e-a9f5a8f5e3f1 None admin] RBAC: Authorizing `identity:create_grant(project_id=139349507026497c98f360774dee737e, user_id=4a92b0d2802e46f4beffaaf39ed6723c, role_id=a2d02bc3295c4a33b1fc0775a17a79e6)` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 07:59:53.409144 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4da41780-8ac6-4d25-805e-a9f5a8f5e3f1 None admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 07:59:53.425948 dv-cinder-851351-1-smb devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 392/817] 10.222.0.42 () {58 vars in 1439 bytes} [Thu Jul 28 07:59:53 2022] PUT /identity/v3/projects/139349507026497c98f360774dee737e/users/4a92b0d2802e46f4beffaaf39ed6723c/roles/a2d02bc3295c4a33b1fc0775a17a79e6 => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 07:59:53.426546 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da41780-8ac6-4d25-805e-a9f5a8f5e3f1 None admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 07:59:53.442014 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f0aea2-225e-4477-8cd7-71da5fe828fc None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 07:59:53.500324 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d92d74-597c-44d5-839a-1df2c9c03066 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 07:59:53.502182 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d92d74-597c-44d5-839a-1df2c9c03066 None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 07:59:53.502706 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d92d74-597c-44d5-839a-1df2c9c03066 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 07:59:53.503439 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d92d74-597c-44d5-839a-1df2c9c03066 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 07:59:53.521687 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d92d74-597c-44d5-839a-1df2c9c03066 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 07:59:53.528991 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application [None req-61d92d74-597c-44d5-839a-1df2c9c03066 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 07:59:53.528991 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 07:59:53.528991 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 07:59:53.528991 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 07:59:53.528991 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 07:59:53.528991 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 07:59:53.528991 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 07:59:53.528991 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 07:59:53.528991 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 07:59:53.528991 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 07:59:53.528991 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 07:59:53.528991 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 07:59:53.528991 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 07:59:53.528991 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 07:59:53.528991 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 07:59:53.528991 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 07:59:53.530002 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 07:59:53.530002 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 07:59:53.530002 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 07:59:53.530002 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 07:59:53.530002 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 07:59:53.530002 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 07:59:53.530002 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 07:59:53.530002 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 07:59:53.530002 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 07:59:53.530002 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 07:59:53.530002 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 07:59:53.530002 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application with Lock( Jul 28 07:59:53.530002 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 07:59:53.530002 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._enter() Jul 28 07:59:53.530002 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 07:59:53.530002 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 07:59:53.530835 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 07:59:53.530835 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.creator() Jul 28 07:59:53.530835 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 07:59:53.530835 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application created_value = creator( Jul 28 07:59:53.530835 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 07:59:53.530835 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 07:59:53.530835 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 07:59:53.530835 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 07:59:53.530835 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 07:59:53.530835 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 07:59:53.530835 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 07:59:53.530835 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application Jul 28 07:59:53.534489 dv-cinder-851351-1-smb devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 426/818] 10.222.0.42 () {56 vars in 1096 bytes} [Thu Jul 28 07:59:53 2022] GET /identity/v3/roles/admin => generated 83 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 07:59:53.535696 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d92d74-597c-44d5-839a-1df2c9c03066 None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 07:59:53.555146 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 07:59:53.566163 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da41780-8ac6-4d25-805e-a9f5a8f5e3f1 None admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 07:59:53.597427 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 07:59:53.618480 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05b60c6-f8dd-4421-9ba1-02cb20672d88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 07:59:53.619607 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05b60c6-f8dd-4421-9ba1-02cb20672d88 None admin] REQUEST_METHOD: `PUT` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 07:59:53.620103 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05b60c6-f8dd-4421-9ba1-02cb20672d88 None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 07:59:53.620572 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05b60c6-f8dd-4421-9ba1-02cb20672d88 None admin] PATH_INFO: `/v3/projects/139349507026497c98f360774dee737e/users/fe8c81659f704e14b8f0e00856a5a9a5/roles/362bd71ac01249fb8fa635381993eec1` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 07:59:53.623650 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e05b60c6-f8dd-4421-9ba1-02cb20672d88 None admin] RBAC: Authorizing `identity:create_grant(project_id=139349507026497c98f360774dee737e, user_id=fe8c81659f704e14b8f0e00856a5a9a5, role_id=362bd71ac01249fb8fa635381993eec1)` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 07:59:53.626086 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e05b60c6-f8dd-4421-9ba1-02cb20672d88 None admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 07:59:53.645276 dv-cinder-851351-1-smb devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 393/819] 10.222.0.42 () {58 vars in 1439 bytes} [Thu Jul 28 07:59:53 2022] PUT /identity/v3/projects/139349507026497c98f360774dee737e/users/fe8c81659f704e14b8f0e00856a5a9a5/roles/362bd71ac01249fb8fa635381993eec1 => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 07:59:53.646917 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05b60c6-f8dd-4421-9ba1-02cb20672d88 None admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 07:59:53.677416 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d92d74-597c-44d5-839a-1df2c9c03066 None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 07:59:53.771124 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64edda89-5098-47a7-b320-f26b57022458 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 07:59:53.773197 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64edda89-5098-47a7-b320-f26b57022458 None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 07:59:53.773746 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64edda89-5098-47a7-b320-f26b57022458 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 07:59:53.774217 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64edda89-5098-47a7-b320-f26b57022458 None admin] PATH_INFO: `/v3/services` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 07:59:53.775225 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64edda89-5098-47a7-b320-f26b57022458 None admin] RBAC: Adding query filter params (type=network) {{(pid=80347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 07:59:53.775776 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64edda89-5098-47a7-b320-f26b57022458 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 07:59:53.781666 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64edda89-5098-47a7-b320-f26b57022458 None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 07:59:53.795569 dv-cinder-851351-1-smb devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 427/820] 10.222.0.42 () {56 vars in 1112 bytes} [Thu Jul 28 07:59:53 2022] GET /identity/v3/services?type=network => generated 350 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 07:59:53.801526 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64edda89-5098-47a7-b320-f26b57022458 None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 07:59:53.857135 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05b60c6-f8dd-4421-9ba1-02cb20672d88 None admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 07:59:53.903141 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35dd602f-f483-4b85-82d7-5cd656fd66ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 07:59:53.903828 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35dd602f-f483-4b85-82d7-5cd656fd66ce None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 07:59:53.904095 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35dd602f-f483-4b85-82d7-5cd656fd66ce None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 07:59:53.904363 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35dd602f-f483-4b85-82d7-5cd656fd66ce None admin] PATH_INFO: `/v3/roles` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 07:59:53.905133 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35dd602f-f483-4b85-82d7-5cd656fd66ce None admin] RBAC: Adding query filter params (name=admin) {{(pid=80348) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 07:59:53.905434 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35dd602f-f483-4b85-82d7-5cd656fd66ce None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 07:59:53.906817 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35dd602f-f483-4b85-82d7-5cd656fd66ce None admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 07:59:53.916817 dv-cinder-851351-1-smb devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 394/821] 10.222.0.42 () {56 vars in 1099 bytes} [Thu Jul 28 07:59:53 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 07:59:53.925750 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35dd602f-f483-4b85-82d7-5cd656fd66ce None admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 07:59:53.951745 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 07:59:53.994670 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64edda89-5098-47a7-b320-f26b57022458 None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 07:59:54.013583 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 07:59:54.085358 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647fc1a1-2dfa-4019-9aed-d08839d81461 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 07:59:54.094076 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647fc1a1-2dfa-4019-9aed-d08839d81461 None admin] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 07:59:54.095028 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647fc1a1-2dfa-4019-9aed-d08839d81461 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 07:59:54.095933 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647fc1a1-2dfa-4019-9aed-d08839d81461 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 07:59:54.097484 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-647fc1a1-2dfa-4019-9aed-d08839d81461 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 07:59:54.100364 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-647fc1a1-2dfa-4019-9aed-d08839d81461 None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 07:59:54.171055 dv-cinder-851351-1-smb devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 428/822] 10.222.0.42 () {60 vars in 1144 bytes} [Thu Jul 28 07:59:53 2022] POST /identity/v3/endpoints => generated 327 bytes in 368 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 28 07:59:54.177862 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35dd602f-f483-4b85-82d7-5cd656fd66ce None admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 07:59:54.256964 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464fc59e-9a02-4b23-815c-05bd267812d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 07:59:54.258394 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464fc59e-9a02-4b23-815c-05bd267812d3 None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 07:59:54.259134 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464fc59e-9a02-4b23-815c-05bd267812d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 07:59:54.259863 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464fc59e-9a02-4b23-815c-05bd267812d3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 07:59:54.282321 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-464fc59e-9a02-4b23-815c-05bd267812d3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 07:59:54.283841 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-464fc59e-9a02-4b23-815c-05bd267812d3 None admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 07:59:54.301024 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application [None req-464fc59e-9a02-4b23-815c-05bd267812d3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 07:59:54.301024 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 07:59:54.301024 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 07:59:54.301024 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 07:59:54.301024 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 07:59:54.301024 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 07:59:54.301024 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 07:59:54.301024 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 07:59:54.301024 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 07:59:54.301024 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 07:59:54.301024 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 07:59:54.301024 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 07:59:54.301024 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 07:59:54.301024 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 07:59:54.301024 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 07:59:54.302009 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 07:59:54.302009 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 07:59:54.302009 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 07:59:54.302009 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 07:59:54.302009 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 07:59:54.302009 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 07:59:54.302009 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 07:59:54.302009 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 07:59:54.302009 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application with Lock( Jul 28 07:59:54.302009 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 07:59:54.302009 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self._enter() Jul 28 07:59:54.302009 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 07:59:54.302009 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 07:59:54.302009 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 07:59:54.302009 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.creator() Jul 28 07:59:54.302009 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 07:59:54.302009 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application created_value = creator( Jul 28 07:59:54.302889 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 07:59:54.302889 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 07:59:54.302889 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 07:59:54.302889 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application Jul 28 07:59:54.302889 dv-cinder-851351-1-smb devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 395/823] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 07:59:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 377 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 07:59:54.308288 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647fc1a1-2dfa-4019-9aed-d08839d81461 None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 07:59:54.469369 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647fc1a1-2dfa-4019-9aed-d08839d81461 None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 07:59:54.509637 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e2b8c2-a35c-473a-a4c9-762ae5096dcc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 07:59:54.511044 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e2b8c2-a35c-473a-a4c9-762ae5096dcc None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 07:59:54.511571 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e2b8c2-a35c-473a-a4c9-762ae5096dcc None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 07:59:54.512038 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e2b8c2-a35c-473a-a4c9-762ae5096dcc None admin] PATH_INFO: `/v3/domains` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 07:59:54.512973 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e2b8c2-a35c-473a-a4c9-762ae5096dcc None admin] RBAC: Adding query filter params (name=Default) {{(pid=80347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 07:59:54.513515 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e2b8c2-a35c-473a-a4c9-762ae5096dcc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 07:59:54.515147 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e2b8c2-a35c-473a-a4c9-762ae5096dcc None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 07:59:54.528713 dv-cinder-851351-1-smb devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 429/824] 10.222.0.42 () {56 vars in 1109 bytes} [Thu Jul 28 07:59:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 07:59:54.533998 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464fc59e-9a02-4b23-815c-05bd267812d3 None admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 07:59:54.604897 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=100 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 07:59:54.646447 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464fc59e-9a02-4b23-815c-05bd267812d3 None admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 07:59:54.689196 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b61a2f-ecfa-4bdf-800c-6bd005a78b1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 07:59:54.689896 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b61a2f-ecfa-4bdf-800c-6bd005a78b1c None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 07:59:54.690166 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b61a2f-ecfa-4bdf-800c-6bd005a78b1c None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 07:59:54.690434 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b61a2f-ecfa-4bdf-800c-6bd005a78b1c None admin] PATH_INFO: `/v3/users/nova` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 07:59:54.699086 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8b61a2f-ecfa-4bdf-800c-6bd005a78b1c None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 07:59:54.700619 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8b61a2f-ecfa-4bdf-800c-6bd005a78b1c None admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 07:59:54.716754 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application [None req-e8b61a2f-ecfa-4bdf-800c-6bd005a78b1c None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 28 07:59:54.716754 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 07:59:54.716754 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 07:59:54.716754 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 07:59:54.716754 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 07:59:54.716754 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 07:59:54.716754 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 07:59:54.716754 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 07:59:54.716754 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 07:59:54.716754 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 07:59:54.716754 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 07:59:54.716754 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 07:59:54.716754 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 28 07:59:54.716754 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 28 07:59:54.716754 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 28 07:59:54.716754 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 28 07:59:54.717747 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 07:59:54.717747 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 07:59:54.717747 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 28 07:59:54.717747 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 07:59:54.717747 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 28 07:59:54.717747 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 07:59:54.717747 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 07:59:54.717747 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 07:59:54.717747 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 07:59:54.717747 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 07:59:54.717747 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 07:59:54.717747 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application with Lock( Jul 28 07:59:54.717747 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 07:59:54.717747 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self._enter() Jul 28 07:59:54.717747 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 07:59:54.717747 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 07:59:54.717747 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 07:59:54.717747 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.creator() Jul 28 07:59:54.718673 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 07:59:54.718673 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application created_value = creator( Jul 28 07:59:54.718673 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 28 07:59:54.718673 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 28 07:59:54.718673 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 28 07:59:54.718673 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 28 07:59:54.718673 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 28 07:59:54.718673 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 28 07:59:54.718673 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 28 07:59:54.718673 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application Jul 28 07:59:54.719196 dv-cinder-851351-1-smb devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 396/825] 10.222.0.42 () {56 vars in 1093 bytes} [Thu Jul 28 07:59:54 2022] GET /identity/v3/users/nova => generated 82 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 07:59:54.724578 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e2b8c2-a35c-473a-a4c9-762ae5096dcc None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 07:59:54.779426 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 07:59:54.896352 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e2b8c2-a35c-473a-a4c9-762ae5096dcc None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 07:59:54.935362 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a346e72-ca9e-4f1e-ae6e-791555bea8ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 07:59:54.935999 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a346e72-ca9e-4f1e-ae6e-791555bea8ef None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 07:59:54.936284 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a346e72-ca9e-4f1e-ae6e-791555bea8ef None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 07:59:54.936546 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a346e72-ca9e-4f1e-ae6e-791555bea8ef None admin] PATH_INFO: `/v3/users` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 07:59:54.937394 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a346e72-ca9e-4f1e-ae6e-791555bea8ef None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 07:59:54.937700 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a346e72-ca9e-4f1e-ae6e-791555bea8ef None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 07:59:54.939133 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a346e72-ca9e-4f1e-ae6e-791555bea8ef None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 07:59:54.958426 dv-cinder-851351-1-smb devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 430/826] 10.222.0.42 () {56 vars in 1133 bytes} [Thu Jul 28 07:59:54 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 07:59:54.963689 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b61a2f-ecfa-4bdf-800c-6bd005a78b1c None admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 07:59:55.068160 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b61a2f-ecfa-4bdf-800c-6bd005a78b1c None admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 07:59:55.093869 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=100 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 07:59:55.114598 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e01762-8224-4923-bf1c-dc10dad8c547 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 07:59:55.115257 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e01762-8224-4923-bf1c-dc10dad8c547 None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 07:59:55.115536 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e01762-8224-4923-bf1c-dc10dad8c547 None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 07:59:55.115810 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e01762-8224-4923-bf1c-dc10dad8c547 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 07:59:55.144166 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94988ada-90a0-4cd5-b677-8bf0f6eb7ccd None None] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 07:59:55.144887 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94988ada-90a0-4cd5-b677-8bf0f6eb7ccd None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 07:59:55.145359 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94988ada-90a0-4cd5-b677-8bf0f6eb7ccd None None] PATH_INFO: `/` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 07:59:55.147313 dv-cinder-851351-1-smb devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 431/827] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 07:59:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 28 07:59:55.153008 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9486ade7-1fed-4b0d-93ed-366a98154e34 None None] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 07:59:55.153586 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9486ade7-1fed-4b0d-93ed-366a98154e34 None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 07:59:55.154106 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9486ade7-1fed-4b0d-93ed-366a98154e34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 07:59:55.177216 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.auth.core [None req-9486ade7-1fed-4b0d-93ed-366a98154e34 None None] MFA Rules not processed for user `f0666d3a50644a7097367331c1ee1a68`. Rule list: `[]` (Enabled: `True`). {{(pid=80347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 07:59:55.178847 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-9486ade7-1fed-4b0d-93ed-366a98154e34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 07:59:55.191466 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91e01762-8224-4923-bf1c-dc10dad8c547 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 07:59:55.192987 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91e01762-8224-4923-bf1c-dc10dad8c547 None admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 07:59:55.300907 dv-cinder-851351-1-smb devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 397/829] 10.222.0.42 () {58 vars in 1282 bytes} [Thu Jul 28 07:59:54 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 28 07:59:55.301160 dv-cinder-851351-1-smb devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 432/829] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 07:59:55 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 28 07:59:55.301473 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e01762-8224-4923-bf1c-dc10dad8c547 None admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 07:59:55.330237 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=100 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 07:59:55.335039 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9486ade7-1fed-4b0d-93ed-366a98154e34 None None] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 07:59:55.353444 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 07:59:55.425664 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e01762-8224-4923-bf1c-dc10dad8c547 None admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 07:59:55.466768 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-274941ba-9034-4557-b2af-ee03c834b367 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 07:59:55.467824 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274941ba-9034-4557-b2af-ee03c834b367 None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 07:59:55.468511 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274941ba-9034-4557-b2af-ee03c834b367 None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 07:59:55.468961 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274941ba-9034-4557-b2af-ee03c834b367 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 07:59:55.473310 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9486ade7-1fed-4b0d-93ed-366a98154e34 None None] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 07:59:55.484872 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-274941ba-9034-4557-b2af-ee03c834b367 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 07:59:55.486756 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-274941ba-9034-4557-b2af-ee03c834b367 None admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 07:59:55.504902 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application [None req-274941ba-9034-4557-b2af-ee03c834b367 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 07:59:55.504902 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 07:59:55.504902 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 07:59:55.504902 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 07:59:55.504902 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 07:59:55.504902 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 07:59:55.504902 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 07:59:55.504902 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 07:59:55.504902 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 07:59:55.504902 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 07:59:55.504902 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 07:59:55.504902 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 07:59:55.504902 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 07:59:55.504902 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 07:59:55.504902 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 07:59:55.506068 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 07:59:55.506068 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 07:59:55.506068 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 07:59:55.506068 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 07:59:55.506068 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 07:59:55.506068 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 07:59:55.506068 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 07:59:55.506068 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 07:59:55.506068 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application with Lock( Jul 28 07:59:55.506068 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 07:59:55.506068 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self._enter() Jul 28 07:59:55.506068 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 07:59:55.506068 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 07:59:55.506068 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 07:59:55.506068 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.creator() Jul 28 07:59:55.506068 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 07:59:55.506068 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application created_value = creator( Jul 28 07:59:55.507103 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 07:59:55.507103 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 07:59:55.507103 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 07:59:55.507103 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application Jul 28 07:59:55.510265 dv-cinder-851351-1-smb devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 398/830] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 07:59:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 07:59:55.518392 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e633dc7b-598e-4185-a607-7d759c3b26c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 07:59:55.518392 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e633dc7b-598e-4185-a607-7d759c3b26c0 None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 07:59:55.518392 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e633dc7b-598e-4185-a607-7d759c3b26c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 07:59:55.518392 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e633dc7b-598e-4185-a607-7d759c3b26c0 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 07:59:55.518818 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-274941ba-9034-4557-b2af-ee03c834b367 None admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 07:59:55.518891 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e633dc7b-598e-4185-a607-7d759c3b26c0 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 07:59:55.518891 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e633dc7b-598e-4185-a607-7d759c3b26c0 None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 07:59:55.529356 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application [None req-e633dc7b-598e-4185-a607-7d759c3b26c0 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 28 07:59:55.529356 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 07:59:55.529356 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 28 07:59:55.529356 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 28 07:59:55.529356 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 28 07:59:55.529356 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 28 07:59:55.529356 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 28 07:59:55.529356 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 07:59:55.529356 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 28 07:59:55.529356 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application Jul 28 07:59:55.529356 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 28 07:59:55.529356 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application Jul 28 07:59:55.529356 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 07:59:55.529356 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 07:59:55.529356 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 07:59:55.529356 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 07:59:55.529356 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 07:59:55.531341 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 07:59:55.531341 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 07:59:55.531341 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 07:59:55.531341 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 07:59:55.531341 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 07:59:55.531341 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 07:59:55.531341 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 28 07:59:55.531341 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 28 07:59:55.531341 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 28 07:59:55.531341 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 28 07:59:55.531341 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 07:59:55.531341 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 07:59:55.531341 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 07:59:55.531341 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 07:59:55.531341 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 07:59:55.531341 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 07:59:55.533633 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 07:59:55.533633 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application with Lock( Jul 28 07:59:55.533633 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 07:59:55.533633 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._enter() Jul 28 07:59:55.533633 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 07:59:55.533633 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 07:59:55.533633 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 07:59:55.533633 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.creator() Jul 28 07:59:55.533633 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 07:59:55.533633 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application created_value = creator( Jul 28 07:59:55.533633 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 28 07:59:55.533633 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 07:59:55.533633 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 28 07:59:55.533633 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application Jul 28 07:59:55.536716 dv-cinder-851351-1-smb devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 433/831] 10.222.0.42 () {56 vars in 1114 bytes} [Thu Jul 28 07:59:55 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 07:59:55.538183 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e633dc7b-598e-4185-a607-7d759c3b26c0 None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 07:59:55.605442 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=100 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 07:59:55.631632 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-274941ba-9034-4557-b2af-ee03c834b367 None admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 07:59:55.649502 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 07:59:55.669235 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148b6090-e57b-4f04-afdb-47e5ab2accc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 07:59:55.669872 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148b6090-e57b-4f04-afdb-47e5ab2accc6 None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 07:59:55.670149 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148b6090-e57b-4f04-afdb-47e5ab2accc6 None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 07:59:55.670420 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148b6090-e57b-4f04-afdb-47e5ab2accc6 None admin] PATH_INFO: `/v3/domains` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 07:59:55.671416 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-148b6090-e57b-4f04-afdb-47e5ab2accc6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80348) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 07:59:55.671416 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-148b6090-e57b-4f04-afdb-47e5ab2accc6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 07:59:55.672947 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-148b6090-e57b-4f04-afdb-47e5ab2accc6 None admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 07:59:55.682225 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e633dc7b-598e-4185-a607-7d759c3b26c0 None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 07:59:55.687877 dv-cinder-851351-1-smb devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 399/832] 10.222.0.42 () {56 vars in 1109 bytes} [Thu Jul 28 07:59:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 07:59:55.696601 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148b6090-e57b-4f04-afdb-47e5ab2accc6 None admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 07:59:55.721750 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd1da0f-7d81-4edc-a2e2-78192e68385e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 07:59:55.722385 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd1da0f-7d81-4edc-a2e2-78192e68385e None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 07:59:55.722661 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd1da0f-7d81-4edc-a2e2-78192e68385e None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 07:59:55.722937 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd1da0f-7d81-4edc-a2e2-78192e68385e None admin] PATH_INFO: `/v3/services` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 07:59:55.723626 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bd1da0f-7d81-4edc-a2e2-78192e68385e None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 07:59:55.723927 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bd1da0f-7d81-4edc-a2e2-78192e68385e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 07:59:55.725438 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bd1da0f-7d81-4edc-a2e2-78192e68385e None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 07:59:55.736031 dv-cinder-851351-1-smb devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 434/833] 10.222.0.42 () {56 vars in 1114 bytes} [Thu Jul 28 07:59:55 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 07:59:55.737262 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd1da0f-7d81-4edc-a2e2-78192e68385e None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 07:59:55.817751 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148b6090-e57b-4f04-afdb-47e5ab2accc6 None admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 07:59:55.851979 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd1da0f-7d81-4edc-a2e2-78192e68385e None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 07:59:55.858005 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0261ebc-61a6-4d61-9b65-c1da54060aad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 07:59:55.858989 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0261ebc-61a6-4d61-9b65-c1da54060aad None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 07:59:55.859473 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0261ebc-61a6-4d61-9b65-c1da54060aad None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 07:59:55.859975 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0261ebc-61a6-4d61-9b65-c1da54060aad None admin] PATH_INFO: `/v3/projects/service` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 07:59:55.863321 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=100 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 07:59:55.868689 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0261ebc-61a6-4d61-9b65-c1da54060aad None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 07:59:55.870529 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0261ebc-61a6-4d61-9b65-c1da54060aad None admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 07:59:55.883438 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application [None req-f0261ebc-61a6-4d61-9b65-c1da54060aad None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 07:59:55.883438 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 07:59:55.883438 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 07:59:55.883438 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 07:59:55.883438 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 07:59:55.883438 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 07:59:55.883438 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 07:59:55.883438 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 07:59:55.883438 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 07:59:55.883438 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 07:59:55.883438 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 07:59:55.883438 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 07:59:55.883438 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 28 07:59:55.883438 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 28 07:59:55.883438 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 28 07:59:55.884397 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 28 07:59:55.884397 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 07:59:55.884397 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 07:59:55.884397 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 07:59:55.884397 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 07:59:55.884397 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 07:59:55.884397 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 07:59:55.884397 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 07:59:55.884397 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application with Lock( Jul 28 07:59:55.884397 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 07:59:55.884397 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self._enter() Jul 28 07:59:55.884397 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 07:59:55.884397 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 07:59:55.884397 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 07:59:55.884397 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.creator() Jul 28 07:59:55.884397 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 07:59:55.884397 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application created_value = creator( Jul 28 07:59:55.885408 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 28 07:59:55.885408 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 28 07:59:55.885408 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 28 07:59:55.885408 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 28 07:59:55.885408 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 28 07:59:55.885408 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 28 07:59:55.885408 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 07:59:55.885408 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application Jul 28 07:59:55.885408 dv-cinder-851351-1-smb devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 400/834] 10.222.0.42 () {56 vars in 1111 bytes} [Thu Jul 28 07:59:55 2022] GET /identity/v3/projects/service => generated 88 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 07:59:55.892787 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0261ebc-61a6-4d61-9b65-c1da54060aad None admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 07:59:55.899834 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c8a99c-fa61-489c-bc7e-6564ec3c5b81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 07:59:55.900516 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c8a99c-fa61-489c-bc7e-6564ec3c5b81 None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 07:59:55.900831 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c8a99c-fa61-489c-bc7e-6564ec3c5b81 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 07:59:55.901102 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c8a99c-fa61-489c-bc7e-6564ec3c5b81 None admin] PATH_INFO: `/v3/services` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 07:59:55.901792 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94c8a99c-fa61-489c-bc7e-6564ec3c5b81 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 07:59:55.902089 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94c8a99c-fa61-489c-bc7e-6564ec3c5b81 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 07:59:55.903460 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94c8a99c-fa61-489c-bc7e-6564ec3c5b81 None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 07:59:55.908504 dv-cinder-851351-1-smb devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 435/835] 10.222.0.42 () {56 vars in 1114 bytes} [Thu Jul 28 07:59:55 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 07:59:55.909661 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938c9531-2653-4996-8883-b8ff0947a54d None None] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 07:59:55.909948 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938c9531-2653-4996-8883-b8ff0947a54d None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 07:59:55.910185 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938c9531-2653-4996-8883-b8ff0947a54d None None] PATH_INFO: `/` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 07:59:55.921023 dv-cinder-851351-1-smb devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 436/836] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 07:59:55 2022] GET /identity => generated 270 bytes in 12 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 07:59:55.922320 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4752f2-1c5d-4aab-a647-178ceeefa67e None None] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 07:59:55.922606 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4752f2-1c5d-4aab-a647-178ceeefa67e None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 07:59:55.922880 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4752f2-1c5d-4aab-a647-178ceeefa67e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 07:59:55.931834 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 07:59:55.944506 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.auth.core [None req-ce4752f2-1c5d-4aab-a647-178ceeefa67e None None] MFA Rules not processed for user `f0666d3a50644a7097367331c1ee1a68`. Rule list: `[]` (Enabled: `True`). {{(pid=80347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 07:59:55.945797 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-ce4752f2-1c5d-4aab-a647-178ceeefa67e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 07:59:56.031605 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0261ebc-61a6-4d61-9b65-c1da54060aad None admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 07:59:56.033793 dv-cinder-851351-1-smb devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 437/837] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 07:59:55 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 07:59:56.035014 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b629cbb6-dea9-4626-b20e-009f9cd74a21 None None] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 07:59:56.035301 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b629cbb6-dea9-4626-b20e-009f9cd74a21 None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 07:59:56.035571 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b629cbb6-dea9-4626-b20e-009f9cd74a21 None None] PATH_INFO: `/` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 07:59:56.041370 dv-cinder-851351-1-smb devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 438/838] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 07:59:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 07:59:56.043347 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c859fdb-5c54-4bd0-9a20-f62d340e1808 None None] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 07:59:56.043632 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c859fdb-5c54-4bd0-9a20-f62d340e1808 None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 07:59:56.043902 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c859fdb-5c54-4bd0-9a20-f62d340e1808 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 07:59:56.063663 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.auth.core [None req-6c859fdb-5c54-4bd0-9a20-f62d340e1808 None None] MFA Rules not processed for user `f0666d3a50644a7097367331c1ee1a68`. Rule list: `[]` (Enabled: `True`). {{(pid=80347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 07:59:56.064932 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-6c859fdb-5c54-4bd0-9a20-f62d340e1808 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 07:59:56.083449 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535b69cb-eb8e-4e47-a631-8db9ed8ce931 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 07:59:56.083819 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535b69cb-eb8e-4e47-a631-8db9ed8ce931 None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 07:59:56.084103 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535b69cb-eb8e-4e47-a631-8db9ed8ce931 None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 07:59:56.084273 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535b69cb-eb8e-4e47-a631-8db9ed8ce931 None admin] PATH_INFO: `/v3/projects` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 07:59:56.085081 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-535b69cb-eb8e-4e47-a631-8db9ed8ce931 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80348) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 07:59:56.085392 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-535b69cb-eb8e-4e47-a631-8db9ed8ce931 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 07:59:56.086951 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-535b69cb-eb8e-4e47-a631-8db9ed8ce931 None admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 07:59:56.105876 dv-cinder-851351-1-smb devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 401/839] 10.222.0.42 () {56 vars in 1148 bytes} [Thu Jul 28 07:59:55 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 07:59:56.107112 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535b69cb-eb8e-4e47-a631-8db9ed8ce931 None admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 07:59:56.153234 dv-cinder-851351-1-smb devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 439/840] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 07:59:56 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 07:59:56.154118 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c859fdb-5c54-4bd0-9a20-f62d340e1808 None None] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 07:59:56.190286 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=100 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 07:59:56.235706 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 07:59:56.245787 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535b69cb-eb8e-4e47-a631-8db9ed8ce931 None admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 07:59:56.278526 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c859fdb-5c54-4bd0-9a20-f62d340e1808 None None] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 07:59:56.285066 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b22b2f6-9b93-4a07-8f83-09b71a7fe1e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 07:59:56.285735 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b22b2f6-9b93-4a07-8f83-09b71a7fe1e4 None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 07:59:56.286013 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b22b2f6-9b93-4a07-8f83-09b71a7fe1e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 07:59:56.286284 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b22b2f6-9b93-4a07-8f83-09b71a7fe1e4 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 07:59:56.299767 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b22b2f6-9b93-4a07-8f83-09b71a7fe1e4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 07:59:56.305040 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application [None req-9b22b2f6-9b93-4a07-8f83-09b71a7fe1e4 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 28 07:59:56.305040 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 07:59:56.305040 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 07:59:56.305040 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 07:59:56.305040 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 07:59:56.305040 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 07:59:56.305040 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 07:59:56.305040 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 07:59:56.305040 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 07:59:56.305040 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 07:59:56.305040 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 07:59:56.305040 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 07:59:56.305040 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 07:59:56.305040 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 07:59:56.305040 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 07:59:56.305040 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 07:59:56.306074 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 07:59:56.306074 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 07:59:56.306074 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 07:59:56.306074 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 07:59:56.306074 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 07:59:56.306074 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 07:59:56.306074 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 07:59:56.306074 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 07:59:56.306074 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 07:59:56.306074 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 07:59:56.306074 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 07:59:56.306074 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application with Lock( Jul 28 07:59:56.306074 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 07:59:56.306074 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self._enter() Jul 28 07:59:56.306074 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 07:59:56.306074 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 07:59:56.307051 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 07:59:56.307051 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.creator() Jul 28 07:59:56.307051 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 07:59:56.307051 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application created_value = creator( Jul 28 07:59:56.307051 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 07:59:56.307051 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 07:59:56.307051 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 07:59:56.307051 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 07:59:56.307051 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 07:59:56.307051 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 07:59:56.307051 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 28 07:59:56.307051 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application Jul 28 07:59:56.307051 dv-cinder-851351-1-smb devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 402/841] 10.222.0.42 () {56 vars in 1102 bytes} [Thu Jul 28 07:59:56 2022] GET /identity/v3/roles/service => generated 85 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 07:59:56.308851 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b22b2f6-9b93-4a07-8f83-09b71a7fe1e4 None admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 07:59:56.323112 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d842c39-2836-4603-aa11-288c4620ec98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 07:59:56.323749 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d842c39-2836-4603-aa11-288c4620ec98 None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 07:59:56.324025 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d842c39-2836-4603-aa11-288c4620ec98 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 07:59:56.324296 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d842c39-2836-4603-aa11-288c4620ec98 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 07:59:56.325137 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d842c39-2836-4603-aa11-288c4620ec98 None admin] RBAC: Adding query filter params (role.id=362bd71ac01249fb8fa635381993eec1, scope.project.id=139349507026497c98f360774dee737e, user.id=02f10880691d4fd180f96f3e40e1d25f) {{(pid=80347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 07:59:56.325444 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d842c39-2836-4603-aa11-288c4620ec98 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 07:59:56.326901 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d842c39-2836-4603-aa11-288c4620ec98 None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 07:59:56.334212 dv-cinder-851351-1-smb devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 440/842] 10.222.0.42 () {56 vars in 1374 bytes} [Thu Jul 28 07:59:56 2022] GET /identity/v3/role_assignments?user.id=02f10880691d4fd180f96f3e40e1d25f&scope.project.id=139349507026497c98f360774dee737e&role.id=362bd71ac01249fb8fa635381993eec1 => generated 608 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 07:59:56.335128 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d842c39-2836-4603-aa11-288c4620ec98 None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 07:59:56.455657 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b22b2f6-9b93-4a07-8f83-09b71a7fe1e4 None admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 07:59:56.476481 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d842c39-2836-4603-aa11-288c4620ec98 None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 07:59:56.496322 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4f40e7-2c2d-477f-a078-26b78679a239 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 07:59:56.497373 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4f40e7-2c2d-477f-a078-26b78679a239 None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 07:59:56.497831 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4f40e7-2c2d-477f-a078-26b78679a239 None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 07:59:56.498278 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4f40e7-2c2d-477f-a078-26b78679a239 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 07:59:56.501124 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=100 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 07:59:56.508243 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 07:59:56.515360 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab4f40e7-2c2d-477f-a078-26b78679a239 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 07:59:56.518931 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3baaea1a-f7b4-4b3d-a7cd-d2bd7b0a860a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 07:59:56.519569 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3baaea1a-f7b4-4b3d-a7cd-d2bd7b0a860a None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 07:59:56.519844 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3baaea1a-f7b4-4b3d-a7cd-d2bd7b0a860a None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 07:59:56.520120 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3baaea1a-f7b4-4b3d-a7cd-d2bd7b0a860a None admin] PATH_INFO: `/v3/roles` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 07:59:56.520906 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3baaea1a-f7b4-4b3d-a7cd-d2bd7b0a860a None admin] RBAC: Adding query filter params (name=service) {{(pid=80347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 07:59:56.521692 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3baaea1a-f7b4-4b3d-a7cd-d2bd7b0a860a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 07:59:56.522252 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application [None req-ab4f40e7-2c2d-477f-a078-26b78679a239 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 07:59:56.522252 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 07:59:56.522252 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 07:59:56.522252 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 07:59:56.522252 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 07:59:56.522252 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 07:59:56.522252 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 07:59:56.522252 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 07:59:56.522252 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 07:59:56.522252 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 07:59:56.522252 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 07:59:56.522252 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 07:59:56.522252 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 07:59:56.522252 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 07:59:56.522252 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 07:59:56.522252 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 07:59:56.523515 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 07:59:56.523515 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 07:59:56.523515 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 07:59:56.523515 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 07:59:56.523515 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 07:59:56.523515 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 07:59:56.523515 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 07:59:56.523515 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 07:59:56.523515 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 07:59:56.523515 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 07:59:56.523515 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 07:59:56.523515 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application with Lock( Jul 28 07:59:56.523515 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 07:59:56.523515 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self._enter() Jul 28 07:59:56.523515 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 07:59:56.523515 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 07:59:56.525245 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 07:59:56.525245 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.creator() Jul 28 07:59:56.525245 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 07:59:56.525245 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application created_value = creator( Jul 28 07:59:56.525245 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 07:59:56.525245 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 07:59:56.525245 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 07:59:56.525245 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 07:59:56.525245 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 07:59:56.525245 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 07:59:56.525245 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 07:59:56.525245 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application Jul 28 07:59:56.526341 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3baaea1a-f7b4-4b3d-a7cd-d2bd7b0a860a None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 07:59:56.526450 dv-cinder-851351-1-smb devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 403/843] 10.222.0.42 () {56 vars in 1096 bytes} [Thu Jul 28 07:59:56 2022] GET /identity/v3/roles/admin => generated 83 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 07:59:56.533324 dv-cinder-851351-1-smb devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 441/844] 10.222.0.42 () {56 vars in 1103 bytes} [Thu Jul 28 07:59:56 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 07:59:56.535214 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4f40e7-2c2d-477f-a078-26b78679a239 None admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 07:59:56.538585 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3baaea1a-f7b4-4b3d-a7cd-d2bd7b0a860a None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 07:59:56.669937 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3baaea1a-f7b4-4b3d-a7cd-d2bd7b0a860a None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 07:59:56.677642 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4f40e7-2c2d-477f-a078-26b78679a239 None admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 07:59:56.717536 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7141a571-d016-4452-a9ac-2eeadd3be8b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 07:59:56.719068 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7141a571-d016-4452-a9ac-2eeadd3be8b5 None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 07:59:56.719535 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7141a571-d016-4452-a9ac-2eeadd3be8b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 07:59:56.720003 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7141a571-d016-4452-a9ac-2eeadd3be8b5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 07:59:56.722296 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd9043e-5e4a-4f18-a503-38cb8f8b6c95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 07:59:56.723201 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd9043e-5e4a-4f18-a503-38cb8f8b6c95 None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 07:59:56.723547 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd9043e-5e4a-4f18-a503-38cb8f8b6c95 None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 07:59:56.724267 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd9043e-5e4a-4f18-a503-38cb8f8b6c95 None admin] PATH_INFO: `/v3/roles` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 07:59:56.725221 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd9043e-5e4a-4f18-a503-38cb8f8b6c95 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80348) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 07:59:56.725652 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd9043e-5e4a-4f18-a503-38cb8f8b6c95 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 07:59:56.727807 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd9043e-5e4a-4f18-a503-38cb8f8b6c95 None admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 07:59:56.738350 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7141a571-d016-4452-a9ac-2eeadd3be8b5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 07:59:56.740117 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7141a571-d016-4452-a9ac-2eeadd3be8b5 None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 07:59:56.744715 dv-cinder-851351-1-smb devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 404/845] 10.222.0.42 () {56 vars in 1099 bytes} [Thu Jul 28 07:59:56 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 07:59:56.748012 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd9043e-5e4a-4f18-a503-38cb8f8b6c95 None admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 07:59:56.762316 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application [None req-7141a571-d016-4452-a9ac-2eeadd3be8b5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 07:59:56.762316 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 07:59:56.762316 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 07:59:56.762316 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 07:59:56.762316 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 07:59:56.762316 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 07:59:56.762316 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 07:59:56.762316 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 07:59:56.762316 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 07:59:56.762316 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 07:59:56.762316 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 07:59:56.762316 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 07:59:56.762316 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 07:59:56.762316 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 07:59:56.762316 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 07:59:56.763490 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 07:59:56.763490 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 07:59:56.763490 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 07:59:56.763490 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 07:59:56.763490 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 07:59:56.763490 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 07:59:56.763490 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 07:59:56.763490 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 07:59:56.763490 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application with Lock( Jul 28 07:59:56.763490 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 07:59:56.763490 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._enter() Jul 28 07:59:56.763490 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 07:59:56.763490 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 07:59:56.763490 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 07:59:56.763490 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.creator() Jul 28 07:59:56.763490 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 07:59:56.763490 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application created_value = creator( Jul 28 07:59:56.764534 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 07:59:56.764534 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 07:59:56.764534 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 07:59:56.764534 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application Jul 28 07:59:56.770613 dv-cinder-851351-1-smb devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 442/846] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 07:59:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 07:59:56.773463 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7141a571-d016-4452-a9ac-2eeadd3be8b5 None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 07:59:56.804757 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=100 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 07:59:56.829796 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 07:59:56.887297 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd9043e-5e4a-4f18-a503-38cb8f8b6c95 None admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 07:59:56.909377 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7141a571-d016-4452-a9ac-2eeadd3be8b5 None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 07:59:56.928804 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4653205-4a25-43cc-96df-1b46331f5093 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 07:59:56.930394 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4653205-4a25-43cc-96df-1b46331f5093 None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 07:59:56.930965 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4653205-4a25-43cc-96df-1b46331f5093 None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 07:59:56.931413 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4653205-4a25-43cc-96df-1b46331f5093 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 07:59:56.948561 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4653205-4a25-43cc-96df-1b46331f5093 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 07:59:56.950959 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4653205-4a25-43cc-96df-1b46331f5093 None admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 07:59:56.955043 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387009cd-a2b6-4075-9379-7e9427ad9321 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 07:59:56.955949 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387009cd-a2b6-4075-9379-7e9427ad9321 None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 07:59:56.956574 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387009cd-a2b6-4075-9379-7e9427ad9321 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 07:59:56.957070 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387009cd-a2b6-4075-9379-7e9427ad9321 None admin] PATH_INFO: `/v3/domains` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 07:59:56.958000 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-387009cd-a2b6-4075-9379-7e9427ad9321 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 07:59:56.958506 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-387009cd-a2b6-4075-9379-7e9427ad9321 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 07:59:56.960242 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-387009cd-a2b6-4075-9379-7e9427ad9321 None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 07:59:56.967958 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application [None req-e4653205-4a25-43cc-96df-1b46331f5093 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 07:59:56.967958 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 07:59:56.967958 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 07:59:56.967958 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 07:59:56.967958 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 07:59:56.967958 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 07:59:56.967958 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 07:59:56.967958 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 07:59:56.967958 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 07:59:56.967958 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 07:59:56.967958 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 07:59:56.967958 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 07:59:56.967958 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 07:59:56.967958 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 07:59:56.967958 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 07:59:56.969144 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 07:59:56.969144 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 07:59:56.969144 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 07:59:56.969144 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 07:59:56.969144 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 07:59:56.969144 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 07:59:56.969144 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 07:59:56.969144 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 07:59:56.969144 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application with Lock( Jul 28 07:59:56.969144 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 07:59:56.969144 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self._enter() Jul 28 07:59:56.969144 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 07:59:56.969144 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 07:59:56.969144 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 07:59:56.969144 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.creator() Jul 28 07:59:56.969144 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 07:59:56.969144 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application created_value = creator( Jul 28 07:59:56.970006 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 07:59:56.970006 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 07:59:56.970006 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 07:59:56.970006 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application Jul 28 07:59:56.973915 dv-cinder-851351-1-smb devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 405/847] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 07:59:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 07:59:56.975375 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4653205-4a25-43cc-96df-1b46331f5093 None admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 07:59:56.982327 dv-cinder-851351-1-smb devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 443/848] 10.222.0.42 () {56 vars in 1109 bytes} [Thu Jul 28 07:59:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 07:59:56.983676 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387009cd-a2b6-4075-9379-7e9427ad9321 None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 07:59:57.073635 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=100 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 07:59:57.084546 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4653205-4a25-43cc-96df-1b46331f5093 None admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 07:59:57.099983 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387009cd-a2b6-4075-9379-7e9427ad9321 None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 07:59:57.102257 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 07:59:57.128513 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-170f3265-763f-438e-a627-1b6e49ce6c0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 07:59:57.129378 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170f3265-763f-438e-a627-1b6e49ce6c0d None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 07:59:57.129754 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170f3265-763f-438e-a627-1b6e49ce6c0d None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 07:59:57.130170 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170f3265-763f-438e-a627-1b6e49ce6c0d None admin] PATH_INFO: `/v3/domains` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 07:59:57.130934 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-170f3265-763f-438e-a627-1b6e49ce6c0d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80348) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 07:59:57.131360 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-170f3265-763f-438e-a627-1b6e49ce6c0d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 07:59:57.133202 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-170f3265-763f-438e-a627-1b6e49ce6c0d None admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 07:59:57.144407 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b5211c-b5e7-48a3-aebb-e08a67243a63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 07:59:57.145440 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b5211c-b5e7-48a3-aebb-e08a67243a63 None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 07:59:57.145894 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b5211c-b5e7-48a3-aebb-e08a67243a63 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 07:59:57.146346 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b5211c-b5e7-48a3-aebb-e08a67243a63 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 07:59:57.160803 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8b5211c-b5e7-48a3-aebb-e08a67243a63 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 07:59:57.160998 dv-cinder-851351-1-smb devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 406/849] 10.222.0.42 () {56 vars in 1109 bytes} [Thu Jul 28 07:59:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 07:59:57.165824 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-170f3265-763f-438e-a627-1b6e49ce6c0d None admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 07:59:57.168188 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8b5211c-b5e7-48a3-aebb-e08a67243a63 None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 07:59:57.181728 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application [None req-c8b5211c-b5e7-48a3-aebb-e08a67243a63 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 28 07:59:57.181728 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 07:59:57.181728 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 07:59:57.181728 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 07:59:57.181728 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 07:59:57.181728 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 07:59:57.181728 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 07:59:57.181728 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 07:59:57.181728 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 07:59:57.181728 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 07:59:57.181728 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 07:59:57.181728 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 07:59:57.181728 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 28 07:59:57.181728 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 28 07:59:57.181728 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 28 07:59:57.181728 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 28 07:59:57.182776 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 07:59:57.182776 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 07:59:57.182776 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 28 07:59:57.182776 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 07:59:57.182776 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 28 07:59:57.182776 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 07:59:57.182776 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 07:59:57.182776 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 07:59:57.182776 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 07:59:57.182776 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 07:59:57.182776 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 07:59:57.182776 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application with Lock( Jul 28 07:59:57.182776 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 07:59:57.182776 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._enter() Jul 28 07:59:57.182776 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 07:59:57.182776 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 07:59:57.182776 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 07:59:57.182776 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.creator() Jul 28 07:59:57.183719 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 07:59:57.183719 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application created_value = creator( Jul 28 07:59:57.183719 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 28 07:59:57.183719 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 28 07:59:57.183719 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 28 07:59:57.183719 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 28 07:59:57.183719 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 28 07:59:57.183719 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 28 07:59:57.183719 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 28 07:59:57.183719 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application Jul 28 07:59:57.190895 dv-cinder-851351-1-smb devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 444/850] 10.222.0.42 () {56 vars in 1117 bytes} [Thu Jul 28 07:59:56 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 07:59:57.192858 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b5211c-b5e7-48a3-aebb-e08a67243a63 None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 07:59:57.302463 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b5211c-b5e7-48a3-aebb-e08a67243a63 None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 07:59:57.315560 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-170f3265-763f-438e-a627-1b6e49ce6c0d None admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 07:59:57.339626 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24470bb4-4d08-4ef9-a79f-a51ebd23d0c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 07:59:57.340740 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24470bb4-4d08-4ef9-a79f-a51ebd23d0c8 None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 07:59:57.341231 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24470bb4-4d08-4ef9-a79f-a51ebd23d0c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 07:59:57.341804 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24470bb4-4d08-4ef9-a79f-a51ebd23d0c8 None admin] PATH_INFO: `/v3/users` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 07:59:57.342810 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24470bb4-4d08-4ef9-a79f-a51ebd23d0c8 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 07:59:57.343419 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24470bb4-4d08-4ef9-a79f-a51ebd23d0c8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 07:59:57.345313 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24470bb4-4d08-4ef9-a79f-a51ebd23d0c8 None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 07:59:57.353289 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1136ff2f-c261-41ca-bcea-f3b5b047981d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 07:59:57.354018 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1136ff2f-c261-41ca-bcea-f3b5b047981d None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 07:59:57.354298 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1136ff2f-c261-41ca-bcea-f3b5b047981d None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 07:59:57.354592 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1136ff2f-c261-41ca-bcea-f3b5b047981d None admin] PATH_INFO: `/v3/users/swift` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 07:59:57.363309 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1136ff2f-c261-41ca-bcea-f3b5b047981d None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 07:59:57.364865 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1136ff2f-c261-41ca-bcea-f3b5b047981d None admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 07:59:57.372256 dv-cinder-851351-1-smb devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 445/851] 10.222.0.42 () {56 vars in 1149 bytes} [Thu Jul 28 07:59:57 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 07:59:57.373484 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24470bb4-4d08-4ef9-a79f-a51ebd23d0c8 None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 07:59:57.378304 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application [None req-1136ff2f-c261-41ca-bcea-f3b5b047981d None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 28 07:59:57.378304 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 07:59:57.378304 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 07:59:57.378304 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 07:59:57.378304 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 07:59:57.378304 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 07:59:57.378304 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 07:59:57.378304 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 07:59:57.378304 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 07:59:57.378304 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 07:59:57.378304 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 07:59:57.378304 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 07:59:57.378304 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 28 07:59:57.378304 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 28 07:59:57.378304 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 28 07:59:57.378304 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 28 07:59:57.379237 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 07:59:57.379237 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 07:59:57.379237 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 28 07:59:57.379237 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 07:59:57.379237 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 28 07:59:57.379237 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 07:59:57.379237 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 07:59:57.379237 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 07:59:57.379237 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 07:59:57.379237 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 07:59:57.379237 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 07:59:57.379237 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application with Lock( Jul 28 07:59:57.379237 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 07:59:57.379237 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self._enter() Jul 28 07:59:57.379237 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 07:59:57.379237 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 07:59:57.379237 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 07:59:57.379237 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.creator() Jul 28 07:59:57.380173 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 07:59:57.380173 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application created_value = creator( Jul 28 07:59:57.380173 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 28 07:59:57.380173 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 28 07:59:57.380173 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 28 07:59:57.380173 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 28 07:59:57.380173 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 28 07:59:57.380173 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 28 07:59:57.380173 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 28 07:59:57.380173 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application Jul 28 07:59:57.384346 dv-cinder-851351-1-smb devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 407/852] 10.222.0.42 () {56 vars in 1096 bytes} [Thu Jul 28 07:59:57 2022] GET /identity/v3/users/swift => generated 83 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 07:59:57.385715 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1136ff2f-c261-41ca-bcea-f3b5b047981d None admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 07:59:57.399940 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=100 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 07:59:57.401904 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 07:59:57.495125 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24470bb4-4d08-4ef9-a79f-a51ebd23d0c8 None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 07:59:57.509419 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1136ff2f-c261-41ca-bcea-f3b5b047981d None admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 07:59:57.531775 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c9d81a5-7de4-4488-acbe-acaec06521de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 07:59:57.532833 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9d81a5-7de4-4488-acbe-acaec06521de None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 07:59:57.533312 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9d81a5-7de4-4488-acbe-acaec06521de None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 07:59:57.533804 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9d81a5-7de4-4488-acbe-acaec06521de None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 07:59:57.548207 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c8e524-bbb1-4927-841f-7d745aebcf09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 07:59:57.549055 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c8e524-bbb1-4927-841f-7d745aebcf09 None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 07:59:57.549337 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c8e524-bbb1-4927-841f-7d745aebcf09 None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 07:59:57.549655 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c8e524-bbb1-4927-841f-7d745aebcf09 None admin] PATH_INFO: `/v3/users` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 07:59:57.550467 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5c8e524-bbb1-4927-841f-7d745aebcf09 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80348) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 07:59:57.550776 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5c8e524-bbb1-4927-841f-7d745aebcf09 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 07:59:57.552433 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5c8e524-bbb1-4927-841f-7d745aebcf09 None admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 07:59:57.579566 dv-cinder-851351-1-smb devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 408/853] 10.222.0.42 () {56 vars in 1135 bytes} [Thu Jul 28 07:59:57 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 07:59:57.581185 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c8e524-bbb1-4927-841f-7d745aebcf09 None admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 07:59:57.613303 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c9d81a5-7de4-4488-acbe-acaec06521de None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 07:59:57.615131 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c9d81a5-7de4-4488-acbe-acaec06521de None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 07:59:57.637683 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 07:59:57.660277 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=100 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 07:59:57.700518 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c8e524-bbb1-4927-841f-7d745aebcf09 None admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 07:59:57.728433 dv-cinder-851351-1-smb devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 446/854] 10.222.0.42 () {58 vars in 1282 bytes} [Thu Jul 28 07:59:57 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 351 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 28 07:59:57.729898 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c9d81a5-7de4-4488-acbe-acaec06521de None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 07:59:57.744154 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9dec02-42b9-4ff2-bd7c-a4f50dbd5acf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 07:59:57.745006 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9dec02-42b9-4ff2-bd7c-a4f50dbd5acf None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 07:59:57.745223 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9dec02-42b9-4ff2-bd7c-a4f50dbd5acf None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 07:59:57.745497 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9dec02-42b9-4ff2-bd7c-a4f50dbd5acf None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 07:59:57.825554 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d9dec02-42b9-4ff2-bd7c-a4f50dbd5acf None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 07:59:57.829444 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d9dec02-42b9-4ff2-bd7c-a4f50dbd5acf None admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 07:59:57.849220 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c9d81a5-7de4-4488-acbe-acaec06521de None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 07:59:57.877536 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 07:59:57.896604 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f23aacf4-0d3a-4431-bedd-a882cbb89848 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 07:59:57.897382 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23aacf4-0d3a-4431-bedd-a882cbb89848 None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 07:59:57.897757 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23aacf4-0d3a-4431-bedd-a882cbb89848 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 07:59:57.898321 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23aacf4-0d3a-4431-bedd-a882cbb89848 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 07:59:57.909365 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f23aacf4-0d3a-4431-bedd-a882cbb89848 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 07:59:57.910964 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f23aacf4-0d3a-4431-bedd-a882cbb89848 None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 07:59:57.918368 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=100 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 07:59:57.927067 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application [None req-f23aacf4-0d3a-4431-bedd-a882cbb89848 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 07:59:57.927067 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 07:59:57.927067 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 07:59:57.927067 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 07:59:57.927067 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 07:59:57.927067 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 07:59:57.927067 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 07:59:57.927067 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 07:59:57.927067 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 07:59:57.927067 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 07:59:57.927067 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 07:59:57.927067 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 07:59:57.927067 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 07:59:57.927067 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 07:59:57.927067 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 07:59:57.928189 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 07:59:57.928189 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 07:59:57.928189 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 07:59:57.928189 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 07:59:57.928189 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 07:59:57.928189 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 07:59:57.928189 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 07:59:57.928189 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 07:59:57.928189 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application with Lock( Jul 28 07:59:57.928189 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 07:59:57.928189 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._enter() Jul 28 07:59:57.928189 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 07:59:57.928189 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 07:59:57.928189 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 07:59:57.928189 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.creator() Jul 28 07:59:57.928189 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 07:59:57.928189 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application created_value = creator( Jul 28 07:59:57.929349 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 07:59:57.929349 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 07:59:57.929349 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 07:59:57.929349 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application Jul 28 07:59:57.935266 dv-cinder-851351-1-smb devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 447/855] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 07:59:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 07:59:57.936311 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f23aacf4-0d3a-4431-bedd-a882cbb89848 None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 07:59:57.968246 dv-cinder-851351-1-smb devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 409/856] 10.222.0.42 () {58 vars in 1282 bytes} [Thu Jul 28 07:59:57 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 383 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 28 07:59:57.970155 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9dec02-42b9-4ff2-bd7c-a4f50dbd5acf None admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 07:59:58.041541 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f23aacf4-0d3a-4431-bedd-a882cbb89848 None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 07:59:58.077521 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826d2781-7504-4547-b5f1-184fd432bfd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 07:59:58.078323 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826d2781-7504-4547-b5f1-184fd432bfd7 None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 07:59:58.079084 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826d2781-7504-4547-b5f1-184fd432bfd7 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 07:59:58.079426 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826d2781-7504-4547-b5f1-184fd432bfd7 None admin] PATH_INFO: `/v3/domains` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 07:59:58.080456 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-826d2781-7504-4547-b5f1-184fd432bfd7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 07:59:58.080562 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-826d2781-7504-4547-b5f1-184fd432bfd7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 07:59:58.081995 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-826d2781-7504-4547-b5f1-184fd432bfd7 None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 07:59:58.083559 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9dec02-42b9-4ff2-bd7c-a4f50dbd5acf None admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 07:59:58.095279 dv-cinder-851351-1-smb devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 448/857] 10.222.0.42 () {56 vars in 1109 bytes} [Thu Jul 28 07:59:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 07:59:58.096515 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0860d4ac-eed2-4e56-92ee-7b5f97896ac0 None None] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 07:59:58.096889 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0860d4ac-eed2-4e56-92ee-7b5f97896ac0 None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 07:59:58.097229 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0860d4ac-eed2-4e56-92ee-7b5f97896ac0 None None] PATH_INFO: `/` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 07:59:58.098707 dv-cinder-851351-1-smb devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 449/858] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 07:59:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 07:59:58.103658 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0860d4ac-eed2-4e56-92ee-7b5f97896ac0 None None] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 07:59:58.133324 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e1155f-7906-4ebd-965b-399882875ad6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 07:59:58.134181 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e1155f-7906-4ebd-965b-399882875ad6 None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 07:59:58.134458 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e1155f-7906-4ebd-965b-399882875ad6 None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 07:59:58.134778 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e1155f-7906-4ebd-965b-399882875ad6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 07:59:58.141060 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 07:59:58.146869 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0e1155f-7906-4ebd-965b-399882875ad6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 07:59:58.148356 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0e1155f-7906-4ebd-965b-399882875ad6 None admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 07:59:58.165370 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application [None req-a0e1155f-7906-4ebd-965b-399882875ad6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 07:59:58.165370 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 07:59:58.165370 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 07:59:58.165370 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 07:59:58.165370 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 07:59:58.165370 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 07:59:58.165370 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 07:59:58.165370 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 07:59:58.165370 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 07:59:58.165370 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 07:59:58.165370 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 07:59:58.165370 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 07:59:58.165370 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 07:59:58.165370 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 07:59:58.165370 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 07:59:58.167242 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 07:59:58.167242 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 07:59:58.167242 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 07:59:58.167242 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 07:59:58.167242 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 07:59:58.167242 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 07:59:58.167242 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 07:59:58.167242 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 07:59:58.167242 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application with Lock( Jul 28 07:59:58.167242 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 07:59:58.167242 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self._enter() Jul 28 07:59:58.167242 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 07:59:58.167242 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 07:59:58.167242 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 07:59:58.167242 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.creator() Jul 28 07:59:58.167242 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 07:59:58.167242 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application created_value = creator( Jul 28 07:59:58.169526 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 07:59:58.169526 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 07:59:58.169526 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 07:59:58.169526 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application Jul 28 07:59:58.171378 dv-cinder-851351-1-smb devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 410/859] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 07:59:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 07:59:58.172805 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ecbdce3-db83-4f05-8b6a-667ea311429b None None] REQUEST_METHOD: `POST` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 07:59:58.173101 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ecbdce3-db83-4f05-8b6a-667ea311429b None None] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 07:59:58.173372 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ecbdce3-db83-4f05-8b6a-667ea311429b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 07:59:58.193381 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.auth.core [None req-5ecbdce3-db83-4f05-8b6a-667ea311429b None None] MFA Rules not processed for user `f0666d3a50644a7097367331c1ee1a68`. Rule list: `[]` (Enabled: `True`). {{(pid=80348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 07:59:58.194590 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.fernet_utils [None req-5ecbdce3-db83-4f05-8b6a-667ea311429b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 07:59:58.212353 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=100 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 07:59:58.272755 dv-cinder-851351-1-smb devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 411/860] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 07:59:58 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 07:59:58.272755 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ecbdce3-db83-4f05-8b6a-667ea311429b None None] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 07:59:58.283456 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0860d4ac-eed2-4e56-92ee-7b5f97896ac0 None None] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 07:59:58.322527 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be3e66e-934c-480e-8901-7cfd74ddd8a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 07:59:58.323313 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be3e66e-934c-480e-8901-7cfd74ddd8a9 None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 07:59:58.323587 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be3e66e-934c-480e-8901-7cfd74ddd8a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 07:59:58.323851 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be3e66e-934c-480e-8901-7cfd74ddd8a9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 07:59:58.331562 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1be3e66e-934c-480e-8901-7cfd74ddd8a9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 07:59:58.333026 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1be3e66e-934c-480e-8901-7cfd74ddd8a9 None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 07:59:58.345130 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application [None req-1be3e66e-934c-480e-8901-7cfd74ddd8a9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 07:59:58.345130 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 07:59:58.345130 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 07:59:58.345130 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 07:59:58.345130 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 07:59:58.345130 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 07:59:58.345130 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 07:59:58.345130 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 07:59:58.345130 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 07:59:58.345130 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 07:59:58.345130 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 07:59:58.345130 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 07:59:58.345130 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 28 07:59:58.345130 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 28 07:59:58.345130 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 28 07:59:58.346082 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 28 07:59:58.346082 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 07:59:58.346082 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 07:59:58.346082 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 07:59:58.346082 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 07:59:58.346082 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 07:59:58.346082 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 07:59:58.346082 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 07:59:58.346082 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application with Lock( Jul 28 07:59:58.346082 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 07:59:58.346082 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._enter() Jul 28 07:59:58.346082 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 07:59:58.346082 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 07:59:58.346082 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 07:59:58.346082 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.creator() Jul 28 07:59:58.346082 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 07:59:58.346082 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application created_value = creator( Jul 28 07:59:58.347074 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 28 07:59:58.347074 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 28 07:59:58.347074 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 28 07:59:58.347074 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 28 07:59:58.347074 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 28 07:59:58.347074 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 28 07:59:58.347074 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 07:59:58.347074 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application Jul 28 07:59:58.347074 dv-cinder-851351-1-smb devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 450/861] 10.222.0.42 () {56 vars in 1111 bytes} [Thu Jul 28 07:59:58 2022] GET /identity/v3/projects/service => generated 88 bytes in 243 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 07:59:58.347074 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be3e66e-934c-480e-8901-7cfd74ddd8a9 None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 07:59:58.390812 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ecbdce3-db83-4f05-8b6a-667ea311429b None None] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 07:59:58.425260 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f42c0db-f803-4db9-8b2a-bdcbb86e3679 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 07:59:58.425897 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f42c0db-f803-4db9-8b2a-bdcbb86e3679 None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 07:59:58.426166 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f42c0db-f803-4db9-8b2a-bdcbb86e3679 None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 07:59:58.426431 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f42c0db-f803-4db9-8b2a-bdcbb86e3679 None admin] PATH_INFO: `/v3/domains` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 07:59:58.427128 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f42c0db-f803-4db9-8b2a-bdcbb86e3679 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80348) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 07:59:58.427427 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f42c0db-f803-4db9-8b2a-bdcbb86e3679 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 07:59:58.428849 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f42c0db-f803-4db9-8b2a-bdcbb86e3679 None admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 07:59:58.440503 dv-cinder-851351-1-smb devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 412/862] 10.222.0.42 () {56 vars in 1109 bytes} [Thu Jul 28 07:59:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 07:59:58.441483 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f42c0db-f803-4db9-8b2a-bdcbb86e3679 None admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 07:59:58.454328 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 07:59:58.456552 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=100 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 07:59:58.465607 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be3e66e-934c-480e-8901-7cfd74ddd8a9 None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 07:59:58.503172 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce351a1a-a6a6-41c2-b9e1-a743cb68ee63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 07:59:58.503803 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce351a1a-a6a6-41c2-b9e1-a743cb68ee63 None admin] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 07:59:58.504223 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce351a1a-a6a6-41c2-b9e1-a743cb68ee63 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 07:59:58.504499 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce351a1a-a6a6-41c2-b9e1-a743cb68ee63 None admin] PATH_INFO: `/v3/services` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 07:59:58.505225 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce351a1a-a6a6-41c2-b9e1-a743cb68ee63 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 07:59:58.506617 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce351a1a-a6a6-41c2-b9e1-a743cb68ee63 None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 07:59:58.525995 dv-cinder-851351-1-smb devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 451/863] 10.222.0.42 () {60 vars in 1141 bytes} [Thu Jul 28 07:59:58 2022] POST /identity/v3/services => generated 251 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 07:59:58.529578 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce351a1a-a6a6-41c2-b9e1-a743cb68ee63 None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 07:59:58.568766 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f42c0db-f803-4db9-8b2a-bdcbb86e3679 None admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 07:59:58.617152 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054b0f71-852e-43b9-9045-955b49332ea8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 07:59:58.617804 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054b0f71-852e-43b9-9045-955b49332ea8 None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 07:59:58.618082 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054b0f71-852e-43b9-9045-955b49332ea8 None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 07:59:58.618349 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054b0f71-852e-43b9-9045-955b49332ea8 None admin] PATH_INFO: `/v3/projects` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 07:59:58.619195 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-054b0f71-852e-43b9-9045-955b49332ea8 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80348) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 07:59:58.619509 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-054b0f71-852e-43b9-9045-955b49332ea8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 07:59:58.621044 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-054b0f71-852e-43b9-9045-955b49332ea8 None admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 07:59:58.639756 dv-cinder-851351-1-smb devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 413/864] 10.222.0.42 () {56 vars in 1148 bytes} [Thu Jul 28 07:59:58 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 07:59:58.641197 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090111b1-c5b0-4b27-92f2-ffa479c392ce None None] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 07:59:58.641426 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090111b1-c5b0-4b27-92f2-ffa479c392ce None None] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 07:59:58.641694 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090111b1-c5b0-4b27-92f2-ffa479c392ce None None] PATH_INFO: `/` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 07:59:58.647432 dv-cinder-851351-1-smb devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 414/865] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 07:59:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 07:59:58.647432 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090111b1-c5b0-4b27-92f2-ffa479c392ce None None] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 07:59:58.666817 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce351a1a-a6a6-41c2-b9e1-a743cb68ee63 None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 07:59:58.704525 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cfcb316-0e57-4527-aae3-091626422abe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 07:59:58.705212 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cfcb316-0e57-4527-aae3-091626422abe None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 07:59:58.705490 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cfcb316-0e57-4527-aae3-091626422abe None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 07:59:58.705758 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cfcb316-0e57-4527-aae3-091626422abe None admin] PATH_INFO: `/v3/projects/service` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 07:59:58.713187 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cfcb316-0e57-4527-aae3-091626422abe None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 07:59:58.714687 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cfcb316-0e57-4527-aae3-091626422abe None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 07:59:58.728790 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application [None req-4cfcb316-0e57-4527-aae3-091626422abe None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 07:59:58.728790 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 07:59:58.728790 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 07:59:58.728790 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 07:59:58.728790 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 07:59:58.728790 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 07:59:58.728790 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 07:59:58.728790 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 07:59:58.728790 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 07:59:58.728790 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 07:59:58.728790 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 07:59:58.728790 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 07:59:58.728790 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 28 07:59:58.728790 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 28 07:59:58.728790 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 28 07:59:58.729882 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 28 07:59:58.729882 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 07:59:58.729882 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 07:59:58.729882 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 07:59:58.729882 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 07:59:58.729882 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 07:59:58.729882 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 07:59:58.729882 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 07:59:58.729882 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application with Lock( Jul 28 07:59:58.729882 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 07:59:58.729882 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._enter() Jul 28 07:59:58.729882 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 07:59:58.729882 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 07:59:58.729882 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 07:59:58.729882 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.creator() Jul 28 07:59:58.729882 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 07:59:58.729882 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application created_value = creator( Jul 28 07:59:58.730882 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 28 07:59:58.730882 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 28 07:59:58.730882 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 28 07:59:58.730882 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 28 07:59:58.730882 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 28 07:59:58.730882 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 28 07:59:58.730882 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 07:59:58.730882 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application Jul 28 07:59:58.731358 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=100 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 07:59:58.731764 dv-cinder-851351-1-smb devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 452/866] 10.222.0.42 () {56 vars in 1111 bytes} [Thu Jul 28 07:59:58 2022] GET /identity/v3/projects/service => generated 88 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 07:59:58.732277 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2e0add-8669-4381-add0-bd1d3851ff3b None None] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 07:59:58.732560 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2e0add-8669-4381-add0-bd1d3851ff3b None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 07:59:58.732889 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2e0add-8669-4381-add0-bd1d3851ff3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 07:59:58.752798 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.auth.core [None req-1a2e0add-8669-4381-add0-bd1d3851ff3b None None] MFA Rules not processed for user `f0666d3a50644a7097367331c1ee1a68`. Rule list: `[]` (Enabled: `True`). {{(pid=80347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 07:59:58.754092 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-1a2e0add-8669-4381-add0-bd1d3851ff3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 07:59:58.762939 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 07:59:58.774227 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090111b1-c5b0-4b27-92f2-ffa479c392ce None None] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 07:59:58.811175 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b39f56-4b1b-4e50-a4ee-b570a4872c9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 07:59:58.811813 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b39f56-4b1b-4e50-a4ee-b570a4872c9d None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 07:59:58.812089 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b39f56-4b1b-4e50-a4ee-b570a4872c9d None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 07:59:58.812362 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b39f56-4b1b-4e50-a4ee-b570a4872c9d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 07:59:58.813199 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b39f56-4b1b-4e50-a4ee-b570a4872c9d None admin] RBAC: Adding query filter params (role.id=a2d02bc3295c4a33b1fc0775a17a79e6, scope.project.id=139349507026497c98f360774dee737e, user.id=4a92b0d2802e46f4beffaaf39ed6723c) {{(pid=80348) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 07:59:58.813509 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b39f56-4b1b-4e50-a4ee-b570a4872c9d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 07:59:58.814949 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b39f56-4b1b-4e50-a4ee-b570a4872c9d None admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 07:59:58.821611 dv-cinder-851351-1-smb devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 415/867] 10.222.0.42 () {56 vars in 1374 bytes} [Thu Jul 28 07:59:58 2022] GET /identity/v3/role_assignments?user.id=4a92b0d2802e46f4beffaaf39ed6723c&scope.project.id=139349507026497c98f360774dee737e&role.id=a2d02bc3295c4a33b1fc0775a17a79e6 => generated 608 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 07:59:58.822508 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b39f56-4b1b-4e50-a4ee-b570a4872c9d None admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 07:59:58.854559 dv-cinder-851351-1-smb devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 453/868] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 07:59:58 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 07:59:58.898816 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a2e0add-8669-4381-add0-bd1d3851ff3b None None] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 07:59:58.957130 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b39f56-4b1b-4e50-a4ee-b570a4872c9d None admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 07:59:59.003818 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=100 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 07:59:59.013887 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-531134d4-0ff7-41b4-a198-15d6fcf0de8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 07:59:59.015228 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531134d4-0ff7-41b4-a198-15d6fcf0de8c None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 07:59:59.015649 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531134d4-0ff7-41b4-a198-15d6fcf0de8c None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 07:59:59.016227 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531134d4-0ff7-41b4-a198-15d6fcf0de8c None admin] PATH_INFO: `/v3/projects` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 07:59:59.017532 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-531134d4-0ff7-41b4-a198-15d6fcf0de8c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80348) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 07:59:59.018109 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-531134d4-0ff7-41b4-a198-15d6fcf0de8c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 07:59:59.020084 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-531134d4-0ff7-41b4-a198-15d6fcf0de8c None admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 07:59:59.023474 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a2e0add-8669-4381-add0-bd1d3851ff3b None None] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 07:59:59.038776 dv-cinder-851351-1-smb devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 416/869] 10.222.0.42 () {56 vars in 1148 bytes} [Thu Jul 28 07:59:58 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 07:59:59.045425 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-531134d4-0ff7-41b4-a198-15d6fcf0de8c None admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 07:59:59.072468 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d1e8959-a4df-42da-bca7-21b18a80fa30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 07:59:59.073176 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1e8959-a4df-42da-bca7-21b18a80fa30 None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 07:59:59.073445 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1e8959-a4df-42da-bca7-21b18a80fa30 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 07:59:59.073714 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1e8959-a4df-42da-bca7-21b18a80fa30 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 07:59:59.074355 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d1e8959-a4df-42da-bca7-21b18a80fa30 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 07:59:59.076240 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d1e8959-a4df-42da-bca7-21b18a80fa30 None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 07:59:59.087042 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application [None req-7d1e8959-a4df-42da-bca7-21b18a80fa30 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 28 07:59:59.087042 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 07:59:59.087042 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 28 07:59:59.087042 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 28 07:59:59.087042 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 28 07:59:59.087042 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 28 07:59:59.087042 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 28 07:59:59.087042 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 07:59:59.087042 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 28 07:59:59.087042 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application Jul 28 07:59:59.087042 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 28 07:59:59.087042 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application Jul 28 07:59:59.087042 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 07:59:59.087042 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 07:59:59.087042 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 07:59:59.087042 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 07:59:59.088067 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 07:59:59.088067 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 07:59:59.088067 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 07:59:59.088067 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 07:59:59.088067 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 07:59:59.088067 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 07:59:59.088067 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 07:59:59.088067 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 28 07:59:59.088067 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 28 07:59:59.088067 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 28 07:59:59.088067 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 28 07:59:59.088067 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 07:59:59.088067 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 07:59:59.088067 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 07:59:59.088067 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 07:59:59.088067 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 07:59:59.088918 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 07:59:59.088918 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 07:59:59.088918 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application with Lock( Jul 28 07:59:59.088918 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 07:59:59.088918 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._enter() Jul 28 07:59:59.088918 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 07:59:59.088918 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 07:59:59.088918 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 07:59:59.088918 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.creator() Jul 28 07:59:59.088918 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 07:59:59.088918 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application created_value = creator( Jul 28 07:59:59.088918 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 28 07:59:59.088918 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 07:59:59.088918 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 28 07:59:59.088918 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application Jul 28 07:59:59.089683 dv-cinder-851351-1-smb devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 454/870] 10.222.0.42 () {56 vars in 1132 bytes} [Thu Jul 28 07:59:58 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 07:59:59.096228 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d1e8959-a4df-42da-bca7-21b18a80fa30 None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 07:59:59.109087 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 07:59:59.186541 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-531134d4-0ff7-41b4-a198-15d6fcf0de8c None admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 07:59:59.226749 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7add42ce-5fd0-430f-a6a7-53e852878481 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 07:59:59.227677 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7add42ce-5fd0-430f-a6a7-53e852878481 None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 07:59:59.228167 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7add42ce-5fd0-430f-a6a7-53e852878481 None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 07:59:59.228768 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7add42ce-5fd0-430f-a6a7-53e852878481 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 07:59:59.229877 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7add42ce-5fd0-430f-a6a7-53e852878481 None admin] RBAC: Adding query filter params (role.id=362bd71ac01249fb8fa635381993eec1, scope.project.id=139349507026497c98f360774dee737e, user.id=fe8c81659f704e14b8f0e00856a5a9a5) {{(pid=80348) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 07:59:59.230355 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7add42ce-5fd0-430f-a6a7-53e852878481 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 07:59:59.232057 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7add42ce-5fd0-430f-a6a7-53e852878481 None admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 07:59:59.235690 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d1e8959-a4df-42da-bca7-21b18a80fa30 None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 07:59:59.239383 dv-cinder-851351-1-smb devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 417/871] 10.222.0.42 () {56 vars in 1374 bytes} [Thu Jul 28 07:59:59 2022] GET /identity/v3/role_assignments?user.id=fe8c81659f704e14b8f0e00856a5a9a5&scope.project.id=139349507026497c98f360774dee737e&role.id=362bd71ac01249fb8fa635381993eec1 => generated 608 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 07:59:59.283629 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e454fcb-6fb1-42fb-a0b2-395ae4736cb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 07:59:59.284274 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e454fcb-6fb1-42fb-a0b2-395ae4736cb7 None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 07:59:59.284548 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e454fcb-6fb1-42fb-a0b2-395ae4736cb7 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 07:59:59.284853 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e454fcb-6fb1-42fb-a0b2-395ae4736cb7 None admin] PATH_INFO: `/v3/services` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 07:59:59.285551 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e454fcb-6fb1-42fb-a0b2-395ae4736cb7 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 07:59:59.285851 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e454fcb-6fb1-42fb-a0b2-395ae4736cb7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 07:59:59.287247 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e454fcb-6fb1-42fb-a0b2-395ae4736cb7 None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 07:59:59.293136 dv-cinder-851351-1-smb devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 455/872] 10.222.0.42 () {56 vars in 1126 bytes} [Thu Jul 28 07:59:59 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 07:59:59.299180 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7add42ce-5fd0-430f-a6a7-53e852878481 None admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 07:59:59.375103 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=100 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 07:59:59.427358 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7add42ce-5fd0-430f-a6a7-53e852878481 None admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 07:59:59.462181 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1061dc-3bf6-4a8e-9126-ba44d5e34ea1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 07:59:59.462852 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1061dc-3bf6-4a8e-9126-ba44d5e34ea1 None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 07:59:59.463163 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1061dc-3bf6-4a8e-9126-ba44d5e34ea1 None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 07:59:59.463439 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1061dc-3bf6-4a8e-9126-ba44d5e34ea1 None admin] PATH_INFO: `/v3/services` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 07:59:59.464129 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae1061dc-3bf6-4a8e-9126-ba44d5e34ea1 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80348) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 07:59:59.464432 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae1061dc-3bf6-4a8e-9126-ba44d5e34ea1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 07:59:59.465939 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae1061dc-3bf6-4a8e-9126-ba44d5e34ea1 None admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 07:59:59.471129 dv-cinder-851351-1-smb devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 418/873] 10.222.0.42 () {56 vars in 1126 bytes} [Thu Jul 28 07:59:59 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:00:00.608895 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9d48a5-989e-4cb4-8a3b-cc2197f780de None None] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:00:00.609500 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9d48a5-989e-4cb4-8a3b-cc2197f780de None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:00:00.609500 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9d48a5-989e-4cb4-8a3b-cc2197f780de None None] PATH_INFO: `/` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:00:00.611050 dv-cinder-851351-1-smb devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 456/874] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 08:00:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 08:00:00.616623 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac71570e-c6cc-4fb3-9a47-05b969b01613 None None] REQUEST_METHOD: `POST` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:00:00.617128 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac71570e-c6cc-4fb3-9a47-05b969b01613 None None] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:00:00.617227 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac71570e-c6cc-4fb3-9a47-05b969b01613 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:00:00.635680 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.auth.core [None req-ac71570e-c6cc-4fb3-9a47-05b969b01613 None None] MFA Rules not processed for user `f0666d3a50644a7097367331c1ee1a68`. Rule list: `[]` (Enabled: `True`). {{(pid=80348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 08:00:00.636914 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.fernet_utils [None req-ac71570e-c6cc-4fb3-9a47-05b969b01613 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:00:00.711660 dv-cinder-851351-1-smb devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 419/875] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 08:00:00 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 08:00:00.739358 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a9d48a5-989e-4cb4-8a3b-cc2197f780de None None] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:00:00.811585 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:00:00.844246 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a9d48a5-989e-4cb4-8a3b-cc2197f780de None None] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:00:00.879928 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfeede58-a8d0-4a19-9d95-732f977271d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:00:00.880496 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfeede58-a8d0-4a19-9d95-732f977271d1 None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:00:00.880804 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfeede58-a8d0-4a19-9d95-732f977271d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:00:00.881072 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfeede58-a8d0-4a19-9d95-732f977271d1 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:00:00.881702 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfeede58-a8d0-4a19-9d95-732f977271d1 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:00:00.883062 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfeede58-a8d0-4a19-9d95-732f977271d1 None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:00:00.892293 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application [None req-dfeede58-a8d0-4a19-9d95-732f977271d1 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 28 08:00:00.892293 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:00:00.892293 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 28 08:00:00.892293 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 28 08:00:00.892293 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 28 08:00:00.892293 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 28 08:00:00.892293 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 28 08:00:00.892293 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 08:00:00.892293 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 28 08:00:00.892293 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application Jul 28 08:00:00.892293 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 28 08:00:00.892293 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application Jul 28 08:00:00.892293 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:00:00.892293 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:00:00.892293 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:00:00.892293 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:00:00.892293 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:00:00.893397 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:00:00.893397 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:00:00.893397 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:00:00.893397 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:00:00.893397 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:00:00.893397 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:00:00.893397 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 28 08:00:00.893397 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 28 08:00:00.893397 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 28 08:00:00.893397 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 28 08:00:00.893397 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:00:00.893397 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:00:00.893397 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:00:00.893397 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:00:00.893397 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:00:00.893397 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:00:00.894295 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:00:00.894295 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application with Lock( Jul 28 08:00:00.894295 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:00:00.894295 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:00:00.894295 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:00:00.894295 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:00:00.894295 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:00:00.894295 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:00:00.894295 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:00:00.894295 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:00:00.894295 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 28 08:00:00.894295 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 08:00:00.894295 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 28 08:00:00.894295 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application Jul 28 08:00:00.894295 dv-cinder-851351-1-smb devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 457/876] 10.222.0.42 () {56 vars in 1114 bytes} [Thu Jul 28 08:00:00 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:00:00.900053 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac71570e-c6cc-4fb3-9a47-05b969b01613 None None] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:00:00.950602 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=100 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:00:01.007685 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac71570e-c6cc-4fb3-9a47-05b969b01613 None None] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:00:01.027082 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3f606e-efa9-4797-9626-ed61dd97cfa3 None None] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:00:01.027374 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3f606e-efa9-4797-9626-ed61dd97cfa3 None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:00:01.027648 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3f606e-efa9-4797-9626-ed61dd97cfa3 None None] PATH_INFO: `/` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:00:01.029316 dv-cinder-851351-1-smb devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 458/877] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 08:00:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 28 08:00:01.034578 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263d12ee-73f8-43b3-b9ea-2593d1e1588a None None] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:00:01.034862 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263d12ee-73f8-43b3-b9ea-2593d1e1588a None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:00:01.035144 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263d12ee-73f8-43b3-b9ea-2593d1e1588a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:00:01.047649 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14cb71db-1701-4354-9b3a-c7d8d3f48bb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:00:01.048685 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14cb71db-1701-4354-9b3a-c7d8d3f48bb1 None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:00:01.049159 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14cb71db-1701-4354-9b3a-c7d8d3f48bb1 None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:00:01.049622 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14cb71db-1701-4354-9b3a-c7d8d3f48bb1 None admin] PATH_INFO: `/v3/services` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:00:01.050500 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14cb71db-1701-4354-9b3a-c7d8d3f48bb1 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80348) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:00:01.050991 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14cb71db-1701-4354-9b3a-c7d8d3f48bb1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:00:01.052571 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14cb71db-1701-4354-9b3a-c7d8d3f48bb1 None admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:00:01.054850 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.auth.core [None req-263d12ee-73f8-43b3-b9ea-2593d1e1588a None None] MFA Rules not processed for user `f0666d3a50644a7097367331c1ee1a68`. Rule list: `[]` (Enabled: `True`). {{(pid=80347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 08:00:01.056713 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-263d12ee-73f8-43b3-b9ea-2593d1e1588a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:00:01.063543 dv-cinder-851351-1-smb devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 420/878] 10.222.0.42 () {56 vars in 1114 bytes} [Thu Jul 28 08:00:00 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:00:01.065152 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14cb71db-1701-4354-9b3a-c7d8d3f48bb1 None admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:00:01.148841 dv-cinder-851351-1-smb devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 459/879] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 08:00:01 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 28 08:00:01.179499 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263d12ee-73f8-43b3-b9ea-2593d1e1588a None None] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:00:01.212028 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14cb71db-1701-4354-9b3a-c7d8d3f48bb1 None admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:00:01.238964 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=100 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:00:01.268509 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:00:01.279252 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55455b4-8213-4ab8-bbed-ef5978ce946e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:00:01.281054 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55455b4-8213-4ab8-bbed-ef5978ce946e None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:00:01.285066 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55455b4-8213-4ab8-bbed-ef5978ce946e None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:00:01.285427 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55455b4-8213-4ab8-bbed-ef5978ce946e None admin] PATH_INFO: `/v3/services` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:00:01.286913 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e55455b4-8213-4ab8-bbed-ef5978ce946e None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80348) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:00:01.287263 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e55455b4-8213-4ab8-bbed-ef5978ce946e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:00:01.290160 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e55455b4-8213-4ab8-bbed-ef5978ce946e None admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:00:01.298891 dv-cinder-851351-1-smb devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 421/880] 10.222.0.42 () {56 vars in 1114 bytes} [Thu Jul 28 08:00:01 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 08:00:01.304364 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55455b4-8213-4ab8-bbed-ef5978ce946e None admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:00:01.319881 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263d12ee-73f8-43b3-b9ea-2593d1e1588a None None] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:00:01.367741 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a9fb79e-4570-4441-a433-c94dd90fe03f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:00:01.368494 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9fb79e-4570-4441-a433-c94dd90fe03f None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:00:01.369098 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9fb79e-4570-4441-a433-c94dd90fe03f None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:00:01.369392 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9fb79e-4570-4441-a433-c94dd90fe03f None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:00:01.384552 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a9fb79e-4570-4441-a433-c94dd90fe03f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 08:00:01.389788 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application [None req-5a9fb79e-4570-4441-a433-c94dd90fe03f None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 28 08:00:01.389788 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:00:01.389788 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:00:01.389788 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:00:01.389788 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:00:01.389788 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:00:01.389788 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:00:01.389788 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:00:01.389788 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:00:01.389788 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:00:01.389788 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:00:01.389788 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:00:01.389788 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 08:00:01.389788 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 08:00:01.389788 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 08:00:01.389788 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 08:00:01.390935 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 08:00:01.390935 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 08:00:01.390935 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 08:00:01.390935 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 08:00:01.390935 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:00:01.390935 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:00:01.390935 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:00:01.390935 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:00:01.390935 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:00:01.390935 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:00:01.390935 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:00:01.390935 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application with Lock( Jul 28 08:00:01.390935 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:00:01.390935 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:00:01.390935 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:00:01.390935 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:00:01.391932 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:00:01.391932 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:00:01.391932 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:00:01.391932 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:00:01.391932 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 08:00:01.391932 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 08:00:01.391932 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 08:00:01.391932 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 08:00:01.391932 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 08:00:01.391932 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 08:00:01.391932 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 28 08:00:01.391932 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application Jul 28 08:00:01.391932 dv-cinder-851351-1-smb devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 460/881] 10.222.0.42 () {56 vars in 1120 bytes} [Thu Jul 28 08:00:01 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:00:01.392821 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e9f9fb-263f-4b0c-81d9-c26d9c9140c9 None None] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:00:01.392821 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e9f9fb-263f-4b0c-81d9-c26d9c9140c9 None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:00:01.392821 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e9f9fb-263f-4b0c-81d9-c26d9c9140c9 None None] PATH_INFO: `/` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:00:01.394867 dv-cinder-851351-1-smb devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 461/882] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 08:00:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 08:00:01.401925 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e9f9fb-263f-4b0c-81d9-c26d9c9140c9 None None] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:00:01.447088 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55455b4-8213-4ab8-bbed-ef5978ce946e None admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:00:01.498841 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690873d8-1443-4026-8b5e-0e858da81218 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:00:01.499698 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690873d8-1443-4026-8b5e-0e858da81218 None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:00:01.500107 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690873d8-1443-4026-8b5e-0e858da81218 None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:00:01.500532 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690873d8-1443-4026-8b5e-0e858da81218 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:00:01.502076 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-690873d8-1443-4026-8b5e-0e858da81218 None admin] RBAC: Adding query filter params (interface=public, service_id=a4fff1bbfa2a49d8a4fde8496673e6e6, region_id=RegionOne) {{(pid=80348) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:00:01.502076 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-690873d8-1443-4026-8b5e-0e858da81218 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:00:01.503848 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-690873d8-1443-4026-8b5e-0e858da81218 None admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:00:01.511536 dv-cinder-851351-1-smb devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 422/883] 10.222.0.42 () {56 vars in 1251 bytes} [Thu Jul 28 08:00:01 2022] GET /identity/v3/endpoints?service_id=a4fff1bbfa2a49d8a4fde8496673e6e6&interface=public®ion_id=RegionOne => generated 194 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 08:00:01.512920 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f30b54b-b5ca-411e-aa64-c8fb80236e3a None None] REQUEST_METHOD: `POST` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:00:01.513322 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f30b54b-b5ca-411e-aa64-c8fb80236e3a None None] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:00:01.513740 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f30b54b-b5ca-411e-aa64-c8fb80236e3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:00:01.540071 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.auth.core [None req-6f30b54b-b5ca-411e-aa64-c8fb80236e3a None None] MFA Rules not processed for user `f0666d3a50644a7097367331c1ee1a68`. Rule list: `[]` (Enabled: `True`). {{(pid=80348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 08:00:01.541886 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.fernet_utils [None req-6f30b54b-b5ca-411e-aa64-c8fb80236e3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:00:01.545286 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e9f9fb-263f-4b0c-81d9-c26d9c9140c9 None None] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:00:01.581945 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:00:01.589562 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=100 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:00:01.596477 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45117eee-641c-4471-ac1e-a9cfa9f5b42d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:00:01.597318 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45117eee-641c-4471-ac1e-a9cfa9f5b42d None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:00:01.597585 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45117eee-641c-4471-ac1e-a9cfa9f5b42d None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:00:01.597862 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45117eee-641c-4471-ac1e-a9cfa9f5b42d None admin] PATH_INFO: `/v3/roles` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:00:01.598724 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45117eee-641c-4471-ac1e-a9cfa9f5b42d None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:00:01.599153 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45117eee-641c-4471-ac1e-a9cfa9f5b42d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:00:01.600522 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45117eee-641c-4471-ac1e-a9cfa9f5b42d None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:00:01.612602 dv-cinder-851351-1-smb devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 462/884] 10.222.0.42 () {56 vars in 1115 bytes} [Thu Jul 28 08:00:01 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 08:00:01.613747 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45117eee-641c-4471-ac1e-a9cfa9f5b42d None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:00:01.636963 dv-cinder-851351-1-smb devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 423/885] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 08:00:01 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 08:00:01.639370 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c193e925-b43b-4f7b-9324-da465a56ada8 None None] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:00:01.639756 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c193e925-b43b-4f7b-9324-da465a56ada8 None None] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:00:01.640210 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c193e925-b43b-4f7b-9324-da465a56ada8 None None] PATH_INFO: `/` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:00:01.641831 dv-cinder-851351-1-smb devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 424/886] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 08:00:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 08:00:01.642563 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c193e925-b43b-4f7b-9324-da465a56ada8 None None] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:00:01.735188 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45117eee-641c-4471-ac1e-a9cfa9f5b42d None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:00:01.769424 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c193e925-b43b-4f7b-9324-da465a56ada8 None None] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:00:01.781041 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f3fabdf-a237-4697-8cef-f55bb688b9ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:00:01.781669 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3fabdf-a237-4697-8cef-f55bb688b9ec None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:00:01.781942 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3fabdf-a237-4697-8cef-f55bb688b9ec None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:00:01.782233 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3fabdf-a237-4697-8cef-f55bb688b9ec None admin] PATH_INFO: `/v3/services` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:00:01.782859 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f3fabdf-a237-4697-8cef-f55bb688b9ec None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:00:01.784259 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f3fabdf-a237-4697-8cef-f55bb688b9ec None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:00:01.797098 dv-cinder-851351-1-smb devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 463/887] 10.222.0.42 () {56 vars in 1087 bytes} [Thu Jul 28 08:00:01 2022] GET /identity/v3/services => generated 1011 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 08:00:01.798547 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1533e6e2-6831-4710-88c8-2ac6a14f19a1 None None] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:00:01.798967 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1533e6e2-6831-4710-88c8-2ac6a14f19a1 None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:00:01.799128 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1533e6e2-6831-4710-88c8-2ac6a14f19a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:00:01.816647 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59abd2d0-a0d6-415f-9a1c-f2eb0693ecf7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:00:01.817837 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59abd2d0-a0d6-415f-9a1c-f2eb0693ecf7 None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:00:01.818326 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59abd2d0-a0d6-415f-9a1c-f2eb0693ecf7 None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:00:01.818824 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59abd2d0-a0d6-415f-9a1c-f2eb0693ecf7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:00:01.820340 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.auth.core [None req-1533e6e2-6831-4710-88c8-2ac6a14f19a1 None None] MFA Rules not processed for user `f0666d3a50644a7097367331c1ee1a68`. Rule list: `[]` (Enabled: `True`). {{(pid=80347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 08:00:01.821671 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-1533e6e2-6831-4710-88c8-2ac6a14f19a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:00:01.839060 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59abd2d0-a0d6-415f-9a1c-f2eb0693ecf7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:00:01.841333 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59abd2d0-a0d6-415f-9a1c-f2eb0693ecf7 None admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:00:01.860385 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application [None req-59abd2d0-a0d6-415f-9a1c-f2eb0693ecf7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 08:00:01.860385 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:00:01.860385 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:00:01.860385 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:00:01.860385 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:00:01.860385 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:00:01.860385 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:00:01.860385 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:00:01.860385 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:00:01.860385 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:00:01.860385 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:00:01.860385 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:00:01.860385 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 08:00:01.860385 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 08:00:01.860385 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 08:00:01.861669 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 08:00:01.861669 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:00:01.861669 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:00:01.861669 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:00:01.861669 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:00:01.861669 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:00:01.861669 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:00:01.861669 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:00:01.861669 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application with Lock( Jul 28 08:00:01.861669 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:00:01.861669 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:00:01.861669 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:00:01.861669 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:00:01.861669 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:00:01.861669 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:00:01.861669 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:00:01.861669 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:00:01.862725 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 08:00:01.862725 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 08:00:01.862725 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 08:00:01.862725 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application Jul 28 08:00:01.866813 dv-cinder-851351-1-smb devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 425/888] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 08:00:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:00:01.867844 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59abd2d0-a0d6-415f-9a1c-f2eb0693ecf7 None admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:00:01.887963 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:00:01.902640 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=100 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:00:01.926126 dv-cinder-851351-1-smb devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 464/889] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 08:00:01 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 08:00:01.926126 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1533e6e2-6831-4710-88c8-2ac6a14f19a1 None None] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:00:02.022528 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59abd2d0-a0d6-415f-9a1c-f2eb0693ecf7 None admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:00:02.056887 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1533e6e2-6831-4710-88c8-2ac6a14f19a1 None None] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:00:02.068822 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566e943e-09ee-4917-985a-73e0eb4e6185 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:00:02.069452 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566e943e-09ee-4917-985a-73e0eb4e6185 None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:00:02.069727 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566e943e-09ee-4917-985a-73e0eb4e6185 None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:00:02.070070 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566e943e-09ee-4917-985a-73e0eb4e6185 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:00:02.070943 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-566e943e-09ee-4917-985a-73e0eb4e6185 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:00:02.072337 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-566e943e-09ee-4917-985a-73e0eb4e6185 None admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:00:02.082959 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application [None req-566e943e-09ee-4917-985a-73e0eb4e6185 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 28 08:00:02.082959 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:00:02.082959 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 28 08:00:02.082959 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 28 08:00:02.082959 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 28 08:00:02.082959 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 28 08:00:02.082959 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 28 08:00:02.082959 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 08:00:02.082959 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 28 08:00:02.082959 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application Jul 28 08:00:02.082959 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 28 08:00:02.082959 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application Jul 28 08:00:02.082959 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:00:02.082959 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:00:02.082959 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:00:02.082959 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:00:02.082959 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:00:02.084060 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:00:02.084060 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:00:02.084060 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:00:02.084060 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:00:02.084060 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:00:02.084060 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:00:02.084060 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 28 08:00:02.084060 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 28 08:00:02.084060 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 28 08:00:02.084060 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 28 08:00:02.084060 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:00:02.084060 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:00:02.084060 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:00:02.084060 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:00:02.084060 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:00:02.084060 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:00:02.085361 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:00:02.085361 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application with Lock( Jul 28 08:00:02.085361 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:00:02.085361 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:00:02.085361 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:00:02.085361 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:00:02.085361 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:00:02.085361 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:00:02.085361 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:00:02.085361 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:00:02.085361 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 28 08:00:02.085361 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 08:00:02.085361 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 28 08:00:02.085361 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application Jul 28 08:00:02.085361 dv-cinder-851351-1-smb devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 426/890] 10.222.0.42 () {56 vars in 1126 bytes} [Thu Jul 28 08:00:01 2022] GET /identity/v3/services/object-store => generated 93 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:00:02.086147 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566e943e-09ee-4917-985a-73e0eb4e6185 None admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:00:02.106708 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de41b98-ed32-4b9a-b977-b8fbe5a71612 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:00:02.107346 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de41b98-ed32-4b9a-b977-b8fbe5a71612 None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:00:02.107624 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de41b98-ed32-4b9a-b977-b8fbe5a71612 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:00:02.107910 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de41b98-ed32-4b9a-b977-b8fbe5a71612 None admin] PATH_INFO: `/v3/domains` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:00:02.108582 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de41b98-ed32-4b9a-b977-b8fbe5a71612 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:00:02.108911 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de41b98-ed32-4b9a-b977-b8fbe5a71612 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:00:02.110269 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de41b98-ed32-4b9a-b977-b8fbe5a71612 None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:00:02.127536 dv-cinder-851351-1-smb devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 465/891] 10.222.0.42 () {56 vars in 1109 bytes} [Thu Jul 28 08:00:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:00:02.129734 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de41b98-ed32-4b9a-b977-b8fbe5a71612 None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:00:02.193824 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:00:02.214598 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=100 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:00:02.233800 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566e943e-09ee-4917-985a-73e0eb4e6185 None admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:00:02.277714 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de41b98-ed32-4b9a-b977-b8fbe5a71612 None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:00:02.280508 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39aed650-deee-484a-97bb-5c98030bf424 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:00:02.281595 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39aed650-deee-484a-97bb-5c98030bf424 None admin] REQUEST_METHOD: `POST` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:00:02.282012 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39aed650-deee-484a-97bb-5c98030bf424 None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:00:02.282414 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39aed650-deee-484a-97bb-5c98030bf424 None admin] PATH_INFO: `/v3/services` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:00:02.283275 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39aed650-deee-484a-97bb-5c98030bf424 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:00:02.284910 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39aed650-deee-484a-97bb-5c98030bf424 None admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:00:02.306955 dv-cinder-851351-1-smb devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 427/892] 10.222.0.42 () {60 vars in 1141 bytes} [Thu Jul 28 08:00:02 2022] POST /identity/v3/services => generated 269 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 08:00:02.306955 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39aed650-deee-484a-97bb-5c98030bf424 None admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:00:02.355003 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5072e1-bef5-4e65-941a-81a855699351 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:00:02.356823 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5072e1-bef5-4e65-941a-81a855699351 None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:00:02.357469 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5072e1-bef5-4e65-941a-81a855699351 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:00:02.358090 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5072e1-bef5-4e65-941a-81a855699351 None admin] PATH_INFO: `/v3/services` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:00:02.359154 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf5072e1-bef5-4e65-941a-81a855699351 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:00:02.359947 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf5072e1-bef5-4e65-941a-81a855699351 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:00:02.362391 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf5072e1-bef5-4e65-941a-81a855699351 None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:00:02.371913 dv-cinder-851351-1-smb devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 466/893] 10.222.0.42 () {56 vars in 1122 bytes} [Thu Jul 28 08:00:02 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:00:02.379445 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5072e1-bef5-4e65-941a-81a855699351 None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:00:02.498836 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39aed650-deee-484a-97bb-5c98030bf424 None admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:00:02.526641 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5072e1-bef5-4e65-941a-81a855699351 None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:00:02.529160 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:00:02.557999 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4bc7b98-8474-45db-894e-9a372712f5b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:00:02.559033 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4bc7b98-8474-45db-894e-9a372712f5b8 None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:00:02.559232 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4bc7b98-8474-45db-894e-9a372712f5b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:00:02.559668 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4bc7b98-8474-45db-894e-9a372712f5b8 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:00:02.570038 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4bc7b98-8474-45db-894e-9a372712f5b8 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:00:02.571675 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4bc7b98-8474-45db-894e-9a372712f5b8 None admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:00:02.585147 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01bed43c-9891-49cf-bc1a-7d0c03aaf662 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:00:02.586182 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01bed43c-9891-49cf-bc1a-7d0c03aaf662 None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:00:02.586758 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01bed43c-9891-49cf-bc1a-7d0c03aaf662 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:00:02.587195 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application [None req-f4bc7b98-8474-45db-894e-9a372712f5b8 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 28 08:00:02.587195 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:00:02.587195 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:00:02.587195 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:00:02.587195 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:00:02.587195 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:00:02.587195 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:00:02.587195 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:00:02.587195 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:00:02.587195 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:00:02.587195 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:00:02.587195 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:00:02.587195 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 28 08:00:02.587195 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 28 08:00:02.587195 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 28 08:00:02.587195 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 28 08:00:02.588182 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:00:02.588182 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:00:02.588182 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 28 08:00:02.588182 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 08:00:02.588182 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 28 08:00:02.588182 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 08:00:02.588182 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:00:02.588182 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:00:02.588182 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:00:02.588182 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:00:02.588182 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:00:02.588182 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application with Lock( Jul 28 08:00:02.588182 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:00:02.588182 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:00:02.588182 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:00:02.588182 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:00:02.588182 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:00:02.588182 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:00:02.589326 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:00:02.589326 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:00:02.589326 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 28 08:00:02.589326 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 28 08:00:02.589326 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 28 08:00:02.589326 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 28 08:00:02.589326 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 28 08:00:02.589326 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 28 08:00:02.589326 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 28 08:00:02.589326 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application Jul 28 08:00:02.589326 dv-cinder-851351-1-smb devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 428/894] 10.222.0.42 () {56 vars in 1117 bytes} [Thu Jul 28 08:00:02 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 282 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:00:02.589944 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01bed43c-9891-49cf-bc1a-7d0c03aaf662 None admin] PATH_INFO: `/v3/services` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:00:02.589944 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01bed43c-9891-49cf-bc1a-7d0c03aaf662 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:00:02.589944 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01bed43c-9891-49cf-bc1a-7d0c03aaf662 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:00:02.596173 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01bed43c-9891-49cf-bc1a-7d0c03aaf662 None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:00:02.597135 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4bc7b98-8474-45db-894e-9a372712f5b8 None admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:00:02.598793 dv-cinder-851351-1-smb devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 467/895] 10.222.0.42 () {56 vars in 1122 bytes} [Thu Jul 28 08:00:02 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:00:02.616685 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:00:02.743810 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4bc7b98-8474-45db-894e-9a372712f5b8 None admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:00:02.788593 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c3bd58-01f5-43aa-8270-d916804efefc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:00:02.788593 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c3bd58-01f5-43aa-8270-d916804efefc None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:00:02.788593 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c3bd58-01f5-43aa-8270-d916804efefc None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:00:02.789293 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c3bd58-01f5-43aa-8270-d916804efefc None admin] PATH_INFO: `/v3/users` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:00:02.789801 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c3bd58-01f5-43aa-8270-d916804efefc None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80348) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:00:02.790199 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c3bd58-01f5-43aa-8270-d916804efefc None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:00:02.792011 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c3bd58-01f5-43aa-8270-d916804efefc None admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:00:02.813458 dv-cinder-851351-1-smb devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 429/896] 10.222.0.42 () {56 vars in 1149 bytes} [Thu Jul 28 08:00:02 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 08:00:02.822541 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01bed43c-9891-49cf-bc1a-7d0c03aaf662 None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:00:02.947519 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01bed43c-9891-49cf-bc1a-7d0c03aaf662 None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:00:02.988510 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d67e4f-daf6-44a8-8f3f-41d3620e9e9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:00:02.989268 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d67e4f-daf6-44a8-8f3f-41d3620e9e9f None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:00:02.989721 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d67e4f-daf6-44a8-8f3f-41d3620e9e9f None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:00:02.990013 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d67e4f-daf6-44a8-8f3f-41d3620e9e9f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:00:03.034028 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:00:03.082736 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5d67e4f-daf6-44a8-8f3f-41d3620e9e9f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:00:03.084230 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5d67e4f-daf6-44a8-8f3f-41d3620e9e9f None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:00:03.204785 dv-cinder-851351-1-smb devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 468/897] 10.222.0.42 () {58 vars in 1282 bytes} [Thu Jul 28 08:00:02 2022] GET /identity/v3/auth/tokens => generated 1362 bytes in 379 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 28 08:00:03.207454 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c3bd58-01f5-43aa-8270-d916804efefc None admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:00:03.275735 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=100 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:00:03.323845 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c3bd58-01f5-43aa-8270-d916804efefc None admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:00:03.366021 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-305e4572-ae02-430b-bde2-f2dc7616cc86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:00:03.366679 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305e4572-ae02-430b-bde2-f2dc7616cc86 None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:00:03.366956 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305e4572-ae02-430b-bde2-f2dc7616cc86 None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:00:03.367298 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305e4572-ae02-430b-bde2-f2dc7616cc86 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:00:03.379214 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-305e4572-ae02-430b-bde2-f2dc7616cc86 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:00:03.380958 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-305e4572-ae02-430b-bde2-f2dc7616cc86 None admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:00:03.398907 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application [None req-305e4572-ae02-430b-bde2-f2dc7616cc86 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 08:00:03.398907 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:00:03.398907 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:00:03.398907 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:00:03.398907 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:00:03.398907 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:00:03.398907 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:00:03.398907 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:00:03.398907 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:00:03.398907 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:00:03.398907 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:00:03.398907 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:00:03.398907 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 08:00:03.398907 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 08:00:03.398907 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 08:00:03.399924 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 08:00:03.399924 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:00:03.399924 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:00:03.399924 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:00:03.399924 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:00:03.399924 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:00:03.399924 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:00:03.399924 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:00:03.399924 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application with Lock( Jul 28 08:00:03.399924 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:00:03.399924 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:00:03.399924 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:00:03.399924 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:00:03.399924 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:00:03.399924 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:00:03.399924 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:00:03.399924 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:00:03.400950 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 08:00:03.400950 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 08:00:03.400950 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 08:00:03.400950 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application Jul 28 08:00:03.404773 dv-cinder-851351-1-smb devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 430/898] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 08:00:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:00:03.406653 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d67e4f-daf6-44a8-8f3f-41d3620e9e9f None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:00:03.485080 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:00:03.523176 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d67e4f-daf6-44a8-8f3f-41d3620e9e9f None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:00:03.561065 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c57d10a-8d0b-481f-8ada-491dd1b7baac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:00:03.561699 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c57d10a-8d0b-481f-8ada-491dd1b7baac None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:00:03.561977 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c57d10a-8d0b-481f-8ada-491dd1b7baac None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:00:03.562274 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c57d10a-8d0b-481f-8ada-491dd1b7baac None admin] PATH_INFO: `/v3/domains` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:00:03.563107 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c57d10a-8d0b-481f-8ada-491dd1b7baac None admin] RBAC: Adding query filter params (name=Default) {{(pid=80347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:00:03.563409 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c57d10a-8d0b-481f-8ada-491dd1b7baac None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:00:03.565026 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c57d10a-8d0b-481f-8ada-491dd1b7baac None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:00:03.583930 dv-cinder-851351-1-smb devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 469/899] 10.222.0.42 () {56 vars in 1109 bytes} [Thu Jul 28 08:00:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:00:03.585735 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-305e4572-ae02-430b-bde2-f2dc7616cc86 None admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:00:03.702850 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-305e4572-ae02-430b-bde2-f2dc7616cc86 None admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:00:03.727345 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=100 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:00:03.750144 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e69696-1e0e-44f7-bf50-79fae6e09664 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:00:03.751753 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e69696-1e0e-44f7-bf50-79fae6e09664 None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:00:03.752249 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e69696-1e0e-44f7-bf50-79fae6e09664 None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:00:03.752801 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e69696-1e0e-44f7-bf50-79fae6e09664 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:00:03.761111 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9e69696-1e0e-44f7-bf50-79fae6e09664 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:00:03.762931 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9e69696-1e0e-44f7-bf50-79fae6e09664 None admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:00:03.776160 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application [None req-a9e69696-1e0e-44f7-bf50-79fae6e09664 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 08:00:03.776160 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:00:03.776160 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:00:03.776160 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:00:03.776160 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:00:03.776160 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:00:03.776160 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:00:03.776160 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:00:03.776160 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:00:03.776160 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:00:03.776160 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:00:03.776160 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:00:03.776160 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 28 08:00:03.776160 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 28 08:00:03.776160 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 28 08:00:03.777227 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 28 08:00:03.777227 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:00:03.777227 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:00:03.777227 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:00:03.777227 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:00:03.777227 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:00:03.777227 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:00:03.777227 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:00:03.777227 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application with Lock( Jul 28 08:00:03.777227 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:00:03.777227 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:00:03.777227 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:00:03.777227 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:00:03.777227 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:00:03.777227 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:00:03.777227 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:00:03.777227 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:00:03.778122 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 28 08:00:03.778122 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 28 08:00:03.778122 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 28 08:00:03.778122 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 28 08:00:03.778122 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 28 08:00:03.778122 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 28 08:00:03.778122 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 08:00:03.778122 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application Jul 28 08:00:03.780859 dv-cinder-851351-1-smb devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 431/900] 10.222.0.42 () {56 vars in 1111 bytes} [Thu Jul 28 08:00:03 2022] GET /identity/v3/projects/service => generated 88 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:00:03.787941 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c57d10a-8d0b-481f-8ada-491dd1b7baac None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:00:03.905080 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c57d10a-8d0b-481f-8ada-491dd1b7baac None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:00:03.909193 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402d8b0b-05c5-4c93-a96a-0daced44dafe None None] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:00:03.909778 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402d8b0b-05c5-4c93-a96a-0daced44dafe None None] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:00:03.910380 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402d8b0b-05c5-4c93-a96a-0daced44dafe None None] PATH_INFO: `/` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:00:03.913522 dv-cinder-851351-1-smb devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 432/901] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 08:00:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 08:00:03.918522 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b9841a-ec15-405e-8275-31020e26ea08 None None] REQUEST_METHOD: `POST` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:00:03.919150 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b9841a-ec15-405e-8275-31020e26ea08 None None] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:00:03.919776 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b9841a-ec15-405e-8275-31020e26ea08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:00:03.931545 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:00:03.946047 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.auth.core [None req-28b9841a-ec15-405e-8275-31020e26ea08 None None] MFA Rules not processed for user `f0666d3a50644a7097367331c1ee1a68`. Rule list: `[]` (Enabled: `True`). {{(pid=80348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 08:00:03.947422 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.fernet_utils [None req-28b9841a-ec15-405e-8275-31020e26ea08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:00:03.954100 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070fec21-74b2-475f-a23c-4fb6616c822e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:00:03.955339 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070fec21-74b2-475f-a23c-4fb6616c822e None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:00:03.956104 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070fec21-74b2-475f-a23c-4fb6616c822e None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:00:03.956810 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070fec21-74b2-475f-a23c-4fb6616c822e None admin] PATH_INFO: `/v3/projects` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:00:03.959106 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-070fec21-74b2-475f-a23c-4fb6616c822e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:00:03.960205 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-070fec21-74b2-475f-a23c-4fb6616c822e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:00:03.962753 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-070fec21-74b2-475f-a23c-4fb6616c822e None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:00:03.991921 dv-cinder-851351-1-smb devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 470/902] 10.222.0.42 () {56 vars in 1148 bytes} [Thu Jul 28 08:00:03 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:00:03.995136 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070fec21-74b2-475f-a23c-4fb6616c822e None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:00:04.057164 dv-cinder-851351-1-smb devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 433/903] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 08:00:03 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 28 08:00:04.083698 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b9841a-ec15-405e-8275-31020e26ea08 None None] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:00:04.140888 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070fec21-74b2-475f-a23c-4fb6616c822e None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:00:04.196458 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ef70bc-862b-483c-8021-6603b8e209d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:00:04.197223 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ef70bc-862b-483c-8021-6603b8e209d9 None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:00:04.197506 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ef70bc-862b-483c-8021-6603b8e209d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:00:04.197830 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ef70bc-862b-483c-8021-6603b8e209d9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:00:04.199129 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38ef70bc-862b-483c-8021-6603b8e209d9 None admin] RBAC: Adding query filter params (role.id=a2ca675df8464a35b15d0c6795636b90, scope.project.id=139349507026497c98f360774dee737e, user.id=4a92b0d2802e46f4beffaaf39ed6723c) {{(pid=80347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:00:04.199440 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38ef70bc-862b-483c-8021-6603b8e209d9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:00:04.201177 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38ef70bc-862b-483c-8021-6603b8e209d9 None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:00:04.216295 dv-cinder-851351-1-smb devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 471/904] 10.222.0.42 () {56 vars in 1374 bytes} [Thu Jul 28 08:00:03 2022] GET /identity/v3/role_assignments?user.id=4a92b0d2802e46f4beffaaf39ed6723c&scope.project.id=139349507026497c98f360774dee737e&role.id=a2ca675df8464a35b15d0c6795636b90 => generated 259 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:00:04.268724 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b9841a-ec15-405e-8275-31020e26ea08 None None] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:00:04.278554 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=100 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:00:04.324428 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99621fc1-f25a-4e38-9051-949f4eab284e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:00:04.325943 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99621fc1-f25a-4e38-9051-949f4eab284e None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:00:04.326621 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99621fc1-f25a-4e38-9051-949f4eab284e None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:00:04.327270 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99621fc1-f25a-4e38-9051-949f4eab284e None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:00:04.329000 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99621fc1-f25a-4e38-9051-949f4eab284e None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:00:04.331782 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99621fc1-f25a-4e38-9051-949f4eab284e None admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:00:04.347848 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application [None req-99621fc1-f25a-4e38-9051-949f4eab284e None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 28 08:00:04.347848 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:00:04.347848 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 28 08:00:04.347848 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 28 08:00:04.347848 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 28 08:00:04.347848 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 28 08:00:04.347848 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 28 08:00:04.347848 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 08:00:04.347848 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 28 08:00:04.347848 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application Jul 28 08:00:04.347848 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 28 08:00:04.347848 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application Jul 28 08:00:04.347848 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:00:04.347848 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:00:04.347848 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:00:04.347848 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:00:04.347848 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:00:04.348985 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:00:04.348985 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:00:04.348985 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:00:04.348985 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:00:04.348985 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:00:04.348985 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:00:04.348985 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 28 08:00:04.348985 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 28 08:00:04.348985 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 28 08:00:04.348985 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 28 08:00:04.348985 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:00:04.348985 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:00:04.348985 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:00:04.348985 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:00:04.348985 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:00:04.348985 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:00:04.349828 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:00:04.349828 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application with Lock( Jul 28 08:00:04.349828 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:00:04.349828 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:00:04.349828 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:00:04.349828 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:00:04.349828 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:00:04.349828 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:00:04.349828 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:00:04.349828 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:00:04.349828 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 28 08:00:04.349828 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 08:00:04.349828 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 28 08:00:04.349828 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application Jul 28 08:00:04.350769 dv-cinder-851351-1-smb devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 434/905] 10.222.0.42 () {56 vars in 1114 bytes} [Thu Jul 28 08:00:04 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 267 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:00:04.357910 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ef70bc-862b-483c-8021-6603b8e209d9 None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:00:04.416327 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:00:04.471789 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ef70bc-862b-483c-8021-6603b8e209d9 None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:00:04.508068 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3011b002-6393-433c-89a0-ef58d74665b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:00:04.508745 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3011b002-6393-433c-89a0-ef58d74665b9 None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:00:04.509274 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3011b002-6393-433c-89a0-ef58d74665b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:00:04.509588 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3011b002-6393-433c-89a0-ef58d74665b9 None admin] PATH_INFO: `/v3/services` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:00:04.510282 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3011b002-6393-433c-89a0-ef58d74665b9 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:00:04.510580 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3011b002-6393-433c-89a0-ef58d74665b9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:00:04.512039 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3011b002-6393-433c-89a0-ef58d74665b9 None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:00:04.517755 dv-cinder-851351-1-smb devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 472/906] 10.222.0.42 () {56 vars in 1114 bytes} [Thu Jul 28 08:00:04 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:00:04.523598 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99621fc1-f25a-4e38-9051-949f4eab284e None admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:00:04.635135 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99621fc1-f25a-4e38-9051-949f4eab284e None admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:00:04.672236 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49a24e7-d3f0-4752-9890-ad03d6360aa7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:00:04.673304 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49a24e7-d3f0-4752-9890-ad03d6360aa7 None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:00:04.673781 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49a24e7-d3f0-4752-9890-ad03d6360aa7 None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:00:04.674269 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49a24e7-d3f0-4752-9890-ad03d6360aa7 None admin] PATH_INFO: `/v3/services` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:00:04.675148 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a49a24e7-d3f0-4752-9890-ad03d6360aa7 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80348) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:00:04.675644 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a49a24e7-d3f0-4752-9890-ad03d6360aa7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:00:04.677276 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a49a24e7-d3f0-4752-9890-ad03d6360aa7 None admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:00:04.687894 dv-cinder-851351-1-smb devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 435/907] 10.222.0.42 () {56 vars in 1114 bytes} [Thu Jul 28 08:00:04 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:00:04.689639 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3011b002-6393-433c-89a0-ef58d74665b9 None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:00:04.770840 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9f863f-a3ca-44e6-a2bb-8a15bfba13be None None] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:00:04.771438 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9f863f-a3ca-44e6-a2bb-8a15bfba13be None None] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:00:04.771438 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9f863f-a3ca-44e6-a2bb-8a15bfba13be None None] PATH_INFO: `/` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:00:04.773005 dv-cinder-851351-1-smb devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 436/908] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 08:00:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 28 08:00:04.778683 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec465fd3-b37f-43f7-976b-1dee7386f852 None None] REQUEST_METHOD: `POST` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:00:04.778989 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec465fd3-b37f-43f7-976b-1dee7386f852 None None] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:00:04.779288 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec465fd3-b37f-43f7-976b-1dee7386f852 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:00:04.799215 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.auth.core [None req-ec465fd3-b37f-43f7-976b-1dee7386f852 None None] MFA Rules not processed for user `f0666d3a50644a7097367331c1ee1a68`. Rule list: `[]` (Enabled: `True`). {{(pid=80348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 08:00:04.800537 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.fernet_utils [None req-ec465fd3-b37f-43f7-976b-1dee7386f852 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:00:04.826396 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3011b002-6393-433c-89a0-ef58d74665b9 None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:00:04.838172 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=100 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:00:04.841186 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:00:04.863707 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb71dba-7486-46ea-bf0d-3f6e3f744c23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:00:04.864461 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb71dba-7486-46ea-bf0d-3f6e3f744c23 None admin] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:00:04.865350 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb71dba-7486-46ea-bf0d-3f6e3f744c23 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:00:04.865350 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb71dba-7486-46ea-bf0d-3f6e3f744c23 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:00:04.865605 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eb71dba-7486-46ea-bf0d-3f6e3f744c23 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:00:04.867010 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eb71dba-7486-46ea-bf0d-3f6e3f744c23 None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:00:04.892717 dv-cinder-851351-1-smb devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 473/909] 10.222.0.42 () {60 vars in 1144 bytes} [Thu Jul 28 08:00:04 2022] POST /identity/v3/endpoints => generated 346 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 08:00:04.892717 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e434f7-5ad2-4083-b806-ba5737c78540 None None] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:00:04.892717 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e434f7-5ad2-4083-b806-ba5737c78540 None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:00:04.892717 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e434f7-5ad2-4083-b806-ba5737c78540 None None] PATH_INFO: `/` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:00:04.893516 dv-cinder-851351-1-smb devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 474/910] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 08:00:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 08:00:04.900846 dv-cinder-851351-1-smb devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 437/911] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 08:00:04 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 28 08:00:04.911388 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9f601c-6cc7-45b1-be81-1acf21828486 None None] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:00:04.912006 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9f601c-6cc7-45b1-be81-1acf21828486 None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:00:04.912006 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9f601c-6cc7-45b1-be81-1acf21828486 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:00:04.935366 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.auth.core [None req-0f9f601c-6cc7-45b1-be81-1acf21828486 None None] MFA Rules not processed for user `f0666d3a50644a7097367331c1ee1a68`. Rule list: `[]` (Enabled: `True`). {{(pid=80347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 08:00:04.936961 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-0f9f601c-6cc7-45b1-be81-1acf21828486 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:00:04.941433 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec465fd3-b37f-43f7-976b-1dee7386f852 None None] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:00:05.039438 dv-cinder-851351-1-smb devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 475/912] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 08:00:04 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 28 08:00:05.062863 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9f601c-6cc7-45b1-be81-1acf21828486 None None] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:00:05.064317 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec465fd3-b37f-43f7-976b-1dee7386f852 None None] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:00:05.127381 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa5734a-2292-44ba-9e25-ca0caa66f121 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:00:05.128158 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa5734a-2292-44ba-9e25-ca0caa66f121 None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:00:05.128431 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa5734a-2292-44ba-9e25-ca0caa66f121 None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:00:05.128833 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa5734a-2292-44ba-9e25-ca0caa66f121 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:00:05.129543 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa5734a-2292-44ba-9e25-ca0caa66f121 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:00:05.130991 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa5734a-2292-44ba-9e25-ca0caa66f121 None admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:00:05.141108 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application [None req-0fa5734a-2292-44ba-9e25-ca0caa66f121 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 28 08:00:05.141108 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:00:05.141108 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 28 08:00:05.141108 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 28 08:00:05.141108 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 28 08:00:05.141108 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 28 08:00:05.141108 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 28 08:00:05.141108 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 08:00:05.141108 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 28 08:00:05.141108 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application Jul 28 08:00:05.141108 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 28 08:00:05.141108 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application Jul 28 08:00:05.141108 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:00:05.141108 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:00:05.141108 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:00:05.141108 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:00:05.142094 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:00:05.142094 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:00:05.142094 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:00:05.142094 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:00:05.142094 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:00:05.142094 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:00:05.142094 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:00:05.142094 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 28 08:00:05.142094 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 28 08:00:05.142094 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 28 08:00:05.142094 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 28 08:00:05.142094 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:00:05.142094 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:00:05.142094 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:00:05.142094 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:00:05.142094 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:00:05.142938 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:00:05.142938 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:00:05.142938 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application with Lock( Jul 28 08:00:05.142938 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:00:05.142938 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:00:05.142938 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:00:05.142938 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:00:05.142938 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:00:05.142938 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:00:05.142938 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:00:05.142938 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:00:05.142938 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 28 08:00:05.142938 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 08:00:05.142938 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 28 08:00:05.142938 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application Jul 28 08:00:05.142938 dv-cinder-851351-1-smb devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 438/913] 10.222.0.42 () {56 vars in 1132 bytes} [Thu Jul 28 08:00:04 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 08:00:05.148290 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa5734a-2292-44ba-9e25-ca0caa66f121 None admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:00:05.183066 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=100 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:00:05.217291 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:00:05.221592 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9f601c-6cc7-45b1-be81-1acf21828486 None None] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:00:05.258779 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60952116-d221-4240-b4e9-bd2e84de3fec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:00:05.259590 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60952116-d221-4240-b4e9-bd2e84de3fec None admin] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:00:05.259873 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60952116-d221-4240-b4e9-bd2e84de3fec None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:00:05.260145 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60952116-d221-4240-b4e9-bd2e84de3fec None admin] PATH_INFO: `/v3/services` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:00:05.261072 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60952116-d221-4240-b4e9-bd2e84de3fec None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:00:05.262681 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60952116-d221-4240-b4e9-bd2e84de3fec None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:00:05.267606 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa5734a-2292-44ba-9e25-ca0caa66f121 None admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:00:05.281742 dv-cinder-851351-1-smb devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 476/914] 10.222.0.42 () {60 vars in 1141 bytes} [Thu Jul 28 08:00:05 2022] POST /identity/v3/services => generated 241 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 08:00:05.314993 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec03c154-8596-4274-aef8-f0fc4b14cbae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:00:05.315564 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec03c154-8596-4274-aef8-f0fc4b14cbae None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:00:05.315844 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec03c154-8596-4274-aef8-f0fc4b14cbae None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:00:05.316117 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec03c154-8596-4274-aef8-f0fc4b14cbae None admin] PATH_INFO: `/v3/services` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:00:05.316844 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec03c154-8596-4274-aef8-f0fc4b14cbae None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80348) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:00:05.317150 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec03c154-8596-4274-aef8-f0fc4b14cbae None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:00:05.318574 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec03c154-8596-4274-aef8-f0fc4b14cbae None admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:00:05.324776 dv-cinder-851351-1-smb devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 439/915] 10.222.0.42 () {56 vars in 1126 bytes} [Thu Jul 28 08:00:05 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:00:05.330684 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60952116-d221-4240-b4e9-bd2e84de3fec None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:00:05.454476 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60952116-d221-4240-b4e9-bd2e84de3fec None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:00:05.498691 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916ccdec-36c9-43ad-85b4-8f16052c384e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:00:05.499404 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916ccdec-36c9-43ad-85b4-8f16052c384e None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:00:05.499699 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916ccdec-36c9-43ad-85b4-8f16052c384e None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:00:05.499969 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916ccdec-36c9-43ad-85b4-8f16052c384e None admin] PATH_INFO: `/v3/services` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:00:05.500786 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-916ccdec-36c9-43ad-85b4-8f16052c384e None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:00:05.501101 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-916ccdec-36c9-43ad-85b4-8f16052c384e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:00:05.502537 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-916ccdec-36c9-43ad-85b4-8f16052c384e None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:00:05.509708 dv-cinder-851351-1-smb devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 477/916] 10.222.0.42 () {56 vars in 1126 bytes} [Thu Jul 28 08:00:05 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:00:05.515715 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec03c154-8596-4274-aef8-f0fc4b14cbae None admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:00:05.611222 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=100 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:00:05.629010 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec03c154-8596-4274-aef8-f0fc4b14cbae None admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:00:05.664376 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a90f89c9-f8a6-4c86-82f6-0fb2ddf923f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:00:05.665045 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90f89c9-f8a6-4c86-82f6-0fb2ddf923f6 None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:00:05.665318 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90f89c9-f8a6-4c86-82f6-0fb2ddf923f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:00:05.665586 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90f89c9-f8a6-4c86-82f6-0fb2ddf923f6 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:00:05.666460 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a90f89c9-f8a6-4c86-82f6-0fb2ddf923f6 None admin] RBAC: Adding query filter params (interface=public, service_id=7558ac86f5a54d68893e76c4d14f06a6, region_id=RegionOne) {{(pid=80348) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:00:05.666768 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a90f89c9-f8a6-4c86-82f6-0fb2ddf923f6 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:00:05.668181 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a90f89c9-f8a6-4c86-82f6-0fb2ddf923f6 None admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:00:05.674750 dv-cinder-851351-1-smb devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 440/917] 10.222.0.42 () {56 vars in 1251 bytes} [Thu Jul 28 08:00:05 2022] GET /identity/v3/endpoints?service_id=7558ac86f5a54d68893e76c4d14f06a6&interface=public®ion_id=RegionOne => generated 194 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:00:05.680418 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916ccdec-36c9-43ad-85b4-8f16052c384e None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:00:05.710275 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:00:05.804016 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916ccdec-36c9-43ad-85b4-8f16052c384e None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:00:05.848004 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f21a5365-9430-45e3-b0fd-345c756baa81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:00:05.848642 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21a5365-9430-45e3-b0fd-345c756baa81 None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:00:05.848949 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21a5365-9430-45e3-b0fd-345c756baa81 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:00:05.849222 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21a5365-9430-45e3-b0fd-345c756baa81 None admin] PATH_INFO: `/v3/services` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:00:05.849884 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f21a5365-9430-45e3-b0fd-345c756baa81 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:00:05.851270 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f21a5365-9430-45e3-b0fd-345c756baa81 None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:00:05.859166 dv-cinder-851351-1-smb devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 478/918] 10.222.0.42 () {56 vars in 1087 bytes} [Thu Jul 28 08:00:05 2022] GET /identity/v3/services => generated 1497 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 08:00:06.397362 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062e4481-db4e-4697-a04d-234991339e6b None None] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:00:06.397891 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062e4481-db4e-4697-a04d-234991339e6b None None] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:00:06.397891 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062e4481-db4e-4697-a04d-234991339e6b None None] PATH_INFO: `/` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:00:06.399575 dv-cinder-851351-1-smb devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 441/919] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 08:00:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 08:00:06.405009 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e9a9a6-1695-4c41-9101-f411daa71e56 None None] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:00:06.405452 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e9a9a6-1695-4c41-9101-f411daa71e56 None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:00:06.405631 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e9a9a6-1695-4c41-9101-f411daa71e56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:00:06.424780 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.auth.core [None req-28e9a9a6-1695-4c41-9101-f411daa71e56 None None] MFA Rules not processed for user `f0666d3a50644a7097367331c1ee1a68`. Rule list: `[]` (Enabled: `True`). {{(pid=80347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 08:00:06.425907 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-28e9a9a6-1695-4c41-9101-f411daa71e56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:00:06.498061 dv-cinder-851351-1-smb devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 479/920] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 08:00:06 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 28 08:00:06.520652 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-062e4481-db4e-4697-a04d-234991339e6b None None] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:00:06.636137 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-062e4481-db4e-4697-a04d-234991339e6b None None] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:00:06.670974 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb4b159-638f-4792-99b6-f3f3700a21b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:00:06.671627 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb4b159-638f-4792-99b6-f3f3700a21b2 None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:00:06.671901 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb4b159-638f-4792-99b6-f3f3700a21b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:00:06.672170 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb4b159-638f-4792-99b6-f3f3700a21b2 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:00:06.683624 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfb4b159-638f-4792-99b6-f3f3700a21b2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 08:00:06.688967 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application [None req-bfb4b159-638f-4792-99b6-f3f3700a21b2 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 28 08:00:06.688967 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:00:06.688967 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:00:06.688967 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:00:06.688967 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:00:06.688967 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:00:06.688967 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:00:06.688967 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:00:06.688967 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:00:06.688967 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:00:06.688967 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:00:06.688967 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:00:06.688967 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 08:00:06.688967 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 08:00:06.688967 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 08:00:06.688967 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 08:00:06.689896 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 08:00:06.689896 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 08:00:06.689896 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 08:00:06.689896 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 08:00:06.689896 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:00:06.689896 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:00:06.689896 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:00:06.689896 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:00:06.689896 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:00:06.689896 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:00:06.689896 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:00:06.689896 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application with Lock( Jul 28 08:00:06.689896 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:00:06.689896 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:00:06.689896 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:00:06.689896 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:00:06.690735 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:00:06.690735 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:00:06.690735 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:00:06.690735 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:00:06.690735 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 08:00:06.690735 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 08:00:06.690735 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 08:00:06.690735 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 08:00:06.690735 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 08:00:06.690735 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 08:00:06.690735 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 28 08:00:06.690735 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application Jul 28 08:00:06.690735 dv-cinder-851351-1-smb devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 442/921] 10.222.0.42 () {56 vars in 1120 bytes} [Thu Jul 28 08:00:06 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:00:06.698181 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e9a9a6-1695-4c41-9101-f411daa71e56 None None] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:00:06.724508 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:00:06.810078 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e9a9a6-1695-4c41-9101-f411daa71e56 None None] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:00:06.846761 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2197b93-be54-4a52-9b27-68d46a360b02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:00:06.847389 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2197b93-be54-4a52-9b27-68d46a360b02 None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:00:06.847662 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2197b93-be54-4a52-9b27-68d46a360b02 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:00:06.847928 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2197b93-be54-4a52-9b27-68d46a360b02 None admin] PATH_INFO: `/v3/roles` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:00:06.848653 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2197b93-be54-4a52-9b27-68d46a360b02 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:00:06.848977 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2197b93-be54-4a52-9b27-68d46a360b02 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:00:06.850351 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2197b93-be54-4a52-9b27-68d46a360b02 None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:00:06.859796 dv-cinder-851351-1-smb devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 480/922] 10.222.0.42 () {56 vars in 1115 bytes} [Thu Jul 28 08:00:06 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:00:06.865558 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb4b159-638f-4792-99b6-f3f3700a21b2 None admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:00:06.888935 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=100 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:00:06.971406 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb4b159-638f-4792-99b6-f3f3700a21b2 None admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:00:07.006732 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0033c6e-0efc-45e1-84ec-98aa314d7e6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:00:07.007732 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0033c6e-0efc-45e1-84ec-98aa314d7e6a None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:00:07.008186 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0033c6e-0efc-45e1-84ec-98aa314d7e6a None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:00:07.008638 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0033c6e-0efc-45e1-84ec-98aa314d7e6a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:00:07.020405 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0033c6e-0efc-45e1-84ec-98aa314d7e6a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:00:07.022259 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0033c6e-0efc-45e1-84ec-98aa314d7e6a None admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:00:07.037642 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application [None req-c0033c6e-0efc-45e1-84ec-98aa314d7e6a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 08:00:07.037642 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:00:07.037642 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:00:07.037642 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:00:07.037642 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:00:07.037642 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:00:07.037642 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:00:07.037642 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:00:07.037642 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:00:07.037642 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:00:07.037642 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:00:07.037642 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:00:07.037642 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 08:00:07.037642 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 08:00:07.037642 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 08:00:07.038552 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 08:00:07.038552 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:00:07.038552 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:00:07.038552 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:00:07.038552 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:00:07.038552 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:00:07.038552 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:00:07.038552 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:00:07.038552 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application with Lock( Jul 28 08:00:07.038552 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:00:07.038552 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:00:07.038552 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:00:07.038552 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:00:07.038552 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:00:07.038552 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:00:07.038552 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:00:07.038552 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:00:07.039480 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 08:00:07.039480 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 08:00:07.039480 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 08:00:07.039480 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application Jul 28 08:00:07.041637 dv-cinder-851351-1-smb devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 443/923] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 08:00:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:00:07.048711 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2197b93-be54-4a52-9b27-68d46a360b02 None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:00:07.136967 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:00:07.159836 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2197b93-be54-4a52-9b27-68d46a360b02 None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:00:07.161854 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec41f73-d488-40d1-82ba-a8c3ddb3f635 None None] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:00:07.162142 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec41f73-d488-40d1-82ba-a8c3ddb3f635 None None] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:00:07.162419 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec41f73-d488-40d1-82ba-a8c3ddb3f635 None None] PATH_INFO: `/` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:00:07.163935 dv-cinder-851351-1-smb devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 444/924] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 08:00:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 08:00:07.173777 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f250463-90b5-4e16-995a-69748bdecb68 None None] REQUEST_METHOD: `POST` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:00:07.174376 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f250463-90b5-4e16-995a-69748bdecb68 None None] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:00:07.174838 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f250463-90b5-4e16-995a-69748bdecb68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:00:07.195247 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.auth.core [None req-8f250463-90b5-4e16-995a-69748bdecb68 None None] MFA Rules not processed for user `f0666d3a50644a7097367331c1ee1a68`. Rule list: `[]` (Enabled: `True`). {{(pid=80348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 08:00:07.196843 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.fernet_utils [None req-8f250463-90b5-4e16-995a-69748bdecb68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:00:07.197157 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f18401-10ec-41f1-9880-1d3778ad8801 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:00:07.197796 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f18401-10ec-41f1-9880-1d3778ad8801 None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:00:07.198072 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f18401-10ec-41f1-9880-1d3778ad8801 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:00:07.198342 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f18401-10ec-41f1-9880-1d3778ad8801 None admin] PATH_INFO: `/v3/domains` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:00:07.199040 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27f18401-10ec-41f1-9880-1d3778ad8801 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:00:07.199341 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27f18401-10ec-41f1-9880-1d3778ad8801 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:00:07.200839 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27f18401-10ec-41f1-9880-1d3778ad8801 None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:00:07.214090 dv-cinder-851351-1-smb devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 481/925] 10.222.0.42 () {56 vars in 1109 bytes} [Thu Jul 28 08:00:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:00:07.219342 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f18401-10ec-41f1-9880-1d3778ad8801 None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:00:07.292797 dv-cinder-851351-1-smb devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 445/926] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 08:00:07 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 28 08:00:07.293047 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=100 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:00:07.315519 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f250463-90b5-4e16-995a-69748bdecb68 None None] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:00:07.338406 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f18401-10ec-41f1-9880-1d3778ad8801 None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:00:07.375740 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67520503-eda3-4856-922d-7f15ac4717d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:00:07.376810 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67520503-eda3-4856-922d-7f15ac4717d5 None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:00:07.377296 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67520503-eda3-4856-922d-7f15ac4717d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:00:07.377827 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67520503-eda3-4856-922d-7f15ac4717d5 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:00:07.386154 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67520503-eda3-4856-922d-7f15ac4717d5 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:00:07.388010 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67520503-eda3-4856-922d-7f15ac4717d5 None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:00:07.391398 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:00:07.408943 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application [None req-67520503-eda3-4856-922d-7f15ac4717d5 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 28 08:00:07.408943 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:00:07.408943 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:00:07.408943 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:00:07.408943 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:00:07.408943 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:00:07.408943 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:00:07.408943 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:00:07.408943 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:00:07.408943 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:00:07.408943 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:00:07.408943 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:00:07.408943 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 28 08:00:07.408943 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 28 08:00:07.408943 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 28 08:00:07.408943 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 28 08:00:07.410388 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:00:07.410388 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:00:07.410388 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 28 08:00:07.410388 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 08:00:07.410388 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 28 08:00:07.410388 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 08:00:07.410388 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:00:07.410388 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:00:07.410388 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:00:07.410388 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:00:07.410388 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:00:07.410388 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application with Lock( Jul 28 08:00:07.410388 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:00:07.410388 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:00:07.410388 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:00:07.410388 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:00:07.410388 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:00:07.410388 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:00:07.411323 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:00:07.411323 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:00:07.411323 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 28 08:00:07.411323 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 28 08:00:07.411323 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 28 08:00:07.411323 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 28 08:00:07.411323 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 28 08:00:07.411323 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 28 08:00:07.411323 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 28 08:00:07.411323 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application Jul 28 08:00:07.419094 dv-cinder-851351-1-smb devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 482/927] 10.222.0.42 () {56 vars in 1117 bytes} [Thu Jul 28 08:00:07 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:00:07.419800 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67520503-eda3-4856-922d-7f15ac4717d5 None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:00:07.444253 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f250463-90b5-4e16-995a-69748bdecb68 None None] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:00:07.490439 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-422e9b40-a60a-4176-ae5a-8f65a775aa30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:00:07.491097 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422e9b40-a60a-4176-ae5a-8f65a775aa30 None admin] REQUEST_METHOD: `POST` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:00:07.491849 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422e9b40-a60a-4176-ae5a-8f65a775aa30 None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:00:07.492123 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422e9b40-a60a-4176-ae5a-8f65a775aa30 None admin] PATH_INFO: `/v3/projects` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:00:07.492875 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-422e9b40-a60a-4176-ae5a-8f65a775aa30 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:00:07.494761 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-422e9b40-a60a-4176-ae5a-8f65a775aa30 None admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:00:07.497420 dv-cinder-851351-1-smb devstack@keystone.service[80348]: WARNING keystone.server.flask.common [None req-422e9b40-a60a-4176-ae5a-8f65a775aa30 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Jul 28 08:00:07.515678 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.sql.core [None req-422e9b40-a60a-4176-ae5a-8f65a775aa30 None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jul 28 08:00:07.515678 dv-cinder-851351-1-smb devstack@keystone.service[80348]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Jul 28 08:00:07.515678 dv-cinder-851351-1-smb devstack@keystone.service[80348]: [parameters: {'id': '560c9dc53b814b0cb2d9cc9962c5de81', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Jul 28 08:00:07.515678 dv-cinder-851351-1-smb devstack@keystone.service[80348]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80348) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jul 28 08:00:07.523570 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application [None req-422e9b40-a60a-4176-ae5a-8f65a775aa30 None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 560c9dc53b814b0cb2d9cc9962c5de81.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 560c9dc53b814b0cb2d9cc9962c5de81. Jul 28 08:00:07.523570 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:00:07.523570 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 28 08:00:07.523570 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 28 08:00:07.523570 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 28 08:00:07.523570 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 28 08:00:07.523570 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 28 08:00:07.523570 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application result = self._query(query) Jul 28 08:00:07.523570 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 28 08:00:07.523570 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application conn.query(q) Jul 28 08:00:07.523570 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 28 08:00:07.523570 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 28 08:00:07.523570 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 28 08:00:07.524514 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application result.read() Jul 28 08:00:07.524514 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 28 08:00:07.524514 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 28 08:00:07.524514 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 28 08:00:07.524514 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 28 08:00:07.524514 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 28 08:00:07.524514 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 28 08:00:07.524514 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 28 08:00:07.524514 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 28 08:00:07.524514 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jul 28 08:00:07.524514 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application Jul 28 08:00:07.524514 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jul 28 08:00:07.524514 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application Jul 28 08:00:07.524514 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:00:07.524514 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jul 28 08:00:07.524514 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jul 28 08:00:07.524514 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Jul 28 08:00:07.524514 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return project_ref.to_dict() Jul 28 08:00:07.525659 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 28 08:00:07.525659 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application next(self.gen) Jul 28 08:00:07.525659 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jul 28 08:00:07.525659 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application yield resource Jul 28 08:00:07.525659 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 28 08:00:07.525659 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application next(self.gen) Jul 28 08:00:07.525659 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jul 28 08:00:07.525659 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application self.session.rollback() Jul 28 08:00:07.525659 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 28 08:00:07.525659 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application self.force_reraise() Jul 28 08:00:07.525659 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 28 08:00:07.525659 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application raise self.value Jul 28 08:00:07.525659 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jul 28 08:00:07.525659 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jul 28 08:00:07.525659 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jul 28 08:00:07.525659 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application session.commit() Jul 28 08:00:07.525659 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jul 28 08:00:07.526604 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jul 28 08:00:07.526604 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jul 28 08:00:07.526604 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application self._prepare_impl() Jul 28 08:00:07.526604 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jul 28 08:00:07.526604 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application self.session.flush() Jul 28 08:00:07.526604 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jul 28 08:00:07.526604 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application self._flush(objects) Jul 28 08:00:07.526604 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jul 28 08:00:07.526604 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jul 28 08:00:07.526604 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jul 28 08:00:07.526604 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application compat.raise_( Jul 28 08:00:07.526604 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 28 08:00:07.526604 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application raise exception Jul 28 08:00:07.526604 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jul 28 08:00:07.526604 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application flush_context.execute() Jul 28 08:00:07.526604 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jul 28 08:00:07.526604 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application rec.execute(self) Jul 28 08:00:07.527552 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jul 28 08:00:07.527552 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jul 28 08:00:07.527552 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jul 28 08:00:07.527552 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application _emit_insert_statements( Jul 28 08:00:07.527552 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Jul 28 08:00:07.527552 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application c = connection._execute_20( Jul 28 08:00:07.527552 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jul 28 08:00:07.527552 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jul 28 08:00:07.527552 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Jul 28 08:00:07.527552 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jul 28 08:00:07.527552 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jul 28 08:00:07.527552 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application ret = self._execute_context( Jul 28 08:00:07.527552 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jul 28 08:00:07.527552 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jul 28 08:00:07.527552 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jul 28 08:00:07.528358 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jul 28 08:00:07.528358 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 28 08:00:07.528358 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application raise exception Jul 28 08:00:07.528358 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 28 08:00:07.528358 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 28 08:00:07.528358 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 28 08:00:07.528358 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 28 08:00:07.528358 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 28 08:00:07.528358 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application result = self._query(query) Jul 28 08:00:07.528358 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 28 08:00:07.528358 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application conn.query(q) Jul 28 08:00:07.528358 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 28 08:00:07.528358 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 28 08:00:07.528358 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 28 08:00:07.528358 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application result.read() Jul 28 08:00:07.528358 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 28 08:00:07.528358 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 28 08:00:07.529516 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 28 08:00:07.529516 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 28 08:00:07.529516 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 28 08:00:07.529516 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 28 08:00:07.529516 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 28 08:00:07.529516 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 28 08:00:07.529516 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jul 28 08:00:07.529516 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Jul 28 08:00:07.529516 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application [parameters: {'id': '560c9dc53b814b0cb2d9cc9962c5de81', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Jul 28 08:00:07.529516 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jul 28 08:00:07.529516 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application Jul 28 08:00:07.529516 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 28 08:00:07.529516 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application Jul 28 08:00:07.529516 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:00:07.529516 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Jul 28 08:00:07.532436 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Jul 28 08:00:07.532436 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jul 28 08:00:07.532436 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jul 28 08:00:07.532436 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Jul 28 08:00:07.532436 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application Jul 28 08:00:07.532436 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 28 08:00:07.532436 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application Jul 28 08:00:07.532436 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:00:07.532436 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:00:07.532436 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:00:07.532436 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:00:07.532436 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:00:07.532436 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:00:07.532436 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:00:07.532436 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:00:07.532436 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:00:07.532436 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:00:07.534799 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:00:07.534799 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Jul 28 08:00:07.534799 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Jul 28 08:00:07.534799 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:00:07.534799 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:00:07.534799 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Jul 28 08:00:07.534799 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application raise exception.Conflict( Jul 28 08:00:07.534799 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 560c9dc53b814b0cb2d9cc9962c5de81. Jul 28 08:00:07.534799 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application Jul 28 08:00:07.534799 dv-cinder-851351-1-smb devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 446/928] 10.222.0.42 () {60 vars in 1140 bytes} [Thu Jul 28 08:00:07 2022] POST /identity/v3/projects => generated 262 bytes in 210 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Jul 28 08:00:07.534799 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2611cd-5744-4599-b38d-fa24e4f1d1d1 None None] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:00:07.534799 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2611cd-5744-4599-b38d-fa24e4f1d1d1 None None] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:00:07.538422 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2611cd-5744-4599-b38d-fa24e4f1d1d1 None None] PATH_INFO: `/` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:00:07.538422 dv-cinder-851351-1-smb devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 447/929] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 08:00:07 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 08:00:07.538422 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2611cd-5744-4599-b38d-fa24e4f1d1d1 None None] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:00:07.557060 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67520503-eda3-4856-922d-7f15ac4717d5 None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:00:07.587360 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:00:07.598733 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c7dffa-7089-4f1b-b533-4dc4d44b54b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:00:07.599470 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c7dffa-7089-4f1b-b533-4dc4d44b54b1 None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:00:07.599848 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c7dffa-7089-4f1b-b533-4dc4d44b54b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:00:07.600122 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c7dffa-7089-4f1b-b533-4dc4d44b54b1 None admin] PATH_INFO: `/v3/users` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:00:07.600989 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c7dffa-7089-4f1b-b533-4dc4d44b54b1 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:00:07.601293 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c7dffa-7089-4f1b-b533-4dc4d44b54b1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:00:07.602792 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c7dffa-7089-4f1b-b533-4dc4d44b54b1 None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:00:07.629504 dv-cinder-851351-1-smb devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 483/930] 10.222.0.42 () {56 vars in 1149 bytes} [Thu Jul 28 08:00:07 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:00:07.629504 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff8a946-ecf9-4157-aaa2-30185d124ed9 None None] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:00:07.629504 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff8a946-ecf9-4157-aaa2-30185d124ed9 None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:00:07.629504 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff8a946-ecf9-4157-aaa2-30185d124ed9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:00:07.647308 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.auth.core [None req-aff8a946-ecf9-4157-aaa2-30185d124ed9 None None] MFA Rules not processed for user `f0666d3a50644a7097367331c1ee1a68`. Rule list: `[]` (Enabled: `True`). {{(pid=80347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 08:00:07.647711 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2611cd-5744-4599-b38d-fa24e4f1d1d1 None None] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:00:07.648485 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-aff8a946-ecf9-4157-aaa2-30185d124ed9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:00:07.685835 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6801072-411d-4108-9158-96212c3a4ca2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:00:07.686522 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6801072-411d-4108-9158-96212c3a4ca2 None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:00:07.687587 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6801072-411d-4108-9158-96212c3a4ca2 None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:00:07.687587 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6801072-411d-4108-9158-96212c3a4ca2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:00:07.694879 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6801072-411d-4108-9158-96212c3a4ca2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:00:07.696468 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6801072-411d-4108-9158-96212c3a4ca2 None admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:00:07.706586 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:00:07.708997 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application [None req-e6801072-411d-4108-9158-96212c3a4ca2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 08:00:07.708997 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:00:07.708997 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:00:07.708997 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:00:07.708997 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:00:07.708997 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:00:07.708997 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:00:07.708997 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:00:07.708997 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:00:07.708997 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:00:07.708997 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:00:07.708997 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:00:07.708997 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 28 08:00:07.708997 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 28 08:00:07.708997 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 28 08:00:07.709897 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 28 08:00:07.709897 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:00:07.709897 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:00:07.709897 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:00:07.709897 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:00:07.709897 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:00:07.709897 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:00:07.709897 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:00:07.709897 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application with Lock( Jul 28 08:00:07.709897 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:00:07.709897 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:00:07.709897 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:00:07.709897 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:00:07.709897 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:00:07.709897 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:00:07.709897 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:00:07.709897 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:00:07.710861 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 28 08:00:07.710861 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 28 08:00:07.710861 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 28 08:00:07.710861 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 28 08:00:07.710861 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 28 08:00:07.710861 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 28 08:00:07.710861 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 08:00:07.710861 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application Jul 28 08:00:07.710861 dv-cinder-851351-1-smb devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 448/931] 10.222.0.42 () {56 vars in 1111 bytes} [Thu Jul 28 08:00:07 2022] GET /identity/v3/projects/service => generated 88 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:00:07.711363 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6801072-411d-4108-9158-96212c3a4ca2 None admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:00:07.736695 dv-cinder-851351-1-smb devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 484/932] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 08:00:07 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 08:00:07.737577 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff8a946-ecf9-4157-aaa2-30185d124ed9 None None] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:00:07.840144 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6801072-411d-4108-9158-96212c3a4ca2 None admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:00:07.843274 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff8a946-ecf9-4157-aaa2-30185d124ed9 None None] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:00:07.849957 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=100 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:00:07.882208 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c59fbfe-18ac-41c1-a649-84be586ad1b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:00:07.882856 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c59fbfe-18ac-41c1-a649-84be586ad1b9 None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:00:07.883196 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c59fbfe-18ac-41c1-a649-84be586ad1b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:00:07.883390 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c59fbfe-18ac-41c1-a649-84be586ad1b9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:00:07.889829 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d4e2a4-8eeb-4f82-b07e-ca596e1522b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:00:07.890854 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d4e2a4-8eeb-4f82-b07e-ca596e1522b5 None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:00:07.891344 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d4e2a4-8eeb-4f82-b07e-ca596e1522b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:00:07.891825 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d4e2a4-8eeb-4f82-b07e-ca596e1522b5 None admin] PATH_INFO: `/v3/projects` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:00:07.893218 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d4e2a4-8eeb-4f82-b07e-ca596e1522b5 None admin] RBAC: Adding query filter params (name=service) {{(pid=80347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:00:07.893752 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d4e2a4-8eeb-4f82-b07e-ca596e1522b5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:00:07.895495 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c59fbfe-18ac-41c1-a649-84be586ad1b9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:00:07.896492 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d4e2a4-8eeb-4f82-b07e-ca596e1522b5 None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:00:07.897351 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c59fbfe-18ac-41c1-a649-84be586ad1b9 None admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:00:07.911786 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application [None req-0c59fbfe-18ac-41c1-a649-84be586ad1b9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 08:00:07.911786 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:00:07.911786 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:00:07.911786 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:00:07.911786 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:00:07.911786 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:00:07.911786 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:00:07.911786 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:00:07.911786 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:00:07.911786 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:00:07.911786 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:00:07.911786 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:00:07.911786 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 08:00:07.911786 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 08:00:07.911786 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 08:00:07.912761 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 08:00:07.912761 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:00:07.912761 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:00:07.912761 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:00:07.912761 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:00:07.912761 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:00:07.912761 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:00:07.912761 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:00:07.912761 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application with Lock( Jul 28 08:00:07.912761 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:00:07.912761 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:00:07.912761 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:00:07.912761 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:00:07.912761 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:00:07.912761 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:00:07.912761 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:00:07.912761 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:00:07.913754 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 08:00:07.913754 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 08:00:07.913754 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 08:00:07.913754 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application Jul 28 08:00:07.921095 dv-cinder-851351-1-smb devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 449/933] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 08:00:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:00:07.921095 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c59fbfe-18ac-41c1-a649-84be586ad1b9 None admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:00:07.936946 dv-cinder-851351-1-smb devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 485/934] 10.222.0.42 () {56 vars in 1112 bytes} [Thu Jul 28 08:00:07 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:00:07.936946 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d4e2a4-8eeb-4f82-b07e-ca596e1522b5 None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:00:08.015844 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:00:08.068391 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c59fbfe-18ac-41c1-a649-84be586ad1b9 None admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:00:08.079407 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d4e2a4-8eeb-4f82-b07e-ca596e1522b5 None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:00:08.106212 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ceaa2e-8dc0-4aa6-b023-b8bead48ef17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:00:08.106842 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ceaa2e-8dc0-4aa6-b023-b8bead48ef17 None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:00:08.107120 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ceaa2e-8dc0-4aa6-b023-b8bead48ef17 None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:00:08.107393 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ceaa2e-8dc0-4aa6-b023-b8bead48ef17 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:00:08.108037 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9ceaa2e-8dc0-4aa6-b023-b8bead48ef17 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:00:08.109570 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9ceaa2e-8dc0-4aa6-b023-b8bead48ef17 None admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:00:08.118486 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa1e1ce-4e64-49c4-be89-ac53df01edb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:00:08.118845 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application [None req-b9ceaa2e-8dc0-4aa6-b023-b8bead48ef17 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 28 08:00:08.118845 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:00:08.118845 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 28 08:00:08.118845 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 28 08:00:08.118845 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 28 08:00:08.118845 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 28 08:00:08.118845 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 28 08:00:08.118845 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 08:00:08.118845 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 28 08:00:08.118845 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application Jul 28 08:00:08.118845 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 28 08:00:08.118845 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application Jul 28 08:00:08.118845 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:00:08.118845 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:00:08.118845 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:00:08.118845 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:00:08.118845 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:00:08.119995 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:00:08.119995 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:00:08.119995 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:00:08.119995 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:00:08.119995 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:00:08.119995 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:00:08.119995 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 28 08:00:08.119995 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 28 08:00:08.119995 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 28 08:00:08.119995 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 28 08:00:08.119995 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:00:08.119995 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:00:08.119995 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:00:08.119995 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:00:08.119995 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:00:08.119995 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:00:08.120943 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:00:08.120943 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application with Lock( Jul 28 08:00:08.120943 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:00:08.120943 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:00:08.120943 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:00:08.120943 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:00:08.120943 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:00:08.120943 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:00:08.120943 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:00:08.120943 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:00:08.120943 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 28 08:00:08.120943 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 08:00:08.120943 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 28 08:00:08.120943 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application Jul 28 08:00:08.121710 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa1e1ce-4e64-49c4-be89-ac53df01edb8 None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:00:08.121710 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa1e1ce-4e64-49c4-be89-ac53df01edb8 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:00:08.121710 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa1e1ce-4e64-49c4-be89-ac53df01edb8 None admin] PATH_INFO: `/v3/domains` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:00:08.121911 dv-cinder-851351-1-smb devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 450/935] 10.222.0.42 () {56 vars in 1126 bytes} [Thu Jul 28 08:00:07 2022] GET /identity/v3/services/object-store => generated 93 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:00:08.121980 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa1e1ce-4e64-49c4-be89-ac53df01edb8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:00:08.121980 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa1e1ce-4e64-49c4-be89-ac53df01edb8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:00:08.123495 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad400b6e-ba0e-415a-936c-6dd93c723053 None None] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:00:08.123495 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad400b6e-ba0e-415a-936c-6dd93c723053 None None] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:00:08.123495 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad400b6e-ba0e-415a-936c-6dd93c723053 None None] PATH_INFO: `/` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:00:08.123842 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa1e1ce-4e64-49c4-be89-ac53df01edb8 None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:00:08.125228 dv-cinder-851351-1-smb devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 451/936] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 08:00:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 08:00:08.130200 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be19379-0d17-4ec1-a18d-71afff9ad3af None None] REQUEST_METHOD: `POST` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:00:08.131135 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be19379-0d17-4ec1-a18d-71afff9ad3af None None] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:00:08.131135 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be19379-0d17-4ec1-a18d-71afff9ad3af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:00:08.136770 dv-cinder-851351-1-smb devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 486/937] 10.222.0.42 () {56 vars in 1109 bytes} [Thu Jul 28 08:00:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:00:08.137707 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa1e1ce-4e64-49c4-be89-ac53df01edb8 None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:00:08.150327 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.auth.core [None req-8be19379-0d17-4ec1-a18d-71afff9ad3af None None] MFA Rules not processed for user `f0666d3a50644a7097367331c1ee1a68`. Rule list: `[]` (Enabled: `True`). {{(pid=80348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 08:00:08.152251 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.fernet_utils [None req-8be19379-0d17-4ec1-a18d-71afff9ad3af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:00:08.173346 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=100 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:00:08.236695 dv-cinder-851351-1-smb devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 452/938] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 08:00:08 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 08:00:08.236695 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be19379-0d17-4ec1-a18d-71afff9ad3af None None] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:00:08.266738 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa1e1ce-4e64-49c4-be89-ac53df01edb8 None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:00:08.274718 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:00:08.307341 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef50f88-b384-4258-8acd-dab30e7173e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:00:08.307967 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef50f88-b384-4258-8acd-dab30e7173e3 None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:00:08.308245 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef50f88-b384-4258-8acd-dab30e7173e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:00:08.308513 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef50f88-b384-4258-8acd-dab30e7173e3 None admin] PATH_INFO: `/v3/services` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:00:08.309229 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ef50f88-b384-4258-8acd-dab30e7173e3 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:00:08.309533 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ef50f88-b384-4258-8acd-dab30e7173e3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:00:08.310907 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ef50f88-b384-4258-8acd-dab30e7173e3 None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:00:08.316264 dv-cinder-851351-1-smb devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 487/939] 10.222.0.42 () {56 vars in 1122 bytes} [Thu Jul 28 08:00:08 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:00:08.322579 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef50f88-b384-4258-8acd-dab30e7173e3 None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:00:08.345632 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be19379-0d17-4ec1-a18d-71afff9ad3af None None] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:00:08.383452 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdec1438-3543-4058-81b2-349188d0b8ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:00:08.384391 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdec1438-3543-4058-81b2-349188d0b8ae None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:00:08.384846 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdec1438-3543-4058-81b2-349188d0b8ae None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:00:08.385272 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdec1438-3543-4058-81b2-349188d0b8ae None admin] PATH_INFO: `/v3/projects/service` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:00:08.392281 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdec1438-3543-4058-81b2-349188d0b8ae None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:00:08.393759 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdec1438-3543-4058-81b2-349188d0b8ae None admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:00:08.406405 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application [None req-cdec1438-3543-4058-81b2-349188d0b8ae None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 08:00:08.406405 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:00:08.406405 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:00:08.406405 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:00:08.406405 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:00:08.406405 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:00:08.406405 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:00:08.406405 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:00:08.406405 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:00:08.406405 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:00:08.406405 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:00:08.406405 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:00:08.406405 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 28 08:00:08.406405 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 28 08:00:08.406405 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 28 08:00:08.407364 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 28 08:00:08.407364 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:00:08.407364 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:00:08.407364 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:00:08.407364 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:00:08.407364 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:00:08.407364 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:00:08.407364 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:00:08.407364 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application with Lock( Jul 28 08:00:08.407364 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:00:08.407364 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:00:08.407364 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:00:08.407364 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:00:08.407364 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:00:08.407364 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:00:08.407364 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:00:08.407364 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:00:08.408246 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 28 08:00:08.408246 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 28 08:00:08.408246 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 28 08:00:08.408246 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 28 08:00:08.408246 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 28 08:00:08.408246 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 28 08:00:08.408246 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 08:00:08.408246 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application Jul 28 08:00:08.408246 dv-cinder-851351-1-smb devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 453/940] 10.222.0.42 () {56 vars in 1111 bytes} [Thu Jul 28 08:00:08 2022] GET /identity/v3/projects/service => generated 88 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:00:08.409327 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdec1438-3543-4058-81b2-349188d0b8ae None admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:00:08.428469 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=100 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:00:08.437152 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef50f88-b384-4258-8acd-dab30e7173e3 None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:00:08.478155 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90343113-8788-43cc-906c-e651febee08e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:00:08.479272 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90343113-8788-43cc-906c-e651febee08e None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:00:08.479861 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90343113-8788-43cc-906c-e651febee08e None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:00:08.480315 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90343113-8788-43cc-906c-e651febee08e None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:00:08.481173 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90343113-8788-43cc-906c-e651febee08e None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:00:08.482919 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90343113-8788-43cc-906c-e651febee08e None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:00:08.492711 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application [None req-90343113-8788-43cc-906c-e651febee08e None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 28 08:00:08.492711 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:00:08.492711 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 28 08:00:08.492711 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 28 08:00:08.492711 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 28 08:00:08.492711 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 28 08:00:08.492711 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 28 08:00:08.492711 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 08:00:08.492711 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 28 08:00:08.492711 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application Jul 28 08:00:08.492711 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 28 08:00:08.492711 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application Jul 28 08:00:08.492711 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:00:08.492711 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:00:08.492711 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:00:08.492711 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:00:08.494007 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:00:08.494007 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:00:08.494007 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:00:08.494007 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:00:08.494007 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:00:08.494007 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:00:08.494007 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:00:08.494007 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 28 08:00:08.494007 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 28 08:00:08.494007 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 28 08:00:08.494007 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 28 08:00:08.494007 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:00:08.494007 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:00:08.494007 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:00:08.494007 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:00:08.494007 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:00:08.495086 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:00:08.495086 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:00:08.495086 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application with Lock( Jul 28 08:00:08.495086 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:00:08.495086 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:00:08.495086 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:00:08.495086 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:00:08.495086 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:00:08.495086 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:00:08.495086 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:00:08.495086 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:00:08.495086 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 28 08:00:08.495086 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 08:00:08.495086 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 28 08:00:08.495086 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application Jul 28 08:00:08.495969 dv-cinder-851351-1-smb devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 488/941] 10.222.0.42 () {56 vars in 1132 bytes} [Thu Jul 28 08:00:08 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:00:08.496653 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90343113-8788-43cc-906c-e651febee08e None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:00:08.527526 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdec1438-3543-4058-81b2-349188d0b8ae None admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:00:08.535372 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:00:08.567077 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f014dc-30b5-4a3c-b7e7-c492f81c7e90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:00:08.567725 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f014dc-30b5-4a3c-b7e7-c492f81c7e90 None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:00:08.568003 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f014dc-30b5-4a3c-b7e7-c492f81c7e90 None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:00:08.568269 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f014dc-30b5-4a3c-b7e7-c492f81c7e90 None admin] PATH_INFO: `/v3/services` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:00:08.569012 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f014dc-30b5-4a3c-b7e7-c492f81c7e90 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80348) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:00:08.569317 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f014dc-30b5-4a3c-b7e7-c492f81c7e90 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:00:08.570748 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f014dc-30b5-4a3c-b7e7-c492f81c7e90 None admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:00:08.576824 dv-cinder-851351-1-smb devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 454/942] 10.222.0.42 () {56 vars in 1122 bytes} [Thu Jul 28 08:00:08 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:00:08.577696 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f014dc-30b5-4a3c-b7e7-c492f81c7e90 None admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:00:08.615926 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90343113-8788-43cc-906c-e651febee08e None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:00:08.653271 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4af22db-b094-414a-b885-e28ebbb18ba2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:00:08.654174 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4af22db-b094-414a-b885-e28ebbb18ba2 None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:00:08.654588 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4af22db-b094-414a-b885-e28ebbb18ba2 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:00:08.655150 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4af22db-b094-414a-b885-e28ebbb18ba2 None admin] PATH_INFO: `/v3/projects` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:00:08.655958 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4af22db-b094-414a-b885-e28ebbb18ba2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:00:08.656255 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4af22db-b094-414a-b885-e28ebbb18ba2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:00:08.657262 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=100 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:00:08.658553 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4af22db-b094-414a-b885-e28ebbb18ba2 None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:00:08.670835 dv-cinder-851351-1-smb devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 489/943] 10.222.0.42 () {56 vars in 1148 bytes} [Thu Jul 28 08:00:08 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:00:08.671686 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4af22db-b094-414a-b885-e28ebbb18ba2 None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:00:08.688757 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f014dc-30b5-4a3c-b7e7-c492f81c7e90 None admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:00:08.726058 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b31968e-5a07-488f-8bae-accc0a8d207a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:00:08.726679 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b31968e-5a07-488f-8bae-accc0a8d207a None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:00:08.726956 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b31968e-5a07-488f-8bae-accc0a8d207a None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:00:08.727245 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b31968e-5a07-488f-8bae-accc0a8d207a None admin] PATH_INFO: `/v3/services` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:00:08.727929 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b31968e-5a07-488f-8bae-accc0a8d207a None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80348) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:00:08.728304 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b31968e-5a07-488f-8bae-accc0a8d207a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:00:08.729736 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b31968e-5a07-488f-8bae-accc0a8d207a None admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:00:08.739452 dv-cinder-851351-1-smb devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 455/944] 10.222.0.42 () {56 vars in 1126 bytes} [Thu Jul 28 08:00:08 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:00:08.739452 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b31968e-5a07-488f-8bae-accc0a8d207a None admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:00:08.779675 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:00:08.789742 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4af22db-b094-414a-b885-e28ebbb18ba2 None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:00:08.824651 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7575cb-06ac-445f-866e-fcf61e3acfb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:00:08.825319 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7575cb-06ac-445f-866e-fcf61e3acfb9 None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:00:08.825594 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7575cb-06ac-445f-866e-fcf61e3acfb9 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:00:08.825863 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7575cb-06ac-445f-866e-fcf61e3acfb9 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:00:08.826617 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c7575cb-06ac-445f-866e-fcf61e3acfb9 None admin] RBAC: Adding query filter params (interface=public, service_id=c09263f604af42919a649236606b7787, region_id=RegionOne) {{(pid=80347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:00:08.826923 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c7575cb-06ac-445f-866e-fcf61e3acfb9 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:00:08.828284 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c7575cb-06ac-445f-866e-fcf61e3acfb9 None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:00:08.833763 dv-cinder-851351-1-smb devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 490/945] 10.222.0.42 () {56 vars in 1251 bytes} [Thu Jul 28 08:00:08 2022] GET /identity/v3/endpoints?service_id=c09263f604af42919a649236606b7787&interface=public®ion_id=RegionOne => generated 194 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:00:08.834557 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7575cb-06ac-445f-866e-fcf61e3acfb9 None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:00:08.846556 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b31968e-5a07-488f-8bae-accc0a8d207a None admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:00:08.884502 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef7796e-8a98-4244-8f43-41d1f9d2dc30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:00:08.885232 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef7796e-8a98-4244-8f43-41d1f9d2dc30 None admin] REQUEST_METHOD: `PUT` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:00:08.885507 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef7796e-8a98-4244-8f43-41d1f9d2dc30 None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:00:08.886069 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef7796e-8a98-4244-8f43-41d1f9d2dc30 None admin] PATH_INFO: `/v3/projects/139349507026497c98f360774dee737e/users/4a92b0d2802e46f4beffaaf39ed6723c/roles/a2ca675df8464a35b15d0c6795636b90` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:00:08.887997 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eef7796e-8a98-4244-8f43-41d1f9d2dc30 None admin] RBAC: Authorizing `identity:create_grant(project_id=139349507026497c98f360774dee737e, user_id=4a92b0d2802e46f4beffaaf39ed6723c, role_id=a2ca675df8464a35b15d0c6795636b90)` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:00:08.889686 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eef7796e-8a98-4244-8f43-41d1f9d2dc30 None admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:00:08.900572 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:00:08.907422 dv-cinder-851351-1-smb devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 456/946] 10.222.0.42 () {58 vars in 1439 bytes} [Thu Jul 28 08:00:08 2022] PUT /identity/v3/projects/139349507026497c98f360774dee737e/users/4a92b0d2802e46f4beffaaf39ed6723c/roles/a2ca675df8464a35b15d0c6795636b90 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 08:00:08.908608 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef7796e-8a98-4244-8f43-41d1f9d2dc30 None admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:00:08.985396 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7575cb-06ac-445f-866e-fcf61e3acfb9 None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:00:09.041297 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b79e414-f58c-417f-a8b7-e9aa07d7ac06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:00:09.042435 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b79e414-f58c-417f-a8b7-e9aa07d7ac06 None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:00:09.042825 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b79e414-f58c-417f-a8b7-e9aa07d7ac06 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:00:09.044320 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b79e414-f58c-417f-a8b7-e9aa07d7ac06 None admin] PATH_INFO: `/v3/services` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:00:09.045248 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b79e414-f58c-417f-a8b7-e9aa07d7ac06 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:00:09.045659 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b79e414-f58c-417f-a8b7-e9aa07d7ac06 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:00:09.047189 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b79e414-f58c-417f-a8b7-e9aa07d7ac06 None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:00:09.056429 dv-cinder-851351-1-smb devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 491/947] 10.222.0.42 () {56 vars in 1126 bytes} [Thu Jul 28 08:00:08 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:00:09.064530 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b79e414-f58c-417f-a8b7-e9aa07d7ac06 None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:00:09.097020 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef7796e-8a98-4244-8f43-41d1f9d2dc30 None admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:00:09.113077 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:00:09.155974 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea4b25e-8f09-48bf-ae11-88ef02a324be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:00:09.156975 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea4b25e-8f09-48bf-ae11-88ef02a324be None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:00:09.157487 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea4b25e-8f09-48bf-ae11-88ef02a324be None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:00:09.157881 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea4b25e-8f09-48bf-ae11-88ef02a324be None admin] PATH_INFO: `/v3/services` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:00:09.159006 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aea4b25e-8f09-48bf-ae11-88ef02a324be None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:00:09.161387 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aea4b25e-8f09-48bf-ae11-88ef02a324be None admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:00:09.180834 dv-cinder-851351-1-smb devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 457/948] 10.222.0.42 () {56 vars in 1087 bytes} [Thu Jul 28 08:00:08 2022] GET /identity/v3/services => generated 1497 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 08:00:09.246757 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b79e414-f58c-417f-a8b7-e9aa07d7ac06 None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:00:09.296613 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d6ab05a-85f9-47b1-94f6-d93923c68e06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:00:09.297545 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6ab05a-85f9-47b1-94f6-d93923c68e06 None admin] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:00:09.297960 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6ab05a-85f9-47b1-94f6-d93923c68e06 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:00:09.298362 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6ab05a-85f9-47b1-94f6-d93923c68e06 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:00:09.299213 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d6ab05a-85f9-47b1-94f6-d93923c68e06 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:00:09.300781 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d6ab05a-85f9-47b1-94f6-d93923c68e06 None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:00:09.328305 dv-cinder-851351-1-smb devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 492/949] 10.222.0.42 () {60 vars in 1144 bytes} [Thu Jul 28 08:00:09 2022] POST /identity/v3/endpoints => generated 347 bytes in 265 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 08:00:10.062113 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ecd563a-e19e-46c7-8087-1264080424cd None None] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:00:10.062657 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ecd563a-e19e-46c7-8087-1264080424cd None None] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:00:10.062657 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ecd563a-e19e-46c7-8087-1264080424cd None None] PATH_INFO: `/` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:00:10.064289 dv-cinder-851351-1-smb devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 458/950] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 08:00:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 08:00:10.069796 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63cc31cc-b77a-4011-afe8-7a1e310e5818 None None] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:00:10.070226 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63cc31cc-b77a-4011-afe8-7a1e310e5818 None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:00:10.070336 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63cc31cc-b77a-4011-afe8-7a1e310e5818 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:00:10.089305 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.auth.core [None req-63cc31cc-b77a-4011-afe8-7a1e310e5818 None None] MFA Rules not processed for user `f0666d3a50644a7097367331c1ee1a68`. Rule list: `[]` (Enabled: `True`). {{(pid=80347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 08:00:10.090490 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-63cc31cc-b77a-4011-afe8-7a1e310e5818 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:00:10.165414 dv-cinder-851351-1-smb devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 493/951] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 08:00:10 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 08:00:10.189274 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ecd563a-e19e-46c7-8087-1264080424cd None None] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:00:10.255441 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=100 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:00:10.300843 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ecd563a-e19e-46c7-8087-1264080424cd None None] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:00:10.336540 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db2d91b-fd79-4946-a04e-bfffc001c656 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:00:10.337190 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db2d91b-fd79-4946-a04e-bfffc001c656 None admin] REQUEST_METHOD: `POST` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:00:10.337506 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db2d91b-fd79-4946-a04e-bfffc001c656 None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:00:10.337775 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db2d91b-fd79-4946-a04e-bfffc001c656 None admin] PATH_INFO: `/v3/users` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:00:10.338466 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4db2d91b-fd79-4946-a04e-bfffc001c656 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:00:10.339897 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4db2d91b-fd79-4946-a04e-bfffc001c656 None admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:00:10.355645 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.sql.core [None req-4db2d91b-fd79-4946-a04e-bfffc001c656 None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jul 28 08:00:10.355645 dv-cinder-851351-1-smb devstack@keystone.service[80348]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Jul 28 08:00:10.355645 dv-cinder-851351-1-smb devstack@keystone.service[80348]: [parameters: {'user_id': 'd03f1d6012a4494295c7d5243aad7b46', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Jul 28 08:00:10.355645 dv-cinder-851351-1-smb devstack@keystone.service[80348]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80348) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jul 28 08:00:10.362783 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application [None req-4db2d91b-fd79-4946-a04e-bfffc001c656 None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Jul 28 08:00:10.362783 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:00:10.362783 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 28 08:00:10.362783 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 28 08:00:10.362783 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 28 08:00:10.362783 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 28 08:00:10.362783 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 28 08:00:10.362783 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application result = self._query(query) Jul 28 08:00:10.362783 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 28 08:00:10.362783 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application conn.query(q) Jul 28 08:00:10.362783 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 28 08:00:10.362783 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 28 08:00:10.362783 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 28 08:00:10.362783 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application result.read() Jul 28 08:00:10.362783 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 28 08:00:10.364084 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 28 08:00:10.364084 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 28 08:00:10.364084 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 28 08:00:10.364084 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 28 08:00:10.364084 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 28 08:00:10.364084 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 28 08:00:10.364084 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 28 08:00:10.364084 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jul 28 08:00:10.364084 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application Jul 28 08:00:10.364084 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jul 28 08:00:10.364084 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application Jul 28 08:00:10.364084 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:00:10.364084 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jul 28 08:00:10.364084 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jul 28 08:00:10.364084 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Jul 28 08:00:10.364084 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Jul 28 08:00:10.364084 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 28 08:00:10.364084 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application next(self.gen) Jul 28 08:00:10.365179 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jul 28 08:00:10.365179 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application yield resource Jul 28 08:00:10.365179 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 28 08:00:10.365179 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application next(self.gen) Jul 28 08:00:10.365179 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jul 28 08:00:10.365179 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application self.session.rollback() Jul 28 08:00:10.365179 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 28 08:00:10.365179 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application self.force_reraise() Jul 28 08:00:10.365179 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 28 08:00:10.365179 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application raise self.value Jul 28 08:00:10.365179 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jul 28 08:00:10.365179 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jul 28 08:00:10.365179 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jul 28 08:00:10.365179 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application session.commit() Jul 28 08:00:10.365179 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jul 28 08:00:10.365179 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jul 28 08:00:10.365179 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jul 28 08:00:10.366251 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application self._prepare_impl() Jul 28 08:00:10.366251 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jul 28 08:00:10.366251 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application self.session.flush() Jul 28 08:00:10.366251 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jul 28 08:00:10.366251 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application self._flush(objects) Jul 28 08:00:10.366251 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jul 28 08:00:10.366251 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jul 28 08:00:10.366251 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jul 28 08:00:10.366251 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application compat.raise_( Jul 28 08:00:10.366251 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 28 08:00:10.366251 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application raise exception Jul 28 08:00:10.366251 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jul 28 08:00:10.366251 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application flush_context.execute() Jul 28 08:00:10.366251 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jul 28 08:00:10.366251 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application rec.execute(self) Jul 28 08:00:10.366251 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jul 28 08:00:10.366251 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jul 28 08:00:10.367195 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jul 28 08:00:10.367195 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application _emit_insert_statements( Jul 28 08:00:10.367195 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Jul 28 08:00:10.367195 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application result = connection._execute_20( Jul 28 08:00:10.367195 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jul 28 08:00:10.367195 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jul 28 08:00:10.367195 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Jul 28 08:00:10.367195 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jul 28 08:00:10.367195 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jul 28 08:00:10.367195 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application ret = self._execute_context( Jul 28 08:00:10.367195 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jul 28 08:00:10.367195 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jul 28 08:00:10.367195 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jul 28 08:00:10.367195 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jul 28 08:00:10.367195 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 28 08:00:10.367195 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application raise exception Jul 28 08:00:10.368053 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 28 08:00:10.368053 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 28 08:00:10.368053 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 28 08:00:10.368053 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 28 08:00:10.368053 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 28 08:00:10.368053 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application result = self._query(query) Jul 28 08:00:10.368053 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 28 08:00:10.368053 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application conn.query(q) Jul 28 08:00:10.368053 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 28 08:00:10.368053 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 28 08:00:10.368053 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 28 08:00:10.368053 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application result.read() Jul 28 08:00:10.368053 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 28 08:00:10.368053 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 28 08:00:10.368053 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 28 08:00:10.368053 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 28 08:00:10.370601 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 28 08:00:10.370601 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 28 08:00:10.370601 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 28 08:00:10.370601 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 28 08:00:10.370601 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jul 28 08:00:10.370601 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Jul 28 08:00:10.370601 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application [parameters: {'user_id': 'd03f1d6012a4494295c7d5243aad7b46', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Jul 28 08:00:10.370601 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jul 28 08:00:10.370601 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application Jul 28 08:00:10.370601 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 28 08:00:10.370601 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application Jul 28 08:00:10.370601 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:00:10.370601 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:00:10.370601 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:00:10.370601 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:00:10.372512 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:00:10.372512 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:00:10.372512 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:00:10.372512 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:00:10.372512 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:00:10.372512 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:00:10.372512 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:00:10.372512 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Jul 28 08:00:10.372512 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Jul 28 08:00:10.372512 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:00:10.372512 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:00:10.372512 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 28 08:00:10.372512 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 08:00:10.372512 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 28 08:00:10.372512 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 08:00:10.372512 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Jul 28 08:00:10.372512 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Jul 28 08:00:10.384253 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Jul 28 08:00:10.384253 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Jul 28 08:00:10.384253 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jul 28 08:00:10.384253 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jul 28 08:00:10.384253 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Jul 28 08:00:10.384253 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application Jul 28 08:00:10.384253 dv-cinder-851351-1-smb devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 459/952] 10.222.0.42 () {60 vars in 1131 bytes} [Thu Jul 28 08:00:10 2022] POST /identity/v3/users => generated 160 bytes in 176 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:00:10.385521 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63cc31cc-b77a-4011-afe8-7a1e310e5818 None None] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:00:10.385521 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:00:10.480613 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63cc31cc-b77a-4011-afe8-7a1e310e5818 None None] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:00:10.525816 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7117bb77-dd75-438e-a140-fc1a814882b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:00:10.526525 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7117bb77-dd75-438e-a140-fc1a814882b4 None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:00:10.526799 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7117bb77-dd75-438e-a140-fc1a814882b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:00:10.527070 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7117bb77-dd75-438e-a140-fc1a814882b4 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:00:10.536305 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7117bb77-dd75-438e-a140-fc1a814882b4 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:00:10.537979 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7117bb77-dd75-438e-a140-fc1a814882b4 None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:00:10.552109 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application [None req-7117bb77-dd75-438e-a140-fc1a814882b4 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jul 28 08:00:10.552109 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:00:10.552109 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:00:10.552109 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:00:10.552109 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:00:10.552109 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:00:10.552109 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:00:10.552109 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:00:10.552109 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:00:10.552109 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:00:10.552109 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:00:10.552109 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:00:10.552109 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 28 08:00:10.552109 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 28 08:00:10.552109 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 28 08:00:10.552109 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 28 08:00:10.553209 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:00:10.553209 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:00:10.553209 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 28 08:00:10.553209 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 08:00:10.553209 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 28 08:00:10.553209 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 08:00:10.553209 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:00:10.553209 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:00:10.553209 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:00:10.553209 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:00:10.553209 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:00:10.553209 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application with Lock( Jul 28 08:00:10.553209 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:00:10.553209 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:00:10.553209 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:00:10.553209 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:00:10.553209 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:00:10.553209 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:00:10.554148 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:00:10.554148 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:00:10.554148 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 28 08:00:10.554148 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 28 08:00:10.554148 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 28 08:00:10.554148 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 28 08:00:10.554148 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 28 08:00:10.554148 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 28 08:00:10.554148 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jul 28 08:00:10.554148 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application Jul 28 08:00:10.554148 dv-cinder-851351-1-smb devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 494/953] 10.222.0.42 () {56 vars in 1099 bytes} [Thu Jul 28 08:00:10 2022] GET /identity/v3/users/cinder => generated 84 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:00:10.560456 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db2d91b-fd79-4946-a04e-bfffc001c656 None admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:00:10.689134 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db2d91b-fd79-4946-a04e-bfffc001c656 None admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:00:10.723531 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:00:10.740034 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43704d9-d491-427b-a91e-29489c78971f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:00:10.740707 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43704d9-d491-427b-a91e-29489c78971f None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:00:10.740987 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43704d9-d491-427b-a91e-29489c78971f None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:00:10.741256 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43704d9-d491-427b-a91e-29489c78971f None admin] PATH_INFO: `/v3/users` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:00:10.742165 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f43704d9-d491-427b-a91e-29489c78971f None admin] RBAC: Adding query filter params (name=cinder) {{(pid=80348) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:00:10.742521 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f43704d9-d491-427b-a91e-29489c78971f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:00:10.745444 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f43704d9-d491-427b-a91e-29489c78971f None admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:00:10.789528 dv-cinder-851351-1-smb devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 460/954] 10.222.0.42 () {56 vars in 1101 bytes} [Thu Jul 28 08:00:10 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:00:11.027278 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ccd739-08e9-4f54-b405-bfec19c59a4e None None] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:00:11.027456 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ccd739-08e9-4f54-b405-bfec19c59a4e None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:00:11.027747 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ccd739-08e9-4f54-b405-bfec19c59a4e None None] PATH_INFO: `/` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:00:11.029465 dv-cinder-851351-1-smb devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 495/955] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 08:00:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 08:00:11.035625 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74e80c8-04a1-43cb-8506-9d2060b44c61 None None] REQUEST_METHOD: `POST` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:00:11.035975 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74e80c8-04a1-43cb-8506-9d2060b44c61 None None] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:00:11.036256 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74e80c8-04a1-43cb-8506-9d2060b44c61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:00:11.056131 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.auth.core [None req-b74e80c8-04a1-43cb-8506-9d2060b44c61 None None] MFA Rules not processed for user `f0666d3a50644a7097367331c1ee1a68`. Rule list: `[]` (Enabled: `True`). {{(pid=80348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 08:00:11.057723 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.fernet_utils [None req-b74e80c8-04a1-43cb-8506-9d2060b44c61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:00:11.129010 dv-cinder-851351-1-smb devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 461/956] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 08:00:11 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 08:00:11.155205 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ccd739-08e9-4f54-b405-bfec19c59a4e None None] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:00:11.225280 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:00:11.267557 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ccd739-08e9-4f54-b405-bfec19c59a4e None None] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:00:11.303340 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0ce579-6f87-4e5c-8660-e0d716f10e4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:00:11.303889 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0ce579-6f87-4e5c-8660-e0d716f10e4f None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:00:11.304157 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0ce579-6f87-4e5c-8660-e0d716f10e4f None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:00:11.304417 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0ce579-6f87-4e5c-8660-e0d716f10e4f None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:00:11.315771 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b0ce579-6f87-4e5c-8660-e0d716f10e4f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 08:00:11.320423 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8428c656-91b9-4a04-8bfd-ff8e2236b41e None None] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:00:11.320736 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8428c656-91b9-4a04-8bfd-ff8e2236b41e None None] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:00:11.320882 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application [None req-9b0ce579-6f87-4e5c-8660-e0d716f10e4f None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 28 08:00:11.320882 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:00:11.320882 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:00:11.320882 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:00:11.320882 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:00:11.320882 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:00:11.320882 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:00:11.320882 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:00:11.320882 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:00:11.320882 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:00:11.320882 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:00:11.320882 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:00:11.320882 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 08:00:11.320882 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 08:00:11.320882 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 08:00:11.320882 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 08:00:11.321755 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 08:00:11.321755 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 08:00:11.321755 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 08:00:11.321755 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 08:00:11.321755 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:00:11.321755 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:00:11.321755 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:00:11.321755 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:00:11.321755 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:00:11.321755 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:00:11.321755 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:00:11.321755 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application with Lock( Jul 28 08:00:11.321755 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:00:11.321755 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:00:11.321755 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:00:11.321755 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:00:11.322633 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:00:11.322633 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:00:11.322633 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:00:11.322633 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:00:11.322633 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 08:00:11.322633 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 08:00:11.322633 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 08:00:11.322633 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 08:00:11.322633 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 08:00:11.322633 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 08:00:11.322633 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 28 08:00:11.322633 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application Jul 28 08:00:11.323309 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8428c656-91b9-4a04-8bfd-ff8e2236b41e None None] PATH_INFO: `/` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:00:11.323309 dv-cinder-851351-1-smb devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 462/957] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 08:00:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 08:00:11.326954 dv-cinder-851351-1-smb devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 496/958] 10.222.0.42 () {56 vars in 1120 bytes} [Thu Jul 28 08:00:11 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:00:11.327622 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0ce579-6f87-4e5c-8660-e0d716f10e4f None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:00:11.327773 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e59d600-3ca7-4951-90d8-a61476758872 None None] REQUEST_METHOD: `POST` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:00:11.328144 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e59d600-3ca7-4951-90d8-a61476758872 None None] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:00:11.328876 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e59d600-3ca7-4951-90d8-a61476758872 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:00:11.347165 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.auth.core [None req-8e59d600-3ca7-4951-90d8-a61476758872 None None] MFA Rules not processed for user `f0666d3a50644a7097367331c1ee1a68`. Rule list: `[]` (Enabled: `True`). {{(pid=80348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 08:00:11.348363 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.fernet_utils [None req-8e59d600-3ca7-4951-90d8-a61476758872 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:00:11.436936 dv-cinder-851351-1-smb devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 463/959] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 08:00:11 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 28 08:00:11.459547 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e59d600-3ca7-4951-90d8-a61476758872 None None] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:00:11.471190 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0ce579-6f87-4e5c-8660-e0d716f10e4f None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:00:11.499688 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:00:11.511916 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=100 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:00:11.513248 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025c0390-61b4-4ede-9445-6d741c516b45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:00:11.514050 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025c0390-61b4-4ede-9445-6d741c516b45 None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:00:11.514050 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025c0390-61b4-4ede-9445-6d741c516b45 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:00:11.514430 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025c0390-61b4-4ede-9445-6d741c516b45 None admin] PATH_INFO: `/v3/roles` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:00:11.515209 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-025c0390-61b4-4ede-9445-6d741c516b45 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:00:11.515526 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-025c0390-61b4-4ede-9445-6d741c516b45 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:00:11.516976 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-025c0390-61b4-4ede-9445-6d741c516b45 None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:00:11.525941 dv-cinder-851351-1-smb devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 497/960] 10.222.0.42 () {56 vars in 1115 bytes} [Thu Jul 28 08:00:11 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 08:00:11.531418 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025c0390-61b4-4ede-9445-6d741c516b45 None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:00:11.573228 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e59d600-3ca7-4951-90d8-a61476758872 None None] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:00:11.612165 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60577c0a-0cb5-4ce8-a87d-baac2084f634 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:00:11.612995 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60577c0a-0cb5-4ce8-a87d-baac2084f634 None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:00:11.613332 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60577c0a-0cb5-4ce8-a87d-baac2084f634 None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:00:11.613607 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60577c0a-0cb5-4ce8-a87d-baac2084f634 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:00:11.614258 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60577c0a-0cb5-4ce8-a87d-baac2084f634 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:00:11.615856 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60577c0a-0cb5-4ce8-a87d-baac2084f634 None admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:00:11.625007 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application [None req-60577c0a-0cb5-4ce8-a87d-baac2084f634 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 28 08:00:11.625007 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:00:11.625007 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 28 08:00:11.625007 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 28 08:00:11.625007 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 28 08:00:11.625007 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 28 08:00:11.625007 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 28 08:00:11.625007 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 08:00:11.625007 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 28 08:00:11.625007 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application Jul 28 08:00:11.625007 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 28 08:00:11.625007 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application Jul 28 08:00:11.625007 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:00:11.625007 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:00:11.625007 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:00:11.625007 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:00:11.625007 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:00:11.626248 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:00:11.626248 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:00:11.626248 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:00:11.626248 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:00:11.626248 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:00:11.626248 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:00:11.626248 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 28 08:00:11.626248 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 28 08:00:11.626248 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 28 08:00:11.626248 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 28 08:00:11.626248 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:00:11.626248 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:00:11.626248 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:00:11.626248 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:00:11.626248 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:00:11.626248 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:00:11.627876 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:00:11.627876 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application with Lock( Jul 28 08:00:11.627876 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:00:11.627876 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:00:11.627876 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:00:11.627876 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:00:11.627876 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:00:11.627876 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:00:11.627876 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:00:11.627876 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:00:11.627876 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 28 08:00:11.627876 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 08:00:11.627876 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 28 08:00:11.627876 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application Jul 28 08:00:11.627876 dv-cinder-851351-1-smb devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 464/961] 10.222.0.42 () {56 vars in 1126 bytes} [Thu Jul 28 08:00:11 2022] GET /identity/v3/services/object-store => generated 93 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 08:00:11.628807 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77501978-7adc-42c8-ae32-6a335eee0e78 None None] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:00:11.628807 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77501978-7adc-42c8-ae32-6a335eee0e78 None None] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:00:11.628807 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77501978-7adc-42c8-ae32-6a335eee0e78 None None] PATH_INFO: `/` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:00:11.629265 dv-cinder-851351-1-smb devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 465/962] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 08:00:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 08:00:11.632610 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77501978-7adc-42c8-ae32-6a335eee0e78 None None] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:00:11.648644 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025c0390-61b4-4ede-9445-6d741c516b45 None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:00:11.681864 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7792400a-c0b6-4773-9f5b-34a1e28af65c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:00:11.682537 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7792400a-c0b6-4773-9f5b-34a1e28af65c None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:00:11.682786 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7792400a-c0b6-4773-9f5b-34a1e28af65c None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:00:11.683060 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7792400a-c0b6-4773-9f5b-34a1e28af65c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:00:11.693648 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7792400a-c0b6-4773-9f5b-34a1e28af65c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:00:11.695073 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7792400a-c0b6-4773-9f5b-34a1e28af65c None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:00:11.709806 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application [None req-7792400a-c0b6-4773-9f5b-34a1e28af65c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 08:00:11.709806 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:00:11.709806 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:00:11.709806 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:00:11.709806 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:00:11.709806 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:00:11.709806 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:00:11.709806 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:00:11.709806 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:00:11.709806 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:00:11.709806 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:00:11.709806 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:00:11.709806 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 08:00:11.709806 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 08:00:11.709806 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 08:00:11.710845 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 08:00:11.710845 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:00:11.710845 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:00:11.710845 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:00:11.710845 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:00:11.710845 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:00:11.710845 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:00:11.710845 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:00:11.710845 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application with Lock( Jul 28 08:00:11.710845 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:00:11.710845 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:00:11.710845 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:00:11.710845 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:00:11.710845 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:00:11.710845 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:00:11.710845 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:00:11.710845 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:00:11.711717 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 08:00:11.711717 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 08:00:11.711717 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 08:00:11.711717 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application Jul 28 08:00:11.711717 dv-cinder-851351-1-smb devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 498/963] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 08:00:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 08:00:11.712175 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7413d8-1de9-41ba-9dd2-1d4e2a3cf722 None None] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:00:11.712519 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7413d8-1de9-41ba-9dd2-1d4e2a3cf722 None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:00:11.712843 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7413d8-1de9-41ba-9dd2-1d4e2a3cf722 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:00:11.731323 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.auth.core [None req-bf7413d8-1de9-41ba-9dd2-1d4e2a3cf722 None None] MFA Rules not processed for user `f0666d3a50644a7097367331c1ee1a68`. Rule list: `[]` (Enabled: `True`). {{(pid=80347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 08:00:11.732531 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-bf7413d8-1de9-41ba-9dd2-1d4e2a3cf722 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:00:11.742905 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77501978-7adc-42c8-ae32-6a335eee0e78 None None] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:00:11.752658 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=100 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:00:11.764091 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:00:11.778103 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07de75d9-f183-406c-9e37-40acd47363b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:00:11.778769 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07de75d9-f183-406c-9e37-40acd47363b6 None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:00:11.779050 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07de75d9-f183-406c-9e37-40acd47363b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:00:11.779359 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07de75d9-f183-406c-9e37-40acd47363b6 None admin] PATH_INFO: `/v3/services` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:00:11.780040 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07de75d9-f183-406c-9e37-40acd47363b6 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80348) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:00:11.780334 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07de75d9-f183-406c-9e37-40acd47363b6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:00:11.781740 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07de75d9-f183-406c-9e37-40acd47363b6 None admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:00:11.786761 dv-cinder-851351-1-smb devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 466/964] 10.222.0.42 () {56 vars in 1122 bytes} [Thu Jul 28 08:00:11 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 08:00:11.787546 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07de75d9-f183-406c-9e37-40acd47363b6 None admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:00:11.806485 dv-cinder-851351-1-smb devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 499/965] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 08:00:11 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 08:00:11.807378 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7413d8-1de9-41ba-9dd2-1d4e2a3cf722 None None] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:00:11.891619 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07de75d9-f183-406c-9e37-40acd47363b6 None admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:00:11.914937 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7413d8-1de9-41ba-9dd2-1d4e2a3cf722 None None] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:00:11.928976 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147f20f4-5980-4db3-a347-93f53bed3d42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:00:11.929594 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147f20f4-5980-4db3-a347-93f53bed3d42 None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:00:11.929891 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147f20f4-5980-4db3-a347-93f53bed3d42 None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:00:11.930147 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147f20f4-5980-4db3-a347-93f53bed3d42 None admin] PATH_INFO: `/v3/domains` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:00:11.930844 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-147f20f4-5980-4db3-a347-93f53bed3d42 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80348) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:00:11.931190 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-147f20f4-5980-4db3-a347-93f53bed3d42 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:00:11.932576 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-147f20f4-5980-4db3-a347-93f53bed3d42 None admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:00:11.945487 dv-cinder-851351-1-smb devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 467/966] 10.222.0.42 () {56 vars in 1109 bytes} [Thu Jul 28 08:00:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:00:11.946440 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147f20f4-5980-4db3-a347-93f53bed3d42 None admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:00:11.956733 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75d054b-f526-4d11-9d57-02f447866f1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:00:11.957363 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75d054b-f526-4d11-9d57-02f447866f1b None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:00:11.957681 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75d054b-f526-4d11-9d57-02f447866f1b None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:00:11.957948 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75d054b-f526-4d11-9d57-02f447866f1b None admin] PATH_INFO: `/v3/services` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:00:11.958630 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c75d054b-f526-4d11-9d57-02f447866f1b None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:00:11.958923 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c75d054b-f526-4d11-9d57-02f447866f1b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:00:11.960286 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c75d054b-f526-4d11-9d57-02f447866f1b None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:00:11.965497 dv-cinder-851351-1-smb devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 500/967] 10.222.0.42 () {56 vars in 1122 bytes} [Thu Jul 28 08:00:11 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:00:11.966332 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75d054b-f526-4d11-9d57-02f447866f1b None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:00:11.980650 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=100 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:00:11.998731 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:00:12.049752 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147f20f4-5980-4db3-a347-93f53bed3d42 None admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:00:12.066276 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75d054b-f526-4d11-9d57-02f447866f1b None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:00:12.085634 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd01703-2c73-4125-96a1-8c25e60db521 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:00:12.086284 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd01703-2c73-4125-96a1-8c25e60db521 None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:00:12.086557 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd01703-2c73-4125-96a1-8c25e60db521 None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:00:12.086824 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd01703-2c73-4125-96a1-8c25e60db521 None admin] PATH_INFO: `/v3/services/compute` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:00:12.087522 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccd01703-2c73-4125-96a1-8c25e60db521 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:00:12.088924 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccd01703-2c73-4125-96a1-8c25e60db521 None admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:00:12.097823 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application [None req-ccd01703-2c73-4125-96a1-8c25e60db521 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jul 28 08:00:12.097823 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:00:12.097823 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 28 08:00:12.097823 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 28 08:00:12.097823 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 28 08:00:12.097823 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 28 08:00:12.097823 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 28 08:00:12.097823 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 08:00:12.097823 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 28 08:00:12.097823 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application Jul 28 08:00:12.097823 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 28 08:00:12.097823 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application Jul 28 08:00:12.097823 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:00:12.097823 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:00:12.097823 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:00:12.097823 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:00:12.097823 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:00:12.098866 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:00:12.098866 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:00:12.098866 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:00:12.098866 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:00:12.098866 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:00:12.098866 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:00:12.098866 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 28 08:00:12.098866 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 28 08:00:12.098866 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 28 08:00:12.098866 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 28 08:00:12.098866 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:00:12.098866 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:00:12.098866 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:00:12.098866 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:00:12.098866 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:00:12.098866 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:00:12.099703 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:00:12.099703 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application with Lock( Jul 28 08:00:12.099703 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:00:12.099703 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:00:12.099703 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:00:12.099703 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:00:12.099703 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:00:12.099703 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:00:12.099703 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:00:12.099703 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:00:12.099703 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 28 08:00:12.099703 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 08:00:12.099703 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 28 08:00:12.099703 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application Jul 28 08:00:12.099703 dv-cinder-851351-1-smb devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 468/968] 10.222.0.42 () {56 vars in 1111 bytes} [Thu Jul 28 08:00:11 2022] GET /identity/v3/services/compute => generated 88 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:00:12.100473 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd01703-2c73-4125-96a1-8c25e60db521 None admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:00:12.106485 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755168df-f709-4829-a4f7-7991da0280fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:00:12.107257 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755168df-f709-4829-a4f7-7991da0280fd None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:00:12.107529 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755168df-f709-4829-a4f7-7991da0280fd None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:00:12.107828 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755168df-f709-4829-a4f7-7991da0280fd None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:00:12.116336 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-755168df-f709-4829-a4f7-7991da0280fd None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:00:12.117943 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-755168df-f709-4829-a4f7-7991da0280fd None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:00:12.130811 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application [None req-755168df-f709-4829-a4f7-7991da0280fd None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 28 08:00:12.130811 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:00:12.130811 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:00:12.130811 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:00:12.130811 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:00:12.130811 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:00:12.130811 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:00:12.130811 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:00:12.130811 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:00:12.130811 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:00:12.130811 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:00:12.130811 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:00:12.130811 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 28 08:00:12.130811 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 28 08:00:12.130811 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 28 08:00:12.130811 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 28 08:00:12.131843 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:00:12.131843 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:00:12.131843 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 28 08:00:12.131843 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 08:00:12.131843 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 28 08:00:12.131843 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 08:00:12.131843 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:00:12.131843 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:00:12.131843 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:00:12.131843 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:00:12.131843 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:00:12.131843 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application with Lock( Jul 28 08:00:12.131843 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:00:12.131843 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:00:12.131843 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:00:12.131843 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:00:12.131843 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:00:12.131843 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:00:12.132841 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:00:12.132841 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:00:12.132841 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 28 08:00:12.132841 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 28 08:00:12.132841 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 28 08:00:12.132841 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 28 08:00:12.132841 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 28 08:00:12.132841 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 28 08:00:12.132841 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 28 08:00:12.132841 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application Jul 28 08:00:12.132841 dv-cinder-851351-1-smb devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 501/969] 10.222.0.42 () {56 vars in 1117 bytes} [Thu Jul 28 08:00:11 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:00:12.132841 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755168df-f709-4829-a4f7-7991da0280fd None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:00:12.208611 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=100 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:00:12.215147 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd01703-2c73-4125-96a1-8c25e60db521 None admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:00:12.242221 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:00:12.251799 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755168df-f709-4829-a4f7-7991da0280fd None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:00:12.251981 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f66a88b-3b55-4850-a016-025a85808b31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:00:12.252566 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f66a88b-3b55-4850-a016-025a85808b31 None admin] REQUEST_METHOD: `POST` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:00:12.252869 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f66a88b-3b55-4850-a016-025a85808b31 None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:00:12.253140 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f66a88b-3b55-4850-a016-025a85808b31 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:00:12.253856 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f66a88b-3b55-4850-a016-025a85808b31 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:00:12.255228 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f66a88b-3b55-4850-a016-025a85808b31 None admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:00:12.280574 dv-cinder-851351-1-smb devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 469/970] 10.222.0.42 () {60 vars in 1144 bytes} [Thu Jul 28 08:00:12 2022] POST /identity/v3/endpoints => generated 349 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 08:00:12.281600 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f66a88b-3b55-4850-a016-025a85808b31 None admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:00:12.305303 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c89bf7c-39b3-456f-a2ca-1610aa8812fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:00:12.305925 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c89bf7c-39b3-456f-a2ca-1610aa8812fb None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:00:12.306301 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c89bf7c-39b3-456f-a2ca-1610aa8812fb None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:00:12.306497 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c89bf7c-39b3-456f-a2ca-1610aa8812fb None admin] PATH_INFO: `/v3/services` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:00:12.307200 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c89bf7c-39b3-456f-a2ca-1610aa8812fb None admin] RBAC: Adding query filter params (name=compute) {{(pid=80347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:00:12.307500 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c89bf7c-39b3-456f-a2ca-1610aa8812fb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:00:12.309251 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c89bf7c-39b3-456f-a2ca-1610aa8812fb None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:00:12.319939 dv-cinder-851351-1-smb devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 502/971] 10.222.0.42 () {56 vars in 1112 bytes} [Thu Jul 28 08:00:12 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:00:12.321127 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c89bf7c-39b3-456f-a2ca-1610aa8812fb None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:00:12.436354 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f66a88b-3b55-4850-a016-025a85808b31 None admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:00:12.454466 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c89bf7c-39b3-456f-a2ca-1610aa8812fb None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:00:12.479079 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211a9dff-db29-4f1f-8168-52a741256265 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:00:12.479742 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211a9dff-db29-4f1f-8168-52a741256265 None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:00:12.480018 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211a9dff-db29-4f1f-8168-52a741256265 None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:00:12.480291 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211a9dff-db29-4f1f-8168-52a741256265 None admin] PATH_INFO: `/v3/users` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:00:12.481127 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-211a9dff-db29-4f1f-8168-52a741256265 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80348) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:00:12.481449 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-211a9dff-db29-4f1f-8168-52a741256265 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:00:12.482891 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-211a9dff-db29-4f1f-8168-52a741256265 None admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:00:12.494726 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4cbd20e-0ef7-4b2d-b2dd-b7cb7d5116dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:00:12.495684 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4cbd20e-0ef7-4b2d-b2dd-b7cb7d5116dc None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:00:12.496142 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4cbd20e-0ef7-4b2d-b2dd-b7cb7d5116dc None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:00:12.496589 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4cbd20e-0ef7-4b2d-b2dd-b7cb7d5116dc None admin] PATH_INFO: `/v3/services` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:00:12.497465 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4cbd20e-0ef7-4b2d-b2dd-b7cb7d5116dc None admin] RBAC: Adding query filter params (type=compute) {{(pid=80347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:00:12.497997 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4cbd20e-0ef7-4b2d-b2dd-b7cb7d5116dc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:00:12.499379 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4cbd20e-0ef7-4b2d-b2dd-b7cb7d5116dc None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:00:12.502120 dv-cinder-851351-1-smb devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 470/972] 10.222.0.42 () {56 vars in 1149 bytes} [Thu Jul 28 08:00:12 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:00:12.507444 dv-cinder-851351-1-smb devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 503/973] 10.222.0.42 () {56 vars in 1112 bytes} [Thu Jul 28 08:00:12 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 08:00:12.507609 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211a9dff-db29-4f1f-8168-52a741256265 None admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:00:12.521357 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:00:12.631035 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211a9dff-db29-4f1f-8168-52a741256265 None admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:00:12.672200 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837bb17a-2dbc-47a7-a2a1-0a0a0a9f60a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:00:12.672867 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837bb17a-2dbc-47a7-a2a1-0a0a0a9f60a4 None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:00:12.673143 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837bb17a-2dbc-47a7-a2a1-0a0a0a9f60a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:00:12.673408 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837bb17a-2dbc-47a7-a2a1-0a0a0a9f60a4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:00:12.747379 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-837bb17a-2dbc-47a7-a2a1-0a0a0a9f60a4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:00:12.748780 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-837bb17a-2dbc-47a7-a2a1-0a0a0a9f60a4 None admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:00:12.760945 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=100 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:00:12.855537 dv-cinder-851351-1-smb devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 471/974] 10.222.0.42 () {58 vars in 1282 bytes} [Thu Jul 28 08:00:12 2022] GET /identity/v3/auth/tokens => generated 1464 bytes in 348 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jul 28 08:00:12.861346 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4cbd20e-0ef7-4b2d-b2dd-b7cb7d5116dc None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:00:12.882106 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:00:12.971975 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4cbd20e-0ef7-4b2d-b2dd-b7cb7d5116dc None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:00:13.007540 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45df533d-710b-47fb-a603-888f8f2b4135 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:00:13.008110 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45df533d-710b-47fb-a603-888f8f2b4135 None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:00:13.008413 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45df533d-710b-47fb-a603-888f8f2b4135 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:00:13.008676 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45df533d-710b-47fb-a603-888f8f2b4135 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:00:13.020021 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45df533d-710b-47fb-a603-888f8f2b4135 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:00:13.021495 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45df533d-710b-47fb-a603-888f8f2b4135 None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:00:13.036516 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application [None req-45df533d-710b-47fb-a603-888f8f2b4135 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 08:00:13.036516 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:00:13.036516 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:00:13.036516 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:00:13.036516 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:00:13.036516 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:00:13.036516 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:00:13.036516 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:00:13.036516 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:00:13.036516 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:00:13.036516 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:00:13.036516 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:00:13.036516 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 08:00:13.036516 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 08:00:13.036516 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 08:00:13.037641 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 08:00:13.037641 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:00:13.037641 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:00:13.037641 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:00:13.037641 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:00:13.037641 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:00:13.037641 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:00:13.037641 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:00:13.037641 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application with Lock( Jul 28 08:00:13.037641 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:00:13.037641 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:00:13.037641 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:00:13.037641 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:00:13.037641 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:00:13.037641 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:00:13.037641 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:00:13.037641 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:00:13.038553 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 08:00:13.038553 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 08:00:13.038553 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 08:00:13.038553 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application Jul 28 08:00:13.038553 dv-cinder-851351-1-smb devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 504/975] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 08:00:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:00:13.044863 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837bb17a-2dbc-47a7-a2a1-0a0a0a9f60a4 None admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:00:13.146870 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837bb17a-2dbc-47a7-a2a1-0a0a0a9f60a4 None admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:00:13.159161 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=100 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:00:13.190869 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e93703a-9b50-4f60-b1b6-9fc5317d9bf6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:00:13.191493 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e93703a-9b50-4f60-b1b6-9fc5317d9bf6 None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:00:13.191767 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e93703a-9b50-4f60-b1b6-9fc5317d9bf6 None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:00:13.192029 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e93703a-9b50-4f60-b1b6-9fc5317d9bf6 None admin] PATH_INFO: `/v3/domains` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:00:13.192812 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e93703a-9b50-4f60-b1b6-9fc5317d9bf6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80348) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:00:13.193100 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e93703a-9b50-4f60-b1b6-9fc5317d9bf6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:00:13.194529 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e93703a-9b50-4f60-b1b6-9fc5317d9bf6 None admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:00:13.208851 dv-cinder-851351-1-smb devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 472/976] 10.222.0.42 () {56 vars in 1109 bytes} [Thu Jul 28 08:00:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 08:00:13.213676 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45df533d-710b-47fb-a603-888f8f2b4135 None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:00:13.285728 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:00:13.325783 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45df533d-710b-47fb-a603-888f8f2b4135 None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:00:13.368711 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f9362cb-c8f2-4c6b-8881-231396971d70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:00:13.369354 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9362cb-c8f2-4c6b-8881-231396971d70 None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:00:13.369625 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9362cb-c8f2-4c6b-8881-231396971d70 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:00:13.369879 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9362cb-c8f2-4c6b-8881-231396971d70 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:00:13.377479 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f9362cb-c8f2-4c6b-8881-231396971d70 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:00:13.378911 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f9362cb-c8f2-4c6b-8881-231396971d70 None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:00:13.391186 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application [None req-7f9362cb-c8f2-4c6b-8881-231396971d70 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 08:00:13.391186 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:00:13.391186 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:00:13.391186 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:00:13.391186 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:00:13.391186 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:00:13.391186 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:00:13.391186 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:00:13.391186 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:00:13.391186 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:00:13.391186 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:00:13.391186 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:00:13.391186 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 28 08:00:13.391186 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 28 08:00:13.391186 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 28 08:00:13.392097 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 28 08:00:13.392097 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:00:13.392097 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:00:13.392097 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:00:13.392097 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:00:13.392097 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:00:13.392097 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:00:13.392097 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:00:13.392097 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application with Lock( Jul 28 08:00:13.392097 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:00:13.392097 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:00:13.392097 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:00:13.392097 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:00:13.392097 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:00:13.392097 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:00:13.392097 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:00:13.392097 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:00:13.393396 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 28 08:00:13.393396 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 28 08:00:13.393396 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 28 08:00:13.393396 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 28 08:00:13.393396 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 28 08:00:13.393396 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 28 08:00:13.393396 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 08:00:13.393396 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application Jul 28 08:00:13.394162 dv-cinder-851351-1-smb devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 505/977] 10.222.0.42 () {56 vars in 1111 bytes} [Thu Jul 28 08:00:13 2022] GET /identity/v3/projects/service => generated 88 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:00:13.398281 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e93703a-9b50-4f60-b1b6-9fc5317d9bf6 None admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:00:13.513800 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e93703a-9b50-4f60-b1b6-9fc5317d9bf6 None admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:00:13.547768 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ef8d77-15d0-4e7f-b888-3465d0be52a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:00:13.548308 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ef8d77-15d0-4e7f-b888-3465d0be52a5 None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:00:13.548587 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ef8d77-15d0-4e7f-b888-3465d0be52a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:00:13.548897 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ef8d77-15d0-4e7f-b888-3465d0be52a5 None admin] PATH_INFO: `/v3/projects` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:00:13.549653 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12ef8d77-15d0-4e7f-b888-3465d0be52a5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80348) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:00:13.549964 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12ef8d77-15d0-4e7f-b888-3465d0be52a5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:00:13.551442 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12ef8d77-15d0-4e7f-b888-3465d0be52a5 None admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:00:13.564068 dv-cinder-851351-1-smb devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 473/978] 10.222.0.42 () {56 vars in 1148 bytes} [Thu Jul 28 08:00:13 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:00:13.569976 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f9362cb-c8f2-4c6b-8881-231396971d70 None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:00:13.674806 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f9362cb-c8f2-4c6b-8881-231396971d70 None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:00:13.703129 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:00:13.714039 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f61e8c13-c999-43bc-a205-b9d0cf1b4995 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:00:13.714829 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61e8c13-c999-43bc-a205-b9d0cf1b4995 None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:00:13.715231 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61e8c13-c999-43bc-a205-b9d0cf1b4995 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:00:13.715630 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61e8c13-c999-43bc-a205-b9d0cf1b4995 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:00:13.716542 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f61e8c13-c999-43bc-a205-b9d0cf1b4995 None admin] RBAC: Adding query filter params (role.id=a2ca675df8464a35b15d0c6795636b90, scope.project.id=139349507026497c98f360774dee737e, user.id=4a92b0d2802e46f4beffaaf39ed6723c) {{(pid=80347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:00:13.717024 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f61e8c13-c999-43bc-a205-b9d0cf1b4995 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:00:13.718590 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f61e8c13-c999-43bc-a205-b9d0cf1b4995 None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:00:13.732713 dv-cinder-851351-1-smb devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 506/979] 10.222.0.42 () {56 vars in 1374 bytes} [Thu Jul 28 08:00:13 2022] GET /identity/v3/role_assignments?user.id=4a92b0d2802e46f4beffaaf39ed6723c&scope.project.id=139349507026497c98f360774dee737e&role.id=a2ca675df8464a35b15d0c6795636b90 => generated 608 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:00:14.294801 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d2bd06-f474-47d3-a56a-211b6f6391e8 None None] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:00:14.295358 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d2bd06-f474-47d3-a56a-211b6f6391e8 None None] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:00:14.295358 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d2bd06-f474-47d3-a56a-211b6f6391e8 None None] PATH_INFO: `/` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:00:14.296794 dv-cinder-851351-1-smb devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 474/980] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 08:00:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 08:00:14.302175 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee542a5-231e-4585-92d9-bd18eb5ed8dd None None] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:00:14.302633 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee542a5-231e-4585-92d9-bd18eb5ed8dd None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:00:14.302711 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee542a5-231e-4585-92d9-bd18eb5ed8dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:00:14.321544 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.auth.core [None req-1ee542a5-231e-4585-92d9-bd18eb5ed8dd None None] MFA Rules not processed for user `f0666d3a50644a7097367331c1ee1a68`. Rule list: `[]` (Enabled: `True`). {{(pid=80347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 08:00:14.322773 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-1ee542a5-231e-4585-92d9-bd18eb5ed8dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:00:14.392424 dv-cinder-851351-1-smb devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 507/981] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 08:00:14 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 08:00:14.414780 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d2bd06-f474-47d3-a56a-211b6f6391e8 None None] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:00:14.451945 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=100 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:00:14.519097 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5288e7c3-df3d-439e-a11e-23e87d6a848d None None] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:00:14.519473 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5288e7c3-df3d-439e-a11e-23e87d6a848d None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:00:14.519656 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5288e7c3-df3d-439e-a11e-23e87d6a848d None None] PATH_INFO: `/` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:00:14.521247 dv-cinder-851351-1-smb devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 508/982] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 08:00:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 28 08:00:14.526688 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a434a66d-02ad-446a-87d8-b9da2e75796d None None] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:00:14.526957 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a434a66d-02ad-446a-87d8-b9da2e75796d None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:00:14.527222 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a434a66d-02ad-446a-87d8-b9da2e75796d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:00:14.536245 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d2bd06-f474-47d3-a56a-211b6f6391e8 None None] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:00:14.547644 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.auth.core [None req-a434a66d-02ad-446a-87d8-b9da2e75796d None None] MFA Rules not processed for user `f0666d3a50644a7097367331c1ee1a68`. Rule list: `[]` (Enabled: `True`). {{(pid=80347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 08:00:14.548888 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-a434a66d-02ad-446a-87d8-b9da2e75796d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:00:14.588680 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7893df6c-3cfd-42b0-940f-258664d8fe19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:00:14.589356 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7893df6c-3cfd-42b0-940f-258664d8fe19 None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:00:14.589625 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7893df6c-3cfd-42b0-940f-258664d8fe19 None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:00:14.589883 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7893df6c-3cfd-42b0-940f-258664d8fe19 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:00:14.590520 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7893df6c-3cfd-42b0-940f-258664d8fe19 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:00:14.591910 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7893df6c-3cfd-42b0-940f-258664d8fe19 None admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:00:14.601638 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application [None req-7893df6c-3cfd-42b0-940f-258664d8fe19 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 28 08:00:14.601638 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:00:14.601638 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 28 08:00:14.601638 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 28 08:00:14.601638 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 28 08:00:14.601638 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 28 08:00:14.601638 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 28 08:00:14.601638 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 08:00:14.601638 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 28 08:00:14.601638 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application Jul 28 08:00:14.601638 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 28 08:00:14.601638 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application Jul 28 08:00:14.601638 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:00:14.601638 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:00:14.601638 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:00:14.601638 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:00:14.601638 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:00:14.602732 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:00:14.602732 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:00:14.602732 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:00:14.602732 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:00:14.602732 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:00:14.602732 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:00:14.602732 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 28 08:00:14.602732 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 28 08:00:14.602732 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 28 08:00:14.602732 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 28 08:00:14.602732 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:00:14.602732 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:00:14.602732 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:00:14.602732 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:00:14.602732 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:00:14.602732 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:00:14.603691 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:00:14.603691 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application with Lock( Jul 28 08:00:14.603691 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:00:14.603691 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:00:14.603691 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:00:14.603691 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:00:14.603691 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:00:14.603691 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:00:14.603691 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:00:14.603691 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:00:14.603691 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 28 08:00:14.603691 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 08:00:14.603691 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 28 08:00:14.603691 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application Jul 28 08:00:14.607802 dv-cinder-851351-1-smb devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 475/983] 10.222.0.42 () {56 vars in 1126 bytes} [Thu Jul 28 08:00:14 2022] GET /identity/v3/services/object-store => generated 93 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:00:14.609107 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7893df6c-3cfd-42b0-940f-258664d8fe19 None admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:00:14.629305 dv-cinder-851351-1-smb devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 509/984] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 08:00:14 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 28 08:00:14.651149 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a434a66d-02ad-446a-87d8-b9da2e75796d None None] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:00:14.705330 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:00:14.710431 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=100 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:00:14.719039 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7893df6c-3cfd-42b0-940f-258664d8fe19 None admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:00:14.756479 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505caada-e68b-45d0-b6d3-d9dac06b6734 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:00:14.757132 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505caada-e68b-45d0-b6d3-d9dac06b6734 None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:00:14.757408 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505caada-e68b-45d0-b6d3-d9dac06b6734 None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:00:14.757527 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a434a66d-02ad-446a-87d8-b9da2e75796d None None] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:00:14.757696 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505caada-e68b-45d0-b6d3-d9dac06b6734 None admin] PATH_INFO: `/v3/services` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:00:14.758351 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-505caada-e68b-45d0-b6d3-d9dac06b6734 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80348) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:00:14.758650 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-505caada-e68b-45d0-b6d3-d9dac06b6734 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:00:14.760127 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-505caada-e68b-45d0-b6d3-d9dac06b6734 None admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:00:14.765314 dv-cinder-851351-1-smb devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 476/985] 10.222.0.42 () {56 vars in 1122 bytes} [Thu Jul 28 08:00:14 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:00:14.770832 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505caada-e68b-45d0-b6d3-d9dac06b6734 None admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:00:14.793497 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155631ab-f605-4778-af9b-edac1abc6ef1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:00:14.794133 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155631ab-f605-4778-af9b-edac1abc6ef1 None admin] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:00:14.794407 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155631ab-f605-4778-af9b-edac1abc6ef1 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:00:14.794687 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155631ab-f605-4778-af9b-edac1abc6ef1 None admin] PATH_INFO: `/v3/services` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:00:14.795375 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-155631ab-f605-4778-af9b-edac1abc6ef1 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:00:14.796770 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-155631ab-f605-4778-af9b-edac1abc6ef1 None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:00:14.813522 dv-cinder-851351-1-smb devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 510/986] 10.222.0.42 () {60 vars in 1141 bytes} [Thu Jul 28 08:00:14 2022] POST /identity/v3/services => generated 242 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 28 08:00:14.888985 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505caada-e68b-45d0-b6d3-d9dac06b6734 None admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:00:14.932162 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155359f1-e538-4aa7-bb6d-22021d412574 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:00:14.932842 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155359f1-e538-4aa7-bb6d-22021d412574 None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:00:14.933116 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155359f1-e538-4aa7-bb6d-22021d412574 None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:00:14.933378 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155359f1-e538-4aa7-bb6d-22021d412574 None admin] PATH_INFO: `/v3/services` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:00:14.934066 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-155359f1-e538-4aa7-bb6d-22021d412574 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80348) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:00:14.934372 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-155359f1-e538-4aa7-bb6d-22021d412574 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:00:14.935774 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-155359f1-e538-4aa7-bb6d-22021d412574 None admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:00:14.946484 dv-cinder-851351-1-smb devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 477/987] 10.222.0.42 () {56 vars in 1122 bytes} [Thu Jul 28 08:00:14 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 08:00:14.947710 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155631ab-f605-4778-af9b-edac1abc6ef1 None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:00:15.054343 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155631ab-f605-4778-af9b-edac1abc6ef1 None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:00:15.067170 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:00:15.090835 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db50dd8-8ce8-42c2-bce8-c487f11de73b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:00:15.091463 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db50dd8-8ce8-42c2-bce8-c487f11de73b None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:00:15.091737 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db50dd8-8ce8-42c2-bce8-c487f11de73b None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:00:15.092005 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db50dd8-8ce8-42c2-bce8-c487f11de73b None admin] PATH_INFO: `/v3/endpoints` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:00:15.092830 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7db50dd8-8ce8-42c2-bce8-c487f11de73b None admin] RBAC: Adding query filter params (interface=admin, service_id=c09263f604af42919a649236606b7787, region_id=RegionOne) {{(pid=80347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:00:15.093134 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7db50dd8-8ce8-42c2-bce8-c487f11de73b None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:00:15.094483 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7db50dd8-8ce8-42c2-bce8-c487f11de73b None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:00:15.104237 dv-cinder-851351-1-smb devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 511/988] 10.222.0.42 () {56 vars in 1249 bytes} [Thu Jul 28 08:00:14 2022] GET /identity/v3/endpoints?service_id=c09263f604af42919a649236606b7787&interface=admin®ion_id=RegionOne => generated 193 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:00:15.105839 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155359f1-e538-4aa7-bb6d-22021d412574 None admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:00:15.126053 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=100 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:00:15.219969 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155359f1-e538-4aa7-bb6d-22021d412574 None admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:00:15.261148 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e094679-8354-4793-b3ab-8bb69a8e6f67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:00:15.261785 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e094679-8354-4793-b3ab-8bb69a8e6f67 None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:00:15.262027 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e094679-8354-4793-b3ab-8bb69a8e6f67 None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:00:15.262322 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e094679-8354-4793-b3ab-8bb69a8e6f67 None admin] PATH_INFO: `/v3/services` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:00:15.262978 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e094679-8354-4793-b3ab-8bb69a8e6f67 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:00:15.264376 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e094679-8354-4793-b3ab-8bb69a8e6f67 None admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:00:15.276798 dv-cinder-851351-1-smb devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 478/989] 10.222.0.42 () {56 vars in 1087 bytes} [Thu Jul 28 08:00:15 2022] GET /identity/v3/services => generated 1727 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 08:00:15.791480 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c4ac0a-e4ac-4d35-bde6-69c058e716bc None None] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:00:15.792136 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c4ac0a-e4ac-4d35-bde6-69c058e716bc None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:00:15.792136 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c4ac0a-e4ac-4d35-bde6-69c058e716bc None None] PATH_INFO: `/` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:00:15.793527 dv-cinder-851351-1-smb devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 512/990] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 08:00:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 08:00:15.799089 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab729009-9f1f-43b4-87bc-64a351f75597 None None] REQUEST_METHOD: `POST` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:00:15.799561 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab729009-9f1f-43b4-87bc-64a351f75597 None None] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:00:15.799637 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab729009-9f1f-43b4-87bc-64a351f75597 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:00:15.818691 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.auth.core [None req-ab729009-9f1f-43b4-87bc-64a351f75597 None None] MFA Rules not processed for user `f0666d3a50644a7097367331c1ee1a68`. Rule list: `[]` (Enabled: `True`). {{(pid=80348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 08:00:15.819901 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.fernet_utils [None req-ab729009-9f1f-43b4-87bc-64a351f75597 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:00:15.907490 dv-cinder-851351-1-smb devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 479/991] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 08:00:15 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 08:00:15.929539 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c4ac0a-e4ac-4d35-bde6-69c058e716bc None None] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:00:16.052848 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c4ac0a-e4ac-4d35-bde6-69c058e716bc None None] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:00:16.087694 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ea1eac-2a3b-4676-99d8-ca6e3981a946 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:00:16.088352 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ea1eac-2a3b-4676-99d8-ca6e3981a946 None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:00:16.088629 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ea1eac-2a3b-4676-99d8-ca6e3981a946 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:00:16.088931 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ea1eac-2a3b-4676-99d8-ca6e3981a946 None admin] PATH_INFO: `/v3/services/image` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:00:16.089559 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24ea1eac-2a3b-4676-99d8-ca6e3981a946 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:00:16.090947 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24ea1eac-2a3b-4676-99d8-ca6e3981a946 None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:00:16.100681 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application [None req-24ea1eac-2a3b-4676-99d8-ca6e3981a946 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jul 28 08:00:16.100681 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:00:16.100681 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 28 08:00:16.100681 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 28 08:00:16.100681 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 28 08:00:16.100681 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 28 08:00:16.100681 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 28 08:00:16.100681 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 08:00:16.100681 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 28 08:00:16.100681 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application Jul 28 08:00:16.100681 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 28 08:00:16.100681 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application Jul 28 08:00:16.100681 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:00:16.100681 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:00:16.100681 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:00:16.100681 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:00:16.100681 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:00:16.101681 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:00:16.101681 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:00:16.101681 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:00:16.101681 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:00:16.101681 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:00:16.101681 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:00:16.101681 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 28 08:00:16.101681 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 28 08:00:16.101681 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 28 08:00:16.101681 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 28 08:00:16.101681 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:00:16.101681 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:00:16.101681 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:00:16.101681 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:00:16.101681 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:00:16.101681 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:00:16.102529 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:00:16.102529 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application with Lock( Jul 28 08:00:16.102529 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:00:16.102529 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:00:16.102529 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:00:16.102529 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:00:16.102529 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:00:16.102529 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:00:16.102529 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:00:16.102529 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:00:16.102529 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 28 08:00:16.102529 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 08:00:16.102529 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 28 08:00:16.102529 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application Jul 28 08:00:16.102529 dv-cinder-851351-1-smb devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 513/992] 10.222.0.42 () {56 vars in 1105 bytes} [Thu Jul 28 08:00:15 2022] GET /identity/v3/services/image => generated 86 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:00:16.112176 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab729009-9f1f-43b4-87bc-64a351f75597 None None] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:00:16.126289 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=100 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:00:16.234093 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab729009-9f1f-43b4-87bc-64a351f75597 None None] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:00:16.275981 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f92d0d-549d-48dc-b0b9-c19178835fe0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:00:16.276604 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f92d0d-549d-48dc-b0b9-c19178835fe0 None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:00:16.276904 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f92d0d-549d-48dc-b0b9-c19178835fe0 None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:00:16.277175 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f92d0d-549d-48dc-b0b9-c19178835fe0 None admin] PATH_INFO: `/v3/services` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:00:16.277878 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f92d0d-549d-48dc-b0b9-c19178835fe0 None admin] RBAC: Adding query filter params (name=image) {{(pid=80348) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:00:16.278183 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f92d0d-549d-48dc-b0b9-c19178835fe0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:00:16.279560 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f92d0d-549d-48dc-b0b9-c19178835fe0 None admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:00:16.286519 dv-cinder-851351-1-smb devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 480/993] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 08:00:16 2022] GET /identity/v3/services?name=image => generated 122 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:00:16.290957 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ea1eac-2a3b-4676-99d8-ca6e3981a946 None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:00:16.346054 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:00:16.417511 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ea1eac-2a3b-4676-99d8-ca6e3981a946 None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:00:16.452994 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92490239-4d3f-419c-abd0-ad1c6fc60a31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:00:16.453981 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92490239-4d3f-419c-abd0-ad1c6fc60a31 None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:00:16.454261 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92490239-4d3f-419c-abd0-ad1c6fc60a31 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:00:16.454531 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92490239-4d3f-419c-abd0-ad1c6fc60a31 None admin] PATH_INFO: `/v3/services` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:00:16.455205 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92490239-4d3f-419c-abd0-ad1c6fc60a31 None admin] RBAC: Adding query filter params (type=image) {{(pid=80347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:00:16.455512 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92490239-4d3f-419c-abd0-ad1c6fc60a31 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:00:16.456914 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92490239-4d3f-419c-abd0-ad1c6fc60a31 None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:00:16.468716 dv-cinder-851351-1-smb devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 514/994] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 08:00:16 2022] GET /identity/v3/services?type=image => generated 122 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:00:16.860126 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc59d180-f0c2-46d2-9378-92b69f19596e None None] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:00:16.860883 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc59d180-f0c2-46d2-9378-92b69f19596e None None] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:00:16.860883 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc59d180-f0c2-46d2-9378-92b69f19596e None None] PATH_INFO: `/` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:00:16.862391 dv-cinder-851351-1-smb devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 481/995] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 08:00:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 08:00:16.868865 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1e4eae-e5de-4795-b7a4-289177564844 None None] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:00:16.869389 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1e4eae-e5de-4795-b7a4-289177564844 None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:00:16.869732 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1e4eae-e5de-4795-b7a4-289177564844 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:00:16.897291 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.auth.core [None req-8e1e4eae-e5de-4795-b7a4-289177564844 None None] MFA Rules not processed for user `f0666d3a50644a7097367331c1ee1a68`. Rule list: `[]` (Enabled: `True`). {{(pid=80347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 08:00:16.898507 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-8e1e4eae-e5de-4795-b7a4-289177564844 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:00:16.972717 dv-cinder-851351-1-smb devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 515/996] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 08:00:16 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 28 08:00:16.992369 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc59d180-f0c2-46d2-9378-92b69f19596e None None] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:00:17.075364 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=100 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:00:17.109107 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc59d180-f0c2-46d2-9378-92b69f19596e None None] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:00:17.145208 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a739fb0-c6a4-4d74-850a-199230514ffe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:00:17.145773 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a739fb0-c6a4-4d74-850a-199230514ffe None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:00:17.146047 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a739fb0-c6a4-4d74-850a-199230514ffe None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:00:17.146316 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a739fb0-c6a4-4d74-850a-199230514ffe None admin] PATH_INFO: `/v3/services/compute` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:00:17.146947 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a739fb0-c6a4-4d74-850a-199230514ffe None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:00:17.148329 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a739fb0-c6a4-4d74-850a-199230514ffe None admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:00:17.162665 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application [None req-0a739fb0-c6a4-4d74-850a-199230514ffe None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jul 28 08:00:17.162665 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:00:17.162665 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 28 08:00:17.162665 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 28 08:00:17.162665 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 28 08:00:17.162665 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 28 08:00:17.162665 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 28 08:00:17.162665 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 08:00:17.162665 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 28 08:00:17.162665 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application Jul 28 08:00:17.162665 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 28 08:00:17.162665 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application Jul 28 08:00:17.162665 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:00:17.162665 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:00:17.162665 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:00:17.162665 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:00:17.162665 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:00:17.163777 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:00:17.163777 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:00:17.163777 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:00:17.163777 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:00:17.163777 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:00:17.163777 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:00:17.163777 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 28 08:00:17.163777 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 28 08:00:17.163777 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 28 08:00:17.163777 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 28 08:00:17.163777 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:00:17.163777 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:00:17.163777 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:00:17.163777 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:00:17.163777 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:00:17.163777 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:00:17.164618 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:00:17.164618 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application with Lock( Jul 28 08:00:17.164618 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:00:17.164618 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:00:17.164618 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:00:17.164618 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:00:17.164618 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:00:17.164618 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:00:17.164618 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:00:17.164618 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:00:17.164618 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 28 08:00:17.164618 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 08:00:17.164618 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 28 08:00:17.164618 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application Jul 28 08:00:17.173209 dv-cinder-851351-1-smb devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 482/997] 10.222.0.42 () {56 vars in 1111 bytes} [Thu Jul 28 08:00:16 2022] GET /identity/v3/services/compute => generated 88 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:00:17.175237 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1e4eae-e5de-4795-b7a4-289177564844 None None] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:00:17.242273 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:00:17.306138 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5e5965-9004-4a19-8bd8-bf93787c93ea None None] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:00:17.306554 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5e5965-9004-4a19-8bd8-bf93787c93ea None None] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:00:17.306704 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5e5965-9004-4a19-8bd8-bf93787c93ea None None] PATH_INFO: `/` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:00:17.308054 dv-cinder-851351-1-smb devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 483/998] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 08:00:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 28 08:00:17.313723 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a33413-79b4-4f5a-be69-ce42b33feb6e None None] REQUEST_METHOD: `POST` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:00:17.314012 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a33413-79b4-4f5a-be69-ce42b33feb6e None None] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:00:17.314441 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a33413-79b4-4f5a-be69-ce42b33feb6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:00:17.333580 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.auth.core [None req-33a33413-79b4-4f5a-be69-ce42b33feb6e None None] MFA Rules not processed for user `f0666d3a50644a7097367331c1ee1a68`. Rule list: `[]` (Enabled: `True`). {{(pid=80348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 08:00:17.334860 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.fernet_utils [None req-33a33413-79b4-4f5a-be69-ce42b33feb6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:00:17.367150 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1e4eae-e5de-4795-b7a4-289177564844 None None] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:00:17.413683 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66859d9f-2677-4b59-b767-d036d538373c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:00:17.414203 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66859d9f-2677-4b59-b767-d036d538373c None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:00:17.414483 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66859d9f-2677-4b59-b767-d036d538373c None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:00:17.414968 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66859d9f-2677-4b59-b767-d036d538373c None admin] PATH_INFO: `/v3/services` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:00:17.415456 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66859d9f-2677-4b59-b767-d036d538373c None admin] RBAC: Adding query filter params (name=compute) {{(pid=80347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:00:17.415733 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66859d9f-2677-4b59-b767-d036d538373c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:00:17.417170 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66859d9f-2677-4b59-b767-d036d538373c None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:00:17.420465 dv-cinder-851351-1-smb devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 484/999] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 08:00:17 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 28 08:00:17.427111 dv-cinder-851351-1-smb devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 516/1000] 10.222.0.42 () {56 vars in 1112 bytes} [Thu Jul 28 08:00:17 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:00:17.428854 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a33413-79b4-4f5a-be69-ce42b33feb6e None None] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:00:17.442723 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66859d9f-2677-4b59-b767-d036d538373c None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:00:17.502422 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=100 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:00:17.537482 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a33413-79b4-4f5a-be69-ce42b33feb6e None None] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:00:17.550711 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:00:17.555506 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66859d9f-2677-4b59-b767-d036d538373c None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:00:17.576109 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-073a2e90-d53e-43a4-b25a-2a51ba2ceadb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:00:17.576799 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073a2e90-d53e-43a4-b25a-2a51ba2ceadb None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:00:17.577081 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073a2e90-d53e-43a4-b25a-2a51ba2ceadb None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:00:17.577356 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073a2e90-d53e-43a4-b25a-2a51ba2ceadb None admin] PATH_INFO: `/v3/services` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:00:17.578079 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-073a2e90-d53e-43a4-b25a-2a51ba2ceadb None admin] RBAC: Adding query filter params (type=compute) {{(pid=80348) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:00:17.578780 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-073a2e90-d53e-43a4-b25a-2a51ba2ceadb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:00:17.580290 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-073a2e90-d53e-43a4-b25a-2a51ba2ceadb None admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:00:17.586152 dv-cinder-851351-1-smb devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 485/1001] 10.222.0.42 () {56 vars in 1112 bytes} [Thu Jul 28 08:00:17 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:00:17.593679 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-073a2e90-d53e-43a4-b25a-2a51ba2ceadb None admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:00:17.598812 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb4e5f7-34ac-4a5d-8db6-4a40eb28ddf0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:00:17.599472 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb4e5f7-34ac-4a5d-8db6-4a40eb28ddf0 None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:00:17.599750 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb4e5f7-34ac-4a5d-8db6-4a40eb28ddf0 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:00:17.600021 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb4e5f7-34ac-4a5d-8db6-4a40eb28ddf0 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:00:17.600655 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb4e5f7-34ac-4a5d-8db6-4a40eb28ddf0 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:00:17.602063 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb4e5f7-34ac-4a5d-8db6-4a40eb28ddf0 None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:00:17.612020 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application [None req-8eb4e5f7-34ac-4a5d-8db6-4a40eb28ddf0 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 28 08:00:17.612020 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:00:17.612020 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 28 08:00:17.612020 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 28 08:00:17.612020 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 28 08:00:17.612020 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 28 08:00:17.612020 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 28 08:00:17.612020 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 08:00:17.612020 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 28 08:00:17.612020 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application Jul 28 08:00:17.612020 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 28 08:00:17.612020 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application Jul 28 08:00:17.612020 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:00:17.612020 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:00:17.612020 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:00:17.612020 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:00:17.612020 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:00:17.613102 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:00:17.613102 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:00:17.613102 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:00:17.613102 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:00:17.613102 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:00:17.613102 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:00:17.613102 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 28 08:00:17.613102 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 28 08:00:17.613102 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 28 08:00:17.613102 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 28 08:00:17.613102 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:00:17.613102 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:00:17.613102 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:00:17.613102 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:00:17.613102 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:00:17.613102 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:00:17.613966 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:00:17.613966 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application with Lock( Jul 28 08:00:17.613966 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:00:17.613966 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:00:17.613966 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:00:17.613966 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:00:17.613966 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:00:17.613966 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:00:17.613966 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:00:17.613966 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:00:17.613966 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 28 08:00:17.613966 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 08:00:17.613966 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 28 08:00:17.613966 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application Jul 28 08:00:17.613966 dv-cinder-851351-1-smb devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 517/1002] 10.222.0.42 () {56 vars in 1126 bytes} [Thu Jul 28 08:00:17 2022] GET /identity/v3/services/object-store => generated 93 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 08:00:17.619410 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb4e5f7-34ac-4a5d-8db6-4a40eb28ddf0 None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:00:17.705808 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-073a2e90-d53e-43a4-b25a-2a51ba2ceadb None admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:00:17.727310 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb4e5f7-34ac-4a5d-8db6-4a40eb28ddf0 None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:00:17.742966 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79ccb22-2582-40e6-a943-bff142db259a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:00:17.743643 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79ccb22-2582-40e6-a943-bff142db259a None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:00:17.743921 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79ccb22-2582-40e6-a943-bff142db259a None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:00:17.744187 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79ccb22-2582-40e6-a943-bff142db259a None admin] PATH_INFO: `/v3/endpoints` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:00:17.744980 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c79ccb22-2582-40e6-a943-bff142db259a None admin] RBAC: Adding query filter params (interface=public, service_id=f3bab66f10114bd9bc194ac08dd60a0b, region_id=RegionOne) {{(pid=80348) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:00:17.745291 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c79ccb22-2582-40e6-a943-bff142db259a None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:00:17.746696 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c79ccb22-2582-40e6-a943-bff142db259a None admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:00:17.748453 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=100 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:00:17.753642 dv-cinder-851351-1-smb devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 486/1003] 10.222.0.42 () {56 vars in 1251 bytes} [Thu Jul 28 08:00:17 2022] GET /identity/v3/endpoints?service_id=f3bab66f10114bd9bc194ac08dd60a0b&interface=public®ion_id=RegionOne => generated 194 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:00:17.759149 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79ccb22-2582-40e6-a943-bff142db259a None admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:00:17.769110 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df55c45d-32a2-46ee-98b1-3c27b59fdfe0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:00:17.769792 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df55c45d-32a2-46ee-98b1-3c27b59fdfe0 None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:00:17.770358 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df55c45d-32a2-46ee-98b1-3c27b59fdfe0 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:00:17.770635 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df55c45d-32a2-46ee-98b1-3c27b59fdfe0 None admin] PATH_INFO: `/v3/services` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:00:17.771316 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df55c45d-32a2-46ee-98b1-3c27b59fdfe0 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:00:17.771913 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df55c45d-32a2-46ee-98b1-3c27b59fdfe0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:00:17.773324 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df55c45d-32a2-46ee-98b1-3c27b59fdfe0 None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:00:17.778650 dv-cinder-851351-1-smb devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 518/1004] 10.222.0.42 () {56 vars in 1122 bytes} [Thu Jul 28 08:00:17 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:00:17.784200 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df55c45d-32a2-46ee-98b1-3c27b59fdfe0 None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:00:17.812798 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:00:17.867189 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79ccb22-2582-40e6-a943-bff142db259a None admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:00:17.898239 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df55c45d-32a2-46ee-98b1-3c27b59fdfe0 None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:00:17.906318 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c0e39e-48cf-485f-81b1-3847e9e7a99e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:00:17.906952 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c0e39e-48cf-485f-81b1-3847e9e7a99e None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:00:17.907223 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c0e39e-48cf-485f-81b1-3847e9e7a99e None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:00:17.907495 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c0e39e-48cf-485f-81b1-3847e9e7a99e None admin] PATH_INFO: `/v3/services` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:00:17.908151 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c0e39e-48cf-485f-81b1-3847e9e7a99e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:00:17.909565 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c0e39e-48cf-485f-81b1-3847e9e7a99e None admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:00:17.916744 dv-cinder-851351-1-smb devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 487/1005] 10.222.0.42 () {56 vars in 1087 bytes} [Thu Jul 28 08:00:17 2022] GET /identity/v3/services => generated 1727 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 08:00:17.946998 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3935f2-0b54-4306-896b-3bdc909408eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:00:17.947643 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3935f2-0b54-4306-896b-3bdc909408eb None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:00:17.947921 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3935f2-0b54-4306-896b-3bdc909408eb None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:00:17.948188 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3935f2-0b54-4306-896b-3bdc909408eb None admin] PATH_INFO: `/v3/services` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:00:17.948931 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc3935f2-0b54-4306-896b-3bdc909408eb None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:00:17.949231 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc3935f2-0b54-4306-896b-3bdc909408eb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:00:17.950679 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc3935f2-0b54-4306-896b-3bdc909408eb None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:00:17.962184 dv-cinder-851351-1-smb devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 519/1006] 10.222.0.42 () {56 vars in 1122 bytes} [Thu Jul 28 08:00:17 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:00:17.963601 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c0e39e-48cf-485f-81b1-3847e9e7a99e None admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:00:18.036652 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=100 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:00:18.081503 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c0e39e-48cf-485f-81b1-3847e9e7a99e None admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:00:18.119019 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba5c9790-71dd-4a90-936a-589a932c4228 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:00:18.119642 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5c9790-71dd-4a90-936a-589a932c4228 None admin] REQUEST_METHOD: `POST` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:00:18.119923 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5c9790-71dd-4a90-936a-589a932c4228 None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:00:18.120189 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5c9790-71dd-4a90-936a-589a932c4228 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:00:18.120935 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba5c9790-71dd-4a90-936a-589a932c4228 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:00:18.122314 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba5c9790-71dd-4a90-936a-589a932c4228 None admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:00:18.140701 dv-cinder-851351-1-smb devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 488/1007] 10.222.0.42 () {60 vars in 1144 bytes} [Thu Jul 28 08:00:17 2022] POST /identity/v3/endpoints => generated 325 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 08:00:18.478562 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814e10ae-0be7-4fa3-8e68-f7643f76fc1b None None] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:00:18.478822 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814e10ae-0be7-4fa3-8e68-f7643f76fc1b None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:00:18.479129 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814e10ae-0be7-4fa3-8e68-f7643f76fc1b None None] PATH_INFO: `/` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:00:18.480785 dv-cinder-851351-1-smb devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 520/1008] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 08:00:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 08:00:18.486536 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ed9aad-f538-460b-8f95-fe2224f2a8ad None None] REQUEST_METHOD: `POST` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:00:18.486859 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ed9aad-f538-460b-8f95-fe2224f2a8ad None None] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:00:18.487069 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ed9aad-f538-460b-8f95-fe2224f2a8ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:00:18.505839 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.auth.core [None req-48ed9aad-f538-460b-8f95-fe2224f2a8ad None None] MFA Rules not processed for user `f0666d3a50644a7097367331c1ee1a68`. Rule list: `[]` (Enabled: `True`). {{(pid=80348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 08:00:18.507030 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.fernet_utils [None req-48ed9aad-f538-460b-8f95-fe2224f2a8ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:00:18.584731 dv-cinder-851351-1-smb devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 489/1009] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 08:00:18 2022] POST /identity/v3/auth/tokens => generated 1707 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 08:00:18.606720 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-814e10ae-0be7-4fa3-8e68-f7643f76fc1b None None] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:00:18.706604 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:00:18.719356 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-814e10ae-0be7-4fa3-8e68-f7643f76fc1b None None] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:00:18.754269 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de0ca20-39d1-4dae-8231-1d2ed4620a70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:00:18.754791 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de0ca20-39d1-4dae-8231-1d2ed4620a70 None admin] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:00:18.755059 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de0ca20-39d1-4dae-8231-1d2ed4620a70 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:00:18.755324 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de0ca20-39d1-4dae-8231-1d2ed4620a70 None admin] PATH_INFO: `/v3/services` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:00:18.756027 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9de0ca20-39d1-4dae-8231-1d2ed4620a70 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:00:18.757416 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9de0ca20-39d1-4dae-8231-1d2ed4620a70 None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:00:18.772591 dv-cinder-851351-1-smb devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 521/1010] 10.222.0.42 () {60 vars in 1141 bytes} [Thu Jul 28 08:00:18 2022] POST /identity/v3/services => generated 242 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 08:00:19.974011 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df529157-4d06-4a5e-9019-eb0938a3e74b None None] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:00:19.974568 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df529157-4d06-4a5e-9019-eb0938a3e74b None None] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:00:19.974568 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df529157-4d06-4a5e-9019-eb0938a3e74b None None] PATH_INFO: `/` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:00:19.975884 dv-cinder-851351-1-smb devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 490/1011] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 08:00:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 08:00:19.981669 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f14666-cb60-4bdc-894e-fdd9130288e9 None None] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:00:19.982193 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f14666-cb60-4bdc-894e-fdd9130288e9 None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:00:19.982193 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f14666-cb60-4bdc-894e-fdd9130288e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:00:20.001253 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.auth.core [None req-20f14666-cb60-4bdc-894e-fdd9130288e9 None None] MFA Rules not processed for user `f0666d3a50644a7097367331c1ee1a68`. Rule list: `[]` (Enabled: `True`). {{(pid=80347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 08:00:20.002437 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-20f14666-cb60-4bdc-894e-fdd9130288e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:00:20.078718 dv-cinder-851351-1-smb devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 522/1012] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 08:00:19 2022] POST /identity/v3/auth/tokens => generated 1803 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 08:00:20.100938 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df529157-4d06-4a5e-9019-eb0938a3e74b None None] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:00:20.158684 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:00:20.181011 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a101222-e044-474a-8ff7-7fe11ff596d7 None None] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:00:20.181270 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a101222-e044-474a-8ff7-7fe11ff596d7 None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:00:20.181549 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a101222-e044-474a-8ff7-7fe11ff596d7 None None] PATH_INFO: `/` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:00:20.183040 dv-cinder-851351-1-smb devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 523/1013] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 08:00:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 28 08:00:20.189232 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d644ae5-ffea-48b5-aa6c-6827f307b353 None None] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:00:20.189512 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d644ae5-ffea-48b5-aa6c-6827f307b353 None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:00:20.189789 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d644ae5-ffea-48b5-aa6c-6827f307b353 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:00:20.210915 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.auth.core [None req-4d644ae5-ffea-48b5-aa6c-6827f307b353 None None] MFA Rules not processed for user `f0666d3a50644a7097367331c1ee1a68`. Rule list: `[]` (Enabled: `True`). {{(pid=80347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 08:00:20.212255 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-4d644ae5-ffea-48b5-aa6c-6827f307b353 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:00:20.238043 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df529157-4d06-4a5e-9019-eb0938a3e74b None None] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:00:20.278522 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678750b5-99bb-4fbb-9744-8fe8a1d5b7a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:00:20.279168 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678750b5-99bb-4fbb-9744-8fe8a1d5b7a3 None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:00:20.279443 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678750b5-99bb-4fbb-9744-8fe8a1d5b7a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:00:20.279704 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678750b5-99bb-4fbb-9744-8fe8a1d5b7a3 None admin] PATH_INFO: `/v3/services/compute` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:00:20.280340 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-678750b5-99bb-4fbb-9744-8fe8a1d5b7a3 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:00:20.281760 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-678750b5-99bb-4fbb-9744-8fe8a1d5b7a3 None admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:00:20.290214 dv-cinder-851351-1-smb devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 524/1014] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 08:00:20 2022] POST /identity/v3/auth/tokens => generated 1803 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 28 08:00:20.290979 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application [None req-678750b5-99bb-4fbb-9744-8fe8a1d5b7a3 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jul 28 08:00:20.290979 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:00:20.290979 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 28 08:00:20.290979 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 28 08:00:20.290979 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 28 08:00:20.290979 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 28 08:00:20.290979 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 28 08:00:20.290979 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 08:00:20.290979 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 28 08:00:20.290979 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application Jul 28 08:00:20.290979 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 28 08:00:20.290979 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application Jul 28 08:00:20.290979 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:00:20.290979 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:00:20.290979 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:00:20.290979 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:00:20.290979 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:00:20.292093 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:00:20.292093 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:00:20.292093 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:00:20.292093 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:00:20.292093 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:00:20.292093 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:00:20.292093 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 28 08:00:20.292093 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 28 08:00:20.292093 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 28 08:00:20.292093 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 28 08:00:20.292093 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:00:20.292093 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:00:20.292093 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:00:20.292093 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:00:20.292093 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:00:20.292093 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:00:20.293362 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:00:20.293362 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application with Lock( Jul 28 08:00:20.293362 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:00:20.293362 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:00:20.293362 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:00:20.293362 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:00:20.293362 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:00:20.293362 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:00:20.293362 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:00:20.293362 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:00:20.293362 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 28 08:00:20.293362 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 08:00:20.293362 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 28 08:00:20.293362 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application Jul 28 08:00:20.297368 dv-cinder-851351-1-smb devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 491/1015] 10.222.0.42 () {56 vars in 1111 bytes} [Thu Jul 28 08:00:20 2022] GET /identity/v3/services/compute => generated 88 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:00:20.298167 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d644ae5-ffea-48b5-aa6c-6827f307b353 None None] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:00:20.307008 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:00:20.313783 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678750b5-99bb-4fbb-9744-8fe8a1d5b7a3 None admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:00:20.405271 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d644ae5-ffea-48b5-aa6c-6827f307b353 None None] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:00:20.419677 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678750b5-99bb-4fbb-9744-8fe8a1d5b7a3 None admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:00:20.432529 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=100 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:00:20.442806 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd644d7d-19b6-443c-9438-2a6130099bce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:00:20.443434 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd644d7d-19b6-443c-9438-2a6130099bce None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:00:20.443719 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd644d7d-19b6-443c-9438-2a6130099bce None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:00:20.443973 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd644d7d-19b6-443c-9438-2a6130099bce None admin] PATH_INFO: `/v3/services` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:00:20.444677 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd644d7d-19b6-443c-9438-2a6130099bce None admin] RBAC: Adding query filter params (name=compute) {{(pid=80347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:00:20.444997 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd644d7d-19b6-443c-9438-2a6130099bce None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:00:20.446389 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd644d7d-19b6-443c-9438-2a6130099bce None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:00:20.451397 dv-cinder-851351-1-smb devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 525/1016] 10.222.0.42 () {56 vars in 1112 bytes} [Thu Jul 28 08:00:20 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 08:00:20.456281 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314361d0-b801-411b-8f8b-92c6ce9fe053 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:00:20.457122 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314361d0-b801-411b-8f8b-92c6ce9fe053 None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:00:20.457435 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd644d7d-19b6-443c-9438-2a6130099bce None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:00:20.457735 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314361d0-b801-411b-8f8b-92c6ce9fe053 None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:00:20.458169 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314361d0-b801-411b-8f8b-92c6ce9fe053 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:00:20.459466 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-314361d0-b801-411b-8f8b-92c6ce9fe053 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:00:20.460951 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-314361d0-b801-411b-8f8b-92c6ce9fe053 None admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:00:20.467274 dv-cinder-851351-1-smb devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 492/1017] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 08:00:20 2022] GET /identity/v3/domains/default => generated 199 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 08:00:20.469059 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314361d0-b801-411b-8f8b-92c6ce9fe053 None admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:00:20.531994 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:00:20.566682 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd644d7d-19b6-443c-9438-2a6130099bce None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:00:20.573634 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314361d0-b801-411b-8f8b-92c6ce9fe053 None admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:00:20.603104 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14104d30-df92-4bf9-941c-5b3788600e52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:00:20.603902 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14104d30-df92-4bf9-941c-5b3788600e52 None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:00:20.604154 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14104d30-df92-4bf9-941c-5b3788600e52 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:00:20.604787 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14104d30-df92-4bf9-941c-5b3788600e52 None admin] PATH_INFO: `/v3/services` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:00:20.605466 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14104d30-df92-4bf9-941c-5b3788600e52 None admin] RBAC: Adding query filter params (type=compute) {{(pid=80347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:00:20.605766 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14104d30-df92-4bf9-941c-5b3788600e52 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:00:20.607117 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14104d30-df92-4bf9-941c-5b3788600e52 None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:00:20.616748 dv-cinder-851351-1-smb devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 526/1018] 10.222.0.42 () {56 vars in 1112 bytes} [Thu Jul 28 08:00:20 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:00:20.616918 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc03b0b7-9d21-4dd4-8efe-567b2991ad6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:00:20.616918 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc03b0b7-9d21-4dd4-8efe-567b2991ad6c None admin] REQUEST_METHOD: `POST` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:00:20.616918 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc03b0b7-9d21-4dd4-8efe-567b2991ad6c None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:00:20.616918 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc03b0b7-9d21-4dd4-8efe-567b2991ad6c None admin] PATH_INFO: `/v3/projects` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:00:20.617593 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc03b0b7-9d21-4dd4-8efe-567b2991ad6c None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:00:20.618781 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14104d30-df92-4bf9-941c-5b3788600e52 None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:00:20.619105 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc03b0b7-9d21-4dd4-8efe-567b2991ad6c None admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:00:20.664888 dv-cinder-851351-1-smb devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 493/1019] 10.222.0.42 () {60 vars in 1141 bytes} [Thu Jul 28 08:00:20 2022] POST /identity/v3/projects => generated 311 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 08:00:20.760351 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14104d30-df92-4bf9-941c-5b3788600e52 None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:00:20.799485 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22440015-b15e-4ebe-89b0-77b3bbdd296c None None] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:00:20.799680 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22440015-b15e-4ebe-89b0-77b3bbdd296c None None] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:00:20.799904 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22440015-b15e-4ebe-89b0-77b3bbdd296c None None] PATH_INFO: `/` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:00:20.801526 dv-cinder-851351-1-smb devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 494/1020] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 08:00:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 28 08:00:20.807029 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc929e7-be55-4ff4-b34f-2bb6fdf85fe5 None None] REQUEST_METHOD: `POST` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:00:20.807363 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc929e7-be55-4ff4-b34f-2bb6fdf85fe5 None None] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:00:20.807549 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc929e7-be55-4ff4-b34f-2bb6fdf85fe5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:00:20.825998 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a4359c-8f0a-4639-a43c-47af735b548a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:00:20.826625 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a4359c-8f0a-4639-a43c-47af735b548a None admin] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:00:20.826888 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a4359c-8f0a-4639-a43c-47af735b548a None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:00:20.827152 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a4359c-8f0a-4639-a43c-47af735b548a None admin] PATH_INFO: `/v3/endpoints` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:00:20.827863 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a4359c-8f0a-4639-a43c-47af735b548a None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:00:20.829632 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a4359c-8f0a-4639-a43c-47af735b548a None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:00:20.832913 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.auth.core [None req-1dc929e7-be55-4ff4-b34f-2bb6fdf85fe5 None None] MFA Rules not processed for user `f0666d3a50644a7097367331c1ee1a68`. Rule list: `[]` (Enabled: `True`). {{(pid=80348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 08:00:20.834101 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.fernet_utils [None req-1dc929e7-be55-4ff4-b34f-2bb6fdf85fe5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:00:20.836461 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:00:20.865881 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:00:20.868746 dv-cinder-851351-1-smb devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 527/1021] 10.222.0.42 () {60 vars in 1144 bytes} [Thu Jul 28 08:00:20 2022] POST /identity/v3/endpoints => generated 334 bytes in 248 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 28 08:00:20.920776 dv-cinder-851351-1-smb devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 495/1022] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 08:00:20 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 28 08:00:20.943652 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a4359c-8f0a-4639-a43c-47af735b548a None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:00:21.053690 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a4359c-8f0a-4639-a43c-47af735b548a None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:00:21.090074 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6c2be2-fed4-4834-86ab-b9715bcb6bb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:00:21.090729 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6c2be2-fed4-4834-86ab-b9715bcb6bb5 None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:00:21.090997 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6c2be2-fed4-4834-86ab-b9715bcb6bb5 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:00:21.091264 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6c2be2-fed4-4834-86ab-b9715bcb6bb5 None admin] PATH_INFO: `/v3/services/image` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:00:21.091890 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e6c2be2-fed4-4834-86ab-b9715bcb6bb5 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:00:21.093279 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e6c2be2-fed4-4834-86ab-b9715bcb6bb5 None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:00:21.111001 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application [None req-0e6c2be2-fed4-4834-86ab-b9715bcb6bb5 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jul 28 08:00:21.111001 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:00:21.111001 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 28 08:00:21.111001 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 28 08:00:21.111001 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 28 08:00:21.111001 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 28 08:00:21.111001 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 28 08:00:21.111001 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 08:00:21.111001 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 28 08:00:21.111001 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application Jul 28 08:00:21.111001 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 28 08:00:21.111001 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application Jul 28 08:00:21.111001 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:00:21.111001 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:00:21.111001 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:00:21.111001 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:00:21.111001 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:00:21.112024 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:00:21.112024 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:00:21.112024 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:00:21.112024 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:00:21.112024 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:00:21.112024 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:00:21.112024 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 28 08:00:21.112024 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 28 08:00:21.112024 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 28 08:00:21.112024 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 28 08:00:21.112024 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:00:21.112024 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:00:21.112024 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:00:21.112024 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:00:21.112024 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:00:21.112024 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:00:21.112892 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:00:21.112892 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application with Lock( Jul 28 08:00:21.112892 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:00:21.112892 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:00:21.112892 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:00:21.112892 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:00:21.112892 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:00:21.112892 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:00:21.112892 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:00:21.112892 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:00:21.112892 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 28 08:00:21.112892 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 08:00:21.112892 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 28 08:00:21.112892 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application Jul 28 08:00:21.114369 dv-cinder-851351-1-smb devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 528/1023] 10.222.0.42 () {56 vars in 1105 bytes} [Thu Jul 28 08:00:20 2022] GET /identity/v3/services/image => generated 86 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:00:21.119490 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc929e7-be55-4ff4-b34f-2bb6fdf85fe5 None None] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:00:21.236137 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc929e7-be55-4ff4-b34f-2bb6fdf85fe5 None None] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:00:21.271505 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2678f69b-4635-432b-9cd3-55aa06560bac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:00:21.272137 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2678f69b-4635-432b-9cd3-55aa06560bac None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:00:21.272409 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2678f69b-4635-432b-9cd3-55aa06560bac None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:00:21.272735 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2678f69b-4635-432b-9cd3-55aa06560bac None admin] PATH_INFO: `/v3/services` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:00:21.273370 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2678f69b-4635-432b-9cd3-55aa06560bac None admin] RBAC: Adding query filter params (name=image) {{(pid=80348) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:00:21.273655 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2678f69b-4635-432b-9cd3-55aa06560bac None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:00:21.275088 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2678f69b-4635-432b-9cd3-55aa06560bac None admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:00:21.284736 dv-cinder-851351-1-smb devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 496/1024] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 08:00:21 2022] GET /identity/v3/services?name=image => generated 122 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:00:21.286772 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6c2be2-fed4-4834-86ab-b9715bcb6bb5 None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:00:21.346937 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:00:21.395291 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6c2be2-fed4-4834-86ab-b9715bcb6bb5 None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:00:21.430167 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953d4c1c-87d2-4067-9a9d-497cd082faa0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:00:21.430844 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953d4c1c-87d2-4067-9a9d-497cd082faa0 None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:00:21.431102 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953d4c1c-87d2-4067-9a9d-497cd082faa0 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:00:21.431367 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953d4c1c-87d2-4067-9a9d-497cd082faa0 None admin] PATH_INFO: `/v3/services` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:00:21.432054 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-953d4c1c-87d2-4067-9a9d-497cd082faa0 None admin] RBAC: Adding query filter params (type=image) {{(pid=80347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:00:21.432347 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-953d4c1c-87d2-4067-9a9d-497cd082faa0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:00:21.433744 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-953d4c1c-87d2-4067-9a9d-497cd082faa0 None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:00:21.438893 dv-cinder-851351-1-smb devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 529/1025] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 08:00:21 2022] GET /identity/v3/services?type=image => generated 350 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 08:00:21.444896 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2678f69b-4635-432b-9cd3-55aa06560bac None admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:00:21.472539 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=100 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:00:21.552252 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2678f69b-4635-432b-9cd3-55aa06560bac None admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:00:21.591416 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8df891-0f74-4f3e-b713-0f5bc7aada67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:00:21.592045 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8df891-0f74-4f3e-b713-0f5bc7aada67 None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:00:21.592316 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8df891-0f74-4f3e-b713-0f5bc7aada67 None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:00:21.592582 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8df891-0f74-4f3e-b713-0f5bc7aada67 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:00:21.593381 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf8df891-0f74-4f3e-b713-0f5bc7aada67 None admin] RBAC: Adding query filter params (interface=public, service_id=054770edb2b4421caeb70bb63c06dd04, region_id=RegionOne) {{(pid=80348) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:00:21.593673 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf8df891-0f74-4f3e-b713-0f5bc7aada67 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:00:21.595043 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf8df891-0f74-4f3e-b713-0f5bc7aada67 None admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:00:21.604991 dv-cinder-851351-1-smb devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 497/1026] 10.222.0.42 () {56 vars in 1251 bytes} [Thu Jul 28 08:00:21 2022] GET /identity/v3/endpoints?service_id=054770edb2b4421caeb70bb63c06dd04&interface=public®ion_id=RegionOne => generated 194 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:00:21.606694 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953d4c1c-87d2-4067-9a9d-497cd082faa0 None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:00:21.720381 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953d4c1c-87d2-4067-9a9d-497cd082faa0 None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:00:21.738835 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:00:21.756618 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84784cd3-acd7-4f64-8855-2443ec0f2e10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:00:21.757558 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84784cd3-acd7-4f64-8855-2443ec0f2e10 None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:00:21.758027 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84784cd3-acd7-4f64-8855-2443ec0f2e10 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:00:21.758464 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84784cd3-acd7-4f64-8855-2443ec0f2e10 None admin] PATH_INFO: `/v3/services` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:00:21.759323 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84784cd3-acd7-4f64-8855-2443ec0f2e10 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:00:21.760915 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84784cd3-acd7-4f64-8855-2443ec0f2e10 None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:00:21.768890 dv-cinder-851351-1-smb devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 530/1027] 10.222.0.42 () {56 vars in 1087 bytes} [Thu Jul 28 08:00:21 2022] GET /identity/v3/services => generated 1957 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 08:00:22.772698 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9003d9c-8274-4f84-9ca2-45b7cb6ab3ca None None] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:00:22.773301 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9003d9c-8274-4f84-9ca2-45b7cb6ab3ca None None] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:00:22.773674 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9003d9c-8274-4f84-9ca2-45b7cb6ab3ca None None] PATH_INFO: `/` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:00:22.776210 dv-cinder-851351-1-smb devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 498/1028] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 08:00:22 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 08:00:22.785122 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efefb04-42b5-4fcf-a948-16ccd00f329b None None] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:00:22.785619 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efefb04-42b5-4fcf-a948-16ccd00f329b None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:00:22.786084 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efefb04-42b5-4fcf-a948-16ccd00f329b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:00:22.816944 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.auth.core [None req-5efefb04-42b5-4fcf-a948-16ccd00f329b None None] MFA Rules not processed for user `f0666d3a50644a7097367331c1ee1a68`. Rule list: `[]` (Enabled: `True`). {{(pid=80347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 08:00:22.819080 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-5efefb04-42b5-4fcf-a948-16ccd00f329b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:00:22.914752 dv-cinder-851351-1-smb devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 531/1029] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 08:00:22 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 08:00:22.952498 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9003d9c-8274-4f84-9ca2-45b7cb6ab3ca None None] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:00:23.060604 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=100 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:00:23.080415 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ded4d0-f6e3-4765-b0a0-05992bb0d6e2 None None] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:00:23.080721 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ded4d0-f6e3-4765-b0a0-05992bb0d6e2 None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:00:23.081065 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ded4d0-f6e3-4765-b0a0-05992bb0d6e2 None None] PATH_INFO: `/` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:00:23.082597 dv-cinder-851351-1-smb devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 532/1030] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 08:00:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 28 08:00:23.082738 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9003d9c-8274-4f84-9ca2-45b7cb6ab3ca None None] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:00:23.087700 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c006ed63-7ee2-4312-be12-54215104b656 None None] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:00:23.087999 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c006ed63-7ee2-4312-be12-54215104b656 None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:00:23.088240 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c006ed63-7ee2-4312-be12-54215104b656 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:00:23.106791 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.auth.core [None req-c006ed63-7ee2-4312-be12-54215104b656 None None] MFA Rules not processed for user `f0666d3a50644a7097367331c1ee1a68`. Rule list: `[]` (Enabled: `True`). {{(pid=80347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 08:00:23.107989 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-c006ed63-7ee2-4312-be12-54215104b656 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:00:23.129522 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bdcf3ff-3446-4587-99db-56ffe0801c15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:00:23.130212 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bdcf3ff-3446-4587-99db-56ffe0801c15 None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:00:23.130500 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bdcf3ff-3446-4587-99db-56ffe0801c15 None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:00:23.130792 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bdcf3ff-3446-4587-99db-56ffe0801c15 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:00:23.132160 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bdcf3ff-3446-4587-99db-56ffe0801c15 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:00:23.133657 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bdcf3ff-3446-4587-99db-56ffe0801c15 None admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:00:23.135680 dv-cinder-851351-1-smb devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 499/1031] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 08:00:22 2022] GET /identity/v3/domains/default => generated 199 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:00:23.141083 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bdcf3ff-3446-4587-99db-56ffe0801c15 None admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:00:23.196414 dv-cinder-851351-1-smb devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 533/1032] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 08:00:23 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 28 08:00:23.219454 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c006ed63-7ee2-4312-be12-54215104b656 None None] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:00:23.252639 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bdcf3ff-3446-4587-99db-56ffe0801c15 None admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:00:23.267177 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:00:23.294748 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1567daaf-7820-426c-9290-b72feb4a60cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:00:23.295385 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1567daaf-7820-426c-9290-b72feb4a60cd None admin] REQUEST_METHOD: `POST` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:00:23.295664 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1567daaf-7820-426c-9290-b72feb4a60cd None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:00:23.295933 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1567daaf-7820-426c-9290-b72feb4a60cd None admin] PATH_INFO: `/v3/users` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:00:23.296643 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1567daaf-7820-426c-9290-b72feb4a60cd None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:00:23.298120 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1567daaf-7820-426c-9290-b72feb4a60cd None admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:00:23.322073 dv-cinder-851351-1-smb devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 500/1033] 10.222.0.42 () {60 vars in 1132 bytes} [Thu Jul 28 08:00:23 2022] POST /identity/v3/users => generated 285 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 28 08:00:23.333998 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c006ed63-7ee2-4312-be12-54215104b656 None None] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:00:23.385386 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffcb207b-36df-45af-8fd0-28693c54fbd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:00:23.386074 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffcb207b-36df-45af-8fd0-28693c54fbd2 None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:00:23.386375 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffcb207b-36df-45af-8fd0-28693c54fbd2 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:00:23.386647 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffcb207b-36df-45af-8fd0-28693c54fbd2 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:00:23.399956 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffcb207b-36df-45af-8fd0-28693c54fbd2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 08:00:23.405123 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application [None req-ffcb207b-36df-45af-8fd0-28693c54fbd2 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 28 08:00:23.405123 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:00:23.405123 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:00:23.405123 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:00:23.405123 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:00:23.405123 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:00:23.405123 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:00:23.405123 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:00:23.405123 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:00:23.405123 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:00:23.405123 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:00:23.405123 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:00:23.405123 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 08:00:23.405123 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 08:00:23.405123 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 08:00:23.405123 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 08:00:23.406143 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 08:00:23.406143 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 08:00:23.406143 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 08:00:23.406143 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 08:00:23.406143 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:00:23.406143 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:00:23.406143 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:00:23.406143 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:00:23.406143 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:00:23.406143 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:00:23.406143 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:00:23.406143 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application with Lock( Jul 28 08:00:23.406143 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:00:23.406143 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:00:23.406143 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:00:23.406143 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:00:23.406981 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:00:23.406981 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:00:23.406981 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:00:23.406981 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:00:23.406981 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 08:00:23.406981 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 08:00:23.406981 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 08:00:23.406981 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 08:00:23.406981 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 08:00:23.406981 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 08:00:23.406981 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 28 08:00:23.406981 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application Jul 28 08:00:23.408251 dv-cinder-851351-1-smb devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 534/1034] 10.222.0.42 () {56 vars in 1120 bytes} [Thu Jul 28 08:00:23 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 08:00:23.412810 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1567daaf-7820-426c-9290-b72feb4a60cd None admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:00:23.427750 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:00:23.534978 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1567daaf-7820-426c-9290-b72feb4a60cd None admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:00:23.573169 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf00599-8d30-4878-8e12-75dcb9b4bf5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:00:23.573982 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf00599-8d30-4878-8e12-75dcb9b4bf5f None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:00:23.574078 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf00599-8d30-4878-8e12-75dcb9b4bf5f None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:00:23.574540 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf00599-8d30-4878-8e12-75dcb9b4bf5f None admin] PATH_INFO: `/v3/roles` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:00:23.576068 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbf00599-8d30-4878-8e12-75dcb9b4bf5f None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80348) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:00:23.576190 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbf00599-8d30-4878-8e12-75dcb9b4bf5f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:00:23.578957 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbf00599-8d30-4878-8e12-75dcb9b4bf5f None admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:00:23.589270 dv-cinder-851351-1-smb devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 501/1035] 10.222.0.42 () {56 vars in 1115 bytes} [Thu Jul 28 08:00:23 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 08:00:23.598179 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffcb207b-36df-45af-8fd0-28693c54fbd2 None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:00:23.728064 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffcb207b-36df-45af-8fd0-28693c54fbd2 None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:00:23.729965 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:00:23.766619 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c11bb1-9abd-4b2f-8b6d-b1675deaf7da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:00:23.767270 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c11bb1-9abd-4b2f-8b6d-b1675deaf7da None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:00:23.767546 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c11bb1-9abd-4b2f-8b6d-b1675deaf7da None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:00:23.767815 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c11bb1-9abd-4b2f-8b6d-b1675deaf7da None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:00:23.779402 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c11bb1-9abd-4b2f-8b6d-b1675deaf7da None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:00:23.780884 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c11bb1-9abd-4b2f-8b6d-b1675deaf7da None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:00:23.792040 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2282c0a2-85da-4632-960d-85574c024043 None None] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:00:23.792547 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2282c0a2-85da-4632-960d-85574c024043 None None] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:00:23.792547 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2282c0a2-85da-4632-960d-85574c024043 None None] PATH_INFO: `/` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:00:23.794311 dv-cinder-851351-1-smb devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 502/1036] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 08:00:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 08:00:23.796368 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application [None req-a9c11bb1-9abd-4b2f-8b6d-b1675deaf7da None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 08:00:23.796368 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:00:23.796368 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:00:23.796368 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:00:23.796368 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:00:23.796368 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:00:23.796368 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:00:23.796368 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:00:23.796368 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:00:23.796368 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:00:23.796368 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:00:23.796368 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:00:23.796368 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 08:00:23.796368 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 08:00:23.796368 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 08:00:23.797515 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 08:00:23.797515 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:00:23.797515 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:00:23.797515 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:00:23.797515 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:00:23.797515 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:00:23.797515 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:00:23.797515 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:00:23.797515 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application with Lock( Jul 28 08:00:23.797515 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:00:23.797515 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:00:23.797515 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:00:23.797515 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:00:23.797515 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:00:23.797515 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:00:23.797515 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:00:23.797515 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:00:23.799004 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 08:00:23.799004 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 08:00:23.799004 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 08:00:23.799004 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application Jul 28 08:00:23.799004 dv-cinder-851351-1-smb devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 535/1037] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 08:00:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 08:00:23.802544 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61716d2-26ec-40d2-ba15-6aba24194b3b None None] REQUEST_METHOD: `POST` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:00:23.802830 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61716d2-26ec-40d2-ba15-6aba24194b3b None None] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:00:23.803111 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61716d2-26ec-40d2-ba15-6aba24194b3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:00:23.805667 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c11bb1-9abd-4b2f-8b6d-b1675deaf7da None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:00:23.821583 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.auth.core [None req-e61716d2-26ec-40d2-ba15-6aba24194b3b None None] MFA Rules not processed for user `f0666d3a50644a7097367331c1ee1a68`. Rule list: `[]` (Enabled: `True`). {{(pid=80348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 08:00:23.822790 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.fernet_utils [None req-e61716d2-26ec-40d2-ba15-6aba24194b3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:00:23.897346 dv-cinder-851351-1-smb devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 503/1038] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 08:00:23 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 28 08:00:23.919161 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c11bb1-9abd-4b2f-8b6d-b1675deaf7da None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:00:23.919618 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e61716d2-26ec-40d2-ba15-6aba24194b3b None None] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:00:23.921846 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=100 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:00:23.956151 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d204a45a-5eac-49da-9017-c9e2f8f2776a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:00:23.956808 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d204a45a-5eac-49da-9017-c9e2f8f2776a None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:00:23.957084 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d204a45a-5eac-49da-9017-c9e2f8f2776a None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:00:23.957352 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d204a45a-5eac-49da-9017-c9e2f8f2776a None admin] PATH_INFO: `/v3/domains` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:00:23.958053 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d204a45a-5eac-49da-9017-c9e2f8f2776a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:00:23.958351 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d204a45a-5eac-49da-9017-c9e2f8f2776a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:00:23.959713 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d204a45a-5eac-49da-9017-c9e2f8f2776a None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:00:23.972687 dv-cinder-851351-1-smb devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 536/1039] 10.222.0.42 () {56 vars in 1109 bytes} [Thu Jul 28 08:00:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:00:23.978364 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d204a45a-5eac-49da-9017-c9e2f8f2776a None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:00:23.995590 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:00:24.044534 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e61716d2-26ec-40d2-ba15-6aba24194b3b None None] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:00:24.079905 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456aa2a6-9563-4a86-9d60-2883422b2312 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:00:24.080555 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456aa2a6-9563-4a86-9d60-2883422b2312 None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:00:24.080857 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456aa2a6-9563-4a86-9d60-2883422b2312 None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:00:24.081127 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456aa2a6-9563-4a86-9d60-2883422b2312 None admin] PATH_INFO: `/v3/services/image` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:00:24.081757 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-456aa2a6-9563-4a86-9d60-2883422b2312 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:00:24.083141 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-456aa2a6-9563-4a86-9d60-2883422b2312 None admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:00:24.091521 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d204a45a-5eac-49da-9017-c9e2f8f2776a None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:00:24.092310 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application [None req-456aa2a6-9563-4a86-9d60-2883422b2312 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jul 28 08:00:24.092310 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:00:24.092310 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 28 08:00:24.092310 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 28 08:00:24.092310 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 28 08:00:24.092310 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 28 08:00:24.092310 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 28 08:00:24.092310 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 08:00:24.092310 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 28 08:00:24.092310 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application Jul 28 08:00:24.092310 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 28 08:00:24.092310 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application Jul 28 08:00:24.092310 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:00:24.092310 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:00:24.092310 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:00:24.092310 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:00:24.092310 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:00:24.096977 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:00:24.096977 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:00:24.096977 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:00:24.096977 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:00:24.096977 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:00:24.096977 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:00:24.096977 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 28 08:00:24.096977 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 28 08:00:24.096977 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 28 08:00:24.096977 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 28 08:00:24.096977 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:00:24.096977 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:00:24.096977 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:00:24.096977 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:00:24.096977 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:00:24.096977 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:00:24.098122 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:00:24.098122 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application with Lock( Jul 28 08:00:24.098122 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:00:24.098122 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:00:24.098122 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:00:24.098122 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:00:24.098122 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:00:24.098122 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:00:24.098122 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:00:24.098122 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:00:24.098122 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 28 08:00:24.098122 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 08:00:24.098122 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 28 08:00:24.098122 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application Jul 28 08:00:24.098122 dv-cinder-851351-1-smb devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 504/1040] 10.222.0.42 () {56 vars in 1105 bytes} [Thu Jul 28 08:00:23 2022] GET /identity/v3/services/image => generated 86 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 08:00:24.100260 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456aa2a6-9563-4a86-9d60-2883422b2312 None admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:00:24.131644 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c23798b2-5c19-4f6f-9cfb-d2d3c38b25d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:00:24.132528 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23798b2-5c19-4f6f-9cfb-d2d3c38b25d3 None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:00:24.132528 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23798b2-5c19-4f6f-9cfb-d2d3c38b25d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:00:24.132867 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23798b2-5c19-4f6f-9cfb-d2d3c38b25d3 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:00:24.140339 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c23798b2-5c19-4f6f-9cfb-d2d3c38b25d3 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:00:24.141811 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c23798b2-5c19-4f6f-9cfb-d2d3c38b25d3 None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:00:24.155206 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application [None req-c23798b2-5c19-4f6f-9cfb-d2d3c38b25d3 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 28 08:00:24.155206 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:00:24.155206 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:00:24.155206 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:00:24.155206 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:00:24.155206 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:00:24.155206 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:00:24.155206 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:00:24.155206 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:00:24.155206 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:00:24.155206 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:00:24.155206 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:00:24.155206 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 28 08:00:24.155206 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 28 08:00:24.155206 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 28 08:00:24.155206 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 28 08:00:24.156198 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:00:24.156198 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:00:24.156198 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 28 08:00:24.156198 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 08:00:24.156198 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 28 08:00:24.156198 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 08:00:24.156198 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:00:24.156198 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:00:24.156198 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:00:24.156198 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:00:24.156198 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:00:24.156198 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application with Lock( Jul 28 08:00:24.156198 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:00:24.156198 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:00:24.156198 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:00:24.156198 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:00:24.156198 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:00:24.156198 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:00:24.157618 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:00:24.157618 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:00:24.157618 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 28 08:00:24.157618 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 28 08:00:24.157618 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 28 08:00:24.157618 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 28 08:00:24.157618 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 28 08:00:24.157618 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 28 08:00:24.157618 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 28 08:00:24.157618 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application Jul 28 08:00:24.157618 dv-cinder-851351-1-smb devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 537/1041] 10.222.0.42 () {56 vars in 1093 bytes} [Thu Jul 28 08:00:23 2022] GET /identity/v3/users/nova => generated 82 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:00:24.162138 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c23798b2-5c19-4f6f-9cfb-d2d3c38b25d3 None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:00:24.175080 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=100 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:00:24.213707 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456aa2a6-9563-4a86-9d60-2883422b2312 None admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:00:24.246778 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:00:24.250007 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b144f88e-4902-484e-b7c3-f2088fac0e97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:00:24.250637 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b144f88e-4902-484e-b7c3-f2088fac0e97 None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:00:24.250914 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b144f88e-4902-484e-b7c3-f2088fac0e97 None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:00:24.251183 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b144f88e-4902-484e-b7c3-f2088fac0e97 None admin] PATH_INFO: `/v3/services` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:00:24.251865 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b144f88e-4902-484e-b7c3-f2088fac0e97 None admin] RBAC: Adding query filter params (name=image) {{(pid=80348) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:00:24.252172 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b144f88e-4902-484e-b7c3-f2088fac0e97 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:00:24.253586 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b144f88e-4902-484e-b7c3-f2088fac0e97 None admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:00:24.259266 dv-cinder-851351-1-smb devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 505/1042] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 08:00:24 2022] GET /identity/v3/services?name=image => generated 122 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:00:24.264918 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b144f88e-4902-484e-b7c3-f2088fac0e97 None admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:00:24.278972 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c23798b2-5c19-4f6f-9cfb-d2d3c38b25d3 None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:00:24.315568 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee049f7-7f3d-4107-b7b2-3a10a8383d6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:00:24.316197 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee049f7-7f3d-4107-b7b2-3a10a8383d6c None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:00:24.316509 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee049f7-7f3d-4107-b7b2-3a10a8383d6c None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:00:24.316759 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee049f7-7f3d-4107-b7b2-3a10a8383d6c None admin] PATH_INFO: `/v3/users` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:00:24.317548 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ee049f7-7f3d-4107-b7b2-3a10a8383d6c None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:00:24.317852 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ee049f7-7f3d-4107-b7b2-3a10a8383d6c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:00:24.319271 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ee049f7-7f3d-4107-b7b2-3a10a8383d6c None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:00:24.339663 dv-cinder-851351-1-smb devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 538/1043] 10.222.0.42 () {56 vars in 1133 bytes} [Thu Jul 28 08:00:24 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 08:00:24.345464 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee049f7-7f3d-4107-b7b2-3a10a8383d6c None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:00:24.374517 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b144f88e-4902-484e-b7c3-f2088fac0e97 None admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:00:24.405740 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=100 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:00:24.413480 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c8c3c71-0904-4538-86ac-0f8dadef8d12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:00:24.414111 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8c3c71-0904-4538-86ac-0f8dadef8d12 None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:00:24.414441 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8c3c71-0904-4538-86ac-0f8dadef8d12 None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:00:24.414712 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8c3c71-0904-4538-86ac-0f8dadef8d12 None admin] PATH_INFO: `/v3/services` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:00:24.415484 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c8c3c71-0904-4538-86ac-0f8dadef8d12 None admin] RBAC: Adding query filter params (type=image) {{(pid=80348) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:00:24.415780 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c8c3c71-0904-4538-86ac-0f8dadef8d12 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:00:24.417171 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c8c3c71-0904-4538-86ac-0f8dadef8d12 None admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:00:24.427835 dv-cinder-851351-1-smb devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 506/1044] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 08:00:24 2022] GET /identity/v3/services?type=image => generated 350 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 08:00:24.429025 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c8c3c71-0904-4538-86ac-0f8dadef8d12 None admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:00:24.453839 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee049f7-7f3d-4107-b7b2-3a10a8383d6c None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:00:24.485373 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:00:24.491522 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78673a7-4593-45c9-81b8-a51aa342596c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:00:24.492159 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78673a7-4593-45c9-81b8-a51aa342596c None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:00:24.492436 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78673a7-4593-45c9-81b8-a51aa342596c None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:00:24.492730 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78673a7-4593-45c9-81b8-a51aa342596c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:00:24.537846 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c8c3c71-0904-4538-86ac-0f8dadef8d12 None admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:00:24.565615 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e78673a7-4593-45c9-81b8-a51aa342596c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:00:24.567072 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e78673a7-4593-45c9-81b8-a51aa342596c None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:00:24.574060 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a354f085-3270-4601-8826-1871b0cdf4f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:00:24.574676 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a354f085-3270-4601-8826-1871b0cdf4f2 None admin] REQUEST_METHOD: `POST` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:00:24.575368 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a354f085-3270-4601-8826-1871b0cdf4f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:00:24.575695 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a354f085-3270-4601-8826-1871b0cdf4f2 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:00:24.576432 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a354f085-3270-4601-8826-1871b0cdf4f2 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:00:24.578880 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a354f085-3270-4601-8826-1871b0cdf4f2 None admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:00:24.601404 dv-cinder-851351-1-smb devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 507/1045] 10.222.0.42 () {60 vars in 1144 bytes} [Thu Jul 28 08:00:24 2022] POST /identity/v3/endpoints => generated 327 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 28 08:00:24.680820 dv-cinder-851351-1-smb devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 539/1046] 10.222.0.42 () {58 vars in 1282 bytes} [Thu Jul 28 08:00:24 2022] GET /identity/v3/auth/tokens => generated 1959 bytes in 336 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jul 28 08:00:24.686588 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a354f085-3270-4601-8826-1871b0cdf4f2 None admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:00:24.745595 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:00:24.810799 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a354f085-3270-4601-8826-1871b0cdf4f2 None admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:00:24.846335 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d782d880-e334-4690-b603-bf37ea4b0dfc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:00:24.846993 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d782d880-e334-4690-b603-bf37ea4b0dfc None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:00:24.847275 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d782d880-e334-4690-b603-bf37ea4b0dfc None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:00:24.847548 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d782d880-e334-4690-b603-bf37ea4b0dfc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:00:24.859500 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d782d880-e334-4690-b603-bf37ea4b0dfc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:00:24.861213 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d782d880-e334-4690-b603-bf37ea4b0dfc None admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:00:24.878748 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application [None req-d782d880-e334-4690-b603-bf37ea4b0dfc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 08:00:24.878748 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:00:24.878748 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:00:24.878748 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:00:24.878748 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:00:24.878748 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:00:24.878748 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:00:24.878748 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:00:24.878748 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:00:24.878748 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:00:24.878748 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:00:24.878748 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:00:24.878748 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 08:00:24.878748 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 08:00:24.878748 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 08:00:24.879706 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 08:00:24.879706 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:00:24.879706 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:00:24.879706 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:00:24.879706 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:00:24.879706 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:00:24.879706 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:00:24.879706 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:00:24.879706 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application with Lock( Jul 28 08:00:24.879706 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:00:24.879706 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:00:24.879706 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:00:24.879706 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:00:24.879706 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:00:24.879706 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:00:24.879706 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:00:24.879706 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:00:24.880596 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 08:00:24.880596 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 08:00:24.880596 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 08:00:24.880596 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application Jul 28 08:00:24.880857 dv-cinder-851351-1-smb devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 508/1047] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 08:00:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:00:24.886486 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78673a7-4593-45c9-81b8-a51aa342596c None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:00:24.918852 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:00:24.991160 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78673a7-4593-45c9-81b8-a51aa342596c None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:00:25.025760 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3a7f65-2ecc-4447-9b17-8204fa446928 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:00:25.026389 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3a7f65-2ecc-4447-9b17-8204fa446928 None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:00:25.026667 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3a7f65-2ecc-4447-9b17-8204fa446928 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:00:25.026939 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3a7f65-2ecc-4447-9b17-8204fa446928 None admin] PATH_INFO: `/v3/domains` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:00:25.027633 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a3a7f65-2ecc-4447-9b17-8204fa446928 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:00:25.027935 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a3a7f65-2ecc-4447-9b17-8204fa446928 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:00:25.029339 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a3a7f65-2ecc-4447-9b17-8204fa446928 None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:00:25.041440 dv-cinder-851351-1-smb devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 540/1048] 10.222.0.42 () {56 vars in 1109 bytes} [Thu Jul 28 08:00:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:00:25.046963 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d782d880-e334-4690-b603-bf37ea4b0dfc None admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:00:25.149260 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=100 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:00:25.159360 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d782d880-e334-4690-b603-bf37ea4b0dfc None admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:00:25.195603 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf0714d-0a97-4a29-9c8d-af1cca667d08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:00:25.196790 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf0714d-0a97-4a29-9c8d-af1cca667d08 None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:00:25.197288 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf0714d-0a97-4a29-9c8d-af1cca667d08 None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:00:25.197737 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf0714d-0a97-4a29-9c8d-af1cca667d08 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:00:25.205324 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caf0714d-0a97-4a29-9c8d-af1cca667d08 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:00:25.207014 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caf0714d-0a97-4a29-9c8d-af1cca667d08 None admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:00:25.218653 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application [None req-caf0714d-0a97-4a29-9c8d-af1cca667d08 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 08:00:25.218653 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:00:25.218653 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:00:25.218653 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:00:25.218653 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:00:25.218653 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:00:25.218653 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:00:25.218653 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:00:25.218653 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:00:25.218653 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:00:25.218653 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:00:25.218653 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:00:25.218653 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 28 08:00:25.218653 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 28 08:00:25.218653 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 28 08:00:25.219627 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 28 08:00:25.219627 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:00:25.219627 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:00:25.219627 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:00:25.219627 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:00:25.219627 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:00:25.219627 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:00:25.219627 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:00:25.219627 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application with Lock( Jul 28 08:00:25.219627 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:00:25.219627 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:00:25.219627 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:00:25.219627 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:00:25.219627 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:00:25.219627 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:00:25.219627 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:00:25.219627 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:00:25.225513 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 28 08:00:25.225513 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 28 08:00:25.225513 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 28 08:00:25.225513 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 28 08:00:25.225513 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 28 08:00:25.225513 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 28 08:00:25.225513 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 08:00:25.225513 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application Jul 28 08:00:25.225513 dv-cinder-851351-1-smb devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 509/1049] 10.222.0.42 () {56 vars in 1111 bytes} [Thu Jul 28 08:00:25 2022] GET /identity/v3/projects/service => generated 88 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:00:25.227191 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3a7f65-2ecc-4447-9b17-8204fa446928 None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:00:25.325090 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:00:25.335962 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3a7f65-2ecc-4447-9b17-8204fa446928 None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:00:25.370367 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec11110-d0e0-4095-9ab4-93f4abd86ce8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:00:25.371035 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec11110-d0e0-4095-9ab4-93f4abd86ce8 None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:00:25.371319 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec11110-d0e0-4095-9ab4-93f4abd86ce8 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:00:25.371591 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec11110-d0e0-4095-9ab4-93f4abd86ce8 None admin] PATH_INFO: `/v3/projects` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:00:25.372346 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ec11110-d0e0-4095-9ab4-93f4abd86ce8 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:00:25.372651 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ec11110-d0e0-4095-9ab4-93f4abd86ce8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:00:25.374108 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ec11110-d0e0-4095-9ab4-93f4abd86ce8 None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:00:25.389023 dv-cinder-851351-1-smb devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 541/1050] 10.222.0.42 () {56 vars in 1148 bytes} [Thu Jul 28 08:00:25 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:00:25.394957 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf0714d-0a97-4a29-9c8d-af1cca667d08 None admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:00:25.417269 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab06a6c-add5-4eeb-9cf1-7c19fa916c2a None None] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:00:25.417593 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab06a6c-add5-4eeb-9cf1-7c19fa916c2a None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:00:25.417913 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab06a6c-add5-4eeb-9cf1-7c19fa916c2a None None] PATH_INFO: `/` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:00:25.419281 dv-cinder-851351-1-smb devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 542/1051] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 08:00:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 08:00:25.424515 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32cdd9c2-0c21-4663-b4b2-5b7f394b3066 None None] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:00:25.424815 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32cdd9c2-0c21-4663-b4b2-5b7f394b3066 None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:00:25.425102 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32cdd9c2-0c21-4663-b4b2-5b7f394b3066 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:00:25.444146 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.auth.core [None req-32cdd9c2-0c21-4663-b4b2-5b7f394b3066 None None] MFA Rules not processed for user `f0666d3a50644a7097367331c1ee1a68`. Rule list: `[]` (Enabled: `True`). {{(pid=80347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 08:00:25.445388 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-32cdd9c2-0c21-4663-b4b2-5b7f394b3066 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:00:25.501000 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf0714d-0a97-4a29-9c8d-af1cca667d08 None admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:00:25.518178 dv-cinder-851351-1-smb devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 543/1052] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 08:00:25 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 08:00:25.535740 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f6774f-e83e-4d33-ba6d-0a7dacdaece8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:00:25.536360 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f6774f-e83e-4d33-ba6d-0a7dacdaece8 None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:00:25.536639 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f6774f-e83e-4d33-ba6d-0a7dacdaece8 None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:00:25.536931 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f6774f-e83e-4d33-ba6d-0a7dacdaece8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:00:25.537723 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53f6774f-e83e-4d33-ba6d-0a7dacdaece8 None admin] RBAC: Adding query filter params (role.id=a2ca675df8464a35b15d0c6795636b90, scope.project.id=139349507026497c98f360774dee737e, user.id=02f10880691d4fd180f96f3e40e1d25f) {{(pid=80348) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:00:25.538028 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53f6774f-e83e-4d33-ba6d-0a7dacdaece8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:00:25.539463 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53f6774f-e83e-4d33-ba6d-0a7dacdaece8 None admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:00:25.541662 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32cdd9c2-0c21-4663-b4b2-5b7f394b3066 None None] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:00:25.546568 dv-cinder-851351-1-smb devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 510/1053] 10.222.0.42 () {56 vars in 1374 bytes} [Thu Jul 28 08:00:25 2022] GET /identity/v3/role_assignments?user.id=02f10880691d4fd180f96f3e40e1d25f&scope.project.id=139349507026497c98f360774dee737e&role.id=a2ca675df8464a35b15d0c6795636b90 => generated 259 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:00:25.638047 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:00:25.659429 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32cdd9c2-0c21-4663-b4b2-5b7f394b3066 None None] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:00:25.698382 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425c9cd9-a8fe-4094-af8f-da304ceff856 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:00:25.699060 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425c9cd9-a8fe-4094-af8f-da304ceff856 None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:00:25.699317 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425c9cd9-a8fe-4094-af8f-da304ceff856 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:00:25.699578 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425c9cd9-a8fe-4094-af8f-da304ceff856 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:00:25.711450 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-425c9cd9-a8fe-4094-af8f-da304ceff856 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 08:00:25.716604 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application [None req-425c9cd9-a8fe-4094-af8f-da304ceff856 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 08:00:25.716604 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:00:25.716604 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:00:25.716604 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:00:25.716604 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:00:25.716604 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:00:25.716604 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:00:25.716604 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:00:25.716604 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:00:25.716604 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:00:25.716604 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:00:25.716604 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:00:25.716604 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 08:00:25.716604 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 08:00:25.716604 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 08:00:25.716604 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 08:00:25.717585 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 08:00:25.717585 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 08:00:25.717585 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 08:00:25.717585 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 08:00:25.717585 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:00:25.717585 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:00:25.717585 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:00:25.717585 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:00:25.717585 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:00:25.717585 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:00:25.717585 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:00:25.717585 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application with Lock( Jul 28 08:00:25.717585 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:00:25.717585 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:00:25.717585 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:00:25.717585 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:00:25.718470 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:00:25.718470 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:00:25.718470 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:00:25.718470 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:00:25.718470 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 08:00:25.718470 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 08:00:25.718470 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 08:00:25.718470 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 08:00:25.718470 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 08:00:25.718470 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 08:00:25.718470 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 08:00:25.718470 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application Jul 28 08:00:25.718470 dv-cinder-851351-1-smb devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 544/1054] 10.222.0.42 () {56 vars in 1096 bytes} [Thu Jul 28 08:00:25 2022] GET /identity/v3/roles/admin => generated 83 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 08:00:25.724496 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f6774f-e83e-4d33-ba6d-0a7dacdaece8 None admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:00:25.754786 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=100 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:00:25.834110 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f6774f-e83e-4d33-ba6d-0a7dacdaece8 None admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:00:25.868450 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c174881-a6fd-4d4b-8fac-44d7e0287460 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:00:25.869176 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c174881-a6fd-4d4b-8fac-44d7e0287460 None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:00:25.869447 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c174881-a6fd-4d4b-8fac-44d7e0287460 None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:00:25.869708 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c174881-a6fd-4d4b-8fac-44d7e0287460 None admin] PATH_INFO: `/v3/roles` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:00:25.870424 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c174881-a6fd-4d4b-8fac-44d7e0287460 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80348) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:00:25.870765 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c174881-a6fd-4d4b-8fac-44d7e0287460 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:00:25.872127 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c174881-a6fd-4d4b-8fac-44d7e0287460 None admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:00:25.885746 dv-cinder-851351-1-smb devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 511/1055] 10.222.0.42 () {56 vars in 1099 bytes} [Thu Jul 28 08:00:25 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:00:25.887430 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425c9cd9-a8fe-4094-af8f-da304ceff856 None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:00:25.990937 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425c9cd9-a8fe-4094-af8f-da304ceff856 None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:00:26.029741 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae0b34d1-6f37-4aaa-933d-6e49312725c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:00:26.030391 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0b34d1-6f37-4aaa-933d-6e49312725c7 None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:00:26.030673 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0b34d1-6f37-4aaa-933d-6e49312725c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:00:26.030941 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0b34d1-6f37-4aaa-933d-6e49312725c7 None admin] PATH_INFO: `/v3/users/d86ac1c1646d4dce80fa5926bfda5927` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:00:26.043923 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:00:26.048510 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae0b34d1-6f37-4aaa-933d-6e49312725c7 None admin] RBAC: Authorizing `identity:get_user(user_id=d86ac1c1646d4dce80fa5926bfda5927)` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:00:26.050651 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae0b34d1-6f37-4aaa-933d-6e49312725c7 None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:00:26.057509 dv-cinder-851351-1-smb devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 545/1056] 10.222.0.42 () {56 vars in 1177 bytes} [Thu Jul 28 08:00:25 2022] GET /identity/v3/users/d86ac1c1646d4dce80fa5926bfda5927 => generated 285 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 08:00:26.059335 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c174881-a6fd-4d4b-8fac-44d7e0287460 None admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:00:26.154806 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=100 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:00:26.170747 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c174881-a6fd-4d4b-8fac-44d7e0287460 None admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:00:26.207306 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed696f3-c6b6-4481-9a26-84023db291fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:00:26.207942 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed696f3-c6b6-4481-9a26-84023db291fb None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:00:26.208221 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed696f3-c6b6-4481-9a26-84023db291fb None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:00:26.208495 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed696f3-c6b6-4481-9a26-84023db291fb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:00:26.280230 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bed696f3-c6b6-4481-9a26-84023db291fb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:00:26.282175 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bed696f3-c6b6-4481-9a26-84023db291fb None admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:00:26.368985 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=100 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:00:26.392930 dv-cinder-851351-1-smb devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 512/1057] 10.222.0.42 () {58 vars in 1282 bytes} [Thu Jul 28 08:00:26 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 28 08:00:26.394608 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae0b34d1-6f37-4aaa-933d-6e49312725c7 None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:00:26.506037 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae0b34d1-6f37-4aaa-933d-6e49312725c7 None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:00:26.543250 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-338f1f57-b7c2-47f9-b1ce-b2491baea44f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:00:26.543836 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338f1f57-b7c2-47f9-b1ce-b2491baea44f None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:00:26.544124 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338f1f57-b7c2-47f9-b1ce-b2491baea44f None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:00:26.544391 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338f1f57-b7c2-47f9-b1ce-b2491baea44f None admin] PATH_INFO: `/v3/projects/ddc4c89a5c5a4bfd80cc08fe59adeeec` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:00:26.545590 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-338f1f57-b7c2-47f9-b1ce-b2491baea44f None admin] RBAC: Authorizing `identity:get_project(project_id=ddc4c89a5c5a4bfd80cc08fe59adeeec)` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:00:26.547022 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-338f1f57-b7c2-47f9-b1ce-b2491baea44f None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:00:26.552706 dv-cinder-851351-1-smb devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 546/1058] 10.222.0.42 () {56 vars in 1186 bytes} [Thu Jul 28 08:00:26 2022] GET /identity/v3/projects/ddc4c89a5c5a4bfd80cc08fe59adeeec => generated 311 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:00:26.554925 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed696f3-c6b6-4481-9a26-84023db291fb None admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:00:26.621134 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef06a3f3-e98c-4bef-8cca-acd6c2443f19 None None] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:00:26.621409 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef06a3f3-e98c-4bef-8cca-acd6c2443f19 None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:00:26.621674 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef06a3f3-e98c-4bef-8cca-acd6c2443f19 None None] PATH_INFO: `/` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:00:26.623026 dv-cinder-851351-1-smb devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 547/1059] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 08:00:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 28 08:00:26.630021 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620b4abf-3e4a-49cc-b2da-45f4cf8d23e2 None None] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:00:26.630301 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620b4abf-3e4a-49cc-b2da-45f4cf8d23e2 None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:00:26.630593 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620b4abf-3e4a-49cc-b2da-45f4cf8d23e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:00:26.660839 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.auth.core [None req-620b4abf-3e4a-49cc-b2da-45f4cf8d23e2 None None] MFA Rules not processed for user `f0666d3a50644a7097367331c1ee1a68`. Rule list: `[]` (Enabled: `True`). {{(pid=80347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 08:00:26.662308 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-620b4abf-3e4a-49cc-b2da-45f4cf8d23e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:00:26.673385 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed696f3-c6b6-4481-9a26-84023db291fb None admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:00:26.709129 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592013aa-ad38-4301-8876-6fb0377a0565 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:00:26.709761 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592013aa-ad38-4301-8876-6fb0377a0565 None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:00:26.710031 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592013aa-ad38-4301-8876-6fb0377a0565 None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:00:26.710304 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592013aa-ad38-4301-8876-6fb0377a0565 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:00:26.711195 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-592013aa-ad38-4301-8876-6fb0377a0565 None admin] RBAC: Adding query filter params (role.id=362bd71ac01249fb8fa635381993eec1, scope.project.id=ddc4c89a5c5a4bfd80cc08fe59adeeec, user.id=d86ac1c1646d4dce80fa5926bfda5927) {{(pid=80348) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:00:26.711597 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-592013aa-ad38-4301-8876-6fb0377a0565 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:00:26.713247 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-592013aa-ad38-4301-8876-6fb0377a0565 None admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:00:26.727576 dv-cinder-851351-1-smb devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 513/1060] 10.222.0.42 () {56 vars in 1374 bytes} [Thu Jul 28 08:00:26 2022] GET /identity/v3/role_assignments?user.id=d86ac1c1646d4dce80fa5926bfda5927&scope.project.id=ddc4c89a5c5a4bfd80cc08fe59adeeec&role.id=362bd71ac01249fb8fa635381993eec1 => generated 259 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:00:26.745877 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:00:26.756683 dv-cinder-851351-1-smb devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 548/1061] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 08:00:26 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 08:00:26.775704 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592013aa-ad38-4301-8876-6fb0377a0565 None admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:00:26.829015 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=100 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:00:26.884864 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592013aa-ad38-4301-8876-6fb0377a0565 None admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:00:26.919364 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0be0c8b-acc6-4ed4-9d2b-9d3cd96ec203 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:00:26.919994 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0be0c8b-acc6-4ed4-9d2b-9d3cd96ec203 None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:00:26.920270 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0be0c8b-acc6-4ed4-9d2b-9d3cd96ec203 None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:00:26.920539 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0be0c8b-acc6-4ed4-9d2b-9d3cd96ec203 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:00:26.989446 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0be0c8b-acc6-4ed4-9d2b-9d3cd96ec203 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:00:26.990916 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0be0c8b-acc6-4ed4-9d2b-9d3cd96ec203 None admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:00:27.041121 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=100 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:00:27.096797 dv-cinder-851351-1-smb devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 514/1062] 10.222.0.42 () {58 vars in 1282 bytes} [Thu Jul 28 08:00:26 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 28 08:00:27.102602 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620b4abf-3e4a-49cc-b2da-45f4cf8d23e2 None None] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:00:27.206880 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620b4abf-3e4a-49cc-b2da-45f4cf8d23e2 None None] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:00:27.242117 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8b1889-f4e6-4448-b76a-3a1ff11c8973 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:00:27.242777 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8b1889-f4e6-4448-b76a-3a1ff11c8973 None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:00:27.243120 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8b1889-f4e6-4448-b76a-3a1ff11c8973 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:00:27.243387 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8b1889-f4e6-4448-b76a-3a1ff11c8973 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:00:27.253779 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba8b1889-f4e6-4448-b76a-3a1ff11c8973 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:00:27.255230 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba8b1889-f4e6-4448-b76a-3a1ff11c8973 None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:00:27.270042 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application [None req-ba8b1889-f4e6-4448-b76a-3a1ff11c8973 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 08:00:27.270042 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:00:27.270042 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:00:27.270042 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:00:27.270042 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:00:27.270042 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:00:27.270042 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:00:27.270042 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:00:27.270042 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:00:27.270042 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:00:27.270042 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:00:27.270042 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:00:27.270042 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 08:00:27.270042 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 08:00:27.270042 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 08:00:27.270955 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 08:00:27.270955 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:00:27.270955 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:00:27.270955 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:00:27.270955 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:00:27.270955 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:00:27.270955 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:00:27.270955 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:00:27.270955 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application with Lock( Jul 28 08:00:27.270955 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:00:27.270955 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:00:27.270955 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:00:27.270955 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:00:27.270955 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:00:27.270955 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:00:27.270955 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:00:27.270955 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:00:27.271841 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 08:00:27.271841 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 08:00:27.271841 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 08:00:27.271841 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application Jul 28 08:00:27.272742 dv-cinder-851351-1-smb devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 549/1063] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 08:00:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:00:27.277444 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0be0c8b-acc6-4ed4-9d2b-9d3cd96ec203 None admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:00:27.382030 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0be0c8b-acc6-4ed4-9d2b-9d3cd96ec203 None admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:00:27.417778 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0afaadb-39f6-456e-ba38-a089b49fd017 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:00:27.418798 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0afaadb-39f6-456e-ba38-a089b49fd017 None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:00:27.419269 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0afaadb-39f6-456e-ba38-a089b49fd017 None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:00:27.419761 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0afaadb-39f6-456e-ba38-a089b49fd017 None admin] PATH_INFO: `/v3/domains` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:00:27.420647 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0afaadb-39f6-456e-ba38-a089b49fd017 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80348) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:00:27.421183 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0afaadb-39f6-456e-ba38-a089b49fd017 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:00:27.422756 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0afaadb-39f6-456e-ba38-a089b49fd017 None admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:00:27.435708 dv-cinder-851351-1-smb devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 515/1064] 10.222.0.42 () {56 vars in 1109 bytes} [Thu Jul 28 08:00:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:00:27.544879 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b826a2b7-e67a-44ef-a5a8-10284f150ca7 None None] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:00:27.545250 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b826a2b7-e67a-44ef-a5a8-10284f150ca7 None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:00:27.545460 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b826a2b7-e67a-44ef-a5a8-10284f150ca7 None None] PATH_INFO: `/` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:00:27.546867 dv-cinder-851351-1-smb devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 550/1065] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 08:00:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 08:00:27.552785 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d725fc0-63fe-4df9-b813-cae669ee6b15 None None] REQUEST_METHOD: `POST` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:00:27.553111 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d725fc0-63fe-4df9-b813-cae669ee6b15 None None] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:00:27.553334 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d725fc0-63fe-4df9-b813-cae669ee6b15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:00:27.573823 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.auth.core [None req-1d725fc0-63fe-4df9-b813-cae669ee6b15 None None] MFA Rules not processed for user `f0666d3a50644a7097367331c1ee1a68`. Rule list: `[]` (Enabled: `True`). {{(pid=80348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 08:00:27.575068 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.fernet_utils [None req-1d725fc0-63fe-4df9-b813-cae669ee6b15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:00:27.577395 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=100 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:00:27.651521 dv-cinder-851351-1-smb devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 516/1066] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 08:00:27 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 08:00:27.673371 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b826a2b7-e67a-44ef-a5a8-10284f150ca7 None None] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:00:27.732959 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:00:27.786875 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b826a2b7-e67a-44ef-a5a8-10284f150ca7 None None] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:00:27.825145 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819b236a-ca8e-462f-b24e-8dc95081deed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:00:27.825795 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819b236a-ca8e-462f-b24e-8dc95081deed None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:00:27.826066 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819b236a-ca8e-462f-b24e-8dc95081deed None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:00:27.826331 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819b236a-ca8e-462f-b24e-8dc95081deed None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:00:27.837374 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-819b236a-ca8e-462f-b24e-8dc95081deed None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 08:00:27.842216 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application [None req-819b236a-ca8e-462f-b24e-8dc95081deed None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 28 08:00:27.842216 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:00:27.842216 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:00:27.842216 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:00:27.842216 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:00:27.842216 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:00:27.842216 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:00:27.842216 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:00:27.842216 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:00:27.842216 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:00:27.842216 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:00:27.842216 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:00:27.842216 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 08:00:27.842216 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 08:00:27.842216 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 08:00:27.842216 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 08:00:27.843127 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 08:00:27.843127 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 08:00:27.843127 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 08:00:27.843127 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 08:00:27.843127 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:00:27.843127 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:00:27.843127 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:00:27.843127 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:00:27.843127 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:00:27.843127 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:00:27.843127 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:00:27.843127 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application with Lock( Jul 28 08:00:27.843127 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:00:27.843127 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:00:27.843127 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:00:27.843127 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:00:27.843954 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:00:27.843954 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:00:27.843954 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:00:27.843954 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:00:27.843954 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 08:00:27.843954 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 08:00:27.843954 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 08:00:27.843954 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 08:00:27.843954 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 08:00:27.843954 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 08:00:27.843954 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 28 08:00:27.843954 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application Jul 28 08:00:27.843954 dv-cinder-851351-1-smb devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 551/1067] 10.222.0.42 () {56 vars in 1120 bytes} [Thu Jul 28 08:00:27 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:00:27.849615 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d725fc0-63fe-4df9-b813-cae669ee6b15 None None] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:00:27.952180 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d725fc0-63fe-4df9-b813-cae669ee6b15 None None] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:00:27.987093 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0ffca8-4515-479c-b2f7-286222d37e2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:00:27.987731 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0ffca8-4515-479c-b2f7-286222d37e2c None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:00:27.988004 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0ffca8-4515-479c-b2f7-286222d37e2c None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:00:27.988274 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0ffca8-4515-479c-b2f7-286222d37e2c None admin] PATH_INFO: `/v3/roles` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:00:27.989018 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb0ffca8-4515-479c-b2f7-286222d37e2c None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80348) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:00:27.989313 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb0ffca8-4515-479c-b2f7-286222d37e2c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:00:27.990663 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb0ffca8-4515-479c-b2f7-286222d37e2c None admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:00:27.996320 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=100 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:00:28.000105 dv-cinder-851351-1-smb devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 517/1068] 10.222.0.42 () {56 vars in 1115 bytes} [Thu Jul 28 08:00:27 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:00:28.005726 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819b236a-ca8e-462f-b24e-8dc95081deed None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:00:28.106941 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819b236a-ca8e-462f-b24e-8dc95081deed None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:00:28.118066 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:00:28.144398 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b481a8-f048-45a2-8f68-cab9f67f03f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:00:28.145085 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b481a8-f048-45a2-8f68-cab9f67f03f1 None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:00:28.145355 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b481a8-f048-45a2-8f68-cab9f67f03f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:00:28.145620 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b481a8-f048-45a2-8f68-cab9f67f03f1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:00:28.159212 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60b481a8-f048-45a2-8f68-cab9f67f03f1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:00:28.160702 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60b481a8-f048-45a2-8f68-cab9f67f03f1 None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:00:28.178473 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application [None req-60b481a8-f048-45a2-8f68-cab9f67f03f1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 08:00:28.178473 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:00:28.178473 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:00:28.178473 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:00:28.178473 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:00:28.178473 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:00:28.178473 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:00:28.178473 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:00:28.178473 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:00:28.178473 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:00:28.178473 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:00:28.178473 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:00:28.178473 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 08:00:28.178473 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 08:00:28.178473 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 08:00:28.179479 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 08:00:28.179479 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:00:28.179479 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:00:28.179479 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:00:28.179479 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:00:28.179479 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:00:28.179479 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:00:28.179479 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:00:28.179479 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application with Lock( Jul 28 08:00:28.179479 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:00:28.179479 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:00:28.179479 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:00:28.179479 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:00:28.179479 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:00:28.179479 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:00:28.179479 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:00:28.179479 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:00:28.180498 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 08:00:28.180498 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 08:00:28.180498 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 08:00:28.180498 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application Jul 28 08:00:28.180498 dv-cinder-851351-1-smb devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 552/1069] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 08:00:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:00:28.186038 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0ffca8-4515-479c-b2f7-286222d37e2c None admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:00:28.291584 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0ffca8-4515-479c-b2f7-286222d37e2c None admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:00:28.325637 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f89bf5-2479-417c-8a09-021dbd5b2b54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:00:28.326256 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f89bf5-2479-417c-8a09-021dbd5b2b54 None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:00:28.326537 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f89bf5-2479-417c-8a09-021dbd5b2b54 None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:00:28.326799 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f89bf5-2479-417c-8a09-021dbd5b2b54 None admin] PATH_INFO: `/v3/domains` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:00:28.327513 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40f89bf5-2479-417c-8a09-021dbd5b2b54 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80348) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:00:28.327808 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40f89bf5-2479-417c-8a09-021dbd5b2b54 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:00:28.329589 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40f89bf5-2479-417c-8a09-021dbd5b2b54 None admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:00:28.341836 dv-cinder-851351-1-smb devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 518/1070] 10.222.0.42 () {56 vars in 1109 bytes} [Thu Jul 28 08:00:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:00:28.347616 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b481a8-f048-45a2-8f68-cab9f67f03f1 None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:00:28.450421 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b481a8-f048-45a2-8f68-cab9f67f03f1 None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:00:28.483955 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb205da6-3fee-4a07-97f6-2698f538c28d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:00:28.484589 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb205da6-3fee-4a07-97f6-2698f538c28d None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:00:28.484891 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb205da6-3fee-4a07-97f6-2698f538c28d None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:00:28.485152 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb205da6-3fee-4a07-97f6-2698f538c28d None admin] PATH_INFO: `/v3/users/nova` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:00:28.492949 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb205da6-3fee-4a07-97f6-2698f538c28d None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:00:28.494486 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb205da6-3fee-4a07-97f6-2698f538c28d None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:00:28.505581 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application [None req-cb205da6-3fee-4a07-97f6-2698f538c28d None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 28 08:00:28.505581 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:00:28.505581 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:00:28.505581 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:00:28.505581 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:00:28.505581 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:00:28.505581 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:00:28.505581 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:00:28.505581 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:00:28.505581 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:00:28.505581 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:00:28.505581 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:00:28.505581 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 28 08:00:28.505581 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 28 08:00:28.505581 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 28 08:00:28.505581 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 28 08:00:28.506577 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:00:28.506577 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:00:28.506577 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 28 08:00:28.506577 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 08:00:28.506577 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 28 08:00:28.506577 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 08:00:28.506577 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:00:28.506577 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:00:28.506577 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:00:28.506577 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:00:28.506577 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:00:28.506577 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application with Lock( Jul 28 08:00:28.506577 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:00:28.506577 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:00:28.506577 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:00:28.506577 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:00:28.506577 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:00:28.506577 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:00:28.507598 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:00:28.507598 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:00:28.507598 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 28 08:00:28.507598 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 28 08:00:28.507598 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 28 08:00:28.507598 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 28 08:00:28.507598 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 28 08:00:28.507598 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 28 08:00:28.507598 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 28 08:00:28.507598 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application Jul 28 08:00:28.507598 dv-cinder-851351-1-smb devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 553/1071] 10.222.0.42 () {56 vars in 1093 bytes} [Thu Jul 28 08:00:28 2022] GET /identity/v3/users/nova => generated 82 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:00:28.512746 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f89bf5-2479-417c-8a09-021dbd5b2b54 None admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:00:28.576273 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=100 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:00:28.618170 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f89bf5-2479-417c-8a09-021dbd5b2b54 None admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:00:28.653289 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff72970d-64cc-4997-ba8b-55bde05fd0eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:00:28.653909 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff72970d-64cc-4997-ba8b-55bde05fd0eb None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:00:28.654179 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff72970d-64cc-4997-ba8b-55bde05fd0eb None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:00:28.654426 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff72970d-64cc-4997-ba8b-55bde05fd0eb None admin] PATH_INFO: `/v3/users` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:00:28.655229 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff72970d-64cc-4997-ba8b-55bde05fd0eb None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80348) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:00:28.655526 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff72970d-64cc-4997-ba8b-55bde05fd0eb None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:00:28.656995 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff72970d-64cc-4997-ba8b-55bde05fd0eb None admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:00:28.676420 dv-cinder-851351-1-smb devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 519/1072] 10.222.0.42 () {56 vars in 1133 bytes} [Thu Jul 28 08:00:28 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:00:28.683001 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb205da6-3fee-4a07-97f6-2698f538c28d None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:00:28.723370 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:00:28.750855 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-defd5efc-f4c0-408d-8218-14eea709b380 None None] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:00:28.751133 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-defd5efc-f4c0-408d-8218-14eea709b380 None None] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:00:28.751634 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-defd5efc-f4c0-408d-8218-14eea709b380 None None] PATH_INFO: `/` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:00:28.752791 dv-cinder-851351-1-smb devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 520/1073] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 08:00:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 08:00:28.757930 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ccc3263-74b3-4b89-8f41-8c2d1ba76c45 None None] REQUEST_METHOD: `POST` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:00:28.758209 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ccc3263-74b3-4b89-8f41-8c2d1ba76c45 None None] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:00:28.758476 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ccc3263-74b3-4b89-8f41-8c2d1ba76c45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:00:28.777190 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.auth.core [None req-1ccc3263-74b3-4b89-8f41-8c2d1ba76c45 None None] MFA Rules not processed for user `f0666d3a50644a7097367331c1ee1a68`. Rule list: `[]` (Enabled: `True`). {{(pid=80348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 08:00:28.779633 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.fernet_utils [None req-1ccc3263-74b3-4b89-8f41-8c2d1ba76c45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:00:28.806622 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb205da6-3fee-4a07-97f6-2698f538c28d None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:00:28.841878 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556bbb95-e107-42a0-a46b-f93eb7300b94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:00:28.842571 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556bbb95-e107-42a0-a46b-f93eb7300b94 None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:00:28.842850 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556bbb95-e107-42a0-a46b-f93eb7300b94 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:00:28.843125 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556bbb95-e107-42a0-a46b-f93eb7300b94 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:00:28.849875 dv-cinder-851351-1-smb devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 521/1074] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 08:00:28 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 28 08:00:28.855481 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-556bbb95-e107-42a0-a46b-f93eb7300b94 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:00:28.857238 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-556bbb95-e107-42a0-a46b-f93eb7300b94 None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:00:28.872094 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ccc3263-74b3-4b89-8f41-8c2d1ba76c45 None None] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:00:28.873426 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application [None req-556bbb95-e107-42a0-a46b-f93eb7300b94 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 08:00:28.873426 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:00:28.873426 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:00:28.873426 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:00:28.873426 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:00:28.873426 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:00:28.873426 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:00:28.873426 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:00:28.873426 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:00:28.873426 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:00:28.873426 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:00:28.873426 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:00:28.873426 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 08:00:28.873426 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 08:00:28.873426 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 08:00:28.874822 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 08:00:28.874822 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:00:28.874822 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:00:28.874822 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:00:28.874822 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:00:28.874822 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:00:28.874822 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:00:28.874822 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:00:28.874822 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application with Lock( Jul 28 08:00:28.874822 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:00:28.874822 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:00:28.874822 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:00:28.874822 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:00:28.874822 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:00:28.874822 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:00:28.874822 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:00:28.874822 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:00:28.876117 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 08:00:28.876117 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 08:00:28.876117 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 08:00:28.876117 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application Jul 28 08:00:28.876117 dv-cinder-851351-1-smb devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 554/1075] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 08:00:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:00:28.880506 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556bbb95-e107-42a0-a46b-f93eb7300b94 None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:00:28.926591 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=100 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:00:28.980936 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:00:28.987402 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ccc3263-74b3-4b89-8f41-8c2d1ba76c45 None None] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:00:29.012514 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556bbb95-e107-42a0-a46b-f93eb7300b94 None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:00:29.025055 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb10363-be86-424f-be26-34f6b6fcc7c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:00:29.025721 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb10363-be86-424f-be26-34f6b6fcc7c4 None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:00:29.025996 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb10363-be86-424f-be26-34f6b6fcc7c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:00:29.026265 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb10363-be86-424f-be26-34f6b6fcc7c4 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:00:29.038313 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb10363-be86-424f-be26-34f6b6fcc7c4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 08:00:29.043460 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application [None req-fbb10363-be86-424f-be26-34f6b6fcc7c4 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 08:00:29.043460 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:00:29.043460 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:00:29.043460 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:00:29.043460 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:00:29.043460 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:00:29.043460 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:00:29.043460 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:00:29.043460 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:00:29.043460 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:00:29.043460 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:00:29.043460 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:00:29.043460 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 08:00:29.043460 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 08:00:29.043460 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 08:00:29.043460 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 08:00:29.044503 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 08:00:29.044503 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 08:00:29.044503 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 08:00:29.044503 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 08:00:29.044503 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:00:29.044503 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:00:29.044503 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:00:29.044503 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:00:29.044503 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:00:29.044503 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:00:29.044503 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:00:29.044503 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application with Lock( Jul 28 08:00:29.044503 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:00:29.044503 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:00:29.044503 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:00:29.044503 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:00:29.045687 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:00:29.045687 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:00:29.045687 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:00:29.045687 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:00:29.045687 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 08:00:29.045687 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 08:00:29.045687 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 08:00:29.045687 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 08:00:29.045687 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 08:00:29.045687 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 08:00:29.045687 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 08:00:29.045687 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application Jul 28 08:00:29.045687 dv-cinder-851351-1-smb devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 522/1076] 10.222.0.42 () {56 vars in 1096 bytes} [Thu Jul 28 08:00:28 2022] GET /identity/v3/roles/admin => generated 83 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 08:00:29.049679 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ceb4e30-fede-483f-ab7d-d77fe17bcdbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:00:29.050265 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ceb4e30-fede-483f-ab7d-d77fe17bcdbc None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:00:29.050518 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ceb4e30-fede-483f-ab7d-d77fe17bcdbc None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:00:29.050813 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ceb4e30-fede-483f-ab7d-d77fe17bcdbc None admin] PATH_INFO: `/v3/domains` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:00:29.051107 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb10363-be86-424f-be26-34f6b6fcc7c4 None admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:00:29.051499 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ceb4e30-fede-483f-ab7d-d77fe17bcdbc None admin] RBAC: Adding query filter params (name=Default) {{(pid=80347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:00:29.051804 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ceb4e30-fede-483f-ab7d-d77fe17bcdbc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:00:29.053268 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ceb4e30-fede-483f-ab7d-d77fe17bcdbc None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:00:29.067776 dv-cinder-851351-1-smb devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 555/1077] 10.222.0.42 () {56 vars in 1109 bytes} [Thu Jul 28 08:00:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 08:00:29.073773 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ceb4e30-fede-483f-ab7d-d77fe17bcdbc None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:00:29.169359 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb10363-be86-424f-be26-34f6b6fcc7c4 None admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:00:29.180198 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=100 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:00:29.182831 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ceb4e30-fede-483f-ab7d-d77fe17bcdbc None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:00:29.207583 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878315c6-eb63-497a-991f-6311370105d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:00:29.208215 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878315c6-eb63-497a-991f-6311370105d4 None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:00:29.208510 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878315c6-eb63-497a-991f-6311370105d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:00:29.208814 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878315c6-eb63-497a-991f-6311370105d4 None admin] PATH_INFO: `/v3/roles` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:00:29.209541 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-878315c6-eb63-497a-991f-6311370105d4 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80348) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:00:29.209853 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-878315c6-eb63-497a-991f-6311370105d4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:00:29.211250 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-878315c6-eb63-497a-991f-6311370105d4 None admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:00:29.218642 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b102c3-6154-4907-852f-4e3ef11dec3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:00:29.219312 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b102c3-6154-4907-852f-4e3ef11dec3f None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:00:29.219579 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b102c3-6154-4907-852f-4e3ef11dec3f None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:00:29.219851 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b102c3-6154-4907-852f-4e3ef11dec3f None admin] PATH_INFO: `/v3/projects/service` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:00:29.220287 dv-cinder-851351-1-smb devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 523/1078] 10.222.0.42 () {56 vars in 1099 bytes} [Thu Jul 28 08:00:29 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:00:29.222171 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:00:29.226398 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878315c6-eb63-497a-991f-6311370105d4 None admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:00:29.231643 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b102c3-6154-4907-852f-4e3ef11dec3f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:00:29.233165 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b102c3-6154-4907-852f-4e3ef11dec3f None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:00:29.246014 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application [None req-96b102c3-6154-4907-852f-4e3ef11dec3f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 08:00:29.246014 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:00:29.246014 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:00:29.246014 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:00:29.246014 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:00:29.246014 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:00:29.246014 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:00:29.246014 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:00:29.246014 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:00:29.246014 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:00:29.246014 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:00:29.246014 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:00:29.246014 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 28 08:00:29.246014 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 28 08:00:29.246014 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 28 08:00:29.247092 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 28 08:00:29.247092 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:00:29.247092 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:00:29.247092 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:00:29.247092 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:00:29.247092 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:00:29.247092 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:00:29.247092 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:00:29.247092 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application with Lock( Jul 28 08:00:29.247092 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:00:29.247092 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:00:29.247092 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:00:29.247092 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:00:29.247092 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:00:29.247092 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:00:29.247092 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:00:29.247092 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:00:29.248002 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 28 08:00:29.248002 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 28 08:00:29.248002 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 28 08:00:29.248002 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 28 08:00:29.248002 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 28 08:00:29.248002 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 28 08:00:29.248002 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 08:00:29.248002 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application Jul 28 08:00:29.248002 dv-cinder-851351-1-smb devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 556/1079] 10.222.0.42 () {56 vars in 1111 bytes} [Thu Jul 28 08:00:29 2022] GET /identity/v3/projects/service => generated 88 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:00:29.253611 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b102c3-6154-4907-852f-4e3ef11dec3f None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:00:29.336178 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878315c6-eb63-497a-991f-6311370105d4 None admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:00:29.360237 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b102c3-6154-4907-852f-4e3ef11dec3f None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:00:29.372869 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771e1330-5940-4ce8-88e5-cfefa7f545d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:00:29.373568 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771e1330-5940-4ce8-88e5-cfefa7f545d1 None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:00:29.373844 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771e1330-5940-4ce8-88e5-cfefa7f545d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:00:29.374113 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771e1330-5940-4ce8-88e5-cfefa7f545d1 None admin] PATH_INFO: `/v3/users/d86ac1c1646d4dce80fa5926bfda5927` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:00:29.375399 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-771e1330-5940-4ce8-88e5-cfefa7f545d1 None admin] RBAC: Authorizing `identity:get_user(user_id=d86ac1c1646d4dce80fa5926bfda5927)` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:00:29.376906 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-771e1330-5940-4ce8-88e5-cfefa7f545d1 None admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:00:29.378605 dv-cinder-851351-1-smb devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 524/1080] 10.222.0.42 () {56 vars in 1177 bytes} [Thu Jul 28 08:00:29 2022] GET /identity/v3/users/d86ac1c1646d4dce80fa5926bfda5927 => generated 285 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 08:00:29.384753 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771e1330-5940-4ce8-88e5-cfefa7f545d1 None admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:00:29.396399 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e19ffc-72b5-4f2f-ac93-57f2c0cac850 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:00:29.397083 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e19ffc-72b5-4f2f-ac93-57f2c0cac850 None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:00:29.397363 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e19ffc-72b5-4f2f-ac93-57f2c0cac850 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:00:29.397636 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e19ffc-72b5-4f2f-ac93-57f2c0cac850 None admin] PATH_INFO: `/v3/projects` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:00:29.398497 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e19ffc-72b5-4f2f-ac93-57f2c0cac850 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:00:29.398827 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e19ffc-72b5-4f2f-ac93-57f2c0cac850 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:00:29.400449 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e19ffc-72b5-4f2f-ac93-57f2c0cac850 None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:00:29.413509 dv-cinder-851351-1-smb devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 557/1081] 10.222.0.42 () {56 vars in 1148 bytes} [Thu Jul 28 08:00:29 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 08:00:29.419572 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e19ffc-72b5-4f2f-ac93-57f2c0cac850 None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:00:29.428772 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=100 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:00:29.489139 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:00:29.500286 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771e1330-5940-4ce8-88e5-cfefa7f545d1 None admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:00:29.533858 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e422e7-780e-4067-aba9-2a234da21908 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:00:29.534242 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e19ffc-72b5-4f2f-ac93-57f2c0cac850 None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:00:29.534505 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e422e7-780e-4067-aba9-2a234da21908 None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:00:29.534780 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e422e7-780e-4067-aba9-2a234da21908 None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:00:29.535048 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e422e7-780e-4067-aba9-2a234da21908 None admin] PATH_INFO: `/v3/projects/ddc4c89a5c5a4bfd80cc08fe59adeeec` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:00:29.536181 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9e422e7-780e-4067-aba9-2a234da21908 None admin] RBAC: Authorizing `identity:get_project(project_id=ddc4c89a5c5a4bfd80cc08fe59adeeec)` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:00:29.537648 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9e422e7-780e-4067-aba9-2a234da21908 None admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:00:29.539331 dv-cinder-851351-1-smb devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 525/1082] 10.222.0.42 () {56 vars in 1186 bytes} [Thu Jul 28 08:00:29 2022] GET /identity/v3/projects/ddc4c89a5c5a4bfd80cc08fe59adeeec => generated 311 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:00:29.545634 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e422e7-780e-4067-aba9-2a234da21908 None admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:00:29.569498 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ffb0ba-6c33-42e1-8c04-75a0b04f1fe5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:00:29.570178 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ffb0ba-6c33-42e1-8c04-75a0b04f1fe5 None admin] REQUEST_METHOD: `PUT` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:00:29.570450 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ffb0ba-6c33-42e1-8c04-75a0b04f1fe5 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:00:29.570717 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ffb0ba-6c33-42e1-8c04-75a0b04f1fe5 None admin] PATH_INFO: `/v3/projects/139349507026497c98f360774dee737e/users/02f10880691d4fd180f96f3e40e1d25f/roles/a2ca675df8464a35b15d0c6795636b90` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:00:29.573059 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ffb0ba-6c33-42e1-8c04-75a0b04f1fe5 None admin] RBAC: Authorizing `identity:create_grant(project_id=139349507026497c98f360774dee737e, user_id=02f10880691d4fd180f96f3e40e1d25f, role_id=a2ca675df8464a35b15d0c6795636b90)` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:00:29.574490 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ffb0ba-6c33-42e1-8c04-75a0b04f1fe5 None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:00:29.588574 dv-cinder-851351-1-smb devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 558/1083] 10.222.0.42 () {58 vars in 1439 bytes} [Thu Jul 28 08:00:29 2022] PUT /identity/v3/projects/139349507026497c98f360774dee737e/users/02f10880691d4fd180f96f3e40e1d25f/roles/a2ca675df8464a35b15d0c6795636b90 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 28 08:00:29.655612 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e422e7-780e-4067-aba9-2a234da21908 None admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:00:29.663574 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=100 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:00:29.695078 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19427d3d-91c7-4464-9240-f85483609dd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:00:29.695656 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19427d3d-91c7-4464-9240-f85483609dd8 None admin] REQUEST_METHOD: `PUT` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:00:29.695933 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19427d3d-91c7-4464-9240-f85483609dd8 None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:00:29.696261 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19427d3d-91c7-4464-9240-f85483609dd8 None admin] PATH_INFO: `/v3/projects/ddc4c89a5c5a4bfd80cc08fe59adeeec/users/d86ac1c1646d4dce80fa5926bfda5927/roles/362bd71ac01249fb8fa635381993eec1` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:00:29.698391 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19427d3d-91c7-4464-9240-f85483609dd8 None admin] RBAC: Authorizing `identity:create_grant(project_id=ddc4c89a5c5a4bfd80cc08fe59adeeec, user_id=d86ac1c1646d4dce80fa5926bfda5927, role_id=362bd71ac01249fb8fa635381993eec1)` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:00:29.699864 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19427d3d-91c7-4464-9240-f85483609dd8 None admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:00:29.716360 dv-cinder-851351-1-smb devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 526/1084] 10.222.0.42 () {58 vars in 1439 bytes} [Thu Jul 28 08:00:29 2022] PUT /identity/v3/projects/ddc4c89a5c5a4bfd80cc08fe59adeeec/users/d86ac1c1646d4dce80fa5926bfda5927/roles/362bd71ac01249fb8fa635381993eec1 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 28 08:00:31.538558 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2cb57b-eeb7-4ca9-8fc4-4e6c8fa8a860 None None] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:00:31.539135 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2cb57b-eeb7-4ca9-8fc4-4e6c8fa8a860 None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:00:31.539135 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2cb57b-eeb7-4ca9-8fc4-4e6c8fa8a860 None None] PATH_INFO: `/` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:00:31.540383 dv-cinder-851351-1-smb devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 559/1085] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 08:00:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 08:00:31.545841 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ddb8da1-1d0d-4161-ab83-fa12d1e4362d None None] REQUEST_METHOD: `POST` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:00:31.546316 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ddb8da1-1d0d-4161-ab83-fa12d1e4362d None None] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:00:31.546415 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ddb8da1-1d0d-4161-ab83-fa12d1e4362d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:00:31.565227 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.auth.core [None req-9ddb8da1-1d0d-4161-ab83-fa12d1e4362d None None] MFA Rules not processed for user `f0666d3a50644a7097367331c1ee1a68`. Rule list: `[]` (Enabled: `True`). {{(pid=80348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 08:00:31.566401 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.fernet_utils [None req-9ddb8da1-1d0d-4161-ab83-fa12d1e4362d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:00:31.635814 dv-cinder-851351-1-smb devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 527/1086] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 08:00:31 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 08:00:31.661745 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd2cb57b-eeb7-4ca9-8fc4-4e6c8fa8a860 None None] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:00:31.693624 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67525470-06b9-4e57-af8a-0c73d5adc682 None None] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:00:31.693882 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67525470-06b9-4e57-af8a-0c73d5adc682 None None] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:00:31.694155 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67525470-06b9-4e57-af8a-0c73d5adc682 None None] PATH_INFO: `/` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:00:31.695606 dv-cinder-851351-1-smb devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 528/1087] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 08:00:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 08:00:31.700415 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98918413-43ba-4461-b8e1-4fe66b0f617f None None] REQUEST_METHOD: `POST` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:00:31.700731 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98918413-43ba-4461-b8e1-4fe66b0f617f None None] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:00:31.701026 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98918413-43ba-4461-b8e1-4fe66b0f617f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:00:31.719065 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.auth.core [None req-98918413-43ba-4461-b8e1-4fe66b0f617f None None] MFA Rules not processed for user `f0666d3a50644a7097367331c1ee1a68`. Rule list: `[]` (Enabled: `True`). {{(pid=80348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 08:00:31.720297 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.fernet_utils [None req-98918413-43ba-4461-b8e1-4fe66b0f617f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:00:31.768995 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd2cb57b-eeb7-4ca9-8fc4-4e6c8fa8a860 None None] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:00:31.784495 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:00:31.787678 dv-cinder-851351-1-smb devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 529/1088] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 08:00:31 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 28 08:00:31.808479 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a0d117-ce1e-47b1-a2e1-d638750983c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:00:31.809082 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a0d117-ce1e-47b1-a2e1-d638750983c2 None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:00:31.809354 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a0d117-ce1e-47b1-a2e1-d638750983c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:00:31.809618 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a0d117-ce1e-47b1-a2e1-d638750983c2 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:00:31.811274 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98918413-43ba-4461-b8e1-4fe66b0f617f None None] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:00:31.821316 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1a0d117-ce1e-47b1-a2e1-d638750983c2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 08:00:31.826338 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application [None req-b1a0d117-ce1e-47b1-a2e1-d638750983c2 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 28 08:00:31.826338 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:00:31.826338 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:00:31.826338 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:00:31.826338 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:00:31.826338 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:00:31.826338 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:00:31.826338 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:00:31.826338 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:00:31.826338 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:00:31.826338 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:00:31.826338 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:00:31.826338 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 08:00:31.826338 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 08:00:31.826338 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 08:00:31.826338 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 08:00:31.827340 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 08:00:31.827340 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 08:00:31.827340 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 08:00:31.827340 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 08:00:31.827340 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:00:31.827340 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:00:31.827340 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:00:31.827340 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:00:31.827340 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:00:31.827340 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:00:31.827340 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:00:31.827340 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application with Lock( Jul 28 08:00:31.827340 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:00:31.827340 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:00:31.827340 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:00:31.827340 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:00:31.828596 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:00:31.828596 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:00:31.828596 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:00:31.828596 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:00:31.828596 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 08:00:31.828596 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 08:00:31.828596 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 08:00:31.828596 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 08:00:31.828596 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 08:00:31.828596 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 08:00:31.828596 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 28 08:00:31.828596 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application Jul 28 08:00:31.828596 dv-cinder-851351-1-smb devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 560/1089] 10.222.0.42 () {56 vars in 1120 bytes} [Thu Jul 28 08:00:31 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:00:31.834543 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a0d117-ce1e-47b1-a2e1-d638750983c2 None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:00:31.840177 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:00:31.916620 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98918413-43ba-4461-b8e1-4fe66b0f617f None None] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:00:31.938454 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a0d117-ce1e-47b1-a2e1-d638750983c2 None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:00:31.953596 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c056462-4a0b-407f-beea-d512a869c98f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:00:31.954238 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c056462-4a0b-407f-beea-d512a869c98f None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:00:31.954532 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c056462-4a0b-407f-beea-d512a869c98f None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:00:31.954795 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c056462-4a0b-407f-beea-d512a869c98f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:00:31.965313 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c056462-4a0b-407f-beea-d512a869c98f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 08:00:31.970221 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application [None req-2c056462-4a0b-407f-beea-d512a869c98f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 08:00:31.970221 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:00:31.970221 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:00:31.970221 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:00:31.970221 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:00:31.970221 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:00:31.970221 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:00:31.970221 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:00:31.970221 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:00:31.970221 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:00:31.970221 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:00:31.970221 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:00:31.970221 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 08:00:31.970221 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 08:00:31.970221 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 08:00:31.970221 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 08:00:31.971154 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 08:00:31.971154 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 08:00:31.971154 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 08:00:31.971154 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 08:00:31.971154 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:00:31.971154 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:00:31.971154 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:00:31.971154 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:00:31.971154 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:00:31.971154 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:00:31.971154 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:00:31.971154 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application with Lock( Jul 28 08:00:31.971154 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:00:31.971154 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:00:31.971154 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:00:31.971154 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:00:31.972024 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:00:31.972024 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:00:31.972024 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:00:31.972024 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:00:31.972024 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 08:00:31.972024 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 08:00:31.972024 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 08:00:31.972024 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 08:00:31.972024 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 08:00:31.972024 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 08:00:31.972024 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 08:00:31.972024 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application Jul 28 08:00:31.972024 dv-cinder-851351-1-smb devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 530/1090] 10.222.0.42 () {56 vars in 1096 bytes} [Thu Jul 28 08:00:31 2022] GET /identity/v3/roles/admin => generated 83 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 08:00:31.977723 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189ba7a5-6cc3-468d-a4af-4b008f808793 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:00:31.978342 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189ba7a5-6cc3-468d-a4af-4b008f808793 None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:00:31.978613 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189ba7a5-6cc3-468d-a4af-4b008f808793 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:00:31.978877 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189ba7a5-6cc3-468d-a4af-4b008f808793 None admin] PATH_INFO: `/v3/roles` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:00:31.979157 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c056462-4a0b-407f-beea-d512a869c98f None admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:00:31.979590 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-189ba7a5-6cc3-468d-a4af-4b008f808793 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:00:31.979885 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-189ba7a5-6cc3-468d-a4af-4b008f808793 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:00:31.981282 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-189ba7a5-6cc3-468d-a4af-4b008f808793 None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:00:31.990684 dv-cinder-851351-1-smb devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 561/1091] 10.222.0.42 () {56 vars in 1115 bytes} [Thu Jul 28 08:00:31 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:00:31.996238 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189ba7a5-6cc3-468d-a4af-4b008f808793 None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:00:32.031826 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:00:32.067290 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=100 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:00:32.085738 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c056462-4a0b-407f-beea-d512a869c98f None admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:00:32.096577 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189ba7a5-6cc3-468d-a4af-4b008f808793 None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:00:32.122042 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4283f222-f6d7-48ed-8ce8-06e4622223f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:00:32.122042 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4283f222-f6d7-48ed-8ce8-06e4622223f1 None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:00:32.127512 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4283f222-f6d7-48ed-8ce8-06e4622223f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:00:32.127512 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4283f222-f6d7-48ed-8ce8-06e4622223f1 None admin] PATH_INFO: `/v3/roles` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:00:32.127512 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4283f222-f6d7-48ed-8ce8-06e4622223f1 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80348) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:00:32.127512 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4283f222-f6d7-48ed-8ce8-06e4622223f1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:00:32.127512 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4283f222-f6d7-48ed-8ce8-06e4622223f1 None admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:00:32.133897 dv-cinder-851351-1-smb devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 531/1092] 10.222.0.42 () {56 vars in 1099 bytes} [Thu Jul 28 08:00:31 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:00:32.137718 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147cad45-56cb-4ccb-8e94-c38c99321289 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:00:32.138367 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147cad45-56cb-4ccb-8e94-c38c99321289 None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:00:32.138643 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147cad45-56cb-4ccb-8e94-c38c99321289 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:00:32.138912 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147cad45-56cb-4ccb-8e94-c38c99321289 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:00:32.139621 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4283f222-f6d7-48ed-8ce8-06e4622223f1 None admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:00:32.149445 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-147cad45-56cb-4ccb-8e94-c38c99321289 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:00:32.150877 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-147cad45-56cb-4ccb-8e94-c38c99321289 None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:00:32.166440 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application [None req-147cad45-56cb-4ccb-8e94-c38c99321289 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 08:00:32.166440 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:00:32.166440 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:00:32.166440 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:00:32.166440 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:00:32.166440 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:00:32.166440 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:00:32.166440 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:00:32.166440 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:00:32.166440 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:00:32.166440 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:00:32.166440 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:00:32.166440 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 08:00:32.166440 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 08:00:32.166440 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 08:00:32.167458 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 08:00:32.167458 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:00:32.167458 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:00:32.167458 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:00:32.167458 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:00:32.167458 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:00:32.167458 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:00:32.167458 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:00:32.167458 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application with Lock( Jul 28 08:00:32.167458 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:00:32.167458 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:00:32.167458 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:00:32.167458 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:00:32.167458 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:00:32.167458 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:00:32.167458 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:00:32.167458 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:00:32.168359 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 08:00:32.168359 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 08:00:32.168359 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 08:00:32.168359 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application Jul 28 08:00:32.168359 dv-cinder-851351-1-smb devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 562/1093] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 08:00:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:00:32.173516 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147cad45-56cb-4ccb-8e94-c38c99321289 None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:00:32.243864 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4283f222-f6d7-48ed-8ce8-06e4622223f1 None admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:00:32.264290 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:00:32.277051 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147cad45-56cb-4ccb-8e94-c38c99321289 None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:00:32.278018 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a8a341-d7b9-4975-99bd-2adc31071268 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:00:32.278669 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a8a341-d7b9-4975-99bd-2adc31071268 None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:00:32.278942 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a8a341-d7b9-4975-99bd-2adc31071268 None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:00:32.279210 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a8a341-d7b9-4975-99bd-2adc31071268 None admin] PATH_INFO: `/v3/users/d86ac1c1646d4dce80fa5926bfda5927` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:00:32.280395 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8a8a341-d7b9-4975-99bd-2adc31071268 None admin] RBAC: Authorizing `identity:get_user(user_id=d86ac1c1646d4dce80fa5926bfda5927)` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:00:32.281876 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8a8a341-d7b9-4975-99bd-2adc31071268 None admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:00:32.283492 dv-cinder-851351-1-smb devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 532/1094] 10.222.0.42 () {56 vars in 1177 bytes} [Thu Jul 28 08:00:32 2022] GET /identity/v3/users/d86ac1c1646d4dce80fa5926bfda5927 => generated 285 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:00:32.289396 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a8a341-d7b9-4975-99bd-2adc31071268 None admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:00:32.308247 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=100 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:00:32.313516 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e4ce316-04d8-429f-9d2d-6a7c395f9143 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:00:32.314145 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4ce316-04d8-429f-9d2d-6a7c395f9143 None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:00:32.314422 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4ce316-04d8-429f-9d2d-6a7c395f9143 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:00:32.314689 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4ce316-04d8-429f-9d2d-6a7c395f9143 None admin] PATH_INFO: `/v3/domains` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:00:32.315378 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e4ce316-04d8-429f-9d2d-6a7c395f9143 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:00:32.315677 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e4ce316-04d8-429f-9d2d-6a7c395f9143 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:00:32.317073 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e4ce316-04d8-429f-9d2d-6a7c395f9143 None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:00:32.329552 dv-cinder-851351-1-smb devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 563/1095] 10.222.0.42 () {56 vars in 1109 bytes} [Thu Jul 28 08:00:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 08:00:32.335446 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e4ce316-04d8-429f-9d2d-6a7c395f9143 None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:00:32.389345 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a8a341-d7b9-4975-99bd-2adc31071268 None admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:00:32.423307 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dda103b-e103-43ce-a5b2-51bff9b19e4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:00:32.423958 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dda103b-e103-43ce-a5b2-51bff9b19e4d None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:00:32.424232 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dda103b-e103-43ce-a5b2-51bff9b19e4d None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:00:32.424501 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dda103b-e103-43ce-a5b2-51bff9b19e4d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:00:32.432917 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e4ce316-04d8-429f-9d2d-6a7c395f9143 None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:00:32.469730 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca36687-acca-45d3-b073-2081c5f6c330 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:00:32.470407 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca36687-acca-45d3-b073-2081c5f6c330 None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:00:32.470682 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca36687-acca-45d3-b073-2081c5f6c330 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:00:32.470964 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca36687-acca-45d3-b073-2081c5f6c330 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:00:32.479153 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cca36687-acca-45d3-b073-2081c5f6c330 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:00:32.480610 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cca36687-acca-45d3-b073-2081c5f6c330 None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:00:32.493572 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application [None req-cca36687-acca-45d3-b073-2081c5f6c330 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 28 08:00:32.493572 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:00:32.493572 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:00:32.493572 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:00:32.493572 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:00:32.493572 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:00:32.493572 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:00:32.493572 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:00:32.493572 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:00:32.493572 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:00:32.493572 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:00:32.493572 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:00:32.493572 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 28 08:00:32.493572 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 28 08:00:32.493572 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 28 08:00:32.493572 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 28 08:00:32.495175 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:00:32.495175 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:00:32.495175 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 28 08:00:32.495175 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 08:00:32.495175 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 28 08:00:32.495175 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 08:00:32.495175 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:00:32.495175 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:00:32.495175 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:00:32.495175 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:00:32.495175 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:00:32.495175 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application with Lock( Jul 28 08:00:32.495175 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:00:32.495175 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:00:32.495175 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:00:32.495175 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:00:32.495175 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:00:32.495175 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:00:32.496420 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:00:32.496420 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:00:32.496420 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 28 08:00:32.496420 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 28 08:00:32.496420 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 28 08:00:32.496420 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 28 08:00:32.496420 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 28 08:00:32.496420 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 28 08:00:32.496420 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 28 08:00:32.496420 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application Jul 28 08:00:32.496420 dv-cinder-851351-1-smb devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 564/1096] 10.222.0.42 () {56 vars in 1093 bytes} [Thu Jul 28 08:00:32 2022] GET /identity/v3/users/nova => generated 82 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:00:32.500940 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dda103b-e103-43ce-a5b2-51bff9b19e4d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:00:32.501200 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca36687-acca-45d3-b073-2081c5f6c330 None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:00:32.502434 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dda103b-e103-43ce-a5b2-51bff9b19e4d None admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:00:32.513106 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:00:32.522439 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=100 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:00:32.611248 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca36687-acca-45d3-b073-2081c5f6c330 None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:00:32.613384 dv-cinder-851351-1-smb devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 533/1097] 10.222.0.42 () {58 vars in 1282 bytes} [Thu Jul 28 08:00:32 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 28 08:00:32.619510 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dda103b-e103-43ce-a5b2-51bff9b19e4d None admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:00:32.645933 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d47be6e-ec2a-4d97-81a8-7a65347e3deb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:00:32.646558 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d47be6e-ec2a-4d97-81a8-7a65347e3deb None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:00:32.646839 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d47be6e-ec2a-4d97-81a8-7a65347e3deb None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:00:32.647110 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d47be6e-ec2a-4d97-81a8-7a65347e3deb None admin] PATH_INFO: `/v3/users` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:00:32.647904 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d47be6e-ec2a-4d97-81a8-7a65347e3deb None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:00:32.648204 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d47be6e-ec2a-4d97-81a8-7a65347e3deb None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:00:32.649751 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d47be6e-ec2a-4d97-81a8-7a65347e3deb None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:00:32.668712 dv-cinder-851351-1-smb devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 565/1098] 10.222.0.42 () {56 vars in 1133 bytes} [Thu Jul 28 08:00:32 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 08:00:32.672940 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d47be6e-ec2a-4d97-81a8-7a65347e3deb None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:00:32.719461 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dda103b-e103-43ce-a5b2-51bff9b19e4d None admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:00:32.737478 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=100 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:00:32.739974 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:00:32.755536 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-548127e2-fd41-45c6-b259-efcc3e327523 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:00:32.756181 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548127e2-fd41-45c6-b259-efcc3e327523 None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:00:32.756462 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548127e2-fd41-45c6-b259-efcc3e327523 None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:00:32.756759 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548127e2-fd41-45c6-b259-efcc3e327523 None admin] PATH_INFO: `/v3/projects/ddc4c89a5c5a4bfd80cc08fe59adeeec` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:00:32.757920 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-548127e2-fd41-45c6-b259-efcc3e327523 None admin] RBAC: Authorizing `identity:get_project(project_id=ddc4c89a5c5a4bfd80cc08fe59adeeec)` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:00:32.759424 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-548127e2-fd41-45c6-b259-efcc3e327523 None admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:00:32.761247 dv-cinder-851351-1-smb devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 534/1099] 10.222.0.42 () {56 vars in 1186 bytes} [Thu Jul 28 08:00:32 2022] GET /identity/v3/projects/ddc4c89a5c5a4bfd80cc08fe59adeeec => generated 311 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:00:32.767466 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-548127e2-fd41-45c6-b259-efcc3e327523 None admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:00:32.775453 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d47be6e-ec2a-4d97-81a8-7a65347e3deb None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:00:32.810346 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b430097a-087b-4d88-b3b3-a26ccf352787 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:00:32.810981 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b430097a-087b-4d88-b3b3-a26ccf352787 None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:00:32.811223 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b430097a-087b-4d88-b3b3-a26ccf352787 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:00:32.811505 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b430097a-087b-4d88-b3b3-a26ccf352787 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:00:32.869367 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-548127e2-fd41-45c6-b259-efcc3e327523 None admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:00:32.884057 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b430097a-087b-4d88-b3b3-a26ccf352787 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:00:32.885925 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b430097a-087b-4d88-b3b3-a26ccf352787 None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:00:32.905002 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56fe67f-6cae-484f-9997-9e4ac07f5a47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:00:32.905624 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56fe67f-6cae-484f-9997-9e4ac07f5a47 None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:00:32.905897 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56fe67f-6cae-484f-9997-9e4ac07f5a47 None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:00:32.906158 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56fe67f-6cae-484f-9997-9e4ac07f5a47 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:00:32.906942 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a56fe67f-6cae-484f-9997-9e4ac07f5a47 None admin] RBAC: Adding query filter params (role.id=362bd71ac01249fb8fa635381993eec1, scope.project.id=ddc4c89a5c5a4bfd80cc08fe59adeeec, user.id=d86ac1c1646d4dce80fa5926bfda5927) {{(pid=80348) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:00:32.907245 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a56fe67f-6cae-484f-9997-9e4ac07f5a47 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:00:32.908695 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a56fe67f-6cae-484f-9997-9e4ac07f5a47 None admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:00:32.914828 dv-cinder-851351-1-smb devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 535/1100] 10.222.0.42 () {56 vars in 1374 bytes} [Thu Jul 28 08:00:32 2022] GET /identity/v3/role_assignments?user.id=d86ac1c1646d4dce80fa5926bfda5927&scope.project.id=ddc4c89a5c5a4bfd80cc08fe59adeeec&role.id=362bd71ac01249fb8fa635381993eec1 => generated 608 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:00:32.956525 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:00:32.997797 dv-cinder-851351-1-smb devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 566/1101] 10.222.0.42 () {58 vars in 1282 bytes} [Thu Jul 28 08:00:32 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 28 08:00:33.003996 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56fe67f-6cae-484f-9997-9e4ac07f5a47 None admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:00:33.058384 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=100 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:00:33.114475 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56fe67f-6cae-484f-9997-9e4ac07f5a47 None admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:00:33.149646 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58420488-c2c6-4405-ae92-b85f326d48a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:00:33.150222 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58420488-c2c6-4405-ae92-b85f326d48a4 None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:00:33.150498 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58420488-c2c6-4405-ae92-b85f326d48a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:00:33.150764 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58420488-c2c6-4405-ae92-b85f326d48a4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:00:33.165045 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58420488-c2c6-4405-ae92-b85f326d48a4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:00:33.166512 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58420488-c2c6-4405-ae92-b85f326d48a4 None admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:00:33.182592 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application [None req-58420488-c2c6-4405-ae92-b85f326d48a4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 08:00:33.182592 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:00:33.182592 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:00:33.182592 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:00:33.182592 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:00:33.182592 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:00:33.182592 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:00:33.182592 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:00:33.182592 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:00:33.182592 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:00:33.182592 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:00:33.182592 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:00:33.182592 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 08:00:33.182592 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 08:00:33.182592 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 08:00:33.183537 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 08:00:33.183537 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:00:33.183537 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:00:33.183537 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:00:33.183537 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:00:33.183537 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:00:33.183537 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:00:33.183537 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:00:33.183537 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application with Lock( Jul 28 08:00:33.183537 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:00:33.183537 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:00:33.183537 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:00:33.183537 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:00:33.183537 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:00:33.183537 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:00:33.183537 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:00:33.183537 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:00:33.184431 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 08:00:33.184431 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 08:00:33.184431 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 08:00:33.184431 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application Jul 28 08:00:33.184431 dv-cinder-851351-1-smb devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 536/1102] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 08:00:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:00:33.189804 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b430097a-087b-4d88-b3b3-a26ccf352787 None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:00:33.297704 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b430097a-087b-4d88-b3b3-a26ccf352787 None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:00:33.335993 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2f7246-b693-4588-9c5e-ef2036d69f51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:00:33.336615 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2f7246-b693-4588-9c5e-ef2036d69f51 None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:00:33.336917 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2f7246-b693-4588-9c5e-ef2036d69f51 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:00:33.337188 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2f7246-b693-4588-9c5e-ef2036d69f51 None admin] PATH_INFO: `/v3/domains` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:00:33.337869 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec2f7246-b693-4588-9c5e-ef2036d69f51 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:00:33.338166 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec2f7246-b693-4588-9c5e-ef2036d69f51 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:00:33.339600 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec2f7246-b693-4588-9c5e-ef2036d69f51 None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:00:33.351392 dv-cinder-851351-1-smb devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 567/1103] 10.222.0.42 () {56 vars in 1109 bytes} [Thu Jul 28 08:00:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:00:33.357310 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58420488-c2c6-4405-ae92-b85f326d48a4 None admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:00:33.467796 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=100 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:00:33.472954 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58420488-c2c6-4405-ae92-b85f326d48a4 None admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:00:33.509502 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e199228-d48e-4f42-b6c0-8ba02f2ced92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:00:33.510415 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e199228-d48e-4f42-b6c0-8ba02f2ced92 None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:00:33.510814 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e199228-d48e-4f42-b6c0-8ba02f2ced92 None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:00:33.511227 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e199228-d48e-4f42-b6c0-8ba02f2ced92 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:00:33.519119 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e199228-d48e-4f42-b6c0-8ba02f2ced92 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:00:33.520603 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e199228-d48e-4f42-b6c0-8ba02f2ced92 None admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:00:33.533430 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application [None req-4e199228-d48e-4f42-b6c0-8ba02f2ced92 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 08:00:33.533430 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:00:33.533430 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:00:33.533430 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:00:33.533430 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:00:33.533430 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:00:33.533430 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:00:33.533430 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:00:33.533430 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:00:33.533430 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:00:33.533430 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:00:33.533430 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:00:33.533430 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 28 08:00:33.533430 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 28 08:00:33.533430 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 28 08:00:33.534464 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 28 08:00:33.534464 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:00:33.534464 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:00:33.534464 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:00:33.534464 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:00:33.534464 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:00:33.534464 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:00:33.534464 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:00:33.534464 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application with Lock( Jul 28 08:00:33.534464 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:00:33.534464 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:00:33.534464 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:00:33.534464 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:00:33.534464 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:00:33.534464 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:00:33.534464 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:00:33.534464 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:00:33.535345 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 28 08:00:33.535345 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 28 08:00:33.535345 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 28 08:00:33.535345 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 28 08:00:33.535345 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 28 08:00:33.535345 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 28 08:00:33.535345 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 08:00:33.535345 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application Jul 28 08:00:33.535345 dv-cinder-851351-1-smb devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 537/1104] 10.222.0.42 () {56 vars in 1111 bytes} [Thu Jul 28 08:00:33 2022] GET /identity/v3/projects/service => generated 88 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:00:33.540776 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2f7246-b693-4588-9c5e-ef2036d69f51 None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:00:33.569793 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:00:33.642306 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2f7246-b693-4588-9c5e-ef2036d69f51 None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:00:33.676809 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e0b165-9ff3-4c3d-a4cd-cb6b2e24281e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:00:33.677439 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e0b165-9ff3-4c3d-a4cd-cb6b2e24281e None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:00:33.677717 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e0b165-9ff3-4c3d-a4cd-cb6b2e24281e None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:00:33.677986 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e0b165-9ff3-4c3d-a4cd-cb6b2e24281e None admin] PATH_INFO: `/v3/projects` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:00:33.678739 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28e0b165-9ff3-4c3d-a4cd-cb6b2e24281e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:00:33.679039 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28e0b165-9ff3-4c3d-a4cd-cb6b2e24281e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:00:33.680586 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28e0b165-9ff3-4c3d-a4cd-cb6b2e24281e None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:00:33.693283 dv-cinder-851351-1-smb devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 568/1105] 10.222.0.42 () {56 vars in 1148 bytes} [Thu Jul 28 08:00:33 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:00:33.699426 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e199228-d48e-4f42-b6c0-8ba02f2ced92 None admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:00:33.802066 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e199228-d48e-4f42-b6c0-8ba02f2ced92 None admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:00:33.836901 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d33c95-b5cf-47b5-b468-42040af524b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:00:33.838332 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d33c95-b5cf-47b5-b468-42040af524b5 None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:00:33.838613 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d33c95-b5cf-47b5-b468-42040af524b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:00:33.838887 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d33c95-b5cf-47b5-b468-42040af524b5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:00:33.839676 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8d33c95-b5cf-47b5-b468-42040af524b5 None admin] RBAC: Adding query filter params (role.id=a2ca675df8464a35b15d0c6795636b90, scope.project.id=139349507026497c98f360774dee737e, user.id=02f10880691d4fd180f96f3e40e1d25f) {{(pid=80348) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:00:33.839959 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8d33c95-b5cf-47b5-b468-42040af524b5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:00:33.841444 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8d33c95-b5cf-47b5-b468-42040af524b5 None admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:00:33.848316 dv-cinder-851351-1-smb devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 538/1106] 10.222.0.42 () {56 vars in 1374 bytes} [Thu Jul 28 08:00:33 2022] GET /identity/v3/role_assignments?user.id=02f10880691d4fd180f96f3e40e1d25f&scope.project.id=139349507026497c98f360774dee737e&role.id=a2ca675df8464a35b15d0c6795636b90 => generated 608 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:00:34.946542 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd04fd34-e037-41d0-8c7c-4929397da867 None None] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:00:34.948711 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd04fd34-e037-41d0-8c7c-4929397da867 None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:00:34.948711 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd04fd34-e037-41d0-8c7c-4929397da867 None None] PATH_INFO: `/` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:00:34.948711 dv-cinder-851351-1-smb devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 569/1107] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 08:00:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 08:00:34.954384 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9164c2-79f8-43c3-b114-24b84fb92adc None None] REQUEST_METHOD: `POST` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:00:34.954857 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9164c2-79f8-43c3-b114-24b84fb92adc None None] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:00:34.954954 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9164c2-79f8-43c3-b114-24b84fb92adc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:00:34.974310 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.auth.core [None req-6b9164c2-79f8-43c3-b114-24b84fb92adc None None] MFA Rules not processed for user `f0666d3a50644a7097367331c1ee1a68`. Rule list: `[]` (Enabled: `True`). {{(pid=80348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 08:00:34.975537 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.fernet_utils [None req-6b9164c2-79f8-43c3-b114-24b84fb92adc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:00:34.994851 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=100 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:00:35.047807 dv-cinder-851351-1-smb devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 539/1108] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 08:00:34 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 08:00:35.073119 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd04fd34-e037-41d0-8c7c-4929397da867 None None] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:00:35.166660 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:00:35.183560 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd04fd34-e037-41d0-8c7c-4929397da867 None None] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:00:35.219233 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5bdc66-00bc-49ea-b8c2-23e2e3772375 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:00:35.219786 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5bdc66-00bc-49ea-b8c2-23e2e3772375 None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:00:35.220058 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5bdc66-00bc-49ea-b8c2-23e2e3772375 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:00:35.220321 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5bdc66-00bc-49ea-b8c2-23e2e3772375 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:00:35.221561 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c5bdc66-00bc-49ea-b8c2-23e2e3772375 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:00:35.222988 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c5bdc66-00bc-49ea-b8c2-23e2e3772375 None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:00:35.224580 dv-cinder-851351-1-smb devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 570/1109] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 08:00:35 2022] GET /identity/v3/domains/default => generated 199 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:00:35.230841 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9164c2-79f8-43c3-b114-24b84fb92adc None None] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:00:35.332747 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9164c2-79f8-43c3-b114-24b84fb92adc None None] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:00:35.369484 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7ce5d3-0a99-408c-9829-33b67f358bc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:00:35.370098 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7ce5d3-0a99-408c-9829-33b67f358bc7 None admin] REQUEST_METHOD: `POST` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:00:35.370381 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7ce5d3-0a99-408c-9829-33b67f358bc7 None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:00:35.370639 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7ce5d3-0a99-408c-9829-33b67f358bc7 None admin] PATH_INFO: `/v3/users` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:00:35.371328 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b7ce5d3-0a99-408c-9829-33b67f358bc7 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:00:35.372798 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b7ce5d3-0a99-408c-9829-33b67f358bc7 None admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:00:35.395853 dv-cinder-851351-1-smb devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 540/1110] 10.222.0.42 () {60 vars in 1132 bytes} [Thu Jul 28 08:00:35 2022] POST /identity/v3/users => generated 286 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 08:00:37.426932 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c264b8c4-1c9a-4e2a-b557-802fd5672274 None None] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:00:37.427475 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c264b8c4-1c9a-4e2a-b557-802fd5672274 None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:00:37.427475 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c264b8c4-1c9a-4e2a-b557-802fd5672274 None None] PATH_INFO: `/` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:00:37.428825 dv-cinder-851351-1-smb devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 571/1111] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 08:00:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 08:00:37.434439 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322c3d4e-98ec-4c74-a981-152a79ecece1 None None] REQUEST_METHOD: `POST` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:00:37.434925 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322c3d4e-98ec-4c74-a981-152a79ecece1 None None] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:00:37.435023 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322c3d4e-98ec-4c74-a981-152a79ecece1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:00:37.454098 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.auth.core [None req-322c3d4e-98ec-4c74-a981-152a79ecece1 None None] MFA Rules not processed for user `f0666d3a50644a7097367331c1ee1a68`. Rule list: `[]` (Enabled: `True`). {{(pid=80348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 08:00:37.455314 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.fernet_utils [None req-322c3d4e-98ec-4c74-a981-152a79ecece1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:00:37.458280 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:00:37.526902 dv-cinder-851351-1-smb devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 541/1112] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 08:00:37 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 08:00:37.549880 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c264b8c4-1c9a-4e2a-b557-802fd5672274 None None] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:00:37.666667 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c264b8c4-1c9a-4e2a-b557-802fd5672274 None None] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:00:37.708256 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-877cd33b-2815-4ba4-ae38-4afbad2c0cb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:00:37.708863 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877cd33b-2815-4ba4-ae38-4afbad2c0cb9 None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:00:37.709139 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877cd33b-2815-4ba4-ae38-4afbad2c0cb9 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:00:37.709399 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877cd33b-2815-4ba4-ae38-4afbad2c0cb9 None admin] PATH_INFO: `/v3/roles/f28d669937b942878bcf6a9103012af9` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:00:37.710923 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-877cd33b-2815-4ba4-ae38-4afbad2c0cb9 None admin] RBAC: Authorizing `identity:get_role(role_id=f28d669937b942878bcf6a9103012af9)` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:00:37.712416 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-877cd33b-2815-4ba4-ae38-4afbad2c0cb9 None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:00:37.713908 dv-cinder-851351-1-smb devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 572/1113] 10.222.0.42 () {56 vars in 1177 bytes} [Thu Jul 28 08:00:37 2022] GET /identity/v3/roles/f28d669937b942878bcf6a9103012af9 => generated 223 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:00:37.720874 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322c3d4e-98ec-4c74-a981-152a79ecece1 None None] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:00:37.843942 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322c3d4e-98ec-4c74-a981-152a79ecece1 None None] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:00:37.885448 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c69108-e94a-42f7-acfa-f480eeabfe14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:00:37.886130 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c69108-e94a-42f7-acfa-f480eeabfe14 None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:00:37.886401 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c69108-e94a-42f7-acfa-f480eeabfe14 None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:00:37.886668 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c69108-e94a-42f7-acfa-f480eeabfe14 None admin] PATH_INFO: `/v3/users/2d52ce350c3d4880a86dad091eac8b91` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:00:37.898794 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=100 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:00:37.903572 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99c69108-e94a-42f7-acfa-f480eeabfe14 None admin] RBAC: Authorizing `identity:get_user(user_id=2d52ce350c3d4880a86dad091eac8b91)` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:00:37.905405 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99c69108-e94a-42f7-acfa-f480eeabfe14 None admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:00:37.907337 dv-cinder-851351-1-smb devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 542/1114] 10.222.0.42 () {56 vars in 1177 bytes} [Thu Jul 28 08:00:37 2022] GET /identity/v3/users/2d52ce350c3d4880a86dad091eac8b91 => generated 286 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:00:37.916875 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-877cd33b-2815-4ba4-ae38-4afbad2c0cb9 None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:00:37.957196 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:00:38.084097 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-877cd33b-2815-4ba4-ae38-4afbad2c0cb9 None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:00:38.124518 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab5a6f8-8b22-4043-b550-03597e997095 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:00:38.125186 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab5a6f8-8b22-4043-b550-03597e997095 None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:00:38.125430 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab5a6f8-8b22-4043-b550-03597e997095 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:00:38.125728 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab5a6f8-8b22-4043-b550-03597e997095 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:00:38.226831 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab5a6f8-8b22-4043-b550-03597e997095 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:00:38.229509 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab5a6f8-8b22-4043-b550-03597e997095 None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:00:38.261246 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:00:38.360789 dv-cinder-851351-1-smb devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 573/1115] 10.222.0.42 () {58 vars in 1282 bytes} [Thu Jul 28 08:00:37 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 445 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 28 08:00:38.367196 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c69108-e94a-42f7-acfa-f480eeabfe14 None admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:00:38.473342 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c69108-e94a-42f7-acfa-f480eeabfe14 None admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:00:38.509695 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-624e49bd-a159-4547-af4a-eb47acf63ba0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:00:38.510328 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624e49bd-a159-4547-af4a-eb47acf63ba0 None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:00:38.510598 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624e49bd-a159-4547-af4a-eb47acf63ba0 None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:00:38.510853 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624e49bd-a159-4547-af4a-eb47acf63ba0 None admin] PATH_INFO: `/v3/projects/ddc4c89a5c5a4bfd80cc08fe59adeeec` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:00:38.512041 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-624e49bd-a159-4547-af4a-eb47acf63ba0 None admin] RBAC: Authorizing `identity:get_project(project_id=ddc4c89a5c5a4bfd80cc08fe59adeeec)` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:00:38.513521 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-624e49bd-a159-4547-af4a-eb47acf63ba0 None admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:00:38.515228 dv-cinder-851351-1-smb devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 543/1116] 10.222.0.42 () {56 vars in 1186 bytes} [Thu Jul 28 08:00:38 2022] GET /identity/v3/projects/ddc4c89a5c5a4bfd80cc08fe59adeeec => generated 311 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 08:00:38.521730 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab5a6f8-8b22-4043-b550-03597e997095 None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:00:38.624869 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab5a6f8-8b22-4043-b550-03597e997095 None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:00:38.648257 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:00:38.661766 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf9ab55-2b93-4bd9-9134-acd29f77416e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:00:38.662394 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf9ab55-2b93-4bd9-9134-acd29f77416e None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:00:38.662664 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf9ab55-2b93-4bd9-9134-acd29f77416e None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:00:38.662930 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf9ab55-2b93-4bd9-9134-acd29f77416e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:00:38.663718 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cf9ab55-2b93-4bd9-9134-acd29f77416e None admin] RBAC: Adding query filter params (role.id=f28d669937b942878bcf6a9103012af9, scope.project.id=ddc4c89a5c5a4bfd80cc08fe59adeeec, user.id=2d52ce350c3d4880a86dad091eac8b91) {{(pid=80347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:00:38.664019 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cf9ab55-2b93-4bd9-9134-acd29f77416e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:00:38.665546 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cf9ab55-2b93-4bd9-9134-acd29f77416e None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:00:38.671624 dv-cinder-851351-1-smb devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 574/1117] 10.222.0.42 () {56 vars in 1374 bytes} [Thu Jul 28 08:00:38 2022] GET /identity/v3/role_assignments?user.id=2d52ce350c3d4880a86dad091eac8b91&scope.project.id=ddc4c89a5c5a4bfd80cc08fe59adeeec&role.id=f28d669937b942878bcf6a9103012af9 => generated 259 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 08:00:40.684407 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d100d64-8316-4767-a462-d1486701cfcd None None] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:00:40.685079 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d100d64-8316-4767-a462-d1486701cfcd None None] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:00:40.685079 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d100d64-8316-4767-a462-d1486701cfcd None None] PATH_INFO: `/` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:00:40.686409 dv-cinder-851351-1-smb devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 544/1118] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 08:00:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 08:00:40.693044 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e40ee78-2469-420d-b6b8-ad8bcadb570b None None] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:00:40.693665 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e40ee78-2469-420d-b6b8-ad8bcadb570b None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:00:40.693665 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e40ee78-2469-420d-b6b8-ad8bcadb570b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:00:40.714563 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.auth.core [None req-3e40ee78-2469-420d-b6b8-ad8bcadb570b None None] MFA Rules not processed for user `f0666d3a50644a7097367331c1ee1a68`. Rule list: `[]` (Enabled: `True`). {{(pid=80347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 08:00:40.716449 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-3e40ee78-2469-420d-b6b8-ad8bcadb570b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:00:40.806054 dv-cinder-851351-1-smb devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 575/1119] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 08:00:40 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 08:00:40.829260 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d100d64-8316-4767-a462-d1486701cfcd None None] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:00:40.902965 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=100 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:00:40.950847 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d100d64-8316-4767-a462-d1486701cfcd None None] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:00:40.998687 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab1abec8-5bc6-4582-9d92-4ee49eb1d302 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:00:40.999482 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1abec8-5bc6-4582-9d92-4ee49eb1d302 None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:00:40.999777 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1abec8-5bc6-4582-9d92-4ee49eb1d302 None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:00:41.000058 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1abec8-5bc6-4582-9d92-4ee49eb1d302 None admin] PATH_INFO: `/v3/roles/f28d669937b942878bcf6a9103012af9` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:00:41.001961 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab1abec8-5bc6-4582-9d92-4ee49eb1d302 None admin] RBAC: Authorizing `identity:get_role(role_id=f28d669937b942878bcf6a9103012af9)` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:00:41.003479 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab1abec8-5bc6-4582-9d92-4ee49eb1d302 None admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:00:41.005074 dv-cinder-851351-1-smb devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 545/1120] 10.222.0.42 () {56 vars in 1177 bytes} [Thu Jul 28 08:00:40 2022] GET /identity/v3/roles/f28d669937b942878bcf6a9103012af9 => generated 223 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 08:00:41.012256 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e40ee78-2469-420d-b6b8-ad8bcadb570b None None] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:00:41.123031 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e40ee78-2469-420d-b6b8-ad8bcadb570b None None] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:00:41.141146 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:00:41.161383 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d272380-9704-4988-af34-93e2cd66c823 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:00:41.162149 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d272380-9704-4988-af34-93e2cd66c823 None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:00:41.162523 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d272380-9704-4988-af34-93e2cd66c823 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:00:41.162916 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d272380-9704-4988-af34-93e2cd66c823 None admin] PATH_INFO: `/v3/users/2d52ce350c3d4880a86dad091eac8b91` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:00:41.164278 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d272380-9704-4988-af34-93e2cd66c823 None admin] RBAC: Authorizing `identity:get_user(user_id=2d52ce350c3d4880a86dad091eac8b91)` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:00:41.165959 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d272380-9704-4988-af34-93e2cd66c823 None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:00:41.167909 dv-cinder-851351-1-smb devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 576/1121] 10.222.0.42 () {56 vars in 1177 bytes} [Thu Jul 28 08:00:41 2022] GET /identity/v3/users/2d52ce350c3d4880a86dad091eac8b91 => generated 286 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:00:41.174653 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab1abec8-5bc6-4582-9d92-4ee49eb1d302 None admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:00:41.343862 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab1abec8-5bc6-4582-9d92-4ee49eb1d302 None admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:00:41.392983 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-622a266c-4ec1-4123-89ab-7919eb846df1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:00:41.393659 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622a266c-4ec1-4123-89ab-7919eb846df1 None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:00:41.393935 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622a266c-4ec1-4123-89ab-7919eb846df1 None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:00:41.394203 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622a266c-4ec1-4123-89ab-7919eb846df1 None admin] PATH_INFO: `/v3/projects/ddc4c89a5c5a4bfd80cc08fe59adeeec` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:00:41.395510 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-622a266c-4ec1-4123-89ab-7919eb846df1 None admin] RBAC: Authorizing `identity:get_project(project_id=ddc4c89a5c5a4bfd80cc08fe59adeeec)` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:00:41.397037 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-622a266c-4ec1-4123-89ab-7919eb846df1 None admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:00:41.398975 dv-cinder-851351-1-smb devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 546/1122] 10.222.0.42 () {56 vars in 1186 bytes} [Thu Jul 28 08:00:41 2022] GET /identity/v3/projects/ddc4c89a5c5a4bfd80cc08fe59adeeec => generated 311 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:00:41.405543 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d272380-9704-4988-af34-93e2cd66c823 None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:00:41.533898 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d272380-9704-4988-af34-93e2cd66c823 None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:00:41.577375 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99463c61-49fa-44b8-b43d-de4d41abc82f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:00:41.578439 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99463c61-49fa-44b8-b43d-de4d41abc82f None admin] REQUEST_METHOD: `PUT` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:00:41.578718 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99463c61-49fa-44b8-b43d-de4d41abc82f None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:00:41.578985 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99463c61-49fa-44b8-b43d-de4d41abc82f None admin] PATH_INFO: `/v3/projects/ddc4c89a5c5a4bfd80cc08fe59adeeec/users/2d52ce350c3d4880a86dad091eac8b91/roles/f28d669937b942878bcf6a9103012af9` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:00:41.581442 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99463c61-49fa-44b8-b43d-de4d41abc82f None admin] RBAC: Authorizing `identity:create_grant(project_id=ddc4c89a5c5a4bfd80cc08fe59adeeec, user_id=2d52ce350c3d4880a86dad091eac8b91, role_id=f28d669937b942878bcf6a9103012af9)` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:00:41.582933 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99463c61-49fa-44b8-b43d-de4d41abc82f None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:00:41.600819 dv-cinder-851351-1-smb devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 577/1123] 10.222.0.42 () {58 vars in 1439 bytes} [Thu Jul 28 08:00:41 2022] PUT /identity/v3/projects/ddc4c89a5c5a4bfd80cc08fe59adeeec/users/2d52ce350c3d4880a86dad091eac8b91/roles/f28d669937b942878bcf6a9103012af9 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 08:00:43.600073 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f20989-723a-4d1e-b824-802ed71555a1 None None] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:00:43.600631 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f20989-723a-4d1e-b824-802ed71555a1 None None] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:00:43.600631 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f20989-723a-4d1e-b824-802ed71555a1 None None] PATH_INFO: `/` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:00:43.602025 dv-cinder-851351-1-smb devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 547/1124] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 08:00:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 08:00:43.607405 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b57081a-7621-4ccf-9f53-48d1d635ed48 None None] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:00:43.607830 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b57081a-7621-4ccf-9f53-48d1d635ed48 None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:00:43.607953 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b57081a-7621-4ccf-9f53-48d1d635ed48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:00:43.626530 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.auth.core [None req-3b57081a-7621-4ccf-9f53-48d1d635ed48 None None] MFA Rules not processed for user `f0666d3a50644a7097367331c1ee1a68`. Rule list: `[]` (Enabled: `True`). {{(pid=80347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 08:00:43.627723 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-3b57081a-7621-4ccf-9f53-48d1d635ed48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:00:43.671200 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:00:43.699180 dv-cinder-851351-1-smb devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 578/1125] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 08:00:43 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 08:00:43.723220 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f20989-723a-4d1e-b824-802ed71555a1 None None] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:00:43.727003 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=100 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:00:43.834354 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f20989-723a-4d1e-b824-802ed71555a1 None None] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:00:43.871442 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3be9977-9003-4cc6-8ef1-c095bc36c283 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:00:43.871985 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3be9977-9003-4cc6-8ef1-c095bc36c283 None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:00:43.872274 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3be9977-9003-4cc6-8ef1-c095bc36c283 None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:00:43.872521 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3be9977-9003-4cc6-8ef1-c095bc36c283 None admin] PATH_INFO: `/v3/roles/f28d669937b942878bcf6a9103012af9` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:00:43.874027 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3be9977-9003-4cc6-8ef1-c095bc36c283 None admin] RBAC: Authorizing `identity:get_role(role_id=f28d669937b942878bcf6a9103012af9)` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:00:43.875409 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3be9977-9003-4cc6-8ef1-c095bc36c283 None admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:00:43.876844 dv-cinder-851351-1-smb devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 548/1126] 10.222.0.42 () {56 vars in 1177 bytes} [Thu Jul 28 08:00:43 2022] GET /identity/v3/roles/f28d669937b942878bcf6a9103012af9 => generated 223 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:00:43.882870 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b57081a-7621-4ccf-9f53-48d1d635ed48 None None] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:00:43.989277 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b57081a-7621-4ccf-9f53-48d1d635ed48 None None] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:00:44.024850 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0594d7ad-2e1d-44da-920c-b29bc20b0a4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:00:44.025491 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0594d7ad-2e1d-44da-920c-b29bc20b0a4e None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:00:44.025764 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0594d7ad-2e1d-44da-920c-b29bc20b0a4e None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:00:44.026032 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0594d7ad-2e1d-44da-920c-b29bc20b0a4e None admin] PATH_INFO: `/v3/users/2d52ce350c3d4880a86dad091eac8b91` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:00:44.027250 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0594d7ad-2e1d-44da-920c-b29bc20b0a4e None admin] RBAC: Authorizing `identity:get_user(user_id=2d52ce350c3d4880a86dad091eac8b91)` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:00:44.028701 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0594d7ad-2e1d-44da-920c-b29bc20b0a4e None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:00:44.030338 dv-cinder-851351-1-smb devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 579/1127] 10.222.0.42 () {56 vars in 1177 bytes} [Thu Jul 28 08:00:43 2022] GET /identity/v3/users/2d52ce350c3d4880a86dad091eac8b91 => generated 286 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 08:00:44.036437 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3be9977-9003-4cc6-8ef1-c095bc36c283 None admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:00:44.110399 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=100 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:00:44.142196 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3be9977-9003-4cc6-8ef1-c095bc36c283 None admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:00:44.178258 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd167542-f24f-433e-8ef0-130bbabc641a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:00:44.178883 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd167542-f24f-433e-8ef0-130bbabc641a None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:00:44.179157 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd167542-f24f-433e-8ef0-130bbabc641a None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:00:44.179424 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd167542-f24f-433e-8ef0-130bbabc641a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:00:44.252174 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd167542-f24f-433e-8ef0-130bbabc641a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:00:44.253707 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd167542-f24f-433e-8ef0-130bbabc641a None admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:00:44.324066 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=100 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:00:44.357981 dv-cinder-851351-1-smb devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 549/1128] 10.222.0.42 () {58 vars in 1282 bytes} [Thu Jul 28 08:00:44 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 28 08:00:44.367318 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0594d7ad-2e1d-44da-920c-b29bc20b0a4e None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:00:44.411462 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:00:44.469025 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0594d7ad-2e1d-44da-920c-b29bc20b0a4e None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:00:44.505043 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-596ef364-8c5a-4e3a-929a-aae1d543bfea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:00:44.505692 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596ef364-8c5a-4e3a-929a-aae1d543bfea None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:00:44.505940 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596ef364-8c5a-4e3a-929a-aae1d543bfea None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:00:44.506200 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596ef364-8c5a-4e3a-929a-aae1d543bfea None admin] PATH_INFO: `/v3/projects/ddc4c89a5c5a4bfd80cc08fe59adeeec` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:00:44.507368 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-596ef364-8c5a-4e3a-929a-aae1d543bfea None admin] RBAC: Authorizing `identity:get_project(project_id=ddc4c89a5c5a4bfd80cc08fe59adeeec)` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:00:44.508879 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-596ef364-8c5a-4e3a-929a-aae1d543bfea None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:00:44.510554 dv-cinder-851351-1-smb devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 580/1129] 10.222.0.42 () {56 vars in 1186 bytes} [Thu Jul 28 08:00:44 2022] GET /identity/v3/projects/ddc4c89a5c5a4bfd80cc08fe59adeeec => generated 311 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:00:44.517035 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd167542-f24f-433e-8ef0-130bbabc641a None admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:00:44.622520 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd167542-f24f-433e-8ef0-130bbabc641a None admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:00:44.658766 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9974f98b-ff85-4e5d-b114-59b9a2f00a65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:00:44.659395 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9974f98b-ff85-4e5d-b114-59b9a2f00a65 None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:00:44.659667 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9974f98b-ff85-4e5d-b114-59b9a2f00a65 None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:00:44.659933 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9974f98b-ff85-4e5d-b114-59b9a2f00a65 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:00:44.660750 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9974f98b-ff85-4e5d-b114-59b9a2f00a65 None admin] RBAC: Adding query filter params (role.id=f28d669937b942878bcf6a9103012af9, scope.project.id=ddc4c89a5c5a4bfd80cc08fe59adeeec, user.id=2d52ce350c3d4880a86dad091eac8b91) {{(pid=80348) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:00:44.661054 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9974f98b-ff85-4e5d-b114-59b9a2f00a65 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:00:44.662551 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9974f98b-ff85-4e5d-b114-59b9a2f00a65 None admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:00:44.671509 dv-cinder-851351-1-smb devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 550/1130] 10.222.0.42 () {56 vars in 1374 bytes} [Thu Jul 28 08:00:44 2022] GET /identity/v3/role_assignments?user.id=2d52ce350c3d4880a86dad091eac8b91&scope.project.id=ddc4c89a5c5a4bfd80cc08fe59adeeec&role.id=f28d669937b942878bcf6a9103012af9 => generated 608 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:00:46.669883 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44da7e0-6842-4727-8836-eef8012faf5e None None] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:00:46.670446 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44da7e0-6842-4727-8836-eef8012faf5e None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:00:46.670446 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44da7e0-6842-4727-8836-eef8012faf5e None None] PATH_INFO: `/` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:00:46.671771 dv-cinder-851351-1-smb devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 581/1131] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 08:00:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 08:00:46.677058 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd3b569-1b2a-4715-885b-b1b02b623285 None None] REQUEST_METHOD: `POST` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:00:46.677500 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd3b569-1b2a-4715-885b-b1b02b623285 None None] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:00:46.677592 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd3b569-1b2a-4715-885b-b1b02b623285 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:00:46.695904 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.auth.core [None req-cdd3b569-1b2a-4715-885b-b1b02b623285 None None] MFA Rules not processed for user `f0666d3a50644a7097367331c1ee1a68`. Rule list: `[]` (Enabled: `True`). {{(pid=80348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 08:00:46.697144 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.fernet_utils [None req-cdd3b569-1b2a-4715-885b-b1b02b623285 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:00:46.725850 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=100 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:00:46.774003 dv-cinder-851351-1-smb devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 551/1132] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 08:00:46 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 08:00:46.798992 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e44da7e0-6842-4727-8836-eef8012faf5e None None] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:00:46.916096 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e44da7e0-6842-4727-8836-eef8012faf5e None None] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:00:46.927202 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:00:46.955873 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c3ebef-61d8-4ec0-bb3e-1394a424b2ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:00:46.956519 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c3ebef-61d8-4ec0-bb3e-1394a424b2ff None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:00:46.956838 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c3ebef-61d8-4ec0-bb3e-1394a424b2ff None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:00:46.957105 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c3ebef-61d8-4ec0-bb3e-1394a424b2ff None admin] PATH_INFO: `/v3/domains/default` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:00:46.958401 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14c3ebef-61d8-4ec0-bb3e-1394a424b2ff None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:00:46.959841 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14c3ebef-61d8-4ec0-bb3e-1394a424b2ff None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:00:46.961479 dv-cinder-851351-1-smb devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 582/1133] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 08:00:46 2022] GET /identity/v3/domains/default => generated 199 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:00:46.967775 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd3b569-1b2a-4715-885b-b1b02b623285 None None] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:00:47.075469 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd3b569-1b2a-4715-885b-b1b02b623285 None None] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:00:47.110248 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75950c58-ae1a-486c-940f-9c2b758c6803 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:00:47.110876 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75950c58-ae1a-486c-940f-9c2b758c6803 None admin] REQUEST_METHOD: `POST` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:00:47.111145 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75950c58-ae1a-486c-940f-9c2b758c6803 None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:00:47.111419 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75950c58-ae1a-486c-940f-9c2b758c6803 None admin] PATH_INFO: `/v3/projects` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:00:47.112102 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75950c58-ae1a-486c-940f-9c2b758c6803 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:00:47.113577 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75950c58-ae1a-486c-940f-9c2b758c6803 None admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:00:47.143582 dv-cinder-851351-1-smb devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 552/1134] 10.222.0.42 () {60 vars in 1141 bytes} [Thu Jul 28 08:00:46 2022] POST /identity/v3/projects => generated 311 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 08:00:49.156546 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac851e9a-1c55-4898-844e-a66c7bac43e4 None None] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:00:49.157401 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac851e9a-1c55-4898-844e-a66c7bac43e4 None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:00:49.157401 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac851e9a-1c55-4898-844e-a66c7bac43e4 None None] PATH_INFO: `/` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:00:49.158734 dv-cinder-851351-1-smb devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 583/1135] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 08:00:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 08:00:49.165078 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3fa2d09-1b62-480f-a5ce-19444ce90e46 None None] REQUEST_METHOD: `POST` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:00:49.165901 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3fa2d09-1b62-480f-a5ce-19444ce90e46 None None] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:00:49.165901 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3fa2d09-1b62-480f-a5ce-19444ce90e46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:00:49.186094 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.auth.core [None req-f3fa2d09-1b62-480f-a5ce-19444ce90e46 None None] MFA Rules not processed for user `f0666d3a50644a7097367331c1ee1a68`. Rule list: `[]` (Enabled: `True`). {{(pid=80348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 08:00:49.187313 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.fernet_utils [None req-f3fa2d09-1b62-480f-a5ce-19444ce90e46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:00:49.199355 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:00:49.258899 dv-cinder-851351-1-smb devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 553/1136] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 08:00:49 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 08:00:49.283485 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac851e9a-1c55-4898-844e-a66c7bac43e4 None None] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:00:49.395407 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac851e9a-1c55-4898-844e-a66c7bac43e4 None None] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:00:49.439506 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01035fe-7d5b-4c5b-9e13-9ba2befc643d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:00:49.440076 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01035fe-7d5b-4c5b-9e13-9ba2befc643d None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:00:49.440348 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01035fe-7d5b-4c5b-9e13-9ba2befc643d None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:00:49.440597 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01035fe-7d5b-4c5b-9e13-9ba2befc643d None admin] PATH_INFO: `/v3/domains/default` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:00:49.441972 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d01035fe-7d5b-4c5b-9e13-9ba2befc643d None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:00:49.443458 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d01035fe-7d5b-4c5b-9e13-9ba2befc643d None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:00:49.445213 dv-cinder-851351-1-smb devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 584/1137] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 08:00:49 2022] GET /identity/v3/domains/default => generated 199 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:00:49.451422 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3fa2d09-1b62-480f-a5ce-19444ce90e46 None None] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:00:49.557879 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3fa2d09-1b62-480f-a5ce-19444ce90e46 None None] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:00:49.592455 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8332067d-7048-459d-94e9-69de2b94830e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:00:49.593149 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8332067d-7048-459d-94e9-69de2b94830e None admin] REQUEST_METHOD: `POST` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:00:49.593462 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8332067d-7048-459d-94e9-69de2b94830e None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:00:49.593772 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8332067d-7048-459d-94e9-69de2b94830e None admin] PATH_INFO: `/v3/users` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:00:49.594481 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8332067d-7048-459d-94e9-69de2b94830e None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:00:49.595980 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8332067d-7048-459d-94e9-69de2b94830e None admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:00:49.618851 dv-cinder-851351-1-smb devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 554/1138] 10.222.0.42 () {60 vars in 1132 bytes} [Thu Jul 28 08:00:49 2022] POST /identity/v3/users => generated 286 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 28 08:00:51.645734 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed03ff3b-9253-4c5e-a51f-c72c341e5bcb None None] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:00:51.646302 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed03ff3b-9253-4c5e-a51f-c72c341e5bcb None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:00:51.646302 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed03ff3b-9253-4c5e-a51f-c72c341e5bcb None None] PATH_INFO: `/` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:00:51.647622 dv-cinder-851351-1-smb devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 585/1139] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 08:00:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 08:00:51.653327 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae94738-e480-4df7-be54-d1917802e471 None None] REQUEST_METHOD: `POST` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:00:51.653774 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae94738-e480-4df7-be54-d1917802e471 None None] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:00:51.655140 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae94738-e480-4df7-be54-d1917802e471 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:00:51.661761 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:00:51.675667 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.auth.core [None req-5ae94738-e480-4df7-be54-d1917802e471 None None] MFA Rules not processed for user `f0666d3a50644a7097367331c1ee1a68`. Rule list: `[]` (Enabled: `True`). {{(pid=80348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 08:00:51.676930 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.fernet_utils [None req-5ae94738-e480-4df7-be54-d1917802e471 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:00:51.745869 dv-cinder-851351-1-smb devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 555/1140] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 08:00:51 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 08:00:51.769680 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed03ff3b-9253-4c5e-a51f-c72c341e5bcb None None] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:00:51.826704 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:00:51.883065 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed03ff3b-9253-4c5e-a51f-c72c341e5bcb None None] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:00:51.918233 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cbea7bb-869e-4242-a1fd-ec7a71b527b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:00:51.918836 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbea7bb-869e-4242-a1fd-ec7a71b527b2 None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:00:51.919109 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbea7bb-869e-4242-a1fd-ec7a71b527b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:00:51.919375 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbea7bb-869e-4242-a1fd-ec7a71b527b2 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:00:51.930423 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cbea7bb-869e-4242-a1fd-ec7a71b527b2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 08:00:51.935388 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application [None req-4cbea7bb-869e-4242-a1fd-ec7a71b527b2 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 08:00:51.935388 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:00:51.935388 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:00:51.935388 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:00:51.935388 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:00:51.935388 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:00:51.935388 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:00:51.935388 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:00:51.935388 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:00:51.935388 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:00:51.935388 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:00:51.935388 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:00:51.935388 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 08:00:51.935388 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 08:00:51.935388 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 08:00:51.935388 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 08:00:51.936530 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 08:00:51.936530 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 08:00:51.936530 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 08:00:51.936530 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 08:00:51.936530 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:00:51.936530 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:00:51.936530 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:00:51.936530 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:00:51.936530 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:00:51.936530 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:00:51.936530 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:00:51.936530 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application with Lock( Jul 28 08:00:51.936530 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:00:51.936530 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:00:51.936530 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:00:51.936530 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:00:51.937696 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:00:51.937696 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:00:51.937696 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:00:51.937696 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:00:51.937696 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 08:00:51.937696 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 08:00:51.937696 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 08:00:51.937696 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 08:00:51.937696 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 08:00:51.937696 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 08:00:51.937696 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 08:00:51.937696 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application Jul 28 08:00:51.937696 dv-cinder-851351-1-smb devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 586/1141] 10.222.0.42 () {56 vars in 1096 bytes} [Thu Jul 28 08:00:51 2022] GET /identity/v3/roles/admin => generated 83 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:00:51.942833 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae94738-e480-4df7-be54-d1917802e471 None None] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:00:52.048563 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae94738-e480-4df7-be54-d1917802e471 None None] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:00:52.079728 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=100 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:00:52.085972 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a083f8-9723-4fa7-933e-4aab74f6515b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:00:52.086849 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a083f8-9723-4fa7-933e-4aab74f6515b None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:00:52.087270 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a083f8-9723-4fa7-933e-4aab74f6515b None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:00:52.087558 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a083f8-9723-4fa7-933e-4aab74f6515b None admin] PATH_INFO: `/v3/roles` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:00:52.088294 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95a083f8-9723-4fa7-933e-4aab74f6515b None admin] RBAC: Adding query filter params (name=admin) {{(pid=80348) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:00:52.088594 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95a083f8-9723-4fa7-933e-4aab74f6515b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:00:52.090014 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95a083f8-9723-4fa7-933e-4aab74f6515b None admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:00:52.098893 dv-cinder-851351-1-smb devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 556/1142] 10.222.0.42 () {56 vars in 1099 bytes} [Thu Jul 28 08:00:51 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:00:52.106414 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cbea7bb-869e-4242-a1fd-ec7a71b527b2 None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:00:52.218511 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cbea7bb-869e-4242-a1fd-ec7a71b527b2 None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:00:52.226435 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:00:52.253496 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0cc8ed-fd0d-4340-ba46-464b82313267 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:00:52.254135 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0cc8ed-fd0d-4340-ba46-464b82313267 None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:00:52.254405 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0cc8ed-fd0d-4340-ba46-464b82313267 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:00:52.254670 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0cc8ed-fd0d-4340-ba46-464b82313267 None admin] PATH_INFO: `/v3/users/3435e911954b4ba2a3e3d0e2c83fae73` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:00:52.268986 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e0cc8ed-fd0d-4340-ba46-464b82313267 None admin] RBAC: Authorizing `identity:get_user(user_id=3435e911954b4ba2a3e3d0e2c83fae73)` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:00:52.270435 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e0cc8ed-fd0d-4340-ba46-464b82313267 None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:00:52.272151 dv-cinder-851351-1-smb devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 587/1143] 10.222.0.42 () {56 vars in 1177 bytes} [Thu Jul 28 08:00:52 2022] GET /identity/v3/users/3435e911954b4ba2a3e3d0e2c83fae73 => generated 286 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:00:52.278253 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a083f8-9723-4fa7-933e-4aab74f6515b None admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:00:52.392984 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a083f8-9723-4fa7-933e-4aab74f6515b None admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:00:52.429369 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ecc216-2482-4b6a-b7b8-f89da7b88908 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:00:52.430182 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ecc216-2482-4b6a-b7b8-f89da7b88908 None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:00:52.430469 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ecc216-2482-4b6a-b7b8-f89da7b88908 None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:00:52.430726 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ecc216-2482-4b6a-b7b8-f89da7b88908 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:00:52.501162 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=100 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:00:52.510206 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69ecc216-2482-4b6a-b7b8-f89da7b88908 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:00:52.511692 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69ecc216-2482-4b6a-b7b8-f89da7b88908 None admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:00:52.617710 dv-cinder-851351-1-smb devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 557/1144] 10.222.0.42 () {58 vars in 1282 bytes} [Thu Jul 28 08:00:52 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 340 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 28 08:00:52.624305 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0cc8ed-fd0d-4340-ba46-464b82313267 None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:00:52.741570 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0cc8ed-fd0d-4340-ba46-464b82313267 None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:00:52.784591 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e903d768-0a80-49d6-87d4-27366a6e0ad1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:00:52.785221 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e903d768-0a80-49d6-87d4-27366a6e0ad1 None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:00:52.785504 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e903d768-0a80-49d6-87d4-27366a6e0ad1 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:00:52.785771 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e903d768-0a80-49d6-87d4-27366a6e0ad1 None admin] PATH_INFO: `/v3/projects/f30f3dc7166f49679e467f459dbc7e8b` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:00:52.787143 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e903d768-0a80-49d6-87d4-27366a6e0ad1 None admin] RBAC: Authorizing `identity:get_project(project_id=f30f3dc7166f49679e467f459dbc7e8b)` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:00:52.788710 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e903d768-0a80-49d6-87d4-27366a6e0ad1 None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:00:52.790637 dv-cinder-851351-1-smb devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 588/1145] 10.222.0.42 () {56 vars in 1186 bytes} [Thu Jul 28 08:00:52 2022] GET /identity/v3/projects/f30f3dc7166f49679e467f459dbc7e8b => generated 311 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:00:52.801299 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ecc216-2482-4b6a-b7b8-f89da7b88908 None admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:00:52.980456 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=100 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:00:52.992369 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ecc216-2482-4b6a-b7b8-f89da7b88908 None admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:00:53.062186 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceeab73b-f6e5-46e8-936f-627f48d735c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:00:53.063208 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceeab73b-f6e5-46e8-936f-627f48d735c2 None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:00:53.063691 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceeab73b-f6e5-46e8-936f-627f48d735c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:00:53.064169 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceeab73b-f6e5-46e8-936f-627f48d735c2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:00:53.065807 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceeab73b-f6e5-46e8-936f-627f48d735c2 None admin] RBAC: Adding query filter params (role.id=362bd71ac01249fb8fa635381993eec1, scope.project.id=f30f3dc7166f49679e467f459dbc7e8b, user.id=3435e911954b4ba2a3e3d0e2c83fae73) {{(pid=80348) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:00:53.066336 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceeab73b-f6e5-46e8-936f-627f48d735c2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:00:53.069301 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceeab73b-f6e5-46e8-936f-627f48d735c2 None admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:00:53.081119 dv-cinder-851351-1-smb devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 558/1146] 10.222.0.42 () {56 vars in 1374 bytes} [Thu Jul 28 08:00:52 2022] GET /identity/v3/role_assignments?user.id=3435e911954b4ba2a3e3d0e2c83fae73&scope.project.id=f30f3dc7166f49679e467f459dbc7e8b&role.id=362bd71ac01249fb8fa635381993eec1 => generated 259 bytes in 281 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:00:55.101642 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9828023a-7c43-4059-a9c1-22d71b020e03 None None] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:00:55.102257 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9828023a-7c43-4059-a9c1-22d71b020e03 None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:00:55.102395 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9828023a-7c43-4059-a9c1-22d71b020e03 None None] PATH_INFO: `/` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:00:55.103868 dv-cinder-851351-1-smb devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 589/1147] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 08:00:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 08:00:55.109610 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2413bc5b-1cbe-4dcf-9b7d-7b363efda637 None None] REQUEST_METHOD: `POST` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:00:55.110355 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2413bc5b-1cbe-4dcf-9b7d-7b363efda637 None None] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:00:55.110355 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2413bc5b-1cbe-4dcf-9b7d-7b363efda637 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:00:55.128841 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.auth.core [None req-2413bc5b-1cbe-4dcf-9b7d-7b363efda637 None None] MFA Rules not processed for user `f0666d3a50644a7097367331c1ee1a68`. Rule list: `[]` (Enabled: `True`). {{(pid=80348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 08:00:55.130059 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.fernet_utils [None req-2413bc5b-1cbe-4dcf-9b7d-7b363efda637 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:00:55.203947 dv-cinder-851351-1-smb devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 559/1148] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 08:00:55 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 08:00:55.226514 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9828023a-7c43-4059-a9c1-22d71b020e03 None None] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:00:55.261003 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:00:55.339465 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9828023a-7c43-4059-a9c1-22d71b020e03 None None] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:00:55.377795 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc59a10-6762-4586-bcbb-270a423c91dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:00:55.378348 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc59a10-6762-4586-bcbb-270a423c91dd None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:00:55.378626 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc59a10-6762-4586-bcbb-270a423c91dd None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:00:55.378895 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc59a10-6762-4586-bcbb-270a423c91dd None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:00:55.391379 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cc59a10-6762-4586-bcbb-270a423c91dd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 08:00:55.396533 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application [None req-3cc59a10-6762-4586-bcbb-270a423c91dd None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 08:00:55.396533 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:00:55.396533 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:00:55.396533 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:00:55.396533 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:00:55.396533 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:00:55.396533 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:00:55.396533 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:00:55.396533 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:00:55.396533 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:00:55.396533 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:00:55.396533 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:00:55.396533 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 08:00:55.396533 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 08:00:55.396533 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 08:00:55.396533 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 08:00:55.398174 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 08:00:55.398174 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 08:00:55.398174 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 08:00:55.398174 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 08:00:55.398174 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:00:55.398174 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:00:55.398174 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:00:55.398174 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:00:55.398174 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:00:55.398174 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:00:55.398174 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:00:55.398174 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application with Lock( Jul 28 08:00:55.398174 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:00:55.398174 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:00:55.398174 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:00:55.398174 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:00:55.399117 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:00:55.399117 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:00:55.399117 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:00:55.399117 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:00:55.399117 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 08:00:55.399117 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 08:00:55.399117 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 08:00:55.399117 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 08:00:55.399117 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 08:00:55.399117 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 08:00:55.399117 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 08:00:55.399117 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application Jul 28 08:00:55.399117 dv-cinder-851351-1-smb devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 590/1149] 10.222.0.42 () {56 vars in 1096 bytes} [Thu Jul 28 08:00:55 2022] GET /identity/v3/roles/admin => generated 83 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 08:00:55.408224 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2413bc5b-1cbe-4dcf-9b7d-7b363efda637 None None] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:00:55.537651 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=100 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:00:55.551002 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2413bc5b-1cbe-4dcf-9b7d-7b363efda637 None None] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:00:55.589270 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82dcefb3-c8d1-4571-b8e6-a159a76cebd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:00:55.589901 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82dcefb3-c8d1-4571-b8e6-a159a76cebd6 None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:00:55.590179 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82dcefb3-c8d1-4571-b8e6-a159a76cebd6 None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:00:55.590448 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82dcefb3-c8d1-4571-b8e6-a159a76cebd6 None admin] PATH_INFO: `/v3/roles` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:00:55.591181 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82dcefb3-c8d1-4571-b8e6-a159a76cebd6 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80348) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:00:55.591486 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82dcefb3-c8d1-4571-b8e6-a159a76cebd6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:00:55.592908 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82dcefb3-c8d1-4571-b8e6-a159a76cebd6 None admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:00:55.602317 dv-cinder-851351-1-smb devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 560/1150] 10.222.0.42 () {56 vars in 1099 bytes} [Thu Jul 28 08:00:55 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:00:55.608602 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc59a10-6762-4586-bcbb-270a423c91dd None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:00:55.707276 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:00:55.718124 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc59a10-6762-4586-bcbb-270a423c91dd None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:00:55.757019 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf65e16-aaff-4cb4-850a-4716eb204cf5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:00:55.757727 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf65e16-aaff-4cb4-850a-4716eb204cf5 None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:00:55.758013 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf65e16-aaff-4cb4-850a-4716eb204cf5 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:00:55.758287 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf65e16-aaff-4cb4-850a-4716eb204cf5 None admin] PATH_INFO: `/v3/users/3435e911954b4ba2a3e3d0e2c83fae73` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:00:55.759564 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cf65e16-aaff-4cb4-850a-4716eb204cf5 None admin] RBAC: Authorizing `identity:get_user(user_id=3435e911954b4ba2a3e3d0e2c83fae73)` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:00:55.761036 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cf65e16-aaff-4cb4-850a-4716eb204cf5 None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:00:55.762691 dv-cinder-851351-1-smb devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 591/1151] 10.222.0.42 () {56 vars in 1177 bytes} [Thu Jul 28 08:00:55 2022] GET /identity/v3/users/3435e911954b4ba2a3e3d0e2c83fae73 => generated 286 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:00:55.769104 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82dcefb3-c8d1-4571-b8e6-a159a76cebd6 None admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:00:55.889603 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82dcefb3-c8d1-4571-b8e6-a159a76cebd6 None admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:00:55.936194 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-325a2b3c-021e-428b-9696-09c00a7608ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:00:55.936883 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325a2b3c-021e-428b-9696-09c00a7608ec None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:00:55.937154 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325a2b3c-021e-428b-9696-09c00a7608ec None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:00:55.937421 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325a2b3c-021e-428b-9696-09c00a7608ec None admin] PATH_INFO: `/v3/projects/f30f3dc7166f49679e467f459dbc7e8b` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:00:55.938620 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-325a2b3c-021e-428b-9696-09c00a7608ec None admin] RBAC: Authorizing `identity:get_project(project_id=f30f3dc7166f49679e467f459dbc7e8b)` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:00:55.940059 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-325a2b3c-021e-428b-9696-09c00a7608ec None admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:00:55.941782 dv-cinder-851351-1-smb devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 561/1152] 10.222.0.42 () {56 vars in 1186 bytes} [Thu Jul 28 08:00:55 2022] GET /identity/v3/projects/f30f3dc7166f49679e467f459dbc7e8b => generated 311 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:00:55.948436 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf65e16-aaff-4cb4-850a-4716eb204cf5 None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:00:56.056302 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf65e16-aaff-4cb4-850a-4716eb204cf5 None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:00:56.093502 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91fd5000-a6b0-444b-8e3e-e719dce4190f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:00:56.094229 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91fd5000-a6b0-444b-8e3e-e719dce4190f None admin] REQUEST_METHOD: `PUT` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:00:56.094506 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91fd5000-a6b0-444b-8e3e-e719dce4190f None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:00:56.094781 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91fd5000-a6b0-444b-8e3e-e719dce4190f None admin] PATH_INFO: `/v3/projects/f30f3dc7166f49679e467f459dbc7e8b/users/3435e911954b4ba2a3e3d0e2c83fae73/roles/362bd71ac01249fb8fa635381993eec1` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:00:56.096950 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91fd5000-a6b0-444b-8e3e-e719dce4190f None admin] RBAC: Authorizing `identity:create_grant(project_id=f30f3dc7166f49679e467f459dbc7e8b, user_id=3435e911954b4ba2a3e3d0e2c83fae73, role_id=362bd71ac01249fb8fa635381993eec1)` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:00:56.098433 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91fd5000-a6b0-444b-8e3e-e719dce4190f None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:00:56.113904 dv-cinder-851351-1-smb devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 592/1153] 10.222.0.42 () {58 vars in 1439 bytes} [Thu Jul 28 08:00:55 2022] PUT /identity/v3/projects/f30f3dc7166f49679e467f459dbc7e8b/users/3435e911954b4ba2a3e3d0e2c83fae73/roles/362bd71ac01249fb8fa635381993eec1 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 28 08:00:58.138244 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca84b6b-b84c-4065-a59f-a6e0b8a8d242 None None] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:00:58.138861 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca84b6b-b84c-4065-a59f-a6e0b8a8d242 None None] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:00:58.138861 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca84b6b-b84c-4065-a59f-a6e0b8a8d242 None None] PATH_INFO: `/` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:00:58.140410 dv-cinder-851351-1-smb devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 562/1154] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 08:00:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 08:00:58.146927 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730cfe68-ddca-4f6f-9878-f41cda960371 None None] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:00:58.147576 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730cfe68-ddca-4f6f-9878-f41cda960371 None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:00:58.147576 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730cfe68-ddca-4f6f-9878-f41cda960371 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:00:58.173648 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.auth.core [None req-730cfe68-ddca-4f6f-9878-f41cda960371 None None] MFA Rules not processed for user `f0666d3a50644a7097367331c1ee1a68`. Rule list: `[]` (Enabled: `True`). {{(pid=80347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 08:00:58.175593 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-730cfe68-ddca-4f6f-9878-f41cda960371 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:00:58.202283 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:00:58.294368 dv-cinder-851351-1-smb devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 593/1155] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 08:00:58 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 28 08:00:58.335134 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca84b6b-b84c-4065-a59f-a6e0b8a8d242 None None] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:00:58.368620 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=100 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:00:58.471588 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca84b6b-b84c-4065-a59f-a6e0b8a8d242 None None] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:00:58.511483 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392705a5-ea82-4d94-b10f-9e29588e6cae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:00:58.512135 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392705a5-ea82-4d94-b10f-9e29588e6cae None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:00:58.512411 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392705a5-ea82-4d94-b10f-9e29588e6cae None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:00:58.512713 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392705a5-ea82-4d94-b10f-9e29588e6cae None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:00:58.525780 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-392705a5-ea82-4d94-b10f-9e29588e6cae None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 08:00:58.530919 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application [None req-392705a5-ea82-4d94-b10f-9e29588e6cae None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 08:00:58.530919 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:00:58.530919 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:00:58.530919 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:00:58.530919 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:00:58.530919 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:00:58.530919 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:00:58.530919 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:00:58.530919 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:00:58.530919 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:00:58.530919 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:00:58.530919 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:00:58.530919 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 08:00:58.530919 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 08:00:58.530919 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 08:00:58.530919 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 08:00:58.532719 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 08:00:58.532719 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 08:00:58.532719 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 08:00:58.532719 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 08:00:58.532719 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:00:58.532719 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:00:58.532719 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:00:58.532719 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:00:58.532719 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:00:58.532719 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:00:58.532719 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:00:58.532719 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application with Lock( Jul 28 08:00:58.532719 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:00:58.532719 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:00:58.532719 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:00:58.532719 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:00:58.534571 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:00:58.534571 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:00:58.534571 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:00:58.534571 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:00:58.534571 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 08:00:58.534571 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 08:00:58.534571 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 08:00:58.534571 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 08:00:58.534571 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 08:00:58.534571 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 08:00:58.534571 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 08:00:58.534571 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application Jul 28 08:00:58.534571 dv-cinder-851351-1-smb devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 563/1156] 10.222.0.42 () {56 vars in 1096 bytes} [Thu Jul 28 08:00:58 2022] GET /identity/v3/roles/admin => generated 83 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:00:58.540960 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-730cfe68-ddca-4f6f-9878-f41cda960371 None None] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:00:58.662244 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-730cfe68-ddca-4f6f-9878-f41cda960371 None None] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:00:58.699860 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b8d2214-9c64-4a4f-9983-9a0212dc910a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:00:58.700597 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8d2214-9c64-4a4f-9983-9a0212dc910a None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:00:58.700969 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8d2214-9c64-4a4f-9983-9a0212dc910a None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:00:58.701355 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8d2214-9c64-4a4f-9983-9a0212dc910a None admin] PATH_INFO: `/v3/roles` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:00:58.702145 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b8d2214-9c64-4a4f-9983-9a0212dc910a None admin] RBAC: Adding query filter params (name=admin) {{(pid=80347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:00:58.702501 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b8d2214-9c64-4a4f-9983-9a0212dc910a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:00:58.704306 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b8d2214-9c64-4a4f-9983-9a0212dc910a None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:00:58.714437 dv-cinder-851351-1-smb devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 594/1157] 10.222.0.42 () {56 vars in 1099 bytes} [Thu Jul 28 08:00:58 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:00:58.721379 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392705a5-ea82-4d94-b10f-9e29588e6cae None admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:00:58.833257 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=100 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:00:58.858639 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392705a5-ea82-4d94-b10f-9e29588e6cae None admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:00:58.899428 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc2ad2e-2245-4fc9-b2ea-a1be4d530e7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:00:58.900150 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc2ad2e-2245-4fc9-b2ea-a1be4d530e7d None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:00:58.900481 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc2ad2e-2245-4fc9-b2ea-a1be4d530e7d None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:00:58.900890 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc2ad2e-2245-4fc9-b2ea-a1be4d530e7d None admin] PATH_INFO: `/v3/users/3435e911954b4ba2a3e3d0e2c83fae73` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:00:58.902265 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fc2ad2e-2245-4fc9-b2ea-a1be4d530e7d None admin] RBAC: Authorizing `identity:get_user(user_id=3435e911954b4ba2a3e3d0e2c83fae73)` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:00:58.903786 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fc2ad2e-2245-4fc9-b2ea-a1be4d530e7d None admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:00:58.905560 dv-cinder-851351-1-smb devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 564/1158] 10.222.0.42 () {56 vars in 1177 bytes} [Thu Jul 28 08:00:58 2022] GET /identity/v3/users/3435e911954b4ba2a3e3d0e2c83fae73 => generated 286 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:00:58.911969 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b8d2214-9c64-4a4f-9983-9a0212dc910a None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:00:58.929859 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:00:59.083941 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b8d2214-9c64-4a4f-9983-9a0212dc910a None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:00:59.145837 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fde7bb2-5350-4331-b1f9-d1985cd2daa9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:00:59.146867 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fde7bb2-5350-4331-b1f9-d1985cd2daa9 None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:00:59.147343 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fde7bb2-5350-4331-b1f9-d1985cd2daa9 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:00:59.147919 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fde7bb2-5350-4331-b1f9-d1985cd2daa9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:00:59.266668 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fde7bb2-5350-4331-b1f9-d1985cd2daa9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:00:59.269377 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fde7bb2-5350-4331-b1f9-d1985cd2daa9 None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:00:59.293538 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:00:59.392044 dv-cinder-851351-1-smb devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 595/1159] 10.222.0.42 () {58 vars in 1282 bytes} [Thu Jul 28 08:00:58 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 480 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 28 08:00:59.398659 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc2ad2e-2245-4fc9-b2ea-a1be4d530e7d None admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:00:59.510987 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc2ad2e-2245-4fc9-b2ea-a1be4d530e7d None admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:00:59.550925 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ce9de8-4a32-4658-8aa5-04060f8ccae9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:00:59.551608 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ce9de8-4a32-4658-8aa5-04060f8ccae9 None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:00:59.551888 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ce9de8-4a32-4658-8aa5-04060f8ccae9 None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:00:59.552159 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ce9de8-4a32-4658-8aa5-04060f8ccae9 None admin] PATH_INFO: `/v3/projects/f30f3dc7166f49679e467f459dbc7e8b` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:00:59.553612 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49ce9de8-4a32-4658-8aa5-04060f8ccae9 None admin] RBAC: Authorizing `identity:get_project(project_id=f30f3dc7166f49679e467f459dbc7e8b)` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:00:59.555188 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49ce9de8-4a32-4658-8aa5-04060f8ccae9 None admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:00:59.557098 dv-cinder-851351-1-smb devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 565/1160] 10.222.0.42 () {56 vars in 1186 bytes} [Thu Jul 28 08:00:59 2022] GET /identity/v3/projects/f30f3dc7166f49679e467f459dbc7e8b => generated 311 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:00:59.564007 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fde7bb2-5350-4331-b1f9-d1985cd2daa9 None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:00:59.672949 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fde7bb2-5350-4331-b1f9-d1985cd2daa9 None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:00:59.687853 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:00:59.712751 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea94321-9fcb-4f4b-95af-43960d569d1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:00:59.713394 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea94321-9fcb-4f4b-95af-43960d569d1a None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:00:59.713666 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea94321-9fcb-4f4b-95af-43960d569d1a None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:00:59.713933 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea94321-9fcb-4f4b-95af-43960d569d1a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:00:59.714738 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ea94321-9fcb-4f4b-95af-43960d569d1a None admin] RBAC: Adding query filter params (role.id=362bd71ac01249fb8fa635381993eec1, scope.project.id=f30f3dc7166f49679e467f459dbc7e8b, user.id=3435e911954b4ba2a3e3d0e2c83fae73) {{(pid=80347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:00:59.715041 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ea94321-9fcb-4f4b-95af-43960d569d1a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:00:59.716482 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ea94321-9fcb-4f4b-95af-43960d569d1a None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:00:59.723456 dv-cinder-851351-1-smb devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 596/1161] 10.222.0.42 () {56 vars in 1374 bytes} [Thu Jul 28 08:00:59 2022] GET /identity/v3/role_assignments?user.id=3435e911954b4ba2a3e3d0e2c83fae73&scope.project.id=f30f3dc7166f49679e467f459dbc7e8b&role.id=362bd71ac01249fb8fa635381993eec1 => generated 608 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:01:01.806766 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00c147e-a463-48f5-9399-27fb2622ac83 None None] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:01:01.807472 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00c147e-a463-48f5-9399-27fb2622ac83 None None] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:01:01.807472 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00c147e-a463-48f5-9399-27fb2622ac83 None None] PATH_INFO: `/` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:01:01.808848 dv-cinder-851351-1-smb devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 566/1162] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 08:01:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 08:01:01.815859 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10e4095-19d5-4b54-a294-64ea252194fa None None] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:01:01.816479 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10e4095-19d5-4b54-a294-64ea252194fa None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:01:01.816742 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10e4095-19d5-4b54-a294-64ea252194fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:01:01.847523 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.auth.core [None req-a10e4095-19d5-4b54-a294-64ea252194fa None None] MFA Rules not processed for user `f0666d3a50644a7097367331c1ee1a68`. Rule list: `[]` (Enabled: `True`). {{(pid=80347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 08:01:01.849706 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-a10e4095-19d5-4b54-a294-64ea252194fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:01:01.984233 dv-cinder-851351-1-smb devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 597/1163] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 08:01:01 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 08:01:02.009020 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a00c147e-a463-48f5-9399-27fb2622ac83 None None] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:01:02.028650 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=100 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:01:02.140773 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a00c147e-a463-48f5-9399-27fb2622ac83 None None] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:01:02.178221 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a346458c-0bbd-4621-88f0-3e70e321483a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:01:02.178903 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a346458c-0bbd-4621-88f0-3e70e321483a None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:01:02.179215 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a346458c-0bbd-4621-88f0-3e70e321483a None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:01:02.179588 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a346458c-0bbd-4621-88f0-3e70e321483a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:01:02.257718 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a346458c-0bbd-4621-88f0-3e70e321483a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:01:02.259208 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a346458c-0bbd-4621-88f0-3e70e321483a None admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:01:02.275614 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=100 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:01:02.403654 dv-cinder-851351-1-smb devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 567/1164] 10.222.0.42 () {58 vars in 1282 bytes} [Thu Jul 28 08:01:02 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 395 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 28 08:01:02.410720 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10e4095-19d5-4b54-a294-64ea252194fa None None] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:01:02.593867 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10e4095-19d5-4b54-a294-64ea252194fa None None] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:01:02.604571 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:01:02.636318 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c252f5-40a7-4b61-82d7-b5071cabac16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:01:02.637022 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c252f5-40a7-4b61-82d7-b5071cabac16 None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:01:02.637299 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c252f5-40a7-4b61-82d7-b5071cabac16 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:01:02.637570 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c252f5-40a7-4b61-82d7-b5071cabac16 None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:01:02.650658 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0c252f5-40a7-4b61-82d7-b5071cabac16 None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:01:02.652167 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0c252f5-40a7-4b61-82d7-b5071cabac16 None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:01:02.665551 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application [None req-c0c252f5-40a7-4b61-82d7-b5071cabac16 None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Jul 28 08:01:02.665551 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:01:02.665551 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Jul 28 08:01:02.665551 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Jul 28 08:01:02.665551 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 28 08:01:02.665551 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 28 08:01:02.665551 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 28 08:01:02.665551 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 28 08:01:02.665551 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. Jul 28 08:01:02.665551 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application Jul 28 08:01:02.665551 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 28 08:01:02.665551 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application Jul 28 08:01:02.665551 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:01:02.665551 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:01:02.665551 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:01:02.665551 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:01:02.665551 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:01:02.666719 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:01:02.666719 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:01:02.666719 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:01:02.666719 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:01:02.666719 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:01:02.666719 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:01:02.666719 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 08:01:02.666719 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 08:01:02.666719 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 08:01:02.666719 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 08:01:02.666719 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:01:02.666719 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:01:02.666719 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:01:02.666719 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:01:02.666719 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:01:02.666719 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:01:02.667652 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:01:02.667652 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application with Lock( Jul 28 08:01:02.667652 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:01:02.667652 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:01:02.667652 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:01:02.667652 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:01:02.667652 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:01:02.667652 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:01:02.667652 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:01:02.667652 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:01:02.667652 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Jul 28 08:01:02.667652 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 08:01:02.667652 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. Jul 28 08:01:02.667652 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application Jul 28 08:01:02.667652 dv-cinder-851351-1-smb devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 598/1165] 10.222.0.42 () {56 vars in 1117 bytes} [Thu Jul 28 08:01:02 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 257 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:01:02.673600 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a346458c-0bbd-4621-88f0-3e70e321483a None admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:01:02.786738 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a346458c-0bbd-4621-88f0-3e70e321483a None admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:01:02.802909 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=100 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:01:02.826274 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfdcee08-8977-4b1d-8d0c-c453f169fb2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:01:02.827011 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfdcee08-8977-4b1d-8d0c-c453f169fb2d None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:01:02.827196 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfdcee08-8977-4b1d-8d0c-c453f169fb2d None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:01:02.827497 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfdcee08-8977-4b1d-8d0c-c453f169fb2d None admin] PATH_INFO: `/v3/domains` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:01:02.828559 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfdcee08-8977-4b1d-8d0c-c453f169fb2d None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=80348) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:01:02.828975 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfdcee08-8977-4b1d-8d0c-c453f169fb2d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:01:02.830357 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfdcee08-8977-4b1d-8d0c-c453f169fb2d None admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:01:02.838956 dv-cinder-851351-1-smb devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 568/1166] 10.222.0.42 () {56 vars in 1115 bytes} [Thu Jul 28 08:01:02 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:01:04.906108 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1e4b95-f50e-43e0-8496-0536ee81f875 None None] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:01:04.906755 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1e4b95-f50e-43e0-8496-0536ee81f875 None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:01:04.906755 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1e4b95-f50e-43e0-8496-0536ee81f875 None None] PATH_INFO: `/` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:01:04.908020 dv-cinder-851351-1-smb devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 599/1167] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 08:01:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 08:01:04.914437 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b78d52-6d36-4867-acd4-6eb6734215fe None None] REQUEST_METHOD: `POST` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:01:04.915282 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b78d52-6d36-4867-acd4-6eb6734215fe None None] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:01:04.915282 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b78d52-6d36-4867-acd4-6eb6734215fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:01:04.935860 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.auth.core [None req-82b78d52-6d36-4867-acd4-6eb6734215fe None None] MFA Rules not processed for user `f0666d3a50644a7097367331c1ee1a68`. Rule list: `[]` (Enabled: `True`). {{(pid=80348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 08:01:04.937127 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.fernet_utils [None req-82b78d52-6d36-4867-acd4-6eb6734215fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:01:05.015462 dv-cinder-851351-1-smb devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 569/1168] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 08:01:04 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 28 08:01:05.038545 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e1e4b95-f50e-43e0-8496-0536ee81f875 None None] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:01:05.161933 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e1e4b95-f50e-43e0-8496-0536ee81f875 None None] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:01:05.198708 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6497c8e9-c168-48b5-ab48-1de21c287b52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:01:05.199349 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6497c8e9-c168-48b5-ab48-1de21c287b52 None admin] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:01:05.199629 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6497c8e9-c168-48b5-ab48-1de21c287b52 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:01:05.199903 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6497c8e9-c168-48b5-ab48-1de21c287b52 None admin] PATH_INFO: `/v3/domains` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:01:05.200627 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6497c8e9-c168-48b5-ab48-1de21c287b52 None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:01:05.202248 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6497c8e9-c168-48b5-ab48-1de21c287b52 None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:01:05.221292 dv-cinder-851351-1-smb devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 600/1169] 10.222.0.42 () {60 vars in 1138 bytes} [Thu Jul 28 08:01:05 2022] POST /identity/v3/domains => generated 267 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 08:01:07.282066 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dae0c08-edaa-4c87-8678-e42e790c554b None None] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:01:07.282966 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dae0c08-edaa-4c87-8678-e42e790c554b None None] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:01:07.282966 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dae0c08-edaa-4c87-8678-e42e790c554b None None] PATH_INFO: `/` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:01:07.284506 dv-cinder-851351-1-smb devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 570/1170] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 08:01:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 08:01:07.290583 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977e4f3f-96e5-4937-8887-ad814696e612 None None] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:01:07.291159 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977e4f3f-96e5-4937-8887-ad814696e612 None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:01:07.291159 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977e4f3f-96e5-4937-8887-ad814696e612 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:01:07.310839 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.auth.core [None req-977e4f3f-96e5-4937-8887-ad814696e612 None None] MFA Rules not processed for user `f0666d3a50644a7097367331c1ee1a68`. Rule list: `[]` (Enabled: `True`). {{(pid=80347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 08:01:07.312049 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-977e4f3f-96e5-4937-8887-ad814696e612 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:01:07.335186 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:01:07.388239 dv-cinder-851351-1-smb devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 601/1171] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 08:01:07 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 08:01:07.411619 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dae0c08-edaa-4c87-8678-e42e790c554b None None] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:01:07.527520 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dae0c08-edaa-4c87-8678-e42e790c554b None None] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:01:07.539170 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=100 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:01:07.566402 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b9b456a-46b6-434c-939c-36780f85f9b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:01:07.567055 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9b456a-46b6-434c-939c-36780f85f9b3 None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:01:07.567334 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9b456a-46b6-434c-939c-36780f85f9b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:01:07.567606 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9b456a-46b6-434c-939c-36780f85f9b3 None admin] PATH_INFO: `/v3/domains/372a464290524b20bd0fa05c674ee260` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:01:07.579659 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b9b456a-46b6-434c-939c-36780f85f9b3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=372a464290524b20bd0fa05c674ee260)` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:01:07.581182 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b9b456a-46b6-434c-939c-36780f85f9b3 None admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:01:07.582939 dv-cinder-851351-1-smb devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 571/1172] 10.222.0.42 () {56 vars in 1183 bytes} [Thu Jul 28 08:01:07 2022] GET /identity/v3/domains/372a464290524b20bd0fa05c674ee260 => generated 267 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:01:07.592136 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977e4f3f-96e5-4937-8887-ad814696e612 None None] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:01:07.701629 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977e4f3f-96e5-4937-8887-ad814696e612 None None] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:01:07.738515 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d5156c-835a-4971-a70b-4d32b0c03923 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:01:07.739151 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d5156c-835a-4971-a70b-4d32b0c03923 None admin] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:01:07.739429 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d5156c-835a-4971-a70b-4d32b0c03923 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:01:07.739694 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d5156c-835a-4971-a70b-4d32b0c03923 None admin] PATH_INFO: `/v3/projects` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:01:07.740397 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d5156c-835a-4971-a70b-4d32b0c03923 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:01:07.741969 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d5156c-835a-4971-a70b-4d32b0c03923 None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:01:07.769964 dv-cinder-851351-1-smb devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 602/1173] 10.222.0.42 () {60 vars in 1141 bytes} [Thu Jul 28 08:01:07 2022] POST /identity/v3/projects => generated 361 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 08:01:09.847691 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9162f3b-03c9-4001-9d38-7c88ab01c69c None None] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:01:09.848429 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9162f3b-03c9-4001-9d38-7c88ab01c69c None None] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:01:09.848429 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9162f3b-03c9-4001-9d38-7c88ab01c69c None None] PATH_INFO: `/` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:01:09.849628 dv-cinder-851351-1-smb devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 572/1174] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 08:01:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 08:01:09.855580 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ffb686-a81d-4c16-ae7e-9b3017bf7eae None None] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:01:09.856094 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ffb686-a81d-4c16-ae7e-9b3017bf7eae None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:01:09.856263 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ffb686-a81d-4c16-ae7e-9b3017bf7eae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:01:09.876098 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.auth.core [None req-41ffb686-a81d-4c16-ae7e-9b3017bf7eae None None] MFA Rules not processed for user `f0666d3a50644a7097367331c1ee1a68`. Rule list: `[]` (Enabled: `True`). {{(pid=80347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 08:01:09.877387 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-41ffb686-a81d-4c16-ae7e-9b3017bf7eae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:01:09.879672 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:01:09.953487 dv-cinder-851351-1-smb devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 603/1175] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 08:01:09 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 08:01:09.979715 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9162f3b-03c9-4001-9d38-7c88ab01c69c None None] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:01:10.094000 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9162f3b-03c9-4001-9d38-7c88ab01c69c None None] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:01:10.131066 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9765eb0-5ecc-42f8-a7d1-5dc1968f7000 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:01:10.131677 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9765eb0-5ecc-42f8-a7d1-5dc1968f7000 None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:01:10.132013 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9765eb0-5ecc-42f8-a7d1-5dc1968f7000 None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:01:10.132416 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9765eb0-5ecc-42f8-a7d1-5dc1968f7000 None admin] PATH_INFO: `/v3/domains/372a464290524b20bd0fa05c674ee260` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:01:10.133766 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9765eb0-5ecc-42f8-a7d1-5dc1968f7000 None admin] RBAC: Authorizing `identity:get_domain(domain_id=372a464290524b20bd0fa05c674ee260)` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:01:10.135278 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9765eb0-5ecc-42f8-a7d1-5dc1968f7000 None admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:01:10.136959 dv-cinder-851351-1-smb devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 573/1176] 10.222.0.42 () {56 vars in 1183 bytes} [Thu Jul 28 08:01:09 2022] GET /identity/v3/domains/372a464290524b20bd0fa05c674ee260 => generated 267 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:01:10.143152 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ffb686-a81d-4c16-ae7e-9b3017bf7eae None None] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:01:10.256493 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ffb686-a81d-4c16-ae7e-9b3017bf7eae None None] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:01:10.296448 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d077a48c-0a46-4010-913d-d2fad94997e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:01:10.297109 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d077a48c-0a46-4010-913d-d2fad94997e8 None admin] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:01:10.297382 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d077a48c-0a46-4010-913d-d2fad94997e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:01:10.297645 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d077a48c-0a46-4010-913d-d2fad94997e8 None admin] PATH_INFO: `/v3/users` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:01:10.298380 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d077a48c-0a46-4010-913d-d2fad94997e8 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:01:10.299873 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d077a48c-0a46-4010-913d-d2fad94997e8 None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:01:10.311644 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:01:10.326749 dv-cinder-851351-1-smb devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 604/1177] 10.222.0.42 () {60 vars in 1132 bytes} [Thu Jul 28 08:01:10 2022] POST /identity/v3/users => generated 311 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 08:01:12.403942 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf87979f-f21c-42dd-bd3e-63242dc409b0 None None] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:01:12.404568 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf87979f-f21c-42dd-bd3e-63242dc409b0 None None] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:01:12.404568 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf87979f-f21c-42dd-bd3e-63242dc409b0 None None] PATH_INFO: `/` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:01:12.406034 dv-cinder-851351-1-smb devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 574/1178] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 08:01:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 28 08:01:12.411784 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120b2639-a1df-4874-a600-f1c9ce2b377f None None] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:01:12.412334 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120b2639-a1df-4874-a600-f1c9ce2b377f None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:01:12.412334 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120b2639-a1df-4874-a600-f1c9ce2b377f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:01:12.432836 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.auth.core [None req-120b2639-a1df-4874-a600-f1c9ce2b377f None None] MFA Rules not processed for user `f0666d3a50644a7097367331c1ee1a68`. Rule list: `[]` (Enabled: `True`). {{(pid=80347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 08:01:12.434038 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-120b2639-a1df-4874-a600-f1c9ce2b377f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:01:12.511876 dv-cinder-851351-1-smb devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 605/1179] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 08:01:12 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 08:01:12.536181 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf87979f-f21c-42dd-bd3e-63242dc409b0 None None] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:01:12.576972 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=100 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:01:12.653268 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf87979f-f21c-42dd-bd3e-63242dc409b0 None None] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:01:12.693868 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1125f64-86d6-4050-a29f-0bcb1110f0e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:01:12.694476 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1125f64-86d6-4050-a29f-0bcb1110f0e9 None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:01:12.694792 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1125f64-86d6-4050-a29f-0bcb1110f0e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:01:12.695108 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1125f64-86d6-4050-a29f-0bcb1110f0e9 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:01:12.707827 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1125f64-86d6-4050-a29f-0bcb1110f0e9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 08:01:12.713122 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application [None req-f1125f64-86d6-4050-a29f-0bcb1110f0e9 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 08:01:12.713122 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:01:12.713122 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:01:12.713122 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:01:12.713122 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:01:12.713122 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:01:12.713122 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:01:12.713122 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:01:12.713122 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:01:12.713122 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:01:12.713122 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:01:12.713122 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:01:12.713122 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 08:01:12.713122 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 08:01:12.713122 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 08:01:12.713122 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 08:01:12.714862 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 08:01:12.714862 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 08:01:12.714862 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 08:01:12.714862 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 08:01:12.714862 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:01:12.714862 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:01:12.714862 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:01:12.714862 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:01:12.714862 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:01:12.714862 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:01:12.714862 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:01:12.714862 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application with Lock( Jul 28 08:01:12.714862 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:01:12.714862 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:01:12.714862 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:01:12.714862 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:01:12.716633 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:01:12.716633 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:01:12.716633 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:01:12.716633 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:01:12.716633 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 08:01:12.716633 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 08:01:12.716633 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 08:01:12.716633 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 08:01:12.716633 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 08:01:12.716633 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 08:01:12.716633 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 08:01:12.716633 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application Jul 28 08:01:12.716633 dv-cinder-851351-1-smb devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 575/1180] 10.222.0.42 () {56 vars in 1096 bytes} [Thu Jul 28 08:01:12 2022] GET /identity/v3/roles/admin => generated 83 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:01:12.722519 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-120b2639-a1df-4874-a600-f1c9ce2b377f None None] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:01:12.835553 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-120b2639-a1df-4874-a600-f1c9ce2b377f None None] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:01:12.862100 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:01:12.876158 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d8534d9-be99-4cb7-95a7-ca102cac13ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:01:12.876885 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8534d9-be99-4cb7-95a7-ca102cac13ea None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:01:12.877209 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8534d9-be99-4cb7-95a7-ca102cac13ea None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:01:12.877528 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8534d9-be99-4cb7-95a7-ca102cac13ea None admin] PATH_INFO: `/v3/roles` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:01:12.878308 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d8534d9-be99-4cb7-95a7-ca102cac13ea None admin] RBAC: Adding query filter params (name=admin) {{(pid=80347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:01:12.878654 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d8534d9-be99-4cb7-95a7-ca102cac13ea None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:01:12.880154 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d8534d9-be99-4cb7-95a7-ca102cac13ea None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:01:12.889901 dv-cinder-851351-1-smb devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 606/1181] 10.222.0.42 () {56 vars in 1099 bytes} [Thu Jul 28 08:01:12 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:01:12.899454 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1125f64-86d6-4050-a29f-0bcb1110f0e9 None admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:01:13.038083 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=100 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:01:13.045375 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1125f64-86d6-4050-a29f-0bcb1110f0e9 None admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:01:13.081596 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff8fc52c-7136-468a-b23c-c5ff0354edfd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:01:13.082265 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8fc52c-7136-468a-b23c-c5ff0354edfd None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:01:13.082542 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8fc52c-7136-468a-b23c-c5ff0354edfd None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:01:13.082810 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8fc52c-7136-468a-b23c-c5ff0354edfd None admin] PATH_INFO: `/v3/users/a396febef9234f59a2172dcf78a82561` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:01:13.097888 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff8fc52c-7136-468a-b23c-c5ff0354edfd None admin] RBAC: Authorizing `identity:get_user(user_id=a396febef9234f59a2172dcf78a82561)` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:01:13.099372 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff8fc52c-7136-468a-b23c-c5ff0354edfd None admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:01:13.101271 dv-cinder-851351-1-smb devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 576/1182] 10.222.0.42 () {56 vars in 1177 bytes} [Thu Jul 28 08:01:12 2022] GET /identity/v3/users/a396febef9234f59a2172dcf78a82561 => generated 311 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:01:13.107752 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d8534d9-be99-4cb7-95a7-ca102cac13ea None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:01:13.232866 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d8534d9-be99-4cb7-95a7-ca102cac13ea None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:01:13.275943 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2af4db-b7e8-478e-a8bd-985a787706f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:01:13.276654 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2af4db-b7e8-478e-a8bd-985a787706f8 None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:01:13.277016 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2af4db-b7e8-478e-a8bd-985a787706f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:01:13.277336 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2af4db-b7e8-478e-a8bd-985a787706f8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:01:13.340718 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:01:13.355937 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e2af4db-b7e8-478e-a8bd-985a787706f8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:01:13.357513 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e2af4db-b7e8-478e-a8bd-985a787706f8 None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:01:13.465564 dv-cinder-851351-1-smb devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 607/1183] 10.222.0.42 () {58 vars in 1282 bytes} [Thu Jul 28 08:01:13 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 358 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jul 28 08:01:13.472096 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff8fc52c-7136-468a-b23c-c5ff0354edfd None admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:01:13.580197 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff8fc52c-7136-468a-b23c-c5ff0354edfd None admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:01:13.621156 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca737ce-ccc2-4fc2-bb59-90f5e1d9a3c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:01:13.621872 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca737ce-ccc2-4fc2-bb59-90f5e1d9a3c2 None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:01:13.622242 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca737ce-ccc2-4fc2-bb59-90f5e1d9a3c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:01:13.622599 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca737ce-ccc2-4fc2-bb59-90f5e1d9a3c2 None admin] PATH_INFO: `/v3/projects/60df1ce5ea5b47378cd23cbeb52075ee` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:01:13.623967 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ca737ce-ccc2-4fc2-bb59-90f5e1d9a3c2 None admin] RBAC: Authorizing `identity:get_project(project_id=60df1ce5ea5b47378cd23cbeb52075ee)` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:01:13.625581 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ca737ce-ccc2-4fc2-bb59-90f5e1d9a3c2 None admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:01:13.627425 dv-cinder-851351-1-smb devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 577/1184] 10.222.0.42 () {56 vars in 1186 bytes} [Thu Jul 28 08:01:13 2022] GET /identity/v3/projects/60df1ce5ea5b47378cd23cbeb52075ee => generated 361 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 08:01:13.634072 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2af4db-b7e8-478e-a8bd-985a787706f8 None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:01:13.730743 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:01:13.747400 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2af4db-b7e8-478e-a8bd-985a787706f8 None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:01:13.794796 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50432e11-8a3e-4a94-8ce8-bf1a5874c848 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:01:13.795427 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50432e11-8a3e-4a94-8ce8-bf1a5874c848 None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:01:13.795697 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50432e11-8a3e-4a94-8ce8-bf1a5874c848 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:01:13.795948 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50432e11-8a3e-4a94-8ce8-bf1a5874c848 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:01:13.796782 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50432e11-8a3e-4a94-8ce8-bf1a5874c848 None admin] RBAC: Adding query filter params (role.id=362bd71ac01249fb8fa635381993eec1, scope.project.id=60df1ce5ea5b47378cd23cbeb52075ee, user.id=a396febef9234f59a2172dcf78a82561) {{(pid=80347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:01:13.797088 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50432e11-8a3e-4a94-8ce8-bf1a5874c848 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:01:13.798534 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50432e11-8a3e-4a94-8ce8-bf1a5874c848 None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:01:13.804814 dv-cinder-851351-1-smb devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 608/1185] 10.222.0.42 () {56 vars in 1374 bytes} [Thu Jul 28 08:01:13 2022] GET /identity/v3/role_assignments?user.id=a396febef9234f59a2172dcf78a82561&scope.project.id=60df1ce5ea5b47378cd23cbeb52075ee&role.id=362bd71ac01249fb8fa635381993eec1 => generated 259 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:01:15.844651 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681a7866-3a74-41ea-bae8-19c16fe8dbf1 None None] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:01:15.845260 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681a7866-3a74-41ea-bae8-19c16fe8dbf1 None None] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:01:15.845260 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681a7866-3a74-41ea-bae8-19c16fe8dbf1 None None] PATH_INFO: `/` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:01:15.846634 dv-cinder-851351-1-smb devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 578/1186] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 08:01:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 08:01:15.853159 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255dd2be-7e75-476f-b122-271f636ad818 None None] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:01:15.853793 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255dd2be-7e75-476f-b122-271f636ad818 None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:01:15.853793 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255dd2be-7e75-476f-b122-271f636ad818 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:01:15.876568 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.auth.core [None req-255dd2be-7e75-476f-b122-271f636ad818 None None] MFA Rules not processed for user `f0666d3a50644a7097367331c1ee1a68`. Rule list: `[]` (Enabled: `True`). {{(pid=80347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 08:01:15.877881 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-255dd2be-7e75-476f-b122-271f636ad818 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:01:15.957347 dv-cinder-851351-1-smb devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 609/1187] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 08:01:15 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 08:01:15.980395 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-681a7866-3a74-41ea-bae8-19c16fe8dbf1 None None] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:01:16.009942 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=100 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:01:16.106186 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-681a7866-3a74-41ea-bae8-19c16fe8dbf1 None None] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:01:16.158141 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e63138a-26a2-48b5-8792-ca64d22b8a46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:01:16.158820 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e63138a-26a2-48b5-8792-ca64d22b8a46 None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:01:16.159095 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e63138a-26a2-48b5-8792-ca64d22b8a46 None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:01:16.159363 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e63138a-26a2-48b5-8792-ca64d22b8a46 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:01:16.172949 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e63138a-26a2-48b5-8792-ca64d22b8a46 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 08:01:16.178030 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application [None req-5e63138a-26a2-48b5-8792-ca64d22b8a46 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 08:01:16.178030 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:01:16.178030 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:01:16.178030 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:01:16.178030 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:01:16.178030 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:01:16.178030 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:01:16.178030 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:01:16.178030 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:01:16.178030 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:01:16.178030 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:01:16.178030 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:01:16.178030 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 08:01:16.178030 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 08:01:16.178030 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 08:01:16.178030 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 08:01:16.179834 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 08:01:16.179834 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 08:01:16.179834 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 08:01:16.179834 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 08:01:16.179834 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:01:16.179834 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:01:16.179834 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:01:16.179834 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:01:16.179834 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:01:16.179834 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:01:16.179834 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:01:16.179834 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application with Lock( Jul 28 08:01:16.179834 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:01:16.179834 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:01:16.179834 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:01:16.179834 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:01:16.181499 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:01:16.181499 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:01:16.181499 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:01:16.181499 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:01:16.181499 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 08:01:16.181499 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 08:01:16.181499 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 08:01:16.181499 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 08:01:16.181499 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 08:01:16.181499 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 08:01:16.181499 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 08:01:16.181499 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application Jul 28 08:01:16.181499 dv-cinder-851351-1-smb devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 579/1188] 10.222.0.42 () {56 vars in 1096 bytes} [Thu Jul 28 08:01:15 2022] GET /identity/v3/roles/admin => generated 83 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 08:01:16.189672 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-255dd2be-7e75-476f-b122-271f636ad818 None None] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:01:16.319792 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:01:16.341261 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-255dd2be-7e75-476f-b122-271f636ad818 None None] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:01:16.379038 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7db83d-3f71-424a-bbc3-0d8c1c2af085 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:01:16.379582 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7db83d-3f71-424a-bbc3-0d8c1c2af085 None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:01:16.379858 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7db83d-3f71-424a-bbc3-0d8c1c2af085 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:01:16.380122 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7db83d-3f71-424a-bbc3-0d8c1c2af085 None admin] PATH_INFO: `/v3/roles` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:01:16.380872 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f7db83d-3f71-424a-bbc3-0d8c1c2af085 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:01:16.381165 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f7db83d-3f71-424a-bbc3-0d8c1c2af085 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:01:16.382597 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f7db83d-3f71-424a-bbc3-0d8c1c2af085 None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:01:16.391940 dv-cinder-851351-1-smb devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 610/1189] 10.222.0.42 () {56 vars in 1099 bytes} [Thu Jul 28 08:01:16 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:01:16.398615 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e63138a-26a2-48b5-8792-ca64d22b8a46 None admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:01:16.495945 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=100 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:01:16.518603 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e63138a-26a2-48b5-8792-ca64d22b8a46 None admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:01:16.557705 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0e161b-754a-434d-8641-9f58de35bc52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:01:16.558374 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0e161b-754a-434d-8641-9f58de35bc52 None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:01:16.558650 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0e161b-754a-434d-8641-9f58de35bc52 None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:01:16.558918 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0e161b-754a-434d-8641-9f58de35bc52 None admin] PATH_INFO: `/v3/users/a396febef9234f59a2172dcf78a82561` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:01:16.560266 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e0e161b-754a-434d-8641-9f58de35bc52 None admin] RBAC: Authorizing `identity:get_user(user_id=a396febef9234f59a2172dcf78a82561)` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:01:16.561795 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e0e161b-754a-434d-8641-9f58de35bc52 None admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:01:16.563543 dv-cinder-851351-1-smb devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 580/1190] 10.222.0.42 () {56 vars in 1177 bytes} [Thu Jul 28 08:01:16 2022] GET /identity/v3/users/a396febef9234f59a2172dcf78a82561 => generated 311 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:01:16.569941 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7db83d-3f71-424a-bbc3-0d8c1c2af085 None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:01:16.677609 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7db83d-3f71-424a-bbc3-0d8c1c2af085 None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:01:16.715975 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae0d620f-4f15-4b11-968e-35e0741cf64d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:01:16.716647 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0d620f-4f15-4b11-968e-35e0741cf64d None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:01:16.716959 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0d620f-4f15-4b11-968e-35e0741cf64d None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:01:16.717232 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0d620f-4f15-4b11-968e-35e0741cf64d None admin] PATH_INFO: `/v3/projects/60df1ce5ea5b47378cd23cbeb52075ee` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:01:16.718537 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae0d620f-4f15-4b11-968e-35e0741cf64d None admin] RBAC: Authorizing `identity:get_project(project_id=60df1ce5ea5b47378cd23cbeb52075ee)` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:01:16.720001 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae0d620f-4f15-4b11-968e-35e0741cf64d None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:01:16.721775 dv-cinder-851351-1-smb devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 611/1191] 10.222.0.42 () {56 vars in 1186 bytes} [Thu Jul 28 08:01:16 2022] GET /identity/v3/projects/60df1ce5ea5b47378cd23cbeb52075ee => generated 361 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 08:01:16.728258 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0e161b-754a-434d-8641-9f58de35bc52 None admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:01:16.846424 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0e161b-754a-434d-8641-9f58de35bc52 None admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:01:16.886278 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-864f0e02-09a4-4624-8103-4dd803edc117 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:01:16.886980 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864f0e02-09a4-4624-8103-4dd803edc117 None admin] REQUEST_METHOD: `PUT` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:01:16.887226 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864f0e02-09a4-4624-8103-4dd803edc117 None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:01:16.887525 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864f0e02-09a4-4624-8103-4dd803edc117 None admin] PATH_INFO: `/v3/projects/60df1ce5ea5b47378cd23cbeb52075ee/users/a396febef9234f59a2172dcf78a82561/roles/362bd71ac01249fb8fa635381993eec1` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:01:16.889767 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-864f0e02-09a4-4624-8103-4dd803edc117 None admin] RBAC: Authorizing `identity:create_grant(project_id=60df1ce5ea5b47378cd23cbeb52075ee, user_id=a396febef9234f59a2172dcf78a82561, role_id=362bd71ac01249fb8fa635381993eec1)` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:01:16.891270 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-864f0e02-09a4-4624-8103-4dd803edc117 None admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:01:16.912838 dv-cinder-851351-1-smb devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 581/1192] 10.222.0.42 () {58 vars in 1439 bytes} [Thu Jul 28 08:01:16 2022] PUT /identity/v3/projects/60df1ce5ea5b47378cd23cbeb52075ee/users/a396febef9234f59a2172dcf78a82561/roles/362bd71ac01249fb8fa635381993eec1 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 08:01:18.950526 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093725ce-ac88-4b99-882a-398da19d70c5 None None] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:01:18.951098 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093725ce-ac88-4b99-882a-398da19d70c5 None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:01:18.951098 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093725ce-ac88-4b99-882a-398da19d70c5 None None] PATH_INFO: `/` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:01:18.952451 dv-cinder-851351-1-smb devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 612/1193] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 08:01:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 08:01:18.958867 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb64631-1fb6-4be7-be44-519705ca1315 None None] REQUEST_METHOD: `POST` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:01:18.959413 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb64631-1fb6-4be7-be44-519705ca1315 None None] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:01:18.959413 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb64631-1fb6-4be7-be44-519705ca1315 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:01:18.981704 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.auth.core [None req-2eb64631-1fb6-4be7-be44-519705ca1315 None None] MFA Rules not processed for user `f0666d3a50644a7097367331c1ee1a68`. Rule list: `[]` (Enabled: `True`). {{(pid=80348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 08:01:18.983012 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.fernet_utils [None req-2eb64631-1fb6-4be7-be44-519705ca1315 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:01:18.986187 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:01:19.055885 dv-cinder-851351-1-smb devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 582/1194] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 08:01:18 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 08:01:19.079751 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-093725ce-ac88-4b99-882a-398da19d70c5 None None] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:01:19.093535 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:01:19.194267 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-093725ce-ac88-4b99-882a-398da19d70c5 None None] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:01:19.234685 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84dde8c1-2fd7-458f-ab76-180c12779b86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:01:19.235236 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84dde8c1-2fd7-458f-ab76-180c12779b86 None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:01:19.235514 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84dde8c1-2fd7-458f-ab76-180c12779b86 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:01:19.235780 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84dde8c1-2fd7-458f-ab76-180c12779b86 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:01:19.246811 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84dde8c1-2fd7-458f-ab76-180c12779b86 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 08:01:19.251769 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application [None req-84dde8c1-2fd7-458f-ab76-180c12779b86 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 08:01:19.251769 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:01:19.251769 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:01:19.251769 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:01:19.251769 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:01:19.251769 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:01:19.251769 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:01:19.251769 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:01:19.251769 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:01:19.251769 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:01:19.251769 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:01:19.251769 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:01:19.251769 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 08:01:19.251769 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 08:01:19.251769 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 08:01:19.251769 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 08:01:19.253595 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 08:01:19.253595 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 08:01:19.253595 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 08:01:19.253595 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 08:01:19.253595 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:01:19.253595 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:01:19.253595 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:01:19.253595 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:01:19.253595 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:01:19.253595 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:01:19.253595 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:01:19.253595 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application with Lock( Jul 28 08:01:19.253595 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:01:19.253595 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:01:19.253595 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:01:19.253595 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:01:19.255213 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:01:19.255213 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:01:19.255213 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:01:19.255213 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:01:19.255213 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 08:01:19.255213 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 08:01:19.255213 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 08:01:19.255213 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 08:01:19.255213 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 08:01:19.255213 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 08:01:19.255213 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 08:01:19.255213 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application Jul 28 08:01:19.255213 dv-cinder-851351-1-smb devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 613/1195] 10.222.0.42 () {56 vars in 1096 bytes} [Thu Jul 28 08:01:19 2022] GET /identity/v3/roles/admin => generated 83 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:01:19.263284 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb64631-1fb6-4be7-be44-519705ca1315 None None] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:01:19.435717 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb64631-1fb6-4be7-be44-519705ca1315 None None] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:01:19.495075 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991a0fbe-b196-4279-8a7b-ff0f6a1bbde3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:01:19.496021 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991a0fbe-b196-4279-8a7b-ff0f6a1bbde3 None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:01:19.496529 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991a0fbe-b196-4279-8a7b-ff0f6a1bbde3 None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:01:19.496930 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991a0fbe-b196-4279-8a7b-ff0f6a1bbde3 None admin] PATH_INFO: `/v3/roles` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:01:19.497671 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-991a0fbe-b196-4279-8a7b-ff0f6a1bbde3 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80348) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:01:19.497974 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-991a0fbe-b196-4279-8a7b-ff0f6a1bbde3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:01:19.500080 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-991a0fbe-b196-4279-8a7b-ff0f6a1bbde3 None admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:01:19.510851 dv-cinder-851351-1-smb devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 583/1196] 10.222.0.42 () {56 vars in 1099 bytes} [Thu Jul 28 08:01:19 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:01:19.516994 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84dde8c1-2fd7-458f-ab76-180c12779b86 None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:01:19.595203 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:01:19.630969 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84dde8c1-2fd7-458f-ab76-180c12779b86 None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:01:19.666089 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8982350-866c-4d60-b5ec-b52cf2d8f8f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:01:19.666805 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8982350-866c-4d60-b5ec-b52cf2d8f8f1 None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:01:19.667125 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8982350-866c-4d60-b5ec-b52cf2d8f8f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:01:19.667439 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8982350-866c-4d60-b5ec-b52cf2d8f8f1 None admin] PATH_INFO: `/v3/users/a396febef9234f59a2172dcf78a82561` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:01:19.668741 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8982350-866c-4d60-b5ec-b52cf2d8f8f1 None admin] RBAC: Authorizing `identity:get_user(user_id=a396febef9234f59a2172dcf78a82561)` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:01:19.670241 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8982350-866c-4d60-b5ec-b52cf2d8f8f1 None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:01:19.671932 dv-cinder-851351-1-smb devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 614/1197] 10.222.0.42 () {56 vars in 1177 bytes} [Thu Jul 28 08:01:19 2022] GET /identity/v3/users/a396febef9234f59a2172dcf78a82561 => generated 311 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:01:19.678178 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991a0fbe-b196-4279-8a7b-ff0f6a1bbde3 None admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:01:19.681269 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=100 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:01:19.789278 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991a0fbe-b196-4279-8a7b-ff0f6a1bbde3 None admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:01:19.825779 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5177fe9d-828c-4df3-90c9-5f70d88cdddc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:01:19.826408 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5177fe9d-828c-4df3-90c9-5f70d88cdddc None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:01:19.826684 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5177fe9d-828c-4df3-90c9-5f70d88cdddc None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:01:19.826952 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5177fe9d-828c-4df3-90c9-5f70d88cdddc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:01:19.906908 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5177fe9d-828c-4df3-90c9-5f70d88cdddc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:01:19.908380 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5177fe9d-828c-4df3-90c9-5f70d88cdddc None admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:01:19.910399 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=100 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:01:20.019306 dv-cinder-851351-1-smb devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 584/1198] 10.222.0.42 () {58 vars in 1282 bytes} [Thu Jul 28 08:01:19 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 342 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 28 08:01:20.028642 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8982350-866c-4d60-b5ec-b52cf2d8f8f1 None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:01:20.161903 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8982350-866c-4d60-b5ec-b52cf2d8f8f1 None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:01:20.203163 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264d82e5-810b-4928-b06d-43ac0128653a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:01:20.203822 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264d82e5-810b-4928-b06d-43ac0128653a None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:01:20.204100 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264d82e5-810b-4928-b06d-43ac0128653a None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:01:20.204367 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264d82e5-810b-4928-b06d-43ac0128653a None admin] PATH_INFO: `/v3/projects/60df1ce5ea5b47378cd23cbeb52075ee` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:01:20.205616 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-264d82e5-810b-4928-b06d-43ac0128653a None admin] RBAC: Authorizing `identity:get_project(project_id=60df1ce5ea5b47378cd23cbeb52075ee)` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:01:20.207069 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-264d82e5-810b-4928-b06d-43ac0128653a None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:01:20.208809 dv-cinder-851351-1-smb devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 615/1199] 10.222.0.42 () {56 vars in 1186 bytes} [Thu Jul 28 08:01:20 2022] GET /identity/v3/projects/60df1ce5ea5b47378cd23cbeb52075ee => generated 361 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:01:20.215375 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5177fe9d-828c-4df3-90c9-5f70d88cdddc None admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:01:20.323865 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5177fe9d-828c-4df3-90c9-5f70d88cdddc None admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:01:20.325667 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=100 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:01:20.363499 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c76e0d-7493-4d9f-bf23-bc664328d7f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:01:20.364132 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c76e0d-7493-4d9f-bf23-bc664328d7f2 None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:01:20.364410 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c76e0d-7493-4d9f-bf23-bc664328d7f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:01:20.364694 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c76e0d-7493-4d9f-bf23-bc664328d7f2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:01:20.365533 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c76e0d-7493-4d9f-bf23-bc664328d7f2 None admin] RBAC: Adding query filter params (role.id=362bd71ac01249fb8fa635381993eec1, scope.project.id=60df1ce5ea5b47378cd23cbeb52075ee, user.id=a396febef9234f59a2172dcf78a82561) {{(pid=80348) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:01:20.365843 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c76e0d-7493-4d9f-bf23-bc664328d7f2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:01:20.367411 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c76e0d-7493-4d9f-bf23-bc664328d7f2 None admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:01:20.374319 dv-cinder-851351-1-smb devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 585/1200] 10.222.0.42 () {56 vars in 1374 bytes} [Thu Jul 28 08:01:20 2022] GET /identity/v3/role_assignments?user.id=a396febef9234f59a2172dcf78a82561&scope.project.id=60df1ce5ea5b47378cd23cbeb52075ee&role.id=362bd71ac01249fb8fa635381993eec1 => generated 608 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:01:30.197820 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=97 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:01:30.371199 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=17 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:02:19.208606 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d27528-7c6d-45ae-8d03-bdb3d38dd7c7 None None] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:02:19.209622 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d27528-7c6d-45ae-8d03-bdb3d38dd7c7 None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:02:19.209622 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d27528-7c6d-45ae-8d03-bdb3d38dd7c7 None None] PATH_INFO: `/` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:02:19.211111 dv-cinder-851351-1-smb devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 616/1201] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 08:02:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 28 08:02:19.220705 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f77e31-eed9-4d68-b298-2456a8157e98 None None] REQUEST_METHOD: `POST` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:02:19.221310 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f77e31-eed9-4d68-b298-2456a8157e98 None None] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:02:19.221651 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f77e31-eed9-4d68-b298-2456a8157e98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:02:19.248713 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.auth.core [None req-e4f77e31-eed9-4d68-b298-2456a8157e98 None None] MFA Rules not processed for user `f0666d3a50644a7097367331c1ee1a68`. Rule list: `[]` (Enabled: `True`). {{(pid=80348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 08:02:19.250322 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.fernet_utils [None req-e4f77e31-eed9-4d68-b298-2456a8157e98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:02:19.365284 dv-cinder-851351-1-smb devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 586/1202] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 08:02:19 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 08:02:19.397966 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d27528-7c6d-45ae-8d03-bdb3d38dd7c7 None None] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:02:19.619043 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d27528-7c6d-45ae-8d03-bdb3d38dd7c7 None None] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:02:19.701378 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946fc685-cc80-466c-95d4-98597727372a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:02:19.702156 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946fc685-cc80-466c-95d4-98597727372a None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:02:19.702780 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946fc685-cc80-466c-95d4-98597727372a None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:02:19.703099 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946fc685-cc80-466c-95d4-98597727372a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:02:19.717547 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-946fc685-cc80-466c-95d4-98597727372a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:02:19.719179 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-946fc685-cc80-466c-95d4-98597727372a None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:02:19.752881 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application [None req-946fc685-cc80-466c-95d4-98597727372a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 08:02:19.752881 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:02:19.752881 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:02:19.752881 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:02:19.752881 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:02:19.752881 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:02:19.752881 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:02:19.752881 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:02:19.752881 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:02:19.752881 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:02:19.752881 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:02:19.752881 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:02:19.752881 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 08:02:19.752881 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 08:02:19.752881 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 08:02:19.754749 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 08:02:19.754749 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:02:19.754749 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:02:19.754749 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:02:19.754749 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:02:19.754749 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:02:19.754749 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:02:19.754749 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:02:19.754749 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application with Lock( Jul 28 08:02:19.754749 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:02:19.754749 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:02:19.754749 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:02:19.754749 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:02:19.754749 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:02:19.754749 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:02:19.754749 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:02:19.754749 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:02:19.757626 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 08:02:19.757626 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 08:02:19.757626 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 08:02:19.757626 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application Jul 28 08:02:19.757626 dv-cinder-851351-1-smb devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 617/1203] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 08:02:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 358 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 08:02:19.762781 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f77e31-eed9-4d68-b298-2456a8157e98 None None] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:02:19.945485 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f77e31-eed9-4d68-b298-2456a8157e98 None None] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:02:20.014124 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=100 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:02:20.025906 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a32f07d-7515-420a-92a4-6c734fb0975c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:02:20.025906 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a32f07d-7515-420a-92a4-6c734fb0975c None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:02:20.025906 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a32f07d-7515-420a-92a4-6c734fb0975c None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:02:20.025906 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a32f07d-7515-420a-92a4-6c734fb0975c None admin] PATH_INFO: `/v3/domains` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:02:20.027258 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a32f07d-7515-420a-92a4-6c734fb0975c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80348) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:02:20.028005 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a32f07d-7515-420a-92a4-6c734fb0975c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:02:20.030856 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a32f07d-7515-420a-92a4-6c734fb0975c None admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:02:20.052534 dv-cinder-851351-1-smb devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 587/1204] 10.222.0.42 () {56 vars in 1109 bytes} [Thu Jul 28 08:02:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 290 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:02:20.061875 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946fc685-cc80-466c-95d4-98597727372a None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:02:20.161387 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:02:20.236886 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946fc685-cc80-466c-95d4-98597727372a None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:02:20.277678 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8070ab56-0bb8-44f9-9aa3-304415c7706a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:02:20.278419 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8070ab56-0bb8-44f9-9aa3-304415c7706a None admin] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:02:20.278717 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8070ab56-0bb8-44f9-9aa3-304415c7706a None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:02:20.279050 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8070ab56-0bb8-44f9-9aa3-304415c7706a None admin] PATH_INFO: `/v3/users` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:02:20.280324 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8070ab56-0bb8-44f9-9aa3-304415c7706a None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:02:20.281514 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8070ab56-0bb8-44f9-9aa3-304415c7706a None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:02:20.309934 dv-cinder-851351-1-smb devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 618/1205] 10.222.0.42 () {60 vars in 1132 bytes} [Thu Jul 28 08:02:20 2022] POST /identity/v3/users => generated 251 bytes in 249 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 08:02:22.626694 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c8b49f-9751-4b39-86a9-dad7f5872bc5 None None] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:02:22.627276 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c8b49f-9751-4b39-86a9-dad7f5872bc5 None None] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:02:22.627276 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c8b49f-9751-4b39-86a9-dad7f5872bc5 None None] PATH_INFO: `/` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:02:22.628965 dv-cinder-851351-1-smb devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 588/1206] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 08:02:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 08:02:22.634433 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e5332a-8f82-4ec1-81e6-d3cb8eabfb5a None None] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:02:22.634918 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e5332a-8f82-4ec1-81e6-d3cb8eabfb5a None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:02:22.635006 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e5332a-8f82-4ec1-81e6-d3cb8eabfb5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:02:22.654547 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.auth.core [None req-06e5332a-8f82-4ec1-81e6-d3cb8eabfb5a None None] MFA Rules not processed for user `f0666d3a50644a7097367331c1ee1a68`. Rule list: `[]` (Enabled: `True`). {{(pid=80347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 08:02:22.655763 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-06e5332a-8f82-4ec1-81e6-d3cb8eabfb5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:02:22.772930 dv-cinder-851351-1-smb devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 619/1207] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 08:02:22 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 08:02:22.790764 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c8b49f-9751-4b39-86a9-dad7f5872bc5 None None] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:02:22.956558 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c8b49f-9751-4b39-86a9-dad7f5872bc5 None None] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:02:23.012358 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810d28cd-2879-40c0-9638-ee8e95eb8e65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:02:23.013357 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810d28cd-2879-40c0-9638-ee8e95eb8e65 None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:02:23.013864 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810d28cd-2879-40c0-9638-ee8e95eb8e65 None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:02:23.014312 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810d28cd-2879-40c0-9638-ee8e95eb8e65 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:02:23.029385 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-810d28cd-2879-40c0-9638-ee8e95eb8e65 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 08:02:23.034894 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application [None req-810d28cd-2879-40c0-9638-ee8e95eb8e65 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 28 08:02:23.034894 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:02:23.034894 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:02:23.034894 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:02:23.034894 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:02:23.034894 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:02:23.034894 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:02:23.034894 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:02:23.034894 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:02:23.034894 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:02:23.034894 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:02:23.034894 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:02:23.034894 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 08:02:23.034894 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 08:02:23.034894 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 08:02:23.034894 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 08:02:23.036901 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 08:02:23.036901 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 08:02:23.036901 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 08:02:23.036901 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 08:02:23.036901 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:02:23.036901 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:02:23.036901 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:02:23.036901 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:02:23.036901 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:02:23.036901 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:02:23.036901 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:02:23.036901 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application with Lock( Jul 28 08:02:23.036901 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:02:23.036901 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:02:23.036901 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:02:23.036901 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:02:23.038568 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:02:23.038568 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:02:23.038568 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:02:23.038568 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:02:23.038568 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 08:02:23.038568 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 08:02:23.038568 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 08:02:23.038568 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 08:02:23.038568 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 08:02:23.038568 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 08:02:23.038568 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 28 08:02:23.038568 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application Jul 28 08:02:23.038568 dv-cinder-851351-1-smb devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 589/1208] 10.222.0.42 () {56 vars in 1102 bytes} [Thu Jul 28 08:02:22 2022] GET /identity/v3/roles/service => generated 85 bytes in 246 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 08:02:23.046119 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e5332a-8f82-4ec1-81e6-d3cb8eabfb5a None None] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:02:23.105029 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:02:23.176365 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e5332a-8f82-4ec1-81e6-d3cb8eabfb5a None None] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:02:23.223270 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f506186e-634a-4c41-9088-00fffb057854 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:02:23.223850 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f506186e-634a-4c41-9088-00fffb057854 None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:02:23.224121 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f506186e-634a-4c41-9088-00fffb057854 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:02:23.224382 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f506186e-634a-4c41-9088-00fffb057854 None admin] PATH_INFO: `/v3/roles` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:02:23.225143 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f506186e-634a-4c41-9088-00fffb057854 None admin] RBAC: Adding query filter params (name=service) {{(pid=80347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:02:23.225624 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f506186e-634a-4c41-9088-00fffb057854 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:02:23.227216 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f506186e-634a-4c41-9088-00fffb057854 None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:02:23.242597 dv-cinder-851351-1-smb devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 620/1209] 10.222.0.42 () {56 vars in 1103 bytes} [Thu Jul 28 08:02:23 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:02:23.243937 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810d28cd-2879-40c0-9638-ee8e95eb8e65 None admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:02:23.316572 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=100 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:02:23.401976 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810d28cd-2879-40c0-9638-ee8e95eb8e65 None admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:02:23.455806 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dcaea8f-fc1b-44ef-9ec0-f9df627c69c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:02:23.456503 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dcaea8f-fc1b-44ef-9ec0-f9df627c69c3 None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:02:23.456846 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dcaea8f-fc1b-44ef-9ec0-f9df627c69c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:02:23.457163 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dcaea8f-fc1b-44ef-9ec0-f9df627c69c3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:02:23.472205 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dcaea8f-fc1b-44ef-9ec0-f9df627c69c3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:02:23.474347 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dcaea8f-fc1b-44ef-9ec0-f9df627c69c3 None admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:02:23.493720 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application [None req-7dcaea8f-fc1b-44ef-9ec0-f9df627c69c3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 08:02:23.493720 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:02:23.493720 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:02:23.493720 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:02:23.493720 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:02:23.493720 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:02:23.493720 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:02:23.493720 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:02:23.493720 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:02:23.493720 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:02:23.493720 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:02:23.493720 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:02:23.493720 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 08:02:23.493720 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 08:02:23.493720 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 08:02:23.494949 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 08:02:23.494949 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:02:23.494949 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:02:23.494949 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:02:23.494949 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:02:23.494949 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:02:23.494949 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:02:23.494949 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:02:23.494949 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application with Lock( Jul 28 08:02:23.494949 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:02:23.494949 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:02:23.494949 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:02:23.494949 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:02:23.494949 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:02:23.494949 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:02:23.494949 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:02:23.494949 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:02:23.495950 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 08:02:23.495950 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 08:02:23.495950 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 08:02:23.495950 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application Jul 28 08:02:23.495950 dv-cinder-851351-1-smb devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 590/1210] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 08:02:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 252 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 08:02:23.501483 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f506186e-634a-4c41-9088-00fffb057854 None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:02:23.656306 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:02:23.662406 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f506186e-634a-4c41-9088-00fffb057854 None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:02:23.732172 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b258df-b4d5-4140-89f7-55d34943b630 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:02:23.733322 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b258df-b4d5-4140-89f7-55d34943b630 None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:02:23.733785 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b258df-b4d5-4140-89f7-55d34943b630 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:02:23.734258 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b258df-b4d5-4140-89f7-55d34943b630 None admin] PATH_INFO: `/v3/domains` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:02:23.735604 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5b258df-b4d5-4140-89f7-55d34943b630 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:02:23.736121 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5b258df-b4d5-4140-89f7-55d34943b630 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:02:23.738868 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5b258df-b4d5-4140-89f7-55d34943b630 None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:02:23.759554 dv-cinder-851351-1-smb devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 621/1211] 10.222.0.42 () {56 vars in 1109 bytes} [Thu Jul 28 08:02:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:02:23.766535 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dcaea8f-fc1b-44ef-9ec0-f9df627c69c3 None admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:02:23.919705 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dcaea8f-fc1b-44ef-9ec0-f9df627c69c3 None admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:02:23.921952 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=100 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:02:23.979599 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688b8323-80c1-48db-9780-9ec0fa068f78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:02:23.980836 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688b8323-80c1-48db-9780-9ec0fa068f78 None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:02:23.981243 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688b8323-80c1-48db-9780-9ec0fa068f78 None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:02:23.981729 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688b8323-80c1-48db-9780-9ec0fa068f78 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:02:23.997407 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-688b8323-80c1-48db-9780-9ec0fa068f78 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:02:24.000299 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-688b8323-80c1-48db-9780-9ec0fa068f78 None admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:02:24.018362 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application [None req-688b8323-80c1-48db-9780-9ec0fa068f78 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 28 08:02:24.018362 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:02:24.018362 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:02:24.018362 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:02:24.018362 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:02:24.018362 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:02:24.018362 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:02:24.018362 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:02:24.018362 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:02:24.018362 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:02:24.018362 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:02:24.018362 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:02:24.018362 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 28 08:02:24.018362 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 28 08:02:24.018362 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 28 08:02:24.018362 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 28 08:02:24.020295 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:02:24.020295 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:02:24.020295 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 28 08:02:24.020295 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 08:02:24.020295 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 28 08:02:24.020295 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 08:02:24.020295 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:02:24.020295 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:02:24.020295 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:02:24.020295 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:02:24.020295 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:02:24.020295 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application with Lock( Jul 28 08:02:24.020295 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:02:24.020295 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:02:24.020295 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:02:24.020295 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:02:24.020295 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:02:24.020295 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:02:24.021668 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:02:24.021668 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:02:24.021668 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 28 08:02:24.021668 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 28 08:02:24.021668 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 28 08:02:24.021668 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 28 08:02:24.021668 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 28 08:02:24.021668 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 28 08:02:24.021668 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 28 08:02:24.021668 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application Jul 28 08:02:24.021668 dv-cinder-851351-1-smb devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 591/1212] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 08:02:23 2022] GET /identity/v3/users/placement => generated 87 bytes in 255 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:02:24.030301 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b258df-b4d5-4140-89f7-55d34943b630 None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:02:24.216265 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b258df-b4d5-4140-89f7-55d34943b630 None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:02:24.276928 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67960eac-4789-440e-8260-7af4e2163b10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:02:24.277905 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67960eac-4789-440e-8260-7af4e2163b10 None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:02:24.278286 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67960eac-4789-440e-8260-7af4e2163b10 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:02:24.278767 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67960eac-4789-440e-8260-7af4e2163b10 None admin] PATH_INFO: `/v3/users` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:02:24.279808 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67960eac-4789-440e-8260-7af4e2163b10 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:02:24.280286 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67960eac-4789-440e-8260-7af4e2163b10 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:02:24.282541 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67960eac-4789-440e-8260-7af4e2163b10 None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:02:24.310140 dv-cinder-851351-1-smb devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 622/1213] 10.222.0.42 () {56 vars in 1143 bytes} [Thu Jul 28 08:02:24 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 281 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 08:02:24.319992 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688b8323-80c1-48db-9780-9ec0fa068f78 None admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:02:24.511354 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688b8323-80c1-48db-9780-9ec0fa068f78 None admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:02:24.554576 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db0d92e-23c0-4453-b6f2-4751e770587b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:02:24.555423 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db0d92e-23c0-4453-b6f2-4751e770587b None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:02:24.557818 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db0d92e-23c0-4453-b6f2-4751e770587b None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:02:24.557818 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db0d92e-23c0-4453-b6f2-4751e770587b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:02:24.610361 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=100 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:02:24.679323 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6db0d92e-23c0-4453-b6f2-4751e770587b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:02:24.682249 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6db0d92e-23c0-4453-b6f2-4751e770587b None admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:02:24.867539 dv-cinder-851351-1-smb devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 592/1214] 10.222.0.42 () {58 vars in 1282 bytes} [Thu Jul 28 08:02:24 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 548 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 28 08:02:24.877554 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67960eac-4789-440e-8260-7af4e2163b10 None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:02:24.909546 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:02:25.058744 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67960eac-4789-440e-8260-7af4e2163b10 None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:02:25.128150 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3e7150-8623-4cb3-a2e8-2860247cd6b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:02:25.129332 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3e7150-8623-4cb3-a2e8-2860247cd6b8 None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:02:25.129775 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3e7150-8623-4cb3-a2e8-2860247cd6b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:02:25.130313 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3e7150-8623-4cb3-a2e8-2860247cd6b8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:02:25.151994 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d3e7150-8623-4cb3-a2e8-2860247cd6b8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:02:25.156265 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d3e7150-8623-4cb3-a2e8-2860247cd6b8 None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:02:25.187234 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application [None req-6d3e7150-8623-4cb3-a2e8-2860247cd6b8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 08:02:25.187234 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:02:25.187234 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:02:25.187234 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:02:25.187234 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:02:25.187234 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:02:25.187234 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:02:25.187234 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:02:25.187234 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:02:25.187234 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:02:25.187234 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:02:25.187234 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:02:25.187234 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 08:02:25.187234 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 08:02:25.187234 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 08:02:25.189070 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 08:02:25.189070 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:02:25.189070 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:02:25.189070 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:02:25.189070 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:02:25.189070 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:02:25.189070 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:02:25.189070 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:02:25.189070 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application with Lock( Jul 28 08:02:25.189070 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:02:25.189070 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:02:25.189070 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:02:25.189070 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:02:25.189070 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:02:25.189070 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:02:25.189070 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:02:25.189070 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:02:25.190766 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 08:02:25.190766 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 08:02:25.190766 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 08:02:25.190766 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application Jul 28 08:02:25.190766 dv-cinder-851351-1-smb devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 623/1215] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 08:02:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 313 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:02:25.198732 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db0d92e-23c0-4453-b6f2-4751e770587b None admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:02:25.288402 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=100 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:02:25.344284 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db0d92e-23c0-4453-b6f2-4751e770587b None admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:02:25.397623 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da664036-10e8-448c-88bd-787655030d38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:02:25.398432 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da664036-10e8-448c-88bd-787655030d38 None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:02:25.398918 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da664036-10e8-448c-88bd-787655030d38 None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:02:25.399391 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da664036-10e8-448c-88bd-787655030d38 None admin] PATH_INFO: `/v3/domains` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:02:25.400657 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da664036-10e8-448c-88bd-787655030d38 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80348) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:02:25.401308 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da664036-10e8-448c-88bd-787655030d38 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:02:25.403924 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da664036-10e8-448c-88bd-787655030d38 None admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:02:25.426323 dv-cinder-851351-1-smb devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 593/1216] 10.222.0.42 () {56 vars in 1109 bytes} [Thu Jul 28 08:02:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:02:25.432216 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3e7150-8623-4cb3-a2e8-2860247cd6b8 None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:02:25.521450 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:02:25.584369 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3e7150-8623-4cb3-a2e8-2860247cd6b8 None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:02:25.654854 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7fc8b4e-7fe1-4ba3-9f91-47d8c8391a70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:02:25.654854 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7fc8b4e-7fe1-4ba3-9f91-47d8c8391a70 None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:02:25.654854 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7fc8b4e-7fe1-4ba3-9f91-47d8c8391a70 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:02:25.654854 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7fc8b4e-7fe1-4ba3-9f91-47d8c8391a70 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:02:25.667999 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7fc8b4e-7fe1-4ba3-9f91-47d8c8391a70 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:02:25.670959 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7fc8b4e-7fe1-4ba3-9f91-47d8c8391a70 None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:02:25.694974 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application [None req-a7fc8b4e-7fe1-4ba3-9f91-47d8c8391a70 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 08:02:25.694974 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:02:25.694974 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:02:25.694974 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:02:25.694974 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:02:25.694974 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:02:25.694974 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:02:25.694974 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:02:25.694974 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:02:25.694974 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:02:25.694974 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:02:25.694974 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:02:25.694974 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 28 08:02:25.694974 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 28 08:02:25.694974 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 28 08:02:25.696139 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 28 08:02:25.696139 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:02:25.696139 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:02:25.696139 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:02:25.696139 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:02:25.696139 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:02:25.696139 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:02:25.696139 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:02:25.696139 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application with Lock( Jul 28 08:02:25.696139 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:02:25.696139 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:02:25.696139 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:02:25.696139 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:02:25.696139 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:02:25.696139 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:02:25.696139 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:02:25.696139 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:02:25.697229 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 28 08:02:25.697229 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 28 08:02:25.697229 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 28 08:02:25.697229 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 28 08:02:25.697229 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 28 08:02:25.697229 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 28 08:02:25.697229 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 08:02:25.697229 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application Jul 28 08:02:25.699040 dv-cinder-851351-1-smb devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 624/1217] 10.222.0.42 () {56 vars in 1111 bytes} [Thu Jul 28 08:02:25 2022] GET /identity/v3/projects/service => generated 88 bytes in 266 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:02:25.704881 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da664036-10e8-448c-88bd-787655030d38 None admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:02:25.893202 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da664036-10e8-448c-88bd-787655030d38 None admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:02:25.936755 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=100 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:02:25.954875 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a443e26-1e76-4232-b9e3-740b3ff64370 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:02:25.956466 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a443e26-1e76-4232-b9e3-740b3ff64370 None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:02:25.956466 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a443e26-1e76-4232-b9e3-740b3ff64370 None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:02:25.956814 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a443e26-1e76-4232-b9e3-740b3ff64370 None admin] PATH_INFO: `/v3/projects` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:02:25.957788 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a443e26-1e76-4232-b9e3-740b3ff64370 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80348) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:02:25.958298 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a443e26-1e76-4232-b9e3-740b3ff64370 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:02:25.960010 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a443e26-1e76-4232-b9e3-740b3ff64370 None admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:02:25.983729 dv-cinder-851351-1-smb devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 594/1218] 10.222.0.42 () {56 vars in 1148 bytes} [Thu Jul 28 08:02:25 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:02:25.986153 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7fc8b4e-7fe1-4ba3-9f91-47d8c8391a70 None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:02:26.148255 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7fc8b4e-7fe1-4ba3-9f91-47d8c8391a70 None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:02:26.196255 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:02:26.208797 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a351af06-5f28-4800-a428-8922d67aaf08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:02:26.210685 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a351af06-5f28-4800-a428-8922d67aaf08 None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:02:26.210922 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a351af06-5f28-4800-a428-8922d67aaf08 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:02:26.211165 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a351af06-5f28-4800-a428-8922d67aaf08 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:02:26.212114 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a351af06-5f28-4800-a428-8922d67aaf08 None admin] RBAC: Adding query filter params (role.id=a2d02bc3295c4a33b1fc0775a17a79e6, scope.project.id=139349507026497c98f360774dee737e, user.id=5db0b219e0d24284907722fbf18ca3e8) {{(pid=80347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:02:26.212379 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a351af06-5f28-4800-a428-8922d67aaf08 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:02:26.214085 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a351af06-5f28-4800-a428-8922d67aaf08 None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:02:26.232989 dv-cinder-851351-1-smb devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 625/1219] 10.222.0.42 () {56 vars in 1374 bytes} [Thu Jul 28 08:02:25 2022] GET /identity/v3/role_assignments?user.id=5db0b219e0d24284907722fbf18ca3e8&scope.project.id=139349507026497c98f360774dee737e&role.id=a2d02bc3295c4a33b1fc0775a17a79e6 => generated 259 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:02:28.647127 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6f22d8-fe42-4ba6-8806-c87baa174962 None None] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:02:28.647822 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6f22d8-fe42-4ba6-8806-c87baa174962 None None] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:02:28.648008 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6f22d8-fe42-4ba6-8806-c87baa174962 None None] PATH_INFO: `/` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:02:28.650830 dv-cinder-851351-1-smb devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 595/1220] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 08:02:28 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 08:02:28.657041 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca312db5-bcf6-4d8a-85ca-e5d808929990 None None] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:02:28.657856 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca312db5-bcf6-4d8a-85ca-e5d808929990 None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:02:28.657856 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca312db5-bcf6-4d8a-85ca-e5d808929990 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:02:28.686077 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.auth.core [None req-ca312db5-bcf6-4d8a-85ca-e5d808929990 None None] MFA Rules not processed for user `f0666d3a50644a7097367331c1ee1a68`. Rule list: `[]` (Enabled: `True`). {{(pid=80347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 08:02:28.688108 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-ca312db5-bcf6-4d8a-85ca-e5d808929990 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:02:28.788860 dv-cinder-851351-1-smb devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 626/1221] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 08:02:28 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 08:02:28.811574 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf6f22d8-fe42-4ba6-8806-c87baa174962 None None] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:02:28.978259 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf6f22d8-fe42-4ba6-8806-c87baa174962 None None] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:02:29.015035 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0592e1c-418c-49be-bfd6-2956a937b38c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:02:29.015689 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0592e1c-418c-49be-bfd6-2956a937b38c None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:02:29.015971 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0592e1c-418c-49be-bfd6-2956a937b38c None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:02:29.016269 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0592e1c-418c-49be-bfd6-2956a937b38c None admin] PATH_INFO: `/v3/roles/service` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:02:29.032348 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0592e1c-418c-49be-bfd6-2956a937b38c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 08:02:29.037375 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application [None req-e0592e1c-418c-49be-bfd6-2956a937b38c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 28 08:02:29.037375 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:02:29.037375 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:02:29.037375 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:02:29.037375 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:02:29.037375 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:02:29.037375 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:02:29.037375 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:02:29.037375 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:02:29.037375 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:02:29.037375 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:02:29.037375 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:02:29.037375 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 08:02:29.037375 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 08:02:29.037375 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 08:02:29.037375 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 08:02:29.038575 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 08:02:29.038575 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 08:02:29.038575 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 08:02:29.038575 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 08:02:29.038575 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:02:29.038575 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:02:29.038575 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:02:29.038575 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:02:29.038575 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:02:29.038575 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:02:29.038575 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:02:29.038575 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application with Lock( Jul 28 08:02:29.038575 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:02:29.038575 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:02:29.038575 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:02:29.038575 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:02:29.040051 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:02:29.040051 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:02:29.040051 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:02:29.040051 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:02:29.040051 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 08:02:29.040051 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 08:02:29.040051 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 08:02:29.040051 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 08:02:29.040051 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 08:02:29.040051 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 08:02:29.040051 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 28 08:02:29.040051 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application Jul 28 08:02:29.040051 dv-cinder-851351-1-smb devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 596/1222] 10.222.0.42 () {56 vars in 1102 bytes} [Thu Jul 28 08:02:28 2022] GET /identity/v3/roles/service => generated 85 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:02:29.046433 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca312db5-bcf6-4d8a-85ca-e5d808929990 None None] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:02:29.175968 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca312db5-bcf6-4d8a-85ca-e5d808929990 None None] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:02:29.206297 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:02:29.221189 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8655e0c8-b3d1-4548-bc43-31817041c141 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:02:29.223139 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8655e0c8-b3d1-4548-bc43-31817041c141 None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:02:29.223638 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8655e0c8-b3d1-4548-bc43-31817041c141 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:02:29.224133 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8655e0c8-b3d1-4548-bc43-31817041c141 None admin] PATH_INFO: `/v3/roles` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:02:29.225537 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8655e0c8-b3d1-4548-bc43-31817041c141 None admin] RBAC: Adding query filter params (name=service) {{(pid=80347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:02:29.226070 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8655e0c8-b3d1-4548-bc43-31817041c141 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:02:29.228374 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8655e0c8-b3d1-4548-bc43-31817041c141 None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:02:29.243392 dv-cinder-851351-1-smb devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 627/1223] 10.222.0.42 () {56 vars in 1103 bytes} [Thu Jul 28 08:02:29 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 08:02:29.252130 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0592e1c-418c-49be-bfd6-2956a937b38c None admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:02:29.326940 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=100 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:02:29.409243 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0592e1c-418c-49be-bfd6-2956a937b38c None admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:02:29.454758 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c1fb77-a163-4e6c-8340-0121d9610319 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:02:29.455438 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c1fb77-a163-4e6c-8340-0121d9610319 None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:02:29.455707 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c1fb77-a163-4e6c-8340-0121d9610319 None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:02:29.455974 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c1fb77-a163-4e6c-8340-0121d9610319 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:02:29.468185 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c1fb77-a163-4e6c-8340-0121d9610319 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:02:29.469754 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c1fb77-a163-4e6c-8340-0121d9610319 None admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:02:29.487752 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application [None req-60c1fb77-a163-4e6c-8340-0121d9610319 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 08:02:29.487752 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:02:29.487752 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:02:29.487752 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:02:29.487752 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:02:29.487752 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:02:29.487752 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:02:29.487752 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:02:29.487752 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:02:29.487752 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:02:29.487752 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:02:29.487752 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:02:29.487752 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 08:02:29.487752 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 08:02:29.487752 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 08:02:29.489940 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 08:02:29.489940 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:02:29.489940 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:02:29.489940 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:02:29.489940 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:02:29.489940 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:02:29.489940 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:02:29.489940 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:02:29.489940 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application with Lock( Jul 28 08:02:29.489940 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:02:29.489940 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:02:29.489940 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:02:29.489940 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:02:29.489940 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:02:29.489940 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:02:29.489940 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:02:29.489940 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:02:29.491723 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 08:02:29.491723 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 08:02:29.491723 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 08:02:29.491723 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application Jul 28 08:02:29.491723 dv-cinder-851351-1-smb devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 597/1224] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 08:02:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:02:29.495692 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8655e0c8-b3d1-4548-bc43-31817041c141 None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:02:29.659885 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8655e0c8-b3d1-4548-bc43-31817041c141 None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:02:29.704382 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad0850e-8549-4aab-8f83-afad40829304 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:02:29.705355 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad0850e-8549-4aab-8f83-afad40829304 None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:02:29.705762 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad0850e-8549-4aab-8f83-afad40829304 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:02:29.706191 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad0850e-8549-4aab-8f83-afad40829304 None admin] PATH_INFO: `/v3/domains` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:02:29.707156 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ad0850e-8549-4aab-8f83-afad40829304 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:02:29.707622 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ad0850e-8549-4aab-8f83-afad40829304 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:02:29.709677 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ad0850e-8549-4aab-8f83-afad40829304 None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:02:29.731737 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c1fb77-a163-4e6c-8340-0121d9610319 None admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:02:29.732556 dv-cinder-851351-1-smb devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 628/1225] 10.222.0.42 () {56 vars in 1109 bytes} [Thu Jul 28 08:02:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:02:29.907507 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=100 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:02:29.917291 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c1fb77-a163-4e6c-8340-0121d9610319 None admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:02:29.968326 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5887651-4607-4e9a-98df-2531257c4637 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:02:29.969041 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5887651-4607-4e9a-98df-2531257c4637 None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:02:29.969371 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5887651-4607-4e9a-98df-2531257c4637 None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:02:29.969589 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5887651-4607-4e9a-98df-2531257c4637 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:02:29.982238 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5887651-4607-4e9a-98df-2531257c4637 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:02:29.985003 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5887651-4607-4e9a-98df-2531257c4637 None admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:02:30.004613 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application [None req-c5887651-4607-4e9a-98df-2531257c4637 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 28 08:02:30.004613 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:02:30.004613 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:02:30.004613 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:02:30.004613 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:02:30.004613 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:02:30.004613 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:02:30.004613 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:02:30.004613 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:02:30.004613 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:02:30.004613 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:02:30.004613 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:02:30.004613 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 28 08:02:30.004613 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 28 08:02:30.004613 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 28 08:02:30.004613 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 28 08:02:30.012402 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:02:30.012402 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:02:30.012402 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 28 08:02:30.012402 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 08:02:30.012402 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 28 08:02:30.012402 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 08:02:30.012402 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:02:30.012402 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:02:30.012402 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:02:30.012402 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:02:30.012402 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:02:30.012402 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application with Lock( Jul 28 08:02:30.012402 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:02:30.012402 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:02:30.012402 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:02:30.012402 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:02:30.012402 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:02:30.012402 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:02:30.014326 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:02:30.014326 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:02:30.014326 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 28 08:02:30.014326 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 28 08:02:30.014326 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 28 08:02:30.014326 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 28 08:02:30.014326 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 28 08:02:30.014326 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 28 08:02:30.014326 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 28 08:02:30.014326 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application Jul 28 08:02:30.014326 dv-cinder-851351-1-smb devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 598/1226] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 08:02:29 2022] GET /identity/v3/users/placement => generated 87 bytes in 276 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:02:30.016584 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad0850e-8549-4aab-8f83-afad40829304 None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:02:30.083717 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:02:30.159565 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad0850e-8549-4aab-8f83-afad40829304 None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:02:30.216054 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecbd5c6c-6c8d-4fd0-8899-99be27a40ae4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:02:30.216952 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbd5c6c-6c8d-4fd0-8899-99be27a40ae4 None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:02:30.217340 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbd5c6c-6c8d-4fd0-8899-99be27a40ae4 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:02:30.217711 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbd5c6c-6c8d-4fd0-8899-99be27a40ae4 None admin] PATH_INFO: `/v3/users` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:02:30.218673 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecbd5c6c-6c8d-4fd0-8899-99be27a40ae4 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:02:30.219070 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecbd5c6c-6c8d-4fd0-8899-99be27a40ae4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:02:30.220615 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecbd5c6c-6c8d-4fd0-8899-99be27a40ae4 None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:02:30.246396 dv-cinder-851351-1-smb devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 629/1227] 10.222.0.42 () {56 vars in 1143 bytes} [Thu Jul 28 08:02:30 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:02:30.253639 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5887651-4607-4e9a-98df-2531257c4637 None admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:02:30.399628 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5887651-4607-4e9a-98df-2531257c4637 None admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:02:30.450573 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a1a754-3406-4287-8b49-ef977f60c9db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:02:30.451305 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a1a754-3406-4287-8b49-ef977f60c9db None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:02:30.451672 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a1a754-3406-4287-8b49-ef977f60c9db None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:02:30.452071 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a1a754-3406-4287-8b49-ef977f60c9db None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:02:30.466937 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2a1a754-3406-4287-8b49-ef977f60c9db None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:02:30.468988 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2a1a754-3406-4287-8b49-ef977f60c9db None admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:02:30.490069 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application [None req-e2a1a754-3406-4287-8b49-ef977f60c9db None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 08:02:30.490069 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:02:30.490069 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:02:30.490069 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:02:30.490069 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:02:30.490069 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:02:30.490069 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:02:30.490069 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:02:30.490069 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:02:30.490069 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:02:30.490069 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:02:30.490069 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:02:30.490069 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 08:02:30.490069 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 08:02:30.490069 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 08:02:30.492085 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 08:02:30.492085 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:02:30.492085 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:02:30.492085 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:02:30.492085 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:02:30.492085 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:02:30.492085 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:02:30.492085 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:02:30.492085 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application with Lock( Jul 28 08:02:30.492085 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:02:30.492085 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:02:30.492085 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:02:30.492085 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:02:30.492085 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:02:30.492085 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:02:30.492085 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:02:30.492085 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:02:30.494330 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 08:02:30.494330 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 08:02:30.494330 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 08:02:30.494330 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application Jul 28 08:02:30.494330 dv-cinder-851351-1-smb devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 599/1228] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 08:02:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 08:02:30.499601 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecbd5c6c-6c8d-4fd0-8899-99be27a40ae4 None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:02:30.652157 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecbd5c6c-6c8d-4fd0-8899-99be27a40ae4 None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:02:30.654965 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:02:30.695187 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d603c4b-2d04-419d-8d5a-aadcf9544d64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:02:30.696208 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d603c4b-2d04-419d-8d5a-aadcf9544d64 None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:02:30.696683 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d603c4b-2d04-419d-8d5a-aadcf9544d64 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:02:30.697155 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d603c4b-2d04-419d-8d5a-aadcf9544d64 None admin] PATH_INFO: `/v3/domains` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:02:30.698375 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d603c4b-2d04-419d-8d5a-aadcf9544d64 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:02:30.698881 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d603c4b-2d04-419d-8d5a-aadcf9544d64 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:02:30.701421 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d603c4b-2d04-419d-8d5a-aadcf9544d64 None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:02:30.722306 dv-cinder-851351-1-smb devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 630/1229] 10.222.0.42 () {56 vars in 1109 bytes} [Thu Jul 28 08:02:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:02:30.729472 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a1a754-3406-4287-8b49-ef977f60c9db None admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:02:30.743218 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=100 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:02:30.885853 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a1a754-3406-4287-8b49-ef977f60c9db None admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:02:30.943071 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef58166e-fc96-4c52-9623-4a8622fdd7e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:02:30.943846 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef58166e-fc96-4c52-9623-4a8622fdd7e5 None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:02:30.944195 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef58166e-fc96-4c52-9623-4a8622fdd7e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:02:30.944575 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef58166e-fc96-4c52-9623-4a8622fdd7e5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:02:30.955079 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef58166e-fc96-4c52-9623-4a8622fdd7e5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:02:30.956835 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef58166e-fc96-4c52-9623-4a8622fdd7e5 None admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:02:30.973463 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application [None req-ef58166e-fc96-4c52-9623-4a8622fdd7e5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 08:02:30.973463 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:02:30.973463 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:02:30.973463 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:02:30.973463 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:02:30.973463 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:02:30.973463 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:02:30.973463 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:02:30.973463 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:02:30.973463 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:02:30.973463 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:02:30.973463 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:02:30.973463 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 28 08:02:30.973463 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 28 08:02:30.973463 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 28 08:02:30.975162 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 28 08:02:30.975162 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:02:30.975162 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:02:30.975162 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:02:30.975162 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:02:30.975162 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:02:30.975162 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:02:30.975162 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:02:30.975162 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application with Lock( Jul 28 08:02:30.975162 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:02:30.975162 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:02:30.975162 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:02:30.975162 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:02:30.975162 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:02:30.975162 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:02:30.975162 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:02:30.975162 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:02:30.976534 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 28 08:02:30.976534 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 28 08:02:30.976534 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 28 08:02:30.976534 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 28 08:02:30.976534 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 28 08:02:30.976534 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 28 08:02:30.976534 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 08:02:30.976534 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application Jul 28 08:02:30.976534 dv-cinder-851351-1-smb devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 600/1230] 10.222.0.42 () {56 vars in 1111 bytes} [Thu Jul 28 08:02:30 2022] GET /identity/v3/projects/service => generated 88 bytes in 247 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:02:30.983773 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d603c4b-2d04-419d-8d5a-aadcf9544d64 None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:02:31.126766 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d603c4b-2d04-419d-8d5a-aadcf9544d64 None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:02:31.177420 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c7a422-0432-4f82-a7b2-03a20ec99601 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:02:31.178189 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c7a422-0432-4f82-a7b2-03a20ec99601 None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:02:31.178565 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c7a422-0432-4f82-a7b2-03a20ec99601 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:02:31.178992 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c7a422-0432-4f82-a7b2-03a20ec99601 None admin] PATH_INFO: `/v3/projects` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:02:31.180091 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2c7a422-0432-4f82-a7b2-03a20ec99601 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:02:31.180649 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2c7a422-0432-4f82-a7b2-03a20ec99601 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:02:31.183222 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2c7a422-0432-4f82-a7b2-03a20ec99601 None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:02:31.199017 dv-cinder-851351-1-smb devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 631/1231] 10.222.0.42 () {56 vars in 1148 bytes} [Thu Jul 28 08:02:30 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:02:31.205801 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef58166e-fc96-4c52-9623-4a8622fdd7e5 None admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:02:31.284687 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=100 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:02:31.330580 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef58166e-fc96-4c52-9623-4a8622fdd7e5 None admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:02:31.382850 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae92e06b-efa1-4846-9243-c783b6b950a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:02:31.383623 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae92e06b-efa1-4846-9243-c783b6b950a8 None admin] REQUEST_METHOD: `PUT` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:02:31.384061 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae92e06b-efa1-4846-9243-c783b6b950a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:02:31.384508 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae92e06b-efa1-4846-9243-c783b6b950a8 None admin] PATH_INFO: `/v3/projects/139349507026497c98f360774dee737e/users/5db0b219e0d24284907722fbf18ca3e8/roles/a2d02bc3295c4a33b1fc0775a17a79e6` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:02:31.410836 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae92e06b-efa1-4846-9243-c783b6b950a8 None admin] RBAC: Authorizing `identity:create_grant(project_id=139349507026497c98f360774dee737e, user_id=5db0b219e0d24284907722fbf18ca3e8, role_id=a2d02bc3295c4a33b1fc0775a17a79e6)` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:02:31.413855 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae92e06b-efa1-4846-9243-c783b6b950a8 None admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:02:31.437481 dv-cinder-851351-1-smb devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 601/1232] 10.222.0.42 () {58 vars in 1439 bytes} [Thu Jul 28 08:02:31 2022] PUT /identity/v3/projects/139349507026497c98f360774dee737e/users/5db0b219e0d24284907722fbf18ca3e8/roles/a2d02bc3295c4a33b1fc0775a17a79e6 => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 28 08:02:33.607519 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09857b49-af1e-42fe-b5fb-c8c9b7e02ae8 None None] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:02:33.608514 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09857b49-af1e-42fe-b5fb-c8c9b7e02ae8 None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:02:33.608514 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09857b49-af1e-42fe-b5fb-c8c9b7e02ae8 None None] PATH_INFO: `/` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:02:33.609651 dv-cinder-851351-1-smb devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 632/1233] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 08:02:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 08:02:33.616938 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b2b4da-d764-4344-9ba9-ae154483361d None None] REQUEST_METHOD: `POST` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:02:33.617589 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b2b4da-d764-4344-9ba9-ae154483361d None None] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:02:33.617589 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b2b4da-d764-4344-9ba9-ae154483361d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:02:33.637174 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.auth.core [None req-e5b2b4da-d764-4344-9ba9-ae154483361d None None] MFA Rules not processed for user `f0666d3a50644a7097367331c1ee1a68`. Rule list: `[]` (Enabled: `True`). {{(pid=80348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 08:02:33.638539 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.fernet_utils [None req-e5b2b4da-d764-4344-9ba9-ae154483361d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:02:33.727759 dv-cinder-851351-1-smb devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 602/1234] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 08:02:33 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 08:02:33.755761 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09857b49-af1e-42fe-b5fb-c8c9b7e02ae8 None None] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:02:33.790912 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:02:33.885627 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09857b49-af1e-42fe-b5fb-c8c9b7e02ae8 None None] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:02:33.926841 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b443287-087e-477e-941b-276b1941edfa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:02:33.927911 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b443287-087e-477e-941b-276b1941edfa None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:02:33.928780 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b443287-087e-477e-941b-276b1941edfa None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:02:33.928780 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b443287-087e-477e-941b-276b1941edfa None admin] PATH_INFO: `/v3/roles/service` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:02:33.944708 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b443287-087e-477e-941b-276b1941edfa None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 08:02:33.946577 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application [None req-7b443287-087e-477e-941b-276b1941edfa None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 28 08:02:33.946577 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:02:33.946577 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:02:33.946577 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:02:33.946577 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:02:33.946577 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:02:33.946577 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:02:33.946577 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:02:33.946577 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:02:33.946577 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:02:33.946577 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:02:33.946577 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:02:33.946577 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 08:02:33.946577 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 08:02:33.946577 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 08:02:33.946577 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 08:02:33.948698 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 08:02:33.948698 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 08:02:33.948698 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 08:02:33.948698 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 08:02:33.948698 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:02:33.948698 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:02:33.948698 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:02:33.948698 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:02:33.948698 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:02:33.948698 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:02:33.948698 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:02:33.948698 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application with Lock( Jul 28 08:02:33.948698 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:02:33.948698 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:02:33.948698 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:02:33.948698 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:02:33.950502 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:02:33.950502 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:02:33.950502 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:02:33.950502 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:02:33.950502 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 08:02:33.950502 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 08:02:33.950502 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 08:02:33.950502 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 08:02:33.950502 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 08:02:33.950502 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 08:02:33.950502 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 28 08:02:33.950502 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application Jul 28 08:02:33.950502 dv-cinder-851351-1-smb devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 633/1235] 10.222.0.42 () {56 vars in 1102 bytes} [Thu Jul 28 08:02:33 2022] GET /identity/v3/roles/service => generated 85 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:02:33.955249 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b2b4da-d764-4344-9ba9-ae154483361d None None] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:02:34.040878 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:02:34.117101 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b2b4da-d764-4344-9ba9-ae154483361d None None] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:02:34.155960 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b59d048-8e48-4b5c-8914-8185cb821854 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:02:34.156511 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b59d048-8e48-4b5c-8914-8185cb821854 None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:02:34.156819 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b59d048-8e48-4b5c-8914-8185cb821854 None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:02:34.157093 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b59d048-8e48-4b5c-8914-8185cb821854 None admin] PATH_INFO: `/v3/roles` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:02:34.157835 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b59d048-8e48-4b5c-8914-8185cb821854 None admin] RBAC: Adding query filter params (name=service) {{(pid=80348) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:02:34.158135 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b59d048-8e48-4b5c-8914-8185cb821854 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:02:34.159530 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b59d048-8e48-4b5c-8914-8185cb821854 None admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:02:34.178200 dv-cinder-851351-1-smb devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 603/1236] 10.222.0.42 () {56 vars in 1103 bytes} [Thu Jul 28 08:02:33 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:02:34.179794 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b443287-087e-477e-941b-276b1941edfa None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:02:34.310578 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:02:34.345892 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b443287-087e-477e-941b-276b1941edfa None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:02:34.412474 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38bc694-5fdb-4243-941c-5e853aca2ec5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:02:34.413495 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38bc694-5fdb-4243-941c-5e853aca2ec5 None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:02:34.413805 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38bc694-5fdb-4243-941c-5e853aca2ec5 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:02:34.414207 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38bc694-5fdb-4243-941c-5e853aca2ec5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:02:34.432187 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a38bc694-5fdb-4243-941c-5e853aca2ec5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:02:34.433715 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a38bc694-5fdb-4243-941c-5e853aca2ec5 None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:02:34.449951 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application [None req-a38bc694-5fdb-4243-941c-5e853aca2ec5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 08:02:34.449951 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:02:34.449951 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:02:34.449951 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:02:34.449951 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:02:34.449951 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:02:34.449951 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:02:34.449951 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:02:34.449951 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:02:34.449951 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:02:34.449951 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:02:34.449951 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:02:34.449951 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 08:02:34.449951 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 08:02:34.449951 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 08:02:34.452857 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 08:02:34.452857 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:02:34.452857 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:02:34.452857 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:02:34.452857 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:02:34.452857 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:02:34.452857 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:02:34.452857 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:02:34.452857 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application with Lock( Jul 28 08:02:34.452857 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:02:34.452857 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:02:34.452857 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:02:34.452857 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:02:34.452857 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:02:34.452857 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:02:34.452857 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:02:34.452857 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:02:34.454738 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 08:02:34.454738 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 08:02:34.454738 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 08:02:34.454738 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application Jul 28 08:02:34.454738 dv-cinder-851351-1-smb devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 634/1237] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 08:02:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 272 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:02:34.459004 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b59d048-8e48-4b5c-8914-8185cb821854 None admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:02:34.596198 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b59d048-8e48-4b5c-8914-8185cb821854 None admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:02:34.611700 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=100 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:02:34.642266 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7bbd69-02b2-4148-ae03-2bb6b5d2a5f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:02:34.643253 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7bbd69-02b2-4148-ae03-2bb6b5d2a5f8 None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:02:34.643253 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7bbd69-02b2-4148-ae03-2bb6b5d2a5f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:02:34.643545 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7bbd69-02b2-4148-ae03-2bb6b5d2a5f8 None admin] PATH_INFO: `/v3/domains` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:02:34.644105 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c7bbd69-02b2-4148-ae03-2bb6b5d2a5f8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80348) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:02:34.644406 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c7bbd69-02b2-4148-ae03-2bb6b5d2a5f8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:02:34.646039 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c7bbd69-02b2-4148-ae03-2bb6b5d2a5f8 None admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:02:34.660304 dv-cinder-851351-1-smb devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 604/1238] 10.222.0.42 () {56 vars in 1109 bytes} [Thu Jul 28 08:02:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 08:02:34.666334 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38bc694-5fdb-4243-941c-5e853aca2ec5 None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:02:34.816284 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38bc694-5fdb-4243-941c-5e853aca2ec5 None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:02:34.859074 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d4ff3c-cc37-42a0-9ad9-a499b8486458 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:02:34.859736 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d4ff3c-cc37-42a0-9ad9-a499b8486458 None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:02:34.860003 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d4ff3c-cc37-42a0-9ad9-a499b8486458 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:02:34.860268 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d4ff3c-cc37-42a0-9ad9-a499b8486458 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:02:34.863396 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:02:34.869925 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d4ff3c-cc37-42a0-9ad9-a499b8486458 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:02:34.872030 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d4ff3c-cc37-42a0-9ad9-a499b8486458 None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:02:34.887191 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application [None req-a4d4ff3c-cc37-42a0-9ad9-a499b8486458 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 28 08:02:34.887191 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:02:34.887191 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:02:34.887191 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:02:34.887191 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:02:34.887191 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:02:34.887191 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:02:34.887191 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:02:34.887191 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:02:34.887191 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:02:34.887191 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:02:34.887191 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:02:34.887191 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 28 08:02:34.887191 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 28 08:02:34.887191 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 28 08:02:34.887191 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 28 08:02:34.889360 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:02:34.889360 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:02:34.889360 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 28 08:02:34.889360 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 08:02:34.889360 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 28 08:02:34.889360 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 08:02:34.889360 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:02:34.889360 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:02:34.889360 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:02:34.889360 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:02:34.889360 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:02:34.889360 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application with Lock( Jul 28 08:02:34.889360 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:02:34.889360 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:02:34.889360 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:02:34.889360 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:02:34.889360 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:02:34.889360 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:02:34.891161 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:02:34.891161 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:02:34.891161 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 28 08:02:34.891161 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 28 08:02:34.891161 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 28 08:02:34.891161 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 28 08:02:34.891161 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 28 08:02:34.891161 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 28 08:02:34.891161 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 28 08:02:34.891161 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application Jul 28 08:02:34.891161 dv-cinder-851351-1-smb devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 635/1239] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 08:02:34 2022] GET /identity/v3/users/placement => generated 87 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 08:02:34.896493 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7bbd69-02b2-4148-ae03-2bb6b5d2a5f8 None admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:02:35.037607 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7bbd69-02b2-4148-ae03-2bb6b5d2a5f8 None admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:02:35.097194 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8249022f-33d7-4159-a16e-ec5a6be756a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:02:35.097965 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8249022f-33d7-4159-a16e-ec5a6be756a1 None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:02:35.098270 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8249022f-33d7-4159-a16e-ec5a6be756a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:02:35.098727 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8249022f-33d7-4159-a16e-ec5a6be756a1 None admin] PATH_INFO: `/v3/users` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:02:35.099581 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8249022f-33d7-4159-a16e-ec5a6be756a1 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80348) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:02:35.099891 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8249022f-33d7-4159-a16e-ec5a6be756a1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:02:35.101556 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8249022f-33d7-4159-a16e-ec5a6be756a1 None admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:02:35.130734 dv-cinder-851351-1-smb devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 605/1240] 10.222.0.42 () {56 vars in 1143 bytes} [Thu Jul 28 08:02:34 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:02:35.139880 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d4ff3c-cc37-42a0-9ad9-a499b8486458 None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:02:35.296451 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d4ff3c-cc37-42a0-9ad9-a499b8486458 None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:02:35.340484 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f765ee50-63a3-4de5-90b5-815aad7d1a22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:02:35.341157 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f765ee50-63a3-4de5-90b5-815aad7d1a22 None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:02:35.341438 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f765ee50-63a3-4de5-90b5-815aad7d1a22 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:02:35.341709 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f765ee50-63a3-4de5-90b5-815aad7d1a22 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:02:35.428095 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:02:35.442578 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f765ee50-63a3-4de5-90b5-815aad7d1a22 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:02:35.444748 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f765ee50-63a3-4de5-90b5-815aad7d1a22 None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:02:35.597444 dv-cinder-851351-1-smb devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 636/1241] 10.222.0.42 () {58 vars in 1282 bytes} [Thu Jul 28 08:02:35 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 452 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 28 08:02:35.599347 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8249022f-33d7-4159-a16e-ec5a6be756a1 None admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:02:35.633857 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=100 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:02:35.743771 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8249022f-33d7-4159-a16e-ec5a6be756a1 None admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:02:35.794129 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27e8041-d1d3-488d-b8fb-70d2a4c9fc5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:02:35.794814 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27e8041-d1d3-488d-b8fb-70d2a4c9fc5e None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:02:35.795089 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27e8041-d1d3-488d-b8fb-70d2a4c9fc5e None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:02:35.795359 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27e8041-d1d3-488d-b8fb-70d2a4c9fc5e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:02:35.809270 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b27e8041-d1d3-488d-b8fb-70d2a4c9fc5e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:02:35.810825 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b27e8041-d1d3-488d-b8fb-70d2a4c9fc5e None admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:02:35.834888 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application [None req-b27e8041-d1d3-488d-b8fb-70d2a4c9fc5e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 08:02:35.834888 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:02:35.834888 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:02:35.834888 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:02:35.834888 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:02:35.834888 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:02:35.834888 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:02:35.834888 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:02:35.834888 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:02:35.834888 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:02:35.834888 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:02:35.834888 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:02:35.834888 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 08:02:35.834888 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 08:02:35.834888 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 08:02:35.835993 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 08:02:35.835993 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:02:35.835993 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:02:35.835993 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:02:35.835993 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:02:35.835993 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:02:35.835993 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:02:35.835993 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:02:35.835993 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application with Lock( Jul 28 08:02:35.835993 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:02:35.835993 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:02:35.835993 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:02:35.835993 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:02:35.835993 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:02:35.835993 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:02:35.835993 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:02:35.835993 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:02:35.837040 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 08:02:35.837040 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 08:02:35.837040 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 08:02:35.837040 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application Jul 28 08:02:35.837040 dv-cinder-851351-1-smb devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 606/1242] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 08:02:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:02:35.845089 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f765ee50-63a3-4de5-90b5-815aad7d1a22 None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:02:36.010408 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:02:36.021530 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f765ee50-63a3-4de5-90b5-815aad7d1a22 None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:02:36.074875 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee58107-67ff-453c-bc4d-13ebbb3bffce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:02:36.075517 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee58107-67ff-453c-bc4d-13ebbb3bffce None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:02:36.075784 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee58107-67ff-453c-bc4d-13ebbb3bffce None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:02:36.076056 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee58107-67ff-453c-bc4d-13ebbb3bffce None admin] PATH_INFO: `/v3/domains` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:02:36.076880 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ee58107-67ff-453c-bc4d-13ebbb3bffce None admin] RBAC: Adding query filter params (name=Default) {{(pid=80347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:02:36.077542 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ee58107-67ff-453c-bc4d-13ebbb3bffce None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:02:36.078968 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ee58107-67ff-453c-bc4d-13ebbb3bffce None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:02:36.098450 dv-cinder-851351-1-smb devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 637/1243] 10.222.0.42 () {56 vars in 1109 bytes} [Thu Jul 28 08:02:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:02:36.107884 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27e8041-d1d3-488d-b8fb-70d2a4c9fc5e None admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:02:36.221896 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=100 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:02:36.256920 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27e8041-d1d3-488d-b8fb-70d2a4c9fc5e None admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:02:36.319942 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc866af2-9c0f-493f-aae9-6b2eb15910c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:02:36.320966 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc866af2-9c0f-493f-aae9-6b2eb15910c9 None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:02:36.321463 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc866af2-9c0f-493f-aae9-6b2eb15910c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:02:36.321967 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc866af2-9c0f-493f-aae9-6b2eb15910c9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:02:36.337520 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc866af2-9c0f-493f-aae9-6b2eb15910c9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:02:36.340654 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc866af2-9c0f-493f-aae9-6b2eb15910c9 None admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:02:36.358457 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application [None req-dc866af2-9c0f-493f-aae9-6b2eb15910c9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 08:02:36.358457 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:02:36.358457 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:02:36.358457 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:02:36.358457 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:02:36.358457 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:02:36.358457 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:02:36.358457 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:02:36.358457 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:02:36.358457 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:02:36.358457 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:02:36.358457 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:02:36.358457 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 28 08:02:36.358457 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 28 08:02:36.358457 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 28 08:02:36.360408 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 28 08:02:36.360408 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:02:36.360408 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:02:36.360408 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:02:36.360408 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:02:36.360408 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:02:36.360408 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:02:36.360408 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:02:36.360408 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application with Lock( Jul 28 08:02:36.360408 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:02:36.360408 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:02:36.360408 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:02:36.360408 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:02:36.360408 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:02:36.360408 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:02:36.360408 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:02:36.360408 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:02:36.362089 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 28 08:02:36.362089 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 28 08:02:36.362089 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 28 08:02:36.362089 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 28 08:02:36.362089 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 28 08:02:36.362089 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 28 08:02:36.362089 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 08:02:36.362089 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application Jul 28 08:02:36.362089 dv-cinder-851351-1-smb devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 607/1244] 10.222.0.42 () {56 vars in 1111 bytes} [Thu Jul 28 08:02:36 2022] GET /identity/v3/projects/service => generated 88 bytes in 253 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:02:36.367137 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee58107-67ff-453c-bc4d-13ebbb3bffce None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:02:36.516922 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee58107-67ff-453c-bc4d-13ebbb3bffce None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:02:36.575310 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279ab83d-b19c-41d5-ab47-97bef73da914 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:02:36.576335 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279ab83d-b19c-41d5-ab47-97bef73da914 None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:02:36.577054 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279ab83d-b19c-41d5-ab47-97bef73da914 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:02:36.577893 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279ab83d-b19c-41d5-ab47-97bef73da914 None admin] PATH_INFO: `/v3/projects` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:02:36.578956 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-279ab83d-b19c-41d5-ab47-97bef73da914 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:02:36.579485 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-279ab83d-b19c-41d5-ab47-97bef73da914 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:02:36.581386 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-279ab83d-b19c-41d5-ab47-97bef73da914 None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:02:36.608686 dv-cinder-851351-1-smb devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 638/1245] 10.222.0.42 () {56 vars in 1148 bytes} [Thu Jul 28 08:02:36 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:02:36.610565 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc866af2-9c0f-493f-aae9-6b2eb15910c9 None admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:02:36.788462 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc866af2-9c0f-493f-aae9-6b2eb15910c9 None admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:02:36.846705 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a83b439-6016-4744-b191-c5bf1970e565 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:02:36.847582 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a83b439-6016-4744-b191-c5bf1970e565 None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:02:36.848006 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a83b439-6016-4744-b191-c5bf1970e565 None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:02:36.848497 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a83b439-6016-4744-b191-c5bf1970e565 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:02:36.849918 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a83b439-6016-4744-b191-c5bf1970e565 None admin] RBAC: Adding query filter params (role.id=a2d02bc3295c4a33b1fc0775a17a79e6, scope.project.id=139349507026497c98f360774dee737e, user.id=5db0b219e0d24284907722fbf18ca3e8) {{(pid=80348) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:02:36.850397 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a83b439-6016-4744-b191-c5bf1970e565 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:02:36.853024 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a83b439-6016-4744-b191-c5bf1970e565 None admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:02:36.863843 dv-cinder-851351-1-smb devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 608/1246] 10.222.0.42 () {56 vars in 1374 bytes} [Thu Jul 28 08:02:36 2022] GET /identity/v3/role_assignments?user.id=5db0b219e0d24284907722fbf18ca3e8&scope.project.id=139349507026497c98f360774dee737e&role.id=a2d02bc3295c4a33b1fc0775a17a79e6 => generated 608 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:02:39.802861 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8c5ac4-398f-434b-b7c4-b40dee47e8d9 None None] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:02:39.803469 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8c5ac4-398f-434b-b7c4-b40dee47e8d9 None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:02:39.803469 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8c5ac4-398f-434b-b7c4-b40dee47e8d9 None None] PATH_INFO: `/` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:02:39.804814 dv-cinder-851351-1-smb devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 639/1247] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 08:02:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 08:02:39.815984 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484c3a77-1e05-41a9-8e63-d49a5625b310 None None] REQUEST_METHOD: `POST` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:02:39.816517 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484c3a77-1e05-41a9-8e63-d49a5625b310 None None] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:02:39.817159 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484c3a77-1e05-41a9-8e63-d49a5625b310 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:02:39.830062 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=100 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:02:39.847286 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.auth.core [None req-484c3a77-1e05-41a9-8e63-d49a5625b310 None None] MFA Rules not processed for user `f0666d3a50644a7097367331c1ee1a68`. Rule list: `[]` (Enabled: `True`). {{(pid=80348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 08:02:39.848954 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.fernet_utils [None req-484c3a77-1e05-41a9-8e63-d49a5625b310 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:02:39.967668 dv-cinder-851351-1-smb devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 609/1248] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 08:02:39 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 08:02:39.992969 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8c5ac4-398f-434b-b7c4-b40dee47e8d9 None None] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:02:40.018500 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:02:40.137072 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8c5ac4-398f-434b-b7c4-b40dee47e8d9 None None] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:02:40.192221 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799146a6-90be-4b84-94fb-8e37ebc9ae79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:02:40.192957 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799146a6-90be-4b84-94fb-8e37ebc9ae79 None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:02:40.193228 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799146a6-90be-4b84-94fb-8e37ebc9ae79 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:02:40.193501 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799146a6-90be-4b84-94fb-8e37ebc9ae79 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:02:40.213248 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-799146a6-90be-4b84-94fb-8e37ebc9ae79 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 08:02:40.223690 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application [None req-799146a6-90be-4b84-94fb-8e37ebc9ae79 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 08:02:40.223690 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:02:40.223690 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:02:40.223690 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:02:40.223690 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:02:40.223690 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:02:40.223690 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:02:40.223690 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:02:40.223690 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:02:40.223690 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:02:40.223690 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:02:40.223690 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:02:40.223690 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 08:02:40.223690 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 08:02:40.223690 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 08:02:40.223690 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 08:02:40.225037 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 08:02:40.225037 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 08:02:40.225037 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 08:02:40.225037 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 08:02:40.225037 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:02:40.225037 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:02:40.225037 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:02:40.225037 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:02:40.225037 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:02:40.225037 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:02:40.225037 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:02:40.225037 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application with Lock( Jul 28 08:02:40.225037 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:02:40.225037 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:02:40.225037 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:02:40.225037 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:02:40.226879 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:02:40.226879 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:02:40.226879 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:02:40.226879 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:02:40.226879 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 08:02:40.226879 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 08:02:40.226879 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 08:02:40.226879 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 08:02:40.226879 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 08:02:40.226879 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 08:02:40.226879 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 08:02:40.226879 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application Jul 28 08:02:40.226879 dv-cinder-851351-1-smb devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 640/1249] 10.222.0.42 () {56 vars in 1096 bytes} [Thu Jul 28 08:02:39 2022] GET /identity/v3/roles/admin => generated 83 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:02:40.236174 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-484c3a77-1e05-41a9-8e63-d49a5625b310 None None] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:02:40.383342 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-484c3a77-1e05-41a9-8e63-d49a5625b310 None None] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:02:40.426264 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=100 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:02:40.435751 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e7bfe6-7711-4933-aeeb-c60d25967b02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:02:40.436911 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e7bfe6-7711-4933-aeeb-c60d25967b02 None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:02:40.437388 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e7bfe6-7711-4933-aeeb-c60d25967b02 None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:02:40.437859 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e7bfe6-7711-4933-aeeb-c60d25967b02 None admin] PATH_INFO: `/v3/roles` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:02:40.439192 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6e7bfe6-7711-4933-aeeb-c60d25967b02 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80348) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:02:40.439775 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6e7bfe6-7711-4933-aeeb-c60d25967b02 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:02:40.442288 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6e7bfe6-7711-4933-aeeb-c60d25967b02 None admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:02:40.461144 dv-cinder-851351-1-smb devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 610/1250] 10.222.0.42 () {56 vars in 1099 bytes} [Thu Jul 28 08:02:40 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:02:40.468174 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799146a6-90be-4b84-94fb-8e37ebc9ae79 None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:02:40.587622 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:02:40.624095 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799146a6-90be-4b84-94fb-8e37ebc9ae79 None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:02:40.670133 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c5cbdb-ce6e-4fb9-aca1-275d42579284 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:02:40.670884 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c5cbdb-ce6e-4fb9-aca1-275d42579284 None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:02:40.671169 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c5cbdb-ce6e-4fb9-aca1-275d42579284 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:02:40.671433 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c5cbdb-ce6e-4fb9-aca1-275d42579284 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:02:40.686603 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c5cbdb-ce6e-4fb9-aca1-275d42579284 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:02:40.689285 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c5cbdb-ce6e-4fb9-aca1-275d42579284 None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:02:40.709097 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application [None req-a9c5cbdb-ce6e-4fb9-aca1-275d42579284 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 08:02:40.709097 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:02:40.709097 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:02:40.709097 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:02:40.709097 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:02:40.709097 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:02:40.709097 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:02:40.709097 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:02:40.709097 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:02:40.709097 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:02:40.709097 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:02:40.709097 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:02:40.709097 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 08:02:40.709097 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 08:02:40.709097 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 08:02:40.710761 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 08:02:40.710761 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:02:40.710761 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:02:40.710761 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:02:40.710761 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:02:40.710761 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:02:40.710761 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:02:40.710761 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:02:40.710761 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application with Lock( Jul 28 08:02:40.710761 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:02:40.710761 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:02:40.710761 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:02:40.710761 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:02:40.710761 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:02:40.710761 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:02:40.710761 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:02:40.710761 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:02:40.712008 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 08:02:40.712008 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 08:02:40.712008 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 08:02:40.712008 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application Jul 28 08:02:40.712008 dv-cinder-851351-1-smb devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 641/1251] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 08:02:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 243 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 08:02:40.719950 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e7bfe6-7711-4933-aeeb-c60d25967b02 None admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:02:40.884068 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e7bfe6-7711-4933-aeeb-c60d25967b02 None admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:02:40.947471 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c5546f-ae4d-4f43-bd5a-b7270ecff4b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:02:40.948169 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c5546f-ae4d-4f43-bd5a-b7270ecff4b3 None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:02:40.948543 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c5546f-ae4d-4f43-bd5a-b7270ecff4b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:02:40.948971 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c5546f-ae4d-4f43-bd5a-b7270ecff4b3 None admin] PATH_INFO: `/v3/domains` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:02:40.950119 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c5546f-ae4d-4f43-bd5a-b7270ecff4b3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80348) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:02:40.950597 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c5546f-ae4d-4f43-bd5a-b7270ecff4b3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:02:40.953306 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c5546f-ae4d-4f43-bd5a-b7270ecff4b3 None admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:02:40.975622 dv-cinder-851351-1-smb devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 611/1252] 10.222.0.42 () {56 vars in 1109 bytes} [Thu Jul 28 08:02:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:02:40.984162 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c5cbdb-ce6e-4fb9-aca1-275d42579284 None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:02:41.151189 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c5cbdb-ce6e-4fb9-aca1-275d42579284 None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:02:41.196818 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:02:41.210255 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94fa058c-8b97-4aa5-88d2-39fce063ab29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:02:41.211016 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fa058c-8b97-4aa5-88d2-39fce063ab29 None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:02:41.211331 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fa058c-8b97-4aa5-88d2-39fce063ab29 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:02:41.211766 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fa058c-8b97-4aa5-88d2-39fce063ab29 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:02:41.222079 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94fa058c-8b97-4aa5-88d2-39fce063ab29 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:02:41.224021 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94fa058c-8b97-4aa5-88d2-39fce063ab29 None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:02:41.248405 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application [None req-94fa058c-8b97-4aa5-88d2-39fce063ab29 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 28 08:02:41.248405 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:02:41.248405 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:02:41.248405 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:02:41.248405 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:02:41.248405 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:02:41.248405 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:02:41.248405 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:02:41.248405 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:02:41.248405 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:02:41.248405 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:02:41.248405 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:02:41.248405 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 28 08:02:41.248405 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 28 08:02:41.248405 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 28 08:02:41.248405 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 28 08:02:41.250618 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:02:41.250618 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:02:41.250618 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 28 08:02:41.250618 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 08:02:41.250618 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 28 08:02:41.250618 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 08:02:41.250618 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:02:41.250618 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:02:41.250618 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:02:41.250618 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:02:41.250618 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:02:41.250618 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application with Lock( Jul 28 08:02:41.250618 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:02:41.250618 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:02:41.250618 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:02:41.250618 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:02:41.250618 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:02:41.250618 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:02:41.252344 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:02:41.252344 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:02:41.252344 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 28 08:02:41.252344 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 28 08:02:41.252344 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 28 08:02:41.252344 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 28 08:02:41.252344 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 28 08:02:41.252344 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 28 08:02:41.252344 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 28 08:02:41.252344 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application Jul 28 08:02:41.252344 dv-cinder-851351-1-smb devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 642/1253] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 08:02:40 2022] GET /identity/v3/users/placement => generated 87 bytes in 267 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:02:41.256615 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c5546f-ae4d-4f43-bd5a-b7270ecff4b3 None admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:02:41.329205 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=100 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:02:41.382597 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c5546f-ae4d-4f43-bd5a-b7270ecff4b3 None admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:02:41.427173 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b6af78-1b3b-4f9d-97b2-12bf73d7581a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:02:41.428061 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b6af78-1b3b-4f9d-97b2-12bf73d7581a None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:02:41.428455 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b6af78-1b3b-4f9d-97b2-12bf73d7581a None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:02:41.428908 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b6af78-1b3b-4f9d-97b2-12bf73d7581a None admin] PATH_INFO: `/v3/users` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:02:41.431040 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8b6af78-1b3b-4f9d-97b2-12bf73d7581a None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80348) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:02:41.431970 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8b6af78-1b3b-4f9d-97b2-12bf73d7581a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:02:41.433946 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8b6af78-1b3b-4f9d-97b2-12bf73d7581a None admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:02:41.459869 dv-cinder-851351-1-smb devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 612/1254] 10.222.0.42 () {56 vars in 1143 bytes} [Thu Jul 28 08:02:41 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 08:02:41.466560 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94fa058c-8b97-4aa5-88d2-39fce063ab29 None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:02:41.606994 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94fa058c-8b97-4aa5-88d2-39fce063ab29 None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:02:41.659112 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de25b759-6252-454b-8a8d-d70bc7347124 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:02:41.659756 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de25b759-6252-454b-8a8d-d70bc7347124 None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:02:41.660036 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de25b759-6252-454b-8a8d-d70bc7347124 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:02:41.660320 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de25b759-6252-454b-8a8d-d70bc7347124 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:02:41.742675 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:02:41.762557 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de25b759-6252-454b-8a8d-d70bc7347124 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:02:41.765282 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de25b759-6252-454b-8a8d-d70bc7347124 None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:02:41.929309 dv-cinder-851351-1-smb devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 643/1255] 10.222.0.42 () {58 vars in 1282 bytes} [Thu Jul 28 08:02:41 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 464 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 28 08:02:41.936173 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b6af78-1b3b-4f9d-97b2-12bf73d7581a None admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:02:42.077819 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b6af78-1b3b-4f9d-97b2-12bf73d7581a None admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:02:42.094152 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=100 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:02:42.122830 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78068ef1-2887-4d2a-829c-da8d55546482 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:02:42.123668 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78068ef1-2887-4d2a-829c-da8d55546482 None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:02:42.124021 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78068ef1-2887-4d2a-829c-da8d55546482 None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:02:42.124436 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78068ef1-2887-4d2a-829c-da8d55546482 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:02:42.141331 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78068ef1-2887-4d2a-829c-da8d55546482 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:02:42.143034 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78068ef1-2887-4d2a-829c-da8d55546482 None admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:02:42.167315 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application [None req-78068ef1-2887-4d2a-829c-da8d55546482 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 08:02:42.167315 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:02:42.167315 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:02:42.167315 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:02:42.167315 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:02:42.167315 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:02:42.167315 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:02:42.167315 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:02:42.167315 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:02:42.167315 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:02:42.167315 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:02:42.167315 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:02:42.167315 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 08:02:42.167315 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 08:02:42.167315 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 08:02:42.168391 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 08:02:42.168391 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:02:42.168391 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:02:42.168391 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:02:42.168391 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:02:42.168391 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:02:42.168391 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:02:42.168391 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:02:42.168391 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application with Lock( Jul 28 08:02:42.168391 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:02:42.168391 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:02:42.168391 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:02:42.168391 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:02:42.168391 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:02:42.168391 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:02:42.168391 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:02:42.168391 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:02:42.169448 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 08:02:42.169448 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 08:02:42.169448 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 08:02:42.169448 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application Jul 28 08:02:42.169448 dv-cinder-851351-1-smb devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 613/1256] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 08:02:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 08:02:42.181571 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de25b759-6252-454b-8a8d-d70bc7347124 None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:02:42.301156 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:02:42.316124 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de25b759-6252-454b-8a8d-d70bc7347124 None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:02:42.362110 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54b9896-ed13-444c-9fe9-818071e8926f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:02:42.362897 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54b9896-ed13-444c-9fe9-818071e8926f None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:02:42.363251 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54b9896-ed13-444c-9fe9-818071e8926f None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:02:42.363596 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54b9896-ed13-444c-9fe9-818071e8926f None admin] PATH_INFO: `/v3/domains` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:02:42.364558 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f54b9896-ed13-444c-9fe9-818071e8926f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:02:42.365064 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f54b9896-ed13-444c-9fe9-818071e8926f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:02:42.366805 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f54b9896-ed13-444c-9fe9-818071e8926f None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:02:42.384374 dv-cinder-851351-1-smb devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 644/1257] 10.222.0.42 () {56 vars in 1109 bytes} [Thu Jul 28 08:02:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:02:42.391835 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78068ef1-2887-4d2a-829c-da8d55546482 None admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:02:42.545710 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78068ef1-2887-4d2a-829c-da8d55546482 None admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:02:42.592280 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf4890f-a61b-4b91-85df-4f329a4f0914 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:02:42.593061 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf4890f-a61b-4b91-85df-4f329a4f0914 None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:02:42.593359 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf4890f-a61b-4b91-85df-4f329a4f0914 None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:02:42.593638 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf4890f-a61b-4b91-85df-4f329a4f0914 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:02:42.601296 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cf4890f-a61b-4b91-85df-4f329a4f0914 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:02:42.602750 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cf4890f-a61b-4b91-85df-4f329a4f0914 None admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:02:42.616117 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application [None req-9cf4890f-a61b-4b91-85df-4f329a4f0914 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 08:02:42.616117 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:02:42.616117 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:02:42.616117 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:02:42.616117 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:02:42.616117 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:02:42.616117 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:02:42.616117 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:02:42.616117 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:02:42.616117 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:02:42.616117 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:02:42.616117 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:02:42.616117 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 28 08:02:42.616117 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 28 08:02:42.616117 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 28 08:02:42.618104 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 28 08:02:42.618104 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:02:42.618104 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:02:42.618104 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:02:42.618104 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:02:42.618104 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:02:42.618104 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:02:42.618104 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:02:42.618104 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application with Lock( Jul 28 08:02:42.618104 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:02:42.618104 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:02:42.618104 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:02:42.618104 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:02:42.618104 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:02:42.618104 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:02:42.618104 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:02:42.618104 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:02:42.619987 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 28 08:02:42.619987 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 28 08:02:42.619987 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 28 08:02:42.619987 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 28 08:02:42.619987 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 28 08:02:42.619987 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 28 08:02:42.619987 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 08:02:42.619987 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application Jul 28 08:02:42.619987 dv-cinder-851351-1-smb devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 614/1258] 10.222.0.42 () {56 vars in 1111 bytes} [Thu Jul 28 08:02:42 2022] GET /identity/v3/projects/service => generated 88 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 08:02:42.623601 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54b9896-ed13-444c-9fe9-818071e8926f None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:02:42.793526 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54b9896-ed13-444c-9fe9-818071e8926f None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:02:42.840469 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1bb0df5-4b0d-4258-8753-30f558c96763 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:02:42.841289 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1bb0df5-4b0d-4258-8753-30f558c96763 None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:02:42.841702 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1bb0df5-4b0d-4258-8753-30f558c96763 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:02:42.842097 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1bb0df5-4b0d-4258-8753-30f558c96763 None admin] PATH_INFO: `/v3/projects` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:02:42.843222 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1bb0df5-4b0d-4258-8753-30f558c96763 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:02:42.843806 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1bb0df5-4b0d-4258-8753-30f558c96763 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:02:42.846079 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1bb0df5-4b0d-4258-8753-30f558c96763 None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:02:42.872786 dv-cinder-851351-1-smb devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 645/1259] 10.222.0.42 () {56 vars in 1148 bytes} [Thu Jul 28 08:02:42 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 08:02:42.874212 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf4890f-a61b-4b91-85df-4f329a4f0914 None admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:02:42.914056 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=100 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:02:43.022979 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf4890f-a61b-4b91-85df-4f329a4f0914 None admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:02:43.062997 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-855ef4d2-a10c-477d-9492-d0f9945fcbe0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:02:43.063642 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855ef4d2-a10c-477d-9492-d0f9945fcbe0 None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:02:43.063921 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855ef4d2-a10c-477d-9492-d0f9945fcbe0 None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:02:43.064188 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855ef4d2-a10c-477d-9492-d0f9945fcbe0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:02:43.065070 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-855ef4d2-a10c-477d-9492-d0f9945fcbe0 None admin] RBAC: Adding query filter params (role.id=362bd71ac01249fb8fa635381993eec1, scope.project.id=139349507026497c98f360774dee737e, user.id=5db0b219e0d24284907722fbf18ca3e8) {{(pid=80348) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:02:43.065378 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-855ef4d2-a10c-477d-9492-d0f9945fcbe0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:02:43.066937 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-855ef4d2-a10c-477d-9492-d0f9945fcbe0 None admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:02:43.074031 dv-cinder-851351-1-smb devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 615/1260] 10.222.0.42 () {56 vars in 1374 bytes} [Thu Jul 28 08:02:42 2022] GET /identity/v3/role_assignments?user.id=5db0b219e0d24284907722fbf18ca3e8&scope.project.id=139349507026497c98f360774dee737e&role.id=362bd71ac01249fb8fa635381993eec1 => generated 259 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:02:45.199990 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00c4b46-7b2a-4b5e-b3b1-f81d632815d9 None None] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:02:45.200534 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00c4b46-7b2a-4b5e-b3b1-f81d632815d9 None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:02:45.200534 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00c4b46-7b2a-4b5e-b3b1-f81d632815d9 None None] PATH_INFO: `/` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:02:45.201985 dv-cinder-851351-1-smb devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 646/1261] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 08:02:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 08:02:45.207986 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15315720-3b73-45e4-a83d-3fdf5e8af0d6 None None] REQUEST_METHOD: `POST` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:02:45.208446 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15315720-3b73-45e4-a83d-3fdf5e8af0d6 None None] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:02:45.208554 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15315720-3b73-45e4-a83d-3fdf5e8af0d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:02:45.227076 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.auth.core [None req-15315720-3b73-45e4-a83d-3fdf5e8af0d6 None None] MFA Rules not processed for user `f0666d3a50644a7097367331c1ee1a68`. Rule list: `[]` (Enabled: `True`). {{(pid=80348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 08:02:45.228314 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.fernet_utils [None req-15315720-3b73-45e4-a83d-3fdf5e8af0d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:02:45.297453 dv-cinder-851351-1-smb devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 616/1262] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 08:02:45 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 28 08:02:45.320213 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00c4b46-7b2a-4b5e-b3b1-f81d632815d9 None None] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:02:45.332747 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:02:45.430379 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00c4b46-7b2a-4b5e-b3b1-f81d632815d9 None None] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:02:45.466262 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb69b9dc-cf21-471e-9a85-dd2d3c535429 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:02:45.466903 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb69b9dc-cf21-471e-9a85-dd2d3c535429 None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:02:45.467181 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb69b9dc-cf21-471e-9a85-dd2d3c535429 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:02:45.467447 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb69b9dc-cf21-471e-9a85-dd2d3c535429 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:02:45.478110 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb69b9dc-cf21-471e-9a85-dd2d3c535429 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 08:02:45.482988 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application [None req-fb69b9dc-cf21-471e-9a85-dd2d3c535429 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 08:02:45.482988 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:02:45.482988 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:02:45.482988 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:02:45.482988 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:02:45.482988 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:02:45.482988 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:02:45.482988 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:02:45.482988 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:02:45.482988 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:02:45.482988 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:02:45.482988 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:02:45.482988 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 08:02:45.482988 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 08:02:45.482988 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 08:02:45.482988 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 08:02:45.484071 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 08:02:45.484071 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 08:02:45.484071 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 08:02:45.484071 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 08:02:45.484071 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:02:45.484071 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:02:45.484071 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:02:45.484071 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:02:45.484071 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:02:45.484071 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:02:45.484071 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:02:45.484071 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application with Lock( Jul 28 08:02:45.484071 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:02:45.484071 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:02:45.484071 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:02:45.484071 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:02:45.485000 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:02:45.485000 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:02:45.485000 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:02:45.485000 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:02:45.485000 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 08:02:45.485000 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 08:02:45.485000 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 08:02:45.485000 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 08:02:45.485000 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 08:02:45.485000 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 08:02:45.485000 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 08:02:45.485000 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application Jul 28 08:02:45.485000 dv-cinder-851351-1-smb devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 647/1263] 10.222.0.42 () {56 vars in 1096 bytes} [Thu Jul 28 08:02:45 2022] GET /identity/v3/roles/admin => generated 83 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:02:45.491011 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15315720-3b73-45e4-a83d-3fdf5e8af0d6 None None] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:02:45.524210 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=100 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:02:45.612286 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15315720-3b73-45e4-a83d-3fdf5e8af0d6 None None] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:02:45.648370 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1e2ab8-6d6e-4002-bfad-b05c5e665af8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:02:45.649008 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1e2ab8-6d6e-4002-bfad-b05c5e665af8 None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:02:45.649277 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1e2ab8-6d6e-4002-bfad-b05c5e665af8 None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:02:45.649543 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1e2ab8-6d6e-4002-bfad-b05c5e665af8 None admin] PATH_INFO: `/v3/roles` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:02:45.650259 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c1e2ab8-6d6e-4002-bfad-b05c5e665af8 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80348) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:02:45.650548 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c1e2ab8-6d6e-4002-bfad-b05c5e665af8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:02:45.651931 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c1e2ab8-6d6e-4002-bfad-b05c5e665af8 None admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:02:45.660574 dv-cinder-851351-1-smb devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 617/1264] 10.222.0.42 () {56 vars in 1099 bytes} [Thu Jul 28 08:02:45 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:02:45.666627 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb69b9dc-cf21-471e-9a85-dd2d3c535429 None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:02:45.738318 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:02:45.771210 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb69b9dc-cf21-471e-9a85-dd2d3c535429 None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:02:45.807511 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c9702c9-353d-4e29-8a3c-55cf33ec45c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:02:45.808148 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9702c9-353d-4e29-8a3c-55cf33ec45c8 None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:02:45.808419 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9702c9-353d-4e29-8a3c-55cf33ec45c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:02:45.808697 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9702c9-353d-4e29-8a3c-55cf33ec45c8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:02:45.819362 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c9702c9-353d-4e29-8a3c-55cf33ec45c8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:02:45.820862 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c9702c9-353d-4e29-8a3c-55cf33ec45c8 None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:02:45.837902 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application [None req-4c9702c9-353d-4e29-8a3c-55cf33ec45c8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 08:02:45.837902 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:02:45.837902 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:02:45.837902 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:02:45.837902 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:02:45.837902 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:02:45.837902 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:02:45.837902 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:02:45.837902 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:02:45.837902 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:02:45.837902 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:02:45.837902 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:02:45.837902 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 08:02:45.837902 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 08:02:45.837902 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 08:02:45.839034 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 08:02:45.839034 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:02:45.839034 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:02:45.839034 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:02:45.839034 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:02:45.839034 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:02:45.839034 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:02:45.839034 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:02:45.839034 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application with Lock( Jul 28 08:02:45.839034 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:02:45.839034 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:02:45.839034 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:02:45.839034 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:02:45.839034 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:02:45.839034 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:02:45.839034 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:02:45.839034 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:02:45.839972 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 08:02:45.839972 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 08:02:45.839972 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 08:02:45.839972 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application Jul 28 08:02:45.839972 dv-cinder-851351-1-smb devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 648/1265] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 08:02:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:02:45.847079 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1e2ab8-6d6e-4002-bfad-b05c5e665af8 None admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:02:45.968691 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=100 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:02:45.994199 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1e2ab8-6d6e-4002-bfad-b05c5e665af8 None admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:02:46.032472 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f56687e-4462-43fc-8594-4c99df1e63d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:02:46.033152 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f56687e-4462-43fc-8594-4c99df1e63d9 None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:02:46.033427 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f56687e-4462-43fc-8594-4c99df1e63d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:02:46.033690 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f56687e-4462-43fc-8594-4c99df1e63d9 None admin] PATH_INFO: `/v3/domains` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:02:46.034390 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f56687e-4462-43fc-8594-4c99df1e63d9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80348) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:02:46.034686 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f56687e-4462-43fc-8594-4c99df1e63d9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:02:46.036180 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f56687e-4462-43fc-8594-4c99df1e63d9 None admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:02:46.049889 dv-cinder-851351-1-smb devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 618/1266] 10.222.0.42 () {56 vars in 1109 bytes} [Thu Jul 28 08:02:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:02:46.056252 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c9702c9-353d-4e29-8a3c-55cf33ec45c8 None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:02:46.188983 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c9702c9-353d-4e29-8a3c-55cf33ec45c8 None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:02:46.214093 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:02:46.237019 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b156a97-5946-4669-9144-08275b631a6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:02:46.238094 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b156a97-5946-4669-9144-08275b631a6c None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:02:46.238570 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b156a97-5946-4669-9144-08275b631a6c None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:02:46.239104 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b156a97-5946-4669-9144-08275b631a6c None admin] PATH_INFO: `/v3/users/placement` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:02:46.253378 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b156a97-5946-4669-9144-08275b631a6c None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:02:46.255788 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b156a97-5946-4669-9144-08275b631a6c None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:02:46.269755 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application [None req-5b156a97-5946-4669-9144-08275b631a6c None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 28 08:02:46.269755 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:02:46.269755 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:02:46.269755 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:02:46.269755 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:02:46.269755 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:02:46.269755 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:02:46.269755 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:02:46.269755 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:02:46.269755 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:02:46.269755 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:02:46.269755 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:02:46.269755 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 28 08:02:46.269755 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 28 08:02:46.269755 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 28 08:02:46.269755 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 28 08:02:46.273986 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:02:46.273986 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:02:46.273986 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 28 08:02:46.273986 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 08:02:46.273986 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 28 08:02:46.273986 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 08:02:46.273986 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:02:46.273986 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:02:46.273986 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:02:46.273986 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:02:46.273986 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:02:46.273986 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application with Lock( Jul 28 08:02:46.273986 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:02:46.273986 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:02:46.273986 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:02:46.273986 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:02:46.273986 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:02:46.273986 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:02:46.275210 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:02:46.275210 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:02:46.275210 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 28 08:02:46.275210 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 28 08:02:46.275210 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 28 08:02:46.275210 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 28 08:02:46.275210 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 28 08:02:46.275210 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 28 08:02:46.275210 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 28 08:02:46.275210 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application Jul 28 08:02:46.275210 dv-cinder-851351-1-smb devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 649/1267] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 08:02:46 2022] GET /identity/v3/users/placement => generated 87 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:02:46.277328 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f56687e-4462-43fc-8594-4c99df1e63d9 None admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:02:46.391749 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f56687e-4462-43fc-8594-4c99df1e63d9 None admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:02:46.427026 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4712052a-0e5e-4c72-bad5-3d944ea9f27a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:02:46.427652 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4712052a-0e5e-4c72-bad5-3d944ea9f27a None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:02:46.427926 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4712052a-0e5e-4c72-bad5-3d944ea9f27a None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:02:46.428195 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4712052a-0e5e-4c72-bad5-3d944ea9f27a None admin] PATH_INFO: `/v3/users` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:02:46.429028 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4712052a-0e5e-4c72-bad5-3d944ea9f27a None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80348) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:02:46.429330 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4712052a-0e5e-4c72-bad5-3d944ea9f27a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:02:46.430809 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4712052a-0e5e-4c72-bad5-3d944ea9f27a None admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:02:46.440686 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=100 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:02:46.450397 dv-cinder-851351-1-smb devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 619/1268] 10.222.0.42 () {56 vars in 1143 bytes} [Thu Jul 28 08:02:46 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:02:46.466211 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b156a97-5946-4669-9144-08275b631a6c None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:02:46.673908 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b156a97-5946-4669-9144-08275b631a6c None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:02:46.734243 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b49a50-5098-4982-a0e1-6fdd028d61e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:02:46.734889 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b49a50-5098-4982-a0e1-6fdd028d61e2 None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:02:46.735168 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b49a50-5098-4982-a0e1-6fdd028d61e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:02:46.735434 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b49a50-5098-4982-a0e1-6fdd028d61e2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:02:46.753589 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58b49a50-5098-4982-a0e1-6fdd028d61e2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:02:46.755157 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58b49a50-5098-4982-a0e1-6fdd028d61e2 None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:02:46.770740 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application [None req-58b49a50-5098-4982-a0e1-6fdd028d61e2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 08:02:46.770740 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:02:46.770740 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:02:46.770740 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:02:46.770740 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:02:46.770740 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:02:46.770740 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:02:46.770740 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:02:46.770740 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:02:46.770740 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:02:46.770740 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:02:46.770740 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:02:46.770740 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 08:02:46.770740 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 08:02:46.770740 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 08:02:46.772350 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 08:02:46.772350 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:02:46.772350 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:02:46.772350 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:02:46.772350 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:02:46.772350 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:02:46.772350 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:02:46.772350 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:02:46.772350 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application with Lock( Jul 28 08:02:46.772350 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:02:46.772350 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:02:46.772350 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:02:46.772350 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:02:46.772350 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:02:46.772350 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:02:46.772350 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:02:46.772350 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:02:46.774022 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 08:02:46.774022 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 08:02:46.774022 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 08:02:46.774022 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application Jul 28 08:02:46.774022 dv-cinder-851351-1-smb devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 650/1269] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 08:02:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 307 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:02:46.784368 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4712052a-0e5e-4c72-bad5-3d944ea9f27a None admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:02:46.926222 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4712052a-0e5e-4c72-bad5-3d944ea9f27a None admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:02:46.964250 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d88a3928-0265-4f6d-825d-90f1bf2ce720 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:02:46.964894 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88a3928-0265-4f6d-825d-90f1bf2ce720 None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:02:46.965171 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88a3928-0265-4f6d-825d-90f1bf2ce720 None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:02:46.965436 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88a3928-0265-4f6d-825d-90f1bf2ce720 None admin] PATH_INFO: `/v3/domains` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:02:46.966122 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d88a3928-0265-4f6d-825d-90f1bf2ce720 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80348) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:02:46.966418 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d88a3928-0265-4f6d-825d-90f1bf2ce720 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:02:46.967910 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d88a3928-0265-4f6d-825d-90f1bf2ce720 None admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:02:46.980697 dv-cinder-851351-1-smb devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 620/1270] 10.222.0.42 () {56 vars in 1109 bytes} [Thu Jul 28 08:02:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:02:46.986627 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b49a50-5098-4982-a0e1-6fdd028d61e2 None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:02:47.023610 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:02:47.096288 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b49a50-5098-4982-a0e1-6fdd028d61e2 None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:02:47.135427 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed50ab49-7da1-43bb-8572-858bb24ffc81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:02:47.136078 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed50ab49-7da1-43bb-8572-858bb24ffc81 None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:02:47.136357 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed50ab49-7da1-43bb-8572-858bb24ffc81 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:02:47.136626 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed50ab49-7da1-43bb-8572-858bb24ffc81 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:02:47.144111 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed50ab49-7da1-43bb-8572-858bb24ffc81 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:02:47.145666 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed50ab49-7da1-43bb-8572-858bb24ffc81 None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:02:47.157595 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application [None req-ed50ab49-7da1-43bb-8572-858bb24ffc81 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 08:02:47.157595 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:02:47.157595 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:02:47.157595 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:02:47.157595 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:02:47.157595 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:02:47.157595 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:02:47.157595 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:02:47.157595 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:02:47.157595 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:02:47.157595 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:02:47.157595 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:02:47.157595 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 28 08:02:47.157595 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 28 08:02:47.157595 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 28 08:02:47.158580 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 28 08:02:47.158580 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:02:47.158580 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:02:47.158580 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:02:47.158580 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:02:47.158580 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:02:47.158580 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:02:47.158580 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:02:47.158580 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application with Lock( Jul 28 08:02:47.158580 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:02:47.158580 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:02:47.158580 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:02:47.158580 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:02:47.158580 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:02:47.158580 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:02:47.158580 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:02:47.158580 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:02:47.159562 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 28 08:02:47.159562 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 28 08:02:47.159562 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 28 08:02:47.159562 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 28 08:02:47.159562 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 28 08:02:47.159562 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 28 08:02:47.159562 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 08:02:47.159562 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application Jul 28 08:02:47.159562 dv-cinder-851351-1-smb devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 651/1271] 10.222.0.42 () {56 vars in 1111 bytes} [Thu Jul 28 08:02:46 2022] GET /identity/v3/projects/service => generated 88 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:02:47.165843 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d88a3928-0265-4f6d-825d-90f1bf2ce720 None admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:02:47.228533 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=100 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:02:47.274582 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d88a3928-0265-4f6d-825d-90f1bf2ce720 None admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:02:47.316206 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d671baa9-0e90-4d17-be77-ef06b4cc1e52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:02:47.317025 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d671baa9-0e90-4d17-be77-ef06b4cc1e52 None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:02:47.317143 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d671baa9-0e90-4d17-be77-ef06b4cc1e52 None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:02:47.317387 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d671baa9-0e90-4d17-be77-ef06b4cc1e52 None admin] PATH_INFO: `/v3/projects` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:02:47.318158 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d671baa9-0e90-4d17-be77-ef06b4cc1e52 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80348) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:02:47.318471 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d671baa9-0e90-4d17-be77-ef06b4cc1e52 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:02:47.319949 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d671baa9-0e90-4d17-be77-ef06b4cc1e52 None admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:02:47.333272 dv-cinder-851351-1-smb devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 621/1272] 10.222.0.42 () {56 vars in 1148 bytes} [Thu Jul 28 08:02:47 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:02:47.341109 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed50ab49-7da1-43bb-8572-858bb24ffc81 None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:02:47.437012 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:02:47.446602 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed50ab49-7da1-43bb-8572-858bb24ffc81 None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:02:47.480844 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a3e811-cfd7-41ba-b77a-1421c943d886 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:02:47.481433 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a3e811-cfd7-41ba-b77a-1421c943d886 None admin] REQUEST_METHOD: `PUT` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:02:47.481706 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a3e811-cfd7-41ba-b77a-1421c943d886 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:02:47.481978 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a3e811-cfd7-41ba-b77a-1421c943d886 None admin] PATH_INFO: `/v3/projects/139349507026497c98f360774dee737e/users/5db0b219e0d24284907722fbf18ca3e8/roles/362bd71ac01249fb8fa635381993eec1` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:02:47.483908 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11a3e811-cfd7-41ba-b77a-1421c943d886 None admin] RBAC: Authorizing `identity:create_grant(project_id=139349507026497c98f360774dee737e, user_id=5db0b219e0d24284907722fbf18ca3e8, role_id=362bd71ac01249fb8fa635381993eec1)` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:02:47.485354 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11a3e811-cfd7-41ba-b77a-1421c943d886 None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:02:47.500784 dv-cinder-851351-1-smb devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 652/1273] 10.222.0.42 () {58 vars in 1439 bytes} [Thu Jul 28 08:02:47 2022] PUT /identity/v3/projects/139349507026497c98f360774dee737e/users/5db0b219e0d24284907722fbf18ca3e8/roles/362bd71ac01249fb8fa635381993eec1 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 08:02:49.476299 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6979f12-6e6a-4235-a145-88a3d05b0682 None None] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:02:49.476907 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6979f12-6e6a-4235-a145-88a3d05b0682 None None] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:02:49.476907 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6979f12-6e6a-4235-a145-88a3d05b0682 None None] PATH_INFO: `/` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:02:49.478185 dv-cinder-851351-1-smb devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 622/1274] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 08:02:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 08:02:49.483886 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3132f5-1192-4cd4-b1f7-356241c0e7cb None None] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:02:49.484371 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3132f5-1192-4cd4-b1f7-356241c0e7cb None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:02:49.484371 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3132f5-1192-4cd4-b1f7-356241c0e7cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:02:49.503294 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.auth.core [None req-cf3132f5-1192-4cd4-b1f7-356241c0e7cb None None] MFA Rules not processed for user `f0666d3a50644a7097367331c1ee1a68`. Rule list: `[]` (Enabled: `True`). {{(pid=80347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 08:02:49.504509 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-cf3132f5-1192-4cd4-b1f7-356241c0e7cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:02:49.582288 dv-cinder-851351-1-smb devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 653/1275] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 08:02:49 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 28 08:02:49.606027 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6979f12-6e6a-4235-a145-88a3d05b0682 None None] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:02:49.725301 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6979f12-6e6a-4235-a145-88a3d05b0682 None None] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:02:49.744703 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=100 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:02:49.763968 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6b6c44-d25d-4af9-8615-0f4807e6ae5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:02:49.764646 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6b6c44-d25d-4af9-8615-0f4807e6ae5f None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:02:49.764963 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6b6c44-d25d-4af9-8615-0f4807e6ae5f None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:02:49.765234 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6b6c44-d25d-4af9-8615-0f4807e6ae5f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:02:49.777708 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd6b6c44-d25d-4af9-8615-0f4807e6ae5f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 08:02:49.782892 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application [None req-bd6b6c44-d25d-4af9-8615-0f4807e6ae5f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 08:02:49.782892 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:02:49.782892 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:02:49.782892 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:02:49.782892 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:02:49.782892 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:02:49.782892 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:02:49.782892 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:02:49.782892 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:02:49.782892 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:02:49.782892 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:02:49.782892 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:02:49.782892 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 08:02:49.782892 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 08:02:49.782892 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 08:02:49.782892 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 08:02:49.784088 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 08:02:49.784088 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 08:02:49.784088 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 08:02:49.784088 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 08:02:49.784088 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:02:49.784088 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:02:49.784088 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:02:49.784088 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:02:49.784088 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:02:49.784088 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:02:49.784088 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:02:49.784088 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application with Lock( Jul 28 08:02:49.784088 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:02:49.784088 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:02:49.784088 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:02:49.784088 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:02:49.785061 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:02:49.785061 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:02:49.785061 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:02:49.785061 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:02:49.785061 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 08:02:49.785061 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 08:02:49.785061 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 08:02:49.785061 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 08:02:49.785061 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 08:02:49.785061 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 08:02:49.785061 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 08:02:49.785061 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application Jul 28 08:02:49.785061 dv-cinder-851351-1-smb devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 623/1276] 10.222.0.42 () {56 vars in 1096 bytes} [Thu Jul 28 08:02:49 2022] GET /identity/v3/roles/admin => generated 83 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:02:49.791348 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3132f5-1192-4cd4-b1f7-356241c0e7cb None None] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:02:49.881008 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:02:49.902508 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3132f5-1192-4cd4-b1f7-356241c0e7cb None None] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:02:49.944810 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05561fc4-9154-43de-8bea-6074f2600e9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:02:49.945479 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05561fc4-9154-43de-8bea-6074f2600e9e None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:02:49.945758 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05561fc4-9154-43de-8bea-6074f2600e9e None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:02:49.945996 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05561fc4-9154-43de-8bea-6074f2600e9e None admin] PATH_INFO: `/v3/roles` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:02:49.946868 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05561fc4-9154-43de-8bea-6074f2600e9e None admin] RBAC: Adding query filter params (name=admin) {{(pid=80347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:02:49.947122 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05561fc4-9154-43de-8bea-6074f2600e9e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:02:49.948470 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05561fc4-9154-43de-8bea-6074f2600e9e None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:02:49.958308 dv-cinder-851351-1-smb devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 654/1277] 10.222.0.42 () {56 vars in 1099 bytes} [Thu Jul 28 08:02:49 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:02:49.964497 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6b6c44-d25d-4af9-8615-0f4807e6ae5f None admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:02:50.065318 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6b6c44-d25d-4af9-8615-0f4807e6ae5f None admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:02:50.100778 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ab7d27-9077-443f-b551-0a9244db6e9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:02:50.101418 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ab7d27-9077-443f-b551-0a9244db6e9e None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:02:50.101687 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ab7d27-9077-443f-b551-0a9244db6e9e None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:02:50.101955 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ab7d27-9077-443f-b551-0a9244db6e9e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:02:50.113543 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66ab7d27-9077-443f-b551-0a9244db6e9e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:02:50.115102 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66ab7d27-9077-443f-b551-0a9244db6e9e None admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:02:50.130049 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application [None req-66ab7d27-9077-443f-b551-0a9244db6e9e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 08:02:50.130049 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:02:50.130049 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:02:50.130049 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:02:50.130049 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:02:50.130049 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:02:50.130049 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:02:50.130049 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:02:50.130049 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:02:50.130049 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:02:50.130049 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:02:50.130049 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:02:50.130049 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 08:02:50.130049 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 08:02:50.130049 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 08:02:50.131184 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 08:02:50.131184 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:02:50.131184 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:02:50.131184 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:02:50.131184 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:02:50.131184 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:02:50.131184 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:02:50.131184 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:02:50.131184 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application with Lock( Jul 28 08:02:50.131184 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:02:50.131184 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:02:50.131184 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:02:50.131184 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:02:50.131184 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:02:50.131184 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:02:50.131184 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:02:50.131184 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:02:50.132355 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 08:02:50.132355 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 08:02:50.132355 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 08:02:50.132355 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application Jul 28 08:02:50.132355 dv-cinder-851351-1-smb devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 624/1278] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 08:02:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:02:50.137338 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05561fc4-9154-43de-8bea-6074f2600e9e None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:02:50.242486 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05561fc4-9154-43de-8bea-6074f2600e9e None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:02:50.278452 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69aa7d7e-8d04-4f8b-8806-1f200244b1b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:02:50.279114 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69aa7d7e-8d04-4f8b-8806-1f200244b1b4 None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:02:50.279435 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69aa7d7e-8d04-4f8b-8806-1f200244b1b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:02:50.279743 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69aa7d7e-8d04-4f8b-8806-1f200244b1b4 None admin] PATH_INFO: `/v3/domains` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:02:50.280491 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69aa7d7e-8d04-4f8b-8806-1f200244b1b4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:02:50.280863 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69aa7d7e-8d04-4f8b-8806-1f200244b1b4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:02:50.282294 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69aa7d7e-8d04-4f8b-8806-1f200244b1b4 None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:02:50.294798 dv-cinder-851351-1-smb devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 655/1279] 10.222.0.42 () {56 vars in 1109 bytes} [Thu Jul 28 08:02:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:02:50.300742 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ab7d27-9077-443f-b551-0a9244db6e9e None admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:02:50.333249 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=100 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:02:50.409148 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ab7d27-9077-443f-b551-0a9244db6e9e None admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:02:50.443838 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99afc9ca-fbe2-4ab7-9e9d-d48a2649c13f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:02:50.444481 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99afc9ca-fbe2-4ab7-9e9d-d48a2649c13f None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:02:50.444766 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99afc9ca-fbe2-4ab7-9e9d-d48a2649c13f None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:02:50.445044 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99afc9ca-fbe2-4ab7-9e9d-d48a2649c13f None admin] PATH_INFO: `/v3/users/placement` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:02:50.453479 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99afc9ca-fbe2-4ab7-9e9d-d48a2649c13f None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:02:50.454986 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99afc9ca-fbe2-4ab7-9e9d-d48a2649c13f None admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:02:50.466757 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application [None req-99afc9ca-fbe2-4ab7-9e9d-d48a2649c13f None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 28 08:02:50.466757 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:02:50.466757 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:02:50.466757 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:02:50.466757 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:02:50.466757 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:02:50.466757 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:02:50.466757 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:02:50.466757 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:02:50.466757 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:02:50.466757 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:02:50.466757 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:02:50.466757 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 28 08:02:50.466757 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 28 08:02:50.466757 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 28 08:02:50.466757 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 28 08:02:50.467938 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:02:50.467938 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:02:50.467938 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 28 08:02:50.467938 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 08:02:50.467938 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 28 08:02:50.467938 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 08:02:50.467938 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:02:50.467938 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:02:50.467938 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:02:50.467938 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:02:50.467938 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:02:50.467938 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application with Lock( Jul 28 08:02:50.467938 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:02:50.467938 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:02:50.467938 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:02:50.467938 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:02:50.467938 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:02:50.467938 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:02:50.469132 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:02:50.469132 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:02:50.469132 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 28 08:02:50.469132 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 28 08:02:50.469132 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 28 08:02:50.469132 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 28 08:02:50.469132 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 28 08:02:50.469132 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 28 08:02:50.469132 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 28 08:02:50.469132 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application Jul 28 08:02:50.472727 dv-cinder-851351-1-smb devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 625/1280] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 08:02:50 2022] GET /identity/v3/users/placement => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:02:50.473943 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69aa7d7e-8d04-4f8b-8806-1f200244b1b4 None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:02:50.477899 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:02:50.576352 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69aa7d7e-8d04-4f8b-8806-1f200244b1b4 None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:02:50.612541 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263a299c-8f4c-4bb5-b860-b72589f3e674 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:02:50.613087 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263a299c-8f4c-4bb5-b860-b72589f3e674 None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:02:50.613360 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263a299c-8f4c-4bb5-b860-b72589f3e674 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:02:50.613595 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263a299c-8f4c-4bb5-b860-b72589f3e674 None admin] PATH_INFO: `/v3/users` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:02:50.616632 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-263a299c-8f4c-4bb5-b860-b72589f3e674 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:02:50.616953 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-263a299c-8f4c-4bb5-b860-b72589f3e674 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:02:50.618393 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-263a299c-8f4c-4bb5-b860-b72589f3e674 None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:02:50.636624 dv-cinder-851351-1-smb devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 656/1281] 10.222.0.42 () {56 vars in 1143 bytes} [Thu Jul 28 08:02:50 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:02:50.642887 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99afc9ca-fbe2-4ab7-9e9d-d48a2649c13f None admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:02:50.744872 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=100 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:02:50.758087 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99afc9ca-fbe2-4ab7-9e9d-d48a2649c13f None admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:02:50.795258 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd2b6913-cd01-4edc-a9ba-30dbcfce56ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:02:50.795953 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2b6913-cd01-4edc-a9ba-30dbcfce56ba None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:02:50.796277 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2b6913-cd01-4edc-a9ba-30dbcfce56ba None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:02:50.796596 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2b6913-cd01-4edc-a9ba-30dbcfce56ba None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:02:50.868207 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd2b6913-cd01-4edc-a9ba-30dbcfce56ba None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:02:50.869766 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd2b6913-cd01-4edc-a9ba-30dbcfce56ba None admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:02:50.964452 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=100 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:02:50.975194 dv-cinder-851351-1-smb devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 626/1282] 10.222.0.42 () {58 vars in 1282 bytes} [Thu Jul 28 08:02:50 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 28 08:02:50.984824 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263a299c-8f4c-4bb5-b860-b72589f3e674 None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:02:51.068103 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:02:51.113970 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263a299c-8f4c-4bb5-b860-b72589f3e674 None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:02:51.155617 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d6371d-ff68-4473-8686-90012bd50cd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:02:51.156183 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d6371d-ff68-4473-8686-90012bd50cd7 None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:02:51.156452 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d6371d-ff68-4473-8686-90012bd50cd7 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:02:51.156753 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d6371d-ff68-4473-8686-90012bd50cd7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:02:51.169683 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10d6371d-ff68-4473-8686-90012bd50cd7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:02:51.170557 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10d6371d-ff68-4473-8686-90012bd50cd7 None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:02:51.186825 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application [None req-10d6371d-ff68-4473-8686-90012bd50cd7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 08:02:51.186825 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:02:51.186825 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:02:51.186825 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:02:51.186825 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:02:51.186825 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:02:51.186825 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:02:51.186825 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:02:51.186825 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:02:51.186825 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:02:51.186825 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:02:51.186825 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:02:51.186825 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 08:02:51.186825 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 08:02:51.186825 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 08:02:51.189068 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 08:02:51.189068 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:02:51.189068 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:02:51.189068 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:02:51.189068 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:02:51.189068 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:02:51.189068 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:02:51.189068 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:02:51.189068 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application with Lock( Jul 28 08:02:51.189068 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:02:51.189068 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:02:51.189068 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:02:51.189068 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:02:51.189068 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:02:51.189068 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:02:51.189068 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:02:51.189068 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:02:51.191282 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 08:02:51.191282 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 08:02:51.191282 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 08:02:51.191282 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application Jul 28 08:02:51.191282 dv-cinder-851351-1-smb devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 657/1283] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 08:02:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:02:51.196692 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd2b6913-cd01-4edc-a9ba-30dbcfce56ba None admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:02:51.316222 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd2b6913-cd01-4edc-a9ba-30dbcfce56ba None admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:02:51.356186 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3565898a-1a76-4e93-bee9-45885f127451 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:02:51.356858 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3565898a-1a76-4e93-bee9-45885f127451 None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:02:51.357136 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3565898a-1a76-4e93-bee9-45885f127451 None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:02:51.357409 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3565898a-1a76-4e93-bee9-45885f127451 None admin] PATH_INFO: `/v3/domains` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:02:51.358113 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3565898a-1a76-4e93-bee9-45885f127451 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80348) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:02:51.358416 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3565898a-1a76-4e93-bee9-45885f127451 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:02:51.359820 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3565898a-1a76-4e93-bee9-45885f127451 None admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:02:51.372265 dv-cinder-851351-1-smb devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 627/1284] 10.222.0.42 () {56 vars in 1109 bytes} [Thu Jul 28 08:02:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:02:51.378770 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d6371d-ff68-4473-8686-90012bd50cd7 None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:02:51.489223 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d6371d-ff68-4473-8686-90012bd50cd7 None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:02:51.502997 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:02:51.527421 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf7b712-66ad-4bf6-bc15-fa07a19a2e40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:02:51.528082 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf7b712-66ad-4bf6-bc15-fa07a19a2e40 None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:02:51.529588 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf7b712-66ad-4bf6-bc15-fa07a19a2e40 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:02:51.529859 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf7b712-66ad-4bf6-bc15-fa07a19a2e40 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:02:51.539674 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bf7b712-66ad-4bf6-bc15-fa07a19a2e40 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:02:51.541230 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bf7b712-66ad-4bf6-bc15-fa07a19a2e40 None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:02:51.555486 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application [None req-2bf7b712-66ad-4bf6-bc15-fa07a19a2e40 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 08:02:51.555486 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:02:51.555486 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:02:51.555486 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:02:51.555486 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:02:51.555486 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:02:51.555486 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:02:51.555486 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:02:51.555486 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:02:51.555486 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:02:51.555486 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:02:51.555486 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:02:51.555486 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 28 08:02:51.555486 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 28 08:02:51.555486 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 28 08:02:51.557056 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 28 08:02:51.557056 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:02:51.557056 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:02:51.557056 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:02:51.557056 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:02:51.557056 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:02:51.557056 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:02:51.557056 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:02:51.557056 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application with Lock( Jul 28 08:02:51.557056 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:02:51.557056 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:02:51.557056 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:02:51.557056 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:02:51.557056 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:02:51.557056 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:02:51.557056 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:02:51.557056 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:02:51.559019 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 28 08:02:51.559019 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 28 08:02:51.559019 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 28 08:02:51.559019 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 28 08:02:51.559019 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 28 08:02:51.559019 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 28 08:02:51.559019 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 08:02:51.559019 dv-cinder-851351-1-smb devstack@keystone.service[80347]: ERROR keystone.server.flask.application Jul 28 08:02:51.559019 dv-cinder-851351-1-smb devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 658/1285] 10.222.0.42 () {56 vars in 1111 bytes} [Thu Jul 28 08:02:51 2022] GET /identity/v3/projects/service => generated 88 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:02:51.564041 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3565898a-1a76-4e93-bee9-45885f127451 None admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:02:51.617237 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=100 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:02:51.670282 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3565898a-1a76-4e93-bee9-45885f127451 None admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:02:51.706807 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3327239-4a76-4395-a9bb-c832c0805438 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:02:51.707610 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3327239-4a76-4395-a9bb-c832c0805438 None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:02:51.707890 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3327239-4a76-4395-a9bb-c832c0805438 None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:02:51.708162 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3327239-4a76-4395-a9bb-c832c0805438 None admin] PATH_INFO: `/v3/projects` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:02:51.708956 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3327239-4a76-4395-a9bb-c832c0805438 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80348) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:02:51.709265 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3327239-4a76-4395-a9bb-c832c0805438 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:02:51.710729 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3327239-4a76-4395-a9bb-c832c0805438 None admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:02:51.723970 dv-cinder-851351-1-smb devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 628/1286] 10.222.0.42 () {56 vars in 1148 bytes} [Thu Jul 28 08:02:51 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:02:51.730548 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf7b712-66ad-4bf6-bc15-fa07a19a2e40 None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:02:51.836092 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf7b712-66ad-4bf6-bc15-fa07a19a2e40 None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:02:51.871461 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ada152-5612-4aa6-8707-60724f83fcc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:02:51.872264 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ada152-5612-4aa6-8707-60724f83fcc5 None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:02:51.872541 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ada152-5612-4aa6-8707-60724f83fcc5 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:02:51.872890 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ada152-5612-4aa6-8707-60724f83fcc5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:02:51.873958 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ada152-5612-4aa6-8707-60724f83fcc5 None admin] RBAC: Adding query filter params (role.id=362bd71ac01249fb8fa635381993eec1, scope.project.id=139349507026497c98f360774dee737e, user.id=5db0b219e0d24284907722fbf18ca3e8) {{(pid=80347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:02:51.874325 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ada152-5612-4aa6-8707-60724f83fcc5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:02:51.876505 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ada152-5612-4aa6-8707-60724f83fcc5 None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:02:51.884341 dv-cinder-851351-1-smb devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 659/1287] 10.222.0.42 () {56 vars in 1374 bytes} [Thu Jul 28 08:02:51 2022] GET /identity/v3/role_assignments?user.id=5db0b219e0d24284907722fbf18ca3e8&scope.project.id=139349507026497c98f360774dee737e&role.id=362bd71ac01249fb8fa635381993eec1 => generated 608 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:02:53.924468 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60216012-d33f-437e-9ca8-5f654788c500 None None] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:02:53.925073 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60216012-d33f-437e-9ca8-5f654788c500 None None] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:02:53.925073 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60216012-d33f-437e-9ca8-5f654788c500 None None] PATH_INFO: `/` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:02:53.926579 dv-cinder-851351-1-smb devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 629/1288] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 08:02:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 08:02:53.933060 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef68c1d-6a38-4a49-b575-5ff425122061 None None] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:02:53.933567 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef68c1d-6a38-4a49-b575-5ff425122061 None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:02:53.934028 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef68c1d-6a38-4a49-b575-5ff425122061 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:02:53.962576 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.auth.core [None req-bef68c1d-6a38-4a49-b575-5ff425122061 None None] MFA Rules not processed for user `f0666d3a50644a7097367331c1ee1a68`. Rule list: `[]` (Enabled: `True`). {{(pid=80347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 08:02:53.963765 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-bef68c1d-6a38-4a49-b575-5ff425122061 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:02:53.994497 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:02:54.035993 dv-cinder-851351-1-smb devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 660/1289] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 08:02:53 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 08:02:54.057947 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60216012-d33f-437e-9ca8-5f654788c500 None None] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:02:54.167369 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60216012-d33f-437e-9ca8-5f654788c500 None None] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:02:54.179240 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=100 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:02:54.203970 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67bab1d5-f1c5-4051-82f6-37a952524089 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:02:54.204644 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67bab1d5-f1c5-4051-82f6-37a952524089 None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:02:54.204957 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67bab1d5-f1c5-4051-82f6-37a952524089 None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:02:54.205233 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67bab1d5-f1c5-4051-82f6-37a952524089 None admin] PATH_INFO: `/v3/services/placement` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:02:54.205875 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67bab1d5-f1c5-4051-82f6-37a952524089 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:02:54.207259 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67bab1d5-f1c5-4051-82f6-37a952524089 None admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:02:54.217099 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application [None req-67bab1d5-f1c5-4051-82f6-37a952524089 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jul 28 08:02:54.217099 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:02:54.217099 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 28 08:02:54.217099 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 28 08:02:54.217099 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 28 08:02:54.217099 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 28 08:02:54.217099 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 28 08:02:54.217099 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 08:02:54.217099 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 28 08:02:54.217099 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application Jul 28 08:02:54.217099 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 28 08:02:54.217099 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application Jul 28 08:02:54.217099 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:02:54.217099 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:02:54.217099 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:02:54.217099 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:02:54.217099 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:02:54.218454 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:02:54.218454 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:02:54.218454 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:02:54.218454 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:02:54.218454 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:02:54.218454 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:02:54.218454 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 28 08:02:54.218454 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 28 08:02:54.218454 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 28 08:02:54.218454 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 28 08:02:54.218454 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:02:54.218454 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:02:54.218454 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:02:54.218454 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:02:54.218454 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:02:54.218454 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:02:54.219504 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:02:54.219504 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application with Lock( Jul 28 08:02:54.219504 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:02:54.219504 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:02:54.219504 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:02:54.219504 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:02:54.219504 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:02:54.219504 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:02:54.219504 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:02:54.219504 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:02:54.219504 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 28 08:02:54.219504 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 08:02:54.219504 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 28 08:02:54.219504 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application Jul 28 08:02:54.219504 dv-cinder-851351-1-smb devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 630/1290] 10.222.0.42 () {56 vars in 1117 bytes} [Thu Jul 28 08:02:54 2022] GET /identity/v3/services/placement => generated 90 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:02:54.224698 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef68c1d-6a38-4a49-b575-5ff425122061 None None] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:02:54.328798 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef68c1d-6a38-4a49-b575-5ff425122061 None None] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:02:54.374511 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53bff0dd-4615-4221-8abc-cab9fa7c3653 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:02:54.375170 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53bff0dd-4615-4221-8abc-cab9fa7c3653 None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:02:54.375448 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53bff0dd-4615-4221-8abc-cab9fa7c3653 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:02:54.375713 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53bff0dd-4615-4221-8abc-cab9fa7c3653 None admin] PATH_INFO: `/v3/services` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:02:54.376463 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53bff0dd-4615-4221-8abc-cab9fa7c3653 None admin] RBAC: Adding query filter params (name=placement) {{(pid=80347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:02:54.376788 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53bff0dd-4615-4221-8abc-cab9fa7c3653 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:02:54.378279 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53bff0dd-4615-4221-8abc-cab9fa7c3653 None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:02:54.385789 dv-cinder-851351-1-smb devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 661/1291] 10.222.0.42 () {56 vars in 1116 bytes} [Thu Jul 28 08:02:54 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 08:02:54.392193 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67bab1d5-f1c5-4051-82f6-37a952524089 None admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:02:54.512886 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67bab1d5-f1c5-4051-82f6-37a952524089 None admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:02:54.547542 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91426a3a-2f93-4ad1-8972-d177d840c96d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:02:54.548160 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91426a3a-2f93-4ad1-8972-d177d840c96d None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:02:54.548434 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91426a3a-2f93-4ad1-8972-d177d840c96d None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:02:54.548729 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91426a3a-2f93-4ad1-8972-d177d840c96d None admin] PATH_INFO: `/v3/services` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:02:54.549412 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91426a3a-2f93-4ad1-8972-d177d840c96d None admin] RBAC: Adding query filter params (type=placement) {{(pid=80348) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:02:54.549709 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91426a3a-2f93-4ad1-8972-d177d840c96d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:02:54.551130 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91426a3a-2f93-4ad1-8972-d177d840c96d None admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:02:54.556060 dv-cinder-851351-1-smb devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 631/1292] 10.222.0.42 () {56 vars in 1116 bytes} [Thu Jul 28 08:02:54 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:02:56.526949 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a7fcde-ac05-4996-a8aa-59a663625dca None None] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:02:56.527481 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a7fcde-ac05-4996-a8aa-59a663625dca None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:02:56.527481 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a7fcde-ac05-4996-a8aa-59a663625dca None None] PATH_INFO: `/` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:02:56.528800 dv-cinder-851351-1-smb devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 662/1293] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 08:02:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 08:02:56.534663 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82adbbbb-60a6-43ae-a5b6-78b8bdb94c6e None None] REQUEST_METHOD: `POST` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:02:56.535152 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82adbbbb-60a6-43ae-a5b6-78b8bdb94c6e None None] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:02:56.535278 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82adbbbb-60a6-43ae-a5b6-78b8bdb94c6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:02:56.554193 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.auth.core [None req-82adbbbb-60a6-43ae-a5b6-78b8bdb94c6e None None] MFA Rules not processed for user `f0666d3a50644a7097367331c1ee1a68`. Rule list: `[]` (Enabled: `True`). {{(pid=80348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 08:02:56.555401 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.fernet_utils [None req-82adbbbb-60a6-43ae-a5b6-78b8bdb94c6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:02:56.586696 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=100 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:02:56.626622 dv-cinder-851351-1-smb devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 632/1294] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 08:02:56 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 08:02:56.649852 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a7fcde-ac05-4996-a8aa-59a663625dca None None] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:02:56.686761 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:02:56.765369 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a7fcde-ac05-4996-a8aa-59a663625dca None None] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:02:56.803300 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f97922-c686-461a-9f61-8174cabd3446 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:02:56.803873 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f97922-c686-461a-9f61-8174cabd3446 None admin] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:02:56.804108 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f97922-c686-461a-9f61-8174cabd3446 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:02:56.804373 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f97922-c686-461a-9f61-8174cabd3446 None admin] PATH_INFO: `/v3/services` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:02:56.805114 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53f97922-c686-461a-9f61-8174cabd3446 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:02:56.806529 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53f97922-c686-461a-9f61-8174cabd3446 None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:02:56.823274 dv-cinder-851351-1-smb devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 663/1295] 10.222.0.42 () {60 vars in 1141 bytes} [Thu Jul 28 08:02:56 2022] POST /identity/v3/services => generated 246 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 08:02:58.835067 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937012e0-ec52-4436-8337-95eb02bfdbba None None] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:02:58.835662 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937012e0-ec52-4436-8337-95eb02bfdbba None None] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:02:58.835662 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937012e0-ec52-4436-8337-95eb02bfdbba None None] PATH_INFO: `/` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:02:58.837010 dv-cinder-851351-1-smb devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 633/1296] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 08:02:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 08:02:58.842429 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a003deef-31c5-463b-8c56-72148351d308 None None] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:02:58.842922 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a003deef-31c5-463b-8c56-72148351d308 None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:02:58.842922 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a003deef-31c5-463b-8c56-72148351d308 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:02:58.862589 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.auth.core [None req-a003deef-31c5-463b-8c56-72148351d308 None None] MFA Rules not processed for user `f0666d3a50644a7097367331c1ee1a68`. Rule list: `[]` (Enabled: `True`). {{(pid=80347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 08:02:58.863787 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-a003deef-31c5-463b-8c56-72148351d308 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:02:58.960701 dv-cinder-851351-1-smb devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 664/1297] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 08:02:58 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 08:02:58.982419 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937012e0-ec52-4436-8337-95eb02bfdbba None None] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:02:59.091358 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937012e0-ec52-4436-8337-95eb02bfdbba None None] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:02:59.128089 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b1751f-1274-4689-9a41-fa91e98d5abf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:02:59.128744 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b1751f-1274-4689-9a41-fa91e98d5abf None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:02:59.129017 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b1751f-1274-4689-9a41-fa91e98d5abf None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:02:59.129316 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b1751f-1274-4689-9a41-fa91e98d5abf None admin] PATH_INFO: `/v3/services/placement` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:02:59.129944 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16b1751f-1274-4689-9a41-fa91e98d5abf None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:02:59.131320 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16b1751f-1274-4689-9a41-fa91e98d5abf None admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:02:59.140567 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application [None req-16b1751f-1274-4689-9a41-fa91e98d5abf None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jul 28 08:02:59.140567 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:02:59.140567 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 28 08:02:59.140567 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 28 08:02:59.140567 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 28 08:02:59.140567 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 28 08:02:59.140567 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 28 08:02:59.140567 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 08:02:59.140567 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 28 08:02:59.140567 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application Jul 28 08:02:59.140567 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 28 08:02:59.140567 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application Jul 28 08:02:59.140567 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:02:59.140567 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:02:59.140567 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:02:59.140567 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:02:59.140567 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:02:59.142352 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:02:59.142352 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:02:59.142352 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:02:59.142352 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:02:59.142352 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:02:59.142352 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:02:59.142352 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 28 08:02:59.142352 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 28 08:02:59.142352 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 28 08:02:59.142352 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 28 08:02:59.142352 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:02:59.142352 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:02:59.142352 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:02:59.142352 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:02:59.142352 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:02:59.142352 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:02:59.144137 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:02:59.144137 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application with Lock( Jul 28 08:02:59.144137 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:02:59.144137 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:02:59.144137 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:02:59.144137 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:02:59.144137 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:02:59.144137 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:02:59.144137 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:02:59.144137 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:02:59.144137 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 28 08:02:59.144137 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 08:02:59.144137 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 28 08:02:59.144137 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application Jul 28 08:02:59.144137 dv-cinder-851351-1-smb devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 634/1298] 10.222.0.42 () {56 vars in 1117 bytes} [Thu Jul 28 08:02:58 2022] GET /identity/v3/services/placement => generated 90 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:02:59.149773 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a003deef-31c5-463b-8c56-72148351d308 None None] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:02:59.170256 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:02:59.255532 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a003deef-31c5-463b-8c56-72148351d308 None None] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:02:59.292602 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac58467-0c74-44ae-824d-ae0463e96789 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:02:59.293253 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac58467-0c74-44ae-824d-ae0463e96789 None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:02:59.293522 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac58467-0c74-44ae-824d-ae0463e96789 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:02:59.293789 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac58467-0c74-44ae-824d-ae0463e96789 None admin] PATH_INFO: `/v3/services` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:02:59.294467 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ac58467-0c74-44ae-824d-ae0463e96789 None admin] RBAC: Adding query filter params (name=placement) {{(pid=80347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:02:59.294763 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ac58467-0c74-44ae-824d-ae0463e96789 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:02:59.296121 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ac58467-0c74-44ae-824d-ae0463e96789 None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:02:59.302110 dv-cinder-851351-1-smb devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 665/1299] 10.222.0.42 () {56 vars in 1116 bytes} [Thu Jul 28 08:02:59 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:02:59.308429 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b1751f-1274-4689-9a41-fa91e98d5abf None admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:02:59.348541 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=100 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:02:59.420504 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b1751f-1274-4689-9a41-fa91e98d5abf None admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:02:59.454676 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63dcc80-9a73-4c74-9c85-5da32545736b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:02:59.455295 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63dcc80-9a73-4c74-9c85-5da32545736b None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:02:59.455569 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63dcc80-9a73-4c74-9c85-5da32545736b None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:02:59.455836 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63dcc80-9a73-4c74-9c85-5da32545736b None admin] PATH_INFO: `/v3/endpoints` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:02:59.456595 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e63dcc80-9a73-4c74-9c85-5da32545736b None admin] RBAC: Adding query filter params (interface=public, service_id=95748e5454104268b4270c88bfbb3e12, region_id=RegionOne) {{(pid=80348) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:02:59.456937 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e63dcc80-9a73-4c74-9c85-5da32545736b None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:02:59.458396 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e63dcc80-9a73-4c74-9c85-5da32545736b None admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:02:59.463878 dv-cinder-851351-1-smb devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 635/1300] 10.222.0.42 () {56 vars in 1251 bytes} [Thu Jul 28 08:02:59 2022] GET /identity/v3/endpoints?service_id=95748e5454104268b4270c88bfbb3e12&interface=public®ion_id=RegionOne => generated 194 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:02:59.469945 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac58467-0c74-44ae-824d-ae0463e96789 None admin] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:02:59.553206 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:02:59.574218 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac58467-0c74-44ae-824d-ae0463e96789 None admin] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:02:59.610360 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a50817-97d1-41f8-8300-67f20cf79c80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:02:59.610889 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a50817-97d1-41f8-8300-67f20cf79c80 None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:02:59.611165 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a50817-97d1-41f8-8300-67f20cf79c80 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:02:59.611433 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a50817-97d1-41f8-8300-67f20cf79c80 None admin] PATH_INFO: `/v3/services` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:02:59.612091 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6a50817-97d1-41f8-8300-67f20cf79c80 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:02:59.613528 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6a50817-97d1-41f8-8300-67f20cf79c80 None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:02:59.620625 dv-cinder-851351-1-smb devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 666/1301] 10.222.0.42 () {56 vars in 1087 bytes} [Thu Jul 28 08:02:59 2022] GET /identity/v3/services => generated 2191 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 08:03:01.631604 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f24e33-bad5-4350-b89a-0d9ac760cb8d None None] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:03:01.632149 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f24e33-bad5-4350-b89a-0d9ac760cb8d None None] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:03:01.632149 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f24e33-bad5-4350-b89a-0d9ac760cb8d None None] PATH_INFO: `/` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:03:01.633579 dv-cinder-851351-1-smb devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 636/1302] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 08:03:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 08:03:01.639143 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709a3cdd-4af5-4b0d-b219-64650083dffa None None] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:03:01.639600 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709a3cdd-4af5-4b0d-b219-64650083dffa None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:03:01.639688 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709a3cdd-4af5-4b0d-b219-64650083dffa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:03:01.658384 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.auth.core [None req-709a3cdd-4af5-4b0d-b219-64650083dffa None None] MFA Rules not processed for user `f0666d3a50644a7097367331c1ee1a68`. Rule list: `[]` (Enabled: `True`). {{(pid=80347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 08:03:01.659590 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-709a3cdd-4af5-4b0d-b219-64650083dffa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:03:01.733854 dv-cinder-851351-1-smb devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 667/1303] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 08:03:01 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 08:03:01.756458 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f24e33-bad5-4350-b89a-0d9ac760cb8d None None] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:03:01.860845 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=100 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:03:01.868455 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f24e33-bad5-4350-b89a-0d9ac760cb8d None None] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:03:01.907034 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9740a238-7f1a-41ec-ac2c-d97248dc76eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:03:01.907594 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9740a238-7f1a-41ec-ac2c-d97248dc76eb None admin] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:03:01.907866 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9740a238-7f1a-41ec-ac2c-d97248dc76eb None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:03:01.908138 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9740a238-7f1a-41ec-ac2c-d97248dc76eb None admin] PATH_INFO: `/v3/services/placement` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:03:01.908799 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9740a238-7f1a-41ec-ac2c-d97248dc76eb None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:03:01.910169 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9740a238-7f1a-41ec-ac2c-d97248dc76eb None admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:03:01.924576 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application [None req-9740a238-7f1a-41ec-ac2c-d97248dc76eb None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jul 28 08:03:01.924576 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:03:01.924576 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 28 08:03:01.924576 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 28 08:03:01.924576 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 28 08:03:01.924576 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 28 08:03:01.924576 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 28 08:03:01.924576 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 08:03:01.924576 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 28 08:03:01.924576 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application Jul 28 08:03:01.924576 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 28 08:03:01.924576 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application Jul 28 08:03:01.924576 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:03:01.924576 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:03:01.924576 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:03:01.924576 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:03:01.924576 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:03:01.925750 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:03:01.925750 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:03:01.925750 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:03:01.925750 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:03:01.925750 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:03:01.925750 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:03:01.925750 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 28 08:03:01.925750 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 28 08:03:01.925750 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 28 08:03:01.925750 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 28 08:03:01.925750 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:03:01.925750 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:03:01.925750 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:03:01.925750 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:03:01.925750 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:03:01.925750 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:03:01.926723 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:03:01.926723 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application with Lock( Jul 28 08:03:01.926723 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:03:01.926723 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:03:01.926723 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:03:01.926723 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:03:01.926723 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:03:01.926723 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:03:01.926723 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:03:01.926723 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:03:01.926723 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 28 08:03:01.926723 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 08:03:01.926723 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 28 08:03:01.926723 dv-cinder-851351-1-smb devstack@keystone.service[80348]: ERROR keystone.server.flask.application Jul 28 08:03:01.926723 dv-cinder-851351-1-smb devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 637/1304] 10.222.0.42 () {56 vars in 1117 bytes} [Thu Jul 28 08:03:01 2022] GET /identity/v3/services/placement => generated 90 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:03:01.937183 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709a3cdd-4af5-4b0d-b219-64650083dffa None None] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:03:02.018923 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:03:02.043212 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709a3cdd-4af5-4b0d-b219-64650083dffa None None] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:03:02.081162 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7845f362-87c0-4f00-9000-3e5f350f1084 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:03:02.081776 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7845f362-87c0-4f00-9000-3e5f350f1084 None admin] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:03:02.082046 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7845f362-87c0-4f00-9000-3e5f350f1084 None admin] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:03:02.082350 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7845f362-87c0-4f00-9000-3e5f350f1084 None admin] PATH_INFO: `/v3/services` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:03:02.083024 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7845f362-87c0-4f00-9000-3e5f350f1084 None admin] RBAC: Adding query filter params (name=placement) {{(pid=80347) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:03:02.083319 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7845f362-87c0-4f00-9000-3e5f350f1084 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:03:02.084710 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7845f362-87c0-4f00-9000-3e5f350f1084 None admin] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:03:02.090258 dv-cinder-851351-1-smb devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 668/1305] 10.222.0.42 () {56 vars in 1116 bytes} [Thu Jul 28 08:03:01 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:03:02.096297 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9740a238-7f1a-41ec-ac2c-d97248dc76eb None admin] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:03:02.200652 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9740a238-7f1a-41ec-ac2c-d97248dc76eb None admin] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:03:02.234466 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ec80bb-efd3-48d9-bf08-b8a0dde96b30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f0666d3a50644a7097367331c1ee1a68', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:03:02.235077 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ec80bb-efd3-48d9-bf08-b8a0dde96b30 None admin] REQUEST_METHOD: `POST` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:03:02.235349 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ec80bb-efd3-48d9-bf08-b8a0dde96b30 None admin] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:03:02.235613 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ec80bb-efd3-48d9-bf08-b8a0dde96b30 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:03:02.236314 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27ec80bb-efd3-48d9-bf08-b8a0dde96b30 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:03:02.237711 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27ec80bb-efd3-48d9-bf08-b8a0dde96b30 None admin] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:03:02.258790 dv-cinder-851351-1-smb devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 638/1306] 10.222.0.42 () {60 vars in 1144 bytes} [Thu Jul 28 08:03:02 2022] POST /identity/v3/endpoints => generated 331 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 08:03:12.087473 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=30 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:03:12.254623 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=91,keystone:INSERT=1 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:04:05.634213 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b842c8f-9c14-4ac1-bc1e-f2b9a079e75e None None] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:04:05.634858 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b842c8f-9c14-4ac1-bc1e-f2b9a079e75e None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:04:05.634858 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b842c8f-9c14-4ac1-bc1e-f2b9a079e75e None None] PATH_INFO: `/` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:04:05.641556 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72454d87-97a3-4a75-9623-3b3de353f96c None None] REQUEST_METHOD: `POST` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:04:05.642070 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72454d87-97a3-4a75-9623-3b3de353f96c None None] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:04:05.642150 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72454d87-97a3-4a75-9623-3b3de353f96c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:04:05.647068 dv-cinder-851351-1-smb devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 669/1307] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 08:04:05 2022] GET /identity => generated 270 bytes in 14 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 28 08:04:05.720895 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.auth.core [None req-72454d87-97a3-4a75-9623-3b3de353f96c None None] MFA Rules not processed for user `f0666d3a50644a7097367331c1ee1a68`. Rule list: `[]` (Enabled: `True`). {{(pid=80348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 08:04:05.722543 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.fernet_utils [None req-72454d87-97a3-4a75-9623-3b3de353f96c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:04:05.874203 dv-cinder-851351-1-smb devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 639/1308] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 08:04:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 234 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 08:04:05.941798 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64212afc-5707-4a28-b719-745c3a0690e2 None None] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:04:05.942797 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64212afc-5707-4a28-b719-745c3a0690e2 None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:04:05.945382 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64212afc-5707-4a28-b719-745c3a0690e2 None None] PATH_INFO: `/` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:04:05.949528 dv-cinder-851351-1-smb devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 670/1309] 10.222.0.42 () {54 vars in 965 bytes} [Thu Jul 28 08:04:05 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 08:04:05.963180 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356042fd-ff2b-4e6f-9fae-ca09556b9a6b None None] REQUEST_METHOD: `POST` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:04:05.963473 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356042fd-ff2b-4e6f-9fae-ca09556b9a6b None None] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:04:05.963775 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356042fd-ff2b-4e6f-9fae-ca09556b9a6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:04:06.098950 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.auth.core [None req-356042fd-ff2b-4e6f-9fae-ca09556b9a6b None None] MFA Rules not processed for user `0f1b1394d91540aaa0bb3f07c78fc812`. Rule list: `[]` (Enabled: `True`). {{(pid=80348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 08:04:06.100304 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.fernet_utils [None req-356042fd-ff2b-4e6f-9fae-ca09556b9a6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:04:06.123394 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=100 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:04:06.190654 dv-cinder-851351-1-smb devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 640/1310] 10.222.0.42 () {58 vars in 1062 bytes} [Thu Jul 28 08:04:05 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 229 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 08:04:06.200140 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64212afc-5707-4a28-b719-745c3a0690e2 None None] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:04:06.202464 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-64212afc-5707-4a28-b719-745c3a0690e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:04:06.322169 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64212afc-5707-4a28-b719-745c3a0690e2 None None] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:04:06.399333 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f54d37f-21f8-4629-8302-72eee42d2be1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f1b1394d91540aaa0bb3f07c78fc812', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '139349507026497c98f360774dee737e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:04:06.399961 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f54d37f-21f8-4629-8302-72eee42d2be1 service neutron] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:04:06.400229 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f54d37f-21f8-4629-8302-72eee42d2be1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:04:06.400494 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f54d37f-21f8-4629-8302-72eee42d2be1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:04:06.402175 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-4f54d37f-21f8-4629-8302-72eee42d2be1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:04:06.460961 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:04:06.523574 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f54d37f-21f8-4629-8302-72eee42d2be1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:04:06.525113 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f54d37f-21f8-4629-8302-72eee42d2be1 service neutron] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:04:06.547730 dv-cinder-851351-1-smb devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 671/1311] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Jul 28 08:04:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 348 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 28 08:04:08.832237 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ab7c6e-97ca-413c-b1cf-f79d250a72ca None None] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:04:08.832839 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ab7c6e-97ca-413c-b1cf-f79d250a72ca None None] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:04:08.832839 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ab7c6e-97ca-413c-b1cf-f79d250a72ca None None] PATH_INFO: `/` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:04:08.834337 dv-cinder-851351-1-smb devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 641/1312] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 08:04:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 08:04:08.839773 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbcb611-82bd-4e8c-9a6a-30137f560933 None None] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:04:08.840245 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbcb611-82bd-4e8c-9a6a-30137f560933 None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:04:08.840337 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbcb611-82bd-4e8c-9a6a-30137f560933 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:04:08.926312 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.auth.core [None req-acbcb611-82bd-4e8c-9a6a-30137f560933 None None] MFA Rules not processed for user `f0666d3a50644a7097367331c1ee1a68`. Rule list: `[]` (Enabled: `True`). {{(pid=80347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 08:04:08.927570 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-acbcb611-82bd-4e8c-9a6a-30137f560933 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:04:09.035056 dv-cinder-851351-1-smb devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 672/1313] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 08:04:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 08:04:09.089031 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89527f22-e839-45a1-ac6a-23b002689098 None None] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:04:09.089391 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89527f22-e839-45a1-ac6a-23b002689098 None None] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:04:09.089755 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89527f22-e839-45a1-ac6a-23b002689098 None None] PATH_INFO: `/` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:04:09.091256 dv-cinder-851351-1-smb devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 642/1314] 10.222.0.42 () {54 vars in 965 bytes} [Thu Jul 28 08:04:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 08:04:09.097573 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f940acdd-6896-4b38-b54a-76d35ac439b8 None None] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:04:09.097863 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f940acdd-6896-4b38-b54a-76d35ac439b8 None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:04:09.098138 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f940acdd-6896-4b38-b54a-76d35ac439b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:04:09.110972 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:04:09.182158 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.auth.core [None req-f940acdd-6896-4b38-b54a-76d35ac439b8 None None] MFA Rules not processed for user `0f1b1394d91540aaa0bb3f07c78fc812`. Rule list: `[]` (Enabled: `True`). {{(pid=80347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 08:04:09.183488 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-f940acdd-6896-4b38-b54a-76d35ac439b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:04:09.274087 dv-cinder-851351-1-smb devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 673/1315] 10.222.0.42 () {58 vars in 1062 bytes} [Thu Jul 28 08:04:09 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 08:04:09.283405 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89527f22-e839-45a1-ac6a-23b002689098 None None] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:04:09.285162 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.fernet_utils [None req-89527f22-e839-45a1-ac6a-23b002689098 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:04:09.398449 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89527f22-e839-45a1-ac6a-23b002689098 None None] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:04:09.473540 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=100 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:04:09.476127 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-880ab6a7-fbd6-4097-8b83-16719eab22fe service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f1b1394d91540aaa0bb3f07c78fc812', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '139349507026497c98f360774dee737e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:04:09.476794 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880ab6a7-fbd6-4097-8b83-16719eab22fe service neutron] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:04:09.477319 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880ab6a7-fbd6-4097-8b83-16719eab22fe service neutron] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:04:09.477681 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880ab6a7-fbd6-4097-8b83-16719eab22fe service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:04:09.479880 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.fernet_utils [None req-880ab6a7-fbd6-4097-8b83-16719eab22fe service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:04:09.592793 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-880ab6a7-fbd6-4097-8b83-16719eab22fe service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:04:09.594248 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-880ab6a7-fbd6-4097-8b83-16719eab22fe service neutron] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:04:09.615308 dv-cinder-851351-1-smb devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 643/1316] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Jul 28 08:04:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 08:04:12.168258 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5b1183-7b5b-4f6d-8a72-93191e3132da None None] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:04:12.168258 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5b1183-7b5b-4f6d-8a72-93191e3132da None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:04:12.168258 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5b1183-7b5b-4f6d-8a72-93191e3132da None None] PATH_INFO: `/` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:04:12.169650 dv-cinder-851351-1-smb devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 674/1317] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 08:04:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 08:04:12.175298 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b754129-4ac2-45f4-9d22-11a025707315 None None] REQUEST_METHOD: `POST` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:04:12.175781 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b754129-4ac2-45f4-9d22-11a025707315 None None] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:04:12.175889 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b754129-4ac2-45f4-9d22-11a025707315 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:04:12.244892 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.auth.core [None req-3b754129-4ac2-45f4-9d22-11a025707315 None None] MFA Rules not processed for user `3e40f59d19f54db3bf0031b56994797a`. Rule list: `[]` (Enabled: `True`). {{(pid=80348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 08:04:12.246126 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.fernet_utils [None req-3b754129-4ac2-45f4-9d22-11a025707315 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:04:12.300082 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=100 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:04:12.347295 dv-cinder-851351-1-smb devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 644/1318] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 08:04:12 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 08:04:12.387207 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd5b1183-7b5b-4f6d-8a72-93191e3132da None None] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:04:12.388818 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-cd5b1183-7b5b-4f6d-8a72-93191e3132da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:04:12.499955 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd5b1183-7b5b-4f6d-8a72-93191e3132da None None] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:04:12.502845 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:04:12.579511 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173f1de4-b9a0-4a43-b2c1-0c70319d1ba0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f1b1394d91540aaa0bb3f07c78fc812', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '139349507026497c98f360774dee737e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:04:12.580128 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173f1de4-b9a0-4a43-b2c1-0c70319d1ba0 service neutron] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:04:12.580400 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173f1de4-b9a0-4a43-b2c1-0c70319d1ba0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:04:12.580695 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173f1de4-b9a0-4a43-b2c1-0c70319d1ba0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:04:12.582326 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-173f1de4-b9a0-4a43-b2c1-0c70319d1ba0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:04:12.693153 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-173f1de4-b9a0-4a43-b2c1-0c70319d1ba0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:04:12.694598 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-173f1de4-b9a0-4a43-b2c1-0c70319d1ba0 service neutron] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:04:12.714327 dv-cinder-851351-1-smb devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 675/1319] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Jul 28 08:04:12 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 08:04:15.478155 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b2141b-eb37-4bc8-84d9-c14ff289b08f None None] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:04:15.478693 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b2141b-eb37-4bc8-84d9-c14ff289b08f None None] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:04:15.478693 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b2141b-eb37-4bc8-84d9-c14ff289b08f None None] PATH_INFO: `/` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:04:15.479998 dv-cinder-851351-1-smb devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 645/1320] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 08:04:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 08:04:15.485372 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbbc03a9-d608-490f-a7e2-8844de29a16d None None] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:04:15.485815 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbbc03a9-d608-490f-a7e2-8844de29a16d None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:04:15.485907 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbbc03a9-d608-490f-a7e2-8844de29a16d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:04:15.528378 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:04:15.556948 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.auth.core [None req-cbbc03a9-d608-490f-a7e2-8844de29a16d None None] MFA Rules not processed for user `f0666d3a50644a7097367331c1ee1a68`. Rule list: `[]` (Enabled: `True`). {{(pid=80347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 08:04:15.558188 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-cbbc03a9-d608-490f-a7e2-8844de29a16d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:04:15.657252 dv-cinder-851351-1-smb devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 676/1321] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 08:04:15 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 08:04:15.696564 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b2141b-eb37-4bc8-84d9-c14ff289b08f None None] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:04:15.698245 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.fernet_utils [None req-c8b2141b-eb37-4bc8-84d9-c14ff289b08f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:04:15.816712 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b2141b-eb37-4bc8-84d9-c14ff289b08f None None] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:04:15.897909 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-448783bb-cf31-4a74-9d50-43397da611ff service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f1b1394d91540aaa0bb3f07c78fc812', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '139349507026497c98f360774dee737e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:04:15.898541 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448783bb-cf31-4a74-9d50-43397da611ff service neutron] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:04:15.898844 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448783bb-cf31-4a74-9d50-43397da611ff service neutron] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:04:15.899110 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448783bb-cf31-4a74-9d50-43397da611ff service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:04:15.900771 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.fernet_utils [None req-448783bb-cf31-4a74-9d50-43397da611ff service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:04:15.908588 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=100 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:04:16.029848 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-448783bb-cf31-4a74-9d50-43397da611ff service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:04:16.031330 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-448783bb-cf31-4a74-9d50-43397da611ff service neutron] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:04:16.050480 dv-cinder-851351-1-smb devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 646/1322] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Jul 28 08:04:15 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 354 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 08:04:18.815905 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c125b21-6a15-4470-ac08-0a01bf6b8c89 None None] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:04:18.816540 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c125b21-6a15-4470-ac08-0a01bf6b8c89 None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:04:18.816540 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c125b21-6a15-4470-ac08-0a01bf6b8c89 None None] PATH_INFO: `/` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:04:18.817893 dv-cinder-851351-1-smb devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 677/1323] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 08:04:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 08:04:18.824030 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e2e310-2763-4351-80b0-8e8fdbaee4af None None] REQUEST_METHOD: `POST` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:04:18.824588 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e2e310-2763-4351-80b0-8e8fdbaee4af None None] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:04:18.824588 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e2e310-2763-4351-80b0-8e8fdbaee4af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:04:18.904025 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.auth.core [None req-19e2e310-2763-4351-80b0-8e8fdbaee4af None None] MFA Rules not processed for user `f0666d3a50644a7097367331c1ee1a68`. Rule list: `[]` (Enabled: `True`). {{(pid=80348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 08:04:18.905299 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.fernet_utils [None req-19e2e310-2763-4351-80b0-8e8fdbaee4af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:04:18.968933 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=100 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:04:19.014824 dv-cinder-851351-1-smb devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 647/1324] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 08:04:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 08:04:19.051473 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c125b21-6a15-4470-ac08-0a01bf6b8c89 None None] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:04:19.053176 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-3c125b21-6a15-4470-ac08-0a01bf6b8c89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:04:19.175207 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c125b21-6a15-4470-ac08-0a01bf6b8c89 None None] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:04:19.188973 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:04:19.254572 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-decb2598-cce3-4ae2-8ea9-bf27ae11f787 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f1b1394d91540aaa0bb3f07c78fc812', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '139349507026497c98f360774dee737e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:04:19.255206 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-decb2598-cce3-4ae2-8ea9-bf27ae11f787 service neutron] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:04:19.255506 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-decb2598-cce3-4ae2-8ea9-bf27ae11f787 service neutron] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:04:19.255767 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-decb2598-cce3-4ae2-8ea9-bf27ae11f787 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:04:19.257557 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-decb2598-cce3-4ae2-8ea9-bf27ae11f787 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:04:19.379202 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-decb2598-cce3-4ae2-8ea9-bf27ae11f787 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:04:19.380675 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-decb2598-cce3-4ae2-8ea9-bf27ae11f787 service neutron] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:04:19.399093 dv-cinder-851351-1-smb devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 678/1325] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Jul 28 08:04:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 348 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 08:04:21.472206 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9538a458-d6ae-40ec-8cb4-1435844156d3 None None] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:04:21.472786 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9538a458-d6ae-40ec-8cb4-1435844156d3 None None] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:04:21.472786 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9538a458-d6ae-40ec-8cb4-1435844156d3 None None] PATH_INFO: `/` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:04:21.474043 dv-cinder-851351-1-smb devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 648/1326] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 08:04:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 08:04:21.479527 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3063e0dc-3bf8-498f-b034-a1b9fa9e7105 None None] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:04:21.480006 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3063e0dc-3bf8-498f-b034-a1b9fa9e7105 None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:04:21.480190 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3063e0dc-3bf8-498f-b034-a1b9fa9e7105 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:04:21.532551 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:04:21.552721 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.auth.core [None req-3063e0dc-3bf8-498f-b034-a1b9fa9e7105 None None] MFA Rules not processed for user `f0666d3a50644a7097367331c1ee1a68`. Rule list: `[]` (Enabled: `True`). {{(pid=80347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 08:04:21.553983 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-3063e0dc-3bf8-498f-b034-a1b9fa9e7105 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:04:21.656072 dv-cinder-851351-1-smb devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 679/1327] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 08:04:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 08:04:21.692368 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9538a458-d6ae-40ec-8cb4-1435844156d3 None None] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:04:21.693949 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.fernet_utils [None req-9538a458-d6ae-40ec-8cb4-1435844156d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:04:21.804172 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9538a458-d6ae-40ec-8cb4-1435844156d3 None None] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:04:21.887403 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd136e2b-06b5-480f-aa42-53bf9a5d47dd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f1b1394d91540aaa0bb3f07c78fc812', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '139349507026497c98f360774dee737e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:04:21.888073 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd136e2b-06b5-480f-aa42-53bf9a5d47dd service neutron] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:04:21.888495 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd136e2b-06b5-480f-aa42-53bf9a5d47dd service neutron] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:04:21.888635 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd136e2b-06b5-480f-aa42-53bf9a5d47dd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:04:21.890354 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.fernet_utils [None req-fd136e2b-06b5-480f-aa42-53bf9a5d47dd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:04:21.908914 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=100 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:04:22.007331 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd136e2b-06b5-480f-aa42-53bf9a5d47dd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:04:22.008830 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd136e2b-06b5-480f-aa42-53bf9a5d47dd service neutron] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:04:22.028540 dv-cinder-851351-1-smb devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 649/1328] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Jul 28 08:04:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 08:04:24.100438 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f51bf5a-825f-409b-8e76-78b57d23cb12 None None] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:04:24.101004 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f51bf5a-825f-409b-8e76-78b57d23cb12 None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:04:24.101126 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f51bf5a-825f-409b-8e76-78b57d23cb12 None None] PATH_INFO: `/` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:04:24.102468 dv-cinder-851351-1-smb devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 680/1329] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 08:04:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 08:04:24.107890 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2355e33-b0fc-4191-babf-1add6fbc9e16 None None] REQUEST_METHOD: `POST` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:04:24.108345 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2355e33-b0fc-4191-babf-1add6fbc9e16 None None] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:04:24.108560 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2355e33-b0fc-4191-babf-1add6fbc9e16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:04:24.183349 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.auth.core [None req-f2355e33-b0fc-4191-babf-1add6fbc9e16 None None] MFA Rules not processed for user `3e40f59d19f54db3bf0031b56994797a`. Rule list: `[]` (Enabled: `True`). {{(pid=80348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 08:04:24.184492 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.fernet_utils [None req-f2355e33-b0fc-4191-babf-1add6fbc9e16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:04:24.262126 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=100 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:04:24.304219 dv-cinder-851351-1-smb devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 650/1330] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 08:04:24 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 08:04:24.345504 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f51bf5a-825f-409b-8e76-78b57d23cb12 None None] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:04:24.347755 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-8f51bf5a-825f-409b-8e76-78b57d23cb12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:04:24.470757 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f51bf5a-825f-409b-8e76-78b57d23cb12 None None] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:04:24.492206 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:04:24.555718 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a9caf33-f006-459f-ac88-e1e650628c9a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f1b1394d91540aaa0bb3f07c78fc812', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '139349507026497c98f360774dee737e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:04:24.556336 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9caf33-f006-459f-ac88-e1e650628c9a service neutron] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:04:24.556826 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9caf33-f006-459f-ac88-e1e650628c9a service neutron] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:04:24.556968 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9caf33-f006-459f-ac88-e1e650628c9a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:04:24.558569 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-5a9caf33-f006-459f-ac88-e1e650628c9a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:04:24.683740 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a9caf33-f006-459f-ac88-e1e650628c9a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:04:24.683740 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a9caf33-f006-459f-ac88-e1e650628c9a service neutron] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:04:24.707853 dv-cinder-851351-1-smb devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 681/1331] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Jul 28 08:04:24 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 363 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 28 08:04:26.979660 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc3065f-0007-433d-bc9f-d1fbf90172a9 None None] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:04:26.980194 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc3065f-0007-433d-bc9f-d1fbf90172a9 None None] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:04:26.980194 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc3065f-0007-433d-bc9f-d1fbf90172a9 None None] PATH_INFO: `/` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:04:26.981542 dv-cinder-851351-1-smb devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 651/1332] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 08:04:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 08:04:26.987167 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a894b3d-d39f-494f-a715-e1a4b7386f2f None None] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:04:26.987612 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a894b3d-d39f-494f-a715-e1a4b7386f2f None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:04:26.987704 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a894b3d-d39f-494f-a715-e1a4b7386f2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:04:27.055318 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:04:27.058175 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.auth.core [None req-6a894b3d-d39f-494f-a715-e1a4b7386f2f None None] MFA Rules not processed for user `f0666d3a50644a7097367331c1ee1a68`. Rule list: `[]` (Enabled: `True`). {{(pid=80347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 08:04:27.059864 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-6a894b3d-d39f-494f-a715-e1a4b7386f2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:04:27.159968 dv-cinder-851351-1-smb devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 682/1333] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 08:04:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 08:04:27.196752 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc3065f-0007-433d-bc9f-d1fbf90172a9 None None] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:04:27.198313 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.fernet_utils [None req-edc3065f-0007-433d-bc9f-d1fbf90172a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:04:27.309877 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc3065f-0007-433d-bc9f-d1fbf90172a9 None None] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:04:27.387925 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36178837-6913-4fe7-9a85-41e07b9b86c7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f1b1394d91540aaa0bb3f07c78fc812', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '139349507026497c98f360774dee737e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:04:27.388557 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36178837-6913-4fe7-9a85-41e07b9b86c7 service neutron] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:04:27.388909 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36178837-6913-4fe7-9a85-41e07b9b86c7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:04:27.389229 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36178837-6913-4fe7-9a85-41e07b9b86c7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:04:27.390901 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.fernet_utils [None req-36178837-6913-4fe7-9a85-41e07b9b86c7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:04:27.419168 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=100 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:04:27.514698 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36178837-6913-4fe7-9a85-41e07b9b86c7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:04:27.516152 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36178837-6913-4fe7-9a85-41e07b9b86c7 service neutron] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:04:27.539497 dv-cinder-851351-1-smb devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 652/1334] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Jul 28 08:04:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 343 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 08:04:29.636573 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fae5db0-9de3-4429-9797-74814d1acd14 None None] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:04:29.637168 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fae5db0-9de3-4429-9797-74814d1acd14 None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:04:29.637168 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fae5db0-9de3-4429-9797-74814d1acd14 None None] PATH_INFO: `/` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:04:29.638533 dv-cinder-851351-1-smb devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 683/1335] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 08:04:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 08:04:29.643950 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00247ad6-2a1a-4f83-8b73-1d364bc258c6 None None] REQUEST_METHOD: `POST` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:04:29.644385 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00247ad6-2a1a-4f83-8b73-1d364bc258c6 None None] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:04:29.644497 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00247ad6-2a1a-4f83-8b73-1d364bc258c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:04:29.712361 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.auth.core [None req-00247ad6-2a1a-4f83-8b73-1d364bc258c6 None None] MFA Rules not processed for user `f0666d3a50644a7097367331c1ee1a68`. Rule list: `[]` (Enabled: `True`). {{(pid=80348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 08:04:29.713655 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.fernet_utils [None req-00247ad6-2a1a-4f83-8b73-1d364bc258c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:04:29.794374 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=100 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:04:29.818460 dv-cinder-851351-1-smb devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 653/1336] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 08:04:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 08:04:29.858758 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fae5db0-9de3-4429-9797-74814d1acd14 None None] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:04:29.860321 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-5fae5db0-9de3-4429-9797-74814d1acd14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:04:29.977469 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fae5db0-9de3-4429-9797-74814d1acd14 None None] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:04:30.008149 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:04:30.055613 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0050d4fe-d8fd-4bf0-af3c-8f7cbb2fcb2b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f1b1394d91540aaa0bb3f07c78fc812', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '139349507026497c98f360774dee737e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:04:30.056252 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0050d4fe-d8fd-4bf0-af3c-8f7cbb2fcb2b service neutron] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:04:30.056539 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0050d4fe-d8fd-4bf0-af3c-8f7cbb2fcb2b service neutron] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:04:30.056836 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0050d4fe-d8fd-4bf0-af3c-8f7cbb2fcb2b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:04:30.058494 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-0050d4fe-d8fd-4bf0-af3c-8f7cbb2fcb2b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:04:30.173418 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0050d4fe-d8fd-4bf0-af3c-8f7cbb2fcb2b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:04:30.174945 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0050d4fe-d8fd-4bf0-af3c-8f7cbb2fcb2b service neutron] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:04:30.193467 dv-cinder-851351-1-smb devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 684/1337] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Jul 28 08:04:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 335 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 08:04:32.578360 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18a8b37-a88f-49cd-804a-fce2e30e7d7f None None] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:04:32.578909 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18a8b37-a88f-49cd-804a-fce2e30e7d7f None None] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:04:32.578909 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18a8b37-a88f-49cd-804a-fce2e30e7d7f None None] PATH_INFO: `/` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:04:32.580309 dv-cinder-851351-1-smb devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 654/1338] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 08:04:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 08:04:32.585612 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0434824f-8346-47bf-81bd-f1a520b2fabe None None] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:04:32.586052 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0434824f-8346-47bf-81bd-f1a520b2fabe None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:04:32.586140 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0434824f-8346-47bf-81bd-f1a520b2fabe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:04:32.657133 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.auth.core [None req-0434824f-8346-47bf-81bd-f1a520b2fabe None None] MFA Rules not processed for user `f0666d3a50644a7097367331c1ee1a68`. Rule list: `[]` (Enabled: `True`). {{(pid=80347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 08:04:32.658501 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-0434824f-8346-47bf-81bd-f1a520b2fabe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:04:32.666891 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:04:32.759914 dv-cinder-851351-1-smb devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 685/1339] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 08:04:32 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 08:04:32.795881 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c18a8b37-a88f-49cd-804a-fce2e30e7d7f None None] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:04:32.797447 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.fernet_utils [None req-c18a8b37-a88f-49cd-804a-fce2e30e7d7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:04:32.908731 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c18a8b37-a88f-49cd-804a-fce2e30e7d7f None None] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:04:32.986712 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390f052d-2695-41fc-ac19-af07036f85f1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f1b1394d91540aaa0bb3f07c78fc812', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '139349507026497c98f360774dee737e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:04:32.987369 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390f052d-2695-41fc-ac19-af07036f85f1 service neutron] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:04:32.987642 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390f052d-2695-41fc-ac19-af07036f85f1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:04:32.987906 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390f052d-2695-41fc-ac19-af07036f85f1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:04:32.989623 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.fernet_utils [None req-390f052d-2695-41fc-ac19-af07036f85f1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:04:33.027786 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=100 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:04:33.103973 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-390f052d-2695-41fc-ac19-af07036f85f1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:04:33.105445 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-390f052d-2695-41fc-ac19-af07036f85f1 service neutron] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:04:33.123987 dv-cinder-851351-1-smb devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 655/1340] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Jul 28 08:04:32 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 08:04:37.164422 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0fae98-dc8a-414d-8864-54b167d2c14f None None] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:04:37.165009 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0fae98-dc8a-414d-8864-54b167d2c14f None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:04:37.165009 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0fae98-dc8a-414d-8864-54b167d2c14f None None] PATH_INFO: `/` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:04:37.166433 dv-cinder-851351-1-smb devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 686/1341] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 08:04:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 08:04:37.171755 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d872f3ea-a48e-46c2-bac2-db1e581f52ba None None] REQUEST_METHOD: `POST` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:04:37.172222 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d872f3ea-a48e-46c2-bac2-db1e581f52ba None None] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:04:37.172323 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d872f3ea-a48e-46c2-bac2-db1e581f52ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:04:37.239287 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.auth.core [None req-d872f3ea-a48e-46c2-bac2-db1e581f52ba None None] MFA Rules not processed for user `f0666d3a50644a7097367331c1ee1a68`. Rule list: `[]` (Enabled: `True`). {{(pid=80348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 08:04:37.240416 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.fernet_utils [None req-d872f3ea-a48e-46c2-bac2-db1e581f52ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:04:37.332407 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=100 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:04:37.344422 dv-cinder-851351-1-smb devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 656/1342] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 08:04:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 08:04:37.383125 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0fae98-dc8a-414d-8864-54b167d2c14f None None] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:04:37.384694 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-ee0fae98-dc8a-414d-8864-54b167d2c14f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:04:37.490535 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0fae98-dc8a-414d-8864-54b167d2c14f None None] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:04:37.527357 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:04:37.567514 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e4ebe3-add8-411f-9832-4b9dc50b3073 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f1b1394d91540aaa0bb3f07c78fc812', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '139349507026497c98f360774dee737e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:04:37.568387 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e4ebe3-add8-411f-9832-4b9dc50b3073 service neutron] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:04:37.568844 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e4ebe3-add8-411f-9832-4b9dc50b3073 service neutron] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:04:37.569207 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e4ebe3-add8-411f-9832-4b9dc50b3073 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:04:37.570960 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-e5e4ebe3-add8-411f-9832-4b9dc50b3073 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:04:37.686299 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5e4ebe3-add8-411f-9832-4b9dc50b3073 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:04:37.687747 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5e4ebe3-add8-411f-9832-4b9dc50b3073 service neutron] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:04:37.705925 dv-cinder-851351-1-smb devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 687/1343] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Jul 28 08:04:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 08:04:40.534571 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786bcec9-2dce-46f1-bc23-38ff75a438f5 None None] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:04:40.535149 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786bcec9-2dce-46f1-bc23-38ff75a438f5 None None] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:04:40.535462 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786bcec9-2dce-46f1-bc23-38ff75a438f5 None None] PATH_INFO: `/` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:04:40.537962 dv-cinder-851351-1-smb devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 657/1344] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 08:04:40 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 08:04:40.546203 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162ec828-2964-4c11-ba93-e80b32f59aff None None] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:04:40.546979 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162ec828-2964-4c11-ba93-e80b32f59aff None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:04:40.547138 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162ec828-2964-4c11-ba93-e80b32f59aff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:04:40.633289 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.auth.core [None req-162ec828-2964-4c11-ba93-e80b32f59aff None None] MFA Rules not processed for user `f0666d3a50644a7097367331c1ee1a68`. Rule list: `[]` (Enabled: `True`). {{(pid=80347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 08:04:40.634876 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-162ec828-2964-4c11-ba93-e80b32f59aff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:04:40.659448 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:04:40.779757 dv-cinder-851351-1-smb devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 688/1345] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 08:04:40 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 235 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 08:04:40.837711 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-786bcec9-2dce-46f1-bc23-38ff75a438f5 None None] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:04:40.839553 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.fernet_utils [None req-786bcec9-2dce-46f1-bc23-38ff75a438f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:04:40.988149 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-786bcec9-2dce-46f1-bc23-38ff75a438f5 None None] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:04:41.101132 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9689cea4-7889-4a0a-8c2f-0687794f9e4a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f1b1394d91540aaa0bb3f07c78fc812', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '139349507026497c98f360774dee737e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:04:41.102238 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9689cea4-7889-4a0a-8c2f-0687794f9e4a service neutron] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:04:41.102717 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9689cea4-7889-4a0a-8c2f-0687794f9e4a service neutron] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:04:41.103186 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9689cea4-7889-4a0a-8c2f-0687794f9e4a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:04:41.106108 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.fernet_utils [None req-9689cea4-7889-4a0a-8c2f-0687794f9e4a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:04:41.176591 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=100 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:04:41.257005 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9689cea4-7889-4a0a-8c2f-0687794f9e4a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:04:41.258512 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9689cea4-7889-4a0a-8c2f-0687794f9e4a service neutron] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:04:41.281008 dv-cinder-851351-1-smb devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 658/1346] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Jul 28 08:04:40 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 444 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 08:04:45.859317 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80fa6ead-219b-4ada-b20c-61c4b8abddac None None] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:04:45.860039 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80fa6ead-219b-4ada-b20c-61c4b8abddac None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:04:45.860039 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80fa6ead-219b-4ada-b20c-61c4b8abddac None None] PATH_INFO: `/` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:04:45.861611 dv-cinder-851351-1-smb devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 689/1347] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 08:04:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 08:04:45.867629 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b829fc3-40ef-4287-954e-ac6129deb390 None None] REQUEST_METHOD: `POST` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:04:45.868207 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b829fc3-40ef-4287-954e-ac6129deb390 None None] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:04:45.868207 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b829fc3-40ef-4287-954e-ac6129deb390 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:04:45.967402 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.auth.core [None req-7b829fc3-40ef-4287-954e-ac6129deb390 None None] MFA Rules not processed for user `f0666d3a50644a7097367331c1ee1a68`. Rule list: `[]` (Enabled: `True`). {{(pid=80348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 08:04:45.969226 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.fernet_utils [None req-7b829fc3-40ef-4287-954e-ac6129deb390 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:04:46.091034 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=100 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:04:46.095140 dv-cinder-851351-1-smb devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 659/1348] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 08:04:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 229 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 08:04:46.145252 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80fa6ead-219b-4ada-b20c-61c4b8abddac None None] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:04:46.146943 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-80fa6ead-219b-4ada-b20c-61c4b8abddac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:04:46.286108 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80fa6ead-219b-4ada-b20c-61c4b8abddac None None] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:04:46.347957 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:04:46.383913 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-622636bf-21aa-4a6b-bafc-59ca8c076e32 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f1b1394d91540aaa0bb3f07c78fc812', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '139349507026497c98f360774dee737e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:04:46.384591 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622636bf-21aa-4a6b-bafc-59ca8c076e32 service neutron] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:04:46.384896 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622636bf-21aa-4a6b-bafc-59ca8c076e32 service neutron] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:04:46.385224 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622636bf-21aa-4a6b-bafc-59ca8c076e32 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:04:46.386969 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-622636bf-21aa-4a6b-bafc-59ca8c076e32 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:04:46.521977 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-622636bf-21aa-4a6b-bafc-59ca8c076e32 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:04:46.523430 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-622636bf-21aa-4a6b-bafc-59ca8c076e32 service neutron] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:04:46.546170 dv-cinder-851351-1-smb devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 690/1349] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Jul 28 08:04:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 402 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 28 08:04:51.855341 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f272eae5-9ef0-4c60-af70-0f9a1658c72c None None] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:04:51.856205 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f272eae5-9ef0-4c60-af70-0f9a1658c72c None None] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:04:51.856620 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f272eae5-9ef0-4c60-af70-0f9a1658c72c None None] PATH_INFO: `/` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:04:51.858320 dv-cinder-851351-1-smb devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 660/1350] 10.222.0.42 () {54 vars in 921 bytes} [Thu Jul 28 08:04:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 08:04:51.866776 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe930ac-b852-42f7-992b-c3aedcd8cbd7 None None] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:04:51.867778 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe930ac-b852-42f7-992b-c3aedcd8cbd7 None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:04:51.868270 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe930ac-b852-42f7-992b-c3aedcd8cbd7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:04:52.007332 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.auth.core [None req-2fe930ac-b852-42f7-992b-c3aedcd8cbd7 None None] MFA Rules not processed for user `5db0b219e0d24284907722fbf18ca3e8`. Rule list: `[]` (Enabled: `True`). {{(pid=80347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 08:04:52.009471 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-2fe930ac-b852-42f7-992b-c3aedcd8cbd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:04:52.047040 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:04:52.201312 dv-cinder-851351-1-smb devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 691/1351] 10.222.0.42 () {58 vars in 1018 bytes} [Thu Jul 28 08:04:51 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 335 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 08:04:56.802997 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a48b4e-70c8-4af0-a54a-6d604925964c None None] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:04:56.803891 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a48b4e-70c8-4af0-a54a-6d604925964c None None] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:04:56.804112 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a48b4e-70c8-4af0-a54a-6d604925964c None None] PATH_INFO: `/` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:04:56.805680 dv-cinder-851351-1-smb devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 661/1352] 10.222.0.42 () {54 vars in 921 bytes} [Thu Jul 28 08:04:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 08:04:56.811059 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0026ce34-3d16-4404-9ece-257955fa07de None None] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:04:56.811604 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0026ce34-3d16-4404-9ece-257955fa07de None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:04:56.811604 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0026ce34-3d16-4404-9ece-257955fa07de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:04:56.909482 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.auth.core [None req-0026ce34-3d16-4404-9ece-257955fa07de None None] MFA Rules not processed for user `5db0b219e0d24284907722fbf18ca3e8`. Rule list: `[]` (Enabled: `True`). {{(pid=80347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 08:04:56.910711 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-0026ce34-3d16-4404-9ece-257955fa07de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:04:57.029754 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:04:57.074367 dv-cinder-851351-1-smb devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 692/1353] 10.222.0.42 () {58 vars in 1018 bytes} [Thu Jul 28 08:04:56 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 264 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 08:04:58.617177 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b5cb61-0263-49cf-beb2-16eb4e14652c None None] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:04:58.618156 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b5cb61-0263-49cf-beb2-16eb4e14652c None None] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:04:58.618476 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b5cb61-0263-49cf-beb2-16eb4e14652c None None] PATH_INFO: `/` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:04:58.620143 dv-cinder-851351-1-smb devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 662/1354] 10.222.0.42 () {54 vars in 921 bytes} [Thu Jul 28 08:04:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 08:04:58.627709 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a90e50-b980-4fe5-a37c-452bc49af650 None None] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:04:58.628393 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a90e50-b980-4fe5-a37c-452bc49af650 None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:04:58.628393 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a90e50-b980-4fe5-a37c-452bc49af650 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:04:58.761481 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.auth.core [None req-29a90e50-b980-4fe5-a37c-452bc49af650 None None] MFA Rules not processed for user `5db0b219e0d24284907722fbf18ca3e8`. Rule list: `[]` (Enabled: `True`). {{(pid=80347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 08:04:58.763641 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-29a90e50-b980-4fe5-a37c-452bc49af650 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:04:58.903571 dv-cinder-851351-1-smb devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 693/1355] 10.222.0.42 () {58 vars in 1018 bytes} [Thu Jul 28 08:04:58 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 277 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 08:05:02.332067 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec7e904-e90b-41fb-b817-14f8fb49e539 None None] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:05:02.333066 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec7e904-e90b-41fb-b817-14f8fb49e539 None None] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:05:02.333595 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec7e904-e90b-41fb-b817-14f8fb49e539 None None] PATH_INFO: `/` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:05:02.336292 dv-cinder-851351-1-smb devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 663/1356] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 08:05:02 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 08:05:02.342607 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ecd47a-0680-4c8a-b618-bb57613119bd None None] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:05:02.343142 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ecd47a-0680-4c8a-b618-bb57613119bd None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:05:02.343142 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ecd47a-0680-4c8a-b618-bb57613119bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:05:02.398145 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:05:02.452995 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.auth.core [None req-c8ecd47a-0680-4c8a-b618-bb57613119bd None None] MFA Rules not processed for user `f0666d3a50644a7097367331c1ee1a68`. Rule list: `[]` (Enabled: `True`). {{(pid=80347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 08:05:02.454930 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-c8ecd47a-0680-4c8a-b618-bb57613119bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:05:02.632774 dv-cinder-851351-1-smb devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 694/1357] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 08:05:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 284 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 08:05:02.702681 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd799ec2-e091-4fa4-84ce-d3ed39238d8b None None] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:05:02.703229 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd799ec2-e091-4fa4-84ce-d3ed39238d8b None None] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:05:02.703680 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd799ec2-e091-4fa4-84ce-d3ed39238d8b None None] PATH_INFO: `/` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:05:02.705320 dv-cinder-851351-1-smb devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 664/1358] 10.222.0.42 () {54 vars in 962 bytes} [Thu Jul 28 08:05:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 08:05:02.719780 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aed3a48-603c-4884-b221-a97085cc5009 None None] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:05:02.720403 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aed3a48-603c-4884-b221-a97085cc5009 None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:05:02.720983 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aed3a48-603c-4884-b221-a97085cc5009 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:05:02.821794 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.auth.core [None req-0aed3a48-603c-4884-b221-a97085cc5009 None None] MFA Rules not processed for user `02f10880691d4fd180f96f3e40e1d25f`. Rule list: `[]` (Enabled: `True`). {{(pid=80347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 08:05:02.823099 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-0aed3a48-603c-4884-b221-a97085cc5009 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:05:02.894432 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:05:03.000402 dv-cinder-851351-1-smb devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 695/1359] 10.222.0.42 () {58 vars in 1059 bytes} [Thu Jul 28 08:05:02 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 285 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 08:05:03.009908 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd799ec2-e091-4fa4-84ce-d3ed39238d8b None None] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:05:03.011406 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.fernet_utils [None req-bd799ec2-e091-4fa4-84ce-d3ed39238d8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:05:03.168873 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd799ec2-e091-4fa4-84ce-d3ed39238d8b None None] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:05:03.248478 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=100 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:05:03.310226 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb41651-8653-4d21-b9c4-9cf26ff438ed service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02f10880691d4fd180f96f3e40e1d25f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '139349507026497c98f360774dee737e', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:05:03.310750 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb41651-8653-4d21-b9c4-9cf26ff438ed service nova] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:05:03.311030 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb41651-8653-4d21-b9c4-9cf26ff438ed service nova] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:05:03.311300 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb41651-8653-4d21-b9c4-9cf26ff438ed service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:05:03.312980 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.fernet_utils [None req-fbb41651-8653-4d21-b9c4-9cf26ff438ed service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:05:03.413535 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb41651-8653-4d21-b9c4-9cf26ff438ed service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:05:03.415169 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb41651-8653-4d21-b9c4-9cf26ff438ed service nova] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:05:03.446430 dv-cinder-851351-1-smb devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 665/1360] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Jul 28 08:05:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 437 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 08:05:05.798540 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928c8576-c561-4571-90f0-bb6ffaf30757 None None] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:05:05.799304 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928c8576-c561-4571-90f0-bb6ffaf30757 None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:05:05.799304 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928c8576-c561-4571-90f0-bb6ffaf30757 None None] PATH_INFO: `/` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:05:05.800831 dv-cinder-851351-1-smb devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 696/1361] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 08:05:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 08:05:05.808023 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d939e459-c53c-4099-ace3-7437cb947b02 None None] REQUEST_METHOD: `POST` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:05:05.808548 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d939e459-c53c-4099-ace3-7437cb947b02 None None] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:05:05.808699 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d939e459-c53c-4099-ace3-7437cb947b02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:05:05.912715 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.auth.core [None req-d939e459-c53c-4099-ace3-7437cb947b02 None None] MFA Rules not processed for user `f0666d3a50644a7097367331c1ee1a68`. Rule list: `[]` (Enabled: `True`). {{(pid=80348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 08:05:05.914363 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.fernet_utils [None req-d939e459-c53c-4099-ace3-7437cb947b02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:05:05.967217 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=100 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:05:06.060970 dv-cinder-851351-1-smb devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 666/1362] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 08:05:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 255 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 08:05:06.095536 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-928c8576-c561-4571-90f0-bb6ffaf30757 None None] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:05:06.097604 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-928c8576-c561-4571-90f0-bb6ffaf30757 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:05:06.331032 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-928c8576-c561-4571-90f0-bb6ffaf30757 None None] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:05:06.342432 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:05:06.510031 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2207ba-abb4-4f3a-b860-f722d24a9135 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02f10880691d4fd180f96f3e40e1d25f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '139349507026497c98f360774dee737e', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:05:06.510662 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2207ba-abb4-4f3a-b860-f722d24a9135 service nova] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:05:06.510943 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2207ba-abb4-4f3a-b860-f722d24a9135 service nova] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:05:06.515050 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2207ba-abb4-4f3a-b860-f722d24a9135 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:05:06.515050 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-0c2207ba-abb4-4f3a-b860-f722d24a9135 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:05:06.649517 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c2207ba-abb4-4f3a-b860-f722d24a9135 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:05:06.651169 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c2207ba-abb4-4f3a-b860-f722d24a9135 service nova] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:05:06.674844 dv-cinder-851351-1-smb devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 697/1363] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Jul 28 08:05:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 580 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 08:05:09.094699 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c136688-3d67-4f74-ba49-45acd7605998 None None] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:05:09.095318 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c136688-3d67-4f74-ba49-45acd7605998 None None] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:05:09.095318 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c136688-3d67-4f74-ba49-45acd7605998 None None] PATH_INFO: `/` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:05:09.096845 dv-cinder-851351-1-smb devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 667/1364] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 08:05:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 08:05:09.102058 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e33b4f-ddb0-4206-8954-ead678811130 None None] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:05:09.102511 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e33b4f-ddb0-4206-8954-ead678811130 None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:05:09.102690 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e33b4f-ddb0-4206-8954-ead678811130 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:05:09.119326 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:05:09.181811 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.auth.core [None req-99e33b4f-ddb0-4206-8954-ead678811130 None None] MFA Rules not processed for user `f0666d3a50644a7097367331c1ee1a68`. Rule list: `[]` (Enabled: `True`). {{(pid=80347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 08:05:09.182976 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-99e33b4f-ddb0-4206-8954-ead678811130 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:05:09.312056 dv-cinder-851351-1-smb devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 698/1365] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 08:05:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 08:05:09.357855 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7101613-216f-430a-be62-5a01e0710d6c None None] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:05:09.358714 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7101613-216f-430a-be62-5a01e0710d6c None None] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:05:09.358714 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7101613-216f-430a-be62-5a01e0710d6c None None] PATH_INFO: `/` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:05:09.360234 dv-cinder-851351-1-smb devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 668/1366] 10.222.0.42 () {54 vars in 962 bytes} [Thu Jul 28 08:05:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 08:05:09.367143 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305aa823-3fa2-471d-8a04-b69e4a15d6c7 None None] REQUEST_METHOD: `POST` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:05:09.367381 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305aa823-3fa2-471d-8a04-b69e4a15d6c7 None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:05:09.367692 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305aa823-3fa2-471d-8a04-b69e4a15d6c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:05:09.457395 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.auth.core [None req-305aa823-3fa2-471d-8a04-b69e4a15d6c7 None None] MFA Rules not processed for user `02f10880691d4fd180f96f3e40e1d25f`. Rule list: `[]` (Enabled: `True`). {{(pid=80347) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 08:05:09.459074 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-305aa823-3fa2-471d-8a04-b69e4a15d6c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:05:09.500409 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:05:09.594632 dv-cinder-851351-1-smb devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 699/1367] 10.222.0.42 () {58 vars in 1059 bytes} [Thu Jul 28 08:05:09 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 229 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 08:05:09.603932 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7101613-216f-430a-be62-5a01e0710d6c None None] Authenticating user token {{(pid=80348) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:05:09.605432 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.fernet_utils [None req-c7101613-216f-430a-be62-5a01e0710d6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:05:09.788380 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7101613-216f-430a-be62-5a01e0710d6c None None] Validating token access rules against request {{(pid=80348) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:05:09.810775 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=100 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:05:09.946688 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35445af5-2d14-4c28-8935-7dec1f520802 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02f10880691d4fd180f96f3e40e1d25f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '139349507026497c98f360774dee737e', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80348) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:05:09.947383 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35445af5-2d14-4c28-8935-7dec1f520802 service nova] REQUEST_METHOD: `GET` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:05:09.947767 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35445af5-2d14-4c28-8935-7dec1f520802 service nova] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:05:09.948143 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35445af5-2d14-4c28-8935-7dec1f520802 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:05:09.949962 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.fernet_utils [None req-35445af5-2d14-4c28-8935-7dec1f520802 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:05:10.070907 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35445af5-2d14-4c28-8935-7dec1f520802 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:05:10.072837 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35445af5-2d14-4c28-8935-7dec1f520802 service nova] RBAC: Authorization granted {{(pid=80348) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:05:10.093500 dv-cinder-851351-1-smb devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 669/1368] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Jul 28 08:05:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 490 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 08:05:10.598884 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d7678e-f47e-4b12-b9c9-1ffc94f8bf24 None None] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:05:10.599585 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d7678e-f47e-4b12-b9c9-1ffc94f8bf24 None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:05:10.599585 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d7678e-f47e-4b12-b9c9-1ffc94f8bf24 None None] PATH_INFO: `/` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:05:10.601193 dv-cinder-851351-1-smb devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 700/1369] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 08:05:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 08:05:10.607514 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd91c4e0-1785-4bd4-be50-5d363bcddc13 None None] REQUEST_METHOD: `POST` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:05:10.608297 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd91c4e0-1785-4bd4-be50-5d363bcddc13 None None] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:05:10.608297 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd91c4e0-1785-4bd4-be50-5d363bcddc13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:05:10.644480 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=100 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:05:10.709230 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.auth.core [None req-bd91c4e0-1785-4bd4-be50-5d363bcddc13 None None] MFA Rules not processed for user `f0666d3a50644a7097367331c1ee1a68`. Rule list: `[]` (Enabled: `True`). {{(pid=80348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 08:05:10.710975 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.fernet_utils [None req-bd91c4e0-1785-4bd4-be50-5d363bcddc13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:05:10.828703 dv-cinder-851351-1-smb devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 670/1370] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 08:05:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 08:05:12.210101 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30d8c92-4da9-4aeb-91a9-7833c8fdfc4a None None] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:05:12.210707 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30d8c92-4da9-4aeb-91a9-7833c8fdfc4a None None] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:05:12.210707 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30d8c92-4da9-4aeb-91a9-7833c8fdfc4a None None] PATH_INFO: `/` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:05:12.212079 dv-cinder-851351-1-smb devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 701/1371] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 08:05:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 08:05:12.217867 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2133aefc-a589-4bf9-b9f0-0795bf0e5ce7 None None] REQUEST_METHOD: `POST` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:05:12.218334 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2133aefc-a589-4bf9-b9f0-0795bf0e5ce7 None None] SCRIPT_NAME: `/identity` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:05:12.218455 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2133aefc-a589-4bf9-b9f0-0795bf0e5ce7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80348) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:05:12.287214 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.auth.core [None req-2133aefc-a589-4bf9-b9f0-0795bf0e5ce7 None None] MFA Rules not processed for user `f0666d3a50644a7097367331c1ee1a68`. Rule list: `[]` (Enabled: `True`). {{(pid=80348) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 08:05:12.288478 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG keystone.common.fernet_utils [None req-2133aefc-a589-4bf9-b9f0-0795bf0e5ce7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80348) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:05:12.342880 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=100 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:05:12.389492 dv-cinder-851351-1-smb devstack@keystone.service[80348]: [pid: 80348|app: 0|req: 671/1372] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 08:05:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 08:05:12.433668 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d30d8c92-4da9-4aeb-91a9-7833c8fdfc4a None None] Authenticating user token {{(pid=80347) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:05:12.435286 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-d30d8c92-4da9-4aeb-91a9-7833c8fdfc4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:05:12.588409 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:05:12.596038 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d30d8c92-4da9-4aeb-91a9-7833c8fdfc4a None None] Validating token access rules against request {{(pid=80347) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:05:12.828840 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91bdf10a-b680-4340-84ba-bb5f479c15e3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '02f10880691d4fd180f96f3e40e1d25f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '139349507026497c98f360774dee737e', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80347) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:05:12.828840 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91bdf10a-b680-4340-84ba-bb5f479c15e3 service nova] REQUEST_METHOD: `GET` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:05:12.828840 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91bdf10a-b680-4340-84ba-bb5f479c15e3 service nova] SCRIPT_NAME: `/identity` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:05:12.828840 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91bdf10a-b680-4340-84ba-bb5f479c15e3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80347) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:05:12.833912 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.fernet_utils [None req-91bdf10a-b680-4340-84ba-bb5f479c15e3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80347) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:05:12.970300 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91bdf10a-b680-4340-84ba-bb5f479c15e3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:05:12.972118 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91bdf10a-b680-4340-84ba-bb5f479c15e3 service nova] RBAC: Authorization granted {{(pid=80347) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:05:13.000957 dv-cinder-851351-1-smb devstack@keystone.service[80347]: DEBUG dbcounter [-] [80347] Writing DB stats keystone:SELECT=100 {{(pid=80347) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:05:13.006094 dv-cinder-851351-1-smb devstack@keystone.service[80347]: [pid: 80347|app: 0|req: 702/1373] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Jul 28 08:05:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 573 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 08:05:22.387563 dv-cinder-851351-1-smb devstack@keystone.service[80348]: DEBUG dbcounter [-] [80348] Writing DB stats keystone:SELECT=19 {{(pid=80348) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:05:33.076137 dv-cinder-851351-1-smb devstack@keystone.service[80335]: Thu Jul 28 08:05:33 2022 - graceful shutdown triggered... Jul 28 08:05:33.076654 dv-cinder-851351-1-smb devstack@keystone.service[80348]: Gracefully killing worker 2 (pid: 80348)... Jul 28 08:05:33.076261 dv-cinder-851351-1-smb systemd[1]: Stopping Devstack devstack@keystone.service... Jul 28 08:05:33.077204 dv-cinder-851351-1-smb devstack@keystone.service[80347]: Gracefully killing worker 1 (pid: 80347)... Jul 28 08:05:34.077300 dv-cinder-851351-1-smb devstack@keystone.service[80335]: worker 1 buried after 1 seconds Jul 28 08:05:34.077300 dv-cinder-851351-1-smb devstack@keystone.service[80335]: worker 2 buried after 1 seconds Jul 28 08:05:34.078354 dv-cinder-851351-1-smb devstack@keystone.service[80335]: goodbye to uWSGI. Jul 28 08:05:34.079390 dv-cinder-851351-1-smb systemd[1]: devstack@keystone.service: Succeeded. Jul 28 08:05:34.079953 dv-cinder-851351-1-smb systemd[1]: Stopped Devstack devstack@keystone.service. Jul 28 08:10:15.773966 dv-cinder-851351-1-smb systemd[1]: Starting Devstack devstack@keystone.service... Jul 28 08:10:15.782506 dv-cinder-851351-1-smb devstack@keystone.service[144058]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Jul 28 08:10:15.785202 dv-cinder-851351-1-smb devstack@keystone.service[144058]: *** Starting uWSGI 2.0.18-debian (64bit) on [Thu Jul 28 08:10:15 2022] *** Jul 28 08:10:15.785372 dv-cinder-851351-1-smb devstack@keystone.service[144058]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jul 28 08:10:15.785372 dv-cinder-851351-1-smb devstack@keystone.service[144058]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jul 28 08:10:15.785372 dv-cinder-851351-1-smb devstack@keystone.service[144058]: nodename: dv-cinder-851351-1-smb Jul 28 08:10:15.785372 dv-cinder-851351-1-smb devstack@keystone.service[144058]: machine: x86_64 Jul 28 08:10:15.785372 dv-cinder-851351-1-smb devstack@keystone.service[144058]: clock source: unix Jul 28 08:10:15.785372 dv-cinder-851351-1-smb devstack@keystone.service[144058]: pcre jit disabled Jul 28 08:10:15.785372 dv-cinder-851351-1-smb devstack@keystone.service[144058]: detected number of CPU cores: 4 Jul 28 08:10:15.785372 dv-cinder-851351-1-smb devstack@keystone.service[144058]: current working directory: / Jul 28 08:10:15.785372 dv-cinder-851351-1-smb devstack@keystone.service[144058]: detected binary path: /usr/bin/uwsgi-core Jul 28 08:10:15.785372 dv-cinder-851351-1-smb devstack@keystone.service[144058]: your processes number limit is 47680 Jul 28 08:10:15.785372 dv-cinder-851351-1-smb devstack@keystone.service[144058]: your memory page size is 4096 bytes Jul 28 08:10:15.785372 dv-cinder-851351-1-smb devstack@keystone.service[144058]: detected max file descriptor number: 2048 Jul 28 08:10:15.785372 dv-cinder-851351-1-smb devstack@keystone.service[144058]: lock engine: pthread robust mutexes Jul 28 08:10:15.786330 dv-cinder-851351-1-smb devstack@keystone.service[144058]: thunder lock: enabled Jul 28 08:10:15.786330 dv-cinder-851351-1-smb devstack@keystone.service[144058]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Jul 28 08:10:15.786330 dv-cinder-851351-1-smb devstack@keystone.service[144058]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Jul 28 08:10:15.824496 dv-cinder-851351-1-smb devstack@keystone.service[144058]: Python main interpreter initialized at 0x559005be09c0 Jul 28 08:10:15.824496 dv-cinder-851351-1-smb devstack@keystone.service[144058]: python threads support enabled Jul 28 08:10:15.824496 dv-cinder-851351-1-smb devstack@keystone.service[144058]: your server socket listen backlog is limited to 100 connections Jul 28 08:10:15.824496 dv-cinder-851351-1-smb devstack@keystone.service[144058]: your mercy for graceful operations on workers is 90 seconds Jul 28 08:10:15.824987 dv-cinder-851351-1-smb devstack@keystone.service[144058]: mapped 403077 bytes (393 KB) for 2 cores Jul 28 08:10:15.824987 dv-cinder-851351-1-smb devstack@keystone.service[144058]: *** Operational MODE: preforking *** Jul 28 08:10:15.825204 dv-cinder-851351-1-smb devstack@keystone.service[144058]: *** uWSGI is running in multiple interpreter mode *** Jul 28 08:10:15.825204 dv-cinder-851351-1-smb devstack@keystone.service[144058]: spawned uWSGI master process (pid: 144058) Jul 28 08:10:15.825435 dv-cinder-851351-1-smb systemd[1]: Started Devstack devstack@keystone.service. Jul 28 08:10:15.826028 dv-cinder-851351-1-smb devstack@keystone.service[144058]: spawned uWSGI worker 1 (pid: 144067, cores: 1) Jul 28 08:10:15.826559 dv-cinder-851351-1-smb devstack@keystone.service[144058]: spawned uWSGI worker 2 (pid: 144068, cores: 1) Jul 28 08:10:15.826868 dv-cinder-851351-1-smb devstack@keystone.service[144058]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jul 28 08:10:21.425381 dv-cinder-851351-1-smb devstack@keystone.service[144068]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 28 08:10:21.425381 dv-cinder-851351-1-smb devstack@keystone.service[144068]: from cryptography.utils import int_from_bytes Jul 28 08:10:21.426308 dv-cinder-851351-1-smb devstack@keystone.service[144068]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 28 08:10:21.426308 dv-cinder-851351-1-smb devstack@keystone.service[144068]: from cryptography.utils import int_from_bytes Jul 28 08:10:21.476142 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=144068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 28 08:10:21.476394 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=144068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 28 08:10:21.476494 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG uwsgi [-] command line args: [] {{(pid=144068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 28 08:10:21.476829 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=144068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 28 08:10:21.476999 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG uwsgi [-] ================================================================================ {{(pid=144068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 28 08:10:21.477270 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG uwsgi [-] admin_token = **** {{(pid=144068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 08:10:21.477521 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG uwsgi [-] config_dir = [] {{(pid=144068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 08:10:21.477675 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=144068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 08:10:21.477885 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG uwsgi [-] config_source = [] {{(pid=144068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 08:10:21.478035 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG uwsgi [-] debug = True {{(pid=144068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 08:10:21.478262 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=144068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 08:10:21.478616 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=144068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 08:10:21.478829 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG uwsgi [-] insecure_debug = False {{(pid=144068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 08:10:21.479066 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=144068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 08:10:21.479350 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=144068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 08:10:21.479542 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG uwsgi [-] list_limit = None {{(pid=144068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 08:10:21.479707 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG uwsgi [-] log_config_append = None {{(pid=144068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 08:10:21.479926 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=144068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 08:10:21.480130 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG uwsgi [-] log_dir = None {{(pid=144068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 08:10:21.480274 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG uwsgi [-] log_file = None {{(pid=144068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 08:10:21.480498 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=144068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 08:10:21.480780 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=144068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 08:10:21.480990 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=144068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 08:10:21.481267 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=144068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 08:10:21.481429 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=144068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 08:10:21.481583 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=144068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 08:10:21.481852 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=144068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 08:10:21.482106 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=144068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 08:10:21.482346 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=144068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 08:10:21.482585 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=144068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 08:10:21.482822 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=144068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 08:10:21.483062 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=144068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 08:10:21.483315 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=144068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 08:10:21.483567 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG uwsgi [-] notification_format = cadf {{(pid=144068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 08:10:21.483849 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=144068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 08:10:21.484360 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.42/identity {{(pid=144068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 08:10:21.484536 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG uwsgi [-] publish_errors = False {{(pid=144068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 08:10:21.484804 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=144068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 08:10:21.485042 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=144068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 08:10:21.485212 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=144068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 08:10:21.485472 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=144068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 08:10:21.485717 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=144068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 08:10:21.485955 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG uwsgi [-] standard_threads = False {{(pid=144068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 08:10:21.486193 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG uwsgi [-] strict_password_check = False {{(pid=144068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 08:10:21.486446 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=144068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 08:10:21.486628 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG uwsgi [-] use_eventlog = False {{(pid=144068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 08:10:21.486790 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG uwsgi [-] use_journal = False {{(pid=144068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 08:10:21.486971 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG uwsgi [-] use_json = False {{(pid=144068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 08:10:21.487151 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG uwsgi [-] use_stderr = False {{(pid=144068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 08:10:21.487334 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG uwsgi [-] use_syslog = False {{(pid=144068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 08:10:21.487570 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG uwsgi [-] watch_log_file = False {{(pid=144068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 08:10:21.487834 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=144068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:10:21.488079 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=144068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:10:21.488343 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=144068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:10:21.488589 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=144068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:10:21.488869 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=144068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:10:21.489186 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=144068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:10:21.489442 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=144068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:10:21.489686 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=144068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:10:21.489942 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=144068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:10:21.490196 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=144068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:10:21.490452 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=144068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:10:21.490694 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=144068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:10:21.490949 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=144068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:10:21.491192 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=144068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:10:21.491446 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=144068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:10:21.491701 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=144068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:10:21.491945 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=144068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:10:21.492208 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=144068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:10:21.492470 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=144068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:10:21.492747 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=144068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:10:21.492992 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=144068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:10:21.493254 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=144068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:10:21.493521 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=144068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:10:21.493779 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=144068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:10:21.494034 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=144068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:10:21.494272 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=144068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:10:21.494511 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=144068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:10:21.494748 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=144068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:10:21.494991 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=144068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:10:21.495246 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=144068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:10:21.495503 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=144068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:10:21.495735 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=144068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:10:21.495971 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=144068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:10:21.496223 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=144068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:10:21.496482 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=144068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:10:21.496748 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=144068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:10:21.497006 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=144068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:10:21.497245 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=144068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:10:21.497486 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=144068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:10:21.497729 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=144068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:10:21.497967 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=144068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:10:21.498203 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=144068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:10:21.498441 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=144068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:10:21.498680 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=144068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:10:21.498925 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=144068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:10:21.499181 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=144068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:10:21.499419 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=144068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:10:21.499646 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=144068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:10:21.499883 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=144068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:10:21.500126 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=144068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:10:21.500370 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=144068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:10:21.500625 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=144068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:10:21.500887 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=144068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:10:21.501131 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=144068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:10:21.501374 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=144068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:10:21.501617 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=144068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:10:21.501860 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=144068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:10:21.502103 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=144068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:10:21.502343 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=144068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:10:21.502600 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=144068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:10:21.502844 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=144068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:10:21.503086 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=144068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:10:21.503325 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=144068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:10:21.503593 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=144068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:10:21.503837 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=144068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:10:21.504076 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=144068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:10:21.504321 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=144068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:10:21.504565 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=144068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:10:21.504904 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=144068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:10:21.505151 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=144068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:10:21.505406 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=144068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:10:21.505658 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=144068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:10:21.505904 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=144068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:10:21.506148 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=144068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:10:21.506392 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=144068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:10:21.506654 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG uwsgi [-] cache.enabled = True {{(pid=144068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:10:21.506901 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=144068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:10:21.507146 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=144068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:10:21.507394 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=144068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:10:21.507637 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=144068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:10:21.507880 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=144068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:10:21.508124 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=144068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:10:21.508366 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=144068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:10:21.508609 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=144068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:10:21.508902 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=144068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:10:21.509148 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=144068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:10:21.509396 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=144068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:10:21.509641 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=144068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:10:21.509889 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=144068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:10:21.510133 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=144068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:10:21.510434 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=144068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:10:21.510683 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=144068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:10:21.510921 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=144068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:10:21.511160 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=144068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:10:21.511398 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=144068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:10:21.511642 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=144068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:10:21.511880 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=144068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:10:21.512127 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=144068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:10:21.512372 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=144068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:10:21.512625 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=144068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:10:21.512897 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=144068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:10:21.513161 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=144068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:10:21.513441 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=144068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:10:21.513691 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=144068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:10:21.513934 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG uwsgi [-] auth.external = None {{(pid=144068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:10:21.514170 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG uwsgi [-] auth.mapped = None {{(pid=144068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:10:21.514475 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=144068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:10:21.514713 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=144068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:10:21.514952 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG uwsgi [-] auth.password = None {{(pid=144068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:10:21.515190 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG uwsgi [-] auth.token = None {{(pid=144068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:10:21.515435 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=144068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:10:21.515679 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG uwsgi [-] catalog.caching = True {{(pid=144068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:10:21.515935 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=144068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:10:21.516174 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=144068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:10:21.516433 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=144068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:10:21.516709 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=144068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:10:21.516950 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=144068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:10:21.517195 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG uwsgi [-] credential.caching = True {{(pid=144068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:10:21.517451 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG uwsgi [-] credential.driver = sql {{(pid=144068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:10:21.517708 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=144068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:10:21.517963 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=144068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:10:21.518208 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=144068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:10:21.518461 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=144068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:10:21.518704 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=144068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:10:21.518976 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=144068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:10:21.519237 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=144068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:10:21.519483 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=144068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:10:21.519745 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=144068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:10:21.520040 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=144068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:10:21.520349 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=144068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:10:21.520621 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=144068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:10:21.520905 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=144068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:10:21.521170 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=144068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:10:21.521414 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG uwsgi [-] federation.caching = True {{(pid=144068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:10:21.521658 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=144068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:10:21.521911 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG uwsgi [-] federation.driver = sql {{(pid=144068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:10:21.522165 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=144068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:10:21.522392 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=144068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:10:21.522643 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=144068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:10:21.522885 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=144068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:10:21.523158 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=144068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:10:21.523405 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=144068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:10:21.523669 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=144068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:10:21.523914 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=144068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:10:21.524178 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=144068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:10:21.524424 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG uwsgi [-] identity.caching = True {{(pid=144068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:10:21.524699 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=144068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:10:21.524961 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=144068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:10:21.525207 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=144068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:10:21.525453 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=144068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:10:21.525709 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG uwsgi [-] identity.driver = sql {{(pid=144068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:10:21.525947 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=144068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:10:21.526195 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=144068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:10:21.526457 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=144068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:10:21.526718 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=144068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:10:21.526956 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=144068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:10:21.527195 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=144068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:10:21.527432 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=144068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:10:21.527685 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=144068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:10:21.527941 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=144068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:10:21.528196 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=144068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:10:21.528459 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=144068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:10:21.528738 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=144068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:10:21.529019 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=144068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:10:21.529266 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=144068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:10:21.529512 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=144068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:10:21.529753 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=144068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:10:21.529997 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=144068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:10:21.530235 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=144068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:10:21.530475 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=144068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:10:21.530722 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=144068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:10:21.530970 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=144068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:10:21.531225 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=144068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:10:21.531463 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=144068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:10:21.531717 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=144068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:10:21.531970 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=144068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:10:21.532212 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=144068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:10:21.532467 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=144068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:10:21.532745 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=144068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:10:21.532986 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=144068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:10:21.533233 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=144068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:10:21.533469 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG uwsgi [-] ldap.password = **** {{(pid=144068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:10:21.533715 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=144068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:10:21.533958 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=144068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:10:21.534208 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=144068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:10:21.534453 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=144068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:10:21.534697 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=144068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:10:21.534951 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=144068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:10:21.535206 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=144068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:10:21.535449 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=144068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:10:21.535685 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=144068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:10:21.535970 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=144068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:10:21.536229 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=144068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:10:21.536480 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=144068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:10:21.536751 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=144068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:10:21.536996 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=144068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:10:21.537236 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG uwsgi [-] ldap.user = None {{(pid=144068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:10:21.537485 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=144068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:10:21.537749 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=144068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:10:21.537991 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=144068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:10:21.538245 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=144068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:10:21.538499 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=144068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:10:21.538754 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=144068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:10:21.538996 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=144068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:10:21.539233 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=144068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:10:21.539474 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=144068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:10:21.539714 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=144068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:10:21.539959 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=144068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:10:21.540195 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=144068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:10:21.540454 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=144068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:10:21.540749 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=144068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:10:21.541008 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=144068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:10:21.541388 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=144068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:10:21.541646 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=144068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:10:21.541885 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=144068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:10:21.542142 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=144068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:10:21.542388 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=144068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:10:21.542633 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=144068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:10:21.542877 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=144068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:10:21.543121 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=144068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:10:21.543375 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=144068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:10:21.543629 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=144068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:10:21.543873 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=144068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:10:21.544134 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG uwsgi [-] policy.driver = sql {{(pid=144068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:10:21.544371 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=144068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:10:21.544621 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=144068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:10:21.544905 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=144068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:10:21.545122 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG uwsgi [-] receipt.caching = True {{(pid=144068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:10:21.545366 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=144068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:10:21.545620 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=144068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:10:21.545869 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=144068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:10:21.546108 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=144068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:10:21.546352 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=144068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:10:21.546610 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG uwsgi [-] resource.caching = True {{(pid=144068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:10:21.546854 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=144068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:10:21.547109 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG uwsgi [-] resource.driver = sql {{(pid=144068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:10:21.547352 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=144068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:10:21.547608 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=144068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:10:21.547866 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=144068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:10:21.548109 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG uwsgi [-] revoke.caching = True {{(pid=144068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:10:21.548362 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=144068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:10:21.548609 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=144068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:10:21.548965 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG uwsgi [-] role.cache_time = None {{(pid=144068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:10:21.549209 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG uwsgi [-] role.caching = True {{(pid=144068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:10:21.549464 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG uwsgi [-] role.driver = sql {{(pid=144068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:10:21.549701 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG uwsgi [-] role.list_limit = None {{(pid=144068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:10:21.549961 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=144068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:10:21.550217 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=144068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:10:21.550471 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=144068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:10:21.550723 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=144068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:10:21.550978 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=144068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:10:21.551230 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=144068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:10:21.551506 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=144068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:10:21.551793 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=144068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:10:21.552017 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=144068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:10:21.552272 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=144068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:10:21.552561 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=144068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:10:21.552842 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=144068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:10:21.553098 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=144068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:10:21.553535 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=144068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:10:21.553776 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=144068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:10:21.554032 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=144068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:10:21.554284 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=144068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:10:21.554538 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=144068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:10:21.554794 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=144068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:10:21.555036 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=144068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:10:21.555299 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=144068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:10:21.555559 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=144068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:10:21.555806 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=144068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:10:21.556044 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=144068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:10:21.556282 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=144068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:10:21.556534 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=144068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:10:21.556819 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=144068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:10:21.557086 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=144068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:10:21.557342 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=144068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:10:21.557588 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=144068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:10:21.557832 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=144068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:10:21.558073 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG uwsgi [-] token.cache_time = None {{(pid=144068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:10:21.558317 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG uwsgi [-] token.caching = True {{(pid=144068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:10:21.558561 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=144068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:10:21.558818 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG uwsgi [-] token.provider = fernet {{(pid=144068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:10:21.559062 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=144068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:10:21.559327 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=144068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:10:21.559582 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=144068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:10:21.559827 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=144068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:10:21.560078 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=144068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:10:21.560328 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=144068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:10:21.560584 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG uwsgi [-] trust.driver = sql {{(pid=144068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:10:21.560853 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=144068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:10:21.561100 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=144068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:10:21.561342 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=144068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:10:21.561595 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=144068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:10:21.561850 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=144068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:10:21.562088 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=144068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:10:21.562340 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=144068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:10:21.562643 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=144068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:10:21.562912 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG uwsgi [-] database.connection = **** {{(pid=144068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:10:21.563164 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=144068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:10:21.563417 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=144068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:10:21.563661 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=144068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:10:21.563908 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=144068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:10:21.564149 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=144068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:10:21.564391 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=144068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:10:21.564633 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=144068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:10:21.564900 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=144068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:10:21.565152 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=144068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:10:21.565397 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=144068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:10:21.565650 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=144068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:10:21.565895 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=144068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:10:21.566151 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=144068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:10:21.566396 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=144068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:10:21.566656 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=144068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:10:21.566894 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=144068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:10:21.567033 dv-cinder-851351-1-smb devstack@keystone.service[144067]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 28 08:10:21.567033 dv-cinder-851351-1-smb devstack@keystone.service[144067]: from cryptography.utils import int_from_bytes Jul 28 08:10:21.567722 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=144068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:10:21.567861 dv-cinder-851351-1-smb devstack@keystone.service[144067]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 28 08:10:21.567861 dv-cinder-851351-1-smb devstack@keystone.service[144067]: from cryptography.utils import int_from_bytes Jul 28 08:10:21.568095 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=144068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:10:21.568095 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=144068) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 28 08:10:21.597339 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=144068) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 08:10:21.597574 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=144068) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 08:10:21.597810 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=144068) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 08:10:21.606340 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=144068) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 08:10:21.615658 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=144067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 28 08:10:21.615847 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=144067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 28 08:10:21.615998 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG uwsgi [-] command line args: [] {{(pid=144067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 28 08:10:21.616291 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=144067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 28 08:10:21.616442 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG uwsgi [-] ================================================================================ {{(pid=144067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 28 08:10:21.616720 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG uwsgi [-] admin_token = **** {{(pid=144067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 08:10:21.616996 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG uwsgi [-] config_dir = [] {{(pid=144067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 08:10:21.617153 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=144067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 08:10:21.617360 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG uwsgi [-] config_source = [] {{(pid=144067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 08:10:21.617494 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG uwsgi [-] debug = True {{(pid=144067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 08:10:21.617710 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=144067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 08:10:21.617977 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=144067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 08:10:21.618129 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG uwsgi [-] insecure_debug = False {{(pid=144067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 08:10:21.618401 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=144067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 08:10:21.618654 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=144067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 08:10:21.618886 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG uwsgi [-] list_limit = None {{(pid=144067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 08:10:21.619031 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG uwsgi [-] log_config_append = None {{(pid=144067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 08:10:21.619233 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=144067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 08:10:21.619380 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG uwsgi [-] log_dir = None {{(pid=144067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 08:10:21.619579 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG uwsgi [-] log_file = None {{(pid=144067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 08:10:21.619816 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=144067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 08:10:21.620056 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=144067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 08:10:21.620303 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=144067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 08:10:21.620553 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=144067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 08:10:21.620760 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=144067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 08:10:21.620946 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=144067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 08:10:21.621195 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=144067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 08:10:21.621452 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=144067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 08:10:21.621686 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=144067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 08:10:21.621924 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=144067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 08:10:21.622162 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=144067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 08:10:21.622386 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=144067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 08:10:21.622640 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=144067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 08:10:21.622892 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG uwsgi [-] notification_format = cadf {{(pid=144067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 08:10:21.623176 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=144067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 08:10:21.623691 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.42/identity {{(pid=144067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 08:10:21.623876 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG uwsgi [-] publish_errors = False {{(pid=144067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 08:10:21.624112 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=144067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 08:10:21.624345 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=144067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 08:10:21.624526 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=144067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 08:10:21.624805 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=144067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 08:10:21.625047 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=144067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 08:10:21.625285 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG uwsgi [-] standard_threads = False {{(pid=144067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 08:10:21.625519 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG uwsgi [-] strict_password_check = False {{(pid=144067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 08:10:21.625765 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=144067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 08:10:21.625945 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG uwsgi [-] use_eventlog = False {{(pid=144067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 08:10:21.626124 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG uwsgi [-] use_journal = False {{(pid=144067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 08:10:21.626303 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG uwsgi [-] use_json = False {{(pid=144067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 08:10:21.626480 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG uwsgi [-] use_stderr = False {{(pid=144067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 08:10:21.626659 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG uwsgi [-] use_syslog = False {{(pid=144067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 08:10:21.626893 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG uwsgi [-] watch_log_file = False {{(pid=144067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 08:10:21.627152 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=144067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:10:21.627396 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=144067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:10:21.627661 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=144067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:10:21.627906 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=144067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:10:21.628159 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=144067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:10:21.628403 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=144067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:10:21.628655 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=144067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:10:21.628918 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=144067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:10:21.629173 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=144067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:10:21.629425 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=144067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:10:21.629736 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=144067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:10:21.629983 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=144067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:10:21.630236 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=144067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:10:21.630478 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=144067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:10:21.630731 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=144067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:10:21.630983 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=144067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:10:21.631227 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=144067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:10:21.631486 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=144067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:10:21.631746 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=144067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:10:21.631996 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=144067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:10:21.632237 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=144067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:10:21.632497 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=144067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:10:21.632790 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=144067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:10:21.633049 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=144067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:10:21.633305 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=144067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:10:21.633542 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=144067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:10:21.633781 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=144067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:10:21.634017 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=144067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:10:21.634259 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=144067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:10:21.634512 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=144067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:10:21.634765 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=144067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:10:21.635002 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=144067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:10:21.635236 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=144067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:10:21.635486 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=144067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:10:21.635739 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=144067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:10:21.635982 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=144067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:10:21.636236 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=144067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:10:21.636363 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=144068) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 08:10:21.636496 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=144067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:10:21.636641 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=144068) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 08:10:21.636814 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=144067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:10:21.636964 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=144067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:10:21.637202 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=144067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:10:21.637439 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=144067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:10:21.637675 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=144067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:10:21.637911 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=144067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:10:21.638154 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=144067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:10:21.638477 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=144067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:10:21.638628 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=144067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:10:21.638867 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=144067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:10:21.639101 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=144067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:10:21.639342 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=144067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:10:21.639582 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=144067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:10:21.639835 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=144067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:10:21.640075 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=144067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:10:21.640319 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=144067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:10:21.640560 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=144067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:10:21.640827 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=144067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:10:21.641073 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=144067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:10:21.641315 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=144067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:10:21.641551 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=144067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:10:21.641805 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=144067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:10:21.642046 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=144067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:10:21.642290 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=144067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:10:21.642528 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=144067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:10:21.642794 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=144067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:10:21.643037 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=144067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:10:21.643272 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=144067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:10:21.643516 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=144067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:10:21.643761 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=144067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:10:21.644037 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=144067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:10:21.644282 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=144067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:10:21.644534 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=144067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:10:21.644811 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=144067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:10:21.645055 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=144067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:10:21.645323 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=144067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:10:21.645565 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=144067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:10:21.645819 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG uwsgi [-] cache.enabled = True {{(pid=144067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:10:21.646061 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=144067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:10:21.646303 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=144067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:10:21.646630 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=144067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:10:21.646792 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=144067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:10:21.647035 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=144067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:10:21.647275 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=144067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:10:21.647517 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=144067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:10:21.647758 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=144067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:10:21.648024 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=144067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:10:21.648268 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=144067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:10:21.648514 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=144067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:10:21.648788 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=144067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:10:21.649035 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=144067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:10:21.649278 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=144067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:10:21.649519 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=144067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:10:21.649759 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=144067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:10:21.650000 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=144067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:10:21.650234 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=144067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:10:21.650468 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=144067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:10:21.650709 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=144067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:10:21.650944 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=144067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:10:21.651188 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=144067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:10:21.651428 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=144067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:10:21.651680 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=144067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:10:21.651924 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=144067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:10:21.652185 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=144067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:10:21.652448 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=144067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:10:21.652715 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=144067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:10:21.652955 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG uwsgi [-] auth.external = None {{(pid=144067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:10:21.653191 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG uwsgi [-] auth.mapped = None {{(pid=144067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:10:21.653492 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=144067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:10:21.653728 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=144067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:10:21.653965 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG uwsgi [-] auth.password = None {{(pid=144067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:10:21.654202 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG uwsgi [-] auth.token = None {{(pid=144067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:10:21.654445 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=144067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:10:21.654686 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG uwsgi [-] catalog.caching = True {{(pid=144067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:10:21.654940 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=144067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:10:21.655176 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=144067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:10:21.655428 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=144067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:10:21.655679 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=144067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:10:21.655915 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=144067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:10:21.656154 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG uwsgi [-] credential.caching = True {{(pid=144067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:10:21.656404 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG uwsgi [-] credential.driver = sql {{(pid=144067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:10:21.656679 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=144067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:10:21.656931 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=144067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:10:21.657172 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=144067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:10:21.657421 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=144067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:10:21.657660 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=144067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:10:21.657930 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=144067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:10:21.658189 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=144067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:10:21.658430 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=144067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:10:21.658687 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=144067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:10:21.658979 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=144067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:10:21.659233 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=144067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:10:21.659501 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=144067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:10:21.659750 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=144067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:10:21.660019 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=144067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:10:21.660261 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG uwsgi [-] federation.caching = True {{(pid=144067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:10:21.660503 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=144067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:10:21.660784 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG uwsgi [-] federation.driver = sql {{(pid=144067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:10:21.661097 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=144067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:10:21.661337 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=144067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:10:21.661592 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=144067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:10:21.661836 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=144067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:10:21.662096 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=144067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:10:21.662342 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=144067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:10:21.662602 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=144067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:10:21.662847 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=144067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:10:21.663099 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=144067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:10:21.663342 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG uwsgi [-] identity.caching = True {{(pid=144067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:10:21.663597 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=144067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:10:21.663850 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=144067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:10:21.664091 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=144067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:10:21.664331 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=144067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:10:21.664582 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG uwsgi [-] identity.driver = sql {{(pid=144067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:10:21.664843 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=144067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:10:21.665088 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=144067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:10:21.665340 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=144067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:10:21.665600 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=144067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:10:21.665838 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=144067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:10:21.666073 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=144067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:10:21.666309 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=144067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:10:21.666557 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=144067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:10:21.666810 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=144067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:10:21.667061 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=144067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:10:21.667321 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=144067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:10:21.667573 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=144067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:10:21.667850 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=144067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:10:21.668095 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=144067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:10:21.668342 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=144067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:10:21.668581 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=144067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:10:21.668849 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=144067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:10:21.669086 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=144067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:10:21.669329 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=144067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:10:21.669575 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=144067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:10:21.669820 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=144067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:10:21.670077 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=144067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:10:21.670315 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=144067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:10:21.670566 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=144067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:10:21.670818 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=144067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:10:21.671060 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=144067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:10:21.671310 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=144067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:10:21.671562 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=144067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:10:21.671800 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=144067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:10:21.672043 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=144067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:10:21.672277 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG uwsgi [-] ldap.password = **** {{(pid=144067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:10:21.672520 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=144067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:10:21.672789 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=144067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:10:21.673039 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=144067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:10:21.673280 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=144067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:10:21.673522 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=144067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:10:21.673775 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=144067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:10:21.674027 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=144067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:10:21.674265 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=144067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:10:21.674500 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=144067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:10:21.674754 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=144067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:10:21.675005 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=144067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:10:21.675245 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=144067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:10:21.675533 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=144067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:10:21.675728 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=144067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:10:21.675950 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG uwsgi [-] ldap.user = None {{(pid=144067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:10:21.676199 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=144067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:10:21.689074 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=144068) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 08:10:21.745010 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=144068) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 08:10:21.745308 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=144068) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 08:10:21.767193 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=144067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:10:21.767459 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=144067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:10:21.767772 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=144067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:10:21.768048 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=144067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:10:21.768322 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=144067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:10:21.768565 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=144067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:10:21.768823 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=144067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:10:21.769100 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=144067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:10:21.769353 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=144067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:10:21.769605 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=144067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:10:21.769854 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=144067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:10:21.770119 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=144067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:10:21.770428 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=144067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:10:21.770689 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=144067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:10:21.770934 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=144067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:10:21.771192 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=144067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:10:21.771436 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=144067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:10:21.771693 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=144067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:10:21.771943 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=144067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:10:21.772189 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=144067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:10:21.772445 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=144067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:10:21.772689 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=144067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:10:21.772961 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=144067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:10:21.773212 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=144067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:10:21.773453 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=144067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:10:21.773717 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG uwsgi [-] policy.driver = sql {{(pid=144067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:10:21.773954 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=144067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:10:21.774206 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=144067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:10:21.774455 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=144067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:10:21.774697 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG uwsgi [-] receipt.caching = True {{(pid=144067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:10:21.774942 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=144067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:10:21.775199 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=144067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:10:21.775451 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=144067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:10:21.775691 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=144067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:10:21.775937 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=144067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:10:21.776184 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG uwsgi [-] resource.caching = True {{(pid=144067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:10:21.776443 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=144067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:10:21.776725 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG uwsgi [-] resource.driver = sql {{(pid=144067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:10:21.776972 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=144067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:10:21.777230 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=144067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:10:21.777497 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=144067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:10:21.777735 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG uwsgi [-] revoke.caching = True {{(pid=144067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:10:21.777990 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=144067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:10:21.778235 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=144067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:10:21.778481 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG uwsgi [-] role.cache_time = None {{(pid=144067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:10:21.778722 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG uwsgi [-] role.caching = True {{(pid=144067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:10:21.778977 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG uwsgi [-] role.driver = sql {{(pid=144067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:10:21.779215 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG uwsgi [-] role.list_limit = None {{(pid=144067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:10:21.779472 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=144067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:10:21.779728 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=144067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:10:21.779991 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=144067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:10:21.780245 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=144067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:10:21.780499 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=144067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:10:21.780780 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=144067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:10:21.781036 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=144067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:10:21.781291 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=144067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:10:21.781533 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=144067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:10:21.781787 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=144067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:10:21.782040 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=144067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:10:21.782296 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=144067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:10:21.782551 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=144067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:10:21.783004 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=144067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:10:21.783246 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=144067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:10:21.783497 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=144067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:10:21.783755 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=144067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:10:21.784010 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=144067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:10:21.784266 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=144067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:10:21.784508 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=144067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:10:21.784799 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=144067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:10:21.785064 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=144067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:10:21.785313 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=144067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:10:21.785550 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=144067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:10:21.785788 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=144067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:10:21.786087 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=144067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:10:21.786347 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=144067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:10:21.786609 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=144067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:10:21.786867 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=144067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:10:21.787113 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=144067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:10:21.787355 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=144067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:10:21.787594 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG uwsgi [-] token.cache_time = None {{(pid=144067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:10:21.787837 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG uwsgi [-] token.caching = True {{(pid=144067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:10:21.788081 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=144067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:10:21.788337 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG uwsgi [-] token.provider = fernet {{(pid=144067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:10:21.788582 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=144067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:10:21.788869 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=144067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:10:21.789127 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=144067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:10:21.789373 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=144067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:10:21.789625 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=144067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:10:21.789878 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=144067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:10:21.790134 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG uwsgi [-] trust.driver = sql {{(pid=144067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:10:21.790379 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=144067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:10:21.790625 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=144067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:10:21.790866 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=144067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:10:21.791120 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=144067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:10:21.791375 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=144067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:10:21.791612 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=144067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:10:21.791862 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=144067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:10:21.792165 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=144067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:10:21.792434 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG uwsgi [-] database.connection = **** {{(pid=144067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:10:21.792709 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=144067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:10:21.792968 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=144067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:10:21.793215 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=144067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:10:21.793464 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=144067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:10:21.793704 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=144067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:10:21.793949 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=144067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:10:21.794191 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=144067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:10:21.794435 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=144067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:10:21.794691 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=144067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:10:21.794936 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=144067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:10:21.795188 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=144067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:10:21.795430 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=144067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:10:21.795686 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=144067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:10:21.795929 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=144067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:10:21.796183 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=144067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:10:21.796421 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=144067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:10:21.796693 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=144067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:10:21.796934 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=144067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:10:21.797109 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=144067) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 28 08:10:21.811087 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=144068) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 08:10:21.811334 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=144068) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 08:10:21.811562 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=144068) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 08:10:21.811798 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=144068) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 08:10:21.812003 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=144068) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 08:10:21.812251 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=144068) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 08:10:21.821763 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=144067) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 08:10:21.822001 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=144067) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 08:10:21.822238 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=144067) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 08:10:21.830793 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=144067) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 08:10:21.835742 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=144068) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 08:10:21.835981 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=144068) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 08:10:21.836223 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=144068) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 08:10:21.836464 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=144068) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 08:10:21.836658 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=144068) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 08:10:21.836938 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=144068) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 08:10:21.837172 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=144068) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 08:10:21.848211 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=144068) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 08:10:21.849265 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=144067) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 08:10:21.849546 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=144067) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 08:10:21.861002 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=144068) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 08:10:21.861238 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=144068) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 08:10:21.861471 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=144068) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 08:10:21.861699 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=144068) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 08:10:21.861871 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=144068) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 08:10:21.862127 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=144068) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 08:10:21.862346 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=144068) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 08:10:21.879676 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=144068) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 08:10:21.879872 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=144068) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jul 28 08:10:21.880228 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=144068) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 08:10:21.880411 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=144068) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jul 28 08:10:21.880711 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=144068) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 08:10:21.880996 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=144068) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 08:10:21.881258 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=144068) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 08:10:21.881519 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=144068) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 08:10:21.887621 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=144067) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 08:10:21.891292 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=144068) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 08:10:21.891574 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=144068) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 08:10:21.891851 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=144068) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 08:10:21.892138 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=144068) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 08:10:21.899174 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=144068) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 28 08:10:21.904026 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=144068) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 28 08:10:21.904286 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=144068) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 08:10:21.904596 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=144068) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 08:10:21.904910 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=144068) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 08:10:21.905197 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=144068) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 08:10:21.905460 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=144068) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 08:10:21.905735 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=144068) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 08:10:21.905983 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=144068) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 08:10:21.906286 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=144068) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 08:10:21.906570 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=144068) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 08:10:21.906831 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=144068) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 08:10:21.922276 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=144067) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 08:10:21.922499 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=144067) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 08:10:21.930559 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=144068) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 08:10:21.932043 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=144068) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 28 08:10:21.932331 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=144068) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 08:10:21.937048 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=144068) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 28 08:10:21.937336 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=144068) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 08:10:21.937620 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=144068) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 08:10:21.944343 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=144068) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 28 08:10:21.944604 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=144068) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 08:10:21.949113 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=144068) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 28 08:10:21.949408 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=144068) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 08:10:21.949717 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=144068) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 08:10:21.950005 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=144068) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 08:10:21.950265 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=144068) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 08:10:21.950568 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=144068) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 08:10:21.950967 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=144068) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 08:10:21.951283 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=144068) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 08:10:21.968338 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=144068) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 08:10:21.968639 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=144068) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 08:10:21.972608 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=144068) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 28 08:10:21.975849 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=144068) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 08:10:21.976145 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=144068) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 08:10:21.976423 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=144067) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 08:10:21.976687 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=144067) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 08:10:21.976901 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=144067) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 08:10:21.977127 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=144067) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 08:10:21.977315 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=144067) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 08:10:21.977567 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=144067) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 08:10:21.980583 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=144068) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 28 08:10:21.983997 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=144068) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 28 08:10:21.987102 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=144068) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 08:10:21.987419 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=144068) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 08:10:21.987690 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=144068) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 08:10:21.988021 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=144068) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 08:10:21.988343 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=144068) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 08:10:21.988690 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=144068) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 08:10:21.990643 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=144067) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 08:10:21.990861 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=144067) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 08:10:21.991107 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=144067) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 08:10:21.991323 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=144067) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 08:10:21.991515 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=144067) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 08:10:21.991750 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=144067) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 08:10:21.991947 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=144067) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 08:10:22.000749 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=144067) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 08:10:22.003648 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=144067) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 08:10:22.003883 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=144067) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 08:10:22.004109 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=144067) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 08:10:22.004333 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=144067) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 08:10:22.004553 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=144067) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 08:10:22.004802 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=144068) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 28 08:10:22.004962 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=144067) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 08:10:22.005118 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=144067) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 08:10:22.005259 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=144068) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 08:10:22.005405 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=144068) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 08:10:22.005614 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=144068) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 08:10:22.012592 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=144068) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 08:10:22.014186 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=144068) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 08:10:22.014472 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=144068) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 08:10:22.015360 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=144067) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 08:10:22.015559 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=144067) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jul 28 08:10:22.015925 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=144067) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 08:10:22.016138 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=144067) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jul 28 08:10:22.016397 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=144067) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 08:10:22.016695 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=144067) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 08:10:22.016954 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=144067) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 08:10:22.017214 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=144067) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 08:10:22.017373 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=144068) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 28 08:10:22.017603 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=144068) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 08:10:22.017902 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=144068) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 08:10:22.018202 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=144068) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 08:10:22.018499 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=144068) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 08:10:22.027164 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=144067) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 08:10:22.027430 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=144067) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 08:10:22.027700 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=144067) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 08:10:22.027987 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=144067) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 08:10:22.030102 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=144068) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 28 08:10:22.030393 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=144068) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 08:10:22.030680 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=144068) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 08:10:22.030969 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=144068) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 08:10:22.031257 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=144068) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 08:10:22.031549 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=144068) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 08:10:22.031841 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=144068) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 08:10:22.035158 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=144067) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 28 08:10:22.038231 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=144067) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 28 08:10:22.038522 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=144067) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 08:10:22.038805 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=144067) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 08:10:22.039087 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=144067) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 08:10:22.039365 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=144067) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 08:10:22.039627 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=144067) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 08:10:22.039893 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=144067) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 08:10:22.040180 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=144067) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 08:10:22.040581 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=144067) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 08:10:22.040886 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=144067) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 08:10:22.041156 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=144067) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 08:10:22.047561 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=144068) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 28 08:10:22.050566 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=144068) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 28 08:10:22.053678 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=144068) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 08:10:22.056316 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=144068) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 08:10:22.057905 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=144068) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 28 08:10:22.058195 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=144068) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 08:10:22.058483 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=144068) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 08:10:22.064275 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=144067) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 08:10:22.065036 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=144068) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 08:10:22.065816 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=144067) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 28 08:10:22.066105 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=144067) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 08:10:22.066657 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=144068) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 28 08:10:22.069673 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=144068) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 08:10:22.069977 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=144068) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 08:10:22.070264 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=144068) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 08:10:22.070546 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=144068) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 08:10:22.070946 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=144067) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 28 08:10:22.071229 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=144067) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 08:10:22.071513 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=144067) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 08:10:22.078095 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=144067) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 28 08:10:22.078371 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=144067) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 08:10:22.078690 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=144068) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 28 08:10:22.078989 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=144068) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 08:10:22.079276 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=144068) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 08:10:22.082595 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=144067) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 28 08:10:22.082938 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=144067) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 08:10:22.083224 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=144067) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 08:10:22.083512 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=144067) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 08:10:22.083798 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=144067) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 08:10:22.084075 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=144067) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 08:10:22.084752 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=144067) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 08:10:22.085033 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=144067) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 08:10:22.086660 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=144068) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 28 08:10:22.086945 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=144068) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 08:10:22.087235 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=144068) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 08:10:22.087514 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=144068) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 08:10:22.087794 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=144068) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 08:10:22.088091 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=144068) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 08:10:22.088359 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=144068) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 08:10:22.088628 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=144068) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 08:10:22.089040 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=144068) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 08:10:22.089335 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=144068) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 08:10:22.089627 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=144068) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 08:10:22.089897 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=144068) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 08:10:22.090180 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=144068) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 08:10:22.090460 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=144068) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 08:10:22.102415 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=144067) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 08:10:22.102689 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=144067) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 08:10:22.106650 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=144067) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 28 08:10:22.109980 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=144067) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 08:10:22.110274 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=144067) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 08:10:22.114570 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=144067) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 28 08:10:22.117798 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=144067) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 28 08:10:22.121099 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=144067) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 08:10:22.121399 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=144067) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 08:10:22.121683 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=144067) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 08:10:22.121969 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=144067) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 08:10:22.122226 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=144067) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 08:10:22.122524 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=144067) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 08:10:22.124073 dv-cinder-851351-1-smb devstack@keystone.service[144068]: WSGI app 0 (mountpoint='') ready in 7 seconds on interpreter 0x559005be09c0 pid: 144068 (default app) Jul 28 08:10:22.127506 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713091e6-10c8-48f4-80cc-de6855161645 None None] REQUEST_METHOD: `GET` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:10:22.127822 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713091e6-10c8-48f4-80cc-de6855161645 None None] SCRIPT_NAME: `/identity` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:10:22.128102 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713091e6-10c8-48f4-80cc-de6855161645 None None] PATH_INFO: `/v3` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:10:22.133019 dv-cinder-851351-1-smb devstack@keystone.service[144068]: [pid: 144068|app: 0|req: 1/1] 10.222.0.42 () {50 vars in 791 bytes} [Thu Jul 28 08:10:22 2022] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:10:22.138672 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=144067) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 28 08:10:22.138964 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=144067) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 08:10:22.139708 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=144067) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 08:10:22.139708 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=144067) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 08:10:22.146646 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=144067) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 08:10:22.148215 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=144067) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 08:10:22.148486 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=144067) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 08:10:22.151201 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=144067) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 28 08:10:22.151488 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=144067) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 08:10:22.151785 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=144067) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 08:10:22.152072 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=144067) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 08:10:22.152348 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=144067) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 08:10:22.163960 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=144067) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 28 08:10:22.164271 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=144067) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 08:10:22.164523 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=144067) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 08:10:22.164828 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=144067) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 08:10:22.165113 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=144067) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 08:10:22.165390 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=144067) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 08:10:22.165670 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=144067) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 08:10:22.181390 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=144067) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 28 08:10:22.184434 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=144067) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 28 08:10:22.187392 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=144067) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 08:10:22.188885 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=144067) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 08:10:22.190388 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=144067) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 28 08:10:22.190709 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=144067) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 08:10:22.190992 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=144067) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 08:10:22.197698 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=144067) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 08:10:22.199183 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=144067) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 28 08:10:22.202133 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=144067) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 08:10:22.202420 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=144067) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 08:10:22.202707 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=144067) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 08:10:22.202980 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=144067) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 08:10:22.211490 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=144067) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 28 08:10:22.211775 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=144067) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 08:10:22.212068 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=144067) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 08:10:22.219092 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=144067) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 28 08:10:22.219346 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=144067) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 08:10:22.219629 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=144067) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 08:10:22.219907 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=144067) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 08:10:22.220199 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=144067) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 08:10:22.220480 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=144067) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 08:10:22.220780 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=144067) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 08:10:22.221069 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=144067) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 08:10:22.221340 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=144067) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 08:10:22.221610 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=144067) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 08:10:22.221896 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=144067) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 08:10:22.222167 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=144067) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 08:10:22.222432 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=144067) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 08:10:22.223212 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=144067) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 08:10:22.266269 dv-cinder-851351-1-smb devstack@keystone.service[144067]: WSGI app 0 (mountpoint='') ready in 7 seconds on interpreter 0x559005be09c0 pid: 144067 (default app) Jul 28 08:10:29.779231 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e212f4c5-02c7-4394-8202-1994b8f8ba34 None None] REQUEST_METHOD: `GET` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:10:29.779880 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e212f4c5-02c7-4394-8202-1994b8f8ba34 None None] SCRIPT_NAME: `/identity` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:10:29.779880 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e212f4c5-02c7-4394-8202-1994b8f8ba34 None None] PATH_INFO: `/` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:10:29.781164 dv-cinder-851351-1-smb devstack@keystone.service[144068]: [pid: 144068|app: 0|req: 2/2] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 08:10:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 28 08:10:29.789136 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc9297a-4c55-42be-83d6-1d13060da704 None None] REQUEST_METHOD: `POST` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:10:29.789689 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc9297a-4c55-42be-83d6-1d13060da704 None None] SCRIPT_NAME: `/identity` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:10:29.789851 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc9297a-4c55-42be-83d6-1d13060da704 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:10:29.861868 dv-cinder-851351-1-smb devstack@keystone.service[144067]: INFO dbcounter [None req-8dc9297a-4c55-42be-83d6-1d13060da704 None None] Registered counter for database keystone Jul 28 08:10:29.883773 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG oslo_db.sqlalchemy.engines [None req-8dc9297a-4c55-42be-83d6-1d13060da704 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=144067) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 28 08:10:29.891388 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG dbcounter [-] [144067] Writer thread running {{(pid=144067) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 28 08:10:30.074932 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG passlib.handlers.bcrypt [None req-8dc9297a-4c55-42be-83d6-1d13060da704 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=144067) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Jul 28 08:10:30.075361 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG passlib.handlers.bcrypt [None req-8dc9297a-4c55-42be-83d6-1d13060da704 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=144067) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Jul 28 08:10:30.131147 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.auth.core [None req-8dc9297a-4c55-42be-83d6-1d13060da704 None None] MFA Rules not processed for user `bf5ceb8f07374635ad506b7d1b4f1612`. Rule list: `[]` (Enabled: `True`). {{(pid=144067) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 08:10:30.132849 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.fernet_utils [None req-8dc9297a-4c55-42be-83d6-1d13060da704 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=144067) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:10:30.268976 dv-cinder-851351-1-smb devstack@keystone.service[144067]: [pid: 144067|app: 0|req: 1/3] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 08:10:29 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 483 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jul 28 08:10:30.292592 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e212f4c5-02c7-4394-8202-1994b8f8ba34 None None] Authenticating user token {{(pid=144068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:10:30.362581 dv-cinder-851351-1-smb devstack@keystone.service[144068]: INFO dbcounter [None req-e212f4c5-02c7-4394-8202-1994b8f8ba34 None None] Registered counter for database keystone Jul 28 08:10:30.382841 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG oslo_db.sqlalchemy.engines [None req-e212f4c5-02c7-4394-8202-1994b8f8ba34 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=144068) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 28 08:10:30.390550 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG dbcounter [-] [144068] Writer thread running {{(pid=144068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 28 08:10:30.512654 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e212f4c5-02c7-4394-8202-1994b8f8ba34 None None] Validating token access rules against request {{(pid=144068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:10:30.517621 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-792a346d-6e7c-4e15-b160-e0357376f419 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fae06d52d2d4b66af2858bdd1a0fbc7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:10:30.518281 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792a346d-6e7c-4e15-b160-e0357376f419 admin admin] REQUEST_METHOD: `GET` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:10:30.518563 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792a346d-6e7c-4e15-b160-e0357376f419 admin admin] SCRIPT_NAME: `/identity` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:10:30.518838 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792a346d-6e7c-4e15-b160-e0357376f419 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:10:30.527448 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-792a346d-6e7c-4e15-b160-e0357376f419 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:10:30.577826 dv-cinder-851351-1-smb devstack@keystone.service[144068]: WARNING keystone.common.rbac_enforcer.enforcer [None req-792a346d-6e7c-4e15-b160-e0357376f419 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Jul 28 08:10:30.578165 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-792a346d-6e7c-4e15-b160-e0357376f419 admin admin] RBAC: Authorization granted {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:10:30.590499 dv-cinder-851351-1-smb devstack@keystone.service[144068]: [pid: 144068|app: 0|req: 3/4] 10.222.0.42 () {58 vars in 1324 bytes} [Thu Jul 28 08:10:30 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 298 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 28 08:10:30.597070 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc9297a-4c55-42be-83d6-1d13060da704 None None] Authenticating user token {{(pid=144067) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:10:30.612117 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc9297a-4c55-42be-83d6-1d13060da704 None None] Validating token access rules against request {{(pid=144067) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:10:30.618011 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98fd864-06f2-4e3b-941e-4816c9d73a83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fae06d52d2d4b66af2858bdd1a0fbc7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144067) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:10:30.619084 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98fd864-06f2-4e3b-941e-4816c9d73a83 admin admin] REQUEST_METHOD: `GET` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:10:30.619374 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98fd864-06f2-4e3b-941e-4816c9d73a83 admin admin] SCRIPT_NAME: `/identity` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:10:30.619664 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98fd864-06f2-4e3b-941e-4816c9d73a83 admin admin] PATH_INFO: `/v3/projects/3fae06d52d2d4b66af2858bdd1a0fbc7` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:10:30.621405 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a98fd864-06f2-4e3b-941e-4816c9d73a83 admin admin] RBAC: Authorizing `identity:get_project(project_id=3fae06d52d2d4b66af2858bdd1a0fbc7)` {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:10:30.672587 dv-cinder-851351-1-smb devstack@keystone.service[144067]: WARNING keystone.common.rbac_enforcer.enforcer [None req-a98fd864-06f2-4e3b-941e-4816c9d73a83 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Jul 28 08:10:30.672970 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a98fd864-06f2-4e3b-941e-4816c9d73a83 admin admin] RBAC: Authorization granted {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:10:30.677671 dv-cinder-851351-1-smb devstack@keystone.service[144067]: [pid: 144067|app: 0|req: 2/5] 10.222.0.42 () {56 vars in 1207 bytes} [Thu Jul 28 08:10:30 2022] GET /identity/v3/projects/3fae06d52d2d4b66af2858bdd1a0fbc7 => generated 344 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:10:32.650641 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079fc77b-c736-4916-a596-e3de51f218f6 None None] REQUEST_METHOD: `GET` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:10:32.651224 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079fc77b-c736-4916-a596-e3de51f218f6 None None] SCRIPT_NAME: `/identity` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:10:32.651224 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079fc77b-c736-4916-a596-e3de51f218f6 None None] PATH_INFO: `/` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:10:32.655496 dv-cinder-851351-1-smb devstack@keystone.service[144068]: [pid: 144068|app: 0|req: 4/6] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 08:10:32 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 08:10:32.661614 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aff59ee-edcc-4e97-a97b-2a231a76e1ed None None] REQUEST_METHOD: `POST` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:10:32.662021 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aff59ee-edcc-4e97-a97b-2a231a76e1ed None None] SCRIPT_NAME: `/identity` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:10:32.662169 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aff59ee-edcc-4e97-a97b-2a231a76e1ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:10:32.683328 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.auth.core [None req-5aff59ee-edcc-4e97-a97b-2a231a76e1ed None None] MFA Rules not processed for user `bf5ceb8f07374635ad506b7d1b4f1612`. Rule list: `[]` (Enabled: `True`). {{(pid=144067) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 08:10:32.684900 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.fernet_utils [None req-5aff59ee-edcc-4e97-a97b-2a231a76e1ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=144067) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:10:32.693480 dv-cinder-851351-1-smb devstack@keystone.service[144067]: [pid: 144067|app: 0|req: 3/7] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 08:10:32 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jul 28 08:10:32.716171 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079fc77b-c736-4916-a596-e3de51f218f6 None None] Authenticating user token {{(pid=144068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:10:32.731002 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079fc77b-c736-4916-a596-e3de51f218f6 None None] Validating token access rules against request {{(pid=144068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:10:32.736083 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3534358b-bc00-4b00-b6d8-4bac2b533c69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fae06d52d2d4b66af2858bdd1a0fbc7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:10:32.736721 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3534358b-bc00-4b00-b6d8-4bac2b533c69 admin admin] REQUEST_METHOD: `GET` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:10:32.737037 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3534358b-bc00-4b00-b6d8-4bac2b533c69 admin admin] SCRIPT_NAME: `/identity` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:10:32.737318 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3534358b-bc00-4b00-b6d8-4bac2b533c69 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:10:32.745782 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3534358b-bc00-4b00-b6d8-4bac2b533c69 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:10:32.747593 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3534358b-bc00-4b00-b6d8-4bac2b533c69 admin admin] RBAC: Authorization granted {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:10:32.756917 dv-cinder-851351-1-smb devstack@keystone.service[144068]: [pid: 144068|app: 0|req: 5/8] 10.222.0.42 () {58 vars in 1324 bytes} [Thu Jul 28 08:10:32 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 28 08:10:32.762925 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aff59ee-edcc-4e97-a97b-2a231a76e1ed None None] Authenticating user token {{(pid=144067) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:10:32.772696 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aff59ee-edcc-4e97-a97b-2a231a76e1ed None None] Validating token access rules against request {{(pid=144067) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:10:32.778533 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-586850ef-dee7-4bf5-aca8-c644bb83ef4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3fae06d52d2d4b66af2858bdd1a0fbc7', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144067) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:10:32.779193 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586850ef-dee7-4bf5-aca8-c644bb83ef4b admin admin] REQUEST_METHOD: `GET` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:10:32.779476 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586850ef-dee7-4bf5-aca8-c644bb83ef4b admin admin] SCRIPT_NAME: `/identity` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:10:32.779746 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586850ef-dee7-4bf5-aca8-c644bb83ef4b admin admin] PATH_INFO: `/v3/users/bf5ceb8f07374635ad506b7d1b4f1612` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:10:32.781324 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-586850ef-dee7-4bf5-aca8-c644bb83ef4b admin admin] RBAC: Authorizing `identity:get_user(user_id=bf5ceb8f07374635ad506b7d1b4f1612)` {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:10:32.783188 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-586850ef-dee7-4bf5-aca8-c644bb83ef4b admin admin] RBAC: Authorization granted {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:10:32.784811 dv-cinder-851351-1-smb devstack@keystone.service[144067]: [pid: 144067|app: 0|req: 4/9] 10.222.0.42 () {56 vars in 1198 bytes} [Thu Jul 28 08:10:32 2022] GET /identity/v3/users/bf5ceb8f07374635ad506b7d1b4f1612 => generated 247 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:10:34.843303 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9dd9d7-b6c7-4ec2-945e-7877e1d6f23e None None] REQUEST_METHOD: `GET` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:10:34.843871 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9dd9d7-b6c7-4ec2-945e-7877e1d6f23e None None] SCRIPT_NAME: `/identity` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:10:34.843871 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9dd9d7-b6c7-4ec2-945e-7877e1d6f23e None None] PATH_INFO: `/` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:10:34.845248 dv-cinder-851351-1-smb devstack@keystone.service[144068]: [pid: 144068|app: 0|req: 6/10] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 08:10:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 08:10:34.850678 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc24a1c-624a-4627-9f9e-fc1c22a5f5a5 None None] REQUEST_METHOD: `POST` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:10:34.851146 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc24a1c-624a-4627-9f9e-fc1c22a5f5a5 None None] SCRIPT_NAME: `/identity` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:10:34.851259 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc24a1c-624a-4627-9f9e-fc1c22a5f5a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:10:34.870294 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.auth.core [None req-5bc24a1c-624a-4627-9f9e-fc1c22a5f5a5 None None] MFA Rules not processed for user `bf5ceb8f07374635ad506b7d1b4f1612`. Rule list: `[]` (Enabled: `True`). {{(pid=144067) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 08:10:34.871530 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.fernet_utils [None req-5bc24a1c-624a-4627-9f9e-fc1c22a5f5a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=144067) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:10:34.872751 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee1d4c2-0604-43fc-a1b4-75aff5565f62 None None] REQUEST_METHOD: `GET` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:10:34.873053 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee1d4c2-0604-43fc-a1b4-75aff5565f62 None None] SCRIPT_NAME: `/identity` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:10:34.873356 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee1d4c2-0604-43fc-a1b4-75aff5565f62 None None] PATH_INFO: `/` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:10:34.874747 dv-cinder-851351-1-smb devstack@keystone.service[144068]: [pid: 144068|app: 0|req: 7/11] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 08:10:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 08:10:34.879913 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f089f6cd-bd78-4477-abdb-0a39dbed24da None None] REQUEST_METHOD: `POST` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:10:34.880205 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f089f6cd-bd78-4477-abdb-0a39dbed24da None None] SCRIPT_NAME: `/identity` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:10:34.880486 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f089f6cd-bd78-4477-abdb-0a39dbed24da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:10:34.925147 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG passlib.handlers.bcrypt [None req-f089f6cd-bd78-4477-abdb-0a39dbed24da None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=144068) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Jul 28 08:10:34.925604 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG passlib.handlers.bcrypt [None req-f089f6cd-bd78-4477-abdb-0a39dbed24da None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=144068) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Jul 28 08:10:34.953369 dv-cinder-851351-1-smb devstack@keystone.service[144067]: [pid: 144067|app: 0|req: 5/12] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 08:10:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 08:10:34.973682 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.auth.core [None req-f089f6cd-bd78-4477-abdb-0a39dbed24da None None] MFA Rules not processed for user `bf5ceb8f07374635ad506b7d1b4f1612`. Rule list: `[]` (Enabled: `True`). {{(pid=144068) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 08:10:34.977685 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.fernet_utils [None req-f089f6cd-bd78-4477-abdb-0a39dbed24da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=144068) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:10:34.983150 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc24a1c-624a-4627-9f9e-fc1c22a5f5a5 None None] Authenticating user token {{(pid=144067) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:10:35.009876 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG dbcounter [-] [144067] Writing DB stats keystone:SELECT=100 {{(pid=144067) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:10:35.085371 dv-cinder-851351-1-smb devstack@keystone.service[144068]: [pid: 144068|app: 0|req: 8/13] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 08:10:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 08:10:35.107323 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f089f6cd-bd78-4477-abdb-0a39dbed24da None None] Authenticating user token {{(pid=144068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:10:35.109751 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc24a1c-624a-4627-9f9e-fc1c22a5f5a5 None None] Validating token access rules against request {{(pid=144067) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:10:35.151591 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-669d9a1a-cffc-4ca6-9a86-26e9c281d0de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144067) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:10:35.152271 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669d9a1a-cffc-4ca6-9a86-26e9c281d0de None admin] REQUEST_METHOD: `GET` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:10:35.152567 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669d9a1a-cffc-4ca6-9a86-26e9c281d0de None admin] SCRIPT_NAME: `/identity` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:10:35.152897 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669d9a1a-cffc-4ca6-9a86-26e9c281d0de None admin] PATH_INFO: `/v3/roles/admin` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:10:35.165070 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-669d9a1a-cffc-4ca6-9a86-26e9c281d0de None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 08:10:35.173706 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application [None req-669d9a1a-cffc-4ca6-9a86-26e9c281d0de None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 08:10:35.173706 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:10:35.173706 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:10:35.173706 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:10:35.173706 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:10:35.173706 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:10:35.173706 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:10:35.173706 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:10:35.173706 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:10:35.173706 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:10:35.173706 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:10:35.173706 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:10:35.173706 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 08:10:35.173706 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 08:10:35.173706 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 08:10:35.173706 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 08:10:35.174898 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 08:10:35.174898 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 08:10:35.174898 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 08:10:35.174898 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 08:10:35.174898 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:10:35.174898 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:10:35.174898 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:10:35.174898 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:10:35.174898 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:10:35.174898 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:10:35.174898 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:10:35.174898 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application with Lock( Jul 28 08:10:35.174898 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:10:35.174898 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:10:35.174898 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:10:35.174898 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:10:35.175880 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:10:35.175880 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:10:35.175880 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:10:35.175880 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:10:35.175880 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 08:10:35.175880 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 08:10:35.175880 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 08:10:35.175880 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 08:10:35.175880 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 08:10:35.175880 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 08:10:35.175880 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 08:10:35.175880 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application Jul 28 08:10:35.175880 dv-cinder-851351-1-smb devstack@keystone.service[144067]: [pid: 144067|app: 0|req: 6/14] 10.222.0.42 () {56 vars in 1096 bytes} [Thu Jul 28 08:10:34 2022] GET /identity/v3/roles/admin => generated 83 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:10:35.182914 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-669d9a1a-cffc-4ca6-9a86-26e9c281d0de None admin] Authenticating user token {{(pid=144067) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:10:35.211661 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f089f6cd-bd78-4477-abdb-0a39dbed24da None None] Validating token access rules against request {{(pid=144068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:10:35.214013 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG dbcounter [-] [144068] Writing DB stats keystone:SELECT=100 {{(pid=144068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:10:35.250474 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdfc0d38-c7e6-4894-ad69-eff1f57fb1bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:10:35.251473 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdfc0d38-c7e6-4894-ad69-eff1f57fb1bd None admin] REQUEST_METHOD: `GET` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:10:35.251791 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdfc0d38-c7e6-4894-ad69-eff1f57fb1bd None admin] SCRIPT_NAME: `/identity` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:10:35.252068 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdfc0d38-c7e6-4894-ad69-eff1f57fb1bd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:10:35.267269 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG dbcounter [-] [144067] Writing DB stats keystone:SELECT=100 {{(pid=144067) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:10:35.287564 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-669d9a1a-cffc-4ca6-9a86-26e9c281d0de None admin] Validating token access rules against request {{(pid=144067) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:10:35.322084 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1489eda2-8f99-42af-8864-60b04a2c8a21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144067) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:10:35.322727 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1489eda2-8f99-42af-8864-60b04a2c8a21 None admin] REQUEST_METHOD: `GET` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:10:35.323009 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1489eda2-8f99-42af-8864-60b04a2c8a21 None admin] SCRIPT_NAME: `/identity` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:10:35.323124 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdfc0d38-c7e6-4894-ad69-eff1f57fb1bd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:10:35.323289 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1489eda2-8f99-42af-8864-60b04a2c8a21 None admin] PATH_INFO: `/v3/roles` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:10:35.324015 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1489eda2-8f99-42af-8864-60b04a2c8a21 None admin] RBAC: Adding query filter params (name=admin) {{(pid=144067) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:10:35.324319 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1489eda2-8f99-42af-8864-60b04a2c8a21 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:10:35.324591 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdfc0d38-c7e6-4894-ad69-eff1f57fb1bd None admin] RBAC: Authorization granted {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:10:35.325773 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1489eda2-8f99-42af-8864-60b04a2c8a21 None admin] RBAC: Authorization granted {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:10:35.338498 dv-cinder-851351-1-smb devstack@keystone.service[144067]: [pid: 144067|app: 0|req: 7/15] 10.222.0.42 () {56 vars in 1099 bytes} [Thu Jul 28 08:10:35 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 08:10:35.343955 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1489eda2-8f99-42af-8864-60b04a2c8a21 None admin] Authenticating user token {{(pid=144067) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:10:35.434242 dv-cinder-851351-1-smb devstack@keystone.service[144068]: [pid: 144068|app: 0|req: 9/16] 10.222.0.42 () {58 vars in 1282 bytes} [Thu Jul 28 08:10:35 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 28 08:10:35.440083 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdfc0d38-c7e6-4894-ad69-eff1f57fb1bd None admin] Authenticating user token {{(pid=144068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:10:35.443505 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG dbcounter [-] [144068] Writing DB stats keystone:SELECT=100 {{(pid=144068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:10:35.448090 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1489eda2-8f99-42af-8864-60b04a2c8a21 None admin] Validating token access rules against request {{(pid=144067) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:10:35.483366 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a864a682-f7df-4e49-85d9-c804fc2b2284 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144067) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:10:35.484024 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a864a682-f7df-4e49-85d9-c804fc2b2284 None admin] REQUEST_METHOD: `GET` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:10:35.484310 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a864a682-f7df-4e49-85d9-c804fc2b2284 None admin] SCRIPT_NAME: `/identity` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:10:35.484595 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a864a682-f7df-4e49-85d9-c804fc2b2284 None admin] PATH_INFO: `/v3/users/bf5ceb8f07374635ad506b7d1b4f1612` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:10:35.485841 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a864a682-f7df-4e49-85d9-c804fc2b2284 None admin] RBAC: Authorizing `identity:get_user(user_id=bf5ceb8f07374635ad506b7d1b4f1612)` {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:10:35.487334 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a864a682-f7df-4e49-85d9-c804fc2b2284 None admin] RBAC: Authorization granted {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:10:35.489026 dv-cinder-851351-1-smb devstack@keystone.service[144067]: [pid: 144067|app: 0|req: 8/17] 10.222.0.42 () {56 vars in 1177 bytes} [Thu Jul 28 08:10:35 2022] GET /identity/v3/users/bf5ceb8f07374635ad506b7d1b4f1612 => generated 247 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 08:10:35.494703 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a864a682-f7df-4e49-85d9-c804fc2b2284 None admin] Authenticating user token {{(pid=144067) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:10:35.509346 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG dbcounter [-] [144067] Writing DB stats keystone:SELECT=100 {{(pid=144067) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:10:35.541228 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdfc0d38-c7e6-4894-ad69-eff1f57fb1bd None admin] Validating token access rules against request {{(pid=144068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:10:35.575601 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c2ba2a-7cc1-47fd-b5c9-4ac9ff374260 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:10:35.576465 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c2ba2a-7cc1-47fd-b5c9-4ac9ff374260 None admin] REQUEST_METHOD: `GET` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:10:35.576777 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c2ba2a-7cc1-47fd-b5c9-4ac9ff374260 None admin] SCRIPT_NAME: `/identity` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:10:35.577051 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c2ba2a-7cc1-47fd-b5c9-4ac9ff374260 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:10:35.595928 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8c2ba2a-7cc1-47fd-b5c9-4ac9ff374260 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:10:35.597446 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8c2ba2a-7cc1-47fd-b5c9-4ac9ff374260 None admin] RBAC: Authorization granted {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:10:35.598885 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a864a682-f7df-4e49-85d9-c804fc2b2284 None admin] Validating token access rules against request {{(pid=144067) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:10:35.616261 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application [None req-c8c2ba2a-7cc1-47fd-b5c9-4ac9ff374260 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 08:10:35.616261 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:10:35.616261 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:10:35.616261 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:10:35.616261 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:10:35.616261 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:10:35.616261 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:10:35.616261 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:10:35.616261 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:10:35.616261 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:10:35.616261 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:10:35.616261 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:10:35.616261 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 08:10:35.616261 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 08:10:35.616261 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 08:10:35.617310 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 08:10:35.617310 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:10:35.617310 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:10:35.617310 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:10:35.617310 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:10:35.617310 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:10:35.617310 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:10:35.617310 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:10:35.617310 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application with Lock( Jul 28 08:10:35.617310 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:10:35.617310 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:10:35.617310 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:10:35.617310 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:10:35.617310 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:10:35.617310 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:10:35.617310 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:10:35.617310 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:10:35.618251 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 08:10:35.618251 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 08:10:35.618251 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 08:10:35.618251 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application Jul 28 08:10:35.618251 dv-cinder-851351-1-smb devstack@keystone.service[144068]: [pid: 144068|app: 0|req: 10/18] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 08:10:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 08:10:35.623657 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c2ba2a-7cc1-47fd-b5c9-4ac9ff374260 None admin] Authenticating user token {{(pid=144068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:10:35.635843 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d85044-401d-40aa-9d39-d7f017b1fc0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144067) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:10:35.636511 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d85044-401d-40aa-9d39-d7f017b1fc0a None admin] REQUEST_METHOD: `GET` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:10:35.636829 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d85044-401d-40aa-9d39-d7f017b1fc0a None admin] SCRIPT_NAME: `/identity` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:10:35.637112 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d85044-401d-40aa-9d39-d7f017b1fc0a None admin] PATH_INFO: `/v3/domains/default` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:10:35.638296 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98d85044-401d-40aa-9d39-d7f017b1fc0a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:10:35.639784 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98d85044-401d-40aa-9d39-d7f017b1fc0a None admin] RBAC: Authorization granted {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:10:35.641443 dv-cinder-851351-1-smb devstack@keystone.service[144067]: [pid: 144067|app: 0|req: 9/19] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 08:10:35 2022] GET /identity/v3/domains/default => generated 199 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 08:10:35.649722 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d85044-401d-40aa-9d39-d7f017b1fc0a None admin] Authenticating user token {{(pid=144067) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:10:35.682292 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG dbcounter [-] [144068] Writing DB stats keystone:SELECT=100 {{(pid=144068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:10:35.726775 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c2ba2a-7cc1-47fd-b5c9-4ac9ff374260 None admin] Validating token access rules against request {{(pid=144068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:10:35.738467 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG dbcounter [-] [144067] Writing DB stats keystone:SELECT=100 {{(pid=144067) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:10:35.759886 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d85044-401d-40aa-9d39-d7f017b1fc0a None admin] Validating token access rules against request {{(pid=144067) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:10:35.761648 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80520fd8-49ee-462f-8b40-fb5131ec39d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:10:35.762282 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80520fd8-49ee-462f-8b40-fb5131ec39d3 None admin] REQUEST_METHOD: `GET` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:10:35.762567 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80520fd8-49ee-462f-8b40-fb5131ec39d3 None admin] SCRIPT_NAME: `/identity` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:10:35.762848 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80520fd8-49ee-462f-8b40-fb5131ec39d3 None admin] PATH_INFO: `/v3/domains` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:10:35.763565 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80520fd8-49ee-462f-8b40-fb5131ec39d3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=144068) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:10:35.763876 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80520fd8-49ee-462f-8b40-fb5131ec39d3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:10:35.765329 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80520fd8-49ee-462f-8b40-fb5131ec39d3 None admin] RBAC: Authorization granted {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:10:35.783819 dv-cinder-851351-1-smb devstack@keystone.service[144068]: [pid: 144068|app: 0|req: 11/20] 10.222.0.42 () {56 vars in 1109 bytes} [Thu Jul 28 08:10:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 08:10:35.797353 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f6e0e5-a98b-4761-88bc-943d89584547 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144067) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:10:35.798023 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f6e0e5-a98b-4761-88bc-943d89584547 None admin] REQUEST_METHOD: `GET` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:10:35.798309 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f6e0e5-a98b-4761-88bc-943d89584547 None admin] SCRIPT_NAME: `/identity` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:10:35.798583 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f6e0e5-a98b-4761-88bc-943d89584547 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:10:35.799435 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67f6e0e5-a98b-4761-88bc-943d89584547 None admin] RBAC: Adding query filter params (role.id=d1020e7bb0b7411d895ddedd6dc02c5b, scope.domain.id=default, user.id=bf5ceb8f07374635ad506b7d1b4f1612) {{(pid=144067) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:10:35.799736 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67f6e0e5-a98b-4761-88bc-943d89584547 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:10:35.801339 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67f6e0e5-a98b-4761-88bc-943d89584547 None admin] RBAC: Authorization granted {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:10:35.809805 dv-cinder-851351-1-smb devstack@keystone.service[144067]: [pid: 144067|app: 0|req: 10/21] 10.222.0.42 () {56 vars in 1322 bytes} [Thu Jul 28 08:10:35 2022] GET /identity/v3/role_assignments?user.id=bf5ceb8f07374635ad506b7d1b4f1612&scope.domain.id=default&role.id=d1020e7bb0b7411d895ddedd6dc02c5b => generated 233 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 08:10:38.176311 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646b68c1-feff-4ea5-b0d6-65c09b982e38 None None] REQUEST_METHOD: `GET` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:10:38.176911 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646b68c1-feff-4ea5-b0d6-65c09b982e38 None None] SCRIPT_NAME: `/identity` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:10:38.176911 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646b68c1-feff-4ea5-b0d6-65c09b982e38 None None] PATH_INFO: `/` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:10:38.178319 dv-cinder-851351-1-smb devstack@keystone.service[144068]: [pid: 144068|app: 0|req: 12/22] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 08:10:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 08:10:38.183643 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7753837e-220d-41e1-9151-83249597713a None None] REQUEST_METHOD: `POST` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:10:38.184067 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7753837e-220d-41e1-9151-83249597713a None None] SCRIPT_NAME: `/identity` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:10:38.184243 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7753837e-220d-41e1-9151-83249597713a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:10:38.210481 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.auth.core [None req-7753837e-220d-41e1-9151-83249597713a None None] MFA Rules not processed for user `bf5ceb8f07374635ad506b7d1b4f1612`. Rule list: `[]` (Enabled: `True`). {{(pid=144067) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 08:10:38.211691 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.fernet_utils [None req-7753837e-220d-41e1-9151-83249597713a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=144067) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:10:38.297269 dv-cinder-851351-1-smb devstack@keystone.service[144067]: [pid: 144067|app: 0|req: 11/23] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 08:10:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 08:10:38.331960 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-646b68c1-feff-4ea5-b0d6-65c09b982e38 None None] Authenticating user token {{(pid=144068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:10:38.366820 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fecee8a-cd37-463e-9ed1-79ed1e980beb None None] REQUEST_METHOD: `GET` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:10:38.367170 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fecee8a-cd37-463e-9ed1-79ed1e980beb None None] SCRIPT_NAME: `/identity` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:10:38.367383 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fecee8a-cd37-463e-9ed1-79ed1e980beb None None] PATH_INFO: `/` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:10:38.368952 dv-cinder-851351-1-smb devstack@keystone.service[144067]: [pid: 144067|app: 0|req: 12/24] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 08:10:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 28 08:10:38.375329 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959d60c4-83cd-4156-bde0-6e5ed416fc0e None None] REQUEST_METHOD: `POST` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:10:38.375606 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959d60c4-83cd-4156-bde0-6e5ed416fc0e None None] SCRIPT_NAME: `/identity` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:10:38.375934 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959d60c4-83cd-4156-bde0-6e5ed416fc0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:10:38.409994 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.auth.core [None req-959d60c4-83cd-4156-bde0-6e5ed416fc0e None None] MFA Rules not processed for user `bf5ceb8f07374635ad506b7d1b4f1612`. Rule list: `[]` (Enabled: `True`). {{(pid=144067) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 08:10:38.411528 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.fernet_utils [None req-959d60c4-83cd-4156-bde0-6e5ed416fc0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=144067) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:10:38.520808 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-646b68c1-feff-4ea5-b0d6-65c09b982e38 None None] Validating token access rules against request {{(pid=144068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:10:38.549093 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG dbcounter [-] [144068] Writing DB stats keystone:SELECT=100 {{(pid=144068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:10:38.560907 dv-cinder-851351-1-smb devstack@keystone.service[144067]: [pid: 144067|app: 0|req: 13/25] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 08:10:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 28 08:10:38.587920 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95e384a-23a2-4a18-a9bf-ec8658e3557b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:10:38.589025 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95e384a-23a2-4a18-a9bf-ec8658e3557b None admin] REQUEST_METHOD: `GET` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:10:38.589557 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95e384a-23a2-4a18-a9bf-ec8658e3557b None admin] SCRIPT_NAME: `/identity` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:10:38.590038 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95e384a-23a2-4a18-a9bf-ec8658e3557b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:10:38.596429 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f9ffcc-fae6-45a1-b83c-7e42139e322d None None] REQUEST_METHOD: `GET` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:10:38.596777 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f9ffcc-fae6-45a1-b83c-7e42139e322d None None] SCRIPT_NAME: `/identity` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:10:38.597064 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f9ffcc-fae6-45a1-b83c-7e42139e322d None None] PATH_INFO: `/` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:10:38.598516 dv-cinder-851351-1-smb devstack@keystone.service[144067]: [pid: 144067|app: 0|req: 14/26] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 08:10:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 28 08:10:38.606951 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e95e384a-23a2-4a18-a9bf-ec8658e3557b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:10:38.609021 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e95e384a-23a2-4a18-a9bf-ec8658e3557b None admin] RBAC: Authorization granted {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:10:38.610152 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36f3005-37f0-4618-a36b-0f61b7dce84e None None] REQUEST_METHOD: `POST` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:10:38.610472 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36f3005-37f0-4618-a36b-0f61b7dce84e None None] SCRIPT_NAME: `/identity` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:10:38.610778 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36f3005-37f0-4618-a36b-0f61b7dce84e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:10:38.626212 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application [None req-e95e384a-23a2-4a18-a9bf-ec8658e3557b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 08:10:38.626212 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:10:38.626212 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:10:38.626212 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:10:38.626212 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:10:38.626212 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:10:38.626212 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:10:38.626212 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:10:38.626212 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:10:38.626212 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:10:38.626212 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:10:38.626212 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:10:38.626212 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 08:10:38.626212 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 08:10:38.626212 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 08:10:38.627206 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 08:10:38.627206 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:10:38.627206 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:10:38.627206 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:10:38.627206 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:10:38.627206 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:10:38.627206 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:10:38.627206 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:10:38.627206 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application with Lock( Jul 28 08:10:38.627206 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:10:38.627206 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:10:38.627206 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:10:38.627206 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:10:38.627206 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:10:38.627206 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:10:38.627206 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:10:38.627206 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:10:38.628159 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 08:10:38.628159 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 08:10:38.628159 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 08:10:38.628159 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application Jul 28 08:10:38.630171 dv-cinder-851351-1-smb devstack@keystone.service[144068]: [pid: 144068|app: 0|req: 13/27] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 08:10:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 299 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:10:38.631245 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95e384a-23a2-4a18-a9bf-ec8658e3557b None admin] Authenticating user token {{(pid=144068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:10:38.632351 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG dbcounter [-] [144067] Writing DB stats keystone:SELECT=100 {{(pid=144067) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:10:38.657051 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.auth.core [None req-f36f3005-37f0-4618-a36b-0f61b7dce84e None None] MFA Rules not processed for user `bf5ceb8f07374635ad506b7d1b4f1612`. Rule list: `[]` (Enabled: `True`). {{(pid=144067) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 08:10:38.658687 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.fernet_utils [None req-f36f3005-37f0-4618-a36b-0f61b7dce84e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=144067) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:10:38.752794 dv-cinder-851351-1-smb devstack@keystone.service[144067]: [pid: 144067|app: 0|req: 15/28] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 08:10:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 08:10:38.757494 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36f3005-37f0-4618-a36b-0f61b7dce84e None None] Authenticating user token {{(pid=144067) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:10:38.774577 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95e384a-23a2-4a18-a9bf-ec8658e3557b None admin] Validating token access rules against request {{(pid=144068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:10:38.812710 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d5db40b-f053-45eb-a8fe-032865395a73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:10:38.813736 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5db40b-f053-45eb-a8fe-032865395a73 None admin] REQUEST_METHOD: `POST` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:10:38.814225 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5db40b-f053-45eb-a8fe-032865395a73 None admin] SCRIPT_NAME: `/identity` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:10:38.814717 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5db40b-f053-45eb-a8fe-032865395a73 None admin] PATH_INFO: `/v3/roles` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:10:38.815677 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d5db40b-f053-45eb-a8fe-032865395a73 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:10:38.817452 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d5db40b-f053-45eb-a8fe-032865395a73 None admin] RBAC: Authorization granted {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:10:38.889988 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36f3005-37f0-4618-a36b-0f61b7dce84e None None] Validating token access rules against request {{(pid=144067) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:10:38.930335 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48569cc4-832f-42b8-8249-a09919e46841 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144067) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:10:38.930998 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48569cc4-832f-42b8-8249-a09919e46841 None admin] REQUEST_METHOD: `GET` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:10:38.931282 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48569cc4-832f-42b8-8249-a09919e46841 None admin] SCRIPT_NAME: `/identity` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:10:38.931558 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48569cc4-832f-42b8-8249-a09919e46841 None admin] PATH_INFO: `/v3/domains` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:10:38.932285 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48569cc4-832f-42b8-8249-a09919e46841 None admin] RBAC: Adding query filter params (name=Default) {{(pid=144067) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:10:38.932592 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48569cc4-832f-42b8-8249-a09919e46841 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:10:38.934080 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48569cc4-832f-42b8-8249-a09919e46841 None admin] RBAC: Authorization granted {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:10:38.936164 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG dbcounter [-] [144067] Writing DB stats keystone:SELECT=100 {{(pid=144067) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:10:38.957340 dv-cinder-851351-1-smb devstack@keystone.service[144067]: [pid: 144067|app: 0|req: 16/29] 10.222.0.42 () {56 vars in 1109 bytes} [Thu Jul 28 08:10:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:10:38.958871 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6086dab6-52f1-436c-b248-40bbb6cbf8c9 None None] REQUEST_METHOD: `GET` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:10:38.959159 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6086dab6-52f1-436c-b248-40bbb6cbf8c9 None None] SCRIPT_NAME: `/identity` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:10:38.959434 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6086dab6-52f1-436c-b248-40bbb6cbf8c9 None None] PATH_INFO: `/` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:10:38.961118 dv-cinder-851351-1-smb devstack@keystone.service[144067]: [pid: 144067|app: 0|req: 17/30] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 08:10:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 08:10:38.965579 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6086dab6-52f1-436c-b248-40bbb6cbf8c9 None None] Authenticating user token {{(pid=144067) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:10:39.072737 dv-cinder-851351-1-smb devstack@keystone.service[144068]: [pid: 144068|app: 0|req: 14/31] 10.222.0.42 () {60 vars in 1131 bytes} [Thu Jul 28 08:10:38 2022] POST /identity/v3/roles => generated 225 bytes in 442 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 08:10:39.075270 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d5db40b-f053-45eb-a8fe-032865395a73 None admin] Authenticating user token {{(pid=144068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:10:39.075690 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6086dab6-52f1-436c-b248-40bbb6cbf8c9 None None] Validating token access rules against request {{(pid=144067) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:10:39.120780 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7916157b-0842-45f1-9aaf-bf6d12466336 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144067) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:10:39.120780 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7916157b-0842-45f1-9aaf-bf6d12466336 None admin] REQUEST_METHOD: `POST` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:10:39.120780 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7916157b-0842-45f1-9aaf-bf6d12466336 None admin] SCRIPT_NAME: `/identity` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:10:39.120780 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7916157b-0842-45f1-9aaf-bf6d12466336 None admin] PATH_INFO: `/v3/roles` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:10:39.121263 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7916157b-0842-45f1-9aaf-bf6d12466336 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:10:39.121263 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7916157b-0842-45f1-9aaf-bf6d12466336 None admin] RBAC: Authorization granted {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:10:39.126964 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG dbcounter [-] [144068] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=144068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:10:39.290386 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d5db40b-f053-45eb-a8fe-032865395a73 None admin] Validating token access rules against request {{(pid=144068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:10:39.369807 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14a1cca-ae04-42b3-935a-6cf26a16e87e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:10:39.370842 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14a1cca-ae04-42b3-935a-6cf26a16e87e None admin] REQUEST_METHOD: `POST` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:10:39.371328 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14a1cca-ae04-42b3-935a-6cf26a16e87e None admin] SCRIPT_NAME: `/identity` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:10:39.371792 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14a1cca-ae04-42b3-935a-6cf26a16e87e None admin] PATH_INFO: `/v3/projects` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:10:39.373116 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f14a1cca-ae04-42b3-935a-6cf26a16e87e None admin] RBAC: Authorizing `identity:create_project()` {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:10:39.374993 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f14a1cca-ae04-42b3-935a-6cf26a16e87e None admin] RBAC: Authorization granted {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:10:39.412713 dv-cinder-851351-1-smb devstack@keystone.service[144067]: [pid: 144067|app: 0|req: 18/32] 10.222.0.42 () {60 vars in 1131 bytes} [Thu Jul 28 08:10:38 2022] POST /identity/v3/roles => generated 219 bytes in 451 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 08:10:39.414998 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903d2279-905c-4761-8f78-cdeb0ab8d2fd None None] REQUEST_METHOD: `POST` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:10:39.415566 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903d2279-905c-4761-8f78-cdeb0ab8d2fd None None] SCRIPT_NAME: `/identity` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:10:39.416148 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903d2279-905c-4761-8f78-cdeb0ab8d2fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:10:39.431103 dv-cinder-851351-1-smb devstack@keystone.service[144068]: [pid: 144068|app: 0|req: 15/33] 10.222.0.42 () {60 vars in 1141 bytes} [Thu Jul 28 08:10:39 2022] POST /identity/v3/projects => generated 301 bytes in 357 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 08:10:39.440224 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.auth.core [None req-903d2279-905c-4761-8f78-cdeb0ab8d2fd None None] MFA Rules not processed for user `bf5ceb8f07374635ad506b7d1b4f1612`. Rule list: `[]` (Enabled: `True`). {{(pid=144067) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 08:10:39.442352 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.fernet_utils [None req-903d2279-905c-4761-8f78-cdeb0ab8d2fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=144067) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:10:39.525455 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG dbcounter [-] [144067] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=144067) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:10:39.549888 dv-cinder-851351-1-smb devstack@keystone.service[144067]: [pid: 144067|app: 0|req: 19/34] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 08:10:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 08:10:39.586946 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14a1cca-ae04-42b3-935a-6cf26a16e87e None admin] Authenticating user token {{(pid=144068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:10:39.587437 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3935bc3-405f-4012-ba91-5349c1ef28a4 None None] REQUEST_METHOD: `GET` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:10:39.587738 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3935bc3-405f-4012-ba91-5349c1ef28a4 None None] SCRIPT_NAME: `/identity` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:10:39.588160 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3935bc3-405f-4012-ba91-5349c1ef28a4 None None] PATH_INFO: `/` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:10:39.590071 dv-cinder-851351-1-smb devstack@keystone.service[144067]: [pid: 144067|app: 0|req: 20/35] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 08:10:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 08:10:39.598965 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d1b431-2db2-4787-9a53-bd64b5c71c12 None None] REQUEST_METHOD: `POST` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:10:39.598965 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d1b431-2db2-4787-9a53-bd64b5c71c12 None None] SCRIPT_NAME: `/identity` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:10:39.598965 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d1b431-2db2-4787-9a53-bd64b5c71c12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:10:39.618098 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.auth.core [None req-61d1b431-2db2-4787-9a53-bd64b5c71c12 None None] MFA Rules not processed for user `bf5ceb8f07374635ad506b7d1b4f1612`. Rule list: `[]` (Enabled: `True`). {{(pid=144067) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 08:10:39.619799 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.fernet_utils [None req-61d1b431-2db2-4787-9a53-bd64b5c71c12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=144067) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:10:39.693126 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG dbcounter [-] [144068] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=144068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:10:39.708645 dv-cinder-851351-1-smb devstack@keystone.service[144067]: [pid: 144067|app: 0|req: 21/36] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 08:10:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 28 08:10:39.710800 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6879e0bd-6dfe-431b-a4f8-5bb68b52e8da None None] REQUEST_METHOD: `GET` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:10:39.711306 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6879e0bd-6dfe-431b-a4f8-5bb68b52e8da None None] SCRIPT_NAME: `/identity` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:10:39.711762 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6879e0bd-6dfe-431b-a4f8-5bb68b52e8da None None] PATH_INFO: `/` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:10:39.713817 dv-cinder-851351-1-smb devstack@keystone.service[144067]: [pid: 144067|app: 0|req: 22/37] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 08:10:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 08:10:39.719823 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10af921-79cb-4b33-94f9-ca56b082721e None None] REQUEST_METHOD: `POST` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:10:39.721008 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10af921-79cb-4b33-94f9-ca56b082721e None None] SCRIPT_NAME: `/identity` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:10:39.721544 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10af921-79cb-4b33-94f9-ca56b082721e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:10:39.725477 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14a1cca-ae04-42b3-935a-6cf26a16e87e None admin] Validating token access rules against request {{(pid=144068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:10:39.748491 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.auth.core [None req-f10af921-79cb-4b33-94f9-ca56b082721e None None] MFA Rules not processed for user `bf5ceb8f07374635ad506b7d1b4f1612`. Rule list: `[]` (Enabled: `True`). {{(pid=144067) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 08:10:39.749805 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.fernet_utils [None req-f10af921-79cb-4b33-94f9-ca56b082721e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=144067) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:10:39.768643 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8888884f-0852-4a75-ae4b-e5bfea3c6c8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:10:39.769351 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8888884f-0852-4a75-ae4b-e5bfea3c6c8b None admin] REQUEST_METHOD: `GET` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:10:39.769647 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8888884f-0852-4a75-ae4b-e5bfea3c6c8b None admin] SCRIPT_NAME: `/identity` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:10:39.769934 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8888884f-0852-4a75-ae4b-e5bfea3c6c8b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:10:39.782369 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8888884f-0852-4a75-ae4b-e5bfea3c6c8b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 08:10:39.791279 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application [None req-8888884f-0852-4a75-ae4b-e5bfea3c6c8b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 08:10:39.791279 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:10:39.791279 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:10:39.791279 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:10:39.791279 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:10:39.791279 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:10:39.791279 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:10:39.791279 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:10:39.791279 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:10:39.791279 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:10:39.791279 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:10:39.791279 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:10:39.791279 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 08:10:39.791279 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 08:10:39.791279 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 08:10:39.791279 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 08:10:39.792288 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 08:10:39.792288 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 08:10:39.792288 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 08:10:39.792288 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 08:10:39.792288 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:10:39.792288 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:10:39.792288 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:10:39.792288 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:10:39.792288 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:10:39.792288 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:10:39.792288 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:10:39.792288 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application with Lock( Jul 28 08:10:39.792288 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:10:39.792288 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:10:39.792288 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:10:39.792288 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:10:39.793233 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:10:39.793233 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:10:39.793233 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:10:39.793233 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:10:39.793233 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 08:10:39.793233 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 08:10:39.793233 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 08:10:39.793233 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 08:10:39.793233 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 08:10:39.793233 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 08:10:39.793233 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 08:10:39.793233 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application Jul 28 08:10:39.793233 dv-cinder-851351-1-smb devstack@keystone.service[144068]: [pid: 144068|app: 0|req: 16/38] 10.222.0.42 () {56 vars in 1096 bytes} [Thu Jul 28 08:10:39 2022] GET /identity/v3/roles/admin => generated 83 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:10:39.795207 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8888884f-0852-4a75-ae4b-e5bfea3c6c8b None admin] Authenticating user token {{(pid=144068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:10:39.820614 dv-cinder-851351-1-smb devstack@keystone.service[144067]: [pid: 144067|app: 0|req: 23/39] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 08:10:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 28 08:10:39.821502 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f10af921-79cb-4b33-94f9-ca56b082721e None None] Authenticating user token {{(pid=144067) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:10:39.868765 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG dbcounter [-] [144067] Writing DB stats keystone:SELECT=100 {{(pid=144067) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:10:39.903503 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8888884f-0852-4a75-ae4b-e5bfea3c6c8b None admin] Validating token access rules against request {{(pid=144068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:10:39.926358 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f10af921-79cb-4b33-94f9-ca56b082721e None None] Validating token access rules against request {{(pid=144067) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:10:39.938141 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca15196-2a14-4cab-88f2-84ae3cc1a8a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:10:39.938801 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca15196-2a14-4cab-88f2-84ae3cc1a8a1 None admin] REQUEST_METHOD: `GET` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:10:39.939084 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca15196-2a14-4cab-88f2-84ae3cc1a8a1 None admin] SCRIPT_NAME: `/identity` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:10:39.939359 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca15196-2a14-4cab-88f2-84ae3cc1a8a1 None admin] PATH_INFO: `/v3/domains/default` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:10:39.940498 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca15196-2a14-4cab-88f2-84ae3cc1a8a1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:10:39.942037 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca15196-2a14-4cab-88f2-84ae3cc1a8a1 None admin] RBAC: Authorization granted {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:10:39.943961 dv-cinder-851351-1-smb devstack@keystone.service[144068]: [pid: 144068|app: 0|req: 17/40] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 08:10:39 2022] GET /identity/v3/domains/default => generated 199 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:10:39.944504 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca15196-2a14-4cab-88f2-84ae3cc1a8a1 None admin] Authenticating user token {{(pid=144068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:10:39.958736 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG dbcounter [-] [144068] Writing DB stats keystone:SELECT=100 {{(pid=144068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:10:39.962796 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-850badef-cc0c-4f16-b440-14964256a3bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144067) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:10:39.963454 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850badef-cc0c-4f16-b440-14964256a3bb None admin] REQUEST_METHOD: `GET` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:10:39.963743 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850badef-cc0c-4f16-b440-14964256a3bb None admin] SCRIPT_NAME: `/identity` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:10:39.964027 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850badef-cc0c-4f16-b440-14964256a3bb None admin] PATH_INFO: `/v3/roles` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:10:39.964812 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-850badef-cc0c-4f16-b440-14964256a3bb None admin] RBAC: Adding query filter params (name=admin) {{(pid=144067) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:10:39.965128 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-850badef-cc0c-4f16-b440-14964256a3bb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:10:39.966683 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-850badef-cc0c-4f16-b440-14964256a3bb None admin] RBAC: Authorization granted {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:10:39.975600 dv-cinder-851351-1-smb devstack@keystone.service[144067]: [pid: 144067|app: 0|req: 24/41] 10.222.0.42 () {56 vars in 1099 bytes} [Thu Jul 28 08:10:39 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:10:39.976418 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-850badef-cc0c-4f16-b440-14964256a3bb None admin] Authenticating user token {{(pid=144067) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:10:40.061655 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca15196-2a14-4cab-88f2-84ae3cc1a8a1 None admin] Validating token access rules against request {{(pid=144068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:10:40.090147 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-850badef-cc0c-4f16-b440-14964256a3bb None admin] Validating token access rules against request {{(pid=144067) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:10:40.098545 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG dbcounter [-] [144067] Writing DB stats keystone:SELECT=100 {{(pid=144067) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:10:40.100268 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7f3a49-73a9-4514-8eac-80e62c795d0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:10:40.101458 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7f3a49-73a9-4514-8eac-80e62c795d0b None admin] REQUEST_METHOD: `POST` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:10:40.101974 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7f3a49-73a9-4514-8eac-80e62c795d0b None admin] SCRIPT_NAME: `/identity` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:10:40.102300 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7f3a49-73a9-4514-8eac-80e62c795d0b None admin] PATH_INFO: `/v3/roles` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:10:40.103065 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef7f3a49-73a9-4514-8eac-80e62c795d0b None admin] RBAC: Authorizing `identity:create_role()` {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:10:40.104529 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef7f3a49-73a9-4514-8eac-80e62c795d0b None admin] RBAC: Authorization granted {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:10:40.121987 dv-cinder-851351-1-smb devstack@keystone.service[144068]: [pid: 144068|app: 0|req: 18/42] 10.222.0.42 () {60 vars in 1131 bytes} [Thu Jul 28 08:10:39 2022] POST /identity/v3/roles => generated 223 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 08:10:40.122864 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7f3a49-73a9-4514-8eac-80e62c795d0b None admin] Authenticating user token {{(pid=144068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:10:40.145079 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f04d5ec9-67a5-44b5-a045-b4d7e473c25b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144067) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:10:40.146241 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04d5ec9-67a5-44b5-a045-b4d7e473c25b None admin] REQUEST_METHOD: `POST` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:10:40.146600 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04d5ec9-67a5-44b5-a045-b4d7e473c25b None admin] SCRIPT_NAME: `/identity` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:10:40.146914 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04d5ec9-67a5-44b5-a045-b4d7e473c25b None admin] PATH_INFO: `/v3/projects` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:10:40.148123 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f04d5ec9-67a5-44b5-a045-b4d7e473c25b None admin] RBAC: Authorizing `identity:create_project()` {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:10:40.150706 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f04d5ec9-67a5-44b5-a045-b4d7e473c25b None admin] RBAC: Authorization granted {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:10:40.191268 dv-cinder-851351-1-smb devstack@keystone.service[144067]: [pid: 144067|app: 0|req: 25/43] 10.222.0.42 () {60 vars in 1141 bytes} [Thu Jul 28 08:10:39 2022] POST /identity/v3/projects => generated 312 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 08:10:40.216380 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG dbcounter [-] [144068] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=144068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:10:40.263335 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7f3a49-73a9-4514-8eac-80e62c795d0b None admin] Validating token access rules against request {{(pid=144068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:10:40.309373 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d75830-36bc-4bb6-9675-e1f69e4f5653 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:10:40.310057 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d75830-36bc-4bb6-9675-e1f69e4f5653 None admin] REQUEST_METHOD: `GET` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:10:40.310951 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d75830-36bc-4bb6-9675-e1f69e4f5653 None admin] SCRIPT_NAME: `/identity` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:10:40.310951 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d75830-36bc-4bb6-9675-e1f69e4f5653 None admin] PATH_INFO: `/v3/users/bf5ceb8f07374635ad506b7d1b4f1612` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:10:40.313538 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0d75830-36bc-4bb6-9675-e1f69e4f5653 None admin] RBAC: Authorizing `identity:get_user(user_id=bf5ceb8f07374635ad506b7d1b4f1612)` {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:10:40.316124 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0d75830-36bc-4bb6-9675-e1f69e4f5653 None admin] RBAC: Authorization granted {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:10:40.317165 dv-cinder-851351-1-smb devstack@keystone.service[144068]: [pid: 144068|app: 0|req: 19/44] 10.222.0.42 () {56 vars in 1177 bytes} [Thu Jul 28 08:10:40 2022] GET /identity/v3/users/bf5ceb8f07374635ad506b7d1b4f1612 => generated 247 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:10:40.322946 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f04d5ec9-67a5-44b5-a045-b4d7e473c25b None admin] Authenticating user token {{(pid=144067) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:10:40.434831 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f04d5ec9-67a5-44b5-a045-b4d7e473c25b None admin] Validating token access rules against request {{(pid=144067) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:10:40.477902 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c0b9e56-951b-4ec9-bca1-394dad737fe5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144067) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:10:40.478496 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0b9e56-951b-4ec9-bca1-394dad737fe5 None admin] REQUEST_METHOD: `GET` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:10:40.478787 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0b9e56-951b-4ec9-bca1-394dad737fe5 None admin] SCRIPT_NAME: `/identity` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:10:40.479074 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0b9e56-951b-4ec9-bca1-394dad737fe5 None admin] PATH_INFO: `/v3/domains/default` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:10:40.480310 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c0b9e56-951b-4ec9-bca1-394dad737fe5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:10:40.481894 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c0b9e56-951b-4ec9-bca1-394dad737fe5 None admin] RBAC: Authorization granted {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:10:40.483595 dv-cinder-851351-1-smb devstack@keystone.service[144067]: [pid: 144067|app: 0|req: 26/45] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 08:10:40 2022] GET /identity/v3/domains/default => generated 199 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:10:40.489501 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d75830-36bc-4bb6-9675-e1f69e4f5653 None admin] Authenticating user token {{(pid=144068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:10:40.599382 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d75830-36bc-4bb6-9675-e1f69e4f5653 None admin] Validating token access rules against request {{(pid=144068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:10:40.635983 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13688ab3-7587-4cce-a9ac-ed9f86810c59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:10:40.636703 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13688ab3-7587-4cce-a9ac-ed9f86810c59 None admin] REQUEST_METHOD: `PUT` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:10:40.637011 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13688ab3-7587-4cce-a9ac-ed9f86810c59 None admin] SCRIPT_NAME: `/identity` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:10:40.637293 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13688ab3-7587-4cce-a9ac-ed9f86810c59 None admin] PATH_INFO: `/v3/domains/default/users/bf5ceb8f07374635ad506b7d1b4f1612/roles/d1020e7bb0b7411d895ddedd6dc02c5b` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:10:40.639450 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13688ab3-7587-4cce-a9ac-ed9f86810c59 None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=bf5ceb8f07374635ad506b7d1b4f1612, role_id=d1020e7bb0b7411d895ddedd6dc02c5b)` {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:10:40.640989 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13688ab3-7587-4cce-a9ac-ed9f86810c59 None admin] RBAC: Authorization granted {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:10:40.646352 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG dbcounter [-] [144068] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=144068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:10:40.658379 dv-cinder-851351-1-smb devstack@keystone.service[144068]: [pid: 144068|app: 0|req: 20/46] 10.222.0.42 () {58 vars in 1361 bytes} [Thu Jul 28 08:10:40 2022] PUT /identity/v3/domains/default/users/bf5ceb8f07374635ad506b7d1b4f1612/roles/d1020e7bb0b7411d895ddedd6dc02c5b => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 08:10:42.220806 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195279d3-a3e4-4107-9b2d-65436fa5a966 None None] REQUEST_METHOD: `GET` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:10:42.221401 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195279d3-a3e4-4107-9b2d-65436fa5a966 None None] SCRIPT_NAME: `/identity` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:10:42.221401 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195279d3-a3e4-4107-9b2d-65436fa5a966 None None] PATH_INFO: `/` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:10:42.222943 dv-cinder-851351-1-smb devstack@keystone.service[144067]: [pid: 144067|app: 0|req: 27/47] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 08:10:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 08:10:42.228429 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba77ba6b-35c2-467e-9ccd-16ef0e977ef8 None None] REQUEST_METHOD: `POST` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:10:42.228954 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba77ba6b-35c2-467e-9ccd-16ef0e977ef8 None None] SCRIPT_NAME: `/identity` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:10:42.229047 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba77ba6b-35c2-467e-9ccd-16ef0e977ef8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:10:42.249302 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.auth.core [None req-ba77ba6b-35c2-467e-9ccd-16ef0e977ef8 None None] MFA Rules not processed for user `bf5ceb8f07374635ad506b7d1b4f1612`. Rule list: `[]` (Enabled: `True`). {{(pid=144068) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 08:10:42.250784 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.fernet_utils [None req-ba77ba6b-35c2-467e-9ccd-16ef0e977ef8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=144068) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:10:42.326543 dv-cinder-851351-1-smb devstack@keystone.service[144068]: [pid: 144068|app: 0|req: 21/48] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 08:10:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 08:10:42.353111 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195279d3-a3e4-4107-9b2d-65436fa5a966 None None] Authenticating user token {{(pid=144067) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:10:42.382873 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG dbcounter [-] [144067] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=144067) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:10:42.464327 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195279d3-a3e4-4107-9b2d-65436fa5a966 None None] Validating token access rules against request {{(pid=144067) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:10:42.500613 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da934815-6df7-458b-8e82-e5dd5d9c6cff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144067) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:10:42.501199 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da934815-6df7-458b-8e82-e5dd5d9c6cff None admin] REQUEST_METHOD: `GET` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:10:42.501482 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da934815-6df7-458b-8e82-e5dd5d9c6cff None admin] SCRIPT_NAME: `/identity` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:10:42.501763 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da934815-6df7-458b-8e82-e5dd5d9c6cff None admin] PATH_INFO: `/v3/domains/default` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:10:42.503029 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da934815-6df7-458b-8e82-e5dd5d9c6cff None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:10:42.504610 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da934815-6df7-458b-8e82-e5dd5d9c6cff None admin] RBAC: Authorization granted {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:10:42.506600 dv-cinder-851351-1-smb devstack@keystone.service[144067]: [pid: 144067|app: 0|req: 28/49] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 08:10:42 2022] GET /identity/v3/domains/default => generated 199 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:10:42.513959 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba77ba6b-35c2-467e-9ccd-16ef0e977ef8 None None] Authenticating user token {{(pid=144068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:10:42.616028 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba77ba6b-35c2-467e-9ccd-16ef0e977ef8 None None] Validating token access rules against request {{(pid=144068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:10:42.644510 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG dbcounter [-] [144068] Writing DB stats keystone:SELECT=100 {{(pid=144068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:10:42.655915 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af071abc-6c7e-49bf-9734-14bad53ace82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:10:42.656558 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af071abc-6c7e-49bf-9734-14bad53ace82 None admin] REQUEST_METHOD: `POST` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:10:42.656878 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af071abc-6c7e-49bf-9734-14bad53ace82 None admin] SCRIPT_NAME: `/identity` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:10:42.657157 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af071abc-6c7e-49bf-9734-14bad53ace82 None admin] PATH_INFO: `/v3/projects` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:10:42.657814 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5e12ea-3614-4299-a6fe-c6bc324a482c None None] REQUEST_METHOD: `GET` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:10:42.657927 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af071abc-6c7e-49bf-9734-14bad53ace82 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:10:42.658270 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5e12ea-3614-4299-a6fe-c6bc324a482c None None] SCRIPT_NAME: `/identity` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:10:42.658644 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5e12ea-3614-4299-a6fe-c6bc324a482c None None] PATH_INFO: `/` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:10:42.659337 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af071abc-6c7e-49bf-9734-14bad53ace82 None admin] RBAC: Authorization granted {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:10:42.660716 dv-cinder-851351-1-smb devstack@keystone.service[144067]: [pid: 144067|app: 0|req: 29/50] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 08:10:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 08:10:42.665924 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8446d4a4-2e38-4de4-85dc-9459f15e213f None None] REQUEST_METHOD: `POST` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:10:42.665924 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8446d4a4-2e38-4de4-85dc-9459f15e213f None None] SCRIPT_NAME: `/identity` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:10:42.666148 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8446d4a4-2e38-4de4-85dc-9459f15e213f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:10:42.687195 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.auth.core [None req-8446d4a4-2e38-4de4-85dc-9459f15e213f None None] MFA Rules not processed for user `bf5ceb8f07374635ad506b7d1b4f1612`. Rule list: `[]` (Enabled: `True`). {{(pid=144067) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 08:10:42.688485 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.fernet_utils [None req-8446d4a4-2e38-4de4-85dc-9459f15e213f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=144067) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:10:42.689103 dv-cinder-851351-1-smb devstack@keystone.service[144068]: [pid: 144068|app: 0|req: 22/51] 10.222.0.42 () {60 vars in 1140 bytes} [Thu Jul 28 08:10:42 2022] POST /identity/v3/projects => generated 298 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 08:10:42.776947 dv-cinder-851351-1-smb devstack@keystone.service[144067]: [pid: 144067|app: 0|req: 30/52] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 08:10:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 08:10:42.800721 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af071abc-6c7e-49bf-9734-14bad53ace82 None admin] Authenticating user token {{(pid=144068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:10:42.918332 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af071abc-6c7e-49bf-9734-14bad53ace82 None admin] Validating token access rules against request {{(pid=144068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:10:42.959087 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-931f6cfa-b410-45a4-961e-9fa1a43bd54b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:10:42.960088 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931f6cfa-b410-45a4-961e-9fa1a43bd54b None admin] REQUEST_METHOD: `GET` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:10:42.960370 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931f6cfa-b410-45a4-961e-9fa1a43bd54b None admin] SCRIPT_NAME: `/identity` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:10:42.960649 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931f6cfa-b410-45a4-961e-9fa1a43bd54b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:10:42.972703 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-931f6cfa-b410-45a4-961e-9fa1a43bd54b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 08:10:42.980579 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application [None req-931f6cfa-b410-45a4-961e-9fa1a43bd54b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 08:10:42.980579 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:10:42.980579 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:10:42.980579 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:10:42.980579 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:10:42.980579 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:10:42.980579 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:10:42.980579 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:10:42.980579 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:10:42.980579 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:10:42.980579 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:10:42.980579 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:10:42.980579 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 08:10:42.980579 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 08:10:42.980579 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 08:10:42.980579 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 08:10:42.981770 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 08:10:42.981770 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 08:10:42.981770 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 08:10:42.981770 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 08:10:42.981770 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:10:42.981770 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:10:42.981770 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:10:42.981770 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:10:42.981770 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:10:42.981770 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:10:42.981770 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:10:42.981770 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application with Lock( Jul 28 08:10:42.981770 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:10:42.981770 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:10:42.981770 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:10:42.981770 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:10:42.988129 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:10:42.988129 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:10:42.988129 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:10:42.988129 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:10:42.988129 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 08:10:42.988129 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 08:10:42.988129 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 08:10:42.988129 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 08:10:42.988129 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 08:10:42.988129 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 08:10:42.988129 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 08:10:42.988129 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application Jul 28 08:10:42.988129 dv-cinder-851351-1-smb devstack@keystone.service[144068]: [pid: 144068|app: 0|req: 23/53] 10.222.0.42 () {56 vars in 1096 bytes} [Thu Jul 28 08:10:42 2022] GET /identity/v3/roles/admin => generated 83 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:10:42.989530 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8446d4a4-2e38-4de4-85dc-9459f15e213f None None] Authenticating user token {{(pid=144067) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:10:43.015825 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG dbcounter [-] [144067] Writing DB stats keystone:SELECT=100 {{(pid=144067) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:10:43.102741 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8446d4a4-2e38-4de4-85dc-9459f15e213f None None] Validating token access rules against request {{(pid=144067) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:10:43.139786 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff9fb31a-303e-4494-8583-f6d3b90e0462 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144067) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:10:43.140443 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9fb31a-303e-4494-8583-f6d3b90e0462 None admin] REQUEST_METHOD: `GET` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:10:43.140756 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9fb31a-303e-4494-8583-f6d3b90e0462 None admin] SCRIPT_NAME: `/identity` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:10:43.141054 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9fb31a-303e-4494-8583-f6d3b90e0462 None admin] PATH_INFO: `/v3/roles` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:10:43.141794 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff9fb31a-303e-4494-8583-f6d3b90e0462 None admin] RBAC: Adding query filter params (name=admin) {{(pid=144067) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:10:43.142107 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff9fb31a-303e-4494-8583-f6d3b90e0462 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:10:43.143570 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff9fb31a-303e-4494-8583-f6d3b90e0462 None admin] RBAC: Authorization granted {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:10:43.152876 dv-cinder-851351-1-smb devstack@keystone.service[144067]: [pid: 144067|app: 0|req: 31/54] 10.222.0.42 () {56 vars in 1099 bytes} [Thu Jul 28 08:10:42 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:10:43.158510 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-931f6cfa-b410-45a4-961e-9fa1a43bd54b None admin] Authenticating user token {{(pid=144068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:10:43.202138 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG dbcounter [-] [144068] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=144068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:10:43.266034 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-931f6cfa-b410-45a4-961e-9fa1a43bd54b None admin] Validating token access rules against request {{(pid=144068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:10:43.303108 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34375e94-c777-4492-bbc5-0144704e79c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:10:43.303769 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34375e94-c777-4492-bbc5-0144704e79c6 None admin] REQUEST_METHOD: `GET` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:10:43.304055 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34375e94-c777-4492-bbc5-0144704e79c6 None admin] SCRIPT_NAME: `/identity` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:10:43.304334 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34375e94-c777-4492-bbc5-0144704e79c6 None admin] PATH_INFO: `/v3/users/bf5ceb8f07374635ad506b7d1b4f1612` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:10:43.305621 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34375e94-c777-4492-bbc5-0144704e79c6 None admin] RBAC: Authorizing `identity:get_user(user_id=bf5ceb8f07374635ad506b7d1b4f1612)` {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:10:43.307092 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34375e94-c777-4492-bbc5-0144704e79c6 None admin] RBAC: Authorization granted {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:10:43.308751 dv-cinder-851351-1-smb devstack@keystone.service[144068]: [pid: 144068|app: 0|req: 24/55] 10.222.0.42 () {56 vars in 1177 bytes} [Thu Jul 28 08:10:43 2022] GET /identity/v3/users/bf5ceb8f07374635ad506b7d1b4f1612 => generated 247 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:10:43.314625 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff9fb31a-303e-4494-8583-f6d3b90e0462 None admin] Authenticating user token {{(pid=144067) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:10:43.406035 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG dbcounter [-] [144067] Writing DB stats keystone:SELECT=100 {{(pid=144067) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:10:43.424854 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff9fb31a-303e-4494-8583-f6d3b90e0462 None admin] Validating token access rules against request {{(pid=144067) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:10:43.461306 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e15874c-4d4e-4fe3-a96a-3ab6602ac203 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144067) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:10:43.461959 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e15874c-4d4e-4fe3-a96a-3ab6602ac203 None admin] REQUEST_METHOD: `GET` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:10:43.462241 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e15874c-4d4e-4fe3-a96a-3ab6602ac203 None admin] SCRIPT_NAME: `/identity` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:10:43.462514 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e15874c-4d4e-4fe3-a96a-3ab6602ac203 None admin] PATH_INFO: `/v3/domains/default` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:10:43.463696 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e15874c-4d4e-4fe3-a96a-3ab6602ac203 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:10:43.465227 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e15874c-4d4e-4fe3-a96a-3ab6602ac203 None admin] RBAC: Authorization granted {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:10:43.466837 dv-cinder-851351-1-smb devstack@keystone.service[144067]: [pid: 144067|app: 0|req: 32/56] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 08:10:43 2022] GET /identity/v3/domains/default => generated 199 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:10:43.472867 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34375e94-c777-4492-bbc5-0144704e79c6 None admin] Authenticating user token {{(pid=144068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:10:43.577964 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34375e94-c777-4492-bbc5-0144704e79c6 None admin] Validating token access rules against request {{(pid=144068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:10:43.585872 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG dbcounter [-] [144068] Writing DB stats keystone:SELECT=100 {{(pid=144068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:10:43.617062 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f0ecf2-17ec-43e6-a383-461953ec3786 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:10:43.618151 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f0ecf2-17ec-43e6-a383-461953ec3786 None admin] REQUEST_METHOD: `GET` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:10:43.618617 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f0ecf2-17ec-43e6-a383-461953ec3786 None admin] SCRIPT_NAME: `/identity` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:10:43.619028 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f0ecf2-17ec-43e6-a383-461953ec3786 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:10:43.620506 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05f0ecf2-17ec-43e6-a383-461953ec3786 None admin] RBAC: Adding query filter params (role.id=d1020e7bb0b7411d895ddedd6dc02c5b, scope.domain.id=default, user.id=bf5ceb8f07374635ad506b7d1b4f1612) {{(pid=144068) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:10:43.621061 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05f0ecf2-17ec-43e6-a383-461953ec3786 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:10:43.623851 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05f0ecf2-17ec-43e6-a383-461953ec3786 None admin] RBAC: Authorization granted {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:10:43.634886 dv-cinder-851351-1-smb devstack@keystone.service[144068]: [pid: 144068|app: 0|req: 25/57] 10.222.0.42 () {56 vars in 1322 bytes} [Thu Jul 28 08:10:43 2022] GET /identity/v3/role_assignments?user.id=bf5ceb8f07374635ad506b7d1b4f1612&scope.domain.id=default&role.id=d1020e7bb0b7411d895ddedd6dc02c5b => generated 530 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:10:44.723652 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6bd6cd-af99-4fce-9b5a-d9a5b8a7f073 None None] REQUEST_METHOD: `GET` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:10:44.724246 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6bd6cd-af99-4fce-9b5a-d9a5b8a7f073 None None] SCRIPT_NAME: `/identity` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:10:44.724246 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6bd6cd-af99-4fce-9b5a-d9a5b8a7f073 None None] PATH_INFO: `/` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:10:44.725656 dv-cinder-851351-1-smb devstack@keystone.service[144067]: [pid: 144067|app: 0|req: 33/58] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 08:10:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 08:10:44.731158 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac5fd7a-1ab1-42a2-8a9d-0d99825c1b22 None None] REQUEST_METHOD: `POST` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:10:44.731541 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac5fd7a-1ab1-42a2-8a9d-0d99825c1b22 None None] SCRIPT_NAME: `/identity` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:10:44.731730 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac5fd7a-1ab1-42a2-8a9d-0d99825c1b22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:10:44.751292 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.auth.core [None req-1ac5fd7a-1ab1-42a2-8a9d-0d99825c1b22 None None] MFA Rules not processed for user `bf5ceb8f07374635ad506b7d1b4f1612`. Rule list: `[]` (Enabled: `True`). {{(pid=144068) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 08:10:44.752523 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.fernet_utils [None req-1ac5fd7a-1ab1-42a2-8a9d-0d99825c1b22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=144068) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:10:44.823677 dv-cinder-851351-1-smb devstack@keystone.service[144068]: [pid: 144068|app: 0|req: 26/59] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 08:10:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 08:10:44.847984 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb6bd6cd-af99-4fce-9b5a-d9a5b8a7f073 None None] Authenticating user token {{(pid=144067) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:10:44.957596 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb6bd6cd-af99-4fce-9b5a-d9a5b8a7f073 None None] Validating token access rules against request {{(pid=144067) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:10:44.995944 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462fed04-823d-40f4-973b-2a3e36eea2a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144067) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:10:44.996611 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462fed04-823d-40f4-973b-2a3e36eea2a4 None admin] REQUEST_METHOD: `GET` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:10:44.996929 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462fed04-823d-40f4-973b-2a3e36eea2a4 None admin] SCRIPT_NAME: `/identity` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:10:44.997210 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462fed04-823d-40f4-973b-2a3e36eea2a4 None admin] PATH_INFO: `/v3/domains/default` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:10:44.998417 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-462fed04-823d-40f4-973b-2a3e36eea2a4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:10:44.999901 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-462fed04-823d-40f4-973b-2a3e36eea2a4 None admin] RBAC: Authorization granted {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:10:45.001583 dv-cinder-851351-1-smb devstack@keystone.service[144067]: [pid: 144067|app: 0|req: 34/60] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 08:10:44 2022] GET /identity/v3/domains/default => generated 199 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:10:45.007830 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac5fd7a-1ab1-42a2-8a9d-0d99825c1b22 None None] Authenticating user token {{(pid=144068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:10:45.111949 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG dbcounter [-] [144068] Writing DB stats keystone:SELECT=100 {{(pid=144068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:10:45.115121 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac5fd7a-1ab1-42a2-8a9d-0d99825c1b22 None None] Validating token access rules against request {{(pid=144068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:10:45.150575 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384a2898-0e3e-41d3-899d-242229266565 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:10:45.151211 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384a2898-0e3e-41d3-899d-242229266565 None admin] REQUEST_METHOD: `POST` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:10:45.151496 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384a2898-0e3e-41d3-899d-242229266565 None admin] SCRIPT_NAME: `/identity` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:10:45.151770 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384a2898-0e3e-41d3-899d-242229266565 None admin] PATH_INFO: `/v3/users` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:10:45.152462 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-384a2898-0e3e-41d3-899d-242229266565 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:10:45.153974 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-384a2898-0e3e-41d3-899d-242229266565 None admin] RBAC: Authorization granted {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:10:45.182875 dv-cinder-851351-1-smb devstack@keystone.service[144068]: [pid: 144068|app: 0|req: 27/61] 10.222.0.42 () {60 vars in 1132 bytes} [Thu Jul 28 08:10:45 2022] POST /identity/v3/users => generated 275 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 08:10:48.122503 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec925bf2-49fb-4c3c-8e7d-7ed62fb72d7d None None] REQUEST_METHOD: `GET` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:10:48.123549 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec925bf2-49fb-4c3c-8e7d-7ed62fb72d7d None None] SCRIPT_NAME: `/identity` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:10:48.124071 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec925bf2-49fb-4c3c-8e7d-7ed62fb72d7d None None] PATH_INFO: `/` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:10:48.125731 dv-cinder-851351-1-smb devstack@keystone.service[144067]: [pid: 144067|app: 0|req: 35/62] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 08:10:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 08:10:48.131204 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d023fd-68bc-4df1-86c9-6bb0bea13f91 None None] REQUEST_METHOD: `POST` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:10:48.131649 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d023fd-68bc-4df1-86c9-6bb0bea13f91 None None] SCRIPT_NAME: `/identity` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:10:48.131768 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d023fd-68bc-4df1-86c9-6bb0bea13f91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:10:48.157722 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.auth.core [None req-68d023fd-68bc-4df1-86c9-6bb0bea13f91 None None] MFA Rules not processed for user `bf5ceb8f07374635ad506b7d1b4f1612`. Rule list: `[]` (Enabled: `True`). {{(pid=144068) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 08:10:48.159324 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.fernet_utils [None req-68d023fd-68bc-4df1-86c9-6bb0bea13f91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=144068) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:10:48.233088 dv-cinder-851351-1-smb devstack@keystone.service[144068]: [pid: 144068|app: 0|req: 28/63] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 08:10:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 08:10:48.276025 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec925bf2-49fb-4c3c-8e7d-7ed62fb72d7d None None] Authenticating user token {{(pid=144067) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:10:48.315659 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG dbcounter [-] [144067] Writing DB stats keystone:SELECT=100 {{(pid=144067) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:10:48.400282 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec925bf2-49fb-4c3c-8e7d-7ed62fb72d7d None None] Validating token access rules against request {{(pid=144067) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:10:48.435031 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5212832-099f-462f-9d9e-07143d5b59aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144067) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:10:48.437294 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e87ded7-01a7-447d-8a3f-d4aff5daf641 None None] REQUEST_METHOD: `GET` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:10:48.437781 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e87ded7-01a7-447d-8a3f-d4aff5daf641 None None] SCRIPT_NAME: `/identity` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:10:48.438206 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e87ded7-01a7-447d-8a3f-d4aff5daf641 None None] PATH_INFO: `/` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:10:48.440032 dv-cinder-851351-1-smb devstack@keystone.service[144068]: [pid: 144068|app: 0|req: 29/64] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 08:10:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 08:10:48.440821 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5212832-099f-462f-9d9e-07143d5b59aa None admin] REQUEST_METHOD: `GET` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:10:48.441297 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5212832-099f-462f-9d9e-07143d5b59aa None admin] SCRIPT_NAME: `/identity` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:10:48.441794 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5212832-099f-462f-9d9e-07143d5b59aa None admin] PATH_INFO: `/v3/roles/admin` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:10:48.445775 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784f39ad-1be4-4d73-ad83-420341ee4fea None None] REQUEST_METHOD: `POST` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:10:48.446316 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784f39ad-1be4-4d73-ad83-420341ee4fea None None] SCRIPT_NAME: `/identity` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:10:48.446774 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784f39ad-1be4-4d73-ad83-420341ee4fea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:10:48.466521 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.auth.core [None req-784f39ad-1be4-4d73-ad83-420341ee4fea None None] MFA Rules not processed for user `bf5ceb8f07374635ad506b7d1b4f1612`. Rule list: `[]` (Enabled: `True`). {{(pid=144068) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 08:10:48.468546 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.fernet_utils [None req-784f39ad-1be4-4d73-ad83-420341ee4fea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=144068) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:10:48.475373 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5212832-099f-462f-9d9e-07143d5b59aa None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 08:10:48.489395 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application [None req-b5212832-099f-462f-9d9e-07143d5b59aa None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 08:10:48.489395 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:10:48.489395 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:10:48.489395 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:10:48.489395 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:10:48.489395 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:10:48.489395 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:10:48.489395 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:10:48.489395 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:10:48.489395 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:10:48.489395 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:10:48.489395 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:10:48.489395 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 08:10:48.489395 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 08:10:48.489395 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 08:10:48.489395 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 08:10:48.490459 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 08:10:48.490459 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 08:10:48.490459 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 08:10:48.490459 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 08:10:48.490459 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:10:48.490459 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:10:48.490459 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:10:48.490459 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:10:48.490459 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:10:48.490459 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:10:48.490459 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:10:48.490459 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application with Lock( Jul 28 08:10:48.490459 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:10:48.490459 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:10:48.490459 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:10:48.490459 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:10:48.491332 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:10:48.491332 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:10:48.491332 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:10:48.491332 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:10:48.491332 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 08:10:48.491332 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 08:10:48.491332 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 08:10:48.491332 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 08:10:48.491332 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 08:10:48.491332 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 08:10:48.491332 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 08:10:48.491332 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application Jul 28 08:10:48.491332 dv-cinder-851351-1-smb devstack@keystone.service[144067]: [pid: 144067|app: 0|req: 36/65] 10.222.0.42 () {56 vars in 1096 bytes} [Thu Jul 28 08:10:48 2022] GET /identity/v3/roles/admin => generated 83 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:10:48.500584 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5212832-099f-462f-9d9e-07143d5b59aa None admin] Authenticating user token {{(pid=144067) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:10:48.555393 dv-cinder-851351-1-smb devstack@keystone.service[144068]: [pid: 144068|app: 0|req: 30/66] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 08:10:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 28 08:10:48.586718 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784f39ad-1be4-4d73-ad83-420341ee4fea None None] Authenticating user token {{(pid=144068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:10:48.606089 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG dbcounter [-] [144068] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=144068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:10:48.660594 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG dbcounter [-] [144067] Writing DB stats keystone:SELECT=100 {{(pid=144067) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:10:48.693564 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5212832-099f-462f-9d9e-07143d5b59aa None admin] Validating token access rules against request {{(pid=144067) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:10:48.732260 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a4e726-7256-4377-a492-94408c66e6b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144067) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:10:48.733445 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a4e726-7256-4377-a492-94408c66e6b0 None admin] REQUEST_METHOD: `GET` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:10:48.734225 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a4e726-7256-4377-a492-94408c66e6b0 None admin] SCRIPT_NAME: `/identity` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:10:48.734954 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a4e726-7256-4377-a492-94408c66e6b0 None admin] PATH_INFO: `/v3/roles` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:10:48.736058 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32a4e726-7256-4377-a492-94408c66e6b0 None admin] RBAC: Adding query filter params (name=admin) {{(pid=144067) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:10:48.736558 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32a4e726-7256-4377-a492-94408c66e6b0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:10:48.738685 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32a4e726-7256-4377-a492-94408c66e6b0 None admin] RBAC: Authorization granted {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:10:48.743537 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784f39ad-1be4-4d73-ad83-420341ee4fea None None] Validating token access rules against request {{(pid=144068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:10:48.750055 dv-cinder-851351-1-smb devstack@keystone.service[144067]: [pid: 144067|app: 0|req: 37/67] 10.222.0.42 () {56 vars in 1099 bytes} [Thu Jul 28 08:10:48 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:10:48.751788 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec59ceec-f2c7-4af2-b470-1f33d10825e6 None None] REQUEST_METHOD: `GET` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:10:48.752303 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec59ceec-f2c7-4af2-b470-1f33d10825e6 None None] SCRIPT_NAME: `/identity` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:10:48.753269 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec59ceec-f2c7-4af2-b470-1f33d10825e6 None None] PATH_INFO: `/` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:10:48.755557 dv-cinder-851351-1-smb devstack@keystone.service[144067]: [pid: 144067|app: 0|req: 38/68] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 08:10:48 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 08:10:48.759965 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec59ceec-f2c7-4af2-b470-1f33d10825e6 None None] Authenticating user token {{(pid=144067) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:10:48.790203 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eecca44e-e618-4f8b-bd5d-d9d55687e869 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:10:48.790886 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eecca44e-e618-4f8b-bd5d-d9d55687e869 None admin] REQUEST_METHOD: `GET` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:10:48.791178 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eecca44e-e618-4f8b-bd5d-d9d55687e869 None admin] SCRIPT_NAME: `/identity` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:10:48.791457 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eecca44e-e618-4f8b-bd5d-d9d55687e869 None admin] PATH_INFO: `/v3/roles/member` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:10:48.806071 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eecca44e-e618-4f8b-bd5d-d9d55687e869 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 08:10:48.812182 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application [None req-eecca44e-e618-4f8b-bd5d-d9d55687e869 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 28 08:10:48.812182 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:10:48.812182 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:10:48.812182 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:10:48.812182 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:10:48.812182 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:10:48.812182 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:10:48.812182 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:10:48.812182 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:10:48.812182 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:10:48.812182 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:10:48.812182 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:10:48.812182 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 08:10:48.812182 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 08:10:48.812182 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 08:10:48.812182 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 08:10:48.813466 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 08:10:48.813466 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 08:10:48.813466 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 08:10:48.813466 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 08:10:48.813466 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:10:48.813466 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:10:48.813466 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:10:48.813466 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:10:48.813466 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:10:48.813466 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:10:48.813466 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:10:48.813466 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application with Lock( Jul 28 08:10:48.813466 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:10:48.813466 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:10:48.813466 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:10:48.813466 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:10:48.814384 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:10:48.814384 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:10:48.814384 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:10:48.814384 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:10:48.814384 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 08:10:48.814384 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 08:10:48.814384 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 08:10:48.814384 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 08:10:48.814384 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 08:10:48.814384 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 08:10:48.814384 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 28 08:10:48.814384 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application Jul 28 08:10:48.817035 dv-cinder-851351-1-smb devstack@keystone.service[144068]: [pid: 144068|app: 0|req: 31/69] 10.222.0.42 () {56 vars in 1099 bytes} [Thu Jul 28 08:10:48 2022] GET /identity/v3/roles/member => generated 84 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 08:10:48.823092 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9118b97b-fcde-426a-91e8-cb93ff309ea8 None None] REQUEST_METHOD: `POST` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:10:48.823092 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9118b97b-fcde-426a-91e8-cb93ff309ea8 None None] SCRIPT_NAME: `/identity` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:10:48.823092 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9118b97b-fcde-426a-91e8-cb93ff309ea8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:10:48.842753 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.auth.core [None req-9118b97b-fcde-426a-91e8-cb93ff309ea8 None None] MFA Rules not processed for user `bf5ceb8f07374635ad506b7d1b4f1612`. Rule list: `[]` (Enabled: `True`). {{(pid=144068) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 08:10:48.844806 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.fernet_utils [None req-9118b97b-fcde-426a-91e8-cb93ff309ea8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=144068) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:10:48.891875 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec59ceec-f2c7-4af2-b470-1f33d10825e6 None None] Validating token access rules against request {{(pid=144067) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:10:48.929189 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb990ad-9ebf-4216-90de-4a17f7ba5616 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144067) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:10:48.930267 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb990ad-9ebf-4216-90de-4a17f7ba5616 None admin] REQUEST_METHOD: `GET` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:10:48.930785 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb990ad-9ebf-4216-90de-4a17f7ba5616 None admin] SCRIPT_NAME: `/identity` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:10:48.931288 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb990ad-9ebf-4216-90de-4a17f7ba5616 None admin] PATH_INFO: `/v3/users/bf5ceb8f07374635ad506b7d1b4f1612` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:10:48.932097 dv-cinder-851351-1-smb devstack@keystone.service[144068]: [pid: 144068|app: 0|req: 32/70] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 08:10:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 08:10:48.932855 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eb990ad-9ebf-4216-90de-4a17f7ba5616 None admin] RBAC: Authorizing `identity:get_user(user_id=bf5ceb8f07374635ad506b7d1b4f1612)` {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:10:48.933257 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9118b97b-fcde-426a-91e8-cb93ff309ea8 None None] Authenticating user token {{(pid=144068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:10:48.934695 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eb990ad-9ebf-4216-90de-4a17f7ba5616 None admin] RBAC: Authorization granted {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:10:48.936450 dv-cinder-851351-1-smb devstack@keystone.service[144067]: [pid: 144067|app: 0|req: 39/71] 10.222.0.42 () {56 vars in 1177 bytes} [Thu Jul 28 08:10:48 2022] GET /identity/v3/users/bf5ceb8f07374635ad506b7d1b4f1612 => generated 247 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:10:48.937842 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d069eb-2bfc-4c92-a428-fc423357d50c None None] REQUEST_METHOD: `GET` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:10:48.938347 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d069eb-2bfc-4c92-a428-fc423357d50c None None] SCRIPT_NAME: `/identity` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:10:48.938864 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d069eb-2bfc-4c92-a428-fc423357d50c None None] PATH_INFO: `/` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:10:48.940305 dv-cinder-851351-1-smb devstack@keystone.service[144067]: [pid: 144067|app: 0|req: 40/72] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 08:10:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 08:10:48.943628 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d069eb-2bfc-4c92-a428-fc423357d50c None None] Authenticating user token {{(pid=144067) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:10:48.954049 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG dbcounter [-] [144068] Writing DB stats keystone:SELECT=100 {{(pid=144068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:10:48.963180 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG dbcounter [-] [144067] Writing DB stats keystone:SELECT=100 {{(pid=144067) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:10:49.053646 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9118b97b-fcde-426a-91e8-cb93ff309ea8 None None] Validating token access rules against request {{(pid=144068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:10:49.070879 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d069eb-2bfc-4c92-a428-fc423357d50c None None] Validating token access rules against request {{(pid=144067) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:10:49.090153 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67311990-74d2-4369-8f92-a25a68d28b01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:10:49.090790 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67311990-74d2-4369-8f92-a25a68d28b01 None admin] REQUEST_METHOD: `GET` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:10:49.091078 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67311990-74d2-4369-8f92-a25a68d28b01 None admin] SCRIPT_NAME: `/identity` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:10:49.091367 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67311990-74d2-4369-8f92-a25a68d28b01 None admin] PATH_INFO: `/v3/roles` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:10:49.092108 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67311990-74d2-4369-8f92-a25a68d28b01 None admin] RBAC: Adding query filter params (name=member) {{(pid=144068) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:10:49.092417 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67311990-74d2-4369-8f92-a25a68d28b01 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:10:49.093909 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67311990-74d2-4369-8f92-a25a68d28b01 None admin] RBAC: Authorization granted {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:10:49.105186 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-472c5a4e-988e-4d96-86f6-29cbef6c60a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144067) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:10:49.105824 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472c5a4e-988e-4d96-86f6-29cbef6c60a8 None admin] REQUEST_METHOD: `GET` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:10:49.106074 dv-cinder-851351-1-smb devstack@keystone.service[144068]: [pid: 144068|app: 0|req: 33/73] 10.222.0.42 () {56 vars in 1101 bytes} [Thu Jul 28 08:10:48 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:10:49.106414 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472c5a4e-988e-4d96-86f6-29cbef6c60a8 None admin] SCRIPT_NAME: `/identity` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:10:49.106700 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472c5a4e-988e-4d96-86f6-29cbef6c60a8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:10:49.107392 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e55ce21-7271-4b9a-869d-82065853fe50 None None] REQUEST_METHOD: `POST` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:10:49.107690 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e55ce21-7271-4b9a-869d-82065853fe50 None None] SCRIPT_NAME: `/identity` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:10:49.107972 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e55ce21-7271-4b9a-869d-82065853fe50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:10:49.128066 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.auth.core [None req-0e55ce21-7271-4b9a-869d-82065853fe50 None None] MFA Rules not processed for user `bf5ceb8f07374635ad506b7d1b4f1612`. Rule list: `[]` (Enabled: `True`). {{(pid=144068) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 08:10:49.129340 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.fernet_utils [None req-0e55ce21-7271-4b9a-869d-82065853fe50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=144068) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:10:49.173651 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-472c5a4e-988e-4d96-86f6-29cbef6c60a8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:10:49.175196 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-472c5a4e-988e-4d96-86f6-29cbef6c60a8 None admin] RBAC: Authorization granted {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:10:49.189206 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG dbcounter [-] [144067] Writing DB stats keystone:SELECT=100 {{(pid=144067) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:10:49.192931 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG dbcounter [-] [144068] Writing DB stats keystone:SELECT=100 {{(pid=144068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:10:49.212688 dv-cinder-851351-1-smb devstack@keystone.service[144068]: [pid: 144068|app: 0|req: 34/74] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 08:10:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 08:10:49.212688 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e55ce21-7271-4b9a-869d-82065853fe50 None None] Authenticating user token {{(pid=144068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:10:49.282138 dv-cinder-851351-1-smb devstack@keystone.service[144067]: [pid: 144067|app: 0|req: 41/75] 10.222.0.42 () {58 vars in 1282 bytes} [Thu Jul 28 08:10:48 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 28 08:10:49.283453 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7694009b-be36-4feb-ba91-6f8f533e934d None None] REQUEST_METHOD: `GET` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:10:49.283752 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7694009b-be36-4feb-ba91-6f8f533e934d None None] SCRIPT_NAME: `/identity` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:10:49.284039 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7694009b-be36-4feb-ba91-6f8f533e934d None None] PATH_INFO: `/` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:10:49.285555 dv-cinder-851351-1-smb devstack@keystone.service[144067]: [pid: 144067|app: 0|req: 42/76] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 08:10:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 08:10:49.286108 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7694009b-be36-4feb-ba91-6f8f533e934d None None] Authenticating user token {{(pid=144067) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:10:49.304301 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e55ce21-7271-4b9a-869d-82065853fe50 None None] Validating token access rules against request {{(pid=144068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:10:49.340490 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41dd94aa-66df-4ca5-9255-6cbf40395064 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:10:49.341223 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41dd94aa-66df-4ca5-9255-6cbf40395064 None admin] REQUEST_METHOD: `GET` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:10:49.341490 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41dd94aa-66df-4ca5-9255-6cbf40395064 None admin] SCRIPT_NAME: `/identity` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:10:49.341754 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41dd94aa-66df-4ca5-9255-6cbf40395064 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:10:49.352376 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41dd94aa-66df-4ca5-9255-6cbf40395064 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 08:10:49.357371 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application [None req-41dd94aa-66df-4ca5-9255-6cbf40395064 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 28 08:10:49.357371 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:10:49.357371 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:10:49.357371 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:10:49.357371 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:10:49.357371 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:10:49.357371 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:10:49.357371 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:10:49.357371 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:10:49.357371 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:10:49.357371 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:10:49.357371 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:10:49.357371 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 08:10:49.357371 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 08:10:49.357371 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 08:10:49.357371 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 08:10:49.365823 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 08:10:49.365823 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 08:10:49.365823 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 08:10:49.365823 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 08:10:49.365823 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:10:49.365823 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:10:49.365823 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:10:49.365823 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:10:49.365823 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:10:49.365823 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:10:49.365823 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:10:49.365823 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application with Lock( Jul 28 08:10:49.365823 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:10:49.365823 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:10:49.365823 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:10:49.365823 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:10:49.366925 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:10:49.366925 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:10:49.366925 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:10:49.366925 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:10:49.366925 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 08:10:49.366925 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 08:10:49.366925 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 08:10:49.366925 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 08:10:49.366925 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 08:10:49.366925 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 08:10:49.366925 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 28 08:10:49.366925 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application Jul 28 08:10:49.366925 dv-cinder-851351-1-smb devstack@keystone.service[144068]: [pid: 144068|app: 0|req: 35/77] 10.222.0.42 () {56 vars in 1114 bytes} [Thu Jul 28 08:10:49 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:10:49.366925 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41dd94aa-66df-4ca5-9255-6cbf40395064 None admin] Authenticating user token {{(pid=144068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:10:49.402869 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7694009b-be36-4feb-ba91-6f8f533e934d None None] Validating token access rules against request {{(pid=144067) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:10:49.416579 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG dbcounter [-] [144067] Writing DB stats keystone:SELECT=100 {{(pid=144067) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:10:49.419623 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG dbcounter [-] [144068] Writing DB stats keystone:SELECT=100 {{(pid=144068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:10:49.439786 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d19bad-9e9a-4a15-843c-873e120c010e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144067) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:10:49.440443 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d19bad-9e9a-4a15-843c-873e120c010e None admin] REQUEST_METHOD: `GET` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:10:49.440758 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d19bad-9e9a-4a15-843c-873e120c010e None admin] SCRIPT_NAME: `/identity` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:10:49.441039 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d19bad-9e9a-4a15-843c-873e120c010e None admin] PATH_INFO: `/v3/users/fbc36457370441478a0d13a56c8e0351` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:10:49.455688 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d19bad-9e9a-4a15-843c-873e120c010e None admin] RBAC: Authorizing `identity:get_user(user_id=fbc36457370441478a0d13a56c8e0351)` {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:10:49.457324 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d19bad-9e9a-4a15-843c-873e120c010e None admin] RBAC: Authorization granted {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:10:49.459079 dv-cinder-851351-1-smb devstack@keystone.service[144067]: [pid: 144067|app: 0|req: 43/78] 10.222.0.42 () {56 vars in 1177 bytes} [Thu Jul 28 08:10:49 2022] GET /identity/v3/users/fbc36457370441478a0d13a56c8e0351 => generated 275 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:10:49.464113 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d19bad-9e9a-4a15-843c-873e120c010e None admin] Authenticating user token {{(pid=144067) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:10:49.467969 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41dd94aa-66df-4ca5-9255-6cbf40395064 None admin] Validating token access rules against request {{(pid=144068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:10:49.502840 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3eee8c5-740b-46c9-ba24-676366574c82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:10:49.503509 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3eee8c5-740b-46c9-ba24-676366574c82 None admin] REQUEST_METHOD: `GET` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:10:49.503792 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3eee8c5-740b-46c9-ba24-676366574c82 None admin] SCRIPT_NAME: `/identity` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:10:49.504066 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3eee8c5-740b-46c9-ba24-676366574c82 None admin] PATH_INFO: `/v3/domains/default` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:10:49.505393 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3eee8c5-740b-46c9-ba24-676366574c82 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:10:49.506914 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3eee8c5-740b-46c9-ba24-676366574c82 None admin] RBAC: Authorization granted {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:10:49.508576 dv-cinder-851351-1-smb devstack@keystone.service[144068]: [pid: 144068|app: 0|req: 36/79] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 08:10:49 2022] GET /identity/v3/domains/default => generated 199 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:10:49.509789 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a0a71e-dc15-4c34-8662-eb2873985417 None None] REQUEST_METHOD: `POST` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:10:49.510074 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a0a71e-dc15-4c34-8662-eb2873985417 None None] SCRIPT_NAME: `/identity` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:10:49.510350 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a0a71e-dc15-4c34-8662-eb2873985417 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:10:49.528978 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.auth.core [None req-17a0a71e-dc15-4c34-8662-eb2873985417 None None] MFA Rules not processed for user `bf5ceb8f07374635ad506b7d1b4f1612`. Rule list: `[]` (Enabled: `True`). {{(pid=144068) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 08:10:49.530208 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.fernet_utils [None req-17a0a71e-dc15-4c34-8662-eb2873985417 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=144068) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:10:49.560647 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d19bad-9e9a-4a15-843c-873e120c010e None admin] Validating token access rules against request {{(pid=144067) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:10:49.594627 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337f52b8-ea68-4c4d-9072-0c2e89f7b719 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144067) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:10:49.595202 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337f52b8-ea68-4c4d-9072-0c2e89f7b719 None admin] REQUEST_METHOD: `GET` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:10:49.595493 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337f52b8-ea68-4c4d-9072-0c2e89f7b719 None admin] SCRIPT_NAME: `/identity` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:10:49.595772 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337f52b8-ea68-4c4d-9072-0c2e89f7b719 None admin] PATH_INFO: `/v3/projects/49167073baf644459c58534448b0037f` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:10:49.596551 dv-cinder-851351-1-smb devstack@keystone.service[144068]: [pid: 144068|app: 0|req: 37/80] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 08:10:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 08:10:49.597520 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a0a71e-dc15-4c34-8662-eb2873985417 None None] Authenticating user token {{(pid=144068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:10:49.601259 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-337f52b8-ea68-4c4d-9072-0c2e89f7b719 None admin] RBAC: Authorizing `identity:get_project(project_id=49167073baf644459c58534448b0037f)` {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:10:49.602613 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-337f52b8-ea68-4c4d-9072-0c2e89f7b719 None admin] RBAC: Authorization granted {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:10:49.604469 dv-cinder-851351-1-smb devstack@keystone.service[144067]: [pid: 144067|app: 0|req: 44/81] 10.222.0.42 () {56 vars in 1186 bytes} [Thu Jul 28 08:10:49 2022] GET /identity/v3/projects/49167073baf644459c58534448b0037f => generated 298 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:10:49.610045 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337f52b8-ea68-4c4d-9072-0c2e89f7b719 None admin] Authenticating user token {{(pid=144067) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:10:49.649169 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG dbcounter [-] [144067] Writing DB stats keystone:SELECT=100 {{(pid=144067) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:10:49.654105 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG dbcounter [-] [144068] Writing DB stats keystone:SELECT=100 {{(pid=144068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:10:49.702753 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a0a71e-dc15-4c34-8662-eb2873985417 None None] Validating token access rules against request {{(pid=144068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:10:49.714888 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337f52b8-ea68-4c4d-9072-0c2e89f7b719 None admin] Validating token access rules against request {{(pid=144067) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:10:49.739884 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e27caec-ae9f-4d36-bb28-f656c3defefc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:10:49.740539 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e27caec-ae9f-4d36-bb28-f656c3defefc None admin] REQUEST_METHOD: `GET` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:10:49.740857 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e27caec-ae9f-4d36-bb28-f656c3defefc None admin] SCRIPT_NAME: `/identity` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:10:49.741141 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e27caec-ae9f-4d36-bb28-f656c3defefc None admin] PATH_INFO: `/v3/roles` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:10:49.741871 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e27caec-ae9f-4d36-bb28-f656c3defefc None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=144068) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:10:49.742185 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e27caec-ae9f-4d36-bb28-f656c3defefc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:10:49.743599 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e27caec-ae9f-4d36-bb28-f656c3defefc None admin] RBAC: Authorization granted {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:10:49.749726 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5aa55f-392c-42c3-bc82-d6bd619e3a79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144067) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:10:49.750360 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5aa55f-392c-42c3-bc82-d6bd619e3a79 None admin] REQUEST_METHOD: `GET` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:10:49.750645 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5aa55f-392c-42c3-bc82-d6bd619e3a79 None admin] SCRIPT_NAME: `/identity` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:10:49.750922 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5aa55f-392c-42c3-bc82-d6bd619e3a79 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:10:49.751515 dv-cinder-851351-1-smb devstack@keystone.service[144068]: [pid: 144068|app: 0|req: 38/82] 10.222.0.42 () {56 vars in 1111 bytes} [Thu Jul 28 08:10:49 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:10:49.752291 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e27caec-ae9f-4d36-bb28-f656c3defefc None admin] Authenticating user token {{(pid=144068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:10:49.823466 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b5aa55f-392c-42c3-bc82-d6bd619e3a79 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:10:49.825013 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b5aa55f-392c-42c3-bc82-d6bd619e3a79 None admin] RBAC: Authorization granted {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:10:49.854676 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e27caec-ae9f-4d36-bb28-f656c3defefc None admin] Validating token access rules against request {{(pid=144068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:10:49.864142 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG dbcounter [-] [144067] Writing DB stats keystone:SELECT=100 {{(pid=144067) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:10:49.871533 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG dbcounter [-] [144068] Writing DB stats keystone:SELECT=100 {{(pid=144068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:10:49.889662 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc519cd-bc4a-4080-90d6-57ff5c8ce2f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:10:49.890292 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc519cd-bc4a-4080-90d6-57ff5c8ce2f7 None admin] REQUEST_METHOD: `POST` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:10:49.890576 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc519cd-bc4a-4080-90d6-57ff5c8ce2f7 None admin] SCRIPT_NAME: `/identity` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:10:49.890852 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc519cd-bc4a-4080-90d6-57ff5c8ce2f7 None admin] PATH_INFO: `/v3/users` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:10:49.891545 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bc519cd-bc4a-4080-90d6-57ff5c8ce2f7 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:10:49.893038 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bc519cd-bc4a-4080-90d6-57ff5c8ce2f7 None admin] RBAC: Authorization granted {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:10:49.914338 dv-cinder-851351-1-smb devstack@keystone.service[144068]: [pid: 144068|app: 0|req: 39/83] 10.222.0.42 () {60 vars in 1132 bytes} [Thu Jul 28 08:10:49 2022] POST /identity/v3/users => generated 289 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 08:10:49.915276 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc519cd-bc4a-4080-90d6-57ff5c8ce2f7 None admin] Authenticating user token {{(pid=144068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:10:49.935580 dv-cinder-851351-1-smb devstack@keystone.service[144067]: [pid: 144067|app: 0|req: 45/84] 10.222.0.42 () {58 vars in 1282 bytes} [Thu Jul 28 08:10:49 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 28 08:10:49.941482 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5aa55f-392c-42c3-bc82-d6bd619e3a79 None admin] Authenticating user token {{(pid=144067) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:10:50.037038 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc519cd-bc4a-4080-90d6-57ff5c8ce2f7 None admin] Validating token access rules against request {{(pid=144068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:10:50.062519 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5aa55f-392c-42c3-bc82-d6bd619e3a79 None admin] Validating token access rules against request {{(pid=144067) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:10:50.074972 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9141a9-a178-44bd-9563-c54567cd5088 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:10:50.075313 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9141a9-a178-44bd-9563-c54567cd5088 None admin] REQUEST_METHOD: `GET` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:10:50.075596 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9141a9-a178-44bd-9563-c54567cd5088 None admin] SCRIPT_NAME: `/identity` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:10:50.075874 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9141a9-a178-44bd-9563-c54567cd5088 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:10:50.076731 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f9141a9-a178-44bd-9563-c54567cd5088 None admin] RBAC: Adding query filter params (role.id=d1020e7bb0b7411d895ddedd6dc02c5b, scope.project.id=49167073baf644459c58534448b0037f, user.id=bf5ceb8f07374635ad506b7d1b4f1612) {{(pid=144068) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:10:50.077054 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f9141a9-a178-44bd-9563-c54567cd5088 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:10:50.078530 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f9141a9-a178-44bd-9563-c54567cd5088 None admin] RBAC: Authorization granted {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:10:50.085197 dv-cinder-851351-1-smb devstack@keystone.service[144068]: [pid: 144068|app: 0|req: 40/85] 10.222.0.42 () {56 vars in 1374 bytes} [Thu Jul 28 08:10:49 2022] GET /identity/v3/role_assignments?user.id=bf5ceb8f07374635ad506b7d1b4f1612&scope.project.id=49167073baf644459c58534448b0037f&role.id=d1020e7bb0b7411d895ddedd6dc02c5b => generated 259 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:10:50.085841 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9141a9-a178-44bd-9563-c54567cd5088 None admin] Authenticating user token {{(pid=144068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:10:50.115697 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aca35d2-a81e-4a6a-b0c0-0d849f54ac6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144067) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:10:50.116826 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aca35d2-a81e-4a6a-b0c0-0d849f54ac6e None admin] REQUEST_METHOD: `GET` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:10:50.117319 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aca35d2-a81e-4a6a-b0c0-0d849f54ac6e None admin] SCRIPT_NAME: `/identity` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:10:50.117795 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aca35d2-a81e-4a6a-b0c0-0d849f54ac6e None admin] PATH_INFO: `/v3/roles/member` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:10:50.126683 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG dbcounter [-] [144067] Writing DB stats keystone:SELECT=100 {{(pid=144067) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:10:50.133527 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aca35d2-a81e-4a6a-b0c0-0d849f54ac6e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 08:10:50.139396 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application [None req-8aca35d2-a81e-4a6a-b0c0-0d849f54ac6e None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 28 08:10:50.139396 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:10:50.139396 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:10:50.139396 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:10:50.139396 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:10:50.139396 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:10:50.139396 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:10:50.139396 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:10:50.139396 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:10:50.139396 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:10:50.139396 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:10:50.139396 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:10:50.139396 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 08:10:50.139396 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 08:10:50.139396 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 08:10:50.139396 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 08:10:50.140498 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 08:10:50.140498 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 08:10:50.140498 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 08:10:50.140498 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 08:10:50.140498 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:10:50.140498 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:10:50.140498 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:10:50.140498 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:10:50.140498 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:10:50.140498 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:10:50.140498 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:10:50.140498 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application with Lock( Jul 28 08:10:50.140498 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:10:50.140498 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:10:50.140498 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:10:50.140498 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:10:50.141427 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:10:50.141427 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:10:50.141427 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:10:50.141427 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:10:50.141427 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 08:10:50.141427 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 08:10:50.141427 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 08:10:50.141427 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 08:10:50.141427 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 08:10:50.141427 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 08:10:50.141427 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 28 08:10:50.141427 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application Jul 28 08:10:50.146240 dv-cinder-851351-1-smb devstack@keystone.service[144067]: [pid: 144067|app: 0|req: 46/86] 10.222.0.42 () {56 vars in 1099 bytes} [Thu Jul 28 08:10:49 2022] GET /identity/v3/roles/member => generated 84 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:10:50.147270 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aca35d2-a81e-4a6a-b0c0-0d849f54ac6e None admin] Authenticating user token {{(pid=144067) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:10:50.149342 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG dbcounter [-] [144068] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=144068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:10:50.235410 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9141a9-a178-44bd-9563-c54567cd5088 None admin] Validating token access rules against request {{(pid=144068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:10:50.288558 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4060e1f4-9eff-4877-ac0e-437a402e99e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:10:50.289521 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4060e1f4-9eff-4877-ac0e-437a402e99e9 None admin] REQUEST_METHOD: `GET` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:10:50.290042 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4060e1f4-9eff-4877-ac0e-437a402e99e9 None admin] SCRIPT_NAME: `/identity` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:10:50.290490 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4060e1f4-9eff-4877-ac0e-437a402e99e9 None admin] PATH_INFO: `/v3/users/fbc36457370441478a0d13a56c8e0351` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:10:50.291734 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4060e1f4-9eff-4877-ac0e-437a402e99e9 None admin] RBAC: Authorizing `identity:get_user(user_id=fbc36457370441478a0d13a56c8e0351)` {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:10:50.293296 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4060e1f4-9eff-4877-ac0e-437a402e99e9 None admin] RBAC: Authorization granted {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:10:50.293431 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aca35d2-a81e-4a6a-b0c0-0d849f54ac6e None admin] Validating token access rules against request {{(pid=144067) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:10:50.295267 dv-cinder-851351-1-smb devstack@keystone.service[144068]: [pid: 144068|app: 0|req: 41/87] 10.222.0.42 () {56 vars in 1177 bytes} [Thu Jul 28 08:10:50 2022] GET /identity/v3/users/fbc36457370441478a0d13a56c8e0351 => generated 275 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:10:50.296073 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4060e1f4-9eff-4877-ac0e-437a402e99e9 None admin] Authenticating user token {{(pid=144068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:10:50.336261 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c835d2d0-2c33-4b59-a283-0fcaa739d756 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144067) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:10:50.336984 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c835d2d0-2c33-4b59-a283-0fcaa739d756 None admin] REQUEST_METHOD: `GET` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:10:50.337267 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c835d2d0-2c33-4b59-a283-0fcaa739d756 None admin] SCRIPT_NAME: `/identity` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:10:50.337547 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c835d2d0-2c33-4b59-a283-0fcaa739d756 None admin] PATH_INFO: `/v3/projects/49167073baf644459c58534448b0037f` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:10:50.338770 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c835d2d0-2c33-4b59-a283-0fcaa739d756 None admin] RBAC: Authorizing `identity:get_project(project_id=49167073baf644459c58534448b0037f)` {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:10:50.340695 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c835d2d0-2c33-4b59-a283-0fcaa739d756 None admin] RBAC: Authorization granted {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:10:50.342211 dv-cinder-851351-1-smb devstack@keystone.service[144067]: [pid: 144067|app: 0|req: 47/88] 10.222.0.42 () {56 vars in 1186 bytes} [Thu Jul 28 08:10:50 2022] GET /identity/v3/projects/49167073baf644459c58534448b0037f => generated 298 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:10:50.342800 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c835d2d0-2c33-4b59-a283-0fcaa739d756 None admin] Authenticating user token {{(pid=144067) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:10:50.425368 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG dbcounter [-] [144067] Writing DB stats keystone:SELECT=100 {{(pid=144067) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:10:50.448596 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4060e1f4-9eff-4877-ac0e-437a402e99e9 None admin] Validating token access rules against request {{(pid=144068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:10:50.461026 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG dbcounter [-] [144068] Writing DB stats keystone:SELECT=100 {{(pid=144068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:10:50.492510 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c835d2d0-2c33-4b59-a283-0fcaa739d756 None admin] Validating token access rules against request {{(pid=144067) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:10:50.533904 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2225592b-a37a-4709-9cdb-836388ff0e43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144067) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:10:50.534946 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2225592b-a37a-4709-9cdb-836388ff0e43 None admin] REQUEST_METHOD: `GET` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:10:50.535556 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2225592b-a37a-4709-9cdb-836388ff0e43 None admin] SCRIPT_NAME: `/identity` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:10:50.536143 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2225592b-a37a-4709-9cdb-836388ff0e43 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:10:50.541791 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-043a208a-2c35-4ff4-b296-9c11d4f864da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:10:50.542438 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043a208a-2c35-4ff4-b296-9c11d4f864da None admin] REQUEST_METHOD: `GET` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:10:50.542724 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043a208a-2c35-4ff4-b296-9c11d4f864da None admin] SCRIPT_NAME: `/identity` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:10:50.543004 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043a208a-2c35-4ff4-b296-9c11d4f864da None admin] PATH_INFO: `/v3/roles` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:10:50.543804 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-043a208a-2c35-4ff4-b296-9c11d4f864da None admin] RBAC: Adding query filter params (name=member) {{(pid=144068) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:10:50.544122 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-043a208a-2c35-4ff4-b296-9c11d4f864da None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:10:50.545551 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-043a208a-2c35-4ff4-b296-9c11d4f864da None admin] RBAC: Authorization granted {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:10:50.568064 dv-cinder-851351-1-smb devstack@keystone.service[144068]: [pid: 144068|app: 0|req: 42/89] 10.222.0.42 () {56 vars in 1101 bytes} [Thu Jul 28 08:10:50 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:10:50.569026 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-043a208a-2c35-4ff4-b296-9c11d4f864da None admin] Authenticating user token {{(pid=144068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:10:50.621557 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2225592b-a37a-4709-9cdb-836388ff0e43 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:10:50.623338 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2225592b-a37a-4709-9cdb-836388ff0e43 None admin] RBAC: Authorization granted {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:10:50.718975 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-043a208a-2c35-4ff4-b296-9c11d4f864da None admin] Validating token access rules against request {{(pid=144068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:10:50.731903 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG dbcounter [-] [144067] Writing DB stats keystone:SELECT=100 {{(pid=144067) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:10:50.780070 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20b8354-7e4d-464c-992d-7600d806a960 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:10:50.780736 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20b8354-7e4d-464c-992d-7600d806a960 None admin] REQUEST_METHOD: `GET` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:10:50.781025 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20b8354-7e4d-464c-992d-7600d806a960 None admin] SCRIPT_NAME: `/identity` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:10:50.781305 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20b8354-7e4d-464c-992d-7600d806a960 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:10:50.782119 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a20b8354-7e4d-464c-992d-7600d806a960 None admin] RBAC: Adding query filter params (role.id=6933b60756fe46dd8f27854f5e192061, scope.project.id=49167073baf644459c58534448b0037f, user.id=fbc36457370441478a0d13a56c8e0351) {{(pid=144068) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:10:50.782448 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a20b8354-7e4d-464c-992d-7600d806a960 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:10:50.783926 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a20b8354-7e4d-464c-992d-7600d806a960 None admin] RBAC: Authorization granted {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:10:50.790389 dv-cinder-851351-1-smb devstack@keystone.service[144068]: [pid: 144068|app: 0|req: 43/90] 10.222.0.42 () {56 vars in 1374 bytes} [Thu Jul 28 08:10:50 2022] GET /identity/v3/role_assignments?user.id=fbc36457370441478a0d13a56c8e0351&scope.project.id=49167073baf644459c58534448b0037f&role.id=6933b60756fe46dd8f27854f5e192061 => generated 259 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:10:50.791045 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20b8354-7e4d-464c-992d-7600d806a960 None admin] Authenticating user token {{(pid=144068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:10:50.816266 dv-cinder-851351-1-smb devstack@keystone.service[144067]: [pid: 144067|app: 0|req: 48/91] 10.222.0.42 () {58 vars in 1282 bytes} [Thu Jul 28 08:10:50 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 474 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 28 08:10:50.822373 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2225592b-a37a-4709-9cdb-836388ff0e43 None admin] Authenticating user token {{(pid=144067) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:10:50.828228 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG dbcounter [-] [144068] Writing DB stats keystone:SELECT=100 {{(pid=144068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:10:50.904186 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20b8354-7e4d-464c-992d-7600d806a960 None admin] Validating token access rules against request {{(pid=144068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:10:50.941367 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a52c701-7176-4073-b5d9-1078338ff53d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:10:50.942321 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a52c701-7176-4073-b5d9-1078338ff53d None admin] REQUEST_METHOD: `GET` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:10:50.942606 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a52c701-7176-4073-b5d9-1078338ff53d None admin] SCRIPT_NAME: `/identity` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:10:50.942884 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a52c701-7176-4073-b5d9-1078338ff53d None admin] PATH_INFO: `/v3/users/fbc36457370441478a0d13a56c8e0351` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:10:50.944150 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a52c701-7176-4073-b5d9-1078338ff53d None admin] RBAC: Authorizing `identity:get_user(user_id=fbc36457370441478a0d13a56c8e0351)` {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:10:50.945703 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a52c701-7176-4073-b5d9-1078338ff53d None admin] RBAC: Authorization granted {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:10:50.947423 dv-cinder-851351-1-smb devstack@keystone.service[144068]: [pid: 144068|app: 0|req: 44/92] 10.222.0.42 () {56 vars in 1177 bytes} [Thu Jul 28 08:10:50 2022] GET /identity/v3/users/fbc36457370441478a0d13a56c8e0351 => generated 275 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:10:50.953198 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a52c701-7176-4073-b5d9-1078338ff53d None admin] Authenticating user token {{(pid=144068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:10:51.064811 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG dbcounter [-] [144068] Writing DB stats keystone:SELECT=100 {{(pid=144068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:10:51.069004 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a52c701-7176-4073-b5d9-1078338ff53d None admin] Validating token access rules against request {{(pid=144068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:10:51.088190 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2225592b-a37a-4709-9cdb-836388ff0e43 None admin] Validating token access rules against request {{(pid=144067) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:10:51.106938 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87095840-e504-4fcd-9660-ab517a626fcb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:10:51.107589 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87095840-e504-4fcd-9660-ab517a626fcb None admin] REQUEST_METHOD: `GET` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:10:51.107875 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87095840-e504-4fcd-9660-ab517a626fcb None admin] SCRIPT_NAME: `/identity` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:10:51.108153 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87095840-e504-4fcd-9660-ab517a626fcb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:10:51.187286 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87095840-e504-4fcd-9660-ab517a626fcb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:10:51.188353 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9bb0af-83a9-4bc2-a428-cb2d929279e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144067) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:10:51.188815 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87095840-e504-4fcd-9660-ab517a626fcb None admin] RBAC: Authorization granted {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:10:51.189597 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9bb0af-83a9-4bc2-a428-cb2d929279e5 None admin] REQUEST_METHOD: `GET` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:10:51.190137 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9bb0af-83a9-4bc2-a428-cb2d929279e5 None admin] SCRIPT_NAME: `/identity` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:10:51.190618 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9bb0af-83a9-4bc2-a428-cb2d929279e5 None admin] PATH_INFO: `/v3/projects/49167073baf644459c58534448b0037f` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:10:51.195285 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f9bb0af-83a9-4bc2-a428-cb2d929279e5 None admin] RBAC: Authorizing `identity:get_project(project_id=49167073baf644459c58534448b0037f)` {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:10:51.197077 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f9bb0af-83a9-4bc2-a428-cb2d929279e5 None admin] RBAC: Authorization granted {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:10:51.199149 dv-cinder-851351-1-smb devstack@keystone.service[144067]: [pid: 144067|app: 0|req: 49/93] 10.222.0.42 () {56 vars in 1186 bytes} [Thu Jul 28 08:10:50 2022] GET /identity/v3/projects/49167073baf644459c58534448b0037f => generated 298 bytes in 377 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 08:10:51.205289 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9bb0af-83a9-4bc2-a428-cb2d929279e5 None admin] Authenticating user token {{(pid=144067) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:10:51.289111 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG dbcounter [-] [144067] Writing DB stats keystone:SELECT=100 {{(pid=144067) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:10:51.290599 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG dbcounter [-] [144068] Writing DB stats keystone:SELECT=100 {{(pid=144068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:10:51.295096 dv-cinder-851351-1-smb devstack@keystone.service[144068]: [pid: 144068|app: 0|req: 45/94] 10.222.0.42 () {58 vars in 1282 bytes} [Thu Jul 28 08:10:50 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 342 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 28 08:10:51.300841 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87095840-e504-4fcd-9660-ab517a626fcb None admin] Authenticating user token {{(pid=144068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:10:51.402074 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87095840-e504-4fcd-9660-ab517a626fcb None admin] Validating token access rules against request {{(pid=144068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:10:51.435235 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9bb0af-83a9-4bc2-a428-cb2d929279e5 None admin] Validating token access rules against request {{(pid=144067) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:10:51.437123 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b47f7f-5477-4c77-b3f9-d4cff68af9c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:10:51.437797 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b47f7f-5477-4c77-b3f9-d4cff68af9c8 None admin] REQUEST_METHOD: `GET` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:10:51.438077 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b47f7f-5477-4c77-b3f9-d4cff68af9c8 None admin] SCRIPT_NAME: `/identity` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:10:51.438353 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b47f7f-5477-4c77-b3f9-d4cff68af9c8 None admin] PATH_INFO: `/v3/projects/8b80e33db5a146f0ade6984dcc9c90d8` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:10:51.442699 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4b47f7f-5477-4c77-b3f9-d4cff68af9c8 None admin] RBAC: Authorizing `identity:get_project(project_id=8b80e33db5a146f0ade6984dcc9c90d8)` {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:10:51.442699 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4b47f7f-5477-4c77-b3f9-d4cff68af9c8 None admin] RBAC: Authorization granted {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:10:51.443007 dv-cinder-851351-1-smb devstack@keystone.service[144068]: [pid: 144068|app: 0|req: 46/95] 10.222.0.42 () {56 vars in 1186 bytes} [Thu Jul 28 08:10:51 2022] GET /identity/v3/projects/8b80e33db5a146f0ade6984dcc9c90d8 => generated 312 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:10:51.451978 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b47f7f-5477-4c77-b3f9-d4cff68af9c8 None admin] Authenticating user token {{(pid=144068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:10:51.501518 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa4cc2d-1de8-4a9d-a399-a46d5f953e9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144067) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:10:51.502539 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa4cc2d-1de8-4a9d-a399-a46d5f953e9f None admin] REQUEST_METHOD: `GET` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:10:51.503120 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa4cc2d-1de8-4a9d-a399-a46d5f953e9f None admin] SCRIPT_NAME: `/identity` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:10:51.503726 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa4cc2d-1de8-4a9d-a399-a46d5f953e9f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:10:51.504830 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa4cc2d-1de8-4a9d-a399-a46d5f953e9f None admin] RBAC: Adding query filter params (role.id=7e9c2306137042cf8b8eba284656ef33, scope.project.id=49167073baf644459c58534448b0037f, user.id=fbc36457370441478a0d13a56c8e0351) {{(pid=144067) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:10:51.505354 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa4cc2d-1de8-4a9d-a399-a46d5f953e9f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:10:51.507386 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa4cc2d-1de8-4a9d-a399-a46d5f953e9f None admin] RBAC: Authorization granted {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:10:51.520862 dv-cinder-851351-1-smb devstack@keystone.service[144067]: [pid: 144067|app: 0|req: 50/96] 10.222.0.42 () {56 vars in 1374 bytes} [Thu Jul 28 08:10:51 2022] GET /identity/v3/role_assignments?user.id=fbc36457370441478a0d13a56c8e0351&scope.project.id=49167073baf644459c58534448b0037f&role.id=7e9c2306137042cf8b8eba284656ef33 => generated 259 bytes in 316 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:10:51.524365 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG dbcounter [-] [144068] Writing DB stats keystone:SELECT=100 {{(pid=144068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:10:51.561190 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b47f7f-5477-4c77-b3f9-d4cff68af9c8 None admin] Validating token access rules against request {{(pid=144068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:10:51.598869 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3151bcc-0927-439a-99aa-98c80921f7fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:10:51.599489 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3151bcc-0927-439a-99aa-98c80921f7fc None admin] REQUEST_METHOD: `GET` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:10:51.599767 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3151bcc-0927-439a-99aa-98c80921f7fc None admin] SCRIPT_NAME: `/identity` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:10:51.600043 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3151bcc-0927-439a-99aa-98c80921f7fc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:10:51.600876 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3151bcc-0927-439a-99aa-98c80921f7fc None admin] RBAC: Adding query filter params (role.id=6933b60756fe46dd8f27854f5e192061, scope.project.id=8b80e33db5a146f0ade6984dcc9c90d8, user.id=fbc36457370441478a0d13a56c8e0351) {{(pid=144068) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:10:51.601189 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3151bcc-0927-439a-99aa-98c80921f7fc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:10:51.602648 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3151bcc-0927-439a-99aa-98c80921f7fc None admin] RBAC: Authorization granted {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:10:51.608736 dv-cinder-851351-1-smb devstack@keystone.service[144068]: [pid: 144068|app: 0|req: 47/97] 10.222.0.42 () {56 vars in 1374 bytes} [Thu Jul 28 08:10:51 2022] GET /identity/v3/role_assignments?user.id=fbc36457370441478a0d13a56c8e0351&scope.project.id=8b80e33db5a146f0ade6984dcc9c90d8&role.id=6933b60756fe46dd8f27854f5e192061 => generated 259 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 08:10:52.828581 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4573b16-3e04-40c5-8651-9968889ebe3c None None] REQUEST_METHOD: `GET` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:10:52.830137 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4573b16-3e04-40c5-8651-9968889ebe3c None None] SCRIPT_NAME: `/identity` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:10:52.830899 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4573b16-3e04-40c5-8651-9968889ebe3c None None] PATH_INFO: `/` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:10:52.833778 dv-cinder-851351-1-smb devstack@keystone.service[144067]: [pid: 144067|app: 0|req: 51/98] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 08:10:52 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 28 08:10:52.842866 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a20e989-6c9c-4dfc-b1fd-98764f4b1699 None None] REQUEST_METHOD: `POST` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:10:52.844241 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a20e989-6c9c-4dfc-b1fd-98764f4b1699 None None] SCRIPT_NAME: `/identity` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:10:52.845076 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a20e989-6c9c-4dfc-b1fd-98764f4b1699 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:10:52.886178 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.auth.core [None req-1a20e989-6c9c-4dfc-b1fd-98764f4b1699 None None] MFA Rules not processed for user `bf5ceb8f07374635ad506b7d1b4f1612`. Rule list: `[]` (Enabled: `True`). {{(pid=144068) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 08:10:52.888620 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.fernet_utils [None req-1a20e989-6c9c-4dfc-b1fd-98764f4b1699 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=144068) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:10:52.991502 dv-cinder-851351-1-smb devstack@keystone.service[144068]: [pid: 144068|app: 0|req: 48/99] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 08:10:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 08:10:53.052207 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4573b16-3e04-40c5-8651-9968889ebe3c None None] Authenticating user token {{(pid=144067) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:10:53.183291 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8701d08d-440f-4ffc-954b-71662b87cbed None None] REQUEST_METHOD: `GET` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:10:53.183548 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8701d08d-440f-4ffc-954b-71662b87cbed None None] SCRIPT_NAME: `/identity` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:10:53.183711 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8701d08d-440f-4ffc-954b-71662b87cbed None None] PATH_INFO: `/` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:10:53.185821 dv-cinder-851351-1-smb devstack@keystone.service[144068]: [pid: 144068|app: 0|req: 49/100] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 08:10:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 08:10:53.223300 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d474c0a6-fc21-4082-a8b7-71f4d7deef90 None None] REQUEST_METHOD: `POST` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:10:53.223637 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d474c0a6-fc21-4082-a8b7-71f4d7deef90 None None] SCRIPT_NAME: `/identity` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:10:53.223866 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d474c0a6-fc21-4082-a8b7-71f4d7deef90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:10:53.262039 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.auth.core [None req-d474c0a6-fc21-4082-a8b7-71f4d7deef90 None None] MFA Rules not processed for user `bf5ceb8f07374635ad506b7d1b4f1612`. Rule list: `[]` (Enabled: `True`). {{(pid=144068) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 08:10:53.263285 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.fernet_utils [None req-d474c0a6-fc21-4082-a8b7-71f4d7deef90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=144068) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:10:53.288529 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG dbcounter [-] [144067] Writing DB stats keystone:SELECT=100 {{(pid=144067) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:10:53.296213 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4573b16-3e04-40c5-8651-9968889ebe3c None None] Validating token access rules against request {{(pid=144067) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:10:53.344713 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG dbcounter [-] [144068] Writing DB stats keystone:SELECT=100 {{(pid=144068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:10:53.357855 dv-cinder-851351-1-smb devstack@keystone.service[144068]: [pid: 144068|app: 0|req: 50/101] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 08:10:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 08:10:53.359569 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f875c4-ad6e-4f91-8d85-d349fa08e62e None None] REQUEST_METHOD: `GET` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:10:53.359942 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f875c4-ad6e-4f91-8d85-d349fa08e62e None None] SCRIPT_NAME: `/identity` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:10:53.360341 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f875c4-ad6e-4f91-8d85-d349fa08e62e None None] PATH_INFO: `/` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:10:53.362298 dv-cinder-851351-1-smb devstack@keystone.service[144068]: [pid: 144068|app: 0|req: 51/102] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 08:10:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 08:10:53.367997 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120b27b9-8504-4d34-963a-f537c0d4f247 None None] REQUEST_METHOD: `POST` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:10:53.368388 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120b27b9-8504-4d34-963a-f537c0d4f247 None None] SCRIPT_NAME: `/identity` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:10:53.368791 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120b27b9-8504-4d34-963a-f537c0d4f247 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:10:53.369246 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6465ad-a733-42c5-9b49-0ccab0e8f41a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144067) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:10:53.370166 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6465ad-a733-42c5-9b49-0ccab0e8f41a None admin] REQUEST_METHOD: `GET` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:10:53.370611 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6465ad-a733-42c5-9b49-0ccab0e8f41a None admin] SCRIPT_NAME: `/identity` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:10:53.371036 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6465ad-a733-42c5-9b49-0ccab0e8f41a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:10:53.388843 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.auth.core [None req-120b27b9-8504-4d34-963a-f537c0d4f247 None None] MFA Rules not processed for user `bf5ceb8f07374635ad506b7d1b4f1612`. Rule list: `[]` (Enabled: `True`). {{(pid=144068) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 08:10:53.390251 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.fernet_utils [None req-120b27b9-8504-4d34-963a-f537c0d4f247 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=144068) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:10:53.404352 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d6465ad-a733-42c5-9b49-0ccab0e8f41a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 08:10:53.410312 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application [None req-1d6465ad-a733-42c5-9b49-0ccab0e8f41a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 08:10:53.410312 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:10:53.410312 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:10:53.410312 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:10:53.410312 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:10:53.410312 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:10:53.410312 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:10:53.410312 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:10:53.410312 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:10:53.410312 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:10:53.410312 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:10:53.410312 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:10:53.410312 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 08:10:53.410312 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 08:10:53.410312 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 08:10:53.410312 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 08:10:53.411594 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 08:10:53.411594 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 08:10:53.411594 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 08:10:53.411594 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 08:10:53.411594 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:10:53.411594 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:10:53.411594 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:10:53.411594 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:10:53.411594 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:10:53.411594 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:10:53.411594 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:10:53.411594 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application with Lock( Jul 28 08:10:53.411594 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:10:53.411594 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:10:53.411594 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:10:53.411594 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:10:53.412815 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:10:53.412815 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:10:53.412815 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:10:53.412815 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:10:53.412815 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 08:10:53.412815 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 08:10:53.412815 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 08:10:53.412815 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 08:10:53.412815 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 08:10:53.412815 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 08:10:53.412815 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 08:10:53.412815 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application Jul 28 08:10:53.420711 dv-cinder-851351-1-smb devstack@keystone.service[144067]: [pid: 144067|app: 0|req: 52/103] 10.222.0.42 () {56 vars in 1096 bytes} [Thu Jul 28 08:10:53 2022] GET /identity/v3/roles/admin => generated 83 bytes in 370 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:10:53.421803 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6465ad-a733-42c5-9b49-0ccab0e8f41a None admin] Authenticating user token {{(pid=144067) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:10:53.471930 dv-cinder-851351-1-smb devstack@keystone.service[144068]: [pid: 144068|app: 0|req: 52/104] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 08:10:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 28 08:10:53.472912 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-120b27b9-8504-4d34-963a-f537c0d4f247 None None] Authenticating user token {{(pid=144068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:10:53.531063 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6465ad-a733-42c5-9b49-0ccab0e8f41a None admin] Validating token access rules against request {{(pid=144067) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:10:53.604193 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-120b27b9-8504-4d34-963a-f537c0d4f247 None None] Validating token access rules against request {{(pid=144068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:10:53.628067 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cabe7677-9755-42b7-b628-5659a6d5bba4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144067) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:10:53.628784 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cabe7677-9755-42b7-b628-5659a6d5bba4 None admin] REQUEST_METHOD: `GET` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:10:53.629074 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cabe7677-9755-42b7-b628-5659a6d5bba4 None admin] SCRIPT_NAME: `/identity` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:10:53.629184 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG dbcounter [-] [144068] Writing DB stats keystone:SELECT=100 {{(pid=144068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:10:53.629398 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cabe7677-9755-42b7-b628-5659a6d5bba4 None admin] PATH_INFO: `/v3/domains/default` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:10:53.633402 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cabe7677-9755-42b7-b628-5659a6d5bba4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:10:53.634914 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cabe7677-9755-42b7-b628-5659a6d5bba4 None admin] RBAC: Authorization granted {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:10:53.636642 dv-cinder-851351-1-smb devstack@keystone.service[144067]: [pid: 144067|app: 0|req: 53/105] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 08:10:53 2022] GET /identity/v3/domains/default => generated 199 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:10:53.639234 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cabe7677-9755-42b7-b628-5659a6d5bba4 None admin] Authenticating user token {{(pid=144067) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:10:53.642270 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22cdb3c1-30aa-4823-8bdf-de157cbfc817 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:10:53.643253 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22cdb3c1-30aa-4823-8bdf-de157cbfc817 None admin] REQUEST_METHOD: `GET` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:10:53.643547 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22cdb3c1-30aa-4823-8bdf-de157cbfc817 None admin] SCRIPT_NAME: `/identity` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:10:53.643867 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22cdb3c1-30aa-4823-8bdf-de157cbfc817 None admin] PATH_INFO: `/v3/roles` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:10:53.644978 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22cdb3c1-30aa-4823-8bdf-de157cbfc817 None admin] RBAC: Adding query filter params (name=admin) {{(pid=144068) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:10:53.645466 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22cdb3c1-30aa-4823-8bdf-de157cbfc817 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:10:53.646892 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22cdb3c1-30aa-4823-8bdf-de157cbfc817 None admin] RBAC: Authorization granted {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:10:53.657125 dv-cinder-851351-1-smb devstack@keystone.service[144068]: [pid: 144068|app: 0|req: 53/106] 10.222.0.42 () {56 vars in 1099 bytes} [Thu Jul 28 08:10:53 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:10:53.657877 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22cdb3c1-30aa-4823-8bdf-de157cbfc817 None admin] Authenticating user token {{(pid=144068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:10:53.708056 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG dbcounter [-] [144067] Writing DB stats keystone:SELECT=100 {{(pid=144067) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:10:53.764984 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22cdb3c1-30aa-4823-8bdf-de157cbfc817 None admin] Validating token access rules against request {{(pid=144068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:10:53.801801 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649787ea-f0bd-4e72-a38b-1eb83f940788 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:10:53.802801 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649787ea-f0bd-4e72-a38b-1eb83f940788 None admin] REQUEST_METHOD: `POST` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:10:53.803283 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649787ea-f0bd-4e72-a38b-1eb83f940788 None admin] SCRIPT_NAME: `/identity` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:10:53.803754 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649787ea-f0bd-4e72-a38b-1eb83f940788 None admin] PATH_INFO: `/v3/projects` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:10:53.804640 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-649787ea-f0bd-4e72-a38b-1eb83f940788 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:10:53.806332 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-649787ea-f0bd-4e72-a38b-1eb83f940788 None admin] RBAC: Authorization granted {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:10:53.850555 dv-cinder-851351-1-smb devstack@keystone.service[144068]: [pid: 144068|app: 0|req: 54/107] 10.222.0.42 () {60 vars in 1141 bytes} [Thu Jul 28 08:10:53 2022] POST /identity/v3/projects => generated 302 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 08:10:53.852498 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649787ea-f0bd-4e72-a38b-1eb83f940788 None admin] Authenticating user token {{(pid=144068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:10:53.860701 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cabe7677-9755-42b7-b628-5659a6d5bba4 None admin] Validating token access rules against request {{(pid=144067) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:10:53.927222 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b5dc76-cb92-4399-9f5b-25b10e4bfe23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144067) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:10:53.927906 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b5dc76-cb92-4399-9f5b-25b10e4bfe23 None admin] REQUEST_METHOD: `GET` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:10:53.928210 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b5dc76-cb92-4399-9f5b-25b10e4bfe23 None admin] SCRIPT_NAME: `/identity` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:10:53.928492 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b5dc76-cb92-4399-9f5b-25b10e4bfe23 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:10:53.945092 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG dbcounter [-] [144068] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=144068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:10:53.981348 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1b5dc76-cb92-4399-9f5b-25b10e4bfe23 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 08:10:53.987034 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application [None req-c1b5dc76-cb92-4399-9f5b-25b10e4bfe23 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 28 08:10:53.987034 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:10:53.987034 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:10:53.987034 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:10:53.987034 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:10:53.987034 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:10:53.987034 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:10:53.987034 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:10:53.987034 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:10:53.987034 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:10:53.987034 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:10:53.987034 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:10:53.987034 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 08:10:53.987034 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 08:10:53.987034 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 08:10:53.987034 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 08:10:53.988067 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 08:10:53.988067 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 08:10:53.988067 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 08:10:53.988067 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 08:10:53.988067 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:10:53.988067 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:10:53.988067 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:10:53.988067 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:10:53.988067 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:10:53.988067 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:10:53.988067 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:10:53.988067 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application with Lock( Jul 28 08:10:53.988067 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:10:53.988067 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:10:53.988067 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:10:53.988067 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:10:53.989071 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:10:53.989071 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:10:53.989071 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:10:53.989071 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:10:53.989071 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 08:10:53.989071 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 08:10:53.989071 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 08:10:53.989071 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 08:10:53.989071 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 08:10:53.989071 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 08:10:53.989071 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 28 08:10:53.989071 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application Jul 28 08:10:53.989071 dv-cinder-851351-1-smb devstack@keystone.service[144067]: [pid: 144067|app: 0|req: 54/108] 10.222.0.42 () {56 vars in 1099 bytes} [Thu Jul 28 08:10:53 2022] GET /identity/v3/roles/reader => generated 84 bytes in 351 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:10:53.996709 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b5dc76-cb92-4399-9f5b-25b10e4bfe23 None admin] Authenticating user token {{(pid=144067) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:10:54.009644 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649787ea-f0bd-4e72-a38b-1eb83f940788 None admin] Validating token access rules against request {{(pid=144068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:10:54.049470 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c194cd-cc25-4bed-8979-f9d3511d2502 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:10:54.050081 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c194cd-cc25-4bed-8979-f9d3511d2502 None admin] REQUEST_METHOD: `GET` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:10:54.050435 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c194cd-cc25-4bed-8979-f9d3511d2502 None admin] SCRIPT_NAME: `/identity` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:10:54.050717 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c194cd-cc25-4bed-8979-f9d3511d2502 None admin] PATH_INFO: `/v3/users/bf5ceb8f07374635ad506b7d1b4f1612` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:10:54.052240 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7c194cd-cc25-4bed-8979-f9d3511d2502 None admin] RBAC: Authorizing `identity:get_user(user_id=bf5ceb8f07374635ad506b7d1b4f1612)` {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:10:54.054431 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7c194cd-cc25-4bed-8979-f9d3511d2502 None admin] RBAC: Authorization granted {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:10:54.056254 dv-cinder-851351-1-smb devstack@keystone.service[144068]: [pid: 144068|app: 0|req: 55/109] 10.222.0.42 () {56 vars in 1177 bytes} [Thu Jul 28 08:10:53 2022] GET /identity/v3/users/bf5ceb8f07374635ad506b7d1b4f1612 => generated 247 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:10:54.062872 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c194cd-cc25-4bed-8979-f9d3511d2502 None admin] Authenticating user token {{(pid=144068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:10:54.215245 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG dbcounter [-] [144067] Writing DB stats keystone:SELECT=100 {{(pid=144067) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:10:54.238357 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b5dc76-cb92-4399-9f5b-25b10e4bfe23 None admin] Validating token access rules against request {{(pid=144067) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:10:54.256488 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c194cd-cc25-4bed-8979-f9d3511d2502 None admin] Validating token access rules against request {{(pid=144068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:10:54.267581 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG dbcounter [-] [144068] Writing DB stats keystone:SELECT=100 {{(pid=144068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:10:54.291996 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a445b15-cefb-4ba3-89e1-46aa2b20e747 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144067) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:10:54.292651 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a445b15-cefb-4ba3-89e1-46aa2b20e747 None admin] REQUEST_METHOD: `GET` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:10:54.292967 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a445b15-cefb-4ba3-89e1-46aa2b20e747 None admin] SCRIPT_NAME: `/identity` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:10:54.293246 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a445b15-cefb-4ba3-89e1-46aa2b20e747 None admin] PATH_INFO: `/v3/roles` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:10:54.294462 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a445b15-cefb-4ba3-89e1-46aa2b20e747 None admin] RBAC: Adding query filter params (name=reader) {{(pid=144067) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:10:54.294788 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a445b15-cefb-4ba3-89e1-46aa2b20e747 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:10:54.296520 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a445b15-cefb-4ba3-89e1-46aa2b20e747 None admin] RBAC: Authorization granted {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:10:54.308510 dv-cinder-851351-1-smb devstack@keystone.service[144067]: [pid: 144067|app: 0|req: 55/110] 10.222.0.42 () {56 vars in 1101 bytes} [Thu Jul 28 08:10:53 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 312 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:10:54.309801 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32038490-41a6-4191-9fe7-c0eec731f21c None None] REQUEST_METHOD: `GET` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:10:54.310163 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32038490-41a6-4191-9fe7-c0eec731f21c None None] SCRIPT_NAME: `/identity` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:10:54.310423 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32038490-41a6-4191-9fe7-c0eec731f21c None None] PATH_INFO: `/` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:10:54.311737 dv-cinder-851351-1-smb devstack@keystone.service[144067]: [pid: 144067|app: 0|req: 56/111] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 08:10:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 08:10:54.315043 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a7559e0-dabf-4ffa-9cbd-d197f71efac0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:10:54.315732 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7559e0-dabf-4ffa-9cbd-d197f71efac0 None admin] REQUEST_METHOD: `GET` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:10:54.316270 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7559e0-dabf-4ffa-9cbd-d197f71efac0 None admin] SCRIPT_NAME: `/identity` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:10:54.316815 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7559e0-dabf-4ffa-9cbd-d197f71efac0 None admin] PATH_INFO: `/v3/projects/49167073baf644459c58534448b0037f` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:10:54.318221 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32038490-41a6-4191-9fe7-c0eec731f21c None None] Authenticating user token {{(pid=144067) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:10:54.318422 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a7559e0-dabf-4ffa-9cbd-d197f71efac0 None admin] RBAC: Authorizing `identity:get_project(project_id=49167073baf644459c58534448b0037f)` {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:10:54.320634 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a7559e0-dabf-4ffa-9cbd-d197f71efac0 None admin] RBAC: Authorization granted {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:10:54.322597 dv-cinder-851351-1-smb devstack@keystone.service[144068]: [pid: 144068|app: 0|req: 56/112] 10.222.0.42 () {56 vars in 1186 bytes} [Thu Jul 28 08:10:54 2022] GET /identity/v3/projects/49167073baf644459c58534448b0037f => generated 298 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 08:10:54.325657 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41d442c-d50b-4353-bb7a-17a072776491 None None] REQUEST_METHOD: `POST` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:10:54.326982 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41d442c-d50b-4353-bb7a-17a072776491 None None] SCRIPT_NAME: `/identity` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:10:54.327314 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41d442c-d50b-4353-bb7a-17a072776491 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:10:54.357425 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.auth.core [None req-b41d442c-d50b-4353-bb7a-17a072776491 None None] MFA Rules not processed for user `bf5ceb8f07374635ad506b7d1b4f1612`. Rule list: `[]` (Enabled: `True`). {{(pid=144068) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 08:10:54.358903 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.fernet_utils [None req-b41d442c-d50b-4353-bb7a-17a072776491 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=144068) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:10:54.450575 dv-cinder-851351-1-smb devstack@keystone.service[144068]: [pid: 144068|app: 0|req: 57/113] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 08:10:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 08:10:54.451954 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41d442c-d50b-4353-bb7a-17a072776491 None None] Authenticating user token {{(pid=144068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:10:54.529458 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32038490-41a6-4191-9fe7-c0eec731f21c None None] Validating token access rules against request {{(pid=144067) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:10:54.580756 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41d442c-d50b-4353-bb7a-17a072776491 None None] Validating token access rules against request {{(pid=144068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:10:54.582645 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG dbcounter [-] [144068] Writing DB stats keystone:SELECT=100 {{(pid=144068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:10:54.589225 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d768865-8116-4203-bbf9-3deb469c71b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144067) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:10:54.590355 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d768865-8116-4203-bbf9-3deb469c71b3 None admin] REQUEST_METHOD: `GET` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:10:54.590842 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d768865-8116-4203-bbf9-3deb469c71b3 None admin] SCRIPT_NAME: `/identity` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:10:54.591340 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d768865-8116-4203-bbf9-3deb469c71b3 None admin] PATH_INFO: `/v3/users/24f15e2e64e74ff09da0acf7fc0fad74` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:10:54.607663 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d768865-8116-4203-bbf9-3deb469c71b3 None admin] RBAC: Authorizing `identity:get_user(user_id=24f15e2e64e74ff09da0acf7fc0fad74)` {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:10:54.609328 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d768865-8116-4203-bbf9-3deb469c71b3 None admin] RBAC: Authorization granted {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:10:54.611312 dv-cinder-851351-1-smb devstack@keystone.service[144067]: [pid: 144067|app: 0|req: 57/114] 10.222.0.42 () {56 vars in 1177 bytes} [Thu Jul 28 08:10:54 2022] GET /identity/v3/users/24f15e2e64e74ff09da0acf7fc0fad74 => generated 289 bytes in 295 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:10:54.611911 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d768865-8116-4203-bbf9-3deb469c71b3 None admin] Authenticating user token {{(pid=144067) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:10:54.626870 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260ea3e4-bd25-4f0b-bba9-dc6b58976526 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:10:54.628062 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260ea3e4-bd25-4f0b-bba9-dc6b58976526 None admin] REQUEST_METHOD: `PUT` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:10:54.628558 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260ea3e4-bd25-4f0b-bba9-dc6b58976526 None admin] SCRIPT_NAME: `/identity` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:10:54.629081 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260ea3e4-bd25-4f0b-bba9-dc6b58976526 None admin] PATH_INFO: `/v3/projects/49167073baf644459c58534448b0037f/users/bf5ceb8f07374635ad506b7d1b4f1612/roles/d1020e7bb0b7411d895ddedd6dc02c5b` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:10:54.630174 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG dbcounter [-] [144067] Writing DB stats keystone:SELECT=100 {{(pid=144067) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:10:54.633812 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-260ea3e4-bd25-4f0b-bba9-dc6b58976526 None admin] RBAC: Authorizing `identity:create_grant(project_id=49167073baf644459c58534448b0037f, user_id=bf5ceb8f07374635ad506b7d1b4f1612, role_id=d1020e7bb0b7411d895ddedd6dc02c5b)` {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:10:54.637089 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-260ea3e4-bd25-4f0b-bba9-dc6b58976526 None admin] RBAC: Authorization granted {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:10:54.655404 dv-cinder-851351-1-smb devstack@keystone.service[144068]: [pid: 144068|app: 0|req: 58/115] 10.222.0.42 () {58 vars in 1439 bytes} [Thu Jul 28 08:10:54 2022] PUT /identity/v3/projects/49167073baf644459c58534448b0037f/users/bf5ceb8f07374635ad506b7d1b4f1612/roles/d1020e7bb0b7411d895ddedd6dc02c5b => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 08:10:54.657202 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7191d98d-ad71-4db3-b608-bbaecb239fe3 None None] REQUEST_METHOD: `GET` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:10:54.657826 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7191d98d-ad71-4db3-b608-bbaecb239fe3 None None] SCRIPT_NAME: `/identity` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:10:54.658394 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7191d98d-ad71-4db3-b608-bbaecb239fe3 None None] PATH_INFO: `/` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:10:54.660137 dv-cinder-851351-1-smb devstack@keystone.service[144068]: [pid: 144068|app: 0|req: 59/116] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 08:10:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 08:10:54.666105 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7191d98d-ad71-4db3-b608-bbaecb239fe3 None None] Authenticating user token {{(pid=144068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:10:54.793635 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7191d98d-ad71-4db3-b608-bbaecb239fe3 None None] Validating token access rules against request {{(pid=144068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:10:54.837865 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47ef91a-aa88-4fbf-9841-03c9a22069ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:10:54.838889 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47ef91a-aa88-4fbf-9841-03c9a22069ac None admin] REQUEST_METHOD: `GET` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:10:54.839518 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47ef91a-aa88-4fbf-9841-03c9a22069ac None admin] SCRIPT_NAME: `/identity` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:10:54.840038 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47ef91a-aa88-4fbf-9841-03c9a22069ac None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:10:54.848120 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d768865-8116-4203-bbf9-3deb469c71b3 None admin] Validating token access rules against request {{(pid=144067) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:10:54.877109 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG dbcounter [-] [144068] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=144068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:10:54.926900 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f47ef91a-aa88-4fbf-9841-03c9a22069ac None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:10:54.929491 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f47ef91a-aa88-4fbf-9841-03c9a22069ac None admin] RBAC: Authorization granted {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:10:54.976093 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e7713a-0cd3-4045-9366-4f5d81fa4aa5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144067) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:10:54.976936 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e7713a-0cd3-4045-9366-4f5d81fa4aa5 None admin] REQUEST_METHOD: `GET` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:10:54.977353 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e7713a-0cd3-4045-9366-4f5d81fa4aa5 None admin] SCRIPT_NAME: `/identity` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:10:54.977645 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e7713a-0cd3-4045-9366-4f5d81fa4aa5 None admin] PATH_INFO: `/v3/roles/member` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:10:54.997731 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e7713a-0cd3-4045-9366-4f5d81fa4aa5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 08:10:55.006079 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application [None req-09e7713a-0cd3-4045-9366-4f5d81fa4aa5 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 28 08:10:55.006079 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:10:55.006079 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:10:55.006079 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:10:55.006079 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:10:55.006079 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:10:55.006079 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:10:55.006079 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:10:55.006079 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:10:55.006079 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:10:55.006079 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:10:55.006079 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:10:55.006079 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 08:10:55.006079 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 08:10:55.006079 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 08:10:55.006079 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 08:10:55.007201 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 08:10:55.007201 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 08:10:55.007201 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 08:10:55.007201 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 08:10:55.007201 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:10:55.007201 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:10:55.007201 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:10:55.007201 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:10:55.007201 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:10:55.007201 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:10:55.007201 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:10:55.007201 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application with Lock( Jul 28 08:10:55.007201 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:10:55.007201 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:10:55.007201 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:10:55.007201 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:10:55.008769 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:10:55.008769 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:10:55.008769 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:10:55.008769 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:10:55.008769 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 08:10:55.008769 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 08:10:55.008769 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 08:10:55.008769 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 08:10:55.008769 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 08:10:55.008769 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 08:10:55.008769 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 28 08:10:55.008769 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application Jul 28 08:10:55.008769 dv-cinder-851351-1-smb devstack@keystone.service[144067]: [pid: 144067|app: 0|req: 58/117] 10.222.0.42 () {56 vars in 1099 bytes} [Thu Jul 28 08:10:54 2022] GET /identity/v3/roles/member => generated 84 bytes in 396 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:10:55.009541 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37db900c-5e53-44c8-90ac-c19846bc923f None None] REQUEST_METHOD: `POST` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:10:55.009541 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37db900c-5e53-44c8-90ac-c19846bc923f None None] SCRIPT_NAME: `/identity` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:10:55.009673 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37db900c-5e53-44c8-90ac-c19846bc923f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:10:55.038125 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.auth.core [None req-37db900c-5e53-44c8-90ac-c19846bc923f None None] MFA Rules not processed for user `bf5ceb8f07374635ad506b7d1b4f1612`. Rule list: `[]` (Enabled: `True`). {{(pid=144067) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 08:10:55.039840 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.fernet_utils [None req-37db900c-5e53-44c8-90ac-c19846bc923f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=144067) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:10:55.070976 dv-cinder-851351-1-smb devstack@keystone.service[144068]: [pid: 144068|app: 0|req: 60/118] 10.222.0.42 () {58 vars in 1282 bytes} [Thu Jul 28 08:10:54 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 405 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 28 08:10:55.072417 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47ef91a-aa88-4fbf-9841-03c9a22069ac None admin] Authenticating user token {{(pid=144068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:10:55.140049 dv-cinder-851351-1-smb devstack@keystone.service[144067]: [pid: 144067|app: 0|req: 59/119] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 08:10:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 08:10:55.140049 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37db900c-5e53-44c8-90ac-c19846bc923f None None] Authenticating user token {{(pid=144067) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:10:55.141845 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG dbcounter [-] [144067] Writing DB stats keystone:SELECT=100 {{(pid=144067) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:10:55.174365 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG dbcounter [-] [144068] Writing DB stats keystone:SELECT=100 {{(pid=144068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:10:55.239278 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47ef91a-aa88-4fbf-9841-03c9a22069ac None admin] Validating token access rules against request {{(pid=144068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:10:55.274078 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37db900c-5e53-44c8-90ac-c19846bc923f None None] Validating token access rules against request {{(pid=144067) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:10:55.283627 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b8e2aa-6769-4250-8eb5-daf918b1f8ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:10:55.284270 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b8e2aa-6769-4250-8eb5-daf918b1f8ce None admin] REQUEST_METHOD: `GET` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:10:55.284559 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b8e2aa-6769-4250-8eb5-daf918b1f8ce None admin] SCRIPT_NAME: `/identity` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:10:55.284870 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b8e2aa-6769-4250-8eb5-daf918b1f8ce None admin] PATH_INFO: `/v3/roles` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:10:55.286092 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65b8e2aa-6769-4250-8eb5-daf918b1f8ce None admin] RBAC: Adding query filter params (name=member) {{(pid=144068) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:10:55.286421 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65b8e2aa-6769-4250-8eb5-daf918b1f8ce None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:10:55.288244 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65b8e2aa-6769-4250-8eb5-daf918b1f8ce None admin] RBAC: Authorization granted {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:10:55.299124 dv-cinder-851351-1-smb devstack@keystone.service[144068]: [pid: 144068|app: 0|req: 61/120] 10.222.0.42 () {56 vars in 1101 bytes} [Thu Jul 28 08:10:55 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:10:55.301210 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba52c69a-d851-45c1-b8f0-3b32be4e6086 None None] REQUEST_METHOD: `GET` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:10:55.301548 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba52c69a-d851-45c1-b8f0-3b32be4e6086 None None] SCRIPT_NAME: `/identity` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:10:55.301832 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba52c69a-d851-45c1-b8f0-3b32be4e6086 None None] PATH_INFO: `/` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:10:55.303711 dv-cinder-851351-1-smb devstack@keystone.service[144068]: [pid: 144068|app: 0|req: 62/121] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 08:10:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 08:10:55.305159 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba52c69a-d851-45c1-b8f0-3b32be4e6086 None None] Authenticating user token {{(pid=144068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:10:55.317748 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa03e4c-d1eb-4ecd-b9be-a34dd3c0e4a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144067) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:10:55.319347 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa03e4c-d1eb-4ecd-b9be-a34dd3c0e4a0 None admin] REQUEST_METHOD: `GET` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:10:55.320250 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa03e4c-d1eb-4ecd-b9be-a34dd3c0e4a0 None admin] SCRIPT_NAME: `/identity` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:10:55.320811 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa03e4c-d1eb-4ecd-b9be-a34dd3c0e4a0 None admin] PATH_INFO: `/v3/projects/49167073baf644459c58534448b0037f` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:10:55.322482 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aa03e4c-d1eb-4ecd-b9be-a34dd3c0e4a0 None admin] RBAC: Authorizing `identity:get_project(project_id=49167073baf644459c58534448b0037f)` {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:10:55.324361 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aa03e4c-d1eb-4ecd-b9be-a34dd3c0e4a0 None admin] RBAC: Authorization granted {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:10:55.327645 dv-cinder-851351-1-smb devstack@keystone.service[144067]: [pid: 144067|app: 0|req: 60/122] 10.222.0.42 () {56 vars in 1186 bytes} [Thu Jul 28 08:10:55 2022] GET /identity/v3/projects/49167073baf644459c58534448b0037f => generated 298 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:10:55.328927 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa03e4c-d1eb-4ecd-b9be-a34dd3c0e4a0 None admin] Authenticating user token {{(pid=144067) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:10:55.411031 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG dbcounter [-] [144067] Writing DB stats keystone:SELECT=100 {{(pid=144067) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:10:55.425210 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba52c69a-d851-45c1-b8f0-3b32be4e6086 None None] Validating token access rules against request {{(pid=144068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:10:55.457315 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG dbcounter [-] [144068] Writing DB stats keystone:SELECT=100 {{(pid=144068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:10:55.461006 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa03e4c-d1eb-4ecd-b9be-a34dd3c0e4a0 None admin] Validating token access rules against request {{(pid=144067) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:10:55.465214 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f2c8db2-6c6a-4e64-85fd-4abf77e8e082 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:10:55.466149 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2c8db2-6c6a-4e64-85fd-4abf77e8e082 None admin] REQUEST_METHOD: `GET` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:10:55.466663 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2c8db2-6c6a-4e64-85fd-4abf77e8e082 None admin] SCRIPT_NAME: `/identity` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:10:55.467155 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2c8db2-6c6a-4e64-85fd-4abf77e8e082 None admin] PATH_INFO: `/v3/roles/member` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:10:55.479672 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f2c8db2-6c6a-4e64-85fd-4abf77e8e082 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 08:10:55.487160 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application [None req-2f2c8db2-6c6a-4e64-85fd-4abf77e8e082 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 28 08:10:55.487160 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:10:55.487160 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:10:55.487160 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:10:55.487160 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:10:55.487160 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:10:55.487160 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:10:55.487160 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:10:55.487160 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:10:55.487160 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:10:55.487160 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:10:55.487160 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:10:55.487160 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 08:10:55.487160 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 08:10:55.487160 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 08:10:55.487160 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 08:10:55.488256 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 08:10:55.488256 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 08:10:55.488256 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 08:10:55.488256 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 08:10:55.488256 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:10:55.488256 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:10:55.488256 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:10:55.488256 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:10:55.488256 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:10:55.488256 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:10:55.488256 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:10:55.488256 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application with Lock( Jul 28 08:10:55.488256 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:10:55.488256 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:10:55.488256 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:10:55.488256 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:10:55.489758 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:10:55.489758 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:10:55.489758 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:10:55.489758 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:10:55.489758 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 08:10:55.489758 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 08:10:55.489758 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 08:10:55.489758 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 08:10:55.489758 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 08:10:55.489758 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 08:10:55.489758 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 28 08:10:55.489758 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application Jul 28 08:10:55.494714 dv-cinder-851351-1-smb devstack@keystone.service[144068]: [pid: 144068|app: 0|req: 63/123] 10.222.0.42 () {56 vars in 1099 bytes} [Thu Jul 28 08:10:55 2022] GET /identity/v3/roles/member => generated 84 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:10:55.496808 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466c5e30-74fb-4bc9-a832-8caf76fd274e None None] REQUEST_METHOD: `POST` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:10:55.497371 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466c5e30-74fb-4bc9-a832-8caf76fd274e None None] SCRIPT_NAME: `/identity` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:10:55.497935 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466c5e30-74fb-4bc9-a832-8caf76fd274e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:10:55.516193 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6309d0f-cc6d-48da-8496-9b3fd226fc04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144067) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:10:55.516919 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6309d0f-cc6d-48da-8496-9b3fd226fc04 None admin] REQUEST_METHOD: `GET` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:10:55.517211 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6309d0f-cc6d-48da-8496-9b3fd226fc04 None admin] SCRIPT_NAME: `/identity` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:10:55.517494 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6309d0f-cc6d-48da-8496-9b3fd226fc04 None admin] PATH_INFO: `/v3/users/fbc36457370441478a0d13a56c8e0351` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:10:55.519082 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6309d0f-cc6d-48da-8496-9b3fd226fc04 None admin] RBAC: Authorizing `identity:get_user(user_id=fbc36457370441478a0d13a56c8e0351)` {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:10:55.520650 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6309d0f-cc6d-48da-8496-9b3fd226fc04 None admin] RBAC: Authorization granted {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:10:55.522771 dv-cinder-851351-1-smb devstack@keystone.service[144067]: [pid: 144067|app: 0|req: 61/124] 10.222.0.42 () {56 vars in 1177 bytes} [Thu Jul 28 08:10:55 2022] GET /identity/v3/users/fbc36457370441478a0d13a56c8e0351 => generated 275 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:10:55.523667 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6309d0f-cc6d-48da-8496-9b3fd226fc04 None admin] Authenticating user token {{(pid=144067) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:10:55.524124 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.auth.core [None req-466c5e30-74fb-4bc9-a832-8caf76fd274e None None] MFA Rules not processed for user `bf5ceb8f07374635ad506b7d1b4f1612`. Rule list: `[]` (Enabled: `True`). {{(pid=144068) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 08:10:55.525699 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.fernet_utils [None req-466c5e30-74fb-4bc9-a832-8caf76fd274e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=144068) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:10:55.615344 dv-cinder-851351-1-smb devstack@keystone.service[144068]: [pid: 144068|app: 0|req: 64/125] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 08:10:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 08:10:55.616747 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466c5e30-74fb-4bc9-a832-8caf76fd274e None None] Authenticating user token {{(pid=144068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:10:55.650861 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6309d0f-cc6d-48da-8496-9b3fd226fc04 None admin] Validating token access rules against request {{(pid=144067) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:10:55.688001 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG dbcounter [-] [144067] Writing DB stats keystone:SELECT=100 {{(pid=144067) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:10:55.694151 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc0443c-8d65-4b60-bbaf-101dbc2f4b1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144067) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:10:55.695550 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc0443c-8d65-4b60-bbaf-101dbc2f4b1f None admin] REQUEST_METHOD: `GET` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:10:55.696218 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc0443c-8d65-4b60-bbaf-101dbc2f4b1f None admin] SCRIPT_NAME: `/identity` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:10:55.696605 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc0443c-8d65-4b60-bbaf-101dbc2f4b1f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:10:55.697518 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dc0443c-8d65-4b60-bbaf-101dbc2f4b1f None admin] RBAC: Adding query filter params (role.id=aac18bff164441838e5b7d98f770be5e, scope.project.id=49167073baf644459c58534448b0037f, user.id=24f15e2e64e74ff09da0acf7fc0fad74) {{(pid=144067) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:10:55.698069 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dc0443c-8d65-4b60-bbaf-101dbc2f4b1f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:10:55.700449 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dc0443c-8d65-4b60-bbaf-101dbc2f4b1f None admin] RBAC: Authorization granted {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:10:55.707147 dv-cinder-851351-1-smb devstack@keystone.service[144067]: [pid: 144067|app: 0|req: 62/126] 10.222.0.42 () {56 vars in 1374 bytes} [Thu Jul 28 08:10:55 2022] GET /identity/v3/role_assignments?user.id=24f15e2e64e74ff09da0acf7fc0fad74&scope.project.id=49167073baf644459c58534448b0037f&role.id=aac18bff164441838e5b7d98f770be5e => generated 259 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:10:55.708524 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc0443c-8d65-4b60-bbaf-101dbc2f4b1f None admin] Authenticating user token {{(pid=144067) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:10:55.740446 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466c5e30-74fb-4bc9-a832-8caf76fd274e None None] Validating token access rules against request {{(pid=144068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:10:55.761026 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG dbcounter [-] [144068] Writing DB stats keystone:SELECT=100 {{(pid=144068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:10:55.799522 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4434a25b-5738-4ba8-bd28-aad26ac4fceb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:10:55.800843 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4434a25b-5738-4ba8-bd28-aad26ac4fceb None admin] REQUEST_METHOD: `GET` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:10:55.802174 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4434a25b-5738-4ba8-bd28-aad26ac4fceb None admin] SCRIPT_NAME: `/identity` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:10:55.802656 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4434a25b-5738-4ba8-bd28-aad26ac4fceb None admin] PATH_INFO: `/v3/roles` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:10:55.803474 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4434a25b-5738-4ba8-bd28-aad26ac4fceb None admin] RBAC: Adding query filter params (name=member) {{(pid=144068) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:10:55.803780 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4434a25b-5738-4ba8-bd28-aad26ac4fceb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:10:55.805277 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4434a25b-5738-4ba8-bd28-aad26ac4fceb None admin] RBAC: Authorization granted {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:10:55.815035 dv-cinder-851351-1-smb devstack@keystone.service[144068]: [pid: 144068|app: 0|req: 65/127] 10.222.0.42 () {56 vars in 1101 bytes} [Thu Jul 28 08:10:55 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:10:55.815739 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4434a25b-5738-4ba8-bd28-aad26ac4fceb None admin] Authenticating user token {{(pid=144068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:10:55.897596 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc0443c-8d65-4b60-bbaf-101dbc2f4b1f None admin] Validating token access rules against request {{(pid=144067) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:10:56.009762 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4434a25b-5738-4ba8-bd28-aad26ac4fceb None admin] Validating token access rules against request {{(pid=144068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:10:56.050625 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ce942f-876a-46d2-b109-e429de2d47df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144067) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:10:56.051843 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ce942f-876a-46d2-b109-e429de2d47df None admin] REQUEST_METHOD: `GET` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:10:56.052193 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ce942f-876a-46d2-b109-e429de2d47df None admin] SCRIPT_NAME: `/identity` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:10:56.052688 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ce942f-876a-46d2-b109-e429de2d47df None admin] PATH_INFO: `/v3/projects/49167073baf644459c58534448b0037f` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:10:56.060398 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59ce942f-876a-46d2-b109-e429de2d47df None admin] RBAC: Authorizing `identity:get_project(project_id=49167073baf644459c58534448b0037f)` {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:10:56.063042 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59ce942f-876a-46d2-b109-e429de2d47df None admin] RBAC: Authorization granted {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:10:56.066107 dv-cinder-851351-1-smb devstack@keystone.service[144067]: [pid: 144067|app: 0|req: 63/128] 10.222.0.42 () {56 vars in 1186 bytes} [Thu Jul 28 08:10:55 2022] GET /identity/v3/projects/49167073baf644459c58534448b0037f => generated 298 bytes in 358 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:10:56.067551 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ce942f-876a-46d2-b109-e429de2d47df None admin] Authenticating user token {{(pid=144067) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:10:56.075537 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a45880cd-f794-4c7e-8119-06b5d65ba8e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:10:56.077111 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45880cd-f794-4c7e-8119-06b5d65ba8e9 None admin] REQUEST_METHOD: `GET` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:10:56.077963 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45880cd-f794-4c7e-8119-06b5d65ba8e9 None admin] SCRIPT_NAME: `/identity` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:10:56.078788 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45880cd-f794-4c7e-8119-06b5d65ba8e9 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:10:56.102150 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a45880cd-f794-4c7e-8119-06b5d65ba8e9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 08:10:56.114054 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application [None req-a45880cd-f794-4c7e-8119-06b5d65ba8e9 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 28 08:10:56.114054 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:10:56.114054 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:10:56.114054 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:10:56.114054 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:10:56.114054 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:10:56.114054 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:10:56.114054 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:10:56.114054 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:10:56.114054 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:10:56.114054 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:10:56.114054 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:10:56.114054 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 08:10:56.114054 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 08:10:56.114054 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 08:10:56.114054 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 08:10:56.116255 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 08:10:56.116255 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 08:10:56.116255 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 08:10:56.116255 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 08:10:56.116255 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:10:56.116255 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:10:56.116255 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:10:56.116255 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:10:56.116255 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:10:56.116255 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:10:56.116255 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:10:56.116255 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application with Lock( Jul 28 08:10:56.116255 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:10:56.116255 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:10:56.116255 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:10:56.116255 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:10:56.119221 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:10:56.119221 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:10:56.119221 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:10:56.119221 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:10:56.119221 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 08:10:56.119221 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 08:10:56.119221 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 08:10:56.119221 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 08:10:56.119221 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 08:10:56.119221 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 08:10:56.119221 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 28 08:10:56.119221 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application Jul 28 08:10:56.126465 dv-cinder-851351-1-smb devstack@keystone.service[144068]: [pid: 144068|app: 0|req: 66/129] 10.222.0.42 () {56 vars in 1114 bytes} [Thu Jul 28 08:10:55 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 311 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:10:56.127133 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a45880cd-f794-4c7e-8119-06b5d65ba8e9 None admin] Authenticating user token {{(pid=144068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:10:56.175471 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG dbcounter [-] [144068] Writing DB stats keystone:SELECT=100 {{(pid=144068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:10:56.261996 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a45880cd-f794-4c7e-8119-06b5d65ba8e9 None admin] Validating token access rules against request {{(pid=144068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:10:56.269306 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG dbcounter [-] [144067] Writing DB stats keystone:SELECT=100 {{(pid=144067) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:10:56.320431 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ce942f-876a-46d2-b109-e429de2d47df None admin] Validating token access rules against request {{(pid=144067) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:10:56.366238 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7bba8a8-92de-4e83-a97f-196a52243423 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144067) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:10:56.368229 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7bba8a8-92de-4e83-a97f-196a52243423 None admin] REQUEST_METHOD: `GET` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:10:56.369148 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8076a540-059b-4d81-99ad-3775ea49495b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:10:56.369710 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7bba8a8-92de-4e83-a97f-196a52243423 None admin] SCRIPT_NAME: `/identity` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:10:56.370210 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7bba8a8-92de-4e83-a97f-196a52243423 None admin] PATH_INFO: `/v3/users/fbc36457370441478a0d13a56c8e0351` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:10:56.371140 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8076a540-059b-4d81-99ad-3775ea49495b None admin] REQUEST_METHOD: `PUT` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:10:56.372397 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8076a540-059b-4d81-99ad-3775ea49495b None admin] SCRIPT_NAME: `/identity` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:10:56.373364 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7bba8a8-92de-4e83-a97f-196a52243423 None admin] RBAC: Authorizing `identity:get_user(user_id=fbc36457370441478a0d13a56c8e0351)` {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:10:56.373872 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8076a540-059b-4d81-99ad-3775ea49495b None admin] PATH_INFO: `/v3/projects/49167073baf644459c58534448b0037f/users/fbc36457370441478a0d13a56c8e0351/roles/6933b60756fe46dd8f27854f5e192061` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:10:56.376515 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7bba8a8-92de-4e83-a97f-196a52243423 None admin] RBAC: Authorization granted {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:10:56.379054 dv-cinder-851351-1-smb devstack@keystone.service[144067]: [pid: 144067|app: 0|req: 64/130] 10.222.0.42 () {56 vars in 1177 bytes} [Thu Jul 28 08:10:56 2022] GET /identity/v3/users/fbc36457370441478a0d13a56c8e0351 => generated 275 bytes in 312 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:10:56.380405 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8076a540-059b-4d81-99ad-3775ea49495b None admin] RBAC: Authorizing `identity:create_grant(project_id=49167073baf644459c58534448b0037f, user_id=fbc36457370441478a0d13a56c8e0351, role_id=6933b60756fe46dd8f27854f5e192061)` {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:10:56.382159 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8076a540-059b-4d81-99ad-3775ea49495b None admin] RBAC: Authorization granted {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:10:56.383252 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7bba8a8-92de-4e83-a97f-196a52243423 None admin] Authenticating user token {{(pid=144067) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:10:56.407787 dv-cinder-851351-1-smb devstack@keystone.service[144068]: [pid: 144068|app: 0|req: 67/131] 10.222.0.42 () {58 vars in 1439 bytes} [Thu Jul 28 08:10:56 2022] PUT /identity/v3/projects/49167073baf644459c58534448b0037f/users/fbc36457370441478a0d13a56c8e0351/roles/6933b60756fe46dd8f27854f5e192061 => generated 0 bytes in 281 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 08:10:56.409182 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8076a540-059b-4d81-99ad-3775ea49495b None admin] Authenticating user token {{(pid=144068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:10:56.572205 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7bba8a8-92de-4e83-a97f-196a52243423 None admin] Validating token access rules against request {{(pid=144067) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:10:56.606930 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG dbcounter [-] [144068] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=144068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:10:56.607460 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG dbcounter [-] [144067] Writing DB stats keystone:SELECT=100 {{(pid=144067) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:10:56.612944 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8076a540-059b-4d81-99ad-3775ea49495b None admin] Validating token access rules against request {{(pid=144068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:10:56.613671 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c84afa90-7489-4345-9601-b31f4cc7529c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144067) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:10:56.614465 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84afa90-7489-4345-9601-b31f4cc7529c None admin] REQUEST_METHOD: `GET` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:10:56.614758 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84afa90-7489-4345-9601-b31f4cc7529c None admin] SCRIPT_NAME: `/identity` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:10:56.615043 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84afa90-7489-4345-9601-b31f4cc7529c None admin] PATH_INFO: `/v3/roles` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:10:56.615814 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c84afa90-7489-4345-9601-b31f4cc7529c None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=144067) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:10:56.616134 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c84afa90-7489-4345-9601-b31f4cc7529c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:10:56.617627 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c84afa90-7489-4345-9601-b31f4cc7529c None admin] RBAC: Authorization granted {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:10:56.627778 dv-cinder-851351-1-smb devstack@keystone.service[144067]: [pid: 144067|app: 0|req: 65/132] 10.222.0.42 () {56 vars in 1111 bytes} [Thu Jul 28 08:10:56 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:10:56.629164 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ad65fc-985d-465c-af04-444f783562c9 None None] REQUEST_METHOD: `GET` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:10:56.629570 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ad65fc-985d-465c-af04-444f783562c9 None None] SCRIPT_NAME: `/identity` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:10:56.629845 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ad65fc-985d-465c-af04-444f783562c9 None None] PATH_INFO: `/` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:10:56.631263 dv-cinder-851351-1-smb devstack@keystone.service[144067]: [pid: 144067|app: 0|req: 66/133] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 08:10:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 08:10:56.635466 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ad65fc-985d-465c-af04-444f783562c9 None None] Authenticating user token {{(pid=144067) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:10:56.663330 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d785b5-1f3e-4d55-883b-88c3b51b681f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:10:56.664018 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d785b5-1f3e-4d55-883b-88c3b51b681f None admin] REQUEST_METHOD: `GET` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:10:56.664307 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d785b5-1f3e-4d55-883b-88c3b51b681f None admin] SCRIPT_NAME: `/identity` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:10:56.664591 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d785b5-1f3e-4d55-883b-88c3b51b681f None admin] PATH_INFO: `/v3/projects/8b80e33db5a146f0ade6984dcc9c90d8` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:10:56.665970 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d785b5-1f3e-4d55-883b-88c3b51b681f None admin] RBAC: Authorizing `identity:get_project(project_id=8b80e33db5a146f0ade6984dcc9c90d8)` {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:10:56.667504 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d785b5-1f3e-4d55-883b-88c3b51b681f None admin] RBAC: Authorization granted {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:10:56.669687 dv-cinder-851351-1-smb devstack@keystone.service[144068]: [pid: 144068|app: 0|req: 68/134] 10.222.0.42 () {56 vars in 1186 bytes} [Thu Jul 28 08:10:56 2022] GET /identity/v3/projects/8b80e33db5a146f0ade6984dcc9c90d8 => generated 312 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:10:56.671021 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecdf9acc-7cf1-4d69-9396-a489bfbed139 None None] REQUEST_METHOD: `POST` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:10:56.671311 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecdf9acc-7cf1-4d69-9396-a489bfbed139 None None] SCRIPT_NAME: `/identity` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:10:56.671589 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecdf9acc-7cf1-4d69-9396-a489bfbed139 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:10:56.692062 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.auth.core [None req-ecdf9acc-7cf1-4d69-9396-a489bfbed139 None None] MFA Rules not processed for user `bf5ceb8f07374635ad506b7d1b4f1612`. Rule list: `[]` (Enabled: `True`). {{(pid=144068) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 08:10:56.693383 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.fernet_utils [None req-ecdf9acc-7cf1-4d69-9396-a489bfbed139 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=144068) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:10:56.757745 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ad65fc-985d-465c-af04-444f783562c9 None None] Validating token access rules against request {{(pid=144067) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:10:56.768375 dv-cinder-851351-1-smb devstack@keystone.service[144068]: [pid: 144068|app: 0|req: 69/135] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 08:10:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 08:10:56.769286 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecdf9acc-7cf1-4d69-9396-a489bfbed139 None None] Authenticating user token {{(pid=144068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:10:56.797109 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b708b8-a42a-4a4d-8aac-1e6cce4bc20f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144067) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:10:56.798427 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b708b8-a42a-4a4d-8aac-1e6cce4bc20f None admin] REQUEST_METHOD: `GET` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:10:56.798825 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b708b8-a42a-4a4d-8aac-1e6cce4bc20f None admin] SCRIPT_NAME: `/identity` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:10:56.799209 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b708b8-a42a-4a4d-8aac-1e6cce4bc20f None admin] PATH_INFO: `/v3/users/fbc36457370441478a0d13a56c8e0351` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:10:56.800948 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b708b8-a42a-4a4d-8aac-1e6cce4bc20f None admin] RBAC: Authorizing `identity:get_user(user_id=fbc36457370441478a0d13a56c8e0351)` {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:10:56.802896 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b708b8-a42a-4a4d-8aac-1e6cce4bc20f None admin] RBAC: Authorization granted {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:10:56.805556 dv-cinder-851351-1-smb devstack@keystone.service[144067]: [pid: 144067|app: 0|req: 67/136] 10.222.0.42 () {56 vars in 1177 bytes} [Thu Jul 28 08:10:56 2022] GET /identity/v3/users/fbc36457370441478a0d13a56c8e0351 => generated 275 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 08:10:56.814661 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b708b8-a42a-4a4d-8aac-1e6cce4bc20f None admin] Authenticating user token {{(pid=144067) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:10:56.889232 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG dbcounter [-] [144068] Writing DB stats keystone:SELECT=100 {{(pid=144068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:10:56.897010 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecdf9acc-7cf1-4d69-9396-a489bfbed139 None None] Validating token access rules against request {{(pid=144068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:10:56.898469 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG dbcounter [-] [144067] Writing DB stats keystone:SELECT=100 {{(pid=144067) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:10:56.945606 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64a3011-1c63-430c-b499-bd4e2480207d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:10:56.947802 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b708b8-a42a-4a4d-8aac-1e6cce4bc20f None admin] Validating token access rules against request {{(pid=144067) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:10:56.948701 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64a3011-1c63-430c-b499-bd4e2480207d None admin] REQUEST_METHOD: `PUT` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:10:56.950521 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64a3011-1c63-430c-b499-bd4e2480207d None admin] SCRIPT_NAME: `/identity` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:10:56.950980 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64a3011-1c63-430c-b499-bd4e2480207d None admin] PATH_INFO: `/v3/projects/8b80e33db5a146f0ade6984dcc9c90d8/users/fbc36457370441478a0d13a56c8e0351/roles/6933b60756fe46dd8f27854f5e192061` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:10:56.954288 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d64a3011-1c63-430c-b499-bd4e2480207d None admin] RBAC: Authorizing `identity:create_grant(project_id=8b80e33db5a146f0ade6984dcc9c90d8, user_id=fbc36457370441478a0d13a56c8e0351, role_id=6933b60756fe46dd8f27854f5e192061)` {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:10:56.960556 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d64a3011-1c63-430c-b499-bd4e2480207d None admin] RBAC: Authorization granted {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:10:56.982966 dv-cinder-851351-1-smb devstack@keystone.service[144068]: [pid: 144068|app: 0|req: 70/137] 10.222.0.42 () {58 vars in 1439 bytes} [Thu Jul 28 08:10:56 2022] PUT /identity/v3/projects/8b80e33db5a146f0ade6984dcc9c90d8/users/fbc36457370441478a0d13a56c8e0351/roles/6933b60756fe46dd8f27854f5e192061 => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 08:10:56.985232 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64a3011-1c63-430c-b499-bd4e2480207d None admin] Authenticating user token {{(pid=144068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:10:57.029789 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4c6989-91f5-424d-89de-5a6879ea61a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144067) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:10:57.030486 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4c6989-91f5-424d-89de-5a6879ea61a0 None admin] REQUEST_METHOD: `GET` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:10:57.030778 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4c6989-91f5-424d-89de-5a6879ea61a0 None admin] SCRIPT_NAME: `/identity` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:10:57.031062 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4c6989-91f5-424d-89de-5a6879ea61a0 None admin] PATH_INFO: `/v3/projects/49167073baf644459c58534448b0037f` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:10:57.036377 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d4c6989-91f5-424d-89de-5a6879ea61a0 None admin] RBAC: Authorizing `identity:get_project(project_id=49167073baf644459c58534448b0037f)` {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:10:57.040387 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d4c6989-91f5-424d-89de-5a6879ea61a0 None admin] RBAC: Authorization granted {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:10:57.045556 dv-cinder-851351-1-smb devstack@keystone.service[144067]: [pid: 144067|app: 0|req: 68/138] 10.222.0.42 () {56 vars in 1186 bytes} [Thu Jul 28 08:10:56 2022] GET /identity/v3/projects/49167073baf644459c58534448b0037f => generated 298 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:10:57.052967 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4c6989-91f5-424d-89de-5a6879ea61a0 None admin] Authenticating user token {{(pid=144067) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:10:57.212789 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64a3011-1c63-430c-b499-bd4e2480207d None admin] Validating token access rules against request {{(pid=144068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:10:57.274991 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4c6989-91f5-424d-89de-5a6879ea61a0 None admin] Validating token access rules against request {{(pid=144067) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:10:57.284251 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b0ac0f-4ee4-4fa5-af83-79eb0814dd08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:10:57.284987 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b0ac0f-4ee4-4fa5-af83-79eb0814dd08 None admin] REQUEST_METHOD: `GET` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:10:57.285275 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b0ac0f-4ee4-4fa5-af83-79eb0814dd08 None admin] SCRIPT_NAME: `/identity` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:10:57.285611 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b0ac0f-4ee4-4fa5-af83-79eb0814dd08 None admin] PATH_INFO: `/v3/domains/default` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:10:57.291517 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b0ac0f-4ee4-4fa5-af83-79eb0814dd08 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:10:57.293038 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b0ac0f-4ee4-4fa5-af83-79eb0814dd08 None admin] RBAC: Authorization granted {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:10:57.297627 dv-cinder-851351-1-smb devstack@keystone.service[144068]: [pid: 144068|app: 0|req: 71/139] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 08:10:56 2022] GET /identity/v3/domains/default => generated 199 bytes in 313 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:10:57.300527 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b0ac0f-4ee4-4fa5-af83-79eb0814dd08 None admin] Authenticating user token {{(pid=144068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:10:57.333804 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG dbcounter [-] [144068] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=144068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:10:57.336959 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG dbcounter [-] [144067] Writing DB stats keystone:SELECT=100 {{(pid=144067) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:10:57.346275 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc32c96-f054-4cb6-92d4-6054f6a26196 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144067) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:10:57.347429 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc32c96-f054-4cb6-92d4-6054f6a26196 None admin] REQUEST_METHOD: `PUT` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:10:57.347904 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc32c96-f054-4cb6-92d4-6054f6a26196 None admin] SCRIPT_NAME: `/identity` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:10:57.348414 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc32c96-f054-4cb6-92d4-6054f6a26196 None admin] PATH_INFO: `/v3/projects/49167073baf644459c58534448b0037f/users/fbc36457370441478a0d13a56c8e0351/roles/7e9c2306137042cf8b8eba284656ef33` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:10:57.356876 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dc32c96-f054-4cb6-92d4-6054f6a26196 None admin] RBAC: Authorizing `identity:create_grant(project_id=49167073baf644459c58534448b0037f, user_id=fbc36457370441478a0d13a56c8e0351, role_id=7e9c2306137042cf8b8eba284656ef33)` {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:10:57.358492 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dc32c96-f054-4cb6-92d4-6054f6a26196 None admin] RBAC: Authorization granted {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:10:57.392842 dv-cinder-851351-1-smb devstack@keystone.service[144067]: [pid: 144067|app: 0|req: 69/140] 10.222.0.42 () {58 vars in 1439 bytes} [Thu Jul 28 08:10:57 2022] PUT /identity/v3/projects/49167073baf644459c58534448b0037f/users/fbc36457370441478a0d13a56c8e0351/roles/7e9c2306137042cf8b8eba284656ef33 => generated 0 bytes in 336 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 08:10:57.433043 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b0ac0f-4ee4-4fa5-af83-79eb0814dd08 None admin] Validating token access rules against request {{(pid=144068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:10:57.464731 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836fcf4e-78ba-4ffe-ac78-e81d4d1478e8 None None] REQUEST_METHOD: `GET` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:10:57.464954 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836fcf4e-78ba-4ffe-ac78-e81d4d1478e8 None None] SCRIPT_NAME: `/identity` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:10:57.465216 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836fcf4e-78ba-4ffe-ac78-e81d4d1478e8 None None] PATH_INFO: `/` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:10:57.466606 dv-cinder-851351-1-smb devstack@keystone.service[144067]: [pid: 144067|app: 0|req: 70/141] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 08:10:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 28 08:10:57.473576 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd43f30b-75aa-4b9c-9fa9-b5cdcf2c724e None None] REQUEST_METHOD: `POST` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:10:57.473869 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd43f30b-75aa-4b9c-9fa9-b5cdcf2c724e None None] SCRIPT_NAME: `/identity` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:10:57.474156 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd43f30b-75aa-4b9c-9fa9-b5cdcf2c724e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:10:57.475228 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f57406ad-05c3-4491-ad60-5c35c6ce13b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:10:57.476067 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57406ad-05c3-4491-ad60-5c35c6ce13b1 None admin] REQUEST_METHOD: `POST` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:10:57.476569 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57406ad-05c3-4491-ad60-5c35c6ce13b1 None admin] SCRIPT_NAME: `/identity` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:10:57.477023 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57406ad-05c3-4491-ad60-5c35c6ce13b1 None admin] PATH_INFO: `/v3/users` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:10:57.477913 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f57406ad-05c3-4491-ad60-5c35c6ce13b1 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:10:57.479598 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f57406ad-05c3-4491-ad60-5c35c6ce13b1 None admin] RBAC: Authorization granted {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:10:57.502620 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.auth.core [None req-bd43f30b-75aa-4b9c-9fa9-b5cdcf2c724e None None] MFA Rules not processed for user `bf5ceb8f07374635ad506b7d1b4f1612`. Rule list: `[]` (Enabled: `True`). {{(pid=144067) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 08:10:57.505866 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.fernet_utils [None req-bd43f30b-75aa-4b9c-9fa9-b5cdcf2c724e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=144067) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:10:57.521647 dv-cinder-851351-1-smb devstack@keystone.service[144068]: [pid: 144068|app: 0|req: 72/142] 10.222.0.42 () {60 vars in 1132 bytes} [Thu Jul 28 08:10:57 2022] POST /identity/v3/users => generated 283 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 08:10:57.616306 dv-cinder-851351-1-smb devstack@keystone.service[144067]: [pid: 144067|app: 0|req: 71/143] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 08:10:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 08:10:57.656758 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f57406ad-05c3-4491-ad60-5c35c6ce13b1 None admin] Authenticating user token {{(pid=144068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:10:57.753291 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG dbcounter [-] [144068] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=144068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:10:57.784879 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f57406ad-05c3-4491-ad60-5c35c6ce13b1 None admin] Validating token access rules against request {{(pid=144068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:10:57.828009 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0838f71-7571-4eef-a5d4-8e640dade01f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:10:57.828700 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0838f71-7571-4eef-a5d4-8e640dade01f None admin] REQUEST_METHOD: `GET` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:10:57.828992 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0838f71-7571-4eef-a5d4-8e640dade01f None admin] SCRIPT_NAME: `/identity` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:10:57.829273 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0838f71-7571-4eef-a5d4-8e640dade01f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:10:57.841498 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0838f71-7571-4eef-a5d4-8e640dade01f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 08:10:57.853600 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application [None req-e0838f71-7571-4eef-a5d4-8e640dade01f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 08:10:57.853600 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:10:57.853600 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:10:57.853600 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:10:57.853600 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:10:57.853600 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:10:57.853600 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:10:57.853600 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:10:57.853600 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:10:57.853600 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:10:57.853600 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:10:57.853600 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:10:57.853600 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 08:10:57.853600 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 08:10:57.853600 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 08:10:57.853600 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 08:10:57.854672 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 08:10:57.854672 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 08:10:57.854672 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 08:10:57.854672 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 08:10:57.854672 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:10:57.854672 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:10:57.854672 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:10:57.854672 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:10:57.854672 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:10:57.854672 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:10:57.854672 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:10:57.854672 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application with Lock( Jul 28 08:10:57.854672 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:10:57.854672 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:10:57.854672 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:10:57.854672 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:10:57.855560 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:10:57.855560 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:10:57.855560 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:10:57.855560 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:10:57.855560 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 08:10:57.855560 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 08:10:57.855560 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 08:10:57.855560 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 08:10:57.855560 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 08:10:57.855560 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 08:10:57.855560 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 08:10:57.855560 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application Jul 28 08:10:57.855560 dv-cinder-851351-1-smb devstack@keystone.service[144068]: [pid: 144068|app: 0|req: 73/144] 10.222.0.42 () {56 vars in 1096 bytes} [Thu Jul 28 08:10:57 2022] GET /identity/v3/roles/admin => generated 83 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:10:57.861125 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd43f30b-75aa-4b9c-9fa9-b5cdcf2c724e None None] Authenticating user token {{(pid=144067) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:10:57.987286 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd43f30b-75aa-4b9c-9fa9-b5cdcf2c724e None None] Validating token access rules against request {{(pid=144067) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:10:58.015375 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG dbcounter [-] [144067] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=144067) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:10:58.041557 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84686c02-7371-4c3c-9a3a-1fee9008cd8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144067) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:10:58.042227 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84686c02-7371-4c3c-9a3a-1fee9008cd8c None admin] REQUEST_METHOD: `GET` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:10:58.042520 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84686c02-7371-4c3c-9a3a-1fee9008cd8c None admin] SCRIPT_NAME: `/identity` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:10:58.042807 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84686c02-7371-4c3c-9a3a-1fee9008cd8c None admin] PATH_INFO: `/v3/roles` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:10:58.043559 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84686c02-7371-4c3c-9a3a-1fee9008cd8c None admin] RBAC: Adding query filter params (name=admin) {{(pid=144067) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:10:58.043876 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84686c02-7371-4c3c-9a3a-1fee9008cd8c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:10:58.045333 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84686c02-7371-4c3c-9a3a-1fee9008cd8c None admin] RBAC: Authorization granted {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:10:58.058804 dv-cinder-851351-1-smb devstack@keystone.service[144067]: [pid: 144067|app: 0|req: 72/145] 10.222.0.42 () {56 vars in 1099 bytes} [Thu Jul 28 08:10:57 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:10:58.064839 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0838f71-7571-4eef-a5d4-8e640dade01f None admin] Authenticating user token {{(pid=144068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:10:58.185019 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0838f71-7571-4eef-a5d4-8e640dade01f None admin] Validating token access rules against request {{(pid=144068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:10:58.221272 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e033d812-3fff-4390-9eb4-cfaefb4df340 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:10:58.221919 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e033d812-3fff-4390-9eb4-cfaefb4df340 None admin] REQUEST_METHOD: `GET` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:10:58.222204 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e033d812-3fff-4390-9eb4-cfaefb4df340 None admin] SCRIPT_NAME: `/identity` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:10:58.222481 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e033d812-3fff-4390-9eb4-cfaefb4df340 None admin] PATH_INFO: `/v3/users/bf5ceb8f07374635ad506b7d1b4f1612` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:10:58.223732 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e033d812-3fff-4390-9eb4-cfaefb4df340 None admin] RBAC: Authorizing `identity:get_user(user_id=bf5ceb8f07374635ad506b7d1b4f1612)` {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:10:58.225241 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e033d812-3fff-4390-9eb4-cfaefb4df340 None admin] RBAC: Authorization granted {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:10:58.226889 dv-cinder-851351-1-smb devstack@keystone.service[144068]: [pid: 144068|app: 0|req: 74/146] 10.222.0.42 () {56 vars in 1177 bytes} [Thu Jul 28 08:10:58 2022] GET /identity/v3/users/bf5ceb8f07374635ad506b7d1b4f1612 => generated 247 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:10:58.232852 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84686c02-7371-4c3c-9a3a-1fee9008cd8c None admin] Authenticating user token {{(pid=144067) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:10:58.352226 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84686c02-7371-4c3c-9a3a-1fee9008cd8c None admin] Validating token access rules against request {{(pid=144067) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:10:58.390786 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b5f169-900e-4d1c-8c5c-631a21366e81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144067) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:10:58.391441 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b5f169-900e-4d1c-8c5c-631a21366e81 None admin] REQUEST_METHOD: `GET` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:10:58.391728 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b5f169-900e-4d1c-8c5c-631a21366e81 None admin] SCRIPT_NAME: `/identity` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:10:58.392010 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b5f169-900e-4d1c-8c5c-631a21366e81 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:10:58.440592 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1ca35a-b43f-4a2a-ba6e-c9ab37630f68 None None] REQUEST_METHOD: `GET` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:10:58.440976 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1ca35a-b43f-4a2a-ba6e-c9ab37630f68 None None] SCRIPT_NAME: `/identity` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:10:58.441164 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1ca35a-b43f-4a2a-ba6e-c9ab37630f68 None None] PATH_INFO: `/` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:10:58.442653 dv-cinder-851351-1-smb devstack@keystone.service[144068]: [pid: 144068|app: 0|req: 75/147] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 08:10:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 28 08:10:58.448224 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb5e9c6-8cbf-43cb-adea-3873e70c0496 None None] REQUEST_METHOD: `POST` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:10:58.448568 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb5e9c6-8cbf-43cb-adea-3873e70c0496 None None] SCRIPT_NAME: `/identity` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:10:58.448890 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb5e9c6-8cbf-43cb-adea-3873e70c0496 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:10:58.449362 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG dbcounter [-] [144067] Writing DB stats keystone:SELECT=100 {{(pid=144067) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:10:58.468473 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9b5f169-900e-4d1c-8c5c-631a21366e81 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:10:58.470019 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9b5f169-900e-4d1c-8c5c-631a21366e81 None admin] RBAC: Authorization granted {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:10:58.472496 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG dbcounter [-] [144068] Writing DB stats keystone:SELECT=100 {{(pid=144068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:10:58.484292 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.auth.core [None req-ceb5e9c6-8cbf-43cb-adea-3873e70c0496 None None] MFA Rules not processed for user `bf5ceb8f07374635ad506b7d1b4f1612`. Rule list: `[]` (Enabled: `True`). {{(pid=144068) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 08:10:58.488885 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.fernet_utils [None req-ceb5e9c6-8cbf-43cb-adea-3873e70c0496 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=144068) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:10:58.588848 dv-cinder-851351-1-smb devstack@keystone.service[144067]: [pid: 144067|app: 0|req: 73/148] 10.222.0.42 () {58 vars in 1282 bytes} [Thu Jul 28 08:10:58 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 356 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 28 08:10:58.597710 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b5f169-900e-4d1c-8c5c-631a21366e81 None admin] Authenticating user token {{(pid=144067) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:10:58.610104 dv-cinder-851351-1-smb devstack@keystone.service[144068]: [pid: 144068|app: 0|req: 76/149] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 08:10:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 28 08:10:58.632343 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb5e9c6-8cbf-43cb-adea-3873e70c0496 None None] Authenticating user token {{(pid=144068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:10:58.694067 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG dbcounter [-] [144067] Writing DB stats keystone:SELECT=100 {{(pid=144067) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:10:58.716849 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b5f169-900e-4d1c-8c5c-631a21366e81 None admin] Validating token access rules against request {{(pid=144067) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:10:58.760806 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d9ee349-dc74-4118-8da8-cfec41e8a182 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144067) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:10:58.761642 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9ee349-dc74-4118-8da8-cfec41e8a182 None admin] REQUEST_METHOD: `GET` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:10:58.761928 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9ee349-dc74-4118-8da8-cfec41e8a182 None admin] SCRIPT_NAME: `/identity` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:10:58.762216 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9ee349-dc74-4118-8da8-cfec41e8a182 None admin] PATH_INFO: `/v3/projects/49167073baf644459c58534448b0037f` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:10:58.763718 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d9ee349-dc74-4118-8da8-cfec41e8a182 None admin] RBAC: Authorizing `identity:get_project(project_id=49167073baf644459c58534448b0037f)` {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:10:58.766053 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d9ee349-dc74-4118-8da8-cfec41e8a182 None admin] RBAC: Authorization granted {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:10:58.767837 dv-cinder-851351-1-smb devstack@keystone.service[144067]: [pid: 144067|app: 0|req: 74/150] 10.222.0.42 () {56 vars in 1186 bytes} [Thu Jul 28 08:10:58 2022] GET /identity/v3/projects/49167073baf644459c58534448b0037f => generated 298 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 08:10:58.774173 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d9ee349-dc74-4118-8da8-cfec41e8a182 None admin] Authenticating user token {{(pid=144067) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:10:58.838364 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb5e9c6-8cbf-43cb-adea-3873e70c0496 None None] Validating token access rules against request {{(pid=144068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:10:58.893465 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d9ee349-dc74-4118-8da8-cfec41e8a182 None admin] Validating token access rules against request {{(pid=144067) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:10:58.909514 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c05e3a9-e7c2-4210-bd2e-9b464cafff42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:10:58.910294 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c05e3a9-e7c2-4210-bd2e-9b464cafff42 None admin] REQUEST_METHOD: `GET` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:10:58.910624 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c05e3a9-e7c2-4210-bd2e-9b464cafff42 None admin] SCRIPT_NAME: `/identity` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:10:58.910899 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c05e3a9-e7c2-4210-bd2e-9b464cafff42 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:10:58.916091 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG dbcounter [-] [144068] Writing DB stats keystone:SELECT=100 {{(pid=144068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:10:58.931920 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c05e3a9-e7c2-4210-bd2e-9b464cafff42 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 08:10:58.934309 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a70203-8432-4588-a84a-ba6742d16d6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144067) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:10:58.934952 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a70203-8432-4588-a84a-ba6742d16d6e None admin] REQUEST_METHOD: `GET` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:10:58.935232 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a70203-8432-4588-a84a-ba6742d16d6e None admin] SCRIPT_NAME: `/identity` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:10:58.935510 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a70203-8432-4588-a84a-ba6742d16d6e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:10:58.936324 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a70203-8432-4588-a84a-ba6742d16d6e None admin] RBAC: Adding query filter params (role.id=d1020e7bb0b7411d895ddedd6dc02c5b, scope.project.id=49167073baf644459c58534448b0037f, user.id=bf5ceb8f07374635ad506b7d1b4f1612) {{(pid=144067) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:10:58.936637 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a70203-8432-4588-a84a-ba6742d16d6e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:10:58.937204 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application [None req-6c05e3a9-e7c2-4210-bd2e-9b464cafff42 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 28 08:10:58.937204 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:10:58.937204 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:10:58.937204 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:10:58.937204 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:10:58.937204 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:10:58.937204 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:10:58.937204 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:10:58.937204 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:10:58.937204 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:10:58.937204 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:10:58.937204 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:10:58.937204 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 08:10:58.937204 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 08:10:58.937204 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 08:10:58.937204 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 08:10:58.939313 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 08:10:58.939313 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 08:10:58.939313 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 08:10:58.939313 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 08:10:58.939313 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:10:58.939313 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:10:58.939313 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:10:58.939313 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:10:58.939313 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:10:58.939313 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:10:58.939313 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:10:58.939313 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application with Lock( Jul 28 08:10:58.939313 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:10:58.939313 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:10:58.939313 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:10:58.939313 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:10:58.941670 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:10:58.941670 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:10:58.941670 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:10:58.941670 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:10:58.941670 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 08:10:58.941670 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 08:10:58.941670 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 08:10:58.941670 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 08:10:58.941670 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 08:10:58.941670 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 08:10:58.941670 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 28 08:10:58.941670 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application Jul 28 08:10:58.943593 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a70203-8432-4588-a84a-ba6742d16d6e None admin] RBAC: Authorization granted {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:10:58.943767 dv-cinder-851351-1-smb devstack@keystone.service[144068]: [pid: 144068|app: 0|req: 77/151] 10.222.0.42 () {56 vars in 1099 bytes} [Thu Jul 28 08:10:58 2022] GET /identity/v3/roles/reader => generated 84 bytes in 307 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 08:10:58.948686 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c05e3a9-e7c2-4210-bd2e-9b464cafff42 None admin] Authenticating user token {{(pid=144068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:10:58.948952 dv-cinder-851351-1-smb devstack@keystone.service[144067]: [pid: 144067|app: 0|req: 75/152] 10.222.0.42 () {56 vars in 1374 bytes} [Thu Jul 28 08:10:58 2022] GET /identity/v3/role_assignments?user.id=bf5ceb8f07374635ad506b7d1b4f1612&scope.project.id=49167073baf644459c58534448b0037f&role.id=d1020e7bb0b7411d895ddedd6dc02c5b => generated 608 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 08:10:59.105554 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c05e3a9-e7c2-4210-bd2e-9b464cafff42 None admin] Validating token access rules against request {{(pid=144068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:10:59.152460 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f10c9d8-3e08-44c2-843a-8717d00650f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:10:59.153059 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f10c9d8-3e08-44c2-843a-8717d00650f6 None admin] REQUEST_METHOD: `GET` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:10:59.153341 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f10c9d8-3e08-44c2-843a-8717d00650f6 None admin] SCRIPT_NAME: `/identity` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:10:59.153615 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f10c9d8-3e08-44c2-843a-8717d00650f6 None admin] PATH_INFO: `/v3/roles` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:10:59.154363 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f10c9d8-3e08-44c2-843a-8717d00650f6 None admin] RBAC: Adding query filter params (name=reader) {{(pid=144068) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:10:59.154672 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f10c9d8-3e08-44c2-843a-8717d00650f6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:10:59.156105 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f10c9d8-3e08-44c2-843a-8717d00650f6 None admin] RBAC: Authorization granted {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:10:59.166244 dv-cinder-851351-1-smb devstack@keystone.service[144068]: [pid: 144068|app: 0|req: 78/153] 10.222.0.42 () {56 vars in 1101 bytes} [Thu Jul 28 08:10:58 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:10:59.172010 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a70203-8432-4588-a84a-ba6742d16d6e None admin] Authenticating user token {{(pid=144067) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:10:59.201100 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG dbcounter [-] [144067] Writing DB stats keystone:SELECT=100 {{(pid=144067) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:10:59.299648 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a70203-8432-4588-a84a-ba6742d16d6e None admin] Validating token access rules against request {{(pid=144067) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:10:59.336507 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57cad2e7-85f9-4052-955d-cefc87cfd3b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144067) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:10:59.337222 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57cad2e7-85f9-4052-955d-cefc87cfd3b0 None admin] REQUEST_METHOD: `GET` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:10:59.337505 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57cad2e7-85f9-4052-955d-cefc87cfd3b0 None admin] SCRIPT_NAME: `/identity` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:10:59.337790 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57cad2e7-85f9-4052-955d-cefc87cfd3b0 None admin] PATH_INFO: `/v3/users/24f15e2e64e74ff09da0acf7fc0fad74` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:10:59.339025 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57cad2e7-85f9-4052-955d-cefc87cfd3b0 None admin] RBAC: Authorizing `identity:get_user(user_id=24f15e2e64e74ff09da0acf7fc0fad74)` {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:10:59.340548 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57cad2e7-85f9-4052-955d-cefc87cfd3b0 None admin] RBAC: Authorization granted {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:10:59.342808 dv-cinder-851351-1-smb devstack@keystone.service[144067]: [pid: 144067|app: 0|req: 76/154] 10.222.0.42 () {56 vars in 1177 bytes} [Thu Jul 28 08:10:59 2022] GET /identity/v3/users/24f15e2e64e74ff09da0acf7fc0fad74 => generated 289 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:10:59.348144 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f10c9d8-3e08-44c2-843a-8717d00650f6 None admin] Authenticating user token {{(pid=144068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:10:59.444907 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG dbcounter [-] [144068] Writing DB stats keystone:SELECT=100 {{(pid=144068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:10:59.508457 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f10c9d8-3e08-44c2-843a-8717d00650f6 None admin] Validating token access rules against request {{(pid=144068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:10:59.559852 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2605b1-a375-467b-9c27-7b14b001627f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:10:59.560526 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2605b1-a375-467b-9c27-7b14b001627f None admin] REQUEST_METHOD: `GET` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:10:59.560833 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2605b1-a375-467b-9c27-7b14b001627f None admin] SCRIPT_NAME: `/identity` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:10:59.561107 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2605b1-a375-467b-9c27-7b14b001627f None admin] PATH_INFO: `/v3/projects/49167073baf644459c58534448b0037f` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:10:59.562328 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb2605b1-a375-467b-9c27-7b14b001627f None admin] RBAC: Authorizing `identity:get_project(project_id=49167073baf644459c58534448b0037f)` {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:10:59.563836 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb2605b1-a375-467b-9c27-7b14b001627f None admin] RBAC: Authorization granted {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:10:59.565891 dv-cinder-851351-1-smb devstack@keystone.service[144068]: [pid: 144068|app: 0|req: 79/155] 10.222.0.42 () {56 vars in 1186 bytes} [Thu Jul 28 08:10:59 2022] GET /identity/v3/projects/49167073baf644459c58534448b0037f => generated 298 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 08:10:59.571964 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57cad2e7-85f9-4052-955d-cefc87cfd3b0 None admin] Authenticating user token {{(pid=144067) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:10:59.587524 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac476c99-e134-4f37-b75a-3e99e581ee68 None None] REQUEST_METHOD: `GET` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:10:59.587852 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac476c99-e134-4f37-b75a-3e99e581ee68 None None] SCRIPT_NAME: `/identity` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:10:59.588065 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac476c99-e134-4f37-b75a-3e99e581ee68 None None] PATH_INFO: `/` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:10:59.589721 dv-cinder-851351-1-smb devstack@keystone.service[144068]: [pid: 144068|app: 0|req: 80/156] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 08:10:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 08:10:59.595342 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0461e5ae-825d-4a75-a7ba-b29e3cd41f92 None None] REQUEST_METHOD: `POST` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:10:59.595764 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0461e5ae-825d-4a75-a7ba-b29e3cd41f92 None None] SCRIPT_NAME: `/identity` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:10:59.596043 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0461e5ae-825d-4a75-a7ba-b29e3cd41f92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:10:59.637758 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.auth.core [None req-0461e5ae-825d-4a75-a7ba-b29e3cd41f92 None None] MFA Rules not processed for user `bf5ceb8f07374635ad506b7d1b4f1612`. Rule list: `[]` (Enabled: `True`). {{(pid=144068) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 08:10:59.638978 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.fernet_utils [None req-0461e5ae-825d-4a75-a7ba-b29e3cd41f92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=144068) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:10:59.701002 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG dbcounter [-] [144067] Writing DB stats keystone:SELECT=100 {{(pid=144067) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:10:59.727102 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57cad2e7-85f9-4052-955d-cefc87cfd3b0 None admin] Validating token access rules against request {{(pid=144067) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:10:59.784543 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e4a417-0f1f-49db-be04-fba6787c881f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144067) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:10:59.786071 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e4a417-0f1f-49db-be04-fba6787c881f None admin] REQUEST_METHOD: `PUT` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:10:59.786071 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e4a417-0f1f-49db-be04-fba6787c881f None admin] SCRIPT_NAME: `/identity` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:10:59.786071 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e4a417-0f1f-49db-be04-fba6787c881f None admin] PATH_INFO: `/v3/projects/49167073baf644459c58534448b0037f/users/24f15e2e64e74ff09da0acf7fc0fad74/roles/aac18bff164441838e5b7d98f770be5e` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:10:59.790242 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7e4a417-0f1f-49db-be04-fba6787c881f None admin] RBAC: Authorizing `identity:create_grant(project_id=49167073baf644459c58534448b0037f, user_id=24f15e2e64e74ff09da0acf7fc0fad74, role_id=aac18bff164441838e5b7d98f770be5e)` {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:10:59.790437 dv-cinder-851351-1-smb devstack@keystone.service[144068]: [pid: 144068|app: 0|req: 81/157] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 08:10:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 363 bytes (3 switches on core 0) Jul 28 08:10:59.796685 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7e4a417-0f1f-49db-be04-fba6787c881f None admin] RBAC: Authorization granted {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:10:59.815506 dv-cinder-851351-1-smb devstack@keystone.service[144067]: [pid: 144067|app: 0|req: 77/158] 10.222.0.42 () {58 vars in 1439 bytes} [Thu Jul 28 08:10:59 2022] PUT /identity/v3/projects/49167073baf644459c58534448b0037f/users/24f15e2e64e74ff09da0acf7fc0fad74/roles/aac18bff164441838e5b7d98f770be5e => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 08:10:59.861358 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0461e5ae-825d-4a75-a7ba-b29e3cd41f92 None None] Authenticating user token {{(pid=144068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:10:59.929582 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG dbcounter [-] [144068] Writing DB stats keystone:SELECT=100 {{(pid=144068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:10:59.989831 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0461e5ae-825d-4a75-a7ba-b29e3cd41f92 None None] Validating token access rules against request {{(pid=144068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:11:00.039791 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9cda6e-a95e-4596-a091-f307c1936af8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:11:00.040476 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9cda6e-a95e-4596-a091-f307c1936af8 None admin] REQUEST_METHOD: `GET` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:11:00.040790 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9cda6e-a95e-4596-a091-f307c1936af8 None admin] SCRIPT_NAME: `/identity` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:11:00.041068 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9cda6e-a95e-4596-a091-f307c1936af8 None admin] PATH_INFO: `/v3/roles/member` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:11:00.053515 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d9cda6e-a95e-4596-a091-f307c1936af8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 08:11:00.058739 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application [None req-5d9cda6e-a95e-4596-a091-f307c1936af8 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 28 08:11:00.058739 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:11:00.058739 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:11:00.058739 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:11:00.058739 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:11:00.058739 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:11:00.058739 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:11:00.058739 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:11:00.058739 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:11:00.058739 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:11:00.058739 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:11:00.058739 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:11:00.058739 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 08:11:00.058739 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 08:11:00.058739 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 08:11:00.058739 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 08:11:00.059901 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 08:11:00.059901 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 08:11:00.059901 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 08:11:00.059901 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 08:11:00.059901 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:11:00.059901 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:11:00.059901 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:11:00.059901 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:11:00.059901 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:11:00.059901 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:11:00.059901 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:11:00.059901 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application with Lock( Jul 28 08:11:00.059901 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:11:00.059901 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:11:00.059901 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:11:00.059901 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:11:00.060852 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:11:00.060852 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:11:00.060852 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:11:00.060852 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:11:00.060852 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 08:11:00.060852 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 08:11:00.060852 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 08:11:00.060852 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 08:11:00.060852 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 08:11:00.060852 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 08:11:00.060852 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 28 08:11:00.060852 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application Jul 28 08:11:00.060852 dv-cinder-851351-1-smb devstack@keystone.service[144068]: [pid: 144068|app: 0|req: 82/159] 10.222.0.42 () {56 vars in 1099 bytes} [Thu Jul 28 08:10:59 2022] GET /identity/v3/roles/member => generated 84 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:11:00.066487 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e4a417-0f1f-49db-be04-fba6787c881f None admin] Authenticating user token {{(pid=144067) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:11:00.208009 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e4a417-0f1f-49db-be04-fba6787c881f None admin] Validating token access rules against request {{(pid=144067) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:11:00.256368 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d67e29-36c0-451b-8d3e-6d46fd4f4421 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144067) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:11:00.257418 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d67e29-36c0-451b-8d3e-6d46fd4f4421 None admin] REQUEST_METHOD: `GET` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:11:00.257933 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d67e29-36c0-451b-8d3e-6d46fd4f4421 None admin] SCRIPT_NAME: `/identity` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:11:00.258421 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d67e29-36c0-451b-8d3e-6d46fd4f4421 None admin] PATH_INFO: `/v3/roles` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:11:00.259399 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24d67e29-36c0-451b-8d3e-6d46fd4f4421 None admin] RBAC: Adding query filter params (name=member) {{(pid=144067) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:11:00.259952 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24d67e29-36c0-451b-8d3e-6d46fd4f4421 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:11:00.261625 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24d67e29-36c0-451b-8d3e-6d46fd4f4421 None admin] RBAC: Authorization granted {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:11:00.271236 dv-cinder-851351-1-smb devstack@keystone.service[144067]: [pid: 144067|app: 0|req: 78/160] 10.222.0.42 () {56 vars in 1101 bytes} [Thu Jul 28 08:11:00 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:11:00.277160 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9cda6e-a95e-4596-a091-f307c1936af8 None admin] Authenticating user token {{(pid=144068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:11:00.410733 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9cda6e-a95e-4596-a091-f307c1936af8 None admin] Validating token access rules against request {{(pid=144068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:11:00.431496 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG dbcounter [-] [144068] Writing DB stats keystone:SELECT=100 {{(pid=144068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:11:00.455484 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5135bdbd-e294-4488-a404-f483d16a97bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:11:00.456154 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5135bdbd-e294-4488-a404-f483d16a97bf None admin] REQUEST_METHOD: `GET` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:11:00.456436 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5135bdbd-e294-4488-a404-f483d16a97bf None admin] SCRIPT_NAME: `/identity` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:11:00.456736 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5135bdbd-e294-4488-a404-f483d16a97bf None admin] PATH_INFO: `/v3/users/fbc36457370441478a0d13a56c8e0351` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:11:00.458028 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5135bdbd-e294-4488-a404-f483d16a97bf None admin] RBAC: Authorizing `identity:get_user(user_id=fbc36457370441478a0d13a56c8e0351)` {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:11:00.459515 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5135bdbd-e294-4488-a404-f483d16a97bf None admin] RBAC: Authorization granted {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:11:00.463986 dv-cinder-851351-1-smb devstack@keystone.service[144068]: [pid: 144068|app: 0|req: 83/161] 10.222.0.42 () {56 vars in 1177 bytes} [Thu Jul 28 08:11:00 2022] GET /identity/v3/users/fbc36457370441478a0d13a56c8e0351 => generated 275 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:11:00.467147 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d67e29-36c0-451b-8d3e-6d46fd4f4421 None admin] Authenticating user token {{(pid=144067) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:11:00.476816 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG dbcounter [-] [144067] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=144067) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:11:00.601326 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d67e29-36c0-451b-8d3e-6d46fd4f4421 None admin] Validating token access rules against request {{(pid=144067) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:11:00.643018 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e75c828e-2c00-4031-84d6-c6795a1afa99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144067) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:11:00.643676 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75c828e-2c00-4031-84d6-c6795a1afa99 None admin] REQUEST_METHOD: `GET` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:11:00.643964 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75c828e-2c00-4031-84d6-c6795a1afa99 None admin] SCRIPT_NAME: `/identity` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:11:00.644248 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75c828e-2c00-4031-84d6-c6795a1afa99 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:11:00.735180 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e75c828e-2c00-4031-84d6-c6795a1afa99 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:11:00.737143 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e75c828e-2c00-4031-84d6-c6795a1afa99 None admin] RBAC: Authorization granted {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:11:00.750436 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG dbcounter [-] [144067] Writing DB stats keystone:SELECT=100 {{(pid=144067) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:11:00.816418 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266848af-e586-4b62-ac8b-5fdbb38982ae None None] REQUEST_METHOD: `GET` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:11:00.816843 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266848af-e586-4b62-ac8b-5fdbb38982ae None None] SCRIPT_NAME: `/identity` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:11:00.817291 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266848af-e586-4b62-ac8b-5fdbb38982ae None None] PATH_INFO: `/` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:11:00.818931 dv-cinder-851351-1-smb devstack@keystone.service[144068]: [pid: 144068|app: 0|req: 84/162] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 08:11:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 08:11:00.838796 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c9a723-1392-4f52-943d-3dfa942b621d None None] REQUEST_METHOD: `POST` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:11:00.839275 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c9a723-1392-4f52-943d-3dfa942b621d None None] SCRIPT_NAME: `/identity` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:11:00.839752 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c9a723-1392-4f52-943d-3dfa942b621d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:11:00.877788 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.auth.core [None req-63c9a723-1392-4f52-943d-3dfa942b621d None None] MFA Rules not processed for user `bf5ceb8f07374635ad506b7d1b4f1612`. Rule list: `[]` (Enabled: `True`). {{(pid=144068) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 08:11:00.878958 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.fernet_utils [None req-63c9a723-1392-4f52-943d-3dfa942b621d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=144068) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:11:00.886823 dv-cinder-851351-1-smb devstack@keystone.service[144067]: [pid: 144067|app: 0|req: 79/163] 10.222.0.42 () {58 vars in 1282 bytes} [Thu Jul 28 08:11:00 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 420 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 28 08:11:00.896178 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e75c828e-2c00-4031-84d6-c6795a1afa99 None admin] Authenticating user token {{(pid=144067) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:11:01.054058 dv-cinder-851351-1-smb devstack@keystone.service[144068]: [pid: 144068|app: 0|req: 85/164] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 08:11:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 28 08:11:01.083498 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c9a723-1392-4f52-943d-3dfa942b621d None None] Authenticating user token {{(pid=144068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:11:01.085500 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e75c828e-2c00-4031-84d6-c6795a1afa99 None admin] Validating token access rules against request {{(pid=144067) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:11:01.093851 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG dbcounter [-] [144067] Writing DB stats keystone:SELECT=100 {{(pid=144067) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:11:01.149502 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552ce56c-fb89-4453-83be-91d62c32e214 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144067) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:11:01.150576 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552ce56c-fb89-4453-83be-91d62c32e214 None admin] REQUEST_METHOD: `GET` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:11:01.151112 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552ce56c-fb89-4453-83be-91d62c32e214 None admin] SCRIPT_NAME: `/identity` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:11:01.151610 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552ce56c-fb89-4453-83be-91d62c32e214 None admin] PATH_INFO: `/v3/projects/49167073baf644459c58534448b0037f` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:11:01.153238 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-552ce56c-fb89-4453-83be-91d62c32e214 None admin] RBAC: Authorizing `identity:get_project(project_id=49167073baf644459c58534448b0037f)` {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:11:01.154977 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-552ce56c-fb89-4453-83be-91d62c32e214 None admin] RBAC: Authorization granted {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:11:01.157325 dv-cinder-851351-1-smb devstack@keystone.service[144067]: [pid: 144067|app: 0|req: 80/165] 10.222.0.42 () {56 vars in 1186 bytes} [Thu Jul 28 08:11:00 2022] GET /identity/v3/projects/49167073baf644459c58534448b0037f => generated 298 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 08:11:01.168798 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552ce56c-fb89-4453-83be-91d62c32e214 None admin] Authenticating user token {{(pid=144067) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:11:01.281623 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c9a723-1392-4f52-943d-3dfa942b621d None None] Validating token access rules against request {{(pid=144068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:11:01.305309 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG dbcounter [-] [144068] Writing DB stats keystone:SELECT=100 {{(pid=144068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:11:01.337183 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b2494fc-fde2-4d7c-bc6f-904f0c7e2589 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:11:01.338265 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2494fc-fde2-4d7c-bc6f-904f0c7e2589 None admin] REQUEST_METHOD: `GET` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:11:01.338828 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2494fc-fde2-4d7c-bc6f-904f0c7e2589 None admin] SCRIPT_NAME: `/identity` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:11:01.339333 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2494fc-fde2-4d7c-bc6f-904f0c7e2589 None admin] PATH_INFO: `/v3/roles/member` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:11:01.359813 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b2494fc-fde2-4d7c-bc6f-904f0c7e2589 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 08:11:01.367198 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application [None req-1b2494fc-fde2-4d7c-bc6f-904f0c7e2589 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 28 08:11:01.367198 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:11:01.367198 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:11:01.367198 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:11:01.367198 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:11:01.367198 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:11:01.367198 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:11:01.367198 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:11:01.367198 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:11:01.367198 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:11:01.367198 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:11:01.367198 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:11:01.367198 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 08:11:01.367198 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 08:11:01.367198 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 08:11:01.367198 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 08:11:01.368209 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 08:11:01.368209 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 08:11:01.368209 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 08:11:01.368209 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 08:11:01.368209 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:11:01.368209 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:11:01.368209 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:11:01.368209 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:11:01.368209 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:11:01.368209 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:11:01.368209 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:11:01.368209 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application with Lock( Jul 28 08:11:01.368209 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:11:01.368209 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:11:01.368209 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:11:01.368209 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:11:01.369182 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:11:01.369182 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:11:01.369182 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:11:01.369182 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:11:01.369182 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 08:11:01.369182 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 08:11:01.369182 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 08:11:01.369182 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 08:11:01.369182 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 08:11:01.369182 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 08:11:01.369182 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 28 08:11:01.369182 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application Jul 28 08:11:01.381000 dv-cinder-851351-1-smb devstack@keystone.service[144068]: [pid: 144068|app: 0|req: 86/166] 10.222.0.42 () {56 vars in 1099 bytes} [Thu Jul 28 08:11:01 2022] GET /identity/v3/roles/member => generated 84 bytes in 295 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:11:01.381000 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97412c26-1ae3-4767-8bc1-51c0246905f5 None None] REQUEST_METHOD: `GET` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:11:01.381000 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97412c26-1ae3-4767-8bc1-51c0246905f5 None None] SCRIPT_NAME: `/identity` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:11:01.381000 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97412c26-1ae3-4767-8bc1-51c0246905f5 None None] PATH_INFO: `/` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:11:01.381000 dv-cinder-851351-1-smb devstack@keystone.service[144068]: [pid: 144068|app: 0|req: 87/167] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 08:11:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 08:11:01.384322 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97412c26-1ae3-4767-8bc1-51c0246905f5 None None] Authenticating user token {{(pid=144068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:11:01.399087 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552ce56c-fb89-4453-83be-91d62c32e214 None admin] Validating token access rules against request {{(pid=144067) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:11:01.473108 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75508723-ed23-4861-8a45-1e6f8774d324 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144067) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:11:01.474227 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75508723-ed23-4861-8a45-1e6f8774d324 None admin] REQUEST_METHOD: `GET` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:11:01.474722 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75508723-ed23-4861-8a45-1e6f8774d324 None admin] SCRIPT_NAME: `/identity` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:11:01.475233 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75508723-ed23-4861-8a45-1e6f8774d324 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:11:01.476255 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75508723-ed23-4861-8a45-1e6f8774d324 None admin] RBAC: Adding query filter params (role.id=6933b60756fe46dd8f27854f5e192061, scope.project.id=49167073baf644459c58534448b0037f, user.id=fbc36457370441478a0d13a56c8e0351) {{(pid=144067) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:11:01.476968 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75508723-ed23-4861-8a45-1e6f8774d324 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:11:01.478681 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75508723-ed23-4861-8a45-1e6f8774d324 None admin] RBAC: Authorization granted {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:11:01.489600 dv-cinder-851351-1-smb devstack@keystone.service[144067]: [pid: 144067|app: 0|req: 81/168] 10.222.0.42 () {56 vars in 1374 bytes} [Thu Jul 28 08:11:01 2022] GET /identity/v3/role_assignments?user.id=fbc36457370441478a0d13a56c8e0351&scope.project.id=49167073baf644459c58534448b0037f&role.id=6933b60756fe46dd8f27854f5e192061 => generated 608 bytes in 321 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 08:11:01.491295 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a85255-caeb-4e1e-a8db-80a73bad74d7 None None] REQUEST_METHOD: `POST` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:11:01.491813 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a85255-caeb-4e1e-a8db-80a73bad74d7 None None] SCRIPT_NAME: `/identity` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:11:01.492317 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a85255-caeb-4e1e-a8db-80a73bad74d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:11:01.523680 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.auth.core [None req-56a85255-caeb-4e1e-a8db-80a73bad74d7 None None] MFA Rules not processed for user `bf5ceb8f07374635ad506b7d1b4f1612`. Rule list: `[]` (Enabled: `True`). {{(pid=144067) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 08:11:01.525507 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.fernet_utils [None req-56a85255-caeb-4e1e-a8db-80a73bad74d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=144067) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:11:01.570191 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97412c26-1ae3-4767-8bc1-51c0246905f5 None None] Validating token access rules against request {{(pid=144068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:11:01.581142 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG dbcounter [-] [144067] Writing DB stats keystone:SELECT=100 {{(pid=144067) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:11:01.621562 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab57c032-dc5d-49b0-8df7-0f4009d7a59a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:11:01.622229 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab57c032-dc5d-49b0-8df7-0f4009d7a59a None admin] REQUEST_METHOD: `GET` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:11:01.622512 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab57c032-dc5d-49b0-8df7-0f4009d7a59a None admin] SCRIPT_NAME: `/identity` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:11:01.622783 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab57c032-dc5d-49b0-8df7-0f4009d7a59a None admin] PATH_INFO: `/v3/roles` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:11:01.623537 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab57c032-dc5d-49b0-8df7-0f4009d7a59a None admin] RBAC: Adding query filter params (name=member) {{(pid=144068) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:11:01.623848 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab57c032-dc5d-49b0-8df7-0f4009d7a59a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:11:01.625307 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab57c032-dc5d-49b0-8df7-0f4009d7a59a None admin] RBAC: Authorization granted {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:11:01.639346 dv-cinder-851351-1-smb devstack@keystone.service[144068]: [pid: 144068|app: 0|req: 88/169] 10.222.0.42 () {56 vars in 1101 bytes} [Thu Jul 28 08:11:01 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:11:01.647914 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab57c032-dc5d-49b0-8df7-0f4009d7a59a None admin] Authenticating user token {{(pid=144068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:11:01.654568 dv-cinder-851351-1-smb devstack@keystone.service[144067]: [pid: 144067|app: 0|req: 82/170] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 08:11:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 08:11:01.702237 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a85255-caeb-4e1e-a8db-80a73bad74d7 None None] Authenticating user token {{(pid=144067) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:11:01.734058 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG dbcounter [-] [144068] Writing DB stats keystone:SELECT=100 {{(pid=144068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:11:01.878644 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab57c032-dc5d-49b0-8df7-0f4009d7a59a None admin] Validating token access rules against request {{(pid=144068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:11:01.881826 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a85255-caeb-4e1e-a8db-80a73bad74d7 None None] Validating token access rules against request {{(pid=144067) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:11:01.926983 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e1b710-8e46-4659-b830-b158914d62f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144067) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:11:01.927663 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e1b710-8e46-4659-b830-b158914d62f9 None admin] REQUEST_METHOD: `GET` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:11:01.927945 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e1b710-8e46-4659-b830-b158914d62f9 None admin] SCRIPT_NAME: `/identity` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:11:01.928222 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e1b710-8e46-4659-b830-b158914d62f9 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:11:01.948641 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e1b710-8e46-4659-b830-b158914d62f9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 08:11:01.951456 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c701d350-8600-41e3-bb07-9077a49fb67e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:11:01.952134 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c701d350-8600-41e3-bb07-9077a49fb67e None admin] REQUEST_METHOD: `GET` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:11:01.952405 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c701d350-8600-41e3-bb07-9077a49fb67e None admin] SCRIPT_NAME: `/identity` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:11:01.952713 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c701d350-8600-41e3-bb07-9077a49fb67e None admin] PATH_INFO: `/v3/users/fbc36457370441478a0d13a56c8e0351` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:11:01.954770 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c701d350-8600-41e3-bb07-9077a49fb67e None admin] RBAC: Authorizing `identity:get_user(user_id=fbc36457370441478a0d13a56c8e0351)` {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:11:01.956244 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c701d350-8600-41e3-bb07-9077a49fb67e None admin] RBAC: Authorization granted {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:11:01.956647 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application [None req-49e1b710-8e46-4659-b830-b158914d62f9 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 28 08:11:01.956647 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:11:01.956647 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:11:01.956647 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:11:01.956647 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:11:01.956647 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:11:01.956647 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:11:01.956647 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:11:01.956647 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:11:01.956647 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:11:01.956647 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:11:01.956647 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:11:01.956647 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 08:11:01.956647 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 08:11:01.956647 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 08:11:01.956647 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 08:11:01.957733 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 08:11:01.957733 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 08:11:01.957733 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 08:11:01.957733 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 08:11:01.957733 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:11:01.957733 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:11:01.957733 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:11:01.957733 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:11:01.957733 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:11:01.957733 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:11:01.957733 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:11:01.957733 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application with Lock( Jul 28 08:11:01.957733 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:11:01.957733 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:11:01.957733 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:11:01.957733 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:11:01.958681 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:11:01.958681 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:11:01.958681 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:11:01.958681 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:11:01.958681 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 08:11:01.958681 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 08:11:01.958681 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 08:11:01.958681 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 08:11:01.958681 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 08:11:01.958681 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 08:11:01.958681 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 28 08:11:01.958681 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application Jul 28 08:11:01.959363 dv-cinder-851351-1-smb devstack@keystone.service[144068]: [pid: 144068|app: 0|req: 89/171] 10.222.0.42 () {56 vars in 1177 bytes} [Thu Jul 28 08:11:01 2022] GET /identity/v3/users/fbc36457370441478a0d13a56c8e0351 => generated 275 bytes in 311 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 08:11:01.961867 dv-cinder-851351-1-smb devstack@keystone.service[144067]: [pid: 144067|app: 0|req: 83/172] 10.222.0.42 () {56 vars in 1114 bytes} [Thu Jul 28 08:11:01 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 260 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:11:01.966180 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4717cf2-c64b-4097-afb3-18f8112c7d6d None None] REQUEST_METHOD: `GET` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:11:01.966476 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4717cf2-c64b-4097-afb3-18f8112c7d6d None None] SCRIPT_NAME: `/identity` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:11:01.966759 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4717cf2-c64b-4097-afb3-18f8112c7d6d None None] PATH_INFO: `/` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:11:01.967632 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e1b710-8e46-4659-b830-b158914d62f9 None admin] Authenticating user token {{(pid=144067) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:11:01.968269 dv-cinder-851351-1-smb devstack@keystone.service[144068]: [pid: 144068|app: 0|req: 90/173] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 08:11:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 08:11:01.974755 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cabcb8ab-8e96-48fb-b143-6ffb24510cb7 None None] REQUEST_METHOD: `POST` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:11:01.974755 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cabcb8ab-8e96-48fb-b143-6ffb24510cb7 None None] SCRIPT_NAME: `/identity` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:11:01.974755 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cabcb8ab-8e96-48fb-b143-6ffb24510cb7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:11:02.010057 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG dbcounter [-] [144067] Writing DB stats keystone:SELECT=100 {{(pid=144067) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:11:02.017123 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.auth.core [None req-cabcb8ab-8e96-48fb-b143-6ffb24510cb7 None None] MFA Rules not processed for user `bf5ceb8f07374635ad506b7d1b4f1612`. Rule list: `[]` (Enabled: `True`). {{(pid=144068) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 08:11:02.018442 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.fernet_utils [None req-cabcb8ab-8e96-48fb-b143-6ffb24510cb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=144068) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:11:02.089832 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e1b710-8e46-4659-b830-b158914d62f9 None admin] Validating token access rules against request {{(pid=144067) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:11:02.128455 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c517b8-69bf-41e2-be4f-c1eb5faac8c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144067) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:11:02.129596 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c517b8-69bf-41e2-be4f-c1eb5faac8c4 None admin] REQUEST_METHOD: `GET` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:11:02.130113 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c517b8-69bf-41e2-be4f-c1eb5faac8c4 None admin] SCRIPT_NAME: `/identity` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:11:02.130624 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c517b8-69bf-41e2-be4f-c1eb5faac8c4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:11:02.133841 dv-cinder-851351-1-smb devstack@keystone.service[144068]: [pid: 144068|app: 0|req: 91/174] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 08:11:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 08:11:02.134588 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cabcb8ab-8e96-48fb-b143-6ffb24510cb7 None None] Authenticating user token {{(pid=144068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:11:02.198632 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG dbcounter [-] [144068] Writing DB stats keystone:SELECT=100 {{(pid=144068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:11:02.207915 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32c517b8-69bf-41e2-be4f-c1eb5faac8c4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:11:02.210528 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32c517b8-69bf-41e2-be4f-c1eb5faac8c4 None admin] RBAC: Authorization granted {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:11:02.245124 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG dbcounter [-] [144067] Writing DB stats keystone:SELECT=100 {{(pid=144067) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:11:02.330584 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cabcb8ab-8e96-48fb-b143-6ffb24510cb7 None None] Validating token access rules against request {{(pid=144068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:11:02.364786 dv-cinder-851351-1-smb devstack@keystone.service[144067]: [pid: 144067|app: 0|req: 84/175] 10.222.0.42 () {58 vars in 1282 bytes} [Thu Jul 28 08:11:01 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 395 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 28 08:11:02.366116 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c517b8-69bf-41e2-be4f-c1eb5faac8c4 None admin] Authenticating user token {{(pid=144067) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:11:02.402748 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493bec46-380e-419f-abb8-2c0873fe016d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:11:02.403396 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493bec46-380e-419f-abb8-2c0873fe016d None admin] REQUEST_METHOD: `GET` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:11:02.403673 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493bec46-380e-419f-abb8-2c0873fe016d None admin] SCRIPT_NAME: `/identity` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:11:02.404131 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493bec46-380e-419f-abb8-2c0873fe016d None admin] PATH_INFO: `/v3/roles` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:11:02.405053 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-493bec46-380e-419f-abb8-2c0873fe016d None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=144068) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:11:02.405507 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-493bec46-380e-419f-abb8-2c0873fe016d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:11:02.407100 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-493bec46-380e-419f-abb8-2c0873fe016d None admin] RBAC: Authorization granted {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:11:02.423475 dv-cinder-851351-1-smb devstack@keystone.service[144068]: [pid: 144068|app: 0|req: 92/176] 10.222.0.42 () {56 vars in 1111 bytes} [Thu Jul 28 08:11:02 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 289 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:11:02.424585 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493bec46-380e-419f-abb8-2c0873fe016d None admin] Authenticating user token {{(pid=144068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:11:02.480027 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c517b8-69bf-41e2-be4f-c1eb5faac8c4 None admin] Validating token access rules against request {{(pid=144067) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:11:02.509174 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG dbcounter [-] [144067] Writing DB stats keystone:SELECT=100 {{(pid=144067) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:11:02.519055 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24706b88-c973-488e-89d9-8b040dfd1503 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144067) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:11:02.520319 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24706b88-c973-488e-89d9-8b040dfd1503 None admin] REQUEST_METHOD: `GET` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:11:02.520829 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24706b88-c973-488e-89d9-8b040dfd1503 None admin] SCRIPT_NAME: `/identity` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:11:02.521286 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24706b88-c973-488e-89d9-8b040dfd1503 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:11:02.533012 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24706b88-c973-488e-89d9-8b040dfd1503 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 08:11:02.538636 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application [None req-24706b88-c973-488e-89d9-8b040dfd1503 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 08:11:02.538636 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:11:02.538636 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:11:02.538636 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:11:02.538636 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:11:02.538636 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:11:02.538636 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:11:02.538636 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:11:02.538636 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:11:02.538636 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:11:02.538636 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:11:02.538636 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:11:02.538636 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 08:11:02.538636 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 08:11:02.538636 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 08:11:02.538636 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 08:11:02.539693 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 08:11:02.539693 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 08:11:02.539693 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 08:11:02.539693 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 08:11:02.539693 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:11:02.539693 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:11:02.539693 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:11:02.539693 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:11:02.539693 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:11:02.539693 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:11:02.539693 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:11:02.539693 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application with Lock( Jul 28 08:11:02.539693 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:11:02.539693 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:11:02.539693 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:11:02.539693 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:11:02.540581 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:11:02.540581 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:11:02.540581 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:11:02.540581 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:11:02.540581 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 08:11:02.540581 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 08:11:02.540581 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 08:11:02.540581 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 08:11:02.540581 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 08:11:02.540581 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 08:11:02.540581 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 08:11:02.540581 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application Jul 28 08:11:02.543141 dv-cinder-851351-1-smb devstack@keystone.service[144067]: [pid: 144067|app: 0|req: 85/177] 10.222.0.42 () {56 vars in 1096 bytes} [Thu Jul 28 08:11:02 2022] GET /identity/v3/roles/admin => generated 83 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:11:02.544297 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24706b88-c973-488e-89d9-8b040dfd1503 None admin] Authenticating user token {{(pid=144067) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:11:02.649848 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG dbcounter [-] [144068] Writing DB stats keystone:SELECT=100 {{(pid=144068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:11:02.658497 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493bec46-380e-419f-abb8-2c0873fe016d None admin] Validating token access rules against request {{(pid=144068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:11:02.666522 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24706b88-c973-488e-89d9-8b040dfd1503 None admin] Validating token access rules against request {{(pid=144067) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:11:02.727433 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b63e6ff-03d2-4ef7-a468-1c6affe4aeb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:11:02.728508 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b63e6ff-03d2-4ef7-a468-1c6affe4aeb9 None admin] REQUEST_METHOD: `GET` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:11:02.729001 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b63e6ff-03d2-4ef7-a468-1c6affe4aeb9 None admin] SCRIPT_NAME: `/identity` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:11:02.729481 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b63e6ff-03d2-4ef7-a468-1c6affe4aeb9 None admin] PATH_INFO: `/v3/projects/8b80e33db5a146f0ade6984dcc9c90d8` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:11:02.731328 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b63e6ff-03d2-4ef7-a468-1c6affe4aeb9 None admin] RBAC: Authorizing `identity:get_project(project_id=8b80e33db5a146f0ade6984dcc9c90d8)` {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:11:02.733031 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b63e6ff-03d2-4ef7-a468-1c6affe4aeb9 None admin] RBAC: Authorization granted {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:11:02.740145 dv-cinder-851351-1-smb devstack@keystone.service[144068]: [pid: 144068|app: 0|req: 93/178] 10.222.0.42 () {56 vars in 1186 bytes} [Thu Jul 28 08:11:02 2022] GET /identity/v3/projects/8b80e33db5a146f0ade6984dcc9c90d8 => generated 312 bytes in 311 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:11:02.741339 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b63e6ff-03d2-4ef7-a468-1c6affe4aeb9 None admin] Authenticating user token {{(pid=144068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:11:02.743180 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abcd3f9c-0b96-4677-bbbf-97babad89913 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144067) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:11:02.743869 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abcd3f9c-0b96-4677-bbbf-97babad89913 None admin] REQUEST_METHOD: `GET` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:11:02.744148 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abcd3f9c-0b96-4677-bbbf-97babad89913 None admin] SCRIPT_NAME: `/identity` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:11:02.744422 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abcd3f9c-0b96-4677-bbbf-97babad89913 None admin] PATH_INFO: `/v3/users/fbc36457370441478a0d13a56c8e0351` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:11:02.745676 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abcd3f9c-0b96-4677-bbbf-97babad89913 None admin] RBAC: Authorizing `identity:get_user(user_id=fbc36457370441478a0d13a56c8e0351)` {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:11:02.747187 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abcd3f9c-0b96-4677-bbbf-97babad89913 None admin] RBAC: Authorization granted {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:11:02.748981 dv-cinder-851351-1-smb devstack@keystone.service[144067]: [pid: 144067|app: 0|req: 86/179] 10.222.0.42 () {56 vars in 1177 bytes} [Thu Jul 28 08:11:02 2022] GET /identity/v3/users/fbc36457370441478a0d13a56c8e0351 => generated 275 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:11:02.752766 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abcd3f9c-0b96-4677-bbbf-97babad89913 None admin] Authenticating user token {{(pid=144067) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:11:02.828537 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG dbcounter [-] [144067] Writing DB stats keystone:SELECT=100 {{(pid=144067) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:11:02.859757 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b63e6ff-03d2-4ef7-a468-1c6affe4aeb9 None admin] Validating token access rules against request {{(pid=144068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:11:02.878827 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abcd3f9c-0b96-4677-bbbf-97babad89913 None admin] Validating token access rules against request {{(pid=144067) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:11:02.894631 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19d9e06-c0e5-4954-b84d-c0a16c7a84ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:11:02.895649 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19d9e06-c0e5-4954-b84d-c0a16c7a84ba None admin] REQUEST_METHOD: `GET` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:11:02.896126 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19d9e06-c0e5-4954-b84d-c0a16c7a84ba None admin] SCRIPT_NAME: `/identity` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:11:02.896594 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19d9e06-c0e5-4954-b84d-c0a16c7a84ba None admin] PATH_INFO: `/v3/roles` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:11:02.897555 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c19d9e06-c0e5-4954-b84d-c0a16c7a84ba None admin] RBAC: Adding query filter params (name=admin) {{(pid=144068) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:11:02.898041 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c19d9e06-c0e5-4954-b84d-c0a16c7a84ba None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:11:02.899647 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c19d9e06-c0e5-4954-b84d-c0a16c7a84ba None admin] RBAC: Authorization granted {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:11:02.908538 dv-cinder-851351-1-smb devstack@keystone.service[144068]: [pid: 144068|app: 0|req: 94/180] 10.222.0.42 () {56 vars in 1099 bytes} [Thu Jul 28 08:11:02 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:11:02.909707 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19d9e06-c0e5-4954-b84d-c0a16c7a84ba None admin] Authenticating user token {{(pid=144068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:11:02.916575 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b28ca5-a550-4f92-a935-bfc78da95985 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144067) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:11:02.917323 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b28ca5-a550-4f92-a935-bfc78da95985 None admin] REQUEST_METHOD: `GET` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:11:02.917608 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b28ca5-a550-4f92-a935-bfc78da95985 None admin] SCRIPT_NAME: `/identity` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:11:02.917886 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b28ca5-a550-4f92-a935-bfc78da95985 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:11:02.918699 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4b28ca5-a550-4f92-a935-bfc78da95985 None admin] RBAC: Adding query filter params (role.id=6933b60756fe46dd8f27854f5e192061, scope.project.id=8b80e33db5a146f0ade6984dcc9c90d8, user.id=fbc36457370441478a0d13a56c8e0351) {{(pid=144067) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:11:02.919068 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4b28ca5-a550-4f92-a935-bfc78da95985 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:11:02.920557 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4b28ca5-a550-4f92-a935-bfc78da95985 None admin] RBAC: Authorization granted {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:11:02.929660 dv-cinder-851351-1-smb devstack@keystone.service[144067]: [pid: 144067|app: 0|req: 87/181] 10.222.0.42 () {56 vars in 1374 bytes} [Thu Jul 28 08:11:02 2022] GET /identity/v3/role_assignments?user.id=fbc36457370441478a0d13a56c8e0351&scope.project.id=8b80e33db5a146f0ade6984dcc9c90d8&role.id=6933b60756fe46dd8f27854f5e192061 => generated 608 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:11:02.931034 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c6b029-b84a-421b-b937-721847ada7c8 None None] REQUEST_METHOD: `GET` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:11:02.931507 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c6b029-b84a-421b-b937-721847ada7c8 None None] SCRIPT_NAME: `/identity` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:11:02.931948 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c6b029-b84a-421b-b937-721847ada7c8 None None] PATH_INFO: `/` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:11:02.933649 dv-cinder-851351-1-smb devstack@keystone.service[144067]: [pid: 144067|app: 0|req: 88/182] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 08:11:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 08:11:02.934795 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c6b029-b84a-421b-b937-721847ada7c8 None None] Authenticating user token {{(pid=144067) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:11:02.946305 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG dbcounter [-] [144068] Writing DB stats keystone:SELECT=100 {{(pid=144068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:11:03.032488 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19d9e06-c0e5-4954-b84d-c0a16c7a84ba None admin] Validating token access rules against request {{(pid=144068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:11:03.066819 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c6b029-b84a-421b-b937-721847ada7c8 None None] Validating token access rules against request {{(pid=144067) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:11:03.072013 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba21add-f4c0-45af-8500-0512cf5c6e80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:11:03.072701 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba21add-f4c0-45af-8500-0512cf5c6e80 None admin] REQUEST_METHOD: `GET` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:11:03.072994 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba21add-f4c0-45af-8500-0512cf5c6e80 None admin] SCRIPT_NAME: `/identity` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:11:03.073270 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba21add-f4c0-45af-8500-0512cf5c6e80 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:11:03.088034 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG dbcounter [-] [144067] Writing DB stats keystone:SELECT=100 {{(pid=144067) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:11:03.109670 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc5c65a-c20e-4493-8a12-a2d61bff9cc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144067) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:11:03.110339 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc5c65a-c20e-4493-8a12-a2d61bff9cc5 None admin] REQUEST_METHOD: `GET` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:11:03.110627 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc5c65a-c20e-4493-8a12-a2d61bff9cc5 None admin] SCRIPT_NAME: `/identity` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:11:03.110896 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc5c65a-c20e-4493-8a12-a2d61bff9cc5 None admin] PATH_INFO: `/v3/users/577d8eda06324e9b93dbb96ab1a98cfa` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:11:03.127984 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc5c65a-c20e-4493-8a12-a2d61bff9cc5 None admin] RBAC: Authorizing `identity:get_user(user_id=577d8eda06324e9b93dbb96ab1a98cfa)` {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:11:03.130111 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc5c65a-c20e-4493-8a12-a2d61bff9cc5 None admin] RBAC: Authorization granted {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:11:03.132055 dv-cinder-851351-1-smb devstack@keystone.service[144067]: [pid: 144067|app: 0|req: 89/183] 10.222.0.42 () {56 vars in 1177 bytes} [Thu Jul 28 08:11:02 2022] GET /identity/v3/users/577d8eda06324e9b93dbb96ab1a98cfa => generated 283 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:11:03.133740 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258c6321-e188-424d-afd0-ce14e74ece60 None None] REQUEST_METHOD: `GET` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:11:03.134026 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258c6321-e188-424d-afd0-ce14e74ece60 None None] SCRIPT_NAME: `/identity` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:11:03.134302 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258c6321-e188-424d-afd0-ce14e74ece60 None None] PATH_INFO: `/` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:11:03.135766 dv-cinder-851351-1-smb devstack@keystone.service[144067]: [pid: 144067|app: 0|req: 90/184] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 08:11:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 08:11:03.136602 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3777953c-ac41-4a63-a615-d982e778cf7f None None] REQUEST_METHOD: `POST` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:11:03.137011 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3777953c-ac41-4a63-a615-d982e778cf7f None None] SCRIPT_NAME: `/identity` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:11:03.137201 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3777953c-ac41-4a63-a615-d982e778cf7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:11:03.154158 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eba21add-f4c0-45af-8500-0512cf5c6e80 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:11:03.155664 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eba21add-f4c0-45af-8500-0512cf5c6e80 None admin] RBAC: Authorization granted {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:11:03.156835 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.auth.core [None req-3777953c-ac41-4a63-a615-d982e778cf7f None None] MFA Rules not processed for user `bf5ceb8f07374635ad506b7d1b4f1612`. Rule list: `[]` (Enabled: `True`). {{(pid=144067) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 08:11:03.158082 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.fernet_utils [None req-3777953c-ac41-4a63-a615-d982e778cf7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=144067) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:11:03.187497 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG dbcounter [-] [144068] Writing DB stats keystone:SELECT=100 {{(pid=144068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:11:03.228448 dv-cinder-851351-1-smb devstack@keystone.service[144067]: [pid: 144067|app: 0|req: 91/185] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 08:11:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 08:11:03.230230 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7451602-5063-486b-9825-048168d25aa7 None None] REQUEST_METHOD: `GET` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:11:03.230526 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7451602-5063-486b-9825-048168d25aa7 None None] SCRIPT_NAME: `/identity` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:11:03.230806 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7451602-5063-486b-9825-048168d25aa7 None None] PATH_INFO: `/` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:11:03.232068 dv-cinder-851351-1-smb devstack@keystone.service[144067]: [pid: 144067|app: 0|req: 92/186] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 08:11:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 08:11:03.233173 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2baf0a4e-255d-46c4-8409-08163180fe9f None None] REQUEST_METHOD: `POST` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:11:03.233614 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2baf0a4e-255d-46c4-8409-08163180fe9f None None] SCRIPT_NAME: `/identity` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:11:03.233890 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2baf0a4e-255d-46c4-8409-08163180fe9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:11:03.251772 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.auth.core [None req-2baf0a4e-255d-46c4-8409-08163180fe9f None None] MFA Rules not processed for user `bf5ceb8f07374635ad506b7d1b4f1612`. Rule list: `[]` (Enabled: `True`). {{(pid=144067) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 08:11:03.253224 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.fernet_utils [None req-2baf0a4e-255d-46c4-8409-08163180fe9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=144067) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:11:03.273117 dv-cinder-851351-1-smb devstack@keystone.service[144068]: [pid: 144068|app: 0|req: 95/187] 10.222.0.42 () {58 vars in 1282 bytes} [Thu Jul 28 08:11:02 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 364 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 28 08:11:03.273990 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba21add-f4c0-45af-8500-0512cf5c6e80 None admin] Authenticating user token {{(pid=144068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:11:03.324393 dv-cinder-851351-1-smb devstack@keystone.service[144067]: [pid: 144067|app: 0|req: 93/188] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 08:11:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 08:11:03.325794 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c42834-27d7-4207-9bab-04f5a85eca77 None None] REQUEST_METHOD: `POST` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:11:03.326088 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c42834-27d7-4207-9bab-04f5a85eca77 None None] SCRIPT_NAME: `/identity` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:11:03.326379 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c42834-27d7-4207-9bab-04f5a85eca77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:11:03.350129 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.auth.core [None req-68c42834-27d7-4207-9bab-04f5a85eca77 None None] MFA Rules not processed for user `bf5ceb8f07374635ad506b7d1b4f1612`. Rule list: `[]` (Enabled: `True`). {{(pid=144067) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 08:11:03.351286 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.fernet_utils [None req-68c42834-27d7-4207-9bab-04f5a85eca77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=144067) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:11:03.375160 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba21add-f4c0-45af-8500-0512cf5c6e80 None admin] Validating token access rules against request {{(pid=144068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:11:03.379652 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG dbcounter [-] [144067] Writing DB stats keystone:SELECT=100 {{(pid=144067) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:11:03.400483 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG dbcounter [-] [144068] Writing DB stats keystone:SELECT=100 {{(pid=144068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:11:03.409807 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002b9c07-cc09-411a-b367-157222d3db7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:11:03.410440 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002b9c07-cc09-411a-b367-157222d3db7b None admin] REQUEST_METHOD: `GET` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:11:03.410696 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002b9c07-cc09-411a-b367-157222d3db7b None admin] SCRIPT_NAME: `/identity` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:11:03.410983 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002b9c07-cc09-411a-b367-157222d3db7b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:11:03.419471 dv-cinder-851351-1-smb devstack@keystone.service[144067]: [pid: 144067|app: 0|req: 94/189] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 08:11:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 08:11:03.420318 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c42834-27d7-4207-9bab-04f5a85eca77 None None] Authenticating user token {{(pid=144067) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:11:03.489579 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-002b9c07-cc09-411a-b367-157222d3db7b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:11:03.491062 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-002b9c07-cc09-411a-b367-157222d3db7b None admin] RBAC: Authorization granted {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:11:03.518880 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c42834-27d7-4207-9bab-04f5a85eca77 None None] Validating token access rules against request {{(pid=144067) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:11:03.553079 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7acdfd21-9c28-4de4-bebe-080c83340b28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144067) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:11:03.553720 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7acdfd21-9c28-4de4-bebe-080c83340b28 None admin] REQUEST_METHOD: `GET` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:11:03.553999 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7acdfd21-9c28-4de4-bebe-080c83340b28 None admin] SCRIPT_NAME: `/identity` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:11:03.554272 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7acdfd21-9c28-4de4-bebe-080c83340b28 None admin] PATH_INFO: `/v3/domains/default` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:11:03.555422 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7acdfd21-9c28-4de4-bebe-080c83340b28 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:11:03.556919 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7acdfd21-9c28-4de4-bebe-080c83340b28 None admin] RBAC: Authorization granted {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:11:03.558536 dv-cinder-851351-1-smb devstack@keystone.service[144067]: [pid: 144067|app: 0|req: 95/190] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 08:11:03 2022] GET /identity/v3/domains/default => generated 199 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:11:03.559336 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7acdfd21-9c28-4de4-bebe-080c83340b28 None admin] Authenticating user token {{(pid=144067) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:11:03.594193 dv-cinder-851351-1-smb devstack@keystone.service[144068]: [pid: 144068|app: 0|req: 96/191] 10.222.0.42 () {58 vars in 1282 bytes} [Thu Jul 28 08:11:03 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 28 08:11:03.595079 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002b9c07-cc09-411a-b367-157222d3db7b None admin] Authenticating user token {{(pid=144068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:11:03.599401 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG dbcounter [-] [144067] Writing DB stats keystone:SELECT=100 {{(pid=144067) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:11:03.621070 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG dbcounter [-] [144068] Writing DB stats keystone:SELECT=100 {{(pid=144068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:11:03.667339 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7acdfd21-9c28-4de4-bebe-080c83340b28 None admin] Validating token access rules against request {{(pid=144067) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:11:03.695705 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002b9c07-cc09-411a-b367-157222d3db7b None admin] Validating token access rules against request {{(pid=144068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:11:03.702035 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d382b7c-a2e8-4e43-984b-416654eb3c14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144067) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:11:03.702703 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d382b7c-a2e8-4e43-984b-416654eb3c14 None admin] REQUEST_METHOD: `GET` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:11:03.702991 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d382b7c-a2e8-4e43-984b-416654eb3c14 None admin] SCRIPT_NAME: `/identity` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:11:03.703270 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d382b7c-a2e8-4e43-984b-416654eb3c14 None admin] PATH_INFO: `/v3/projects/49167073baf644459c58534448b0037f` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:11:03.704551 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d382b7c-a2e8-4e43-984b-416654eb3c14 None admin] RBAC: Authorizing `identity:get_project(project_id=49167073baf644459c58534448b0037f)` {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:11:03.706071 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d382b7c-a2e8-4e43-984b-416654eb3c14 None admin] RBAC: Authorization granted {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:11:03.707780 dv-cinder-851351-1-smb devstack@keystone.service[144067]: [pid: 144067|app: 0|req: 96/192] 10.222.0.42 () {56 vars in 1186 bytes} [Thu Jul 28 08:11:03 2022] GET /identity/v3/projects/49167073baf644459c58534448b0037f => generated 298 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:11:03.708532 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d382b7c-a2e8-4e43-984b-416654eb3c14 None admin] Authenticating user token {{(pid=144067) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:11:03.729950 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5acadc12-d236-4b65-8f8c-3ab60700bf8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:11:03.730631 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5acadc12-d236-4b65-8f8c-3ab60700bf8c None admin] REQUEST_METHOD: `GET` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:11:03.730912 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5acadc12-d236-4b65-8f8c-3ab60700bf8c None admin] SCRIPT_NAME: `/identity` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:11:03.731188 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5acadc12-d236-4b65-8f8c-3ab60700bf8c None admin] PATH_INFO: `/v3/roles/reader` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:11:03.741854 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5acadc12-d236-4b65-8f8c-3ab60700bf8c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 08:11:03.746777 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application [None req-5acadc12-d236-4b65-8f8c-3ab60700bf8c None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 28 08:11:03.746777 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:11:03.746777 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:11:03.746777 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:11:03.746777 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:11:03.746777 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:11:03.746777 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:11:03.746777 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:11:03.746777 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:11:03.746777 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:11:03.746777 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:11:03.746777 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:11:03.746777 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 08:11:03.746777 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 08:11:03.746777 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 08:11:03.746777 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 08:11:03.748040 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 08:11:03.748040 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 08:11:03.748040 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 08:11:03.748040 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 08:11:03.748040 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:11:03.748040 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:11:03.748040 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:11:03.748040 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:11:03.748040 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:11:03.748040 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:11:03.748040 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:11:03.748040 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application with Lock( Jul 28 08:11:03.748040 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:11:03.748040 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:11:03.748040 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:11:03.748040 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:11:03.749010 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:11:03.749010 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:11:03.749010 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:11:03.749010 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:11:03.749010 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 08:11:03.749010 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 08:11:03.749010 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 08:11:03.749010 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 08:11:03.749010 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 08:11:03.749010 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 08:11:03.749010 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 28 08:11:03.749010 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application Jul 28 08:11:03.749010 dv-cinder-851351-1-smb devstack@keystone.service[144068]: [pid: 144068|app: 0|req: 97/193] 10.222.0.42 () {56 vars in 1099 bytes} [Thu Jul 28 08:11:03 2022] GET /identity/v3/roles/reader => generated 84 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:11:03.749010 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5acadc12-d236-4b65-8f8c-3ab60700bf8c None admin] Authenticating user token {{(pid=144068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:11:03.817428 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d382b7c-a2e8-4e43-984b-416654eb3c14 None admin] Validating token access rules against request {{(pid=144067) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:11:03.818992 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG dbcounter [-] [144067] Writing DB stats keystone:SELECT=100 {{(pid=144067) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:11:03.838003 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG dbcounter [-] [144068] Writing DB stats keystone:SELECT=100 {{(pid=144068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:11:03.853335 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5acadc12-d236-4b65-8f8c-3ab60700bf8c None admin] Validating token access rules against request {{(pid=144068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:11:03.853584 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a7f966-4a1c-4d9c-b3ca-d4bdaf38080f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144067) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:11:03.854251 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a7f966-4a1c-4d9c-b3ca-d4bdaf38080f None admin] REQUEST_METHOD: `GET` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:11:03.854535 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a7f966-4a1c-4d9c-b3ca-d4bdaf38080f None admin] SCRIPT_NAME: `/identity` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:11:03.854815 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a7f966-4a1c-4d9c-b3ca-d4bdaf38080f None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:11:03.865605 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51a7f966-4a1c-4d9c-b3ca-d4bdaf38080f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 08:11:03.870796 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application [None req-51a7f966-4a1c-4d9c-b3ca-d4bdaf38080f None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 28 08:11:03.870796 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:11:03.870796 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:11:03.870796 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:11:03.870796 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:11:03.870796 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:11:03.870796 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:11:03.870796 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:11:03.870796 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:11:03.870796 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:11:03.870796 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:11:03.870796 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:11:03.870796 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 08:11:03.870796 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 08:11:03.870796 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 08:11:03.870796 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 08:11:03.871965 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 08:11:03.871965 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 08:11:03.871965 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 08:11:03.871965 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 08:11:03.871965 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:11:03.871965 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:11:03.871965 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:11:03.871965 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:11:03.871965 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:11:03.871965 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:11:03.871965 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:11:03.871965 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application with Lock( Jul 28 08:11:03.871965 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:11:03.871965 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:11:03.871965 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:11:03.871965 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:11:03.873023 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:11:03.873023 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:11:03.873023 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:11:03.873023 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:11:03.873023 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 08:11:03.873023 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 08:11:03.873023 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 08:11:03.873023 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 08:11:03.873023 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 08:11:03.873023 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 08:11:03.873023 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 28 08:11:03.873023 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application Jul 28 08:11:03.873023 dv-cinder-851351-1-smb devstack@keystone.service[144067]: [pid: 144067|app: 0|req: 97/194] 10.222.0.42 () {56 vars in 1114 bytes} [Thu Jul 28 08:11:03 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:11:03.873023 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a7f966-4a1c-4d9c-b3ca-d4bdaf38080f None admin] Authenticating user token {{(pid=144067) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:11:03.895659 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b1fa7d3-e298-44a5-a1fc-b6310991d14c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:11:03.896297 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1fa7d3-e298-44a5-a1fc-b6310991d14c None admin] REQUEST_METHOD: `POST` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:11:03.896583 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1fa7d3-e298-44a5-a1fc-b6310991d14c None admin] SCRIPT_NAME: `/identity` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:11:03.896899 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1fa7d3-e298-44a5-a1fc-b6310991d14c None admin] PATH_INFO: `/v3/users` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:11:03.897607 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b1fa7d3-e298-44a5-a1fc-b6310991d14c None admin] RBAC: Authorizing `identity:create_user()` {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:11:03.899106 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b1fa7d3-e298-44a5-a1fc-b6310991d14c None admin] RBAC: Authorization granted {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:11:03.923537 dv-cinder-851351-1-smb devstack@keystone.service[144068]: [pid: 144068|app: 0|req: 98/195] 10.222.0.42 () {60 vars in 1132 bytes} [Thu Jul 28 08:11:03 2022] POST /identity/v3/users => generated 297 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 08:11:03.924394 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b1fa7d3-e298-44a5-a1fc-b6310991d14c None admin] Authenticating user token {{(pid=144068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:11:03.994141 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a7f966-4a1c-4d9c-b3ca-d4bdaf38080f None admin] Validating token access rules against request {{(pid=144067) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:11:04.037402 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dedb8c6-5c4e-434b-a018-2b5df6a25fd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144067) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:11:04.038383 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dedb8c6-5c4e-434b-a018-2b5df6a25fd1 None admin] REQUEST_METHOD: `GET` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:11:04.038677 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dedb8c6-5c4e-434b-a018-2b5df6a25fd1 None admin] SCRIPT_NAME: `/identity` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:11:04.038971 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dedb8c6-5c4e-434b-a018-2b5df6a25fd1 None admin] PATH_INFO: `/v3/projects/2c58e7ea67d84cf692dd9eb3f6cb73a0` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:11:04.040292 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dedb8c6-5c4e-434b-a018-2b5df6a25fd1 None admin] RBAC: Authorizing `identity:get_project(project_id=2c58e7ea67d84cf692dd9eb3f6cb73a0)` {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:11:04.041858 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dedb8c6-5c4e-434b-a018-2b5df6a25fd1 None admin] RBAC: Authorization granted {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:11:04.043883 dv-cinder-851351-1-smb devstack@keystone.service[144067]: [pid: 144067|app: 0|req: 98/196] 10.222.0.42 () {56 vars in 1186 bytes} [Thu Jul 28 08:11:03 2022] GET /identity/v3/projects/2c58e7ea67d84cf692dd9eb3f6cb73a0 => generated 302 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:11:04.046352 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b1fa7d3-e298-44a5-a1fc-b6310991d14c None admin] Validating token access rules against request {{(pid=144068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:11:04.049703 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dedb8c6-5c4e-434b-a018-2b5df6a25fd1 None admin] Authenticating user token {{(pid=144067) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:11:04.085933 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG dbcounter [-] [144067] Writing DB stats keystone:SELECT=100 {{(pid=144067) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:11:04.088718 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6445a6a-fb1d-499f-ba09-50d03fb03c3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:11:04.089376 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6445a6a-fb1d-499f-ba09-50d03fb03c3a None admin] REQUEST_METHOD: `GET` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:11:04.089740 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6445a6a-fb1d-499f-ba09-50d03fb03c3a None admin] SCRIPT_NAME: `/identity` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:11:04.089978 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6445a6a-fb1d-499f-ba09-50d03fb03c3a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:11:04.091908 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6445a6a-fb1d-499f-ba09-50d03fb03c3a None admin] RBAC: Adding query filter params (role.id=7e9c2306137042cf8b8eba284656ef33, scope.project.id=49167073baf644459c58534448b0037f, user.id=fbc36457370441478a0d13a56c8e0351) {{(pid=144068) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:11:04.091908 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6445a6a-fb1d-499f-ba09-50d03fb03c3a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:11:04.093041 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6445a6a-fb1d-499f-ba09-50d03fb03c3a None admin] RBAC: Authorization granted {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:11:04.100964 dv-cinder-851351-1-smb devstack@keystone.service[144068]: [pid: 144068|app: 0|req: 99/197] 10.222.0.42 () {56 vars in 1374 bytes} [Thu Jul 28 08:11:03 2022] GET /identity/v3/role_assignments?user.id=fbc36457370441478a0d13a56c8e0351&scope.project.id=49167073baf644459c58534448b0037f&role.id=7e9c2306137042cf8b8eba284656ef33 => generated 608 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:11:04.104364 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6445a6a-fb1d-499f-ba09-50d03fb03c3a None admin] Authenticating user token {{(pid=144068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:11:04.111487 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG dbcounter [-] [144068] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=144068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:11:04.203436 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dedb8c6-5c4e-434b-a018-2b5df6a25fd1 None admin] Validating token access rules against request {{(pid=144067) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:11:04.251251 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1711e5fc-a343-45c9-8fe1-763549aec05f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144067) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:11:04.251929 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1711e5fc-a343-45c9-8fe1-763549aec05f None admin] REQUEST_METHOD: `GET` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:11:04.252205 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1711e5fc-a343-45c9-8fe1-763549aec05f None admin] SCRIPT_NAME: `/identity` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:11:04.252487 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1711e5fc-a343-45c9-8fe1-763549aec05f None admin] PATH_INFO: `/v3/roles` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:11:04.253258 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1711e5fc-a343-45c9-8fe1-763549aec05f None admin] RBAC: Adding query filter params (name=reader) {{(pid=144067) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:11:04.253575 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1711e5fc-a343-45c9-8fe1-763549aec05f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:11:04.255047 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1711e5fc-a343-45c9-8fe1-763549aec05f None admin] RBAC: Authorization granted {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:11:04.262136 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6445a6a-fb1d-499f-ba09-50d03fb03c3a None admin] Validating token access rules against request {{(pid=144068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:11:04.272858 dv-cinder-851351-1-smb devstack@keystone.service[144067]: [pid: 144067|app: 0|req: 99/198] 10.222.0.42 () {56 vars in 1101 bytes} [Thu Jul 28 08:11:04 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:11:04.274147 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1711e5fc-a343-45c9-8fe1-763549aec05f None admin] Authenticating user token {{(pid=144067) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:11:04.319481 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6be70b-a8f3-4c24-9046-0c5113ecd43c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:11:04.320119 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6be70b-a8f3-4c24-9046-0c5113ecd43c None admin] REQUEST_METHOD: `GET` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:11:04.320404 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6be70b-a8f3-4c24-9046-0c5113ecd43c None admin] SCRIPT_NAME: `/identity` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:11:04.320721 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6be70b-a8f3-4c24-9046-0c5113ecd43c None admin] PATH_INFO: `/v3/roles` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:11:04.321644 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce6be70b-a8f3-4c24-9046-0c5113ecd43c None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=144068) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:11:04.321942 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce6be70b-a8f3-4c24-9046-0c5113ecd43c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:11:04.324861 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce6be70b-a8f3-4c24-9046-0c5113ecd43c None admin] RBAC: Authorization granted {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:11:04.338438 dv-cinder-851351-1-smb devstack@keystone.service[144068]: [pid: 144068|app: 0|req: 100/199] 10.222.0.42 () {56 vars in 1111 bytes} [Thu Jul 28 08:11:04 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:11:04.339338 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6be70b-a8f3-4c24-9046-0c5113ecd43c None admin] Authenticating user token {{(pid=144068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:11:04.415289 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG dbcounter [-] [144067] Writing DB stats keystone:SELECT=100 {{(pid=144067) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:11:04.424224 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG dbcounter [-] [144068] Writing DB stats keystone:SELECT=100 {{(pid=144068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:11:04.425831 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1711e5fc-a343-45c9-8fe1-763549aec05f None admin] Validating token access rules against request {{(pid=144067) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:11:04.470986 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6be70b-a8f3-4c24-9046-0c5113ecd43c None admin] Validating token access rules against request {{(pid=144068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:11:04.478864 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0bf3fa6-f6cf-440a-81b0-e17b8e9a00a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144067) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:11:04.479931 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0bf3fa6-f6cf-440a-81b0-e17b8e9a00a1 None admin] REQUEST_METHOD: `GET` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:11:04.479931 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0bf3fa6-f6cf-440a-81b0-e17b8e9a00a1 None admin] SCRIPT_NAME: `/identity` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:11:04.480155 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0bf3fa6-f6cf-440a-81b0-e17b8e9a00a1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:11:04.480922 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0bf3fa6-f6cf-440a-81b0-e17b8e9a00a1 None admin] RBAC: Adding query filter params (role.id=d1020e7bb0b7411d895ddedd6dc02c5b, scope.project.id=2c58e7ea67d84cf692dd9eb3f6cb73a0, user.id=577d8eda06324e9b93dbb96ab1a98cfa) {{(pid=144067) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:11:04.481237 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0bf3fa6-f6cf-440a-81b0-e17b8e9a00a1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:11:04.482740 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0bf3fa6-f6cf-440a-81b0-e17b8e9a00a1 None admin] RBAC: Authorization granted {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:11:04.489315 dv-cinder-851351-1-smb devstack@keystone.service[144067]: [pid: 144067|app: 0|req: 100/200] 10.222.0.42 () {56 vars in 1374 bytes} [Thu Jul 28 08:11:04 2022] GET /identity/v3/role_assignments?user.id=577d8eda06324e9b93dbb96ab1a98cfa&scope.project.id=2c58e7ea67d84cf692dd9eb3f6cb73a0&role.id=d1020e7bb0b7411d895ddedd6dc02c5b => generated 259 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:11:04.489959 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0bf3fa6-f6cf-440a-81b0-e17b8e9a00a1 None admin] Authenticating user token {{(pid=144067) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:11:04.559074 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feef5756-d6fd-4c14-a48f-041d68bd5015 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:11:04.559754 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feef5756-d6fd-4c14-a48f-041d68bd5015 None admin] REQUEST_METHOD: `GET` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:11:04.560036 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feef5756-d6fd-4c14-a48f-041d68bd5015 None admin] SCRIPT_NAME: `/identity` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:11:04.560314 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feef5756-d6fd-4c14-a48f-041d68bd5015 None admin] PATH_INFO: `/v3/users/24f15e2e64e74ff09da0acf7fc0fad74` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:11:04.562569 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feef5756-d6fd-4c14-a48f-041d68bd5015 None admin] RBAC: Authorizing `identity:get_user(user_id=24f15e2e64e74ff09da0acf7fc0fad74)` {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:11:04.567574 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feef5756-d6fd-4c14-a48f-041d68bd5015 None admin] RBAC: Authorization granted {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:11:04.570862 dv-cinder-851351-1-smb devstack@keystone.service[144068]: [pid: 144068|app: 0|req: 101/201] 10.222.0.42 () {56 vars in 1177 bytes} [Thu Jul 28 08:11:04 2022] GET /identity/v3/users/24f15e2e64e74ff09da0acf7fc0fad74 => generated 289 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:11:04.578373 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feef5756-d6fd-4c14-a48f-041d68bd5015 None admin] Authenticating user token {{(pid=144068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:11:04.670239 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0bf3fa6-f6cf-440a-81b0-e17b8e9a00a1 None admin] Validating token access rules against request {{(pid=144067) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:11:04.709821 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feef5756-d6fd-4c14-a48f-041d68bd5015 None admin] Validating token access rules against request {{(pid=144068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:11:04.735179 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a90d9f8d-b21d-41f3-81d3-7fb83ac646d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144067) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:11:04.735754 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90d9f8d-b21d-41f3-81d3-7fb83ac646d1 None admin] REQUEST_METHOD: `GET` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:11:04.736041 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90d9f8d-b21d-41f3-81d3-7fb83ac646d1 None admin] SCRIPT_NAME: `/identity` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:11:04.736331 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90d9f8d-b21d-41f3-81d3-7fb83ac646d1 None admin] PATH_INFO: `/v3/users/577d8eda06324e9b93dbb96ab1a98cfa` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:11:04.737611 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a90d9f8d-b21d-41f3-81d3-7fb83ac646d1 None admin] RBAC: Authorizing `identity:get_user(user_id=577d8eda06324e9b93dbb96ab1a98cfa)` {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:11:04.739179 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a90d9f8d-b21d-41f3-81d3-7fb83ac646d1 None admin] RBAC: Authorization granted {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:11:04.740899 dv-cinder-851351-1-smb devstack@keystone.service[144067]: [pid: 144067|app: 0|req: 101/202] 10.222.0.42 () {56 vars in 1177 bytes} [Thu Jul 28 08:11:04 2022] GET /identity/v3/users/577d8eda06324e9b93dbb96ab1a98cfa => generated 283 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:11:04.749697 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a90d9f8d-b21d-41f3-81d3-7fb83ac646d1 None admin] Authenticating user token {{(pid=144067) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:11:04.753818 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f085bf6-d65a-4318-acd6-4c847f89bb5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:11:04.755590 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f085bf6-d65a-4318-acd6-4c847f89bb5f None admin] REQUEST_METHOD: `GET` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:11:04.755870 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f085bf6-d65a-4318-acd6-4c847f89bb5f None admin] SCRIPT_NAME: `/identity` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:11:04.756145 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f085bf6-d65a-4318-acd6-4c847f89bb5f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:11:04.760084 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG dbcounter [-] [144068] Writing DB stats keystone:SELECT=100 {{(pid=144068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:11:04.818072 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG dbcounter [-] [144067] Writing DB stats keystone:SELECT=100 {{(pid=144067) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:11:04.838049 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f085bf6-d65a-4318-acd6-4c847f89bb5f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:11:04.839542 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f085bf6-d65a-4318-acd6-4c847f89bb5f None admin] RBAC: Authorization granted {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:11:04.961670 dv-cinder-851351-1-smb devstack@keystone.service[144068]: [pid: 144068|app: 0|req: 102/203] 10.222.0.42 () {58 vars in 1282 bytes} [Thu Jul 28 08:11:04 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 384 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 28 08:11:04.967264 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f085bf6-d65a-4318-acd6-4c847f89bb5f None admin] Authenticating user token {{(pid=144068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:11:05.015403 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a90d9f8d-b21d-41f3-81d3-7fb83ac646d1 None admin] Validating token access rules against request {{(pid=144067) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:11:05.061560 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f41cafe0-cd0b-42d5-9d90-7449f88c2170 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144067) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:11:05.062451 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41cafe0-cd0b-42d5-9d90-7449f88c2170 None admin] REQUEST_METHOD: `GET` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:11:05.062731 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41cafe0-cd0b-42d5-9d90-7449f88c2170 None admin] SCRIPT_NAME: `/identity` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:11:05.063005 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41cafe0-cd0b-42d5-9d90-7449f88c2170 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:11:05.066601 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG dbcounter [-] [144068] Writing DB stats keystone:SELECT=100 {{(pid=144068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:11:05.146290 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f41cafe0-cd0b-42d5-9d90-7449f88c2170 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:11:05.147827 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f41cafe0-cd0b-42d5-9d90-7449f88c2170 None admin] RBAC: Authorization granted {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:11:05.174530 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG dbcounter [-] [144067] Writing DB stats keystone:SELECT=100 {{(pid=144067) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:11:05.195020 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f085bf6-d65a-4318-acd6-4c847f89bb5f None admin] Validating token access rules against request {{(pid=144068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:11:05.252255 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70129a53-996b-4ea8-b9fc-86da39f033ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:11:05.252866 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70129a53-996b-4ea8-b9fc-86da39f033ec None admin] REQUEST_METHOD: `GET` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:11:05.253157 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70129a53-996b-4ea8-b9fc-86da39f033ec None admin] SCRIPT_NAME: `/identity` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:11:05.253435 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70129a53-996b-4ea8-b9fc-86da39f033ec None admin] PATH_INFO: `/v3/projects/49167073baf644459c58534448b0037f` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:11:05.254722 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70129a53-996b-4ea8-b9fc-86da39f033ec None admin] RBAC: Authorizing `identity:get_project(project_id=49167073baf644459c58534448b0037f)` {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:11:05.256205 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70129a53-996b-4ea8-b9fc-86da39f033ec None admin] RBAC: Authorization granted {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:11:05.257964 dv-cinder-851351-1-smb devstack@keystone.service[144068]: [pid: 144068|app: 0|req: 103/204] 10.222.0.42 () {56 vars in 1186 bytes} [Thu Jul 28 08:11:04 2022] GET /identity/v3/projects/49167073baf644459c58534448b0037f => generated 298 bytes in 291 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:11:05.261140 dv-cinder-851351-1-smb devstack@keystone.service[144067]: [pid: 144067|app: 0|req: 102/205] 10.222.0.42 () {58 vars in 1282 bytes} [Thu Jul 28 08:11:04 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 512 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 28 08:11:05.264241 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70129a53-996b-4ea8-b9fc-86da39f033ec None admin] Authenticating user token {{(pid=144068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:11:05.269745 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f41cafe0-cd0b-42d5-9d90-7449f88c2170 None admin] Authenticating user token {{(pid=144067) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:11:05.452107 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70129a53-996b-4ea8-b9fc-86da39f033ec None admin] Validating token access rules against request {{(pid=144068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:11:05.457015 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG dbcounter [-] [144068] Writing DB stats keystone:SELECT=100 {{(pid=144068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:11:05.482998 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f41cafe0-cd0b-42d5-9d90-7449f88c2170 None admin] Validating token access rules against request {{(pid=144067) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:11:05.518742 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG dbcounter [-] [144067] Writing DB stats keystone:SELECT=100 {{(pid=144067) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:11:05.519263 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8d1b74-b961-4378-ae6e-42699343830f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:11:05.520016 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8d1b74-b961-4378-ae6e-42699343830f None admin] REQUEST_METHOD: `GET` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:11:05.520261 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8d1b74-b961-4378-ae6e-42699343830f None admin] SCRIPT_NAME: `/identity` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:11:05.520538 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8d1b74-b961-4378-ae6e-42699343830f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:11:05.524686 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a8d1b74-b961-4378-ae6e-42699343830f None admin] RBAC: Adding query filter params (role.id=aac18bff164441838e5b7d98f770be5e, scope.project.id=49167073baf644459c58534448b0037f, user.id=24f15e2e64e74ff09da0acf7fc0fad74) {{(pid=144068) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:11:05.524686 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a8d1b74-b961-4378-ae6e-42699343830f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:11:05.524686 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a8d1b74-b961-4378-ae6e-42699343830f None admin] RBAC: Authorization granted {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:11:05.539058 dv-cinder-851351-1-smb devstack@keystone.service[144068]: [pid: 144068|app: 0|req: 104/206] 10.222.0.42 () {56 vars in 1374 bytes} [Thu Jul 28 08:11:05 2022] GET /identity/v3/role_assignments?user.id=24f15e2e64e74ff09da0acf7fc0fad74&scope.project.id=49167073baf644459c58534448b0037f&role.id=aac18bff164441838e5b7d98f770be5e => generated 608 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:11:05.552337 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10bda25f-2749-435b-bb7e-8460d0168601 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144067) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:11:05.553059 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10bda25f-2749-435b-bb7e-8460d0168601 None admin] REQUEST_METHOD: `GET` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:11:05.553344 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10bda25f-2749-435b-bb7e-8460d0168601 None admin] SCRIPT_NAME: `/identity` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:11:05.553627 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10bda25f-2749-435b-bb7e-8460d0168601 None admin] PATH_INFO: `/v3/projects/2c58e7ea67d84cf692dd9eb3f6cb73a0` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:11:05.557546 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10bda25f-2749-435b-bb7e-8460d0168601 None admin] RBAC: Authorizing `identity:get_project(project_id=2c58e7ea67d84cf692dd9eb3f6cb73a0)` {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:11:05.559133 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10bda25f-2749-435b-bb7e-8460d0168601 None admin] RBAC: Authorization granted {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:11:05.561316 dv-cinder-851351-1-smb devstack@keystone.service[144067]: [pid: 144067|app: 0|req: 103/207] 10.222.0.42 () {56 vars in 1186 bytes} [Thu Jul 28 08:11:05 2022] GET /identity/v3/projects/2c58e7ea67d84cf692dd9eb3f6cb73a0 => generated 302 bytes in 292 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:11:05.567271 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8d1b74-b961-4378-ae6e-42699343830f None admin] Authenticating user token {{(pid=144068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:11:05.706522 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8d1b74-b961-4378-ae6e-42699343830f None admin] Validating token access rules against request {{(pid=144068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:11:05.760195 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5d96fa-c2be-423f-9345-84850f8a7c52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:11:05.760894 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5d96fa-c2be-423f-9345-84850f8a7c52 None admin] REQUEST_METHOD: `GET` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:11:05.761177 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5d96fa-c2be-423f-9345-84850f8a7c52 None admin] SCRIPT_NAME: `/identity` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:11:05.761417 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5d96fa-c2be-423f-9345-84850f8a7c52 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:11:05.762247 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac5d96fa-c2be-423f-9345-84850f8a7c52 None admin] RBAC: Adding query filter params (role.id=7e9c2306137042cf8b8eba284656ef33, scope.project.id=2c58e7ea67d84cf692dd9eb3f6cb73a0, user.id=577d8eda06324e9b93dbb96ab1a98cfa) {{(pid=144068) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:11:05.762561 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac5d96fa-c2be-423f-9345-84850f8a7c52 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:11:05.764032 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac5d96fa-c2be-423f-9345-84850f8a7c52 None admin] RBAC: Authorization granted {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:11:05.773664 dv-cinder-851351-1-smb devstack@keystone.service[144068]: [pid: 144068|app: 0|req: 105/208] 10.222.0.42 () {56 vars in 1374 bytes} [Thu Jul 28 08:11:05 2022] GET /identity/v3/role_assignments?user.id=577d8eda06324e9b93dbb96ab1a98cfa&scope.project.id=2c58e7ea67d84cf692dd9eb3f6cb73a0&role.id=7e9c2306137042cf8b8eba284656ef33 => generated 259 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:11:06.339992 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ebfc6e3-ffb5-4c64-95e9-c24c29c51c4c None None] REQUEST_METHOD: `GET` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:11:06.340566 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ebfc6e3-ffb5-4c64-95e9-c24c29c51c4c None None] SCRIPT_NAME: `/identity` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:11:06.340566 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ebfc6e3-ffb5-4c64-95e9-c24c29c51c4c None None] PATH_INFO: `/` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:11:06.342250 dv-cinder-851351-1-smb devstack@keystone.service[144067]: [pid: 144067|app: 0|req: 104/209] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 08:11:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 08:11:06.348714 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0a11f6-b18c-41e2-a010-64b8ade4f312 None None] REQUEST_METHOD: `POST` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:11:06.350144 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0a11f6-b18c-41e2-a010-64b8ade4f312 None None] SCRIPT_NAME: `/identity` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:11:06.350144 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0a11f6-b18c-41e2-a010-64b8ade4f312 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:11:06.362256 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928a4e56-c02c-45ff-9a83-f71a612c8c29 None None] REQUEST_METHOD: `GET` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:11:06.362592 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928a4e56-c02c-45ff-9a83-f71a612c8c29 None None] SCRIPT_NAME: `/identity` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:11:06.362779 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928a4e56-c02c-45ff-9a83-f71a612c8c29 None None] PATH_INFO: `/` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:11:06.364488 dv-cinder-851351-1-smb devstack@keystone.service[144067]: [pid: 144067|app: 0|req: 105/210] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 08:11:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 28 08:11:06.370154 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d619f42f-e875-4b14-9958-3fcd82ab8607 None None] REQUEST_METHOD: `POST` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:11:06.370758 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d619f42f-e875-4b14-9958-3fcd82ab8607 None None] SCRIPT_NAME: `/identity` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:11:06.371165 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d619f42f-e875-4b14-9958-3fcd82ab8607 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:11:06.375266 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.auth.core [None req-9d0a11f6-b18c-41e2-a010-64b8ade4f312 None None] MFA Rules not processed for user `bf5ceb8f07374635ad506b7d1b4f1612`. Rule list: `[]` (Enabled: `True`). {{(pid=144068) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 08:11:06.376901 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.fernet_utils [None req-9d0a11f6-b18c-41e2-a010-64b8ade4f312 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=144068) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:11:06.390810 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.auth.core [None req-d619f42f-e875-4b14-9958-3fcd82ab8607 None None] MFA Rules not processed for user `bf5ceb8f07374635ad506b7d1b4f1612`. Rule list: `[]` (Enabled: `True`). {{(pid=144067) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 08:11:06.392234 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.fernet_utils [None req-d619f42f-e875-4b14-9958-3fcd82ab8607 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=144067) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:11:06.409875 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG dbcounter [-] [144068] Writing DB stats keystone:SELECT=100 {{(pid=144068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:11:06.457647 dv-cinder-851351-1-smb devstack@keystone.service[144068]: [pid: 144068|app: 0|req: 106/211] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 08:11:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 08:11:06.480774 dv-cinder-851351-1-smb devstack@keystone.service[144067]: [pid: 144067|app: 0|req: 106/212] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 08:11:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 08:11:06.481908 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d0a11f6-b18c-41e2-a010-64b8ade4f312 None None] Authenticating user token {{(pid=144068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:11:06.508898 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d619f42f-e875-4b14-9958-3fcd82ab8607 None None] Authenticating user token {{(pid=144067) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:11:06.584510 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d0a11f6-b18c-41e2-a010-64b8ade4f312 None None] Validating token access rules against request {{(pid=144068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:11:06.614324 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d619f42f-e875-4b14-9958-3fcd82ab8607 None None] Validating token access rules against request {{(pid=144067) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:11:06.620592 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8c1cc4-830d-4698-8a9b-9c834892e9bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:11:06.621303 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8c1cc4-830d-4698-8a9b-9c834892e9bd None admin] REQUEST_METHOD: `GET` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:11:06.621595 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8c1cc4-830d-4698-8a9b-9c834892e9bd None admin] SCRIPT_NAME: `/identity` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:11:06.621880 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8c1cc4-830d-4698-8a9b-9c834892e9bd None admin] PATH_INFO: `/v3/domains/default` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:11:06.623067 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b8c1cc4-830d-4698-8a9b-9c834892e9bd None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:11:06.624570 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b8c1cc4-830d-4698-8a9b-9c834892e9bd None admin] RBAC: Authorization granted {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:11:06.626779 dv-cinder-851351-1-smb devstack@keystone.service[144068]: [pid: 144068|app: 0|req: 107/213] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 08:11:06 2022] GET /identity/v3/domains/default => generated 199 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:11:06.632299 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8c1cc4-830d-4698-8a9b-9c834892e9bd None admin] Authenticating user token {{(pid=144068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:11:06.641543 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG dbcounter [-] [144067] Writing DB stats keystone:SELECT=100 {{(pid=144067) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:11:06.659941 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c46a300d-b9b2-4193-9da5-7bef8670ec08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144067) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:11:06.660771 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46a300d-b9b2-4193-9da5-7bef8670ec08 None admin] REQUEST_METHOD: `GET` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:11:06.661054 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46a300d-b9b2-4193-9da5-7bef8670ec08 None admin] SCRIPT_NAME: `/identity` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:11:06.661328 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46a300d-b9b2-4193-9da5-7bef8670ec08 None admin] PATH_INFO: `/v3/roles/member` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:11:06.672196 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c46a300d-b9b2-4193-9da5-7bef8670ec08 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 08:11:06.675488 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG dbcounter [-] [144068] Writing DB stats keystone:SELECT=100 {{(pid=144068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:11:06.677372 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application [None req-c46a300d-b9b2-4193-9da5-7bef8670ec08 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 28 08:11:06.677372 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:11:06.677372 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:11:06.677372 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:11:06.677372 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:11:06.677372 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:11:06.677372 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:11:06.677372 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:11:06.677372 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:11:06.677372 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:11:06.677372 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:11:06.677372 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:11:06.677372 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 08:11:06.677372 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 08:11:06.677372 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 08:11:06.677372 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 08:11:06.678396 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 08:11:06.678396 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 08:11:06.678396 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 08:11:06.678396 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 08:11:06.678396 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:11:06.678396 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:11:06.678396 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:11:06.678396 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:11:06.678396 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:11:06.678396 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:11:06.678396 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:11:06.678396 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application with Lock( Jul 28 08:11:06.678396 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:11:06.678396 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:11:06.678396 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:11:06.678396 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:11:06.679354 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:11:06.679354 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:11:06.679354 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:11:06.679354 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:11:06.679354 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 08:11:06.679354 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 08:11:06.679354 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 08:11:06.679354 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 08:11:06.679354 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 08:11:06.679354 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 08:11:06.679354 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 28 08:11:06.679354 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application Jul 28 08:11:06.683599 dv-cinder-851351-1-smb devstack@keystone.service[144067]: [pid: 144067|app: 0|req: 107/214] 10.222.0.42 () {56 vars in 1099 bytes} [Thu Jul 28 08:11:06 2022] GET /identity/v3/roles/member => generated 84 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 08:11:06.685416 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c46a300d-b9b2-4193-9da5-7bef8670ec08 None admin] Authenticating user token {{(pid=144067) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:11:06.766645 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8c1cc4-830d-4698-8a9b-9c834892e9bd None admin] Validating token access rules against request {{(pid=144068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:11:06.801843 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf780365-d049-4ea5-a65f-1d144c05e127 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:11:06.802573 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf780365-d049-4ea5-a65f-1d144c05e127 None admin] REQUEST_METHOD: `POST` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:11:06.802920 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf780365-d049-4ea5-a65f-1d144c05e127 None admin] SCRIPT_NAME: `/identity` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:11:06.803260 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf780365-d049-4ea5-a65f-1d144c05e127 None admin] PATH_INFO: `/v3/users` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:11:06.804034 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf780365-d049-4ea5-a65f-1d144c05e127 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:11:06.805182 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c46a300d-b9b2-4193-9da5-7bef8670ec08 None admin] Validating token access rules against request {{(pid=144067) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:11:06.805728 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf780365-d049-4ea5-a65f-1d144c05e127 None admin] RBAC: Authorization granted {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:11:06.840540 dv-cinder-851351-1-smb devstack@keystone.service[144068]: [pid: 144068|app: 0|req: 108/215] 10.222.0.42 () {60 vars in 1132 bytes} [Thu Jul 28 08:11:06 2022] POST /identity/v3/users => generated 297 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 28 08:11:06.853215 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d259204-ec44-4bb6-9cf4-be7a27fc6301 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144067) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:11:06.854136 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d259204-ec44-4bb6-9cf4-be7a27fc6301 None admin] REQUEST_METHOD: `GET` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:11:06.854478 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d259204-ec44-4bb6-9cf4-be7a27fc6301 None admin] SCRIPT_NAME: `/identity` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:11:06.854908 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d259204-ec44-4bb6-9cf4-be7a27fc6301 None admin] PATH_INFO: `/v3/roles` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:11:06.855800 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d259204-ec44-4bb6-9cf4-be7a27fc6301 None admin] RBAC: Adding query filter params (name=member) {{(pid=144067) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:11:06.856193 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d259204-ec44-4bb6-9cf4-be7a27fc6301 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:11:06.858120 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d259204-ec44-4bb6-9cf4-be7a27fc6301 None admin] RBAC: Authorization granted {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:11:06.869446 dv-cinder-851351-1-smb devstack@keystone.service[144067]: [pid: 144067|app: 0|req: 108/216] 10.222.0.42 () {56 vars in 1101 bytes} [Thu Jul 28 08:11:06 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 08:11:06.875725 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf780365-d049-4ea5-a65f-1d144c05e127 None admin] Authenticating user token {{(pid=144068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:11:06.991193 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG dbcounter [-] [144068] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=144068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:11:07.010196 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf780365-d049-4ea5-a65f-1d144c05e127 None admin] Validating token access rules against request {{(pid=144068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:11:07.020393 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f11f70-dfbd-4609-97cb-d9860cf710fd None None] REQUEST_METHOD: `GET` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:11:07.020692 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f11f70-dfbd-4609-97cb-d9860cf710fd None None] SCRIPT_NAME: `/identity` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:11:07.020971 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f11f70-dfbd-4609-97cb-d9860cf710fd None None] PATH_INFO: `/` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:11:07.024211 dv-cinder-851351-1-smb devstack@keystone.service[144067]: [pid: 144067|app: 0|req: 109/217] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 08:11:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 08:11:07.031435 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d77a6a-cefb-47c5-aa92-71b65c8be84e None None] REQUEST_METHOD: `POST` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:11:07.032364 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d77a6a-cefb-47c5-aa92-71b65c8be84e None None] SCRIPT_NAME: `/identity` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:11:07.032905 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d77a6a-cefb-47c5-aa92-71b65c8be84e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:11:07.048540 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231fccdc-1216-458a-a00f-7ead3f003d8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:11:07.049240 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231fccdc-1216-458a-a00f-7ead3f003d8c None admin] REQUEST_METHOD: `GET` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:11:07.049523 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231fccdc-1216-458a-a00f-7ead3f003d8c None admin] SCRIPT_NAME: `/identity` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:11:07.049798 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231fccdc-1216-458a-a00f-7ead3f003d8c None admin] PATH_INFO: `/v3/users/d1f187addf31424d8bd31e4d0260bc28` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:11:07.063394 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.auth.core [None req-a3d77a6a-cefb-47c5-aa92-71b65c8be84e None None] MFA Rules not processed for user `bf5ceb8f07374635ad506b7d1b4f1612`. Rule list: `[]` (Enabled: `True`). {{(pid=144067) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 08:11:07.065465 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.fernet_utils [None req-a3d77a6a-cefb-47c5-aa92-71b65c8be84e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=144067) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:11:07.066591 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-231fccdc-1216-458a-a00f-7ead3f003d8c None admin] RBAC: Authorizing `identity:get_user(user_id=d1f187addf31424d8bd31e4d0260bc28)` {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:11:07.068108 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-231fccdc-1216-458a-a00f-7ead3f003d8c None admin] RBAC: Authorization granted {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:11:07.070326 dv-cinder-851351-1-smb devstack@keystone.service[144068]: [pid: 144068|app: 0|req: 109/218] 10.222.0.42 () {56 vars in 1177 bytes} [Thu Jul 28 08:11:06 2022] GET /identity/v3/users/d1f187addf31424d8bd31e4d0260bc28 => generated 297 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:11:07.077142 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231fccdc-1216-458a-a00f-7ead3f003d8c None admin] Authenticating user token {{(pid=144068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:11:07.119751 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG dbcounter [-] [144067] Writing DB stats keystone:SELECT=100 {{(pid=144067) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:11:07.160176 dv-cinder-851351-1-smb devstack@keystone.service[144067]: [pid: 144067|app: 0|req: 110/219] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 08:11:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 28 08:11:07.184359 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d77a6a-cefb-47c5-aa92-71b65c8be84e None None] Authenticating user token {{(pid=144067) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:11:07.220206 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231fccdc-1216-458a-a00f-7ead3f003d8c None admin] Validating token access rules against request {{(pid=144068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:11:07.266697 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e3f6c7-2568-4b6a-8313-a4017d059a68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:11:07.267454 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e3f6c7-2568-4b6a-8313-a4017d059a68 None admin] REQUEST_METHOD: `GET` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:11:07.267739 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e3f6c7-2568-4b6a-8313-a4017d059a68 None admin] SCRIPT_NAME: `/identity` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:11:07.268016 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e3f6c7-2568-4b6a-8313-a4017d059a68 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:11:07.303176 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG dbcounter [-] [144068] Writing DB stats keystone:SELECT=100 {{(pid=144068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:11:07.311008 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d77a6a-cefb-47c5-aa92-71b65c8be84e None None] Validating token access rules against request {{(pid=144067) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:11:07.353387 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d95b40c8-4cc6-44e3-9bab-3319ac0620fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144067) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:11:07.355091 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95b40c8-4cc6-44e3-9bab-3319ac0620fb None admin] REQUEST_METHOD: `GET` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:11:07.356178 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95b40c8-4cc6-44e3-9bab-3319ac0620fb None admin] SCRIPT_NAME: `/identity` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:11:07.356677 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95b40c8-4cc6-44e3-9bab-3319ac0620fb None admin] PATH_INFO: `/v3/roles/admin` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:11:07.357896 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67e3f6c7-2568-4b6a-8313-a4017d059a68 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:11:07.359630 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67e3f6c7-2568-4b6a-8313-a4017d059a68 None admin] RBAC: Authorization granted {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:11:07.370636 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d95b40c8-4cc6-44e3-9bab-3319ac0620fb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 08:11:07.379102 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application [None req-d95b40c8-4cc6-44e3-9bab-3319ac0620fb None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 08:11:07.379102 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:11:07.379102 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:11:07.379102 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:11:07.379102 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:11:07.379102 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:11:07.379102 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:11:07.379102 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:11:07.379102 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:11:07.379102 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:11:07.379102 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:11:07.379102 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:11:07.379102 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 08:11:07.379102 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 08:11:07.379102 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 08:11:07.379102 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 08:11:07.380235 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 08:11:07.380235 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 08:11:07.380235 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 08:11:07.380235 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 08:11:07.380235 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:11:07.380235 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:11:07.380235 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:11:07.380235 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:11:07.380235 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:11:07.380235 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:11:07.380235 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:11:07.380235 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application with Lock( Jul 28 08:11:07.380235 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:11:07.380235 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:11:07.380235 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:11:07.380235 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:11:07.381191 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:11:07.381191 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:11:07.381191 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:11:07.381191 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:11:07.381191 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 08:11:07.381191 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 08:11:07.381191 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 08:11:07.381191 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 08:11:07.381191 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 08:11:07.381191 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 08:11:07.381191 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 08:11:07.381191 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application Jul 28 08:11:07.382590 dv-cinder-851351-1-smb devstack@keystone.service[144067]: [pid: 144067|app: 0|req: 111/220] 10.222.0.42 () {56 vars in 1096 bytes} [Thu Jul 28 08:11:07 2022] GET /identity/v3/roles/admin => generated 83 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 08:11:07.389693 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d95b40c8-4cc6-44e3-9bab-3319ac0620fb None admin] Authenticating user token {{(pid=144067) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:11:07.464061 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG dbcounter [-] [144067] Writing DB stats keystone:SELECT=100 {{(pid=144067) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:11:07.554472 dv-cinder-851351-1-smb devstack@keystone.service[144068]: [pid: 144068|app: 0|req: 110/221] 10.222.0.42 () {58 vars in 1282 bytes} [Thu Jul 28 08:11:07 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 478 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 28 08:11:07.561091 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e3f6c7-2568-4b6a-8313-a4017d059a68 None admin] Authenticating user token {{(pid=144068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:11:07.588729 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d95b40c8-4cc6-44e3-9bab-3319ac0620fb None admin] Validating token access rules against request {{(pid=144067) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:11:07.632317 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01423b21-3b31-4040-a2e5-f76360a9e921 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144067) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:11:07.633424 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01423b21-3b31-4040-a2e5-f76360a9e921 None admin] REQUEST_METHOD: `GET` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:11:07.634315 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01423b21-3b31-4040-a2e5-f76360a9e921 None admin] SCRIPT_NAME: `/identity` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:11:07.634822 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01423b21-3b31-4040-a2e5-f76360a9e921 None admin] PATH_INFO: `/v3/roles` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:11:07.636339 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01423b21-3b31-4040-a2e5-f76360a9e921 None admin] RBAC: Adding query filter params (name=admin) {{(pid=144067) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:11:07.636919 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01423b21-3b31-4040-a2e5-f76360a9e921 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:11:07.638854 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01423b21-3b31-4040-a2e5-f76360a9e921 None admin] RBAC: Authorization granted {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:11:07.660905 dv-cinder-851351-1-smb devstack@keystone.service[144067]: [pid: 144067|app: 0|req: 112/222] 10.222.0.42 () {56 vars in 1099 bytes} [Thu Jul 28 08:11:07 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:11:07.667454 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG dbcounter [-] [144068] Writing DB stats keystone:SELECT=100 {{(pid=144068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:11:07.668257 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01423b21-3b31-4040-a2e5-f76360a9e921 None admin] Authenticating user token {{(pid=144067) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:11:07.785015 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e3f6c7-2568-4b6a-8313-a4017d059a68 None admin] Validating token access rules against request {{(pid=144068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:11:07.809148 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG dbcounter [-] [144067] Writing DB stats keystone:SELECT=100 {{(pid=144067) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:11:07.819227 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01423b21-3b31-4040-a2e5-f76360a9e921 None admin] Validating token access rules against request {{(pid=144067) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:11:07.857968 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fff134b-5a54-441b-b43e-08b4c5f3f9cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:11:07.858652 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fff134b-5a54-441b-b43e-08b4c5f3f9cc None admin] REQUEST_METHOD: `GET` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:11:07.858940 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fff134b-5a54-441b-b43e-08b4c5f3f9cc None admin] SCRIPT_NAME: `/identity` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:11:07.859217 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fff134b-5a54-441b-b43e-08b4c5f3f9cc None admin] PATH_INFO: `/v3/projects/2c58e7ea67d84cf692dd9eb3f6cb73a0` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:11:07.860578 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fff134b-5a54-441b-b43e-08b4c5f3f9cc None admin] RBAC: Authorizing `identity:get_project(project_id=2c58e7ea67d84cf692dd9eb3f6cb73a0)` {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:11:07.862084 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fff134b-5a54-441b-b43e-08b4c5f3f9cc None admin] RBAC: Authorization granted {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:11:07.872440 dv-cinder-851351-1-smb devstack@keystone.service[144068]: [pid: 144068|app: 0|req: 111/223] 10.222.0.42 () {56 vars in 1186 bytes} [Thu Jul 28 08:11:07 2022] GET /identity/v3/projects/2c58e7ea67d84cf692dd9eb3f6cb73a0 => generated 302 bytes in 312 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 08:11:07.882215 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fff134b-5a54-441b-b43e-08b4c5f3f9cc None admin] Authenticating user token {{(pid=144068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:11:07.885576 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59179f06-7d35-4971-95ca-35818a768e54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144067) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:11:07.886197 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59179f06-7d35-4971-95ca-35818a768e54 None admin] REQUEST_METHOD: `GET` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:11:07.886483 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59179f06-7d35-4971-95ca-35818a768e54 None admin] SCRIPT_NAME: `/identity` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:11:07.886766 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59179f06-7d35-4971-95ca-35818a768e54 None admin] PATH_INFO: `/v3/users/577d8eda06324e9b93dbb96ab1a98cfa` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:11:07.888026 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59179f06-7d35-4971-95ca-35818a768e54 None admin] RBAC: Authorizing `identity:get_user(user_id=577d8eda06324e9b93dbb96ab1a98cfa)` {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:11:07.889705 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59179f06-7d35-4971-95ca-35818a768e54 None admin] RBAC: Authorization granted {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:11:07.891805 dv-cinder-851351-1-smb devstack@keystone.service[144067]: [pid: 144067|app: 0|req: 113/224] 10.222.0.42 () {56 vars in 1177 bytes} [Thu Jul 28 08:11:07 2022] GET /identity/v3/users/577d8eda06324e9b93dbb96ab1a98cfa => generated 283 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:11:07.897343 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59179f06-7d35-4971-95ca-35818a768e54 None admin] Authenticating user token {{(pid=144067) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:11:08.006313 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59179f06-7d35-4971-95ca-35818a768e54 None admin] Validating token access rules against request {{(pid=144067) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:11:08.043770 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0060199-c144-4adc-a3dc-1d104669d682 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144067) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:11:08.044536 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0060199-c144-4adc-a3dc-1d104669d682 None admin] REQUEST_METHOD: `GET` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:11:08.044858 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0060199-c144-4adc-a3dc-1d104669d682 None admin] SCRIPT_NAME: `/identity` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:11:08.045138 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0060199-c144-4adc-a3dc-1d104669d682 None admin] PATH_INFO: `/v3/projects/2c58e7ea67d84cf692dd9eb3f6cb73a0` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:11:08.046349 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0060199-c144-4adc-a3dc-1d104669d682 None admin] RBAC: Authorizing `identity:get_project(project_id=2c58e7ea67d84cf692dd9eb3f6cb73a0)` {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:11:08.047928 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0060199-c144-4adc-a3dc-1d104669d682 None admin] RBAC: Authorization granted {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:11:08.049905 dv-cinder-851351-1-smb devstack@keystone.service[144067]: [pid: 144067|app: 0|req: 114/225] 10.222.0.42 () {56 vars in 1186 bytes} [Thu Jul 28 08:11:07 2022] GET /identity/v3/projects/2c58e7ea67d84cf692dd9eb3f6cb73a0 => generated 302 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 08:11:08.055779 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0060199-c144-4adc-a3dc-1d104669d682 None admin] Authenticating user token {{(pid=144067) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:11:08.091766 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG dbcounter [-] [144067] Writing DB stats keystone:SELECT=100 {{(pid=144067) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:11:08.100509 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fff134b-5a54-441b-b43e-08b4c5f3f9cc None admin] Validating token access rules against request {{(pid=144068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:11:08.119525 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG dbcounter [-] [144068] Writing DB stats keystone:SELECT=100 {{(pid=144068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:11:08.149280 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5ed754-fd68-41eb-91fd-bcde2c466629 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:11:08.150106 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5ed754-fd68-41eb-91fd-bcde2c466629 None admin] REQUEST_METHOD: `GET` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:11:08.150390 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5ed754-fd68-41eb-91fd-bcde2c466629 None admin] SCRIPT_NAME: `/identity` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:11:08.150675 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5ed754-fd68-41eb-91fd-bcde2c466629 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:11:08.151750 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db5ed754-fd68-41eb-91fd-bcde2c466629 None admin] RBAC: Adding query filter params (role.id=6933b60756fe46dd8f27854f5e192061, scope.project.id=2c58e7ea67d84cf692dd9eb3f6cb73a0, user.id=d1f187addf31424d8bd31e4d0260bc28) {{(pid=144068) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:11:08.152093 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db5ed754-fd68-41eb-91fd-bcde2c466629 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:11:08.153955 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db5ed754-fd68-41eb-91fd-bcde2c466629 None admin] RBAC: Authorization granted {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:11:08.161706 dv-cinder-851351-1-smb devstack@keystone.service[144068]: [pid: 144068|app: 0|req: 112/226] 10.222.0.42 () {56 vars in 1374 bytes} [Thu Jul 28 08:11:07 2022] GET /identity/v3/role_assignments?user.id=d1f187addf31424d8bd31e4d0260bc28&scope.project.id=2c58e7ea67d84cf692dd9eb3f6cb73a0&role.id=6933b60756fe46dd8f27854f5e192061 => generated 259 bytes in 280 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 08:11:08.163748 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a70b22-7aef-47c0-af0e-910a117d4241 None None] REQUEST_METHOD: `GET` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:11:08.164037 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a70b22-7aef-47c0-af0e-910a117d4241 None None] SCRIPT_NAME: `/identity` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:11:08.164320 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a70b22-7aef-47c0-af0e-910a117d4241 None None] PATH_INFO: `/` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:11:08.166083 dv-cinder-851351-1-smb devstack@keystone.service[144068]: [pid: 144068|app: 0|req: 113/227] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 08:11:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 08:11:08.177827 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0060199-c144-4adc-a3dc-1d104669d682 None admin] Validating token access rules against request {{(pid=144067) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:11:08.186518 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4f35bf-93bd-47ab-a6e1-35c847bc95d2 None None] REQUEST_METHOD: `POST` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:11:08.187684 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4f35bf-93bd-47ab-a6e1-35c847bc95d2 None None] SCRIPT_NAME: `/identity` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:11:08.187958 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4f35bf-93bd-47ab-a6e1-35c847bc95d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:11:08.228324 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.auth.core [None req-3b4f35bf-93bd-47ab-a6e1-35c847bc95d2 None None] MFA Rules not processed for user `bf5ceb8f07374635ad506b7d1b4f1612`. Rule list: `[]` (Enabled: `True`). {{(pid=144068) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 08:11:08.233394 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.fernet_utils [None req-3b4f35bf-93bd-47ab-a6e1-35c847bc95d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=144068) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:11:08.265730 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23bfd10-a4dd-415a-82e0-cda624031fa4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144067) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:11:08.267501 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23bfd10-a4dd-415a-82e0-cda624031fa4 None admin] REQUEST_METHOD: `PUT` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:11:08.267804 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23bfd10-a4dd-415a-82e0-cda624031fa4 None admin] SCRIPT_NAME: `/identity` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:11:08.268084 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23bfd10-a4dd-415a-82e0-cda624031fa4 None admin] PATH_INFO: `/v3/projects/2c58e7ea67d84cf692dd9eb3f6cb73a0/users/577d8eda06324e9b93dbb96ab1a98cfa/roles/d1020e7bb0b7411d895ddedd6dc02c5b` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:11:08.273164 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e23bfd10-a4dd-415a-82e0-cda624031fa4 None admin] RBAC: Authorizing `identity:create_grant(project_id=2c58e7ea67d84cf692dd9eb3f6cb73a0, user_id=577d8eda06324e9b93dbb96ab1a98cfa, role_id=d1020e7bb0b7411d895ddedd6dc02c5b)` {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:11:08.275801 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e23bfd10-a4dd-415a-82e0-cda624031fa4 None admin] RBAC: Authorization granted {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:11:08.300098 dv-cinder-851351-1-smb devstack@keystone.service[144067]: [pid: 144067|app: 0|req: 115/228] 10.222.0.42 () {58 vars in 1439 bytes} [Thu Jul 28 08:11:08 2022] PUT /identity/v3/projects/2c58e7ea67d84cf692dd9eb3f6cb73a0/users/577d8eda06324e9b93dbb96ab1a98cfa/roles/d1020e7bb0b7411d895ddedd6dc02c5b => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 28 08:11:08.350455 dv-cinder-851351-1-smb devstack@keystone.service[144068]: [pid: 144068|app: 0|req: 114/229] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 08:11:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 28 08:11:08.385565 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23bfd10-a4dd-415a-82e0-cda624031fa4 None admin] Authenticating user token {{(pid=144067) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:11:08.504589 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG dbcounter [-] [144067] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=144067) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:11:08.514404 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23bfd10-a4dd-415a-82e0-cda624031fa4 None admin] Validating token access rules against request {{(pid=144067) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:11:08.554881 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75da7f32-6339-4134-a57c-c3e3794037c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144067) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:11:08.555549 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75da7f32-6339-4134-a57c-c3e3794037c2 None admin] REQUEST_METHOD: `GET` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:11:08.555819 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75da7f32-6339-4134-a57c-c3e3794037c2 None admin] SCRIPT_NAME: `/identity` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:11:08.556098 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75da7f32-6339-4134-a57c-c3e3794037c2 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:11:08.570305 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75da7f32-6339-4134-a57c-c3e3794037c2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 08:11:08.575962 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application [None req-75da7f32-6339-4134-a57c-c3e3794037c2 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 28 08:11:08.575962 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:11:08.575962 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:11:08.575962 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:11:08.575962 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:11:08.575962 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:11:08.575962 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:11:08.575962 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:11:08.575962 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:11:08.575962 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:11:08.575962 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:11:08.575962 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:11:08.575962 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 08:11:08.575962 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 08:11:08.575962 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 08:11:08.575962 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 08:11:08.577933 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 08:11:08.577933 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 08:11:08.577933 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 08:11:08.577933 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 08:11:08.577933 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:11:08.577933 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:11:08.577933 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:11:08.577933 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:11:08.577933 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:11:08.577933 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:11:08.577933 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:11:08.577933 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application with Lock( Jul 28 08:11:08.577933 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:11:08.577933 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:11:08.577933 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:11:08.577933 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:11:08.579483 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:11:08.579483 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:11:08.579483 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:11:08.579483 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:11:08.579483 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 08:11:08.579483 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 08:11:08.579483 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 08:11:08.579483 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 08:11:08.579483 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 08:11:08.579483 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 08:11:08.579483 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 28 08:11:08.579483 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application Jul 28 08:11:08.579483 dv-cinder-851351-1-smb devstack@keystone.service[144067]: [pid: 144067|app: 0|req: 116/230] 10.222.0.42 () {56 vars in 1114 bytes} [Thu Jul 28 08:11:08 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:11:08.583771 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b4f35bf-93bd-47ab-a6e1-35c847bc95d2 None None] Authenticating user token {{(pid=144068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:11:08.684151 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b4f35bf-93bd-47ab-a6e1-35c847bc95d2 None None] Validating token access rules against request {{(pid=144068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:11:08.696266 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG dbcounter [-] [144068] Writing DB stats keystone:SELECT=100 {{(pid=144068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:11:08.741873 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-814baa2c-2b1d-45ca-bf00-e8efe675e1b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:11:08.742939 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814baa2c-2b1d-45ca-bf00-e8efe675e1b1 None admin] REQUEST_METHOD: `GET` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:11:08.743432 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814baa2c-2b1d-45ca-bf00-e8efe675e1b1 None admin] SCRIPT_NAME: `/identity` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:11:08.743915 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814baa2c-2b1d-45ca-bf00-e8efe675e1b1 None admin] PATH_INFO: `/v3/roles` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:11:08.745273 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-814baa2c-2b1d-45ca-bf00-e8efe675e1b1 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=144068) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:11:08.745817 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-814baa2c-2b1d-45ca-bf00-e8efe675e1b1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:11:08.748417 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-814baa2c-2b1d-45ca-bf00-e8efe675e1b1 None admin] RBAC: Authorization granted {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:11:08.763571 dv-cinder-851351-1-smb devstack@keystone.service[144068]: [pid: 144068|app: 0|req: 115/231] 10.222.0.42 () {56 vars in 1111 bytes} [Thu Jul 28 08:11:08 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 08:11:08.770369 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75da7f32-6339-4134-a57c-c3e3794037c2 None admin] Authenticating user token {{(pid=144067) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:11:08.954462 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75da7f32-6339-4134-a57c-c3e3794037c2 None admin] Validating token access rules against request {{(pid=144067) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:11:09.000218 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2542ff47-1cbc-4138-8bbf-a31a86dddac4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144067) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:11:09.001294 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2542ff47-1cbc-4138-8bbf-a31a86dddac4 None admin] REQUEST_METHOD: `GET` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:11:09.001809 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2542ff47-1cbc-4138-8bbf-a31a86dddac4 None admin] SCRIPT_NAME: `/identity` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:11:09.002302 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2542ff47-1cbc-4138-8bbf-a31a86dddac4 None admin] PATH_INFO: `/v3/users/577d8eda06324e9b93dbb96ab1a98cfa` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:11:09.009460 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2542ff47-1cbc-4138-8bbf-a31a86dddac4 None admin] RBAC: Authorizing `identity:get_user(user_id=577d8eda06324e9b93dbb96ab1a98cfa)` {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:11:09.011248 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2542ff47-1cbc-4138-8bbf-a31a86dddac4 None admin] RBAC: Authorization granted {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:11:09.013226 dv-cinder-851351-1-smb devstack@keystone.service[144067]: [pid: 144067|app: 0|req: 117/232] 10.222.0.42 () {56 vars in 1177 bytes} [Thu Jul 28 08:11:08 2022] GET /identity/v3/users/577d8eda06324e9b93dbb96ab1a98cfa => generated 283 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:11:09.019064 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-814baa2c-2b1d-45ca-bf00-e8efe675e1b1 None admin] Authenticating user token {{(pid=144068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:11:09.164866 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-814baa2c-2b1d-45ca-bf00-e8efe675e1b1 None admin] Validating token access rules against request {{(pid=144068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:11:09.205074 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670d426c-9dfc-403e-b2ad-ce1e6caeb944 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:11:09.205736 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670d426c-9dfc-403e-b2ad-ce1e6caeb944 None admin] REQUEST_METHOD: `GET` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:11:09.206017 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670d426c-9dfc-403e-b2ad-ce1e6caeb944 None admin] SCRIPT_NAME: `/identity` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:11:09.206284 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670d426c-9dfc-403e-b2ad-ce1e6caeb944 None admin] PATH_INFO: `/v3/projects/2c58e7ea67d84cf692dd9eb3f6cb73a0` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:11:09.207542 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-670d426c-9dfc-403e-b2ad-ce1e6caeb944 None admin] RBAC: Authorizing `identity:get_project(project_id=2c58e7ea67d84cf692dd9eb3f6cb73a0)` {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:11:09.209018 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-670d426c-9dfc-403e-b2ad-ce1e6caeb944 None admin] RBAC: Authorization granted {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:11:09.211449 dv-cinder-851351-1-smb devstack@keystone.service[144068]: [pid: 144068|app: 0|req: 116/233] 10.222.0.42 () {56 vars in 1186 bytes} [Thu Jul 28 08:11:09 2022] GET /identity/v3/projects/2c58e7ea67d84cf692dd9eb3f6cb73a0 => generated 302 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:11:09.217095 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2542ff47-1cbc-4138-8bbf-a31a86dddac4 None admin] Authenticating user token {{(pid=144067) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:11:09.268926 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG dbcounter [-] [144067] Writing DB stats keystone:SELECT=100 {{(pid=144067) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:11:09.359723 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2542ff47-1cbc-4138-8bbf-a31a86dddac4 None admin] Validating token access rules against request {{(pid=144067) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:11:09.404576 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-817dac5d-93fc-4997-b8b1-2696d647b0bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144067) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:11:09.406091 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817dac5d-93fc-4997-b8b1-2696d647b0bc None admin] REQUEST_METHOD: `PUT` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:11:09.406535 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817dac5d-93fc-4997-b8b1-2696d647b0bc None admin] SCRIPT_NAME: `/identity` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:11:09.407033 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817dac5d-93fc-4997-b8b1-2696d647b0bc None admin] PATH_INFO: `/v3/projects/2c58e7ea67d84cf692dd9eb3f6cb73a0/users/577d8eda06324e9b93dbb96ab1a98cfa/roles/7e9c2306137042cf8b8eba284656ef33` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:11:09.414618 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-817dac5d-93fc-4997-b8b1-2696d647b0bc None admin] RBAC: Authorizing `identity:create_grant(project_id=2c58e7ea67d84cf692dd9eb3f6cb73a0, user_id=577d8eda06324e9b93dbb96ab1a98cfa, role_id=7e9c2306137042cf8b8eba284656ef33)` {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:11:09.416370 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-817dac5d-93fc-4997-b8b1-2696d647b0bc None admin] RBAC: Authorization granted {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:11:09.440706 dv-cinder-851351-1-smb devstack@keystone.service[144067]: [pid: 144067|app: 0|req: 118/234] 10.222.0.42 () {58 vars in 1439 bytes} [Thu Jul 28 08:11:09 2022] PUT /identity/v3/projects/2c58e7ea67d84cf692dd9eb3f6cb73a0/users/577d8eda06324e9b93dbb96ab1a98cfa/roles/7e9c2306137042cf8b8eba284656ef33 => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 08:11:09.574494 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7461f4e6-f43b-4251-824d-df0133199716 None None] REQUEST_METHOD: `GET` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:11:09.575036 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7461f4e6-f43b-4251-824d-df0133199716 None None] SCRIPT_NAME: `/identity` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:11:09.575557 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7461f4e6-f43b-4251-824d-df0133199716 None None] PATH_INFO: `/` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:11:09.576593 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61b6fe3-fd91-486d-8a64-db5fd6e95e07 None None] REQUEST_METHOD: `GET` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:11:09.576918 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61b6fe3-fd91-486d-8a64-db5fd6e95e07 None None] SCRIPT_NAME: `/identity` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:11:09.577199 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61b6fe3-fd91-486d-8a64-db5fd6e95e07 None None] PATH_INFO: `/` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:11:09.578162 dv-cinder-851351-1-smb devstack@keystone.service[144068]: [pid: 144068|app: 0|req: 117/235] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 08:11:09 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 08:11:09.578797 dv-cinder-851351-1-smb devstack@keystone.service[144067]: [pid: 144067|app: 0|req: 119/236] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 08:11:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 08:11:09.584121 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9718af-775b-4e69-9d64-87b7759c7e3b None None] REQUEST_METHOD: `POST` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:11:09.586312 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920fed84-5334-4788-b74a-bf2a3ab46803 None None] REQUEST_METHOD: `POST` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:11:09.586857 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9718af-775b-4e69-9d64-87b7759c7e3b None None] SCRIPT_NAME: `/identity` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:11:09.587337 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9718af-775b-4e69-9d64-87b7759c7e3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:11:09.587829 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920fed84-5334-4788-b74a-bf2a3ab46803 None None] SCRIPT_NAME: `/identity` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:11:09.591247 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920fed84-5334-4788-b74a-bf2a3ab46803 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:11:09.623897 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.auth.core [None req-4d9718af-775b-4e69-9d64-87b7759c7e3b None None] MFA Rules not processed for user `bf5ceb8f07374635ad506b7d1b4f1612`. Rule list: `[]` (Enabled: `True`). {{(pid=144068) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 08:11:09.625221 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.auth.core [None req-920fed84-5334-4788-b74a-bf2a3ab46803 None None] MFA Rules not processed for user `bf5ceb8f07374635ad506b7d1b4f1612`. Rule list: `[]` (Enabled: `True`). {{(pid=144067) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 08:11:09.626670 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.fernet_utils [None req-4d9718af-775b-4e69-9d64-87b7759c7e3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=144068) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:11:09.628072 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.fernet_utils [None req-920fed84-5334-4788-b74a-bf2a3ab46803 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=144067) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:11:09.683987 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG dbcounter [-] [144068] Writing DB stats keystone:SELECT=100 {{(pid=144068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:11:09.738690 dv-cinder-851351-1-smb devstack@keystone.service[144068]: [pid: 144068|app: 0|req: 118/237] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 08:11:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 08:11:09.748851 dv-cinder-851351-1-smb devstack@keystone.service[144067]: [pid: 144067|app: 0|req: 120/238] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 08:11:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 08:11:09.766214 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-920fed84-5334-4788-b74a-bf2a3ab46803 None None] Authenticating user token {{(pid=144067) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:11:09.766419 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9718af-775b-4e69-9d64-87b7759c7e3b None None] Authenticating user token {{(pid=144068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:11:09.786510 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG dbcounter [-] [144067] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=144067) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:11:09.910383 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9718af-775b-4e69-9d64-87b7759c7e3b None None] Validating token access rules against request {{(pid=144068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:11:09.953421 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e379ab2f-96aa-49db-b7c8-af0775998694 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:11:09.954389 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e379ab2f-96aa-49db-b7c8-af0775998694 None admin] REQUEST_METHOD: `GET` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:11:09.955855 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e379ab2f-96aa-49db-b7c8-af0775998694 None admin] SCRIPT_NAME: `/identity` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:11:09.956299 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e379ab2f-96aa-49db-b7c8-af0775998694 None admin] PATH_INFO: `/v3/domains/default` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:11:09.959270 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e379ab2f-96aa-49db-b7c8-af0775998694 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:11:09.962772 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e379ab2f-96aa-49db-b7c8-af0775998694 None admin] RBAC: Authorization granted {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:11:09.964733 dv-cinder-851351-1-smb devstack@keystone.service[144068]: [pid: 144068|app: 0|req: 119/239] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 08:11:09 2022] GET /identity/v3/domains/default => generated 199 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:11:09.975564 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e379ab2f-96aa-49db-b7c8-af0775998694 None admin] Authenticating user token {{(pid=144068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:11:10.033601 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-920fed84-5334-4788-b74a-bf2a3ab46803 None None] Validating token access rules against request {{(pid=144067) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:11:10.044685 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG dbcounter [-] [144068] Writing DB stats keystone:SELECT=100 {{(pid=144068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:11:10.109964 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a23e0fd-434a-427d-a42d-65c33c7a08a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144067) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:11:10.110875 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a23e0fd-434a-427d-a42d-65c33c7a08a1 None admin] REQUEST_METHOD: `GET` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:11:10.111170 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a23e0fd-434a-427d-a42d-65c33c7a08a1 None admin] SCRIPT_NAME: `/identity` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:11:10.111449 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a23e0fd-434a-427d-a42d-65c33c7a08a1 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:11:10.134407 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a23e0fd-434a-427d-a42d-65c33c7a08a1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 08:11:10.142754 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application [None req-2a23e0fd-434a-427d-a42d-65c33c7a08a1 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 28 08:11:10.142754 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:11:10.142754 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:11:10.142754 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:11:10.142754 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:11:10.142754 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:11:10.142754 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:11:10.142754 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:11:10.142754 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:11:10.142754 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:11:10.142754 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:11:10.142754 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:11:10.142754 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 08:11:10.142754 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 08:11:10.142754 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 08:11:10.142754 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 08:11:10.143770 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 08:11:10.143770 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 08:11:10.143770 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 08:11:10.143770 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 08:11:10.143770 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:11:10.143770 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:11:10.143770 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:11:10.143770 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:11:10.143770 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:11:10.143770 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:11:10.143770 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:11:10.143770 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application with Lock( Jul 28 08:11:10.143770 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:11:10.143770 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:11:10.143770 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:11:10.143770 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:11:10.144724 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:11:10.144724 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:11:10.144724 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:11:10.144724 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:11:10.144724 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 08:11:10.144724 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 08:11:10.144724 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 08:11:10.144724 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 08:11:10.144724 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 08:11:10.144724 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 08:11:10.144724 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 28 08:11:10.144724 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application Jul 28 08:11:10.144724 dv-cinder-851351-1-smb devstack@keystone.service[144067]: [pid: 144067|app: 0|req: 121/240] 10.222.0.42 () {56 vars in 1099 bytes} [Thu Jul 28 08:11:09 2022] GET /identity/v3/roles/reader => generated 84 bytes in 378 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:11:10.151951 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a23e0fd-434a-427d-a42d-65c33c7a08a1 None admin] Authenticating user token {{(pid=144067) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:11:10.161879 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e379ab2f-96aa-49db-b7c8-af0775998694 None admin] Validating token access rules against request {{(pid=144068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:11:10.235349 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG dbcounter [-] [144067] Writing DB stats keystone:SELECT=100 {{(pid=144067) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:11:10.262230 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c6fc29-4921-4a90-ac17-2dee3eb40ff3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:11:10.263605 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c6fc29-4921-4a90-ac17-2dee3eb40ff3 None admin] REQUEST_METHOD: `POST` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:11:10.264103 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c6fc29-4921-4a90-ac17-2dee3eb40ff3 None admin] SCRIPT_NAME: `/identity` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:11:10.264522 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c6fc29-4921-4a90-ac17-2dee3eb40ff3 None admin] PATH_INFO: `/v3/users` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:11:10.265310 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04c6fc29-4921-4a90-ac17-2dee3eb40ff3 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:11:10.267088 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04c6fc29-4921-4a90-ac17-2dee3eb40ff3 None admin] RBAC: Authorization granted {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:11:10.272525 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a23e0fd-434a-427d-a42d-65c33c7a08a1 None admin] Validating token access rules against request {{(pid=144067) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:11:10.313558 dv-cinder-851351-1-smb devstack@keystone.service[144068]: [pid: 144068|app: 0|req: 120/241] 10.222.0.42 () {60 vars in 1132 bytes} [Thu Jul 28 08:11:09 2022] POST /identity/v3/users => generated 293 bytes in 338 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 08:11:10.320169 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a46b02b-8266-462c-8cc1-bd14985b50cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144067) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:11:10.320950 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a46b02b-8266-462c-8cc1-bd14985b50cb None admin] REQUEST_METHOD: `GET` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:11:10.321238 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a46b02b-8266-462c-8cc1-bd14985b50cb None admin] SCRIPT_NAME: `/identity` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:11:10.321523 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a46b02b-8266-462c-8cc1-bd14985b50cb None admin] PATH_INFO: `/v3/roles` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:11:10.322356 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a46b02b-8266-462c-8cc1-bd14985b50cb None admin] RBAC: Adding query filter params (name=reader) {{(pid=144067) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:11:10.322679 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a46b02b-8266-462c-8cc1-bd14985b50cb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:11:10.324306 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a46b02b-8266-462c-8cc1-bd14985b50cb None admin] RBAC: Authorization granted {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:11:10.335612 dv-cinder-851351-1-smb devstack@keystone.service[144067]: [pid: 144067|app: 0|req: 122/242] 10.222.0.42 () {56 vars in 1101 bytes} [Thu Jul 28 08:11:10 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:11:10.341493 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c6fc29-4921-4a90-ac17-2dee3eb40ff3 None admin] Authenticating user token {{(pid=144068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:11:10.475346 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG dbcounter [-] [144068] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=144068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:11:10.485960 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c6fc29-4921-4a90-ac17-2dee3eb40ff3 None admin] Validating token access rules against request {{(pid=144068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:11:10.542070 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01666544-4c28-4a29-86a2-14db068740ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:11:10.542798 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01666544-4c28-4a29-86a2-14db068740ac None admin] REQUEST_METHOD: `GET` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:11:10.543088 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01666544-4c28-4a29-86a2-14db068740ac None admin] SCRIPT_NAME: `/identity` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:11:10.543421 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01666544-4c28-4a29-86a2-14db068740ac None admin] PATH_INFO: `/v3/users/63729ca97ebc4b25b8cc06a29c0431ff` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:11:10.558789 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01666544-4c28-4a29-86a2-14db068740ac None admin] RBAC: Authorizing `identity:get_user(user_id=63729ca97ebc4b25b8cc06a29c0431ff)` {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:11:10.560331 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01666544-4c28-4a29-86a2-14db068740ac None admin] RBAC: Authorization granted {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:11:10.562643 dv-cinder-851351-1-smb devstack@keystone.service[144068]: [pid: 144068|app: 0|req: 121/243] 10.222.0.42 () {56 vars in 1177 bytes} [Thu Jul 28 08:11:10 2022] GET /identity/v3/users/63729ca97ebc4b25b8cc06a29c0431ff => generated 297 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:11:10.569838 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a46b02b-8266-462c-8cc1-bd14985b50cb None admin] Authenticating user token {{(pid=144067) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:11:10.705596 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a46b02b-8266-462c-8cc1-bd14985b50cb None admin] Validating token access rules against request {{(pid=144067) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:11:10.738934 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG dbcounter [-] [144067] Writing DB stats keystone:SELECT=100 {{(pid=144067) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:11:10.744937 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb64912-e403-44af-925e-505ab48084b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144067) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:11:10.745973 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb64912-e403-44af-925e-505ab48084b4 None admin] REQUEST_METHOD: `GET` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:11:10.746647 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb64912-e403-44af-925e-505ab48084b4 None admin] SCRIPT_NAME: `/identity` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:11:10.746930 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb64912-e403-44af-925e-505ab48084b4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:11:10.826584 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bb64912-e403-44af-925e-505ab48084b4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:11:10.828572 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19cb8f5-49c9-4ec8-b6b6-c7237129ee88 None None] REQUEST_METHOD: `GET` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:11:10.828885 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19cb8f5-49c9-4ec8-b6b6-c7237129ee88 None None] SCRIPT_NAME: `/identity` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:11:10.829164 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19cb8f5-49c9-4ec8-b6b6-c7237129ee88 None None] PATH_INFO: `/` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:11:10.830621 dv-cinder-851351-1-smb devstack@keystone.service[144068]: [pid: 144068|app: 0|req: 122/244] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 08:11:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 28 08:11:10.832065 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bb64912-e403-44af-925e-505ab48084b4 None admin] RBAC: Authorization granted {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:11:10.840422 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5e52ae-c0f7-42fa-81ff-3f02596b5fef None None] REQUEST_METHOD: `POST` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:11:10.840807 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5e52ae-c0f7-42fa-81ff-3f02596b5fef None None] SCRIPT_NAME: `/identity` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:11:10.841012 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5e52ae-c0f7-42fa-81ff-3f02596b5fef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:11:10.862576 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.auth.core [None req-6f5e52ae-c0f7-42fa-81ff-3f02596b5fef None None] MFA Rules not processed for user `bf5ceb8f07374635ad506b7d1b4f1612`. Rule list: `[]` (Enabled: `True`). {{(pid=144068) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 08:11:10.863884 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.fernet_utils [None req-6f5e52ae-c0f7-42fa-81ff-3f02596b5fef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=144068) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:11:10.964788 dv-cinder-851351-1-smb devstack@keystone.service[144068]: [pid: 144068|app: 0|req: 123/245] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 08:11:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 08:11:10.968702 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa83b7d2-7242-4c13-9c16-f15417af5b8a None None] REQUEST_METHOD: `GET` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:11:10.968702 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa83b7d2-7242-4c13-9c16-f15417af5b8a None None] SCRIPT_NAME: `/identity` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:11:10.968702 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa83b7d2-7242-4c13-9c16-f15417af5b8a None None] PATH_INFO: `/` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:11:10.972100 dv-cinder-851351-1-smb devstack@keystone.service[144068]: [pid: 144068|app: 0|req: 124/246] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 08:11:10 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 08:11:10.980692 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f70bcd-ce6e-48bb-859a-c2e3904941ff None None] REQUEST_METHOD: `POST` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:11:10.980692 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f70bcd-ce6e-48bb-859a-c2e3904941ff None None] SCRIPT_NAME: `/identity` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:11:10.980692 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f70bcd-ce6e-48bb-859a-c2e3904941ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:11:10.991416 dv-cinder-851351-1-smb devstack@keystone.service[144067]: [pid: 144067|app: 0|req: 123/247] 10.222.0.42 () {58 vars in 1282 bytes} [Thu Jul 28 08:11:10 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 422 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 28 08:11:10.998132 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb64912-e403-44af-925e-505ab48084b4 None admin] Authenticating user token {{(pid=144067) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:11:11.017838 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.auth.core [None req-f1f70bcd-ce6e-48bb-859a-c2e3904941ff None None] MFA Rules not processed for user `bf5ceb8f07374635ad506b7d1b4f1612`. Rule list: `[]` (Enabled: `True`). {{(pid=144068) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 08:11:11.019414 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.fernet_utils [None req-f1f70bcd-ce6e-48bb-859a-c2e3904941ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=144068) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:11:11.048821 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG dbcounter [-] [144067] Writing DB stats keystone:SELECT=100 {{(pid=144067) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:11:11.117187 dv-cinder-851351-1-smb devstack@keystone.service[144068]: [pid: 144068|app: 0|req: 125/248] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 08:11:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 08:11:11.118082 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f70bcd-ce6e-48bb-859a-c2e3904941ff None None] Authenticating user token {{(pid=144068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:11:11.140697 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG dbcounter [-] [144068] Writing DB stats keystone:SELECT=100 {{(pid=144068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:11:11.188274 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb64912-e403-44af-925e-505ab48084b4 None admin] Validating token access rules against request {{(pid=144067) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:11:11.253199 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f70bcd-ce6e-48bb-859a-c2e3904941ff None None] Validating token access rules against request {{(pid=144068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:11:11.280940 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c75f57c-bf74-4a19-873f-1ef48ed8e3a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144067) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:11:11.281629 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c75f57c-bf74-4a19-873f-1ef48ed8e3a2 None admin] REQUEST_METHOD: `GET` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:11:11.281920 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c75f57c-bf74-4a19-873f-1ef48ed8e3a2 None admin] SCRIPT_NAME: `/identity` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:11:11.284941 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c75f57c-bf74-4a19-873f-1ef48ed8e3a2 None admin] PATH_INFO: `/v3/projects/2c58e7ea67d84cf692dd9eb3f6cb73a0` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:11:11.286320 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c75f57c-bf74-4a19-873f-1ef48ed8e3a2 None admin] RBAC: Authorizing `identity:get_project(project_id=2c58e7ea67d84cf692dd9eb3f6cb73a0)` {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:11:11.287842 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c75f57c-bf74-4a19-873f-1ef48ed8e3a2 None admin] RBAC: Authorization granted {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:11:11.289612 dv-cinder-851351-1-smb devstack@keystone.service[144067]: [pid: 144067|app: 0|req: 124/249] 10.222.0.42 () {56 vars in 1186 bytes} [Thu Jul 28 08:11:10 2022] GET /identity/v3/projects/2c58e7ea67d84cf692dd9eb3f6cb73a0 => generated 302 bytes in 293 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:11:11.290397 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c75f57c-bf74-4a19-873f-1ef48ed8e3a2 None admin] Authenticating user token {{(pid=144067) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:11:11.319539 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de27b7eb-3546-4457-a3ef-b5c13071a7c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:11:11.320221 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de27b7eb-3546-4457-a3ef-b5c13071a7c7 None admin] REQUEST_METHOD: `GET` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:11:11.320505 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de27b7eb-3546-4457-a3ef-b5c13071a7c7 None admin] SCRIPT_NAME: `/identity` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:11:11.320810 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de27b7eb-3546-4457-a3ef-b5c13071a7c7 None admin] PATH_INFO: `/v3/roles/member` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:11:11.345012 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de27b7eb-3546-4457-a3ef-b5c13071a7c7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 08:11:11.354867 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application [None req-de27b7eb-3546-4457-a3ef-b5c13071a7c7 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 28 08:11:11.354867 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:11:11.354867 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:11:11.354867 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:11:11.354867 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:11:11.354867 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:11:11.354867 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:11:11.354867 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:11:11.354867 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:11:11.354867 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:11:11.354867 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:11:11.354867 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:11:11.354867 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 08:11:11.354867 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 08:11:11.354867 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 08:11:11.354867 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 08:11:11.355944 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 08:11:11.355944 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 08:11:11.355944 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 08:11:11.355944 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 08:11:11.355944 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:11:11.355944 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:11:11.355944 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:11:11.355944 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:11:11.355944 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:11:11.355944 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:11:11.355944 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:11:11.355944 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application with Lock( Jul 28 08:11:11.355944 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:11:11.355944 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:11:11.355944 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:11:11.355944 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:11:11.356935 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:11:11.356935 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:11:11.356935 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:11:11.356935 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:11:11.356935 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 08:11:11.356935 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 08:11:11.356935 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 08:11:11.356935 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 08:11:11.356935 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 08:11:11.356935 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 08:11:11.356935 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 28 08:11:11.356935 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application Jul 28 08:11:11.356935 dv-cinder-851351-1-smb devstack@keystone.service[144068]: [pid: 144068|app: 0|req: 126/250] 10.222.0.42 () {56 vars in 1099 bytes} [Thu Jul 28 08:11:11 2022] GET /identity/v3/roles/member => generated 84 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:11:11.358767 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de27b7eb-3546-4457-a3ef-b5c13071a7c7 None admin] Authenticating user token {{(pid=144068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:11:11.446054 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG dbcounter [-] [144068] Writing DB stats keystone:SELECT=100 {{(pid=144068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:11:11.490735 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de27b7eb-3546-4457-a3ef-b5c13071a7c7 None admin] Validating token access rules against request {{(pid=144068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:11:11.504508 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG dbcounter [-] [144067] Writing DB stats keystone:SELECT=100 {{(pid=144067) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:11:11.508796 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c75f57c-bf74-4a19-873f-1ef48ed8e3a2 None admin] Validating token access rules against request {{(pid=144067) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:11:11.568068 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0042fd6-45cb-4098-bbb5-58f88f284ca5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:11:11.568730 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0042fd6-45cb-4098-bbb5-58f88f284ca5 None admin] REQUEST_METHOD: `GET` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:11:11.569013 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0042fd6-45cb-4098-bbb5-58f88f284ca5 None admin] SCRIPT_NAME: `/identity` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:11:11.569288 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0042fd6-45cb-4098-bbb5-58f88f284ca5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:11:11.570101 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0042fd6-45cb-4098-bbb5-58f88f284ca5 None admin] RBAC: Adding query filter params (role.id=aac18bff164441838e5b7d98f770be5e, scope.project.id=2c58e7ea67d84cf692dd9eb3f6cb73a0, user.id=63729ca97ebc4b25b8cc06a29c0431ff) {{(pid=144068) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:11:11.570411 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0042fd6-45cb-4098-bbb5-58f88f284ca5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:11:11.571908 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0042fd6-45cb-4098-bbb5-58f88f284ca5 None admin] RBAC: Authorization granted {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:11:11.584756 dv-cinder-851351-1-smb devstack@keystone.service[144068]: [pid: 144068|app: 0|req: 127/251] 10.222.0.42 () {56 vars in 1374 bytes} [Thu Jul 28 08:11:11 2022] GET /identity/v3/role_assignments?user.id=63729ca97ebc4b25b8cc06a29c0431ff&scope.project.id=2c58e7ea67d84cf692dd9eb3f6cb73a0&role.id=aac18bff164441838e5b7d98f770be5e => generated 259 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:11:11.585816 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0042fd6-45cb-4098-bbb5-58f88f284ca5 None admin] Authenticating user token {{(pid=144068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:11:11.589604 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09fb801f-425d-4392-8341-f8d9e61ecf7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144067) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:11:11.590291 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09fb801f-425d-4392-8341-f8d9e61ecf7a None admin] REQUEST_METHOD: `GET` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:11:11.590572 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09fb801f-425d-4392-8341-f8d9e61ecf7a None admin] SCRIPT_NAME: `/identity` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:11:11.590848 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09fb801f-425d-4392-8341-f8d9e61ecf7a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:11:11.615252 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09fb801f-425d-4392-8341-f8d9e61ecf7a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 08:11:11.623562 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application [None req-09fb801f-425d-4392-8341-f8d9e61ecf7a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 08:11:11.623562 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:11:11.623562 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:11:11.623562 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:11:11.623562 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:11:11.623562 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:11:11.623562 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:11:11.623562 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:11:11.623562 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:11:11.623562 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:11:11.623562 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:11:11.623562 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:11:11.623562 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 08:11:11.623562 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 08:11:11.623562 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 08:11:11.623562 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 08:11:11.624730 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 08:11:11.624730 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 08:11:11.624730 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 08:11:11.624730 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 08:11:11.624730 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:11:11.624730 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:11:11.624730 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:11:11.624730 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:11:11.624730 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:11:11.624730 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:11:11.624730 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:11:11.624730 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application with Lock( Jul 28 08:11:11.624730 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:11:11.624730 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:11:11.624730 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:11:11.624730 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:11:11.625649 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:11:11.625649 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:11:11.625649 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:11:11.625649 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:11:11.625649 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 08:11:11.625649 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 08:11:11.625649 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 08:11:11.625649 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 08:11:11.625649 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 08:11:11.625649 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 08:11:11.625649 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 08:11:11.625649 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application Jul 28 08:11:11.625649 dv-cinder-851351-1-smb devstack@keystone.service[144067]: [pid: 144067|app: 0|req: 125/252] 10.222.0.42 () {56 vars in 1096 bytes} [Thu Jul 28 08:11:11 2022] GET /identity/v3/roles/admin => generated 83 bytes in 335 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:11:11.640002 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09fb801f-425d-4392-8341-f8d9e61ecf7a None admin] Authenticating user token {{(pid=144067) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:11:11.826263 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0042fd6-45cb-4098-bbb5-58f88f284ca5 None admin] Validating token access rules against request {{(pid=144068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:11:11.865578 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09fb801f-425d-4392-8341-f8d9e61ecf7a None admin] Validating token access rules against request {{(pid=144067) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:11:11.903807 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG dbcounter [-] [144068] Writing DB stats keystone:SELECT=100 {{(pid=144068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:11:11.914952 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b400c78-cd1d-4734-bc15-3d7eae524f42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:11:11.915603 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b400c78-cd1d-4734-bc15-3d7eae524f42 None admin] REQUEST_METHOD: `GET` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:11:11.915884 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b400c78-cd1d-4734-bc15-3d7eae524f42 None admin] SCRIPT_NAME: `/identity` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:11:11.916157 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b400c78-cd1d-4734-bc15-3d7eae524f42 None admin] PATH_INFO: `/v3/roles` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:11:11.916926 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b400c78-cd1d-4734-bc15-3d7eae524f42 None admin] RBAC: Adding query filter params (name=member) {{(pid=144068) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:11:11.917233 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b400c78-cd1d-4734-bc15-3d7eae524f42 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:11:11.918647 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b400c78-cd1d-4734-bc15-3d7eae524f42 None admin] RBAC: Authorization granted {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:11:11.937249 dv-cinder-851351-1-smb devstack@keystone.service[144068]: [pid: 144068|app: 0|req: 128/253] 10.222.0.42 () {56 vars in 1101 bytes} [Thu Jul 28 08:11:11 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 351 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:11:11.947586 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b400c78-cd1d-4734-bc15-3d7eae524f42 None admin] Authenticating user token {{(pid=144068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:11:11.959329 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23eb36f3-c744-43a2-b5ca-47526298fd89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144067) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:11:11.960337 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23eb36f3-c744-43a2-b5ca-47526298fd89 None admin] REQUEST_METHOD: `GET` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:11:11.960617 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23eb36f3-c744-43a2-b5ca-47526298fd89 None admin] SCRIPT_NAME: `/identity` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:11:11.962871 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23eb36f3-c744-43a2-b5ca-47526298fd89 None admin] PATH_INFO: `/v3/roles` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:11:11.962871 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23eb36f3-c744-43a2-b5ca-47526298fd89 None admin] RBAC: Adding query filter params (name=admin) {{(pid=144067) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:11:11.962871 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23eb36f3-c744-43a2-b5ca-47526298fd89 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:11:11.963442 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23eb36f3-c744-43a2-b5ca-47526298fd89 None admin] RBAC: Authorization granted {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:11:11.976187 dv-cinder-851351-1-smb devstack@keystone.service[144067]: [pid: 144067|app: 0|req: 126/254] 10.222.0.42 () {56 vars in 1099 bytes} [Thu Jul 28 08:11:11 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 337 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:11:11.987152 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23eb36f3-c744-43a2-b5ca-47526298fd89 None admin] Authenticating user token {{(pid=144067) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:11:12.019200 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG dbcounter [-] [144067] Writing DB stats keystone:SELECT=100 {{(pid=144067) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:11:12.127284 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23eb36f3-c744-43a2-b5ca-47526298fd89 None admin] Validating token access rules against request {{(pid=144067) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:11:12.161334 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b400c78-cd1d-4734-bc15-3d7eae524f42 None admin] Validating token access rules against request {{(pid=144068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:11:12.183733 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b078fa4-fc67-4a00-8db5-48366611a460 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144067) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:11:12.184744 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b078fa4-fc67-4a00-8db5-48366611a460 None admin] REQUEST_METHOD: `GET` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:11:12.185204 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b078fa4-fc67-4a00-8db5-48366611a460 None admin] SCRIPT_NAME: `/identity` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:11:12.185640 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b078fa4-fc67-4a00-8db5-48366611a460 None admin] PATH_INFO: `/v3/users/577d8eda06324e9b93dbb96ab1a98cfa` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:11:12.187435 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b078fa4-fc67-4a00-8db5-48366611a460 None admin] RBAC: Authorizing `identity:get_user(user_id=577d8eda06324e9b93dbb96ab1a98cfa)` {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:11:12.189128 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b078fa4-fc67-4a00-8db5-48366611a460 None admin] RBAC: Authorization granted {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:11:12.191722 dv-cinder-851351-1-smb devstack@keystone.service[144067]: [pid: 144067|app: 0|req: 127/255] 10.222.0.42 () {56 vars in 1177 bytes} [Thu Jul 28 08:11:11 2022] GET /identity/v3/users/577d8eda06324e9b93dbb96ab1a98cfa => generated 283 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:11:12.193273 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e594dad-afe6-49bd-bcca-0cc74be172bb None None] REQUEST_METHOD: `GET` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:11:12.193857 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e594dad-afe6-49bd-bcca-0cc74be172bb None None] SCRIPT_NAME: `/identity` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:11:12.194297 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e594dad-afe6-49bd-bcca-0cc74be172bb None None] PATH_INFO: `/` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:11:12.200461 dv-cinder-851351-1-smb devstack@keystone.service[144067]: [pid: 144067|app: 0|req: 128/256] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 08:11:12 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 08:11:12.201592 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e594dad-afe6-49bd-bcca-0cc74be172bb None None] Authenticating user token {{(pid=144067) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:11:12.253343 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dceacf81-b36e-4e6f-820d-f86729555941 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:11:12.254381 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dceacf81-b36e-4e6f-820d-f86729555941 None admin] REQUEST_METHOD: `GET` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:11:12.254813 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dceacf81-b36e-4e6f-820d-f86729555941 None admin] SCRIPT_NAME: `/identity` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:11:12.255236 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dceacf81-b36e-4e6f-820d-f86729555941 None admin] PATH_INFO: `/v3/users/d1f187addf31424d8bd31e4d0260bc28` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:11:12.258266 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dceacf81-b36e-4e6f-820d-f86729555941 None admin] RBAC: Authorizing `identity:get_user(user_id=d1f187addf31424d8bd31e4d0260bc28)` {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:11:12.259948 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dceacf81-b36e-4e6f-820d-f86729555941 None admin] RBAC: Authorization granted {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:11:12.264143 dv-cinder-851351-1-smb devstack@keystone.service[144068]: [pid: 144068|app: 0|req: 129/257] 10.222.0.42 () {56 vars in 1177 bytes} [Thu Jul 28 08:11:11 2022] GET /identity/v3/users/d1f187addf31424d8bd31e4d0260bc28 => generated 297 bytes in 318 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 08:11:12.266988 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55a2956-544d-4c97-8484-179d521fb32e None None] REQUEST_METHOD: `POST` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:11:12.267478 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55a2956-544d-4c97-8484-179d521fb32e None None] SCRIPT_NAME: `/identity` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:11:12.268302 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55a2956-544d-4c97-8484-179d521fb32e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:11:12.317880 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.auth.core [None req-f55a2956-544d-4c97-8484-179d521fb32e None None] MFA Rules not processed for user `bf5ceb8f07374635ad506b7d1b4f1612`. Rule list: `[]` (Enabled: `True`). {{(pid=144068) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 08:11:12.319132 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.fernet_utils [None req-f55a2956-544d-4c97-8484-179d521fb32e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=144068) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:11:12.345153 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG dbcounter [-] [144067] Writing DB stats keystone:SELECT=100 {{(pid=144067) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:11:12.354195 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e594dad-afe6-49bd-bcca-0cc74be172bb None None] Validating token access rules against request {{(pid=144067) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:11:12.394822 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae0a12c-9edb-4ca2-9648-a95c85e9da0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144067) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:11:12.396565 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae0a12c-9edb-4ca2-9648-a95c85e9da0c None admin] REQUEST_METHOD: `GET` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:11:12.397584 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae0a12c-9edb-4ca2-9648-a95c85e9da0c None admin] SCRIPT_NAME: `/identity` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:11:12.399216 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae0a12c-9edb-4ca2-9648-a95c85e9da0c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:11:12.437887 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG dbcounter [-] [144068] Writing DB stats keystone:SELECT=100 {{(pid=144068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:11:12.450444 dv-cinder-851351-1-smb devstack@keystone.service[144068]: [pid: 144068|app: 0|req: 130/258] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 08:11:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 08:11:12.451971 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55a2956-544d-4c97-8484-179d521fb32e None None] Authenticating user token {{(pid=144068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:11:12.555407 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ae0a12c-9edb-4ca2-9648-a95c85e9da0c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:11:12.558048 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ae0a12c-9edb-4ca2-9648-a95c85e9da0c None admin] RBAC: Authorization granted {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:11:12.649872 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55a2956-544d-4c97-8484-179d521fb32e None None] Validating token access rules against request {{(pid=144068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:11:12.718809 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d9cf8d-3385-4bbe-9d5c-628e97619117 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:11:12.719495 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d9cf8d-3385-4bbe-9d5c-628e97619117 None admin] REQUEST_METHOD: `GET` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:11:12.719779 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d9cf8d-3385-4bbe-9d5c-628e97619117 None admin] SCRIPT_NAME: `/identity` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:11:12.720058 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d9cf8d-3385-4bbe-9d5c-628e97619117 None admin] PATH_INFO: `/v3/projects/2c58e7ea67d84cf692dd9eb3f6cb73a0` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:11:12.721082 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG dbcounter [-] [144067] Writing DB stats keystone:SELECT=100 {{(pid=144067) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:11:12.725455 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07d9cf8d-3385-4bbe-9d5c-628e97619117 None admin] RBAC: Authorizing `identity:get_project(project_id=2c58e7ea67d84cf692dd9eb3f6cb73a0)` {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:11:12.726971 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07d9cf8d-3385-4bbe-9d5c-628e97619117 None admin] RBAC: Authorization granted {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:11:12.728944 dv-cinder-851351-1-smb devstack@keystone.service[144068]: [pid: 144068|app: 0|req: 131/259] 10.222.0.42 () {56 vars in 1186 bytes} [Thu Jul 28 08:11:12 2022] GET /identity/v3/projects/2c58e7ea67d84cf692dd9eb3f6cb73a0 => generated 302 bytes in 277 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:11:12.729575 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d9cf8d-3385-4bbe-9d5c-628e97619117 None admin] Authenticating user token {{(pid=144068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:11:12.737096 dv-cinder-851351-1-smb devstack@keystone.service[144067]: [pid: 144067|app: 0|req: 129/260] 10.222.0.42 () {58 vars in 1282 bytes} [Thu Jul 28 08:11:12 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 536 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 28 08:11:12.738343 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae0a12c-9edb-4ca2-9648-a95c85e9da0c None admin] Authenticating user token {{(pid=144067) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:11:12.805207 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG dbcounter [-] [144068] Writing DB stats keystone:SELECT=100 {{(pid=144068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:11:12.876541 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d9cf8d-3385-4bbe-9d5c-628e97619117 None admin] Validating token access rules against request {{(pid=144068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:11:12.934714 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6ff15e-1c2c-4bce-b5ef-ef3eaab06de3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:11:12.937161 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6ff15e-1c2c-4bce-b5ef-ef3eaab06de3 None admin] REQUEST_METHOD: `GET` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:11:12.937866 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6ff15e-1c2c-4bce-b5ef-ef3eaab06de3 None admin] SCRIPT_NAME: `/identity` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:11:12.939475 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6ff15e-1c2c-4bce-b5ef-ef3eaab06de3 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:11:12.949001 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae0a12c-9edb-4ca2-9648-a95c85e9da0c None admin] Validating token access rules against request {{(pid=144067) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:11:12.963933 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f6ff15e-1c2c-4bce-b5ef-ef3eaab06de3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 08:11:12.972614 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application [None req-6f6ff15e-1c2c-4bce-b5ef-ef3eaab06de3 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 28 08:11:12.972614 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:11:12.972614 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:11:12.972614 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:11:12.972614 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:11:12.972614 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:11:12.972614 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:11:12.972614 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:11:12.972614 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:11:12.972614 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:11:12.972614 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:11:12.972614 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:11:12.972614 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 08:11:12.972614 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 08:11:12.972614 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 08:11:12.972614 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 08:11:12.973832 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 08:11:12.973832 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 08:11:12.973832 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 08:11:12.973832 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 08:11:12.973832 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:11:12.973832 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:11:12.973832 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:11:12.973832 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:11:12.973832 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:11:12.973832 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:11:12.973832 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:11:12.973832 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application with Lock( Jul 28 08:11:12.973832 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:11:12.973832 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:11:12.973832 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:11:12.973832 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:11:12.974780 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:11:12.974780 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:11:12.974780 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:11:12.974780 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:11:12.974780 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 08:11:12.974780 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 08:11:12.974780 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 08:11:12.974780 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 08:11:12.974780 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 08:11:12.974780 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 08:11:12.974780 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 28 08:11:12.974780 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application Jul 28 08:11:12.977933 dv-cinder-851351-1-smb devstack@keystone.service[144068]: [pid: 144068|app: 0|req: 132/261] 10.222.0.42 () {56 vars in 1114 bytes} [Thu Jul 28 08:11:12 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 248 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:11:12.979147 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6ff15e-1c2c-4bce-b5ef-ef3eaab06de3 None admin] Authenticating user token {{(pid=144068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:11:13.094115 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d0cd1c-7c98-4039-bc90-b3eff591096a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144067) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:11:13.094859 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d0cd1c-7c98-4039-bc90-b3eff591096a None admin] REQUEST_METHOD: `PUT` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:11:13.095227 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d0cd1c-7c98-4039-bc90-b3eff591096a None admin] SCRIPT_NAME: `/identity` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:11:13.095558 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d0cd1c-7c98-4039-bc90-b3eff591096a None admin] PATH_INFO: `/v3/projects/2c58e7ea67d84cf692dd9eb3f6cb73a0/users/d1f187addf31424d8bd31e4d0260bc28/roles/6933b60756fe46dd8f27854f5e192061` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:11:13.097653 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45d0cd1c-7c98-4039-bc90-b3eff591096a None admin] RBAC: Authorizing `identity:create_grant(project_id=2c58e7ea67d84cf692dd9eb3f6cb73a0, user_id=d1f187addf31424d8bd31e4d0260bc28, role_id=6933b60756fe46dd8f27854f5e192061)` {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:11:13.099198 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45d0cd1c-7c98-4039-bc90-b3eff591096a None admin] RBAC: Authorization granted {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:11:13.103181 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6ff15e-1c2c-4bce-b5ef-ef3eaab06de3 None admin] Validating token access rules against request {{(pid=144068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:11:13.136105 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG dbcounter [-] [144068] Writing DB stats keystone:SELECT=100 {{(pid=144068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:11:13.143176 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d557db-1942-433e-8cad-9243538f908c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:11:13.144367 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d557db-1942-433e-8cad-9243538f908c None admin] REQUEST_METHOD: `GET` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:11:13.144961 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d557db-1942-433e-8cad-9243538f908c None admin] SCRIPT_NAME: `/identity` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:11:13.145536 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d557db-1942-433e-8cad-9243538f908c None admin] PATH_INFO: `/v3/projects/2c58e7ea67d84cf692dd9eb3f6cb73a0` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:11:13.147016 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6d557db-1942-433e-8cad-9243538f908c None admin] RBAC: Authorizing `identity:get_project(project_id=2c58e7ea67d84cf692dd9eb3f6cb73a0)` {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:11:13.148809 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6d557db-1942-433e-8cad-9243538f908c None admin] RBAC: Authorization granted {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:11:13.151208 dv-cinder-851351-1-smb devstack@keystone.service[144068]: [pid: 144068|app: 0|req: 133/262] 10.222.0.42 () {56 vars in 1186 bytes} [Thu Jul 28 08:11:12 2022] GET /identity/v3/projects/2c58e7ea67d84cf692dd9eb3f6cb73a0 => generated 302 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:11:13.152346 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d557db-1942-433e-8cad-9243538f908c None admin] Authenticating user token {{(pid=144068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:11:13.157582 dv-cinder-851351-1-smb devstack@keystone.service[144067]: [pid: 144067|app: 0|req: 130/263] 10.222.0.42 () {58 vars in 1439 bytes} [Thu Jul 28 08:11:12 2022] PUT /identity/v3/projects/2c58e7ea67d84cf692dd9eb3f6cb73a0/users/d1f187addf31424d8bd31e4d0260bc28/roles/6933b60756fe46dd8f27854f5e192061 => generated 0 bytes in 419 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 08:11:13.158929 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d0cd1c-7c98-4039-bc90-b3eff591096a None admin] Authenticating user token {{(pid=144067) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:11:13.299418 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d557db-1942-433e-8cad-9243538f908c None admin] Validating token access rules against request {{(pid=144068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:11:13.311056 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG dbcounter [-] [144067] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=144067) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:11:13.351421 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c568764-acad-4fd4-b388-4ecfcfb9a3a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:11:13.352496 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c568764-acad-4fd4-b388-4ecfcfb9a3a9 None admin] REQUEST_METHOD: `GET` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:11:13.353010 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c568764-acad-4fd4-b388-4ecfcfb9a3a9 None admin] SCRIPT_NAME: `/identity` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:11:13.353565 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c568764-acad-4fd4-b388-4ecfcfb9a3a9 None admin] PATH_INFO: `/v3/roles` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:11:13.354538 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c568764-acad-4fd4-b388-4ecfcfb9a3a9 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=144068) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:11:13.355136 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c568764-acad-4fd4-b388-4ecfcfb9a3a9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:11:13.356820 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c568764-acad-4fd4-b388-4ecfcfb9a3a9 None admin] RBAC: Authorization granted {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:11:13.367323 dv-cinder-851351-1-smb devstack@keystone.service[144068]: [pid: 144068|app: 0|req: 134/264] 10.222.0.42 () {56 vars in 1111 bytes} [Thu Jul 28 08:11:13 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:11:13.373513 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c568764-acad-4fd4-b388-4ecfcfb9a3a9 None admin] Authenticating user token {{(pid=144068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:11:13.407592 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d0cd1c-7c98-4039-bc90-b3eff591096a None admin] Validating token access rules against request {{(pid=144067) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:11:13.429910 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG dbcounter [-] [144068] Writing DB stats keystone:SELECT=100 {{(pid=144068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:11:13.461349 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3046e94-831c-48cd-982f-70ddb50c13d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144067) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:11:13.462016 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3046e94-831c-48cd-982f-70ddb50c13d1 None admin] REQUEST_METHOD: `GET` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:11:13.462299 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3046e94-831c-48cd-982f-70ddb50c13d1 None admin] SCRIPT_NAME: `/identity` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:11:13.462578 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3046e94-831c-48cd-982f-70ddb50c13d1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:11:13.463472 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3046e94-831c-48cd-982f-70ddb50c13d1 None admin] RBAC: Adding query filter params (role.id=d1020e7bb0b7411d895ddedd6dc02c5b, scope.project.id=2c58e7ea67d84cf692dd9eb3f6cb73a0, user.id=577d8eda06324e9b93dbb96ab1a98cfa) {{(pid=144067) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:11:13.463792 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3046e94-831c-48cd-982f-70ddb50c13d1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:11:13.465432 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3046e94-831c-48cd-982f-70ddb50c13d1 None admin] RBAC: Authorization granted {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:11:13.481911 dv-cinder-851351-1-smb devstack@keystone.service[144067]: [pid: 144067|app: 0|req: 131/265] 10.222.0.42 () {56 vars in 1374 bytes} [Thu Jul 28 08:11:13 2022] GET /identity/v3/role_assignments?user.id=577d8eda06324e9b93dbb96ab1a98cfa&scope.project.id=2c58e7ea67d84cf692dd9eb3f6cb73a0&role.id=d1020e7bb0b7411d895ddedd6dc02c5b => generated 608 bytes in 324 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:11:13.484968 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f769d7-756c-4db0-b2f5-4d0a28b3f365 None None] REQUEST_METHOD: `GET` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:11:13.485270 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f769d7-756c-4db0-b2f5-4d0a28b3f365 None None] SCRIPT_NAME: `/identity` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:11:13.485555 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f769d7-756c-4db0-b2f5-4d0a28b3f365 None None] PATH_INFO: `/` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:11:13.492231 dv-cinder-851351-1-smb devstack@keystone.service[144067]: [pid: 144067|app: 0|req: 132/266] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 08:11:13 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 08:11:13.511293 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c568764-acad-4fd4-b388-4ecfcfb9a3a9 None admin] Validating token access rules against request {{(pid=144068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:11:13.514660 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11aedfe6-6c70-4b6f-9d8e-40cb98d12b28 None None] REQUEST_METHOD: `POST` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:11:13.514991 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11aedfe6-6c70-4b6f-9d8e-40cb98d12b28 None None] SCRIPT_NAME: `/identity` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:11:13.515233 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11aedfe6-6c70-4b6f-9d8e-40cb98d12b28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:11:13.556150 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.auth.core [None req-11aedfe6-6c70-4b6f-9d8e-40cb98d12b28 None None] MFA Rules not processed for user `bf5ceb8f07374635ad506b7d1b4f1612`. Rule list: `[]` (Enabled: `True`). {{(pid=144067) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 08:11:13.557344 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.fernet_utils [None req-11aedfe6-6c70-4b6f-9d8e-40cb98d12b28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=144067) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:11:13.579018 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2370a0a1-0224-4c20-9446-163391cc57a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:11:13.579727 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2370a0a1-0224-4c20-9446-163391cc57a4 None admin] REQUEST_METHOD: `GET` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:11:13.580182 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2370a0a1-0224-4c20-9446-163391cc57a4 None admin] SCRIPT_NAME: `/identity` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:11:13.580656 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2370a0a1-0224-4c20-9446-163391cc57a4 None admin] PATH_INFO: `/v3/users/577d8eda06324e9b93dbb96ab1a98cfa` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:11:13.585936 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2370a0a1-0224-4c20-9446-163391cc57a4 None admin] RBAC: Authorizing `identity:get_user(user_id=577d8eda06324e9b93dbb96ab1a98cfa)` {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:11:13.587715 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2370a0a1-0224-4c20-9446-163391cc57a4 None admin] RBAC: Authorization granted {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:11:13.590468 dv-cinder-851351-1-smb devstack@keystone.service[144068]: [pid: 144068|app: 0|req: 135/267] 10.222.0.42 () {56 vars in 1177 bytes} [Thu Jul 28 08:11:13 2022] GET /identity/v3/users/577d8eda06324e9b93dbb96ab1a98cfa => generated 283 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 08:11:13.596211 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2370a0a1-0224-4c20-9446-163391cc57a4 None admin] Authenticating user token {{(pid=144068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:11:13.688809 dv-cinder-851351-1-smb devstack@keystone.service[144067]: [pid: 144067|app: 0|req: 133/268] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 08:11:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 08:11:13.690411 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b798176-3609-4178-bdf0-5a1e3f9edbba None None] REQUEST_METHOD: `GET` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:11:13.690710 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b798176-3609-4178-bdf0-5a1e3f9edbba None None] SCRIPT_NAME: `/identity` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:11:13.690995 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b798176-3609-4178-bdf0-5a1e3f9edbba None None] PATH_INFO: `/` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:11:13.692495 dv-cinder-851351-1-smb devstack@keystone.service[144067]: [pid: 144067|app: 0|req: 134/269] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 08:11:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 08:11:13.699205 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a76f82-7f73-45c2-ad6e-11f0b5a53c07 None None] REQUEST_METHOD: `POST` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:11:13.699569 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a76f82-7f73-45c2-ad6e-11f0b5a53c07 None None] SCRIPT_NAME: `/identity` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:11:13.699761 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a76f82-7f73-45c2-ad6e-11f0b5a53c07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:11:13.742091 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.auth.core [None req-94a76f82-7f73-45c2-ad6e-11f0b5a53c07 None None] MFA Rules not processed for user `bf5ceb8f07374635ad506b7d1b4f1612`. Rule list: `[]` (Enabled: `True`). {{(pid=144067) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 08:11:13.743447 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.fernet_utils [None req-94a76f82-7f73-45c2-ad6e-11f0b5a53c07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=144067) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:11:13.745829 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2370a0a1-0224-4c20-9446-163391cc57a4 None admin] Validating token access rules against request {{(pid=144068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:11:13.773108 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG dbcounter [-] [144068] Writing DB stats keystone:SELECT=100 {{(pid=144068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:11:13.791986 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ea2615-6fb0-4c56-98f0-6145ae15e92a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:11:13.793102 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ea2615-6fb0-4c56-98f0-6145ae15e92a None admin] REQUEST_METHOD: `GET` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:11:13.793625 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ea2615-6fb0-4c56-98f0-6145ae15e92a None admin] SCRIPT_NAME: `/identity` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:11:13.794087 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ea2615-6fb0-4c56-98f0-6145ae15e92a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:11:13.841243 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG dbcounter [-] [144067] Writing DB stats keystone:SELECT=100 {{(pid=144067) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:11:13.875185 dv-cinder-851351-1-smb devstack@keystone.service[144067]: [pid: 144067|app: 0|req: 135/270] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 08:11:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 08:11:13.876393 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a76f82-7f73-45c2-ad6e-11f0b5a53c07 None None] Authenticating user token {{(pid=144067) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:11:13.904947 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89ea2615-6fb0-4c56-98f0-6145ae15e92a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:11:13.906411 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89ea2615-6fb0-4c56-98f0-6145ae15e92a None admin] RBAC: Authorization granted {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:11:14.031341 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a76f82-7f73-45c2-ad6e-11f0b5a53c07 None None] Validating token access rules against request {{(pid=144067) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:11:14.068592 dv-cinder-851351-1-smb devstack@keystone.service[144068]: [pid: 144068|app: 0|req: 136/271] 10.222.0.42 () {58 vars in 1282 bytes} [Thu Jul 28 08:11:13 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 468 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 28 08:11:14.068592 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ea2615-6fb0-4c56-98f0-6145ae15e92a None admin] Authenticating user token {{(pid=144068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:11:14.078788 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0585f7-b647-4d0d-aec1-69b91868673e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144067) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:11:14.079882 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0585f7-b647-4d0d-aec1-69b91868673e None admin] REQUEST_METHOD: `GET` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:11:14.080465 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0585f7-b647-4d0d-aec1-69b91868673e None admin] SCRIPT_NAME: `/identity` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:11:14.081196 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0585f7-b647-4d0d-aec1-69b91868673e None admin] PATH_INFO: `/v3/roles/member` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:11:14.085701 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG dbcounter [-] [144068] Writing DB stats keystone:SELECT=100 {{(pid=144068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:11:14.098308 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be0585f7-b647-4d0d-aec1-69b91868673e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 08:11:14.103326 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application [None req-be0585f7-b647-4d0d-aec1-69b91868673e None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 28 08:11:14.103326 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:11:14.103326 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:11:14.103326 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:11:14.103326 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:11:14.103326 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:11:14.103326 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:11:14.103326 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:11:14.103326 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:11:14.103326 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:11:14.103326 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:11:14.103326 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:11:14.103326 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 08:11:14.103326 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 08:11:14.103326 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 08:11:14.103326 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 08:11:14.104375 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 08:11:14.104375 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 08:11:14.104375 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 08:11:14.104375 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 08:11:14.104375 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:11:14.104375 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:11:14.104375 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:11:14.104375 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:11:14.104375 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:11:14.104375 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:11:14.104375 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:11:14.104375 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application with Lock( Jul 28 08:11:14.104375 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:11:14.104375 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:11:14.104375 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:11:14.104375 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:11:14.105332 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:11:14.105332 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:11:14.105332 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:11:14.105332 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:11:14.105332 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 08:11:14.105332 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 08:11:14.105332 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 08:11:14.105332 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 08:11:14.105332 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 08:11:14.105332 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 08:11:14.105332 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 28 08:11:14.105332 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application Jul 28 08:11:14.105332 dv-cinder-851351-1-smb devstack@keystone.service[144067]: [pid: 144067|app: 0|req: 136/272] 10.222.0.42 () {56 vars in 1099 bytes} [Thu Jul 28 08:11:13 2022] GET /identity/v3/roles/member => generated 84 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:11:14.106114 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0585f7-b647-4d0d-aec1-69b91868673e None admin] Authenticating user token {{(pid=144067) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:11:14.144480 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG dbcounter [-] [144067] Writing DB stats keystone:SELECT=100 {{(pid=144067) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:11:14.197609 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ea2615-6fb0-4c56-98f0-6145ae15e92a None admin] Validating token access rules against request {{(pid=144068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:11:14.230011 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0585f7-b647-4d0d-aec1-69b91868673e None admin] Validating token access rules against request {{(pid=144067) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:11:14.241332 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d79859d-ce0c-433d-980a-4cc8a2515f96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:11:14.242000 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d79859d-ce0c-433d-980a-4cc8a2515f96 None admin] REQUEST_METHOD: `GET` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:11:14.242291 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d79859d-ce0c-433d-980a-4cc8a2515f96 None admin] SCRIPT_NAME: `/identity` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:11:14.242566 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d79859d-ce0c-433d-980a-4cc8a2515f96 None admin] PATH_INFO: `/v3/domains/default` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:11:14.243834 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d79859d-ce0c-433d-980a-4cc8a2515f96 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:11:14.245370 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d79859d-ce0c-433d-980a-4cc8a2515f96 None admin] RBAC: Authorization granted {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:11:14.247225 dv-cinder-851351-1-smb devstack@keystone.service[144068]: [pid: 144068|app: 0|req: 137/273] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 08:11:14 2022] GET /identity/v3/domains/default => generated 199 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:11:14.249925 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d79859d-ce0c-433d-980a-4cc8a2515f96 None admin] Authenticating user token {{(pid=144068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:11:14.270008 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d538d0b-a96d-4350-b48a-13b25404b83b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144067) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:11:14.270676 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d538d0b-a96d-4350-b48a-13b25404b83b None admin] REQUEST_METHOD: `GET` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:11:14.270959 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d538d0b-a96d-4350-b48a-13b25404b83b None admin] SCRIPT_NAME: `/identity` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:11:14.271242 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d538d0b-a96d-4350-b48a-13b25404b83b None admin] PATH_INFO: `/v3/projects/2c58e7ea67d84cf692dd9eb3f6cb73a0` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:11:14.272462 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d538d0b-a96d-4350-b48a-13b25404b83b None admin] RBAC: Authorizing `identity:get_project(project_id=2c58e7ea67d84cf692dd9eb3f6cb73a0)` {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:11:14.274003 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d538d0b-a96d-4350-b48a-13b25404b83b None admin] RBAC: Authorization granted {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:11:14.275721 dv-cinder-851351-1-smb devstack@keystone.service[144067]: [pid: 144067|app: 0|req: 137/274] 10.222.0.42 () {56 vars in 1186 bytes} [Thu Jul 28 08:11:14 2022] GET /identity/v3/projects/2c58e7ea67d84cf692dd9eb3f6cb73a0 => generated 302 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:11:14.277060 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a6524f-63ef-408c-9abf-23407000ba93 None None] REQUEST_METHOD: `GET` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:11:14.277349 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a6524f-63ef-408c-9abf-23407000ba93 None None] SCRIPT_NAME: `/identity` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:11:14.277628 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a6524f-63ef-408c-9abf-23407000ba93 None None] PATH_INFO: `/` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:11:14.278870 dv-cinder-851351-1-smb devstack@keystone.service[144067]: [pid: 144067|app: 0|req: 138/275] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 08:11:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 08:11:14.279558 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a6524f-63ef-408c-9abf-23407000ba93 None None] Authenticating user token {{(pid=144067) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:11:14.366138 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG dbcounter [-] [144068] Writing DB stats keystone:SELECT=100 {{(pid=144068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:11:14.384849 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d79859d-ce0c-433d-980a-4cc8a2515f96 None admin] Validating token access rules against request {{(pid=144068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:11:14.403627 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a6524f-63ef-408c-9abf-23407000ba93 None None] Validating token access rules against request {{(pid=144067) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:11:14.405469 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG dbcounter [-] [144067] Writing DB stats keystone:SELECT=100 {{(pid=144067) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:11:14.424318 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf1cefa-278e-486e-a6f2-6ce53a707535 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:11:14.425002 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf1cefa-278e-486e-a6f2-6ce53a707535 None admin] REQUEST_METHOD: `GET` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:11:14.425284 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf1cefa-278e-486e-a6f2-6ce53a707535 None admin] SCRIPT_NAME: `/identity` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:11:14.425560 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf1cefa-278e-486e-a6f2-6ce53a707535 None admin] PATH_INFO: `/v3/roles` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:11:14.426369 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faf1cefa-278e-486e-a6f2-6ce53a707535 None admin] RBAC: Adding query filter params (name=member) {{(pid=144068) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:11:14.426678 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faf1cefa-278e-486e-a6f2-6ce53a707535 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:11:14.428072 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faf1cefa-278e-486e-a6f2-6ce53a707535 None admin] RBAC: Authorization granted {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:11:14.436780 dv-cinder-851351-1-smb devstack@keystone.service[144068]: [pid: 144068|app: 0|req: 138/276] 10.222.0.42 () {56 vars in 1101 bytes} [Thu Jul 28 08:11:14 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:11:14.437634 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf1cefa-278e-486e-a6f2-6ce53a707535 None admin] Authenticating user token {{(pid=144068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:11:14.455832 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fab268a-a843-4084-b9cd-de266f3bbffd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144067) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:11:14.456958 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fab268a-a843-4084-b9cd-de266f3bbffd None admin] REQUEST_METHOD: `POST` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:11:14.457543 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fab268a-a843-4084-b9cd-de266f3bbffd None admin] SCRIPT_NAME: `/identity` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:11:14.458086 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fab268a-a843-4084-b9cd-de266f3bbffd None admin] PATH_INFO: `/v3/users` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:11:14.459009 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fab268a-a843-4084-b9cd-de266f3bbffd None admin] RBAC: Authorizing `identity:create_user()` {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:11:14.461061 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fab268a-a843-4084-b9cd-de266f3bbffd None admin] RBAC: Authorization granted {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:11:14.494156 dv-cinder-851351-1-smb devstack@keystone.service[144067]: [pid: 144067|app: 0|req: 139/277] 10.222.0.42 () {60 vars in 1132 bytes} [Thu Jul 28 08:11:14 2022] POST /identity/v3/users => generated 293 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 08:11:14.495814 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c384474-e795-4d27-8f67-a5e0fc486198 None None] REQUEST_METHOD: `POST` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:11:14.496204 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c384474-e795-4d27-8f67-a5e0fc486198 None None] SCRIPT_NAME: `/identity` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:11:14.496541 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c384474-e795-4d27-8f67-a5e0fc486198 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:11:14.527352 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.auth.core [None req-8c384474-e795-4d27-8f67-a5e0fc486198 None None] MFA Rules not processed for user `bf5ceb8f07374635ad506b7d1b4f1612`. Rule list: `[]` (Enabled: `True`). {{(pid=144067) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 08:11:14.528811 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.fernet_utils [None req-8c384474-e795-4d27-8f67-a5e0fc486198 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=144067) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:11:14.580047 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf1cefa-278e-486e-a6f2-6ce53a707535 None admin] Validating token access rules against request {{(pid=144068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:11:14.632791 dv-cinder-851351-1-smb devstack@keystone.service[144067]: [pid: 144067|app: 0|req: 140/278] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 08:11:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 08:11:14.632791 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c384474-e795-4d27-8f67-a5e0fc486198 None None] Authenticating user token {{(pid=144067) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:11:14.642249 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5baa24c2-0358-4c70-af59-89c17c78a0fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:11:14.642916 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5baa24c2-0358-4c70-af59-89c17c78a0fd None admin] REQUEST_METHOD: `GET` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:11:14.643272 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5baa24c2-0358-4c70-af59-89c17c78a0fd None admin] SCRIPT_NAME: `/identity` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:11:14.643537 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5baa24c2-0358-4c70-af59-89c17c78a0fd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:11:14.644439 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5baa24c2-0358-4c70-af59-89c17c78a0fd None admin] RBAC: Adding query filter params (role.id=7e9c2306137042cf8b8eba284656ef33, scope.project.id=2c58e7ea67d84cf692dd9eb3f6cb73a0, user.id=577d8eda06324e9b93dbb96ab1a98cfa) {{(pid=144068) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:11:14.644813 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5baa24c2-0358-4c70-af59-89c17c78a0fd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:11:14.646405 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5baa24c2-0358-4c70-af59-89c17c78a0fd None admin] RBAC: Authorization granted {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:11:14.659857 dv-cinder-851351-1-smb devstack@keystone.service[144068]: [pid: 144068|app: 0|req: 139/279] 10.222.0.42 () {56 vars in 1374 bytes} [Thu Jul 28 08:11:14 2022] GET /identity/v3/role_assignments?user.id=577d8eda06324e9b93dbb96ab1a98cfa&scope.project.id=2c58e7ea67d84cf692dd9eb3f6cb73a0&role.id=7e9c2306137042cf8b8eba284656ef33 => generated 608 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:11:14.660950 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5baa24c2-0358-4c70-af59-89c17c78a0fd None admin] Authenticating user token {{(pid=144068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:11:14.682723 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG dbcounter [-] [144068] Writing DB stats keystone:SELECT=100 {{(pid=144068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:11:14.783177 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG dbcounter [-] [144067] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=144067) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:11:14.807007 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c384474-e795-4d27-8f67-a5e0fc486198 None None] Validating token access rules against request {{(pid=144067) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:11:14.822484 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5baa24c2-0358-4c70-af59-89c17c78a0fd None admin] Validating token access rules against request {{(pid=144068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:11:14.858859 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf58643-2a07-4058-89f3-4665a2395817 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144067) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:11:14.861674 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf58643-2a07-4058-89f3-4665a2395817 None admin] REQUEST_METHOD: `GET` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:11:14.862247 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf58643-2a07-4058-89f3-4665a2395817 None admin] SCRIPT_NAME: `/identity` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:11:14.862535 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf58643-2a07-4058-89f3-4665a2395817 None admin] PATH_INFO: `/v3/users/9b849a2813204a01ba7d1d74158f47fb` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:11:14.877481 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e990dc49-e185-46fd-9a34-eb27494f129e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:11:14.878161 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e990dc49-e185-46fd-9a34-eb27494f129e None admin] REQUEST_METHOD: `GET` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:11:14.878622 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e990dc49-e185-46fd-9a34-eb27494f129e None admin] SCRIPT_NAME: `/identity` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:11:14.878911 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e990dc49-e185-46fd-9a34-eb27494f129e None admin] PATH_INFO: `/v3/roles/reader` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:11:14.887477 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebf58643-2a07-4058-89f3-4665a2395817 None admin] RBAC: Authorizing `identity:get_user(user_id=9b849a2813204a01ba7d1d74158f47fb)` {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:11:14.892236 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebf58643-2a07-4058-89f3-4665a2395817 None admin] RBAC: Authorization granted {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:11:14.893747 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e990dc49-e185-46fd-9a34-eb27494f129e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 08:11:14.894255 dv-cinder-851351-1-smb devstack@keystone.service[144067]: [pid: 144067|app: 0|req: 141/280] 10.222.0.42 () {56 vars in 1177 bytes} [Thu Jul 28 08:11:14 2022] GET /identity/v3/users/9b849a2813204a01ba7d1d74158f47fb => generated 293 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:11:14.899591 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application [None req-e990dc49-e185-46fd-9a34-eb27494f129e None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 28 08:11:14.899591 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:11:14.899591 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:11:14.899591 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:11:14.899591 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:11:14.899591 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:11:14.899591 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:11:14.899591 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:11:14.899591 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:11:14.899591 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:11:14.899591 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:11:14.899591 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:11:14.899591 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 08:11:14.899591 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 08:11:14.899591 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 08:11:14.899591 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 08:11:14.900825 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 08:11:14.900825 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 08:11:14.900825 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 08:11:14.900825 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 08:11:14.900825 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:11:14.900825 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:11:14.900825 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:11:14.900825 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:11:14.900825 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:11:14.900825 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:11:14.900825 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:11:14.900825 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application with Lock( Jul 28 08:11:14.900825 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:11:14.900825 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:11:14.900825 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:11:14.900825 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:11:14.901745 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:11:14.901745 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:11:14.901745 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:11:14.901745 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:11:14.901745 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 08:11:14.901745 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 08:11:14.901745 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 08:11:14.901745 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 08:11:14.901745 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 08:11:14.901745 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 08:11:14.901745 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 28 08:11:14.901745 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application Jul 28 08:11:14.903992 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf58643-2a07-4058-89f3-4665a2395817 None admin] Authenticating user token {{(pid=144067) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:11:14.904780 dv-cinder-851351-1-smb devstack@keystone.service[144068]: [pid: 144068|app: 0|req: 140/281] 10.222.0.42 () {56 vars in 1099 bytes} [Thu Jul 28 08:11:14 2022] GET /identity/v3/roles/reader => generated 84 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:11:14.907070 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e990dc49-e185-46fd-9a34-eb27494f129e None admin] Authenticating user token {{(pid=144068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:11:15.021902 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG dbcounter [-] [144068] Writing DB stats keystone:SELECT=100 {{(pid=144068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:11:15.055917 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf58643-2a07-4058-89f3-4665a2395817 None admin] Validating token access rules against request {{(pid=144067) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:11:15.078351 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e990dc49-e185-46fd-9a34-eb27494f129e None admin] Validating token access rules against request {{(pid=144068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:11:15.105950 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0c7c9d-f25d-4160-a0f5-da3d50e19928 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144067) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:11:15.107085 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0c7c9d-f25d-4160-a0f5-da3d50e19928 None admin] REQUEST_METHOD: `GET` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:11:15.107585 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0c7c9d-f25d-4160-a0f5-da3d50e19928 None admin] SCRIPT_NAME: `/identity` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:11:15.108067 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0c7c9d-f25d-4160-a0f5-da3d50e19928 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:11:15.109162 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f0c7c9d-f25d-4160-a0f5-da3d50e19928 None admin] RBAC: Adding query filter params (role.id=6933b60756fe46dd8f27854f5e192061, user.id=9b849a2813204a01ba7d1d74158f47fb, scope.system=all) {{(pid=144067) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:11:15.109735 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f0c7c9d-f25d-4160-a0f5-da3d50e19928 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:11:15.111797 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f0c7c9d-f25d-4160-a0f5-da3d50e19928 None admin] RBAC: Authorization granted {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:11:15.118754 dv-cinder-851351-1-smb devstack@keystone.service[144067]: [pid: 144067|app: 0|req: 142/282] 10.222.0.42 () {56 vars in 1308 bytes} [Thu Jul 28 08:11:14 2022] GET /identity/v3/role_assignments?user.id=9b849a2813204a01ba7d1d74158f47fb&scope.system=all&role.id=6933b60756fe46dd8f27854f5e192061 => generated 226 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:11:15.122454 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac1afc6-42e8-4eaa-9243-46919ea616fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:11:15.123383 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac1afc6-42e8-4eaa-9243-46919ea616fd None admin] REQUEST_METHOD: `GET` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:11:15.123814 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac1afc6-42e8-4eaa-9243-46919ea616fd None admin] SCRIPT_NAME: `/identity` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:11:15.124244 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac1afc6-42e8-4eaa-9243-46919ea616fd None admin] PATH_INFO: `/v3/roles` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:11:15.125214 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac1afc6-42e8-4eaa-9243-46919ea616fd None admin] RBAC: Adding query filter params (name=reader) {{(pid=144068) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:11:15.125700 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac1afc6-42e8-4eaa-9243-46919ea616fd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:11:15.127338 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac1afc6-42e8-4eaa-9243-46919ea616fd None admin] RBAC: Authorization granted {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:11:15.139087 dv-cinder-851351-1-smb devstack@keystone.service[144068]: [pid: 144068|app: 0|req: 141/283] 10.222.0.42 () {56 vars in 1101 bytes} [Thu Jul 28 08:11:14 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 08:11:15.148766 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0c7c9d-f25d-4160-a0f5-da3d50e19928 None admin] Authenticating user token {{(pid=144067) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:11:15.159681 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG dbcounter [-] [144067] Writing DB stats keystone:SELECT=100 {{(pid=144067) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:11:15.272641 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0c7c9d-f25d-4160-a0f5-da3d50e19928 None admin] Validating token access rules against request {{(pid=144067) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:11:15.312262 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1289d9cd-d8ca-40b9-93f9-5ec97dc616ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144067) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:11:15.312976 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1289d9cd-d8ca-40b9-93f9-5ec97dc616ab None admin] REQUEST_METHOD: `GET` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:11:15.313256 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1289d9cd-d8ca-40b9-93f9-5ec97dc616ab None admin] SCRIPT_NAME: `/identity` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:11:15.313530 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1289d9cd-d8ca-40b9-93f9-5ec97dc616ab None admin] PATH_INFO: `/v3/users/63729ca97ebc4b25b8cc06a29c0431ff` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:11:15.314758 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1289d9cd-d8ca-40b9-93f9-5ec97dc616ab None admin] RBAC: Authorizing `identity:get_user(user_id=63729ca97ebc4b25b8cc06a29c0431ff)` {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:11:15.316270 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1289d9cd-d8ca-40b9-93f9-5ec97dc616ab None admin] RBAC: Authorization granted {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:11:15.318366 dv-cinder-851351-1-smb devstack@keystone.service[144067]: [pid: 144067|app: 0|req: 143/284] 10.222.0.42 () {56 vars in 1177 bytes} [Thu Jul 28 08:11:15 2022] GET /identity/v3/users/63729ca97ebc4b25b8cc06a29c0431ff => generated 297 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 08:11:15.323790 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac1afc6-42e8-4eaa-9243-46919ea616fd None admin] Authenticating user token {{(pid=144068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:11:15.467911 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac1afc6-42e8-4eaa-9243-46919ea616fd None admin] Validating token access rules against request {{(pid=144068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:11:15.505300 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20613096-1822-4624-addd-7cf7625b927e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:11:15.506405 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20613096-1822-4624-addd-7cf7625b927e None admin] REQUEST_METHOD: `GET` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:11:15.506907 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20613096-1822-4624-addd-7cf7625b927e None admin] SCRIPT_NAME: `/identity` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:11:15.507392 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20613096-1822-4624-addd-7cf7625b927e None admin] PATH_INFO: `/v3/projects/2c58e7ea67d84cf692dd9eb3f6cb73a0` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:11:15.508875 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20613096-1822-4624-addd-7cf7625b927e None admin] RBAC: Authorizing `identity:get_project(project_id=2c58e7ea67d84cf692dd9eb3f6cb73a0)` {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:11:15.510568 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20613096-1822-4624-addd-7cf7625b927e None admin] RBAC: Authorization granted {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:11:15.512820 dv-cinder-851351-1-smb devstack@keystone.service[144068]: [pid: 144068|app: 0|req: 142/285] 10.222.0.42 () {56 vars in 1186 bytes} [Thu Jul 28 08:11:15 2022] GET /identity/v3/projects/2c58e7ea67d84cf692dd9eb3f6cb73a0 => generated 302 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:11:15.520694 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1289d9cd-d8ca-40b9-93f9-5ec97dc616ab None admin] Authenticating user token {{(pid=144067) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:11:15.596539 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea60b4e5-bc8c-4d9d-a203-7fa8871e0922 None None] REQUEST_METHOD: `GET` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:11:15.596847 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea60b4e5-bc8c-4d9d-a203-7fa8871e0922 None None] SCRIPT_NAME: `/identity` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:11:15.597279 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea60b4e5-bc8c-4d9d-a203-7fa8871e0922 None None] PATH_INFO: `/` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:11:15.598977 dv-cinder-851351-1-smb devstack@keystone.service[144068]: [pid: 144068|app: 0|req: 143/286] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 08:11:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 28 08:11:15.605402 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b75e389-941d-4c3c-92cf-c2ae3dd7f5f9 None None] REQUEST_METHOD: `POST` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:11:15.606087 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b75e389-941d-4c3c-92cf-c2ae3dd7f5f9 None None] SCRIPT_NAME: `/identity` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:11:15.606577 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b75e389-941d-4c3c-92cf-c2ae3dd7f5f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:11:15.620852 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG dbcounter [-] [144068] Writing DB stats keystone:SELECT=100 {{(pid=144068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:11:15.629092 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.auth.core [None req-3b75e389-941d-4c3c-92cf-c2ae3dd7f5f9 None None] MFA Rules not processed for user `bf5ceb8f07374635ad506b7d1b4f1612`. Rule list: `[]` (Enabled: `True`). {{(pid=144068) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 08:11:15.630835 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.fernet_utils [None req-3b75e389-941d-4c3c-92cf-c2ae3dd7f5f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=144068) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:11:15.660576 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG dbcounter [-] [144067] Writing DB stats keystone:SELECT=100 {{(pid=144067) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:11:15.683965 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1289d9cd-d8ca-40b9-93f9-5ec97dc616ab None admin] Validating token access rules against request {{(pid=144067) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:11:15.721444 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-869dcf6e-4cc7-42dd-9b3c-0729239f9c3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144067) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:11:15.722054 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869dcf6e-4cc7-42dd-9b3c-0729239f9c3f None admin] REQUEST_METHOD: `PUT` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:11:15.722676 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869dcf6e-4cc7-42dd-9b3c-0729239f9c3f None admin] SCRIPT_NAME: `/identity` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:11:15.723033 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869dcf6e-4cc7-42dd-9b3c-0729239f9c3f None admin] PATH_INFO: `/v3/projects/2c58e7ea67d84cf692dd9eb3f6cb73a0/users/63729ca97ebc4b25b8cc06a29c0431ff/roles/aac18bff164441838e5b7d98f770be5e` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:11:15.725126 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-869dcf6e-4cc7-42dd-9b3c-0729239f9c3f None admin] RBAC: Authorizing `identity:create_grant(project_id=2c58e7ea67d84cf692dd9eb3f6cb73a0, user_id=63729ca97ebc4b25b8cc06a29c0431ff, role_id=aac18bff164441838e5b7d98f770be5e)` {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:11:15.726790 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-869dcf6e-4cc7-42dd-9b3c-0729239f9c3f None admin] RBAC: Authorization granted {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:11:15.746813 dv-cinder-851351-1-smb devstack@keystone.service[144067]: [pid: 144067|app: 0|req: 144/287] 10.222.0.42 () {58 vars in 1439 bytes} [Thu Jul 28 08:11:15 2022] PUT /identity/v3/projects/2c58e7ea67d84cf692dd9eb3f6cb73a0/users/63729ca97ebc4b25b8cc06a29c0431ff/roles/aac18bff164441838e5b7d98f770be5e => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 08:11:15.759611 dv-cinder-851351-1-smb devstack@keystone.service[144068]: [pid: 144068|app: 0|req: 144/288] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 08:11:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 28 08:11:15.799916 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-869dcf6e-4cc7-42dd-9b3c-0729239f9c3f None admin] Authenticating user token {{(pid=144067) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:11:15.927761 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-869dcf6e-4cc7-42dd-9b3c-0729239f9c3f None admin] Validating token access rules against request {{(pid=144067) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:11:15.972690 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f5411a4-009c-4d9a-8d95-b826b99ee07e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144067) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:11:15.973468 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5411a4-009c-4d9a-8d95-b826b99ee07e None admin] REQUEST_METHOD: `GET` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:11:15.973693 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5411a4-009c-4d9a-8d95-b826b99ee07e None admin] SCRIPT_NAME: `/identity` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:11:15.973949 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5411a4-009c-4d9a-8d95-b826b99ee07e None admin] PATH_INFO: `/v3/roles/member` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:11:15.982586 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG dbcounter [-] [144067] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=144067) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:11:15.991382 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f5411a4-009c-4d9a-8d95-b826b99ee07e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 08:11:16.001472 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application [None req-3f5411a4-009c-4d9a-8d95-b826b99ee07e None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 28 08:11:16.001472 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:11:16.001472 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:11:16.001472 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:11:16.001472 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:11:16.001472 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:11:16.001472 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:11:16.001472 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:11:16.001472 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:11:16.001472 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:11:16.001472 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:11:16.001472 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:11:16.001472 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 08:11:16.001472 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 08:11:16.001472 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 08:11:16.001472 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 08:11:16.002839 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 08:11:16.002839 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 08:11:16.002839 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 08:11:16.002839 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 08:11:16.002839 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:11:16.002839 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:11:16.002839 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:11:16.002839 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:11:16.002839 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:11:16.002839 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:11:16.002839 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:11:16.002839 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application with Lock( Jul 28 08:11:16.002839 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:11:16.002839 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:11:16.002839 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:11:16.002839 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:11:16.004124 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:11:16.004124 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:11:16.004124 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:11:16.004124 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:11:16.004124 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 08:11:16.004124 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 08:11:16.004124 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 08:11:16.004124 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 08:11:16.004124 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 08:11:16.004124 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 08:11:16.004124 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 28 08:11:16.004124 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application Jul 28 08:11:16.004124 dv-cinder-851351-1-smb devstack@keystone.service[144067]: [pid: 144067|app: 0|req: 145/289] 10.222.0.42 () {56 vars in 1099 bytes} [Thu Jul 28 08:11:15 2022] GET /identity/v3/roles/member => generated 84 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 08:11:16.012374 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b75e389-941d-4c3c-92cf-c2ae3dd7f5f9 None None] Authenticating user token {{(pid=144068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:11:16.134567 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b75e389-941d-4c3c-92cf-c2ae3dd7f5f9 None None] Validating token access rules against request {{(pid=144068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:11:16.168882 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG dbcounter [-] [144068] Writing DB stats keystone:SELECT=100 {{(pid=144068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:11:16.178920 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aff67fd-6773-4915-aac9-6e8d4e188920 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:11:16.179570 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aff67fd-6773-4915-aac9-6e8d4e188920 None admin] REQUEST_METHOD: `GET` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:11:16.179853 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aff67fd-6773-4915-aac9-6e8d4e188920 None admin] SCRIPT_NAME: `/identity` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:11:16.180128 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aff67fd-6773-4915-aac9-6e8d4e188920 None admin] PATH_INFO: `/v3/roles` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:11:16.180911 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aff67fd-6773-4915-aac9-6e8d4e188920 None admin] RBAC: Adding query filter params (name=member) {{(pid=144068) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:11:16.181214 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aff67fd-6773-4915-aac9-6e8d4e188920 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:11:16.182620 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aff67fd-6773-4915-aac9-6e8d4e188920 None admin] RBAC: Authorization granted {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:11:16.192265 dv-cinder-851351-1-smb devstack@keystone.service[144068]: [pid: 144068|app: 0|req: 145/290] 10.222.0.42 () {56 vars in 1101 bytes} [Thu Jul 28 08:11:16 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:11:16.198110 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f5411a4-009c-4d9a-8d95-b826b99ee07e None admin] Authenticating user token {{(pid=144067) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:11:16.353563 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f5411a4-009c-4d9a-8d95-b826b99ee07e None admin] Validating token access rules against request {{(pid=144067) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:11:16.398757 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc871e6b-0fcb-441e-be1f-679a5042654f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144067) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:11:16.399902 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc871e6b-0fcb-441e-be1f-679a5042654f None admin] REQUEST_METHOD: `GET` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:11:16.400398 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc871e6b-0fcb-441e-be1f-679a5042654f None admin] SCRIPT_NAME: `/identity` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:11:16.400927 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc871e6b-0fcb-441e-be1f-679a5042654f None admin] PATH_INFO: `/v3/users/d1f187addf31424d8bd31e4d0260bc28` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:11:16.404635 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc871e6b-0fcb-441e-be1f-679a5042654f None admin] RBAC: Authorizing `identity:get_user(user_id=d1f187addf31424d8bd31e4d0260bc28)` {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:11:16.406507 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc871e6b-0fcb-441e-be1f-679a5042654f None admin] RBAC: Authorization granted {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:11:16.408840 dv-cinder-851351-1-smb devstack@keystone.service[144067]: [pid: 144067|app: 0|req: 146/291] 10.222.0.42 () {56 vars in 1177 bytes} [Thu Jul 28 08:11:16 2022] GET /identity/v3/users/d1f187addf31424d8bd31e4d0260bc28 => generated 297 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:11:16.414979 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aff67fd-6773-4915-aac9-6e8d4e188920 None admin] Authenticating user token {{(pid=144068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:11:16.551714 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aff67fd-6773-4915-aac9-6e8d4e188920 None admin] Validating token access rules against request {{(pid=144068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:11:16.593489 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5af4b4b-e400-4034-9dee-f64612069fde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:11:16.594157 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5af4b4b-e400-4034-9dee-f64612069fde None admin] REQUEST_METHOD: `GET` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:11:16.594443 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5af4b4b-e400-4034-9dee-f64612069fde None admin] SCRIPT_NAME: `/identity` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:11:16.594718 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5af4b4b-e400-4034-9dee-f64612069fde None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:11:16.660761 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG dbcounter [-] [144068] Writing DB stats keystone:SELECT=100 {{(pid=144068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:11:16.668903 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5af4b4b-e400-4034-9dee-f64612069fde None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:11:16.670462 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5af4b4b-e400-4034-9dee-f64612069fde None admin] RBAC: Authorization granted {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:11:16.781113 dv-cinder-851351-1-smb devstack@keystone.service[144068]: [pid: 144068|app: 0|req: 146/292] 10.222.0.42 () {58 vars in 1282 bytes} [Thu Jul 28 08:11:16 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 367 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 28 08:11:16.786914 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc871e6b-0fcb-441e-be1f-679a5042654f None admin] Authenticating user token {{(pid=144067) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:11:16.896796 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG dbcounter [-] [144067] Writing DB stats keystone:SELECT=100 {{(pid=144067) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:11:16.953772 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc871e6b-0fcb-441e-be1f-679a5042654f None admin] Validating token access rules against request {{(pid=144067) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:11:17.025462 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99eb81a6-e7e4-4995-bba3-f4ab139829f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144067) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:11:17.026470 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99eb81a6-e7e4-4995-bba3-f4ab139829f9 None admin] REQUEST_METHOD: `GET` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:11:17.026905 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99eb81a6-e7e4-4995-bba3-f4ab139829f9 None admin] SCRIPT_NAME: `/identity` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:11:17.027332 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99eb81a6-e7e4-4995-bba3-f4ab139829f9 None admin] PATH_INFO: `/v3/projects/2c58e7ea67d84cf692dd9eb3f6cb73a0` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:11:17.028809 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99eb81a6-e7e4-4995-bba3-f4ab139829f9 None admin] RBAC: Authorizing `identity:get_project(project_id=2c58e7ea67d84cf692dd9eb3f6cb73a0)` {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:11:17.030464 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99eb81a6-e7e4-4995-bba3-f4ab139829f9 None admin] RBAC: Authorization granted {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:11:17.032397 dv-cinder-851351-1-smb devstack@keystone.service[144067]: [pid: 144067|app: 0|req: 147/293] 10.222.0.42 () {56 vars in 1186 bytes} [Thu Jul 28 08:11:16 2022] GET /identity/v3/projects/2c58e7ea67d84cf692dd9eb3f6cb73a0 => generated 302 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:11:17.039074 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5af4b4b-e400-4034-9dee-f64612069fde None admin] Authenticating user token {{(pid=144068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:11:17.186907 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG dbcounter [-] [144068] Writing DB stats keystone:SELECT=100 {{(pid=144068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:11:17.196549 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5af4b4b-e400-4034-9dee-f64612069fde None admin] Validating token access rules against request {{(pid=144068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:11:17.251000 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91b1d49-8148-4a79-bdd7-ac1599ba6df1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:11:17.251569 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91b1d49-8148-4a79-bdd7-ac1599ba6df1 None admin] REQUEST_METHOD: `GET` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:11:17.251857 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91b1d49-8148-4a79-bdd7-ac1599ba6df1 None admin] SCRIPT_NAME: `/identity` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:11:17.252136 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91b1d49-8148-4a79-bdd7-ac1599ba6df1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:11:17.252983 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b91b1d49-8148-4a79-bdd7-ac1599ba6df1 None admin] RBAC: Adding query filter params (role.id=6933b60756fe46dd8f27854f5e192061, scope.project.id=2c58e7ea67d84cf692dd9eb3f6cb73a0, user.id=d1f187addf31424d8bd31e4d0260bc28) {{(pid=144068) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:11:17.253303 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b91b1d49-8148-4a79-bdd7-ac1599ba6df1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:11:17.254870 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b91b1d49-8148-4a79-bdd7-ac1599ba6df1 None admin] RBAC: Authorization granted {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:11:17.265904 dv-cinder-851351-1-smb devstack@keystone.service[144068]: [pid: 144068|app: 0|req: 147/294] 10.222.0.42 () {56 vars in 1374 bytes} [Thu Jul 28 08:11:17 2022] GET /identity/v3/role_assignments?user.id=d1f187addf31424d8bd31e4d0260bc28&scope.project.id=2c58e7ea67d84cf692dd9eb3f6cb73a0&role.id=6933b60756fe46dd8f27854f5e192061 => generated 608 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:11:17.502365 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a766de5-d7f2-4e35-a46f-dd9892d6e315 None None] REQUEST_METHOD: `GET` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:11:17.502881 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a766de5-d7f2-4e35-a46f-dd9892d6e315 None None] SCRIPT_NAME: `/identity` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:11:17.503335 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a766de5-d7f2-4e35-a46f-dd9892d6e315 None None] PATH_INFO: `/` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:11:17.505019 dv-cinder-851351-1-smb devstack@keystone.service[144067]: [pid: 144067|app: 0|req: 148/295] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 08:11:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 08:11:17.510858 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acefbaf5-58f8-41c1-90bf-6ca70d37b653 None None] REQUEST_METHOD: `POST` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:11:17.511155 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acefbaf5-58f8-41c1-90bf-6ca70d37b653 None None] SCRIPT_NAME: `/identity` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:11:17.511411 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acefbaf5-58f8-41c1-90bf-6ca70d37b653 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:11:17.530758 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.auth.core [None req-acefbaf5-58f8-41c1-90bf-6ca70d37b653 None None] MFA Rules not processed for user `bf5ceb8f07374635ad506b7d1b4f1612`. Rule list: `[]` (Enabled: `True`). {{(pid=144068) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 08:11:17.531974 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.fernet_utils [None req-acefbaf5-58f8-41c1-90bf-6ca70d37b653 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=144068) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:11:17.605726 dv-cinder-851351-1-smb devstack@keystone.service[144068]: [pid: 144068|app: 0|req: 148/296] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 08:11:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 08:11:17.629949 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a766de5-d7f2-4e35-a46f-dd9892d6e315 None None] Authenticating user token {{(pid=144067) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:11:17.651886 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d5c24a-21d3-4bb8-98f9-5f21f86c67d2 None None] REQUEST_METHOD: `GET` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:11:17.652233 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d5c24a-21d3-4bb8-98f9-5f21f86c67d2 None None] SCRIPT_NAME: `/identity` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:11:17.653155 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d5c24a-21d3-4bb8-98f9-5f21f86c67d2 None None] PATH_INFO: `/` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:11:17.654290 dv-cinder-851351-1-smb devstack@keystone.service[144068]: [pid: 144068|app: 0|req: 149/297] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 08:11:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 28 08:11:17.664358 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc93f6f-4182-49ac-9ff2-e7b83c07f2b8 None None] REQUEST_METHOD: `POST` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:11:17.665040 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc93f6f-4182-49ac-9ff2-e7b83c07f2b8 None None] SCRIPT_NAME: `/identity` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:11:17.665548 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc93f6f-4182-49ac-9ff2-e7b83c07f2b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:11:17.686040 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.auth.core [None req-4dc93f6f-4182-49ac-9ff2-e7b83c07f2b8 None None] MFA Rules not processed for user `bf5ceb8f07374635ad506b7d1b4f1612`. Rule list: `[]` (Enabled: `True`). {{(pid=144068) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 08:11:17.687789 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.fernet_utils [None req-4dc93f6f-4182-49ac-9ff2-e7b83c07f2b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=144068) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:11:17.780218 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a766de5-d7f2-4e35-a46f-dd9892d6e315 None None] Validating token access rules against request {{(pid=144067) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:11:17.786164 dv-cinder-851351-1-smb devstack@keystone.service[144068]: [pid: 144068|app: 0|req: 150/298] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 08:11:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 28 08:11:17.791556 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18fa916b-c277-4950-ad01-b012ce3a0c83 None None] REQUEST_METHOD: `GET` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:11:17.791556 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18fa916b-c277-4950-ad01-b012ce3a0c83 None None] SCRIPT_NAME: `/identity` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:11:17.791556 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18fa916b-c277-4950-ad01-b012ce3a0c83 None None] PATH_INFO: `/` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:11:17.792865 dv-cinder-851351-1-smb devstack@keystone.service[144068]: [pid: 144068|app: 0|req: 151/299] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 08:11:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 08:11:17.801325 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee9ef38-992b-4d5a-a5a3-630555b04dfe None None] REQUEST_METHOD: `POST` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:11:17.801758 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee9ef38-992b-4d5a-a5a3-630555b04dfe None None] SCRIPT_NAME: `/identity` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:11:17.802038 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee9ef38-992b-4d5a-a5a3-630555b04dfe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:11:17.822659 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.auth.core [None req-bee9ef38-992b-4d5a-a5a3-630555b04dfe None None] MFA Rules not processed for user `bf5ceb8f07374635ad506b7d1b4f1612`. Rule list: `[]` (Enabled: `True`). {{(pid=144068) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 08:11:17.823926 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.fernet_utils [None req-bee9ef38-992b-4d5a-a5a3-630555b04dfe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=144068) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:11:17.825033 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f399d63b-92b8-4f27-87c8-a73b1baac519 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144067) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:11:17.825713 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f399d63b-92b8-4f27-87c8-a73b1baac519 None admin] REQUEST_METHOD: `GET` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:11:17.826156 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f399d63b-92b8-4f27-87c8-a73b1baac519 None admin] SCRIPT_NAME: `/identity` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:11:17.826286 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f399d63b-92b8-4f27-87c8-a73b1baac519 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:11:17.828762 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG dbcounter [-] [144067] Writing DB stats keystone:SELECT=100 {{(pid=144067) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:11:17.840294 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f399d63b-92b8-4f27-87c8-a73b1baac519 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 08:11:17.840838 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG dbcounter [-] [144068] Writing DB stats keystone:SELECT=100 {{(pid=144068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:11:17.845769 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application [None req-f399d63b-92b8-4f27-87c8-a73b1baac519 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 28 08:11:17.845769 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:11:17.845769 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:11:17.845769 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:11:17.845769 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:11:17.845769 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:11:17.845769 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:11:17.845769 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:11:17.845769 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:11:17.845769 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:11:17.845769 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:11:17.845769 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:11:17.845769 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 08:11:17.845769 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 08:11:17.845769 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 08:11:17.845769 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 08:11:17.846877 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 08:11:17.846877 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 08:11:17.846877 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 08:11:17.846877 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 08:11:17.846877 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:11:17.846877 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:11:17.846877 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:11:17.846877 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:11:17.846877 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:11:17.846877 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:11:17.846877 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:11:17.846877 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application with Lock( Jul 28 08:11:17.846877 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:11:17.846877 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:11:17.846877 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:11:17.846877 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:11:17.847804 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:11:17.847804 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:11:17.847804 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:11:17.847804 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:11:17.847804 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 08:11:17.847804 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 08:11:17.847804 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 08:11:17.847804 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 08:11:17.847804 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 08:11:17.847804 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 08:11:17.847804 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 28 08:11:17.847804 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application Jul 28 08:11:17.847804 dv-cinder-851351-1-smb devstack@keystone.service[144067]: [pid: 144067|app: 0|req: 149/300] 10.222.0.42 () {56 vars in 1099 bytes} [Thu Jul 28 08:11:17 2022] GET /identity/v3/roles/reader => generated 84 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:11:17.849802 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f399d63b-92b8-4f27-87c8-a73b1baac519 None admin] Authenticating user token {{(pid=144067) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:11:17.907464 dv-cinder-851351-1-smb devstack@keystone.service[144068]: [pid: 144068|app: 0|req: 152/301] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 08:11:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 28 08:11:17.908861 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee9ef38-992b-4d5a-a5a3-630555b04dfe None None] Authenticating user token {{(pid=144068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:11:17.977197 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f399d63b-92b8-4f27-87c8-a73b1baac519 None admin] Validating token access rules against request {{(pid=144067) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:11:18.026874 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76cbd6e3-3a64-4f14-abff-2dceef98ee6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144067) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:11:18.028061 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76cbd6e3-3a64-4f14-abff-2dceef98ee6c None admin] REQUEST_METHOD: `GET` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:11:18.028622 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76cbd6e3-3a64-4f14-abff-2dceef98ee6c None admin] SCRIPT_NAME: `/identity` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:11:18.028971 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76cbd6e3-3a64-4f14-abff-2dceef98ee6c None admin] PATH_INFO: `/v3/domains/default` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:11:18.030379 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76cbd6e3-3a64-4f14-abff-2dceef98ee6c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:11:18.031846 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76cbd6e3-3a64-4f14-abff-2dceef98ee6c None admin] RBAC: Authorization granted {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:11:18.033778 dv-cinder-851351-1-smb devstack@keystone.service[144067]: [pid: 144067|app: 0|req: 150/302] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 08:11:17 2022] GET /identity/v3/domains/default => generated 199 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:11:18.039374 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76cbd6e3-3a64-4f14-abff-2dceef98ee6c None admin] Authenticating user token {{(pid=144067) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:11:18.059479 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee9ef38-992b-4d5a-a5a3-630555b04dfe None None] Validating token access rules against request {{(pid=144068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:11:18.107671 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05acc30-3f5a-4e50-a7f8-53c25c1bf240 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:11:18.108177 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG dbcounter [-] [144067] Writing DB stats keystone:SELECT=100 {{(pid=144067) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:11:18.108788 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05acc30-3f5a-4e50-a7f8-53c25c1bf240 None admin] REQUEST_METHOD: `GET` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:11:18.109077 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05acc30-3f5a-4e50-a7f8-53c25c1bf240 None admin] SCRIPT_NAME: `/identity` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:11:18.109354 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05acc30-3f5a-4e50-a7f8-53c25c1bf240 None admin] PATH_INFO: `/v3/roles` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:11:18.110101 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a05acc30-3f5a-4e50-a7f8-53c25c1bf240 None admin] RBAC: Adding query filter params (name=reader) {{(pid=144068) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:11:18.110655 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a05acc30-3f5a-4e50-a7f8-53c25c1bf240 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:11:18.111820 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a05acc30-3f5a-4e50-a7f8-53c25c1bf240 None admin] RBAC: Authorization granted {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:11:18.121098 dv-cinder-851351-1-smb devstack@keystone.service[144068]: [pid: 144068|app: 0|req: 153/303] 10.222.0.42 () {56 vars in 1101 bytes} [Thu Jul 28 08:11:17 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:11:18.121811 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05acc30-3f5a-4e50-a7f8-53c25c1bf240 None admin] Authenticating user token {{(pid=144068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:11:18.135241 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG dbcounter [-] [144068] Writing DB stats keystone:SELECT=100 {{(pid=144068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:11:18.168030 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76cbd6e3-3a64-4f14-abff-2dceef98ee6c None admin] Validating token access rules against request {{(pid=144067) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:11:18.209221 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcaa5d9a-b6e5-4a69-ba7c-4d8236c482d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144067) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:11:18.210406 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcaa5d9a-b6e5-4a69-ba7c-4d8236c482d7 None admin] REQUEST_METHOD: `GET` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:11:18.210859 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcaa5d9a-b6e5-4a69-ba7c-4d8236c482d7 None admin] SCRIPT_NAME: `/identity` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:11:18.211310 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcaa5d9a-b6e5-4a69-ba7c-4d8236c482d7 None admin] PATH_INFO: `/v3/roles/member` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:11:18.224653 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcaa5d9a-b6e5-4a69-ba7c-4d8236c482d7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 08:11:18.229722 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application [None req-dcaa5d9a-b6e5-4a69-ba7c-4d8236c482d7 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 28 08:11:18.229722 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:11:18.229722 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:11:18.229722 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:11:18.229722 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:11:18.229722 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:11:18.229722 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:11:18.229722 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:11:18.229722 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:11:18.229722 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:11:18.229722 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:11:18.229722 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:11:18.229722 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 08:11:18.229722 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 08:11:18.229722 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 08:11:18.229722 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 08:11:18.230838 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 08:11:18.230838 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 08:11:18.230838 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 08:11:18.230838 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 08:11:18.230838 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:11:18.230838 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:11:18.230838 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:11:18.230838 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:11:18.230838 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:11:18.230838 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:11:18.230838 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:11:18.230838 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application with Lock( Jul 28 08:11:18.230838 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:11:18.230838 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:11:18.230838 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:11:18.230838 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:11:18.231827 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:11:18.231827 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:11:18.231827 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:11:18.231827 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:11:18.231827 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 08:11:18.231827 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 08:11:18.231827 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 08:11:18.231827 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 08:11:18.231827 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 08:11:18.231827 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 08:11:18.231827 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 28 08:11:18.231827 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application Jul 28 08:11:18.236019 dv-cinder-851351-1-smb devstack@keystone.service[144067]: [pid: 144067|app: 0|req: 151/304] 10.222.0.42 () {56 vars in 1099 bytes} [Thu Jul 28 08:11:18 2022] GET /identity/v3/roles/member => generated 84 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:11:18.236631 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcaa5d9a-b6e5-4a69-ba7c-4d8236c482d7 None admin] Authenticating user token {{(pid=144067) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:11:18.250260 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05acc30-3f5a-4e50-a7f8-53c25c1bf240 None admin] Validating token access rules against request {{(pid=144068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:11:18.291322 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d5d3e9-476e-46d0-9db9-656ef9403b5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:11:18.291877 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d5d3e9-476e-46d0-9db9-656ef9403b5a None admin] REQUEST_METHOD: `POST` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:11:18.292161 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d5d3e9-476e-46d0-9db9-656ef9403b5a None admin] SCRIPT_NAME: `/identity` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:11:18.292456 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d5d3e9-476e-46d0-9db9-656ef9403b5a None admin] PATH_INFO: `/v3/groups` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:11:18.293153 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d5d3e9-476e-46d0-9db9-656ef9403b5a None admin] RBAC: Authorizing `identity:create_group()` {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:11:18.294612 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d5d3e9-476e-46d0-9db9-656ef9403b5a None admin] RBAC: Authorization granted {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:11:18.312683 dv-cinder-851351-1-smb devstack@keystone.service[144068]: [pid: 144068|app: 0|req: 154/305] 10.222.0.42 () {60 vars in 1134 bytes} [Thu Jul 28 08:11:18 2022] POST /identity/v3/groups => generated 229 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 08:11:18.313536 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d5d3e9-476e-46d0-9db9-656ef9403b5a None admin] Authenticating user token {{(pid=144068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:11:18.374416 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcaa5d9a-b6e5-4a69-ba7c-4d8236c482d7 None admin] Validating token access rules against request {{(pid=144067) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:11:18.403657 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG dbcounter [-] [144067] Writing DB stats keystone:SELECT=100 {{(pid=144067) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:11:18.414844 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG dbcounter [-] [144068] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=144068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:11:18.417780 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d950b1-9b0a-4e66-899d-e114e6259de6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144067) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:11:18.418452 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d950b1-9b0a-4e66-899d-e114e6259de6 None admin] REQUEST_METHOD: `GET` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:11:18.418740 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d950b1-9b0a-4e66-899d-e114e6259de6 None admin] SCRIPT_NAME: `/identity` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:11:18.419140 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d950b1-9b0a-4e66-899d-e114e6259de6 None admin] PATH_INFO: `/v3/users/7a6afc76ee0a43d8acf0eb5cdddf840f` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:11:18.436037 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7d950b1-9b0a-4e66-899d-e114e6259de6 None admin] RBAC: Authorizing `identity:get_user(user_id=7a6afc76ee0a43d8acf0eb5cdddf840f)` {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:11:18.437575 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7d950b1-9b0a-4e66-899d-e114e6259de6 None admin] RBAC: Authorization granted {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:11:18.444609 dv-cinder-851351-1-smb devstack@keystone.service[144067]: [pid: 144067|app: 0|req: 152/306] 10.222.0.42 () {56 vars in 1177 bytes} [Thu Jul 28 08:11:18 2022] GET /identity/v3/users/7a6afc76ee0a43d8acf0eb5cdddf840f => generated 293 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:11:18.444609 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ed8c30-d25e-4e77-b4c6-c5449c8ec346 None None] REQUEST_METHOD: `GET` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:11:18.444609 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ed8c30-d25e-4e77-b4c6-c5449c8ec346 None None] SCRIPT_NAME: `/identity` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:11:18.444609 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ed8c30-d25e-4e77-b4c6-c5449c8ec346 None None] PATH_INFO: `/` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:11:18.444609 dv-cinder-851351-1-smb devstack@keystone.service[144067]: [pid: 144067|app: 0|req: 153/307] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 08:11:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 08:11:18.446051 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ed8c30-d25e-4e77-b4c6-c5449c8ec346 None None] Authenticating user token {{(pid=144067) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:11:18.461287 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d5d3e9-476e-46d0-9db9-656ef9403b5a None admin] Validating token access rules against request {{(pid=144068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:11:18.501584 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab7e972a-09a9-4bef-aeae-855e07243b6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:11:18.502650 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7e972a-09a9-4bef-aeae-855e07243b6d None admin] REQUEST_METHOD: `GET` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:11:18.502940 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7e972a-09a9-4bef-aeae-855e07243b6d None admin] SCRIPT_NAME: `/identity` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:11:18.503386 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7e972a-09a9-4bef-aeae-855e07243b6d None admin] PATH_INFO: `/v3/roles` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:11:18.504165 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab7e972a-09a9-4bef-aeae-855e07243b6d None admin] RBAC: Adding query filter params (name=member) {{(pid=144068) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:11:18.505054 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab7e972a-09a9-4bef-aeae-855e07243b6d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:11:18.505955 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab7e972a-09a9-4bef-aeae-855e07243b6d None admin] RBAC: Authorization granted {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:11:18.514935 dv-cinder-851351-1-smb devstack@keystone.service[144068]: [pid: 144068|app: 0|req: 155/308] 10.222.0.42 () {56 vars in 1101 bytes} [Thu Jul 28 08:11:18 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:11:18.516213 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2607b6-efe8-4b1c-900a-5a146cc12cfc None None] REQUEST_METHOD: `POST` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:11:18.516504 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2607b6-efe8-4b1c-900a-5a146cc12cfc None None] SCRIPT_NAME: `/identity` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:11:18.516828 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2607b6-efe8-4b1c-900a-5a146cc12cfc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:11:18.538462 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.auth.core [None req-fe2607b6-efe8-4b1c-900a-5a146cc12cfc None None] MFA Rules not processed for user `bf5ceb8f07374635ad506b7d1b4f1612`. Rule list: `[]` (Enabled: `True`). {{(pid=144068) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 08:11:18.538462 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.fernet_utils [None req-fe2607b6-efe8-4b1c-900a-5a146cc12cfc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=144068) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:11:18.567094 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ed8c30-d25e-4e77-b4c6-c5449c8ec346 None None] Validating token access rules against request {{(pid=144067) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:11:18.610131 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e819eb5-8ea3-4713-aab4-2e72fd9e5410 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144067) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:11:18.610883 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e819eb5-8ea3-4713-aab4-2e72fd9e5410 None admin] REQUEST_METHOD: `GET` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:11:18.611236 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e819eb5-8ea3-4713-aab4-2e72fd9e5410 None admin] SCRIPT_NAME: `/identity` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:11:18.611575 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e819eb5-8ea3-4713-aab4-2e72fd9e5410 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:11:18.612446 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e819eb5-8ea3-4713-aab4-2e72fd9e5410 None admin] RBAC: Adding query filter params (role.id=aac18bff164441838e5b7d98f770be5e, user.id=7a6afc76ee0a43d8acf0eb5cdddf840f, scope.system=all) {{(pid=144067) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:11:18.612878 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e819eb5-8ea3-4713-aab4-2e72fd9e5410 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:11:18.614455 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e819eb5-8ea3-4713-aab4-2e72fd9e5410 None admin] RBAC: Authorization granted {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:11:18.618084 dv-cinder-851351-1-smb devstack@keystone.service[144068]: [pid: 144068|app: 0|req: 156/309] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 08:11:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 08:11:18.618771 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2607b6-efe8-4b1c-900a-5a146cc12cfc None None] Authenticating user token {{(pid=144068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:11:18.633390 dv-cinder-851351-1-smb devstack@keystone.service[144067]: [pid: 144067|app: 0|req: 154/310] 10.222.0.42 () {56 vars in 1308 bytes} [Thu Jul 28 08:11:18 2022] GET /identity/v3/role_assignments?user.id=7a6afc76ee0a43d8acf0eb5cdddf840f&scope.system=all&role.id=aac18bff164441838e5b7d98f770be5e => generated 226 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 08:11:18.641522 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e819eb5-8ea3-4713-aab4-2e72fd9e5410 None admin] Authenticating user token {{(pid=144067) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:11:18.693925 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG dbcounter [-] [144067] Writing DB stats keystone:SELECT=100 {{(pid=144067) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:11:18.707734 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG dbcounter [-] [144068] Writing DB stats keystone:SELECT=100 {{(pid=144068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:11:18.764382 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e819eb5-8ea3-4713-aab4-2e72fd9e5410 None admin] Validating token access rules against request {{(pid=144067) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:11:18.770189 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2607b6-efe8-4b1c-900a-5a146cc12cfc None None] Validating token access rules against request {{(pid=144068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:11:18.805895 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aba0563-91be-4727-a894-cab9c9aca02c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144067) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:11:18.806614 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aba0563-91be-4727-a894-cab9c9aca02c None admin] REQUEST_METHOD: `GET` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:11:18.806898 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aba0563-91be-4727-a894-cab9c9aca02c None admin] SCRIPT_NAME: `/identity` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:11:18.807177 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aba0563-91be-4727-a894-cab9c9aca02c None admin] PATH_INFO: `/v3/roles/reader` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:11:18.820405 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aba0563-91be-4727-a894-cab9c9aca02c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 08:11:18.821353 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a3bca2-d2aa-4fa3-b19f-92aa40142174 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:11:18.822195 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a3bca2-d2aa-4fa3-b19f-92aa40142174 None admin] REQUEST_METHOD: `GET` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:11:18.822505 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a3bca2-d2aa-4fa3-b19f-92aa40142174 None admin] SCRIPT_NAME: `/identity` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:11:18.822881 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a3bca2-d2aa-4fa3-b19f-92aa40142174 None admin] PATH_INFO: `/v3/users/9b849a2813204a01ba7d1d74158f47fb` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:11:18.824269 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5a3bca2-d2aa-4fa3-b19f-92aa40142174 None admin] RBAC: Authorizing `identity:get_user(user_id=9b849a2813204a01ba7d1d74158f47fb)` {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:11:18.825704 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application [None req-4aba0563-91be-4727-a894-cab9c9aca02c None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 28 08:11:18.825704 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:11:18.825704 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:11:18.825704 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:11:18.825704 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:11:18.825704 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:11:18.825704 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:11:18.825704 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:11:18.825704 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:11:18.825704 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:11:18.825704 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:11:18.825704 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:11:18.825704 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 08:11:18.825704 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 08:11:18.825704 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 08:11:18.825704 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 08:11:18.826710 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 08:11:18.826710 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 08:11:18.826710 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 08:11:18.826710 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 08:11:18.826710 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:11:18.826710 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:11:18.826710 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:11:18.826710 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:11:18.826710 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:11:18.826710 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:11:18.826710 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:11:18.826710 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application with Lock( Jul 28 08:11:18.826710 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:11:18.826710 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:11:18.826710 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:11:18.826710 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:11:18.827658 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:11:18.827658 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:11:18.827658 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:11:18.827658 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:11:18.827658 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 08:11:18.827658 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 08:11:18.827658 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 08:11:18.827658 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 08:11:18.827658 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 08:11:18.827658 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 08:11:18.827658 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 28 08:11:18.827658 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application Jul 28 08:11:18.828354 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5a3bca2-d2aa-4fa3-b19f-92aa40142174 None admin] RBAC: Authorization granted {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:11:18.828442 dv-cinder-851351-1-smb devstack@keystone.service[144067]: [pid: 144067|app: 0|req: 155/311] 10.222.0.42 () {56 vars in 1099 bytes} [Thu Jul 28 08:11:18 2022] GET /identity/v3/roles/reader => generated 84 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 08:11:18.833586 dv-cinder-851351-1-smb devstack@keystone.service[144068]: [pid: 144068|app: 0|req: 157/312] 10.222.0.42 () {56 vars in 1177 bytes} [Thu Jul 28 08:11:18 2022] GET /identity/v3/users/9b849a2813204a01ba7d1d74158f47fb => generated 293 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:11:18.833880 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aba0563-91be-4727-a894-cab9c9aca02c None admin] Authenticating user token {{(pid=144067) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:11:18.841686 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a3bca2-d2aa-4fa3-b19f-92aa40142174 None admin] Authenticating user token {{(pid=144068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:11:18.957289 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a3bca2-d2aa-4fa3-b19f-92aa40142174 None admin] Validating token access rules against request {{(pid=144068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:11:19.002621 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aba0563-91be-4727-a894-cab9c9aca02c None admin] Validating token access rules against request {{(pid=144067) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:11:19.006557 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG dbcounter [-] [144067] Writing DB stats keystone:SELECT=100 {{(pid=144067) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:11:19.011565 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG dbcounter [-] [144068] Writing DB stats keystone:SELECT=100 {{(pid=144068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:11:19.021903 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-032e4404-8529-4eb6-8e7f-5477a0e177c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:11:19.023400 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032e4404-8529-4eb6-8e7f-5477a0e177c2 None admin] REQUEST_METHOD: `PUT` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:11:19.024407 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032e4404-8529-4eb6-8e7f-5477a0e177c2 None admin] SCRIPT_NAME: `/identity` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:11:19.025222 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032e4404-8529-4eb6-8e7f-5477a0e177c2 None admin] PATH_INFO: `/v3/system/users/9b849a2813204a01ba7d1d74158f47fb/roles/6933b60756fe46dd8f27854f5e192061` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:11:19.028039 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-032e4404-8529-4eb6-8e7f-5477a0e177c2 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=9b849a2813204a01ba7d1d74158f47fb, role_id=6933b60756fe46dd8f27854f5e192061)` {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:11:19.029840 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-032e4404-8529-4eb6-8e7f-5477a0e177c2 None admin] RBAC: Authorization granted {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:11:19.045894 dv-cinder-851351-1-smb devstack@keystone.service[144068]: [pid: 144068|app: 0|req: 158/313] 10.222.0.42 () {58 vars in 1334 bytes} [Thu Jul 28 08:11:18 2022] PUT /identity/v3/system/users/9b849a2813204a01ba7d1d74158f47fb/roles/6933b60756fe46dd8f27854f5e192061 => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 28 08:11:19.063017 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4640bb5-17f3-45d7-a554-17c22e0bc4c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144067) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:11:19.064304 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4640bb5-17f3-45d7-a554-17c22e0bc4c9 None admin] REQUEST_METHOD: `GET` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:11:19.064901 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4640bb5-17f3-45d7-a554-17c22e0bc4c9 None admin] SCRIPT_NAME: `/identity` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:11:19.065470 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4640bb5-17f3-45d7-a554-17c22e0bc4c9 None admin] PATH_INFO: `/v3/roles` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:11:19.066577 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4640bb5-17f3-45d7-a554-17c22e0bc4c9 None admin] RBAC: Adding query filter params (name=reader) {{(pid=144067) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:11:19.067161 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4640bb5-17f3-45d7-a554-17c22e0bc4c9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:11:19.069049 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4640bb5-17f3-45d7-a554-17c22e0bc4c9 None admin] RBAC: Authorization granted {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:11:19.081307 dv-cinder-851351-1-smb devstack@keystone.service[144067]: [pid: 144067|app: 0|req: 156/314] 10.222.0.42 () {56 vars in 1101 bytes} [Thu Jul 28 08:11:18 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:11:19.092362 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-032e4404-8529-4eb6-8e7f-5477a0e177c2 None admin] Authenticating user token {{(pid=144068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:11:19.223703 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-032e4404-8529-4eb6-8e7f-5477a0e177c2 None admin] Validating token access rules against request {{(pid=144068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:11:19.272284 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1c1b51-8ee5-4773-bce2-18c9ea052fb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:11:19.273398 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1c1b51-8ee5-4773-bce2-18c9ea052fb2 None admin] REQUEST_METHOD: `GET` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:11:19.273887 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1c1b51-8ee5-4773-bce2-18c9ea052fb2 None admin] SCRIPT_NAME: `/identity` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:11:19.274379 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1c1b51-8ee5-4773-bce2-18c9ea052fb2 None admin] PATH_INFO: `/v3/users/63729ca97ebc4b25b8cc06a29c0431ff` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:11:19.275859 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae1c1b51-8ee5-4773-bce2-18c9ea052fb2 None admin] RBAC: Authorizing `identity:get_user(user_id=63729ca97ebc4b25b8cc06a29c0431ff)` {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:11:19.277647 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae1c1b51-8ee5-4773-bce2-18c9ea052fb2 None admin] RBAC: Authorization granted {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:11:19.280052 dv-cinder-851351-1-smb devstack@keystone.service[144068]: [pid: 144068|app: 0|req: 159/315] 10.222.0.42 () {56 vars in 1177 bytes} [Thu Jul 28 08:11:19 2022] GET /identity/v3/users/63729ca97ebc4b25b8cc06a29c0431ff => generated 297 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:11:19.285513 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4640bb5-17f3-45d7-a554-17c22e0bc4c9 None admin] Authenticating user token {{(pid=144067) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:11:19.395821 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4640bb5-17f3-45d7-a554-17c22e0bc4c9 None admin] Validating token access rules against request {{(pid=144067) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:11:19.432536 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2246eabd-8b1a-46c8-9e24-9e80925b876f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144067) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:11:19.433619 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2246eabd-8b1a-46c8-9e24-9e80925b876f None admin] REQUEST_METHOD: `GET` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:11:19.434141 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2246eabd-8b1a-46c8-9e24-9e80925b876f None admin] SCRIPT_NAME: `/identity` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:11:19.434643 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2246eabd-8b1a-46c8-9e24-9e80925b876f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:11:19.472969 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG dbcounter [-] [144067] Writing DB stats keystone:SELECT=100 {{(pid=144067) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:11:19.512004 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2246eabd-8b1a-46c8-9e24-9e80925b876f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:11:19.514002 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2246eabd-8b1a-46c8-9e24-9e80925b876f None admin] RBAC: Authorization granted {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:11:19.618792 dv-cinder-851351-1-smb devstack@keystone.service[144067]: [pid: 144067|app: 0|req: 157/316] 10.222.0.42 () {58 vars in 1282 bytes} [Thu Jul 28 08:11:19 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 28 08:11:19.627738 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1c1b51-8ee5-4773-bce2-18c9ea052fb2 None admin] Authenticating user token {{(pid=144068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:11:19.740211 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG dbcounter [-] [144068] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=144068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:11:19.812897 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1c1b51-8ee5-4773-bce2-18c9ea052fb2 None admin] Validating token access rules against request {{(pid=144068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:11:19.873591 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1483a2-81df-47ad-a141-5a20d9b5cf74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:11:19.874636 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1483a2-81df-47ad-a141-5a20d9b5cf74 None admin] REQUEST_METHOD: `GET` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:11:19.875072 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1483a2-81df-47ad-a141-5a20d9b5cf74 None admin] SCRIPT_NAME: `/identity` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:11:19.875522 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1483a2-81df-47ad-a141-5a20d9b5cf74 None admin] PATH_INFO: `/v3/projects/2c58e7ea67d84cf692dd9eb3f6cb73a0` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:11:19.877346 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea1483a2-81df-47ad-a141-5a20d9b5cf74 None admin] RBAC: Authorizing `identity:get_project(project_id=2c58e7ea67d84cf692dd9eb3f6cb73a0)` {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:11:19.879820 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea1483a2-81df-47ad-a141-5a20d9b5cf74 None admin] RBAC: Authorization granted {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:11:19.883083 dv-cinder-851351-1-smb devstack@keystone.service[144068]: [pid: 144068|app: 0|req: 160/317] 10.222.0.42 () {56 vars in 1186 bytes} [Thu Jul 28 08:11:19 2022] GET /identity/v3/projects/2c58e7ea67d84cf692dd9eb3f6cb73a0 => generated 302 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 08:11:19.892314 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2246eabd-8b1a-46c8-9e24-9e80925b876f None admin] Authenticating user token {{(pid=144067) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:11:20.000104 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG dbcounter [-] [144067] Writing DB stats keystone:SELECT=100 {{(pid=144067) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:11:20.040519 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2246eabd-8b1a-46c8-9e24-9e80925b876f None admin] Validating token access rules against request {{(pid=144067) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:11:20.077824 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b18aa7e-c858-43c7-ae33-294fdbcd64ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144067) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:11:20.078863 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b18aa7e-c858-43c7-ae33-294fdbcd64ff None admin] REQUEST_METHOD: `GET` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:11:20.079390 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b18aa7e-c858-43c7-ae33-294fdbcd64ff None admin] SCRIPT_NAME: `/identity` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:11:20.079863 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b18aa7e-c858-43c7-ae33-294fdbcd64ff None admin] PATH_INFO: `/v3/role_assignments` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:11:20.080910 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b18aa7e-c858-43c7-ae33-294fdbcd64ff None admin] RBAC: Adding query filter params (role.id=aac18bff164441838e5b7d98f770be5e, scope.project.id=2c58e7ea67d84cf692dd9eb3f6cb73a0, user.id=63729ca97ebc4b25b8cc06a29c0431ff) {{(pid=144067) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:11:20.081438 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b18aa7e-c858-43c7-ae33-294fdbcd64ff None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:11:20.083141 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b18aa7e-c858-43c7-ae33-294fdbcd64ff None admin] RBAC: Authorization granted {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:11:20.095831 dv-cinder-851351-1-smb devstack@keystone.service[144067]: [pid: 144067|app: 0|req: 158/318] 10.222.0.42 () {56 vars in 1374 bytes} [Thu Jul 28 08:11:19 2022] GET /identity/v3/role_assignments?user.id=63729ca97ebc4b25b8cc06a29c0431ff&scope.project.id=2c58e7ea67d84cf692dd9eb3f6cb73a0&role.id=aac18bff164441838e5b7d98f770be5e => generated 608 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:11:20.422050 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26fc835-082d-4b2d-aa5f-61d891ef1d10 None None] REQUEST_METHOD: `GET` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:11:20.422289 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26fc835-082d-4b2d-aa5f-61d891ef1d10 None None] SCRIPT_NAME: `/identity` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:11:20.422578 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26fc835-082d-4b2d-aa5f-61d891ef1d10 None None] PATH_INFO: `/` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:11:20.424158 dv-cinder-851351-1-smb devstack@keystone.service[144068]: [pid: 144068|app: 0|req: 161/319] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 08:11:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 08:11:20.429770 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ddadba4-4377-495a-8eff-faacf1f6d23d None None] REQUEST_METHOD: `POST` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:11:20.430141 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ddadba4-4377-495a-8eff-faacf1f6d23d None None] SCRIPT_NAME: `/identity` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:11:20.430422 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ddadba4-4377-495a-8eff-faacf1f6d23d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:11:20.449301 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.auth.core [None req-6ddadba4-4377-495a-8eff-faacf1f6d23d None None] MFA Rules not processed for user `bf5ceb8f07374635ad506b7d1b4f1612`. Rule list: `[]` (Enabled: `True`). {{(pid=144067) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 08:11:20.450509 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.fernet_utils [None req-6ddadba4-4377-495a-8eff-faacf1f6d23d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=144067) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:11:20.527639 dv-cinder-851351-1-smb devstack@keystone.service[144067]: [pid: 144067|app: 0|req: 159/320] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 08:11:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 08:11:20.549870 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26fc835-082d-4b2d-aa5f-61d891ef1d10 None None] Authenticating user token {{(pid=144068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:11:20.660297 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26fc835-082d-4b2d-aa5f-61d891ef1d10 None None] Validating token access rules against request {{(pid=144068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:11:20.690681 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG dbcounter [-] [144068] Writing DB stats keystone:SELECT=100 {{(pid=144068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:11:20.698271 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42325419-ff22-415c-8886-f1f7c1f4364c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:11:20.698934 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42325419-ff22-415c-8886-f1f7c1f4364c None admin] REQUEST_METHOD: `GET` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:11:20.699203 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42325419-ff22-415c-8886-f1f7c1f4364c None admin] SCRIPT_NAME: `/identity` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:11:20.699482 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42325419-ff22-415c-8886-f1f7c1f4364c None admin] PATH_INFO: `/v3/domains/default` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:11:20.700708 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42325419-ff22-415c-8886-f1f7c1f4364c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:11:20.702181 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42325419-ff22-415c-8886-f1f7c1f4364c None admin] RBAC: Authorization granted {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:11:20.703991 dv-cinder-851351-1-smb devstack@keystone.service[144068]: [pid: 144068|app: 0|req: 162/321] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 08:11:20 2022] GET /identity/v3/domains/default => generated 199 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 08:11:20.709752 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ddadba4-4377-495a-8eff-faacf1f6d23d None None] Authenticating user token {{(pid=144067) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:11:20.742332 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52181e96-6efc-49e6-bd11-1925d9e3301d None None] REQUEST_METHOD: `GET` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:11:20.742738 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52181e96-6efc-49e6-bd11-1925d9e3301d None None] SCRIPT_NAME: `/identity` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:11:20.743026 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52181e96-6efc-49e6-bd11-1925d9e3301d None None] PATH_INFO: `/` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:11:20.744433 dv-cinder-851351-1-smb devstack@keystone.service[144068]: [pid: 144068|app: 0|req: 163/322] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 08:11:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 08:11:20.749851 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ecdc960-6270-41b5-b1d2-8ad1911617b2 None None] REQUEST_METHOD: `POST` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:11:20.750137 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ecdc960-6270-41b5-b1d2-8ad1911617b2 None None] SCRIPT_NAME: `/identity` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:11:20.750417 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ecdc960-6270-41b5-b1d2-8ad1911617b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:11:20.769335 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.auth.core [None req-1ecdc960-6270-41b5-b1d2-8ad1911617b2 None None] MFA Rules not processed for user `bf5ceb8f07374635ad506b7d1b4f1612`. Rule list: `[]` (Enabled: `True`). {{(pid=144068) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 08:11:20.770636 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.fernet_utils [None req-1ecdc960-6270-41b5-b1d2-8ad1911617b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=144068) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:11:20.781608 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG dbcounter [-] [144067] Writing DB stats keystone:SELECT=100 {{(pid=144067) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:11:20.832356 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ddadba4-4377-495a-8eff-faacf1f6d23d None None] Validating token access rules against request {{(pid=144067) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:11:20.853740 dv-cinder-851351-1-smb devstack@keystone.service[144068]: [pid: 144068|app: 0|req: 164/323] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 08:11:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 08:11:20.875438 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c84ee051-f2e7-46c6-8ba2-f7f53ff774c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144067) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:11:20.875781 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ecdc960-6270-41b5-b1d2-8ad1911617b2 None None] Authenticating user token {{(pid=144068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:11:20.876582 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84ee051-f2e7-46c6-8ba2-f7f53ff774c8 None admin] REQUEST_METHOD: `POST` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:11:20.876907 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84ee051-f2e7-46c6-8ba2-f7f53ff774c8 None admin] SCRIPT_NAME: `/identity` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:11:20.881525 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84ee051-f2e7-46c6-8ba2-f7f53ff774c8 None admin] PATH_INFO: `/v3/groups` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:11:20.882280 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c84ee051-f2e7-46c6-8ba2-f7f53ff774c8 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:11:20.883801 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c84ee051-f2e7-46c6-8ba2-f7f53ff774c8 None admin] RBAC: Authorization granted {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:11:20.916699 dv-cinder-851351-1-smb devstack@keystone.service[144067]: [pid: 144067|app: 0|req: 160/324] 10.222.0.42 () {60 vars in 1134 bytes} [Thu Jul 28 08:11:20 2022] POST /identity/v3/groups => generated 226 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 08:11:21.009362 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ecdc960-6270-41b5-b1d2-8ad1911617b2 None None] Validating token access rules against request {{(pid=144068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:11:21.040316 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG dbcounter [-] [144068] Writing DB stats keystone:SELECT=100 {{(pid=144068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:11:21.049713 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79fcfe8-f215-4167-b3f8-e8f2e60608d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:11:21.050391 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79fcfe8-f215-4167-b3f8-e8f2e60608d5 None admin] REQUEST_METHOD: `GET` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:11:21.050671 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79fcfe8-f215-4167-b3f8-e8f2e60608d5 None admin] SCRIPT_NAME: `/identity` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:11:21.050943 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79fcfe8-f215-4167-b3f8-e8f2e60608d5 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:11:21.062888 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a79fcfe8-f215-4167-b3f8-e8f2e60608d5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 08:11:21.068011 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application [None req-a79fcfe8-f215-4167-b3f8-e8f2e60608d5 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 28 08:11:21.068011 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:11:21.068011 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:11:21.068011 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:11:21.068011 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:11:21.068011 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:11:21.068011 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:11:21.068011 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:11:21.068011 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:11:21.068011 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:11:21.068011 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:11:21.068011 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:11:21.068011 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 08:11:21.068011 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 08:11:21.068011 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 08:11:21.068011 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 08:11:21.069180 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 08:11:21.069180 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 08:11:21.069180 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 08:11:21.069180 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 08:11:21.069180 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:11:21.069180 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:11:21.069180 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:11:21.069180 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:11:21.069180 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:11:21.069180 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:11:21.069180 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:11:21.069180 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application with Lock( Jul 28 08:11:21.069180 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:11:21.069180 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:11:21.069180 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:11:21.069180 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:11:21.070124 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:11:21.070124 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:11:21.070124 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:11:21.070124 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:11:21.070124 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 08:11:21.070124 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 08:11:21.070124 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 08:11:21.070124 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 08:11:21.070124 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 08:11:21.070124 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 08:11:21.070124 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 28 08:11:21.070124 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application Jul 28 08:11:21.071372 dv-cinder-851351-1-smb devstack@keystone.service[144068]: [pid: 144068|app: 0|req: 165/325] 10.222.0.42 () {56 vars in 1099 bytes} [Thu Jul 28 08:11:20 2022] GET /identity/v3/roles/reader => generated 84 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:11:21.075621 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c84ee051-f2e7-46c6-8ba2-f7f53ff774c8 None admin] Authenticating user token {{(pid=144067) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:11:21.198583 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c84ee051-f2e7-46c6-8ba2-f7f53ff774c8 None admin] Validating token access rules against request {{(pid=144067) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:11:21.222149 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG dbcounter [-] [144067] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=144067) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:11:21.240796 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d56308-fa30-4c8b-991b-597c3f2011d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144067) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:11:21.240796 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d56308-fa30-4c8b-991b-597c3f2011d2 None admin] REQUEST_METHOD: `GET` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:11:21.241278 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d56308-fa30-4c8b-991b-597c3f2011d2 None admin] SCRIPT_NAME: `/identity` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:11:21.241278 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d56308-fa30-4c8b-991b-597c3f2011d2 None admin] PATH_INFO: `/v3/roles` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:11:21.242107 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52d56308-fa30-4c8b-991b-597c3f2011d2 None admin] RBAC: Adding query filter params (name=reader) {{(pid=144067) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:11:21.242231 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52d56308-fa30-4c8b-991b-597c3f2011d2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:11:21.243619 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52d56308-fa30-4c8b-991b-597c3f2011d2 None admin] RBAC: Authorization granted {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:11:21.253987 dv-cinder-851351-1-smb devstack@keystone.service[144067]: [pid: 144067|app: 0|req: 161/326] 10.222.0.42 () {56 vars in 1101 bytes} [Thu Jul 28 08:11:21 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:11:21.260272 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79fcfe8-f215-4167-b3f8-e8f2e60608d5 None admin] Authenticating user token {{(pid=144068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:11:21.267067 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12fc915d-e820-4b00-b504-be0e9a0136bd None None] REQUEST_METHOD: `GET` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:11:21.267395 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12fc915d-e820-4b00-b504-be0e9a0136bd None None] SCRIPT_NAME: `/identity` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:11:21.267646 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12fc915d-e820-4b00-b504-be0e9a0136bd None None] PATH_INFO: `/` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:11:21.269338 dv-cinder-851351-1-smb devstack@keystone.service[144067]: [pid: 144067|app: 0|req: 162/327] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 08:11:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 08:11:21.276817 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2b8c6b-2ec9-4803-b494-5c7242d01a99 None None] REQUEST_METHOD: `POST` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:11:21.277122 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2b8c6b-2ec9-4803-b494-5c7242d01a99 None None] SCRIPT_NAME: `/identity` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:11:21.278025 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2b8c6b-2ec9-4803-b494-5c7242d01a99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:11:21.306405 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.auth.core [None req-fa2b8c6b-2ec9-4803-b494-5c7242d01a99 None None] MFA Rules not processed for user `bf5ceb8f07374635ad506b7d1b4f1612`. Rule list: `[]` (Enabled: `True`). {{(pid=144067) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 08:11:21.307645 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.fernet_utils [None req-fa2b8c6b-2ec9-4803-b494-5c7242d01a99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=144067) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:11:21.399309 dv-cinder-851351-1-smb devstack@keystone.service[144067]: [pid: 144067|app: 0|req: 163/328] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 08:11:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 28 08:11:21.421119 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79fcfe8-f215-4167-b3f8-e8f2e60608d5 None admin] Validating token access rules against request {{(pid=144068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:11:21.437400 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa2b8c6b-2ec9-4803-b494-5c7242d01a99 None None] Authenticating user token {{(pid=144067) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:11:21.471390 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00123cd4-3d02-4b15-85c1-7098d5fa4a54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:11:21.472487 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00123cd4-3d02-4b15-85c1-7098d5fa4a54 None admin] REQUEST_METHOD: `GET` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:11:21.472825 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00123cd4-3d02-4b15-85c1-7098d5fa4a54 None admin] SCRIPT_NAME: `/identity` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:11:21.472825 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00123cd4-3d02-4b15-85c1-7098d5fa4a54 None admin] PATH_INFO: `/v3/users/7a6afc76ee0a43d8acf0eb5cdddf840f` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:11:21.475267 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00123cd4-3d02-4b15-85c1-7098d5fa4a54 None admin] RBAC: Authorizing `identity:get_user(user_id=7a6afc76ee0a43d8acf0eb5cdddf840f)` {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:11:21.475937 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00123cd4-3d02-4b15-85c1-7098d5fa4a54 None admin] RBAC: Authorization granted {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:11:21.479156 dv-cinder-851351-1-smb devstack@keystone.service[144068]: [pid: 144068|app: 0|req: 166/329] 10.222.0.42 () {56 vars in 1177 bytes} [Thu Jul 28 08:11:21 2022] GET /identity/v3/users/7a6afc76ee0a43d8acf0eb5cdddf840f => generated 293 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 08:11:21.484577 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00123cd4-3d02-4b15-85c1-7098d5fa4a54 None admin] Authenticating user token {{(pid=144068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:11:21.558486 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG dbcounter [-] [144068] Writing DB stats keystone:SELECT=100 {{(pid=144068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:11:21.577871 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa2b8c6b-2ec9-4803-b494-5c7242d01a99 None None] Validating token access rules against request {{(pid=144067) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:11:21.596584 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG dbcounter [-] [144067] Writing DB stats keystone:SELECT=100 {{(pid=144067) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:11:21.621238 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00123cd4-3d02-4b15-85c1-7098d5fa4a54 None admin] Validating token access rules against request {{(pid=144068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:11:21.634194 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06050abb-7709-499f-b968-0654d95e69bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144067) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:11:21.634883 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06050abb-7709-499f-b968-0654d95e69bc None admin] REQUEST_METHOD: `GET` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:11:21.635163 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06050abb-7709-499f-b968-0654d95e69bc None admin] SCRIPT_NAME: `/identity` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:11:21.635446 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06050abb-7709-499f-b968-0654d95e69bc None admin] PATH_INFO: `/v3/roles/member` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:11:21.658668 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06050abb-7709-499f-b968-0654d95e69bc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 08:11:21.664333 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application [None req-06050abb-7709-499f-b968-0654d95e69bc None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 28 08:11:21.664333 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:11:21.664333 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:11:21.664333 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:11:21.664333 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:11:21.664333 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:11:21.664333 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:11:21.664333 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:11:21.664333 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:11:21.664333 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:11:21.664333 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:11:21.664333 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:11:21.664333 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 08:11:21.664333 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 08:11:21.664333 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 08:11:21.664333 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 08:11:21.665471 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 08:11:21.665471 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 08:11:21.665471 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 08:11:21.665471 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 08:11:21.665471 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:11:21.665471 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:11:21.665471 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:11:21.665471 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:11:21.665471 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:11:21.665471 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:11:21.665471 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:11:21.665471 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application with Lock( Jul 28 08:11:21.665471 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:11:21.665471 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:11:21.665471 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:11:21.665471 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:11:21.666404 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:11:21.666404 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:11:21.666404 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:11:21.666404 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:11:21.666404 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 08:11:21.666404 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 08:11:21.666404 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 08:11:21.666404 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 08:11:21.666404 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 08:11:21.666404 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 08:11:21.666404 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 28 08:11:21.666404 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application Jul 28 08:11:21.670784 dv-cinder-851351-1-smb devstack@keystone.service[144067]: [pid: 144067|app: 0|req: 164/330] 10.222.0.42 () {56 vars in 1099 bytes} [Thu Jul 28 08:11:21 2022] GET /identity/v3/roles/member => generated 84 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:11:21.671766 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06050abb-7709-499f-b968-0654d95e69bc None admin] Authenticating user token {{(pid=144067) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:11:21.679505 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173bc58d-3c18-4643-b684-a6d09435ca4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:11:21.680942 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173bc58d-3c18-4643-b684-a6d09435ca4b None admin] REQUEST_METHOD: `PUT` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:11:21.681476 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173bc58d-3c18-4643-b684-a6d09435ca4b None admin] SCRIPT_NAME: `/identity` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:11:21.682549 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173bc58d-3c18-4643-b684-a6d09435ca4b None admin] PATH_INFO: `/v3/system/users/7a6afc76ee0a43d8acf0eb5cdddf840f/roles/aac18bff164441838e5b7d98f770be5e` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:11:21.684810 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-173bc58d-3c18-4643-b684-a6d09435ca4b None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=7a6afc76ee0a43d8acf0eb5cdddf840f, role_id=aac18bff164441838e5b7d98f770be5e)` {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:11:21.686480 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-173bc58d-3c18-4643-b684-a6d09435ca4b None admin] RBAC: Authorization granted {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:11:21.698693 dv-cinder-851351-1-smb devstack@keystone.service[144068]: [pid: 144068|app: 0|req: 167/331] 10.222.0.42 () {58 vars in 1334 bytes} [Thu Jul 28 08:11:21 2022] PUT /identity/v3/system/users/7a6afc76ee0a43d8acf0eb5cdddf840f/roles/aac18bff164441838e5b7d98f770be5e => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 08:11:21.817095 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06050abb-7709-499f-b968-0654d95e69bc None admin] Validating token access rules against request {{(pid=144067) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:11:21.859178 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a3728a-6ebc-428a-8272-540e5143abb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144067) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:11:21.860007 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a3728a-6ebc-428a-8272-540e5143abb5 None admin] REQUEST_METHOD: `GET` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:11:21.860287 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a3728a-6ebc-428a-8272-540e5143abb5 None admin] SCRIPT_NAME: `/identity` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:11:21.860562 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a3728a-6ebc-428a-8272-540e5143abb5 None admin] PATH_INFO: `/v3/roles` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:11:21.861411 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a3728a-6ebc-428a-8272-540e5143abb5 None admin] RBAC: Adding query filter params (name=member) {{(pid=144067) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:11:21.861723 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a3728a-6ebc-428a-8272-540e5143abb5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:11:21.863192 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a3728a-6ebc-428a-8272-540e5143abb5 None admin] RBAC: Authorization granted {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:11:21.873700 dv-cinder-851351-1-smb devstack@keystone.service[144067]: [pid: 144067|app: 0|req: 165/332] 10.222.0.42 () {56 vars in 1101 bytes} [Thu Jul 28 08:11:21 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:11:21.879773 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173bc58d-3c18-4643-b684-a6d09435ca4b None admin] Authenticating user token {{(pid=144068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:11:21.998340 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173bc58d-3c18-4643-b684-a6d09435ca4b None admin] Validating token access rules against request {{(pid=144068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:11:22.021540 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG dbcounter [-] [144068] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=144068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:11:22.041615 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5707821a-df77-4d73-914f-2f6f51469131 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:11:22.042286 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5707821a-df77-4d73-914f-2f6f51469131 None admin] REQUEST_METHOD: `GET` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:11:22.042572 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5707821a-df77-4d73-914f-2f6f51469131 None admin] SCRIPT_NAME: `/identity` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:11:22.042851 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5707821a-df77-4d73-914f-2f6f51469131 None admin] PATH_INFO: `/v3/users/9b849a2813204a01ba7d1d74158f47fb` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:11:22.044095 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5707821a-df77-4d73-914f-2f6f51469131 None admin] RBAC: Authorizing `identity:get_user(user_id=9b849a2813204a01ba7d1d74158f47fb)` {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:11:22.045589 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5707821a-df77-4d73-914f-2f6f51469131 None admin] RBAC: Authorization granted {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:11:22.047244 dv-cinder-851351-1-smb devstack@keystone.service[144068]: [pid: 144068|app: 0|req: 168/333] 10.222.0.42 () {56 vars in 1177 bytes} [Thu Jul 28 08:11:21 2022] GET /identity/v3/users/9b849a2813204a01ba7d1d74158f47fb => generated 293 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:11:22.053361 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a3728a-6ebc-428a-8272-540e5143abb5 None admin] Authenticating user token {{(pid=144067) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:11:22.112338 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG dbcounter [-] [144067] Writing DB stats keystone:SELECT=100 {{(pid=144067) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:11:22.205318 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a3728a-6ebc-428a-8272-540e5143abb5 None admin] Validating token access rules against request {{(pid=144067) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:11:22.260431 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-516155e3-4e02-47e4-b5de-258a8b62d775 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144067) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:11:22.261157 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516155e3-4e02-47e4-b5de-258a8b62d775 None admin] REQUEST_METHOD: `GET` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:11:22.261447 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516155e3-4e02-47e4-b5de-258a8b62d775 None admin] SCRIPT_NAME: `/identity` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:11:22.261727 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516155e3-4e02-47e4-b5de-258a8b62d775 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:11:22.262540 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-516155e3-4e02-47e4-b5de-258a8b62d775 None admin] RBAC: Adding query filter params (role.id=6933b60756fe46dd8f27854f5e192061, user.id=9b849a2813204a01ba7d1d74158f47fb, scope.system=all) {{(pid=144067) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:11:22.262853 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-516155e3-4e02-47e4-b5de-258a8b62d775 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:11:22.264353 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-516155e3-4e02-47e4-b5de-258a8b62d775 None admin] RBAC: Authorization granted {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:11:22.280464 dv-cinder-851351-1-smb devstack@keystone.service[144067]: [pid: 144067|app: 0|req: 166/334] 10.222.0.42 () {56 vars in 1308 bytes} [Thu Jul 28 08:11:22 2022] GET /identity/v3/role_assignments?user.id=9b849a2813204a01ba7d1d74158f47fb&scope.system=all&role.id=6933b60756fe46dd8f27854f5e192061 => generated 510 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:11:23.635798 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e8e681-1e2c-4764-84d8-09c8bcab834b None None] REQUEST_METHOD: `GET` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:11:23.636368 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e8e681-1e2c-4764-84d8-09c8bcab834b None None] SCRIPT_NAME: `/identity` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:11:23.636368 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e8e681-1e2c-4764-84d8-09c8bcab834b None None] PATH_INFO: `/` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:11:23.638110 dv-cinder-851351-1-smb devstack@keystone.service[144068]: [pid: 144068|app: 0|req: 169/335] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 08:11:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 08:11:23.643593 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a76f86d-6a58-43b4-a911-facc35e203c3 None None] REQUEST_METHOD: `POST` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:11:23.644505 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a76f86d-6a58-43b4-a911-facc35e203c3 None None] SCRIPT_NAME: `/identity` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:11:23.645143 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a76f86d-6a58-43b4-a911-facc35e203c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:11:23.650902 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea6a371-83c1-407f-a36d-511da5164f93 None None] REQUEST_METHOD: `GET` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:11:23.651619 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea6a371-83c1-407f-a36d-511da5164f93 None None] SCRIPT_NAME: `/identity` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:11:23.652140 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea6a371-83c1-407f-a36d-511da5164f93 None None] PATH_INFO: `/` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:11:23.654119 dv-cinder-851351-1-smb devstack@keystone.service[144068]: [pid: 144068|app: 0|req: 170/336] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 08:11:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 08:11:23.660971 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a320dad-7d42-4077-a1f9-e1cdef8d4414 None None] REQUEST_METHOD: `POST` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:11:23.661964 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a320dad-7d42-4077-a1f9-e1cdef8d4414 None None] SCRIPT_NAME: `/identity` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:11:23.662659 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a320dad-7d42-4077-a1f9-e1cdef8d4414 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:11:23.670381 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.auth.core [None req-3a76f86d-6a58-43b4-a911-facc35e203c3 None None] MFA Rules not processed for user `bf5ceb8f07374635ad506b7d1b4f1612`. Rule list: `[]` (Enabled: `True`). {{(pid=144067) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 08:11:23.671620 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.fernet_utils [None req-3a76f86d-6a58-43b4-a911-facc35e203c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=144067) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:11:23.685359 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.auth.core [None req-7a320dad-7d42-4077-a1f9-e1cdef8d4414 None None] MFA Rules not processed for user `bf5ceb8f07374635ad506b7d1b4f1612`. Rule list: `[]` (Enabled: `True`). {{(pid=144068) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 08:11:23.686922 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.fernet_utils [None req-7a320dad-7d42-4077-a1f9-e1cdef8d4414 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=144068) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:11:23.778856 dv-cinder-851351-1-smb devstack@keystone.service[144068]: [pid: 144068|app: 0|req: 171/337] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 08:11:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 28 08:11:23.808368 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a320dad-7d42-4077-a1f9-e1cdef8d4414 None None] Authenticating user token {{(pid=144068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:11:23.821107 dv-cinder-851351-1-smb devstack@keystone.service[144067]: [pid: 144067|app: 0|req: 167/338] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 08:11:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 08:11:23.860572 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a76f86d-6a58-43b4-a911-facc35e203c3 None None] Authenticating user token {{(pid=144067) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:11:23.915207 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG dbcounter [-] [144067] Writing DB stats keystone:SELECT=100 {{(pid=144067) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:11:23.928836 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a320dad-7d42-4077-a1f9-e1cdef8d4414 None None] Validating token access rules against request {{(pid=144068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:11:23.961074 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG dbcounter [-] [144068] Writing DB stats keystone:SELECT=100 {{(pid=144068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:11:23.989822 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e9dfa1-fed2-4172-b968-35f6a829f5cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:11:23.989822 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e9dfa1-fed2-4172-b968-35f6a829f5cb None admin] REQUEST_METHOD: `GET` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:11:23.989822 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e9dfa1-fed2-4172-b968-35f6a829f5cb None admin] SCRIPT_NAME: `/identity` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:11:23.989822 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e9dfa1-fed2-4172-b968-35f6a829f5cb None admin] PATH_INFO: `/v3/roles/member` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:11:24.005928 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e9dfa1-fed2-4172-b968-35f6a829f5cb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 08:11:24.011294 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application [None req-24e9dfa1-fed2-4172-b968-35f6a829f5cb None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 28 08:11:24.011294 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:11:24.011294 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:11:24.011294 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:11:24.011294 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:11:24.011294 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:11:24.011294 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:11:24.011294 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:11:24.011294 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:11:24.011294 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:11:24.011294 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:11:24.011294 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:11:24.011294 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 08:11:24.011294 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 08:11:24.011294 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 08:11:24.011294 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 08:11:24.012627 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 08:11:24.012627 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 08:11:24.012627 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 08:11:24.012627 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 08:11:24.012627 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:11:24.012627 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:11:24.012627 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:11:24.012627 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:11:24.012627 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:11:24.012627 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:11:24.012627 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:11:24.012627 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application with Lock( Jul 28 08:11:24.012627 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:11:24.012627 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:11:24.012627 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:11:24.012627 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:11:24.017863 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:11:24.017863 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:11:24.017863 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:11:24.017863 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:11:24.017863 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 08:11:24.017863 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 08:11:24.017863 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 08:11:24.017863 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 08:11:24.017863 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 08:11:24.017863 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 08:11:24.017863 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 28 08:11:24.017863 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application Jul 28 08:11:24.020591 dv-cinder-851351-1-smb devstack@keystone.service[144068]: [pid: 144068|app: 0|req: 172/339] 10.222.0.42 () {56 vars in 1099 bytes} [Thu Jul 28 08:11:23 2022] GET /identity/v3/roles/member => generated 84 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 08:11:24.030099 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e9dfa1-fed2-4172-b968-35f6a829f5cb None admin] Authenticating user token {{(pid=144068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:11:24.104691 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a76f86d-6a58-43b4-a911-facc35e203c3 None None] Validating token access rules against request {{(pid=144067) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:11:24.165772 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c0588f3-9bfa-492e-819c-48bf8c686095 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144067) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:11:24.166538 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0588f3-9bfa-492e-819c-48bf8c686095 None admin] REQUEST_METHOD: `GET` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:11:24.166924 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0588f3-9bfa-492e-819c-48bf8c686095 None admin] SCRIPT_NAME: `/identity` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:11:24.167326 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0588f3-9bfa-492e-819c-48bf8c686095 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:11:24.185844 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e9dfa1-fed2-4172-b968-35f6a829f5cb None admin] Validating token access rules against request {{(pid=144068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:11:24.197444 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c0588f3-9bfa-492e-819c-48bf8c686095 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 08:11:24.203025 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application [None req-4c0588f3-9bfa-492e-819c-48bf8c686095 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 28 08:11:24.203025 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:11:24.203025 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:11:24.203025 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:11:24.203025 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:11:24.203025 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:11:24.203025 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:11:24.203025 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:11:24.203025 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:11:24.203025 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:11:24.203025 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:11:24.203025 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:11:24.203025 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 08:11:24.203025 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 08:11:24.203025 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 08:11:24.203025 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 08:11:24.204072 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 08:11:24.204072 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 08:11:24.204072 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 08:11:24.204072 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 08:11:24.204072 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:11:24.204072 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:11:24.204072 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:11:24.204072 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:11:24.204072 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:11:24.204072 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:11:24.204072 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:11:24.204072 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application with Lock( Jul 28 08:11:24.204072 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:11:24.204072 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:11:24.204072 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:11:24.204072 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:11:24.205058 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:11:24.205058 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:11:24.205058 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:11:24.205058 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:11:24.205058 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 08:11:24.205058 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 08:11:24.205058 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 08:11:24.205058 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 08:11:24.205058 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 08:11:24.205058 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 08:11:24.205058 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 28 08:11:24.205058 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application Jul 28 08:11:24.207779 dv-cinder-851351-1-smb devstack@keystone.service[144067]: [pid: 144067|app: 0|req: 168/340] 10.222.0.42 () {56 vars in 1114 bytes} [Thu Jul 28 08:11:23 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 348 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 08:11:24.214589 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c0588f3-9bfa-492e-819c-48bf8c686095 None admin] Authenticating user token {{(pid=144067) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:11:24.241958 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd5fdea4-a5dc-44d5-8c74-505c7bcde24f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:11:24.243761 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5fdea4-a5dc-44d5-8c74-505c7bcde24f None admin] REQUEST_METHOD: `GET` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:11:24.244455 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5fdea4-a5dc-44d5-8c74-505c7bcde24f None admin] SCRIPT_NAME: `/identity` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:11:24.246542 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5fdea4-a5dc-44d5-8c74-505c7bcde24f None admin] PATH_INFO: `/v3/roles` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:11:24.247537 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd5fdea4-a5dc-44d5-8c74-505c7bcde24f None admin] RBAC: Adding query filter params (name=member) {{(pid=144068) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:11:24.248083 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd5fdea4-a5dc-44d5-8c74-505c7bcde24f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:11:24.250629 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd5fdea4-a5dc-44d5-8c74-505c7bcde24f None admin] RBAC: Authorization granted {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:11:24.282271 dv-cinder-851351-1-smb devstack@keystone.service[144068]: [pid: 144068|app: 0|req: 173/341] 10.222.0.42 () {56 vars in 1101 bytes} [Thu Jul 28 08:11:24 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 08:11:24.288317 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd5fdea4-a5dc-44d5-8c74-505c7bcde24f None admin] Authenticating user token {{(pid=144068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:11:24.396337 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG dbcounter [-] [144068] Writing DB stats keystone:SELECT=100 {{(pid=144068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:11:24.424296 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG dbcounter [-] [144067] Writing DB stats keystone:SELECT=100 {{(pid=144067) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:11:24.462623 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c0588f3-9bfa-492e-819c-48bf8c686095 None admin] Validating token access rules against request {{(pid=144067) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:11:24.520891 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd5fdea4-a5dc-44d5-8c74-505c7bcde24f None admin] Validating token access rules against request {{(pid=144068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:11:24.527222 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e3f5ab-c157-4929-a923-30859d51789a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144067) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:11:24.528020 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e3f5ab-c157-4929-a923-30859d51789a None admin] REQUEST_METHOD: `GET` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:11:24.528307 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e3f5ab-c157-4929-a923-30859d51789a None admin] SCRIPT_NAME: `/identity` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:11:24.528650 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e3f5ab-c157-4929-a923-30859d51789a None admin] PATH_INFO: `/v3/roles` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:11:24.529445 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68e3f5ab-c157-4929-a923-30859d51789a None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=144067) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:11:24.529761 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68e3f5ab-c157-4929-a923-30859d51789a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:11:24.531198 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68e3f5ab-c157-4929-a923-30859d51789a None admin] RBAC: Authorization granted {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:11:24.543503 dv-cinder-851351-1-smb devstack@keystone.service[144067]: [pid: 144067|app: 0|req: 169/342] 10.222.0.42 () {56 vars in 1111 bytes} [Thu Jul 28 08:11:24 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 329 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:11:24.545233 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b55c287-6c35-426a-af48-8299fffced7e None None] REQUEST_METHOD: `GET` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:11:24.545780 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b55c287-6c35-426a-af48-8299fffced7e None None] SCRIPT_NAME: `/identity` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:11:24.546245 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b55c287-6c35-426a-af48-8299fffced7e None None] PATH_INFO: `/` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:11:24.548375 dv-cinder-851351-1-smb devstack@keystone.service[144067]: [pid: 144067|app: 0|req: 170/343] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 08:11:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 08:11:24.557855 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feac0924-b87a-44b9-8aab-dbb531f7a0dc None None] REQUEST_METHOD: `POST` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:11:24.558404 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feac0924-b87a-44b9-8aab-dbb531f7a0dc None None] SCRIPT_NAME: `/identity` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:11:24.558879 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feac0924-b87a-44b9-8aab-dbb531f7a0dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:11:24.589733 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.auth.core [None req-feac0924-b87a-44b9-8aab-dbb531f7a0dc None None] MFA Rules not processed for user `bf5ceb8f07374635ad506b7d1b4f1612`. Rule list: `[]` (Enabled: `True`). {{(pid=144067) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 08:11:24.590950 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.fernet_utils [None req-feac0924-b87a-44b9-8aab-dbb531f7a0dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=144067) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:11:24.596594 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b707101f-097d-47eb-aa48-be9581c1a2ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:11:24.597504 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b707101f-097d-47eb-aa48-be9581c1a2ee None admin] REQUEST_METHOD: `GET` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:11:24.598914 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b707101f-097d-47eb-aa48-be9581c1a2ee None admin] SCRIPT_NAME: `/identity` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:11:24.599381 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b707101f-097d-47eb-aa48-be9581c1a2ee None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:11:24.697930 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b707101f-097d-47eb-aa48-be9581c1a2ee None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:11:24.700219 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b707101f-097d-47eb-aa48-be9581c1a2ee None admin] RBAC: Authorization granted {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:11:24.703101 dv-cinder-851351-1-smb devstack@keystone.service[144067]: [pid: 144067|app: 0|req: 171/344] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 08:11:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 363 bytes (3 switches on core 0) Jul 28 08:11:24.705670 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feac0924-b87a-44b9-8aab-dbb531f7a0dc None None] Authenticating user token {{(pid=144067) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:11:24.751702 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG dbcounter [-] [144068] Writing DB stats keystone:SELECT=100 {{(pid=144068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:11:24.813520 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG dbcounter [-] [144067] Writing DB stats keystone:SELECT=100 {{(pid=144067) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:11:24.838785 dv-cinder-851351-1-smb devstack@keystone.service[144068]: [pid: 144068|app: 0|req: 174/345] 10.222.0.42 () {58 vars in 1282 bytes} [Thu Jul 28 08:11:24 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 551 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 28 08:11:24.848368 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132ffe97-9a13-420e-a441-af251290230d None None] REQUEST_METHOD: `GET` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:11:24.848368 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132ffe97-9a13-420e-a441-af251290230d None None] SCRIPT_NAME: `/identity` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:11:24.848368 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132ffe97-9a13-420e-a441-af251290230d None None] PATH_INFO: `/` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:11:24.849106 dv-cinder-851351-1-smb devstack@keystone.service[144068]: [pid: 144068|app: 0|req: 175/346] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 08:11:24 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 08:11:24.849834 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-132ffe97-9a13-420e-a441-af251290230d None None] Authenticating user token {{(pid=144068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:11:24.855309 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feac0924-b87a-44b9-8aab-dbb531f7a0dc None None] Validating token access rules against request {{(pid=144067) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:11:24.908050 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af03532e-cf17-44d9-8c92-90d6d2638af0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144067) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:11:24.908728 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af03532e-cf17-44d9-8c92-90d6d2638af0 None admin] REQUEST_METHOD: `GET` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:11:24.909068 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af03532e-cf17-44d9-8c92-90d6d2638af0 None admin] SCRIPT_NAME: `/identity` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:11:24.909373 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af03532e-cf17-44d9-8c92-90d6d2638af0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:11:25.008494 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-132ffe97-9a13-420e-a441-af251290230d None None] Validating token access rules against request {{(pid=144068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:11:25.016223 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af03532e-cf17-44d9-8c92-90d6d2638af0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:11:25.017773 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af03532e-cf17-44d9-8c92-90d6d2638af0 None admin] RBAC: Authorization granted {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:11:25.066105 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb221a0-0de0-4622-8ef3-dbe1791ae4cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:11:25.066836 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb221a0-0de0-4622-8ef3-dbe1791ae4cb None admin] REQUEST_METHOD: `GET` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:11:25.067122 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb221a0-0de0-4622-8ef3-dbe1791ae4cb None admin] SCRIPT_NAME: `/identity` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:11:25.068022 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb221a0-0de0-4622-8ef3-dbe1791ae4cb None admin] PATH_INFO: `/v3/roles/member` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:11:25.079580 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG dbcounter [-] [144068] Writing DB stats keystone:SELECT=100 {{(pid=144068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:11:25.085034 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcb221a0-0de0-4622-8ef3-dbe1791ae4cb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 08:11:25.092684 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application [None req-bcb221a0-0de0-4622-8ef3-dbe1791ae4cb None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 28 08:11:25.092684 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:11:25.092684 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:11:25.092684 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:11:25.092684 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:11:25.092684 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:11:25.092684 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:11:25.092684 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:11:25.092684 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:11:25.092684 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:11:25.092684 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:11:25.092684 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:11:25.092684 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 08:11:25.092684 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 08:11:25.092684 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 08:11:25.092684 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 08:11:25.093729 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 08:11:25.093729 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 08:11:25.093729 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 08:11:25.093729 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 08:11:25.093729 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:11:25.093729 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:11:25.093729 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:11:25.093729 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:11:25.093729 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:11:25.093729 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:11:25.093729 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:11:25.093729 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application with Lock( Jul 28 08:11:25.093729 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:11:25.093729 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:11:25.093729 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:11:25.093729 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:11:25.094662 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:11:25.094662 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:11:25.094662 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:11:25.094662 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:11:25.094662 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 08:11:25.094662 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 08:11:25.094662 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 08:11:25.094662 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 08:11:25.094662 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 08:11:25.094662 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 08:11:25.094662 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 28 08:11:25.094662 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application Jul 28 08:11:25.095861 dv-cinder-851351-1-smb devstack@keystone.service[144068]: [pid: 144068|app: 0|req: 176/347] 10.222.0.42 () {56 vars in 1099 bytes} [Thu Jul 28 08:11:24 2022] GET /identity/v3/roles/member => generated 84 bytes in 246 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:11:25.097551 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb221a0-0de0-4622-8ef3-dbe1791ae4cb None admin] Authenticating user token {{(pid=144068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:11:25.110003 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG dbcounter [-] [144067] Writing DB stats keystone:SELECT=100 {{(pid=144067) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:11:25.146126 dv-cinder-851351-1-smb devstack@keystone.service[144067]: [pid: 144067|app: 0|req: 172/348] 10.222.0.42 () {58 vars in 1282 bytes} [Thu Jul 28 08:11:24 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 441 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 28 08:11:25.147449 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f9ae96-6114-47b9-9570-ea881d2ff394 None None] REQUEST_METHOD: `POST` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:11:25.147743 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f9ae96-6114-47b9-9570-ea881d2ff394 None None] SCRIPT_NAME: `/identity` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:11:25.148024 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f9ae96-6114-47b9-9570-ea881d2ff394 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:11:25.176892 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.auth.core [None req-b9f9ae96-6114-47b9-9570-ea881d2ff394 None None] MFA Rules not processed for user `bf5ceb8f07374635ad506b7d1b4f1612`. Rule list: `[]` (Enabled: `True`). {{(pid=144067) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 08:11:25.178142 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.fernet_utils [None req-b9f9ae96-6114-47b9-9570-ea881d2ff394 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=144067) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:11:25.237748 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb221a0-0de0-4622-8ef3-dbe1791ae4cb None admin] Validating token access rules against request {{(pid=144068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:11:25.269150 dv-cinder-851351-1-smb devstack@keystone.service[144067]: [pid: 144067|app: 0|req: 173/349] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 08:11:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 08:11:25.270235 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f9ae96-6114-47b9-9570-ea881d2ff394 None None] Authenticating user token {{(pid=144067) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:11:25.280128 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b03b7b-f91b-4536-b385-7dc9c65d38fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:11:25.280843 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b03b7b-f91b-4536-b385-7dc9c65d38fe None admin] REQUEST_METHOD: `GET` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:11:25.281131 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b03b7b-f91b-4536-b385-7dc9c65d38fe None admin] SCRIPT_NAME: `/identity` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:11:25.281408 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b03b7b-f91b-4536-b385-7dc9c65d38fe None admin] PATH_INFO: `/v3/projects/49167073baf644459c58534448b0037f` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:11:25.284562 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b03b7b-f91b-4536-b385-7dc9c65d38fe None admin] RBAC: Authorizing `identity:get_project(project_id=49167073baf644459c58534448b0037f)` {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:11:25.286121 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b03b7b-f91b-4536-b385-7dc9c65d38fe None admin] RBAC: Authorization granted {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:11:25.288059 dv-cinder-851351-1-smb devstack@keystone.service[144068]: [pid: 144068|app: 0|req: 177/350] 10.222.0.42 () {56 vars in 1186 bytes} [Thu Jul 28 08:11:25 2022] GET /identity/v3/projects/49167073baf644459c58534448b0037f => generated 298 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:11:25.288864 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b03b7b-f91b-4536-b385-7dc9c65d38fe None admin] Authenticating user token {{(pid=144068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:11:25.378085 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG dbcounter [-] [144068] Writing DB stats keystone:SELECT=100 {{(pid=144068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:11:25.400379 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f9ae96-6114-47b9-9570-ea881d2ff394 None None] Validating token access rules against request {{(pid=144067) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:11:25.405833 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG dbcounter [-] [144067] Writing DB stats keystone:SELECT=100 {{(pid=144067) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:11:25.425181 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b03b7b-f91b-4536-b385-7dc9c65d38fe None admin] Validating token access rules against request {{(pid=144068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:11:25.445684 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ebaac31-d290-4e5e-980c-942177ece3cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144067) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:11:25.446351 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebaac31-d290-4e5e-980c-942177ece3cc None admin] REQUEST_METHOD: `GET` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:11:25.446638 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebaac31-d290-4e5e-980c-942177ece3cc None admin] SCRIPT_NAME: `/identity` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:11:25.446919 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebaac31-d290-4e5e-980c-942177ece3cc None admin] PATH_INFO: `/v3/roles` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:11:25.447680 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ebaac31-d290-4e5e-980c-942177ece3cc None admin] RBAC: Adding query filter params (name=member) {{(pid=144067) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:11:25.447991 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ebaac31-d290-4e5e-980c-942177ece3cc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:11:25.449610 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ebaac31-d290-4e5e-980c-942177ece3cc None admin] RBAC: Authorization granted {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:11:25.459541 dv-cinder-851351-1-smb devstack@keystone.service[144067]: [pid: 144067|app: 0|req: 174/351] 10.222.0.42 () {56 vars in 1101 bytes} [Thu Jul 28 08:11:25 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:11:25.460937 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ebaac31-d290-4e5e-980c-942177ece3cc None admin] Authenticating user token {{(pid=144067) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:11:25.472755 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca279aa-0393-4f65-8c3a-6f6e8b90ccb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:11:25.473619 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca279aa-0393-4f65-8c3a-6f6e8b90ccb3 None admin] REQUEST_METHOD: `GET` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:11:25.473906 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca279aa-0393-4f65-8c3a-6f6e8b90ccb3 None admin] SCRIPT_NAME: `/identity` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:11:25.474185 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca279aa-0393-4f65-8c3a-6f6e8b90ccb3 None admin] PATH_INFO: `/v3/projects/49167073baf644459c58534448b0037f` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:11:25.475436 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cca279aa-0393-4f65-8c3a-6f6e8b90ccb3 None admin] RBAC: Authorizing `identity:get_project(project_id=49167073baf644459c58534448b0037f)` {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:11:25.477073 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cca279aa-0393-4f65-8c3a-6f6e8b90ccb3 None admin] RBAC: Authorization granted {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:11:25.479090 dv-cinder-851351-1-smb devstack@keystone.service[144068]: [pid: 144068|app: 0|req: 178/352] 10.222.0.42 () {56 vars in 1186 bytes} [Thu Jul 28 08:11:25 2022] GET /identity/v3/projects/49167073baf644459c58534448b0037f => generated 298 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:11:25.479910 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca279aa-0393-4f65-8c3a-6f6e8b90ccb3 None admin] Authenticating user token {{(pid=144068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:11:25.596714 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ebaac31-d290-4e5e-980c-942177ece3cc None admin] Validating token access rules against request {{(pid=144067) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:11:25.626367 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca279aa-0393-4f65-8c3a-6f6e8b90ccb3 None admin] Validating token access rules against request {{(pid=144068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:11:25.643728 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f731c240-3eb2-4fd1-b462-0633a6e4bd44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144067) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:11:25.644420 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f731c240-3eb2-4fd1-b462-0633a6e4bd44 None admin] REQUEST_METHOD: `GET` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:11:25.644801 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f731c240-3eb2-4fd1-b462-0633a6e4bd44 None admin] SCRIPT_NAME: `/identity` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:11:25.645036 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f731c240-3eb2-4fd1-b462-0633a6e4bd44 None admin] PATH_INFO: `/v3/groups/cfc51bfe26d54218b5109575a2ff2a46` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:11:25.652225 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f731c240-3eb2-4fd1-b462-0633a6e4bd44 None admin] RBAC: Authorizing `identity:get_group(group_id=cfc51bfe26d54218b5109575a2ff2a46)` {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:11:25.653754 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f731c240-3eb2-4fd1-b462-0633a6e4bd44 None admin] RBAC: Authorization granted {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:11:25.655686 dv-cinder-851351-1-smb devstack@keystone.service[144067]: [pid: 144067|app: 0|req: 175/353] 10.222.0.42 () {56 vars in 1180 bytes} [Thu Jul 28 08:11:25 2022] GET /identity/v3/groups/cfc51bfe26d54218b5109575a2ff2a46 => generated 226 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:11:25.656773 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f731c240-3eb2-4fd1-b462-0633a6e4bd44 None admin] Authenticating user token {{(pid=144067) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:11:25.675043 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16b9303-1d4f-4c6f-803b-1c3cac0c32bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:11:25.676116 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16b9303-1d4f-4c6f-803b-1c3cac0c32bf None admin] REQUEST_METHOD: `GET` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:11:25.676625 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16b9303-1d4f-4c6f-803b-1c3cac0c32bf None admin] SCRIPT_NAME: `/identity` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:11:25.677129 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16b9303-1d4f-4c6f-803b-1c3cac0c32bf None admin] PATH_INFO: `/v3/roles/reader` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:11:25.680828 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG dbcounter [-] [144068] Writing DB stats keystone:SELECT=100 {{(pid=144068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:11:25.694529 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e16b9303-1d4f-4c6f-803b-1c3cac0c32bf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 08:11:25.699671 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application [None req-e16b9303-1d4f-4c6f-803b-1c3cac0c32bf None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 28 08:11:25.699671 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:11:25.699671 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:11:25.699671 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:11:25.699671 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:11:25.699671 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:11:25.699671 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:11:25.699671 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:11:25.699671 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:11:25.699671 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:11:25.699671 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:11:25.699671 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:11:25.699671 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 08:11:25.699671 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 08:11:25.699671 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 08:11:25.699671 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 08:11:25.701911 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 08:11:25.701911 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 08:11:25.701911 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 08:11:25.701911 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 08:11:25.701911 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:11:25.701911 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:11:25.701911 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:11:25.701911 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:11:25.701911 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:11:25.701911 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:11:25.701911 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:11:25.701911 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application with Lock( Jul 28 08:11:25.701911 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:11:25.701911 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:11:25.701911 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:11:25.701911 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:11:25.703036 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:11:25.703036 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:11:25.703036 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:11:25.703036 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:11:25.703036 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 08:11:25.703036 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 08:11:25.703036 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 08:11:25.703036 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 08:11:25.703036 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 08:11:25.703036 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 08:11:25.703036 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 28 08:11:25.703036 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application Jul 28 08:11:25.703036 dv-cinder-851351-1-smb devstack@keystone.service[144068]: [pid: 144068|app: 0|req: 179/354] 10.222.0.42 () {56 vars in 1099 bytes} [Thu Jul 28 08:11:25 2022] GET /identity/v3/roles/reader => generated 84 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:11:25.703036 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16b9303-1d4f-4c6f-803b-1c3cac0c32bf None admin] Authenticating user token {{(pid=144068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:11:25.708332 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG dbcounter [-] [144067] Writing DB stats keystone:SELECT=100 {{(pid=144067) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:11:25.813258 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f731c240-3eb2-4fd1-b462-0633a6e4bd44 None admin] Validating token access rules against request {{(pid=144067) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:11:25.842316 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16b9303-1d4f-4c6f-803b-1c3cac0c32bf None admin] Validating token access rules against request {{(pid=144068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:11:25.857232 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b8eb60-1fad-419d-a818-8ff4d9cebfcc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144067) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:11:25.857801 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b8eb60-1fad-419d-a818-8ff4d9cebfcc None admin] REQUEST_METHOD: `GET` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:11:25.858085 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b8eb60-1fad-419d-a818-8ff4d9cebfcc None admin] SCRIPT_NAME: `/identity` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:11:25.858364 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b8eb60-1fad-419d-a818-8ff4d9cebfcc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:11:25.889710 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f80b02c5-9d75-479b-a034-048a160c4017 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:11:25.890377 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80b02c5-9d75-479b-a034-048a160c4017 None admin] REQUEST_METHOD: `GET` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:11:25.890718 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80b02c5-9d75-479b-a034-048a160c4017 None admin] SCRIPT_NAME: `/identity` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:11:25.890930 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80b02c5-9d75-479b-a034-048a160c4017 None admin] PATH_INFO: `/v3/groups/cfc51bfe26d54218b5109575a2ff2a46` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:11:25.892834 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f80b02c5-9d75-479b-a034-048a160c4017 None admin] RBAC: Authorizing `identity:get_group(group_id=cfc51bfe26d54218b5109575a2ff2a46)` {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:11:25.893599 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f80b02c5-9d75-479b-a034-048a160c4017 None admin] RBAC: Authorization granted {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:11:25.895376 dv-cinder-851351-1-smb devstack@keystone.service[144068]: [pid: 144068|app: 0|req: 180/355] 10.222.0.42 () {56 vars in 1180 bytes} [Thu Jul 28 08:11:25 2022] GET /identity/v3/groups/cfc51bfe26d54218b5109575a2ff2a46 => generated 226 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:11:25.896541 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc24111-e8ba-4fdb-820a-6f4eae75b6a8 None None] REQUEST_METHOD: `GET` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:11:25.896868 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc24111-e8ba-4fdb-820a-6f4eae75b6a8 None None] SCRIPT_NAME: `/identity` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:11:25.897158 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc24111-e8ba-4fdb-820a-6f4eae75b6a8 None None] PATH_INFO: `/` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:11:25.898629 dv-cinder-851351-1-smb devstack@keystone.service[144068]: [pid: 144068|app: 0|req: 181/356] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 08:11:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 08:11:25.899337 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc24111-e8ba-4fdb-820a-6f4eae75b6a8 None None] Authenticating user token {{(pid=144068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:11:25.951076 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90b8eb60-1fad-419d-a818-8ff4d9cebfcc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:11:25.953791 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90b8eb60-1fad-419d-a818-8ff4d9cebfcc None admin] RBAC: Authorization granted {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:11:25.994252 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG dbcounter [-] [144068] Writing DB stats keystone:SELECT=100 {{(pid=144068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:11:25.994423 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG dbcounter [-] [144067] Writing DB stats keystone:SELECT=100 {{(pid=144067) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:11:26.046423 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc24111-e8ba-4fdb-820a-6f4eae75b6a8 None None] Validating token access rules against request {{(pid=144068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:11:26.088569 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff02b94a-ce5f-4b5f-bfe0-83a690bbaadb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:11:26.089259 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff02b94a-ce5f-4b5f-bfe0-83a690bbaadb None admin] REQUEST_METHOD: `GET` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:11:26.089542 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff02b94a-ce5f-4b5f-bfe0-83a690bbaadb None admin] SCRIPT_NAME: `/identity` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:11:26.090931 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff02b94a-ce5f-4b5f-bfe0-83a690bbaadb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:11:26.090931 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff02b94a-ce5f-4b5f-bfe0-83a690bbaadb None admin] RBAC: Adding query filter params (group.id=cfc51bfe26d54218b5109575a2ff2a46, role.id=6933b60756fe46dd8f27854f5e192061, scope.project.id=49167073baf644459c58534448b0037f) {{(pid=144068) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:11:26.090931 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff02b94a-ce5f-4b5f-bfe0-83a690bbaadb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:11:26.091203 dv-cinder-851351-1-smb devstack@keystone.service[144067]: [pid: 144067|app: 0|req: 176/357] 10.222.0.42 () {58 vars in 1282 bytes} [Thu Jul 28 08:11:25 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 435 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 28 08:11:26.092117 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b8eb60-1fad-419d-a818-8ff4d9cebfcc None admin] Authenticating user token {{(pid=144067) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:11:26.092386 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff02b94a-ce5f-4b5f-bfe0-83a690bbaadb None admin] RBAC: Authorization granted {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:11:26.099496 dv-cinder-851351-1-smb devstack@keystone.service[144068]: [pid: 144068|app: 0|req: 182/358] 10.222.0.42 () {56 vars in 1376 bytes} [Thu Jul 28 08:11:25 2022] GET /identity/v3/role_assignments?group.id=cfc51bfe26d54218b5109575a2ff2a46&scope.project.id=49167073baf644459c58534448b0037f&role.id=6933b60756fe46dd8f27854f5e192061 => generated 260 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:11:26.100195 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff02b94a-ce5f-4b5f-bfe0-83a690bbaadb None admin] Authenticating user token {{(pid=144068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:11:26.240950 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff02b94a-ce5f-4b5f-bfe0-83a690bbaadb None admin] Validating token access rules against request {{(pid=144068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:11:26.242844 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b8eb60-1fad-419d-a818-8ff4d9cebfcc None admin] Validating token access rules against request {{(pid=144067) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:11:26.276440 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG dbcounter [-] [144068] Writing DB stats keystone:SELECT=100 {{(pid=144068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:11:26.285706 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG dbcounter [-] [144067] Writing DB stats keystone:SELECT=100 {{(pid=144067) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:11:26.290135 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf04ba6b-8bb4-4acb-83d8-a1eae5bc0b24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:11:26.290703 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf04ba6b-8bb4-4acb-83d8-a1eae5bc0b24 None admin] REQUEST_METHOD: `GET` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:11:26.290991 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf04ba6b-8bb4-4acb-83d8-a1eae5bc0b24 None admin] SCRIPT_NAME: `/identity` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:11:26.291311 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf04ba6b-8bb4-4acb-83d8-a1eae5bc0b24 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:11:26.292096 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf04ba6b-8bb4-4acb-83d8-a1eae5bc0b24 None admin] RBAC: Adding query filter params (group.id=cfc51bfe26d54218b5109575a2ff2a46, role.id=7e9c2306137042cf8b8eba284656ef33, scope.project.id=49167073baf644459c58534448b0037f) {{(pid=144068) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:11:26.292410 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf04ba6b-8bb4-4acb-83d8-a1eae5bc0b24 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:11:26.293976 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf04ba6b-8bb4-4acb-83d8-a1eae5bc0b24 None admin] RBAC: Authorization granted {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:11:26.301231 dv-cinder-851351-1-smb devstack@keystone.service[144068]: [pid: 144068|app: 0|req: 183/359] 10.222.0.42 () {56 vars in 1376 bytes} [Thu Jul 28 08:11:26 2022] GET /identity/v3/role_assignments?group.id=cfc51bfe26d54218b5109575a2ff2a46&scope.project.id=49167073baf644459c58534448b0037f&role.id=7e9c2306137042cf8b8eba284656ef33 => generated 260 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:11:26.301866 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3bfeae-34d5-456f-9e8e-a67d9132e26f None None] REQUEST_METHOD: `POST` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:11:26.302155 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3bfeae-34d5-456f-9e8e-a67d9132e26f None None] SCRIPT_NAME: `/identity` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:11:26.302434 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3bfeae-34d5-456f-9e8e-a67d9132e26f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:11:26.302971 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-118789ee-d9a4-492a-be51-02ce734c24f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144067) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:11:26.303875 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118789ee-d9a4-492a-be51-02ce734c24f5 None admin] REQUEST_METHOD: `GET` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:11:26.304393 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118789ee-d9a4-492a-be51-02ce734c24f5 None admin] SCRIPT_NAME: `/identity` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:11:26.304909 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118789ee-d9a4-492a-be51-02ce734c24f5 None admin] PATH_INFO: `/v3/roles` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:11:26.306044 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-118789ee-d9a4-492a-be51-02ce734c24f5 None admin] RBAC: Adding query filter params (name=reader) {{(pid=144067) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:11:26.306637 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-118789ee-d9a4-492a-be51-02ce734c24f5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:11:26.308441 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-118789ee-d9a4-492a-be51-02ce734c24f5 None admin] RBAC: Authorization granted {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:11:26.322614 dv-cinder-851351-1-smb devstack@keystone.service[144067]: [pid: 144067|app: 0|req: 177/360] 10.222.0.42 () {56 vars in 1101 bytes} [Thu Jul 28 08:11:26 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:11:26.324485 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55925cb-ecdd-4d42-a7d3-665b6f0c9880 None None] REQUEST_METHOD: `GET` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:11:26.325099 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55925cb-ecdd-4d42-a7d3-665b6f0c9880 None None] SCRIPT_NAME: `/identity` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:11:26.325690 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55925cb-ecdd-4d42-a7d3-665b6f0c9880 None None] PATH_INFO: `/` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:11:26.326523 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.auth.core [None req-5d3bfeae-34d5-456f-9e8e-a67d9132e26f None None] MFA Rules not processed for user `bf5ceb8f07374635ad506b7d1b4f1612`. Rule list: `[]` (Enabled: `True`). {{(pid=144068) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 08:11:26.327930 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.fernet_utils [None req-5d3bfeae-34d5-456f-9e8e-a67d9132e26f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=144068) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:11:26.328171 dv-cinder-851351-1-smb devstack@keystone.service[144067]: [pid: 144067|app: 0|req: 178/361] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 08:11:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 08:11:26.332747 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b55925cb-ecdd-4d42-a7d3-665b6f0c9880 None None] Authenticating user token {{(pid=144067) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:11:26.432900 dv-cinder-851351-1-smb devstack@keystone.service[144068]: [pid: 144068|app: 0|req: 184/362] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 08:11:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 08:11:26.434223 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d3bfeae-34d5-456f-9e8e-a67d9132e26f None None] Authenticating user token {{(pid=144068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:11:26.471904 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b55925cb-ecdd-4d42-a7d3-665b6f0c9880 None None] Validating token access rules against request {{(pid=144067) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:11:26.531626 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d1b044-66f5-4f8c-b74f-e294cf2391d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144067) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:11:26.532224 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d1b044-66f5-4f8c-b74f-e294cf2391d6 None admin] REQUEST_METHOD: `GET` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:11:26.532505 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d1b044-66f5-4f8c-b74f-e294cf2391d6 None admin] SCRIPT_NAME: `/identity` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:11:26.533653 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d1b044-66f5-4f8c-b74f-e294cf2391d6 None admin] PATH_INFO: `/v3/projects/2c58e7ea67d84cf692dd9eb3f6cb73a0` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:11:26.534879 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0d1b044-66f5-4f8c-b74f-e294cf2391d6 None admin] RBAC: Authorizing `identity:get_project(project_id=2c58e7ea67d84cf692dd9eb3f6cb73a0)` {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:11:26.536484 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0d1b044-66f5-4f8c-b74f-e294cf2391d6 None admin] RBAC: Authorization granted {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:11:26.538252 dv-cinder-851351-1-smb devstack@keystone.service[144067]: [pid: 144067|app: 0|req: 179/363] 10.222.0.42 () {56 vars in 1186 bytes} [Thu Jul 28 08:11:26 2022] GET /identity/v3/projects/2c58e7ea67d84cf692dd9eb3f6cb73a0 => generated 302 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:11:26.539553 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86da780-f390-4742-9f9f-c6920c81848d None None] REQUEST_METHOD: `POST` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:11:26.539843 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86da780-f390-4742-9f9f-c6920c81848d None None] SCRIPT_NAME: `/identity` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:11:26.540120 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86da780-f390-4742-9f9f-c6920c81848d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:11:26.578591 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d3bfeae-34d5-456f-9e8e-a67d9132e26f None None] Validating token access rules against request {{(pid=144068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:11:26.584408 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.auth.core [None req-d86da780-f390-4742-9f9f-c6920c81848d None None] MFA Rules not processed for user `bf5ceb8f07374635ad506b7d1b4f1612`. Rule list: `[]` (Enabled: `True`). {{(pid=144067) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 08:11:26.586058 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.fernet_utils [None req-d86da780-f390-4742-9f9f-c6920c81848d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=144067) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:11:26.610973 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG dbcounter [-] [144068] Writing DB stats keystone:SELECT=100 {{(pid=144068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:11:26.627899 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa5997b-e820-49e0-bfae-60139eb81af9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:11:26.629250 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa5997b-e820-49e0-bfae-60139eb81af9 None admin] REQUEST_METHOD: `GET` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:11:26.629793 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa5997b-e820-49e0-bfae-60139eb81af9 None admin] SCRIPT_NAME: `/identity` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:11:26.630133 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa5997b-e820-49e0-bfae-60139eb81af9 None admin] PATH_INFO: `/v3/users/7a6afc76ee0a43d8acf0eb5cdddf840f` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:11:26.631712 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfa5997b-e820-49e0-bfae-60139eb81af9 None admin] RBAC: Authorizing `identity:get_user(user_id=7a6afc76ee0a43d8acf0eb5cdddf840f)` {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:11:26.634275 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfa5997b-e820-49e0-bfae-60139eb81af9 None admin] RBAC: Authorization granted {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:11:26.636408 dv-cinder-851351-1-smb devstack@keystone.service[144068]: [pid: 144068|app: 0|req: 185/364] 10.222.0.42 () {56 vars in 1177 bytes} [Thu Jul 28 08:11:26 2022] GET /identity/v3/users/7a6afc76ee0a43d8acf0eb5cdddf840f => generated 293 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:11:26.637330 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa5997b-e820-49e0-bfae-60139eb81af9 None admin] Authenticating user token {{(pid=144068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:11:26.657783 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG dbcounter [-] [144067] Writing DB stats keystone:SELECT=100 {{(pid=144067) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:11:26.675656 dv-cinder-851351-1-smb devstack@keystone.service[144067]: [pid: 144067|app: 0|req: 180/365] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 08:11:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 08:11:26.681679 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d86da780-f390-4742-9f9f-c6920c81848d None None] Authenticating user token {{(pid=144067) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:11:26.780706 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa5997b-e820-49e0-bfae-60139eb81af9 None admin] Validating token access rules against request {{(pid=144068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:11:26.826742 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d86da780-f390-4742-9f9f-c6920c81848d None None] Validating token access rules against request {{(pid=144067) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:11:26.831021 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629d7575-0b73-4ca6-8637-d19d9b615351 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:11:26.831718 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629d7575-0b73-4ca6-8637-d19d9b615351 None admin] REQUEST_METHOD: `GET` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:11:26.831998 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629d7575-0b73-4ca6-8637-d19d9b615351 None admin] SCRIPT_NAME: `/identity` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:11:26.832326 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629d7575-0b73-4ca6-8637-d19d9b615351 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:11:26.844702 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-629d7575-0b73-4ca6-8637-d19d9b615351 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 08:11:26.850846 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application [None req-629d7575-0b73-4ca6-8637-d19d9b615351 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 28 08:11:26.850846 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:11:26.850846 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:11:26.850846 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:11:26.850846 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:11:26.850846 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:11:26.850846 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:11:26.850846 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:11:26.850846 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:11:26.850846 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:11:26.850846 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:11:26.850846 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:11:26.850846 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 08:11:26.850846 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 08:11:26.850846 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 08:11:26.850846 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 08:11:26.852016 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 08:11:26.852016 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 08:11:26.852016 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 08:11:26.852016 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 08:11:26.852016 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:11:26.852016 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:11:26.852016 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:11:26.852016 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:11:26.852016 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:11:26.852016 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:11:26.852016 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:11:26.852016 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application with Lock( Jul 28 08:11:26.852016 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:11:26.852016 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:11:26.852016 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:11:26.852016 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:11:26.853801 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:11:26.853801 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:11:26.853801 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:11:26.853801 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:11:26.853801 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 08:11:26.853801 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 08:11:26.853801 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 08:11:26.853801 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 08:11:26.853801 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 08:11:26.853801 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 08:11:26.853801 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 28 08:11:26.853801 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application Jul 28 08:11:26.853801 dv-cinder-851351-1-smb devstack@keystone.service[144068]: [pid: 144068|app: 0|req: 186/366] 10.222.0.42 () {56 vars in 1114 bytes} [Thu Jul 28 08:11:26 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:11:26.853801 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629d7575-0b73-4ca6-8637-d19d9b615351 None admin] Authenticating user token {{(pid=144068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:11:26.872940 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef24a29-1624-4964-8316-9d979f88cc6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144067) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:11:26.873921 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef24a29-1624-4964-8316-9d979f88cc6b None admin] REQUEST_METHOD: `GET` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:11:26.874206 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef24a29-1624-4964-8316-9d979f88cc6b None admin] SCRIPT_NAME: `/identity` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:11:26.874492 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef24a29-1624-4964-8316-9d979f88cc6b None admin] PATH_INFO: `/v3/groups/cfc51bfe26d54218b5109575a2ff2a46` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:11:26.876317 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aef24a29-1624-4964-8316-9d979f88cc6b None admin] RBAC: Authorizing `identity:get_group(group_id=cfc51bfe26d54218b5109575a2ff2a46)` {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:11:26.877889 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aef24a29-1624-4964-8316-9d979f88cc6b None admin] RBAC: Authorization granted {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:11:26.880006 dv-cinder-851351-1-smb devstack@keystone.service[144067]: [pid: 144067|app: 0|req: 181/367] 10.222.0.42 () {56 vars in 1180 bytes} [Thu Jul 28 08:11:26 2022] GET /identity/v3/groups/cfc51bfe26d54218b5109575a2ff2a46 => generated 226 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:11:26.880871 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef24a29-1624-4964-8316-9d979f88cc6b None admin] Authenticating user token {{(pid=144067) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:11:26.922001 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG dbcounter [-] [144068] Writing DB stats keystone:SELECT=100 {{(pid=144068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:11:26.962525 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG dbcounter [-] [144067] Writing DB stats keystone:SELECT=100 {{(pid=144067) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:11:26.984863 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629d7575-0b73-4ca6-8637-d19d9b615351 None admin] Validating token access rules against request {{(pid=144068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:11:27.021339 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef24a29-1624-4964-8316-9d979f88cc6b None admin] Validating token access rules against request {{(pid=144067) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:11:27.031504 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d92ec3b-cb3a-4340-a48e-97c77b11d471 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:11:27.032158 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d92ec3b-cb3a-4340-a48e-97c77b11d471 None admin] REQUEST_METHOD: `GET` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:11:27.032445 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d92ec3b-cb3a-4340-a48e-97c77b11d471 None admin] SCRIPT_NAME: `/identity` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:11:27.033153 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d92ec3b-cb3a-4340-a48e-97c77b11d471 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:11:27.033997 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d92ec3b-cb3a-4340-a48e-97c77b11d471 None admin] RBAC: Adding query filter params (role.id=aac18bff164441838e5b7d98f770be5e, user.id=7a6afc76ee0a43d8acf0eb5cdddf840f, scope.system=all) {{(pid=144068) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:11:27.034631 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d92ec3b-cb3a-4340-a48e-97c77b11d471 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:11:27.037116 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d92ec3b-cb3a-4340-a48e-97c77b11d471 None admin] RBAC: Authorization granted {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:11:27.052463 dv-cinder-851351-1-smb devstack@keystone.service[144068]: [pid: 144068|app: 0|req: 187/368] 10.222.0.42 () {56 vars in 1308 bytes} [Thu Jul 28 08:11:26 2022] GET /identity/v3/role_assignments?user.id=7a6afc76ee0a43d8acf0eb5cdddf840f&scope.system=all&role.id=aac18bff164441838e5b7d98f770be5e => generated 510 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:11:27.053396 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d92ec3b-cb3a-4340-a48e-97c77b11d471 None admin] Authenticating user token {{(pid=144068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:11:27.061071 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d771c73-6918-442d-93e1-3287d67ccda4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144067) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:11:27.061764 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d771c73-6918-442d-93e1-3287d67ccda4 None admin] REQUEST_METHOD: `GET` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:11:27.062047 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d771c73-6918-442d-93e1-3287d67ccda4 None admin] SCRIPT_NAME: `/identity` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:11:27.062325 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d771c73-6918-442d-93e1-3287d67ccda4 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:11:27.076025 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d771c73-6918-442d-93e1-3287d67ccda4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 08:11:27.081538 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application [None req-6d771c73-6918-442d-93e1-3287d67ccda4 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 08:11:27.081538 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:11:27.081538 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:11:27.081538 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:11:27.081538 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:11:27.081538 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:11:27.081538 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:11:27.081538 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:11:27.081538 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:11:27.081538 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:11:27.081538 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:11:27.081538 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:11:27.081538 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 08:11:27.081538 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 08:11:27.081538 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 08:11:27.081538 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 08:11:27.082656 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 08:11:27.082656 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 08:11:27.082656 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 08:11:27.082656 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 08:11:27.082656 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:11:27.082656 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:11:27.082656 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:11:27.082656 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:11:27.082656 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:11:27.082656 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:11:27.082656 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:11:27.082656 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application with Lock( Jul 28 08:11:27.082656 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:11:27.082656 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:11:27.082656 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:11:27.082656 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:11:27.084886 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:11:27.084886 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:11:27.084886 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:11:27.084886 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:11:27.084886 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 08:11:27.084886 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 08:11:27.084886 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 08:11:27.084886 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 08:11:27.084886 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 08:11:27.084886 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 08:11:27.084886 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 08:11:27.084886 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application Jul 28 08:11:27.084886 dv-cinder-851351-1-smb devstack@keystone.service[144067]: [pid: 144067|app: 0|req: 182/369] 10.222.0.42 () {56 vars in 1096 bytes} [Thu Jul 28 08:11:26 2022] GET /identity/v3/roles/admin => generated 83 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:11:27.084886 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d771c73-6918-442d-93e1-3287d67ccda4 None admin] Authenticating user token {{(pid=144067) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:11:27.199981 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d92ec3b-cb3a-4340-a48e-97c77b11d471 None admin] Validating token access rules against request {{(pid=144068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:11:27.206615 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d771c73-6918-442d-93e1-3287d67ccda4 None admin] Validating token access rules against request {{(pid=144067) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:11:27.229119 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG dbcounter [-] [144068] Writing DB stats keystone:SELECT=100 {{(pid=144068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:11:27.232649 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG dbcounter [-] [144067] Writing DB stats keystone:SELECT=100 {{(pid=144067) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:11:27.256102 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c31305-427b-4af0-b533-bb65a590bc77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144067) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:11:27.256795 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c31305-427b-4af0-b533-bb65a590bc77 None admin] REQUEST_METHOD: `GET` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:11:27.257087 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c31305-427b-4af0-b533-bb65a590bc77 None admin] SCRIPT_NAME: `/identity` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:11:27.257365 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c31305-427b-4af0-b533-bb65a590bc77 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:11:27.258205 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27c31305-427b-4af0-b533-bb65a590bc77 None admin] RBAC: Adding query filter params (group.id=cfc51bfe26d54218b5109575a2ff2a46, role.id=6933b60756fe46dd8f27854f5e192061, scope.project.id=2c58e7ea67d84cf692dd9eb3f6cb73a0) {{(pid=144067) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:11:27.258524 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27c31305-427b-4af0-b533-bb65a590bc77 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:11:27.260068 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27c31305-427b-4af0-b533-bb65a590bc77 None admin] RBAC: Authorization granted {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:11:27.262636 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050cd91b-e7ba-4db7-b714-4b5d7284bb1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:11:27.263303 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050cd91b-e7ba-4db7-b714-4b5d7284bb1c None admin] REQUEST_METHOD: `GET` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:11:27.263741 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050cd91b-e7ba-4db7-b714-4b5d7284bb1c None admin] SCRIPT_NAME: `/identity` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:11:27.264026 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050cd91b-e7ba-4db7-b714-4b5d7284bb1c None admin] PATH_INFO: `/v3/roles` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:11:27.264810 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-050cd91b-e7ba-4db7-b714-4b5d7284bb1c None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=144068) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:11:27.265128 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-050cd91b-e7ba-4db7-b714-4b5d7284bb1c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:11:27.266557 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-050cd91b-e7ba-4db7-b714-4b5d7284bb1c None admin] RBAC: Authorization granted {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:11:27.266685 dv-cinder-851351-1-smb devstack@keystone.service[144067]: [pid: 144067|app: 0|req: 183/370] 10.222.0.42 () {56 vars in 1376 bytes} [Thu Jul 28 08:11:27 2022] GET /identity/v3/role_assignments?group.id=cfc51bfe26d54218b5109575a2ff2a46&scope.project.id=2c58e7ea67d84cf692dd9eb3f6cb73a0&role.id=6933b60756fe46dd8f27854f5e192061 => generated 260 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:11:27.267517 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c31305-427b-4af0-b533-bb65a590bc77 None admin] Authenticating user token {{(pid=144067) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:11:27.281187 dv-cinder-851351-1-smb devstack@keystone.service[144068]: [pid: 144068|app: 0|req: 188/371] 10.222.0.42 () {56 vars in 1111 bytes} [Thu Jul 28 08:11:27 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:11:27.286958 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050cd91b-e7ba-4db7-b714-4b5d7284bb1c None admin] Authenticating user token {{(pid=144068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:11:27.439186 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050cd91b-e7ba-4db7-b714-4b5d7284bb1c None admin] Validating token access rules against request {{(pid=144068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:11:27.459707 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c31305-427b-4af0-b533-bb65a590bc77 None admin] Validating token access rules against request {{(pid=144067) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:11:27.482905 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ef0888-672a-45d2-8eab-50452491c29d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:11:27.483942 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ef0888-672a-45d2-8eab-50452491c29d None admin] REQUEST_METHOD: `GET` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:11:27.484439 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ef0888-672a-45d2-8eab-50452491c29d None admin] SCRIPT_NAME: `/identity` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:11:27.485089 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ef0888-672a-45d2-8eab-50452491c29d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:11:27.534858 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ef399e-2b88-4d54-bd96-0524825fc7f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144067) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:11:27.535974 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ef399e-2b88-4d54-bd96-0524825fc7f6 None admin] REQUEST_METHOD: `GET` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:11:27.536458 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ef399e-2b88-4d54-bd96-0524825fc7f6 None admin] SCRIPT_NAME: `/identity` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:11:27.537873 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ef399e-2b88-4d54-bd96-0524825fc7f6 None admin] PATH_INFO: `/v3/roles` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:11:27.538874 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7ef399e-2b88-4d54-bd96-0524825fc7f6 None admin] RBAC: Adding query filter params (name=admin) {{(pid=144067) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:11:27.540158 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7ef399e-2b88-4d54-bd96-0524825fc7f6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:11:27.541883 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7ef399e-2b88-4d54-bd96-0524825fc7f6 None admin] RBAC: Authorization granted {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:11:27.556739 dv-cinder-851351-1-smb devstack@keystone.service[144067]: [pid: 144067|app: 0|req: 184/372] 10.222.0.42 () {56 vars in 1099 bytes} [Thu Jul 28 08:11:27 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 289 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:11:27.558323 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG dbcounter [-] [144068] Writing DB stats keystone:SELECT=100 {{(pid=144068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:11:27.562808 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ef399e-2b88-4d54-bd96-0524825fc7f6 None admin] Authenticating user token {{(pid=144067) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:11:27.601273 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00ef0888-672a-45d2-8eab-50452491c29d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:11:27.602809 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00ef0888-672a-45d2-8eab-50452491c29d None admin] RBAC: Authorization granted {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:11:27.627251 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG dbcounter [-] [144067] Writing DB stats keystone:SELECT=100 {{(pid=144067) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:11:27.713440 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ef399e-2b88-4d54-bd96-0524825fc7f6 None admin] Validating token access rules against request {{(pid=144067) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:11:27.732651 dv-cinder-851351-1-smb devstack@keystone.service[144068]: [pid: 144068|app: 0|req: 189/373] 10.222.0.42 () {58 vars in 1282 bytes} [Thu Jul 28 08:11:27 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 446 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 28 08:11:27.739297 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ef0888-672a-45d2-8eab-50452491c29d None admin] Authenticating user token {{(pid=144068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:11:27.786210 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e72a40-303b-48f6-8fc6-f9e566a9a5b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144067) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:11:27.786875 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e72a40-303b-48f6-8fc6-f9e566a9a5b2 None admin] REQUEST_METHOD: `GET` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:11:27.787160 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e72a40-303b-48f6-8fc6-f9e566a9a5b2 None admin] SCRIPT_NAME: `/identity` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:11:27.787439 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e72a40-303b-48f6-8fc6-f9e566a9a5b2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:11:27.869029 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG dbcounter [-] [144068] Writing DB stats keystone:SELECT=100 {{(pid=144068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:11:27.912138 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ef0888-672a-45d2-8eab-50452491c29d None admin] Validating token access rules against request {{(pid=144068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:11:27.933170 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e72a40-303b-48f6-8fc6-f9e566a9a5b2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:11:27.935402 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e72a40-303b-48f6-8fc6-f9e566a9a5b2 None admin] RBAC: Authorization granted {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:11:27.977500 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5cf6fd2-1136-45a0-bd08-504e679f2948 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:11:27.978541 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5cf6fd2-1136-45a0-bd08-504e679f2948 None admin] REQUEST_METHOD: `GET` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:11:27.979060 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5cf6fd2-1136-45a0-bd08-504e679f2948 None admin] SCRIPT_NAME: `/identity` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:11:27.979551 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5cf6fd2-1136-45a0-bd08-504e679f2948 None admin] PATH_INFO: `/v3/projects/2c58e7ea67d84cf692dd9eb3f6cb73a0` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:11:27.981094 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5cf6fd2-1136-45a0-bd08-504e679f2948 None admin] RBAC: Authorizing `identity:get_project(project_id=2c58e7ea67d84cf692dd9eb3f6cb73a0)` {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:11:27.983705 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5cf6fd2-1136-45a0-bd08-504e679f2948 None admin] RBAC: Authorization granted {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:11:27.986192 dv-cinder-851351-1-smb devstack@keystone.service[144068]: [pid: 144068|app: 0|req: 190/374] 10.222.0.42 () {56 vars in 1186 bytes} [Thu Jul 28 08:11:27 2022] GET /identity/v3/projects/2c58e7ea67d84cf692dd9eb3f6cb73a0 => generated 302 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 08:11:27.991466 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5cf6fd2-1136-45a0-bd08-504e679f2948 None admin] Authenticating user token {{(pid=144068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:11:28.025739 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG dbcounter [-] [144067] Writing DB stats keystone:SELECT=100 {{(pid=144067) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:11:28.133812 dv-cinder-851351-1-smb devstack@keystone.service[144067]: [pid: 144067|app: 0|req: 185/375] 10.222.0.42 () {58 vars in 1282 bytes} [Thu Jul 28 08:11:27 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 571 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 28 08:11:28.139075 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e72a40-303b-48f6-8fc6-f9e566a9a5b2 None admin] Authenticating user token {{(pid=144067) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:11:28.182291 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5cf6fd2-1136-45a0-bd08-504e679f2948 None admin] Validating token access rules against request {{(pid=144068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:11:28.247221 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8c221e-edd7-44e3-a26c-2710a0c64b39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:11:28.247809 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8c221e-edd7-44e3-a26c-2710a0c64b39 None admin] REQUEST_METHOD: `GET` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:11:28.248091 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8c221e-edd7-44e3-a26c-2710a0c64b39 None admin] SCRIPT_NAME: `/identity` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:11:28.248367 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8c221e-edd7-44e3-a26c-2710a0c64b39 None admin] PATH_INFO: `/v3/groups/cfc51bfe26d54218b5109575a2ff2a46` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:11:28.250319 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d8c221e-edd7-44e3-a26c-2710a0c64b39 None admin] RBAC: Authorizing `identity:get_group(group_id=cfc51bfe26d54218b5109575a2ff2a46)` {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:11:28.251784 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d8c221e-edd7-44e3-a26c-2710a0c64b39 None admin] RBAC: Authorization granted {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:11:28.254199 dv-cinder-851351-1-smb devstack@keystone.service[144068]: [pid: 144068|app: 0|req: 191/376] 10.222.0.42 () {56 vars in 1180 bytes} [Thu Jul 28 08:11:27 2022] GET /identity/v3/groups/cfc51bfe26d54218b5109575a2ff2a46 => generated 226 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 08:11:28.260703 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8c221e-edd7-44e3-a26c-2710a0c64b39 None admin] Authenticating user token {{(pid=144068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:11:28.277039 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG dbcounter [-] [144068] Writing DB stats keystone:SELECT=100 {{(pid=144068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:11:28.320815 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e72a40-303b-48f6-8fc6-f9e566a9a5b2 None admin] Validating token access rules against request {{(pid=144067) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:11:28.396428 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d651da5-47c8-4a77-8175-46cb47c3738f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144067) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:11:28.398412 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d651da5-47c8-4a77-8175-46cb47c3738f None admin] REQUEST_METHOD: `GET` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:11:28.399105 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d651da5-47c8-4a77-8175-46cb47c3738f None admin] SCRIPT_NAME: `/identity` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:11:28.400975 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d651da5-47c8-4a77-8175-46cb47c3738f None admin] PATH_INFO: `/v3/projects/3fae06d52d2d4b66af2858bdd1a0fbc7` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:11:28.403486 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d651da5-47c8-4a77-8175-46cb47c3738f None admin] RBAC: Authorizing `identity:get_project(project_id=3fae06d52d2d4b66af2858bdd1a0fbc7)` {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:11:28.408381 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d651da5-47c8-4a77-8175-46cb47c3738f None admin] RBAC: Authorization granted {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:11:28.412310 dv-cinder-851351-1-smb devstack@keystone.service[144067]: [pid: 144067|app: 0|req: 186/377] 10.222.0.42 () {56 vars in 1186 bytes} [Thu Jul 28 08:11:28 2022] GET /identity/v3/projects/3fae06d52d2d4b66af2858bdd1a0fbc7 => generated 344 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 08:11:28.416234 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d651da5-47c8-4a77-8175-46cb47c3738f None admin] Authenticating user token {{(pid=144067) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:11:28.439189 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8c221e-edd7-44e3-a26c-2710a0c64b39 None admin] Validating token access rules against request {{(pid=144068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:11:28.444299 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG dbcounter [-] [144067] Writing DB stats keystone:SELECT=100 {{(pid=144067) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:11:28.489298 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-942b495a-7d37-42e5-8999-21ec2a23e9d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:11:28.490354 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942b495a-7d37-42e5-8999-21ec2a23e9d3 None admin] REQUEST_METHOD: `GET` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:11:28.491014 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942b495a-7d37-42e5-8999-21ec2a23e9d3 None admin] SCRIPT_NAME: `/identity` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:11:28.491515 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942b495a-7d37-42e5-8999-21ec2a23e9d3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:11:28.492526 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-942b495a-7d37-42e5-8999-21ec2a23e9d3 None admin] RBAC: Adding query filter params (group.id=cfc51bfe26d54218b5109575a2ff2a46, role.id=7e9c2306137042cf8b8eba284656ef33, scope.project.id=2c58e7ea67d84cf692dd9eb3f6cb73a0) {{(pid=144068) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:11:28.493263 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-942b495a-7d37-42e5-8999-21ec2a23e9d3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:11:28.496109 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-942b495a-7d37-42e5-8999-21ec2a23e9d3 None admin] RBAC: Authorization granted {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:11:28.510984 dv-cinder-851351-1-smb devstack@keystone.service[144068]: [pid: 144068|app: 0|req: 192/378] 10.222.0.42 () {56 vars in 1376 bytes} [Thu Jul 28 08:11:28 2022] GET /identity/v3/role_assignments?group.id=cfc51bfe26d54218b5109575a2ff2a46&scope.project.id=2c58e7ea67d84cf692dd9eb3f6cb73a0&role.id=7e9c2306137042cf8b8eba284656ef33 => generated 260 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:11:28.576376 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d651da5-47c8-4a77-8175-46cb47c3738f None admin] Validating token access rules against request {{(pid=144067) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:11:28.615898 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce080d9a-5341-4c78-83d1-6e9bfa57077c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144067) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:11:28.616999 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce080d9a-5341-4c78-83d1-6e9bfa57077c None admin] REQUEST_METHOD: `GET` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:11:28.617516 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce080d9a-5341-4c78-83d1-6e9bfa57077c None admin] SCRIPT_NAME: `/identity` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:11:28.618031 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce080d9a-5341-4c78-83d1-6e9bfa57077c None admin] PATH_INFO: `/v3/groups/c5a27b7b13aa4e1781357988ee30c5b9` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:11:28.624229 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce080d9a-5341-4c78-83d1-6e9bfa57077c None admin] RBAC: Authorizing `identity:get_group(group_id=c5a27b7b13aa4e1781357988ee30c5b9)` {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:11:28.626166 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce080d9a-5341-4c78-83d1-6e9bfa57077c None admin] RBAC: Authorization granted {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:11:28.628628 dv-cinder-851351-1-smb devstack@keystone.service[144067]: [pid: 144067|app: 0|req: 187/379] 10.222.0.42 () {56 vars in 1180 bytes} [Thu Jul 28 08:11:28 2022] GET /identity/v3/groups/c5a27b7b13aa4e1781357988ee30c5b9 => generated 229 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 08:11:28.637885 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-942b495a-7d37-42e5-8999-21ec2a23e9d3 None admin] Authenticating user token {{(pid=144068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:11:28.722332 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG dbcounter [-] [144068] Writing DB stats keystone:SELECT=100 {{(pid=144068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:11:28.766305 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-942b495a-7d37-42e5-8999-21ec2a23e9d3 None admin] Validating token access rules against request {{(pid=144068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:11:28.805445 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0257baf5-58e8-4be1-980a-7479ba72bae8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:11:28.806482 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0257baf5-58e8-4be1-980a-7479ba72bae8 None admin] REQUEST_METHOD: `GET` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:11:28.806987 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0257baf5-58e8-4be1-980a-7479ba72bae8 None admin] SCRIPT_NAME: `/identity` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:11:28.807500 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0257baf5-58e8-4be1-980a-7479ba72bae8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:11:28.808895 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0257baf5-58e8-4be1-980a-7479ba72bae8 None admin] RBAC: Adding query filter params (group.id=c5a27b7b13aa4e1781357988ee30c5b9, role.id=d1020e7bb0b7411d895ddedd6dc02c5b, scope.project.id=3fae06d52d2d4b66af2858bdd1a0fbc7) {{(pid=144068) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:11:28.809791 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0257baf5-58e8-4be1-980a-7479ba72bae8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:11:28.811635 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0257baf5-58e8-4be1-980a-7479ba72bae8 None admin] RBAC: Authorization granted {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:11:28.820458 dv-cinder-851351-1-smb devstack@keystone.service[144068]: [pid: 144068|app: 0|req: 193/380] 10.222.0.42 () {56 vars in 1376 bytes} [Thu Jul 28 08:11:28 2022] GET /identity/v3/role_assignments?group.id=c5a27b7b13aa4e1781357988ee30c5b9&scope.project.id=3fae06d52d2d4b66af2858bdd1a0fbc7&role.id=d1020e7bb0b7411d895ddedd6dc02c5b => generated 260 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:11:28.841706 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c84dbf8-30ee-48bc-beea-98f6d7039c29 None None] REQUEST_METHOD: `GET` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:11:28.842383 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c84dbf8-30ee-48bc-beea-98f6d7039c29 None None] SCRIPT_NAME: `/identity` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:11:28.842885 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c84dbf8-30ee-48bc-beea-98f6d7039c29 None None] PATH_INFO: `/` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:11:28.844936 dv-cinder-851351-1-smb devstack@keystone.service[144067]: [pid: 144067|app: 0|req: 188/381] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 08:11:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 08:11:28.854790 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be230f7-25cc-4774-99dd-93ad31c2815c None None] REQUEST_METHOD: `POST` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:11:28.855490 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be230f7-25cc-4774-99dd-93ad31c2815c None None] SCRIPT_NAME: `/identity` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:11:28.856087 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be230f7-25cc-4774-99dd-93ad31c2815c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:11:28.885979 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.auth.core [None req-6be230f7-25cc-4774-99dd-93ad31c2815c None None] MFA Rules not processed for user `bf5ceb8f07374635ad506b7d1b4f1612`. Rule list: `[]` (Enabled: `True`). {{(pid=144068) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 08:11:28.887261 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.fernet_utils [None req-6be230f7-25cc-4774-99dd-93ad31c2815c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=144068) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:11:28.977089 dv-cinder-851351-1-smb devstack@keystone.service[144068]: [pid: 144068|app: 0|req: 194/382] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 08:11:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 08:11:28.994865 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e368c5a-ac98-4570-8289-b113785d2084 None None] REQUEST_METHOD: `GET` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:11:28.995430 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e368c5a-ac98-4570-8289-b113785d2084 None None] SCRIPT_NAME: `/identity` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:11:28.995430 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e368c5a-ac98-4570-8289-b113785d2084 None None] PATH_INFO: `/` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:11:28.997061 dv-cinder-851351-1-smb devstack@keystone.service[144067]: [pid: 144067|app: 0|req: 189/383] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 08:11:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 08:11:29.003567 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be230f7-25cc-4774-99dd-93ad31c2815c None None] Authenticating user token {{(pid=144068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:11:29.008883 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feddd317-755a-4042-a878-029a3538fda9 None None] REQUEST_METHOD: `POST` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:11:29.009221 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feddd317-755a-4042-a878-029a3538fda9 None None] SCRIPT_NAME: `/identity` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:11:29.009441 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feddd317-755a-4042-a878-029a3538fda9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:11:29.042184 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.auth.core [None req-feddd317-755a-4042-a878-029a3538fda9 None None] MFA Rules not processed for user `bf5ceb8f07374635ad506b7d1b4f1612`. Rule list: `[]` (Enabled: `True`). {{(pid=144067) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 08:11:29.043345 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.fernet_utils [None req-feddd317-755a-4042-a878-029a3538fda9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=144067) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:11:29.165095 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG dbcounter [-] [144068] Writing DB stats keystone:SELECT=100 {{(pid=144068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:11:29.185121 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be230f7-25cc-4774-99dd-93ad31c2815c None None] Validating token access rules against request {{(pid=144068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:11:29.206968 dv-cinder-851351-1-smb devstack@keystone.service[144067]: [pid: 144067|app: 0|req: 190/384] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 08:11:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 08:11:29.224778 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60859ff4-cb43-4a40-a07e-a9f934997df8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:11:29.225826 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60859ff4-cb43-4a40-a07e-a9f934997df8 None admin] REQUEST_METHOD: `GET` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:11:29.226359 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60859ff4-cb43-4a40-a07e-a9f934997df8 None admin] SCRIPT_NAME: `/identity` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:11:29.226859 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60859ff4-cb43-4a40-a07e-a9f934997df8 None admin] PATH_INFO: `/v3/roles/member` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:11:29.238683 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60859ff4-cb43-4a40-a07e-a9f934997df8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 08:11:29.240823 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feddd317-755a-4042-a878-029a3538fda9 None None] Authenticating user token {{(pid=144067) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:11:29.244721 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application [None req-60859ff4-cb43-4a40-a07e-a9f934997df8 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 28 08:11:29.244721 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:11:29.244721 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:11:29.244721 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:11:29.244721 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:11:29.244721 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:11:29.244721 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:11:29.244721 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:11:29.244721 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:11:29.244721 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:11:29.244721 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:11:29.244721 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:11:29.244721 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 08:11:29.244721 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 08:11:29.244721 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 08:11:29.244721 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 08:11:29.245774 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 08:11:29.245774 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 08:11:29.245774 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 08:11:29.245774 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 08:11:29.245774 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:11:29.245774 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:11:29.245774 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:11:29.245774 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:11:29.245774 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:11:29.245774 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:11:29.245774 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:11:29.245774 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application with Lock( Jul 28 08:11:29.245774 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:11:29.245774 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:11:29.245774 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:11:29.245774 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:11:29.246713 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:11:29.246713 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:11:29.246713 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:11:29.246713 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:11:29.246713 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 08:11:29.246713 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 08:11:29.246713 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 08:11:29.246713 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 08:11:29.246713 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 08:11:29.246713 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 08:11:29.246713 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 28 08:11:29.246713 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application Jul 28 08:11:29.249583 dv-cinder-851351-1-smb devstack@keystone.service[144068]: [pid: 144068|app: 0|req: 195/385] 10.222.0.42 () {56 vars in 1099 bytes} [Thu Jul 28 08:11:29 2022] GET /identity/v3/roles/member => generated 84 bytes in 246 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:11:29.253472 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG dbcounter [-] [144067] Writing DB stats keystone:SELECT=100 {{(pid=144067) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:11:29.258181 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60859ff4-cb43-4a40-a07e-a9f934997df8 None admin] Authenticating user token {{(pid=144068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:11:29.401688 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60859ff4-cb43-4a40-a07e-a9f934997df8 None admin] Validating token access rules against request {{(pid=144068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:11:29.437110 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG dbcounter [-] [144068] Writing DB stats keystone:SELECT=100 {{(pid=144068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:11:29.440915 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c72a6b-d244-4523-a560-cae0a16b581a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:11:29.442018 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c72a6b-d244-4523-a560-cae0a16b581a None admin] REQUEST_METHOD: `GET` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:11:29.442567 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c72a6b-d244-4523-a560-cae0a16b581a None admin] SCRIPT_NAME: `/identity` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:11:29.443212 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c72a6b-d244-4523-a560-cae0a16b581a None admin] PATH_INFO: `/v3/roles` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:11:29.444170 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86c72a6b-d244-4523-a560-cae0a16b581a None admin] RBAC: Adding query filter params (name=member) {{(pid=144068) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:11:29.444755 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86c72a6b-d244-4523-a560-cae0a16b581a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:11:29.446371 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86c72a6b-d244-4523-a560-cae0a16b581a None admin] RBAC: Authorization granted {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:11:29.458030 dv-cinder-851351-1-smb devstack@keystone.service[144068]: [pid: 144068|app: 0|req: 196/386] 10.222.0.42 () {56 vars in 1101 bytes} [Thu Jul 28 08:11:29 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:11:29.467779 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c72a6b-d244-4523-a560-cae0a16b581a None admin] Authenticating user token {{(pid=144068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:11:29.491854 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feddd317-755a-4042-a878-029a3538fda9 None None] Validating token access rules against request {{(pid=144067) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:11:29.562838 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7aa7aa1-69dd-410d-b005-a26b26bc47c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144067) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:11:29.563523 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7aa7aa1-69dd-410d-b005-a26b26bc47c2 None admin] REQUEST_METHOD: `GET` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:11:29.563802 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7aa7aa1-69dd-410d-b005-a26b26bc47c2 None admin] SCRIPT_NAME: `/identity` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:11:29.564070 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7aa7aa1-69dd-410d-b005-a26b26bc47c2 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:11:29.597687 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7aa7aa1-69dd-410d-b005-a26b26bc47c2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 08:11:29.602896 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application [None req-e7aa7aa1-69dd-410d-b005-a26b26bc47c2 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 28 08:11:29.602896 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:11:29.602896 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:11:29.602896 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:11:29.602896 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:11:29.602896 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:11:29.602896 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:11:29.602896 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:11:29.602896 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:11:29.602896 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:11:29.602896 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:11:29.602896 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:11:29.602896 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 08:11:29.602896 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 08:11:29.602896 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 08:11:29.602896 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 08:11:29.603994 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 08:11:29.603994 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 08:11:29.603994 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 08:11:29.603994 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 08:11:29.603994 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:11:29.603994 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:11:29.603994 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:11:29.603994 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:11:29.603994 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:11:29.603994 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:11:29.603994 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:11:29.603994 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application with Lock( Jul 28 08:11:29.603994 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:11:29.603994 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:11:29.603994 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:11:29.603994 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:11:29.604947 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:11:29.604947 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:11:29.604947 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:11:29.604947 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:11:29.604947 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 08:11:29.604947 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 08:11:29.604947 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 08:11:29.604947 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 08:11:29.604947 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 08:11:29.604947 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 08:11:29.604947 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 28 08:11:29.604947 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application Jul 28 08:11:29.604947 dv-cinder-851351-1-smb devstack@keystone.service[144067]: [pid: 144067|app: 0|req: 191/387] 10.222.0.42 () {56 vars in 1114 bytes} [Thu Jul 28 08:11:29 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 364 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:11:29.617759 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7aa7aa1-69dd-410d-b005-a26b26bc47c2 None admin] Authenticating user token {{(pid=144067) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:11:29.628252 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c72a6b-d244-4523-a560-cae0a16b581a None admin] Validating token access rules against request {{(pid=144068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:11:29.672063 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-898c7a37-6049-49dc-8d54-7b82fce2484d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:11:29.673028 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898c7a37-6049-49dc-8d54-7b82fce2484d None admin] REQUEST_METHOD: `GET` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:11:29.673356 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898c7a37-6049-49dc-8d54-7b82fce2484d None admin] SCRIPT_NAME: `/identity` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:11:29.673637 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898c7a37-6049-49dc-8d54-7b82fce2484d None admin] PATH_INFO: `/v3/groups/cfc51bfe26d54218b5109575a2ff2a46` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:11:29.675102 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-898c7a37-6049-49dc-8d54-7b82fce2484d None admin] RBAC: Authorizing `identity:get_group(group_id=cfc51bfe26d54218b5109575a2ff2a46)` {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:11:29.676634 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-898c7a37-6049-49dc-8d54-7b82fce2484d None admin] RBAC: Authorization granted {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:11:29.679120 dv-cinder-851351-1-smb devstack@keystone.service[144068]: [pid: 144068|app: 0|req: 197/388] 10.222.0.42 () {56 vars in 1180 bytes} [Thu Jul 28 08:11:29 2022] GET /identity/v3/groups/cfc51bfe26d54218b5109575a2ff2a46 => generated 226 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:11:29.685631 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-898c7a37-6049-49dc-8d54-7b82fce2484d None admin] Authenticating user token {{(pid=144068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:11:29.776829 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG dbcounter [-] [144067] Writing DB stats keystone:SELECT=100 {{(pid=144067) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:11:29.802638 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG dbcounter [-] [144068] Writing DB stats keystone:SELECT=100 {{(pid=144068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:11:29.853794 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7aa7aa1-69dd-410d-b005-a26b26bc47c2 None admin] Validating token access rules against request {{(pid=144067) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:11:29.904624 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-898c7a37-6049-49dc-8d54-7b82fce2484d None admin] Validating token access rules against request {{(pid=144068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:11:29.927408 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f57bb48-664f-474a-9abc-ad08299824c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144067) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:11:29.929059 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f57bb48-664f-474a-9abc-ad08299824c4 None admin] REQUEST_METHOD: `GET` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:11:29.929491 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f57bb48-664f-474a-9abc-ad08299824c4 None admin] SCRIPT_NAME: `/identity` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:11:29.929931 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f57bb48-664f-474a-9abc-ad08299824c4 None admin] PATH_INFO: `/v3/roles` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:11:29.930838 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f57bb48-664f-474a-9abc-ad08299824c4 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=144067) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:11:29.931304 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f57bb48-664f-474a-9abc-ad08299824c4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:11:29.933172 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f57bb48-664f-474a-9abc-ad08299824c4 None admin] RBAC: Authorization granted {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:11:29.947046 dv-cinder-851351-1-smb devstack@keystone.service[144067]: [pid: 144067|app: 0|req: 192/389] 10.222.0.42 () {56 vars in 1111 bytes} [Thu Jul 28 08:11:29 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 330 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:11:29.954654 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f57bb48-664f-474a-9abc-ad08299824c4 None admin] Authenticating user token {{(pid=144067) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:11:30.002573 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af19cf43-a8f6-42a5-a8dc-ffb0bccd8d29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:11:30.003555 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af19cf43-a8f6-42a5-a8dc-ffb0bccd8d29 None admin] REQUEST_METHOD: `GET` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:11:30.004136 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af19cf43-a8f6-42a5-a8dc-ffb0bccd8d29 None admin] SCRIPT_NAME: `/identity` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:11:30.004637 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af19cf43-a8f6-42a5-a8dc-ffb0bccd8d29 None admin] PATH_INFO: `/v3/projects/49167073baf644459c58534448b0037f` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:11:30.006840 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af19cf43-a8f6-42a5-a8dc-ffb0bccd8d29 None admin] RBAC: Authorizing `identity:get_project(project_id=49167073baf644459c58534448b0037f)` {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:11:30.008527 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af19cf43-a8f6-42a5-a8dc-ffb0bccd8d29 None admin] RBAC: Authorization granted {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:11:30.017798 dv-cinder-851351-1-smb devstack@keystone.service[144068]: [pid: 144068|app: 0|req: 198/390] 10.222.0.42 () {56 vars in 1186 bytes} [Thu Jul 28 08:11:29 2022] GET /identity/v3/projects/49167073baf644459c58534448b0037f => generated 298 bytes in 332 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 08:11:30.034015 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af19cf43-a8f6-42a5-a8dc-ffb0bccd8d29 None admin] Authenticating user token {{(pid=144068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:11:30.151342 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f57bb48-664f-474a-9abc-ad08299824c4 None admin] Validating token access rules against request {{(pid=144067) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:11:30.195947 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG dbcounter [-] [144067] Writing DB stats keystone:SELECT=100 {{(pid=144067) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:11:30.212617 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f3180e2-72fe-4781-b681-6c4ca6dfa8e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144067) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:11:30.213720 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3180e2-72fe-4781-b681-6c4ca6dfa8e9 None admin] REQUEST_METHOD: `GET` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:11:30.214213 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3180e2-72fe-4781-b681-6c4ca6dfa8e9 None admin] SCRIPT_NAME: `/identity` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:11:30.215668 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3180e2-72fe-4781-b681-6c4ca6dfa8e9 None admin] PATH_INFO: `/v3/groups/cfc51bfe26d54218b5109575a2ff2a46` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:11:30.217486 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f3180e2-72fe-4781-b681-6c4ca6dfa8e9 None admin] RBAC: Authorizing `identity:get_group(group_id=cfc51bfe26d54218b5109575a2ff2a46)` {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:11:30.219246 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f3180e2-72fe-4781-b681-6c4ca6dfa8e9 None admin] RBAC: Authorization granted {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:11:30.221593 dv-cinder-851351-1-smb devstack@keystone.service[144067]: [pid: 144067|app: 0|req: 193/391] 10.222.0.42 () {56 vars in 1180 bytes} [Thu Jul 28 08:11:29 2022] GET /identity/v3/groups/cfc51bfe26d54218b5109575a2ff2a46 => generated 226 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:11:30.223121 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83ad3c0-ec5b-4f40-91c1-e0cffabff657 None None] REQUEST_METHOD: `GET` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:11:30.223638 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83ad3c0-ec5b-4f40-91c1-e0cffabff657 None None] SCRIPT_NAME: `/identity` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:11:30.224205 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83ad3c0-ec5b-4f40-91c1-e0cffabff657 None None] PATH_INFO: `/` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:11:30.226341 dv-cinder-851351-1-smb devstack@keystone.service[144067]: [pid: 144067|app: 0|req: 194/392] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 08:11:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 08:11:30.227402 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b83ad3c0-ec5b-4f40-91c1-e0cffabff657 None None] Authenticating user token {{(pid=144067) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:11:30.291139 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af19cf43-a8f6-42a5-a8dc-ffb0bccd8d29 None admin] Validating token access rules against request {{(pid=144068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:11:30.342547 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG dbcounter [-] [144068] Writing DB stats keystone:SELECT=100 {{(pid=144068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:11:30.368597 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2fa539-3a15-44b5-b11c-8622228ef347 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:11:30.369334 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2fa539-3a15-44b5-b11c-8622228ef347 None admin] REQUEST_METHOD: `PUT` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:11:30.369620 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2fa539-3a15-44b5-b11c-8622228ef347 None admin] SCRIPT_NAME: `/identity` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:11:30.369898 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2fa539-3a15-44b5-b11c-8622228ef347 None admin] PATH_INFO: `/v3/projects/49167073baf644459c58534448b0037f/groups/cfc51bfe26d54218b5109575a2ff2a46/roles/6933b60756fe46dd8f27854f5e192061` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:11:30.376948 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b2fa539-3a15-44b5-b11c-8622228ef347 None admin] RBAC: Authorizing `identity:create_grant(project_id=49167073baf644459c58534448b0037f, group_id=cfc51bfe26d54218b5109575a2ff2a46, role_id=6933b60756fe46dd8f27854f5e192061)` {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:11:30.378482 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b2fa539-3a15-44b5-b11c-8622228ef347 None admin] RBAC: Authorization granted {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:11:30.407377 dv-cinder-851351-1-smb devstack@keystone.service[144068]: [pid: 144068|app: 0|req: 199/393] 10.222.0.42 () {58 vars in 1442 bytes} [Thu Jul 28 08:11:30 2022] PUT /identity/v3/projects/49167073baf644459c58534448b0037f/groups/cfc51bfe26d54218b5109575a2ff2a46/roles/6933b60756fe46dd8f27854f5e192061 => generated 0 bytes in 374 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 28 08:11:30.408816 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7e2d46-5228-43da-9c72-5da98aa7e5b6 None None] REQUEST_METHOD: `POST` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:11:30.409216 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7e2d46-5228-43da-9c72-5da98aa7e5b6 None None] SCRIPT_NAME: `/identity` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:11:30.409505 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7e2d46-5228-43da-9c72-5da98aa7e5b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:11:30.418176 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b83ad3c0-ec5b-4f40-91c1-e0cffabff657 None None] Validating token access rules against request {{(pid=144067) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:11:30.431957 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.auth.core [None req-bf7e2d46-5228-43da-9c72-5da98aa7e5b6 None None] MFA Rules not processed for user `bf5ceb8f07374635ad506b7d1b4f1612`. Rule list: `[]` (Enabled: `True`). {{(pid=144068) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 08:11:30.433377 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.fernet_utils [None req-bf7e2d46-5228-43da-9c72-5da98aa7e5b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=144068) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:11:30.492499 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d425469-1a1e-4af8-8e62-4aef2ac6e171 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144067) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:11:30.493108 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d425469-1a1e-4af8-8e62-4aef2ac6e171 None admin] REQUEST_METHOD: `GET` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:11:30.493402 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d425469-1a1e-4af8-8e62-4aef2ac6e171 None admin] SCRIPT_NAME: `/identity` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:11:30.493671 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d425469-1a1e-4af8-8e62-4aef2ac6e171 None admin] PATH_INFO: `/v3/projects/49167073baf644459c58534448b0037f` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:11:30.499768 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d425469-1a1e-4af8-8e62-4aef2ac6e171 None admin] RBAC: Authorizing `identity:get_project(project_id=49167073baf644459c58534448b0037f)` {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:11:30.501408 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d425469-1a1e-4af8-8e62-4aef2ac6e171 None admin] RBAC: Authorization granted {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:11:30.504584 dv-cinder-851351-1-smb devstack@keystone.service[144067]: [pid: 144067|app: 0|req: 195/394] 10.222.0.42 () {56 vars in 1186 bytes} [Thu Jul 28 08:11:30 2022] GET /identity/v3/projects/49167073baf644459c58534448b0037f => generated 298 bytes in 277 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:11:30.513722 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d425469-1a1e-4af8-8e62-4aef2ac6e171 None admin] Authenticating user token {{(pid=144067) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:11:30.559623 dv-cinder-851351-1-smb devstack@keystone.service[144068]: [pid: 144068|app: 0|req: 200/395] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 08:11:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 08:11:30.588191 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7e2d46-5228-43da-9c72-5da98aa7e5b6 None None] Authenticating user token {{(pid=144068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:11:30.636394 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG dbcounter [-] [144067] Writing DB stats keystone:SELECT=100 {{(pid=144067) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:11:30.696305 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d425469-1a1e-4af8-8e62-4aef2ac6e171 None admin] Validating token access rules against request {{(pid=144067) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:11:30.722269 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7e2d46-5228-43da-9c72-5da98aa7e5b6 None None] Validating token access rules against request {{(pid=144068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:11:30.737864 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG dbcounter [-] [144068] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=144068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:11:30.743278 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4816ae7-141a-46f8-a1ac-e1d36dc3c8b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144067) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:11:30.744446 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4816ae7-141a-46f8-a1ac-e1d36dc3c8b0 None admin] REQUEST_METHOD: `PUT` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:11:30.744734 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4816ae7-141a-46f8-a1ac-e1d36dc3c8b0 None admin] SCRIPT_NAME: `/identity` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:11:30.745971 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4816ae7-141a-46f8-a1ac-e1d36dc3c8b0 None admin] PATH_INFO: `/v3/projects/49167073baf644459c58534448b0037f/groups/cfc51bfe26d54218b5109575a2ff2a46/roles/7e9c2306137042cf8b8eba284656ef33` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:11:30.748288 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4816ae7-141a-46f8-a1ac-e1d36dc3c8b0 None admin] RBAC: Authorizing `identity:create_grant(project_id=49167073baf644459c58534448b0037f, group_id=cfc51bfe26d54218b5109575a2ff2a46, role_id=7e9c2306137042cf8b8eba284656ef33)` {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:11:30.750394 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4816ae7-141a-46f8-a1ac-e1d36dc3c8b0 None admin] RBAC: Authorization granted {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:11:30.779062 dv-cinder-851351-1-smb devstack@keystone.service[144067]: [pid: 144067|app: 0|req: 196/396] 10.222.0.42 () {58 vars in 1442 bytes} [Thu Jul 28 08:11:30 2022] PUT /identity/v3/projects/49167073baf644459c58534448b0037f/groups/cfc51bfe26d54218b5109575a2ff2a46/roles/7e9c2306137042cf8b8eba284656ef33 => generated 0 bytes in 266 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 08:11:30.785191 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6ef3da-adc5-4a38-a0de-6bf88e296c03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:11:30.786343 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6ef3da-adc5-4a38-a0de-6bf88e296c03 None admin] REQUEST_METHOD: `GET` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:11:30.786871 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6ef3da-adc5-4a38-a0de-6bf88e296c03 None admin] SCRIPT_NAME: `/identity` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:11:30.787416 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6ef3da-adc5-4a38-a0de-6bf88e296c03 None admin] PATH_INFO: `/v3/roles/member` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:11:30.804529 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d6ef3da-adc5-4a38-a0de-6bf88e296c03 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 08:11:30.810414 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application [None req-9d6ef3da-adc5-4a38-a0de-6bf88e296c03 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 28 08:11:30.810414 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:11:30.810414 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:11:30.810414 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:11:30.810414 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:11:30.810414 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:11:30.810414 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:11:30.810414 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:11:30.810414 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:11:30.810414 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:11:30.810414 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:11:30.810414 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:11:30.810414 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 08:11:30.810414 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 08:11:30.810414 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 08:11:30.810414 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 08:11:30.811667 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 08:11:30.811667 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 08:11:30.811667 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 08:11:30.811667 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 08:11:30.811667 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:11:30.811667 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:11:30.811667 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:11:30.811667 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:11:30.811667 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:11:30.811667 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:11:30.811667 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:11:30.811667 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application with Lock( Jul 28 08:11:30.811667 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:11:30.811667 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:11:30.811667 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:11:30.811667 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:11:30.812600 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:11:30.812600 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:11:30.812600 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:11:30.812600 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:11:30.812600 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 08:11:30.812600 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 08:11:30.812600 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 08:11:30.812600 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 08:11:30.812600 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 08:11:30.812600 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 08:11:30.812600 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 28 08:11:30.812600 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application Jul 28 08:11:30.815756 dv-cinder-851351-1-smb devstack@keystone.service[144068]: [pid: 144068|app: 0|req: 201/397] 10.222.0.42 () {56 vars in 1099 bytes} [Thu Jul 28 08:11:30 2022] GET /identity/v3/roles/member => generated 84 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 08:11:30.822075 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4816ae7-141a-46f8-a1ac-e1d36dc3c8b0 None admin] Authenticating user token {{(pid=144067) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:11:30.962567 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4816ae7-141a-46f8-a1ac-e1d36dc3c8b0 None admin] Validating token access rules against request {{(pid=144067) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:11:31.005388 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG dbcounter [-] [144067] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=144067) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:11:31.021252 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ccd1cff-654c-4586-8fec-eebaf67d2b2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144067) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:11:31.022364 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ccd1cff-654c-4586-8fec-eebaf67d2b2a None admin] REQUEST_METHOD: `GET` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:11:31.022854 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ccd1cff-654c-4586-8fec-eebaf67d2b2a None admin] SCRIPT_NAME: `/identity` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:11:31.023390 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ccd1cff-654c-4586-8fec-eebaf67d2b2a None admin] PATH_INFO: `/v3/roles` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:11:31.024413 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ccd1cff-654c-4586-8fec-eebaf67d2b2a None admin] RBAC: Adding query filter params (name=member) {{(pid=144067) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:11:31.024965 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ccd1cff-654c-4586-8fec-eebaf67d2b2a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:11:31.026678 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ccd1cff-654c-4586-8fec-eebaf67d2b2a None admin] RBAC: Authorization granted {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:11:31.036931 dv-cinder-851351-1-smb devstack@keystone.service[144067]: [pid: 144067|app: 0|req: 197/398] 10.222.0.42 () {56 vars in 1101 bytes} [Thu Jul 28 08:11:30 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:11:31.043534 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6ef3da-adc5-4a38-a0de-6bf88e296c03 None admin] Authenticating user token {{(pid=144068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:11:31.158704 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6ef3da-adc5-4a38-a0de-6bf88e296c03 None admin] Validating token access rules against request {{(pid=144068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:11:31.200267 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ca2926-3d93-43f0-9311-02b53d7d202f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:11:31.205065 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ca2926-3d93-43f0-9311-02b53d7d202f None admin] REQUEST_METHOD: `GET` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:11:31.205381 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ca2926-3d93-43f0-9311-02b53d7d202f None admin] SCRIPT_NAME: `/identity` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:11:31.205628 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ca2926-3d93-43f0-9311-02b53d7d202f None admin] PATH_INFO: `/v3/groups/cfc51bfe26d54218b5109575a2ff2a46` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:11:31.206905 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55ca2926-3d93-43f0-9311-02b53d7d202f None admin] RBAC: Authorizing `identity:get_group(group_id=cfc51bfe26d54218b5109575a2ff2a46)` {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:11:31.208464 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55ca2926-3d93-43f0-9311-02b53d7d202f None admin] RBAC: Authorization granted {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:11:31.210857 dv-cinder-851351-1-smb devstack@keystone.service[144068]: [pid: 144068|app: 0|req: 202/399] 10.222.0.42 () {56 vars in 1180 bytes} [Thu Jul 28 08:11:31 2022] GET /identity/v3/groups/cfc51bfe26d54218b5109575a2ff2a46 => generated 226 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:11:31.216756 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ccd1cff-654c-4586-8fec-eebaf67d2b2a None admin] Authenticating user token {{(pid=144067) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:11:31.226427 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24b3303-42ea-4677-a7be-7057bf10d6a6 None None] REQUEST_METHOD: `GET` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:11:31.226758 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24b3303-42ea-4677-a7be-7057bf10d6a6 None None] SCRIPT_NAME: `/identity` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:11:31.226983 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24b3303-42ea-4677-a7be-7057bf10d6a6 None None] PATH_INFO: `/` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:11:31.228713 dv-cinder-851351-1-smb devstack@keystone.service[144068]: [pid: 144068|app: 0|req: 203/400] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 08:11:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 28 08:11:31.233913 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94bf4d47-b69c-4837-9cc0-b8097e8cac87 None None] REQUEST_METHOD: `POST` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:11:31.234203 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94bf4d47-b69c-4837-9cc0-b8097e8cac87 None None] SCRIPT_NAME: `/identity` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:11:31.234480 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94bf4d47-b69c-4837-9cc0-b8097e8cac87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:11:31.253142 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.auth.core [None req-94bf4d47-b69c-4837-9cc0-b8097e8cac87 None None] MFA Rules not processed for user `bf5ceb8f07374635ad506b7d1b4f1612`. Rule list: `[]` (Enabled: `True`). {{(pid=144068) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 08:11:31.254389 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.fernet_utils [None req-94bf4d47-b69c-4837-9cc0-b8097e8cac87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=144068) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:11:31.316972 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG dbcounter [-] [144068] Writing DB stats keystone:SELECT=100 {{(pid=144068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:11:31.391155 dv-cinder-851351-1-smb devstack@keystone.service[144068]: [pid: 144068|app: 0|req: 204/401] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 08:11:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 28 08:11:31.415188 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ccd1cff-654c-4586-8fec-eebaf67d2b2a None admin] Validating token access rules against request {{(pid=144067) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:11:31.439199 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94bf4d47-b69c-4837-9cc0-b8097e8cac87 None None] Authenticating user token {{(pid=144068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:11:31.483291 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f030ed8c-c159-42af-8d56-bc1fd3829c7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144067) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:11:31.485309 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f030ed8c-c159-42af-8d56-bc1fd3829c7e None admin] REQUEST_METHOD: `GET` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:11:31.485828 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f030ed8c-c159-42af-8d56-bc1fd3829c7e None admin] SCRIPT_NAME: `/identity` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:11:31.486324 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f030ed8c-c159-42af-8d56-bc1fd3829c7e None admin] PATH_INFO: `/v3/projects/2c58e7ea67d84cf692dd9eb3f6cb73a0` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:11:31.487761 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f030ed8c-c159-42af-8d56-bc1fd3829c7e None admin] RBAC: Authorizing `identity:get_project(project_id=2c58e7ea67d84cf692dd9eb3f6cb73a0)` {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:11:31.490105 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f030ed8c-c159-42af-8d56-bc1fd3829c7e None admin] RBAC: Authorization granted {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:11:31.492841 dv-cinder-851351-1-smb devstack@keystone.service[144067]: [pid: 144067|app: 0|req: 198/402] 10.222.0.42 () {56 vars in 1186 bytes} [Thu Jul 28 08:11:31 2022] GET /identity/v3/projects/2c58e7ea67d84cf692dd9eb3f6cb73a0 => generated 302 bytes in 277 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:11:31.494446 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093a6b3d-5de3-4dd9-b648-5619604387e6 None None] REQUEST_METHOD: `GET` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:11:31.494942 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093a6b3d-5de3-4dd9-b648-5619604387e6 None None] SCRIPT_NAME: `/identity` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:11:31.495573 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093a6b3d-5de3-4dd9-b648-5619604387e6 None None] PATH_INFO: `/` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:11:31.497308 dv-cinder-851351-1-smb devstack@keystone.service[144067]: [pid: 144067|app: 0|req: 199/403] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 08:11:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 08:11:31.503307 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-093a6b3d-5de3-4dd9-b648-5619604387e6 None None] Authenticating user token {{(pid=144067) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:11:31.572155 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG dbcounter [-] [144067] Writing DB stats keystone:SELECT=100 {{(pid=144067) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:11:31.572545 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94bf4d47-b69c-4837-9cc0-b8097e8cac87 None None] Validating token access rules against request {{(pid=144068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:11:31.610542 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16cb2b53-f08e-40bf-9e94-6fdaa8ace7c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:11:31.611613 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16cb2b53-f08e-40bf-9e94-6fdaa8ace7c6 None admin] REQUEST_METHOD: `GET` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:11:31.612126 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16cb2b53-f08e-40bf-9e94-6fdaa8ace7c6 None admin] SCRIPT_NAME: `/identity` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:11:31.612627 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16cb2b53-f08e-40bf-9e94-6fdaa8ace7c6 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:11:31.624103 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16cb2b53-f08e-40bf-9e94-6fdaa8ace7c6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 08:11:31.629977 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application [None req-16cb2b53-f08e-40bf-9e94-6fdaa8ace7c6 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 28 08:11:31.629977 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:11:31.629977 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:11:31.629977 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:11:31.629977 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:11:31.629977 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:11:31.629977 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:11:31.629977 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:11:31.629977 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:11:31.629977 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:11:31.629977 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:11:31.629977 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:11:31.629977 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 08:11:31.629977 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 08:11:31.629977 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 08:11:31.629977 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 08:11:31.631578 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 08:11:31.631578 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 08:11:31.631578 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 08:11:31.631578 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 08:11:31.631578 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:11:31.631578 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:11:31.631578 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:11:31.631578 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:11:31.631578 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:11:31.631578 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:11:31.631578 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:11:31.631578 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application with Lock( Jul 28 08:11:31.631578 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:11:31.631578 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:11:31.631578 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:11:31.631578 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:11:31.632687 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:11:31.632687 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:11:31.632687 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:11:31.632687 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:11:31.632687 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 08:11:31.632687 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 08:11:31.632687 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 08:11:31.632687 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 08:11:31.632687 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 08:11:31.632687 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 08:11:31.632687 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 28 08:11:31.632687 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application Jul 28 08:11:31.633407 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-093a6b3d-5de3-4dd9-b648-5619604387e6 None None] Validating token access rules against request {{(pid=144067) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:11:31.635770 dv-cinder-851351-1-smb devstack@keystone.service[144068]: [pid: 144068|app: 0|req: 205/404] 10.222.0.42 () {56 vars in 1114 bytes} [Thu Jul 28 08:11:31 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:11:31.637362 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd39178a-daed-41eb-ae01-82c5ccd5c56c None None] REQUEST_METHOD: `POST` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:11:31.637851 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd39178a-daed-41eb-ae01-82c5ccd5c56c None None] SCRIPT_NAME: `/identity` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:11:31.638532 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd39178a-daed-41eb-ae01-82c5ccd5c56c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:11:31.659478 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.auth.core [None req-dd39178a-daed-41eb-ae01-82c5ccd5c56c None None] MFA Rules not processed for user `bf5ceb8f07374635ad506b7d1b4f1612`. Rule list: `[]` (Enabled: `True`). {{(pid=144068) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 08:11:31.661198 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.fernet_utils [None req-dd39178a-daed-41eb-ae01-82c5ccd5c56c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=144068) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:11:31.679213 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35515275-1280-4532-a69c-dac9a6035c38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144067) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:11:31.679981 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35515275-1280-4532-a69c-dac9a6035c38 None admin] REQUEST_METHOD: `PUT` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:11:31.680274 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35515275-1280-4532-a69c-dac9a6035c38 None admin] SCRIPT_NAME: `/identity` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:11:31.680555 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35515275-1280-4532-a69c-dac9a6035c38 None admin] PATH_INFO: `/v3/projects/2c58e7ea67d84cf692dd9eb3f6cb73a0/groups/cfc51bfe26d54218b5109575a2ff2a46/roles/6933b60756fe46dd8f27854f5e192061` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:11:31.682968 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35515275-1280-4532-a69c-dac9a6035c38 None admin] RBAC: Authorizing `identity:create_grant(project_id=2c58e7ea67d84cf692dd9eb3f6cb73a0, group_id=cfc51bfe26d54218b5109575a2ff2a46, role_id=6933b60756fe46dd8f27854f5e192061)` {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:11:31.684955 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35515275-1280-4532-a69c-dac9a6035c38 None admin] RBAC: Authorization granted {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:11:31.687685 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG dbcounter [-] [144068] Writing DB stats keystone:SELECT=100 {{(pid=144068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:11:31.708770 dv-cinder-851351-1-smb devstack@keystone.service[144067]: [pid: 144067|app: 0|req: 200/405] 10.222.0.42 () {58 vars in 1442 bytes} [Thu Jul 28 08:11:31 2022] PUT /identity/v3/projects/2c58e7ea67d84cf692dd9eb3f6cb73a0/groups/cfc51bfe26d54218b5109575a2ff2a46/roles/6933b60756fe46dd8f27854f5e192061 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 08:11:31.711790 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35515275-1280-4532-a69c-dac9a6035c38 None admin] Authenticating user token {{(pid=144067) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:11:31.792194 dv-cinder-851351-1-smb devstack@keystone.service[144068]: [pid: 144068|app: 0|req: 206/406] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 08:11:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 08:11:31.834327 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd39178a-daed-41eb-ae01-82c5ccd5c56c None None] Authenticating user token {{(pid=144068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:11:31.888835 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35515275-1280-4532-a69c-dac9a6035c38 None admin] Validating token access rules against request {{(pid=144067) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:11:31.921987 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG dbcounter [-] [144067] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=144067) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:11:31.958016 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf8ddd3-816e-4a65-86f9-fdb6105d247b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144067) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:11:31.959062 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf8ddd3-816e-4a65-86f9-fdb6105d247b None admin] REQUEST_METHOD: `GET` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:11:31.959615 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf8ddd3-816e-4a65-86f9-fdb6105d247b None admin] SCRIPT_NAME: `/identity` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:11:31.960681 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf8ddd3-816e-4a65-86f9-fdb6105d247b None admin] PATH_INFO: `/v3/roles` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:11:31.961787 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbf8ddd3-816e-4a65-86f9-fdb6105d247b None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=144067) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:11:31.962314 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbf8ddd3-816e-4a65-86f9-fdb6105d247b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:11:31.963969 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbf8ddd3-816e-4a65-86f9-fdb6105d247b None admin] RBAC: Authorization granted {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:11:31.974041 dv-cinder-851351-1-smb devstack@keystone.service[144067]: [pid: 144067|app: 0|req: 201/407] 10.222.0.42 () {56 vars in 1111 bytes} [Thu Jul 28 08:11:31 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:11:31.979194 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd39178a-daed-41eb-ae01-82c5ccd5c56c None None] Validating token access rules against request {{(pid=144068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:11:31.980359 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf8ddd3-816e-4a65-86f9-fdb6105d247b None admin] Authenticating user token {{(pid=144067) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:11:32.022045 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3079ba-cb63-4f0a-bb2e-534fe9e60586 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:11:32.023717 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3079ba-cb63-4f0a-bb2e-534fe9e60586 None admin] REQUEST_METHOD: `GET` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:11:32.024019 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3079ba-cb63-4f0a-bb2e-534fe9e60586 None admin] SCRIPT_NAME: `/identity` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:11:32.024304 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3079ba-cb63-4f0a-bb2e-534fe9e60586 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:11:32.038690 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b3079ba-cb63-4f0a-bb2e-534fe9e60586 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 08:11:32.045320 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application [None req-3b3079ba-cb63-4f0a-bb2e-534fe9e60586 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 08:11:32.045320 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:11:32.045320 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:11:32.045320 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:11:32.045320 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:11:32.045320 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:11:32.045320 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:11:32.045320 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:11:32.045320 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:11:32.045320 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:11:32.045320 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:11:32.045320 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:11:32.045320 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 08:11:32.045320 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 08:11:32.045320 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 08:11:32.045320 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 08:11:32.046860 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 08:11:32.046860 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 08:11:32.046860 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 08:11:32.046860 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 08:11:32.046860 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:11:32.046860 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:11:32.046860 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:11:32.046860 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:11:32.046860 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:11:32.046860 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:11:32.046860 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:11:32.046860 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application with Lock( Jul 28 08:11:32.046860 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:11:32.046860 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:11:32.046860 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:11:32.046860 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:11:32.047787 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:11:32.047787 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:11:32.047787 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:11:32.047787 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:11:32.047787 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 08:11:32.047787 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 08:11:32.047787 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 08:11:32.047787 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 08:11:32.047787 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 08:11:32.047787 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 08:11:32.047787 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 08:11:32.047787 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application Jul 28 08:11:32.047787 dv-cinder-851351-1-smb devstack@keystone.service[144068]: [pid: 144068|app: 0|req: 207/408] 10.222.0.42 () {56 vars in 1096 bytes} [Thu Jul 28 08:11:31 2022] GET /identity/v3/roles/admin => generated 83 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:11:32.055089 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3079ba-cb63-4f0a-bb2e-534fe9e60586 None admin] Authenticating user token {{(pid=144068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:11:32.100462 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG dbcounter [-] [144068] Writing DB stats keystone:SELECT=100 {{(pid=144068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:11:32.145102 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf8ddd3-816e-4a65-86f9-fdb6105d247b None admin] Validating token access rules against request {{(pid=144067) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:11:32.183641 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7402d03-22d1-4cf2-9206-46086986861a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144067) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:11:32.184335 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7402d03-22d1-4cf2-9206-46086986861a None admin] REQUEST_METHOD: `GET` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:11:32.184626 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7402d03-22d1-4cf2-9206-46086986861a None admin] SCRIPT_NAME: `/identity` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:11:32.184934 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7402d03-22d1-4cf2-9206-46086986861a None admin] PATH_INFO: `/v3/groups/cfc51bfe26d54218b5109575a2ff2a46` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:11:32.186468 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7402d03-22d1-4cf2-9206-46086986861a None admin] RBAC: Authorizing `identity:get_group(group_id=cfc51bfe26d54218b5109575a2ff2a46)` {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:11:32.188000 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7402d03-22d1-4cf2-9206-46086986861a None admin] RBAC: Authorization granted {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:11:32.189801 dv-cinder-851351-1-smb devstack@keystone.service[144067]: [pid: 144067|app: 0|req: 202/409] 10.222.0.42 () {56 vars in 1180 bytes} [Thu Jul 28 08:11:31 2022] GET /identity/v3/groups/cfc51bfe26d54218b5109575a2ff2a46 => generated 226 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:11:32.196060 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7402d03-22d1-4cf2-9206-46086986861a None admin] Authenticating user token {{(pid=144067) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:11:32.241311 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3079ba-cb63-4f0a-bb2e-534fe9e60586 None admin] Validating token access rules against request {{(pid=144068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:11:32.277484 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aaca486-d108-4938-aae7-4aab37015e98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:11:32.278119 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aaca486-d108-4938-aae7-4aab37015e98 None admin] REQUEST_METHOD: `GET` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:11:32.278396 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aaca486-d108-4938-aae7-4aab37015e98 None admin] SCRIPT_NAME: `/identity` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:11:32.278667 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aaca486-d108-4938-aae7-4aab37015e98 None admin] PATH_INFO: `/v3/roles` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:11:32.279396 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aaca486-d108-4938-aae7-4aab37015e98 None admin] RBAC: Adding query filter params (name=admin) {{(pid=144068) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:11:32.279699 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aaca486-d108-4938-aae7-4aab37015e98 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:11:32.284695 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aaca486-d108-4938-aae7-4aab37015e98 None admin] RBAC: Authorization granted {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:11:32.290540 dv-cinder-851351-1-smb devstack@keystone.service[144068]: [pid: 144068|app: 0|req: 208/410] 10.222.0.42 () {56 vars in 1099 bytes} [Thu Jul 28 08:11:32 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 08:11:32.294771 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG dbcounter [-] [144067] Writing DB stats keystone:SELECT=100 {{(pid=144067) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:11:32.298570 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aaca486-d108-4938-aae7-4aab37015e98 None admin] Authenticating user token {{(pid=144068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:11:32.413298 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7402d03-22d1-4cf2-9206-46086986861a None admin] Validating token access rules against request {{(pid=144067) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:11:32.446887 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG dbcounter [-] [144068] Writing DB stats keystone:SELECT=100 {{(pid=144068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:11:32.471294 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8276e82a-3df7-4249-a9d4-c540fb9b5ca6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144067) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:11:32.471960 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8276e82a-3df7-4249-a9d4-c540fb9b5ca6 None admin] REQUEST_METHOD: `GET` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:11:32.472236 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8276e82a-3df7-4249-a9d4-c540fb9b5ca6 None admin] SCRIPT_NAME: `/identity` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:11:32.472509 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8276e82a-3df7-4249-a9d4-c540fb9b5ca6 None admin] PATH_INFO: `/v3/projects/2c58e7ea67d84cf692dd9eb3f6cb73a0` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:11:32.474984 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8276e82a-3df7-4249-a9d4-c540fb9b5ca6 None admin] RBAC: Authorizing `identity:get_project(project_id=2c58e7ea67d84cf692dd9eb3f6cb73a0)` {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:11:32.476542 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8276e82a-3df7-4249-a9d4-c540fb9b5ca6 None admin] RBAC: Authorization granted {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:11:32.478621 dv-cinder-851351-1-smb devstack@keystone.service[144067]: [pid: 144067|app: 0|req: 203/411] 10.222.0.42 () {56 vars in 1186 bytes} [Thu Jul 28 08:11:32 2022] GET /identity/v3/projects/2c58e7ea67d84cf692dd9eb3f6cb73a0 => generated 302 bytes in 283 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:11:32.482915 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aaca486-d108-4938-aae7-4aab37015e98 None admin] Validating token access rules against request {{(pid=144068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:11:32.485403 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8276e82a-3df7-4249-a9d4-c540fb9b5ca6 None admin] Authenticating user token {{(pid=144067) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:11:32.574469 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a48ab7-34d3-4263-8c71-4b9e09057448 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:11:32.575133 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a48ab7-34d3-4263-8c71-4b9e09057448 None admin] REQUEST_METHOD: `GET` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:11:32.575417 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a48ab7-34d3-4263-8c71-4b9e09057448 None admin] SCRIPT_NAME: `/identity` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:11:32.575685 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a48ab7-34d3-4263-8c71-4b9e09057448 None admin] PATH_INFO: `/v3/groups/c5a27b7b13aa4e1781357988ee30c5b9` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:11:32.579093 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67a48ab7-34d3-4263-8c71-4b9e09057448 None admin] RBAC: Authorizing `identity:get_group(group_id=c5a27b7b13aa4e1781357988ee30c5b9)` {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:11:32.580537 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67a48ab7-34d3-4263-8c71-4b9e09057448 None admin] RBAC: Authorization granted {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:11:32.583676 dv-cinder-851351-1-smb devstack@keystone.service[144068]: [pid: 144068|app: 0|req: 209/412] 10.222.0.42 () {56 vars in 1180 bytes} [Thu Jul 28 08:11:32 2022] GET /identity/v3/groups/c5a27b7b13aa4e1781357988ee30c5b9 => generated 229 bytes in 285 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 08:11:32.588487 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a48ab7-34d3-4263-8c71-4b9e09057448 None admin] Authenticating user token {{(pid=144068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:11:32.646826 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8276e82a-3df7-4249-a9d4-c540fb9b5ca6 None admin] Validating token access rules against request {{(pid=144067) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:11:32.685112 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG dbcounter [-] [144067] Writing DB stats keystone:SELECT=100 {{(pid=144067) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:11:32.724358 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a48ab7-34d3-4263-8c71-4b9e09057448 None admin] Validating token access rules against request {{(pid=144068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:11:32.753420 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5a133c-31cb-420a-84cc-913045c83a93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144067) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:11:32.754191 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5a133c-31cb-420a-84cc-913045c83a93 None admin] REQUEST_METHOD: `PUT` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:11:32.754482 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5a133c-31cb-420a-84cc-913045c83a93 None admin] SCRIPT_NAME: `/identity` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:11:32.754766 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5a133c-31cb-420a-84cc-913045c83a93 None admin] PATH_INFO: `/v3/projects/2c58e7ea67d84cf692dd9eb3f6cb73a0/groups/cfc51bfe26d54218b5109575a2ff2a46/roles/7e9c2306137042cf8b8eba284656ef33` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:11:32.759767 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b1ff13e-1535-4aad-a715-be881ae78ccd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:11:32.760428 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1ff13e-1535-4aad-a715-be881ae78ccd None admin] REQUEST_METHOD: `GET` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:11:32.760741 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1ff13e-1535-4aad-a715-be881ae78ccd None admin] SCRIPT_NAME: `/identity` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:11:32.761018 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1ff13e-1535-4aad-a715-be881ae78ccd None admin] PATH_INFO: `/v3/projects/3fae06d52d2d4b66af2858bdd1a0fbc7` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:11:32.762026 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc5a133c-31cb-420a-84cc-913045c83a93 None admin] RBAC: Authorizing `identity:create_grant(project_id=2c58e7ea67d84cf692dd9eb3f6cb73a0, group_id=cfc51bfe26d54218b5109575a2ff2a46, role_id=7e9c2306137042cf8b8eba284656ef33)` {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:11:32.762236 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b1ff13e-1535-4aad-a715-be881ae78ccd None admin] RBAC: Authorizing `identity:get_project(project_id=3fae06d52d2d4b66af2858bdd1a0fbc7)` {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:11:32.763521 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc5a133c-31cb-420a-84cc-913045c83a93 None admin] RBAC: Authorization granted {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:11:32.763652 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b1ff13e-1535-4aad-a715-be881ae78ccd None admin] RBAC: Authorization granted {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:11:32.765615 dv-cinder-851351-1-smb devstack@keystone.service[144068]: [pid: 144068|app: 0|req: 210/413] 10.222.0.42 () {56 vars in 1186 bytes} [Thu Jul 28 08:11:32 2022] GET /identity/v3/projects/3fae06d52d2d4b66af2858bdd1a0fbc7 => generated 344 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:11:32.771405 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b1ff13e-1535-4aad-a715-be881ae78ccd None admin] Authenticating user token {{(pid=144068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:11:32.795244 dv-cinder-851351-1-smb devstack@keystone.service[144067]: [pid: 144067|app: 0|req: 204/414] 10.222.0.42 () {58 vars in 1442 bytes} [Thu Jul 28 08:11:32 2022] PUT /identity/v3/projects/2c58e7ea67d84cf692dd9eb3f6cb73a0/groups/cfc51bfe26d54218b5109575a2ff2a46/roles/7e9c2306137042cf8b8eba284656ef33 => generated 0 bytes in 310 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 08:11:32.800171 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG dbcounter [-] [144068] Writing DB stats keystone:SELECT=100 {{(pid=144068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:11:32.846523 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f1ddb9-a335-497d-af01-6fb637f2fb3f None None] REQUEST_METHOD: `GET` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:11:32.847195 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f1ddb9-a335-497d-af01-6fb637f2fb3f None None] SCRIPT_NAME: `/identity` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:11:32.847492 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f1ddb9-a335-497d-af01-6fb637f2fb3f None None] PATH_INFO: `/` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:11:32.849849 dv-cinder-851351-1-smb devstack@keystone.service[144067]: [pid: 144067|app: 0|req: 205/415] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 08:11:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 28 08:11:32.855571 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166879ef-365f-4d06-b5c7-5e6becf407b7 None None] REQUEST_METHOD: `POST` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:11:32.855867 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166879ef-365f-4d06-b5c7-5e6becf407b7 None None] SCRIPT_NAME: `/identity` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:11:32.856412 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166879ef-365f-4d06-b5c7-5e6becf407b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:11:32.893866 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.auth.core [None req-166879ef-365f-4d06-b5c7-5e6becf407b7 None None] MFA Rules not processed for user `bf5ceb8f07374635ad506b7d1b4f1612`. Rule list: `[]` (Enabled: `True`). {{(pid=144067) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 08:11:32.895275 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.fernet_utils [None req-166879ef-365f-4d06-b5c7-5e6becf407b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=144067) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:11:32.899611 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b1ff13e-1535-4aad-a715-be881ae78ccd None admin] Validating token access rules against request {{(pid=144068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:11:32.941803 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d50113f-43d9-4771-a74f-0241537ac059 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:11:32.942478 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d50113f-43d9-4771-a74f-0241537ac059 None admin] REQUEST_METHOD: `PUT` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:11:32.942763 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d50113f-43d9-4771-a74f-0241537ac059 None admin] SCRIPT_NAME: `/identity` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:11:32.943088 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d50113f-43d9-4771-a74f-0241537ac059 None admin] PATH_INFO: `/v3/projects/3fae06d52d2d4b66af2858bdd1a0fbc7/groups/c5a27b7b13aa4e1781357988ee30c5b9/roles/d1020e7bb0b7411d895ddedd6dc02c5b` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:11:32.945261 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d50113f-43d9-4771-a74f-0241537ac059 None admin] RBAC: Authorizing `identity:create_grant(project_id=3fae06d52d2d4b66af2858bdd1a0fbc7, group_id=c5a27b7b13aa4e1781357988ee30c5b9, role_id=d1020e7bb0b7411d895ddedd6dc02c5b)` {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:11:32.947267 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d50113f-43d9-4771-a74f-0241537ac059 None admin] RBAC: Authorization granted {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:11:32.964361 dv-cinder-851351-1-smb devstack@keystone.service[144068]: [pid: 144068|app: 0|req: 211/416] 10.222.0.42 () {58 vars in 1442 bytes} [Thu Jul 28 08:11:32 2022] PUT /identity/v3/projects/3fae06d52d2d4b66af2858bdd1a0fbc7/groups/c5a27b7b13aa4e1781357988ee30c5b9/roles/d1020e7bb0b7411d895ddedd6dc02c5b => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 28 08:11:33.063633 dv-cinder-851351-1-smb devstack@keystone.service[144067]: [pid: 144067|app: 0|req: 206/417] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 08:11:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 08:11:33.087992 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d50113f-43d9-4771-a74f-0241537ac059 None admin] Authenticating user token {{(pid=144068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:11:33.167997 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51a7206-8529-4a09-be90-37654b272a8d None None] REQUEST_METHOD: `GET` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:11:33.168703 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51a7206-8529-4a09-be90-37654b272a8d None None] SCRIPT_NAME: `/identity` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:11:33.169204 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51a7206-8529-4a09-be90-37654b272a8d None None] PATH_INFO: `/` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:11:33.175102 dv-cinder-851351-1-smb devstack@keystone.service[144067]: [pid: 144067|app: 0|req: 207/418] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 08:11:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 28 08:11:33.177166 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456d9f26-e579-4675-8fd8-6e6d2674998a None None] REQUEST_METHOD: `POST` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:11:33.177669 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456d9f26-e579-4675-8fd8-6e6d2674998a None None] SCRIPT_NAME: `/identity` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:11:33.178148 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456d9f26-e579-4675-8fd8-6e6d2674998a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:11:33.188956 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG dbcounter [-] [144068] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=144068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:11:33.198293 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.auth.core [None req-456d9f26-e579-4675-8fd8-6e6d2674998a None None] MFA Rules not processed for user `bf5ceb8f07374635ad506b7d1b4f1612`. Rule list: `[]` (Enabled: `True`). {{(pid=144067) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 08:11:33.199420 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.fernet_utils [None req-456d9f26-e579-4675-8fd8-6e6d2674998a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=144067) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:11:33.219890 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d50113f-43d9-4771-a74f-0241537ac059 None admin] Validating token access rules against request {{(pid=144068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:11:33.267534 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f48ac9-e8bc-4d27-9001-1d11fc7e6940 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:11:33.268524 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f48ac9-e8bc-4d27-9001-1d11fc7e6940 None admin] REQUEST_METHOD: `GET` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:11:33.268843 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f48ac9-e8bc-4d27-9001-1d11fc7e6940 None admin] SCRIPT_NAME: `/identity` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:11:33.269137 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f48ac9-e8bc-4d27-9001-1d11fc7e6940 None admin] PATH_INFO: `/v3/roles/member` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:11:33.283500 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3f48ac9-e8bc-4d27-9001-1d11fc7e6940 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 08:11:33.290643 dv-cinder-851351-1-smb devstack@keystone.service[144067]: [pid: 144067|app: 0|req: 208/419] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 08:11:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 08:11:33.291137 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application [None req-b3f48ac9-e8bc-4d27-9001-1d11fc7e6940 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 28 08:11:33.291137 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:11:33.291137 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:11:33.291137 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:11:33.291137 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:11:33.291137 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:11:33.291137 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:11:33.291137 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:11:33.291137 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:11:33.291137 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:11:33.291137 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:11:33.291137 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:11:33.291137 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 08:11:33.291137 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 08:11:33.291137 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 08:11:33.291137 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 08:11:33.292168 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 08:11:33.292168 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 08:11:33.292168 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 08:11:33.292168 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 08:11:33.292168 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:11:33.292168 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:11:33.292168 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:11:33.292168 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:11:33.292168 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:11:33.292168 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:11:33.292168 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:11:33.292168 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application with Lock( Jul 28 08:11:33.292168 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:11:33.292168 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:11:33.292168 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:11:33.292168 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:11:33.293136 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:11:33.293136 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:11:33.293136 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:11:33.293136 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:11:33.293136 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 08:11:33.293136 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 08:11:33.293136 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 08:11:33.293136 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 08:11:33.293136 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 08:11:33.293136 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 08:11:33.293136 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 28 08:11:33.293136 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application Jul 28 08:11:33.293136 dv-cinder-851351-1-smb devstack@keystone.service[144068]: [pid: 144068|app: 0|req: 212/420] 10.222.0.42 () {56 vars in 1099 bytes} [Thu Jul 28 08:11:33 2022] GET /identity/v3/roles/member => generated 84 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:11:33.311118 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456d9f26-e579-4675-8fd8-6e6d2674998a None None] Authenticating user token {{(pid=144067) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:11:33.325588 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f48ac9-e8bc-4d27-9001-1d11fc7e6940 None admin] Authenticating user token {{(pid=144068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:11:33.369550 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG dbcounter [-] [144067] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=144067) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:11:33.470769 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f48ac9-e8bc-4d27-9001-1d11fc7e6940 None admin] Validating token access rules against request {{(pid=144068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:11:33.509590 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c6f7755-253f-475c-accc-768019619886 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:11:33.510263 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6f7755-253f-475c-accc-768019619886 None admin] REQUEST_METHOD: `GET` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:11:33.513436 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6f7755-253f-475c-accc-768019619886 None admin] SCRIPT_NAME: `/identity` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:11:33.513737 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6f7755-253f-475c-accc-768019619886 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:11:33.526988 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG dbcounter [-] [144068] Writing DB stats keystone:SELECT=100 {{(pid=144068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:11:33.538458 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456d9f26-e579-4675-8fd8-6e6d2674998a None None] Validating token access rules against request {{(pid=144067) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:11:33.540299 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c6f7755-253f-475c-accc-768019619886 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 08:11:33.545664 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application [None req-3c6f7755-253f-475c-accc-768019619886 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 28 08:11:33.545664 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:11:33.545664 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:11:33.545664 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:11:33.545664 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:11:33.545664 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:11:33.545664 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:11:33.545664 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:11:33.545664 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:11:33.545664 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:11:33.545664 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:11:33.545664 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:11:33.545664 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 08:11:33.545664 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 08:11:33.545664 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 08:11:33.545664 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 08:11:33.546708 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 08:11:33.546708 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 08:11:33.546708 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 08:11:33.546708 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 08:11:33.546708 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:11:33.546708 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:11:33.546708 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:11:33.546708 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:11:33.546708 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:11:33.546708 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:11:33.546708 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:11:33.546708 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application with Lock( Jul 28 08:11:33.546708 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:11:33.546708 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:11:33.546708 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:11:33.546708 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:11:33.547662 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:11:33.547662 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:11:33.547662 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:11:33.547662 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:11:33.547662 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 08:11:33.547662 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 08:11:33.547662 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 08:11:33.547662 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 08:11:33.547662 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 08:11:33.547662 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 08:11:33.547662 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 28 08:11:33.547662 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application Jul 28 08:11:33.548356 dv-cinder-851351-1-smb devstack@keystone.service[144068]: [pid: 144068|app: 0|req: 213/421] 10.222.0.42 () {56 vars in 1114 bytes} [Thu Jul 28 08:11:33 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:11:33.558422 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c6f7755-253f-475c-accc-768019619886 None admin] Authenticating user token {{(pid=144068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:11:33.607758 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e5d097-5376-405f-bcd8-c0b86f39f517 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144067) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:11:33.608858 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e5d097-5376-405f-bcd8-c0b86f39f517 None admin] REQUEST_METHOD: `GET` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:11:33.609358 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e5d097-5376-405f-bcd8-c0b86f39f517 None admin] SCRIPT_NAME: `/identity` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:11:33.609862 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e5d097-5376-405f-bcd8-c0b86f39f517 None admin] PATH_INFO: `/v3/roles` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:11:33.610816 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e5d097-5376-405f-bcd8-c0b86f39f517 None admin] RBAC: Adding query filter params (name=member) {{(pid=144067) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:11:33.611359 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e5d097-5376-405f-bcd8-c0b86f39f517 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:11:33.613020 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e5d097-5376-405f-bcd8-c0b86f39f517 None admin] RBAC: Authorization granted {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:11:33.630963 dv-cinder-851351-1-smb devstack@keystone.service[144067]: [pid: 144067|app: 0|req: 209/422] 10.222.0.42 () {56 vars in 1101 bytes} [Thu Jul 28 08:11:33 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 320 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:11:33.636365 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e5d097-5376-405f-bcd8-c0b86f39f517 None admin] Authenticating user token {{(pid=144067) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:11:33.666795 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c6f7755-253f-475c-accc-768019619886 None admin] Validating token access rules against request {{(pid=144068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:11:33.708221 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef39e824-de64-4651-ab17-a71da72179c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:11:33.708894 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef39e824-de64-4651-ab17-a71da72179c4 None admin] REQUEST_METHOD: `GET` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:11:33.709174 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef39e824-de64-4651-ab17-a71da72179c4 None admin] SCRIPT_NAME: `/identity` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:11:33.709444 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef39e824-de64-4651-ab17-a71da72179c4 None admin] PATH_INFO: `/v3/roles` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:11:33.710180 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef39e824-de64-4651-ab17-a71da72179c4 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=144068) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:11:33.711293 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef39e824-de64-4651-ab17-a71da72179c4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:11:33.712654 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef39e824-de64-4651-ab17-a71da72179c4 None admin] RBAC: Authorization granted {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:11:33.731653 dv-cinder-851351-1-smb devstack@keystone.service[144068]: [pid: 144068|app: 0|req: 214/423] 10.222.0.42 () {56 vars in 1111 bytes} [Thu Jul 28 08:11:33 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:11:33.737757 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef39e824-de64-4651-ab17-a71da72179c4 None admin] Authenticating user token {{(pid=144068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:11:33.818890 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG dbcounter [-] [144067] Writing DB stats keystone:SELECT=100 {{(pid=144067) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:11:33.826202 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e5d097-5376-405f-bcd8-c0b86f39f517 None admin] Validating token access rules against request {{(pid=144067) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:11:33.871433 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG dbcounter [-] [144068] Writing DB stats keystone:SELECT=100 {{(pid=144068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:11:33.882347 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc76655-6e03-49d4-bd2e-ec680cdb787c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144067) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:11:33.883007 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc76655-6e03-49d4-bd2e-ec680cdb787c None admin] REQUEST_METHOD: `GET` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:11:33.883292 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc76655-6e03-49d4-bd2e-ec680cdb787c None admin] SCRIPT_NAME: `/identity` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:11:33.883571 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc76655-6e03-49d4-bd2e-ec680cdb787c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:11:33.944004 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef39e824-de64-4651-ab17-a71da72179c4 None admin] Validating token access rules against request {{(pid=144068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:11:34.005685 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc76655-6e03-49d4-bd2e-ec680cdb787c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:11:34.007207 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc76655-6e03-49d4-bd2e-ec680cdb787c None admin] RBAC: Authorization granted {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:11:34.011577 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a013b7b-8448-49f3-9678-20880cbd0b53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:11:34.012219 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a013b7b-8448-49f3-9678-20880cbd0b53 None admin] REQUEST_METHOD: `GET` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:11:34.012502 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a013b7b-8448-49f3-9678-20880cbd0b53 None admin] SCRIPT_NAME: `/identity` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:11:34.012875 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a013b7b-8448-49f3-9678-20880cbd0b53 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:11:34.139537 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a013b7b-8448-49f3-9678-20880cbd0b53 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:11:34.141074 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a013b7b-8448-49f3-9678-20880cbd0b53 None admin] RBAC: Authorization granted {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:11:34.178160 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG dbcounter [-] [144067] Writing DB stats keystone:SELECT=100 {{(pid=144067) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:11:34.189559 dv-cinder-851351-1-smb devstack@keystone.service[144067]: [pid: 144067|app: 0|req: 210/424] 10.222.0.42 () {58 vars in 1282 bytes} [Thu Jul 28 08:11:33 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 553 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 28 08:11:34.194968 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc76655-6e03-49d4-bd2e-ec680cdb787c None admin] Authenticating user token {{(pid=144067) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:11:34.235071 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG dbcounter [-] [144068] Writing DB stats keystone:SELECT=100 {{(pid=144068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:11:34.283629 dv-cinder-851351-1-smb devstack@keystone.service[144068]: [pid: 144068|app: 0|req: 215/425] 10.222.0.42 () {58 vars in 1282 bytes} [Thu Jul 28 08:11:33 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 546 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 28 08:11:34.289518 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d83891-b8ee-4b91-b8d4-0b584644bbb5 None None] REQUEST_METHOD: `GET` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:11:34.289834 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d83891-b8ee-4b91-b8d4-0b584644bbb5 None None] SCRIPT_NAME: `/identity` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:11:34.290121 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d83891-b8ee-4b91-b8d4-0b584644bbb5 None None] PATH_INFO: `/` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:11:34.296347 dv-cinder-851351-1-smb devstack@keystone.service[144068]: [pid: 144068|app: 0|req: 216/426] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 08:11:34 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 08:11:34.296347 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d83891-b8ee-4b91-b8d4-0b584644bbb5 None None] Authenticating user token {{(pid=144068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:11:34.337817 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc76655-6e03-49d4-bd2e-ec680cdb787c None admin] Validating token access rules against request {{(pid=144067) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:11:34.375023 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7877f22-1ccc-4ac0-a8a2-98d8f6db1037 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144067) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:11:34.375777 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7877f22-1ccc-4ac0-a8a2-98d8f6db1037 None admin] REQUEST_METHOD: `GET` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:11:34.376148 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7877f22-1ccc-4ac0-a8a2-98d8f6db1037 None admin] SCRIPT_NAME: `/identity` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:11:34.376499 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7877f22-1ccc-4ac0-a8a2-98d8f6db1037 None admin] PATH_INFO: `/v3/projects/49167073baf644459c58534448b0037f` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:11:34.377847 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7877f22-1ccc-4ac0-a8a2-98d8f6db1037 None admin] RBAC: Authorizing `identity:get_project(project_id=49167073baf644459c58534448b0037f)` {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:11:34.379545 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7877f22-1ccc-4ac0-a8a2-98d8f6db1037 None admin] RBAC: Authorization granted {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:11:34.381382 dv-cinder-851351-1-smb devstack@keystone.service[144067]: [pid: 144067|app: 0|req: 211/427] 10.222.0.42 () {56 vars in 1186 bytes} [Thu Jul 28 08:11:34 2022] GET /identity/v3/projects/49167073baf644459c58534448b0037f => generated 298 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 08:11:34.386194 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c395ef3-0aaf-4ca4-8835-058ed2356fb8 None None] REQUEST_METHOD: `POST` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:11:34.386363 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c395ef3-0aaf-4ca4-8835-058ed2356fb8 None None] SCRIPT_NAME: `/identity` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:11:34.386655 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c395ef3-0aaf-4ca4-8835-058ed2356fb8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:11:34.410695 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.auth.core [None req-4c395ef3-0aaf-4ca4-8835-058ed2356fb8 None None] MFA Rules not processed for user `bf5ceb8f07374635ad506b7d1b4f1612`. Rule list: `[]` (Enabled: `True`). {{(pid=144067) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 08:11:34.412186 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.fernet_utils [None req-4c395ef3-0aaf-4ca4-8835-058ed2356fb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=144067) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:11:34.413370 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d83891-b8ee-4b91-b8d4-0b584644bbb5 None None] Validating token access rules against request {{(pid=144068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:11:34.469767 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70579977-25e6-4dab-bdc3-3f9f6959caf8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:11:34.470569 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70579977-25e6-4dab-bdc3-3f9f6959caf8 None admin] REQUEST_METHOD: `GET` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:11:34.470945 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70579977-25e6-4dab-bdc3-3f9f6959caf8 None admin] SCRIPT_NAME: `/identity` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:11:34.471300 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70579977-25e6-4dab-bdc3-3f9f6959caf8 None admin] PATH_INFO: `/v3/projects/49167073baf644459c58534448b0037f` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:11:34.472790 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70579977-25e6-4dab-bdc3-3f9f6959caf8 None admin] RBAC: Authorizing `identity:get_project(project_id=49167073baf644459c58534448b0037f)` {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:11:34.474516 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70579977-25e6-4dab-bdc3-3f9f6959caf8 None admin] RBAC: Authorization granted {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:11:34.476771 dv-cinder-851351-1-smb devstack@keystone.service[144068]: [pid: 144068|app: 0|req: 217/428] 10.222.0.42 () {56 vars in 1186 bytes} [Thu Jul 28 08:11:34 2022] GET /identity/v3/projects/49167073baf644459c58534448b0037f => generated 298 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:11:34.477770 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70579977-25e6-4dab-bdc3-3f9f6959caf8 None admin] Authenticating user token {{(pid=144068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:11:34.495202 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG dbcounter [-] [144067] Writing DB stats keystone:SELECT=100 {{(pid=144067) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:11:34.512182 dv-cinder-851351-1-smb devstack@keystone.service[144067]: [pid: 144067|app: 0|req: 212/429] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 08:11:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 08:11:34.513170 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c395ef3-0aaf-4ca4-8835-058ed2356fb8 None None] Authenticating user token {{(pid=144067) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:11:34.520407 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG dbcounter [-] [144068] Writing DB stats keystone:SELECT=100 {{(pid=144068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:11:34.613501 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70579977-25e6-4dab-bdc3-3f9f6959caf8 None admin] Validating token access rules against request {{(pid=144068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:11:34.633335 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c395ef3-0aaf-4ca4-8835-058ed2356fb8 None None] Validating token access rules against request {{(pid=144067) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:11:34.651918 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b1f1bab-e25d-4e52-bb08-9298a1821223 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:11:34.653001 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1f1bab-e25d-4e52-bb08-9298a1821223 None admin] REQUEST_METHOD: `GET` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:11:34.653507 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1f1bab-e25d-4e52-bb08-9298a1821223 None admin] SCRIPT_NAME: `/identity` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:11:34.654113 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1f1bab-e25d-4e52-bb08-9298a1821223 None admin] PATH_INFO: `/v3/groups/cfc51bfe26d54218b5109575a2ff2a46` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:11:34.655773 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b1f1bab-e25d-4e52-bb08-9298a1821223 None admin] RBAC: Authorizing `identity:get_group(group_id=cfc51bfe26d54218b5109575a2ff2a46)` {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:11:34.657475 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b1f1bab-e25d-4e52-bb08-9298a1821223 None admin] RBAC: Authorization granted {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:11:34.659752 dv-cinder-851351-1-smb devstack@keystone.service[144068]: [pid: 144068|app: 0|req: 218/430] 10.222.0.42 () {56 vars in 1180 bytes} [Thu Jul 28 08:11:34 2022] GET /identity/v3/groups/cfc51bfe26d54218b5109575a2ff2a46 => generated 226 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:11:34.660878 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b1f1bab-e25d-4e52-bb08-9298a1821223 None admin] Authenticating user token {{(pid=144068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:11:34.681880 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b491cd7-ed0f-43e4-b3f6-17d628908b8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144067) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:11:34.682579 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b491cd7-ed0f-43e4-b3f6-17d628908b8b None admin] REQUEST_METHOD: `GET` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:11:34.682871 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b491cd7-ed0f-43e4-b3f6-17d628908b8b None admin] SCRIPT_NAME: `/identity` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:11:34.683145 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b491cd7-ed0f-43e4-b3f6-17d628908b8b None admin] PATH_INFO: `/v3/groups/cfc51bfe26d54218b5109575a2ff2a46` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:11:34.684763 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b491cd7-ed0f-43e4-b3f6-17d628908b8b None admin] RBAC: Authorizing `identity:get_group(group_id=cfc51bfe26d54218b5109575a2ff2a46)` {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:11:34.686254 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b491cd7-ed0f-43e4-b3f6-17d628908b8b None admin] RBAC: Authorization granted {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:11:34.692734 dv-cinder-851351-1-smb devstack@keystone.service[144067]: [pid: 144067|app: 0|req: 213/431] 10.222.0.42 () {56 vars in 1180 bytes} [Thu Jul 28 08:11:34 2022] GET /identity/v3/groups/cfc51bfe26d54218b5109575a2ff2a46 => generated 226 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:11:34.693905 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b491cd7-ed0f-43e4-b3f6-17d628908b8b None admin] Authenticating user token {{(pid=144067) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:11:34.774568 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG dbcounter [-] [144067] Writing DB stats keystone:SELECT=100 {{(pid=144067) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:11:34.783724 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG dbcounter [-] [144068] Writing DB stats keystone:SELECT=100 {{(pid=144068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:11:34.792372 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b1f1bab-e25d-4e52-bb08-9298a1821223 None admin] Validating token access rules against request {{(pid=144068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:11:34.823257 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b491cd7-ed0f-43e4-b3f6-17d628908b8b None admin] Validating token access rules against request {{(pid=144067) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:11:34.836474 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c6beba-0e7f-4815-b32b-edc65c206df5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:11:34.837521 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c6beba-0e7f-4815-b32b-edc65c206df5 None admin] REQUEST_METHOD: `GET` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:11:34.837768 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c6beba-0e7f-4815-b32b-edc65c206df5 None admin] SCRIPT_NAME: `/identity` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:11:34.838037 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c6beba-0e7f-4815-b32b-edc65c206df5 None admin] PATH_INFO: `/v3/roles/member` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:11:34.852452 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c6beba-0e7f-4815-b32b-edc65c206df5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 08:11:34.859496 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application [None req-f2c6beba-0e7f-4815-b32b-edc65c206df5 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 28 08:11:34.859496 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:11:34.859496 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:11:34.859496 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:11:34.859496 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:11:34.859496 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:11:34.859496 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:11:34.859496 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:11:34.859496 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:11:34.859496 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:11:34.859496 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:11:34.859496 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:11:34.859496 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 08:11:34.859496 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 08:11:34.859496 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 08:11:34.859496 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 08:11:34.860649 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 08:11:34.860649 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 08:11:34.860649 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 08:11:34.860649 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 08:11:34.860649 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:11:34.860649 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:11:34.860649 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:11:34.860649 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:11:34.860649 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:11:34.860649 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:11:34.860649 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:11:34.860649 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application with Lock( Jul 28 08:11:34.860649 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:11:34.860649 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:11:34.860649 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:11:34.860649 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:11:34.861624 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:11:34.861624 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:11:34.861624 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:11:34.861624 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:11:34.861624 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 08:11:34.861624 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 08:11:34.861624 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 08:11:34.861624 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 08:11:34.861624 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 08:11:34.861624 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 08:11:34.861624 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 28 08:11:34.861624 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application Jul 28 08:11:34.861624 dv-cinder-851351-1-smb devstack@keystone.service[144068]: [pid: 144068|app: 0|req: 219/432] 10.222.0.42 () {56 vars in 1099 bytes} [Thu Jul 28 08:11:34 2022] GET /identity/v3/roles/member => generated 84 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:11:34.861624 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c6beba-0e7f-4815-b32b-edc65c206df5 None admin] Authenticating user token {{(pid=144068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:11:34.871806 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8100b3b2-33e9-4da4-972e-178a29960901 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144067) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:11:34.872871 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8100b3b2-33e9-4da4-972e-178a29960901 None admin] REQUEST_METHOD: `GET` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:11:34.873384 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8100b3b2-33e9-4da4-972e-178a29960901 None admin] SCRIPT_NAME: `/identity` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:11:34.873869 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8100b3b2-33e9-4da4-972e-178a29960901 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:11:34.874927 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8100b3b2-33e9-4da4-972e-178a29960901 None admin] RBAC: Adding query filter params (group.id=cfc51bfe26d54218b5109575a2ff2a46, role.id=6933b60756fe46dd8f27854f5e192061, scope.project.id=49167073baf644459c58534448b0037f) {{(pid=144067) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:11:34.875592 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8100b3b2-33e9-4da4-972e-178a29960901 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:11:34.877508 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8100b3b2-33e9-4da4-972e-178a29960901 None admin] RBAC: Authorization granted {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:11:34.885050 dv-cinder-851351-1-smb devstack@keystone.service[144067]: [pid: 144067|app: 0|req: 214/433] 10.222.0.42 () {56 vars in 1376 bytes} [Thu Jul 28 08:11:34 2022] GET /identity/v3/role_assignments?group.id=cfc51bfe26d54218b5109575a2ff2a46&scope.project.id=49167073baf644459c58534448b0037f&role.id=6933b60756fe46dd8f27854f5e192061 => generated 611 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:11:34.886129 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8100b3b2-33e9-4da4-972e-178a29960901 None admin] Authenticating user token {{(pid=144067) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:11:35.090315 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8100b3b2-33e9-4da4-972e-178a29960901 None admin] Validating token access rules against request {{(pid=144067) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:11:35.093989 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c6beba-0e7f-4815-b32b-edc65c206df5 None admin] Validating token access rules against request {{(pid=144068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:11:35.119315 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG dbcounter [-] [144067] Writing DB stats keystone:SELECT=100 {{(pid=144067) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:11:35.135219 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2bf0782-7e1f-4058-810a-b0a1f7692c72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144067) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:11:35.136282 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2bf0782-7e1f-4058-810a-b0a1f7692c72 None admin] REQUEST_METHOD: `GET` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:11:35.137295 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2bf0782-7e1f-4058-810a-b0a1f7692c72 None admin] SCRIPT_NAME: `/identity` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:11:35.137920 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2bf0782-7e1f-4058-810a-b0a1f7692c72 None admin] PATH_INFO: `/v3/roles` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:11:35.138710 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f383253-c1bc-43e0-8008-76e5bde14a29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:11:35.139209 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2bf0782-7e1f-4058-810a-b0a1f7692c72 None admin] RBAC: Adding query filter params (name=member) {{(pid=144067) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:11:35.139336 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f383253-c1bc-43e0-8008-76e5bde14a29 None admin] REQUEST_METHOD: `GET` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:11:35.139615 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f383253-c1bc-43e0-8008-76e5bde14a29 None admin] SCRIPT_NAME: `/identity` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:11:35.140172 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f383253-c1bc-43e0-8008-76e5bde14a29 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:11:35.140699 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f383253-c1bc-43e0-8008-76e5bde14a29 None admin] RBAC: Adding query filter params (group.id=cfc51bfe26d54218b5109575a2ff2a46, role.id=7e9c2306137042cf8b8eba284656ef33, scope.project.id=49167073baf644459c58534448b0037f) {{(pid=144068) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:11:35.141036 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f383253-c1bc-43e0-8008-76e5bde14a29 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:11:35.141393 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2bf0782-7e1f-4058-810a-b0a1f7692c72 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:11:35.143529 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f383253-c1bc-43e0-8008-76e5bde14a29 None admin] RBAC: Authorization granted {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:11:35.143875 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2bf0782-7e1f-4058-810a-b0a1f7692c72 None admin] RBAC: Authorization granted {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:11:35.151969 dv-cinder-851351-1-smb devstack@keystone.service[144068]: [pid: 144068|app: 0|req: 220/434] 10.222.0.42 () {56 vars in 1376 bytes} [Thu Jul 28 08:11:34 2022] GET /identity/v3/role_assignments?group.id=cfc51bfe26d54218b5109575a2ff2a46&scope.project.id=49167073baf644459c58534448b0037f&role.id=7e9c2306137042cf8b8eba284656ef33 => generated 611 bytes in 290 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:11:35.160982 dv-cinder-851351-1-smb devstack@keystone.service[144067]: [pid: 144067|app: 0|req: 215/435] 10.222.0.42 () {56 vars in 1101 bytes} [Thu Jul 28 08:11:34 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:11:35.168736 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f383253-c1bc-43e0-8008-76e5bde14a29 None admin] Authenticating user token {{(pid=144068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:11:35.202105 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbae5da8-6896-40da-8e01-d85bd42c60ce None None] REQUEST_METHOD: `GET` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:11:35.202401 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbae5da8-6896-40da-8e01-d85bd42c60ce None None] SCRIPT_NAME: `/identity` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:11:35.202685 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbae5da8-6896-40da-8e01-d85bd42c60ce None None] PATH_INFO: `/` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:11:35.202795 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG dbcounter [-] [144068] Writing DB stats keystone:SELECT=100 {{(pid=144068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:11:35.208656 dv-cinder-851351-1-smb devstack@keystone.service[144067]: [pid: 144067|app: 0|req: 216/436] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 08:11:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 08:11:35.211689 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56641653-3bbf-4954-a3bf-a2dac9b4fa66 None None] REQUEST_METHOD: `POST` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:11:35.211974 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56641653-3bbf-4954-a3bf-a2dac9b4fa66 None None] SCRIPT_NAME: `/identity` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:11:35.212348 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56641653-3bbf-4954-a3bf-a2dac9b4fa66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:11:35.235236 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.auth.core [None req-56641653-3bbf-4954-a3bf-a2dac9b4fa66 None None] MFA Rules not processed for user `bf5ceb8f07374635ad506b7d1b4f1612`. Rule list: `[]` (Enabled: `True`). {{(pid=144067) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 08:11:35.236630 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.fernet_utils [None req-56641653-3bbf-4954-a3bf-a2dac9b4fa66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=144067) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:11:35.314709 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f383253-c1bc-43e0-8008-76e5bde14a29 None admin] Validating token access rules against request {{(pid=144068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:11:35.352728 dv-cinder-851351-1-smb devstack@keystone.service[144067]: [pid: 144067|app: 0|req: 217/437] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 08:11:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 08:11:35.370600 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e094c4-5017-458f-b8cc-101ccda7d098 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:11:35.371251 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e094c4-5017-458f-b8cc-101ccda7d098 None admin] REQUEST_METHOD: `GET` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:11:35.371551 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e094c4-5017-458f-b8cc-101ccda7d098 None admin] SCRIPT_NAME: `/identity` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:11:35.371828 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e094c4-5017-458f-b8cc-101ccda7d098 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:11:35.383056 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56641653-3bbf-4954-a3bf-a2dac9b4fa66 None None] Authenticating user token {{(pid=144067) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:11:35.468731 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33e094c4-5017-458f-b8cc-101ccda7d098 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:11:35.470971 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33e094c4-5017-458f-b8cc-101ccda7d098 None admin] RBAC: Authorization granted {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:11:35.499329 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG dbcounter [-] [144068] Writing DB stats keystone:SELECT=100 {{(pid=144068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:11:35.536345 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56641653-3bbf-4954-a3bf-a2dac9b4fa66 None None] Validating token access rules against request {{(pid=144067) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:11:35.565785 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG dbcounter [-] [144067] Writing DB stats keystone:SELECT=100 {{(pid=144067) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:11:35.589508 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b26430db-b4e9-49e3-8edd-9471683551cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144067) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:11:35.590166 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26430db-b4e9-49e3-8edd-9471683551cb None admin] REQUEST_METHOD: `GET` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:11:35.590448 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26430db-b4e9-49e3-8edd-9471683551cb None admin] SCRIPT_NAME: `/identity` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:11:35.590726 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26430db-b4e9-49e3-8edd-9471683551cb None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:11:35.602631 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b26430db-b4e9-49e3-8edd-9471683551cb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 08:11:35.608467 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application [None req-b26430db-b4e9-49e3-8edd-9471683551cb None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 28 08:11:35.608467 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:11:35.608467 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:11:35.608467 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:11:35.608467 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:11:35.608467 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:11:35.608467 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:11:35.608467 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:11:35.608467 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:11:35.608467 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:11:35.608467 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:11:35.608467 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:11:35.608467 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 08:11:35.608467 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 08:11:35.608467 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 08:11:35.608467 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 08:11:35.609668 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 08:11:35.609668 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 08:11:35.609668 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 08:11:35.609668 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 08:11:35.609668 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:11:35.609668 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:11:35.609668 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:11:35.609668 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:11:35.609668 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:11:35.609668 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:11:35.609668 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:11:35.609668 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application with Lock( Jul 28 08:11:35.609668 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:11:35.609668 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:11:35.609668 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:11:35.609668 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:11:35.610677 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:11:35.610677 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:11:35.610677 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:11:35.610677 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:11:35.610677 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 08:11:35.610677 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 08:11:35.610677 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 08:11:35.610677 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 08:11:35.610677 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 08:11:35.610677 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 08:11:35.610677 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 28 08:11:35.610677 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application Jul 28 08:11:35.612769 dv-cinder-851351-1-smb devstack@keystone.service[144067]: [pid: 144067|app: 0|req: 218/438] 10.222.0.42 () {56 vars in 1114 bytes} [Thu Jul 28 08:11:35 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:11:35.613501 dv-cinder-851351-1-smb devstack@keystone.service[144068]: [pid: 144068|app: 0|req: 221/439] 10.222.0.42 () {58 vars in 1282 bytes} [Thu Jul 28 08:11:35 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 447 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 28 08:11:35.614650 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66bb287f-5b34-4450-80c3-a6e93512dff9 None None] REQUEST_METHOD: `GET` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:11:35.615504 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66bb287f-5b34-4450-80c3-a6e93512dff9 None None] SCRIPT_NAME: `/identity` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:11:35.615793 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66bb287f-5b34-4450-80c3-a6e93512dff9 None None] PATH_INFO: `/` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:11:35.620286 dv-cinder-851351-1-smb devstack@keystone.service[144067]: [pid: 144067|app: 0|req: 219/440] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 08:11:35 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 08:11:35.623585 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e094c4-5017-458f-b8cc-101ccda7d098 None admin] Authenticating user token {{(pid=144068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:11:35.623742 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8c6296-9477-46c0-b5e3-5c11f3d50f61 None None] REQUEST_METHOD: `POST` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:11:35.624039 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8c6296-9477-46c0-b5e3-5c11f3d50f61 None None] SCRIPT_NAME: `/identity` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:11:35.624325 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8c6296-9477-46c0-b5e3-5c11f3d50f61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:11:35.644922 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.auth.core [None req-5c8c6296-9477-46c0-b5e3-5c11f3d50f61 None None] MFA Rules not processed for user `bf5ceb8f07374635ad506b7d1b4f1612`. Rule list: `[]` (Enabled: `True`). {{(pid=144067) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 08:11:35.647294 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.fernet_utils [None req-5c8c6296-9477-46c0-b5e3-5c11f3d50f61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=144067) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:11:35.741254 dv-cinder-851351-1-smb devstack@keystone.service[144067]: [pid: 144067|app: 0|req: 220/441] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 08:11:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 08:11:35.741889 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c8c6296-9477-46c0-b5e3-5c11f3d50f61 None None] Authenticating user token {{(pid=144067) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:11:35.774620 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e094c4-5017-458f-b8cc-101ccda7d098 None admin] Validating token access rules against request {{(pid=144068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:11:35.798224 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG dbcounter [-] [144068] Writing DB stats keystone:SELECT=100 {{(pid=144068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:11:35.815968 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb81bd59-fbda-49fd-bdcc-173cf59a02dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:11:35.816769 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb81bd59-fbda-49fd-bdcc-173cf59a02dd None admin] REQUEST_METHOD: `GET` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:11:35.817048 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb81bd59-fbda-49fd-bdcc-173cf59a02dd None admin] SCRIPT_NAME: `/identity` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:11:35.817319 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb81bd59-fbda-49fd-bdcc-173cf59a02dd None admin] PATH_INFO: `/v3/projects/2c58e7ea67d84cf692dd9eb3f6cb73a0` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:11:35.818510 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb81bd59-fbda-49fd-bdcc-173cf59a02dd None admin] RBAC: Authorizing `identity:get_project(project_id=2c58e7ea67d84cf692dd9eb3f6cb73a0)` {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:11:35.819971 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb81bd59-fbda-49fd-bdcc-173cf59a02dd None admin] RBAC: Authorization granted {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:11:35.821937 dv-cinder-851351-1-smb devstack@keystone.service[144068]: [pid: 144068|app: 0|req: 222/442] 10.222.0.42 () {56 vars in 1186 bytes} [Thu Jul 28 08:11:35 2022] GET /identity/v3/projects/2c58e7ea67d84cf692dd9eb3f6cb73a0 => generated 302 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:11:35.822715 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb81bd59-fbda-49fd-bdcc-173cf59a02dd None admin] Authenticating user token {{(pid=144068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:11:35.866327 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c8c6296-9477-46c0-b5e3-5c11f3d50f61 None None] Validating token access rules against request {{(pid=144067) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:11:35.873974 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG dbcounter [-] [144067] Writing DB stats keystone:SELECT=100 {{(pid=144067) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:11:35.902173 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e045638d-b717-4957-97e1-c6266c8097ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144067) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:11:35.902814 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e045638d-b717-4957-97e1-c6266c8097ba None admin] REQUEST_METHOD: `GET` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:11:35.903082 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e045638d-b717-4957-97e1-c6266c8097ba None admin] SCRIPT_NAME: `/identity` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:11:35.903363 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e045638d-b717-4957-97e1-c6266c8097ba None admin] PATH_INFO: `/v3/roles` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:11:35.904091 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e045638d-b717-4957-97e1-c6266c8097ba None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=144067) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:11:35.904397 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e045638d-b717-4957-97e1-c6266c8097ba None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:11:35.905842 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e045638d-b717-4957-97e1-c6266c8097ba None admin] RBAC: Authorization granted {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:11:35.919771 dv-cinder-851351-1-smb devstack@keystone.service[144067]: [pid: 144067|app: 0|req: 221/443] 10.222.0.42 () {56 vars in 1111 bytes} [Thu Jul 28 08:11:35 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:11:35.920631 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e045638d-b717-4957-97e1-c6266c8097ba None admin] Authenticating user token {{(pid=144067) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:11:35.943354 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb81bd59-fbda-49fd-bdcc-173cf59a02dd None admin] Validating token access rules against request {{(pid=144068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:11:35.982077 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-822cd5fc-4d73-405c-ab28-86cdac38e771 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:11:35.983078 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822cd5fc-4d73-405c-ab28-86cdac38e771 None admin] REQUEST_METHOD: `GET` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:11:35.983078 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822cd5fc-4d73-405c-ab28-86cdac38e771 None admin] SCRIPT_NAME: `/identity` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:11:35.984236 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822cd5fc-4d73-405c-ab28-86cdac38e771 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:11:35.996483 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-822cd5fc-4d73-405c-ab28-86cdac38e771 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 08:11:36.001367 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application [None req-822cd5fc-4d73-405c-ab28-86cdac38e771 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 08:11:36.001367 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:11:36.001367 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:11:36.001367 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:11:36.001367 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:11:36.001367 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:11:36.001367 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:11:36.001367 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:11:36.001367 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:11:36.001367 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:11:36.001367 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:11:36.001367 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:11:36.001367 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 08:11:36.001367 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 08:11:36.001367 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 08:11:36.001367 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 08:11:36.002487 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 08:11:36.002487 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 08:11:36.002487 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 08:11:36.002487 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 08:11:36.002487 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:11:36.002487 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:11:36.002487 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:11:36.002487 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:11:36.002487 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:11:36.002487 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:11:36.002487 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:11:36.002487 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application with Lock( Jul 28 08:11:36.002487 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:11:36.002487 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:11:36.002487 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:11:36.002487 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:11:36.008642 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:11:36.008642 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:11:36.008642 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:11:36.008642 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:11:36.008642 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 08:11:36.008642 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 08:11:36.008642 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 08:11:36.008642 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 08:11:36.008642 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 08:11:36.008642 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 08:11:36.008642 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 08:11:36.008642 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application Jul 28 08:11:36.008642 dv-cinder-851351-1-smb devstack@keystone.service[144068]: [pid: 144068|app: 0|req: 223/444] 10.222.0.42 () {56 vars in 1096 bytes} [Thu Jul 28 08:11:35 2022] GET /identity/v3/roles/admin => generated 83 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:11:36.008642 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-822cd5fc-4d73-405c-ab28-86cdac38e771 None admin] Authenticating user token {{(pid=144068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:11:36.044342 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e045638d-b717-4957-97e1-c6266c8097ba None admin] Validating token access rules against request {{(pid=144067) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:11:36.056657 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG dbcounter [-] [144068] Writing DB stats keystone:SELECT=100 {{(pid=144068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:11:36.084264 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ab289c-218b-41ba-9e03-23b45435d0c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144067) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:11:36.085233 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ab289c-218b-41ba-9e03-23b45435d0c9 None admin] REQUEST_METHOD: `GET` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:11:36.085981 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ab289c-218b-41ba-9e03-23b45435d0c9 None admin] SCRIPT_NAME: `/identity` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:11:36.086460 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ab289c-218b-41ba-9e03-23b45435d0c9 None admin] PATH_INFO: `/v3/groups/cfc51bfe26d54218b5109575a2ff2a46` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:11:36.088088 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18ab289c-218b-41ba-9e03-23b45435d0c9 None admin] RBAC: Authorizing `identity:get_group(group_id=cfc51bfe26d54218b5109575a2ff2a46)` {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:11:36.090638 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18ab289c-218b-41ba-9e03-23b45435d0c9 None admin] RBAC: Authorization granted {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:11:36.092918 dv-cinder-851351-1-smb devstack@keystone.service[144067]: [pid: 144067|app: 0|req: 222/445] 10.222.0.42 () {56 vars in 1180 bytes} [Thu Jul 28 08:11:35 2022] GET /identity/v3/groups/cfc51bfe26d54218b5109575a2ff2a46 => generated 226 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:11:36.093592 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ab289c-218b-41ba-9e03-23b45435d0c9 None admin] Authenticating user token {{(pid=144067) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:11:36.120148 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-822cd5fc-4d73-405c-ab28-86cdac38e771 None admin] Validating token access rules against request {{(pid=144068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:11:36.130930 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG dbcounter [-] [144067] Writing DB stats keystone:SELECT=100 {{(pid=144067) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:11:36.156300 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945b40cd-179a-4956-affc-fcc7e8cf3fdf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:11:36.157003 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945b40cd-179a-4956-affc-fcc7e8cf3fdf None admin] REQUEST_METHOD: `GET` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:11:36.157268 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945b40cd-179a-4956-affc-fcc7e8cf3fdf None admin] SCRIPT_NAME: `/identity` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:11:36.157563 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945b40cd-179a-4956-affc-fcc7e8cf3fdf None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:11:36.211230 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ab289c-218b-41ba-9e03-23b45435d0c9 None admin] Validating token access rules against request {{(pid=144067) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:11:36.233154 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-945b40cd-179a-4956-affc-fcc7e8cf3fdf None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:11:36.234673 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-945b40cd-179a-4956-affc-fcc7e8cf3fdf None admin] RBAC: Authorization granted {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:11:36.250811 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb111357-9e21-4658-a704-d09e797798b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144067) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:11:36.251381 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb111357-9e21-4658-a704-d09e797798b2 None admin] REQUEST_METHOD: `GET` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:11:36.251638 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb111357-9e21-4658-a704-d09e797798b2 None admin] SCRIPT_NAME: `/identity` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:11:36.251915 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb111357-9e21-4658-a704-d09e797798b2 None admin] PATH_INFO: `/v3/roles` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:11:36.252650 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb111357-9e21-4658-a704-d09e797798b2 None admin] RBAC: Adding query filter params (name=admin) {{(pid=144067) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:11:36.255479 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb111357-9e21-4658-a704-d09e797798b2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:11:36.255479 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb111357-9e21-4658-a704-d09e797798b2 None admin] RBAC: Authorization granted {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:11:36.263111 dv-cinder-851351-1-smb devstack@keystone.service[144067]: [pid: 144067|app: 0|req: 223/446] 10.222.0.42 () {56 vars in 1099 bytes} [Thu Jul 28 08:11:36 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:11:36.263946 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb111357-9e21-4658-a704-d09e797798b2 None admin] Authenticating user token {{(pid=144067) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:11:36.296925 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG dbcounter [-] [144068] Writing DB stats keystone:SELECT=100 {{(pid=144068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:11:36.358826 dv-cinder-851351-1-smb devstack@keystone.service[144068]: [pid: 144068|app: 0|req: 224/447] 10.222.0.42 () {58 vars in 1282 bytes} [Thu Jul 28 08:11:36 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 356 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 28 08:11:36.359765 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945b40cd-179a-4956-affc-fcc7e8cf3fdf None admin] Authenticating user token {{(pid=144068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:11:36.373032 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG dbcounter [-] [144067] Writing DB stats keystone:SELECT=100 {{(pid=144067) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:11:36.377592 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb111357-9e21-4658-a704-d09e797798b2 None admin] Validating token access rules against request {{(pid=144067) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:11:36.414969 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fee06ee-5298-4ea9-925e-cc34f03081ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144067) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:11:36.415610 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fee06ee-5298-4ea9-925e-cc34f03081ee None admin] REQUEST_METHOD: `GET` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:11:36.415890 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fee06ee-5298-4ea9-925e-cc34f03081ee None admin] SCRIPT_NAME: `/identity` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:11:36.416190 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fee06ee-5298-4ea9-925e-cc34f03081ee None admin] PATH_INFO: `/v3/role_assignments` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:11:36.417020 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fee06ee-5298-4ea9-925e-cc34f03081ee None admin] RBAC: Adding query filter params (group.id=cfc51bfe26d54218b5109575a2ff2a46, role.id=6933b60756fe46dd8f27854f5e192061, scope.project.id=2c58e7ea67d84cf692dd9eb3f6cb73a0) {{(pid=144067) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:11:36.417334 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fee06ee-5298-4ea9-925e-cc34f03081ee None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:11:36.418842 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fee06ee-5298-4ea9-925e-cc34f03081ee None admin] RBAC: Authorization granted {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:11:36.425269 dv-cinder-851351-1-smb devstack@keystone.service[144067]: [pid: 144067|app: 0|req: 224/448] 10.222.0.42 () {56 vars in 1376 bytes} [Thu Jul 28 08:11:36 2022] GET /identity/v3/role_assignments?group.id=cfc51bfe26d54218b5109575a2ff2a46&scope.project.id=2c58e7ea67d84cf692dd9eb3f6cb73a0&role.id=6933b60756fe46dd8f27854f5e192061 => generated 611 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:11:36.426144 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fee06ee-5298-4ea9-925e-cc34f03081ee None admin] Authenticating user token {{(pid=144067) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:11:36.478849 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945b40cd-179a-4956-affc-fcc7e8cf3fdf None admin] Validating token access rules against request {{(pid=144068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:11:36.531622 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c27fb13b-43cf-4dfe-8cbb-4be87ae3a03b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:11:36.532299 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27fb13b-43cf-4dfe-8cbb-4be87ae3a03b None admin] REQUEST_METHOD: `GET` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:11:36.533588 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27fb13b-43cf-4dfe-8cbb-4be87ae3a03b None admin] SCRIPT_NAME: `/identity` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:11:36.533588 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27fb13b-43cf-4dfe-8cbb-4be87ae3a03b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:11:36.557375 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG dbcounter [-] [144068] Writing DB stats keystone:SELECT=100 {{(pid=144068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:11:36.572043 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fee06ee-5298-4ea9-925e-cc34f03081ee None admin] Validating token access rules against request {{(pid=144067) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:11:36.627971 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0067cb-31de-4f12-8166-bf94406c64e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144067) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:11:36.629232 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0067cb-31de-4f12-8166-bf94406c64e4 None admin] REQUEST_METHOD: `GET` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:11:36.629750 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0067cb-31de-4f12-8166-bf94406c64e4 None admin] SCRIPT_NAME: `/identity` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:11:36.629981 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c27fb13b-43cf-4dfe-8cbb-4be87ae3a03b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:11:36.630097 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0067cb-31de-4f12-8166-bf94406c64e4 None admin] PATH_INFO: `/v3/projects/2c58e7ea67d84cf692dd9eb3f6cb73a0` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:11:36.631431 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d0067cb-31de-4f12-8166-bf94406c64e4 None admin] RBAC: Authorizing `identity:get_project(project_id=2c58e7ea67d84cf692dd9eb3f6cb73a0)` {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:11:36.631560 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c27fb13b-43cf-4dfe-8cbb-4be87ae3a03b None admin] RBAC: Authorization granted {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:11:36.632963 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d0067cb-31de-4f12-8166-bf94406c64e4 None admin] RBAC: Authorization granted {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:11:36.635425 dv-cinder-851351-1-smb devstack@keystone.service[144067]: [pid: 144067|app: 0|req: 225/449] 10.222.0.42 () {56 vars in 1186 bytes} [Thu Jul 28 08:11:36 2022] GET /identity/v3/projects/2c58e7ea67d84cf692dd9eb3f6cb73a0 => generated 302 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:11:36.641922 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0067cb-31de-4f12-8166-bf94406c64e4 None admin] Authenticating user token {{(pid=144067) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:11:36.679698 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG dbcounter [-] [144067] Writing DB stats keystone:SELECT=100 {{(pid=144067) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:11:36.767963 dv-cinder-851351-1-smb devstack@keystone.service[144068]: [pid: 144068|app: 0|req: 225/450] 10.222.0.42 () {58 vars in 1282 bytes} [Thu Jul 28 08:11:36 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 407 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 28 08:11:36.771947 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c27fb13b-43cf-4dfe-8cbb-4be87ae3a03b None admin] Authenticating user token {{(pid=144068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:11:36.781394 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0067cb-31de-4f12-8166-bf94406c64e4 None admin] Validating token access rules against request {{(pid=144067) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:11:36.823607 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d821bfe1-ff4c-4aba-976e-c4b55e79da5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144067) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:11:36.824186 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d821bfe1-ff4c-4aba-976e-c4b55e79da5e None admin] REQUEST_METHOD: `GET` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:11:36.824469 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d821bfe1-ff4c-4aba-976e-c4b55e79da5e None admin] SCRIPT_NAME: `/identity` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:11:36.824859 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d821bfe1-ff4c-4aba-976e-c4b55e79da5e None admin] PATH_INFO: `/v3/groups/cfc51bfe26d54218b5109575a2ff2a46` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:11:36.826064 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d821bfe1-ff4c-4aba-976e-c4b55e79da5e None admin] RBAC: Authorizing `identity:get_group(group_id=cfc51bfe26d54218b5109575a2ff2a46)` {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:11:36.827540 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d821bfe1-ff4c-4aba-976e-c4b55e79da5e None admin] RBAC: Authorization granted {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:11:36.829446 dv-cinder-851351-1-smb devstack@keystone.service[144067]: [pid: 144067|app: 0|req: 226/451] 10.222.0.42 () {56 vars in 1180 bytes} [Thu Jul 28 08:11:36 2022] GET /identity/v3/groups/cfc51bfe26d54218b5109575a2ff2a46 => generated 226 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 08:11:36.837101 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d821bfe1-ff4c-4aba-976e-c4b55e79da5e None admin] Authenticating user token {{(pid=144067) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:11:36.847240 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG dbcounter [-] [144068] Writing DB stats keystone:SELECT=100 {{(pid=144068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:11:36.908096 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c27fb13b-43cf-4dfe-8cbb-4be87ae3a03b None admin] Validating token access rules against request {{(pid=144068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:11:36.941611 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG dbcounter [-] [144067] Writing DB stats keystone:SELECT=100 {{(pid=144067) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:11:36.943418 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb2774e-544e-4f3f-ba5a-38025a53431f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:11:36.944360 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb2774e-544e-4f3f-ba5a-38025a53431f None admin] REQUEST_METHOD: `GET` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:11:36.944646 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb2774e-544e-4f3f-ba5a-38025a53431f None admin] SCRIPT_NAME: `/identity` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:11:36.944950 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb2774e-544e-4f3f-ba5a-38025a53431f None admin] PATH_INFO: `/v3/projects/3fae06d52d2d4b66af2858bdd1a0fbc7` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:11:36.945633 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d821bfe1-ff4c-4aba-976e-c4b55e79da5e None admin] Validating token access rules against request {{(pid=144067) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:11:36.946120 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb2774e-544e-4f3f-ba5a-38025a53431f None admin] RBAC: Authorizing `identity:get_project(project_id=3fae06d52d2d4b66af2858bdd1a0fbc7)` {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:11:36.947591 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb2774e-544e-4f3f-ba5a-38025a53431f None admin] RBAC: Authorization granted {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:11:36.949308 dv-cinder-851351-1-smb devstack@keystone.service[144068]: [pid: 144068|app: 0|req: 226/452] 10.222.0.42 () {56 vars in 1186 bytes} [Thu Jul 28 08:11:36 2022] GET /identity/v3/projects/3fae06d52d2d4b66af2858bdd1a0fbc7 => generated 344 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 08:11:36.954826 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb2774e-544e-4f3f-ba5a-38025a53431f None admin] Authenticating user token {{(pid=144068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:11:36.985459 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5815234a-fe69-4921-b529-b84275dd8965 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144067) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:11:36.986689 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5815234a-fe69-4921-b529-b84275dd8965 None admin] REQUEST_METHOD: `GET` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:11:36.986689 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5815234a-fe69-4921-b529-b84275dd8965 None admin] SCRIPT_NAME: `/identity` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:11:36.986876 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5815234a-fe69-4921-b529-b84275dd8965 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:11:36.987534 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5815234a-fe69-4921-b529-b84275dd8965 None admin] RBAC: Adding query filter params (group.id=cfc51bfe26d54218b5109575a2ff2a46, role.id=7e9c2306137042cf8b8eba284656ef33, scope.project.id=2c58e7ea67d84cf692dd9eb3f6cb73a0) {{(pid=144067) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:11:36.987877 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5815234a-fe69-4921-b529-b84275dd8965 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:11:36.989544 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5815234a-fe69-4921-b529-b84275dd8965 None admin] RBAC: Authorization granted {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:11:36.996346 dv-cinder-851351-1-smb devstack@keystone.service[144067]: [pid: 144067|app: 0|req: 227/453] 10.222.0.42 () {56 vars in 1376 bytes} [Thu Jul 28 08:11:36 2022] GET /identity/v3/role_assignments?group.id=cfc51bfe26d54218b5109575a2ff2a46&scope.project.id=2c58e7ea67d84cf692dd9eb3f6cb73a0&role.id=7e9c2306137042cf8b8eba284656ef33 => generated 611 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:11:37.070958 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb2774e-544e-4f3f-ba5a-38025a53431f None admin] Validating token access rules against request {{(pid=144068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:11:37.091792 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG dbcounter [-] [144068] Writing DB stats keystone:SELECT=100 {{(pid=144068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:11:37.112615 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e75a9e2-189c-416f-a550-c9025d08f1d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:11:37.113319 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e75a9e2-189c-416f-a550-c9025d08f1d9 None admin] REQUEST_METHOD: `GET` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:11:37.113671 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e75a9e2-189c-416f-a550-c9025d08f1d9 None admin] SCRIPT_NAME: `/identity` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:11:37.113948 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e75a9e2-189c-416f-a550-c9025d08f1d9 None admin] PATH_INFO: `/v3/groups/c5a27b7b13aa4e1781357988ee30c5b9` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:11:37.115280 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e75a9e2-189c-416f-a550-c9025d08f1d9 None admin] RBAC: Authorizing `identity:get_group(group_id=c5a27b7b13aa4e1781357988ee30c5b9)` {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:11:37.116826 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e75a9e2-189c-416f-a550-c9025d08f1d9 None admin] RBAC: Authorization granted {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:11:37.118563 dv-cinder-851351-1-smb devstack@keystone.service[144068]: [pid: 144068|app: 0|req: 227/454] 10.222.0.42 () {56 vars in 1180 bytes} [Thu Jul 28 08:11:36 2022] GET /identity/v3/groups/c5a27b7b13aa4e1781357988ee30c5b9 => generated 229 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 08:11:37.125131 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5815234a-fe69-4921-b529-b84275dd8965 None admin] Authenticating user token {{(pid=144067) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:11:37.239401 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5815234a-fe69-4921-b529-b84275dd8965 None admin] Validating token access rules against request {{(pid=144067) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:11:37.284001 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26948589-e8df-42e3-8172-167599885e40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144067) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:11:37.284646 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26948589-e8df-42e3-8172-167599885e40 None admin] REQUEST_METHOD: `GET` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:11:37.284960 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26948589-e8df-42e3-8172-167599885e40 None admin] SCRIPT_NAME: `/identity` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:11:37.285241 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26948589-e8df-42e3-8172-167599885e40 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:11:37.286956 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26948589-e8df-42e3-8172-167599885e40 None admin] RBAC: Adding query filter params (group.id=c5a27b7b13aa4e1781357988ee30c5b9, role.id=d1020e7bb0b7411d895ddedd6dc02c5b, scope.project.id=3fae06d52d2d4b66af2858bdd1a0fbc7) {{(pid=144067) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:11:37.286956 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26948589-e8df-42e3-8172-167599885e40 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:11:37.287817 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26948589-e8df-42e3-8172-167599885e40 None admin] RBAC: Authorization granted {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:11:37.294891 dv-cinder-851351-1-smb devstack@keystone.service[144067]: [pid: 144067|app: 0|req: 228/455] 10.222.0.42 () {56 vars in 1376 bytes} [Thu Jul 28 08:11:37 2022] GET /identity/v3/role_assignments?group.id=c5a27b7b13aa4e1781357988ee30c5b9&scope.project.id=3fae06d52d2d4b66af2858bdd1a0fbc7&role.id=d1020e7bb0b7411d895ddedd6dc02c5b => generated 611 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:11:39.768331 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c93a363-7627-41f9-965e-b970a1f5f321 None None] REQUEST_METHOD: `GET` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:11:39.768972 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c93a363-7627-41f9-965e-b970a1f5f321 None None] SCRIPT_NAME: `/identity` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:11:39.768972 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c93a363-7627-41f9-965e-b970a1f5f321 None None] PATH_INFO: `/` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:11:39.770763 dv-cinder-851351-1-smb devstack@keystone.service[144068]: [pid: 144068|app: 0|req: 228/456] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 08:11:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 08:11:39.777021 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b09c50-1fc8-44f3-9935-d2450de76a58 None None] REQUEST_METHOD: `POST` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:11:39.777582 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b09c50-1fc8-44f3-9935-d2450de76a58 None None] SCRIPT_NAME: `/identity` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:11:39.777582 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b09c50-1fc8-44f3-9935-d2450de76a58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:11:39.809890 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.auth.core [None req-34b09c50-1fc8-44f3-9935-d2450de76a58 None None] MFA Rules not processed for user `bf5ceb8f07374635ad506b7d1b4f1612`. Rule list: `[]` (Enabled: `True`). {{(pid=144067) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 08:11:39.811145 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.fernet_utils [None req-34b09c50-1fc8-44f3-9935-d2450de76a58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=144067) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:11:39.835074 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG dbcounter [-] [144067] Writing DB stats keystone:SELECT=100 {{(pid=144067) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:11:39.896757 dv-cinder-851351-1-smb devstack@keystone.service[144067]: [pid: 144067|app: 0|req: 229/457] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 08:11:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 28 08:11:39.913794 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c93a363-7627-41f9-965e-b970a1f5f321 None None] Authenticating user token {{(pid=144068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:11:40.030580 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c93a363-7627-41f9-965e-b970a1f5f321 None None] Validating token access rules against request {{(pid=144068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:11:40.044759 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dadaf32d-6e31-4f12-9bfc-0dce467ec459 None None] REQUEST_METHOD: `GET` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:11:40.045123 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dadaf32d-6e31-4f12-9bfc-0dce467ec459 None None] SCRIPT_NAME: `/identity` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:11:40.045322 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dadaf32d-6e31-4f12-9bfc-0dce467ec459 None None] PATH_INFO: `/` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:11:40.046845 dv-cinder-851351-1-smb devstack@keystone.service[144067]: [pid: 144067|app: 0|req: 230/458] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 08:11:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 08:11:40.055142 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6c05af-a24b-48a5-917d-a964b4829b4a None None] REQUEST_METHOD: `POST` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:11:40.055621 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6c05af-a24b-48a5-917d-a964b4829b4a None None] SCRIPT_NAME: `/identity` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:11:40.056101 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6c05af-a24b-48a5-917d-a964b4829b4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:11:40.092527 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.auth.core [None req-9c6c05af-a24b-48a5-917d-a964b4829b4a None None] MFA Rules not processed for user `bf5ceb8f07374635ad506b7d1b4f1612`. Rule list: `[]` (Enabled: `True`). {{(pid=144067) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 08:11:40.093777 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.fernet_utils [None req-9c6c05af-a24b-48a5-917d-a964b4829b4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=144067) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:11:40.099222 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83a28f8-7a10-42f1-92f8-fb6a8f96d084 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:11:40.099905 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83a28f8-7a10-42f1-92f8-fb6a8f96d084 None admin] REQUEST_METHOD: `GET` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:11:40.100190 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83a28f8-7a10-42f1-92f8-fb6a8f96d084 None admin] SCRIPT_NAME: `/identity` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:11:40.100466 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83a28f8-7a10-42f1-92f8-fb6a8f96d084 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:11:40.121681 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e83a28f8-7a10-42f1-92f8-fb6a8f96d084 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:11:40.123189 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e83a28f8-7a10-42f1-92f8-fb6a8f96d084 None admin] RBAC: Authorization granted {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:11:40.150091 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application [None req-e83a28f8-7a10-42f1-92f8-fb6a8f96d084 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 08:11:40.150091 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:11:40.150091 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:11:40.150091 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:11:40.150091 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:11:40.150091 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:11:40.150091 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:11:40.150091 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:11:40.150091 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:11:40.150091 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:11:40.150091 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:11:40.150091 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:11:40.150091 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 08:11:40.150091 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 08:11:40.150091 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 08:11:40.151179 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 08:11:40.151179 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:11:40.151179 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:11:40.151179 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:11:40.151179 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:11:40.151179 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:11:40.151179 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:11:40.151179 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:11:40.151179 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application with Lock( Jul 28 08:11:40.151179 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:11:40.151179 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:11:40.151179 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:11:40.151179 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:11:40.151179 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:11:40.151179 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:11:40.151179 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:11:40.151179 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:11:40.152171 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 08:11:40.152171 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 08:11:40.152171 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 08:11:40.152171 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application Jul 28 08:11:40.156723 dv-cinder-851351-1-smb devstack@keystone.service[144068]: [pid: 144068|app: 0|req: 229/459] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 08:11:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:11:40.158141 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83a28f8-7a10-42f1-92f8-fb6a8f96d084 None admin] Authenticating user token {{(pid=144068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:11:40.204559 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG dbcounter [-] [144068] Writing DB stats keystone:SELECT=100 {{(pid=144068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:11:40.262054 dv-cinder-851351-1-smb devstack@keystone.service[144067]: [pid: 144067|app: 0|req: 231/460] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 08:11:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 08:11:40.288331 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6c05af-a24b-48a5-917d-a964b4829b4a None None] Authenticating user token {{(pid=144067) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:11:40.309209 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83a28f8-7a10-42f1-92f8-fb6a8f96d084 None admin] Validating token access rules against request {{(pid=144068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:11:40.351233 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67278a0d-342a-43bf-b550-62561bc10b9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:11:40.351873 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67278a0d-342a-43bf-b550-62561bc10b9f None admin] REQUEST_METHOD: `GET` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:11:40.352154 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67278a0d-342a-43bf-b550-62561bc10b9f None admin] SCRIPT_NAME: `/identity` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:11:40.352430 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67278a0d-342a-43bf-b550-62561bc10b9f None admin] PATH_INFO: `/v3/domains` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:11:40.353195 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67278a0d-342a-43bf-b550-62561bc10b9f None admin] RBAC: Adding query filter params (name=Default) {{(pid=144068) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:11:40.353500 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67278a0d-342a-43bf-b550-62561bc10b9f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:11:40.354895 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67278a0d-342a-43bf-b550-62561bc10b9f None admin] RBAC: Authorization granted {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:11:40.368033 dv-cinder-851351-1-smb devstack@keystone.service[144068]: [pid: 144068|app: 0|req: 230/461] 10.222.0.42 () {56 vars in 1109 bytes} [Thu Jul 28 08:11:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 08:11:40.374401 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67278a0d-342a-43bf-b550-62561bc10b9f None admin] Authenticating user token {{(pid=144068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:11:40.479950 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG dbcounter [-] [144067] Writing DB stats keystone:SELECT=100 {{(pid=144067) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:11:40.487811 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG dbcounter [-] [144068] Writing DB stats keystone:SELECT=100 {{(pid=144068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:11:40.496911 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67278a0d-342a-43bf-b550-62561bc10b9f None admin] Validating token access rules against request {{(pid=144068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:11:40.500220 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6c05af-a24b-48a5-917d-a964b4829b4a None None] Validating token access rules against request {{(pid=144067) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:11:40.538600 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b831b4-884e-4bd9-af07-10b15cb981bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144067) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:11:40.539658 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b831b4-884e-4bd9-af07-10b15cb981bf None admin] REQUEST_METHOD: `GET` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:11:40.540166 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b831b4-884e-4bd9-af07-10b15cb981bf None admin] SCRIPT_NAME: `/identity` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:11:40.540648 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b831b4-884e-4bd9-af07-10b15cb981bf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:11:40.541642 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42df3e41-a7bf-426d-a40f-36033f465d4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:11:40.542347 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42df3e41-a7bf-426d-a40f-36033f465d4c None admin] REQUEST_METHOD: `POST` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:11:40.542697 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42df3e41-a7bf-426d-a40f-36033f465d4c None admin] SCRIPT_NAME: `/identity` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:11:40.543043 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42df3e41-a7bf-426d-a40f-36033f465d4c None admin] PATH_INFO: `/v3/users` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:11:40.544121 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42df3e41-a7bf-426d-a40f-36033f465d4c None admin] RBAC: Authorizing `identity:create_user()` {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:11:40.546125 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42df3e41-a7bf-426d-a40f-36033f465d4c None admin] RBAC: Authorization granted {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:11:40.553635 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60b831b4-884e-4bd9-af07-10b15cb981bf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:11:40.555378 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60b831b4-884e-4bd9-af07-10b15cb981bf None admin] RBAC: Authorization granted {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:11:40.575407 dv-cinder-851351-1-smb devstack@keystone.service[144068]: [pid: 144068|app: 0|req: 231/462] 10.222.0.42 () {60 vars in 1132 bytes} [Thu Jul 28 08:11:40 2022] POST /identity/v3/users => generated 246 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 08:11:40.576911 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605c9d74-c681-4369-93df-bc9ed6bba6b0 None None] REQUEST_METHOD: `GET` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:11:40.577199 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605c9d74-c681-4369-93df-bc9ed6bba6b0 None None] SCRIPT_NAME: `/identity` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:11:40.577480 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605c9d74-c681-4369-93df-bc9ed6bba6b0 None None] PATH_INFO: `/` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:11:40.578327 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application [None req-60b831b4-884e-4bd9-af07-10b15cb981bf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 08:11:40.578327 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:11:40.578327 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:11:40.578327 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:11:40.578327 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:11:40.578327 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:11:40.578327 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:11:40.578327 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:11:40.578327 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:11:40.578327 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:11:40.578327 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:11:40.578327 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:11:40.578327 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 08:11:40.578327 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 08:11:40.578327 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 08:11:40.583811 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 08:11:40.583811 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:11:40.583811 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:11:40.583811 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:11:40.583811 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:11:40.583811 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:11:40.583811 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:11:40.583811 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:11:40.583811 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application with Lock( Jul 28 08:11:40.583811 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:11:40.583811 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:11:40.583811 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:11:40.583811 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:11:40.583811 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:11:40.583811 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:11:40.583811 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:11:40.583811 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:11:40.584844 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 08:11:40.584844 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 08:11:40.584844 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 08:11:40.584844 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application Jul 28 08:11:40.585087 dv-cinder-851351-1-smb devstack@keystone.service[144068]: [pid: 144068|app: 0|req: 232/463] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 08:11:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 08:11:40.585087 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b65ab8-aac8-44a3-b284-bee0c8a5ef8a None None] REQUEST_METHOD: `GET` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:11:40.585087 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b65ab8-aac8-44a3-b284-bee0c8a5ef8a None None] SCRIPT_NAME: `/identity` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:11:40.585087 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b65ab8-aac8-44a3-b284-bee0c8a5ef8a None None] PATH_INFO: `/` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:11:40.587317 dv-cinder-851351-1-smb devstack@keystone.service[144068]: [pid: 144068|app: 0|req: 233/464] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 08:11:40 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 08:11:40.588129 dv-cinder-851351-1-smb devstack@keystone.service[144067]: [pid: 144067|app: 0|req: 232/465] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 08:11:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 300 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 08:11:40.589130 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6edf8122-19b5-4934-88dd-041f1cb9ad40 None None] REQUEST_METHOD: `POST` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:11:40.589484 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6edf8122-19b5-4934-88dd-041f1cb9ad40 None None] SCRIPT_NAME: `/identity` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:11:40.589771 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6edf8122-19b5-4934-88dd-041f1cb9ad40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:11:40.590553 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01244c40-c205-4e19-b173-cb9d5b2e9a77 None None] REQUEST_METHOD: `POST` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:11:40.591024 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01244c40-c205-4e19-b173-cb9d5b2e9a77 None None] SCRIPT_NAME: `/identity` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:11:40.591498 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01244c40-c205-4e19-b173-cb9d5b2e9a77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:11:40.610821 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.auth.core [None req-01244c40-c205-4e19-b173-cb9d5b2e9a77 None None] MFA Rules not processed for user `bf5ceb8f07374635ad506b7d1b4f1612`. Rule list: `[]` (Enabled: `True`). {{(pid=144067) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 08:11:40.611047 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.auth.core [None req-6edf8122-19b5-4934-88dd-041f1cb9ad40 None None] MFA Rules not processed for user `bf5ceb8f07374635ad506b7d1b4f1612`. Rule list: `[]` (Enabled: `True`). {{(pid=144068) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 08:11:40.612506 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.fernet_utils [None req-6edf8122-19b5-4934-88dd-041f1cb9ad40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=144068) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:11:40.613260 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.fernet_utils [None req-01244c40-c205-4e19-b173-cb9d5b2e9a77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=144067) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:11:40.701884 dv-cinder-851351-1-smb devstack@keystone.service[144067]: [pid: 144067|app: 0|req: 233/466] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 08:11:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 08:11:40.709767 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01244c40-c205-4e19-b173-cb9d5b2e9a77 None None] Authenticating user token {{(pid=144067) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:11:40.712989 dv-cinder-851351-1-smb devstack@keystone.service[144068]: [pid: 144068|app: 0|req: 234/467] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 08:11:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 08:11:40.729417 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6edf8122-19b5-4934-88dd-041f1cb9ad40 None None] Authenticating user token {{(pid=144068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:11:40.809386 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG dbcounter [-] [144067] Writing DB stats keystone:SELECT=100 {{(pid=144067) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:11:40.830663 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG dbcounter [-] [144068] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=144068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:11:40.859223 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01244c40-c205-4e19-b173-cb9d5b2e9a77 None None] Validating token access rules against request {{(pid=144067) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:11:40.861375 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6edf8122-19b5-4934-88dd-041f1cb9ad40 None None] Validating token access rules against request {{(pid=144068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:11:40.902332 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96527740-f45b-4018-9bec-3382b673de61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:11:40.903462 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96527740-f45b-4018-9bec-3382b673de61 None admin] REQUEST_METHOD: `GET` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:11:40.903462 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96527740-f45b-4018-9bec-3382b673de61 None admin] SCRIPT_NAME: `/identity` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:11:40.903660 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96527740-f45b-4018-9bec-3382b673de61 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:11:40.911069 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d398356-5602-4be7-9de4-f5fcdf69bc4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144067) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:11:40.911736 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d398356-5602-4be7-9de4-f5fcdf69bc4d None admin] REQUEST_METHOD: `GET` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:11:40.912022 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d398356-5602-4be7-9de4-f5fcdf69bc4d None admin] SCRIPT_NAME: `/identity` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:11:40.912300 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d398356-5602-4be7-9de4-f5fcdf69bc4d None admin] PATH_INFO: `/v3/domains` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:11:40.913063 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d398356-5602-4be7-9de4-f5fcdf69bc4d None admin] RBAC: Adding query filter params (name=Default) {{(pid=144067) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:11:40.913379 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d398356-5602-4be7-9de4-f5fcdf69bc4d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:11:40.914816 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d398356-5602-4be7-9de4-f5fcdf69bc4d None admin] RBAC: Authorization granted {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:11:40.916600 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96527740-f45b-4018-9bec-3382b673de61 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:11:40.918307 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96527740-f45b-4018-9bec-3382b673de61 None admin] RBAC: Authorization granted {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:11:40.927865 dv-cinder-851351-1-smb devstack@keystone.service[144067]: [pid: 144067|app: 0|req: 234/468] 10.222.0.42 () {56 vars in 1109 bytes} [Thu Jul 28 08:11:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:11:40.928566 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d398356-5602-4be7-9de4-f5fcdf69bc4d None admin] Authenticating user token {{(pid=144067) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:11:40.939258 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application [None req-96527740-f45b-4018-9bec-3382b673de61 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 08:11:40.939258 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:11:40.939258 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:11:40.939258 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:11:40.939258 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:11:40.939258 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:11:40.939258 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:11:40.939258 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:11:40.939258 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:11:40.939258 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:11:40.939258 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:11:40.939258 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:11:40.939258 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 08:11:40.939258 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 08:11:40.939258 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 08:11:40.940295 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 08:11:40.940295 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:11:40.940295 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:11:40.940295 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:11:40.940295 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:11:40.940295 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:11:40.940295 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:11:40.940295 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:11:40.940295 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application with Lock( Jul 28 08:11:40.940295 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:11:40.940295 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:11:40.940295 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:11:40.940295 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:11:40.940295 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:11:40.940295 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:11:40.940295 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:11:40.940295 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:11:40.941311 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 08:11:40.941311 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 08:11:40.941311 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 08:11:40.941311 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application Jul 28 08:11:40.943772 dv-cinder-851351-1-smb devstack@keystone.service[144068]: [pid: 144068|app: 0|req: 235/469] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 08:11:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 08:11:40.944991 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96527740-f45b-4018-9bec-3382b673de61 None admin] Authenticating user token {{(pid=144068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:11:41.057393 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96527740-f45b-4018-9bec-3382b673de61 None admin] Validating token access rules against request {{(pid=144068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:11:41.075603 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d398356-5602-4be7-9de4-f5fcdf69bc4d None admin] Validating token access rules against request {{(pid=144067) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:11:41.093853 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f2fcd0-0845-493f-b7d6-eba9ea284542 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:11:41.094957 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f2fcd0-0845-493f-b7d6-eba9ea284542 None admin] REQUEST_METHOD: `POST` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:11:41.095582 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f2fcd0-0845-493f-b7d6-eba9ea284542 None admin] SCRIPT_NAME: `/identity` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:11:41.096088 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f2fcd0-0845-493f-b7d6-eba9ea284542 None admin] PATH_INFO: `/v3/users` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:11:41.097052 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f2fcd0-0845-493f-b7d6-eba9ea284542 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:11:41.098855 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f2fcd0-0845-493f-b7d6-eba9ea284542 None admin] RBAC: Authorization granted {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:11:41.109695 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG dbcounter [-] [144067] Writing DB stats keystone:SELECT=100 {{(pid=144067) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:11:41.116722 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG dbcounter [-] [144068] Writing DB stats keystone:SELECT=100 {{(pid=144068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:11:41.121881 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ceb84a-2e3a-484e-a3c7-2301fba9af95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144067) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:11:41.123174 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ceb84a-2e3a-484e-a3c7-2301fba9af95 None admin] REQUEST_METHOD: `GET` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:11:41.123456 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ceb84a-2e3a-484e-a3c7-2301fba9af95 None admin] SCRIPT_NAME: `/identity` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:11:41.123750 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ceb84a-2e3a-484e-a3c7-2301fba9af95 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:11:41.133059 dv-cinder-851351-1-smb devstack@keystone.service[144068]: [pid: 144068|app: 0|req: 236/470] 10.222.0.42 () {60 vars in 1132 bytes} [Thu Jul 28 08:11:40 2022] POST /identity/v3/users => generated 248 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 08:11:41.134573 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f2fcd0-0845-493f-b7d6-eba9ea284542 None admin] Authenticating user token {{(pid=144068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:11:41.137990 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92ceb84a-2e3a-484e-a3c7-2301fba9af95 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:11:41.139923 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92ceb84a-2e3a-484e-a3c7-2301fba9af95 None admin] RBAC: Authorization granted {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:11:41.159598 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application [None req-92ceb84a-2e3a-484e-a3c7-2301fba9af95 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 08:11:41.159598 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:11:41.159598 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:11:41.159598 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:11:41.159598 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:11:41.159598 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:11:41.159598 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:11:41.159598 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:11:41.159598 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:11:41.159598 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:11:41.159598 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:11:41.159598 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:11:41.159598 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 08:11:41.159598 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 08:11:41.159598 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 08:11:41.160865 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 08:11:41.160865 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:11:41.160865 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:11:41.160865 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:11:41.160865 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:11:41.160865 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:11:41.160865 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:11:41.160865 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:11:41.160865 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application with Lock( Jul 28 08:11:41.160865 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:11:41.160865 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:11:41.160865 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:11:41.160865 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:11:41.160865 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:11:41.160865 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:11:41.160865 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:11:41.160865 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:11:41.161861 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 08:11:41.161861 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 08:11:41.161861 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 08:11:41.161861 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application Jul 28 08:11:41.161861 dv-cinder-851351-1-smb devstack@keystone.service[144067]: [pid: 144067|app: 0|req: 235/471] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 08:11:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:11:41.167327 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ceb84a-2e3a-484e-a3c7-2301fba9af95 None admin] Authenticating user token {{(pid=144067) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:11:41.290037 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f2fcd0-0845-493f-b7d6-eba9ea284542 None admin] Validating token access rules against request {{(pid=144068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:11:41.333780 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051ba914-3efc-43e1-a065-fb2b41a98f22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:11:41.335078 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051ba914-3efc-43e1-a065-fb2b41a98f22 None admin] REQUEST_METHOD: `GET` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:11:41.335994 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051ba914-3efc-43e1-a065-fb2b41a98f22 None admin] SCRIPT_NAME: `/identity` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:11:41.336563 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051ba914-3efc-43e1-a065-fb2b41a98f22 None admin] PATH_INFO: `/v3/domains` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:11:41.338169 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-051ba914-3efc-43e1-a065-fb2b41a98f22 None admin] RBAC: Adding query filter params (name=Default) {{(pid=144068) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:11:41.338774 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-051ba914-3efc-43e1-a065-fb2b41a98f22 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:11:41.340448 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-051ba914-3efc-43e1-a065-fb2b41a98f22 None admin] RBAC: Authorization granted {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:11:41.355255 dv-cinder-851351-1-smb devstack@keystone.service[144068]: [pid: 144068|app: 0|req: 237/472] 10.222.0.42 () {56 vars in 1109 bytes} [Thu Jul 28 08:11:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:11:41.356933 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5495ba32-abf2-4a08-bf36-10a9dafda36c None None] REQUEST_METHOD: `GET` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:11:41.357378 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5495ba32-abf2-4a08-bf36-10a9dafda36c None None] SCRIPT_NAME: `/identity` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:11:41.357827 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5495ba32-abf2-4a08-bf36-10a9dafda36c None None] PATH_INFO: `/` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:11:41.359637 dv-cinder-851351-1-smb devstack@keystone.service[144068]: [pid: 144068|app: 0|req: 238/473] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 08:11:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 08:11:41.365755 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5495ba32-abf2-4a08-bf36-10a9dafda36c None None] Authenticating user token {{(pid=144068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:11:41.404805 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ceb84a-2e3a-484e-a3c7-2301fba9af95 None admin] Validating token access rules against request {{(pid=144067) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:11:41.429821 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG dbcounter [-] [144068] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=144068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:11:41.463775 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5071eca8-89b8-47fc-b771-81704cf17300 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144067) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:11:41.464871 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5071eca8-89b8-47fc-b771-81704cf17300 None admin] REQUEST_METHOD: `GET` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:11:41.466968 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5071eca8-89b8-47fc-b771-81704cf17300 None admin] SCRIPT_NAME: `/identity` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:11:41.467478 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5071eca8-89b8-47fc-b771-81704cf17300 None admin] PATH_INFO: `/v3/domains` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:11:41.468772 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5071eca8-89b8-47fc-b771-81704cf17300 None admin] RBAC: Adding query filter params (name=Default) {{(pid=144067) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:11:41.469296 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5071eca8-89b8-47fc-b771-81704cf17300 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:11:41.471769 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5071eca8-89b8-47fc-b771-81704cf17300 None admin] RBAC: Authorization granted {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:11:41.494180 dv-cinder-851351-1-smb devstack@keystone.service[144067]: [pid: 144067|app: 0|req: 236/474] 10.222.0.42 () {56 vars in 1109 bytes} [Thu Jul 28 08:11:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 327 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 08:11:41.496619 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d54dd89-28d7-49d2-84cf-ffbce3b0088d None None] REQUEST_METHOD: `POST` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:11:41.497146 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d54dd89-28d7-49d2-84cf-ffbce3b0088d None None] SCRIPT_NAME: `/identity` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:11:41.497615 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d54dd89-28d7-49d2-84cf-ffbce3b0088d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:11:41.502158 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5495ba32-abf2-4a08-bf36-10a9dafda36c None None] Validating token access rules against request {{(pid=144068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:11:41.523650 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.auth.core [None req-7d54dd89-28d7-49d2-84cf-ffbce3b0088d None None] MFA Rules not processed for user `bf5ceb8f07374635ad506b7d1b4f1612`. Rule list: `[]` (Enabled: `True`). {{(pid=144067) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 08:11:41.524792 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.fernet_utils [None req-7d54dd89-28d7-49d2-84cf-ffbce3b0088d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=144067) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:11:41.543984 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021ebf53-ef3f-45b8-a792-55b09b9d7b9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:11:41.544612 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021ebf53-ef3f-45b8-a792-55b09b9d7b9d None admin] REQUEST_METHOD: `POST` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:11:41.544924 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021ebf53-ef3f-45b8-a792-55b09b9d7b9d None admin] SCRIPT_NAME: `/identity` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:11:41.545212 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021ebf53-ef3f-45b8-a792-55b09b9d7b9d None admin] PATH_INFO: `/v3/users` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:11:41.545892 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-021ebf53-ef3f-45b8-a792-55b09b9d7b9d None admin] RBAC: Authorizing `identity:create_user()` {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:11:41.547347 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-021ebf53-ef3f-45b8-a792-55b09b9d7b9d None admin] RBAC: Authorization granted {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:11:41.568964 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG dbcounter [-] [144067] Writing DB stats keystone:SELECT=100 {{(pid=144067) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:11:41.571488 dv-cinder-851351-1-smb devstack@keystone.service[144068]: [pid: 144068|app: 0|req: 239/475] 10.222.0.42 () {60 vars in 1132 bytes} [Thu Jul 28 08:11:41 2022] POST /identity/v3/users => generated 249 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 08:11:41.575293 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021ebf53-ef3f-45b8-a792-55b09b9d7b9d None admin] Authenticating user token {{(pid=144068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:11:41.611772 dv-cinder-851351-1-smb devstack@keystone.service[144067]: [pid: 144067|app: 0|req: 237/476] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 08:11:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 08:11:41.639263 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d54dd89-28d7-49d2-84cf-ffbce3b0088d None None] Authenticating user token {{(pid=144067) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:11:41.755777 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021ebf53-ef3f-45b8-a792-55b09b9d7b9d None admin] Validating token access rules against request {{(pid=144068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:11:41.772194 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG dbcounter [-] [144068] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=144068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:11:41.819623 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d54dd89-28d7-49d2-84cf-ffbce3b0088d None None] Validating token access rules against request {{(pid=144067) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:11:41.823353 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd0a0244-270a-44ca-9af4-d2302867db50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:11:41.824696 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0a0244-270a-44ca-9af4-d2302867db50 None admin] REQUEST_METHOD: `POST` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:11:41.824696 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0a0244-270a-44ca-9af4-d2302867db50 None admin] SCRIPT_NAME: `/identity` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:11:41.825014 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0a0244-270a-44ca-9af4-d2302867db50 None admin] PATH_INFO: `/v3/users` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:11:41.825660 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd0a0244-270a-44ca-9af4-d2302867db50 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:11:41.827230 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd0a0244-270a-44ca-9af4-d2302867db50 None admin] RBAC: Authorization granted {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:11:41.869283 dv-cinder-851351-1-smb devstack@keystone.service[144068]: [pid: 144068|app: 0|req: 240/477] 10.222.0.42 () {60 vars in 1132 bytes} [Thu Jul 28 08:11:41 2022] POST /identity/v3/users => generated 248 bytes in 297 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 08:11:41.880048 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a0b8ea-a761-4628-beeb-8ac5f48abfcb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144067) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:11:41.880759 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a0b8ea-a761-4628-beeb-8ac5f48abfcb None admin] REQUEST_METHOD: `POST` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:11:41.881093 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a0b8ea-a761-4628-beeb-8ac5f48abfcb None admin] SCRIPT_NAME: `/identity` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:11:41.881377 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a0b8ea-a761-4628-beeb-8ac5f48abfcb None admin] PATH_INFO: `/v3/roles` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:11:41.882162 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29a0b8ea-a761-4628-beeb-8ac5f48abfcb None admin] RBAC: Authorizing `identity:create_role()` {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:11:41.883811 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29a0b8ea-a761-4628-beeb-8ac5f48abfcb None admin] RBAC: Authorization granted {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:11:41.894350 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.sql.core [None req-29a0b8ea-a761-4628-beeb-8ac5f48abfcb None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jul 28 08:11:41.894350 dv-cinder-851351-1-smb devstack@keystone.service[144067]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Jul 28 08:11:41.894350 dv-cinder-851351-1-smb devstack@keystone.service[144067]: [parameters: {'id': '23e4cad8c42749138544d16101173746', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Jul 28 08:11:41.894350 dv-cinder-851351-1-smb devstack@keystone.service[144067]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=144067) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jul 28 08:11:41.913566 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application [None req-29a0b8ea-a761-4628-beeb-8ac5f48abfcb None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Jul 28 08:11:41.913566 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:11:41.913566 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 28 08:11:41.913566 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 28 08:11:41.913566 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 28 08:11:41.913566 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 28 08:11:41.913566 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 28 08:11:41.913566 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application result = self._query(query) Jul 28 08:11:41.913566 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 28 08:11:41.913566 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application conn.query(q) Jul 28 08:11:41.913566 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 28 08:11:41.913566 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 28 08:11:41.913566 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 28 08:11:41.913566 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application result.read() Jul 28 08:11:41.913566 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 28 08:11:41.914633 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 28 08:11:41.914633 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 28 08:11:41.914633 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 28 08:11:41.914633 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 28 08:11:41.914633 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 28 08:11:41.914633 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 28 08:11:41.914633 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 28 08:11:41.914633 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jul 28 08:11:41.914633 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application Jul 28 08:11:41.914633 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jul 28 08:11:41.914633 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application Jul 28 08:11:41.914633 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:11:41.914633 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jul 28 08:11:41.914633 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jul 28 08:11:41.914633 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role Jul 28 08:11:41.914633 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return ref.to_dict() Jul 28 08:11:41.914633 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 28 08:11:41.914633 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application next(self.gen) Jul 28 08:11:41.915719 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jul 28 08:11:41.915719 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application yield resource Jul 28 08:11:41.915719 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 28 08:11:41.915719 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application next(self.gen) Jul 28 08:11:41.915719 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jul 28 08:11:41.915719 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application self.session.rollback() Jul 28 08:11:41.915719 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 28 08:11:41.915719 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application self.force_reraise() Jul 28 08:11:41.915719 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 28 08:11:41.915719 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application raise self.value Jul 28 08:11:41.915719 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jul 28 08:11:41.915719 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jul 28 08:11:41.915719 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jul 28 08:11:41.915719 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application session.commit() Jul 28 08:11:41.915719 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jul 28 08:11:41.915719 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jul 28 08:11:41.915719 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jul 28 08:11:41.916761 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application self._prepare_impl() Jul 28 08:11:41.916761 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jul 28 08:11:41.916761 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application self.session.flush() Jul 28 08:11:41.916761 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jul 28 08:11:41.916761 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application self._flush(objects) Jul 28 08:11:41.916761 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jul 28 08:11:41.916761 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jul 28 08:11:41.916761 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jul 28 08:11:41.916761 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application compat.raise_( Jul 28 08:11:41.916761 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 28 08:11:41.916761 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application raise exception Jul 28 08:11:41.916761 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jul 28 08:11:41.916761 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application flush_context.execute() Jul 28 08:11:41.916761 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jul 28 08:11:41.916761 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application rec.execute(self) Jul 28 08:11:41.916761 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jul 28 08:11:41.916761 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jul 28 08:11:41.917803 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jul 28 08:11:41.917803 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application _emit_insert_statements( Jul 28 08:11:41.917803 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Jul 28 08:11:41.917803 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application c = connection._execute_20( Jul 28 08:11:41.917803 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jul 28 08:11:41.917803 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jul 28 08:11:41.917803 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Jul 28 08:11:41.917803 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jul 28 08:11:41.917803 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jul 28 08:11:41.917803 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application ret = self._execute_context( Jul 28 08:11:41.917803 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jul 28 08:11:41.917803 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jul 28 08:11:41.917803 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jul 28 08:11:41.917803 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jul 28 08:11:41.917803 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 28 08:11:41.917803 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application raise exception Jul 28 08:11:41.919126 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 28 08:11:41.919126 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 28 08:11:41.919126 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 28 08:11:41.919126 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 28 08:11:41.919126 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 28 08:11:41.919126 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application result = self._query(query) Jul 28 08:11:41.919126 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 28 08:11:41.919126 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application conn.query(q) Jul 28 08:11:41.919126 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 28 08:11:41.919126 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 28 08:11:41.919126 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 28 08:11:41.919126 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application result.read() Jul 28 08:11:41.919126 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 28 08:11:41.919126 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 28 08:11:41.919126 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 28 08:11:41.919126 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 28 08:11:41.920391 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 28 08:11:41.920391 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 28 08:11:41.920391 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 28 08:11:41.920391 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 28 08:11:41.920391 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jul 28 08:11:41.920391 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Jul 28 08:11:41.920391 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application [parameters: {'id': '23e4cad8c42749138544d16101173746', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Jul 28 08:11:41.920391 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jul 28 08:11:41.920391 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application Jul 28 08:11:41.920391 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 28 08:11:41.920391 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application Jul 28 08:11:41.920391 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:11:41.920391 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:11:41.920391 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:11:41.920391 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:11:41.920391 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:11:41.922284 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:11:41.922284 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:11:41.922284 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:11:41.922284 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:11:41.922284 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:11:41.922284 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:11:41.922284 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post Jul 28 08:11:41.922284 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( Jul 28 08:11:41.922284 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:11:41.922284 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:11:41.922284 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role Jul 28 08:11:41.922284 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) Jul 28 08:11:41.922284 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jul 28 08:11:41.922284 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jul 28 08:11:41.922284 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Jul 28 08:11:41.922284 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application Jul 28 08:11:41.923610 dv-cinder-851351-1-smb devstack@keystone.service[144067]: [pid: 144067|app: 0|req: 238/478] 10.222.0.42 () {60 vars in 1131 bytes} [Thu Jul 28 08:11:41 2022] POST /identity/v3/roles => generated 144 bytes in 277 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Jul 28 08:11:41.928698 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd0a0244-270a-44ca-9af4-d2302867db50 None admin] Authenticating user token {{(pid=144068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:11:42.052961 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd0a0244-270a-44ca-9af4-d2302867db50 None admin] Validating token access rules against request {{(pid=144068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:11:42.089812 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763cd8d4-dc8d-466b-acc2-35b112936971 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:11:42.090475 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763cd8d4-dc8d-466b-acc2-35b112936971 None admin] REQUEST_METHOD: `GET` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:11:42.090755 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763cd8d4-dc8d-466b-acc2-35b112936971 None admin] SCRIPT_NAME: `/identity` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:11:42.091033 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763cd8d4-dc8d-466b-acc2-35b112936971 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:11:42.104414 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-763cd8d4-dc8d-466b-acc2-35b112936971 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 08:11:42.110058 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application [None req-763cd8d4-dc8d-466b-acc2-35b112936971 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 28 08:11:42.110058 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:11:42.110058 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:11:42.110058 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:11:42.110058 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:11:42.110058 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:11:42.110058 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:11:42.110058 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:11:42.110058 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:11:42.110058 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:11:42.110058 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:11:42.110058 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:11:42.110058 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 08:11:42.110058 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 08:11:42.110058 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 08:11:42.110058 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 08:11:42.112539 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 08:11:42.112539 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 08:11:42.112539 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 08:11:42.112539 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 08:11:42.112539 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:11:42.112539 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:11:42.112539 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:11:42.112539 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:11:42.112539 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:11:42.112539 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:11:42.112539 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:11:42.112539 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application with Lock( Jul 28 08:11:42.112539 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:11:42.112539 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:11:42.112539 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:11:42.112539 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:11:42.114771 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:11:42.114771 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:11:42.114771 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:11:42.114771 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:11:42.114771 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 08:11:42.114771 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 08:11:42.114771 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 08:11:42.114771 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 08:11:42.114771 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 08:11:42.114771 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 08:11:42.114771 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 28 08:11:42.114771 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application Jul 28 08:11:42.114771 dv-cinder-851351-1-smb devstack@keystone.service[144068]: [pid: 144068|app: 0|req: 241/479] 10.222.0.42 () {56 vars in 1114 bytes} [Thu Jul 28 08:11:41 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:11:42.118014 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a0b8ea-a761-4628-beeb-8ac5f48abfcb None admin] Authenticating user token {{(pid=144067) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:11:42.165438 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG dbcounter [-] [144067] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=144067) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:11:42.244710 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a0b8ea-a761-4628-beeb-8ac5f48abfcb None admin] Validating token access rules against request {{(pid=144067) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:11:42.283744 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5fa6554-1b26-4e98-943c-61135b6be171 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144067) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:11:42.284452 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5fa6554-1b26-4e98-943c-61135b6be171 None admin] REQUEST_METHOD: `GET` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:11:42.284833 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5fa6554-1b26-4e98-943c-61135b6be171 None admin] SCRIPT_NAME: `/identity` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:11:42.285111 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5fa6554-1b26-4e98-943c-61135b6be171 None admin] PATH_INFO: `/v3/roles` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:11:42.285916 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5fa6554-1b26-4e98-943c-61135b6be171 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=144067) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:11:42.286230 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5fa6554-1b26-4e98-943c-61135b6be171 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:11:42.287705 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5fa6554-1b26-4e98-943c-61135b6be171 None admin] RBAC: Authorization granted {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:11:42.297361 dv-cinder-851351-1-smb devstack@keystone.service[144067]: [pid: 144067|app: 0|req: 239/480] 10.222.0.42 () {56 vars in 1111 bytes} [Thu Jul 28 08:11:42 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:11:42.883960 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2074988f-248c-4473-b700-808567e24eae None None] REQUEST_METHOD: `GET` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:11:42.884508 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2074988f-248c-4473-b700-808567e24eae None None] SCRIPT_NAME: `/identity` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:11:42.884508 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2074988f-248c-4473-b700-808567e24eae None None] PATH_INFO: `/` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:11:42.886210 dv-cinder-851351-1-smb devstack@keystone.service[144068]: [pid: 144068|app: 0|req: 242/481] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 08:11:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 08:11:42.891486 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ec68dd-c516-49e1-9dbc-e5430dadb27b None None] REQUEST_METHOD: `POST` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:11:42.891963 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ec68dd-c516-49e1-9dbc-e5430dadb27b None None] SCRIPT_NAME: `/identity` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:11:42.892067 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ec68dd-c516-49e1-9dbc-e5430dadb27b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:11:42.910734 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.auth.core [None req-68ec68dd-c516-49e1-9dbc-e5430dadb27b None None] MFA Rules not processed for user `bf5ceb8f07374635ad506b7d1b4f1612`. Rule list: `[]` (Enabled: `True`). {{(pid=144067) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 08:11:42.911954 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.fernet_utils [None req-68ec68dd-c516-49e1-9dbc-e5430dadb27b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=144067) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:11:43.027072 dv-cinder-851351-1-smb devstack@keystone.service[144067]: [pid: 144067|app: 0|req: 240/482] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 08:11:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 08:11:43.062278 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2074988f-248c-4473-b700-808567e24eae None None] Authenticating user token {{(pid=144068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:11:43.092396 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG dbcounter [-] [144068] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=144068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:11:43.199825 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2074988f-248c-4473-b700-808567e24eae None None] Validating token access rules against request {{(pid=144068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:11:43.242826 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f857f6c9-fef7-42d1-81c8-7ec91600a320 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:11:43.243875 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f857f6c9-fef7-42d1-81c8-7ec91600a320 None admin] REQUEST_METHOD: `GET` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:11:43.244363 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f857f6c9-fef7-42d1-81c8-7ec91600a320 None admin] SCRIPT_NAME: `/identity` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:11:43.244896 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f857f6c9-fef7-42d1-81c8-7ec91600a320 None admin] PATH_INFO: `/v3/roles/service` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:11:43.263398 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f857f6c9-fef7-42d1-81c8-7ec91600a320 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 08:11:43.269622 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application [None req-f857f6c9-fef7-42d1-81c8-7ec91600a320 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 28 08:11:43.269622 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:11:43.269622 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:11:43.269622 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:11:43.269622 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:11:43.269622 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:11:43.269622 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:11:43.269622 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:11:43.269622 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:11:43.269622 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:11:43.269622 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:11:43.269622 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:11:43.269622 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 08:11:43.269622 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 08:11:43.269622 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 08:11:43.269622 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 08:11:43.270733 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 08:11:43.270733 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 08:11:43.270733 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 08:11:43.270733 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 08:11:43.270733 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:11:43.270733 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:11:43.270733 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:11:43.270733 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:11:43.270733 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:11:43.270733 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:11:43.270733 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:11:43.270733 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application with Lock( Jul 28 08:11:43.270733 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:11:43.270733 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:11:43.270733 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:11:43.270733 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:11:43.271634 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:11:43.271634 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:11:43.271634 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:11:43.271634 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:11:43.271634 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 08:11:43.271634 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 08:11:43.271634 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 08:11:43.271634 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 08:11:43.271634 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 08:11:43.271634 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 08:11:43.271634 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 28 08:11:43.271634 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application Jul 28 08:11:43.278489 dv-cinder-851351-1-smb devstack@keystone.service[144068]: [pid: 144068|app: 0|req: 243/483] 10.222.0.42 () {56 vars in 1102 bytes} [Thu Jul 28 08:11:43 2022] GET /identity/v3/roles/service => generated 85 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:11:43.285968 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ec68dd-c516-49e1-9dbc-e5430dadb27b None None] Authenticating user token {{(pid=144067) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:11:43.335984 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG dbcounter [-] [144067] Writing DB stats keystone:SELECT=100 {{(pid=144067) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:11:43.443915 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ec68dd-c516-49e1-9dbc-e5430dadb27b None None] Validating token access rules against request {{(pid=144067) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:11:43.502141 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39aa9d1-421f-4eb7-a791-408b8bc9fe6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144067) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:11:43.502712 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39aa9d1-421f-4eb7-a791-408b8bc9fe6d None admin] REQUEST_METHOD: `GET` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:11:43.502995 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39aa9d1-421f-4eb7-a791-408b8bc9fe6d None admin] SCRIPT_NAME: `/identity` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:11:43.503270 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39aa9d1-421f-4eb7-a791-408b8bc9fe6d None admin] PATH_INFO: `/v3/roles` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:11:43.504129 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e39aa9d1-421f-4eb7-a791-408b8bc9fe6d None admin] RBAC: Adding query filter params (name=service) {{(pid=144067) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:11:43.504444 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e39aa9d1-421f-4eb7-a791-408b8bc9fe6d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:11:43.505950 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e39aa9d1-421f-4eb7-a791-408b8bc9fe6d None admin] RBAC: Authorization granted {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:11:43.521862 dv-cinder-851351-1-smb devstack@keystone.service[144067]: [pid: 144067|app: 0|req: 241/484] 10.222.0.42 () {56 vars in 1103 bytes} [Thu Jul 28 08:11:43 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:11:43.527367 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f857f6c9-fef7-42d1-81c8-7ec91600a320 None admin] Authenticating user token {{(pid=144068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:11:43.674912 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG dbcounter [-] [144068] Writing DB stats keystone:SELECT=100 {{(pid=144068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:11:43.705487 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f857f6c9-fef7-42d1-81c8-7ec91600a320 None admin] Validating token access rules against request {{(pid=144068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:11:43.758451 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb2d0d1e-4699-409c-a2ac-cb9c1a4c2a64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:11:43.759037 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2d0d1e-4699-409c-a2ac-cb9c1a4c2a64 None admin] REQUEST_METHOD: `GET` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:11:43.759318 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2d0d1e-4699-409c-a2ac-cb9c1a4c2a64 None admin] SCRIPT_NAME: `/identity` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:11:43.759594 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2d0d1e-4699-409c-a2ac-cb9c1a4c2a64 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:11:43.778002 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb2d0d1e-4699-409c-a2ac-cb9c1a4c2a64 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:11:43.779483 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb2d0d1e-4699-409c-a2ac-cb9c1a4c2a64 None admin] RBAC: Authorization granted {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:11:43.798850 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application [None req-bb2d0d1e-4699-409c-a2ac-cb9c1a4c2a64 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 08:11:43.798850 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:11:43.798850 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:11:43.798850 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:11:43.798850 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:11:43.798850 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:11:43.798850 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:11:43.798850 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:11:43.798850 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:11:43.798850 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:11:43.798850 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:11:43.798850 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:11:43.798850 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 08:11:43.798850 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 08:11:43.798850 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 08:11:43.799912 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 08:11:43.799912 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:11:43.799912 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:11:43.799912 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:11:43.799912 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:11:43.799912 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:11:43.799912 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:11:43.799912 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:11:43.799912 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application with Lock( Jul 28 08:11:43.799912 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:11:43.799912 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:11:43.799912 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:11:43.799912 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:11:43.799912 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:11:43.799912 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:11:43.799912 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:11:43.799912 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:11:43.801039 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 08:11:43.801039 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 08:11:43.801039 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 08:11:43.801039 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application Jul 28 08:11:43.801039 dv-cinder-851351-1-smb devstack@keystone.service[144068]: [pid: 144068|app: 0|req: 244/485] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 08:11:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 273 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:11:43.806669 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39aa9d1-421f-4eb7-a791-408b8bc9fe6d None admin] Authenticating user token {{(pid=144067) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:11:43.809085 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f61f91d-0213-47bb-bbbd-826e39bda525 None None] REQUEST_METHOD: `GET` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:11:43.809375 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f61f91d-0213-47bb-bbbd-826e39bda525 None None] SCRIPT_NAME: `/identity` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:11:43.809653 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f61f91d-0213-47bb-bbbd-826e39bda525 None None] PATH_INFO: `/` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:11:43.811028 dv-cinder-851351-1-smb devstack@keystone.service[144068]: [pid: 144068|app: 0|req: 245/486] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 08:11:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 28 08:11:43.833235 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df28ba73-2e91-4dc8-a371-f1393dd667bc None None] REQUEST_METHOD: `POST` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:11:43.833588 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df28ba73-2e91-4dc8-a371-f1393dd667bc None None] SCRIPT_NAME: `/identity` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:11:43.833809 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df28ba73-2e91-4dc8-a371-f1393dd667bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:11:43.864283 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.auth.core [None req-df28ba73-2e91-4dc8-a371-f1393dd667bc None None] MFA Rules not processed for user `bf5ceb8f07374635ad506b7d1b4f1612`. Rule list: `[]` (Enabled: `True`). {{(pid=144068) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 08:11:43.865597 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.fernet_utils [None req-df28ba73-2e91-4dc8-a371-f1393dd667bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=144068) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:11:43.985017 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG dbcounter [-] [144067] Writing DB stats keystone:SELECT=100 {{(pid=144067) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:11:44.009416 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39aa9d1-421f-4eb7-a791-408b8bc9fe6d None admin] Validating token access rules against request {{(pid=144067) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:11:44.013173 dv-cinder-851351-1-smb devstack@keystone.service[144068]: [pid: 144068|app: 0|req: 246/487] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 08:11:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 08:11:44.046887 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261b575c-9826-4abd-9340-b6c97e003e38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144067) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:11:44.047521 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261b575c-9826-4abd-9340-b6c97e003e38 None admin] REQUEST_METHOD: `GET` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:11:44.047808 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261b575c-9826-4abd-9340-b6c97e003e38 None admin] SCRIPT_NAME: `/identity` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:11:44.048088 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261b575c-9826-4abd-9340-b6c97e003e38 None admin] PATH_INFO: `/v3/domains` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:11:44.048911 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-261b575c-9826-4abd-9340-b6c97e003e38 None admin] RBAC: Adding query filter params (name=Default) {{(pid=144067) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:11:44.049223 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-261b575c-9826-4abd-9340-b6c97e003e38 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:11:44.050872 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-261b575c-9826-4abd-9340-b6c97e003e38 None admin] RBAC: Authorization granted {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:11:44.063474 dv-cinder-851351-1-smb devstack@keystone.service[144067]: [pid: 144067|app: 0|req: 242/488] 10.222.0.42 () {56 vars in 1109 bytes} [Thu Jul 28 08:11:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:11:44.069941 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df28ba73-2e91-4dc8-a371-f1393dd667bc None None] Authenticating user token {{(pid=144068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:11:44.075889 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261b575c-9826-4abd-9340-b6c97e003e38 None admin] Authenticating user token {{(pid=144067) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:11:44.202467 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG dbcounter [-] [144068] Writing DB stats keystone:SELECT=100 {{(pid=144068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:11:44.229342 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261b575c-9826-4abd-9340-b6c97e003e38 None admin] Validating token access rules against request {{(pid=144067) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:11:44.302511 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65034a23-fffe-4f94-83ec-80cbff75af7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144067) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:11:44.302908 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df28ba73-2e91-4dc8-a371-f1393dd667bc None None] Validating token access rules against request {{(pid=144068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:11:44.303404 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65034a23-fffe-4f94-83ec-80cbff75af7e None admin] REQUEST_METHOD: `GET` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:11:44.303677 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65034a23-fffe-4f94-83ec-80cbff75af7e None admin] SCRIPT_NAME: `/identity` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:11:44.304124 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65034a23-fffe-4f94-83ec-80cbff75af7e None admin] PATH_INFO: `/v3/roles/service` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:11:44.328230 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65034a23-fffe-4f94-83ec-80cbff75af7e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 08:11:44.334027 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application [None req-65034a23-fffe-4f94-83ec-80cbff75af7e None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 28 08:11:44.334027 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:11:44.334027 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:11:44.334027 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:11:44.334027 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:11:44.334027 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:11:44.334027 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:11:44.334027 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:11:44.334027 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:11:44.334027 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:11:44.334027 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:11:44.334027 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:11:44.334027 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 08:11:44.334027 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 08:11:44.334027 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 08:11:44.334027 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 08:11:44.335242 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 08:11:44.335242 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 08:11:44.335242 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 08:11:44.335242 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 08:11:44.335242 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:11:44.335242 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:11:44.335242 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:11:44.335242 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:11:44.335242 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:11:44.335242 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:11:44.335242 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:11:44.335242 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application with Lock( Jul 28 08:11:44.335242 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:11:44.335242 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:11:44.335242 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:11:44.335242 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:11:44.336722 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:11:44.336722 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:11:44.336722 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:11:44.336722 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:11:44.336722 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 08:11:44.336722 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 08:11:44.336722 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 08:11:44.336722 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 08:11:44.336722 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 08:11:44.336722 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 08:11:44.336722 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 28 08:11:44.336722 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application Jul 28 08:11:44.346043 dv-cinder-851351-1-smb devstack@keystone.service[144067]: [pid: 144067|app: 0|req: 243/489] 10.222.0.42 () {56 vars in 1102 bytes} [Thu Jul 28 08:11:44 2022] GET /identity/v3/roles/service => generated 85 bytes in 271 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:11:44.350896 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c56252f4-ab36-4b0f-a549-c1fcd7b02500 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:11:44.351718 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56252f4-ab36-4b0f-a549-c1fcd7b02500 None admin] REQUEST_METHOD: `GET` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:11:44.352084 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56252f4-ab36-4b0f-a549-c1fcd7b02500 None admin] SCRIPT_NAME: `/identity` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:11:44.352425 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56252f4-ab36-4b0f-a549-c1fcd7b02500 None admin] PATH_INFO: `/v3/users/nova` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:11:44.353828 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65034a23-fffe-4f94-83ec-80cbff75af7e None admin] Authenticating user token {{(pid=144067) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:11:44.365507 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c56252f4-ab36-4b0f-a549-c1fcd7b02500 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:11:44.367397 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c56252f4-ab36-4b0f-a549-c1fcd7b02500 None admin] RBAC: Authorization granted {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:11:44.372221 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG dbcounter [-] [144067] Writing DB stats keystone:SELECT=100 {{(pid=144067) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:11:44.384293 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application [None req-c56252f4-ab36-4b0f-a549-c1fcd7b02500 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 28 08:11:44.384293 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:11:44.384293 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:11:44.384293 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:11:44.384293 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:11:44.384293 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:11:44.384293 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:11:44.384293 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:11:44.384293 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:11:44.384293 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:11:44.384293 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:11:44.384293 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:11:44.384293 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 28 08:11:44.384293 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 28 08:11:44.384293 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 28 08:11:44.384293 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 28 08:11:44.385595 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:11:44.385595 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:11:44.385595 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 28 08:11:44.385595 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 08:11:44.385595 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 28 08:11:44.385595 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 08:11:44.385595 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:11:44.385595 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:11:44.385595 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:11:44.385595 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:11:44.385595 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:11:44.385595 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application with Lock( Jul 28 08:11:44.385595 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:11:44.385595 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:11:44.385595 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:11:44.385595 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:11:44.385595 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:11:44.385595 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:11:44.386638 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:11:44.386638 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:11:44.386638 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 28 08:11:44.386638 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 28 08:11:44.386638 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 28 08:11:44.386638 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 28 08:11:44.386638 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 28 08:11:44.386638 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 28 08:11:44.386638 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 28 08:11:44.386638 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application Jul 28 08:11:44.388862 dv-cinder-851351-1-smb devstack@keystone.service[144068]: [pid: 144068|app: 0|req: 247/490] 10.222.0.42 () {56 vars in 1093 bytes} [Thu Jul 28 08:11:44 2022] GET /identity/v3/users/nova => generated 82 bytes in 319 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:11:44.389941 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbbff183-cb32-406e-b3e1-99c6742b74af None None] REQUEST_METHOD: `GET` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:11:44.390230 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbbff183-cb32-406e-b3e1-99c6742b74af None None] SCRIPT_NAME: `/identity` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:11:44.390510 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbbff183-cb32-406e-b3e1-99c6742b74af None None] PATH_INFO: `/` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:11:44.391891 dv-cinder-851351-1-smb devstack@keystone.service[144068]: [pid: 144068|app: 0|req: 248/491] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 08:11:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 08:11:44.398965 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbbff183-cb32-406e-b3e1-99c6742b74af None None] Authenticating user token {{(pid=144068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:11:44.479525 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65034a23-fffe-4f94-83ec-80cbff75af7e None admin] Validating token access rules against request {{(pid=144067) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:11:44.510270 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbbff183-cb32-406e-b3e1-99c6742b74af None None] Validating token access rules against request {{(pid=144068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:11:44.522653 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca4dd5f8-7a77-473a-886c-dbbcb3d016b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144067) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:11:44.523683 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4dd5f8-7a77-473a-886c-dbbcb3d016b0 None admin] REQUEST_METHOD: `GET` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:11:44.524192 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4dd5f8-7a77-473a-886c-dbbcb3d016b0 None admin] SCRIPT_NAME: `/identity` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:11:44.524694 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4dd5f8-7a77-473a-886c-dbbcb3d016b0 None admin] PATH_INFO: `/v3/roles` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:11:44.525911 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca4dd5f8-7a77-473a-886c-dbbcb3d016b0 None admin] RBAC: Adding query filter params (name=service) {{(pid=144067) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:11:44.526533 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca4dd5f8-7a77-473a-886c-dbbcb3d016b0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:11:44.528235 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca4dd5f8-7a77-473a-886c-dbbcb3d016b0 None admin] RBAC: Authorization granted {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:11:44.537485 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG dbcounter [-] [144068] Writing DB stats keystone:SELECT=100 {{(pid=144068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:11:44.543869 dv-cinder-851351-1-smb devstack@keystone.service[144067]: [pid: 144067|app: 0|req: 244/492] 10.222.0.42 () {56 vars in 1103 bytes} [Thu Jul 28 08:11:44 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:11:44.546670 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26321993-1c17-40e2-8396-1faaf0a300c0 None None] REQUEST_METHOD: `POST` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:11:44.547441 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26321993-1c17-40e2-8396-1faaf0a300c0 None None] SCRIPT_NAME: `/identity` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:11:44.547953 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26321993-1c17-40e2-8396-1faaf0a300c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:11:44.555678 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6821d9ae-3718-4840-85cc-ea337c2c2155 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:11:44.556221 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6821d9ae-3718-4840-85cc-ea337c2c2155 None admin] REQUEST_METHOD: `GET` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:11:44.556522 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6821d9ae-3718-4840-85cc-ea337c2c2155 None admin] SCRIPT_NAME: `/identity` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:11:44.556833 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6821d9ae-3718-4840-85cc-ea337c2c2155 None admin] PATH_INFO: `/v3/users` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:11:44.557678 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6821d9ae-3718-4840-85cc-ea337c2c2155 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=144068) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:11:44.557977 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6821d9ae-3718-4840-85cc-ea337c2c2155 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:11:44.559477 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6821d9ae-3718-4840-85cc-ea337c2c2155 None admin] RBAC: Authorization granted {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:11:44.573525 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.auth.core [None req-26321993-1c17-40e2-8396-1faaf0a300c0 None None] MFA Rules not processed for user `bf5ceb8f07374635ad506b7d1b4f1612`. Rule list: `[]` (Enabled: `True`). {{(pid=144067) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 08:11:44.575200 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.fernet_utils [None req-26321993-1c17-40e2-8396-1faaf0a300c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=144067) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:11:44.599734 dv-cinder-851351-1-smb devstack@keystone.service[144068]: [pid: 144068|app: 0|req: 249/493] 10.222.0.42 () {56 vars in 1133 bytes} [Thu Jul 28 08:11:44 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:11:44.600624 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6821d9ae-3718-4840-85cc-ea337c2c2155 None admin] Authenticating user token {{(pid=144068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:11:44.654581 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG dbcounter [-] [144067] Writing DB stats keystone:SELECT=100 {{(pid=144067) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:11:44.664813 dv-cinder-851351-1-smb devstack@keystone.service[144067]: [pid: 144067|app: 0|req: 245/494] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 08:11:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 08:11:44.665702 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26321993-1c17-40e2-8396-1faaf0a300c0 None None] Authenticating user token {{(pid=144067) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:11:44.724387 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6821d9ae-3718-4840-85cc-ea337c2c2155 None admin] Validating token access rules against request {{(pid=144068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:11:44.761734 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04827549-90b4-4e90-bf4f-4034ba063f62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:11:44.762484 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04827549-90b4-4e90-bf4f-4034ba063f62 None admin] REQUEST_METHOD: `GET` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:11:44.762853 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04827549-90b4-4e90-bf4f-4034ba063f62 None admin] SCRIPT_NAME: `/identity` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:11:44.763182 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04827549-90b4-4e90-bf4f-4034ba063f62 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:11:44.776547 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04827549-90b4-4e90-bf4f-4034ba063f62 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:11:44.778346 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04827549-90b4-4e90-bf4f-4034ba063f62 None admin] RBAC: Authorization granted {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:11:44.781640 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26321993-1c17-40e2-8396-1faaf0a300c0 None None] Validating token access rules against request {{(pid=144067) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:11:44.797693 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application [None req-04827549-90b4-4e90-bf4f-4034ba063f62 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 08:11:44.797693 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:11:44.797693 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:11:44.797693 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:11:44.797693 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:11:44.797693 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:11:44.797693 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:11:44.797693 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:11:44.797693 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:11:44.797693 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:11:44.797693 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:11:44.797693 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:11:44.797693 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 08:11:44.797693 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 08:11:44.797693 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 08:11:44.798957 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 08:11:44.798957 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:11:44.798957 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:11:44.798957 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:11:44.798957 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:11:44.798957 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:11:44.798957 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:11:44.798957 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:11:44.798957 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application with Lock( Jul 28 08:11:44.798957 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:11:44.798957 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:11:44.798957 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:11:44.798957 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:11:44.798957 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:11:44.798957 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:11:44.798957 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:11:44.798957 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:11:44.799991 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 08:11:44.799991 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 08:11:44.799991 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 08:11:44.799991 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application Jul 28 08:11:44.799991 dv-cinder-851351-1-smb devstack@keystone.service[144068]: [pid: 144068|app: 0|req: 250/495] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 08:11:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:11:44.800777 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cce80e8-586e-4952-b81f-0538f5c00c67 None None] REQUEST_METHOD: `GET` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:11:44.801075 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cce80e8-586e-4952-b81f-0538f5c00c67 None None] SCRIPT_NAME: `/identity` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:11:44.801398 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cce80e8-586e-4952-b81f-0538f5c00c67 None None] PATH_INFO: `/` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:11:44.803080 dv-cinder-851351-1-smb devstack@keystone.service[144068]: [pid: 144068|app: 0|req: 251/496] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 08:11:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 08:11:44.805946 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cce80e8-586e-4952-b81f-0538f5c00c67 None None] Authenticating user token {{(pid=144068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:11:44.824769 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a07df0-bfb2-40aa-b329-d7b432ab0416 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144067) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:11:44.825396 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a07df0-bfb2-40aa-b329-d7b432ab0416 None admin] REQUEST_METHOD: `GET` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:11:44.825666 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a07df0-bfb2-40aa-b329-d7b432ab0416 None admin] SCRIPT_NAME: `/identity` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:11:44.825959 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a07df0-bfb2-40aa-b329-d7b432ab0416 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:11:44.851609 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG dbcounter [-] [144068] Writing DB stats keystone:SELECT=100 {{(pid=144068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:11:44.901853 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG dbcounter [-] [144067] Writing DB stats keystone:SELECT=100 {{(pid=144067) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:11:44.904382 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a07df0-bfb2-40aa-b329-d7b432ab0416 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:11:44.906081 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a07df0-bfb2-40aa-b329-d7b432ab0416 None admin] RBAC: Authorization granted {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:11:44.936456 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cce80e8-586e-4952-b81f-0538f5c00c67 None None] Validating token access rules against request {{(pid=144068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:11:44.986342 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bdbf2f7-656a-494f-873b-ea8b8ed98f9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:11:44.987853 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bdbf2f7-656a-494f-873b-ea8b8ed98f9b None admin] REQUEST_METHOD: `GET` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:11:44.988139 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bdbf2f7-656a-494f-873b-ea8b8ed98f9b None admin] SCRIPT_NAME: `/identity` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:11:44.988417 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bdbf2f7-656a-494f-873b-ea8b8ed98f9b None admin] PATH_INFO: `/v3/roles/service` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:11:45.000133 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bdbf2f7-656a-494f-873b-ea8b8ed98f9b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 08:11:45.005652 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application [None req-4bdbf2f7-656a-494f-873b-ea8b8ed98f9b None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 28 08:11:45.005652 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:11:45.005652 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:11:45.005652 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:11:45.005652 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:11:45.005652 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:11:45.005652 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:11:45.005652 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:11:45.005652 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:11:45.005652 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:11:45.005652 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:11:45.005652 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:11:45.005652 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 08:11:45.005652 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 08:11:45.005652 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 08:11:45.005652 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 08:11:45.006667 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 08:11:45.006667 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 08:11:45.006667 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 08:11:45.006667 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 08:11:45.006667 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:11:45.006667 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:11:45.006667 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:11:45.006667 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:11:45.006667 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:11:45.006667 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:11:45.006667 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:11:45.006667 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application with Lock( Jul 28 08:11:45.006667 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:11:45.006667 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:11:45.006667 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:11:45.006667 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:11:45.007692 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:11:45.007692 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:11:45.007692 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:11:45.007692 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:11:45.007692 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 08:11:45.007692 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 08:11:45.007692 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 08:11:45.007692 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 08:11:45.007692 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 08:11:45.007692 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 08:11:45.007692 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 28 08:11:45.007692 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application Jul 28 08:11:45.007692 dv-cinder-851351-1-smb devstack@keystone.service[144068]: [pid: 144068|app: 0|req: 252/497] 10.222.0.42 () {56 vars in 1102 bytes} [Thu Jul 28 08:11:44 2022] GET /identity/v3/roles/service => generated 85 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:11:45.007692 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bdbf2f7-656a-494f-873b-ea8b8ed98f9b None admin] Authenticating user token {{(pid=144068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:11:45.025588 dv-cinder-851351-1-smb devstack@keystone.service[144067]: [pid: 144067|app: 0|req: 246/498] 10.222.0.42 () {58 vars in 1282 bytes} [Thu Jul 28 08:11:44 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 360 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 28 08:11:45.027464 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3dad45-3a8f-48c3-addb-0863c556b479 None None] REQUEST_METHOD: `POST` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:11:45.027787 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3dad45-3a8f-48c3-addb-0863c556b479 None None] SCRIPT_NAME: `/identity` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:11:45.028067 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3dad45-3a8f-48c3-addb-0863c556b479 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:11:45.046347 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.auth.core [None req-8d3dad45-3a8f-48c3-addb-0863c556b479 None None] MFA Rules not processed for user `bf5ceb8f07374635ad506b7d1b4f1612`. Rule list: `[]` (Enabled: `True`). {{(pid=144067) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 08:11:45.047550 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.fernet_utils [None req-8d3dad45-3a8f-48c3-addb-0863c556b479 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=144067) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:11:45.128113 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG dbcounter [-] [144068] Writing DB stats keystone:SELECT=100 {{(pid=144068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:11:45.129526 dv-cinder-851351-1-smb devstack@keystone.service[144067]: [pid: 144067|app: 0|req: 247/499] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 08:11:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 08:11:45.136975 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bdbf2f7-656a-494f-873b-ea8b8ed98f9b None admin] Validating token access rules against request {{(pid=144068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:11:45.141608 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3dad45-3a8f-48c3-addb-0863c556b479 None None] Authenticating user token {{(pid=144067) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:11:45.175107 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG dbcounter [-] [144067] Writing DB stats keystone:SELECT=100 {{(pid=144067) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:11:45.183914 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d540a9-39ff-4dfd-ad72-ec55102fac89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:11:45.184962 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d540a9-39ff-4dfd-ad72-ec55102fac89 None admin] REQUEST_METHOD: `GET` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:11:45.185450 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d540a9-39ff-4dfd-ad72-ec55102fac89 None admin] SCRIPT_NAME: `/identity` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:11:45.185926 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d540a9-39ff-4dfd-ad72-ec55102fac89 None admin] PATH_INFO: `/v3/domains` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:11:45.186883 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6d540a9-39ff-4dfd-ad72-ec55102fac89 None admin] RBAC: Adding query filter params (name=Default) {{(pid=144068) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:11:45.187279 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6d540a9-39ff-4dfd-ad72-ec55102fac89 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:11:45.188722 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6d540a9-39ff-4dfd-ad72-ec55102fac89 None admin] RBAC: Authorization granted {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:11:45.204432 dv-cinder-851351-1-smb devstack@keystone.service[144068]: [pid: 144068|app: 0|req: 253/500] 10.222.0.42 () {56 vars in 1109 bytes} [Thu Jul 28 08:11:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:11:45.205382 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d540a9-39ff-4dfd-ad72-ec55102fac89 None admin] Authenticating user token {{(pid=144068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:11:45.255258 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3dad45-3a8f-48c3-addb-0863c556b479 None None] Validating token access rules against request {{(pid=144067) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:11:45.293084 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88121827-c790-42e9-85d1-a2b45b4e10e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144067) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:11:45.293729 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88121827-c790-42e9-85d1-a2b45b4e10e5 None admin] REQUEST_METHOD: `GET` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:11:45.294017 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88121827-c790-42e9-85d1-a2b45b4e10e5 None admin] SCRIPT_NAME: `/identity` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:11:45.294297 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88121827-c790-42e9-85d1-a2b45b4e10e5 None admin] PATH_INFO: `/v3/roles` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:11:45.295039 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88121827-c790-42e9-85d1-a2b45b4e10e5 None admin] RBAC: Adding query filter params (name=service) {{(pid=144067) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:11:45.295350 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88121827-c790-42e9-85d1-a2b45b4e10e5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:11:45.296800 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88121827-c790-42e9-85d1-a2b45b4e10e5 None admin] RBAC: Authorization granted {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:11:45.305248 dv-cinder-851351-1-smb devstack@keystone.service[144067]: [pid: 144067|app: 0|req: 248/501] 10.222.0.42 () {56 vars in 1103 bytes} [Thu Jul 28 08:11:45 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:11:45.306074 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88121827-c790-42e9-85d1-a2b45b4e10e5 None admin] Authenticating user token {{(pid=144067) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:11:45.309060 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d540a9-39ff-4dfd-ad72-ec55102fac89 None admin] Validating token access rules against request {{(pid=144068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:11:45.352888 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d838047-aa34-4019-8295-8c6bc8674387 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:11:45.353564 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d838047-aa34-4019-8295-8c6bc8674387 None admin] REQUEST_METHOD: `GET` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:11:45.353845 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d838047-aa34-4019-8295-8c6bc8674387 None admin] SCRIPT_NAME: `/identity` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:11:45.354118 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d838047-aa34-4019-8295-8c6bc8674387 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:11:45.366764 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d838047-aa34-4019-8295-8c6bc8674387 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:11:45.368288 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d838047-aa34-4019-8295-8c6bc8674387 None admin] RBAC: Authorization granted {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:11:45.385119 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application [None req-2d838047-aa34-4019-8295-8c6bc8674387 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 08:11:45.385119 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:11:45.385119 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:11:45.385119 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:11:45.385119 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:11:45.385119 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:11:45.385119 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:11:45.385119 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:11:45.385119 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:11:45.385119 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:11:45.385119 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:11:45.385119 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:11:45.385119 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 08:11:45.385119 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 08:11:45.385119 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 08:11:45.386864 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 08:11:45.386864 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:11:45.386864 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:11:45.386864 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:11:45.386864 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:11:45.386864 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:11:45.386864 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:11:45.386864 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:11:45.386864 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application with Lock( Jul 28 08:11:45.386864 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:11:45.386864 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:11:45.386864 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:11:45.386864 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:11:45.386864 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:11:45.386864 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:11:45.386864 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:11:45.386864 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:11:45.387856 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 08:11:45.387856 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 08:11:45.387856 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 08:11:45.387856 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application Jul 28 08:11:45.387856 dv-cinder-851351-1-smb devstack@keystone.service[144068]: [pid: 144068|app: 0|req: 254/502] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 08:11:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:11:45.387856 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1d921b-ff17-45a7-b5f4-673d61ed3080 None None] REQUEST_METHOD: `GET` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:11:45.387856 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1d921b-ff17-45a7-b5f4-673d61ed3080 None None] SCRIPT_NAME: `/identity` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:11:45.388358 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1d921b-ff17-45a7-b5f4-673d61ed3080 None None] PATH_INFO: `/` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:11:45.389489 dv-cinder-851351-1-smb devstack@keystone.service[144068]: [pid: 144068|app: 0|req: 255/503] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 08:11:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 08:11:45.390241 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b1d921b-ff17-45a7-b5f4-673d61ed3080 None None] Authenticating user token {{(pid=144068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:11:45.402821 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG dbcounter [-] [144068] Writing DB stats keystone:SELECT=100 {{(pid=144068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:11:45.446517 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG dbcounter [-] [144067] Writing DB stats keystone:SELECT=100 {{(pid=144067) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:11:45.459302 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88121827-c790-42e9-85d1-a2b45b4e10e5 None admin] Validating token access rules against request {{(pid=144067) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:11:45.494702 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1068dc86-6c88-4c91-8f26-e4df1ca24a35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144067) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:11:45.495391 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1068dc86-6c88-4c91-8f26-e4df1ca24a35 None admin] REQUEST_METHOD: `GET` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:11:45.495654 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1068dc86-6c88-4c91-8f26-e4df1ca24a35 None admin] SCRIPT_NAME: `/identity` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:11:45.495932 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1068dc86-6c88-4c91-8f26-e4df1ca24a35 None admin] PATH_INFO: `/v3/roles/service` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:11:45.506804 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1068dc86-6c88-4c91-8f26-e4df1ca24a35 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 08:11:45.511079 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b1d921b-ff17-45a7-b5f4-673d61ed3080 None None] Validating token access rules against request {{(pid=144068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:11:45.513014 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application [None req-1068dc86-6c88-4c91-8f26-e4df1ca24a35 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 28 08:11:45.513014 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:11:45.513014 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:11:45.513014 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:11:45.513014 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:11:45.513014 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:11:45.513014 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:11:45.513014 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:11:45.513014 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:11:45.513014 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:11:45.513014 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:11:45.513014 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:11:45.513014 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 08:11:45.513014 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 08:11:45.513014 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 08:11:45.513014 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 08:11:45.514103 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 08:11:45.514103 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 08:11:45.514103 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 08:11:45.514103 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 08:11:45.514103 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:11:45.514103 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:11:45.514103 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:11:45.514103 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:11:45.514103 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:11:45.514103 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:11:45.514103 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:11:45.514103 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application with Lock( Jul 28 08:11:45.514103 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:11:45.514103 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:11:45.514103 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:11:45.514103 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:11:45.515028 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:11:45.515028 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:11:45.515028 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:11:45.515028 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:11:45.515028 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 08:11:45.515028 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 08:11:45.515028 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 08:11:45.515028 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 08:11:45.515028 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 08:11:45.515028 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 08:11:45.515028 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 28 08:11:45.515028 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application Jul 28 08:11:45.515028 dv-cinder-851351-1-smb devstack@keystone.service[144067]: [pid: 144067|app: 0|req: 249/504] 10.222.0.42 () {56 vars in 1102 bytes} [Thu Jul 28 08:11:45 2022] GET /identity/v3/roles/service => generated 85 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:11:45.515028 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1068dc86-6c88-4c91-8f26-e4df1ca24a35 None admin] Authenticating user token {{(pid=144067) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:11:45.549518 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08aaacd-f3ea-4d1c-943f-3b6fb9fdadfb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:11:45.550178 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08aaacd-f3ea-4d1c-943f-3b6fb9fdadfb None admin] REQUEST_METHOD: `GET` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:11:45.550464 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08aaacd-f3ea-4d1c-943f-3b6fb9fdadfb None admin] SCRIPT_NAME: `/identity` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:11:45.550767 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08aaacd-f3ea-4d1c-943f-3b6fb9fdadfb None admin] PATH_INFO: `/v3/users/glance` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:11:45.560636 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c08aaacd-f3ea-4d1c-943f-3b6fb9fdadfb None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:11:45.562462 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c08aaacd-f3ea-4d1c-943f-3b6fb9fdadfb None admin] RBAC: Authorization granted {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:11:45.574366 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application [None req-c08aaacd-f3ea-4d1c-943f-3b6fb9fdadfb None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jul 28 08:11:45.574366 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:11:45.574366 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:11:45.574366 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:11:45.574366 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:11:45.574366 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:11:45.574366 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:11:45.574366 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:11:45.574366 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:11:45.574366 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:11:45.574366 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:11:45.574366 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:11:45.574366 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 28 08:11:45.574366 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 28 08:11:45.574366 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 28 08:11:45.574366 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 28 08:11:45.575451 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:11:45.575451 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:11:45.575451 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 28 08:11:45.575451 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 08:11:45.575451 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 28 08:11:45.575451 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 08:11:45.575451 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:11:45.575451 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:11:45.575451 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:11:45.575451 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:11:45.575451 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:11:45.575451 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application with Lock( Jul 28 08:11:45.575451 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:11:45.575451 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:11:45.575451 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:11:45.575451 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:11:45.575451 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:11:45.575451 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:11:45.576496 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:11:45.576496 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:11:45.576496 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 28 08:11:45.576496 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 28 08:11:45.576496 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 28 08:11:45.576496 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 28 08:11:45.576496 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 28 08:11:45.576496 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 28 08:11:45.576496 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jul 28 08:11:45.576496 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application Jul 28 08:11:45.576496 dv-cinder-851351-1-smb devstack@keystone.service[144068]: [pid: 144068|app: 0|req: 256/505] 10.222.0.42 () {56 vars in 1099 bytes} [Thu Jul 28 08:11:45 2022] GET /identity/v3/users/glance => generated 84 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:11:45.577230 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08aaacd-f3ea-4d1c-943f-3b6fb9fdadfb None admin] Authenticating user token {{(pid=144068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:11:45.626412 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1068dc86-6c88-4c91-8f26-e4df1ca24a35 None admin] Validating token access rules against request {{(pid=144067) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:11:45.645917 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG dbcounter [-] [144068] Writing DB stats keystone:SELECT=100 {{(pid=144068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:11:45.665966 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d5ad75-2bc8-4c65-a0f6-3d1fe730bd70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144067) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:11:45.666646 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d5ad75-2bc8-4c65-a0f6-3d1fe730bd70 None admin] REQUEST_METHOD: `GET` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:11:45.666933 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d5ad75-2bc8-4c65-a0f6-3d1fe730bd70 None admin] SCRIPT_NAME: `/identity` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:11:45.667209 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d5ad75-2bc8-4c65-a0f6-3d1fe730bd70 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:11:45.679647 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0d5ad75-2bc8-4c65-a0f6-3d1fe730bd70 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:11:45.681248 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0d5ad75-2bc8-4c65-a0f6-3d1fe730bd70 None admin] RBAC: Authorization granted {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:11:45.684859 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08aaacd-f3ea-4d1c-943f-3b6fb9fdadfb None admin] Validating token access rules against request {{(pid=144068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:11:45.697400 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application [None req-a0d5ad75-2bc8-4c65-a0f6-3d1fe730bd70 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 08:11:45.697400 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:11:45.697400 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:11:45.697400 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:11:45.697400 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:11:45.697400 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:11:45.697400 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:11:45.697400 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:11:45.697400 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:11:45.697400 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:11:45.697400 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:11:45.697400 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:11:45.697400 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 08:11:45.697400 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 08:11:45.697400 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 08:11:45.698605 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 08:11:45.698605 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:11:45.698605 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:11:45.698605 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:11:45.698605 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:11:45.698605 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:11:45.698605 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:11:45.698605 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:11:45.698605 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application with Lock( Jul 28 08:11:45.698605 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:11:45.698605 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:11:45.698605 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:11:45.698605 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:11:45.698605 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:11:45.698605 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:11:45.698605 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:11:45.698605 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:11:45.699721 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 08:11:45.699721 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 08:11:45.699721 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 08:11:45.699721 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application Jul 28 08:11:45.699721 dv-cinder-851351-1-smb devstack@keystone.service[144067]: [pid: 144067|app: 0|req: 250/506] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 08:11:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:11:45.700036 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5284515-4765-405d-a216-0a572455a230 None None] REQUEST_METHOD: `POST` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:11:45.700285 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5284515-4765-405d-a216-0a572455a230 None None] SCRIPT_NAME: `/identity` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:11:45.700504 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5284515-4765-405d-a216-0a572455a230 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:11:45.709016 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG dbcounter [-] [144067] Writing DB stats keystone:SELECT=100 {{(pid=144067) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:11:45.721270 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.auth.core [None req-c5284515-4765-405d-a216-0a572455a230 None None] MFA Rules not processed for user `bf5ceb8f07374635ad506b7d1b4f1612`. Rule list: `[]` (Enabled: `True`). {{(pid=144067) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 08:11:45.722526 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.fernet_utils [None req-c5284515-4765-405d-a216-0a572455a230 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=144067) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:11:45.728395 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2886f115-9bea-4ea9-b4ec-412653f8281c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:11:45.729067 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2886f115-9bea-4ea9-b4ec-412653f8281c None admin] REQUEST_METHOD: `GET` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:11:45.729351 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2886f115-9bea-4ea9-b4ec-412653f8281c None admin] SCRIPT_NAME: `/identity` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:11:45.729626 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2886f115-9bea-4ea9-b4ec-412653f8281c None admin] PATH_INFO: `/v3/domains` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:11:45.730332 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2886f115-9bea-4ea9-b4ec-412653f8281c None admin] RBAC: Adding query filter params (name=Default) {{(pid=144068) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:11:45.730637 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2886f115-9bea-4ea9-b4ec-412653f8281c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:11:45.732058 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2886f115-9bea-4ea9-b4ec-412653f8281c None admin] RBAC: Authorization granted {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:11:45.745413 dv-cinder-851351-1-smb devstack@keystone.service[144068]: [pid: 144068|app: 0|req: 257/507] 10.222.0.42 () {56 vars in 1109 bytes} [Thu Jul 28 08:11:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:11:45.746324 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2886f115-9bea-4ea9-b4ec-412653f8281c None admin] Authenticating user token {{(pid=144068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:11:45.796332 dv-cinder-851351-1-smb devstack@keystone.service[144067]: [pid: 144067|app: 0|req: 251/508] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 08:11:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 08:11:45.797025 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5284515-4765-405d-a216-0a572455a230 None None] Authenticating user token {{(pid=144067) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:11:45.864737 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2886f115-9bea-4ea9-b4ec-412653f8281c None admin] Validating token access rules against request {{(pid=144068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:11:45.893816 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG dbcounter [-] [144068] Writing DB stats keystone:SELECT=100 {{(pid=144068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:11:45.904921 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41abad9b-5fd8-41ef-a1c9-3ad4d360c380 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:11:45.905479 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41abad9b-5fd8-41ef-a1c9-3ad4d360c380 None admin] REQUEST_METHOD: `GET` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:11:45.905765 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41abad9b-5fd8-41ef-a1c9-3ad4d360c380 None admin] SCRIPT_NAME: `/identity` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:11:45.906046 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41abad9b-5fd8-41ef-a1c9-3ad4d360c380 None admin] PATH_INFO: `/v3/roles` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:11:45.906791 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41abad9b-5fd8-41ef-a1c9-3ad4d360c380 None admin] RBAC: Adding query filter params (name=service) {{(pid=144068) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:11:45.907100 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41abad9b-5fd8-41ef-a1c9-3ad4d360c380 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:11:45.908524 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41abad9b-5fd8-41ef-a1c9-3ad4d360c380 None admin] RBAC: Authorization granted {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:11:45.916933 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5284515-4765-405d-a216-0a572455a230 None None] Validating token access rules against request {{(pid=144067) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:11:45.917406 dv-cinder-851351-1-smb devstack@keystone.service[144068]: [pid: 144068|app: 0|req: 258/509] 10.222.0.42 () {56 vars in 1103 bytes} [Thu Jul 28 08:11:45 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:11:45.918268 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41abad9b-5fd8-41ef-a1c9-3ad4d360c380 None admin] Authenticating user token {{(pid=144068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:11:45.957050 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe9c76b-26fe-48e3-aa93-dc9dfa82d774 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144067) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:11:45.957755 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe9c76b-26fe-48e3-aa93-dc9dfa82d774 None admin] REQUEST_METHOD: `GET` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:11:45.958039 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe9c76b-26fe-48e3-aa93-dc9dfa82d774 None admin] SCRIPT_NAME: `/identity` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:11:45.958315 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe9c76b-26fe-48e3-aa93-dc9dfa82d774 None admin] PATH_INFO: `/v3/users` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:11:45.959129 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbe9c76b-26fe-48e3-aa93-dc9dfa82d774 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=144067) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:11:45.959439 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbe9c76b-26fe-48e3-aa93-dc9dfa82d774 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:11:45.961370 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbe9c76b-26fe-48e3-aa93-dc9dfa82d774 None admin] RBAC: Authorization granted {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:11:45.963507 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG dbcounter [-] [144067] Writing DB stats keystone:SELECT=100 {{(pid=144067) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:11:46.001396 dv-cinder-851351-1-smb devstack@keystone.service[144067]: [pid: 144067|app: 0|req: 252/510] 10.222.0.42 () {56 vars in 1137 bytes} [Thu Jul 28 08:11:45 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:11:46.002284 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe9c76b-26fe-48e3-aa93-dc9dfa82d774 None admin] Authenticating user token {{(pid=144067) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:11:46.033066 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41abad9b-5fd8-41ef-a1c9-3ad4d360c380 None admin] Validating token access rules against request {{(pid=144068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:11:46.072908 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2e18e5-170a-4071-899b-6e223b90c2ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:11:46.073588 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2e18e5-170a-4071-899b-6e223b90c2ec None admin] REQUEST_METHOD: `GET` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:11:46.073873 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2e18e5-170a-4071-899b-6e223b90c2ec None admin] SCRIPT_NAME: `/identity` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:11:46.074148 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2e18e5-170a-4071-899b-6e223b90c2ec None admin] PATH_INFO: `/v3/domains` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:11:46.074849 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac2e18e5-170a-4071-899b-6e223b90c2ec None admin] RBAC: Adding query filter params (name=Default) {{(pid=144068) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:11:46.075160 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac2e18e5-170a-4071-899b-6e223b90c2ec None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:11:46.076580 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac2e18e5-170a-4071-899b-6e223b90c2ec None admin] RBAC: Authorization granted {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:11:46.089495 dv-cinder-851351-1-smb devstack@keystone.service[144068]: [pid: 144068|app: 0|req: 259/511] 10.222.0.42 () {56 vars in 1109 bytes} [Thu Jul 28 08:11:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:11:46.090387 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2e18e5-170a-4071-899b-6e223b90c2ec None admin] Authenticating user token {{(pid=144068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:11:46.119538 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe9c76b-26fe-48e3-aa93-dc9dfa82d774 None admin] Validating token access rules against request {{(pid=144067) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:11:46.142107 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG dbcounter [-] [144068] Writing DB stats keystone:SELECT=100 {{(pid=144068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:11:46.157084 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8172520c-c644-46d4-b622-7d4ca64a7b91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144067) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:11:46.157670 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8172520c-c644-46d4-b622-7d4ca64a7b91 None admin] REQUEST_METHOD: `GET` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:11:46.157957 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8172520c-c644-46d4-b622-7d4ca64a7b91 None admin] SCRIPT_NAME: `/identity` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:11:46.158238 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8172520c-c644-46d4-b622-7d4ca64a7b91 None admin] PATH_INFO: `/v3/projects/service` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:11:46.165430 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8172520c-c644-46d4-b622-7d4ca64a7b91 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:11:46.166925 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8172520c-c644-46d4-b622-7d4ca64a7b91 None admin] RBAC: Authorization granted {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:11:46.181182 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application [None req-8172520c-c644-46d4-b622-7d4ca64a7b91 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 08:11:46.181182 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:11:46.181182 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:11:46.181182 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:11:46.181182 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:11:46.181182 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:11:46.181182 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:11:46.181182 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:11:46.181182 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:11:46.181182 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:11:46.181182 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:11:46.181182 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:11:46.181182 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 28 08:11:46.181182 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 28 08:11:46.181182 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 28 08:11:46.182226 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 28 08:11:46.182226 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:11:46.182226 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:11:46.182226 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:11:46.182226 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:11:46.182226 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:11:46.182226 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:11:46.182226 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:11:46.182226 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application with Lock( Jul 28 08:11:46.182226 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:11:46.182226 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:11:46.182226 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:11:46.182226 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:11:46.182226 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:11:46.182226 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:11:46.182226 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:11:46.182226 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:11:46.183181 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 28 08:11:46.183181 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 28 08:11:46.183181 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 28 08:11:46.183181 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 28 08:11:46.183181 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 28 08:11:46.183181 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 28 08:11:46.183181 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 08:11:46.183181 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application Jul 28 08:11:46.183181 dv-cinder-851351-1-smb devstack@keystone.service[144067]: [pid: 144067|app: 0|req: 253/512] 10.222.0.42 () {56 vars in 1111 bytes} [Thu Jul 28 08:11:46 2022] GET /identity/v3/projects/service => generated 88 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:11:46.183181 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8172520c-c644-46d4-b622-7d4ca64a7b91 None admin] Authenticating user token {{(pid=144067) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:11:46.200947 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2e18e5-170a-4071-899b-6e223b90c2ec None admin] Validating token access rules against request {{(pid=144068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:11:46.237755 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3884689b-243d-42e3-a9a7-4963a39a7d78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:11:46.238544 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3884689b-243d-42e3-a9a7-4963a39a7d78 None admin] REQUEST_METHOD: `GET` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:11:46.238831 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3884689b-243d-42e3-a9a7-4963a39a7d78 None admin] SCRIPT_NAME: `/identity` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:11:46.239110 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3884689b-243d-42e3-a9a7-4963a39a7d78 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:11:46.240228 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG dbcounter [-] [144067] Writing DB stats keystone:SELECT=100 {{(pid=144067) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:11:46.249944 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3884689b-243d-42e3-a9a7-4963a39a7d78 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:11:46.251452 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3884689b-243d-42e3-a9a7-4963a39a7d78 None admin] RBAC: Authorization granted {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:11:46.266544 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application [None req-3884689b-243d-42e3-a9a7-4963a39a7d78 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 08:11:46.266544 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:11:46.266544 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:11:46.266544 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:11:46.266544 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:11:46.266544 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:11:46.266544 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:11:46.266544 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:11:46.266544 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:11:46.266544 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:11:46.266544 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:11:46.266544 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:11:46.266544 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 08:11:46.266544 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 08:11:46.266544 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 08:11:46.267636 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 08:11:46.267636 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:11:46.267636 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:11:46.267636 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:11:46.267636 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:11:46.267636 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:11:46.267636 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:11:46.267636 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:11:46.267636 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application with Lock( Jul 28 08:11:46.267636 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:11:46.267636 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:11:46.267636 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:11:46.267636 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:11:46.267636 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:11:46.267636 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:11:46.267636 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:11:46.267636 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:11:46.268605 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 08:11:46.268605 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 08:11:46.268605 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 08:11:46.268605 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application Jul 28 08:11:46.268605 dv-cinder-851351-1-smb devstack@keystone.service[144068]: [pid: 144068|app: 0|req: 260/513] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 08:11:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:11:46.268605 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3884689b-243d-42e3-a9a7-4963a39a7d78 None admin] Authenticating user token {{(pid=144068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:11:46.296866 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8172520c-c644-46d4-b622-7d4ca64a7b91 None admin] Validating token access rules against request {{(pid=144067) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:11:46.336068 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8af372a-d983-4cbb-9ad0-9b5816412382 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144067) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:11:46.336760 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8af372a-d983-4cbb-9ad0-9b5816412382 None admin] REQUEST_METHOD: `GET` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:11:46.337051 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8af372a-d983-4cbb-9ad0-9b5816412382 None admin] SCRIPT_NAME: `/identity` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:11:46.337329 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8af372a-d983-4cbb-9ad0-9b5816412382 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:11:46.348308 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8af372a-d983-4cbb-9ad0-9b5816412382 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:11:46.349855 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8af372a-d983-4cbb-9ad0-9b5816412382 None admin] RBAC: Authorization granted {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:11:46.365782 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application [None req-a8af372a-d983-4cbb-9ad0-9b5816412382 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 08:11:46.365782 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:11:46.365782 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:11:46.365782 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:11:46.365782 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:11:46.365782 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:11:46.365782 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:11:46.365782 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:11:46.365782 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:11:46.365782 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:11:46.365782 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:11:46.365782 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:11:46.365782 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 08:11:46.365782 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 08:11:46.365782 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 08:11:46.366946 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 08:11:46.366946 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:11:46.366946 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:11:46.366946 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:11:46.366946 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:11:46.366946 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:11:46.366946 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:11:46.366946 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:11:46.366946 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application with Lock( Jul 28 08:11:46.366946 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:11:46.366946 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:11:46.366946 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:11:46.366946 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:11:46.366946 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:11:46.366946 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:11:46.366946 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:11:46.366946 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:11:46.368039 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 08:11:46.368039 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 08:11:46.368039 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 08:11:46.368039 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application Jul 28 08:11:46.368553 dv-cinder-851351-1-smb devstack@keystone.service[144067]: [pid: 144067|app: 0|req: 254/514] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 08:11:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:11:46.369539 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8af372a-d983-4cbb-9ad0-9b5816412382 None admin] Authenticating user token {{(pid=144067) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:11:46.372365 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG dbcounter [-] [144068] Writing DB stats keystone:SELECT=100 {{(pid=144068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:11:46.375493 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3884689b-243d-42e3-a9a7-4963a39a7d78 None admin] Validating token access rules against request {{(pid=144068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:11:46.412410 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb64dc4-cb1d-4c15-bc0a-28634d563698 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:11:46.413049 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb64dc4-cb1d-4c15-bc0a-28634d563698 None admin] REQUEST_METHOD: `GET` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:11:46.413330 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb64dc4-cb1d-4c15-bc0a-28634d563698 None admin] SCRIPT_NAME: `/identity` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:11:46.413606 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb64dc4-cb1d-4c15-bc0a-28634d563698 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:11:46.482713 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8af372a-d983-4cbb-9ad0-9b5816412382 None admin] Validating token access rules against request {{(pid=144067) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:11:46.485432 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG dbcounter [-] [144067] Writing DB stats keystone:SELECT=100 {{(pid=144067) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:11:46.504090 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb64dc4-cb1d-4c15-bc0a-28634d563698 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:11:46.505637 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb64dc4-cb1d-4c15-bc0a-28634d563698 None admin] RBAC: Authorization granted {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:11:46.523662 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5941c8c2-87bb-468f-881b-e3d2df8fbc6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144067) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:11:46.524337 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5941c8c2-87bb-468f-881b-e3d2df8fbc6b None admin] REQUEST_METHOD: `GET` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:11:46.524621 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5941c8c2-87bb-468f-881b-e3d2df8fbc6b None admin] SCRIPT_NAME: `/identity` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:11:46.524937 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5941c8c2-87bb-468f-881b-e3d2df8fbc6b None admin] PATH_INFO: `/v3/users/neutron` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:11:46.533571 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5941c8c2-87bb-468f-881b-e3d2df8fbc6b None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:11:46.535156 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5941c8c2-87bb-468f-881b-e3d2df8fbc6b None admin] RBAC: Authorization granted {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:11:46.549164 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application [None req-5941c8c2-87bb-468f-881b-e3d2df8fbc6b None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jul 28 08:11:46.549164 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:11:46.549164 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:11:46.549164 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:11:46.549164 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:11:46.549164 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:11:46.549164 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:11:46.549164 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:11:46.549164 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:11:46.549164 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:11:46.549164 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:11:46.549164 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:11:46.549164 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 28 08:11:46.549164 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 28 08:11:46.549164 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 28 08:11:46.549164 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 28 08:11:46.550441 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:11:46.550441 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:11:46.550441 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 28 08:11:46.550441 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 08:11:46.550441 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 28 08:11:46.550441 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 08:11:46.550441 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:11:46.550441 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:11:46.550441 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:11:46.550441 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:11:46.550441 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:11:46.550441 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application with Lock( Jul 28 08:11:46.550441 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:11:46.550441 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:11:46.550441 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:11:46.550441 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:11:46.550441 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:11:46.550441 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:11:46.551804 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:11:46.551804 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:11:46.551804 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 28 08:11:46.551804 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 28 08:11:46.551804 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 28 08:11:46.551804 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 28 08:11:46.551804 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 28 08:11:46.551804 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 28 08:11:46.551804 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jul 28 08:11:46.551804 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application Jul 28 08:11:46.552980 dv-cinder-851351-1-smb devstack@keystone.service[144067]: [pid: 144067|app: 0|req: 255/515] 10.222.0.42 () {56 vars in 1102 bytes} [Thu Jul 28 08:11:46 2022] GET /identity/v3/users/neutron => generated 85 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:11:46.553781 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5941c8c2-87bb-468f-881b-e3d2df8fbc6b None admin] Authenticating user token {{(pid=144067) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:11:46.618725 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG dbcounter [-] [144068] Writing DB stats keystone:SELECT=100 {{(pid=144068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:11:46.623609 dv-cinder-851351-1-smb devstack@keystone.service[144068]: [pid: 144068|app: 0|req: 261/516] 10.222.0.42 () {58 vars in 1282 bytes} [Thu Jul 28 08:11:46 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 355 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 28 08:11:46.624973 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb64dc4-cb1d-4c15-bc0a-28634d563698 None admin] Authenticating user token {{(pid=144068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:11:46.684894 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5941c8c2-87bb-468f-881b-e3d2df8fbc6b None admin] Validating token access rules against request {{(pid=144067) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:11:46.724347 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc9cd49f-949b-46b6-b1ef-87747411baaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144067) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:11:46.725049 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9cd49f-949b-46b6-b1ef-87747411baaa None admin] REQUEST_METHOD: `GET` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:11:46.725333 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9cd49f-949b-46b6-b1ef-87747411baaa None admin] SCRIPT_NAME: `/identity` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:11:46.725655 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9cd49f-949b-46b6-b1ef-87747411baaa None admin] PATH_INFO: `/v3/projects` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:11:46.727504 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc9cd49f-949b-46b6-b1ef-87747411baaa None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=144067) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:11:46.727504 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc9cd49f-949b-46b6-b1ef-87747411baaa None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:11:46.731606 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc9cd49f-949b-46b6-b1ef-87747411baaa None admin] RBAC: Authorization granted {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:11:46.748798 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb64dc4-cb1d-4c15-bc0a-28634d563698 None admin] Validating token access rules against request {{(pid=144068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:11:46.749054 dv-cinder-851351-1-smb devstack@keystone.service[144067]: [pid: 144067|app: 0|req: 256/517] 10.222.0.42 () {56 vars in 1148 bytes} [Thu Jul 28 08:11:46 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:11:46.749777 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc9cd49f-949b-46b6-b1ef-87747411baaa None admin] Authenticating user token {{(pid=144067) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:11:46.782213 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG dbcounter [-] [144067] Writing DB stats keystone:SELECT=100 {{(pid=144067) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:11:46.789642 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b34aa3-dfd9-4047-ba2b-a12e4a9e22ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:11:46.790786 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b34aa3-dfd9-4047-ba2b-a12e4a9e22ab None admin] REQUEST_METHOD: `GET` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:11:46.791272 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b34aa3-dfd9-4047-ba2b-a12e4a9e22ab None admin] SCRIPT_NAME: `/identity` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:11:46.791756 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b34aa3-dfd9-4047-ba2b-a12e4a9e22ab None admin] PATH_INFO: `/v3/domains` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:11:46.793515 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b34aa3-dfd9-4047-ba2b-a12e4a9e22ab None admin] RBAC: Adding query filter params (name=Default) {{(pid=144068) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:11:46.793645 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b34aa3-dfd9-4047-ba2b-a12e4a9e22ab None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:11:46.795549 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b34aa3-dfd9-4047-ba2b-a12e4a9e22ab None admin] RBAC: Authorization granted {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:11:46.809426 dv-cinder-851351-1-smb devstack@keystone.service[144068]: [pid: 144068|app: 0|req: 262/518] 10.222.0.42 () {56 vars in 1109 bytes} [Thu Jul 28 08:11:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:11:46.810199 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b34aa3-dfd9-4047-ba2b-a12e4a9e22ab None admin] Authenticating user token {{(pid=144068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:11:46.875554 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc9cd49f-949b-46b6-b1ef-87747411baaa None admin] Validating token access rules against request {{(pid=144067) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:11:46.882619 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG dbcounter [-] [144068] Writing DB stats keystone:SELECT=100 {{(pid=144068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:11:46.912241 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6c17d8-bb6b-48e8-9e5a-68485ac839ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144067) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:11:46.912921 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6c17d8-bb6b-48e8-9e5a-68485ac839ac None admin] REQUEST_METHOD: `GET` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:11:46.913222 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6c17d8-bb6b-48e8-9e5a-68485ac839ac None admin] SCRIPT_NAME: `/identity` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:11:46.913483 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6c17d8-bb6b-48e8-9e5a-68485ac839ac None admin] PATH_INFO: `/v3/domains` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:11:46.914216 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae6c17d8-bb6b-48e8-9e5a-68485ac839ac None admin] RBAC: Adding query filter params (name=Default) {{(pid=144067) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:11:46.914524 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae6c17d8-bb6b-48e8-9e5a-68485ac839ac None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:11:46.915956 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae6c17d8-bb6b-48e8-9e5a-68485ac839ac None admin] RBAC: Authorization granted {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:11:46.925103 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b34aa3-dfd9-4047-ba2b-a12e4a9e22ab None admin] Validating token access rules against request {{(pid=144068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:11:46.930228 dv-cinder-851351-1-smb devstack@keystone.service[144067]: [pid: 144067|app: 0|req: 257/519] 10.222.0.42 () {56 vars in 1109 bytes} [Thu Jul 28 08:11:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:11:46.931103 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6c17d8-bb6b-48e8-9e5a-68485ac839ac None admin] Authenticating user token {{(pid=144067) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:11:46.964514 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00dc8c32-1d25-4459-a04a-feef519e84ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:11:46.965058 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00dc8c32-1d25-4459-a04a-feef519e84ab None admin] REQUEST_METHOD: `GET` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:11:46.965333 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00dc8c32-1d25-4459-a04a-feef519e84ab None admin] SCRIPT_NAME: `/identity` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:11:46.965601 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00dc8c32-1d25-4459-a04a-feef519e84ab None admin] PATH_INFO: `/v3/users` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:11:46.966414 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00dc8c32-1d25-4459-a04a-feef519e84ab None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=144068) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:11:46.966726 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00dc8c32-1d25-4459-a04a-feef519e84ab None admin] RBAC: Authorizing `identity:list_users()` {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:11:46.968183 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00dc8c32-1d25-4459-a04a-feef519e84ab None admin] RBAC: Authorization granted {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:11:46.986364 dv-cinder-851351-1-smb devstack@keystone.service[144068]: [pid: 144068|app: 0|req: 263/520] 10.222.0.42 () {56 vars in 1139 bytes} [Thu Jul 28 08:11:46 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:11:46.987232 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00dc8c32-1d25-4459-a04a-feef519e84ab None admin] Authenticating user token {{(pid=144068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:11:47.035908 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG dbcounter [-] [144067] Writing DB stats keystone:SELECT=100 {{(pid=144067) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:11:47.052221 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6c17d8-bb6b-48e8-9e5a-68485ac839ac None admin] Validating token access rules against request {{(pid=144067) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:11:47.088727 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca6a4fd-8fab-4be0-aa1e-e3c2f9dbc48b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144067) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:11:47.089398 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca6a4fd-8fab-4be0-aa1e-e3c2f9dbc48b None admin] REQUEST_METHOD: `GET` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:11:47.089676 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca6a4fd-8fab-4be0-aa1e-e3c2f9dbc48b None admin] SCRIPT_NAME: `/identity` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:11:47.089948 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca6a4fd-8fab-4be0-aa1e-e3c2f9dbc48b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:11:47.096939 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00dc8c32-1d25-4459-a04a-feef519e84ab None admin] Validating token access rules against request {{(pid=144068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:11:47.110639 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca6a4fd-8fab-4be0-aa1e-e3c2f9dbc48b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:11:47.112141 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca6a4fd-8fab-4be0-aa1e-e3c2f9dbc48b None admin] RBAC: Authorization granted {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:11:47.115298 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG dbcounter [-] [144068] Writing DB stats keystone:SELECT=100 {{(pid=144068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:11:47.128637 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application [None req-bca6a4fd-8fab-4be0-aa1e-e3c2f9dbc48b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 08:11:47.128637 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:11:47.128637 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:11:47.128637 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:11:47.128637 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:11:47.128637 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:11:47.128637 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:11:47.128637 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:11:47.128637 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:11:47.128637 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:11:47.128637 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:11:47.128637 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:11:47.128637 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 08:11:47.128637 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 08:11:47.128637 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 08:11:47.130152 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 08:11:47.130152 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:11:47.130152 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:11:47.130152 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:11:47.130152 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:11:47.130152 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:11:47.130152 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:11:47.130152 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:11:47.130152 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application with Lock( Jul 28 08:11:47.130152 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:11:47.130152 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:11:47.130152 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:11:47.130152 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:11:47.130152 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:11:47.130152 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:11:47.130152 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:11:47.130152 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:11:47.131117 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 08:11:47.131117 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 08:11:47.131117 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 08:11:47.131117 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application Jul 28 08:11:47.131117 dv-cinder-851351-1-smb devstack@keystone.service[144067]: [pid: 144067|app: 0|req: 258/521] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 08:11:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:11:47.131117 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca6a4fd-8fab-4be0-aa1e-e3c2f9dbc48b None admin] Authenticating user token {{(pid=144067) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:11:47.138463 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b26f25-5de6-4adc-a197-8ead4d72a975 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:11:47.139102 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b26f25-5de6-4adc-a197-8ead4d72a975 None admin] REQUEST_METHOD: `GET` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:11:47.139388 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b26f25-5de6-4adc-a197-8ead4d72a975 None admin] SCRIPT_NAME: `/identity` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:11:47.139682 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b26f25-5de6-4adc-a197-8ead4d72a975 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:11:47.140465 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b26f25-5de6-4adc-a197-8ead4d72a975 None admin] RBAC: Adding query filter params (role.id=9aa6ce92dcbb4164ac0e44d2aa2a0248, scope.project.id=fa39ab7491e5413ca648e31ee9177fa0, user.id=2c1de9cd80344cefa3e06ae8c9c9e5d9) {{(pid=144068) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:11:47.140811 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b26f25-5de6-4adc-a197-8ead4d72a975 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:11:47.142287 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b26f25-5de6-4adc-a197-8ead4d72a975 None admin] RBAC: Authorization granted {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:11:47.148144 dv-cinder-851351-1-smb devstack@keystone.service[144068]: [pid: 144068|app: 0|req: 264/522] 10.222.0.42 () {56 vars in 1374 bytes} [Thu Jul 28 08:11:46 2022] GET /identity/v3/role_assignments?user.id=2c1de9cd80344cefa3e06ae8c9c9e5d9&scope.project.id=fa39ab7491e5413ca648e31ee9177fa0&role.id=9aa6ce92dcbb4164ac0e44d2aa2a0248 => generated 259 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:11:47.149013 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b26f25-5de6-4adc-a197-8ead4d72a975 None admin] Authenticating user token {{(pid=144068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:11:47.259490 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca6a4fd-8fab-4be0-aa1e-e3c2f9dbc48b None admin] Validating token access rules against request {{(pid=144067) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:11:47.282675 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b26f25-5de6-4adc-a197-8ead4d72a975 None admin] Validating token access rules against request {{(pid=144068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:11:47.301387 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8712b6c8-862f-4783-a280-7a9d50f13285 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144067) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:11:47.302381 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8712b6c8-862f-4783-a280-7a9d50f13285 None admin] REQUEST_METHOD: `POST` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:11:47.302943 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8712b6c8-862f-4783-a280-7a9d50f13285 None admin] SCRIPT_NAME: `/identity` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:11:47.303396 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8712b6c8-862f-4783-a280-7a9d50f13285 None admin] PATH_INFO: `/v3/users` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:11:47.304381 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8712b6c8-862f-4783-a280-7a9d50f13285 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:11:47.306127 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8712b6c8-862f-4783-a280-7a9d50f13285 None admin] RBAC: Authorization granted {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:11:47.316770 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG dbcounter [-] [144067] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=144067) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:11:47.324284 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c96bd6e-4d0d-4fb2-9bc2-9a02e7147c56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:11:47.325083 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c96bd6e-4d0d-4fb2-9bc2-9a02e7147c56 None admin] REQUEST_METHOD: `GET` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:11:47.325357 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c96bd6e-4d0d-4fb2-9bc2-9a02e7147c56 None admin] SCRIPT_NAME: `/identity` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:11:47.326526 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c96bd6e-4d0d-4fb2-9bc2-9a02e7147c56 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:11:47.336491 dv-cinder-851351-1-smb devstack@keystone.service[144067]: [pid: 144067|app: 0|req: 259/523] 10.222.0.42 () {60 vars in 1132 bytes} [Thu Jul 28 08:11:47 2022] POST /identity/v3/users => generated 247 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 08:11:47.336816 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c96bd6e-4d0d-4fb2-9bc2-9a02e7147c56 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:11:47.342427 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8712b6c8-862f-4783-a280-7a9d50f13285 None admin] Authenticating user token {{(pid=144067) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:11:47.342654 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c96bd6e-4d0d-4fb2-9bc2-9a02e7147c56 None admin] RBAC: Authorization granted {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:11:47.362871 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application [None req-4c96bd6e-4d0d-4fb2-9bc2-9a02e7147c56 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jul 28 08:11:47.362871 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:11:47.362871 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:11:47.362871 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:11:47.362871 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:11:47.362871 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:11:47.362871 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:11:47.362871 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:11:47.362871 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:11:47.362871 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:11:47.362871 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:11:47.362871 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:11:47.362871 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 28 08:11:47.362871 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 28 08:11:47.362871 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 28 08:11:47.362871 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 28 08:11:47.364305 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:11:47.364305 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:11:47.364305 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 28 08:11:47.364305 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 08:11:47.364305 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 28 08:11:47.364305 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 08:11:47.364305 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:11:47.364305 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:11:47.364305 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:11:47.364305 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:11:47.364305 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:11:47.364305 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application with Lock( Jul 28 08:11:47.364305 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:11:47.364305 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:11:47.364305 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:11:47.364305 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:11:47.364305 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:11:47.364305 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:11:47.365463 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:11:47.365463 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:11:47.365463 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 28 08:11:47.365463 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 28 08:11:47.365463 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 28 08:11:47.365463 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 28 08:11:47.365463 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 28 08:11:47.365463 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 28 08:11:47.365463 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jul 28 08:11:47.365463 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application Jul 28 08:11:47.365463 dv-cinder-851351-1-smb devstack@keystone.service[144068]: [pid: 144068|app: 0|req: 265/524] 10.222.0.42 () {56 vars in 1099 bytes} [Thu Jul 28 08:11:47 2022] GET /identity/v3/users/cinder => generated 84 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:11:47.366506 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c96bd6e-4d0d-4fb2-9bc2-9a02e7147c56 None admin] Authenticating user token {{(pid=144068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:11:47.431586 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG dbcounter [-] [144068] Writing DB stats keystone:SELECT=100 {{(pid=144068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:11:47.471330 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8712b6c8-862f-4783-a280-7a9d50f13285 None admin] Validating token access rules against request {{(pid=144067) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:11:47.513312 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04fa38d3-739b-44d8-8d17-3a3750dcbc7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144067) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:11:47.513889 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04fa38d3-739b-44d8-8d17-3a3750dcbc7a None admin] REQUEST_METHOD: `GET` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:11:47.514175 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04fa38d3-739b-44d8-8d17-3a3750dcbc7a None admin] SCRIPT_NAME: `/identity` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:11:47.514458 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04fa38d3-739b-44d8-8d17-3a3750dcbc7a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:11:47.518431 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c96bd6e-4d0d-4fb2-9bc2-9a02e7147c56 None admin] Validating token access rules against request {{(pid=144068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:11:47.560789 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b55f0082-f85d-4499-864b-a37d7bdc7b1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:11:47.561773 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55f0082-f85d-4499-864b-a37d7bdc7b1a None admin] REQUEST_METHOD: `GET` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:11:47.562066 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55f0082-f85d-4499-864b-a37d7bdc7b1a None admin] SCRIPT_NAME: `/identity` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:11:47.562386 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55f0082-f85d-4499-864b-a37d7bdc7b1a None admin] PATH_INFO: `/v3/domains` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:11:47.563055 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b55f0082-f85d-4499-864b-a37d7bdc7b1a None admin] RBAC: Adding query filter params (name=Default) {{(pid=144068) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:11:47.563362 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b55f0082-f85d-4499-864b-a37d7bdc7b1a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:11:47.565936 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b55f0082-f85d-4499-864b-a37d7bdc7b1a None admin] RBAC: Authorization granted {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:11:47.579803 dv-cinder-851351-1-smb devstack@keystone.service[144068]: [pid: 144068|app: 0|req: 266/525] 10.222.0.42 () {56 vars in 1109 bytes} [Thu Jul 28 08:11:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:11:47.580510 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b55f0082-f85d-4499-864b-a37d7bdc7b1a None admin] Authenticating user token {{(pid=144068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:11:47.586051 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG dbcounter [-] [144067] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=144067) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:11:47.596912 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04fa38d3-739b-44d8-8d17-3a3750dcbc7a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:11:47.598493 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04fa38d3-739b-44d8-8d17-3a3750dcbc7a None admin] RBAC: Authorization granted {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:11:47.713678 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b55f0082-f85d-4499-864b-a37d7bdc7b1a None admin] Validating token access rules against request {{(pid=144068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:11:47.716055 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG dbcounter [-] [144068] Writing DB stats keystone:SELECT=100 {{(pid=144068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:11:47.724093 dv-cinder-851351-1-smb devstack@keystone.service[144067]: [pid: 144067|app: 0|req: 260/526] 10.222.0.42 () {58 vars in 1282 bytes} [Thu Jul 28 08:11:47 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 387 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 28 08:11:47.725029 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04fa38d3-739b-44d8-8d17-3a3750dcbc7a None admin] Authenticating user token {{(pid=144067) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:11:47.763661 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-163b1be1-48bb-4dc1-917a-1eb2f27681d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:11:47.764543 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163b1be1-48bb-4dc1-917a-1eb2f27681d2 None admin] REQUEST_METHOD: `GET` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:11:47.765848 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163b1be1-48bb-4dc1-917a-1eb2f27681d2 None admin] SCRIPT_NAME: `/identity` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:11:47.766204 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163b1be1-48bb-4dc1-917a-1eb2f27681d2 None admin] PATH_INFO: `/v3/users` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:11:47.767114 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-163b1be1-48bb-4dc1-917a-1eb2f27681d2 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=144068) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:11:47.767493 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-163b1be1-48bb-4dc1-917a-1eb2f27681d2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:11:47.769074 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-163b1be1-48bb-4dc1-917a-1eb2f27681d2 None admin] RBAC: Authorization granted {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:11:47.794115 dv-cinder-851351-1-smb devstack@keystone.service[144068]: [pid: 144068|app: 0|req: 267/527] 10.222.0.42 () {56 vars in 1137 bytes} [Thu Jul 28 08:11:47 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:11:47.795813 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-163b1be1-48bb-4dc1-917a-1eb2f27681d2 None admin] Authenticating user token {{(pid=144068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:11:47.838356 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG dbcounter [-] [144067] Writing DB stats keystone:SELECT=100 {{(pid=144067) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:11:47.849849 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04fa38d3-739b-44d8-8d17-3a3750dcbc7a None admin] Validating token access rules against request {{(pid=144067) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:11:47.897139 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f7ff1a2-d4d3-4e76-9373-14309dc18f2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144067) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:11:47.897813 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7ff1a2-d4d3-4e76-9373-14309dc18f2a None admin] REQUEST_METHOD: `GET` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:11:47.898097 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7ff1a2-d4d3-4e76-9373-14309dc18f2a None admin] SCRIPT_NAME: `/identity` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:11:47.898371 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7ff1a2-d4d3-4e76-9373-14309dc18f2a None admin] PATH_INFO: `/v3/projects/service` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:11:47.906158 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f7ff1a2-d4d3-4e76-9373-14309dc18f2a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:11:47.907665 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f7ff1a2-d4d3-4e76-9373-14309dc18f2a None admin] RBAC: Authorization granted {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:11:47.920319 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application [None req-9f7ff1a2-d4d3-4e76-9373-14309dc18f2a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 08:11:47.920319 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:11:47.920319 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:11:47.920319 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:11:47.920319 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:11:47.920319 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:11:47.920319 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:11:47.920319 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:11:47.920319 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:11:47.920319 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:11:47.920319 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:11:47.920319 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:11:47.920319 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 28 08:11:47.920319 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 28 08:11:47.920319 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 28 08:11:47.921429 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 28 08:11:47.921429 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:11:47.921429 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:11:47.921429 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:11:47.921429 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:11:47.921429 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:11:47.921429 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:11:47.921429 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:11:47.921429 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application with Lock( Jul 28 08:11:47.921429 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:11:47.921429 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:11:47.921429 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:11:47.921429 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:11:47.921429 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:11:47.921429 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:11:47.921429 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:11:47.921429 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:11:47.923127 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 28 08:11:47.923127 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 28 08:11:47.923127 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 28 08:11:47.923127 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 28 08:11:47.923127 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 28 08:11:47.923127 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 28 08:11:47.923127 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 08:11:47.923127 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application Jul 28 08:11:47.923127 dv-cinder-851351-1-smb devstack@keystone.service[144067]: [pid: 144067|app: 0|req: 261/528] 10.222.0.42 () {56 vars in 1111 bytes} [Thu Jul 28 08:11:47 2022] GET /identity/v3/projects/service => generated 88 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:11:47.923127 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f7ff1a2-d4d3-4e76-9373-14309dc18f2a None admin] Authenticating user token {{(pid=144067) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:11:47.946286 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-163b1be1-48bb-4dc1-917a-1eb2f27681d2 None admin] Validating token access rules against request {{(pid=144068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:11:48.000327 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd79625f-de6c-4287-acca-375e5a4bcfa9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:11:48.001508 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd79625f-de6c-4287-acca-375e5a4bcfa9 None admin] REQUEST_METHOD: `GET` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:11:48.002015 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd79625f-de6c-4287-acca-375e5a4bcfa9 None admin] SCRIPT_NAME: `/identity` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:11:48.002593 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd79625f-de6c-4287-acca-375e5a4bcfa9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:11:48.014771 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd79625f-de6c-4287-acca-375e5a4bcfa9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:11:48.016792 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd79625f-de6c-4287-acca-375e5a4bcfa9 None admin] RBAC: Authorization granted {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:11:48.033976 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application [None req-bd79625f-de6c-4287-acca-375e5a4bcfa9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 08:11:48.033976 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:11:48.033976 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:11:48.033976 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:11:48.033976 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:11:48.033976 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:11:48.033976 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:11:48.033976 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:11:48.033976 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:11:48.033976 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:11:48.033976 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:11:48.033976 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:11:48.033976 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 08:11:48.033976 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 08:11:48.033976 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 08:11:48.035033 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 08:11:48.035033 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:11:48.035033 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:11:48.035033 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:11:48.035033 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:11:48.035033 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:11:48.035033 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:11:48.035033 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:11:48.035033 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application with Lock( Jul 28 08:11:48.035033 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:11:48.035033 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:11:48.035033 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:11:48.035033 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:11:48.035033 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:11:48.035033 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:11:48.035033 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:11:48.035033 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:11:48.036128 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 08:11:48.036128 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 08:11:48.036128 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 08:11:48.036128 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application Jul 28 08:11:48.038191 dv-cinder-851351-1-smb devstack@keystone.service[144068]: [pid: 144068|app: 0|req: 268/529] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 08:11:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 243 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:11:48.038473 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f7ff1a2-d4d3-4e76-9373-14309dc18f2a None admin] Validating token access rules against request {{(pid=144067) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:11:48.039613 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd79625f-de6c-4287-acca-375e5a4bcfa9 None admin] Authenticating user token {{(pid=144068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:11:48.056398 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG dbcounter [-] [144068] Writing DB stats keystone:SELECT=100 {{(pid=144068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:11:48.075514 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-869fa511-3cda-4f89-88d9-dfa56a3c00c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144067) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:11:48.076294 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869fa511-3cda-4f89-88d9-dfa56a3c00c6 None admin] REQUEST_METHOD: `GET` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:11:48.076424 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869fa511-3cda-4f89-88d9-dfa56a3c00c6 None admin] SCRIPT_NAME: `/identity` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:11:48.076786 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869fa511-3cda-4f89-88d9-dfa56a3c00c6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:11:48.100756 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG dbcounter [-] [144067] Writing DB stats keystone:SELECT=100 {{(pid=144067) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:11:48.150589 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-869fa511-3cda-4f89-88d9-dfa56a3c00c6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:11:48.152153 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-869fa511-3cda-4f89-88d9-dfa56a3c00c6 None admin] RBAC: Authorization granted {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:11:48.158532 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd79625f-de6c-4287-acca-375e5a4bcfa9 None admin] Validating token access rules against request {{(pid=144068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:11:48.197601 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90370cee-4d78-49be-9220-3d8297006e8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:11:48.198740 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90370cee-4d78-49be-9220-3d8297006e8e None admin] REQUEST_METHOD: `GET` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:11:48.199232 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90370cee-4d78-49be-9220-3d8297006e8e None admin] SCRIPT_NAME: `/identity` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:11:48.199805 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90370cee-4d78-49be-9220-3d8297006e8e None admin] PATH_INFO: `/v3/projects` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:11:48.200945 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90370cee-4d78-49be-9220-3d8297006e8e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=144068) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:11:48.201477 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90370cee-4d78-49be-9220-3d8297006e8e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:11:48.203379 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90370cee-4d78-49be-9220-3d8297006e8e None admin] RBAC: Authorization granted {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:11:48.229271 dv-cinder-851351-1-smb devstack@keystone.service[144068]: [pid: 144068|app: 0|req: 269/530] 10.222.0.42 () {56 vars in 1148 bytes} [Thu Jul 28 08:11:48 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:11:48.230650 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90370cee-4d78-49be-9220-3d8297006e8e None admin] Authenticating user token {{(pid=144068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:11:48.261685 dv-cinder-851351-1-smb devstack@keystone.service[144067]: [pid: 144067|app: 0|req: 262/531] 10.222.0.42 () {58 vars in 1282 bytes} [Thu Jul 28 08:11:47 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 28 08:11:48.263035 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-869fa511-3cda-4f89-88d9-dfa56a3c00c6 None admin] Authenticating user token {{(pid=144067) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:11:48.328319 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG dbcounter [-] [144068] Writing DB stats keystone:SELECT=100 {{(pid=144068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:11:48.340815 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG dbcounter [-] [144067] Writing DB stats keystone:SELECT=100 {{(pid=144067) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:11:48.365996 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90370cee-4d78-49be-9220-3d8297006e8e None admin] Validating token access rules against request {{(pid=144068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:11:48.397707 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-869fa511-3cda-4f89-88d9-dfa56a3c00c6 None admin] Validating token access rules against request {{(pid=144067) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:11:48.412221 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37fdcab1-6698-467a-965c-490b295bba54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:11:48.413027 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37fdcab1-6698-467a-965c-490b295bba54 None admin] REQUEST_METHOD: `GET` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:11:48.413426 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37fdcab1-6698-467a-965c-490b295bba54 None admin] SCRIPT_NAME: `/identity` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:11:48.413796 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37fdcab1-6698-467a-965c-490b295bba54 None admin] PATH_INFO: `/v3/domains` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:11:48.414602 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37fdcab1-6698-467a-965c-490b295bba54 None admin] RBAC: Adding query filter params (name=Default) {{(pid=144068) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:11:48.415007 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37fdcab1-6698-467a-965c-490b295bba54 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:11:48.416885 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37fdcab1-6698-467a-965c-490b295bba54 None admin] RBAC: Authorization granted {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:11:48.429202 dv-cinder-851351-1-smb devstack@keystone.service[144068]: [pid: 144068|app: 0|req: 270/532] 10.222.0.42 () {56 vars in 1109 bytes} [Thu Jul 28 08:11:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:11:48.430319 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37fdcab1-6698-467a-965c-490b295bba54 None admin] Authenticating user token {{(pid=144068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:11:48.443100 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2cb122-ad37-4361-a0ae-123abd59f6de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144067) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:11:48.444519 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2cb122-ad37-4361-a0ae-123abd59f6de None admin] REQUEST_METHOD: `GET` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:11:48.445090 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2cb122-ad37-4361-a0ae-123abd59f6de None admin] SCRIPT_NAME: `/identity` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:11:48.445542 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2cb122-ad37-4361-a0ae-123abd59f6de None admin] PATH_INFO: `/v3/role_assignments` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:11:48.446771 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c2cb122-ad37-4361-a0ae-123abd59f6de None admin] RBAC: Adding query filter params (role.id=9aa6ce92dcbb4164ac0e44d2aa2a0248, scope.project.id=fa39ab7491e5413ca648e31ee9177fa0, user.id=05fa683ca43e40489a294d83584a0db9) {{(pid=144067) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:11:48.447262 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c2cb122-ad37-4361-a0ae-123abd59f6de None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:11:48.449696 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c2cb122-ad37-4361-a0ae-123abd59f6de None admin] RBAC: Authorization granted {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:11:48.458432 dv-cinder-851351-1-smb devstack@keystone.service[144067]: [pid: 144067|app: 0|req: 263/533] 10.222.0.42 () {56 vars in 1374 bytes} [Thu Jul 28 08:11:48 2022] GET /identity/v3/role_assignments?user.id=05fa683ca43e40489a294d83584a0db9&scope.project.id=fa39ab7491e5413ca648e31ee9177fa0&role.id=9aa6ce92dcbb4164ac0e44d2aa2a0248 => generated 259 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:11:48.459621 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2cb122-ad37-4361-a0ae-123abd59f6de None admin] Authenticating user token {{(pid=144067) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:11:48.588780 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2cb122-ad37-4361-a0ae-123abd59f6de None admin] Validating token access rules against request {{(pid=144067) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:11:48.611269 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG dbcounter [-] [144067] Writing DB stats keystone:SELECT=100 {{(pid=144067) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:11:48.639111 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ceecf41-b0de-4cd5-abbb-1533ff613ead None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144067) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:11:48.641131 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ceecf41-b0de-4cd5-abbb-1533ff613ead None admin] REQUEST_METHOD: `GET` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:11:48.641697 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ceecf41-b0de-4cd5-abbb-1533ff613ead None admin] SCRIPT_NAME: `/identity` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:11:48.642181 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ceecf41-b0de-4cd5-abbb-1533ff613ead None admin] PATH_INFO: `/v3/projects/service` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:11:48.643281 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37fdcab1-6698-467a-965c-490b295bba54 None admin] Validating token access rules against request {{(pid=144068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:11:48.654354 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ceecf41-b0de-4cd5-abbb-1533ff613ead None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:11:48.656912 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ceecf41-b0de-4cd5-abbb-1533ff613ead None admin] RBAC: Authorization granted {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:11:48.675064 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application [None req-1ceecf41-b0de-4cd5-abbb-1533ff613ead None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 08:11:48.675064 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:11:48.675064 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:11:48.675064 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:11:48.675064 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:11:48.675064 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:11:48.675064 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:11:48.675064 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:11:48.675064 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:11:48.675064 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:11:48.675064 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:11:48.675064 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:11:48.675064 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 28 08:11:48.675064 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 28 08:11:48.675064 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 28 08:11:48.676198 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 28 08:11:48.676198 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:11:48.676198 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:11:48.676198 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:11:48.676198 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:11:48.676198 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:11:48.676198 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:11:48.676198 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:11:48.676198 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application with Lock( Jul 28 08:11:48.676198 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:11:48.676198 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:11:48.676198 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:11:48.676198 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:11:48.676198 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:11:48.676198 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:11:48.676198 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:11:48.676198 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:11:48.677229 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 28 08:11:48.677229 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 28 08:11:48.677229 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 28 08:11:48.677229 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 28 08:11:48.677229 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 28 08:11:48.677229 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 28 08:11:48.677229 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 08:11:48.677229 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application Jul 28 08:11:48.679580 dv-cinder-851351-1-smb devstack@keystone.service[144067]: [pid: 144067|app: 0|req: 264/534] 10.222.0.42 () {56 vars in 1111 bytes} [Thu Jul 28 08:11:48 2022] GET /identity/v3/projects/service => generated 88 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:11:48.686103 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ceecf41-b0de-4cd5-abbb-1533ff613ead None admin] Authenticating user token {{(pid=144067) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:11:48.688359 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG dbcounter [-] [144068] Writing DB stats keystone:SELECT=100 {{(pid=144068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:11:48.704500 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2779006-c945-481b-976e-f5cb4eb25d3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:11:48.705500 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2779006-c945-481b-976e-f5cb4eb25d3d None admin] REQUEST_METHOD: `GET` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:11:48.705977 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2779006-c945-481b-976e-f5cb4eb25d3d None admin] SCRIPT_NAME: `/identity` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:11:48.706405 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2779006-c945-481b-976e-f5cb4eb25d3d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:11:48.726637 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2779006-c945-481b-976e-f5cb4eb25d3d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:11:48.729233 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2779006-c945-481b-976e-f5cb4eb25d3d None admin] RBAC: Authorization granted {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:11:48.758272 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application [None req-f2779006-c945-481b-976e-f5cb4eb25d3d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 08:11:48.758272 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:11:48.758272 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:11:48.758272 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:11:48.758272 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:11:48.758272 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:11:48.758272 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:11:48.758272 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:11:48.758272 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:11:48.758272 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:11:48.758272 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:11:48.758272 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:11:48.758272 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 08:11:48.758272 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 08:11:48.758272 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 08:11:48.759397 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 08:11:48.759397 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:11:48.759397 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:11:48.759397 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:11:48.759397 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:11:48.759397 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:11:48.759397 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:11:48.759397 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:11:48.759397 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application with Lock( Jul 28 08:11:48.759397 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:11:48.759397 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:11:48.759397 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:11:48.759397 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:11:48.759397 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:11:48.759397 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:11:48.759397 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:11:48.759397 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:11:48.760378 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 08:11:48.760378 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 08:11:48.760378 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 08:11:48.760378 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application Jul 28 08:11:48.760378 dv-cinder-851351-1-smb devstack@keystone.service[144068]: [pid: 144068|app: 0|req: 271/535] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 08:11:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 330 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:11:48.768798 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2779006-c945-481b-976e-f5cb4eb25d3d None admin] Authenticating user token {{(pid=144068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:11:48.877177 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ceecf41-b0de-4cd5-abbb-1533ff613ead None admin] Validating token access rules against request {{(pid=144067) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:11:48.905779 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2779006-c945-481b-976e-f5cb4eb25d3d None admin] Validating token access rules against request {{(pid=144068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:11:48.950019 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b3d0d81-3f38-44bb-b4d8-973c93889901 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:11:48.950675 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3d0d81-3f38-44bb-b4d8-973c93889901 None admin] REQUEST_METHOD: `GET` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:11:48.950965 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3d0d81-3f38-44bb-b4d8-973c93889901 None admin] SCRIPT_NAME: `/identity` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:11:48.951243 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3d0d81-3f38-44bb-b4d8-973c93889901 None admin] PATH_INFO: `/v3/domains` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:11:48.951960 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b3d0d81-3f38-44bb-b4d8-973c93889901 None admin] RBAC: Adding query filter params (name=Default) {{(pid=144068) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:11:48.952271 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b3d0d81-3f38-44bb-b4d8-973c93889901 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:11:48.953722 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b3d0d81-3f38-44bb-b4d8-973c93889901 None admin] RBAC: Authorization granted {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:11:48.960980 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c248064-f41e-4ecc-8955-30a15ca22532 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144067) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:11:48.961635 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c248064-f41e-4ecc-8955-30a15ca22532 None admin] REQUEST_METHOD: `GET` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:11:48.961910 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c248064-f41e-4ecc-8955-30a15ca22532 None admin] SCRIPT_NAME: `/identity` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:11:48.962188 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c248064-f41e-4ecc-8955-30a15ca22532 None admin] PATH_INFO: `/v3/projects` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:11:48.962974 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c248064-f41e-4ecc-8955-30a15ca22532 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=144067) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:11:48.963281 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c248064-f41e-4ecc-8955-30a15ca22532 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:11:48.964800 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c248064-f41e-4ecc-8955-30a15ca22532 None admin] RBAC: Authorization granted {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:11:48.982719 dv-cinder-851351-1-smb devstack@keystone.service[144068]: [pid: 144068|app: 0|req: 272/536] 10.222.0.42 () {56 vars in 1109 bytes} [Thu Jul 28 08:11:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:11:48.992695 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b3d0d81-3f38-44bb-b4d8-973c93889901 None admin] Authenticating user token {{(pid=144068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:11:48.996650 dv-cinder-851351-1-smb devstack@keystone.service[144067]: [pid: 144067|app: 0|req: 265/537] 10.222.0.42 () {56 vars in 1148 bytes} [Thu Jul 28 08:11:48 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 313 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:11:49.003786 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c248064-f41e-4ecc-8955-30a15ca22532 None admin] Authenticating user token {{(pid=144067) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:11:49.080112 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG dbcounter [-] [144067] Writing DB stats keystone:SELECT=100 {{(pid=144067) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:11:49.095567 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG dbcounter [-] [144068] Writing DB stats keystone:SELECT=100 {{(pid=144068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:11:49.186229 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b3d0d81-3f38-44bb-b4d8-973c93889901 None admin] Validating token access rules against request {{(pid=144068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:11:49.229581 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7882733c-9452-40e7-bde6-07f7ef8fd5dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:11:49.230253 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7882733c-9452-40e7-bde6-07f7ef8fd5dc None admin] REQUEST_METHOD: `GET` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:11:49.230868 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7882733c-9452-40e7-bde6-07f7ef8fd5dc None admin] SCRIPT_NAME: `/identity` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:11:49.231153 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7882733c-9452-40e7-bde6-07f7ef8fd5dc None admin] PATH_INFO: `/v3/projects/service` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:11:49.238983 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7882733c-9452-40e7-bde6-07f7ef8fd5dc None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:11:49.239165 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c248064-f41e-4ecc-8955-30a15ca22532 None admin] Validating token access rules against request {{(pid=144067) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:11:49.240454 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7882733c-9452-40e7-bde6-07f7ef8fd5dc None admin] RBAC: Authorization granted {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:11:49.255564 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application [None req-7882733c-9452-40e7-bde6-07f7ef8fd5dc None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 08:11:49.255564 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:11:49.255564 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:11:49.255564 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:11:49.255564 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:11:49.255564 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:11:49.255564 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:11:49.255564 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:11:49.255564 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:11:49.255564 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:11:49.255564 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:11:49.255564 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:11:49.255564 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 28 08:11:49.255564 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 28 08:11:49.255564 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 28 08:11:49.256654 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 28 08:11:49.256654 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:11:49.256654 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:11:49.256654 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:11:49.256654 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:11:49.256654 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:11:49.256654 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:11:49.256654 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:11:49.256654 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application with Lock( Jul 28 08:11:49.256654 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:11:49.256654 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:11:49.256654 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:11:49.256654 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:11:49.256654 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:11:49.256654 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:11:49.256654 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:11:49.256654 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:11:49.257666 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 28 08:11:49.257666 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 28 08:11:49.257666 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 28 08:11:49.257666 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 28 08:11:49.257666 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 28 08:11:49.257666 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 28 08:11:49.257666 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 08:11:49.257666 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application Jul 28 08:11:49.257666 dv-cinder-851351-1-smb devstack@keystone.service[144068]: [pid: 144068|app: 0|req: 273/538] 10.222.0.42 () {56 vars in 1111 bytes} [Thu Jul 28 08:11:48 2022] GET /identity/v3/projects/service => generated 88 bytes in 268 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:11:49.263532 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7882733c-9452-40e7-bde6-07f7ef8fd5dc None admin] Authenticating user token {{(pid=144068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:11:49.302927 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12572fad-a923-42a8-ac4f-a7b60a928764 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144067) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:11:49.303564 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12572fad-a923-42a8-ac4f-a7b60a928764 None admin] REQUEST_METHOD: `GET` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:11:49.303913 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12572fad-a923-42a8-ac4f-a7b60a928764 None admin] SCRIPT_NAME: `/identity` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:11:49.304195 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12572fad-a923-42a8-ac4f-a7b60a928764 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:11:49.305238 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12572fad-a923-42a8-ac4f-a7b60a928764 None admin] RBAC: Adding query filter params (role.id=9aa6ce92dcbb4164ac0e44d2aa2a0248, scope.project.id=fa39ab7491e5413ca648e31ee9177fa0, user.id=ccb4223a248b45fba8dff662f7260b21) {{(pid=144067) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:11:49.305561 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12572fad-a923-42a8-ac4f-a7b60a928764 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:11:49.307341 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12572fad-a923-42a8-ac4f-a7b60a928764 None admin] RBAC: Authorization granted {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:11:49.321014 dv-cinder-851351-1-smb devstack@keystone.service[144067]: [pid: 144067|app: 0|req: 266/539] 10.222.0.42 () {56 vars in 1374 bytes} [Thu Jul 28 08:11:49 2022] GET /identity/v3/role_assignments?user.id=ccb4223a248b45fba8dff662f7260b21&scope.project.id=fa39ab7491e5413ca648e31ee9177fa0&role.id=9aa6ce92dcbb4164ac0e44d2aa2a0248 => generated 259 bytes in 312 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:11:49.323030 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a46a53-f50c-4237-b0a3-461d6b30d516 None None] REQUEST_METHOD: `GET` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:11:49.324816 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a46a53-f50c-4237-b0a3-461d6b30d516 None None] SCRIPT_NAME: `/identity` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:11:49.326229 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a46a53-f50c-4237-b0a3-461d6b30d516 None None] PATH_INFO: `/` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:11:49.328120 dv-cinder-851351-1-smb devstack@keystone.service[144067]: [pid: 144067|app: 0|req: 267/540] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 08:11:49 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 08:11:49.336741 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebfe36a0-b9fa-49e1-9cd7-0a9ae9594de1 None None] REQUEST_METHOD: `POST` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:11:49.336741 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebfe36a0-b9fa-49e1-9cd7-0a9ae9594de1 None None] SCRIPT_NAME: `/identity` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:11:49.336741 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebfe36a0-b9fa-49e1-9cd7-0a9ae9594de1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:11:49.358954 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.auth.core [None req-ebfe36a0-b9fa-49e1-9cd7-0a9ae9594de1 None None] MFA Rules not processed for user `bf5ceb8f07374635ad506b7d1b4f1612`. Rule list: `[]` (Enabled: `True`). {{(pid=144067) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 08:11:49.362374 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.fernet_utils [None req-ebfe36a0-b9fa-49e1-9cd7-0a9ae9594de1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=144067) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:11:49.470106 dv-cinder-851351-1-smb devstack@keystone.service[144067]: [pid: 144067|app: 0|req: 268/541] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 08:11:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 28 08:11:49.493765 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebfe36a0-b9fa-49e1-9cd7-0a9ae9594de1 None None] Authenticating user token {{(pid=144067) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:11:49.497166 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7882733c-9452-40e7-bde6-07f7ef8fd5dc None admin] Validating token access rules against request {{(pid=144068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:11:49.506882 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG dbcounter [-] [144068] Writing DB stats keystone:SELECT=100 {{(pid=144068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:11:49.532760 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG dbcounter [-] [144067] Writing DB stats keystone:SELECT=100 {{(pid=144067) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:11:49.566685 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737973b5-88de-4e0f-a7b4-a69020e344a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:11:49.567749 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737973b5-88de-4e0f-a7b4-a69020e344a6 None admin] REQUEST_METHOD: `GET` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:11:49.568270 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737973b5-88de-4e0f-a7b4-a69020e344a6 None admin] SCRIPT_NAME: `/identity` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:11:49.568860 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737973b5-88de-4e0f-a7b4-a69020e344a6 None admin] PATH_INFO: `/v3/projects` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:11:49.569850 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-737973b5-88de-4e0f-a7b4-a69020e344a6 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=144068) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:11:49.570380 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-737973b5-88de-4e0f-a7b4-a69020e344a6 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:11:49.572302 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-737973b5-88de-4e0f-a7b4-a69020e344a6 None admin] RBAC: Authorization granted {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:11:49.586853 dv-cinder-851351-1-smb devstack@keystone.service[144068]: [pid: 144068|app: 0|req: 274/542] 10.222.0.42 () {56 vars in 1148 bytes} [Thu Jul 28 08:11:49 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 324 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:11:49.593251 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babdad47-472f-4ba4-b43c-f4642dd8dfa5 None None] REQUEST_METHOD: `GET` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:11:49.593553 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babdad47-472f-4ba4-b43c-f4642dd8dfa5 None None] SCRIPT_NAME: `/identity` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:11:49.593835 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babdad47-472f-4ba4-b43c-f4642dd8dfa5 None None] PATH_INFO: `/` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:11:49.595492 dv-cinder-851351-1-smb devstack@keystone.service[144068]: [pid: 144068|app: 0|req: 275/543] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 08:11:49 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 08:11:49.596336 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-babdad47-472f-4ba4-b43c-f4642dd8dfa5 None None] Authenticating user token {{(pid=144068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:11:49.620115 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebfe36a0-b9fa-49e1-9cd7-0a9ae9594de1 None None] Validating token access rules against request {{(pid=144067) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:11:49.658537 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6914f461-a175-438f-b0a9-297fb5297d35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144067) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:11:49.659213 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6914f461-a175-438f-b0a9-297fb5297d35 None admin] REQUEST_METHOD: `GET` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:11:49.659498 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6914f461-a175-438f-b0a9-297fb5297d35 None admin] SCRIPT_NAME: `/identity` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:11:49.659779 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6914f461-a175-438f-b0a9-297fb5297d35 None admin] PATH_INFO: `/v3/roles/service` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:11:49.671658 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6914f461-a175-438f-b0a9-297fb5297d35 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 08:11:49.677005 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application [None req-6914f461-a175-438f-b0a9-297fb5297d35 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 28 08:11:49.677005 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:11:49.677005 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:11:49.677005 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:11:49.677005 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:11:49.677005 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:11:49.677005 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:11:49.677005 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:11:49.677005 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:11:49.677005 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:11:49.677005 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:11:49.677005 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:11:49.677005 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 08:11:49.677005 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 08:11:49.677005 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 08:11:49.677005 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 08:11:49.678020 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 08:11:49.678020 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 08:11:49.678020 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 08:11:49.678020 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 08:11:49.678020 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:11:49.678020 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:11:49.678020 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:11:49.678020 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:11:49.678020 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:11:49.678020 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:11:49.678020 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:11:49.678020 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application with Lock( Jul 28 08:11:49.678020 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:11:49.678020 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:11:49.678020 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:11:49.678020 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:11:49.678938 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:11:49.678938 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:11:49.678938 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:11:49.678938 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:11:49.678938 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 08:11:49.678938 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 08:11:49.678938 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 08:11:49.678938 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 08:11:49.678938 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 08:11:49.678938 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 08:11:49.678938 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 28 08:11:49.678938 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application Jul 28 08:11:49.683158 dv-cinder-851351-1-smb devstack@keystone.service[144067]: [pid: 144067|app: 0|req: 269/544] 10.222.0.42 () {56 vars in 1102 bytes} [Thu Jul 28 08:11:49 2022] GET /identity/v3/roles/service => generated 85 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 08:11:49.684590 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34cf658-5b16-4155-8ec7-eb401a36877e None None] REQUEST_METHOD: `POST` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:11:49.684923 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34cf658-5b16-4155-8ec7-eb401a36877e None None] SCRIPT_NAME: `/identity` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:11:49.685286 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34cf658-5b16-4155-8ec7-eb401a36877e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:11:49.705044 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.auth.core [None req-b34cf658-5b16-4155-8ec7-eb401a36877e None None] MFA Rules not processed for user `bf5ceb8f07374635ad506b7d1b4f1612`. Rule list: `[]` (Enabled: `True`). {{(pid=144067) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 08:11:49.706142 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.fernet_utils [None req-b34cf658-5b16-4155-8ec7-eb401a36877e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=144067) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:11:49.729898 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-babdad47-472f-4ba4-b43c-f4642dd8dfa5 None None] Validating token access rules against request {{(pid=144068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:11:49.768410 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffef73ce-743c-4a55-b5c5-35d26b9043fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:11:49.769624 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffef73ce-743c-4a55-b5c5-35d26b9043fe None admin] REQUEST_METHOD: `GET` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:11:49.770268 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffef73ce-743c-4a55-b5c5-35d26b9043fe None admin] SCRIPT_NAME: `/identity` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:11:49.770757 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffef73ce-743c-4a55-b5c5-35d26b9043fe None admin] PATH_INFO: `/v3/role_assignments` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:11:49.771835 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffef73ce-743c-4a55-b5c5-35d26b9043fe None admin] RBAC: Adding query filter params (role.id=9aa6ce92dcbb4164ac0e44d2aa2a0248, scope.project.id=fa39ab7491e5413ca648e31ee9177fa0, user.id=a576c39228684b6281a4087acad6a52a) {{(pid=144068) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:11:49.772391 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffef73ce-743c-4a55-b5c5-35d26b9043fe None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:11:49.774281 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffef73ce-743c-4a55-b5c5-35d26b9043fe None admin] RBAC: Authorization granted {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:11:49.780911 dv-cinder-851351-1-smb devstack@keystone.service[144068]: [pid: 144068|app: 0|req: 276/545] 10.222.0.42 () {56 vars in 1374 bytes} [Thu Jul 28 08:11:49 2022] GET /identity/v3/role_assignments?user.id=a576c39228684b6281a4087acad6a52a&scope.project.id=fa39ab7491e5413ca648e31ee9177fa0&role.id=9aa6ce92dcbb4164ac0e44d2aa2a0248 => generated 259 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:11:49.782003 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffef73ce-743c-4a55-b5c5-35d26b9043fe None admin] Authenticating user token {{(pid=144068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:11:49.799537 dv-cinder-851351-1-smb devstack@keystone.service[144067]: [pid: 144067|app: 0|req: 270/546] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 08:11:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 08:11:49.815323 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG dbcounter [-] [144068] Writing DB stats keystone:SELECT=100 {{(pid=144068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:11:49.841366 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34cf658-5b16-4155-8ec7-eb401a36877e None None] Authenticating user token {{(pid=144067) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:11:49.902038 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffef73ce-743c-4a55-b5c5-35d26b9043fe None admin] Validating token access rules against request {{(pid=144068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:11:49.916506 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG dbcounter [-] [144067] Writing DB stats keystone:SELECT=100 {{(pid=144067) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:11:49.970403 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43037648-7878-45f6-b521-f75cfaf4feac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:11:49.971497 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43037648-7878-45f6-b521-f75cfaf4feac None admin] REQUEST_METHOD: `GET` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:11:49.972976 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43037648-7878-45f6-b521-f75cfaf4feac None admin] SCRIPT_NAME: `/identity` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:11:49.973470 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43037648-7878-45f6-b521-f75cfaf4feac None admin] PATH_INFO: `/v3/roles` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:11:49.974686 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43037648-7878-45f6-b521-f75cfaf4feac None admin] RBAC: Adding query filter params (name=service) {{(pid=144068) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:11:49.976111 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43037648-7878-45f6-b521-f75cfaf4feac None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:11:49.977975 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43037648-7878-45f6-b521-f75cfaf4feac None admin] RBAC: Authorization granted {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:11:49.997493 dv-cinder-851351-1-smb devstack@keystone.service[144068]: [pid: 144068|app: 0|req: 277/547] 10.222.0.42 () {56 vars in 1103 bytes} [Thu Jul 28 08:11:49 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:11:50.004888 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43037648-7878-45f6-b521-f75cfaf4feac None admin] Authenticating user token {{(pid=144068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:11:50.092631 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34cf658-5b16-4155-8ec7-eb401a36877e None None] Validating token access rules against request {{(pid=144067) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:11:50.147557 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG dbcounter [-] [144068] Writing DB stats keystone:SELECT=100 {{(pid=144068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:11:50.164584 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43037648-7878-45f6-b521-f75cfaf4feac None admin] Validating token access rules against request {{(pid=144068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:11:50.169005 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14414c15-5947-4380-ab03-d5a4076a4f54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144067) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:11:50.169696 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14414c15-5947-4380-ab03-d5a4076a4f54 None admin] REQUEST_METHOD: `GET` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:11:50.169978 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14414c15-5947-4380-ab03-d5a4076a4f54 None admin] SCRIPT_NAME: `/identity` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:11:50.170255 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14414c15-5947-4380-ab03-d5a4076a4f54 None admin] PATH_INFO: `/v3/roles/service` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:11:50.205897 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14414c15-5947-4380-ab03-d5a4076a4f54 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 08:11:50.208707 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba2c46d-9fb4-437a-bcbb-46eef8656335 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:11:50.209388 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba2c46d-9fb4-437a-bcbb-46eef8656335 None admin] REQUEST_METHOD: `GET` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:11:50.209670 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba2c46d-9fb4-437a-bcbb-46eef8656335 None admin] SCRIPT_NAME: `/identity` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:11:50.209937 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba2c46d-9fb4-437a-bcbb-46eef8656335 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:11:50.212734 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application [None req-14414c15-5947-4380-ab03-d5a4076a4f54 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 28 08:11:50.212734 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:11:50.212734 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:11:50.212734 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:11:50.212734 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:11:50.212734 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:11:50.212734 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:11:50.212734 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:11:50.212734 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:11:50.212734 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:11:50.212734 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:11:50.212734 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:11:50.212734 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 08:11:50.212734 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 08:11:50.212734 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 08:11:50.212734 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 08:11:50.213769 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 08:11:50.213769 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 08:11:50.213769 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 08:11:50.213769 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 08:11:50.213769 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:11:50.213769 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:11:50.213769 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:11:50.213769 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:11:50.213769 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:11:50.213769 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:11:50.213769 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:11:50.213769 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application with Lock( Jul 28 08:11:50.213769 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:11:50.213769 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:11:50.213769 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:11:50.213769 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:11:50.214689 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:11:50.214689 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:11:50.214689 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:11:50.214689 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:11:50.214689 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 08:11:50.214689 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 08:11:50.214689 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 08:11:50.214689 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 08:11:50.214689 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 08:11:50.214689 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 08:11:50.214689 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 28 08:11:50.214689 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application Jul 28 08:11:50.214689 dv-cinder-851351-1-smb devstack@keystone.service[144067]: [pid: 144067|app: 0|req: 271/548] 10.222.0.42 () {56 vars in 1102 bytes} [Thu Jul 28 08:11:49 2022] GET /identity/v3/roles/service => generated 85 bytes in 374 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 08:11:50.224500 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14414c15-5947-4380-ab03-d5a4076a4f54 None admin] Authenticating user token {{(pid=144067) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:11:50.236153 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba2c46d-9fb4-437a-bcbb-46eef8656335 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:11:50.237737 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba2c46d-9fb4-437a-bcbb-46eef8656335 None admin] RBAC: Authorization granted {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:11:50.257116 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application [None req-4ba2c46d-9fb4-437a-bcbb-46eef8656335 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 08:11:50.257116 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:11:50.257116 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:11:50.257116 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:11:50.257116 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:11:50.257116 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:11:50.257116 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:11:50.257116 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:11:50.257116 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:11:50.257116 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:11:50.257116 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:11:50.257116 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:11:50.257116 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 08:11:50.257116 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 08:11:50.257116 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 08:11:50.258125 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 08:11:50.258125 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:11:50.258125 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:11:50.258125 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:11:50.258125 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:11:50.258125 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:11:50.258125 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:11:50.258125 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:11:50.258125 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application with Lock( Jul 28 08:11:50.258125 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:11:50.258125 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:11:50.258125 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:11:50.258125 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:11:50.258125 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:11:50.258125 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:11:50.258125 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:11:50.258125 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:11:50.259314 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 08:11:50.259314 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 08:11:50.259314 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 08:11:50.259314 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application Jul 28 08:11:50.259314 dv-cinder-851351-1-smb devstack@keystone.service[144068]: [pid: 144068|app: 0|req: 278/549] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 08:11:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 254 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 08:11:50.264141 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba2c46d-9fb4-437a-bcbb-46eef8656335 None admin] Authenticating user token {{(pid=144068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:11:50.354818 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG dbcounter [-] [144067] Writing DB stats keystone:SELECT=100 {{(pid=144067) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:11:50.410800 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba2c46d-9fb4-437a-bcbb-46eef8656335 None admin] Validating token access rules against request {{(pid=144068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:11:50.428460 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14414c15-5947-4380-ab03-d5a4076a4f54 None admin] Validating token access rules against request {{(pid=144067) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:11:50.459946 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df899fe4-5e0e-4d6a-9425-025486bf90a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:11:50.461427 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df899fe4-5e0e-4d6a-9425-025486bf90a0 None admin] REQUEST_METHOD: `GET` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:11:50.461919 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df899fe4-5e0e-4d6a-9425-025486bf90a0 None admin] SCRIPT_NAME: `/identity` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:11:50.462410 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df899fe4-5e0e-4d6a-9425-025486bf90a0 None admin] PATH_INFO: `/v3/domains` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:11:50.463329 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df899fe4-5e0e-4d6a-9425-025486bf90a0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=144068) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:11:50.463877 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df899fe4-5e0e-4d6a-9425-025486bf90a0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:11:50.465517 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df899fe4-5e0e-4d6a-9425-025486bf90a0 None admin] RBAC: Authorization granted {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:11:50.491992 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8374b7f-7d78-478f-b6ca-49091b13afde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144067) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:11:50.492620 dv-cinder-851351-1-smb devstack@keystone.service[144068]: [pid: 144068|app: 0|req: 279/550] 10.222.0.42 () {56 vars in 1109 bytes} [Thu Jul 28 08:11:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:11:50.493350 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8374b7f-7d78-478f-b6ca-49091b13afde None admin] REQUEST_METHOD: `GET` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:11:50.493843 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8374b7f-7d78-478f-b6ca-49091b13afde None admin] SCRIPT_NAME: `/identity` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:11:50.494355 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8374b7f-7d78-478f-b6ca-49091b13afde None admin] PATH_INFO: `/v3/roles` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:11:50.495329 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8374b7f-7d78-478f-b6ca-49091b13afde None admin] RBAC: Adding query filter params (name=service) {{(pid=144067) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:11:50.495887 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8374b7f-7d78-478f-b6ca-49091b13afde None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:11:50.497568 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8374b7f-7d78-478f-b6ca-49091b13afde None admin] RBAC: Authorization granted {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:11:50.497990 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df899fe4-5e0e-4d6a-9425-025486bf90a0 None admin] Authenticating user token {{(pid=144068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:11:50.509005 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG dbcounter [-] [144068] Writing DB stats keystone:SELECT=100 {{(pid=144068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:11:50.510367 dv-cinder-851351-1-smb devstack@keystone.service[144067]: [pid: 144067|app: 0|req: 272/551] 10.222.0.42 () {56 vars in 1103 bytes} [Thu Jul 28 08:11:50 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 286 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:11:50.517080 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8374b7f-7d78-478f-b6ca-49091b13afde None admin] Authenticating user token {{(pid=144067) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:11:50.714474 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df899fe4-5e0e-4d6a-9425-025486bf90a0 None admin] Validating token access rules against request {{(pid=144068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:11:50.743447 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8374b7f-7d78-478f-b6ca-49091b13afde None admin] Validating token access rules against request {{(pid=144067) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:11:50.792534 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8124957e-f717-40d0-9a44-da416d6119dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:11:50.793149 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8124957e-f717-40d0-9a44-da416d6119dd None admin] REQUEST_METHOD: `GET` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:11:50.794592 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8124957e-f717-40d0-9a44-da416d6119dd None admin] SCRIPT_NAME: `/identity` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:11:50.794887 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8124957e-f717-40d0-9a44-da416d6119dd None admin] PATH_INFO: `/v3/users/nova` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:11:50.812142 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8124957e-f717-40d0-9a44-da416d6119dd None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:11:50.813700 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8124957e-f717-40d0-9a44-da416d6119dd None admin] RBAC: Authorization granted {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:11:50.820712 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954cfef4-36f1-4fc3-913a-b879039819a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144067) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:11:50.821394 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954cfef4-36f1-4fc3-913a-b879039819a8 None admin] REQUEST_METHOD: `GET` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:11:50.821683 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954cfef4-36f1-4fc3-913a-b879039819a8 None admin] SCRIPT_NAME: `/identity` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:11:50.821964 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954cfef4-36f1-4fc3-913a-b879039819a8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:11:50.843224 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application [None req-8124957e-f717-40d0-9a44-da416d6119dd None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 28 08:11:50.843224 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:11:50.843224 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:11:50.843224 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:11:50.843224 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:11:50.843224 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:11:50.843224 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:11:50.843224 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:11:50.843224 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:11:50.843224 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:11:50.843224 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:11:50.843224 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:11:50.843224 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 28 08:11:50.843224 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 28 08:11:50.843224 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 28 08:11:50.843224 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 28 08:11:50.844367 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:11:50.844367 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:11:50.844367 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 28 08:11:50.844367 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 08:11:50.844367 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 28 08:11:50.844367 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 08:11:50.844367 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:11:50.844367 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:11:50.844367 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:11:50.844367 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:11:50.844367 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:11:50.844367 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application with Lock( Jul 28 08:11:50.844367 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:11:50.844367 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:11:50.844367 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:11:50.844367 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:11:50.844367 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:11:50.844367 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:11:50.845444 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:11:50.845444 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:11:50.845444 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 28 08:11:50.845444 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 28 08:11:50.845444 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 28 08:11:50.845444 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 28 08:11:50.845444 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 28 08:11:50.845444 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 28 08:11:50.845444 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 28 08:11:50.845444 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application Jul 28 08:11:50.848841 dv-cinder-851351-1-smb devstack@keystone.service[144068]: [pid: 144068|app: 0|req: 280/552] 10.222.0.42 () {56 vars in 1093 bytes} [Thu Jul 28 08:11:50 2022] GET /identity/v3/users/nova => generated 82 bytes in 351 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 08:11:50.849918 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-954cfef4-36f1-4fc3-913a-b879039819a8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:11:50.851485 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-954cfef4-36f1-4fc3-913a-b879039819a8 None admin] RBAC: Authorization granted {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:11:50.853042 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8124957e-f717-40d0-9a44-da416d6119dd None admin] Authenticating user token {{(pid=144068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:11:50.860103 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG dbcounter [-] [144067] Writing DB stats keystone:SELECT=100 {{(pid=144067) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:11:50.884113 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application [None req-954cfef4-36f1-4fc3-913a-b879039819a8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 08:11:50.884113 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:11:50.884113 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:11:50.884113 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:11:50.884113 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:11:50.884113 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:11:50.884113 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:11:50.884113 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:11:50.884113 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:11:50.884113 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:11:50.884113 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:11:50.884113 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:11:50.884113 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 08:11:50.884113 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 08:11:50.884113 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 08:11:50.886358 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 08:11:50.886358 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:11:50.886358 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:11:50.886358 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:11:50.886358 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:11:50.886358 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:11:50.886358 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:11:50.886358 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:11:50.886358 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application with Lock( Jul 28 08:11:50.886358 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:11:50.886358 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:11:50.886358 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:11:50.886358 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:11:50.886358 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:11:50.886358 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:11:50.886358 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:11:50.886358 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:11:50.888709 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 08:11:50.888709 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 08:11:50.888709 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 08:11:50.888709 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application Jul 28 08:11:50.894036 dv-cinder-851351-1-smb devstack@keystone.service[144067]: [pid: 144067|app: 0|req: 273/553] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 08:11:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 377 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:11:50.895054 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954cfef4-36f1-4fc3-913a-b879039819a8 None admin] Authenticating user token {{(pid=144067) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:11:51.004709 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG dbcounter [-] [144068] Writing DB stats keystone:SELECT=100 {{(pid=144068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:11:51.051449 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954cfef4-36f1-4fc3-913a-b879039819a8 None admin] Validating token access rules against request {{(pid=144067) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:11:51.056066 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8124957e-f717-40d0-9a44-da416d6119dd None admin] Validating token access rules against request {{(pid=144068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:11:51.096504 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d10c1b9-c463-4000-bc3f-f4c845a6be47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144067) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:11:51.097506 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d10c1b9-c463-4000-bc3f-f4c845a6be47 None admin] REQUEST_METHOD: `GET` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:11:51.098057 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d10c1b9-c463-4000-bc3f-f4c845a6be47 None admin] SCRIPT_NAME: `/identity` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:11:51.098493 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d10c1b9-c463-4000-bc3f-f4c845a6be47 None admin] PATH_INFO: `/v3/domains` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:11:51.099197 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6433ae38-edc5-4884-b5d3-e17866214ee6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:11:51.099527 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d10c1b9-c463-4000-bc3f-f4c845a6be47 None admin] RBAC: Adding query filter params (name=Default) {{(pid=144067) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:11:51.099999 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d10c1b9-c463-4000-bc3f-f4c845a6be47 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:11:51.100157 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6433ae38-edc5-4884-b5d3-e17866214ee6 None admin] REQUEST_METHOD: `GET` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:11:51.100447 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6433ae38-edc5-4884-b5d3-e17866214ee6 None admin] SCRIPT_NAME: `/identity` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:11:51.100754 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6433ae38-edc5-4884-b5d3-e17866214ee6 None admin] PATH_INFO: `/v3/users` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:11:51.101569 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6433ae38-edc5-4884-b5d3-e17866214ee6 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=144068) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:11:51.101882 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6433ae38-edc5-4884-b5d3-e17866214ee6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:11:51.102389 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d10c1b9-c463-4000-bc3f-f4c845a6be47 None admin] RBAC: Authorization granted {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:11:51.103335 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6433ae38-edc5-4884-b5d3-e17866214ee6 None admin] RBAC: Authorization granted {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:11:51.123842 dv-cinder-851351-1-smb devstack@keystone.service[144067]: [pid: 144067|app: 0|req: 274/554] 10.222.0.42 () {56 vars in 1109 bytes} [Thu Jul 28 08:11:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:11:51.123842 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85d0377-864b-48d1-88b3-53f3453591d3 None None] REQUEST_METHOD: `GET` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:11:51.123842 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85d0377-864b-48d1-88b3-53f3453591d3 None None] SCRIPT_NAME: `/identity` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:11:51.123842 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85d0377-864b-48d1-88b3-53f3453591d3 None None] PATH_INFO: `/` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:11:51.129886 dv-cinder-851351-1-smb devstack@keystone.service[144067]: [pid: 144067|app: 0|req: 275/555] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 08:11:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 08:11:51.129886 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b85d0377-864b-48d1-88b3-53f3453591d3 None None] Authenticating user token {{(pid=144067) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:11:51.139796 dv-cinder-851351-1-smb devstack@keystone.service[144068]: [pid: 144068|app: 0|req: 281/556] 10.222.0.42 () {56 vars in 1133 bytes} [Thu Jul 28 08:11:50 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 282 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:11:51.140832 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6433ae38-edc5-4884-b5d3-e17866214ee6 None admin] Authenticating user token {{(pid=144068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:11:51.199631 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG dbcounter [-] [144067] Writing DB stats keystone:SELECT=100 {{(pid=144067) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:11:51.254597 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b85d0377-864b-48d1-88b3-53f3453591d3 None None] Validating token access rules against request {{(pid=144067) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:11:51.266571 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6433ae38-edc5-4884-b5d3-e17866214ee6 None admin] Validating token access rules against request {{(pid=144068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:11:51.295314 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6777376a-b5dc-4fd1-b219-96e6516cd1bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144067) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:11:51.297036 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6777376a-b5dc-4fd1-b219-96e6516cd1bd None admin] REQUEST_METHOD: `GET` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:11:51.297591 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6777376a-b5dc-4fd1-b219-96e6516cd1bd None admin] SCRIPT_NAME: `/identity` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:11:51.298081 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6777376a-b5dc-4fd1-b219-96e6516cd1bd None admin] PATH_INFO: `/v3/users/swift` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:11:51.303582 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG dbcounter [-] [144068] Writing DB stats keystone:SELECT=100 {{(pid=144068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:11:51.312300 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6777376a-b5dc-4fd1-b219-96e6516cd1bd None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:11:51.315077 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6777376a-b5dc-4fd1-b219-96e6516cd1bd None admin] RBAC: Authorization granted {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:11:51.327676 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a855ebaf-2614-4bb8-86e2-4b5b4370e47d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:11:51.328794 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a855ebaf-2614-4bb8-86e2-4b5b4370e47d None admin] REQUEST_METHOD: `GET` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:11:51.329211 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a855ebaf-2614-4bb8-86e2-4b5b4370e47d None admin] SCRIPT_NAME: `/identity` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:11:51.329651 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a855ebaf-2614-4bb8-86e2-4b5b4370e47d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:11:51.334277 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application [None req-6777376a-b5dc-4fd1-b219-96e6516cd1bd None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 28 08:11:51.334277 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:11:51.334277 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:11:51.334277 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:11:51.334277 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:11:51.334277 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:11:51.334277 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:11:51.334277 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:11:51.334277 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:11:51.334277 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:11:51.334277 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:11:51.334277 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:11:51.334277 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 28 08:11:51.334277 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 28 08:11:51.334277 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 28 08:11:51.334277 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 28 08:11:51.335982 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:11:51.335982 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:11:51.335982 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 28 08:11:51.335982 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 08:11:51.335982 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 28 08:11:51.335982 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 08:11:51.335982 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:11:51.335982 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:11:51.335982 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:11:51.335982 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:11:51.335982 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:11:51.335982 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application with Lock( Jul 28 08:11:51.335982 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:11:51.335982 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:11:51.335982 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:11:51.335982 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:11:51.335982 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:11:51.335982 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:11:51.337120 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:11:51.337120 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:11:51.337120 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 28 08:11:51.337120 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 28 08:11:51.337120 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 28 08:11:51.337120 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 28 08:11:51.337120 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 28 08:11:51.337120 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 28 08:11:51.337120 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 28 08:11:51.337120 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application Jul 28 08:11:51.344300 dv-cinder-851351-1-smb devstack@keystone.service[144067]: [pid: 144067|app: 0|req: 276/557] 10.222.0.42 () {56 vars in 1096 bytes} [Thu Jul 28 08:11:51 2022] GET /identity/v3/users/swift => generated 83 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:11:51.346093 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a291a2ef-866d-4580-b130-d964669f5d21 None None] REQUEST_METHOD: `POST` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:11:51.346588 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a291a2ef-866d-4580-b130-d964669f5d21 None None] SCRIPT_NAME: `/identity` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:11:51.347087 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a291a2ef-866d-4580-b130-d964669f5d21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:11:51.348679 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a855ebaf-2614-4bb8-86e2-4b5b4370e47d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:11:51.351929 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a855ebaf-2614-4bb8-86e2-4b5b4370e47d None admin] RBAC: Authorization granted {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:11:51.367385 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.auth.core [None req-a291a2ef-866d-4580-b130-d964669f5d21 None None] MFA Rules not processed for user `bf5ceb8f07374635ad506b7d1b4f1612`. Rule list: `[]` (Enabled: `True`). {{(pid=144067) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 08:11:51.369739 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.fernet_utils [None req-a291a2ef-866d-4580-b130-d964669f5d21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=144067) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:11:51.379275 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application [None req-a855ebaf-2614-4bb8-86e2-4b5b4370e47d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 08:11:51.379275 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:11:51.379275 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:11:51.379275 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:11:51.379275 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:11:51.379275 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:11:51.379275 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:11:51.379275 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:11:51.379275 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:11:51.379275 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:11:51.379275 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:11:51.379275 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:11:51.379275 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 08:11:51.379275 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 08:11:51.379275 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 08:11:51.380393 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 08:11:51.380393 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:11:51.380393 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:11:51.380393 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:11:51.380393 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:11:51.380393 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:11:51.380393 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:11:51.380393 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:11:51.380393 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application with Lock( Jul 28 08:11:51.380393 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:11:51.380393 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:11:51.380393 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:11:51.380393 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:11:51.380393 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:11:51.380393 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:11:51.380393 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:11:51.380393 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:11:51.381534 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 08:11:51.381534 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 08:11:51.381534 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 08:11:51.381534 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application Jul 28 08:11:51.388154 dv-cinder-851351-1-smb devstack@keystone.service[144068]: [pid: 144068|app: 0|req: 282/558] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 08:11:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:11:51.389976 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a855ebaf-2614-4bb8-86e2-4b5b4370e47d None admin] Authenticating user token {{(pid=144068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:11:51.455390 dv-cinder-851351-1-smb devstack@keystone.service[144067]: [pid: 144067|app: 0|req: 277/559] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 08:11:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 08:11:51.461983 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a291a2ef-866d-4580-b130-d964669f5d21 None None] Authenticating user token {{(pid=144067) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:11:51.533979 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG dbcounter [-] [144067] Writing DB stats keystone:SELECT=100 {{(pid=144067) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:11:51.573965 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a855ebaf-2614-4bb8-86e2-4b5b4370e47d None admin] Validating token access rules against request {{(pid=144068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:11:51.597620 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a291a2ef-866d-4580-b130-d964669f5d21 None None] Validating token access rules against request {{(pid=144067) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:11:51.633784 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c689e6e-575c-41f6-b279-336c2d43e420 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:11:51.634838 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c689e6e-575c-41f6-b279-336c2d43e420 None admin] REQUEST_METHOD: `GET` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:11:51.635462 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c689e6e-575c-41f6-b279-336c2d43e420 None admin] SCRIPT_NAME: `/identity` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:11:51.635881 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c689e6e-575c-41f6-b279-336c2d43e420 None admin] PATH_INFO: `/v3/users` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:11:51.636924 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a44233ea-0106-40a9-9f43-8d529ca2f7a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144067) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:11:51.637356 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c689e6e-575c-41f6-b279-336c2d43e420 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=144068) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:11:51.637815 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c689e6e-575c-41f6-b279-336c2d43e420 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:11:51.638237 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44233ea-0106-40a9-9f43-8d529ca2f7a1 None admin] REQUEST_METHOD: `GET` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:11:51.638717 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44233ea-0106-40a9-9f43-8d529ca2f7a1 None admin] SCRIPT_NAME: `/identity` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:11:51.639223 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44233ea-0106-40a9-9f43-8d529ca2f7a1 None admin] PATH_INFO: `/v3/domains` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:11:51.640148 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a44233ea-0106-40a9-9f43-8d529ca2f7a1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=144067) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:11:51.640475 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c689e6e-575c-41f6-b279-336c2d43e420 None admin] RBAC: Authorization granted {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:11:51.640986 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a44233ea-0106-40a9-9f43-8d529ca2f7a1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:11:51.642698 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a44233ea-0106-40a9-9f43-8d529ca2f7a1 None admin] RBAC: Authorization granted {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:11:51.656919 dv-cinder-851351-1-smb devstack@keystone.service[144067]: [pid: 144067|app: 0|req: 278/560] 10.222.0.42 () {56 vars in 1109 bytes} [Thu Jul 28 08:11:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:11:51.658156 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a44233ea-0106-40a9-9f43-8d529ca2f7a1 None admin] Authenticating user token {{(pid=144067) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:11:51.680791 dv-cinder-851351-1-smb devstack@keystone.service[144068]: [pid: 144068|app: 0|req: 283/561] 10.222.0.42 () {56 vars in 1135 bytes} [Thu Jul 28 08:11:51 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 288 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:11:51.682624 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c689e6e-575c-41f6-b279-336c2d43e420 None admin] Authenticating user token {{(pid=144068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:11:51.717386 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG dbcounter [-] [144068] Writing DB stats keystone:SELECT=100 {{(pid=144068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:11:51.792787 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c689e6e-575c-41f6-b279-336c2d43e420 None admin] Validating token access rules against request {{(pid=144068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:11:51.809166 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a44233ea-0106-40a9-9f43-8d529ca2f7a1 None admin] Validating token access rules against request {{(pid=144067) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:11:51.812368 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG dbcounter [-] [144067] Writing DB stats keystone:SELECT=100 {{(pid=144067) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:11:51.829817 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-936846db-bf86-45c6-8312-5af517527fce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:11:51.830757 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936846db-bf86-45c6-8312-5af517527fce None admin] REQUEST_METHOD: `GET` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:11:51.831214 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936846db-bf86-45c6-8312-5af517527fce None admin] SCRIPT_NAME: `/identity` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:11:51.831492 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936846db-bf86-45c6-8312-5af517527fce None admin] PATH_INFO: `/v3/projects/service` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:11:51.839129 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-936846db-bf86-45c6-8312-5af517527fce None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:11:51.840612 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-936846db-bf86-45c6-8312-5af517527fce None admin] RBAC: Authorization granted {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:11:51.848366 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47645f97-c77a-4b0a-b3e8-5de7d01bc2f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144067) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:11:51.849126 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47645f97-c77a-4b0a-b3e8-5de7d01bc2f5 None admin] REQUEST_METHOD: `GET` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:11:51.849410 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47645f97-c77a-4b0a-b3e8-5de7d01bc2f5 None admin] SCRIPT_NAME: `/identity` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:11:51.849684 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47645f97-c77a-4b0a-b3e8-5de7d01bc2f5 None admin] PATH_INFO: `/v3/roles/service` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:11:51.852473 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application [None req-936846db-bf86-45c6-8312-5af517527fce None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 08:11:51.852473 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:11:51.852473 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:11:51.852473 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:11:51.852473 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:11:51.852473 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:11:51.852473 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:11:51.852473 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:11:51.852473 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:11:51.852473 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:11:51.852473 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:11:51.852473 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:11:51.852473 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 28 08:11:51.852473 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 28 08:11:51.852473 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 28 08:11:51.853647 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 28 08:11:51.853647 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:11:51.853647 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:11:51.853647 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:11:51.853647 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:11:51.853647 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:11:51.853647 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:11:51.853647 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:11:51.853647 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application with Lock( Jul 28 08:11:51.853647 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:11:51.853647 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:11:51.853647 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:11:51.853647 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:11:51.853647 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:11:51.853647 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:11:51.853647 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:11:51.853647 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:11:51.854665 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 28 08:11:51.854665 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 28 08:11:51.854665 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 28 08:11:51.854665 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 28 08:11:51.854665 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 28 08:11:51.854665 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 28 08:11:51.854665 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 08:11:51.854665 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application Jul 28 08:11:51.854665 dv-cinder-851351-1-smb devstack@keystone.service[144068]: [pid: 144068|app: 0|req: 284/562] 10.222.0.42 () {56 vars in 1111 bytes} [Thu Jul 28 08:11:51 2022] GET /identity/v3/projects/service => generated 88 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:11:51.855220 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-936846db-bf86-45c6-8312-5af517527fce None admin] Authenticating user token {{(pid=144068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:11:51.866161 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47645f97-c77a-4b0a-b3e8-5de7d01bc2f5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 08:11:51.871585 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application [None req-47645f97-c77a-4b0a-b3e8-5de7d01bc2f5 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 28 08:11:51.871585 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:11:51.871585 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:11:51.871585 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:11:51.871585 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:11:51.871585 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:11:51.871585 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:11:51.871585 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:11:51.871585 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:11:51.871585 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:11:51.871585 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:11:51.871585 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:11:51.871585 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 08:11:51.871585 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 08:11:51.871585 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 08:11:51.871585 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 08:11:51.872941 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 08:11:51.872941 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 08:11:51.872941 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 08:11:51.872941 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 08:11:51.872941 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:11:51.872941 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:11:51.872941 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:11:51.872941 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:11:51.872941 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:11:51.872941 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:11:51.872941 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:11:51.872941 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application with Lock( Jul 28 08:11:51.872941 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:11:51.872941 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:11:51.872941 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:11:51.872941 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:11:51.873906 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:11:51.873906 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:11:51.873906 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:11:51.873906 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:11:51.873906 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 08:11:51.873906 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 08:11:51.873906 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 08:11:51.873906 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 08:11:51.873906 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 08:11:51.873906 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 08:11:51.873906 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 28 08:11:51.873906 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application Jul 28 08:11:51.873906 dv-cinder-851351-1-smb devstack@keystone.service[144067]: [pid: 144067|app: 0|req: 279/563] 10.222.0.42 () {56 vars in 1102 bytes} [Thu Jul 28 08:11:51 2022] GET /identity/v3/roles/service => generated 85 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:11:51.874734 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b0c5b9-66bb-451c-a82c-8f66e6eedfe8 None None] REQUEST_METHOD: `GET` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:11:51.874734 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b0c5b9-66bb-451c-a82c-8f66e6eedfe8 None None] SCRIPT_NAME: `/identity` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:11:51.874734 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b0c5b9-66bb-451c-a82c-8f66e6eedfe8 None None] PATH_INFO: `/` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:11:51.875883 dv-cinder-851351-1-smb devstack@keystone.service[144067]: [pid: 144067|app: 0|req: 280/564] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 08:11:51 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 08:11:51.876397 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b0c5b9-66bb-451c-a82c-8f66e6eedfe8 None None] Authenticating user token {{(pid=144067) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:11:51.966193 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG dbcounter [-] [144068] Writing DB stats keystone:SELECT=100 {{(pid=144068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:11:51.977112 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-936846db-bf86-45c6-8312-5af517527fce None admin] Validating token access rules against request {{(pid=144068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:11:51.984786 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b0c5b9-66bb-451c-a82c-8f66e6eedfe8 None None] Validating token access rules against request {{(pid=144067) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:11:52.012589 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d30534c-f5e3-4bca-8b65-4e0403da7b94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:11:52.013248 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d30534c-f5e3-4bca-8b65-4e0403da7b94 None admin] REQUEST_METHOD: `GET` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:11:52.013556 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d30534c-f5e3-4bca-8b65-4e0403da7b94 None admin] SCRIPT_NAME: `/identity` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:11:52.013797 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d30534c-f5e3-4bca-8b65-4e0403da7b94 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:11:52.018653 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efeefc76-409a-49cb-9268-9b8b29722b62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144067) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:11:52.019288 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efeefc76-409a-49cb-9268-9b8b29722b62 None admin] REQUEST_METHOD: `GET` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:11:52.019622 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efeefc76-409a-49cb-9268-9b8b29722b62 None admin] SCRIPT_NAME: `/identity` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:11:52.019881 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efeefc76-409a-49cb-9268-9b8b29722b62 None admin] PATH_INFO: `/v3/projects` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:11:52.020644 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efeefc76-409a-49cb-9268-9b8b29722b62 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=144067) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:11:52.020972 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efeefc76-409a-49cb-9268-9b8b29722b62 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:11:52.022439 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efeefc76-409a-49cb-9268-9b8b29722b62 None admin] RBAC: Authorization granted {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:11:52.035192 dv-cinder-851351-1-smb devstack@keystone.service[144067]: [pid: 144067|app: 0|req: 281/565] 10.222.0.42 () {56 vars in 1148 bytes} [Thu Jul 28 08:11:51 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:11:52.036894 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80db6ce8-fd09-4ce5-86c0-cb8b8c3c345a None None] REQUEST_METHOD: `POST` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:11:52.037180 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80db6ce8-fd09-4ce5-86c0-cb8b8c3c345a None None] SCRIPT_NAME: `/identity` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:11:52.037458 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80db6ce8-fd09-4ce5-86c0-cb8b8c3c345a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:11:52.055454 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.auth.core [None req-80db6ce8-fd09-4ce5-86c0-cb8b8c3c345a None None] MFA Rules not processed for user `bf5ceb8f07374635ad506b7d1b4f1612`. Rule list: `[]` (Enabled: `True`). {{(pid=144067) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 08:11:52.056685 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.fernet_utils [None req-80db6ce8-fd09-4ce5-86c0-cb8b8c3c345a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=144067) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:11:52.074797 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG dbcounter [-] [144067] Writing DB stats keystone:SELECT=100 {{(pid=144067) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:11:52.084013 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d30534c-f5e3-4bca-8b65-4e0403da7b94 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:11:52.085449 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d30534c-f5e3-4bca-8b65-4e0403da7b94 None admin] RBAC: Authorization granted {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:11:52.127679 dv-cinder-851351-1-smb devstack@keystone.service[144067]: [pid: 144067|app: 0|req: 282/566] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 08:11:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 08:11:52.128529 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80db6ce8-fd09-4ce5-86c0-cb8b8c3c345a None None] Authenticating user token {{(pid=144067) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:11:52.182581 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG dbcounter [-] [144068] Writing DB stats keystone:SELECT=100 {{(pid=144068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:11:52.194512 dv-cinder-851351-1-smb devstack@keystone.service[144068]: [pid: 144068|app: 0|req: 285/567] 10.222.0.42 () {58 vars in 1282 bytes} [Thu Jul 28 08:11:51 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 340 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 28 08:11:52.196000 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00f492a-44a7-4243-8479-86298c04a83c None None] REQUEST_METHOD: `GET` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:11:52.196290 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00f492a-44a7-4243-8479-86298c04a83c None None] SCRIPT_NAME: `/identity` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:11:52.196568 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00f492a-44a7-4243-8479-86298c04a83c None None] PATH_INFO: `/` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:11:52.197874 dv-cinder-851351-1-smb devstack@keystone.service[144068]: [pid: 144068|app: 0|req: 286/568] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 08:11:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 08:11:52.198557 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00f492a-44a7-4243-8479-86298c04a83c None None] Authenticating user token {{(pid=144068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:11:52.247780 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80db6ce8-fd09-4ce5-86c0-cb8b8c3c345a None None] Validating token access rules against request {{(pid=144067) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:11:52.284835 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6e7d07-02e5-4f13-9656-ed89ed1ef0c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144067) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:11:52.285484 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6e7d07-02e5-4f13-9656-ed89ed1ef0c9 None admin] REQUEST_METHOD: `GET` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:11:52.285770 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6e7d07-02e5-4f13-9656-ed89ed1ef0c9 None admin] SCRIPT_NAME: `/identity` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:11:52.286051 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6e7d07-02e5-4f13-9656-ed89ed1ef0c9 None admin] PATH_INFO: `/v3/roles` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:11:52.286786 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c6e7d07-02e5-4f13-9656-ed89ed1ef0c9 None admin] RBAC: Adding query filter params (name=service) {{(pid=144067) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:11:52.287099 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c6e7d07-02e5-4f13-9656-ed89ed1ef0c9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:11:52.288517 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c6e7d07-02e5-4f13-9656-ed89ed1ef0c9 None admin] RBAC: Authorization granted {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:11:52.296906 dv-cinder-851351-1-smb devstack@keystone.service[144067]: [pid: 144067|app: 0|req: 283/569] 10.222.0.42 () {56 vars in 1103 bytes} [Thu Jul 28 08:11:52 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:11:52.297722 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6e7d07-02e5-4f13-9656-ed89ed1ef0c9 None admin] Authenticating user token {{(pid=144067) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:11:52.305588 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00f492a-44a7-4243-8479-86298c04a83c None None] Validating token access rules against request {{(pid=144068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:11:52.316227 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG dbcounter [-] [144067] Writing DB stats keystone:SELECT=100 {{(pid=144067) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:11:52.344072 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-669b4e48-cea0-4262-a16d-744b8689f473 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:11:52.344707 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669b4e48-cea0-4262-a16d-744b8689f473 None admin] REQUEST_METHOD: `PUT` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:11:52.345003 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669b4e48-cea0-4262-a16d-744b8689f473 None admin] SCRIPT_NAME: `/identity` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:11:52.345281 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669b4e48-cea0-4262-a16d-744b8689f473 None admin] PATH_INFO: `/v3/projects/fa39ab7491e5413ca648e31ee9177fa0/users/2c1de9cd80344cefa3e06ae8c9c9e5d9/roles/9aa6ce92dcbb4164ac0e44d2aa2a0248` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:11:52.360644 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-669b4e48-cea0-4262-a16d-744b8689f473 None admin] RBAC: Authorizing `identity:create_grant(project_id=fa39ab7491e5413ca648e31ee9177fa0, user_id=2c1de9cd80344cefa3e06ae8c9c9e5d9, role_id=9aa6ce92dcbb4164ac0e44d2aa2a0248)` {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:11:52.362137 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-669b4e48-cea0-4262-a16d-744b8689f473 None admin] RBAC: Authorization granted {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:11:52.375991 dv-cinder-851351-1-smb devstack@keystone.service[144068]: [pid: 144068|app: 0|req: 287/570] 10.222.0.42 () {58 vars in 1439 bytes} [Thu Jul 28 08:11:52 2022] PUT /identity/v3/projects/fa39ab7491e5413ca648e31ee9177fa0/users/2c1de9cd80344cefa3e06ae8c9c9e5d9/roles/9aa6ce92dcbb4164ac0e44d2aa2a0248 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 08:11:52.376897 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-669b4e48-cea0-4262-a16d-744b8689f473 None admin] Authenticating user token {{(pid=144068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:11:52.428124 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6e7d07-02e5-4f13-9656-ed89ed1ef0c9 None admin] Validating token access rules against request {{(pid=144067) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:11:52.429737 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG dbcounter [-] [144068] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=144068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:11:52.472901 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-043bfa6e-9b34-41c1-bfdf-16e4c061a96c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144067) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:11:52.473598 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043bfa6e-9b34-41c1-bfdf-16e4c061a96c None admin] REQUEST_METHOD: `GET` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:11:52.473886 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043bfa6e-9b34-41c1-bfdf-16e4c061a96c None admin] SCRIPT_NAME: `/identity` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:11:52.474163 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043bfa6e-9b34-41c1-bfdf-16e4c061a96c None admin] PATH_INFO: `/v3/roles/service` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:11:52.489285 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-043bfa6e-9b34-41c1-bfdf-16e4c061a96c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 08:11:52.495072 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application [None req-043bfa6e-9b34-41c1-bfdf-16e4c061a96c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 28 08:11:52.495072 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:11:52.495072 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:11:52.495072 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:11:52.495072 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:11:52.495072 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:11:52.495072 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:11:52.495072 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:11:52.495072 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:11:52.495072 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:11:52.495072 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:11:52.495072 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:11:52.495072 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 08:11:52.495072 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 08:11:52.495072 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 08:11:52.495072 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 08:11:52.496203 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 08:11:52.496203 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 08:11:52.496203 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 08:11:52.496203 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 08:11:52.496203 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:11:52.496203 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:11:52.496203 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:11:52.496203 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:11:52.496203 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:11:52.496203 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:11:52.496203 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:11:52.496203 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application with Lock( Jul 28 08:11:52.496203 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:11:52.496203 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:11:52.496203 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:11:52.496203 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:11:52.497228 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:11:52.497228 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:11:52.497228 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:11:52.497228 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:11:52.497228 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 08:11:52.497228 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 08:11:52.497228 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 08:11:52.497228 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 08:11:52.497228 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 08:11:52.497228 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 08:11:52.497228 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 28 08:11:52.497228 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application Jul 28 08:11:52.501557 dv-cinder-851351-1-smb devstack@keystone.service[144067]: [pid: 144067|app: 0|req: 284/571] 10.222.0.42 () {56 vars in 1102 bytes} [Thu Jul 28 08:11:52 2022] GET /identity/v3/roles/service => generated 85 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:11:52.502861 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cca81b7-bd92-455c-ab85-2199a3fb2f7a None None] REQUEST_METHOD: `POST` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:11:52.503150 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cca81b7-bd92-455c-ab85-2199a3fb2f7a None None] SCRIPT_NAME: `/identity` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:11:52.503435 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cca81b7-bd92-455c-ab85-2199a3fb2f7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:11:52.515878 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-669b4e48-cea0-4262-a16d-744b8689f473 None admin] Validating token access rules against request {{(pid=144068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:11:52.522696 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.auth.core [None req-4cca81b7-bd92-455c-ab85-2199a3fb2f7a None None] MFA Rules not processed for user `bf5ceb8f07374635ad506b7d1b4f1612`. Rule list: `[]` (Enabled: `True`). {{(pid=144067) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 08:11:52.523945 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.fernet_utils [None req-4cca81b7-bd92-455c-ab85-2199a3fb2f7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=144067) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:11:52.563869 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49eefd4b-a613-4aa4-ba2a-9999640b0c4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:11:52.564552 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49eefd4b-a613-4aa4-ba2a-9999640b0c4b None admin] REQUEST_METHOD: `GET` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:11:52.564893 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49eefd4b-a613-4aa4-ba2a-9999640b0c4b None admin] SCRIPT_NAME: `/identity` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:11:52.565173 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49eefd4b-a613-4aa4-ba2a-9999640b0c4b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:11:52.576290 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49eefd4b-a613-4aa4-ba2a-9999640b0c4b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:11:52.577808 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49eefd4b-a613-4aa4-ba2a-9999640b0c4b None admin] RBAC: Authorization granted {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:11:52.595022 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application [None req-49eefd4b-a613-4aa4-ba2a-9999640b0c4b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 08:11:52.595022 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:11:52.595022 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:11:52.595022 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:11:52.595022 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:11:52.595022 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:11:52.595022 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:11:52.595022 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:11:52.595022 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:11:52.595022 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:11:52.595022 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:11:52.595022 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:11:52.595022 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 08:11:52.595022 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 08:11:52.595022 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 08:11:52.596200 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 08:11:52.596200 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:11:52.596200 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:11:52.596200 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:11:52.596200 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:11:52.596200 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:11:52.596200 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:11:52.596200 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:11:52.596200 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application with Lock( Jul 28 08:11:52.596200 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:11:52.596200 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:11:52.596200 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:11:52.596200 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:11:52.596200 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:11:52.596200 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:11:52.596200 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:11:52.596200 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:11:52.597383 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 08:11:52.597383 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 08:11:52.597383 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 08:11:52.597383 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application Jul 28 08:11:52.597383 dv-cinder-851351-1-smb devstack@keystone.service[144068]: [pid: 144068|app: 0|req: 288/572] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 08:11:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:11:52.597383 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49eefd4b-a613-4aa4-ba2a-9999640b0c4b None admin] Authenticating user token {{(pid=144068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:11:52.606667 dv-cinder-851351-1-smb devstack@keystone.service[144067]: [pid: 144067|app: 0|req: 285/573] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 08:11:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 08:11:52.607723 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cca81b7-bd92-455c-ab85-2199a3fb2f7a None None] Authenticating user token {{(pid=144067) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:11:52.626719 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG dbcounter [-] [144067] Writing DB stats keystone:SELECT=100 {{(pid=144067) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:11:52.707059 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG dbcounter [-] [144068] Writing DB stats keystone:SELECT=100 {{(pid=144068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:11:52.719230 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49eefd4b-a613-4aa4-ba2a-9999640b0c4b None admin] Validating token access rules against request {{(pid=144068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:11:52.741143 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cca81b7-bd92-455c-ab85-2199a3fb2f7a None None] Validating token access rules against request {{(pid=144067) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:11:52.762819 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7b2a46-7087-4c87-9964-be5d4d07b615 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:11:52.763781 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7b2a46-7087-4c87-9964-be5d4d07b615 None admin] REQUEST_METHOD: `GET` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:11:52.763781 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7b2a46-7087-4c87-9964-be5d4d07b615 None admin] SCRIPT_NAME: `/identity` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:11:52.764047 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7b2a46-7087-4c87-9964-be5d4d07b615 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:11:52.775668 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b7b2a46-7087-4c87-9964-be5d4d07b615 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:11:52.777194 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b7b2a46-7087-4c87-9964-be5d4d07b615 None admin] RBAC: Authorization granted {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:11:52.785669 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f705c1-0aa3-4866-83c4-af340c9cde7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144067) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:11:52.786287 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f705c1-0aa3-4866-83c4-af340c9cde7e None admin] REQUEST_METHOD: `GET` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:11:52.786570 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f705c1-0aa3-4866-83c4-af340c9cde7e None admin] SCRIPT_NAME: `/identity` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:11:52.786868 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f705c1-0aa3-4866-83c4-af340c9cde7e None admin] PATH_INFO: `/v3/roles` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:11:52.787572 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2f705c1-0aa3-4866-83c4-af340c9cde7e None admin] RBAC: Adding query filter params (name=service) {{(pid=144067) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:11:52.787921 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2f705c1-0aa3-4866-83c4-af340c9cde7e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:11:52.789366 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2f705c1-0aa3-4866-83c4-af340c9cde7e None admin] RBAC: Authorization granted {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:11:52.792289 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application [None req-8b7b2a46-7087-4c87-9964-be5d4d07b615 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 08:11:52.792289 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:11:52.792289 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:11:52.792289 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:11:52.792289 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:11:52.792289 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:11:52.792289 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:11:52.792289 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:11:52.792289 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:11:52.792289 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:11:52.792289 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:11:52.792289 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:11:52.792289 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 08:11:52.792289 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 08:11:52.792289 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 08:11:52.793299 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 08:11:52.793299 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:11:52.793299 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:11:52.793299 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:11:52.793299 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:11:52.793299 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:11:52.793299 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:11:52.793299 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:11:52.793299 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application with Lock( Jul 28 08:11:52.793299 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:11:52.793299 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:11:52.793299 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:11:52.793299 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:11:52.793299 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:11:52.793299 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:11:52.793299 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:11:52.793299 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:11:52.799828 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 08:11:52.799828 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 08:11:52.799828 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 08:11:52.799828 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application Jul 28 08:11:52.799828 dv-cinder-851351-1-smb devstack@keystone.service[144068]: [pid: 144068|app: 0|req: 289/574] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 08:11:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:11:52.799828 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7b2a46-7087-4c87-9964-be5d4d07b615 None admin] Authenticating user token {{(pid=144068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:11:52.807777 dv-cinder-851351-1-smb devstack@keystone.service[144067]: [pid: 144067|app: 0|req: 286/575] 10.222.0.42 () {56 vars in 1103 bytes} [Thu Jul 28 08:11:52 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:11:52.807777 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f705c1-0aa3-4866-83c4-af340c9cde7e None admin] Authenticating user token {{(pid=144067) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:11:52.881737 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG dbcounter [-] [144067] Writing DB stats keystone:SELECT=100 {{(pid=144067) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:11:52.912992 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7b2a46-7087-4c87-9964-be5d4d07b615 None admin] Validating token access rules against request {{(pid=144068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:11:52.921486 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f705c1-0aa3-4866-83c4-af340c9cde7e None admin] Validating token access rules against request {{(pid=144067) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:11:52.948015 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b890b298-1756-4fdc-82c7-fee7ae5b83fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:11:52.948768 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b890b298-1756-4fdc-82c7-fee7ae5b83fb None admin] REQUEST_METHOD: `GET` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:11:52.949050 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b890b298-1756-4fdc-82c7-fee7ae5b83fb None admin] SCRIPT_NAME: `/identity` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:11:52.949320 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b890b298-1756-4fdc-82c7-fee7ae5b83fb None admin] PATH_INFO: `/v3/domains` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:11:52.950019 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b890b298-1756-4fdc-82c7-fee7ae5b83fb None admin] RBAC: Adding query filter params (name=Default) {{(pid=144068) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:11:52.950314 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b890b298-1756-4fdc-82c7-fee7ae5b83fb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:11:52.951854 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b890b298-1756-4fdc-82c7-fee7ae5b83fb None admin] RBAC: Authorization granted {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:11:52.958498 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e735838-ded5-4090-8485-e23bc7698637 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144067) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:11:52.959161 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e735838-ded5-4090-8485-e23bc7698637 None admin] REQUEST_METHOD: `GET` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:11:52.959442 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e735838-ded5-4090-8485-e23bc7698637 None admin] SCRIPT_NAME: `/identity` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:11:52.959717 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e735838-ded5-4090-8485-e23bc7698637 None admin] PATH_INFO: `/v3/roles/service` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:11:52.968833 dv-cinder-851351-1-smb devstack@keystone.service[144068]: [pid: 144068|app: 0|req: 290/576] 10.222.0.42 () {56 vars in 1109 bytes} [Thu Jul 28 08:11:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:11:52.970064 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b890b298-1756-4fdc-82c7-fee7ae5b83fb None admin] Authenticating user token {{(pid=144068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:11:52.975950 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG dbcounter [-] [144068] Writing DB stats keystone:SELECT=100 {{(pid=144068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:11:52.977604 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e735838-ded5-4090-8485-e23bc7698637 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 08:11:52.984103 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application [None req-4e735838-ded5-4090-8485-e23bc7698637 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 28 08:11:52.984103 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:11:52.984103 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:11:52.984103 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:11:52.984103 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:11:52.984103 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:11:52.984103 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:11:52.984103 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:11:52.984103 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:11:52.984103 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:11:52.984103 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:11:52.984103 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:11:52.984103 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 08:11:52.984103 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 08:11:52.984103 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 08:11:52.984103 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 08:11:52.985162 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 08:11:52.985162 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 08:11:52.985162 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 08:11:52.985162 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 08:11:52.985162 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:11:52.985162 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:11:52.985162 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:11:52.985162 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:11:52.985162 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:11:52.985162 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:11:52.985162 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:11:52.985162 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application with Lock( Jul 28 08:11:52.985162 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:11:52.985162 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:11:52.985162 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:11:52.985162 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:11:52.986210 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:11:52.986210 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:11:52.986210 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:11:52.986210 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:11:52.986210 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 08:11:52.986210 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 08:11:52.986210 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 08:11:52.986210 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 08:11:52.986210 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 08:11:52.986210 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 08:11:52.986210 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 28 08:11:52.986210 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application Jul 28 08:11:52.990793 dv-cinder-851351-1-smb devstack@keystone.service[144067]: [pid: 144067|app: 0|req: 287/577] 10.222.0.42 () {56 vars in 1102 bytes} [Thu Jul 28 08:11:52 2022] GET /identity/v3/roles/service => generated 85 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:11:52.991707 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e735838-ded5-4090-8485-e23bc7698637 None admin] Authenticating user token {{(pid=144067) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:11:53.099264 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b890b298-1756-4fdc-82c7-fee7ae5b83fb None admin] Validating token access rules against request {{(pid=144068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:11:53.104141 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e735838-ded5-4090-8485-e23bc7698637 None admin] Validating token access rules against request {{(pid=144067) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:11:53.132625 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG dbcounter [-] [144067] Writing DB stats keystone:SELECT=100 {{(pid=144067) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:11:53.141941 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7c8682-d5e4-49f4-9439-2af1f01836d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144067) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:11:53.142602 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7c8682-d5e4-49f4-9439-2af1f01836d1 None admin] REQUEST_METHOD: `GET` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:11:53.142885 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7c8682-d5e4-49f4-9439-2af1f01836d1 None admin] SCRIPT_NAME: `/identity` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:11:53.143160 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7c8682-d5e4-49f4-9439-2af1f01836d1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:11:53.145748 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb78a48-d97e-4d9c-a08b-e4d262834981 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:11:53.146713 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb78a48-d97e-4d9c-a08b-e4d262834981 None admin] REQUEST_METHOD: `GET` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:11:53.147013 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb78a48-d97e-4d9c-a08b-e4d262834981 None admin] SCRIPT_NAME: `/identity` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:11:53.147295 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb78a48-d97e-4d9c-a08b-e4d262834981 None admin] PATH_INFO: `/v3/domains` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:11:53.148006 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bb78a48-d97e-4d9c-a08b-e4d262834981 None admin] RBAC: Adding query filter params (name=Default) {{(pid=144068) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:11:53.148311 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bb78a48-d97e-4d9c-a08b-e4d262834981 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:11:53.149736 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bb78a48-d97e-4d9c-a08b-e4d262834981 None admin] RBAC: Authorization granted {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:11:53.154210 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d7c8682-d5e4-49f4-9439-2af1f01836d1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:11:53.155669 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d7c8682-d5e4-49f4-9439-2af1f01836d1 None admin] RBAC: Authorization granted {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:11:53.167570 dv-cinder-851351-1-smb devstack@keystone.service[144068]: [pid: 144068|app: 0|req: 291/578] 10.222.0.42 () {56 vars in 1109 bytes} [Thu Jul 28 08:11:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:11:53.167570 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb78a48-d97e-4d9c-a08b-e4d262834981 None admin] Authenticating user token {{(pid=144068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:11:53.170267 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application [None req-2d7c8682-d5e4-49f4-9439-2af1f01836d1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 08:11:53.170267 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:11:53.170267 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:11:53.170267 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:11:53.170267 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:11:53.170267 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:11:53.170267 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:11:53.170267 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:11:53.170267 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:11:53.170267 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:11:53.170267 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:11:53.170267 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:11:53.170267 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 08:11:53.170267 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 08:11:53.170267 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 08:11:53.171200 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 08:11:53.171200 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:11:53.171200 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:11:53.171200 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:11:53.171200 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:11:53.171200 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:11:53.171200 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:11:53.171200 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:11:53.171200 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application with Lock( Jul 28 08:11:53.171200 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:11:53.171200 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:11:53.171200 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:11:53.171200 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:11:53.171200 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:11:53.171200 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:11:53.171200 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:11:53.171200 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:11:53.172190 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 08:11:53.172190 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 08:11:53.172190 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 08:11:53.172190 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application Jul 28 08:11:53.172190 dv-cinder-851351-1-smb devstack@keystone.service[144067]: [pid: 144067|app: 0|req: 288/579] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 08:11:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:11:53.172190 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7c8682-d5e4-49f4-9439-2af1f01836d1 None admin] Authenticating user token {{(pid=144067) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:11:53.234792 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG dbcounter [-] [144068] Writing DB stats keystone:SELECT=100 {{(pid=144068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:11:53.281194 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb78a48-d97e-4d9c-a08b-e4d262834981 None admin] Validating token access rules against request {{(pid=144068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:11:53.289656 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7c8682-d5e4-49f4-9439-2af1f01836d1 None admin] Validating token access rules against request {{(pid=144067) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:11:53.314918 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831327ed-75f5-473e-8e53-2d79db455cf8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:11:53.315556 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831327ed-75f5-473e-8e53-2d79db455cf8 None admin] REQUEST_METHOD: `GET` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:11:53.315811 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831327ed-75f5-473e-8e53-2d79db455cf8 None admin] SCRIPT_NAME: `/identity` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:11:53.316082 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831327ed-75f5-473e-8e53-2d79db455cf8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:11:53.323463 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-831327ed-75f5-473e-8e53-2d79db455cf8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:11:53.325453 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-831327ed-75f5-473e-8e53-2d79db455cf8 None admin] RBAC: Authorization granted {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:11:53.327180 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f64c0a2-0f2b-47e4-8759-393c265db155 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144067) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:11:53.327817 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f64c0a2-0f2b-47e4-8759-393c265db155 None admin] REQUEST_METHOD: `GET` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:11:53.328097 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f64c0a2-0f2b-47e4-8759-393c265db155 None admin] SCRIPT_NAME: `/identity` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:11:53.328371 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f64c0a2-0f2b-47e4-8759-393c265db155 None admin] PATH_INFO: `/v3/roles` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:11:53.329153 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f64c0a2-0f2b-47e4-8759-393c265db155 None admin] RBAC: Adding query filter params (name=service) {{(pid=144067) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:11:53.329458 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f64c0a2-0f2b-47e4-8759-393c265db155 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:11:53.330845 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f64c0a2-0f2b-47e4-8759-393c265db155 None admin] RBAC: Authorization granted {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:11:53.339559 dv-cinder-851351-1-smb devstack@keystone.service[144067]: [pid: 144067|app: 0|req: 289/580] 10.222.0.42 () {56 vars in 1103 bytes} [Thu Jul 28 08:11:53 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:11:53.340345 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application [None req-831327ed-75f5-473e-8e53-2d79db455cf8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 08:11:53.340345 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:11:53.340345 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:11:53.340345 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:11:53.340345 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:11:53.340345 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:11:53.340345 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:11:53.340345 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:11:53.340345 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:11:53.340345 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:11:53.340345 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:11:53.340345 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:11:53.340345 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 28 08:11:53.340345 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 28 08:11:53.340345 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 28 08:11:53.341414 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 28 08:11:53.341414 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:11:53.341414 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:11:53.341414 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:11:53.341414 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:11:53.341414 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:11:53.341414 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:11:53.341414 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:11:53.341414 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application with Lock( Jul 28 08:11:53.341414 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:11:53.341414 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:11:53.341414 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:11:53.341414 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:11:53.341414 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:11:53.341414 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:11:53.341414 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:11:53.341414 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:11:53.342380 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 28 08:11:53.342380 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 28 08:11:53.342380 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 28 08:11:53.342380 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 28 08:11:53.342380 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 28 08:11:53.342380 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 28 08:11:53.342380 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 08:11:53.342380 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application Jul 28 08:11:53.342931 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f64c0a2-0f2b-47e4-8759-393c265db155 None admin] Authenticating user token {{(pid=144067) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:11:53.344729 dv-cinder-851351-1-smb devstack@keystone.service[144068]: [pid: 144068|app: 0|req: 292/581] 10.222.0.42 () {56 vars in 1111 bytes} [Thu Jul 28 08:11:53 2022] GET /identity/v3/projects/service => generated 88 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:11:53.345768 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831327ed-75f5-473e-8e53-2d79db455cf8 None admin] Authenticating user token {{(pid=144068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:11:53.394422 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG dbcounter [-] [144067] Writing DB stats keystone:SELECT=100 {{(pid=144067) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:11:53.459502 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f64c0a2-0f2b-47e4-8759-393c265db155 None admin] Validating token access rules against request {{(pid=144067) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:11:53.462001 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831327ed-75f5-473e-8e53-2d79db455cf8 None admin] Validating token access rules against request {{(pid=144068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:11:53.492373 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG dbcounter [-] [144068] Writing DB stats keystone:SELECT=100 {{(pid=144068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:11:53.497883 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95c90f2-8588-4e43-8ac7-a19e5455f994 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144067) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:11:53.498576 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95c90f2-8588-4e43-8ac7-a19e5455f994 None admin] REQUEST_METHOD: `GET` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:11:53.498922 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95c90f2-8588-4e43-8ac7-a19e5455f994 None admin] SCRIPT_NAME: `/identity` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:11:53.499204 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95c90f2-8588-4e43-8ac7-a19e5455f994 None admin] PATH_INFO: `/v3/users/glance` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:11:53.505968 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be07b02-724c-4e0d-86f9-f4ae7bd3fc72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:11:53.506708 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be07b02-724c-4e0d-86f9-f4ae7bd3fc72 None admin] REQUEST_METHOD: `GET` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:11:53.507056 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be07b02-724c-4e0d-86f9-f4ae7bd3fc72 None admin] SCRIPT_NAME: `/identity` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:11:53.507398 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be07b02-724c-4e0d-86f9-f4ae7bd3fc72 None admin] PATH_INFO: `/v3/domains` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:11:53.508202 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6be07b02-724c-4e0d-86f9-f4ae7bd3fc72 None admin] RBAC: Adding query filter params (name=Default) {{(pid=144068) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:11:53.508597 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6be07b02-724c-4e0d-86f9-f4ae7bd3fc72 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:11:53.508945 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e95c90f2-8588-4e43-8ac7-a19e5455f994 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:11:53.510107 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6be07b02-724c-4e0d-86f9-f4ae7bd3fc72 None admin] RBAC: Authorization granted {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:11:53.510725 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e95c90f2-8588-4e43-8ac7-a19e5455f994 None admin] RBAC: Authorization granted {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:11:53.528887 dv-cinder-851351-1-smb devstack@keystone.service[144068]: [pid: 144068|app: 0|req: 293/582] 10.222.0.42 () {56 vars in 1109 bytes} [Thu Jul 28 08:11:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:11:53.529497 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application [None req-e95c90f2-8588-4e43-8ac7-a19e5455f994 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jul 28 08:11:53.529497 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:11:53.529497 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:11:53.529497 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:11:53.529497 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:11:53.529497 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:11:53.529497 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:11:53.529497 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:11:53.529497 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:11:53.529497 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:11:53.529497 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:11:53.529497 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:11:53.529497 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 28 08:11:53.529497 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 28 08:11:53.529497 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 28 08:11:53.529497 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 28 08:11:53.531434 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:11:53.531434 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:11:53.531434 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 28 08:11:53.531434 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 08:11:53.531434 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 28 08:11:53.531434 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 08:11:53.531434 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:11:53.531434 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:11:53.531434 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:11:53.531434 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:11:53.531434 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:11:53.531434 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application with Lock( Jul 28 08:11:53.531434 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:11:53.531434 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:11:53.531434 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:11:53.531434 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:11:53.531434 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:11:53.531434 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:11:53.536905 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:11:53.536905 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:11:53.536905 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 28 08:11:53.536905 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 28 08:11:53.536905 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 28 08:11:53.536905 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 28 08:11:53.536905 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 28 08:11:53.536905 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 28 08:11:53.536905 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jul 28 08:11:53.536905 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application Jul 28 08:11:53.538663 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be07b02-724c-4e0d-86f9-f4ae7bd3fc72 None admin] Authenticating user token {{(pid=144068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:11:53.538883 dv-cinder-851351-1-smb devstack@keystone.service[144067]: [pid: 144067|app: 0|req: 290/583] 10.222.0.42 () {56 vars in 1099 bytes} [Thu Jul 28 08:11:53 2022] GET /identity/v3/users/glance => generated 84 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:11:53.538883 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95c90f2-8588-4e43-8ac7-a19e5455f994 None admin] Authenticating user token {{(pid=144067) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:11:53.636278 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95c90f2-8588-4e43-8ac7-a19e5455f994 None admin] Validating token access rules against request {{(pid=144067) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:11:53.637850 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG dbcounter [-] [144067] Writing DB stats keystone:SELECT=100 {{(pid=144067) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:11:53.638441 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be07b02-724c-4e0d-86f9-f4ae7bd3fc72 None admin] Validating token access rules against request {{(pid=144068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:11:53.675438 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-525f34b6-b40a-4073-b9d0-fbd8659ff892 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:11:53.676147 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525f34b6-b40a-4073-b9d0-fbd8659ff892 None admin] REQUEST_METHOD: `GET` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:11:53.676419 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525f34b6-b40a-4073-b9d0-fbd8659ff892 None admin] SCRIPT_NAME: `/identity` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:11:53.676710 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525f34b6-b40a-4073-b9d0-fbd8659ff892 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:11:53.678297 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c617935-85aa-4717-930e-7df12d3a0526 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144067) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:11:53.679144 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c617935-85aa-4717-930e-7df12d3a0526 None admin] REQUEST_METHOD: `GET` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:11:53.679629 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c617935-85aa-4717-930e-7df12d3a0526 None admin] SCRIPT_NAME: `/identity` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:11:53.680110 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c617935-85aa-4717-930e-7df12d3a0526 None admin] PATH_INFO: `/v3/projects` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:11:53.681101 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c617935-85aa-4717-930e-7df12d3a0526 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=144067) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:11:53.681624 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c617935-85aa-4717-930e-7df12d3a0526 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:11:53.683279 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c617935-85aa-4717-930e-7df12d3a0526 None admin] RBAC: Authorization granted {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:11:53.687222 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-525f34b6-b40a-4073-b9d0-fbd8659ff892 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:11:53.688710 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-525f34b6-b40a-4073-b9d0-fbd8659ff892 None admin] RBAC: Authorization granted {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:11:53.701421 dv-cinder-851351-1-smb devstack@keystone.service[144067]: [pid: 144067|app: 0|req: 291/584] 10.222.0.42 () {56 vars in 1148 bytes} [Thu Jul 28 08:11:53 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:11:53.701421 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c617935-85aa-4717-930e-7df12d3a0526 None admin] Authenticating user token {{(pid=144067) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:11:53.703669 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application [None req-525f34b6-b40a-4073-b9d0-fbd8659ff892 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 08:11:53.703669 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:11:53.703669 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:11:53.703669 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:11:53.703669 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:11:53.703669 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:11:53.703669 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:11:53.703669 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:11:53.703669 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:11:53.703669 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:11:53.703669 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:11:53.703669 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:11:53.703669 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 08:11:53.703669 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 08:11:53.703669 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 08:11:53.704654 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 08:11:53.704654 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:11:53.704654 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:11:53.704654 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:11:53.704654 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:11:53.704654 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:11:53.704654 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:11:53.704654 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:11:53.704654 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application with Lock( Jul 28 08:11:53.704654 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:11:53.704654 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:11:53.704654 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:11:53.704654 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:11:53.704654 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:11:53.704654 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:11:53.704654 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:11:53.704654 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:11:53.705664 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 08:11:53.705664 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 08:11:53.705664 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 08:11:53.705664 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application Jul 28 08:11:53.709622 dv-cinder-851351-1-smb devstack@keystone.service[144068]: [pid: 144068|app: 0|req: 294/585] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 08:11:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:11:53.710461 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-525f34b6-b40a-4073-b9d0-fbd8659ff892 None admin] Authenticating user token {{(pid=144068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:11:53.749136 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG dbcounter [-] [144068] Writing DB stats keystone:SELECT=100 {{(pid=144068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:11:53.814098 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c617935-85aa-4717-930e-7df12d3a0526 None admin] Validating token access rules against request {{(pid=144067) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:11:53.824783 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-525f34b6-b40a-4073-b9d0-fbd8659ff892 None admin] Validating token access rules against request {{(pid=144068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:11:53.854359 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac47026-9041-4ea9-9ca9-1383e8c52d14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144067) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:11:53.855008 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac47026-9041-4ea9-9ca9-1383e8c52d14 None admin] REQUEST_METHOD: `GET` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:11:53.855380 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac47026-9041-4ea9-9ca9-1383e8c52d14 None admin] SCRIPT_NAME: `/identity` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:11:53.855644 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac47026-9041-4ea9-9ca9-1383e8c52d14 None admin] PATH_INFO: `/v3/users` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:11:53.856381 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac47026-9041-4ea9-9ca9-1383e8c52d14 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=144067) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:11:53.856767 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac47026-9041-4ea9-9ca9-1383e8c52d14 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:11:53.858251 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac47026-9041-4ea9-9ca9-1383e8c52d14 None admin] RBAC: Authorization granted {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:11:53.866249 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dabc412-fd06-4e83-8b28-98fc935ac947 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:11:53.867024 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dabc412-fd06-4e83-8b28-98fc935ac947 None admin] REQUEST_METHOD: `GET` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:11:53.867303 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dabc412-fd06-4e83-8b28-98fc935ac947 None admin] SCRIPT_NAME: `/identity` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:11:53.868330 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dabc412-fd06-4e83-8b28-98fc935ac947 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:11:53.875733 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dabc412-fd06-4e83-8b28-98fc935ac947 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:11:53.881345 dv-cinder-851351-1-smb devstack@keystone.service[144067]: [pid: 144067|app: 0|req: 292/586] 10.222.0.42 () {56 vars in 1137 bytes} [Thu Jul 28 08:11:53 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:11:53.881519 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dabc412-fd06-4e83-8b28-98fc935ac947 None admin] RBAC: Authorization granted {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:11:53.881650 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac47026-9041-4ea9-9ca9-1383e8c52d14 None admin] Authenticating user token {{(pid=144067) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:11:53.892414 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application [None req-4dabc412-fd06-4e83-8b28-98fc935ac947 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jul 28 08:11:53.892414 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:11:53.892414 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:11:53.892414 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:11:53.892414 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:11:53.892414 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:11:53.892414 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:11:53.892414 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:11:53.892414 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:11:53.892414 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:11:53.892414 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:11:53.892414 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:11:53.892414 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 28 08:11:53.892414 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 28 08:11:53.892414 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 28 08:11:53.892414 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 28 08:11:53.893696 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:11:53.893696 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:11:53.893696 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 28 08:11:53.893696 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 08:11:53.893696 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 28 08:11:53.893696 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 08:11:53.893696 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:11:53.893696 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:11:53.893696 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:11:53.893696 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:11:53.893696 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:11:53.893696 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application with Lock( Jul 28 08:11:53.893696 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:11:53.893696 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:11:53.893696 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:11:53.893696 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:11:53.893696 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:11:53.893696 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:11:53.894874 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:11:53.894874 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:11:53.894874 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 28 08:11:53.894874 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 28 08:11:53.894874 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 28 08:11:53.894874 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 28 08:11:53.894874 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 28 08:11:53.894874 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 28 08:11:53.894874 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jul 28 08:11:53.894874 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application Jul 28 08:11:53.894874 dv-cinder-851351-1-smb devstack@keystone.service[144068]: [pid: 144068|app: 0|req: 295/587] 10.222.0.42 () {56 vars in 1102 bytes} [Thu Jul 28 08:11:53 2022] GET /identity/v3/users/neutron => generated 85 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:11:53.895540 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dabc412-fd06-4e83-8b28-98fc935ac947 None admin] Authenticating user token {{(pid=144068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:11:53.909046 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG dbcounter [-] [144067] Writing DB stats keystone:SELECT=100 {{(pid=144067) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:11:54.000571 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac47026-9041-4ea9-9ca9-1383e8c52d14 None admin] Validating token access rules against request {{(pid=144067) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:11:54.001526 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG dbcounter [-] [144068] Writing DB stats keystone:SELECT=100 {{(pid=144068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:11:54.009603 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dabc412-fd06-4e83-8b28-98fc935ac947 None admin] Validating token access rules against request {{(pid=144068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:11:54.036347 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2505dca1-2ba8-49c9-861d-6e66223235d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144067) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:11:54.037034 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2505dca1-2ba8-49c9-861d-6e66223235d2 None admin] REQUEST_METHOD: `GET` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:11:54.037315 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2505dca1-2ba8-49c9-861d-6e66223235d2 None admin] SCRIPT_NAME: `/identity` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:11:54.037586 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2505dca1-2ba8-49c9-861d-6e66223235d2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:11:54.038389 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2505dca1-2ba8-49c9-861d-6e66223235d2 None admin] RBAC: Adding query filter params (role.id=9aa6ce92dcbb4164ac0e44d2aa2a0248, scope.project.id=fa39ab7491e5413ca648e31ee9177fa0, user.id=fffb2166afc14796bc3c9c9eba793ec0) {{(pid=144067) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:11:54.038705 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2505dca1-2ba8-49c9-861d-6e66223235d2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:11:54.040165 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2505dca1-2ba8-49c9-861d-6e66223235d2 None admin] RBAC: Authorization granted {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:11:54.045869 dv-cinder-851351-1-smb devstack@keystone.service[144067]: [pid: 144067|app: 0|req: 293/588] 10.222.0.42 () {56 vars in 1374 bytes} [Thu Jul 28 08:11:53 2022] GET /identity/v3/role_assignments?user.id=fffb2166afc14796bc3c9c9eba793ec0&scope.project.id=fa39ab7491e5413ca648e31ee9177fa0&role.id=9aa6ce92dcbb4164ac0e44d2aa2a0248 => generated 259 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:11:54.046620 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2505dca1-2ba8-49c9-861d-6e66223235d2 None admin] Authenticating user token {{(pid=144067) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:11:54.062153 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41aaed30-0aa7-4a9e-a79f-6260b2aac48e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:11:54.063224 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41aaed30-0aa7-4a9e-a79f-6260b2aac48e None admin] REQUEST_METHOD: `GET` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:11:54.063723 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41aaed30-0aa7-4a9e-a79f-6260b2aac48e None admin] SCRIPT_NAME: `/identity` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:11:54.064242 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41aaed30-0aa7-4a9e-a79f-6260b2aac48e None admin] PATH_INFO: `/v3/domains` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:11:54.065335 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41aaed30-0aa7-4a9e-a79f-6260b2aac48e None admin] RBAC: Adding query filter params (name=Default) {{(pid=144068) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:11:54.066024 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41aaed30-0aa7-4a9e-a79f-6260b2aac48e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:11:54.067669 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41aaed30-0aa7-4a9e-a79f-6260b2aac48e None admin] RBAC: Authorization granted {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:11:54.087117 dv-cinder-851351-1-smb devstack@keystone.service[144068]: [pid: 144068|app: 0|req: 296/589] 10.222.0.42 () {56 vars in 1109 bytes} [Thu Jul 28 08:11:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:11:54.087117 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41aaed30-0aa7-4a9e-a79f-6260b2aac48e None admin] Authenticating user token {{(pid=144068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:11:54.174862 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG dbcounter [-] [144067] Writing DB stats keystone:SELECT=100 {{(pid=144067) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:11:54.204735 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41aaed30-0aa7-4a9e-a79f-6260b2aac48e None admin] Validating token access rules against request {{(pid=144068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:11:54.208454 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2505dca1-2ba8-49c9-861d-6e66223235d2 None admin] Validating token access rules against request {{(pid=144067) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:11:54.252235 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68cbab1d-30b6-479c-b755-16e3188810e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144067) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:11:54.253042 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68cbab1d-30b6-479c-b755-16e3188810e3 None admin] REQUEST_METHOD: `GET` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:11:54.253335 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68cbab1d-30b6-479c-b755-16e3188810e3 None admin] SCRIPT_NAME: `/identity` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:11:54.253620 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68cbab1d-30b6-479c-b755-16e3188810e3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:11:54.258913 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-973b889b-595a-4089-adca-4a9b0ea9497d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:11:54.259760 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973b889b-595a-4089-adca-4a9b0ea9497d None admin] REQUEST_METHOD: `GET` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:11:54.260212 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973b889b-595a-4089-adca-4a9b0ea9497d None admin] SCRIPT_NAME: `/identity` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:11:54.260646 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973b889b-595a-4089-adca-4a9b0ea9497d None admin] PATH_INFO: `/v3/users` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:11:54.262194 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-973b889b-595a-4089-adca-4a9b0ea9497d None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=144068) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:11:54.262676 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-973b889b-595a-4089-adca-4a9b0ea9497d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:11:54.265102 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-973b889b-595a-4089-adca-4a9b0ea9497d None admin] RBAC: Authorization granted {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:11:54.265460 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68cbab1d-30b6-479c-b755-16e3188810e3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:11:54.266951 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68cbab1d-30b6-479c-b755-16e3188810e3 None admin] RBAC: Authorization granted {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:11:54.283334 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application [None req-68cbab1d-30b6-479c-b755-16e3188810e3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 08:11:54.283334 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:11:54.283334 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:11:54.283334 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:11:54.283334 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:11:54.283334 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:11:54.283334 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:11:54.283334 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:11:54.283334 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:11:54.283334 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:11:54.283334 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:11:54.283334 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:11:54.283334 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 08:11:54.283334 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 08:11:54.283334 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 08:11:54.284567 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 08:11:54.284567 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:11:54.284567 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:11:54.284567 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:11:54.284567 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:11:54.284567 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:11:54.284567 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:11:54.284567 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:11:54.284567 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application with Lock( Jul 28 08:11:54.284567 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:11:54.284567 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:11:54.284567 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:11:54.284567 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:11:54.284567 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:11:54.284567 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:11:54.284567 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:11:54.284567 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:11:54.285799 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 08:11:54.285799 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 08:11:54.285799 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 08:11:54.285799 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application Jul 28 08:11:54.289486 dv-cinder-851351-1-smb devstack@keystone.service[144067]: [pid: 144067|app: 0|req: 294/590] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 08:11:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 243 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:11:54.290143 dv-cinder-851351-1-smb devstack@keystone.service[144068]: [pid: 144068|app: 0|req: 297/591] 10.222.0.42 () {56 vars in 1139 bytes} [Thu Jul 28 08:11:54 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:11:54.290397 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68cbab1d-30b6-479c-b755-16e3188810e3 None admin] Authenticating user token {{(pid=144067) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:11:54.291424 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-973b889b-595a-4089-adca-4a9b0ea9497d None admin] Authenticating user token {{(pid=144068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:11:54.311286 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG dbcounter [-] [144068] Writing DB stats keystone:SELECT=100 {{(pid=144068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:11:54.408921 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68cbab1d-30b6-479c-b755-16e3188810e3 None admin] Validating token access rules against request {{(pid=144067) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:11:54.419757 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-973b889b-595a-4089-adca-4a9b0ea9497d None admin] Validating token access rules against request {{(pid=144068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:11:54.448224 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd0860d5-7e64-444e-9cd9-f3340419caef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144067) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:11:54.448954 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0860d5-7e64-444e-9cd9-f3340419caef None admin] REQUEST_METHOD: `GET` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:11:54.449270 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0860d5-7e64-444e-9cd9-f3340419caef None admin] SCRIPT_NAME: `/identity` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:11:54.449528 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0860d5-7e64-444e-9cd9-f3340419caef None admin] PATH_INFO: `/v3/users/cinder` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:11:54.453388 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG dbcounter [-] [144067] Writing DB stats keystone:SELECT=100 {{(pid=144067) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:11:54.459530 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd0860d5-7e64-444e-9cd9-f3340419caef None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:11:54.462253 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd0860d5-7e64-444e-9cd9-f3340419caef None admin] RBAC: Authorization granted {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:11:54.471067 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605f8f79-9ef7-43af-9a70-bfb4e3f9c1a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:11:54.472000 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605f8f79-9ef7-43af-9a70-bfb4e3f9c1a9 None admin] REQUEST_METHOD: `GET` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:11:54.472470 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605f8f79-9ef7-43af-9a70-bfb4e3f9c1a9 None admin] SCRIPT_NAME: `/identity` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:11:54.472983 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605f8f79-9ef7-43af-9a70-bfb4e3f9c1a9 None admin] PATH_INFO: `/v3/domains` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:11:54.473877 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-605f8f79-9ef7-43af-9a70-bfb4e3f9c1a9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=144068) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:11:54.474340 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-605f8f79-9ef7-43af-9a70-bfb4e3f9c1a9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:11:54.474971 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application [None req-bd0860d5-7e64-444e-9cd9-f3340419caef None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jul 28 08:11:54.474971 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:11:54.474971 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:11:54.474971 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:11:54.474971 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:11:54.474971 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:11:54.474971 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:11:54.474971 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:11:54.474971 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:11:54.474971 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:11:54.474971 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:11:54.474971 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:11:54.474971 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 28 08:11:54.474971 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 28 08:11:54.474971 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 28 08:11:54.474971 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 28 08:11:54.476192 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:11:54.476192 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:11:54.476192 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 28 08:11:54.476192 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 08:11:54.476192 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 28 08:11:54.476192 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 08:11:54.476192 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:11:54.476192 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:11:54.476192 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:11:54.476192 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:11:54.476192 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:11:54.476192 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application with Lock( Jul 28 08:11:54.476192 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:11:54.476192 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:11:54.476192 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:11:54.476192 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:11:54.476192 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:11:54.476192 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:11:54.477285 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:11:54.477285 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:11:54.477285 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 28 08:11:54.477285 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 28 08:11:54.477285 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 28 08:11:54.477285 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 28 08:11:54.477285 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 28 08:11:54.477285 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 28 08:11:54.477285 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jul 28 08:11:54.477285 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application Jul 28 08:11:54.477285 dv-cinder-851351-1-smb devstack@keystone.service[144067]: [pid: 144067|app: 0|req: 295/592] 10.222.0.42 () {56 vars in 1099 bytes} [Thu Jul 28 08:11:54 2022] GET /identity/v3/users/cinder => generated 84 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:11:54.477285 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd0860d5-7e64-444e-9cd9-f3340419caef None admin] Authenticating user token {{(pid=144067) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:11:54.479095 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-605f8f79-9ef7-43af-9a70-bfb4e3f9c1a9 None admin] RBAC: Authorization granted {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:11:54.492165 dv-cinder-851351-1-smb devstack@keystone.service[144068]: [pid: 144068|app: 0|req: 298/593] 10.222.0.42 () {56 vars in 1109 bytes} [Thu Jul 28 08:11:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:11:54.494050 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c5e38b-90da-4643-8889-e1636dd5670d None None] REQUEST_METHOD: `GET` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:11:54.494050 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c5e38b-90da-4643-8889-e1636dd5670d None None] SCRIPT_NAME: `/identity` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:11:54.494423 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c5e38b-90da-4643-8889-e1636dd5670d None None] PATH_INFO: `/` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:11:54.495843 dv-cinder-851351-1-smb devstack@keystone.service[144068]: [pid: 144068|app: 0|req: 299/594] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 08:11:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 08:11:54.497621 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c5e38b-90da-4643-8889-e1636dd5670d None None] Authenticating user token {{(pid=144068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:11:54.582334 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG dbcounter [-] [144068] Writing DB stats keystone:SELECT=100 {{(pid=144068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:11:54.599809 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd0860d5-7e64-444e-9cd9-f3340419caef None admin] Validating token access rules against request {{(pid=144067) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:11:54.613738 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c5e38b-90da-4643-8889-e1636dd5670d None None] Validating token access rules against request {{(pid=144068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:11:54.641850 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12de6edd-7536-439d-99f6-0bb9c5e2cb76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144067) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:11:54.642913 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12de6edd-7536-439d-99f6-0bb9c5e2cb76 None admin] REQUEST_METHOD: `GET` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:11:54.643367 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12de6edd-7536-439d-99f6-0bb9c5e2cb76 None admin] SCRIPT_NAME: `/identity` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:11:54.643867 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12de6edd-7536-439d-99f6-0bb9c5e2cb76 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:11:54.654271 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2806c87a-ca39-4b9f-a1ba-cf935f76a82c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:11:54.654761 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2806c87a-ca39-4b9f-a1ba-cf935f76a82c None admin] REQUEST_METHOD: `GET` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:11:54.655044 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2806c87a-ca39-4b9f-a1ba-cf935f76a82c None admin] SCRIPT_NAME: `/identity` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:11:54.655316 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2806c87a-ca39-4b9f-a1ba-cf935f76a82c None admin] PATH_INFO: `/v3/users` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:11:54.656697 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12de6edd-7536-439d-99f6-0bb9c5e2cb76 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:11:54.657271 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2806c87a-ca39-4b9f-a1ba-cf935f76a82c None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=144068) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:11:54.657585 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2806c87a-ca39-4b9f-a1ba-cf935f76a82c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:11:54.658344 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12de6edd-7536-439d-99f6-0bb9c5e2cb76 None admin] RBAC: Authorization granted {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:11:54.659031 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2806c87a-ca39-4b9f-a1ba-cf935f76a82c None admin] RBAC: Authorization granted {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:11:54.675142 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application [None req-12de6edd-7536-439d-99f6-0bb9c5e2cb76 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 08:11:54.675142 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:11:54.675142 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:11:54.675142 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:11:54.675142 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:11:54.675142 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:11:54.675142 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:11:54.675142 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:11:54.675142 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:11:54.675142 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:11:54.675142 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:11:54.675142 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:11:54.675142 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 08:11:54.675142 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 08:11:54.675142 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 08:11:54.676208 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 08:11:54.676208 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:11:54.676208 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:11:54.676208 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:11:54.676208 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:11:54.676208 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:11:54.676208 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:11:54.676208 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:11:54.676208 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application with Lock( Jul 28 08:11:54.676208 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:11:54.676208 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:11:54.676208 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:11:54.676208 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:11:54.676208 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:11:54.676208 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:11:54.676208 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:11:54.676208 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:11:54.677610 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 08:11:54.677610 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 08:11:54.677610 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 08:11:54.677610 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application Jul 28 08:11:54.681031 dv-cinder-851351-1-smb devstack@keystone.service[144067]: [pid: 144067|app: 0|req: 296/595] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 08:11:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:11:54.682216 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12de6edd-7536-439d-99f6-0bb9c5e2cb76 None admin] Authenticating user token {{(pid=144067) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:11:54.682357 dv-cinder-851351-1-smb devstack@keystone.service[144068]: [pid: 144068|app: 0|req: 300/596] 10.222.0.42 () {56 vars in 1137 bytes} [Thu Jul 28 08:11:54 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:11:54.683566 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f86a8cc-8267-4819-b944-1a1ed7c8dde9 None None] REQUEST_METHOD: `POST` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:11:54.683853 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f86a8cc-8267-4819-b944-1a1ed7c8dde9 None None] SCRIPT_NAME: `/identity` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:11:54.684123 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f86a8cc-8267-4819-b944-1a1ed7c8dde9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:11:54.704886 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.auth.core [None req-7f86a8cc-8267-4819-b944-1a1ed7c8dde9 None None] MFA Rules not processed for user `bf5ceb8f07374635ad506b7d1b4f1612`. Rule list: `[]` (Enabled: `True`). {{(pid=144068) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 08:11:54.706188 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.fernet_utils [None req-7f86a8cc-8267-4819-b944-1a1ed7c8dde9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=144068) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:11:54.740924 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG dbcounter [-] [144067] Writing DB stats keystone:SELECT=100 {{(pid=144067) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:11:54.787633 dv-cinder-851351-1-smb devstack@keystone.service[144068]: [pid: 144068|app: 0|req: 301/597] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 08:11:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 08:11:54.788555 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f86a8cc-8267-4819-b944-1a1ed7c8dde9 None None] Authenticating user token {{(pid=144068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:11:54.821906 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12de6edd-7536-439d-99f6-0bb9c5e2cb76 None admin] Validating token access rules against request {{(pid=144067) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:11:54.858812 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG dbcounter [-] [144068] Writing DB stats keystone:SELECT=100 {{(pid=144068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:11:54.866714 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1350bcd9-c7d2-429a-a442-5dcbc143fe4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144067) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:11:54.867608 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1350bcd9-c7d2-429a-a442-5dcbc143fe4d None admin] REQUEST_METHOD: `GET` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:11:54.867911 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1350bcd9-c7d2-429a-a442-5dcbc143fe4d None admin] SCRIPT_NAME: `/identity` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:11:54.868186 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1350bcd9-c7d2-429a-a442-5dcbc143fe4d None admin] PATH_INFO: `/v3/projects/service` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:11:54.875600 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1350bcd9-c7d2-429a-a442-5dcbc143fe4d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:11:54.878106 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1350bcd9-c7d2-429a-a442-5dcbc143fe4d None admin] RBAC: Authorization granted {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:11:54.891786 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application [None req-1350bcd9-c7d2-429a-a442-5dcbc143fe4d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 08:11:54.891786 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:11:54.891786 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:11:54.891786 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:11:54.891786 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:11:54.891786 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:11:54.891786 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:11:54.891786 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:11:54.891786 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:11:54.891786 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:11:54.891786 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:11:54.891786 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:11:54.891786 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 28 08:11:54.891786 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 28 08:11:54.891786 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 28 08:11:54.893002 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 28 08:11:54.893002 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:11:54.893002 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:11:54.893002 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:11:54.893002 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:11:54.893002 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:11:54.893002 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:11:54.893002 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:11:54.893002 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application with Lock( Jul 28 08:11:54.893002 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:11:54.893002 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:11:54.893002 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:11:54.893002 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:11:54.893002 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:11:54.893002 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:11:54.893002 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:11:54.893002 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:11:54.893992 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 28 08:11:54.893992 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 28 08:11:54.893992 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 28 08:11:54.893992 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 28 08:11:54.893992 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 28 08:11:54.893992 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 28 08:11:54.893992 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 08:11:54.893992 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application Jul 28 08:11:54.893992 dv-cinder-851351-1-smb devstack@keystone.service[144067]: [pid: 144067|app: 0|req: 297/598] 10.222.0.42 () {56 vars in 1111 bytes} [Thu Jul 28 08:11:54 2022] GET /identity/v3/projects/service => generated 88 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:11:54.893992 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1350bcd9-c7d2-429a-a442-5dcbc143fe4d None admin] Authenticating user token {{(pid=144067) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:11:54.907033 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f86a8cc-8267-4819-b944-1a1ed7c8dde9 None None] Validating token access rules against request {{(pid=144068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:11:54.949793 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82682d2-06a3-4446-9c77-c75a49a3fab7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:11:54.950461 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82682d2-06a3-4446-9c77-c75a49a3fab7 None admin] REQUEST_METHOD: `GET` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:11:54.950749 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82682d2-06a3-4446-9c77-c75a49a3fab7 None admin] SCRIPT_NAME: `/identity` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:11:54.950997 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82682d2-06a3-4446-9c77-c75a49a3fab7 None admin] PATH_INFO: `/v3/domains` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:11:54.951703 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d82682d2-06a3-4446-9c77-c75a49a3fab7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=144068) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:11:54.952008 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d82682d2-06a3-4446-9c77-c75a49a3fab7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:11:54.953567 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d82682d2-06a3-4446-9c77-c75a49a3fab7 None admin] RBAC: Authorization granted {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:11:54.967156 dv-cinder-851351-1-smb devstack@keystone.service[144068]: [pid: 144068|app: 0|req: 302/599] 10.222.0.42 () {56 vars in 1109 bytes} [Thu Jul 28 08:11:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:11:54.968410 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82682d2-06a3-4446-9c77-c75a49a3fab7 None admin] Authenticating user token {{(pid=144068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:11:55.024239 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1350bcd9-c7d2-429a-a442-5dcbc143fe4d None admin] Validating token access rules against request {{(pid=144067) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:11:55.035455 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG dbcounter [-] [144067] Writing DB stats keystone:SELECT=100 {{(pid=144067) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:11:55.068802 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18fbc1fc-7868-444c-826a-84eee8eda6b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144067) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:11:55.069485 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18fbc1fc-7868-444c-826a-84eee8eda6b8 None admin] REQUEST_METHOD: `GET` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:11:55.069767 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18fbc1fc-7868-444c-826a-84eee8eda6b8 None admin] SCRIPT_NAME: `/identity` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:11:55.070045 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18fbc1fc-7868-444c-826a-84eee8eda6b8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:11:55.086265 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18fbc1fc-7868-444c-826a-84eee8eda6b8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:11:55.087969 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18fbc1fc-7868-444c-826a-84eee8eda6b8 None admin] RBAC: Authorization granted {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:11:55.102305 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82682d2-06a3-4446-9c77-c75a49a3fab7 None admin] Validating token access rules against request {{(pid=144068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:11:55.108196 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application [None req-18fbc1fc-7868-444c-826a-84eee8eda6b8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 08:11:55.108196 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:11:55.108196 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:11:55.108196 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:11:55.108196 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:11:55.108196 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:11:55.108196 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:11:55.108196 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:11:55.108196 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:11:55.108196 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:11:55.108196 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:11:55.108196 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:11:55.108196 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 08:11:55.108196 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 08:11:55.108196 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 08:11:55.109471 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 08:11:55.109471 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:11:55.109471 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:11:55.109471 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:11:55.109471 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:11:55.109471 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:11:55.109471 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:11:55.109471 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:11:55.109471 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application with Lock( Jul 28 08:11:55.109471 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:11:55.109471 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:11:55.109471 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:11:55.109471 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:11:55.109471 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:11:55.109471 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:11:55.109471 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:11:55.109471 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:11:55.110662 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 08:11:55.110662 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 08:11:55.110662 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 08:11:55.110662 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application Jul 28 08:11:55.111998 dv-cinder-851351-1-smb devstack@keystone.service[144067]: [pid: 144067|app: 0|req: 298/600] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 08:11:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:11:55.112296 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18fbc1fc-7868-444c-826a-84eee8eda6b8 None admin] Authenticating user token {{(pid=144067) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:11:55.132877 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG dbcounter [-] [144068] Writing DB stats keystone:SELECT=100 {{(pid=144068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:11:55.152205 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339e6fa5-6f85-4521-85b8-13771c29f522 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:11:55.153153 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339e6fa5-6f85-4521-85b8-13771c29f522 None admin] REQUEST_METHOD: `GET` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:11:55.153863 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339e6fa5-6f85-4521-85b8-13771c29f522 None admin] SCRIPT_NAME: `/identity` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:11:55.154149 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339e6fa5-6f85-4521-85b8-13771c29f522 None admin] PATH_INFO: `/v3/roles/service` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:11:55.172354 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-339e6fa5-6f85-4521-85b8-13771c29f522 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 08:11:55.178060 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application [None req-339e6fa5-6f85-4521-85b8-13771c29f522 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 28 08:11:55.178060 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:11:55.178060 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:11:55.178060 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:11:55.178060 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:11:55.178060 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:11:55.178060 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:11:55.178060 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:11:55.178060 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:11:55.178060 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:11:55.178060 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:11:55.178060 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:11:55.178060 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 08:11:55.178060 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 08:11:55.178060 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 08:11:55.178060 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 08:11:55.180077 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 08:11:55.180077 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 08:11:55.180077 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 08:11:55.180077 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 08:11:55.180077 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:11:55.180077 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:11:55.180077 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:11:55.180077 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:11:55.180077 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:11:55.180077 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:11:55.180077 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:11:55.180077 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application with Lock( Jul 28 08:11:55.180077 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:11:55.180077 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:11:55.180077 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:11:55.180077 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:11:55.181919 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:11:55.181919 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:11:55.181919 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:11:55.181919 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:11:55.181919 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 08:11:55.181919 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 08:11:55.181919 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 08:11:55.181919 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 08:11:55.181919 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 08:11:55.181919 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 08:11:55.181919 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 28 08:11:55.181919 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application Jul 28 08:11:55.181919 dv-cinder-851351-1-smb devstack@keystone.service[144068]: [pid: 144068|app: 0|req: 303/601] 10.222.0.42 () {56 vars in 1102 bytes} [Thu Jul 28 08:11:54 2022] GET /identity/v3/roles/service => generated 85 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:11:55.181919 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339e6fa5-6f85-4521-85b8-13771c29f522 None admin] Authenticating user token {{(pid=144068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:11:55.261305 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18fbc1fc-7868-444c-826a-84eee8eda6b8 None admin] Validating token access rules against request {{(pid=144067) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:11:55.305134 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4449ecc9-5d1c-4fcb-825f-6140ecae1c3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144067) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:11:55.305777 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4449ecc9-5d1c-4fcb-825f-6140ecae1c3f None admin] REQUEST_METHOD: `GET` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:11:55.306060 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4449ecc9-5d1c-4fcb-825f-6140ecae1c3f None admin] SCRIPT_NAME: `/identity` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:11:55.306333 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4449ecc9-5d1c-4fcb-825f-6140ecae1c3f None admin] PATH_INFO: `/v3/projects` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:11:55.306442 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339e6fa5-6f85-4521-85b8-13771c29f522 None admin] Validating token access rules against request {{(pid=144068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:11:55.307108 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4449ecc9-5d1c-4fcb-825f-6140ecae1c3f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=144067) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:11:55.307419 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4449ecc9-5d1c-4fcb-825f-6140ecae1c3f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:11:55.308940 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4449ecc9-5d1c-4fcb-825f-6140ecae1c3f None admin] RBAC: Authorization granted {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:11:55.326812 dv-cinder-851351-1-smb devstack@keystone.service[144067]: [pid: 144067|app: 0|req: 299/602] 10.222.0.42 () {56 vars in 1148 bytes} [Thu Jul 28 08:11:55 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:11:55.327663 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4449ecc9-5d1c-4fcb-825f-6140ecae1c3f None admin] Authenticating user token {{(pid=144067) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:11:55.349296 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7b3789-6364-49e8-b234-19952c9fda86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:11:55.349963 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7b3789-6364-49e8-b234-19952c9fda86 None admin] REQUEST_METHOD: `GET` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:11:55.350432 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7b3789-6364-49e8-b234-19952c9fda86 None admin] SCRIPT_NAME: `/identity` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:11:55.350858 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7b3789-6364-49e8-b234-19952c9fda86 None admin] PATH_INFO: `/v3/projects/service` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:11:55.351586 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG dbcounter [-] [144067] Writing DB stats keystone:SELECT=100 {{(pid=144067) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:11:55.359247 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c7b3789-6364-49e8-b234-19952c9fda86 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:11:55.361127 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c7b3789-6364-49e8-b234-19952c9fda86 None admin] RBAC: Authorization granted {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:11:55.374837 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application [None req-9c7b3789-6364-49e8-b234-19952c9fda86 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 08:11:55.374837 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:11:55.374837 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:11:55.374837 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:11:55.374837 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:11:55.374837 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:11:55.374837 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:11:55.374837 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:11:55.374837 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:11:55.374837 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:11:55.374837 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:11:55.374837 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:11:55.374837 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 28 08:11:55.374837 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 28 08:11:55.374837 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 28 08:11:55.376112 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 28 08:11:55.376112 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:11:55.376112 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:11:55.376112 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:11:55.376112 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:11:55.376112 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:11:55.376112 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:11:55.376112 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:11:55.376112 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application with Lock( Jul 28 08:11:55.376112 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:11:55.376112 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:11:55.376112 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:11:55.376112 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:11:55.376112 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:11:55.376112 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:11:55.376112 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:11:55.376112 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:11:55.377379 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 28 08:11:55.377379 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 28 08:11:55.377379 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 28 08:11:55.377379 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 28 08:11:55.377379 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 28 08:11:55.377379 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 28 08:11:55.377379 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 08:11:55.377379 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application Jul 28 08:11:55.377379 dv-cinder-851351-1-smb devstack@keystone.service[144068]: [pid: 144068|app: 0|req: 304/603] 10.222.0.42 () {56 vars in 1111 bytes} [Thu Jul 28 08:11:55 2022] GET /identity/v3/projects/service => generated 88 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:11:55.378374 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7b3789-6364-49e8-b234-19952c9fda86 None admin] Authenticating user token {{(pid=144068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:11:55.430548 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG dbcounter [-] [144068] Writing DB stats keystone:SELECT=100 {{(pid=144068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:11:55.441966 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4449ecc9-5d1c-4fcb-825f-6140ecae1c3f None admin] Validating token access rules against request {{(pid=144067) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:11:55.489361 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3405a4-ec32-4f07-aa44-74fe7e388993 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144067) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:11:55.490080 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3405a4-ec32-4f07-aa44-74fe7e388993 None admin] REQUEST_METHOD: `GET` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:11:55.490238 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3405a4-ec32-4f07-aa44-74fe7e388993 None admin] SCRIPT_NAME: `/identity` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:11:55.490509 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3405a4-ec32-4f07-aa44-74fe7e388993 None admin] PATH_INFO: `/v3/domains` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:11:55.491212 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff3405a4-ec32-4f07-aa44-74fe7e388993 None admin] RBAC: Adding query filter params (name=Default) {{(pid=144067) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:11:55.491521 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff3405a4-ec32-4f07-aa44-74fe7e388993 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:11:55.492993 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff3405a4-ec32-4f07-aa44-74fe7e388993 None admin] RBAC: Authorization granted {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:11:55.501472 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7b3789-6364-49e8-b234-19952c9fda86 None admin] Validating token access rules against request {{(pid=144068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:11:55.505368 dv-cinder-851351-1-smb devstack@keystone.service[144067]: [pid: 144067|app: 0|req: 300/604] 10.222.0.42 () {56 vars in 1109 bytes} [Thu Jul 28 08:11:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:11:55.506185 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3405a4-ec32-4f07-aa44-74fe7e388993 None admin] Authenticating user token {{(pid=144067) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:11:55.541137 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70773502-742e-4c0c-bc15-5c9d1514e0ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:11:55.542167 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70773502-742e-4c0c-bc15-5c9d1514e0ce None admin] REQUEST_METHOD: `GET` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:11:55.542604 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70773502-742e-4c0c-bc15-5c9d1514e0ce None admin] SCRIPT_NAME: `/identity` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:11:55.543068 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70773502-742e-4c0c-bc15-5c9d1514e0ce None admin] PATH_INFO: `/v3/roles` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:11:55.543948 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70773502-742e-4c0c-bc15-5c9d1514e0ce None admin] RBAC: Adding query filter params (name=service) {{(pid=144068) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:11:55.544523 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70773502-742e-4c0c-bc15-5c9d1514e0ce None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:11:55.546202 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70773502-742e-4c0c-bc15-5c9d1514e0ce None admin] RBAC: Authorization granted {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:11:55.555377 dv-cinder-851351-1-smb devstack@keystone.service[144068]: [pid: 144068|app: 0|req: 305/605] 10.222.0.42 () {56 vars in 1103 bytes} [Thu Jul 28 08:11:55 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:11:55.556590 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70773502-742e-4c0c-bc15-5c9d1514e0ce None admin] Authenticating user token {{(pid=144068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:11:55.602841 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG dbcounter [-] [144067] Writing DB stats keystone:SELECT=100 {{(pid=144067) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:11:55.623905 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3405a4-ec32-4f07-aa44-74fe7e388993 None admin] Validating token access rules against request {{(pid=144067) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:11:55.659493 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1577a77-fecb-4572-a0d0-060953697679 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144067) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:11:55.660310 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1577a77-fecb-4572-a0d0-060953697679 None admin] REQUEST_METHOD: `PUT` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:11:55.660622 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1577a77-fecb-4572-a0d0-060953697679 None admin] SCRIPT_NAME: `/identity` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:11:55.660932 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1577a77-fecb-4572-a0d0-060953697679 None admin] PATH_INFO: `/v3/projects/fa39ab7491e5413ca648e31ee9177fa0/users/05fa683ca43e40489a294d83584a0db9/roles/9aa6ce92dcbb4164ac0e44d2aa2a0248` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:11:55.669985 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70773502-742e-4c0c-bc15-5c9d1514e0ce None admin] Validating token access rules against request {{(pid=144068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:11:55.672600 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG dbcounter [-] [144068] Writing DB stats keystone:SELECT=100 {{(pid=144068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:11:55.678788 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1577a77-fecb-4572-a0d0-060953697679 None admin] RBAC: Authorizing `identity:create_grant(project_id=fa39ab7491e5413ca648e31ee9177fa0, user_id=05fa683ca43e40489a294d83584a0db9, role_id=9aa6ce92dcbb4164ac0e44d2aa2a0248)` {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:11:55.680271 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1577a77-fecb-4572-a0d0-060953697679 None admin] RBAC: Authorization granted {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:11:55.704699 dv-cinder-851351-1-smb devstack@keystone.service[144067]: [pid: 144067|app: 0|req: 301/606] 10.222.0.42 () {58 vars in 1439 bytes} [Thu Jul 28 08:11:55 2022] PUT /identity/v3/projects/fa39ab7491e5413ca648e31ee9177fa0/users/05fa683ca43e40489a294d83584a0db9/roles/9aa6ce92dcbb4164ac0e44d2aa2a0248 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 08:11:55.704699 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1577a77-fecb-4572-a0d0-060953697679 None admin] Authenticating user token {{(pid=144067) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:11:55.721780 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f22d77f-235f-4151-8f9b-26fb103da1e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:11:55.722437 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f22d77f-235f-4151-8f9b-26fb103da1e6 None admin] REQUEST_METHOD: `GET` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:11:55.722771 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f22d77f-235f-4151-8f9b-26fb103da1e6 None admin] SCRIPT_NAME: `/identity` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:11:55.723045 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f22d77f-235f-4151-8f9b-26fb103da1e6 None admin] PATH_INFO: `/v3/projects` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:11:55.723851 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f22d77f-235f-4151-8f9b-26fb103da1e6 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=144068) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:11:55.724180 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f22d77f-235f-4151-8f9b-26fb103da1e6 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:11:55.725874 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f22d77f-235f-4151-8f9b-26fb103da1e6 None admin] RBAC: Authorization granted {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:11:55.750376 dv-cinder-851351-1-smb devstack@keystone.service[144068]: [pid: 144068|app: 0|req: 306/607] 10.222.0.42 () {56 vars in 1148 bytes} [Thu Jul 28 08:11:55 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:11:55.750376 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f22d77f-235f-4151-8f9b-26fb103da1e6 None admin] Authenticating user token {{(pid=144068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:11:55.859801 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1577a77-fecb-4572-a0d0-060953697679 None admin] Validating token access rules against request {{(pid=144067) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:11:55.900487 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG dbcounter [-] [144067] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=144067) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:11:55.910083 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc19e07-048e-4c8d-9b1c-6d7a09babf79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144067) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:11:55.911218 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc19e07-048e-4c8d-9b1c-6d7a09babf79 None admin] REQUEST_METHOD: `GET` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:11:55.912295 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc19e07-048e-4c8d-9b1c-6d7a09babf79 None admin] SCRIPT_NAME: `/identity` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:11:55.912624 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc19e07-048e-4c8d-9b1c-6d7a09babf79 None admin] PATH_INFO: `/v3/projects/service` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:11:55.923457 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbc19e07-048e-4c8d-9b1c-6d7a09babf79 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:11:55.924984 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbc19e07-048e-4c8d-9b1c-6d7a09babf79 None admin] RBAC: Authorization granted {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:11:55.937781 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application [None req-bbc19e07-048e-4c8d-9b1c-6d7a09babf79 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 08:11:55.937781 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:11:55.937781 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:11:55.937781 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:11:55.937781 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:11:55.937781 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:11:55.937781 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:11:55.937781 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:11:55.937781 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:11:55.937781 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:11:55.937781 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:11:55.937781 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:11:55.937781 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 28 08:11:55.937781 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 28 08:11:55.937781 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 28 08:11:55.938813 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 28 08:11:55.938813 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:11:55.938813 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:11:55.938813 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:11:55.938813 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:11:55.938813 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:11:55.938813 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:11:55.938813 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:11:55.938813 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application with Lock( Jul 28 08:11:55.938813 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:11:55.938813 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:11:55.938813 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:11:55.938813 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:11:55.938813 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:11:55.938813 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:11:55.938813 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:11:55.938813 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:11:55.939799 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 28 08:11:55.939799 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 28 08:11:55.939799 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 28 08:11:55.939799 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 28 08:11:55.939799 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 28 08:11:55.939799 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 28 08:11:55.939799 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 08:11:55.939799 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application Jul 28 08:11:55.939799 dv-cinder-851351-1-smb devstack@keystone.service[144067]: [pid: 144067|app: 0|req: 302/608] 10.222.0.42 () {56 vars in 1111 bytes} [Thu Jul 28 08:11:55 2022] GET /identity/v3/projects/service => generated 88 bytes in 243 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:11:55.939799 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc19e07-048e-4c8d-9b1c-6d7a09babf79 None admin] Authenticating user token {{(pid=144067) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:11:55.946113 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f22d77f-235f-4151-8f9b-26fb103da1e6 None admin] Validating token access rules against request {{(pid=144068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:11:55.999224 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d32cf3b-7d18-489b-a01e-b54a3bce4e0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:11:56.000642 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d32cf3b-7d18-489b-a01e-b54a3bce4e0d None admin] REQUEST_METHOD: `GET` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:11:56.001568 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d32cf3b-7d18-489b-a01e-b54a3bce4e0d None admin] SCRIPT_NAME: `/identity` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:11:56.002060 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d32cf3b-7d18-489b-a01e-b54a3bce4e0d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:11:56.015231 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d32cf3b-7d18-489b-a01e-b54a3bce4e0d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:11:56.016732 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d32cf3b-7d18-489b-a01e-b54a3bce4e0d None admin] RBAC: Authorization granted {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:11:56.032753 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application [None req-9d32cf3b-7d18-489b-a01e-b54a3bce4e0d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 08:11:56.032753 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:11:56.032753 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:11:56.032753 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:11:56.032753 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:11:56.032753 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:11:56.032753 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:11:56.032753 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:11:56.032753 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:11:56.032753 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:11:56.032753 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:11:56.032753 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:11:56.032753 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 08:11:56.032753 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 08:11:56.032753 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 08:11:56.034053 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 08:11:56.034053 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:11:56.034053 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:11:56.034053 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:11:56.034053 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:11:56.034053 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:11:56.034053 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:11:56.034053 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:11:56.034053 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application with Lock( Jul 28 08:11:56.034053 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:11:56.034053 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:11:56.034053 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:11:56.034053 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:11:56.034053 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:11:56.034053 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:11:56.034053 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:11:56.034053 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:11:56.035085 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 08:11:56.035085 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 08:11:56.035085 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 08:11:56.035085 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application Jul 28 08:11:56.035085 dv-cinder-851351-1-smb devstack@keystone.service[144068]: [pid: 144068|app: 0|req: 307/609] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 08:11:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 284 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:11:56.035407 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d32cf3b-7d18-489b-a01e-b54a3bce4e0d None admin] Authenticating user token {{(pid=144068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:11:56.058975 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG dbcounter [-] [144068] Writing DB stats keystone:SELECT=100 {{(pid=144068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:11:56.071502 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc19e07-048e-4c8d-9b1c-6d7a09babf79 None admin] Validating token access rules against request {{(pid=144067) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:11:56.116333 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d36a28c8-7589-49c2-afba-24109129dcb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144067) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:11:56.117501 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36a28c8-7589-49c2-afba-24109129dcb7 None admin] REQUEST_METHOD: `PUT` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:11:56.118015 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36a28c8-7589-49c2-afba-24109129dcb7 None admin] SCRIPT_NAME: `/identity` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:11:56.118510 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36a28c8-7589-49c2-afba-24109129dcb7 None admin] PATH_INFO: `/v3/projects/fa39ab7491e5413ca648e31ee9177fa0/users/ccb4223a248b45fba8dff662f7260b21/roles/9aa6ce92dcbb4164ac0e44d2aa2a0248` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:11:56.135546 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d36a28c8-7589-49c2-afba-24109129dcb7 None admin] RBAC: Authorizing `identity:create_grant(project_id=fa39ab7491e5413ca648e31ee9177fa0, user_id=ccb4223a248b45fba8dff662f7260b21, role_id=9aa6ce92dcbb4164ac0e44d2aa2a0248)` {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:11:56.137274 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d36a28c8-7589-49c2-afba-24109129dcb7 None admin] RBAC: Authorization granted {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:11:56.153444 dv-cinder-851351-1-smb devstack@keystone.service[144067]: [pid: 144067|app: 0|req: 303/610] 10.222.0.42 () {58 vars in 1439 bytes} [Thu Jul 28 08:11:55 2022] PUT /identity/v3/projects/fa39ab7491e5413ca648e31ee9177fa0/users/ccb4223a248b45fba8dff662f7260b21/roles/9aa6ce92dcbb4164ac0e44d2aa2a0248 => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 08:11:56.154431 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d36a28c8-7589-49c2-afba-24109129dcb7 None admin] Authenticating user token {{(pid=144067) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:11:56.182060 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d32cf3b-7d18-489b-a01e-b54a3bce4e0d None admin] Validating token access rules against request {{(pid=144068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:11:56.233410 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a7c3a8-1881-49dc-8f92-1206e3992862 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:11:56.234241 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a7c3a8-1881-49dc-8f92-1206e3992862 None admin] REQUEST_METHOD: `GET` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:11:56.234620 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a7c3a8-1881-49dc-8f92-1206e3992862 None admin] SCRIPT_NAME: `/identity` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:11:56.235017 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a7c3a8-1881-49dc-8f92-1206e3992862 None admin] PATH_INFO: `/v3/projects` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:11:56.235980 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60a7c3a8-1881-49dc-8f92-1206e3992862 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=144068) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:11:56.236431 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60a7c3a8-1881-49dc-8f92-1206e3992862 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:11:56.238252 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60a7c3a8-1881-49dc-8f92-1206e3992862 None admin] RBAC: Authorization granted {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:11:56.241105 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG dbcounter [-] [144067] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=144067) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:11:56.255495 dv-cinder-851351-1-smb devstack@keystone.service[144068]: [pid: 144068|app: 0|req: 308/611] 10.222.0.42 () {56 vars in 1148 bytes} [Thu Jul 28 08:11:56 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:11:56.257213 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25cd60da-a58a-455d-a704-0b02034246a3 None None] REQUEST_METHOD: `GET` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:11:56.257608 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25cd60da-a58a-455d-a704-0b02034246a3 None None] SCRIPT_NAME: `/identity` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:11:56.258036 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25cd60da-a58a-455d-a704-0b02034246a3 None None] PATH_INFO: `/` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:11:56.262331 dv-cinder-851351-1-smb devstack@keystone.service[144068]: [pid: 144068|app: 0|req: 309/612] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 08:11:56 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 08:11:56.262331 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25cd60da-a58a-455d-a704-0b02034246a3 None None] Authenticating user token {{(pid=144068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:11:56.332076 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d36a28c8-7589-49c2-afba-24109129dcb7 None admin] Validating token access rules against request {{(pid=144067) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:11:56.377353 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18692a03-1fbd-434e-bae8-8e50abc4b1d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144067) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:11:56.377788 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG dbcounter [-] [144068] Writing DB stats keystone:SELECT=100 {{(pid=144068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:11:56.378474 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18692a03-1fbd-434e-bae8-8e50abc4b1d9 None admin] REQUEST_METHOD: `GET` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:11:56.379391 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18692a03-1fbd-434e-bae8-8e50abc4b1d9 None admin] SCRIPT_NAME: `/identity` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:11:56.379668 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18692a03-1fbd-434e-bae8-8e50abc4b1d9 None admin] PATH_INFO: `/v3/domains` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:11:56.380411 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18692a03-1fbd-434e-bae8-8e50abc4b1d9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=144067) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:11:56.381633 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18692a03-1fbd-434e-bae8-8e50abc4b1d9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:11:56.382788 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18692a03-1fbd-434e-bae8-8e50abc4b1d9 None admin] RBAC: Authorization granted {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:11:56.405923 dv-cinder-851351-1-smb devstack@keystone.service[144067]: [pid: 144067|app: 0|req: 304/613] 10.222.0.42 () {56 vars in 1109 bytes} [Thu Jul 28 08:11:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:11:56.412591 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca29fc2-50c4-4812-89cb-81e01002c423 None None] REQUEST_METHOD: `POST` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:11:56.413464 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca29fc2-50c4-4812-89cb-81e01002c423 None None] SCRIPT_NAME: `/identity` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:11:56.414139 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca29fc2-50c4-4812-89cb-81e01002c423 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:11:56.420656 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25cd60da-a58a-455d-a704-0b02034246a3 None None] Validating token access rules against request {{(pid=144068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:11:56.437314 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.auth.core [None req-fca29fc2-50c4-4812-89cb-81e01002c423 None None] MFA Rules not processed for user `bf5ceb8f07374635ad506b7d1b4f1612`. Rule list: `[]` (Enabled: `True`). {{(pid=144067) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 08:11:56.438801 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.fernet_utils [None req-fca29fc2-50c4-4812-89cb-81e01002c423 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=144067) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:11:56.459742 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58612a11-7416-4b83-b08a-09e4b017a8c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:11:56.461114 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58612a11-7416-4b83-b08a-09e4b017a8c5 None admin] REQUEST_METHOD: `PUT` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:11:56.461499 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58612a11-7416-4b83-b08a-09e4b017a8c5 None admin] SCRIPT_NAME: `/identity` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:11:56.461874 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58612a11-7416-4b83-b08a-09e4b017a8c5 None admin] PATH_INFO: `/v3/projects/fa39ab7491e5413ca648e31ee9177fa0/users/a576c39228684b6281a4087acad6a52a/roles/9aa6ce92dcbb4164ac0e44d2aa2a0248` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:11:56.479060 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58612a11-7416-4b83-b08a-09e4b017a8c5 None admin] RBAC: Authorizing `identity:create_grant(project_id=fa39ab7491e5413ca648e31ee9177fa0, user_id=a576c39228684b6281a4087acad6a52a, role_id=9aa6ce92dcbb4164ac0e44d2aa2a0248)` {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:11:56.480864 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58612a11-7416-4b83-b08a-09e4b017a8c5 None admin] RBAC: Authorization granted {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:11:56.498908 dv-cinder-851351-1-smb devstack@keystone.service[144068]: [pid: 144068|app: 0|req: 310/614] 10.222.0.42 () {58 vars in 1439 bytes} [Thu Jul 28 08:11:56 2022] PUT /identity/v3/projects/fa39ab7491e5413ca648e31ee9177fa0/users/a576c39228684b6281a4087acad6a52a/roles/9aa6ce92dcbb4164ac0e44d2aa2a0248 => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 08:11:56.500169 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58612a11-7416-4b83-b08a-09e4b017a8c5 None admin] Authenticating user token {{(pid=144068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:11:56.519817 dv-cinder-851351-1-smb devstack@keystone.service[144067]: [pid: 144067|app: 0|req: 305/615] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 08:11:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 08:11:56.562299 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca29fc2-50c4-4812-89cb-81e01002c423 None None] Authenticating user token {{(pid=144067) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:11:56.625131 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG dbcounter [-] [144067] Writing DB stats keystone:SELECT=100 {{(pid=144067) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:11:56.633120 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58612a11-7416-4b83-b08a-09e4b017a8c5 None admin] Validating token access rules against request {{(pid=144068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:11:56.664404 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG dbcounter [-] [144068] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=144068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:11:56.680752 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b2804d-fe1d-4ecd-9122-62595f7d6e7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:11:56.681449 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b2804d-fe1d-4ecd-9122-62595f7d6e7d None admin] REQUEST_METHOD: `GET` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:11:56.681736 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b2804d-fe1d-4ecd-9122-62595f7d6e7d None admin] SCRIPT_NAME: `/identity` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:11:56.682015 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b2804d-fe1d-4ecd-9122-62595f7d6e7d None admin] PATH_INFO: `/v3/users/nova` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:11:56.695170 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10b2804d-fe1d-4ecd-9122-62595f7d6e7d None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:11:56.697030 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10b2804d-fe1d-4ecd-9122-62595f7d6e7d None admin] RBAC: Authorization granted {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:11:56.713119 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application [None req-10b2804d-fe1d-4ecd-9122-62595f7d6e7d None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 28 08:11:56.713119 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:11:56.713119 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:11:56.713119 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:11:56.713119 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:11:56.713119 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:11:56.713119 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:11:56.713119 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:11:56.713119 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:11:56.713119 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:11:56.713119 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:11:56.713119 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:11:56.713119 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 28 08:11:56.713119 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 28 08:11:56.713119 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 28 08:11:56.713119 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 28 08:11:56.714266 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:11:56.714266 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:11:56.714266 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 28 08:11:56.714266 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 08:11:56.714266 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 28 08:11:56.714266 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 08:11:56.714266 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:11:56.714266 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:11:56.714266 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:11:56.714266 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:11:56.714266 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:11:56.714266 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application with Lock( Jul 28 08:11:56.714266 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:11:56.714266 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:11:56.714266 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:11:56.714266 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:11:56.714266 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:11:56.714266 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:11:56.715352 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:11:56.715352 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:11:56.715352 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 28 08:11:56.715352 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 28 08:11:56.715352 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 28 08:11:56.715352 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 28 08:11:56.715352 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 28 08:11:56.715352 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 28 08:11:56.715352 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 28 08:11:56.715352 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application Jul 28 08:11:56.715352 dv-cinder-851351-1-smb devstack@keystone.service[144068]: [pid: 144068|app: 0|req: 311/616] 10.222.0.42 () {56 vars in 1093 bytes} [Thu Jul 28 08:11:56 2022] GET /identity/v3/users/nova => generated 82 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:11:56.721045 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b2804d-fe1d-4ecd-9122-62595f7d6e7d None admin] Authenticating user token {{(pid=144068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:11:56.734571 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca29fc2-50c4-4812-89cb-81e01002c423 None None] Validating token access rules against request {{(pid=144067) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:11:56.779657 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b90048e-ba58-4ccd-b59f-0817f15853af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144067) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:11:56.779657 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b90048e-ba58-4ccd-b59f-0817f15853af None admin] REQUEST_METHOD: `GET` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:11:56.779657 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b90048e-ba58-4ccd-b59f-0817f15853af None admin] SCRIPT_NAME: `/identity` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:11:56.780063 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b90048e-ba58-4ccd-b59f-0817f15853af None admin] PATH_INFO: `/v3/roles/service` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:11:56.799400 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b90048e-ba58-4ccd-b59f-0817f15853af None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 08:11:56.807569 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application [None req-9b90048e-ba58-4ccd-b59f-0817f15853af None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 28 08:11:56.807569 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:11:56.807569 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:11:56.807569 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:11:56.807569 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:11:56.807569 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:11:56.807569 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:11:56.807569 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:11:56.807569 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:11:56.807569 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:11:56.807569 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:11:56.807569 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:11:56.807569 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 08:11:56.807569 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 08:11:56.807569 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 08:11:56.807569 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 08:11:56.808600 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 08:11:56.808600 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 08:11:56.808600 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 08:11:56.808600 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 08:11:56.808600 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:11:56.808600 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:11:56.808600 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:11:56.808600 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:11:56.808600 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:11:56.808600 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:11:56.808600 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:11:56.808600 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application with Lock( Jul 28 08:11:56.808600 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:11:56.808600 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:11:56.808600 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:11:56.808600 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:11:56.809573 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:11:56.809573 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:11:56.809573 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:11:56.809573 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:11:56.809573 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 08:11:56.809573 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 08:11:56.809573 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 08:11:56.809573 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 08:11:56.809573 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 08:11:56.809573 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 08:11:56.809573 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 28 08:11:56.809573 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application Jul 28 08:11:56.812460 dv-cinder-851351-1-smb devstack@keystone.service[144067]: [pid: 144067|app: 0|req: 306/617] 10.222.0.42 () {56 vars in 1102 bytes} [Thu Jul 28 08:11:56 2022] GET /identity/v3/roles/service => generated 85 bytes in 249 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 08:11:56.815999 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b90048e-ba58-4ccd-b59f-0817f15853af None admin] Authenticating user token {{(pid=144067) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:11:56.881594 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b2804d-fe1d-4ecd-9122-62595f7d6e7d None admin] Validating token access rules against request {{(pid=144068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:11:56.938309 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef91a258-1b90-4ad2-bf06-4a5e1c4325ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:11:56.939336 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef91a258-1b90-4ad2-bf06-4a5e1c4325ef None admin] REQUEST_METHOD: `GET` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:11:56.939838 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef91a258-1b90-4ad2-bf06-4a5e1c4325ef None admin] SCRIPT_NAME: `/identity` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:11:56.940337 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef91a258-1b90-4ad2-bf06-4a5e1c4325ef None admin] PATH_INFO: `/v3/users` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:11:56.941494 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef91a258-1b90-4ad2-bf06-4a5e1c4325ef None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=144068) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:11:56.942074 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef91a258-1b90-4ad2-bf06-4a5e1c4325ef None admin] RBAC: Authorizing `identity:list_users()` {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:11:56.943783 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef91a258-1b90-4ad2-bf06-4a5e1c4325ef None admin] RBAC: Authorization granted {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:11:56.964083 dv-cinder-851351-1-smb devstack@keystone.service[144068]: [pid: 144068|app: 0|req: 312/618] 10.222.0.42 () {56 vars in 1133 bytes} [Thu Jul 28 08:11:56 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:11:56.976507 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef91a258-1b90-4ad2-bf06-4a5e1c4325ef None admin] Authenticating user token {{(pid=144068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:11:56.991518 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG dbcounter [-] [144067] Writing DB stats keystone:SELECT=100 {{(pid=144067) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:11:57.002616 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b90048e-ba58-4ccd-b59f-0817f15853af None admin] Validating token access rules against request {{(pid=144067) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:11:57.053177 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb33609-7abc-47ab-bff6-7391f9895f97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144067) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:11:57.053687 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb33609-7abc-47ab-bff6-7391f9895f97 None admin] REQUEST_METHOD: `GET` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:11:57.054491 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb33609-7abc-47ab-bff6-7391f9895f97 None admin] SCRIPT_NAME: `/identity` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:11:57.054491 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb33609-7abc-47ab-bff6-7391f9895f97 None admin] PATH_INFO: `/v3/roles` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:11:57.055462 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beb33609-7abc-47ab-bff6-7391f9895f97 None admin] RBAC: Adding query filter params (name=service) {{(pid=144067) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:11:57.055462 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beb33609-7abc-47ab-bff6-7391f9895f97 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:11:57.057347 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beb33609-7abc-47ab-bff6-7391f9895f97 None admin] RBAC: Authorization granted {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:11:57.077093 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG dbcounter [-] [144068] Writing DB stats keystone:SELECT=100 {{(pid=144068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:11:57.083562 dv-cinder-851351-1-smb devstack@keystone.service[144067]: [pid: 144067|app: 0|req: 307/619] 10.222.0.42 () {56 vars in 1103 bytes} [Thu Jul 28 08:11:56 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:11:57.090022 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb33609-7abc-47ab-bff6-7391f9895f97 None admin] Authenticating user token {{(pid=144067) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:11:57.144743 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef91a258-1b90-4ad2-bf06-4a5e1c4325ef None admin] Validating token access rules against request {{(pid=144068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:11:57.201607 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eece752-1e63-4e52-af85-1794890260bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:11:57.202159 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eece752-1e63-4e52-af85-1794890260bf None admin] REQUEST_METHOD: `GET` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:11:57.202443 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eece752-1e63-4e52-af85-1794890260bf None admin] SCRIPT_NAME: `/identity` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:11:57.202714 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eece752-1e63-4e52-af85-1794890260bf None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:11:57.318623 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb33609-7abc-47ab-bff6-7391f9895f97 None admin] Validating token access rules against request {{(pid=144067) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:11:57.363366 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eece752-1e63-4e52-af85-1794890260bf None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:11:57.364896 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eece752-1e63-4e52-af85-1794890260bf None admin] RBAC: Authorization granted {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:11:57.407203 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36fcf64f-7637-419c-84b0-93f11bc6d146 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144067) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:11:57.408725 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fcf64f-7637-419c-84b0-93f11bc6d146 None admin] REQUEST_METHOD: `GET` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:11:57.409441 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fcf64f-7637-419c-84b0-93f11bc6d146 None admin] SCRIPT_NAME: `/identity` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:11:57.410166 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fcf64f-7637-419c-84b0-93f11bc6d146 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:11:57.415682 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG dbcounter [-] [144068] Writing DB stats keystone:SELECT=100 {{(pid=144068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:11:57.441668 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36fcf64f-7637-419c-84b0-93f11bc6d146 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:11:57.443567 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36fcf64f-7637-419c-84b0-93f11bc6d146 None admin] RBAC: Authorization granted {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:11:57.474473 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application [None req-36fcf64f-7637-419c-84b0-93f11bc6d146 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 08:11:57.474473 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:11:57.474473 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:11:57.474473 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:11:57.474473 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:11:57.474473 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:11:57.474473 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:11:57.474473 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:11:57.474473 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:11:57.474473 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:11:57.474473 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:11:57.474473 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:11:57.474473 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 08:11:57.474473 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 08:11:57.474473 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 08:11:57.475590 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 08:11:57.475590 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:11:57.475590 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:11:57.475590 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:11:57.475590 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:11:57.475590 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:11:57.475590 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:11:57.475590 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:11:57.475590 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application with Lock( Jul 28 08:11:57.475590 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:11:57.475590 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:11:57.475590 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:11:57.475590 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:11:57.475590 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:11:57.475590 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:11:57.475590 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:11:57.475590 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:11:57.476754 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 08:11:57.476754 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 08:11:57.476754 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 08:11:57.476754 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application Jul 28 08:11:57.482058 dv-cinder-851351-1-smb devstack@keystone.service[144067]: [pid: 144067|app: 0|req: 308/620] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 08:11:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 392 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 08:11:57.489735 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36fcf64f-7637-419c-84b0-93f11bc6d146 None admin] Authenticating user token {{(pid=144067) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:11:57.499324 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG dbcounter [-] [144067] Writing DB stats keystone:SELECT=100 {{(pid=144067) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:11:57.528655 dv-cinder-851351-1-smb devstack@keystone.service[144068]: [pid: 144068|app: 0|req: 313/621] 10.222.0.42 () {58 vars in 1282 bytes} [Thu Jul 28 08:11:56 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 552 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 28 08:11:57.534391 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eece752-1e63-4e52-af85-1794890260bf None admin] Authenticating user token {{(pid=144068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:11:57.709372 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eece752-1e63-4e52-af85-1794890260bf None admin] Validating token access rules against request {{(pid=144068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:11:57.730256 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36fcf64f-7637-419c-84b0-93f11bc6d146 None admin] Validating token access rules against request {{(pid=144067) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:11:57.829380 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b70b7be2-cfe0-4e59-8822-6f6a66e5e038 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:11:57.832126 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70b7be2-cfe0-4e59-8822-6f6a66e5e038 None admin] REQUEST_METHOD: `GET` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:11:57.834174 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70b7be2-cfe0-4e59-8822-6f6a66e5e038 None admin] SCRIPT_NAME: `/identity` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:11:57.834913 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70b7be2-cfe0-4e59-8822-6f6a66e5e038 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:11:57.856546 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af564038-79b1-4a8c-a715-886f14a2da9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144067) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:11:57.858065 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af564038-79b1-4a8c-a715-886f14a2da9e None admin] REQUEST_METHOD: `GET` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:11:57.858789 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af564038-79b1-4a8c-a715-886f14a2da9e None admin] SCRIPT_NAME: `/identity` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:11:57.859519 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af564038-79b1-4a8c-a715-886f14a2da9e None admin] PATH_INFO: `/v3/domains` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:11:57.861213 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af564038-79b1-4a8c-a715-886f14a2da9e None admin] RBAC: Adding query filter params (name=Default) {{(pid=144067) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:11:57.862021 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af564038-79b1-4a8c-a715-886f14a2da9e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:11:57.865013 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af564038-79b1-4a8c-a715-886f14a2da9e None admin] RBAC: Authorization granted {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:11:57.875370 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b70b7be2-cfe0-4e59-8822-6f6a66e5e038 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:11:57.880353 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b70b7be2-cfe0-4e59-8822-6f6a66e5e038 None admin] RBAC: Authorization granted {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:11:57.904275 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG dbcounter [-] [144068] Writing DB stats keystone:SELECT=100 {{(pid=144068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:11:57.918954 dv-cinder-851351-1-smb devstack@keystone.service[144067]: [pid: 144067|app: 0|req: 309/622] 10.222.0.42 () {56 vars in 1109 bytes} [Thu Jul 28 08:11:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 429 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:11:57.925361 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af564038-79b1-4a8c-a715-886f14a2da9e None admin] Authenticating user token {{(pid=144067) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:11:57.933837 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application [None req-b70b7be2-cfe0-4e59-8822-6f6a66e5e038 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 08:11:57.933837 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:11:57.933837 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:11:57.933837 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:11:57.933837 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:11:57.933837 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:11:57.933837 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:11:57.933837 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:11:57.933837 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:11:57.933837 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:11:57.933837 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:11:57.933837 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:11:57.933837 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 08:11:57.933837 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 08:11:57.933837 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 08:11:57.935262 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 08:11:57.935262 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:11:57.935262 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:11:57.935262 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:11:57.935262 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:11:57.935262 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:11:57.935262 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:11:57.935262 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:11:57.935262 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application with Lock( Jul 28 08:11:57.935262 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:11:57.935262 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:11:57.935262 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:11:57.935262 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:11:57.935262 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:11:57.935262 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:11:57.935262 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:11:57.935262 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:11:57.936741 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 08:11:57.936741 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 08:11:57.936741 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 08:11:57.936741 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application Jul 28 08:11:57.936741 dv-cinder-851351-1-smb devstack@keystone.service[144068]: [pid: 144068|app: 0|req: 314/623] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 08:11:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 402 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:11:57.949302 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b70b7be2-cfe0-4e59-8822-6f6a66e5e038 None admin] Authenticating user token {{(pid=144068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:11:58.087764 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG dbcounter [-] [144067] Writing DB stats keystone:SELECT=100 {{(pid=144067) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:11:58.165736 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af564038-79b1-4a8c-a715-886f14a2da9e None admin] Validating token access rules against request {{(pid=144067) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:11:58.218948 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b70b7be2-cfe0-4e59-8822-6f6a66e5e038 None admin] Validating token access rules against request {{(pid=144068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:11:58.221195 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd2a071a-d746-4932-9819-d784840a85df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144067) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:11:58.222327 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2a071a-d746-4932-9819-d784840a85df None admin] REQUEST_METHOD: `GET` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:11:58.222815 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2a071a-d746-4932-9819-d784840a85df None admin] SCRIPT_NAME: `/identity` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:11:58.224170 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2a071a-d746-4932-9819-d784840a85df None admin] PATH_INFO: `/v3/users/swift` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:11:58.232437 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd2a071a-d746-4932-9819-d784840a85df None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:11:58.234789 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd2a071a-d746-4932-9819-d784840a85df None admin] RBAC: Authorization granted {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:11:58.251865 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application [None req-fd2a071a-d746-4932-9819-d784840a85df None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 28 08:11:58.251865 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:11:58.251865 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:11:58.251865 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:11:58.251865 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:11:58.251865 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:11:58.251865 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:11:58.251865 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:11:58.251865 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:11:58.251865 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:11:58.251865 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:11:58.251865 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:11:58.251865 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 28 08:11:58.251865 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 28 08:11:58.251865 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 28 08:11:58.251865 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 28 08:11:58.254194 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:11:58.254194 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:11:58.254194 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 28 08:11:58.254194 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 08:11:58.254194 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 28 08:11:58.254194 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 08:11:58.254194 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:11:58.254194 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:11:58.254194 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:11:58.254194 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:11:58.254194 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:11:58.254194 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application with Lock( Jul 28 08:11:58.254194 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:11:58.254194 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:11:58.254194 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:11:58.254194 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:11:58.254194 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:11:58.254194 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:11:58.255513 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:11:58.255513 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:11:58.255513 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 28 08:11:58.255513 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 28 08:11:58.255513 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 28 08:11:58.255513 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 28 08:11:58.255513 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 28 08:11:58.255513 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 28 08:11:58.255513 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 28 08:11:58.255513 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application Jul 28 08:11:58.258322 dv-cinder-851351-1-smb devstack@keystone.service[144067]: [pid: 144067|app: 0|req: 310/624] 10.222.0.42 () {56 vars in 1096 bytes} [Thu Jul 28 08:11:57 2022] GET /identity/v3/users/swift => generated 83 bytes in 334 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:11:58.265718 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd2a071a-d746-4932-9819-d784840a85df None admin] Authenticating user token {{(pid=144067) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:11:58.308412 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f22dac-4ff2-4b84-8faa-fe8c81b22a25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:11:58.309402 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f22dac-4ff2-4b84-8faa-fe8c81b22a25 None admin] REQUEST_METHOD: `GET` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:11:58.309879 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f22dac-4ff2-4b84-8faa-fe8c81b22a25 None admin] SCRIPT_NAME: `/identity` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:11:58.310334 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f22dac-4ff2-4b84-8faa-fe8c81b22a25 None admin] PATH_INFO: `/v3/domains` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:11:58.311233 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f22dac-4ff2-4b84-8faa-fe8c81b22a25 None admin] RBAC: Adding query filter params (name=Default) {{(pid=144068) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:11:58.311706 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f22dac-4ff2-4b84-8faa-fe8c81b22a25 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:11:58.313293 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f22dac-4ff2-4b84-8faa-fe8c81b22a25 None admin] RBAC: Authorization granted {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:11:58.333025 dv-cinder-851351-1-smb devstack@keystone.service[144068]: [pid: 144068|app: 0|req: 315/625] 10.222.0.42 () {56 vars in 1109 bytes} [Thu Jul 28 08:11:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 389 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:11:58.339260 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f22dac-4ff2-4b84-8faa-fe8c81b22a25 None admin] Authenticating user token {{(pid=144068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:11:58.403999 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG dbcounter [-] [144068] Writing DB stats keystone:SELECT=100 {{(pid=144068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:11:58.455192 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f22dac-4ff2-4b84-8faa-fe8c81b22a25 None admin] Validating token access rules against request {{(pid=144068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:11:58.483397 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd2a071a-d746-4932-9819-d784840a85df None admin] Validating token access rules against request {{(pid=144067) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:11:58.493706 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9893677-7a61-4f95-b774-d9e76e1ec1d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:11:58.494751 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9893677-7a61-4f95-b774-d9e76e1ec1d0 None admin] REQUEST_METHOD: `GET` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:11:58.495246 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9893677-7a61-4f95-b774-d9e76e1ec1d0 None admin] SCRIPT_NAME: `/identity` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:11:58.495747 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9893677-7a61-4f95-b774-d9e76e1ec1d0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:11:58.503444 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9893677-7a61-4f95-b774-d9e76e1ec1d0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:11:58.505355 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9893677-7a61-4f95-b774-d9e76e1ec1d0 None admin] RBAC: Authorization granted {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:11:58.518557 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application [None req-b9893677-7a61-4f95-b774-d9e76e1ec1d0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 08:11:58.518557 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:11:58.518557 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:11:58.518557 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:11:58.518557 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:11:58.518557 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:11:58.518557 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:11:58.518557 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:11:58.518557 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:11:58.518557 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:11:58.518557 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:11:58.518557 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:11:58.518557 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 28 08:11:58.518557 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 28 08:11:58.518557 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 28 08:11:58.519700 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 28 08:11:58.519700 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:11:58.519700 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:11:58.519700 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:11:58.519700 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:11:58.519700 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:11:58.519700 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:11:58.519700 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:11:58.519700 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application with Lock( Jul 28 08:11:58.519700 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:11:58.519700 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:11:58.519700 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:11:58.519700 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:11:58.519700 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:11:58.519700 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:11:58.519700 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:11:58.519700 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:11:58.520716 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 28 08:11:58.520716 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 28 08:11:58.520716 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 28 08:11:58.520716 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 28 08:11:58.520716 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 28 08:11:58.520716 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 28 08:11:58.520716 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 08:11:58.520716 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application Jul 28 08:11:58.523328 dv-cinder-851351-1-smb devstack@keystone.service[144068]: [pid: 144068|app: 0|req: 316/626] 10.222.0.42 () {56 vars in 1111 bytes} [Thu Jul 28 08:11:58 2022] GET /identity/v3/projects/service => generated 88 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 08:11:58.529277 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG dbcounter [-] [144067] Writing DB stats keystone:SELECT=100 {{(pid=144067) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:11:58.529673 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9893677-7a61-4f95-b774-d9e76e1ec1d0 None admin] Authenticating user token {{(pid=144068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:11:58.553456 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0acf814a-b535-47d5-86d9-a7db0396fd08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144067) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:11:58.554123 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0acf814a-b535-47d5-86d9-a7db0396fd08 None admin] REQUEST_METHOD: `GET` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:11:58.554417 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0acf814a-b535-47d5-86d9-a7db0396fd08 None admin] SCRIPT_NAME: `/identity` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:11:58.554725 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0acf814a-b535-47d5-86d9-a7db0396fd08 None admin] PATH_INFO: `/v3/users` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:11:58.555522 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0acf814a-b535-47d5-86d9-a7db0396fd08 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=144067) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:11:58.555834 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0acf814a-b535-47d5-86d9-a7db0396fd08 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:11:58.557374 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0acf814a-b535-47d5-86d9-a7db0396fd08 None admin] RBAC: Authorization granted {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:11:58.576657 dv-cinder-851351-1-smb devstack@keystone.service[144067]: [pid: 144067|app: 0|req: 311/627] 10.222.0.42 () {56 vars in 1135 bytes} [Thu Jul 28 08:11:58 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 311 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 08:11:58.577756 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b095594-f177-436d-b3cd-1d94bd25599f None None] REQUEST_METHOD: `GET` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:11:58.578041 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b095594-f177-436d-b3cd-1d94bd25599f None None] SCRIPT_NAME: `/identity` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:11:58.578330 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b095594-f177-436d-b3cd-1d94bd25599f None None] PATH_INFO: `/` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:11:58.583112 dv-cinder-851351-1-smb devstack@keystone.service[144067]: [pid: 144067|app: 0|req: 312/628] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 08:11:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 08:11:58.583112 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb280343-6c00-4aaf-8da7-da1421ce7791 None None] REQUEST_METHOD: `GET` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:11:58.583112 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb280343-6c00-4aaf-8da7-da1421ce7791 None None] SCRIPT_NAME: `/identity` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:11:58.583112 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb280343-6c00-4aaf-8da7-da1421ce7791 None None] PATH_INFO: `/` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:11:58.583112 dv-cinder-851351-1-smb devstack@keystone.service[144067]: [pid: 144067|app: 0|req: 313/629] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 08:11:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 08:11:58.583924 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb280343-6c00-4aaf-8da7-da1421ce7791 None None] Authenticating user token {{(pid=144067) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:11:58.660721 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9893677-7a61-4f95-b774-d9e76e1ec1d0 None admin] Validating token access rules against request {{(pid=144068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:11:58.679736 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG dbcounter [-] [144068] Writing DB stats keystone:SELECT=100 {{(pid=144068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:11:58.702224 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e9daee-02d6-4795-a10b-29a118f942c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:11:58.702498 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb280343-6c00-4aaf-8da7-da1421ce7791 None None] Validating token access rules against request {{(pid=144067) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:11:58.702871 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e9daee-02d6-4795-a10b-29a118f942c8 None admin] REQUEST_METHOD: `GET` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:11:58.703161 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e9daee-02d6-4795-a10b-29a118f942c8 None admin] SCRIPT_NAME: `/identity` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:11:58.703441 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e9daee-02d6-4795-a10b-29a118f942c8 None admin] PATH_INFO: `/v3/projects` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:11:58.704225 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e9daee-02d6-4795-a10b-29a118f942c8 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=144068) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:11:58.704535 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e9daee-02d6-4795-a10b-29a118f942c8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:11:58.706127 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e9daee-02d6-4795-a10b-29a118f942c8 None admin] RBAC: Authorization granted {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:11:58.720721 dv-cinder-851351-1-smb devstack@keystone.service[144068]: [pid: 144068|app: 0|req: 317/630] 10.222.0.42 () {56 vars in 1148 bytes} [Thu Jul 28 08:11:58 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:11:58.721419 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a61229-afa4-47f4-9f75-0a3ba3847f95 None None] REQUEST_METHOD: `POST` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:11:58.721638 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a61229-afa4-47f4-9f75-0a3ba3847f95 None None] SCRIPT_NAME: `/identity` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:11:58.721870 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a61229-afa4-47f4-9f75-0a3ba3847f95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:11:58.740540 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.auth.core [None req-e1a61229-afa4-47f4-9f75-0a3ba3847f95 None None] MFA Rules not processed for user `bf5ceb8f07374635ad506b7d1b4f1612`. Rule list: `[]` (Enabled: `True`). {{(pid=144068) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 08:11:58.741807 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.fernet_utils [None req-e1a61229-afa4-47f4-9f75-0a3ba3847f95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=144068) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:11:58.747783 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74df10cd-56bc-4495-ac42-5a3afa95a108 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144067) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:11:58.748480 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74df10cd-56bc-4495-ac42-5a3afa95a108 None admin] REQUEST_METHOD: `GET` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:11:58.748797 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74df10cd-56bc-4495-ac42-5a3afa95a108 None admin] SCRIPT_NAME: `/identity` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:11:58.749079 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74df10cd-56bc-4495-ac42-5a3afa95a108 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:11:58.760394 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74df10cd-56bc-4495-ac42-5a3afa95a108 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:11:58.761872 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74df10cd-56bc-4495-ac42-5a3afa95a108 None admin] RBAC: Authorization granted {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:11:58.777544 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application [None req-74df10cd-56bc-4495-ac42-5a3afa95a108 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 08:11:58.777544 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:11:58.777544 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:11:58.777544 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:11:58.777544 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:11:58.777544 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:11:58.777544 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:11:58.777544 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:11:58.777544 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:11:58.777544 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:11:58.777544 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:11:58.777544 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:11:58.777544 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 08:11:58.777544 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 08:11:58.777544 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 08:11:58.778598 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 08:11:58.778598 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:11:58.778598 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:11:58.778598 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:11:58.778598 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:11:58.778598 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:11:58.778598 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:11:58.778598 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:11:58.778598 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application with Lock( Jul 28 08:11:58.778598 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:11:58.778598 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:11:58.778598 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:11:58.778598 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:11:58.778598 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:11:58.778598 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:11:58.778598 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:11:58.778598 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:11:58.779651 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 08:11:58.779651 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 08:11:58.779651 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 08:11:58.779651 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application Jul 28 08:11:58.779651 dv-cinder-851351-1-smb devstack@keystone.service[144067]: [pid: 144067|app: 0|req: 314/631] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 08:11:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:11:58.780515 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2f07bd-5870-4a2a-8ab3-ca5fb5815c37 None None] REQUEST_METHOD: `POST` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:11:58.780631 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2f07bd-5870-4a2a-8ab3-ca5fb5815c37 None None] SCRIPT_NAME: `/identity` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:11:58.780894 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2f07bd-5870-4a2a-8ab3-ca5fb5815c37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:11:58.802069 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.auth.core [None req-ec2f07bd-5870-4a2a-8ab3-ca5fb5815c37 None None] MFA Rules not processed for user `bf5ceb8f07374635ad506b7d1b4f1612`. Rule list: `[]` (Enabled: `True`). {{(pid=144067) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 08:11:58.803409 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.fernet_utils [None req-ec2f07bd-5870-4a2a-8ab3-ca5fb5815c37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=144067) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:11:58.828711 dv-cinder-851351-1-smb devstack@keystone.service[144068]: [pid: 144068|app: 0|req: 318/632] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 08:11:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 08:11:58.828711 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a61229-afa4-47f4-9f75-0a3ba3847f95 None None] Authenticating user token {{(pid=144068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:11:58.840624 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG dbcounter [-] [144067] Writing DB stats keystone:SELECT=100 {{(pid=144067) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:11:58.888712 dv-cinder-851351-1-smb devstack@keystone.service[144067]: [pid: 144067|app: 0|req: 315/633] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 08:11:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 08:11:58.889923 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2f07bd-5870-4a2a-8ab3-ca5fb5815c37 None None] Authenticating user token {{(pid=144067) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:11:58.959494 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a61229-afa4-47f4-9f75-0a3ba3847f95 None None] Validating token access rules against request {{(pid=144068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:11:58.968838 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG dbcounter [-] [144068] Writing DB stats keystone:SELECT=100 {{(pid=144068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:11:58.999711 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa1b4623-c76d-49ce-83ad-2efe6c012f14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:11:59.000356 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1b4623-c76d-49ce-83ad-2efe6c012f14 None admin] REQUEST_METHOD: `GET` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:11:59.000639 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1b4623-c76d-49ce-83ad-2efe6c012f14 None admin] SCRIPT_NAME: `/identity` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:11:59.000959 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1b4623-c76d-49ce-83ad-2efe6c012f14 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:11:59.001777 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa1b4623-c76d-49ce-83ad-2efe6c012f14 None admin] RBAC: Adding query filter params (role.id=9aa6ce92dcbb4164ac0e44d2aa2a0248, scope.project.id=fa39ab7491e5413ca648e31ee9177fa0, user.id=2c1de9cd80344cefa3e06ae8c9c9e5d9) {{(pid=144068) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:11:59.002090 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa1b4623-c76d-49ce-83ad-2efe6c012f14 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:11:59.003562 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa1b4623-c76d-49ce-83ad-2efe6c012f14 None admin] RBAC: Authorization granted {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:11:59.009932 dv-cinder-851351-1-smb devstack@keystone.service[144068]: [pid: 144068|app: 0|req: 319/634] 10.222.0.42 () {56 vars in 1374 bytes} [Thu Jul 28 08:11:58 2022] GET /identity/v3/role_assignments?user.id=2c1de9cd80344cefa3e06ae8c9c9e5d9&scope.project.id=fa39ab7491e5413ca648e31ee9177fa0&role.id=9aa6ce92dcbb4164ac0e44d2aa2a0248 => generated 608 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:11:59.010839 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa1b4623-c76d-49ce-83ad-2efe6c012f14 None admin] Authenticating user token {{(pid=144068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:11:59.011251 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2f07bd-5870-4a2a-8ab3-ca5fb5815c37 None None] Validating token access rules against request {{(pid=144067) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:11:59.060685 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e675be5-cfec-4c39-96b1-abdf7ed07759 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144067) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:11:59.061369 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e675be5-cfec-4c39-96b1-abdf7ed07759 None admin] REQUEST_METHOD: `GET` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:11:59.061653 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e675be5-cfec-4c39-96b1-abdf7ed07759 None admin] SCRIPT_NAME: `/identity` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:11:59.061932 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e675be5-cfec-4c39-96b1-abdf7ed07759 None admin] PATH_INFO: `/v3/domains` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:11:59.063250 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e675be5-cfec-4c39-96b1-abdf7ed07759 None admin] RBAC: Adding query filter params (name=Default) {{(pid=144067) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:11:59.063592 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e675be5-cfec-4c39-96b1-abdf7ed07759 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:11:59.065911 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e675be5-cfec-4c39-96b1-abdf7ed07759 None admin] RBAC: Authorization granted {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:11:59.082000 dv-cinder-851351-1-smb devstack@keystone.service[144067]: [pid: 144067|app: 0|req: 316/635] 10.222.0.42 () {56 vars in 1109 bytes} [Thu Jul 28 08:11:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:11:59.082982 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e675be5-cfec-4c39-96b1-abdf7ed07759 None admin] Authenticating user token {{(pid=144067) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:11:59.114326 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG dbcounter [-] [144067] Writing DB stats keystone:SELECT=100 {{(pid=144067) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:11:59.140555 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa1b4623-c76d-49ce-83ad-2efe6c012f14 None admin] Validating token access rules against request {{(pid=144068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:11:59.181984 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6361bbc-1342-4ea9-afc6-f4f85fc40845 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:11:59.182767 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6361bbc-1342-4ea9-afc6-f4f85fc40845 None admin] REQUEST_METHOD: `GET` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:11:59.183049 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6361bbc-1342-4ea9-afc6-f4f85fc40845 None admin] SCRIPT_NAME: `/identity` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:11:59.183322 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6361bbc-1342-4ea9-afc6-f4f85fc40845 None admin] PATH_INFO: `/v3/roles/service` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:11:59.197092 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6361bbc-1342-4ea9-afc6-f4f85fc40845 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 08:11:59.202757 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application [None req-f6361bbc-1342-4ea9-afc6-f4f85fc40845 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 28 08:11:59.202757 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:11:59.202757 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:11:59.202757 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:11:59.202757 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:11:59.202757 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:11:59.202757 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:11:59.202757 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:11:59.202757 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:11:59.202757 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:11:59.202757 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:11:59.202757 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:11:59.202757 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 08:11:59.202757 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 08:11:59.202757 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 08:11:59.202757 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 08:11:59.203976 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 08:11:59.203976 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 08:11:59.203976 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 08:11:59.203976 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 08:11:59.203976 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:11:59.203976 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:11:59.203976 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:11:59.203976 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:11:59.203976 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:11:59.203976 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:11:59.203976 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:11:59.203976 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application with Lock( Jul 28 08:11:59.203976 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:11:59.203976 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:11:59.203976 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:11:59.203976 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:11:59.205010 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:11:59.205010 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:11:59.205010 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:11:59.205010 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:11:59.205010 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 08:11:59.205010 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 08:11:59.205010 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 08:11:59.205010 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 08:11:59.205010 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 08:11:59.205010 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 08:11:59.205010 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 28 08:11:59.205010 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application Jul 28 08:11:59.205010 dv-cinder-851351-1-smb devstack@keystone.service[144068]: [pid: 144068|app: 0|req: 320/636] 10.222.0.42 () {56 vars in 1102 bytes} [Thu Jul 28 08:11:59 2022] GET /identity/v3/roles/service => generated 85 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:11:59.205919 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8875ab4c-88dd-47ab-bad5-49a45432f8dd None None] REQUEST_METHOD: `GET` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:11:59.206530 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8875ab4c-88dd-47ab-bad5-49a45432f8dd None None] SCRIPT_NAME: `/identity` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:11:59.206530 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8875ab4c-88dd-47ab-bad5-49a45432f8dd None None] PATH_INFO: `/` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:11:59.207353 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e675be5-cfec-4c39-96b1-abdf7ed07759 None admin] Validating token access rules against request {{(pid=144067) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:11:59.212965 dv-cinder-851351-1-smb devstack@keystone.service[144068]: [pid: 144068|app: 0|req: 321/637] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 08:11:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 08:11:59.212965 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8875ab4c-88dd-47ab-bad5-49a45432f8dd None None] Authenticating user token {{(pid=144068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:11:59.249855 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG dbcounter [-] [144068] Writing DB stats keystone:SELECT=100 {{(pid=144068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:11:59.253827 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3630d4f-6f12-47de-8066-fcef1bcc363d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144067) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:11:59.254976 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3630d4f-6f12-47de-8066-fcef1bcc363d None admin] REQUEST_METHOD: `GET` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:11:59.255443 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3630d4f-6f12-47de-8066-fcef1bcc363d None admin] SCRIPT_NAME: `/identity` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:11:59.256721 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3630d4f-6f12-47de-8066-fcef1bcc363d None admin] PATH_INFO: `/v3/roles/service` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:11:59.277142 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3630d4f-6f12-47de-8066-fcef1bcc363d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 08:11:59.282732 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application [None req-b3630d4f-6f12-47de-8066-fcef1bcc363d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 28 08:11:59.282732 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:11:59.282732 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:11:59.282732 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:11:59.282732 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:11:59.282732 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:11:59.282732 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:11:59.282732 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:11:59.282732 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:11:59.282732 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:11:59.282732 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:11:59.282732 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:11:59.282732 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 08:11:59.282732 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 08:11:59.282732 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 08:11:59.282732 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 08:11:59.284433 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 08:11:59.284433 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 08:11:59.284433 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 08:11:59.284433 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 08:11:59.284433 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:11:59.284433 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:11:59.284433 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:11:59.284433 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:11:59.284433 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:11:59.284433 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:11:59.284433 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:11:59.284433 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application with Lock( Jul 28 08:11:59.284433 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:11:59.284433 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:11:59.284433 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:11:59.284433 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:11:59.285588 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:11:59.285588 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:11:59.285588 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:11:59.285588 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:11:59.285588 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 08:11:59.285588 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 08:11:59.285588 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 08:11:59.285588 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 08:11:59.285588 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 08:11:59.285588 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 08:11:59.285588 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 28 08:11:59.285588 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application Jul 28 08:11:59.285588 dv-cinder-851351-1-smb devstack@keystone.service[144067]: [pid: 144067|app: 0|req: 317/638] 10.222.0.42 () {56 vars in 1102 bytes} [Thu Jul 28 08:11:59 2022] GET /identity/v3/roles/service => generated 85 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:11:59.285588 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3630d4f-6f12-47de-8066-fcef1bcc363d None admin] Authenticating user token {{(pid=144067) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:11:59.353004 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8875ab4c-88dd-47ab-bad5-49a45432f8dd None None] Validating token access rules against request {{(pid=144068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:11:59.393469 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc65963-ee75-4568-a321-4ea4e78c9563 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:11:59.394160 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc65963-ee75-4568-a321-4ea4e78c9563 None admin] REQUEST_METHOD: `GET` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:11:59.394434 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc65963-ee75-4568-a321-4ea4e78c9563 None admin] SCRIPT_NAME: `/identity` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:11:59.394697 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc65963-ee75-4568-a321-4ea4e78c9563 None admin] PATH_INFO: `/v3/projects/service` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:11:59.402164 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cc65963-ee75-4568-a321-4ea4e78c9563 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:11:59.403674 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cc65963-ee75-4568-a321-4ea4e78c9563 None admin] RBAC: Authorization granted {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:11:59.417415 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application [None req-5cc65963-ee75-4568-a321-4ea4e78c9563 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 08:11:59.417415 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:11:59.417415 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:11:59.417415 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:11:59.417415 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:11:59.417415 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:11:59.417415 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:11:59.417415 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:11:59.417415 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:11:59.417415 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:11:59.417415 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:11:59.417415 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:11:59.417415 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 28 08:11:59.417415 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 28 08:11:59.417415 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 28 08:11:59.418618 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 28 08:11:59.418618 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:11:59.418618 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:11:59.418618 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:11:59.418618 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:11:59.418618 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:11:59.418618 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:11:59.418618 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:11:59.418618 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application with Lock( Jul 28 08:11:59.418618 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:11:59.418618 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:11:59.418618 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:11:59.418618 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:11:59.418618 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:11:59.418618 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:11:59.418618 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:11:59.418618 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:11:59.420313 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 28 08:11:59.420313 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 28 08:11:59.420313 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 28 08:11:59.420313 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 28 08:11:59.420313 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 28 08:11:59.420313 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 28 08:11:59.420313 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 08:11:59.420313 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application Jul 28 08:11:59.420313 dv-cinder-851351-1-smb devstack@keystone.service[144068]: [pid: 144068|app: 0|req: 322/639] 10.222.0.42 () {56 vars in 1111 bytes} [Thu Jul 28 08:11:59 2022] GET /identity/v3/projects/service => generated 88 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:11:59.420313 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3155909-53ba-4da3-a97b-dce3a0ecd38d None None] REQUEST_METHOD: `POST` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:11:59.420313 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3155909-53ba-4da3-a97b-dce3a0ecd38d None None] SCRIPT_NAME: `/identity` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:11:59.421223 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3155909-53ba-4da3-a97b-dce3a0ecd38d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:11:59.425288 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG dbcounter [-] [144067] Writing DB stats keystone:SELECT=100 {{(pid=144067) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:11:59.445461 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3630d4f-6f12-47de-8066-fcef1bcc363d None admin] Validating token access rules against request {{(pid=144067) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:11:59.446360 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.auth.core [None req-e3155909-53ba-4da3-a97b-dce3a0ecd38d None None] MFA Rules not processed for user `bf5ceb8f07374635ad506b7d1b4f1612`. Rule list: `[]` (Enabled: `True`). {{(pid=144068) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 08:11:59.448704 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.fernet_utils [None req-e3155909-53ba-4da3-a97b-dce3a0ecd38d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=144068) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:11:59.484373 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0921e9dc-d7e0-4b30-8c43-a20acbaaa6d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144067) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:11:59.485062 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0921e9dc-d7e0-4b30-8c43-a20acbaaa6d8 None admin] REQUEST_METHOD: `GET` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:11:59.485357 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0921e9dc-d7e0-4b30-8c43-a20acbaaa6d8 None admin] SCRIPT_NAME: `/identity` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:11:59.485616 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0921e9dc-d7e0-4b30-8c43-a20acbaaa6d8 None admin] PATH_INFO: `/v3/roles` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:11:59.486356 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0921e9dc-d7e0-4b30-8c43-a20acbaaa6d8 None admin] RBAC: Adding query filter params (name=service) {{(pid=144067) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:11:59.486668 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0921e9dc-d7e0-4b30-8c43-a20acbaaa6d8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:11:59.488091 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0921e9dc-d7e0-4b30-8c43-a20acbaaa6d8 None admin] RBAC: Authorization granted {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:11:59.499403 dv-cinder-851351-1-smb devstack@keystone.service[144067]: [pid: 144067|app: 0|req: 318/640] 10.222.0.42 () {56 vars in 1103 bytes} [Thu Jul 28 08:11:59 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:11:59.500903 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0921e9dc-d7e0-4b30-8c43-a20acbaaa6d8 None admin] Authenticating user token {{(pid=144067) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:11:59.547859 dv-cinder-851351-1-smb devstack@keystone.service[144068]: [pid: 144068|app: 0|req: 323/641] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 08:11:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 08:11:59.548655 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3155909-53ba-4da3-a97b-dce3a0ecd38d None None] Authenticating user token {{(pid=144068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:11:59.582889 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG dbcounter [-] [144068] Writing DB stats keystone:SELECT=100 {{(pid=144068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:11:59.629865 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0921e9dc-d7e0-4b30-8c43-a20acbaaa6d8 None admin] Validating token access rules against request {{(pid=144067) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:11:59.669079 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1170616-b5e6-4a76-8f0c-6b2dd98c229a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144067) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:11:59.669732 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1170616-b5e6-4a76-8f0c-6b2dd98c229a None admin] REQUEST_METHOD: `GET` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:11:59.670031 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1170616-b5e6-4a76-8f0c-6b2dd98c229a None admin] SCRIPT_NAME: `/identity` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:11:59.670298 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1170616-b5e6-4a76-8f0c-6b2dd98c229a None admin] PATH_INFO: `/v3/roles` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:11:59.671042 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1170616-b5e6-4a76-8f0c-6b2dd98c229a None admin] RBAC: Adding query filter params (name=service) {{(pid=144067) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:11:59.671352 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1170616-b5e6-4a76-8f0c-6b2dd98c229a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:11:59.672800 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1170616-b5e6-4a76-8f0c-6b2dd98c229a None admin] RBAC: Authorization granted {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:11:59.676976 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3155909-53ba-4da3-a97b-dce3a0ecd38d None None] Validating token access rules against request {{(pid=144068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:11:59.687029 dv-cinder-851351-1-smb devstack@keystone.service[144067]: [pid: 144067|app: 0|req: 319/642] 10.222.0.42 () {56 vars in 1103 bytes} [Thu Jul 28 08:11:59 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:11:59.687029 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1170616-b5e6-4a76-8f0c-6b2dd98c229a None admin] Authenticating user token {{(pid=144067) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:11:59.699397 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG dbcounter [-] [144067] Writing DB stats keystone:SELECT=100 {{(pid=144067) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:11:59.720996 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c6ce86-e643-4e32-951a-17806c3ae6a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:11:59.721637 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c6ce86-e643-4e32-951a-17806c3ae6a7 None admin] REQUEST_METHOD: `GET` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:11:59.721933 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c6ce86-e643-4e32-951a-17806c3ae6a7 None admin] SCRIPT_NAME: `/identity` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:11:59.722193 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c6ce86-e643-4e32-951a-17806c3ae6a7 None admin] PATH_INFO: `/v3/projects` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:11:59.723021 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19c6ce86-e643-4e32-951a-17806c3ae6a7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=144068) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:11:59.723317 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19c6ce86-e643-4e32-951a-17806c3ae6a7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:11:59.724809 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19c6ce86-e643-4e32-951a-17806c3ae6a7 None admin] RBAC: Authorization granted {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:11:59.743551 dv-cinder-851351-1-smb devstack@keystone.service[144068]: [pid: 144068|app: 0|req: 324/643] 10.222.0.42 () {56 vars in 1148 bytes} [Thu Jul 28 08:11:59 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:11:59.743551 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c6ce86-e643-4e32-951a-17806c3ae6a7 None admin] Authenticating user token {{(pid=144068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:11:59.804537 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1170616-b5e6-4a76-8f0c-6b2dd98c229a None admin] Validating token access rules against request {{(pid=144067) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:11:59.839174 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG dbcounter [-] [144068] Writing DB stats keystone:SELECT=100 {{(pid=144068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:11:59.841591 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19dbc538-447a-42a2-b4be-501f34cb0f38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144067) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:11:59.842329 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19dbc538-447a-42a2-b4be-501f34cb0f38 None admin] REQUEST_METHOD: `GET` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:11:59.842619 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19dbc538-447a-42a2-b4be-501f34cb0f38 None admin] SCRIPT_NAME: `/identity` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:11:59.842807 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19dbc538-447a-42a2-b4be-501f34cb0f38 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:11:59.854935 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19dbc538-447a-42a2-b4be-501f34cb0f38 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:11:59.856639 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19dbc538-447a-42a2-b4be-501f34cb0f38 None admin] RBAC: Authorization granted {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:11:59.859769 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c6ce86-e643-4e32-951a-17806c3ae6a7 None admin] Validating token access rules against request {{(pid=144068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:11:59.871447 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application [None req-19dbc538-447a-42a2-b4be-501f34cb0f38 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 08:11:59.871447 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:11:59.871447 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:11:59.871447 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:11:59.871447 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:11:59.871447 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:11:59.871447 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:11:59.871447 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:11:59.871447 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:11:59.871447 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:11:59.871447 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:11:59.871447 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:11:59.871447 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 08:11:59.871447 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 08:11:59.871447 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 08:11:59.872555 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 08:11:59.872555 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:11:59.872555 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:11:59.872555 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:11:59.872555 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:11:59.872555 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:11:59.872555 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:11:59.872555 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:11:59.872555 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application with Lock( Jul 28 08:11:59.872555 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:11:59.872555 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:11:59.872555 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:11:59.872555 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:11:59.872555 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:11:59.872555 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:11:59.872555 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:11:59.872555 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:11:59.873591 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 08:11:59.873591 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 08:11:59.873591 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 08:11:59.873591 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application Jul 28 08:11:59.873591 dv-cinder-851351-1-smb devstack@keystone.service[144067]: [pid: 144067|app: 0|req: 320/644] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 08:11:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:11:59.873914 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19dbc538-447a-42a2-b4be-501f34cb0f38 None admin] Authenticating user token {{(pid=144067) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:11:59.907309 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb6f5a77-5e96-43f3-9c79-0e0a615eba75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:11:59.908228 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6f5a77-5e96-43f3-9c79-0e0a615eba75 None admin] REQUEST_METHOD: `GET` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:11:59.908487 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6f5a77-5e96-43f3-9c79-0e0a615eba75 None admin] SCRIPT_NAME: `/identity` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:11:59.909233 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6f5a77-5e96-43f3-9c79-0e0a615eba75 None admin] PATH_INFO: `/v3/roles/service` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:11:59.922908 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb6f5a77-5e96-43f3-9c79-0e0a615eba75 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 08:11:59.928422 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application [None req-eb6f5a77-5e96-43f3-9c79-0e0a615eba75 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 28 08:11:59.928422 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:11:59.928422 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:11:59.928422 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:11:59.928422 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:11:59.928422 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:11:59.928422 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:11:59.928422 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:11:59.928422 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:11:59.928422 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:11:59.928422 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:11:59.928422 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:11:59.928422 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 08:11:59.928422 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 08:11:59.928422 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 08:11:59.928422 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 08:11:59.929477 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 08:11:59.929477 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 08:11:59.929477 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 08:11:59.929477 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 08:11:59.929477 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:11:59.929477 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:11:59.929477 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:11:59.929477 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:11:59.929477 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:11:59.929477 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:11:59.929477 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:11:59.929477 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application with Lock( Jul 28 08:11:59.929477 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:11:59.929477 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:11:59.929477 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:11:59.929477 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:11:59.930449 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:11:59.930449 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:11:59.930449 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:11:59.930449 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:11:59.930449 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 08:11:59.930449 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 08:11:59.930449 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 08:11:59.930449 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 08:11:59.930449 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 08:11:59.930449 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 08:11:59.930449 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 28 08:11:59.930449 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application Jul 28 08:11:59.934920 dv-cinder-851351-1-smb devstack@keystone.service[144068]: [pid: 144068|app: 0|req: 325/645] 10.222.0.42 () {56 vars in 1102 bytes} [Thu Jul 28 08:11:59 2022] GET /identity/v3/roles/service => generated 85 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:11:59.935549 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb6f5a77-5e96-43f3-9c79-0e0a615eba75 None admin] Authenticating user token {{(pid=144068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:11:59.942581 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG dbcounter [-] [144067] Writing DB stats keystone:SELECT=100 {{(pid=144067) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:11:59.991697 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19dbc538-447a-42a2-b4be-501f34cb0f38 None admin] Validating token access rules against request {{(pid=144067) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:12:00.027826 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a36045-70c0-4d0f-bcdd-4e7e35569776 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144067) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:12:00.028473 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a36045-70c0-4d0f-bcdd-4e7e35569776 None admin] REQUEST_METHOD: `GET` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:12:00.028788 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a36045-70c0-4d0f-bcdd-4e7e35569776 None admin] SCRIPT_NAME: `/identity` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:12:00.029067 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a36045-70c0-4d0f-bcdd-4e7e35569776 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:12:00.040050 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3a36045-70c0-4d0f-bcdd-4e7e35569776 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:12:00.041583 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3a36045-70c0-4d0f-bcdd-4e7e35569776 None admin] RBAC: Authorization granted {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:12:00.056342 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application [None req-e3a36045-70c0-4d0f-bcdd-4e7e35569776 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 08:12:00.056342 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:12:00.056342 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:12:00.056342 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:12:00.056342 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:12:00.056342 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:12:00.056342 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:12:00.056342 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:12:00.056342 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:12:00.056342 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:12:00.056342 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:12:00.056342 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:12:00.056342 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 08:12:00.056342 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 08:12:00.056342 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 08:12:00.058169 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 08:12:00.058169 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:12:00.058169 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:12:00.058169 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:12:00.058169 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:12:00.058169 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:12:00.058169 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:12:00.058169 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:12:00.058169 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application with Lock( Jul 28 08:12:00.058169 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:12:00.058169 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:12:00.058169 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:12:00.058169 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:12:00.058169 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:12:00.058169 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:12:00.058169 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:12:00.058169 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:12:00.060363 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 08:12:00.060363 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 08:12:00.060363 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 08:12:00.060363 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application Jul 28 08:12:00.062177 dv-cinder-851351-1-smb devstack@keystone.service[144067]: [pid: 144067|app: 0|req: 321/646] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 08:11:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:12:00.063055 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a36045-70c0-4d0f-bcdd-4e7e35569776 None admin] Authenticating user token {{(pid=144067) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:12:00.076028 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb6f5a77-5e96-43f3-9c79-0e0a615eba75 None admin] Validating token access rules against request {{(pid=144068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:12:00.114311 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edbf3a96-7e75-4407-bea0-483c2b6756ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:12:00.115315 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbf3a96-7e75-4407-bea0-483c2b6756ba None admin] REQUEST_METHOD: `PUT` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:12:00.115315 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbf3a96-7e75-4407-bea0-483c2b6756ba None admin] SCRIPT_NAME: `/identity` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:12:00.115564 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbf3a96-7e75-4407-bea0-483c2b6756ba None admin] PATH_INFO: `/v3/projects/fa39ab7491e5413ca648e31ee9177fa0/users/fffb2166afc14796bc3c9c9eba793ec0/roles/9aa6ce92dcbb4164ac0e44d2aa2a0248` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:12:00.128436 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG dbcounter [-] [144068] Writing DB stats keystone:SELECT=100 {{(pid=144068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:12:00.133029 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edbf3a96-7e75-4407-bea0-483c2b6756ba None admin] RBAC: Authorizing `identity:create_grant(project_id=fa39ab7491e5413ca648e31ee9177fa0, user_id=fffb2166afc14796bc3c9c9eba793ec0, role_id=9aa6ce92dcbb4164ac0e44d2aa2a0248)` {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:12:00.135717 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edbf3a96-7e75-4407-bea0-483c2b6756ba None admin] RBAC: Authorization granted {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:12:00.152594 dv-cinder-851351-1-smb devstack@keystone.service[144068]: [pid: 144068|app: 0|req: 326/647] 10.222.0.42 () {58 vars in 1439 bytes} [Thu Jul 28 08:11:59 2022] PUT /identity/v3/projects/fa39ab7491e5413ca648e31ee9177fa0/users/fffb2166afc14796bc3c9c9eba793ec0/roles/9aa6ce92dcbb4164ac0e44d2aa2a0248 => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 08:12:00.153608 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edbf3a96-7e75-4407-bea0-483c2b6756ba None admin] Authenticating user token {{(pid=144068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:12:00.186067 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a36045-70c0-4d0f-bcdd-4e7e35569776 None admin] Validating token access rules against request {{(pid=144067) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:12:00.204602 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG dbcounter [-] [144067] Writing DB stats keystone:SELECT=100 {{(pid=144067) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:12:00.235545 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32cd1c1c-3ce6-44c0-a40b-50298fc0d69a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144067) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:12:00.236879 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32cd1c1c-3ce6-44c0-a40b-50298fc0d69a None admin] REQUEST_METHOD: `GET` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:12:00.237462 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32cd1c1c-3ce6-44c0-a40b-50298fc0d69a None admin] SCRIPT_NAME: `/identity` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:12:00.237985 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32cd1c1c-3ce6-44c0-a40b-50298fc0d69a None admin] PATH_INFO: `/v3/domains` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:12:00.239025 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32cd1c1c-3ce6-44c0-a40b-50298fc0d69a None admin] RBAC: Adding query filter params (name=Default) {{(pid=144067) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:12:00.239546 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32cd1c1c-3ce6-44c0-a40b-50298fc0d69a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:12:00.241559 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32cd1c1c-3ce6-44c0-a40b-50298fc0d69a None admin] RBAC: Authorization granted {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:12:00.266363 dv-cinder-851351-1-smb devstack@keystone.service[144067]: [pid: 144067|app: 0|req: 322/648] 10.222.0.42 () {56 vars in 1109 bytes} [Thu Jul 28 08:12:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:12:00.267665 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32cd1c1c-3ce6-44c0-a40b-50298fc0d69a None admin] Authenticating user token {{(pid=144067) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:12:00.310166 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edbf3a96-7e75-4407-bea0-483c2b6756ba None admin] Validating token access rules against request {{(pid=144068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:12:00.365758 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c2b5670-8fb3-449b-b1e2-bc3b9e9da6f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:12:00.366402 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2b5670-8fb3-449b-b1e2-bc3b9e9da6f9 None admin] REQUEST_METHOD: `GET` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:12:00.366687 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2b5670-8fb3-449b-b1e2-bc3b9e9da6f9 None admin] SCRIPT_NAME: `/identity` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:12:00.366964 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2b5670-8fb3-449b-b1e2-bc3b9e9da6f9 None admin] PATH_INFO: `/v3/roles` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:12:00.367711 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c2b5670-8fb3-449b-b1e2-bc3b9e9da6f9 None admin] RBAC: Adding query filter params (name=service) {{(pid=144068) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:12:00.368021 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c2b5670-8fb3-449b-b1e2-bc3b9e9da6f9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:12:00.369547 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c2b5670-8fb3-449b-b1e2-bc3b9e9da6f9 None admin] RBAC: Authorization granted {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:12:00.382103 dv-cinder-851351-1-smb devstack@keystone.service[144068]: [pid: 144068|app: 0|req: 327/649] 10.222.0.42 () {56 vars in 1103 bytes} [Thu Jul 28 08:12:00 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:12:00.382863 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c2b5670-8fb3-449b-b1e2-bc3b9e9da6f9 None admin] Authenticating user token {{(pid=144068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:12:00.408608 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32cd1c1c-3ce6-44c0-a40b-50298fc0d69a None admin] Validating token access rules against request {{(pid=144067) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:12:00.444296 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG dbcounter [-] [144068] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=144068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:12:00.449228 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-145ca146-b526-4686-9b58-ea2fa84ec91c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144067) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:12:00.450163 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145ca146-b526-4686-9b58-ea2fa84ec91c None admin] REQUEST_METHOD: `GET` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:12:00.450609 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145ca146-b526-4686-9b58-ea2fa84ec91c None admin] SCRIPT_NAME: `/identity` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:12:00.451048 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145ca146-b526-4686-9b58-ea2fa84ec91c None admin] PATH_INFO: `/v3/domains` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:12:00.451942 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-145ca146-b526-4686-9b58-ea2fa84ec91c None admin] RBAC: Adding query filter params (name=Default) {{(pid=144067) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:12:00.452425 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-145ca146-b526-4686-9b58-ea2fa84ec91c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:12:00.454784 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-145ca146-b526-4686-9b58-ea2fa84ec91c None admin] RBAC: Authorization granted {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:12:00.471693 dv-cinder-851351-1-smb devstack@keystone.service[144067]: [pid: 144067|app: 0|req: 323/650] 10.222.0.42 () {56 vars in 1109 bytes} [Thu Jul 28 08:12:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:12:00.477565 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-145ca146-b526-4686-9b58-ea2fa84ec91c None admin] Authenticating user token {{(pid=144067) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:12:00.499007 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c2b5670-8fb3-449b-b1e2-bc3b9e9da6f9 None admin] Validating token access rules against request {{(pid=144068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:12:00.526042 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG dbcounter [-] [144067] Writing DB stats keystone:SELECT=100 {{(pid=144067) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:12:00.536606 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c4faf0-b6f8-4042-b123-de783eaeefc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:12:00.537429 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c4faf0-b6f8-4042-b123-de783eaeefc9 None admin] REQUEST_METHOD: `GET` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:12:00.537718 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c4faf0-b6f8-4042-b123-de783eaeefc9 None admin] SCRIPT_NAME: `/identity` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:12:00.537997 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c4faf0-b6f8-4042-b123-de783eaeefc9 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:12:00.547350 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99c4faf0-b6f8-4042-b123-de783eaeefc9 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:12:00.548944 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99c4faf0-b6f8-4042-b123-de783eaeefc9 None admin] RBAC: Authorization granted {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:12:00.563476 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application [None req-99c4faf0-b6f8-4042-b123-de783eaeefc9 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jul 28 08:12:00.563476 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:12:00.563476 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:12:00.563476 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:12:00.563476 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:12:00.563476 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:12:00.563476 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:12:00.563476 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:12:00.563476 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:12:00.563476 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:12:00.563476 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:12:00.563476 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:12:00.563476 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 28 08:12:00.563476 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 28 08:12:00.563476 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 28 08:12:00.563476 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 28 08:12:00.564818 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:12:00.564818 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:12:00.564818 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 28 08:12:00.564818 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 08:12:00.564818 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 28 08:12:00.564818 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 08:12:00.564818 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:12:00.564818 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:12:00.564818 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:12:00.564818 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:12:00.564818 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:12:00.564818 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application with Lock( Jul 28 08:12:00.564818 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:12:00.564818 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:12:00.564818 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:12:00.564818 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:12:00.564818 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:12:00.564818 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:12:00.566018 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:12:00.566018 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:12:00.566018 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 28 08:12:00.566018 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 28 08:12:00.566018 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 28 08:12:00.566018 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 28 08:12:00.566018 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 28 08:12:00.566018 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 28 08:12:00.566018 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jul 28 08:12:00.566018 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application Jul 28 08:12:00.566018 dv-cinder-851351-1-smb devstack@keystone.service[144068]: [pid: 144068|app: 0|req: 328/651] 10.222.0.42 () {56 vars in 1102 bytes} [Thu Jul 28 08:12:00 2022] GET /identity/v3/users/neutron => generated 85 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:12:00.570241 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c4faf0-b6f8-4042-b123-de783eaeefc9 None admin] Authenticating user token {{(pid=144068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:12:00.600678 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-145ca146-b526-4686-9b58-ea2fa84ec91c None admin] Validating token access rules against request {{(pid=144067) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:12:00.640574 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f21b046-dd00-43a3-9363-968ba01ad65e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144067) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:12:00.641575 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f21b046-dd00-43a3-9363-968ba01ad65e None admin] REQUEST_METHOD: `GET` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:12:00.642128 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f21b046-dd00-43a3-9363-968ba01ad65e None admin] SCRIPT_NAME: `/identity` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:12:00.642550 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f21b046-dd00-43a3-9363-968ba01ad65e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:12:00.655551 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f21b046-dd00-43a3-9363-968ba01ad65e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:12:00.657560 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f21b046-dd00-43a3-9363-968ba01ad65e None admin] RBAC: Authorization granted {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:12:00.674683 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application [None req-7f21b046-dd00-43a3-9363-968ba01ad65e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 08:12:00.674683 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:12:00.674683 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:12:00.674683 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:12:00.674683 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:12:00.674683 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:12:00.674683 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:12:00.674683 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:12:00.674683 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:12:00.674683 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:12:00.674683 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:12:00.674683 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:12:00.674683 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 08:12:00.674683 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 08:12:00.674683 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 08:12:00.676029 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 08:12:00.676029 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:12:00.676029 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:12:00.676029 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:12:00.676029 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:12:00.676029 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:12:00.676029 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:12:00.676029 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:12:00.676029 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application with Lock( Jul 28 08:12:00.676029 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:12:00.676029 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:12:00.676029 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:12:00.676029 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:12:00.676029 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:12:00.676029 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:12:00.676029 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:12:00.676029 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:12:00.677264 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 08:12:00.677264 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 08:12:00.677264 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 08:12:00.677264 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application Jul 28 08:12:00.679276 dv-cinder-851351-1-smb devstack@keystone.service[144067]: [pid: 144067|app: 0|req: 324/652] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 08:12:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:12:00.680342 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f21b046-dd00-43a3-9363-968ba01ad65e None admin] Authenticating user token {{(pid=144067) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:12:00.688223 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c4faf0-b6f8-4042-b123-de783eaeefc9 None admin] Validating token access rules against request {{(pid=144068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:12:00.703498 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG dbcounter [-] [144068] Writing DB stats keystone:SELECT=100 {{(pid=144068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:12:00.729481 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-960a4ba3-69fd-430f-94e1-19de275d3fe5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:12:00.729970 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960a4ba3-69fd-430f-94e1-19de275d3fe5 None admin] REQUEST_METHOD: `GET` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:12:00.730257 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960a4ba3-69fd-430f-94e1-19de275d3fe5 None admin] SCRIPT_NAME: `/identity` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:12:00.730537 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960a4ba3-69fd-430f-94e1-19de275d3fe5 None admin] PATH_INFO: `/v3/users/glance` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:12:00.740165 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-960a4ba3-69fd-430f-94e1-19de275d3fe5 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:12:00.741797 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-960a4ba3-69fd-430f-94e1-19de275d3fe5 None admin] RBAC: Authorization granted {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:12:00.755459 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application [None req-960a4ba3-69fd-430f-94e1-19de275d3fe5 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jul 28 08:12:00.755459 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:12:00.755459 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:12:00.755459 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:12:00.755459 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:12:00.755459 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:12:00.755459 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:12:00.755459 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:12:00.755459 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:12:00.755459 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:12:00.755459 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:12:00.755459 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:12:00.755459 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 28 08:12:00.755459 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 28 08:12:00.755459 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 28 08:12:00.755459 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 28 08:12:00.756806 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:12:00.756806 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:12:00.756806 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 28 08:12:00.756806 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 08:12:00.756806 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 28 08:12:00.756806 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 08:12:00.756806 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:12:00.756806 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:12:00.756806 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:12:00.756806 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:12:00.756806 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:12:00.756806 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application with Lock( Jul 28 08:12:00.756806 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:12:00.756806 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:12:00.756806 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:12:00.756806 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:12:00.756806 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:12:00.756806 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:12:00.758020 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:12:00.758020 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:12:00.758020 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 28 08:12:00.758020 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 28 08:12:00.758020 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 28 08:12:00.758020 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 28 08:12:00.758020 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 28 08:12:00.758020 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 28 08:12:00.758020 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jul 28 08:12:00.758020 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application Jul 28 08:12:00.761030 dv-cinder-851351-1-smb devstack@keystone.service[144068]: [pid: 144068|app: 0|req: 329/653] 10.222.0.42 () {56 vars in 1099 bytes} [Thu Jul 28 08:12:00 2022] GET /identity/v3/users/glance => generated 84 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:12:00.761962 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-960a4ba3-69fd-430f-94e1-19de275d3fe5 None admin] Authenticating user token {{(pid=144068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:12:00.790413 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG dbcounter [-] [144067] Writing DB stats keystone:SELECT=100 {{(pid=144067) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:12:00.809364 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f21b046-dd00-43a3-9363-968ba01ad65e None admin] Validating token access rules against request {{(pid=144067) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:12:00.850762 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe01d35-47e3-428a-aeca-97e8734e8953 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144067) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:12:00.851721 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe01d35-47e3-428a-aeca-97e8734e8953 None admin] REQUEST_METHOD: `GET` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:12:00.852189 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe01d35-47e3-428a-aeca-97e8734e8953 None admin] SCRIPT_NAME: `/identity` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:12:00.852640 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe01d35-47e3-428a-aeca-97e8734e8953 None admin] PATH_INFO: `/v3/users` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:12:00.853776 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abe01d35-47e3-428a-aeca-97e8734e8953 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=144067) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:12:00.854254 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abe01d35-47e3-428a-aeca-97e8734e8953 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:12:00.856067 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abe01d35-47e3-428a-aeca-97e8734e8953 None admin] RBAC: Authorization granted {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:12:00.877386 dv-cinder-851351-1-smb devstack@keystone.service[144067]: [pid: 144067|app: 0|req: 325/654] 10.222.0.42 () {56 vars in 1139 bytes} [Thu Jul 28 08:12:00 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:12:00.878652 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe01d35-47e3-428a-aeca-97e8734e8953 None admin] Authenticating user token {{(pid=144067) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:12:00.886890 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-960a4ba3-69fd-430f-94e1-19de275d3fe5 None admin] Validating token access rules against request {{(pid=144068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:12:00.927636 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22850082-9fb6-4ffd-b4d8-e6f04a2402dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:12:00.928299 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22850082-9fb6-4ffd-b4d8-e6f04a2402dd None admin] REQUEST_METHOD: `GET` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:12:00.928586 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22850082-9fb6-4ffd-b4d8-e6f04a2402dd None admin] SCRIPT_NAME: `/identity` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:12:00.929232 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22850082-9fb6-4ffd-b4d8-e6f04a2402dd None admin] PATH_INFO: `/v3/domains` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:12:00.929738 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22850082-9fb6-4ffd-b4d8-e6f04a2402dd None admin] RBAC: Adding query filter params (name=Default) {{(pid=144068) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:12:00.930054 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22850082-9fb6-4ffd-b4d8-e6f04a2402dd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:12:00.931583 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22850082-9fb6-4ffd-b4d8-e6f04a2402dd None admin] RBAC: Authorization granted {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:12:00.945903 dv-cinder-851351-1-smb devstack@keystone.service[144068]: [pid: 144068|app: 0|req: 330/655] 10.222.0.42 () {56 vars in 1109 bytes} [Thu Jul 28 08:12:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:12:00.946902 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22850082-9fb6-4ffd-b4d8-e6f04a2402dd None admin] Authenticating user token {{(pid=144068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:12:00.983023 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG dbcounter [-] [144068] Writing DB stats keystone:SELECT=100 {{(pid=144068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:12:00.999149 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe01d35-47e3-428a-aeca-97e8734e8953 None admin] Validating token access rules against request {{(pid=144067) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:12:01.039414 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b19a9cd-9ef5-4883-b1cf-3d83852680e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144067) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:12:01.040499 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b19a9cd-9ef5-4883-b1cf-3d83852680e0 None admin] REQUEST_METHOD: `GET` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:12:01.040955 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b19a9cd-9ef5-4883-b1cf-3d83852680e0 None admin] SCRIPT_NAME: `/identity` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:12:01.041373 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b19a9cd-9ef5-4883-b1cf-3d83852680e0 None admin] PATH_INFO: `/v3/users` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:12:01.042476 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b19a9cd-9ef5-4883-b1cf-3d83852680e0 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=144067) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:12:01.042949 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b19a9cd-9ef5-4883-b1cf-3d83852680e0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:12:01.044587 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b19a9cd-9ef5-4883-b1cf-3d83852680e0 None admin] RBAC: Authorization granted {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:12:01.060995 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG dbcounter [-] [144067] Writing DB stats keystone:SELECT=100 {{(pid=144067) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:12:01.064119 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22850082-9fb6-4ffd-b4d8-e6f04a2402dd None admin] Validating token access rules against request {{(pid=144068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:12:01.068732 dv-cinder-851351-1-smb devstack@keystone.service[144067]: [pid: 144067|app: 0|req: 326/656] 10.222.0.42 () {56 vars in 1137 bytes} [Thu Jul 28 08:12:00 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:12:01.068732 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b19a9cd-9ef5-4883-b1cf-3d83852680e0 None admin] Authenticating user token {{(pid=144067) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:12:01.111475 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f64fec-b531-417e-bf2c-6b64acc949eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:12:01.112465 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f64fec-b531-417e-bf2c-6b64acc949eb None admin] REQUEST_METHOD: `GET` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:12:01.113000 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f64fec-b531-417e-bf2c-6b64acc949eb None admin] SCRIPT_NAME: `/identity` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:12:01.113581 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f64fec-b531-417e-bf2c-6b64acc949eb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:12:01.182787 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b19a9cd-9ef5-4883-b1cf-3d83852680e0 None admin] Validating token access rules against request {{(pid=144067) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:12:01.198873 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52f64fec-b531-417e-bf2c-6b64acc949eb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:12:01.200874 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52f64fec-b531-417e-bf2c-6b64acc949eb None admin] RBAC: Authorization granted {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:12:01.223371 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8774d6e-46bb-47b5-9c67-67f1d1853278 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144067) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:12:01.224052 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8774d6e-46bb-47b5-9c67-67f1d1853278 None admin] REQUEST_METHOD: `GET` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:12:01.224333 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8774d6e-46bb-47b5-9c67-67f1d1853278 None admin] SCRIPT_NAME: `/identity` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:12:01.224606 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8774d6e-46bb-47b5-9c67-67f1d1853278 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:12:01.233205 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8774d6e-46bb-47b5-9c67-67f1d1853278 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:12:01.234955 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8774d6e-46bb-47b5-9c67-67f1d1853278 None admin] RBAC: Authorization granted {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:12:01.238692 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG dbcounter [-] [144068] Writing DB stats keystone:SELECT=100 {{(pid=144068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:12:01.249910 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application [None req-f8774d6e-46bb-47b5-9c67-67f1d1853278 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jul 28 08:12:01.249910 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:12:01.249910 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:12:01.249910 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:12:01.249910 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:12:01.249910 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:12:01.249910 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:12:01.249910 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:12:01.249910 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:12:01.249910 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:12:01.249910 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:12:01.249910 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:12:01.249910 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 28 08:12:01.249910 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 28 08:12:01.249910 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 28 08:12:01.249910 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 28 08:12:01.251201 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:12:01.251201 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:12:01.251201 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 28 08:12:01.251201 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 08:12:01.251201 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 28 08:12:01.251201 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 08:12:01.251201 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:12:01.251201 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:12:01.251201 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:12:01.251201 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:12:01.251201 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:12:01.251201 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application with Lock( Jul 28 08:12:01.251201 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:12:01.251201 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:12:01.251201 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:12:01.251201 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:12:01.251201 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:12:01.251201 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:12:01.252243 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:12:01.252243 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:12:01.252243 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 28 08:12:01.252243 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 28 08:12:01.252243 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 28 08:12:01.252243 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 28 08:12:01.252243 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 28 08:12:01.252243 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 28 08:12:01.252243 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jul 28 08:12:01.252243 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application Jul 28 08:12:01.252243 dv-cinder-851351-1-smb devstack@keystone.service[144067]: [pid: 144067|app: 0|req: 327/657] 10.222.0.42 () {56 vars in 1099 bytes} [Thu Jul 28 08:12:01 2022] GET /identity/v3/users/cinder => generated 84 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:12:01.252955 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8774d6e-46bb-47b5-9c67-67f1d1853278 None admin] Authenticating user token {{(pid=144067) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:12:01.327601 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG dbcounter [-] [144067] Writing DB stats keystone:SELECT=100 {{(pid=144067) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:12:01.338151 dv-cinder-851351-1-smb devstack@keystone.service[144068]: [pid: 144068|app: 0|req: 331/658] 10.222.0.42 () {58 vars in 1282 bytes} [Thu Jul 28 08:12:00 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 391 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 28 08:12:01.339645 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f64fec-b531-417e-bf2c-6b64acc949eb None admin] Authenticating user token {{(pid=144068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:12:01.381103 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8774d6e-46bb-47b5-9c67-67f1d1853278 None admin] Validating token access rules against request {{(pid=144067) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:12:01.416237 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d433b0f-7300-4fb2-a1e8-564ea0971c90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144067) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:12:01.416915 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d433b0f-7300-4fb2-a1e8-564ea0971c90 None admin] REQUEST_METHOD: `GET` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:12:01.417200 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d433b0f-7300-4fb2-a1e8-564ea0971c90 None admin] SCRIPT_NAME: `/identity` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:12:01.417462 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d433b0f-7300-4fb2-a1e8-564ea0971c90 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:12:01.492337 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d433b0f-7300-4fb2-a1e8-564ea0971c90 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:12:01.493892 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d433b0f-7300-4fb2-a1e8-564ea0971c90 None admin] RBAC: Authorization granted {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:12:01.516322 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f64fec-b531-417e-bf2c-6b64acc949eb None admin] Validating token access rules against request {{(pid=144068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:12:01.550071 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG dbcounter [-] [144068] Writing DB stats keystone:SELECT=100 {{(pid=144068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:12:01.556484 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e77dc543-483a-4cd6-a645-639e39213fa4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:12:01.557164 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77dc543-483a-4cd6-a645-639e39213fa4 None admin] REQUEST_METHOD: `GET` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:12:01.557452 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77dc543-483a-4cd6-a645-639e39213fa4 None admin] SCRIPT_NAME: `/identity` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:12:01.557729 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77dc543-483a-4cd6-a645-639e39213fa4 None admin] PATH_INFO: `/v3/users` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:12:01.558549 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e77dc543-483a-4cd6-a645-639e39213fa4 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=144068) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:12:01.558858 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e77dc543-483a-4cd6-a645-639e39213fa4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:12:01.560338 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e77dc543-483a-4cd6-a645-639e39213fa4 None admin] RBAC: Authorization granted {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:12:01.562363 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG dbcounter [-] [144067] Writing DB stats keystone:SELECT=100 {{(pid=144067) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:12:01.579232 dv-cinder-851351-1-smb devstack@keystone.service[144068]: [pid: 144068|app: 0|req: 332/659] 10.222.0.42 () {56 vars in 1137 bytes} [Thu Jul 28 08:12:01 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:12:01.580930 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ffff2b-f31b-4a43-a6d3-4c34f9aae5d1 None None] REQUEST_METHOD: `GET` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:12:01.581421 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ffff2b-f31b-4a43-a6d3-4c34f9aae5d1 None None] SCRIPT_NAME: `/identity` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:12:01.581942 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ffff2b-f31b-4a43-a6d3-4c34f9aae5d1 None None] PATH_INFO: `/` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:12:01.587888 dv-cinder-851351-1-smb devstack@keystone.service[144068]: [pid: 144068|app: 0|req: 333/660] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 08:12:01 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 08:12:01.589089 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ffff2b-f31b-4a43-a6d3-4c34f9aae5d1 None None] Authenticating user token {{(pid=144068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:12:01.610208 dv-cinder-851351-1-smb devstack@keystone.service[144067]: [pid: 144067|app: 0|req: 328/661] 10.222.0.42 () {58 vars in 1282 bytes} [Thu Jul 28 08:12:01 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 358 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 28 08:12:01.611239 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d433b0f-7300-4fb2-a1e8-564ea0971c90 None admin] Authenticating user token {{(pid=144067) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:12:01.705013 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ffff2b-f31b-4a43-a6d3-4c34f9aae5d1 None None] Validating token access rules against request {{(pid=144068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:12:01.722168 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d433b0f-7300-4fb2-a1e8-564ea0971c90 None admin] Validating token access rules against request {{(pid=144067) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:12:01.740587 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c751462-bfca-4daf-844e-48cb532f1971 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:12:01.741269 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c751462-bfca-4daf-844e-48cb532f1971 None admin] REQUEST_METHOD: `GET` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:12:01.741550 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c751462-bfca-4daf-844e-48cb532f1971 None admin] SCRIPT_NAME: `/identity` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:12:01.741822 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c751462-bfca-4daf-844e-48cb532f1971 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:12:01.752293 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c751462-bfca-4daf-844e-48cb532f1971 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:12:01.753874 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c751462-bfca-4daf-844e-48cb532f1971 None admin] RBAC: Authorization granted {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:12:01.760843 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85cc83a6-9228-4666-84ea-d345413d5841 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144067) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:12:01.761796 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85cc83a6-9228-4666-84ea-d345413d5841 None admin] REQUEST_METHOD: `GET` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:12:01.762264 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85cc83a6-9228-4666-84ea-d345413d5841 None admin] SCRIPT_NAME: `/identity` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:12:01.762748 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85cc83a6-9228-4666-84ea-d345413d5841 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:12:01.769350 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application [None req-4c751462-bfca-4daf-844e-48cb532f1971 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 08:12:01.769350 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:12:01.769350 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:12:01.769350 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:12:01.769350 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:12:01.769350 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:12:01.769350 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:12:01.769350 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:12:01.769350 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:12:01.769350 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:12:01.769350 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:12:01.769350 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:12:01.769350 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 08:12:01.769350 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 08:12:01.769350 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 08:12:01.770429 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 08:12:01.770429 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:12:01.770429 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:12:01.770429 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:12:01.770429 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:12:01.770429 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:12:01.770429 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:12:01.770429 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:12:01.770429 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application with Lock( Jul 28 08:12:01.770429 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:12:01.770429 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:12:01.770429 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:12:01.770429 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:12:01.770429 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:12:01.770429 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:12:01.770429 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:12:01.770429 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:12:01.771425 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 08:12:01.771425 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 08:12:01.771425 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 08:12:01.771425 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application Jul 28 08:12:01.775368 dv-cinder-851351-1-smb devstack@keystone.service[144068]: [pid: 144068|app: 0|req: 334/662] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 08:12:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:12:01.776655 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda442d0-a4f8-489b-8daa-97f9b95766ec None None] REQUEST_METHOD: `POST` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:12:01.776960 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda442d0-a4f8-489b-8daa-97f9b95766ec None None] SCRIPT_NAME: `/identity` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:12:01.777236 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda442d0-a4f8-489b-8daa-97f9b95766ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:12:01.795571 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.auth.core [None req-bda442d0-a4f8-489b-8daa-97f9b95766ec None None] MFA Rules not processed for user `bf5ceb8f07374635ad506b7d1b4f1612`. Rule list: `[]` (Enabled: `True`). {{(pid=144068) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 08:12:01.795853 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG dbcounter [-] [144067] Writing DB stats keystone:SELECT=100 {{(pid=144067) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:12:01.796868 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.fernet_utils [None req-bda442d0-a4f8-489b-8daa-97f9b95766ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=144068) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:12:01.841652 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG dbcounter [-] [144068] Writing DB stats keystone:SELECT=100 {{(pid=144068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:12:01.853561 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85cc83a6-9228-4666-84ea-d345413d5841 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:12:01.856336 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85cc83a6-9228-4666-84ea-d345413d5841 None admin] RBAC: Authorization granted {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:12:01.884706 dv-cinder-851351-1-smb devstack@keystone.service[144068]: [pid: 144068|app: 0|req: 335/663] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 08:12:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 08:12:01.884706 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda442d0-a4f8-489b-8daa-97f9b95766ec None None] Authenticating user token {{(pid=144068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:12:01.980075 dv-cinder-851351-1-smb devstack@keystone.service[144067]: [pid: 144067|app: 0|req: 329/664] 10.222.0.42 () {58 vars in 1282 bytes} [Thu Jul 28 08:12:01 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 369 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 28 08:12:01.980795 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85cc83a6-9228-4666-84ea-d345413d5841 None admin] Authenticating user token {{(pid=144067) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:12:02.016122 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda442d0-a4f8-489b-8daa-97f9b95766ec None None] Validating token access rules against request {{(pid=144068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:12:02.048025 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG dbcounter [-] [144067] Writing DB stats keystone:SELECT=100 {{(pid=144067) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:12:02.058154 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a51a877-da85-4e3a-abd5-a7d2fcad5e92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:12:02.058814 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a51a877-da85-4e3a-abd5-a7d2fcad5e92 None admin] REQUEST_METHOD: `GET` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:12:02.059094 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a51a877-da85-4e3a-abd5-a7d2fcad5e92 None admin] SCRIPT_NAME: `/identity` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:12:02.059365 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a51a877-da85-4e3a-abd5-a7d2fcad5e92 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:12:02.070826 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a51a877-da85-4e3a-abd5-a7d2fcad5e92 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:12:02.072301 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a51a877-da85-4e3a-abd5-a7d2fcad5e92 None admin] RBAC: Authorization granted {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:12:02.088908 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application [None req-8a51a877-da85-4e3a-abd5-a7d2fcad5e92 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 08:12:02.088908 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:12:02.088908 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:12:02.088908 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:12:02.088908 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:12:02.088908 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:12:02.088908 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:12:02.088908 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:12:02.088908 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:12:02.088908 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:12:02.088908 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:12:02.088908 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:12:02.088908 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 08:12:02.088908 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 08:12:02.088908 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 08:12:02.089959 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 08:12:02.089959 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:12:02.089959 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:12:02.089959 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:12:02.089959 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:12:02.089959 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:12:02.089959 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:12:02.089959 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:12:02.089959 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application with Lock( Jul 28 08:12:02.089959 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:12:02.089959 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:12:02.089959 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:12:02.089959 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:12:02.089959 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:12:02.089959 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:12:02.089959 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:12:02.089959 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:12:02.090953 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 08:12:02.090953 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 08:12:02.090953 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 08:12:02.090953 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application Jul 28 08:12:02.090953 dv-cinder-851351-1-smb devstack@keystone.service[144068]: [pid: 144068|app: 0|req: 336/665] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 08:12:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:12:02.090953 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a51a877-da85-4e3a-abd5-a7d2fcad5e92 None admin] Authenticating user token {{(pid=144068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:12:02.102402 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85cc83a6-9228-4666-84ea-d345413d5841 None admin] Validating token access rules against request {{(pid=144067) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:12:02.119904 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG dbcounter [-] [144068] Writing DB stats keystone:SELECT=100 {{(pid=144068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:12:02.139222 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3eafafe-032a-4e0c-82ec-3efda0e48e54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144067) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:12:02.139873 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3eafafe-032a-4e0c-82ec-3efda0e48e54 None admin] REQUEST_METHOD: `GET` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:12:02.140153 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3eafafe-032a-4e0c-82ec-3efda0e48e54 None admin] SCRIPT_NAME: `/identity` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:12:02.140434 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3eafafe-032a-4e0c-82ec-3efda0e48e54 None admin] PATH_INFO: `/v3/domains` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:12:02.141202 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3eafafe-032a-4e0c-82ec-3efda0e48e54 None admin] RBAC: Adding query filter params (name=Default) {{(pid=144067) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:12:02.141538 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3eafafe-032a-4e0c-82ec-3efda0e48e54 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:12:02.142952 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3eafafe-032a-4e0c-82ec-3efda0e48e54 None admin] RBAC: Authorization granted {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:12:02.155326 dv-cinder-851351-1-smb devstack@keystone.service[144067]: [pid: 144067|app: 0|req: 330/666] 10.222.0.42 () {56 vars in 1109 bytes} [Thu Jul 28 08:12:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:12:02.157720 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3eafafe-032a-4e0c-82ec-3efda0e48e54 None admin] Authenticating user token {{(pid=144067) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:12:02.206367 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a51a877-da85-4e3a-abd5-a7d2fcad5e92 None admin] Validating token access rules against request {{(pid=144068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:12:02.247822 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe4af40c-17b9-4f31-9e1b-a601904c0c0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:12:02.248420 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4af40c-17b9-4f31-9e1b-a601904c0c0b None admin] REQUEST_METHOD: `GET` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:12:02.248736 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4af40c-17b9-4f31-9e1b-a601904c0c0b None admin] SCRIPT_NAME: `/identity` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:12:02.249023 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4af40c-17b9-4f31-9e1b-a601904c0c0b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:12:02.262491 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe4af40c-17b9-4f31-9e1b-a601904c0c0b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 08:12:02.268069 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application [None req-fe4af40c-17b9-4f31-9e1b-a601904c0c0b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 08:12:02.268069 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:12:02.268069 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:12:02.268069 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:12:02.268069 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:12:02.268069 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:12:02.268069 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:12:02.268069 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:12:02.268069 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:12:02.268069 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:12:02.268069 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:12:02.268069 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:12:02.268069 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 08:12:02.268069 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 08:12:02.268069 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 08:12:02.268069 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 08:12:02.269372 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 08:12:02.269372 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 08:12:02.269372 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 08:12:02.269372 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 08:12:02.269372 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:12:02.269372 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:12:02.269372 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:12:02.269372 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:12:02.269372 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:12:02.269372 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:12:02.269372 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:12:02.269372 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application with Lock( Jul 28 08:12:02.269372 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:12:02.269372 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:12:02.269372 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:12:02.269372 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:12:02.270347 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:12:02.270347 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:12:02.270347 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:12:02.270347 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:12:02.270347 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 08:12:02.270347 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 08:12:02.270347 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 08:12:02.270347 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 08:12:02.270347 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 08:12:02.270347 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 08:12:02.270347 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 08:12:02.270347 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application Jul 28 08:12:02.270347 dv-cinder-851351-1-smb devstack@keystone.service[144068]: [pid: 144068|app: 0|req: 337/667] 10.222.0.42 () {56 vars in 1096 bytes} [Thu Jul 28 08:12:02 2022] GET /identity/v3/roles/admin => generated 83 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:12:02.270347 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe4af40c-17b9-4f31-9e1b-a601904c0c0b None admin] Authenticating user token {{(pid=144068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:12:02.276303 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3eafafe-032a-4e0c-82ec-3efda0e48e54 None admin] Validating token access rules against request {{(pid=144067) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:12:02.297681 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG dbcounter [-] [144067] Writing DB stats keystone:SELECT=100 {{(pid=144067) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:12:02.314240 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12dae57-92c6-4247-94e0-c9111956f08b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144067) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:12:02.315045 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12dae57-92c6-4247-94e0-c9111956f08b None admin] REQUEST_METHOD: `GET` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:12:02.315333 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12dae57-92c6-4247-94e0-c9111956f08b None admin] SCRIPT_NAME: `/identity` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:12:02.315610 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12dae57-92c6-4247-94e0-c9111956f08b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:12:02.328960 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d12dae57-92c6-4247-94e0-c9111956f08b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:12:02.330544 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d12dae57-92c6-4247-94e0-c9111956f08b None admin] RBAC: Authorization granted {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:12:02.347916 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application [None req-d12dae57-92c6-4247-94e0-c9111956f08b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 08:12:02.347916 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:12:02.347916 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:12:02.347916 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:12:02.347916 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:12:02.347916 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:12:02.347916 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:12:02.347916 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:12:02.347916 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:12:02.347916 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:12:02.347916 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:12:02.347916 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:12:02.347916 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 08:12:02.347916 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 08:12:02.347916 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 08:12:02.349136 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 08:12:02.349136 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:12:02.349136 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:12:02.349136 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:12:02.349136 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:12:02.349136 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:12:02.349136 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:12:02.349136 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:12:02.349136 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application with Lock( Jul 28 08:12:02.349136 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:12:02.349136 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:12:02.349136 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:12:02.349136 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:12:02.349136 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:12:02.349136 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:12:02.349136 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:12:02.349136 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:12:02.350134 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 08:12:02.350134 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 08:12:02.350134 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 08:12:02.350134 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application Jul 28 08:12:02.350134 dv-cinder-851351-1-smb devstack@keystone.service[144067]: [pid: 144067|app: 0|req: 331/668] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 08:12:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:12:02.350134 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12dae57-92c6-4247-94e0-c9111956f08b None admin] Authenticating user token {{(pid=144067) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:12:02.371120 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG dbcounter [-] [144068] Writing DB stats keystone:SELECT=100 {{(pid=144068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:12:02.388964 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe4af40c-17b9-4f31-9e1b-a601904c0c0b None admin] Validating token access rules against request {{(pid=144068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:12:02.424831 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd8501b8-5e6b-49d5-bbe0-7e5c4746b1a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:12:02.425445 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8501b8-5e6b-49d5-bbe0-7e5c4746b1a8 None admin] REQUEST_METHOD: `GET` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:12:02.425862 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8501b8-5e6b-49d5-bbe0-7e5c4746b1a8 None admin] SCRIPT_NAME: `/identity` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:12:02.426142 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8501b8-5e6b-49d5-bbe0-7e5c4746b1a8 None admin] PATH_INFO: `/v3/domains` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:12:02.426864 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd8501b8-5e6b-49d5-bbe0-7e5c4746b1a8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=144068) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:12:02.427168 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd8501b8-5e6b-49d5-bbe0-7e5c4746b1a8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:12:02.428594 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd8501b8-5e6b-49d5-bbe0-7e5c4746b1a8 None admin] RBAC: Authorization granted {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:12:02.442094 dv-cinder-851351-1-smb devstack@keystone.service[144068]: [pid: 144068|app: 0|req: 338/669] 10.222.0.42 () {56 vars in 1109 bytes} [Thu Jul 28 08:12:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:12:02.443249 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13bdd3aa-c8d0-437d-aea9-d14ee1e7e958 None None] REQUEST_METHOD: `GET` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:12:02.443549 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13bdd3aa-c8d0-437d-aea9-d14ee1e7e958 None None] SCRIPT_NAME: `/identity` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:12:02.443796 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13bdd3aa-c8d0-437d-aea9-d14ee1e7e958 None None] PATH_INFO: `/` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:12:02.448731 dv-cinder-851351-1-smb devstack@keystone.service[144068]: [pid: 144068|app: 0|req: 339/670] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 08:12:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 08:12:02.448731 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13bdd3aa-c8d0-437d-aea9-d14ee1e7e958 None None] Authenticating user token {{(pid=144068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:12:02.469685 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12dae57-92c6-4247-94e0-c9111956f08b None admin] Validating token access rules against request {{(pid=144067) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:12:02.507577 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b58d8e-ead7-4cd1-9191-3e46879ec04a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144067) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:12:02.508564 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b58d8e-ead7-4cd1-9191-3e46879ec04a None admin] REQUEST_METHOD: `GET` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:12:02.508864 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b58d8e-ead7-4cd1-9191-3e46879ec04a None admin] SCRIPT_NAME: `/identity` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:12:02.509159 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b58d8e-ead7-4cd1-9191-3e46879ec04a None admin] PATH_INFO: `/v3/projects/service` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:12:02.516515 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10b58d8e-ead7-4cd1-9191-3e46879ec04a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:12:02.518120 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10b58d8e-ead7-4cd1-9191-3e46879ec04a None admin] RBAC: Authorization granted {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:12:02.530034 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application [None req-10b58d8e-ead7-4cd1-9191-3e46879ec04a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 08:12:02.530034 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:12:02.530034 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:12:02.530034 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:12:02.530034 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:12:02.530034 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:12:02.530034 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:12:02.530034 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:12:02.530034 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:12:02.530034 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:12:02.530034 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:12:02.530034 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:12:02.530034 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 28 08:12:02.530034 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 28 08:12:02.530034 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 28 08:12:02.531211 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 28 08:12:02.531211 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:12:02.531211 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:12:02.531211 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:12:02.531211 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:12:02.531211 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:12:02.531211 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:12:02.531211 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:12:02.531211 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application with Lock( Jul 28 08:12:02.531211 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:12:02.531211 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:12:02.531211 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:12:02.531211 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:12:02.531211 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:12:02.531211 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:12:02.531211 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:12:02.531211 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:12:02.532188 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 28 08:12:02.532188 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 28 08:12:02.532188 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 28 08:12:02.532188 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 28 08:12:02.532188 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 28 08:12:02.532188 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 28 08:12:02.532188 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 08:12:02.532188 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application Jul 28 08:12:02.532188 dv-cinder-851351-1-smb devstack@keystone.service[144067]: [pid: 144067|app: 0|req: 332/671] 10.222.0.42 () {56 vars in 1111 bytes} [Thu Jul 28 08:12:02 2022] GET /identity/v3/projects/service => generated 88 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:12:02.532188 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b58d8e-ead7-4cd1-9191-3e46879ec04a None admin] Authenticating user token {{(pid=144067) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:12:02.558483 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13bdd3aa-c8d0-437d-aea9-d14ee1e7e958 None None] Validating token access rules against request {{(pid=144068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:12:02.567397 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG dbcounter [-] [144067] Writing DB stats keystone:SELECT=100 {{(pid=144067) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:12:02.594273 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84abd6a4-8066-4a82-a77c-1596cee895c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:12:02.594910 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84abd6a4-8066-4a82-a77c-1596cee895c6 None admin] REQUEST_METHOD: `GET` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:12:02.595195 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84abd6a4-8066-4a82-a77c-1596cee895c6 None admin] SCRIPT_NAME: `/identity` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:12:02.595478 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84abd6a4-8066-4a82-a77c-1596cee895c6 None admin] PATH_INFO: `/v3/roles` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:12:02.596241 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84abd6a4-8066-4a82-a77c-1596cee895c6 None admin] RBAC: Adding query filter params (name=admin) {{(pid=144068) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:12:02.596525 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84abd6a4-8066-4a82-a77c-1596cee895c6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:12:02.597988 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84abd6a4-8066-4a82-a77c-1596cee895c6 None admin] RBAC: Authorization granted {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:12:02.610225 dv-cinder-851351-1-smb devstack@keystone.service[144068]: [pid: 144068|app: 0|req: 340/672] 10.222.0.42 () {56 vars in 1099 bytes} [Thu Jul 28 08:12:02 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:12:02.610225 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84abd6a4-8066-4a82-a77c-1596cee895c6 None admin] Authenticating user token {{(pid=144068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:12:02.617555 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG dbcounter [-] [144068] Writing DB stats keystone:SELECT=100 {{(pid=144068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:12:02.641842 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b58d8e-ead7-4cd1-9191-3e46879ec04a None admin] Validating token access rules against request {{(pid=144067) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:12:02.678185 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa54226f-fc81-4eb8-8727-36d70b3e9382 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144067) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:12:02.678825 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa54226f-fc81-4eb8-8727-36d70b3e9382 None admin] REQUEST_METHOD: `GET` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:12:02.679109 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa54226f-fc81-4eb8-8727-36d70b3e9382 None admin] SCRIPT_NAME: `/identity` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:12:02.679398 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa54226f-fc81-4eb8-8727-36d70b3e9382 None admin] PATH_INFO: `/v3/domains` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:12:02.680124 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa54226f-fc81-4eb8-8727-36d70b3e9382 None admin] RBAC: Adding query filter params (name=Default) {{(pid=144067) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:12:02.680438 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa54226f-fc81-4eb8-8727-36d70b3e9382 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:12:02.681936 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa54226f-fc81-4eb8-8727-36d70b3e9382 None admin] RBAC: Authorization granted {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:12:02.694572 dv-cinder-851351-1-smb devstack@keystone.service[144067]: [pid: 144067|app: 0|req: 333/673] 10.222.0.42 () {56 vars in 1109 bytes} [Thu Jul 28 08:12:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:12:02.695975 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa75fb5-82b6-4f4d-a669-5ed0820043d4 None None] REQUEST_METHOD: `POST` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:12:02.696522 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa75fb5-82b6-4f4d-a669-5ed0820043d4 None None] SCRIPT_NAME: `/identity` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:12:02.696522 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa75fb5-82b6-4f4d-a669-5ed0820043d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:12:02.715528 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.auth.core [None req-caa75fb5-82b6-4f4d-a669-5ed0820043d4 None None] MFA Rules not processed for user `bf5ceb8f07374635ad506b7d1b4f1612`. Rule list: `[]` (Enabled: `True`). {{(pid=144067) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 08:12:02.715789 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84abd6a4-8066-4a82-a77c-1596cee895c6 None admin] Validating token access rules against request {{(pid=144068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:12:02.716841 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.fernet_utils [None req-caa75fb5-82b6-4f4d-a669-5ed0820043d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=144067) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:12:02.751286 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6421434-4295-46ee-bba5-699b9664e6c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:12:02.751974 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6421434-4295-46ee-bba5-699b9664e6c6 None admin] REQUEST_METHOD: `GET` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:12:02.752236 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6421434-4295-46ee-bba5-699b9664e6c6 None admin] SCRIPT_NAME: `/identity` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:12:02.752510 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6421434-4295-46ee-bba5-699b9664e6c6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:12:02.759901 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6421434-4295-46ee-bba5-699b9664e6c6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:12:02.761353 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6421434-4295-46ee-bba5-699b9664e6c6 None admin] RBAC: Authorization granted {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:12:02.774456 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application [None req-b6421434-4295-46ee-bba5-699b9664e6c6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 08:12:02.774456 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:12:02.774456 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:12:02.774456 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:12:02.774456 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:12:02.774456 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:12:02.774456 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:12:02.774456 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:12:02.774456 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:12:02.774456 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:12:02.774456 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:12:02.774456 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:12:02.774456 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 28 08:12:02.774456 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 28 08:12:02.774456 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 28 08:12:02.775637 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 28 08:12:02.775637 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:12:02.775637 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:12:02.775637 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:12:02.775637 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:12:02.775637 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:12:02.775637 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:12:02.775637 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:12:02.775637 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application with Lock( Jul 28 08:12:02.775637 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:12:02.775637 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:12:02.775637 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:12:02.775637 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:12:02.775637 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:12:02.775637 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:12:02.775637 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:12:02.775637 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:12:02.781830 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 28 08:12:02.781830 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 28 08:12:02.781830 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 28 08:12:02.781830 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 28 08:12:02.781830 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 28 08:12:02.781830 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 28 08:12:02.781830 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 08:12:02.781830 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application Jul 28 08:12:02.781830 dv-cinder-851351-1-smb devstack@keystone.service[144068]: [pid: 144068|app: 0|req: 341/674] 10.222.0.42 () {56 vars in 1111 bytes} [Thu Jul 28 08:12:02 2022] GET /identity/v3/projects/service => generated 88 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:12:02.781830 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6421434-4295-46ee-bba5-699b9664e6c6 None admin] Authenticating user token {{(pid=144068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:12:02.789901 dv-cinder-851351-1-smb devstack@keystone.service[144067]: [pid: 144067|app: 0|req: 334/675] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 08:12:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 08:12:02.790887 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa75fb5-82b6-4f4d-a669-5ed0820043d4 None None] Authenticating user token {{(pid=144067) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:12:02.816981 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG dbcounter [-] [144067] Writing DB stats keystone:SELECT=100 {{(pid=144067) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:12:02.861647 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG dbcounter [-] [144068] Writing DB stats keystone:SELECT=100 {{(pid=144068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:12:02.898384 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa75fb5-82b6-4f4d-a669-5ed0820043d4 None None] Validating token access rules against request {{(pid=144067) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:12:02.899523 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6421434-4295-46ee-bba5-699b9664e6c6 None admin] Validating token access rules against request {{(pid=144068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:12:02.933667 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05993c61-bd48-47f7-8dca-a5fc7386dbb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144067) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:12:02.933952 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39dcf51f-7271-48ef-a38b-6cac95f6cf63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:12:02.934320 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39dcf51f-7271-48ef-a38b-6cac95f6cf63 None admin] REQUEST_METHOD: `GET` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:12:02.934424 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05993c61-bd48-47f7-8dca-a5fc7386dbb3 None admin] REQUEST_METHOD: `GET` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:12:02.934595 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05993c61-bd48-47f7-8dca-a5fc7386dbb3 None admin] SCRIPT_NAME: `/identity` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:12:02.934700 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39dcf51f-7271-48ef-a38b-6cac95f6cf63 None admin] SCRIPT_NAME: `/identity` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:12:02.934866 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05993c61-bd48-47f7-8dca-a5fc7386dbb3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:12:02.934970 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39dcf51f-7271-48ef-a38b-6cac95f6cf63 None admin] PATH_INFO: `/v3/projects` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:12:02.935637 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39dcf51f-7271-48ef-a38b-6cac95f6cf63 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=144068) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:12:02.935956 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39dcf51f-7271-48ef-a38b-6cac95f6cf63 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:12:02.937462 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39dcf51f-7271-48ef-a38b-6cac95f6cf63 None admin] RBAC: Authorization granted {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:12:02.945739 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05993c61-bd48-47f7-8dca-a5fc7386dbb3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:12:02.947218 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05993c61-bd48-47f7-8dca-a5fc7386dbb3 None admin] RBAC: Authorization granted {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:12:02.950879 dv-cinder-851351-1-smb devstack@keystone.service[144068]: [pid: 144068|app: 0|req: 342/676] 10.222.0.42 () {56 vars in 1148 bytes} [Thu Jul 28 08:12:02 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:12:02.951815 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39dcf51f-7271-48ef-a38b-6cac95f6cf63 None admin] Authenticating user token {{(pid=144068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:12:02.963513 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application [None req-05993c61-bd48-47f7-8dca-a5fc7386dbb3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 08:12:02.963513 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:12:02.963513 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:12:02.963513 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:12:02.963513 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:12:02.963513 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:12:02.963513 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:12:02.963513 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:12:02.963513 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:12:02.963513 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:12:02.963513 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:12:02.963513 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:12:02.963513 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 08:12:02.963513 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 08:12:02.963513 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 08:12:02.964948 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 08:12:02.964948 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:12:02.964948 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:12:02.964948 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:12:02.964948 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:12:02.964948 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:12:02.964948 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:12:02.964948 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:12:02.964948 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application with Lock( Jul 28 08:12:02.964948 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:12:02.964948 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:12:02.964948 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:12:02.964948 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:12:02.964948 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:12:02.964948 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:12:02.964948 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:12:02.964948 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:12:02.966009 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 08:12:02.966009 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 08:12:02.966009 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 08:12:02.966009 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application Jul 28 08:12:02.966009 dv-cinder-851351-1-smb devstack@keystone.service[144067]: [pid: 144067|app: 0|req: 335/677] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 08:12:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:12:02.966009 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05993c61-bd48-47f7-8dca-a5fc7386dbb3 None admin] Authenticating user token {{(pid=144067) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:12:03.045623 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG dbcounter [-] [144067] Writing DB stats keystone:SELECT=100 {{(pid=144067) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:12:03.068420 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39dcf51f-7271-48ef-a38b-6cac95f6cf63 None admin] Validating token access rules against request {{(pid=144068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:12:03.071165 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05993c61-bd48-47f7-8dca-a5fc7386dbb3 None admin] Validating token access rules against request {{(pid=144067) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:12:03.096237 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG dbcounter [-] [144068] Writing DB stats keystone:SELECT=100 {{(pid=144068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:12:03.105933 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79bf3f22-74c5-48dc-8a45-cd6a0916a532 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:12:03.106601 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79bf3f22-74c5-48dc-8a45-cd6a0916a532 None admin] REQUEST_METHOD: `GET` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:12:03.106885 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79bf3f22-74c5-48dc-8a45-cd6a0916a532 None admin] SCRIPT_NAME: `/identity` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:12:03.107160 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79bf3f22-74c5-48dc-8a45-cd6a0916a532 None admin] PATH_INFO: `/v3/projects/service` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:12:03.107512 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f804bc-9a63-4d86-8e3f-bde61dae00cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144067) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:12:03.108234 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f804bc-9a63-4d86-8e3f-bde61dae00cb None admin] REQUEST_METHOD: `GET` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:12:03.108586 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f804bc-9a63-4d86-8e3f-bde61dae00cb None admin] SCRIPT_NAME: `/identity` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:12:03.108992 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f804bc-9a63-4d86-8e3f-bde61dae00cb None admin] PATH_INFO: `/v3/projects` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:12:03.109781 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4f804bc-9a63-4d86-8e3f-bde61dae00cb None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=144067) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:12:03.110099 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4f804bc-9a63-4d86-8e3f-bde61dae00cb None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:12:03.111584 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4f804bc-9a63-4d86-8e3f-bde61dae00cb None admin] RBAC: Authorization granted {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:12:03.116785 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79bf3f22-74c5-48dc-8a45-cd6a0916a532 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:12:03.118252 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79bf3f22-74c5-48dc-8a45-cd6a0916a532 None admin] RBAC: Authorization granted {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:12:03.125813 dv-cinder-851351-1-smb devstack@keystone.service[144067]: [pid: 144067|app: 0|req: 336/678] 10.222.0.42 () {56 vars in 1148 bytes} [Thu Jul 28 08:12:02 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:12:03.126674 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f804bc-9a63-4d86-8e3f-bde61dae00cb None admin] Authenticating user token {{(pid=144067) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:12:03.130151 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application [None req-79bf3f22-74c5-48dc-8a45-cd6a0916a532 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 08:12:03.130151 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:12:03.130151 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:12:03.130151 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:12:03.130151 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:12:03.130151 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:12:03.130151 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:12:03.130151 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:12:03.130151 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:12:03.130151 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:12:03.130151 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:12:03.130151 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:12:03.130151 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 28 08:12:03.130151 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 28 08:12:03.130151 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 28 08:12:03.131139 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 28 08:12:03.131139 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:12:03.131139 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:12:03.131139 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:12:03.131139 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:12:03.131139 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:12:03.131139 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:12:03.131139 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:12:03.131139 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application with Lock( Jul 28 08:12:03.131139 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:12:03.131139 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:12:03.131139 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:12:03.131139 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:12:03.131139 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:12:03.131139 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:12:03.131139 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:12:03.131139 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:12:03.132270 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 28 08:12:03.132270 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 28 08:12:03.132270 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 28 08:12:03.132270 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 28 08:12:03.132270 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 28 08:12:03.132270 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 28 08:12:03.132270 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 08:12:03.132270 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application Jul 28 08:12:03.136222 dv-cinder-851351-1-smb devstack@keystone.service[144068]: [pid: 144068|app: 0|req: 343/679] 10.222.0.42 () {56 vars in 1111 bytes} [Thu Jul 28 08:12:02 2022] GET /identity/v3/projects/service => generated 88 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:12:03.137074 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79bf3f22-74c5-48dc-8a45-cd6a0916a532 None admin] Authenticating user token {{(pid=144068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:12:03.236333 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f804bc-9a63-4d86-8e3f-bde61dae00cb None admin] Validating token access rules against request {{(pid=144067) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:12:03.243440 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79bf3f22-74c5-48dc-8a45-cd6a0916a532 None admin] Validating token access rules against request {{(pid=144068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:12:03.272813 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf55c66-e61d-4130-ac56-fd11df8a581b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144067) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:12:03.273484 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf55c66-e61d-4130-ac56-fd11df8a581b None admin] REQUEST_METHOD: `GET` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:12:03.273766 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf55c66-e61d-4130-ac56-fd11df8a581b None admin] SCRIPT_NAME: `/identity` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:12:03.274038 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf55c66-e61d-4130-ac56-fd11df8a581b None admin] PATH_INFO: `/v3/roles/service` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:12:03.276204 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG dbcounter [-] [144067] Writing DB stats keystone:SELECT=100 {{(pid=144067) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:12:03.279728 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532f0fd3-0aa7-480e-8be4-3e322bccf995 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:12:03.280513 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532f0fd3-0aa7-480e-8be4-3e322bccf995 None admin] REQUEST_METHOD: `GET` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:12:03.280831 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532f0fd3-0aa7-480e-8be4-3e322bccf995 None admin] SCRIPT_NAME: `/identity` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:12:03.281225 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532f0fd3-0aa7-480e-8be4-3e322bccf995 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:12:03.281907 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-532f0fd3-0aa7-480e-8be4-3e322bccf995 None admin] RBAC: Adding query filter params (role.id=9aa6ce92dcbb4164ac0e44d2aa2a0248, scope.project.id=fa39ab7491e5413ca648e31ee9177fa0, user.id=ccb4223a248b45fba8dff662f7260b21) {{(pid=144068) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:12:03.282216 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-532f0fd3-0aa7-480e-8be4-3e322bccf995 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:12:03.283657 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-532f0fd3-0aa7-480e-8be4-3e322bccf995 None admin] RBAC: Authorization granted {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:12:03.286296 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaf55c66-e61d-4130-ac56-fd11df8a581b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 08:12:03.290024 dv-cinder-851351-1-smb devstack@keystone.service[144068]: [pid: 144068|app: 0|req: 344/680] 10.222.0.42 () {56 vars in 1374 bytes} [Thu Jul 28 08:12:03 2022] GET /identity/v3/role_assignments?user.id=ccb4223a248b45fba8dff662f7260b21&scope.project.id=fa39ab7491e5413ca648e31ee9177fa0&role.id=9aa6ce92dcbb4164ac0e44d2aa2a0248 => generated 608 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:12:03.291363 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application [None req-eaf55c66-e61d-4130-ac56-fd11df8a581b None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 28 08:12:03.291363 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:12:03.291363 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:12:03.291363 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:12:03.291363 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:12:03.291363 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:12:03.291363 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:12:03.291363 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:12:03.291363 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:12:03.291363 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:12:03.291363 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:12:03.291363 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:12:03.291363 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 08:12:03.291363 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 08:12:03.291363 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 08:12:03.291363 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 08:12:03.292372 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 08:12:03.292372 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 08:12:03.292372 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 08:12:03.292372 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 08:12:03.292372 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:12:03.292372 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:12:03.292372 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:12:03.292372 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:12:03.292372 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:12:03.292372 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:12:03.292372 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:12:03.292372 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application with Lock( Jul 28 08:12:03.292372 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:12:03.292372 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:12:03.292372 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:12:03.292372 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:12:03.293358 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:12:03.293358 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:12:03.293358 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:12:03.293358 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:12:03.293358 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 08:12:03.293358 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 08:12:03.293358 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 08:12:03.293358 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 08:12:03.293358 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 08:12:03.293358 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 08:12:03.293358 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 28 08:12:03.293358 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application Jul 28 08:12:03.294067 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532f0fd3-0aa7-480e-8be4-3e322bccf995 None admin] Authenticating user token {{(pid=144068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:12:03.294157 dv-cinder-851351-1-smb devstack@keystone.service[144067]: [pid: 144067|app: 0|req: 337/681] 10.222.0.42 () {56 vars in 1102 bytes} [Thu Jul 28 08:12:03 2022] GET /identity/v3/roles/service => generated 85 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:12:03.294157 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf55c66-e61d-4130-ac56-fd11df8a581b None admin] Authenticating user token {{(pid=144067) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:12:03.382111 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG dbcounter [-] [144068] Writing DB stats keystone:SELECT=100 {{(pid=144068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:12:03.430387 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf55c66-e61d-4130-ac56-fd11df8a581b None admin] Validating token access rules against request {{(pid=144067) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:12:03.444402 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532f0fd3-0aa7-480e-8be4-3e322bccf995 None admin] Validating token access rules against request {{(pid=144068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:12:03.472059 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494ce4fe-1b9c-4edc-912c-a90a3d6724bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144067) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:12:03.472059 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494ce4fe-1b9c-4edc-912c-a90a3d6724bd None admin] REQUEST_METHOD: `GET` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:12:03.472059 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494ce4fe-1b9c-4edc-912c-a90a3d6724bd None admin] SCRIPT_NAME: `/identity` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:12:03.472059 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494ce4fe-1b9c-4edc-912c-a90a3d6724bd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:12:03.472651 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-494ce4fe-1b9c-4edc-912c-a90a3d6724bd None admin] RBAC: Adding query filter params (role.id=9aa6ce92dcbb4164ac0e44d2aa2a0248, scope.project.id=fa39ab7491e5413ca648e31ee9177fa0, user.id=05fa683ca43e40489a294d83584a0db9) {{(pid=144067) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:12:03.473022 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-494ce4fe-1b9c-4edc-912c-a90a3d6724bd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:12:03.474508 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-494ce4fe-1b9c-4edc-912c-a90a3d6724bd None admin] RBAC: Authorization granted {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:12:03.484212 dv-cinder-851351-1-smb devstack@keystone.service[144067]: [pid: 144067|app: 0|req: 338/682] 10.222.0.42 () {56 vars in 1374 bytes} [Thu Jul 28 08:12:03 2022] GET /identity/v3/role_assignments?user.id=05fa683ca43e40489a294d83584a0db9&scope.project.id=fa39ab7491e5413ca648e31ee9177fa0&role.id=9aa6ce92dcbb4164ac0e44d2aa2a0248 => generated 608 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:12:03.484838 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494ce4fe-1b9c-4edc-912c-a90a3d6724bd None admin] Authenticating user token {{(pid=144067) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:12:03.489713 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd970f1-8000-482d-81c5-d311306d4dd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:12:03.490381 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd970f1-8000-482d-81c5-d311306d4dd7 None admin] REQUEST_METHOD: `GET` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:12:03.490664 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd970f1-8000-482d-81c5-d311306d4dd7 None admin] SCRIPT_NAME: `/identity` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:12:03.490941 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd970f1-8000-482d-81c5-d311306d4dd7 None admin] PATH_INFO: `/v3/domains` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:12:03.491685 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cd970f1-8000-482d-81c5-d311306d4dd7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=144068) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:12:03.492106 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cd970f1-8000-482d-81c5-d311306d4dd7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:12:03.493695 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cd970f1-8000-482d-81c5-d311306d4dd7 None admin] RBAC: Authorization granted {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:12:03.509359 dv-cinder-851351-1-smb devstack@keystone.service[144068]: [pid: 144068|app: 0|req: 345/683] 10.222.0.42 () {56 vars in 1109 bytes} [Thu Jul 28 08:12:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:12:03.510299 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd970f1-8000-482d-81c5-d311306d4dd7 None admin] Authenticating user token {{(pid=144068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:12:03.567010 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG dbcounter [-] [144067] Writing DB stats keystone:SELECT=100 {{(pid=144067) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:12:03.618879 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494ce4fe-1b9c-4edc-912c-a90a3d6724bd None admin] Validating token access rules against request {{(pid=144067) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:12:03.661632 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab90624-144d-47c3-a7a2-64dc74506efa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144067) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:12:03.662333 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd970f1-8000-482d-81c5-d311306d4dd7 None admin] Validating token access rules against request {{(pid=144068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:12:03.663260 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab90624-144d-47c3-a7a2-64dc74506efa None admin] REQUEST_METHOD: `GET` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:12:03.664166 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab90624-144d-47c3-a7a2-64dc74506efa None admin] SCRIPT_NAME: `/identity` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:12:03.665137 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab90624-144d-47c3-a7a2-64dc74506efa None admin] PATH_INFO: `/v3/projects` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:12:03.666131 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ab90624-144d-47c3-a7a2-64dc74506efa None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=144067) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:12:03.666669 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ab90624-144d-47c3-a7a2-64dc74506efa None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:12:03.669064 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ab90624-144d-47c3-a7a2-64dc74506efa None admin] RBAC: Authorization granted {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:12:03.679957 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG dbcounter [-] [144068] Writing DB stats keystone:SELECT=100 {{(pid=144068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:12:03.687017 dv-cinder-851351-1-smb devstack@keystone.service[144067]: [pid: 144067|app: 0|req: 339/684] 10.222.0.42 () {56 vars in 1148 bytes} [Thu Jul 28 08:12:03 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:12:03.688421 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab90624-144d-47c3-a7a2-64dc74506efa None admin] Authenticating user token {{(pid=144067) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:12:03.708825 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ce6c5e-58e8-445b-bfeb-81c83f5ade11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:12:03.709461 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ce6c5e-58e8-445b-bfeb-81c83f5ade11 None admin] REQUEST_METHOD: `GET` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:12:03.709739 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ce6c5e-58e8-445b-bfeb-81c83f5ade11 None admin] SCRIPT_NAME: `/identity` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:12:03.710266 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ce6c5e-58e8-445b-bfeb-81c83f5ade11 None admin] PATH_INFO: `/v3/roles` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:12:03.711092 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76ce6c5e-58e8-445b-bfeb-81c83f5ade11 None admin] RBAC: Adding query filter params (name=service) {{(pid=144068) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:12:03.711397 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76ce6c5e-58e8-445b-bfeb-81c83f5ade11 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:12:03.714747 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76ce6c5e-58e8-445b-bfeb-81c83f5ade11 None admin] RBAC: Authorization granted {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:12:03.723793 dv-cinder-851351-1-smb devstack@keystone.service[144068]: [pid: 144068|app: 0|req: 346/685] 10.222.0.42 () {56 vars in 1103 bytes} [Thu Jul 28 08:12:03 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:12:03.724566 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ce6c5e-58e8-445b-bfeb-81c83f5ade11 None admin] Authenticating user token {{(pid=144068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:12:03.819952 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab90624-144d-47c3-a7a2-64dc74506efa None admin] Validating token access rules against request {{(pid=144067) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:12:03.841719 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG dbcounter [-] [144067] Writing DB stats keystone:SELECT=100 {{(pid=144067) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:12:03.862627 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34d265b-8ee8-4637-a239-7a907669b733 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144067) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:12:03.863892 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34d265b-8ee8-4637-a239-7a907669b733 None admin] REQUEST_METHOD: `GET` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:12:03.864345 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34d265b-8ee8-4637-a239-7a907669b733 None admin] SCRIPT_NAME: `/identity` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:12:03.864924 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34d265b-8ee8-4637-a239-7a907669b733 None admin] PATH_INFO: `/v3/users/nova` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:12:03.867201 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ce6c5e-58e8-445b-bfeb-81c83f5ade11 None admin] Validating token access rules against request {{(pid=144068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:12:03.873087 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b34d265b-8ee8-4637-a239-7a907669b733 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:12:03.874569 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b34d265b-8ee8-4637-a239-7a907669b733 None admin] RBAC: Authorization granted {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:12:03.888296 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application [None req-b34d265b-8ee8-4637-a239-7a907669b733 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 28 08:12:03.888296 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:12:03.888296 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:12:03.888296 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:12:03.888296 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:12:03.888296 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:12:03.888296 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:12:03.888296 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:12:03.888296 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:12:03.888296 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:12:03.888296 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:12:03.888296 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:12:03.888296 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 28 08:12:03.888296 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 28 08:12:03.888296 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 28 08:12:03.888296 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 28 08:12:03.889562 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:12:03.889562 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:12:03.889562 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 28 08:12:03.889562 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 08:12:03.889562 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 28 08:12:03.889562 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 08:12:03.889562 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:12:03.889562 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:12:03.889562 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:12:03.889562 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:12:03.889562 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:12:03.889562 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application with Lock( Jul 28 08:12:03.889562 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:12:03.889562 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:12:03.889562 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:12:03.889562 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:12:03.889562 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:12:03.889562 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:12:03.890602 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:12:03.890602 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:12:03.890602 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 28 08:12:03.890602 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 28 08:12:03.890602 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 28 08:12:03.890602 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 28 08:12:03.890602 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 28 08:12:03.890602 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 28 08:12:03.890602 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 28 08:12:03.890602 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application Jul 28 08:12:03.890602 dv-cinder-851351-1-smb devstack@keystone.service[144067]: [pid: 144067|app: 0|req: 340/686] 10.222.0.42 () {56 vars in 1093 bytes} [Thu Jul 28 08:12:03 2022] GET /identity/v3/users/nova => generated 82 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:12:03.891321 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34d265b-8ee8-4637-a239-7a907669b733 None admin] Authenticating user token {{(pid=144067) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:12:03.913273 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64474446-6200-4560-bcc3-97dc7e18f641 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:12:03.914319 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64474446-6200-4560-bcc3-97dc7e18f641 None admin] REQUEST_METHOD: `GET` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:12:03.915060 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64474446-6200-4560-bcc3-97dc7e18f641 None admin] SCRIPT_NAME: `/identity` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:12:03.915487 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64474446-6200-4560-bcc3-97dc7e18f641 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:12:03.916446 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64474446-6200-4560-bcc3-97dc7e18f641 None admin] RBAC: Adding query filter params (role.id=9aa6ce92dcbb4164ac0e44d2aa2a0248, scope.project.id=fa39ab7491e5413ca648e31ee9177fa0, user.id=a576c39228684b6281a4087acad6a52a) {{(pid=144068) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:12:03.916973 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64474446-6200-4560-bcc3-97dc7e18f641 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:12:03.919149 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64474446-6200-4560-bcc3-97dc7e18f641 None admin] RBAC: Authorization granted {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:12:03.928784 dv-cinder-851351-1-smb devstack@keystone.service[144068]: [pid: 144068|app: 0|req: 347/687] 10.222.0.42 () {56 vars in 1374 bytes} [Thu Jul 28 08:12:03 2022] GET /identity/v3/role_assignments?user.id=a576c39228684b6281a4087acad6a52a&scope.project.id=fa39ab7491e5413ca648e31ee9177fa0&role.id=9aa6ce92dcbb4164ac0e44d2aa2a0248 => generated 608 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:12:03.930484 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64474446-6200-4560-bcc3-97dc7e18f641 None admin] Authenticating user token {{(pid=144068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:12:04.025152 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG dbcounter [-] [144068] Writing DB stats keystone:SELECT=100 {{(pid=144068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:12:04.080958 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34d265b-8ee8-4637-a239-7a907669b733 None admin] Validating token access rules against request {{(pid=144067) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:12:04.139722 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac58bbde-345e-4348-91de-6d164f19291b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144067) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:12:04.140547 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64474446-6200-4560-bcc3-97dc7e18f641 None admin] Validating token access rules against request {{(pid=144068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:12:04.141129 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac58bbde-345e-4348-91de-6d164f19291b None admin] REQUEST_METHOD: `GET` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:12:04.141668 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac58bbde-345e-4348-91de-6d164f19291b None admin] SCRIPT_NAME: `/identity` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:12:04.142166 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac58bbde-345e-4348-91de-6d164f19291b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:12:04.156628 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac58bbde-345e-4348-91de-6d164f19291b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:12:04.158549 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac58bbde-345e-4348-91de-6d164f19291b None admin] RBAC: Authorization granted {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:12:04.181047 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application [None req-ac58bbde-345e-4348-91de-6d164f19291b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 08:12:04.181047 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:12:04.181047 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:12:04.181047 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:12:04.181047 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:12:04.181047 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:12:04.181047 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:12:04.181047 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:12:04.181047 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:12:04.181047 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:12:04.181047 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:12:04.181047 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:12:04.181047 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 08:12:04.181047 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 08:12:04.181047 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 08:12:04.182120 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 08:12:04.182120 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:12:04.182120 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:12:04.182120 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:12:04.182120 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:12:04.182120 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:12:04.182120 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:12:04.182120 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:12:04.182120 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application with Lock( Jul 28 08:12:04.182120 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:12:04.182120 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:12:04.182120 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:12:04.182120 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:12:04.182120 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:12:04.182120 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:12:04.182120 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:12:04.182120 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:12:04.183719 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 08:12:04.183719 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 08:12:04.183719 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 08:12:04.183719 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application Jul 28 08:12:04.183719 dv-cinder-851351-1-smb devstack@keystone.service[144067]: [pid: 144067|app: 0|req: 341/688] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 08:12:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 292 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:12:04.188029 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac58bbde-345e-4348-91de-6d164f19291b None admin] Authenticating user token {{(pid=144067) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:12:04.189852 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c195da22-68e4-4697-99ec-5983ddd3a2ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:12:04.190757 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c195da22-68e4-4697-99ec-5983ddd3a2ae None admin] REQUEST_METHOD: `GET` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:12:04.191555 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c195da22-68e4-4697-99ec-5983ddd3a2ae None admin] SCRIPT_NAME: `/identity` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:12:04.193017 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c195da22-68e4-4697-99ec-5983ddd3a2ae None admin] PATH_INFO: `/v3/users` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:12:04.194715 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c195da22-68e4-4697-99ec-5983ddd3a2ae None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=144068) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:12:04.194715 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c195da22-68e4-4697-99ec-5983ddd3a2ae None admin] RBAC: Authorizing `identity:list_users()` {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:12:04.195425 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c195da22-68e4-4697-99ec-5983ddd3a2ae None admin] RBAC: Authorization granted {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:12:04.218034 dv-cinder-851351-1-smb devstack@keystone.service[144068]: [pid: 144068|app: 0|req: 348/689] 10.222.0.42 () {56 vars in 1133 bytes} [Thu Jul 28 08:12:03 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 288 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:12:04.224296 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c195da22-68e4-4697-99ec-5983ddd3a2ae None admin] Authenticating user token {{(pid=144068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:12:04.231934 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG dbcounter [-] [144067] Writing DB stats keystone:SELECT=100 {{(pid=144067) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:12:04.323015 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac58bbde-345e-4348-91de-6d164f19291b None admin] Validating token access rules against request {{(pid=144067) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:12:04.345118 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG dbcounter [-] [144068] Writing DB stats keystone:SELECT=100 {{(pid=144068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:12:04.352138 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c195da22-68e4-4697-99ec-5983ddd3a2ae None admin] Validating token access rules against request {{(pid=144068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:12:04.370804 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b861dbf3-ab37-452e-bd3a-f2286966bda3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144067) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:12:04.371765 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b861dbf3-ab37-452e-bd3a-f2286966bda3 None admin] REQUEST_METHOD: `GET` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:12:04.372402 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b861dbf3-ab37-452e-bd3a-f2286966bda3 None admin] SCRIPT_NAME: `/identity` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:12:04.373008 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b861dbf3-ab37-452e-bd3a-f2286966bda3 None admin] PATH_INFO: `/v3/domains` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:12:04.373892 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b861dbf3-ab37-452e-bd3a-f2286966bda3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=144067) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:12:04.374535 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b861dbf3-ab37-452e-bd3a-f2286966bda3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:12:04.376343 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b861dbf3-ab37-452e-bd3a-f2286966bda3 None admin] RBAC: Authorization granted {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:12:04.391951 dv-cinder-851351-1-smb devstack@keystone.service[144067]: [pid: 144067|app: 0|req: 342/690] 10.222.0.42 () {56 vars in 1109 bytes} [Thu Jul 28 08:12:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:12:04.400521 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b861dbf3-ab37-452e-bd3a-f2286966bda3 None admin] Authenticating user token {{(pid=144067) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:12:04.431032 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66e9ede-cce6-4479-98bf-bc7f295d45a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:12:04.431733 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66e9ede-cce6-4479-98bf-bc7f295d45a7 None admin] REQUEST_METHOD: `GET` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:12:04.431955 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66e9ede-cce6-4479-98bf-bc7f295d45a7 None admin] SCRIPT_NAME: `/identity` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:12:04.432242 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66e9ede-cce6-4479-98bf-bc7f295d45a7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:12:04.562994 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG dbcounter [-] [144067] Writing DB stats keystone:SELECT=100 {{(pid=144067) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:12:04.581142 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d66e9ede-cce6-4479-98bf-bc7f295d45a7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:12:04.582696 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d66e9ede-cce6-4479-98bf-bc7f295d45a7 None admin] RBAC: Authorization granted {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:12:04.583835 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b861dbf3-ab37-452e-bd3a-f2286966bda3 None admin] Validating token access rules against request {{(pid=144067) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:12:04.693549 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92738ec0-20f8-44b4-a56f-5d504c9c47da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144067) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:12:04.694149 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92738ec0-20f8-44b4-a56f-5d504c9c47da None admin] REQUEST_METHOD: `GET` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:12:04.694433 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92738ec0-20f8-44b4-a56f-5d504c9c47da None admin] SCRIPT_NAME: `/identity` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:12:04.694711 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92738ec0-20f8-44b4-a56f-5d504c9c47da None admin] PATH_INFO: `/v3/users/swift` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:12:04.706672 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92738ec0-20f8-44b4-a56f-5d504c9c47da None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:12:04.708256 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92738ec0-20f8-44b4-a56f-5d504c9c47da None admin] RBAC: Authorization granted {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:12:04.722902 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application [None req-92738ec0-20f8-44b4-a56f-5d504c9c47da None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 28 08:12:04.722902 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:12:04.722902 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:12:04.722902 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:12:04.722902 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:12:04.722902 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:12:04.722902 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:12:04.722902 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:12:04.722902 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:12:04.722902 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:12:04.722902 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:12:04.722902 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:12:04.722902 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 28 08:12:04.722902 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 28 08:12:04.722902 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 28 08:12:04.722902 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 28 08:12:04.724081 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:12:04.724081 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:12:04.724081 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 28 08:12:04.724081 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 08:12:04.724081 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 28 08:12:04.724081 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 08:12:04.724081 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:12:04.724081 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:12:04.724081 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:12:04.724081 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:12:04.724081 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:12:04.724081 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application with Lock( Jul 28 08:12:04.724081 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:12:04.724081 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:12:04.724081 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:12:04.724081 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:12:04.724081 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:12:04.724081 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:12:04.725523 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:12:04.725523 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:12:04.725523 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 28 08:12:04.725523 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 28 08:12:04.725523 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 28 08:12:04.725523 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 28 08:12:04.725523 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 28 08:12:04.725523 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 28 08:12:04.725523 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 28 08:12:04.725523 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application Jul 28 08:12:04.725523 dv-cinder-851351-1-smb devstack@keystone.service[144067]: [pid: 144067|app: 0|req: 343/691] 10.222.0.42 () {56 vars in 1096 bytes} [Thu Jul 28 08:12:04 2022] GET /identity/v3/users/swift => generated 83 bytes in 326 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 08:12:04.745568 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92738ec0-20f8-44b4-a56f-5d504c9c47da None admin] Authenticating user token {{(pid=144067) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:12:04.756457 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG dbcounter [-] [144068] Writing DB stats keystone:SELECT=100 {{(pid=144068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:12:04.765404 dv-cinder-851351-1-smb devstack@keystone.service[144068]: [pid: 144068|app: 0|req: 349/692] 10.222.0.42 () {58 vars in 1282 bytes} [Thu Jul 28 08:12:04 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 541 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 28 08:12:04.767070 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66e9ede-cce6-4479-98bf-bc7f295d45a7 None admin] Authenticating user token {{(pid=144068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:12:04.904731 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92738ec0-20f8-44b4-a56f-5d504c9c47da None admin] Validating token access rules against request {{(pid=144067) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:12:04.940942 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42fb0983-2fd6-4ff6-995b-cbc10958304a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144067) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:12:04.941969 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fb0983-2fd6-4ff6-995b-cbc10958304a None admin] REQUEST_METHOD: `GET` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:12:04.942264 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fb0983-2fd6-4ff6-995b-cbc10958304a None admin] SCRIPT_NAME: `/identity` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:12:04.942531 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fb0983-2fd6-4ff6-995b-cbc10958304a None admin] PATH_INFO: `/v3/users` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:12:04.943322 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42fb0983-2fd6-4ff6-995b-cbc10958304a None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=144067) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:12:04.943707 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42fb0983-2fd6-4ff6-995b-cbc10958304a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:12:04.945135 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42fb0983-2fd6-4ff6-995b-cbc10958304a None admin] RBAC: Authorization granted {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:12:04.965721 dv-cinder-851351-1-smb devstack@keystone.service[144067]: [pid: 144067|app: 0|req: 344/693] 10.222.0.42 () {56 vars in 1135 bytes} [Thu Jul 28 08:12:04 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:12:04.971865 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42fb0983-2fd6-4ff6-995b-cbc10958304a None admin] Authenticating user token {{(pid=144067) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:12:04.996694 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG dbcounter [-] [144067] Writing DB stats keystone:SELECT=100 {{(pid=144067) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:12:05.074677 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66e9ede-cce6-4479-98bf-bc7f295d45a7 None admin] Validating token access rules against request {{(pid=144068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:12:05.080582 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42fb0983-2fd6-4ff6-995b-cbc10958304a None admin] Validating token access rules against request {{(pid=144067) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:12:05.131752 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ad290e-a591-4d3b-9a84-000d6a6e4708 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144067) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:12:05.132853 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ad290e-a591-4d3b-9a84-000d6a6e4708 None admin] REQUEST_METHOD: `GET` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:12:05.132853 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ad290e-a591-4d3b-9a84-000d6a6e4708 None admin] SCRIPT_NAME: `/identity` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:12:05.133205 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ad290e-a591-4d3b-9a84-000d6a6e4708 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:12:05.291439 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ad290e-a591-4d3b-9a84-000d6a6e4708 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:12:05.292892 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ad290e-a591-4d3b-9a84-000d6a6e4708 None admin] RBAC: Authorization granted {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:12:05.321076 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG dbcounter [-] [144067] Writing DB stats keystone:SELECT=100 {{(pid=144067) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:12:05.406958 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef579c61-e345-4a0e-9d8f-b1d2efdf0051 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:12:05.407629 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef579c61-e345-4a0e-9d8f-b1d2efdf0051 None admin] REQUEST_METHOD: `GET` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:12:05.407913 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef579c61-e345-4a0e-9d8f-b1d2efdf0051 None admin] SCRIPT_NAME: `/identity` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:12:05.408186 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef579c61-e345-4a0e-9d8f-b1d2efdf0051 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:12:05.428678 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef579c61-e345-4a0e-9d8f-b1d2efdf0051 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:12:05.429642 dv-cinder-851351-1-smb devstack@keystone.service[144067]: [pid: 144067|app: 0|req: 345/694] 10.222.0.42 () {58 vars in 1282 bytes} [Thu Jul 28 08:12:04 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 458 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 28 08:12:05.430158 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef579c61-e345-4a0e-9d8f-b1d2efdf0051 None admin] RBAC: Authorization granted {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:12:05.435211 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ad290e-a591-4d3b-9a84-000d6a6e4708 None admin] Authenticating user token {{(pid=144067) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:12:05.456362 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application [None req-ef579c61-e345-4a0e-9d8f-b1d2efdf0051 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 08:12:05.456362 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:12:05.456362 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:12:05.456362 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:12:05.456362 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:12:05.456362 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:12:05.456362 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:12:05.456362 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:12:05.456362 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:12:05.456362 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:12:05.456362 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:12:05.456362 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:12:05.456362 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 08:12:05.456362 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 08:12:05.456362 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 08:12:05.458411 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 08:12:05.458411 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:12:05.458411 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:12:05.458411 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:12:05.458411 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:12:05.458411 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:12:05.458411 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:12:05.458411 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:12:05.458411 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application with Lock( Jul 28 08:12:05.458411 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:12:05.458411 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:12:05.458411 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:12:05.458411 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:12:05.458411 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:12:05.458411 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:12:05.458411 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:12:05.458411 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:12:05.463029 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 08:12:05.463029 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 08:12:05.463029 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 08:12:05.463029 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application Jul 28 08:12:05.465614 dv-cinder-851351-1-smb devstack@keystone.service[144068]: [pid: 144068|app: 0|req: 350/695] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 08:12:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 698 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:12:05.474215 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef579c61-e345-4a0e-9d8f-b1d2efdf0051 None admin] Authenticating user token {{(pid=144068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:12:05.609034 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG dbcounter [-] [144068] Writing DB stats keystone:SELECT=100 {{(pid=144068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:12:05.625596 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ad290e-a591-4d3b-9a84-000d6a6e4708 None admin] Validating token access rules against request {{(pid=144067) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:12:05.644469 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG dbcounter [-] [144067] Writing DB stats keystone:SELECT=100 {{(pid=144067) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:12:05.691087 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef579c61-e345-4a0e-9d8f-b1d2efdf0051 None admin] Validating token access rules against request {{(pid=144068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:12:05.691416 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd47f13-627d-4a20-a7f5-0ec14fad420d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144067) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:12:05.692694 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd47f13-627d-4a20-a7f5-0ec14fad420d None admin] REQUEST_METHOD: `GET` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:12:05.693348 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd47f13-627d-4a20-a7f5-0ec14fad420d None admin] SCRIPT_NAME: `/identity` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:12:05.693978 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd47f13-627d-4a20-a7f5-0ec14fad420d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:12:05.714290 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acd47f13-627d-4a20-a7f5-0ec14fad420d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:12:05.717427 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acd47f13-627d-4a20-a7f5-0ec14fad420d None admin] RBAC: Authorization granted {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:12:05.727387 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e29687b-56e0-48f9-87b1-dbfa46684248 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:12:05.728302 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e29687b-56e0-48f9-87b1-dbfa46684248 None admin] REQUEST_METHOD: `GET` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:12:05.728826 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e29687b-56e0-48f9-87b1-dbfa46684248 None admin] SCRIPT_NAME: `/identity` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:12:05.729301 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e29687b-56e0-48f9-87b1-dbfa46684248 None admin] PATH_INFO: `/v3/domains` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:12:05.730229 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e29687b-56e0-48f9-87b1-dbfa46684248 None admin] RBAC: Adding query filter params (name=Default) {{(pid=144068) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:12:05.730809 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e29687b-56e0-48f9-87b1-dbfa46684248 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:12:05.732395 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e29687b-56e0-48f9-87b1-dbfa46684248 None admin] RBAC: Authorization granted {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:12:05.745217 dv-cinder-851351-1-smb devstack@keystone.service[144068]: [pid: 144068|app: 0|req: 351/696] 10.222.0.42 () {56 vars in 1109 bytes} [Thu Jul 28 08:12:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 08:12:05.746877 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f567d58c-3ff8-4f3a-aa03-71bb85eb4010 None None] REQUEST_METHOD: `GET` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:12:05.747256 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application [None req-acd47f13-627d-4a20-a7f5-0ec14fad420d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 08:12:05.747256 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:12:05.747256 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:12:05.747256 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:12:05.747256 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:12:05.747256 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:12:05.747256 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:12:05.747256 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:12:05.747256 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:12:05.747256 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:12:05.747256 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:12:05.747256 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:12:05.747256 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 08:12:05.747256 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 08:12:05.747256 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 08:12:05.748177 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 08:12:05.748177 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:12:05.748177 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:12:05.748177 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:12:05.748177 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:12:05.748177 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:12:05.748177 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:12:05.748177 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:12:05.748177 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application with Lock( Jul 28 08:12:05.748177 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:12:05.748177 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:12:05.748177 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:12:05.748177 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:12:05.748177 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:12:05.748177 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:12:05.748177 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:12:05.748177 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:12:05.749195 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 08:12:05.749195 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 08:12:05.749195 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 08:12:05.749195 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application Jul 28 08:12:05.750034 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f567d58c-3ff8-4f3a-aa03-71bb85eb4010 None None] SCRIPT_NAME: `/identity` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:12:05.750572 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f567d58c-3ff8-4f3a-aa03-71bb85eb4010 None None] PATH_INFO: `/` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:12:05.752359 dv-cinder-851351-1-smb devstack@keystone.service[144068]: [pid: 144068|app: 0|req: 352/698] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 08:12:05 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 08:12:05.753352 dv-cinder-851351-1-smb devstack@keystone.service[144067]: [pid: 144067|app: 0|req: 346/698] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 08:12:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 315 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:12:05.753484 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f567d58c-3ff8-4f3a-aa03-71bb85eb4010 None None] Authenticating user token {{(pid=144068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:12:05.758762 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029b5dac-76c4-4089-a78d-d6f189701cde None None] REQUEST_METHOD: `POST` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:12:05.759254 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029b5dac-76c4-4089-a78d-d6f189701cde None None] SCRIPT_NAME: `/identity` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:12:05.759765 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029b5dac-76c4-4089-a78d-d6f189701cde None None] PATH_INFO: `/v3/auth/tokens` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:12:05.793469 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.auth.core [None req-029b5dac-76c4-4089-a78d-d6f189701cde None None] MFA Rules not processed for user `bf5ceb8f07374635ad506b7d1b4f1612`. Rule list: `[]` (Enabled: `True`). {{(pid=144067) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 08:12:05.795724 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.fernet_utils [None req-029b5dac-76c4-4089-a78d-d6f189701cde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=144067) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:12:05.873391 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f567d58c-3ff8-4f3a-aa03-71bb85eb4010 None None] Validating token access rules against request {{(pid=144068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:12:05.881998 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG dbcounter [-] [144068] Writing DB stats keystone:SELECT=100 {{(pid=144068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:12:05.913640 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f41ebbe7-679c-4c06-b21d-8af1df74717b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:12:05.914736 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41ebbe7-679c-4c06-b21d-8af1df74717b None admin] REQUEST_METHOD: `GET` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:12:05.915221 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41ebbe7-679c-4c06-b21d-8af1df74717b None admin] SCRIPT_NAME: `/identity` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:12:05.915692 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41ebbe7-679c-4c06-b21d-8af1df74717b None admin] PATH_INFO: `/v3/projects/service` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:12:05.923383 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f41ebbe7-679c-4c06-b21d-8af1df74717b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:12:05.925260 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f41ebbe7-679c-4c06-b21d-8af1df74717b None admin] RBAC: Authorization granted {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:12:05.925636 dv-cinder-851351-1-smb devstack@keystone.service[144067]: [pid: 144067|app: 0|req: 347/699] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 08:12:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 28 08:12:05.927296 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-029b5dac-76c4-4089-a78d-d6f189701cde None None] Authenticating user token {{(pid=144067) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:12:05.937903 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application [None req-f41ebbe7-679c-4c06-b21d-8af1df74717b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 08:12:05.937903 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:12:05.937903 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:12:05.937903 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:12:05.937903 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:12:05.937903 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:12:05.937903 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:12:05.937903 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:12:05.937903 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:12:05.937903 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:12:05.937903 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:12:05.937903 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:12:05.937903 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 28 08:12:05.937903 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 28 08:12:05.937903 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 28 08:12:05.938906 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 28 08:12:05.938906 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:12:05.938906 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:12:05.938906 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:12:05.938906 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:12:05.938906 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:12:05.938906 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:12:05.938906 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:12:05.938906 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application with Lock( Jul 28 08:12:05.938906 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:12:05.938906 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:12:05.938906 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:12:05.938906 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:12:05.938906 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:12:05.938906 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:12:05.938906 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:12:05.938906 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:12:05.939904 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 28 08:12:05.939904 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 28 08:12:05.939904 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 28 08:12:05.939904 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 28 08:12:05.939904 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 28 08:12:05.939904 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 28 08:12:05.939904 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 08:12:05.939904 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application Jul 28 08:12:05.942929 dv-cinder-851351-1-smb devstack@keystone.service[144068]: [pid: 144068|app: 0|req: 353/700] 10.222.0.42 () {56 vars in 1111 bytes} [Thu Jul 28 08:12:05 2022] GET /identity/v3/projects/service => generated 88 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:12:05.944433 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0ed089-fce4-44e4-a3d3-d5800b894749 None None] REQUEST_METHOD: `GET` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:12:05.944947 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0ed089-fce4-44e4-a3d3-d5800b894749 None None] SCRIPT_NAME: `/identity` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:12:05.945547 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0ed089-fce4-44e4-a3d3-d5800b894749 None None] PATH_INFO: `/` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:12:05.947187 dv-cinder-851351-1-smb devstack@keystone.service[144068]: [pid: 144068|app: 0|req: 354/701] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 08:12:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 08:12:05.948630 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0ed089-fce4-44e4-a3d3-d5800b894749 None None] Authenticating user token {{(pid=144068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:12:06.042383 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG dbcounter [-] [144067] Writing DB stats keystone:SELECT=100 {{(pid=144067) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:12:06.055730 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-029b5dac-76c4-4089-a78d-d6f189701cde None None] Validating token access rules against request {{(pid=144067) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:12:06.080974 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0ed089-fce4-44e4-a3d3-d5800b894749 None None] Validating token access rules against request {{(pid=144068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:12:06.095234 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99208da0-751c-44ae-a98a-ef19831ae9dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144067) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:12:06.095906 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99208da0-751c-44ae-a98a-ef19831ae9dd None admin] REQUEST_METHOD: `GET` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:12:06.096191 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99208da0-751c-44ae-a98a-ef19831ae9dd None admin] SCRIPT_NAME: `/identity` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:12:06.096467 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99208da0-751c-44ae-a98a-ef19831ae9dd None admin] PATH_INFO: `/v3/domains` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:12:06.097234 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99208da0-751c-44ae-a98a-ef19831ae9dd None admin] RBAC: Adding query filter params (name=Default) {{(pid=144067) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:12:06.097657 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99208da0-751c-44ae-a98a-ef19831ae9dd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:12:06.099072 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99208da0-751c-44ae-a98a-ef19831ae9dd None admin] RBAC: Authorization granted {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:12:06.111522 dv-cinder-851351-1-smb devstack@keystone.service[144067]: [pid: 144067|app: 0|req: 348/702] 10.222.0.42 () {56 vars in 1109 bytes} [Thu Jul 28 08:12:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:12:06.111522 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae0ceea-da00-4b98-9ae4-e6127e024314 None None] REQUEST_METHOD: `POST` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:12:06.111522 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae0ceea-da00-4b98-9ae4-e6127e024314 None None] SCRIPT_NAME: `/identity` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:12:06.111522 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae0ceea-da00-4b98-9ae4-e6127e024314 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:12:06.122343 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a995694-3dfb-4550-8148-8a4fa7ad570a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:12:06.122978 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a995694-3dfb-4550-8148-8a4fa7ad570a None admin] REQUEST_METHOD: `GET` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:12:06.123256 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a995694-3dfb-4550-8148-8a4fa7ad570a None admin] SCRIPT_NAME: `/identity` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:12:06.123585 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a995694-3dfb-4550-8148-8a4fa7ad570a None admin] PATH_INFO: `/v3/projects` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:12:06.124289 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a995694-3dfb-4550-8148-8a4fa7ad570a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=144068) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:12:06.124597 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a995694-3dfb-4550-8148-8a4fa7ad570a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:12:06.126083 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a995694-3dfb-4550-8148-8a4fa7ad570a None admin] RBAC: Authorization granted {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:12:06.132313 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.auth.core [None req-5ae0ceea-da00-4b98-9ae4-e6127e024314 None None] MFA Rules not processed for user `bf5ceb8f07374635ad506b7d1b4f1612`. Rule list: `[]` (Enabled: `True`). {{(pid=144067) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 08:12:06.133553 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.fernet_utils [None req-5ae0ceea-da00-4b98-9ae4-e6127e024314 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=144067) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:12:06.143082 dv-cinder-851351-1-smb devstack@keystone.service[144068]: [pid: 144068|app: 0|req: 355/703] 10.222.0.42 () {56 vars in 1148 bytes} [Thu Jul 28 08:12:05 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 08:12:06.143082 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a995694-3dfb-4550-8148-8a4fa7ad570a None admin] Authenticating user token {{(pid=144068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:12:06.174162 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG dbcounter [-] [144068] Writing DB stats keystone:SELECT=100 {{(pid=144068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:12:06.212090 dv-cinder-851351-1-smb devstack@keystone.service[144067]: [pid: 144067|app: 0|req: 349/704] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 08:12:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 08:12:06.213566 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae0ceea-da00-4b98-9ae4-e6127e024314 None None] Authenticating user token {{(pid=144067) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:12:06.257330 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a995694-3dfb-4550-8148-8a4fa7ad570a None admin] Validating token access rules against request {{(pid=144068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:12:06.295553 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c16c57-8c71-494f-86f1-280bd32997e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:12:06.296220 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c16c57-8c71-494f-86f1-280bd32997e7 None admin] REQUEST_METHOD: `GET` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:12:06.296500 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c16c57-8c71-494f-86f1-280bd32997e7 None admin] SCRIPT_NAME: `/identity` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:12:06.296833 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c16c57-8c71-494f-86f1-280bd32997e7 None admin] PATH_INFO: `/v3/services/network` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:12:06.297555 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09c16c57-8c71-494f-86f1-280bd32997e7 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:12:06.298942 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09c16c57-8c71-494f-86f1-280bd32997e7 None admin] RBAC: Authorization granted {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:12:06.303350 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG dbcounter [-] [144067] Writing DB stats keystone:SELECT=100 {{(pid=144067) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:12:06.311592 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application [None req-09c16c57-8c71-494f-86f1-280bd32997e7 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jul 28 08:12:06.311592 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:12:06.311592 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 28 08:12:06.311592 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 28 08:12:06.311592 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 28 08:12:06.311592 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 28 08:12:06.311592 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 28 08:12:06.311592 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 08:12:06.311592 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 28 08:12:06.311592 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application Jul 28 08:12:06.311592 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 28 08:12:06.311592 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application Jul 28 08:12:06.311592 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:12:06.311592 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:12:06.311592 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:12:06.311592 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:12:06.311592 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:12:06.313325 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:12:06.313325 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:12:06.313325 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:12:06.313325 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:12:06.313325 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:12:06.313325 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:12:06.313325 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 28 08:12:06.313325 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 28 08:12:06.313325 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 28 08:12:06.313325 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 28 08:12:06.313325 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:12:06.313325 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:12:06.313325 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:12:06.313325 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:12:06.313325 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:12:06.313325 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:12:06.314575 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:12:06.314575 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application with Lock( Jul 28 08:12:06.314575 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:12:06.314575 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:12:06.314575 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:12:06.314575 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:12:06.314575 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:12:06.314575 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:12:06.314575 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:12:06.314575 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:12:06.314575 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 28 08:12:06.314575 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 08:12:06.314575 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 28 08:12:06.314575 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application Jul 28 08:12:06.314575 dv-cinder-851351-1-smb devstack@keystone.service[144068]: [pid: 144068|app: 0|req: 356/705] 10.222.0.42 () {56 vars in 1111 bytes} [Thu Jul 28 08:12:06 2022] GET /identity/v3/services/network => generated 88 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:12:06.315473 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c16c57-8c71-494f-86f1-280bd32997e7 None admin] Authenticating user token {{(pid=144068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:12:06.330895 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae0ceea-da00-4b98-9ae4-e6127e024314 None None] Validating token access rules against request {{(pid=144067) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:12:06.368952 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ca4586-c497-467b-8502-6fc7eaa30787 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144067) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:12:06.370038 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ca4586-c497-467b-8502-6fc7eaa30787 None admin] REQUEST_METHOD: `GET` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:12:06.370509 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ca4586-c497-467b-8502-6fc7eaa30787 None admin] SCRIPT_NAME: `/identity` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:12:06.370970 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ca4586-c497-467b-8502-6fc7eaa30787 None admin] PATH_INFO: `/v3/projects/service` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:12:06.383578 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2ca4586-c497-467b-8502-6fc7eaa30787 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:12:06.385332 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2ca4586-c497-467b-8502-6fc7eaa30787 None admin] RBAC: Authorization granted {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:12:06.398756 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application [None req-e2ca4586-c497-467b-8502-6fc7eaa30787 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 08:12:06.398756 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:12:06.398756 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:12:06.398756 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:12:06.398756 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:12:06.398756 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:12:06.398756 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:12:06.398756 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:12:06.398756 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:12:06.398756 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:12:06.398756 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:12:06.398756 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:12:06.398756 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 28 08:12:06.398756 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 28 08:12:06.398756 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 28 08:12:06.400025 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 28 08:12:06.400025 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:12:06.400025 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:12:06.400025 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:12:06.400025 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:12:06.400025 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:12:06.400025 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:12:06.400025 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:12:06.400025 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application with Lock( Jul 28 08:12:06.400025 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:12:06.400025 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:12:06.400025 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:12:06.400025 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:12:06.400025 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:12:06.400025 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:12:06.400025 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:12:06.400025 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:12:06.401232 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 28 08:12:06.401232 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 28 08:12:06.401232 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 28 08:12:06.401232 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 28 08:12:06.401232 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 28 08:12:06.401232 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 28 08:12:06.401232 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 08:12:06.401232 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application Jul 28 08:12:06.403203 dv-cinder-851351-1-smb devstack@keystone.service[144067]: [pid: 144067|app: 0|req: 350/706] 10.222.0.42 () {56 vars in 1111 bytes} [Thu Jul 28 08:12:06 2022] GET /identity/v3/projects/service => generated 88 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:12:06.404205 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ca4586-c497-467b-8502-6fc7eaa30787 None admin] Authenticating user token {{(pid=144067) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:12:06.411657 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG dbcounter [-] [144068] Writing DB stats keystone:SELECT=100 {{(pid=144068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:12:06.423357 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c16c57-8c71-494f-86f1-280bd32997e7 None admin] Validating token access rules against request {{(pid=144068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:12:06.459635 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5a0b10-edaa-42b0-86e6-48d754f54c52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:12:06.460263 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5a0b10-edaa-42b0-86e6-48d754f54c52 None admin] REQUEST_METHOD: `GET` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:12:06.460541 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5a0b10-edaa-42b0-86e6-48d754f54c52 None admin] SCRIPT_NAME: `/identity` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:12:06.461216 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5a0b10-edaa-42b0-86e6-48d754f54c52 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:12:06.462015 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b5a0b10-edaa-42b0-86e6-48d754f54c52 None admin] RBAC: Adding query filter params (role.id=d1020e7bb0b7411d895ddedd6dc02c5b, scope.project.id=fa39ab7491e5413ca648e31ee9177fa0, user.id=2c1de9cd80344cefa3e06ae8c9c9e5d9) {{(pid=144068) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:12:06.462320 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b5a0b10-edaa-42b0-86e6-48d754f54c52 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:12:06.463751 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b5a0b10-edaa-42b0-86e6-48d754f54c52 None admin] RBAC: Authorization granted {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:12:06.469348 dv-cinder-851351-1-smb devstack@keystone.service[144068]: [pid: 144068|app: 0|req: 357/707] 10.222.0.42 () {56 vars in 1374 bytes} [Thu Jul 28 08:12:06 2022] GET /identity/v3/role_assignments?user.id=2c1de9cd80344cefa3e06ae8c9c9e5d9&scope.project.id=fa39ab7491e5413ca648e31ee9177fa0&role.id=d1020e7bb0b7411d895ddedd6dc02c5b => generated 259 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:12:06.470141 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5a0b10-edaa-42b0-86e6-48d754f54c52 None admin] Authenticating user token {{(pid=144068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:12:06.540245 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ca4586-c497-467b-8502-6fc7eaa30787 None admin] Validating token access rules against request {{(pid=144067) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:12:06.589000 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5a0b10-edaa-42b0-86e6-48d754f54c52 None admin] Validating token access rules against request {{(pid=144068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:12:06.589625 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e627b5-79fb-4ef6-880d-640fee11a6de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144067) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:12:06.590295 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e627b5-79fb-4ef6-880d-640fee11a6de None admin] REQUEST_METHOD: `GET` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:12:06.590574 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e627b5-79fb-4ef6-880d-640fee11a6de None admin] SCRIPT_NAME: `/identity` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:12:06.590847 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e627b5-79fb-4ef6-880d-640fee11a6de None admin] PATH_INFO: `/v3/domains/Default` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:12:06.604750 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG dbcounter [-] [144067] Writing DB stats keystone:SELECT=100 {{(pid=144067) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:12:06.606547 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47e627b5-79fb-4ef6-880d-640fee11a6de None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:12:06.608462 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47e627b5-79fb-4ef6-880d-640fee11a6de None admin] RBAC: Authorization granted {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:12:06.632389 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application [None req-47e627b5-79fb-4ef6-880d-640fee11a6de None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 08:12:06.632389 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:12:06.632389 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:12:06.632389 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:12:06.632389 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:12:06.632389 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:12:06.632389 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:12:06.632389 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:12:06.632389 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:12:06.632389 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:12:06.632389 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:12:06.632389 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:12:06.632389 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 08:12:06.632389 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 08:12:06.632389 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 08:12:06.633525 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 08:12:06.633525 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:12:06.633525 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:12:06.633525 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:12:06.633525 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:12:06.633525 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:12:06.633525 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:12:06.633525 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:12:06.633525 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application with Lock( Jul 28 08:12:06.633525 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:12:06.633525 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:12:06.633525 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:12:06.633525 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:12:06.633525 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:12:06.633525 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:12:06.633525 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:12:06.633525 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:12:06.634575 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 08:12:06.634575 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 08:12:06.634575 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 08:12:06.634575 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application Jul 28 08:12:06.640830 dv-cinder-851351-1-smb devstack@keystone.service[144067]: [pid: 144067|app: 0|req: 351/708] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 08:12:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:12:06.640830 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e627b5-79fb-4ef6-880d-640fee11a6de None admin] Authenticating user token {{(pid=144067) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:12:06.647155 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eec1286-b1a6-4e42-aa07-3d8cc25eb4e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:12:06.647779 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eec1286-b1a6-4e42-aa07-3d8cc25eb4e0 None admin] REQUEST_METHOD: `GET` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:12:06.648064 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eec1286-b1a6-4e42-aa07-3d8cc25eb4e0 None admin] SCRIPT_NAME: `/identity` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:12:06.648764 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eec1286-b1a6-4e42-aa07-3d8cc25eb4e0 None admin] PATH_INFO: `/v3/services` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:12:06.649128 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eec1286-b1a6-4e42-aa07-3d8cc25eb4e0 None admin] RBAC: Adding query filter params (name=network) {{(pid=144068) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:12:06.649462 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eec1286-b1a6-4e42-aa07-3d8cc25eb4e0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:12:06.650919 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eec1286-b1a6-4e42-aa07-3d8cc25eb4e0 None admin] RBAC: Authorization granted {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:12:06.657252 dv-cinder-851351-1-smb devstack@keystone.service[144068]: [pid: 144068|app: 0|req: 358/709] 10.222.0.42 () {56 vars in 1112 bytes} [Thu Jul 28 08:12:06 2022] GET /identity/v3/services?name=network => generated 124 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:12:06.658220 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eec1286-b1a6-4e42-aa07-3d8cc25eb4e0 None admin] Authenticating user token {{(pid=144068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:12:06.688807 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG dbcounter [-] [144068] Writing DB stats keystone:SELECT=100 {{(pid=144068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:12:06.778597 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e627b5-79fb-4ef6-880d-640fee11a6de None admin] Validating token access rules against request {{(pid=144067) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:12:06.792570 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eec1286-b1a6-4e42-aa07-3d8cc25eb4e0 None admin] Validating token access rules against request {{(pid=144068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:12:06.820135 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5a1866-dfd5-4272-a545-160d1b993c35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144067) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:12:06.820919 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5a1866-dfd5-4272-a545-160d1b993c35 None admin] REQUEST_METHOD: `GET` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:12:06.821201 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5a1866-dfd5-4272-a545-160d1b993c35 None admin] SCRIPT_NAME: `/identity` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:12:06.821695 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5a1866-dfd5-4272-a545-160d1b993c35 None admin] PATH_INFO: `/v3/projects` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:12:06.822443 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a5a1866-dfd5-4272-a545-160d1b993c35 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=144067) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:12:06.822722 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a5a1866-dfd5-4272-a545-160d1b993c35 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:12:06.824368 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a5a1866-dfd5-4272-a545-160d1b993c35 None admin] RBAC: Authorization granted {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:12:06.831661 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57dcc26c-881e-464e-95ff-3408324a6fa8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:12:06.832336 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57dcc26c-881e-464e-95ff-3408324a6fa8 None admin] REQUEST_METHOD: `GET` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:12:06.832619 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57dcc26c-881e-464e-95ff-3408324a6fa8 None admin] SCRIPT_NAME: `/identity` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:12:06.832935 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57dcc26c-881e-464e-95ff-3408324a6fa8 None admin] PATH_INFO: `/v3/domains` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:12:06.833646 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57dcc26c-881e-464e-95ff-3408324a6fa8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=144068) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:12:06.833957 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57dcc26c-881e-464e-95ff-3408324a6fa8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:12:06.835339 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57dcc26c-881e-464e-95ff-3408324a6fa8 None admin] RBAC: Authorization granted {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:12:06.844415 dv-cinder-851351-1-smb devstack@keystone.service[144067]: [pid: 144067|app: 0|req: 352/710] 10.222.0.42 () {56 vars in 1148 bytes} [Thu Jul 28 08:12:06 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:12:06.845602 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5a1866-dfd5-4272-a545-160d1b993c35 None admin] Authenticating user token {{(pid=144067) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:12:06.848428 dv-cinder-851351-1-smb devstack@keystone.service[144068]: [pid: 144068|app: 0|req: 359/711] 10.222.0.42 () {56 vars in 1109 bytes} [Thu Jul 28 08:12:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:12:06.849759 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c143152-1f4c-4181-acc0-62b5c335286e None None] REQUEST_METHOD: `GET` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:12:06.850050 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c143152-1f4c-4181-acc0-62b5c335286e None None] SCRIPT_NAME: `/identity` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:12:06.850328 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c143152-1f4c-4181-acc0-62b5c335286e None None] PATH_INFO: `/` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:12:06.851705 dv-cinder-851351-1-smb devstack@keystone.service[144068]: [pid: 144068|app: 0|req: 360/712] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 08:12:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 08:12:06.855235 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c143152-1f4c-4181-acc0-62b5c335286e None None] Authenticating user token {{(pid=144068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:12:06.909204 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG dbcounter [-] [144067] Writing DB stats keystone:SELECT=100 {{(pid=144067) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:12:06.945521 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG dbcounter [-] [144068] Writing DB stats keystone:SELECT=100 {{(pid=144068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:12:06.960300 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5a1866-dfd5-4272-a545-160d1b993c35 None admin] Validating token access rules against request {{(pid=144067) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:12:06.977334 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c143152-1f4c-4181-acc0-62b5c335286e None None] Validating token access rules against request {{(pid=144068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:12:07.002679 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea05707-462c-45e1-88ad-92bc5bbf92bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144067) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:12:07.003321 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea05707-462c-45e1-88ad-92bc5bbf92bc None admin] REQUEST_METHOD: `GET` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:12:07.003605 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea05707-462c-45e1-88ad-92bc5bbf92bc None admin] SCRIPT_NAME: `/identity` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:12:07.003922 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea05707-462c-45e1-88ad-92bc5bbf92bc None admin] PATH_INFO: `/v3/services` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:12:07.004620 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ea05707-462c-45e1-88ad-92bc5bbf92bc None admin] RBAC: Adding query filter params (type=network) {{(pid=144067) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:12:07.004959 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ea05707-462c-45e1-88ad-92bc5bbf92bc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:12:07.006384 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ea05707-462c-45e1-88ad-92bc5bbf92bc None admin] RBAC: Authorization granted {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:12:07.024706 dv-cinder-851351-1-smb devstack@keystone.service[144067]: [pid: 144067|app: 0|req: 353/713] 10.222.0.42 () {56 vars in 1112 bytes} [Thu Jul 28 08:12:06 2022] GET /identity/v3/services?type=network => generated 124 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:12:07.024706 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea05707-462c-45e1-88ad-92bc5bbf92bc None admin] Authenticating user token {{(pid=144067) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:12:07.026363 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d900890f-0342-4363-adc5-c8d0599138ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:12:07.027196 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d900890f-0342-4363-adc5-c8d0599138ed None admin] REQUEST_METHOD: `GET` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:12:07.027482 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d900890f-0342-4363-adc5-c8d0599138ed None admin] SCRIPT_NAME: `/identity` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:12:07.027757 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d900890f-0342-4363-adc5-c8d0599138ed None admin] PATH_INFO: `/v3/role_assignments` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:12:07.028641 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d900890f-0342-4363-adc5-c8d0599138ed None admin] RBAC: Adding query filter params (role.id=9aa6ce92dcbb4164ac0e44d2aa2a0248, scope.project.id=fa39ab7491e5413ca648e31ee9177fa0, user.id=fffb2166afc14796bc3c9c9eba793ec0) {{(pid=144068) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:12:07.029023 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d900890f-0342-4363-adc5-c8d0599138ed None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:12:07.030692 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d900890f-0342-4363-adc5-c8d0599138ed None admin] RBAC: Authorization granted {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:12:07.038626 dv-cinder-851351-1-smb devstack@keystone.service[144068]: [pid: 144068|app: 0|req: 361/714] 10.222.0.42 () {56 vars in 1374 bytes} [Thu Jul 28 08:12:06 2022] GET /identity/v3/role_assignments?user.id=fffb2166afc14796bc3c9c9eba793ec0&scope.project.id=fa39ab7491e5413ca648e31ee9177fa0&role.id=9aa6ce92dcbb4164ac0e44d2aa2a0248 => generated 608 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:12:07.040045 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce18453f-35ad-49c7-8bcd-06385f17f54f None None] REQUEST_METHOD: `POST` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:12:07.040335 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce18453f-35ad-49c7-8bcd-06385f17f54f None None] SCRIPT_NAME: `/identity` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:12:07.040610 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce18453f-35ad-49c7-8bcd-06385f17f54f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:12:07.071653 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.auth.core [None req-ce18453f-35ad-49c7-8bcd-06385f17f54f None None] MFA Rules not processed for user `bf5ceb8f07374635ad506b7d1b4f1612`. Rule list: `[]` (Enabled: `True`). {{(pid=144068) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 08:12:07.073167 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.fernet_utils [None req-ce18453f-35ad-49c7-8bcd-06385f17f54f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=144068) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:12:07.237016 dv-cinder-851351-1-smb devstack@keystone.service[144068]: [pid: 144068|app: 0|req: 362/715] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 08:12:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 08:12:07.243392 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea05707-462c-45e1-88ad-92bc5bbf92bc None admin] Validating token access rules against request {{(pid=144067) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:12:07.263314 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce18453f-35ad-49c7-8bcd-06385f17f54f None None] Authenticating user token {{(pid=144068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:12:07.266870 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG dbcounter [-] [144067] Writing DB stats keystone:SELECT=100 {{(pid=144067) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:12:07.305569 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-232ff879-b4ec-43e6-b8f2-c6ce899f46b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144067) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:12:07.306224 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232ff879-b4ec-43e6-b8f2-c6ce899f46b8 None admin] REQUEST_METHOD: `POST` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:12:07.306512 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232ff879-b4ec-43e6-b8f2-c6ce899f46b8 None admin] SCRIPT_NAME: `/identity` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:12:07.306787 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232ff879-b4ec-43e6-b8f2-c6ce899f46b8 None admin] PATH_INFO: `/v3/users` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:12:07.307497 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-232ff879-b4ec-43e6-b8f2-c6ce899f46b8 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:12:07.309126 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-232ff879-b4ec-43e6-b8f2-c6ce899f46b8 None admin] RBAC: Authorization granted {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:12:07.334541 dv-cinder-851351-1-smb devstack@keystone.service[144067]: [pid: 144067|app: 0|req: 354/716] 10.222.0.42 () {60 vars in 1132 bytes} [Thu Jul 28 08:12:07 2022] POST /identity/v3/users => generated 254 bytes in 321 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 08:12:07.360820 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG dbcounter [-] [144068] Writing DB stats keystone:SELECT=100 {{(pid=144068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:12:07.399118 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce18453f-35ad-49c7-8bcd-06385f17f54f None None] Validating token access rules against request {{(pid=144068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:12:07.440418 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3fd0033-0e4a-462c-9ec4-77f4bf08e4e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:12:07.441140 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3fd0033-0e4a-462c-9ec4-77f4bf08e4e6 None admin] REQUEST_METHOD: `GET` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:12:07.441511 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3fd0033-0e4a-462c-9ec4-77f4bf08e4e6 None admin] SCRIPT_NAME: `/identity` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:12:07.441741 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3fd0033-0e4a-462c-9ec4-77f4bf08e4e6 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:12:07.442407 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3fd0033-0e4a-462c-9ec4-77f4bf08e4e6 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:12:07.443846 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3fd0033-0e4a-462c-9ec4-77f4bf08e4e6 None admin] RBAC: Authorization granted {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:12:07.454065 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application [None req-b3fd0033-0e4a-462c-9ec4-77f4bf08e4e6 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 28 08:12:07.454065 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:12:07.454065 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 28 08:12:07.454065 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 28 08:12:07.454065 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 28 08:12:07.454065 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 28 08:12:07.454065 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 28 08:12:07.454065 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 08:12:07.454065 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 28 08:12:07.454065 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application Jul 28 08:12:07.454065 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 28 08:12:07.454065 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application Jul 28 08:12:07.454065 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:12:07.454065 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:12:07.454065 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:12:07.454065 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:12:07.455204 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:12:07.455204 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:12:07.455204 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:12:07.455204 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:12:07.455204 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:12:07.455204 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:12:07.455204 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:12:07.455204 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 28 08:12:07.455204 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 28 08:12:07.455204 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 28 08:12:07.455204 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 28 08:12:07.455204 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:12:07.455204 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:12:07.455204 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:12:07.455204 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:12:07.455204 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:12:07.456138 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:12:07.456138 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:12:07.456138 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application with Lock( Jul 28 08:12:07.456138 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:12:07.456138 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:12:07.456138 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:12:07.456138 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:12:07.456138 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:12:07.456138 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:12:07.456138 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:12:07.456138 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:12:07.456138 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 28 08:12:07.456138 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 08:12:07.456138 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 28 08:12:07.456138 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application Jul 28 08:12:07.456138 dv-cinder-851351-1-smb devstack@keystone.service[144068]: [pid: 144068|app: 0|req: 363/717] 10.222.0.42 () {56 vars in 1129 bytes} [Thu Jul 28 08:12:07 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 08:12:07.463807 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-232ff879-b4ec-43e6-b8f2-c6ce899f46b8 None admin] Authenticating user token {{(pid=144067) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:12:07.595040 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-232ff879-b4ec-43e6-b8f2-c6ce899f46b8 None admin] Validating token access rules against request {{(pid=144067) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:12:07.632062 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31462cad-134e-4b5e-93af-be5375f89de1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144067) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:12:07.636688 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31462cad-134e-4b5e-93af-be5375f89de1 None admin] REQUEST_METHOD: `GET` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:12:07.636688 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31462cad-134e-4b5e-93af-be5375f89de1 None admin] SCRIPT_NAME: `/identity` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:12:07.636688 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31462cad-134e-4b5e-93af-be5375f89de1 None admin] PATH_INFO: `/v3/services` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:12:07.636688 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31462cad-134e-4b5e-93af-be5375f89de1 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=144067) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:12:07.636688 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31462cad-134e-4b5e-93af-be5375f89de1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:12:07.636688 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31462cad-134e-4b5e-93af-be5375f89de1 None admin] RBAC: Authorization granted {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:12:07.641614 dv-cinder-851351-1-smb devstack@keystone.service[144067]: [pid: 144067|app: 0|req: 355/718] 10.222.0.42 () {56 vars in 1124 bytes} [Thu Jul 28 08:12:07 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:12:07.647474 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3fd0033-0e4a-462c-9ec4-77f4bf08e4e6 None admin] Authenticating user token {{(pid=144068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:12:07.766228 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3fd0033-0e4a-462c-9ec4-77f4bf08e4e6 None admin] Validating token access rules against request {{(pid=144068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:12:07.806404 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2dcedae-d1f0-4fd7-9921-da2e4b2c5edc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:12:07.807367 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2dcedae-d1f0-4fd7-9921-da2e4b2c5edc None admin] REQUEST_METHOD: `GET` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:12:07.807833 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2dcedae-d1f0-4fd7-9921-da2e4b2c5edc None admin] SCRIPT_NAME: `/identity` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:12:07.808325 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2dcedae-d1f0-4fd7-9921-da2e4b2c5edc None admin] PATH_INFO: `/v3/services` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:12:07.809273 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2dcedae-d1f0-4fd7-9921-da2e4b2c5edc None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=144068) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:12:07.809759 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2dcedae-d1f0-4fd7-9921-da2e4b2c5edc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:12:07.811332 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2dcedae-d1f0-4fd7-9921-da2e4b2c5edc None admin] RBAC: Authorization granted {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:12:07.817235 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG dbcounter [-] [144068] Writing DB stats keystone:SELECT=100 {{(pid=144068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:12:07.820979 dv-cinder-851351-1-smb devstack@keystone.service[144068]: [pid: 144068|app: 0|req: 364/719] 10.222.0.42 () {56 vars in 1124 bytes} [Thu Jul 28 08:12:07 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:12:08.642708 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c67924-0cbe-4e82-8d27-cbdab746c568 None None] REQUEST_METHOD: `GET` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:12:08.643271 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c67924-0cbe-4e82-8d27-cbdab746c568 None None] SCRIPT_NAME: `/identity` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:12:08.643271 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c67924-0cbe-4e82-8d27-cbdab746c568 None None] PATH_INFO: `/` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:12:08.645253 dv-cinder-851351-1-smb devstack@keystone.service[144067]: [pid: 144067|app: 0|req: 356/720] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 08:12:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 08:12:08.650803 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feda2561-d71c-4951-9ce0-0e23ac0c3eaa None None] REQUEST_METHOD: `POST` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:12:08.651360 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feda2561-d71c-4951-9ce0-0e23ac0c3eaa None None] SCRIPT_NAME: `/identity` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:12:08.651360 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feda2561-d71c-4951-9ce0-0e23ac0c3eaa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:12:08.673380 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.auth.core [None req-feda2561-d71c-4951-9ce0-0e23ac0c3eaa None None] MFA Rules not processed for user `bf5ceb8f07374635ad506b7d1b4f1612`. Rule list: `[]` (Enabled: `True`). {{(pid=144068) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 08:12:08.674609 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.fernet_utils [None req-feda2561-d71c-4951-9ce0-0e23ac0c3eaa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=144068) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:12:08.762971 dv-cinder-851351-1-smb devstack@keystone.service[144068]: [pid: 144068|app: 0|req: 365/721] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 08:12:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 08:12:08.799584 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c67924-0cbe-4e82-8d27-cbdab746c568 None None] Authenticating user token {{(pid=144067) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:12:08.868572 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG dbcounter [-] [144067] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=144067) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:12:08.973087 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c67924-0cbe-4e82-8d27-cbdab746c568 None None] Validating token access rules against request {{(pid=144067) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:12:09.046739 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c167114b-7628-4d77-ba31-defb19412258 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144067) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:12:09.048055 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c167114b-7628-4d77-ba31-defb19412258 None admin] REQUEST_METHOD: `GET` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:12:09.048783 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c167114b-7628-4d77-ba31-defb19412258 None admin] SCRIPT_NAME: `/identity` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:12:09.049654 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c167114b-7628-4d77-ba31-defb19412258 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:12:09.073774 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c167114b-7628-4d77-ba31-defb19412258 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 08:12:09.079312 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application [None req-c167114b-7628-4d77-ba31-defb19412258 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 08:12:09.079312 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:12:09.079312 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:12:09.079312 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:12:09.079312 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:12:09.079312 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:12:09.079312 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:12:09.079312 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:12:09.079312 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:12:09.079312 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:12:09.079312 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:12:09.079312 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:12:09.079312 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 08:12:09.079312 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 08:12:09.079312 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 08:12:09.079312 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 08:12:09.080402 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 08:12:09.080402 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 08:12:09.080402 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 08:12:09.080402 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 08:12:09.080402 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:12:09.080402 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:12:09.080402 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:12:09.080402 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:12:09.080402 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:12:09.080402 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:12:09.080402 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:12:09.080402 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application with Lock( Jul 28 08:12:09.080402 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:12:09.080402 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:12:09.080402 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:12:09.080402 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:12:09.081350 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:12:09.081350 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:12:09.081350 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:12:09.081350 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:12:09.081350 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 08:12:09.081350 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 08:12:09.081350 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 08:12:09.081350 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 08:12:09.081350 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 08:12:09.081350 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 08:12:09.081350 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 08:12:09.081350 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application Jul 28 08:12:09.081350 dv-cinder-851351-1-smb devstack@keystone.service[144067]: [pid: 144067|app: 0|req: 357/722] 10.222.0.42 () {56 vars in 1096 bytes} [Thu Jul 28 08:12:08 2022] GET /identity/v3/roles/admin => generated 83 bytes in 282 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:12:09.089859 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feda2561-d71c-4951-9ce0-0e23ac0c3eaa None None] Authenticating user token {{(pid=144068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:12:09.252974 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feda2561-d71c-4951-9ce0-0e23ac0c3eaa None None] Validating token access rules against request {{(pid=144068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:12:09.293500 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG dbcounter [-] [144068] Writing DB stats keystone:SELECT=100 {{(pid=144068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:12:09.299574 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a760e3f-c77b-4618-ab40-172488ecd9d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:12:09.300216 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a760e3f-c77b-4618-ab40-172488ecd9d8 None admin] REQUEST_METHOD: `GET` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:12:09.300499 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a760e3f-c77b-4618-ab40-172488ecd9d8 None admin] SCRIPT_NAME: `/identity` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:12:09.300860 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a760e3f-c77b-4618-ab40-172488ecd9d8 None admin] PATH_INFO: `/v3/roles` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:12:09.305501 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a760e3f-c77b-4618-ab40-172488ecd9d8 None admin] RBAC: Adding query filter params (name=admin) {{(pid=144068) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:12:09.305825 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a760e3f-c77b-4618-ab40-172488ecd9d8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:12:09.307238 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a760e3f-c77b-4618-ab40-172488ecd9d8 None admin] RBAC: Authorization granted {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:12:09.316651 dv-cinder-851351-1-smb devstack@keystone.service[144068]: [pid: 144068|app: 0|req: 366/723] 10.222.0.42 () {56 vars in 1099 bytes} [Thu Jul 28 08:12:09 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:12:09.321943 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c167114b-7628-4d77-ba31-defb19412258 None admin] Authenticating user token {{(pid=144067) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:12:09.507435 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fba43e6-24d3-4b69-821a-55e9410607f8 None None] REQUEST_METHOD: `GET` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:12:09.507630 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fba43e6-24d3-4b69-821a-55e9410607f8 None None] SCRIPT_NAME: `/identity` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:12:09.507927 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fba43e6-24d3-4b69-821a-55e9410607f8 None None] PATH_INFO: `/` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:12:09.508185 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG dbcounter [-] [144067] Writing DB stats keystone:SELECT=100 {{(pid=144067) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:12:09.509540 dv-cinder-851351-1-smb devstack@keystone.service[144068]: [pid: 144068|app: 0|req: 367/724] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 08:12:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 28 08:12:09.518192 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1e161b-dde0-4027-9dfa-0e3e49ad3fd1 None None] REQUEST_METHOD: `POST` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:12:09.518477 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1e161b-dde0-4027-9dfa-0e3e49ad3fd1 None None] SCRIPT_NAME: `/identity` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:12:09.518764 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1e161b-dde0-4027-9dfa-0e3e49ad3fd1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:12:09.520978 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c167114b-7628-4d77-ba31-defb19412258 None admin] Validating token access rules against request {{(pid=144067) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:12:09.561895 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.auth.core [None req-fc1e161b-dde0-4027-9dfa-0e3e49ad3fd1 None None] MFA Rules not processed for user `bf5ceb8f07374635ad506b7d1b4f1612`. Rule list: `[]` (Enabled: `True`). {{(pid=144068) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 08:12:09.563163 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.fernet_utils [None req-fc1e161b-dde0-4027-9dfa-0e3e49ad3fd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=144068) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:12:09.564853 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9aea04d-cd34-485c-8ba4-ed67827910be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144067) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:12:09.566190 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9aea04d-cd34-485c-8ba4-ed67827910be None admin] REQUEST_METHOD: `GET` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:12:09.566693 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9aea04d-cd34-485c-8ba4-ed67827910be None admin] SCRIPT_NAME: `/identity` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:12:09.567124 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9aea04d-cd34-485c-8ba4-ed67827910be None admin] PATH_INFO: `/v3/domains/Default` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:12:09.582555 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9aea04d-cd34-485c-8ba4-ed67827910be None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:12:09.584355 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9aea04d-cd34-485c-8ba4-ed67827910be None admin] RBAC: Authorization granted {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:12:09.611112 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application [None req-c9aea04d-cd34-485c-8ba4-ed67827910be None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 08:12:09.611112 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:12:09.611112 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:12:09.611112 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:12:09.611112 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:12:09.611112 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:12:09.611112 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:12:09.611112 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:12:09.611112 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:12:09.611112 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:12:09.611112 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:12:09.611112 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:12:09.611112 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 08:12:09.611112 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 08:12:09.611112 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 08:12:09.613371 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 08:12:09.613371 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:12:09.613371 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:12:09.613371 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:12:09.613371 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:12:09.613371 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:12:09.613371 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:12:09.613371 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:12:09.613371 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application with Lock( Jul 28 08:12:09.613371 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:12:09.613371 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:12:09.613371 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:12:09.613371 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:12:09.613371 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:12:09.613371 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:12:09.613371 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:12:09.613371 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:12:09.616044 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 08:12:09.616044 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 08:12:09.616044 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 08:12:09.616044 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application Jul 28 08:12:09.620233 dv-cinder-851351-1-smb devstack@keystone.service[144067]: [pid: 144067|app: 0|req: 358/725] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 08:12:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 299 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:12:09.627258 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9aea04d-cd34-485c-8ba4-ed67827910be None admin] Authenticating user token {{(pid=144067) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:12:09.716983 dv-cinder-851351-1-smb devstack@keystone.service[144068]: [pid: 144068|app: 0|req: 368/726] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 08:12:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 08:12:09.730518 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b7e7ab-a273-43ac-a9db-5e072b02cad3 None None] REQUEST_METHOD: `GET` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:12:09.730828 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b7e7ab-a273-43ac-a9db-5e072b02cad3 None None] SCRIPT_NAME: `/identity` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:12:09.731099 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b7e7ab-a273-43ac-a9db-5e072b02cad3 None None] PATH_INFO: `/` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:12:09.732767 dv-cinder-851351-1-smb devstack@keystone.service[144068]: [pid: 144068|app: 0|req: 369/727] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 08:12:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 28 08:12:09.738963 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db53742-c2d6-492e-b537-096916c50960 None None] REQUEST_METHOD: `POST` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:12:09.739238 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db53742-c2d6-492e-b537-096916c50960 None None] SCRIPT_NAME: `/identity` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:12:09.739560 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db53742-c2d6-492e-b537-096916c50960 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:12:09.763326 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.auth.core [None req-2db53742-c2d6-492e-b537-096916c50960 None None] MFA Rules not processed for user `bf5ceb8f07374635ad506b7d1b4f1612`. Rule list: `[]` (Enabled: `True`). {{(pid=144068) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 08:12:09.764471 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.fernet_utils [None req-2db53742-c2d6-492e-b537-096916c50960 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=144068) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:12:09.841785 dv-cinder-851351-1-smb devstack@keystone.service[144068]: [pid: 144068|app: 0|req: 370/728] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 08:12:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (3 switches on core 0) Jul 28 08:12:09.842752 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db53742-c2d6-492e-b537-096916c50960 None None] Authenticating user token {{(pid=144068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:12:09.851975 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9aea04d-cd34-485c-8ba4-ed67827910be None admin] Validating token access rules against request {{(pid=144067) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:12:09.899565 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG dbcounter [-] [144068] Writing DB stats keystone:SELECT=100 {{(pid=144068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:12:09.920086 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a804dd9-328d-400d-a563-b3c14abccbdb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144067) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:12:09.921537 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a804dd9-328d-400d-a563-b3c14abccbdb None admin] REQUEST_METHOD: `GET` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:12:09.922341 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a804dd9-328d-400d-a563-b3c14abccbdb None admin] SCRIPT_NAME: `/identity` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:12:09.923278 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a804dd9-328d-400d-a563-b3c14abccbdb None admin] PATH_INFO: `/v3/domains` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:12:09.924838 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a804dd9-328d-400d-a563-b3c14abccbdb None admin] RBAC: Adding query filter params (name=Default) {{(pid=144067) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:12:09.925818 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a804dd9-328d-400d-a563-b3c14abccbdb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:12:09.928922 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a804dd9-328d-400d-a563-b3c14abccbdb None admin] RBAC: Authorization granted {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:12:09.949144 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db53742-c2d6-492e-b537-096916c50960 None None] Validating token access rules against request {{(pid=144068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:12:09.953713 dv-cinder-851351-1-smb devstack@keystone.service[144067]: [pid: 144067|app: 0|req: 359/729] 10.222.0.42 () {56 vars in 1109 bytes} [Thu Jul 28 08:12:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 329 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:12:09.955512 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a804dd9-328d-400d-a563-b3c14abccbdb None admin] Authenticating user token {{(pid=144067) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:12:09.982278 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG dbcounter [-] [144067] Writing DB stats keystone:SELECT=100 {{(pid=144067) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:12:09.992279 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1f5d0e-091c-491b-a4bb-6cad65b9eefc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:12:09.993087 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1f5d0e-091c-491b-a4bb-6cad65b9eefc None admin] REQUEST_METHOD: `POST` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:12:09.993509 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1f5d0e-091c-491b-a4bb-6cad65b9eefc None admin] SCRIPT_NAME: `/identity` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:12:09.993882 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1f5d0e-091c-491b-a4bb-6cad65b9eefc None admin] PATH_INFO: `/v3/services` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:12:09.994749 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b1f5d0e-091c-491b-a4bb-6cad65b9eefc None admin] RBAC: Authorizing `identity:create_service()` {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:12:09.996359 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b1f5d0e-091c-491b-a4bb-6cad65b9eefc None admin] RBAC: Authorization granted {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:12:10.017283 dv-cinder-851351-1-smb devstack@keystone.service[144068]: [pid: 144068|app: 0|req: 371/730] 10.222.0.42 () {60 vars in 1141 bytes} [Thu Jul 28 08:12:09 2022] POST /identity/v3/services => generated 240 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 08:12:10.018312 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1f5d0e-091c-491b-a4bb-6cad65b9eefc None admin] Authenticating user token {{(pid=144068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:12:10.152369 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1f5d0e-091c-491b-a4bb-6cad65b9eefc None admin] Validating token access rules against request {{(pid=144068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:12:10.164596 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG dbcounter [-] [144068] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=144068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:12:10.204342 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d880a0-52af-40a1-b9d9-98178fdbaca0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:12:10.205406 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d880a0-52af-40a1-b9d9-98178fdbaca0 None admin] REQUEST_METHOD: `GET` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:12:10.205694 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d880a0-52af-40a1-b9d9-98178fdbaca0 None admin] SCRIPT_NAME: `/identity` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:12:10.205975 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d880a0-52af-40a1-b9d9-98178fdbaca0 None admin] PATH_INFO: `/v3/users/nova` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:12:10.207267 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a804dd9-328d-400d-a563-b3c14abccbdb None admin] Validating token access rules against request {{(pid=144067) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:12:10.215448 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2d880a0-52af-40a1-b9d9-98178fdbaca0 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:12:10.218190 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2d880a0-52af-40a1-b9d9-98178fdbaca0 None admin] RBAC: Authorization granted {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:12:10.233648 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application [None req-b2d880a0-52af-40a1-b9d9-98178fdbaca0 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 28 08:12:10.233648 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:12:10.233648 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:12:10.233648 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:12:10.233648 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:12:10.233648 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:12:10.233648 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:12:10.233648 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:12:10.233648 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:12:10.233648 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:12:10.233648 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:12:10.233648 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:12:10.233648 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 28 08:12:10.233648 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 28 08:12:10.233648 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 28 08:12:10.233648 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 28 08:12:10.235965 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:12:10.235965 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:12:10.235965 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 28 08:12:10.235965 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 08:12:10.235965 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 28 08:12:10.235965 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 08:12:10.235965 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:12:10.235965 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:12:10.235965 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:12:10.235965 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:12:10.235965 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:12:10.235965 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application with Lock( Jul 28 08:12:10.235965 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:12:10.235965 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:12:10.235965 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:12:10.235965 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:12:10.235965 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:12:10.235965 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:12:10.238409 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:12:10.238409 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:12:10.238409 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 28 08:12:10.238409 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 28 08:12:10.238409 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 28 08:12:10.238409 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 28 08:12:10.238409 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 28 08:12:10.238409 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 28 08:12:10.238409 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 28 08:12:10.238409 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application Jul 28 08:12:10.238409 dv-cinder-851351-1-smb devstack@keystone.service[144068]: [pid: 144068|app: 0|req: 372/731] 10.222.0.42 () {56 vars in 1093 bytes} [Thu Jul 28 08:12:10 2022] GET /identity/v3/users/nova => generated 82 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:12:10.240926 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1d1286-c55d-47f3-8014-b277ca86ae58 None None] REQUEST_METHOD: `GET` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:12:10.241145 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1d1286-c55d-47f3-8014-b277ca86ae58 None None] SCRIPT_NAME: `/identity` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:12:10.241321 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1d1286-c55d-47f3-8014-b277ca86ae58 None None] PATH_INFO: `/` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:12:10.242638 dv-cinder-851351-1-smb devstack@keystone.service[144068]: [pid: 144068|app: 0|req: 373/732] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 08:12:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 08:12:10.246777 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1d1286-c55d-47f3-8014-b277ca86ae58 None None] Authenticating user token {{(pid=144068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:12:10.261086 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7359b8fb-b09a-41ba-88be-23bafabee692 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144067) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:12:10.261706 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7359b8fb-b09a-41ba-88be-23bafabee692 None admin] REQUEST_METHOD: `GET` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:12:10.261982 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7359b8fb-b09a-41ba-88be-23bafabee692 None admin] SCRIPT_NAME: `/identity` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:12:10.262233 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7359b8fb-b09a-41ba-88be-23bafabee692 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:12:10.278792 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7359b8fb-b09a-41ba-88be-23bafabee692 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 08:12:10.283762 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application [None req-7359b8fb-b09a-41ba-88be-23bafabee692 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 08:12:10.283762 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:12:10.283762 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:12:10.283762 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:12:10.283762 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:12:10.283762 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:12:10.283762 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:12:10.283762 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:12:10.283762 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:12:10.283762 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:12:10.283762 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:12:10.283762 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:12:10.283762 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 08:12:10.283762 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 08:12:10.283762 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 08:12:10.283762 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 08:12:10.285829 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 08:12:10.285829 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 08:12:10.285829 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 08:12:10.285829 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 08:12:10.285829 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:12:10.285829 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:12:10.285829 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:12:10.285829 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:12:10.285829 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:12:10.285829 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:12:10.285829 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:12:10.285829 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application with Lock( Jul 28 08:12:10.285829 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:12:10.285829 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:12:10.285829 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:12:10.285829 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:12:10.287729 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:12:10.287729 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:12:10.287729 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:12:10.287729 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:12:10.287729 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 08:12:10.287729 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 08:12:10.287729 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 08:12:10.287729 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 08:12:10.287729 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 08:12:10.287729 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 08:12:10.287729 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 08:12:10.287729 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application Jul 28 08:12:10.287729 dv-cinder-851351-1-smb devstack@keystone.service[144067]: [pid: 144067|app: 0|req: 360/733] 10.222.0.42 () {56 vars in 1096 bytes} [Thu Jul 28 08:12:09 2022] GET /identity/v3/roles/admin => generated 83 bytes in 331 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:12:10.287729 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fb8ce4-0283-41cd-890e-39de73c2ccc9 None None] REQUEST_METHOD: `POST` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:12:10.291289 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fb8ce4-0283-41cd-890e-39de73c2ccc9 None None] SCRIPT_NAME: `/identity` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:12:10.291289 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fb8ce4-0283-41cd-890e-39de73c2ccc9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:12:10.322234 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.auth.core [None req-21fb8ce4-0283-41cd-890e-39de73c2ccc9 None None] MFA Rules not processed for user `bf5ceb8f07374635ad506b7d1b4f1612`. Rule list: `[]` (Enabled: `True`). {{(pid=144067) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 08:12:10.324897 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.fernet_utils [None req-21fb8ce4-0283-41cd-890e-39de73c2ccc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=144067) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:12:10.362915 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1d1286-c55d-47f3-8014-b277ca86ae58 None None] Validating token access rules against request {{(pid=144068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:12:10.398753 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d6d6b43-0870-484b-a376-ac683fc347f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:12:10.399449 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6d6b43-0870-484b-a376-ac683fc347f5 None admin] REQUEST_METHOD: `GET` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:12:10.399776 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6d6b43-0870-484b-a376-ac683fc347f5 None admin] SCRIPT_NAME: `/identity` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:12:10.400049 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6d6b43-0870-484b-a376-ac683fc347f5 None admin] PATH_INFO: `/v3/users` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:12:10.400895 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d6d6b43-0870-484b-a376-ac683fc347f5 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=144068) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:12:10.401205 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d6d6b43-0870-484b-a376-ac683fc347f5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:12:10.403338 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d6d6b43-0870-484b-a376-ac683fc347f5 None admin] RBAC: Authorization granted {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:12:10.422482 dv-cinder-851351-1-smb devstack@keystone.service[144068]: [pid: 144068|app: 0|req: 374/734] 10.222.0.42 () {56 vars in 1133 bytes} [Thu Jul 28 08:12:10 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:12:10.423375 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d6d6b43-0870-484b-a376-ac683fc347f5 None admin] Authenticating user token {{(pid=144068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:12:10.444353 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG dbcounter [-] [144067] Writing DB stats keystone:SELECT=100 {{(pid=144067) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:12:10.454742 dv-cinder-851351-1-smb devstack@keystone.service[144067]: [pid: 144067|app: 0|req: 361/735] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 08:12:10 2022] POST /identity/v3/auth/tokens => generated 898 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 08:12:10.456484 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21fb8ce4-0283-41cd-890e-39de73c2ccc9 None None] Authenticating user token {{(pid=144067) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:12:10.485112 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG dbcounter [-] [144068] Writing DB stats keystone:SELECT=100 {{(pid=144068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:12:10.560813 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d6d6b43-0870-484b-a376-ac683fc347f5 None admin] Validating token access rules against request {{(pid=144068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:12:10.563263 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21fb8ce4-0283-41cd-890e-39de73c2ccc9 None None] Validating token access rules against request {{(pid=144067) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:12:10.597942 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cda864c-1fe8-4007-86df-c7c0a5e77bd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:12:10.598580 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cda864c-1fe8-4007-86df-c7c0a5e77bd3 None admin] REQUEST_METHOD: `GET` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:12:10.598859 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cda864c-1fe8-4007-86df-c7c0a5e77bd3 None admin] SCRIPT_NAME: `/identity` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:12:10.599128 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cda864c-1fe8-4007-86df-c7c0a5e77bd3 None admin] PATH_INFO: `/v3/roles` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:12:10.599904 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cda864c-1fe8-4007-86df-c7c0a5e77bd3 None admin] RBAC: Adding query filter params (name=admin) {{(pid=144068) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:12:10.600154 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cda864c-1fe8-4007-86df-c7c0a5e77bd3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:12:10.600734 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf6e825-729c-4cfa-93bf-c46dffdc581a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144067) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:12:10.601464 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf6e825-729c-4cfa-93bf-c46dffdc581a None admin] REQUEST_METHOD: `GET` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:12:10.601642 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cda864c-1fe8-4007-86df-c7c0a5e77bd3 None admin] RBAC: Authorization granted {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:12:10.601802 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf6e825-729c-4cfa-93bf-c46dffdc581a None admin] SCRIPT_NAME: `/identity` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:12:10.602185 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf6e825-729c-4cfa-93bf-c46dffdc581a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:12:10.610749 dv-cinder-851351-1-smb devstack@keystone.service[144068]: [pid: 144068|app: 0|req: 375/736] 10.222.0.42 () {56 vars in 1099 bytes} [Thu Jul 28 08:12:10 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:12:10.611742 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cda864c-1fe8-4007-86df-c7c0a5e77bd3 None admin] Authenticating user token {{(pid=144068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:12:10.616626 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baf6e825-729c-4cfa-93bf-c46dffdc581a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:12:10.618259 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baf6e825-729c-4cfa-93bf-c46dffdc581a None admin] RBAC: Authorization granted {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:12:10.638121 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application [None req-baf6e825-729c-4cfa-93bf-c46dffdc581a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 08:12:10.638121 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:12:10.638121 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:12:10.638121 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:12:10.638121 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:12:10.638121 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:12:10.638121 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:12:10.638121 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:12:10.638121 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:12:10.638121 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:12:10.638121 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:12:10.638121 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:12:10.638121 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 08:12:10.638121 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 08:12:10.638121 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 08:12:10.639182 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 08:12:10.639182 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:12:10.639182 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:12:10.639182 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:12:10.639182 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:12:10.639182 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:12:10.639182 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:12:10.639182 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:12:10.639182 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application with Lock( Jul 28 08:12:10.639182 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:12:10.639182 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:12:10.639182 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:12:10.639182 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:12:10.639182 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:12:10.639182 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:12:10.639182 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:12:10.639182 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:12:10.640170 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 08:12:10.640170 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 08:12:10.640170 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 08:12:10.640170 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application Jul 28 08:12:10.647021 dv-cinder-851351-1-smb devstack@keystone.service[144067]: [pid: 144067|app: 0|req: 362/737] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 08:12:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:12:10.648458 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf6e825-729c-4cfa-93bf-c46dffdc581a None admin] Authenticating user token {{(pid=144067) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:12:10.706133 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG dbcounter [-] [144067] Writing DB stats keystone:SELECT=100 {{(pid=144067) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:12:10.707136 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG dbcounter [-] [144068] Writing DB stats keystone:SELECT=100 {{(pid=144068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:12:10.721402 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cda864c-1fe8-4007-86df-c7c0a5e77bd3 None admin] Validating token access rules against request {{(pid=144068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:12:10.760192 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8700dc41-b1c9-4346-bf34-075bb9a8b993 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:12:10.761018 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8700dc41-b1c9-4346-bf34-075bb9a8b993 None admin] REQUEST_METHOD: `GET` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:12:10.761139 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8700dc41-b1c9-4346-bf34-075bb9a8b993 None admin] SCRIPT_NAME: `/identity` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:12:10.761417 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8700dc41-b1c9-4346-bf34-075bb9a8b993 None admin] PATH_INFO: `/v3/roles/service` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:12:10.771187 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf6e825-729c-4cfa-93bf-c46dffdc581a None admin] Validating token access rules against request {{(pid=144067) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:12:10.772334 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8700dc41-b1c9-4346-bf34-075bb9a8b993 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 08:12:10.777864 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application [None req-8700dc41-b1c9-4346-bf34-075bb9a8b993 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 28 08:12:10.777864 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:12:10.777864 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:12:10.777864 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:12:10.777864 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:12:10.777864 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:12:10.777864 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:12:10.777864 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:12:10.777864 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:12:10.777864 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:12:10.777864 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:12:10.777864 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:12:10.777864 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 08:12:10.777864 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 08:12:10.777864 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 08:12:10.777864 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 08:12:10.778913 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 08:12:10.778913 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 08:12:10.778913 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 08:12:10.778913 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 08:12:10.778913 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:12:10.778913 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:12:10.778913 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:12:10.778913 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:12:10.778913 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:12:10.778913 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:12:10.778913 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:12:10.778913 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application with Lock( Jul 28 08:12:10.778913 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:12:10.778913 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:12:10.778913 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:12:10.778913 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:12:10.779863 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:12:10.779863 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:12:10.779863 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:12:10.779863 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:12:10.779863 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 08:12:10.779863 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 08:12:10.779863 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 08:12:10.779863 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 08:12:10.779863 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 08:12:10.779863 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 08:12:10.779863 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 28 08:12:10.779863 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application Jul 28 08:12:10.779863 dv-cinder-851351-1-smb devstack@keystone.service[144068]: [pid: 144068|app: 0|req: 376/738] 10.222.0.42 () {56 vars in 1102 bytes} [Thu Jul 28 08:12:10 2022] GET /identity/v3/roles/service => generated 85 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:12:10.779863 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8700dc41-b1c9-4346-bf34-075bb9a8b993 None admin] Authenticating user token {{(pid=144068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:12:10.817339 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82083b53-a5df-42c6-8269-0abce2b56057 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144067) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:12:10.817927 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82083b53-a5df-42c6-8269-0abce2b56057 None admin] REQUEST_METHOD: `GET` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:12:10.818202 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82083b53-a5df-42c6-8269-0abce2b56057 None admin] SCRIPT_NAME: `/identity` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:12:10.818480 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82083b53-a5df-42c6-8269-0abce2b56057 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:12:10.832780 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82083b53-a5df-42c6-8269-0abce2b56057 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:12:10.834624 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82083b53-a5df-42c6-8269-0abce2b56057 None admin] RBAC: Authorization granted {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:12:10.851494 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application [None req-82083b53-a5df-42c6-8269-0abce2b56057 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 08:12:10.851494 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:12:10.851494 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:12:10.851494 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:12:10.851494 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:12:10.851494 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:12:10.851494 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:12:10.851494 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:12:10.851494 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:12:10.851494 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:12:10.851494 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:12:10.851494 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:12:10.851494 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 08:12:10.851494 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 08:12:10.851494 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 08:12:10.853420 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 08:12:10.853420 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:12:10.853420 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:12:10.853420 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:12:10.853420 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:12:10.853420 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:12:10.853420 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:12:10.853420 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:12:10.853420 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application with Lock( Jul 28 08:12:10.853420 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:12:10.853420 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:12:10.853420 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:12:10.853420 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:12:10.853420 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:12:10.853420 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:12:10.853420 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:12:10.853420 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:12:10.854627 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 08:12:10.854627 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 08:12:10.854627 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 08:12:10.854627 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application Jul 28 08:12:10.863261 dv-cinder-851351-1-smb devstack@keystone.service[144067]: [pid: 144067|app: 0|req: 363/739] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 08:12:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:12:10.864141 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17910d3-5382-45b0-be79-72c4067781fd None None] REQUEST_METHOD: `GET` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:12:10.864813 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17910d3-5382-45b0-be79-72c4067781fd None None] SCRIPT_NAME: `/identity` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:12:10.865102 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17910d3-5382-45b0-be79-72c4067781fd None None] PATH_INFO: `/` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:12:10.867041 dv-cinder-851351-1-smb devstack@keystone.service[144067]: [pid: 144067|app: 0|req: 364/740] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 08:12:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 08:12:10.867586 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17910d3-5382-45b0-be79-72c4067781fd None None] Authenticating user token {{(pid=144067) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:12:10.906745 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8700dc41-b1c9-4346-bf34-075bb9a8b993 None admin] Validating token access rules against request {{(pid=144068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:12:10.945667 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f9ec859-e87a-46f6-8ca4-4ab14a3b1cd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:12:10.946420 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9ec859-e87a-46f6-8ca4-4ab14a3b1cd0 None admin] REQUEST_METHOD: `GET` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:12:10.946702 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9ec859-e87a-46f6-8ca4-4ab14a3b1cd0 None admin] SCRIPT_NAME: `/identity` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:12:10.946973 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9ec859-e87a-46f6-8ca4-4ab14a3b1cd0 None admin] PATH_INFO: `/v3/domains` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:12:10.947798 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f9ec859-e87a-46f6-8ca4-4ab14a3b1cd0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=144068) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:12:10.948112 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f9ec859-e87a-46f6-8ca4-4ab14a3b1cd0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:12:10.949543 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f9ec859-e87a-46f6-8ca4-4ab14a3b1cd0 None admin] RBAC: Authorization granted {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:12:10.964379 dv-cinder-851351-1-smb devstack@keystone.service[144068]: [pid: 144068|app: 0|req: 377/741] 10.222.0.42 () {56 vars in 1109 bytes} [Thu Jul 28 08:12:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:12:10.965398 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f9ec859-e87a-46f6-8ca4-4ab14a3b1cd0 None admin] Authenticating user token {{(pid=144068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:12:10.980254 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG dbcounter [-] [144068] Writing DB stats keystone:SELECT=100 {{(pid=144068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:12:10.996173 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17910d3-5382-45b0-be79-72c4067781fd None None] Validating token access rules against request {{(pid=144067) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:12:10.997934 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG dbcounter [-] [144067] Writing DB stats keystone:SELECT=100 {{(pid=144067) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:12:11.034017 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6303822b-2cdd-4db4-9aab-06c984b262b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144067) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:12:11.034655 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6303822b-2cdd-4db4-9aab-06c984b262b4 None admin] REQUEST_METHOD: `GET` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:12:11.034967 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6303822b-2cdd-4db4-9aab-06c984b262b4 None admin] SCRIPT_NAME: `/identity` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:12:11.035467 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6303822b-2cdd-4db4-9aab-06c984b262b4 None admin] PATH_INFO: `/v3/roles` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:12:11.035975 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6303822b-2cdd-4db4-9aab-06c984b262b4 None admin] RBAC: Adding query filter params (name=service) {{(pid=144067) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:12:11.036285 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6303822b-2cdd-4db4-9aab-06c984b262b4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:12:11.037719 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6303822b-2cdd-4db4-9aab-06c984b262b4 None admin] RBAC: Authorization granted {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:12:11.048819 dv-cinder-851351-1-smb devstack@keystone.service[144067]: [pid: 144067|app: 0|req: 365/742] 10.222.0.42 () {56 vars in 1103 bytes} [Thu Jul 28 08:12:10 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:12:11.050101 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4f0043-2ccd-4962-9b50-224ce41ca7f5 None None] REQUEST_METHOD: `POST` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:12:11.050387 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4f0043-2ccd-4962-9b50-224ce41ca7f5 None None] SCRIPT_NAME: `/identity` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:12:11.050791 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4f0043-2ccd-4962-9b50-224ce41ca7f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:12:11.068729 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.auth.core [None req-fe4f0043-2ccd-4962-9b50-224ce41ca7f5 None None] MFA Rules not processed for user `bf5ceb8f07374635ad506b7d1b4f1612`. Rule list: `[]` (Enabled: `True`). {{(pid=144067) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 08:12:11.069861 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.fernet_utils [None req-fe4f0043-2ccd-4962-9b50-224ce41ca7f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=144067) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:12:11.084338 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f9ec859-e87a-46f6-8ca4-4ab14a3b1cd0 None admin] Validating token access rules against request {{(pid=144068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:12:11.120912 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e20d8192-961b-44a9-8a8c-1d835ff1eba0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:12:11.121557 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20d8192-961b-44a9-8a8c-1d835ff1eba0 None admin] REQUEST_METHOD: `GET` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:12:11.121856 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20d8192-961b-44a9-8a8c-1d835ff1eba0 None admin] SCRIPT_NAME: `/identity` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:12:11.122109 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20d8192-961b-44a9-8a8c-1d835ff1eba0 None admin] PATH_INFO: `/v3/domains` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:12:11.122813 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e20d8192-961b-44a9-8a8c-1d835ff1eba0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=144068) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:12:11.123121 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e20d8192-961b-44a9-8a8c-1d835ff1eba0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:12:11.124491 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e20d8192-961b-44a9-8a8c-1d835ff1eba0 None admin] RBAC: Authorization granted {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:12:11.136998 dv-cinder-851351-1-smb devstack@keystone.service[144068]: [pid: 144068|app: 0|req: 378/743] 10.222.0.42 () {56 vars in 1109 bytes} [Thu Jul 28 08:12:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:12:11.138059 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e20d8192-961b-44a9-8a8c-1d835ff1eba0 None admin] Authenticating user token {{(pid=144068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:12:11.156695 dv-cinder-851351-1-smb devstack@keystone.service[144067]: [pid: 144067|app: 0|req: 366/744] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 08:12:11 2022] POST /identity/v3/auth/tokens => generated 898 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 08:12:11.156695 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe4f0043-2ccd-4962-9b50-224ce41ca7f5 None None] Authenticating user token {{(pid=144067) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:12:11.230120 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG dbcounter [-] [144068] Writing DB stats keystone:SELECT=100 {{(pid=144068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:12:11.278824 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG dbcounter [-] [144067] Writing DB stats keystone:SELECT=100 {{(pid=144067) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:12:11.285031 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e20d8192-961b-44a9-8a8c-1d835ff1eba0 None admin] Validating token access rules against request {{(pid=144068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:12:11.287281 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe4f0043-2ccd-4962-9b50-224ce41ca7f5 None None] Validating token access rules against request {{(pid=144067) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:12:11.324638 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e174b2f-89fc-44c2-9386-23c038905b4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144067) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:12:11.325711 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e174b2f-89fc-44c2-9386-23c038905b4d None admin] REQUEST_METHOD: `GET` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:12:11.326139 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e174b2f-89fc-44c2-9386-23c038905b4d None admin] SCRIPT_NAME: `/identity` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:12:11.326581 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e174b2f-89fc-44c2-9386-23c038905b4d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:12:11.338401 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e174b2f-89fc-44c2-9386-23c038905b4d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:12:11.339886 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e174b2f-89fc-44c2-9386-23c038905b4d None admin] RBAC: Authorization granted {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:12:11.342857 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09786690-4ac0-4477-b59f-6ad1fe439ade None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:12:11.343912 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09786690-4ac0-4477-b59f-6ad1fe439ade None admin] REQUEST_METHOD: `GET` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:12:11.344409 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09786690-4ac0-4477-b59f-6ad1fe439ade None admin] SCRIPT_NAME: `/identity` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:12:11.344931 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09786690-4ac0-4477-b59f-6ad1fe439ade None admin] PATH_INFO: `/v3/projects/service` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:12:11.356175 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application [None req-8e174b2f-89fc-44c2-9386-23c038905b4d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 08:12:11.356175 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:12:11.356175 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:12:11.356175 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:12:11.356175 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:12:11.356175 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:12:11.356175 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:12:11.356175 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:12:11.356175 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:12:11.356175 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:12:11.356175 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:12:11.356175 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:12:11.356175 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 08:12:11.356175 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 08:12:11.356175 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 08:12:11.357270 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 08:12:11.357270 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:12:11.357270 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:12:11.357270 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:12:11.357270 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:12:11.357270 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:12:11.357270 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:12:11.357270 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:12:11.357270 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application with Lock( Jul 28 08:12:11.357270 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:12:11.357270 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:12:11.357270 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:12:11.357270 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:12:11.357270 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:12:11.357270 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:12:11.357270 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:12:11.357270 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:12:11.363110 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 08:12:11.363110 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 08:12:11.363110 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 08:12:11.363110 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application Jul 28 08:12:11.363375 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09786690-4ac0-4477-b59f-6ad1fe439ade None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:12:11.363469 dv-cinder-851351-1-smb devstack@keystone.service[144067]: [pid: 144067|app: 0|req: 367/745] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 08:12:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:12:11.363469 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e174b2f-89fc-44c2-9386-23c038905b4d None admin] Authenticating user token {{(pid=144067) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:12:11.363624 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09786690-4ac0-4477-b59f-6ad1fe439ade None admin] RBAC: Authorization granted {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:12:11.374729 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application [None req-09786690-4ac0-4477-b59f-6ad1fe439ade None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 08:12:11.374729 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:12:11.374729 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:12:11.374729 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:12:11.374729 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:12:11.374729 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:12:11.374729 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:12:11.374729 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:12:11.374729 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:12:11.374729 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:12:11.374729 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:12:11.374729 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:12:11.374729 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 28 08:12:11.374729 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 28 08:12:11.374729 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 28 08:12:11.375770 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 28 08:12:11.375770 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:12:11.375770 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:12:11.375770 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:12:11.375770 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:12:11.375770 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:12:11.375770 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:12:11.375770 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:12:11.375770 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application with Lock( Jul 28 08:12:11.375770 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:12:11.375770 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:12:11.375770 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:12:11.375770 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:12:11.375770 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:12:11.375770 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:12:11.375770 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:12:11.375770 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:12:11.376832 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 28 08:12:11.376832 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 28 08:12:11.376832 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 28 08:12:11.376832 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 28 08:12:11.376832 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 28 08:12:11.376832 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 28 08:12:11.376832 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 08:12:11.376832 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application Jul 28 08:12:11.380653 dv-cinder-851351-1-smb devstack@keystone.service[144068]: [pid: 144068|app: 0|req: 379/746] 10.222.0.42 () {56 vars in 1111 bytes} [Thu Jul 28 08:12:11 2022] GET /identity/v3/projects/service => generated 88 bytes in 243 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:12:11.381482 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09786690-4ac0-4477-b59f-6ad1fe439ade None admin] Authenticating user token {{(pid=144068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:12:11.486725 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e174b2f-89fc-44c2-9386-23c038905b4d None admin] Validating token access rules against request {{(pid=144067) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:12:11.493667 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09786690-4ac0-4477-b59f-6ad1fe439ade None admin] Validating token access rules against request {{(pid=144068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:12:11.527872 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG dbcounter [-] [144068] Writing DB stats keystone:SELECT=100 {{(pid=144068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:12:11.534999 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5620c3a-e320-46d0-b939-25602d9110d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144067) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:12:11.535657 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5620c3a-e320-46d0-b939-25602d9110d1 None admin] REQUEST_METHOD: `GET` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:12:11.535938 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5620c3a-e320-46d0-b939-25602d9110d1 None admin] SCRIPT_NAME: `/identity` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:12:11.536250 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5620c3a-e320-46d0-b939-25602d9110d1 None admin] PATH_INFO: `/v3/users/swift` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:12:11.536839 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523c825d-effc-4f1e-94a1-1905e9e0faa4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:12:11.537473 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523c825d-effc-4f1e-94a1-1905e9e0faa4 None admin] REQUEST_METHOD: `POST` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:12:11.537757 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523c825d-effc-4f1e-94a1-1905e9e0faa4 None admin] SCRIPT_NAME: `/identity` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:12:11.538032 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523c825d-effc-4f1e-94a1-1905e9e0faa4 None admin] PATH_INFO: `/v3/services` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:12:11.538744 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-523c825d-effc-4f1e-94a1-1905e9e0faa4 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:12:11.540131 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-523c825d-effc-4f1e-94a1-1905e9e0faa4 None admin] RBAC: Authorization granted {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:12:11.544837 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5620c3a-e320-46d0-b939-25602d9110d1 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:12:11.546145 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5620c3a-e320-46d0-b939-25602d9110d1 None admin] RBAC: Authorization granted {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:12:11.556059 dv-cinder-851351-1-smb devstack@keystone.service[144068]: [pid: 144068|app: 0|req: 380/747] 10.222.0.42 () {60 vars in 1141 bytes} [Thu Jul 28 08:12:11 2022] POST /identity/v3/services => generated 251 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 08:12:11.557273 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523c825d-effc-4f1e-94a1-1905e9e0faa4 None admin] Authenticating user token {{(pid=144068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:12:11.559384 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application [None req-a5620c3a-e320-46d0-b939-25602d9110d1 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 28 08:12:11.559384 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:12:11.559384 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:12:11.559384 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:12:11.559384 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:12:11.559384 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:12:11.559384 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:12:11.559384 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:12:11.559384 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:12:11.559384 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:12:11.559384 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:12:11.559384 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:12:11.559384 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 28 08:12:11.559384 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 28 08:12:11.559384 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 28 08:12:11.559384 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 28 08:12:11.560407 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:12:11.560407 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:12:11.560407 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 28 08:12:11.560407 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 08:12:11.560407 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 28 08:12:11.560407 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 08:12:11.560407 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:12:11.560407 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:12:11.560407 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:12:11.560407 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:12:11.560407 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:12:11.560407 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application with Lock( Jul 28 08:12:11.560407 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:12:11.560407 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:12:11.560407 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:12:11.560407 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:12:11.560407 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:12:11.560407 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:12:11.561530 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:12:11.561530 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:12:11.561530 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 28 08:12:11.561530 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 28 08:12:11.561530 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 28 08:12:11.561530 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 28 08:12:11.561530 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 28 08:12:11.561530 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 28 08:12:11.561530 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 28 08:12:11.561530 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application Jul 28 08:12:11.565807 dv-cinder-851351-1-smb devstack@keystone.service[144067]: [pid: 144067|app: 0|req: 368/748] 10.222.0.42 () {56 vars in 1096 bytes} [Thu Jul 28 08:12:11 2022] GET /identity/v3/users/swift => generated 83 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:12:11.567047 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5620c3a-e320-46d0-b939-25602d9110d1 None admin] Authenticating user token {{(pid=144067) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:12:11.578232 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG dbcounter [-] [144067] Writing DB stats keystone:SELECT=100 {{(pid=144067) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:12:11.698222 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523c825d-effc-4f1e-94a1-1905e9e0faa4 None admin] Validating token access rules against request {{(pid=144068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:12:11.704210 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5620c3a-e320-46d0-b939-25602d9110d1 None admin] Validating token access rules against request {{(pid=144067) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:12:11.742906 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-274e0d12-0427-4868-b925-062851297dce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:12:11.743662 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274e0d12-0427-4868-b925-062851297dce None admin] REQUEST_METHOD: `GET` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:12:11.743922 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274e0d12-0427-4868-b925-062851297dce None admin] SCRIPT_NAME: `/identity` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:12:11.744203 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274e0d12-0427-4868-b925-062851297dce None admin] PATH_INFO: `/v3/domains` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:12:11.744972 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-274e0d12-0427-4868-b925-062851297dce None admin] RBAC: Adding query filter params (name=Default) {{(pid=144068) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:12:11.745285 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-274e0d12-0427-4868-b925-062851297dce None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:12:11.746698 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-274e0d12-0427-4868-b925-062851297dce None admin] RBAC: Authorization granted {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:12:11.747589 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0046cad8-4955-4de1-b61c-383ef3e28896 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144067) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:12:11.748489 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0046cad8-4955-4de1-b61c-383ef3e28896 None admin] REQUEST_METHOD: `GET` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:12:11.749024 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0046cad8-4955-4de1-b61c-383ef3e28896 None admin] SCRIPT_NAME: `/identity` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:12:11.749506 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0046cad8-4955-4de1-b61c-383ef3e28896 None admin] PATH_INFO: `/v3/projects` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:12:11.750528 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0046cad8-4955-4de1-b61c-383ef3e28896 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=144067) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:12:11.750841 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0046cad8-4955-4de1-b61c-383ef3e28896 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:12:11.752368 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0046cad8-4955-4de1-b61c-383ef3e28896 None admin] RBAC: Authorization granted {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:12:11.761781 dv-cinder-851351-1-smb devstack@keystone.service[144068]: [pid: 144068|app: 0|req: 381/749] 10.222.0.42 () {56 vars in 1109 bytes} [Thu Jul 28 08:12:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:12:11.762685 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-274e0d12-0427-4868-b925-062851297dce None admin] Authenticating user token {{(pid=144068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:12:11.766458 dv-cinder-851351-1-smb devstack@keystone.service[144067]: [pid: 144067|app: 0|req: 369/750] 10.222.0.42 () {56 vars in 1148 bytes} [Thu Jul 28 08:12:11 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:12:11.768943 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0046cad8-4955-4de1-b61c-383ef3e28896 None admin] Authenticating user token {{(pid=144067) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:12:11.830005 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG dbcounter [-] [144068] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=144068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:12:11.865682 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG dbcounter [-] [144067] Writing DB stats keystone:SELECT=100 {{(pid=144067) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:12:11.886977 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-274e0d12-0427-4868-b925-062851297dce None admin] Validating token access rules against request {{(pid=144068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:12:11.907545 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0046cad8-4955-4de1-b61c-383ef3e28896 None admin] Validating token access rules against request {{(pid=144067) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:12:11.936017 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a5797d-9263-4dfb-bcc5-7085aa9ece34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:12:11.937117 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a5797d-9263-4dfb-bcc5-7085aa9ece34 None admin] REQUEST_METHOD: `GET` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:12:11.937606 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a5797d-9263-4dfb-bcc5-7085aa9ece34 None admin] SCRIPT_NAME: `/identity` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:12:11.938090 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a5797d-9263-4dfb-bcc5-7085aa9ece34 None admin] PATH_INFO: `/v3/users` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:12:11.939604 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38a5797d-9263-4dfb-bcc5-7085aa9ece34 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=144068) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:12:11.940149 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38a5797d-9263-4dfb-bcc5-7085aa9ece34 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:12:11.943445 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38a5797d-9263-4dfb-bcc5-7085aa9ece34 None admin] RBAC: Authorization granted {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:12:11.951982 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3a789b-19b1-47fa-b0b1-2378fd77d61f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144067) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:12:11.952782 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3a789b-19b1-47fa-b0b1-2378fd77d61f None admin] REQUEST_METHOD: `GET` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:12:11.953072 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3a789b-19b1-47fa-b0b1-2378fd77d61f None admin] SCRIPT_NAME: `/identity` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:12:11.953358 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3a789b-19b1-47fa-b0b1-2378fd77d61f None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:12:11.962420 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e3a789b-19b1-47fa-b0b1-2378fd77d61f None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:12:11.963919 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e3a789b-19b1-47fa-b0b1-2378fd77d61f None admin] RBAC: Authorization granted {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:12:11.980704 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application [None req-2e3a789b-19b1-47fa-b0b1-2378fd77d61f None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 28 08:12:11.980704 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:12:11.980704 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:12:11.980704 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:12:11.980704 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:12:11.980704 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:12:11.980704 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:12:11.980704 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:12:11.980704 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:12:11.980704 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:12:11.980704 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:12:11.980704 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:12:11.980704 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 28 08:12:11.980704 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 28 08:12:11.980704 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 28 08:12:11.980704 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 28 08:12:11.983069 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:12:11.983069 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:12:11.983069 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 28 08:12:11.983069 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 08:12:11.983069 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 28 08:12:11.983069 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 08:12:11.983069 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:12:11.983069 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:12:11.983069 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:12:11.983069 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:12:11.983069 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:12:11.983069 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application with Lock( Jul 28 08:12:11.983069 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:12:11.983069 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:12:11.983069 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:12:11.983069 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:12:11.983069 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:12:11.983069 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:12:11.985417 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:12:11.985417 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:12:11.985417 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 28 08:12:11.985417 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 28 08:12:11.985417 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 28 08:12:11.985417 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 28 08:12:11.985417 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 28 08:12:11.985417 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 28 08:12:11.985417 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 28 08:12:11.985417 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application Jul 28 08:12:11.985417 dv-cinder-851351-1-smb devstack@keystone.service[144067]: [pid: 144067|app: 0|req: 370/751] 10.222.0.42 () {56 vars in 1117 bytes} [Thu Jul 28 08:12:11 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:12:11.986979 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3a789b-19b1-47fa-b0b1-2378fd77d61f None admin] Authenticating user token {{(pid=144067) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:12:11.993445 dv-cinder-851351-1-smb devstack@keystone.service[144068]: [pid: 144068|app: 0|req: 382/752] 10.222.0.42 () {56 vars in 1135 bytes} [Thu Jul 28 08:12:11 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:12:11.994979 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a5797d-9263-4dfb-bcc5-7085aa9ece34 None admin] Authenticating user token {{(pid=144068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:12:12.131209 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a5797d-9263-4dfb-bcc5-7085aa9ece34 None admin] Validating token access rules against request {{(pid=144068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:12:12.133435 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG dbcounter [-] [144068] Writing DB stats keystone:SELECT=100 {{(pid=144068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:12:12.179005 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d57650-d6fb-43bd-995b-80262017046c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:12:12.179772 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d57650-d6fb-43bd-995b-80262017046c None admin] REQUEST_METHOD: `GET` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:12:12.180134 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d57650-d6fb-43bd-995b-80262017046c None admin] SCRIPT_NAME: `/identity` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:12:12.180488 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d57650-d6fb-43bd-995b-80262017046c None admin] PATH_INFO: `/v3/users` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:12:12.181549 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1d57650-d6fb-43bd-995b-80262017046c None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=144068) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:12:12.182108 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1d57650-d6fb-43bd-995b-80262017046c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:12:12.183564 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1d57650-d6fb-43bd-995b-80262017046c None admin] RBAC: Authorization granted {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:12:12.185228 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3a789b-19b1-47fa-b0b1-2378fd77d61f None admin] Validating token access rules against request {{(pid=144067) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:12:12.209140 dv-cinder-851351-1-smb devstack@keystone.service[144068]: [pid: 144068|app: 0|req: 383/753] 10.222.0.42 () {56 vars in 1149 bytes} [Thu Jul 28 08:12:11 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:12:12.210136 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d57650-d6fb-43bd-995b-80262017046c None admin] Authenticating user token {{(pid=144068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:12:12.215554 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG dbcounter [-] [144067] Writing DB stats keystone:SELECT=100 {{(pid=144067) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:12:12.225580 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f630417-097f-4cae-80a0-a5341496c8f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144067) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:12:12.226285 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f630417-097f-4cae-80a0-a5341496c8f3 None admin] REQUEST_METHOD: `PUT` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:12:12.226571 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f630417-097f-4cae-80a0-a5341496c8f3 None admin] SCRIPT_NAME: `/identity` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:12:12.226852 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f630417-097f-4cae-80a0-a5341496c8f3 None admin] PATH_INFO: `/v3/projects/fa39ab7491e5413ca648e31ee9177fa0/users/2c1de9cd80344cefa3e06ae8c9c9e5d9/roles/d1020e7bb0b7411d895ddedd6dc02c5b` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:12:12.228904 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f630417-097f-4cae-80a0-a5341496c8f3 None admin] RBAC: Authorizing `identity:create_grant(project_id=fa39ab7491e5413ca648e31ee9177fa0, user_id=2c1de9cd80344cefa3e06ae8c9c9e5d9, role_id=d1020e7bb0b7411d895ddedd6dc02c5b)` {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:12:12.230394 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f630417-097f-4cae-80a0-a5341496c8f3 None admin] RBAC: Authorization granted {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:12:12.244161 dv-cinder-851351-1-smb devstack@keystone.service[144067]: [pid: 144067|app: 0|req: 371/754] 10.222.0.42 () {58 vars in 1439 bytes} [Thu Jul 28 08:12:11 2022] PUT /identity/v3/projects/fa39ab7491e5413ca648e31ee9177fa0/users/2c1de9cd80344cefa3e06ae8c9c9e5d9/roles/d1020e7bb0b7411d895ddedd6dc02c5b => generated 0 bytes in 261 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 08:12:12.245455 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f630417-097f-4cae-80a0-a5341496c8f3 None admin] Authenticating user token {{(pid=144067) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:12:12.351136 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d57650-d6fb-43bd-995b-80262017046c None admin] Validating token access rules against request {{(pid=144068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:12:12.382876 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f630417-097f-4cae-80a0-a5341496c8f3 None admin] Validating token access rules against request {{(pid=144067) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:12:12.395599 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17af680-95d6-4d01-b8aa-52012fcdf9aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:12:12.396600 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17af680-95d6-4d01-b8aa-52012fcdf9aa None admin] REQUEST_METHOD: `GET` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:12:12.396846 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17af680-95d6-4d01-b8aa-52012fcdf9aa None admin] SCRIPT_NAME: `/identity` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:12:12.397245 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17af680-95d6-4d01-b8aa-52012fcdf9aa None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:12:12.427393 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd81252-4c96-4b92-a0ed-62b2189e9079 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144067) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:12:12.428345 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd81252-4c96-4b92-a0ed-62b2189e9079 None admin] REQUEST_METHOD: `GET` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:12:12.428835 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd81252-4c96-4b92-a0ed-62b2189e9079 None admin] SCRIPT_NAME: `/identity` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:12:12.429267 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd81252-4c96-4b92-a0ed-62b2189e9079 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:12:12.431646 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG dbcounter [-] [144068] Writing DB stats keystone:SELECT=100 {{(pid=144068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:12:12.483412 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b17af680-95d6-4d01-b8aa-52012fcdf9aa None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:12:12.485199 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b17af680-95d6-4d01-b8aa-52012fcdf9aa None admin] RBAC: Authorization granted {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:12:12.500119 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG dbcounter [-] [144067] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=144067) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:12:12.522025 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcd81252-4c96-4b92-a0ed-62b2189e9079 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:12:12.523299 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcd81252-4c96-4b92-a0ed-62b2189e9079 None admin] RBAC: Authorization granted {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:12:12.624201 dv-cinder-851351-1-smb devstack@keystone.service[144068]: [pid: 144068|app: 0|req: 384/755] 10.222.0.42 () {58 vars in 1282 bytes} [Thu Jul 28 08:12:12 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 414 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 28 08:12:12.626110 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000b4569-534a-40fa-8246-a4c3d6e5bdf8 None None] REQUEST_METHOD: `GET` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:12:12.626628 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000b4569-534a-40fa-8246-a4c3d6e5bdf8 None None] SCRIPT_NAME: `/identity` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:12:12.627213 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000b4569-534a-40fa-8246-a4c3d6e5bdf8 None None] PATH_INFO: `/` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:12:12.633601 dv-cinder-851351-1-smb devstack@keystone.service[144068]: [pid: 144068|app: 0|req: 385/756] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 08:12:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 08:12:12.635176 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000b4569-534a-40fa-8246-a4c3d6e5bdf8 None None] Authenticating user token {{(pid=144068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:12:12.639196 dv-cinder-851351-1-smb devstack@keystone.service[144067]: [pid: 144067|app: 0|req: 372/757] 10.222.0.42 () {58 vars in 1282 bytes} [Thu Jul 28 08:12:12 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 394 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 28 08:12:12.645457 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde52dc0-33e1-41d1-bf26-6d2751c3220d None None] REQUEST_METHOD: `POST` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:12:12.645830 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde52dc0-33e1-41d1-bf26-6d2751c3220d None None] SCRIPT_NAME: `/identity` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:12:12.646091 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde52dc0-33e1-41d1-bf26-6d2751c3220d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:12:12.667509 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.auth.core [None req-dde52dc0-33e1-41d1-bf26-6d2751c3220d None None] MFA Rules not processed for user `bf5ceb8f07374635ad506b7d1b4f1612`. Rule list: `[]` (Enabled: `True`). {{(pid=144067) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 08:12:12.668790 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.fernet_utils [None req-dde52dc0-33e1-41d1-bf26-6d2751c3220d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=144067) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:12:12.710314 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG dbcounter [-] [144068] Writing DB stats keystone:SELECT=100 {{(pid=144068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:12:12.750305 dv-cinder-851351-1-smb devstack@keystone.service[144067]: [pid: 144067|app: 0|req: 373/758] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 08:12:12 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 08:12:12.751184 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde52dc0-33e1-41d1-bf26-6d2751c3220d None None] Authenticating user token {{(pid=144067) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:12:12.762404 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000b4569-534a-40fa-8246-a4c3d6e5bdf8 None None] Validating token access rules against request {{(pid=144068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:12:12.771391 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG dbcounter [-] [144067] Writing DB stats keystone:SELECT=100 {{(pid=144067) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:12:12.805222 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c7e2e0-1844-40a5-863f-12bcd3d7a3d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:12:12.805915 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c7e2e0-1844-40a5-863f-12bcd3d7a3d5 None admin] REQUEST_METHOD: `GET` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:12:12.806195 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c7e2e0-1844-40a5-863f-12bcd3d7a3d5 None admin] SCRIPT_NAME: `/identity` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:12:12.806467 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c7e2e0-1844-40a5-863f-12bcd3d7a3d5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:12:12.823017 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c7e2e0-1844-40a5-863f-12bcd3d7a3d5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:12:12.826417 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c7e2e0-1844-40a5-863f-12bcd3d7a3d5 None admin] RBAC: Authorization granted {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:12:12.847116 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application [None req-98c7e2e0-1844-40a5-863f-12bcd3d7a3d5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 08:12:12.847116 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:12:12.847116 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:12:12.847116 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:12:12.847116 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:12:12.847116 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:12:12.847116 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:12:12.847116 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:12:12.847116 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:12:12.847116 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:12:12.847116 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:12:12.847116 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:12:12.847116 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 08:12:12.847116 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 08:12:12.847116 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 08:12:12.848245 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 08:12:12.848245 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:12:12.848245 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:12:12.848245 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:12:12.848245 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:12:12.848245 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:12:12.848245 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:12:12.848245 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:12:12.848245 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application with Lock( Jul 28 08:12:12.848245 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:12:12.848245 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:12:12.848245 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:12:12.848245 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:12:12.848245 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:12:12.848245 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:12:12.848245 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:12:12.848245 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:12:12.849276 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 08:12:12.849276 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 08:12:12.849276 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 08:12:12.849276 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application Jul 28 08:12:12.849521 dv-cinder-851351-1-smb devstack@keystone.service[144068]: [pid: 144068|app: 0|req: 386/759] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 08:12:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:12:12.850978 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c7e2e0-1844-40a5-863f-12bcd3d7a3d5 None admin] Authenticating user token {{(pid=144068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:12:12.871420 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde52dc0-33e1-41d1-bf26-6d2751c3220d None None] Validating token access rules against request {{(pid=144067) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:12:12.914575 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce0802e-ba62-4b24-8ca4-1cac9c4d3f6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144067) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:12:12.915165 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce0802e-ba62-4b24-8ca4-1cac9c4d3f6d None admin] REQUEST_METHOD: `GET` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:12:12.915450 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce0802e-ba62-4b24-8ca4-1cac9c4d3f6d None admin] SCRIPT_NAME: `/identity` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:12:12.915730 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce0802e-ba62-4b24-8ca4-1cac9c4d3f6d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:12:12.927848 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ce0802e-ba62-4b24-8ca4-1cac9c4d3f6d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:12:12.929587 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ce0802e-ba62-4b24-8ca4-1cac9c4d3f6d None admin] RBAC: Authorization granted {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:12:12.949324 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application [None req-8ce0802e-ba62-4b24-8ca4-1cac9c4d3f6d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 08:12:12.949324 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:12:12.949324 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:12:12.949324 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:12:12.949324 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:12:12.949324 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:12:12.949324 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:12:12.949324 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:12:12.949324 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:12:12.949324 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:12:12.949324 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:12:12.949324 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:12:12.949324 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 08:12:12.949324 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 08:12:12.949324 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 08:12:12.950569 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 08:12:12.950569 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:12:12.950569 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:12:12.950569 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:12:12.950569 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:12:12.950569 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:12:12.950569 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:12:12.950569 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:12:12.950569 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application with Lock( Jul 28 08:12:12.950569 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:12:12.950569 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:12:12.950569 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:12:12.950569 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:12:12.950569 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:12:12.950569 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:12:12.950569 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:12:12.950569 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:12:12.951856 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 08:12:12.951856 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 08:12:12.951856 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 08:12:12.951856 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application Jul 28 08:12:12.955209 dv-cinder-851351-1-smb devstack@keystone.service[144067]: [pid: 144067|app: 0|req: 374/760] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 08:12:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:12:12.956223 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce0802e-ba62-4b24-8ca4-1cac9c4d3f6d None admin] Authenticating user token {{(pid=144067) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:12:12.996687 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c7e2e0-1844-40a5-863f-12bcd3d7a3d5 None admin] Validating token access rules against request {{(pid=144068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:12:13.008201 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG dbcounter [-] [144068] Writing DB stats keystone:SELECT=100 {{(pid=144068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:12:13.030727 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG dbcounter [-] [144067] Writing DB stats keystone:SELECT=100 {{(pid=144067) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:12:13.033439 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e99cb5-b528-49fa-9a14-7263832caf75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:12:13.034445 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e99cb5-b528-49fa-9a14-7263832caf75 None admin] REQUEST_METHOD: `GET` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:12:13.034925 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e99cb5-b528-49fa-9a14-7263832caf75 None admin] SCRIPT_NAME: `/identity` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:12:13.036329 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e99cb5-b528-49fa-9a14-7263832caf75 None admin] PATH_INFO: `/v3/services/network` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:12:13.037176 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0e99cb5-b528-49fa-9a14-7263832caf75 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:12:13.038741 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0e99cb5-b528-49fa-9a14-7263832caf75 None admin] RBAC: Authorization granted {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:12:13.049073 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application [None req-a0e99cb5-b528-49fa-9a14-7263832caf75 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jul 28 08:12:13.049073 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:12:13.049073 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 28 08:12:13.049073 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 28 08:12:13.049073 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 28 08:12:13.049073 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 28 08:12:13.049073 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 28 08:12:13.049073 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 08:12:13.049073 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 28 08:12:13.049073 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application Jul 28 08:12:13.049073 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 28 08:12:13.049073 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application Jul 28 08:12:13.049073 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:12:13.049073 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:12:13.049073 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:12:13.049073 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:12:13.049073 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:12:13.050582 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:12:13.050582 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:12:13.050582 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:12:13.050582 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:12:13.050582 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:12:13.050582 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:12:13.050582 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 28 08:12:13.050582 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 28 08:12:13.050582 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 28 08:12:13.050582 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 28 08:12:13.050582 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:12:13.050582 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:12:13.050582 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:12:13.050582 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:12:13.050582 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:12:13.050582 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:12:13.051635 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:12:13.051635 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application with Lock( Jul 28 08:12:13.051635 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:12:13.051635 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:12:13.051635 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:12:13.051635 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:12:13.051635 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:12:13.051635 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:12:13.051635 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:12:13.051635 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:12:13.051635 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 28 08:12:13.051635 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 08:12:13.051635 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 28 08:12:13.051635 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application Jul 28 08:12:13.058822 dv-cinder-851351-1-smb devstack@keystone.service[144068]: [pid: 144068|app: 0|req: 387/761] 10.222.0.42 () {56 vars in 1111 bytes} [Thu Jul 28 08:12:12 2022] GET /identity/v3/services/network => generated 88 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:12:13.059997 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e99cb5-b528-49fa-9a14-7263832caf75 None admin] Authenticating user token {{(pid=144068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:12:13.067503 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce0802e-ba62-4b24-8ca4-1cac9c4d3f6d None admin] Validating token access rules against request {{(pid=144067) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:12:13.105123 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e45e70-6c31-49c7-85cd-7deece012caf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144067) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:12:13.105579 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e45e70-6c31-49c7-85cd-7deece012caf None admin] REQUEST_METHOD: `GET` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:12:13.105870 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e45e70-6c31-49c7-85cd-7deece012caf None admin] SCRIPT_NAME: `/identity` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:12:13.106153 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e45e70-6c31-49c7-85cd-7deece012caf None admin] PATH_INFO: `/v3/domains` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:12:13.106871 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e45e70-6c31-49c7-85cd-7deece012caf None admin] RBAC: Adding query filter params (name=Default) {{(pid=144067) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:12:13.107184 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e45e70-6c31-49c7-85cd-7deece012caf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:12:13.108741 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e45e70-6c31-49c7-85cd-7deece012caf None admin] RBAC: Authorization granted {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:12:13.126417 dv-cinder-851351-1-smb devstack@keystone.service[144067]: [pid: 144067|app: 0|req: 375/762] 10.222.0.42 () {56 vars in 1109 bytes} [Thu Jul 28 08:12:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:12:13.126417 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e45e70-6c31-49c7-85cd-7deece012caf None admin] Authenticating user token {{(pid=144067) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:12:13.177905 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e99cb5-b528-49fa-9a14-7263832caf75 None admin] Validating token access rules against request {{(pid=144068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:12:13.220015 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae3936e3-ac39-45d2-9455-af25eb5b9724 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:12:13.221023 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3936e3-ac39-45d2-9455-af25eb5b9724 None admin] REQUEST_METHOD: `GET` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:12:13.222012 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3936e3-ac39-45d2-9455-af25eb5b9724 None admin] SCRIPT_NAME: `/identity` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:12:13.222491 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3936e3-ac39-45d2-9455-af25eb5b9724 None admin] PATH_INFO: `/v3/domains` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:12:13.223648 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae3936e3-ac39-45d2-9455-af25eb5b9724 None admin] RBAC: Adding query filter params (name=Default) {{(pid=144068) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:12:13.224111 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae3936e3-ac39-45d2-9455-af25eb5b9724 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:12:13.226591 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae3936e3-ac39-45d2-9455-af25eb5b9724 None admin] RBAC: Authorization granted {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:12:13.234371 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e45e70-6c31-49c7-85cd-7deece012caf None admin] Validating token access rules against request {{(pid=144067) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:12:13.242241 dv-cinder-851351-1-smb devstack@keystone.service[144068]: [pid: 144068|app: 0|req: 388/763] 10.222.0.42 () {56 vars in 1109 bytes} [Thu Jul 28 08:12:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:12:13.243348 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae3936e3-ac39-45d2-9455-af25eb5b9724 None admin] Authenticating user token {{(pid=144068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:12:13.267784 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG dbcounter [-] [144067] Writing DB stats keystone:SELECT=100 {{(pid=144067) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:12:13.277475 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78917d10-ca57-4d2d-8317-3806cad7bbcd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144067) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:12:13.278403 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78917d10-ca57-4d2d-8317-3806cad7bbcd None admin] REQUEST_METHOD: `GET` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:12:13.278844 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78917d10-ca57-4d2d-8317-3806cad7bbcd None admin] SCRIPT_NAME: `/identity` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:12:13.279278 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78917d10-ca57-4d2d-8317-3806cad7bbcd None admin] PATH_INFO: `/v3/services` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:12:13.280127 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78917d10-ca57-4d2d-8317-3806cad7bbcd None admin] RBAC: Adding query filter params (name=network) {{(pid=144067) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:12:13.280604 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78917d10-ca57-4d2d-8317-3806cad7bbcd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:12:13.281593 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG dbcounter [-] [144068] Writing DB stats keystone:SELECT=100 {{(pid=144068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:12:13.282743 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78917d10-ca57-4d2d-8317-3806cad7bbcd None admin] RBAC: Authorization granted {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:12:13.292976 dv-cinder-851351-1-smb devstack@keystone.service[144067]: [pid: 144067|app: 0|req: 376/764] 10.222.0.42 () {56 vars in 1112 bytes} [Thu Jul 28 08:12:13 2022] GET /identity/v3/services?name=network => generated 124 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:12:13.294203 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78917d10-ca57-4d2d-8317-3806cad7bbcd None admin] Authenticating user token {{(pid=144067) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:12:13.355265 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae3936e3-ac39-45d2-9455-af25eb5b9724 None admin] Validating token access rules against request {{(pid=144068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:12:13.391468 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc45e3c-36bc-412d-a89a-58aea2afc5dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:12:13.392131 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc45e3c-36bc-412d-a89a-58aea2afc5dc None admin] REQUEST_METHOD: `GET` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:12:13.392413 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc45e3c-36bc-412d-a89a-58aea2afc5dc None admin] SCRIPT_NAME: `/identity` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:12:13.392706 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc45e3c-36bc-412d-a89a-58aea2afc5dc None admin] PATH_INFO: `/v3/projects/service` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:12:13.400339 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fc45e3c-36bc-412d-a89a-58aea2afc5dc None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:12:13.401840 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fc45e3c-36bc-412d-a89a-58aea2afc5dc None admin] RBAC: Authorization granted {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:12:13.406010 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78917d10-ca57-4d2d-8317-3806cad7bbcd None admin] Validating token access rules against request {{(pid=144067) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:12:13.413795 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application [None req-0fc45e3c-36bc-412d-a89a-58aea2afc5dc None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 08:12:13.413795 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:12:13.413795 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:12:13.413795 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:12:13.413795 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:12:13.413795 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:12:13.413795 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:12:13.413795 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:12:13.413795 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:12:13.413795 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:12:13.413795 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:12:13.413795 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:12:13.413795 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 28 08:12:13.413795 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 28 08:12:13.413795 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 28 08:12:13.415048 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 28 08:12:13.415048 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:12:13.415048 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:12:13.415048 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:12:13.415048 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:12:13.415048 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:12:13.415048 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:12:13.415048 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:12:13.415048 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application with Lock( Jul 28 08:12:13.415048 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:12:13.415048 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:12:13.415048 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:12:13.415048 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:12:13.415048 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:12:13.415048 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:12:13.415048 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:12:13.415048 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:12:13.416200 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 28 08:12:13.416200 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 28 08:12:13.416200 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 28 08:12:13.416200 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 28 08:12:13.416200 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 28 08:12:13.416200 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 28 08:12:13.416200 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 08:12:13.416200 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application Jul 28 08:12:13.419950 dv-cinder-851351-1-smb devstack@keystone.service[144068]: [pid: 144068|app: 0|req: 389/765] 10.222.0.42 () {56 vars in 1111 bytes} [Thu Jul 28 08:12:13 2022] GET /identity/v3/projects/service => generated 88 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:12:13.420893 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc45e3c-36bc-412d-a89a-58aea2afc5dc None admin] Authenticating user token {{(pid=144068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:12:13.447481 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae86dda2-7fb2-4118-a7c6-c043027d2575 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144067) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:12:13.448410 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae86dda2-7fb2-4118-a7c6-c043027d2575 None admin] REQUEST_METHOD: `GET` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:12:13.448917 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae86dda2-7fb2-4118-a7c6-c043027d2575 None admin] SCRIPT_NAME: `/identity` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:12:13.449369 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae86dda2-7fb2-4118-a7c6-c043027d2575 None admin] PATH_INFO: `/v3/projects/service` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:12:13.457118 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae86dda2-7fb2-4118-a7c6-c043027d2575 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:12:13.458835 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae86dda2-7fb2-4118-a7c6-c043027d2575 None admin] RBAC: Authorization granted {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:12:13.472710 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application [None req-ae86dda2-7fb2-4118-a7c6-c043027d2575 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 08:12:13.472710 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:12:13.472710 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:12:13.472710 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:12:13.472710 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:12:13.472710 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:12:13.472710 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:12:13.472710 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:12:13.472710 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:12:13.472710 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:12:13.472710 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:12:13.472710 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:12:13.472710 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 28 08:12:13.472710 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 28 08:12:13.472710 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 28 08:12:13.473958 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 28 08:12:13.473958 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:12:13.473958 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:12:13.473958 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:12:13.473958 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:12:13.473958 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:12:13.473958 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:12:13.473958 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:12:13.473958 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application with Lock( Jul 28 08:12:13.473958 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:12:13.473958 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:12:13.473958 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:12:13.473958 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:12:13.473958 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:12:13.473958 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:12:13.473958 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:12:13.473958 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:12:13.475055 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 28 08:12:13.475055 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 28 08:12:13.475055 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 28 08:12:13.475055 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 28 08:12:13.475055 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 28 08:12:13.475055 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 28 08:12:13.475055 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 08:12:13.475055 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application Jul 28 08:12:13.481885 dv-cinder-851351-1-smb devstack@keystone.service[144067]: [pid: 144067|app: 0|req: 377/766] 10.222.0.42 () {56 vars in 1111 bytes} [Thu Jul 28 08:12:13 2022] GET /identity/v3/projects/service => generated 88 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:12:13.483180 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae86dda2-7fb2-4118-a7c6-c043027d2575 None admin] Authenticating user token {{(pid=144067) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:12:13.523061 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG dbcounter [-] [144068] Writing DB stats keystone:SELECT=100 {{(pid=144068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:12:13.530977 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc45e3c-36bc-412d-a89a-58aea2afc5dc None admin] Validating token access rules against request {{(pid=144068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:12:13.544240 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG dbcounter [-] [144067] Writing DB stats keystone:SELECT=100 {{(pid=144067) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:12:13.568932 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f1f0a1-1523-4d2b-b3cd-195522a0ec38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:12:13.569576 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f1f0a1-1523-4d2b-b3cd-195522a0ec38 None admin] REQUEST_METHOD: `GET` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:12:13.569860 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f1f0a1-1523-4d2b-b3cd-195522a0ec38 None admin] SCRIPT_NAME: `/identity` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:12:13.570137 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f1f0a1-1523-4d2b-b3cd-195522a0ec38 None admin] PATH_INFO: `/v3/services` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:12:13.571192 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26f1f0a1-1523-4d2b-b3cd-195522a0ec38 None admin] RBAC: Adding query filter params (type=network) {{(pid=144068) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:12:13.571311 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26f1f0a1-1523-4d2b-b3cd-195522a0ec38 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:12:13.572629 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26f1f0a1-1523-4d2b-b3cd-195522a0ec38 None admin] RBAC: Authorization granted {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:12:13.583284 dv-cinder-851351-1-smb devstack@keystone.service[144068]: [pid: 144068|app: 0|req: 390/767] 10.222.0.42 () {56 vars in 1112 bytes} [Thu Jul 28 08:12:13 2022] GET /identity/v3/services?type=network => generated 350 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:12:13.583284 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f1f0a1-1523-4d2b-b3cd-195522a0ec38 None admin] Authenticating user token {{(pid=144068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:12:13.604073 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae86dda2-7fb2-4118-a7c6-c043027d2575 None admin] Validating token access rules against request {{(pid=144067) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:12:13.640367 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-632b9ebb-f007-4495-95b0-1d5e7c3eba7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144067) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:12:13.641453 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632b9ebb-f007-4495-95b0-1d5e7c3eba7d None admin] REQUEST_METHOD: `GET` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:12:13.641981 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632b9ebb-f007-4495-95b0-1d5e7c3eba7d None admin] SCRIPT_NAME: `/identity` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:12:13.642487 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632b9ebb-f007-4495-95b0-1d5e7c3eba7d None admin] PATH_INFO: `/v3/projects` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:12:13.643493 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-632b9ebb-f007-4495-95b0-1d5e7c3eba7d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=144067) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:12:13.644036 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-632b9ebb-f007-4495-95b0-1d5e7c3eba7d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:12:13.645963 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-632b9ebb-f007-4495-95b0-1d5e7c3eba7d None admin] RBAC: Authorization granted {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:12:13.659712 dv-cinder-851351-1-smb devstack@keystone.service[144067]: [pid: 144067|app: 0|req: 378/768] 10.222.0.42 () {56 vars in 1148 bytes} [Thu Jul 28 08:12:13 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:12:13.661093 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-632b9ebb-f007-4495-95b0-1d5e7c3eba7d None admin] Authenticating user token {{(pid=144067) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:12:13.700567 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f1f0a1-1523-4d2b-b3cd-195522a0ec38 None admin] Validating token access rules against request {{(pid=144068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:12:13.736850 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce312ea-04fe-4269-aa79-f8b429f4004c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:12:13.737489 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce312ea-04fe-4269-aa79-f8b429f4004c None admin] REQUEST_METHOD: `GET` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:12:13.737773 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce312ea-04fe-4269-aa79-f8b429f4004c None admin] SCRIPT_NAME: `/identity` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:12:13.738107 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce312ea-04fe-4269-aa79-f8b429f4004c None admin] PATH_INFO: `/v3/projects` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:12:13.738910 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce312ea-04fe-4269-aa79-f8b429f4004c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=144068) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:12:13.739217 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce312ea-04fe-4269-aa79-f8b429f4004c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:12:13.740691 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce312ea-04fe-4269-aa79-f8b429f4004c None admin] RBAC: Authorization granted {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:12:13.759144 dv-cinder-851351-1-smb devstack@keystone.service[144068]: [pid: 144068|app: 0|req: 391/769] 10.222.0.42 () {56 vars in 1148 bytes} [Thu Jul 28 08:12:13 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:12:13.759144 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce312ea-04fe-4269-aa79-f8b429f4004c None admin] Authenticating user token {{(pid=144068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:12:13.778130 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG dbcounter [-] [144068] Writing DB stats keystone:SELECT=100 {{(pid=144068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:12:13.780937 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-632b9ebb-f007-4495-95b0-1d5e7c3eba7d None admin] Validating token access rules against request {{(pid=144067) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:12:13.795083 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG dbcounter [-] [144067] Writing DB stats keystone:SELECT=100 {{(pid=144067) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:12:13.825128 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f42fed7-9305-492b-92cf-96f806b552af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144067) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:12:13.825836 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f42fed7-9305-492b-92cf-96f806b552af None admin] REQUEST_METHOD: `GET` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:12:13.826125 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f42fed7-9305-492b-92cf-96f806b552af None admin] SCRIPT_NAME: `/identity` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:12:13.826411 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f42fed7-9305-492b-92cf-96f806b552af None admin] PATH_INFO: `/v3/endpoints` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:12:13.827210 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f42fed7-9305-492b-92cf-96f806b552af None admin] RBAC: Adding query filter params (interface=public, service_id=56056334b1c6471b97987d723dc9fb57, region_id=RegionOne) {{(pid=144067) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:12:13.827533 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f42fed7-9305-492b-92cf-96f806b552af None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:12:13.829026 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f42fed7-9305-492b-92cf-96f806b552af None admin] RBAC: Authorization granted {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:12:13.838006 dv-cinder-851351-1-smb devstack@keystone.service[144067]: [pid: 144067|app: 0|req: 379/770] 10.222.0.42 () {56 vars in 1251 bytes} [Thu Jul 28 08:12:13 2022] GET /identity/v3/endpoints?service_id=56056334b1c6471b97987d723dc9fb57&interface=public®ion_id=RegionOne => generated 194 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:12:13.840418 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd3c02f-044c-4c22-86d8-b22872a7b787 None None] REQUEST_METHOD: `GET` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:12:13.841014 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd3c02f-044c-4c22-86d8-b22872a7b787 None None] SCRIPT_NAME: `/identity` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:12:13.841510 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd3c02f-044c-4c22-86d8-b22872a7b787 None None] PATH_INFO: `/` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:12:13.844411 dv-cinder-851351-1-smb devstack@keystone.service[144067]: [pid: 144067|app: 0|req: 380/771] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 08:12:13 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 08:12:13.845946 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd3c02f-044c-4c22-86d8-b22872a7b787 None None] Authenticating user token {{(pid=144067) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:12:13.873919 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce312ea-04fe-4269-aa79-f8b429f4004c None admin] Validating token access rules against request {{(pid=144068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:12:13.917723 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf6685d3-88a2-4878-98af-e985973ab0be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:12:13.918703 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6685d3-88a2-4878-98af-e985973ab0be None admin] REQUEST_METHOD: `GET` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:12:13.919137 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6685d3-88a2-4878-98af-e985973ab0be None admin] SCRIPT_NAME: `/identity` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:12:13.919583 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6685d3-88a2-4878-98af-e985973ab0be None admin] PATH_INFO: `/v3/role_assignments` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:12:13.921056 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf6685d3-88a2-4878-98af-e985973ab0be None admin] RBAC: Adding query filter params (role.id=d1020e7bb0b7411d895ddedd6dc02c5b, scope.project.id=fa39ab7491e5413ca648e31ee9177fa0, user.id=fffb2166afc14796bc3c9c9eba793ec0) {{(pid=144068) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:12:13.921588 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf6685d3-88a2-4878-98af-e985973ab0be None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:12:13.924217 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf6685d3-88a2-4878-98af-e985973ab0be None admin] RBAC: Authorization granted {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:12:13.934302 dv-cinder-851351-1-smb devstack@keystone.service[144068]: [pid: 144068|app: 0|req: 392/772] 10.222.0.42 () {56 vars in 1374 bytes} [Thu Jul 28 08:12:13 2022] GET /identity/v3/role_assignments?user.id=fffb2166afc14796bc3c9c9eba793ec0&scope.project.id=fa39ab7491e5413ca648e31ee9177fa0&role.id=d1020e7bb0b7411d895ddedd6dc02c5b => generated 259 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:12:13.935605 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf6685d3-88a2-4878-98af-e985973ab0be None admin] Authenticating user token {{(pid=144068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:12:13.978054 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd3c02f-044c-4c22-86d8-b22872a7b787 None None] Validating token access rules against request {{(pid=144067) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:12:14.039928 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d217f4-b6df-46f4-85cd-d94efd07c793 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144067) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:12:14.041282 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d217f4-b6df-46f4-85cd-d94efd07c793 None admin] REQUEST_METHOD: `GET` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:12:14.042281 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d217f4-b6df-46f4-85cd-d94efd07c793 None admin] SCRIPT_NAME: `/identity` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:12:14.042736 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d217f4-b6df-46f4-85cd-d94efd07c793 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:12:14.044050 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d217f4-b6df-46f4-85cd-d94efd07c793 None admin] RBAC: Adding query filter params (role.id=9aa6ce92dcbb4164ac0e44d2aa2a0248, scope.project.id=fa39ab7491e5413ca648e31ee9177fa0, user.id=64acbde3263f4bb8b102034fc3a9d4e6) {{(pid=144067) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:12:14.044795 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d217f4-b6df-46f4-85cd-d94efd07c793 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:12:14.046369 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d217f4-b6df-46f4-85cd-d94efd07c793 None admin] RBAC: Authorization granted {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:12:14.060430 dv-cinder-851351-1-smb devstack@keystone.service[144067]: [pid: 144067|app: 0|req: 381/773] 10.222.0.42 () {56 vars in 1374 bytes} [Thu Jul 28 08:12:13 2022] GET /identity/v3/role_assignments?user.id=64acbde3263f4bb8b102034fc3a9d4e6&scope.project.id=fa39ab7491e5413ca648e31ee9177fa0&role.id=9aa6ce92dcbb4164ac0e44d2aa2a0248 => generated 259 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:12:14.060430 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6651f5c2-d5a4-445e-ac6a-5898e0e9b14d None None] REQUEST_METHOD: `POST` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:12:14.060430 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6651f5c2-d5a4-445e-ac6a-5898e0e9b14d None None] SCRIPT_NAME: `/identity` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:12:14.060430 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6651f5c2-d5a4-445e-ac6a-5898e0e9b14d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:12:14.082284 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.auth.core [None req-6651f5c2-d5a4-445e-ac6a-5898e0e9b14d None None] MFA Rules not processed for user `bf5ceb8f07374635ad506b7d1b4f1612`. Rule list: `[]` (Enabled: `True`). {{(pid=144067) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 08:12:14.084574 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.fernet_utils [None req-6651f5c2-d5a4-445e-ac6a-5898e0e9b14d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=144067) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:12:14.109162 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG dbcounter [-] [144068] Writing DB stats keystone:SELECT=100 {{(pid=144068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:12:14.126214 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG dbcounter [-] [144067] Writing DB stats keystone:SELECT=100 {{(pid=144067) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:12:14.154431 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf6685d3-88a2-4878-98af-e985973ab0be None admin] Validating token access rules against request {{(pid=144068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:12:14.187276 dv-cinder-851351-1-smb devstack@keystone.service[144067]: [pid: 144067|app: 0|req: 382/774] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 08:12:14 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 08:12:14.204862 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1d6cc9-b3e4-4728-91ad-157ca2560a79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:12:14.205530 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1d6cc9-b3e4-4728-91ad-157ca2560a79 None admin] REQUEST_METHOD: `GET` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:12:14.205818 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1d6cc9-b3e4-4728-91ad-157ca2560a79 None admin] SCRIPT_NAME: `/identity` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:12:14.206092 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1d6cc9-b3e4-4728-91ad-157ca2560a79 None admin] PATH_INFO: `/v3/services` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:12:14.206886 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d1d6cc9-b3e4-4728-91ad-157ca2560a79 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:12:14.208411 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d1d6cc9-b3e4-4728-91ad-157ca2560a79 None admin] RBAC: Authorization granted {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:12:14.215572 dv-cinder-851351-1-smb devstack@keystone.service[144068]: [pid: 144068|app: 0|req: 393/775] 10.222.0.42 () {56 vars in 1087 bytes} [Thu Jul 28 08:12:13 2022] GET /identity/v3/services => generated 772 bytes in 281 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:12:14.219054 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6651f5c2-d5a4-445e-ac6a-5898e0e9b14d None None] Authenticating user token {{(pid=144067) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:12:14.381773 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6651f5c2-d5a4-445e-ac6a-5898e0e9b14d None None] Validating token access rules against request {{(pid=144067) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:12:14.424550 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a97f8b-5b57-424c-90d6-dc0e4e541da0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144067) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:12:14.425287 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a97f8b-5b57-424c-90d6-dc0e4e541da0 None admin] REQUEST_METHOD: `GET` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:12:14.425630 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a97f8b-5b57-424c-90d6-dc0e4e541da0 None admin] SCRIPT_NAME: `/identity` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:12:14.425907 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a97f8b-5b57-424c-90d6-dc0e4e541da0 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:12:14.426573 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a97f8b-5b57-424c-90d6-dc0e4e541da0 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:12:14.428070 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a97f8b-5b57-424c-90d6-dc0e4e541da0 None admin] RBAC: Authorization granted {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:12:14.440368 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application [None req-e0a97f8b-5b57-424c-90d6-dc0e4e541da0 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 28 08:12:14.440368 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:12:14.440368 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 28 08:12:14.440368 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 28 08:12:14.440368 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 28 08:12:14.440368 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 28 08:12:14.440368 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 28 08:12:14.440368 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 08:12:14.440368 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 28 08:12:14.440368 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application Jul 28 08:12:14.440368 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 28 08:12:14.440368 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application Jul 28 08:12:14.440368 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:12:14.440368 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:12:14.440368 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:12:14.440368 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:12:14.441651 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:12:14.441651 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:12:14.441651 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:12:14.441651 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:12:14.441651 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:12:14.441651 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:12:14.441651 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:12:14.441651 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 28 08:12:14.441651 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 28 08:12:14.441651 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 28 08:12:14.441651 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 28 08:12:14.441651 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:12:14.441651 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:12:14.441651 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:12:14.441651 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:12:14.441651 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:12:14.442609 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:12:14.442609 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:12:14.442609 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application with Lock( Jul 28 08:12:14.442609 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:12:14.442609 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:12:14.442609 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:12:14.442609 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:12:14.442609 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:12:14.442609 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:12:14.442609 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:12:14.442609 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:12:14.442609 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 28 08:12:14.442609 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 08:12:14.442609 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 28 08:12:14.442609 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application Jul 28 08:12:14.442609 dv-cinder-851351-1-smb devstack@keystone.service[144067]: [pid: 144067|app: 0|req: 383/776] 10.222.0.42 () {56 vars in 1129 bytes} [Thu Jul 28 08:12:14 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:12:14.450124 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1d6cc9-b3e4-4728-91ad-157ca2560a79 None admin] Authenticating user token {{(pid=144068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:12:14.469414 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7e9699-5717-4031-ac34-8050c3d00a06 None None] REQUEST_METHOD: `GET` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:12:14.469773 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7e9699-5717-4031-ac34-8050c3d00a06 None None] SCRIPT_NAME: `/identity` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:12:14.469940 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7e9699-5717-4031-ac34-8050c3d00a06 None None] PATH_INFO: `/` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:12:14.471654 dv-cinder-851351-1-smb devstack@keystone.service[144067]: [pid: 144067|app: 0|req: 384/777] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 08:12:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 28 08:12:14.477787 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a0988a-f446-4c1c-adb6-70b5aac59506 None None] REQUEST_METHOD: `POST` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:12:14.478162 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a0988a-f446-4c1c-adb6-70b5aac59506 None None] SCRIPT_NAME: `/identity` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:12:14.478380 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a0988a-f446-4c1c-adb6-70b5aac59506 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:12:14.500687 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.auth.core [None req-62a0988a-f446-4c1c-adb6-70b5aac59506 None None] MFA Rules not processed for user `bf5ceb8f07374635ad506b7d1b4f1612`. Rule list: `[]` (Enabled: `True`). {{(pid=144067) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 08:12:14.501913 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.fernet_utils [None req-62a0988a-f446-4c1c-adb6-70b5aac59506 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=144067) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:12:14.533917 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG dbcounter [-] [144067] Writing DB stats keystone:SELECT=100 {{(pid=144067) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:12:14.582070 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1d6cc9-b3e4-4728-91ad-157ca2560a79 None admin] Validating token access rules against request {{(pid=144068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:12:14.593292 dv-cinder-851351-1-smb devstack@keystone.service[144067]: [pid: 144067|app: 0|req: 385/778] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 08:12:14 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 28 08:12:14.621912 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a0988a-f446-4c1c-adb6-70b5aac59506 None None] Authenticating user token {{(pid=144067) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:12:14.629495 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b54fb14-586b-4a07-8537-2db7def16ea2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:12:14.630526 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b54fb14-586b-4a07-8537-2db7def16ea2 None admin] REQUEST_METHOD: `GET` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:12:14.631054 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b54fb14-586b-4a07-8537-2db7def16ea2 None admin] SCRIPT_NAME: `/identity` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:12:14.631555 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b54fb14-586b-4a07-8537-2db7def16ea2 None admin] PATH_INFO: `/v3/services` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:12:14.632570 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b54fb14-586b-4a07-8537-2db7def16ea2 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=144068) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:12:14.633172 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b54fb14-586b-4a07-8537-2db7def16ea2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:12:14.634859 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b54fb14-586b-4a07-8537-2db7def16ea2 None admin] RBAC: Authorization granted {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:12:14.641188 dv-cinder-851351-1-smb devstack@keystone.service[144068]: [pid: 144068|app: 0|req: 394/779] 10.222.0.42 () {56 vars in 1124 bytes} [Thu Jul 28 08:12:14 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:12:14.646977 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b54fb14-586b-4a07-8537-2db7def16ea2 None admin] Authenticating user token {{(pid=144068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:12:14.666644 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG dbcounter [-] [144068] Writing DB stats keystone:SELECT=100 {{(pid=144068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:12:14.771132 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b54fb14-586b-4a07-8537-2db7def16ea2 None admin] Validating token access rules against request {{(pid=144068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:12:14.857566 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254f78ae-e449-4bf2-89ca-79795c681f44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:12:14.858667 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254f78ae-e449-4bf2-89ca-79795c681f44 None admin] REQUEST_METHOD: `GET` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:12:14.858667 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254f78ae-e449-4bf2-89ca-79795c681f44 None admin] SCRIPT_NAME: `/identity` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:12:14.858952 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254f78ae-e449-4bf2-89ca-79795c681f44 None admin] PATH_INFO: `/v3/services` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:12:14.859489 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-254f78ae-e449-4bf2-89ca-79795c681f44 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=144068) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:12:14.859798 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-254f78ae-e449-4bf2-89ca-79795c681f44 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:12:14.861369 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-254f78ae-e449-4bf2-89ca-79795c681f44 None admin] RBAC: Authorization granted {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:12:14.872471 dv-cinder-851351-1-smb devstack@keystone.service[144068]: [pid: 144068|app: 0|req: 395/780] 10.222.0.42 () {56 vars in 1124 bytes} [Thu Jul 28 08:12:14 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:12:14.878476 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254f78ae-e449-4bf2-89ca-79795c681f44 None admin] Authenticating user token {{(pid=144068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:12:14.950217 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a0988a-f446-4c1c-adb6-70b5aac59506 None None] Validating token access rules against request {{(pid=144067) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:12:14.999200 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43b6ecd-fb11-4223-b3ec-a5a7c3fe41d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144067) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:12:15.000785 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43b6ecd-fb11-4223-b3ec-a5a7c3fe41d5 None admin] REQUEST_METHOD: `GET` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:12:15.001280 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43b6ecd-fb11-4223-b3ec-a5a7c3fe41d5 None admin] SCRIPT_NAME: `/identity` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:12:15.001762 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43b6ecd-fb11-4223-b3ec-a5a7c3fe41d5 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:12:15.026306 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f43b6ecd-fb11-4223-b3ec-a5a7c3fe41d5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 08:12:15.037745 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application [None req-f43b6ecd-fb11-4223-b3ec-a5a7c3fe41d5 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 08:12:15.037745 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:12:15.037745 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:12:15.037745 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:12:15.037745 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:12:15.037745 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:12:15.037745 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:12:15.037745 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:12:15.037745 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:12:15.037745 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:12:15.037745 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:12:15.037745 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:12:15.037745 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 08:12:15.037745 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 08:12:15.037745 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 08:12:15.037745 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 08:12:15.039067 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 08:12:15.039067 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 08:12:15.039067 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 08:12:15.039067 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 08:12:15.039067 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:12:15.039067 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:12:15.039067 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:12:15.039067 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:12:15.039067 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:12:15.039067 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:12:15.039067 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:12:15.039067 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application with Lock( Jul 28 08:12:15.039067 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:12:15.039067 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:12:15.039067 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:12:15.039067 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:12:15.040101 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:12:15.040101 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:12:15.040101 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:12:15.040101 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:12:15.040101 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 08:12:15.040101 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 08:12:15.040101 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 08:12:15.040101 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 08:12:15.040101 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 08:12:15.040101 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 08:12:15.040101 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 08:12:15.040101 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application Jul 28 08:12:15.052907 dv-cinder-851351-1-smb devstack@keystone.service[144067]: [pid: 144067|app: 0|req: 386/781] 10.222.0.42 () {56 vars in 1096 bytes} [Thu Jul 28 08:12:14 2022] GET /identity/v3/roles/admin => generated 83 bytes in 427 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:12:15.063928 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43b6ecd-fb11-4223-b3ec-a5a7c3fe41d5 None admin] Authenticating user token {{(pid=144067) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:12:15.091344 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG dbcounter [-] [144068] Writing DB stats keystone:SELECT=100 {{(pid=144068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:12:15.117145 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG dbcounter [-] [144067] Writing DB stats keystone:SELECT=100 {{(pid=144067) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:12:15.143747 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254f78ae-e449-4bf2-89ca-79795c681f44 None admin] Validating token access rules against request {{(pid=144068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:12:15.208149 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c57344-75de-4dda-9623-23d30eaf878d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:12:15.209094 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c57344-75de-4dda-9623-23d30eaf878d None admin] REQUEST_METHOD: `GET` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:12:15.209533 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c57344-75de-4dda-9623-23d30eaf878d None admin] SCRIPT_NAME: `/identity` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:12:15.209961 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c57344-75de-4dda-9623-23d30eaf878d None admin] PATH_INFO: `/v3/endpoints` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:12:15.211266 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5c57344-75de-4dda-9623-23d30eaf878d None admin] RBAC: Adding query filter params (interface=public, service_id=df182955b8394bc59c315384cbffc45c, region_id=RegionOne) {{(pid=144068) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:12:15.211753 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5c57344-75de-4dda-9623-23d30eaf878d None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:12:15.213348 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5c57344-75de-4dda-9623-23d30eaf878d None admin] RBAC: Authorization granted {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:12:15.222046 dv-cinder-851351-1-smb devstack@keystone.service[144068]: [pid: 144068|app: 0|req: 396/782] 10.222.0.42 () {56 vars in 1251 bytes} [Thu Jul 28 08:12:14 2022] GET /identity/v3/endpoints?service_id=df182955b8394bc59c315384cbffc45c&interface=public®ion_id=RegionOne => generated 194 bytes in 344 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 08:12:15.227924 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c57344-75de-4dda-9623-23d30eaf878d None admin] Authenticating user token {{(pid=144068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:12:15.266507 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43b6ecd-fb11-4223-b3ec-a5a7c3fe41d5 None admin] Validating token access rules against request {{(pid=144067) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:12:15.338861 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aadabb34-84f8-4a5a-bced-3ccd9ee93415 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144067) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:12:15.341046 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aadabb34-84f8-4a5a-bced-3ccd9ee93415 None admin] REQUEST_METHOD: `GET` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:12:15.343134 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aadabb34-84f8-4a5a-bced-3ccd9ee93415 None admin] SCRIPT_NAME: `/identity` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:12:15.343594 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aadabb34-84f8-4a5a-bced-3ccd9ee93415 None admin] PATH_INFO: `/v3/roles` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:12:15.344579 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aadabb34-84f8-4a5a-bced-3ccd9ee93415 None admin] RBAC: Adding query filter params (name=admin) {{(pid=144067) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:12:15.345251 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aadabb34-84f8-4a5a-bced-3ccd9ee93415 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:12:15.348388 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aadabb34-84f8-4a5a-bced-3ccd9ee93415 None admin] RBAC: Authorization granted {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:12:15.373018 dv-cinder-851351-1-smb devstack@keystone.service[144067]: [pid: 144067|app: 0|req: 387/783] 10.222.0.42 () {56 vars in 1099 bytes} [Thu Jul 28 08:12:15 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 310 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 08:12:15.379260 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aadabb34-84f8-4a5a-bced-3ccd9ee93415 None admin] Authenticating user token {{(pid=144067) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:12:15.395054 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c57344-75de-4dda-9623-23d30eaf878d None admin] Validating token access rules against request {{(pid=144068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:12:15.440690 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c82f40-5a38-4037-8556-26606c347857 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:12:15.441395 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c82f40-5a38-4037-8556-26606c347857 None admin] REQUEST_METHOD: `GET` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:12:15.441676 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c82f40-5a38-4037-8556-26606c347857 None admin] SCRIPT_NAME: `/identity` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:12:15.441950 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c82f40-5a38-4037-8556-26606c347857 None admin] PATH_INFO: `/v3/services` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:12:15.442627 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c82f40-5a38-4037-8556-26606c347857 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:12:15.444026 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c82f40-5a38-4037-8556-26606c347857 None admin] RBAC: Authorization granted {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:12:15.455982 dv-cinder-851351-1-smb devstack@keystone.service[144068]: [pid: 144068|app: 0|req: 397/784] 10.222.0.42 () {56 vars in 1087 bytes} [Thu Jul 28 08:12:15 2022] GET /identity/v3/services => generated 772 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 08:12:15.566390 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG dbcounter [-] [144067] Writing DB stats keystone:SELECT=100 {{(pid=144067) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:12:15.589337 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aadabb34-84f8-4a5a-bced-3ccd9ee93415 None admin] Validating token access rules against request {{(pid=144067) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:12:15.646689 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b68e0f7-beb4-411d-a6ab-8339024d9aa9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144067) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:12:15.647665 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b68e0f7-beb4-411d-a6ab-8339024d9aa9 None admin] REQUEST_METHOD: `GET` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:12:15.648101 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b68e0f7-beb4-411d-a6ab-8339024d9aa9 None admin] SCRIPT_NAME: `/identity` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:12:15.648494 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b68e0f7-beb4-411d-a6ab-8339024d9aa9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:12:15.664612 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b68e0f7-beb4-411d-a6ab-8339024d9aa9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:12:15.666166 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b68e0f7-beb4-411d-a6ab-8339024d9aa9 None admin] RBAC: Authorization granted {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:12:15.688329 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application [None req-3b68e0f7-beb4-411d-a6ab-8339024d9aa9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 08:12:15.688329 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:12:15.688329 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:12:15.688329 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:12:15.688329 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:12:15.688329 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:12:15.688329 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:12:15.688329 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:12:15.688329 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:12:15.688329 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:12:15.688329 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:12:15.688329 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:12:15.688329 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 08:12:15.688329 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 08:12:15.688329 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 08:12:15.689499 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 08:12:15.689499 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:12:15.689499 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:12:15.689499 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:12:15.689499 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:12:15.689499 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:12:15.689499 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:12:15.689499 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:12:15.689499 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application with Lock( Jul 28 08:12:15.689499 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:12:15.689499 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:12:15.689499 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:12:15.689499 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:12:15.689499 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:12:15.689499 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:12:15.689499 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:12:15.689499 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:12:15.690493 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 08:12:15.690493 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 08:12:15.690493 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 08:12:15.690493 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application Jul 28 08:12:15.690493 dv-cinder-851351-1-smb devstack@keystone.service[144067]: [pid: 144067|app: 0|req: 388/785] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 08:12:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 312 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 08:12:15.697012 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c82f40-5a38-4037-8556-26606c347857 None admin] Authenticating user token {{(pid=144068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:12:15.701837 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG dbcounter [-] [144068] Writing DB stats keystone:SELECT=100 {{(pid=144068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:12:15.830060 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c82f40-5a38-4037-8556-26606c347857 None admin] Validating token access rules against request {{(pid=144068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:12:15.883297 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67084090-3741-4604-94fd-aea68fe02b6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:12:15.884105 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67084090-3741-4604-94fd-aea68fe02b6a None admin] REQUEST_METHOD: `GET` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:12:15.884307 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67084090-3741-4604-94fd-aea68fe02b6a None admin] SCRIPT_NAME: `/identity` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:12:15.884555 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67084090-3741-4604-94fd-aea68fe02b6a None admin] PATH_INFO: `/v3/domains` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:12:15.885351 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67084090-3741-4604-94fd-aea68fe02b6a None admin] RBAC: Adding query filter params (name=Default) {{(pid=144068) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:12:15.885657 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67084090-3741-4604-94fd-aea68fe02b6a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:12:15.887113 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67084090-3741-4604-94fd-aea68fe02b6a None admin] RBAC: Authorization granted {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:12:15.901637 dv-cinder-851351-1-smb devstack@keystone.service[144068]: [pid: 144068|app: 0|req: 398/786] 10.222.0.42 () {56 vars in 1109 bytes} [Thu Jul 28 08:12:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:12:15.913844 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b68e0f7-beb4-411d-a6ab-8339024d9aa9 None admin] Authenticating user token {{(pid=144067) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:12:16.065993 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b68e0f7-beb4-411d-a6ab-8339024d9aa9 None admin] Validating token access rules against request {{(pid=144067) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:12:16.130444 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c98836e-6be7-4a8d-8b72-ad8bdf972177 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144067) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:12:16.131034 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c98836e-6be7-4a8d-8b72-ad8bdf972177 None admin] REQUEST_METHOD: `GET` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:12:16.131380 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c98836e-6be7-4a8d-8b72-ad8bdf972177 None admin] SCRIPT_NAME: `/identity` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:12:16.131671 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c98836e-6be7-4a8d-8b72-ad8bdf972177 None admin] PATH_INFO: `/v3/users/nova` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:12:16.144907 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c98836e-6be7-4a8d-8b72-ad8bdf972177 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:12:16.146469 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c98836e-6be7-4a8d-8b72-ad8bdf972177 None admin] RBAC: Authorization granted {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:12:16.148565 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG dbcounter [-] [144067] Writing DB stats keystone:SELECT=100 {{(pid=144067) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:12:16.166230 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application [None req-1c98836e-6be7-4a8d-8b72-ad8bdf972177 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 28 08:12:16.166230 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:12:16.166230 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:12:16.166230 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:12:16.166230 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:12:16.166230 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:12:16.166230 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:12:16.166230 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:12:16.166230 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:12:16.166230 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:12:16.166230 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:12:16.166230 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:12:16.166230 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 28 08:12:16.166230 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 28 08:12:16.166230 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 28 08:12:16.166230 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 28 08:12:16.167379 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:12:16.167379 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:12:16.167379 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 28 08:12:16.167379 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 08:12:16.167379 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 28 08:12:16.167379 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 08:12:16.167379 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:12:16.167379 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:12:16.167379 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:12:16.167379 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:12:16.167379 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:12:16.167379 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application with Lock( Jul 28 08:12:16.167379 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:12:16.167379 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:12:16.167379 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:12:16.167379 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:12:16.167379 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:12:16.167379 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:12:16.168422 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:12:16.168422 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:12:16.168422 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 28 08:12:16.168422 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 28 08:12:16.168422 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 28 08:12:16.168422 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 28 08:12:16.168422 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 28 08:12:16.168422 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 28 08:12:16.168422 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 28 08:12:16.168422 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application Jul 28 08:12:16.169063 dv-cinder-851351-1-smb devstack@keystone.service[144067]: [pid: 144067|app: 0|req: 389/787] 10.222.0.42 () {56 vars in 1093 bytes} [Thu Jul 28 08:12:15 2022] GET /identity/v3/users/nova => generated 82 bytes in 255 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:12:16.174508 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67084090-3741-4604-94fd-aea68fe02b6a None admin] Authenticating user token {{(pid=144068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:12:16.280350 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG dbcounter [-] [144068] Writing DB stats keystone:SELECT=100 {{(pid=144068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:12:16.338105 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67084090-3741-4604-94fd-aea68fe02b6a None admin] Validating token access rules against request {{(pid=144068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:12:16.385840 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b05b452-7129-470e-9440-a760229750a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:12:16.386368 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b05b452-7129-470e-9440-a760229750a8 None admin] REQUEST_METHOD: `GET` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:12:16.386655 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b05b452-7129-470e-9440-a760229750a8 None admin] SCRIPT_NAME: `/identity` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:12:16.386933 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b05b452-7129-470e-9440-a760229750a8 None admin] PATH_INFO: `/v3/users` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:12:16.387757 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b05b452-7129-470e-9440-a760229750a8 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=144068) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:12:16.388065 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b05b452-7129-470e-9440-a760229750a8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:12:16.389547 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b05b452-7129-470e-9440-a760229750a8 None admin] RBAC: Authorization granted {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:12:16.417931 dv-cinder-851351-1-smb devstack@keystone.service[144068]: [pid: 144068|app: 0|req: 399/788] 10.222.0.42 () {56 vars in 1133 bytes} [Thu Jul 28 08:12:16 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:12:16.426557 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c98836e-6be7-4a8d-8b72-ad8bdf972177 None admin] Authenticating user token {{(pid=144067) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:12:16.551707 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c98836e-6be7-4a8d-8b72-ad8bdf972177 None admin] Validating token access rules against request {{(pid=144067) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:12:16.571178 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6c81c8-6fe8-43ea-8abe-3cc9d02b2519 None None] REQUEST_METHOD: `GET` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:12:16.571553 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6c81c8-6fe8-43ea-8abe-3cc9d02b2519 None None] SCRIPT_NAME: `/identity` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:12:16.571746 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6c81c8-6fe8-43ea-8abe-3cc9d02b2519 None None] PATH_INFO: `/` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:12:16.573464 dv-cinder-851351-1-smb devstack@keystone.service[144068]: [pid: 144068|app: 0|req: 400/789] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 08:12:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 08:12:16.592766 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aeeead7-ccd4-4e82-afa5-78742c2ebdd1 None None] REQUEST_METHOD: `POST` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:12:16.593130 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aeeead7-ccd4-4e82-afa5-78742c2ebdd1 None None] SCRIPT_NAME: `/identity` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:12:16.593327 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aeeead7-ccd4-4e82-afa5-78742c2ebdd1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:12:16.618943 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.auth.core [None req-1aeeead7-ccd4-4e82-afa5-78742c2ebdd1 None None] MFA Rules not processed for user `bf5ceb8f07374635ad506b7d1b4f1612`. Rule list: `[]` (Enabled: `True`). {{(pid=144068) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 08:12:16.620943 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.fernet_utils [None req-1aeeead7-ccd4-4e82-afa5-78742c2ebdd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=144068) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:12:16.625383 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe222cb-ce34-440c-b1b9-b914ad9351b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144067) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:12:16.626042 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe222cb-ce34-440c-b1b9-b914ad9351b6 None admin] REQUEST_METHOD: `GET` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:12:16.626329 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe222cb-ce34-440c-b1b9-b914ad9351b6 None admin] SCRIPT_NAME: `/identity` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:12:16.626613 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe222cb-ce34-440c-b1b9-b914ad9351b6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:12:16.710062 dv-cinder-851351-1-smb devstack@keystone.service[144068]: [pid: 144068|app: 0|req: 401/790] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 08:12:16 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 08:12:16.738889 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aeeead7-ccd4-4e82-afa5-78742c2ebdd1 None None] Authenticating user token {{(pid=144068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:12:16.761097 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG dbcounter [-] [144067] Writing DB stats keystone:SELECT=100 {{(pid=144067) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:12:16.768872 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fe222cb-ce34-440c-b1b9-b914ad9351b6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:12:16.773294 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fe222cb-ce34-440c-b1b9-b914ad9351b6 None admin] RBAC: Authorization granted {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:12:16.845064 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG dbcounter [-] [144068] Writing DB stats keystone:SELECT=100 {{(pid=144068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:12:16.927306 dv-cinder-851351-1-smb devstack@keystone.service[144067]: [pid: 144067|app: 0|req: 390/791] 10.222.0.42 () {58 vars in 1282 bytes} [Thu Jul 28 08:12:16 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 501 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 28 08:12:16.929052 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a405649d-a38c-4eb1-958b-85b398a94868 None None] REQUEST_METHOD: `GET` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:12:16.929052 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a405649d-a38c-4eb1-958b-85b398a94868 None None] SCRIPT_NAME: `/identity` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:12:16.929407 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a405649d-a38c-4eb1-958b-85b398a94868 None None] PATH_INFO: `/` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:12:16.935055 dv-cinder-851351-1-smb devstack@keystone.service[144067]: [pid: 144067|app: 0|req: 391/792] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 08:12:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 08:12:16.936473 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a405649d-a38c-4eb1-958b-85b398a94868 None None] Authenticating user token {{(pid=144067) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:12:16.952455 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aeeead7-ccd4-4e82-afa5-78742c2ebdd1 None None] Validating token access rules against request {{(pid=144068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:12:17.025564 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1615a3e8-cb75-435c-a508-4b028ae3e2b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:12:17.026844 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1615a3e8-cb75-435c-a508-4b028ae3e2b1 None admin] REQUEST_METHOD: `GET` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:12:17.027338 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1615a3e8-cb75-435c-a508-4b028ae3e2b1 None admin] SCRIPT_NAME: `/identity` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:12:17.027800 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1615a3e8-cb75-435c-a508-4b028ae3e2b1 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:12:17.041290 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1615a3e8-cb75-435c-a508-4b028ae3e2b1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 08:12:17.047745 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application [None req-1615a3e8-cb75-435c-a508-4b028ae3e2b1 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 08:12:17.047745 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:12:17.047745 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:12:17.047745 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:12:17.047745 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:12:17.047745 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:12:17.047745 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:12:17.047745 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:12:17.047745 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:12:17.047745 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:12:17.047745 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:12:17.047745 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:12:17.047745 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 08:12:17.047745 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 08:12:17.047745 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 08:12:17.047745 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 08:12:17.048516 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 08:12:17.048516 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 08:12:17.048516 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 08:12:17.048516 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 08:12:17.048516 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:12:17.048516 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:12:17.048516 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:12:17.048516 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:12:17.048516 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:12:17.048516 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:12:17.048516 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:12:17.048516 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application with Lock( Jul 28 08:12:17.048516 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:12:17.048516 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:12:17.048516 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:12:17.048516 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:12:17.049294 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:12:17.049294 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:12:17.049294 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:12:17.049294 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:12:17.049294 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 08:12:17.049294 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 08:12:17.049294 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 08:12:17.049294 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 08:12:17.049294 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 08:12:17.049294 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 08:12:17.049294 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 08:12:17.049294 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application Jul 28 08:12:17.052007 dv-cinder-851351-1-smb devstack@keystone.service[144068]: [pid: 144068|app: 0|req: 402/793] 10.222.0.42 () {56 vars in 1096 bytes} [Thu Jul 28 08:12:16 2022] GET /identity/v3/roles/admin => generated 83 bytes in 314 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:12:17.053469 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51522791-b8f3-4ebb-94ae-f070da318dfd None None] REQUEST_METHOD: `POST` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:12:17.053968 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51522791-b8f3-4ebb-94ae-f070da318dfd None None] SCRIPT_NAME: `/identity` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:12:17.054431 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51522791-b8f3-4ebb-94ae-f070da318dfd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:12:17.083804 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.auth.core [None req-51522791-b8f3-4ebb-94ae-f070da318dfd None None] MFA Rules not processed for user `bf5ceb8f07374635ad506b7d1b4f1612`. Rule list: `[]` (Enabled: `True`). {{(pid=144068) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 08:12:17.086321 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.fernet_utils [None req-51522791-b8f3-4ebb-94ae-f070da318dfd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=144068) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:12:17.138118 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG dbcounter [-] [144067] Writing DB stats keystone:SELECT=100 {{(pid=144067) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:12:17.144007 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a405649d-a38c-4eb1-958b-85b398a94868 None None] Validating token access rules against request {{(pid=144067) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:12:17.176693 dv-cinder-851351-1-smb devstack@keystone.service[144068]: [pid: 144068|app: 0|req: 403/794] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 08:12:17 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 08:12:17.176693 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51522791-b8f3-4ebb-94ae-f070da318dfd None None] Authenticating user token {{(pid=144068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:12:17.195138 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ae89bd-6c04-4941-862c-e6c88abc6382 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144067) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:12:17.196411 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ae89bd-6c04-4941-862c-e6c88abc6382 None admin] REQUEST_METHOD: `GET` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:12:17.196621 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ae89bd-6c04-4941-862c-e6c88abc6382 None admin] SCRIPT_NAME: `/identity` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:12:17.197190 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ae89bd-6c04-4941-862c-e6c88abc6382 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:12:17.209852 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65ae89bd-6c04-4941-862c-e6c88abc6382 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:12:17.211635 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65ae89bd-6c04-4941-862c-e6c88abc6382 None admin] RBAC: Authorization granted {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:12:17.218103 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG dbcounter [-] [144068] Writing DB stats keystone:SELECT=100 {{(pid=144068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:12:17.231441 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application [None req-65ae89bd-6c04-4941-862c-e6c88abc6382 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 08:12:17.231441 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:12:17.231441 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:12:17.231441 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:12:17.231441 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:12:17.231441 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:12:17.231441 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:12:17.231441 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:12:17.231441 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:12:17.231441 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:12:17.231441 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:12:17.231441 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:12:17.231441 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 08:12:17.231441 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 08:12:17.231441 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 08:12:17.232248 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 08:12:17.232248 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:12:17.232248 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:12:17.232248 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:12:17.232248 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:12:17.232248 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:12:17.232248 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:12:17.232248 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:12:17.232248 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application with Lock( Jul 28 08:12:17.232248 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:12:17.232248 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:12:17.232248 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:12:17.232248 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:12:17.232248 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:12:17.232248 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:12:17.232248 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:12:17.232248 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:12:17.233003 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 08:12:17.233003 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 08:12:17.233003 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 08:12:17.233003 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application Jul 28 08:12:17.233190 dv-cinder-851351-1-smb devstack@keystone.service[144067]: [pid: 144067|app: 0|req: 392/795] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 08:12:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 297 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:12:17.234835 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24ffe0b-b280-4325-83a6-3cc8bb21988a None None] REQUEST_METHOD: `GET` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:12:17.235192 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24ffe0b-b280-4325-83a6-3cc8bb21988a None None] SCRIPT_NAME: `/identity` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:12:17.235556 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24ffe0b-b280-4325-83a6-3cc8bb21988a None None] PATH_INFO: `/` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:12:17.237108 dv-cinder-851351-1-smb devstack@keystone.service[144067]: [pid: 144067|app: 0|req: 393/796] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 08:12:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 08:12:17.242208 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24ffe0b-b280-4325-83a6-3cc8bb21988a None None] Authenticating user token {{(pid=144067) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:12:17.298694 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51522791-b8f3-4ebb-94ae-f070da318dfd None None] Validating token access rules against request {{(pid=144068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:12:17.349656 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2584123c-9e03-48b0-93ef-573d4e38d4b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:12:17.350302 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2584123c-9e03-48b0-93ef-573d4e38d4b8 None admin] REQUEST_METHOD: `GET` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:12:17.350586 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2584123c-9e03-48b0-93ef-573d4e38d4b8 None admin] SCRIPT_NAME: `/identity` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:12:17.350868 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2584123c-9e03-48b0-93ef-573d4e38d4b8 None admin] PATH_INFO: `/v3/roles` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:12:17.351613 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2584123c-9e03-48b0-93ef-573d4e38d4b8 None admin] RBAC: Adding query filter params (name=admin) {{(pid=144068) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:12:17.351929 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2584123c-9e03-48b0-93ef-573d4e38d4b8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:12:17.353446 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2584123c-9e03-48b0-93ef-573d4e38d4b8 None admin] RBAC: Authorization granted {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:12:17.370352 dv-cinder-851351-1-smb devstack@keystone.service[144068]: [pid: 144068|app: 0|req: 404/797] 10.222.0.42 () {56 vars in 1099 bytes} [Thu Jul 28 08:12:17 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:12:17.370352 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2584123c-9e03-48b0-93ef-573d4e38d4b8 None admin] Authenticating user token {{(pid=144068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:12:17.403388 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24ffe0b-b280-4325-83a6-3cc8bb21988a None None] Validating token access rules against request {{(pid=144067) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:12:17.464064 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148f433a-09c9-4b69-9c0c-00ac560197bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144067) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:12:17.464637 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148f433a-09c9-4b69-9c0c-00ac560197bd None admin] REQUEST_METHOD: `GET` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:12:17.464957 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148f433a-09c9-4b69-9c0c-00ac560197bd None admin] SCRIPT_NAME: `/identity` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:12:17.465238 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148f433a-09c9-4b69-9c0c-00ac560197bd None admin] PATH_INFO: `/v3/roles/service` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:12:17.479858 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-148f433a-09c9-4b69-9c0c-00ac560197bd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 08:12:17.485003 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application [None req-148f433a-09c9-4b69-9c0c-00ac560197bd None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 28 08:12:17.485003 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:12:17.485003 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:12:17.485003 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:12:17.485003 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:12:17.485003 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:12:17.485003 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:12:17.485003 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:12:17.485003 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:12:17.485003 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:12:17.485003 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:12:17.485003 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:12:17.485003 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 08:12:17.485003 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 08:12:17.485003 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 08:12:17.485003 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 08:12:17.486134 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 08:12:17.486134 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 08:12:17.486134 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 08:12:17.486134 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 08:12:17.486134 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:12:17.486134 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:12:17.486134 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:12:17.486134 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:12:17.486134 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:12:17.486134 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:12:17.486134 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:12:17.486134 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application with Lock( Jul 28 08:12:17.486134 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:12:17.486134 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:12:17.486134 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:12:17.486134 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:12:17.487129 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:12:17.487129 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:12:17.487129 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:12:17.487129 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:12:17.487129 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 08:12:17.487129 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 08:12:17.487129 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 08:12:17.487129 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 08:12:17.487129 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 08:12:17.487129 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 08:12:17.487129 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 28 08:12:17.487129 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application Jul 28 08:12:17.487129 dv-cinder-851351-1-smb devstack@keystone.service[144067]: [pid: 144067|app: 0|req: 394/798] 10.222.0.42 () {56 vars in 1102 bytes} [Thu Jul 28 08:12:17 2022] GET /identity/v3/roles/service => generated 85 bytes in 249 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:12:17.488257 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a1a332-48b2-44ce-988d-41f9a34912d1 None None] REQUEST_METHOD: `POST` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:12:17.488257 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a1a332-48b2-44ce-988d-41f9a34912d1 None None] SCRIPT_NAME: `/identity` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:12:17.488257 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a1a332-48b2-44ce-988d-41f9a34912d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:12:17.509450 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.auth.core [None req-60a1a332-48b2-44ce-988d-41f9a34912d1 None None] MFA Rules not processed for user `bf5ceb8f07374635ad506b7d1b4f1612`. Rule list: `[]` (Enabled: `True`). {{(pid=144067) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 08:12:17.510695 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.fernet_utils [None req-60a1a332-48b2-44ce-988d-41f9a34912d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=144067) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:12:17.515771 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG dbcounter [-] [144067] Writing DB stats keystone:SELECT=100 {{(pid=144067) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:12:17.519889 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2584123c-9e03-48b0-93ef-573d4e38d4b8 None admin] Validating token access rules against request {{(pid=144068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:12:17.525095 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG dbcounter [-] [144068] Writing DB stats keystone:SELECT=100 {{(pid=144068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:12:17.585753 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6628617-8077-4078-8784-00e0c212ad8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:12:17.587300 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6628617-8077-4078-8784-00e0c212ad8c None admin] REQUEST_METHOD: `GET` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:12:17.587795 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6628617-8077-4078-8784-00e0c212ad8c None admin] SCRIPT_NAME: `/identity` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:12:17.588289 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6628617-8077-4078-8784-00e0c212ad8c None admin] PATH_INFO: `/v3/domains` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:12:17.589687 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6628617-8077-4078-8784-00e0c212ad8c None admin] RBAC: Adding query filter params (name=Default) {{(pid=144068) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:12:17.590233 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6628617-8077-4078-8784-00e0c212ad8c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:12:17.592961 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6628617-8077-4078-8784-00e0c212ad8c None admin] RBAC: Authorization granted {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:12:17.620607 dv-cinder-851351-1-smb devstack@keystone.service[144068]: [pid: 144068|app: 0|req: 405/799] 10.222.0.42 () {56 vars in 1109 bytes} [Thu Jul 28 08:12:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:12:17.620607 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6628617-8077-4078-8784-00e0c212ad8c None admin] Authenticating user token {{(pid=144068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:12:17.639836 dv-cinder-851351-1-smb devstack@keystone.service[144067]: [pid: 144067|app: 0|req: 395/800] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 08:12:17 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 08:12:17.641585 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a1a332-48b2-44ce-988d-41f9a34912d1 None None] Authenticating user token {{(pid=144067) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:12:17.795260 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a1a332-48b2-44ce-988d-41f9a34912d1 None None] Validating token access rules against request {{(pid=144067) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:12:17.799757 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6628617-8077-4078-8784-00e0c212ad8c None admin] Validating token access rules against request {{(pid=144068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:12:17.844994 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37553f18-58cf-42f1-8658-df6ed9a6e706 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:12:17.845675 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37553f18-58cf-42f1-8658-df6ed9a6e706 None admin] REQUEST_METHOD: `GET` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:12:17.845953 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37553f18-58cf-42f1-8658-df6ed9a6e706 None admin] SCRIPT_NAME: `/identity` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:12:17.846203 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feace6cb-081b-4890-b8d0-16deaa28bc46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144067) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:12:17.846312 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37553f18-58cf-42f1-8658-df6ed9a6e706 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:12:17.847394 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feace6cb-081b-4890-b8d0-16deaa28bc46 None admin] REQUEST_METHOD: `GET` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:12:17.847889 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feace6cb-081b-4890-b8d0-16deaa28bc46 None admin] SCRIPT_NAME: `/identity` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:12:17.848579 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feace6cb-081b-4890-b8d0-16deaa28bc46 None admin] PATH_INFO: `/v3/roles` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:12:17.849914 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feace6cb-081b-4890-b8d0-16deaa28bc46 None admin] RBAC: Adding query filter params (name=service) {{(pid=144067) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:12:17.850375 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feace6cb-081b-4890-b8d0-16deaa28bc46 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:12:17.851945 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feace6cb-081b-4890-b8d0-16deaa28bc46 None admin] RBAC: Authorization granted {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:12:17.860191 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37553f18-58cf-42f1-8658-df6ed9a6e706 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:12:17.861706 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37553f18-58cf-42f1-8658-df6ed9a6e706 None admin] RBAC: Authorization granted {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:12:17.868259 dv-cinder-851351-1-smb devstack@keystone.service[144067]: [pid: 144067|app: 0|req: 396/801] 10.222.0.42 () {56 vars in 1103 bytes} [Thu Jul 28 08:12:17 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:12:17.868259 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feace6cb-081b-4890-b8d0-16deaa28bc46 None admin] Authenticating user token {{(pid=144067) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:12:17.871270 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG dbcounter [-] [144067] Writing DB stats keystone:SELECT=100 {{(pid=144067) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:12:17.890243 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application [None req-37553f18-58cf-42f1-8658-df6ed9a6e706 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 08:12:17.890243 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:12:17.890243 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:12:17.890243 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:12:17.890243 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:12:17.890243 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:12:17.890243 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:12:17.890243 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:12:17.890243 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:12:17.890243 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:12:17.890243 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:12:17.890243 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:12:17.890243 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 08:12:17.890243 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 08:12:17.890243 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 08:12:17.891797 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 08:12:17.891797 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:12:17.891797 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:12:17.891797 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:12:17.891797 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:12:17.891797 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:12:17.891797 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:12:17.891797 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:12:17.891797 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application with Lock( Jul 28 08:12:17.891797 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:12:17.891797 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:12:17.891797 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:12:17.891797 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:12:17.891797 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:12:17.891797 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:12:17.891797 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:12:17.891797 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:12:17.892538 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 08:12:17.892538 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 08:12:17.892538 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 08:12:17.892538 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application Jul 28 08:12:17.892538 dv-cinder-851351-1-smb devstack@keystone.service[144068]: [pid: 144068|app: 0|req: 406/802] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 08:12:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 277 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:12:17.892538 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37553f18-58cf-42f1-8658-df6ed9a6e706 None admin] Authenticating user token {{(pid=144068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:12:17.926870 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG dbcounter [-] [144068] Writing DB stats keystone:SELECT=100 {{(pid=144068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:12:18.014675 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feace6cb-081b-4890-b8d0-16deaa28bc46 None admin] Validating token access rules against request {{(pid=144067) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:12:18.015781 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37553f18-58cf-42f1-8658-df6ed9a6e706 None admin] Validating token access rules against request {{(pid=144068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:12:18.053238 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda65361-57b7-4f8c-b40d-85f24970b59b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:12:18.053907 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda65361-57b7-4f8c-b40d-85f24970b59b None admin] REQUEST_METHOD: `GET` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:12:18.054270 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda65361-57b7-4f8c-b40d-85f24970b59b None admin] SCRIPT_NAME: `/identity` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:12:18.054594 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda65361-57b7-4f8c-b40d-85f24970b59b None admin] PATH_INFO: `/v3/services/network` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:12:18.055311 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dda65361-57b7-4f8c-b40d-85f24970b59b None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:12:18.056796 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dda65361-57b7-4f8c-b40d-85f24970b59b None admin] RBAC: Authorization granted {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:12:18.057458 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a35fa02a-53d9-489f-9e11-4534736fe9b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144067) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:12:18.058480 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35fa02a-53d9-489f-9e11-4534736fe9b3 None admin] REQUEST_METHOD: `GET` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:12:18.058957 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35fa02a-53d9-489f-9e11-4534736fe9b3 None admin] SCRIPT_NAME: `/identity` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:12:18.059428 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35fa02a-53d9-489f-9e11-4534736fe9b3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:12:18.066910 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application [None req-dda65361-57b7-4f8c-b40d-85f24970b59b None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jul 28 08:12:18.066910 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:12:18.066910 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 28 08:12:18.066910 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 28 08:12:18.066910 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 28 08:12:18.066910 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 28 08:12:18.066910 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 28 08:12:18.066910 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 08:12:18.066910 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 28 08:12:18.066910 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application Jul 28 08:12:18.066910 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 28 08:12:18.066910 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application Jul 28 08:12:18.066910 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:12:18.066910 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:12:18.066910 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:12:18.066910 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:12:18.066910 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:12:18.067823 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:12:18.067823 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:12:18.067823 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:12:18.067823 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:12:18.067823 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:12:18.067823 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:12:18.067823 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 28 08:12:18.067823 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 28 08:12:18.067823 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 28 08:12:18.067823 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 28 08:12:18.067823 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:12:18.067823 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:12:18.067823 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:12:18.067823 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:12:18.067823 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:12:18.067823 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:12:18.068551 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:12:18.068551 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application with Lock( Jul 28 08:12:18.068551 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:12:18.068551 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:12:18.068551 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:12:18.068551 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:12:18.068551 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:12:18.068551 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:12:18.068551 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:12:18.068551 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:12:18.068551 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 28 08:12:18.068551 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 08:12:18.068551 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 28 08:12:18.068551 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application Jul 28 08:12:18.069196 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a35fa02a-53d9-489f-9e11-4534736fe9b3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:12:18.069261 dv-cinder-851351-1-smb devstack@keystone.service[144068]: [pid: 144068|app: 0|req: 407/803] 10.222.0.42 () {56 vars in 1111 bytes} [Thu Jul 28 08:12:17 2022] GET /identity/v3/services/network => generated 88 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:12:18.069261 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda65361-57b7-4f8c-b40d-85f24970b59b None admin] Authenticating user token {{(pid=144068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:12:18.069386 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a35fa02a-53d9-489f-9e11-4534736fe9b3 None admin] RBAC: Authorization granted {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:12:18.082707 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application [None req-a35fa02a-53d9-489f-9e11-4534736fe9b3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 08:12:18.082707 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:12:18.082707 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:12:18.082707 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:12:18.082707 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:12:18.082707 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:12:18.082707 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:12:18.082707 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:12:18.082707 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:12:18.082707 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:12:18.082707 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:12:18.082707 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:12:18.082707 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 28 08:12:18.082707 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 28 08:12:18.082707 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 28 08:12:18.083715 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 28 08:12:18.083715 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:12:18.083715 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:12:18.083715 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:12:18.083715 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:12:18.083715 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:12:18.083715 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:12:18.083715 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:12:18.083715 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application with Lock( Jul 28 08:12:18.083715 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:12:18.083715 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:12:18.083715 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:12:18.083715 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:12:18.083715 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:12:18.083715 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:12:18.083715 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:12:18.083715 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:12:18.084621 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 28 08:12:18.084621 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 28 08:12:18.084621 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 28 08:12:18.084621 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 28 08:12:18.084621 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 28 08:12:18.084621 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 28 08:12:18.084621 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 08:12:18.084621 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application Jul 28 08:12:18.084621 dv-cinder-851351-1-smb devstack@keystone.service[144067]: [pid: 144067|app: 0|req: 397/804] 10.222.0.42 () {56 vars in 1111 bytes} [Thu Jul 28 08:12:17 2022] GET /identity/v3/projects/service => generated 88 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:12:18.085277 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a35fa02a-53d9-489f-9e11-4534736fe9b3 None admin] Authenticating user token {{(pid=144067) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:12:18.155005 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG dbcounter [-] [144067] Writing DB stats keystone:SELECT=100 {{(pid=144067) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:12:18.162598 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG dbcounter [-] [144068] Writing DB stats keystone:SELECT=100 {{(pid=144068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:12:18.193120 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda65361-57b7-4f8c-b40d-85f24970b59b None admin] Validating token access rules against request {{(pid=144068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:12:18.199414 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a35fa02a-53d9-489f-9e11-4534736fe9b3 None admin] Validating token access rules against request {{(pid=144067) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:12:18.229900 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5727bf73-e62b-4186-b490-405f300fcccf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:12:18.230554 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5727bf73-e62b-4186-b490-405f300fcccf None admin] REQUEST_METHOD: `GET` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:12:18.230837 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5727bf73-e62b-4186-b490-405f300fcccf None admin] SCRIPT_NAME: `/identity` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:12:18.231112 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5727bf73-e62b-4186-b490-405f300fcccf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:12:18.236441 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070218d4-9c13-490b-a74d-9e9c15e240f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144067) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:12:18.237117 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070218d4-9c13-490b-a74d-9e9c15e240f3 None admin] REQUEST_METHOD: `GET` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:12:18.237399 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070218d4-9c13-490b-a74d-9e9c15e240f3 None admin] SCRIPT_NAME: `/identity` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:12:18.237672 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070218d4-9c13-490b-a74d-9e9c15e240f3 None admin] PATH_INFO: `/v3/domains` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:12:18.238526 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-070218d4-9c13-490b-a74d-9e9c15e240f3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=144067) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:12:18.238828 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-070218d4-9c13-490b-a74d-9e9c15e240f3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:12:18.240250 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-070218d4-9c13-490b-a74d-9e9c15e240f3 None admin] RBAC: Authorization granted {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:12:18.242203 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5727bf73-e62b-4186-b490-405f300fcccf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:12:18.243648 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5727bf73-e62b-4186-b490-405f300fcccf None admin] RBAC: Authorization granted {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:12:18.252548 dv-cinder-851351-1-smb devstack@keystone.service[144067]: [pid: 144067|app: 0|req: 398/805] 10.222.0.42 () {56 vars in 1109 bytes} [Thu Jul 28 08:12:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:12:18.253876 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb68dae-9805-4cef-8360-ac96973f381d None None] REQUEST_METHOD: `GET` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:12:18.254234 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb68dae-9805-4cef-8360-ac96973f381d None None] SCRIPT_NAME: `/identity` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:12:18.254519 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb68dae-9805-4cef-8360-ac96973f381d None None] PATH_INFO: `/` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:12:18.255776 dv-cinder-851351-1-smb devstack@keystone.service[144067]: [pid: 144067|app: 0|req: 399/806] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 08:12:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 08:12:18.256486 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb68dae-9805-4cef-8360-ac96973f381d None None] Authenticating user token {{(pid=144067) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:12:18.259075 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application [None req-5727bf73-e62b-4186-b490-405f300fcccf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 08:12:18.259075 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:12:18.259075 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:12:18.259075 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:12:18.259075 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:12:18.259075 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:12:18.259075 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:12:18.259075 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:12:18.259075 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:12:18.259075 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:12:18.259075 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:12:18.259075 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:12:18.259075 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 08:12:18.259075 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 08:12:18.259075 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 08:12:18.260065 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 08:12:18.260065 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:12:18.260065 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:12:18.260065 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:12:18.260065 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:12:18.260065 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:12:18.260065 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:12:18.260065 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:12:18.260065 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application with Lock( Jul 28 08:12:18.260065 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:12:18.260065 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:12:18.260065 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:12:18.260065 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:12:18.260065 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:12:18.260065 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:12:18.260065 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:12:18.260065 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:12:18.261595 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 08:12:18.261595 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 08:12:18.261595 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 08:12:18.261595 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application Jul 28 08:12:18.261595 dv-cinder-851351-1-smb devstack@keystone.service[144068]: [pid: 144068|app: 0|req: 408/807] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 08:12:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:12:18.261595 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5727bf73-e62b-4186-b490-405f300fcccf None admin] Authenticating user token {{(pid=144068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:12:18.366926 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb68dae-9805-4cef-8360-ac96973f381d None None] Validating token access rules against request {{(pid=144067) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:12:18.391078 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG dbcounter [-] [144067] Writing DB stats keystone:SELECT=100 {{(pid=144067) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:12:18.402722 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5727bf73-e62b-4186-b490-405f300fcccf None admin] Validating token access rules against request {{(pid=144068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:12:18.405142 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99773727-5bc7-4a2e-a379-ba626634c660 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144067) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:12:18.405770 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99773727-5bc7-4a2e-a379-ba626634c660 None admin] REQUEST_METHOD: `GET` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:12:18.406056 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99773727-5bc7-4a2e-a379-ba626634c660 None admin] SCRIPT_NAME: `/identity` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:12:18.406341 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99773727-5bc7-4a2e-a379-ba626634c660 None admin] PATH_INFO: `/v3/services` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:12:18.407041 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99773727-5bc7-4a2e-a379-ba626634c660 None admin] RBAC: Adding query filter params (name=network) {{(pid=144067) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:12:18.407357 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99773727-5bc7-4a2e-a379-ba626634c660 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:12:18.408794 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99773727-5bc7-4a2e-a379-ba626634c660 None admin] RBAC: Authorization granted {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:12:18.413720 dv-cinder-851351-1-smb devstack@keystone.service[144067]: [pid: 144067|app: 0|req: 400/808] 10.222.0.42 () {56 vars in 1112 bytes} [Thu Jul 28 08:12:18 2022] GET /identity/v3/services?name=network => generated 124 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:12:18.414510 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99773727-5bc7-4a2e-a379-ba626634c660 None admin] Authenticating user token {{(pid=144067) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:12:18.432839 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG dbcounter [-] [144068] Writing DB stats keystone:SELECT=100 {{(pid=144068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:12:18.438564 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7528bf9-8bd2-4209-baf2-2ac4c6f245b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:12:18.439201 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7528bf9-8bd2-4209-baf2-2ac4c6f245b2 None admin] REQUEST_METHOD: `GET` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:12:18.439485 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7528bf9-8bd2-4209-baf2-2ac4c6f245b2 None admin] SCRIPT_NAME: `/identity` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:12:18.439762 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7528bf9-8bd2-4209-baf2-2ac4c6f245b2 None admin] PATH_INFO: `/v3/projects` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:12:18.440529 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7528bf9-8bd2-4209-baf2-2ac4c6f245b2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=144068) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:12:18.440878 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7528bf9-8bd2-4209-baf2-2ac4c6f245b2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:12:18.442359 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7528bf9-8bd2-4209-baf2-2ac4c6f245b2 None admin] RBAC: Authorization granted {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:12:18.454710 dv-cinder-851351-1-smb devstack@keystone.service[144068]: [pid: 144068|app: 0|req: 409/809] 10.222.0.42 () {56 vars in 1148 bytes} [Thu Jul 28 08:12:18 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:12:18.455950 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8acc3ff5-1daa-414b-870d-e237e074afdc None None] REQUEST_METHOD: `POST` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:12:18.456214 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8acc3ff5-1daa-414b-870d-e237e074afdc None None] SCRIPT_NAME: `/identity` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:12:18.456495 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8acc3ff5-1daa-414b-870d-e237e074afdc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:12:18.476111 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.auth.core [None req-8acc3ff5-1daa-414b-870d-e237e074afdc None None] MFA Rules not processed for user `bf5ceb8f07374635ad506b7d1b4f1612`. Rule list: `[]` (Enabled: `True`). {{(pid=144068) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 08:12:18.477363 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.fernet_utils [None req-8acc3ff5-1daa-414b-870d-e237e074afdc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=144068) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:12:18.538681 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99773727-5bc7-4a2e-a379-ba626634c660 None admin] Validating token access rules against request {{(pid=144067) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:12:18.546547 dv-cinder-851351-1-smb devstack@keystone.service[144068]: [pid: 144068|app: 0|req: 410/810] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 08:12:18 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 08:12:18.547472 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8acc3ff5-1daa-414b-870d-e237e074afdc None None] Authenticating user token {{(pid=144068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:12:18.592566 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e93f379d-46bf-43a9-8241-2a7859c4f2d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144067) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:12:18.593281 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93f379d-46bf-43a9-8241-2a7859c4f2d6 None admin] REQUEST_METHOD: `GET` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:12:18.593564 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93f379d-46bf-43a9-8241-2a7859c4f2d6 None admin] SCRIPT_NAME: `/identity` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:12:18.593847 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93f379d-46bf-43a9-8241-2a7859c4f2d6 None admin] PATH_INFO: `/v3/users/swift` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:12:18.602291 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e93f379d-46bf-43a9-8241-2a7859c4f2d6 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:12:18.603792 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e93f379d-46bf-43a9-8241-2a7859c4f2d6 None admin] RBAC: Authorization granted {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:12:18.616645 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application [None req-e93f379d-46bf-43a9-8241-2a7859c4f2d6 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 28 08:12:18.616645 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:12:18.616645 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:12:18.616645 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:12:18.616645 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:12:18.616645 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:12:18.616645 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:12:18.616645 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:12:18.616645 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:12:18.616645 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:12:18.616645 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:12:18.616645 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:12:18.616645 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 28 08:12:18.616645 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 28 08:12:18.616645 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 28 08:12:18.616645 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 28 08:12:18.618475 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:12:18.618475 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:12:18.618475 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 28 08:12:18.618475 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 08:12:18.618475 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 28 08:12:18.618475 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 08:12:18.618475 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:12:18.618475 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:12:18.618475 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:12:18.618475 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:12:18.618475 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:12:18.618475 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application with Lock( Jul 28 08:12:18.618475 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:12:18.618475 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:12:18.618475 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:12:18.618475 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:12:18.618475 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:12:18.618475 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:12:18.620340 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:12:18.620340 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:12:18.620340 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 28 08:12:18.620340 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 28 08:12:18.620340 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 28 08:12:18.620340 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 28 08:12:18.620340 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 28 08:12:18.620340 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 28 08:12:18.620340 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 28 08:12:18.620340 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application Jul 28 08:12:18.621744 dv-cinder-851351-1-smb devstack@keystone.service[144067]: [pid: 144067|app: 0|req: 401/811] 10.222.0.42 () {56 vars in 1096 bytes} [Thu Jul 28 08:12:18 2022] GET /identity/v3/users/swift => generated 83 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:12:18.623221 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e93f379d-46bf-43a9-8241-2a7859c4f2d6 None admin] Authenticating user token {{(pid=144067) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:12:18.670639 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8acc3ff5-1daa-414b-870d-e237e074afdc None None] Validating token access rules against request {{(pid=144068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:12:18.682828 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG dbcounter [-] [144067] Writing DB stats keystone:SELECT=100 {{(pid=144067) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:12:18.695250 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG dbcounter [-] [144068] Writing DB stats keystone:SELECT=100 {{(pid=144068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:12:18.710363 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046b3329-d24b-4784-ac0e-1ff40932f472 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:12:18.711367 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046b3329-d24b-4784-ac0e-1ff40932f472 None admin] REQUEST_METHOD: `GET` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:12:18.711651 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046b3329-d24b-4784-ac0e-1ff40932f472 None admin] SCRIPT_NAME: `/identity` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:12:18.711935 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046b3329-d24b-4784-ac0e-1ff40932f472 None admin] PATH_INFO: `/v3/domains` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:12:18.712693 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-046b3329-d24b-4784-ac0e-1ff40932f472 None admin] RBAC: Adding query filter params (name=Default) {{(pid=144068) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:12:18.713013 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-046b3329-d24b-4784-ac0e-1ff40932f472 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:12:18.714437 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-046b3329-d24b-4784-ac0e-1ff40932f472 None admin] RBAC: Authorization granted {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:12:18.727132 dv-cinder-851351-1-smb devstack@keystone.service[144068]: [pid: 144068|app: 0|req: 411/812] 10.222.0.42 () {56 vars in 1109 bytes} [Thu Jul 28 08:12:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:12:18.727786 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046b3329-d24b-4784-ac0e-1ff40932f472 None admin] Authenticating user token {{(pid=144068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:12:18.754693 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e93f379d-46bf-43a9-8241-2a7859c4f2d6 None admin] Validating token access rules against request {{(pid=144067) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:12:18.793319 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6fac66-88f9-44a1-bd25-31dc3d049221 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144067) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:12:18.793948 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6fac66-88f9-44a1-bd25-31dc3d049221 None admin] REQUEST_METHOD: `GET` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:12:18.794227 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6fac66-88f9-44a1-bd25-31dc3d049221 None admin] SCRIPT_NAME: `/identity` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:12:18.794503 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6fac66-88f9-44a1-bd25-31dc3d049221 None admin] PATH_INFO: `/v3/services` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:12:18.795208 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a6fac66-88f9-44a1-bd25-31dc3d049221 None admin] RBAC: Adding query filter params (type=network) {{(pid=144067) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:12:18.795502 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a6fac66-88f9-44a1-bd25-31dc3d049221 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:12:18.797093 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a6fac66-88f9-44a1-bd25-31dc3d049221 None admin] RBAC: Authorization granted {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:12:18.802423 dv-cinder-851351-1-smb devstack@keystone.service[144067]: [pid: 144067|app: 0|req: 402/813] 10.222.0.42 () {56 vars in 1112 bytes} [Thu Jul 28 08:12:18 2022] GET /identity/v3/services?type=network => generated 350 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:12:18.803272 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6fac66-88f9-44a1-bd25-31dc3d049221 None admin] Authenticating user token {{(pid=144067) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:12:18.848339 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046b3329-d24b-4784-ac0e-1ff40932f472 None admin] Validating token access rules against request {{(pid=144068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:12:18.887866 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad64be50-9066-4f30-b485-59b74004eba0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:12:18.888412 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad64be50-9066-4f30-b485-59b74004eba0 None admin] REQUEST_METHOD: `GET` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:12:18.888719 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad64be50-9066-4f30-b485-59b74004eba0 None admin] SCRIPT_NAME: `/identity` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:12:18.889113 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad64be50-9066-4f30-b485-59b74004eba0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:12:18.889810 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad64be50-9066-4f30-b485-59b74004eba0 None admin] RBAC: Adding query filter params (role.id=d1020e7bb0b7411d895ddedd6dc02c5b, scope.project.id=fa39ab7491e5413ca648e31ee9177fa0, user.id=2c1de9cd80344cefa3e06ae8c9c9e5d9) {{(pid=144068) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:12:18.890122 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad64be50-9066-4f30-b485-59b74004eba0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:12:18.891595 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad64be50-9066-4f30-b485-59b74004eba0 None admin] RBAC: Authorization granted {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:12:18.899466 dv-cinder-851351-1-smb devstack@keystone.service[144068]: [pid: 144068|app: 0|req: 412/814] 10.222.0.42 () {56 vars in 1374 bytes} [Thu Jul 28 08:12:18 2022] GET /identity/v3/role_assignments?user.id=2c1de9cd80344cefa3e06ae8c9c9e5d9&scope.project.id=fa39ab7491e5413ca648e31ee9177fa0&role.id=d1020e7bb0b7411d895ddedd6dc02c5b => generated 608 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:12:18.900249 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad64be50-9066-4f30-b485-59b74004eba0 None admin] Authenticating user token {{(pid=144068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:12:18.950892 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6fac66-88f9-44a1-bd25-31dc3d049221 None admin] Validating token access rules against request {{(pid=144067) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:12:18.970814 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG dbcounter [-] [144067] Writing DB stats keystone:SELECT=100 {{(pid=144067) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:12:18.977571 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG dbcounter [-] [144068] Writing DB stats keystone:SELECT=100 {{(pid=144068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:12:19.022051 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda60d34-2e2c-4a01-9b96-ab56c811dfea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144067) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:12:19.023138 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda60d34-2e2c-4a01-9b96-ab56c811dfea None admin] REQUEST_METHOD: `GET` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:12:19.023502 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda60d34-2e2c-4a01-9b96-ab56c811dfea None admin] SCRIPT_NAME: `/identity` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:12:19.023975 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda60d34-2e2c-4a01-9b96-ab56c811dfea None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:12:19.025152 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fda60d34-2e2c-4a01-9b96-ab56c811dfea None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:12:19.027713 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fda60d34-2e2c-4a01-9b96-ab56c811dfea None admin] RBAC: Authorization granted {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:12:19.040907 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application [None req-fda60d34-2e2c-4a01-9b96-ab56c811dfea None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 28 08:12:19.040907 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:12:19.040907 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 28 08:12:19.040907 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 28 08:12:19.040907 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 28 08:12:19.040907 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 28 08:12:19.040907 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 28 08:12:19.040907 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 08:12:19.040907 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 28 08:12:19.040907 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application Jul 28 08:12:19.040907 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 28 08:12:19.040907 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application Jul 28 08:12:19.040907 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:12:19.040907 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:12:19.040907 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:12:19.040907 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:12:19.042575 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:12:19.042575 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:12:19.042575 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:12:19.042575 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:12:19.042575 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:12:19.042575 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:12:19.042575 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:12:19.042575 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 28 08:12:19.042575 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 28 08:12:19.042575 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 28 08:12:19.042575 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 28 08:12:19.042575 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:12:19.042575 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:12:19.042575 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:12:19.042575 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:12:19.042575 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:12:19.052964 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:12:19.052964 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:12:19.052964 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application with Lock( Jul 28 08:12:19.052964 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:12:19.052964 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:12:19.052964 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:12:19.052964 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:12:19.052964 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:12:19.052964 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:12:19.052964 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:12:19.052964 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:12:19.052964 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 28 08:12:19.052964 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 08:12:19.052964 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 28 08:12:19.052964 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application Jul 28 08:12:19.052964 dv-cinder-851351-1-smb devstack@keystone.service[144067]: [pid: 144067|app: 0|req: 403/815] 10.222.0.42 () {56 vars in 1129 bytes} [Thu Jul 28 08:12:18 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:12:19.054691 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda60d34-2e2c-4a01-9b96-ab56c811dfea None admin] Authenticating user token {{(pid=144067) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:12:19.104550 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad64be50-9066-4f30-b485-59b74004eba0 None admin] Validating token access rules against request {{(pid=144068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:12:19.158137 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae2d795-296f-489b-bc3e-6444a31fb8d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:12:19.158697 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae2d795-296f-489b-bc3e-6444a31fb8d2 None admin] REQUEST_METHOD: `GET` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:12:19.158981 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae2d795-296f-489b-bc3e-6444a31fb8d2 None admin] SCRIPT_NAME: `/identity` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:12:19.159253 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae2d795-296f-489b-bc3e-6444a31fb8d2 None admin] PATH_INFO: `/v3/users` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:12:19.160119 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae2d795-296f-489b-bc3e-6444a31fb8d2 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=144068) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:12:19.160450 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae2d795-296f-489b-bc3e-6444a31fb8d2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:12:19.161997 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae2d795-296f-489b-bc3e-6444a31fb8d2 None admin] RBAC: Authorization granted {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:12:19.186944 dv-cinder-851351-1-smb devstack@keystone.service[144068]: [pid: 144068|app: 0|req: 413/816] 10.222.0.42 () {56 vars in 1135 bytes} [Thu Jul 28 08:12:18 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 283 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:12:19.186944 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae2d795-296f-489b-bc3e-6444a31fb8d2 None admin] Authenticating user token {{(pid=144068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:12:19.199054 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda60d34-2e2c-4a01-9b96-ab56c811dfea None admin] Validating token access rules against request {{(pid=144067) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:12:19.236813 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc13bf3f-6c7a-491c-94d3-d43ff7a9a1c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144067) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:12:19.237514 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc13bf3f-6c7a-491c-94d3-d43ff7a9a1c4 None admin] REQUEST_METHOD: `GET` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:12:19.237793 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc13bf3f-6c7a-491c-94d3-d43ff7a9a1c4 None admin] SCRIPT_NAME: `/identity` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:12:19.238155 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc13bf3f-6c7a-491c-94d3-d43ff7a9a1c4 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:12:19.247611 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc13bf3f-6c7a-491c-94d3-d43ff7a9a1c4 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:12:19.249139 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc13bf3f-6c7a-491c-94d3-d43ff7a9a1c4 None admin] RBAC: Authorization granted {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:12:19.261731 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application [None req-fc13bf3f-6c7a-491c-94d3-d43ff7a9a1c4 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 28 08:12:19.261731 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:12:19.261731 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:12:19.261731 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:12:19.261731 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:12:19.261731 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:12:19.261731 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:12:19.261731 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:12:19.261731 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:12:19.261731 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:12:19.261731 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:12:19.261731 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:12:19.261731 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 28 08:12:19.261731 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 28 08:12:19.261731 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 28 08:12:19.261731 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 28 08:12:19.262626 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:12:19.262626 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:12:19.262626 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 28 08:12:19.262626 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 08:12:19.262626 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 28 08:12:19.262626 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 08:12:19.262626 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:12:19.262626 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:12:19.262626 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:12:19.262626 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:12:19.262626 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:12:19.262626 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application with Lock( Jul 28 08:12:19.262626 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:12:19.262626 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:12:19.262626 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:12:19.262626 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:12:19.262626 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:12:19.262626 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:12:19.263466 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:12:19.263466 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:12:19.263466 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 28 08:12:19.263466 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 28 08:12:19.263466 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 28 08:12:19.263466 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 28 08:12:19.263466 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 28 08:12:19.263466 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 28 08:12:19.263466 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 28 08:12:19.263466 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application Jul 28 08:12:19.263466 dv-cinder-851351-1-smb devstack@keystone.service[144067]: [pid: 144067|app: 0|req: 404/817] 10.222.0.42 () {56 vars in 1117 bytes} [Thu Jul 28 08:12:19 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:12:19.264007 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc13bf3f-6c7a-491c-94d3-d43ff7a9a1c4 None admin] Authenticating user token {{(pid=144067) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:12:19.309686 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae2d795-296f-489b-bc3e-6444a31fb8d2 None admin] Validating token access rules against request {{(pid=144068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:12:19.310051 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG dbcounter [-] [144067] Writing DB stats keystone:SELECT=100 {{(pid=144067) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:12:19.313229 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG dbcounter [-] [144068] Writing DB stats keystone:SELECT=100 {{(pid=144068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:12:19.347776 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c2cf70-1163-44b9-ae67-684f49f7a5f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:12:19.348525 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c2cf70-1163-44b9-ae67-684f49f7a5f0 None admin] REQUEST_METHOD: `POST` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:12:19.348858 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c2cf70-1163-44b9-ae67-684f49f7a5f0 None admin] SCRIPT_NAME: `/identity` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:12:19.349156 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c2cf70-1163-44b9-ae67-684f49f7a5f0 None admin] PATH_INFO: `/v3/endpoints` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:12:19.349977 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c2cf70-1163-44b9-ae67-684f49f7a5f0 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:12:19.351373 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c2cf70-1163-44b9-ae67-684f49f7a5f0 None admin] RBAC: Authorization granted {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:12:19.387931 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc13bf3f-6c7a-491c-94d3-d43ff7a9a1c4 None admin] Validating token access rules against request {{(pid=144067) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:12:19.389104 dv-cinder-851351-1-smb devstack@keystone.service[144068]: [pid: 144068|app: 0|req: 414/818] 10.222.0.42 () {60 vars in 1144 bytes} [Thu Jul 28 08:12:19 2022] POST /identity/v3/endpoints => generated 327 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 08:12:19.390574 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c2cf70-1163-44b9-ae67-684f49f7a5f0 None admin] Authenticating user token {{(pid=144068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:12:19.459954 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d17b54-1403-458b-80de-6659f00f0b37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144067) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:12:19.460712 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d17b54-1403-458b-80de-6659f00f0b37 None admin] REQUEST_METHOD: `GET` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:12:19.461443 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d17b54-1403-458b-80de-6659f00f0b37 None admin] SCRIPT_NAME: `/identity` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:12:19.461845 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d17b54-1403-458b-80de-6659f00f0b37 None admin] PATH_INFO: `/v3/services` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:12:19.463154 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75d17b54-1403-458b-80de-6659f00f0b37 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=144067) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:12:19.463801 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75d17b54-1403-458b-80de-6659f00f0b37 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:12:19.467754 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75d17b54-1403-458b-80de-6659f00f0b37 None admin] RBAC: Authorization granted {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:12:19.485028 dv-cinder-851351-1-smb devstack@keystone.service[144067]: [pid: 144067|app: 0|req: 405/819] 10.222.0.42 () {56 vars in 1124 bytes} [Thu Jul 28 08:12:19 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:12:19.487137 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d17b54-1403-458b-80de-6659f00f0b37 None admin] Authenticating user token {{(pid=144067) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:12:19.579317 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c2cf70-1163-44b9-ae67-684f49f7a5f0 None admin] Validating token access rules against request {{(pid=144068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:12:19.631253 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d9a6ba-8d33-43a7-8a6e-520d75d0d638 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:12:19.631940 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d9a6ba-8d33-43a7-8a6e-520d75d0d638 None admin] REQUEST_METHOD: `GET` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:12:19.632218 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d9a6ba-8d33-43a7-8a6e-520d75d0d638 None admin] SCRIPT_NAME: `/identity` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:12:19.632529 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d9a6ba-8d33-43a7-8a6e-520d75d0d638 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:12:19.645971 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27d9a6ba-8d33-43a7-8a6e-520d75d0d638 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:12:19.647455 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27d9a6ba-8d33-43a7-8a6e-520d75d0d638 None admin] RBAC: Authorization granted {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:12:19.658601 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG dbcounter [-] [144067] Writing DB stats keystone:SELECT=100 {{(pid=144067) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:12:19.668278 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application [None req-27d9a6ba-8d33-43a7-8a6e-520d75d0d638 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 08:12:19.668278 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:12:19.668278 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:12:19.668278 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:12:19.668278 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:12:19.668278 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:12:19.668278 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:12:19.668278 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:12:19.668278 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:12:19.668278 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:12:19.668278 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:12:19.668278 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:12:19.668278 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 08:12:19.668278 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 08:12:19.668278 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 08:12:19.669604 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 08:12:19.669604 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:12:19.669604 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:12:19.669604 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:12:19.669604 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:12:19.669604 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:12:19.669604 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:12:19.669604 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:12:19.669604 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application with Lock( Jul 28 08:12:19.669604 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:12:19.669604 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:12:19.669604 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:12:19.669604 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:12:19.669604 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:12:19.669604 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:12:19.669604 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:12:19.669604 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:12:19.670872 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 08:12:19.670872 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 08:12:19.670872 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 08:12:19.670872 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application Jul 28 08:12:19.671202 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d17b54-1403-458b-80de-6659f00f0b37 None admin] Validating token access rules against request {{(pid=144067) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:12:19.671309 dv-cinder-851351-1-smb devstack@keystone.service[144068]: [pid: 144068|app: 0|req: 415/820] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 08:12:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 280 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:12:19.672099 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d9a6ba-8d33-43a7-8a6e-520d75d0d638 None admin] Authenticating user token {{(pid=144068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:12:19.697668 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG dbcounter [-] [144068] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=144068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:12:19.718967 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc79111-626b-4ac4-b283-cf91c009feeb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144067) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:12:19.719538 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc79111-626b-4ac4-b283-cf91c009feeb None admin] REQUEST_METHOD: `GET` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:12:19.719820 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc79111-626b-4ac4-b283-cf91c009feeb None admin] SCRIPT_NAME: `/identity` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:12:19.720095 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc79111-626b-4ac4-b283-cf91c009feeb None admin] PATH_INFO: `/v3/users` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:12:19.720942 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fc79111-626b-4ac4-b283-cf91c009feeb None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=144067) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:12:19.721258 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fc79111-626b-4ac4-b283-cf91c009feeb None admin] RBAC: Authorizing `identity:list_users()` {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:12:19.722780 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fc79111-626b-4ac4-b283-cf91c009feeb None admin] RBAC: Authorization granted {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:12:19.744017 dv-cinder-851351-1-smb devstack@keystone.service[144067]: [pid: 144067|app: 0|req: 406/821] 10.222.0.42 () {56 vars in 1149 bytes} [Thu Jul 28 08:12:19 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:12:19.745108 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc79111-626b-4ac4-b283-cf91c009feeb None admin] Authenticating user token {{(pid=144067) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:12:19.814693 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d9a6ba-8d33-43a7-8a6e-520d75d0d638 None admin] Validating token access rules against request {{(pid=144068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:12:19.852631 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce13a3f-0f61-4ed8-ba2c-a08fcb991374 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:12:19.853291 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce13a3f-0f61-4ed8-ba2c-a08fcb991374 None admin] REQUEST_METHOD: `GET` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:12:19.853581 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce13a3f-0f61-4ed8-ba2c-a08fcb991374 None admin] SCRIPT_NAME: `/identity` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:12:19.853855 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce13a3f-0f61-4ed8-ba2c-a08fcb991374 None admin] PATH_INFO: `/v3/services` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:12:19.854590 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ce13a3f-0f61-4ed8-ba2c-a08fcb991374 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=144068) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:12:19.854858 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ce13a3f-0f61-4ed8-ba2c-a08fcb991374 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:12:19.856244 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ce13a3f-0f61-4ed8-ba2c-a08fcb991374 None admin] RBAC: Authorization granted {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:12:19.867350 dv-cinder-851351-1-smb devstack@keystone.service[144068]: [pid: 144068|app: 0|req: 416/822] 10.222.0.42 () {56 vars in 1124 bytes} [Thu Jul 28 08:12:19 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:12:19.867350 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce13a3f-0f61-4ed8-ba2c-a08fcb991374 None admin] Authenticating user token {{(pid=144068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:12:19.883403 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc79111-626b-4ac4-b283-cf91c009feeb None admin] Validating token access rules against request {{(pid=144067) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:12:19.934941 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f785c46-60a5-415b-89e8-efbe0a038eb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144067) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:12:19.935597 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f785c46-60a5-415b-89e8-efbe0a038eb9 None admin] REQUEST_METHOD: `GET` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:12:19.935880 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f785c46-60a5-415b-89e8-efbe0a038eb9 None admin] SCRIPT_NAME: `/identity` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:12:19.936160 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f785c46-60a5-415b-89e8-efbe0a038eb9 None admin] PATH_INFO: `/v3/domains` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:12:19.936916 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f785c46-60a5-415b-89e8-efbe0a038eb9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=144067) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:12:19.937224 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f785c46-60a5-415b-89e8-efbe0a038eb9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:12:19.938668 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f785c46-60a5-415b-89e8-efbe0a038eb9 None admin] RBAC: Authorization granted {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:12:19.953847 dv-cinder-851351-1-smb devstack@keystone.service[144067]: [pid: 144067|app: 0|req: 407/823] 10.222.0.42 () {56 vars in 1109 bytes} [Thu Jul 28 08:12:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:12:19.959535 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f785c46-60a5-415b-89e8-efbe0a038eb9 None admin] Authenticating user token {{(pid=144067) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:12:19.975502 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG dbcounter [-] [144068] Writing DB stats keystone:SELECT=100 {{(pid=144068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:12:19.979632 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG dbcounter [-] [144067] Writing DB stats keystone:SELECT=100 {{(pid=144067) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:12:20.016859 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce13a3f-0f61-4ed8-ba2c-a08fcb991374 None admin] Validating token access rules against request {{(pid=144068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:12:20.053420 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169d744c-e329-4bb4-a024-d212451e0a57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:12:20.054088 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169d744c-e329-4bb4-a024-d212451e0a57 None admin] REQUEST_METHOD: `GET` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:12:20.054373 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169d744c-e329-4bb4-a024-d212451e0a57 None admin] SCRIPT_NAME: `/identity` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:12:20.054654 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169d744c-e329-4bb4-a024-d212451e0a57 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:12:20.066174 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-169d744c-e329-4bb4-a024-d212451e0a57 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:12:20.068104 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-169d744c-e329-4bb4-a024-d212451e0a57 None admin] RBAC: Authorization granted {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:12:20.081369 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f785c46-60a5-415b-89e8-efbe0a038eb9 None admin] Validating token access rules against request {{(pid=144067) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:12:20.083090 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application [None req-169d744c-e329-4bb4-a024-d212451e0a57 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 08:12:20.083090 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:12:20.083090 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:12:20.083090 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:12:20.083090 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:12:20.083090 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:12:20.083090 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:12:20.083090 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:12:20.083090 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:12:20.083090 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:12:20.083090 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:12:20.083090 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:12:20.083090 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 08:12:20.083090 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 08:12:20.083090 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 08:12:20.083864 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 08:12:20.083864 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:12:20.083864 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:12:20.083864 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:12:20.083864 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:12:20.083864 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:12:20.083864 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:12:20.083864 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:12:20.083864 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application with Lock( Jul 28 08:12:20.083864 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:12:20.083864 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:12:20.083864 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:12:20.083864 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:12:20.083864 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:12:20.083864 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:12:20.083864 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:12:20.083864 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:12:20.084634 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 08:12:20.084634 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 08:12:20.084634 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 08:12:20.084634 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application Jul 28 08:12:20.084634 dv-cinder-851351-1-smb devstack@keystone.service[144068]: [pid: 144068|app: 0|req: 417/824] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 08:12:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:12:20.085188 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169d744c-e329-4bb4-a024-d212451e0a57 None admin] Authenticating user token {{(pid=144068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:12:20.124632 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-404eb1fa-042f-4b1e-97db-b2996f20e8f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144067) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:12:20.125314 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404eb1fa-042f-4b1e-97db-b2996f20e8f7 None admin] REQUEST_METHOD: `POST` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:12:20.125595 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404eb1fa-042f-4b1e-97db-b2996f20e8f7 None admin] SCRIPT_NAME: `/identity` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:12:20.125874 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404eb1fa-042f-4b1e-97db-b2996f20e8f7 None admin] PATH_INFO: `/v3/endpoints` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:12:20.126596 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-404eb1fa-042f-4b1e-97db-b2996f20e8f7 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:12:20.127993 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-404eb1fa-042f-4b1e-97db-b2996f20e8f7 None admin] RBAC: Authorization granted {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:12:20.160699 dv-cinder-851351-1-smb devstack@keystone.service[144067]: [pid: 144067|app: 0|req: 408/825] 10.222.0.42 () {60 vars in 1144 bytes} [Thu Jul 28 08:12:19 2022] POST /identity/v3/endpoints => generated 346 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 08:12:20.160699 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-404eb1fa-042f-4b1e-97db-b2996f20e8f7 None admin] Authenticating user token {{(pid=144067) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:12:20.209302 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169d744c-e329-4bb4-a024-d212451e0a57 None admin] Validating token access rules against request {{(pid=144068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:12:20.250045 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG dbcounter [-] [144068] Writing DB stats keystone:SELECT=100 {{(pid=144068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:12:20.260786 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG dbcounter [-] [144067] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=144067) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:12:20.277627 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40185ef9-ed1d-4f26-a8ac-fd2f6a65fa38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:12:20.278349 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40185ef9-ed1d-4f26-a8ac-fd2f6a65fa38 None admin] REQUEST_METHOD: `GET` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:12:20.278653 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40185ef9-ed1d-4f26-a8ac-fd2f6a65fa38 None admin] SCRIPT_NAME: `/identity` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:12:20.278928 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40185ef9-ed1d-4f26-a8ac-fd2f6a65fa38 None admin] PATH_INFO: `/v3/projects/service` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:12:20.289668 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40185ef9-ed1d-4f26-a8ac-fd2f6a65fa38 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:12:20.291159 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40185ef9-ed1d-4f26-a8ac-fd2f6a65fa38 None admin] RBAC: Authorization granted {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:12:20.303971 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application [None req-40185ef9-ed1d-4f26-a8ac-fd2f6a65fa38 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 08:12:20.303971 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:12:20.303971 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:12:20.303971 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:12:20.303971 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:12:20.303971 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:12:20.303971 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:12:20.303971 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:12:20.303971 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:12:20.303971 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:12:20.303971 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:12:20.303971 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:12:20.303971 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 28 08:12:20.303971 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 28 08:12:20.303971 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 28 08:12:20.304905 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 28 08:12:20.304905 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:12:20.304905 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:12:20.304905 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:12:20.304905 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:12:20.304905 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:12:20.304905 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:12:20.304905 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:12:20.304905 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application with Lock( Jul 28 08:12:20.304905 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:12:20.304905 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:12:20.304905 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:12:20.304905 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:12:20.304905 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:12:20.304905 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:12:20.304905 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:12:20.304905 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:12:20.306074 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 28 08:12:20.306074 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 28 08:12:20.306074 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 28 08:12:20.306074 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 28 08:12:20.306074 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 28 08:12:20.306074 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 28 08:12:20.306074 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 08:12:20.306074 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application Jul 28 08:12:20.306074 dv-cinder-851351-1-smb devstack@keystone.service[144068]: [pid: 144068|app: 0|req: 418/826] 10.222.0.42 () {56 vars in 1111 bytes} [Thu Jul 28 08:12:20 2022] GET /identity/v3/projects/service => generated 88 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:12:20.311297 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40185ef9-ed1d-4f26-a8ac-fd2f6a65fa38 None admin] Authenticating user token {{(pid=144068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:12:20.315600 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-404eb1fa-042f-4b1e-97db-b2996f20e8f7 None admin] Validating token access rules against request {{(pid=144067) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:12:20.369528 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a04fe6db-8253-4013-aedb-5fb307c440da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144067) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:12:20.370569 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04fe6db-8253-4013-aedb-5fb307c440da None admin] REQUEST_METHOD: `GET` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:12:20.371582 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04fe6db-8253-4013-aedb-5fb307c440da None admin] SCRIPT_NAME: `/identity` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:12:20.372383 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04fe6db-8253-4013-aedb-5fb307c440da None admin] PATH_INFO: `/v3/domains` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:12:20.373245 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a04fe6db-8253-4013-aedb-5fb307c440da None admin] RBAC: Adding query filter params (name=Default) {{(pid=144067) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:12:20.373245 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a04fe6db-8253-4013-aedb-5fb307c440da None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:12:20.377341 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a04fe6db-8253-4013-aedb-5fb307c440da None admin] RBAC: Authorization granted {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:12:20.391686 dv-cinder-851351-1-smb devstack@keystone.service[144067]: [pid: 144067|app: 0|req: 409/827] 10.222.0.42 () {56 vars in 1109 bytes} [Thu Jul 28 08:12:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:12:20.397708 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a04fe6db-8253-4013-aedb-5fb307c440da None admin] Authenticating user token {{(pid=144067) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:12:20.453274 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40185ef9-ed1d-4f26-a8ac-fd2f6a65fa38 None admin] Validating token access rules against request {{(pid=144068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:12:20.495341 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f3fb8d-4bb9-476c-9861-fef15c171a49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:12:20.496450 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f3fb8d-4bb9-476c-9861-fef15c171a49 None admin] REQUEST_METHOD: `GET` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:12:20.496952 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f3fb8d-4bb9-476c-9861-fef15c171a49 None admin] SCRIPT_NAME: `/identity` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:12:20.497450 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f3fb8d-4bb9-476c-9861-fef15c171a49 None admin] PATH_INFO: `/v3/projects` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:12:20.498428 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f3fb8d-4bb9-476c-9861-fef15c171a49 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=144068) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:12:20.498933 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f3fb8d-4bb9-476c-9861-fef15c171a49 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:12:20.500648 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f3fb8d-4bb9-476c-9861-fef15c171a49 None admin] RBAC: Authorization granted {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:12:20.515702 dv-cinder-851351-1-smb devstack@keystone.service[144068]: [pid: 144068|app: 0|req: 419/828] 10.222.0.42 () {56 vars in 1148 bytes} [Thu Jul 28 08:12:20 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:12:20.522612 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f3fb8d-4bb9-476c-9861-fef15c171a49 None admin] Authenticating user token {{(pid=144068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:12:20.533099 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a04fe6db-8253-4013-aedb-5fb307c440da None admin] Validating token access rules against request {{(pid=144067) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:12:20.567795 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG dbcounter [-] [144067] Writing DB stats keystone:SELECT=100 {{(pid=144067) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:12:20.577915 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-548157ac-f906-48e4-bee2-3b40a1fd4662 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144067) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:12:20.578577 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548157ac-f906-48e4-bee2-3b40a1fd4662 None admin] REQUEST_METHOD: `GET` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:12:20.578905 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548157ac-f906-48e4-bee2-3b40a1fd4662 None admin] SCRIPT_NAME: `/identity` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:12:20.579186 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548157ac-f906-48e4-bee2-3b40a1fd4662 None admin] PATH_INFO: `/v3/projects/service` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:12:20.588649 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG dbcounter [-] [144068] Writing DB stats keystone:SELECT=100 {{(pid=144068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:12:20.588941 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-548157ac-f906-48e4-bee2-3b40a1fd4662 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:12:20.591431 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-548157ac-f906-48e4-bee2-3b40a1fd4662 None admin] RBAC: Authorization granted {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:12:20.606781 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application [None req-548157ac-f906-48e4-bee2-3b40a1fd4662 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 08:12:20.606781 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:12:20.606781 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:12:20.606781 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:12:20.606781 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:12:20.606781 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:12:20.606781 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:12:20.606781 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:12:20.606781 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:12:20.606781 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:12:20.606781 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:12:20.606781 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:12:20.606781 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 28 08:12:20.606781 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 28 08:12:20.606781 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 28 08:12:20.607630 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 28 08:12:20.607630 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:12:20.607630 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:12:20.607630 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:12:20.607630 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:12:20.607630 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:12:20.607630 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:12:20.607630 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:12:20.607630 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application with Lock( Jul 28 08:12:20.607630 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:12:20.607630 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:12:20.607630 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:12:20.607630 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:12:20.607630 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:12:20.607630 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:12:20.607630 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:12:20.607630 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:12:20.608417 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 28 08:12:20.608417 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 28 08:12:20.608417 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 28 08:12:20.608417 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 28 08:12:20.608417 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 28 08:12:20.608417 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 28 08:12:20.608417 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 08:12:20.608417 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application Jul 28 08:12:20.613085 dv-cinder-851351-1-smb devstack@keystone.service[144067]: [pid: 144067|app: 0|req: 410/829] 10.222.0.42 () {56 vars in 1111 bytes} [Thu Jul 28 08:12:20 2022] GET /identity/v3/projects/service => generated 88 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:12:20.614110 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-548157ac-f906-48e4-bee2-3b40a1fd4662 None admin] Authenticating user token {{(pid=144067) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:12:20.664061 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f3fb8d-4bb9-476c-9861-fef15c171a49 None admin] Validating token access rules against request {{(pid=144068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:12:20.701851 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe263b59-f9fd-416d-92aa-f59fce262865 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:12:20.702595 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe263b59-f9fd-416d-92aa-f59fce262865 None admin] REQUEST_METHOD: `PUT` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:12:20.702878 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe263b59-f9fd-416d-92aa-f59fce262865 None admin] SCRIPT_NAME: `/identity` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:12:20.703155 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe263b59-f9fd-416d-92aa-f59fce262865 None admin] PATH_INFO: `/v3/projects/fa39ab7491e5413ca648e31ee9177fa0/users/fffb2166afc14796bc3c9c9eba793ec0/roles/d1020e7bb0b7411d895ddedd6dc02c5b` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:12:20.705331 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe263b59-f9fd-416d-92aa-f59fce262865 None admin] RBAC: Authorizing `identity:create_grant(project_id=fa39ab7491e5413ca648e31ee9177fa0, user_id=fffb2166afc14796bc3c9c9eba793ec0, role_id=d1020e7bb0b7411d895ddedd6dc02c5b)` {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:12:20.707082 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe263b59-f9fd-416d-92aa-f59fce262865 None admin] RBAC: Authorization granted {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:12:20.728733 dv-cinder-851351-1-smb devstack@keystone.service[144068]: [pid: 144068|app: 0|req: 420/830] 10.222.0.42 () {58 vars in 1439 bytes} [Thu Jul 28 08:12:20 2022] PUT /identity/v3/projects/fa39ab7491e5413ca648e31ee9177fa0/users/fffb2166afc14796bc3c9c9eba793ec0/roles/d1020e7bb0b7411d895ddedd6dc02c5b => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 08:12:20.740299 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-548157ac-f906-48e4-bee2-3b40a1fd4662 None admin] Validating token access rules against request {{(pid=144067) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:12:20.780496 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee0fa57-25fb-47fb-95a2-5a5f26ae3546 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144067) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:12:20.781113 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee0fa57-25fb-47fb-95a2-5a5f26ae3546 None admin] REQUEST_METHOD: `GET` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:12:20.781401 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee0fa57-25fb-47fb-95a2-5a5f26ae3546 None admin] SCRIPT_NAME: `/identity` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:12:20.781683 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee0fa57-25fb-47fb-95a2-5a5f26ae3546 None admin] PATH_INFO: `/v3/projects` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:12:20.782515 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee0fa57-25fb-47fb-95a2-5a5f26ae3546 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=144067) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:12:20.782831 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee0fa57-25fb-47fb-95a2-5a5f26ae3546 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:12:20.784391 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee0fa57-25fb-47fb-95a2-5a5f26ae3546 None admin] RBAC: Authorization granted {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:12:20.800030 dv-cinder-851351-1-smb devstack@keystone.service[144067]: [pid: 144067|app: 0|req: 411/831] 10.222.0.42 () {56 vars in 1148 bytes} [Thu Jul 28 08:12:20 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:12:20.806665 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe263b59-f9fd-416d-92aa-f59fce262865 None admin] Authenticating user token {{(pid=144068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:12:20.925863 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe263b59-f9fd-416d-92aa-f59fce262865 None admin] Validating token access rules against request {{(pid=144068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:12:20.928445 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG dbcounter [-] [144068] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=144068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:12:20.965778 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cda6b7d-6c00-4f72-8ce9-4e618e5c0a11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:12:20.966478 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cda6b7d-6c00-4f72-8ce9-4e618e5c0a11 None admin] REQUEST_METHOD: `PUT` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:12:20.966760 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cda6b7d-6c00-4f72-8ce9-4e618e5c0a11 None admin] SCRIPT_NAME: `/identity` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:12:20.967036 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cda6b7d-6c00-4f72-8ce9-4e618e5c0a11 None admin] PATH_INFO: `/v3/projects/fa39ab7491e5413ca648e31ee9177fa0/users/64acbde3263f4bb8b102034fc3a9d4e6/roles/9aa6ce92dcbb4164ac0e44d2aa2a0248` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:12:20.988911 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cda6b7d-6c00-4f72-8ce9-4e618e5c0a11 None admin] RBAC: Authorizing `identity:create_grant(project_id=fa39ab7491e5413ca648e31ee9177fa0, user_id=64acbde3263f4bb8b102034fc3a9d4e6, role_id=9aa6ce92dcbb4164ac0e44d2aa2a0248)` {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:12:20.990410 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cda6b7d-6c00-4f72-8ce9-4e618e5c0a11 None admin] RBAC: Authorization granted {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:12:21.008173 dv-cinder-851351-1-smb devstack@keystone.service[144068]: [pid: 144068|app: 0|req: 421/832] 10.222.0.42 () {58 vars in 1439 bytes} [Thu Jul 28 08:12:20 2022] PUT /identity/v3/projects/fa39ab7491e5413ca648e31ee9177fa0/users/64acbde3263f4bb8b102034fc3a9d4e6/roles/9aa6ce92dcbb4164ac0e44d2aa2a0248 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 08:12:21.259271 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d037bd0b-1940-46a9-8661-d629a1c8eafd None None] REQUEST_METHOD: `GET` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:12:21.259683 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d037bd0b-1940-46a9-8661-d629a1c8eafd None None] SCRIPT_NAME: `/identity` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:12:21.259823 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d037bd0b-1940-46a9-8661-d629a1c8eafd None None] PATH_INFO: `/` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:12:21.261584 dv-cinder-851351-1-smb devstack@keystone.service[144067]: [pid: 144067|app: 0|req: 412/833] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 08:12:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 08:12:21.267299 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294e691c-2075-421c-9b88-18ff99d8d7f7 None None] REQUEST_METHOD: `POST` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:12:21.267950 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294e691c-2075-421c-9b88-18ff99d8d7f7 None None] SCRIPT_NAME: `/identity` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:12:21.267950 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294e691c-2075-421c-9b88-18ff99d8d7f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:12:21.287290 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.auth.core [None req-294e691c-2075-421c-9b88-18ff99d8d7f7 None None] MFA Rules not processed for user `bf5ceb8f07374635ad506b7d1b4f1612`. Rule list: `[]` (Enabled: `True`). {{(pid=144068) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 08:12:21.288593 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.fernet_utils [None req-294e691c-2075-421c-9b88-18ff99d8d7f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=144068) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:12:21.362229 dv-cinder-851351-1-smb devstack@keystone.service[144068]: [pid: 144068|app: 0|req: 422/834] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 08:12:21 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 08:12:21.384945 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d037bd0b-1940-46a9-8661-d629a1c8eafd None None] Authenticating user token {{(pid=144067) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:12:21.439580 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG dbcounter [-] [144067] Writing DB stats keystone:SELECT=100 {{(pid=144067) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:12:21.498513 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d037bd0b-1940-46a9-8661-d629a1c8eafd None None] Validating token access rules against request {{(pid=144067) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:12:21.536489 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e660f9ee-8559-4fec-8808-0be9fa6054ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144067) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:12:21.537124 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e660f9ee-8559-4fec-8808-0be9fa6054ae None admin] REQUEST_METHOD: `GET` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:12:21.537401 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e660f9ee-8559-4fec-8808-0be9fa6054ae None admin] SCRIPT_NAME: `/identity` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:12:21.537675 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e660f9ee-8559-4fec-8808-0be9fa6054ae None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:12:21.538322 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e660f9ee-8559-4fec-8808-0be9fa6054ae None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:12:21.539728 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e660f9ee-8559-4fec-8808-0be9fa6054ae None admin] RBAC: Authorization granted {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:12:21.554841 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application [None req-e660f9ee-8559-4fec-8808-0be9fa6054ae None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 28 08:12:21.554841 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:12:21.554841 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 28 08:12:21.554841 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 28 08:12:21.554841 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 28 08:12:21.554841 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 28 08:12:21.554841 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 28 08:12:21.554841 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 08:12:21.554841 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 28 08:12:21.554841 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application Jul 28 08:12:21.554841 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 28 08:12:21.554841 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application Jul 28 08:12:21.554841 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:12:21.554841 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:12:21.554841 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:12:21.554841 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:12:21.555722 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:12:21.555722 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:12:21.555722 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:12:21.555722 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:12:21.555722 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:12:21.555722 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:12:21.555722 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:12:21.555722 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 28 08:12:21.555722 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 28 08:12:21.555722 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 28 08:12:21.555722 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 28 08:12:21.555722 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:12:21.555722 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:12:21.555722 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:12:21.555722 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:12:21.555722 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:12:21.556445 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:12:21.556445 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:12:21.556445 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application with Lock( Jul 28 08:12:21.556445 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:12:21.556445 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:12:21.556445 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:12:21.556445 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:12:21.556445 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:12:21.556445 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:12:21.556445 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:12:21.556445 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:12:21.556445 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 28 08:12:21.556445 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 08:12:21.556445 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 28 08:12:21.556445 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application Jul 28 08:12:21.557688 dv-cinder-851351-1-smb devstack@keystone.service[144067]: [pid: 144067|app: 0|req: 413/835] 10.222.0.42 () {56 vars in 1132 bytes} [Thu Jul 28 08:12:21 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:12:21.568852 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294e691c-2075-421c-9b88-18ff99d8d7f7 None None] Authenticating user token {{(pid=144068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:12:21.659554 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG dbcounter [-] [144068] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=144068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:12:21.676517 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294e691c-2075-421c-9b88-18ff99d8d7f7 None None] Validating token access rules against request {{(pid=144068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:12:21.714026 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4988bf98-f112-4795-83c2-36c2eafcdf11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:12:21.714677 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4988bf98-f112-4795-83c2-36c2eafcdf11 None admin] REQUEST_METHOD: `GET` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:12:21.714958 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4988bf98-f112-4795-83c2-36c2eafcdf11 None admin] SCRIPT_NAME: `/identity` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:12:21.715237 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4988bf98-f112-4795-83c2-36c2eafcdf11 None admin] PATH_INFO: `/v3/services` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:12:21.715945 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4988bf98-f112-4795-83c2-36c2eafcdf11 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=144068) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:12:21.716258 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4988bf98-f112-4795-83c2-36c2eafcdf11 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:12:21.717807 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4988bf98-f112-4795-83c2-36c2eafcdf11 None admin] RBAC: Authorization granted {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:12:21.723309 dv-cinder-851351-1-smb devstack@keystone.service[144068]: [pid: 144068|app: 0|req: 423/836] 10.222.0.42 () {56 vars in 1126 bytes} [Thu Jul 28 08:12:21 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:12:21.729163 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e660f9ee-8559-4fec-8808-0be9fa6054ae None admin] Authenticating user token {{(pid=144067) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:12:21.851327 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e660f9ee-8559-4fec-8808-0be9fa6054ae None admin] Validating token access rules against request {{(pid=144067) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:12:21.888755 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG dbcounter [-] [144067] Writing DB stats keystone:SELECT=100 {{(pid=144067) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:12:21.915504 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0963ce91-52d1-460d-89a7-bd6d99868823 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144067) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:12:21.916414 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0963ce91-52d1-460d-89a7-bd6d99868823 None admin] REQUEST_METHOD: `GET` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:12:21.916865 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0963ce91-52d1-460d-89a7-bd6d99868823 None admin] SCRIPT_NAME: `/identity` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:12:21.917261 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0963ce91-52d1-460d-89a7-bd6d99868823 None admin] PATH_INFO: `/v3/services` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:12:21.918274 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0963ce91-52d1-460d-89a7-bd6d99868823 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=144067) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:12:21.918722 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0963ce91-52d1-460d-89a7-bd6d99868823 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:12:21.921008 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0963ce91-52d1-460d-89a7-bd6d99868823 None admin] RBAC: Authorization granted {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:12:21.932441 dv-cinder-851351-1-smb devstack@keystone.service[144067]: [pid: 144067|app: 0|req: 414/837] 10.222.0.42 () {56 vars in 1126 bytes} [Thu Jul 28 08:12:21 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:12:22.882874 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7f71a4-41c5-4394-bef4-392afb24aa49 None None] REQUEST_METHOD: `GET` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:12:22.884220 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7f71a4-41c5-4394-bef4-392afb24aa49 None None] SCRIPT_NAME: `/identity` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:12:22.884986 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7f71a4-41c5-4394-bef4-392afb24aa49 None None] PATH_INFO: `/` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:12:22.887639 dv-cinder-851351-1-smb devstack@keystone.service[144068]: [pid: 144068|app: 0|req: 424/838] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 08:12:22 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 08:12:22.896155 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524bdb96-9480-4851-8755-769b356eba0e None None] REQUEST_METHOD: `POST` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:12:22.897593 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524bdb96-9480-4851-8755-769b356eba0e None None] SCRIPT_NAME: `/identity` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:12:22.898317 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524bdb96-9480-4851-8755-769b356eba0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:12:22.928591 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.auth.core [None req-524bdb96-9480-4851-8755-769b356eba0e None None] MFA Rules not processed for user `bf5ceb8f07374635ad506b7d1b4f1612`. Rule list: `[]` (Enabled: `True`). {{(pid=144067) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 08:12:22.931192 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.fernet_utils [None req-524bdb96-9480-4851-8755-769b356eba0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=144067) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:12:23.000075 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba5cfc9-364e-4a88-b709-c8f6db8cc2f6 None None] REQUEST_METHOD: `GET` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:12:23.000597 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba5cfc9-364e-4a88-b709-c8f6db8cc2f6 None None] SCRIPT_NAME: `/identity` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:12:23.001174 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba5cfc9-364e-4a88-b709-c8f6db8cc2f6 None None] PATH_INFO: `/` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:12:23.004714 dv-cinder-851351-1-smb devstack@keystone.service[144068]: [pid: 144068|app: 0|req: 425/839] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 08:12:22 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 28 08:12:23.014124 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25cbfe2-18eb-47b5-ba9c-5046fe826cea None None] REQUEST_METHOD: `POST` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:12:23.015065 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25cbfe2-18eb-47b5-ba9c-5046fe826cea None None] SCRIPT_NAME: `/identity` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:12:23.015762 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25cbfe2-18eb-47b5-ba9c-5046fe826cea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:12:23.042270 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.auth.core [None req-d25cbfe2-18eb-47b5-ba9c-5046fe826cea None None] MFA Rules not processed for user `bf5ceb8f07374635ad506b7d1b4f1612`. Rule list: `[]` (Enabled: `True`). {{(pid=144068) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 08:12:23.044083 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.fernet_utils [None req-d25cbfe2-18eb-47b5-ba9c-5046fe826cea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=144068) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:12:23.052908 dv-cinder-851351-1-smb devstack@keystone.service[144067]: [pid: 144067|app: 0|req: 415/840] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 08:12:22 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 08:12:23.078776 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524bdb96-9480-4851-8755-769b356eba0e None None] Authenticating user token {{(pid=144067) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:12:23.138561 dv-cinder-851351-1-smb devstack@keystone.service[144068]: [pid: 144068|app: 0|req: 426/841] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 08:12:23 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 28 08:12:23.168477 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d25cbfe2-18eb-47b5-ba9c-5046fe826cea None None] Authenticating user token {{(pid=144068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:12:23.227902 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524bdb96-9480-4851-8755-769b356eba0e None None] Validating token access rules against request {{(pid=144067) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:12:23.235785 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG dbcounter [-] [144067] Writing DB stats keystone:SELECT=100 {{(pid=144067) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:12:23.258817 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG dbcounter [-] [144068] Writing DB stats keystone:SELECT=100 {{(pid=144068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:12:23.269413 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17662aa0-12b0-41a4-bc33-d2d06fcd0064 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144067) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:12:23.270879 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17662aa0-12b0-41a4-bc33-d2d06fcd0064 None admin] REQUEST_METHOD: `GET` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:12:23.271174 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17662aa0-12b0-41a4-bc33-d2d06fcd0064 None admin] SCRIPT_NAME: `/identity` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:12:23.271496 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17662aa0-12b0-41a4-bc33-d2d06fcd0064 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:12:23.272403 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17662aa0-12b0-41a4-bc33-d2d06fcd0064 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:12:23.274523 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17662aa0-12b0-41a4-bc33-d2d06fcd0064 None admin] RBAC: Authorization granted {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:12:23.285125 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d25cbfe2-18eb-47b5-ba9c-5046fe826cea None None] Validating token access rules against request {{(pid=144068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:12:23.286791 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application [None req-17662aa0-12b0-41a4-bc33-d2d06fcd0064 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 28 08:12:23.286791 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:12:23.286791 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 28 08:12:23.286791 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 28 08:12:23.286791 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 28 08:12:23.286791 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 28 08:12:23.286791 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 28 08:12:23.286791 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 08:12:23.286791 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 28 08:12:23.286791 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application Jul 28 08:12:23.286791 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 28 08:12:23.286791 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application Jul 28 08:12:23.286791 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:12:23.286791 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:12:23.286791 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:12:23.286791 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:12:23.286791 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:12:23.287764 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:12:23.287764 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:12:23.287764 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:12:23.287764 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:12:23.287764 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:12:23.287764 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:12:23.287764 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 28 08:12:23.287764 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 28 08:12:23.287764 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 28 08:12:23.287764 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 28 08:12:23.287764 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:12:23.287764 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:12:23.287764 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:12:23.287764 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:12:23.287764 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:12:23.287764 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:12:23.288526 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:12:23.288526 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application with Lock( Jul 28 08:12:23.288526 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:12:23.288526 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:12:23.288526 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:12:23.288526 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:12:23.288526 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:12:23.288526 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:12:23.288526 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:12:23.288526 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:12:23.288526 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 28 08:12:23.288526 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 08:12:23.288526 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 28 08:12:23.288526 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application Jul 28 08:12:23.294118 dv-cinder-851351-1-smb devstack@keystone.service[144067]: [pid: 144067|app: 0|req: 416/842] 10.222.0.42 () {56 vars in 1114 bytes} [Thu Jul 28 08:12:23 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 08:12:23.295848 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb97bd9-bd44-45bb-be29-cd8b1803c25f None None] REQUEST_METHOD: `GET` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:12:23.296136 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb97bd9-bd44-45bb-be29-cd8b1803c25f None None] SCRIPT_NAME: `/identity` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:12:23.296418 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb97bd9-bd44-45bb-be29-cd8b1803c25f None None] PATH_INFO: `/` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:12:23.298403 dv-cinder-851351-1-smb devstack@keystone.service[144067]: [pid: 144067|app: 0|req: 417/843] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 08:12:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 08:12:23.299335 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb97bd9-bd44-45bb-be29-cd8b1803c25f None None] Authenticating user token {{(pid=144067) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:12:23.327174 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23df158e-dfcc-42f4-b000-f4bc2cb4ed82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:12:23.327835 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23df158e-dfcc-42f4-b000-f4bc2cb4ed82 None admin] REQUEST_METHOD: `GET` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:12:23.328122 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23df158e-dfcc-42f4-b000-f4bc2cb4ed82 None admin] SCRIPT_NAME: `/identity` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:12:23.328402 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23df158e-dfcc-42f4-b000-f4bc2cb4ed82 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:12:23.339570 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23df158e-dfcc-42f4-b000-f4bc2cb4ed82 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 08:12:23.344657 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application [None req-23df158e-dfcc-42f4-b000-f4bc2cb4ed82 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 08:12:23.344657 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:12:23.344657 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:12:23.344657 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:12:23.344657 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:12:23.344657 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:12:23.344657 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:12:23.344657 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:12:23.344657 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:12:23.344657 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:12:23.344657 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:12:23.344657 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:12:23.344657 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 08:12:23.344657 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 08:12:23.344657 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 08:12:23.344657 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 08:12:23.345499 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 08:12:23.345499 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 08:12:23.345499 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 08:12:23.345499 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 08:12:23.345499 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:12:23.345499 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:12:23.345499 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:12:23.345499 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:12:23.345499 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:12:23.345499 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:12:23.345499 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:12:23.345499 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application with Lock( Jul 28 08:12:23.345499 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:12:23.345499 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:12:23.345499 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:12:23.345499 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:12:23.346386 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:12:23.346386 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:12:23.346386 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:12:23.346386 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:12:23.346386 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 08:12:23.346386 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 08:12:23.346386 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 08:12:23.346386 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 08:12:23.346386 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 08:12:23.346386 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 08:12:23.346386 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 08:12:23.346386 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application Jul 28 08:12:23.346386 dv-cinder-851351-1-smb devstack@keystone.service[144068]: [pid: 144068|app: 0|req: 427/844] 10.222.0.42 () {56 vars in 1096 bytes} [Thu Jul 28 08:12:23 2022] GET /identity/v3/roles/admin => generated 83 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 08:12:23.347912 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347a57ec-fd09-4d6c-a8e3-d0a709ee5bc1 None None] REQUEST_METHOD: `POST` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:12:23.347912 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347a57ec-fd09-4d6c-a8e3-d0a709ee5bc1 None None] SCRIPT_NAME: `/identity` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:12:23.347912 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347a57ec-fd09-4d6c-a8e3-d0a709ee5bc1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:12:23.366984 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.auth.core [None req-347a57ec-fd09-4d6c-a8e3-d0a709ee5bc1 None None] MFA Rules not processed for user `bf5ceb8f07374635ad506b7d1b4f1612`. Rule list: `[]` (Enabled: `True`). {{(pid=144068) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 08:12:23.368440 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.fernet_utils [None req-347a57ec-fd09-4d6c-a8e3-d0a709ee5bc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=144068) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:12:23.417037 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb97bd9-bd44-45bb-be29-cd8b1803c25f None None] Validating token access rules against request {{(pid=144067) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:12:23.448853 dv-cinder-851351-1-smb devstack@keystone.service[144068]: [pid: 144068|app: 0|req: 428/845] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 08:12:23 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 08:12:23.448853 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347a57ec-fd09-4d6c-a8e3-d0a709ee5bc1 None None] Authenticating user token {{(pid=144068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:12:23.465312 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9f5a93-170e-4216-80a2-42030a6180e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144067) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:12:23.465811 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9f5a93-170e-4216-80a2-42030a6180e9 None admin] REQUEST_METHOD: `GET` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:12:23.466096 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9f5a93-170e-4216-80a2-42030a6180e9 None admin] SCRIPT_NAME: `/identity` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:12:23.466374 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9f5a93-170e-4216-80a2-42030a6180e9 None admin] PATH_INFO: `/v3/services` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:12:23.467128 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe9f5a93-170e-4216-80a2-42030a6180e9 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=144067) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:12:23.467396 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe9f5a93-170e-4216-80a2-42030a6180e9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:12:23.468819 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe9f5a93-170e-4216-80a2-42030a6180e9 None admin] RBAC: Authorization granted {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:12:23.473714 dv-cinder-851351-1-smb devstack@keystone.service[144067]: [pid: 144067|app: 0|req: 418/846] 10.222.0.42 () {56 vars in 1114 bytes} [Thu Jul 28 08:12:23 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:12:23.474477 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9f5a93-170e-4216-80a2-42030a6180e9 None admin] Authenticating user token {{(pid=144067) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:12:23.512814 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG dbcounter [-] [144067] Writing DB stats keystone:SELECT=100 {{(pid=144067) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:12:23.527738 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG dbcounter [-] [144068] Writing DB stats keystone:SELECT=100 {{(pid=144068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:12:23.563465 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347a57ec-fd09-4d6c-a8e3-d0a709ee5bc1 None None] Validating token access rules against request {{(pid=144068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:12:23.587999 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9f5a93-170e-4216-80a2-42030a6180e9 None admin] Validating token access rules against request {{(pid=144067) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:12:23.599171 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-545186da-cb9d-41ba-aa40-68de4c0ef6a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:12:23.599821 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545186da-cb9d-41ba-aa40-68de4c0ef6a0 None admin] REQUEST_METHOD: `GET` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:12:23.600112 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545186da-cb9d-41ba-aa40-68de4c0ef6a0 None admin] SCRIPT_NAME: `/identity` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:12:23.600394 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545186da-cb9d-41ba-aa40-68de4c0ef6a0 None admin] PATH_INFO: `/v3/roles` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:12:23.601176 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-545186da-cb9d-41ba-aa40-68de4c0ef6a0 None admin] RBAC: Adding query filter params (name=admin) {{(pid=144068) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:12:23.601489 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-545186da-cb9d-41ba-aa40-68de4c0ef6a0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:12:23.602889 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-545186da-cb9d-41ba-aa40-68de4c0ef6a0 None admin] RBAC: Authorization granted {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:12:23.616635 dv-cinder-851351-1-smb devstack@keystone.service[144068]: [pid: 144068|app: 0|req: 429/847] 10.222.0.42 () {56 vars in 1099 bytes} [Thu Jul 28 08:12:23 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:12:23.616635 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-545186da-cb9d-41ba-aa40-68de4c0ef6a0 None admin] Authenticating user token {{(pid=144068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:12:23.629911 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4741cfd9-d075-4fba-be23-6d0e86769a0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144067) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:12:23.630582 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4741cfd9-d075-4fba-be23-6d0e86769a0d None admin] REQUEST_METHOD: `GET` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:12:23.630865 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4741cfd9-d075-4fba-be23-6d0e86769a0d None admin] SCRIPT_NAME: `/identity` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:12:23.631147 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4741cfd9-d075-4fba-be23-6d0e86769a0d None admin] PATH_INFO: `/v3/roles/service` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:12:23.642904 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4741cfd9-d075-4fba-be23-6d0e86769a0d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 08:12:23.648436 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application [None req-4741cfd9-d075-4fba-be23-6d0e86769a0d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 28 08:12:23.648436 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:12:23.648436 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:12:23.648436 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:12:23.648436 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:12:23.648436 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:12:23.648436 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:12:23.648436 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:12:23.648436 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:12:23.648436 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:12:23.648436 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:12:23.648436 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:12:23.648436 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 08:12:23.648436 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 08:12:23.648436 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 08:12:23.648436 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 08:12:23.649394 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 08:12:23.649394 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 08:12:23.649394 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 08:12:23.649394 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 08:12:23.649394 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:12:23.649394 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:12:23.649394 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:12:23.649394 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:12:23.649394 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:12:23.649394 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:12:23.649394 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:12:23.649394 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application with Lock( Jul 28 08:12:23.649394 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:12:23.649394 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:12:23.649394 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:12:23.649394 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:12:23.650317 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:12:23.650317 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:12:23.650317 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:12:23.650317 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:12:23.650317 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 08:12:23.650317 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 08:12:23.650317 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 08:12:23.650317 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 08:12:23.650317 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 08:12:23.650317 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 08:12:23.650317 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 28 08:12:23.650317 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application Jul 28 08:12:23.654603 dv-cinder-851351-1-smb devstack@keystone.service[144067]: [pid: 144067|app: 0|req: 419/848] 10.222.0.42 () {56 vars in 1102 bytes} [Thu Jul 28 08:12:23 2022] GET /identity/v3/roles/service => generated 85 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:12:23.655533 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4741cfd9-d075-4fba-be23-6d0e86769a0d None admin] Authenticating user token {{(pid=144067) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:12:23.724764 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-545186da-cb9d-41ba-aa40-68de4c0ef6a0 None admin] Validating token access rules against request {{(pid=144068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:12:23.756854 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG dbcounter [-] [144068] Writing DB stats keystone:SELECT=100 {{(pid=144068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:12:23.759210 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG dbcounter [-] [144067] Writing DB stats keystone:SELECT=100 {{(pid=144067) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:12:23.764634 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b41d4ac-fbb4-46d5-9bc5-002622a7b42a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:12:23.765438 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b41d4ac-fbb4-46d5-9bc5-002622a7b42a None admin] REQUEST_METHOD: `GET` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:12:23.765745 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b41d4ac-fbb4-46d5-9bc5-002622a7b42a None admin] SCRIPT_NAME: `/identity` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:12:23.766005 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b41d4ac-fbb4-46d5-9bc5-002622a7b42a None admin] PATH_INFO: `/v3/services` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:12:23.766709 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b41d4ac-fbb4-46d5-9bc5-002622a7b42a None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=144068) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:12:23.767020 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b41d4ac-fbb4-46d5-9bc5-002622a7b42a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:12:23.767869 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4741cfd9-d075-4fba-be23-6d0e86769a0d None admin] Validating token access rules against request {{(pid=144067) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:12:23.768420 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b41d4ac-fbb4-46d5-9bc5-002622a7b42a None admin] RBAC: Authorization granted {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:12:23.773725 dv-cinder-851351-1-smb devstack@keystone.service[144068]: [pid: 144068|app: 0|req: 430/849] 10.222.0.42 () {56 vars in 1114 bytes} [Thu Jul 28 08:12:23 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:12:23.774391 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b41d4ac-fbb4-46d5-9bc5-002622a7b42a None admin] Authenticating user token {{(pid=144068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:12:23.828704 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-315a3c6c-baa9-4627-b66a-ee997f9cd471 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144067) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:12:23.829394 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315a3c6c-baa9-4627-b66a-ee997f9cd471 None admin] REQUEST_METHOD: `GET` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:12:23.829680 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315a3c6c-baa9-4627-b66a-ee997f9cd471 None admin] SCRIPT_NAME: `/identity` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:12:23.829962 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315a3c6c-baa9-4627-b66a-ee997f9cd471 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:12:23.843629 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-315a3c6c-baa9-4627-b66a-ee997f9cd471 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:12:23.845316 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-315a3c6c-baa9-4627-b66a-ee997f9cd471 None admin] RBAC: Authorization granted {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:12:23.863103 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application [None req-315a3c6c-baa9-4627-b66a-ee997f9cd471 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 08:12:23.863103 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:12:23.863103 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:12:23.863103 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:12:23.863103 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:12:23.863103 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:12:23.863103 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:12:23.863103 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:12:23.863103 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:12:23.863103 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:12:23.863103 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:12:23.863103 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:12:23.863103 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 08:12:23.863103 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 08:12:23.863103 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 08:12:23.864136 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 08:12:23.864136 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:12:23.864136 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:12:23.864136 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:12:23.864136 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:12:23.864136 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:12:23.864136 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:12:23.864136 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:12:23.864136 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application with Lock( Jul 28 08:12:23.864136 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:12:23.864136 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:12:23.864136 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:12:23.864136 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:12:23.864136 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:12:23.864136 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:12:23.864136 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:12:23.864136 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:12:23.865143 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 08:12:23.865143 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 08:12:23.865143 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 08:12:23.865143 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application Jul 28 08:12:23.865143 dv-cinder-851351-1-smb devstack@keystone.service[144067]: [pid: 144067|app: 0|req: 420/850] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 08:12:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:12:23.873391 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-315a3c6c-baa9-4627-b66a-ee997f9cd471 None admin] Authenticating user token {{(pid=144067) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:12:23.919276 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b41d4ac-fbb4-46d5-9bc5-002622a7b42a None admin] Validating token access rules against request {{(pid=144068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:12:23.958979 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83860405-d890-4586-888c-2c64c31d9abd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:12:23.959685 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83860405-d890-4586-888c-2c64c31d9abd None admin] REQUEST_METHOD: `GET` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:12:23.959980 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83860405-d890-4586-888c-2c64c31d9abd None admin] SCRIPT_NAME: `/identity` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:12:23.960242 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83860405-d890-4586-888c-2c64c31d9abd None admin] PATH_INFO: `/v3/roles` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:12:23.961423 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83860405-d890-4586-888c-2c64c31d9abd None admin] RBAC: Adding query filter params (name=service) {{(pid=144068) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:12:23.961731 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83860405-d890-4586-888c-2c64c31d9abd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:12:23.963126 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83860405-d890-4586-888c-2c64c31d9abd None admin] RBAC: Authorization granted {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:12:23.973342 dv-cinder-851351-1-smb devstack@keystone.service[144068]: [pid: 144068|app: 0|req: 431/851] 10.222.0.42 () {56 vars in 1103 bytes} [Thu Jul 28 08:12:23 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:12:23.980773 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83860405-d890-4586-888c-2c64c31d9abd None admin] Authenticating user token {{(pid=144068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:12:24.015860 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-315a3c6c-baa9-4627-b66a-ee997f9cd471 None admin] Validating token access rules against request {{(pid=144067) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:12:24.052998 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19941f8-7ac3-4ea6-a160-5623948f1855 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144067) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:12:24.053635 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19941f8-7ac3-4ea6-a160-5623948f1855 None admin] REQUEST_METHOD: `GET` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:12:24.053919 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19941f8-7ac3-4ea6-a160-5623948f1855 None admin] SCRIPT_NAME: `/identity` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:12:24.054207 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19941f8-7ac3-4ea6-a160-5623948f1855 None admin] PATH_INFO: `/v3/domains` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:12:24.054913 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b19941f8-7ac3-4ea6-a160-5623948f1855 None admin] RBAC: Adding query filter params (name=Default) {{(pid=144067) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:12:24.055236 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b19941f8-7ac3-4ea6-a160-5623948f1855 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:12:24.056382 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG dbcounter [-] [144068] Writing DB stats keystone:SELECT=100 {{(pid=144068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:12:24.056628 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b19941f8-7ac3-4ea6-a160-5623948f1855 None admin] RBAC: Authorization granted {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:12:24.070471 dv-cinder-851351-1-smb devstack@keystone.service[144067]: [pid: 144067|app: 0|req: 421/852] 10.222.0.42 () {56 vars in 1109 bytes} [Thu Jul 28 08:12:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 08:12:24.076150 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19941f8-7ac3-4ea6-a160-5623948f1855 None admin] Authenticating user token {{(pid=144067) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:12:24.087394 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG dbcounter [-] [144067] Writing DB stats keystone:SELECT=100 {{(pid=144067) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:12:24.116282 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83860405-d890-4586-888c-2c64c31d9abd None admin] Validating token access rules against request {{(pid=144068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:12:24.155200 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8440bbb9-fd53-4601-84dc-ac13ec534bc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:12:24.155862 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8440bbb9-fd53-4601-84dc-ac13ec534bc8 None admin] REQUEST_METHOD: `GET` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:12:24.156142 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8440bbb9-fd53-4601-84dc-ac13ec534bc8 None admin] SCRIPT_NAME: `/identity` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:12:24.156414 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8440bbb9-fd53-4601-84dc-ac13ec534bc8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:12:24.167494 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8440bbb9-fd53-4601-84dc-ac13ec534bc8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:12:24.169004 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8440bbb9-fd53-4601-84dc-ac13ec534bc8 None admin] RBAC: Authorization granted {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:12:24.183549 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application [None req-8440bbb9-fd53-4601-84dc-ac13ec534bc8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 08:12:24.183549 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:12:24.183549 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:12:24.183549 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:12:24.183549 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:12:24.183549 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:12:24.183549 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:12:24.183549 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:12:24.183549 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:12:24.183549 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:12:24.183549 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:12:24.183549 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:12:24.183549 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 08:12:24.183549 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 08:12:24.183549 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 08:12:24.184395 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 08:12:24.184395 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:12:24.184395 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:12:24.184395 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:12:24.184395 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:12:24.184395 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:12:24.184395 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:12:24.184395 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:12:24.184395 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application with Lock( Jul 28 08:12:24.184395 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:12:24.184395 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:12:24.184395 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:12:24.184395 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:12:24.184395 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:12:24.184395 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:12:24.184395 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:12:24.184395 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:12:24.185243 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 08:12:24.185243 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 08:12:24.185243 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 08:12:24.185243 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application Jul 28 08:12:24.185243 dv-cinder-851351-1-smb devstack@keystone.service[144068]: [pid: 144068|app: 0|req: 432/853] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 08:12:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 08:12:24.186029 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba5297c-5999-4f4e-a8f9-0fb300a423cb None None] REQUEST_METHOD: `GET` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:12:24.186253 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba5297c-5999-4f4e-a8f9-0fb300a423cb None None] SCRIPT_NAME: `/identity` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:12:24.186529 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba5297c-5999-4f4e-a8f9-0fb300a423cb None None] PATH_INFO: `/` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:12:24.187998 dv-cinder-851351-1-smb devstack@keystone.service[144068]: [pid: 144068|app: 0|req: 433/854] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 08:12:24 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 08:12:24.190852 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba5297c-5999-4f4e-a8f9-0fb300a423cb None None] Authenticating user token {{(pid=144068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:12:24.200557 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19941f8-7ac3-4ea6-a160-5623948f1855 None admin] Validating token access rules against request {{(pid=144067) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:12:24.234734 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d21b21-e536-43f5-a2e9-060da1bc67b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144067) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:12:24.235312 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d21b21-e536-43f5-a2e9-060da1bc67b3 None admin] REQUEST_METHOD: `GET` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:12:24.235595 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d21b21-e536-43f5-a2e9-060da1bc67b3 None admin] SCRIPT_NAME: `/identity` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:12:24.235873 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d21b21-e536-43f5-a2e9-060da1bc67b3 None admin] PATH_INFO: `/v3/users/swift` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:12:24.243827 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42d21b21-e536-43f5-a2e9-060da1bc67b3 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:12:24.245345 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42d21b21-e536-43f5-a2e9-060da1bc67b3 None admin] RBAC: Authorization granted {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:12:24.258458 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application [None req-42d21b21-e536-43f5-a2e9-060da1bc67b3 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 28 08:12:24.258458 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:12:24.258458 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:12:24.258458 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:12:24.258458 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:12:24.258458 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:12:24.258458 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:12:24.258458 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:12:24.258458 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:12:24.258458 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:12:24.258458 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:12:24.258458 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:12:24.258458 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 28 08:12:24.258458 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 28 08:12:24.258458 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 28 08:12:24.258458 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 28 08:12:24.259318 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:12:24.259318 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:12:24.259318 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 28 08:12:24.259318 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 08:12:24.259318 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 28 08:12:24.259318 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 08:12:24.259318 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:12:24.259318 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:12:24.259318 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:12:24.259318 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:12:24.259318 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:12:24.259318 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application with Lock( Jul 28 08:12:24.259318 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:12:24.259318 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:12:24.259318 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:12:24.259318 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:12:24.259318 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:12:24.259318 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:12:24.260161 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:12:24.260161 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:12:24.260161 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 28 08:12:24.260161 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 28 08:12:24.260161 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 28 08:12:24.260161 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 28 08:12:24.260161 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 28 08:12:24.260161 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 28 08:12:24.260161 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 28 08:12:24.260161 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application Jul 28 08:12:24.260161 dv-cinder-851351-1-smb devstack@keystone.service[144067]: [pid: 144067|app: 0|req: 422/855] 10.222.0.42 () {56 vars in 1096 bytes} [Thu Jul 28 08:12:24 2022] GET /identity/v3/users/swift => generated 83 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 08:12:24.261279 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1148286b-ede3-4799-b61e-77d23047c234 None None] REQUEST_METHOD: `POST` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:12:24.261279 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1148286b-ede3-4799-b61e-77d23047c234 None None] SCRIPT_NAME: `/identity` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:12:24.261409 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1148286b-ede3-4799-b61e-77d23047c234 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:12:24.279088 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.auth.core [None req-1148286b-ede3-4799-b61e-77d23047c234 None None] MFA Rules not processed for user `bf5ceb8f07374635ad506b7d1b4f1612`. Rule list: `[]` (Enabled: `True`). {{(pid=144067) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 08:12:24.280306 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.fernet_utils [None req-1148286b-ede3-4799-b61e-77d23047c234 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=144067) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:12:24.308429 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba5297c-5999-4f4e-a8f9-0fb300a423cb None None] Validating token access rules against request {{(pid=144068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:12:24.318257 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG dbcounter [-] [144068] Writing DB stats keystone:SELECT=100 {{(pid=144068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:12:24.341548 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG dbcounter [-] [144067] Writing DB stats keystone:SELECT=100 {{(pid=144067) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:12:24.348633 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f11f1c-e057-404a-a2c6-0356d7db7aa4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:12:24.349293 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f11f1c-e057-404a-a2c6-0356d7db7aa4 None admin] REQUEST_METHOD: `GET` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:12:24.349572 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f11f1c-e057-404a-a2c6-0356d7db7aa4 None admin] SCRIPT_NAME: `/identity` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:12:24.349846 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f11f1c-e057-404a-a2c6-0356d7db7aa4 None admin] PATH_INFO: `/v3/domains` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:12:24.350548 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65f11f1c-e057-404a-a2c6-0356d7db7aa4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=144068) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:12:24.350849 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65f11f1c-e057-404a-a2c6-0356d7db7aa4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:12:24.352238 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65f11f1c-e057-404a-a2c6-0356d7db7aa4 None admin] RBAC: Authorization granted {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:12:24.359253 dv-cinder-851351-1-smb devstack@keystone.service[144067]: [pid: 144067|app: 0|req: 423/856] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 08:12:24 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 08:12:24.360180 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1148286b-ede3-4799-b61e-77d23047c234 None None] Authenticating user token {{(pid=144067) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:12:24.368857 dv-cinder-851351-1-smb devstack@keystone.service[144068]: [pid: 144068|app: 0|req: 434/857] 10.222.0.42 () {56 vars in 1109 bytes} [Thu Jul 28 08:12:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 08:12:24.371971 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f11f1c-e057-404a-a2c6-0356d7db7aa4 None admin] Authenticating user token {{(pid=144068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:12:24.479624 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1148286b-ede3-4799-b61e-77d23047c234 None None] Validating token access rules against request {{(pid=144067) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:12:24.490614 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f11f1c-e057-404a-a2c6-0356d7db7aa4 None admin] Validating token access rules against request {{(pid=144068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:12:24.520201 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ba1955-907e-4e8a-848a-3e7c0a962602 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144067) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:12:24.520874 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ba1955-907e-4e8a-848a-3e7c0a962602 None admin] REQUEST_METHOD: `GET` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:12:24.521156 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ba1955-907e-4e8a-848a-3e7c0a962602 None admin] SCRIPT_NAME: `/identity` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:12:24.521435 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ba1955-907e-4e8a-848a-3e7c0a962602 None admin] PATH_INFO: `/v3/users` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:12:24.522258 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29ba1955-907e-4e8a-848a-3e7c0a962602 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=144067) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:12:24.522563 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29ba1955-907e-4e8a-848a-3e7c0a962602 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:12:24.524030 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29ba1955-907e-4e8a-848a-3e7c0a962602 None admin] RBAC: Authorization granted {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:12:24.526718 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d604c2-6555-4de8-811a-f274b49ba587 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:12:24.527680 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d604c2-6555-4de8-811a-f274b49ba587 None admin] REQUEST_METHOD: `POST` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:12:24.527680 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d604c2-6555-4de8-811a-f274b49ba587 None admin] SCRIPT_NAME: `/identity` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:12:24.527945 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d604c2-6555-4de8-811a-f274b49ba587 None admin] PATH_INFO: `/v3/services` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:12:24.528636 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0d604c2-6555-4de8-811a-f274b49ba587 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:12:24.530066 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0d604c2-6555-4de8-811a-f274b49ba587 None admin] RBAC: Authorization granted {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:12:24.544451 dv-cinder-851351-1-smb devstack@keystone.service[144067]: [pid: 144067|app: 0|req: 424/858] 10.222.0.42 () {56 vars in 1135 bytes} [Thu Jul 28 08:12:24 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:12:24.545404 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ba1955-907e-4e8a-848a-3e7c0a962602 None admin] Authenticating user token {{(pid=144067) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:12:24.546901 dv-cinder-851351-1-smb devstack@keystone.service[144068]: [pid: 144068|app: 0|req: 435/859] 10.222.0.42 () {60 vars in 1141 bytes} [Thu Jul 28 08:12:24 2022] POST /identity/v3/services => generated 269 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 08:12:24.549822 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d604c2-6555-4de8-811a-f274b49ba587 None admin] Authenticating user token {{(pid=144068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:12:24.584328 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG dbcounter [-] [144068] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=144068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:12:24.656092 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG dbcounter [-] [144067] Writing DB stats keystone:SELECT=100 {{(pid=144067) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:12:24.691793 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d604c2-6555-4de8-811a-f274b49ba587 None admin] Validating token access rules against request {{(pid=144068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:12:24.713438 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ba1955-907e-4e8a-848a-3e7c0a962602 None admin] Validating token access rules against request {{(pid=144067) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:12:24.730989 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3214b1ed-b620-4de4-a08c-ceb890aa78c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:12:24.731639 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3214b1ed-b620-4de4-a08c-ceb890aa78c2 None admin] REQUEST_METHOD: `GET` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:12:24.731919 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3214b1ed-b620-4de4-a08c-ceb890aa78c2 None admin] SCRIPT_NAME: `/identity` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:12:24.732189 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3214b1ed-b620-4de4-a08c-ceb890aa78c2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:12:24.754226 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566e289b-1851-4eac-a85f-3f42c75b23be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144067) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:12:24.754953 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566e289b-1851-4eac-a85f-3f42c75b23be None admin] REQUEST_METHOD: `GET` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:12:24.755242 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566e289b-1851-4eac-a85f-3f42c75b23be None admin] SCRIPT_NAME: `/identity` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:12:24.755578 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566e289b-1851-4eac-a85f-3f42c75b23be None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:12:24.763800 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-566e289b-1851-4eac-a85f-3f42c75b23be None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:12:24.765521 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-566e289b-1851-4eac-a85f-3f42c75b23be None admin] RBAC: Authorization granted {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:12:24.779560 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application [None req-566e289b-1851-4eac-a85f-3f42c75b23be None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 28 08:12:24.779560 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:12:24.779560 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:12:24.779560 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:12:24.779560 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:12:24.779560 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:12:24.779560 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:12:24.779560 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:12:24.779560 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:12:24.779560 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:12:24.779560 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:12:24.779560 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:12:24.779560 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 28 08:12:24.779560 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 28 08:12:24.779560 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 28 08:12:24.779560 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 28 08:12:24.780480 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:12:24.780480 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:12:24.780480 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 28 08:12:24.780480 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 08:12:24.780480 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 28 08:12:24.780480 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 08:12:24.780480 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:12:24.780480 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:12:24.780480 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:12:24.780480 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:12:24.780480 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:12:24.780480 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application with Lock( Jul 28 08:12:24.780480 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:12:24.780480 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:12:24.780480 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:12:24.780480 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:12:24.780480 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:12:24.780480 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:12:24.781566 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:12:24.781566 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:12:24.781566 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 28 08:12:24.781566 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 28 08:12:24.781566 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 28 08:12:24.781566 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 28 08:12:24.781566 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 28 08:12:24.781566 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 28 08:12:24.781566 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 28 08:12:24.781566 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application Jul 28 08:12:24.781566 dv-cinder-851351-1-smb devstack@keystone.service[144067]: [pid: 144067|app: 0|req: 425/860] 10.222.0.42 () {56 vars in 1117 bytes} [Thu Jul 28 08:12:24 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:12:24.787161 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566e289b-1851-4eac-a85f-3f42c75b23be None admin] Authenticating user token {{(pid=144067) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:12:24.818802 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3214b1ed-b620-4de4-a08c-ceb890aa78c2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:12:24.820302 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3214b1ed-b620-4de4-a08c-ceb890aa78c2 None admin] RBAC: Authorization granted {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:12:24.846881 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG dbcounter [-] [144068] Writing DB stats keystone:SELECT=100 {{(pid=144068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:12:24.930690 dv-cinder-851351-1-smb devstack@keystone.service[144068]: [pid: 144068|app: 0|req: 436/861] 10.222.0.42 () {58 vars in 1282 bytes} [Thu Jul 28 08:12:24 2022] GET /identity/v3/auth/tokens => generated 1261 bytes in 381 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 28 08:12:24.933133 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566e289b-1851-4eac-a85f-3f42c75b23be None admin] Validating token access rules against request {{(pid=144067) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:12:24.935927 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3214b1ed-b620-4de4-a08c-ceb890aa78c2 None admin] Authenticating user token {{(pid=144068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:12:24.956771 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG dbcounter [-] [144067] Writing DB stats keystone:SELECT=100 {{(pid=144067) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:12:24.991326 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339b5386-7dd6-4e62-aa88-a80070a41c70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144067) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:12:24.992024 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339b5386-7dd6-4e62-aa88-a80070a41c70 None admin] REQUEST_METHOD: `GET` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:12:24.992304 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339b5386-7dd6-4e62-aa88-a80070a41c70 None admin] SCRIPT_NAME: `/identity` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:12:24.992577 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339b5386-7dd6-4e62-aa88-a80070a41c70 None admin] PATH_INFO: `/v3/users` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:12:24.993433 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-339b5386-7dd6-4e62-aa88-a80070a41c70 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=144067) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:12:24.993740 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-339b5386-7dd6-4e62-aa88-a80070a41c70 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:12:24.995280 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-339b5386-7dd6-4e62-aa88-a80070a41c70 None admin] RBAC: Authorization granted {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:12:25.024006 dv-cinder-851351-1-smb devstack@keystone.service[144067]: [pid: 144067|app: 0|req: 426/862] 10.222.0.42 () {56 vars in 1149 bytes} [Thu Jul 28 08:12:24 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 08:12:25.026621 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339b5386-7dd6-4e62-aa88-a80070a41c70 None admin] Authenticating user token {{(pid=144067) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:12:25.075211 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3214b1ed-b620-4de4-a08c-ceb890aa78c2 None admin] Validating token access rules against request {{(pid=144068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:12:25.109944 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG dbcounter [-] [144068] Writing DB stats keystone:SELECT=100 {{(pid=144068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:12:25.125461 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea658346-0078-425e-9395-c4f875e990c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:12:25.126411 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea658346-0078-425e-9395-c4f875e990c0 None admin] REQUEST_METHOD: `GET` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:12:25.126861 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea658346-0078-425e-9395-c4f875e990c0 None admin] SCRIPT_NAME: `/identity` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:12:25.127340 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea658346-0078-425e-9395-c4f875e990c0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:12:25.141455 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea658346-0078-425e-9395-c4f875e990c0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:12:25.144051 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea658346-0078-425e-9395-c4f875e990c0 None admin] RBAC: Authorization granted {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:12:25.156319 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339b5386-7dd6-4e62-aa88-a80070a41c70 None admin] Validating token access rules against request {{(pid=144067) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:12:25.164120 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application [None req-ea658346-0078-425e-9395-c4f875e990c0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 08:12:25.164120 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:12:25.164120 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:12:25.164120 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:12:25.164120 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:12:25.164120 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:12:25.164120 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:12:25.164120 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:12:25.164120 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:12:25.164120 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:12:25.164120 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:12:25.164120 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:12:25.164120 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 08:12:25.164120 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 08:12:25.164120 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 08:12:25.164997 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 08:12:25.164997 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:12:25.164997 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:12:25.164997 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:12:25.164997 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:12:25.164997 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:12:25.164997 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:12:25.164997 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:12:25.164997 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application with Lock( Jul 28 08:12:25.164997 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:12:25.164997 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:12:25.164997 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:12:25.164997 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:12:25.164997 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:12:25.164997 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:12:25.164997 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:12:25.164997 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:12:25.165786 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 08:12:25.165786 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 08:12:25.165786 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 08:12:25.165786 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application Jul 28 08:12:25.166877 dv-cinder-851351-1-smb devstack@keystone.service[144068]: [pid: 144068|app: 0|req: 437/863] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 08:12:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 08:12:25.177908 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea658346-0078-425e-9395-c4f875e990c0 None admin] Authenticating user token {{(pid=144068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:12:25.199593 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e593b9-2fc3-4ded-923f-87148c16b2f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144067) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:12:25.200236 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e593b9-2fc3-4ded-923f-87148c16b2f4 None admin] REQUEST_METHOD: `GET` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:12:25.200524 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e593b9-2fc3-4ded-923f-87148c16b2f4 None admin] SCRIPT_NAME: `/identity` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:12:25.200842 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e593b9-2fc3-4ded-923f-87148c16b2f4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:12:25.253130 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG dbcounter [-] [144067] Writing DB stats keystone:SELECT=100 {{(pid=144067) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:12:25.292425 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9e593b9-2fc3-4ded-923f-87148c16b2f4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:12:25.294432 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9e593b9-2fc3-4ded-923f-87148c16b2f4 None admin] RBAC: Authorization granted {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:12:25.319578 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea658346-0078-425e-9395-c4f875e990c0 None admin] Validating token access rules against request {{(pid=144068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:12:25.374549 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-465a9c32-e2b7-4885-94e0-6bdc819f1d54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:12:25.376296 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465a9c32-e2b7-4885-94e0-6bdc819f1d54 None admin] REQUEST_METHOD: `GET` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:12:25.376865 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465a9c32-e2b7-4885-94e0-6bdc819f1d54 None admin] SCRIPT_NAME: `/identity` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:12:25.377343 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465a9c32-e2b7-4885-94e0-6bdc819f1d54 None admin] PATH_INFO: `/v3/domains` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:12:25.378301 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-465a9c32-e2b7-4885-94e0-6bdc819f1d54 None admin] RBAC: Adding query filter params (name=Default) {{(pid=144068) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:12:25.379066 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-465a9c32-e2b7-4885-94e0-6bdc819f1d54 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:12:25.381650 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-465a9c32-e2b7-4885-94e0-6bdc819f1d54 None admin] RBAC: Authorization granted {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:12:25.399207 dv-cinder-851351-1-smb devstack@keystone.service[144068]: [pid: 144068|app: 0|req: 438/864] 10.222.0.42 () {56 vars in 1109 bytes} [Thu Jul 28 08:12:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:12:25.404474 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-465a9c32-e2b7-4885-94e0-6bdc819f1d54 None admin] Authenticating user token {{(pid=144068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:12:25.428808 dv-cinder-851351-1-smb devstack@keystone.service[144067]: [pid: 144067|app: 0|req: 427/865] 10.222.0.42 () {58 vars in 1282 bytes} [Thu Jul 28 08:12:25 2022] GET /identity/v3/auth/tokens => generated 1261 bytes in 399 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 28 08:12:25.431481 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e593b9-2fc3-4ded-923f-87148c16b2f4 None admin] Authenticating user token {{(pid=144067) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:12:25.441123 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG dbcounter [-] [144068] Writing DB stats keystone:SELECT=100 {{(pid=144068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:12:25.513273 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG dbcounter [-] [144067] Writing DB stats keystone:SELECT=100 {{(pid=144067) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:12:25.515475 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-465a9c32-e2b7-4885-94e0-6bdc819f1d54 None admin] Validating token access rules against request {{(pid=144068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:12:25.548852 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e593b9-2fc3-4ded-923f-87148c16b2f4 None admin] Validating token access rules against request {{(pid=144067) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:12:25.551613 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b97c3c-90c2-4cb2-a3e1-89264299099c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:12:25.553020 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b97c3c-90c2-4cb2-a3e1-89264299099c None admin] REQUEST_METHOD: `GET` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:12:25.553020 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b97c3c-90c2-4cb2-a3e1-89264299099c None admin] SCRIPT_NAME: `/identity` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:12:25.553020 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b97c3c-90c2-4cb2-a3e1-89264299099c None admin] PATH_INFO: `/v3/projects/service` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:12:25.560969 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68b97c3c-90c2-4cb2-a3e1-89264299099c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:12:25.562595 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68b97c3c-90c2-4cb2-a3e1-89264299099c None admin] RBAC: Authorization granted {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:12:25.574708 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application [None req-68b97c3c-90c2-4cb2-a3e1-89264299099c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 08:12:25.574708 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:12:25.574708 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:12:25.574708 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:12:25.574708 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:12:25.574708 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:12:25.574708 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:12:25.574708 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:12:25.574708 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:12:25.574708 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:12:25.574708 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:12:25.574708 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:12:25.574708 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 28 08:12:25.574708 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 28 08:12:25.574708 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 28 08:12:25.575545 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 28 08:12:25.575545 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:12:25.575545 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:12:25.575545 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:12:25.575545 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:12:25.575545 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:12:25.575545 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:12:25.575545 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:12:25.575545 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application with Lock( Jul 28 08:12:25.575545 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:12:25.575545 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:12:25.575545 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:12:25.575545 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:12:25.575545 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:12:25.575545 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:12:25.575545 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:12:25.575545 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:12:25.576358 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 28 08:12:25.576358 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 28 08:12:25.576358 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 28 08:12:25.576358 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 28 08:12:25.576358 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 28 08:12:25.576358 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 28 08:12:25.576358 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 08:12:25.576358 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application Jul 28 08:12:25.581728 dv-cinder-851351-1-smb devstack@keystone.service[144068]: [pid: 144068|app: 0|req: 439/866] 10.222.0.42 () {56 vars in 1111 bytes} [Thu Jul 28 08:12:25 2022] GET /identity/v3/projects/service => generated 88 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 08:12:25.581873 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b97c3c-90c2-4cb2-a3e1-89264299099c None admin] Authenticating user token {{(pid=144068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:12:25.595335 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-522dec69-3b3a-44e1-81d8-6890679d8602 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144067) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:12:25.596469 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522dec69-3b3a-44e1-81d8-6890679d8602 None admin] REQUEST_METHOD: `GET` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:12:25.597151 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522dec69-3b3a-44e1-81d8-6890679d8602 None admin] SCRIPT_NAME: `/identity` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:12:25.597669 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522dec69-3b3a-44e1-81d8-6890679d8602 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:12:25.609182 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-522dec69-3b3a-44e1-81d8-6890679d8602 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:12:25.610950 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-522dec69-3b3a-44e1-81d8-6890679d8602 None admin] RBAC: Authorization granted {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:12:25.627468 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application [None req-522dec69-3b3a-44e1-81d8-6890679d8602 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 08:12:25.627468 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:12:25.627468 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:12:25.627468 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:12:25.627468 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:12:25.627468 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:12:25.627468 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:12:25.627468 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:12:25.627468 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:12:25.627468 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:12:25.627468 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:12:25.627468 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:12:25.627468 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 08:12:25.627468 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 08:12:25.627468 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 08:12:25.628342 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 08:12:25.628342 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:12:25.628342 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:12:25.628342 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:12:25.628342 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:12:25.628342 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:12:25.628342 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:12:25.628342 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:12:25.628342 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application with Lock( Jul 28 08:12:25.628342 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:12:25.628342 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:12:25.628342 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:12:25.628342 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:12:25.628342 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:12:25.628342 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:12:25.628342 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:12:25.628342 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:12:25.629592 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 08:12:25.629592 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 08:12:25.629592 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 08:12:25.629592 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application Jul 28 08:12:25.631592 dv-cinder-851351-1-smb devstack@keystone.service[144067]: [pid: 144067|app: 0|req: 428/867] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 08:12:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:12:25.640085 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-522dec69-3b3a-44e1-81d8-6890679d8602 None admin] Authenticating user token {{(pid=144067) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:12:25.708608 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG dbcounter [-] [144068] Writing DB stats keystone:SELECT=100 {{(pid=144068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:12:25.717234 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b97c3c-90c2-4cb2-a3e1-89264299099c None admin] Validating token access rules against request {{(pid=144068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:12:25.761152 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a5067ae-a684-441a-b6c9-8fbb4a3b86c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:12:25.762115 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5067ae-a684-441a-b6c9-8fbb4a3b86c8 None admin] REQUEST_METHOD: `GET` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:12:25.762567 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5067ae-a684-441a-b6c9-8fbb4a3b86c8 None admin] SCRIPT_NAME: `/identity` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:12:25.762984 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5067ae-a684-441a-b6c9-8fbb4a3b86c8 None admin] PATH_INFO: `/v3/projects` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:12:25.763931 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a5067ae-a684-441a-b6c9-8fbb4a3b86c8 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=144068) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:12:25.764436 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a5067ae-a684-441a-b6c9-8fbb4a3b86c8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:12:25.766128 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a5067ae-a684-441a-b6c9-8fbb4a3b86c8 None admin] RBAC: Authorization granted {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:12:25.766565 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-522dec69-3b3a-44e1-81d8-6890679d8602 None admin] Validating token access rules against request {{(pid=144067) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:12:25.782592 dv-cinder-851351-1-smb devstack@keystone.service[144068]: [pid: 144068|app: 0|req: 440/868] 10.222.0.42 () {56 vars in 1148 bytes} [Thu Jul 28 08:12:25 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 08:12:25.791099 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a5067ae-a684-441a-b6c9-8fbb4a3b86c8 None admin] Authenticating user token {{(pid=144068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:12:25.806806 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG dbcounter [-] [144067] Writing DB stats keystone:SELECT=100 {{(pid=144067) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:12:25.820135 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f975aac1-4ce1-429c-8978-2d934ec6074f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144067) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:12:25.821132 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f975aac1-4ce1-429c-8978-2d934ec6074f None admin] REQUEST_METHOD: `GET` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:12:25.821132 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f975aac1-4ce1-429c-8978-2d934ec6074f None admin] SCRIPT_NAME: `/identity` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:12:25.821398 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f975aac1-4ce1-429c-8978-2d934ec6074f None admin] PATH_INFO: `/v3/domains` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:12:25.822230 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f975aac1-4ce1-429c-8978-2d934ec6074f None admin] RBAC: Adding query filter params (name=Default) {{(pid=144067) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:12:25.822564 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f975aac1-4ce1-429c-8978-2d934ec6074f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:12:25.824017 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f975aac1-4ce1-429c-8978-2d934ec6074f None admin] RBAC: Authorization granted {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:12:25.843934 dv-cinder-851351-1-smb devstack@keystone.service[144067]: [pid: 144067|app: 0|req: 429/869] 10.222.0.42 () {56 vars in 1109 bytes} [Thu Jul 28 08:12:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:12:25.845759 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f975aac1-4ce1-429c-8978-2d934ec6074f None admin] Authenticating user token {{(pid=144067) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:12:25.930212 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a5067ae-a684-441a-b6c9-8fbb4a3b86c8 None admin] Validating token access rules against request {{(pid=144068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:12:25.967566 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f975aac1-4ce1-429c-8978-2d934ec6074f None admin] Validating token access rules against request {{(pid=144067) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:12:25.970652 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9797d02a-626c-48e9-bca9-0760acd3c615 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:12:25.971849 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9797d02a-626c-48e9-bca9-0760acd3c615 None admin] REQUEST_METHOD: `GET` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:12:25.972341 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9797d02a-626c-48e9-bca9-0760acd3c615 None admin] SCRIPT_NAME: `/identity` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:12:25.972822 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9797d02a-626c-48e9-bca9-0760acd3c615 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:12:25.973784 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9797d02a-626c-48e9-bca9-0760acd3c615 None admin] RBAC: Adding query filter params (role.id=d1020e7bb0b7411d895ddedd6dc02c5b, scope.project.id=fa39ab7491e5413ca648e31ee9177fa0, user.id=fffb2166afc14796bc3c9c9eba793ec0) {{(pid=144068) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:12:25.974096 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9797d02a-626c-48e9-bca9-0760acd3c615 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:12:25.975560 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9797d02a-626c-48e9-bca9-0760acd3c615 None admin] RBAC: Authorization granted {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:12:25.988643 dv-cinder-851351-1-smb devstack@keystone.service[144068]: [pid: 144068|app: 0|req: 441/870] 10.222.0.42 () {56 vars in 1374 bytes} [Thu Jul 28 08:12:25 2022] GET /identity/v3/role_assignments?user.id=fffb2166afc14796bc3c9c9eba793ec0&scope.project.id=fa39ab7491e5413ca648e31ee9177fa0&role.id=d1020e7bb0b7411d895ddedd6dc02c5b => generated 608 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 08:12:25.990279 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e45d40-1200-43eb-ae87-cc5ac0af5dc0 None None] REQUEST_METHOD: `GET` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:12:25.990678 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e45d40-1200-43eb-ae87-cc5ac0af5dc0 None None] SCRIPT_NAME: `/identity` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:12:25.991056 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e45d40-1200-43eb-ae87-cc5ac0af5dc0 None None] PATH_INFO: `/` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:12:25.992863 dv-cinder-851351-1-smb devstack@keystone.service[144068]: [pid: 144068|app: 0|req: 442/871] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 08:12:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 08:12:25.998705 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfeed184-bc20-426e-8595-05c5e9326085 None None] REQUEST_METHOD: `POST` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:12:25.998996 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfeed184-bc20-426e-8595-05c5e9326085 None None] SCRIPT_NAME: `/identity` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:12:25.999274 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfeed184-bc20-426e-8595-05c5e9326085 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:12:26.019825 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.auth.core [None req-dfeed184-bc20-426e-8595-05c5e9326085 None None] MFA Rules not processed for user `bf5ceb8f07374635ad506b7d1b4f1612`. Rule list: `[]` (Enabled: `True`). {{(pid=144068) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 08:12:26.021077 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.fernet_utils [None req-dfeed184-bc20-426e-8595-05c5e9326085 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=144068) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:12:26.021988 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1200c4a9-3d5e-4765-8748-0306e947d516 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144067) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:12:26.022895 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1200c4a9-3d5e-4765-8748-0306e947d516 None admin] REQUEST_METHOD: `GET` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:12:26.023777 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1200c4a9-3d5e-4765-8748-0306e947d516 None admin] SCRIPT_NAME: `/identity` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:12:26.024260 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1200c4a9-3d5e-4765-8748-0306e947d516 None admin] PATH_INFO: `/v3/projects/service` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:12:26.035492 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1200c4a9-3d5e-4765-8748-0306e947d516 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:12:26.038055 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1200c4a9-3d5e-4765-8748-0306e947d516 None admin] RBAC: Authorization granted {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:12:26.039362 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG dbcounter [-] [144068] Writing DB stats keystone:SELECT=100 {{(pid=144068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:12:26.059010 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application [None req-1200c4a9-3d5e-4765-8748-0306e947d516 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 08:12:26.059010 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:12:26.059010 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:12:26.059010 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:12:26.059010 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:12:26.059010 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:12:26.059010 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:12:26.059010 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:12:26.059010 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:12:26.059010 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:12:26.059010 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:12:26.059010 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:12:26.059010 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 28 08:12:26.059010 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 28 08:12:26.059010 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 28 08:12:26.060060 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 28 08:12:26.060060 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:12:26.060060 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:12:26.060060 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:12:26.060060 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:12:26.060060 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:12:26.060060 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:12:26.060060 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:12:26.060060 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application with Lock( Jul 28 08:12:26.060060 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:12:26.060060 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:12:26.060060 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:12:26.060060 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:12:26.060060 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:12:26.060060 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:12:26.060060 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:12:26.060060 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:12:26.061118 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 28 08:12:26.061118 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 28 08:12:26.061118 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 28 08:12:26.061118 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 28 08:12:26.061118 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 28 08:12:26.061118 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 28 08:12:26.061118 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 08:12:26.061118 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application Jul 28 08:12:26.068754 dv-cinder-851351-1-smb devstack@keystone.service[144067]: [pid: 144067|app: 0|req: 430/872] 10.222.0.42 () {56 vars in 1111 bytes} [Thu Jul 28 08:12:25 2022] GET /identity/v3/projects/service => generated 88 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:12:26.070826 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1200c4a9-3d5e-4765-8748-0306e947d516 None admin] Authenticating user token {{(pid=144067) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:12:26.115233 dv-cinder-851351-1-smb devstack@keystone.service[144068]: [pid: 144068|app: 0|req: 443/873] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 08:12:25 2022] POST /identity/v3/auth/tokens => generated 1261 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 08:12:26.132165 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG dbcounter [-] [144067] Writing DB stats keystone:SELECT=100 {{(pid=144067) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:12:26.138525 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfeed184-bc20-426e-8595-05c5e9326085 None None] Authenticating user token {{(pid=144068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:12:26.202338 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1200c4a9-3d5e-4765-8748-0306e947d516 None admin] Validating token access rules against request {{(pid=144067) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:12:26.242390 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d4d25c-4bae-4767-913f-b3723547f21f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144067) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:12:26.243040 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d4d25c-4bae-4767-913f-b3723547f21f None admin] REQUEST_METHOD: `GET` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:12:26.243325 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d4d25c-4bae-4767-913f-b3723547f21f None admin] SCRIPT_NAME: `/identity` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:12:26.243608 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d4d25c-4bae-4767-913f-b3723547f21f None admin] PATH_INFO: `/v3/projects` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:12:26.244453 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8d4d25c-4bae-4767-913f-b3723547f21f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=144067) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:12:26.244720 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8d4d25c-4bae-4767-913f-b3723547f21f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:12:26.246244 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8d4d25c-4bae-4767-913f-b3723547f21f None admin] RBAC: Authorization granted {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:12:26.260600 dv-cinder-851351-1-smb devstack@keystone.service[144067]: [pid: 144067|app: 0|req: 431/874] 10.222.0.42 () {56 vars in 1148 bytes} [Thu Jul 28 08:12:26 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 08:12:26.261724 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfeed184-bc20-426e-8595-05c5e9326085 None None] Validating token access rules against request {{(pid=144068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:12:26.266469 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d4d25c-4bae-4767-913f-b3723547f21f None admin] Authenticating user token {{(pid=144067) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:12:26.300938 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620c93ec-0392-4143-a40a-c1d0b83bc322 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:12:26.301578 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620c93ec-0392-4143-a40a-c1d0b83bc322 None admin] REQUEST_METHOD: `POST` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:12:26.301871 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620c93ec-0392-4143-a40a-c1d0b83bc322 None admin] SCRIPT_NAME: `/identity` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:12:26.302144 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620c93ec-0392-4143-a40a-c1d0b83bc322 None admin] PATH_INFO: `/v3/services` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:12:26.302871 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-620c93ec-0392-4143-a40a-c1d0b83bc322 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:12:26.304262 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-620c93ec-0392-4143-a40a-c1d0b83bc322 None admin] RBAC: Authorization granted {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:12:26.324394 dv-cinder-851351-1-smb devstack@keystone.service[144068]: [pid: 144068|app: 0|req: 444/875] 10.222.0.42 () {60 vars in 1141 bytes} [Thu Jul 28 08:12:26 2022] POST /identity/v3/services => generated 251 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 28 08:12:26.388360 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d4d25c-4bae-4767-913f-b3723547f21f None admin] Validating token access rules against request {{(pid=144067) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:12:26.391325 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG dbcounter [-] [144067] Writing DB stats keystone:SELECT=100 {{(pid=144067) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:12:26.443053 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e03925-42df-4c6f-acd3-4f0bdec004cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144067) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:12:26.443708 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e03925-42df-4c6f-acd3-4f0bdec004cf None admin] REQUEST_METHOD: `GET` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:12:26.444051 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e03925-42df-4c6f-acd3-4f0bdec004cf None admin] SCRIPT_NAME: `/identity` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:12:26.444334 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e03925-42df-4c6f-acd3-4f0bdec004cf None admin] PATH_INFO: `/v3/role_assignments` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:12:26.445192 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e03925-42df-4c6f-acd3-4f0bdec004cf None admin] RBAC: Adding query filter params (role.id=9aa6ce92dcbb4164ac0e44d2aa2a0248, scope.project.id=fa39ab7491e5413ca648e31ee9177fa0, user.id=64acbde3263f4bb8b102034fc3a9d4e6) {{(pid=144067) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:12:26.445510 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e03925-42df-4c6f-acd3-4f0bdec004cf None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:12:26.447016 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e03925-42df-4c6f-acd3-4f0bdec004cf None admin] RBAC: Authorization granted {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:12:26.454698 dv-cinder-851351-1-smb devstack@keystone.service[144067]: [pid: 144067|app: 0|req: 432/876] 10.222.0.42 () {56 vars in 1374 bytes} [Thu Jul 28 08:12:26 2022] GET /identity/v3/role_assignments?user.id=64acbde3263f4bb8b102034fc3a9d4e6&scope.project.id=fa39ab7491e5413ca648e31ee9177fa0&role.id=9aa6ce92dcbb4164ac0e44d2aa2a0248 => generated 608 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 08:12:26.708039 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbdd4794-2af8-4145-808e-3eb1367f9522 None None] REQUEST_METHOD: `GET` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:12:26.708281 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbdd4794-2af8-4145-808e-3eb1367f9522 None None] SCRIPT_NAME: `/identity` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:12:26.708479 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbdd4794-2af8-4145-808e-3eb1367f9522 None None] PATH_INFO: `/` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:12:26.710337 dv-cinder-851351-1-smb devstack@keystone.service[144068]: [pid: 144068|app: 0|req: 445/877] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 08:12:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 08:12:26.718017 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85004e37-09bb-4911-88dd-39c387222e2a None None] REQUEST_METHOD: `POST` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:12:26.718429 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85004e37-09bb-4911-88dd-39c387222e2a None None] SCRIPT_NAME: `/identity` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:12:26.718713 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85004e37-09bb-4911-88dd-39c387222e2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:12:26.740839 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.auth.core [None req-85004e37-09bb-4911-88dd-39c387222e2a None None] MFA Rules not processed for user `bf5ceb8f07374635ad506b7d1b4f1612`. Rule list: `[]` (Enabled: `True`). {{(pid=144067) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 08:12:26.742030 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.fernet_utils [None req-85004e37-09bb-4911-88dd-39c387222e2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=144067) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:12:26.817531 dv-cinder-851351-1-smb devstack@keystone.service[144067]: [pid: 144067|app: 0|req: 433/878] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 08:12:26 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 08:12:26.840378 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbdd4794-2af8-4145-808e-3eb1367f9522 None None] Authenticating user token {{(pid=144068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:12:26.854701 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG dbcounter [-] [144068] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=144068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:12:26.950393 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbdd4794-2af8-4145-808e-3eb1367f9522 None None] Validating token access rules against request {{(pid=144068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:12:26.985435 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6c40b1-5613-42ec-9784-32035fbd9938 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:12:26.986450 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6c40b1-5613-42ec-9784-32035fbd9938 None admin] REQUEST_METHOD: `GET` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:12:26.986450 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6c40b1-5613-42ec-9784-32035fbd9938 None admin] SCRIPT_NAME: `/identity` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:12:26.986610 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6c40b1-5613-42ec-9784-32035fbd9938 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:12:26.987228 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b6c40b1-5613-42ec-9784-32035fbd9938 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:12:26.989694 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b6c40b1-5613-42ec-9784-32035fbd9938 None admin] RBAC: Authorization granted {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:12:26.999011 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application [None req-2b6c40b1-5613-42ec-9784-32035fbd9938 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 28 08:12:26.999011 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:12:26.999011 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 28 08:12:26.999011 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 28 08:12:26.999011 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 28 08:12:26.999011 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 28 08:12:26.999011 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 28 08:12:26.999011 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 08:12:26.999011 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 28 08:12:26.999011 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application Jul 28 08:12:26.999011 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 28 08:12:26.999011 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application Jul 28 08:12:26.999011 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:12:26.999011 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:12:26.999011 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:12:26.999011 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:12:26.999864 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:12:26.999864 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:12:26.999864 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:12:26.999864 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:12:26.999864 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:12:26.999864 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:12:26.999864 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:12:26.999864 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 28 08:12:26.999864 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 28 08:12:26.999864 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 28 08:12:26.999864 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 28 08:12:26.999864 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:12:26.999864 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:12:26.999864 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:12:26.999864 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:12:26.999864 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:12:27.000818 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:12:27.000818 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:12:27.000818 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application with Lock( Jul 28 08:12:27.000818 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:12:27.000818 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:12:27.000818 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:12:27.000818 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:12:27.000818 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:12:27.000818 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:12:27.000818 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:12:27.000818 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:12:27.000818 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 28 08:12:27.000818 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 08:12:27.000818 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 28 08:12:27.000818 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application Jul 28 08:12:27.000818 dv-cinder-851351-1-smb devstack@keystone.service[144068]: [pid: 144068|app: 0|req: 446/879] 10.222.0.42 () {56 vars in 1132 bytes} [Thu Jul 28 08:12:26 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:12:27.008339 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85004e37-09bb-4911-88dd-39c387222e2a None None] Authenticating user token {{(pid=144067) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:12:27.110299 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG dbcounter [-] [144067] Writing DB stats keystone:SELECT=100 {{(pid=144067) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:12:27.122042 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85004e37-09bb-4911-88dd-39c387222e2a None None] Validating token access rules against request {{(pid=144067) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:12:27.157878 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e32adf6-b247-4df8-9851-9e18e9eb4f39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144067) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:12:27.158869 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e32adf6-b247-4df8-9851-9e18e9eb4f39 None admin] REQUEST_METHOD: `GET` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:12:27.159353 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e32adf6-b247-4df8-9851-9e18e9eb4f39 None admin] SCRIPT_NAME: `/identity` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:12:27.159915 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e32adf6-b247-4df8-9851-9e18e9eb4f39 None admin] PATH_INFO: `/v3/services` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:12:27.160834 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e32adf6-b247-4df8-9851-9e18e9eb4f39 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=144067) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:12:27.161397 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e32adf6-b247-4df8-9851-9e18e9eb4f39 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:12:27.162986 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e32adf6-b247-4df8-9851-9e18e9eb4f39 None admin] RBAC: Authorization granted {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:12:27.172766 dv-cinder-851351-1-smb devstack@keystone.service[144067]: [pid: 144067|app: 0|req: 434/880] 10.222.0.42 () {56 vars in 1126 bytes} [Thu Jul 28 08:12:27 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:12:27.174708 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6c40b1-5613-42ec-9784-32035fbd9938 None admin] Authenticating user token {{(pid=144068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:12:27.261895 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG dbcounter [-] [144068] Writing DB stats keystone:SELECT=100 {{(pid=144068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:12:27.292072 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6c40b1-5613-42ec-9784-32035fbd9938 None admin] Validating token access rules against request {{(pid=144068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:12:27.330977 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eea753c-544c-4a35-bf41-bfc1ba77cfe6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:12:27.332073 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eea753c-544c-4a35-bf41-bfc1ba77cfe6 None admin] REQUEST_METHOD: `GET` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:12:27.332558 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eea753c-544c-4a35-bf41-bfc1ba77cfe6 None admin] SCRIPT_NAME: `/identity` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:12:27.333053 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eea753c-544c-4a35-bf41-bfc1ba77cfe6 None admin] PATH_INFO: `/v3/services` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:12:27.333967 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eea753c-544c-4a35-bf41-bfc1ba77cfe6 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=144068) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:12:27.335941 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eea753c-544c-4a35-bf41-bfc1ba77cfe6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:12:27.338815 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eea753c-544c-4a35-bf41-bfc1ba77cfe6 None admin] RBAC: Authorization granted {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:12:27.355148 dv-cinder-851351-1-smb devstack@keystone.service[144068]: [pid: 144068|app: 0|req: 447/881] 10.222.0.42 () {56 vars in 1126 bytes} [Thu Jul 28 08:12:27 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:12:27.356899 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e32adf6-b247-4df8-9851-9e18e9eb4f39 None admin] Authenticating user token {{(pid=144067) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:12:27.461726 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e32adf6-b247-4df8-9851-9e18e9eb4f39 None admin] Validating token access rules against request {{(pid=144067) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:12:27.497636 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b517b4-448a-479f-84bc-0b23003201c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144067) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:12:27.498279 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b517b4-448a-479f-84bc-0b23003201c4 None admin] REQUEST_METHOD: `GET` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:12:27.498567 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b517b4-448a-479f-84bc-0b23003201c4 None admin] SCRIPT_NAME: `/identity` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:12:27.498847 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b517b4-448a-479f-84bc-0b23003201c4 None admin] PATH_INFO: `/v3/endpoints` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:12:27.499621 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b517b4-448a-479f-84bc-0b23003201c4 None admin] RBAC: Adding query filter params (interface=public, service_id=756483e73faf432bad250753c4b5f85c, region_id=RegionOne) {{(pid=144067) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:12:27.499941 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b517b4-448a-479f-84bc-0b23003201c4 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:12:27.501384 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b517b4-448a-479f-84bc-0b23003201c4 None admin] RBAC: Authorization granted {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:12:27.507121 dv-cinder-851351-1-smb devstack@keystone.service[144067]: [pid: 144067|app: 0|req: 435/882] 10.222.0.42 () {56 vars in 1251 bytes} [Thu Jul 28 08:12:27 2022] GET /identity/v3/endpoints?service_id=756483e73faf432bad250753c4b5f85c&interface=public®ion_id=RegionOne => generated 194 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:12:27.513095 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eea753c-544c-4a35-bf41-bfc1ba77cfe6 None admin] Authenticating user token {{(pid=144068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:12:27.628093 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eea753c-544c-4a35-bf41-bfc1ba77cfe6 None admin] Validating token access rules against request {{(pid=144068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:12:27.665336 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c833843-ac1a-4c79-96e6-b4eb2e38794a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:12:27.665974 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c833843-ac1a-4c79-96e6-b4eb2e38794a None admin] REQUEST_METHOD: `GET` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:12:27.666255 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c833843-ac1a-4c79-96e6-b4eb2e38794a None admin] SCRIPT_NAME: `/identity` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:12:27.666529 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c833843-ac1a-4c79-96e6-b4eb2e38794a None admin] PATH_INFO: `/v3/services` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:12:27.667358 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c833843-ac1a-4c79-96e6-b4eb2e38794a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:12:27.668766 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c833843-ac1a-4c79-96e6-b4eb2e38794a None admin] RBAC: Authorization granted {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:12:27.675481 dv-cinder-851351-1-smb devstack@keystone.service[144068]: [pid: 144068|app: 0|req: 448/883] 10.222.0.42 () {56 vars in 1087 bytes} [Thu Jul 28 08:12:27 2022] GET /identity/v3/services => generated 1268 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 08:12:28.265387 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc32d54-3634-4098-a09f-f74d2e82a564 None None] REQUEST_METHOD: `GET` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:12:28.265874 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc32d54-3634-4098-a09f-f74d2e82a564 None None] SCRIPT_NAME: `/identity` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:12:28.265874 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc32d54-3634-4098-a09f-f74d2e82a564 None None] PATH_INFO: `/` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:12:28.267496 dv-cinder-851351-1-smb devstack@keystone.service[144067]: [pid: 144067|app: 0|req: 436/884] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 08:12:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 08:12:28.273026 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6f308e-75d0-452d-b787-21706e922dcc None None] REQUEST_METHOD: `POST` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:12:28.273427 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6f308e-75d0-452d-b787-21706e922dcc None None] SCRIPT_NAME: `/identity` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:12:28.273590 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6f308e-75d0-452d-b787-21706e922dcc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:12:28.280017 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG dbcounter [-] [144068] Writing DB stats keystone:SELECT=100 {{(pid=144068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:12:28.292556 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.auth.core [None req-8b6f308e-75d0-452d-b787-21706e922dcc None None] MFA Rules not processed for user `bf5ceb8f07374635ad506b7d1b4f1612`. Rule list: `[]` (Enabled: `True`). {{(pid=144068) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 08:12:28.293785 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.fernet_utils [None req-8b6f308e-75d0-452d-b787-21706e922dcc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=144068) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:12:28.362989 dv-cinder-851351-1-smb devstack@keystone.service[144068]: [pid: 144068|app: 0|req: 449/885] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 08:12:28 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 08:12:28.384490 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc32d54-3634-4098-a09f-f74d2e82a564 None None] Authenticating user token {{(pid=144067) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:12:28.409818 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG dbcounter [-] [144067] Writing DB stats keystone:SELECT=100 {{(pid=144067) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:12:28.476000 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa0ef65-f44e-4852-b56f-1ce2423b308b None None] REQUEST_METHOD: `GET` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:12:28.476328 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa0ef65-f44e-4852-b56f-1ce2423b308b None None] SCRIPT_NAME: `/identity` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:12:28.476550 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa0ef65-f44e-4852-b56f-1ce2423b308b None None] PATH_INFO: `/` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:12:28.478236 dv-cinder-851351-1-smb devstack@keystone.service[144068]: [pid: 144068|app: 0|req: 450/886] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 08:12:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 28 08:12:28.483336 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14858944-98a6-4073-8197-130e68ad1e6d None None] REQUEST_METHOD: `POST` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:12:28.483624 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14858944-98a6-4073-8197-130e68ad1e6d None None] SCRIPT_NAME: `/identity` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:12:28.483900 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14858944-98a6-4073-8197-130e68ad1e6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:12:28.502446 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc32d54-3634-4098-a09f-f74d2e82a564 None None] Validating token access rules against request {{(pid=144067) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:12:28.503293 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.auth.core [None req-14858944-98a6-4073-8197-130e68ad1e6d None None] MFA Rules not processed for user `bf5ceb8f07374635ad506b7d1b4f1612`. Rule list: `[]` (Enabled: `True`). {{(pid=144068) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 08:12:28.506839 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.fernet_utils [None req-14858944-98a6-4073-8197-130e68ad1e6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=144068) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:12:28.539439 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f1925c-f9ce-4130-9f03-88893b5b51dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144067) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:12:28.540078 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f1925c-f9ce-4130-9f03-88893b5b51dc None admin] REQUEST_METHOD: `GET` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:12:28.540367 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f1925c-f9ce-4130-9f03-88893b5b51dc None admin] SCRIPT_NAME: `/identity` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:12:28.540644 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f1925c-f9ce-4130-9f03-88893b5b51dc None admin] PATH_INFO: `/v3/services/object-store` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:12:28.541369 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24f1925c-f9ce-4130-9f03-88893b5b51dc None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:12:28.542825 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24f1925c-f9ce-4130-9f03-88893b5b51dc None admin] RBAC: Authorization granted {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:12:28.552438 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application [None req-24f1925c-f9ce-4130-9f03-88893b5b51dc None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 28 08:12:28.552438 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:12:28.552438 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 28 08:12:28.552438 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 28 08:12:28.552438 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 28 08:12:28.552438 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 28 08:12:28.552438 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 28 08:12:28.552438 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 08:12:28.552438 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 28 08:12:28.552438 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application Jul 28 08:12:28.552438 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 28 08:12:28.552438 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application Jul 28 08:12:28.552438 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:12:28.552438 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:12:28.552438 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:12:28.552438 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:12:28.552438 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:12:28.553415 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:12:28.553415 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:12:28.553415 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:12:28.553415 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:12:28.553415 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:12:28.553415 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:12:28.553415 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 28 08:12:28.553415 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 28 08:12:28.553415 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 28 08:12:28.553415 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 28 08:12:28.553415 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:12:28.553415 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:12:28.553415 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:12:28.553415 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:12:28.553415 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:12:28.553415 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:12:28.554405 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:12:28.554405 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application with Lock( Jul 28 08:12:28.554405 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:12:28.554405 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:12:28.554405 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:12:28.554405 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:12:28.554405 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:12:28.554405 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:12:28.554405 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:12:28.554405 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:12:28.554405 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 28 08:12:28.554405 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 08:12:28.554405 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 28 08:12:28.554405 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application Jul 28 08:12:28.554405 dv-cinder-851351-1-smb devstack@keystone.service[144067]: [pid: 144067|app: 0|req: 437/887] 10.222.0.42 () {56 vars in 1126 bytes} [Thu Jul 28 08:12:28 2022] GET /identity/v3/services/object-store => generated 93 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:12:28.559634 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f1925c-f9ce-4130-9f03-88893b5b51dc None admin] Authenticating user token {{(pid=144067) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:12:28.595943 dv-cinder-851351-1-smb devstack@keystone.service[144068]: [pid: 144068|app: 0|req: 451/888] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 08:12:28 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 28 08:12:28.605556 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0483ae35-d038-4496-b46d-39fa181546e3 None None] REQUEST_METHOD: `GET` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:12:28.606028 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0483ae35-d038-4496-b46d-39fa181546e3 None None] SCRIPT_NAME: `/identity` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:12:28.606527 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0483ae35-d038-4496-b46d-39fa181546e3 None None] PATH_INFO: `/` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:12:28.609079 dv-cinder-851351-1-smb devstack@keystone.service[144068]: [pid: 144068|app: 0|req: 452/889] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 08:12:28 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 08:12:28.615154 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0483ae35-d038-4496-b46d-39fa181546e3 None None] Authenticating user token {{(pid=144068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:12:28.675681 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG dbcounter [-] [144067] Writing DB stats keystone:SELECT=100 {{(pid=144067) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:12:28.693887 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f1925c-f9ce-4130-9f03-88893b5b51dc None admin] Validating token access rules against request {{(pid=144067) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:12:28.698501 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG dbcounter [-] [144068] Writing DB stats keystone:SELECT=100 {{(pid=144068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:12:28.738281 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6b2855-5584-46ae-ad33-e8602485bde0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144067) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:12:28.738920 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6b2855-5584-46ae-ad33-e8602485bde0 None admin] REQUEST_METHOD: `GET` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:12:28.739220 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6b2855-5584-46ae-ad33-e8602485bde0 None admin] SCRIPT_NAME: `/identity` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:12:28.739480 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6b2855-5584-46ae-ad33-e8602485bde0 None admin] PATH_INFO: `/v3/services` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:12:28.740178 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de6b2855-5584-46ae-ad33-e8602485bde0 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=144067) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:12:28.740485 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de6b2855-5584-46ae-ad33-e8602485bde0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:12:28.741944 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de6b2855-5584-46ae-ad33-e8602485bde0 None admin] RBAC: Authorization granted {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:12:28.750358 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0483ae35-d038-4496-b46d-39fa181546e3 None None] Validating token access rules against request {{(pid=144068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:12:28.752205 dv-cinder-851351-1-smb devstack@keystone.service[144067]: [pid: 144067|app: 0|req: 438/890] 10.222.0.42 () {56 vars in 1122 bytes} [Thu Jul 28 08:12:28 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 08:12:28.753642 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981aa201-d1b6-4054-9f59-d774f9f90226 None None] REQUEST_METHOD: `POST` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:12:28.754019 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981aa201-d1b6-4054-9f59-d774f9f90226 None None] SCRIPT_NAME: `/identity` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:12:28.754377 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981aa201-d1b6-4054-9f59-d774f9f90226 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:12:28.775305 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.auth.core [None req-981aa201-d1b6-4054-9f59-d774f9f90226 None None] MFA Rules not processed for user `bf5ceb8f07374635ad506b7d1b4f1612`. Rule list: `[]` (Enabled: `True`). {{(pid=144067) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 08:12:28.776541 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.fernet_utils [None req-981aa201-d1b6-4054-9f59-d774f9f90226 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=144067) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:12:28.791728 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec75318-2109-44cb-9cf8-194be8e3c2ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:12:28.792318 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec75318-2109-44cb-9cf8-194be8e3c2ae None admin] REQUEST_METHOD: `GET` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:12:28.792594 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec75318-2109-44cb-9cf8-194be8e3c2ae None admin] SCRIPT_NAME: `/identity` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:12:28.792899 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec75318-2109-44cb-9cf8-194be8e3c2ae None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:12:28.793549 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ec75318-2109-44cb-9cf8-194be8e3c2ae None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:12:28.794937 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ec75318-2109-44cb-9cf8-194be8e3c2ae None admin] RBAC: Authorization granted {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:12:28.804223 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application [None req-2ec75318-2109-44cb-9cf8-194be8e3c2ae None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 28 08:12:28.804223 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:12:28.804223 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 28 08:12:28.804223 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 28 08:12:28.804223 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 28 08:12:28.804223 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 28 08:12:28.804223 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 28 08:12:28.804223 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 08:12:28.804223 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 28 08:12:28.804223 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application Jul 28 08:12:28.804223 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 28 08:12:28.804223 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application Jul 28 08:12:28.804223 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:12:28.804223 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:12:28.804223 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:12:28.804223 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:12:28.804223 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:12:28.805396 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:12:28.805396 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:12:28.805396 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:12:28.805396 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:12:28.805396 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:12:28.805396 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:12:28.805396 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 28 08:12:28.805396 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 28 08:12:28.805396 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 28 08:12:28.805396 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 28 08:12:28.805396 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:12:28.805396 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:12:28.805396 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:12:28.805396 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:12:28.805396 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:12:28.805396 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:12:28.811282 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:12:28.811282 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application with Lock( Jul 28 08:12:28.811282 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:12:28.811282 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:12:28.811282 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:12:28.811282 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:12:28.811282 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:12:28.811282 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:12:28.811282 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:12:28.811282 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:12:28.811282 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 28 08:12:28.811282 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 08:12:28.811282 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 28 08:12:28.811282 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application Jul 28 08:12:28.811282 dv-cinder-851351-1-smb devstack@keystone.service[144068]: [pid: 144068|app: 0|req: 453/891] 10.222.0.42 () {56 vars in 1114 bytes} [Thu Jul 28 08:12:28 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:12:28.812184 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec75318-2109-44cb-9cf8-194be8e3c2ae None admin] Authenticating user token {{(pid=144068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:12:28.868695 dv-cinder-851351-1-smb devstack@keystone.service[144067]: [pid: 144067|app: 0|req: 439/892] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 08:12:28 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 08:12:28.869969 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981aa201-d1b6-4054-9f59-d774f9f90226 None None] Authenticating user token {{(pid=144067) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:12:28.947128 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec75318-2109-44cb-9cf8-194be8e3c2ae None admin] Validating token access rules against request {{(pid=144068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:12:28.993309 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG dbcounter [-] [144068] Writing DB stats keystone:SELECT=100 {{(pid=144068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:12:28.994090 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG dbcounter [-] [144067] Writing DB stats keystone:SELECT=100 {{(pid=144067) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:12:29.015049 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d77398a-6cc3-4854-882f-1ce27942cd7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:12:29.016226 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d77398a-6cc3-4854-882f-1ce27942cd7a None admin] REQUEST_METHOD: `GET` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:12:29.016625 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d77398a-6cc3-4854-882f-1ce27942cd7a None admin] SCRIPT_NAME: `/identity` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:12:29.017344 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d77398a-6cc3-4854-882f-1ce27942cd7a None admin] PATH_INFO: `/v3/services` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:12:29.018440 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d77398a-6cc3-4854-882f-1ce27942cd7a None admin] RBAC: Adding query filter params (type=object-store) {{(pid=144068) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:12:29.018790 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d77398a-6cc3-4854-882f-1ce27942cd7a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:12:29.020081 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981aa201-d1b6-4054-9f59-d774f9f90226 None None] Validating token access rules against request {{(pid=144067) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:12:29.020427 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d77398a-6cc3-4854-882f-1ce27942cd7a None admin] RBAC: Authorization granted {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:12:29.028855 dv-cinder-851351-1-smb devstack@keystone.service[144068]: [pid: 144068|app: 0|req: 454/893] 10.222.0.42 () {56 vars in 1122 bytes} [Thu Jul 28 08:12:28 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:12:29.029762 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d77398a-6cc3-4854-882f-1ce27942cd7a None admin] Authenticating user token {{(pid=144068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:12:29.075408 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-210e0b7e-e707-4efa-a0e1-174829f57610 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144067) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:12:29.077927 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210e0b7e-e707-4efa-a0e1-174829f57610 None admin] REQUEST_METHOD: `GET` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:12:29.078727 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210e0b7e-e707-4efa-a0e1-174829f57610 None admin] SCRIPT_NAME: `/identity` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:12:29.079762 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210e0b7e-e707-4efa-a0e1-174829f57610 None admin] PATH_INFO: `/v3/services` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:12:29.080779 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-210e0b7e-e707-4efa-a0e1-174829f57610 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=144067) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:12:29.081771 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-210e0b7e-e707-4efa-a0e1-174829f57610 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:12:29.083806 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-210e0b7e-e707-4efa-a0e1-174829f57610 None admin] RBAC: Authorization granted {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:12:29.092484 dv-cinder-851351-1-smb devstack@keystone.service[144067]: [pid: 144067|app: 0|req: 440/894] 10.222.0.42 () {56 vars in 1114 bytes} [Thu Jul 28 08:12:28 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:12:29.098821 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-210e0b7e-e707-4efa-a0e1-174829f57610 None admin] Authenticating user token {{(pid=144067) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:12:29.154907 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d77398a-6cc3-4854-882f-1ce27942cd7a None admin] Validating token access rules against request {{(pid=144068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:12:29.204006 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd61042-3cd1-46d7-ae65-113df7155cdb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:12:29.204914 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd61042-3cd1-46d7-ae65-113df7155cdb None admin] REQUEST_METHOD: `GET` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:12:29.205305 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd61042-3cd1-46d7-ae65-113df7155cdb None admin] SCRIPT_NAME: `/identity` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:12:29.205694 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd61042-3cd1-46d7-ae65-113df7155cdb None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:12:29.218549 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bd61042-3cd1-46d7-ae65-113df7155cdb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 08:12:29.224559 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application [None req-0bd61042-3cd1-46d7-ae65-113df7155cdb None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 28 08:12:29.224559 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:12:29.224559 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:12:29.224559 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:12:29.224559 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:12:29.224559 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:12:29.224559 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:12:29.224559 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:12:29.224559 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:12:29.224559 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:12:29.224559 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:12:29.224559 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:12:29.224559 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 08:12:29.224559 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 08:12:29.224559 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 08:12:29.224559 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 08:12:29.225536 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 08:12:29.225536 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 08:12:29.225536 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 08:12:29.225536 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 08:12:29.225536 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:12:29.225536 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:12:29.225536 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:12:29.225536 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:12:29.225536 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:12:29.225536 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:12:29.225536 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:12:29.225536 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application with Lock( Jul 28 08:12:29.225536 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:12:29.225536 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:12:29.225536 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:12:29.225536 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:12:29.226278 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:12:29.226278 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:12:29.226278 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:12:29.226278 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:12:29.226278 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 08:12:29.226278 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 08:12:29.226278 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 08:12:29.226278 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 08:12:29.226278 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 08:12:29.226278 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 08:12:29.226278 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 28 08:12:29.226278 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application Jul 28 08:12:29.229822 dv-cinder-851351-1-smb devstack@keystone.service[144068]: [pid: 144068|app: 0|req: 455/895] 10.222.0.42 () {56 vars in 1120 bytes} [Thu Jul 28 08:12:29 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:12:29.232244 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd61042-3cd1-46d7-ae65-113df7155cdb None admin] Authenticating user token {{(pid=144068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:12:29.256651 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-210e0b7e-e707-4efa-a0e1-174829f57610 None admin] Validating token access rules against request {{(pid=144067) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:12:29.302404 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG dbcounter [-] [144068] Writing DB stats keystone:SELECT=100 {{(pid=144068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:12:29.305218 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0944aae-eea2-4c3d-a084-fd43df773b4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144067) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:12:29.305882 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0944aae-eea2-4c3d-a084-fd43df773b4d None admin] REQUEST_METHOD: `GET` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:12:29.306171 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0944aae-eea2-4c3d-a084-fd43df773b4d None admin] SCRIPT_NAME: `/identity` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:12:29.306450 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0944aae-eea2-4c3d-a084-fd43df773b4d None admin] PATH_INFO: `/v3/services` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:12:29.307296 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0944aae-eea2-4c3d-a084-fd43df773b4d None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=144067) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:12:29.307623 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0944aae-eea2-4c3d-a084-fd43df773b4d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:12:29.309444 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0944aae-eea2-4c3d-a084-fd43df773b4d None admin] RBAC: Authorization granted {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:12:29.321710 dv-cinder-851351-1-smb devstack@keystone.service[144067]: [pid: 144067|app: 0|req: 441/896] 10.222.0.42 () {56 vars in 1114 bytes} [Thu Jul 28 08:12:29 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 08:12:29.322946 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0944aae-eea2-4c3d-a084-fd43df773b4d None admin] Authenticating user token {{(pid=144067) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:12:29.336518 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG dbcounter [-] [144067] Writing DB stats keystone:SELECT=100 {{(pid=144067) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:12:29.374857 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd61042-3cd1-46d7-ae65-113df7155cdb None admin] Validating token access rules against request {{(pid=144068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:12:29.424256 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c660d5c-ba1d-493a-8409-1ae892a10c83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:12:29.425267 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c660d5c-ba1d-493a-8409-1ae892a10c83 None admin] REQUEST_METHOD: `GET` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:12:29.426061 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c660d5c-ba1d-493a-8409-1ae892a10c83 None admin] SCRIPT_NAME: `/identity` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:12:29.426514 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c660d5c-ba1d-493a-8409-1ae892a10c83 None admin] PATH_INFO: `/v3/roles` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:12:29.428059 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c660d5c-ba1d-493a-8409-1ae892a10c83 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=144068) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:12:29.428687 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c660d5c-ba1d-493a-8409-1ae892a10c83 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:12:29.430559 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c660d5c-ba1d-493a-8409-1ae892a10c83 None admin] RBAC: Authorization granted {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:12:29.448029 dv-cinder-851351-1-smb devstack@keystone.service[144068]: [pid: 144068|app: 0|req: 456/897] 10.222.0.42 () {56 vars in 1115 bytes} [Thu Jul 28 08:12:29 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:12:29.449051 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c660d5c-ba1d-493a-8409-1ae892a10c83 None admin] Authenticating user token {{(pid=144068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:12:29.453134 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0944aae-eea2-4c3d-a084-fd43df773b4d None admin] Validating token access rules against request {{(pid=144067) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:12:29.499771 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80bdc926-042c-40a1-9ef6-1ffa1dd32270 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144067) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:12:29.500590 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80bdc926-042c-40a1-9ef6-1ffa1dd32270 None admin] REQUEST_METHOD: `GET` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:12:29.500937 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80bdc926-042c-40a1-9ef6-1ffa1dd32270 None admin] SCRIPT_NAME: `/identity` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:12:29.501228 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80bdc926-042c-40a1-9ef6-1ffa1dd32270 None admin] PATH_INFO: `/v3/endpoints` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:12:29.502604 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80bdc926-042c-40a1-9ef6-1ffa1dd32270 None admin] RBAC: Adding query filter params (interface=public, service_id=f24733e5059d401e9c106d0a17524898, region_id=RegionOne) {{(pid=144067) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:12:29.502712 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80bdc926-042c-40a1-9ef6-1ffa1dd32270 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:12:29.504397 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80bdc926-042c-40a1-9ef6-1ffa1dd32270 None admin] RBAC: Authorization granted {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:12:29.516031 dv-cinder-851351-1-smb devstack@keystone.service[144067]: [pid: 144067|app: 0|req: 442/898] 10.222.0.42 () {56 vars in 1251 bytes} [Thu Jul 28 08:12:29 2022] GET /identity/v3/endpoints?service_id=f24733e5059d401e9c106d0a17524898&interface=public®ion_id=RegionOne => generated 194 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 08:12:29.517114 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80bdc926-042c-40a1-9ef6-1ffa1dd32270 None admin] Authenticating user token {{(pid=144067) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:12:29.582296 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c660d5c-ba1d-493a-8409-1ae892a10c83 None admin] Validating token access rules against request {{(pid=144068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:12:29.601397 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG dbcounter [-] [144068] Writing DB stats keystone:SELECT=100 {{(pid=144068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:12:29.608351 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG dbcounter [-] [144067] Writing DB stats keystone:SELECT=100 {{(pid=144067) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:12:29.634884 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f610eadc-649c-4942-a1c3-1ab1ded58d19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:12:29.635731 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f610eadc-649c-4942-a1c3-1ab1ded58d19 None admin] REQUEST_METHOD: `GET` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:12:29.636120 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f610eadc-649c-4942-a1c3-1ab1ded58d19 None admin] SCRIPT_NAME: `/identity` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:12:29.636501 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f610eadc-649c-4942-a1c3-1ab1ded58d19 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:12:29.648259 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80bdc926-042c-40a1-9ef6-1ffa1dd32270 None admin] Validating token access rules against request {{(pid=144067) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:12:29.652894 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f610eadc-649c-4942-a1c3-1ab1ded58d19 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:12:29.654590 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f610eadc-649c-4942-a1c3-1ab1ded58d19 None admin] RBAC: Authorization granted {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:12:29.674580 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application [None req-f610eadc-649c-4942-a1c3-1ab1ded58d19 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 08:12:29.674580 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:12:29.674580 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:12:29.674580 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:12:29.674580 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:12:29.674580 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:12:29.674580 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:12:29.674580 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:12:29.674580 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:12:29.674580 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:12:29.674580 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:12:29.674580 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:12:29.674580 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 08:12:29.674580 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 08:12:29.674580 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 08:12:29.675710 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 08:12:29.675710 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:12:29.675710 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:12:29.675710 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:12:29.675710 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:12:29.675710 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:12:29.675710 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:12:29.675710 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:12:29.675710 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application with Lock( Jul 28 08:12:29.675710 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:12:29.675710 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:12:29.675710 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:12:29.675710 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:12:29.675710 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:12:29.675710 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:12:29.675710 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:12:29.675710 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:12:29.676553 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 08:12:29.676553 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 08:12:29.676553 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 08:12:29.676553 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application Jul 28 08:12:29.681933 dv-cinder-851351-1-smb devstack@keystone.service[144068]: [pid: 144068|app: 0|req: 457/899] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 08:12:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 08:12:29.685535 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f610eadc-649c-4942-a1c3-1ab1ded58d19 None admin] Authenticating user token {{(pid=144068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:12:29.703750 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ab00c4-ec20-46e5-bd19-198b2fe5710f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144067) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:12:29.705071 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ab00c4-ec20-46e5-bd19-198b2fe5710f None admin] REQUEST_METHOD: `GET` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:12:29.706034 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ab00c4-ec20-46e5-bd19-198b2fe5710f None admin] SCRIPT_NAME: `/identity` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:12:29.706522 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ab00c4-ec20-46e5-bd19-198b2fe5710f None admin] PATH_INFO: `/v3/services` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:12:29.707848 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ab00c4-ec20-46e5-bd19-198b2fe5710f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:12:29.710202 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ab00c4-ec20-46e5-bd19-198b2fe5710f None admin] RBAC: Authorization granted {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:12:29.718998 dv-cinder-851351-1-smb devstack@keystone.service[144067]: [pid: 144067|app: 0|req: 443/900] 10.222.0.42 () {56 vars in 1087 bytes} [Thu Jul 28 08:12:29 2022] GET /identity/v3/services => generated 1268 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 08:12:29.830031 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f610eadc-649c-4942-a1c3-1ab1ded58d19 None admin] Validating token access rules against request {{(pid=144068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:12:29.876825 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3a4f23-4c11-4df1-adbd-bc43d4ff69fb None None] REQUEST_METHOD: `GET` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:12:29.877153 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3a4f23-4c11-4df1-adbd-bc43d4ff69fb None None] SCRIPT_NAME: `/identity` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:12:29.877335 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3a4f23-4c11-4df1-adbd-bc43d4ff69fb None None] PATH_INFO: `/` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:12:29.879997 dv-cinder-851351-1-smb devstack@keystone.service[144067]: [pid: 144067|app: 0|req: 444/901] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 08:12:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 28 08:12:29.882034 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f618ff6c-0952-4891-93ad-9555da39d54f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:12:29.882946 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f618ff6c-0952-4891-93ad-9555da39d54f None admin] REQUEST_METHOD: `GET` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:12:29.883430 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f618ff6c-0952-4891-93ad-9555da39d54f None admin] SCRIPT_NAME: `/identity` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:12:29.883939 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f618ff6c-0952-4891-93ad-9555da39d54f None admin] PATH_INFO: `/v3/domains` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:12:29.884915 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f618ff6c-0952-4891-93ad-9555da39d54f None admin] RBAC: Adding query filter params (name=Default) {{(pid=144068) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:12:29.885405 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1fc0d3-d859-42a0-8f49-abd6777265a3 None None] REQUEST_METHOD: `POST` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:12:29.885640 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f618ff6c-0952-4891-93ad-9555da39d54f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:12:29.885735 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1fc0d3-d859-42a0-8f49-abd6777265a3 None None] SCRIPT_NAME: `/identity` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:12:29.885961 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1fc0d3-d859-42a0-8f49-abd6777265a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:12:29.887773 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f618ff6c-0952-4891-93ad-9555da39d54f None admin] RBAC: Authorization granted {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:12:29.902473 dv-cinder-851351-1-smb devstack@keystone.service[144068]: [pid: 144068|app: 0|req: 458/902] 10.222.0.42 () {56 vars in 1109 bytes} [Thu Jul 28 08:12:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:12:29.908431 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f618ff6c-0952-4891-93ad-9555da39d54f None admin] Authenticating user token {{(pid=144068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:12:29.913230 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.auth.core [None req-ea1fc0d3-d859-42a0-8f49-abd6777265a3 None None] MFA Rules not processed for user `bf5ceb8f07374635ad506b7d1b4f1612`. Rule list: `[]` (Enabled: `True`). {{(pid=144067) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 08:12:29.914579 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.fernet_utils [None req-ea1fc0d3-d859-42a0-8f49-abd6777265a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=144067) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:12:29.946390 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG dbcounter [-] [144068] Writing DB stats keystone:SELECT=100 {{(pid=144068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:12:30.012780 dv-cinder-851351-1-smb devstack@keystone.service[144067]: [pid: 144067|app: 0|req: 445/903] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 08:12:29 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 28 08:12:30.037605 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1fc0d3-d859-42a0-8f49-abd6777265a3 None None] Authenticating user token {{(pid=144067) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:12:30.045395 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f618ff6c-0952-4891-93ad-9555da39d54f None admin] Validating token access rules against request {{(pid=144068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:12:30.087156 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73515241-ef20-40f4-b6f6-ef9849d98b20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:12:30.087821 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73515241-ef20-40f4-b6f6-ef9849d98b20 None admin] REQUEST_METHOD: `GET` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:12:30.088182 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73515241-ef20-40f4-b6f6-ef9849d98b20 None admin] SCRIPT_NAME: `/identity` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:12:30.088541 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73515241-ef20-40f4-b6f6-ef9849d98b20 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:12:30.098019 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73515241-ef20-40f4-b6f6-ef9849d98b20 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:12:30.099939 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73515241-ef20-40f4-b6f6-ef9849d98b20 None admin] RBAC: Authorization granted {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:12:30.115238 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application [None req-73515241-ef20-40f4-b6f6-ef9849d98b20 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 28 08:12:30.115238 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:12:30.115238 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:12:30.115238 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:12:30.115238 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:12:30.115238 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:12:30.115238 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:12:30.115238 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:12:30.115238 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:12:30.115238 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:12:30.115238 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:12:30.115238 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:12:30.115238 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 28 08:12:30.115238 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 28 08:12:30.115238 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 28 08:12:30.115238 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 28 08:12:30.116171 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:12:30.116171 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:12:30.116171 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 28 08:12:30.116171 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 08:12:30.116171 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 28 08:12:30.116171 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 08:12:30.116171 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:12:30.116171 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:12:30.116171 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:12:30.116171 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:12:30.116171 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:12:30.116171 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application with Lock( Jul 28 08:12:30.116171 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:12:30.116171 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:12:30.116171 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:12:30.116171 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:12:30.116171 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:12:30.116171 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:12:30.117102 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:12:30.117102 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:12:30.117102 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 28 08:12:30.117102 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 28 08:12:30.117102 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 28 08:12:30.117102 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 28 08:12:30.117102 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 28 08:12:30.117102 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 28 08:12:30.117102 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 28 08:12:30.117102 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application Jul 28 08:12:30.121837 dv-cinder-851351-1-smb devstack@keystone.service[144068]: [pid: 144068|app: 0|req: 459/904] 10.222.0.42 () {56 vars in 1117 bytes} [Thu Jul 28 08:12:29 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 08:12:30.123398 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73515241-ef20-40f4-b6f6-ef9849d98b20 None admin] Authenticating user token {{(pid=144068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:12:30.125100 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG dbcounter [-] [144067] Writing DB stats keystone:SELECT=100 {{(pid=144067) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:12:30.172031 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1fc0d3-d859-42a0-8f49-abd6777265a3 None None] Validating token access rules against request {{(pid=144067) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:12:30.215344 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc00d5d-a834-4fb7-a360-4a1cbf5f8e41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144067) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:12:30.216415 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc00d5d-a834-4fb7-a360-4a1cbf5f8e41 None admin] REQUEST_METHOD: `GET` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:12:30.216550 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc00d5d-a834-4fb7-a360-4a1cbf5f8e41 None admin] SCRIPT_NAME: `/identity` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:12:30.216865 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc00d5d-a834-4fb7-a360-4a1cbf5f8e41 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:12:30.217526 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cc00d5d-a834-4fb7-a360-4a1cbf5f8e41 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:12:30.218957 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cc00d5d-a834-4fb7-a360-4a1cbf5f8e41 None admin] RBAC: Authorization granted {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:12:30.219956 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG dbcounter [-] [144068] Writing DB stats keystone:SELECT=100 {{(pid=144068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:12:30.232025 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application [None req-0cc00d5d-a834-4fb7-a360-4a1cbf5f8e41 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 28 08:12:30.232025 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:12:30.232025 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 28 08:12:30.232025 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 28 08:12:30.232025 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 28 08:12:30.232025 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 28 08:12:30.232025 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 28 08:12:30.232025 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 08:12:30.232025 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 28 08:12:30.232025 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application Jul 28 08:12:30.232025 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 28 08:12:30.232025 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application Jul 28 08:12:30.232025 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:12:30.232025 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:12:30.232025 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:12:30.232025 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:12:30.233140 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:12:30.233140 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:12:30.233140 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:12:30.233140 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:12:30.233140 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:12:30.233140 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:12:30.233140 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:12:30.233140 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 28 08:12:30.233140 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 28 08:12:30.233140 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 28 08:12:30.233140 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 28 08:12:30.233140 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:12:30.233140 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:12:30.233140 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:12:30.233140 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:12:30.233140 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:12:30.234495 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:12:30.234495 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:12:30.234495 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application with Lock( Jul 28 08:12:30.234495 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:12:30.234495 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:12:30.234495 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:12:30.234495 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:12:30.234495 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:12:30.234495 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:12:30.234495 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:12:30.234495 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:12:30.234495 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 28 08:12:30.234495 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 08:12:30.234495 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 28 08:12:30.234495 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application Jul 28 08:12:30.239846 dv-cinder-851351-1-smb devstack@keystone.service[144067]: [pid: 144067|app: 0|req: 446/905] 10.222.0.42 () {56 vars in 1132 bytes} [Thu Jul 28 08:12:30 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:12:30.241564 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc00d5d-a834-4fb7-a360-4a1cbf5f8e41 None admin] Authenticating user token {{(pid=144067) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:12:30.248585 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73515241-ef20-40f4-b6f6-ef9849d98b20 None admin] Validating token access rules against request {{(pid=144068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:12:30.300236 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f07410e3-ee6a-4286-8580-7b8c8bf3f1c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:12:30.301607 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07410e3-ee6a-4286-8580-7b8c8bf3f1c9 None admin] REQUEST_METHOD: `GET` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:12:30.302200 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07410e3-ee6a-4286-8580-7b8c8bf3f1c9 None admin] SCRIPT_NAME: `/identity` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:12:30.302825 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07410e3-ee6a-4286-8580-7b8c8bf3f1c9 None admin] PATH_INFO: `/v3/users` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:12:30.304652 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f07410e3-ee6a-4286-8580-7b8c8bf3f1c9 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=144068) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:12:30.305714 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f07410e3-ee6a-4286-8580-7b8c8bf3f1c9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:12:30.308095 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f07410e3-ee6a-4286-8580-7b8c8bf3f1c9 None admin] RBAC: Authorization granted {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:12:30.332862 dv-cinder-851351-1-smb devstack@keystone.service[144068]: [pid: 144068|app: 0|req: 460/906] 10.222.0.42 () {56 vars in 1149 bytes} [Thu Jul 28 08:12:30 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:12:30.339815 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f07410e3-ee6a-4286-8580-7b8c8bf3f1c9 None admin] Authenticating user token {{(pid=144068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:12:30.376149 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc00d5d-a834-4fb7-a360-4a1cbf5f8e41 None admin] Validating token access rules against request {{(pid=144067) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:12:30.415101 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG dbcounter [-] [144067] Writing DB stats keystone:SELECT=100 {{(pid=144067) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:12:30.430427 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a7c0953-4be4-49e7-877f-97e7f6ec72ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144067) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:12:30.431547 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7c0953-4be4-49e7-877f-97e7f6ec72ff None admin] REQUEST_METHOD: `GET` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:12:30.432065 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7c0953-4be4-49e7-877f-97e7f6ec72ff None admin] SCRIPT_NAME: `/identity` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:12:30.432559 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7c0953-4be4-49e7-877f-97e7f6ec72ff None admin] PATH_INFO: `/v3/services` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:12:30.433595 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a7c0953-4be4-49e7-877f-97e7f6ec72ff None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=144067) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:12:30.434958 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a7c0953-4be4-49e7-877f-97e7f6ec72ff None admin] RBAC: Authorizing `identity:list_services()` {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:12:30.436962 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a7c0953-4be4-49e7-877f-97e7f6ec72ff None admin] RBAC: Authorization granted {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:12:30.457703 dv-cinder-851351-1-smb devstack@keystone.service[144067]: [pid: 144067|app: 0|req: 447/907] 10.222.0.42 () {56 vars in 1126 bytes} [Thu Jul 28 08:12:30 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:12:30.459036 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a7c0953-4be4-49e7-877f-97e7f6ec72ff None admin] Authenticating user token {{(pid=144067) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:12:30.517597 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f07410e3-ee6a-4286-8580-7b8c8bf3f1c9 None admin] Validating token access rules against request {{(pid=144068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:12:30.597572 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-409f24f4-adf7-4c03-ad52-ea56743442cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:12:30.598680 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409f24f4-adf7-4c03-ad52-ea56743442cb None admin] REQUEST_METHOD: `GET` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:12:30.599232 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409f24f4-adf7-4c03-ad52-ea56743442cb None admin] SCRIPT_NAME: `/identity` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:12:30.599746 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409f24f4-adf7-4c03-ad52-ea56743442cb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:12:30.622038 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG dbcounter [-] [144068] Writing DB stats keystone:SELECT=100 {{(pid=144068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:12:30.676585 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a7c0953-4be4-49e7-877f-97e7f6ec72ff None admin] Validating token access rules against request {{(pid=144067) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:12:30.747311 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-409f24f4-adf7-4c03-ad52-ea56743442cb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:12:30.748806 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-409f24f4-adf7-4c03-ad52-ea56743442cb None admin] RBAC: Authorization granted {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:12:30.755107 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91359970-de4b-4ab9-a014-5165b9f86200 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144067) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:12:30.755807 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91359970-de4b-4ab9-a014-5165b9f86200 None admin] REQUEST_METHOD: `GET` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:12:30.756100 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91359970-de4b-4ab9-a014-5165b9f86200 None admin] SCRIPT_NAME: `/identity` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:12:30.756380 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91359970-de4b-4ab9-a014-5165b9f86200 None admin] PATH_INFO: `/v3/services` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:12:30.760018 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91359970-de4b-4ab9-a014-5165b9f86200 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=144067) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:12:30.760018 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91359970-de4b-4ab9-a014-5165b9f86200 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:12:30.760018 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91359970-de4b-4ab9-a014-5165b9f86200 None admin] RBAC: Authorization granted {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:12:30.775989 dv-cinder-851351-1-smb devstack@keystone.service[144067]: [pid: 144067|app: 0|req: 448/908] 10.222.0.42 () {56 vars in 1126 bytes} [Thu Jul 28 08:12:30 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 312 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:12:30.777180 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91359970-de4b-4ab9-a014-5165b9f86200 None admin] Authenticating user token {{(pid=144067) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:12:30.876228 dv-cinder-851351-1-smb devstack@keystone.service[144068]: [pid: 144068|app: 0|req: 461/909] 10.222.0.42 () {58 vars in 1282 bytes} [Thu Jul 28 08:12:30 2022] GET /identity/v3/auth/tokens => generated 1362 bytes in 537 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 28 08:12:30.883553 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-409f24f4-adf7-4c03-ad52-ea56743442cb None admin] Authenticating user token {{(pid=144068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:12:30.895067 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG dbcounter [-] [144067] Writing DB stats keystone:SELECT=100 {{(pid=144067) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:12:30.989068 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG dbcounter [-] [144068] Writing DB stats keystone:SELECT=100 {{(pid=144068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:12:30.996947 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91359970-de4b-4ab9-a014-5165b9f86200 None admin] Validating token access rules against request {{(pid=144067) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:12:31.054560 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adfd6cf8-9fa0-41df-a391-4888dd4c12fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144067) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:12:31.055166 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adfd6cf8-9fa0-41df-a391-4888dd4c12fa None admin] REQUEST_METHOD: `POST` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:12:31.055450 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adfd6cf8-9fa0-41df-a391-4888dd4c12fa None admin] SCRIPT_NAME: `/identity` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:12:31.055732 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adfd6cf8-9fa0-41df-a391-4888dd4c12fa None admin] PATH_INFO: `/v3/endpoints` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:12:31.056473 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adfd6cf8-9fa0-41df-a391-4888dd4c12fa None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:12:31.057929 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adfd6cf8-9fa0-41df-a391-4888dd4c12fa None admin] RBAC: Authorization granted {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:12:31.074166 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-409f24f4-adf7-4c03-ad52-ea56743442cb None admin] Validating token access rules against request {{(pid=144068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:12:31.084230 dv-cinder-851351-1-smb devstack@keystone.service[144067]: [pid: 144067|app: 0|req: 449/910] 10.222.0.42 () {60 vars in 1144 bytes} [Thu Jul 28 08:12:30 2022] POST /identity/v3/endpoints => generated 347 bytes in 308 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 08:12:31.136288 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8acf7b7-c8b6-4825-9e24-3772fdfeb081 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:12:31.137121 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8acf7b7-c8b6-4825-9e24-3772fdfeb081 None admin] REQUEST_METHOD: `GET` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:12:31.137427 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8acf7b7-c8b6-4825-9e24-3772fdfeb081 None admin] SCRIPT_NAME: `/identity` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:12:31.137717 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8acf7b7-c8b6-4825-9e24-3772fdfeb081 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:12:31.151974 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8acf7b7-c8b6-4825-9e24-3772fdfeb081 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:12:31.153507 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8acf7b7-c8b6-4825-9e24-3772fdfeb081 None admin] RBAC: Authorization granted {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:12:31.172279 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application [None req-b8acf7b7-c8b6-4825-9e24-3772fdfeb081 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 08:12:31.172279 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:12:31.172279 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:12:31.172279 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:12:31.172279 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:12:31.172279 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:12:31.172279 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:12:31.172279 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:12:31.172279 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:12:31.172279 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:12:31.172279 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:12:31.172279 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:12:31.172279 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 08:12:31.172279 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 08:12:31.172279 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 08:12:31.173197 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 08:12:31.173197 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:12:31.173197 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:12:31.173197 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:12:31.173197 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:12:31.173197 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:12:31.173197 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:12:31.173197 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:12:31.173197 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application with Lock( Jul 28 08:12:31.173197 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:12:31.173197 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:12:31.173197 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:12:31.173197 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:12:31.173197 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:12:31.173197 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:12:31.173197 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:12:31.173197 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:12:31.174058 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 08:12:31.174058 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 08:12:31.174058 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 08:12:31.174058 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application Jul 28 08:12:31.174786 dv-cinder-851351-1-smb devstack@keystone.service[144068]: [pid: 144068|app: 0|req: 462/911] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 08:12:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 291 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 08:12:31.181112 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adfd6cf8-9fa0-41df-a391-4888dd4c12fa None admin] Authenticating user token {{(pid=144067) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:12:31.305889 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adfd6cf8-9fa0-41df-a391-4888dd4c12fa None admin] Validating token access rules against request {{(pid=144067) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:12:31.311861 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8958c7a5-5bcd-4d6d-b70c-4eb50f5e9b9b None None] REQUEST_METHOD: `GET` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:12:31.312355 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8958c7a5-5bcd-4d6d-b70c-4eb50f5e9b9b None None] SCRIPT_NAME: `/identity` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:12:31.312430 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8958c7a5-5bcd-4d6d-b70c-4eb50f5e9b9b None None] PATH_INFO: `/` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:12:31.313933 dv-cinder-851351-1-smb devstack@keystone.service[144068]: [pid: 144068|app: 0|req: 463/912] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 08:12:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 08:12:31.319408 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b6de2e-dc95-41b4-a196-2a3c3fd1d7f9 None None] REQUEST_METHOD: `POST` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:12:31.319942 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b6de2e-dc95-41b4-a196-2a3c3fd1d7f9 None None] SCRIPT_NAME: `/identity` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:12:31.320390 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b6de2e-dc95-41b4-a196-2a3c3fd1d7f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:12:31.325245 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG dbcounter [-] [144067] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=144067) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:12:31.344749 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.auth.core [None req-b1b6de2e-dc95-41b4-a196-2a3c3fd1d7f9 None None] MFA Rules not processed for user `bf5ceb8f07374635ad506b7d1b4f1612`. Rule list: `[]` (Enabled: `True`). {{(pid=144068) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 08:12:31.346337 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.fernet_utils [None req-b1b6de2e-dc95-41b4-a196-2a3c3fd1d7f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=144068) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:12:31.348206 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a5ffe1-5947-4a54-bdc8-81215f6bc3f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144067) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:12:31.348885 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a5ffe1-5947-4a54-bdc8-81215f6bc3f2 None admin] REQUEST_METHOD: `GET` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:12:31.349173 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a5ffe1-5947-4a54-bdc8-81215f6bc3f2 None admin] SCRIPT_NAME: `/identity` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:12:31.349491 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a5ffe1-5947-4a54-bdc8-81215f6bc3f2 None admin] PATH_INFO: `/v3/domains` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:12:31.350179 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07a5ffe1-5947-4a54-bdc8-81215f6bc3f2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=144067) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:12:31.350493 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07a5ffe1-5947-4a54-bdc8-81215f6bc3f2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:12:31.351976 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07a5ffe1-5947-4a54-bdc8-81215f6bc3f2 None admin] RBAC: Authorization granted {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:12:31.369083 dv-cinder-851351-1-smb devstack@keystone.service[144067]: [pid: 144067|app: 0|req: 450/913] 10.222.0.42 () {56 vars in 1109 bytes} [Thu Jul 28 08:12:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:12:31.370754 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a5ffe1-5947-4a54-bdc8-81215f6bc3f2 None admin] Authenticating user token {{(pid=144067) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:12:31.428843 dv-cinder-851351-1-smb devstack@keystone.service[144068]: [pid: 144068|app: 0|req: 464/914] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 08:12:31 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 28 08:12:31.451362 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b6de2e-dc95-41b4-a196-2a3c3fd1d7f9 None None] Authenticating user token {{(pid=144068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:12:31.477207 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG dbcounter [-] [144068] Writing DB stats keystone:SELECT=100 {{(pid=144068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:12:31.489483 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a5ffe1-5947-4a54-bdc8-81215f6bc3f2 None admin] Validating token access rules against request {{(pid=144067) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:12:31.525822 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-323034d3-748f-497a-9747-3567f1dc640f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144067) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:12:31.526464 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323034d3-748f-497a-9747-3567f1dc640f None admin] REQUEST_METHOD: `GET` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:12:31.526753 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323034d3-748f-497a-9747-3567f1dc640f None admin] SCRIPT_NAME: `/identity` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:12:31.527035 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323034d3-748f-497a-9747-3567f1dc640f None admin] PATH_INFO: `/v3/projects/service` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:12:31.534423 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-323034d3-748f-497a-9747-3567f1dc640f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:12:31.535958 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-323034d3-748f-497a-9747-3567f1dc640f None admin] RBAC: Authorization granted {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:12:31.547961 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application [None req-323034d3-748f-497a-9747-3567f1dc640f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 08:12:31.547961 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:12:31.547961 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:12:31.547961 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:12:31.547961 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:12:31.547961 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:12:31.547961 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:12:31.547961 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:12:31.547961 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:12:31.547961 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:12:31.547961 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:12:31.547961 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:12:31.547961 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 28 08:12:31.547961 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 28 08:12:31.547961 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 28 08:12:31.548938 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 28 08:12:31.548938 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:12:31.548938 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:12:31.548938 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:12:31.548938 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:12:31.548938 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:12:31.548938 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:12:31.548938 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:12:31.548938 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application with Lock( Jul 28 08:12:31.548938 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:12:31.548938 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:12:31.548938 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:12:31.548938 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:12:31.548938 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:12:31.548938 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:12:31.548938 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:12:31.548938 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:12:31.549755 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 28 08:12:31.549755 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 28 08:12:31.549755 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 28 08:12:31.549755 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 28 08:12:31.549755 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 28 08:12:31.549755 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 28 08:12:31.549755 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 08:12:31.549755 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application Jul 28 08:12:31.554303 dv-cinder-851351-1-smb devstack@keystone.service[144067]: [pid: 144067|app: 0|req: 451/915] 10.222.0.42 () {56 vars in 1111 bytes} [Thu Jul 28 08:12:31 2022] GET /identity/v3/projects/service => generated 88 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:12:31.555782 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-323034d3-748f-497a-9747-3567f1dc640f None admin] Authenticating user token {{(pid=144067) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:12:31.594041 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b6de2e-dc95-41b4-a196-2a3c3fd1d7f9 None None] Validating token access rules against request {{(pid=144068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:12:31.598840 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG dbcounter [-] [144067] Writing DB stats keystone:SELECT=100 {{(pid=144067) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:12:31.638618 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54498b1-19fd-4546-a3b7-2e7f728636fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:12:31.639450 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54498b1-19fd-4546-a3b7-2e7f728636fe None admin] REQUEST_METHOD: `POST` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:12:31.639805 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54498b1-19fd-4546-a3b7-2e7f728636fe None admin] SCRIPT_NAME: `/identity` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:12:31.640149 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54498b1-19fd-4546-a3b7-2e7f728636fe None admin] PATH_INFO: `/v3/services` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:12:31.641190 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c54498b1-19fd-4546-a3b7-2e7f728636fe None admin] RBAC: Authorizing `identity:create_service()` {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:12:31.642585 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c54498b1-19fd-4546-a3b7-2e7f728636fe None admin] RBAC: Authorization granted {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:12:31.668708 dv-cinder-851351-1-smb devstack@keystone.service[144068]: [pid: 144068|app: 0|req: 465/916] 10.222.0.42 () {60 vars in 1141 bytes} [Thu Jul 28 08:12:31 2022] POST /identity/v3/services => generated 241 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 08:12:31.693504 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-323034d3-748f-497a-9747-3567f1dc640f None admin] Validating token access rules against request {{(pid=144067) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:12:31.751765 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29da5136-77dd-443f-9b7a-0e255de005ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144067) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:12:31.752995 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29da5136-77dd-443f-9b7a-0e255de005ef None admin] REQUEST_METHOD: `GET` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:12:31.753534 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29da5136-77dd-443f-9b7a-0e255de005ef None admin] SCRIPT_NAME: `/identity` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:12:31.754010 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29da5136-77dd-443f-9b7a-0e255de005ef None admin] PATH_INFO: `/v3/projects` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:12:31.755530 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29da5136-77dd-443f-9b7a-0e255de005ef None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=144067) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:12:31.755907 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29da5136-77dd-443f-9b7a-0e255de005ef None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:12:31.758111 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29da5136-77dd-443f-9b7a-0e255de005ef None admin] RBAC: Authorization granted {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:12:31.784014 dv-cinder-851351-1-smb devstack@keystone.service[144067]: [pid: 144067|app: 0|req: 452/917] 10.222.0.42 () {56 vars in 1148 bytes} [Thu Jul 28 08:12:31 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:12:31.786952 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54498b1-19fd-4546-a3b7-2e7f728636fe None admin] Authenticating user token {{(pid=144068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:12:31.890611 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG dbcounter [-] [144068] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=144068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:12:31.913362 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54498b1-19fd-4546-a3b7-2e7f728636fe None admin] Validating token access rules against request {{(pid=144068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:12:31.949673 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8551de37-3057-40d4-9bbe-89463045bb03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:12:31.950311 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8551de37-3057-40d4-9bbe-89463045bb03 None admin] REQUEST_METHOD: `GET` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:12:31.950590 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8551de37-3057-40d4-9bbe-89463045bb03 None admin] SCRIPT_NAME: `/identity` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:12:31.950863 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8551de37-3057-40d4-9bbe-89463045bb03 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:12:31.951669 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8551de37-3057-40d4-9bbe-89463045bb03 None admin] RBAC: Adding query filter params (role.id=cfa933c7b37b473c8e22091c8b829530, scope.project.id=fa39ab7491e5413ca648e31ee9177fa0, user.id=64acbde3263f4bb8b102034fc3a9d4e6) {{(pid=144068) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:12:31.951981 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8551de37-3057-40d4-9bbe-89463045bb03 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:12:31.953545 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8551de37-3057-40d4-9bbe-89463045bb03 None admin] RBAC: Authorization granted {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:12:31.964854 dv-cinder-851351-1-smb devstack@keystone.service[144068]: [pid: 144068|app: 0|req: 466/918] 10.222.0.42 () {56 vars in 1374 bytes} [Thu Jul 28 08:12:31 2022] GET /identity/v3/role_assignments?user.id=64acbde3263f4bb8b102034fc3a9d4e6&scope.project.id=fa39ab7491e5413ca648e31ee9177fa0&role.id=cfa933c7b37b473c8e22091c8b829530 => generated 259 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 08:12:31.997491 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6710427-d6e2-4102-aa05-f9dbdaaa1619 None None] REQUEST_METHOD: `GET` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:12:31.997772 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6710427-d6e2-4102-aa05-f9dbdaaa1619 None None] SCRIPT_NAME: `/identity` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:12:31.998058 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6710427-d6e2-4102-aa05-f9dbdaaa1619 None None] PATH_INFO: `/` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:12:31.999864 dv-cinder-851351-1-smb devstack@keystone.service[144067]: [pid: 144067|app: 0|req: 453/919] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 08:12:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 08:12:32.005864 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694628fb-e18b-41fc-9f9e-54518af164ee None None] REQUEST_METHOD: `POST` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:12:32.006193 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694628fb-e18b-41fc-9f9e-54518af164ee None None] SCRIPT_NAME: `/identity` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:12:32.006474 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694628fb-e18b-41fc-9f9e-54518af164ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:12:32.027731 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.auth.core [None req-694628fb-e18b-41fc-9f9e-54518af164ee None None] MFA Rules not processed for user `bf5ceb8f07374635ad506b7d1b4f1612`. Rule list: `[]` (Enabled: `True`). {{(pid=144068) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 08:12:32.029125 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.fernet_utils [None req-694628fb-e18b-41fc-9f9e-54518af164ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=144068) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:12:32.122198 dv-cinder-851351-1-smb devstack@keystone.service[144068]: [pid: 144068|app: 0|req: 467/920] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 08:12:32 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 08:12:32.144515 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6710427-d6e2-4102-aa05-f9dbdaaa1619 None None] Authenticating user token {{(pid=144067) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:12:32.294910 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG dbcounter [-] [144067] Writing DB stats keystone:SELECT=100 {{(pid=144067) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:12:32.307522 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6710427-d6e2-4102-aa05-f9dbdaaa1619 None None] Validating token access rules against request {{(pid=144067) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:12:32.346800 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494df2c0-f9f0-427e-ad98-3fcff4ea50c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144067) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:12:32.347824 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494df2c0-f9f0-427e-ad98-3fcff4ea50c2 None admin] REQUEST_METHOD: `GET` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:12:32.348291 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494df2c0-f9f0-427e-ad98-3fcff4ea50c2 None admin] SCRIPT_NAME: `/identity` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:12:32.348803 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494df2c0-f9f0-427e-ad98-3fcff4ea50c2 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:12:32.349688 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-494df2c0-f9f0-427e-ad98-3fcff4ea50c2 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:12:32.351335 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-494df2c0-f9f0-427e-ad98-3fcff4ea50c2 None admin] RBAC: Authorization granted {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:12:32.361379 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application [None req-494df2c0-f9f0-427e-ad98-3fcff4ea50c2 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 28 08:12:32.361379 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:12:32.361379 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 28 08:12:32.361379 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 28 08:12:32.361379 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 28 08:12:32.361379 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 28 08:12:32.361379 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 28 08:12:32.361379 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 08:12:32.361379 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 28 08:12:32.361379 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application Jul 28 08:12:32.361379 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 28 08:12:32.361379 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application Jul 28 08:12:32.361379 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:12:32.361379 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:12:32.361379 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:12:32.361379 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:12:32.361379 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:12:32.362339 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:12:32.362339 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:12:32.362339 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:12:32.362339 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:12:32.362339 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:12:32.362339 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:12:32.362339 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 28 08:12:32.362339 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 28 08:12:32.362339 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 28 08:12:32.362339 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 28 08:12:32.362339 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:12:32.362339 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:12:32.362339 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:12:32.362339 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:12:32.362339 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:12:32.362339 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:12:32.363152 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:12:32.363152 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application with Lock( Jul 28 08:12:32.363152 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:12:32.363152 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:12:32.363152 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:12:32.363152 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:12:32.363152 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:12:32.363152 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:12:32.363152 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:12:32.363152 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:12:32.363152 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 28 08:12:32.363152 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 08:12:32.363152 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 28 08:12:32.363152 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application Jul 28 08:12:32.365592 dv-cinder-851351-1-smb devstack@keystone.service[144067]: [pid: 144067|app: 0|req: 454/921] 10.222.0.42 () {56 vars in 1114 bytes} [Thu Jul 28 08:12:32 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:12:32.374070 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694628fb-e18b-41fc-9f9e-54518af164ee None None] Authenticating user token {{(pid=144068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:12:32.476419 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG dbcounter [-] [144068] Writing DB stats keystone:SELECT=100 {{(pid=144068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:12:32.504045 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694628fb-e18b-41fc-9f9e-54518af164ee None None] Validating token access rules against request {{(pid=144068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:12:32.540959 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87cc9aa1-23ef-4758-9781-a370834a84a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:12:32.541831 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87cc9aa1-23ef-4758-9781-a370834a84a8 None admin] REQUEST_METHOD: `GET` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:12:32.542248 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87cc9aa1-23ef-4758-9781-a370834a84a8 None admin] SCRIPT_NAME: `/identity` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:12:32.542762 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87cc9aa1-23ef-4758-9781-a370834a84a8 None admin] PATH_INFO: `/v3/services` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:12:32.543582 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87cc9aa1-23ef-4758-9781-a370834a84a8 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=144068) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:12:32.544046 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87cc9aa1-23ef-4758-9781-a370834a84a8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:12:32.545578 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87cc9aa1-23ef-4758-9781-a370834a84a8 None admin] RBAC: Authorization granted {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:12:32.551256 dv-cinder-851351-1-smb devstack@keystone.service[144068]: [pid: 144068|app: 0|req: 468/922] 10.222.0.42 () {56 vars in 1114 bytes} [Thu Jul 28 08:12:32 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:12:32.556922 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494df2c0-f9f0-427e-ad98-3fcff4ea50c2 None admin] Authenticating user token {{(pid=144067) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:12:32.662686 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494df2c0-f9f0-427e-ad98-3fcff4ea50c2 None admin] Validating token access rules against request {{(pid=144067) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:12:32.698254 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df9a361-8b36-467f-bd02-743e05767c51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144067) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:12:32.699144 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df9a361-8b36-467f-bd02-743e05767c51 None admin] REQUEST_METHOD: `GET` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:12:32.699560 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df9a361-8b36-467f-bd02-743e05767c51 None admin] SCRIPT_NAME: `/identity` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:12:32.699969 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df9a361-8b36-467f-bd02-743e05767c51 None admin] PATH_INFO: `/v3/services` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:12:32.700855 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3df9a361-8b36-467f-bd02-743e05767c51 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=144067) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:12:32.701329 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3df9a361-8b36-467f-bd02-743e05767c51 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:12:32.702913 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3df9a361-8b36-467f-bd02-743e05767c51 None admin] RBAC: Authorization granted {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:12:32.708769 dv-cinder-851351-1-smb devstack@keystone.service[144067]: [pid: 144067|app: 0|req: 455/923] 10.222.0.42 () {56 vars in 1114 bytes} [Thu Jul 28 08:12:32 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:12:32.715357 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87cc9aa1-23ef-4758-9781-a370834a84a8 None admin] Authenticating user token {{(pid=144068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:12:32.836829 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87cc9aa1-23ef-4758-9781-a370834a84a8 None admin] Validating token access rules against request {{(pid=144068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:12:32.873815 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe6561fa-f8d7-45fa-8970-ef092a812c7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:12:32.874806 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6561fa-f8d7-45fa-8970-ef092a812c7c None admin] REQUEST_METHOD: `POST` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:12:32.875290 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6561fa-f8d7-45fa-8970-ef092a812c7c None admin] SCRIPT_NAME: `/identity` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:12:32.875763 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6561fa-f8d7-45fa-8970-ef092a812c7c None admin] PATH_INFO: `/v3/endpoints` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:12:32.876742 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe6561fa-f8d7-45fa-8970-ef092a812c7c None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:12:32.878350 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe6561fa-f8d7-45fa-8970-ef092a812c7c None admin] RBAC: Authorization granted {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:12:32.893147 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG dbcounter [-] [144068] Writing DB stats keystone:SELECT=100 {{(pid=144068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:12:32.909244 dv-cinder-851351-1-smb devstack@keystone.service[144068]: [pid: 144068|app: 0|req: 469/924] 10.222.0.42 () {60 vars in 1144 bytes} [Thu Jul 28 08:12:32 2022] POST /identity/v3/endpoints => generated 346 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 08:12:33.407017 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b0a2f5-187c-4363-bd7f-da81337c8ea5 None None] REQUEST_METHOD: `GET` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:12:33.407404 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b0a2f5-187c-4363-bd7f-da81337c8ea5 None None] SCRIPT_NAME: `/identity` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:12:33.407604 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b0a2f5-187c-4363-bd7f-da81337c8ea5 None None] PATH_INFO: `/` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:12:33.409258 dv-cinder-851351-1-smb devstack@keystone.service[144067]: [pid: 144067|app: 0|req: 456/925] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 08:12:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 08:12:33.414789 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2875797-4590-4948-b33c-7a1d40f80a22 None None] REQUEST_METHOD: `POST` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:12:33.415269 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2875797-4590-4948-b33c-7a1d40f80a22 None None] SCRIPT_NAME: `/identity` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:12:33.415340 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2875797-4590-4948-b33c-7a1d40f80a22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:12:33.435844 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.auth.core [None req-d2875797-4590-4948-b33c-7a1d40f80a22 None None] MFA Rules not processed for user `bf5ceb8f07374635ad506b7d1b4f1612`. Rule list: `[]` (Enabled: `True`). {{(pid=144068) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 08:12:33.437104 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.fernet_utils [None req-d2875797-4590-4948-b33c-7a1d40f80a22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=144068) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:12:33.517682 dv-cinder-851351-1-smb devstack@keystone.service[144068]: [pid: 144068|app: 0|req: 470/926] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 08:12:33 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 08:12:33.538967 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b0a2f5-187c-4363-bd7f-da81337c8ea5 None None] Authenticating user token {{(pid=144067) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:12:33.561024 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG dbcounter [-] [144067] Writing DB stats keystone:SELECT=100 {{(pid=144067) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:12:33.651365 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b0a2f5-187c-4363-bd7f-da81337c8ea5 None None] Validating token access rules against request {{(pid=144067) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:12:33.687119 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b1d1f7-e811-4655-9993-684e38ef86be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144067) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:12:33.687705 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b1d1f7-e811-4655-9993-684e38ef86be None admin] REQUEST_METHOD: `GET` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:12:33.687979 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b1d1f7-e811-4655-9993-684e38ef86be None admin] SCRIPT_NAME: `/identity` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:12:33.688252 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b1d1f7-e811-4655-9993-684e38ef86be None admin] PATH_INFO: `/v3/services/compute` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:12:33.688959 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b1d1f7-e811-4655-9993-684e38ef86be None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:12:33.690367 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b1d1f7-e811-4655-9993-684e38ef86be None admin] RBAC: Authorization granted {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:12:33.700770 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application [None req-35b1d1f7-e811-4655-9993-684e38ef86be None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jul 28 08:12:33.700770 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:12:33.700770 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 28 08:12:33.700770 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 28 08:12:33.700770 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 28 08:12:33.700770 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 28 08:12:33.700770 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 28 08:12:33.700770 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 08:12:33.700770 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 28 08:12:33.700770 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application Jul 28 08:12:33.700770 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 28 08:12:33.700770 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application Jul 28 08:12:33.700770 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:12:33.700770 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:12:33.700770 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:12:33.700770 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:12:33.700770 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:12:33.701936 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:12:33.701936 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:12:33.701936 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:12:33.701936 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:12:33.701936 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:12:33.701936 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:12:33.701936 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 28 08:12:33.701936 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 28 08:12:33.701936 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 28 08:12:33.701936 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 28 08:12:33.701936 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:12:33.701936 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:12:33.701936 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:12:33.701936 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:12:33.701936 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:12:33.701936 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:12:33.702678 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:12:33.702678 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application with Lock( Jul 28 08:12:33.702678 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:12:33.702678 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:12:33.702678 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:12:33.702678 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:12:33.702678 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:12:33.702678 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:12:33.702678 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:12:33.702678 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:12:33.702678 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 28 08:12:33.702678 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 08:12:33.702678 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 28 08:12:33.702678 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application Jul 28 08:12:33.702678 dv-cinder-851351-1-smb devstack@keystone.service[144067]: [pid: 144067|app: 0|req: 457/927] 10.222.0.42 () {56 vars in 1111 bytes} [Thu Jul 28 08:12:33 2022] GET /identity/v3/services/compute => generated 88 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:12:33.708822 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2875797-4590-4948-b33c-7a1d40f80a22 None None] Authenticating user token {{(pid=144068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:12:33.817914 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2875797-4590-4948-b33c-7a1d40f80a22 None None] Validating token access rules against request {{(pid=144068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:12:33.821098 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b48439-d095-470a-be18-c4e99323d720 None None] REQUEST_METHOD: `GET` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:12:33.821381 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b48439-d095-470a-be18-c4e99323d720 None None] SCRIPT_NAME: `/identity` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:12:33.822271 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b48439-d095-470a-be18-c4e99323d720 None None] PATH_INFO: `/` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:12:33.823972 dv-cinder-851351-1-smb devstack@keystone.service[144067]: [pid: 144067|app: 0|req: 458/928] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 08:12:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 28 08:12:33.831819 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98cd9cf-2503-46cd-b300-e42b9a24d2ef None None] REQUEST_METHOD: `POST` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:12:33.832104 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98cd9cf-2503-46cd-b300-e42b9a24d2ef None None] SCRIPT_NAME: `/identity` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:12:33.832379 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98cd9cf-2503-46cd-b300-e42b9a24d2ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:12:33.843909 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG dbcounter [-] [144068] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=144068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:12:33.859575 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.auth.core [None req-e98cd9cf-2503-46cd-b300-e42b9a24d2ef None None] MFA Rules not processed for user `bf5ceb8f07374635ad506b7d1b4f1612`. Rule list: `[]` (Enabled: `True`). {{(pid=144067) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 08:12:33.861989 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.fernet_utils [None req-e98cd9cf-2503-46cd-b300-e42b9a24d2ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=144067) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:12:33.879696 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe88d799-5f79-4aca-973c-9bc2a12f67dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:12:33.880349 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe88d799-5f79-4aca-973c-9bc2a12f67dc None admin] REQUEST_METHOD: `GET` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:12:33.880640 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe88d799-5f79-4aca-973c-9bc2a12f67dc None admin] SCRIPT_NAME: `/identity` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:12:33.880958 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe88d799-5f79-4aca-973c-9bc2a12f67dc None admin] PATH_INFO: `/v3/services` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:12:33.881652 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe88d799-5f79-4aca-973c-9bc2a12f67dc None admin] RBAC: Adding query filter params (name=compute) {{(pid=144068) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:12:33.881963 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe88d799-5f79-4aca-973c-9bc2a12f67dc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:12:33.883359 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe88d799-5f79-4aca-973c-9bc2a12f67dc None admin] RBAC: Authorization granted {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:12:33.888869 dv-cinder-851351-1-smb devstack@keystone.service[144068]: [pid: 144068|app: 0|req: 471/929] 10.222.0.42 () {56 vars in 1112 bytes} [Thu Jul 28 08:12:33 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:12:33.894730 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe88d799-5f79-4aca-973c-9bc2a12f67dc None admin] Authenticating user token {{(pid=144068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:12:33.957178 dv-cinder-851351-1-smb devstack@keystone.service[144067]: [pid: 144067|app: 0|req: 459/930] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 08:12:33 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 28 08:12:33.979234 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98cd9cf-2503-46cd-b300-e42b9a24d2ef None None] Authenticating user token {{(pid=144067) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:12:33.999752 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG dbcounter [-] [144067] Writing DB stats keystone:SELECT=100 {{(pid=144067) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:12:34.012559 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe88d799-5f79-4aca-973c-9bc2a12f67dc None admin] Validating token access rules against request {{(pid=144068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:12:34.048223 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821dbc57-59db-44ad-80d2-ab45b7892371 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:12:34.048895 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821dbc57-59db-44ad-80d2-ab45b7892371 None admin] REQUEST_METHOD: `GET` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:12:34.049182 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821dbc57-59db-44ad-80d2-ab45b7892371 None admin] SCRIPT_NAME: `/identity` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:12:34.049456 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821dbc57-59db-44ad-80d2-ab45b7892371 None admin] PATH_INFO: `/v3/services` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:12:34.050155 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-821dbc57-59db-44ad-80d2-ab45b7892371 None admin] RBAC: Adding query filter params (type=compute) {{(pid=144068) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:12:34.050537 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-821dbc57-59db-44ad-80d2-ab45b7892371 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:12:34.051919 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-821dbc57-59db-44ad-80d2-ab45b7892371 None admin] RBAC: Authorization granted {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:12:34.064841 dv-cinder-851351-1-smb devstack@keystone.service[144068]: [pid: 144068|app: 0|req: 472/931] 10.222.0.42 () {56 vars in 1112 bytes} [Thu Jul 28 08:12:33 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 08:12:34.102071 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98cd9cf-2503-46cd-b300-e42b9a24d2ef None None] Validating token access rules against request {{(pid=144067) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:12:34.144188 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06514f2c-b9f9-4c80-9391-aa3b76902c6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144067) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:12:34.144932 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06514f2c-b9f9-4c80-9391-aa3b76902c6f None admin] REQUEST_METHOD: `GET` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:12:34.145222 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06514f2c-b9f9-4c80-9391-aa3b76902c6f None admin] SCRIPT_NAME: `/identity` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:12:34.145506 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06514f2c-b9f9-4c80-9391-aa3b76902c6f None admin] PATH_INFO: `/v3/services/object-store` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:12:34.146190 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06514f2c-b9f9-4c80-9391-aa3b76902c6f None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:12:34.147682 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06514f2c-b9f9-4c80-9391-aa3b76902c6f None admin] RBAC: Authorization granted {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:12:34.157971 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application [None req-06514f2c-b9f9-4c80-9391-aa3b76902c6f None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 28 08:12:34.157971 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:12:34.157971 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 28 08:12:34.157971 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 28 08:12:34.157971 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 28 08:12:34.157971 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 28 08:12:34.157971 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 28 08:12:34.157971 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 08:12:34.157971 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 28 08:12:34.157971 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application Jul 28 08:12:34.157971 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 28 08:12:34.157971 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application Jul 28 08:12:34.157971 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:12:34.157971 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:12:34.157971 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:12:34.157971 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:12:34.157971 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:12:34.158943 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:12:34.158943 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:12:34.158943 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:12:34.158943 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:12:34.158943 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:12:34.158943 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:12:34.158943 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 28 08:12:34.158943 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 28 08:12:34.158943 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 28 08:12:34.158943 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 28 08:12:34.158943 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:12:34.158943 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:12:34.158943 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:12:34.158943 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:12:34.158943 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:12:34.158943 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:12:34.159749 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:12:34.159749 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application with Lock( Jul 28 08:12:34.159749 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:12:34.159749 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:12:34.159749 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:12:34.159749 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:12:34.159749 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:12:34.159749 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:12:34.159749 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:12:34.159749 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:12:34.159749 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 28 08:12:34.159749 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 08:12:34.159749 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 28 08:12:34.159749 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application Jul 28 08:12:34.159749 dv-cinder-851351-1-smb devstack@keystone.service[144067]: [pid: 144067|app: 0|req: 460/932] 10.222.0.42 () {56 vars in 1126 bytes} [Thu Jul 28 08:12:33 2022] GET /identity/v3/services/object-store => generated 93 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:12:34.167021 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821dbc57-59db-44ad-80d2-ab45b7892371 None admin] Authenticating user token {{(pid=144068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:12:34.227297 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG dbcounter [-] [144068] Writing DB stats keystone:SELECT=100 {{(pid=144068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:12:34.237013 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1049438-2114-4d0f-8446-dc9c5a2ca667 None None] REQUEST_METHOD: `GET` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:12:34.237294 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1049438-2114-4d0f-8446-dc9c5a2ca667 None None] SCRIPT_NAME: `/identity` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:12:34.237580 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1049438-2114-4d0f-8446-dc9c5a2ca667 None None] PATH_INFO: `/` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:12:34.239028 dv-cinder-851351-1-smb devstack@keystone.service[144067]: [pid: 144067|app: 0|req: 461/933] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 08:12:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 08:12:34.244299 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e74dda6-8142-4748-a917-8e205d9c1e16 None None] REQUEST_METHOD: `POST` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:12:34.244590 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e74dda6-8142-4748-a917-8e205d9c1e16 None None] SCRIPT_NAME: `/identity` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:12:34.246167 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e74dda6-8142-4748-a917-8e205d9c1e16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:12:34.267869 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.auth.core [None req-9e74dda6-8142-4748-a917-8e205d9c1e16 None None] MFA Rules not processed for user `bf5ceb8f07374635ad506b7d1b4f1612`. Rule list: `[]` (Enabled: `True`). {{(pid=144067) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 08:12:34.268993 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.fernet_utils [None req-9e74dda6-8142-4748-a917-8e205d9c1e16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=144067) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:12:34.295266 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821dbc57-59db-44ad-80d2-ab45b7892371 None admin] Validating token access rules against request {{(pid=144068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:12:34.338814 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b620455-92b3-4eb7-9890-dc8ac1afc112 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:12:34.339747 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b620455-92b3-4eb7-9890-dc8ac1afc112 None admin] REQUEST_METHOD: `GET` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:12:34.340040 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b620455-92b3-4eb7-9890-dc8ac1afc112 None admin] SCRIPT_NAME: `/identity` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:12:34.340321 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b620455-92b3-4eb7-9890-dc8ac1afc112 None admin] PATH_INFO: `/v3/services` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:12:34.341049 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b620455-92b3-4eb7-9890-dc8ac1afc112 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=144068) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:12:34.341360 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b620455-92b3-4eb7-9890-dc8ac1afc112 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:12:34.343226 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b620455-92b3-4eb7-9890-dc8ac1afc112 None admin] RBAC: Authorization granted {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:12:34.348193 dv-cinder-851351-1-smb devstack@keystone.service[144067]: [pid: 144067|app: 0|req: 462/934] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 08:12:34 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 28 08:12:34.353394 dv-cinder-851351-1-smb devstack@keystone.service[144068]: [pid: 144068|app: 0|req: 473/935] 10.222.0.42 () {56 vars in 1122 bytes} [Thu Jul 28 08:12:34 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:12:34.354513 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e74dda6-8142-4748-a917-8e205d9c1e16 None None] Authenticating user token {{(pid=144067) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:12:34.368122 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG dbcounter [-] [144067] Writing DB stats keystone:SELECT=100 {{(pid=144067) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:12:34.370470 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b620455-92b3-4eb7-9890-dc8ac1afc112 None admin] Authenticating user token {{(pid=144068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:12:34.474749 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e74dda6-8142-4748-a917-8e205d9c1e16 None None] Validating token access rules against request {{(pid=144067) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:12:34.500423 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b620455-92b3-4eb7-9890-dc8ac1afc112 None admin] Validating token access rules against request {{(pid=144068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:12:34.512978 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405a6e6c-ded5-497f-8033-ea441dc66af1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144067) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:12:34.513973 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405a6e6c-ded5-497f-8033-ea441dc66af1 None admin] REQUEST_METHOD: `GET` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:12:34.514448 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405a6e6c-ded5-497f-8033-ea441dc66af1 None admin] SCRIPT_NAME: `/identity` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:12:34.514915 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405a6e6c-ded5-497f-8033-ea441dc66af1 None admin] PATH_INFO: `/v3/services` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:12:34.515836 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-405a6e6c-ded5-497f-8033-ea441dc66af1 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=144067) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:12:34.516336 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-405a6e6c-ded5-497f-8033-ea441dc66af1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:12:34.517934 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG dbcounter [-] [144068] Writing DB stats keystone:SELECT=100 {{(pid=144068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:12:34.518551 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-405a6e6c-ded5-497f-8033-ea441dc66af1 None admin] RBAC: Authorization granted {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:12:34.529967 dv-cinder-851351-1-smb devstack@keystone.service[144067]: [pid: 144067|app: 0|req: 463/936] 10.222.0.42 () {56 vars in 1122 bytes} [Thu Jul 28 08:12:34 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:12:34.531239 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405a6e6c-ded5-497f-8033-ea441dc66af1 None admin] Authenticating user token {{(pid=144067) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:12:34.546319 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd25eecc-4ed4-4820-b6d6-944293413c52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:12:34.547004 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd25eecc-4ed4-4820-b6d6-944293413c52 None admin] REQUEST_METHOD: `GET` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:12:34.547284 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd25eecc-4ed4-4820-b6d6-944293413c52 None admin] SCRIPT_NAME: `/identity` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:12:34.547562 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd25eecc-4ed4-4820-b6d6-944293413c52 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:12:34.562924 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd25eecc-4ed4-4820-b6d6-944293413c52 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 08:12:34.570136 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application [None req-bd25eecc-4ed4-4820-b6d6-944293413c52 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 28 08:12:34.570136 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:12:34.570136 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:12:34.570136 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:12:34.570136 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:12:34.570136 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:12:34.570136 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:12:34.570136 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:12:34.570136 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:12:34.570136 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:12:34.570136 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:12:34.570136 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:12:34.570136 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 08:12:34.570136 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 08:12:34.570136 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 08:12:34.570136 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 08:12:34.570999 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 08:12:34.570999 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 08:12:34.570999 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 08:12:34.570999 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 08:12:34.570999 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:12:34.570999 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:12:34.570999 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:12:34.570999 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:12:34.570999 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:12:34.570999 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:12:34.570999 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:12:34.570999 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application with Lock( Jul 28 08:12:34.570999 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:12:34.570999 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:12:34.570999 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:12:34.570999 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:12:34.571823 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:12:34.571823 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:12:34.571823 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:12:34.571823 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:12:34.571823 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 08:12:34.571823 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 08:12:34.571823 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 08:12:34.571823 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 08:12:34.571823 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 08:12:34.571823 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 08:12:34.571823 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 28 08:12:34.571823 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application Jul 28 08:12:34.575129 dv-cinder-851351-1-smb devstack@keystone.service[144068]: [pid: 144068|app: 0|req: 474/937] 10.222.0.42 () {56 vars in 1120 bytes} [Thu Jul 28 08:12:34 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:12:34.580996 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd25eecc-4ed4-4820-b6d6-944293413c52 None admin] Authenticating user token {{(pid=144068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:12:34.620771 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG dbcounter [-] [144067] Writing DB stats keystone:SELECT=100 {{(pid=144067) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:12:34.660795 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405a6e6c-ded5-497f-8033-ea441dc66af1 None admin] Validating token access rules against request {{(pid=144067) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:12:34.705250 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34a380d-e1f2-475f-8689-8c42f8d63e4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144067) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:12:34.706313 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34a380d-e1f2-475f-8689-8c42f8d63e4c None admin] REQUEST_METHOD: `GET` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:12:34.706873 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34a380d-e1f2-475f-8689-8c42f8d63e4c None admin] SCRIPT_NAME: `/identity` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:12:34.707369 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34a380d-e1f2-475f-8689-8c42f8d63e4c None admin] PATH_INFO: `/v3/endpoints` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:12:34.708435 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f34a380d-e1f2-475f-8689-8c42f8d63e4c None admin] RBAC: Adding query filter params (interface=public, service_id=15269930d9414981ba19c2deffcb1acd, region_id=RegionOne) {{(pid=144067) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:12:34.709005 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f34a380d-e1f2-475f-8689-8c42f8d63e4c None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:12:34.710710 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f34a380d-e1f2-475f-8689-8c42f8d63e4c None admin] RBAC: Authorization granted {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:12:34.722318 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd25eecc-4ed4-4820-b6d6-944293413c52 None admin] Validating token access rules against request {{(pid=144068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:12:34.722696 dv-cinder-851351-1-smb devstack@keystone.service[144067]: [pid: 144067|app: 0|req: 464/938] 10.222.0.42 () {56 vars in 1251 bytes} [Thu Jul 28 08:12:34 2022] GET /identity/v3/endpoints?service_id=15269930d9414981ba19c2deffcb1acd&interface=public®ion_id=RegionOne => generated 194 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:12:34.723653 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34a380d-e1f2-475f-8689-8c42f8d63e4c None admin] Authenticating user token {{(pid=144067) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:12:34.756519 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9daa00a9-175a-4793-9f4c-66c56c0c384c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:12:34.757118 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9daa00a9-175a-4793-9f4c-66c56c0c384c None admin] REQUEST_METHOD: `GET` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:12:34.757401 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9daa00a9-175a-4793-9f4c-66c56c0c384c None admin] SCRIPT_NAME: `/identity` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:12:34.757740 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9daa00a9-175a-4793-9f4c-66c56c0c384c None admin] PATH_INFO: `/v3/roles` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:12:34.758412 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9daa00a9-175a-4793-9f4c-66c56c0c384c None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=144068) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:12:34.758720 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9daa00a9-175a-4793-9f4c-66c56c0c384c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:12:34.760114 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9daa00a9-175a-4793-9f4c-66c56c0c384c None admin] RBAC: Authorization granted {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:12:34.769449 dv-cinder-851351-1-smb devstack@keystone.service[144068]: [pid: 144068|app: 0|req: 475/939] 10.222.0.42 () {56 vars in 1115 bytes} [Thu Jul 28 08:12:34 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 08:12:34.778078 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9daa00a9-175a-4793-9f4c-66c56c0c384c None admin] Authenticating user token {{(pid=144068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:12:34.827808 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG dbcounter [-] [144068] Writing DB stats keystone:SELECT=100 {{(pid=144068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:12:34.846325 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34a380d-e1f2-475f-8689-8c42f8d63e4c None admin] Validating token access rules against request {{(pid=144067) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:12:34.886833 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f542ef-6686-4fd5-9cec-f1b0ed86a774 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144067) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:12:34.888460 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f542ef-6686-4fd5-9cec-f1b0ed86a774 None admin] REQUEST_METHOD: `GET` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:12:34.888924 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f542ef-6686-4fd5-9cec-f1b0ed86a774 None admin] SCRIPT_NAME: `/identity` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:12:34.889343 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f542ef-6686-4fd5-9cec-f1b0ed86a774 None admin] PATH_INFO: `/v3/services` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:12:34.890162 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38f542ef-6686-4fd5-9cec-f1b0ed86a774 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:12:34.892574 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38f542ef-6686-4fd5-9cec-f1b0ed86a774 None admin] RBAC: Authorization granted {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:12:34.894367 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG dbcounter [-] [144067] Writing DB stats keystone:SELECT=100 {{(pid=144067) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:12:34.909336 dv-cinder-851351-1-smb devstack@keystone.service[144067]: [pid: 144067|app: 0|req: 465/940] 10.222.0.42 () {56 vars in 1087 bytes} [Thu Jul 28 08:12:34 2022] GET /identity/v3/services => generated 1497 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 08:12:34.923368 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9daa00a9-175a-4793-9f4c-66c56c0c384c None admin] Validating token access rules against request {{(pid=144068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:12:34.966031 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b42b018d-18fe-46d6-b0e5-5b82ace31ffb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:12:34.969965 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42b018d-18fe-46d6-b0e5-5b82ace31ffb None admin] REQUEST_METHOD: `GET` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:12:34.969965 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42b018d-18fe-46d6-b0e5-5b82ace31ffb None admin] SCRIPT_NAME: `/identity` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:12:34.969965 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42b018d-18fe-46d6-b0e5-5b82ace31ffb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:12:34.987250 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b42b018d-18fe-46d6-b0e5-5b82ace31ffb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:12:34.992700 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b42b018d-18fe-46d6-b0e5-5b82ace31ffb None admin] RBAC: Authorization granted {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:12:35.009490 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application [None req-b42b018d-18fe-46d6-b0e5-5b82ace31ffb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 08:12:35.009490 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:12:35.009490 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:12:35.009490 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:12:35.009490 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:12:35.009490 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:12:35.009490 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:12:35.009490 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:12:35.009490 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:12:35.009490 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:12:35.009490 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:12:35.009490 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:12:35.009490 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 08:12:35.009490 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 08:12:35.009490 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 08:12:35.010524 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 08:12:35.010524 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:12:35.010524 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:12:35.010524 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:12:35.010524 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:12:35.010524 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:12:35.010524 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:12:35.010524 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:12:35.010524 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application with Lock( Jul 28 08:12:35.010524 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:12:35.010524 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:12:35.010524 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:12:35.010524 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:12:35.010524 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:12:35.010524 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:12:35.010524 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:12:35.010524 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:12:35.011560 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 08:12:35.011560 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 08:12:35.011560 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 08:12:35.011560 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application Jul 28 08:12:35.013583 dv-cinder-851351-1-smb devstack@keystone.service[144068]: [pid: 144068|app: 0|req: 476/941] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 08:12:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:12:35.019765 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f542ef-6686-4fd5-9cec-f1b0ed86a774 None admin] Authenticating user token {{(pid=144067) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:12:35.108128 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff71bfdb-3561-4c3a-b206-3595bc664e32 None None] REQUEST_METHOD: `GET` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:12:35.108780 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff71bfdb-3561-4c3a-b206-3595bc664e32 None None] SCRIPT_NAME: `/identity` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:12:35.109261 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff71bfdb-3561-4c3a-b206-3595bc664e32 None None] PATH_INFO: `/` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:12:35.111103 dv-cinder-851351-1-smb devstack@keystone.service[144068]: [pid: 144068|app: 0|req: 477/942] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 08:12:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 08:12:35.116317 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232c0457-785b-47e4-8270-b8bd8d78dc7e None None] REQUEST_METHOD: `POST` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:12:35.116949 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232c0457-785b-47e4-8270-b8bd8d78dc7e None None] SCRIPT_NAME: `/identity` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:12:35.117232 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232c0457-785b-47e4-8270-b8bd8d78dc7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:12:35.139899 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f542ef-6686-4fd5-9cec-f1b0ed86a774 None admin] Validating token access rules against request {{(pid=144067) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:12:35.140456 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.auth.core [None req-232c0457-785b-47e4-8270-b8bd8d78dc7e None None] MFA Rules not processed for user `bf5ceb8f07374635ad506b7d1b4f1612`. Rule list: `[]` (Enabled: `True`). {{(pid=144068) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 08:12:35.141732 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.fernet_utils [None req-232c0457-785b-47e4-8270-b8bd8d78dc7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=144068) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:12:35.180888 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2902bffc-2fb5-4089-b40a-c48583b28ef2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144067) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:12:35.181860 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2902bffc-2fb5-4089-b40a-c48583b28ef2 None admin] REQUEST_METHOD: `GET` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:12:35.182149 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2902bffc-2fb5-4089-b40a-c48583b28ef2 None admin] SCRIPT_NAME: `/identity` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:12:35.182430 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2902bffc-2fb5-4089-b40a-c48583b28ef2 None admin] PATH_INFO: `/v3/domains` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:12:35.183440 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2902bffc-2fb5-4089-b40a-c48583b28ef2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=144067) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:12:35.183758 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2902bffc-2fb5-4089-b40a-c48583b28ef2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:12:35.185224 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2902bffc-2fb5-4089-b40a-c48583b28ef2 None admin] RBAC: Authorization granted {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:12:35.199834 dv-cinder-851351-1-smb devstack@keystone.service[144067]: [pid: 144067|app: 0|req: 466/943] 10.222.0.42 () {56 vars in 1109 bytes} [Thu Jul 28 08:12:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:12:35.205731 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2902bffc-2fb5-4089-b40a-c48583b28ef2 None admin] Authenticating user token {{(pid=144067) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:12:35.230587 dv-cinder-851351-1-smb devstack@keystone.service[144068]: [pid: 144068|app: 0|req: 478/944] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 08:12:35 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 08:12:35.258079 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-232c0457-785b-47e4-8270-b8bd8d78dc7e None None] Authenticating user token {{(pid=144068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:12:35.274802 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG dbcounter [-] [144067] Writing DB stats keystone:SELECT=100 {{(pid=144067) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:12:35.277488 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG dbcounter [-] [144068] Writing DB stats keystone:SELECT=100 {{(pid=144068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:12:35.317205 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2902bffc-2fb5-4089-b40a-c48583b28ef2 None admin] Validating token access rules against request {{(pid=144067) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:12:35.353881 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb184ad-b3fb-4e50-8fd6-d20b119146f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144067) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:12:35.355275 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb184ad-b3fb-4e50-8fd6-d20b119146f7 None admin] REQUEST_METHOD: `GET` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:12:35.355822 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb184ad-b3fb-4e50-8fd6-d20b119146f7 None admin] SCRIPT_NAME: `/identity` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:12:35.356368 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb184ad-b3fb-4e50-8fd6-d20b119146f7 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:12:35.366784 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bb184ad-b3fb-4e50-8fd6-d20b119146f7 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:12:35.367191 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-232c0457-785b-47e4-8270-b8bd8d78dc7e None None] Validating token access rules against request {{(pid=144068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:12:35.368631 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bb184ad-b3fb-4e50-8fd6-d20b119146f7 None admin] RBAC: Authorization granted {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:12:35.383663 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application [None req-5bb184ad-b3fb-4e50-8fd6-d20b119146f7 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 28 08:12:35.383663 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:12:35.383663 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:12:35.383663 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:12:35.383663 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:12:35.383663 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:12:35.383663 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:12:35.383663 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:12:35.383663 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:12:35.383663 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:12:35.383663 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:12:35.383663 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:12:35.383663 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 28 08:12:35.383663 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 28 08:12:35.383663 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 28 08:12:35.383663 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 28 08:12:35.384728 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:12:35.384728 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:12:35.384728 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 28 08:12:35.384728 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 08:12:35.384728 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 28 08:12:35.384728 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 08:12:35.384728 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:12:35.384728 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:12:35.384728 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:12:35.384728 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:12:35.384728 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:12:35.384728 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application with Lock( Jul 28 08:12:35.384728 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:12:35.384728 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:12:35.384728 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:12:35.384728 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:12:35.384728 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:12:35.384728 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:12:35.385785 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:12:35.385785 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:12:35.385785 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 28 08:12:35.385785 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 28 08:12:35.385785 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 28 08:12:35.385785 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 28 08:12:35.385785 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 28 08:12:35.385785 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 28 08:12:35.385785 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 28 08:12:35.385785 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application Jul 28 08:12:35.388361 dv-cinder-851351-1-smb devstack@keystone.service[144067]: [pid: 144067|app: 0|req: 467/945] 10.222.0.42 () {56 vars in 1117 bytes} [Thu Jul 28 08:12:35 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:12:35.393487 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb184ad-b3fb-4e50-8fd6-d20b119146f7 None admin] Authenticating user token {{(pid=144067) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:12:35.416593 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e40f77-2ae1-4581-9880-c93dab1a901c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:12:35.417571 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e40f77-2ae1-4581-9880-c93dab1a901c None admin] REQUEST_METHOD: `POST` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:12:35.417861 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e40f77-2ae1-4581-9880-c93dab1a901c None admin] SCRIPT_NAME: `/identity` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:12:35.418136 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e40f77-2ae1-4581-9880-c93dab1a901c None admin] PATH_INFO: `/v3/projects` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:12:35.419083 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e40f77-2ae1-4581-9880-c93dab1a901c None admin] RBAC: Authorizing `identity:create_project()` {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:12:35.421312 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e40f77-2ae1-4581-9880-c93dab1a901c None admin] RBAC: Authorization granted {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:12:35.425411 dv-cinder-851351-1-smb devstack@keystone.service[144068]: WARNING keystone.server.flask.common [None req-29e40f77-2ae1-4581-9880-c93dab1a901c None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Jul 28 08:12:35.451786 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.sql.core [None req-29e40f77-2ae1-4581-9880-c93dab1a901c None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jul 28 08:12:35.451786 dv-cinder-851351-1-smb devstack@keystone.service[144068]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Jul 28 08:12:35.451786 dv-cinder-851351-1-smb devstack@keystone.service[144068]: [parameters: {'id': '203405ffa9da47a89e5706002bcde7f7', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Jul 28 08:12:35.451786 dv-cinder-851351-1-smb devstack@keystone.service[144068]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=144068) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jul 28 08:12:35.475758 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application [None req-29e40f77-2ae1-4581-9880-c93dab1a901c None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 203405ffa9da47a89e5706002bcde7f7.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 203405ffa9da47a89e5706002bcde7f7. Jul 28 08:12:35.475758 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:12:35.475758 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 28 08:12:35.475758 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 28 08:12:35.475758 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 28 08:12:35.475758 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 28 08:12:35.475758 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 28 08:12:35.475758 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application result = self._query(query) Jul 28 08:12:35.475758 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 28 08:12:35.475758 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application conn.query(q) Jul 28 08:12:35.475758 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 28 08:12:35.475758 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 28 08:12:35.475758 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 28 08:12:35.476555 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application result.read() Jul 28 08:12:35.476555 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 28 08:12:35.476555 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 28 08:12:35.476555 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 28 08:12:35.476555 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 28 08:12:35.476555 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 28 08:12:35.476555 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 28 08:12:35.476555 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 28 08:12:35.476555 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 28 08:12:35.476555 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jul 28 08:12:35.476555 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application Jul 28 08:12:35.476555 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jul 28 08:12:35.476555 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application Jul 28 08:12:35.476555 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:12:35.476555 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jul 28 08:12:35.476555 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jul 28 08:12:35.476555 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Jul 28 08:12:35.476555 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return project_ref.to_dict() Jul 28 08:12:35.477433 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 28 08:12:35.477433 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application next(self.gen) Jul 28 08:12:35.477433 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jul 28 08:12:35.477433 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application yield resource Jul 28 08:12:35.477433 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 28 08:12:35.477433 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application next(self.gen) Jul 28 08:12:35.477433 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jul 28 08:12:35.477433 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application self.session.rollback() Jul 28 08:12:35.477433 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 28 08:12:35.477433 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application self.force_reraise() Jul 28 08:12:35.477433 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 28 08:12:35.477433 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application raise self.value Jul 28 08:12:35.477433 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jul 28 08:12:35.477433 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jul 28 08:12:35.477433 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jul 28 08:12:35.477433 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application session.commit() Jul 28 08:12:35.477433 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jul 28 08:12:35.478245 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jul 28 08:12:35.478245 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jul 28 08:12:35.478245 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application self._prepare_impl() Jul 28 08:12:35.478245 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jul 28 08:12:35.478245 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application self.session.flush() Jul 28 08:12:35.478245 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jul 28 08:12:35.478245 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application self._flush(objects) Jul 28 08:12:35.478245 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jul 28 08:12:35.478245 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jul 28 08:12:35.478245 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jul 28 08:12:35.478245 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application compat.raise_( Jul 28 08:12:35.478245 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 28 08:12:35.478245 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application raise exception Jul 28 08:12:35.478245 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jul 28 08:12:35.478245 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application flush_context.execute() Jul 28 08:12:35.478245 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jul 28 08:12:35.478245 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application rec.execute(self) Jul 28 08:12:35.479368 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jul 28 08:12:35.479368 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jul 28 08:12:35.479368 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jul 28 08:12:35.479368 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application _emit_insert_statements( Jul 28 08:12:35.479368 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Jul 28 08:12:35.479368 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application c = connection._execute_20( Jul 28 08:12:35.479368 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jul 28 08:12:35.479368 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jul 28 08:12:35.479368 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Jul 28 08:12:35.479368 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jul 28 08:12:35.479368 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jul 28 08:12:35.479368 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application ret = self._execute_context( Jul 28 08:12:35.479368 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jul 28 08:12:35.479368 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jul 28 08:12:35.479368 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jul 28 08:12:35.480360 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jul 28 08:12:35.480360 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 28 08:12:35.480360 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application raise exception Jul 28 08:12:35.480360 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 28 08:12:35.480360 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 28 08:12:35.480360 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 28 08:12:35.480360 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 28 08:12:35.480360 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 28 08:12:35.480360 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application result = self._query(query) Jul 28 08:12:35.480360 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 28 08:12:35.480360 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application conn.query(q) Jul 28 08:12:35.480360 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 28 08:12:35.480360 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 28 08:12:35.480360 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 28 08:12:35.480360 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application result.read() Jul 28 08:12:35.480360 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 28 08:12:35.480360 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 28 08:12:35.481192 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 28 08:12:35.481192 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 28 08:12:35.481192 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 28 08:12:35.481192 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 28 08:12:35.481192 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 28 08:12:35.481192 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 28 08:12:35.481192 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jul 28 08:12:35.481192 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Jul 28 08:12:35.481192 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application [parameters: {'id': '203405ffa9da47a89e5706002bcde7f7', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Jul 28 08:12:35.481192 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jul 28 08:12:35.481192 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application Jul 28 08:12:35.481192 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 28 08:12:35.481192 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application Jul 28 08:12:35.481192 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:12:35.481192 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Jul 28 08:12:35.484177 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Jul 28 08:12:35.484177 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jul 28 08:12:35.484177 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jul 28 08:12:35.484177 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Jul 28 08:12:35.484177 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application Jul 28 08:12:35.484177 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 28 08:12:35.484177 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application Jul 28 08:12:35.484177 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:12:35.484177 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:12:35.484177 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:12:35.484177 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:12:35.484177 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:12:35.484177 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:12:35.484177 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:12:35.484177 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:12:35.484177 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:12:35.484177 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:12:35.486308 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:12:35.486308 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Jul 28 08:12:35.486308 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Jul 28 08:12:35.486308 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:12:35.486308 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:12:35.486308 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Jul 28 08:12:35.486308 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application raise exception.Conflict( Jul 28 08:12:35.486308 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 203405ffa9da47a89e5706002bcde7f7. Jul 28 08:12:35.486308 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application Jul 28 08:12:35.486308 dv-cinder-851351-1-smb devstack@keystone.service[144068]: [pid: 144068|app: 0|req: 479/946] 10.222.0.42 () {60 vars in 1140 bytes} [Thu Jul 28 08:12:35 2022] POST /identity/v3/projects => generated 262 bytes in 222 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:12:35.486308 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e40f77-2ae1-4581-9880-c93dab1a901c None admin] Authenticating user token {{(pid=144068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:12:35.522930 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb184ad-b3fb-4e50-8fd6-d20b119146f7 None admin] Validating token access rules against request {{(pid=144067) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:12:35.543575 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG dbcounter [-] [144067] Writing DB stats keystone:SELECT=100 {{(pid=144067) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:12:35.564630 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4b02dc-b59a-4773-9268-a0e730870113 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144067) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:12:35.565298 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4b02dc-b59a-4773-9268-a0e730870113 None admin] REQUEST_METHOD: `GET` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:12:35.565579 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4b02dc-b59a-4773-9268-a0e730870113 None admin] SCRIPT_NAME: `/identity` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:12:35.565938 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4b02dc-b59a-4773-9268-a0e730870113 None admin] PATH_INFO: `/v3/users` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:12:35.566827 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a4b02dc-b59a-4773-9268-a0e730870113 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=144067) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:12:35.567165 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a4b02dc-b59a-4773-9268-a0e730870113 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:12:35.568794 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a4b02dc-b59a-4773-9268-a0e730870113 None admin] RBAC: Authorization granted {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:12:35.589347 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG dbcounter [-] [144068] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=144068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:12:35.591798 dv-cinder-851351-1-smb devstack@keystone.service[144067]: [pid: 144067|app: 0|req: 468/947] 10.222.0.42 () {56 vars in 1149 bytes} [Thu Jul 28 08:12:35 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 08:12:35.600182 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4b02dc-b59a-4773-9268-a0e730870113 None admin] Authenticating user token {{(pid=144067) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:12:35.631074 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e40f77-2ae1-4581-9880-c93dab1a901c None admin] Validating token access rules against request {{(pid=144068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:12:35.680926 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc5ab6e-60d8-47b5-85e5-f33782afb194 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:12:35.681948 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc5ab6e-60d8-47b5-85e5-f33782afb194 None admin] REQUEST_METHOD: `GET` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:12:35.682232 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc5ab6e-60d8-47b5-85e5-f33782afb194 None admin] SCRIPT_NAME: `/identity` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:12:35.682779 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc5ab6e-60d8-47b5-85e5-f33782afb194 None admin] PATH_INFO: `/v3/projects/service` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:12:35.691986 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcc5ab6e-60d8-47b5-85e5-f33782afb194 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:12:35.694849 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcc5ab6e-60d8-47b5-85e5-f33782afb194 None admin] RBAC: Authorization granted {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:12:35.709199 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application [None req-fcc5ab6e-60d8-47b5-85e5-f33782afb194 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 08:12:35.709199 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:12:35.709199 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:12:35.709199 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:12:35.709199 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:12:35.709199 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:12:35.709199 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:12:35.709199 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:12:35.709199 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:12:35.709199 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:12:35.709199 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:12:35.709199 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:12:35.709199 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 28 08:12:35.709199 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 28 08:12:35.709199 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 28 08:12:35.710209 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 28 08:12:35.710209 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:12:35.710209 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:12:35.710209 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:12:35.710209 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:12:35.710209 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:12:35.710209 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:12:35.710209 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:12:35.710209 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application with Lock( Jul 28 08:12:35.710209 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:12:35.710209 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:12:35.710209 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:12:35.710209 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:12:35.710209 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:12:35.710209 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:12:35.710209 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:12:35.710209 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:12:35.712016 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 28 08:12:35.712016 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 28 08:12:35.712016 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 28 08:12:35.712016 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 28 08:12:35.712016 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 28 08:12:35.712016 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 28 08:12:35.712016 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 08:12:35.712016 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application Jul 28 08:12:35.712016 dv-cinder-851351-1-smb devstack@keystone.service[144068]: [pid: 144068|app: 0|req: 480/948] 10.222.0.42 () {56 vars in 1111 bytes} [Thu Jul 28 08:12:35 2022] GET /identity/v3/projects/service => generated 88 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:12:35.718723 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc5ab6e-60d8-47b5-85e5-f33782afb194 None admin] Authenticating user token {{(pid=144068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:12:35.740224 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4b02dc-b59a-4773-9268-a0e730870113 None admin] Validating token access rules against request {{(pid=144067) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:12:35.787043 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79a233c-13b9-4af6-bc98-e43194fd9b36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144067) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:12:35.788380 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79a233c-13b9-4af6-bc98-e43194fd9b36 None admin] REQUEST_METHOD: `GET` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:12:35.788972 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79a233c-13b9-4af6-bc98-e43194fd9b36 None admin] SCRIPT_NAME: `/identity` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:12:35.789275 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79a233c-13b9-4af6-bc98-e43194fd9b36 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:12:35.805133 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b79a233c-13b9-4af6-bc98-e43194fd9b36 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:12:35.806866 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b79a233c-13b9-4af6-bc98-e43194fd9b36 None admin] RBAC: Authorization granted {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:12:35.831895 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application [None req-b79a233c-13b9-4af6-bc98-e43194fd9b36 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 08:12:35.831895 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:12:35.831895 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:12:35.831895 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:12:35.831895 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:12:35.831895 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:12:35.831895 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:12:35.831895 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:12:35.831895 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:12:35.831895 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:12:35.831895 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:12:35.831895 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:12:35.831895 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 08:12:35.831895 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 08:12:35.831895 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 08:12:35.832879 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 08:12:35.832879 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:12:35.832879 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:12:35.832879 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:12:35.832879 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:12:35.832879 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:12:35.832879 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:12:35.832879 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:12:35.832879 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application with Lock( Jul 28 08:12:35.832879 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:12:35.832879 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:12:35.832879 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:12:35.832879 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:12:35.832879 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:12:35.832879 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:12:35.832879 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:12:35.832879 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:12:35.833723 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 08:12:35.833723 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 08:12:35.833723 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 08:12:35.833723 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application Jul 28 08:12:35.834506 dv-cinder-851351-1-smb devstack@keystone.service[144067]: [pid: 144067|app: 0|req: 469/949] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 08:12:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:12:35.840199 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79a233c-13b9-4af6-bc98-e43194fd9b36 None admin] Authenticating user token {{(pid=144067) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:12:35.850291 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc5ab6e-60d8-47b5-85e5-f33782afb194 None admin] Validating token access rules against request {{(pid=144068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:12:35.879425 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG dbcounter [-] [144067] Writing DB stats keystone:SELECT=100 {{(pid=144067) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:12:35.888568 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG dbcounter [-] [144068] Writing DB stats keystone:SELECT=100 {{(pid=144068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:12:35.897166 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598fe882-c180-4cb0-ae3a-91f03055c3b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:12:35.898083 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598fe882-c180-4cb0-ae3a-91f03055c3b5 None admin] REQUEST_METHOD: `GET` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:12:35.898638 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598fe882-c180-4cb0-ae3a-91f03055c3b5 None admin] SCRIPT_NAME: `/identity` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:12:35.899135 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598fe882-c180-4cb0-ae3a-91f03055c3b5 None admin] PATH_INFO: `/v3/projects` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:12:35.900215 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-598fe882-c180-4cb0-ae3a-91f03055c3b5 None admin] RBAC: Adding query filter params (name=service) {{(pid=144068) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:12:35.900746 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-598fe882-c180-4cb0-ae3a-91f03055c3b5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:12:35.902577 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-598fe882-c180-4cb0-ae3a-91f03055c3b5 None admin] RBAC: Authorization granted {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:12:35.929680 dv-cinder-851351-1-smb devstack@keystone.service[144068]: [pid: 144068|app: 0|req: 481/950] 10.222.0.42 () {56 vars in 1112 bytes} [Thu Jul 28 08:12:35 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:12:35.980962 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79a233c-13b9-4af6-bc98-e43194fd9b36 None admin] Validating token access rules against request {{(pid=144067) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:12:36.021393 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c0d424-76f0-40e8-9060-1ee89708fd4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144067) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:12:36.022052 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c0d424-76f0-40e8-9060-1ee89708fd4a None admin] REQUEST_METHOD: `GET` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:12:36.022332 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c0d424-76f0-40e8-9060-1ee89708fd4a None admin] SCRIPT_NAME: `/identity` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:12:36.022606 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c0d424-76f0-40e8-9060-1ee89708fd4a None admin] PATH_INFO: `/v3/domains` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:12:36.023336 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57c0d424-76f0-40e8-9060-1ee89708fd4a None admin] RBAC: Adding query filter params (name=Default) {{(pid=144067) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:12:36.023644 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57c0d424-76f0-40e8-9060-1ee89708fd4a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:12:36.025167 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57c0d424-76f0-40e8-9060-1ee89708fd4a None admin] RBAC: Authorization granted {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:12:36.039582 dv-cinder-851351-1-smb devstack@keystone.service[144067]: [pid: 144067|app: 0|req: 470/951] 10.222.0.42 () {56 vars in 1109 bytes} [Thu Jul 28 08:12:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:12:36.045628 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598fe882-c180-4cb0-ae3a-91f03055c3b5 None admin] Authenticating user token {{(pid=144068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:12:36.160795 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598fe882-c180-4cb0-ae3a-91f03055c3b5 None admin] Validating token access rules against request {{(pid=144068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:12:36.199934 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bafae6f-ba90-4ef2-b485-088dececc5c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:12:36.201015 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bafae6f-ba90-4ef2-b485-088dececc5c3 None admin] REQUEST_METHOD: `GET` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:12:36.201505 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bafae6f-ba90-4ef2-b485-088dececc5c3 None admin] SCRIPT_NAME: `/identity` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:12:36.202004 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bafae6f-ba90-4ef2-b485-088dececc5c3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:12:36.209904 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bafae6f-ba90-4ef2-b485-088dececc5c3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:12:36.211983 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bafae6f-ba90-4ef2-b485-088dececc5c3 None admin] RBAC: Authorization granted {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:12:36.224110 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application [None req-1bafae6f-ba90-4ef2-b485-088dececc5c3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 08:12:36.224110 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:12:36.224110 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:12:36.224110 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:12:36.224110 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:12:36.224110 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:12:36.224110 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:12:36.224110 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:12:36.224110 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:12:36.224110 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:12:36.224110 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:12:36.224110 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:12:36.224110 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 28 08:12:36.224110 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 28 08:12:36.224110 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 28 08:12:36.225037 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 28 08:12:36.225037 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:12:36.225037 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:12:36.225037 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:12:36.225037 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:12:36.225037 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:12:36.225037 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:12:36.225037 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:12:36.225037 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application with Lock( Jul 28 08:12:36.225037 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:12:36.225037 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:12:36.225037 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:12:36.225037 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:12:36.225037 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:12:36.225037 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:12:36.225037 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:12:36.225037 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:12:36.225900 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 28 08:12:36.225900 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 28 08:12:36.225900 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 28 08:12:36.225900 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 28 08:12:36.225900 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 28 08:12:36.225900 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 28 08:12:36.225900 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 08:12:36.225900 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application Jul 28 08:12:36.228428 dv-cinder-851351-1-smb devstack@keystone.service[144068]: [pid: 144068|app: 0|req: 482/952] 10.222.0.42 () {56 vars in 1111 bytes} [Thu Jul 28 08:12:36 2022] GET /identity/v3/projects/service => generated 88 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:12:36.237819 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c0d424-76f0-40e8-9060-1ee89708fd4a None admin] Authenticating user token {{(pid=144067) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:12:36.256080 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ffcf849-9c81-4310-a051-b2264970c795 None None] REQUEST_METHOD: `GET` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:12:36.256769 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ffcf849-9c81-4310-a051-b2264970c795 None None] SCRIPT_NAME: `/identity` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:12:36.257250 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ffcf849-9c81-4310-a051-b2264970c795 None None] PATH_INFO: `/` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:12:36.259089 dv-cinder-851351-1-smb devstack@keystone.service[144068]: [pid: 144068|app: 0|req: 483/953] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 08:12:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 08:12:36.264573 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2e1991-f51e-4d54-ac38-03dd3d56e8a1 None None] REQUEST_METHOD: `POST` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:12:36.265146 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2e1991-f51e-4d54-ac38-03dd3d56e8a1 None None] SCRIPT_NAME: `/identity` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:12:36.265645 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2e1991-f51e-4d54-ac38-03dd3d56e8a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:12:36.285213 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.auth.core [None req-8e2e1991-f51e-4d54-ac38-03dd3d56e8a1 None None] MFA Rules not processed for user `bf5ceb8f07374635ad506b7d1b4f1612`. Rule list: `[]` (Enabled: `True`). {{(pid=144068) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 08:12:36.286856 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.fernet_utils [None req-8e2e1991-f51e-4d54-ac38-03dd3d56e8a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=144068) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:12:36.329853 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG dbcounter [-] [144067] Writing DB stats keystone:SELECT=100 {{(pid=144067) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:12:36.340434 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG dbcounter [-] [144068] Writing DB stats keystone:SELECT=100 {{(pid=144068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:12:36.343406 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c0d424-76f0-40e8-9060-1ee89708fd4a None admin] Validating token access rules against request {{(pid=144067) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:12:36.363581 dv-cinder-851351-1-smb devstack@keystone.service[144068]: [pid: 144068|app: 0|req: 484/954] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 08:12:36 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 28 08:12:36.379453 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa2508a8-5d65-46c8-9011-65c0de5d325d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144067) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:12:36.380103 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2508a8-5d65-46c8-9011-65c0de5d325d None admin] REQUEST_METHOD: `GET` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:12:36.380384 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2508a8-5d65-46c8-9011-65c0de5d325d None admin] SCRIPT_NAME: `/identity` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:12:36.380673 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2508a8-5d65-46c8-9011-65c0de5d325d None admin] PATH_INFO: `/v3/projects` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:12:36.381491 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa2508a8-5d65-46c8-9011-65c0de5d325d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=144067) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:12:36.381805 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa2508a8-5d65-46c8-9011-65c0de5d325d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:12:36.383268 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa2508a8-5d65-46c8-9011-65c0de5d325d None admin] RBAC: Authorization granted {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:12:36.386912 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2e1991-f51e-4d54-ac38-03dd3d56e8a1 None None] Authenticating user token {{(pid=144068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:12:36.396430 dv-cinder-851351-1-smb devstack@keystone.service[144067]: [pid: 144067|app: 0|req: 471/955] 10.222.0.42 () {56 vars in 1148 bytes} [Thu Jul 28 08:12:36 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:12:36.402502 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa2508a8-5d65-46c8-9011-65c0de5d325d None admin] Authenticating user token {{(pid=144067) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:12:36.491056 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2e1991-f51e-4d54-ac38-03dd3d56e8a1 None None] Validating token access rules against request {{(pid=144068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:12:36.529328 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7d712b-287b-40b6-81b2-6b2fef8a2150 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:12:36.530132 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7d712b-287b-40b6-81b2-6b2fef8a2150 None admin] REQUEST_METHOD: `POST` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:12:36.530545 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7d712b-287b-40b6-81b2-6b2fef8a2150 None admin] SCRIPT_NAME: `/identity` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:12:36.530916 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7d712b-287b-40b6-81b2-6b2fef8a2150 None admin] PATH_INFO: `/v3/services` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:12:36.531726 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a7d712b-287b-40b6-81b2-6b2fef8a2150 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:12:36.533226 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a7d712b-287b-40b6-81b2-6b2fef8a2150 None admin] RBAC: Authorization granted {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:12:36.538832 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa2508a8-5d65-46c8-9011-65c0de5d325d None admin] Validating token access rules against request {{(pid=144067) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:12:36.550687 dv-cinder-851351-1-smb devstack@keystone.service[144068]: [pid: 144068|app: 0|req: 485/956] 10.222.0.42 () {60 vars in 1141 bytes} [Thu Jul 28 08:12:36 2022] POST /identity/v3/services => generated 242 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 28 08:12:36.595340 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05504993-ae1b-4a40-b29a-e449e48f76e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144067) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:12:36.596468 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05504993-ae1b-4a40-b29a-e449e48f76e7 None admin] REQUEST_METHOD: `PUT` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:12:36.596974 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05504993-ae1b-4a40-b29a-e449e48f76e7 None admin] SCRIPT_NAME: `/identity` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:12:36.597557 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05504993-ae1b-4a40-b29a-e449e48f76e7 None admin] PATH_INFO: `/v3/projects/fa39ab7491e5413ca648e31ee9177fa0/users/64acbde3263f4bb8b102034fc3a9d4e6/roles/cfa933c7b37b473c8e22091c8b829530` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:12:36.600501 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05504993-ae1b-4a40-b29a-e449e48f76e7 None admin] RBAC: Authorizing `identity:create_grant(project_id=fa39ab7491e5413ca648e31ee9177fa0, user_id=64acbde3263f4bb8b102034fc3a9d4e6, role_id=cfa933c7b37b473c8e22091c8b829530)` {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:12:36.602467 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05504993-ae1b-4a40-b29a-e449e48f76e7 None admin] RBAC: Authorization granted {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:12:36.625718 dv-cinder-851351-1-smb devstack@keystone.service[144067]: [pid: 144067|app: 0|req: 472/957] 10.222.0.42 () {58 vars in 1439 bytes} [Thu Jul 28 08:12:36 2022] PUT /identity/v3/projects/fa39ab7491e5413ca648e31ee9177fa0/users/64acbde3263f4bb8b102034fc3a9d4e6/roles/cfa933c7b37b473c8e22091c8b829530 => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 08:12:37.107171 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec94ea15-9a6b-4339-9e74-34604e2c0f25 None None] REQUEST_METHOD: `GET` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:12:37.108058 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec94ea15-9a6b-4339-9e74-34604e2c0f25 None None] SCRIPT_NAME: `/identity` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:12:37.108491 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec94ea15-9a6b-4339-9e74-34604e2c0f25 None None] PATH_INFO: `/` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:12:37.110299 dv-cinder-851351-1-smb devstack@keystone.service[144068]: [pid: 144068|app: 0|req: 486/958] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 08:12:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 08:12:37.116016 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7eff695-84b0-49d1-ab0b-a917aea5b406 None None] REQUEST_METHOD: `POST` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:12:37.116882 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7eff695-84b0-49d1-ab0b-a917aea5b406 None None] SCRIPT_NAME: `/identity` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:12:37.117392 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7eff695-84b0-49d1-ab0b-a917aea5b406 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:12:37.126884 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG dbcounter [-] [144067] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=144067) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:12:37.139260 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.auth.core [None req-f7eff695-84b0-49d1-ab0b-a917aea5b406 None None] MFA Rules not processed for user `bf5ceb8f07374635ad506b7d1b4f1612`. Rule list: `[]` (Enabled: `True`). {{(pid=144067) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 08:12:37.140829 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.fernet_utils [None req-f7eff695-84b0-49d1-ab0b-a917aea5b406 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=144067) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:12:37.217013 dv-cinder-851351-1-smb devstack@keystone.service[144067]: [pid: 144067|app: 0|req: 473/959] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 08:12:37 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 28 08:12:37.240914 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec94ea15-9a6b-4339-9e74-34604e2c0f25 None None] Authenticating user token {{(pid=144068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:12:37.317936 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG dbcounter [-] [144068] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=144068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:12:37.412580 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec94ea15-9a6b-4339-9e74-34604e2c0f25 None None] Validating token access rules against request {{(pid=144068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:12:37.465682 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5672a813-ab11-473c-a2b4-7234061b99dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:12:37.466737 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5672a813-ab11-473c-a2b4-7234061b99dc None admin] REQUEST_METHOD: `GET` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:12:37.467208 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5672a813-ab11-473c-a2b4-7234061b99dc None admin] SCRIPT_NAME: `/identity` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:12:37.467685 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5672a813-ab11-473c-a2b4-7234061b99dc None admin] PATH_INFO: `/v3/services/object-store` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:12:37.468813 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5672a813-ab11-473c-a2b4-7234061b99dc None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:12:37.471299 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5672a813-ab11-473c-a2b4-7234061b99dc None admin] RBAC: Authorization granted {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:12:37.487475 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application [None req-5672a813-ab11-473c-a2b4-7234061b99dc None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 28 08:12:37.487475 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:12:37.487475 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 28 08:12:37.487475 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 28 08:12:37.487475 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 28 08:12:37.487475 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 28 08:12:37.487475 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 28 08:12:37.487475 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 08:12:37.487475 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 28 08:12:37.487475 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application Jul 28 08:12:37.487475 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 28 08:12:37.487475 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application Jul 28 08:12:37.487475 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:12:37.487475 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:12:37.487475 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:12:37.487475 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:12:37.487475 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:12:37.488564 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:12:37.488564 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:12:37.488564 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:12:37.488564 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:12:37.488564 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:12:37.488564 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:12:37.488564 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 28 08:12:37.488564 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 28 08:12:37.488564 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 28 08:12:37.488564 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 28 08:12:37.488564 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:12:37.488564 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:12:37.488564 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:12:37.488564 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:12:37.488564 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:12:37.488564 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:12:37.489495 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:12:37.489495 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application with Lock( Jul 28 08:12:37.489495 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:12:37.489495 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:12:37.489495 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:12:37.489495 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:12:37.489495 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:12:37.489495 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:12:37.489495 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:12:37.489495 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:12:37.489495 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 28 08:12:37.489495 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 08:12:37.489495 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 28 08:12:37.489495 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application Jul 28 08:12:37.490184 dv-cinder-851351-1-smb devstack@keystone.service[144068]: [pid: 144068|app: 0|req: 487/960] 10.222.0.42 () {56 vars in 1126 bytes} [Thu Jul 28 08:12:37 2022] GET /identity/v3/services/object-store => generated 93 bytes in 250 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 08:12:37.495750 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7eff695-84b0-49d1-ab0b-a917aea5b406 None None] Authenticating user token {{(pid=144067) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:12:37.603605 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7eff695-84b0-49d1-ab0b-a917aea5b406 None None] Validating token access rules against request {{(pid=144067) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:12:37.643559 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e398a8-80f6-4169-8314-9ea5e02e80d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144067) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:12:37.644438 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e398a8-80f6-4169-8314-9ea5e02e80d7 None admin] REQUEST_METHOD: `GET` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:12:37.644773 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e398a8-80f6-4169-8314-9ea5e02e80d7 None admin] SCRIPT_NAME: `/identity` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:12:37.645055 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e398a8-80f6-4169-8314-9ea5e02e80d7 None admin] PATH_INFO: `/v3/services` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:12:37.645768 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e398a8-80f6-4169-8314-9ea5e02e80d7 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=144067) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:12:37.646073 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e398a8-80f6-4169-8314-9ea5e02e80d7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:12:37.647878 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e398a8-80f6-4169-8314-9ea5e02e80d7 None admin] RBAC: Authorization granted {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:12:37.649968 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG dbcounter [-] [144067] Writing DB stats keystone:SELECT=100 {{(pid=144067) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:12:37.656390 dv-cinder-851351-1-smb devstack@keystone.service[144067]: [pid: 144067|app: 0|req: 474/961] 10.222.0.42 () {56 vars in 1122 bytes} [Thu Jul 28 08:12:37 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:12:37.662184 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5672a813-ab11-473c-a2b4-7234061b99dc None admin] Authenticating user token {{(pid=144068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:12:37.784229 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5672a813-ab11-473c-a2b4-7234061b99dc None admin] Validating token access rules against request {{(pid=144068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:12:37.793620 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG dbcounter [-] [144068] Writing DB stats keystone:SELECT=100 {{(pid=144068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:12:37.824092 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79066a6e-6f2f-4d3f-8274-63c09f46a99d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:12:37.824871 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79066a6e-6f2f-4d3f-8274-63c09f46a99d None admin] REQUEST_METHOD: `GET` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:12:37.825154 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79066a6e-6f2f-4d3f-8274-63c09f46a99d None admin] SCRIPT_NAME: `/identity` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:12:37.825425 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79066a6e-6f2f-4d3f-8274-63c09f46a99d None admin] PATH_INFO: `/v3/services` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:12:37.826120 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79066a6e-6f2f-4d3f-8274-63c09f46a99d None admin] RBAC: Adding query filter params (type=object-store) {{(pid=144068) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:12:37.826423 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79066a6e-6f2f-4d3f-8274-63c09f46a99d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:12:37.827809 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79066a6e-6f2f-4d3f-8274-63c09f46a99d None admin] RBAC: Authorization granted {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:12:37.834057 dv-cinder-851351-1-smb devstack@keystone.service[144068]: [pid: 144068|app: 0|req: 488/962] 10.222.0.42 () {56 vars in 1122 bytes} [Thu Jul 28 08:12:37 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:12:37.841829 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e398a8-80f6-4169-8314-9ea5e02e80d7 None admin] Authenticating user token {{(pid=144067) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:12:37.968260 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e398a8-80f6-4169-8314-9ea5e02e80d7 None admin] Validating token access rules against request {{(pid=144067) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:12:38.013449 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d1b1592-91f4-499e-8edb-331e30d8d714 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144067) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:12:38.014113 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1b1592-91f4-499e-8edb-331e30d8d714 None admin] REQUEST_METHOD: `POST` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:12:38.014394 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1b1592-91f4-499e-8edb-331e30d8d714 None admin] SCRIPT_NAME: `/identity` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:12:38.014666 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1b1592-91f4-499e-8edb-331e30d8d714 None admin] PATH_INFO: `/v3/endpoints` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:12:38.015408 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d1b1592-91f4-499e-8edb-331e30d8d714 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:12:38.016871 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d1b1592-91f4-499e-8edb-331e30d8d714 None admin] RBAC: Authorization granted {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:12:38.044622 dv-cinder-851351-1-smb devstack@keystone.service[144067]: [pid: 144067|app: 0|req: 475/963] 10.222.0.42 () {60 vars in 1144 bytes} [Thu Jul 28 08:12:37 2022] POST /identity/v3/endpoints => generated 349 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 08:12:38.226367 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c04028-cc13-4b73-89a0-5f35fe4baddc None None] REQUEST_METHOD: `GET` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:12:38.226927 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c04028-cc13-4b73-89a0-5f35fe4baddc None None] SCRIPT_NAME: `/identity` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:12:38.226927 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c04028-cc13-4b73-89a0-5f35fe4baddc None None] PATH_INFO: `/` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:12:38.228305 dv-cinder-851351-1-smb devstack@keystone.service[144068]: [pid: 144068|app: 0|req: 489/964] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 08:12:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 08:12:38.234599 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76225e1-b0fd-40af-a2bf-d42bbd0d27f1 None None] REQUEST_METHOD: `POST` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:12:38.235107 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76225e1-b0fd-40af-a2bf-d42bbd0d27f1 None None] SCRIPT_NAME: `/identity` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:12:38.235202 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76225e1-b0fd-40af-a2bf-d42bbd0d27f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:12:38.255404 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.auth.core [None req-a76225e1-b0fd-40af-a2bf-d42bbd0d27f1 None None] MFA Rules not processed for user `bf5ceb8f07374635ad506b7d1b4f1612`. Rule list: `[]` (Enabled: `True`). {{(pid=144067) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 08:12:38.256712 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.fernet_utils [None req-a76225e1-b0fd-40af-a2bf-d42bbd0d27f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=144067) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:12:38.312323 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG dbcounter [-] [144067] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=144067) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:12:38.340423 dv-cinder-851351-1-smb devstack@keystone.service[144067]: [pid: 144067|app: 0|req: 476/965] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 08:12:38 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 08:12:38.364620 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c04028-cc13-4b73-89a0-5f35fe4baddc None None] Authenticating user token {{(pid=144068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:12:38.472979 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c04028-cc13-4b73-89a0-5f35fe4baddc None None] Validating token access rules against request {{(pid=144068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:12:38.509654 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5fead50-2006-43fa-ba43-9e5b599c94f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:12:38.510651 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5fead50-2006-43fa-ba43-9e5b599c94f7 None admin] REQUEST_METHOD: `POST` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:12:38.511181 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5fead50-2006-43fa-ba43-9e5b599c94f7 None admin] SCRIPT_NAME: `/identity` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:12:38.511648 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5fead50-2006-43fa-ba43-9e5b599c94f7 None admin] PATH_INFO: `/v3/users` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:12:38.512546 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5fead50-2006-43fa-ba43-9e5b599c94f7 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:12:38.514204 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5fead50-2006-43fa-ba43-9e5b599c94f7 None admin] RBAC: Authorization granted {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:12:38.530180 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.sql.core [None req-e5fead50-2006-43fa-ba43-9e5b599c94f7 None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jul 28 08:12:38.530180 dv-cinder-851351-1-smb devstack@keystone.service[144068]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Jul 28 08:12:38.530180 dv-cinder-851351-1-smb devstack@keystone.service[144068]: [parameters: {'user_id': 'eaa5931965704e5f8eb49532a281a317', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Jul 28 08:12:38.530180 dv-cinder-851351-1-smb devstack@keystone.service[144068]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=144068) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jul 28 08:12:38.538094 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application [None req-e5fead50-2006-43fa-ba43-9e5b599c94f7 None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Jul 28 08:12:38.538094 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:12:38.538094 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 28 08:12:38.538094 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 28 08:12:38.538094 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 28 08:12:38.538094 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 28 08:12:38.538094 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 28 08:12:38.538094 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application result = self._query(query) Jul 28 08:12:38.538094 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 28 08:12:38.538094 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application conn.query(q) Jul 28 08:12:38.538094 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 28 08:12:38.538094 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 28 08:12:38.538094 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 28 08:12:38.538094 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application result.read() Jul 28 08:12:38.538094 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 28 08:12:38.538976 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 28 08:12:38.538976 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 28 08:12:38.538976 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 28 08:12:38.538976 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 28 08:12:38.538976 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 28 08:12:38.538976 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 28 08:12:38.538976 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 28 08:12:38.538976 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jul 28 08:12:38.538976 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application Jul 28 08:12:38.538976 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jul 28 08:12:38.538976 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application Jul 28 08:12:38.538976 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:12:38.538976 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jul 28 08:12:38.538976 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jul 28 08:12:38.538976 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Jul 28 08:12:38.538976 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Jul 28 08:12:38.538976 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 28 08:12:38.538976 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application next(self.gen) Jul 28 08:12:38.539859 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jul 28 08:12:38.539859 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application yield resource Jul 28 08:12:38.539859 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 28 08:12:38.539859 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application next(self.gen) Jul 28 08:12:38.539859 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jul 28 08:12:38.539859 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application self.session.rollback() Jul 28 08:12:38.539859 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 28 08:12:38.539859 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application self.force_reraise() Jul 28 08:12:38.539859 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 28 08:12:38.539859 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application raise self.value Jul 28 08:12:38.539859 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jul 28 08:12:38.539859 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jul 28 08:12:38.539859 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jul 28 08:12:38.539859 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application session.commit() Jul 28 08:12:38.539859 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jul 28 08:12:38.539859 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jul 28 08:12:38.539859 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jul 28 08:12:38.540697 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application self._prepare_impl() Jul 28 08:12:38.540697 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jul 28 08:12:38.540697 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application self.session.flush() Jul 28 08:12:38.540697 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jul 28 08:12:38.540697 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application self._flush(objects) Jul 28 08:12:38.540697 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jul 28 08:12:38.540697 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jul 28 08:12:38.540697 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jul 28 08:12:38.540697 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application compat.raise_( Jul 28 08:12:38.540697 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 28 08:12:38.540697 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application raise exception Jul 28 08:12:38.540697 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jul 28 08:12:38.540697 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application flush_context.execute() Jul 28 08:12:38.540697 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jul 28 08:12:38.540697 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application rec.execute(self) Jul 28 08:12:38.540697 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jul 28 08:12:38.540697 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jul 28 08:12:38.541527 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jul 28 08:12:38.541527 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application _emit_insert_statements( Jul 28 08:12:38.541527 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Jul 28 08:12:38.541527 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application result = connection._execute_20( Jul 28 08:12:38.541527 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jul 28 08:12:38.541527 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jul 28 08:12:38.541527 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Jul 28 08:12:38.541527 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jul 28 08:12:38.541527 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jul 28 08:12:38.541527 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application ret = self._execute_context( Jul 28 08:12:38.541527 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jul 28 08:12:38.541527 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jul 28 08:12:38.541527 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jul 28 08:12:38.541527 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jul 28 08:12:38.541527 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 28 08:12:38.541527 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application raise exception Jul 28 08:12:38.542306 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 28 08:12:38.542306 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 28 08:12:38.542306 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 28 08:12:38.542306 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 28 08:12:38.542306 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 28 08:12:38.542306 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application result = self._query(query) Jul 28 08:12:38.542306 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 28 08:12:38.542306 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application conn.query(q) Jul 28 08:12:38.542306 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 28 08:12:38.542306 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 28 08:12:38.542306 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 28 08:12:38.542306 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application result.read() Jul 28 08:12:38.542306 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 28 08:12:38.542306 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 28 08:12:38.542306 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 28 08:12:38.542306 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 28 08:12:38.543064 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 28 08:12:38.543064 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 28 08:12:38.543064 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 28 08:12:38.543064 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 28 08:12:38.543064 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jul 28 08:12:38.543064 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Jul 28 08:12:38.543064 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application [parameters: {'user_id': 'eaa5931965704e5f8eb49532a281a317', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Jul 28 08:12:38.543064 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jul 28 08:12:38.543064 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application Jul 28 08:12:38.543064 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 28 08:12:38.543064 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application Jul 28 08:12:38.543064 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:12:38.543064 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:12:38.543064 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:12:38.543064 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:12:38.543794 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:12:38.543794 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:12:38.543794 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:12:38.543794 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:12:38.543794 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:12:38.543794 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:12:38.543794 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:12:38.543794 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Jul 28 08:12:38.543794 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Jul 28 08:12:38.543794 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:12:38.543794 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:12:38.543794 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 28 08:12:38.543794 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 08:12:38.543794 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 28 08:12:38.543794 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 08:12:38.543794 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Jul 28 08:12:38.543794 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Jul 28 08:12:38.544641 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Jul 28 08:12:38.544641 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Jul 28 08:12:38.544641 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jul 28 08:12:38.544641 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jul 28 08:12:38.544641 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Jul 28 08:12:38.544641 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application Jul 28 08:12:38.548646 dv-cinder-851351-1-smb devstack@keystone.service[144068]: [pid: 144068|app: 0|req: 490/966] 10.222.0.42 () {60 vars in 1131 bytes} [Thu Jul 28 08:12:38 2022] POST /identity/v3/users => generated 160 bytes in 184 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:12:38.555105 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76225e1-b0fd-40af-a2bf-d42bbd0d27f1 None None] Authenticating user token {{(pid=144067) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:12:38.666047 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76225e1-b0fd-40af-a2bf-d42bbd0d27f1 None None] Validating token access rules against request {{(pid=144067) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:12:38.707015 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05d58de-c996-4fcb-b6a6-ba8d680ef2aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144067) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:12:38.708417 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05d58de-c996-4fcb-b6a6-ba8d680ef2aa None admin] REQUEST_METHOD: `GET` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:12:38.709004 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05d58de-c996-4fcb-b6a6-ba8d680ef2aa None admin] SCRIPT_NAME: `/identity` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:12:38.709824 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05d58de-c996-4fcb-b6a6-ba8d680ef2aa None admin] PATH_INFO: `/v3/users/cinder` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:12:38.719669 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0806ac-14cc-4c49-b387-8b92245a918f None None] REQUEST_METHOD: `GET` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:12:38.720231 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a05d58de-c996-4fcb-b6a6-ba8d680ef2aa None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:12:38.720503 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0806ac-14cc-4c49-b387-8b92245a918f None None] SCRIPT_NAME: `/identity` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:12:38.721145 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0806ac-14cc-4c49-b387-8b92245a918f None None] PATH_INFO: `/` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:12:38.721778 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a05d58de-c996-4fcb-b6a6-ba8d680ef2aa None admin] RBAC: Authorization granted {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:12:38.729195 dv-cinder-851351-1-smb devstack@keystone.service[144068]: [pid: 144068|app: 0|req: 491/967] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 08:12:38 2022] GET /identity => generated 270 bytes in 12 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 08:12:38.734629 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0defdafd-fe67-47a0-a48a-dd7812ac66ed None None] REQUEST_METHOD: `POST` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:12:38.735273 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0defdafd-fe67-47a0-a48a-dd7812ac66ed None None] SCRIPT_NAME: `/identity` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:12:38.735917 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0defdafd-fe67-47a0-a48a-dd7812ac66ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:12:38.738627 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application [None req-a05d58de-c996-4fcb-b6a6-ba8d680ef2aa None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jul 28 08:12:38.738627 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:12:38.738627 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:12:38.738627 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:12:38.738627 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:12:38.738627 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:12:38.738627 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:12:38.738627 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:12:38.738627 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:12:38.738627 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:12:38.738627 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:12:38.738627 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:12:38.738627 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 28 08:12:38.738627 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 28 08:12:38.738627 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 28 08:12:38.738627 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 28 08:12:38.739776 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:12:38.739776 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:12:38.739776 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 28 08:12:38.739776 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 08:12:38.739776 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 28 08:12:38.739776 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 08:12:38.739776 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:12:38.739776 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:12:38.739776 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:12:38.739776 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:12:38.739776 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:12:38.739776 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application with Lock( Jul 28 08:12:38.739776 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:12:38.739776 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:12:38.739776 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:12:38.739776 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:12:38.739776 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:12:38.739776 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:12:38.741142 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:12:38.741142 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:12:38.741142 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 28 08:12:38.741142 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 28 08:12:38.741142 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 28 08:12:38.741142 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 28 08:12:38.741142 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 28 08:12:38.741142 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 28 08:12:38.741142 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jul 28 08:12:38.741142 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application Jul 28 08:12:38.741142 dv-cinder-851351-1-smb devstack@keystone.service[144067]: [pid: 144067|app: 0|req: 477/968] 10.222.0.42 () {56 vars in 1099 bytes} [Thu Jul 28 08:12:38 2022] GET /identity/v3/users/cinder => generated 84 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:12:38.748890 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05d58de-c996-4fcb-b6a6-ba8d680ef2aa None admin] Authenticating user token {{(pid=144067) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:12:38.771029 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.auth.core [None req-0defdafd-fe67-47a0-a48a-dd7812ac66ed None None] MFA Rules not processed for user `bf5ceb8f07374635ad506b7d1b4f1612`. Rule list: `[]` (Enabled: `True`). {{(pid=144068) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 08:12:38.773128 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.fernet_utils [None req-0defdafd-fe67-47a0-a48a-dd7812ac66ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=144068) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:12:38.799031 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG dbcounter [-] [144067] Writing DB stats keystone:SELECT=100 {{(pid=144067) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:12:38.807016 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG dbcounter [-] [144068] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=144068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:12:38.856297 dv-cinder-851351-1-smb devstack@keystone.service[144068]: [pid: 144068|app: 0|req: 492/969] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 08:12:38 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 08:12:38.879778 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0defdafd-fe67-47a0-a48a-dd7812ac66ed None None] Authenticating user token {{(pid=144068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:12:38.886078 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05d58de-c996-4fcb-b6a6-ba8d680ef2aa None admin] Validating token access rules against request {{(pid=144067) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:12:38.933322 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2306a831-c7d8-4cb8-abb1-0509b9da5d1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144067) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:12:38.933879 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2306a831-c7d8-4cb8-abb1-0509b9da5d1f None admin] REQUEST_METHOD: `GET` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:12:38.934166 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2306a831-c7d8-4cb8-abb1-0509b9da5d1f None admin] SCRIPT_NAME: `/identity` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:12:38.934447 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2306a831-c7d8-4cb8-abb1-0509b9da5d1f None admin] PATH_INFO: `/v3/users` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:12:38.935236 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2306a831-c7d8-4cb8-abb1-0509b9da5d1f None admin] RBAC: Adding query filter params (name=cinder) {{(pid=144067) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:12:38.935548 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2306a831-c7d8-4cb8-abb1-0509b9da5d1f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:12:38.937047 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2306a831-c7d8-4cb8-abb1-0509b9da5d1f None admin] RBAC: Authorization granted {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:12:38.981567 dv-cinder-851351-1-smb devstack@keystone.service[144067]: [pid: 144067|app: 0|req: 478/970] 10.222.0.42 () {56 vars in 1101 bytes} [Thu Jul 28 08:12:38 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:12:38.981567 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3129f94-b121-45ed-908b-f32aa351e63e None None] REQUEST_METHOD: `GET` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:12:38.981567 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3129f94-b121-45ed-908b-f32aa351e63e None None] SCRIPT_NAME: `/identity` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:12:38.981567 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3129f94-b121-45ed-908b-f32aa351e63e None None] PATH_INFO: `/` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:12:38.981567 dv-cinder-851351-1-smb devstack@keystone.service[144067]: [pid: 144067|app: 0|req: 479/971] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 08:12:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 08:12:38.985999 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b5aa17-2959-4d5c-9c13-9dbc5472cad3 None None] REQUEST_METHOD: `POST` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:12:38.986286 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b5aa17-2959-4d5c-9c13-9dbc5472cad3 None None] SCRIPT_NAME: `/identity` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:12:38.986560 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b5aa17-2959-4d5c-9c13-9dbc5472cad3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:12:39.007378 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.auth.core [None req-03b5aa17-2959-4d5c-9c13-9dbc5472cad3 None None] MFA Rules not processed for user `bf5ceb8f07374635ad506b7d1b4f1612`. Rule list: `[]` (Enabled: `True`). {{(pid=144067) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 08:12:39.008624 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.fernet_utils [None req-03b5aa17-2959-4d5c-9c13-9dbc5472cad3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=144067) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:12:39.013031 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0defdafd-fe67-47a0-a48a-dd7812ac66ed None None] Validating token access rules against request {{(pid=144068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:12:39.062349 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f112f9-6885-4dd4-b020-3e8cd8258b9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:12:39.063503 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f112f9-6885-4dd4-b020-3e8cd8258b9f None admin] REQUEST_METHOD: `GET` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:12:39.063784 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f112f9-6885-4dd4-b020-3e8cd8258b9f None admin] SCRIPT_NAME: `/identity` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:12:39.064058 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f112f9-6885-4dd4-b020-3e8cd8258b9f None admin] PATH_INFO: `/v3/services/compute` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:12:39.065029 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f112f9-6885-4dd4-b020-3e8cd8258b9f None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:12:39.066780 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f112f9-6885-4dd4-b020-3e8cd8258b9f None admin] RBAC: Authorization granted {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:12:39.081087 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application [None req-c2f112f9-6885-4dd4-b020-3e8cd8258b9f None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jul 28 08:12:39.081087 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:12:39.081087 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 28 08:12:39.081087 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 28 08:12:39.081087 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 28 08:12:39.081087 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 28 08:12:39.081087 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 28 08:12:39.081087 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 08:12:39.081087 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 28 08:12:39.081087 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application Jul 28 08:12:39.081087 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 28 08:12:39.081087 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application Jul 28 08:12:39.081087 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:12:39.081087 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:12:39.081087 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:12:39.081087 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:12:39.081087 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:12:39.082178 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:12:39.082178 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:12:39.082178 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:12:39.082178 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:12:39.082178 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:12:39.082178 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:12:39.082178 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 28 08:12:39.082178 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 28 08:12:39.082178 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 28 08:12:39.082178 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 28 08:12:39.082178 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:12:39.082178 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:12:39.082178 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:12:39.082178 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:12:39.082178 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:12:39.082178 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:12:39.089686 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:12:39.089686 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application with Lock( Jul 28 08:12:39.089686 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:12:39.089686 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:12:39.089686 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:12:39.089686 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:12:39.089686 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:12:39.089686 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:12:39.089686 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:12:39.089686 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:12:39.089686 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 28 08:12:39.089686 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 08:12:39.089686 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 28 08:12:39.089686 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application Jul 28 08:12:39.089686 dv-cinder-851351-1-smb devstack@keystone.service[144068]: [pid: 144068|app: 0|req: 493/972] 10.222.0.42 () {56 vars in 1111 bytes} [Thu Jul 28 08:12:38 2022] GET /identity/v3/services/compute => generated 88 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 08:12:39.090467 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f112f9-6885-4dd4-b020-3e8cd8258b9f None admin] Authenticating user token {{(pid=144068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:12:39.102092 dv-cinder-851351-1-smb devstack@keystone.service[144067]: [pid: 144067|app: 0|req: 480/973] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 08:12:38 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 08:12:39.127951 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG dbcounter [-] [144068] Writing DB stats keystone:SELECT=100 {{(pid=144068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:12:39.131282 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b5aa17-2959-4d5c-9c13-9dbc5472cad3 None None] Authenticating user token {{(pid=144067) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:12:39.165247 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG dbcounter [-] [144067] Writing DB stats keystone:SELECT=100 {{(pid=144067) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:12:39.224807 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f112f9-6885-4dd4-b020-3e8cd8258b9f None admin] Validating token access rules against request {{(pid=144068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:12:39.266847 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b5aa17-2959-4d5c-9c13-9dbc5472cad3 None None] Validating token access rules against request {{(pid=144067) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:12:39.273427 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f428c2c-fcf0-4ca7-998b-e16c98967db4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:12:39.274714 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f428c2c-fcf0-4ca7-998b-e16c98967db4 None admin] REQUEST_METHOD: `GET` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:12:39.275062 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f428c2c-fcf0-4ca7-998b-e16c98967db4 None admin] SCRIPT_NAME: `/identity` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:12:39.275338 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f428c2c-fcf0-4ca7-998b-e16c98967db4 None admin] PATH_INFO: `/v3/services` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:12:39.276030 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f428c2c-fcf0-4ca7-998b-e16c98967db4 None admin] RBAC: Adding query filter params (name=compute) {{(pid=144068) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:12:39.276338 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f428c2c-fcf0-4ca7-998b-e16c98967db4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:12:39.277807 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f428c2c-fcf0-4ca7-998b-e16c98967db4 None admin] RBAC: Authorization granted {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:12:39.283855 dv-cinder-851351-1-smb devstack@keystone.service[144068]: [pid: 144068|app: 0|req: 494/974] 10.222.0.42 () {56 vars in 1112 bytes} [Thu Jul 28 08:12:39 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:12:39.289905 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f428c2c-fcf0-4ca7-998b-e16c98967db4 None admin] Authenticating user token {{(pid=144068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:12:39.315324 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c8b0b9-8304-4b0e-a022-384d480cca8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144067) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:12:39.316048 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c8b0b9-8304-4b0e-a022-384d480cca8d None admin] REQUEST_METHOD: `GET` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:12:39.316329 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c8b0b9-8304-4b0e-a022-384d480cca8d None admin] SCRIPT_NAME: `/identity` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:12:39.316605 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c8b0b9-8304-4b0e-a022-384d480cca8d None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:12:39.327685 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75c8b0b9-8304-4b0e-a022-384d480cca8d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 08:12:39.332811 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application [None req-75c8b0b9-8304-4b0e-a022-384d480cca8d None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 28 08:12:39.332811 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:12:39.332811 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:12:39.332811 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:12:39.332811 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:12:39.332811 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:12:39.332811 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:12:39.332811 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:12:39.332811 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:12:39.332811 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:12:39.332811 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:12:39.332811 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:12:39.332811 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 08:12:39.332811 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 08:12:39.332811 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 08:12:39.332811 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 08:12:39.333737 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 08:12:39.333737 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 08:12:39.333737 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 08:12:39.333737 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 08:12:39.333737 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:12:39.333737 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:12:39.333737 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:12:39.333737 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:12:39.333737 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:12:39.333737 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:12:39.333737 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:12:39.333737 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application with Lock( Jul 28 08:12:39.333737 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:12:39.333737 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:12:39.333737 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:12:39.333737 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:12:39.334550 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:12:39.334550 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:12:39.334550 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:12:39.334550 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:12:39.334550 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 08:12:39.334550 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 08:12:39.334550 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 08:12:39.334550 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 08:12:39.334550 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 08:12:39.334550 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 08:12:39.334550 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 28 08:12:39.334550 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application Jul 28 08:12:39.334550 dv-cinder-851351-1-smb devstack@keystone.service[144067]: [pid: 144067|app: 0|req: 481/975] 10.222.0.42 () {56 vars in 1120 bytes} [Thu Jul 28 08:12:39 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:12:39.342165 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c8b0b9-8304-4b0e-a022-384d480cca8d None admin] Authenticating user token {{(pid=144067) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:12:39.399223 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG dbcounter [-] [144068] Writing DB stats keystone:SELECT=100 {{(pid=144068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:12:39.409911 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f428c2c-fcf0-4ca7-998b-e16c98967db4 None admin] Validating token access rules against request {{(pid=144068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:12:39.440490 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG dbcounter [-] [144067] Writing DB stats keystone:SELECT=100 {{(pid=144067) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:12:39.448547 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1af7c0-26ba-485b-a561-473dc513bea3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:12:39.449219 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1af7c0-26ba-485b-a561-473dc513bea3 None admin] REQUEST_METHOD: `GET` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:12:39.449500 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1af7c0-26ba-485b-a561-473dc513bea3 None admin] SCRIPT_NAME: `/identity` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:12:39.449773 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1af7c0-26ba-485b-a561-473dc513bea3 None admin] PATH_INFO: `/v3/services` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:12:39.450465 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f1af7c0-26ba-485b-a561-473dc513bea3 None admin] RBAC: Adding query filter params (type=compute) {{(pid=144068) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:12:39.450769 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f1af7c0-26ba-485b-a561-473dc513bea3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:12:39.452142 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f1af7c0-26ba-485b-a561-473dc513bea3 None admin] RBAC: Authorization granted {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:12:39.454119 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c8b0b9-8304-4b0e-a022-384d480cca8d None admin] Validating token access rules against request {{(pid=144067) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:12:39.462470 dv-cinder-851351-1-smb devstack@keystone.service[144068]: [pid: 144068|app: 0|req: 495/976] 10.222.0.42 () {56 vars in 1112 bytes} [Thu Jul 28 08:12:39 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 08:12:39.463511 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1af7c0-26ba-485b-a561-473dc513bea3 None admin] Authenticating user token {{(pid=144068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:12:39.496689 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a8f5615-3acc-4723-b330-269a4f82fcf1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144067) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:12:39.497469 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8f5615-3acc-4723-b330-269a4f82fcf1 None admin] REQUEST_METHOD: `GET` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:12:39.497577 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8f5615-3acc-4723-b330-269a4f82fcf1 None admin] SCRIPT_NAME: `/identity` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:12:39.497802 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8f5615-3acc-4723-b330-269a4f82fcf1 None admin] PATH_INFO: `/v3/roles` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:12:39.498529 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a8f5615-3acc-4723-b330-269a4f82fcf1 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=144067) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:12:39.498841 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a8f5615-3acc-4723-b330-269a4f82fcf1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:12:39.500238 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a8f5615-3acc-4723-b330-269a4f82fcf1 None admin] RBAC: Authorization granted {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:12:39.509207 dv-cinder-851351-1-smb devstack@keystone.service[144067]: [pid: 144067|app: 0|req: 482/977] 10.222.0.42 () {56 vars in 1115 bytes} [Thu Jul 28 08:12:39 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 08:12:39.515063 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a8f5615-3acc-4723-b330-269a4f82fcf1 None admin] Authenticating user token {{(pid=144067) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:12:39.578154 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1af7c0-26ba-485b-a561-473dc513bea3 None admin] Validating token access rules against request {{(pid=144068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:12:39.617660 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e091f979-130a-42d6-b674-293b7bf2fe63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:12:39.618321 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e091f979-130a-42d6-b674-293b7bf2fe63 None admin] REQUEST_METHOD: `GET` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:12:39.618611 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e091f979-130a-42d6-b674-293b7bf2fe63 None admin] SCRIPT_NAME: `/identity` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:12:39.618895 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e091f979-130a-42d6-b674-293b7bf2fe63 None admin] PATH_INFO: `/v3/endpoints` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:12:39.619708 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e091f979-130a-42d6-b674-293b7bf2fe63 None admin] RBAC: Adding query filter params (interface=public, service_id=545bb1eb9c04474c8a53ec2ed462dd99, region_id=RegionOne) {{(pid=144068) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:12:39.620024 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e091f979-130a-42d6-b674-293b7bf2fe63 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:12:39.621472 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e091f979-130a-42d6-b674-293b7bf2fe63 None admin] RBAC: Authorization granted {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:12:39.627188 dv-cinder-851351-1-smb devstack@keystone.service[144068]: [pid: 144068|app: 0|req: 496/978] 10.222.0.42 () {56 vars in 1251 bytes} [Thu Jul 28 08:12:39 2022] GET /identity/v3/endpoints?service_id=545bb1eb9c04474c8a53ec2ed462dd99&interface=public®ion_id=RegionOne => generated 194 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:12:39.632935 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e091f979-130a-42d6-b674-293b7bf2fe63 None admin] Authenticating user token {{(pid=144068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:12:39.633372 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a8f5615-3acc-4723-b330-269a4f82fcf1 None admin] Validating token access rules against request {{(pid=144067) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:12:39.653927 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG dbcounter [-] [144068] Writing DB stats keystone:SELECT=100 {{(pid=144068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:12:39.674884 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7371e340-0740-4b30-892c-98288d0f5e25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144067) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:12:39.675868 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7371e340-0740-4b30-892c-98288d0f5e25 None admin] REQUEST_METHOD: `GET` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:12:39.676457 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7371e340-0740-4b30-892c-98288d0f5e25 None admin] SCRIPT_NAME: `/identity` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:12:39.676851 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7371e340-0740-4b30-892c-98288d0f5e25 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:12:39.689585 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7371e340-0740-4b30-892c-98288d0f5e25 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:12:39.691348 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7371e340-0740-4b30-892c-98288d0f5e25 None admin] RBAC: Authorization granted {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:12:39.710163 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application [None req-7371e340-0740-4b30-892c-98288d0f5e25 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 08:12:39.710163 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:12:39.710163 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:12:39.710163 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:12:39.710163 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:12:39.710163 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:12:39.710163 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:12:39.710163 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:12:39.710163 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:12:39.710163 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:12:39.710163 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:12:39.710163 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:12:39.710163 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 08:12:39.710163 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 08:12:39.710163 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 08:12:39.711676 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 08:12:39.711676 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:12:39.711676 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:12:39.711676 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:12:39.711676 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:12:39.711676 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:12:39.711676 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:12:39.711676 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:12:39.711676 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application with Lock( Jul 28 08:12:39.711676 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:12:39.711676 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:12:39.711676 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:12:39.711676 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:12:39.711676 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:12:39.711676 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:12:39.711676 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:12:39.711676 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:12:39.712625 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 08:12:39.712625 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 08:12:39.712625 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 08:12:39.712625 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application Jul 28 08:12:39.712625 dv-cinder-851351-1-smb devstack@keystone.service[144067]: [pid: 144067|app: 0|req: 483/979] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 08:12:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 08:12:39.718721 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7371e340-0740-4b30-892c-98288d0f5e25 None admin] Authenticating user token {{(pid=144067) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:12:39.722002 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG dbcounter [-] [144067] Writing DB stats keystone:SELECT=100 {{(pid=144067) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:12:39.761617 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e091f979-130a-42d6-b674-293b7bf2fe63 None admin] Validating token access rules against request {{(pid=144068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:12:39.810083 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2c1288-24a5-4a1a-bcbd-383f198e4b12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:12:39.810736 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2c1288-24a5-4a1a-bcbd-383f198e4b12 None admin] REQUEST_METHOD: `GET` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:12:39.811019 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2c1288-24a5-4a1a-bcbd-383f198e4b12 None admin] SCRIPT_NAME: `/identity` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:12:39.811295 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2c1288-24a5-4a1a-bcbd-383f198e4b12 None admin] PATH_INFO: `/v3/services` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:12:39.811977 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b2c1288-24a5-4a1a-bcbd-383f198e4b12 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:12:39.813431 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b2c1288-24a5-4a1a-bcbd-383f198e4b12 None admin] RBAC: Authorization granted {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:12:39.820623 dv-cinder-851351-1-smb devstack@keystone.service[144068]: [pid: 144068|app: 0|req: 497/980] 10.222.0.42 () {56 vars in 1087 bytes} [Thu Jul 28 08:12:39 2022] GET /identity/v3/services => generated 1727 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 08:12:39.842841 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7371e340-0740-4b30-892c-98288d0f5e25 None admin] Validating token access rules against request {{(pid=144067) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:12:39.883026 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a1c72e-5634-4bfa-a9ba-8e00ad2d978d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144067) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:12:39.884000 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a1c72e-5634-4bfa-a9ba-8e00ad2d978d None admin] REQUEST_METHOD: `GET` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:12:39.884516 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a1c72e-5634-4bfa-a9ba-8e00ad2d978d None admin] SCRIPT_NAME: `/identity` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:12:39.884984 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a1c72e-5634-4bfa-a9ba-8e00ad2d978d None admin] PATH_INFO: `/v3/domains` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:12:39.886214 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9a1c72e-5634-4bfa-a9ba-8e00ad2d978d None admin] RBAC: Adding query filter params (name=Default) {{(pid=144067) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:12:39.886732 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9a1c72e-5634-4bfa-a9ba-8e00ad2d978d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:12:39.888337 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9a1c72e-5634-4bfa-a9ba-8e00ad2d978d None admin] RBAC: Authorization granted {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:12:39.907671 dv-cinder-851351-1-smb devstack@keystone.service[144067]: [pid: 144067|app: 0|req: 484/981] 10.222.0.42 () {56 vars in 1109 bytes} [Thu Jul 28 08:12:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:12:39.908748 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2c1288-24a5-4a1a-bcbd-383f198e4b12 None admin] Authenticating user token {{(pid=144068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:12:40.016955 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG dbcounter [-] [144068] Writing DB stats keystone:SELECT=100 {{(pid=144068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:12:40.037359 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2c1288-24a5-4a1a-bcbd-383f198e4b12 None admin] Validating token access rules against request {{(pid=144068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:12:40.072593 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deac6c51-bfd0-4816-96ad-443b5efdce0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:12:40.073283 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deac6c51-bfd0-4816-96ad-443b5efdce0d None admin] REQUEST_METHOD: `GET` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:12:40.073569 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deac6c51-bfd0-4816-96ad-443b5efdce0d None admin] SCRIPT_NAME: `/identity` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:12:40.073848 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deac6c51-bfd0-4816-96ad-443b5efdce0d None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:12:40.082213 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deac6c51-bfd0-4816-96ad-443b5efdce0d None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:12:40.083691 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deac6c51-bfd0-4816-96ad-443b5efdce0d None admin] RBAC: Authorization granted {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:12:40.096301 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application [None req-deac6c51-bfd0-4816-96ad-443b5efdce0d None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 28 08:12:40.096301 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:12:40.096301 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:12:40.096301 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:12:40.096301 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:12:40.096301 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:12:40.096301 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:12:40.096301 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:12:40.096301 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:12:40.096301 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:12:40.096301 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:12:40.096301 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:12:40.096301 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 28 08:12:40.096301 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 28 08:12:40.096301 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 28 08:12:40.096301 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 28 08:12:40.097358 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:12:40.097358 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:12:40.097358 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 28 08:12:40.097358 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 08:12:40.097358 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 28 08:12:40.097358 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 08:12:40.097358 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:12:40.097358 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:12:40.097358 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:12:40.097358 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:12:40.097358 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:12:40.097358 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application with Lock( Jul 28 08:12:40.097358 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:12:40.097358 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:12:40.097358 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:12:40.097358 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:12:40.097358 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:12:40.097358 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:12:40.098241 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:12:40.098241 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:12:40.098241 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 28 08:12:40.098241 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 28 08:12:40.098241 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 28 08:12:40.098241 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 28 08:12:40.098241 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 28 08:12:40.098241 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 28 08:12:40.098241 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 28 08:12:40.098241 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application Jul 28 08:12:40.098241 dv-cinder-851351-1-smb devstack@keystone.service[144068]: [pid: 144068|app: 0|req: 498/982] 10.222.0.42 () {56 vars in 1117 bytes} [Thu Jul 28 08:12:39 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:12:40.105029 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a1c72e-5634-4bfa-a9ba-8e00ad2d978d None admin] Authenticating user token {{(pid=144067) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:12:40.171578 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG dbcounter [-] [144067] Writing DB stats keystone:SELECT=100 {{(pid=144067) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:12:40.215201 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a1c72e-5634-4bfa-a9ba-8e00ad2d978d None admin] Validating token access rules against request {{(pid=144067) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:12:40.230325 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec000a9-144b-460d-8d0f-f312a0b7fac9 None None] REQUEST_METHOD: `GET` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:12:40.230613 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec000a9-144b-460d-8d0f-f312a0b7fac9 None None] SCRIPT_NAME: `/identity` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:12:40.230891 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec000a9-144b-460d-8d0f-f312a0b7fac9 None None] PATH_INFO: `/` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:12:40.232276 dv-cinder-851351-1-smb devstack@keystone.service[144068]: [pid: 144068|app: 0|req: 499/983] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 08:12:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 28 08:12:40.237343 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347345eb-5e25-41c3-b353-f527c21a5f2a None None] REQUEST_METHOD: `POST` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:12:40.237604 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347345eb-5e25-41c3-b353-f527c21a5f2a None None] SCRIPT_NAME: `/identity` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:12:40.237961 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347345eb-5e25-41c3-b353-f527c21a5f2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:12:40.255102 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0543e0ce-7401-4ebe-bdb8-3f1d82a1471f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144067) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:12:40.255754 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0543e0ce-7401-4ebe-bdb8-3f1d82a1471f None admin] REQUEST_METHOD: `GET` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:12:40.256085 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0543e0ce-7401-4ebe-bdb8-3f1d82a1471f None admin] SCRIPT_NAME: `/identity` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:12:40.256360 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.auth.core [None req-347345eb-5e25-41c3-b353-f527c21a5f2a None None] MFA Rules not processed for user `bf5ceb8f07374635ad506b7d1b4f1612`. Rule list: `[]` (Enabled: `True`). {{(pid=144068) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 08:12:40.256461 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0543e0ce-7401-4ebe-bdb8-3f1d82a1471f None admin] PATH_INFO: `/v3/users` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:12:40.257207 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0543e0ce-7401-4ebe-bdb8-3f1d82a1471f None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=144067) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:12:40.257515 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0543e0ce-7401-4ebe-bdb8-3f1d82a1471f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:12:40.257608 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.fernet_utils [None req-347345eb-5e25-41c3-b353-f527c21a5f2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=144068) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:12:40.259045 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0543e0ce-7401-4ebe-bdb8-3f1d82a1471f None admin] RBAC: Authorization granted {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:12:40.281546 dv-cinder-851351-1-smb devstack@keystone.service[144067]: [pid: 144067|app: 0|req: 485/984] 10.222.0.42 () {56 vars in 1149 bytes} [Thu Jul 28 08:12:40 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:12:40.287198 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0543e0ce-7401-4ebe-bdb8-3f1d82a1471f None admin] Authenticating user token {{(pid=144067) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:12:40.335441 dv-cinder-851351-1-smb devstack@keystone.service[144068]: [pid: 144068|app: 0|req: 500/985] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 08:12:40 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 28 08:12:40.357922 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347345eb-5e25-41c3-b353-f527c21a5f2a None None] Authenticating user token {{(pid=144068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:12:40.398009 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0543e0ce-7401-4ebe-bdb8-3f1d82a1471f None admin] Validating token access rules against request {{(pid=144067) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:12:40.420284 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG dbcounter [-] [144067] Writing DB stats keystone:SELECT=100 {{(pid=144067) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:12:40.431318 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG dbcounter [-] [144068] Writing DB stats keystone:SELECT=100 {{(pid=144068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:12:40.439552 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a3cb17-c839-46fe-8bb3-c497a547e0b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144067) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:12:40.440513 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a3cb17-c839-46fe-8bb3-c497a547e0b1 None admin] REQUEST_METHOD: `GET` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:12:40.440949 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a3cb17-c839-46fe-8bb3-c497a547e0b1 None admin] SCRIPT_NAME: `/identity` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:12:40.441375 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a3cb17-c839-46fe-8bb3-c497a547e0b1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:12:40.465116 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347345eb-5e25-41c3-b353-f527c21a5f2a None None] Validating token access rules against request {{(pid=144068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:12:40.504051 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280a9cc1-b881-4343-b4d6-1d29d1e3ee38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:12:40.504836 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280a9cc1-b881-4343-b4d6-1d29d1e3ee38 None admin] REQUEST_METHOD: `GET` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:12:40.505229 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280a9cc1-b881-4343-b4d6-1d29d1e3ee38 None admin] SCRIPT_NAME: `/identity` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:12:40.505511 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280a9cc1-b881-4343-b4d6-1d29d1e3ee38 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:12:40.506217 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-280a9cc1-b881-4343-b4d6-1d29d1e3ee38 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:12:40.507658 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-280a9cc1-b881-4343-b4d6-1d29d1e3ee38 None admin] RBAC: Authorization granted {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:12:40.512212 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53a3cb17-c839-46fe-8bb3-c497a547e0b1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:12:40.513714 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53a3cb17-c839-46fe-8bb3-c497a547e0b1 None admin] RBAC: Authorization granted {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:12:40.517234 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application [None req-280a9cc1-b881-4343-b4d6-1d29d1e3ee38 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 28 08:12:40.517234 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:12:40.517234 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 28 08:12:40.517234 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 28 08:12:40.517234 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 28 08:12:40.517234 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 28 08:12:40.517234 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 28 08:12:40.517234 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 08:12:40.517234 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 28 08:12:40.517234 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application Jul 28 08:12:40.517234 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 28 08:12:40.517234 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application Jul 28 08:12:40.517234 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:12:40.517234 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:12:40.517234 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:12:40.517234 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:12:40.517234 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:12:40.518207 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:12:40.518207 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:12:40.518207 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:12:40.518207 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:12:40.518207 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:12:40.518207 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:12:40.518207 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 28 08:12:40.518207 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 28 08:12:40.518207 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 28 08:12:40.518207 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 28 08:12:40.518207 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:12:40.518207 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:12:40.518207 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:12:40.518207 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:12:40.518207 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:12:40.518207 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:12:40.519071 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:12:40.519071 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application with Lock( Jul 28 08:12:40.519071 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:12:40.519071 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:12:40.519071 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:12:40.519071 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:12:40.519071 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:12:40.519071 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:12:40.519071 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:12:40.519071 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:12:40.519071 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 28 08:12:40.519071 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 08:12:40.519071 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 28 08:12:40.519071 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application Jul 28 08:12:40.519071 dv-cinder-851351-1-smb devstack@keystone.service[144068]: [pid: 144068|app: 0|req: 501/986] 10.222.0.42 () {56 vars in 1126 bytes} [Thu Jul 28 08:12:40 2022] GET /identity/v3/services/object-store => generated 93 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:12:40.524861 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280a9cc1-b881-4343-b4d6-1d29d1e3ee38 None admin] Authenticating user token {{(pid=144068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:12:40.624729 dv-cinder-851351-1-smb devstack@keystone.service[144067]: [pid: 144067|app: 0|req: 486/987] 10.222.0.42 () {58 vars in 1282 bytes} [Thu Jul 28 08:12:40 2022] GET /identity/v3/auth/tokens => generated 1560 bytes in 338 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 28 08:12:40.630348 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a3cb17-c839-46fe-8bb3-c497a547e0b1 None admin] Authenticating user token {{(pid=144067) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:12:40.640609 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280a9cc1-b881-4343-b4d6-1d29d1e3ee38 None admin] Validating token access rules against request {{(pid=144068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:12:40.652218 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG dbcounter [-] [144067] Writing DB stats keystone:SELECT=100 {{(pid=144067) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:12:40.677232 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75cd8a9-f327-4d50-804d-920c24e5064d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:12:40.678178 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75cd8a9-f327-4d50-804d-920c24e5064d None admin] REQUEST_METHOD: `GET` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:12:40.678465 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75cd8a9-f327-4d50-804d-920c24e5064d None admin] SCRIPT_NAME: `/identity` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:12:40.678895 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75cd8a9-f327-4d50-804d-920c24e5064d None admin] PATH_INFO: `/v3/services` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:12:40.679593 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c75cd8a9-f327-4d50-804d-920c24e5064d None admin] RBAC: Adding query filter params (name=object-store) {{(pid=144068) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:12:40.679899 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c75cd8a9-f327-4d50-804d-920c24e5064d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:12:40.681688 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c75cd8a9-f327-4d50-804d-920c24e5064d None admin] RBAC: Authorization granted {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:12:40.683240 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG dbcounter [-] [144068] Writing DB stats keystone:SELECT=100 {{(pid=144068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:12:40.692824 dv-cinder-851351-1-smb devstack@keystone.service[144068]: [pid: 144068|app: 0|req: 502/988] 10.222.0.42 () {56 vars in 1122 bytes} [Thu Jul 28 08:12:40 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 08:12:40.693557 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75cd8a9-f327-4d50-804d-920c24e5064d None admin] Authenticating user token {{(pid=144068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:12:40.750845 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a3cb17-c839-46fe-8bb3-c497a547e0b1 None admin] Validating token access rules against request {{(pid=144067) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:12:40.792770 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f44fe03-1d82-4b6b-b70c-ca5653c0b48a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144067) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:12:40.793434 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f44fe03-1d82-4b6b-b70c-ca5653c0b48a None admin] REQUEST_METHOD: `GET` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:12:40.793720 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f44fe03-1d82-4b6b-b70c-ca5653c0b48a None admin] SCRIPT_NAME: `/identity` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:12:40.793994 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f44fe03-1d82-4b6b-b70c-ca5653c0b48a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:12:40.805167 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f44fe03-1d82-4b6b-b70c-ca5653c0b48a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:12:40.806641 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f44fe03-1d82-4b6b-b70c-ca5653c0b48a None admin] RBAC: Authorization granted {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:12:40.819482 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75cd8a9-f327-4d50-804d-920c24e5064d None admin] Validating token access rules against request {{(pid=144068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:12:40.822199 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application [None req-7f44fe03-1d82-4b6b-b70c-ca5653c0b48a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 08:12:40.822199 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:12:40.822199 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:12:40.822199 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:12:40.822199 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:12:40.822199 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:12:40.822199 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:12:40.822199 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:12:40.822199 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:12:40.822199 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:12:40.822199 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:12:40.822199 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:12:40.822199 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 08:12:40.822199 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 08:12:40.822199 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 08:12:40.823158 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 08:12:40.823158 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:12:40.823158 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:12:40.823158 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:12:40.823158 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:12:40.823158 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:12:40.823158 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:12:40.823158 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:12:40.823158 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application with Lock( Jul 28 08:12:40.823158 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:12:40.823158 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:12:40.823158 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:12:40.823158 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:12:40.823158 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:12:40.823158 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:12:40.823158 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:12:40.823158 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:12:40.823992 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 08:12:40.823992 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 08:12:40.823992 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 08:12:40.823992 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application Jul 28 08:12:40.823992 dv-cinder-851351-1-smb devstack@keystone.service[144067]: [pid: 144067|app: 0|req: 487/989] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 08:12:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 08:12:40.829008 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f44fe03-1d82-4b6b-b70c-ca5653c0b48a None admin] Authenticating user token {{(pid=144067) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:12:40.857426 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5be92c-c37c-442d-8dbc-f9fdf7f1ddf5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:12:40.858318 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5be92c-c37c-442d-8dbc-f9fdf7f1ddf5 None admin] REQUEST_METHOD: `GET` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:12:40.858647 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5be92c-c37c-442d-8dbc-f9fdf7f1ddf5 None admin] SCRIPT_NAME: `/identity` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:12:40.859240 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5be92c-c37c-442d-8dbc-f9fdf7f1ddf5 None admin] PATH_INFO: `/v3/services` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:12:40.860146 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e5be92c-c37c-442d-8dbc-f9fdf7f1ddf5 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=144068) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:12:40.860459 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e5be92c-c37c-442d-8dbc-f9fdf7f1ddf5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:12:40.861894 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e5be92c-c37c-442d-8dbc-f9fdf7f1ddf5 None admin] RBAC: Authorization granted {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:12:40.867301 dv-cinder-851351-1-smb devstack@keystone.service[144068]: [pid: 144068|app: 0|req: 503/990] 10.222.0.42 () {56 vars in 1122 bytes} [Thu Jul 28 08:12:40 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:12:40.873202 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5be92c-c37c-442d-8dbc-f9fdf7f1ddf5 None admin] Authenticating user token {{(pid=144068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:12:40.912236 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG dbcounter [-] [144067] Writing DB stats keystone:SELECT=100 {{(pid=144067) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:12:40.937905 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG dbcounter [-] [144068] Writing DB stats keystone:SELECT=100 {{(pid=144068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:12:40.943877 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f44fe03-1d82-4b6b-b70c-ca5653c0b48a None admin] Validating token access rules against request {{(pid=144067) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:12:40.983811 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5be92c-c37c-442d-8dbc-f9fdf7f1ddf5 None admin] Validating token access rules against request {{(pid=144068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:12:40.988226 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-942e24ff-a511-4b1f-961c-282fea94e804 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144067) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:12:40.988909 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942e24ff-a511-4b1f-961c-282fea94e804 None admin] REQUEST_METHOD: `GET` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:12:40.989195 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942e24ff-a511-4b1f-961c-282fea94e804 None admin] SCRIPT_NAME: `/identity` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:12:40.989473 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942e24ff-a511-4b1f-961c-282fea94e804 None admin] PATH_INFO: `/v3/domains` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:12:40.990195 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-942e24ff-a511-4b1f-961c-282fea94e804 None admin] RBAC: Adding query filter params (name=Default) {{(pid=144067) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:12:40.990498 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-942e24ff-a511-4b1f-961c-282fea94e804 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:12:40.991906 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-942e24ff-a511-4b1f-961c-282fea94e804 None admin] RBAC: Authorization granted {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:12:41.009020 dv-cinder-851351-1-smb devstack@keystone.service[144067]: [pid: 144067|app: 0|req: 488/991] 10.222.0.42 () {56 vars in 1109 bytes} [Thu Jul 28 08:12:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 08:12:41.010157 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-942e24ff-a511-4b1f-961c-282fea94e804 None admin] Authenticating user token {{(pid=144067) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:12:41.024571 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1bcf96f-a0fe-434a-a9d5-593315406813 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:12:41.025486 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1bcf96f-a0fe-434a-a9d5-593315406813 None admin] REQUEST_METHOD: `GET` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:12:41.025866 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1bcf96f-a0fe-434a-a9d5-593315406813 None admin] SCRIPT_NAME: `/identity` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:12:41.026360 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1bcf96f-a0fe-434a-a9d5-593315406813 None admin] PATH_INFO: `/v3/endpoints` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:12:41.027233 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1bcf96f-a0fe-434a-a9d5-593315406813 None admin] RBAC: Adding query filter params (interface=admin, service_id=15269930d9414981ba19c2deffcb1acd, region_id=RegionOne) {{(pid=144068) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:12:41.027648 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1bcf96f-a0fe-434a-a9d5-593315406813 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:12:41.029270 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1bcf96f-a0fe-434a-a9d5-593315406813 None admin] RBAC: Authorization granted {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:12:41.035413 dv-cinder-851351-1-smb devstack@keystone.service[144068]: [pid: 144068|app: 0|req: 504/992] 10.222.0.42 () {56 vars in 1249 bytes} [Thu Jul 28 08:12:40 2022] GET /identity/v3/endpoints?service_id=15269930d9414981ba19c2deffcb1acd&interface=admin®ion_id=RegionOne => generated 193 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 08:12:41.041008 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1bcf96f-a0fe-434a-a9d5-593315406813 None admin] Authenticating user token {{(pid=144068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:12:41.128516 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-942e24ff-a511-4b1f-961c-282fea94e804 None admin] Validating token access rules against request {{(pid=144067) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:12:41.158703 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG dbcounter [-] [144067] Writing DB stats keystone:SELECT=100 {{(pid=144067) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:12:41.160573 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1bcf96f-a0fe-434a-a9d5-593315406813 None admin] Validating token access rules against request {{(pid=144068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:12:41.164835 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364dc60a-4438-4dcf-97b2-29fdfcac8071 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144067) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:12:41.165444 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364dc60a-4438-4dcf-97b2-29fdfcac8071 None admin] REQUEST_METHOD: `GET` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:12:41.165728 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364dc60a-4438-4dcf-97b2-29fdfcac8071 None admin] SCRIPT_NAME: `/identity` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:12:41.166007 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364dc60a-4438-4dcf-97b2-29fdfcac8071 None admin] PATH_INFO: `/v3/projects/service` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:12:41.173323 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-364dc60a-4438-4dcf-97b2-29fdfcac8071 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:12:41.175100 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-364dc60a-4438-4dcf-97b2-29fdfcac8071 None admin] RBAC: Authorization granted {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:12:41.187095 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG dbcounter [-] [144068] Writing DB stats keystone:SELECT=100 {{(pid=144068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:12:41.188230 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application [None req-364dc60a-4438-4dcf-97b2-29fdfcac8071 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 08:12:41.188230 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:12:41.188230 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:12:41.188230 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:12:41.188230 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:12:41.188230 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:12:41.188230 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:12:41.188230 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:12:41.188230 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:12:41.188230 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:12:41.188230 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:12:41.188230 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:12:41.188230 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 28 08:12:41.188230 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 28 08:12:41.188230 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 28 08:12:41.194553 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 28 08:12:41.194553 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:12:41.194553 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:12:41.194553 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:12:41.194553 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:12:41.194553 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:12:41.194553 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:12:41.194553 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:12:41.194553 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application with Lock( Jul 28 08:12:41.194553 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:12:41.194553 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:12:41.194553 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:12:41.194553 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:12:41.194553 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:12:41.194553 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:12:41.194553 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:12:41.194553 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:12:41.195638 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 28 08:12:41.195638 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 28 08:12:41.195638 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 28 08:12:41.195638 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 28 08:12:41.195638 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 28 08:12:41.195638 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 28 08:12:41.195638 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 08:12:41.195638 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application Jul 28 08:12:41.195638 dv-cinder-851351-1-smb devstack@keystone.service[144067]: [pid: 144067|app: 0|req: 489/993] 10.222.0.42 () {56 vars in 1111 bytes} [Thu Jul 28 08:12:41 2022] GET /identity/v3/projects/service => generated 88 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:12:41.197595 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364dc60a-4438-4dcf-97b2-29fdfcac8071 None admin] Authenticating user token {{(pid=144067) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:12:41.204058 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bda57d0-40b7-40c4-9016-86d01535ff23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:12:41.204818 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bda57d0-40b7-40c4-9016-86d01535ff23 None admin] REQUEST_METHOD: `GET` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:12:41.205162 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bda57d0-40b7-40c4-9016-86d01535ff23 None admin] SCRIPT_NAME: `/identity` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:12:41.205503 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bda57d0-40b7-40c4-9016-86d01535ff23 None admin] PATH_INFO: `/v3/services` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:12:41.206217 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bda57d0-40b7-40c4-9016-86d01535ff23 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:12:41.207688 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bda57d0-40b7-40c4-9016-86d01535ff23 None admin] RBAC: Authorization granted {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:12:41.214495 dv-cinder-851351-1-smb devstack@keystone.service[144068]: [pid: 144068|app: 0|req: 505/994] 10.222.0.42 () {56 vars in 1087 bytes} [Thu Jul 28 08:12:41 2022] GET /identity/v3/services => generated 1727 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 28 08:12:41.313972 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364dc60a-4438-4dcf-97b2-29fdfcac8071 None admin] Validating token access rules against request {{(pid=144067) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:12:41.353070 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f561126c-43df-490b-b0c3-b41e01d8ad0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144067) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:12:41.353798 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f561126c-43df-490b-b0c3-b41e01d8ad0d None admin] REQUEST_METHOD: `GET` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:12:41.354149 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f561126c-43df-490b-b0c3-b41e01d8ad0d None admin] SCRIPT_NAME: `/identity` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:12:41.354493 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f561126c-43df-490b-b0c3-b41e01d8ad0d None admin] PATH_INFO: `/v3/projects` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:12:41.355460 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f561126c-43df-490b-b0c3-b41e01d8ad0d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=144067) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:12:41.355837 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f561126c-43df-490b-b0c3-b41e01d8ad0d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:12:41.357522 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f561126c-43df-490b-b0c3-b41e01d8ad0d None admin] RBAC: Authorization granted {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:12:41.376539 dv-cinder-851351-1-smb devstack@keystone.service[144067]: [pid: 144067|app: 0|req: 490/995] 10.222.0.42 () {56 vars in 1148 bytes} [Thu Jul 28 08:12:41 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:12:41.378526 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bda57d0-40b7-40c4-9016-86d01535ff23 None admin] Authenticating user token {{(pid=144068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:12:41.488746 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bda57d0-40b7-40c4-9016-86d01535ff23 None admin] Validating token access rules against request {{(pid=144068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:12:41.524862 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07acda47-ba3a-4670-a5c3-5864b756196e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:12:41.525492 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07acda47-ba3a-4670-a5c3-5864b756196e None admin] REQUEST_METHOD: `GET` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:12:41.525754 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07acda47-ba3a-4670-a5c3-5864b756196e None admin] SCRIPT_NAME: `/identity` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:12:41.526058 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07acda47-ba3a-4670-a5c3-5864b756196e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:12:41.526841 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07acda47-ba3a-4670-a5c3-5864b756196e None admin] RBAC: Adding query filter params (role.id=cfa933c7b37b473c8e22091c8b829530, scope.project.id=fa39ab7491e5413ca648e31ee9177fa0, user.id=64acbde3263f4bb8b102034fc3a9d4e6) {{(pid=144068) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:12:41.527183 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07acda47-ba3a-4670-a5c3-5864b756196e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:12:41.528628 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07acda47-ba3a-4670-a5c3-5864b756196e None admin] RBAC: Authorization granted {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:12:41.540715 dv-cinder-851351-1-smb devstack@keystone.service[144068]: [pid: 144068|app: 0|req: 506/996] 10.222.0.42 () {56 vars in 1374 bytes} [Thu Jul 28 08:12:41 2022] GET /identity/v3/role_assignments?user.id=64acbde3263f4bb8b102034fc3a9d4e6&scope.project.id=fa39ab7491e5413ca648e31ee9177fa0&role.id=cfa933c7b37b473c8e22091c8b829530 => generated 608 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:12:41.864735 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8bbad3-590a-419f-8cc0-0b35d0abf5ea None None] REQUEST_METHOD: `GET` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:12:41.865098 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8bbad3-590a-419f-8cc0-0b35d0abf5ea None None] SCRIPT_NAME: `/identity` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:12:41.865280 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8bbad3-590a-419f-8cc0-0b35d0abf5ea None None] PATH_INFO: `/` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:12:41.866870 dv-cinder-851351-1-smb devstack@keystone.service[144067]: [pid: 144067|app: 0|req: 491/997] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 08:12:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 08:12:41.872149 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5aab8f0-65ee-420b-9201-37f0f92d9a59 None None] REQUEST_METHOD: `POST` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:12:41.872428 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5aab8f0-65ee-420b-9201-37f0f92d9a59 None None] SCRIPT_NAME: `/identity` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:12:41.872739 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5aab8f0-65ee-420b-9201-37f0f92d9a59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:12:41.891846 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.auth.core [None req-a5aab8f0-65ee-420b-9201-37f0f92d9a59 None None] MFA Rules not processed for user `bf5ceb8f07374635ad506b7d1b4f1612`. Rule list: `[]` (Enabled: `True`). {{(pid=144068) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 08:12:41.893088 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.fernet_utils [None req-a5aab8f0-65ee-420b-9201-37f0f92d9a59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=144068) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:12:41.947594 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG dbcounter [-] [144068] Writing DB stats keystone:SELECT=100 {{(pid=144068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:12:41.966667 dv-cinder-851351-1-smb devstack@keystone.service[144068]: [pid: 144068|app: 0|req: 507/998] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 08:12:41 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 08:12:41.989479 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8bbad3-590a-419f-8cc0-0b35d0abf5ea None None] Authenticating user token {{(pid=144067) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:12:42.047589 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG dbcounter [-] [144067] Writing DB stats keystone:SELECT=100 {{(pid=144067) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:12:42.100429 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8bbad3-590a-419f-8cc0-0b35d0abf5ea None None] Validating token access rules against request {{(pid=144067) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:12:42.138488 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b47f68c-08cf-4cc2-b972-3df25b09e08d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144067) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:12:42.139056 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b47f68c-08cf-4cc2-b972-3df25b09e08d None admin] REQUEST_METHOD: `GET` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:12:42.139343 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b47f68c-08cf-4cc2-b972-3df25b09e08d None admin] SCRIPT_NAME: `/identity` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:12:42.139621 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b47f68c-08cf-4cc2-b972-3df25b09e08d None admin] PATH_INFO: `/v3/services/compute` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:12:42.140265 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b47f68c-08cf-4cc2-b972-3df25b09e08d None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:12:42.141706 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b47f68c-08cf-4cc2-b972-3df25b09e08d None admin] RBAC: Authorization granted {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:12:42.150707 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application [None req-3b47f68c-08cf-4cc2-b972-3df25b09e08d None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jul 28 08:12:42.150707 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:12:42.150707 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 28 08:12:42.150707 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 28 08:12:42.150707 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 28 08:12:42.150707 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 28 08:12:42.150707 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 28 08:12:42.150707 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 08:12:42.150707 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 28 08:12:42.150707 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application Jul 28 08:12:42.150707 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 28 08:12:42.150707 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application Jul 28 08:12:42.150707 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:12:42.150707 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:12:42.150707 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:12:42.150707 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:12:42.150707 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:12:42.151652 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:12:42.151652 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:12:42.151652 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:12:42.151652 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:12:42.151652 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:12:42.151652 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:12:42.151652 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 28 08:12:42.151652 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 28 08:12:42.151652 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 28 08:12:42.151652 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 28 08:12:42.151652 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:12:42.151652 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:12:42.151652 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:12:42.151652 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:12:42.151652 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:12:42.151652 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:12:42.152463 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:12:42.152463 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application with Lock( Jul 28 08:12:42.152463 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:12:42.152463 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:12:42.152463 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:12:42.152463 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:12:42.152463 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:12:42.152463 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:12:42.152463 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:12:42.152463 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:12:42.152463 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 28 08:12:42.152463 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 08:12:42.152463 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 28 08:12:42.152463 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application Jul 28 08:12:42.157082 dv-cinder-851351-1-smb devstack@keystone.service[144067]: [pid: 144067|app: 0|req: 492/999] 10.222.0.42 () {56 vars in 1111 bytes} [Thu Jul 28 08:12:41 2022] GET /identity/v3/services/compute => generated 88 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:12:42.158646 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5aab8f0-65ee-420b-9201-37f0f92d9a59 None None] Authenticating user token {{(pid=144068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:12:42.263673 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5aab8f0-65ee-420b-9201-37f0f92d9a59 None None] Validating token access rules against request {{(pid=144068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:12:42.300400 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852f7abf-304d-4f58-ae13-6a512008310c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:12:42.301064 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852f7abf-304d-4f58-ae13-6a512008310c None admin] REQUEST_METHOD: `GET` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:12:42.301362 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852f7abf-304d-4f58-ae13-6a512008310c None admin] SCRIPT_NAME: `/identity` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:12:42.301634 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852f7abf-304d-4f58-ae13-6a512008310c None admin] PATH_INFO: `/v3/services` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:12:42.302331 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-852f7abf-304d-4f58-ae13-6a512008310c None admin] RBAC: Adding query filter params (name=compute) {{(pid=144068) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:12:42.302641 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-852f7abf-304d-4f58-ae13-6a512008310c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:12:42.304020 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-852f7abf-304d-4f58-ae13-6a512008310c None admin] RBAC: Authorization granted {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:12:42.309441 dv-cinder-851351-1-smb devstack@keystone.service[144068]: [pid: 144068|app: 0|req: 508/1000] 10.222.0.42 () {56 vars in 1112 bytes} [Thu Jul 28 08:12:42 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:12:42.315079 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b47f68c-08cf-4cc2-b972-3df25b09e08d None admin] Authenticating user token {{(pid=144067) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:12:42.425987 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b47f68c-08cf-4cc2-b972-3df25b09e08d None admin] Validating token access rules against request {{(pid=144067) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:12:42.442199 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG dbcounter [-] [144067] Writing DB stats keystone:SELECT=100 {{(pid=144067) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:12:42.467208 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8386e21d-18f3-4661-a38c-b8c22df62df2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144067) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:12:42.468370 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8386e21d-18f3-4661-a38c-b8c22df62df2 None admin] REQUEST_METHOD: `GET` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:12:42.468370 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8386e21d-18f3-4661-a38c-b8c22df62df2 None admin] SCRIPT_NAME: `/identity` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:12:42.468539 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8386e21d-18f3-4661-a38c-b8c22df62df2 None admin] PATH_INFO: `/v3/services` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:12:42.469227 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8386e21d-18f3-4661-a38c-b8c22df62df2 None admin] RBAC: Adding query filter params (type=compute) {{(pid=144067) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:12:42.469538 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8386e21d-18f3-4661-a38c-b8c22df62df2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:12:42.470955 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8386e21d-18f3-4661-a38c-b8c22df62df2 None admin] RBAC: Authorization granted {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:12:42.476556 dv-cinder-851351-1-smb devstack@keystone.service[144067]: [pid: 144067|app: 0|req: 493/1001] 10.222.0.42 () {56 vars in 1112 bytes} [Thu Jul 28 08:12:42 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:12:42.482655 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852f7abf-304d-4f58-ae13-6a512008310c None admin] Authenticating user token {{(pid=144068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:12:42.535755 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG dbcounter [-] [144068] Writing DB stats keystone:SELECT=100 {{(pid=144068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:12:42.590675 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852f7abf-304d-4f58-ae13-6a512008310c None admin] Validating token access rules against request {{(pid=144068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:12:42.626298 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f9eaa5-5319-45d4-84bc-37cf78b902de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:12:42.626954 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f9eaa5-5319-45d4-84bc-37cf78b902de None admin] REQUEST_METHOD: `POST` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:12:42.627239 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f9eaa5-5319-45d4-84bc-37cf78b902de None admin] SCRIPT_NAME: `/identity` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:12:42.627512 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f9eaa5-5319-45d4-84bc-37cf78b902de None admin] PATH_INFO: `/v3/endpoints` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:12:42.628263 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f9eaa5-5319-45d4-84bc-37cf78b902de None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:12:42.629803 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f9eaa5-5319-45d4-84bc-37cf78b902de None admin] RBAC: Authorization granted {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:12:42.664744 dv-cinder-851351-1-smb devstack@keystone.service[144068]: [pid: 144068|app: 0|req: 509/1002] 10.222.0.42 () {60 vars in 1144 bytes} [Thu Jul 28 08:12:42 2022] POST /identity/v3/endpoints => generated 334 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 28 08:12:43.248936 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8481a56-809b-49ed-b77f-c196c617ae2e None None] REQUEST_METHOD: `GET` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:12:43.249120 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8481a56-809b-49ed-b77f-c196c617ae2e None None] SCRIPT_NAME: `/identity` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:12:43.249381 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8481a56-809b-49ed-b77f-c196c617ae2e None None] PATH_INFO: `/` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:12:43.250777 dv-cinder-851351-1-smb devstack@keystone.service[144067]: [pid: 144067|app: 0|req: 494/1003] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 08:12:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 08:12:43.256946 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ecd725-1717-43a4-a072-4a666e214db5 None None] REQUEST_METHOD: `POST` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:12:43.257229 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ecd725-1717-43a4-a072-4a666e214db5 None None] SCRIPT_NAME: `/identity` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:12:43.257509 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ecd725-1717-43a4-a072-4a666e214db5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:12:43.277024 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.auth.core [None req-f8ecd725-1717-43a4-a072-4a666e214db5 None None] MFA Rules not processed for user `bf5ceb8f07374635ad506b7d1b4f1612`. Rule list: `[]` (Enabled: `True`). {{(pid=144068) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 08:12:43.278233 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.fernet_utils [None req-f8ecd725-1717-43a4-a072-4a666e214db5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=144068) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:12:43.364125 dv-cinder-851351-1-smb devstack@keystone.service[144068]: [pid: 144068|app: 0|req: 510/1004] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 08:12:43 2022] POST /identity/v3/auth/tokens => generated 1716 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 08:12:43.387681 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8481a56-809b-49ed-b77f-c196c617ae2e None None] Authenticating user token {{(pid=144067) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:12:43.530362 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8481a56-809b-49ed-b77f-c196c617ae2e None None] Validating token access rules against request {{(pid=144067) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:12:43.579228 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5477dc8f-2d91-4769-9418-d8f783ae8de9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144067) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:12:43.580337 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5477dc8f-2d91-4769-9418-d8f783ae8de9 None admin] REQUEST_METHOD: `GET` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:12:43.580337 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5477dc8f-2d91-4769-9418-d8f783ae8de9 None admin] SCRIPT_NAME: `/identity` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:12:43.580337 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5477dc8f-2d91-4769-9418-d8f783ae8de9 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:12:43.580803 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5477dc8f-2d91-4769-9418-d8f783ae8de9 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:12:43.582251 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5477dc8f-2d91-4769-9418-d8f783ae8de9 None admin] RBAC: Authorization granted {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:12:43.593341 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application [None req-5477dc8f-2d91-4769-9418-d8f783ae8de9 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 28 08:12:43.593341 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:12:43.593341 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 28 08:12:43.593341 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 28 08:12:43.593341 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 28 08:12:43.593341 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 28 08:12:43.593341 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 28 08:12:43.593341 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 08:12:43.593341 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 28 08:12:43.593341 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application Jul 28 08:12:43.593341 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 28 08:12:43.593341 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application Jul 28 08:12:43.593341 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:12:43.593341 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:12:43.593341 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:12:43.593341 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:12:43.593341 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:12:43.594316 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:12:43.594316 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:12:43.594316 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:12:43.594316 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:12:43.594316 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:12:43.594316 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:12:43.594316 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 28 08:12:43.594316 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 28 08:12:43.594316 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 28 08:12:43.594316 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 28 08:12:43.594316 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:12:43.594316 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:12:43.594316 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:12:43.594316 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:12:43.594316 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:12:43.594316 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:12:43.600960 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:12:43.600960 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application with Lock( Jul 28 08:12:43.600960 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:12:43.600960 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:12:43.600960 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:12:43.600960 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:12:43.600960 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:12:43.600960 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:12:43.600960 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:12:43.600960 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:12:43.600960 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 28 08:12:43.600960 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 08:12:43.600960 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 28 08:12:43.600960 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application Jul 28 08:12:43.600960 dv-cinder-851351-1-smb devstack@keystone.service[144067]: [pid: 144067|app: 0|req: 495/1005] 10.222.0.42 () {56 vars in 1126 bytes} [Thu Jul 28 08:12:43 2022] GET /identity/v3/services/object-store => generated 93 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:12:43.601910 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ecd725-1717-43a4-a072-4a666e214db5 None None] Authenticating user token {{(pid=144068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:12:43.606688 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0352a41-023d-474f-a38e-65d3b509b673 None None] REQUEST_METHOD: `GET` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:12:43.607685 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0352a41-023d-474f-a38e-65d3b509b673 None None] SCRIPT_NAME: `/identity` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:12:43.607998 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0352a41-023d-474f-a38e-65d3b509b673 None None] PATH_INFO: `/` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:12:43.610023 dv-cinder-851351-1-smb devstack@keystone.service[144067]: [pid: 144067|app: 0|req: 496/1006] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 08:12:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 28 08:12:43.615670 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0bc6051-5b93-451f-89df-dfdd5be0fa3a None None] REQUEST_METHOD: `POST` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:12:43.615955 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0bc6051-5b93-451f-89df-dfdd5be0fa3a None None] SCRIPT_NAME: `/identity` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:12:43.616228 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0bc6051-5b93-451f-89df-dfdd5be0fa3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:12:43.635350 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG dbcounter [-] [144068] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=144068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:12:43.635812 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.auth.core [None req-c0bc6051-5b93-451f-89df-dfdd5be0fa3a None None] MFA Rules not processed for user `bf5ceb8f07374635ad506b7d1b4f1612`. Rule list: `[]` (Enabled: `True`). {{(pid=144067) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 08:12:43.637542 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.fernet_utils [None req-c0bc6051-5b93-451f-89df-dfdd5be0fa3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=144067) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:12:43.694660 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG dbcounter [-] [144067] Writing DB stats keystone:SELECT=100 {{(pid=144067) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:12:43.731754 dv-cinder-851351-1-smb devstack@keystone.service[144067]: [pid: 144067|app: 0|req: 497/1007] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 08:12:43 2022] POST /identity/v3/auth/tokens => generated 1716 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 08:12:43.732229 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ecd725-1717-43a4-a072-4a666e214db5 None None] Validating token access rules against request {{(pid=144068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:12:43.753827 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0bc6051-5b93-451f-89df-dfdd5be0fa3a None None] Authenticating user token {{(pid=144067) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:12:43.775760 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7616653b-d675-4417-8171-fe9ae688c6d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:12:43.776411 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7616653b-d675-4417-8171-fe9ae688c6d9 None admin] REQUEST_METHOD: `GET` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:12:43.776767 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7616653b-d675-4417-8171-fe9ae688c6d9 None admin] SCRIPT_NAME: `/identity` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:12:43.777003 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7616653b-d675-4417-8171-fe9ae688c6d9 None admin] PATH_INFO: `/v3/services` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:12:43.777706 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7616653b-d675-4417-8171-fe9ae688c6d9 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=144068) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:12:43.778004 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7616653b-d675-4417-8171-fe9ae688c6d9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:12:43.780299 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7616653b-d675-4417-8171-fe9ae688c6d9 None admin] RBAC: Authorization granted {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:12:43.785519 dv-cinder-851351-1-smb devstack@keystone.service[144068]: [pid: 144068|app: 0|req: 511/1008] 10.222.0.42 () {56 vars in 1122 bytes} [Thu Jul 28 08:12:43 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:12:43.791205 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7616653b-d675-4417-8171-fe9ae688c6d9 None admin] Authenticating user token {{(pid=144068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:12:43.888592 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0bc6051-5b93-451f-89df-dfdd5be0fa3a None None] Validating token access rules against request {{(pid=144067) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:12:43.912491 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG dbcounter [-] [144068] Writing DB stats keystone:SELECT=100 {{(pid=144068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:12:43.920413 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7616653b-d675-4417-8171-fe9ae688c6d9 None admin] Validating token access rules against request {{(pid=144068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:12:43.949972 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa2e910-ad03-4f28-8006-f98acdb06bba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144067) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:12:43.950632 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa2e910-ad03-4f28-8006-f98acdb06bba None admin] REQUEST_METHOD: `GET` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:12:43.950915 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa2e910-ad03-4f28-8006-f98acdb06bba None admin] SCRIPT_NAME: `/identity` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:12:43.951189 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa2e910-ad03-4f28-8006-f98acdb06bba None admin] PATH_INFO: `/v3/services/image` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:12:43.952032 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfa2e910-ad03-4f28-8006-f98acdb06bba None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:12:43.953261 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfa2e910-ad03-4f28-8006-f98acdb06bba None admin] RBAC: Authorization granted {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:12:43.960197 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3585f6c3-01e6-49c0-a516-f03a4fc99177 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:12:43.960862 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3585f6c3-01e6-49c0-a516-f03a4fc99177 None admin] REQUEST_METHOD: `GET` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:12:43.961448 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3585f6c3-01e6-49c0-a516-f03a4fc99177 None admin] SCRIPT_NAME: `/identity` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:12:43.961731 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3585f6c3-01e6-49c0-a516-f03a4fc99177 None admin] PATH_INFO: `/v3/services` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:12:43.962425 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3585f6c3-01e6-49c0-a516-f03a4fc99177 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=144068) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:12:43.962732 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3585f6c3-01e6-49c0-a516-f03a4fc99177 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:12:43.963341 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application [None req-dfa2e910-ad03-4f28-8006-f98acdb06bba None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jul 28 08:12:43.963341 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:12:43.963341 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 28 08:12:43.963341 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 28 08:12:43.963341 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 28 08:12:43.963341 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 28 08:12:43.963341 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 28 08:12:43.963341 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 08:12:43.963341 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 28 08:12:43.963341 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application Jul 28 08:12:43.963341 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 28 08:12:43.963341 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application Jul 28 08:12:43.963341 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:12:43.963341 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:12:43.963341 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:12:43.963341 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:12:43.963341 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:12:43.964233 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:12:43.964233 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:12:43.964233 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:12:43.964233 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:12:43.964233 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:12:43.964233 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:12:43.964233 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 28 08:12:43.964233 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 28 08:12:43.964233 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 28 08:12:43.964233 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 28 08:12:43.964233 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:12:43.964233 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:12:43.964233 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:12:43.964233 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:12:43.964233 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:12:43.964233 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:12:43.965262 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:12:43.965262 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application with Lock( Jul 28 08:12:43.965262 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:12:43.965262 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:12:43.965262 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:12:43.965262 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:12:43.965262 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:12:43.965262 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:12:43.965262 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:12:43.965262 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:12:43.965262 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 28 08:12:43.965262 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 08:12:43.965262 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 28 08:12:43.965262 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application Jul 28 08:12:43.965967 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3585f6c3-01e6-49c0-a516-f03a4fc99177 None admin] RBAC: Authorization granted {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:12:43.966034 dv-cinder-851351-1-smb devstack@keystone.service[144067]: [pid: 144067|app: 0|req: 498/1009] 10.222.0.42 () {56 vars in 1105 bytes} [Thu Jul 28 08:12:43 2022] GET /identity/v3/services/image => generated 86 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 08:12:43.972311 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa2e910-ad03-4f28-8006-f98acdb06bba None admin] Authenticating user token {{(pid=144067) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:12:43.979857 dv-cinder-851351-1-smb devstack@keystone.service[144068]: [pid: 144068|app: 0|req: 512/1010] 10.222.0.42 () {56 vars in 1122 bytes} [Thu Jul 28 08:12:43 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:12:43.985654 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3585f6c3-01e6-49c0-a516-f03a4fc99177 None admin] Authenticating user token {{(pid=144068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:12:44.023474 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG dbcounter [-] [144067] Writing DB stats keystone:SELECT=100 {{(pid=144067) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:12:44.087587 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa2e910-ad03-4f28-8006-f98acdb06bba None admin] Validating token access rules against request {{(pid=144067) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:12:44.097934 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3585f6c3-01e6-49c0-a516-f03a4fc99177 None admin] Validating token access rules against request {{(pid=144068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:12:44.123313 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb369e62-8b20-4512-aeba-8a8197f7944b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144067) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:12:44.124040 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb369e62-8b20-4512-aeba-8a8197f7944b None admin] REQUEST_METHOD: `GET` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:12:44.124388 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb369e62-8b20-4512-aeba-8a8197f7944b None admin] SCRIPT_NAME: `/identity` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:12:44.124635 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb369e62-8b20-4512-aeba-8a8197f7944b None admin] PATH_INFO: `/v3/services` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:12:44.125327 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb369e62-8b20-4512-aeba-8a8197f7944b None admin] RBAC: Adding query filter params (name=image) {{(pid=144067) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:12:44.125633 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb369e62-8b20-4512-aeba-8a8197f7944b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:12:44.127033 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb369e62-8b20-4512-aeba-8a8197f7944b None admin] RBAC: Authorization granted {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:12:44.132465 dv-cinder-851351-1-smb devstack@keystone.service[144067]: [pid: 144067|app: 0|req: 499/1011] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 08:12:43 2022] GET /identity/v3/services?name=image => generated 122 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 08:12:44.141288 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb369e62-8b20-4512-aeba-8a8197f7944b None admin] Authenticating user token {{(pid=144067) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:12:44.144575 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc69b1b6-09a6-4e78-a108-a63fee83ff0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:12:44.145636 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc69b1b6-09a6-4e78-a108-a63fee83ff0d None admin] REQUEST_METHOD: `POST` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:12:44.145636 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc69b1b6-09a6-4e78-a108-a63fee83ff0d None admin] SCRIPT_NAME: `/identity` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:12:44.145822 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc69b1b6-09a6-4e78-a108-a63fee83ff0d None admin] PATH_INFO: `/v3/endpoints` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:12:44.146554 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc69b1b6-09a6-4e78-a108-a63fee83ff0d None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:12:44.147935 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc69b1b6-09a6-4e78-a108-a63fee83ff0d None admin] RBAC: Authorization granted {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:12:44.168994 dv-cinder-851351-1-smb devstack@keystone.service[144068]: [pid: 144068|app: 0|req: 513/1012] 10.222.0.42 () {60 vars in 1144 bytes} [Thu Jul 28 08:12:43 2022] POST /identity/v3/endpoints => generated 325 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 08:12:44.269158 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb369e62-8b20-4512-aeba-8a8197f7944b None admin] Validating token access rules against request {{(pid=144067) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:12:44.271079 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG dbcounter [-] [144067] Writing DB stats keystone:SELECT=100 {{(pid=144067) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:12:44.328852 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-913b3f05-6d87-406f-b582-0ac6ac960b06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144067) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:12:44.329480 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913b3f05-6d87-406f-b582-0ac6ac960b06 None admin] REQUEST_METHOD: `GET` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:12:44.329760 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913b3f05-6d87-406f-b582-0ac6ac960b06 None admin] SCRIPT_NAME: `/identity` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:12:44.330031 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913b3f05-6d87-406f-b582-0ac6ac960b06 None admin] PATH_INFO: `/v3/services` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:12:44.331564 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-913b3f05-6d87-406f-b582-0ac6ac960b06 None admin] RBAC: Adding query filter params (type=image) {{(pid=144067) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:12:44.331871 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-913b3f05-6d87-406f-b582-0ac6ac960b06 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:12:44.333342 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-913b3f05-6d87-406f-b582-0ac6ac960b06 None admin] RBAC: Authorization granted {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:12:44.344783 dv-cinder-851351-1-smb devstack@keystone.service[144067]: [pid: 144067|app: 0|req: 500/1013] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 08:12:44 2022] GET /identity/v3/services?type=image => generated 122 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:12:44.839140 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f5ad03-23c6-46ad-94fb-202506518303 None None] REQUEST_METHOD: `GET` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:12:44.839693 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f5ad03-23c6-46ad-94fb-202506518303 None None] SCRIPT_NAME: `/identity` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:12:44.839693 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f5ad03-23c6-46ad-94fb-202506518303 None None] PATH_INFO: `/` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:12:44.841307 dv-cinder-851351-1-smb devstack@keystone.service[144068]: [pid: 144068|app: 0|req: 514/1014] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 08:12:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 08:12:44.846616 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13bf371-d373-44de-9baf-eeaa4def5364 None None] REQUEST_METHOD: `POST` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:12:44.847146 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13bf371-d373-44de-9baf-eeaa4def5364 None None] SCRIPT_NAME: `/identity` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:12:44.847331 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13bf371-d373-44de-9baf-eeaa4def5364 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:12:44.865720 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.auth.core [None req-c13bf371-d373-44de-9baf-eeaa4def5364 None None] MFA Rules not processed for user `bf5ceb8f07374635ad506b7d1b4f1612`. Rule list: `[]` (Enabled: `True`). {{(pid=144067) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 08:12:44.866925 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.fernet_utils [None req-c13bf371-d373-44de-9baf-eeaa4def5364 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=144067) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:12:44.936111 dv-cinder-851351-1-smb devstack@keystone.service[144067]: [pid: 144067|app: 0|req: 501/1015] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 08:12:44 2022] POST /identity/v3/auth/tokens => generated 1863 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 08:12:44.959785 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f5ad03-23c6-46ad-94fb-202506518303 None None] Authenticating user token {{(pid=144068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:12:45.000473 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG dbcounter [-] [144068] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=144068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:12:45.141348 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f5ad03-23c6-46ad-94fb-202506518303 None None] Validating token access rules against request {{(pid=144068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:12:45.179362 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23bcb478-1fdc-41d4-ade3-3b0575076416 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:12:45.180026 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23bcb478-1fdc-41d4-ade3-3b0575076416 None admin] REQUEST_METHOD: `GET` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:12:45.180306 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23bcb478-1fdc-41d4-ade3-3b0575076416 None admin] SCRIPT_NAME: `/identity` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:12:45.180576 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23bcb478-1fdc-41d4-ade3-3b0575076416 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:12:45.192079 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23bcb478-1fdc-41d4-ade3-3b0575076416 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 08:12:45.197064 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application [None req-23bcb478-1fdc-41d4-ade3-3b0575076416 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 28 08:12:45.197064 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:12:45.197064 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:12:45.197064 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:12:45.197064 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:12:45.197064 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:12:45.197064 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:12:45.197064 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:12:45.197064 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:12:45.197064 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:12:45.197064 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:12:45.197064 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:12:45.197064 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 08:12:45.197064 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 08:12:45.197064 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 08:12:45.197064 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 08:12:45.197940 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 08:12:45.197940 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 08:12:45.197940 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 08:12:45.197940 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 08:12:45.197940 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:12:45.197940 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:12:45.197940 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:12:45.197940 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:12:45.197940 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:12:45.197940 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:12:45.197940 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:12:45.197940 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application with Lock( Jul 28 08:12:45.197940 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:12:45.197940 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:12:45.197940 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:12:45.197940 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:12:45.204247 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:12:45.204247 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:12:45.204247 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:12:45.204247 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:12:45.204247 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 08:12:45.204247 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 08:12:45.204247 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 08:12:45.204247 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 08:12:45.204247 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 08:12:45.204247 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 08:12:45.204247 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 28 08:12:45.204247 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application Jul 28 08:12:45.204247 dv-cinder-851351-1-smb devstack@keystone.service[144068]: [pid: 144068|app: 0|req: 515/1016] 10.222.0.42 () {56 vars in 1120 bytes} [Thu Jul 28 08:12:44 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:12:45.206431 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13bf371-d373-44de-9baf-eeaa4def5364 None None] Authenticating user token {{(pid=144067) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:12:45.304539 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG dbcounter [-] [144067] Writing DB stats keystone:SELECT=100 {{(pid=144067) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:12:45.316020 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13bf371-d373-44de-9baf-eeaa4def5364 None None] Validating token access rules against request {{(pid=144067) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:12:45.355510 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b9a25e2-dbfd-46b7-b58b-e5b19e81041e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144067) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:12:45.356160 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9a25e2-dbfd-46b7-b58b-e5b19e81041e None admin] REQUEST_METHOD: `GET` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:12:45.356444 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9a25e2-dbfd-46b7-b58b-e5b19e81041e None admin] SCRIPT_NAME: `/identity` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:12:45.356774 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9a25e2-dbfd-46b7-b58b-e5b19e81041e None admin] PATH_INFO: `/v3/roles` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:12:45.357527 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b9a25e2-dbfd-46b7-b58b-e5b19e81041e None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=144067) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:12:45.357835 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b9a25e2-dbfd-46b7-b58b-e5b19e81041e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:12:45.359334 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b9a25e2-dbfd-46b7-b58b-e5b19e81041e None admin] RBAC: Authorization granted {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:12:45.369590 dv-cinder-851351-1-smb devstack@keystone.service[144067]: [pid: 144067|app: 0|req: 502/1017] 10.222.0.42 () {56 vars in 1115 bytes} [Thu Jul 28 08:12:45 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:12:45.375425 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23bcb478-1fdc-41d4-ade3-3b0575076416 None admin] Authenticating user token {{(pid=144068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:12:45.465883 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG dbcounter [-] [144068] Writing DB stats keystone:SELECT=100 {{(pid=144068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:12:45.489851 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23bcb478-1fdc-41d4-ade3-3b0575076416 None admin] Validating token access rules against request {{(pid=144068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:12:45.526589 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb13e6b-e1ff-47f1-aada-94b44b18828f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:12:45.527255 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb13e6b-e1ff-47f1-aada-94b44b18828f None admin] REQUEST_METHOD: `GET` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:12:45.527542 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb13e6b-e1ff-47f1-aada-94b44b18828f None admin] SCRIPT_NAME: `/identity` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:12:45.527816 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb13e6b-e1ff-47f1-aada-94b44b18828f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:12:45.539180 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb13e6b-e1ff-47f1-aada-94b44b18828f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:12:45.540697 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb13e6b-e1ff-47f1-aada-94b44b18828f None admin] RBAC: Authorization granted {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:12:45.555531 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application [None req-2bb13e6b-e1ff-47f1-aada-94b44b18828f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 08:12:45.555531 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:12:45.555531 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:12:45.555531 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:12:45.555531 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:12:45.555531 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:12:45.555531 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:12:45.555531 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:12:45.555531 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:12:45.555531 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:12:45.555531 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:12:45.555531 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:12:45.555531 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 08:12:45.555531 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 08:12:45.555531 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 08:12:45.556422 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 08:12:45.556422 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:12:45.556422 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:12:45.556422 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:12:45.556422 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:12:45.556422 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:12:45.556422 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:12:45.556422 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:12:45.556422 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application with Lock( Jul 28 08:12:45.556422 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:12:45.556422 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:12:45.556422 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:12:45.556422 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:12:45.556422 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:12:45.556422 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:12:45.556422 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:12:45.556422 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:12:45.562420 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 08:12:45.562420 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 08:12:45.562420 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 08:12:45.562420 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application Jul 28 08:12:45.562420 dv-cinder-851351-1-smb devstack@keystone.service[144068]: [pid: 144068|app: 0|req: 516/1018] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 08:12:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:12:45.562682 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b9a25e2-dbfd-46b7-b58b-e5b19e81041e None admin] Authenticating user token {{(pid=144067) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:12:45.674198 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b9a25e2-dbfd-46b7-b58b-e5b19e81041e None admin] Validating token access rules against request {{(pid=144067) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:12:45.713700 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2cf1013-2772-4895-b976-0ef423788858 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144067) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:12:45.714346 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2cf1013-2772-4895-b976-0ef423788858 None admin] REQUEST_METHOD: `GET` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:12:45.714629 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2cf1013-2772-4895-b976-0ef423788858 None admin] SCRIPT_NAME: `/identity` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:12:45.714911 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2cf1013-2772-4895-b976-0ef423788858 None admin] PATH_INFO: `/v3/domains` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:12:45.715620 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2cf1013-2772-4895-b976-0ef423788858 None admin] RBAC: Adding query filter params (name=Default) {{(pid=144067) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:12:45.715984 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2cf1013-2772-4895-b976-0ef423788858 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:12:45.717408 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2cf1013-2772-4895-b976-0ef423788858 None admin] RBAC: Authorization granted {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:12:45.730418 dv-cinder-851351-1-smb devstack@keystone.service[144067]: [pid: 144067|app: 0|req: 503/1019] 10.222.0.42 () {56 vars in 1109 bytes} [Thu Jul 28 08:12:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 08:12:45.736290 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb13e6b-e1ff-47f1-aada-94b44b18828f None admin] Authenticating user token {{(pid=144068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:12:45.847146 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb13e6b-e1ff-47f1-aada-94b44b18828f None admin] Validating token access rules against request {{(pid=144068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:12:45.877470 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG dbcounter [-] [144068] Writing DB stats keystone:SELECT=100 {{(pid=144068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:12:45.884257 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60294fe5-092a-4eac-a169-90101cf8c3aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:12:45.884954 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60294fe5-092a-4eac-a169-90101cf8c3aa None admin] REQUEST_METHOD: `GET` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:12:45.885237 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60294fe5-092a-4eac-a169-90101cf8c3aa None admin] SCRIPT_NAME: `/identity` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:12:45.885513 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60294fe5-092a-4eac-a169-90101cf8c3aa None admin] PATH_INFO: `/v3/users/nova` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:12:45.894649 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60294fe5-092a-4eac-a169-90101cf8c3aa None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:12:45.896123 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60294fe5-092a-4eac-a169-90101cf8c3aa None admin] RBAC: Authorization granted {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:12:45.908217 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application [None req-60294fe5-092a-4eac-a169-90101cf8c3aa None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 28 08:12:45.908217 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:12:45.908217 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:12:45.908217 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:12:45.908217 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:12:45.908217 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:12:45.908217 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:12:45.908217 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:12:45.908217 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:12:45.908217 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:12:45.908217 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:12:45.908217 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:12:45.908217 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 28 08:12:45.908217 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 28 08:12:45.908217 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 28 08:12:45.908217 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 28 08:12:45.909390 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:12:45.909390 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:12:45.909390 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 28 08:12:45.909390 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 08:12:45.909390 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 28 08:12:45.909390 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 08:12:45.909390 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:12:45.909390 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:12:45.909390 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:12:45.909390 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:12:45.909390 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:12:45.909390 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application with Lock( Jul 28 08:12:45.909390 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:12:45.909390 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:12:45.909390 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:12:45.909390 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:12:45.909390 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:12:45.909390 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:12:45.915418 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:12:45.915418 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:12:45.915418 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 28 08:12:45.915418 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 28 08:12:45.915418 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 28 08:12:45.915418 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 28 08:12:45.915418 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 28 08:12:45.915418 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 28 08:12:45.915418 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 28 08:12:45.915418 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application Jul 28 08:12:45.915418 dv-cinder-851351-1-smb devstack@keystone.service[144068]: [pid: 144068|app: 0|req: 517/1020] 10.222.0.42 () {56 vars in 1093 bytes} [Thu Jul 28 08:12:45 2022] GET /identity/v3/users/nova => generated 82 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:12:45.917640 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2cf1013-2772-4895-b976-0ef423788858 None admin] Authenticating user token {{(pid=144067) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:12:45.935941 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG dbcounter [-] [144067] Writing DB stats keystone:SELECT=100 {{(pid=144067) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:12:46.038694 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2cf1013-2772-4895-b976-0ef423788858 None admin] Validating token access rules against request {{(pid=144067) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:12:46.076318 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25835be6-d5f3-4554-b254-d64454ec8064 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144067) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:12:46.076988 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25835be6-d5f3-4554-b254-d64454ec8064 None admin] REQUEST_METHOD: `GET` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:12:46.077271 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25835be6-d5f3-4554-b254-d64454ec8064 None admin] SCRIPT_NAME: `/identity` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:12:46.077547 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25835be6-d5f3-4554-b254-d64454ec8064 None admin] PATH_INFO: `/v3/users` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:12:46.078362 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25835be6-d5f3-4554-b254-d64454ec8064 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=144067) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:12:46.078667 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25835be6-d5f3-4554-b254-d64454ec8064 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:12:46.080143 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25835be6-d5f3-4554-b254-d64454ec8064 None admin] RBAC: Authorization granted {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:12:46.099604 dv-cinder-851351-1-smb devstack@keystone.service[144067]: [pid: 144067|app: 0|req: 504/1021] 10.222.0.42 () {56 vars in 1133 bytes} [Thu Jul 28 08:12:45 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:12:46.105429 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60294fe5-092a-4eac-a169-90101cf8c3aa None admin] Authenticating user token {{(pid=144068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:12:46.207757 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60294fe5-092a-4eac-a169-90101cf8c3aa None admin] Validating token access rules against request {{(pid=144068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:12:46.242785 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe4ae229-d8f8-4fb2-a023-f3c2f5885ffe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:12:46.243351 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4ae229-d8f8-4fb2-a023-f3c2f5885ffe None admin] REQUEST_METHOD: `GET` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:12:46.243630 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4ae229-d8f8-4fb2-a023-f3c2f5885ffe None admin] SCRIPT_NAME: `/identity` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:12:46.243908 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4ae229-d8f8-4fb2-a023-f3c2f5885ffe None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:12:46.304720 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG dbcounter [-] [144068] Writing DB stats keystone:SELECT=100 {{(pid=144068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:12:46.305887 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7ea81b-f2f7-434e-a147-f79e11cacaff None None] REQUEST_METHOD: `GET` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:12:46.306179 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7ea81b-f2f7-434e-a147-f79e11cacaff None None] SCRIPT_NAME: `/identity` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:12:46.306526 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7ea81b-f2f7-434e-a147-f79e11cacaff None None] PATH_INFO: `/` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:12:46.308222 dv-cinder-851351-1-smb devstack@keystone.service[144067]: [pid: 144067|app: 0|req: 505/1022] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 08:12:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 28 08:12:46.313908 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d37cb34-ef13-47ba-9bc2-b118e49f4760 None None] REQUEST_METHOD: `POST` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:12:46.314198 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d37cb34-ef13-47ba-9bc2-b118e49f4760 None None] SCRIPT_NAME: `/identity` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:12:46.314478 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d37cb34-ef13-47ba-9bc2-b118e49f4760 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:12:46.321144 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe4ae229-d8f8-4fb2-a023-f3c2f5885ffe None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:12:46.322790 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe4ae229-d8f8-4fb2-a023-f3c2f5885ffe None admin] RBAC: Authorization granted {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:12:46.332835 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.auth.core [None req-2d37cb34-ef13-47ba-9bc2-b118e49f4760 None None] MFA Rules not processed for user `bf5ceb8f07374635ad506b7d1b4f1612`. Rule list: `[]` (Enabled: `True`). {{(pid=144067) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 08:12:46.334051 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.fernet_utils [None req-2d37cb34-ef13-47ba-9bc2-b118e49f4760 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=144067) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:12:46.407948 dv-cinder-851351-1-smb devstack@keystone.service[144067]: [pid: 144067|app: 0|req: 506/1023] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 08:12:46 2022] POST /identity/v3/auth/tokens => generated 1863 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 08:12:46.409408 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693920c4-3677-424c-9137-68f037f233a9 None None] REQUEST_METHOD: `GET` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:12:46.409840 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693920c4-3677-424c-9137-68f037f233a9 None None] SCRIPT_NAME: `/identity` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:12:46.410118 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693920c4-3677-424c-9137-68f037f233a9 None None] PATH_INFO: `/` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:12:46.412698 dv-cinder-851351-1-smb devstack@keystone.service[144067]: [pid: 144067|app: 0|req: 507/1024] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 08:12:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 08:12:46.417517 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059a67ce-7305-4e60-a8ed-7a1b240b3d98 None None] REQUEST_METHOD: `POST` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:12:46.417807 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059a67ce-7305-4e60-a8ed-7a1b240b3d98 None None] SCRIPT_NAME: `/identity` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:12:46.418097 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059a67ce-7305-4e60-a8ed-7a1b240b3d98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:12:46.424865 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG dbcounter [-] [144067] Writing DB stats keystone:SELECT=100 {{(pid=144067) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:12:46.439712 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.auth.core [None req-059a67ce-7305-4e60-a8ed-7a1b240b3d98 None None] MFA Rules not processed for user `bf5ceb8f07374635ad506b7d1b4f1612`. Rule list: `[]` (Enabled: `True`). {{(pid=144067) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 08:12:46.441132 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.fernet_utils [None req-059a67ce-7305-4e60-a8ed-7a1b240b3d98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=144067) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:12:46.442939 dv-cinder-851351-1-smb devstack@keystone.service[144068]: [pid: 144068|app: 0|req: 518/1025] 10.222.0.42 () {58 vars in 1282 bytes} [Thu Jul 28 08:12:46 2022] GET /identity/v3/auth/tokens => generated 1863 bytes in 338 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 28 08:12:46.443812 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe4ae229-d8f8-4fb2-a023-f3c2f5885ffe None admin] Authenticating user token {{(pid=144068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:12:46.513358 dv-cinder-851351-1-smb devstack@keystone.service[144067]: [pid: 144067|app: 0|req: 508/1026] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 08:12:46 2022] POST /identity/v3/auth/tokens => generated 1863 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 28 08:12:46.514136 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059a67ce-7305-4e60-a8ed-7a1b240b3d98 None None] Authenticating user token {{(pid=144067) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:12:46.542277 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG dbcounter [-] [144068] Writing DB stats keystone:SELECT=100 {{(pid=144068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:12:46.551923 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe4ae229-d8f8-4fb2-a023-f3c2f5885ffe None admin] Validating token access rules against request {{(pid=144068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:12:46.586756 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47eecec8-d3b3-4f78-86f2-00a4b376af5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:12:46.587405 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47eecec8-d3b3-4f78-86f2-00a4b376af5c None admin] REQUEST_METHOD: `GET` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:12:46.587683 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47eecec8-d3b3-4f78-86f2-00a4b376af5c None admin] SCRIPT_NAME: `/identity` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:12:46.587955 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47eecec8-d3b3-4f78-86f2-00a4b376af5c None admin] PATH_INFO: `/v3/domains/default` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:12:46.589149 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47eecec8-d3b3-4f78-86f2-00a4b376af5c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:12:46.590669 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47eecec8-d3b3-4f78-86f2-00a4b376af5c None admin] RBAC: Authorization granted {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:12:46.592287 dv-cinder-851351-1-smb devstack@keystone.service[144068]: [pid: 144068|app: 0|req: 519/1027] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 08:12:46 2022] GET /identity/v3/domains/default => generated 199 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:12:46.593069 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47eecec8-d3b3-4f78-86f2-00a4b376af5c None admin] Authenticating user token {{(pid=144068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:12:46.619060 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059a67ce-7305-4e60-a8ed-7a1b240b3d98 None None] Validating token access rules against request {{(pid=144067) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:12:46.652773 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG dbcounter [-] [144067] Writing DB stats keystone:SELECT=100 {{(pid=144067) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:12:46.658727 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f350c5f9-0d1d-486c-ab77-012c29b4e214 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144067) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:12:46.659395 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f350c5f9-0d1d-486c-ab77-012c29b4e214 None admin] REQUEST_METHOD: `GET` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:12:46.659771 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f350c5f9-0d1d-486c-ab77-012c29b4e214 None admin] SCRIPT_NAME: `/identity` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:12:46.660051 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f350c5f9-0d1d-486c-ab77-012c29b4e214 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:12:46.671339 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f350c5f9-0d1d-486c-ab77-012c29b4e214 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:12:46.672881 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f350c5f9-0d1d-486c-ab77-012c29b4e214 None admin] RBAC: Authorization granted {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:12:46.689745 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application [None req-f350c5f9-0d1d-486c-ab77-012c29b4e214 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 08:12:46.689745 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:12:46.689745 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:12:46.689745 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:12:46.689745 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:12:46.689745 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:12:46.689745 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:12:46.689745 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:12:46.689745 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:12:46.689745 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:12:46.689745 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:12:46.689745 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:12:46.689745 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 08:12:46.689745 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 08:12:46.689745 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 08:12:46.690720 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 08:12:46.690720 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:12:46.690720 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:12:46.690720 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:12:46.690720 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:12:46.690720 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:12:46.690720 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:12:46.690720 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:12:46.690720 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application with Lock( Jul 28 08:12:46.690720 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:12:46.690720 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:12:46.690720 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:12:46.690720 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:12:46.690720 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:12:46.690720 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:12:46.690720 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:12:46.690720 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:12:46.691759 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 08:12:46.691759 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 08:12:46.691759 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 08:12:46.691759 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application Jul 28 08:12:46.691759 dv-cinder-851351-1-smb devstack@keystone.service[144067]: [pid: 144067|app: 0|req: 509/1028] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 08:12:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:12:46.692117 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f350c5f9-0d1d-486c-ab77-012c29b4e214 None admin] Authenticating user token {{(pid=144067) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:12:46.698954 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47eecec8-d3b3-4f78-86f2-00a4b376af5c None admin] Validating token access rules against request {{(pid=144068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:12:46.735086 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b9b825-c12f-4fb3-901a-5ddb64abe16f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:12:46.735712 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b9b825-c12f-4fb3-901a-5ddb64abe16f None admin] REQUEST_METHOD: `POST` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:12:46.735994 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b9b825-c12f-4fb3-901a-5ddb64abe16f None admin] SCRIPT_NAME: `/identity` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:12:46.736266 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b9b825-c12f-4fb3-901a-5ddb64abe16f None admin] PATH_INFO: `/v3/services` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:12:46.737004 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b9b825-c12f-4fb3-901a-5ddb64abe16f None admin] RBAC: Authorizing `identity:create_service()` {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:12:46.738445 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b9b825-c12f-4fb3-901a-5ddb64abe16f None admin] RBAC: Authorization granted {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:12:46.754920 dv-cinder-851351-1-smb devstack@keystone.service[144068]: [pid: 144068|app: 0|req: 520/1029] 10.222.0.42 () {60 vars in 1141 bytes} [Thu Jul 28 08:12:46 2022] POST /identity/v3/services => generated 242 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 08:12:46.755794 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b9b825-c12f-4fb3-901a-5ddb64abe16f None admin] Authenticating user token {{(pid=144068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:12:46.783401 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG dbcounter [-] [144068] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=144068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:12:46.810352 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f350c5f9-0d1d-486c-ab77-012c29b4e214 None admin] Validating token access rules against request {{(pid=144067) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:12:46.859218 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b46bcc9-7447-4dc2-a3ac-4833e6db9f05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144067) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:12:46.860119 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b46bcc9-7447-4dc2-a3ac-4833e6db9f05 None admin] REQUEST_METHOD: `POST` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:12:46.860413 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b46bcc9-7447-4dc2-a3ac-4833e6db9f05 None admin] SCRIPT_NAME: `/identity` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:12:46.860833 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b46bcc9-7447-4dc2-a3ac-4833e6db9f05 None admin] PATH_INFO: `/v3/projects` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:12:46.861497 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b46bcc9-7447-4dc2-a3ac-4833e6db9f05 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:12:46.863188 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b46bcc9-7447-4dc2-a3ac-4833e6db9f05 None admin] RBAC: Authorization granted {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:12:46.879994 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b9b825-c12f-4fb3-901a-5ddb64abe16f None admin] Validating token access rules against request {{(pid=144068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:12:46.895126 dv-cinder-851351-1-smb devstack@keystone.service[144067]: [pid: 144067|app: 0|req: 510/1030] 10.222.0.42 () {60 vars in 1141 bytes} [Thu Jul 28 08:12:46 2022] POST /identity/v3/projects => generated 311 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 08:12:46.921277 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e898aef-0dc0-4d23-936f-fab3bd5381a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:12:46.921942 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e898aef-0dc0-4d23-936f-fab3bd5381a5 None admin] REQUEST_METHOD: `GET` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:12:46.922909 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e898aef-0dc0-4d23-936f-fab3bd5381a5 None admin] SCRIPT_NAME: `/identity` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:12:46.922909 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e898aef-0dc0-4d23-936f-fab3bd5381a5 None admin] PATH_INFO: `/v3/domains` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:12:46.923247 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e898aef-0dc0-4d23-936f-fab3bd5381a5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=144068) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:12:46.923539 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e898aef-0dc0-4d23-936f-fab3bd5381a5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:12:46.925023 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e898aef-0dc0-4d23-936f-fab3bd5381a5 None admin] RBAC: Authorization granted {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:12:46.940879 dv-cinder-851351-1-smb devstack@keystone.service[144068]: [pid: 144068|app: 0|req: 521/1031] 10.222.0.42 () {56 vars in 1109 bytes} [Thu Jul 28 08:12:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:12:46.947241 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b46bcc9-7447-4dc2-a3ac-4833e6db9f05 None admin] Authenticating user token {{(pid=144067) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:12:47.004245 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG dbcounter [-] [144067] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=144067) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:12:47.085844 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b46bcc9-7447-4dc2-a3ac-4833e6db9f05 None admin] Validating token access rules against request {{(pid=144067) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:12:47.126140 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb2eb15-eccb-48dc-82b0-e69c538f3691 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144067) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:12:47.126813 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb2eb15-eccb-48dc-82b0-e69c538f3691 None admin] REQUEST_METHOD: `GET` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:12:47.127096 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb2eb15-eccb-48dc-82b0-e69c538f3691 None admin] SCRIPT_NAME: `/identity` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:12:47.127374 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb2eb15-eccb-48dc-82b0-e69c538f3691 None admin] PATH_INFO: `/v3/projects/service` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:12:47.134853 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fb2eb15-eccb-48dc-82b0-e69c538f3691 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:12:47.136350 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fb2eb15-eccb-48dc-82b0-e69c538f3691 None admin] RBAC: Authorization granted {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:12:47.148653 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application [None req-8fb2eb15-eccb-48dc-82b0-e69c538f3691 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 08:12:47.148653 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:12:47.148653 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:12:47.148653 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:12:47.148653 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:12:47.148653 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:12:47.148653 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:12:47.148653 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:12:47.148653 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:12:47.148653 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:12:47.148653 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:12:47.148653 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:12:47.148653 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 28 08:12:47.148653 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 28 08:12:47.148653 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 28 08:12:47.149598 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 28 08:12:47.149598 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:12:47.149598 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:12:47.149598 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:12:47.149598 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:12:47.149598 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:12:47.149598 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:12:47.149598 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:12:47.149598 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application with Lock( Jul 28 08:12:47.149598 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:12:47.149598 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:12:47.149598 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:12:47.149598 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:12:47.149598 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:12:47.149598 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:12:47.149598 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:12:47.149598 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:12:47.150451 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 28 08:12:47.150451 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 28 08:12:47.150451 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 28 08:12:47.150451 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 28 08:12:47.150451 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 28 08:12:47.150451 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 28 08:12:47.150451 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 08:12:47.150451 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application Jul 28 08:12:47.150451 dv-cinder-851351-1-smb devstack@keystone.service[144067]: [pid: 144067|app: 0|req: 511/1032] 10.222.0.42 () {56 vars in 1111 bytes} [Thu Jul 28 08:12:46 2022] GET /identity/v3/projects/service => generated 88 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:12:47.155773 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e898aef-0dc0-4d23-936f-fab3bd5381a5 None admin] Authenticating user token {{(pid=144068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:12:47.242047 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG dbcounter [-] [144068] Writing DB stats keystone:SELECT=100 {{(pid=144068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:12:47.263824 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e898aef-0dc0-4d23-936f-fab3bd5381a5 None admin] Validating token access rules against request {{(pid=144068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:12:47.301562 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dced25fe-5956-47e5-8d79-cec9d2b66386 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:12:47.302263 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dced25fe-5956-47e5-8d79-cec9d2b66386 None admin] REQUEST_METHOD: `GET` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:12:47.302542 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dced25fe-5956-47e5-8d79-cec9d2b66386 None admin] SCRIPT_NAME: `/identity` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:12:47.302814 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dced25fe-5956-47e5-8d79-cec9d2b66386 None admin] PATH_INFO: `/v3/projects` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:12:47.303588 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dced25fe-5956-47e5-8d79-cec9d2b66386 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=144068) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:12:47.303895 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dced25fe-5956-47e5-8d79-cec9d2b66386 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:12:47.305427 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dced25fe-5956-47e5-8d79-cec9d2b66386 None admin] RBAC: Authorization granted {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:12:47.318504 dv-cinder-851351-1-smb devstack@keystone.service[144068]: [pid: 144068|app: 0|req: 522/1033] 10.222.0.42 () {56 vars in 1148 bytes} [Thu Jul 28 08:12:47 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:12:47.327053 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb2eb15-eccb-48dc-82b0-e69c538f3691 None admin] Authenticating user token {{(pid=144067) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:12:47.426205 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG dbcounter [-] [144067] Writing DB stats keystone:SELECT=100 {{(pid=144067) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:12:47.436644 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb2eb15-eccb-48dc-82b0-e69c538f3691 None admin] Validating token access rules against request {{(pid=144067) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:12:47.472453 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-482b9a5b-37f2-4fb7-9c74-0a2e4789997c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144067) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:12:47.473127 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482b9a5b-37f2-4fb7-9c74-0a2e4789997c None admin] REQUEST_METHOD: `GET` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:12:47.473404 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482b9a5b-37f2-4fb7-9c74-0a2e4789997c None admin] SCRIPT_NAME: `/identity` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:12:47.473676 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482b9a5b-37f2-4fb7-9c74-0a2e4789997c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:12:47.474490 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-482b9a5b-37f2-4fb7-9c74-0a2e4789997c None admin] RBAC: Adding query filter params (role.id=cfa933c7b37b473c8e22091c8b829530, scope.project.id=fa39ab7491e5413ca648e31ee9177fa0, user.id=2c1de9cd80344cefa3e06ae8c9c9e5d9) {{(pid=144067) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:12:47.474800 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-482b9a5b-37f2-4fb7-9c74-0a2e4789997c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:12:47.476263 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-482b9a5b-37f2-4fb7-9c74-0a2e4789997c None admin] RBAC: Authorization granted {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:12:47.482600 dv-cinder-851351-1-smb devstack@keystone.service[144067]: [pid: 144067|app: 0|req: 512/1034] 10.222.0.42 () {56 vars in 1374 bytes} [Thu Jul 28 08:12:47 2022] GET /identity/v3/role_assignments?user.id=2c1de9cd80344cefa3e06ae8c9c9e5d9&scope.project.id=fa39ab7491e5413ca648e31ee9177fa0&role.id=cfa933c7b37b473c8e22091c8b829530 => generated 259 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:12:48.828638 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0bbe71-c912-4450-b05f-2d6e9111f1fc None None] REQUEST_METHOD: `GET` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:12:48.829333 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0bbe71-c912-4450-b05f-2d6e9111f1fc None None] SCRIPT_NAME: `/identity` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:12:48.829333 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0bbe71-c912-4450-b05f-2d6e9111f1fc None None] PATH_INFO: `/` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:12:48.830795 dv-cinder-851351-1-smb devstack@keystone.service[144068]: [pid: 144068|app: 0|req: 523/1035] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 08:12:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 08:12:48.836172 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49c6b5f-361d-422d-a7ac-e1c96e3cd712 None None] REQUEST_METHOD: `POST` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:12:48.837106 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49c6b5f-361d-422d-a7ac-e1c96e3cd712 None None] SCRIPT_NAME: `/identity` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:12:48.837106 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49c6b5f-361d-422d-a7ac-e1c96e3cd712 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:12:48.856000 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.auth.core [None req-a49c6b5f-361d-422d-a7ac-e1c96e3cd712 None None] MFA Rules not processed for user `bf5ceb8f07374635ad506b7d1b4f1612`. Rule list: `[]` (Enabled: `True`). {{(pid=144067) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 08:12:48.857308 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.fernet_utils [None req-a49c6b5f-361d-422d-a7ac-e1c96e3cd712 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=144067) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:12:48.930154 dv-cinder-851351-1-smb devstack@keystone.service[144067]: [pid: 144067|app: 0|req: 513/1036] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 08:12:48 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 08:12:48.953052 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0bbe71-c912-4450-b05f-2d6e9111f1fc None None] Authenticating user token {{(pid=144068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:12:48.969944 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e371ee7-5782-4b4d-b157-74a2c91f472e None None] REQUEST_METHOD: `GET` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:12:48.970290 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e371ee7-5782-4b4d-b157-74a2c91f472e None None] SCRIPT_NAME: `/identity` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:12:48.970486 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e371ee7-5782-4b4d-b157-74a2c91f472e None None] PATH_INFO: `/` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:12:48.972204 dv-cinder-851351-1-smb devstack@keystone.service[144067]: [pid: 144067|app: 0|req: 514/1037] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 08:12:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 28 08:12:48.977651 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01156890-f275-4218-a578-fd771c2e0c22 None None] REQUEST_METHOD: `POST` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:12:48.977930 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01156890-f275-4218-a578-fd771c2e0c22 None None] SCRIPT_NAME: `/identity` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:12:48.978385 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01156890-f275-4218-a578-fd771c2e0c22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:12:48.998278 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.auth.core [None req-01156890-f275-4218-a578-fd771c2e0c22 None None] MFA Rules not processed for user `bf5ceb8f07374635ad506b7d1b4f1612`. Rule list: `[]` (Enabled: `True`). {{(pid=144067) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 08:12:48.999489 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.fernet_utils [None req-01156890-f275-4218-a578-fd771c2e0c22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=144067) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:12:49.071736 dv-cinder-851351-1-smb devstack@keystone.service[144067]: [pid: 144067|app: 0|req: 515/1038] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 08:12:48 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 28 08:12:49.075258 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0bbe71-c912-4450-b05f-2d6e9111f1fc None None] Validating token access rules against request {{(pid=144068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:12:49.097379 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01156890-f275-4218-a578-fd771c2e0c22 None None] Authenticating user token {{(pid=144067) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:12:49.113185 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f96934b-9c19-4cb0-a393-86f737730ed1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:12:49.113937 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f96934b-9c19-4cb0-a393-86f737730ed1 None admin] REQUEST_METHOD: `GET` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:12:49.114130 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f96934b-9c19-4cb0-a393-86f737730ed1 None admin] SCRIPT_NAME: `/identity` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:12:49.114404 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f96934b-9c19-4cb0-a393-86f737730ed1 None admin] PATH_INFO: `/v3/services/image` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:12:49.115043 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f96934b-9c19-4cb0-a393-86f737730ed1 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:12:49.115900 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG dbcounter [-] [144067] Writing DB stats keystone:SELECT=100 {{(pid=144067) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:12:49.116434 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f96934b-9c19-4cb0-a393-86f737730ed1 None admin] RBAC: Authorization granted {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:12:49.126585 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application [None req-1f96934b-9c19-4cb0-a393-86f737730ed1 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jul 28 08:12:49.126585 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:12:49.126585 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 28 08:12:49.126585 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 28 08:12:49.126585 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 28 08:12:49.126585 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 28 08:12:49.126585 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 28 08:12:49.126585 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 08:12:49.126585 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 28 08:12:49.126585 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application Jul 28 08:12:49.126585 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 28 08:12:49.126585 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application Jul 28 08:12:49.126585 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:12:49.126585 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:12:49.126585 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:12:49.126585 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:12:49.126585 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:12:49.127630 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:12:49.127630 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:12:49.127630 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:12:49.127630 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:12:49.127630 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:12:49.127630 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:12:49.127630 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 28 08:12:49.127630 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 28 08:12:49.127630 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 28 08:12:49.127630 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 28 08:12:49.127630 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:12:49.127630 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:12:49.127630 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:12:49.127630 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:12:49.127630 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:12:49.127630 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:12:49.128551 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:12:49.128551 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application with Lock( Jul 28 08:12:49.128551 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:12:49.128551 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:12:49.128551 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:12:49.128551 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:12:49.128551 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:12:49.128551 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:12:49.128551 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:12:49.128551 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:12:49.128551 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 28 08:12:49.128551 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 08:12:49.128551 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 28 08:12:49.128551 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application Jul 28 08:12:49.128551 dv-cinder-851351-1-smb devstack@keystone.service[144068]: [pid: 144068|app: 0|req: 524/1039] 10.222.0.42 () {56 vars in 1105 bytes} [Thu Jul 28 08:12:48 2022] GET /identity/v3/services/image => generated 86 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:12:49.134002 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f96934b-9c19-4cb0-a393-86f737730ed1 None admin] Authenticating user token {{(pid=144068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:12:49.140157 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG dbcounter [-] [144068] Writing DB stats keystone:SELECT=100 {{(pid=144068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:12:49.208912 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01156890-f275-4218-a578-fd771c2e0c22 None None] Validating token access rules against request {{(pid=144067) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:12:49.243567 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f96934b-9c19-4cb0-a393-86f737730ed1 None admin] Validating token access rules against request {{(pid=144068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:12:49.250575 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64b2fb0-0a02-4e90-8be4-d7c1df10a02a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144067) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:12:49.252183 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64b2fb0-0a02-4e90-8be4-d7c1df10a02a None admin] REQUEST_METHOD: `GET` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:12:49.252722 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64b2fb0-0a02-4e90-8be4-d7c1df10a02a None admin] SCRIPT_NAME: `/identity` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:12:49.253275 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64b2fb0-0a02-4e90-8be4-d7c1df10a02a None admin] PATH_INFO: `/v3/domains/default` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:12:49.255493 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a64b2fb0-0a02-4e90-8be4-d7c1df10a02a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:12:49.257747 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a64b2fb0-0a02-4e90-8be4-d7c1df10a02a None admin] RBAC: Authorization granted {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:12:49.260734 dv-cinder-851351-1-smb devstack@keystone.service[144067]: [pid: 144067|app: 0|req: 516/1040] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 08:12:49 2022] GET /identity/v3/domains/default => generated 199 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 08:12:49.268219 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64b2fb0-0a02-4e90-8be4-d7c1df10a02a None admin] Authenticating user token {{(pid=144067) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:12:49.282740 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f497097-feee-404e-aaa0-481d14fd7103 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:12:49.283468 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f497097-feee-404e-aaa0-481d14fd7103 None admin] REQUEST_METHOD: `GET` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:12:49.283744 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f497097-feee-404e-aaa0-481d14fd7103 None admin] SCRIPT_NAME: `/identity` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:12:49.283960 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f497097-feee-404e-aaa0-481d14fd7103 None admin] PATH_INFO: `/v3/services` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:12:49.284708 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f497097-feee-404e-aaa0-481d14fd7103 None admin] RBAC: Adding query filter params (name=image) {{(pid=144068) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:12:49.284995 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f497097-feee-404e-aaa0-481d14fd7103 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:12:49.286414 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f497097-feee-404e-aaa0-481d14fd7103 None admin] RBAC: Authorization granted {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:12:49.293042 dv-cinder-851351-1-smb devstack@keystone.service[144068]: [pid: 144068|app: 0|req: 525/1041] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 08:12:49 2022] GET /identity/v3/services?name=image => generated 122 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 08:12:49.298904 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f497097-feee-404e-aaa0-481d14fd7103 None admin] Authenticating user token {{(pid=144068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:12:49.363106 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG dbcounter [-] [144067] Writing DB stats keystone:SELECT=100 {{(pid=144067) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:12:49.379174 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG dbcounter [-] [144068] Writing DB stats keystone:SELECT=100 {{(pid=144068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:12:49.381662 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64b2fb0-0a02-4e90-8be4-d7c1df10a02a None admin] Validating token access rules against request {{(pid=144067) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:12:49.416064 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f497097-feee-404e-aaa0-481d14fd7103 None admin] Validating token access rules against request {{(pid=144068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:12:49.418642 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64057315-d138-4226-af32-cd4196b2af68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144067) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:12:49.419351 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64057315-d138-4226-af32-cd4196b2af68 None admin] REQUEST_METHOD: `POST` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:12:49.419641 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64057315-d138-4226-af32-cd4196b2af68 None admin] SCRIPT_NAME: `/identity` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:12:49.419920 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64057315-d138-4226-af32-cd4196b2af68 None admin] PATH_INFO: `/v3/users` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:12:49.420627 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64057315-d138-4226-af32-cd4196b2af68 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:12:49.422122 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64057315-d138-4226-af32-cd4196b2af68 None admin] RBAC: Authorization granted {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:12:49.445274 dv-cinder-851351-1-smb devstack@keystone.service[144067]: [pid: 144067|app: 0|req: 517/1042] 10.222.0.42 () {60 vars in 1132 bytes} [Thu Jul 28 08:12:49 2022] POST /identity/v3/users => generated 285 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 28 08:12:49.455041 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8cf1b1d-d727-4b88-9e45-587d252b2423 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:12:49.455707 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8cf1b1d-d727-4b88-9e45-587d252b2423 None admin] REQUEST_METHOD: `GET` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:12:49.455992 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8cf1b1d-d727-4b88-9e45-587d252b2423 None admin] SCRIPT_NAME: `/identity` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:12:49.456266 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8cf1b1d-d727-4b88-9e45-587d252b2423 None admin] PATH_INFO: `/v3/services` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:12:49.457073 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8cf1b1d-d727-4b88-9e45-587d252b2423 None admin] RBAC: Adding query filter params (type=image) {{(pid=144068) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:12:49.457382 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8cf1b1d-d727-4b88-9e45-587d252b2423 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:12:49.458820 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8cf1b1d-d727-4b88-9e45-587d252b2423 None admin] RBAC: Authorization granted {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:12:49.470874 dv-cinder-851351-1-smb devstack@keystone.service[144068]: [pid: 144068|app: 0|req: 526/1043] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 08:12:49 2022] GET /identity/v3/services?type=image => generated 350 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:12:49.471947 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64057315-d138-4226-af32-cd4196b2af68 None admin] Authenticating user token {{(pid=144067) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:12:49.480354 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839aa023-42fc-44d4-8ef9-baa07825b882 None None] REQUEST_METHOD: `GET` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:12:49.480718 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839aa023-42fc-44d4-8ef9-baa07825b882 None None] SCRIPT_NAME: `/identity` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:12:49.480983 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839aa023-42fc-44d4-8ef9-baa07825b882 None None] PATH_INFO: `/` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:12:49.482735 dv-cinder-851351-1-smb devstack@keystone.service[144068]: [pid: 144068|app: 0|req: 527/1044] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 08:12:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 08:12:49.488482 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee6353d-37c7-42ae-82be-42d8502aec20 None None] REQUEST_METHOD: `POST` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:12:49.488879 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee6353d-37c7-42ae-82be-42d8502aec20 None None] SCRIPT_NAME: `/identity` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:12:49.489076 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee6353d-37c7-42ae-82be-42d8502aec20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:12:49.508688 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.auth.core [None req-3ee6353d-37c7-42ae-82be-42d8502aec20 None None] MFA Rules not processed for user `bf5ceb8f07374635ad506b7d1b4f1612`. Rule list: `[]` (Enabled: `True`). {{(pid=144068) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 08:12:49.509966 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.fernet_utils [None req-3ee6353d-37c7-42ae-82be-42d8502aec20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=144068) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:12:49.585651 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64057315-d138-4226-af32-cd4196b2af68 None admin] Validating token access rules against request {{(pid=144067) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:12:49.588615 dv-cinder-851351-1-smb devstack@keystone.service[144068]: [pid: 144068|app: 0|req: 528/1045] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 08:12:49 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 08:12:49.611208 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee6353d-37c7-42ae-82be-42d8502aec20 None None] Authenticating user token {{(pid=144068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:12:49.625839 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38e8e06-f6d8-450c-8a67-12e05e6e8e48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144067) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:12:49.626522 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38e8e06-f6d8-450c-8a67-12e05e6e8e48 None admin] REQUEST_METHOD: `GET` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:12:49.626832 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38e8e06-f6d8-450c-8a67-12e05e6e8e48 None admin] SCRIPT_NAME: `/identity` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:12:49.627115 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38e8e06-f6d8-450c-8a67-12e05e6e8e48 None admin] PATH_INFO: `/v3/endpoints` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:12:49.628016 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a38e8e06-f6d8-450c-8a67-12e05e6e8e48 None admin] RBAC: Adding query filter params (interface=public, service_id=7a0b283ed0ae4916b417f138d043a7cd, region_id=RegionOne) {{(pid=144067) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:12:49.628410 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a38e8e06-f6d8-450c-8a67-12e05e6e8e48 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:12:49.630421 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a38e8e06-f6d8-450c-8a67-12e05e6e8e48 None admin] RBAC: Authorization granted {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:12:49.635554 dv-cinder-851351-1-smb devstack@keystone.service[144067]: [pid: 144067|app: 0|req: 518/1046] 10.222.0.42 () {56 vars in 1251 bytes} [Thu Jul 28 08:12:49 2022] GET /identity/v3/endpoints?service_id=7a0b283ed0ae4916b417f138d043a7cd&interface=public®ion_id=RegionOne => generated 194 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:12:49.641829 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38e8e06-f6d8-450c-8a67-12e05e6e8e48 None admin] Authenticating user token {{(pid=144067) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:12:49.646619 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG dbcounter [-] [144067] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=144067) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:12:49.689723 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG dbcounter [-] [144068] Writing DB stats keystone:SELECT=100 {{(pid=144068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:12:49.734159 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee6353d-37c7-42ae-82be-42d8502aec20 None None] Validating token access rules against request {{(pid=144068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:12:49.764549 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38e8e06-f6d8-450c-8a67-12e05e6e8e48 None admin] Validating token access rules against request {{(pid=144067) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:12:49.770255 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8efd6b57-fdd0-47e6-928d-15dde2da61a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:12:49.770926 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efd6b57-fdd0-47e6-928d-15dde2da61a3 None admin] REQUEST_METHOD: `GET` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:12:49.771209 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efd6b57-fdd0-47e6-928d-15dde2da61a3 None admin] SCRIPT_NAME: `/identity` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:12:49.771482 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efd6b57-fdd0-47e6-928d-15dde2da61a3 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:12:49.783361 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8efd6b57-fdd0-47e6-928d-15dde2da61a3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 08:12:49.788338 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application [None req-8efd6b57-fdd0-47e6-928d-15dde2da61a3 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 28 08:12:49.788338 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:12:49.788338 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:12:49.788338 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:12:49.788338 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:12:49.788338 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:12:49.788338 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:12:49.788338 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:12:49.788338 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:12:49.788338 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:12:49.788338 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:12:49.788338 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:12:49.788338 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 08:12:49.788338 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 08:12:49.788338 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 08:12:49.788338 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 08:12:49.789289 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 08:12:49.789289 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 08:12:49.789289 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 08:12:49.789289 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 08:12:49.789289 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:12:49.789289 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:12:49.789289 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:12:49.789289 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:12:49.789289 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:12:49.789289 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:12:49.789289 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:12:49.789289 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application with Lock( Jul 28 08:12:49.789289 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:12:49.789289 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:12:49.789289 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:12:49.789289 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:12:49.790085 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:12:49.790085 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:12:49.790085 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:12:49.790085 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:12:49.790085 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 08:12:49.790085 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 08:12:49.790085 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 08:12:49.790085 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 08:12:49.790085 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 08:12:49.790085 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 08:12:49.790085 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 28 08:12:49.790085 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application Jul 28 08:12:49.790085 dv-cinder-851351-1-smb devstack@keystone.service[144068]: [pid: 144068|app: 0|req: 529/1047] 10.222.0.42 () {56 vars in 1120 bytes} [Thu Jul 28 08:12:49 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 08:12:49.796492 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8efd6b57-fdd0-47e6-928d-15dde2da61a3 None admin] Authenticating user token {{(pid=144068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:12:49.803001 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b11b8bc-1fde-4d51-af9e-73ee5b876010 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144067) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:12:49.803654 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b11b8bc-1fde-4d51-af9e-73ee5b876010 None admin] REQUEST_METHOD: `GET` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:12:49.803940 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b11b8bc-1fde-4d51-af9e-73ee5b876010 None admin] SCRIPT_NAME: `/identity` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:12:49.804221 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b11b8bc-1fde-4d51-af9e-73ee5b876010 None admin] PATH_INFO: `/v3/services` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:12:49.804984 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b11b8bc-1fde-4d51-af9e-73ee5b876010 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:12:49.806406 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b11b8bc-1fde-4d51-af9e-73ee5b876010 None admin] RBAC: Authorization granted {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:12:49.813517 dv-cinder-851351-1-smb devstack@keystone.service[144067]: [pid: 144067|app: 0|req: 519/1048] 10.222.0.42 () {56 vars in 1087 bytes} [Thu Jul 28 08:12:49 2022] GET /identity/v3/services => generated 1957 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 28 08:12:49.919598 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8efd6b57-fdd0-47e6-928d-15dde2da61a3 None admin] Validating token access rules against request {{(pid=144068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:12:49.948163 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG dbcounter [-] [144068] Writing DB stats keystone:SELECT=100 {{(pid=144068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:12:49.964183 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea9cd290-3cd9-46c4-9bad-9d9b3c3ac7b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:12:49.964895 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9cd290-3cd9-46c4-9bad-9d9b3c3ac7b2 None admin] REQUEST_METHOD: `GET` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:12:49.965254 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9cd290-3cd9-46c4-9bad-9d9b3c3ac7b2 None admin] SCRIPT_NAME: `/identity` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:12:49.965536 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9cd290-3cd9-46c4-9bad-9d9b3c3ac7b2 None admin] PATH_INFO: `/v3/roles` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:12:49.966308 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea9cd290-3cd9-46c4-9bad-9d9b3c3ac7b2 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=144068) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:12:49.968739 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea9cd290-3cd9-46c4-9bad-9d9b3c3ac7b2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:12:49.968739 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea9cd290-3cd9-46c4-9bad-9d9b3c3ac7b2 None admin] RBAC: Authorization granted {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:12:49.981777 dv-cinder-851351-1-smb devstack@keystone.service[144068]: [pid: 144068|app: 0|req: 530/1049] 10.222.0.42 () {56 vars in 1115 bytes} [Thu Jul 28 08:12:49 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:12:49.988361 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b11b8bc-1fde-4d51-af9e-73ee5b876010 None admin] Authenticating user token {{(pid=144067) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:12:50.070526 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG dbcounter [-] [144067] Writing DB stats keystone:SELECT=100 {{(pid=144067) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:12:50.116727 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b11b8bc-1fde-4d51-af9e-73ee5b876010 None admin] Validating token access rules against request {{(pid=144067) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:12:50.157162 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c5456f-10b3-4326-9d0a-676c7fec95e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144067) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:12:50.157895 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c5456f-10b3-4326-9d0a-676c7fec95e8 None admin] REQUEST_METHOD: `GET` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:12:50.158181 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c5456f-10b3-4326-9d0a-676c7fec95e8 None admin] SCRIPT_NAME: `/identity` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:12:50.158504 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c5456f-10b3-4326-9d0a-676c7fec95e8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:12:50.170262 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c5456f-10b3-4326-9d0a-676c7fec95e8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:12:50.171672 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c5456f-10b3-4326-9d0a-676c7fec95e8 None admin] RBAC: Authorization granted {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:12:50.186828 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application [None req-98c5456f-10b3-4326-9d0a-676c7fec95e8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 08:12:50.186828 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:12:50.186828 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:12:50.186828 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:12:50.186828 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:12:50.186828 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:12:50.186828 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:12:50.186828 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:12:50.186828 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:12:50.186828 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:12:50.186828 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:12:50.186828 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:12:50.186828 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 08:12:50.186828 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 08:12:50.186828 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 08:12:50.187729 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 08:12:50.187729 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:12:50.187729 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:12:50.187729 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:12:50.187729 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:12:50.187729 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:12:50.187729 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:12:50.187729 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:12:50.187729 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application with Lock( Jul 28 08:12:50.187729 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:12:50.187729 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:12:50.187729 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:12:50.187729 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:12:50.187729 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:12:50.187729 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:12:50.187729 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:12:50.187729 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:12:50.188640 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 08:12:50.188640 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 08:12:50.188640 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 08:12:50.188640 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application Jul 28 08:12:50.188640 dv-cinder-851351-1-smb devstack@keystone.service[144067]: [pid: 144067|app: 0|req: 520/1050] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 08:12:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:12:50.194239 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea9cd290-3cd9-46c4-9bad-9d9b3c3ac7b2 None admin] Authenticating user token {{(pid=144068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:12:50.321850 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea9cd290-3cd9-46c4-9bad-9d9b3c3ac7b2 None admin] Validating token access rules against request {{(pid=144068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:12:50.369077 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf4ca0b-311a-4bb3-9fce-ae581b13921f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:12:50.369840 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf4ca0b-311a-4bb3-9fce-ae581b13921f None admin] REQUEST_METHOD: `GET` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:12:50.370189 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf4ca0b-311a-4bb3-9fce-ae581b13921f None admin] SCRIPT_NAME: `/identity` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:12:50.370507 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf4ca0b-311a-4bb3-9fce-ae581b13921f None admin] PATH_INFO: `/v3/domains` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:12:50.371388 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbf4ca0b-311a-4bb3-9fce-ae581b13921f None admin] RBAC: Adding query filter params (name=Default) {{(pid=144068) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:12:50.371767 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbf4ca0b-311a-4bb3-9fce-ae581b13921f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:12:50.373656 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbf4ca0b-311a-4bb3-9fce-ae581b13921f None admin] RBAC: Authorization granted {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:12:50.392396 dv-cinder-851351-1-smb devstack@keystone.service[144068]: [pid: 144068|app: 0|req: 531/1051] 10.222.0.42 () {56 vars in 1109 bytes} [Thu Jul 28 08:12:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:12:50.394375 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c5456f-10b3-4326-9d0a-676c7fec95e8 None admin] Authenticating user token {{(pid=144067) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:12:50.504192 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c5456f-10b3-4326-9d0a-676c7fec95e8 None admin] Validating token access rules against request {{(pid=144067) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:12:50.525293 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG dbcounter [-] [144067] Writing DB stats keystone:SELECT=100 {{(pid=144067) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:12:50.542526 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce42707b-dab3-44e1-a7c3-28891e923bd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144067) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:12:50.543204 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce42707b-dab3-44e1-a7c3-28891e923bd8 None admin] REQUEST_METHOD: `GET` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:12:50.543507 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce42707b-dab3-44e1-a7c3-28891e923bd8 None admin] SCRIPT_NAME: `/identity` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:12:50.543786 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce42707b-dab3-44e1-a7c3-28891e923bd8 None admin] PATH_INFO: `/v3/users/nova` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:12:50.553303 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce42707b-dab3-44e1-a7c3-28891e923bd8 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:12:50.554811 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce42707b-dab3-44e1-a7c3-28891e923bd8 None admin] RBAC: Authorization granted {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:12:50.567220 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application [None req-ce42707b-dab3-44e1-a7c3-28891e923bd8 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 28 08:12:50.567220 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:12:50.567220 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:12:50.567220 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:12:50.567220 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:12:50.567220 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:12:50.567220 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:12:50.567220 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:12:50.567220 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:12:50.567220 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:12:50.567220 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:12:50.567220 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:12:50.567220 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 28 08:12:50.567220 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 28 08:12:50.567220 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 28 08:12:50.567220 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 28 08:12:50.568180 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:12:50.568180 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:12:50.568180 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 28 08:12:50.568180 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 08:12:50.568180 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 28 08:12:50.568180 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 08:12:50.568180 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:12:50.568180 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:12:50.568180 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:12:50.568180 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:12:50.568180 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:12:50.568180 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application with Lock( Jul 28 08:12:50.568180 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:12:50.568180 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:12:50.568180 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:12:50.568180 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:12:50.568180 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:12:50.568180 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:12:50.569338 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:12:50.569338 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:12:50.569338 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 28 08:12:50.569338 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 28 08:12:50.569338 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 28 08:12:50.569338 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 28 08:12:50.569338 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 28 08:12:50.569338 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 28 08:12:50.569338 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 28 08:12:50.569338 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application Jul 28 08:12:50.573141 dv-cinder-851351-1-smb devstack@keystone.service[144067]: [pid: 144067|app: 0|req: 521/1052] 10.222.0.42 () {56 vars in 1093 bytes} [Thu Jul 28 08:12:50 2022] GET /identity/v3/users/nova => generated 82 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:12:50.574635 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf4ca0b-311a-4bb3-9fce-ae581b13921f None admin] Authenticating user token {{(pid=144068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:12:50.628577 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG dbcounter [-] [144068] Writing DB stats keystone:SELECT=100 {{(pid=144068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:12:50.693603 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf4ca0b-311a-4bb3-9fce-ae581b13921f None admin] Validating token access rules against request {{(pid=144068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:12:50.731218 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c2c817-383e-4536-b3ae-5e54d0e69edb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:12:50.731950 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c2c817-383e-4536-b3ae-5e54d0e69edb None admin] REQUEST_METHOD: `GET` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:12:50.732279 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c2c817-383e-4536-b3ae-5e54d0e69edb None admin] SCRIPT_NAME: `/identity` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:12:50.732387 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c2c817-383e-4536-b3ae-5e54d0e69edb None admin] PATH_INFO: `/v3/users` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:12:50.733241 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c2c817-383e-4536-b3ae-5e54d0e69edb None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=144068) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:12:50.733552 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c2c817-383e-4536-b3ae-5e54d0e69edb None admin] RBAC: Authorizing `identity:list_users()` {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:12:50.734995 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c2c817-383e-4536-b3ae-5e54d0e69edb None admin] RBAC: Authorization granted {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:12:50.753584 dv-cinder-851351-1-smb devstack@keystone.service[144068]: [pid: 144068|app: 0|req: 532/1053] 10.222.0.42 () {56 vars in 1133 bytes} [Thu Jul 28 08:12:50 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:12:50.759463 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce42707b-dab3-44e1-a7c3-28891e923bd8 None admin] Authenticating user token {{(pid=144067) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:12:50.863581 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce42707b-dab3-44e1-a7c3-28891e923bd8 None admin] Validating token access rules against request {{(pid=144067) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:12:50.899107 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509b4c52-41d2-45b4-86ce-506cd7b901ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144067) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:12:50.899769 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509b4c52-41d2-45b4-86ce-506cd7b901ac None admin] REQUEST_METHOD: `GET` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:12:50.900053 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509b4c52-41d2-45b4-86ce-506cd7b901ac None admin] SCRIPT_NAME: `/identity` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:12:50.900325 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509b4c52-41d2-45b4-86ce-506cd7b901ac None admin] PATH_INFO: `/v3/domains/Default` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:12:50.911613 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-509b4c52-41d2-45b4-86ce-506cd7b901ac None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:12:50.913142 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-509b4c52-41d2-45b4-86ce-506cd7b901ac None admin] RBAC: Authorization granted {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:12:50.928198 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application [None req-509b4c52-41d2-45b4-86ce-506cd7b901ac None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 08:12:50.928198 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:12:50.928198 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:12:50.928198 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:12:50.928198 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:12:50.928198 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:12:50.928198 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:12:50.928198 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:12:50.928198 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:12:50.928198 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:12:50.928198 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:12:50.928198 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:12:50.928198 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 08:12:50.928198 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 08:12:50.928198 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 08:12:50.929539 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 08:12:50.929539 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:12:50.929539 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:12:50.929539 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:12:50.929539 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:12:50.929539 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:12:50.929539 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:12:50.929539 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:12:50.929539 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application with Lock( Jul 28 08:12:50.929539 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:12:50.929539 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:12:50.929539 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:12:50.929539 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:12:50.929539 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:12:50.929539 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:12:50.929539 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:12:50.929539 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:12:50.930376 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 08:12:50.930376 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 08:12:50.930376 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 08:12:50.930376 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application Jul 28 08:12:50.930376 dv-cinder-851351-1-smb devstack@keystone.service[144067]: [pid: 144067|app: 0|req: 522/1054] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 08:12:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 08:12:50.935346 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c2c817-383e-4536-b3ae-5e54d0e69edb None admin] Authenticating user token {{(pid=144068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:12:51.057554 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c2c817-383e-4536-b3ae-5e54d0e69edb None admin] Validating token access rules against request {{(pid=144068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:12:51.059523 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG dbcounter [-] [144068] Writing DB stats keystone:SELECT=100 {{(pid=144068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:12:51.099576 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94ada8e-e516-40d5-a377-a89da8dc22c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:12:51.100271 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94ada8e-e516-40d5-a377-a89da8dc22c6 None admin] REQUEST_METHOD: `GET` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:12:51.100557 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94ada8e-e516-40d5-a377-a89da8dc22c6 None admin] SCRIPT_NAME: `/identity` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:12:51.100849 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94ada8e-e516-40d5-a377-a89da8dc22c6 None admin] PATH_INFO: `/v3/domains` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:12:51.101559 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e94ada8e-e516-40d5-a377-a89da8dc22c6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=144068) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:12:51.101864 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e94ada8e-e516-40d5-a377-a89da8dc22c6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:12:51.103302 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e94ada8e-e516-40d5-a377-a89da8dc22c6 None admin] RBAC: Authorization granted {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:12:51.120547 dv-cinder-851351-1-smb devstack@keystone.service[144068]: [pid: 144068|app: 0|req: 533/1055] 10.222.0.42 () {56 vars in 1109 bytes} [Thu Jul 28 08:12:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 08:12:51.122016 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509b4c52-41d2-45b4-86ce-506cd7b901ac None admin] Authenticating user token {{(pid=144067) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:12:51.156254 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG dbcounter [-] [144067] Writing DB stats keystone:SELECT=100 {{(pid=144067) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:12:51.231947 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509b4c52-41d2-45b4-86ce-506cd7b901ac None admin] Validating token access rules against request {{(pid=144067) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:12:51.268067 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384e323a-8af7-4092-bbdd-0e0b1ed807e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144067) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:12:51.268761 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384e323a-8af7-4092-bbdd-0e0b1ed807e2 None admin] REQUEST_METHOD: `GET` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:12:51.269213 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384e323a-8af7-4092-bbdd-0e0b1ed807e2 None admin] SCRIPT_NAME: `/identity` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:12:51.269450 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384e323a-8af7-4092-bbdd-0e0b1ed807e2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:12:51.277503 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-384e323a-8af7-4092-bbdd-0e0b1ed807e2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:12:51.278959 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-384e323a-8af7-4092-bbdd-0e0b1ed807e2 None admin] RBAC: Authorization granted {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:12:51.291066 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application [None req-384e323a-8af7-4092-bbdd-0e0b1ed807e2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 08:12:51.291066 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:12:51.291066 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:12:51.291066 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:12:51.291066 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:12:51.291066 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:12:51.291066 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:12:51.291066 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:12:51.291066 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:12:51.291066 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:12:51.291066 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:12:51.291066 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:12:51.291066 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 28 08:12:51.291066 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 28 08:12:51.291066 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 28 08:12:51.291985 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 28 08:12:51.291985 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:12:51.291985 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:12:51.291985 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:12:51.291985 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:12:51.291985 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:12:51.291985 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:12:51.291985 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:12:51.291985 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application with Lock( Jul 28 08:12:51.291985 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:12:51.291985 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:12:51.291985 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:12:51.291985 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:12:51.291985 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:12:51.291985 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:12:51.291985 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:12:51.291985 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:12:51.293296 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 28 08:12:51.293296 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 28 08:12:51.293296 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 28 08:12:51.293296 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 28 08:12:51.293296 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 28 08:12:51.293296 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 28 08:12:51.293296 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 08:12:51.293296 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application Jul 28 08:12:51.296761 dv-cinder-851351-1-smb devstack@keystone.service[144067]: [pid: 144067|app: 0|req: 523/1056] 10.222.0.42 () {56 vars in 1111 bytes} [Thu Jul 28 08:12:51 2022] GET /identity/v3/projects/service => generated 88 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:12:51.298613 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94ada8e-e516-40d5-a377-a89da8dc22c6 None admin] Authenticating user token {{(pid=144068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:12:51.400949 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94ada8e-e516-40d5-a377-a89da8dc22c6 None admin] Validating token access rules against request {{(pid=144068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:12:51.440010 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304b3571-9719-485d-ab75-45721885f0c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:12:51.440671 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304b3571-9719-485d-ab75-45721885f0c5 None admin] REQUEST_METHOD: `GET` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:12:51.440997 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304b3571-9719-485d-ab75-45721885f0c5 None admin] SCRIPT_NAME: `/identity` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:12:51.441273 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304b3571-9719-485d-ab75-45721885f0c5 None admin] PATH_INFO: `/v3/projects` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:12:51.442051 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-304b3571-9719-485d-ab75-45721885f0c5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=144068) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:12:51.442363 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-304b3571-9719-485d-ab75-45721885f0c5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:12:51.443860 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-304b3571-9719-485d-ab75-45721885f0c5 None admin] RBAC: Authorization granted {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:12:51.462473 dv-cinder-851351-1-smb devstack@keystone.service[144068]: [pid: 144068|app: 0|req: 534/1057] 10.222.0.42 () {56 vars in 1148 bytes} [Thu Jul 28 08:12:51 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:12:51.464206 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384e323a-8af7-4092-bbdd-0e0b1ed807e2 None admin] Authenticating user token {{(pid=144067) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:12:51.556033 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610aedda-1cc7-41de-b6aa-9ff73a250f48 None None] REQUEST_METHOD: `GET` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:12:51.556329 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610aedda-1cc7-41de-b6aa-9ff73a250f48 None None] SCRIPT_NAME: `/identity` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:12:51.556780 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610aedda-1cc7-41de-b6aa-9ff73a250f48 None None] PATH_INFO: `/` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:12:51.558301 dv-cinder-851351-1-smb devstack@keystone.service[144068]: [pid: 144068|app: 0|req: 535/1058] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 08:12:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 28 08:12:51.563453 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e642ee9d-955a-44bc-9f34-87a8402a5b25 None None] REQUEST_METHOD: `POST` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:12:51.563623 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG dbcounter [-] [144067] Writing DB stats keystone:SELECT=100 {{(pid=144067) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:12:51.563706 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e642ee9d-955a-44bc-9f34-87a8402a5b25 None None] SCRIPT_NAME: `/identity` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:12:51.563986 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e642ee9d-955a-44bc-9f34-87a8402a5b25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:12:51.576003 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384e323a-8af7-4092-bbdd-0e0b1ed807e2 None admin] Validating token access rules against request {{(pid=144067) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:12:51.582714 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.auth.core [None req-e642ee9d-955a-44bc-9f34-87a8402a5b25 None None] MFA Rules not processed for user `bf5ceb8f07374635ad506b7d1b4f1612`. Rule list: `[]` (Enabled: `True`). {{(pid=144068) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 08:12:51.583950 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.fernet_utils [None req-e642ee9d-955a-44bc-9f34-87a8402a5b25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=144068) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:12:51.602644 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG dbcounter [-] [144068] Writing DB stats keystone:SELECT=100 {{(pid=144068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:12:51.618085 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4645a243-00ac-4ae6-9f63-4dda114a8225 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144067) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:12:51.618790 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4645a243-00ac-4ae6-9f63-4dda114a8225 None admin] REQUEST_METHOD: `PUT` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:12:51.619078 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4645a243-00ac-4ae6-9f63-4dda114a8225 None admin] SCRIPT_NAME: `/identity` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:12:51.619458 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4645a243-00ac-4ae6-9f63-4dda114a8225 None admin] PATH_INFO: `/v3/projects/fa39ab7491e5413ca648e31ee9177fa0/users/2c1de9cd80344cefa3e06ae8c9c9e5d9/roles/cfa933c7b37b473c8e22091c8b829530` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:12:51.622723 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4645a243-00ac-4ae6-9f63-4dda114a8225 None admin] RBAC: Authorizing `identity:create_grant(project_id=fa39ab7491e5413ca648e31ee9177fa0, user_id=2c1de9cd80344cefa3e06ae8c9c9e5d9, role_id=cfa933c7b37b473c8e22091c8b829530)` {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:12:51.624234 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4645a243-00ac-4ae6-9f63-4dda114a8225 None admin] RBAC: Authorization granted {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:12:51.643062 dv-cinder-851351-1-smb devstack@keystone.service[144067]: [pid: 144067|app: 0|req: 524/1059] 10.222.0.42 () {58 vars in 1439 bytes} [Thu Jul 28 08:12:51 2022] PUT /identity/v3/projects/fa39ab7491e5413ca648e31ee9177fa0/users/2c1de9cd80344cefa3e06ae8c9c9e5d9/roles/cfa933c7b37b473c8e22091c8b829530 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 08:12:51.660841 dv-cinder-851351-1-smb devstack@keystone.service[144068]: [pid: 144068|app: 0|req: 536/1060] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 08:12:51 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 28 08:12:51.684161 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4645a243-00ac-4ae6-9f63-4dda114a8225 None admin] Authenticating user token {{(pid=144067) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:12:51.803766 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4645a243-00ac-4ae6-9f63-4dda114a8225 None admin] Validating token access rules against request {{(pid=144067) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:12:51.842566 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cdc88e6-4155-467f-880c-8961ffd71049 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144067) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:12:51.843233 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cdc88e6-4155-467f-880c-8961ffd71049 None admin] REQUEST_METHOD: `GET` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:12:51.843519 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cdc88e6-4155-467f-880c-8961ffd71049 None admin] SCRIPT_NAME: `/identity` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:12:51.843803 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cdc88e6-4155-467f-880c-8961ffd71049 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:12:51.854782 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cdc88e6-4155-467f-880c-8961ffd71049 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 08:12:51.860416 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application [None req-9cdc88e6-4155-467f-880c-8961ffd71049 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 08:12:51.860416 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:12:51.860416 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:12:51.860416 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:12:51.860416 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:12:51.860416 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:12:51.860416 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:12:51.860416 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:12:51.860416 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:12:51.860416 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:12:51.860416 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:12:51.860416 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:12:51.860416 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 08:12:51.860416 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 08:12:51.860416 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 08:12:51.860416 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 08:12:51.861482 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 08:12:51.861482 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 08:12:51.861482 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 08:12:51.861482 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 08:12:51.861482 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:12:51.861482 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:12:51.861482 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:12:51.861482 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:12:51.861482 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:12:51.861482 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:12:51.861482 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:12:51.861482 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application with Lock( Jul 28 08:12:51.861482 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:12:51.861482 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:12:51.861482 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:12:51.861482 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:12:51.862563 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:12:51.862563 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:12:51.862563 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:12:51.862563 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:12:51.862563 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 08:12:51.862563 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 08:12:51.862563 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 08:12:51.862563 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 08:12:51.862563 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 08:12:51.862563 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 08:12:51.862563 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 08:12:51.862563 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application Jul 28 08:12:51.862563 dv-cinder-851351-1-smb devstack@keystone.service[144067]: [pid: 144067|app: 0|req: 525/1061] 10.222.0.42 () {56 vars in 1096 bytes} [Thu Jul 28 08:12:51 2022] GET /identity/v3/roles/admin => generated 83 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:12:51.869685 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e642ee9d-955a-44bc-9f34-87a8402a5b25 None None] Authenticating user token {{(pid=144068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:12:51.978178 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e642ee9d-955a-44bc-9f34-87a8402a5b25 None None] Validating token access rules against request {{(pid=144068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:12:52.018386 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c74df5-b770-440c-af14-ed57993ab8c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:12:52.019074 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c74df5-b770-440c-af14-ed57993ab8c8 None admin] REQUEST_METHOD: `GET` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:12:52.019366 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c74df5-b770-440c-af14-ed57993ab8c8 None admin] SCRIPT_NAME: `/identity` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:12:52.019635 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c74df5-b770-440c-af14-ed57993ab8c8 None admin] PATH_INFO: `/v3/roles` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:12:52.020415 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82c74df5-b770-440c-af14-ed57993ab8c8 None admin] RBAC: Adding query filter params (name=admin) {{(pid=144068) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:12:52.020752 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82c74df5-b770-440c-af14-ed57993ab8c8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:12:52.022146 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82c74df5-b770-440c-af14-ed57993ab8c8 None admin] RBAC: Authorization granted {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:12:52.030957 dv-cinder-851351-1-smb devstack@keystone.service[144068]: [pid: 144068|app: 0|req: 537/1062] 10.222.0.42 () {56 vars in 1099 bytes} [Thu Jul 28 08:12:51 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:12:52.036985 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cdc88e6-4155-467f-880c-8961ffd71049 None admin] Authenticating user token {{(pid=144067) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:12:52.037339 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057b98dd-e492-45fa-8a14-98f5c80262a7 None None] REQUEST_METHOD: `GET` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:12:52.037624 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057b98dd-e492-45fa-8a14-98f5c80262a7 None None] SCRIPT_NAME: `/identity` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:12:52.037895 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057b98dd-e492-45fa-8a14-98f5c80262a7 None None] PATH_INFO: `/` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:12:52.039363 dv-cinder-851351-1-smb devstack@keystone.service[144068]: [pid: 144068|app: 0|req: 538/1063] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 08:12:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 08:12:52.044578 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4309d8f-70e3-48d4-9520-78d43c96cc7a None None] REQUEST_METHOD: `POST` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:12:52.044896 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4309d8f-70e3-48d4-9520-78d43c96cc7a None None] SCRIPT_NAME: `/identity` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:12:52.045172 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4309d8f-70e3-48d4-9520-78d43c96cc7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:12:52.054996 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG dbcounter [-] [144067] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=144067) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:12:52.068375 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.auth.core [None req-d4309d8f-70e3-48d4-9520-78d43c96cc7a None None] MFA Rules not processed for user `bf5ceb8f07374635ad506b7d1b4f1612`. Rule list: `[]` (Enabled: `True`). {{(pid=144068) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 08:12:52.070703 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.fernet_utils [None req-d4309d8f-70e3-48d4-9520-78d43c96cc7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=144068) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:12:52.083148 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG dbcounter [-] [144068] Writing DB stats keystone:SELECT=100 {{(pid=144068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:12:52.146048 dv-cinder-851351-1-smb devstack@keystone.service[144068]: [pid: 144068|app: 0|req: 539/1064] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 08:12:52 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 28 08:12:52.155604 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cdc88e6-4155-467f-880c-8961ffd71049 None admin] Validating token access rules against request {{(pid=144067) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:12:52.168365 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4309d8f-70e3-48d4-9520-78d43c96cc7a None None] Authenticating user token {{(pid=144068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:12:52.192401 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c0c12f-097b-4f07-9494-e3feda5de90f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144067) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:12:52.193108 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c0c12f-097b-4f07-9494-e3feda5de90f None admin] REQUEST_METHOD: `GET` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:12:52.193401 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c0c12f-097b-4f07-9494-e3feda5de90f None admin] SCRIPT_NAME: `/identity` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:12:52.193690 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c0c12f-097b-4f07-9494-e3feda5de90f None admin] PATH_INFO: `/v3/users/9a14ff9188ae4c87951d765322c9e9a4` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:12:52.209736 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c0c12f-097b-4f07-9494-e3feda5de90f None admin] RBAC: Authorizing `identity:get_user(user_id=9a14ff9188ae4c87951d765322c9e9a4)` {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:12:52.211840 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c0c12f-097b-4f07-9494-e3feda5de90f None admin] RBAC: Authorization granted {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:12:52.213532 dv-cinder-851351-1-smb devstack@keystone.service[144067]: [pid: 144067|app: 0|req: 526/1065] 10.222.0.42 () {56 vars in 1177 bytes} [Thu Jul 28 08:12:52 2022] GET /identity/v3/users/9a14ff9188ae4c87951d765322c9e9a4 => generated 285 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:12:52.219191 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c0c12f-097b-4f07-9494-e3feda5de90f None admin] Authenticating user token {{(pid=144067) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:12:52.285151 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4309d8f-70e3-48d4-9520-78d43c96cc7a None None] Validating token access rules against request {{(pid=144068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:12:52.295349 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG dbcounter [-] [144067] Writing DB stats keystone:SELECT=100 {{(pid=144067) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:12:52.321931 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a3f6c9-72bf-4d22-a11b-d1e31a72c857 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:12:52.322599 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a3f6c9-72bf-4d22-a11b-d1e31a72c857 None admin] REQUEST_METHOD: `GET` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:12:52.322882 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a3f6c9-72bf-4d22-a11b-d1e31a72c857 None admin] SCRIPT_NAME: `/identity` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:12:52.323157 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a3f6c9-72bf-4d22-a11b-d1e31a72c857 None admin] PATH_INFO: `/v3/services/image` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:12:52.323802 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09a3f6c9-72bf-4d22-a11b-d1e31a72c857 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:12:52.325249 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09a3f6c9-72bf-4d22-a11b-d1e31a72c857 None admin] RBAC: Authorization granted {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:12:52.330486 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c0c12f-097b-4f07-9494-e3feda5de90f None admin] Validating token access rules against request {{(pid=144067) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:12:52.334526 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application [None req-09a3f6c9-72bf-4d22-a11b-d1e31a72c857 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jul 28 08:12:52.334526 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:12:52.334526 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 28 08:12:52.334526 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 28 08:12:52.334526 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 28 08:12:52.334526 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 28 08:12:52.334526 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 28 08:12:52.334526 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 08:12:52.334526 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 28 08:12:52.334526 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application Jul 28 08:12:52.334526 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 28 08:12:52.334526 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application Jul 28 08:12:52.334526 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:12:52.334526 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:12:52.334526 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:12:52.334526 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:12:52.334526 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:12:52.335458 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:12:52.335458 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:12:52.335458 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:12:52.335458 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:12:52.335458 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:12:52.335458 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:12:52.335458 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 28 08:12:52.335458 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 28 08:12:52.335458 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 28 08:12:52.335458 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 28 08:12:52.335458 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:12:52.335458 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:12:52.335458 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:12:52.335458 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:12:52.335458 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:12:52.335458 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:12:52.342209 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:12:52.342209 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application with Lock( Jul 28 08:12:52.342209 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:12:52.342209 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:12:52.342209 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:12:52.342209 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:12:52.342209 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:12:52.342209 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:12:52.342209 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:12:52.342209 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:12:52.342209 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 28 08:12:52.342209 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 08:12:52.342209 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 28 08:12:52.342209 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application Jul 28 08:12:52.342209 dv-cinder-851351-1-smb devstack@keystone.service[144068]: [pid: 144068|app: 0|req: 540/1066] 10.222.0.42 () {56 vars in 1105 bytes} [Thu Jul 28 08:12:52 2022] GET /identity/v3/services/image => generated 86 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 08:12:52.343038 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a3f6c9-72bf-4d22-a11b-d1e31a72c857 None admin] Authenticating user token {{(pid=144068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:12:52.354226 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG dbcounter [-] [144068] Writing DB stats keystone:SELECT=100 {{(pid=144068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:12:52.374345 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfeb617e-6ac4-4d8b-8d90-7f6947f5f0cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144067) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:12:52.375084 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfeb617e-6ac4-4d8b-8d90-7f6947f5f0cb None admin] REQUEST_METHOD: `GET` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:12:52.375378 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfeb617e-6ac4-4d8b-8d90-7f6947f5f0cb None admin] SCRIPT_NAME: `/identity` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:12:52.375660 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfeb617e-6ac4-4d8b-8d90-7f6947f5f0cb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:12:52.448812 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfeb617e-6ac4-4d8b-8d90-7f6947f5f0cb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:12:52.449615 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a3f6c9-72bf-4d22-a11b-d1e31a72c857 None admin] Validating token access rules against request {{(pid=144068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:12:52.450315 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfeb617e-6ac4-4d8b-8d90-7f6947f5f0cb None admin] RBAC: Authorization granted {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:12:52.486391 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc9ff07-9f64-4011-9f3a-cf1b9471f26a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:12:52.487035 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc9ff07-9f64-4011-9f3a-cf1b9471f26a None admin] REQUEST_METHOD: `GET` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:12:52.487319 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc9ff07-9f64-4011-9f3a-cf1b9471f26a None admin] SCRIPT_NAME: `/identity` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:12:52.487635 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc9ff07-9f64-4011-9f3a-cf1b9471f26a None admin] PATH_INFO: `/v3/services` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:12:52.488332 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cc9ff07-9f64-4011-9f3a-cf1b9471f26a None admin] RBAC: Adding query filter params (name=image) {{(pid=144068) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:12:52.488646 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cc9ff07-9f64-4011-9f3a-cf1b9471f26a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:12:52.490083 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cc9ff07-9f64-4011-9f3a-cf1b9471f26a None admin] RBAC: Authorization granted {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:12:52.500480 dv-cinder-851351-1-smb devstack@keystone.service[144068]: [pid: 144068|app: 0|req: 541/1067] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 08:12:52 2022] GET /identity/v3/services?name=image => generated 122 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 08:12:52.501798 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc9ff07-9f64-4011-9f3a-cf1b9471f26a None admin] Authenticating user token {{(pid=144068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:12:52.533413 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG dbcounter [-] [144067] Writing DB stats keystone:SELECT=100 {{(pid=144067) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:12:52.574928 dv-cinder-851351-1-smb devstack@keystone.service[144067]: [pid: 144067|app: 0|req: 527/1068] 10.222.0.42 () {58 vars in 1282 bytes} [Thu Jul 28 08:12:52 2022] GET /identity/v3/auth/tokens => generated 1959 bytes in 351 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jul 28 08:12:52.576517 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfeb617e-6ac4-4d8b-8d90-7f6947f5f0cb None admin] Authenticating user token {{(pid=144067) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:12:52.579632 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG dbcounter [-] [144068] Writing DB stats keystone:SELECT=100 {{(pid=144068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:12:52.616052 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc9ff07-9f64-4011-9f3a-cf1b9471f26a None admin] Validating token access rules against request {{(pid=144068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:12:52.654376 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1958335c-f51c-4714-a6bf-75ed29d3c438 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:12:52.655069 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1958335c-f51c-4714-a6bf-75ed29d3c438 None admin] REQUEST_METHOD: `GET` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:12:52.655398 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1958335c-f51c-4714-a6bf-75ed29d3c438 None admin] SCRIPT_NAME: `/identity` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:12:52.655665 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1958335c-f51c-4714-a6bf-75ed29d3c438 None admin] PATH_INFO: `/v3/services` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:12:52.656640 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1958335c-f51c-4714-a6bf-75ed29d3c438 None admin] RBAC: Adding query filter params (type=image) {{(pid=144068) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:12:52.656996 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1958335c-f51c-4714-a6bf-75ed29d3c438 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:12:52.658634 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1958335c-f51c-4714-a6bf-75ed29d3c438 None admin] RBAC: Authorization granted {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:12:52.669124 dv-cinder-851351-1-smb devstack@keystone.service[144068]: [pid: 144068|app: 0|req: 542/1069] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 08:12:52 2022] GET /identity/v3/services?type=image => generated 350 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 08:12:52.670256 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1958335c-f51c-4714-a6bf-75ed29d3c438 None admin] Authenticating user token {{(pid=144068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:12:52.682206 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfeb617e-6ac4-4d8b-8d90-7f6947f5f0cb None admin] Validating token access rules against request {{(pid=144067) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:12:52.720318 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2996803-d8ef-4c3f-9df9-6ebee714562a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144067) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:12:52.721028 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2996803-d8ef-4c3f-9df9-6ebee714562a None admin] REQUEST_METHOD: `GET` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:12:52.721312 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2996803-d8ef-4c3f-9df9-6ebee714562a None admin] SCRIPT_NAME: `/identity` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:12:52.721589 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2996803-d8ef-4c3f-9df9-6ebee714562a None admin] PATH_INFO: `/v3/projects/bdc83bde204a42df9eea2d927be64bd3` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:12:52.722828 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2996803-d8ef-4c3f-9df9-6ebee714562a None admin] RBAC: Authorizing `identity:get_project(project_id=bdc83bde204a42df9eea2d927be64bd3)` {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:12:52.724295 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2996803-d8ef-4c3f-9df9-6ebee714562a None admin] RBAC: Authorization granted {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:12:52.731006 dv-cinder-851351-1-smb devstack@keystone.service[144067]: [pid: 144067|app: 0|req: 528/1070] 10.222.0.42 () {56 vars in 1186 bytes} [Thu Jul 28 08:12:52 2022] GET /identity/v3/projects/bdc83bde204a42df9eea2d927be64bd3 => generated 311 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:12:52.732103 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2996803-d8ef-4c3f-9df9-6ebee714562a None admin] Authenticating user token {{(pid=144067) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:12:52.777820 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG dbcounter [-] [144067] Writing DB stats keystone:SELECT=100 {{(pid=144067) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:12:52.788159 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1958335c-f51c-4714-a6bf-75ed29d3c438 None admin] Validating token access rules against request {{(pid=144068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:12:52.822480 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc36f7d-0807-4a91-9923-45be6986d66d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:12:52.823400 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc36f7d-0807-4a91-9923-45be6986d66d None admin] REQUEST_METHOD: `POST` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:12:52.823847 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc36f7d-0807-4a91-9923-45be6986d66d None admin] SCRIPT_NAME: `/identity` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:12:52.824121 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc36f7d-0807-4a91-9923-45be6986d66d None admin] PATH_INFO: `/v3/endpoints` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:12:52.824866 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcc36f7d-0807-4a91-9923-45be6986d66d None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:12:52.826313 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcc36f7d-0807-4a91-9923-45be6986d66d None admin] RBAC: Authorization granted {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:12:52.831778 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG dbcounter [-] [144068] Writing DB stats keystone:SELECT=100 {{(pid=144068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:12:52.846826 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2996803-d8ef-4c3f-9df9-6ebee714562a None admin] Validating token access rules against request {{(pid=144067) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:12:52.848636 dv-cinder-851351-1-smb devstack@keystone.service[144068]: [pid: 144068|app: 0|req: 543/1071] 10.222.0.42 () {60 vars in 1144 bytes} [Thu Jul 28 08:12:52 2022] POST /identity/v3/endpoints => generated 327 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 08:12:52.903564 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f774290-4f32-4c8f-a6cf-1c2e80ee2373 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144067) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:12:52.904223 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f774290-4f32-4c8f-a6cf-1c2e80ee2373 None admin] REQUEST_METHOD: `GET` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:12:52.904501 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f774290-4f32-4c8f-a6cf-1c2e80ee2373 None admin] SCRIPT_NAME: `/identity` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:12:52.904816 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f774290-4f32-4c8f-a6cf-1c2e80ee2373 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:12:52.905664 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f774290-4f32-4c8f-a6cf-1c2e80ee2373 None admin] RBAC: Adding query filter params (role.id=d1020e7bb0b7411d895ddedd6dc02c5b, scope.project.id=bdc83bde204a42df9eea2d927be64bd3, user.id=9a14ff9188ae4c87951d765322c9e9a4) {{(pid=144067) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:12:52.905978 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f774290-4f32-4c8f-a6cf-1c2e80ee2373 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:12:52.907515 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f774290-4f32-4c8f-a6cf-1c2e80ee2373 None admin] RBAC: Authorization granted {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:12:52.914448 dv-cinder-851351-1-smb devstack@keystone.service[144067]: [pid: 144067|app: 0|req: 529/1072] 10.222.0.42 () {56 vars in 1374 bytes} [Thu Jul 28 08:12:52 2022] GET /identity/v3/role_assignments?user.id=9a14ff9188ae4c87951d765322c9e9a4&scope.project.id=bdc83bde204a42df9eea2d927be64bd3&role.id=d1020e7bb0b7411d895ddedd6dc02c5b => generated 259 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:12:53.692615 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157b28d5-91df-47c0-9a47-e2c8f2aed4b5 None None] REQUEST_METHOD: `GET` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:12:53.693222 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157b28d5-91df-47c0-9a47-e2c8f2aed4b5 None None] SCRIPT_NAME: `/identity` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:12:53.693222 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157b28d5-91df-47c0-9a47-e2c8f2aed4b5 None None] PATH_INFO: `/` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:12:53.694789 dv-cinder-851351-1-smb devstack@keystone.service[144068]: [pid: 144068|app: 0|req: 544/1073] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 08:12:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 08:12:53.702030 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ee9b09-8669-4a06-ac6c-a2a6fc273b39 None None] REQUEST_METHOD: `POST` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:12:53.702684 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ee9b09-8669-4a06-ac6c-a2a6fc273b39 None None] SCRIPT_NAME: `/identity` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:12:53.702935 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ee9b09-8669-4a06-ac6c-a2a6fc273b39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:12:53.726684 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.auth.core [None req-89ee9b09-8669-4a06-ac6c-a2a6fc273b39 None None] MFA Rules not processed for user `bf5ceb8f07374635ad506b7d1b4f1612`. Rule list: `[]` (Enabled: `True`). {{(pid=144067) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 08:12:53.727907 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.fernet_utils [None req-89ee9b09-8669-4a06-ac6c-a2a6fc273b39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=144067) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:12:53.803638 dv-cinder-851351-1-smb devstack@keystone.service[144067]: [pid: 144067|app: 0|req: 530/1074] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 08:12:53 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 08:12:53.827199 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157b28d5-91df-47c0-9a47-e2c8f2aed4b5 None None] Authenticating user token {{(pid=144068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:12:53.944951 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157b28d5-91df-47c0-9a47-e2c8f2aed4b5 None None] Validating token access rules against request {{(pid=144068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:12:53.984200 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e44acd9-d58a-4da9-9a69-8835f4aadee1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:12:53.984200 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e44acd9-d58a-4da9-9a69-8835f4aadee1 None admin] REQUEST_METHOD: `GET` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:12:53.984200 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e44acd9-d58a-4da9-9a69-8835f4aadee1 None admin] SCRIPT_NAME: `/identity` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:12:53.984200 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e44acd9-d58a-4da9-9a69-8835f4aadee1 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:12:53.997837 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e44acd9-d58a-4da9-9a69-8835f4aadee1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 08:12:54.002974 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application [None req-3e44acd9-d58a-4da9-9a69-8835f4aadee1 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 28 08:12:54.002974 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:12:54.002974 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:12:54.002974 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:12:54.002974 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:12:54.002974 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:12:54.002974 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:12:54.002974 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:12:54.002974 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:12:54.002974 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:12:54.002974 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:12:54.002974 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:12:54.002974 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 08:12:54.002974 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 08:12:54.002974 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 08:12:54.002974 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 08:12:54.003929 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 08:12:54.003929 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 08:12:54.003929 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 08:12:54.003929 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 08:12:54.003929 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:12:54.003929 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:12:54.003929 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:12:54.003929 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:12:54.003929 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:12:54.003929 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:12:54.003929 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:12:54.003929 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application with Lock( Jul 28 08:12:54.003929 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:12:54.003929 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:12:54.003929 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:12:54.003929 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:12:54.004764 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:12:54.004764 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:12:54.004764 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:12:54.004764 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:12:54.004764 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 08:12:54.004764 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 08:12:54.004764 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 08:12:54.004764 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 08:12:54.004764 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 08:12:54.004764 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 08:12:54.004764 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 28 08:12:54.004764 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application Jul 28 08:12:54.004764 dv-cinder-851351-1-smb devstack@keystone.service[144068]: [pid: 144068|app: 0|req: 545/1075] 10.222.0.42 () {56 vars in 1120 bytes} [Thu Jul 28 08:12:53 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:12:54.010394 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ee9b09-8669-4a06-ac6c-a2a6fc273b39 None None] Authenticating user token {{(pid=144067) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:12:54.040470 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG dbcounter [-] [144067] Writing DB stats keystone:SELECT=100 {{(pid=144067) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:12:54.116148 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ee9b09-8669-4a06-ac6c-a2a6fc273b39 None None] Validating token access rules against request {{(pid=144067) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:12:54.150641 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdfe8842-6265-4c2e-bd99-20b5526d40fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144067) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:12:54.151281 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdfe8842-6265-4c2e-bd99-20b5526d40fc None admin] REQUEST_METHOD: `GET` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:12:54.151566 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdfe8842-6265-4c2e-bd99-20b5526d40fc None admin] SCRIPT_NAME: `/identity` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:12:54.151845 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdfe8842-6265-4c2e-bd99-20b5526d40fc None admin] PATH_INFO: `/v3/roles` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:12:54.152575 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdfe8842-6265-4c2e-bd99-20b5526d40fc None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=144067) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:12:54.152917 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdfe8842-6265-4c2e-bd99-20b5526d40fc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:12:54.154364 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdfe8842-6265-4c2e-bd99-20b5526d40fc None admin] RBAC: Authorization granted {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:12:54.162911 dv-cinder-851351-1-smb devstack@keystone.service[144067]: [pid: 144067|app: 0|req: 531/1076] 10.222.0.42 () {56 vars in 1115 bytes} [Thu Jul 28 08:12:54 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 08:12:54.168739 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e44acd9-d58a-4da9-9a69-8835f4aadee1 None admin] Authenticating user token {{(pid=144068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:12:54.225172 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG dbcounter [-] [144068] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=144068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:12:54.274420 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e44acd9-d58a-4da9-9a69-8835f4aadee1 None admin] Validating token access rules against request {{(pid=144068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:12:54.307724 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ef861b-905c-442d-810d-498104c68b82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:12:54.308377 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ef861b-905c-442d-810d-498104c68b82 None admin] REQUEST_METHOD: `GET` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:12:54.308653 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ef861b-905c-442d-810d-498104c68b82 None admin] SCRIPT_NAME: `/identity` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:12:54.308946 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ef861b-905c-442d-810d-498104c68b82 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:12:54.319867 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ef861b-905c-442d-810d-498104c68b82 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:12:54.321396 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ef861b-905c-442d-810d-498104c68b82 None admin] RBAC: Authorization granted {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:12:54.335995 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application [None req-03ef861b-905c-442d-810d-498104c68b82 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 08:12:54.335995 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:12:54.335995 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:12:54.335995 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:12:54.335995 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:12:54.335995 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:12:54.335995 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:12:54.335995 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:12:54.335995 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:12:54.335995 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:12:54.335995 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:12:54.335995 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:12:54.335995 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 08:12:54.335995 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 08:12:54.335995 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 08:12:54.337426 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 08:12:54.337426 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:12:54.337426 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:12:54.337426 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:12:54.337426 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:12:54.337426 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:12:54.337426 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:12:54.337426 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:12:54.337426 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application with Lock( Jul 28 08:12:54.337426 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:12:54.337426 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:12:54.337426 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:12:54.337426 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:12:54.337426 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:12:54.337426 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:12:54.337426 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:12:54.337426 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:12:54.338277 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 08:12:54.338277 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 08:12:54.338277 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 08:12:54.338277 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application Jul 28 08:12:54.342467 dv-cinder-851351-1-smb devstack@keystone.service[144068]: [pid: 144068|app: 0|req: 546/1077] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 08:12:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:12:54.343942 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdfe8842-6265-4c2e-bd99-20b5526d40fc None admin] Authenticating user token {{(pid=144067) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:12:54.438804 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG dbcounter [-] [144067] Writing DB stats keystone:SELECT=100 {{(pid=144067) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:12:54.450604 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdfe8842-6265-4c2e-bd99-20b5526d40fc None admin] Validating token access rules against request {{(pid=144067) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:12:54.487384 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66279ba-67c5-41ce-a968-be127dbcdb55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144067) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:12:54.488003 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66279ba-67c5-41ce-a968-be127dbcdb55 None admin] REQUEST_METHOD: `GET` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:12:54.488285 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66279ba-67c5-41ce-a968-be127dbcdb55 None admin] SCRIPT_NAME: `/identity` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:12:54.488563 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66279ba-67c5-41ce-a968-be127dbcdb55 None admin] PATH_INFO: `/v3/domains` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:12:54.489300 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c66279ba-67c5-41ce-a968-be127dbcdb55 None admin] RBAC: Adding query filter params (name=Default) {{(pid=144067) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:12:54.489610 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c66279ba-67c5-41ce-a968-be127dbcdb55 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:12:54.490985 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c66279ba-67c5-41ce-a968-be127dbcdb55 None admin] RBAC: Authorization granted {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:12:54.503923 dv-cinder-851351-1-smb devstack@keystone.service[144067]: [pid: 144067|app: 0|req: 532/1078] 10.222.0.42 () {56 vars in 1109 bytes} [Thu Jul 28 08:12:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 08:12:54.509741 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ef861b-905c-442d-810d-498104c68b82 None admin] Authenticating user token {{(pid=144068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:12:54.615966 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ef861b-905c-442d-810d-498104c68b82 None admin] Validating token access rules against request {{(pid=144068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:12:54.618502 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG dbcounter [-] [144068] Writing DB stats keystone:SELECT=100 {{(pid=144068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:12:54.654922 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e763d09-93d0-427b-9b3c-a0c14ae4288f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:12:54.655562 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e763d09-93d0-427b-9b3c-a0c14ae4288f None admin] REQUEST_METHOD: `GET` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:12:54.655912 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e763d09-93d0-427b-9b3c-a0c14ae4288f None admin] SCRIPT_NAME: `/identity` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:12:54.656219 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e763d09-93d0-427b-9b3c-a0c14ae4288f None admin] PATH_INFO: `/v3/users/nova` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:12:54.664715 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e763d09-93d0-427b-9b3c-a0c14ae4288f None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:12:54.666261 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e763d09-93d0-427b-9b3c-a0c14ae4288f None admin] RBAC: Authorization granted {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:12:54.678000 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application [None req-6e763d09-93d0-427b-9b3c-a0c14ae4288f None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 28 08:12:54.678000 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:12:54.678000 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:12:54.678000 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:12:54.678000 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:12:54.678000 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:12:54.678000 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:12:54.678000 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:12:54.678000 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:12:54.678000 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:12:54.678000 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:12:54.678000 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:12:54.678000 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 28 08:12:54.678000 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 28 08:12:54.678000 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 28 08:12:54.678000 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 28 08:12:54.679100 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:12:54.679100 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:12:54.679100 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 28 08:12:54.679100 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 08:12:54.679100 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 28 08:12:54.679100 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 08:12:54.679100 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:12:54.679100 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:12:54.679100 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:12:54.679100 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:12:54.679100 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:12:54.679100 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application with Lock( Jul 28 08:12:54.679100 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:12:54.679100 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:12:54.679100 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:12:54.679100 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:12:54.679100 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:12:54.679100 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:12:54.680215 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:12:54.680215 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:12:54.680215 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 28 08:12:54.680215 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 28 08:12:54.680215 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 28 08:12:54.680215 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 28 08:12:54.680215 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 28 08:12:54.680215 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 28 08:12:54.680215 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 28 08:12:54.680215 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application Jul 28 08:12:54.685679 dv-cinder-851351-1-smb devstack@keystone.service[144068]: [pid: 144068|app: 0|req: 547/1079] 10.222.0.42 () {56 vars in 1093 bytes} [Thu Jul 28 08:12:54 2022] GET /identity/v3/users/nova => generated 82 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:12:54.687194 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66279ba-67c5-41ce-a968-be127dbcdb55 None admin] Authenticating user token {{(pid=144067) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:12:54.793099 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66279ba-67c5-41ce-a968-be127dbcdb55 None admin] Validating token access rules against request {{(pid=144067) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:12:54.828399 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc04483-4c71-4de0-a0f0-b987a1c13c17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144067) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:12:54.829061 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc04483-4c71-4de0-a0f0-b987a1c13c17 None admin] REQUEST_METHOD: `GET` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:12:54.829342 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc04483-4c71-4de0-a0f0-b987a1c13c17 None admin] SCRIPT_NAME: `/identity` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:12:54.829619 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc04483-4c71-4de0-a0f0-b987a1c13c17 None admin] PATH_INFO: `/v3/users` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:12:54.830431 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dc04483-4c71-4de0-a0f0-b987a1c13c17 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=144067) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:12:54.830737 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dc04483-4c71-4de0-a0f0-b987a1c13c17 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:12:54.832253 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dc04483-4c71-4de0-a0f0-b987a1c13c17 None admin] RBAC: Authorization granted {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:12:54.851933 dv-cinder-851351-1-smb devstack@keystone.service[144067]: [pid: 144067|app: 0|req: 533/1080] 10.222.0.42 () {56 vars in 1133 bytes} [Thu Jul 28 08:12:54 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:12:54.856849 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e763d09-93d0-427b-9b3c-a0c14ae4288f None admin] Authenticating user token {{(pid=144068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:12:54.926904 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c844cde3-4bc6-4b5f-bd96-d0201835e38e None None] REQUEST_METHOD: `GET` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:12:54.927280 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c844cde3-4bc6-4b5f-bd96-d0201835e38e None None] SCRIPT_NAME: `/identity` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:12:54.927456 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c844cde3-4bc6-4b5f-bd96-d0201835e38e None None] PATH_INFO: `/` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:12:54.929015 dv-cinder-851351-1-smb devstack@keystone.service[144067]: [pid: 144067|app: 0|req: 534/1081] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 08:12:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 28 08:12:54.933954 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f67b09-fc04-4e91-8b21-8c879d2909da None None] REQUEST_METHOD: `POST` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:12:54.934240 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f67b09-fc04-4e91-8b21-8c879d2909da None None] SCRIPT_NAME: `/identity` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:12:54.934526 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f67b09-fc04-4e91-8b21-8c879d2909da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:12:54.952587 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.auth.core [None req-36f67b09-fc04-4e91-8b21-8c879d2909da None None] MFA Rules not processed for user `bf5ceb8f07374635ad506b7d1b4f1612`. Rule list: `[]` (Enabled: `True`). {{(pid=144067) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 08:12:54.953831 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.fernet_utils [None req-36f67b09-fc04-4e91-8b21-8c879d2909da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=144067) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:12:54.955857 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG dbcounter [-] [144067] Writing DB stats keystone:SELECT=100 {{(pid=144067) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:12:54.963641 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e763d09-93d0-427b-9b3c-a0c14ae4288f None admin] Validating token access rules against request {{(pid=144068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:12:54.997922 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf6e941-6a17-4c89-8bc2-7d02ff7d04f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:12:54.998558 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf6e941-6a17-4c89-8bc2-7d02ff7d04f6 None admin] REQUEST_METHOD: `GET` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:12:54.998841 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf6e941-6a17-4c89-8bc2-7d02ff7d04f6 None admin] SCRIPT_NAME: `/identity` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:12:54.999117 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf6e941-6a17-4c89-8bc2-7d02ff7d04f6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:12:55.023692 dv-cinder-851351-1-smb devstack@keystone.service[144067]: [pid: 144067|app: 0|req: 535/1082] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 08:12:54 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 28 08:12:55.028205 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4ec4ed-3d7b-422b-a5d3-e8c7a8d41868 None None] REQUEST_METHOD: `GET` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:12:55.028505 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4ec4ed-3d7b-422b-a5d3-e8c7a8d41868 None None] SCRIPT_NAME: `/identity` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:12:55.028823 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4ec4ed-3d7b-422b-a5d3-e8c7a8d41868 None None] PATH_INFO: `/` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:12:55.030133 dv-cinder-851351-1-smb devstack@keystone.service[144067]: [pid: 144067|app: 0|req: 536/1083] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 08:12:55 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 08:12:55.031172 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG dbcounter [-] [144068] Writing DB stats keystone:SELECT=100 {{(pid=144068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:12:55.035950 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8288888-e737-4382-8b6e-914683877fcf None None] REQUEST_METHOD: `POST` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:12:55.036242 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8288888-e737-4382-8b6e-914683877fcf None None] SCRIPT_NAME: `/identity` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:12:55.036527 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8288888-e737-4382-8b6e-914683877fcf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:12:55.055045 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.auth.core [None req-d8288888-e737-4382-8b6e-914683877fcf None None] MFA Rules not processed for user `bf5ceb8f07374635ad506b7d1b4f1612`. Rule list: `[]` (Enabled: `True`). {{(pid=144067) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 08:12:55.056204 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.fernet_utils [None req-d8288888-e737-4382-8b6e-914683877fcf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=144067) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:12:55.073297 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cf6e941-6a17-4c89-8bc2-7d02ff7d04f6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:12:55.074758 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cf6e941-6a17-4c89-8bc2-7d02ff7d04f6 None admin] RBAC: Authorization granted {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:12:55.125524 dv-cinder-851351-1-smb devstack@keystone.service[144067]: [pid: 144067|app: 0|req: 537/1084] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 08:12:55 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 08:12:55.126463 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8288888-e737-4382-8b6e-914683877fcf None None] Authenticating user token {{(pid=144067) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:12:55.181662 dv-cinder-851351-1-smb devstack@keystone.service[144068]: [pid: 144068|app: 0|req: 548/1085] 10.222.0.42 () {58 vars in 1282 bytes} [Thu Jul 28 08:12:54 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 28 08:12:55.182643 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf6e941-6a17-4c89-8bc2-7d02ff7d04f6 None admin] Authenticating user token {{(pid=144068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:12:55.200414 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG dbcounter [-] [144067] Writing DB stats keystone:SELECT=100 {{(pid=144067) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:12:55.236122 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8288888-e737-4382-8b6e-914683877fcf None None] Validating token access rules against request {{(pid=144067) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:12:55.245666 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG dbcounter [-] [144068] Writing DB stats keystone:SELECT=100 {{(pid=144068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:12:55.274040 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51e1ab7-f701-41d0-a0df-b95e5e72f948 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144067) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:12:55.274702 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51e1ab7-f701-41d0-a0df-b95e5e72f948 None admin] REQUEST_METHOD: `GET` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:12:55.275156 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51e1ab7-f701-41d0-a0df-b95e5e72f948 None admin] SCRIPT_NAME: `/identity` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:12:55.275629 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51e1ab7-f701-41d0-a0df-b95e5e72f948 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:12:55.288182 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf6e941-6a17-4c89-8bc2-7d02ff7d04f6 None admin] Validating token access rules against request {{(pid=144068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:12:55.288915 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a51e1ab7-f701-41d0-a0df-b95e5e72f948 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 08:12:55.293950 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application [None req-a51e1ab7-f701-41d0-a0df-b95e5e72f948 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 08:12:55.293950 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:12:55.293950 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:12:55.293950 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:12:55.293950 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:12:55.293950 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:12:55.293950 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:12:55.293950 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:12:55.293950 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:12:55.293950 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:12:55.293950 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:12:55.293950 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:12:55.293950 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 08:12:55.293950 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 08:12:55.293950 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 08:12:55.293950 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 08:12:55.295012 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 08:12:55.295012 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 08:12:55.295012 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 08:12:55.295012 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 08:12:55.295012 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:12:55.295012 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:12:55.295012 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:12:55.295012 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:12:55.295012 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:12:55.295012 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:12:55.295012 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:12:55.295012 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application with Lock( Jul 28 08:12:55.295012 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:12:55.295012 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:12:55.295012 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:12:55.295012 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:12:55.295827 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:12:55.295827 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:12:55.295827 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:12:55.295827 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:12:55.295827 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 08:12:55.295827 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 08:12:55.295827 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 08:12:55.295827 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 08:12:55.295827 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 08:12:55.295827 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 08:12:55.295827 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 08:12:55.295827 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application Jul 28 08:12:55.295827 dv-cinder-851351-1-smb devstack@keystone.service[144067]: [pid: 144067|app: 0|req: 538/1086] 10.222.0.42 () {56 vars in 1096 bytes} [Thu Jul 28 08:12:55 2022] GET /identity/v3/roles/admin => generated 83 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:12:55.296486 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51e1ab7-f701-41d0-a0df-b95e5e72f948 None admin] Authenticating user token {{(pid=144067) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:12:55.328553 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8148650b-8351-453a-861d-6fe77878d018 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:12:55.329228 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8148650b-8351-453a-861d-6fe77878d018 None admin] REQUEST_METHOD: `GET` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:12:55.329515 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8148650b-8351-453a-861d-6fe77878d018 None admin] SCRIPT_NAME: `/identity` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:12:55.329782 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8148650b-8351-453a-861d-6fe77878d018 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:12:55.398928 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8148650b-8351-453a-861d-6fe77878d018 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:12:55.400403 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8148650b-8351-453a-861d-6fe77878d018 None admin] RBAC: Authorization granted {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:12:55.401458 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51e1ab7-f701-41d0-a0df-b95e5e72f948 None admin] Validating token access rules against request {{(pid=144067) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:12:55.431143 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG dbcounter [-] [144067] Writing DB stats keystone:SELECT=100 {{(pid=144067) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:12:55.439634 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e69cb63-c8cf-4b36-ae0d-b0127cfdc6d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144067) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:12:55.440288 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e69cb63-c8cf-4b36-ae0d-b0127cfdc6d6 None admin] REQUEST_METHOD: `GET` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:12:55.440581 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e69cb63-c8cf-4b36-ae0d-b0127cfdc6d6 None admin] SCRIPT_NAME: `/identity` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:12:55.440942 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e69cb63-c8cf-4b36-ae0d-b0127cfdc6d6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:12:55.452273 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e69cb63-c8cf-4b36-ae0d-b0127cfdc6d6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:12:55.453839 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e69cb63-c8cf-4b36-ae0d-b0127cfdc6d6 None admin] RBAC: Authorization granted {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:12:55.464994 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG dbcounter [-] [144068] Writing DB stats keystone:SELECT=100 {{(pid=144068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:12:55.470410 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application [None req-6e69cb63-c8cf-4b36-ae0d-b0127cfdc6d6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 08:12:55.470410 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:12:55.470410 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:12:55.470410 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:12:55.470410 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:12:55.470410 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:12:55.470410 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:12:55.470410 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:12:55.470410 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:12:55.470410 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:12:55.470410 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:12:55.470410 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:12:55.470410 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 08:12:55.470410 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 08:12:55.470410 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 08:12:55.471533 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 08:12:55.471533 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:12:55.471533 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:12:55.471533 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:12:55.471533 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:12:55.471533 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:12:55.471533 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:12:55.471533 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:12:55.471533 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application with Lock( Jul 28 08:12:55.471533 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:12:55.471533 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:12:55.471533 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:12:55.471533 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:12:55.471533 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:12:55.471533 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:12:55.471533 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:12:55.471533 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:12:55.472636 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 08:12:55.472636 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 08:12:55.472636 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 08:12:55.472636 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application Jul 28 08:12:55.472636 dv-cinder-851351-1-smb devstack@keystone.service[144067]: [pid: 144067|app: 0|req: 539/1087] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 08:12:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:12:55.473008 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e69cb63-c8cf-4b36-ae0d-b0127cfdc6d6 None admin] Authenticating user token {{(pid=144067) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:12:55.511711 dv-cinder-851351-1-smb devstack@keystone.service[144068]: [pid: 144068|app: 0|req: 549/1088] 10.222.0.42 () {58 vars in 1282 bytes} [Thu Jul 28 08:12:55 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 28 08:12:55.512996 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8148650b-8351-453a-861d-6fe77878d018 None admin] Authenticating user token {{(pid=144068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:12:55.594032 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e69cb63-c8cf-4b36-ae0d-b0127cfdc6d6 None admin] Validating token access rules against request {{(pid=144067) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:12:55.620167 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8148650b-8351-453a-861d-6fe77878d018 None admin] Validating token access rules against request {{(pid=144068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:12:55.633229 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df120344-fae2-4867-a06f-e00b93fc82b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144067) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:12:55.633868 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df120344-fae2-4867-a06f-e00b93fc82b9 None admin] REQUEST_METHOD: `GET` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:12:55.634154 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df120344-fae2-4867-a06f-e00b93fc82b9 None admin] SCRIPT_NAME: `/identity` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:12:55.634436 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df120344-fae2-4867-a06f-e00b93fc82b9 None admin] PATH_INFO: `/v3/roles` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:12:55.635180 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df120344-fae2-4867-a06f-e00b93fc82b9 None admin] RBAC: Adding query filter params (name=admin) {{(pid=144067) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:12:55.635492 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df120344-fae2-4867-a06f-e00b93fc82b9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:12:55.636933 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df120344-fae2-4867-a06f-e00b93fc82b9 None admin] RBAC: Authorization granted {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:12:55.646386 dv-cinder-851351-1-smb devstack@keystone.service[144067]: [pid: 144067|app: 0|req: 540/1089] 10.222.0.42 () {56 vars in 1099 bytes} [Thu Jul 28 08:12:55 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:12:55.647036 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df120344-fae2-4867-a06f-e00b93fc82b9 None admin] Authenticating user token {{(pid=144067) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:12:55.664982 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d5c913-1696-4d83-a335-bb40f5ef933a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:12:55.665647 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d5c913-1696-4d83-a335-bb40f5ef933a None admin] REQUEST_METHOD: `GET` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:12:55.665930 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d5c913-1696-4d83-a335-bb40f5ef933a None admin] SCRIPT_NAME: `/identity` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:12:55.666211 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d5c913-1696-4d83-a335-bb40f5ef933a None admin] PATH_INFO: `/v3/domains` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:12:55.666916 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95d5c913-1696-4d83-a335-bb40f5ef933a None admin] RBAC: Adding query filter params (name=Default) {{(pid=144068) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:12:55.667232 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95d5c913-1696-4d83-a335-bb40f5ef933a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:12:55.668598 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95d5c913-1696-4d83-a335-bb40f5ef933a None admin] RBAC: Authorization granted {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:12:55.680608 dv-cinder-851351-1-smb devstack@keystone.service[144068]: [pid: 144068|app: 0|req: 550/1090] 10.222.0.42 () {56 vars in 1109 bytes} [Thu Jul 28 08:12:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:12:55.681532 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d5c913-1696-4d83-a335-bb40f5ef933a None admin] Authenticating user token {{(pid=144068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:12:55.701087 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG dbcounter [-] [144067] Writing DB stats keystone:SELECT=100 {{(pid=144067) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:12:55.709693 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG dbcounter [-] [144068] Writing DB stats keystone:SELECT=100 {{(pid=144068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:12:55.760962 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df120344-fae2-4867-a06f-e00b93fc82b9 None admin] Validating token access rules against request {{(pid=144067) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:12:55.794799 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d5c913-1696-4d83-a335-bb40f5ef933a None admin] Validating token access rules against request {{(pid=144068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:12:55.801628 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f2fda0-e834-4a45-8fbd-9246981f7408 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144067) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:12:55.802313 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f2fda0-e834-4a45-8fbd-9246981f7408 None admin] REQUEST_METHOD: `GET` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:12:55.802598 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f2fda0-e834-4a45-8fbd-9246981f7408 None admin] SCRIPT_NAME: `/identity` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:12:55.802883 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f2fda0-e834-4a45-8fbd-9246981f7408 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:12:55.814740 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f2fda0-e834-4a45-8fbd-9246981f7408 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:12:55.816349 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f2fda0-e834-4a45-8fbd-9246981f7408 None admin] RBAC: Authorization granted {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:12:55.829882 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce0f8c6c-8c58-42b3-aec3-909190bb041e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:12:55.830542 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0f8c6c-8c58-42b3-aec3-909190bb041e None admin] REQUEST_METHOD: `GET` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:12:55.830830 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0f8c6c-8c58-42b3-aec3-909190bb041e None admin] SCRIPT_NAME: `/identity` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:12:55.831117 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0f8c6c-8c58-42b3-aec3-909190bb041e None admin] PATH_INFO: `/v3/users/9a14ff9188ae4c87951d765322c9e9a4` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:12:55.832000 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application [None req-83f2fda0-e834-4a45-8fbd-9246981f7408 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 08:12:55.832000 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:12:55.832000 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:12:55.832000 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:12:55.832000 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:12:55.832000 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:12:55.832000 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:12:55.832000 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:12:55.832000 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:12:55.832000 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:12:55.832000 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:12:55.832000 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:12:55.832000 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 08:12:55.832000 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 08:12:55.832000 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 08:12:55.832880 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 08:12:55.832880 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:12:55.832880 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:12:55.832880 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:12:55.832880 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:12:55.832880 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:12:55.832880 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:12:55.832880 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:12:55.832880 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application with Lock( Jul 28 08:12:55.832880 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:12:55.832880 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:12:55.832880 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:12:55.832880 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:12:55.832880 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:12:55.832880 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:12:55.832880 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:12:55.832880 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:12:55.833709 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 08:12:55.833709 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 08:12:55.833709 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 08:12:55.833709 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application Jul 28 08:12:55.833929 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce0f8c6c-8c58-42b3-aec3-909190bb041e None admin] RBAC: Authorizing `identity:get_user(user_id=9a14ff9188ae4c87951d765322c9e9a4)` {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:12:55.834003 dv-cinder-851351-1-smb devstack@keystone.service[144067]: [pid: 144067|app: 0|req: 541/1091] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 08:12:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:12:55.834075 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce0f8c6c-8c58-42b3-aec3-909190bb041e None admin] RBAC: Authorization granted {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:12:55.834141 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f2fda0-e834-4a45-8fbd-9246981f7408 None admin] Authenticating user token {{(pid=144067) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:12:55.835755 dv-cinder-851351-1-smb devstack@keystone.service[144068]: [pid: 144068|app: 0|req: 551/1092] 10.222.0.42 () {56 vars in 1177 bytes} [Thu Jul 28 08:12:55 2022] GET /identity/v3/users/9a14ff9188ae4c87951d765322c9e9a4 => generated 285 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:12:55.841063 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce0f8c6c-8c58-42b3-aec3-909190bb041e None admin] Authenticating user token {{(pid=144068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:12:55.940653 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG dbcounter [-] [144068] Writing DB stats keystone:SELECT=100 {{(pid=144068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:12:55.943817 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG dbcounter [-] [144067] Writing DB stats keystone:SELECT=100 {{(pid=144067) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:12:55.950841 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce0f8c6c-8c58-42b3-aec3-909190bb041e None admin] Validating token access rules against request {{(pid=144068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:12:55.953155 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f2fda0-e834-4a45-8fbd-9246981f7408 None admin] Validating token access rules against request {{(pid=144067) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:12:55.990032 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9069d7-9c89-4949-bf9d-1b51074b86d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:12:55.990675 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9069d7-9c89-4949-bf9d-1b51074b86d7 None admin] REQUEST_METHOD: `GET` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:12:55.990959 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9069d7-9c89-4949-bf9d-1b51074b86d7 None admin] SCRIPT_NAME: `/identity` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:12:55.991280 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9069d7-9c89-4949-bf9d-1b51074b86d7 None admin] PATH_INFO: `/v3/domains` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:12:55.991976 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df9069d7-9c89-4949-bf9d-1b51074b86d7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=144068) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:12:55.992289 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df9069d7-9c89-4949-bf9d-1b51074b86d7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:12:55.993694 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df9069d7-9c89-4949-bf9d-1b51074b86d7 None admin] RBAC: Authorization granted {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:12:55.994134 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d827d1a8-8e87-41fe-b070-3afca3a57de3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144067) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:12:55.994818 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d827d1a8-8e87-41fe-b070-3afca3a57de3 None admin] REQUEST_METHOD: `GET` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:12:55.995076 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d827d1a8-8e87-41fe-b070-3afca3a57de3 None admin] SCRIPT_NAME: `/identity` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:12:55.995561 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d827d1a8-8e87-41fe-b070-3afca3a57de3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:12:56.003284 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d827d1a8-8e87-41fe-b070-3afca3a57de3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:12:56.004804 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d827d1a8-8e87-41fe-b070-3afca3a57de3 None admin] RBAC: Authorization granted {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:12:56.007790 dv-cinder-851351-1-smb devstack@keystone.service[144068]: [pid: 144068|app: 0|req: 552/1093] 10.222.0.42 () {56 vars in 1109 bytes} [Thu Jul 28 08:12:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:12:56.008904 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9069d7-9c89-4949-bf9d-1b51074b86d7 None admin] Authenticating user token {{(pid=144068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:12:56.017885 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application [None req-d827d1a8-8e87-41fe-b070-3afca3a57de3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 08:12:56.017885 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:12:56.017885 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:12:56.017885 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:12:56.017885 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:12:56.017885 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:12:56.017885 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:12:56.017885 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:12:56.017885 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:12:56.017885 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:12:56.017885 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:12:56.017885 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:12:56.017885 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 28 08:12:56.017885 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 28 08:12:56.017885 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 28 08:12:56.019580 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 28 08:12:56.019580 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:12:56.019580 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:12:56.019580 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:12:56.019580 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:12:56.019580 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:12:56.019580 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:12:56.019580 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:12:56.019580 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application with Lock( Jul 28 08:12:56.019580 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:12:56.019580 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:12:56.019580 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:12:56.019580 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:12:56.019580 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:12:56.019580 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:12:56.019580 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:12:56.019580 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:12:56.020449 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 28 08:12:56.020449 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 28 08:12:56.020449 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 28 08:12:56.020449 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 28 08:12:56.020449 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 28 08:12:56.020449 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 28 08:12:56.020449 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 08:12:56.020449 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application Jul 28 08:12:56.020449 dv-cinder-851351-1-smb devstack@keystone.service[144067]: [pid: 144067|app: 0|req: 542/1094] 10.222.0.42 () {56 vars in 1111 bytes} [Thu Jul 28 08:12:55 2022] GET /identity/v3/projects/service => generated 88 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:12:56.026538 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d827d1a8-8e87-41fe-b070-3afca3a57de3 None admin] Authenticating user token {{(pid=144067) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:12:56.150190 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9069d7-9c89-4949-bf9d-1b51074b86d7 None admin] Validating token access rules against request {{(pid=144068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:12:56.169496 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d827d1a8-8e87-41fe-b070-3afca3a57de3 None admin] Validating token access rules against request {{(pid=144067) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:12:56.203143 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a1d2c0-160e-423a-b321-b7d34b1232ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:12:56.204154 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a1d2c0-160e-423a-b321-b7d34b1232ad None admin] REQUEST_METHOD: `GET` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:12:56.204594 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a1d2c0-160e-423a-b321-b7d34b1232ad None admin] SCRIPT_NAME: `/identity` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:12:56.205029 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a1d2c0-160e-423a-b321-b7d34b1232ad None admin] PATH_INFO: `/v3/projects/bdc83bde204a42df9eea2d927be64bd3` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:12:56.206197 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53a1d2c0-160e-423a-b321-b7d34b1232ad None admin] RBAC: Authorizing `identity:get_project(project_id=bdc83bde204a42df9eea2d927be64bd3)` {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:12:56.207691 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53a1d2c0-160e-423a-b321-b7d34b1232ad None admin] RBAC: Authorization granted {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:12:56.208629 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ba897f-e033-48be-8ce2-621071aa07e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144067) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:12:56.209312 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ba897f-e033-48be-8ce2-621071aa07e8 None admin] REQUEST_METHOD: `GET` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:12:56.209600 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ba897f-e033-48be-8ce2-621071aa07e8 None admin] SCRIPT_NAME: `/identity` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:12:56.209797 dv-cinder-851351-1-smb devstack@keystone.service[144068]: [pid: 144068|app: 0|req: 553/1095] 10.222.0.42 () {56 vars in 1186 bytes} [Thu Jul 28 08:12:56 2022] GET /identity/v3/projects/bdc83bde204a42df9eea2d927be64bd3 => generated 311 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:12:56.210059 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ba897f-e033-48be-8ce2-621071aa07e8 None admin] PATH_INFO: `/v3/projects` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:12:56.210844 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ba897f-e033-48be-8ce2-621071aa07e8 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=144067) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:12:56.211235 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ba897f-e033-48be-8ce2-621071aa07e8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:12:56.213150 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ba897f-e033-48be-8ce2-621071aa07e8 None admin] RBAC: Authorization granted {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:12:56.217046 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a1d2c0-160e-423a-b321-b7d34b1232ad None admin] Authenticating user token {{(pid=144068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:12:56.230080 dv-cinder-851351-1-smb devstack@keystone.service[144067]: [pid: 144067|app: 0|req: 543/1096] 10.222.0.42 () {56 vars in 1148 bytes} [Thu Jul 28 08:12:56 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:12:56.237173 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ba897f-e033-48be-8ce2-621071aa07e8 None admin] Authenticating user token {{(pid=144067) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:12:56.247032 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG dbcounter [-] [144068] Writing DB stats keystone:SELECT=100 {{(pid=144068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:12:56.258276 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG dbcounter [-] [144067] Writing DB stats keystone:SELECT=100 {{(pid=144067) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:12:56.359740 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a1d2c0-160e-423a-b321-b7d34b1232ad None admin] Validating token access rules against request {{(pid=144068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:12:56.375137 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ba897f-e033-48be-8ce2-621071aa07e8 None admin] Validating token access rules against request {{(pid=144067) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:12:56.397692 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4633fb-0477-4f98-8537-758ca39af4a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:12:56.398402 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4633fb-0477-4f98-8537-758ca39af4a9 None admin] REQUEST_METHOD: `PUT` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:12:56.398806 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4633fb-0477-4f98-8537-758ca39af4a9 None admin] SCRIPT_NAME: `/identity` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:12:56.398985 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4633fb-0477-4f98-8537-758ca39af4a9 None admin] PATH_INFO: `/v3/projects/bdc83bde204a42df9eea2d927be64bd3/users/9a14ff9188ae4c87951d765322c9e9a4/roles/d1020e7bb0b7411d895ddedd6dc02c5b` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:12:56.401345 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d4633fb-0477-4f98-8537-758ca39af4a9 None admin] RBAC: Authorizing `identity:create_grant(project_id=bdc83bde204a42df9eea2d927be64bd3, user_id=9a14ff9188ae4c87951d765322c9e9a4, role_id=d1020e7bb0b7411d895ddedd6dc02c5b)` {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:12:56.402582 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d4633fb-0477-4f98-8537-758ca39af4a9 None admin] RBAC: Authorization granted {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:12:56.414591 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bdb6db5-067f-4c1f-98f2-8151e7cc71e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144067) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:12:56.415293 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bdb6db5-067f-4c1f-98f2-8151e7cc71e4 None admin] REQUEST_METHOD: `GET` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:12:56.415581 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bdb6db5-067f-4c1f-98f2-8151e7cc71e4 None admin] SCRIPT_NAME: `/identity` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:12:56.415859 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bdb6db5-067f-4c1f-98f2-8151e7cc71e4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:12:56.416720 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bdb6db5-067f-4c1f-98f2-8151e7cc71e4 None admin] RBAC: Adding query filter params (role.id=cfa933c7b37b473c8e22091c8b829530, scope.project.id=fa39ab7491e5413ca648e31ee9177fa0, user.id=2c1de9cd80344cefa3e06ae8c9c9e5d9) {{(pid=144067) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:12:56.417042 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bdb6db5-067f-4c1f-98f2-8151e7cc71e4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:12:56.418060 dv-cinder-851351-1-smb devstack@keystone.service[144068]: [pid: 144068|app: 0|req: 554/1097] 10.222.0.42 () {58 vars in 1439 bytes} [Thu Jul 28 08:12:56 2022] PUT /identity/v3/projects/bdc83bde204a42df9eea2d927be64bd3/users/9a14ff9188ae4c87951d765322c9e9a4/roles/d1020e7bb0b7411d895ddedd6dc02c5b => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 08:12:56.418557 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bdb6db5-067f-4c1f-98f2-8151e7cc71e4 None admin] RBAC: Authorization granted {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:12:56.426115 dv-cinder-851351-1-smb devstack@keystone.service[144067]: [pid: 144067|app: 0|req: 544/1098] 10.222.0.42 () {56 vars in 1374 bytes} [Thu Jul 28 08:12:56 2022] GET /identity/v3/role_assignments?user.id=2c1de9cd80344cefa3e06ae8c9c9e5d9&scope.project.id=fa39ab7491e5413ca648e31ee9177fa0&role.id=cfa933c7b37b473c8e22091c8b829530 => generated 608 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 08:12:58.464179 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17633e55-ecb0-49b1-8c60-7641329c5061 None None] REQUEST_METHOD: `GET` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:12:58.464797 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17633e55-ecb0-49b1-8c60-7641329c5061 None None] SCRIPT_NAME: `/identity` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:12:58.464797 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17633e55-ecb0-49b1-8c60-7641329c5061 None None] PATH_INFO: `/` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:12:58.466223 dv-cinder-851351-1-smb devstack@keystone.service[144068]: [pid: 144068|app: 0|req: 555/1099] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 08:12:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 08:12:58.471712 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e458aaa3-fb47-4d16-b34d-451dc1a04c81 None None] REQUEST_METHOD: `POST` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:12:58.472203 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e458aaa3-fb47-4d16-b34d-451dc1a04c81 None None] SCRIPT_NAME: `/identity` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:12:58.472380 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e458aaa3-fb47-4d16-b34d-451dc1a04c81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:12:58.491562 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.auth.core [None req-e458aaa3-fb47-4d16-b34d-451dc1a04c81 None None] MFA Rules not processed for user `bf5ceb8f07374635ad506b7d1b4f1612`. Rule list: `[]` (Enabled: `True`). {{(pid=144067) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 08:12:58.492841 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.fernet_utils [None req-e458aaa3-fb47-4d16-b34d-451dc1a04c81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=144067) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:12:58.566070 dv-cinder-851351-1-smb devstack@keystone.service[144067]: [pid: 144067|app: 0|req: 545/1100] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 08:12:58 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 08:12:58.590295 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17633e55-ecb0-49b1-8c60-7641329c5061 None None] Authenticating user token {{(pid=144068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:12:58.678000 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG dbcounter [-] [144068] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=144068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:12:58.700794 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17633e55-ecb0-49b1-8c60-7641329c5061 None None] Validating token access rules against request {{(pid=144068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:12:58.738841 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f32427b-5a08-4108-a6dc-d0f697d7afb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:12:58.739054 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f32427b-5a08-4108-a6dc-d0f697d7afb3 None admin] REQUEST_METHOD: `GET` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:12:58.739274 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f32427b-5a08-4108-a6dc-d0f697d7afb3 None admin] SCRIPT_NAME: `/identity` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:12:58.739549 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f32427b-5a08-4108-a6dc-d0f697d7afb3 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:12:58.751123 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f32427b-5a08-4108-a6dc-d0f697d7afb3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 08:12:58.756602 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application [None req-9f32427b-5a08-4108-a6dc-d0f697d7afb3 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 08:12:58.756602 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:12:58.756602 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:12:58.756602 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:12:58.756602 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:12:58.756602 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:12:58.756602 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:12:58.756602 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:12:58.756602 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:12:58.756602 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:12:58.756602 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:12:58.756602 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:12:58.756602 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 08:12:58.756602 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 08:12:58.756602 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 08:12:58.756602 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 08:12:58.757670 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 08:12:58.757670 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 08:12:58.757670 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 08:12:58.757670 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 08:12:58.757670 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:12:58.757670 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:12:58.757670 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:12:58.757670 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:12:58.757670 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:12:58.757670 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:12:58.757670 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:12:58.757670 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application with Lock( Jul 28 08:12:58.757670 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:12:58.757670 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:12:58.757670 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:12:58.757670 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:12:58.758550 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:12:58.758550 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:12:58.758550 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:12:58.758550 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:12:58.758550 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 08:12:58.758550 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 08:12:58.758550 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 08:12:58.758550 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 08:12:58.758550 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 08:12:58.758550 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 08:12:58.758550 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 08:12:58.758550 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application Jul 28 08:12:58.758550 dv-cinder-851351-1-smb devstack@keystone.service[144068]: [pid: 144068|app: 0|req: 556/1101] 10.222.0.42 () {56 vars in 1096 bytes} [Thu Jul 28 08:12:58 2022] GET /identity/v3/roles/admin => generated 83 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:12:58.764623 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e458aaa3-fb47-4d16-b34d-451dc1a04c81 None None] Authenticating user token {{(pid=144067) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:12:58.775394 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG dbcounter [-] [144067] Writing DB stats keystone:SELECT=100 {{(pid=144067) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:12:58.867940 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e458aaa3-fb47-4d16-b34d-451dc1a04c81 None None] Validating token access rules against request {{(pid=144067) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:12:58.902974 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a46dc01-2939-4beb-93d5-92fc0a5fb6a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144067) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:12:58.903604 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a46dc01-2939-4beb-93d5-92fc0a5fb6a9 None admin] REQUEST_METHOD: `GET` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:12:58.903889 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a46dc01-2939-4beb-93d5-92fc0a5fb6a9 None admin] SCRIPT_NAME: `/identity` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:12:58.904163 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a46dc01-2939-4beb-93d5-92fc0a5fb6a9 None admin] PATH_INFO: `/v3/roles` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:12:58.904923 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a46dc01-2939-4beb-93d5-92fc0a5fb6a9 None admin] RBAC: Adding query filter params (name=admin) {{(pid=144067) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:12:58.905226 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a46dc01-2939-4beb-93d5-92fc0a5fb6a9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:12:58.906629 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a46dc01-2939-4beb-93d5-92fc0a5fb6a9 None admin] RBAC: Authorization granted {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:12:58.915363 dv-cinder-851351-1-smb devstack@keystone.service[144067]: [pid: 144067|app: 0|req: 546/1102] 10.222.0.42 () {56 vars in 1099 bytes} [Thu Jul 28 08:12:58 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:12:58.921670 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f32427b-5a08-4108-a6dc-d0f697d7afb3 None admin] Authenticating user token {{(pid=144068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:12:59.039590 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f32427b-5a08-4108-a6dc-d0f697d7afb3 None admin] Validating token access rules against request {{(pid=144068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:12:59.074787 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd62dff8-0958-4050-8418-3f7613556315 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:12:59.075433 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd62dff8-0958-4050-8418-3f7613556315 None admin] REQUEST_METHOD: `GET` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:12:59.075711 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd62dff8-0958-4050-8418-3f7613556315 None admin] SCRIPT_NAME: `/identity` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:12:59.075979 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd62dff8-0958-4050-8418-3f7613556315 None admin] PATH_INFO: `/v3/users/9a14ff9188ae4c87951d765322c9e9a4` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:12:59.077224 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd62dff8-0958-4050-8418-3f7613556315 None admin] RBAC: Authorizing `identity:get_user(user_id=9a14ff9188ae4c87951d765322c9e9a4)` {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:12:59.078658 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd62dff8-0958-4050-8418-3f7613556315 None admin] RBAC: Authorization granted {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:12:59.080331 dv-cinder-851351-1-smb devstack@keystone.service[144068]: [pid: 144068|app: 0|req: 557/1103] 10.222.0.42 () {56 vars in 1177 bytes} [Thu Jul 28 08:12:58 2022] GET /identity/v3/users/9a14ff9188ae4c87951d765322c9e9a4 => generated 285 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:12:59.087002 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a46dc01-2939-4beb-93d5-92fc0a5fb6a9 None admin] Authenticating user token {{(pid=144067) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:12:59.158929 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG dbcounter [-] [144067] Writing DB stats keystone:SELECT=100 {{(pid=144067) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:12:59.194173 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a46dc01-2939-4beb-93d5-92fc0a5fb6a9 None admin] Validating token access rules against request {{(pid=144067) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:12:59.229271 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20cee524-d441-4d47-ba81-7fdf9e186062 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144067) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:12:59.229900 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20cee524-d441-4d47-ba81-7fdf9e186062 None admin] REQUEST_METHOD: `GET` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:12:59.230182 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20cee524-d441-4d47-ba81-7fdf9e186062 None admin] SCRIPT_NAME: `/identity` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:12:59.230450 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20cee524-d441-4d47-ba81-7fdf9e186062 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:12:59.307502 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20cee524-d441-4d47-ba81-7fdf9e186062 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:12:59.308928 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20cee524-d441-4d47-ba81-7fdf9e186062 None admin] RBAC: Authorization granted {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:12:59.385536 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG dbcounter [-] [144067] Writing DB stats keystone:SELECT=100 {{(pid=144067) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:12:59.416974 dv-cinder-851351-1-smb devstack@keystone.service[144067]: [pid: 144067|app: 0|req: 547/1104] 10.222.0.42 () {58 vars in 1282 bytes} [Thu Jul 28 08:12:59 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 28 08:12:59.423405 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd62dff8-0958-4050-8418-3f7613556315 None admin] Authenticating user token {{(pid=144068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:12:59.434903 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG dbcounter [-] [144068] Writing DB stats keystone:SELECT=100 {{(pid=144068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:12:59.533530 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd62dff8-0958-4050-8418-3f7613556315 None admin] Validating token access rules against request {{(pid=144068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:12:59.569269 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d08916-7d5a-4f8d-be28-dd9960634b81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:12:59.569838 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d08916-7d5a-4f8d-be28-dd9960634b81 None admin] REQUEST_METHOD: `GET` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:12:59.570125 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d08916-7d5a-4f8d-be28-dd9960634b81 None admin] SCRIPT_NAME: `/identity` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:12:59.570599 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d08916-7d5a-4f8d-be28-dd9960634b81 None admin] PATH_INFO: `/v3/projects/bdc83bde204a42df9eea2d927be64bd3` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:12:59.571644 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4d08916-7d5a-4f8d-be28-dd9960634b81 None admin] RBAC: Authorizing `identity:get_project(project_id=bdc83bde204a42df9eea2d927be64bd3)` {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:12:59.573121 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4d08916-7d5a-4f8d-be28-dd9960634b81 None admin] RBAC: Authorization granted {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:12:59.574841 dv-cinder-851351-1-smb devstack@keystone.service[144068]: [pid: 144068|app: 0|req: 558/1105] 10.222.0.42 () {56 vars in 1186 bytes} [Thu Jul 28 08:12:59 2022] GET /identity/v3/projects/bdc83bde204a42df9eea2d927be64bd3 => generated 311 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:12:59.581576 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20cee524-d441-4d47-ba81-7fdf9e186062 None admin] Authenticating user token {{(pid=144067) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:12:59.696176 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20cee524-d441-4d47-ba81-7fdf9e186062 None admin] Validating token access rules against request {{(pid=144067) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:12:59.736388 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc41000-3b55-4068-a778-caf5ae5a6657 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144067) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:12:59.737066 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc41000-3b55-4068-a778-caf5ae5a6657 None admin] REQUEST_METHOD: `GET` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:12:59.737348 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc41000-3b55-4068-a778-caf5ae5a6657 None admin] SCRIPT_NAME: `/identity` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:12:59.737711 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc41000-3b55-4068-a778-caf5ae5a6657 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:12:59.738525 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc41000-3b55-4068-a778-caf5ae5a6657 None admin] RBAC: Adding query filter params (role.id=d1020e7bb0b7411d895ddedd6dc02c5b, scope.project.id=bdc83bde204a42df9eea2d927be64bd3, user.id=9a14ff9188ae4c87951d765322c9e9a4) {{(pid=144067) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:12:59.738844 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc41000-3b55-4068-a778-caf5ae5a6657 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:12:59.740325 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc41000-3b55-4068-a778-caf5ae5a6657 None admin] RBAC: Authorization granted {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:12:59.747282 dv-cinder-851351-1-smb devstack@keystone.service[144067]: [pid: 144067|app: 0|req: 548/1106] 10.222.0.42 () {56 vars in 1374 bytes} [Thu Jul 28 08:12:59 2022] GET /identity/v3/role_assignments?user.id=9a14ff9188ae4c87951d765322c9e9a4&scope.project.id=bdc83bde204a42df9eea2d927be64bd3&role.id=d1020e7bb0b7411d895ddedd6dc02c5b => generated 608 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:13:01.773871 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e758201c-6256-4227-a9db-c0b0ea9f8634 None None] REQUEST_METHOD: `GET` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:13:01.774437 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e758201c-6256-4227-a9db-c0b0ea9f8634 None None] SCRIPT_NAME: `/identity` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:13:01.774437 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e758201c-6256-4227-a9db-c0b0ea9f8634 None None] PATH_INFO: `/` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:13:01.775804 dv-cinder-851351-1-smb devstack@keystone.service[144068]: [pid: 144068|app: 0|req: 559/1107] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 08:13:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 08:13:01.781854 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38979398-6eee-4531-8527-2c71c2334988 None None] REQUEST_METHOD: `POST` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:13:01.782460 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38979398-6eee-4531-8527-2c71c2334988 None None] SCRIPT_NAME: `/identity` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:13:01.782460 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38979398-6eee-4531-8527-2c71c2334988 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:13:01.802954 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.auth.core [None req-38979398-6eee-4531-8527-2c71c2334988 None None] MFA Rules not processed for user `bf5ceb8f07374635ad506b7d1b4f1612`. Rule list: `[]` (Enabled: `True`). {{(pid=144067) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 08:13:01.804218 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.fernet_utils [None req-38979398-6eee-4531-8527-2c71c2334988 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=144067) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:13:01.838015 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG dbcounter [-] [144067] Writing DB stats keystone:SELECT=100 {{(pid=144067) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:13:01.886019 dv-cinder-851351-1-smb devstack@keystone.service[144067]: [pid: 144067|app: 0|req: 549/1108] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 08:13:01 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 08:13:01.911074 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e758201c-6256-4227-a9db-c0b0ea9f8634 None None] Authenticating user token {{(pid=144068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:13:02.008778 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG dbcounter [-] [144068] Writing DB stats keystone:SELECT=100 {{(pid=144068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:13:02.037460 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e758201c-6256-4227-a9db-c0b0ea9f8634 None None] Validating token access rules against request {{(pid=144068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:13:02.073684 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af6a072-2ffb-4f0e-9170-d19ffd275609 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:13:02.074368 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af6a072-2ffb-4f0e-9170-d19ffd275609 None admin] REQUEST_METHOD: `GET` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:13:02.074651 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af6a072-2ffb-4f0e-9170-d19ffd275609 None admin] SCRIPT_NAME: `/identity` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:13:02.075038 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af6a072-2ffb-4f0e-9170-d19ffd275609 None admin] PATH_INFO: `/v3/domains/default` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:13:02.076387 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9af6a072-2ffb-4f0e-9170-d19ffd275609 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:13:02.077891 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9af6a072-2ffb-4f0e-9170-d19ffd275609 None admin] RBAC: Authorization granted {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:13:02.079554 dv-cinder-851351-1-smb devstack@keystone.service[144068]: [pid: 144068|app: 0|req: 560/1109] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 08:13:01 2022] GET /identity/v3/domains/default => generated 199 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:13:02.085770 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38979398-6eee-4531-8527-2c71c2334988 None None] Authenticating user token {{(pid=144067) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:13:02.195585 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38979398-6eee-4531-8527-2c71c2334988 None None] Validating token access rules against request {{(pid=144067) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:13:02.233087 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0f947a-2bc0-41e2-9c2e-4d47d4060281 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144067) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:13:02.233719 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0f947a-2bc0-41e2-9c2e-4d47d4060281 None admin] REQUEST_METHOD: `POST` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:13:02.234002 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0f947a-2bc0-41e2-9c2e-4d47d4060281 None admin] SCRIPT_NAME: `/identity` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:13:02.234277 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0f947a-2bc0-41e2-9c2e-4d47d4060281 None admin] PATH_INFO: `/v3/users` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:13:02.234966 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c0f947a-2bc0-41e2-9c2e-4d47d4060281 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:13:02.236439 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c0f947a-2bc0-41e2-9c2e-4d47d4060281 None admin] RBAC: Authorization granted {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:13:02.259396 dv-cinder-851351-1-smb devstack@keystone.service[144067]: [pid: 144067|app: 0|req: 550/1110] 10.222.0.42 () {60 vars in 1132 bytes} [Thu Jul 28 08:13:02 2022] POST /identity/v3/users => generated 286 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 08:13:04.300778 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf7b651-3c74-4962-9ee1-6af92297fa7e None None] REQUEST_METHOD: `GET` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:13:04.301300 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf7b651-3c74-4962-9ee1-6af92297fa7e None None] SCRIPT_NAME: `/identity` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:13:04.301300 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf7b651-3c74-4962-9ee1-6af92297fa7e None None] PATH_INFO: `/` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:13:04.302590 dv-cinder-851351-1-smb devstack@keystone.service[144068]: [pid: 144068|app: 0|req: 561/1111] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 08:13:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 08:13:04.308179 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b7712a-04e8-4761-bc6e-c4129e321dec None None] REQUEST_METHOD: `POST` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:13:04.308684 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b7712a-04e8-4761-bc6e-c4129e321dec None None] SCRIPT_NAME: `/identity` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:13:04.308776 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b7712a-04e8-4761-bc6e-c4129e321dec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:13:04.327111 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.auth.core [None req-64b7712a-04e8-4761-bc6e-c4129e321dec None None] MFA Rules not processed for user `bf5ceb8f07374635ad506b7d1b4f1612`. Rule list: `[]` (Enabled: `True`). {{(pid=144067) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 08:13:04.328317 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.fernet_utils [None req-64b7712a-04e8-4761-bc6e-c4129e321dec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=144067) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:13:04.343569 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG dbcounter [-] [144067] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=144067) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:13:04.402848 dv-cinder-851351-1-smb devstack@keystone.service[144067]: [pid: 144067|app: 0|req: 551/1112] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 08:13:04 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 28 08:13:04.425945 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf7b651-3c74-4962-9ee1-6af92297fa7e None None] Authenticating user token {{(pid=144068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:13:04.548143 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf7b651-3c74-4962-9ee1-6af92297fa7e None None] Validating token access rules against request {{(pid=144068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:13:04.584808 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e5ebfb-da69-4632-9300-e682a6558b9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:13:04.585465 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e5ebfb-da69-4632-9300-e682a6558b9d None admin] REQUEST_METHOD: `GET` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:13:04.585737 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e5ebfb-da69-4632-9300-e682a6558b9d None admin] SCRIPT_NAME: `/identity` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:13:04.586015 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e5ebfb-da69-4632-9300-e682a6558b9d None admin] PATH_INFO: `/v3/roles/7e9c2306137042cf8b8eba284656ef33` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:13:04.587863 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65e5ebfb-da69-4632-9300-e682a6558b9d None admin] RBAC: Authorizing `identity:get_role(role_id=7e9c2306137042cf8b8eba284656ef33)` {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:13:04.589987 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65e5ebfb-da69-4632-9300-e682a6558b9d None admin] RBAC: Authorization granted {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:13:04.591416 dv-cinder-851351-1-smb devstack@keystone.service[144068]: [pid: 144068|app: 0|req: 562/1113] 10.222.0.42 () {56 vars in 1177 bytes} [Thu Jul 28 08:13:04 2022] GET /identity/v3/roles/7e9c2306137042cf8b8eba284656ef33 => generated 223 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:13:04.597730 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b7712a-04e8-4761-bc6e-c4129e321dec None None] Authenticating user token {{(pid=144067) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:13:04.700695 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b7712a-04e8-4761-bc6e-c4129e321dec None None] Validating token access rules against request {{(pid=144067) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:13:04.739140 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade23807-2c7a-4c13-9425-5ac30478cd29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144067) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:13:04.739788 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade23807-2c7a-4c13-9425-5ac30478cd29 None admin] REQUEST_METHOD: `GET` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:13:04.740077 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade23807-2c7a-4c13-9425-5ac30478cd29 None admin] SCRIPT_NAME: `/identity` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:13:04.740339 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade23807-2c7a-4c13-9425-5ac30478cd29 None admin] PATH_INFO: `/v3/users/3dcff3008c734a3f95a0a7b56c369059` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:13:04.755398 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ade23807-2c7a-4c13-9425-5ac30478cd29 None admin] RBAC: Authorizing `identity:get_user(user_id=3dcff3008c734a3f95a0a7b56c369059)` {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:13:04.756922 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ade23807-2c7a-4c13-9425-5ac30478cd29 None admin] RBAC: Authorization granted {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:13:04.758676 dv-cinder-851351-1-smb devstack@keystone.service[144067]: [pid: 144067|app: 0|req: 552/1114] 10.222.0.42 () {56 vars in 1177 bytes} [Thu Jul 28 08:13:04 2022] GET /identity/v3/users/3dcff3008c734a3f95a0a7b56c369059 => generated 286 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:13:04.764782 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e5ebfb-da69-4632-9300-e682a6558b9d None admin] Authenticating user token {{(pid=144068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:13:04.781163 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG dbcounter [-] [144068] Writing DB stats keystone:SELECT=100 {{(pid=144068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:13:04.875579 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e5ebfb-da69-4632-9300-e682a6558b9d None admin] Validating token access rules against request {{(pid=144068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:13:04.914546 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd4bc919-74dd-4f6b-aed6-976d50e3bcd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:13:04.915193 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4bc919-74dd-4f6b-aed6-976d50e3bcd4 None admin] REQUEST_METHOD: `GET` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:13:04.915475 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4bc919-74dd-4f6b-aed6-976d50e3bcd4 None admin] SCRIPT_NAME: `/identity` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:13:04.915745 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4bc919-74dd-4f6b-aed6-976d50e3bcd4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:13:05.000122 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd4bc919-74dd-4f6b-aed6-976d50e3bcd4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:13:05.002563 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd4bc919-74dd-4f6b-aed6-976d50e3bcd4 None admin] RBAC: Authorization granted {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:13:05.021225 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG dbcounter [-] [144068] Writing DB stats keystone:SELECT=100 {{(pid=144068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:13:05.127689 dv-cinder-851351-1-smb devstack@keystone.service[144068]: [pid: 144068|app: 0|req: 563/1115] 10.222.0.42 () {58 vars in 1282 bytes} [Thu Jul 28 08:13:04 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 363 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 28 08:13:05.134090 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade23807-2c7a-4c13-9425-5ac30478cd29 None admin] Authenticating user token {{(pid=144067) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:13:05.145658 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG dbcounter [-] [144067] Writing DB stats keystone:SELECT=100 {{(pid=144067) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:13:05.242902 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade23807-2c7a-4c13-9425-5ac30478cd29 None admin] Validating token access rules against request {{(pid=144067) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:13:05.281180 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3ac8cb-72d5-433f-9b9c-21f852ebdc27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144067) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:13:05.281884 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3ac8cb-72d5-433f-9b9c-21f852ebdc27 None admin] REQUEST_METHOD: `GET` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:13:05.282209 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3ac8cb-72d5-433f-9b9c-21f852ebdc27 None admin] SCRIPT_NAME: `/identity` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:13:05.282527 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3ac8cb-72d5-433f-9b9c-21f852ebdc27 None admin] PATH_INFO: `/v3/projects/bdc83bde204a42df9eea2d927be64bd3` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:13:05.283867 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d3ac8cb-72d5-433f-9b9c-21f852ebdc27 None admin] RBAC: Authorizing `identity:get_project(project_id=bdc83bde204a42df9eea2d927be64bd3)` {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:13:05.285518 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d3ac8cb-72d5-433f-9b9c-21f852ebdc27 None admin] RBAC: Authorization granted {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:13:05.287255 dv-cinder-851351-1-smb devstack@keystone.service[144067]: [pid: 144067|app: 0|req: 553/1116] 10.222.0.42 () {56 vars in 1186 bytes} [Thu Jul 28 08:13:05 2022] GET /identity/v3/projects/bdc83bde204a42df9eea2d927be64bd3 => generated 311 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 08:13:05.295706 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd4bc919-74dd-4f6b-aed6-976d50e3bcd4 None admin] Authenticating user token {{(pid=144068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:13:05.404159 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd4bc919-74dd-4f6b-aed6-976d50e3bcd4 None admin] Validating token access rules against request {{(pid=144068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:13:05.419483 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG dbcounter [-] [144068] Writing DB stats keystone:SELECT=100 {{(pid=144068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:13:05.442983 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d1d7a7-2321-49f8-91b8-86fa27901a05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:13:05.443668 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d1d7a7-2321-49f8-91b8-86fa27901a05 None admin] REQUEST_METHOD: `GET` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:13:05.443992 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d1d7a7-2321-49f8-91b8-86fa27901a05 None admin] SCRIPT_NAME: `/identity` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:13:05.444307 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d1d7a7-2321-49f8-91b8-86fa27901a05 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:13:05.445208 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47d1d7a7-2321-49f8-91b8-86fa27901a05 None admin] RBAC: Adding query filter params (role.id=7e9c2306137042cf8b8eba284656ef33, scope.project.id=bdc83bde204a42df9eea2d927be64bd3, user.id=3dcff3008c734a3f95a0a7b56c369059) {{(pid=144068) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:13:05.445561 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47d1d7a7-2321-49f8-91b8-86fa27901a05 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:13:05.447080 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47d1d7a7-2321-49f8-91b8-86fa27901a05 None admin] RBAC: Authorization granted {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:13:05.453568 dv-cinder-851351-1-smb devstack@keystone.service[144068]: [pid: 144068|app: 0|req: 564/1117] 10.222.0.42 () {56 vars in 1374 bytes} [Thu Jul 28 08:13:05 2022] GET /identity/v3/role_assignments?user.id=3dcff3008c734a3f95a0a7b56c369059&scope.project.id=bdc83bde204a42df9eea2d927be64bd3&role.id=7e9c2306137042cf8b8eba284656ef33 => generated 259 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 08:13:07.456696 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8c1d1e-ccf8-44fe-bcf8-88e29b9b0a78 None None] REQUEST_METHOD: `GET` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:13:07.457310 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8c1d1e-ccf8-44fe-bcf8-88e29b9b0a78 None None] SCRIPT_NAME: `/identity` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:13:07.457310 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8c1d1e-ccf8-44fe-bcf8-88e29b9b0a78 None None] PATH_INFO: `/` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:13:07.458650 dv-cinder-851351-1-smb devstack@keystone.service[144067]: [pid: 144067|app: 0|req: 554/1118] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 08:13:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 08:13:07.465084 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842c36bc-3dea-4a00-9ef7-197ed68b64b9 None None] REQUEST_METHOD: `POST` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:13:07.465597 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842c36bc-3dea-4a00-9ef7-197ed68b64b9 None None] SCRIPT_NAME: `/identity` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:13:07.465685 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842c36bc-3dea-4a00-9ef7-197ed68b64b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:13:07.485824 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.auth.core [None req-842c36bc-3dea-4a00-9ef7-197ed68b64b9 None None] MFA Rules not processed for user `bf5ceb8f07374635ad506b7d1b4f1612`. Rule list: `[]` (Enabled: `True`). {{(pid=144068) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 08:13:07.487076 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.fernet_utils [None req-842c36bc-3dea-4a00-9ef7-197ed68b64b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=144068) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:13:07.563401 dv-cinder-851351-1-smb devstack@keystone.service[144068]: [pid: 144068|app: 0|req: 565/1119] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 08:13:07 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 08:13:07.587149 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8c1d1e-ccf8-44fe-bcf8-88e29b9b0a78 None None] Authenticating user token {{(pid=144067) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:13:07.673741 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG dbcounter [-] [144067] Writing DB stats keystone:SELECT=100 {{(pid=144067) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:13:07.700578 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8c1d1e-ccf8-44fe-bcf8-88e29b9b0a78 None None] Validating token access rules against request {{(pid=144067) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:13:07.738861 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd1d332-0307-4ae3-9d7e-d1b5a83d2f58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144067) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:13:07.739422 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd1d332-0307-4ae3-9d7e-d1b5a83d2f58 None admin] REQUEST_METHOD: `GET` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:13:07.739704 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd1d332-0307-4ae3-9d7e-d1b5a83d2f58 None admin] SCRIPT_NAME: `/identity` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:13:07.739979 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd1d332-0307-4ae3-9d7e-d1b5a83d2f58 None admin] PATH_INFO: `/v3/roles/7e9c2306137042cf8b8eba284656ef33` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:13:07.741528 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd1d332-0307-4ae3-9d7e-d1b5a83d2f58 None admin] RBAC: Authorizing `identity:get_role(role_id=7e9c2306137042cf8b8eba284656ef33)` {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:13:07.742927 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd1d332-0307-4ae3-9d7e-d1b5a83d2f58 None admin] RBAC: Authorization granted {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:13:07.744323 dv-cinder-851351-1-smb devstack@keystone.service[144067]: [pid: 144067|app: 0|req: 555/1120] 10.222.0.42 () {56 vars in 1177 bytes} [Thu Jul 28 08:13:07 2022] GET /identity/v3/roles/7e9c2306137042cf8b8eba284656ef33 => generated 223 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:13:07.750541 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842c36bc-3dea-4a00-9ef7-197ed68b64b9 None None] Authenticating user token {{(pid=144068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:13:07.864839 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842c36bc-3dea-4a00-9ef7-197ed68b64b9 None None] Validating token access rules against request {{(pid=144068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:13:07.872970 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG dbcounter [-] [144068] Writing DB stats keystone:SELECT=100 {{(pid=144068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:13:07.902037 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-779afee2-be98-4ae2-a96d-be28b4c29302 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:13:07.902708 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779afee2-be98-4ae2-a96d-be28b4c29302 None admin] REQUEST_METHOD: `GET` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:13:07.902994 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779afee2-be98-4ae2-a96d-be28b4c29302 None admin] SCRIPT_NAME: `/identity` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:13:07.903275 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779afee2-be98-4ae2-a96d-be28b4c29302 None admin] PATH_INFO: `/v3/users/3dcff3008c734a3f95a0a7b56c369059` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:13:07.904498 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-779afee2-be98-4ae2-a96d-be28b4c29302 None admin] RBAC: Authorizing `identity:get_user(user_id=3dcff3008c734a3f95a0a7b56c369059)` {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:13:07.905995 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-779afee2-be98-4ae2-a96d-be28b4c29302 None admin] RBAC: Authorization granted {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:13:07.907664 dv-cinder-851351-1-smb devstack@keystone.service[144068]: [pid: 144068|app: 0|req: 566/1121] 10.222.0.42 () {56 vars in 1177 bytes} [Thu Jul 28 08:13:07 2022] GET /identity/v3/users/3dcff3008c734a3f95a0a7b56c369059 => generated 286 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:13:07.913902 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd1d332-0307-4ae3-9d7e-d1b5a83d2f58 None admin] Authenticating user token {{(pid=144067) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:13:08.023367 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd1d332-0307-4ae3-9d7e-d1b5a83d2f58 None admin] Validating token access rules against request {{(pid=144067) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:13:08.059753 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4542afe7-6b1f-4969-a845-508fb796db7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144067) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:13:08.060422 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4542afe7-6b1f-4969-a845-508fb796db7c None admin] REQUEST_METHOD: `GET` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:13:08.060731 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4542afe7-6b1f-4969-a845-508fb796db7c None admin] SCRIPT_NAME: `/identity` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:13:08.061012 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4542afe7-6b1f-4969-a845-508fb796db7c None admin] PATH_INFO: `/v3/projects/bdc83bde204a42df9eea2d927be64bd3` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:13:08.062225 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4542afe7-6b1f-4969-a845-508fb796db7c None admin] RBAC: Authorizing `identity:get_project(project_id=bdc83bde204a42df9eea2d927be64bd3)` {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:13:08.063703 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4542afe7-6b1f-4969-a845-508fb796db7c None admin] RBAC: Authorization granted {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:13:08.065510 dv-cinder-851351-1-smb devstack@keystone.service[144067]: [pid: 144067|app: 0|req: 556/1122] 10.222.0.42 () {56 vars in 1186 bytes} [Thu Jul 28 08:13:07 2022] GET /identity/v3/projects/bdc83bde204a42df9eea2d927be64bd3 => generated 311 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:13:08.071873 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-779afee2-be98-4ae2-a96d-be28b4c29302 None admin] Authenticating user token {{(pid=144068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:13:08.192908 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-779afee2-be98-4ae2-a96d-be28b4c29302 None admin] Validating token access rules against request {{(pid=144068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:13:08.234934 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd6e6efc-ea74-44dc-9617-8df0d712e999 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:13:08.235635 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6e6efc-ea74-44dc-9617-8df0d712e999 None admin] REQUEST_METHOD: `PUT` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:13:08.235919 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6e6efc-ea74-44dc-9617-8df0d712e999 None admin] SCRIPT_NAME: `/identity` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:13:08.236200 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6e6efc-ea74-44dc-9617-8df0d712e999 None admin] PATH_INFO: `/v3/projects/bdc83bde204a42df9eea2d927be64bd3/users/3dcff3008c734a3f95a0a7b56c369059/roles/7e9c2306137042cf8b8eba284656ef33` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:13:08.238965 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd6e6efc-ea74-44dc-9617-8df0d712e999 None admin] RBAC: Authorizing `identity:create_grant(project_id=bdc83bde204a42df9eea2d927be64bd3, user_id=3dcff3008c734a3f95a0a7b56c369059, role_id=7e9c2306137042cf8b8eba284656ef33)` {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:13:08.240541 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd6e6efc-ea74-44dc-9617-8df0d712e999 None admin] RBAC: Authorization granted {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:13:08.256955 dv-cinder-851351-1-smb devstack@keystone.service[144068]: [pid: 144068|app: 0|req: 567/1123] 10.222.0.42 () {58 vars in 1439 bytes} [Thu Jul 28 08:13:08 2022] PUT /identity/v3/projects/bdc83bde204a42df9eea2d927be64bd3/users/3dcff3008c734a3f95a0a7b56c369059/roles/7e9c2306137042cf8b8eba284656ef33 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 08:13:10.313620 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63de9b24-ba64-44f7-82ee-315b94dbd52e None None] REQUEST_METHOD: `GET` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:13:10.314150 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63de9b24-ba64-44f7-82ee-315b94dbd52e None None] SCRIPT_NAME: `/identity` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:13:10.314150 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63de9b24-ba64-44f7-82ee-315b94dbd52e None None] PATH_INFO: `/` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:13:10.315441 dv-cinder-851351-1-smb devstack@keystone.service[144067]: [pid: 144067|app: 0|req: 557/1124] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 08:13:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 08:13:10.321149 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2b29ad-706c-4bf0-856a-1a03eb3bda8a None None] REQUEST_METHOD: `POST` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:13:10.321599 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2b29ad-706c-4bf0-856a-1a03eb3bda8a None None] SCRIPT_NAME: `/identity` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:13:10.321697 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2b29ad-706c-4bf0-856a-1a03eb3bda8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:13:10.341608 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.auth.core [None req-1f2b29ad-706c-4bf0-856a-1a03eb3bda8a None None] MFA Rules not processed for user `bf5ceb8f07374635ad506b7d1b4f1612`. Rule list: `[]` (Enabled: `True`). {{(pid=144068) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 08:13:10.342824 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.fernet_utils [None req-1f2b29ad-706c-4bf0-856a-1a03eb3bda8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=144068) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:13:10.372324 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG dbcounter [-] [144068] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=144068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:13:10.415341 dv-cinder-851351-1-smb devstack@keystone.service[144068]: [pid: 144068|app: 0|req: 568/1125] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 08:13:10 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 08:13:10.438497 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63de9b24-ba64-44f7-82ee-315b94dbd52e None None] Authenticating user token {{(pid=144067) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:13:10.454475 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG dbcounter [-] [144067] Writing DB stats keystone:SELECT=100 {{(pid=144067) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:13:10.550322 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63de9b24-ba64-44f7-82ee-315b94dbd52e None None] Validating token access rules against request {{(pid=144067) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:13:10.587105 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af4352f-88eb-4b79-88bb-0f45907bf49f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144067) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:13:10.587784 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af4352f-88eb-4b79-88bb-0f45907bf49f None admin] REQUEST_METHOD: `GET` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:13:10.588061 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af4352f-88eb-4b79-88bb-0f45907bf49f None admin] SCRIPT_NAME: `/identity` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:13:10.588348 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af4352f-88eb-4b79-88bb-0f45907bf49f None admin] PATH_INFO: `/v3/roles/7e9c2306137042cf8b8eba284656ef33` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:13:10.589881 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3af4352f-88eb-4b79-88bb-0f45907bf49f None admin] RBAC: Authorizing `identity:get_role(role_id=7e9c2306137042cf8b8eba284656ef33)` {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:13:10.591285 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3af4352f-88eb-4b79-88bb-0f45907bf49f None admin] RBAC: Authorization granted {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:13:10.592703 dv-cinder-851351-1-smb devstack@keystone.service[144067]: [pid: 144067|app: 0|req: 558/1126] 10.222.0.42 () {56 vars in 1177 bytes} [Thu Jul 28 08:13:10 2022] GET /identity/v3/roles/7e9c2306137042cf8b8eba284656ef33 => generated 223 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:13:10.599101 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2b29ad-706c-4bf0-856a-1a03eb3bda8a None None] Authenticating user token {{(pid=144068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:13:10.701778 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2b29ad-706c-4bf0-856a-1a03eb3bda8a None None] Validating token access rules against request {{(pid=144068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:13:10.739431 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82166838-c229-4ab9-a1ab-f5c00caa98d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:13:10.740083 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82166838-c229-4ab9-a1ab-f5c00caa98d1 None admin] REQUEST_METHOD: `GET` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:13:10.740360 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82166838-c229-4ab9-a1ab-f5c00caa98d1 None admin] SCRIPT_NAME: `/identity` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:13:10.740627 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82166838-c229-4ab9-a1ab-f5c00caa98d1 None admin] PATH_INFO: `/v3/users/3dcff3008c734a3f95a0a7b56c369059` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:13:10.741895 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82166838-c229-4ab9-a1ab-f5c00caa98d1 None admin] RBAC: Authorizing `identity:get_user(user_id=3dcff3008c734a3f95a0a7b56c369059)` {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:13:10.743336 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82166838-c229-4ab9-a1ab-f5c00caa98d1 None admin] RBAC: Authorization granted {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:13:10.745007 dv-cinder-851351-1-smb devstack@keystone.service[144068]: [pid: 144068|app: 0|req: 569/1127] 10.222.0.42 () {56 vars in 1177 bytes} [Thu Jul 28 08:13:10 2022] GET /identity/v3/users/3dcff3008c734a3f95a0a7b56c369059 => generated 286 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:13:10.751079 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af4352f-88eb-4b79-88bb-0f45907bf49f None admin] Authenticating user token {{(pid=144067) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:13:10.834696 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG dbcounter [-] [144067] Writing DB stats keystone:SELECT=100 {{(pid=144067) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:13:10.855687 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af4352f-88eb-4b79-88bb-0f45907bf49f None admin] Validating token access rules against request {{(pid=144067) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:13:10.891152 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed0c2a0-47d7-4e09-b9c7-126898e51e77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144067) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:13:10.891773 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed0c2a0-47d7-4e09-b9c7-126898e51e77 None admin] REQUEST_METHOD: `GET` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:13:10.892055 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed0c2a0-47d7-4e09-b9c7-126898e51e77 None admin] SCRIPT_NAME: `/identity` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:13:10.892328 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed0c2a0-47d7-4e09-b9c7-126898e51e77 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:13:10.962206 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ed0c2a0-47d7-4e09-b9c7-126898e51e77 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:13:10.963688 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ed0c2a0-47d7-4e09-b9c7-126898e51e77 None admin] RBAC: Authorization granted {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:13:11.049029 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG dbcounter [-] [144067] Writing DB stats keystone:SELECT=100 {{(pid=144067) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:13:11.071041 dv-cinder-851351-1-smb devstack@keystone.service[144067]: [pid: 144067|app: 0|req: 559/1128] 10.222.0.42 () {58 vars in 1282 bytes} [Thu Jul 28 08:13:10 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 28 08:13:11.077351 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82166838-c229-4ab9-a1ab-f5c00caa98d1 None admin] Authenticating user token {{(pid=144068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:13:11.111961 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG dbcounter [-] [144068] Writing DB stats keystone:SELECT=100 {{(pid=144068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:13:11.183731 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82166838-c229-4ab9-a1ab-f5c00caa98d1 None admin] Validating token access rules against request {{(pid=144068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:13:11.221077 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db9bcf21-88fe-4e06-8747-b409d6c05952 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:13:11.221732 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9bcf21-88fe-4e06-8747-b409d6c05952 None admin] REQUEST_METHOD: `GET` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:13:11.222100 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9bcf21-88fe-4e06-8747-b409d6c05952 None admin] SCRIPT_NAME: `/identity` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:13:11.222375 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9bcf21-88fe-4e06-8747-b409d6c05952 None admin] PATH_INFO: `/v3/projects/bdc83bde204a42df9eea2d927be64bd3` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:13:11.223650 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db9bcf21-88fe-4e06-8747-b409d6c05952 None admin] RBAC: Authorizing `identity:get_project(project_id=bdc83bde204a42df9eea2d927be64bd3)` {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:13:11.225158 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db9bcf21-88fe-4e06-8747-b409d6c05952 None admin] RBAC: Authorization granted {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:13:11.226863 dv-cinder-851351-1-smb devstack@keystone.service[144068]: [pid: 144068|app: 0|req: 570/1129] 10.222.0.42 () {56 vars in 1186 bytes} [Thu Jul 28 08:13:11 2022] GET /identity/v3/projects/bdc83bde204a42df9eea2d927be64bd3 => generated 311 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:13:11.233519 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed0c2a0-47d7-4e09-b9c7-126898e51e77 None admin] Authenticating user token {{(pid=144067) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:13:11.348632 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed0c2a0-47d7-4e09-b9c7-126898e51e77 None admin] Validating token access rules against request {{(pid=144067) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:13:11.384951 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f651a61-06da-49ef-a595-a40e717c6eac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144067) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:13:11.385500 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f651a61-06da-49ef-a595-a40e717c6eac None admin] REQUEST_METHOD: `GET` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:13:11.385782 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f651a61-06da-49ef-a595-a40e717c6eac None admin] SCRIPT_NAME: `/identity` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:13:11.386057 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f651a61-06da-49ef-a595-a40e717c6eac None admin] PATH_INFO: `/v3/role_assignments` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:13:11.386864 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f651a61-06da-49ef-a595-a40e717c6eac None admin] RBAC: Adding query filter params (role.id=7e9c2306137042cf8b8eba284656ef33, scope.project.id=bdc83bde204a42df9eea2d927be64bd3, user.id=3dcff3008c734a3f95a0a7b56c369059) {{(pid=144067) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:13:11.387178 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f651a61-06da-49ef-a595-a40e717c6eac None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:13:11.388649 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f651a61-06da-49ef-a595-a40e717c6eac None admin] RBAC: Authorization granted {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:13:11.394777 dv-cinder-851351-1-smb devstack@keystone.service[144067]: [pid: 144067|app: 0|req: 560/1130] 10.222.0.42 () {56 vars in 1374 bytes} [Thu Jul 28 08:13:11 2022] GET /identity/v3/role_assignments?user.id=3dcff3008c734a3f95a0a7b56c369059&scope.project.id=bdc83bde204a42df9eea2d927be64bd3&role.id=7e9c2306137042cf8b8eba284656ef33 => generated 608 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:13:13.418288 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5bd335-6cff-4c51-ac23-5e9e04524c28 None None] REQUEST_METHOD: `GET` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:13:13.418881 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5bd335-6cff-4c51-ac23-5e9e04524c28 None None] SCRIPT_NAME: `/identity` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:13:13.418881 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5bd335-6cff-4c51-ac23-5e9e04524c28 None None] PATH_INFO: `/` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:13:13.420194 dv-cinder-851351-1-smb devstack@keystone.service[144068]: [pid: 144068|app: 0|req: 571/1131] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 08:13:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 08:13:13.425758 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f291bc7e-ed64-40c4-9e9d-27a646d02932 None None] REQUEST_METHOD: `POST` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:13:13.426197 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f291bc7e-ed64-40c4-9e9d-27a646d02932 None None] SCRIPT_NAME: `/identity` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:13:13.426303 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f291bc7e-ed64-40c4-9e9d-27a646d02932 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:13:13.445028 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.auth.core [None req-f291bc7e-ed64-40c4-9e9d-27a646d02932 None None] MFA Rules not processed for user `bf5ceb8f07374635ad506b7d1b4f1612`. Rule list: `[]` (Enabled: `True`). {{(pid=144067) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 08:13:13.446239 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.fernet_utils [None req-f291bc7e-ed64-40c4-9e9d-27a646d02932 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=144067) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:13:13.489802 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG dbcounter [-] [144067] Writing DB stats keystone:SELECT=100 {{(pid=144067) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:13:13.521147 dv-cinder-851351-1-smb devstack@keystone.service[144067]: [pid: 144067|app: 0|req: 561/1132] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 08:13:13 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 08:13:13.544905 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5bd335-6cff-4c51-ac23-5e9e04524c28 None None] Authenticating user token {{(pid=144068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:13:13.647454 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG dbcounter [-] [144068] Writing DB stats keystone:SELECT=100 {{(pid=144068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:13:13.652278 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5bd335-6cff-4c51-ac23-5e9e04524c28 None None] Validating token access rules against request {{(pid=144068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:13:13.687225 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7bb0934-0812-4d91-8d6a-47a913b7b51a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:13:13.687875 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7bb0934-0812-4d91-8d6a-47a913b7b51a None admin] REQUEST_METHOD: `GET` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:13:13.688160 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7bb0934-0812-4d91-8d6a-47a913b7b51a None admin] SCRIPT_NAME: `/identity` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:13:13.688431 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7bb0934-0812-4d91-8d6a-47a913b7b51a None admin] PATH_INFO: `/v3/domains/default` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:13:13.689678 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7bb0934-0812-4d91-8d6a-47a913b7b51a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:13:13.691155 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7bb0934-0812-4d91-8d6a-47a913b7b51a None admin] RBAC: Authorization granted {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:13:13.692808 dv-cinder-851351-1-smb devstack@keystone.service[144068]: [pid: 144068|app: 0|req: 572/1133] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 08:13:13 2022] GET /identity/v3/domains/default => generated 199 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:13:13.699504 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f291bc7e-ed64-40c4-9e9d-27a646d02932 None None] Authenticating user token {{(pid=144067) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:13:13.802687 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f291bc7e-ed64-40c4-9e9d-27a646d02932 None None] Validating token access rules against request {{(pid=144067) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:13:13.840333 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-113404c9-97fb-46d9-9e46-860dbd093fe9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144067) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:13:13.840987 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113404c9-97fb-46d9-9e46-860dbd093fe9 None admin] REQUEST_METHOD: `POST` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:13:13.841265 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113404c9-97fb-46d9-9e46-860dbd093fe9 None admin] SCRIPT_NAME: `/identity` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:13:13.841540 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113404c9-97fb-46d9-9e46-860dbd093fe9 None admin] PATH_INFO: `/v3/projects` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:13:13.842234 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-113404c9-97fb-46d9-9e46-860dbd093fe9 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:13:13.843696 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-113404c9-97fb-46d9-9e46-860dbd093fe9 None admin] RBAC: Authorization granted {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:13:13.872921 dv-cinder-851351-1-smb devstack@keystone.service[144067]: [pid: 144067|app: 0|req: 562/1134] 10.222.0.42 () {60 vars in 1141 bytes} [Thu Jul 28 08:13:13 2022] POST /identity/v3/projects => generated 311 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 08:13:15.914345 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b0b656-aa56-4a21-84ef-f503b9e74e93 None None] REQUEST_METHOD: `GET` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:13:15.914963 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b0b656-aa56-4a21-84ef-f503b9e74e93 None None] SCRIPT_NAME: `/identity` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:13:15.915211 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b0b656-aa56-4a21-84ef-f503b9e74e93 None None] PATH_INFO: `/` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:13:15.917624 dv-cinder-851351-1-smb devstack@keystone.service[144068]: [pid: 144068|app: 0|req: 573/1135] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 08:13:15 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 08:13:15.923595 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb6bda5-ae4f-44b1-b61d-68f2cf3d7421 None None] REQUEST_METHOD: `POST` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:13:15.924121 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb6bda5-ae4f-44b1-b61d-68f2cf3d7421 None None] SCRIPT_NAME: `/identity` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:13:15.924121 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb6bda5-ae4f-44b1-b61d-68f2cf3d7421 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:13:15.943669 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.auth.core [None req-5bb6bda5-ae4f-44b1-b61d-68f2cf3d7421 None None] MFA Rules not processed for user `bf5ceb8f07374635ad506b7d1b4f1612`. Rule list: `[]` (Enabled: `True`). {{(pid=144067) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 08:13:15.944944 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.fernet_utils [None req-5bb6bda5-ae4f-44b1-b61d-68f2cf3d7421 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=144067) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:13:15.967635 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG dbcounter [-] [144067] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=144067) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:13:16.029711 dv-cinder-851351-1-smb devstack@keystone.service[144067]: [pid: 144067|app: 0|req: 563/1136] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 08:13:15 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 08:13:16.055540 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b0b656-aa56-4a21-84ef-f503b9e74e93 None None] Authenticating user token {{(pid=144068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:13:16.168408 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b0b656-aa56-4a21-84ef-f503b9e74e93 None None] Validating token access rules against request {{(pid=144068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:13:16.208248 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf632bb0-6c0d-40a6-abb1-0a8fc025a49b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:13:16.208961 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf632bb0-6c0d-40a6-abb1-0a8fc025a49b None admin] REQUEST_METHOD: `GET` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:13:16.209247 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf632bb0-6c0d-40a6-abb1-0a8fc025a49b None admin] SCRIPT_NAME: `/identity` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:13:16.209525 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf632bb0-6c0d-40a6-abb1-0a8fc025a49b None admin] PATH_INFO: `/v3/domains/default` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:13:16.210781 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf632bb0-6c0d-40a6-abb1-0a8fc025a49b None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:13:16.212606 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf632bb0-6c0d-40a6-abb1-0a8fc025a49b None admin] RBAC: Authorization granted {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:13:16.214314 dv-cinder-851351-1-smb devstack@keystone.service[144068]: [pid: 144068|app: 0|req: 574/1137] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 08:13:16 2022] GET /identity/v3/domains/default => generated 199 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:13:16.223630 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb6bda5-ae4f-44b1-b61d-68f2cf3d7421 None None] Authenticating user token {{(pid=144067) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:13:16.334685 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb6bda5-ae4f-44b1-b61d-68f2cf3d7421 None None] Validating token access rules against request {{(pid=144067) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:13:16.372780 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c4f296-6220-4827-abac-d6a27b8a748a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144067) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:13:16.373477 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c4f296-6220-4827-abac-d6a27b8a748a None admin] REQUEST_METHOD: `POST` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:13:16.373804 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c4f296-6220-4827-abac-d6a27b8a748a None admin] SCRIPT_NAME: `/identity` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:13:16.374130 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c4f296-6220-4827-abac-d6a27b8a748a None admin] PATH_INFO: `/v3/users` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:13:16.374890 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45c4f296-6220-4827-abac-d6a27b8a748a None admin] RBAC: Authorizing `identity:create_user()` {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:13:16.376423 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45c4f296-6220-4827-abac-d6a27b8a748a None admin] RBAC: Authorization granted {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:13:16.402826 dv-cinder-851351-1-smb devstack@keystone.service[144067]: [pid: 144067|app: 0|req: 564/1138] 10.222.0.42 () {60 vars in 1132 bytes} [Thu Jul 28 08:13:16 2022] POST /identity/v3/users => generated 286 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 08:13:18.483308 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df05c9a-8d1e-4590-814f-9ce8087865cd None None] REQUEST_METHOD: `GET` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:13:18.483888 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df05c9a-8d1e-4590-814f-9ce8087865cd None None] SCRIPT_NAME: `/identity` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:13:18.483888 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df05c9a-8d1e-4590-814f-9ce8087865cd None None] PATH_INFO: `/` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:13:18.485229 dv-cinder-851351-1-smb devstack@keystone.service[144068]: [pid: 144068|app: 0|req: 575/1139] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 08:13:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 28 08:13:18.491040 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bcfae29-4bed-46fa-9616-f43e9e2d87bb None None] REQUEST_METHOD: `POST` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:13:18.491554 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bcfae29-4bed-46fa-9616-f43e9e2d87bb None None] SCRIPT_NAME: `/identity` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:13:18.491689 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bcfae29-4bed-46fa-9616-f43e9e2d87bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:13:18.512759 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.auth.core [None req-8bcfae29-4bed-46fa-9616-f43e9e2d87bb None None] MFA Rules not processed for user `bf5ceb8f07374635ad506b7d1b4f1612`. Rule list: `[]` (Enabled: `True`). {{(pid=144067) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 08:13:18.514017 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.fernet_utils [None req-8bcfae29-4bed-46fa-9616-f43e9e2d87bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=144067) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:13:18.527295 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG dbcounter [-] [144067] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=144067) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:13:18.604048 dv-cinder-851351-1-smb devstack@keystone.service[144067]: [pid: 144067|app: 0|req: 565/1140] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 08:13:18 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 08:13:18.628454 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df05c9a-8d1e-4590-814f-9ce8087865cd None None] Authenticating user token {{(pid=144068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:13:18.672697 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG dbcounter [-] [144068] Writing DB stats keystone:SELECT=100 {{(pid=144068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:13:18.748958 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df05c9a-8d1e-4590-814f-9ce8087865cd None None] Validating token access rules against request {{(pid=144068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:13:18.786970 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554dd59a-8502-4428-8908-98010e9e55b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:13:18.787634 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554dd59a-8502-4428-8908-98010e9e55b7 None admin] REQUEST_METHOD: `GET` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:13:18.787916 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554dd59a-8502-4428-8908-98010e9e55b7 None admin] SCRIPT_NAME: `/identity` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:13:18.788196 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554dd59a-8502-4428-8908-98010e9e55b7 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:13:18.799886 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-554dd59a-8502-4428-8908-98010e9e55b7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 08:13:18.804912 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application [None req-554dd59a-8502-4428-8908-98010e9e55b7 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 08:13:18.804912 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:13:18.804912 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:13:18.804912 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:13:18.804912 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:13:18.804912 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:13:18.804912 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:13:18.804912 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:13:18.804912 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:13:18.804912 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:13:18.804912 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:13:18.804912 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:13:18.804912 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 08:13:18.804912 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 08:13:18.804912 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 08:13:18.804912 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 08:13:18.806484 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 08:13:18.806484 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 08:13:18.806484 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 08:13:18.806484 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 08:13:18.806484 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:13:18.806484 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:13:18.806484 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:13:18.806484 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:13:18.806484 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:13:18.806484 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:13:18.806484 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:13:18.806484 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application with Lock( Jul 28 08:13:18.806484 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:13:18.806484 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:13:18.806484 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:13:18.806484 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:13:18.807289 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:13:18.807289 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:13:18.807289 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:13:18.807289 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:13:18.807289 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 08:13:18.807289 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 08:13:18.807289 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 08:13:18.807289 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 08:13:18.807289 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 08:13:18.807289 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 08:13:18.807289 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 08:13:18.807289 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application Jul 28 08:13:18.807289 dv-cinder-851351-1-smb devstack@keystone.service[144068]: [pid: 144068|app: 0|req: 576/1141] 10.222.0.42 () {56 vars in 1096 bytes} [Thu Jul 28 08:13:18 2022] GET /identity/v3/roles/admin => generated 83 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:13:18.813075 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bcfae29-4bed-46fa-9616-f43e9e2d87bb None None] Authenticating user token {{(pid=144067) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:13:18.919932 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bcfae29-4bed-46fa-9616-f43e9e2d87bb None None] Validating token access rules against request {{(pid=144067) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:13:18.956009 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f35dfab2-7320-4ffb-a88a-e04d7eee9b25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144067) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:13:18.956771 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35dfab2-7320-4ffb-a88a-e04d7eee9b25 None admin] REQUEST_METHOD: `GET` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:13:18.957038 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35dfab2-7320-4ffb-a88a-e04d7eee9b25 None admin] SCRIPT_NAME: `/identity` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:13:18.957316 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35dfab2-7320-4ffb-a88a-e04d7eee9b25 None admin] PATH_INFO: `/v3/roles` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:13:18.958226 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f35dfab2-7320-4ffb-a88a-e04d7eee9b25 None admin] RBAC: Adding query filter params (name=admin) {{(pid=144067) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:13:18.958656 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f35dfab2-7320-4ffb-a88a-e04d7eee9b25 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:13:18.960103 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f35dfab2-7320-4ffb-a88a-e04d7eee9b25 None admin] RBAC: Authorization granted {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:13:18.972072 dv-cinder-851351-1-smb devstack@keystone.service[144067]: [pid: 144067|app: 0|req: 566/1142] 10.222.0.42 () {56 vars in 1099 bytes} [Thu Jul 28 08:13:18 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:13:18.978231 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554dd59a-8502-4428-8908-98010e9e55b7 None admin] Authenticating user token {{(pid=144068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:13:19.092646 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG dbcounter [-] [144068] Writing DB stats keystone:SELECT=100 {{(pid=144068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:13:19.099191 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554dd59a-8502-4428-8908-98010e9e55b7 None admin] Validating token access rules against request {{(pid=144068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:13:19.133730 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8f8b4d-acd7-4ceb-9bc3-91e8a2f6a1a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:13:19.134393 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8f8b4d-acd7-4ceb-9bc3-91e8a2f6a1a3 None admin] REQUEST_METHOD: `GET` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:13:19.134662 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8f8b4d-acd7-4ceb-9bc3-91e8a2f6a1a3 None admin] SCRIPT_NAME: `/identity` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:13:19.134936 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8f8b4d-acd7-4ceb-9bc3-91e8a2f6a1a3 None admin] PATH_INFO: `/v3/users/e8c468add28a4889839903cc5abfffcd` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:13:19.149841 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d8f8b4d-acd7-4ceb-9bc3-91e8a2f6a1a3 None admin] RBAC: Authorizing `identity:get_user(user_id=e8c468add28a4889839903cc5abfffcd)` {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:13:19.151320 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d8f8b4d-acd7-4ceb-9bc3-91e8a2f6a1a3 None admin] RBAC: Authorization granted {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:13:19.153115 dv-cinder-851351-1-smb devstack@keystone.service[144068]: [pid: 144068|app: 0|req: 577/1143] 10.222.0.42 () {56 vars in 1177 bytes} [Thu Jul 28 08:13:18 2022] GET /identity/v3/users/e8c468add28a4889839903cc5abfffcd => generated 286 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:13:19.159335 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f35dfab2-7320-4ffb-a88a-e04d7eee9b25 None admin] Authenticating user token {{(pid=144067) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:13:19.163616 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG dbcounter [-] [144067] Writing DB stats keystone:SELECT=100 {{(pid=144067) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:13:19.266629 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f35dfab2-7320-4ffb-a88a-e04d7eee9b25 None admin] Validating token access rules against request {{(pid=144067) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:13:19.306530 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c57b556-cdf1-487e-a7b3-b0e55ce082ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144067) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:13:19.307177 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c57b556-cdf1-487e-a7b3-b0e55ce082ff None admin] REQUEST_METHOD: `GET` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:13:19.307463 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c57b556-cdf1-487e-a7b3-b0e55ce082ff None admin] SCRIPT_NAME: `/identity` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:13:19.307769 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c57b556-cdf1-487e-a7b3-b0e55ce082ff None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:13:19.378534 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c57b556-cdf1-487e-a7b3-b0e55ce082ff None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:13:19.379942 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c57b556-cdf1-487e-a7b3-b0e55ce082ff None admin] RBAC: Authorization granted {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:13:19.382781 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG dbcounter [-] [144067] Writing DB stats keystone:SELECT=100 {{(pid=144067) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:13:19.491046 dv-cinder-851351-1-smb devstack@keystone.service[144067]: [pid: 144067|app: 0|req: 567/1144] 10.222.0.42 () {58 vars in 1282 bytes} [Thu Jul 28 08:13:19 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 28 08:13:19.497238 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8f8b4d-acd7-4ceb-9bc3-91e8a2f6a1a3 None admin] Authenticating user token {{(pid=144068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:13:19.605129 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8f8b4d-acd7-4ceb-9bc3-91e8a2f6a1a3 None admin] Validating token access rules against request {{(pid=144068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:13:19.641989 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c70c20-f963-45fa-bfcb-ab36e9a86d76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:13:19.642560 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c70c20-f963-45fa-bfcb-ab36e9a86d76 None admin] REQUEST_METHOD: `GET` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:13:19.642836 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c70c20-f963-45fa-bfcb-ab36e9a86d76 None admin] SCRIPT_NAME: `/identity` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:13:19.643105 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c70c20-f963-45fa-bfcb-ab36e9a86d76 None admin] PATH_INFO: `/v3/projects/c02ae736ef9048009a900f9735327631` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:13:19.644334 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37c70c20-f963-45fa-bfcb-ab36e9a86d76 None admin] RBAC: Authorizing `identity:get_project(project_id=c02ae736ef9048009a900f9735327631)` {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:13:19.645818 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37c70c20-f963-45fa-bfcb-ab36e9a86d76 None admin] RBAC: Authorization granted {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:13:19.647537 dv-cinder-851351-1-smb devstack@keystone.service[144068]: [pid: 144068|app: 0|req: 578/1145] 10.222.0.42 () {56 vars in 1186 bytes} [Thu Jul 28 08:13:19 2022] GET /identity/v3/projects/c02ae736ef9048009a900f9735327631 => generated 311 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:13:19.653955 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c57b556-cdf1-487e-a7b3-b0e55ce082ff None admin] Authenticating user token {{(pid=144067) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:13:19.777350 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c57b556-cdf1-487e-a7b3-b0e55ce082ff None admin] Validating token access rules against request {{(pid=144067) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:13:19.779815 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG dbcounter [-] [144067] Writing DB stats keystone:SELECT=100 {{(pid=144067) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:13:19.814795 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-798d8eb0-4829-43e9-9873-993e2fe77531 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144067) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:13:19.815457 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798d8eb0-4829-43e9-9873-993e2fe77531 None admin] REQUEST_METHOD: `GET` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:13:19.815737 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798d8eb0-4829-43e9-9873-993e2fe77531 None admin] SCRIPT_NAME: `/identity` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:13:19.816015 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798d8eb0-4829-43e9-9873-993e2fe77531 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:13:19.816859 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-798d8eb0-4829-43e9-9873-993e2fe77531 None admin] RBAC: Adding query filter params (role.id=d1020e7bb0b7411d895ddedd6dc02c5b, scope.project.id=c02ae736ef9048009a900f9735327631, user.id=e8c468add28a4889839903cc5abfffcd) {{(pid=144067) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:13:19.817186 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-798d8eb0-4829-43e9-9873-993e2fe77531 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:13:19.818651 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-798d8eb0-4829-43e9-9873-993e2fe77531 None admin] RBAC: Authorization granted {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:13:19.824575 dv-cinder-851351-1-smb devstack@keystone.service[144067]: [pid: 144067|app: 0|req: 568/1146] 10.222.0.42 () {56 vars in 1374 bytes} [Thu Jul 28 08:13:19 2022] GET /identity/v3/role_assignments?user.id=e8c468add28a4889839903cc5abfffcd&scope.project.id=c02ae736ef9048009a900f9735327631&role.id=d1020e7bb0b7411d895ddedd6dc02c5b => generated 259 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:13:21.884228 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6672f4-ed86-4698-b2d0-5cda491b88b2 None None] REQUEST_METHOD: `GET` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:13:21.884866 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6672f4-ed86-4698-b2d0-5cda491b88b2 None None] SCRIPT_NAME: `/identity` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:13:21.884866 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6672f4-ed86-4698-b2d0-5cda491b88b2 None None] PATH_INFO: `/` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:13:21.886209 dv-cinder-851351-1-smb devstack@keystone.service[144068]: [pid: 144068|app: 0|req: 579/1147] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 08:13:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 08:13:21.894922 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827467ea-0d5d-400f-a5fd-6e99147d4aff None None] REQUEST_METHOD: `POST` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:13:21.895493 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827467ea-0d5d-400f-a5fd-6e99147d4aff None None] SCRIPT_NAME: `/identity` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:13:21.895755 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827467ea-0d5d-400f-a5fd-6e99147d4aff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:13:21.918591 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.auth.core [None req-827467ea-0d5d-400f-a5fd-6e99147d4aff None None] MFA Rules not processed for user `bf5ceb8f07374635ad506b7d1b4f1612`. Rule list: `[]` (Enabled: `True`). {{(pid=144067) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 08:13:21.919844 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.fernet_utils [None req-827467ea-0d5d-400f-a5fd-6e99147d4aff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=144067) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:13:21.999616 dv-cinder-851351-1-smb devstack@keystone.service[144067]: [pid: 144067|app: 0|req: 569/1148] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 08:13:21 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 08:13:22.023551 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6672f4-ed86-4698-b2d0-5cda491b88b2 None None] Authenticating user token {{(pid=144068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:13:22.065234 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG dbcounter [-] [144068] Writing DB stats keystone:SELECT=100 {{(pid=144068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:13:22.152037 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6672f4-ed86-4698-b2d0-5cda491b88b2 None None] Validating token access rules against request {{(pid=144068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:13:22.189913 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04cce932-ee59-4ba4-b216-c000af471b63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:13:22.190586 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04cce932-ee59-4ba4-b216-c000af471b63 None admin] REQUEST_METHOD: `GET` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:13:22.190870 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04cce932-ee59-4ba4-b216-c000af471b63 None admin] SCRIPT_NAME: `/identity` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:13:22.191146 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04cce932-ee59-4ba4-b216-c000af471b63 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:13:22.202112 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04cce932-ee59-4ba4-b216-c000af471b63 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 08:13:22.207191 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application [None req-04cce932-ee59-4ba4-b216-c000af471b63 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 08:13:22.207191 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:13:22.207191 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:13:22.207191 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:13:22.207191 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:13:22.207191 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:13:22.207191 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:13:22.207191 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:13:22.207191 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:13:22.207191 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:13:22.207191 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:13:22.207191 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:13:22.207191 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 08:13:22.207191 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 08:13:22.207191 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 08:13:22.207191 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 08:13:22.208831 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 08:13:22.208831 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 08:13:22.208831 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 08:13:22.208831 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 08:13:22.208831 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:13:22.208831 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:13:22.208831 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:13:22.208831 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:13:22.208831 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:13:22.208831 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:13:22.208831 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:13:22.208831 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application with Lock( Jul 28 08:13:22.208831 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:13:22.208831 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:13:22.208831 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:13:22.208831 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:13:22.209873 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:13:22.209873 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:13:22.209873 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:13:22.209873 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:13:22.209873 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 08:13:22.209873 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 08:13:22.209873 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 08:13:22.209873 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 08:13:22.209873 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 08:13:22.209873 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 08:13:22.209873 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 08:13:22.209873 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application Jul 28 08:13:22.209873 dv-cinder-851351-1-smb devstack@keystone.service[144068]: [pid: 144068|app: 0|req: 580/1149] 10.222.0.42 () {56 vars in 1096 bytes} [Thu Jul 28 08:13:22 2022] GET /identity/v3/roles/admin => generated 83 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:13:22.219397 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-827467ea-0d5d-400f-a5fd-6e99147d4aff None None] Authenticating user token {{(pid=144067) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:13:22.394627 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG dbcounter [-] [144067] Writing DB stats keystone:SELECT=100 {{(pid=144067) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:13:22.401142 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-827467ea-0d5d-400f-a5fd-6e99147d4aff None None] Validating token access rules against request {{(pid=144067) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:13:22.463757 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38309988-5033-43bb-93d1-565849461d9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144067) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:13:22.464799 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38309988-5033-43bb-93d1-565849461d9f None admin] REQUEST_METHOD: `GET` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:13:22.465307 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38309988-5033-43bb-93d1-565849461d9f None admin] SCRIPT_NAME: `/identity` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:13:22.465800 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38309988-5033-43bb-93d1-565849461d9f None admin] PATH_INFO: `/v3/roles` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:13:22.467187 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38309988-5033-43bb-93d1-565849461d9f None admin] RBAC: Adding query filter params (name=admin) {{(pid=144067) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:13:22.467752 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38309988-5033-43bb-93d1-565849461d9f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:13:22.470419 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38309988-5033-43bb-93d1-565849461d9f None admin] RBAC: Authorization granted {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:13:22.487238 dv-cinder-851351-1-smb devstack@keystone.service[144067]: [pid: 144067|app: 0|req: 570/1150] 10.222.0.42 () {56 vars in 1099 bytes} [Thu Jul 28 08:13:22 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:13:22.493713 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04cce932-ee59-4ba4-b216-c000af471b63 None admin] Authenticating user token {{(pid=144068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:13:22.583810 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG dbcounter [-] [144068] Writing DB stats keystone:SELECT=100 {{(pid=144068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:13:22.605030 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04cce932-ee59-4ba4-b216-c000af471b63 None admin] Validating token access rules against request {{(pid=144068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:13:22.642818 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2fc2716-d6d4-46c0-b283-9e30d44c1b8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:13:22.643501 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2fc2716-d6d4-46c0-b283-9e30d44c1b8e None admin] REQUEST_METHOD: `GET` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:13:22.643788 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2fc2716-d6d4-46c0-b283-9e30d44c1b8e None admin] SCRIPT_NAME: `/identity` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:13:22.644071 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2fc2716-d6d4-46c0-b283-9e30d44c1b8e None admin] PATH_INFO: `/v3/users/e8c468add28a4889839903cc5abfffcd` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:13:22.645378 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2fc2716-d6d4-46c0-b283-9e30d44c1b8e None admin] RBAC: Authorizing `identity:get_user(user_id=e8c468add28a4889839903cc5abfffcd)` {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:13:22.646865 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2fc2716-d6d4-46c0-b283-9e30d44c1b8e None admin] RBAC: Authorization granted {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:13:22.648523 dv-cinder-851351-1-smb devstack@keystone.service[144068]: [pid: 144068|app: 0|req: 581/1151] 10.222.0.42 () {56 vars in 1177 bytes} [Thu Jul 28 08:13:22 2022] GET /identity/v3/users/e8c468add28a4889839903cc5abfffcd => generated 286 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:13:22.654962 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38309988-5033-43bb-93d1-565849461d9f None admin] Authenticating user token {{(pid=144067) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:13:22.761831 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38309988-5033-43bb-93d1-565849461d9f None admin] Validating token access rules against request {{(pid=144067) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:13:22.798208 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5136b098-4693-4c01-be5d-e19530518970 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144067) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:13:22.798989 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5136b098-4693-4c01-be5d-e19530518970 None admin] REQUEST_METHOD: `GET` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:13:22.799354 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5136b098-4693-4c01-be5d-e19530518970 None admin] SCRIPT_NAME: `/identity` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:13:22.799716 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5136b098-4693-4c01-be5d-e19530518970 None admin] PATH_INFO: `/v3/projects/c02ae736ef9048009a900f9735327631` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:13:22.801159 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5136b098-4693-4c01-be5d-e19530518970 None admin] RBAC: Authorizing `identity:get_project(project_id=c02ae736ef9048009a900f9735327631)` {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:13:22.802744 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5136b098-4693-4c01-be5d-e19530518970 None admin] RBAC: Authorization granted {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:13:22.804425 dv-cinder-851351-1-smb devstack@keystone.service[144067]: [pid: 144067|app: 0|req: 571/1152] 10.222.0.42 () {56 vars in 1186 bytes} [Thu Jul 28 08:13:22 2022] GET /identity/v3/projects/c02ae736ef9048009a900f9735327631 => generated 311 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:13:22.811049 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2fc2716-d6d4-46c0-b283-9e30d44c1b8e None admin] Authenticating user token {{(pid=144068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:13:22.921557 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2fc2716-d6d4-46c0-b283-9e30d44c1b8e None admin] Validating token access rules against request {{(pid=144068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:13:22.959882 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebca5f6a-4d35-44ed-a664-37e2bc45f2b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:13:22.960587 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebca5f6a-4d35-44ed-a664-37e2bc45f2b9 None admin] REQUEST_METHOD: `PUT` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:13:22.960903 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebca5f6a-4d35-44ed-a664-37e2bc45f2b9 None admin] SCRIPT_NAME: `/identity` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:13:22.961184 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebca5f6a-4d35-44ed-a664-37e2bc45f2b9 None admin] PATH_INFO: `/v3/projects/c02ae736ef9048009a900f9735327631/users/e8c468add28a4889839903cc5abfffcd/roles/d1020e7bb0b7411d895ddedd6dc02c5b` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:13:22.963552 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebca5f6a-4d35-44ed-a664-37e2bc45f2b9 None admin] RBAC: Authorizing `identity:create_grant(project_id=c02ae736ef9048009a900f9735327631, user_id=e8c468add28a4889839903cc5abfffcd, role_id=d1020e7bb0b7411d895ddedd6dc02c5b)` {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:13:22.965097 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebca5f6a-4d35-44ed-a664-37e2bc45f2b9 None admin] RBAC: Authorization granted {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:13:22.984540 dv-cinder-851351-1-smb devstack@keystone.service[144068]: [pid: 144068|app: 0|req: 582/1153] 10.222.0.42 () {58 vars in 1439 bytes} [Thu Jul 28 08:13:22 2022] PUT /identity/v3/projects/c02ae736ef9048009a900f9735327631/users/e8c468add28a4889839903cc5abfffcd/roles/d1020e7bb0b7411d895ddedd6dc02c5b => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 08:13:25.028515 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b16c5a-92b2-45d0-98f2-685223685279 None None] REQUEST_METHOD: `GET` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:13:25.029281 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b16c5a-92b2-45d0-98f2-685223685279 None None] SCRIPT_NAME: `/identity` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:13:25.029281 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b16c5a-92b2-45d0-98f2-685223685279 None None] PATH_INFO: `/` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:13:25.030486 dv-cinder-851351-1-smb devstack@keystone.service[144067]: [pid: 144067|app: 0|req: 572/1154] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 08:13:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 08:13:25.036072 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6e3e89-c6a7-49bb-b075-470d78d1fcdd None None] REQUEST_METHOD: `POST` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:13:25.036556 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6e3e89-c6a7-49bb-b075-470d78d1fcdd None None] SCRIPT_NAME: `/identity` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:13:25.036683 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6e3e89-c6a7-49bb-b075-470d78d1fcdd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:13:25.054926 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.auth.core [None req-4b6e3e89-c6a7-49bb-b075-470d78d1fcdd None None] MFA Rules not processed for user `bf5ceb8f07374635ad506b7d1b4f1612`. Rule list: `[]` (Enabled: `True`). {{(pid=144068) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 08:13:25.056153 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.fernet_utils [None req-4b6e3e89-c6a7-49bb-b075-470d78d1fcdd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=144068) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:13:25.059207 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG dbcounter [-] [144068] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=144068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:13:25.127642 dv-cinder-851351-1-smb devstack@keystone.service[144068]: [pid: 144068|app: 0|req: 583/1155] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 08:13:25 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 08:13:25.151254 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b16c5a-92b2-45d0-98f2-685223685279 None None] Authenticating user token {{(pid=144067) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:13:25.185039 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG dbcounter [-] [144067] Writing DB stats keystone:SELECT=100 {{(pid=144067) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:13:25.268378 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b16c5a-92b2-45d0-98f2-685223685279 None None] Validating token access rules against request {{(pid=144067) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:13:25.304793 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d8576b-6915-47ed-947c-34ac46c80272 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144067) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:13:25.305459 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d8576b-6915-47ed-947c-34ac46c80272 None admin] REQUEST_METHOD: `GET` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:13:25.305744 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d8576b-6915-47ed-947c-34ac46c80272 None admin] SCRIPT_NAME: `/identity` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:13:25.306018 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d8576b-6915-47ed-947c-34ac46c80272 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:13:25.318009 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76d8576b-6915-47ed-947c-34ac46c80272 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 08:13:25.323019 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application [None req-76d8576b-6915-47ed-947c-34ac46c80272 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 08:13:25.323019 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:13:25.323019 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:13:25.323019 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:13:25.323019 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:13:25.323019 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:13:25.323019 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:13:25.323019 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:13:25.323019 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:13:25.323019 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:13:25.323019 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:13:25.323019 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:13:25.323019 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 08:13:25.323019 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 08:13:25.323019 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 08:13:25.323019 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 08:13:25.324772 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 08:13:25.324772 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 08:13:25.324772 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 08:13:25.324772 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 08:13:25.324772 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:13:25.324772 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:13:25.324772 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:13:25.324772 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:13:25.324772 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:13:25.324772 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:13:25.324772 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:13:25.324772 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application with Lock( Jul 28 08:13:25.324772 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:13:25.324772 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:13:25.324772 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:13:25.324772 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:13:25.326288 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:13:25.326288 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:13:25.326288 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:13:25.326288 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:13:25.326288 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 08:13:25.326288 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 08:13:25.326288 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 08:13:25.326288 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 08:13:25.326288 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 08:13:25.326288 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 08:13:25.326288 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 08:13:25.326288 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application Jul 28 08:13:25.326288 dv-cinder-851351-1-smb devstack@keystone.service[144067]: [pid: 144067|app: 0|req: 573/1156] 10.222.0.42 () {56 vars in 1096 bytes} [Thu Jul 28 08:13:25 2022] GET /identity/v3/roles/admin => generated 83 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:13:25.331872 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6e3e89-c6a7-49bb-b075-470d78d1fcdd None None] Authenticating user token {{(pid=144068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:13:25.434901 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6e3e89-c6a7-49bb-b075-470d78d1fcdd None None] Validating token access rules against request {{(pid=144068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:13:25.472560 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263dc925-e6e6-4eca-8611-253a0bf7c0ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:13:25.473227 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263dc925-e6e6-4eca-8611-253a0bf7c0ee None admin] REQUEST_METHOD: `GET` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:13:25.473510 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263dc925-e6e6-4eca-8611-253a0bf7c0ee None admin] SCRIPT_NAME: `/identity` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:13:25.473780 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263dc925-e6e6-4eca-8611-253a0bf7c0ee None admin] PATH_INFO: `/v3/roles` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:13:25.474511 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-263dc925-e6e6-4eca-8611-253a0bf7c0ee None admin] RBAC: Adding query filter params (name=admin) {{(pid=144068) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:13:25.474820 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-263dc925-e6e6-4eca-8611-253a0bf7c0ee None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:13:25.476221 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-263dc925-e6e6-4eca-8611-253a0bf7c0ee None admin] RBAC: Authorization granted {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:13:25.485033 dv-cinder-851351-1-smb devstack@keystone.service[144068]: [pid: 144068|app: 0|req: 584/1157] 10.222.0.42 () {56 vars in 1099 bytes} [Thu Jul 28 08:13:25 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:13:25.491158 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d8576b-6915-47ed-947c-34ac46c80272 None admin] Authenticating user token {{(pid=144067) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:13:25.610124 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG dbcounter [-] [144067] Writing DB stats keystone:SELECT=100 {{(pid=144067) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:13:25.633881 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d8576b-6915-47ed-947c-34ac46c80272 None admin] Validating token access rules against request {{(pid=144067) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:13:25.704514 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca4c0649-2214-432f-a5b0-7d0d00d63cd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144067) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:13:25.705721 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4c0649-2214-432f-a5b0-7d0d00d63cd0 None admin] REQUEST_METHOD: `GET` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:13:25.706302 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4c0649-2214-432f-a5b0-7d0d00d63cd0 None admin] SCRIPT_NAME: `/identity` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:13:25.706810 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4c0649-2214-432f-a5b0-7d0d00d63cd0 None admin] PATH_INFO: `/v3/users/e8c468add28a4889839903cc5abfffcd` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:13:25.709244 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca4c0649-2214-432f-a5b0-7d0d00d63cd0 None admin] RBAC: Authorizing `identity:get_user(user_id=e8c468add28a4889839903cc5abfffcd)` {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:13:25.712410 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca4c0649-2214-432f-a5b0-7d0d00d63cd0 None admin] RBAC: Authorization granted {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:13:25.715786 dv-cinder-851351-1-smb devstack@keystone.service[144067]: [pid: 144067|app: 0|req: 574/1158] 10.222.0.42 () {56 vars in 1177 bytes} [Thu Jul 28 08:13:25 2022] GET /identity/v3/users/e8c468add28a4889839903cc5abfffcd => generated 286 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:13:25.725365 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263dc925-e6e6-4eca-8611-253a0bf7c0ee None admin] Authenticating user token {{(pid=144068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:13:25.728727 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG dbcounter [-] [144068] Writing DB stats keystone:SELECT=100 {{(pid=144068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:13:25.847688 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263dc925-e6e6-4eca-8611-253a0bf7c0ee None admin] Validating token access rules against request {{(pid=144068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:13:25.887617 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d6f569-9e48-4f56-84d5-7d0b14a0e644 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:13:25.888177 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d6f569-9e48-4f56-84d5-7d0b14a0e644 None admin] REQUEST_METHOD: `GET` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:13:25.888459 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d6f569-9e48-4f56-84d5-7d0b14a0e644 None admin] SCRIPT_NAME: `/identity` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:13:25.888766 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d6f569-9e48-4f56-84d5-7d0b14a0e644 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:13:25.968508 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d6f569-9e48-4f56-84d5-7d0b14a0e644 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:13:25.970187 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d6f569-9e48-4f56-84d5-7d0b14a0e644 None admin] RBAC: Authorization granted {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:13:25.972463 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG dbcounter [-] [144068] Writing DB stats keystone:SELECT=100 {{(pid=144068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:13:26.085472 dv-cinder-851351-1-smb devstack@keystone.service[144068]: [pid: 144068|app: 0|req: 585/1159] 10.222.0.42 () {58 vars in 1282 bytes} [Thu Jul 28 08:13:25 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 361 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 28 08:13:26.095278 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca4c0649-2214-432f-a5b0-7d0d00d63cd0 None admin] Authenticating user token {{(pid=144067) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:13:26.207836 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca4c0649-2214-432f-a5b0-7d0d00d63cd0 None admin] Validating token access rules against request {{(pid=144067) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:13:26.246952 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b31a30-3221-4c8b-8faf-a6ead2354a2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144067) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:13:26.247625 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b31a30-3221-4c8b-8faf-a6ead2354a2c None admin] REQUEST_METHOD: `GET` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:13:26.247917 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b31a30-3221-4c8b-8faf-a6ead2354a2c None admin] SCRIPT_NAME: `/identity` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:13:26.248196 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b31a30-3221-4c8b-8faf-a6ead2354a2c None admin] PATH_INFO: `/v3/projects/c02ae736ef9048009a900f9735327631` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:13:26.249497 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01b31a30-3221-4c8b-8faf-a6ead2354a2c None admin] RBAC: Authorizing `identity:get_project(project_id=c02ae736ef9048009a900f9735327631)` {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:13:26.251032 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01b31a30-3221-4c8b-8faf-a6ead2354a2c None admin] RBAC: Authorization granted {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:13:26.252954 dv-cinder-851351-1-smb devstack@keystone.service[144067]: [pid: 144067|app: 0|req: 575/1160] 10.222.0.42 () {56 vars in 1186 bytes} [Thu Jul 28 08:13:26 2022] GET /identity/v3/projects/c02ae736ef9048009a900f9735327631 => generated 311 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:13:26.263138 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d6f569-9e48-4f56-84d5-7d0b14a0e644 None admin] Authenticating user token {{(pid=144068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:13:26.450675 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d6f569-9e48-4f56-84d5-7d0b14a0e644 None admin] Validating token access rules against request {{(pid=144068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:13:26.453555 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG dbcounter [-] [144068] Writing DB stats keystone:SELECT=100 {{(pid=144068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:13:26.517800 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3f1566-6fbe-453e-82fd-a4150f5e3f02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:13:26.518773 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3f1566-6fbe-453e-82fd-a4150f5e3f02 None admin] REQUEST_METHOD: `GET` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:13:26.519193 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3f1566-6fbe-453e-82fd-a4150f5e3f02 None admin] SCRIPT_NAME: `/identity` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:13:26.519605 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3f1566-6fbe-453e-82fd-a4150f5e3f02 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:13:26.520994 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef3f1566-6fbe-453e-82fd-a4150f5e3f02 None admin] RBAC: Adding query filter params (role.id=d1020e7bb0b7411d895ddedd6dc02c5b, scope.project.id=c02ae736ef9048009a900f9735327631, user.id=e8c468add28a4889839903cc5abfffcd) {{(pid=144068) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:13:26.521403 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef3f1566-6fbe-453e-82fd-a4150f5e3f02 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:13:26.523842 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef3f1566-6fbe-453e-82fd-a4150f5e3f02 None admin] RBAC: Authorization granted {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:13:26.535231 dv-cinder-851351-1-smb devstack@keystone.service[144068]: [pid: 144068|app: 0|req: 586/1161] 10.222.0.42 () {56 vars in 1374 bytes} [Thu Jul 28 08:13:26 2022] GET /identity/v3/role_assignments?user.id=e8c468add28a4889839903cc5abfffcd&scope.project.id=c02ae736ef9048009a900f9735327631&role.id=d1020e7bb0b7411d895ddedd6dc02c5b => generated 608 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:13:28.630257 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ed88cf-f325-4a93-bad7-f360073b8b5d None None] REQUEST_METHOD: `GET` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:13:28.630821 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ed88cf-f325-4a93-bad7-f360073b8b5d None None] SCRIPT_NAME: `/identity` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:13:28.630821 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ed88cf-f325-4a93-bad7-f360073b8b5d None None] PATH_INFO: `/` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:13:28.632209 dv-cinder-851351-1-smb devstack@keystone.service[144067]: [pid: 144067|app: 0|req: 576/1162] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 08:13:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 08:13:28.638590 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4339055c-8fd7-4265-806f-4580ba026525 None None] REQUEST_METHOD: `POST` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:13:28.639174 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4339055c-8fd7-4265-806f-4580ba026525 None None] SCRIPT_NAME: `/identity` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:13:28.639174 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4339055c-8fd7-4265-806f-4580ba026525 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:13:28.659074 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.auth.core [None req-4339055c-8fd7-4265-806f-4580ba026525 None None] MFA Rules not processed for user `bf5ceb8f07374635ad506b7d1b4f1612`. Rule list: `[]` (Enabled: `True`). {{(pid=144068) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 08:13:28.660373 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.fernet_utils [None req-4339055c-8fd7-4265-806f-4580ba026525 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=144068) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:13:28.738714 dv-cinder-851351-1-smb devstack@keystone.service[144068]: [pid: 144068|app: 0|req: 587/1163] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 08:13:28 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 28 08:13:28.761817 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ed88cf-f325-4a93-bad7-f360073b8b5d None None] Authenticating user token {{(pid=144067) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:13:28.791785 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG dbcounter [-] [144067] Writing DB stats keystone:SELECT=100 {{(pid=144067) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:13:28.880078 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ed88cf-f325-4a93-bad7-f360073b8b5d None None] Validating token access rules against request {{(pid=144067) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:13:28.919690 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37dc0f6-bb2e-4793-93e3-f6c14c375e43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144067) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:13:28.920255 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37dc0f6-bb2e-4793-93e3-f6c14c375e43 None admin] REQUEST_METHOD: `GET` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:13:28.920541 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37dc0f6-bb2e-4793-93e3-f6c14c375e43 None admin] SCRIPT_NAME: `/identity` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:13:28.920827 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37dc0f6-bb2e-4793-93e3-f6c14c375e43 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:13:29.002038 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c37dc0f6-bb2e-4793-93e3-f6c14c375e43 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:13:29.003663 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c37dc0f6-bb2e-4793-93e3-f6c14c375e43 None admin] RBAC: Authorization granted {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:13:29.032245 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG dbcounter [-] [144067] Writing DB stats keystone:SELECT=100 {{(pid=144067) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:13:29.118040 dv-cinder-851351-1-smb devstack@keystone.service[144067]: [pid: 144067|app: 0|req: 577/1164] 10.222.0.42 () {58 vars in 1282 bytes} [Thu Jul 28 08:13:28 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 357 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 28 08:13:29.128155 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4339055c-8fd7-4265-806f-4580ba026525 None None] Authenticating user token {{(pid=144068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:13:29.293931 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG dbcounter [-] [144068] Writing DB stats keystone:SELECT=100 {{(pid=144068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:13:29.302100 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4339055c-8fd7-4265-806f-4580ba026525 None None] Validating token access rules against request {{(pid=144068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:13:29.343070 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cebb2eeb-6145-42b3-9592-0d12a8d77424 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:13:29.343802 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cebb2eeb-6145-42b3-9592-0d12a8d77424 None admin] REQUEST_METHOD: `GET` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:13:29.344138 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cebb2eeb-6145-42b3-9592-0d12a8d77424 None admin] SCRIPT_NAME: `/identity` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:13:29.344465 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cebb2eeb-6145-42b3-9592-0d12a8d77424 None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:13:29.352598 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cebb2eeb-6145-42b3-9592-0d12a8d77424 None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:13:29.354178 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cebb2eeb-6145-42b3-9592-0d12a8d77424 None admin] RBAC: Authorization granted {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:13:29.367165 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application [None req-cebb2eeb-6145-42b3-9592-0d12a8d77424 None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Jul 28 08:13:29.367165 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:13:29.367165 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Jul 28 08:13:29.367165 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Jul 28 08:13:29.367165 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 28 08:13:29.367165 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 28 08:13:29.367165 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 28 08:13:29.367165 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 28 08:13:29.367165 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. Jul 28 08:13:29.367165 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application Jul 28 08:13:29.367165 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 28 08:13:29.367165 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application Jul 28 08:13:29.367165 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:13:29.367165 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:13:29.367165 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:13:29.367165 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:13:29.367165 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:13:29.369057 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:13:29.369057 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:13:29.369057 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:13:29.369057 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:13:29.369057 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:13:29.369057 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:13:29.369057 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 08:13:29.369057 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 08:13:29.369057 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 08:13:29.369057 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 08:13:29.369057 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:13:29.369057 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:13:29.369057 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:13:29.369057 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:13:29.369057 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:13:29.369057 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:13:29.370637 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:13:29.370637 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application with Lock( Jul 28 08:13:29.370637 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:13:29.370637 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:13:29.370637 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:13:29.370637 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:13:29.370637 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:13:29.370637 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:13:29.370637 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:13:29.370637 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:13:29.370637 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Jul 28 08:13:29.370637 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 08:13:29.370637 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. Jul 28 08:13:29.370637 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application Jul 28 08:13:29.370637 dv-cinder-851351-1-smb devstack@keystone.service[144068]: [pid: 144068|app: 0|req: 588/1165] 10.222.0.42 () {56 vars in 1117 bytes} [Thu Jul 28 08:13:29 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 242 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:13:29.376333 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37dc0f6-bb2e-4793-93e3-f6c14c375e43 None admin] Authenticating user token {{(pid=144067) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:13:29.490685 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37dc0f6-bb2e-4793-93e3-f6c14c375e43 None admin] Validating token access rules against request {{(pid=144067) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:13:29.517496 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG dbcounter [-] [144067] Writing DB stats keystone:SELECT=100 {{(pid=144067) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:13:29.530064 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab749ab7-eaa0-42e6-b73e-2d6ba78db5db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144067) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:13:29.530712 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab749ab7-eaa0-42e6-b73e-2d6ba78db5db None admin] REQUEST_METHOD: `GET` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:13:29.530994 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab749ab7-eaa0-42e6-b73e-2d6ba78db5db None admin] SCRIPT_NAME: `/identity` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:13:29.531272 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab749ab7-eaa0-42e6-b73e-2d6ba78db5db None admin] PATH_INFO: `/v3/domains` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:13:29.531995 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab749ab7-eaa0-42e6-b73e-2d6ba78db5db None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=144067) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:13:29.532303 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab749ab7-eaa0-42e6-b73e-2d6ba78db5db None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:13:29.533754 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab749ab7-eaa0-42e6-b73e-2d6ba78db5db None admin] RBAC: Authorization granted {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:13:29.542425 dv-cinder-851351-1-smb devstack@keystone.service[144067]: [pid: 144067|app: 0|req: 578/1166] 10.222.0.42 () {56 vars in 1115 bytes} [Thu Jul 28 08:13:29 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:13:31.622134 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2989ee38-f20b-4122-9d0a-5e4696f8dfef None None] REQUEST_METHOD: `GET` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:13:31.622745 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2989ee38-f20b-4122-9d0a-5e4696f8dfef None None] SCRIPT_NAME: `/identity` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:13:31.623079 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2989ee38-f20b-4122-9d0a-5e4696f8dfef None None] PATH_INFO: `/` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:13:31.625769 dv-cinder-851351-1-smb devstack@keystone.service[144068]: [pid: 144068|app: 0|req: 589/1167] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 08:13:31 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 08:13:31.634897 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00463b7f-5a45-4b9c-8b6a-c2830e76ecee None None] REQUEST_METHOD: `POST` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:13:31.635464 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00463b7f-5a45-4b9c-8b6a-c2830e76ecee None None] SCRIPT_NAME: `/identity` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:13:31.635562 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00463b7f-5a45-4b9c-8b6a-c2830e76ecee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:13:31.655819 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.auth.core [None req-00463b7f-5a45-4b9c-8b6a-c2830e76ecee None None] MFA Rules not processed for user `bf5ceb8f07374635ad506b7d1b4f1612`. Rule list: `[]` (Enabled: `True`). {{(pid=144067) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 08:13:31.657119 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.fernet_utils [None req-00463b7f-5a45-4b9c-8b6a-c2830e76ecee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=144067) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:13:31.735858 dv-cinder-851351-1-smb devstack@keystone.service[144067]: [pid: 144067|app: 0|req: 579/1168] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 08:13:31 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 08:13:31.759189 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2989ee38-f20b-4122-9d0a-5e4696f8dfef None None] Authenticating user token {{(pid=144068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:13:31.895906 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2989ee38-f20b-4122-9d0a-5e4696f8dfef None None] Validating token access rules against request {{(pid=144068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:13:31.933367 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e6eb8a-8a87-4906-b2e3-5235a3550633 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:13:31.934007 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e6eb8a-8a87-4906-b2e3-5235a3550633 None admin] REQUEST_METHOD: `POST` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:13:31.934288 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e6eb8a-8a87-4906-b2e3-5235a3550633 None admin] SCRIPT_NAME: `/identity` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:13:31.934555 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e6eb8a-8a87-4906-b2e3-5235a3550633 None admin] PATH_INFO: `/v3/domains` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:13:31.935294 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e6eb8a-8a87-4906-b2e3-5235a3550633 None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:13:31.936712 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e6eb8a-8a87-4906-b2e3-5235a3550633 None admin] RBAC: Authorization granted {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:13:31.957002 dv-cinder-851351-1-smb devstack@keystone.service[144068]: [pid: 144068|app: 0|req: 590/1169] 10.222.0.42 () {60 vars in 1138 bytes} [Thu Jul 28 08:13:31 2022] POST /identity/v3/domains => generated 267 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 28 08:13:34.022315 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981f5717-c847-4ce4-99cc-c08d9234a0a5 None None] REQUEST_METHOD: `GET` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:13:34.022888 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981f5717-c847-4ce4-99cc-c08d9234a0a5 None None] SCRIPT_NAME: `/identity` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:13:34.022888 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981f5717-c847-4ce4-99cc-c08d9234a0a5 None None] PATH_INFO: `/` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:13:34.024202 dv-cinder-851351-1-smb devstack@keystone.service[144067]: [pid: 144067|app: 0|req: 580/1170] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 08:13:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 08:13:34.030392 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a6063c-bcf6-4bef-82f1-92543b1dffda None None] REQUEST_METHOD: `POST` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:13:34.031007 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a6063c-bcf6-4bef-82f1-92543b1dffda None None] SCRIPT_NAME: `/identity` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:13:34.031007 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a6063c-bcf6-4bef-82f1-92543b1dffda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:13:34.050589 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.auth.core [None req-38a6063c-bcf6-4bef-82f1-92543b1dffda None None] MFA Rules not processed for user `bf5ceb8f07374635ad506b7d1b4f1612`. Rule list: `[]` (Enabled: `True`). {{(pid=144068) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 08:13:34.051821 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.fernet_utils [None req-38a6063c-bcf6-4bef-82f1-92543b1dffda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=144068) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:13:34.064095 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG dbcounter [-] [144068] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=144068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:13:34.127074 dv-cinder-851351-1-smb devstack@keystone.service[144068]: [pid: 144068|app: 0|req: 591/1171] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 08:13:34 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 08:13:34.150105 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981f5717-c847-4ce4-99cc-c08d9234a0a5 None None] Authenticating user token {{(pid=144067) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:13:34.266543 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981f5717-c847-4ce4-99cc-c08d9234a0a5 None None] Validating token access rules against request {{(pid=144067) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:13:34.287896 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG dbcounter [-] [144067] Writing DB stats keystone:SELECT=100 {{(pid=144067) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:13:34.309055 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c319cca-1bc1-4fb9-b2a7-1a15b9d1d741 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144067) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:13:34.309787 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c319cca-1bc1-4fb9-b2a7-1a15b9d1d741 None admin] REQUEST_METHOD: `GET` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:13:34.310112 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c319cca-1bc1-4fb9-b2a7-1a15b9d1d741 None admin] SCRIPT_NAME: `/identity` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:13:34.310435 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c319cca-1bc1-4fb9-b2a7-1a15b9d1d741 None admin] PATH_INFO: `/v3/domains/452d52f5919042e0b01c7ffb64ff1137` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:13:34.323259 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c319cca-1bc1-4fb9-b2a7-1a15b9d1d741 None admin] RBAC: Authorizing `identity:get_domain(domain_id=452d52f5919042e0b01c7ffb64ff1137)` {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:13:34.324875 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c319cca-1bc1-4fb9-b2a7-1a15b9d1d741 None admin] RBAC: Authorization granted {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:13:34.326699 dv-cinder-851351-1-smb devstack@keystone.service[144067]: [pid: 144067|app: 0|req: 581/1172] 10.222.0.42 () {56 vars in 1183 bytes} [Thu Jul 28 08:13:34 2022] GET /identity/v3/domains/452d52f5919042e0b01c7ffb64ff1137 => generated 267 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:13:34.333453 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a6063c-bcf6-4bef-82f1-92543b1dffda None None] Authenticating user token {{(pid=144068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:13:34.468054 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a6063c-bcf6-4bef-82f1-92543b1dffda None None] Validating token access rules against request {{(pid=144068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:13:34.508114 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b0dfa2-5d2c-42a6-bd07-ef4afc04aa62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:13:34.508794 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b0dfa2-5d2c-42a6-bd07-ef4afc04aa62 None admin] REQUEST_METHOD: `POST` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:13:34.509083 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b0dfa2-5d2c-42a6-bd07-ef4afc04aa62 None admin] SCRIPT_NAME: `/identity` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:13:34.509363 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b0dfa2-5d2c-42a6-bd07-ef4afc04aa62 None admin] PATH_INFO: `/v3/projects` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:13:34.510095 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1b0dfa2-5d2c-42a6-bd07-ef4afc04aa62 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:13:34.511631 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1b0dfa2-5d2c-42a6-bd07-ef4afc04aa62 None admin] RBAC: Authorization granted {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:13:34.537122 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG dbcounter [-] [144068] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=144068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:13:34.547382 dv-cinder-851351-1-smb devstack@keystone.service[144068]: [pid: 144068|app: 0|req: 592/1173] 10.222.0.42 () {60 vars in 1141 bytes} [Thu Jul 28 08:13:34 2022] POST /identity/v3/projects => generated 361 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 08:13:36.686724 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76caf98c-81f1-45d2-9d68-93717adc4e22 None None] REQUEST_METHOD: `GET` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:13:36.687308 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76caf98c-81f1-45d2-9d68-93717adc4e22 None None] SCRIPT_NAME: `/identity` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:13:36.687308 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76caf98c-81f1-45d2-9d68-93717adc4e22 None None] PATH_INFO: `/` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:13:36.688860 dv-cinder-851351-1-smb devstack@keystone.service[144067]: [pid: 144067|app: 0|req: 582/1174] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 08:13:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 08:13:36.695004 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a9ae55-b6f1-40ef-9933-28bf3dca4669 None None] REQUEST_METHOD: `POST` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:13:36.695605 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a9ae55-b6f1-40ef-9933-28bf3dca4669 None None] SCRIPT_NAME: `/identity` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:13:36.695605 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a9ae55-b6f1-40ef-9933-28bf3dca4669 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:13:36.716090 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.auth.core [None req-76a9ae55-b6f1-40ef-9933-28bf3dca4669 None None] MFA Rules not processed for user `bf5ceb8f07374635ad506b7d1b4f1612`. Rule list: `[]` (Enabled: `True`). {{(pid=144068) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 08:13:36.717384 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.fernet_utils [None req-76a9ae55-b6f1-40ef-9933-28bf3dca4669 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=144068) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:13:36.799101 dv-cinder-851351-1-smb devstack@keystone.service[144068]: [pid: 144068|app: 0|req: 593/1175] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 08:13:36 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 08:13:36.824650 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76caf98c-81f1-45d2-9d68-93717adc4e22 None None] Authenticating user token {{(pid=144067) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:13:36.947009 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76caf98c-81f1-45d2-9d68-93717adc4e22 None None] Validating token access rules against request {{(pid=144067) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:13:36.988578 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e694d4d-34b1-4fa9-b7f2-280588ec9572 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144067) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:13:36.989307 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e694d4d-34b1-4fa9-b7f2-280588ec9572 None admin] REQUEST_METHOD: `GET` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:13:36.989596 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e694d4d-34b1-4fa9-b7f2-280588ec9572 None admin] SCRIPT_NAME: `/identity` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:13:36.989879 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e694d4d-34b1-4fa9-b7f2-280588ec9572 None admin] PATH_INFO: `/v3/domains/452d52f5919042e0b01c7ffb64ff1137` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:13:36.991247 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e694d4d-34b1-4fa9-b7f2-280588ec9572 None admin] RBAC: Authorizing `identity:get_domain(domain_id=452d52f5919042e0b01c7ffb64ff1137)` {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:13:36.992802 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e694d4d-34b1-4fa9-b7f2-280588ec9572 None admin] RBAC: Authorization granted {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:13:36.994553 dv-cinder-851351-1-smb devstack@keystone.service[144067]: [pid: 144067|app: 0|req: 583/1176] 10.222.0.42 () {56 vars in 1183 bytes} [Thu Jul 28 08:13:36 2022] GET /identity/v3/domains/452d52f5919042e0b01c7ffb64ff1137 => generated 267 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:13:37.003562 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a9ae55-b6f1-40ef-9933-28bf3dca4669 None None] Authenticating user token {{(pid=144068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:13:37.111609 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a9ae55-b6f1-40ef-9933-28bf3dca4669 None None] Validating token access rules against request {{(pid=144068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:13:37.141035 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG dbcounter [-] [144068] Writing DB stats keystone:SELECT=100 {{(pid=144068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:13:37.151199 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15514a78-630f-4055-9a36-07048c4e3a2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:13:37.151905 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15514a78-630f-4055-9a36-07048c4e3a2e None admin] REQUEST_METHOD: `POST` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:13:37.152235 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15514a78-630f-4055-9a36-07048c4e3a2e None admin] SCRIPT_NAME: `/identity` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:13:37.152557 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15514a78-630f-4055-9a36-07048c4e3a2e None admin] PATH_INFO: `/v3/users` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:13:37.153377 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15514a78-630f-4055-9a36-07048c4e3a2e None admin] RBAC: Authorizing `identity:create_user()` {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:13:37.154893 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15514a78-630f-4055-9a36-07048c4e3a2e None admin] RBAC: Authorization granted {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:13:37.180124 dv-cinder-851351-1-smb devstack@keystone.service[144068]: [pid: 144068|app: 0|req: 594/1177] 10.222.0.42 () {60 vars in 1132 bytes} [Thu Jul 28 08:13:37 2022] POST /identity/v3/users => generated 311 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 08:13:39.300495 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc85132-bf8f-4315-9232-440f744e88d7 None None] REQUEST_METHOD: `GET` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:13:39.301072 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc85132-bf8f-4315-9232-440f744e88d7 None None] SCRIPT_NAME: `/identity` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:13:39.301072 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc85132-bf8f-4315-9232-440f744e88d7 None None] PATH_INFO: `/` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:13:39.302579 dv-cinder-851351-1-smb devstack@keystone.service[144067]: [pid: 144067|app: 0|req: 584/1178] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 08:13:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 08:13:39.308484 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7908f6-e303-40a5-8c4f-05567626a9a7 None None] REQUEST_METHOD: `POST` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:13:39.309049 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7908f6-e303-40a5-8c4f-05567626a9a7 None None] SCRIPT_NAME: `/identity` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:13:39.309182 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7908f6-e303-40a5-8c4f-05567626a9a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:13:39.329142 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.auth.core [None req-bb7908f6-e303-40a5-8c4f-05567626a9a7 None None] MFA Rules not processed for user `bf5ceb8f07374635ad506b7d1b4f1612`. Rule list: `[]` (Enabled: `True`). {{(pid=144068) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 08:13:39.330457 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.fernet_utils [None req-bb7908f6-e303-40a5-8c4f-05567626a9a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=144068) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:13:39.409408 dv-cinder-851351-1-smb devstack@keystone.service[144068]: [pid: 144068|app: 0|req: 595/1179] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 08:13:39 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 08:13:39.433311 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc85132-bf8f-4315-9232-440f744e88d7 None None] Authenticating user token {{(pid=144067) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:13:39.489249 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG dbcounter [-] [144067] Writing DB stats keystone:SELECT=100 {{(pid=144067) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:13:39.551961 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc85132-bf8f-4315-9232-440f744e88d7 None None] Validating token access rules against request {{(pid=144067) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:13:39.594395 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7709f56c-76e6-4b91-9d0b-e122c52e8e3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144067) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:13:39.595144 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7709f56c-76e6-4b91-9d0b-e122c52e8e3c None admin] REQUEST_METHOD: `GET` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:13:39.595474 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7709f56c-76e6-4b91-9d0b-e122c52e8e3c None admin] SCRIPT_NAME: `/identity` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:13:39.595850 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7709f56c-76e6-4b91-9d0b-e122c52e8e3c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:13:39.608527 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7709f56c-76e6-4b91-9d0b-e122c52e8e3c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 08:13:39.613639 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application [None req-7709f56c-76e6-4b91-9d0b-e122c52e8e3c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 08:13:39.613639 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:13:39.613639 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:13:39.613639 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:13:39.613639 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:13:39.613639 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:13:39.613639 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:13:39.613639 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:13:39.613639 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:13:39.613639 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:13:39.613639 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:13:39.613639 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:13:39.613639 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 08:13:39.613639 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 08:13:39.613639 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 08:13:39.613639 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 08:13:39.615263 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 08:13:39.615263 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 08:13:39.615263 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 08:13:39.615263 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 08:13:39.615263 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:13:39.615263 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:13:39.615263 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:13:39.615263 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:13:39.615263 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:13:39.615263 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:13:39.615263 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:13:39.615263 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application with Lock( Jul 28 08:13:39.615263 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:13:39.615263 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:13:39.615263 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:13:39.615263 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:13:39.616914 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:13:39.616914 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:13:39.616914 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:13:39.616914 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:13:39.616914 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 08:13:39.616914 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 08:13:39.616914 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 08:13:39.616914 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 08:13:39.616914 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 08:13:39.616914 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 08:13:39.616914 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 08:13:39.616914 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application Jul 28 08:13:39.616914 dv-cinder-851351-1-smb devstack@keystone.service[144067]: [pid: 144067|app: 0|req: 585/1180] 10.222.0.42 () {56 vars in 1096 bytes} [Thu Jul 28 08:13:39 2022] GET /identity/v3/roles/admin => generated 83 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:13:39.622553 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb7908f6-e303-40a5-8c4f-05567626a9a7 None None] Authenticating user token {{(pid=144068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:13:39.729010 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb7908f6-e303-40a5-8c4f-05567626a9a7 None None] Validating token access rules against request {{(pid=144068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:13:39.745807 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG dbcounter [-] [144068] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=144068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:13:39.770559 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a88533d-9934-4bad-988f-c856493bcfd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:13:39.771296 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a88533d-9934-4bad-988f-c856493bcfd0 None admin] REQUEST_METHOD: `GET` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:13:39.771612 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a88533d-9934-4bad-988f-c856493bcfd0 None admin] SCRIPT_NAME: `/identity` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:13:39.771936 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a88533d-9934-4bad-988f-c856493bcfd0 None admin] PATH_INFO: `/v3/roles` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:13:39.772715 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a88533d-9934-4bad-988f-c856493bcfd0 None admin] RBAC: Adding query filter params (name=admin) {{(pid=144068) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:13:39.773087 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a88533d-9934-4bad-988f-c856493bcfd0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:13:39.774517 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a88533d-9934-4bad-988f-c856493bcfd0 None admin] RBAC: Authorization granted {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:13:39.783658 dv-cinder-851351-1-smb devstack@keystone.service[144068]: [pid: 144068|app: 0|req: 596/1181] 10.222.0.42 () {56 vars in 1099 bytes} [Thu Jul 28 08:13:39 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:13:39.790018 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7709f56c-76e6-4b91-9d0b-e122c52e8e3c None admin] Authenticating user token {{(pid=144067) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:13:39.908988 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7709f56c-76e6-4b91-9d0b-e122c52e8e3c None admin] Validating token access rules against request {{(pid=144067) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:13:39.916928 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG dbcounter [-] [144067] Writing DB stats keystone:SELECT=100 {{(pid=144067) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:13:39.949178 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4caf5ba5-6262-486d-8b30-561c17efb1c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144067) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:13:39.949848 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4caf5ba5-6262-486d-8b30-561c17efb1c7 None admin] REQUEST_METHOD: `GET` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:13:39.950137 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4caf5ba5-6262-486d-8b30-561c17efb1c7 None admin] SCRIPT_NAME: `/identity` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:13:39.950423 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4caf5ba5-6262-486d-8b30-561c17efb1c7 None admin] PATH_INFO: `/v3/users/bf2f5b5d93e7430d8472a259167ace9f` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:13:39.965966 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4caf5ba5-6262-486d-8b30-561c17efb1c7 None admin] RBAC: Authorizing `identity:get_user(user_id=bf2f5b5d93e7430d8472a259167ace9f)` {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:13:39.967474 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4caf5ba5-6262-486d-8b30-561c17efb1c7 None admin] RBAC: Authorization granted {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:13:39.969274 dv-cinder-851351-1-smb devstack@keystone.service[144067]: [pid: 144067|app: 0|req: 586/1182] 10.222.0.42 () {56 vars in 1177 bytes} [Thu Jul 28 08:13:39 2022] GET /identity/v3/users/bf2f5b5d93e7430d8472a259167ace9f => generated 311 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:13:39.975503 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a88533d-9934-4bad-988f-c856493bcfd0 None admin] Authenticating user token {{(pid=144068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:13:40.082550 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a88533d-9934-4bad-988f-c856493bcfd0 None admin] Validating token access rules against request {{(pid=144068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:13:40.122592 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ff6ed6-5483-46de-92b4-33aed51ad703 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:13:40.123228 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ff6ed6-5483-46de-92b4-33aed51ad703 None admin] REQUEST_METHOD: `GET` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:13:40.123510 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ff6ed6-5483-46de-92b4-33aed51ad703 None admin] SCRIPT_NAME: `/identity` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:13:40.123791 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ff6ed6-5483-46de-92b4-33aed51ad703 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:13:40.174638 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG dbcounter [-] [144068] Writing DB stats keystone:SELECT=100 {{(pid=144068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:13:40.203233 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26ff6ed6-5483-46de-92b4-33aed51ad703 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:13:40.204885 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26ff6ed6-5483-46de-92b4-33aed51ad703 None admin] RBAC: Authorization granted {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:13:40.318228 dv-cinder-851351-1-smb devstack@keystone.service[144068]: [pid: 144068|app: 0|req: 597/1183] 10.222.0.42 () {58 vars in 1282 bytes} [Thu Jul 28 08:13:39 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 343 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jul 28 08:13:40.326303 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4caf5ba5-6262-486d-8b30-561c17efb1c7 None admin] Authenticating user token {{(pid=144067) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:13:40.448001 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4caf5ba5-6262-486d-8b30-561c17efb1c7 None admin] Validating token access rules against request {{(pid=144067) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:13:40.488297 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e24c92ef-9306-4f60-a8e9-4e116988fe1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144067) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:13:40.488993 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24c92ef-9306-4f60-a8e9-4e116988fe1d None admin] REQUEST_METHOD: `GET` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:13:40.489278 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24c92ef-9306-4f60-a8e9-4e116988fe1d None admin] SCRIPT_NAME: `/identity` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:13:40.489539 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24c92ef-9306-4f60-a8e9-4e116988fe1d None admin] PATH_INFO: `/v3/projects/1622752c850d4745a934d9193109796c` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:13:40.490799 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e24c92ef-9306-4f60-a8e9-4e116988fe1d None admin] RBAC: Authorizing `identity:get_project(project_id=1622752c850d4745a934d9193109796c)` {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:13:40.492273 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e24c92ef-9306-4f60-a8e9-4e116988fe1d None admin] RBAC: Authorization granted {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:13:40.494018 dv-cinder-851351-1-smb devstack@keystone.service[144067]: [pid: 144067|app: 0|req: 587/1184] 10.222.0.42 () {56 vars in 1186 bytes} [Thu Jul 28 08:13:40 2022] GET /identity/v3/projects/1622752c850d4745a934d9193109796c => generated 361 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:13:40.504842 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ff6ed6-5483-46de-92b4-33aed51ad703 None admin] Authenticating user token {{(pid=144068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:13:40.635281 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG dbcounter [-] [144068] Writing DB stats keystone:SELECT=100 {{(pid=144068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:13:40.662212 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ff6ed6-5483-46de-92b4-33aed51ad703 None admin] Validating token access rules against request {{(pid=144068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:13:40.701708 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe71c799-05d1-4f5a-9daa-12487f9ca41e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:13:40.702263 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe71c799-05d1-4f5a-9daa-12487f9ca41e None admin] REQUEST_METHOD: `GET` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:13:40.702543 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe71c799-05d1-4f5a-9daa-12487f9ca41e None admin] SCRIPT_NAME: `/identity` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:13:40.702811 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe71c799-05d1-4f5a-9daa-12487f9ca41e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:13:40.703632 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe71c799-05d1-4f5a-9daa-12487f9ca41e None admin] RBAC: Adding query filter params (role.id=d1020e7bb0b7411d895ddedd6dc02c5b, scope.project.id=1622752c850d4745a934d9193109796c, user.id=bf2f5b5d93e7430d8472a259167ace9f) {{(pid=144068) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:13:40.703959 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe71c799-05d1-4f5a-9daa-12487f9ca41e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:13:40.705554 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe71c799-05d1-4f5a-9daa-12487f9ca41e None admin] RBAC: Authorization granted {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:13:40.713020 dv-cinder-851351-1-smb devstack@keystone.service[144068]: [pid: 144068|app: 0|req: 598/1185] 10.222.0.42 () {56 vars in 1374 bytes} [Thu Jul 28 08:13:40 2022] GET /identity/v3/role_assignments?user.id=bf2f5b5d93e7430d8472a259167ace9f&scope.project.id=1622752c850d4745a934d9193109796c&role.id=d1020e7bb0b7411d895ddedd6dc02c5b => generated 259 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:13:42.778249 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5b66fd-bd92-40a2-9c1d-0a219673d8ed None None] REQUEST_METHOD: `GET` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:13:42.778814 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5b66fd-bd92-40a2-9c1d-0a219673d8ed None None] SCRIPT_NAME: `/identity` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:13:42.778974 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5b66fd-bd92-40a2-9c1d-0a219673d8ed None None] PATH_INFO: `/` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:13:42.780326 dv-cinder-851351-1-smb devstack@keystone.service[144067]: [pid: 144067|app: 0|req: 588/1186] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 08:13:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 08:13:42.786587 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a76b4d-fecc-48bb-acdc-761cc83cf769 None None] REQUEST_METHOD: `POST` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:13:42.787142 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a76b4d-fecc-48bb-acdc-761cc83cf769 None None] SCRIPT_NAME: `/identity` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:13:42.787250 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a76b4d-fecc-48bb-acdc-761cc83cf769 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:13:42.807211 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.auth.core [None req-99a76b4d-fecc-48bb-acdc-761cc83cf769 None None] MFA Rules not processed for user `bf5ceb8f07374635ad506b7d1b4f1612`. Rule list: `[]` (Enabled: `True`). {{(pid=144068) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 08:13:42.808447 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.fernet_utils [None req-99a76b4d-fecc-48bb-acdc-761cc83cf769 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=144068) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:13:42.886000 dv-cinder-851351-1-smb devstack@keystone.service[144068]: [pid: 144068|app: 0|req: 599/1187] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 08:13:42 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 08:13:42.908808 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce5b66fd-bd92-40a2-9c1d-0a219673d8ed None None] Authenticating user token {{(pid=144067) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:13:42.943130 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG dbcounter [-] [144067] Writing DB stats keystone:SELECT=100 {{(pid=144067) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:13:43.031948 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce5b66fd-bd92-40a2-9c1d-0a219673d8ed None None] Validating token access rules against request {{(pid=144067) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:13:43.072332 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b247172c-8114-4d72-ba65-8e56c29496e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144067) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:13:43.073290 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b247172c-8114-4d72-ba65-8e56c29496e3 None admin] REQUEST_METHOD: `GET` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:13:43.073689 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b247172c-8114-4d72-ba65-8e56c29496e3 None admin] SCRIPT_NAME: `/identity` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:13:43.074087 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b247172c-8114-4d72-ba65-8e56c29496e3 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:13:43.088544 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b247172c-8114-4d72-ba65-8e56c29496e3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 08:13:43.094536 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application [None req-b247172c-8114-4d72-ba65-8e56c29496e3 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 08:13:43.094536 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:13:43.094536 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:13:43.094536 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:13:43.094536 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:13:43.094536 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:13:43.094536 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:13:43.094536 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:13:43.094536 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:13:43.094536 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:13:43.094536 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:13:43.094536 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:13:43.094536 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 08:13:43.094536 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 08:13:43.094536 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 08:13:43.094536 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 08:13:43.096344 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 08:13:43.096344 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 08:13:43.096344 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 08:13:43.096344 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 08:13:43.096344 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:13:43.096344 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:13:43.096344 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:13:43.096344 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:13:43.096344 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:13:43.096344 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:13:43.096344 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:13:43.096344 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application with Lock( Jul 28 08:13:43.096344 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:13:43.096344 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:13:43.096344 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:13:43.096344 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:13:43.098172 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:13:43.098172 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:13:43.098172 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:13:43.098172 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:13:43.098172 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 08:13:43.098172 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 08:13:43.098172 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 08:13:43.098172 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 08:13:43.098172 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 08:13:43.098172 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 08:13:43.098172 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 08:13:43.098172 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application Jul 28 08:13:43.098172 dv-cinder-851351-1-smb devstack@keystone.service[144067]: [pid: 144067|app: 0|req: 589/1188] 10.222.0.42 () {56 vars in 1096 bytes} [Thu Jul 28 08:13:42 2022] GET /identity/v3/roles/admin => generated 83 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:13:43.104137 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a76b4d-fecc-48bb-acdc-761cc83cf769 None None] Authenticating user token {{(pid=144068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:13:43.181529 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG dbcounter [-] [144068] Writing DB stats keystone:SELECT=100 {{(pid=144068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:13:43.219307 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a76b4d-fecc-48bb-acdc-761cc83cf769 None None] Validating token access rules against request {{(pid=144068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:13:43.260038 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db1b04a-61c9-4372-ad36-7ec3f0817a1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:13:43.260711 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db1b04a-61c9-4372-ad36-7ec3f0817a1c None admin] REQUEST_METHOD: `GET` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:13:43.260994 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db1b04a-61c9-4372-ad36-7ec3f0817a1c None admin] SCRIPT_NAME: `/identity` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:13:43.261271 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db1b04a-61c9-4372-ad36-7ec3f0817a1c None admin] PATH_INFO: `/v3/roles` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:13:43.261999 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db1b04a-61c9-4372-ad36-7ec3f0817a1c None admin] RBAC: Adding query filter params (name=admin) {{(pid=144068) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:13:43.262306 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db1b04a-61c9-4372-ad36-7ec3f0817a1c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:13:43.263714 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db1b04a-61c9-4372-ad36-7ec3f0817a1c None admin] RBAC: Authorization granted {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:13:43.273363 dv-cinder-851351-1-smb devstack@keystone.service[144068]: [pid: 144068|app: 0|req: 600/1189] 10.222.0.42 () {56 vars in 1099 bytes} [Thu Jul 28 08:13:43 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:13:43.279798 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b247172c-8114-4d72-ba65-8e56c29496e3 None admin] Authenticating user token {{(pid=144067) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:13:43.383049 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG dbcounter [-] [144067] Writing DB stats keystone:SELECT=100 {{(pid=144067) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:13:43.393048 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b247172c-8114-4d72-ba65-8e56c29496e3 None admin] Validating token access rules against request {{(pid=144067) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:13:43.433792 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6618f5c7-66a7-4ee5-b625-557ea521c675 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144067) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:13:43.434529 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6618f5c7-66a7-4ee5-b625-557ea521c675 None admin] REQUEST_METHOD: `GET` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:13:43.434858 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6618f5c7-66a7-4ee5-b625-557ea521c675 None admin] SCRIPT_NAME: `/identity` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:13:43.435179 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6618f5c7-66a7-4ee5-b625-557ea521c675 None admin] PATH_INFO: `/v3/users/bf2f5b5d93e7430d8472a259167ace9f` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:13:43.438515 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6618f5c7-66a7-4ee5-b625-557ea521c675 None admin] RBAC: Authorizing `identity:get_user(user_id=bf2f5b5d93e7430d8472a259167ace9f)` {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:13:43.440094 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6618f5c7-66a7-4ee5-b625-557ea521c675 None admin] RBAC: Authorization granted {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:13:43.442653 dv-cinder-851351-1-smb devstack@keystone.service[144067]: [pid: 144067|app: 0|req: 590/1190] 10.222.0.42 () {56 vars in 1177 bytes} [Thu Jul 28 08:13:43 2022] GET /identity/v3/users/bf2f5b5d93e7430d8472a259167ace9f => generated 311 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:13:43.449041 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db1b04a-61c9-4372-ad36-7ec3f0817a1c None admin] Authenticating user token {{(pid=144068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:13:43.594015 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db1b04a-61c9-4372-ad36-7ec3f0817a1c None admin] Validating token access rules against request {{(pid=144068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:13:43.626649 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG dbcounter [-] [144068] Writing DB stats keystone:SELECT=100 {{(pid=144068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:13:43.632709 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-710ec504-2521-4be3-8785-d2119e2d927d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:13:43.633454 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710ec504-2521-4be3-8785-d2119e2d927d None admin] REQUEST_METHOD: `GET` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:13:43.633682 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710ec504-2521-4be3-8785-d2119e2d927d None admin] SCRIPT_NAME: `/identity` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:13:43.633956 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710ec504-2521-4be3-8785-d2119e2d927d None admin] PATH_INFO: `/v3/projects/1622752c850d4745a934d9193109796c` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:13:43.635258 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-710ec504-2521-4be3-8785-d2119e2d927d None admin] RBAC: Authorizing `identity:get_project(project_id=1622752c850d4745a934d9193109796c)` {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:13:43.636772 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-710ec504-2521-4be3-8785-d2119e2d927d None admin] RBAC: Authorization granted {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:13:43.638639 dv-cinder-851351-1-smb devstack@keystone.service[144068]: [pid: 144068|app: 0|req: 601/1191] 10.222.0.42 () {56 vars in 1186 bytes} [Thu Jul 28 08:13:43 2022] GET /identity/v3/projects/1622752c850d4745a934d9193109796c => generated 361 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 08:13:43.645625 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6618f5c7-66a7-4ee5-b625-557ea521c675 None admin] Authenticating user token {{(pid=144067) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:13:43.766671 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6618f5c7-66a7-4ee5-b625-557ea521c675 None admin] Validating token access rules against request {{(pid=144067) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:13:43.806505 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf45f87-58c1-4f76-aaee-fb27ca4b66bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144067) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:13:43.807234 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf45f87-58c1-4f76-aaee-fb27ca4b66bb None admin] REQUEST_METHOD: `PUT` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:13:43.807503 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf45f87-58c1-4f76-aaee-fb27ca4b66bb None admin] SCRIPT_NAME: `/identity` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:13:43.807782 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf45f87-58c1-4f76-aaee-fb27ca4b66bb None admin] PATH_INFO: `/v3/projects/1622752c850d4745a934d9193109796c/users/bf2f5b5d93e7430d8472a259167ace9f/roles/d1020e7bb0b7411d895ddedd6dc02c5b` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:13:43.809892 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf45f87-58c1-4f76-aaee-fb27ca4b66bb None admin] RBAC: Authorizing `identity:create_grant(project_id=1622752c850d4745a934d9193109796c, user_id=bf2f5b5d93e7430d8472a259167ace9f, role_id=d1020e7bb0b7411d895ddedd6dc02c5b)` {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:13:43.811385 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf45f87-58c1-4f76-aaee-fb27ca4b66bb None admin] RBAC: Authorization granted {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:13:43.826739 dv-cinder-851351-1-smb devstack@keystone.service[144067]: [pid: 144067|app: 0|req: 591/1192] 10.222.0.42 () {58 vars in 1439 bytes} [Thu Jul 28 08:13:43 2022] PUT /identity/v3/projects/1622752c850d4745a934d9193109796c/users/bf2f5b5d93e7430d8472a259167ace9f/roles/d1020e7bb0b7411d895ddedd6dc02c5b => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 08:13:45.939842 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4973a8d7-aaf4-4bfb-b508-a407fefaf91b None None] REQUEST_METHOD: `GET` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:13:45.940490 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4973a8d7-aaf4-4bfb-b508-a407fefaf91b None None] SCRIPT_NAME: `/identity` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:13:45.940490 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4973a8d7-aaf4-4bfb-b508-a407fefaf91b None None] PATH_INFO: `/` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:13:45.941795 dv-cinder-851351-1-smb devstack@keystone.service[144068]: [pid: 144068|app: 0|req: 602/1193] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 08:13:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 08:13:45.947604 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda4c697-6b87-4e38-aaa0-af25e5b3ec13 None None] REQUEST_METHOD: `POST` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:13:45.948142 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda4c697-6b87-4e38-aaa0-af25e5b3ec13 None None] SCRIPT_NAME: `/identity` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:13:45.948142 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda4c697-6b87-4e38-aaa0-af25e5b3ec13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:13:45.968371 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.auth.core [None req-eda4c697-6b87-4e38-aaa0-af25e5b3ec13 None None] MFA Rules not processed for user `bf5ceb8f07374635ad506b7d1b4f1612`. Rule list: `[]` (Enabled: `True`). {{(pid=144067) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 08:13:45.969662 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.fernet_utils [None req-eda4c697-6b87-4e38-aaa0-af25e5b3ec13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=144067) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:13:45.986575 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG dbcounter [-] [144067] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=144067) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:13:46.047449 dv-cinder-851351-1-smb devstack@keystone.service[144067]: [pid: 144067|app: 0|req: 592/1194] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 08:13:45 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 08:13:46.070972 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4973a8d7-aaf4-4bfb-b508-a407fefaf91b None None] Authenticating user token {{(pid=144068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:13:46.187478 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4973a8d7-aaf4-4bfb-b508-a407fefaf91b None None] Validating token access rules against request {{(pid=144068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:13:46.227719 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96aa05b8-2058-4051-bc2a-739c53dc3dad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:13:46.228354 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96aa05b8-2058-4051-bc2a-739c53dc3dad None admin] REQUEST_METHOD: `GET` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:13:46.228703 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96aa05b8-2058-4051-bc2a-739c53dc3dad None admin] SCRIPT_NAME: `/identity` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:13:46.229073 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96aa05b8-2058-4051-bc2a-739c53dc3dad None admin] PATH_INFO: `/v3/roles/admin` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:13:46.242596 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96aa05b8-2058-4051-bc2a-739c53dc3dad None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 08:13:46.247782 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application [None req-96aa05b8-2058-4051-bc2a-739c53dc3dad None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 08:13:46.247782 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:13:46.247782 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:13:46.247782 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:13:46.247782 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:13:46.247782 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:13:46.247782 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:13:46.247782 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:13:46.247782 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:13:46.247782 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:13:46.247782 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:13:46.247782 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:13:46.247782 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 08:13:46.247782 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 08:13:46.247782 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 08:13:46.247782 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 08:13:46.249547 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 08:13:46.249547 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 08:13:46.249547 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 08:13:46.249547 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 08:13:46.249547 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:13:46.249547 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:13:46.249547 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:13:46.249547 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:13:46.249547 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:13:46.249547 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:13:46.249547 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:13:46.249547 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application with Lock( Jul 28 08:13:46.249547 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:13:46.249547 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:13:46.249547 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:13:46.249547 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:13:46.251353 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:13:46.251353 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:13:46.251353 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:13:46.251353 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:13:46.251353 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 08:13:46.251353 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 08:13:46.251353 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 08:13:46.251353 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 08:13:46.251353 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 08:13:46.251353 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 08:13:46.251353 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 08:13:46.251353 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application Jul 28 08:13:46.251353 dv-cinder-851351-1-smb devstack@keystone.service[144068]: [pid: 144068|app: 0|req: 603/1195] 10.222.0.42 () {56 vars in 1096 bytes} [Thu Jul 28 08:13:46 2022] GET /identity/v3/roles/admin => generated 83 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:13:46.257166 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda4c697-6b87-4e38-aaa0-af25e5b3ec13 None None] Authenticating user token {{(pid=144067) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:13:46.380776 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda4c697-6b87-4e38-aaa0-af25e5b3ec13 None None] Validating token access rules against request {{(pid=144067) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:13:46.422667 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-865e454b-516c-4d4c-ac22-9f6f473978b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144067) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:13:46.423321 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865e454b-516c-4d4c-ac22-9f6f473978b0 None admin] REQUEST_METHOD: `GET` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:13:46.423595 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865e454b-516c-4d4c-ac22-9f6f473978b0 None admin] SCRIPT_NAME: `/identity` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:13:46.423876 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865e454b-516c-4d4c-ac22-9f6f473978b0 None admin] PATH_INFO: `/v3/roles` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:13:46.424712 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-865e454b-516c-4d4c-ac22-9f6f473978b0 None admin] RBAC: Adding query filter params (name=admin) {{(pid=144067) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:13:46.425007 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-865e454b-516c-4d4c-ac22-9f6f473978b0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:13:46.426429 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-865e454b-516c-4d4c-ac22-9f6f473978b0 None admin] RBAC: Authorization granted {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:13:46.435791 dv-cinder-851351-1-smb devstack@keystone.service[144067]: [pid: 144067|app: 0|req: 593/1196] 10.222.0.42 () {56 vars in 1099 bytes} [Thu Jul 28 08:13:46 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 08:13:46.442125 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96aa05b8-2058-4051-bc2a-739c53dc3dad None admin] Authenticating user token {{(pid=144068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:13:46.520031 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG dbcounter [-] [144068] Writing DB stats keystone:SELECT=100 {{(pid=144068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:13:46.565063 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96aa05b8-2058-4051-bc2a-739c53dc3dad None admin] Validating token access rules against request {{(pid=144068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:13:46.601964 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d56374-0e36-407a-a298-1cc19fc3eedc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:13:46.602688 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d56374-0e36-407a-a298-1cc19fc3eedc None admin] REQUEST_METHOD: `GET` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:13:46.603012 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d56374-0e36-407a-a298-1cc19fc3eedc None admin] SCRIPT_NAME: `/identity` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:13:46.603364 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d56374-0e36-407a-a298-1cc19fc3eedc None admin] PATH_INFO: `/v3/users/bf2f5b5d93e7430d8472a259167ace9f` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:13:46.604628 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47d56374-0e36-407a-a298-1cc19fc3eedc None admin] RBAC: Authorizing `identity:get_user(user_id=bf2f5b5d93e7430d8472a259167ace9f)` {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:13:46.606186 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47d56374-0e36-407a-a298-1cc19fc3eedc None admin] RBAC: Authorization granted {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:13:46.607907 dv-cinder-851351-1-smb devstack@keystone.service[144068]: [pid: 144068|app: 0|req: 604/1197] 10.222.0.42 () {56 vars in 1177 bytes} [Thu Jul 28 08:13:46 2022] GET /identity/v3/users/bf2f5b5d93e7430d8472a259167ace9f => generated 311 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:13:46.614127 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-865e454b-516c-4d4c-ac22-9f6f473978b0 None admin] Authenticating user token {{(pid=144067) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:13:46.630662 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG dbcounter [-] [144067] Writing DB stats keystone:SELECT=100 {{(pid=144067) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:13:46.731374 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-865e454b-516c-4d4c-ac22-9f6f473978b0 None admin] Validating token access rules against request {{(pid=144067) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:13:46.768986 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d0a30c-3cab-428e-a84e-d852977fed5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144067) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:13:46.769633 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d0a30c-3cab-428e-a84e-d852977fed5d None admin] REQUEST_METHOD: `GET` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:13:46.769915 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d0a30c-3cab-428e-a84e-d852977fed5d None admin] SCRIPT_NAME: `/identity` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:13:46.770254 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d0a30c-3cab-428e-a84e-d852977fed5d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:13:46.850962 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30d0a30c-3cab-428e-a84e-d852977fed5d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:13:46.852468 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30d0a30c-3cab-428e-a84e-d852977fed5d None admin] RBAC: Authorization granted {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:13:46.868195 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG dbcounter [-] [144067] Writing DB stats keystone:SELECT=100 {{(pid=144067) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:13:46.964467 dv-cinder-851351-1-smb devstack@keystone.service[144067]: [pid: 144067|app: 0|req: 594/1198] 10.222.0.42 () {58 vars in 1282 bytes} [Thu Jul 28 08:13:46 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 351 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 28 08:13:46.971597 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d56374-0e36-407a-a298-1cc19fc3eedc None admin] Authenticating user token {{(pid=144068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:13:47.107147 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d56374-0e36-407a-a298-1cc19fc3eedc None admin] Validating token access rules against request {{(pid=144068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:13:47.137202 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG dbcounter [-] [144068] Writing DB stats keystone:SELECT=100 {{(pid=144068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:13:47.146917 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17889644-7d58-44c1-9716-c8fdec381b7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:13:47.147600 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17889644-7d58-44c1-9716-c8fdec381b7f None admin] REQUEST_METHOD: `GET` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:13:47.147879 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17889644-7d58-44c1-9716-c8fdec381b7f None admin] SCRIPT_NAME: `/identity` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:13:47.148153 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17889644-7d58-44c1-9716-c8fdec381b7f None admin] PATH_INFO: `/v3/projects/1622752c850d4745a934d9193109796c` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:13:47.149512 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17889644-7d58-44c1-9716-c8fdec381b7f None admin] RBAC: Authorizing `identity:get_project(project_id=1622752c850d4745a934d9193109796c)` {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:13:47.151003 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17889644-7d58-44c1-9716-c8fdec381b7f None admin] RBAC: Authorization granted {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:13:47.152805 dv-cinder-851351-1-smb devstack@keystone.service[144068]: [pid: 144068|app: 0|req: 605/1199] 10.222.0.42 () {56 vars in 1186 bytes} [Thu Jul 28 08:13:46 2022] GET /identity/v3/projects/1622752c850d4745a934d9193109796c => generated 361 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:13:47.159567 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d0a30c-3cab-428e-a84e-d852977fed5d None admin] Authenticating user token {{(pid=144067) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:13:47.273804 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d0a30c-3cab-428e-a84e-d852977fed5d None admin] Validating token access rules against request {{(pid=144067) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:13:47.288853 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG dbcounter [-] [144067] Writing DB stats keystone:SELECT=100 {{(pid=144067) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:13:47.313721 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af1ca08-60ef-434b-a482-9a71aa3e369c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144067) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:13:47.314364 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af1ca08-60ef-434b-a482-9a71aa3e369c None admin] REQUEST_METHOD: `GET` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:13:47.314648 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af1ca08-60ef-434b-a482-9a71aa3e369c None admin] SCRIPT_NAME: `/identity` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:13:47.314923 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af1ca08-60ef-434b-a482-9a71aa3e369c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:13:47.315796 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af1ca08-60ef-434b-a482-9a71aa3e369c None admin] RBAC: Adding query filter params (role.id=d1020e7bb0b7411d895ddedd6dc02c5b, scope.project.id=1622752c850d4745a934d9193109796c, user.id=bf2f5b5d93e7430d8472a259167ace9f) {{(pid=144067) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:13:47.316114 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af1ca08-60ef-434b-a482-9a71aa3e369c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:13:47.317640 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af1ca08-60ef-434b-a482-9a71aa3e369c None admin] RBAC: Authorization granted {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:13:47.324647 dv-cinder-851351-1-smb devstack@keystone.service[144067]: [pid: 144067|app: 0|req: 595/1200] 10.222.0.42 () {56 vars in 1374 bytes} [Thu Jul 28 08:13:47 2022] GET /identity/v3/role_assignments?user.id=bf2f5b5d93e7430d8472a259167ace9f&scope.project.id=1622752c850d4745a934d9193109796c&role.id=d1020e7bb0b7411d895ddedd6dc02c5b => generated 608 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:13:57.142399 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG dbcounter [-] [144068] Writing DB stats keystone:SELECT=2 {{(pid=144068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:13:57.321885 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG dbcounter [-] [144067] Writing DB stats keystone:SELECT=12 {{(pid=144067) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:14:46.215036 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d9504f-32e0-489a-9a4b-18c852facb98 None None] REQUEST_METHOD: `GET` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:14:46.219756 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d9504f-32e0-489a-9a4b-18c852facb98 None None] SCRIPT_NAME: `/identity` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:14:46.219756 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d9504f-32e0-489a-9a4b-18c852facb98 None None] PATH_INFO: `/` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:14:46.219756 dv-cinder-851351-1-smb devstack@keystone.service[144068]: [pid: 144068|app: 0|req: 606/1201] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 08:14:46 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 08:14:46.230564 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5466381c-9db6-4f9c-8d3c-dc952fd09796 None None] REQUEST_METHOD: `POST` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:14:46.231258 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5466381c-9db6-4f9c-8d3c-dc952fd09796 None None] SCRIPT_NAME: `/identity` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:14:46.231698 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5466381c-9db6-4f9c-8d3c-dc952fd09796 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:14:46.266713 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.auth.core [None req-5466381c-9db6-4f9c-8d3c-dc952fd09796 None None] MFA Rules not processed for user `bf5ceb8f07374635ad506b7d1b4f1612`. Rule list: `[]` (Enabled: `True`). {{(pid=144067) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 08:14:46.269302 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.fernet_utils [None req-5466381c-9db6-4f9c-8d3c-dc952fd09796 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=144067) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:14:46.407913 dv-cinder-851351-1-smb devstack@keystone.service[144067]: [pid: 144067|app: 0|req: 596/1202] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 08:14:46 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 08:14:46.457850 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d9504f-32e0-489a-9a4b-18c852facb98 None None] Authenticating user token {{(pid=144068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:14:46.670470 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d9504f-32e0-489a-9a4b-18c852facb98 None None] Validating token access rules against request {{(pid=144068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:14:46.724755 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83016c67-53a7-49c6-906c-db5954b26491 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:14:46.725812 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83016c67-53a7-49c6-906c-db5954b26491 None admin] REQUEST_METHOD: `GET` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:14:46.726267 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83016c67-53a7-49c6-906c-db5954b26491 None admin] SCRIPT_NAME: `/identity` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:14:46.726910 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83016c67-53a7-49c6-906c-db5954b26491 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:14:46.749473 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83016c67-53a7-49c6-906c-db5954b26491 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:14:46.751561 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83016c67-53a7-49c6-906c-db5954b26491 None admin] RBAC: Authorization granted {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:14:46.777010 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application [None req-83016c67-53a7-49c6-906c-db5954b26491 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 08:14:46.777010 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:14:46.777010 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:14:46.777010 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:14:46.777010 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:14:46.777010 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:14:46.777010 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:14:46.777010 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:14:46.777010 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:14:46.777010 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:14:46.777010 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:14:46.777010 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:14:46.777010 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 08:14:46.777010 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 08:14:46.777010 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 08:14:46.778830 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 08:14:46.778830 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:14:46.778830 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:14:46.778830 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:14:46.778830 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:14:46.778830 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:14:46.778830 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:14:46.778830 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:14:46.778830 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application with Lock( Jul 28 08:14:46.778830 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:14:46.778830 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:14:46.778830 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:14:46.778830 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:14:46.778830 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:14:46.778830 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:14:46.778830 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:14:46.778830 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:14:46.787002 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 08:14:46.787002 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 08:14:46.787002 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 08:14:46.787002 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application Jul 28 08:14:46.787002 dv-cinder-851351-1-smb devstack@keystone.service[144068]: [pid: 144068|app: 0|req: 607/1203] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 08:14:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 323 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:14:46.787546 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5466381c-9db6-4f9c-8d3c-dc952fd09796 None None] Authenticating user token {{(pid=144067) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:14:46.976740 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5466381c-9db6-4f9c-8d3c-dc952fd09796 None None] Validating token access rules against request {{(pid=144067) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:14:47.035268 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG dbcounter [-] [144067] Writing DB stats keystone:SELECT=100 {{(pid=144067) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:14:47.043509 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf47983-f89d-479d-bedf-5dfbb0831220 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144067) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:14:47.044226 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf47983-f89d-479d-bedf-5dfbb0831220 None admin] REQUEST_METHOD: `GET` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:14:47.044717 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf47983-f89d-479d-bedf-5dfbb0831220 None admin] SCRIPT_NAME: `/identity` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:14:47.044899 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf47983-f89d-479d-bedf-5dfbb0831220 None admin] PATH_INFO: `/v3/domains` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:14:47.045661 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf47983-f89d-479d-bedf-5dfbb0831220 None admin] RBAC: Adding query filter params (name=Default) {{(pid=144067) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:14:47.046123 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf47983-f89d-479d-bedf-5dfbb0831220 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:14:47.047844 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf47983-f89d-479d-bedf-5dfbb0831220 None admin] RBAC: Authorization granted {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:14:47.063577 dv-cinder-851351-1-smb devstack@keystone.service[144067]: [pid: 144067|app: 0|req: 597/1204] 10.222.0.42 () {56 vars in 1109 bytes} [Thu Jul 28 08:14:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 277 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:14:47.072250 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83016c67-53a7-49c6-906c-db5954b26491 None admin] Authenticating user token {{(pid=144068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:14:47.163755 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG dbcounter [-] [144068] Writing DB stats keystone:SELECT=100 {{(pid=144068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:14:47.243664 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83016c67-53a7-49c6-906c-db5954b26491 None admin] Validating token access rules against request {{(pid=144068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:14:47.288489 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ead9d12-c453-4c35-953c-54573b543f37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:14:47.289226 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ead9d12-c453-4c35-953c-54573b543f37 None admin] REQUEST_METHOD: `POST` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:14:47.289521 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ead9d12-c453-4c35-953c-54573b543f37 None admin] SCRIPT_NAME: `/identity` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:14:47.289790 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ead9d12-c453-4c35-953c-54573b543f37 None admin] PATH_INFO: `/v3/users` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:14:47.290631 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ead9d12-c453-4c35-953c-54573b543f37 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:14:47.292288 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ead9d12-c453-4c35-953c-54573b543f37 None admin] RBAC: Authorization granted {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:14:47.323558 dv-cinder-851351-1-smb devstack@keystone.service[144068]: [pid: 144068|app: 0|req: 608/1205] 10.222.0.42 () {60 vars in 1132 bytes} [Thu Jul 28 08:14:47 2022] POST /identity/v3/users => generated 251 bytes in 252 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 28 08:14:49.615002 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5961d0b-5e10-4673-b371-0b1dbab47419 None None] REQUEST_METHOD: `GET` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:14:49.615642 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5961d0b-5e10-4673-b371-0b1dbab47419 None None] SCRIPT_NAME: `/identity` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:14:49.615642 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5961d0b-5e10-4673-b371-0b1dbab47419 None None] PATH_INFO: `/` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:14:49.617092 dv-cinder-851351-1-smb devstack@keystone.service[144067]: [pid: 144067|app: 0|req: 598/1206] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 08:14:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 28 08:14:49.623320 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac569cb-7e92-45f8-aa75-e82bfcb9c30e None None] REQUEST_METHOD: `POST` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:14:49.623932 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac569cb-7e92-45f8-aa75-e82bfcb9c30e None None] SCRIPT_NAME: `/identity` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:14:49.623932 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac569cb-7e92-45f8-aa75-e82bfcb9c30e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:14:49.644540 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.auth.core [None req-9ac569cb-7e92-45f8-aa75-e82bfcb9c30e None None] MFA Rules not processed for user `bf5ceb8f07374635ad506b7d1b4f1612`. Rule list: `[]` (Enabled: `True`). {{(pid=144068) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 08:14:49.645854 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.fernet_utils [None req-9ac569cb-7e92-45f8-aa75-e82bfcb9c30e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=144068) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:14:49.746859 dv-cinder-851351-1-smb devstack@keystone.service[144068]: [pid: 144068|app: 0|req: 609/1207] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 08:14:49 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 08:14:49.772578 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5961d0b-5e10-4673-b371-0b1dbab47419 None None] Authenticating user token {{(pid=144067) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:14:49.926982 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5961d0b-5e10-4673-b371-0b1dbab47419 None None] Validating token access rules against request {{(pid=144067) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:14:49.974964 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca10825b-260b-48e1-a4a7-6193f10885ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144067) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:14:49.975830 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca10825b-260b-48e1-a4a7-6193f10885ce None admin] REQUEST_METHOD: `GET` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:14:49.976219 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca10825b-260b-48e1-a4a7-6193f10885ce None admin] SCRIPT_NAME: `/identity` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:14:49.976604 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca10825b-260b-48e1-a4a7-6193f10885ce None admin] PATH_INFO: `/v3/roles/service` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:14:49.992236 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca10825b-260b-48e1-a4a7-6193f10885ce None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 08:14:49.997555 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application [None req-ca10825b-260b-48e1-a4a7-6193f10885ce None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 28 08:14:49.997555 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:14:49.997555 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:14:49.997555 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:14:49.997555 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:14:49.997555 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:14:49.997555 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:14:49.997555 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:14:49.997555 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:14:49.997555 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:14:49.997555 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:14:49.997555 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:14:49.997555 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 08:14:49.997555 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 08:14:49.997555 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 08:14:49.997555 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 08:14:49.999087 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 08:14:49.999087 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 08:14:49.999087 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 08:14:49.999087 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 08:14:49.999087 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:14:49.999087 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:14:49.999087 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:14:49.999087 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:14:49.999087 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:14:49.999087 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:14:49.999087 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:14:49.999087 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application with Lock( Jul 28 08:14:49.999087 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:14:49.999087 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:14:49.999087 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:14:49.999087 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:14:50.000439 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:14:50.000439 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:14:50.000439 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:14:50.000439 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:14:50.000439 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 08:14:50.000439 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 08:14:50.000439 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 08:14:50.000439 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 08:14:50.000439 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 08:14:50.000439 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 08:14:50.000439 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 28 08:14:50.000439 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application Jul 28 08:14:50.004234 dv-cinder-851351-1-smb devstack@keystone.service[144067]: [pid: 144067|app: 0|req: 599/1208] 10.222.0.42 () {56 vars in 1102 bytes} [Thu Jul 28 08:14:49 2022] GET /identity/v3/roles/service => generated 85 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:14:50.005558 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac569cb-7e92-45f8-aa75-e82bfcb9c30e None None] Authenticating user token {{(pid=144068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:14:50.067520 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG dbcounter [-] [144068] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=144068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:14:50.146497 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac569cb-7e92-45f8-aa75-e82bfcb9c30e None None] Validating token access rules against request {{(pid=144068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:14:50.188914 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd79414d-0849-4b14-8ccc-0bb7d858d218 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:14:50.189758 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd79414d-0849-4b14-8ccc-0bb7d858d218 None admin] REQUEST_METHOD: `GET` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:14:50.190044 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd79414d-0849-4b14-8ccc-0bb7d858d218 None admin] SCRIPT_NAME: `/identity` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:14:50.190321 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd79414d-0849-4b14-8ccc-0bb7d858d218 None admin] PATH_INFO: `/v3/roles` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:14:50.191453 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd79414d-0849-4b14-8ccc-0bb7d858d218 None admin] RBAC: Adding query filter params (name=service) {{(pid=144068) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:14:50.191649 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd79414d-0849-4b14-8ccc-0bb7d858d218 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:14:50.193373 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd79414d-0849-4b14-8ccc-0bb7d858d218 None admin] RBAC: Authorization granted {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:14:50.203893 dv-cinder-851351-1-smb devstack@keystone.service[144068]: [pid: 144068|app: 0|req: 610/1209] 10.222.0.42 () {56 vars in 1103 bytes} [Thu Jul 28 08:14:50 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:14:50.211316 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca10825b-260b-48e1-a4a7-6193f10885ce None admin] Authenticating user token {{(pid=144067) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:14:50.283019 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG dbcounter [-] [144067] Writing DB stats keystone:SELECT=100 {{(pid=144067) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:14:50.366782 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca10825b-260b-48e1-a4a7-6193f10885ce None admin] Validating token access rules against request {{(pid=144067) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:14:50.415145 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2fc9a4-06e5-4c78-8dc8-e75cc5c440c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144067) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:14:50.415816 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2fc9a4-06e5-4c78-8dc8-e75cc5c440c3 None admin] REQUEST_METHOD: `GET` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:14:50.416136 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2fc9a4-06e5-4c78-8dc8-e75cc5c440c3 None admin] SCRIPT_NAME: `/identity` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:14:50.416453 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2fc9a4-06e5-4c78-8dc8-e75cc5c440c3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:14:50.434045 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a2fc9a4-06e5-4c78-8dc8-e75cc5c440c3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:14:50.435637 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a2fc9a4-06e5-4c78-8dc8-e75cc5c440c3 None admin] RBAC: Authorization granted {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:14:50.452358 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application [None req-2a2fc9a4-06e5-4c78-8dc8-e75cc5c440c3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 08:14:50.452358 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:14:50.452358 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:14:50.452358 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:14:50.452358 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:14:50.452358 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:14:50.452358 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:14:50.452358 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:14:50.452358 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:14:50.452358 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:14:50.452358 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:14:50.452358 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:14:50.452358 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 08:14:50.452358 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 08:14:50.452358 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 08:14:50.454451 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 08:14:50.454451 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:14:50.454451 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:14:50.454451 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:14:50.454451 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:14:50.454451 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:14:50.454451 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:14:50.454451 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:14:50.454451 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application with Lock( Jul 28 08:14:50.454451 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:14:50.454451 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:14:50.454451 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:14:50.454451 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:14:50.454451 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:14:50.454451 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:14:50.454451 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:14:50.454451 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:14:50.456071 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 08:14:50.456071 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 08:14:50.456071 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 08:14:50.456071 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application Jul 28 08:14:50.456071 dv-cinder-851351-1-smb devstack@keystone.service[144067]: [pid: 144067|app: 0|req: 600/1210] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 08:14:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 244 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:14:50.461942 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd79414d-0849-4b14-8ccc-0bb7d858d218 None admin] Authenticating user token {{(pid=144068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:14:50.617713 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG dbcounter [-] [144068] Writing DB stats keystone:SELECT=100 {{(pid=144068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:14:50.621832 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd79414d-0849-4b14-8ccc-0bb7d858d218 None admin] Validating token access rules against request {{(pid=144068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:14:50.664342 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b275ac-cddd-499d-ac2a-be0c6b7399f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:14:50.665521 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b275ac-cddd-499d-ac2a-be0c6b7399f7 None admin] REQUEST_METHOD: `GET` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:14:50.665521 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b275ac-cddd-499d-ac2a-be0c6b7399f7 None admin] SCRIPT_NAME: `/identity` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:14:50.665521 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b275ac-cddd-499d-ac2a-be0c6b7399f7 None admin] PATH_INFO: `/v3/domains` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:14:50.666233 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b275ac-cddd-499d-ac2a-be0c6b7399f7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=144068) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:14:50.666532 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b275ac-cddd-499d-ac2a-be0c6b7399f7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:14:50.668037 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b275ac-cddd-499d-ac2a-be0c6b7399f7 None admin] RBAC: Authorization granted {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:14:50.686660 dv-cinder-851351-1-smb devstack@keystone.service[144068]: [pid: 144068|app: 0|req: 611/1211] 10.222.0.42 () {56 vars in 1109 bytes} [Thu Jul 28 08:14:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 08:14:50.696353 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2fc9a4-06e5-4c78-8dc8-e75cc5c440c3 None admin] Authenticating user token {{(pid=144067) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:14:50.847737 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2fc9a4-06e5-4c78-8dc8-e75cc5c440c3 None admin] Validating token access rules against request {{(pid=144067) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:14:50.849846 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG dbcounter [-] [144067] Writing DB stats keystone:SELECT=100 {{(pid=144067) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:14:50.908295 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cedb21f6-277b-4ebd-83cb-1a41f69cf213 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144067) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:14:50.909048 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cedb21f6-277b-4ebd-83cb-1a41f69cf213 None admin] REQUEST_METHOD: `GET` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:14:50.909337 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cedb21f6-277b-4ebd-83cb-1a41f69cf213 None admin] SCRIPT_NAME: `/identity` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:14:50.909595 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cedb21f6-277b-4ebd-83cb-1a41f69cf213 None admin] PATH_INFO: `/v3/users/placement` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:14:50.919600 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cedb21f6-277b-4ebd-83cb-1a41f69cf213 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:14:50.921150 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cedb21f6-277b-4ebd-83cb-1a41f69cf213 None admin] RBAC: Authorization granted {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:14:50.935214 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application [None req-cedb21f6-277b-4ebd-83cb-1a41f69cf213 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 28 08:14:50.935214 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:14:50.935214 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:14:50.935214 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:14:50.935214 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:14:50.935214 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:14:50.935214 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:14:50.935214 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:14:50.935214 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:14:50.935214 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:14:50.935214 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:14:50.935214 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:14:50.935214 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 28 08:14:50.935214 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 28 08:14:50.935214 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 28 08:14:50.935214 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 28 08:14:50.941249 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:14:50.941249 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:14:50.941249 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 28 08:14:50.941249 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 08:14:50.941249 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 28 08:14:50.941249 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 08:14:50.941249 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:14:50.941249 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:14:50.941249 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:14:50.941249 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:14:50.941249 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:14:50.941249 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application with Lock( Jul 28 08:14:50.941249 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:14:50.941249 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:14:50.941249 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:14:50.941249 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:14:50.941249 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:14:50.941249 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:14:50.942215 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:14:50.942215 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:14:50.942215 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 28 08:14:50.942215 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 28 08:14:50.942215 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 28 08:14:50.942215 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 28 08:14:50.942215 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 28 08:14:50.942215 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 28 08:14:50.942215 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 28 08:14:50.942215 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application Jul 28 08:14:50.942215 dv-cinder-851351-1-smb devstack@keystone.service[144067]: [pid: 144067|app: 0|req: 601/1212] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 08:14:50 2022] GET /identity/v3/users/placement => generated 87 bytes in 242 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:14:50.945712 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b275ac-cddd-499d-ac2a-be0c6b7399f7 None admin] Authenticating user token {{(pid=144068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:14:51.160555 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b275ac-cddd-499d-ac2a-be0c6b7399f7 None admin] Validating token access rules against request {{(pid=144068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:14:51.215060 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d670f7e-1c18-43d0-8ae6-0c31c37c7d7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:14:51.215735 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d670f7e-1c18-43d0-8ae6-0c31c37c7d7a None admin] REQUEST_METHOD: `GET` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:14:51.216011 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d670f7e-1c18-43d0-8ae6-0c31c37c7d7a None admin] SCRIPT_NAME: `/identity` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:14:51.216296 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d670f7e-1c18-43d0-8ae6-0c31c37c7d7a None admin] PATH_INFO: `/v3/users` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:14:51.217266 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d670f7e-1c18-43d0-8ae6-0c31c37c7d7a None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=144068) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:14:51.217721 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d670f7e-1c18-43d0-8ae6-0c31c37c7d7a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:14:51.219050 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d670f7e-1c18-43d0-8ae6-0c31c37c7d7a None admin] RBAC: Authorization granted {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:14:51.256724 dv-cinder-851351-1-smb devstack@keystone.service[144068]: [pid: 144068|app: 0|req: 612/1213] 10.222.0.42 () {56 vars in 1143 bytes} [Thu Jul 28 08:14:50 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 307 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:14:51.259939 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cedb21f6-277b-4ebd-83cb-1a41f69cf213 None admin] Authenticating user token {{(pid=144067) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:14:51.423252 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cedb21f6-277b-4ebd-83cb-1a41f69cf213 None admin] Validating token access rules against request {{(pid=144067) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:14:51.465602 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d30ca5a3-6edf-4112-99d8-32224d831d74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144067) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:14:51.466337 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30ca5a3-6edf-4112-99d8-32224d831d74 None admin] REQUEST_METHOD: `GET` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:14:51.466632 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30ca5a3-6edf-4112-99d8-32224d831d74 None admin] SCRIPT_NAME: `/identity` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:14:51.466897 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30ca5a3-6edf-4112-99d8-32224d831d74 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:14:51.519772 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG dbcounter [-] [144067] Writing DB stats keystone:SELECT=100 {{(pid=144067) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:14:51.597200 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d30ca5a3-6edf-4112-99d8-32224d831d74 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:14:51.598785 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d30ca5a3-6edf-4112-99d8-32224d831d74 None admin] RBAC: Authorization granted {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:14:51.764230 dv-cinder-851351-1-smb devstack@keystone.service[144067]: [pid: 144067|app: 0|req: 602/1214] 10.222.0.42 () {58 vars in 1282 bytes} [Thu Jul 28 08:14:51 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 505 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 28 08:14:51.772555 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d670f7e-1c18-43d0-8ae6-0c31c37c7d7a None admin] Authenticating user token {{(pid=144068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:14:51.798087 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG dbcounter [-] [144068] Writing DB stats keystone:SELECT=100 {{(pid=144068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:14:51.938124 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d670f7e-1c18-43d0-8ae6-0c31c37c7d7a None admin] Validating token access rules against request {{(pid=144068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:14:52.012570 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-324a9a5e-981a-474d-b68e-a38a07ffa717 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:14:52.013718 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324a9a5e-981a-474d-b68e-a38a07ffa717 None admin] REQUEST_METHOD: `GET` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:14:52.014291 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324a9a5e-981a-474d-b68e-a38a07ffa717 None admin] SCRIPT_NAME: `/identity` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:14:52.014692 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324a9a5e-981a-474d-b68e-a38a07ffa717 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:14:52.037344 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-324a9a5e-981a-474d-b68e-a38a07ffa717 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:14:52.041238 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-324a9a5e-981a-474d-b68e-a38a07ffa717 None admin] RBAC: Authorization granted {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:14:52.064703 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application [None req-324a9a5e-981a-474d-b68e-a38a07ffa717 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 08:14:52.064703 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:14:52.064703 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:14:52.064703 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:14:52.064703 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:14:52.064703 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:14:52.064703 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:14:52.064703 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:14:52.064703 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:14:52.064703 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:14:52.064703 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:14:52.064703 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:14:52.064703 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 08:14:52.064703 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 08:14:52.064703 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 08:14:52.065794 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 08:14:52.065794 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:14:52.065794 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:14:52.065794 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:14:52.065794 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:14:52.065794 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:14:52.065794 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:14:52.065794 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:14:52.065794 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application with Lock( Jul 28 08:14:52.065794 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:14:52.065794 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:14:52.065794 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:14:52.065794 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:14:52.065794 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:14:52.065794 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:14:52.065794 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:14:52.065794 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:14:52.066647 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 08:14:52.066647 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 08:14:52.066647 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 08:14:52.066647 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application Jul 28 08:14:52.066861 dv-cinder-851351-1-smb devstack@keystone.service[144068]: [pid: 144068|app: 0|req: 613/1215] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 08:14:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 296 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:14:52.076492 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d30ca5a3-6edf-4112-99d8-32224d831d74 None admin] Authenticating user token {{(pid=144067) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:14:52.167403 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG dbcounter [-] [144067] Writing DB stats keystone:SELECT=100 {{(pid=144067) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:14:52.226958 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d30ca5a3-6edf-4112-99d8-32224d831d74 None admin] Validating token access rules against request {{(pid=144067) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:14:52.278386 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001e7a35-2ded-4ff2-aa99-c3c93c1fbe8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144067) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:14:52.279075 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001e7a35-2ded-4ff2-aa99-c3c93c1fbe8a None admin] REQUEST_METHOD: `GET` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:14:52.279486 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001e7a35-2ded-4ff2-aa99-c3c93c1fbe8a None admin] SCRIPT_NAME: `/identity` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:14:52.279871 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001e7a35-2ded-4ff2-aa99-c3c93c1fbe8a None admin] PATH_INFO: `/v3/domains` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:14:52.281065 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-001e7a35-2ded-4ff2-aa99-c3c93c1fbe8a None admin] RBAC: Adding query filter params (name=Default) {{(pid=144067) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:14:52.281581 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-001e7a35-2ded-4ff2-aa99-c3c93c1fbe8a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:14:52.283592 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-001e7a35-2ded-4ff2-aa99-c3c93c1fbe8a None admin] RBAC: Authorization granted {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:14:52.301582 dv-cinder-851351-1-smb devstack@keystone.service[144067]: [pid: 144067|app: 0|req: 603/1216] 10.222.0.42 () {56 vars in 1109 bytes} [Thu Jul 28 08:14:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:14:52.309658 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-324a9a5e-981a-474d-b68e-a38a07ffa717 None admin] Authenticating user token {{(pid=144068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:14:52.413430 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG dbcounter [-] [144068] Writing DB stats keystone:SELECT=100 {{(pid=144068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:14:52.458020 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-324a9a5e-981a-474d-b68e-a38a07ffa717 None admin] Validating token access rules against request {{(pid=144068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:14:52.509291 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97fd0c2-7f5e-4445-a5bc-d7ecd1d4b556 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:14:52.510223 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97fd0c2-7f5e-4445-a5bc-d7ecd1d4b556 None admin] REQUEST_METHOD: `GET` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:14:52.510639 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97fd0c2-7f5e-4445-a5bc-d7ecd1d4b556 None admin] SCRIPT_NAME: `/identity` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:14:52.511032 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97fd0c2-7f5e-4445-a5bc-d7ecd1d4b556 None admin] PATH_INFO: `/v3/projects/service` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:14:52.522274 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e97fd0c2-7f5e-4445-a5bc-d7ecd1d4b556 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:14:52.525058 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e97fd0c2-7f5e-4445-a5bc-d7ecd1d4b556 None admin] RBAC: Authorization granted {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:14:52.550090 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application [None req-e97fd0c2-7f5e-4445-a5bc-d7ecd1d4b556 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 08:14:52.550090 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:14:52.550090 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:14:52.550090 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:14:52.550090 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:14:52.550090 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:14:52.550090 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:14:52.550090 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:14:52.550090 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:14:52.550090 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:14:52.550090 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:14:52.550090 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:14:52.550090 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 28 08:14:52.550090 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 28 08:14:52.550090 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 28 08:14:52.551333 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 28 08:14:52.551333 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:14:52.551333 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:14:52.551333 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:14:52.551333 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:14:52.551333 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:14:52.551333 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:14:52.551333 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:14:52.551333 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application with Lock( Jul 28 08:14:52.551333 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:14:52.551333 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:14:52.551333 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:14:52.551333 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:14:52.551333 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:14:52.551333 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:14:52.551333 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:14:52.551333 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:14:52.557344 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 28 08:14:52.557344 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 28 08:14:52.557344 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 28 08:14:52.557344 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 28 08:14:52.557344 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 28 08:14:52.557344 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 28 08:14:52.557344 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 08:14:52.557344 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application Jul 28 08:14:52.557344 dv-cinder-851351-1-smb devstack@keystone.service[144068]: [pid: 144068|app: 0|req: 614/1217] 10.222.0.42 () {56 vars in 1111 bytes} [Thu Jul 28 08:14:52 2022] GET /identity/v3/projects/service => generated 88 bytes in 244 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:14:52.558577 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001e7a35-2ded-4ff2-aa99-c3c93c1fbe8a None admin] Authenticating user token {{(pid=144067) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:14:52.713164 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001e7a35-2ded-4ff2-aa99-c3c93c1fbe8a None admin] Validating token access rules against request {{(pid=144067) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:14:52.747735 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG dbcounter [-] [144067] Writing DB stats keystone:SELECT=100 {{(pid=144067) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:14:52.764656 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-450bdb67-d1ec-465c-9ebe-084283f30e6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144067) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:14:52.765775 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450bdb67-d1ec-465c-9ebe-084283f30e6d None admin] REQUEST_METHOD: `GET` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:14:52.765775 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450bdb67-d1ec-465c-9ebe-084283f30e6d None admin] SCRIPT_NAME: `/identity` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:14:52.766085 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450bdb67-d1ec-465c-9ebe-084283f30e6d None admin] PATH_INFO: `/v3/projects` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:14:52.766658 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-450bdb67-d1ec-465c-9ebe-084283f30e6d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=144067) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:14:52.766975 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-450bdb67-d1ec-465c-9ebe-084283f30e6d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:14:52.768543 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-450bdb67-d1ec-465c-9ebe-084283f30e6d None admin] RBAC: Authorization granted {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:14:52.783367 dv-cinder-851351-1-smb devstack@keystone.service[144067]: [pid: 144067|app: 0|req: 604/1218] 10.222.0.42 () {56 vars in 1148 bytes} [Thu Jul 28 08:14:52 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 08:14:52.793442 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97fd0c2-7f5e-4445-a5bc-d7ecd1d4b556 None admin] Authenticating user token {{(pid=144068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:14:52.929209 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97fd0c2-7f5e-4445-a5bc-d7ecd1d4b556 None admin] Validating token access rules against request {{(pid=144068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:14:52.963826 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG dbcounter [-] [144068] Writing DB stats keystone:SELECT=100 {{(pid=144068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:14:52.975520 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477d7124-26e1-4638-a539-0046a190f470 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:14:52.976203 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477d7124-26e1-4638-a539-0046a190f470 None admin] REQUEST_METHOD: `GET` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:14:52.976498 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477d7124-26e1-4638-a539-0046a190f470 None admin] SCRIPT_NAME: `/identity` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:14:52.977384 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477d7124-26e1-4638-a539-0046a190f470 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:14:52.978250 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-477d7124-26e1-4638-a539-0046a190f470 None admin] RBAC: Adding query filter params (role.id=9aa6ce92dcbb4164ac0e44d2aa2a0248, scope.project.id=fa39ab7491e5413ca648e31ee9177fa0, user.id=5f254b5035b6418db1fac08a128b3097) {{(pid=144068) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:14:52.978589 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-477d7124-26e1-4638-a539-0046a190f470 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:14:52.980236 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-477d7124-26e1-4638-a539-0046a190f470 None admin] RBAC: Authorization granted {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:14:52.988282 dv-cinder-851351-1-smb devstack@keystone.service[144068]: [pid: 144068|app: 0|req: 615/1219] 10.222.0.42 () {56 vars in 1374 bytes} [Thu Jul 28 08:14:52 2022] GET /identity/v3/role_assignments?user.id=5f254b5035b6418db1fac08a128b3097&scope.project.id=fa39ab7491e5413ca648e31ee9177fa0&role.id=9aa6ce92dcbb4164ac0e44d2aa2a0248 => generated 259 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:14:55.155063 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a880171-84c9-42ce-8f83-e595918ab97d None None] REQUEST_METHOD: `GET` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:14:55.155704 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a880171-84c9-42ce-8f83-e595918ab97d None None] SCRIPT_NAME: `/identity` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:14:55.155920 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a880171-84c9-42ce-8f83-e595918ab97d None None] PATH_INFO: `/` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:14:55.158325 dv-cinder-851351-1-smb devstack@keystone.service[144067]: [pid: 144067|app: 0|req: 605/1220] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 08:14:55 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 08:14:55.167526 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9852016a-0df1-489f-9b92-245543e56611 None None] REQUEST_METHOD: `POST` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:14:55.168212 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9852016a-0df1-489f-9b92-245543e56611 None None] SCRIPT_NAME: `/identity` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:14:55.168420 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9852016a-0df1-489f-9b92-245543e56611 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:14:55.195361 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.auth.core [None req-9852016a-0df1-489f-9b92-245543e56611 None None] MFA Rules not processed for user `bf5ceb8f07374635ad506b7d1b4f1612`. Rule list: `[]` (Enabled: `True`). {{(pid=144068) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 08:14:55.197569 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.fernet_utils [None req-9852016a-0df1-489f-9b92-245543e56611 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=144068) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:14:55.291402 dv-cinder-851351-1-smb devstack@keystone.service[144068]: [pid: 144068|app: 0|req: 616/1221] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 08:14:55 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 08:14:55.319971 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a880171-84c9-42ce-8f83-e595918ab97d None None] Authenticating user token {{(pid=144067) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:14:55.470903 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a880171-84c9-42ce-8f83-e595918ab97d None None] Validating token access rules against request {{(pid=144067) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:14:55.529246 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d760276-f5ae-45d7-a375-a23d7babb546 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144067) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:14:55.530326 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d760276-f5ae-45d7-a375-a23d7babb546 None admin] REQUEST_METHOD: `GET` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:14:55.530802 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d760276-f5ae-45d7-a375-a23d7babb546 None admin] SCRIPT_NAME: `/identity` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:14:55.531278 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d760276-f5ae-45d7-a375-a23d7babb546 None admin] PATH_INFO: `/v3/roles/service` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:14:55.549365 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d760276-f5ae-45d7-a375-a23d7babb546 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 08:14:55.554942 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application [None req-1d760276-f5ae-45d7-a375-a23d7babb546 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 28 08:14:55.554942 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:14:55.554942 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:14:55.554942 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:14:55.554942 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:14:55.554942 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:14:55.554942 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:14:55.554942 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:14:55.554942 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:14:55.554942 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:14:55.554942 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:14:55.554942 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:14:55.554942 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 08:14:55.554942 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 08:14:55.554942 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 08:14:55.554942 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 08:14:55.556377 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 08:14:55.556377 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 08:14:55.556377 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 08:14:55.556377 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 08:14:55.556377 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:14:55.556377 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:14:55.556377 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:14:55.556377 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:14:55.556377 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:14:55.556377 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:14:55.556377 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:14:55.556377 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application with Lock( Jul 28 08:14:55.556377 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:14:55.556377 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:14:55.556377 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:14:55.556377 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:14:55.557779 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:14:55.557779 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:14:55.557779 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:14:55.557779 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:14:55.557779 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 08:14:55.557779 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 08:14:55.557779 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 08:14:55.557779 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 08:14:55.557779 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 08:14:55.557779 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 08:14:55.557779 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 28 08:14:55.557779 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application Jul 28 08:14:55.557779 dv-cinder-851351-1-smb devstack@keystone.service[144067]: [pid: 144067|app: 0|req: 606/1222] 10.222.0.42 () {56 vars in 1102 bytes} [Thu Jul 28 08:14:55 2022] GET /identity/v3/roles/service => generated 85 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:14:55.565175 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9852016a-0df1-489f-9b92-245543e56611 None None] Authenticating user token {{(pid=144068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:14:55.710584 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9852016a-0df1-489f-9b92-245543e56611 None None] Validating token access rules against request {{(pid=144068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:14:55.746644 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG dbcounter [-] [144068] Writing DB stats keystone:SELECT=100 {{(pid=144068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:14:55.762913 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2e3ac3-d4b7-4fd9-a1ec-8521bb892ad7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:14:55.763956 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2e3ac3-d4b7-4fd9-a1ec-8521bb892ad7 None admin] REQUEST_METHOD: `GET` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:14:55.764392 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2e3ac3-d4b7-4fd9-a1ec-8521bb892ad7 None admin] SCRIPT_NAME: `/identity` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:14:55.764877 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2e3ac3-d4b7-4fd9-a1ec-8521bb892ad7 None admin] PATH_INFO: `/v3/roles` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:14:55.766198 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f2e3ac3-d4b7-4fd9-a1ec-8521bb892ad7 None admin] RBAC: Adding query filter params (name=service) {{(pid=144068) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:14:55.766734 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f2e3ac3-d4b7-4fd9-a1ec-8521bb892ad7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:14:55.769453 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f2e3ac3-d4b7-4fd9-a1ec-8521bb892ad7 None admin] RBAC: Authorization granted {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:14:55.788577 dv-cinder-851351-1-smb devstack@keystone.service[144068]: [pid: 144068|app: 0|req: 617/1223] 10.222.0.42 () {56 vars in 1103 bytes} [Thu Jul 28 08:14:55 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:14:55.790591 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d760276-f5ae-45d7-a375-a23d7babb546 None admin] Authenticating user token {{(pid=144067) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:14:55.857140 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG dbcounter [-] [144067] Writing DB stats keystone:SELECT=100 {{(pid=144067) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:14:55.942194 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d760276-f5ae-45d7-a375-a23d7babb546 None admin] Validating token access rules against request {{(pid=144067) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:14:55.993057 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-522a93e6-13ec-480c-8d68-2db51b480c69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144067) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:14:55.993947 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522a93e6-13ec-480c-8d68-2db51b480c69 None admin] REQUEST_METHOD: `GET` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:14:55.994356 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522a93e6-13ec-480c-8d68-2db51b480c69 None admin] SCRIPT_NAME: `/identity` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:14:55.994784 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522a93e6-13ec-480c-8d68-2db51b480c69 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:14:56.011085 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-522a93e6-13ec-480c-8d68-2db51b480c69 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:14:56.013403 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-522a93e6-13ec-480c-8d68-2db51b480c69 None admin] RBAC: Authorization granted {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:14:56.033598 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application [None req-522a93e6-13ec-480c-8d68-2db51b480c69 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 08:14:56.033598 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:14:56.033598 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:14:56.033598 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:14:56.033598 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:14:56.033598 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:14:56.033598 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:14:56.033598 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:14:56.033598 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:14:56.033598 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:14:56.033598 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:14:56.033598 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:14:56.033598 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 08:14:56.033598 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 08:14:56.033598 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 08:14:56.034643 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 08:14:56.034643 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:14:56.034643 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:14:56.034643 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:14:56.034643 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:14:56.034643 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:14:56.034643 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:14:56.034643 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:14:56.034643 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application with Lock( Jul 28 08:14:56.034643 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:14:56.034643 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:14:56.034643 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:14:56.034643 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:14:56.034643 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:14:56.034643 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:14:56.034643 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:14:56.034643 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:14:56.035629 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 08:14:56.035629 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 08:14:56.035629 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 08:14:56.035629 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application Jul 28 08:14:56.036100 dv-cinder-851351-1-smb devstack@keystone.service[144067]: [pid: 144067|app: 0|req: 607/1224] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 08:14:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 246 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 08:14:56.042814 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2e3ac3-d4b7-4fd9-a1ec-8521bb892ad7 None admin] Authenticating user token {{(pid=144068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:14:56.193413 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2e3ac3-d4b7-4fd9-a1ec-8521bb892ad7 None admin] Validating token access rules against request {{(pid=144068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:14:56.254242 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf89af33-f74d-4fcb-a058-0fc015d6d031 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:14:56.255060 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf89af33-f74d-4fcb-a058-0fc015d6d031 None admin] REQUEST_METHOD: `GET` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:14:56.255435 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf89af33-f74d-4fcb-a058-0fc015d6d031 None admin] SCRIPT_NAME: `/identity` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:14:56.255807 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf89af33-f74d-4fcb-a058-0fc015d6d031 None admin] PATH_INFO: `/v3/domains` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:14:56.256636 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf89af33-f74d-4fcb-a058-0fc015d6d031 None admin] RBAC: Adding query filter params (name=Default) {{(pid=144068) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:14:56.257092 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf89af33-f74d-4fcb-a058-0fc015d6d031 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:14:56.258721 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf89af33-f74d-4fcb-a058-0fc015d6d031 None admin] RBAC: Authorization granted {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:14:56.275628 dv-cinder-851351-1-smb devstack@keystone.service[144068]: [pid: 144068|app: 0|req: 618/1225] 10.222.0.42 () {56 vars in 1109 bytes} [Thu Jul 28 08:14:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:14:56.281942 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-522a93e6-13ec-480c-8d68-2db51b480c69 None admin] Authenticating user token {{(pid=144067) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:14:56.402323 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG dbcounter [-] [144067] Writing DB stats keystone:SELECT=100 {{(pid=144067) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:14:56.411884 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-522a93e6-13ec-480c-8d68-2db51b480c69 None admin] Validating token access rules against request {{(pid=144067) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:14:56.471640 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d82d44-f746-470b-9b16-0724527121dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144067) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:14:56.472687 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d82d44-f746-470b-9b16-0724527121dd None admin] REQUEST_METHOD: `GET` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:14:56.473221 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d82d44-f746-470b-9b16-0724527121dd None admin] SCRIPT_NAME: `/identity` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:14:56.473779 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d82d44-f746-470b-9b16-0724527121dd None admin] PATH_INFO: `/v3/users/placement` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:14:56.484145 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03d82d44-f746-470b-9b16-0724527121dd None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:14:56.486431 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03d82d44-f746-470b-9b16-0724527121dd None admin] RBAC: Authorization granted {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:14:56.504205 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application [None req-03d82d44-f746-470b-9b16-0724527121dd None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 28 08:14:56.504205 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:14:56.504205 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:14:56.504205 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:14:56.504205 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:14:56.504205 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:14:56.504205 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:14:56.504205 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:14:56.504205 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:14:56.504205 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:14:56.504205 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:14:56.504205 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:14:56.504205 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 28 08:14:56.504205 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 28 08:14:56.504205 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 28 08:14:56.504205 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 28 08:14:56.506932 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:14:56.506932 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:14:56.506932 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 28 08:14:56.506932 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 08:14:56.506932 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 28 08:14:56.506932 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 08:14:56.506932 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:14:56.506932 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:14:56.506932 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:14:56.506932 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:14:56.506932 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:14:56.506932 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application with Lock( Jul 28 08:14:56.506932 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:14:56.506932 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:14:56.506932 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:14:56.506932 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:14:56.506932 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:14:56.506932 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:14:56.507881 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:14:56.507881 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:14:56.507881 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 28 08:14:56.507881 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 28 08:14:56.507881 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 28 08:14:56.507881 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 28 08:14:56.507881 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 28 08:14:56.507881 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 28 08:14:56.507881 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 28 08:14:56.507881 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application Jul 28 08:14:56.507881 dv-cinder-851351-1-smb devstack@keystone.service[144067]: [pid: 144067|app: 0|req: 608/1226] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 08:14:56 2022] GET /identity/v3/users/placement => generated 87 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 08:14:56.515331 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf89af33-f74d-4fcb-a058-0fc015d6d031 None admin] Authenticating user token {{(pid=144068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:14:56.581133 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG dbcounter [-] [144068] Writing DB stats keystone:SELECT=100 {{(pid=144068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:14:56.669914 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf89af33-f74d-4fcb-a058-0fc015d6d031 None admin] Validating token access rules against request {{(pid=144068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:14:56.742016 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d889a1b-26c4-4b69-9b05-1f238999b432 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:14:56.743006 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d889a1b-26c4-4b69-9b05-1f238999b432 None admin] REQUEST_METHOD: `GET` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:14:56.743499 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d889a1b-26c4-4b69-9b05-1f238999b432 None admin] SCRIPT_NAME: `/identity` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:14:56.743968 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d889a1b-26c4-4b69-9b05-1f238999b432 None admin] PATH_INFO: `/v3/users` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:14:56.745238 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d889a1b-26c4-4b69-9b05-1f238999b432 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=144068) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:14:56.745656 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d889a1b-26c4-4b69-9b05-1f238999b432 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:14:56.747329 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d889a1b-26c4-4b69-9b05-1f238999b432 None admin] RBAC: Authorization granted {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:14:56.770619 dv-cinder-851351-1-smb devstack@keystone.service[144068]: [pid: 144068|app: 0|req: 619/1227] 10.222.0.42 () {56 vars in 1143 bytes} [Thu Jul 28 08:14:56 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:14:56.778499 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d82d44-f746-470b-9b16-0724527121dd None admin] Authenticating user token {{(pid=144067) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:14:56.923540 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d82d44-f746-470b-9b16-0724527121dd None admin] Validating token access rules against request {{(pid=144067) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:14:56.975350 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb40a3b-8785-42c6-b89d-4a390c4c26ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144067) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:14:56.976074 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb40a3b-8785-42c6-b89d-4a390c4c26ad None admin] REQUEST_METHOD: `GET` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:14:56.976459 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb40a3b-8785-42c6-b89d-4a390c4c26ad None admin] SCRIPT_NAME: `/identity` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:14:56.976794 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb40a3b-8785-42c6-b89d-4a390c4c26ad None admin] PATH_INFO: `/v3/domains/Default` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:14:56.998534 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb40a3b-8785-42c6-b89d-4a390c4c26ad None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:14:56.999982 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb40a3b-8785-42c6-b89d-4a390c4c26ad None admin] RBAC: Authorization granted {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:14:57.024562 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application [None req-afb40a3b-8785-42c6-b89d-4a390c4c26ad None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 08:14:57.024562 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:14:57.024562 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:14:57.024562 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:14:57.024562 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:14:57.024562 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:14:57.024562 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:14:57.024562 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:14:57.024562 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:14:57.024562 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:14:57.024562 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:14:57.024562 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:14:57.024562 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 08:14:57.024562 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 08:14:57.024562 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 08:14:57.026625 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 08:14:57.026625 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:14:57.026625 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:14:57.026625 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:14:57.026625 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:14:57.026625 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:14:57.026625 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:14:57.026625 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:14:57.026625 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application with Lock( Jul 28 08:14:57.026625 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:14:57.026625 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:14:57.026625 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:14:57.026625 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:14:57.026625 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:14:57.026625 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:14:57.026625 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:14:57.026625 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:14:57.028370 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 08:14:57.028370 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 08:14:57.028370 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 08:14:57.028370 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application Jul 28 08:14:57.028370 dv-cinder-851351-1-smb devstack@keystone.service[144067]: [pid: 144067|app: 0|req: 609/1228] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 08:14:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 249 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 08:14:57.034903 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d889a1b-26c4-4b69-9b05-1f238999b432 None admin] Authenticating user token {{(pid=144068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:14:57.189984 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d889a1b-26c4-4b69-9b05-1f238999b432 None admin] Validating token access rules against request {{(pid=144068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:14:57.193796 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG dbcounter [-] [144068] Writing DB stats keystone:SELECT=100 {{(pid=144068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:14:57.238789 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8c7ff1-f847-437f-8a6e-6307f607aea7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:14:57.239809 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8c7ff1-f847-437f-8a6e-6307f607aea7 None admin] REQUEST_METHOD: `GET` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:14:57.240249 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8c7ff1-f847-437f-8a6e-6307f607aea7 None admin] SCRIPT_NAME: `/identity` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:14:57.240812 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8c7ff1-f847-437f-8a6e-6307f607aea7 None admin] PATH_INFO: `/v3/domains` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:14:57.241907 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d8c7ff1-f847-437f-8a6e-6307f607aea7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=144068) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:14:57.242420 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d8c7ff1-f847-437f-8a6e-6307f607aea7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:14:57.244741 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d8c7ff1-f847-437f-8a6e-6307f607aea7 None admin] RBAC: Authorization granted {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:14:57.271207 dv-cinder-851351-1-smb devstack@keystone.service[144068]: [pid: 144068|app: 0|req: 620/1229] 10.222.0.42 () {56 vars in 1109 bytes} [Thu Jul 28 08:14:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 08:14:57.272729 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb40a3b-8785-42c6-b89d-4a390c4c26ad None admin] Authenticating user token {{(pid=144067) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:14:57.285854 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG dbcounter [-] [144067] Writing DB stats keystone:SELECT=100 {{(pid=144067) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:14:57.422019 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb40a3b-8785-42c6-b89d-4a390c4c26ad None admin] Validating token access rules against request {{(pid=144067) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:14:57.468799 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24a5992-cdfa-4066-aab8-ef10da76d6e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144067) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:14:57.469502 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24a5992-cdfa-4066-aab8-ef10da76d6e8 None admin] REQUEST_METHOD: `GET` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:14:57.469794 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24a5992-cdfa-4066-aab8-ef10da76d6e8 None admin] SCRIPT_NAME: `/identity` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:14:57.470060 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24a5992-cdfa-4066-aab8-ef10da76d6e8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:14:57.480387 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a24a5992-cdfa-4066-aab8-ef10da76d6e8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:14:57.482237 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a24a5992-cdfa-4066-aab8-ef10da76d6e8 None admin] RBAC: Authorization granted {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:14:57.496291 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application [None req-a24a5992-cdfa-4066-aab8-ef10da76d6e8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 08:14:57.496291 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:14:57.496291 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:14:57.496291 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:14:57.496291 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:14:57.496291 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:14:57.496291 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:14:57.496291 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:14:57.496291 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:14:57.496291 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:14:57.496291 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:14:57.496291 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:14:57.496291 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 28 08:14:57.496291 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 28 08:14:57.496291 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 28 08:14:57.500904 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 28 08:14:57.500904 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:14:57.500904 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:14:57.500904 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:14:57.500904 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:14:57.500904 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:14:57.500904 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:14:57.500904 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:14:57.500904 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application with Lock( Jul 28 08:14:57.500904 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:14:57.500904 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:14:57.500904 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:14:57.500904 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:14:57.500904 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:14:57.500904 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:14:57.500904 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:14:57.500904 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:14:57.502525 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 28 08:14:57.502525 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 28 08:14:57.502525 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 28 08:14:57.502525 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 28 08:14:57.502525 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 28 08:14:57.502525 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 28 08:14:57.502525 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 08:14:57.502525 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application Jul 28 08:14:57.502525 dv-cinder-851351-1-smb devstack@keystone.service[144067]: [pid: 144067|app: 0|req: 610/1230] 10.222.0.42 () {56 vars in 1111 bytes} [Thu Jul 28 08:14:57 2022] GET /identity/v3/projects/service => generated 88 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 08:14:57.505780 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8c7ff1-f847-437f-8a6e-6307f607aea7 None admin] Authenticating user token {{(pid=144068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:14:57.668815 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8c7ff1-f847-437f-8a6e-6307f607aea7 None admin] Validating token access rules against request {{(pid=144068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:14:57.732030 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e9ea49e-a7eb-4223-a82a-7f009c57b714 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:14:57.732916 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9ea49e-a7eb-4223-a82a-7f009c57b714 None admin] REQUEST_METHOD: `GET` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:14:57.733312 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9ea49e-a7eb-4223-a82a-7f009c57b714 None admin] SCRIPT_NAME: `/identity` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:14:57.733716 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9ea49e-a7eb-4223-a82a-7f009c57b714 None admin] PATH_INFO: `/v3/projects` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:14:57.734724 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e9ea49e-a7eb-4223-a82a-7f009c57b714 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=144068) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:14:57.735081 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e9ea49e-a7eb-4223-a82a-7f009c57b714 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:14:57.737074 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e9ea49e-a7eb-4223-a82a-7f009c57b714 None admin] RBAC: Authorization granted {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:14:57.755851 dv-cinder-851351-1-smb devstack@keystone.service[144068]: [pid: 144068|app: 0|req: 621/1231] 10.222.0.42 () {56 vars in 1148 bytes} [Thu Jul 28 08:14:57 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:14:57.762920 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24a5992-cdfa-4066-aab8-ef10da76d6e8 None admin] Authenticating user token {{(pid=144067) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:14:57.863635 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG dbcounter [-] [144067] Writing DB stats keystone:SELECT=100 {{(pid=144067) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:14:57.910442 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24a5992-cdfa-4066-aab8-ef10da76d6e8 None admin] Validating token access rules against request {{(pid=144067) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:14:57.961764 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b70fcae3-abad-4956-89a0-a32025fd7384 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144067) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:14:57.963091 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70fcae3-abad-4956-89a0-a32025fd7384 None admin] REQUEST_METHOD: `PUT` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:14:57.963536 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70fcae3-abad-4956-89a0-a32025fd7384 None admin] SCRIPT_NAME: `/identity` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:14:57.963985 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70fcae3-abad-4956-89a0-a32025fd7384 None admin] PATH_INFO: `/v3/projects/fa39ab7491e5413ca648e31ee9177fa0/users/5f254b5035b6418db1fac08a128b3097/roles/9aa6ce92dcbb4164ac0e44d2aa2a0248` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:14:57.990848 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b70fcae3-abad-4956-89a0-a32025fd7384 None admin] RBAC: Authorizing `identity:create_grant(project_id=fa39ab7491e5413ca648e31ee9177fa0, user_id=5f254b5035b6418db1fac08a128b3097, role_id=9aa6ce92dcbb4164ac0e44d2aa2a0248)` {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:14:57.992348 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b70fcae3-abad-4956-89a0-a32025fd7384 None admin] RBAC: Authorization granted {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:14:58.006747 dv-cinder-851351-1-smb devstack@keystone.service[144067]: [pid: 144067|app: 0|req: 611/1232] 10.222.0.42 () {58 vars in 1439 bytes} [Thu Jul 28 08:14:57 2022] PUT /identity/v3/projects/fa39ab7491e5413ca648e31ee9177fa0/users/5f254b5035b6418db1fac08a128b3097/roles/9aa6ce92dcbb4164ac0e44d2aa2a0248 => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 28 08:15:00.456601 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60fa974a-72db-4df3-a967-3c141c39329f None None] REQUEST_METHOD: `GET` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:15:00.457393 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60fa974a-72db-4df3-a967-3c141c39329f None None] SCRIPT_NAME: `/identity` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:15:00.457685 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60fa974a-72db-4df3-a967-3c141c39329f None None] PATH_INFO: `/` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:15:00.460304 dv-cinder-851351-1-smb devstack@keystone.service[144068]: [pid: 144068|app: 0|req: 622/1233] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 08:15:00 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 08:15:00.468174 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41b1ede-dc07-4632-aea5-be61f0bcce13 None None] REQUEST_METHOD: `POST` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:15:00.469009 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41b1ede-dc07-4632-aea5-be61f0bcce13 None None] SCRIPT_NAME: `/identity` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:15:00.469009 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41b1ede-dc07-4632-aea5-be61f0bcce13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:15:00.492338 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.auth.core [None req-d41b1ede-dc07-4632-aea5-be61f0bcce13 None None] MFA Rules not processed for user `bf5ceb8f07374635ad506b7d1b4f1612`. Rule list: `[]` (Enabled: `True`). {{(pid=144067) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 08:15:00.493972 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.fernet_utils [None req-d41b1ede-dc07-4632-aea5-be61f0bcce13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=144067) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:15:00.587418 dv-cinder-851351-1-smb devstack@keystone.service[144067]: [pid: 144067|app: 0|req: 612/1234] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 08:15:00 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 08:15:00.615608 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60fa974a-72db-4df3-a967-3c141c39329f None None] Authenticating user token {{(pid=144068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:15:00.661598 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG dbcounter [-] [144068] Writing DB stats keystone:SELECT=100 {{(pid=144068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:15:00.788502 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60fa974a-72db-4df3-a967-3c141c39329f None None] Validating token access rules against request {{(pid=144068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:15:00.840356 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8492d09-a091-4371-adf6-6bbde9abd7c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:15:00.841494 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8492d09-a091-4371-adf6-6bbde9abd7c8 None admin] REQUEST_METHOD: `GET` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:15:00.841991 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8492d09-a091-4371-adf6-6bbde9abd7c8 None admin] SCRIPT_NAME: `/identity` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:15:00.842478 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8492d09-a091-4371-adf6-6bbde9abd7c8 None admin] PATH_INFO: `/v3/roles/service` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:15:00.861701 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8492d09-a091-4371-adf6-6bbde9abd7c8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 08:15:00.869359 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application [None req-a8492d09-a091-4371-adf6-6bbde9abd7c8 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 28 08:15:00.869359 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:15:00.869359 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:15:00.869359 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:15:00.869359 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:15:00.869359 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:15:00.869359 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:15:00.869359 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:15:00.869359 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:15:00.869359 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:15:00.869359 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:15:00.869359 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:15:00.869359 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 08:15:00.869359 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 08:15:00.869359 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 08:15:00.869359 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 08:15:00.871390 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 08:15:00.871390 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 08:15:00.871390 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 08:15:00.871390 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 08:15:00.871390 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:15:00.871390 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:15:00.871390 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:15:00.871390 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:15:00.871390 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:15:00.871390 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:15:00.871390 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:15:00.871390 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application with Lock( Jul 28 08:15:00.871390 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:15:00.871390 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:15:00.871390 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:15:00.871390 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:15:00.872486 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:15:00.872486 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:15:00.872486 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:15:00.872486 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:15:00.872486 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 08:15:00.872486 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 08:15:00.872486 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 08:15:00.872486 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 08:15:00.872486 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 08:15:00.872486 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 08:15:00.872486 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 28 08:15:00.872486 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application Jul 28 08:15:00.872486 dv-cinder-851351-1-smb devstack@keystone.service[144068]: [pid: 144068|app: 0|req: 623/1235] 10.222.0.42 () {56 vars in 1102 bytes} [Thu Jul 28 08:15:00 2022] GET /identity/v3/roles/service => generated 85 bytes in 258 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:15:00.878345 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41b1ede-dc07-4632-aea5-be61f0bcce13 None None] Authenticating user token {{(pid=144067) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:15:00.963726 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG dbcounter [-] [144067] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=144067) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:15:01.049378 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41b1ede-dc07-4632-aea5-be61f0bcce13 None None] Validating token access rules against request {{(pid=144067) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:15:01.104445 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee2074a-ff1c-43fe-9cab-e4018ff5c638 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144067) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:15:01.105232 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee2074a-ff1c-43fe-9cab-e4018ff5c638 None admin] REQUEST_METHOD: `GET` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:15:01.105565 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee2074a-ff1c-43fe-9cab-e4018ff5c638 None admin] SCRIPT_NAME: `/identity` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:15:01.105895 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee2074a-ff1c-43fe-9cab-e4018ff5c638 None admin] PATH_INFO: `/v3/roles` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:15:01.106719 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ee2074a-ff1c-43fe-9cab-e4018ff5c638 None admin] RBAC: Adding query filter params (name=service) {{(pid=144067) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:15:01.107097 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ee2074a-ff1c-43fe-9cab-e4018ff5c638 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:15:01.108872 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ee2074a-ff1c-43fe-9cab-e4018ff5c638 None admin] RBAC: Authorization granted {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:15:01.128072 dv-cinder-851351-1-smb devstack@keystone.service[144067]: [pid: 144067|app: 0|req: 613/1236] 10.222.0.42 () {56 vars in 1103 bytes} [Thu Jul 28 08:15:00 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:15:01.129507 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8492d09-a091-4371-adf6-6bbde9abd7c8 None admin] Authenticating user token {{(pid=144068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:15:01.256052 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG dbcounter [-] [144068] Writing DB stats keystone:SELECT=100 {{(pid=144068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:15:01.278168 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8492d09-a091-4371-adf6-6bbde9abd7c8 None admin] Validating token access rules against request {{(pid=144068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:15:01.334538 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005bbae5-1230-4a67-b3f5-cc45272531b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:15:01.335413 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005bbae5-1230-4a67-b3f5-cc45272531b0 None admin] REQUEST_METHOD: `GET` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:15:01.335799 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005bbae5-1230-4a67-b3f5-cc45272531b0 None admin] SCRIPT_NAME: `/identity` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:15:01.336210 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005bbae5-1230-4a67-b3f5-cc45272531b0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:15:01.350940 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-005bbae5-1230-4a67-b3f5-cc45272531b0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:15:01.353056 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-005bbae5-1230-4a67-b3f5-cc45272531b0 None admin] RBAC: Authorization granted {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:15:01.375875 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application [None req-005bbae5-1230-4a67-b3f5-cc45272531b0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 08:15:01.375875 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:15:01.375875 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:15:01.375875 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:15:01.375875 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:15:01.375875 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:15:01.375875 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:15:01.375875 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:15:01.375875 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:15:01.375875 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:15:01.375875 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:15:01.375875 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:15:01.375875 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 08:15:01.375875 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 08:15:01.375875 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 08:15:01.378136 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 08:15:01.378136 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:15:01.378136 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:15:01.378136 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:15:01.378136 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:15:01.378136 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:15:01.378136 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:15:01.378136 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:15:01.378136 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application with Lock( Jul 28 08:15:01.378136 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:15:01.378136 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:15:01.378136 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:15:01.378136 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:15:01.378136 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:15:01.378136 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:15:01.378136 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:15:01.378136 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:15:01.379911 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 08:15:01.379911 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 08:15:01.379911 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 08:15:01.379911 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application Jul 28 08:15:01.379911 dv-cinder-851351-1-smb devstack@keystone.service[144068]: [pid: 144068|app: 0|req: 624/1237] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 08:15:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 249 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:15:01.387126 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee2074a-ff1c-43fe-9cab-e4018ff5c638 None admin] Authenticating user token {{(pid=144067) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:15:01.520923 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee2074a-ff1c-43fe-9cab-e4018ff5c638 None admin] Validating token access rules against request {{(pid=144067) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:15:01.534328 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG dbcounter [-] [144067] Writing DB stats keystone:SELECT=100 {{(pid=144067) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:15:01.570245 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-741d5467-09d5-4781-9e59-5b108787d842 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144067) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:15:01.571040 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741d5467-09d5-4781-9e59-5b108787d842 None admin] REQUEST_METHOD: `GET` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:15:01.571355 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741d5467-09d5-4781-9e59-5b108787d842 None admin] SCRIPT_NAME: `/identity` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:15:01.571708 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741d5467-09d5-4781-9e59-5b108787d842 None admin] PATH_INFO: `/v3/domains` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:15:01.572509 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-741d5467-09d5-4781-9e59-5b108787d842 None admin] RBAC: Adding query filter params (name=Default) {{(pid=144067) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:15:01.572911 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-741d5467-09d5-4781-9e59-5b108787d842 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:15:01.574443 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-741d5467-09d5-4781-9e59-5b108787d842 None admin] RBAC: Authorization granted {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:15:01.592008 dv-cinder-851351-1-smb devstack@keystone.service[144067]: [pid: 144067|app: 0|req: 614/1238] 10.222.0.42 () {56 vars in 1109 bytes} [Thu Jul 28 08:15:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:15:01.599290 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005bbae5-1230-4a67-b3f5-cc45272531b0 None admin] Authenticating user token {{(pid=144068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:15:01.760528 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005bbae5-1230-4a67-b3f5-cc45272531b0 None admin] Validating token access rules against request {{(pid=144068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:15:01.799423 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9513bf2-7da6-411f-9259-721529929acc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:15:01.800182 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9513bf2-7da6-411f-9259-721529929acc None admin] REQUEST_METHOD: `GET` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:15:01.800466 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9513bf2-7da6-411f-9259-721529929acc None admin] SCRIPT_NAME: `/identity` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:15:01.800767 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9513bf2-7da6-411f-9259-721529929acc None admin] PATH_INFO: `/v3/users/placement` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:15:01.804655 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG dbcounter [-] [144068] Writing DB stats keystone:SELECT=100 {{(pid=144068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:15:01.810674 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9513bf2-7da6-411f-9259-721529929acc None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:15:01.812967 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9513bf2-7da6-411f-9259-721529929acc None admin] RBAC: Authorization granted {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:15:01.827032 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application [None req-c9513bf2-7da6-411f-9259-721529929acc None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 28 08:15:01.827032 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:15:01.827032 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:15:01.827032 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:15:01.827032 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:15:01.827032 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:15:01.827032 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:15:01.827032 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:15:01.827032 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:15:01.827032 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:15:01.827032 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:15:01.827032 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:15:01.827032 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 28 08:15:01.827032 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 28 08:15:01.827032 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 28 08:15:01.827032 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 28 08:15:01.829210 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:15:01.829210 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:15:01.829210 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 28 08:15:01.829210 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 08:15:01.829210 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 28 08:15:01.829210 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 08:15:01.829210 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:15:01.829210 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:15:01.829210 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:15:01.829210 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:15:01.829210 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:15:01.829210 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application with Lock( Jul 28 08:15:01.829210 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:15:01.829210 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:15:01.829210 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:15:01.829210 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:15:01.829210 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:15:01.829210 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:15:01.830995 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:15:01.830995 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:15:01.830995 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 28 08:15:01.830995 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 28 08:15:01.830995 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 28 08:15:01.830995 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 28 08:15:01.830995 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 28 08:15:01.830995 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 28 08:15:01.830995 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 28 08:15:01.830995 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application Jul 28 08:15:01.830995 dv-cinder-851351-1-smb devstack@keystone.service[144068]: [pid: 144068|app: 0|req: 625/1239] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 08:15:01 2022] GET /identity/v3/users/placement => generated 87 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:15:01.836784 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-741d5467-09d5-4781-9e59-5b108787d842 None admin] Authenticating user token {{(pid=144067) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:15:01.987495 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-741d5467-09d5-4781-9e59-5b108787d842 None admin] Validating token access rules against request {{(pid=144067) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:15:02.036019 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a1aa48c-c6d7-4d69-a47f-982f028767b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144067) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:15:02.037156 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1aa48c-c6d7-4d69-a47f-982f028767b1 None admin] REQUEST_METHOD: `GET` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:15:02.037618 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1aa48c-c6d7-4d69-a47f-982f028767b1 None admin] SCRIPT_NAME: `/identity` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:15:02.038089 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1aa48c-c6d7-4d69-a47f-982f028767b1 None admin] PATH_INFO: `/v3/users` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:15:02.039757 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a1aa48c-c6d7-4d69-a47f-982f028767b1 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=144067) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:15:02.040252 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a1aa48c-c6d7-4d69-a47f-982f028767b1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:15:02.043042 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a1aa48c-c6d7-4d69-a47f-982f028767b1 None admin] RBAC: Authorization granted {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:15:02.079252 dv-cinder-851351-1-smb devstack@keystone.service[144067]: [pid: 144067|app: 0|req: 615/1240] 10.222.0.42 () {56 vars in 1143 bytes} [Thu Jul 28 08:15:01 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:15:02.088724 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9513bf2-7da6-411f-9259-721529929acc None admin] Authenticating user token {{(pid=144068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:15:02.234338 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9513bf2-7da6-411f-9259-721529929acc None admin] Validating token access rules against request {{(pid=144068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:15:02.281051 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78175bf-9700-42ca-b25d-ff09d6cd6656 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:15:02.281727 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78175bf-9700-42ca-b25d-ff09d6cd6656 None admin] REQUEST_METHOD: `GET` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:15:02.282035 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78175bf-9700-42ca-b25d-ff09d6cd6656 None admin] SCRIPT_NAME: `/identity` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:15:02.282311 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78175bf-9700-42ca-b25d-ff09d6cd6656 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:15:02.360022 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG dbcounter [-] [144068] Writing DB stats keystone:SELECT=100 {{(pid=144068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:15:02.368230 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e78175bf-9700-42ca-b25d-ff09d6cd6656 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:15:02.369814 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e78175bf-9700-42ca-b25d-ff09d6cd6656 None admin] RBAC: Authorization granted {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:15:02.504025 dv-cinder-851351-1-smb devstack@keystone.service[144068]: [pid: 144068|app: 0|req: 626/1241] 10.222.0.42 () {58 vars in 1282 bytes} [Thu Jul 28 08:15:02 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 417 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jul 28 08:15:02.512081 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a1aa48c-c6d7-4d69-a47f-982f028767b1 None admin] Authenticating user token {{(pid=144067) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:15:02.549872 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG dbcounter [-] [144067] Writing DB stats keystone:SELECT=100 {{(pid=144067) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:15:02.667218 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a1aa48c-c6d7-4d69-a47f-982f028767b1 None admin] Validating token access rules against request {{(pid=144067) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:15:02.745968 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703b6085-8f36-4043-b314-fc6b73ec182e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144067) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:15:02.747226 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703b6085-8f36-4043-b314-fc6b73ec182e None admin] REQUEST_METHOD: `GET` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:15:02.747739 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703b6085-8f36-4043-b314-fc6b73ec182e None admin] SCRIPT_NAME: `/identity` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:15:02.748222 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703b6085-8f36-4043-b314-fc6b73ec182e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:15:02.768897 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-703b6085-8f36-4043-b314-fc6b73ec182e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:15:02.770428 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-703b6085-8f36-4043-b314-fc6b73ec182e None admin] RBAC: Authorization granted {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:15:02.786914 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application [None req-703b6085-8f36-4043-b314-fc6b73ec182e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 08:15:02.786914 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:15:02.786914 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:15:02.786914 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:15:02.786914 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:15:02.786914 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:15:02.786914 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:15:02.786914 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:15:02.786914 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:15:02.786914 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:15:02.786914 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:15:02.786914 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:15:02.786914 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 08:15:02.786914 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 08:15:02.786914 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 08:15:02.788295 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 08:15:02.788295 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:15:02.788295 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:15:02.788295 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:15:02.788295 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:15:02.788295 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:15:02.788295 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:15:02.788295 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:15:02.788295 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application with Lock( Jul 28 08:15:02.788295 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:15:02.788295 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:15:02.788295 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:15:02.788295 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:15:02.788295 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:15:02.788295 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:15:02.788295 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:15:02.788295 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:15:02.789401 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 08:15:02.789401 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 08:15:02.789401 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 08:15:02.789401 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application Jul 28 08:15:02.789401 dv-cinder-851351-1-smb devstack@keystone.service[144067]: [pid: 144067|app: 0|req: 616/1242] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 08:15:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 277 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:15:02.794564 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78175bf-9700-42ca-b25d-ff09d6cd6656 None admin] Authenticating user token {{(pid=144068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:15:02.935491 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG dbcounter [-] [144068] Writing DB stats keystone:SELECT=100 {{(pid=144068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:15:02.942892 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78175bf-9700-42ca-b25d-ff09d6cd6656 None admin] Validating token access rules against request {{(pid=144068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:15:02.992483 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6131dd49-fc33-465b-a58b-729545ce1d98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:15:02.993225 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6131dd49-fc33-465b-a58b-729545ce1d98 None admin] REQUEST_METHOD: `GET` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:15:02.993568 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6131dd49-fc33-465b-a58b-729545ce1d98 None admin] SCRIPT_NAME: `/identity` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:15:02.993835 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6131dd49-fc33-465b-a58b-729545ce1d98 None admin] PATH_INFO: `/v3/domains` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:15:02.994662 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6131dd49-fc33-465b-a58b-729545ce1d98 None admin] RBAC: Adding query filter params (name=Default) {{(pid=144068) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:15:02.994985 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6131dd49-fc33-465b-a58b-729545ce1d98 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:15:02.996807 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6131dd49-fc33-465b-a58b-729545ce1d98 None admin] RBAC: Authorization granted {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:15:03.011180 dv-cinder-851351-1-smb devstack@keystone.service[144068]: [pid: 144068|app: 0|req: 627/1243] 10.222.0.42 () {56 vars in 1109 bytes} [Thu Jul 28 08:15:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 08:15:03.018129 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703b6085-8f36-4043-b314-fc6b73ec182e None admin] Authenticating user token {{(pid=144067) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:15:03.122331 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG dbcounter [-] [144067] Writing DB stats keystone:SELECT=100 {{(pid=144067) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:15:03.158467 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703b6085-8f36-4043-b314-fc6b73ec182e None admin] Validating token access rules against request {{(pid=144067) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:15:03.204554 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb1e259-b1be-451a-8f4e-b3233060d981 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144067) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:15:03.205268 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb1e259-b1be-451a-8f4e-b3233060d981 None admin] REQUEST_METHOD: `GET` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:15:03.205551 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb1e259-b1be-451a-8f4e-b3233060d981 None admin] SCRIPT_NAME: `/identity` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:15:03.205828 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb1e259-b1be-451a-8f4e-b3233060d981 None admin] PATH_INFO: `/v3/projects/service` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:15:03.213953 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bb1e259-b1be-451a-8f4e-b3233060d981 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:15:03.215451 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bb1e259-b1be-451a-8f4e-b3233060d981 None admin] RBAC: Authorization granted {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:15:03.228999 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application [None req-5bb1e259-b1be-451a-8f4e-b3233060d981 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 08:15:03.228999 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:15:03.228999 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:15:03.228999 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:15:03.228999 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:15:03.228999 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:15:03.228999 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:15:03.228999 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:15:03.228999 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:15:03.228999 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:15:03.228999 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:15:03.228999 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:15:03.228999 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 28 08:15:03.228999 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 28 08:15:03.228999 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 28 08:15:03.230943 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 28 08:15:03.230943 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:15:03.230943 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:15:03.230943 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:15:03.230943 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:15:03.230943 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:15:03.230943 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:15:03.230943 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:15:03.230943 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application with Lock( Jul 28 08:15:03.230943 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:15:03.230943 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:15:03.230943 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:15:03.230943 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:15:03.230943 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:15:03.230943 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:15:03.230943 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:15:03.230943 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:15:03.232411 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 28 08:15:03.232411 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 28 08:15:03.232411 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 28 08:15:03.232411 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 28 08:15:03.232411 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 28 08:15:03.232411 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 28 08:15:03.232411 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 08:15:03.232411 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application Jul 28 08:15:03.232411 dv-cinder-851351-1-smb devstack@keystone.service[144067]: [pid: 144067|app: 0|req: 617/1244] 10.222.0.42 () {56 vars in 1111 bytes} [Thu Jul 28 08:15:03 2022] GET /identity/v3/projects/service => generated 88 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 08:15:03.241487 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6131dd49-fc33-465b-a58b-729545ce1d98 None admin] Authenticating user token {{(pid=144068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:15:03.384246 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6131dd49-fc33-465b-a58b-729545ce1d98 None admin] Validating token access rules against request {{(pid=144068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:15:03.451480 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f3444e8-8f92-4b5d-85a4-901cf21bfa91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:15:03.452552 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3444e8-8f92-4b5d-85a4-901cf21bfa91 None admin] REQUEST_METHOD: `GET` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:15:03.452877 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3444e8-8f92-4b5d-85a4-901cf21bfa91 None admin] SCRIPT_NAME: `/identity` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:15:03.453234 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3444e8-8f92-4b5d-85a4-901cf21bfa91 None admin] PATH_INFO: `/v3/projects` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:15:03.454773 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f3444e8-8f92-4b5d-85a4-901cf21bfa91 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=144068) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:15:03.455364 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f3444e8-8f92-4b5d-85a4-901cf21bfa91 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:15:03.458095 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f3444e8-8f92-4b5d-85a4-901cf21bfa91 None admin] RBAC: Authorization granted {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:15:03.477699 dv-cinder-851351-1-smb devstack@keystone.service[144068]: [pid: 144068|app: 0|req: 628/1245] 10.222.0.42 () {56 vars in 1148 bytes} [Thu Jul 28 08:15:03 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:15:03.485220 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb1e259-b1be-451a-8f4e-b3233060d981 None admin] Authenticating user token {{(pid=144067) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:15:03.632320 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb1e259-b1be-451a-8f4e-b3233060d981 None admin] Validating token access rules against request {{(pid=144067) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:15:03.679324 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae66ad6-f429-4e75-91eb-0ef49de747c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144067) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:15:03.680458 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae66ad6-f429-4e75-91eb-0ef49de747c6 None admin] REQUEST_METHOD: `GET` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:15:03.681086 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae66ad6-f429-4e75-91eb-0ef49de747c6 None admin] SCRIPT_NAME: `/identity` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:15:03.681705 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae66ad6-f429-4e75-91eb-0ef49de747c6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:15:03.683234 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae66ad6-f429-4e75-91eb-0ef49de747c6 None admin] RBAC: Adding query filter params (role.id=9aa6ce92dcbb4164ac0e44d2aa2a0248, scope.project.id=fa39ab7491e5413ca648e31ee9177fa0, user.id=5f254b5035b6418db1fac08a128b3097) {{(pid=144067) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:15:03.684033 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae66ad6-f429-4e75-91eb-0ef49de747c6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:15:03.686913 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae66ad6-f429-4e75-91eb-0ef49de747c6 None admin] RBAC: Authorization granted {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:15:03.699429 dv-cinder-851351-1-smb devstack@keystone.service[144067]: [pid: 144067|app: 0|req: 618/1246] 10.222.0.42 () {56 vars in 1374 bytes} [Thu Jul 28 08:15:03 2022] GET /identity/v3/role_assignments?user.id=5f254b5035b6418db1fac08a128b3097&scope.project.id=fa39ab7491e5413ca648e31ee9177fa0&role.id=9aa6ce92dcbb4164ac0e44d2aa2a0248 => generated 608 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:15:06.102823 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d242fa-3ad6-4cf4-be4d-624d7b78f2ac None None] REQUEST_METHOD: `GET` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:15:06.103408 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d242fa-3ad6-4cf4-be4d-624d7b78f2ac None None] SCRIPT_NAME: `/identity` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:15:06.103408 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d242fa-3ad6-4cf4-be4d-624d7b78f2ac None None] PATH_INFO: `/` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:15:06.104859 dv-cinder-851351-1-smb devstack@keystone.service[144068]: [pid: 144068|app: 0|req: 629/1247] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 08:15:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 08:15:06.111092 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94190df0-5454-48dd-b264-7d1bc04b1b8f None None] REQUEST_METHOD: `POST` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:15:06.111644 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94190df0-5454-48dd-b264-7d1bc04b1b8f None None] SCRIPT_NAME: `/identity` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:15:06.111734 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94190df0-5454-48dd-b264-7d1bc04b1b8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:15:06.121486 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG dbcounter [-] [144067] Writing DB stats keystone:SELECT=100 {{(pid=144067) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:15:06.138520 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.auth.core [None req-94190df0-5454-48dd-b264-7d1bc04b1b8f None None] MFA Rules not processed for user `bf5ceb8f07374635ad506b7d1b4f1612`. Rule list: `[]` (Enabled: `True`). {{(pid=144067) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 08:15:06.140068 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.fernet_utils [None req-94190df0-5454-48dd-b264-7d1bc04b1b8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=144067) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:15:06.228373 dv-cinder-851351-1-smb devstack@keystone.service[144067]: [pid: 144067|app: 0|req: 619/1248] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 08:15:06 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 28 08:15:06.254183 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d242fa-3ad6-4cf4-be4d-624d7b78f2ac None None] Authenticating user token {{(pid=144068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:15:06.281228 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG dbcounter [-] [144068] Writing DB stats keystone:SELECT=100 {{(pid=144068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:15:06.402141 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d242fa-3ad6-4cf4-be4d-624d7b78f2ac None None] Validating token access rules against request {{(pid=144068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:15:06.454480 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7640dfa-ffeb-4eb2-8331-aeded7018ca0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:15:06.455666 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7640dfa-ffeb-4eb2-8331-aeded7018ca0 None admin] REQUEST_METHOD: `GET` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:15:06.456158 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7640dfa-ffeb-4eb2-8331-aeded7018ca0 None admin] SCRIPT_NAME: `/identity` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:15:06.456642 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7640dfa-ffeb-4eb2-8331-aeded7018ca0 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:15:06.474576 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7640dfa-ffeb-4eb2-8331-aeded7018ca0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 08:15:06.482219 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application [None req-c7640dfa-ffeb-4eb2-8331-aeded7018ca0 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 08:15:06.482219 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:15:06.482219 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:15:06.482219 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:15:06.482219 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:15:06.482219 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:15:06.482219 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:15:06.482219 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:15:06.482219 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:15:06.482219 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:15:06.482219 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:15:06.482219 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:15:06.482219 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 08:15:06.482219 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 08:15:06.482219 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 08:15:06.482219 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 08:15:06.483986 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 08:15:06.483986 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 08:15:06.483986 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 08:15:06.483986 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 08:15:06.483986 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:15:06.483986 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:15:06.483986 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:15:06.483986 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:15:06.483986 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:15:06.483986 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:15:06.483986 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:15:06.483986 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application with Lock( Jul 28 08:15:06.483986 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:15:06.483986 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:15:06.483986 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:15:06.483986 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:15:06.485812 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:15:06.485812 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:15:06.485812 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:15:06.485812 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:15:06.485812 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 08:15:06.485812 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 08:15:06.485812 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 08:15:06.485812 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 08:15:06.485812 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 08:15:06.485812 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 08:15:06.485812 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 08:15:06.485812 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application Jul 28 08:15:06.485812 dv-cinder-851351-1-smb devstack@keystone.service[144068]: [pid: 144068|app: 0|req: 630/1249] 10.222.0.42 () {56 vars in 1096 bytes} [Thu Jul 28 08:15:06 2022] GET /identity/v3/roles/admin => generated 83 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:15:06.493610 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94190df0-5454-48dd-b264-7d1bc04b1b8f None None] Authenticating user token {{(pid=144067) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:15:06.639528 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94190df0-5454-48dd-b264-7d1bc04b1b8f None None] Validating token access rules against request {{(pid=144067) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:15:06.681942 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG dbcounter [-] [144067] Writing DB stats keystone:SELECT=100 {{(pid=144067) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:15:06.691201 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7a7a8c-ea22-474f-9a30-a0d1993c4626 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144067) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:15:06.692305 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7a7a8c-ea22-474f-9a30-a0d1993c4626 None admin] REQUEST_METHOD: `GET` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:15:06.693103 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7a7a8c-ea22-474f-9a30-a0d1993c4626 None admin] SCRIPT_NAME: `/identity` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:15:06.693501 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7a7a8c-ea22-474f-9a30-a0d1993c4626 None admin] PATH_INFO: `/v3/roles` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:15:06.694293 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d7a7a8c-ea22-474f-9a30-a0d1993c4626 None admin] RBAC: Adding query filter params (name=admin) {{(pid=144067) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:15:06.694666 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d7a7a8c-ea22-474f-9a30-a0d1993c4626 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:15:06.696140 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d7a7a8c-ea22-474f-9a30-a0d1993c4626 None admin] RBAC: Authorization granted {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:15:06.706848 dv-cinder-851351-1-smb devstack@keystone.service[144067]: [pid: 144067|app: 0|req: 620/1250] 10.222.0.42 () {56 vars in 1099 bytes} [Thu Jul 28 08:15:06 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:15:06.715541 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7640dfa-ffeb-4eb2-8331-aeded7018ca0 None admin] Authenticating user token {{(pid=144068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:15:06.841506 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG dbcounter [-] [144068] Writing DB stats keystone:SELECT=100 {{(pid=144068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:15:06.871333 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7640dfa-ffeb-4eb2-8331-aeded7018ca0 None admin] Validating token access rules against request {{(pid=144068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:15:06.922022 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d9110f-1dd3-4c6d-8cda-79f4e6af9586 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:15:06.923129 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d9110f-1dd3-4c6d-8cda-79f4e6af9586 None admin] REQUEST_METHOD: `GET` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:15:06.923639 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d9110f-1dd3-4c6d-8cda-79f4e6af9586 None admin] SCRIPT_NAME: `/identity` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:15:06.924125 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d9110f-1dd3-4c6d-8cda-79f4e6af9586 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:15:06.939202 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d9110f-1dd3-4c6d-8cda-79f4e6af9586 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:15:06.941684 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d9110f-1dd3-4c6d-8cda-79f4e6af9586 None admin] RBAC: Authorization granted {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:15:06.967322 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application [None req-d4d9110f-1dd3-4c6d-8cda-79f4e6af9586 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 08:15:06.967322 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:15:06.967322 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:15:06.967322 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:15:06.967322 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:15:06.967322 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:15:06.967322 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:15:06.967322 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:15:06.967322 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:15:06.967322 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:15:06.967322 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:15:06.967322 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:15:06.967322 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 08:15:06.967322 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 08:15:06.967322 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 08:15:06.969032 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 08:15:06.969032 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:15:06.969032 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:15:06.969032 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:15:06.969032 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:15:06.969032 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:15:06.969032 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:15:06.969032 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:15:06.969032 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application with Lock( Jul 28 08:15:06.969032 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:15:06.969032 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:15:06.969032 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:15:06.969032 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:15:06.969032 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:15:06.969032 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:15:06.969032 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:15:06.969032 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:15:06.970557 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 08:15:06.970557 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 08:15:06.970557 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 08:15:06.970557 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application Jul 28 08:15:06.970557 dv-cinder-851351-1-smb devstack@keystone.service[144068]: [pid: 144068|app: 0|req: 631/1251] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 08:15:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 255 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:15:06.978794 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7a7a8c-ea22-474f-9a30-a0d1993c4626 None admin] Authenticating user token {{(pid=144067) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:15:07.119635 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7a7a8c-ea22-474f-9a30-a0d1993c4626 None admin] Validating token access rules against request {{(pid=144067) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:15:07.171253 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc5e4672-3d78-4c72-b427-4b2a645d96b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144067) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:15:07.172484 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5e4672-3d78-4c72-b427-4b2a645d96b8 None admin] REQUEST_METHOD: `GET` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:15:07.173113 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5e4672-3d78-4c72-b427-4b2a645d96b8 None admin] SCRIPT_NAME: `/identity` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:15:07.173654 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5e4672-3d78-4c72-b427-4b2a645d96b8 None admin] PATH_INFO: `/v3/domains` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:15:07.175267 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc5e4672-3d78-4c72-b427-4b2a645d96b8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=144067) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:15:07.175804 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc5e4672-3d78-4c72-b427-4b2a645d96b8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:15:07.178535 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc5e4672-3d78-4c72-b427-4b2a645d96b8 None admin] RBAC: Authorization granted {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:15:07.194996 dv-cinder-851351-1-smb devstack@keystone.service[144067]: [pid: 144067|app: 0|req: 621/1252] 10.222.0.42 () {56 vars in 1109 bytes} [Thu Jul 28 08:15:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:15:07.202896 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d9110f-1dd3-4c6d-8cda-79f4e6af9586 None admin] Authenticating user token {{(pid=144068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:15:07.362901 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d9110f-1dd3-4c6d-8cda-79f4e6af9586 None admin] Validating token access rules against request {{(pid=144068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:15:07.408592 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG dbcounter [-] [144068] Writing DB stats keystone:SELECT=100 {{(pid=144068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:15:07.420301 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed4cc2e-a26a-4da2-a311-d858417205fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:15:07.421205 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed4cc2e-a26a-4da2-a311-d858417205fd None admin] REQUEST_METHOD: `GET` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:15:07.421570 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed4cc2e-a26a-4da2-a311-d858417205fd None admin] SCRIPT_NAME: `/identity` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:15:07.421895 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed4cc2e-a26a-4da2-a311-d858417205fd None admin] PATH_INFO: `/v3/users/placement` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:15:07.433386 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ed4cc2e-a26a-4da2-a311-d858417205fd None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:15:07.435148 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ed4cc2e-a26a-4da2-a311-d858417205fd None admin] RBAC: Authorization granted {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:15:07.449877 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application [None req-3ed4cc2e-a26a-4da2-a311-d858417205fd None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 28 08:15:07.449877 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:15:07.449877 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:15:07.449877 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:15:07.449877 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:15:07.449877 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:15:07.449877 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:15:07.449877 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:15:07.449877 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:15:07.449877 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:15:07.449877 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:15:07.449877 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:15:07.449877 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 28 08:15:07.449877 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 28 08:15:07.449877 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 28 08:15:07.449877 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 28 08:15:07.452405 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:15:07.452405 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:15:07.452405 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 28 08:15:07.452405 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 08:15:07.452405 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 28 08:15:07.452405 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 08:15:07.452405 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:15:07.452405 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:15:07.452405 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:15:07.452405 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:15:07.452405 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:15:07.452405 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application with Lock( Jul 28 08:15:07.452405 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:15:07.452405 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:15:07.452405 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:15:07.452405 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:15:07.452405 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:15:07.452405 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:15:07.454365 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:15:07.454365 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:15:07.454365 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 28 08:15:07.454365 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 28 08:15:07.454365 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 28 08:15:07.454365 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 28 08:15:07.454365 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 28 08:15:07.454365 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 28 08:15:07.454365 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 28 08:15:07.454365 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application Jul 28 08:15:07.454365 dv-cinder-851351-1-smb devstack@keystone.service[144068]: [pid: 144068|app: 0|req: 632/1253] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 08:15:07 2022] GET /identity/v3/users/placement => generated 87 bytes in 250 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 08:15:07.462356 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc5e4672-3d78-4c72-b427-4b2a645d96b8 None admin] Authenticating user token {{(pid=144067) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:15:07.540926 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG dbcounter [-] [144067] Writing DB stats keystone:SELECT=100 {{(pid=144067) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:15:07.601194 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc5e4672-3d78-4c72-b427-4b2a645d96b8 None admin] Validating token access rules against request {{(pid=144067) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:15:07.656997 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea5bd47-959f-40c3-9937-e1988282d62f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144067) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:15:07.657755 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea5bd47-959f-40c3-9937-e1988282d62f None admin] REQUEST_METHOD: `GET` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:15:07.658127 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea5bd47-959f-40c3-9937-e1988282d62f None admin] SCRIPT_NAME: `/identity` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:15:07.658652 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea5bd47-959f-40c3-9937-e1988282d62f None admin] PATH_INFO: `/v3/users` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:15:07.660575 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bea5bd47-959f-40c3-9937-e1988282d62f None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=144067) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:15:07.661200 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bea5bd47-959f-40c3-9937-e1988282d62f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:15:07.663951 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bea5bd47-959f-40c3-9937-e1988282d62f None admin] RBAC: Authorization granted {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:15:07.689487 dv-cinder-851351-1-smb devstack@keystone.service[144067]: [pid: 144067|app: 0|req: 622/1254] 10.222.0.42 () {56 vars in 1143 bytes} [Thu Jul 28 08:15:07 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:15:07.697237 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed4cc2e-a26a-4da2-a311-d858417205fd None admin] Authenticating user token {{(pid=144068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:15:07.837532 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed4cc2e-a26a-4da2-a311-d858417205fd None admin] Validating token access rules against request {{(pid=144068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:15:07.877824 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b0abd1-f2e4-4f86-8296-9ecaff4fc716 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:15:07.878477 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b0abd1-f2e4-4f86-8296-9ecaff4fc716 None admin] REQUEST_METHOD: `GET` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:15:07.878783 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b0abd1-f2e4-4f86-8296-9ecaff4fc716 None admin] SCRIPT_NAME: `/identity` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:15:07.879132 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b0abd1-f2e4-4f86-8296-9ecaff4fc716 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:15:07.962061 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG dbcounter [-] [144068] Writing DB stats keystone:SELECT=100 {{(pid=144068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:15:07.979360 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29b0abd1-f2e4-4f86-8296-9ecaff4fc716 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:15:07.980889 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29b0abd1-f2e4-4f86-8296-9ecaff4fc716 None admin] RBAC: Authorization granted {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:15:08.121327 dv-cinder-851351-1-smb devstack@keystone.service[144068]: [pid: 144068|app: 0|req: 633/1255] 10.222.0.42 () {58 vars in 1282 bytes} [Thu Jul 28 08:15:07 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 425 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 28 08:15:08.129172 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea5bd47-959f-40c3-9937-e1988282d62f None admin] Authenticating user token {{(pid=144067) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:15:08.269723 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea5bd47-959f-40c3-9937-e1988282d62f None admin] Validating token access rules against request {{(pid=144067) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:15:08.286321 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG dbcounter [-] [144067] Writing DB stats keystone:SELECT=100 {{(pid=144067) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:15:08.315674 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac7df1b-0bf8-452e-87f4-a997c9cfa5c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144067) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:15:08.316584 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac7df1b-0bf8-452e-87f4-a997c9cfa5c5 None admin] REQUEST_METHOD: `GET` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:15:08.316896 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac7df1b-0bf8-452e-87f4-a997c9cfa5c5 None admin] SCRIPT_NAME: `/identity` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:15:08.317203 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac7df1b-0bf8-452e-87f4-a997c9cfa5c5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:15:08.334277 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eac7df1b-0bf8-452e-87f4-a997c9cfa5c5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:15:08.335812 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eac7df1b-0bf8-452e-87f4-a997c9cfa5c5 None admin] RBAC: Authorization granted {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:15:08.353411 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application [None req-eac7df1b-0bf8-452e-87f4-a997c9cfa5c5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 08:15:08.353411 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:15:08.353411 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:15:08.353411 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:15:08.353411 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:15:08.353411 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:15:08.353411 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:15:08.353411 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:15:08.353411 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:15:08.353411 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:15:08.353411 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:15:08.353411 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:15:08.353411 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 08:15:08.353411 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 08:15:08.353411 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 08:15:08.354369 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 08:15:08.354369 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:15:08.354369 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:15:08.354369 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:15:08.354369 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:15:08.354369 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:15:08.354369 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:15:08.354369 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:15:08.354369 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application with Lock( Jul 28 08:15:08.354369 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:15:08.354369 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:15:08.354369 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:15:08.354369 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:15:08.354369 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:15:08.354369 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:15:08.354369 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:15:08.354369 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:15:08.360484 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 08:15:08.360484 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 08:15:08.360484 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 08:15:08.360484 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application Jul 28 08:15:08.360484 dv-cinder-851351-1-smb devstack@keystone.service[144067]: [pid: 144067|app: 0|req: 623/1256] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 08:15:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:15:08.362740 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b0abd1-f2e4-4f86-8296-9ecaff4fc716 None admin] Authenticating user token {{(pid=144068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:15:08.500907 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG dbcounter [-] [144068] Writing DB stats keystone:SELECT=100 {{(pid=144068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:15:08.524220 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b0abd1-f2e4-4f86-8296-9ecaff4fc716 None admin] Validating token access rules against request {{(pid=144068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:15:08.578656 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8965a2-8da7-4d4b-8a59-8a0f6b33c3f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:15:08.580014 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8965a2-8da7-4d4b-8a59-8a0f6b33c3f4 None admin] REQUEST_METHOD: `GET` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:15:08.580559 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8965a2-8da7-4d4b-8a59-8a0f6b33c3f4 None admin] SCRIPT_NAME: `/identity` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:15:08.581111 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8965a2-8da7-4d4b-8a59-8a0f6b33c3f4 None admin] PATH_INFO: `/v3/domains` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:15:08.582680 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e8965a2-8da7-4d4b-8a59-8a0f6b33c3f4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=144068) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:15:08.583218 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e8965a2-8da7-4d4b-8a59-8a0f6b33c3f4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:15:08.586292 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e8965a2-8da7-4d4b-8a59-8a0f6b33c3f4 None admin] RBAC: Authorization granted {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:15:08.617149 dv-cinder-851351-1-smb devstack@keystone.service[144068]: [pid: 144068|app: 0|req: 634/1257] 10.222.0.42 () {56 vars in 1109 bytes} [Thu Jul 28 08:15:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:15:08.619404 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac7df1b-0bf8-452e-87f4-a997c9cfa5c5 None admin] Authenticating user token {{(pid=144067) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:15:08.766666 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac7df1b-0bf8-452e-87f4-a997c9cfa5c5 None admin] Validating token access rules against request {{(pid=144067) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:15:08.814222 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ea70a2-ab06-4ba8-ad8d-49d18c9a71de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144067) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:15:08.815779 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ea70a2-ab06-4ba8-ad8d-49d18c9a71de None admin] REQUEST_METHOD: `GET` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:15:08.816253 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ea70a2-ab06-4ba8-ad8d-49d18c9a71de None admin] SCRIPT_NAME: `/identity` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:15:08.816755 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ea70a2-ab06-4ba8-ad8d-49d18c9a71de None admin] PATH_INFO: `/v3/projects/service` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:15:08.828451 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45ea70a2-ab06-4ba8-ad8d-49d18c9a71de None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:15:08.830690 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45ea70a2-ab06-4ba8-ad8d-49d18c9a71de None admin] RBAC: Authorization granted {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:15:08.846958 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application [None req-45ea70a2-ab06-4ba8-ad8d-49d18c9a71de None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 08:15:08.846958 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:15:08.846958 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:15:08.846958 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:15:08.846958 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:15:08.846958 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:15:08.846958 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:15:08.846958 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:15:08.846958 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:15:08.846958 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:15:08.846958 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:15:08.846958 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:15:08.846958 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 28 08:15:08.846958 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 28 08:15:08.846958 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 28 08:15:08.848936 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 28 08:15:08.848936 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:15:08.848936 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:15:08.848936 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:15:08.848936 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:15:08.848936 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:15:08.848936 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:15:08.848936 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:15:08.848936 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application with Lock( Jul 28 08:15:08.848936 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:15:08.848936 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:15:08.848936 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:15:08.848936 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:15:08.848936 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:15:08.848936 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:15:08.848936 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:15:08.848936 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:15:08.850063 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 28 08:15:08.850063 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 28 08:15:08.850063 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 28 08:15:08.850063 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 28 08:15:08.850063 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 28 08:15:08.850063 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 28 08:15:08.850063 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 08:15:08.850063 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application Jul 28 08:15:08.850063 dv-cinder-851351-1-smb devstack@keystone.service[144067]: [pid: 144067|app: 0|req: 624/1258] 10.222.0.42 () {56 vars in 1111 bytes} [Thu Jul 28 08:15:08 2022] GET /identity/v3/projects/service => generated 88 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:15:08.855442 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8965a2-8da7-4d4b-8a59-8a0f6b33c3f4 None admin] Authenticating user token {{(pid=144068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:15:09.004639 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8965a2-8da7-4d4b-8a59-8a0f6b33c3f4 None admin] Validating token access rules against request {{(pid=144068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:15:09.048884 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4403bc43-77cf-42b1-98cd-9509959dfe5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:15:09.049732 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4403bc43-77cf-42b1-98cd-9509959dfe5e None admin] REQUEST_METHOD: `GET` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:15:09.050133 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4403bc43-77cf-42b1-98cd-9509959dfe5e None admin] SCRIPT_NAME: `/identity` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:15:09.050501 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4403bc43-77cf-42b1-98cd-9509959dfe5e None admin] PATH_INFO: `/v3/projects` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:15:09.051425 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4403bc43-77cf-42b1-98cd-9509959dfe5e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=144068) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:15:09.051944 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4403bc43-77cf-42b1-98cd-9509959dfe5e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:15:09.053919 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4403bc43-77cf-42b1-98cd-9509959dfe5e None admin] RBAC: Authorization granted {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:15:09.079770 dv-cinder-851351-1-smb devstack@keystone.service[144068]: [pid: 144068|app: 0|req: 635/1259] 10.222.0.42 () {56 vars in 1148 bytes} [Thu Jul 28 08:15:08 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:15:09.082696 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ea70a2-ab06-4ba8-ad8d-49d18c9a71de None admin] Authenticating user token {{(pid=144067) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:15:09.125646 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG dbcounter [-] [144067] Writing DB stats keystone:SELECT=100 {{(pid=144067) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:15:09.252016 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ea70a2-ab06-4ba8-ad8d-49d18c9a71de None admin] Validating token access rules against request {{(pid=144067) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:15:09.307269 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa569a1-1593-42a6-9193-b60e11581088 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144067) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:15:09.307927 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa569a1-1593-42a6-9193-b60e11581088 None admin] REQUEST_METHOD: `GET` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:15:09.308215 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa569a1-1593-42a6-9193-b60e11581088 None admin] SCRIPT_NAME: `/identity` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:15:09.308487 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa569a1-1593-42a6-9193-b60e11581088 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:15:09.309349 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfa569a1-1593-42a6-9193-b60e11581088 None admin] RBAC: Adding query filter params (role.id=d1020e7bb0b7411d895ddedd6dc02c5b, scope.project.id=fa39ab7491e5413ca648e31ee9177fa0, user.id=5f254b5035b6418db1fac08a128b3097) {{(pid=144067) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:15:09.309671 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfa569a1-1593-42a6-9193-b60e11581088 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:15:09.311185 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfa569a1-1593-42a6-9193-b60e11581088 None admin] RBAC: Authorization granted {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:15:09.318422 dv-cinder-851351-1-smb devstack@keystone.service[144067]: [pid: 144067|app: 0|req: 625/1260] 10.222.0.42 () {56 vars in 1374 bytes} [Thu Jul 28 08:15:09 2022] GET /identity/v3/role_assignments?user.id=5f254b5035b6418db1fac08a128b3097&scope.project.id=fa39ab7491e5413ca648e31ee9177fa0&role.id=d1020e7bb0b7411d895ddedd6dc02c5b => generated 259 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:15:11.670397 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d805d77e-191f-465e-a499-2c31b4b5e33e None None] REQUEST_METHOD: `GET` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:15:11.671039 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d805d77e-191f-465e-a499-2c31b4b5e33e None None] SCRIPT_NAME: `/identity` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:15:11.671039 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d805d77e-191f-465e-a499-2c31b4b5e33e None None] PATH_INFO: `/` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:15:11.672716 dv-cinder-851351-1-smb devstack@keystone.service[144068]: [pid: 144068|app: 0|req: 636/1261] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 08:15:11 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 08:15:11.683911 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f98ce02-414e-4781-9163-91608150ed17 None None] REQUEST_METHOD: `POST` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:15:11.683911 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f98ce02-414e-4781-9163-91608150ed17 None None] SCRIPT_NAME: `/identity` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:15:11.683911 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f98ce02-414e-4781-9163-91608150ed17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:15:11.704288 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.auth.core [None req-3f98ce02-414e-4781-9163-91608150ed17 None None] MFA Rules not processed for user `bf5ceb8f07374635ad506b7d1b4f1612`. Rule list: `[]` (Enabled: `True`). {{(pid=144067) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 08:15:11.705936 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.fernet_utils [None req-3f98ce02-414e-4781-9163-91608150ed17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=144067) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:15:11.812343 dv-cinder-851351-1-smb devstack@keystone.service[144067]: [pid: 144067|app: 0|req: 626/1262] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 08:15:11 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 08:15:11.836603 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d805d77e-191f-465e-a499-2c31b4b5e33e None None] Authenticating user token {{(pid=144068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:15:11.850088 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG dbcounter [-] [144068] Writing DB stats keystone:SELECT=100 {{(pid=144068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:15:11.972832 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d805d77e-191f-465e-a499-2c31b4b5e33e None None] Validating token access rules against request {{(pid=144068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:15:12.030613 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c05ac36-7473-46a9-b93e-b0b893e9edcb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:15:12.031925 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c05ac36-7473-46a9-b93e-b0b893e9edcb None admin] REQUEST_METHOD: `GET` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:15:12.032410 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c05ac36-7473-46a9-b93e-b0b893e9edcb None admin] SCRIPT_NAME: `/identity` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:15:12.035882 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c05ac36-7473-46a9-b93e-b0b893e9edcb None admin] PATH_INFO: `/v3/roles/admin` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:15:12.052743 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c05ac36-7473-46a9-b93e-b0b893e9edcb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 08:15:12.059405 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application [None req-1c05ac36-7473-46a9-b93e-b0b893e9edcb None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 08:15:12.059405 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:15:12.059405 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:15:12.059405 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:15:12.059405 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:15:12.059405 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:15:12.059405 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:15:12.059405 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:15:12.059405 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:15:12.059405 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:15:12.059405 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:15:12.059405 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:15:12.059405 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 08:15:12.059405 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 08:15:12.059405 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 08:15:12.059405 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 08:15:12.060710 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 08:15:12.060710 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 08:15:12.060710 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 08:15:12.060710 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 08:15:12.060710 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:15:12.060710 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:15:12.060710 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:15:12.060710 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:15:12.060710 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:15:12.060710 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:15:12.060710 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:15:12.060710 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application with Lock( Jul 28 08:15:12.060710 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:15:12.060710 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:15:12.060710 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:15:12.060710 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:15:12.061739 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:15:12.061739 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:15:12.061739 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:15:12.061739 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:15:12.061739 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 08:15:12.061739 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 08:15:12.061739 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 08:15:12.061739 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 08:15:12.061739 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 08:15:12.061739 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 08:15:12.061739 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 08:15:12.061739 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application Jul 28 08:15:12.061739 dv-cinder-851351-1-smb devstack@keystone.service[144068]: [pid: 144068|app: 0|req: 637/1263] 10.222.0.42 () {56 vars in 1096 bytes} [Thu Jul 28 08:15:11 2022] GET /identity/v3/roles/admin => generated 83 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 08:15:12.069726 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f98ce02-414e-4781-9163-91608150ed17 None None] Authenticating user token {{(pid=144067) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:15:12.095007 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG dbcounter [-] [144067] Writing DB stats keystone:SELECT=100 {{(pid=144067) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:15:12.207133 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f98ce02-414e-4781-9163-91608150ed17 None None] Validating token access rules against request {{(pid=144067) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:15:12.260977 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34178f18-e2ff-4098-a2b4-85c8e380e495 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144067) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:15:12.262236 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34178f18-e2ff-4098-a2b4-85c8e380e495 None admin] REQUEST_METHOD: `GET` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:15:12.262646 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34178f18-e2ff-4098-a2b4-85c8e380e495 None admin] SCRIPT_NAME: `/identity` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:15:12.262931 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34178f18-e2ff-4098-a2b4-85c8e380e495 None admin] PATH_INFO: `/v3/roles` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:15:12.264129 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34178f18-e2ff-4098-a2b4-85c8e380e495 None admin] RBAC: Adding query filter params (name=admin) {{(pid=144067) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:15:12.264499 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34178f18-e2ff-4098-a2b4-85c8e380e495 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:15:12.266057 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34178f18-e2ff-4098-a2b4-85c8e380e495 None admin] RBAC: Authorization granted {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:15:12.280358 dv-cinder-851351-1-smb devstack@keystone.service[144067]: [pid: 144067|app: 0|req: 627/1264] 10.222.0.42 () {56 vars in 1099 bytes} [Thu Jul 28 08:15:12 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:15:12.287853 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c05ac36-7473-46a9-b93e-b0b893e9edcb None admin] Authenticating user token {{(pid=144068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:15:12.400138 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG dbcounter [-] [144068] Writing DB stats keystone:SELECT=100 {{(pid=144068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:15:12.448490 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c05ac36-7473-46a9-b93e-b0b893e9edcb None admin] Validating token access rules against request {{(pid=144068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:15:12.491932 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad89632-3f39-48cd-8e70-7aeefee0e8aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:15:12.492612 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad89632-3f39-48cd-8e70-7aeefee0e8aa None admin] REQUEST_METHOD: `GET` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:15:12.492965 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad89632-3f39-48cd-8e70-7aeefee0e8aa None admin] SCRIPT_NAME: `/identity` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:15:12.493472 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad89632-3f39-48cd-8e70-7aeefee0e8aa None admin] PATH_INFO: `/v3/domains/Default` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:15:12.506833 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fad89632-3f39-48cd-8e70-7aeefee0e8aa None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:15:12.508536 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fad89632-3f39-48cd-8e70-7aeefee0e8aa None admin] RBAC: Authorization granted {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:15:12.532286 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application [None req-fad89632-3f39-48cd-8e70-7aeefee0e8aa None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 08:15:12.532286 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:15:12.532286 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:15:12.532286 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:15:12.532286 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:15:12.532286 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:15:12.532286 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:15:12.532286 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:15:12.532286 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:15:12.532286 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:15:12.532286 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:15:12.532286 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:15:12.532286 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 08:15:12.532286 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 08:15:12.532286 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 08:15:12.533386 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 08:15:12.533386 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:15:12.533386 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:15:12.533386 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:15:12.533386 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:15:12.533386 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:15:12.533386 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:15:12.533386 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:15:12.533386 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application with Lock( Jul 28 08:15:12.533386 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:15:12.533386 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:15:12.533386 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:15:12.533386 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:15:12.533386 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:15:12.533386 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:15:12.533386 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:15:12.533386 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:15:12.534332 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 08:15:12.534332 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 08:15:12.534332 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 08:15:12.534332 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application Jul 28 08:15:12.534773 dv-cinder-851351-1-smb devstack@keystone.service[144068]: [pid: 144068|app: 0|req: 638/1265] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 08:15:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 248 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 08:15:12.540831 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34178f18-e2ff-4098-a2b4-85c8e380e495 None admin] Authenticating user token {{(pid=144067) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:15:12.646884 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG dbcounter [-] [144067] Writing DB stats keystone:SELECT=100 {{(pid=144067) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:15:12.679883 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34178f18-e2ff-4098-a2b4-85c8e380e495 None admin] Validating token access rules against request {{(pid=144067) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:15:12.748099 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25652513-43f8-4b72-90ef-a060a7a32fde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144067) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:15:12.749904 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25652513-43f8-4b72-90ef-a060a7a32fde None admin] REQUEST_METHOD: `GET` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:15:12.750687 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25652513-43f8-4b72-90ef-a060a7a32fde None admin] SCRIPT_NAME: `/identity` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:15:12.751524 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25652513-43f8-4b72-90ef-a060a7a32fde None admin] PATH_INFO: `/v3/domains` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:15:12.754636 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25652513-43f8-4b72-90ef-a060a7a32fde None admin] RBAC: Adding query filter params (name=Default) {{(pid=144067) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:15:12.755468 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25652513-43f8-4b72-90ef-a060a7a32fde None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:15:12.759242 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25652513-43f8-4b72-90ef-a060a7a32fde None admin] RBAC: Authorization granted {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:15:12.789485 dv-cinder-851351-1-smb devstack@keystone.service[144067]: [pid: 144067|app: 0|req: 628/1266] 10.222.0.42 () {56 vars in 1109 bytes} [Thu Jul 28 08:15:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:15:12.791069 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad89632-3f39-48cd-8e70-7aeefee0e8aa None admin] Authenticating user token {{(pid=144068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:15:12.915638 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad89632-3f39-48cd-8e70-7aeefee0e8aa None admin] Validating token access rules against request {{(pid=144068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:15:12.939714 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG dbcounter [-] [144068] Writing DB stats keystone:SELECT=100 {{(pid=144068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:15:12.959861 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9aab1e-6004-48be-a447-7a778e9f8efe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:15:12.961123 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9aab1e-6004-48be-a447-7a778e9f8efe None admin] REQUEST_METHOD: `GET` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:15:12.961702 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9aab1e-6004-48be-a447-7a778e9f8efe None admin] SCRIPT_NAME: `/identity` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:15:12.962334 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9aab1e-6004-48be-a447-7a778e9f8efe None admin] PATH_INFO: `/v3/users/placement` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:15:12.977874 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba9aab1e-6004-48be-a447-7a778e9f8efe None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:15:12.981297 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba9aab1e-6004-48be-a447-7a778e9f8efe None admin] RBAC: Authorization granted {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:15:12.999915 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application [None req-ba9aab1e-6004-48be-a447-7a778e9f8efe None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 28 08:15:12.999915 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:15:12.999915 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:15:12.999915 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:15:12.999915 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:15:12.999915 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:15:12.999915 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:15:12.999915 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:15:12.999915 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:15:12.999915 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:15:12.999915 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:15:12.999915 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:15:12.999915 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 28 08:15:12.999915 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 28 08:15:12.999915 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 28 08:15:12.999915 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 28 08:15:13.001176 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:15:13.001176 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:15:13.001176 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 28 08:15:13.001176 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 08:15:13.001176 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 28 08:15:13.001176 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 08:15:13.001176 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:15:13.001176 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:15:13.001176 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:15:13.001176 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:15:13.001176 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:15:13.001176 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application with Lock( Jul 28 08:15:13.001176 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:15:13.001176 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:15:13.001176 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:15:13.001176 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:15:13.001176 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:15:13.001176 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:15:13.002572 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:15:13.002572 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:15:13.002572 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 28 08:15:13.002572 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 28 08:15:13.002572 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 28 08:15:13.002572 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 28 08:15:13.002572 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 28 08:15:13.002572 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 28 08:15:13.002572 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 28 08:15:13.002572 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application Jul 28 08:15:13.002572 dv-cinder-851351-1-smb devstack@keystone.service[144068]: [pid: 144068|app: 0|req: 639/1267] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 08:15:12 2022] GET /identity/v3/users/placement => generated 87 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:15:13.012228 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25652513-43f8-4b72-90ef-a060a7a32fde None admin] Authenticating user token {{(pid=144067) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:15:13.144693 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25652513-43f8-4b72-90ef-a060a7a32fde None admin] Validating token access rules against request {{(pid=144067) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:15:13.191730 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c56bcb-d91a-421d-9227-800bd1843803 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144067) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:15:13.192691 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c56bcb-d91a-421d-9227-800bd1843803 None admin] REQUEST_METHOD: `GET` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:15:13.193109 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c56bcb-d91a-421d-9227-800bd1843803 None admin] SCRIPT_NAME: `/identity` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:15:13.193499 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c56bcb-d91a-421d-9227-800bd1843803 None admin] PATH_INFO: `/v3/users` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:15:13.194634 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c56bcb-d91a-421d-9227-800bd1843803 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=144067) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:15:13.195168 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c56bcb-d91a-421d-9227-800bd1843803 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:15:13.197332 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c56bcb-d91a-421d-9227-800bd1843803 None admin] RBAC: Authorization granted {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:15:13.213665 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG dbcounter [-] [144067] Writing DB stats keystone:SELECT=100 {{(pid=144067) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:15:13.230525 dv-cinder-851351-1-smb devstack@keystone.service[144067]: [pid: 144067|app: 0|req: 629/1268] 10.222.0.42 () {56 vars in 1143 bytes} [Thu Jul 28 08:15:13 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:15:13.236841 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9aab1e-6004-48be-a447-7a778e9f8efe None admin] Authenticating user token {{(pid=144068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:15:13.358978 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9aab1e-6004-48be-a447-7a778e9f8efe None admin] Validating token access rules against request {{(pid=144068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:15:13.400135 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e290d9f-11c9-4a3b-b219-1128d8202659 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:15:13.400771 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e290d9f-11c9-4a3b-b219-1128d8202659 None admin] REQUEST_METHOD: `GET` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:15:13.401056 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e290d9f-11c9-4a3b-b219-1128d8202659 None admin] SCRIPT_NAME: `/identity` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:15:13.401332 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e290d9f-11c9-4a3b-b219-1128d8202659 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:15:13.415754 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e290d9f-11c9-4a3b-b219-1128d8202659 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:15:13.417389 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e290d9f-11c9-4a3b-b219-1128d8202659 None admin] RBAC: Authorization granted {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:15:13.434097 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application [None req-4e290d9f-11c9-4a3b-b219-1128d8202659 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 08:15:13.434097 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:15:13.434097 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:15:13.434097 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:15:13.434097 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:15:13.434097 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:15:13.434097 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:15:13.434097 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:15:13.434097 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:15:13.434097 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:15:13.434097 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:15:13.434097 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:15:13.434097 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 08:15:13.434097 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 08:15:13.434097 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 08:15:13.435722 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 08:15:13.435722 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:15:13.435722 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:15:13.435722 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:15:13.435722 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:15:13.435722 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:15:13.435722 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:15:13.435722 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:15:13.435722 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application with Lock( Jul 28 08:15:13.435722 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:15:13.435722 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:15:13.435722 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:15:13.435722 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:15:13.435722 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:15:13.435722 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:15:13.435722 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:15:13.435722 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:15:13.436570 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 08:15:13.436570 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 08:15:13.436570 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 08:15:13.436570 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application Jul 28 08:15:13.436570 dv-cinder-851351-1-smb devstack@keystone.service[144068]: [pid: 144068|app: 0|req: 640/1269] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 08:15:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:15:13.442063 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c56bcb-d91a-421d-9227-800bd1843803 None admin] Authenticating user token {{(pid=144067) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:15:13.567799 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c56bcb-d91a-421d-9227-800bd1843803 None admin] Validating token access rules against request {{(pid=144067) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:15:13.610880 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005c9bac-cd98-45ff-b4e8-5272322832ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144067) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:15:13.611531 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005c9bac-cd98-45ff-b4e8-5272322832ea None admin] REQUEST_METHOD: `GET` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:15:13.611812 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005c9bac-cd98-45ff-b4e8-5272322832ea None admin] SCRIPT_NAME: `/identity` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:15:13.612090 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005c9bac-cd98-45ff-b4e8-5272322832ea None admin] PATH_INFO: `/v3/domains` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:15:13.612866 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-005c9bac-cd98-45ff-b4e8-5272322832ea None admin] RBAC: Adding query filter params (name=Default) {{(pid=144067) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:15:13.613181 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-005c9bac-cd98-45ff-b4e8-5272322832ea None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:15:13.614655 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-005c9bac-cd98-45ff-b4e8-5272322832ea None admin] RBAC: Authorization granted {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:15:13.628777 dv-cinder-851351-1-smb devstack@keystone.service[144067]: [pid: 144067|app: 0|req: 630/1270] 10.222.0.42 () {56 vars in 1109 bytes} [Thu Jul 28 08:15:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:15:13.635799 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e290d9f-11c9-4a3b-b219-1128d8202659 None admin] Authenticating user token {{(pid=144068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:15:13.673565 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG dbcounter [-] [144068] Writing DB stats keystone:SELECT=100 {{(pid=144068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:15:13.773539 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e290d9f-11c9-4a3b-b219-1128d8202659 None admin] Validating token access rules against request {{(pid=144068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:15:13.812918 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d2c149-c574-4afd-be92-1a9553df8066 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:15:13.813578 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d2c149-c574-4afd-be92-1a9553df8066 None admin] REQUEST_METHOD: `GET` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:15:13.813853 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d2c149-c574-4afd-be92-1a9553df8066 None admin] SCRIPT_NAME: `/identity` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:15:13.814179 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d2c149-c574-4afd-be92-1a9553df8066 None admin] PATH_INFO: `/v3/projects/service` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:15:13.822299 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d2c149-c574-4afd-be92-1a9553df8066 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:15:13.824334 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d2c149-c574-4afd-be92-1a9553df8066 None admin] RBAC: Authorization granted {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:15:13.838635 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application [None req-a2d2c149-c574-4afd-be92-1a9553df8066 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 08:15:13.838635 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:15:13.838635 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:15:13.838635 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:15:13.838635 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:15:13.838635 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:15:13.838635 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:15:13.838635 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:15:13.838635 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:15:13.838635 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:15:13.838635 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:15:13.838635 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:15:13.838635 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 28 08:15:13.838635 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 28 08:15:13.838635 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 28 08:15:13.839621 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 28 08:15:13.839621 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:15:13.839621 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:15:13.839621 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:15:13.839621 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:15:13.839621 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:15:13.839621 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:15:13.839621 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:15:13.839621 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application with Lock( Jul 28 08:15:13.839621 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:15:13.839621 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:15:13.839621 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:15:13.839621 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:15:13.839621 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:15:13.839621 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:15:13.839621 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:15:13.839621 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:15:13.841602 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 28 08:15:13.841602 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 28 08:15:13.841602 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 28 08:15:13.841602 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 28 08:15:13.841602 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 28 08:15:13.841602 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 28 08:15:13.841602 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 08:15:13.841602 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application Jul 28 08:15:13.841602 dv-cinder-851351-1-smb devstack@keystone.service[144068]: [pid: 144068|app: 0|req: 641/1271] 10.222.0.42 () {56 vars in 1111 bytes} [Thu Jul 28 08:15:13 2022] GET /identity/v3/projects/service => generated 88 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:15:13.846080 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005c9bac-cd98-45ff-b4e8-5272322832ea None admin] Authenticating user token {{(pid=144067) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:15:13.928371 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG dbcounter [-] [144067] Writing DB stats keystone:SELECT=100 {{(pid=144067) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:15:13.995718 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005c9bac-cd98-45ff-b4e8-5272322832ea None admin] Validating token access rules against request {{(pid=144067) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:15:14.037270 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31689a0a-a2fa-4f85-87df-c592a6f0ec0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144067) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:15:14.037918 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31689a0a-a2fa-4f85-87df-c592a6f0ec0d None admin] REQUEST_METHOD: `GET` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:15:14.038205 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31689a0a-a2fa-4f85-87df-c592a6f0ec0d None admin] SCRIPT_NAME: `/identity` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:15:14.038485 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31689a0a-a2fa-4f85-87df-c592a6f0ec0d None admin] PATH_INFO: `/v3/projects` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:15:14.039263 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31689a0a-a2fa-4f85-87df-c592a6f0ec0d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=144067) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:15:14.039865 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31689a0a-a2fa-4f85-87df-c592a6f0ec0d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:15:14.041380 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31689a0a-a2fa-4f85-87df-c592a6f0ec0d None admin] RBAC: Authorization granted {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:15:14.054759 dv-cinder-851351-1-smb devstack@keystone.service[144067]: [pid: 144067|app: 0|req: 631/1272] 10.222.0.42 () {56 vars in 1148 bytes} [Thu Jul 28 08:15:13 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:15:14.061159 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d2c149-c574-4afd-be92-1a9553df8066 None admin] Authenticating user token {{(pid=144068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:15:14.172779 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG dbcounter [-] [144068] Writing DB stats keystone:SELECT=100 {{(pid=144068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:15:14.183482 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d2c149-c574-4afd-be92-1a9553df8066 None admin] Validating token access rules against request {{(pid=144068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:15:14.223263 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a3fbca-967b-44e8-af7e-5475bc65dd48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:15:14.223969 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a3fbca-967b-44e8-af7e-5475bc65dd48 None admin] REQUEST_METHOD: `PUT` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:15:14.224252 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a3fbca-967b-44e8-af7e-5475bc65dd48 None admin] SCRIPT_NAME: `/identity` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:15:14.224526 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a3fbca-967b-44e8-af7e-5475bc65dd48 None admin] PATH_INFO: `/v3/projects/fa39ab7491e5413ca648e31ee9177fa0/users/5f254b5035b6418db1fac08a128b3097/roles/d1020e7bb0b7411d895ddedd6dc02c5b` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:15:14.226735 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08a3fbca-967b-44e8-af7e-5475bc65dd48 None admin] RBAC: Authorizing `identity:create_grant(project_id=fa39ab7491e5413ca648e31ee9177fa0, user_id=5f254b5035b6418db1fac08a128b3097, role_id=d1020e7bb0b7411d895ddedd6dc02c5b)` {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:15:14.228245 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08a3fbca-967b-44e8-af7e-5475bc65dd48 None admin] RBAC: Authorization granted {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:15:14.245185 dv-cinder-851351-1-smb devstack@keystone.service[144068]: [pid: 144068|app: 0|req: 642/1273] 10.222.0.42 () {58 vars in 1439 bytes} [Thu Jul 28 08:15:14 2022] PUT /identity/v3/projects/fa39ab7491e5413ca648e31ee9177fa0/users/5f254b5035b6418db1fac08a128b3097/roles/d1020e7bb0b7411d895ddedd6dc02c5b => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 08:15:16.270262 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e50f386-21f4-4eb0-ba4a-b8467ebc0234 None None] REQUEST_METHOD: `GET` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:15:16.270783 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e50f386-21f4-4eb0-ba4a-b8467ebc0234 None None] SCRIPT_NAME: `/identity` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:15:16.270783 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e50f386-21f4-4eb0-ba4a-b8467ebc0234 None None] PATH_INFO: `/` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:15:16.272056 dv-cinder-851351-1-smb devstack@keystone.service[144067]: [pid: 144067|app: 0|req: 632/1274] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 08:15:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 08:15:16.277625 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d375df9-654b-4ce9-aa80-4291b33a6d42 None None] REQUEST_METHOD: `POST` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:15:16.278104 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d375df9-654b-4ce9-aa80-4291b33a6d42 None None] SCRIPT_NAME: `/identity` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:15:16.278192 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d375df9-654b-4ce9-aa80-4291b33a6d42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:15:16.297476 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.auth.core [None req-0d375df9-654b-4ce9-aa80-4291b33a6d42 None None] MFA Rules not processed for user `bf5ceb8f07374635ad506b7d1b4f1612`. Rule list: `[]` (Enabled: `True`). {{(pid=144068) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 08:15:16.298863 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.fernet_utils [None req-0d375df9-654b-4ce9-aa80-4291b33a6d42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=144068) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:15:16.372192 dv-cinder-851351-1-smb devstack@keystone.service[144068]: [pid: 144068|app: 0|req: 643/1275] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 08:15:16 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 08:15:16.395782 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e50f386-21f4-4eb0-ba4a-b8467ebc0234 None None] Authenticating user token {{(pid=144067) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:15:16.510435 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e50f386-21f4-4eb0-ba4a-b8467ebc0234 None None] Validating token access rules against request {{(pid=144067) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:15:16.531174 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG dbcounter [-] [144067] Writing DB stats keystone:SELECT=100 {{(pid=144067) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:15:16.550138 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78058434-a6bc-47b5-b231-23150cbf78f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144067) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:15:16.550795 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78058434-a6bc-47b5-b231-23150cbf78f4 None admin] REQUEST_METHOD: `GET` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:15:16.551074 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78058434-a6bc-47b5-b231-23150cbf78f4 None admin] SCRIPT_NAME: `/identity` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:15:16.551333 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78058434-a6bc-47b5-b231-23150cbf78f4 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:15:16.562284 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78058434-a6bc-47b5-b231-23150cbf78f4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 08:15:16.567302 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application [None req-78058434-a6bc-47b5-b231-23150cbf78f4 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 08:15:16.567302 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:15:16.567302 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:15:16.567302 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:15:16.567302 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:15:16.567302 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:15:16.567302 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:15:16.567302 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:15:16.567302 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:15:16.567302 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:15:16.567302 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:15:16.567302 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:15:16.567302 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 08:15:16.567302 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 08:15:16.567302 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 08:15:16.567302 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 08:15:16.568308 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 08:15:16.568308 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 08:15:16.568308 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 08:15:16.568308 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 08:15:16.568308 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:15:16.568308 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:15:16.568308 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:15:16.568308 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:15:16.568308 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:15:16.568308 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:15:16.568308 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:15:16.568308 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application with Lock( Jul 28 08:15:16.568308 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:15:16.568308 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:15:16.568308 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:15:16.568308 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:15:16.569160 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:15:16.569160 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:15:16.569160 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:15:16.569160 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:15:16.569160 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 08:15:16.569160 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 08:15:16.569160 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 08:15:16.569160 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 08:15:16.569160 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 08:15:16.569160 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 08:15:16.569160 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 08:15:16.569160 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application Jul 28 08:15:16.569160 dv-cinder-851351-1-smb devstack@keystone.service[144067]: [pid: 144067|app: 0|req: 633/1276] 10.222.0.42 () {56 vars in 1096 bytes} [Thu Jul 28 08:15:16 2022] GET /identity/v3/roles/admin => generated 83 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:15:16.574929 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d375df9-654b-4ce9-aa80-4291b33a6d42 None None] Authenticating user token {{(pid=144068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:15:16.662724 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG dbcounter [-] [144068] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=144068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:15:16.691757 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d375df9-654b-4ce9-aa80-4291b33a6d42 None None] Validating token access rules against request {{(pid=144068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:15:16.738001 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1feb0b8-fd24-4f75-a79e-983c9250d277 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:15:16.739053 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1feb0b8-fd24-4f75-a79e-983c9250d277 None admin] REQUEST_METHOD: `GET` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:15:16.739461 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1feb0b8-fd24-4f75-a79e-983c9250d277 None admin] SCRIPT_NAME: `/identity` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:15:16.739851 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1feb0b8-fd24-4f75-a79e-983c9250d277 None admin] PATH_INFO: `/v3/roles` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:15:16.740881 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1feb0b8-fd24-4f75-a79e-983c9250d277 None admin] RBAC: Adding query filter params (name=admin) {{(pid=144068) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:15:16.741341 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1feb0b8-fd24-4f75-a79e-983c9250d277 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:15:16.743299 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1feb0b8-fd24-4f75-a79e-983c9250d277 None admin] RBAC: Authorization granted {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:15:16.756063 dv-cinder-851351-1-smb devstack@keystone.service[144068]: [pid: 144068|app: 0|req: 644/1277] 10.222.0.42 () {56 vars in 1099 bytes} [Thu Jul 28 08:15:16 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:15:16.764386 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78058434-a6bc-47b5-b231-23150cbf78f4 None admin] Authenticating user token {{(pid=144067) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:15:16.888573 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78058434-a6bc-47b5-b231-23150cbf78f4 None admin] Validating token access rules against request {{(pid=144067) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:15:16.930095 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c4ed55a-7ee0-4922-b117-d599a58470fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144067) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:15:16.930779 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4ed55a-7ee0-4922-b117-d599a58470fa None admin] REQUEST_METHOD: `GET` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:15:16.931034 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4ed55a-7ee0-4922-b117-d599a58470fa None admin] SCRIPT_NAME: `/identity` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:15:16.931389 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4ed55a-7ee0-4922-b117-d599a58470fa None admin] PATH_INFO: `/v3/domains/Default` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:15:16.944234 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c4ed55a-7ee0-4922-b117-d599a58470fa None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:15:16.945807 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c4ed55a-7ee0-4922-b117-d599a58470fa None admin] RBAC: Authorization granted {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:15:16.962332 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application [None req-9c4ed55a-7ee0-4922-b117-d599a58470fa None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 08:15:16.962332 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:15:16.962332 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:15:16.962332 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:15:16.962332 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:15:16.962332 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:15:16.962332 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:15:16.962332 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:15:16.962332 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:15:16.962332 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:15:16.962332 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:15:16.962332 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:15:16.962332 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 08:15:16.962332 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 08:15:16.962332 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 08:15:16.963886 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 08:15:16.963886 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:15:16.963886 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:15:16.963886 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:15:16.963886 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:15:16.963886 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:15:16.963886 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:15:16.963886 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:15:16.963886 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application with Lock( Jul 28 08:15:16.963886 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:15:16.963886 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:15:16.963886 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:15:16.963886 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:15:16.963886 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:15:16.963886 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:15:16.963886 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:15:16.963886 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:15:16.965016 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 08:15:16.965016 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 08:15:16.965016 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 08:15:16.965016 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application Jul 28 08:15:16.965016 dv-cinder-851351-1-smb devstack@keystone.service[144067]: [pid: 144067|app: 0|req: 634/1278] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 08:15:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:15:16.970539 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1feb0b8-fd24-4f75-a79e-983c9250d277 None admin] Authenticating user token {{(pid=144068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:15:17.079882 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1feb0b8-fd24-4f75-a79e-983c9250d277 None admin] Validating token access rules against request {{(pid=144068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:15:17.117599 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a6f73d-0f31-4707-8411-e21bfdad8773 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:15:17.118234 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a6f73d-0f31-4707-8411-e21bfdad8773 None admin] REQUEST_METHOD: `GET` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:15:17.118507 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a6f73d-0f31-4707-8411-e21bfdad8773 None admin] SCRIPT_NAME: `/identity` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:15:17.118778 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a6f73d-0f31-4707-8411-e21bfdad8773 None admin] PATH_INFO: `/v3/domains` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:15:17.119485 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a6f73d-0f31-4707-8411-e21bfdad8773 None admin] RBAC: Adding query filter params (name=Default) {{(pid=144068) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:15:17.119786 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a6f73d-0f31-4707-8411-e21bfdad8773 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:15:17.121205 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a6f73d-0f31-4707-8411-e21bfdad8773 None admin] RBAC: Authorization granted {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:15:17.134773 dv-cinder-851351-1-smb devstack@keystone.service[144068]: [pid: 144068|app: 0|req: 645/1279] 10.222.0.42 () {56 vars in 1109 bytes} [Thu Jul 28 08:15:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:15:17.143868 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c4ed55a-7ee0-4922-b117-d599a58470fa None admin] Authenticating user token {{(pid=144067) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:15:17.176329 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG dbcounter [-] [144067] Writing DB stats keystone:SELECT=100 {{(pid=144067) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:15:17.252347 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c4ed55a-7ee0-4922-b117-d599a58470fa None admin] Validating token access rules against request {{(pid=144067) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:15:17.291253 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273b0b89-f144-405b-aaf5-aa89cb866a27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144067) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:15:17.292990 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273b0b89-f144-405b-aaf5-aa89cb866a27 None admin] REQUEST_METHOD: `GET` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:15:17.292990 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273b0b89-f144-405b-aaf5-aa89cb866a27 None admin] SCRIPT_NAME: `/identity` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:15:17.292990 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273b0b89-f144-405b-aaf5-aa89cb866a27 None admin] PATH_INFO: `/v3/users/placement` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:15:17.301384 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-273b0b89-f144-405b-aaf5-aa89cb866a27 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:15:17.302881 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-273b0b89-f144-405b-aaf5-aa89cb866a27 None admin] RBAC: Authorization granted {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:15:17.314969 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application [None req-273b0b89-f144-405b-aaf5-aa89cb866a27 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 28 08:15:17.314969 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:15:17.314969 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:15:17.314969 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:15:17.314969 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:15:17.314969 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:15:17.314969 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:15:17.314969 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:15:17.314969 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:15:17.314969 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:15:17.314969 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:15:17.314969 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:15:17.314969 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 28 08:15:17.314969 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 28 08:15:17.314969 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 28 08:15:17.314969 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 28 08:15:17.316945 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:15:17.316945 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:15:17.316945 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 28 08:15:17.316945 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 08:15:17.316945 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 28 08:15:17.316945 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 08:15:17.316945 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:15:17.316945 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:15:17.316945 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:15:17.316945 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:15:17.316945 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:15:17.316945 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application with Lock( Jul 28 08:15:17.316945 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:15:17.316945 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:15:17.316945 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:15:17.316945 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:15:17.316945 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:15:17.316945 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:15:17.318153 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:15:17.318153 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:15:17.318153 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 28 08:15:17.318153 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 28 08:15:17.318153 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 28 08:15:17.318153 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 28 08:15:17.318153 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 28 08:15:17.318153 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 28 08:15:17.318153 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 28 08:15:17.318153 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application Jul 28 08:15:17.318153 dv-cinder-851351-1-smb devstack@keystone.service[144067]: [pid: 144067|app: 0|req: 635/1280] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 08:15:17 2022] GET /identity/v3/users/placement => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:15:17.324645 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a6f73d-0f31-4707-8411-e21bfdad8773 None admin] Authenticating user token {{(pid=144068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:15:17.329472 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG dbcounter [-] [144068] Writing DB stats keystone:SELECT=100 {{(pid=144068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:15:17.441583 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a6f73d-0f31-4707-8411-e21bfdad8773 None admin] Validating token access rules against request {{(pid=144068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:15:17.478545 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1099406f-c17b-48b1-91f6-97a009e135c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:15:17.479165 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1099406f-c17b-48b1-91f6-97a009e135c0 None admin] REQUEST_METHOD: `GET` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:15:17.479463 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1099406f-c17b-48b1-91f6-97a009e135c0 None admin] SCRIPT_NAME: `/identity` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:15:17.479738 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1099406f-c17b-48b1-91f6-97a009e135c0 None admin] PATH_INFO: `/v3/users` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:15:17.480560 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1099406f-c17b-48b1-91f6-97a009e135c0 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=144068) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:15:17.480897 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1099406f-c17b-48b1-91f6-97a009e135c0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:15:17.482353 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1099406f-c17b-48b1-91f6-97a009e135c0 None admin] RBAC: Authorization granted {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:15:17.501340 dv-cinder-851351-1-smb devstack@keystone.service[144068]: [pid: 144068|app: 0|req: 646/1281] 10.222.0.42 () {56 vars in 1143 bytes} [Thu Jul 28 08:15:17 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:15:17.507493 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273b0b89-f144-405b-aaf5-aa89cb866a27 None admin] Authenticating user token {{(pid=144067) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:15:17.611374 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG dbcounter [-] [144067] Writing DB stats keystone:SELECT=100 {{(pid=144067) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:15:17.622691 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273b0b89-f144-405b-aaf5-aa89cb866a27 None admin] Validating token access rules against request {{(pid=144067) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:15:17.664743 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff2aa8f2-b574-40db-82fd-537912dacfcc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144067) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:15:17.665375 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2aa8f2-b574-40db-82fd-537912dacfcc None admin] REQUEST_METHOD: `GET` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:15:17.665662 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2aa8f2-b574-40db-82fd-537912dacfcc None admin] SCRIPT_NAME: `/identity` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:15:17.665943 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2aa8f2-b574-40db-82fd-537912dacfcc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:15:17.757445 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff2aa8f2-b574-40db-82fd-537912dacfcc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:15:17.758881 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff2aa8f2-b574-40db-82fd-537912dacfcc None admin] RBAC: Authorization granted {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:15:17.854565 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG dbcounter [-] [144067] Writing DB stats keystone:SELECT=100 {{(pid=144067) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:15:17.866065 dv-cinder-851351-1-smb devstack@keystone.service[144067]: [pid: 144067|app: 0|req: 636/1282] 10.222.0.42 () {58 vars in 1282 bytes} [Thu Jul 28 08:15:17 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 359 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 28 08:15:17.872205 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1099406f-c17b-48b1-91f6-97a009e135c0 None admin] Authenticating user token {{(pid=144068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:15:17.939712 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG dbcounter [-] [144068] Writing DB stats keystone:SELECT=100 {{(pid=144068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:15:17.986080 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1099406f-c17b-48b1-91f6-97a009e135c0 None admin] Validating token access rules against request {{(pid=144068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:15:18.021828 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c8829d-fe7c-4776-b272-457dbce2be0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:15:18.022397 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c8829d-fe7c-4776-b272-457dbce2be0c None admin] REQUEST_METHOD: `GET` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:15:18.022672 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c8829d-fe7c-4776-b272-457dbce2be0c None admin] SCRIPT_NAME: `/identity` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:15:18.022942 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c8829d-fe7c-4776-b272-457dbce2be0c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:15:18.033446 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20c8829d-fe7c-4776-b272-457dbce2be0c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:15:18.034913 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20c8829d-fe7c-4776-b272-457dbce2be0c None admin] RBAC: Authorization granted {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:15:18.049964 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application [None req-20c8829d-fe7c-4776-b272-457dbce2be0c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 08:15:18.049964 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:15:18.049964 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:15:18.049964 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:15:18.049964 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:15:18.049964 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:15:18.049964 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:15:18.049964 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:15:18.049964 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:15:18.049964 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:15:18.049964 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:15:18.049964 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:15:18.049964 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 08:15:18.049964 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 08:15:18.049964 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 08:15:18.051075 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 08:15:18.051075 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:15:18.051075 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:15:18.051075 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:15:18.051075 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:15:18.051075 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:15:18.051075 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:15:18.051075 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:15:18.051075 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application with Lock( Jul 28 08:15:18.051075 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:15:18.051075 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:15:18.051075 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:15:18.051075 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:15:18.051075 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:15:18.051075 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:15:18.051075 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:15:18.051075 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:15:18.052561 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 08:15:18.052561 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 08:15:18.052561 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 08:15:18.052561 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application Jul 28 08:15:18.052561 dv-cinder-851351-1-smb devstack@keystone.service[144068]: [pid: 144068|app: 0|req: 647/1283] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 08:15:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:15:18.057680 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff2aa8f2-b574-40db-82fd-537912dacfcc None admin] Authenticating user token {{(pid=144067) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:15:18.168563 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff2aa8f2-b574-40db-82fd-537912dacfcc None admin] Validating token access rules against request {{(pid=144067) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:15:18.205870 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8fb8e68-87b4-4c54-89c4-da2784842a0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144067) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:15:18.206511 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fb8e68-87b4-4c54-89c4-da2784842a0f None admin] REQUEST_METHOD: `GET` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:15:18.206796 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fb8e68-87b4-4c54-89c4-da2784842a0f None admin] SCRIPT_NAME: `/identity` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:15:18.207069 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fb8e68-87b4-4c54-89c4-da2784842a0f None admin] PATH_INFO: `/v3/domains` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:15:18.207774 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8fb8e68-87b4-4c54-89c4-da2784842a0f None admin] RBAC: Adding query filter params (name=Default) {{(pid=144067) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:15:18.208081 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8fb8e68-87b4-4c54-89c4-da2784842a0f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:15:18.209522 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8fb8e68-87b4-4c54-89c4-da2784842a0f None admin] RBAC: Authorization granted {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:15:18.222179 dv-cinder-851351-1-smb devstack@keystone.service[144067]: [pid: 144067|app: 0|req: 637/1284] 10.222.0.42 () {56 vars in 1109 bytes} [Thu Jul 28 08:15:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:15:18.228247 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c8829d-fe7c-4776-b272-457dbce2be0c None admin] Authenticating user token {{(pid=144068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:15:18.343600 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c8829d-fe7c-4776-b272-457dbce2be0c None admin] Validating token access rules against request {{(pid=144068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:15:18.361409 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG dbcounter [-] [144068] Writing DB stats keystone:SELECT=100 {{(pid=144068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:15:18.385854 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ba4c9d-327e-449f-bc35-6906207cb8e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:15:18.386538 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ba4c9d-327e-449f-bc35-6906207cb8e8 None admin] REQUEST_METHOD: `GET` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:15:18.386816 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ba4c9d-327e-449f-bc35-6906207cb8e8 None admin] SCRIPT_NAME: `/identity` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:15:18.387091 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ba4c9d-327e-449f-bc35-6906207cb8e8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:15:18.395206 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52ba4c9d-327e-449f-bc35-6906207cb8e8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:15:18.396739 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52ba4c9d-327e-449f-bc35-6906207cb8e8 None admin] RBAC: Authorization granted {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:15:18.409455 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application [None req-52ba4c9d-327e-449f-bc35-6906207cb8e8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 08:15:18.409455 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:15:18.409455 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:15:18.409455 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:15:18.409455 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:15:18.409455 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:15:18.409455 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:15:18.409455 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:15:18.409455 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:15:18.409455 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:15:18.409455 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:15:18.409455 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:15:18.409455 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 28 08:15:18.409455 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 28 08:15:18.409455 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 28 08:15:18.411311 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 28 08:15:18.411311 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:15:18.411311 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:15:18.411311 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:15:18.411311 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:15:18.411311 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:15:18.411311 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:15:18.411311 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:15:18.411311 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application with Lock( Jul 28 08:15:18.411311 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:15:18.411311 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:15:18.411311 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:15:18.411311 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:15:18.411311 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:15:18.411311 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:15:18.411311 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:15:18.411311 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:15:18.413124 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 28 08:15:18.413124 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 28 08:15:18.413124 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 28 08:15:18.413124 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 28 08:15:18.413124 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 28 08:15:18.413124 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 28 08:15:18.413124 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 08:15:18.413124 dv-cinder-851351-1-smb devstack@keystone.service[144068]: ERROR keystone.server.flask.application Jul 28 08:15:18.413124 dv-cinder-851351-1-smb devstack@keystone.service[144068]: [pid: 144068|app: 0|req: 648/1285] 10.222.0.42 () {56 vars in 1111 bytes} [Thu Jul 28 08:15:18 2022] GET /identity/v3/projects/service => generated 88 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:15:18.417437 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8fb8e68-87b4-4c54-89c4-da2784842a0f None admin] Authenticating user token {{(pid=144067) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:15:18.474495 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG dbcounter [-] [144067] Writing DB stats keystone:SELECT=100 {{(pid=144067) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:15:18.529349 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8fb8e68-87b4-4c54-89c4-da2784842a0f None admin] Validating token access rules against request {{(pid=144067) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:15:18.565187 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3bd221-1841-4669-b253-9e5b7cd3b6aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144067) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:15:18.565808 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3bd221-1841-4669-b253-9e5b7cd3b6aa None admin] REQUEST_METHOD: `GET` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:15:18.566087 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3bd221-1841-4669-b253-9e5b7cd3b6aa None admin] SCRIPT_NAME: `/identity` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:15:18.566372 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3bd221-1841-4669-b253-9e5b7cd3b6aa None admin] PATH_INFO: `/v3/projects` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:15:18.567153 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d3bd221-1841-4669-b253-9e5b7cd3b6aa None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=144067) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:15:18.567458 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d3bd221-1841-4669-b253-9e5b7cd3b6aa None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:15:18.568946 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d3bd221-1841-4669-b253-9e5b7cd3b6aa None admin] RBAC: Authorization granted {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:15:18.581467 dv-cinder-851351-1-smb devstack@keystone.service[144067]: [pid: 144067|app: 0|req: 638/1286] 10.222.0.42 () {56 vars in 1148 bytes} [Thu Jul 28 08:15:18 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:15:18.588429 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ba4c9d-327e-449f-bc35-6906207cb8e8 None admin] Authenticating user token {{(pid=144068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:15:18.701502 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ba4c9d-327e-449f-bc35-6906207cb8e8 None admin] Validating token access rules against request {{(pid=144068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:15:18.738463 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f39ece-e72a-44eb-9d83-4eb4f5508e87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:15:18.739089 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f39ece-e72a-44eb-9d83-4eb4f5508e87 None admin] REQUEST_METHOD: `GET` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:15:18.739367 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f39ece-e72a-44eb-9d83-4eb4f5508e87 None admin] SCRIPT_NAME: `/identity` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:15:18.739637 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f39ece-e72a-44eb-9d83-4eb4f5508e87 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:15:18.740442 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62f39ece-e72a-44eb-9d83-4eb4f5508e87 None admin] RBAC: Adding query filter params (role.id=d1020e7bb0b7411d895ddedd6dc02c5b, scope.project.id=fa39ab7491e5413ca648e31ee9177fa0, user.id=5f254b5035b6418db1fac08a128b3097) {{(pid=144068) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:15:18.740788 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62f39ece-e72a-44eb-9d83-4eb4f5508e87 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:15:18.742264 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62f39ece-e72a-44eb-9d83-4eb4f5508e87 None admin] RBAC: Authorization granted {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:15:18.748569 dv-cinder-851351-1-smb devstack@keystone.service[144068]: [pid: 144068|app: 0|req: 649/1287] 10.222.0.42 () {56 vars in 1374 bytes} [Thu Jul 28 08:15:18 2022] GET /identity/v3/role_assignments?user.id=5f254b5035b6418db1fac08a128b3097&scope.project.id=fa39ab7491e5413ca648e31ee9177fa0&role.id=d1020e7bb0b7411d895ddedd6dc02c5b => generated 608 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:15:20.801335 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da7dbfb-f5ad-42c8-90cb-6174e405f8ba None None] REQUEST_METHOD: `GET` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:15:20.802314 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da7dbfb-f5ad-42c8-90cb-6174e405f8ba None None] SCRIPT_NAME: `/identity` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:15:20.802590 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da7dbfb-f5ad-42c8-90cb-6174e405f8ba None None] PATH_INFO: `/` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:15:20.804094 dv-cinder-851351-1-smb devstack@keystone.service[144067]: [pid: 144067|app: 0|req: 639/1288] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 08:15:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 08:15:20.809962 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1352c744-0961-4fc3-972a-7616f57723e8 None None] REQUEST_METHOD: `POST` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:15:20.810451 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1352c744-0961-4fc3-972a-7616f57723e8 None None] SCRIPT_NAME: `/identity` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:15:20.810555 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1352c744-0961-4fc3-972a-7616f57723e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:15:20.830760 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.auth.core [None req-1352c744-0961-4fc3-972a-7616f57723e8 None None] MFA Rules not processed for user `bf5ceb8f07374635ad506b7d1b4f1612`. Rule list: `[]` (Enabled: `True`). {{(pid=144068) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 08:15:20.832230 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.fernet_utils [None req-1352c744-0961-4fc3-972a-7616f57723e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=144068) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:15:20.864936 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG dbcounter [-] [144068] Writing DB stats keystone:SELECT=100 {{(pid=144068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:15:20.906019 dv-cinder-851351-1-smb devstack@keystone.service[144068]: [pid: 144068|app: 0|req: 650/1289] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 08:15:20 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 08:15:20.928210 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da7dbfb-f5ad-42c8-90cb-6174e405f8ba None None] Authenticating user token {{(pid=144067) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:15:21.079255 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da7dbfb-f5ad-42c8-90cb-6174e405f8ba None None] Validating token access rules against request {{(pid=144067) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:15:21.091725 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG dbcounter [-] [144067] Writing DB stats keystone:SELECT=100 {{(pid=144067) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:15:21.117940 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb4a312e-dcac-4252-b5d5-298211dd0820 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144067) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:15:21.118610 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4a312e-dcac-4252-b5d5-298211dd0820 None admin] REQUEST_METHOD: `GET` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:15:21.118895 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4a312e-dcac-4252-b5d5-298211dd0820 None admin] SCRIPT_NAME: `/identity` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:15:21.119175 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4a312e-dcac-4252-b5d5-298211dd0820 None admin] PATH_INFO: `/v3/services/placement` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:15:21.119825 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb4a312e-dcac-4252-b5d5-298211dd0820 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:15:21.121281 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb4a312e-dcac-4252-b5d5-298211dd0820 None admin] RBAC: Authorization granted {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:15:21.131039 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application [None req-eb4a312e-dcac-4252-b5d5-298211dd0820 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jul 28 08:15:21.131039 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:15:21.131039 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 28 08:15:21.131039 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 28 08:15:21.131039 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 28 08:15:21.131039 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 28 08:15:21.131039 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 28 08:15:21.131039 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 08:15:21.131039 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 28 08:15:21.131039 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application Jul 28 08:15:21.131039 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 28 08:15:21.131039 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application Jul 28 08:15:21.131039 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:15:21.131039 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:15:21.131039 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:15:21.131039 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:15:21.131039 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:15:21.133004 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:15:21.133004 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:15:21.133004 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:15:21.133004 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:15:21.133004 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:15:21.133004 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:15:21.133004 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 28 08:15:21.133004 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 28 08:15:21.133004 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 28 08:15:21.133004 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 28 08:15:21.133004 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:15:21.133004 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:15:21.133004 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:15:21.133004 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:15:21.133004 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:15:21.133004 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:15:21.135105 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:15:21.135105 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application with Lock( Jul 28 08:15:21.135105 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:15:21.135105 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:15:21.135105 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:15:21.135105 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:15:21.135105 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:15:21.135105 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:15:21.135105 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:15:21.135105 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:15:21.135105 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 28 08:15:21.135105 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 08:15:21.135105 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 28 08:15:21.135105 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application Jul 28 08:15:21.135105 dv-cinder-851351-1-smb devstack@keystone.service[144067]: [pid: 144067|app: 0|req: 640/1290] 10.222.0.42 () {56 vars in 1117 bytes} [Thu Jul 28 08:15:20 2022] GET /identity/v3/services/placement => generated 90 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:15:21.146777 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1352c744-0961-4fc3-972a-7616f57723e8 None None] Authenticating user token {{(pid=144068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:15:21.254093 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1352c744-0961-4fc3-972a-7616f57723e8 None None] Validating token access rules against request {{(pid=144068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:15:21.289794 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ec3ffd-a7e1-49ea-8feb-7e4815f85f5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:15:21.290429 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ec3ffd-a7e1-49ea-8feb-7e4815f85f5c None admin] REQUEST_METHOD: `GET` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:15:21.290720 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ec3ffd-a7e1-49ea-8feb-7e4815f85f5c None admin] SCRIPT_NAME: `/identity` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:15:21.290997 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ec3ffd-a7e1-49ea-8feb-7e4815f85f5c None admin] PATH_INFO: `/v3/services` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:15:21.291701 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ec3ffd-a7e1-49ea-8feb-7e4815f85f5c None admin] RBAC: Adding query filter params (name=placement) {{(pid=144068) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:15:21.292006 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ec3ffd-a7e1-49ea-8feb-7e4815f85f5c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:15:21.293450 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ec3ffd-a7e1-49ea-8feb-7e4815f85f5c None admin] RBAC: Authorization granted {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:15:21.299083 dv-cinder-851351-1-smb devstack@keystone.service[144068]: [pid: 144068|app: 0|req: 651/1291] 10.222.0.42 () {56 vars in 1116 bytes} [Thu Jul 28 08:15:21 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:15:21.305228 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb4a312e-dcac-4252-b5d5-298211dd0820 None admin] Authenticating user token {{(pid=144067) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:15:21.445773 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb4a312e-dcac-4252-b5d5-298211dd0820 None admin] Validating token access rules against request {{(pid=144067) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:15:21.484033 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a00dc39a-3605-4a15-a730-8a6552225031 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144067) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:15:21.484732 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00dc39a-3605-4a15-a730-8a6552225031 None admin] REQUEST_METHOD: `GET` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:15:21.485084 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00dc39a-3605-4a15-a730-8a6552225031 None admin] SCRIPT_NAME: `/identity` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:15:21.485405 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00dc39a-3605-4a15-a730-8a6552225031 None admin] PATH_INFO: `/v3/services` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:15:21.486188 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a00dc39a-3605-4a15-a730-8a6552225031 None admin] RBAC: Adding query filter params (type=placement) {{(pid=144067) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:15:21.486547 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a00dc39a-3605-4a15-a730-8a6552225031 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:15:21.493396 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a00dc39a-3605-4a15-a730-8a6552225031 None admin] RBAC: Authorization granted {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:15:21.500726 dv-cinder-851351-1-smb devstack@keystone.service[144067]: [pid: 144067|app: 0|req: 641/1292] 10.222.0.42 () {56 vars in 1116 bytes} [Thu Jul 28 08:15:21 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:15:23.550518 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d8994e-65b1-4ce4-af10-1b58ab7fdfed None None] REQUEST_METHOD: `GET` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:15:23.551111 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d8994e-65b1-4ce4-af10-1b58ab7fdfed None None] SCRIPT_NAME: `/identity` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:15:23.551111 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d8994e-65b1-4ce4-af10-1b58ab7fdfed None None] PATH_INFO: `/` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:15:23.552429 dv-cinder-851351-1-smb devstack@keystone.service[144068]: [pid: 144068|app: 0|req: 652/1293] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 08:15:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 08:15:23.559063 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399d17a9-05cd-425d-ac92-1fb8a589e8b8 None None] REQUEST_METHOD: `POST` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:15:23.559559 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399d17a9-05cd-425d-ac92-1fb8a589e8b8 None None] SCRIPT_NAME: `/identity` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:15:23.559952 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399d17a9-05cd-425d-ac92-1fb8a589e8b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:15:23.590651 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.auth.core [None req-399d17a9-05cd-425d-ac92-1fb8a589e8b8 None None] MFA Rules not processed for user `bf5ceb8f07374635ad506b7d1b4f1612`. Rule list: `[]` (Enabled: `True`). {{(pid=144067) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 08:15:23.592706 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.fernet_utils [None req-399d17a9-05cd-425d-ac92-1fb8a589e8b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=144067) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:15:23.644131 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG dbcounter [-] [144067] Writing DB stats keystone:SELECT=100 {{(pid=144067) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:15:23.709374 dv-cinder-851351-1-smb devstack@keystone.service[144067]: [pid: 144067|app: 0|req: 642/1294] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 08:15:23 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 08:15:23.733822 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d8994e-65b1-4ce4-af10-1b58ab7fdfed None None] Authenticating user token {{(pid=144068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:15:23.780277 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG dbcounter [-] [144068] Writing DB stats keystone:SELECT=100 {{(pid=144068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:15:23.859944 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d8994e-65b1-4ce4-af10-1b58ab7fdfed None None] Validating token access rules against request {{(pid=144068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:15:23.896052 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42cf8b08-07b2-403f-808e-84c0badb8809 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:15:23.896712 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42cf8b08-07b2-403f-808e-84c0badb8809 None admin] REQUEST_METHOD: `POST` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:15:23.897000 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42cf8b08-07b2-403f-808e-84c0badb8809 None admin] SCRIPT_NAME: `/identity` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:15:23.897274 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42cf8b08-07b2-403f-808e-84c0badb8809 None admin] PATH_INFO: `/v3/services` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:15:23.897993 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42cf8b08-07b2-403f-808e-84c0badb8809 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:15:23.899385 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42cf8b08-07b2-403f-808e-84c0badb8809 None admin] RBAC: Authorization granted {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:15:23.915305 dv-cinder-851351-1-smb devstack@keystone.service[144068]: [pid: 144068|app: 0|req: 653/1295] 10.222.0.42 () {60 vars in 1141 bytes} [Thu Jul 28 08:15:23 2022] POST /identity/v3/services => generated 246 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 08:15:25.943873 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa042a7-491c-40d5-9333-4555669b8053 None None] REQUEST_METHOD: `GET` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:15:25.944477 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa042a7-491c-40d5-9333-4555669b8053 None None] SCRIPT_NAME: `/identity` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:15:25.944477 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa042a7-491c-40d5-9333-4555669b8053 None None] PATH_INFO: `/` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:15:25.945837 dv-cinder-851351-1-smb devstack@keystone.service[144067]: [pid: 144067|app: 0|req: 643/1296] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 08:15:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 08:15:25.951631 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0632f681-b3c6-4d08-af0d-47e31b6cb577 None None] REQUEST_METHOD: `POST` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:15:25.952138 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0632f681-b3c6-4d08-af0d-47e31b6cb577 None None] SCRIPT_NAME: `/identity` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:15:25.952230 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0632f681-b3c6-4d08-af0d-47e31b6cb577 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:15:25.974725 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.auth.core [None req-0632f681-b3c6-4d08-af0d-47e31b6cb577 None None] MFA Rules not processed for user `bf5ceb8f07374635ad506b7d1b4f1612`. Rule list: `[]` (Enabled: `True`). {{(pid=144068) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 08:15:25.975966 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.fernet_utils [None req-0632f681-b3c6-4d08-af0d-47e31b6cb577 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=144068) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:15:26.061564 dv-cinder-851351-1-smb devstack@keystone.service[144068]: [pid: 144068|app: 0|req: 654/1297] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 08:15:25 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 28 08:15:26.084450 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa042a7-491c-40d5-9333-4555669b8053 None None] Authenticating user token {{(pid=144067) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:15:26.191501 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa042a7-491c-40d5-9333-4555669b8053 None None] Validating token access rules against request {{(pid=144067) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:15:26.228357 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d88c527b-add2-464e-b0c7-f8e927c067da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144067) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:15:26.228961 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88c527b-add2-464e-b0c7-f8e927c067da None admin] REQUEST_METHOD: `GET` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:15:26.229234 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88c527b-add2-464e-b0c7-f8e927c067da None admin] SCRIPT_NAME: `/identity` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:15:26.229508 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88c527b-add2-464e-b0c7-f8e927c067da None admin] PATH_INFO: `/v3/services/placement` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:15:26.230147 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d88c527b-add2-464e-b0c7-f8e927c067da None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:15:26.231548 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d88c527b-add2-464e-b0c7-f8e927c067da None admin] RBAC: Authorization granted {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:15:26.243677 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application [None req-d88c527b-add2-464e-b0c7-f8e927c067da None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jul 28 08:15:26.243677 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:15:26.243677 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 28 08:15:26.243677 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 28 08:15:26.243677 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 28 08:15:26.243677 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 28 08:15:26.243677 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 28 08:15:26.243677 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 08:15:26.243677 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 28 08:15:26.243677 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application Jul 28 08:15:26.243677 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 28 08:15:26.243677 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application Jul 28 08:15:26.243677 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:15:26.243677 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:15:26.243677 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:15:26.243677 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:15:26.243677 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:15:26.245009 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:15:26.245009 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:15:26.245009 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:15:26.245009 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:15:26.245009 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:15:26.245009 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:15:26.245009 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 28 08:15:26.245009 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 28 08:15:26.245009 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 28 08:15:26.245009 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 28 08:15:26.245009 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:15:26.245009 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:15:26.245009 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:15:26.245009 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:15:26.245009 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:15:26.245009 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:15:26.246252 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:15:26.246252 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application with Lock( Jul 28 08:15:26.246252 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:15:26.246252 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:15:26.246252 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:15:26.246252 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:15:26.246252 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:15:26.246252 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:15:26.246252 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:15:26.246252 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:15:26.246252 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 28 08:15:26.246252 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 08:15:26.246252 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 28 08:15:26.246252 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application Jul 28 08:15:26.246252 dv-cinder-851351-1-smb devstack@keystone.service[144067]: [pid: 144067|app: 0|req: 644/1298] 10.222.0.42 () {56 vars in 1117 bytes} [Thu Jul 28 08:15:26 2022] GET /identity/v3/services/placement => generated 90 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:15:26.251401 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0632f681-b3c6-4d08-af0d-47e31b6cb577 None None] Authenticating user token {{(pid=144068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:15:26.271392 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG dbcounter [-] [144068] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=144068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:15:26.362343 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0632f681-b3c6-4d08-af0d-47e31b6cb577 None None] Validating token access rules against request {{(pid=144068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:15:26.398419 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5542dfd5-d620-48b4-bc80-180527e5c4cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:15:26.399058 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5542dfd5-d620-48b4-bc80-180527e5c4cb None admin] REQUEST_METHOD: `GET` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:15:26.399336 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5542dfd5-d620-48b4-bc80-180527e5c4cb None admin] SCRIPT_NAME: `/identity` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:15:26.399610 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5542dfd5-d620-48b4-bc80-180527e5c4cb None admin] PATH_INFO: `/v3/services` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:15:26.400301 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5542dfd5-d620-48b4-bc80-180527e5c4cb None admin] RBAC: Adding query filter params (name=placement) {{(pid=144068) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:15:26.400605 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5542dfd5-d620-48b4-bc80-180527e5c4cb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:15:26.402011 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5542dfd5-d620-48b4-bc80-180527e5c4cb None admin] RBAC: Authorization granted {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:15:26.407656 dv-cinder-851351-1-smb devstack@keystone.service[144068]: [pid: 144068|app: 0|req: 655/1299] 10.222.0.42 () {56 vars in 1116 bytes} [Thu Jul 28 08:15:26 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:15:26.414383 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d88c527b-add2-464e-b0c7-f8e927c067da None admin] Authenticating user token {{(pid=144067) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:15:26.447888 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG dbcounter [-] [144067] Writing DB stats keystone:SELECT=100 {{(pid=144067) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:15:26.518903 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d88c527b-add2-464e-b0c7-f8e927c067da None admin] Validating token access rules against request {{(pid=144067) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:15:26.556777 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ebb4ae4-60f2-4607-85ba-adebbaed241b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144067) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:15:26.557648 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ebb4ae4-60f2-4607-85ba-adebbaed241b None admin] REQUEST_METHOD: `GET` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:15:26.557934 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ebb4ae4-60f2-4607-85ba-adebbaed241b None admin] SCRIPT_NAME: `/identity` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:15:26.558426 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ebb4ae4-60f2-4607-85ba-adebbaed241b None admin] PATH_INFO: `/v3/endpoints` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:15:26.559901 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ebb4ae4-60f2-4607-85ba-adebbaed241b None admin] RBAC: Adding query filter params (interface=public, service_id=f1abf9a7ae1747d191a5867909862d5e, region_id=RegionOne) {{(pid=144067) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:15:26.560479 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ebb4ae4-60f2-4607-85ba-adebbaed241b None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:15:26.563171 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ebb4ae4-60f2-4607-85ba-adebbaed241b None admin] RBAC: Authorization granted {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:15:26.572538 dv-cinder-851351-1-smb devstack@keystone.service[144067]: [pid: 144067|app: 0|req: 645/1300] 10.222.0.42 () {56 vars in 1251 bytes} [Thu Jul 28 08:15:26 2022] GET /identity/v3/endpoints?service_id=f1abf9a7ae1747d191a5867909862d5e&interface=public®ion_id=RegionOne => generated 194 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:15:26.578868 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5542dfd5-d620-48b4-bc80-180527e5c4cb None admin] Authenticating user token {{(pid=144068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:15:26.667749 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG dbcounter [-] [144068] Writing DB stats keystone:SELECT=100 {{(pid=144068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:15:26.688881 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5542dfd5-d620-48b4-bc80-180527e5c4cb None admin] Validating token access rules against request {{(pid=144068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:15:26.738818 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ee171a-edc7-47d2-920c-58e5809b309d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:15:26.739866 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ee171a-edc7-47d2-920c-58e5809b309d None admin] REQUEST_METHOD: `GET` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:15:26.740373 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ee171a-edc7-47d2-920c-58e5809b309d None admin] SCRIPT_NAME: `/identity` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:15:26.740912 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ee171a-edc7-47d2-920c-58e5809b309d None admin] PATH_INFO: `/v3/services` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:15:26.742107 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23ee171a-edc7-47d2-920c-58e5809b309d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:15:26.745338 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23ee171a-edc7-47d2-920c-58e5809b309d None admin] RBAC: Authorization granted {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:15:26.757520 dv-cinder-851351-1-smb devstack@keystone.service[144068]: [pid: 144068|app: 0|req: 656/1301] 10.222.0.42 () {56 vars in 1087 bytes} [Thu Jul 28 08:15:26 2022] GET /identity/v3/services => generated 2191 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 08:15:28.789382 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6aed33-2dce-4805-b06a-230355d63ff4 None None] REQUEST_METHOD: `GET` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:15:28.789924 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6aed33-2dce-4805-b06a-230355d63ff4 None None] SCRIPT_NAME: `/identity` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:15:28.789924 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6aed33-2dce-4805-b06a-230355d63ff4 None None] PATH_INFO: `/` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:15:28.791290 dv-cinder-851351-1-smb devstack@keystone.service[144067]: [pid: 144067|app: 0|req: 646/1302] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 08:15:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 08:15:28.797007 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c2075e-5ff2-487c-a355-87c98ad623cc None None] REQUEST_METHOD: `POST` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:15:28.797434 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c2075e-5ff2-487c-a355-87c98ad623cc None None] SCRIPT_NAME: `/identity` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:15:28.797570 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c2075e-5ff2-487c-a355-87c98ad623cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:15:28.816876 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.auth.core [None req-93c2075e-5ff2-487c-a355-87c98ad623cc None None] MFA Rules not processed for user `bf5ceb8f07374635ad506b7d1b4f1612`. Rule list: `[]` (Enabled: `True`). {{(pid=144068) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 08:15:28.818097 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.fernet_utils [None req-93c2075e-5ff2-487c-a355-87c98ad623cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=144068) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:15:28.890203 dv-cinder-851351-1-smb devstack@keystone.service[144068]: [pid: 144068|app: 0|req: 657/1303] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 08:15:28 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 08:15:28.913240 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd6aed33-2dce-4805-b06a-230355d63ff4 None None] Authenticating user token {{(pid=144067) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:15:29.015475 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG dbcounter [-] [144067] Writing DB stats keystone:SELECT=100 {{(pid=144067) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:15:29.024941 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd6aed33-2dce-4805-b06a-230355d63ff4 None None] Validating token access rules against request {{(pid=144067) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:15:29.060652 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f50dde-3094-406c-80ad-bdb3d745a3fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144067) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:15:29.061244 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f50dde-3094-406c-80ad-bdb3d745a3fd None admin] REQUEST_METHOD: `GET` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:15:29.061523 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f50dde-3094-406c-80ad-bdb3d745a3fd None admin] SCRIPT_NAME: `/identity` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:15:29.061800 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f50dde-3094-406c-80ad-bdb3d745a3fd None admin] PATH_INFO: `/v3/services/placement` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:15:29.062444 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08f50dde-3094-406c-80ad-bdb3d745a3fd None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:15:29.063919 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08f50dde-3094-406c-80ad-bdb3d745a3fd None admin] RBAC: Authorization granted {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:15:29.073665 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application [None req-08f50dde-3094-406c-80ad-bdb3d745a3fd None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jul 28 08:15:29.073665 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:15:29.073665 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 28 08:15:29.073665 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 28 08:15:29.073665 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 28 08:15:29.073665 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 28 08:15:29.073665 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 28 08:15:29.073665 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 08:15:29.073665 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 28 08:15:29.073665 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application Jul 28 08:15:29.073665 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 28 08:15:29.073665 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application Jul 28 08:15:29.073665 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:15:29.073665 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:15:29.073665 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:15:29.073665 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:15:29.073665 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:15:29.074864 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:15:29.074864 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:15:29.074864 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:15:29.074864 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:15:29.074864 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:15:29.074864 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:15:29.074864 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 28 08:15:29.074864 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 28 08:15:29.074864 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 28 08:15:29.074864 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 28 08:15:29.074864 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:15:29.074864 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:15:29.074864 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:15:29.074864 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:15:29.074864 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:15:29.074864 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:15:29.075883 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:15:29.075883 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application with Lock( Jul 28 08:15:29.075883 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:15:29.075883 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:15:29.075883 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:15:29.075883 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:15:29.075883 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:15:29.075883 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:15:29.075883 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:15:29.075883 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:15:29.075883 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 28 08:15:29.075883 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 08:15:29.075883 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 28 08:15:29.075883 dv-cinder-851351-1-smb devstack@keystone.service[144067]: ERROR keystone.server.flask.application Jul 28 08:15:29.080173 dv-cinder-851351-1-smb devstack@keystone.service[144067]: [pid: 144067|app: 0|req: 647/1304] 10.222.0.42 () {56 vars in 1117 bytes} [Thu Jul 28 08:15:28 2022] GET /identity/v3/services/placement => generated 90 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:15:29.081271 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c2075e-5ff2-487c-a355-87c98ad623cc None None] Authenticating user token {{(pid=144068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:15:29.160582 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG dbcounter [-] [144068] Writing DB stats keystone:SELECT=100 {{(pid=144068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:15:29.185093 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c2075e-5ff2-487c-a355-87c98ad623cc None None] Validating token access rules against request {{(pid=144068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:15:29.219774 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e55f625-b94e-4aff-8145-f14ae88dcb8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:15:29.220470 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e55f625-b94e-4aff-8145-f14ae88dcb8d None admin] REQUEST_METHOD: `GET` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:15:29.220775 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e55f625-b94e-4aff-8145-f14ae88dcb8d None admin] SCRIPT_NAME: `/identity` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:15:29.221049 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e55f625-b94e-4aff-8145-f14ae88dcb8d None admin] PATH_INFO: `/v3/services` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:15:29.221737 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e55f625-b94e-4aff-8145-f14ae88dcb8d None admin] RBAC: Adding query filter params (name=placement) {{(pid=144068) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:15:29.222030 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e55f625-b94e-4aff-8145-f14ae88dcb8d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:15:29.223425 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e55f625-b94e-4aff-8145-f14ae88dcb8d None admin] RBAC: Authorization granted {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:15:29.228906 dv-cinder-851351-1-smb devstack@keystone.service[144068]: [pid: 144068|app: 0|req: 658/1305] 10.222.0.42 () {56 vars in 1116 bytes} [Thu Jul 28 08:15:29 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:15:29.234998 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f50dde-3094-406c-80ad-bdb3d745a3fd None admin] Authenticating user token {{(pid=144067) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:15:29.343011 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f50dde-3094-406c-80ad-bdb3d745a3fd None admin] Validating token access rules against request {{(pid=144067) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:15:29.378498 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c91a43-f3c9-4eb4-9384-7d76f34f9a95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bf5ceb8f07374635ad506b7d1b4f1612', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144067) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:15:29.379133 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c91a43-f3c9-4eb4-9384-7d76f34f9a95 None admin] REQUEST_METHOD: `POST` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:15:29.379412 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c91a43-f3c9-4eb4-9384-7d76f34f9a95 None admin] SCRIPT_NAME: `/identity` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:15:29.379684 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c91a43-f3c9-4eb4-9384-7d76f34f9a95 None admin] PATH_INFO: `/v3/endpoints` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:15:29.380406 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88c91a43-f3c9-4eb4-9384-7d76f34f9a95 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:15:29.381840 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88c91a43-f3c9-4eb4-9384-7d76f34f9a95 None admin] RBAC: Authorization granted {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:15:29.405209 dv-cinder-851351-1-smb devstack@keystone.service[144067]: [pid: 144067|app: 0|req: 648/1306] 10.222.0.42 () {60 vars in 1144 bytes} [Thu Jul 28 08:15:29 2022] POST /identity/v3/endpoints => generated 331 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 08:15:39.226239 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG dbcounter [-] [144068] Writing DB stats keystone:SELECT=30 {{(pid=144068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:15:39.400211 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG dbcounter [-] [144067] Writing DB stats keystone:SELECT=91,keystone:INSERT=1 {{(pid=144067) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:16:34.347194 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1bbc447-2845-41fa-abe3-b731a06e514c None None] REQUEST_METHOD: `GET` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:16:34.347779 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1bbc447-2845-41fa-abe3-b731a06e514c None None] SCRIPT_NAME: `/identity` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:16:34.347779 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1bbc447-2845-41fa-abe3-b731a06e514c None None] PATH_INFO: `/` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:16:34.349524 dv-cinder-851351-1-smb devstack@keystone.service[144068]: [pid: 144068|app: 0|req: 659/1307] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 08:16:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 08:16:34.355334 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf69d16b-3cb0-4f50-a9bd-bdbe32628e80 None None] REQUEST_METHOD: `POST` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:16:34.355895 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf69d16b-3cb0-4f50-a9bd-bdbe32628e80 None None] SCRIPT_NAME: `/identity` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:16:34.355895 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf69d16b-3cb0-4f50-a9bd-bdbe32628e80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:16:34.517333 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.auth.core [None req-cf69d16b-3cb0-4f50-a9bd-bdbe32628e80 None None] MFA Rules not processed for user `bf5ceb8f07374635ad506b7d1b4f1612`. Rule list: `[]` (Enabled: `True`). {{(pid=144067) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 08:16:34.518722 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.fernet_utils [None req-cf69d16b-3cb0-4f50-a9bd-bdbe32628e80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=144067) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:16:34.706991 dv-cinder-851351-1-smb devstack@keystone.service[144067]: [pid: 144067|app: 0|req: 649/1308] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 08:16:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 353 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 08:16:34.785079 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee85591-9291-40eb-8636-31c6835358fb None None] REQUEST_METHOD: `GET` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:16:34.785361 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee85591-9291-40eb-8636-31c6835358fb None None] SCRIPT_NAME: `/identity` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:16:34.785637 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee85591-9291-40eb-8636-31c6835358fb None None] PATH_INFO: `/` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:16:34.787327 dv-cinder-851351-1-smb devstack@keystone.service[144068]: [pid: 144068|app: 0|req: 660/1309] 10.222.0.42 () {54 vars in 965 bytes} [Thu Jul 28 08:16:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 08:16:34.797961 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfad4f0a-26dd-4e1e-868b-5c0b11180ba6 None None] REQUEST_METHOD: `POST` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:16:34.798531 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfad4f0a-26dd-4e1e-868b-5c0b11180ba6 None None] SCRIPT_NAME: `/identity` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:16:34.798912 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfad4f0a-26dd-4e1e-868b-5c0b11180ba6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:16:34.951736 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.auth.core [None req-bfad4f0a-26dd-4e1e-868b-5c0b11180ba6 None None] MFA Rules not processed for user `ccb4223a248b45fba8dff662f7260b21`. Rule list: `[]` (Enabled: `True`). {{(pid=144067) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 08:16:34.954403 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.fernet_utils [None req-bfad4f0a-26dd-4e1e-868b-5c0b11180ba6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=144067) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:16:34.997657 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG dbcounter [-] [144067] Writing DB stats keystone:SELECT=100 {{(pid=144067) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:16:35.121357 dv-cinder-851351-1-smb devstack@keystone.service[144067]: [pid: 144067|app: 0|req: 650/1310] 10.222.0.42 () {58 vars in 1062 bytes} [Thu Jul 28 08:16:34 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 325 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 08:16:35.130367 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee85591-9291-40eb-8636-31c6835358fb None None] Authenticating user token {{(pid=144068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:16:35.132212 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.fernet_utils [None req-7ee85591-9291-40eb-8636-31c6835358fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=144068) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:16:35.388575 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee85591-9291-40eb-8636-31c6835358fb None None] Validating token access rules against request {{(pid=144068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:16:35.569439 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0949afa4-0323-49f2-8534-2269315f8104 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccb4223a248b45fba8dff662f7260b21', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa39ab7491e5413ca648e31ee9177fa0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:16:35.570108 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0949afa4-0323-49f2-8534-2269315f8104 service neutron] REQUEST_METHOD: `GET` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:16:35.570397 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0949afa4-0323-49f2-8534-2269315f8104 service neutron] SCRIPT_NAME: `/identity` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:16:35.570673 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0949afa4-0323-49f2-8534-2269315f8104 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:16:35.577892 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.fernet_utils [None req-0949afa4-0323-49f2-8534-2269315f8104 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=144068) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:16:35.657130 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG dbcounter [-] [144068] Writing DB stats keystone:SELECT=100 {{(pid=144068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:16:35.730780 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0949afa4-0323-49f2-8534-2269315f8104 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:16:35.732273 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0949afa4-0323-49f2-8534-2269315f8104 service neutron] RBAC: Authorization granted {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:16:35.758188 dv-cinder-851351-1-smb devstack@keystone.service[144068]: [pid: 144068|app: 0|req: 661/1311] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Jul 28 08:16:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 628 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 08:16:38.397054 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7d3bbf-7a65-4fd1-aa28-fbc79e40e64a None None] REQUEST_METHOD: `GET` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:16:38.397585 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7d3bbf-7a65-4fd1-aa28-fbc79e40e64a None None] SCRIPT_NAME: `/identity` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:16:38.397700 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7d3bbf-7a65-4fd1-aa28-fbc79e40e64a None None] PATH_INFO: `/` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:16:38.399210 dv-cinder-851351-1-smb devstack@keystone.service[144067]: [pid: 144067|app: 0|req: 651/1312] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 08:16:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 08:16:38.404967 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8ecfa1-e81d-46d8-b796-148c4ec7dfeb None None] REQUEST_METHOD: `POST` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:16:38.405480 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8ecfa1-e81d-46d8-b796-148c4ec7dfeb None None] SCRIPT_NAME: `/identity` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:16:38.405557 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8ecfa1-e81d-46d8-b796-148c4ec7dfeb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:16:38.501486 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.auth.core [None req-6b8ecfa1-e81d-46d8-b796-148c4ec7dfeb None None] MFA Rules not processed for user `bf5ceb8f07374635ad506b7d1b4f1612`. Rule list: `[]` (Enabled: `True`). {{(pid=144068) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 08:16:38.502775 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.fernet_utils [None req-6b8ecfa1-e81d-46d8-b796-148c4ec7dfeb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=144068) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:16:38.613089 dv-cinder-851351-1-smb devstack@keystone.service[144068]: [pid: 144068|app: 0|req: 662/1313] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 08:16:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 08:16:38.650830 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7d3bbf-7a65-4fd1-aa28-fbc79e40e64a None None] Authenticating user token {{(pid=144067) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:16:38.652389 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.fernet_utils [None req-9d7d3bbf-7a65-4fd1-aa28-fbc79e40e64a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=144067) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:16:38.779790 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7d3bbf-7a65-4fd1-aa28-fbc79e40e64a None None] Validating token access rules against request {{(pid=144067) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:16:38.852688 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG dbcounter [-] [144067] Writing DB stats keystone:SELECT=100 {{(pid=144067) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:16:38.855158 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b202a37a-49e2-4ec9-81c9-dffe36c9c493 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccb4223a248b45fba8dff662f7260b21', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa39ab7491e5413ca648e31ee9177fa0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144067) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:16:38.855862 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b202a37a-49e2-4ec9-81c9-dffe36c9c493 service neutron] REQUEST_METHOD: `GET` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:16:38.856094 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b202a37a-49e2-4ec9-81c9-dffe36c9c493 service neutron] SCRIPT_NAME: `/identity` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:16:38.856376 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b202a37a-49e2-4ec9-81c9-dffe36c9c493 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:16:38.858749 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.fernet_utils [None req-b202a37a-49e2-4ec9-81c9-dffe36c9c493 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=144067) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:16:38.973016 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b202a37a-49e2-4ec9-81c9-dffe36c9c493 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:16:38.974427 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b202a37a-49e2-4ec9-81c9-dffe36c9c493 service neutron] RBAC: Authorization granted {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:16:38.997814 dv-cinder-851351-1-smb devstack@keystone.service[144067]: [pid: 144067|app: 0|req: 652/1314] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Jul 28 08:16:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 348 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 08:16:41.338263 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2790fd6d-f27a-420c-923f-55fcdfcaa556 None None] REQUEST_METHOD: `GET` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:16:41.339170 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2790fd6d-f27a-420c-923f-55fcdfcaa556 None None] SCRIPT_NAME: `/identity` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:16:41.339170 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2790fd6d-f27a-420c-923f-55fcdfcaa556 None None] PATH_INFO: `/` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:16:41.340572 dv-cinder-851351-1-smb devstack@keystone.service[144068]: [pid: 144068|app: 0|req: 663/1315] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 08:16:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 08:16:41.347067 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76c2eda-9fc6-487f-9c78-079197ffa5bf None None] REQUEST_METHOD: `POST` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:16:41.347522 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76c2eda-9fc6-487f-9c78-079197ffa5bf None None] SCRIPT_NAME: `/identity` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:16:41.347617 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76c2eda-9fc6-487f-9c78-079197ffa5bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:16:41.419478 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.auth.core [None req-e76c2eda-9fc6-487f-9c78-079197ffa5bf None None] MFA Rules not processed for user `fbc36457370441478a0d13a56c8e0351`. Rule list: `[]` (Enabled: `True`). {{(pid=144067) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 08:16:41.420762 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.fernet_utils [None req-e76c2eda-9fc6-487f-9c78-079197ffa5bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=144067) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:16:41.476326 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG dbcounter [-] [144067] Writing DB stats keystone:SELECT=100 {{(pid=144067) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:16:41.523955 dv-cinder-851351-1-smb devstack@keystone.service[144067]: [pid: 144067|app: 0|req: 653/1316] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 08:16:41 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 08:16:41.563774 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2790fd6d-f27a-420c-923f-55fcdfcaa556 None None] Authenticating user token {{(pid=144068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:16:41.565362 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.fernet_utils [None req-2790fd6d-f27a-420c-923f-55fcdfcaa556 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=144068) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:16:41.575464 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG dbcounter [-] [144068] Writing DB stats keystone:SELECT=100 {{(pid=144068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:16:41.675414 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2790fd6d-f27a-420c-923f-55fcdfcaa556 None None] Validating token access rules against request {{(pid=144068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:16:41.749837 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b005654e-71a9-4224-a56c-357129ee1b16 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccb4223a248b45fba8dff662f7260b21', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa39ab7491e5413ca648e31ee9177fa0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:16:41.750501 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b005654e-71a9-4224-a56c-357129ee1b16 service neutron] REQUEST_METHOD: `GET` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:16:41.750774 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b005654e-71a9-4224-a56c-357129ee1b16 service neutron] SCRIPT_NAME: `/identity` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:16:41.751041 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b005654e-71a9-4224-a56c-357129ee1b16 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:16:41.752711 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.fernet_utils [None req-b005654e-71a9-4224-a56c-357129ee1b16 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=144068) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:16:41.815911 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG dbcounter [-] [144068] Writing DB stats keystone:SELECT=100 {{(pid=144068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:16:41.866470 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b005654e-71a9-4224-a56c-357129ee1b16 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:16:41.867986 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b005654e-71a9-4224-a56c-357129ee1b16 service neutron] RBAC: Authorization granted {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:16:41.887831 dv-cinder-851351-1-smb devstack@keystone.service[144068]: [pid: 144068|app: 0|req: 664/1317] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Jul 28 08:16:41 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 08:16:44.486611 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8defa323-6f1b-4003-a423-403e612d7358 None None] REQUEST_METHOD: `GET` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:16:44.487155 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8defa323-6f1b-4003-a423-403e612d7358 None None] SCRIPT_NAME: `/identity` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:16:44.487155 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8defa323-6f1b-4003-a423-403e612d7358 None None] PATH_INFO: `/` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:16:44.488565 dv-cinder-851351-1-smb devstack@keystone.service[144067]: [pid: 144067|app: 0|req: 654/1318] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 08:16:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 08:16:44.494116 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab72a9ab-2707-4528-9ec3-bae034c43d7a None None] REQUEST_METHOD: `POST` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:16:44.494506 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab72a9ab-2707-4528-9ec3-bae034c43d7a None None] SCRIPT_NAME: `/identity` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:16:44.494665 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab72a9ab-2707-4528-9ec3-bae034c43d7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:16:44.564978 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.auth.core [None req-ab72a9ab-2707-4528-9ec3-bae034c43d7a None None] MFA Rules not processed for user `bf5ceb8f07374635ad506b7d1b4f1612`. Rule list: `[]` (Enabled: `True`). {{(pid=144068) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 08:16:44.566244 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.fernet_utils [None req-ab72a9ab-2707-4528-9ec3-bae034c43d7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=144068) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:16:44.665423 dv-cinder-851351-1-smb devstack@keystone.service[144068]: [pid: 144068|app: 0|req: 665/1319] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 08:16:44 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 08:16:44.705259 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8defa323-6f1b-4003-a423-403e612d7358 None None] Authenticating user token {{(pid=144067) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:16:44.706898 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.fernet_utils [None req-8defa323-6f1b-4003-a423-403e612d7358 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=144067) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:16:44.819912 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8defa323-6f1b-4003-a423-403e612d7358 None None] Validating token access rules against request {{(pid=144067) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:16:44.900120 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97488ee2-723d-48bc-8376-ec425a435e32 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccb4223a248b45fba8dff662f7260b21', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa39ab7491e5413ca648e31ee9177fa0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144067) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:16:44.900791 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97488ee2-723d-48bc-8376-ec425a435e32 service neutron] REQUEST_METHOD: `GET` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:16:44.901079 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97488ee2-723d-48bc-8376-ec425a435e32 service neutron] SCRIPT_NAME: `/identity` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:16:44.901356 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97488ee2-723d-48bc-8376-ec425a435e32 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:16:44.903011 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.fernet_utils [None req-97488ee2-723d-48bc-8376-ec425a435e32 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=144067) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:16:44.911101 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG dbcounter [-] [144067] Writing DB stats keystone:SELECT=100 {{(pid=144067) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:16:45.020060 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97488ee2-723d-48bc-8376-ec425a435e32 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:16:45.021562 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97488ee2-723d-48bc-8376-ec425a435e32 service neutron] RBAC: Authorization granted {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:16:45.040333 dv-cinder-851351-1-smb devstack@keystone.service[144067]: [pid: 144067|app: 0|req: 655/1320] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Jul 28 08:16:44 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 336 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 08:16:47.756170 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae08a58-6752-4de4-bdea-81a6c44ab545 None None] REQUEST_METHOD: `GET` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:16:47.756721 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae08a58-6752-4de4-bdea-81a6c44ab545 None None] SCRIPT_NAME: `/identity` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:16:47.756721 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae08a58-6752-4de4-bdea-81a6c44ab545 None None] PATH_INFO: `/` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:16:47.758260 dv-cinder-851351-1-smb devstack@keystone.service[144068]: [pid: 144068|app: 0|req: 666/1321] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 08:16:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 08:16:47.763846 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740b9672-3d76-48bb-8523-90c1176df3e2 None None] REQUEST_METHOD: `POST` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:16:47.764304 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740b9672-3d76-48bb-8523-90c1176df3e2 None None] SCRIPT_NAME: `/identity` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:16:47.764520 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740b9672-3d76-48bb-8523-90c1176df3e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:16:47.834842 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.auth.core [None req-740b9672-3d76-48bb-8523-90c1176df3e2 None None] MFA Rules not processed for user `bf5ceb8f07374635ad506b7d1b4f1612`. Rule list: `[]` (Enabled: `True`). {{(pid=144067) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 08:16:47.836066 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.fernet_utils [None req-740b9672-3d76-48bb-8523-90c1176df3e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=144067) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:16:47.898064 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG dbcounter [-] [144067] Writing DB stats keystone:SELECT=100 {{(pid=144067) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:16:47.943244 dv-cinder-851351-1-smb devstack@keystone.service[144067]: [pid: 144067|app: 0|req: 656/1322] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 08:16:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 08:16:47.980324 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae08a58-6752-4de4-bdea-81a6c44ab545 None None] Authenticating user token {{(pid=144068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:16:47.982027 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.fernet_utils [None req-dae08a58-6752-4de4-bdea-81a6c44ab545 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=144068) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:16:48.004133 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG dbcounter [-] [144068] Writing DB stats keystone:SELECT=100 {{(pid=144068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:16:48.109031 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae08a58-6752-4de4-bdea-81a6c44ab545 None None] Validating token access rules against request {{(pid=144068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:16:48.192352 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-661de812-ea63-4f48-82ba-afad11a47bec service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccb4223a248b45fba8dff662f7260b21', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa39ab7491e5413ca648e31ee9177fa0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:16:48.193035 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661de812-ea63-4f48-82ba-afad11a47bec service neutron] REQUEST_METHOD: `GET` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:16:48.193316 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661de812-ea63-4f48-82ba-afad11a47bec service neutron] SCRIPT_NAME: `/identity` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:16:48.193587 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661de812-ea63-4f48-82ba-afad11a47bec service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:16:48.195342 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.fernet_utils [None req-661de812-ea63-4f48-82ba-afad11a47bec service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=144068) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:16:48.280700 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG dbcounter [-] [144068] Writing DB stats keystone:SELECT=100 {{(pid=144068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:16:48.327042 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-661de812-ea63-4f48-82ba-afad11a47bec service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:16:48.328696 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-661de812-ea63-4f48-82ba-afad11a47bec service neutron] RBAC: Authorization granted {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:16:48.350836 dv-cinder-851351-1-smb devstack@keystone.service[144068]: [pid: 144068|app: 0|req: 667/1323] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Jul 28 08:16:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 371 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 08:16:50.412876 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045fb847-f769-40f5-bd14-4eec9233343a None None] REQUEST_METHOD: `GET` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:16:50.413412 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045fb847-f769-40f5-bd14-4eec9233343a None None] SCRIPT_NAME: `/identity` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:16:50.413412 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045fb847-f769-40f5-bd14-4eec9233343a None None] PATH_INFO: `/` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:16:50.414785 dv-cinder-851351-1-smb devstack@keystone.service[144067]: [pid: 144067|app: 0|req: 657/1324] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 08:16:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 08:16:50.421848 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca7b083-3e4e-422e-94a8-bafe08f5340a None None] REQUEST_METHOD: `POST` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:16:50.422547 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca7b083-3e4e-422e-94a8-bafe08f5340a None None] SCRIPT_NAME: `/identity` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:16:50.422897 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca7b083-3e4e-422e-94a8-bafe08f5340a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:16:50.497538 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.auth.core [None req-fca7b083-3e4e-422e-94a8-bafe08f5340a None None] MFA Rules not processed for user `bf5ceb8f07374635ad506b7d1b4f1612`. Rule list: `[]` (Enabled: `True`). {{(pid=144068) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 08:16:50.498835 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.fernet_utils [None req-fca7b083-3e4e-422e-94a8-bafe08f5340a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=144068) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:16:50.606649 dv-cinder-851351-1-smb devstack@keystone.service[144068]: [pid: 144068|app: 0|req: 668/1325] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 08:16:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 08:16:50.642961 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045fb847-f769-40f5-bd14-4eec9233343a None None] Authenticating user token {{(pid=144067) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:16:50.644621 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.fernet_utils [None req-045fb847-f769-40f5-bd14-4eec9233343a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=144067) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:16:50.761833 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045fb847-f769-40f5-bd14-4eec9233343a None None] Validating token access rules against request {{(pid=144067) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:16:50.838644 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa26def-259c-4073-bdff-4c3ea06ec574 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccb4223a248b45fba8dff662f7260b21', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa39ab7491e5413ca648e31ee9177fa0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144067) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:16:50.839645 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa26def-259c-4073-bdff-4c3ea06ec574 service neutron] REQUEST_METHOD: `GET` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:16:50.839929 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa26def-259c-4073-bdff-4c3ea06ec574 service neutron] SCRIPT_NAME: `/identity` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:16:50.840223 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa26def-259c-4073-bdff-4c3ea06ec574 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:16:50.841949 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.fernet_utils [None req-6fa26def-259c-4073-bdff-4c3ea06ec574 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=144067) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:16:50.859901 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG dbcounter [-] [144067] Writing DB stats keystone:SELECT=100 {{(pid=144067) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:16:50.957389 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fa26def-259c-4073-bdff-4c3ea06ec574 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:16:50.958806 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fa26def-259c-4073-bdff-4c3ea06ec574 service neutron] RBAC: Authorization granted {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:16:50.979931 dv-cinder-851351-1-smb devstack@keystone.service[144067]: [pid: 144067|app: 0|req: 658/1326] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Jul 28 08:16:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 338 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 08:16:53.034670 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92893e5f-a707-423f-afe8-dcb549813713 None None] REQUEST_METHOD: `GET` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:16:53.035272 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92893e5f-a707-423f-afe8-dcb549813713 None None] SCRIPT_NAME: `/identity` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:16:53.035272 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92893e5f-a707-423f-afe8-dcb549813713 None None] PATH_INFO: `/` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:16:53.036585 dv-cinder-851351-1-smb devstack@keystone.service[144068]: [pid: 144068|app: 0|req: 669/1327] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 08:16:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 08:16:53.041958 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424d753c-373e-4260-9665-9ce8af680b5b None None] REQUEST_METHOD: `POST` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:16:53.042396 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424d753c-373e-4260-9665-9ce8af680b5b None None] SCRIPT_NAME: `/identity` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:16:53.042499 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424d753c-373e-4260-9665-9ce8af680b5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:16:53.113218 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.auth.core [None req-424d753c-373e-4260-9665-9ce8af680b5b None None] MFA Rules not processed for user `fbc36457370441478a0d13a56c8e0351`. Rule list: `[]` (Enabled: `True`). {{(pid=144067) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 08:16:53.114455 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.fernet_utils [None req-424d753c-373e-4260-9665-9ce8af680b5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=144067) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:16:53.190871 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG dbcounter [-] [144067] Writing DB stats keystone:SELECT=100 {{(pid=144067) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:16:53.230515 dv-cinder-851351-1-smb devstack@keystone.service[144067]: [pid: 144067|app: 0|req: 659/1328] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 08:16:53 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 08:16:53.268569 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92893e5f-a707-423f-afe8-dcb549813713 None None] Authenticating user token {{(pid=144068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:16:53.270201 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.fernet_utils [None req-92893e5f-a707-423f-afe8-dcb549813713 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=144068) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:16:53.304539 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG dbcounter [-] [144068] Writing DB stats keystone:SELECT=100 {{(pid=144068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:16:53.384371 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92893e5f-a707-423f-afe8-dcb549813713 None None] Validating token access rules against request {{(pid=144068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:16:53.466159 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e9142c9-ff24-402d-84c4-37cfb874e1f3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccb4223a248b45fba8dff662f7260b21', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa39ab7491e5413ca648e31ee9177fa0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:16:53.466802 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9142c9-ff24-402d-84c4-37cfb874e1f3 service neutron] REQUEST_METHOD: `GET` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:16:53.467116 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9142c9-ff24-402d-84c4-37cfb874e1f3 service neutron] SCRIPT_NAME: `/identity` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:16:53.467392 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9142c9-ff24-402d-84c4-37cfb874e1f3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:16:53.469106 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.fernet_utils [None req-7e9142c9-ff24-402d-84c4-37cfb874e1f3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=144068) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:16:53.554961 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG dbcounter [-] [144068] Writing DB stats keystone:SELECT=100 {{(pid=144068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:16:53.592296 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e9142c9-ff24-402d-84c4-37cfb874e1f3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:16:53.593854 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e9142c9-ff24-402d-84c4-37cfb874e1f3 service neutron] RBAC: Authorization granted {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:16:53.613481 dv-cinder-851351-1-smb devstack@keystone.service[144068]: [pid: 144068|app: 0|req: 670/1329] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Jul 28 08:16:53 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 345 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 08:16:55.913035 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77c9561-52d4-4b32-94b9-f1b6988212a4 None None] REQUEST_METHOD: `GET` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:16:55.913629 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77c9561-52d4-4b32-94b9-f1b6988212a4 None None] SCRIPT_NAME: `/identity` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:16:55.913629 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77c9561-52d4-4b32-94b9-f1b6988212a4 None None] PATH_INFO: `/` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:16:55.914959 dv-cinder-851351-1-smb devstack@keystone.service[144067]: [pid: 144067|app: 0|req: 660/1330] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 08:16:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 08:16:55.920522 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e00d64-7bc7-49bc-bcc7-6f06ee0326a8 None None] REQUEST_METHOD: `POST` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:16:55.921002 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e00d64-7bc7-49bc-bcc7-6f06ee0326a8 None None] SCRIPT_NAME: `/identity` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:16:55.921104 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e00d64-7bc7-49bc-bcc7-6f06ee0326a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:16:55.994496 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.auth.core [None req-88e00d64-7bc7-49bc-bcc7-6f06ee0326a8 None None] MFA Rules not processed for user `bf5ceb8f07374635ad506b7d1b4f1612`. Rule list: `[]` (Enabled: `True`). {{(pid=144068) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 08:16:55.995750 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.fernet_utils [None req-88e00d64-7bc7-49bc-bcc7-6f06ee0326a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=144068) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:16:56.098508 dv-cinder-851351-1-smb devstack@keystone.service[144068]: [pid: 144068|app: 0|req: 671/1331] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 08:16:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 08:16:56.148183 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd95a66f-190a-4612-a60a-eb05650c8c13 None None] REQUEST_METHOD: `GET` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:16:56.148557 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd95a66f-190a-4612-a60a-eb05650c8c13 None None] SCRIPT_NAME: `/identity` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:16:56.148857 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd95a66f-190a-4612-a60a-eb05650c8c13 None None] PATH_INFO: `/` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:16:56.151018 dv-cinder-851351-1-smb devstack@keystone.service[144067]: [pid: 144067|app: 0|req: 661/1332] 10.222.0.42 () {54 vars in 965 bytes} [Thu Jul 28 08:16:56 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 08:16:56.158277 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ed33f0-11f0-482f-aaa8-27aa21c17c85 None None] REQUEST_METHOD: `POST` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:16:56.158609 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ed33f0-11f0-482f-aaa8-27aa21c17c85 None None] SCRIPT_NAME: `/identity` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:16:56.158991 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ed33f0-11f0-482f-aaa8-27aa21c17c85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:16:56.214343 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG dbcounter [-] [144068] Writing DB stats keystone:SELECT=100 {{(pid=144068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:16:56.248446 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.auth.core [None req-06ed33f0-11f0-482f-aaa8-27aa21c17c85 None None] MFA Rules not processed for user `ccb4223a248b45fba8dff662f7260b21`. Rule list: `[]` (Enabled: `True`). {{(pid=144068) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 08:16:56.249725 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.fernet_utils [None req-06ed33f0-11f0-482f-aaa8-27aa21c17c85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=144068) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:16:56.329530 dv-cinder-851351-1-smb devstack@keystone.service[144068]: [pid: 144068|app: 0|req: 672/1333] 10.222.0.42 () {58 vars in 1062 bytes} [Thu Jul 28 08:16:56 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 08:16:56.339146 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd95a66f-190a-4612-a60a-eb05650c8c13 None None] Authenticating user token {{(pid=144067) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:16:56.340700 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.fernet_utils [None req-dd95a66f-190a-4612-a60a-eb05650c8c13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=144067) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:16:56.447239 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd95a66f-190a-4612-a60a-eb05650c8c13 None None] Validating token access rules against request {{(pid=144067) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:16:56.524575 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae90795-136c-4654-bad5-baba57ff7eb1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccb4223a248b45fba8dff662f7260b21', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa39ab7491e5413ca648e31ee9177fa0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144067) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:16:56.525206 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae90795-136c-4654-bad5-baba57ff7eb1 service neutron] REQUEST_METHOD: `GET` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:16:56.525487 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae90795-136c-4654-bad5-baba57ff7eb1 service neutron] SCRIPT_NAME: `/identity` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:16:56.525759 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae90795-136c-4654-bad5-baba57ff7eb1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:16:56.527461 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.fernet_utils [None req-6ae90795-136c-4654-bad5-baba57ff7eb1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=144067) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:16:56.556235 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG dbcounter [-] [144067] Writing DB stats keystone:SELECT=100 {{(pid=144067) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:16:56.645326 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ae90795-136c-4654-bad5-baba57ff7eb1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:16:56.646806 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ae90795-136c-4654-bad5-baba57ff7eb1 service neutron] RBAC: Authorization granted {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:16:56.665448 dv-cinder-851351-1-smb devstack@keystone.service[144067]: [pid: 144067|app: 0|req: 662/1334] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Jul 28 08:16:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 28 08:16:58.933284 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d26b12d-e962-4682-a0d4-d168df20a182 None None] REQUEST_METHOD: `GET` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:16:58.933866 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d26b12d-e962-4682-a0d4-d168df20a182 None None] SCRIPT_NAME: `/identity` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:16:58.933866 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d26b12d-e962-4682-a0d4-d168df20a182 None None] PATH_INFO: `/` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:16:58.935290 dv-cinder-851351-1-smb devstack@keystone.service[144068]: [pid: 144068|app: 0|req: 673/1335] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 08:16:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 08:16:58.940972 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5043647d-a03f-40a3-ad4f-d1875d801185 None None] REQUEST_METHOD: `POST` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:16:58.941394 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5043647d-a03f-40a3-ad4f-d1875d801185 None None] SCRIPT_NAME: `/identity` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:16:58.941544 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5043647d-a03f-40a3-ad4f-d1875d801185 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:16:59.014863 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.auth.core [None req-5043647d-a03f-40a3-ad4f-d1875d801185 None None] MFA Rules not processed for user `bf5ceb8f07374635ad506b7d1b4f1612`. Rule list: `[]` (Enabled: `True`). {{(pid=144067) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 08:16:59.016149 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.fernet_utils [None req-5043647d-a03f-40a3-ad4f-d1875d801185 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=144067) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:16:59.099023 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG dbcounter [-] [144067] Writing DB stats keystone:SELECT=100 {{(pid=144067) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:16:59.128745 dv-cinder-851351-1-smb devstack@keystone.service[144067]: [pid: 144067|app: 0|req: 663/1336] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 08:16:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 08:16:59.171775 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d26b12d-e962-4682-a0d4-d168df20a182 None None] Authenticating user token {{(pid=144068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:16:59.173474 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.fernet_utils [None req-9d26b12d-e962-4682-a0d4-d168df20a182 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=144068) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:16:59.289670 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d26b12d-e962-4682-a0d4-d168df20a182 None None] Validating token access rules against request {{(pid=144068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:16:59.321271 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG dbcounter [-] [144068] Writing DB stats keystone:SELECT=100 {{(pid=144068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:16:59.371825 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a6e891-2102-4f33-8adc-c55880e25a66 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccb4223a248b45fba8dff662f7260b21', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa39ab7491e5413ca648e31ee9177fa0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:16:59.372472 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a6e891-2102-4f33-8adc-c55880e25a66 service neutron] REQUEST_METHOD: `GET` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:16:59.372797 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a6e891-2102-4f33-8adc-c55880e25a66 service neutron] SCRIPT_NAME: `/identity` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:16:59.373072 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a6e891-2102-4f33-8adc-c55880e25a66 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:16:59.374794 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.fernet_utils [None req-70a6e891-2102-4f33-8adc-c55880e25a66 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=144068) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:16:59.501749 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a6e891-2102-4f33-8adc-c55880e25a66 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:16:59.503217 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a6e891-2102-4f33-8adc-c55880e25a66 service neutron] RBAC: Authorization granted {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:16:59.522365 dv-cinder-851351-1-smb devstack@keystone.service[144068]: [pid: 144068|app: 0|req: 674/1337] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Jul 28 08:16:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 351 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 08:17:01.896705 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84920e66-72e3-4340-bc04-38881fd6a2ac None None] REQUEST_METHOD: `GET` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:17:01.897366 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84920e66-72e3-4340-bc04-38881fd6a2ac None None] SCRIPT_NAME: `/identity` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:17:01.897366 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84920e66-72e3-4340-bc04-38881fd6a2ac None None] PATH_INFO: `/` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:17:01.898658 dv-cinder-851351-1-smb devstack@keystone.service[144067]: [pid: 144067|app: 0|req: 664/1338] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 08:17:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 08:17:01.904300 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9451b2d5-fe94-4c5a-933d-5007e2dbe43f None None] REQUEST_METHOD: `POST` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:17:01.904761 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9451b2d5-fe94-4c5a-933d-5007e2dbe43f None None] SCRIPT_NAME: `/identity` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:17:01.904861 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9451b2d5-fe94-4c5a-933d-5007e2dbe43f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:17:01.975119 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.auth.core [None req-9451b2d5-fe94-4c5a-933d-5007e2dbe43f None None] MFA Rules not processed for user `bf5ceb8f07374635ad506b7d1b4f1612`. Rule list: `[]` (Enabled: `True`). {{(pid=144068) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 08:17:01.977555 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.fernet_utils [None req-9451b2d5-fe94-4c5a-933d-5007e2dbe43f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=144068) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:17:01.985716 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG dbcounter [-] [144068] Writing DB stats keystone:SELECT=100 {{(pid=144068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:17:02.079563 dv-cinder-851351-1-smb devstack@keystone.service[144068]: [pid: 144068|app: 0|req: 675/1339] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 08:17:01 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 08:17:02.117076 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84920e66-72e3-4340-bc04-38881fd6a2ac None None] Authenticating user token {{(pid=144067) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:17:02.118679 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.fernet_utils [None req-84920e66-72e3-4340-bc04-38881fd6a2ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=144067) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:17:02.250220 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84920e66-72e3-4340-bc04-38881fd6a2ac None None] Validating token access rules against request {{(pid=144067) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:17:02.331236 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2818e08a-ed77-4b26-a378-5046c9bc1996 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccb4223a248b45fba8dff662f7260b21', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa39ab7491e5413ca648e31ee9177fa0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144067) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:17:02.331871 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2818e08a-ed77-4b26-a378-5046c9bc1996 service neutron] REQUEST_METHOD: `GET` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:17:02.332163 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2818e08a-ed77-4b26-a378-5046c9bc1996 service neutron] SCRIPT_NAME: `/identity` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:17:02.332446 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2818e08a-ed77-4b26-a378-5046c9bc1996 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:17:02.334273 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.fernet_utils [None req-2818e08a-ed77-4b26-a378-5046c9bc1996 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=144067) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:17:02.373996 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG dbcounter [-] [144067] Writing DB stats keystone:SELECT=100 {{(pid=144067) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:17:02.450886 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2818e08a-ed77-4b26-a378-5046c9bc1996 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:17:02.452360 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2818e08a-ed77-4b26-a378-5046c9bc1996 service neutron] RBAC: Authorization granted {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:17:02.471599 dv-cinder-851351-1-smb devstack@keystone.service[144067]: [pid: 144067|app: 0|req: 665/1340] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Jul 28 08:17:02 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 355 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 08:17:06.534110 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8e1783-1d65-403a-b997-0977d86fab05 None None] REQUEST_METHOD: `GET` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:17:06.534641 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8e1783-1d65-403a-b997-0977d86fab05 None None] SCRIPT_NAME: `/identity` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:17:06.534641 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8e1783-1d65-403a-b997-0977d86fab05 None None] PATH_INFO: `/` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:17:06.536056 dv-cinder-851351-1-smb devstack@keystone.service[144068]: [pid: 144068|app: 0|req: 676/1341] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 08:17:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 08:17:06.542893 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b5357a-f7b4-4905-b0ce-e252c476f0b3 None None] REQUEST_METHOD: `POST` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:17:06.543485 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b5357a-f7b4-4905-b0ce-e252c476f0b3 None None] SCRIPT_NAME: `/identity` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:17:06.543822 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b5357a-f7b4-4905-b0ce-e252c476f0b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:17:06.646052 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.auth.core [None req-e8b5357a-f7b4-4905-b0ce-e252c476f0b3 None None] MFA Rules not processed for user `bf5ceb8f07374635ad506b7d1b4f1612`. Rule list: `[]` (Enabled: `True`). {{(pid=144067) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 08:17:06.647385 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.fernet_utils [None req-e8b5357a-f7b4-4905-b0ce-e252c476f0b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=144067) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:17:06.754095 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG dbcounter [-] [144067] Writing DB stats keystone:SELECT=100 {{(pid=144067) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:17:06.767977 dv-cinder-851351-1-smb devstack@keystone.service[144067]: [pid: 144067|app: 0|req: 666/1342] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 08:17:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 227 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 08:17:06.814735 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8e1783-1d65-403a-b997-0977d86fab05 None None] Authenticating user token {{(pid=144068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:17:06.815914 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.fernet_utils [None req-bb8e1783-1d65-403a-b997-0977d86fab05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=144068) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:17:06.945243 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8e1783-1d65-403a-b997-0977d86fab05 None None] Validating token access rules against request {{(pid=144068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:17:06.991170 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG dbcounter [-] [144068] Writing DB stats keystone:SELECT=100 {{(pid=144068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:17:07.042741 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f0319d-05e1-4d1d-8f79-22c7f254d934 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccb4223a248b45fba8dff662f7260b21', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa39ab7491e5413ca648e31ee9177fa0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:17:07.043432 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f0319d-05e1-4d1d-8f79-22c7f254d934 service neutron] REQUEST_METHOD: `GET` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:17:07.043789 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f0319d-05e1-4d1d-8f79-22c7f254d934 service neutron] SCRIPT_NAME: `/identity` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:17:07.043987 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f0319d-05e1-4d1d-8f79-22c7f254d934 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:17:07.045835 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.fernet_utils [None req-a1f0319d-05e1-4d1d-8f79-22c7f254d934 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=144068) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:17:07.222331 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f0319d-05e1-4d1d-8f79-22c7f254d934 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:17:07.225297 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f0319d-05e1-4d1d-8f79-22c7f254d934 service neutron] RBAC: Authorization granted {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:17:07.257862 dv-cinder-851351-1-smb devstack@keystone.service[144068]: [pid: 144068|app: 0|req: 677/1343] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Jul 28 08:17:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 446 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 08:17:10.526817 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dedb4d4-2523-4971-9ac5-fce37d685748 None None] REQUEST_METHOD: `GET` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:17:10.527378 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dedb4d4-2523-4971-9ac5-fce37d685748 None None] SCRIPT_NAME: `/identity` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:17:10.527378 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dedb4d4-2523-4971-9ac5-fce37d685748 None None] PATH_INFO: `/` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:17:10.529048 dv-cinder-851351-1-smb devstack@keystone.service[144067]: [pid: 144067|app: 0|req: 667/1344] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 08:17:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 08:17:10.535679 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24171d03-c076-4103-b7d4-0770a684ef4c None None] REQUEST_METHOD: `POST` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:17:10.536493 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24171d03-c076-4103-b7d4-0770a684ef4c None None] SCRIPT_NAME: `/identity` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:17:10.536493 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24171d03-c076-4103-b7d4-0770a684ef4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:17:10.648787 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.auth.core [None req-24171d03-c076-4103-b7d4-0770a684ef4c None None] MFA Rules not processed for user `bf5ceb8f07374635ad506b7d1b4f1612`. Rule list: `[]` (Enabled: `True`). {{(pid=144068) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 08:17:10.650186 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.fernet_utils [None req-24171d03-c076-4103-b7d4-0770a684ef4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=144068) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:17:10.681504 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG dbcounter [-] [144068] Writing DB stats keystone:SELECT=100 {{(pid=144068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:17:10.808538 dv-cinder-851351-1-smb devstack@keystone.service[144068]: [pid: 144068|app: 0|req: 678/1345] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 08:17:10 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 274 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 08:17:10.852911 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dedb4d4-2523-4971-9ac5-fce37d685748 None None] Authenticating user token {{(pid=144067) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:17:10.854632 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.fernet_utils [None req-6dedb4d4-2523-4971-9ac5-fce37d685748 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=144067) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:17:11.001142 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dedb4d4-2523-4971-9ac5-fce37d685748 None None] Validating token access rules against request {{(pid=144067) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:17:11.127087 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9410e7e3-c39c-45cd-91ec-b3bb6b8f5ee4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccb4223a248b45fba8dff662f7260b21', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa39ab7491e5413ca648e31ee9177fa0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144067) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:17:11.128162 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9410e7e3-c39c-45cd-91ec-b3bb6b8f5ee4 service neutron] REQUEST_METHOD: `GET` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:17:11.128651 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9410e7e3-c39c-45cd-91ec-b3bb6b8f5ee4 service neutron] SCRIPT_NAME: `/identity` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:17:11.129188 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9410e7e3-c39c-45cd-91ec-b3bb6b8f5ee4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:17:11.132086 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.fernet_utils [None req-9410e7e3-c39c-45cd-91ec-b3bb6b8f5ee4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=144067) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:17:11.193360 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG dbcounter [-] [144067] Writing DB stats keystone:SELECT=100 {{(pid=144067) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:17:11.282527 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9410e7e3-c39c-45cd-91ec-b3bb6b8f5ee4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:17:11.284494 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9410e7e3-c39c-45cd-91ec-b3bb6b8f5ee4 service neutron] RBAC: Authorization granted {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:17:11.307682 dv-cinder-851351-1-smb devstack@keystone.service[144067]: [pid: 144067|app: 0|req: 668/1346] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Jul 28 08:17:10 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 455 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 08:17:16.403945 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a50b547-76a3-454a-9495-a30762f5eb0a None None] REQUEST_METHOD: `GET` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:17:16.404439 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a50b547-76a3-454a-9495-a30762f5eb0a None None] SCRIPT_NAME: `/identity` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:17:16.404539 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a50b547-76a3-454a-9495-a30762f5eb0a None None] PATH_INFO: `/` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:17:16.405969 dv-cinder-851351-1-smb devstack@keystone.service[144068]: [pid: 144068|app: 0|req: 679/1347] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 08:17:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 08:17:16.412425 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49b62e9-16ba-4073-8159-9676eb5df5d1 None None] REQUEST_METHOD: `POST` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:17:16.413146 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49b62e9-16ba-4073-8159-9676eb5df5d1 None None] SCRIPT_NAME: `/identity` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:17:16.413146 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49b62e9-16ba-4073-8159-9676eb5df5d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:17:16.494276 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.auth.core [None req-e49b62e9-16ba-4073-8159-9676eb5df5d1 None None] MFA Rules not processed for user `bf5ceb8f07374635ad506b7d1b4f1612`. Rule list: `[]` (Enabled: `True`). {{(pid=144067) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 08:17:16.495615 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.fernet_utils [None req-e49b62e9-16ba-4073-8159-9676eb5df5d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=144067) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:17:16.624596 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG dbcounter [-] [144067] Writing DB stats keystone:SELECT=100 {{(pid=144067) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:17:16.627644 dv-cinder-851351-1-smb devstack@keystone.service[144067]: [pid: 144067|app: 0|req: 669/1348] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 08:17:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 08:17:16.668910 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a50b547-76a3-454a-9495-a30762f5eb0a None None] Authenticating user token {{(pid=144068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:17:16.670821 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.fernet_utils [None req-8a50b547-76a3-454a-9495-a30762f5eb0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=144068) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:17:16.812739 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a50b547-76a3-454a-9495-a30762f5eb0a None None] Validating token access rules against request {{(pid=144068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:17:16.868898 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG dbcounter [-] [144068] Writing DB stats keystone:SELECT=100 {{(pid=144068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:17:16.912623 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a780b5e1-aac9-4727-818f-7c8226f3aa17 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ccb4223a248b45fba8dff662f7260b21', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa39ab7491e5413ca648e31ee9177fa0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:17:16.913237 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a780b5e1-aac9-4727-818f-7c8226f3aa17 service neutron] REQUEST_METHOD: `GET` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:17:16.913531 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a780b5e1-aac9-4727-818f-7c8226f3aa17 service neutron] SCRIPT_NAME: `/identity` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:17:16.914006 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a780b5e1-aac9-4727-818f-7c8226f3aa17 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:17:16.916713 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.fernet_utils [None req-a780b5e1-aac9-4727-818f-7c8226f3aa17 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=144068) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:17:17.079903 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a780b5e1-aac9-4727-818f-7c8226f3aa17 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:17:17.081570 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a780b5e1-aac9-4727-818f-7c8226f3aa17 service neutron] RBAC: Authorization granted {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:17:17.103102 dv-cinder-851351-1-smb devstack@keystone.service[144068]: [pid: 144068|app: 0|req: 680/1349] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Jul 28 08:17:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 435 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 28 08:17:22.551493 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73c3ca0-ce92-4624-9340-5dc38f8e05de None None] REQUEST_METHOD: `GET` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:17:22.552054 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73c3ca0-ce92-4624-9340-5dc38f8e05de None None] SCRIPT_NAME: `/identity` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:17:22.552054 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73c3ca0-ce92-4624-9340-5dc38f8e05de None None] PATH_INFO: `/` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:17:22.553637 dv-cinder-851351-1-smb devstack@keystone.service[144067]: [pid: 144067|app: 0|req: 670/1350] 10.222.0.42 () {54 vars in 921 bytes} [Thu Jul 28 08:17:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 08:17:22.559737 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1dd5db-98c1-46da-8b90-a24aab481006 None None] REQUEST_METHOD: `POST` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:17:22.560809 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1dd5db-98c1-46da-8b90-a24aab481006 None None] SCRIPT_NAME: `/identity` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:17:22.561472 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1dd5db-98c1-46da-8b90-a24aab481006 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:17:22.670587 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.auth.core [None req-0a1dd5db-98c1-46da-8b90-a24aab481006 None None] MFA Rules not processed for user `5f254b5035b6418db1fac08a128b3097`. Rule list: `[]` (Enabled: `True`). {{(pid=144068) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 08:17:22.671763 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.fernet_utils [None req-0a1dd5db-98c1-46da-8b90-a24aab481006 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=144068) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:17:22.704060 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG dbcounter [-] [144068] Writing DB stats keystone:SELECT=100 {{(pid=144068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:17:22.865709 dv-cinder-851351-1-smb devstack@keystone.service[144068]: [pid: 144068|app: 0|req: 681/1351] 10.222.0.42 () {58 vars in 1018 bytes} [Thu Jul 28 08:17:22 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 307 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 08:17:27.737785 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2db5ec-9637-4709-8cd7-00969cc9f02a None None] REQUEST_METHOD: `GET` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:17:27.738890 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2db5ec-9637-4709-8cd7-00969cc9f02a None None] SCRIPT_NAME: `/identity` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:17:27.739216 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2db5ec-9637-4709-8cd7-00969cc9f02a None None] PATH_INFO: `/` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:17:27.741266 dv-cinder-851351-1-smb devstack@keystone.service[144067]: [pid: 144067|app: 0|req: 671/1352] 10.222.0.42 () {54 vars in 921 bytes} [Thu Jul 28 08:17:27 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 08:17:27.747056 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b74f6f4-11b4-465e-b978-8e6c1e1a690e None None] REQUEST_METHOD: `POST` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:17:27.747703 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b74f6f4-11b4-465e-b978-8e6c1e1a690e None None] SCRIPT_NAME: `/identity` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:17:27.747841 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b74f6f4-11b4-465e-b978-8e6c1e1a690e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:17:27.881680 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.auth.core [None req-7b74f6f4-11b4-465e-b978-8e6c1e1a690e None None] MFA Rules not processed for user `5f254b5035b6418db1fac08a128b3097`. Rule list: `[]` (Enabled: `True`). {{(pid=144068) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 08:17:27.882986 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.fernet_utils [None req-7b74f6f4-11b4-465e-b978-8e6c1e1a690e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=144068) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:17:27.992189 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG dbcounter [-] [144068] Writing DB stats keystone:SELECT=100 {{(pid=144068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:17:28.044425 dv-cinder-851351-1-smb devstack@keystone.service[144068]: [pid: 144068|app: 0|req: 682/1353] 10.222.0.42 () {58 vars in 1018 bytes} [Thu Jul 28 08:17:27 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 298 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 08:17:29.150319 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b98449-968c-47af-a6d5-e4f8127043d3 None None] REQUEST_METHOD: `GET` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:17:29.150882 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b98449-968c-47af-a6d5-e4f8127043d3 None None] SCRIPT_NAME: `/identity` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:17:29.151133 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b98449-968c-47af-a6d5-e4f8127043d3 None None] PATH_INFO: `/` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:17:29.152681 dv-cinder-851351-1-smb devstack@keystone.service[144067]: [pid: 144067|app: 0|req: 672/1354] 10.222.0.42 () {54 vars in 921 bytes} [Thu Jul 28 08:17:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 08:17:29.158972 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff2f2f0-525a-41ef-bcdc-11952ac4ac99 None None] REQUEST_METHOD: `POST` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:17:29.159838 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff2f2f0-525a-41ef-bcdc-11952ac4ac99 None None] SCRIPT_NAME: `/identity` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:17:29.159838 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff2f2f0-525a-41ef-bcdc-11952ac4ac99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:17:29.253009 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.auth.core [None req-bff2f2f0-525a-41ef-bcdc-11952ac4ac99 None None] MFA Rules not processed for user `5f254b5035b6418db1fac08a128b3097`. Rule list: `[]` (Enabled: `True`). {{(pid=144068) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 08:17:29.254274 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.fernet_utils [None req-bff2f2f0-525a-41ef-bcdc-11952ac4ac99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=144068) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:17:29.386275 dv-cinder-851351-1-smb devstack@keystone.service[144068]: [pid: 144068|app: 0|req: 683/1355] 10.222.0.42 () {58 vars in 1018 bytes} [Thu Jul 28 08:17:29 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 229 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 08:17:32.966164 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18fbdeb2-3cd9-4c79-af45-a8494c095c30 None None] REQUEST_METHOD: `GET` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:17:32.966678 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18fbdeb2-3cd9-4c79-af45-a8494c095c30 None None] SCRIPT_NAME: `/identity` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:17:32.970339 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18fbdeb2-3cd9-4c79-af45-a8494c095c30 None None] PATH_INFO: `/` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:17:32.970339 dv-cinder-851351-1-smb devstack@keystone.service[144067]: [pid: 144067|app: 0|req: 673/1356] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 08:17:32 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 08:17:32.977011 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbae9d7-766b-4a04-a68d-927ecbb1be07 None None] REQUEST_METHOD: `POST` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:17:32.977976 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbae9d7-766b-4a04-a68d-927ecbb1be07 None None] SCRIPT_NAME: `/identity` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:17:32.978474 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbae9d7-766b-4a04-a68d-927ecbb1be07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:17:33.048369 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG dbcounter [-] [144068] Writing DB stats keystone:SELECT=100 {{(pid=144068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:17:33.091171 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.auth.core [None req-adbae9d7-766b-4a04-a68d-927ecbb1be07 None None] MFA Rules not processed for user `bf5ceb8f07374635ad506b7d1b4f1612`. Rule list: `[]` (Enabled: `True`). {{(pid=144068) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 08:17:33.092451 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.fernet_utils [None req-adbae9d7-766b-4a04-a68d-927ecbb1be07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=144068) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:17:33.240068 dv-cinder-851351-1-smb devstack@keystone.service[144068]: [pid: 144068|app: 0|req: 684/1357] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 08:17:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 264 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 08:17:33.301635 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a664a0b-318b-4d6e-81fe-66df6758fdbb None None] REQUEST_METHOD: `GET` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:17:33.302339 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a664a0b-318b-4d6e-81fe-66df6758fdbb None None] SCRIPT_NAME: `/identity` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:17:33.302882 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a664a0b-318b-4d6e-81fe-66df6758fdbb None None] PATH_INFO: `/` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:17:33.305872 dv-cinder-851351-1-smb devstack@keystone.service[144067]: [pid: 144067|app: 0|req: 674/1358] 10.222.0.42 () {54 vars in 962 bytes} [Thu Jul 28 08:17:33 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 08:17:33.329927 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714f209a-704d-4a96-bdff-3432b7ba3b35 None None] REQUEST_METHOD: `POST` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:17:33.330792 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714f209a-704d-4a96-bdff-3432b7ba3b35 None None] SCRIPT_NAME: `/identity` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:17:33.331238 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714f209a-704d-4a96-bdff-3432b7ba3b35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:17:33.447557 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.auth.core [None req-714f209a-704d-4a96-bdff-3432b7ba3b35 None None] MFA Rules not processed for user `2c1de9cd80344cefa3e06ae8c9c9e5d9`. Rule list: `[]` (Enabled: `True`). {{(pid=144068) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 08:17:33.448768 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.fernet_utils [None req-714f209a-704d-4a96-bdff-3432b7ba3b35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=144068) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:17:33.513509 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG dbcounter [-] [144068] Writing DB stats keystone:SELECT=100 {{(pid=144068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:17:33.647752 dv-cinder-851351-1-smb devstack@keystone.service[144068]: [pid: 144068|app: 0|req: 685/1359] 10.222.0.42 () {58 vars in 1059 bytes} [Thu Jul 28 08:17:33 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 320 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 08:17:33.657081 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a664a0b-318b-4d6e-81fe-66df6758fdbb None None] Authenticating user token {{(pid=144067) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:17:33.658761 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.fernet_utils [None req-2a664a0b-318b-4d6e-81fe-66df6758fdbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=144067) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:17:33.886251 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a664a0b-318b-4d6e-81fe-66df6758fdbb None None] Validating token access rules against request {{(pid=144067) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:17:34.025904 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG dbcounter [-] [144067] Writing DB stats keystone:SELECT=100 {{(pid=144067) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:17:34.105518 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47844486-cfa7-4446-ade4-4a8a3ad8b4f3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c1de9cd80344cefa3e06ae8c9c9e5d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa39ab7491e5413ca648e31ee9177fa0', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144067) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:17:34.106541 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47844486-cfa7-4446-ade4-4a8a3ad8b4f3 service nova] REQUEST_METHOD: `GET` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:17:34.107015 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47844486-cfa7-4446-ade4-4a8a3ad8b4f3 service nova] SCRIPT_NAME: `/identity` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:17:34.107477 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47844486-cfa7-4446-ade4-4a8a3ad8b4f3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:17:34.110469 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.fernet_utils [None req-47844486-cfa7-4446-ade4-4a8a3ad8b4f3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=144067) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:17:34.276474 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47844486-cfa7-4446-ade4-4a8a3ad8b4f3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:17:34.278334 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47844486-cfa7-4446-ade4-4a8a3ad8b4f3 service nova] RBAC: Authorization granted {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:17:34.299608 dv-cinder-851351-1-smb devstack@keystone.service[144067]: [pid: 144067|app: 0|req: 675/1360] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Jul 28 08:17:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 644 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 08:17:37.062438 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210bec90-3def-4f9b-8ed9-91d528c4ac01 None None] REQUEST_METHOD: `GET` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:17:37.063138 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210bec90-3def-4f9b-8ed9-91d528c4ac01 None None] SCRIPT_NAME: `/identity` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:17:37.063138 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210bec90-3def-4f9b-8ed9-91d528c4ac01 None None] PATH_INFO: `/` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:17:37.065242 dv-cinder-851351-1-smb devstack@keystone.service[144068]: [pid: 144068|app: 0|req: 686/1361] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 08:17:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 08:17:37.071675 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f57e71-675f-4288-b6c9-90d7a8e38ed5 None None] REQUEST_METHOD: `POST` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:17:37.072162 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f57e71-675f-4288-b6c9-90d7a8e38ed5 None None] SCRIPT_NAME: `/identity` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:17:37.072415 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f57e71-675f-4288-b6c9-90d7a8e38ed5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:17:37.172216 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.auth.core [None req-13f57e71-675f-4288-b6c9-90d7a8e38ed5 None None] MFA Rules not processed for user `bf5ceb8f07374635ad506b7d1b4f1612`. Rule list: `[]` (Enabled: `True`). {{(pid=144067) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 08:17:37.175245 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.fernet_utils [None req-13f57e71-675f-4288-b6c9-90d7a8e38ed5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=144067) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:17:37.244465 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG dbcounter [-] [144067] Writing DB stats keystone:SELECT=100 {{(pid=144067) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:17:37.324367 dv-cinder-851351-1-smb devstack@keystone.service[144067]: [pid: 144067|app: 0|req: 676/1362] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 08:17:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 254 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 08:17:37.377266 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-210bec90-3def-4f9b-8ed9-91d528c4ac01 None None] Authenticating user token {{(pid=144068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:17:37.377266 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.fernet_utils [None req-210bec90-3def-4f9b-8ed9-91d528c4ac01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=144068) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:17:37.574405 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-210bec90-3def-4f9b-8ed9-91d528c4ac01 None None] Validating token access rules against request {{(pid=144068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:17:37.594490 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG dbcounter [-] [144068] Writing DB stats keystone:SELECT=100 {{(pid=144068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:17:37.769414 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f279d7-b0a0-4cec-a256-b7bc59fdc608 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c1de9cd80344cefa3e06ae8c9c9e5d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa39ab7491e5413ca648e31ee9177fa0', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:17:37.770285 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f279d7-b0a0-4cec-a256-b7bc59fdc608 service nova] REQUEST_METHOD: `GET` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:17:37.770750 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f279d7-b0a0-4cec-a256-b7bc59fdc608 service nova] SCRIPT_NAME: `/identity` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:17:37.771963 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f279d7-b0a0-4cec-a256-b7bc59fdc608 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:17:37.773512 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.fernet_utils [None req-79f279d7-b0a0-4cec-a256-b7bc59fdc608 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=144068) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:17:37.903621 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79f279d7-b0a0-4cec-a256-b7bc59fdc608 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:17:37.905662 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79f279d7-b0a0-4cec-a256-b7bc59fdc608 service nova] RBAC: Authorization granted {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:17:37.931628 dv-cinder-851351-1-smb devstack@keystone.service[144068]: [pid: 144068|app: 0|req: 687/1363] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Jul 28 08:17:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 557 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 08:17:40.335888 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7653e9-17d1-4d7c-9587-7c25eaf3f336 None None] REQUEST_METHOD: `GET` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:17:40.336484 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7653e9-17d1-4d7c-9587-7c25eaf3f336 None None] SCRIPT_NAME: `/identity` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:17:40.336484 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7653e9-17d1-4d7c-9587-7c25eaf3f336 None None] PATH_INFO: `/` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:17:40.338007 dv-cinder-851351-1-smb devstack@keystone.service[144067]: [pid: 144067|app: 0|req: 677/1364] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 08:17:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 08:17:40.343627 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5fff005-1ee0-4169-b959-d4a05d16f03a None None] REQUEST_METHOD: `POST` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:17:40.344195 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5fff005-1ee0-4169-b959-d4a05d16f03a None None] SCRIPT_NAME: `/identity` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:17:40.344298 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5fff005-1ee0-4169-b959-d4a05d16f03a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:17:40.360863 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG dbcounter [-] [144068] Writing DB stats keystone:SELECT=100 {{(pid=144068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:17:40.416799 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.auth.core [None req-d5fff005-1ee0-4169-b959-d4a05d16f03a None None] MFA Rules not processed for user `bf5ceb8f07374635ad506b7d1b4f1612`. Rule list: `[]` (Enabled: `True`). {{(pid=144068) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 08:17:40.418061 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.fernet_utils [None req-d5fff005-1ee0-4169-b959-d4a05d16f03a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=144068) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:17:40.524210 dv-cinder-851351-1-smb devstack@keystone.service[144068]: [pid: 144068|app: 0|req: 688/1365] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 08:17:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 08:17:40.569858 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a14241d-7408-4cc1-874d-4701dd2f4010 None None] REQUEST_METHOD: `GET` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:17:40.570650 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a14241d-7408-4cc1-874d-4701dd2f4010 None None] SCRIPT_NAME: `/identity` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:17:40.570650 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a14241d-7408-4cc1-874d-4701dd2f4010 None None] PATH_INFO: `/` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:17:40.572286 dv-cinder-851351-1-smb devstack@keystone.service[144067]: [pid: 144067|app: 0|req: 678/1366] 10.222.0.42 () {54 vars in 962 bytes} [Thu Jul 28 08:17:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 08:17:40.577978 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141242c9-7abb-499f-8d00-89952094ea3d None None] REQUEST_METHOD: `POST` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:17:40.578431 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141242c9-7abb-499f-8d00-89952094ea3d None None] SCRIPT_NAME: `/identity` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:17:40.578797 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141242c9-7abb-499f-8d00-89952094ea3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:17:40.660095 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.auth.core [None req-141242c9-7abb-499f-8d00-89952094ea3d None None] MFA Rules not processed for user `2c1de9cd80344cefa3e06ae8c9c9e5d9`. Rule list: `[]` (Enabled: `True`). {{(pid=144068) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 08:17:40.661434 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.fernet_utils [None req-141242c9-7abb-499f-8d00-89952094ea3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=144068) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:17:40.700033 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG dbcounter [-] [144068] Writing DB stats keystone:SELECT=100 {{(pid=144068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:17:40.792716 dv-cinder-851351-1-smb devstack@keystone.service[144068]: [pid: 144068|app: 0|req: 689/1367] 10.222.0.42 () {58 vars in 1059 bytes} [Thu Jul 28 08:17:40 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 08:17:40.801010 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a14241d-7408-4cc1-874d-4701dd2f4010 None None] Authenticating user token {{(pid=144067) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:17:40.802714 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.fernet_utils [None req-3a14241d-7408-4cc1-874d-4701dd2f4010 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=144067) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:17:40.971563 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a14241d-7408-4cc1-874d-4701dd2f4010 None None] Validating token access rules against request {{(pid=144067) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:17:41.003326 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG dbcounter [-] [144067] Writing DB stats keystone:SELECT=100 {{(pid=144067) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:17:41.107880 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6c3bcf-1e61-4933-9260-4fcc1e504ece service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c1de9cd80344cefa3e06ae8c9c9e5d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa39ab7491e5413ca648e31ee9177fa0', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144067) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:17:41.108519 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6c3bcf-1e61-4933-9260-4fcc1e504ece service nova] REQUEST_METHOD: `GET` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:17:41.108832 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6c3bcf-1e61-4933-9260-4fcc1e504ece service nova] SCRIPT_NAME: `/identity` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:17:41.109111 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6c3bcf-1e61-4933-9260-4fcc1e504ece service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:17:41.110793 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.fernet_utils [None req-fc6c3bcf-1e61-4933-9260-4fcc1e504ece service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=144067) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:17:41.205216 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc6c3bcf-1e61-4933-9260-4fcc1e504ece service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:17:41.207157 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc6c3bcf-1e61-4933-9260-4fcc1e504ece service nova] RBAC: Authorization granted {{(pid=144067) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:17:41.227426 dv-cinder-851351-1-smb devstack@keystone.service[144067]: [pid: 144067|app: 0|req: 679/1368] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Jul 28 08:17:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 427 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 08:17:41.773223 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2a1930-153e-49c7-91ee-924766cc56c6 None None] REQUEST_METHOD: `GET` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:17:41.773746 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2a1930-153e-49c7-91ee-924766cc56c6 None None] SCRIPT_NAME: `/identity` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:17:41.773746 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2a1930-153e-49c7-91ee-924766cc56c6 None None] PATH_INFO: `/` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:17:41.776714 dv-cinder-851351-1-smb devstack@keystone.service[144068]: [pid: 144068|app: 0|req: 690/1369] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 08:17:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 08:17:41.780616 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab9ef79-30ac-4221-9f63-4fce63ccc3a1 None None] REQUEST_METHOD: `POST` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:17:41.781119 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab9ef79-30ac-4221-9f63-4fce63ccc3a1 None None] SCRIPT_NAME: `/identity` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:17:41.781399 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab9ef79-30ac-4221-9f63-4fce63ccc3a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:17:41.816853 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG dbcounter [-] [144067] Writing DB stats keystone:SELECT=100 {{(pid=144067) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:17:41.855255 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.auth.core [None req-4ab9ef79-30ac-4221-9f63-4fce63ccc3a1 None None] MFA Rules not processed for user `bf5ceb8f07374635ad506b7d1b4f1612`. Rule list: `[]` (Enabled: `True`). {{(pid=144067) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 08:17:41.856460 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.fernet_utils [None req-4ab9ef79-30ac-4221-9f63-4fce63ccc3a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=144067) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:17:41.973188 dv-cinder-851351-1-smb devstack@keystone.service[144067]: [pid: 144067|app: 0|req: 680/1370] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 08:17:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 08:17:43.322560 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46fc48b-0258-4ce0-984b-dd2d1bd060cd None None] REQUEST_METHOD: `GET` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:17:43.323116 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46fc48b-0258-4ce0-984b-dd2d1bd060cd None None] SCRIPT_NAME: `/identity` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:17:43.323116 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46fc48b-0258-4ce0-984b-dd2d1bd060cd None None] PATH_INFO: `/` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:17:43.324539 dv-cinder-851351-1-smb devstack@keystone.service[144068]: [pid: 144068|app: 0|req: 691/1371] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 08:17:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 08:17:43.330000 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d4ab61-7cd3-4588-ad71-5e8641814e96 None None] REQUEST_METHOD: `POST` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:17:43.330450 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d4ab61-7cd3-4588-ad71-5e8641814e96 None None] SCRIPT_NAME: `/identity` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:17:43.330537 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d4ab61-7cd3-4588-ad71-5e8641814e96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=144067) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:17:43.400436 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.auth.core [None req-11d4ab61-7cd3-4588-ad71-5e8641814e96 None None] MFA Rules not processed for user `bf5ceb8f07374635ad506b7d1b4f1612`. Rule list: `[]` (Enabled: `True`). {{(pid=144067) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 08:17:43.401690 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG keystone.common.fernet_utils [None req-11d4ab61-7cd3-4588-ad71-5e8641814e96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=144067) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:17:43.456318 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG dbcounter [-] [144067] Writing DB stats keystone:SELECT=100 {{(pid=144067) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:17:43.511532 dv-cinder-851351-1-smb devstack@keystone.service[144067]: [pid: 144067|app: 0|req: 681/1372] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 08:17:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 08:17:43.557712 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f46fc48b-0258-4ce0-984b-dd2d1bd060cd None None] Authenticating user token {{(pid=144068) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:17:43.559332 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.fernet_utils [None req-f46fc48b-0258-4ce0-984b-dd2d1bd060cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=144068) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:17:43.903470 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG dbcounter [-] [144068] Writing DB stats keystone:SELECT=100 {{(pid=144068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:17:43.926121 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f46fc48b-0258-4ce0-984b-dd2d1bd060cd None None] Validating token access rules against request {{(pid=144068) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:17:44.171869 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3eb780-0d69-426b-932e-18cbddbe9fa4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2c1de9cd80344cefa3e06ae8c9c9e5d9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa39ab7491e5413ca648e31ee9177fa0', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=144068) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:17:44.171869 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3eb780-0d69-426b-932e-18cbddbe9fa4 service nova] REQUEST_METHOD: `GET` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:17:44.171869 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3eb780-0d69-426b-932e-18cbddbe9fa4 service nova] SCRIPT_NAME: `/identity` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:17:44.171869 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3eb780-0d69-426b-932e-18cbddbe9fa4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=144068) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:17:44.188416 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.fernet_utils [None req-ab3eb780-0d69-426b-932e-18cbddbe9fa4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=144068) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:17:44.226591 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab3eb780-0d69-426b-932e-18cbddbe9fa4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:17:44.226591 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab3eb780-0d69-426b-932e-18cbddbe9fa4 service nova] RBAC: Authorization granted {{(pid=144068) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:17:44.232370 dv-cinder-851351-1-smb devstack@keystone.service[144068]: DEBUG dbcounter [-] [144068] Writing DB stats keystone:SELECT=100 {{(pid=144068) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:17:44.235981 dv-cinder-851351-1-smb devstack@keystone.service[144068]: [pid: 144068|app: 0|req: 692/1373] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Jul 28 08:17:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 679 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 08:17:53.509983 dv-cinder-851351-1-smb devstack@keystone.service[144067]: DEBUG dbcounter [-] [144067] Writing DB stats keystone:SELECT=19 {{(pid=144067) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:18:03.575749 dv-cinder-851351-1-smb systemd[1]: Stopping Devstack devstack@keystone.service... Jul 28 08:18:03.576317 dv-cinder-851351-1-smb devstack@keystone.service[144058]: Thu Jul 28 08:18:03 2022 - graceful shutdown triggered... Jul 28 08:18:03.576913 dv-cinder-851351-1-smb devstack@keystone.service[144067]: Gracefully killing worker 1 (pid: 144067)... Jul 28 08:18:03.577303 dv-cinder-851351-1-smb devstack@keystone.service[144068]: Gracefully killing worker 2 (pid: 144068)... Jul 28 08:18:04.577496 dv-cinder-851351-1-smb devstack@keystone.service[144058]: worker 1 buried after 1 seconds Jul 28 08:18:04.577496 dv-cinder-851351-1-smb devstack@keystone.service[144058]: worker 2 buried after 1 seconds Jul 28 08:18:04.577496 dv-cinder-851351-1-smb devstack@keystone.service[144058]: goodbye to uWSGI. Jul 28 08:18:04.579278 dv-cinder-851351-1-smb systemd[1]: devstack@keystone.service: Succeeded. Jul 28 08:18:04.579843 dv-cinder-851351-1-smb systemd[1]: Stopped Devstack devstack@keystone.service. Jul 28 08:22:51.514211 dv-cinder-851351-1-smb systemd[1]: Starting Devstack devstack@keystone.service... Jul 28 08:22:51.523987 dv-cinder-851351-1-smb devstack@keystone.service[207588]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Jul 28 08:22:51.526096 dv-cinder-851351-1-smb devstack@keystone.service[207588]: *** Starting uWSGI 2.0.18-debian (64bit) on [Thu Jul 28 08:22:51 2022] *** Jul 28 08:22:51.526096 dv-cinder-851351-1-smb devstack@keystone.service[207588]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jul 28 08:22:51.526096 dv-cinder-851351-1-smb devstack@keystone.service[207588]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jul 28 08:22:51.526096 dv-cinder-851351-1-smb devstack@keystone.service[207588]: nodename: dv-cinder-851351-1-smb Jul 28 08:22:51.526096 dv-cinder-851351-1-smb devstack@keystone.service[207588]: machine: x86_64 Jul 28 08:22:51.526096 dv-cinder-851351-1-smb devstack@keystone.service[207588]: clock source: unix Jul 28 08:22:51.526096 dv-cinder-851351-1-smb devstack@keystone.service[207588]: pcre jit disabled Jul 28 08:22:51.526096 dv-cinder-851351-1-smb devstack@keystone.service[207588]: detected number of CPU cores: 4 Jul 28 08:22:51.526096 dv-cinder-851351-1-smb devstack@keystone.service[207588]: current working directory: / Jul 28 08:22:51.526096 dv-cinder-851351-1-smb devstack@keystone.service[207588]: detected binary path: /usr/bin/uwsgi-core Jul 28 08:22:51.526096 dv-cinder-851351-1-smb devstack@keystone.service[207588]: your processes number limit is 47680 Jul 28 08:22:51.526096 dv-cinder-851351-1-smb devstack@keystone.service[207588]: your memory page size is 4096 bytes Jul 28 08:22:51.526876 dv-cinder-851351-1-smb devstack@keystone.service[207588]: detected max file descriptor number: 2048 Jul 28 08:22:51.526876 dv-cinder-851351-1-smb devstack@keystone.service[207588]: lock engine: pthread robust mutexes Jul 28 08:22:51.526876 dv-cinder-851351-1-smb devstack@keystone.service[207588]: thunder lock: enabled Jul 28 08:22:51.526876 dv-cinder-851351-1-smb devstack@keystone.service[207588]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Jul 28 08:22:51.526876 dv-cinder-851351-1-smb devstack@keystone.service[207588]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Jul 28 08:22:51.565865 dv-cinder-851351-1-smb devstack@keystone.service[207588]: Python main interpreter initialized at 0x564ffc6c99c0 Jul 28 08:22:51.565865 dv-cinder-851351-1-smb devstack@keystone.service[207588]: python threads support enabled Jul 28 08:22:51.565865 dv-cinder-851351-1-smb devstack@keystone.service[207588]: your server socket listen backlog is limited to 100 connections Jul 28 08:22:51.565865 dv-cinder-851351-1-smb devstack@keystone.service[207588]: your mercy for graceful operations on workers is 90 seconds Jul 28 08:22:51.566344 dv-cinder-851351-1-smb devstack@keystone.service[207588]: mapped 403077 bytes (393 KB) for 2 cores Jul 28 08:22:51.566344 dv-cinder-851351-1-smb devstack@keystone.service[207588]: *** Operational MODE: preforking *** Jul 28 08:22:51.566579 dv-cinder-851351-1-smb devstack@keystone.service[207588]: *** uWSGI is running in multiple interpreter mode *** Jul 28 08:22:51.566579 dv-cinder-851351-1-smb devstack@keystone.service[207588]: spawned uWSGI master process (pid: 207588) Jul 28 08:22:51.566786 dv-cinder-851351-1-smb systemd[1]: Started Devstack devstack@keystone.service. Jul 28 08:22:51.567534 dv-cinder-851351-1-smb devstack@keystone.service[207588]: spawned uWSGI worker 1 (pid: 207600, cores: 1) Jul 28 08:22:51.567772 dv-cinder-851351-1-smb devstack@keystone.service[207588]: spawned uWSGI worker 2 (pid: 207601, cores: 1) Jul 28 08:22:51.568702 dv-cinder-851351-1-smb devstack@keystone.service[207588]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jul 28 08:22:57.061587 dv-cinder-851351-1-smb devstack@keystone.service[207600]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 28 08:22:57.061587 dv-cinder-851351-1-smb devstack@keystone.service[207600]: from cryptography.utils import int_from_bytes Jul 28 08:22:57.062520 dv-cinder-851351-1-smb devstack@keystone.service[207601]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 28 08:22:57.062520 dv-cinder-851351-1-smb devstack@keystone.service[207601]: from cryptography.utils import int_from_bytes Jul 28 08:22:57.062993 dv-cinder-851351-1-smb devstack@keystone.service[207600]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 28 08:22:57.062993 dv-cinder-851351-1-smb devstack@keystone.service[207600]: from cryptography.utils import int_from_bytes Jul 28 08:22:57.063124 dv-cinder-851351-1-smb devstack@keystone.service[207601]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 28 08:22:57.063124 dv-cinder-851351-1-smb devstack@keystone.service[207601]: from cryptography.utils import int_from_bytes Jul 28 08:22:57.112369 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=207600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 28 08:22:57.112621 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=207600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 28 08:22:57.112743 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=207601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 28 08:22:57.112851 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG uwsgi [-] command line args: [] {{(pid=207600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 28 08:22:57.112938 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=207601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 28 08:22:57.113014 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG uwsgi [-] command line args: [] {{(pid=207601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 28 08:22:57.113081 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=207600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 28 08:22:57.113173 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG uwsgi [-] ================================================================================ {{(pid=207600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 28 08:22:57.113248 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=207601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 28 08:22:57.113413 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG uwsgi [-] admin_token = **** {{(pid=207600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 08:22:57.113512 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG uwsgi [-] ================================================================================ {{(pid=207601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 28 08:22:57.113653 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG uwsgi [-] config_dir = [] {{(pid=207600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 08:22:57.113840 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG uwsgi [-] admin_token = **** {{(pid=207601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 08:22:57.113920 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=207600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 08:22:57.113995 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG uwsgi [-] config_dir = [] {{(pid=207601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 08:22:57.114083 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG uwsgi [-] config_source = [] {{(pid=207600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 08:22:57.114159 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=207601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 08:22:57.114244 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG uwsgi [-] debug = True {{(pid=207600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 08:22:57.114332 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG uwsgi [-] config_source = [] {{(pid=207601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 08:22:57.114408 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=207600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 08:22:57.114759 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG uwsgi [-] debug = True {{(pid=207601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 08:22:57.114759 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=207601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 08:22:57.115008 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=207600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 08:22:57.115131 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=207601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 08:22:57.115249 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG uwsgi [-] insecure_debug = False {{(pid=207600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 08:22:57.115364 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG uwsgi [-] insecure_debug = False {{(pid=207601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 08:22:57.115486 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=207600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 08:22:57.115601 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=207601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 08:22:57.115716 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=207600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 08:22:57.115836 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=207601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 08:22:57.115957 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG uwsgi [-] list_limit = None {{(pid=207600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 08:22:57.116073 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG uwsgi [-] list_limit = None {{(pid=207601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 08:22:57.116189 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG uwsgi [-] log_config_append = None {{(pid=207600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 08:22:57.116304 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG uwsgi [-] log_config_append = None {{(pid=207601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 08:22:57.116420 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=207600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 08:22:57.116551 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=207601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 08:22:57.116711 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG uwsgi [-] log_dir = None {{(pid=207600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 08:22:57.116860 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG uwsgi [-] log_dir = None {{(pid=207601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 08:22:57.116953 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG uwsgi [-] log_file = None {{(pid=207600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 08:22:57.117023 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG uwsgi [-] log_file = None {{(pid=207601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 08:22:57.117162 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=207600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 08:22:57.117310 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=207601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 08:22:57.117404 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=207600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 08:22:57.117584 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=207601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 08:22:57.117691 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=207600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 08:22:57.117820 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=207601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 08:22:57.117922 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=207600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 08:22:57.118050 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=207601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 08:22:57.118153 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=207600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 08:22:57.118283 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=207601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 08:22:57.118380 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=207600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 08:22:57.118470 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=207601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 08:22:57.118611 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=207600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 08:22:57.118745 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=207601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 08:22:57.118878 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=207600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 08:22:57.119013 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=207601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 08:22:57.119147 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=207600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 08:22:57.119286 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=207601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 08:22:57.119379 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=207600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 08:22:57.119513 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=207601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 08:22:57.119647 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=207600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 08:22:57.119738 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=207601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 08:22:57.119870 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=207600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 08:22:57.119979 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=207601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 08:22:57.120081 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=207600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 08:22:57.120221 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=207601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 08:22:57.120315 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG uwsgi [-] notification_format = cadf {{(pid=207600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 08:22:57.120407 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG uwsgi [-] notification_format = cadf {{(pid=207601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 08:22:57.120496 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=207600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 08:22:57.120589 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=207601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 08:22:57.120696 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.42/identity {{(pid=207600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 08:22:57.120696 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG uwsgi [-] publish_errors = False {{(pid=207600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 08:22:57.120881 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.42/identity {{(pid=207601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 08:22:57.120881 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG uwsgi [-] publish_errors = False {{(pid=207601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 08:22:57.121053 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=207600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 08:22:57.121140 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=207601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 08:22:57.121227 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=207600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 08:22:57.121227 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=207600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 08:22:57.121439 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=207601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 08:22:57.121439 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=207601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 08:22:57.121611 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=207600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 08:22:57.121699 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=207601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 08:22:57.121795 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=207600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 08:22:57.121896 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=207601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 08:22:57.121991 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG uwsgi [-] standard_threads = False {{(pid=207600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 08:22:57.122083 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG uwsgi [-] standard_threads = False {{(pid=207601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 08:22:57.122171 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG uwsgi [-] strict_password_check = False {{(pid=207600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 08:22:57.122256 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG uwsgi [-] strict_password_check = False {{(pid=207601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 08:22:57.122344 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=207600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 08:22:57.122344 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG uwsgi [-] use_eventlog = False {{(pid=207600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 08:22:57.122500 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=207601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 08:22:57.122591 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG uwsgi [-] use_journal = False {{(pid=207600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 08:22:57.122682 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG uwsgi [-] use_eventlog = False {{(pid=207601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 08:22:57.122768 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG uwsgi [-] use_json = False {{(pid=207600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 08:22:57.122854 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG uwsgi [-] use_journal = False {{(pid=207601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 08:22:57.122934 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG uwsgi [-] use_stderr = False {{(pid=207600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 08:22:57.123019 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG uwsgi [-] use_json = False {{(pid=207601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 08:22:57.123110 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG uwsgi [-] use_syslog = False {{(pid=207600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 08:22:57.123197 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG uwsgi [-] use_stderr = False {{(pid=207601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 08:22:57.123197 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG uwsgi [-] use_syslog = False {{(pid=207601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 08:22:57.123368 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG uwsgi [-] watch_log_file = False {{(pid=207600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 08:22:57.123456 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG uwsgi [-] watch_log_file = False {{(pid=207601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 08:22:57.123541 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=207600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:22:57.123637 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=207601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:22:57.123724 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=207600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:22:57.123811 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=207601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:22:57.123898 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=207600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:22:57.123984 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=207601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:22:57.124064 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=207600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:22:57.124282 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=207601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:22:57.124430 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=207600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:22:57.124528 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=207600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:22:57.124618 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=207601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:22:57.124751 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=207600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:22:57.124848 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=207601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:22:57.124987 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=207600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:22:57.125088 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=207601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:22:57.125257 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=207601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:22:57.125394 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=207600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:22:57.125495 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=207600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:22:57.125586 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=207601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:22:57.125718 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=207600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:22:57.125817 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=207601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:22:57.125986 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=207600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:22:57.126135 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=207601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:22:57.126232 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=207601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:22:57.126321 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=207600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:22:57.126424 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=207600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:22:57.126522 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=207601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:22:57.126690 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=207601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:22:57.126837 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=207600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:22:57.126936 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=207600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:22:57.127033 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=207601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:22:57.127130 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=207600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:22:57.127219 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=207601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:22:57.127408 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=207600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:22:57.127557 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=207601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:22:57.127647 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=207601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:22:57.127743 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=207600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:22:57.127910 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=207600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:22:57.128047 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=207601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:22:57.128147 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=207600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:22:57.128232 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=207601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:22:57.128358 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=207601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:22:57.128476 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=207600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:22:57.128638 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=207601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:22:57.128812 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=207600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:22:57.128919 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=207600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:22:57.129003 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=207601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:22:57.129125 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=207600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:22:57.129236 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=207601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:22:57.129362 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=207600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:22:57.129470 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=207601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:22:57.129594 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=207600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:22:57.129699 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=207601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:22:57.129852 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=207600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:22:57.130008 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=207601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:22:57.130112 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=207601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:22:57.130202 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=207600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:22:57.130291 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=207601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:22:57.130379 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=207600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:22:57.130554 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=207601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:22:57.130710 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=207600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:22:57.130809 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=207600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:22:57.130899 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=207601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:22:57.130997 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=207600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:22:57.131080 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=207601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:22:57.131244 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=207600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:22:57.131399 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=207601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:22:57.131507 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=207600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:22:57.131605 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=207601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:22:57.131694 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=207600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:22:57.131783 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=207601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:22:57.131922 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=207600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:22:57.132036 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=207601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:22:57.132163 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=207600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:22:57.132278 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=207601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:22:57.132401 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=207601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:22:57.132506 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=207600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:22:57.132630 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=207600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:22:57.132782 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=207601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:22:57.132867 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=207600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:22:57.132955 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=207601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:22:57.133138 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=207600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:22:57.133287 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=207601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:22:57.133385 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=207601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:22:57.133482 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=207600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:22:57.133571 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=207601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:22:57.133659 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=207600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:22:57.133823 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=207601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:22:57.133973 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=207600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:22:57.134071 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=207601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:22:57.134248 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=207600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:22:57.134248 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=207600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:22:57.134408 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=207601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:22:57.134496 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=207600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:22:57.134577 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=207601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:22:57.134702 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=207600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:22:57.134812 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=207601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:22:57.134972 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=207600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:22:57.135122 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=207601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:22:57.135219 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=207601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:22:57.135308 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=207600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:22:57.135410 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=207601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:22:57.135499 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=207600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:22:57.135666 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=207600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:22:57.135812 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=207601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:22:57.135917 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=207601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:22:57.136007 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=207600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:22:57.136105 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=207601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:22:57.136195 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=207600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:22:57.136362 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=207600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:22:57.136511 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=207601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:22:57.136609 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=207601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:22:57.136724 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=207600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:22:57.136827 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=207600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:22:57.136918 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=207601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:22:57.137015 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=207600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:22:57.137102 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=207601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:22:57.137273 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=207601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:22:57.137381 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=207600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:22:57.137477 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=207600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:22:57.137566 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=207601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:22:57.137736 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=207600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:22:57.137828 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=207601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:22:57.137969 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=207600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:22:57.138068 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=207601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:22:57.138217 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=207601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:22:57.138324 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=207600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:22:57.138424 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=207600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:22:57.138512 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=207601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:22:57.138675 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=207600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:22:57.138767 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=207601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:22:57.138916 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=207600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:22:57.139008 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=207601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:22:57.139153 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=207600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:22:57.139251 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=207601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:22:57.139395 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=207601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:22:57.139485 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=207600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:22:57.139650 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=207600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:22:57.139747 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=207601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:22:57.140081 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=207601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:22:57.140234 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=207600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:22:57.140234 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=207600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:22:57.140399 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=207601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:22:57.140490 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=207600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:22:57.140647 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=207601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:22:57.140795 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=207600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:22:57.140910 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=207601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:22:57.141008 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=207600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:22:57.141163 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=207601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:22:57.141276 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG uwsgi [-] cache.enabled = True {{(pid=207600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:22:57.141420 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=207601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:22:57.141519 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=207600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:22:57.141656 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=207600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:22:57.141753 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG uwsgi [-] cache.enabled = True {{(pid=207601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:22:57.141895 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=207601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:22:57.141998 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=207600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:22:57.142096 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=207600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:22:57.142183 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=207601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:22:57.142352 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=207600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:22:57.142451 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=207601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:22:57.142589 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=207600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:22:57.142694 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=207601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:22:57.142796 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=207600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:22:57.142884 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=207601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:22:57.143053 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=207600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:22:57.143152 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=207601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:22:57.143289 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=207601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:22:57.143393 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=207600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:22:57.143531 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=207601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:22:57.143630 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=207600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:22:57.143771 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=207600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:22:57.143868 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=207601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:22:57.144011 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=207600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:22:57.144117 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=207601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:22:57.144254 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=207600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:22:57.144353 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=207601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:22:57.144474 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=207600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:22:57.144563 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=207601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:22:57.144742 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=207601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:22:57.144860 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=207600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:22:57.144980 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=207600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:22:57.145074 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=207601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:22:57.145213 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=207600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:22:57.145302 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=207601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:22:57.145446 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=207600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:22:57.145543 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=207601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:22:57.145679 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=207601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:22:57.145773 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=207600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:22:57.145913 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=207600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:22:57.146000 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=207601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:22:57.146146 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=207601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:22:57.146246 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=207600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:22:57.146387 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=207601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:22:57.146483 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=207600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:22:57.146624 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=207601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:22:57.146724 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=207600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:22:57.146872 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=207601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:22:57.146990 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=207600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:22:57.147115 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=207601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:22:57.147216 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=207600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:22:57.147370 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=207601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:22:57.147481 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=207600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:22:57.147615 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=207601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:22:57.147743 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=207600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:22:57.147878 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=207601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:22:57.147975 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=207600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:22:57.148143 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=207601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:22:57.148238 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG uwsgi [-] auth.external = None {{(pid=207600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:22:57.148392 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=207601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:22:57.148490 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG uwsgi [-] auth.mapped = None {{(pid=207600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:22:57.148632 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG uwsgi [-] auth.external = None {{(pid=207601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:22:57.148804 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=207600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:22:57.148937 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG uwsgi [-] auth.mapped = None {{(pid=207601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:22:57.149108 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=207600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:22:57.149209 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=207601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:22:57.149300 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG uwsgi [-] auth.password = None {{(pid=207600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:22:57.149392 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=207601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:22:57.149480 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG uwsgi [-] auth.token = None {{(pid=207600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:22:57.149624 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG uwsgi [-] auth.password = None {{(pid=207601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:22:57.149721 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=207600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:22:57.149859 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG uwsgi [-] catalog.caching = True {{(pid=207600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:22:57.149953 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG uwsgi [-] auth.token = None {{(pid=207601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:22:57.150102 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=207601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:22:57.150196 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=207600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:22:57.150333 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=207600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:22:57.150427 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG uwsgi [-] catalog.caching = True {{(pid=207601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:22:57.150581 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=207600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:22:57.150675 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=207601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:22:57.150814 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=207601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:22:57.150902 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=207600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:22:57.151052 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=207600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:22:57.151138 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=207601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:22:57.151290 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG uwsgi [-] credential.caching = True {{(pid=207600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:22:57.151379 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=207601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:22:57.151526 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=207601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:22:57.151620 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG uwsgi [-] credential.driver = sql {{(pid=207600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:22:57.151767 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG uwsgi [-] credential.caching = True {{(pid=207601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:22:57.151857 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=207600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:22:57.152017 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=207600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:22:57.152112 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG uwsgi [-] credential.driver = sql {{(pid=207601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:22:57.152257 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=207600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:22:57.152353 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=207601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:22:57.152503 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=207600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:22:57.152597 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=207601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:22:57.152767 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=207600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:22:57.152871 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=207601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:22:57.153017 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=207601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:22:57.153111 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=207600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:22:57.153260 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=207601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:22:57.153355 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=207600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:22:57.153505 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=207600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:22:57.153605 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=207601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:22:57.153760 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=207600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:22:57.153855 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=207601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:22:57.154004 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=207601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:22:57.154091 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=207600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:22:57.154288 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=207601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:22:57.154468 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=207600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:22:57.154559 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=207600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:22:57.154639 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=207601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:22:57.154779 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=207600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:22:57.154867 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=207601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:22:57.155051 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=207600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:22:57.155157 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=207601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:22:57.155294 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG uwsgi [-] federation.caching = True {{(pid=207600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:22:57.155382 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=207601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:22:57.155579 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=207601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:22:57.155823 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG uwsgi [-] federation.caching = True {{(pid=207601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:22:57.156070 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=207601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:22:57.156359 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG uwsgi [-] federation.driver = sql {{(pid=207601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:22:57.156614 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=207601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:22:57.156877 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=207601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:22:57.157136 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=207601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:22:57.157383 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=207601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:22:57.157557 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=207600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:22:57.157660 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=207601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:22:57.157845 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG uwsgi [-] federation.driver = sql {{(pid=207600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:22:57.157941 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=207601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:22:57.158105 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=207600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:22:57.158201 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=207601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:22:57.158349 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=207600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:22:57.158450 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=207601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:22:57.158608 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=207600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:22:57.158696 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=207601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:22:57.158853 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG uwsgi [-] identity.caching = True {{(pid=207601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:22:57.158942 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=207600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:22:57.159111 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=207601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:22:57.159257 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=207600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:22:57.159354 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=207600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:22:57.159442 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=207601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:22:57.159605 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=207601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:22:57.159747 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=207600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:22:57.159841 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=207600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:22:57.159941 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=207601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:22:57.160089 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG uwsgi [-] identity.driver = sql {{(pid=207601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:22:57.160178 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=207600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:22:57.160330 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=207601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:22:57.160426 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG uwsgi [-] identity.caching = True {{(pid=207600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:22:57.160579 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=207601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:22:57.160711 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=207600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:22:57.160857 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=207600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:22:57.160952 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=207601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:22:57.161102 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=207600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:22:57.161197 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=207601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:22:57.161340 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=207601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:22:57.161450 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=207600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:22:57.161581 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=207601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:22:57.161674 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG uwsgi [-] identity.driver = sql {{(pid=207600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:22:57.161813 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=207600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:22:57.161915 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=207601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:22:57.162091 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=207600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:22:57.162174 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=207601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:22:57.162296 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=207600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:22:57.162396 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=207601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:22:57.162545 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=207601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:22:57.162637 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=207600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:22:57.162783 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=207600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:22:57.162876 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=207601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:22:57.163021 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=207600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:22:57.163118 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=207601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:22:57.163256 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=207600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:22:57.163351 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=207601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:22:57.163506 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=207600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:22:57.163595 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=207601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:22:57.163758 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=207600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:22:57.163852 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=207601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:22:57.163997 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=207601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:22:57.164089 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=207600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:22:57.164241 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=207601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:22:57.164330 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=207600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:22:57.164478 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=207601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:22:57.164573 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=207600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:22:57.164744 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=207601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:22:57.164834 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=207600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:22:57.164993 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=207601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:22:57.165089 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=207600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:22:57.165236 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=207600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:22:57.165322 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=207601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:22:57.165474 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=207600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:22:57.165570 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=207601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:22:57.165711 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=207601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:22:57.165804 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=207600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:22:57.165942 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=207600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:22:57.166027 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=207601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:22:57.166181 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=207600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:22:57.166275 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=207601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:22:57.166426 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=207600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:22:57.166514 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=207601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:22:57.166669 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=207600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:22:57.166756 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=207601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:22:57.166917 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=207601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:22:57.167010 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=207600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:22:57.167150 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=207600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:22:57.167251 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=207601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:22:57.167389 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=207601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:22:57.167481 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=207600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:22:57.167625 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG uwsgi [-] ldap.password = **** {{(pid=207601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:22:57.167727 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=207600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:22:57.167862 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=207600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:22:57.167955 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=207601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:22:57.168101 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=207601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:22:57.168187 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=207600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:22:57.168345 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=207600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:22:57.168437 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=207601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:22:57.168581 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=207600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:22:57.168706 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=207601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:22:57.168847 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=207601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:22:57.168941 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=207600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:22:57.169080 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG uwsgi [-] ldap.password = **** {{(pid=207600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:22:57.169167 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=207601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:22:57.169320 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=207600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:22:57.169408 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=207601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:22:57.169560 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=207600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:22:57.169647 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=207601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:22:57.169793 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=207601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:22:57.169885 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=207600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:22:57.170036 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=207600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:22:57.170212 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=207601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:22:57.170358 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=207600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:22:57.170514 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=207601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:22:57.170659 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=207600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:22:57.170798 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=207601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:22:57.170946 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=207600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:22:57.171091 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=207601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:22:57.171276 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=207600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:22:57.171413 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=207601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:22:57.171558 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=207600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:22:57.171700 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG uwsgi [-] ldap.user = None {{(pid=207601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:22:57.171850 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=207600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:22:57.171987 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=207601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:22:57.172123 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=207600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:22:57.172258 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=207601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:22:57.172411 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=207600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:22:57.172561 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=207601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:22:57.172733 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=207600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:22:57.172876 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=207601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:22:57.173014 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=207600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:22:57.173157 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=207601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:22:57.173292 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG uwsgi [-] ldap.user = None {{(pid=207600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:22:57.173434 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=207601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:22:57.173569 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=207600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:22:57.173711 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=207601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:22:57.173857 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=207600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:22:57.174001 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=207601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:22:57.174136 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=207600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:22:57.174284 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=207601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:22:57.174435 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=207600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:22:57.174577 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=207601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:22:57.174717 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=207600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:22:57.174858 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=207601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:22:57.174993 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=207600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:22:57.175139 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=207601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:22:57.175283 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=207600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:22:57.175425 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=207601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:22:57.175568 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=207600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:22:57.175703 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=207601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:22:57.175832 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=207600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:22:57.175982 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=207601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:22:57.176127 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=207600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:22:57.176279 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=207601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:22:57.176421 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=207600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:22:57.176564 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=207601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:22:57.176762 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=207600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:22:57.176909 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=207601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:22:57.177054 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=207600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:22:57.177189 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=207601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:22:57.177329 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=207600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:22:57.177474 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=207601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:22:57.177615 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=207600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:22:57.177761 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=207601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:22:57.177761 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=207601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:22:57.178026 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=207600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:22:57.178181 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=207601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:22:57.178334 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=207600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:22:57.178469 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=207601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:22:57.178611 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=207600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:22:57.178758 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=207601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:22:57.178900 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=207600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:22:57.179035 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=207601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:22:57.179178 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=207600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:22:57.179319 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG uwsgi [-] policy.driver = sql {{(pid=207601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:22:57.179465 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=207600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:22:57.179603 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=207601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:22:57.179736 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=207600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:22:57.179877 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=207601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:22:57.180012 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=207600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:22:57.180157 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=207601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:22:57.180391 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=207600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:22:57.180537 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG uwsgi [-] receipt.caching = True {{(pid=207601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:22:57.180699 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=207600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:22:57.180847 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=207601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:22:57.180985 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=207600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:22:57.180985 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG uwsgi [-] policy.driver = sql {{(pid=207600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:22:57.181254 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=207601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:22:57.181396 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=207600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:22:57.181533 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=207601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:22:57.181668 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=207600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:22:57.181810 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=207601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:22:57.182023 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=207600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:22:57.182172 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=207601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:22:57.182320 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG uwsgi [-] receipt.caching = True {{(pid=207600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:22:57.182457 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG uwsgi [-] resource.caching = True {{(pid=207601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:22:57.182599 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=207600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:22:57.182739 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=207601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:22:57.182881 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=207600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:22:57.183026 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG uwsgi [-] resource.driver = sql {{(pid=207601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:22:57.183165 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=207600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:22:57.183309 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=207601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:22:57.183453 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=207600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:22:57.183599 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=207601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:22:57.183739 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=207600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:22:57.183885 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=207601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:22:57.184020 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG uwsgi [-] resource.caching = True {{(pid=207600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:22:57.184154 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG uwsgi [-] revoke.caching = True {{(pid=207601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:22:57.184303 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=207600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:22:57.184457 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=207601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:22:57.184592 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG uwsgi [-] resource.driver = sql {{(pid=207600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:22:57.184760 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=207601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:22:57.184898 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=207600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:22:57.185035 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG uwsgi [-] role.cache_time = None {{(pid=207601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:22:57.185185 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=207600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:22:57.185329 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG uwsgi [-] role.caching = True {{(pid=207601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:22:57.185467 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=207600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:22:57.185614 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG uwsgi [-] role.driver = sql {{(pid=207601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:22:57.185755 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG uwsgi [-] revoke.caching = True {{(pid=207600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:22:57.185899 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG uwsgi [-] role.list_limit = None {{(pid=207601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:22:57.186035 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=207600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:22:57.186135 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=207601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:22:57.186207 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=207600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:22:57.186283 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=207601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:22:57.186479 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG uwsgi [-] role.cache_time = None {{(pid=207600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:22:57.186620 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=207601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:22:57.186761 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG uwsgi [-] role.caching = True {{(pid=207600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:22:57.186896 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=207601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:22:57.187037 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG uwsgi [-] role.driver = sql {{(pid=207600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:22:57.187184 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=207601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:22:57.187322 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG uwsgi [-] role.list_limit = None {{(pid=207600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:22:57.187463 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=207601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:22:57.187605 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=207600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:22:57.187740 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=207601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:22:57.187881 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=207600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:22:57.188032 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=207601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:22:57.188167 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=207600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:22:57.188315 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=207601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:22:57.188457 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=207600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:22:57.188598 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=207601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:22:57.188780 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=207600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:22:57.188916 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=207601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:22:57.189065 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=207600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:22:57.189065 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=207600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:22:57.189338 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=207601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:22:57.189473 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=207600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:22:57.189617 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=207601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:22:57.189759 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=207600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:22:57.189910 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=207601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:22:57.190045 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=207600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:22:57.190187 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=207601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:22:57.190321 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=207600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:22:57.190467 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=207601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:22:57.190609 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=207600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:22:57.190753 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=207601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:22:57.190893 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=207600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:22:57.191047 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=207601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:22:57.191142 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=207600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:22:57.191238 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=207601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:22:57.191320 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=207600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:22:57.191400 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=207601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:22:57.191479 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=207600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:22:57.191558 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=207601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:22:57.191654 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=207600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:22:57.191745 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=207601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:22:57.191841 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=207600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:22:57.191934 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=207601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:22:57.192015 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=207600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:22:57.192102 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=207601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:22:57.192171 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=207600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:22:57.192311 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=207601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:22:57.192398 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=207600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:22:57.192485 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=207601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:22:57.192565 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=207600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:22:57.192645 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=207601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:22:57.192816 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=207600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:22:57.192917 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=207601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:22:57.193013 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=207600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:22:57.193100 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=207601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:22:57.193187 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=207600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:22:57.193267 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=207601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:22:57.193356 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=207600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:22:57.193443 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=207601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:22:57.193530 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=207600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:22:57.193617 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG uwsgi [-] token.cache_time = None {{(pid=207601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:22:57.193697 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=207600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:22:57.193775 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG uwsgi [-] token.caching = True {{(pid=207601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:22:57.193866 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=207600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:22:57.193954 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=207601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:22:57.194034 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=207600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:22:57.194112 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG uwsgi [-] token.provider = fernet {{(pid=207601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:22:57.194191 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=207600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:22:57.194269 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=207601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:22:57.194361 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG uwsgi [-] token.cache_time = None {{(pid=207600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:22:57.194442 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=207601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:22:57.194528 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG uwsgi [-] token.caching = True {{(pid=207600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:22:57.194614 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=207601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:22:57.194694 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=207600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:22:57.194789 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=207601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:22:57.194879 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG uwsgi [-] token.provider = fernet {{(pid=207600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:22:57.194960 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=207601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:22:57.195038 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=207600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:22:57.195122 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=207601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:22:57.195209 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=207600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:22:57.195289 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG uwsgi [-] trust.driver = sql {{(pid=207601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:22:57.195380 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=207600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:22:57.195477 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=207601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:22:57.195565 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=207600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:22:57.195645 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=207601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:22:57.195732 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=207600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:22:57.195818 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=207601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:22:57.195911 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=207600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:22:57.195998 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=207601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:22:57.196087 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG uwsgi [-] trust.driver = sql {{(pid=207600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:22:57.196168 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=207601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:22:57.196254 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=207600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:22:57.196333 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=207601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:22:57.196423 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=207600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:22:57.196504 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=207601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:22:57.196589 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=207600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:22:57.196716 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=207601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:22:57.196812 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=207600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:22:57.196894 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG uwsgi [-] database.connection = **** {{(pid=207601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:22:57.196983 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=207600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:22:57.197072 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=207601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:22:57.197202 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=207600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:22:57.197297 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=207601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:22:57.197391 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=207600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:22:57.197478 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=207601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:22:57.197558 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=207600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:22:57.197643 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=207601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:22:57.197729 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG uwsgi [-] database.connection = **** {{(pid=207600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:22:57.197815 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=207601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:22:57.197910 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=207600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:22:57.197999 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=207601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:22:57.198079 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=207600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:22:57.198170 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=207601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:22:57.198258 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=207600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:22:57.198339 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=207601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:22:57.198424 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=207600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:22:57.198515 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=207601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:22:57.198602 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=207600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:22:57.198694 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=207601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:22:57.198775 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=207600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:22:57.198866 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=207601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:22:57.198953 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=207600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:22:57.199033 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=207601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:22:57.199120 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=207600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:22:57.199213 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=207601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:22:57.199301 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=207600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:22:57.199387 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=207601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:22:57.199474 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=207600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:22:57.199554 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=207601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:22:57.199645 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=207600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:22:57.199879 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=207601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:22:57.199972 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=207600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:22:57.200061 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=207601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:22:57.200141 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=207600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:22:57.200220 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=207601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:22:57.200299 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=207600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:22:57.200387 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=207601) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 28 08:22:57.200484 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=207600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:22:57.200484 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=207600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:22:57.200484 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=207600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:22:57.200484 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=207600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:22:57.200815 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=207600) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 28 08:22:57.229207 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=207601) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 08:22:57.229439 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=207601) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 08:22:57.229672 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=207601) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 08:22:57.229832 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=207600) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 08:22:57.230034 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=207600) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 08:22:57.230264 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=207600) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 08:22:57.238158 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=207601) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 08:22:57.238989 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=207600) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 08:22:57.268051 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=207601) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 08:22:57.268392 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=207601) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 08:22:57.268592 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=207600) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 08:22:57.268891 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=207600) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 08:22:57.320261 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=207601) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 08:22:57.320534 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=207600) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 08:22:57.370665 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=207601) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 08:22:57.370956 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=207600) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 08:22:57.371129 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=207601) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 08:22:57.371240 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=207600) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 08:22:57.434874 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=207600) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 08:22:57.435133 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=207600) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 08:22:57.435235 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=207600) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 08:22:57.435435 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=207601) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 08:22:57.435538 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=207600) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 08:22:57.435670 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=207601) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 08:22:57.435819 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=207600) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 08:22:57.435953 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=207601) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 08:22:57.436145 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=207600) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 08:22:57.436245 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=207601) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 08:22:57.436245 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=207601) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 08:22:57.436548 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=207601) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 08:22:57.458862 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=207600) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 08:22:57.459130 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=207600) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 08:22:57.459323 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=207600) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 08:22:57.459531 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=207600) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 08:22:57.459667 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=207600) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 08:22:57.459917 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=207600) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 08:22:57.460272 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=207600) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 08:22:57.461638 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=207601) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 08:22:57.462013 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=207601) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 08:22:57.462439 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=207601) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 08:22:57.462800 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=207601) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 08:22:57.463172 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=207601) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 08:22:57.463578 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=207601) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 08:22:57.464014 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=207601) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 08:22:57.471706 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=207600) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 08:22:57.473230 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=207601) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 08:22:57.484424 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=207600) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 08:22:57.484702 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=207601) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 08:22:57.484804 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=207600) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 08:22:57.484945 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=207600) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 08:22:57.485141 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=207601) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 08:22:57.485246 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=207600) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 08:22:57.485389 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=207601) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 08:22:57.485579 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=207600) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 08:22:57.485729 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=207601) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 08:22:57.485871 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=207600) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 08:22:57.486012 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=207601) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 08:22:57.486152 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=207600) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 08:22:57.486302 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=207601) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 08:22:57.486302 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=207601) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 08:22:57.502668 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=207600) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 08:22:57.502896 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=207601) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 08:22:57.503006 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=207600) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jul 28 08:22:57.503167 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=207601) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jul 28 08:22:57.503398 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=207600) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 08:22:57.503498 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=207601) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 08:22:57.503645 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=207600) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jul 28 08:22:57.503779 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=207601) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jul 28 08:22:57.503910 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=207600) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 08:22:57.504055 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=207601) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 08:22:57.504232 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=207600) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 08:22:57.504366 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=207601) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 08:22:57.504500 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=207600) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 08:22:57.504635 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=207601) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 08:22:57.504811 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=207600) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 08:22:57.504971 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=207601) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 08:22:57.514042 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=207600) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 08:22:57.514322 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=207600) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 08:22:57.514572 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=207600) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 08:22:57.514871 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=207601) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 08:22:57.515082 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=207600) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 08:22:57.515239 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=207601) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 08:22:57.515387 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=207601) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 08:22:57.515698 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=207601) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 08:22:57.523706 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=207600) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 28 08:22:57.529454 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=207601) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 28 08:22:57.531557 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=207600) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 28 08:22:57.531557 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=207600) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 08:22:57.531557 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=207600) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 08:22:57.532014 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=207600) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 08:22:57.533079 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=207600) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 08:22:57.533079 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=207600) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 08:22:57.533079 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=207600) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 08:22:57.533325 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=207600) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 08:22:57.533711 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=207600) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 08:22:57.533813 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=207600) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 08:22:57.534061 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=207600) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 08:22:57.538290 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=207601) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 28 08:22:57.538701 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=207601) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 08:22:57.539050 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=207601) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 08:22:57.539139 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=207601) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 08:22:57.539419 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=207601) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 08:22:57.539681 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=207601) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 08:22:57.539951 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=207601) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 08:22:57.540241 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=207601) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 08:22:57.540578 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=207601) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 08:22:57.540797 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=207601) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 08:22:57.541065 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=207601) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 08:22:57.558755 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=207600) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 08:22:57.560948 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=207600) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 28 08:22:57.561240 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=207600) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 08:22:57.564002 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=207601) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 08:22:57.565563 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=207601) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 28 08:22:57.565858 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=207601) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 08:22:57.565969 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=207600) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 28 08:22:57.566178 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=207600) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 08:22:57.566463 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=207600) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 08:22:57.570481 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=207601) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 28 08:22:57.571435 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=207601) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 08:22:57.571435 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=207601) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 08:22:57.573040 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=207600) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 28 08:22:57.573330 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=207600) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 08:22:57.577618 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=207600) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 28 08:22:57.577815 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=207601) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 28 08:22:57.577960 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=207600) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 08:22:57.578106 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=207601) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 08:22:57.578253 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=207600) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 08:22:57.578430 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=207600) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 08:22:57.578730 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=207600) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 08:22:57.579021 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=207600) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 08:22:57.579307 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=207600) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 08:22:57.579588 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=207600) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 08:22:57.582093 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=207601) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 28 08:22:57.582389 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=207601) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 08:22:57.582676 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=207601) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 08:22:57.582962 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=207601) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 08:22:57.583242 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=207601) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 08:22:57.583536 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=207601) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 08:22:57.583812 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=207601) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 08:22:57.584079 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=207601) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 08:22:57.596007 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=207600) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 08:22:57.596256 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=207600) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 08:22:57.600305 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=207600) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 28 08:22:57.600528 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=207601) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 08:22:57.600724 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=207601) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 08:22:57.603482 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=207600) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 08:22:57.603780 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=207600) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 08:22:57.604575 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=207601) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 28 08:22:57.607735 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=207601) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 08:22:57.608033 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=207601) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 08:22:57.608225 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=207600) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 28 08:22:57.611346 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=207600) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 28 08:22:57.612427 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=207601) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 28 08:22:57.614578 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=207600) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 08:22:57.614887 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=207600) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 08:22:57.615177 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=207600) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 08:22:57.615477 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=207600) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 08:22:57.615679 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=207601) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 28 08:22:57.615830 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=207600) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 08:22:57.616086 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=207600) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 08:22:57.618825 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=207601) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 08:22:57.619126 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=207601) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 08:22:57.619416 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=207601) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 08:22:57.619717 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=207601) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 08:22:57.619976 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=207601) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 08:22:57.620296 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=207601) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 08:22:57.632021 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=207600) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 28 08:22:57.632312 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=207600) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 08:22:57.632583 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=207600) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 08:22:57.632852 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=207600) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 08:22:57.636254 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=207601) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 28 08:22:57.636542 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=207601) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 08:22:57.636836 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=207601) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 08:22:57.637101 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=207601) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 08:22:57.639761 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=207600) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 08:22:57.641368 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=207600) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 08:22:57.641626 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=207600) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 08:22:57.643974 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=207601) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 08:22:57.644447 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=207600) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 28 08:22:57.644776 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=207600) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 08:22:57.645086 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=207600) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 08:22:57.645374 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=207600) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 08:22:57.645588 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=207601) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 08:22:57.645691 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=207600) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 08:22:57.645829 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=207601) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 08:22:57.648615 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=207601) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 28 08:22:57.648923 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=207601) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 08:22:57.649227 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=207601) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 08:22:57.649510 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=207601) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 08:22:57.649788 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=207601) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 08:22:57.657205 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=207600) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 28 08:22:57.657489 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=207600) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 08:22:57.657784 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=207600) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 08:22:57.658059 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=207600) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 08:22:57.658349 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=207600) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 08:22:57.658627 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=207600) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 08:22:57.658918 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=207600) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 08:22:57.661249 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=207601) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 28 08:22:57.661533 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=207601) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 08:22:57.661821 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=207601) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 08:22:57.662055 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=207601) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 08:22:57.662371 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=207601) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 08:22:57.662649 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=207601) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 08:22:57.662912 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=207601) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 08:22:57.674488 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=207600) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 28 08:22:57.677460 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=207600) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 28 08:22:57.678441 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=207601) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 28 08:22:57.680399 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=207600) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 08:22:57.681420 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=207601) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 28 08:22:57.682947 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=207600) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 08:22:57.684365 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=207601) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 08:22:57.684570 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=207600) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 28 08:22:57.684823 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=207600) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 08:22:57.685177 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=207600) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 08:22:57.686998 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=207601) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 08:22:57.688502 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=207601) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 28 08:22:57.688815 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=207601) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 08:22:57.689102 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=207601) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 08:22:57.691618 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=207600) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 08:22:57.693262 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=207600) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 28 08:22:57.695527 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=207601) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 08:22:57.696228 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=207600) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 08:22:57.696521 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=207600) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 08:22:57.696833 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=207600) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 08:22:57.697127 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=207600) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 08:22:57.697332 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=207601) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 28 08:22:57.700056 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=207601) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 08:22:57.700339 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=207601) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 08:22:57.700634 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=207601) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 08:22:57.700950 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=207601) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 08:22:57.705164 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=207600) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 28 08:22:57.705456 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=207600) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 08:22:57.705741 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=207600) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 08:22:57.709012 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=207601) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 28 08:22:57.709304 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=207601) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 08:22:57.709599 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=207601) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 08:22:57.712565 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=207600) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 28 08:22:57.712875 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=207600) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 08:22:57.713164 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=207600) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 08:22:57.713444 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=207600) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 08:22:57.713732 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=207600) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 08:22:57.714017 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=207600) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 08:22:57.714304 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=207600) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 08:22:57.714580 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=207600) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 08:22:57.714958 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=207600) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 08:22:57.715246 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=207600) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 08:22:57.715881 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=207600) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 08:22:57.716150 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=207600) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 08:22:57.716439 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=207600) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 08:22:57.716729 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=207600) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 08:22:57.716876 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=207601) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 28 08:22:57.717014 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=207601) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 08:22:57.717309 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=207601) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 08:22:57.717586 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=207601) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 08:22:57.717869 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=207601) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 08:22:57.718258 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=207601) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 08:22:57.718537 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=207601) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 08:22:57.718808 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=207601) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 08:22:57.719185 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=207601) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 08:22:57.719456 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=207601) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 08:22:57.719739 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=207601) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 08:22:57.720029 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=207601) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 08:22:57.720300 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=207601) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 08:22:57.720567 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=207601) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 08:22:57.750214 dv-cinder-851351-1-smb devstack@keystone.service[207600]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x564ffc6c99c0 pid: 207600 (default app) Jul 28 08:22:57.753649 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a7d99c-578a-43cc-8202-2a5d02d4238c None None] REQUEST_METHOD: `GET` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:22:57.753941 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a7d99c-578a-43cc-8202-2a5d02d4238c None None] SCRIPT_NAME: `/identity` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:22:57.754076 dv-cinder-851351-1-smb devstack@keystone.service[207601]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x564ffc6c99c0 pid: 207601 (default app) Jul 28 08:22:57.754191 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a7d99c-578a-43cc-8202-2a5d02d4238c None None] PATH_INFO: `/v3` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:22:57.758603 dv-cinder-851351-1-smb devstack@keystone.service[207600]: [pid: 207600|app: 0|req: 1/1] 10.222.0.42 () {50 vars in 791 bytes} [Thu Jul 28 08:22:57 2022] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:23:05.445621 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d681df-15c1-413a-bffb-b2b55940132f None None] REQUEST_METHOD: `GET` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:23:05.446246 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d681df-15c1-413a-bffb-b2b55940132f None None] SCRIPT_NAME: `/identity` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:23:05.446246 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d681df-15c1-413a-bffb-b2b55940132f None None] PATH_INFO: `/` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:23:05.450701 dv-cinder-851351-1-smb devstack@keystone.service[207601]: [pid: 207601|app: 0|req: 1/2] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 08:23:05 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 08:23:05.456439 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1c2eca-2d71-4bdc-b964-0f16895ce88e None None] REQUEST_METHOD: `POST` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:23:05.456965 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1c2eca-2d71-4bdc-b964-0f16895ce88e None None] SCRIPT_NAME: `/identity` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:23:05.457073 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1c2eca-2d71-4bdc-b964-0f16895ce88e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:23:05.527761 dv-cinder-851351-1-smb devstack@keystone.service[207600]: INFO dbcounter [None req-bf1c2eca-2d71-4bdc-b964-0f16895ce88e None None] Registered counter for database keystone Jul 28 08:23:05.549585 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG oslo_db.sqlalchemy.engines [None req-bf1c2eca-2d71-4bdc-b964-0f16895ce88e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=207600) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 28 08:23:05.557263 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG dbcounter [-] [207600] Writer thread running {{(pid=207600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 28 08:23:05.735451 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG passlib.handlers.bcrypt [None req-bf1c2eca-2d71-4bdc-b964-0f16895ce88e None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=207600) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Jul 28 08:23:05.735768 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG passlib.handlers.bcrypt [None req-bf1c2eca-2d71-4bdc-b964-0f16895ce88e None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=207600) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Jul 28 08:23:05.790543 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.auth.core [None req-bf1c2eca-2d71-4bdc-b964-0f16895ce88e None None] MFA Rules not processed for user `b8110ade874c4aa7af27f5c376df700a`. Rule list: `[]` (Enabled: `True`). {{(pid=207600) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 08:23:05.792168 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.fernet_utils [None req-bf1c2eca-2d71-4bdc-b964-0f16895ce88e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=207600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:23:05.921691 dv-cinder-851351-1-smb devstack@keystone.service[207600]: [pid: 207600|app: 0|req: 2/3] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 08:23:05 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 466 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jul 28 08:23:05.945944 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d681df-15c1-413a-bffb-b2b55940132f None None] Authenticating user token {{(pid=207601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:23:06.016347 dv-cinder-851351-1-smb devstack@keystone.service[207601]: INFO dbcounter [None req-a5d681df-15c1-413a-bffb-b2b55940132f None None] Registered counter for database keystone Jul 28 08:23:06.037011 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG oslo_db.sqlalchemy.engines [None req-a5d681df-15c1-413a-bffb-b2b55940132f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=207601) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 28 08:23:06.044972 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG dbcounter [-] [207601] Writer thread running {{(pid=207601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 28 08:23:06.163993 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d681df-15c1-413a-bffb-b2b55940132f None None] Validating token access rules against request {{(pid=207601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:23:06.168906 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2c9d81-e87f-48d1-a8f2-020b7b1a2b36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce031eecc2864701bc87b5b179ea31ec', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:23:06.169573 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2c9d81-e87f-48d1-a8f2-020b7b1a2b36 admin admin] REQUEST_METHOD: `GET` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:23:06.169853 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2c9d81-e87f-48d1-a8f2-020b7b1a2b36 admin admin] SCRIPT_NAME: `/identity` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:23:06.170129 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2c9d81-e87f-48d1-a8f2-020b7b1a2b36 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:23:06.179088 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d2c9d81-e87f-48d1-a8f2-020b7b1a2b36 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:23:06.230414 dv-cinder-851351-1-smb devstack@keystone.service[207601]: WARNING keystone.common.rbac_enforcer.enforcer [None req-8d2c9d81-e87f-48d1-a8f2-020b7b1a2b36 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Jul 28 08:23:06.230755 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d2c9d81-e87f-48d1-a8f2-020b7b1a2b36 admin admin] RBAC: Authorization granted {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:23:06.241585 dv-cinder-851351-1-smb devstack@keystone.service[207601]: [pid: 207601|app: 0|req: 2/4] 10.222.0.42 () {58 vars in 1324 bytes} [Thu Jul 28 08:23:05 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 296 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 28 08:23:06.247868 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf1c2eca-2d71-4bdc-b964-0f16895ce88e None None] Authenticating user token {{(pid=207600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:23:06.263009 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf1c2eca-2d71-4bdc-b964-0f16895ce88e None None] Validating token access rules against request {{(pid=207600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:23:06.268134 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad373a1-c2fa-4dbe-9552-8faba8364348 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce031eecc2864701bc87b5b179ea31ec', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:23:06.269270 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad373a1-c2fa-4dbe-9552-8faba8364348 admin admin] REQUEST_METHOD: `GET` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:23:06.269569 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad373a1-c2fa-4dbe-9552-8faba8364348 admin admin] SCRIPT_NAME: `/identity` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:23:06.269855 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad373a1-c2fa-4dbe-9552-8faba8364348 admin admin] PATH_INFO: `/v3/projects/ce031eecc2864701bc87b5b179ea31ec` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:23:06.271396 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ad373a1-c2fa-4dbe-9552-8faba8364348 admin admin] RBAC: Authorizing `identity:get_project(project_id=ce031eecc2864701bc87b5b179ea31ec)` {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:23:06.321443 dv-cinder-851351-1-smb devstack@keystone.service[207600]: WARNING keystone.common.rbac_enforcer.enforcer [None req-7ad373a1-c2fa-4dbe-9552-8faba8364348 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Jul 28 08:23:06.321794 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ad373a1-c2fa-4dbe-9552-8faba8364348 admin admin] RBAC: Authorization granted {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:23:06.326741 dv-cinder-851351-1-smb devstack@keystone.service[207600]: [pid: 207600|app: 0|req: 3/5] 10.222.0.42 () {56 vars in 1207 bytes} [Thu Jul 28 08:23:06 2022] GET /identity/v3/projects/ce031eecc2864701bc87b5b179ea31ec => generated 344 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:23:08.302979 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae1896c-e5da-4663-9aa1-4db19dcf765b None None] REQUEST_METHOD: `GET` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:23:08.303547 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae1896c-e5da-4663-9aa1-4db19dcf765b None None] SCRIPT_NAME: `/identity` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:23:08.303547 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae1896c-e5da-4663-9aa1-4db19dcf765b None None] PATH_INFO: `/` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:23:08.307617 dv-cinder-851351-1-smb devstack@keystone.service[207601]: [pid: 207601|app: 0|req: 3/6] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 08:23:08 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 28 08:23:08.313330 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d066b6-4fb5-4ac4-adca-26cf209f018e None None] REQUEST_METHOD: `POST` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:23:08.313771 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d066b6-4fb5-4ac4-adca-26cf209f018e None None] SCRIPT_NAME: `/identity` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:23:08.313880 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d066b6-4fb5-4ac4-adca-26cf209f018e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:23:08.337100 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.auth.core [None req-45d066b6-4fb5-4ac4-adca-26cf209f018e None None] MFA Rules not processed for user `b8110ade874c4aa7af27f5c376df700a`. Rule list: `[]` (Enabled: `True`). {{(pid=207600) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 08:23:08.338643 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.fernet_utils [None req-45d066b6-4fb5-4ac4-adca-26cf209f018e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=207600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:23:08.347367 dv-cinder-851351-1-smb devstack@keystone.service[207600]: [pid: 207600|app: 0|req: 4/7] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 08:23:08 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jul 28 08:23:08.369865 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae1896c-e5da-4663-9aa1-4db19dcf765b None None] Authenticating user token {{(pid=207601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:23:08.384692 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae1896c-e5da-4663-9aa1-4db19dcf765b None None] Validating token access rules against request {{(pid=207601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:23:08.389811 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672c9d34-5b05-4c1f-b0e4-3e6fcea75633 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce031eecc2864701bc87b5b179ea31ec', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:23:08.390445 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672c9d34-5b05-4c1f-b0e4-3e6fcea75633 admin admin] REQUEST_METHOD: `GET` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:23:08.390736 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672c9d34-5b05-4c1f-b0e4-3e6fcea75633 admin admin] SCRIPT_NAME: `/identity` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:23:08.391017 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672c9d34-5b05-4c1f-b0e4-3e6fcea75633 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:23:08.399278 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-672c9d34-5b05-4c1f-b0e4-3e6fcea75633 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:23:08.401125 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-672c9d34-5b05-4c1f-b0e4-3e6fcea75633 admin admin] RBAC: Authorization granted {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:23:08.410018 dv-cinder-851351-1-smb devstack@keystone.service[207601]: [pid: 207601|app: 0|req: 4/8] 10.222.0.42 () {58 vars in 1324 bytes} [Thu Jul 28 08:23:08 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 28 08:23:08.416122 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d066b6-4fb5-4ac4-adca-26cf209f018e None None] Authenticating user token {{(pid=207600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:23:08.425745 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d066b6-4fb5-4ac4-adca-26cf209f018e None None] Validating token access rules against request {{(pid=207600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:23:08.430469 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cdd1b04-f488-4221-bc31-d9390380c2b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ce031eecc2864701bc87b5b179ea31ec', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:23:08.431136 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cdd1b04-f488-4221-bc31-d9390380c2b3 admin admin] REQUEST_METHOD: `GET` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:23:08.431420 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cdd1b04-f488-4221-bc31-d9390380c2b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:23:08.431701 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cdd1b04-f488-4221-bc31-d9390380c2b3 admin admin] PATH_INFO: `/v3/users/b8110ade874c4aa7af27f5c376df700a` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:23:08.433250 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cdd1b04-f488-4221-bc31-d9390380c2b3 admin admin] RBAC: Authorizing `identity:get_user(user_id=b8110ade874c4aa7af27f5c376df700a)` {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:23:08.435123 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cdd1b04-f488-4221-bc31-d9390380c2b3 admin admin] RBAC: Authorization granted {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:23:08.436734 dv-cinder-851351-1-smb devstack@keystone.service[207600]: [pid: 207600|app: 0|req: 5/9] 10.222.0.42 () {56 vars in 1198 bytes} [Thu Jul 28 08:23:08 2022] GET /identity/v3/users/b8110ade874c4aa7af27f5c376df700a => generated 247 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:23:10.543648 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0295b6-a1c9-468f-854f-cc1cde5c58a7 None None] REQUEST_METHOD: `GET` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:23:10.544263 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0295b6-a1c9-468f-854f-cc1cde5c58a7 None None] SCRIPT_NAME: `/identity` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:23:10.544263 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0295b6-a1c9-468f-854f-cc1cde5c58a7 None None] PATH_INFO: `/` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:23:10.545663 dv-cinder-851351-1-smb devstack@keystone.service[207601]: [pid: 207601|app: 0|req: 5/10] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 08:23:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 28 08:23:10.551257 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6724d6-c680-4194-b3f4-69564fe452e7 None None] REQUEST_METHOD: `POST` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:23:10.551732 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6724d6-c680-4194-b3f4-69564fe452e7 None None] SCRIPT_NAME: `/identity` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:23:10.551831 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6724d6-c680-4194-b3f4-69564fe452e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:23:10.571899 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.auth.core [None req-3b6724d6-c680-4194-b3f4-69564fe452e7 None None] MFA Rules not processed for user `b8110ade874c4aa7af27f5c376df700a`. Rule list: `[]` (Enabled: `True`). {{(pid=207600) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 08:23:10.573167 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.fernet_utils [None req-3b6724d6-c680-4194-b3f4-69564fe452e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=207600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:23:10.582644 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73d3e5c-96f1-40ed-a638-c03e15239b51 None None] REQUEST_METHOD: `GET` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:23:10.582914 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73d3e5c-96f1-40ed-a638-c03e15239b51 None None] SCRIPT_NAME: `/identity` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:23:10.583186 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73d3e5c-96f1-40ed-a638-c03e15239b51 None None] PATH_INFO: `/` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:23:10.584561 dv-cinder-851351-1-smb devstack@keystone.service[207601]: [pid: 207601|app: 0|req: 6/11] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 08:23:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 08:23:10.589945 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d43623-a7de-4f09-a05f-23ed72c554de None None] REQUEST_METHOD: `POST` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:23:10.590597 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d43623-a7de-4f09-a05f-23ed72c554de None None] SCRIPT_NAME: `/identity` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:23:10.590870 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d43623-a7de-4f09-a05f-23ed72c554de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:23:10.633304 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG passlib.handlers.bcrypt [None req-21d43623-a7de-4f09-a05f-23ed72c554de None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=207601) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Jul 28 08:23:10.633724 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG passlib.handlers.bcrypt [None req-21d43623-a7de-4f09-a05f-23ed72c554de None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=207601) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Jul 28 08:23:10.656723 dv-cinder-851351-1-smb devstack@keystone.service[207600]: [pid: 207600|app: 0|req: 6/12] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 08:23:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 08:23:10.678653 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6724d6-c680-4194-b3f4-69564fe452e7 None None] Authenticating user token {{(pid=207600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:23:10.678874 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.auth.core [None req-21d43623-a7de-4f09-a05f-23ed72c554de None None] MFA Rules not processed for user `b8110ade874c4aa7af27f5c376df700a`. Rule list: `[]` (Enabled: `True`). {{(pid=207601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 08:23:10.680422 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.fernet_utils [None req-21d43623-a7de-4f09-a05f-23ed72c554de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=207601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:23:10.703647 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG dbcounter [-] [207600] Writing DB stats keystone:SELECT=100 {{(pid=207600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:23:10.783537 dv-cinder-851351-1-smb devstack@keystone.service[207601]: [pid: 207601|app: 0|req: 7/13] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 08:23:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 28 08:23:10.786777 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6724d6-c680-4194-b3f4-69564fe452e7 None None] Validating token access rules against request {{(pid=207600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:23:10.806849 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d43623-a7de-4f09-a05f-23ed72c554de None None] Authenticating user token {{(pid=207601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:23:10.820732 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4709b25-e7bb-43e8-838e-2222f522b737 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:23:10.821393 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4709b25-e7bb-43e8-838e-2222f522b737 None admin] REQUEST_METHOD: `GET` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:23:10.821679 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4709b25-e7bb-43e8-838e-2222f522b737 None admin] SCRIPT_NAME: `/identity` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:23:10.821960 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4709b25-e7bb-43e8-838e-2222f522b737 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:23:10.891977 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4709b25-e7bb-43e8-838e-2222f522b737 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:23:10.893766 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4709b25-e7bb-43e8-838e-2222f522b737 None admin] RBAC: Authorization granted {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:23:10.912905 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d43623-a7de-4f09-a05f-23ed72c554de None None] Validating token access rules against request {{(pid=207601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:23:10.915636 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG dbcounter [-] [207601] Writing DB stats keystone:SELECT=100 {{(pid=207601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:23:10.919267 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG dbcounter [-] [207600] Writing DB stats keystone:SELECT=100 {{(pid=207600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:23:10.956405 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6022384d-4678-4136-8a37-9887f85c85db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:23:10.957597 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6022384d-4678-4136-8a37-9887f85c85db None admin] REQUEST_METHOD: `GET` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:23:10.957928 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6022384d-4678-4136-8a37-9887f85c85db None admin] SCRIPT_NAME: `/identity` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:23:10.958286 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6022384d-4678-4136-8a37-9887f85c85db None admin] PATH_INFO: `/v3/roles/admin` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:23:10.971518 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6022384d-4678-4136-8a37-9887f85c85db None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 08:23:10.980245 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application [None req-6022384d-4678-4136-8a37-9887f85c85db None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 08:23:10.980245 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:23:10.980245 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:23:10.980245 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:23:10.980245 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:23:10.980245 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:23:10.980245 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:23:10.980245 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:23:10.980245 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:23:10.980245 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:23:10.980245 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:23:10.980245 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:23:10.980245 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 08:23:10.980245 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 08:23:10.980245 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 08:23:10.980245 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 08:23:10.981380 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 08:23:10.981380 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 08:23:10.981380 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 08:23:10.981380 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 08:23:10.981380 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:23:10.981380 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:23:10.981380 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:23:10.981380 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:23:10.981380 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:23:10.981380 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:23:10.981380 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:23:10.981380 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application with Lock( Jul 28 08:23:10.981380 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:23:10.981380 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:23:10.981380 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:23:10.981380 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:23:10.982320 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:23:10.982320 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:23:10.982320 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:23:10.982320 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:23:10.982320 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 08:23:10.982320 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 08:23:10.982320 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 08:23:10.982320 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 08:23:10.982320 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 08:23:10.982320 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 08:23:10.982320 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 08:23:10.982320 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application Jul 28 08:23:10.982320 dv-cinder-851351-1-smb devstack@keystone.service[207601]: [pid: 207601|app: 0|req: 8/14] 10.222.0.42 () {56 vars in 1096 bytes} [Thu Jul 28 08:23:10 2022] GET /identity/v3/roles/admin => generated 83 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 08:23:10.987496 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6022384d-4678-4136-8a37-9887f85c85db None admin] Authenticating user token {{(pid=207601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:23:10.997060 dv-cinder-851351-1-smb devstack@keystone.service[207600]: [pid: 207600|app: 0|req: 7/15] 10.222.0.42 () {58 vars in 1282 bytes} [Thu Jul 28 08:23:10 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 28 08:23:11.002798 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4709b25-e7bb-43e8-838e-2222f522b737 None admin] Authenticating user token {{(pid=207600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:23:11.091215 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6022384d-4678-4136-8a37-9887f85c85db None admin] Validating token access rules against request {{(pid=207601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:23:11.104690 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4709b25-e7bb-43e8-838e-2222f522b737 None admin] Validating token access rules against request {{(pid=207600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:23:11.124690 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54c255b-9c14-409e-ace9-8b1f258ced89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:23:11.125343 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54c255b-9c14-409e-ace9-8b1f258ced89 None admin] REQUEST_METHOD: `GET` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:23:11.125631 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54c255b-9c14-409e-ace9-8b1f258ced89 None admin] SCRIPT_NAME: `/identity` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:23:11.125913 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54c255b-9c14-409e-ace9-8b1f258ced89 None admin] PATH_INFO: `/v3/roles` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:23:11.126656 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d54c255b-9c14-409e-ace9-8b1f258ced89 None admin] RBAC: Adding query filter params (name=admin) {{(pid=207601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:23:11.126987 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d54c255b-9c14-409e-ace9-8b1f258ced89 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:23:11.127136 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG dbcounter [-] [207600] Writing DB stats keystone:SELECT=100 {{(pid=207600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:23:11.128580 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d54c255b-9c14-409e-ace9-8b1f258ced89 None admin] RBAC: Authorization granted {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:23:11.139980 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938b1732-8b62-4d2f-b315-de98723b57c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:23:11.140643 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938b1732-8b62-4d2f-b315-de98723b57c3 None admin] REQUEST_METHOD: `GET` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:23:11.140976 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938b1732-8b62-4d2f-b315-de98723b57c3 None admin] SCRIPT_NAME: `/identity` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:23:11.141126 dv-cinder-851351-1-smb devstack@keystone.service[207601]: [pid: 207601|app: 0|req: 9/16] 10.222.0.42 () {56 vars in 1099 bytes} [Thu Jul 28 08:23:10 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:23:11.141265 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938b1732-8b62-4d2f-b315-de98723b57c3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:23:11.146795 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54c255b-9c14-409e-ace9-8b1f258ced89 None admin] Authenticating user token {{(pid=207601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:23:11.152060 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-938b1732-8b62-4d2f-b315-de98723b57c3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:23:11.153593 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-938b1732-8b62-4d2f-b315-de98723b57c3 None admin] RBAC: Authorization granted {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:23:11.171965 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application [None req-938b1732-8b62-4d2f-b315-de98723b57c3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 08:23:11.171965 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:23:11.171965 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:23:11.171965 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:23:11.171965 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:23:11.171965 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:23:11.171965 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:23:11.171965 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:23:11.171965 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:23:11.171965 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:23:11.171965 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:23:11.171965 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:23:11.171965 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 08:23:11.171965 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 08:23:11.171965 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 08:23:11.173018 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 08:23:11.173018 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:23:11.173018 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:23:11.173018 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:23:11.173018 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:23:11.173018 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:23:11.173018 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:23:11.173018 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:23:11.173018 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application with Lock( Jul 28 08:23:11.173018 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:23:11.173018 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:23:11.173018 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:23:11.173018 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:23:11.173018 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:23:11.173018 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:23:11.173018 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:23:11.173018 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:23:11.173971 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 08:23:11.173971 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 08:23:11.173971 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 08:23:11.173971 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application Jul 28 08:23:11.173971 dv-cinder-851351-1-smb devstack@keystone.service[207600]: [pid: 207600|app: 0|req: 8/17] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 08:23:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 08:23:11.175370 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG dbcounter [-] [207601] Writing DB stats keystone:SELECT=100 {{(pid=207601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:23:11.179574 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938b1732-8b62-4d2f-b315-de98723b57c3 None admin] Authenticating user token {{(pid=207600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:23:11.252437 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54c255b-9c14-409e-ace9-8b1f258ced89 None admin] Validating token access rules against request {{(pid=207601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:23:11.290083 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8092450c-1f8a-4a38-ba6e-e88937207ec2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:23:11.290789 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8092450c-1f8a-4a38-ba6e-e88937207ec2 None admin] REQUEST_METHOD: `GET` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:23:11.291055 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8092450c-1f8a-4a38-ba6e-e88937207ec2 None admin] SCRIPT_NAME: `/identity` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:23:11.291334 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8092450c-1f8a-4a38-ba6e-e88937207ec2 None admin] PATH_INFO: `/v3/users/b8110ade874c4aa7af27f5c376df700a` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:23:11.293082 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8092450c-1f8a-4a38-ba6e-e88937207ec2 None admin] RBAC: Authorizing `identity:get_user(user_id=b8110ade874c4aa7af27f5c376df700a)` {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:23:11.294601 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8092450c-1f8a-4a38-ba6e-e88937207ec2 None admin] RBAC: Authorization granted {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:23:11.296398 dv-cinder-851351-1-smb devstack@keystone.service[207601]: [pid: 207601|app: 0|req: 10/18] 10.222.0.42 () {56 vars in 1177 bytes} [Thu Jul 28 08:23:11 2022] GET /identity/v3/users/b8110ade874c4aa7af27f5c376df700a => generated 247 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 08:23:11.302742 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8092450c-1f8a-4a38-ba6e-e88937207ec2 None admin] Authenticating user token {{(pid=207601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:23:11.396332 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938b1732-8b62-4d2f-b315-de98723b57c3 None admin] Validating token access rules against request {{(pid=207600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:23:11.404418 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG dbcounter [-] [207601] Writing DB stats keystone:SELECT=100 {{(pid=207601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:23:11.411210 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8092450c-1f8a-4a38-ba6e-e88937207ec2 None admin] Validating token access rules against request {{(pid=207601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:23:11.431878 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0368d429-66d4-4c87-88c9-12cf0c2849a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:23:11.432517 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0368d429-66d4-4c87-88c9-12cf0c2849a4 None admin] REQUEST_METHOD: `GET` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:23:11.432834 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0368d429-66d4-4c87-88c9-12cf0c2849a4 None admin] SCRIPT_NAME: `/identity` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:23:11.433114 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0368d429-66d4-4c87-88c9-12cf0c2849a4 None admin] PATH_INFO: `/v3/domains` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:23:11.433828 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0368d429-66d4-4c87-88c9-12cf0c2849a4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=207600) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:23:11.434145 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0368d429-66d4-4c87-88c9-12cf0c2849a4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:23:11.435567 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0368d429-66d4-4c87-88c9-12cf0c2849a4 None admin] RBAC: Authorization granted {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:23:11.444776 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b26d8150-21dd-409b-8042-08fc85bea727 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:23:11.445442 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26d8150-21dd-409b-8042-08fc85bea727 None admin] REQUEST_METHOD: `GET` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:23:11.445728 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26d8150-21dd-409b-8042-08fc85bea727 None admin] SCRIPT_NAME: `/identity` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:23:11.446002 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26d8150-21dd-409b-8042-08fc85bea727 None admin] PATH_INFO: `/v3/domains/default` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:23:11.447220 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b26d8150-21dd-409b-8042-08fc85bea727 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:23:11.448694 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b26d8150-21dd-409b-8042-08fc85bea727 None admin] RBAC: Authorization granted {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:23:11.450318 dv-cinder-851351-1-smb devstack@keystone.service[207601]: [pid: 207601|app: 0|req: 11/19] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 08:23:11 2022] GET /identity/v3/domains/default => generated 199 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 08:23:11.453225 dv-cinder-851351-1-smb devstack@keystone.service[207600]: [pid: 207600|app: 0|req: 9/20] 10.222.0.42 () {56 vars in 1109 bytes} [Thu Jul 28 08:23:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 08:23:11.456375 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b26d8150-21dd-409b-8042-08fc85bea727 None admin] Authenticating user token {{(pid=207601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:23:11.566956 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b26d8150-21dd-409b-8042-08fc85bea727 None admin] Validating token access rules against request {{(pid=207601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:23:11.605335 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67275b79-70bc-42f1-879d-61b3c5dd9efd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:23:11.605996 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67275b79-70bc-42f1-879d-61b3c5dd9efd None admin] REQUEST_METHOD: `GET` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:23:11.606271 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67275b79-70bc-42f1-879d-61b3c5dd9efd None admin] SCRIPT_NAME: `/identity` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:23:11.606511 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67275b79-70bc-42f1-879d-61b3c5dd9efd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:23:11.607328 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67275b79-70bc-42f1-879d-61b3c5dd9efd None admin] RBAC: Adding query filter params (role.id=d0ce88034c6b41878db755343f5840be, scope.domain.id=default, user.id=b8110ade874c4aa7af27f5c376df700a) {{(pid=207601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:23:11.607644 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67275b79-70bc-42f1-879d-61b3c5dd9efd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:23:11.609253 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67275b79-70bc-42f1-879d-61b3c5dd9efd None admin] RBAC: Authorization granted {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:23:11.618221 dv-cinder-851351-1-smb devstack@keystone.service[207601]: [pid: 207601|app: 0|req: 12/21] 10.222.0.42 () {56 vars in 1322 bytes} [Thu Jul 28 08:23:11 2022] GET /identity/v3/role_assignments?user.id=b8110ade874c4aa7af27f5c376df700a&scope.domain.id=default&role.id=d0ce88034c6b41878db755343f5840be => generated 233 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:23:13.867409 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e212d6-545e-48a2-b740-5425e5439fed None None] REQUEST_METHOD: `GET` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:23:13.867976 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e212d6-545e-48a2-b740-5425e5439fed None None] SCRIPT_NAME: `/identity` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:23:13.867976 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e212d6-545e-48a2-b740-5425e5439fed None None] PATH_INFO: `/` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:23:13.869397 dv-cinder-851351-1-smb devstack@keystone.service[207600]: [pid: 207600|app: 0|req: 10/22] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 08:23:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 08:23:13.886726 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2238c3-417c-4ce2-b838-b3e403422f2c None None] REQUEST_METHOD: `POST` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:23:13.887247 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2238c3-417c-4ce2-b838-b3e403422f2c None None] SCRIPT_NAME: `/identity` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:23:13.887342 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2238c3-417c-4ce2-b838-b3e403422f2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:23:13.910200 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.auth.core [None req-be2238c3-417c-4ce2-b838-b3e403422f2c None None] MFA Rules not processed for user `b8110ade874c4aa7af27f5c376df700a`. Rule list: `[]` (Enabled: `True`). {{(pid=207601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 08:23:13.911600 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.fernet_utils [None req-be2238c3-417c-4ce2-b838-b3e403422f2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=207601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:23:13.934377 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG dbcounter [-] [207601] Writing DB stats keystone:SELECT=100 {{(pid=207601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:23:13.969529 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a502a0-91c4-4b6a-84d7-95c9de8cbb28 None None] REQUEST_METHOD: `GET` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:23:13.969888 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a502a0-91c4-4b6a-84d7-95c9de8cbb28 None None] SCRIPT_NAME: `/identity` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:23:13.970103 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a502a0-91c4-4b6a-84d7-95c9de8cbb28 None None] PATH_INFO: `/` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:23:13.971785 dv-cinder-851351-1-smb devstack@keystone.service[207600]: [pid: 207600|app: 0|req: 11/23] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 08:23:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 08:23:13.976743 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337c74fc-52ef-4db1-871e-fbe0fe5e8f88 None None] REQUEST_METHOD: `POST` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:23:13.977038 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337c74fc-52ef-4db1-871e-fbe0fe5e8f88 None None] SCRIPT_NAME: `/identity` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:23:13.977324 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337c74fc-52ef-4db1-871e-fbe0fe5e8f88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:23:14.006804 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.auth.core [None req-337c74fc-52ef-4db1-871e-fbe0fe5e8f88 None None] MFA Rules not processed for user `b8110ade874c4aa7af27f5c376df700a`. Rule list: `[]` (Enabled: `True`). {{(pid=207600) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 08:23:14.008061 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.fernet_utils [None req-337c74fc-52ef-4db1-871e-fbe0fe5e8f88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=207600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:23:14.029187 dv-cinder-851351-1-smb devstack@keystone.service[207601]: [pid: 207601|app: 0|req: 13/24] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 08:23:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 08:23:14.071205 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG dbcounter [-] [207600] Writing DB stats keystone:SELECT=100 {{(pid=207600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:23:14.071405 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be2238c3-417c-4ce2-b838-b3e403422f2c None None] Authenticating user token {{(pid=207601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:23:14.153422 dv-cinder-851351-1-smb devstack@keystone.service[207600]: [pid: 207600|app: 0|req: 12/25] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 08:23:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 28 08:23:14.189253 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337c74fc-52ef-4db1-871e-fbe0fe5e8f88 None None] Authenticating user token {{(pid=207600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:23:14.278854 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be2238c3-417c-4ce2-b838-b3e403422f2c None None] Validating token access rules against request {{(pid=207601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:23:14.350790 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0cadf35-fe6e-4bb1-8387-19f865c42ae6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:23:14.351476 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0cadf35-fe6e-4bb1-8387-19f865c42ae6 None admin] REQUEST_METHOD: `GET` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:23:14.351764 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0cadf35-fe6e-4bb1-8387-19f865c42ae6 None admin] SCRIPT_NAME: `/identity` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:23:14.352043 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0cadf35-fe6e-4bb1-8387-19f865c42ae6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:23:14.376391 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0cadf35-fe6e-4bb1-8387-19f865c42ae6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:23:14.377939 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0cadf35-fe6e-4bb1-8387-19f865c42ae6 None admin] RBAC: Authorization granted {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:23:14.407701 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application [None req-f0cadf35-fe6e-4bb1-8387-19f865c42ae6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 08:23:14.407701 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:23:14.407701 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:23:14.407701 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:23:14.407701 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:23:14.407701 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:23:14.407701 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:23:14.407701 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:23:14.407701 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:23:14.407701 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:23:14.407701 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:23:14.407701 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:23:14.407701 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 08:23:14.407701 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 08:23:14.407701 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 08:23:14.408786 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 08:23:14.408786 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:23:14.408786 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:23:14.408786 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:23:14.408786 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:23:14.408786 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:23:14.408786 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:23:14.408786 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:23:14.408786 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application with Lock( Jul 28 08:23:14.408786 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:23:14.408786 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:23:14.408786 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:23:14.408786 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:23:14.408786 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:23:14.408786 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:23:14.408786 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:23:14.408786 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:23:14.410118 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 08:23:14.410118 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 08:23:14.410118 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 08:23:14.410118 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application Jul 28 08:23:14.410118 dv-cinder-851351-1-smb devstack@keystone.service[207601]: [pid: 207601|app: 0|req: 14/26] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 08:23:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 338 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 08:23:14.417581 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292fb2a4-5d61-461a-b7d2-91869a7fac83 None None] REQUEST_METHOD: `GET` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:23:14.417882 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292fb2a4-5d61-461a-b7d2-91869a7fac83 None None] SCRIPT_NAME: `/identity` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:23:14.418063 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337c74fc-52ef-4db1-871e-fbe0fe5e8f88 None None] Validating token access rules against request {{(pid=207600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:23:14.418177 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292fb2a4-5d61-461a-b7d2-91869a7fac83 None None] PATH_INFO: `/` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:23:14.419491 dv-cinder-851351-1-smb devstack@keystone.service[207601]: [pid: 207601|app: 0|req: 15/27] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 08:23:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 28 08:23:14.420233 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292fb2a4-5d61-461a-b7d2-91869a7fac83 None None] Authenticating user token {{(pid=207601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:23:14.442798 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG dbcounter [-] [207601] Writing DB stats keystone:SELECT=100 {{(pid=207601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:23:14.462438 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02218625-60b6-4dfd-91b2-0951bbbc21d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:23:14.463379 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02218625-60b6-4dfd-91b2-0951bbbc21d4 None admin] REQUEST_METHOD: `POST` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:23:14.463885 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02218625-60b6-4dfd-91b2-0951bbbc21d4 None admin] SCRIPT_NAME: `/identity` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:23:14.464338 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02218625-60b6-4dfd-91b2-0951bbbc21d4 None admin] PATH_INFO: `/v3/roles` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:23:14.465637 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02218625-60b6-4dfd-91b2-0951bbbc21d4 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:23:14.467291 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02218625-60b6-4dfd-91b2-0951bbbc21d4 None admin] RBAC: Authorization granted {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:23:14.594376 dv-cinder-851351-1-smb devstack@keystone.service[207600]: [pid: 207600|app: 0|req: 13/28] 10.222.0.42 () {60 vars in 1131 bytes} [Thu Jul 28 08:23:14 2022] POST /identity/v3/roles => generated 219 bytes in 406 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 28 08:23:14.596237 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5faa726-d38f-481f-b42c-c220b5ac701b None None] REQUEST_METHOD: `POST` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:23:14.596754 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5faa726-d38f-481f-b42c-c220b5ac701b None None] SCRIPT_NAME: `/identity` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:23:14.597234 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5faa726-d38f-481f-b42c-c220b5ac701b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:23:14.621409 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.auth.core [None req-d5faa726-d38f-481f-b42c-c220b5ac701b None None] MFA Rules not processed for user `b8110ade874c4aa7af27f5c376df700a`. Rule list: `[]` (Enabled: `True`). {{(pid=207600) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 08:23:14.623355 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.fernet_utils [None req-d5faa726-d38f-481f-b42c-c220b5ac701b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=207600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:23:14.644200 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG dbcounter [-] [207600] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=207600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:23:14.695713 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292fb2a4-5d61-461a-b7d2-91869a7fac83 None None] Validating token access rules against request {{(pid=207601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:23:14.761163 dv-cinder-851351-1-smb devstack@keystone.service[207600]: [pid: 207600|app: 0|req: 14/29] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 08:23:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 08:23:14.763735 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697431c1-842c-45cc-856e-1a31f685a2f6 None None] REQUEST_METHOD: `GET` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:23:14.764080 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697431c1-842c-45cc-856e-1a31f685a2f6 None None] SCRIPT_NAME: `/identity` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:23:14.764364 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697431c1-842c-45cc-856e-1a31f685a2f6 None None] PATH_INFO: `/` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:23:14.767741 dv-cinder-851351-1-smb devstack@keystone.service[207600]: [pid: 207600|app: 0|req: 15/30] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 08:23:14 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 08:23:14.773941 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c3859f-9b9d-4931-8996-4679d2053b61 None None] REQUEST_METHOD: `POST` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:23:14.774256 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c3859f-9b9d-4931-8996-4679d2053b61 None None] SCRIPT_NAME: `/identity` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:23:14.774516 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c3859f-9b9d-4931-8996-4679d2053b61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:23:14.782571 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbafc510-82d2-4ffb-84bb-279c8fa928c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:23:14.783653 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbafc510-82d2-4ffb-84bb-279c8fa928c6 None admin] REQUEST_METHOD: `GET` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:23:14.784194 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbafc510-82d2-4ffb-84bb-279c8fa928c6 None admin] SCRIPT_NAME: `/identity` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:23:14.784732 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbafc510-82d2-4ffb-84bb-279c8fa928c6 None admin] PATH_INFO: `/v3/domains` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:23:14.786300 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbafc510-82d2-4ffb-84bb-279c8fa928c6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=207601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:23:14.787144 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbafc510-82d2-4ffb-84bb-279c8fa928c6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:23:14.789595 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbafc510-82d2-4ffb-84bb-279c8fa928c6 None admin] RBAC: Authorization granted {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:23:14.796758 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.auth.core [None req-65c3859f-9b9d-4931-8996-4679d2053b61 None None] MFA Rules not processed for user `b8110ade874c4aa7af27f5c376df700a`. Rule list: `[]` (Enabled: `True`). {{(pid=207600) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 08:23:14.797248 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.fernet_utils [None req-65c3859f-9b9d-4931-8996-4679d2053b61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=207600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:23:14.823315 dv-cinder-851351-1-smb devstack@keystone.service[207601]: [pid: 207601|app: 0|req: 16/31] 10.222.0.42 () {56 vars in 1109 bytes} [Thu Jul 28 08:23:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 403 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:23:14.825566 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbafc510-82d2-4ffb-84bb-279c8fa928c6 None admin] Authenticating user token {{(pid=207601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:23:14.905447 dv-cinder-851351-1-smb devstack@keystone.service[207600]: [pid: 207600|app: 0|req: 16/32] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 08:23:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 08:23:14.905447 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c3859f-9b9d-4931-8996-4679d2053b61 None None] Authenticating user token {{(pid=207600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:23:14.915991 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG dbcounter [-] [207601] Writing DB stats keystone:SELECT=100 {{(pid=207601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:23:14.957018 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbafc510-82d2-4ffb-84bb-279c8fa928c6 None admin] Validating token access rules against request {{(pid=207601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:23:14.999789 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46486940-bd9d-4a2c-87fe-43ca03ad6a49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:23:15.000998 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46486940-bd9d-4a2c-87fe-43ca03ad6a49 None admin] REQUEST_METHOD: `GET` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:23:15.001515 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46486940-bd9d-4a2c-87fe-43ca03ad6a49 None admin] SCRIPT_NAME: `/identity` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:23:15.002017 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46486940-bd9d-4a2c-87fe-43ca03ad6a49 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:23:15.016358 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46486940-bd9d-4a2c-87fe-43ca03ad6a49 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 08:23:15.017262 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG dbcounter [-] [207600] Writing DB stats keystone:SELECT=100 {{(pid=207600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:23:15.022904 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application [None req-46486940-bd9d-4a2c-87fe-43ca03ad6a49 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 08:23:15.022904 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:23:15.022904 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:23:15.022904 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:23:15.022904 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:23:15.022904 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:23:15.022904 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:23:15.022904 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:23:15.022904 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:23:15.022904 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:23:15.022904 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:23:15.022904 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:23:15.022904 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 08:23:15.022904 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 08:23:15.022904 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 08:23:15.022904 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 08:23:15.023974 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 08:23:15.023974 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 08:23:15.023974 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 08:23:15.023974 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 08:23:15.023974 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:23:15.023974 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:23:15.023974 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:23:15.023974 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:23:15.023974 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:23:15.023974 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:23:15.023974 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:23:15.023974 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application with Lock( Jul 28 08:23:15.023974 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:23:15.023974 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:23:15.023974 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:23:15.023974 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:23:15.024890 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:23:15.024890 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:23:15.024890 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:23:15.024890 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:23:15.024890 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 08:23:15.024890 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 08:23:15.024890 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 08:23:15.024890 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 08:23:15.024890 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 08:23:15.024890 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 08:23:15.024890 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 08:23:15.024890 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application Jul 28 08:23:15.030517 dv-cinder-851351-1-smb devstack@keystone.service[207601]: [pid: 207601|app: 0|req: 17/33] 10.222.0.42 () {56 vars in 1096 bytes} [Thu Jul 28 08:23:14 2022] GET /identity/v3/roles/admin => generated 83 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:23:15.036920 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46486940-bd9d-4a2c-87fe-43ca03ad6a49 None admin] Authenticating user token {{(pid=207601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:23:15.037146 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c3859f-9b9d-4931-8996-4679d2053b61 None None] Validating token access rules against request {{(pid=207600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:23:15.086738 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4643e055-1cc2-481c-a2bc-aed439c4dc0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:23:15.087590 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4643e055-1cc2-481c-a2bc-aed439c4dc0a None admin] REQUEST_METHOD: `POST` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:23:15.087978 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4643e055-1cc2-481c-a2bc-aed439c4dc0a None admin] SCRIPT_NAME: `/identity` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:23:15.088358 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4643e055-1cc2-481c-a2bc-aed439c4dc0a None admin] PATH_INFO: `/v3/projects` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:23:15.089223 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4643e055-1cc2-481c-a2bc-aed439c4dc0a None admin] RBAC: Authorizing `identity:create_project()` {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:23:15.091610 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4643e055-1cc2-481c-a2bc-aed439c4dc0a None admin] RBAC: Authorization granted {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:23:15.135063 dv-cinder-851351-1-smb devstack@keystone.service[207600]: [pid: 207600|app: 0|req: 17/34] 10.222.0.42 () {60 vars in 1141 bytes} [Thu Jul 28 08:23:14 2022] POST /identity/v3/projects => generated 301 bytes in 231 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 08:23:15.136249 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4643e055-1cc2-481c-a2bc-aed439c4dc0a None admin] Authenticating user token {{(pid=207600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:23:15.232771 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46486940-bd9d-4a2c-87fe-43ca03ad6a49 None admin] Validating token access rules against request {{(pid=207601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:23:15.317199 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4643e055-1cc2-481c-a2bc-aed439c4dc0a None admin] Validating token access rules against request {{(pid=207600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:23:15.320866 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG dbcounter [-] [207601] Writing DB stats keystone:SELECT=100 {{(pid=207601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:23:15.353014 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f72dcef3-b619-47fd-8c16-f2b38c85a0af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:23:15.353696 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72dcef3-b619-47fd-8c16-f2b38c85a0af None admin] REQUEST_METHOD: `POST` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:23:15.353985 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72dcef3-b619-47fd-8c16-f2b38c85a0af None admin] SCRIPT_NAME: `/identity` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:23:15.354267 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72dcef3-b619-47fd-8c16-f2b38c85a0af None admin] PATH_INFO: `/v3/roles` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:23:15.355040 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f72dcef3-b619-47fd-8c16-f2b38c85a0af None admin] RBAC: Authorizing `identity:create_role()` {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:23:15.356543 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f72dcef3-b619-47fd-8c16-f2b38c85a0af None admin] RBAC: Authorization granted {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:23:15.369520 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eecda568-9893-4df2-9871-bdc11cb2facf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:23:15.370352 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eecda568-9893-4df2-9871-bdc11cb2facf None admin] REQUEST_METHOD: `GET` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:23:15.370956 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eecda568-9893-4df2-9871-bdc11cb2facf None admin] SCRIPT_NAME: `/identity` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:23:15.371070 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eecda568-9893-4df2-9871-bdc11cb2facf None admin] PATH_INFO: `/v3/roles` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:23:15.371844 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eecda568-9893-4df2-9871-bdc11cb2facf None admin] RBAC: Adding query filter params (name=admin) {{(pid=207600) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:23:15.372156 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eecda568-9893-4df2-9871-bdc11cb2facf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:23:15.373890 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eecda568-9893-4df2-9871-bdc11cb2facf None admin] RBAC: Authorization granted {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:23:15.378281 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG dbcounter [-] [207600] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=207600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:23:15.390825 dv-cinder-851351-1-smb devstack@keystone.service[207600]: [pid: 207600|app: 0|req: 18/35] 10.222.0.42 () {56 vars in 1099 bytes} [Thu Jul 28 08:23:15 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:23:15.391049 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd77cc1a-8984-4b21-b1e9-dc2c043899f2 None None] REQUEST_METHOD: `GET` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:23:15.391221 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd77cc1a-8984-4b21-b1e9-dc2c043899f2 None None] SCRIPT_NAME: `/identity` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:23:15.391486 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd77cc1a-8984-4b21-b1e9-dc2c043899f2 None None] PATH_INFO: `/` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:23:15.399599 dv-cinder-851351-1-smb devstack@keystone.service[207600]: [pid: 207600|app: 0|req: 19/36] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 08:23:15 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 08:23:15.399599 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd77cc1a-8984-4b21-b1e9-dc2c043899f2 None None] Authenticating user token {{(pid=207600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:23:15.494569 dv-cinder-851351-1-smb devstack@keystone.service[207601]: [pid: 207601|app: 0|req: 18/37] 10.222.0.42 () {60 vars in 1131 bytes} [Thu Jul 28 08:23:15 2022] POST /identity/v3/roles => generated 225 bytes in 464 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 08:23:15.495995 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9b19cd-e925-4886-beca-f3f911597c3f None None] REQUEST_METHOD: `POST` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:23:15.496294 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9b19cd-e925-4886-beca-f3f911597c3f None None] SCRIPT_NAME: `/identity` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:23:15.496580 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9b19cd-e925-4886-beca-f3f911597c3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:23:15.515997 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd77cc1a-8984-4b21-b1e9-dc2c043899f2 None None] Validating token access rules against request {{(pid=207600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:23:15.521226 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.auth.core [None req-7f9b19cd-e925-4886-beca-f3f911597c3f None None] MFA Rules not processed for user `b8110ade874c4aa7af27f5c376df700a`. Rule list: `[]` (Enabled: `True`). {{(pid=207601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 08:23:15.523015 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.fernet_utils [None req-7f9b19cd-e925-4886-beca-f3f911597c3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=207601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:23:15.563117 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a56a6e-01c7-4673-a774-2243ebea98a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:23:15.564098 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a56a6e-01c7-4673-a774-2243ebea98a4 None admin] REQUEST_METHOD: `GET` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:23:15.564531 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a56a6e-01c7-4673-a774-2243ebea98a4 None admin] SCRIPT_NAME: `/identity` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:23:15.565088 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a56a6e-01c7-4673-a774-2243ebea98a4 None admin] PATH_INFO: `/v3/users/b8110ade874c4aa7af27f5c376df700a` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:23:15.566602 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a56a6e-01c7-4673-a774-2243ebea98a4 None admin] RBAC: Authorizing `identity:get_user(user_id=b8110ade874c4aa7af27f5c376df700a)` {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:23:15.568749 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a56a6e-01c7-4673-a774-2243ebea98a4 None admin] RBAC: Authorization granted {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:23:15.571901 dv-cinder-851351-1-smb devstack@keystone.service[207600]: [pid: 207600|app: 0|req: 20/38] 10.222.0.42 () {56 vars in 1177 bytes} [Thu Jul 28 08:23:15 2022] GET /identity/v3/users/b8110ade874c4aa7af27f5c376df700a => generated 247 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:23:15.573554 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4fe301-8e67-433f-b43b-406247dbea52 None None] REQUEST_METHOD: `GET` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:23:15.574020 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4fe301-8e67-433f-b43b-406247dbea52 None None] SCRIPT_NAME: `/identity` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:23:15.574465 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4fe301-8e67-433f-b43b-406247dbea52 None None] PATH_INFO: `/` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:23:15.576012 dv-cinder-851351-1-smb devstack@keystone.service[207600]: [pid: 207600|app: 0|req: 21/39] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 08:23:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 08:23:15.582413 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4fe301-8e67-433f-b43b-406247dbea52 None None] Authenticating user token {{(pid=207600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:23:15.615456 dv-cinder-851351-1-smb devstack@keystone.service[207601]: [pid: 207601|app: 0|req: 19/40] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 08:23:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 08:23:15.616888 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed0b58f-effe-48a8-b2b9-d65a77f2e437 None None] REQUEST_METHOD: `POST` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:23:15.617187 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed0b58f-effe-48a8-b2b9-d65a77f2e437 None None] SCRIPT_NAME: `/identity` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:23:15.617468 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed0b58f-effe-48a8-b2b9-d65a77f2e437 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:23:15.646720 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.auth.core [None req-aed0b58f-effe-48a8-b2b9-d65a77f2e437 None None] MFA Rules not processed for user `b8110ade874c4aa7af27f5c376df700a`. Rule list: `[]` (Enabled: `True`). {{(pid=207601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 08:23:15.647988 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.fernet_utils [None req-aed0b58f-effe-48a8-b2b9-d65a77f2e437 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=207601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:23:15.661931 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG dbcounter [-] [207600] Writing DB stats keystone:SELECT=100 {{(pid=207600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:23:15.712630 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4fe301-8e67-433f-b43b-406247dbea52 None None] Validating token access rules against request {{(pid=207600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:23:15.732552 dv-cinder-851351-1-smb devstack@keystone.service[207601]: [pid: 207601|app: 0|req: 20/41] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 08:23:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 08:23:15.733834 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed0b58f-effe-48a8-b2b9-d65a77f2e437 None None] Authenticating user token {{(pid=207601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:23:15.755956 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09066996-3a43-43fb-ae0e-f1157d0009b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:23:15.756559 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09066996-3a43-43fb-ae0e-f1157d0009b0 None admin] REQUEST_METHOD: `GET` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:23:15.756903 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09066996-3a43-43fb-ae0e-f1157d0009b0 None admin] SCRIPT_NAME: `/identity` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:23:15.757183 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09066996-3a43-43fb-ae0e-f1157d0009b0 None admin] PATH_INFO: `/v3/domains/default` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:23:15.758420 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09066996-3a43-43fb-ae0e-f1157d0009b0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:23:15.759951 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09066996-3a43-43fb-ae0e-f1157d0009b0 None admin] RBAC: Authorization granted {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:23:15.761744 dv-cinder-851351-1-smb devstack@keystone.service[207600]: [pid: 207600|app: 0|req: 22/42] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 08:23:15 2022] GET /identity/v3/domains/default => generated 199 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:23:15.762604 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09066996-3a43-43fb-ae0e-f1157d0009b0 None admin] Authenticating user token {{(pid=207600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:23:15.792455 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG dbcounter [-] [207601] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=207601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:23:15.847519 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed0b58f-effe-48a8-b2b9-d65a77f2e437 None None] Validating token access rules against request {{(pid=207601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:23:15.869866 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09066996-3a43-43fb-ae0e-f1157d0009b0 None admin] Validating token access rules against request {{(pid=207600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:23:15.886703 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f131cf4a-0803-43b0-9414-51a9319f363a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:23:15.887373 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f131cf4a-0803-43b0-9414-51a9319f363a None admin] REQUEST_METHOD: `POST` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:23:15.887665 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f131cf4a-0803-43b0-9414-51a9319f363a None admin] SCRIPT_NAME: `/identity` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:23:15.887950 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f131cf4a-0803-43b0-9414-51a9319f363a None admin] PATH_INFO: `/v3/roles` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:23:15.888754 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f131cf4a-0803-43b0-9414-51a9319f363a None admin] RBAC: Authorizing `identity:create_role()` {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:23:15.890456 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f131cf4a-0803-43b0-9414-51a9319f363a None admin] RBAC: Authorization granted {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:23:15.907529 dv-cinder-851351-1-smb devstack@keystone.service[207601]: [pid: 207601|app: 0|req: 21/43] 10.222.0.42 () {60 vars in 1131 bytes} [Thu Jul 28 08:23:15 2022] POST /identity/v3/roles => generated 223 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 08:23:15.908402 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f131cf4a-0803-43b0-9414-51a9319f363a None admin] Authenticating user token {{(pid=207601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:23:15.913784 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-164038b0-1765-4750-a64c-78dedd81eec4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:23:15.914518 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164038b0-1765-4750-a64c-78dedd81eec4 None admin] REQUEST_METHOD: `GET` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:23:15.914834 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164038b0-1765-4750-a64c-78dedd81eec4 None admin] SCRIPT_NAME: `/identity` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:23:15.915123 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164038b0-1765-4750-a64c-78dedd81eec4 None admin] PATH_INFO: `/v3/domains/default` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:23:15.916540 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-164038b0-1765-4750-a64c-78dedd81eec4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:23:15.918204 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-164038b0-1765-4750-a64c-78dedd81eec4 None admin] RBAC: Authorization granted {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:23:15.920411 dv-cinder-851351-1-smb devstack@keystone.service[207600]: [pid: 207600|app: 0|req: 23/44] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 08:23:15 2022] GET /identity/v3/domains/default => generated 199 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:23:15.926279 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-164038b0-1765-4750-a64c-78dedd81eec4 None admin] Authenticating user token {{(pid=207600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:23:15.929431 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG dbcounter [-] [207600] Writing DB stats keystone:SELECT=100 {{(pid=207600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:23:16.048355 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f131cf4a-0803-43b0-9414-51a9319f363a None admin] Validating token access rules against request {{(pid=207601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:23:16.054562 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-164038b0-1765-4750-a64c-78dedd81eec4 None admin] Validating token access rules against request {{(pid=207600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:23:16.060989 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG dbcounter [-] [207601] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=207601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:23:16.093945 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a4272f-5803-477b-97f9-c344c2b2367b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:23:16.094768 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a4272f-5803-477b-97f9-c344c2b2367b None admin] REQUEST_METHOD: `PUT` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:23:16.095163 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a4272f-5803-477b-97f9-c344c2b2367b None admin] SCRIPT_NAME: `/identity` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:23:16.095451 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a4272f-5803-477b-97f9-c344c2b2367b None admin] PATH_INFO: `/v3/domains/default/users/b8110ade874c4aa7af27f5c376df700a/roles/d0ce88034c6b41878db755343f5840be` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:23:16.096339 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99f39e6-7f4f-4783-b3f8-7915bc06d687 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:23:16.097056 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99f39e6-7f4f-4783-b3f8-7915bc06d687 None admin] REQUEST_METHOD: `POST` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:23:16.097342 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99f39e6-7f4f-4783-b3f8-7915bc06d687 None admin] SCRIPT_NAME: `/identity` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:23:16.097586 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5a4272f-5803-477b-97f9-c344c2b2367b None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=b8110ade874c4aa7af27f5c376df700a, role_id=d0ce88034c6b41878db755343f5840be)` {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:23:16.097689 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99f39e6-7f4f-4783-b3f8-7915bc06d687 None admin] PATH_INFO: `/v3/projects` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:23:16.098315 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f99f39e6-7f4f-4783-b3f8-7915bc06d687 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:23:16.099087 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5a4272f-5803-477b-97f9-c344c2b2367b None admin] RBAC: Authorization granted {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:23:16.099811 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f99f39e6-7f4f-4783-b3f8-7915bc06d687 None admin] RBAC: Authorization granted {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:23:16.117388 dv-cinder-851351-1-smb devstack@keystone.service[207601]: [pid: 207601|app: 0|req: 22/45] 10.222.0.42 () {58 vars in 1361 bytes} [Thu Jul 28 08:23:15 2022] PUT /identity/v3/domains/default/users/b8110ade874c4aa7af27f5c376df700a/roles/d0ce88034c6b41878db755343f5840be => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 08:23:16.134375 dv-cinder-851351-1-smb devstack@keystone.service[207600]: [pid: 207600|app: 0|req: 24/46] 10.222.0.42 () {60 vars in 1141 bytes} [Thu Jul 28 08:23:15 2022] POST /identity/v3/projects => generated 312 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 28 08:23:18.125047 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f49bf0-9d90-4186-8b42-53956ce892a1 None None] REQUEST_METHOD: `GET` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:23:18.125666 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f49bf0-9d90-4186-8b42-53956ce892a1 None None] SCRIPT_NAME: `/identity` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:23:18.125666 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f49bf0-9d90-4186-8b42-53956ce892a1 None None] PATH_INFO: `/` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:23:18.126986 dv-cinder-851351-1-smb devstack@keystone.service[207601]: [pid: 207601|app: 0|req: 23/47] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 08:23:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 08:23:18.132703 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0e1b21-a726-46a3-b751-9b4c4ef04c3e None None] REQUEST_METHOD: `POST` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:23:18.133200 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0e1b21-a726-46a3-b751-9b4c4ef04c3e None None] SCRIPT_NAME: `/identity` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:23:18.133359 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0e1b21-a726-46a3-b751-9b4c4ef04c3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:23:18.153345 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.auth.core [None req-5f0e1b21-a726-46a3-b751-9b4c4ef04c3e None None] MFA Rules not processed for user `b8110ade874c4aa7af27f5c376df700a`. Rule list: `[]` (Enabled: `True`). {{(pid=207600) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 08:23:18.154483 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.fernet_utils [None req-5f0e1b21-a726-46a3-b751-9b4c4ef04c3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=207600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:23:18.165631 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6814b32b-0d2f-48d8-a181-57d1ce1d4572 None None] REQUEST_METHOD: `GET` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:23:18.165927 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6814b32b-0d2f-48d8-a181-57d1ce1d4572 None None] SCRIPT_NAME: `/identity` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:23:18.166250 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6814b32b-0d2f-48d8-a181-57d1ce1d4572 None None] PATH_INFO: `/` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:23:18.167708 dv-cinder-851351-1-smb devstack@keystone.service[207601]: [pid: 207601|app: 0|req: 24/48] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 08:23:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 08:23:18.173491 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93128e7f-31cf-4a1d-bc57-72eed16b831e None None] REQUEST_METHOD: `POST` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:23:18.173830 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93128e7f-31cf-4a1d-bc57-72eed16b831e None None] SCRIPT_NAME: `/identity` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:23:18.174104 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93128e7f-31cf-4a1d-bc57-72eed16b831e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:23:18.192721 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.auth.core [None req-93128e7f-31cf-4a1d-bc57-72eed16b831e None None] MFA Rules not processed for user `b8110ade874c4aa7af27f5c376df700a`. Rule list: `[]` (Enabled: `True`). {{(pid=207601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 08:23:18.193852 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.fernet_utils [None req-93128e7f-31cf-4a1d-bc57-72eed16b831e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=207601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:23:18.217215 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG dbcounter [-] [207600] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=207600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:23:18.237701 dv-cinder-851351-1-smb devstack@keystone.service[207600]: [pid: 207600|app: 0|req: 25/49] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 08:23:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 08:23:18.260595 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f0e1b21-a726-46a3-b751-9b4c4ef04c3e None None] Authenticating user token {{(pid=207600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:23:18.274820 dv-cinder-851351-1-smb devstack@keystone.service[207601]: [pid: 207601|app: 0|req: 25/50] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 08:23:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 28 08:23:18.297734 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93128e7f-31cf-4a1d-bc57-72eed16b831e None None] Authenticating user token {{(pid=207601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:23:18.372575 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f0e1b21-a726-46a3-b751-9b4c4ef04c3e None None] Validating token access rules against request {{(pid=207600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:23:18.404504 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG dbcounter [-] [207601] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=207601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:23:18.408527 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93128e7f-31cf-4a1d-bc57-72eed16b831e None None] Validating token access rules against request {{(pid=207601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:23:18.409928 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae14f7e-f522-45ea-9071-0cab71529b4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:23:18.410597 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae14f7e-f522-45ea-9071-0cab71529b4c None admin] REQUEST_METHOD: `GET` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:23:18.410892 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae14f7e-f522-45ea-9071-0cab71529b4c None admin] SCRIPT_NAME: `/identity` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:23:18.411164 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae14f7e-f522-45ea-9071-0cab71529b4c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:23:18.424248 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fae14f7e-f522-45ea-9071-0cab71529b4c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 08:23:18.431031 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application [None req-fae14f7e-f522-45ea-9071-0cab71529b4c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 08:23:18.431031 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:23:18.431031 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:23:18.431031 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:23:18.431031 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:23:18.431031 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:23:18.431031 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:23:18.431031 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:23:18.431031 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:23:18.431031 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:23:18.431031 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:23:18.431031 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:23:18.431031 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 08:23:18.431031 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 08:23:18.431031 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 08:23:18.431031 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 08:23:18.432064 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 08:23:18.432064 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 08:23:18.432064 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 08:23:18.432064 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 08:23:18.432064 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:23:18.432064 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:23:18.432064 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:23:18.432064 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:23:18.432064 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:23:18.432064 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:23:18.432064 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:23:18.432064 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application with Lock( Jul 28 08:23:18.432064 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:23:18.432064 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:23:18.432064 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:23:18.432064 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:23:18.432986 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:23:18.432986 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:23:18.432986 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:23:18.432986 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:23:18.432986 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 08:23:18.432986 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 08:23:18.432986 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 08:23:18.432986 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 08:23:18.432986 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 08:23:18.432986 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 08:23:18.432986 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 08:23:18.432986 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application Jul 28 08:23:18.432986 dv-cinder-851351-1-smb devstack@keystone.service[207600]: [pid: 207600|app: 0|req: 26/51] 10.222.0.42 () {56 vars in 1096 bytes} [Thu Jul 28 08:23:18 2022] GET /identity/v3/roles/admin => generated 83 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:23:18.438434 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae14f7e-f522-45ea-9071-0cab71529b4c None admin] Authenticating user token {{(pid=207600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:23:18.450658 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42973ba5-7699-4d87-8246-623a95a528be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:23:18.451399 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42973ba5-7699-4d87-8246-623a95a528be None admin] REQUEST_METHOD: `GET` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:23:18.451690 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42973ba5-7699-4d87-8246-623a95a528be None admin] SCRIPT_NAME: `/identity` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:23:18.451937 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42973ba5-7699-4d87-8246-623a95a528be None admin] PATH_INFO: `/v3/domains/default` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:23:18.453138 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42973ba5-7699-4d87-8246-623a95a528be None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:23:18.454616 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42973ba5-7699-4d87-8246-623a95a528be None admin] RBAC: Authorization granted {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:23:18.456260 dv-cinder-851351-1-smb devstack@keystone.service[207601]: [pid: 207601|app: 0|req: 26/52] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 08:23:18 2022] GET /identity/v3/domains/default => generated 199 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:23:18.462651 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42973ba5-7699-4d87-8246-623a95a528be None admin] Authenticating user token {{(pid=207601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:23:18.488852 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG dbcounter [-] [207600] Writing DB stats keystone:SELECT=100 {{(pid=207600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:23:18.554211 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae14f7e-f522-45ea-9071-0cab71529b4c None admin] Validating token access rules against request {{(pid=207600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:23:18.580206 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42973ba5-7699-4d87-8246-623a95a528be None admin] Validating token access rules against request {{(pid=207601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:23:18.596171 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-459a5147-2bc9-4717-a508-d90850a87406 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:23:18.597134 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459a5147-2bc9-4717-a508-d90850a87406 None admin] REQUEST_METHOD: `GET` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:23:18.597576 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459a5147-2bc9-4717-a508-d90850a87406 None admin] SCRIPT_NAME: `/identity` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:23:18.598006 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459a5147-2bc9-4717-a508-d90850a87406 None admin] PATH_INFO: `/v3/roles` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:23:18.599199 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-459a5147-2bc9-4717-a508-d90850a87406 None admin] RBAC: Adding query filter params (name=admin) {{(pid=207600) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:23:18.599642 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-459a5147-2bc9-4717-a508-d90850a87406 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:23:18.602020 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-459a5147-2bc9-4717-a508-d90850a87406 None admin] RBAC: Authorization granted {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:23:18.615983 dv-cinder-851351-1-smb devstack@keystone.service[207600]: [pid: 207600|app: 0|req: 27/53] 10.222.0.42 () {56 vars in 1099 bytes} [Thu Jul 28 08:23:18 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 08:23:18.619035 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-237a9efa-308e-412c-89c4-d89d518be46e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:23:18.619687 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237a9efa-308e-412c-89c4-d89d518be46e None admin] REQUEST_METHOD: `POST` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:23:18.619957 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237a9efa-308e-412c-89c4-d89d518be46e None admin] SCRIPT_NAME: `/identity` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:23:18.620236 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237a9efa-308e-412c-89c4-d89d518be46e None admin] PATH_INFO: `/v3/projects` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:23:18.620979 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-237a9efa-308e-412c-89c4-d89d518be46e None admin] RBAC: Authorizing `identity:create_project()` {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:23:18.622269 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-459a5147-2bc9-4717-a508-d90850a87406 None admin] Authenticating user token {{(pid=207600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:23:18.622448 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-237a9efa-308e-412c-89c4-d89d518be46e None admin] RBAC: Authorization granted {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:23:18.654209 dv-cinder-851351-1-smb devstack@keystone.service[207601]: [pid: 207601|app: 0|req: 27/54] 10.222.0.42 () {60 vars in 1140 bytes} [Thu Jul 28 08:23:18 2022] POST /identity/v3/projects => generated 298 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 28 08:23:18.757050 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-459a5147-2bc9-4717-a508-d90850a87406 None admin] Validating token access rules against request {{(pid=207600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:23:18.765628 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG dbcounter [-] [207600] Writing DB stats keystone:SELECT=100 {{(pid=207600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:23:18.800244 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff91cd6-fa0f-4281-9218-f0ee83913e4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:23:18.800972 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff91cd6-fa0f-4281-9218-f0ee83913e4c None admin] REQUEST_METHOD: `GET` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:23:18.801260 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff91cd6-fa0f-4281-9218-f0ee83913e4c None admin] SCRIPT_NAME: `/identity` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:23:18.801540 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff91cd6-fa0f-4281-9218-f0ee83913e4c None admin] PATH_INFO: `/v3/users/b8110ade874c4aa7af27f5c376df700a` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:23:18.802837 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff91cd6-fa0f-4281-9218-f0ee83913e4c None admin] RBAC: Authorizing `identity:get_user(user_id=b8110ade874c4aa7af27f5c376df700a)` {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:23:18.804357 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff91cd6-fa0f-4281-9218-f0ee83913e4c None admin] RBAC: Authorization granted {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:23:18.806090 dv-cinder-851351-1-smb devstack@keystone.service[207600]: [pid: 207600|app: 0|req: 28/55] 10.222.0.42 () {56 vars in 1177 bytes} [Thu Jul 28 08:23:18 2022] GET /identity/v3/users/b8110ade874c4aa7af27f5c376df700a => generated 247 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 08:23:18.812340 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-237a9efa-308e-412c-89c4-d89d518be46e None admin] Authenticating user token {{(pid=207601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:23:18.834236 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG dbcounter [-] [207601] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=207601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:23:18.927650 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-237a9efa-308e-412c-89c4-d89d518be46e None admin] Validating token access rules against request {{(pid=207601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:23:18.973585 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4506273-d204-4225-a664-3acc8ccb0dd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:23:18.974270 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4506273-d204-4225-a664-3acc8ccb0dd1 None admin] REQUEST_METHOD: `GET` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:23:18.974564 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4506273-d204-4225-a664-3acc8ccb0dd1 None admin] SCRIPT_NAME: `/identity` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:23:18.974843 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4506273-d204-4225-a664-3acc8ccb0dd1 None admin] PATH_INFO: `/v3/domains/default` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:23:18.976146 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4506273-d204-4225-a664-3acc8ccb0dd1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:23:18.977681 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4506273-d204-4225-a664-3acc8ccb0dd1 None admin] RBAC: Authorization granted {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:23:18.979327 dv-cinder-851351-1-smb devstack@keystone.service[207601]: [pid: 207601|app: 0|req: 28/56] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 08:23:18 2022] GET /identity/v3/domains/default => generated 199 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:23:18.985556 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff91cd6-fa0f-4281-9218-f0ee83913e4c None admin] Authenticating user token {{(pid=207600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:23:19.097675 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff91cd6-fa0f-4281-9218-f0ee83913e4c None admin] Validating token access rules against request {{(pid=207600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:23:19.134619 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0bba838-82b2-487f-b668-1875e43fb7da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:23:19.135351 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0bba838-82b2-487f-b668-1875e43fb7da None admin] REQUEST_METHOD: `GET` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:23:19.135501 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0bba838-82b2-487f-b668-1875e43fb7da None admin] SCRIPT_NAME: `/identity` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:23:19.135808 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0bba838-82b2-487f-b668-1875e43fb7da None admin] PATH_INFO: `/v3/role_assignments` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:23:19.136626 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0bba838-82b2-487f-b668-1875e43fb7da None admin] RBAC: Adding query filter params (role.id=d0ce88034c6b41878db755343f5840be, scope.domain.id=default, user.id=b8110ade874c4aa7af27f5c376df700a) {{(pid=207600) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:23:19.136999 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0bba838-82b2-487f-b668-1875e43fb7da None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:23:19.138472 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0bba838-82b2-487f-b668-1875e43fb7da None admin] RBAC: Authorization granted {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:23:19.146609 dv-cinder-851351-1-smb devstack@keystone.service[207600]: [pid: 207600|app: 0|req: 29/57] 10.222.0.42 () {56 vars in 1322 bytes} [Thu Jul 28 08:23:18 2022] GET /identity/v3/role_assignments?user.id=b8110ade874c4aa7af27f5c376df700a&scope.domain.id=default&role.id=d0ce88034c6b41878db755343f5840be => generated 530 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:23:20.714113 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88cb644-1ac4-470b-8002-9e66d9d1cd44 None None] REQUEST_METHOD: `GET` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:23:20.715071 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88cb644-1ac4-470b-8002-9e66d9d1cd44 None None] SCRIPT_NAME: `/identity` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:23:20.715071 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88cb644-1ac4-470b-8002-9e66d9d1cd44 None None] PATH_INFO: `/` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:23:20.716420 dv-cinder-851351-1-smb devstack@keystone.service[207601]: [pid: 207601|app: 0|req: 29/58] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 08:23:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 08:23:20.722049 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d621a2c8-d088-4af8-8ea7-527c0a6f64f0 None None] REQUEST_METHOD: `POST` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:23:20.722532 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d621a2c8-d088-4af8-8ea7-527c0a6f64f0 None None] SCRIPT_NAME: `/identity` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:23:20.722626 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d621a2c8-d088-4af8-8ea7-527c0a6f64f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:23:20.741993 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.auth.core [None req-d621a2c8-d088-4af8-8ea7-527c0a6f64f0 None None] MFA Rules not processed for user `b8110ade874c4aa7af27f5c376df700a`. Rule list: `[]` (Enabled: `True`). {{(pid=207600) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 08:23:20.743233 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.fernet_utils [None req-d621a2c8-d088-4af8-8ea7-527c0a6f64f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=207600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:23:20.776855 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG dbcounter [-] [207600] Writing DB stats keystone:SELECT=100 {{(pid=207600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:23:20.818451 dv-cinder-851351-1-smb devstack@keystone.service[207600]: [pid: 207600|app: 0|req: 30/59] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 08:23:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 08:23:20.842850 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88cb644-1ac4-470b-8002-9e66d9d1cd44 None None] Authenticating user token {{(pid=207601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:23:20.936522 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG dbcounter [-] [207601] Writing DB stats keystone:SELECT=100 {{(pid=207601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:23:20.954063 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88cb644-1ac4-470b-8002-9e66d9d1cd44 None None] Validating token access rules against request {{(pid=207601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:23:20.990792 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a6248d-a78b-4702-9961-87df90f5a01c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:23:20.991366 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a6248d-a78b-4702-9961-87df90f5a01c None admin] REQUEST_METHOD: `GET` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:23:20.991657 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a6248d-a78b-4702-9961-87df90f5a01c None admin] SCRIPT_NAME: `/identity` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:23:20.991937 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a6248d-a78b-4702-9961-87df90f5a01c None admin] PATH_INFO: `/v3/domains/default` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:23:20.993234 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a6248d-a78b-4702-9961-87df90f5a01c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:23:20.994743 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a6248d-a78b-4702-9961-87df90f5a01c None admin] RBAC: Authorization granted {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:23:20.996393 dv-cinder-851351-1-smb devstack@keystone.service[207601]: [pid: 207601|app: 0|req: 30/60] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 08:23:20 2022] GET /identity/v3/domains/default => generated 199 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:23:21.002567 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d621a2c8-d088-4af8-8ea7-527c0a6f64f0 None None] Authenticating user token {{(pid=207600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:23:21.108916 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d621a2c8-d088-4af8-8ea7-527c0a6f64f0 None None] Validating token access rules against request {{(pid=207600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:23:21.149998 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91494e9f-920f-416a-812b-e1a4c3692e9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:23:21.150630 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91494e9f-920f-416a-812b-e1a4c3692e9c None admin] REQUEST_METHOD: `POST` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:23:21.150920 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91494e9f-920f-416a-812b-e1a4c3692e9c None admin] SCRIPT_NAME: `/identity` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:23:21.151197 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91494e9f-920f-416a-812b-e1a4c3692e9c None admin] PATH_INFO: `/v3/users` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:23:21.151906 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91494e9f-920f-416a-812b-e1a4c3692e9c None admin] RBAC: Authorizing `identity:create_user()` {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:23:21.153438 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91494e9f-920f-416a-812b-e1a4c3692e9c None admin] RBAC: Authorization granted {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:23:21.181381 dv-cinder-851351-1-smb devstack@keystone.service[207600]: [pid: 207600|app: 0|req: 31/61] 10.222.0.42 () {60 vars in 1132 bytes} [Thu Jul 28 08:23:21 2022] POST /identity/v3/users => generated 275 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 08:23:24.180127 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6580b313-719b-4882-bbd6-1cc1521c0e08 None None] REQUEST_METHOD: `GET` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:23:24.181098 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6580b313-719b-4882-bbd6-1cc1521c0e08 None None] SCRIPT_NAME: `/identity` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:23:24.181591 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6580b313-719b-4882-bbd6-1cc1521c0e08 None None] PATH_INFO: `/` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:23:24.183188 dv-cinder-851351-1-smb devstack@keystone.service[207601]: [pid: 207601|app: 0|req: 31/62] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 08:23:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 08:23:24.188781 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a002ed-125b-41b8-ba16-6b275538835e None None] REQUEST_METHOD: `POST` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:23:24.189594 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a002ed-125b-41b8-ba16-6b275538835e None None] SCRIPT_NAME: `/identity` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:23:24.190059 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a002ed-125b-41b8-ba16-6b275538835e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:23:24.217760 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.auth.core [None req-67a002ed-125b-41b8-ba16-6b275538835e None None] MFA Rules not processed for user `b8110ade874c4aa7af27f5c376df700a`. Rule list: `[]` (Enabled: `True`). {{(pid=207600) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 08:23:24.219345 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.fernet_utils [None req-67a002ed-125b-41b8-ba16-6b275538835e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=207600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:23:24.238690 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG dbcounter [-] [207600] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=207600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:23:24.323225 dv-cinder-851351-1-smb devstack@keystone.service[207600]: [pid: 207600|app: 0|req: 32/63] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 08:23:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 08:23:24.362707 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6580b313-719b-4882-bbd6-1cc1521c0e08 None None] Authenticating user token {{(pid=207601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:23:24.505826 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6580b313-719b-4882-bbd6-1cc1521c0e08 None None] Validating token access rules against request {{(pid=207601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:23:24.554737 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34583246-d20f-4b90-a198-b438104b9c42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:23:24.555776 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34583246-d20f-4b90-a198-b438104b9c42 None admin] REQUEST_METHOD: `GET` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:23:24.556254 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34583246-d20f-4b90-a198-b438104b9c42 None admin] SCRIPT_NAME: `/identity` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:23:24.556746 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34583246-d20f-4b90-a198-b438104b9c42 None admin] PATH_INFO: `/v3/roles/member` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:23:24.577764 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34583246-d20f-4b90-a198-b438104b9c42 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 08:23:24.583317 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application [None req-34583246-d20f-4b90-a198-b438104b9c42 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 28 08:23:24.583317 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:23:24.583317 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:23:24.583317 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:23:24.583317 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:23:24.583317 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:23:24.583317 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:23:24.583317 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:23:24.583317 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:23:24.583317 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:23:24.583317 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:23:24.583317 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:23:24.583317 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 08:23:24.583317 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 08:23:24.583317 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 08:23:24.583317 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 08:23:24.584340 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 08:23:24.584340 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 08:23:24.584340 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 08:23:24.584340 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 08:23:24.584340 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:23:24.584340 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:23:24.584340 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:23:24.584340 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:23:24.584340 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:23:24.584340 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:23:24.584340 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:23:24.584340 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application with Lock( Jul 28 08:23:24.584340 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:23:24.584340 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:23:24.584340 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:23:24.584340 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:23:24.585258 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:23:24.585258 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:23:24.585258 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:23:24.585258 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:23:24.585258 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 08:23:24.585258 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 08:23:24.585258 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 08:23:24.585258 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 08:23:24.585258 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 08:23:24.585258 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 08:23:24.585258 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 28 08:23:24.585258 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application Jul 28 08:23:24.587844 dv-cinder-851351-1-smb devstack@keystone.service[207601]: [pid: 207601|app: 0|req: 32/64] 10.222.0.42 () {56 vars in 1099 bytes} [Thu Jul 28 08:23:24 2022] GET /identity/v3/roles/member => generated 84 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:23:24.594619 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a002ed-125b-41b8-ba16-6b275538835e None None] Authenticating user token {{(pid=207600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:23:24.614708 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebd84f3-2ddc-4b18-8a3f-81c5e5554eed None None] REQUEST_METHOD: `GET` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:23:24.615085 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebd84f3-2ddc-4b18-8a3f-81c5e5554eed None None] SCRIPT_NAME: `/identity` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:23:24.615288 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebd84f3-2ddc-4b18-8a3f-81c5e5554eed None None] PATH_INFO: `/` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:23:24.616720 dv-cinder-851351-1-smb devstack@keystone.service[207601]: [pid: 207601|app: 0|req: 33/65] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 08:23:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 28 08:23:24.617779 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99218f57-3254-4197-aa07-daccfcf60c57 None None] REQUEST_METHOD: `GET` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:23:24.618078 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99218f57-3254-4197-aa07-daccfcf60c57 None None] SCRIPT_NAME: `/identity` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:23:24.618357 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99218f57-3254-4197-aa07-daccfcf60c57 None None] PATH_INFO: `/` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:23:24.619703 dv-cinder-851351-1-smb devstack@keystone.service[207601]: [pid: 207601|app: 0|req: 34/66] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 08:23:24 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 08:23:24.625298 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e670b201-507a-4439-aec1-73cf7b5ceea6 None None] REQUEST_METHOD: `POST` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:23:24.625812 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e670b201-507a-4439-aec1-73cf7b5ceea6 None None] SCRIPT_NAME: `/identity` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:23:24.626257 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e670b201-507a-4439-aec1-73cf7b5ceea6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:23:24.644873 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.auth.core [None req-e670b201-507a-4439-aec1-73cf7b5ceea6 None None] MFA Rules not processed for user `b8110ade874c4aa7af27f5c376df700a`. Rule list: `[]` (Enabled: `True`). {{(pid=207601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 08:23:24.646391 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.fernet_utils [None req-e670b201-507a-4439-aec1-73cf7b5ceea6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=207601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:23:24.657294 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG dbcounter [-] [207601] Writing DB stats keystone:SELECT=100 {{(pid=207601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:23:24.714375 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a002ed-125b-41b8-ba16-6b275538835e None None] Validating token access rules against request {{(pid=207600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:23:24.720840 dv-cinder-851351-1-smb devstack@keystone.service[207601]: [pid: 207601|app: 0|req: 35/67] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 08:23:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 28 08:23:24.728685 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ff58d4-5494-45f6-b464-ae268a564ce3 None None] REQUEST_METHOD: `POST` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:23:24.729500 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ff58d4-5494-45f6-b464-ae268a564ce3 None None] SCRIPT_NAME: `/identity` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:23:24.730094 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ff58d4-5494-45f6-b464-ae268a564ce3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:23:24.751091 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb06019-2f9f-41b4-873e-51cd611e503d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:23:24.752119 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb06019-2f9f-41b4-873e-51cd611e503d None admin] REQUEST_METHOD: `GET` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:23:24.752630 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb06019-2f9f-41b4-873e-51cd611e503d None admin] SCRIPT_NAME: `/identity` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:23:24.753161 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb06019-2f9f-41b4-873e-51cd611e503d None admin] PATH_INFO: `/v3/roles` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:23:24.754124 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fb06019-2f9f-41b4-873e-51cd611e503d None admin] RBAC: Adding query filter params (name=member) {{(pid=207600) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:23:24.754668 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fb06019-2f9f-41b4-873e-51cd611e503d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:23:24.756370 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fb06019-2f9f-41b4-873e-51cd611e503d None admin] RBAC: Authorization granted {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:23:24.761776 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.auth.core [None req-e5ff58d4-5494-45f6-b464-ae268a564ce3 None None] MFA Rules not processed for user `b8110ade874c4aa7af27f5c376df700a`. Rule list: `[]` (Enabled: `True`). {{(pid=207601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 08:23:24.763136 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.fernet_utils [None req-e5ff58d4-5494-45f6-b464-ae268a564ce3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=207601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:23:24.766686 dv-cinder-851351-1-smb devstack@keystone.service[207600]: [pid: 207600|app: 0|req: 33/68] 10.222.0.42 () {56 vars in 1101 bytes} [Thu Jul 28 08:23:24 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:23:24.768847 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb06019-2f9f-41b4-873e-51cd611e503d None admin] Authenticating user token {{(pid=207600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:23:24.789038 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG dbcounter [-] [207600] Writing DB stats keystone:SELECT=100 {{(pid=207600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:23:24.848065 dv-cinder-851351-1-smb devstack@keystone.service[207601]: [pid: 207601|app: 0|req: 36/69] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 08:23:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 08:23:24.848822 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ff58d4-5494-45f6-b464-ae268a564ce3 None None] Authenticating user token {{(pid=207601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:23:24.909555 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb06019-2f9f-41b4-873e-51cd611e503d None admin] Validating token access rules against request {{(pid=207600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:23:24.944397 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG dbcounter [-] [207601] Writing DB stats keystone:SELECT=100 {{(pid=207601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:23:24.948363 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c16d60-b182-4c7c-a74c-9e5ed3eec866 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:23:24.949083 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c16d60-b182-4c7c-a74c-9e5ed3eec866 None admin] REQUEST_METHOD: `GET` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:23:24.949372 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c16d60-b182-4c7c-a74c-9e5ed3eec866 None admin] SCRIPT_NAME: `/identity` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:23:24.949648 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c16d60-b182-4c7c-a74c-9e5ed3eec866 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:23:24.960233 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c16d60-b182-4c7c-a74c-9e5ed3eec866 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 08:23:24.966246 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application [None req-55c16d60-b182-4c7c-a74c-9e5ed3eec866 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 08:23:24.966246 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:23:24.966246 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:23:24.966246 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:23:24.966246 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:23:24.966246 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:23:24.966246 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:23:24.966246 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:23:24.966246 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:23:24.966246 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:23:24.966246 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:23:24.966246 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:23:24.966246 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 08:23:24.966246 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 08:23:24.966246 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 08:23:24.966246 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 08:23:24.967474 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 08:23:24.967474 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 08:23:24.967474 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 08:23:24.967474 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 08:23:24.967474 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:23:24.967474 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:23:24.967474 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:23:24.967474 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:23:24.967474 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:23:24.967474 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:23:24.967474 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:23:24.967474 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application with Lock( Jul 28 08:23:24.967474 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:23:24.967474 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:23:24.967474 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:23:24.967474 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:23:24.968562 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:23:24.968562 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:23:24.968562 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:23:24.968562 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:23:24.968562 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 08:23:24.968562 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 08:23:24.968562 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 08:23:24.968562 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 08:23:24.968562 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 08:23:24.968562 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 08:23:24.968562 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 08:23:24.968562 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application Jul 28 08:23:24.968562 dv-cinder-851351-1-smb devstack@keystone.service[207600]: [pid: 207600|app: 0|req: 34/70] 10.222.0.42 () {56 vars in 1096 bytes} [Thu Jul 28 08:23:24 2022] GET /identity/v3/roles/admin => generated 83 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:23:24.968562 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c16d60-b182-4c7c-a74c-9e5ed3eec866 None admin] Authenticating user token {{(pid=207600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:23:24.974722 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ff58d4-5494-45f6-b464-ae268a564ce3 None None] Validating token access rules against request {{(pid=207601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:23:25.011768 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da53cd40-5dbe-4981-8bcb-bd544eff1da7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:23:25.012361 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da53cd40-5dbe-4981-8bcb-bd544eff1da7 None admin] REQUEST_METHOD: `GET` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:23:25.012648 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da53cd40-5dbe-4981-8bcb-bd544eff1da7 None admin] SCRIPT_NAME: `/identity` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:23:25.012963 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da53cd40-5dbe-4981-8bcb-bd544eff1da7 None admin] PATH_INFO: `/v3/users/8c28b8a46b2e45fdbcbb20dfc58d7f41` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:23:25.028592 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da53cd40-5dbe-4981-8bcb-bd544eff1da7 None admin] RBAC: Authorizing `identity:get_user(user_id=8c28b8a46b2e45fdbcbb20dfc58d7f41)` {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:23:25.030188 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da53cd40-5dbe-4981-8bcb-bd544eff1da7 None admin] RBAC: Authorization granted {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:23:25.031922 dv-cinder-851351-1-smb devstack@keystone.service[207601]: [pid: 207601|app: 0|req: 37/71] 10.222.0.42 () {56 vars in 1177 bytes} [Thu Jul 28 08:23:24 2022] GET /identity/v3/users/8c28b8a46b2e45fdbcbb20dfc58d7f41 => generated 275 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:23:25.033169 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce9976c-4244-4cec-a490-42ef50b38597 None None] REQUEST_METHOD: `GET` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:23:25.033463 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce9976c-4244-4cec-a490-42ef50b38597 None None] SCRIPT_NAME: `/identity` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:23:25.033746 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce9976c-4244-4cec-a490-42ef50b38597 None None] PATH_INFO: `/` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:23:25.034968 dv-cinder-851351-1-smb devstack@keystone.service[207601]: [pid: 207601|app: 0|req: 38/72] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 08:23:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 08:23:25.036002 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e42091-70c6-4edc-bb63-1c9871ada82e None None] REQUEST_METHOD: `GET` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:23:25.036358 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e42091-70c6-4edc-bb63-1c9871ada82e None None] SCRIPT_NAME: `/identity` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:23:25.036899 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e42091-70c6-4edc-bb63-1c9871ada82e None None] PATH_INFO: `/` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:23:25.038266 dv-cinder-851351-1-smb devstack@keystone.service[207601]: [pid: 207601|app: 0|req: 39/73] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 08:23:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 08:23:25.038836 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e42091-70c6-4edc-bb63-1c9871ada82e None None] Authenticating user token {{(pid=207601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:23:25.051865 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG dbcounter [-] [207600] Writing DB stats keystone:SELECT=100 {{(pid=207600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:23:25.076073 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c16d60-b182-4c7c-a74c-9e5ed3eec866 None admin] Validating token access rules against request {{(pid=207600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:23:25.112544 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fea2502-380c-48be-b56c-c0d43bd8b502 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:23:25.113229 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fea2502-380c-48be-b56c-c0d43bd8b502 None admin] REQUEST_METHOD: `GET` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:23:25.113520 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fea2502-380c-48be-b56c-c0d43bd8b502 None admin] SCRIPT_NAME: `/identity` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:23:25.113800 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fea2502-380c-48be-b56c-c0d43bd8b502 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:23:25.124235 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fea2502-380c-48be-b56c-c0d43bd8b502 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 08:23:25.129784 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application [None req-6fea2502-380c-48be-b56c-c0d43bd8b502 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 28 08:23:25.129784 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:23:25.129784 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:23:25.129784 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:23:25.129784 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:23:25.129784 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:23:25.129784 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:23:25.129784 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:23:25.129784 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:23:25.129784 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:23:25.129784 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:23:25.129784 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:23:25.129784 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 08:23:25.129784 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 08:23:25.129784 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 08:23:25.129784 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 08:23:25.130961 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 08:23:25.130961 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 08:23:25.130961 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 08:23:25.130961 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 08:23:25.130961 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:23:25.130961 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:23:25.130961 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:23:25.130961 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:23:25.130961 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:23:25.130961 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:23:25.130961 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:23:25.130961 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application with Lock( Jul 28 08:23:25.130961 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:23:25.130961 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:23:25.130961 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:23:25.130961 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:23:25.132113 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:23:25.132113 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:23:25.132113 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:23:25.132113 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:23:25.132113 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 08:23:25.132113 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 08:23:25.132113 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 08:23:25.132113 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 08:23:25.132113 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 08:23:25.132113 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 08:23:25.132113 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 28 08:23:25.132113 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application Jul 28 08:23:25.132113 dv-cinder-851351-1-smb devstack@keystone.service[207600]: [pid: 207600|app: 0|req: 35/74] 10.222.0.42 () {56 vars in 1114 bytes} [Thu Jul 28 08:23:24 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:23:25.136643 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fea2502-380c-48be-b56c-c0d43bd8b502 None admin] Authenticating user token {{(pid=207600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:23:25.146977 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e42091-70c6-4edc-bb63-1c9871ada82e None None] Validating token access rules against request {{(pid=207601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:23:25.176536 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG dbcounter [-] [207601] Writing DB stats keystone:SELECT=100 {{(pid=207601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:23:25.182263 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b0c1a59-d7ee-4ac5-b2c2-d3f756605a43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:23:25.182911 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0c1a59-d7ee-4ac5-b2c2-d3f756605a43 None admin] REQUEST_METHOD: `GET` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:23:25.183183 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0c1a59-d7ee-4ac5-b2c2-d3f756605a43 None admin] SCRIPT_NAME: `/identity` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:23:25.183487 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0c1a59-d7ee-4ac5-b2c2-d3f756605a43 None admin] PATH_INFO: `/v3/roles` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:23:25.184230 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b0c1a59-d7ee-4ac5-b2c2-d3f756605a43 None admin] RBAC: Adding query filter params (name=admin) {{(pid=207601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:23:25.184539 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b0c1a59-d7ee-4ac5-b2c2-d3f756605a43 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:23:25.186092 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b0c1a59-d7ee-4ac5-b2c2-d3f756605a43 None admin] RBAC: Authorization granted {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:23:25.194793 dv-cinder-851351-1-smb devstack@keystone.service[207601]: [pid: 207601|app: 0|req: 40/75] 10.222.0.42 () {56 vars in 1099 bytes} [Thu Jul 28 08:23:25 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:23:25.196008 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a627a6f1-b9e7-49f8-9e16-93ed964a9e9d None None] REQUEST_METHOD: `POST` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:23:25.196301 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a627a6f1-b9e7-49f8-9e16-93ed964a9e9d None None] SCRIPT_NAME: `/identity` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:23:25.196826 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a627a6f1-b9e7-49f8-9e16-93ed964a9e9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:23:25.214495 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.auth.core [None req-a627a6f1-b9e7-49f8-9e16-93ed964a9e9d None None] MFA Rules not processed for user `b8110ade874c4aa7af27f5c376df700a`. Rule list: `[]` (Enabled: `True`). {{(pid=207601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 08:23:25.216121 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.fernet_utils [None req-a627a6f1-b9e7-49f8-9e16-93ed964a9e9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=207601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:23:25.240240 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fea2502-380c-48be-b56c-c0d43bd8b502 None admin] Validating token access rules against request {{(pid=207600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:23:25.273453 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbdbe67a-3370-498d-a829-daad9223b53c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:23:25.274014 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbdbe67a-3370-498d-a829-daad9223b53c None admin] REQUEST_METHOD: `GET` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:23:25.274292 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbdbe67a-3370-498d-a829-daad9223b53c None admin] SCRIPT_NAME: `/identity` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:23:25.274573 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbdbe67a-3370-498d-a829-daad9223b53c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:23:25.278123 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG dbcounter [-] [207600] Writing DB stats keystone:SELECT=100 {{(pid=207600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:23:25.286545 dv-cinder-851351-1-smb devstack@keystone.service[207601]: [pid: 207601|app: 0|req: 41/76] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 08:23:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 08:23:25.287844 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0ec3fe-158c-4483-82be-cfa6df41a48e None None] REQUEST_METHOD: `POST` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:23:25.288142 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0ec3fe-158c-4483-82be-cfa6df41a48e None None] SCRIPT_NAME: `/identity` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:23:25.288429 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0ec3fe-158c-4483-82be-cfa6df41a48e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:23:25.306714 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.auth.core [None req-5c0ec3fe-158c-4483-82be-cfa6df41a48e None None] MFA Rules not processed for user `b8110ade874c4aa7af27f5c376df700a`. Rule list: `[]` (Enabled: `True`). {{(pid=207601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 08:23:25.307978 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.fernet_utils [None req-5c0ec3fe-158c-4483-82be-cfa6df41a48e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=207601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:23:25.350901 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbdbe67a-3370-498d-a829-daad9223b53c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:23:25.352423 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbdbe67a-3370-498d-a829-daad9223b53c None admin] RBAC: Authorization granted {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:23:25.376871 dv-cinder-851351-1-smb devstack@keystone.service[207601]: [pid: 207601|app: 0|req: 42/77] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 08:23:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 08:23:25.377614 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0ec3fe-158c-4483-82be-cfa6df41a48e None None] Authenticating user token {{(pid=207601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:23:25.434737 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG dbcounter [-] [207601] Writing DB stats keystone:SELECT=100 {{(pid=207601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:23:25.455032 dv-cinder-851351-1-smb devstack@keystone.service[207600]: [pid: 207600|app: 0|req: 36/78] 10.222.0.42 () {58 vars in 1282 bytes} [Thu Jul 28 08:23:25 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 28 08:23:25.455911 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbdbe67a-3370-498d-a829-daad9223b53c None admin] Authenticating user token {{(pid=207600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:23:25.482249 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0ec3fe-158c-4483-82be-cfa6df41a48e None None] Validating token access rules against request {{(pid=207601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:23:25.495197 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG dbcounter [-] [207600] Writing DB stats keystone:SELECT=100 {{(pid=207600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:23:25.518595 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03d5e6b-514d-404b-a83c-35b8cf578de9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:23:25.519248 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03d5e6b-514d-404b-a83c-35b8cf578de9 None admin] REQUEST_METHOD: `GET` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:23:25.519535 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03d5e6b-514d-404b-a83c-35b8cf578de9 None admin] SCRIPT_NAME: `/identity` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:23:25.519813 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03d5e6b-514d-404b-a83c-35b8cf578de9 None admin] PATH_INFO: `/v3/roles` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:23:25.520552 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e03d5e6b-514d-404b-a83c-35b8cf578de9 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=207601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:23:25.520901 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e03d5e6b-514d-404b-a83c-35b8cf578de9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:23:25.522317 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e03d5e6b-514d-404b-a83c-35b8cf578de9 None admin] RBAC: Authorization granted {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:23:25.531538 dv-cinder-851351-1-smb devstack@keystone.service[207601]: [pid: 207601|app: 0|req: 43/79] 10.222.0.42 () {56 vars in 1111 bytes} [Thu Jul 28 08:23:25 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:23:25.533483 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03d5e6b-514d-404b-a83c-35b8cf578de9 None admin] Authenticating user token {{(pid=207601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:23:25.563153 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbdbe67a-3370-498d-a829-daad9223b53c None admin] Validating token access rules against request {{(pid=207600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:23:25.599687 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f12a0b-276b-47c6-949b-63e7544833e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:23:25.600430 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f12a0b-276b-47c6-949b-63e7544833e1 None admin] REQUEST_METHOD: `GET` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:23:25.600752 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f12a0b-276b-47c6-949b-63e7544833e1 None admin] SCRIPT_NAME: `/identity` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:23:25.601035 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f12a0b-276b-47c6-949b-63e7544833e1 None admin] PATH_INFO: `/v3/users/b8110ade874c4aa7af27f5c376df700a` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:23:25.602272 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5f12a0b-276b-47c6-949b-63e7544833e1 None admin] RBAC: Authorizing `identity:get_user(user_id=b8110ade874c4aa7af27f5c376df700a)` {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:23:25.603781 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5f12a0b-276b-47c6-949b-63e7544833e1 None admin] RBAC: Authorization granted {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:23:25.605463 dv-cinder-851351-1-smb devstack@keystone.service[207600]: [pid: 207600|app: 0|req: 37/80] 10.222.0.42 () {56 vars in 1177 bytes} [Thu Jul 28 08:23:25 2022] GET /identity/v3/users/b8110ade874c4aa7af27f5c376df700a => generated 247 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:23:25.606239 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f12a0b-276b-47c6-949b-63e7544833e1 None admin] Authenticating user token {{(pid=207600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:23:25.635369 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03d5e6b-514d-404b-a83c-35b8cf578de9 None admin] Validating token access rules against request {{(pid=207601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:23:25.651861 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG dbcounter [-] [207601] Writing DB stats keystone:SELECT=100 {{(pid=207601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:23:25.671898 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a5c772f-78dd-4386-9bfb-3f9da65f4b41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:23:25.672565 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5c772f-78dd-4386-9bfb-3f9da65f4b41 None admin] REQUEST_METHOD: `GET` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:23:25.672879 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5c772f-78dd-4386-9bfb-3f9da65f4b41 None admin] SCRIPT_NAME: `/identity` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:23:25.673161 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5c772f-78dd-4386-9bfb-3f9da65f4b41 None admin] PATH_INFO: `/v3/roles/member` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:23:25.684024 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a5c772f-78dd-4386-9bfb-3f9da65f4b41 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 08:23:25.689524 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application [None req-2a5c772f-78dd-4386-9bfb-3f9da65f4b41 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 28 08:23:25.689524 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:23:25.689524 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:23:25.689524 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:23:25.689524 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:23:25.689524 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:23:25.689524 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:23:25.689524 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:23:25.689524 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:23:25.689524 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:23:25.689524 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:23:25.689524 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:23:25.689524 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 08:23:25.689524 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 08:23:25.689524 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 08:23:25.689524 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 08:23:25.690522 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 08:23:25.690522 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 08:23:25.690522 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 08:23:25.690522 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 08:23:25.690522 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:23:25.690522 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:23:25.690522 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:23:25.690522 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:23:25.690522 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:23:25.690522 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:23:25.690522 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:23:25.690522 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application with Lock( Jul 28 08:23:25.690522 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:23:25.690522 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:23:25.690522 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:23:25.690522 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:23:25.691419 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:23:25.691419 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:23:25.691419 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:23:25.691419 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:23:25.691419 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 08:23:25.691419 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 08:23:25.691419 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 08:23:25.691419 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 08:23:25.691419 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 08:23:25.691419 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 08:23:25.691419 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 28 08:23:25.691419 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application Jul 28 08:23:25.691419 dv-cinder-851351-1-smb devstack@keystone.service[207601]: [pid: 207601|app: 0|req: 44/81] 10.222.0.42 () {56 vars in 1099 bytes} [Thu Jul 28 08:23:25 2022] GET /identity/v3/roles/member => generated 84 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:23:25.692150 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a5c772f-78dd-4386-9bfb-3f9da65f4b41 None admin] Authenticating user token {{(pid=207601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:23:25.712815 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f12a0b-276b-47c6-949b-63e7544833e1 None admin] Validating token access rules against request {{(pid=207600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:23:25.715541 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG dbcounter [-] [207600] Writing DB stats keystone:SELECT=100 {{(pid=207600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:23:25.748438 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d29719f-6721-47c4-8bec-8e5ffaf717f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:23:25.749133 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d29719f-6721-47c4-8bec-8e5ffaf717f9 None admin] REQUEST_METHOD: `GET` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:23:25.749422 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d29719f-6721-47c4-8bec-8e5ffaf717f9 None admin] SCRIPT_NAME: `/identity` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:23:25.749701 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d29719f-6721-47c4-8bec-8e5ffaf717f9 None admin] PATH_INFO: `/v3/domains/default` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:23:25.750897 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d29719f-6721-47c4-8bec-8e5ffaf717f9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:23:25.752361 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d29719f-6721-47c4-8bec-8e5ffaf717f9 None admin] RBAC: Authorization granted {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:23:25.754003 dv-cinder-851351-1-smb devstack@keystone.service[207600]: [pid: 207600|app: 0|req: 38/82] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 08:23:25 2022] GET /identity/v3/domains/default => generated 199 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:23:25.754861 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d29719f-6721-47c4-8bec-8e5ffaf717f9 None admin] Authenticating user token {{(pid=207600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:23:25.794374 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a5c772f-78dd-4386-9bfb-3f9da65f4b41 None admin] Validating token access rules against request {{(pid=207601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:23:25.827382 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e1173e1-7b88-462f-94cd-04081b747a89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:23:25.828046 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1173e1-7b88-462f-94cd-04081b747a89 None admin] REQUEST_METHOD: `GET` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:23:25.828332 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1173e1-7b88-462f-94cd-04081b747a89 None admin] SCRIPT_NAME: `/identity` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:23:25.828608 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1173e1-7b88-462f-94cd-04081b747a89 None admin] PATH_INFO: `/v3/projects/4a64079f46494355a0aa3aafd9a90c0c` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:23:25.829835 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e1173e1-7b88-462f-94cd-04081b747a89 None admin] RBAC: Authorizing `identity:get_project(project_id=4a64079f46494355a0aa3aafd9a90c0c)` {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:23:25.831296 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e1173e1-7b88-462f-94cd-04081b747a89 None admin] RBAC: Authorization granted {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:23:25.833015 dv-cinder-851351-1-smb devstack@keystone.service[207601]: [pid: 207601|app: 0|req: 45/83] 10.222.0.42 () {56 vars in 1186 bytes} [Thu Jul 28 08:23:25 2022] GET /identity/v3/projects/4a64079f46494355a0aa3aafd9a90c0c => generated 298 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:23:25.833790 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e1173e1-7b88-462f-94cd-04081b747a89 None admin] Authenticating user token {{(pid=207601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:23:25.857887 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d29719f-6721-47c4-8bec-8e5ffaf717f9 None admin] Validating token access rules against request {{(pid=207600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:23:25.879684 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG dbcounter [-] [207601] Writing DB stats keystone:SELECT=100 {{(pid=207601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:23:25.895663 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae833926-da2f-4137-a0f0-63f7f4a44944 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:23:25.896620 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae833926-da2f-4137-a0f0-63f7f4a44944 None admin] REQUEST_METHOD: `GET` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:23:25.897178 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae833926-da2f-4137-a0f0-63f7f4a44944 None admin] SCRIPT_NAME: `/identity` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:23:25.897456 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae833926-da2f-4137-a0f0-63f7f4a44944 None admin] PATH_INFO: `/v3/users/8c28b8a46b2e45fdbcbb20dfc58d7f41` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:23:25.898702 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae833926-da2f-4137-a0f0-63f7f4a44944 None admin] RBAC: Authorizing `identity:get_user(user_id=8c28b8a46b2e45fdbcbb20dfc58d7f41)` {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:23:25.900296 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae833926-da2f-4137-a0f0-63f7f4a44944 None admin] RBAC: Authorization granted {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:23:25.901957 dv-cinder-851351-1-smb devstack@keystone.service[207600]: [pid: 207600|app: 0|req: 39/84] 10.222.0.42 () {56 vars in 1177 bytes} [Thu Jul 28 08:23:25 2022] GET /identity/v3/users/8c28b8a46b2e45fdbcbb20dfc58d7f41 => generated 275 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:23:25.902733 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae833926-da2f-4137-a0f0-63f7f4a44944 None admin] Authenticating user token {{(pid=207600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:23:25.940285 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e1173e1-7b88-462f-94cd-04081b747a89 None admin] Validating token access rules against request {{(pid=207601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:23:25.944269 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG dbcounter [-] [207600] Writing DB stats keystone:SELECT=100 {{(pid=207600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:23:25.977696 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5de7aa3-057b-4568-a40d-0c8f3d137b4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:23:25.978340 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5de7aa3-057b-4568-a40d-0c8f3d137b4c None admin] REQUEST_METHOD: `GET` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:23:25.978657 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5de7aa3-057b-4568-a40d-0c8f3d137b4c None admin] SCRIPT_NAME: `/identity` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:23:25.978930 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5de7aa3-057b-4568-a40d-0c8f3d137b4c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:23:26.003200 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae833926-da2f-4137-a0f0-63f7f4a44944 None admin] Validating token access rules against request {{(pid=207600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:23:26.035955 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56315b5-abe1-424f-a85b-e4b731b264e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:23:26.036581 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56315b5-abe1-424f-a85b-e4b731b264e4 None admin] REQUEST_METHOD: `GET` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:23:26.036893 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56315b5-abe1-424f-a85b-e4b731b264e4 None admin] SCRIPT_NAME: `/identity` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:23:26.037173 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56315b5-abe1-424f-a85b-e4b731b264e4 None admin] PATH_INFO: `/v3/roles` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:23:26.037904 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a56315b5-abe1-424f-a85b-e4b731b264e4 None admin] RBAC: Adding query filter params (name=member) {{(pid=207600) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:23:26.038213 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a56315b5-abe1-424f-a85b-e4b731b264e4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:23:26.039638 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a56315b5-abe1-424f-a85b-e4b731b264e4 None admin] RBAC: Authorization granted {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:23:26.046447 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5de7aa3-057b-4568-a40d-0c8f3d137b4c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:23:26.047703 dv-cinder-851351-1-smb devstack@keystone.service[207600]: [pid: 207600|app: 0|req: 40/85] 10.222.0.42 () {56 vars in 1101 bytes} [Thu Jul 28 08:23:25 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:23:26.052690 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5de7aa3-057b-4568-a40d-0c8f3d137b4c None admin] RBAC: Authorization granted {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:23:26.052810 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56315b5-abe1-424f-a85b-e4b731b264e4 None admin] Authenticating user token {{(pid=207600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:23:26.097193 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG dbcounter [-] [207601] Writing DB stats keystone:SELECT=100 {{(pid=207601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:23:26.151678 dv-cinder-851351-1-smb devstack@keystone.service[207601]: [pid: 207601|app: 0|req: 46/86] 10.222.0.42 () {58 vars in 1282 bytes} [Thu Jul 28 08:23:25 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 28 08:23:26.152550 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5de7aa3-057b-4568-a40d-0c8f3d137b4c None admin] Authenticating user token {{(pid=207601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:23:26.158791 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56315b5-abe1-424f-a85b-e4b731b264e4 None admin] Validating token access rules against request {{(pid=207600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:23:26.160499 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG dbcounter [-] [207600] Writing DB stats keystone:SELECT=100 {{(pid=207600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:23:26.194059 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12bf76e2-1ac4-40b6-b631-f1fcf3e99b29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:23:26.194693 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12bf76e2-1ac4-40b6-b631-f1fcf3e99b29 None admin] REQUEST_METHOD: `POST` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:23:26.194976 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12bf76e2-1ac4-40b6-b631-f1fcf3e99b29 None admin] SCRIPT_NAME: `/identity` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:23:26.195251 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12bf76e2-1ac4-40b6-b631-f1fcf3e99b29 None admin] PATH_INFO: `/v3/users` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:23:26.195946 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12bf76e2-1ac4-40b6-b631-f1fcf3e99b29 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:23:26.197441 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12bf76e2-1ac4-40b6-b631-f1fcf3e99b29 None admin] RBAC: Authorization granted {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:23:26.218512 dv-cinder-851351-1-smb devstack@keystone.service[207600]: [pid: 207600|app: 0|req: 41/87] 10.222.0.42 () {60 vars in 1132 bytes} [Thu Jul 28 08:23:26 2022] POST /identity/v3/users => generated 289 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 08:23:26.219338 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12bf76e2-1ac4-40b6-b631-f1fcf3e99b29 None admin] Authenticating user token {{(pid=207600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:23:26.262786 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5de7aa3-057b-4568-a40d-0c8f3d137b4c None admin] Validating token access rules against request {{(pid=207601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:23:26.305376 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3cd041c-0f1a-4a10-81a5-848eb71872e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:23:26.305952 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3cd041c-0f1a-4a10-81a5-848eb71872e8 None admin] REQUEST_METHOD: `GET` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:23:26.306342 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3cd041c-0f1a-4a10-81a5-848eb71872e8 None admin] SCRIPT_NAME: `/identity` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:23:26.306786 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3cd041c-0f1a-4a10-81a5-848eb71872e8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:23:26.307705 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3cd041c-0f1a-4a10-81a5-848eb71872e8 None admin] RBAC: Adding query filter params (role.id=70a2fd2878c549aeb19b16ec37e37164, scope.project.id=4a64079f46494355a0aa3aafd9a90c0c, user.id=8c28b8a46b2e45fdbcbb20dfc58d7f41) {{(pid=207601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:23:26.308020 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3cd041c-0f1a-4a10-81a5-848eb71872e8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:23:26.309645 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3cd041c-0f1a-4a10-81a5-848eb71872e8 None admin] RBAC: Authorization granted {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:23:26.316285 dv-cinder-851351-1-smb devstack@keystone.service[207601]: [pid: 207601|app: 0|req: 47/88] 10.222.0.42 () {56 vars in 1374 bytes} [Thu Jul 28 08:23:26 2022] GET /identity/v3/role_assignments?user.id=8c28b8a46b2e45fdbcbb20dfc58d7f41&scope.project.id=4a64079f46494355a0aa3aafd9a90c0c&role.id=70a2fd2878c549aeb19b16ec37e37164 => generated 259 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:23:26.317103 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3cd041c-0f1a-4a10-81a5-848eb71872e8 None admin] Authenticating user token {{(pid=207601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:23:26.331271 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG dbcounter [-] [207601] Writing DB stats keystone:SELECT=100 {{(pid=207601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:23:26.360485 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12bf76e2-1ac4-40b6-b631-f1fcf3e99b29 None admin] Validating token access rules against request {{(pid=207600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:23:26.409389 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97628365-6bc7-4142-b4cf-69c79149643b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:23:26.410162 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97628365-6bc7-4142-b4cf-69c79149643b None admin] REQUEST_METHOD: `GET` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:23:26.410456 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97628365-6bc7-4142-b4cf-69c79149643b None admin] SCRIPT_NAME: `/identity` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:23:26.410732 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97628365-6bc7-4142-b4cf-69c79149643b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:23:26.447570 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG dbcounter [-] [207600] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=207600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:23:26.476386 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3cd041c-0f1a-4a10-81a5-848eb71872e8 None admin] Validating token access rules against request {{(pid=207601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:23:26.513830 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97628365-6bc7-4142-b4cf-69c79149643b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:23:26.515764 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97628365-6bc7-4142-b4cf-69c79149643b None admin] RBAC: Authorization granted {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:23:26.528431 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c5b190-ea62-4417-bc24-e570b01216d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:23:26.529198 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c5b190-ea62-4417-bc24-e570b01216d3 None admin] REQUEST_METHOD: `GET` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:23:26.529487 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c5b190-ea62-4417-bc24-e570b01216d3 None admin] SCRIPT_NAME: `/identity` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:23:26.529769 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c5b190-ea62-4417-bc24-e570b01216d3 None admin] PATH_INFO: `/v3/users/8c28b8a46b2e45fdbcbb20dfc58d7f41` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:23:26.530998 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86c5b190-ea62-4417-bc24-e570b01216d3 None admin] RBAC: Authorizing `identity:get_user(user_id=8c28b8a46b2e45fdbcbb20dfc58d7f41)` {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:23:26.532483 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86c5b190-ea62-4417-bc24-e570b01216d3 None admin] RBAC: Authorization granted {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:23:26.534526 dv-cinder-851351-1-smb devstack@keystone.service[207601]: [pid: 207601|app: 0|req: 48/89] 10.222.0.42 () {56 vars in 1177 bytes} [Thu Jul 28 08:23:26 2022] GET /identity/v3/users/8c28b8a46b2e45fdbcbb20dfc58d7f41 => generated 275 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:23:26.535200 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c5b190-ea62-4417-bc24-e570b01216d3 None admin] Authenticating user token {{(pid=207601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:23:26.632417 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG dbcounter [-] [207601] Writing DB stats keystone:SELECT=100 {{(pid=207601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:23:26.667695 dv-cinder-851351-1-smb devstack@keystone.service[207600]: [pid: 207600|app: 0|req: 42/90] 10.222.0.42 () {58 vars in 1282 bytes} [Thu Jul 28 08:23:26 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 444 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 28 08:23:26.667695 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97628365-6bc7-4142-b4cf-69c79149643b None admin] Authenticating user token {{(pid=207600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:23:26.670826 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c5b190-ea62-4417-bc24-e570b01216d3 None admin] Validating token access rules against request {{(pid=207601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:23:26.714144 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc1ac0e-5016-4223-9820-7a76ab9cea3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:23:26.716128 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc1ac0e-5016-4223-9820-7a76ab9cea3f None admin] REQUEST_METHOD: `GET` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:23:26.716471 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc1ac0e-5016-4223-9820-7a76ab9cea3f None admin] SCRIPT_NAME: `/identity` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:23:26.716867 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc1ac0e-5016-4223-9820-7a76ab9cea3f None admin] PATH_INFO: `/v3/projects/4a64079f46494355a0aa3aafd9a90c0c` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:23:26.718145 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfc1ac0e-5016-4223-9820-7a76ab9cea3f None admin] RBAC: Authorizing `identity:get_project(project_id=4a64079f46494355a0aa3aafd9a90c0c)` {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:23:26.719627 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfc1ac0e-5016-4223-9820-7a76ab9cea3f None admin] RBAC: Authorization granted {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:23:26.721605 dv-cinder-851351-1-smb devstack@keystone.service[207601]: [pid: 207601|app: 0|req: 49/91] 10.222.0.42 () {56 vars in 1186 bytes} [Thu Jul 28 08:23:26 2022] GET /identity/v3/projects/4a64079f46494355a0aa3aafd9a90c0c => generated 298 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:23:26.725539 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc1ac0e-5016-4223-9820-7a76ab9cea3f None admin] Authenticating user token {{(pid=207601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:23:26.758374 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG dbcounter [-] [207600] Writing DB stats keystone:SELECT=100 {{(pid=207600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:23:26.810273 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97628365-6bc7-4142-b4cf-69c79149643b None admin] Validating token access rules against request {{(pid=207600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:23:26.851798 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a9c939d-9bfa-4473-93e8-7778186ac26e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:23:26.852762 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9c939d-9bfa-4473-93e8-7778186ac26e None admin] REQUEST_METHOD: `GET` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:23:26.853229 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9c939d-9bfa-4473-93e8-7778186ac26e None admin] SCRIPT_NAME: `/identity` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:23:26.854153 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9c939d-9bfa-4473-93e8-7778186ac26e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:23:26.934521 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a9c939d-9bfa-4473-93e8-7778186ac26e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:23:26.936506 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a9c939d-9bfa-4473-93e8-7778186ac26e None admin] RBAC: Authorization granted {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:23:26.984646 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc1ac0e-5016-4223-9820-7a76ab9cea3f None admin] Validating token access rules against request {{(pid=207601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:23:27.011310 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG dbcounter [-] [207600] Writing DB stats keystone:SELECT=100 {{(pid=207600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:23:27.047210 dv-cinder-851351-1-smb devstack@keystone.service[207600]: [pid: 207600|app: 0|req: 43/92] 10.222.0.42 () {58 vars in 1282 bytes} [Thu Jul 28 08:23:26 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 383 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 28 08:23:27.048540 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a9c939d-9bfa-4473-93e8-7778186ac26e None admin] Authenticating user token {{(pid=207600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:23:27.100387 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fcaaffb-42b0-4a56-9e18-b92104485931 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:23:27.101111 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fcaaffb-42b0-4a56-9e18-b92104485931 None admin] REQUEST_METHOD: `GET` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:23:27.101399 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fcaaffb-42b0-4a56-9e18-b92104485931 None admin] SCRIPT_NAME: `/identity` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:23:27.101682 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fcaaffb-42b0-4a56-9e18-b92104485931 None admin] PATH_INFO: `/v3/projects/4a64079f46494355a0aa3aafd9a90c0c` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:23:27.102876 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fcaaffb-42b0-4a56-9e18-b92104485931 None admin] RBAC: Authorizing `identity:get_project(project_id=4a64079f46494355a0aa3aafd9a90c0c)` {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:23:27.104348 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fcaaffb-42b0-4a56-9e18-b92104485931 None admin] RBAC: Authorization granted {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:23:27.116926 dv-cinder-851351-1-smb devstack@keystone.service[207601]: [pid: 207601|app: 0|req: 50/93] 10.222.0.42 () {56 vars in 1186 bytes} [Thu Jul 28 08:23:26 2022] GET /identity/v3/projects/4a64079f46494355a0aa3aafd9a90c0c => generated 298 bytes in 395 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:23:27.117968 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fcaaffb-42b0-4a56-9e18-b92104485931 None admin] Authenticating user token {{(pid=207601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:23:27.159202 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a9c939d-9bfa-4473-93e8-7778186ac26e None admin] Validating token access rules against request {{(pid=207600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:23:27.166590 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG dbcounter [-] [207601] Writing DB stats keystone:SELECT=100 {{(pid=207601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:23:27.198832 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46ad705-b7d6-469f-9700-13e1c533de4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:23:27.199916 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46ad705-b7d6-469f-9700-13e1c533de4d None admin] REQUEST_METHOD: `GET` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:23:27.200502 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46ad705-b7d6-469f-9700-13e1c533de4d None admin] SCRIPT_NAME: `/identity` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:23:27.201214 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46ad705-b7d6-469f-9700-13e1c533de4d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:23:27.202221 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e46ad705-b7d6-469f-9700-13e1c533de4d None admin] RBAC: Adding query filter params (role.id=d0ce88034c6b41878db755343f5840be, scope.project.id=4a64079f46494355a0aa3aafd9a90c0c, user.id=b8110ade874c4aa7af27f5c376df700a) {{(pid=207600) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:23:27.202743 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e46ad705-b7d6-469f-9700-13e1c533de4d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:23:27.204651 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e46ad705-b7d6-469f-9700-13e1c533de4d None admin] RBAC: Authorization granted {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:23:27.211870 dv-cinder-851351-1-smb devstack@keystone.service[207600]: [pid: 207600|app: 0|req: 44/94] 10.222.0.42 () {56 vars in 1374 bytes} [Thu Jul 28 08:23:27 2022] GET /identity/v3/role_assignments?user.id=b8110ade874c4aa7af27f5c376df700a&scope.project.id=4a64079f46494355a0aa3aafd9a90c0c&role.id=d0ce88034c6b41878db755343f5840be => generated 259 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:23:27.217438 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46ad705-b7d6-469f-9700-13e1c533de4d None admin] Authenticating user token {{(pid=207600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:23:27.264218 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG dbcounter [-] [207600] Writing DB stats keystone:SELECT=100 {{(pid=207600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:23:27.417086 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46ad705-b7d6-469f-9700-13e1c533de4d None admin] Validating token access rules against request {{(pid=207600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:23:27.479729 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fcaaffb-42b0-4a56-9e18-b92104485931 None admin] Validating token access rules against request {{(pid=207601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:23:27.486360 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1de88da-b0e1-48b9-a4fa-a4177ab74d65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:23:27.487072 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1de88da-b0e1-48b9-a4fa-a4177ab74d65 None admin] REQUEST_METHOD: `GET` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:23:27.487366 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1de88da-b0e1-48b9-a4fa-a4177ab74d65 None admin] SCRIPT_NAME: `/identity` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:23:27.487644 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1de88da-b0e1-48b9-a4fa-a4177ab74d65 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:23:27.488480 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1de88da-b0e1-48b9-a4fa-a4177ab74d65 None admin] RBAC: Adding query filter params (role.id=e617201b25d44cb1844c9f28bcac91fb, scope.project.id=4a64079f46494355a0aa3aafd9a90c0c, user.id=8c28b8a46b2e45fdbcbb20dfc58d7f41) {{(pid=207600) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:23:27.488836 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1de88da-b0e1-48b9-a4fa-a4177ab74d65 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:23:27.490367 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1de88da-b0e1-48b9-a4fa-a4177ab74d65 None admin] RBAC: Authorization granted {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:23:27.501979 dv-cinder-851351-1-smb devstack@keystone.service[207600]: [pid: 207600|app: 0|req: 45/95] 10.222.0.42 () {56 vars in 1374 bytes} [Thu Jul 28 08:23:27 2022] GET /identity/v3/role_assignments?user.id=8c28b8a46b2e45fdbcbb20dfc58d7f41&scope.project.id=4a64079f46494355a0aa3aafd9a90c0c&role.id=e617201b25d44cb1844c9f28bcac91fb => generated 259 bytes in 289 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:23:27.555260 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f397f54-5f3c-4e04-90ba-752821cc84bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:23:27.556375 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f397f54-5f3c-4e04-90ba-752821cc84bb None admin] REQUEST_METHOD: `GET` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:23:27.556927 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f397f54-5f3c-4e04-90ba-752821cc84bb None admin] SCRIPT_NAME: `/identity` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:23:27.557425 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f397f54-5f3c-4e04-90ba-752821cc84bb None admin] PATH_INFO: `/v3/projects/c929b0da67274d9a84f2281af295d8ed` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:23:27.558867 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f397f54-5f3c-4e04-90ba-752821cc84bb None admin] RBAC: Authorizing `identity:get_project(project_id=c929b0da67274d9a84f2281af295d8ed)` {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:23:27.560724 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f397f54-5f3c-4e04-90ba-752821cc84bb None admin] RBAC: Authorization granted {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:23:27.563179 dv-cinder-851351-1-smb devstack@keystone.service[207601]: [pid: 207601|app: 0|req: 51/96] 10.222.0.42 () {56 vars in 1186 bytes} [Thu Jul 28 08:23:27 2022] GET /identity/v3/projects/c929b0da67274d9a84f2281af295d8ed => generated 312 bytes in 446 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:23:27.569482 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1de88da-b0e1-48b9-a4fa-a4177ab74d65 None admin] Authenticating user token {{(pid=207600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:23:27.692078 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG dbcounter [-] [207600] Writing DB stats keystone:SELECT=100 {{(pid=207600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:23:27.710022 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1de88da-b0e1-48b9-a4fa-a4177ab74d65 None admin] Validating token access rules against request {{(pid=207600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:23:27.761943 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88de5c17-06af-41c4-a45a-4375803cce52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:23:27.762594 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88de5c17-06af-41c4-a45a-4375803cce52 None admin] REQUEST_METHOD: `GET` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:23:27.762886 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88de5c17-06af-41c4-a45a-4375803cce52 None admin] SCRIPT_NAME: `/identity` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:23:27.763171 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88de5c17-06af-41c4-a45a-4375803cce52 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:23:27.764059 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88de5c17-06af-41c4-a45a-4375803cce52 None admin] RBAC: Adding query filter params (role.id=70a2fd2878c549aeb19b16ec37e37164, scope.project.id=c929b0da67274d9a84f2281af295d8ed, user.id=8c28b8a46b2e45fdbcbb20dfc58d7f41) {{(pid=207600) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:23:27.764380 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88de5c17-06af-41c4-a45a-4375803cce52 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:23:27.768017 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88de5c17-06af-41c4-a45a-4375803cce52 None admin] RBAC: Authorization granted {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:23:27.779983 dv-cinder-851351-1-smb devstack@keystone.service[207600]: [pid: 207600|app: 0|req: 46/97] 10.222.0.42 () {56 vars in 1374 bytes} [Thu Jul 28 08:23:27 2022] GET /identity/v3/role_assignments?user.id=8c28b8a46b2e45fdbcbb20dfc58d7f41&scope.project.id=c929b0da67274d9a84f2281af295d8ed&role.id=70a2fd2878c549aeb19b16ec37e37164 => generated 259 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 08:23:28.807248 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2038829e-7094-4826-a632-ffd524d24a95 None None] REQUEST_METHOD: `GET` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:23:28.808341 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2038829e-7094-4826-a632-ffd524d24a95 None None] SCRIPT_NAME: `/identity` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:23:28.808930 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2038829e-7094-4826-a632-ffd524d24a95 None None] PATH_INFO: `/` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:23:28.810700 dv-cinder-851351-1-smb devstack@keystone.service[207601]: [pid: 207601|app: 0|req: 52/98] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 08:23:28 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 08:23:28.816716 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f0e2e2-885a-43a4-b635-c0e15594b34d None None] REQUEST_METHOD: `POST` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:23:28.817665 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f0e2e2-885a-43a4-b635-c0e15594b34d None None] SCRIPT_NAME: `/identity` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:23:28.818162 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f0e2e2-885a-43a4-b635-c0e15594b34d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:23:28.837387 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.auth.core [None req-57f0e2e2-885a-43a4-b635-c0e15594b34d None None] MFA Rules not processed for user `b8110ade874c4aa7af27f5c376df700a`. Rule list: `[]` (Enabled: `True`). {{(pid=207600) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 08:23:28.838979 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.fernet_utils [None req-57f0e2e2-885a-43a4-b635-c0e15594b34d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=207600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:23:28.912707 dv-cinder-851351-1-smb devstack@keystone.service[207600]: [pid: 207600|app: 0|req: 47/99] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 08:23:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 08:23:28.935962 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2038829e-7094-4826-a632-ffd524d24a95 None None] Authenticating user token {{(pid=207601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:23:29.020715 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b3dc2d-e61c-4186-a9aa-bd0a66315d2d None None] REQUEST_METHOD: `GET` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:23:29.020715 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b3dc2d-e61c-4186-a9aa-bd0a66315d2d None None] SCRIPT_NAME: `/identity` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:23:29.021038 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b3dc2d-e61c-4186-a9aa-bd0a66315d2d None None] PATH_INFO: `/` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:23:29.022655 dv-cinder-851351-1-smb devstack@keystone.service[207600]: [pid: 207600|app: 0|req: 48/100] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 08:23:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 08:23:29.027831 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed44b4b0-0c41-4344-bd75-53f6b4e7d1aa None None] REQUEST_METHOD: `POST` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:23:29.028116 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed44b4b0-0c41-4344-bd75-53f6b4e7d1aa None None] SCRIPT_NAME: `/identity` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:23:29.028393 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed44b4b0-0c41-4344-bd75-53f6b4e7d1aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:23:29.055298 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.auth.core [None req-ed44b4b0-0c41-4344-bd75-53f6b4e7d1aa None None] MFA Rules not processed for user `b8110ade874c4aa7af27f5c376df700a`. Rule list: `[]` (Enabled: `True`). {{(pid=207600) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 08:23:29.056528 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.fernet_utils [None req-ed44b4b0-0c41-4344-bd75-53f6b4e7d1aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=207600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:23:29.069157 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG dbcounter [-] [207601] Writing DB stats keystone:SELECT=100 {{(pid=207601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:23:29.106681 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2038829e-7094-4826-a632-ffd524d24a95 None None] Validating token access rules against request {{(pid=207601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:23:29.176363 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd67a4e-b545-45b6-acc8-dc8919679ff3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:23:29.177070 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd67a4e-b545-45b6-acc8-dc8919679ff3 None admin] REQUEST_METHOD: `GET` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:23:29.177357 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd67a4e-b545-45b6-acc8-dc8919679ff3 None admin] SCRIPT_NAME: `/identity` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:23:29.177639 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd67a4e-b545-45b6-acc8-dc8919679ff3 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:23:29.196078 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afd67a4e-b545-45b6-acc8-dc8919679ff3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 08:23:29.198545 dv-cinder-851351-1-smb devstack@keystone.service[207600]: [pid: 207600|app: 0|req: 49/101] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 08:23:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 28 08:23:29.201606 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application [None req-afd67a4e-b545-45b6-acc8-dc8919679ff3 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 28 08:23:29.201606 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:23:29.201606 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:23:29.201606 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:23:29.201606 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:23:29.201606 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:23:29.201606 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:23:29.201606 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:23:29.201606 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:23:29.201606 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:23:29.201606 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:23:29.201606 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:23:29.201606 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 08:23:29.201606 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 08:23:29.201606 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 08:23:29.201606 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 08:23:29.202540 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 08:23:29.202540 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 08:23:29.202540 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 08:23:29.202540 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 08:23:29.202540 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:23:29.202540 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:23:29.202540 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:23:29.202540 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:23:29.202540 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:23:29.202540 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:23:29.202540 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:23:29.202540 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application with Lock( Jul 28 08:23:29.202540 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:23:29.202540 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:23:29.202540 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:23:29.202540 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:23:29.203849 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:23:29.203849 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:23:29.203849 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:23:29.203849 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:23:29.203849 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 08:23:29.203849 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 08:23:29.203849 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 08:23:29.203849 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 08:23:29.203849 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 08:23:29.203849 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 08:23:29.203849 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 28 08:23:29.203849 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application Jul 28 08:23:29.203849 dv-cinder-851351-1-smb devstack@keystone.service[207601]: [pid: 207601|app: 0|req: 53/102] 10.222.0.42 () {56 vars in 1099 bytes} [Thu Jul 28 08:23:28 2022] GET /identity/v3/roles/reader => generated 84 bytes in 268 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:23:29.208898 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed44b4b0-0c41-4344-bd75-53f6b4e7d1aa None None] Authenticating user token {{(pid=207600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:23:29.228768 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG dbcounter [-] [207600] Writing DB stats keystone:SELECT=100 {{(pid=207600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:23:29.250953 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd67a4e-b545-45b6-acc8-dc8919679ff3 None admin] Authenticating user token {{(pid=207601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:23:29.394858 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed44b4b0-0c41-4344-bd75-53f6b4e7d1aa None None] Validating token access rules against request {{(pid=207600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:23:29.404747 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd67a4e-b545-45b6-acc8-dc8919679ff3 None admin] Validating token access rules against request {{(pid=207601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:23:29.447083 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25033f78-a6ba-411b-b320-4cf7ac95e567 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:23:29.447761 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25033f78-a6ba-411b-b320-4cf7ac95e567 None admin] REQUEST_METHOD: `GET` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:23:29.448051 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25033f78-a6ba-411b-b320-4cf7ac95e567 None admin] SCRIPT_NAME: `/identity` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:23:29.448334 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25033f78-a6ba-411b-b320-4cf7ac95e567 None admin] PATH_INFO: `/v3/roles/member` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:23:29.467463 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG dbcounter [-] [207601] Writing DB stats keystone:SELECT=100 {{(pid=207601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:23:29.473770 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25033f78-a6ba-411b-b320-4cf7ac95e567 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 08:23:29.479311 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application [None req-25033f78-a6ba-411b-b320-4cf7ac95e567 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 28 08:23:29.479311 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:23:29.479311 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:23:29.479311 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:23:29.479311 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:23:29.479311 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:23:29.479311 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:23:29.479311 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:23:29.479311 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:23:29.479311 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:23:29.479311 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:23:29.479311 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:23:29.479311 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 08:23:29.479311 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 08:23:29.479311 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 08:23:29.479311 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 08:23:29.480284 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 08:23:29.480284 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 08:23:29.480284 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 08:23:29.480284 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 08:23:29.480284 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:23:29.480284 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:23:29.480284 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:23:29.480284 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:23:29.480284 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:23:29.480284 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:23:29.480284 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:23:29.480284 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application with Lock( Jul 28 08:23:29.480284 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:23:29.480284 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:23:29.480284 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:23:29.480284 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:23:29.481195 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:23:29.481195 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:23:29.481195 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:23:29.481195 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:23:29.481195 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 08:23:29.481195 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 08:23:29.481195 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 08:23:29.481195 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 08:23:29.481195 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 08:23:29.481195 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 08:23:29.481195 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 28 08:23:29.481195 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application Jul 28 08:23:29.481849 dv-cinder-851351-1-smb devstack@keystone.service[207601]: [pid: 207601|app: 0|req: 54/103] 10.222.0.42 () {56 vars in 1099 bytes} [Thu Jul 28 08:23:29 2022] GET /identity/v3/roles/member => generated 84 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 08:23:29.487119 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc7e431-8f0a-4b7a-a24a-40b666884dea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:23:29.487837 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc7e431-8f0a-4b7a-a24a-40b666884dea None admin] REQUEST_METHOD: `GET` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:23:29.488133 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc7e431-8f0a-4b7a-a24a-40b666884dea None admin] SCRIPT_NAME: `/identity` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:23:29.488414 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc7e431-8f0a-4b7a-a24a-40b666884dea None admin] PATH_INFO: `/v3/roles` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:23:29.493263 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdc7e431-8f0a-4b7a-a24a-40b666884dea None admin] RBAC: Adding query filter params (name=reader) {{(pid=207600) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:23:29.493592 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdc7e431-8f0a-4b7a-a24a-40b666884dea None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:23:29.495024 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdc7e431-8f0a-4b7a-a24a-40b666884dea None admin] RBAC: Authorization granted {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:23:29.497560 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25033f78-a6ba-411b-b320-4cf7ac95e567 None admin] Authenticating user token {{(pid=207601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:23:29.508567 dv-cinder-851351-1-smb devstack@keystone.service[207600]: [pid: 207600|app: 0|req: 50/104] 10.222.0.42 () {56 vars in 1101 bytes} [Thu Jul 28 08:23:29 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 300 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:23:29.517751 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc7e431-8f0a-4b7a-a24a-40b666884dea None admin] Authenticating user token {{(pid=207600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:23:29.668320 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25033f78-a6ba-411b-b320-4cf7ac95e567 None admin] Validating token access rules against request {{(pid=207601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:23:29.704796 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG dbcounter [-] [207600] Writing DB stats keystone:SELECT=100 {{(pid=207600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:23:29.714198 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58af0f92-c815-49e2-ae63-622bf1c6635a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:23:29.715228 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58af0f92-c815-49e2-ae63-622bf1c6635a None admin] REQUEST_METHOD: `GET` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:23:29.715517 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58af0f92-c815-49e2-ae63-622bf1c6635a None admin] SCRIPT_NAME: `/identity` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:23:29.715799 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58af0f92-c815-49e2-ae63-622bf1c6635a None admin] PATH_INFO: `/v3/roles` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:23:29.716635 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58af0f92-c815-49e2-ae63-622bf1c6635a None admin] RBAC: Adding query filter params (name=member) {{(pid=207601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:23:29.716977 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58af0f92-c815-49e2-ae63-622bf1c6635a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:23:29.718447 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58af0f92-c815-49e2-ae63-622bf1c6635a None admin] RBAC: Authorization granted {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:23:29.737382 dv-cinder-851351-1-smb devstack@keystone.service[207601]: [pid: 207601|app: 0|req: 55/105] 10.222.0.42 () {56 vars in 1101 bytes} [Thu Jul 28 08:23:29 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:23:29.743183 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b2f1e3-fc51-4bb5-a1c1-9a8d00ae0e54 None None] REQUEST_METHOD: `GET` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:23:29.743485 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b2f1e3-fc51-4bb5-a1c1-9a8d00ae0e54 None None] SCRIPT_NAME: `/identity` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:23:29.743764 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b2f1e3-fc51-4bb5-a1c1-9a8d00ae0e54 None None] PATH_INFO: `/` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:23:29.745141 dv-cinder-851351-1-smb devstack@keystone.service[207601]: [pid: 207601|app: 0|req: 56/106] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 08:23:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 28 08:23:29.747321 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b2f1e3-fc51-4bb5-a1c1-9a8d00ae0e54 None None] Authenticating user token {{(pid=207601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:23:29.780400 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc7e431-8f0a-4b7a-a24a-40b666884dea None admin] Validating token access rules against request {{(pid=207600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:23:29.860586 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43482b3b-f515-4bce-980d-ff7aa86db5e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:23:29.862812 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43482b3b-f515-4bce-980d-ff7aa86db5e4 None admin] REQUEST_METHOD: `GET` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:23:29.863117 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43482b3b-f515-4bce-980d-ff7aa86db5e4 None admin] SCRIPT_NAME: `/identity` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:23:29.863403 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43482b3b-f515-4bce-980d-ff7aa86db5e4 None admin] PATH_INFO: `/v3/users/1c3d0bca92884996b0a179a4a76a7d45` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:23:29.886276 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG dbcounter [-] [207601] Writing DB stats keystone:SELECT=100 {{(pid=207601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:23:29.899115 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43482b3b-f515-4bce-980d-ff7aa86db5e4 None admin] RBAC: Authorizing `identity:get_user(user_id=1c3d0bca92884996b0a179a4a76a7d45)` {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:23:29.900646 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43482b3b-f515-4bce-980d-ff7aa86db5e4 None admin] RBAC: Authorization granted {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:23:29.906270 dv-cinder-851351-1-smb devstack@keystone.service[207600]: [pid: 207600|app: 0|req: 51/107] 10.222.0.42 () {56 vars in 1177 bytes} [Thu Jul 28 08:23:29 2022] GET /identity/v3/users/1c3d0bca92884996b0a179a4a76a7d45 => generated 289 bytes in 389 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:23:29.907566 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238e59f3-8efb-44fa-af9c-0dea8e5e9b1d None None] REQUEST_METHOD: `POST` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:23:29.907858 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238e59f3-8efb-44fa-af9c-0dea8e5e9b1d None None] SCRIPT_NAME: `/identity` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:23:29.908138 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238e59f3-8efb-44fa-af9c-0dea8e5e9b1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:23:29.945686 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.auth.core [None req-238e59f3-8efb-44fa-af9c-0dea8e5e9b1d None None] MFA Rules not processed for user `b8110ade874c4aa7af27f5c376df700a`. Rule list: `[]` (Enabled: `True`). {{(pid=207600) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 08:23:29.946830 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.fernet_utils [None req-238e59f3-8efb-44fa-af9c-0dea8e5e9b1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=207600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:23:29.979654 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b2f1e3-fc51-4bb5-a1c1-9a8d00ae0e54 None None] Validating token access rules against request {{(pid=207601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:23:30.022474 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6eded22-c5e1-4456-9c8f-aa529982ed11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:23:30.023431 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6eded22-c5e1-4456-9c8f-aa529982ed11 None admin] REQUEST_METHOD: `GET` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:23:30.023725 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6eded22-c5e1-4456-9c8f-aa529982ed11 None admin] SCRIPT_NAME: `/identity` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:23:30.024010 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6eded22-c5e1-4456-9c8f-aa529982ed11 None admin] PATH_INFO: `/v3/users/8c28b8a46b2e45fdbcbb20dfc58d7f41` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:23:30.025750 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6eded22-c5e1-4456-9c8f-aa529982ed11 None admin] RBAC: Authorizing `identity:get_user(user_id=8c28b8a46b2e45fdbcbb20dfc58d7f41)` {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:23:30.027486 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6eded22-c5e1-4456-9c8f-aa529982ed11 None admin] RBAC: Authorization granted {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:23:30.029986 dv-cinder-851351-1-smb devstack@keystone.service[207601]: [pid: 207601|app: 0|req: 57/108] 10.222.0.42 () {56 vars in 1177 bytes} [Thu Jul 28 08:23:29 2022] GET /identity/v3/users/8c28b8a46b2e45fdbcbb20dfc58d7f41 => generated 275 bytes in 284 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:23:30.030841 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6eded22-c5e1-4456-9c8f-aa529982ed11 None admin] Authenticating user token {{(pid=207601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:23:30.037403 dv-cinder-851351-1-smb devstack@keystone.service[207600]: [pid: 207600|app: 0|req: 52/109] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 08:23:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 08:23:30.046410 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520265bf-46e2-4c6c-9620-99b189091c90 None None] REQUEST_METHOD: `GET` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:23:30.046808 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520265bf-46e2-4c6c-9620-99b189091c90 None None] SCRIPT_NAME: `/identity` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:23:30.047219 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520265bf-46e2-4c6c-9620-99b189091c90 None None] PATH_INFO: `/` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:23:30.049159 dv-cinder-851351-1-smb devstack@keystone.service[207600]: [pid: 207600|app: 0|req: 53/110] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 08:23:30 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 08:23:30.050040 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-520265bf-46e2-4c6c-9620-99b189091c90 None None] Authenticating user token {{(pid=207600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:23:30.136086 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG dbcounter [-] [207600] Writing DB stats keystone:SELECT=100 {{(pid=207600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:23:30.147590 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6eded22-c5e1-4456-9c8f-aa529982ed11 None admin] Validating token access rules against request {{(pid=207601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:23:30.179496 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG dbcounter [-] [207601] Writing DB stats keystone:SELECT=100 {{(pid=207601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:23:30.184709 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-520265bf-46e2-4c6c-9620-99b189091c90 None None] Validating token access rules against request {{(pid=207600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:23:30.186048 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a571376-09da-4087-8ffe-62ed71dc848c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:23:30.187205 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a571376-09da-4087-8ffe-62ed71dc848c None admin] REQUEST_METHOD: `GET` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:23:30.187867 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a571376-09da-4087-8ffe-62ed71dc848c None admin] SCRIPT_NAME: `/identity` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:23:30.188152 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a571376-09da-4087-8ffe-62ed71dc848c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:23:30.228638 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8b3483-21ef-4891-99b8-d68327178ffa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:23:30.229610 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8b3483-21ef-4891-99b8-d68327178ffa None admin] REQUEST_METHOD: `GET` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:23:30.230125 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8b3483-21ef-4891-99b8-d68327178ffa None admin] SCRIPT_NAME: `/identity` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:23:30.230570 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8b3483-21ef-4891-99b8-d68327178ffa None admin] PATH_INFO: `/v3/projects/4a64079f46494355a0aa3aafd9a90c0c` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:23:30.232024 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e8b3483-21ef-4891-99b8-d68327178ffa None admin] RBAC: Authorizing `identity:get_project(project_id=4a64079f46494355a0aa3aafd9a90c0c)` {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:23:30.233881 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e8b3483-21ef-4891-99b8-d68327178ffa None admin] RBAC: Authorization granted {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:23:30.235901 dv-cinder-851351-1-smb devstack@keystone.service[207600]: [pid: 207600|app: 0|req: 54/111] 10.222.0.42 () {56 vars in 1186 bytes} [Thu Jul 28 08:23:30 2022] GET /identity/v3/projects/4a64079f46494355a0aa3aafd9a90c0c => generated 298 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:23:30.237600 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d02c832-bd12-4174-a230-3e7f16f607d7 None None] REQUEST_METHOD: `POST` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:23:30.238050 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d02c832-bd12-4174-a230-3e7f16f607d7 None None] SCRIPT_NAME: `/identity` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:23:30.238481 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d02c832-bd12-4174-a230-3e7f16f607d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:23:30.259038 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.auth.core [None req-2d02c832-bd12-4174-a230-3e7f16f607d7 None None] MFA Rules not processed for user `b8110ade874c4aa7af27f5c376df700a`. Rule list: `[]` (Enabled: `True`). {{(pid=207600) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 08:23:30.260589 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.fernet_utils [None req-2d02c832-bd12-4174-a230-3e7f16f607d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=207600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:23:30.264707 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a571376-09da-4087-8ffe-62ed71dc848c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:23:30.266022 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a571376-09da-4087-8ffe-62ed71dc848c None admin] RBAC: Authorization granted {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:23:30.344813 dv-cinder-851351-1-smb devstack@keystone.service[207600]: [pid: 207600|app: 0|req: 55/112] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 08:23:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 08:23:30.346137 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d02c832-bd12-4174-a230-3e7f16f607d7 None None] Authenticating user token {{(pid=207600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:23:30.380981 dv-cinder-851351-1-smb devstack@keystone.service[207601]: [pid: 207601|app: 0|req: 58/113] 10.222.0.42 () {58 vars in 1282 bytes} [Thu Jul 28 08:23:30 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 350 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 28 08:23:30.381710 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a571376-09da-4087-8ffe-62ed71dc848c None admin] Authenticating user token {{(pid=207601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:23:30.414029 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG dbcounter [-] [207601] Writing DB stats keystone:SELECT=100 {{(pid=207601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:23:30.432167 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG dbcounter [-] [207600] Writing DB stats keystone:SELECT=100 {{(pid=207600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:23:30.479015 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d02c832-bd12-4174-a230-3e7f16f607d7 None None] Validating token access rules against request {{(pid=207600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:23:30.492426 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a571376-09da-4087-8ffe-62ed71dc848c None admin] Validating token access rules against request {{(pid=207601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:23:30.516087 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d2ac481-65a9-4f7b-a373-b1870226a971 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:23:30.516796 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2ac481-65a9-4f7b-a373-b1870226a971 None admin] REQUEST_METHOD: `GET` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:23:30.517104 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2ac481-65a9-4f7b-a373-b1870226a971 None admin] SCRIPT_NAME: `/identity` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:23:30.517372 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2ac481-65a9-4f7b-a373-b1870226a971 None admin] PATH_INFO: `/v3/domains/default` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:23:30.518698 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d2ac481-65a9-4f7b-a373-b1870226a971 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:23:30.520531 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d2ac481-65a9-4f7b-a373-b1870226a971 None admin] RBAC: Authorization granted {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:23:30.522381 dv-cinder-851351-1-smb devstack@keystone.service[207600]: [pid: 207600|app: 0|req: 56/114] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 08:23:30 2022] GET /identity/v3/domains/default => generated 199 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:23:30.525555 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d2ac481-65a9-4f7b-a373-b1870226a971 None admin] Authenticating user token {{(pid=207600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:23:30.531430 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab0c609-b6f7-4ba6-b0ec-69f650123e13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:23:30.532142 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab0c609-b6f7-4ba6-b0ec-69f650123e13 None admin] REQUEST_METHOD: `PUT` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:23:30.532436 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab0c609-b6f7-4ba6-b0ec-69f650123e13 None admin] SCRIPT_NAME: `/identity` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:23:30.532747 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab0c609-b6f7-4ba6-b0ec-69f650123e13 None admin] PATH_INFO: `/v3/projects/4a64079f46494355a0aa3aafd9a90c0c/users/8c28b8a46b2e45fdbcbb20dfc58d7f41/roles/70a2fd2878c549aeb19b16ec37e37164` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:23:30.534774 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bab0c609-b6f7-4ba6-b0ec-69f650123e13 None admin] RBAC: Authorizing `identity:create_grant(project_id=4a64079f46494355a0aa3aafd9a90c0c, user_id=8c28b8a46b2e45fdbcbb20dfc58d7f41, role_id=70a2fd2878c549aeb19b16ec37e37164)` {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:23:30.536274 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bab0c609-b6f7-4ba6-b0ec-69f650123e13 None admin] RBAC: Authorization granted {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:23:30.550126 dv-cinder-851351-1-smb devstack@keystone.service[207601]: [pid: 207601|app: 0|req: 59/115] 10.222.0.42 () {58 vars in 1439 bytes} [Thu Jul 28 08:23:30 2022] PUT /identity/v3/projects/4a64079f46494355a0aa3aafd9a90c0c/users/8c28b8a46b2e45fdbcbb20dfc58d7f41/roles/70a2fd2878c549aeb19b16ec37e37164 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 08:23:30.550975 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab0c609-b6f7-4ba6-b0ec-69f650123e13 None admin] Authenticating user token {{(pid=207601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:23:30.652089 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d2ac481-65a9-4f7b-a373-b1870226a971 None admin] Validating token access rules against request {{(pid=207600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:23:30.661352 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG dbcounter [-] [207601] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=207601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:23:30.674702 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab0c609-b6f7-4ba6-b0ec-69f650123e13 None admin] Validating token access rules against request {{(pid=207601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:23:30.685728 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG dbcounter [-] [207600] Writing DB stats keystone:SELECT=100 {{(pid=207600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:23:30.696801 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c235e15-a6a6-4372-8261-8a343e2ac879 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:23:30.697945 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c235e15-a6a6-4372-8261-8a343e2ac879 None admin] REQUEST_METHOD: `GET` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:23:30.698538 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c235e15-a6a6-4372-8261-8a343e2ac879 None admin] SCRIPT_NAME: `/identity` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:23:30.698821 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c235e15-a6a6-4372-8261-8a343e2ac879 None admin] PATH_INFO: `/v3/projects/4a64079f46494355a0aa3aafd9a90c0c` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:23:30.700129 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c235e15-a6a6-4372-8261-8a343e2ac879 None admin] RBAC: Authorizing `identity:get_project(project_id=4a64079f46494355a0aa3aafd9a90c0c)` {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:23:30.701735 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c235e15-a6a6-4372-8261-8a343e2ac879 None admin] RBAC: Authorization granted {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:23:30.703503 dv-cinder-851351-1-smb devstack@keystone.service[207600]: [pid: 207600|app: 0|req: 57/116] 10.222.0.42 () {56 vars in 1186 bytes} [Thu Jul 28 08:23:30 2022] GET /identity/v3/projects/4a64079f46494355a0aa3aafd9a90c0c => generated 298 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:23:30.705017 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379c6e17-e243-433b-b959-87539c4ed95b None None] REQUEST_METHOD: `GET` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:23:30.705230 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379c6e17-e243-433b-b959-87539c4ed95b None None] SCRIPT_NAME: `/identity` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:23:30.705515 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379c6e17-e243-433b-b959-87539c4ed95b None None] PATH_INFO: `/` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:23:30.706983 dv-cinder-851351-1-smb devstack@keystone.service[207600]: [pid: 207600|app: 0|req: 58/117] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 08:23:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 08:23:30.707632 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379c6e17-e243-433b-b959-87539c4ed95b None None] Authenticating user token {{(pid=207600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:23:30.721236 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60292001-219e-4a0d-9807-e51e10364441 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:23:30.721922 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60292001-219e-4a0d-9807-e51e10364441 None admin] REQUEST_METHOD: `GET` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:23:30.722214 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60292001-219e-4a0d-9807-e51e10364441 None admin] SCRIPT_NAME: `/identity` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:23:30.722501 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60292001-219e-4a0d-9807-e51e10364441 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:23:30.737947 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60292001-219e-4a0d-9807-e51e10364441 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 08:23:30.743058 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application [None req-60292001-219e-4a0d-9807-e51e10364441 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 08:23:30.743058 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:23:30.743058 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:23:30.743058 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:23:30.743058 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:23:30.743058 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:23:30.743058 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:23:30.743058 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:23:30.743058 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:23:30.743058 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:23:30.743058 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:23:30.743058 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:23:30.743058 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 08:23:30.743058 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 08:23:30.743058 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 08:23:30.743058 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 08:23:30.744250 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 08:23:30.744250 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 08:23:30.744250 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 08:23:30.744250 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 08:23:30.744250 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:23:30.744250 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:23:30.744250 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:23:30.744250 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:23:30.744250 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:23:30.744250 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:23:30.744250 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:23:30.744250 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application with Lock( Jul 28 08:23:30.744250 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:23:30.744250 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:23:30.744250 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:23:30.744250 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:23:30.745227 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:23:30.745227 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:23:30.745227 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:23:30.745227 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:23:30.745227 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 08:23:30.745227 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 08:23:30.745227 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 08:23:30.745227 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 08:23:30.745227 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 08:23:30.745227 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 08:23:30.745227 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 08:23:30.745227 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application Jul 28 08:23:30.745227 dv-cinder-851351-1-smb devstack@keystone.service[207601]: [pid: 207601|app: 0|req: 60/118] 10.222.0.42 () {56 vars in 1096 bytes} [Thu Jul 28 08:23:30 2022] GET /identity/v3/roles/admin => generated 83 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:23:30.745963 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23fba02e-c25c-4221-afc7-b6e3ca35e35d None None] REQUEST_METHOD: `GET` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:23:30.746211 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23fba02e-c25c-4221-afc7-b6e3ca35e35d None None] SCRIPT_NAME: `/identity` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:23:30.746378 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23fba02e-c25c-4221-afc7-b6e3ca35e35d None None] PATH_INFO: `/` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:23:30.747900 dv-cinder-851351-1-smb devstack@keystone.service[207601]: [pid: 207601|app: 0|req: 61/119] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 08:23:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 08:23:30.748436 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23fba02e-c25c-4221-afc7-b6e3ca35e35d None None] Authenticating user token {{(pid=207601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:23:30.828862 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379c6e17-e243-433b-b959-87539c4ed95b None None] Validating token access rules against request {{(pid=207600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:23:30.866001 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f712a41-679e-4463-b9f0-b9e5fec0f817 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:23:30.866695 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f712a41-679e-4463-b9f0-b9e5fec0f817 None admin] REQUEST_METHOD: `POST` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:23:30.866920 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f712a41-679e-4463-b9f0-b9e5fec0f817 None admin] SCRIPT_NAME: `/identity` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:23:30.867203 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f712a41-679e-4463-b9f0-b9e5fec0f817 None admin] PATH_INFO: `/v3/projects` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:23:30.867910 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f712a41-679e-4463-b9f0-b9e5fec0f817 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:23:30.869416 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f712a41-679e-4463-b9f0-b9e5fec0f817 None admin] RBAC: Authorization granted {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:23:30.870715 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23fba02e-c25c-4221-afc7-b6e3ca35e35d None None] Validating token access rules against request {{(pid=207601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:23:30.906436 dv-cinder-851351-1-smb devstack@keystone.service[207600]: [pid: 207600|app: 0|req: 59/120] 10.222.0.42 () {60 vars in 1141 bytes} [Thu Jul 28 08:23:30 2022] POST /identity/v3/projects => generated 302 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 08:23:30.907843 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9c7753-262c-457b-bf57-4945d385778e None None] REQUEST_METHOD: `POST` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:23:30.908142 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9c7753-262c-457b-bf57-4945d385778e None None] SCRIPT_NAME: `/identity` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:23:30.908432 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9c7753-262c-457b-bf57-4945d385778e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:23:30.919835 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63838445-9aca-4acd-8640-14e4d918dd73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:23:30.921340 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63838445-9aca-4acd-8640-14e4d918dd73 None admin] REQUEST_METHOD: `GET` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:23:30.922071 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63838445-9aca-4acd-8640-14e4d918dd73 None admin] SCRIPT_NAME: `/identity` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:23:30.922588 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63838445-9aca-4acd-8640-14e4d918dd73 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:23:30.923679 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63838445-9aca-4acd-8640-14e4d918dd73 None admin] RBAC: Adding query filter params (role.id=4af3ffd96e0540dbb20e6ccb08a61f0b, scope.project.id=4a64079f46494355a0aa3aafd9a90c0c, user.id=1c3d0bca92884996b0a179a4a76a7d45) {{(pid=207601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:23:30.924337 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63838445-9aca-4acd-8640-14e4d918dd73 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:23:30.927229 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63838445-9aca-4acd-8640-14e4d918dd73 None admin] RBAC: Authorization granted {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:23:30.932306 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.auth.core [None req-3d9c7753-262c-457b-bf57-4945d385778e None None] MFA Rules not processed for user `b8110ade874c4aa7af27f5c376df700a`. Rule list: `[]` (Enabled: `True`). {{(pid=207600) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 08:23:30.934084 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.fernet_utils [None req-3d9c7753-262c-457b-bf57-4945d385778e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=207600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:23:30.935514 dv-cinder-851351-1-smb devstack@keystone.service[207601]: [pid: 207601|app: 0|req: 62/121] 10.222.0.42 () {56 vars in 1374 bytes} [Thu Jul 28 08:23:30 2022] GET /identity/v3/role_assignments?user.id=1c3d0bca92884996b0a179a4a76a7d45&scope.project.id=4a64079f46494355a0aa3aafd9a90c0c&role.id=4af3ffd96e0540dbb20e6ccb08a61f0b => generated 259 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:23:30.937426 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63838445-9aca-4acd-8640-14e4d918dd73 None admin] Authenticating user token {{(pid=207601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:23:30.967179 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG dbcounter [-] [207601] Writing DB stats keystone:SELECT=100 {{(pid=207601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:23:31.030299 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG dbcounter [-] [207600] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=207600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:23:31.075321 dv-cinder-851351-1-smb devstack@keystone.service[207600]: [pid: 207600|app: 0|req: 60/122] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 08:23:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 08:23:31.076781 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63254e0-435a-4548-9ce2-bfc186df6a97 None None] REQUEST_METHOD: `POST` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:23:31.077081 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63254e0-435a-4548-9ce2-bfc186df6a97 None None] SCRIPT_NAME: `/identity` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:23:31.077371 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63254e0-435a-4548-9ce2-bfc186df6a97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:23:31.121959 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.auth.core [None req-c63254e0-435a-4548-9ce2-bfc186df6a97 None None] MFA Rules not processed for user `b8110ade874c4aa7af27f5c376df700a`. Rule list: `[]` (Enabled: `True`). {{(pid=207600) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 08:23:31.123269 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.fernet_utils [None req-c63254e0-435a-4548-9ce2-bfc186df6a97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=207600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:23:31.142127 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63838445-9aca-4acd-8640-14e4d918dd73 None admin] Validating token access rules against request {{(pid=207601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:23:31.196203 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-705d04f9-76b6-4bc6-a473-03f26919fbd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:23:31.196891 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705d04f9-76b6-4bc6-a473-03f26919fbd8 None admin] REQUEST_METHOD: `GET` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:23:31.197215 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705d04f9-76b6-4bc6-a473-03f26919fbd8 None admin] SCRIPT_NAME: `/identity` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:23:31.197499 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705d04f9-76b6-4bc6-a473-03f26919fbd8 None admin] PATH_INFO: `/v3/roles` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:23:31.198290 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-705d04f9-76b6-4bc6-a473-03f26919fbd8 None admin] RBAC: Adding query filter params (name=admin) {{(pid=207601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:23:31.198606 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-705d04f9-76b6-4bc6-a473-03f26919fbd8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:23:31.200018 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-705d04f9-76b6-4bc6-a473-03f26919fbd8 None admin] RBAC: Authorization granted {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:23:31.214400 dv-cinder-851351-1-smb devstack@keystone.service[207601]: [pid: 207601|app: 0|req: 63/123] 10.222.0.42 () {56 vars in 1099 bytes} [Thu Jul 28 08:23:30 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:23:31.218156 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-705d04f9-76b6-4bc6-a473-03f26919fbd8 None admin] Authenticating user token {{(pid=207601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:23:31.225043 dv-cinder-851351-1-smb devstack@keystone.service[207600]: [pid: 207600|app: 0|req: 61/124] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 08:23:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 08:23:31.225985 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63254e0-435a-4548-9ce2-bfc186df6a97 None None] Authenticating user token {{(pid=207600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:23:31.330427 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG dbcounter [-] [207601] Writing DB stats keystone:SELECT=100 {{(pid=207601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:23:31.384997 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-705d04f9-76b6-4bc6-a473-03f26919fbd8 None admin] Validating token access rules against request {{(pid=207601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:23:31.418825 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63254e0-435a-4548-9ce2-bfc186df6a97 None None] Validating token access rules against request {{(pid=207600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:23:31.430004 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG dbcounter [-] [207600] Writing DB stats keystone:SELECT=100 {{(pid=207600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:23:31.434518 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db415d11-e930-4739-bec3-f6f652de6abe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:23:31.435734 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db415d11-e930-4739-bec3-f6f652de6abe None admin] REQUEST_METHOD: `GET` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:23:31.436316 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db415d11-e930-4739-bec3-f6f652de6abe None admin] SCRIPT_NAME: `/identity` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:23:31.436855 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db415d11-e930-4739-bec3-f6f652de6abe None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:23:31.450821 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db415d11-e930-4739-bec3-f6f652de6abe None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 08:23:31.457959 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application [None req-db415d11-e930-4739-bec3-f6f652de6abe None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 28 08:23:31.457959 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:23:31.457959 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:23:31.457959 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:23:31.457959 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:23:31.457959 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:23:31.457959 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:23:31.457959 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:23:31.457959 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:23:31.457959 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:23:31.457959 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:23:31.457959 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:23:31.457959 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 08:23:31.457959 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 08:23:31.457959 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 08:23:31.457959 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 08:23:31.459027 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 08:23:31.459027 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 08:23:31.459027 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 08:23:31.459027 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 08:23:31.459027 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:23:31.459027 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:23:31.459027 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:23:31.459027 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:23:31.459027 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:23:31.459027 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:23:31.459027 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:23:31.459027 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application with Lock( Jul 28 08:23:31.459027 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:23:31.459027 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:23:31.459027 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:23:31.459027 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:23:31.459943 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:23:31.459943 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:23:31.459943 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:23:31.459943 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:23:31.459943 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 08:23:31.459943 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 08:23:31.459943 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 08:23:31.459943 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 08:23:31.459943 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 08:23:31.459943 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 08:23:31.459943 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 28 08:23:31.459943 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application Jul 28 08:23:31.462822 dv-cinder-851351-1-smb devstack@keystone.service[207601]: [pid: 207601|app: 0|req: 64/125] 10.222.0.42 () {56 vars in 1114 bytes} [Thu Jul 28 08:23:31 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 248 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:23:31.464178 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db415d11-e930-4739-bec3-f6f652de6abe None admin] Authenticating user token {{(pid=207601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:23:31.498532 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f27e10e6-3740-4171-b74b-6352dfc7f95c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:23:31.499231 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27e10e6-3740-4171-b74b-6352dfc7f95c None admin] REQUEST_METHOD: `GET` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:23:31.499522 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27e10e6-3740-4171-b74b-6352dfc7f95c None admin] SCRIPT_NAME: `/identity` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:23:31.499815 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27e10e6-3740-4171-b74b-6352dfc7f95c None admin] PATH_INFO: `/v3/users/b8110ade874c4aa7af27f5c376df700a` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:23:31.503582 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f27e10e6-3740-4171-b74b-6352dfc7f95c None admin] RBAC: Authorizing `identity:get_user(user_id=b8110ade874c4aa7af27f5c376df700a)` {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:23:31.505128 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f27e10e6-3740-4171-b74b-6352dfc7f95c None admin] RBAC: Authorization granted {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:23:31.507047 dv-cinder-851351-1-smb devstack@keystone.service[207600]: [pid: 207600|app: 0|req: 62/126] 10.222.0.42 () {56 vars in 1177 bytes} [Thu Jul 28 08:23:31 2022] GET /identity/v3/users/b8110ade874c4aa7af27f5c376df700a => generated 247 bytes in 281 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:23:31.507622 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f27e10e6-3740-4171-b74b-6352dfc7f95c None admin] Authenticating user token {{(pid=207600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:23:31.616842 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db415d11-e930-4739-bec3-f6f652de6abe None admin] Validating token access rules against request {{(pid=207601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:23:31.660625 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2dba57a-08b9-4e60-a2fc-bfeccf7a688a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:23:31.661356 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2dba57a-08b9-4e60-a2fc-bfeccf7a688a None admin] REQUEST_METHOD: `GET` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:23:31.662673 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2dba57a-08b9-4e60-a2fc-bfeccf7a688a None admin] SCRIPT_NAME: `/identity` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:23:31.662959 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2dba57a-08b9-4e60-a2fc-bfeccf7a688a None admin] PATH_INFO: `/v3/roles/member` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:23:31.670811 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG dbcounter [-] [207601] Writing DB stats keystone:SELECT=100 {{(pid=207601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:23:31.686688 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2dba57a-08b9-4e60-a2fc-bfeccf7a688a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 08:23:31.692444 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application [None req-a2dba57a-08b9-4e60-a2fc-bfeccf7a688a None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 28 08:23:31.692444 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:23:31.692444 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:23:31.692444 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:23:31.692444 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:23:31.692444 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:23:31.692444 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:23:31.692444 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:23:31.692444 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:23:31.692444 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:23:31.692444 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:23:31.692444 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:23:31.692444 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 08:23:31.692444 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 08:23:31.692444 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 08:23:31.692444 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 08:23:31.693508 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 08:23:31.693508 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 08:23:31.693508 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 08:23:31.693508 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 08:23:31.693508 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:23:31.693508 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:23:31.693508 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:23:31.693508 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:23:31.693508 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:23:31.693508 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:23:31.693508 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:23:31.693508 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application with Lock( Jul 28 08:23:31.693508 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:23:31.693508 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:23:31.693508 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:23:31.693508 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:23:31.694361 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:23:31.694361 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:23:31.694361 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:23:31.694361 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:23:31.694361 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 08:23:31.694361 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 08:23:31.694361 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 08:23:31.694361 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 08:23:31.694361 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 08:23:31.694361 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 08:23:31.694361 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 28 08:23:31.694361 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application Jul 28 08:23:31.701428 dv-cinder-851351-1-smb devstack@keystone.service[207601]: [pid: 207601|app: 0|req: 65/127] 10.222.0.42 () {56 vars in 1099 bytes} [Thu Jul 28 08:23:31 2022] GET /identity/v3/roles/member => generated 84 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:23:31.702073 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2dba57a-08b9-4e60-a2fc-bfeccf7a688a None admin] Authenticating user token {{(pid=207601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:23:31.717289 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f27e10e6-3740-4171-b74b-6352dfc7f95c None admin] Validating token access rules against request {{(pid=207600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:23:31.794071 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b19bd8-4221-4086-8157-738cd5084433 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:23:31.794912 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b19bd8-4221-4086-8157-738cd5084433 None admin] REQUEST_METHOD: `GET` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:23:31.795217 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b19bd8-4221-4086-8157-738cd5084433 None admin] SCRIPT_NAME: `/identity` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:23:31.795491 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b19bd8-4221-4086-8157-738cd5084433 None admin] PATH_INFO: `/v3/roles` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:23:31.796257 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b19bd8-4221-4086-8157-738cd5084433 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=207600) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:23:31.796574 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b19bd8-4221-4086-8157-738cd5084433 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:23:31.798047 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b19bd8-4221-4086-8157-738cd5084433 None admin] RBAC: Authorization granted {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:23:31.813201 dv-cinder-851351-1-smb devstack@keystone.service[207600]: [pid: 207600|app: 0|req: 63/128] 10.222.0.42 () {56 vars in 1111 bytes} [Thu Jul 28 08:23:31 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 306 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:23:31.813874 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b19bd8-4221-4086-8157-738cd5084433 None admin] Authenticating user token {{(pid=207600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:23:31.833386 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2dba57a-08b9-4e60-a2fc-bfeccf7a688a None admin] Validating token access rules against request {{(pid=207601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:23:31.870007 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137da848-9e9e-4247-9b7f-778caec732ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:23:31.870605 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137da848-9e9e-4247-9b7f-778caec732ea None admin] REQUEST_METHOD: `GET` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:23:31.870899 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137da848-9e9e-4247-9b7f-778caec732ea None admin] SCRIPT_NAME: `/identity` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:23:31.871181 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137da848-9e9e-4247-9b7f-778caec732ea None admin] PATH_INFO: `/v3/projects/4a64079f46494355a0aa3aafd9a90c0c` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:23:31.872462 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-137da848-9e9e-4247-9b7f-778caec732ea None admin] RBAC: Authorizing `identity:get_project(project_id=4a64079f46494355a0aa3aafd9a90c0c)` {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:23:31.874007 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-137da848-9e9e-4247-9b7f-778caec732ea None admin] RBAC: Authorization granted {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:23:31.876079 dv-cinder-851351-1-smb devstack@keystone.service[207601]: [pid: 207601|app: 0|req: 66/129] 10.222.0.42 () {56 vars in 1186 bytes} [Thu Jul 28 08:23:31 2022] GET /identity/v3/projects/4a64079f46494355a0aa3aafd9a90c0c => generated 298 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:23:31.876920 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137da848-9e9e-4247-9b7f-778caec732ea None admin] Authenticating user token {{(pid=207601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:23:31.941060 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG dbcounter [-] [207600] Writing DB stats keystone:SELECT=100 {{(pid=207600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:23:31.945108 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG dbcounter [-] [207601] Writing DB stats keystone:SELECT=100 {{(pid=207601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:23:31.981578 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137da848-9e9e-4247-9b7f-778caec732ea None admin] Validating token access rules against request {{(pid=207601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:23:32.017546 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96540490-e824-4ed9-b48a-f3238f5f57f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:23:32.018224 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96540490-e824-4ed9-b48a-f3238f5f57f2 None admin] REQUEST_METHOD: `GET` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:23:32.018556 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96540490-e824-4ed9-b48a-f3238f5f57f2 None admin] SCRIPT_NAME: `/identity` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:23:32.018797 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96540490-e824-4ed9-b48a-f3238f5f57f2 None admin] PATH_INFO: `/v3/users/8c28b8a46b2e45fdbcbb20dfc58d7f41` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:23:32.020036 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96540490-e824-4ed9-b48a-f3238f5f57f2 None admin] RBAC: Authorizing `identity:get_user(user_id=8c28b8a46b2e45fdbcbb20dfc58d7f41)` {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:23:32.021557 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96540490-e824-4ed9-b48a-f3238f5f57f2 None admin] RBAC: Authorization granted {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:23:32.023517 dv-cinder-851351-1-smb devstack@keystone.service[207601]: [pid: 207601|app: 0|req: 67/130] 10.222.0.42 () {56 vars in 1177 bytes} [Thu Jul 28 08:23:31 2022] GET /identity/v3/users/8c28b8a46b2e45fdbcbb20dfc58d7f41 => generated 275 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:23:32.024295 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96540490-e824-4ed9-b48a-f3238f5f57f2 None admin] Authenticating user token {{(pid=207601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:23:32.108722 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b19bd8-4221-4086-8157-738cd5084433 None admin] Validating token access rules against request {{(pid=207600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:23:32.130517 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96540490-e824-4ed9-b48a-f3238f5f57f2 None admin] Validating token access rules against request {{(pid=207601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:23:32.165129 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3fe3725-be0d-42e6-b113-9e0400f8de32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:23:32.165821 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3fe3725-be0d-42e6-b113-9e0400f8de32 None admin] REQUEST_METHOD: `PUT` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:23:32.166114 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3fe3725-be0d-42e6-b113-9e0400f8de32 None admin] SCRIPT_NAME: `/identity` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:23:32.166403 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3fe3725-be0d-42e6-b113-9e0400f8de32 None admin] PATH_INFO: `/v3/projects/4a64079f46494355a0aa3aafd9a90c0c/users/b8110ade874c4aa7af27f5c376df700a/roles/d0ce88034c6b41878db755343f5840be` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:23:32.172694 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3fe3725-be0d-42e6-b113-9e0400f8de32 None admin] RBAC: Authorizing `identity:create_grant(project_id=4a64079f46494355a0aa3aafd9a90c0c, user_id=b8110ade874c4aa7af27f5c376df700a, role_id=d0ce88034c6b41878db755343f5840be)` {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:23:32.172694 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3fe3725-be0d-42e6-b113-9e0400f8de32 None admin] RBAC: Authorization granted {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:23:32.177128 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG dbcounter [-] [207601] Writing DB stats keystone:SELECT=100 {{(pid=207601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:23:32.191611 dv-cinder-851351-1-smb devstack@keystone.service[207601]: [pid: 207601|app: 0|req: 68/131] 10.222.0.42 () {58 vars in 1439 bytes} [Thu Jul 28 08:23:32 2022] PUT /identity/v3/projects/4a64079f46494355a0aa3aafd9a90c0c/users/b8110ade874c4aa7af27f5c376df700a/roles/d0ce88034c6b41878db755343f5840be => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 08:23:32.192505 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3fe3725-be0d-42e6-b113-9e0400f8de32 None admin] Authenticating user token {{(pid=207601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:23:32.200273 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20493fa6-77f6-40f2-b4c6-78d2b6f9c40b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:23:32.201032 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20493fa6-77f6-40f2-b4c6-78d2b6f9c40b None admin] REQUEST_METHOD: `GET` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:23:32.205004 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20493fa6-77f6-40f2-b4c6-78d2b6f9c40b None admin] SCRIPT_NAME: `/identity` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:23:32.205376 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20493fa6-77f6-40f2-b4c6-78d2b6f9c40b None admin] PATH_INFO: `/v3/roles` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:23:32.206158 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20493fa6-77f6-40f2-b4c6-78d2b6f9c40b None admin] RBAC: Adding query filter params (name=member) {{(pid=207600) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:23:32.206551 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20493fa6-77f6-40f2-b4c6-78d2b6f9c40b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:23:32.208064 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20493fa6-77f6-40f2-b4c6-78d2b6f9c40b None admin] RBAC: Authorization granted {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:23:32.227786 dv-cinder-851351-1-smb devstack@keystone.service[207600]: [pid: 207600|app: 0|req: 64/132] 10.222.0.42 () {56 vars in 1101 bytes} [Thu Jul 28 08:23:31 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 414 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:23:32.233814 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20493fa6-77f6-40f2-b4c6-78d2b6f9c40b None admin] Authenticating user token {{(pid=207600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:23:32.313708 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3fe3725-be0d-42e6-b113-9e0400f8de32 None admin] Validating token access rules against request {{(pid=207601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:23:32.354301 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b0cc27-8cbc-4aaf-82f3-e7a964b2cc17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:23:32.355003 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b0cc27-8cbc-4aaf-82f3-e7a964b2cc17 None admin] REQUEST_METHOD: `GET` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:23:32.355297 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b0cc27-8cbc-4aaf-82f3-e7a964b2cc17 None admin] SCRIPT_NAME: `/identity` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:23:32.355581 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b0cc27-8cbc-4aaf-82f3-e7a964b2cc17 None admin] PATH_INFO: `/v3/projects/4a64079f46494355a0aa3aafd9a90c0c` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:23:32.357167 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67b0cc27-8cbc-4aaf-82f3-e7a964b2cc17 None admin] RBAC: Authorizing `identity:get_project(project_id=4a64079f46494355a0aa3aafd9a90c0c)` {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:23:32.358674 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67b0cc27-8cbc-4aaf-82f3-e7a964b2cc17 None admin] RBAC: Authorization granted {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:23:32.360822 dv-cinder-851351-1-smb devstack@keystone.service[207601]: [pid: 207601|app: 0|req: 69/133] 10.222.0.42 () {56 vars in 1186 bytes} [Thu Jul 28 08:23:32 2022] GET /identity/v3/projects/4a64079f46494355a0aa3aafd9a90c0c => generated 298 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:23:32.366787 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b0cc27-8cbc-4aaf-82f3-e7a964b2cc17 None admin] Authenticating user token {{(pid=207601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:23:32.410956 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG dbcounter [-] [207600] Writing DB stats keystone:SELECT=100 {{(pid=207600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:23:32.418270 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20493fa6-77f6-40f2-b4c6-78d2b6f9c40b None admin] Validating token access rules against request {{(pid=207600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:23:32.449210 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG dbcounter [-] [207601] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=207601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:23:32.482397 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b0cc27-8cbc-4aaf-82f3-e7a964b2cc17 None admin] Validating token access rules against request {{(pid=207601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:23:32.482608 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57931bbe-adf1-46e4-9204-8a5e2b735411 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:23:32.483139 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57931bbe-adf1-46e4-9204-8a5e2b735411 None admin] REQUEST_METHOD: `GET` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:23:32.483433 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57931bbe-adf1-46e4-9204-8a5e2b735411 None admin] SCRIPT_NAME: `/identity` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:23:32.483718 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57931bbe-adf1-46e4-9204-8a5e2b735411 None admin] PATH_INFO: `/v3/users/8c28b8a46b2e45fdbcbb20dfc58d7f41` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:23:32.486165 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57931bbe-adf1-46e4-9204-8a5e2b735411 None admin] RBAC: Authorizing `identity:get_user(user_id=8c28b8a46b2e45fdbcbb20dfc58d7f41)` {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:23:32.487685 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57931bbe-adf1-46e4-9204-8a5e2b735411 None admin] RBAC: Authorization granted {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:23:32.492337 dv-cinder-851351-1-smb devstack@keystone.service[207600]: [pid: 207600|app: 0|req: 65/134] 10.222.0.42 () {56 vars in 1177 bytes} [Thu Jul 28 08:23:32 2022] GET /identity/v3/users/8c28b8a46b2e45fdbcbb20dfc58d7f41 => generated 275 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:23:32.497676 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57931bbe-adf1-46e4-9204-8a5e2b735411 None admin] Authenticating user token {{(pid=207600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:23:32.524361 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d7c5d4-5d43-4c4c-840c-3745de30c9ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:23:32.525311 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d7c5d4-5d43-4c4c-840c-3745de30c9ee None admin] REQUEST_METHOD: `PUT` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:23:32.525594 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d7c5d4-5d43-4c4c-840c-3745de30c9ee None admin] SCRIPT_NAME: `/identity` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:23:32.525882 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d7c5d4-5d43-4c4c-840c-3745de30c9ee None admin] PATH_INFO: `/v3/projects/4a64079f46494355a0aa3aafd9a90c0c/users/8c28b8a46b2e45fdbcbb20dfc58d7f41/roles/e617201b25d44cb1844c9f28bcac91fb` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:23:32.528706 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4d7c5d4-5d43-4c4c-840c-3745de30c9ee None admin] RBAC: Authorizing `identity:create_grant(project_id=4a64079f46494355a0aa3aafd9a90c0c, user_id=8c28b8a46b2e45fdbcbb20dfc58d7f41, role_id=e617201b25d44cb1844c9f28bcac91fb)` {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:23:32.530306 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4d7c5d4-5d43-4c4c-840c-3745de30c9ee None admin] RBAC: Authorization granted {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:23:32.558785 dv-cinder-851351-1-smb devstack@keystone.service[207601]: [pid: 207601|app: 0|req: 70/135] 10.222.0.42 () {58 vars in 1439 bytes} [Thu Jul 28 08:23:32 2022] PUT /identity/v3/projects/4a64079f46494355a0aa3aafd9a90c0c/users/8c28b8a46b2e45fdbcbb20dfc58d7f41/roles/e617201b25d44cb1844c9f28bcac91fb => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 08:23:32.653325 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57931bbe-adf1-46e4-9204-8a5e2b735411 None admin] Validating token access rules against request {{(pid=207600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:23:32.710207 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ab0b58-3a9d-47d8-8e9d-a5dbae227329 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:23:32.710876 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ab0b58-3a9d-47d8-8e9d-a5dbae227329 None admin] REQUEST_METHOD: `GET` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:23:32.711168 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ab0b58-3a9d-47d8-8e9d-a5dbae227329 None admin] SCRIPT_NAME: `/identity` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:23:32.711450 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ab0b58-3a9d-47d8-8e9d-a5dbae227329 None admin] PATH_INFO: `/v3/projects/c929b0da67274d9a84f2281af295d8ed` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:23:32.712752 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6ab0b58-3a9d-47d8-8e9d-a5dbae227329 None admin] RBAC: Authorizing `identity:get_project(project_id=c929b0da67274d9a84f2281af295d8ed)` {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:23:32.714284 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6ab0b58-3a9d-47d8-8e9d-a5dbae227329 None admin] RBAC: Authorization granted {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:23:32.716988 dv-cinder-851351-1-smb devstack@keystone.service[207600]: [pid: 207600|app: 0|req: 66/136] 10.222.0.42 () {56 vars in 1186 bytes} [Thu Jul 28 08:23:32 2022] GET /identity/v3/projects/c929b0da67274d9a84f2281af295d8ed => generated 312 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:23:32.722626 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d7c5d4-5d43-4c4c-840c-3745de30c9ee None admin] Authenticating user token {{(pid=207601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:23:32.849812 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d7c5d4-5d43-4c4c-840c-3745de30c9ee None admin] Validating token access rules against request {{(pid=207601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:23:32.871898 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG dbcounter [-] [207601] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=207601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:23:32.892438 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6d88a8-88fc-4c78-b12b-8268dc739224 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:23:32.893207 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6d88a8-88fc-4c78-b12b-8268dc739224 None admin] REQUEST_METHOD: `PUT` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:23:32.893500 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6d88a8-88fc-4c78-b12b-8268dc739224 None admin] SCRIPT_NAME: `/identity` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:23:32.893789 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6d88a8-88fc-4c78-b12b-8268dc739224 None admin] PATH_INFO: `/v3/projects/c929b0da67274d9a84f2281af295d8ed/users/8c28b8a46b2e45fdbcbb20dfc58d7f41/roles/70a2fd2878c549aeb19b16ec37e37164` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:23:32.896088 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c6d88a8-88fc-4c78-b12b-8268dc739224 None admin] RBAC: Authorizing `identity:create_grant(project_id=c929b0da67274d9a84f2281af295d8ed, user_id=8c28b8a46b2e45fdbcbb20dfc58d7f41, role_id=70a2fd2878c549aeb19b16ec37e37164)` {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:23:32.899710 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c6d88a8-88fc-4c78-b12b-8268dc739224 None admin] RBAC: Authorization granted {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:23:32.915375 dv-cinder-851351-1-smb devstack@keystone.service[207601]: [pid: 207601|app: 0|req: 71/137] 10.222.0.42 () {58 vars in 1439 bytes} [Thu Jul 28 08:23:32 2022] PUT /identity/v3/projects/c929b0da67274d9a84f2281af295d8ed/users/8c28b8a46b2e45fdbcbb20dfc58d7f41/roles/70a2fd2878c549aeb19b16ec37e37164 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 08:23:33.125946 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6db855-e400-47a2-9f6a-35346d085626 None None] REQUEST_METHOD: `GET` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:23:33.126537 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6db855-e400-47a2-9f6a-35346d085626 None None] SCRIPT_NAME: `/identity` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:23:33.126537 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6db855-e400-47a2-9f6a-35346d085626 None None] PATH_INFO: `/` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:23:33.127900 dv-cinder-851351-1-smb devstack@keystone.service[207600]: [pid: 207600|app: 0|req: 67/138] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 08:23:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 08:23:33.133756 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3cdb53-8fc4-49d6-bd91-4d9a24cefab1 None None] REQUEST_METHOD: `POST` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:23:33.134290 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3cdb53-8fc4-49d6-bd91-4d9a24cefab1 None None] SCRIPT_NAME: `/identity` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:23:33.134408 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3cdb53-8fc4-49d6-bd91-4d9a24cefab1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:23:33.161955 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.auth.core [None req-0b3cdb53-8fc4-49d6-bd91-4d9a24cefab1 None None] MFA Rules not processed for user `b8110ade874c4aa7af27f5c376df700a`. Rule list: `[]` (Enabled: `True`). {{(pid=207601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 08:23:33.163228 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.fernet_utils [None req-0b3cdb53-8fc4-49d6-bd91-4d9a24cefab1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=207601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:23:33.242753 dv-cinder-851351-1-smb devstack@keystone.service[207601]: [pid: 207601|app: 0|req: 72/139] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 08:23:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 08:23:33.268467 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e6db855-e400-47a2-9f6a-35346d085626 None None] Authenticating user token {{(pid=207600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:23:33.306730 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG dbcounter [-] [207600] Writing DB stats keystone:SELECT=100 {{(pid=207600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:23:33.399514 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e6db855-e400-47a2-9f6a-35346d085626 None None] Validating token access rules against request {{(pid=207600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:23:33.444533 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9ffdd7-3b7a-4bd2-9383-ac606fe1b27c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:23:33.445242 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9ffdd7-3b7a-4bd2-9383-ac606fe1b27c None admin] REQUEST_METHOD: `GET` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:23:33.445579 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9ffdd7-3b7a-4bd2-9383-ac606fe1b27c None admin] SCRIPT_NAME: `/identity` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:23:33.445867 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9ffdd7-3b7a-4bd2-9383-ac606fe1b27c None admin] PATH_INFO: `/v3/roles/member` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:23:33.460624 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d9ffdd7-3b7a-4bd2-9383-ac606fe1b27c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 08:23:33.466977 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application [None req-3d9ffdd7-3b7a-4bd2-9383-ac606fe1b27c None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 28 08:23:33.466977 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:23:33.466977 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:23:33.466977 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:23:33.466977 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:23:33.466977 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:23:33.466977 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:23:33.466977 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:23:33.466977 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:23:33.466977 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:23:33.466977 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:23:33.466977 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:23:33.466977 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 08:23:33.466977 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 08:23:33.466977 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 08:23:33.466977 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 08:23:33.469422 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 08:23:33.469422 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 08:23:33.469422 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 08:23:33.469422 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 08:23:33.469422 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:23:33.469422 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:23:33.469422 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:23:33.469422 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:23:33.469422 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:23:33.469422 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:23:33.469422 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:23:33.469422 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application with Lock( Jul 28 08:23:33.469422 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:23:33.469422 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:23:33.469422 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:23:33.469422 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:23:33.471524 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:23:33.471524 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:23:33.471524 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:23:33.471524 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:23:33.471524 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 08:23:33.471524 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 08:23:33.471524 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 08:23:33.471524 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 08:23:33.471524 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 08:23:33.471524 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 08:23:33.471524 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 28 08:23:33.471524 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application Jul 28 08:23:33.471524 dv-cinder-851351-1-smb devstack@keystone.service[207600]: [pid: 207600|app: 0|req: 68/140] 10.222.0.42 () {56 vars in 1099 bytes} [Thu Jul 28 08:23:33 2022] GET /identity/v3/roles/member => generated 84 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:23:33.476694 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b3cdb53-8fc4-49d6-bd91-4d9a24cefab1 None None] Authenticating user token {{(pid=207601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:23:33.601420 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b3cdb53-8fc4-49d6-bd91-4d9a24cefab1 None None] Validating token access rules against request {{(pid=207601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:23:33.613373 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG dbcounter [-] [207601] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=207601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:23:33.646900 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9779bddb-d9d4-48df-9d54-92110fb97303 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:23:33.647556 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9779bddb-d9d4-48df-9d54-92110fb97303 None admin] REQUEST_METHOD: `GET` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:23:33.647848 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9779bddb-d9d4-48df-9d54-92110fb97303 None admin] SCRIPT_NAME: `/identity` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:23:33.648134 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9779bddb-d9d4-48df-9d54-92110fb97303 None admin] PATH_INFO: `/v3/roles` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:23:33.648943 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9779bddb-d9d4-48df-9d54-92110fb97303 None admin] RBAC: Adding query filter params (name=member) {{(pid=207601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:23:33.649356 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9779bddb-d9d4-48df-9d54-92110fb97303 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:23:33.650831 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9779bddb-d9d4-48df-9d54-92110fb97303 None admin] RBAC: Authorization granted {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:23:33.660413 dv-cinder-851351-1-smb devstack@keystone.service[207601]: [pid: 207601|app: 0|req: 73/141] 10.222.0.42 () {56 vars in 1101 bytes} [Thu Jul 28 08:23:33 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:23:33.666994 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9ffdd7-3b7a-4bd2-9383-ac606fe1b27c None admin] Authenticating user token {{(pid=207600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:23:33.801393 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG dbcounter [-] [207600] Writing DB stats keystone:SELECT=100 {{(pid=207600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:23:33.808999 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9ffdd7-3b7a-4bd2-9383-ac606fe1b27c None admin] Validating token access rules against request {{(pid=207600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:23:33.854177 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88631f34-c275-486b-8509-154c601e21fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:23:33.854853 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88631f34-c275-486b-8509-154c601e21fa None admin] REQUEST_METHOD: `GET` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:23:33.855147 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88631f34-c275-486b-8509-154c601e21fa None admin] SCRIPT_NAME: `/identity` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:23:33.855433 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88631f34-c275-486b-8509-154c601e21fa None admin] PATH_INFO: `/v3/users/8c28b8a46b2e45fdbcbb20dfc58d7f41` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:23:33.856838 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88631f34-c275-486b-8509-154c601e21fa None admin] RBAC: Authorizing `identity:get_user(user_id=8c28b8a46b2e45fdbcbb20dfc58d7f41)` {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:23:33.858482 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88631f34-c275-486b-8509-154c601e21fa None admin] RBAC: Authorization granted {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:23:33.860270 dv-cinder-851351-1-smb devstack@keystone.service[207600]: [pid: 207600|app: 0|req: 69/142] 10.222.0.42 () {56 vars in 1177 bytes} [Thu Jul 28 08:23:33 2022] GET /identity/v3/users/8c28b8a46b2e45fdbcbb20dfc58d7f41 => generated 275 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:23:33.866678 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9779bddb-d9d4-48df-9d54-92110fb97303 None admin] Authenticating user token {{(pid=207601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:23:33.939764 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65167c8-367d-4495-99db-63b46caf82bb None None] REQUEST_METHOD: `GET` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:23:33.939974 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65167c8-367d-4495-99db-63b46caf82bb None None] SCRIPT_NAME: `/identity` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:23:33.940235 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65167c8-367d-4495-99db-63b46caf82bb None None] PATH_INFO: `/` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:23:33.942019 dv-cinder-851351-1-smb devstack@keystone.service[207600]: [pid: 207600|app: 0|req: 70/143] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 08:23:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 08:23:33.947514 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34bf7d5c-5b71-4b38-ac92-b7eb5997f572 None None] REQUEST_METHOD: `POST` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:23:33.947845 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34bf7d5c-5b71-4b38-ac92-b7eb5997f572 None None] SCRIPT_NAME: `/identity` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:23:33.948093 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34bf7d5c-5b71-4b38-ac92-b7eb5997f572 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:23:33.976434 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.auth.core [None req-34bf7d5c-5b71-4b38-ac92-b7eb5997f572 None None] MFA Rules not processed for user `b8110ade874c4aa7af27f5c376df700a`. Rule list: `[]` (Enabled: `True`). {{(pid=207600) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 08:23:33.977697 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.fernet_utils [None req-34bf7d5c-5b71-4b38-ac92-b7eb5997f572 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=207600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:23:34.024311 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9779bddb-d9d4-48df-9d54-92110fb97303 None admin] Validating token access rules against request {{(pid=207601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:23:34.074037 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51fa9f0-34c2-4aa9-b902-845498527349 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:23:34.074934 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51fa9f0-34c2-4aa9-b902-845498527349 None admin] REQUEST_METHOD: `GET` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:23:34.075174 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51fa9f0-34c2-4aa9-b902-845498527349 None admin] SCRIPT_NAME: `/identity` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:23:34.075563 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51fa9f0-34c2-4aa9-b902-845498527349 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:23:34.123186 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG dbcounter [-] [207601] Writing DB stats keystone:SELECT=100 {{(pid=207601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:23:34.139268 dv-cinder-851351-1-smb devstack@keystone.service[207600]: [pid: 207600|app: 0|req: 71/144] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 08:23:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 363 bytes (3 switches on core 0) Jul 28 08:23:34.140404 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737619f6-0023-4ae1-9f96-25cd8c33ee94 None None] REQUEST_METHOD: `GET` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:23:34.140719 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737619f6-0023-4ae1-9f96-25cd8c33ee94 None None] SCRIPT_NAME: `/identity` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:23:34.141008 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737619f6-0023-4ae1-9f96-25cd8c33ee94 None None] PATH_INFO: `/` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:23:34.142321 dv-cinder-851351-1-smb devstack@keystone.service[207600]: [pid: 207600|app: 0|req: 72/145] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 08:23:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 08:23:34.150075 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113e6908-33c7-4636-9ef1-1fb82746076a None None] REQUEST_METHOD: `POST` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:23:34.150357 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113e6908-33c7-4636-9ef1-1fb82746076a None None] SCRIPT_NAME: `/identity` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:23:34.150625 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113e6908-33c7-4636-9ef1-1fb82746076a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:23:34.165350 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a51fa9f0-34c2-4aa9-b902-845498527349 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:23:34.168904 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a51fa9f0-34c2-4aa9-b902-845498527349 None admin] RBAC: Authorization granted {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:23:34.189701 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.auth.core [None req-113e6908-33c7-4636-9ef1-1fb82746076a None None] MFA Rules not processed for user `b8110ade874c4aa7af27f5c376df700a`. Rule list: `[]` (Enabled: `True`). {{(pid=207600) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 08:23:34.190991 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.fernet_utils [None req-113e6908-33c7-4636-9ef1-1fb82746076a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=207600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:23:34.334868 dv-cinder-851351-1-smb devstack@keystone.service[207600]: [pid: 207600|app: 0|req: 73/146] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 08:23:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 08:23:34.336196 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-113e6908-33c7-4636-9ef1-1fb82746076a None None] Authenticating user token {{(pid=207600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:23:34.341408 dv-cinder-851351-1-smb devstack@keystone.service[207601]: [pid: 207601|app: 0|req: 74/147] 10.222.0.42 () {58 vars in 1282 bytes} [Thu Jul 28 08:23:33 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 475 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 28 08:23:34.345004 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51fa9f0-34c2-4aa9-b902-845498527349 None admin] Authenticating user token {{(pid=207601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:23:34.377936 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG dbcounter [-] [207600] Writing DB stats keystone:SELECT=100 {{(pid=207600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:23:34.514777 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-113e6908-33c7-4636-9ef1-1fb82746076a None None] Validating token access rules against request {{(pid=207600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:23:34.569500 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG dbcounter [-] [207601] Writing DB stats keystone:SELECT=100 {{(pid=207601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:23:34.589773 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ac6490-f815-42c6-8165-5a61eac7f6b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:23:34.590757 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ac6490-f815-42c6-8165-5a61eac7f6b0 None admin] REQUEST_METHOD: `GET` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:23:34.591261 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ac6490-f815-42c6-8165-5a61eac7f6b0 None admin] SCRIPT_NAME: `/identity` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:23:34.591697 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ac6490-f815-42c6-8165-5a61eac7f6b0 None admin] PATH_INFO: `/v3/domains/default` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:23:34.593380 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18ac6490-f815-42c6-8165-5a61eac7f6b0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:23:34.595054 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18ac6490-f815-42c6-8165-5a61eac7f6b0 None admin] RBAC: Authorization granted {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:23:34.600983 dv-cinder-851351-1-smb devstack@keystone.service[207600]: [pid: 207600|app: 0|req: 74/148] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 08:23:34 2022] GET /identity/v3/domains/default => generated 199 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:23:34.602101 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ac6490-f815-42c6-8165-5a61eac7f6b0 None admin] Authenticating user token {{(pid=207600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:23:34.726764 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51fa9f0-34c2-4aa9-b902-845498527349 None admin] Validating token access rules against request {{(pid=207601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:23:34.824331 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG dbcounter [-] [207600] Writing DB stats keystone:SELECT=100 {{(pid=207600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:23:34.866702 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ac6490-f815-42c6-8165-5a61eac7f6b0 None admin] Validating token access rules against request {{(pid=207600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:23:34.874008 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dbfcba7-6d15-4a7a-9270-116fe05ab1f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:23:34.874709 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbfcba7-6d15-4a7a-9270-116fe05ab1f5 None admin] REQUEST_METHOD: `GET` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:23:34.874999 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbfcba7-6d15-4a7a-9270-116fe05ab1f5 None admin] SCRIPT_NAME: `/identity` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:23:34.875282 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbfcba7-6d15-4a7a-9270-116fe05ab1f5 None admin] PATH_INFO: `/v3/projects/4a64079f46494355a0aa3aafd9a90c0c` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:23:34.876776 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dbfcba7-6d15-4a7a-9270-116fe05ab1f5 None admin] RBAC: Authorizing `identity:get_project(project_id=4a64079f46494355a0aa3aafd9a90c0c)` {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:23:34.879223 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dbfcba7-6d15-4a7a-9270-116fe05ab1f5 None admin] RBAC: Authorization granted {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:23:34.897510 dv-cinder-851351-1-smb devstack@keystone.service[207601]: [pid: 207601|app: 0|req: 75/149] 10.222.0.42 () {56 vars in 1186 bytes} [Thu Jul 28 08:23:34 2022] GET /identity/v3/projects/4a64079f46494355a0aa3aafd9a90c0c => generated 298 bytes in 549 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:23:34.898514 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dbfcba7-6d15-4a7a-9270-116fe05ab1f5 None admin] Authenticating user token {{(pid=207601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:23:35.029854 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-822f0805-2c5a-4cbd-b66f-a74eb66f4e2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:23:35.030553 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822f0805-2c5a-4cbd-b66f-a74eb66f4e2c None admin] REQUEST_METHOD: `GET` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:23:35.030832 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822f0805-2c5a-4cbd-b66f-a74eb66f4e2c None admin] SCRIPT_NAME: `/identity` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:23:35.031103 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822f0805-2c5a-4cbd-b66f-a74eb66f4e2c None admin] PATH_INFO: `/v3/roles/reader` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:23:35.042609 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-822f0805-2c5a-4cbd-b66f-a74eb66f4e2c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 08:23:35.049435 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application [None req-822f0805-2c5a-4cbd-b66f-a74eb66f4e2c None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 28 08:23:35.049435 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:23:35.049435 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:23:35.049435 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:23:35.049435 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:23:35.049435 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:23:35.049435 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:23:35.049435 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:23:35.049435 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:23:35.049435 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:23:35.049435 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:23:35.049435 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:23:35.049435 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 08:23:35.049435 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 08:23:35.049435 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 08:23:35.049435 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 08:23:35.050648 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 08:23:35.050648 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 08:23:35.050648 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 08:23:35.050648 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 08:23:35.050648 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:23:35.050648 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:23:35.050648 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:23:35.050648 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:23:35.050648 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:23:35.050648 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:23:35.050648 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:23:35.050648 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application with Lock( Jul 28 08:23:35.050648 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:23:35.050648 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:23:35.050648 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:23:35.050648 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:23:35.052077 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:23:35.052077 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:23:35.052077 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:23:35.052077 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:23:35.052077 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 08:23:35.052077 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 08:23:35.052077 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 08:23:35.052077 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 08:23:35.052077 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 08:23:35.052077 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 08:23:35.052077 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 28 08:23:35.052077 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application Jul 28 08:23:35.053103 dv-cinder-851351-1-smb devstack@keystone.service[207600]: [pid: 207600|app: 0|req: 75/150] 10.222.0.42 () {56 vars in 1099 bytes} [Thu Jul 28 08:23:34 2022] GET /identity/v3/roles/reader => generated 84 bytes in 451 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:23:35.056688 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-822f0805-2c5a-4cbd-b66f-a74eb66f4e2c None admin] Authenticating user token {{(pid=207600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:23:35.094330 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dbfcba7-6d15-4a7a-9270-116fe05ab1f5 None admin] Validating token access rules against request {{(pid=207601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:23:35.147675 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-978318b6-2793-4083-b58e-87adc20f4f2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:23:35.148443 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978318b6-2793-4083-b58e-87adc20f4f2b None admin] REQUEST_METHOD: `POST` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:23:35.148762 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978318b6-2793-4083-b58e-87adc20f4f2b None admin] SCRIPT_NAME: `/identity` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:23:35.149044 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978318b6-2793-4083-b58e-87adc20f4f2b None admin] PATH_INFO: `/v3/users` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:23:35.150027 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-978318b6-2793-4083-b58e-87adc20f4f2b None admin] RBAC: Authorizing `identity:create_user()` {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:23:35.152320 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-978318b6-2793-4083-b58e-87adc20f4f2b None admin] RBAC: Authorization granted {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:23:35.170630 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-822f0805-2c5a-4cbd-b66f-a74eb66f4e2c None admin] Validating token access rules against request {{(pid=207600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:23:35.175251 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG dbcounter [-] [207601] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=207601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:23:35.192958 dv-cinder-851351-1-smb devstack@keystone.service[207601]: [pid: 207601|app: 0|req: 76/151] 10.222.0.42 () {60 vars in 1132 bytes} [Thu Jul 28 08:23:34 2022] POST /identity/v3/users => generated 283 bytes in 295 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 08:23:35.194655 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af701c57-82b9-4eca-94f1-ecd4f7c90a5f None None] REQUEST_METHOD: `GET` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:23:35.195264 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af701c57-82b9-4eca-94f1-ecd4f7c90a5f None None] SCRIPT_NAME: `/identity` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:23:35.195560 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af701c57-82b9-4eca-94f1-ecd4f7c90a5f None None] PATH_INFO: `/` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:23:35.197689 dv-cinder-851351-1-smb devstack@keystone.service[207601]: [pid: 207601|app: 0|req: 77/152] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 08:23:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 08:23:35.198318 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af701c57-82b9-4eca-94f1-ecd4f7c90a5f None None] Authenticating user token {{(pid=207601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:23:35.221297 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f772b508-355d-4bff-be1b-e305fdf8ea24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:23:35.222290 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f772b508-355d-4bff-be1b-e305fdf8ea24 None admin] REQUEST_METHOD: `GET` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:23:35.222670 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f772b508-355d-4bff-be1b-e305fdf8ea24 None admin] SCRIPT_NAME: `/identity` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:23:35.223170 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f772b508-355d-4bff-be1b-e305fdf8ea24 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:23:35.224160 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f772b508-355d-4bff-be1b-e305fdf8ea24 None admin] RBAC: Adding query filter params (role.id=70a2fd2878c549aeb19b16ec37e37164, scope.project.id=4a64079f46494355a0aa3aafd9a90c0c, user.id=8c28b8a46b2e45fdbcbb20dfc58d7f41) {{(pid=207600) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:23:35.224642 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f772b508-355d-4bff-be1b-e305fdf8ea24 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:23:35.226457 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f772b508-355d-4bff-be1b-e305fdf8ea24 None admin] RBAC: Authorization granted {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:23:35.244694 dv-cinder-851351-1-smb devstack@keystone.service[207600]: [pid: 207600|app: 0|req: 76/153] 10.222.0.42 () {56 vars in 1374 bytes} [Thu Jul 28 08:23:35 2022] GET /identity/v3/role_assignments?user.id=8c28b8a46b2e45fdbcbb20dfc58d7f41&scope.project.id=4a64079f46494355a0aa3aafd9a90c0c&role.id=70a2fd2878c549aeb19b16ec37e37164 => generated 608 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:23:35.246197 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764ec6fb-19c8-40c6-b472-d6268acaa48c None None] REQUEST_METHOD: `POST` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:23:35.246492 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764ec6fb-19c8-40c6-b472-d6268acaa48c None None] SCRIPT_NAME: `/identity` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:23:35.246767 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764ec6fb-19c8-40c6-b472-d6268acaa48c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:23:35.284781 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.auth.core [None req-764ec6fb-19c8-40c6-b472-d6268acaa48c None None] MFA Rules not processed for user `b8110ade874c4aa7af27f5c376df700a`. Rule list: `[]` (Enabled: `True`). {{(pid=207600) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 08:23:35.286181 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.fernet_utils [None req-764ec6fb-19c8-40c6-b472-d6268acaa48c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=207600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:23:35.308057 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG dbcounter [-] [207600] Writing DB stats keystone:SELECT=100 {{(pid=207600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:23:35.332137 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af701c57-82b9-4eca-94f1-ecd4f7c90a5f None None] Validating token access rules against request {{(pid=207601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:23:35.379218 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cca70af-6acc-47ce-9d2e-4f6e9eb04136 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:23:35.379787 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cca70af-6acc-47ce-9d2e-4f6e9eb04136 None admin] REQUEST_METHOD: `GET` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:23:35.380073 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cca70af-6acc-47ce-9d2e-4f6e9eb04136 None admin] SCRIPT_NAME: `/identity` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:23:35.382368 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cca70af-6acc-47ce-9d2e-4f6e9eb04136 None admin] PATH_INFO: `/v3/roles` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:23:35.382368 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cca70af-6acc-47ce-9d2e-4f6e9eb04136 None admin] RBAC: Adding query filter params (name=reader) {{(pid=207601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:23:35.382368 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cca70af-6acc-47ce-9d2e-4f6e9eb04136 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:23:35.383655 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cca70af-6acc-47ce-9d2e-4f6e9eb04136 None admin] RBAC: Authorization granted {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:23:35.394882 dv-cinder-851351-1-smb devstack@keystone.service[207601]: [pid: 207601|app: 0|req: 78/154] 10.222.0.42 () {56 vars in 1101 bytes} [Thu Jul 28 08:23:35 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:23:35.400846 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cca70af-6acc-47ce-9d2e-4f6e9eb04136 None admin] Authenticating user token {{(pid=207601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:23:35.419066 dv-cinder-851351-1-smb devstack@keystone.service[207600]: [pid: 207600|app: 0|req: 77/155] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 08:23:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 08:23:35.445884 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-764ec6fb-19c8-40c6-b472-d6268acaa48c None None] Authenticating user token {{(pid=207600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:23:35.473353 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG dbcounter [-] [207601] Writing DB stats keystone:SELECT=100 {{(pid=207601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:23:35.524458 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cca70af-6acc-47ce-9d2e-4f6e9eb04136 None admin] Validating token access rules against request {{(pid=207601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:23:35.567921 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4124f6c-e67f-483f-bcf2-5dbaddd30636 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:23:35.568601 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4124f6c-e67f-483f-bcf2-5dbaddd30636 None admin] REQUEST_METHOD: `GET` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:23:35.568747 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-764ec6fb-19c8-40c6-b472-d6268acaa48c None None] Validating token access rules against request {{(pid=207600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:23:35.568926 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4124f6c-e67f-483f-bcf2-5dbaddd30636 None admin] SCRIPT_NAME: `/identity` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:23:35.569192 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4124f6c-e67f-483f-bcf2-5dbaddd30636 None admin] PATH_INFO: `/v3/users/1c3d0bca92884996b0a179a4a76a7d45` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:23:35.570454 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4124f6c-e67f-483f-bcf2-5dbaddd30636 None admin] RBAC: Authorizing `identity:get_user(user_id=1c3d0bca92884996b0a179a4a76a7d45)` {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:23:35.572176 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4124f6c-e67f-483f-bcf2-5dbaddd30636 None admin] RBAC: Authorization granted {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:23:35.574861 dv-cinder-851351-1-smb devstack@keystone.service[207601]: [pid: 207601|app: 0|req: 79/156] 10.222.0.42 () {56 vars in 1177 bytes} [Thu Jul 28 08:23:35 2022] GET /identity/v3/users/1c3d0bca92884996b0a179a4a76a7d45 => generated 289 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:23:35.580546 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4124f6c-e67f-483f-bcf2-5dbaddd30636 None admin] Authenticating user token {{(pid=207601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:23:35.611653 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295721ad-ff36-434f-bd0a-49efe7a4ade0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:23:35.612330 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295721ad-ff36-434f-bd0a-49efe7a4ade0 None admin] REQUEST_METHOD: `GET` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:23:35.612657 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295721ad-ff36-434f-bd0a-49efe7a4ade0 None admin] SCRIPT_NAME: `/identity` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:23:35.612981 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295721ad-ff36-434f-bd0a-49efe7a4ade0 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:23:35.624615 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-295721ad-ff36-434f-bd0a-49efe7a4ade0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 08:23:35.630576 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application [None req-295721ad-ff36-434f-bd0a-49efe7a4ade0 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 08:23:35.630576 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:23:35.630576 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:23:35.630576 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:23:35.630576 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:23:35.630576 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:23:35.630576 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:23:35.630576 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:23:35.630576 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:23:35.630576 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:23:35.630576 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:23:35.630576 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:23:35.630576 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 08:23:35.630576 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 08:23:35.630576 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 08:23:35.630576 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 08:23:35.631576 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 08:23:35.631576 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 08:23:35.631576 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 08:23:35.631576 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 08:23:35.631576 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:23:35.631576 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:23:35.631576 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:23:35.631576 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:23:35.631576 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:23:35.631576 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:23:35.631576 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:23:35.631576 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application with Lock( Jul 28 08:23:35.631576 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:23:35.631576 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:23:35.631576 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:23:35.631576 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:23:35.634298 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:23:35.634298 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:23:35.634298 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:23:35.634298 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:23:35.634298 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 08:23:35.634298 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 08:23:35.634298 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 08:23:35.634298 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 08:23:35.634298 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 08:23:35.634298 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 08:23:35.634298 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 08:23:35.634298 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application Jul 28 08:23:35.634298 dv-cinder-851351-1-smb devstack@keystone.service[207600]: [pid: 207600|app: 0|req: 78/157] 10.222.0.42 () {56 vars in 1096 bytes} [Thu Jul 28 08:23:35 2022] GET /identity/v3/roles/admin => generated 83 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 08:23:35.638517 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295721ad-ff36-434f-bd0a-49efe7a4ade0 None admin] Authenticating user token {{(pid=207600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:23:35.643109 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG dbcounter [-] [207600] Writing DB stats keystone:SELECT=100 {{(pid=207600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:23:35.701095 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4124f6c-e67f-483f-bcf2-5dbaddd30636 None admin] Validating token access rules against request {{(pid=207601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:23:35.738064 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG dbcounter [-] [207601] Writing DB stats keystone:SELECT=100 {{(pid=207601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:23:35.742723 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49393ba9-056c-4d7d-9c76-7a49a2e85acd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:23:35.743621 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49393ba9-056c-4d7d-9c76-7a49a2e85acd None admin] REQUEST_METHOD: `GET` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:23:35.744195 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49393ba9-056c-4d7d-9c76-7a49a2e85acd None admin] SCRIPT_NAME: `/identity` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:23:35.744483 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49393ba9-056c-4d7d-9c76-7a49a2e85acd None admin] PATH_INFO: `/v3/projects/4a64079f46494355a0aa3aafd9a90c0c` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:23:35.746255 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49393ba9-056c-4d7d-9c76-7a49a2e85acd None admin] RBAC: Authorizing `identity:get_project(project_id=4a64079f46494355a0aa3aafd9a90c0c)` {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:23:35.748167 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49393ba9-056c-4d7d-9c76-7a49a2e85acd None admin] RBAC: Authorization granted {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:23:35.751002 dv-cinder-851351-1-smb devstack@keystone.service[207601]: [pid: 207601|app: 0|req: 80/158] 10.222.0.42 () {56 vars in 1186 bytes} [Thu Jul 28 08:23:35 2022] GET /identity/v3/projects/4a64079f46494355a0aa3aafd9a90c0c => generated 298 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 08:23:35.752334 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407a667b-d457-42a8-90c6-45ebee995a4a None None] REQUEST_METHOD: `GET` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:23:35.752684 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407a667b-d457-42a8-90c6-45ebee995a4a None None] SCRIPT_NAME: `/identity` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:23:35.753025 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407a667b-d457-42a8-90c6-45ebee995a4a None None] PATH_INFO: `/` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:23:35.754324 dv-cinder-851351-1-smb devstack@keystone.service[207601]: [pid: 207601|app: 0|req: 81/159] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 08:23:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 08:23:35.760000 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ae907d-bdae-46c9-b1f5-cb351664749b None None] REQUEST_METHOD: `POST` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:23:35.760245 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ae907d-bdae-46c9-b1f5-cb351664749b None None] SCRIPT_NAME: `/identity` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:23:35.760535 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ae907d-bdae-46c9-b1f5-cb351664749b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:23:35.766802 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295721ad-ff36-434f-bd0a-49efe7a4ade0 None admin] Validating token access rules against request {{(pid=207600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:23:35.785303 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.auth.core [None req-76ae907d-bdae-46c9-b1f5-cb351664749b None None] MFA Rules not processed for user `b8110ade874c4aa7af27f5c376df700a`. Rule list: `[]` (Enabled: `True`). {{(pid=207601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 08:23:35.786533 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.fernet_utils [None req-76ae907d-bdae-46c9-b1f5-cb351664749b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=207601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:23:35.816870 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279ed6dc-814e-475e-aafb-3a50d2dd8099 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:23:35.818172 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279ed6dc-814e-475e-aafb-3a50d2dd8099 None admin] REQUEST_METHOD: `GET` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:23:35.818868 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279ed6dc-814e-475e-aafb-3a50d2dd8099 None admin] SCRIPT_NAME: `/identity` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:23:35.819313 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279ed6dc-814e-475e-aafb-3a50d2dd8099 None admin] PATH_INFO: `/v3/roles` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:23:35.820389 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-279ed6dc-814e-475e-aafb-3a50d2dd8099 None admin] RBAC: Adding query filter params (name=admin) {{(pid=207600) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:23:35.820932 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-279ed6dc-814e-475e-aafb-3a50d2dd8099 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:23:35.823194 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-279ed6dc-814e-475e-aafb-3a50d2dd8099 None admin] RBAC: Authorization granted {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:23:35.835657 dv-cinder-851351-1-smb devstack@keystone.service[207600]: [pid: 207600|app: 0|req: 79/160] 10.222.0.42 () {56 vars in 1099 bytes} [Thu Jul 28 08:23:35 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:23:35.837261 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279ed6dc-814e-475e-aafb-3a50d2dd8099 None admin] Authenticating user token {{(pid=207600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:23:35.870864 dv-cinder-851351-1-smb devstack@keystone.service[207601]: [pid: 207601|app: 0|req: 82/161] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 08:23:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 28 08:23:35.871761 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ae907d-bdae-46c9-b1f5-cb351664749b None None] Authenticating user token {{(pid=207601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:23:35.946182 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG dbcounter [-] [207600] Writing DB stats keystone:SELECT=100 {{(pid=207600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:23:35.997359 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279ed6dc-814e-475e-aafb-3a50d2dd8099 None admin] Validating token access rules against request {{(pid=207600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:23:36.008017 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ae907d-bdae-46c9-b1f5-cb351664749b None None] Validating token access rules against request {{(pid=207601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:23:36.045728 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39144653-05dd-46b4-b62a-57b08bba3666 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:23:36.046444 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39144653-05dd-46b4-b62a-57b08bba3666 None admin] REQUEST_METHOD: `PUT` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:23:36.046732 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39144653-05dd-46b4-b62a-57b08bba3666 None admin] SCRIPT_NAME: `/identity` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:23:36.047013 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39144653-05dd-46b4-b62a-57b08bba3666 None admin] PATH_INFO: `/v3/projects/4a64079f46494355a0aa3aafd9a90c0c/users/1c3d0bca92884996b0a179a4a76a7d45/roles/4af3ffd96e0540dbb20e6ccb08a61f0b` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:23:36.049108 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39144653-05dd-46b4-b62a-57b08bba3666 None admin] RBAC: Authorizing `identity:create_grant(project_id=4a64079f46494355a0aa3aafd9a90c0c, user_id=1c3d0bca92884996b0a179a4a76a7d45, role_id=4af3ffd96e0540dbb20e6ccb08a61f0b)` {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:23:36.051511 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39144653-05dd-46b4-b62a-57b08bba3666 None admin] RBAC: Authorization granted {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:23:36.057810 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG dbcounter [-] [207601] Writing DB stats keystone:SELECT=100 {{(pid=207601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:23:36.063520 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225d4fef-debd-4e9b-8151-1135dd1027e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:23:36.064356 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225d4fef-debd-4e9b-8151-1135dd1027e2 None admin] REQUEST_METHOD: `GET` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:23:36.067755 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225d4fef-debd-4e9b-8151-1135dd1027e2 None admin] SCRIPT_NAME: `/identity` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:23:36.067755 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225d4fef-debd-4e9b-8151-1135dd1027e2 None admin] PATH_INFO: `/v3/users/b8110ade874c4aa7af27f5c376df700a` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:23:36.067970 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-225d4fef-debd-4e9b-8151-1135dd1027e2 None admin] RBAC: Authorizing `identity:get_user(user_id=b8110ade874c4aa7af27f5c376df700a)` {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:23:36.070276 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-225d4fef-debd-4e9b-8151-1135dd1027e2 None admin] RBAC: Authorization granted {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:23:36.072789 dv-cinder-851351-1-smb devstack@keystone.service[207601]: [pid: 207601|app: 0|req: 83/162] 10.222.0.42 () {56 vars in 1177 bytes} [Thu Jul 28 08:23:35 2022] GET /identity/v3/users/b8110ade874c4aa7af27f5c376df700a => generated 247 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:23:36.073780 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225d4fef-debd-4e9b-8151-1135dd1027e2 None admin] Authenticating user token {{(pid=207601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:23:36.077217 dv-cinder-851351-1-smb devstack@keystone.service[207600]: [pid: 207600|app: 0|req: 80/163] 10.222.0.42 () {58 vars in 1439 bytes} [Thu Jul 28 08:23:35 2022] PUT /identity/v3/projects/4a64079f46494355a0aa3aafd9a90c0c/users/1c3d0bca92884996b0a179a4a76a7d45/roles/4af3ffd96e0540dbb20e6ccb08a61f0b => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 08:23:36.081965 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39144653-05dd-46b4-b62a-57b08bba3666 None admin] Authenticating user token {{(pid=207600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:23:36.225800 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225d4fef-debd-4e9b-8151-1135dd1027e2 None admin] Validating token access rules against request {{(pid=207601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:23:36.250555 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39144653-05dd-46b4-b62a-57b08bba3666 None admin] Validating token access rules against request {{(pid=207600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:23:36.285337 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81a335a-ad66-47e4-ac34-74629bc693a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:23:36.286032 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81a335a-ad66-47e4-ac34-74629bc693a4 None admin] REQUEST_METHOD: `GET` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:23:36.286305 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81a335a-ad66-47e4-ac34-74629bc693a4 None admin] SCRIPT_NAME: `/identity` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:23:36.286575 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81a335a-ad66-47e4-ac34-74629bc693a4 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:23:36.289116 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG dbcounter [-] [207600] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=207600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:23:36.308967 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c4f0a9-d5f1-4cfe-bc9c-e70406bde656 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:23:36.309633 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c4f0a9-d5f1-4cfe-bc9c-e70406bde656 None admin] REQUEST_METHOD: `GET` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:23:36.309970 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c4f0a9-d5f1-4cfe-bc9c-e70406bde656 None admin] SCRIPT_NAME: `/identity` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:23:36.310240 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c4f0a9-d5f1-4cfe-bc9c-e70406bde656 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:23:36.317902 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d81a335a-ad66-47e4-ac34-74629bc693a4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 08:23:36.322884 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application [None req-d81a335a-ad66-47e4-ac34-74629bc693a4 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 28 08:23:36.322884 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:23:36.322884 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:23:36.322884 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:23:36.322884 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:23:36.322884 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:23:36.322884 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:23:36.322884 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:23:36.322884 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:23:36.322884 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:23:36.322884 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:23:36.322884 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:23:36.322884 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 08:23:36.322884 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 08:23:36.322884 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 08:23:36.322884 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 08:23:36.323931 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 08:23:36.323931 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 08:23:36.323931 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 08:23:36.323931 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 08:23:36.323931 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:23:36.323931 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:23:36.323931 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:23:36.323931 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:23:36.323931 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:23:36.323931 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:23:36.323931 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:23:36.323931 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application with Lock( Jul 28 08:23:36.323931 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:23:36.323931 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:23:36.323931 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:23:36.323931 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:23:36.325395 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:23:36.325395 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:23:36.325395 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:23:36.325395 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:23:36.325395 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 08:23:36.325395 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 08:23:36.325395 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 08:23:36.325395 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 08:23:36.325395 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 08:23:36.325395 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 08:23:36.325395 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 28 08:23:36.325395 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application Jul 28 08:23:36.325395 dv-cinder-851351-1-smb devstack@keystone.service[207601]: [pid: 207601|app: 0|req: 84/164] 10.222.0.42 () {56 vars in 1114 bytes} [Thu Jul 28 08:23:36 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 251 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:23:36.330720 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468b492b-c62b-432c-be11-6697a6cecbe8 None None] REQUEST_METHOD: `GET` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:23:36.331007 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468b492b-c62b-432c-be11-6697a6cecbe8 None None] SCRIPT_NAME: `/identity` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:23:36.331282 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468b492b-c62b-432c-be11-6697a6cecbe8 None None] PATH_INFO: `/` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:23:36.333059 dv-cinder-851351-1-smb devstack@keystone.service[207601]: [pid: 207601|app: 0|req: 85/165] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 08:23:36 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 08:23:36.338737 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2dbfd3-7c7d-48cc-9450-e36c5eb5caa7 None None] REQUEST_METHOD: `POST` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:23:36.339062 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2dbfd3-7c7d-48cc-9450-e36c5eb5caa7 None None] SCRIPT_NAME: `/identity` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:23:36.340187 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2dbfd3-7c7d-48cc-9450-e36c5eb5caa7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:23:36.361235 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.auth.core [None req-cd2dbfd3-7c7d-48cc-9450-e36c5eb5caa7 None None] MFA Rules not processed for user `b8110ade874c4aa7af27f5c376df700a`. Rule list: `[]` (Enabled: `True`). {{(pid=207601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 08:23:36.362521 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.fernet_utils [None req-cd2dbfd3-7c7d-48cc-9450-e36c5eb5caa7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=207601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:23:36.422295 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG dbcounter [-] [207601] Writing DB stats keystone:SELECT=100 {{(pid=207601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:23:36.436599 dv-cinder-851351-1-smb devstack@keystone.service[207601]: [pid: 207601|app: 0|req: 86/166] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 08:23:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 28 08:23:36.441158 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2dbfd3-7c7d-48cc-9450-e36c5eb5caa7 None None] Authenticating user token {{(pid=207601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:23:36.550508 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2dbfd3-7c7d-48cc-9450-e36c5eb5caa7 None None] Validating token access rules against request {{(pid=207601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:23:36.553557 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c4f0a9-d5f1-4cfe-bc9c-e70406bde656 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:23:36.555089 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c4f0a9-d5f1-4cfe-bc9c-e70406bde656 None admin] RBAC: Authorization granted {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:23:36.588025 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844645f7-9dfa-4b1b-90b6-ab2998d07700 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:23:36.588686 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844645f7-9dfa-4b1b-90b6-ab2998d07700 None admin] REQUEST_METHOD: `GET` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:23:36.588970 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844645f7-9dfa-4b1b-90b6-ab2998d07700 None admin] SCRIPT_NAME: `/identity` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:23:36.589241 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844645f7-9dfa-4b1b-90b6-ab2998d07700 None admin] PATH_INFO: `/v3/roles` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:23:36.590527 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-844645f7-9dfa-4b1b-90b6-ab2998d07700 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=207601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:23:36.590846 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-844645f7-9dfa-4b1b-90b6-ab2998d07700 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:23:36.592381 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-844645f7-9dfa-4b1b-90b6-ab2998d07700 None admin] RBAC: Authorization granted {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:23:36.602266 dv-cinder-851351-1-smb devstack@keystone.service[207601]: [pid: 207601|app: 0|req: 87/167] 10.222.0.42 () {56 vars in 1111 bytes} [Thu Jul 28 08:23:36 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:23:36.605835 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844645f7-9dfa-4b1b-90b6-ab2998d07700 None admin] Authenticating user token {{(pid=207601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:23:36.659296 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG dbcounter [-] [207601] Writing DB stats keystone:SELECT=100 {{(pid=207601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:23:36.716551 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844645f7-9dfa-4b1b-90b6-ab2998d07700 None admin] Validating token access rules against request {{(pid=207601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:23:36.778719 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-415c16a8-c353-427f-90b1-3c746a8a939f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:23:36.779799 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415c16a8-c353-427f-90b1-3c746a8a939f None admin] REQUEST_METHOD: `GET` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:23:36.780302 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415c16a8-c353-427f-90b1-3c746a8a939f None admin] SCRIPT_NAME: `/identity` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:23:36.784885 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415c16a8-c353-427f-90b1-3c746a8a939f None admin] PATH_INFO: `/v3/roles/member` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:23:36.817396 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-415c16a8-c353-427f-90b1-3c746a8a939f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 08:23:36.823459 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application [None req-415c16a8-c353-427f-90b1-3c746a8a939f None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 28 08:23:36.823459 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:23:36.823459 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:23:36.823459 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:23:36.823459 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:23:36.823459 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:23:36.823459 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:23:36.823459 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:23:36.823459 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:23:36.823459 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:23:36.823459 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:23:36.823459 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:23:36.823459 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 08:23:36.823459 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 08:23:36.823459 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 08:23:36.823459 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 08:23:36.824459 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 08:23:36.824459 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 08:23:36.824459 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 08:23:36.824459 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 08:23:36.824459 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:23:36.824459 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:23:36.824459 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:23:36.824459 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:23:36.824459 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:23:36.824459 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:23:36.824459 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:23:36.824459 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application with Lock( Jul 28 08:23:36.824459 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:23:36.824459 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:23:36.824459 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:23:36.824459 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:23:36.825444 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:23:36.825444 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:23:36.825444 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:23:36.825444 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:23:36.825444 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 08:23:36.825444 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 08:23:36.825444 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 08:23:36.825444 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 08:23:36.825444 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 08:23:36.825444 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 08:23:36.825444 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 28 08:23:36.825444 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application Jul 28 08:23:36.832763 dv-cinder-851351-1-smb devstack@keystone.service[207601]: [pid: 207601|app: 0|req: 88/168] 10.222.0.42 () {56 vars in 1099 bytes} [Thu Jul 28 08:23:36 2022] GET /identity/v3/roles/member => generated 84 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:23:36.833960 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-415c16a8-c353-427f-90b1-3c746a8a939f None admin] Authenticating user token {{(pid=207601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:23:36.912211 dv-cinder-851351-1-smb devstack@keystone.service[207600]: [pid: 207600|app: 0|req: 81/169] 10.222.0.42 () {58 vars in 1282 bytes} [Thu Jul 28 08:23:36 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 831 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 28 08:23:36.913360 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c4f0a9-d5f1-4cfe-bc9c-e70406bde656 None admin] Authenticating user token {{(pid=207600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:23:36.981054 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG dbcounter [-] [207600] Writing DB stats keystone:SELECT=100 {{(pid=207600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:23:37.085135 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-415c16a8-c353-427f-90b1-3c746a8a939f None admin] Validating token access rules against request {{(pid=207601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:23:37.094049 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG dbcounter [-] [207601] Writing DB stats keystone:SELECT=100 {{(pid=207601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:23:37.142489 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c4f0a9-d5f1-4cfe-bc9c-e70406bde656 None admin] Validating token access rules against request {{(pid=207600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:23:37.180157 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8a663f-9055-40fb-9566-7b997a1090ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:23:37.180835 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8a663f-9055-40fb-9566-7b997a1090ed None admin] REQUEST_METHOD: `GET` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:23:37.181120 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8a663f-9055-40fb-9566-7b997a1090ed None admin] SCRIPT_NAME: `/identity` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:23:37.181393 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8a663f-9055-40fb-9566-7b997a1090ed None admin] PATH_INFO: `/v3/roles` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:23:37.182136 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e8a663f-9055-40fb-9566-7b997a1090ed None admin] RBAC: Adding query filter params (name=member) {{(pid=207600) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:23:37.182443 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e8a663f-9055-40fb-9566-7b997a1090ed None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:23:37.183857 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e8a663f-9055-40fb-9566-7b997a1090ed None admin] RBAC: Authorization granted {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:23:37.192744 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa6b99c-a265-4a5b-b4b9-520058eb83c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:23:37.193433 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa6b99c-a265-4a5b-b4b9-520058eb83c2 None admin] REQUEST_METHOD: `GET` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:23:37.193555 dv-cinder-851351-1-smb devstack@keystone.service[207600]: [pid: 207600|app: 0|req: 82/170] 10.222.0.42 () {56 vars in 1101 bytes} [Thu Jul 28 08:23:36 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 280 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:23:37.193801 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa6b99c-a265-4a5b-b4b9-520058eb83c2 None admin] SCRIPT_NAME: `/identity` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:23:37.194087 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa6b99c-a265-4a5b-b4b9-520058eb83c2 None admin] PATH_INFO: `/v3/users/8c28b8a46b2e45fdbcbb20dfc58d7f41` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:23:37.194511 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8a663f-9055-40fb-9566-7b997a1090ed None admin] Authenticating user token {{(pid=207600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:23:37.195565 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaa6b99c-a265-4a5b-b4b9-520058eb83c2 None admin] RBAC: Authorizing `identity:get_user(user_id=8c28b8a46b2e45fdbcbb20dfc58d7f41)` {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:23:37.197115 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaa6b99c-a265-4a5b-b4b9-520058eb83c2 None admin] RBAC: Authorization granted {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:23:37.206456 dv-cinder-851351-1-smb devstack@keystone.service[207601]: [pid: 207601|app: 0|req: 89/171] 10.222.0.42 () {56 vars in 1177 bytes} [Thu Jul 28 08:23:36 2022] GET /identity/v3/users/8c28b8a46b2e45fdbcbb20dfc58d7f41 => generated 275 bytes in 373 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:23:37.207227 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa6b99c-a265-4a5b-b4b9-520058eb83c2 None admin] Authenticating user token {{(pid=207601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:23:37.311552 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG dbcounter [-] [207600] Writing DB stats keystone:SELECT=100 {{(pid=207600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:23:37.324446 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8a663f-9055-40fb-9566-7b997a1090ed None admin] Validating token access rules against request {{(pid=207600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:23:37.361455 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2246a13b-b929-46bd-9d9b-47ce6b577daa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:23:37.362025 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2246a13b-b929-46bd-9d9b-47ce6b577daa None admin] REQUEST_METHOD: `GET` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:23:37.364646 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2246a13b-b929-46bd-9d9b-47ce6b577daa None admin] SCRIPT_NAME: `/identity` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:23:37.364970 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2246a13b-b929-46bd-9d9b-47ce6b577daa None admin] PATH_INFO: `/v3/projects/4a64079f46494355a0aa3aafd9a90c0c` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:23:37.367824 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2246a13b-b929-46bd-9d9b-47ce6b577daa None admin] RBAC: Authorizing `identity:get_project(project_id=4a64079f46494355a0aa3aafd9a90c0c)` {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:23:37.369339 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2246a13b-b929-46bd-9d9b-47ce6b577daa None admin] RBAC: Authorization granted {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:23:37.371223 dv-cinder-851351-1-smb devstack@keystone.service[207600]: [pid: 207600|app: 0|req: 83/172] 10.222.0.42 () {56 vars in 1186 bytes} [Thu Jul 28 08:23:37 2022] GET /identity/v3/projects/4a64079f46494355a0aa3aafd9a90c0c => generated 298 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:23:37.371821 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2246a13b-b929-46bd-9d9b-47ce6b577daa None admin] Authenticating user token {{(pid=207600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:23:37.448642 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa6b99c-a265-4a5b-b4b9-520058eb83c2 None admin] Validating token access rules against request {{(pid=207601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:23:37.484768 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8289bf6d-e704-4ac6-9c83-32b8b8fa2185 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:23:37.485600 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8289bf6d-e704-4ac6-9c83-32b8b8fa2185 None admin] REQUEST_METHOD: `GET` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:23:37.485939 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8289bf6d-e704-4ac6-9c83-32b8b8fa2185 None admin] SCRIPT_NAME: `/identity` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:23:37.486223 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8289bf6d-e704-4ac6-9c83-32b8b8fa2185 None admin] PATH_INFO: `/v3/users/8c28b8a46b2e45fdbcbb20dfc58d7f41` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:23:37.487422 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8289bf6d-e704-4ac6-9c83-32b8b8fa2185 None admin] RBAC: Authorizing `identity:get_user(user_id=8c28b8a46b2e45fdbcbb20dfc58d7f41)` {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:23:37.489065 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8289bf6d-e704-4ac6-9c83-32b8b8fa2185 None admin] RBAC: Authorization granted {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:23:37.497347 dv-cinder-851351-1-smb devstack@keystone.service[207601]: [pid: 207601|app: 0|req: 90/173] 10.222.0.42 () {56 vars in 1177 bytes} [Thu Jul 28 08:23:37 2022] GET /identity/v3/users/8c28b8a46b2e45fdbcbb20dfc58d7f41 => generated 275 bytes in 290 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:23:37.498257 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8289bf6d-e704-4ac6-9c83-32b8b8fa2185 None admin] Authenticating user token {{(pid=207601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:23:37.567445 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG dbcounter [-] [207601] Writing DB stats keystone:SELECT=100 {{(pid=207601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:23:37.618360 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8289bf6d-e704-4ac6-9c83-32b8b8fa2185 None admin] Validating token access rules against request {{(pid=207601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:23:37.707613 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee8ddb3-ad05-42f6-a9a2-a1650523e360 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:23:37.708769 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee8ddb3-ad05-42f6-a9a2-a1650523e360 None admin] REQUEST_METHOD: `GET` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:23:37.709276 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee8ddb3-ad05-42f6-a9a2-a1650523e360 None admin] SCRIPT_NAME: `/identity` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:23:37.709766 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee8ddb3-ad05-42f6-a9a2-a1650523e360 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:23:37.710801 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee8ddb3-ad05-42f6-a9a2-a1650523e360 None admin] RBAC: Adding query filter params (role.id=d0ce88034c6b41878db755343f5840be, scope.project.id=4a64079f46494355a0aa3aafd9a90c0c, user.id=b8110ade874c4aa7af27f5c376df700a) {{(pid=207601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:23:37.711431 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee8ddb3-ad05-42f6-a9a2-a1650523e360 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:23:37.713346 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee8ddb3-ad05-42f6-a9a2-a1650523e360 None admin] RBAC: Authorization granted {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:23:37.726134 dv-cinder-851351-1-smb devstack@keystone.service[207601]: [pid: 207601|app: 0|req: 91/174] 10.222.0.42 () {56 vars in 1374 bytes} [Thu Jul 28 08:23:37 2022] GET /identity/v3/role_assignments?user.id=b8110ade874c4aa7af27f5c376df700a&scope.project.id=4a64079f46494355a0aa3aafd9a90c0c&role.id=d0ce88034c6b41878db755343f5840be => generated 608 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:23:37.727325 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee8ddb3-ad05-42f6-a9a2-a1650523e360 None admin] Authenticating user token {{(pid=207601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:23:37.730931 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2246a13b-b929-46bd-9d9b-47ce6b577daa None admin] Validating token access rules against request {{(pid=207600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:23:37.834833 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e168b90e-6235-4539-bd03-2823677ce3a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:23:37.835501 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e168b90e-6235-4539-bd03-2823677ce3a1 None admin] REQUEST_METHOD: `GET` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:23:37.836755 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e168b90e-6235-4539-bd03-2823677ce3a1 None admin] SCRIPT_NAME: `/identity` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:23:37.836755 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e168b90e-6235-4539-bd03-2823677ce3a1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:23:37.906518 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG dbcounter [-] [207600] Writing DB stats keystone:SELECT=100 {{(pid=207600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:23:37.944592 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee8ddb3-ad05-42f6-a9a2-a1650523e360 None admin] Validating token access rules against request {{(pid=207601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:23:37.957086 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG dbcounter [-] [207601] Writing DB stats keystone:SELECT=100 {{(pid=207601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:23:38.009810 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8416040e-4ff3-4584-ad09-296384ffcff8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:23:38.010854 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8416040e-4ff3-4584-ad09-296384ffcff8 None admin] REQUEST_METHOD: `GET` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:23:38.011350 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8416040e-4ff3-4584-ad09-296384ffcff8 None admin] SCRIPT_NAME: `/identity` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:23:38.011842 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8416040e-4ff3-4584-ad09-296384ffcff8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:23:38.030884 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e168b90e-6235-4539-bd03-2823677ce3a1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:23:38.032386 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e168b90e-6235-4539-bd03-2823677ce3a1 None admin] RBAC: Authorization granted {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:23:38.128633 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8416040e-4ff3-4584-ad09-296384ffcff8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:23:38.130610 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8416040e-4ff3-4584-ad09-296384ffcff8 None admin] RBAC: Authorization granted {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:23:38.284128 dv-cinder-851351-1-smb devstack@keystone.service[207600]: [pid: 207600|app: 0|req: 84/175] 10.222.0.42 () {58 vars in 1282 bytes} [Thu Jul 28 08:23:37 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 912 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 28 08:23:38.289833 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e168b90e-6235-4539-bd03-2823677ce3a1 None admin] Authenticating user token {{(pid=207600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:23:38.338008 dv-cinder-851351-1-smb devstack@keystone.service[207601]: [pid: 207601|app: 0|req: 92/176] 10.222.0.42 () {58 vars in 1282 bytes} [Thu Jul 28 08:23:37 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 611 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 28 08:23:38.344005 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8416040e-4ff3-4584-ad09-296384ffcff8 None admin] Authenticating user token {{(pid=207601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:23:38.355899 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG dbcounter [-] [207601] Writing DB stats keystone:SELECT=100 {{(pid=207601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:23:38.393703 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG dbcounter [-] [207600] Writing DB stats keystone:SELECT=100 {{(pid=207600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:23:38.469661 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8416040e-4ff3-4584-ad09-296384ffcff8 None admin] Validating token access rules against request {{(pid=207601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:23:38.474402 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e168b90e-6235-4539-bd03-2823677ce3a1 None admin] Validating token access rules against request {{(pid=207600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:23:38.509076 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3127dd79-2f02-4308-b361-01e54a1a5ce7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:23:38.510023 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3127dd79-2f02-4308-b361-01e54a1a5ce7 None admin] REQUEST_METHOD: `GET` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:23:38.510486 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3127dd79-2f02-4308-b361-01e54a1a5ce7 None admin] SCRIPT_NAME: `/identity` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:23:38.510955 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3127dd79-2f02-4308-b361-01e54a1a5ce7 None admin] PATH_INFO: `/v3/projects/c929b0da67274d9a84f2281af295d8ed` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:23:38.512364 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3127dd79-2f02-4308-b361-01e54a1a5ce7 None admin] RBAC: Authorizing `identity:get_project(project_id=c929b0da67274d9a84f2281af295d8ed)` {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:23:38.514098 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3127dd79-2f02-4308-b361-01e54a1a5ce7 None admin] RBAC: Authorization granted {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:23:38.515994 dv-cinder-851351-1-smb devstack@keystone.service[207601]: [pid: 207601|app: 0|req: 93/177] 10.222.0.42 () {56 vars in 1186 bytes} [Thu Jul 28 08:23:38 2022] GET /identity/v3/projects/c929b0da67274d9a84f2281af295d8ed => generated 312 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 08:23:38.521833 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3127dd79-2f02-4308-b361-01e54a1a5ce7 None admin] Authenticating user token {{(pid=207601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:23:38.539015 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b0f4594-f7d0-4da8-9cb6-60a92c9ff017 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:23:38.540179 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0f4594-f7d0-4da8-9cb6-60a92c9ff017 None admin] REQUEST_METHOD: `GET` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:23:38.540765 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0f4594-f7d0-4da8-9cb6-60a92c9ff017 None admin] SCRIPT_NAME: `/identity` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:23:38.541266 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0f4594-f7d0-4da8-9cb6-60a92c9ff017 None admin] PATH_INFO: `/v3/projects/4a64079f46494355a0aa3aafd9a90c0c` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:23:38.545594 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b0f4594-f7d0-4da8-9cb6-60a92c9ff017 None admin] RBAC: Authorizing `identity:get_project(project_id=4a64079f46494355a0aa3aafd9a90c0c)` {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:23:38.547412 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b0f4594-f7d0-4da8-9cb6-60a92c9ff017 None admin] RBAC: Authorization granted {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:23:38.549769 dv-cinder-851351-1-smb devstack@keystone.service[207600]: [pid: 207600|app: 0|req: 85/178] 10.222.0.42 () {56 vars in 1186 bytes} [Thu Jul 28 08:23:38 2022] GET /identity/v3/projects/4a64079f46494355a0aa3aafd9a90c0c => generated 298 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 08:23:38.555940 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b0f4594-f7d0-4da8-9cb6-60a92c9ff017 None admin] Authenticating user token {{(pid=207600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:23:38.633605 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG dbcounter [-] [207601] Writing DB stats keystone:SELECT=100 {{(pid=207601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:23:38.683576 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3127dd79-2f02-4308-b361-01e54a1a5ce7 None admin] Validating token access rules against request {{(pid=207601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:23:38.741005 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeaba455-1842-4693-b974-306c9e93340f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:23:38.741950 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeaba455-1842-4693-b974-306c9e93340f None admin] REQUEST_METHOD: `GET` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:23:38.742384 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeaba455-1842-4693-b974-306c9e93340f None admin] SCRIPT_NAME: `/identity` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:23:38.742829 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeaba455-1842-4693-b974-306c9e93340f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:23:38.743819 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeaba455-1842-4693-b974-306c9e93340f None admin] RBAC: Adding query filter params (role.id=70a2fd2878c549aeb19b16ec37e37164, scope.project.id=c929b0da67274d9a84f2281af295d8ed, user.id=8c28b8a46b2e45fdbcbb20dfc58d7f41) {{(pid=207601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:23:38.744294 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeaba455-1842-4693-b974-306c9e93340f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:23:38.744841 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b0f4594-f7d0-4da8-9cb6-60a92c9ff017 None admin] Validating token access rules against request {{(pid=207600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:23:38.746111 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeaba455-1842-4693-b974-306c9e93340f None admin] RBAC: Authorization granted {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:23:38.752755 dv-cinder-851351-1-smb devstack@keystone.service[207601]: [pid: 207601|app: 0|req: 94/179] 10.222.0.42 () {56 vars in 1374 bytes} [Thu Jul 28 08:23:38 2022] GET /identity/v3/role_assignments?user.id=8c28b8a46b2e45fdbcbb20dfc58d7f41&scope.project.id=c929b0da67274d9a84f2281af295d8ed&role.id=70a2fd2878c549aeb19b16ec37e37164 => generated 608 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 08:23:38.760713 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772b9d91-ad18-45e1-8895-8b29bcc30e40 None None] REQUEST_METHOD: `GET` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:23:38.761487 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772b9d91-ad18-45e1-8895-8b29bcc30e40 None None] SCRIPT_NAME: `/identity` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:23:38.761922 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772b9d91-ad18-45e1-8895-8b29bcc30e40 None None] PATH_INFO: `/` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:23:38.763909 dv-cinder-851351-1-smb devstack@keystone.service[207601]: [pid: 207601|app: 0|req: 95/180] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 08:23:38 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 08:23:38.778540 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b926637-a1c7-4fcb-98d8-b495d360a6ec None None] REQUEST_METHOD: `POST` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:23:38.779112 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b926637-a1c7-4fcb-98d8-b495d360a6ec None None] SCRIPT_NAME: `/identity` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:23:38.779552 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b926637-a1c7-4fcb-98d8-b495d360a6ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:23:38.783476 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19280028-e4c3-4537-adb8-8daa7adeaa4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:23:38.784479 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19280028-e4c3-4537-adb8-8daa7adeaa4c None admin] REQUEST_METHOD: `GET` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:23:38.784999 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19280028-e4c3-4537-adb8-8daa7adeaa4c None admin] SCRIPT_NAME: `/identity` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:23:38.785493 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19280028-e4c3-4537-adb8-8daa7adeaa4c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:23:38.786527 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19280028-e4c3-4537-adb8-8daa7adeaa4c None admin] RBAC: Adding query filter params (role.id=e617201b25d44cb1844c9f28bcac91fb, scope.project.id=4a64079f46494355a0aa3aafd9a90c0c, user.id=8c28b8a46b2e45fdbcbb20dfc58d7f41) {{(pid=207600) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:23:38.787275 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19280028-e4c3-4537-adb8-8daa7adeaa4c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:23:38.796885 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG dbcounter [-] [207600] Writing DB stats keystone:SELECT=100 {{(pid=207600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:23:38.797677 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19280028-e4c3-4537-adb8-8daa7adeaa4c None admin] RBAC: Authorization granted {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:23:38.809309 dv-cinder-851351-1-smb devstack@keystone.service[207600]: [pid: 207600|app: 0|req: 86/181] 10.222.0.42 () {56 vars in 1374 bytes} [Thu Jul 28 08:23:38 2022] GET /identity/v3/role_assignments?user.id=8c28b8a46b2e45fdbcbb20dfc58d7f41&scope.project.id=4a64079f46494355a0aa3aafd9a90c0c&role.id=e617201b25d44cb1844c9f28bcac91fb => generated 608 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 08:23:38.829208 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.auth.core [None req-1b926637-a1c7-4fcb-98d8-b495d360a6ec None None] MFA Rules not processed for user `b8110ade874c4aa7af27f5c376df700a`. Rule list: `[]` (Enabled: `True`). {{(pid=207601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 08:23:38.830439 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.fernet_utils [None req-1b926637-a1c7-4fcb-98d8-b495d360a6ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=207601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:23:38.957017 dv-cinder-851351-1-smb devstack@keystone.service[207601]: [pid: 207601|app: 0|req: 96/182] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 08:23:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 28 08:23:38.991390 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19280028-e4c3-4537-adb8-8daa7adeaa4c None admin] Authenticating user token {{(pid=207600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:23:39.071291 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4579540b-6cc1-4465-8a08-fa115747dc2b None None] REQUEST_METHOD: `GET` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:23:39.072297 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4579540b-6cc1-4465-8a08-fa115747dc2b None None] SCRIPT_NAME: `/identity` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:23:39.074241 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4579540b-6cc1-4465-8a08-fa115747dc2b None None] PATH_INFO: `/` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:23:39.076479 dv-cinder-851351-1-smb devstack@keystone.service[207601]: [pid: 207601|app: 0|req: 97/183] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 08:23:39 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 08:23:39.084812 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c69807-bd34-42de-bcef-5430d329bb10 None None] REQUEST_METHOD: `POST` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:23:39.086161 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c69807-bd34-42de-bcef-5430d329bb10 None None] SCRIPT_NAME: `/identity` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:23:39.086843 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c69807-bd34-42de-bcef-5430d329bb10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:23:39.112514 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.auth.core [None req-f0c69807-bd34-42de-bcef-5430d329bb10 None None] MFA Rules not processed for user `b8110ade874c4aa7af27f5c376df700a`. Rule list: `[]` (Enabled: `True`). {{(pid=207601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 08:23:39.115471 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.fernet_utils [None req-f0c69807-bd34-42de-bcef-5430d329bb10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=207601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:23:39.164611 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19280028-e4c3-4537-adb8-8daa7adeaa4c None admin] Validating token access rules against request {{(pid=207600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:23:39.212629 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6555aee-dd67-4f3f-9cc0-e2a4377ac907 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:23:39.213785 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6555aee-dd67-4f3f-9cc0-e2a4377ac907 None admin] REQUEST_METHOD: `GET` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:23:39.214633 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6555aee-dd67-4f3f-9cc0-e2a4377ac907 None admin] SCRIPT_NAME: `/identity` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:23:39.215615 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6555aee-dd67-4f3f-9cc0-e2a4377ac907 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:23:39.224285 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG dbcounter [-] [207601] Writing DB stats keystone:SELECT=100 {{(pid=207601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:23:39.232948 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6555aee-dd67-4f3f-9cc0-e2a4377ac907 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 08:23:39.235286 dv-cinder-851351-1-smb devstack@keystone.service[207601]: [pid: 207601|app: 0|req: 98/184] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 08:23:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 08:23:39.236433 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86930f87-56c4-4dc4-b470-254a15607776 None None] REQUEST_METHOD: `GET` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:23:39.239706 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application [None req-d6555aee-dd67-4f3f-9cc0-e2a4377ac907 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 08:23:39.239706 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:23:39.239706 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:23:39.239706 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:23:39.239706 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:23:39.239706 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:23:39.239706 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:23:39.239706 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:23:39.239706 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:23:39.239706 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:23:39.239706 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:23:39.239706 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:23:39.239706 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 08:23:39.239706 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 08:23:39.239706 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 08:23:39.239706 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 08:23:39.240767 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 08:23:39.240767 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 08:23:39.240767 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 08:23:39.240767 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 08:23:39.240767 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:23:39.240767 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:23:39.240767 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:23:39.240767 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:23:39.240767 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:23:39.240767 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:23:39.240767 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:23:39.240767 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application with Lock( Jul 28 08:23:39.240767 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:23:39.240767 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:23:39.240767 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:23:39.240767 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:23:39.241658 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:23:39.241658 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:23:39.241658 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:23:39.241658 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:23:39.241658 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 08:23:39.241658 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 08:23:39.241658 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 08:23:39.241658 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 08:23:39.241658 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 08:23:39.241658 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 08:23:39.241658 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 08:23:39.241658 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application Jul 28 08:23:39.242390 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86930f87-56c4-4dc4-b470-254a15607776 None None] SCRIPT_NAME: `/identity` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:23:39.242390 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86930f87-56c4-4dc4-b470-254a15607776 None None] PATH_INFO: `/` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:23:39.242390 dv-cinder-851351-1-smb devstack@keystone.service[207601]: [pid: 207601|app: 0|req: 99/185] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 08:23:39 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 08:23:39.244427 dv-cinder-851351-1-smb devstack@keystone.service[207600]: [pid: 207600|app: 0|req: 87/186] 10.222.0.42 () {56 vars in 1096 bytes} [Thu Jul 28 08:23:38 2022] GET /identity/v3/roles/admin => generated 83 bytes in 254 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:23:39.250633 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86930f87-56c4-4dc4-b470-254a15607776 None None] Authenticating user token {{(pid=207601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:23:39.253061 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245efe88-aba8-4a42-be86-1f80a8abeb29 None None] REQUEST_METHOD: `POST` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:23:39.253534 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245efe88-aba8-4a42-be86-1f80a8abeb29 None None] SCRIPT_NAME: `/identity` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:23:39.253968 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245efe88-aba8-4a42-be86-1f80a8abeb29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:23:39.279343 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.auth.core [None req-245efe88-aba8-4a42-be86-1f80a8abeb29 None None] MFA Rules not processed for user `b8110ade874c4aa7af27f5c376df700a`. Rule list: `[]` (Enabled: `True`). {{(pid=207600) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 08:23:39.280873 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.fernet_utils [None req-245efe88-aba8-4a42-be86-1f80a8abeb29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=207600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:23:39.334715 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG dbcounter [-] [207600] Writing DB stats keystone:SELECT=100 {{(pid=207600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:23:39.363931 dv-cinder-851351-1-smb devstack@keystone.service[207600]: [pid: 207600|app: 0|req: 88/187] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 08:23:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 08:23:39.364858 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245efe88-aba8-4a42-be86-1f80a8abeb29 None None] Authenticating user token {{(pid=207600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:23:39.385636 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86930f87-56c4-4dc4-b470-254a15607776 None None] Validating token access rules against request {{(pid=207601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:23:39.420767 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb057789-a860-4bf5-8843-844774da141c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:23:39.421409 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb057789-a860-4bf5-8843-844774da141c None admin] REQUEST_METHOD: `GET` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:23:39.421698 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb057789-a860-4bf5-8843-844774da141c None admin] SCRIPT_NAME: `/identity` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:23:39.421975 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb057789-a860-4bf5-8843-844774da141c None admin] PATH_INFO: `/v3/roles` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:23:39.422713 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb057789-a860-4bf5-8843-844774da141c None admin] RBAC: Adding query filter params (name=admin) {{(pid=207601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:23:39.423025 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb057789-a860-4bf5-8843-844774da141c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:23:39.424432 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb057789-a860-4bf5-8843-844774da141c None admin] RBAC: Authorization granted {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:23:39.432642 dv-cinder-851351-1-smb devstack@keystone.service[207601]: [pid: 207601|app: 0|req: 100/188] 10.222.0.42 () {56 vars in 1099 bytes} [Thu Jul 28 08:23:39 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:23:39.433863 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b54617-efed-47fa-93b2-e91d0beffd1e None None] REQUEST_METHOD: `GET` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:23:39.434156 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b54617-efed-47fa-93b2-e91d0beffd1e None None] SCRIPT_NAME: `/identity` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:23:39.434436 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b54617-efed-47fa-93b2-e91d0beffd1e None None] PATH_INFO: `/` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:23:39.436154 dv-cinder-851351-1-smb devstack@keystone.service[207601]: [pid: 207601|app: 0|req: 101/189] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 08:23:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 08:23:39.436901 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b54617-efed-47fa-93b2-e91d0beffd1e None None] Authenticating user token {{(pid=207601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:23:39.472785 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245efe88-aba8-4a42-be86-1f80a8abeb29 None None] Validating token access rules against request {{(pid=207600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:23:39.499416 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG dbcounter [-] [207601] Writing DB stats keystone:SELECT=100 {{(pid=207601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:23:39.507561 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4cd36a-dfd0-4b49-8e04-4045e4f25885 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:23:39.508226 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4cd36a-dfd0-4b49-8e04-4045e4f25885 None admin] REQUEST_METHOD: `GET` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:23:39.508511 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4cd36a-dfd0-4b49-8e04-4045e4f25885 None admin] SCRIPT_NAME: `/identity` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:23:39.508817 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4cd36a-dfd0-4b49-8e04-4045e4f25885 None admin] PATH_INFO: `/v3/domains/default` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:23:39.510013 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab4cd36a-dfd0-4b49-8e04-4045e4f25885 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:23:39.511495 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab4cd36a-dfd0-4b49-8e04-4045e4f25885 None admin] RBAC: Authorization granted {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:23:39.513195 dv-cinder-851351-1-smb devstack@keystone.service[207600]: [pid: 207600|app: 0|req: 89/190] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 08:23:39 2022] GET /identity/v3/domains/default => generated 199 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:23:39.513972 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4cd36a-dfd0-4b49-8e04-4045e4f25885 None admin] Authenticating user token {{(pid=207600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:23:39.546983 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b54617-efed-47fa-93b2-e91d0beffd1e None None] Validating token access rules against request {{(pid=207601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:23:39.561254 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG dbcounter [-] [207600] Writing DB stats keystone:SELECT=100 {{(pid=207600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:23:39.580452 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f4f9141-9335-4981-93ab-d6d06d471fac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:23:39.581147 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4f9141-9335-4981-93ab-d6d06d471fac None admin] REQUEST_METHOD: `GET` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:23:39.581431 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4f9141-9335-4981-93ab-d6d06d471fac None admin] SCRIPT_NAME: `/identity` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:23:39.581703 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4f9141-9335-4981-93ab-d6d06d471fac None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:23:39.592503 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f4f9141-9335-4981-93ab-d6d06d471fac None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 08:23:39.597984 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application [None req-5f4f9141-9335-4981-93ab-d6d06d471fac None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 28 08:23:39.597984 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:23:39.597984 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:23:39.597984 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:23:39.597984 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:23:39.597984 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:23:39.597984 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:23:39.597984 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:23:39.597984 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:23:39.597984 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:23:39.597984 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:23:39.597984 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:23:39.597984 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 08:23:39.597984 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 08:23:39.597984 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 08:23:39.597984 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 08:23:39.598999 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 08:23:39.598999 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 08:23:39.598999 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 08:23:39.598999 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 08:23:39.598999 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:23:39.598999 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:23:39.598999 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:23:39.598999 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:23:39.598999 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:23:39.598999 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:23:39.598999 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:23:39.598999 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application with Lock( Jul 28 08:23:39.598999 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:23:39.598999 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:23:39.598999 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:23:39.598999 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:23:39.599886 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:23:39.599886 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:23:39.599886 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:23:39.599886 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:23:39.599886 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 08:23:39.599886 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 08:23:39.599886 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 08:23:39.599886 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 08:23:39.599886 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 08:23:39.599886 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 08:23:39.599886 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 28 08:23:39.599886 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application Jul 28 08:23:39.599886 dv-cinder-851351-1-smb devstack@keystone.service[207601]: [pid: 207601|app: 0|req: 102/191] 10.222.0.42 () {56 vars in 1114 bytes} [Thu Jul 28 08:23:39 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:23:39.600632 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125c87cf-8d26-4b51-bfb2-4d795cbeb53a None None] REQUEST_METHOD: `POST` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:23:39.600632 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125c87cf-8d26-4b51-bfb2-4d795cbeb53a None None] SCRIPT_NAME: `/identity` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:23:39.600890 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125c87cf-8d26-4b51-bfb2-4d795cbeb53a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:23:39.618390 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.auth.core [None req-125c87cf-8d26-4b51-bfb2-4d795cbeb53a None None] MFA Rules not processed for user `b8110ade874c4aa7af27f5c376df700a`. Rule list: `[]` (Enabled: `True`). {{(pid=207601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 08:23:39.619626 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.fernet_utils [None req-125c87cf-8d26-4b51-bfb2-4d795cbeb53a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=207601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:23:39.621736 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4cd36a-dfd0-4b49-8e04-4045e4f25885 None admin] Validating token access rules against request {{(pid=207600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:23:39.656817 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f7d8a26-78c5-4a5e-bc02-37f421273dbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:23:39.657473 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7d8a26-78c5-4a5e-bc02-37f421273dbf None admin] REQUEST_METHOD: `GET` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:23:39.657763 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7d8a26-78c5-4a5e-bc02-37f421273dbf None admin] SCRIPT_NAME: `/identity` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:23:39.658041 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7d8a26-78c5-4a5e-bc02-37f421273dbf None admin] PATH_INFO: `/v3/users/947b8ef66ba34159ba94af8aac2c1206` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:23:39.671452 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f7d8a26-78c5-4a5e-bc02-37f421273dbf None admin] RBAC: Authorizing `identity:get_user(user_id=947b8ef66ba34159ba94af8aac2c1206)` {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:23:39.672960 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f7d8a26-78c5-4a5e-bc02-37f421273dbf None admin] RBAC: Authorization granted {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:23:39.674649 dv-cinder-851351-1-smb devstack@keystone.service[207600]: [pid: 207600|app: 0|req: 90/192] 10.222.0.42 () {56 vars in 1177 bytes} [Thu Jul 28 08:23:39 2022] GET /identity/v3/users/947b8ef66ba34159ba94af8aac2c1206 => generated 283 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:23:39.675419 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f7d8a26-78c5-4a5e-bc02-37f421273dbf None admin] Authenticating user token {{(pid=207600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:23:39.691305 dv-cinder-851351-1-smb devstack@keystone.service[207601]: [pid: 207601|app: 0|req: 103/193] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 08:23:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 08:23:39.692184 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-125c87cf-8d26-4b51-bfb2-4d795cbeb53a None None] Authenticating user token {{(pid=207601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:23:39.742925 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG dbcounter [-] [207601] Writing DB stats keystone:SELECT=100 {{(pid=207601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:23:39.778337 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f7d8a26-78c5-4a5e-bc02-37f421273dbf None admin] Validating token access rules against request {{(pid=207600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:23:39.781737 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG dbcounter [-] [207600] Writing DB stats keystone:SELECT=100 {{(pid=207600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:23:39.792773 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-125c87cf-8d26-4b51-bfb2-4d795cbeb53a None None] Validating token access rules against request {{(pid=207601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:23:39.816755 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f79bf7-5f43-4ff5-abcc-22410e4e4dcd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:23:39.817405 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f79bf7-5f43-4ff5-abcc-22410e4e4dcd None admin] REQUEST_METHOD: `POST` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:23:39.817695 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f79bf7-5f43-4ff5-abcc-22410e4e4dcd None admin] SCRIPT_NAME: `/identity` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:23:39.817989 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f79bf7-5f43-4ff5-abcc-22410e4e4dcd None admin] PATH_INFO: `/v3/users` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:23:39.818695 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2f79bf7-5f43-4ff5-abcc-22410e4e4dcd None admin] RBAC: Authorizing `identity:create_user()` {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:23:39.820175 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2f79bf7-5f43-4ff5-abcc-22410e4e4dcd None admin] RBAC: Authorization granted {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:23:39.826683 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3fc1095-e084-4137-9d4c-97c81c2d1c8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:23:39.827313 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3fc1095-e084-4137-9d4c-97c81c2d1c8d None admin] REQUEST_METHOD: `GET` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:23:39.827593 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3fc1095-e084-4137-9d4c-97c81c2d1c8d None admin] SCRIPT_NAME: `/identity` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:23:39.827869 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3fc1095-e084-4137-9d4c-97c81c2d1c8d None admin] PATH_INFO: `/v3/roles` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:23:39.828603 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3fc1095-e084-4137-9d4c-97c81c2d1c8d None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=207601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:23:39.828940 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3fc1095-e084-4137-9d4c-97c81c2d1c8d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:23:39.830297 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3fc1095-e084-4137-9d4c-97c81c2d1c8d None admin] RBAC: Authorization granted {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:23:39.838843 dv-cinder-851351-1-smb devstack@keystone.service[207601]: [pid: 207601|app: 0|req: 104/194] 10.222.0.42 () {56 vars in 1111 bytes} [Thu Jul 28 08:23:39 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:23:39.840043 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3fc1095-e084-4137-9d4c-97c81c2d1c8d None admin] Authenticating user token {{(pid=207601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:23:39.843232 dv-cinder-851351-1-smb devstack@keystone.service[207600]: [pid: 207600|app: 0|req: 91/195] 10.222.0.42 () {60 vars in 1132 bytes} [Thu Jul 28 08:23:39 2022] POST /identity/v3/users => generated 297 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 08:23:39.850511 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f79bf7-5f43-4ff5-abcc-22410e4e4dcd None admin] Authenticating user token {{(pid=207600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:23:39.972037 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3fc1095-e084-4137-9d4c-97c81c2d1c8d None admin] Validating token access rules against request {{(pid=207601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:23:39.984136 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG dbcounter [-] [207601] Writing DB stats keystone:SELECT=100 {{(pid=207601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:23:39.987441 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f79bf7-5f43-4ff5-abcc-22410e4e4dcd None admin] Validating token access rules against request {{(pid=207600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:23:40.012393 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d8ca63-3df1-4462-bfd2-b86196a58504 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:23:40.013143 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d8ca63-3df1-4462-bfd2-b86196a58504 None admin] REQUEST_METHOD: `GET` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:23:40.013431 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d8ca63-3df1-4462-bfd2-b86196a58504 None admin] SCRIPT_NAME: `/identity` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:23:40.013703 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d8ca63-3df1-4462-bfd2-b86196a58504 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:23:40.031030 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83eb25e-f119-439a-a231-1cc3db0feb9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:23:40.031619 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83eb25e-f119-439a-a231-1cc3db0feb9a None admin] REQUEST_METHOD: `GET` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:23:40.031903 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83eb25e-f119-439a-a231-1cc3db0feb9a None admin] SCRIPT_NAME: `/identity` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:23:40.032180 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83eb25e-f119-439a-a231-1cc3db0feb9a None admin] PATH_INFO: `/v3/roles/reader` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:23:40.044743 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a83eb25e-f119-439a-a231-1cc3db0feb9a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 08:23:40.050452 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application [None req-a83eb25e-f119-439a-a231-1cc3db0feb9a None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 28 08:23:40.050452 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:23:40.050452 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:23:40.050452 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:23:40.050452 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:23:40.050452 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:23:40.050452 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:23:40.050452 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:23:40.050452 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:23:40.050452 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:23:40.050452 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:23:40.050452 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:23:40.050452 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 08:23:40.050452 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 08:23:40.050452 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 08:23:40.050452 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 08:23:40.051623 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 08:23:40.051623 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 08:23:40.051623 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 08:23:40.051623 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 08:23:40.051623 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:23:40.051623 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:23:40.051623 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:23:40.051623 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:23:40.051623 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:23:40.051623 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:23:40.051623 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:23:40.051623 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application with Lock( Jul 28 08:23:40.051623 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:23:40.051623 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:23:40.051623 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:23:40.051623 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:23:40.052779 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:23:40.052779 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:23:40.052779 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:23:40.052779 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:23:40.052779 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 08:23:40.052779 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 08:23:40.052779 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 08:23:40.052779 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 08:23:40.052779 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 08:23:40.052779 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 08:23:40.052779 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 28 08:23:40.052779 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application Jul 28 08:23:40.053629 dv-cinder-851351-1-smb devstack@keystone.service[207600]: [pid: 207600|app: 0|req: 92/196] 10.222.0.42 () {56 vars in 1099 bytes} [Thu Jul 28 08:23:39 2022] GET /identity/v3/roles/reader => generated 84 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:23:40.053866 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83eb25e-f119-439a-a231-1cc3db0feb9a None admin] Authenticating user token {{(pid=207600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:23:40.081841 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG dbcounter [-] [207600] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=207600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:23:40.100077 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3d8ca63-3df1-4462-bfd2-b86196a58504 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:23:40.101738 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3d8ca63-3df1-4462-bfd2-b86196a58504 None admin] RBAC: Authorization granted {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:23:40.180921 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83eb25e-f119-439a-a231-1cc3db0feb9a None admin] Validating token access rules against request {{(pid=207600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:23:40.221306 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535aec0f-2716-420d-9972-228308db4395 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:23:40.222333 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535aec0f-2716-420d-9972-228308db4395 None admin] REQUEST_METHOD: `GET` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:23:40.222724 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535aec0f-2716-420d-9972-228308db4395 None admin] SCRIPT_NAME: `/identity` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:23:40.223011 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535aec0f-2716-420d-9972-228308db4395 None admin] PATH_INFO: `/v3/users/947b8ef66ba34159ba94af8aac2c1206` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:23:40.224233 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-535aec0f-2716-420d-9972-228308db4395 None admin] RBAC: Authorizing `identity:get_user(user_id=947b8ef66ba34159ba94af8aac2c1206)` {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:23:40.225751 dv-cinder-851351-1-smb devstack@keystone.service[207601]: [pid: 207601|app: 0|req: 105/197] 10.222.0.42 () {58 vars in 1282 bytes} [Thu Jul 28 08:23:39 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 386 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 28 08:23:40.226146 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-535aec0f-2716-420d-9972-228308db4395 None admin] RBAC: Authorization granted {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:23:40.229712 dv-cinder-851351-1-smb devstack@keystone.service[207600]: [pid: 207600|app: 0|req: 93/198] 10.222.0.42 () {56 vars in 1177 bytes} [Thu Jul 28 08:23:40 2022] GET /identity/v3/users/947b8ef66ba34159ba94af8aac2c1206 => generated 283 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:23:40.229862 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d8ca63-3df1-4462-bfd2-b86196a58504 None admin] Authenticating user token {{(pid=207601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:23:40.232475 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535aec0f-2716-420d-9972-228308db4395 None admin] Authenticating user token {{(pid=207600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:23:40.250992 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG dbcounter [-] [207601] Writing DB stats keystone:SELECT=100 {{(pid=207601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:23:40.333914 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG dbcounter [-] [207600] Writing DB stats keystone:SELECT=100 {{(pid=207600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:23:40.348335 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535aec0f-2716-420d-9972-228308db4395 None admin] Validating token access rules against request {{(pid=207600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:23:40.374306 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d8ca63-3df1-4462-bfd2-b86196a58504 None admin] Validating token access rules against request {{(pid=207601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:23:40.384612 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47ff3f9-2cbe-4b95-88ab-759e6164e504 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:23:40.385481 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47ff3f9-2cbe-4b95-88ab-759e6164e504 None admin] REQUEST_METHOD: `GET` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:23:40.386198 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47ff3f9-2cbe-4b95-88ab-759e6164e504 None admin] SCRIPT_NAME: `/identity` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:23:40.386198 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47ff3f9-2cbe-4b95-88ab-759e6164e504 None admin] PATH_INFO: `/v3/projects/4a9d64056e4a4c2f805643b31ac7e061` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:23:40.387509 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a47ff3f9-2cbe-4b95-88ab-759e6164e504 None admin] RBAC: Authorizing `identity:get_project(project_id=4a9d64056e4a4c2f805643b31ac7e061)` {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:23:40.389311 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a47ff3f9-2cbe-4b95-88ab-759e6164e504 None admin] RBAC: Authorization granted {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:23:40.396136 dv-cinder-851351-1-smb devstack@keystone.service[207600]: [pid: 207600|app: 0|req: 94/199] 10.222.0.42 () {56 vars in 1186 bytes} [Thu Jul 28 08:23:40 2022] GET /identity/v3/projects/4a9d64056e4a4c2f805643b31ac7e061 => generated 302 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 08:23:40.397198 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47ff3f9-2cbe-4b95-88ab-759e6164e504 None admin] Authenticating user token {{(pid=207600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:23:40.421620 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c9cc85-0838-437b-9c9e-d0cdffe023da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:23:40.422536 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c9cc85-0838-437b-9c9e-d0cdffe023da None admin] REQUEST_METHOD: `GET` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:23:40.423251 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c9cc85-0838-437b-9c9e-d0cdffe023da None admin] SCRIPT_NAME: `/identity` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:23:40.423688 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c9cc85-0838-437b-9c9e-d0cdffe023da None admin] PATH_INFO: `/v3/roles` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:23:40.424882 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5c9cc85-0838-437b-9c9e-d0cdffe023da None admin] RBAC: Adding query filter params (name=reader) {{(pid=207601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:23:40.425792 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5c9cc85-0838-437b-9c9e-d0cdffe023da None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:23:40.427895 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5c9cc85-0838-437b-9c9e-d0cdffe023da None admin] RBAC: Authorization granted {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:23:40.446350 dv-cinder-851351-1-smb devstack@keystone.service[207601]: [pid: 207601|app: 0|req: 106/200] 10.222.0.42 () {56 vars in 1101 bytes} [Thu Jul 28 08:23:40 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:23:40.449757 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c9cc85-0838-437b-9c9e-d0cdffe023da None admin] Authenticating user token {{(pid=207601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:23:40.528010 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47ff3f9-2cbe-4b95-88ab-759e6164e504 None admin] Validating token access rules against request {{(pid=207600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:23:40.539330 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG dbcounter [-] [207601] Writing DB stats keystone:SELECT=100 {{(pid=207601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:23:40.559992 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c9cc85-0838-437b-9c9e-d0cdffe023da None admin] Validating token access rules against request {{(pid=207601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:23:40.567803 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d681d03-0036-4da5-b33a-e1b62e2d9488 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:23:40.568701 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d681d03-0036-4da5-b33a-e1b62e2d9488 None admin] REQUEST_METHOD: `GET` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:23:40.569153 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d681d03-0036-4da5-b33a-e1b62e2d9488 None admin] SCRIPT_NAME: `/identity` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:23:40.569588 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d681d03-0036-4da5-b33a-e1b62e2d9488 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:23:40.596975 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3251ddda-3cab-4399-a652-a75650fe2a9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:23:40.597626 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3251ddda-3cab-4399-a652-a75650fe2a9a None admin] REQUEST_METHOD: `GET` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:23:40.597914 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3251ddda-3cab-4399-a652-a75650fe2a9a None admin] SCRIPT_NAME: `/identity` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:23:40.598195 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3251ddda-3cab-4399-a652-a75650fe2a9a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:23:40.599249 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3251ddda-3cab-4399-a652-a75650fe2a9a None admin] RBAC: Adding query filter params (role.id=d0ce88034c6b41878db755343f5840be, scope.project.id=4a9d64056e4a4c2f805643b31ac7e061, user.id=947b8ef66ba34159ba94af8aac2c1206) {{(pid=207601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:23:40.599383 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3251ddda-3cab-4399-a652-a75650fe2a9a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:23:40.600843 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3251ddda-3cab-4399-a652-a75650fe2a9a None admin] RBAC: Authorization granted {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:23:40.607079 dv-cinder-851351-1-smb devstack@keystone.service[207601]: [pid: 207601|app: 0|req: 107/201] 10.222.0.42 () {56 vars in 1374 bytes} [Thu Jul 28 08:23:40 2022] GET /identity/v3/role_assignments?user.id=947b8ef66ba34159ba94af8aac2c1206&scope.project.id=4a9d64056e4a4c2f805643b31ac7e061&role.id=d0ce88034c6b41878db755343f5840be => generated 259 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:23:40.608078 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3251ddda-3cab-4399-a652-a75650fe2a9a None admin] Authenticating user token {{(pid=207601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:23:40.608495 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG dbcounter [-] [207600] Writing DB stats keystone:SELECT=100 {{(pid=207600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:23:40.662904 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d681d03-0036-4da5-b33a-e1b62e2d9488 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:23:40.665229 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d681d03-0036-4da5-b33a-e1b62e2d9488 None admin] RBAC: Authorization granted {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:23:40.813670 dv-cinder-851351-1-smb devstack@keystone.service[207600]: [pid: 207600|app: 0|req: 95/202] 10.222.0.42 () {58 vars in 1282 bytes} [Thu Jul 28 08:23:40 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 417 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 28 08:23:40.819699 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d681d03-0036-4da5-b33a-e1b62e2d9488 None admin] Authenticating user token {{(pid=207600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:23:40.838892 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3251ddda-3cab-4399-a652-a75650fe2a9a None admin] Validating token access rules against request {{(pid=207601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:23:40.882954 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG dbcounter [-] [207600] Writing DB stats keystone:SELECT=100 {{(pid=207600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:23:40.935899 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d681d03-0036-4da5-b33a-e1b62e2d9488 None admin] Validating token access rules against request {{(pid=207600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:23:40.944656 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f369231e-139a-44ad-b009-f13aec0d3b1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:23:40.945367 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f369231e-139a-44ad-b009-f13aec0d3b1a None admin] REQUEST_METHOD: `GET` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:23:40.945666 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f369231e-139a-44ad-b009-f13aec0d3b1a None admin] SCRIPT_NAME: `/identity` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:23:40.945947 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f369231e-139a-44ad-b009-f13aec0d3b1a None admin] PATH_INFO: `/v3/users/1c3d0bca92884996b0a179a4a76a7d45` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:23:40.947200 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f369231e-139a-44ad-b009-f13aec0d3b1a None admin] RBAC: Authorizing `identity:get_user(user_id=1c3d0bca92884996b0a179a4a76a7d45)` {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:23:40.948701 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f369231e-139a-44ad-b009-f13aec0d3b1a None admin] RBAC: Authorization granted {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:23:40.950467 dv-cinder-851351-1-smb devstack@keystone.service[207601]: [pid: 207601|app: 0|req: 108/203] 10.222.0.42 () {56 vars in 1177 bytes} [Thu Jul 28 08:23:40 2022] GET /identity/v3/users/1c3d0bca92884996b0a179a4a76a7d45 => generated 289 bytes in 343 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:23:40.957681 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f369231e-139a-44ad-b009-f13aec0d3b1a None admin] Authenticating user token {{(pid=207601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:23:40.965822 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG dbcounter [-] [207601] Writing DB stats keystone:SELECT=100 {{(pid=207601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:23:40.982723 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeaf19e6-bd03-4d5f-b405-e521004761fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:23:40.983781 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeaf19e6-bd03-4d5f-b405-e521004761fb None admin] REQUEST_METHOD: `GET` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:23:40.984439 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeaf19e6-bd03-4d5f-b405-e521004761fb None admin] SCRIPT_NAME: `/identity` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:23:40.985637 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeaf19e6-bd03-4d5f-b405-e521004761fb None admin] PATH_INFO: `/v3/projects/4a9d64056e4a4c2f805643b31ac7e061` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:23:40.988527 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeaf19e6-bd03-4d5f-b405-e521004761fb None admin] RBAC: Authorizing `identity:get_project(project_id=4a9d64056e4a4c2f805643b31ac7e061)` {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:23:40.990271 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeaf19e6-bd03-4d5f-b405-e521004761fb None admin] RBAC: Authorization granted {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:23:40.992445 dv-cinder-851351-1-smb devstack@keystone.service[207600]: [pid: 207600|app: 0|req: 96/204] 10.222.0.42 () {56 vars in 1186 bytes} [Thu Jul 28 08:23:40 2022] GET /identity/v3/projects/4a9d64056e4a4c2f805643b31ac7e061 => generated 302 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:23:40.998739 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeaf19e6-bd03-4d5f-b405-e521004761fb None admin] Authenticating user token {{(pid=207600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:23:41.108853 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeaf19e6-bd03-4d5f-b405-e521004761fb None admin] Validating token access rules against request {{(pid=207600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:23:41.140617 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG dbcounter [-] [207600] Writing DB stats keystone:SELECT=100 {{(pid=207600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:23:41.169461 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89d52c7-1612-4c11-9f57-88567b16b252 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:23:41.170140 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89d52c7-1612-4c11-9f57-88567b16b252 None admin] REQUEST_METHOD: `GET` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:23:41.171549 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89d52c7-1612-4c11-9f57-88567b16b252 None admin] SCRIPT_NAME: `/identity` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:23:41.171835 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89d52c7-1612-4c11-9f57-88567b16b252 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:23:41.172688 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b89d52c7-1612-4c11-9f57-88567b16b252 None admin] RBAC: Adding query filter params (role.id=e617201b25d44cb1844c9f28bcac91fb, scope.project.id=4a9d64056e4a4c2f805643b31ac7e061, user.id=947b8ef66ba34159ba94af8aac2c1206) {{(pid=207600) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:23:41.173008 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b89d52c7-1612-4c11-9f57-88567b16b252 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:23:41.174494 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b89d52c7-1612-4c11-9f57-88567b16b252 None admin] RBAC: Authorization granted {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:23:41.182913 dv-cinder-851351-1-smb devstack@keystone.service[207600]: [pid: 207600|app: 0|req: 97/205] 10.222.0.42 () {56 vars in 1374 bytes} [Thu Jul 28 08:23:40 2022] GET /identity/v3/role_assignments?user.id=947b8ef66ba34159ba94af8aac2c1206&scope.project.id=4a9d64056e4a4c2f805643b31ac7e061&role.id=e617201b25d44cb1844c9f28bcac91fb => generated 259 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:23:41.196700 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f369231e-139a-44ad-b009-f13aec0d3b1a None admin] Validating token access rules against request {{(pid=207601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:23:41.235607 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1cad4a-3edc-40e1-80d1-c08febbbcb4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:23:41.236247 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1cad4a-3edc-40e1-80d1-c08febbbcb4d None admin] REQUEST_METHOD: `GET` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:23:41.236537 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1cad4a-3edc-40e1-80d1-c08febbbcb4d None admin] SCRIPT_NAME: `/identity` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:23:41.236848 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1cad4a-3edc-40e1-80d1-c08febbbcb4d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:23:41.356627 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae1cad4a-3edc-40e1-80d1-c08febbbcb4d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:23:41.358326 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae1cad4a-3edc-40e1-80d1-c08febbbcb4d None admin] RBAC: Authorization granted {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:23:41.361463 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG dbcounter [-] [207601] Writing DB stats keystone:SELECT=100 {{(pid=207601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:23:41.498263 dv-cinder-851351-1-smb devstack@keystone.service[207601]: [pid: 207601|app: 0|req: 109/206] 10.222.0.42 () {58 vars in 1282 bytes} [Thu Jul 28 08:23:40 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 541 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 28 08:23:41.503918 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89d52c7-1612-4c11-9f57-88567b16b252 None admin] Authenticating user token {{(pid=207600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:23:41.617117 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89d52c7-1612-4c11-9f57-88567b16b252 None admin] Validating token access rules against request {{(pid=207600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:23:41.653333 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68af5b6b-845a-4aa2-aeb0-273afaf916b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:23:41.654417 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68af5b6b-845a-4aa2-aeb0-273afaf916b2 None admin] REQUEST_METHOD: `GET` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:23:41.654922 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68af5b6b-845a-4aa2-aeb0-273afaf916b2 None admin] SCRIPT_NAME: `/identity` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:23:41.655411 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68af5b6b-845a-4aa2-aeb0-273afaf916b2 None admin] PATH_INFO: `/v3/projects/4a64079f46494355a0aa3aafd9a90c0c` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:23:41.656888 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68af5b6b-845a-4aa2-aeb0-273afaf916b2 None admin] RBAC: Authorizing `identity:get_project(project_id=4a64079f46494355a0aa3aafd9a90c0c)` {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:23:41.658585 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68af5b6b-845a-4aa2-aeb0-273afaf916b2 None admin] RBAC: Authorization granted {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:23:41.660853 dv-cinder-851351-1-smb devstack@keystone.service[207600]: [pid: 207600|app: 0|req: 98/207] 10.222.0.42 () {56 vars in 1186 bytes} [Thu Jul 28 08:23:41 2022] GET /identity/v3/projects/4a64079f46494355a0aa3aafd9a90c0c => generated 298 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:23:41.668688 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1cad4a-3edc-40e1-80d1-c08febbbcb4d None admin] Authenticating user token {{(pid=207601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:23:41.820767 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1cad4a-3edc-40e1-80d1-c08febbbcb4d None admin] Validating token access rules against request {{(pid=207601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:23:41.823075 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG dbcounter [-] [207601] Writing DB stats keystone:SELECT=100 {{(pid=207601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:23:41.857678 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d10c3e9-6631-4ae6-a62e-2d001d251d34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:23:41.858746 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d10c3e9-6631-4ae6-a62e-2d001d251d34 None admin] REQUEST_METHOD: `GET` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:23:41.859207 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d10c3e9-6631-4ae6-a62e-2d001d251d34 None admin] SCRIPT_NAME: `/identity` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:23:41.859627 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d10c3e9-6631-4ae6-a62e-2d001d251d34 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:23:41.860588 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d10c3e9-6631-4ae6-a62e-2d001d251d34 None admin] RBAC: Adding query filter params (role.id=4af3ffd96e0540dbb20e6ccb08a61f0b, scope.project.id=4a64079f46494355a0aa3aafd9a90c0c, user.id=1c3d0bca92884996b0a179a4a76a7d45) {{(pid=207601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:23:41.861088 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d10c3e9-6631-4ae6-a62e-2d001d251d34 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:23:41.862709 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d10c3e9-6631-4ae6-a62e-2d001d251d34 None admin] RBAC: Authorization granted {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:23:41.871141 dv-cinder-851351-1-smb devstack@keystone.service[207601]: [pid: 207601|app: 0|req: 110/208] 10.222.0.42 () {56 vars in 1374 bytes} [Thu Jul 28 08:23:41 2022] GET /identity/v3/role_assignments?user.id=1c3d0bca92884996b0a179a4a76a7d45&scope.project.id=4a64079f46494355a0aa3aafd9a90c0c&role.id=4af3ffd96e0540dbb20e6ccb08a61f0b => generated 608 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:23:42.301344 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b3a780-a0d5-4509-b3fd-459db2ba72ab None None] REQUEST_METHOD: `GET` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:23:42.301634 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b3a780-a0d5-4509-b3fd-459db2ba72ab None None] SCRIPT_NAME: `/identity` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:23:42.302069 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b3a780-a0d5-4509-b3fd-459db2ba72ab None None] PATH_INFO: `/` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:23:42.303613 dv-cinder-851351-1-smb devstack@keystone.service[207600]: [pid: 207600|app: 0|req: 99/209] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 08:23:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 08:23:42.309112 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a996bbd4-bf20-4b77-bc24-195fdfc30b4b None None] REQUEST_METHOD: `POST` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:23:42.309434 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a996bbd4-bf20-4b77-bc24-195fdfc30b4b None None] SCRIPT_NAME: `/identity` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:23:42.309719 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a996bbd4-bf20-4b77-bc24-195fdfc30b4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:23:42.332793 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.auth.core [None req-a996bbd4-bf20-4b77-bc24-195fdfc30b4b None None] MFA Rules not processed for user `b8110ade874c4aa7af27f5c376df700a`. Rule list: `[]` (Enabled: `True`). {{(pid=207601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 08:23:42.334011 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.fernet_utils [None req-a996bbd4-bf20-4b77-bc24-195fdfc30b4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=207601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:23:42.367239 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6973379e-5187-4559-969b-2a2d71df68ae None None] REQUEST_METHOD: `GET` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:23:42.367584 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6973379e-5187-4559-969b-2a2d71df68ae None None] SCRIPT_NAME: `/identity` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:23:42.367802 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6973379e-5187-4559-969b-2a2d71df68ae None None] PATH_INFO: `/` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:23:42.369372 dv-cinder-851351-1-smb devstack@keystone.service[207600]: [pid: 207600|app: 0|req: 100/210] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 08:23:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 08:23:42.375230 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64566572-49ca-4021-84a0-b9473d628352 None None] REQUEST_METHOD: `POST` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:23:42.375518 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64566572-49ca-4021-84a0-b9473d628352 None None] SCRIPT_NAME: `/identity` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:23:42.375794 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64566572-49ca-4021-84a0-b9473d628352 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:23:42.403637 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.auth.core [None req-64566572-49ca-4021-84a0-b9473d628352 None None] MFA Rules not processed for user `b8110ade874c4aa7af27f5c376df700a`. Rule list: `[]` (Enabled: `True`). {{(pid=207600) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 08:23:42.405287 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.fernet_utils [None req-64566572-49ca-4021-84a0-b9473d628352 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=207600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:23:42.415168 dv-cinder-851351-1-smb devstack@keystone.service[207601]: [pid: 207601|app: 0|req: 111/211] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 08:23:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 08:23:42.438862 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a996bbd4-bf20-4b77-bc24-195fdfc30b4b None None] Authenticating user token {{(pid=207601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:23:42.473122 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG dbcounter [-] [207600] Writing DB stats keystone:SELECT=100 {{(pid=207600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:23:42.490587 dv-cinder-851351-1-smb devstack@keystone.service[207600]: [pid: 207600|app: 0|req: 101/212] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 08:23:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 28 08:23:42.516265 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64566572-49ca-4021-84a0-b9473d628352 None None] Authenticating user token {{(pid=207600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:23:42.556313 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG dbcounter [-] [207601] Writing DB stats keystone:SELECT=100 {{(pid=207601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:23:42.562688 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a996bbd4-bf20-4b77-bc24-195fdfc30b4b None None] Validating token access rules against request {{(pid=207601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:23:42.601575 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b59349-23f2-4bb4-ba53-53d3c8abe441 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:23:42.602643 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b59349-23f2-4bb4-ba53-53d3c8abe441 None admin] REQUEST_METHOD: `GET` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:23:42.603148 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b59349-23f2-4bb4-ba53-53d3c8abe441 None admin] SCRIPT_NAME: `/identity` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:23:42.603661 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b59349-23f2-4bb4-ba53-53d3c8abe441 None admin] PATH_INFO: `/v3/roles/member` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:23:42.616181 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3b59349-23f2-4bb4-ba53-53d3c8abe441 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 08:23:42.620837 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64566572-49ca-4021-84a0-b9473d628352 None None] Validating token access rules against request {{(pid=207600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:23:42.622757 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application [None req-f3b59349-23f2-4bb4-ba53-53d3c8abe441 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 28 08:23:42.622757 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:23:42.622757 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:23:42.622757 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:23:42.622757 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:23:42.622757 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:23:42.622757 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:23:42.622757 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:23:42.622757 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:23:42.622757 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:23:42.622757 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:23:42.622757 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:23:42.622757 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 08:23:42.622757 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 08:23:42.622757 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 08:23:42.622757 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 08:23:42.623966 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 08:23:42.623966 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 08:23:42.623966 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 08:23:42.623966 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 08:23:42.623966 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:23:42.623966 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:23:42.623966 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:23:42.623966 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:23:42.623966 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:23:42.623966 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:23:42.623966 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:23:42.623966 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application with Lock( Jul 28 08:23:42.623966 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:23:42.623966 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:23:42.623966 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:23:42.623966 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:23:42.624981 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:23:42.624981 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:23:42.624981 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:23:42.624981 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:23:42.624981 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 08:23:42.624981 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 08:23:42.624981 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 08:23:42.624981 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 08:23:42.624981 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 08:23:42.624981 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 08:23:42.624981 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 28 08:23:42.624981 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application Jul 28 08:23:42.627976 dv-cinder-851351-1-smb devstack@keystone.service[207601]: [pid: 207601|app: 0|req: 112/213] 10.222.0.42 () {56 vars in 1099 bytes} [Thu Jul 28 08:23:42 2022] GET /identity/v3/roles/member => generated 84 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:23:42.638659 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b59349-23f2-4bb4-ba53-53d3c8abe441 None admin] Authenticating user token {{(pid=207601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:23:42.675539 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18672ae1-300b-48ae-948c-ab38431c1564 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:23:42.676648 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18672ae1-300b-48ae-948c-ab38431c1564 None admin] REQUEST_METHOD: `GET` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:23:42.677220 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18672ae1-300b-48ae-948c-ab38431c1564 None admin] SCRIPT_NAME: `/identity` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:23:42.677728 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18672ae1-300b-48ae-948c-ab38431c1564 None admin] PATH_INFO: `/v3/domains/default` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:23:42.679434 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18672ae1-300b-48ae-948c-ab38431c1564 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:23:42.681316 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18672ae1-300b-48ae-948c-ab38431c1564 None admin] RBAC: Authorization granted {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:23:42.683603 dv-cinder-851351-1-smb devstack@keystone.service[207600]: [pid: 207600|app: 0|req: 102/214] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 08:23:42 2022] GET /identity/v3/domains/default => generated 199 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 08:23:42.690419 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18672ae1-300b-48ae-948c-ab38431c1564 None admin] Authenticating user token {{(pid=207600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:23:42.759546 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b59349-23f2-4bb4-ba53-53d3c8abe441 None admin] Validating token access rules against request {{(pid=207601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:23:42.761575 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG dbcounter [-] [207600] Writing DB stats keystone:SELECT=100 {{(pid=207600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:23:42.806280 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed986b1-79a4-47f5-ab27-2174fa4b4358 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:23:42.806988 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed986b1-79a4-47f5-ab27-2174fa4b4358 None admin] REQUEST_METHOD: `GET` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:23:42.807214 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed986b1-79a4-47f5-ab27-2174fa4b4358 None admin] SCRIPT_NAME: `/identity` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:23:42.807493 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed986b1-79a4-47f5-ab27-2174fa4b4358 None admin] PATH_INFO: `/v3/roles` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:23:42.808501 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed986b1-79a4-47f5-ab27-2174fa4b4358 None admin] RBAC: Adding query filter params (name=member) {{(pid=207601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:23:42.808895 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed986b1-79a4-47f5-ab27-2174fa4b4358 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:23:42.811133 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed986b1-79a4-47f5-ab27-2174fa4b4358 None admin] RBAC: Authorization granted {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:23:42.815780 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18672ae1-300b-48ae-948c-ab38431c1564 None admin] Validating token access rules against request {{(pid=207600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:23:42.824745 dv-cinder-851351-1-smb devstack@keystone.service[207601]: [pid: 207601|app: 0|req: 113/215] 10.222.0.42 () {56 vars in 1101 bytes} [Thu Jul 28 08:23:42 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:23:42.827930 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed986b1-79a4-47f5-ab27-2174fa4b4358 None admin] Authenticating user token {{(pid=207601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:23:42.856473 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG dbcounter [-] [207601] Writing DB stats keystone:SELECT=100 {{(pid=207601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:23:42.873024 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a529cad-0542-4741-a812-723214335a70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:23:42.873686 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a529cad-0542-4741-a812-723214335a70 None admin] REQUEST_METHOD: `POST` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:23:42.873973 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a529cad-0542-4741-a812-723214335a70 None admin] SCRIPT_NAME: `/identity` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:23:42.874249 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a529cad-0542-4741-a812-723214335a70 None admin] PATH_INFO: `/v3/users` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:23:42.874964 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a529cad-0542-4741-a812-723214335a70 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:23:42.876439 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a529cad-0542-4741-a812-723214335a70 None admin] RBAC: Authorization granted {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:23:42.920693 dv-cinder-851351-1-smb devstack@keystone.service[207600]: [pid: 207600|app: 0|req: 103/216] 10.222.0.42 () {60 vars in 1132 bytes} [Thu Jul 28 08:23:42 2022] POST /identity/v3/users => generated 297 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 28 08:23:42.959919 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed986b1-79a4-47f5-ab27-2174fa4b4358 None admin] Validating token access rules against request {{(pid=207601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:23:43.000314 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19c394b-2fae-4b47-a34c-98ca54bd5c90 None None] REQUEST_METHOD: `GET` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:23:43.000754 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19c394b-2fae-4b47-a34c-98ca54bd5c90 None None] SCRIPT_NAME: `/identity` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:23:43.001043 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19c394b-2fae-4b47-a34c-98ca54bd5c90 None None] PATH_INFO: `/` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:23:43.003622 dv-cinder-851351-1-smb devstack@keystone.service[207600]: [pid: 207600|app: 0|req: 104/217] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 08:23:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 28 08:23:43.009836 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab57e43-491c-4488-9dc5-299700b3f676 None None] REQUEST_METHOD: `POST` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:23:43.010199 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab57e43-491c-4488-9dc5-299700b3f676 None None] SCRIPT_NAME: `/identity` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:23:43.010385 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab57e43-491c-4488-9dc5-299700b3f676 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:23:43.012568 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c9a9b60-ba12-4ebd-98d8-866ee27e6784 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:23:43.013381 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9a9b60-ba12-4ebd-98d8-866ee27e6784 None admin] REQUEST_METHOD: `GET` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:23:43.013676 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9a9b60-ba12-4ebd-98d8-866ee27e6784 None admin] SCRIPT_NAME: `/identity` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:23:43.013958 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9a9b60-ba12-4ebd-98d8-866ee27e6784 None admin] PATH_INFO: `/v3/users/98ec5e65337342c9add09e83bd7469e8` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:23:43.029986 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.auth.core [None req-4ab57e43-491c-4488-9dc5-299700b3f676 None None] MFA Rules not processed for user `b8110ade874c4aa7af27f5c376df700a`. Rule list: `[]` (Enabled: `True`). {{(pid=207600) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 08:23:43.031595 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.fernet_utils [None req-4ab57e43-491c-4488-9dc5-299700b3f676 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=207600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:23:43.031877 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c9a9b60-ba12-4ebd-98d8-866ee27e6784 None admin] RBAC: Authorizing `identity:get_user(user_id=98ec5e65337342c9add09e83bd7469e8)` {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:23:43.033428 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c9a9b60-ba12-4ebd-98d8-866ee27e6784 None admin] RBAC: Authorization granted {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:23:43.036729 dv-cinder-851351-1-smb devstack@keystone.service[207601]: [pid: 207601|app: 0|req: 114/218] 10.222.0.42 () {56 vars in 1177 bytes} [Thu Jul 28 08:23:42 2022] GET /identity/v3/users/98ec5e65337342c9add09e83bd7469e8 => generated 297 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 08:23:43.042185 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c9a9b60-ba12-4ebd-98d8-866ee27e6784 None admin] Authenticating user token {{(pid=207601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:23:43.135574 dv-cinder-851351-1-smb devstack@keystone.service[207600]: [pid: 207600|app: 0|req: 105/219] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 08:23:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 28 08:23:43.155784 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG dbcounter [-] [207601] Writing DB stats keystone:SELECT=100 {{(pid=207601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:23:43.162744 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab57e43-491c-4488-9dc5-299700b3f676 None None] Authenticating user token {{(pid=207600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:23:43.177345 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c9a9b60-ba12-4ebd-98d8-866ee27e6784 None admin] Validating token access rules against request {{(pid=207601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:23:43.217502 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG dbcounter [-] [207600] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=207600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:23:43.241506 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa19182-d2b4-4541-83f8-42647c89e7cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:23:43.242457 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa19182-d2b4-4541-83f8-42647c89e7cf None admin] REQUEST_METHOD: `GET` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:23:43.242965 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa19182-d2b4-4541-83f8-42647c89e7cf None admin] SCRIPT_NAME: `/identity` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:23:43.243249 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa19182-d2b4-4541-83f8-42647c89e7cf None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:23:43.301452 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab57e43-491c-4488-9dc5-299700b3f676 None None] Validating token access rules against request {{(pid=207600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:23:43.332324 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaa19182-d2b4-4541-83f8-42647c89e7cf None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:23:43.333951 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaa19182-d2b4-4541-83f8-42647c89e7cf None admin] RBAC: Authorization granted {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:23:43.345479 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e35c66f0-79fb-469d-8e24-0e2a2bf9cffa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:23:43.346759 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35c66f0-79fb-469d-8e24-0e2a2bf9cffa None admin] REQUEST_METHOD: `GET` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:23:43.347052 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35c66f0-79fb-469d-8e24-0e2a2bf9cffa None admin] SCRIPT_NAME: `/identity` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:23:43.347325 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35c66f0-79fb-469d-8e24-0e2a2bf9cffa None admin] PATH_INFO: `/v3/roles/admin` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:23:43.362623 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e35c66f0-79fb-469d-8e24-0e2a2bf9cffa None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 08:23:43.368872 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application [None req-e35c66f0-79fb-469d-8e24-0e2a2bf9cffa None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 08:23:43.368872 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:23:43.368872 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:23:43.368872 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:23:43.368872 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:23:43.368872 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:23:43.368872 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:23:43.368872 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:23:43.368872 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:23:43.368872 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:23:43.368872 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:23:43.368872 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:23:43.368872 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 08:23:43.368872 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 08:23:43.368872 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 08:23:43.368872 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 08:23:43.369873 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 08:23:43.369873 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 08:23:43.369873 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 08:23:43.369873 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 08:23:43.369873 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:23:43.369873 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:23:43.369873 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:23:43.369873 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:23:43.369873 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:23:43.369873 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:23:43.369873 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:23:43.369873 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application with Lock( Jul 28 08:23:43.369873 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:23:43.369873 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:23:43.369873 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:23:43.369873 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:23:43.370748 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:23:43.370748 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:23:43.370748 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:23:43.370748 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:23:43.370748 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 08:23:43.370748 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 08:23:43.370748 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 08:23:43.370748 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 08:23:43.370748 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 08:23:43.370748 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 08:23:43.370748 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 08:23:43.370748 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application Jul 28 08:23:43.371577 dv-cinder-851351-1-smb devstack@keystone.service[207600]: [pid: 207600|app: 0|req: 106/220] 10.222.0.42 () {56 vars in 1096 bytes} [Thu Jul 28 08:23:43 2022] GET /identity/v3/roles/admin => generated 83 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 08:23:43.378289 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e35c66f0-79fb-469d-8e24-0e2a2bf9cffa None admin] Authenticating user token {{(pid=207600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:23:43.430774 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG dbcounter [-] [207601] Writing DB stats keystone:SELECT=100 {{(pid=207601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:23:43.454184 dv-cinder-851351-1-smb devstack@keystone.service[207601]: [pid: 207601|app: 0|req: 115/221] 10.222.0.42 () {58 vars in 1282 bytes} [Thu Jul 28 08:23:43 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 412 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 28 08:23:43.461224 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa19182-d2b4-4541-83f8-42647c89e7cf None admin] Authenticating user token {{(pid=207601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:23:43.509801 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG dbcounter [-] [207600] Writing DB stats keystone:SELECT=100 {{(pid=207600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:23:43.516743 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e35c66f0-79fb-469d-8e24-0e2a2bf9cffa None admin] Validating token access rules against request {{(pid=207600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:23:43.580440 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a53e374-fea3-421d-b12f-ddc941588f30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:23:43.581112 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a53e374-fea3-421d-b12f-ddc941588f30 None admin] REQUEST_METHOD: `GET` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:23:43.581398 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a53e374-fea3-421d-b12f-ddc941588f30 None admin] SCRIPT_NAME: `/identity` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:23:43.581673 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a53e374-fea3-421d-b12f-ddc941588f30 None admin] PATH_INFO: `/v3/roles` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:23:43.582422 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a53e374-fea3-421d-b12f-ddc941588f30 None admin] RBAC: Adding query filter params (name=admin) {{(pid=207600) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:23:43.582731 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a53e374-fea3-421d-b12f-ddc941588f30 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:23:43.584142 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a53e374-fea3-421d-b12f-ddc941588f30 None admin] RBAC: Authorization granted {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:23:43.594093 dv-cinder-851351-1-smb devstack@keystone.service[207600]: [pid: 207600|app: 0|req: 107/222] 10.222.0.42 () {56 vars in 1099 bytes} [Thu Jul 28 08:23:43 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:23:43.601740 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a53e374-fea3-421d-b12f-ddc941588f30 None admin] Authenticating user token {{(pid=207600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:23:43.623652 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa19182-d2b4-4541-83f8-42647c89e7cf None admin] Validating token access rules against request {{(pid=207601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:23:43.666477 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0cddd8f-f0f3-4e6d-b075-92b20c6c1b7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:23:43.667754 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0cddd8f-f0f3-4e6d-b075-92b20c6c1b7b None admin] REQUEST_METHOD: `GET` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:23:43.668904 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0cddd8f-f0f3-4e6d-b075-92b20c6c1b7b None admin] SCRIPT_NAME: `/identity` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:23:43.669570 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0cddd8f-f0f3-4e6d-b075-92b20c6c1b7b None admin] PATH_INFO: `/v3/projects/4a9d64056e4a4c2f805643b31ac7e061` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:23:43.673895 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0cddd8f-f0f3-4e6d-b075-92b20c6c1b7b None admin] RBAC: Authorizing `identity:get_project(project_id=4a9d64056e4a4c2f805643b31ac7e061)` {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:23:43.675689 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0cddd8f-f0f3-4e6d-b075-92b20c6c1b7b None admin] RBAC: Authorization granted {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:23:43.677898 dv-cinder-851351-1-smb devstack@keystone.service[207601]: [pid: 207601|app: 0|req: 116/223] 10.222.0.42 () {56 vars in 1186 bytes} [Thu Jul 28 08:23:43 2022] GET /identity/v3/projects/4a9d64056e4a4c2f805643b31ac7e061 => generated 302 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:23:43.684013 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0cddd8f-f0f3-4e6d-b075-92b20c6c1b7b None admin] Authenticating user token {{(pid=207601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:23:43.747755 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG dbcounter [-] [207601] Writing DB stats keystone:SELECT=100 {{(pid=207601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:23:43.761725 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a53e374-fea3-421d-b12f-ddc941588f30 None admin] Validating token access rules against request {{(pid=207600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:23:43.805278 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a90534d-a84f-49ab-b375-4bf3259ce346 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:23:43.806087 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a90534d-a84f-49ab-b375-4bf3259ce346 None admin] REQUEST_METHOD: `GET` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:23:43.806483 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a90534d-a84f-49ab-b375-4bf3259ce346 None admin] SCRIPT_NAME: `/identity` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:23:43.806762 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a90534d-a84f-49ab-b375-4bf3259ce346 None admin] PATH_INFO: `/v3/users/947b8ef66ba34159ba94af8aac2c1206` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:23:43.808148 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a90534d-a84f-49ab-b375-4bf3259ce346 None admin] RBAC: Authorizing `identity:get_user(user_id=947b8ef66ba34159ba94af8aac2c1206)` {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:23:43.810287 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a90534d-a84f-49ab-b375-4bf3259ce346 None admin] RBAC: Authorization granted {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:23:43.816034 dv-cinder-851351-1-smb devstack@keystone.service[207600]: [pid: 207600|app: 0|req: 108/224] 10.222.0.42 () {56 vars in 1177 bytes} [Thu Jul 28 08:23:43 2022] GET /identity/v3/users/947b8ef66ba34159ba94af8aac2c1206 => generated 283 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:23:43.816034 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743eb018-440a-47b2-996b-1767c8274885 None None] REQUEST_METHOD: `GET` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:23:43.816034 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743eb018-440a-47b2-996b-1767c8274885 None None] SCRIPT_NAME: `/identity` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:23:43.816034 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743eb018-440a-47b2-996b-1767c8274885 None None] PATH_INFO: `/` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:23:43.816034 dv-cinder-851351-1-smb devstack@keystone.service[207600]: [pid: 207600|app: 0|req: 109/225] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 08:23:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 08:23:43.816900 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0cddd8f-f0f3-4e6d-b075-92b20c6c1b7b None admin] Validating token access rules against request {{(pid=207601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:23:43.822316 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a64dfd-ba5c-4537-9301-f92d5c9cf146 None None] REQUEST_METHOD: `POST` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:23:43.822609 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a64dfd-ba5c-4537-9301-f92d5c9cf146 None None] SCRIPT_NAME: `/identity` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:23:43.822893 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a64dfd-ba5c-4537-9301-f92d5c9cf146 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:23:43.845449 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.auth.core [None req-60a64dfd-ba5c-4537-9301-f92d5c9cf146 None None] MFA Rules not processed for user `b8110ade874c4aa7af27f5c376df700a`. Rule list: `[]` (Enabled: `True`). {{(pid=207600) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 08:23:43.847001 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.fernet_utils [None req-60a64dfd-ba5c-4537-9301-f92d5c9cf146 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=207600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:23:43.858920 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d009d747-d538-41e6-a31a-fe6e5067b13f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:23:43.860061 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d009d747-d538-41e6-a31a-fe6e5067b13f None admin] REQUEST_METHOD: `GET` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:23:43.860590 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d009d747-d538-41e6-a31a-fe6e5067b13f None admin] SCRIPT_NAME: `/identity` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:23:43.861256 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d009d747-d538-41e6-a31a-fe6e5067b13f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:23:43.862305 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d009d747-d538-41e6-a31a-fe6e5067b13f None admin] RBAC: Adding query filter params (role.id=70a2fd2878c549aeb19b16ec37e37164, scope.project.id=4a9d64056e4a4c2f805643b31ac7e061, user.id=98ec5e65337342c9add09e83bd7469e8) {{(pid=207601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:23:43.863054 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d009d747-d538-41e6-a31a-fe6e5067b13f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:23:43.865050 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d009d747-d538-41e6-a31a-fe6e5067b13f None admin] RBAC: Authorization granted {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:23:43.872191 dv-cinder-851351-1-smb devstack@keystone.service[207601]: [pid: 207601|app: 0|req: 117/226] 10.222.0.42 () {56 vars in 1374 bytes} [Thu Jul 28 08:23:43 2022] GET /identity/v3/role_assignments?user.id=98ec5e65337342c9add09e83bd7469e8&scope.project.id=4a9d64056e4a4c2f805643b31ac7e061&role.id=70a2fd2878c549aeb19b16ec37e37164 => generated 259 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 08:23:43.873485 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d009d747-d538-41e6-a31a-fe6e5067b13f None admin] Authenticating user token {{(pid=207601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:23:43.889662 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG dbcounter [-] [207600] Writing DB stats keystone:SELECT=100 {{(pid=207600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:23:43.961548 dv-cinder-851351-1-smb devstack@keystone.service[207600]: [pid: 207600|app: 0|req: 110/227] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 08:23:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 08:23:44.030422 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a64dfd-ba5c-4537-9301-f92d5c9cf146 None None] Authenticating user token {{(pid=207600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:23:44.122778 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d009d747-d538-41e6-a31a-fe6e5067b13f None admin] Validating token access rules against request {{(pid=207601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:23:44.139520 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG dbcounter [-] [207601] Writing DB stats keystone:SELECT=100 {{(pid=207601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:23:44.183400 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62944f6-c257-40ce-9b6a-9a64d8fd0546 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:23:44.184743 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62944f6-c257-40ce-9b6a-9a64d8fd0546 None admin] REQUEST_METHOD: `GET` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:23:44.185941 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62944f6-c257-40ce-9b6a-9a64d8fd0546 None admin] SCRIPT_NAME: `/identity` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:23:44.186599 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62944f6-c257-40ce-9b6a-9a64d8fd0546 None admin] PATH_INFO: `/v3/projects/4a9d64056e4a4c2f805643b31ac7e061` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:23:44.189410 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e62944f6-c257-40ce-9b6a-9a64d8fd0546 None admin] RBAC: Authorizing `identity:get_project(project_id=4a9d64056e4a4c2f805643b31ac7e061)` {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:23:44.191254 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e62944f6-c257-40ce-9b6a-9a64d8fd0546 None admin] RBAC: Authorization granted {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:23:44.201796 dv-cinder-851351-1-smb devstack@keystone.service[207601]: [pid: 207601|app: 0|req: 118/228] 10.222.0.42 () {56 vars in 1186 bytes} [Thu Jul 28 08:23:43 2022] GET /identity/v3/projects/4a9d64056e4a4c2f805643b31ac7e061 => generated 302 bytes in 322 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:23:44.207753 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62944f6-c257-40ce-9b6a-9a64d8fd0546 None admin] Authenticating user token {{(pid=207601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:23:44.237843 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a64dfd-ba5c-4537-9301-f92d5c9cf146 None None] Validating token access rules against request {{(pid=207600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:23:44.315952 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f1db513-c957-4b91-b0ca-3968bb18c84c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:23:44.317060 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1db513-c957-4b91-b0ca-3968bb18c84c None admin] REQUEST_METHOD: `GET` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:23:44.317573 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1db513-c957-4b91-b0ca-3968bb18c84c None admin] SCRIPT_NAME: `/identity` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:23:44.318111 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1db513-c957-4b91-b0ca-3968bb18c84c None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:23:44.350605 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f1db513-c957-4b91-b0ca-3968bb18c84c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 08:23:44.355932 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application [None req-7f1db513-c957-4b91-b0ca-3968bb18c84c None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 28 08:23:44.355932 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:23:44.355932 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:23:44.355932 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:23:44.355932 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:23:44.355932 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:23:44.355932 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:23:44.355932 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:23:44.355932 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:23:44.355932 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:23:44.355932 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:23:44.355932 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:23:44.355932 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 08:23:44.355932 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 08:23:44.355932 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 08:23:44.355932 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 08:23:44.357079 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 08:23:44.357079 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 08:23:44.357079 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 08:23:44.357079 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 08:23:44.357079 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:23:44.357079 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:23:44.357079 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:23:44.357079 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:23:44.357079 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:23:44.357079 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:23:44.357079 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:23:44.357079 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application with Lock( Jul 28 08:23:44.357079 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:23:44.357079 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:23:44.357079 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:23:44.357079 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:23:44.357983 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:23:44.357983 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:23:44.357983 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:23:44.357983 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:23:44.357983 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 08:23:44.357983 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 08:23:44.357983 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 08:23:44.357983 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 08:23:44.357983 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 08:23:44.357983 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 08:23:44.357983 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 28 08:23:44.357983 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application Jul 28 08:23:44.369787 dv-cinder-851351-1-smb devstack@keystone.service[207600]: [pid: 207600|app: 0|req: 111/229] 10.222.0.42 () {56 vars in 1114 bytes} [Thu Jul 28 08:23:44 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 340 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:23:44.377956 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f1db513-c957-4b91-b0ca-3968bb18c84c None admin] Authenticating user token {{(pid=207600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:23:44.388299 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62944f6-c257-40ce-9b6a-9a64d8fd0546 None admin] Validating token access rules against request {{(pid=207601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:23:44.418459 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG dbcounter [-] [207600] Writing DB stats keystone:SELECT=100 {{(pid=207600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:23:44.447097 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215065cd-c6fb-4978-8201-a5634a5d3ff9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:23:44.448777 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215065cd-c6fb-4978-8201-a5634a5d3ff9 None admin] REQUEST_METHOD: `PUT` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:23:44.449287 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215065cd-c6fb-4978-8201-a5634a5d3ff9 None admin] SCRIPT_NAME: `/identity` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:23:44.449791 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215065cd-c6fb-4978-8201-a5634a5d3ff9 None admin] PATH_INFO: `/v3/projects/4a9d64056e4a4c2f805643b31ac7e061/users/947b8ef66ba34159ba94af8aac2c1206/roles/d0ce88034c6b41878db755343f5840be` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:23:44.454868 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-215065cd-c6fb-4978-8201-a5634a5d3ff9 None admin] RBAC: Authorizing `identity:create_grant(project_id=4a9d64056e4a4c2f805643b31ac7e061, user_id=947b8ef66ba34159ba94af8aac2c1206, role_id=d0ce88034c6b41878db755343f5840be)` {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:23:44.456627 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-215065cd-c6fb-4978-8201-a5634a5d3ff9 None admin] RBAC: Authorization granted {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:23:44.499807 dv-cinder-851351-1-smb devstack@keystone.service[207601]: [pid: 207601|app: 0|req: 119/230] 10.222.0.42 () {58 vars in 1439 bytes} [Thu Jul 28 08:23:44 2022] PUT /identity/v3/projects/4a9d64056e4a4c2f805643b31ac7e061/users/947b8ef66ba34159ba94af8aac2c1206/roles/d0ce88034c6b41878db755343f5840be => generated 0 bytes in 292 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 08:23:44.510677 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f1db513-c957-4b91-b0ca-3968bb18c84c None admin] Validating token access rules against request {{(pid=207600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:23:44.554120 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-537d8014-89c1-4754-87c9-a4d14b9a90a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:23:44.554833 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537d8014-89c1-4754-87c9-a4d14b9a90a8 None admin] REQUEST_METHOD: `GET` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:23:44.555132 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537d8014-89c1-4754-87c9-a4d14b9a90a8 None admin] SCRIPT_NAME: `/identity` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:23:44.555414 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537d8014-89c1-4754-87c9-a4d14b9a90a8 None admin] PATH_INFO: `/v3/roles` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:23:44.556175 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-537d8014-89c1-4754-87c9-a4d14b9a90a8 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=207600) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:23:44.556488 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-537d8014-89c1-4754-87c9-a4d14b9a90a8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:23:44.558082 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-537d8014-89c1-4754-87c9-a4d14b9a90a8 None admin] RBAC: Authorization granted {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:23:44.568026 dv-cinder-851351-1-smb devstack@keystone.service[207600]: [pid: 207600|app: 0|req: 112/231] 10.222.0.42 () {56 vars in 1111 bytes} [Thu Jul 28 08:23:44 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:23:44.573629 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215065cd-c6fb-4978-8201-a5634a5d3ff9 None admin] Authenticating user token {{(pid=207601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:23:44.650277 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG dbcounter [-] [207601] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=207601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:23:44.734132 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215065cd-c6fb-4978-8201-a5634a5d3ff9 None admin] Validating token access rules against request {{(pid=207601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:23:44.782410 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd51ff3e-5b19-4c82-881b-e1a5e46af5f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:23:44.782992 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd51ff3e-5b19-4c82-881b-e1a5e46af5f3 None admin] REQUEST_METHOD: `GET` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:23:44.783281 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd51ff3e-5b19-4c82-881b-e1a5e46af5f3 None admin] SCRIPT_NAME: `/identity` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:23:44.783565 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd51ff3e-5b19-4c82-881b-e1a5e46af5f3 None admin] PATH_INFO: `/v3/users/947b8ef66ba34159ba94af8aac2c1206` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:23:44.784810 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd51ff3e-5b19-4c82-881b-e1a5e46af5f3 None admin] RBAC: Authorizing `identity:get_user(user_id=947b8ef66ba34159ba94af8aac2c1206)` {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:23:44.786295 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd51ff3e-5b19-4c82-881b-e1a5e46af5f3 None admin] RBAC: Authorization granted {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:23:44.788320 dv-cinder-851351-1-smb devstack@keystone.service[207601]: [pid: 207601|app: 0|req: 120/232] 10.222.0.42 () {56 vars in 1177 bytes} [Thu Jul 28 08:23:44 2022] GET /identity/v3/users/947b8ef66ba34159ba94af8aac2c1206 => generated 283 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:23:44.793756 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-537d8014-89c1-4754-87c9-a4d14b9a90a8 None admin] Authenticating user token {{(pid=207600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:23:44.889973 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG dbcounter [-] [207600] Writing DB stats keystone:SELECT=100 {{(pid=207600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:23:44.910015 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-537d8014-89c1-4754-87c9-a4d14b9a90a8 None admin] Validating token access rules against request {{(pid=207600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:23:44.945979 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0b3bd6-846d-4324-8715-bd3f3035a54b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:23:44.946657 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0b3bd6-846d-4324-8715-bd3f3035a54b None admin] REQUEST_METHOD: `GET` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:23:44.946940 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0b3bd6-846d-4324-8715-bd3f3035a54b None admin] SCRIPT_NAME: `/identity` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:23:44.947219 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0b3bd6-846d-4324-8715-bd3f3035a54b None admin] PATH_INFO: `/v3/projects/4a9d64056e4a4c2f805643b31ac7e061` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:23:44.948425 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d0b3bd6-846d-4324-8715-bd3f3035a54b None admin] RBAC: Authorizing `identity:get_project(project_id=4a9d64056e4a4c2f805643b31ac7e061)` {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:23:44.949976 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d0b3bd6-846d-4324-8715-bd3f3035a54b None admin] RBAC: Authorization granted {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:23:44.952067 dv-cinder-851351-1-smb devstack@keystone.service[207600]: [pid: 207600|app: 0|req: 113/233] 10.222.0.42 () {56 vars in 1186 bytes} [Thu Jul 28 08:23:44 2022] GET /identity/v3/projects/4a9d64056e4a4c2f805643b31ac7e061 => generated 302 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:23:44.957607 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd51ff3e-5b19-4c82-881b-e1a5e46af5f3 None admin] Authenticating user token {{(pid=207601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:23:45.061683 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd51ff3e-5b19-4c82-881b-e1a5e46af5f3 None admin] Validating token access rules against request {{(pid=207601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:23:45.068982 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG dbcounter [-] [207601] Writing DB stats keystone:SELECT=100 {{(pid=207601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:23:45.110844 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4a307f-4b5e-4aa3-8792-0e6c2ef670b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:23:45.111559 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4a307f-4b5e-4aa3-8792-0e6c2ef670b2 None admin] REQUEST_METHOD: `PUT` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:23:45.111885 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4a307f-4b5e-4aa3-8792-0e6c2ef670b2 None admin] SCRIPT_NAME: `/identity` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:23:45.112166 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4a307f-4b5e-4aa3-8792-0e6c2ef670b2 None admin] PATH_INFO: `/v3/projects/4a9d64056e4a4c2f805643b31ac7e061/users/947b8ef66ba34159ba94af8aac2c1206/roles/e617201b25d44cb1844c9f28bcac91fb` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:23:45.114506 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f4a307f-4b5e-4aa3-8792-0e6c2ef670b2 None admin] RBAC: Authorizing `identity:create_grant(project_id=4a9d64056e4a4c2f805643b31ac7e061, user_id=947b8ef66ba34159ba94af8aac2c1206, role_id=e617201b25d44cb1844c9f28bcac91fb)` {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:23:45.115984 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f4a307f-4b5e-4aa3-8792-0e6c2ef670b2 None admin] RBAC: Authorization granted {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:23:45.143518 dv-cinder-851351-1-smb devstack@keystone.service[207601]: [pid: 207601|app: 0|req: 121/234] 10.222.0.42 () {58 vars in 1439 bytes} [Thu Jul 28 08:23:44 2022] PUT /identity/v3/projects/4a9d64056e4a4c2f805643b31ac7e061/users/947b8ef66ba34159ba94af8aac2c1206/roles/e617201b25d44cb1844c9f28bcac91fb => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 08:23:45.444280 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b82c6c6-22ce-4a71-b328-cc5cfab61690 None None] REQUEST_METHOD: `GET` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:23:45.444726 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b82c6c6-22ce-4a71-b328-cc5cfab61690 None None] SCRIPT_NAME: `/identity` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:23:45.444926 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b82c6c6-22ce-4a71-b328-cc5cfab61690 None None] PATH_INFO: `/` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:23:45.446629 dv-cinder-851351-1-smb devstack@keystone.service[207600]: [pid: 207600|app: 0|req: 114/235] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 08:23:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 08:23:45.451847 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0ff1a6-0cf9-4007-b51a-32973325c659 None None] REQUEST_METHOD: `POST` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:23:45.452145 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0ff1a6-0cf9-4007-b51a-32973325c659 None None] SCRIPT_NAME: `/identity` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:23:45.452435 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0ff1a6-0cf9-4007-b51a-32973325c659 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:23:45.473017 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.auth.core [None req-5b0ff1a6-0cf9-4007-b51a-32973325c659 None None] MFA Rules not processed for user `b8110ade874c4aa7af27f5c376df700a`. Rule list: `[]` (Enabled: `True`). {{(pid=207601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 08:23:45.474231 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.fernet_utils [None req-5b0ff1a6-0cf9-4007-b51a-32973325c659 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=207601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:23:45.553453 dv-cinder-851351-1-smb devstack@keystone.service[207601]: [pid: 207601|app: 0|req: 122/236] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 08:23:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 08:23:45.574576 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a396eb3-b0f8-4758-8ca3-07583908316a None None] REQUEST_METHOD: `GET` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:23:45.575248 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a396eb3-b0f8-4758-8ca3-07583908316a None None] SCRIPT_NAME: `/identity` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:23:45.575761 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a396eb3-b0f8-4758-8ca3-07583908316a None None] PATH_INFO: `/` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:23:45.577270 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b0ff1a6-0cf9-4007-b51a-32973325c659 None None] Authenticating user token {{(pid=207601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:23:45.577936 dv-cinder-851351-1-smb devstack@keystone.service[207600]: [pid: 207600|app: 0|req: 115/237] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 08:23:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 08:23:45.583356 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd76350-74d3-43e5-b2f3-ae845289d5a3 None None] REQUEST_METHOD: `POST` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:23:45.583920 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd76350-74d3-43e5-b2f3-ae845289d5a3 None None] SCRIPT_NAME: `/identity` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:23:45.584408 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd76350-74d3-43e5-b2f3-ae845289d5a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:23:45.605611 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.auth.core [None req-3cd76350-74d3-43e5-b2f3-ae845289d5a3 None None] MFA Rules not processed for user `b8110ade874c4aa7af27f5c376df700a`. Rule list: `[]` (Enabled: `True`). {{(pid=207600) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 08:23:45.607450 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.fernet_utils [None req-3cd76350-74d3-43e5-b2f3-ae845289d5a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=207600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:23:45.710451 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG dbcounter [-] [207601] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=207601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:23:45.723375 dv-cinder-851351-1-smb devstack@keystone.service[207600]: [pid: 207600|app: 0|req: 116/238] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 08:23:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 28 08:23:45.725800 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b0ff1a6-0cf9-4007-b51a-32973325c659 None None] Validating token access rules against request {{(pid=207601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:23:45.762463 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a310d88-fc67-4ab1-b4cd-0e7a2f0f6953 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:23:45.763198 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a310d88-fc67-4ab1-b4cd-0e7a2f0f6953 None admin] REQUEST_METHOD: `GET` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:23:45.763489 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a310d88-fc67-4ab1-b4cd-0e7a2f0f6953 None admin] SCRIPT_NAME: `/identity` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:23:45.763764 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a310d88-fc67-4ab1-b4cd-0e7a2f0f6953 None admin] PATH_INFO: `/v3/domains/default` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:23:45.764995 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a310d88-fc67-4ab1-b4cd-0e7a2f0f6953 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:23:45.766472 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a310d88-fc67-4ab1-b4cd-0e7a2f0f6953 None admin] RBAC: Authorization granted {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:23:45.768617 dv-cinder-851351-1-smb devstack@keystone.service[207601]: [pid: 207601|app: 0|req: 123/239] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 08:23:45 2022] GET /identity/v3/domains/default => generated 199 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 08:23:45.769861 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd76350-74d3-43e5-b2f3-ae845289d5a3 None None] Authenticating user token {{(pid=207600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:23:45.778559 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a310d88-fc67-4ab1-b4cd-0e7a2f0f6953 None admin] Authenticating user token {{(pid=207601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:23:45.944378 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG dbcounter [-] [207600] Writing DB stats keystone:SELECT=100 {{(pid=207600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:23:45.971947 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a310d88-fc67-4ab1-b4cd-0e7a2f0f6953 None admin] Validating token access rules against request {{(pid=207601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:23:45.983979 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd76350-74d3-43e5-b2f3-ae845289d5a3 None None] Validating token access rules against request {{(pid=207600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:23:46.026914 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2dc750-f41d-4bd0-b19f-a06823e857f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:23:46.027819 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2dc750-f41d-4bd0-b19f-a06823e857f4 None admin] REQUEST_METHOD: `GET` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:23:46.028209 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2dc750-f41d-4bd0-b19f-a06823e857f4 None admin] SCRIPT_NAME: `/identity` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:23:46.028559 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2dc750-f41d-4bd0-b19f-a06823e857f4 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:23:46.040796 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a2dc750-f41d-4bd0-b19f-a06823e857f4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 08:23:46.047033 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application [None req-5a2dc750-f41d-4bd0-b19f-a06823e857f4 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 28 08:23:46.047033 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:23:46.047033 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:23:46.047033 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:23:46.047033 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:23:46.047033 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:23:46.047033 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:23:46.047033 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:23:46.047033 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:23:46.047033 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:23:46.047033 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:23:46.047033 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:23:46.047033 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 08:23:46.047033 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 08:23:46.047033 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 08:23:46.047033 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 08:23:46.048098 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 08:23:46.048098 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 08:23:46.048098 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 08:23:46.048098 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 08:23:46.048098 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:23:46.048098 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:23:46.048098 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:23:46.048098 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:23:46.048098 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:23:46.048098 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:23:46.048098 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:23:46.048098 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application with Lock( Jul 28 08:23:46.048098 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:23:46.048098 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:23:46.048098 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:23:46.048098 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:23:46.049367 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:23:46.049367 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:23:46.049367 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:23:46.049367 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:23:46.049367 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 08:23:46.049367 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 08:23:46.049367 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 08:23:46.049367 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 08:23:46.049367 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 08:23:46.049367 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 08:23:46.049367 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 28 08:23:46.049367 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application Jul 28 08:23:46.049367 dv-cinder-851351-1-smb devstack@keystone.service[207600]: [pid: 207600|app: 0|req: 117/240] 10.222.0.42 () {56 vars in 1099 bytes} [Thu Jul 28 08:23:45 2022] GET /identity/v3/roles/reader => generated 84 bytes in 279 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:23:46.055908 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2dc750-f41d-4bd0-b19f-a06823e857f4 None admin] Authenticating user token {{(pid=207600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:23:46.079164 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2ebbdb-0e53-42be-ac31-171617ed5257 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:23:46.079878 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2ebbdb-0e53-42be-ac31-171617ed5257 None admin] REQUEST_METHOD: `POST` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:23:46.080162 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2ebbdb-0e53-42be-ac31-171617ed5257 None admin] SCRIPT_NAME: `/identity` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:23:46.080436 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2ebbdb-0e53-42be-ac31-171617ed5257 None admin] PATH_INFO: `/v3/users` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:23:46.081188 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d2ebbdb-0e53-42be-ac31-171617ed5257 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:23:46.082675 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d2ebbdb-0e53-42be-ac31-171617ed5257 None admin] RBAC: Authorization granted {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:23:46.127257 dv-cinder-851351-1-smb devstack@keystone.service[207601]: [pid: 207601|app: 0|req: 124/241] 10.222.0.42 () {60 vars in 1132 bytes} [Thu Jul 28 08:23:45 2022] POST /identity/v3/users => generated 293 bytes in 350 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 08:23:46.225671 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2dc750-f41d-4bd0-b19f-a06823e857f4 None admin] Validating token access rules against request {{(pid=207600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:23:46.274003 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad279da0-953e-4287-8f1a-b589850be9d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:23:46.275123 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad279da0-953e-4287-8f1a-b589850be9d3 None admin] REQUEST_METHOD: `GET` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:23:46.275599 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad279da0-953e-4287-8f1a-b589850be9d3 None admin] SCRIPT_NAME: `/identity` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:23:46.276073 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad279da0-953e-4287-8f1a-b589850be9d3 None admin] PATH_INFO: `/v3/roles` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:23:46.277078 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad279da0-953e-4287-8f1a-b589850be9d3 None admin] RBAC: Adding query filter params (name=reader) {{(pid=207600) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:23:46.277593 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad279da0-953e-4287-8f1a-b589850be9d3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:23:46.279344 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad279da0-953e-4287-8f1a-b589850be9d3 None admin] RBAC: Authorization granted {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:23:46.289867 dv-cinder-851351-1-smb devstack@keystone.service[207600]: [pid: 207600|app: 0|req: 118/242] 10.222.0.42 () {56 vars in 1101 bytes} [Thu Jul 28 08:23:46 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:23:46.299620 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2ebbdb-0e53-42be-ac31-171617ed5257 None admin] Authenticating user token {{(pid=207601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:23:46.329979 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG dbcounter [-] [207601] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=207601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:23:46.420935 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2ebbdb-0e53-42be-ac31-171617ed5257 None admin] Validating token access rules against request {{(pid=207601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:23:46.461315 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa7bddd-0d64-4d8e-b122-ea0791f39cf2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:23:46.461992 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa7bddd-0d64-4d8e-b122-ea0791f39cf2 None admin] REQUEST_METHOD: `GET` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:23:46.462276 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa7bddd-0d64-4d8e-b122-ea0791f39cf2 None admin] SCRIPT_NAME: `/identity` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:23:46.462554 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa7bddd-0d64-4d8e-b122-ea0791f39cf2 None admin] PATH_INFO: `/v3/users/15e084dadcc347398223908f72f171ad` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:23:46.475610 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c45210-d48f-451b-a74e-8dc7fa9d4f5b None None] REQUEST_METHOD: `GET` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:23:46.476329 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c45210-d48f-451b-a74e-8dc7fa9d4f5b None None] SCRIPT_NAME: `/identity` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:23:46.476889 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c45210-d48f-451b-a74e-8dc7fa9d4f5b None None] PATH_INFO: `/` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:23:46.478512 dv-cinder-851351-1-smb devstack@keystone.service[207600]: [pid: 207600|app: 0|req: 119/243] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 08:23:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 28 08:23:46.482728 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa7bddd-0d64-4d8e-b122-ea0791f39cf2 None admin] RBAC: Authorizing `identity:get_user(user_id=15e084dadcc347398223908f72f171ad)` {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:23:46.482728 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa7bddd-0d64-4d8e-b122-ea0791f39cf2 None admin] RBAC: Authorization granted {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:23:46.484237 dv-cinder-851351-1-smb devstack@keystone.service[207601]: [pid: 207601|app: 0|req: 125/244] 10.222.0.42 () {56 vars in 1177 bytes} [Thu Jul 28 08:23:46 2022] GET /identity/v3/users/15e084dadcc347398223908f72f171ad => generated 297 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:23:46.484799 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ffd640-f7e3-4421-9550-30e0078bd2a7 None None] REQUEST_METHOD: `POST` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:23:46.485084 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ffd640-f7e3-4421-9550-30e0078bd2a7 None None] SCRIPT_NAME: `/identity` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:23:46.485993 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ffd640-f7e3-4421-9550-30e0078bd2a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:23:46.488987 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa7bddd-0d64-4d8e-b122-ea0791f39cf2 None admin] Authenticating user token {{(pid=207601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:23:46.494267 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG dbcounter [-] [207600] Writing DB stats keystone:SELECT=100 {{(pid=207600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:23:46.513958 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.auth.core [None req-73ffd640-f7e3-4421-9550-30e0078bd2a7 None None] MFA Rules not processed for user `b8110ade874c4aa7af27f5c376df700a`. Rule list: `[]` (Enabled: `True`). {{(pid=207600) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 08:23:46.515285 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.fernet_utils [None req-73ffd640-f7e3-4421-9550-30e0078bd2a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=207600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:23:46.601127 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG dbcounter [-] [207601] Writing DB stats keystone:SELECT=100 {{(pid=207601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:23:46.615182 dv-cinder-851351-1-smb devstack@keystone.service[207600]: [pid: 207600|app: 0|req: 120/245] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 08:23:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 28 08:23:46.628151 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa7bddd-0d64-4d8e-b122-ea0791f39cf2 None admin] Validating token access rules against request {{(pid=207601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:23:46.641448 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ffd640-f7e3-4421-9550-30e0078bd2a7 None None] Authenticating user token {{(pid=207600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:23:46.681562 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab6b92ed-20ec-4d46-a602-4c4ecb1fcb01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:23:46.683646 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6b92ed-20ec-4d46-a602-4c4ecb1fcb01 None admin] REQUEST_METHOD: `GET` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:23:46.684172 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6b92ed-20ec-4d46-a602-4c4ecb1fcb01 None admin] SCRIPT_NAME: `/identity` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:23:46.684658 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6b92ed-20ec-4d46-a602-4c4ecb1fcb01 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:23:46.767540 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ffd640-f7e3-4421-9550-30e0078bd2a7 None None] Validating token access rules against request {{(pid=207600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:23:46.794857 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab6b92ed-20ec-4d46-a602-4c4ecb1fcb01 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:23:46.797619 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab6b92ed-20ec-4d46-a602-4c4ecb1fcb01 None admin] RBAC: Authorization granted {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:23:46.806220 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG dbcounter [-] [207600] Writing DB stats keystone:SELECT=100 {{(pid=207600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:23:46.815169 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9bf546b-5e43-4497-88e3-a8eeb59744c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:23:46.815935 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9bf546b-5e43-4497-88e3-a8eeb59744c6 None admin] REQUEST_METHOD: `GET` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:23:46.816280 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9bf546b-5e43-4497-88e3-a8eeb59744c6 None admin] SCRIPT_NAME: `/identity` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:23:46.816642 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9bf546b-5e43-4497-88e3-a8eeb59744c6 None admin] PATH_INFO: `/v3/roles/member` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:23:46.829739 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9bf546b-5e43-4497-88e3-a8eeb59744c6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 08:23:46.836777 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application [None req-e9bf546b-5e43-4497-88e3-a8eeb59744c6 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 28 08:23:46.836777 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:23:46.836777 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:23:46.836777 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:23:46.836777 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:23:46.836777 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:23:46.836777 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:23:46.836777 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:23:46.836777 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:23:46.836777 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:23:46.836777 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:23:46.836777 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:23:46.836777 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 08:23:46.836777 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 08:23:46.836777 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 08:23:46.836777 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 08:23:46.837844 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 08:23:46.837844 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 08:23:46.837844 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 08:23:46.837844 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 08:23:46.837844 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:23:46.837844 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:23:46.837844 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:23:46.837844 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:23:46.837844 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:23:46.837844 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:23:46.837844 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:23:46.837844 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application with Lock( Jul 28 08:23:46.837844 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:23:46.837844 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:23:46.837844 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:23:46.837844 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:23:46.839586 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:23:46.839586 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:23:46.839586 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:23:46.839586 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:23:46.839586 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 08:23:46.839586 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 08:23:46.839586 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 08:23:46.839586 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 08:23:46.839586 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 08:23:46.839586 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 08:23:46.839586 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 28 08:23:46.839586 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application Jul 28 08:23:46.839586 dv-cinder-851351-1-smb devstack@keystone.service[207600]: [pid: 207600|app: 0|req: 121/246] 10.222.0.42 () {56 vars in 1099 bytes} [Thu Jul 28 08:23:46 2022] GET /identity/v3/roles/member => generated 84 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 08:23:46.848632 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9bf546b-5e43-4497-88e3-a8eeb59744c6 None admin] Authenticating user token {{(pid=207600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:23:46.936732 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG dbcounter [-] [207601] Writing DB stats keystone:SELECT=100 {{(pid=207601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:23:46.990612 dv-cinder-851351-1-smb devstack@keystone.service[207601]: [pid: 207601|app: 0|req: 126/247] 10.222.0.42 () {58 vars in 1282 bytes} [Thu Jul 28 08:23:46 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 502 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 28 08:23:46.996438 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab6b92ed-20ec-4d46-a602-4c4ecb1fcb01 None admin] Authenticating user token {{(pid=207601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:23:47.046315 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9bf546b-5e43-4497-88e3-a8eeb59744c6 None admin] Validating token access rules against request {{(pid=207600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:23:47.123186 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29051937-ddd8-43bb-b28a-ff79b1b2c26c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:23:47.123829 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29051937-ddd8-43bb-b28a-ff79b1b2c26c None admin] REQUEST_METHOD: `GET` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:23:47.124110 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29051937-ddd8-43bb-b28a-ff79b1b2c26c None admin] SCRIPT_NAME: `/identity` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:23:47.124385 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29051937-ddd8-43bb-b28a-ff79b1b2c26c None admin] PATH_INFO: `/v3/roles` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:23:47.125164 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29051937-ddd8-43bb-b28a-ff79b1b2c26c None admin] RBAC: Adding query filter params (name=member) {{(pid=207600) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:23:47.125471 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29051937-ddd8-43bb-b28a-ff79b1b2c26c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:23:47.131731 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29051937-ddd8-43bb-b28a-ff79b1b2c26c None admin] RBAC: Authorization granted {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:23:47.154552 dv-cinder-851351-1-smb devstack@keystone.service[207600]: [pid: 207600|app: 0|req: 122/248] 10.222.0.42 () {56 vars in 1101 bytes} [Thu Jul 28 08:23:46 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 309 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 08:23:47.160789 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29051937-ddd8-43bb-b28a-ff79b1b2c26c None admin] Authenticating user token {{(pid=207600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:23:47.222143 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab6b92ed-20ec-4d46-a602-4c4ecb1fcb01 None admin] Validating token access rules against request {{(pid=207601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:23:47.243439 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG dbcounter [-] [207600] Writing DB stats keystone:SELECT=100 {{(pid=207600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:23:47.288948 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64eca8f5-cff3-401e-934e-9bab738d764c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:23:47.289621 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64eca8f5-cff3-401e-934e-9bab738d764c None admin] REQUEST_METHOD: `GET` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:23:47.289903 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64eca8f5-cff3-401e-934e-9bab738d764c None admin] SCRIPT_NAME: `/identity` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:23:47.290178 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64eca8f5-cff3-401e-934e-9bab738d764c None admin] PATH_INFO: `/v3/projects/4a9d64056e4a4c2f805643b31ac7e061` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:23:47.291393 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64eca8f5-cff3-401e-934e-9bab738d764c None admin] RBAC: Authorizing `identity:get_project(project_id=4a9d64056e4a4c2f805643b31ac7e061)` {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:23:47.293023 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64eca8f5-cff3-401e-934e-9bab738d764c None admin] RBAC: Authorization granted {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:23:47.295300 dv-cinder-851351-1-smb devstack@keystone.service[207601]: [pid: 207601|app: 0|req: 127/249] 10.222.0.42 () {56 vars in 1186 bytes} [Thu Jul 28 08:23:46 2022] GET /identity/v3/projects/4a9d64056e4a4c2f805643b31ac7e061 => generated 302 bytes in 299 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 08:23:47.296638 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470ec8c8-f1b4-4f73-a12e-bcfae4d70b42 None None] REQUEST_METHOD: `GET` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:23:47.296900 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470ec8c8-f1b4-4f73-a12e-bcfae4d70b42 None None] SCRIPT_NAME: `/identity` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:23:47.297130 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470ec8c8-f1b4-4f73-a12e-bcfae4d70b42 None None] PATH_INFO: `/` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:23:47.298509 dv-cinder-851351-1-smb devstack@keystone.service[207601]: [pid: 207601|app: 0|req: 128/250] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 08:23:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 08:23:47.302242 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-470ec8c8-f1b4-4f73-a12e-bcfae4d70b42 None None] Authenticating user token {{(pid=207601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:23:47.348201 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29051937-ddd8-43bb-b28a-ff79b1b2c26c None admin] Validating token access rules against request {{(pid=207600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:23:47.358084 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG dbcounter [-] [207601] Writing DB stats keystone:SELECT=100 {{(pid=207601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:23:47.404297 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afccd42b-d2ed-43c6-92a4-d7d16f87de41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:23:47.405344 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afccd42b-d2ed-43c6-92a4-d7d16f87de41 None admin] REQUEST_METHOD: `GET` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:23:47.405732 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afccd42b-d2ed-43c6-92a4-d7d16f87de41 None admin] SCRIPT_NAME: `/identity` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:23:47.406134 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afccd42b-d2ed-43c6-92a4-d7d16f87de41 None admin] PATH_INFO: `/v3/users/98ec5e65337342c9add09e83bd7469e8` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:23:47.407545 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afccd42b-d2ed-43c6-92a4-d7d16f87de41 None admin] RBAC: Authorizing `identity:get_user(user_id=98ec5e65337342c9add09e83bd7469e8)` {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:23:47.409191 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afccd42b-d2ed-43c6-92a4-d7d16f87de41 None admin] RBAC: Authorization granted {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:23:47.411784 dv-cinder-851351-1-smb devstack@keystone.service[207600]: [pid: 207600|app: 0|req: 123/251] 10.222.0.42 () {56 vars in 1177 bytes} [Thu Jul 28 08:23:47 2022] GET /identity/v3/users/98ec5e65337342c9add09e83bd7469e8 => generated 297 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:23:47.415018 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c4c8c1-32bb-4c1c-a723-2f2eb0cdc086 None None] REQUEST_METHOD: `POST` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:23:47.415018 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c4c8c1-32bb-4c1c-a723-2f2eb0cdc086 None None] SCRIPT_NAME: `/identity` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:23:47.415018 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c4c8c1-32bb-4c1c-a723-2f2eb0cdc086 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:23:47.451708 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.auth.core [None req-71c4c8c1-32bb-4c1c-a723-2f2eb0cdc086 None None] MFA Rules not processed for user `b8110ade874c4aa7af27f5c376df700a`. Rule list: `[]` (Enabled: `True`). {{(pid=207600) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 08:23:47.454117 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.fernet_utils [None req-71c4c8c1-32bb-4c1c-a723-2f2eb0cdc086 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=207600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:23:47.463029 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-470ec8c8-f1b4-4f73-a12e-bcfae4d70b42 None None] Validating token access rules against request {{(pid=207601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:23:47.518768 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a7892b-2ca3-4b91-a0b8-96ba0d1e8cb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:23:47.520838 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a7892b-2ca3-4b91-a0b8-96ba0d1e8cb1 None admin] REQUEST_METHOD: `GET` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:23:47.521524 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a7892b-2ca3-4b91-a0b8-96ba0d1e8cb1 None admin] SCRIPT_NAME: `/identity` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:23:47.522594 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a7892b-2ca3-4b91-a0b8-96ba0d1e8cb1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:23:47.524524 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a7892b-2ca3-4b91-a0b8-96ba0d1e8cb1 None admin] RBAC: Adding query filter params (role.id=4af3ffd96e0540dbb20e6ccb08a61f0b, scope.project.id=4a9d64056e4a4c2f805643b31ac7e061, user.id=15e084dadcc347398223908f72f171ad) {{(pid=207601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:23:47.526298 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a7892b-2ca3-4b91-a0b8-96ba0d1e8cb1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:23:47.528018 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a7892b-2ca3-4b91-a0b8-96ba0d1e8cb1 None admin] RBAC: Authorization granted {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:23:47.547324 dv-cinder-851351-1-smb devstack@keystone.service[207601]: [pid: 207601|app: 0|req: 129/252] 10.222.0.42 () {56 vars in 1374 bytes} [Thu Jul 28 08:23:47 2022] GET /identity/v3/role_assignments?user.id=15e084dadcc347398223908f72f171ad&scope.project.id=4a9d64056e4a4c2f805643b31ac7e061&role.id=4af3ffd96e0540dbb20e6ccb08a61f0b => generated 259 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 08:23:47.547636 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a7892b-2ca3-4b91-a0b8-96ba0d1e8cb1 None admin] Authenticating user token {{(pid=207601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:23:47.598665 dv-cinder-851351-1-smb devstack@keystone.service[207600]: [pid: 207600|app: 0|req: 124/253] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 08:23:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 08:23:47.625718 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c4c8c1-32bb-4c1c-a723-2f2eb0cdc086 None None] Authenticating user token {{(pid=207600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:23:47.738783 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG dbcounter [-] [207600] Writing DB stats keystone:SELECT=100 {{(pid=207600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:23:47.801094 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a7892b-2ca3-4b91-a0b8-96ba0d1e8cb1 None admin] Validating token access rules against request {{(pid=207601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:23:47.825159 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG dbcounter [-] [207601] Writing DB stats keystone:SELECT=100 {{(pid=207601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:23:47.845247 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c4c8c1-32bb-4c1c-a723-2f2eb0cdc086 None None] Validating token access rules against request {{(pid=207600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:23:47.869863 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f62272-5adf-4f3e-9034-e93485c3f397 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:23:47.870555 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f62272-5adf-4f3e-9034-e93485c3f397 None admin] REQUEST_METHOD: `GET` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:23:47.870845 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f62272-5adf-4f3e-9034-e93485c3f397 None admin] SCRIPT_NAME: `/identity` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:23:47.871125 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f62272-5adf-4f3e-9034-e93485c3f397 None admin] PATH_INFO: `/v3/projects/4a9d64056e4a4c2f805643b31ac7e061` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:23:47.874648 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14f62272-5adf-4f3e-9034-e93485c3f397 None admin] RBAC: Authorizing `identity:get_project(project_id=4a9d64056e4a4c2f805643b31ac7e061)` {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:23:47.874648 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14f62272-5adf-4f3e-9034-e93485c3f397 None admin] RBAC: Authorization granted {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:23:47.876066 dv-cinder-851351-1-smb devstack@keystone.service[207601]: [pid: 207601|app: 0|req: 130/254] 10.222.0.42 () {56 vars in 1186 bytes} [Thu Jul 28 08:23:47 2022] GET /identity/v3/projects/4a9d64056e4a4c2f805643b31ac7e061 => generated 302 bytes in 329 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:23:47.888145 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f62272-5adf-4f3e-9034-e93485c3f397 None admin] Authenticating user token {{(pid=207601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:23:47.923127 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941941b4-8911-4888-840d-0315e14445e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:23:47.924131 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941941b4-8911-4888-840d-0315e14445e9 None admin] REQUEST_METHOD: `GET` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:23:47.924606 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941941b4-8911-4888-840d-0315e14445e9 None admin] SCRIPT_NAME: `/identity` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:23:47.926380 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941941b4-8911-4888-840d-0315e14445e9 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:23:47.944744 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-941941b4-8911-4888-840d-0315e14445e9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 08:23:47.948608 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application [None req-941941b4-8911-4888-840d-0315e14445e9 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 08:23:47.948608 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:23:47.948608 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:23:47.948608 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:23:47.948608 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:23:47.948608 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:23:47.948608 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:23:47.948608 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:23:47.948608 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:23:47.948608 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:23:47.948608 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:23:47.948608 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:23:47.948608 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 08:23:47.948608 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 08:23:47.948608 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 08:23:47.948608 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 08:23:47.949682 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 08:23:47.949682 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 08:23:47.949682 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 08:23:47.949682 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 08:23:47.949682 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:23:47.949682 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:23:47.949682 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:23:47.949682 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:23:47.949682 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:23:47.949682 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:23:47.949682 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:23:47.949682 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application with Lock( Jul 28 08:23:47.949682 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:23:47.949682 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:23:47.949682 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:23:47.949682 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:23:47.951007 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:23:47.951007 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:23:47.951007 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:23:47.951007 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:23:47.951007 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 08:23:47.951007 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 08:23:47.951007 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 08:23:47.951007 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 08:23:47.951007 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 08:23:47.951007 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 08:23:47.951007 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 08:23:47.951007 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application Jul 28 08:23:47.951841 dv-cinder-851351-1-smb devstack@keystone.service[207600]: [pid: 207600|app: 0|req: 125/255] 10.222.0.42 () {56 vars in 1096 bytes} [Thu Jul 28 08:23:47 2022] GET /identity/v3/roles/admin => generated 83 bytes in 326 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:23:47.958628 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941941b4-8911-4888-840d-0315e14445e9 None admin] Authenticating user token {{(pid=207600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:23:48.093517 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941941b4-8911-4888-840d-0315e14445e9 None admin] Validating token access rules against request {{(pid=207600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:23:48.111965 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f62272-5adf-4f3e-9034-e93485c3f397 None admin] Validating token access rules against request {{(pid=207601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:23:48.117489 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG dbcounter [-] [207600] Writing DB stats keystone:SELECT=100 {{(pid=207600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:23:48.153125 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65fdc303-890d-434d-8373-d007c61cfcf6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:23:48.154241 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65fdc303-890d-434d-8373-d007c61cfcf6 None admin] REQUEST_METHOD: `PUT` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:23:48.154768 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65fdc303-890d-434d-8373-d007c61cfcf6 None admin] SCRIPT_NAME: `/identity` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:23:48.155248 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65fdc303-890d-434d-8373-d007c61cfcf6 None admin] PATH_INFO: `/v3/projects/4a9d64056e4a4c2f805643b31ac7e061/users/98ec5e65337342c9add09e83bd7469e8/roles/70a2fd2878c549aeb19b16ec37e37164` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:23:48.157670 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65fdc303-890d-434d-8373-d007c61cfcf6 None admin] RBAC: Authorizing `identity:create_grant(project_id=4a9d64056e4a4c2f805643b31ac7e061, user_id=98ec5e65337342c9add09e83bd7469e8, role_id=70a2fd2878c549aeb19b16ec37e37164)` {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:23:48.159417 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65fdc303-890d-434d-8373-d007c61cfcf6 None admin] RBAC: Authorization granted {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:23:48.168902 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e919fa6a-c389-41f8-a0ab-ef67f21881cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:23:48.168902 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e919fa6a-c389-41f8-a0ab-ef67f21881cb None admin] REQUEST_METHOD: `GET` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:23:48.168902 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e919fa6a-c389-41f8-a0ab-ef67f21881cb None admin] SCRIPT_NAME: `/identity` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:23:48.168902 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e919fa6a-c389-41f8-a0ab-ef67f21881cb None admin] PATH_INFO: `/v3/roles` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:23:48.169360 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e919fa6a-c389-41f8-a0ab-ef67f21881cb None admin] RBAC: Adding query filter params (name=admin) {{(pid=207600) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:23:48.169360 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e919fa6a-c389-41f8-a0ab-ef67f21881cb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:23:48.169360 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e919fa6a-c389-41f8-a0ab-ef67f21881cb None admin] RBAC: Authorization granted {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:23:48.184691 dv-cinder-851351-1-smb devstack@keystone.service[207600]: [pid: 207600|app: 0|req: 126/256] 10.222.0.42 () {56 vars in 1099 bytes} [Thu Jul 28 08:23:47 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:23:48.184691 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5792ff-107a-49db-bd0c-070f59d48453 None None] REQUEST_METHOD: `GET` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:23:48.184691 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5792ff-107a-49db-bd0c-070f59d48453 None None] SCRIPT_NAME: `/identity` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:23:48.184691 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5792ff-107a-49db-bd0c-070f59d48453 None None] PATH_INFO: `/` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:23:48.184691 dv-cinder-851351-1-smb devstack@keystone.service[207600]: [pid: 207600|app: 0|req: 127/257] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 08:23:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 08:23:48.187801 dv-cinder-851351-1-smb devstack@keystone.service[207601]: [pid: 207601|app: 0|req: 131/258] 10.222.0.42 () {58 vars in 1439 bytes} [Thu Jul 28 08:23:47 2022] PUT /identity/v3/projects/4a9d64056e4a4c2f805643b31ac7e061/users/98ec5e65337342c9add09e83bd7469e8/roles/70a2fd2878c549aeb19b16ec37e37164 => generated 0 bytes in 301 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 28 08:23:48.189319 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed5792ff-107a-49db-bd0c-070f59d48453 None None] Authenticating user token {{(pid=207600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:23:48.189820 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acad6652-be18-47e7-a89f-f7581d501b19 None None] REQUEST_METHOD: `POST` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:23:48.190319 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acad6652-be18-47e7-a89f-f7581d501b19 None None] SCRIPT_NAME: `/identity` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:23:48.190840 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acad6652-be18-47e7-a89f-f7581d501b19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:23:48.217380 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.auth.core [None req-acad6652-be18-47e7-a89f-f7581d501b19 None None] MFA Rules not processed for user `b8110ade874c4aa7af27f5c376df700a`. Rule list: `[]` (Enabled: `True`). {{(pid=207601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 08:23:48.219068 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.fernet_utils [None req-acad6652-be18-47e7-a89f-f7581d501b19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=207601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:23:48.257073 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG dbcounter [-] [207601] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=207601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:23:48.341818 dv-cinder-851351-1-smb devstack@keystone.service[207601]: [pid: 207601|app: 0|req: 132/259] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 08:23:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 28 08:23:48.377681 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acad6652-be18-47e7-a89f-f7581d501b19 None None] Authenticating user token {{(pid=207601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:23:48.413120 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed5792ff-107a-49db-bd0c-070f59d48453 None None] Validating token access rules against request {{(pid=207600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:23:48.472772 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c647b5f4-e4a2-4ae7-807f-916e5dbb5f3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:23:48.473292 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c647b5f4-e4a2-4ae7-807f-916e5dbb5f3b None admin] REQUEST_METHOD: `GET` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:23:48.473591 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c647b5f4-e4a2-4ae7-807f-916e5dbb5f3b None admin] SCRIPT_NAME: `/identity` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:23:48.473876 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c647b5f4-e4a2-4ae7-807f-916e5dbb5f3b None admin] PATH_INFO: `/v3/users/947b8ef66ba34159ba94af8aac2c1206` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:23:48.476192 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c647b5f4-e4a2-4ae7-807f-916e5dbb5f3b None admin] RBAC: Authorizing `identity:get_user(user_id=947b8ef66ba34159ba94af8aac2c1206)` {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:23:48.477864 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c647b5f4-e4a2-4ae7-807f-916e5dbb5f3b None admin] RBAC: Authorization granted {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:23:48.484134 dv-cinder-851351-1-smb devstack@keystone.service[207600]: [pid: 207600|app: 0|req: 128/260] 10.222.0.42 () {56 vars in 1177 bytes} [Thu Jul 28 08:23:48 2022] GET /identity/v3/users/947b8ef66ba34159ba94af8aac2c1206 => generated 283 bytes in 291 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:23:48.485482 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c647b5f4-e4a2-4ae7-807f-916e5dbb5f3b None admin] Authenticating user token {{(pid=207600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:23:48.538547 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acad6652-be18-47e7-a89f-f7581d501b19 None None] Validating token access rules against request {{(pid=207601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:23:48.563494 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG dbcounter [-] [207600] Writing DB stats keystone:SELECT=100 {{(pid=207600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:23:48.581699 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b16f77-e841-448d-bff7-bcd4f2115868 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:23:48.582779 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b16f77-e841-448d-bff7-bcd4f2115868 None admin] REQUEST_METHOD: `GET` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:23:48.583298 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b16f77-e841-448d-bff7-bcd4f2115868 None admin] SCRIPT_NAME: `/identity` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:23:48.583816 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b16f77-e841-448d-bff7-bcd4f2115868 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:23:48.597395 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66b16f77-e841-448d-bff7-bcd4f2115868 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 08:23:48.605570 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application [None req-66b16f77-e841-448d-bff7-bcd4f2115868 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 28 08:23:48.605570 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:23:48.605570 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:23:48.605570 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:23:48.605570 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:23:48.605570 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:23:48.605570 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:23:48.605570 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:23:48.605570 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:23:48.605570 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:23:48.605570 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:23:48.605570 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:23:48.605570 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 08:23:48.605570 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 08:23:48.605570 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 08:23:48.605570 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 08:23:48.606689 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 08:23:48.606689 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 08:23:48.606689 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 08:23:48.606689 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 08:23:48.606689 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:23:48.606689 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:23:48.606689 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:23:48.606689 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:23:48.606689 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:23:48.606689 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:23:48.606689 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:23:48.606689 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application with Lock( Jul 28 08:23:48.606689 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:23:48.606689 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:23:48.606689 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:23:48.606689 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:23:48.607558 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:23:48.607558 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:23:48.607558 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:23:48.607558 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:23:48.607558 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 08:23:48.607558 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 08:23:48.607558 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 08:23:48.607558 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 08:23:48.607558 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 08:23:48.607558 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 08:23:48.607558 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 28 08:23:48.607558 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application Jul 28 08:23:48.610292 dv-cinder-851351-1-smb devstack@keystone.service[207601]: [pid: 207601|app: 0|req: 133/261] 10.222.0.42 () {56 vars in 1114 bytes} [Thu Jul 28 08:23:48 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 08:23:48.617911 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b16f77-e841-448d-bff7-bcd4f2115868 None admin] Authenticating user token {{(pid=207601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:23:48.652266 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c647b5f4-e4a2-4ae7-807f-916e5dbb5f3b None admin] Validating token access rules against request {{(pid=207600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:23:48.664910 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG dbcounter [-] [207601] Writing DB stats keystone:SELECT=100 {{(pid=207601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:23:48.696552 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f091765-cc5b-4241-ac77-e53112841ce0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:23:48.697032 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f091765-cc5b-4241-ac77-e53112841ce0 None admin] REQUEST_METHOD: `GET` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:23:48.697318 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f091765-cc5b-4241-ac77-e53112841ce0 None admin] SCRIPT_NAME: `/identity` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:23:48.697596 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f091765-cc5b-4241-ac77-e53112841ce0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:23:48.765567 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b16f77-e841-448d-bff7-bcd4f2115868 None admin] Validating token access rules against request {{(pid=207601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:23:48.789592 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f091765-cc5b-4241-ac77-e53112841ce0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:23:48.791092 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f091765-cc5b-4241-ac77-e53112841ce0 None admin] RBAC: Authorization granted {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:23:48.804692 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae3d0be-a5e5-4f47-a67f-c791ac335e5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:23:48.805831 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae3d0be-a5e5-4f47-a67f-c791ac335e5b None admin] REQUEST_METHOD: `GET` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:23:48.806337 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae3d0be-a5e5-4f47-a67f-c791ac335e5b None admin] SCRIPT_NAME: `/identity` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:23:48.806833 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae3d0be-a5e5-4f47-a67f-c791ac335e5b None admin] PATH_INFO: `/v3/roles` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:23:48.807803 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae3d0be-a5e5-4f47-a67f-c791ac335e5b None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=207601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:23:48.808372 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae3d0be-a5e5-4f47-a67f-c791ac335e5b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:23:48.810173 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae3d0be-a5e5-4f47-a67f-c791ac335e5b None admin] RBAC: Authorization granted {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:23:48.820292 dv-cinder-851351-1-smb devstack@keystone.service[207601]: [pid: 207601|app: 0|req: 134/262] 10.222.0.42 () {56 vars in 1111 bytes} [Thu Jul 28 08:23:48 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:23:48.825706 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae3d0be-a5e5-4f47-a67f-c791ac335e5b None admin] Authenticating user token {{(pid=207601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:23:48.860338 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG dbcounter [-] [207600] Writing DB stats keystone:SELECT=100 {{(pid=207600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:23:48.969033 dv-cinder-851351-1-smb devstack@keystone.service[207600]: [pid: 207600|app: 0|req: 129/263] 10.222.0.42 () {58 vars in 1282 bytes} [Thu Jul 28 08:23:48 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 484 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 28 08:23:48.976731 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f091765-cc5b-4241-ac77-e53112841ce0 None admin] Authenticating user token {{(pid=207600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:23:49.101472 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG dbcounter [-] [207601] Writing DB stats keystone:SELECT=100 {{(pid=207601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:23:49.123703 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae3d0be-a5e5-4f47-a67f-c791ac335e5b None admin] Validating token access rules against request {{(pid=207601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:23:49.182429 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f091765-cc5b-4241-ac77-e53112841ce0 None admin] Validating token access rules against request {{(pid=207600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:23:49.201317 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f13aed-6030-494b-833c-90abc0cdf8aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:23:49.202422 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f13aed-6030-494b-833c-90abc0cdf8aa None admin] REQUEST_METHOD: `GET` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:23:49.204115 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f13aed-6030-494b-833c-90abc0cdf8aa None admin] SCRIPT_NAME: `/identity` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:23:49.204612 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f13aed-6030-494b-833c-90abc0cdf8aa None admin] PATH_INFO: `/v3/users/947b8ef66ba34159ba94af8aac2c1206` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:23:49.206376 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81f13aed-6030-494b-833c-90abc0cdf8aa None admin] RBAC: Authorizing `identity:get_user(user_id=947b8ef66ba34159ba94af8aac2c1206)` {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:23:49.208930 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81f13aed-6030-494b-833c-90abc0cdf8aa None admin] RBAC: Authorization granted {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:23:49.211288 dv-cinder-851351-1-smb devstack@keystone.service[207601]: [pid: 207601|app: 0|req: 135/264] 10.222.0.42 () {56 vars in 1177 bytes} [Thu Jul 28 08:23:48 2022] GET /identity/v3/users/947b8ef66ba34159ba94af8aac2c1206 => generated 283 bytes in 386 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:23:49.220358 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f13aed-6030-494b-833c-90abc0cdf8aa None admin] Authenticating user token {{(pid=207601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:23:49.264559 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b09fb8-72a2-4244-a753-468ef54ccc92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:23:49.265060 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b09fb8-72a2-4244-a753-468ef54ccc92 None admin] REQUEST_METHOD: `GET` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:23:49.265338 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b09fb8-72a2-4244-a753-468ef54ccc92 None admin] SCRIPT_NAME: `/identity` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:23:49.267817 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b09fb8-72a2-4244-a753-468ef54ccc92 None admin] PATH_INFO: `/v3/projects/4a9d64056e4a4c2f805643b31ac7e061` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:23:49.269521 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67b09fb8-72a2-4244-a753-468ef54ccc92 None admin] RBAC: Authorizing `identity:get_project(project_id=4a9d64056e4a4c2f805643b31ac7e061)` {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:23:49.271113 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67b09fb8-72a2-4244-a753-468ef54ccc92 None admin] RBAC: Authorization granted {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:23:49.274931 dv-cinder-851351-1-smb devstack@keystone.service[207600]: [pid: 207600|app: 0|req: 130/265] 10.222.0.42 () {56 vars in 1186 bytes} [Thu Jul 28 08:23:48 2022] GET /identity/v3/projects/4a9d64056e4a4c2f805643b31ac7e061 => generated 302 bytes in 298 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 08:23:49.280215 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b09fb8-72a2-4244-a753-468ef54ccc92 None admin] Authenticating user token {{(pid=207600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:23:49.305072 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG dbcounter [-] [207600] Writing DB stats keystone:SELECT=100 {{(pid=207600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:23:49.422233 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f13aed-6030-494b-833c-90abc0cdf8aa None admin] Validating token access rules against request {{(pid=207601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:23:49.495438 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b09fb8-72a2-4244-a753-468ef54ccc92 None admin] Validating token access rules against request {{(pid=207600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:23:49.502368 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef08b3a7-725c-45c6-951e-5515c33eeaf3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:23:49.503031 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef08b3a7-725c-45c6-951e-5515c33eeaf3 None admin] REQUEST_METHOD: `GET` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:23:49.503321 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef08b3a7-725c-45c6-951e-5515c33eeaf3 None admin] SCRIPT_NAME: `/identity` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:23:49.503607 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef08b3a7-725c-45c6-951e-5515c33eeaf3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:23:49.569050 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG dbcounter [-] [207601] Writing DB stats keystone:SELECT=100 {{(pid=207601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:23:49.570828 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df78f392-05cf-4306-bdd5-62780bfb33f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:23:49.571767 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df78f392-05cf-4306-bdd5-62780bfb33f2 None admin] REQUEST_METHOD: `GET` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:23:49.572225 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df78f392-05cf-4306-bdd5-62780bfb33f2 None admin] SCRIPT_NAME: `/identity` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:23:49.572515 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df78f392-05cf-4306-bdd5-62780bfb33f2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:23:49.573372 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df78f392-05cf-4306-bdd5-62780bfb33f2 None admin] RBAC: Adding query filter params (role.id=d0ce88034c6b41878db755343f5840be, scope.project.id=4a9d64056e4a4c2f805643b31ac7e061, user.id=947b8ef66ba34159ba94af8aac2c1206) {{(pid=207600) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:23:49.573813 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df78f392-05cf-4306-bdd5-62780bfb33f2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:23:49.575269 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df78f392-05cf-4306-bdd5-62780bfb33f2 None admin] RBAC: Authorization granted {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:23:49.600872 dv-cinder-851351-1-smb devstack@keystone.service[207600]: [pid: 207600|app: 0|req: 131/266] 10.222.0.42 () {56 vars in 1374 bytes} [Thu Jul 28 08:23:49 2022] GET /identity/v3/role_assignments?user.id=947b8ef66ba34159ba94af8aac2c1206&scope.project.id=4a9d64056e4a4c2f805643b31ac7e061&role.id=d0ce88034c6b41878db755343f5840be => generated 608 bytes in 322 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:23:49.627333 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef08b3a7-725c-45c6-951e-5515c33eeaf3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:23:49.629617 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef08b3a7-725c-45c6-951e-5515c33eeaf3 None admin] RBAC: Authorization granted {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:23:49.681010 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42db1c8c-c149-407d-b590-96c377eecde9 None None] REQUEST_METHOD: `GET` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:23:49.681369 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42db1c8c-c149-407d-b590-96c377eecde9 None None] SCRIPT_NAME: `/identity` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:23:49.681593 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42db1c8c-c149-407d-b590-96c377eecde9 None None] PATH_INFO: `/` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:23:49.683336 dv-cinder-851351-1-smb devstack@keystone.service[207600]: [pid: 207600|app: 0|req: 132/267] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 08:23:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 28 08:23:49.688796 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97819fe-46ca-467d-9358-1bc6710e286d None None] REQUEST_METHOD: `POST` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:23:49.689092 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97819fe-46ca-467d-9358-1bc6710e286d None None] SCRIPT_NAME: `/identity` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:23:49.689376 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97819fe-46ca-467d-9358-1bc6710e286d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:23:49.724984 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.auth.core [None req-f97819fe-46ca-467d-9358-1bc6710e286d None None] MFA Rules not processed for user `b8110ade874c4aa7af27f5c376df700a`. Rule list: `[]` (Enabled: `True`). {{(pid=207600) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 08:23:49.724984 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.fernet_utils [None req-f97819fe-46ca-467d-9358-1bc6710e286d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=207600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:23:49.808151 dv-cinder-851351-1-smb devstack@keystone.service[207601]: [pid: 207601|app: 0|req: 136/268] 10.222.0.42 () {58 vars in 1282 bytes} [Thu Jul 28 08:23:49 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 588 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 28 08:23:49.815775 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef08b3a7-725c-45c6-951e-5515c33eeaf3 None admin] Authenticating user token {{(pid=207601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:23:49.890131 dv-cinder-851351-1-smb devstack@keystone.service[207600]: [pid: 207600|app: 0|req: 133/269] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 08:23:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 08:23:49.891695 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9b7eb2-8537-4222-9645-c6591e5767ee None None] REQUEST_METHOD: `GET` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:23:49.891991 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9b7eb2-8537-4222-9645-c6591e5767ee None None] SCRIPT_NAME: `/identity` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:23:49.892313 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9b7eb2-8537-4222-9645-c6591e5767ee None None] PATH_INFO: `/` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:23:49.893944 dv-cinder-851351-1-smb devstack@keystone.service[207600]: [pid: 207600|app: 0|req: 134/270] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 08:23:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 08:23:49.902958 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8277de-3ce1-4ebf-8fa2-61df6c58f11e None None] REQUEST_METHOD: `POST` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:23:49.903252 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8277de-3ce1-4ebf-8fa2-61df6c58f11e None None] SCRIPT_NAME: `/identity` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:23:49.903539 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8277de-3ce1-4ebf-8fa2-61df6c58f11e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:23:49.914325 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG dbcounter [-] [207600] Writing DB stats keystone:SELECT=100 {{(pid=207600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:23:49.938140 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.auth.core [None req-ce8277de-3ce1-4ebf-8fa2-61df6c58f11e None None] MFA Rules not processed for user `b8110ade874c4aa7af27f5c376df700a`. Rule list: `[]` (Enabled: `True`). {{(pid=207600) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 08:23:49.939590 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.fernet_utils [None req-ce8277de-3ce1-4ebf-8fa2-61df6c58f11e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=207600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:23:49.943617 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG dbcounter [-] [207601] Writing DB stats keystone:SELECT=100 {{(pid=207601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:23:50.009433 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef08b3a7-725c-45c6-951e-5515c33eeaf3 None admin] Validating token access rules against request {{(pid=207601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:23:50.035395 dv-cinder-851351-1-smb devstack@keystone.service[207600]: [pid: 207600|app: 0|req: 135/271] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 08:23:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 08:23:50.036918 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce8277de-3ce1-4ebf-8fa2-61df6c58f11e None None] Authenticating user token {{(pid=207600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:23:50.057052 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bbd0b27-fe2e-473a-94eb-db6f43a0a978 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:23:50.059648 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbd0b27-fe2e-473a-94eb-db6f43a0a978 None admin] REQUEST_METHOD: `GET` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:23:50.059843 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbd0b27-fe2e-473a-94eb-db6f43a0a978 None admin] SCRIPT_NAME: `/identity` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:23:50.060123 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbd0b27-fe2e-473a-94eb-db6f43a0a978 None admin] PATH_INFO: `/v3/projects/4a9d64056e4a4c2f805643b31ac7e061` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:23:50.061805 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bbd0b27-fe2e-473a-94eb-db6f43a0a978 None admin] RBAC: Authorizing `identity:get_project(project_id=4a9d64056e4a4c2f805643b31ac7e061)` {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:23:50.063316 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bbd0b27-fe2e-473a-94eb-db6f43a0a978 None admin] RBAC: Authorization granted {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:23:50.065463 dv-cinder-851351-1-smb devstack@keystone.service[207601]: [pid: 207601|app: 0|req: 137/272] 10.222.0.42 () {56 vars in 1186 bytes} [Thu Jul 28 08:23:49 2022] GET /identity/v3/projects/4a9d64056e4a4c2f805643b31ac7e061 => generated 302 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:23:50.071690 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bbd0b27-fe2e-473a-94eb-db6f43a0a978 None admin] Authenticating user token {{(pid=207601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:23:50.180730 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce8277de-3ce1-4ebf-8fa2-61df6c58f11e None None] Validating token access rules against request {{(pid=207600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:23:50.193512 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bbd0b27-fe2e-473a-94eb-db6f43a0a978 None admin] Validating token access rules against request {{(pid=207601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:23:50.226994 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG dbcounter [-] [207601] Writing DB stats keystone:SELECT=100 {{(pid=207601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:23:50.228996 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b1837f-8a88-4ca4-8e0e-418ffda6d800 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:23:50.230137 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b1837f-8a88-4ca4-8e0e-418ffda6d800 None admin] REQUEST_METHOD: `GET` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:23:50.230523 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b1837f-8a88-4ca4-8e0e-418ffda6d800 None admin] SCRIPT_NAME: `/identity` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:23:50.231012 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b1837f-8a88-4ca4-8e0e-418ffda6d800 None admin] PATH_INFO: `/v3/roles/member` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:23:50.238296 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG dbcounter [-] [207600] Writing DB stats keystone:SELECT=100 {{(pid=207600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:23:50.244002 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0a2a93-426a-46e0-927b-e70966b8573d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:23:50.244954 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0a2a93-426a-46e0-927b-e70966b8573d None admin] REQUEST_METHOD: `GET` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:23:50.245456 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0a2a93-426a-46e0-927b-e70966b8573d None admin] SCRIPT_NAME: `/identity` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:23:50.245891 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0a2a93-426a-46e0-927b-e70966b8573d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:23:50.246998 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b0a2a93-426a-46e0-927b-e70966b8573d None admin] RBAC: Adding query filter params (role.id=e617201b25d44cb1844c9f28bcac91fb, scope.project.id=4a9d64056e4a4c2f805643b31ac7e061, user.id=947b8ef66ba34159ba94af8aac2c1206) {{(pid=207601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:23:50.247483 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b0a2a93-426a-46e0-927b-e70966b8573d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:23:50.248749 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14b1837f-8a88-4ca4-8e0e-418ffda6d800 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 08:23:50.250192 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b0a2a93-426a-46e0-927b-e70966b8573d None admin] RBAC: Authorization granted {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:23:50.254497 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application [None req-14b1837f-8a88-4ca4-8e0e-418ffda6d800 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 28 08:23:50.254497 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:23:50.254497 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:23:50.254497 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:23:50.254497 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:23:50.254497 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:23:50.254497 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:23:50.254497 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:23:50.254497 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:23:50.254497 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:23:50.254497 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:23:50.254497 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:23:50.254497 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 08:23:50.254497 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 08:23:50.254497 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 08:23:50.254497 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 08:23:50.255697 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 08:23:50.255697 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 08:23:50.255697 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 08:23:50.255697 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 08:23:50.255697 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:23:50.255697 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:23:50.255697 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:23:50.255697 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:23:50.255697 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:23:50.255697 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:23:50.255697 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:23:50.255697 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application with Lock( Jul 28 08:23:50.255697 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:23:50.255697 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:23:50.255697 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:23:50.255697 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:23:50.256805 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:23:50.256805 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:23:50.256805 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:23:50.256805 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:23:50.256805 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 08:23:50.256805 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 08:23:50.256805 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 08:23:50.256805 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 08:23:50.256805 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 08:23:50.256805 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 08:23:50.256805 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 28 08:23:50.256805 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application Jul 28 08:23:50.262645 dv-cinder-851351-1-smb devstack@keystone.service[207600]: [pid: 207600|app: 0|req: 136/273] 10.222.0.42 () {56 vars in 1099 bytes} [Thu Jul 28 08:23:50 2022] GET /identity/v3/roles/member => generated 84 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:23:50.262645 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b1837f-8a88-4ca4-8e0e-418ffda6d800 None admin] Authenticating user token {{(pid=207600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:23:50.265776 dv-cinder-851351-1-smb devstack@keystone.service[207601]: [pid: 207601|app: 0|req: 138/274] 10.222.0.42 () {56 vars in 1374 bytes} [Thu Jul 28 08:23:50 2022] GET /identity/v3/role_assignments?user.id=947b8ef66ba34159ba94af8aac2c1206&scope.project.id=4a9d64056e4a4c2f805643b31ac7e061&role.id=e617201b25d44cb1844c9f28bcac91fb => generated 608 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:23:50.266958 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0a2a93-426a-46e0-927b-e70966b8573d None admin] Authenticating user token {{(pid=207601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:23:50.378518 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b1837f-8a88-4ca4-8e0e-418ffda6d800 None admin] Validating token access rules against request {{(pid=207600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:23:50.458988 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085ed55c-ddb9-445f-ba98-a9314239aab4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:23:50.459673 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085ed55c-ddb9-445f-ba98-a9314239aab4 None admin] REQUEST_METHOD: `GET` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:23:50.459958 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085ed55c-ddb9-445f-ba98-a9314239aab4 None admin] SCRIPT_NAME: `/identity` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:23:50.460236 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085ed55c-ddb9-445f-ba98-a9314239aab4 None admin] PATH_INFO: `/v3/domains/default` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:23:50.463490 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-085ed55c-ddb9-445f-ba98-a9314239aab4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:23:50.465437 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-085ed55c-ddb9-445f-ba98-a9314239aab4 None admin] RBAC: Authorization granted {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:23:50.473025 dv-cinder-851351-1-smb devstack@keystone.service[207600]: [pid: 207600|app: 0|req: 137/275] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 08:23:50 2022] GET /identity/v3/domains/default => generated 199 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:23:50.480414 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085ed55c-ddb9-445f-ba98-a9314239aab4 None admin] Authenticating user token {{(pid=207600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:23:50.505104 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0a2a93-426a-46e0-927b-e70966b8573d None admin] Validating token access rules against request {{(pid=207601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:23:50.550205 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42424787-766f-47ae-b220-84f2f3ccbcd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:23:50.550867 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42424787-766f-47ae-b220-84f2f3ccbcd1 None admin] REQUEST_METHOD: `GET` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:23:50.551153 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42424787-766f-47ae-b220-84f2f3ccbcd1 None admin] SCRIPT_NAME: `/identity` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:23:50.551431 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42424787-766f-47ae-b220-84f2f3ccbcd1 None admin] PATH_INFO: `/v3/roles` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:23:50.552193 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42424787-766f-47ae-b220-84f2f3ccbcd1 None admin] RBAC: Adding query filter params (name=member) {{(pid=207601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:23:50.552501 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42424787-766f-47ae-b220-84f2f3ccbcd1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:23:50.553955 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42424787-766f-47ae-b220-84f2f3ccbcd1 None admin] RBAC: Authorization granted {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:23:50.563776 dv-cinder-851351-1-smb devstack@keystone.service[207601]: [pid: 207601|app: 0|req: 139/276] 10.222.0.42 () {56 vars in 1101 bytes} [Thu Jul 28 08:23:50 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 297 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:23:50.565218 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe9b02b-e44a-47c1-bc38-8c40205a8bca None None] REQUEST_METHOD: `GET` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:23:50.565509 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe9b02b-e44a-47c1-bc38-8c40205a8bca None None] SCRIPT_NAME: `/identity` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:23:50.565785 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe9b02b-e44a-47c1-bc38-8c40205a8bca None None] PATH_INFO: `/` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:23:50.567080 dv-cinder-851351-1-smb devstack@keystone.service[207601]: [pid: 207601|app: 0|req: 140/277] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 08:23:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 08:23:50.571412 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG dbcounter [-] [207600] Writing DB stats keystone:SELECT=100 {{(pid=207600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:23:50.571664 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe9b02b-e44a-47c1-bc38-8c40205a8bca None None] Authenticating user token {{(pid=207601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:23:50.618867 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085ed55c-ddb9-445f-ba98-a9314239aab4 None admin] Validating token access rules against request {{(pid=207600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:23:50.644027 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG dbcounter [-] [207601] Writing DB stats keystone:SELECT=100 {{(pid=207601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:23:50.658442 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44715777-3d9b-4d54-b85d-2c82049287ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:23:50.659087 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44715777-3d9b-4d54-b85d-2c82049287ba None admin] REQUEST_METHOD: `POST` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:23:50.659379 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44715777-3d9b-4d54-b85d-2c82049287ba None admin] SCRIPT_NAME: `/identity` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:23:50.659659 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44715777-3d9b-4d54-b85d-2c82049287ba None admin] PATH_INFO: `/v3/users` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:23:50.660371 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44715777-3d9b-4d54-b85d-2c82049287ba None admin] RBAC: Authorizing `identity:create_user()` {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:23:50.661949 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44715777-3d9b-4d54-b85d-2c82049287ba None admin] RBAC: Authorization granted {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:23:50.688408 dv-cinder-851351-1-smb devstack@keystone.service[207600]: [pid: 207600|app: 0|req: 138/278] 10.222.0.42 () {60 vars in 1132 bytes} [Thu Jul 28 08:23:50 2022] POST /identity/v3/users => generated 293 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 28 08:23:50.698309 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c781b6c3-5599-4f2e-ae80-67f6e098fc98 None None] REQUEST_METHOD: `POST` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:23:50.698677 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c781b6c3-5599-4f2e-ae80-67f6e098fc98 None None] SCRIPT_NAME: `/identity` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:23:50.698882 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c781b6c3-5599-4f2e-ae80-67f6e098fc98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:23:50.705166 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe9b02b-e44a-47c1-bc38-8c40205a8bca None None] Validating token access rules against request {{(pid=207601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:23:50.727890 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.auth.core [None req-c781b6c3-5599-4f2e-ae80-67f6e098fc98 None None] MFA Rules not processed for user `b8110ade874c4aa7af27f5c376df700a`. Rule list: `[]` (Enabled: `True`). {{(pid=207600) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 08:23:50.730503 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.fernet_utils [None req-c781b6c3-5599-4f2e-ae80-67f6e098fc98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=207600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:23:50.752361 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5af7c97-f9ba-42c3-8827-a7368c3a15b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:23:50.753214 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5af7c97-f9ba-42c3-8827-a7368c3a15b9 None admin] REQUEST_METHOD: `GET` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:23:50.753505 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5af7c97-f9ba-42c3-8827-a7368c3a15b9 None admin] SCRIPT_NAME: `/identity` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:23:50.753876 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5af7c97-f9ba-42c3-8827-a7368c3a15b9 None admin] PATH_INFO: `/v3/users/4e00ef2a5d8647efa7744dc2ebcbbcc5` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:23:50.775422 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5af7c97-f9ba-42c3-8827-a7368c3a15b9 None admin] RBAC: Authorizing `identity:get_user(user_id=4e00ef2a5d8647efa7744dc2ebcbbcc5)` {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:23:50.776972 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5af7c97-f9ba-42c3-8827-a7368c3a15b9 None admin] RBAC: Authorization granted {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:23:50.779336 dv-cinder-851351-1-smb devstack@keystone.service[207601]: [pid: 207601|app: 0|req: 141/279] 10.222.0.42 () {56 vars in 1177 bytes} [Thu Jul 28 08:23:50 2022] GET /identity/v3/users/4e00ef2a5d8647efa7744dc2ebcbbcc5 => generated 293 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:23:50.786692 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5af7c97-f9ba-42c3-8827-a7368c3a15b9 None admin] Authenticating user token {{(pid=207601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:23:50.833697 dv-cinder-851351-1-smb devstack@keystone.service[207600]: [pid: 207600|app: 0|req: 139/280] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 08:23:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 08:23:50.856764 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c781b6c3-5599-4f2e-ae80-67f6e098fc98 None None] Authenticating user token {{(pid=207600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:23:50.922385 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG dbcounter [-] [207600] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=207600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:23:50.954740 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5af7c97-f9ba-42c3-8827-a7368c3a15b9 None admin] Validating token access rules against request {{(pid=207601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:23:50.969610 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG dbcounter [-] [207601] Writing DB stats keystone:SELECT=100 {{(pid=207601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:23:50.997925 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c781b6c3-5599-4f2e-ae80-67f6e098fc98 None None] Validating token access rules against request {{(pid=207600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:23:51.006707 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a829e4-e059-44c5-8f2d-63ff3a401f12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:23:51.007404 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a829e4-e059-44c5-8f2d-63ff3a401f12 None admin] REQUEST_METHOD: `GET` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:23:51.007692 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a829e4-e059-44c5-8f2d-63ff3a401f12 None admin] SCRIPT_NAME: `/identity` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:23:51.008024 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a829e4-e059-44c5-8f2d-63ff3a401f12 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:23:51.008904 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a829e4-e059-44c5-8f2d-63ff3a401f12 None admin] RBAC: Adding query filter params (role.id=70a2fd2878c549aeb19b16ec37e37164, user.id=4e00ef2a5d8647efa7744dc2ebcbbcc5, scope.system=all) {{(pid=207601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:23:51.009225 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a829e4-e059-44c5-8f2d-63ff3a401f12 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:23:51.010714 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a829e4-e059-44c5-8f2d-63ff3a401f12 None admin] RBAC: Authorization granted {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:23:51.017425 dv-cinder-851351-1-smb devstack@keystone.service[207601]: [pid: 207601|app: 0|req: 142/281] 10.222.0.42 () {56 vars in 1308 bytes} [Thu Jul 28 08:23:50 2022] GET /identity/v3/role_assignments?user.id=4e00ef2a5d8647efa7744dc2ebcbbcc5&scope.system=all&role.id=70a2fd2878c549aeb19b16ec37e37164 => generated 226 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:23:51.035745 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1933e5-5c15-4c10-98d3-531e0fc61538 None None] REQUEST_METHOD: `GET` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:23:51.036069 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1933e5-5c15-4c10-98d3-531e0fc61538 None None] SCRIPT_NAME: `/identity` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:23:51.036307 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1933e5-5c15-4c10-98d3-531e0fc61538 None None] PATH_INFO: `/` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:23:51.038078 dv-cinder-851351-1-smb devstack@keystone.service[207601]: [pid: 207601|app: 0|req: 143/282] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 08:23:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 28 08:23:51.046584 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55c38d5-2050-4930-970f-49e1166970c0 None None] REQUEST_METHOD: `POST` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:23:51.047249 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55c38d5-2050-4930-970f-49e1166970c0 None None] SCRIPT_NAME: `/identity` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:23:51.047616 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55c38d5-2050-4930-970f-49e1166970c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:23:51.051156 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea5e762-5b7a-41b8-bc28-a246c1165e8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:23:51.051950 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea5e762-5b7a-41b8-bc28-a246c1165e8c None admin] REQUEST_METHOD: `GET` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:23:51.052268 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea5e762-5b7a-41b8-bc28-a246c1165e8c None admin] SCRIPT_NAME: `/identity` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:23:51.052732 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea5e762-5b7a-41b8-bc28-a246c1165e8c None admin] PATH_INFO: `/v3/roles/reader` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:23:51.069424 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.auth.core [None req-b55c38d5-2050-4930-970f-49e1166970c0 None None] MFA Rules not processed for user `b8110ade874c4aa7af27f5c376df700a`. Rule list: `[]` (Enabled: `True`). {{(pid=207601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 08:23:51.070580 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea5e762-5b7a-41b8-bc28-a246c1165e8c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 08:23:51.070812 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.fernet_utils [None req-b55c38d5-2050-4930-970f-49e1166970c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=207601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:23:51.076076 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application [None req-7ea5e762-5b7a-41b8-bc28-a246c1165e8c None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 28 08:23:51.076076 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:23:51.076076 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:23:51.076076 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:23:51.076076 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:23:51.076076 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:23:51.076076 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:23:51.076076 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:23:51.076076 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:23:51.076076 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:23:51.076076 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:23:51.076076 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:23:51.076076 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 08:23:51.076076 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 08:23:51.076076 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 08:23:51.076076 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 08:23:51.077196 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 08:23:51.077196 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 08:23:51.077196 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 08:23:51.077196 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 08:23:51.077196 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:23:51.077196 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:23:51.077196 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:23:51.077196 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:23:51.077196 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:23:51.077196 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:23:51.077196 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:23:51.077196 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application with Lock( Jul 28 08:23:51.077196 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:23:51.077196 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:23:51.077196 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:23:51.077196 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:23:51.078086 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:23:51.078086 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:23:51.078086 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:23:51.078086 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:23:51.078086 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 08:23:51.078086 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 08:23:51.078086 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 08:23:51.078086 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 08:23:51.078086 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 08:23:51.078086 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 08:23:51.078086 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 28 08:23:51.078086 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application Jul 28 08:23:51.078747 dv-cinder-851351-1-smb devstack@keystone.service[207600]: [pid: 207600|app: 0|req: 140/283] 10.222.0.42 () {56 vars in 1099 bytes} [Thu Jul 28 08:23:50 2022] GET /identity/v3/roles/reader => generated 84 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 08:23:51.087128 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea5e762-5b7a-41b8-bc28-a246c1165e8c None admin] Authenticating user token {{(pid=207600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:23:51.169187 dv-cinder-851351-1-smb devstack@keystone.service[207601]: [pid: 207601|app: 0|req: 144/284] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 08:23:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 28 08:23:51.199551 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b55c38d5-2050-4930-970f-49e1166970c0 None None] Authenticating user token {{(pid=207601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:23:51.248855 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea5e762-5b7a-41b8-bc28-a246c1165e8c None admin] Validating token access rules against request {{(pid=207600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:23:51.266761 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG dbcounter [-] [207600] Writing DB stats keystone:SELECT=100 {{(pid=207600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:23:51.298467 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5721c1a7-7cd6-42be-ad58-3a3d329ab311 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:23:51.299117 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5721c1a7-7cd6-42be-ad58-3a3d329ab311 None admin] REQUEST_METHOD: `GET` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:23:51.299395 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5721c1a7-7cd6-42be-ad58-3a3d329ab311 None admin] SCRIPT_NAME: `/identity` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:23:51.299869 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5721c1a7-7cd6-42be-ad58-3a3d329ab311 None admin] PATH_INFO: `/v3/roles` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:23:51.301050 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5721c1a7-7cd6-42be-ad58-3a3d329ab311 None admin] RBAC: Adding query filter params (name=reader) {{(pid=207600) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:23:51.301366 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5721c1a7-7cd6-42be-ad58-3a3d329ab311 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:23:51.302795 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5721c1a7-7cd6-42be-ad58-3a3d329ab311 None admin] RBAC: Authorization granted {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:23:51.313359 dv-cinder-851351-1-smb devstack@keystone.service[207600]: [pid: 207600|app: 0|req: 141/285] 10.222.0.42 () {56 vars in 1101 bytes} [Thu Jul 28 08:23:51 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:23:51.322441 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5721c1a7-7cd6-42be-ad58-3a3d329ab311 None admin] Authenticating user token {{(pid=207600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:23:51.369474 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b55c38d5-2050-4930-970f-49e1166970c0 None None] Validating token access rules against request {{(pid=207601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:23:51.375817 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG dbcounter [-] [207601] Writing DB stats keystone:SELECT=100 {{(pid=207601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:23:51.453939 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c4d31c7-8ec2-49f7-bcb2-aa4cec52b6d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:23:51.455956 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4d31c7-8ec2-49f7-bcb2-aa4cec52b6d6 None admin] REQUEST_METHOD: `GET` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:23:51.457669 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4d31c7-8ec2-49f7-bcb2-aa4cec52b6d6 None admin] SCRIPT_NAME: `/identity` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:23:51.458189 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4d31c7-8ec2-49f7-bcb2-aa4cec52b6d6 None admin] PATH_INFO: `/v3/roles/member` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:23:51.485860 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c4d31c7-8ec2-49f7-bcb2-aa4cec52b6d6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 08:23:51.492153 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application [None req-5c4d31c7-8ec2-49f7-bcb2-aa4cec52b6d6 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 28 08:23:51.492153 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:23:51.492153 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:23:51.492153 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:23:51.492153 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:23:51.492153 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:23:51.492153 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:23:51.492153 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:23:51.492153 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:23:51.492153 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:23:51.492153 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:23:51.492153 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:23:51.492153 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 08:23:51.492153 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 08:23:51.492153 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 08:23:51.492153 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 08:23:51.493190 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 08:23:51.493190 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 08:23:51.493190 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 08:23:51.493190 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 08:23:51.493190 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:23:51.493190 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:23:51.493190 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:23:51.493190 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:23:51.493190 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:23:51.493190 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:23:51.493190 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:23:51.493190 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application with Lock( Jul 28 08:23:51.493190 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:23:51.493190 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:23:51.493190 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:23:51.493190 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:23:51.494078 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:23:51.494078 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:23:51.494078 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:23:51.494078 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:23:51.494078 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 08:23:51.494078 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 08:23:51.494078 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 08:23:51.494078 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 08:23:51.494078 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 08:23:51.494078 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 08:23:51.494078 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 28 08:23:51.494078 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application Jul 28 08:23:51.497574 dv-cinder-851351-1-smb devstack@keystone.service[207601]: [pid: 207601|app: 0|req: 145/286] 10.222.0.42 () {56 vars in 1099 bytes} [Thu Jul 28 08:23:51 2022] GET /identity/v3/roles/member => generated 84 bytes in 299 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 08:23:51.505389 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c4d31c7-8ec2-49f7-bcb2-aa4cec52b6d6 None admin] Authenticating user token {{(pid=207601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:23:51.543716 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5721c1a7-7cd6-42be-ad58-3a3d329ab311 None admin] Validating token access rules against request {{(pid=207600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:23:51.587986 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2facddb6-920a-44ed-875d-b00c15090690 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:23:51.588657 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2facddb6-920a-44ed-875d-b00c15090690 None admin] REQUEST_METHOD: `GET` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:23:51.589376 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2facddb6-920a-44ed-875d-b00c15090690 None admin] SCRIPT_NAME: `/identity` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:23:51.589655 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2facddb6-920a-44ed-875d-b00c15090690 None admin] PATH_INFO: `/v3/users/15e084dadcc347398223908f72f171ad` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:23:51.590977 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2facddb6-920a-44ed-875d-b00c15090690 None admin] RBAC: Authorizing `identity:get_user(user_id=15e084dadcc347398223908f72f171ad)` {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:23:51.592459 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2facddb6-920a-44ed-875d-b00c15090690 None admin] RBAC: Authorization granted {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:23:51.594503 dv-cinder-851351-1-smb devstack@keystone.service[207600]: [pid: 207600|app: 0|req: 142/287] 10.222.0.42 () {56 vars in 1177 bytes} [Thu Jul 28 08:23:51 2022] GET /identity/v3/users/15e084dadcc347398223908f72f171ad => generated 297 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:23:51.600039 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2facddb6-920a-44ed-875d-b00c15090690 None admin] Authenticating user token {{(pid=207600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:23:51.643046 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG dbcounter [-] [207600] Writing DB stats keystone:SELECT=100 {{(pid=207600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:23:51.674651 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c4d31c7-8ec2-49f7-bcb2-aa4cec52b6d6 None admin] Validating token access rules against request {{(pid=207601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:23:51.709060 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2facddb6-920a-44ed-875d-b00c15090690 None admin] Validating token access rules against request {{(pid=207600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:23:51.724051 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c25360-5224-4724-9417-db6db6a641d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:23:51.725116 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c25360-5224-4724-9417-db6db6a641d1 None admin] REQUEST_METHOD: `GET` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:23:51.726220 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c25360-5224-4724-9417-db6db6a641d1 None admin] SCRIPT_NAME: `/identity` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:23:51.726733 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c25360-5224-4724-9417-db6db6a641d1 None admin] PATH_INFO: `/v3/roles` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:23:51.727776 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15c25360-5224-4724-9417-db6db6a641d1 None admin] RBAC: Adding query filter params (name=member) {{(pid=207601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:23:51.728307 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15c25360-5224-4724-9417-db6db6a641d1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:23:51.729952 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15c25360-5224-4724-9417-db6db6a641d1 None admin] RBAC: Authorization granted {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:23:51.740926 dv-cinder-851351-1-smb devstack@keystone.service[207601]: [pid: 207601|app: 0|req: 146/288] 10.222.0.42 () {56 vars in 1101 bytes} [Thu Jul 28 08:23:51 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:23:51.753828 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c25360-5224-4724-9417-db6db6a641d1 None admin] Authenticating user token {{(pid=207601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:23:51.775404 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252406d2-7e9f-47f8-a038-0040b0ff1648 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:23:51.776083 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252406d2-7e9f-47f8-a038-0040b0ff1648 None admin] REQUEST_METHOD: `GET` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:23:51.776370 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252406d2-7e9f-47f8-a038-0040b0ff1648 None admin] SCRIPT_NAME: `/identity` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:23:51.776647 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252406d2-7e9f-47f8-a038-0040b0ff1648 None admin] PATH_INFO: `/v3/projects/4a9d64056e4a4c2f805643b31ac7e061` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:23:51.778068 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-252406d2-7e9f-47f8-a038-0040b0ff1648 None admin] RBAC: Authorizing `identity:get_project(project_id=4a9d64056e4a4c2f805643b31ac7e061)` {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:23:51.784697 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-252406d2-7e9f-47f8-a038-0040b0ff1648 None admin] RBAC: Authorization granted {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:23:51.784697 dv-cinder-851351-1-smb devstack@keystone.service[207600]: [pid: 207600|app: 0|req: 143/289] 10.222.0.42 () {56 vars in 1186 bytes} [Thu Jul 28 08:23:51 2022] GET /identity/v3/projects/4a9d64056e4a4c2f805643b31ac7e061 => generated 302 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 08:23:51.787630 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252406d2-7e9f-47f8-a038-0040b0ff1648 None admin] Authenticating user token {{(pid=207600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:23:51.815283 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG dbcounter [-] [207601] Writing DB stats keystone:SELECT=100 {{(pid=207601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:23:51.979087 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c25360-5224-4724-9417-db6db6a641d1 None admin] Validating token access rules against request {{(pid=207601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:23:51.982559 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252406d2-7e9f-47f8-a038-0040b0ff1648 None admin] Validating token access rules against request {{(pid=207600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:23:51.993403 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG dbcounter [-] [207600] Writing DB stats keystone:SELECT=100 {{(pid=207600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:23:52.025062 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e20c7013-671a-4130-beeb-ab499876dadf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:23:52.026147 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20c7013-671a-4130-beeb-ab499876dadf None admin] REQUEST_METHOD: `PUT` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:23:52.026645 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20c7013-671a-4130-beeb-ab499876dadf None admin] SCRIPT_NAME: `/identity` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:23:52.027161 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20c7013-671a-4130-beeb-ab499876dadf None admin] PATH_INFO: `/v3/projects/4a9d64056e4a4c2f805643b31ac7e061/users/15e084dadcc347398223908f72f171ad/roles/4af3ffd96e0540dbb20e6ccb08a61f0b` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:23:52.029573 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e20c7013-671a-4130-beeb-ab499876dadf None admin] RBAC: Authorizing `identity:create_grant(project_id=4a9d64056e4a4c2f805643b31ac7e061, user_id=15e084dadcc347398223908f72f171ad, role_id=4af3ffd96e0540dbb20e6ccb08a61f0b)` {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:23:52.031374 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e20c7013-671a-4130-beeb-ab499876dadf None admin] RBAC: Authorization granted {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:23:52.049673 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58203074-b466-4635-a06c-e303830b51b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:23:52.051336 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58203074-b466-4635-a06c-e303830b51b7 None admin] REQUEST_METHOD: `GET` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:23:52.053028 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58203074-b466-4635-a06c-e303830b51b7 None admin] SCRIPT_NAME: `/identity` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:23:52.053539 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58203074-b466-4635-a06c-e303830b51b7 None admin] PATH_INFO: `/v3/users/98ec5e65337342c9add09e83bd7469e8` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:23:52.054401 dv-cinder-851351-1-smb devstack@keystone.service[207600]: [pid: 207600|app: 0|req: 144/290] 10.222.0.42 () {58 vars in 1439 bytes} [Thu Jul 28 08:23:51 2022] PUT /identity/v3/projects/4a9d64056e4a4c2f805643b31ac7e061/users/15e084dadcc347398223908f72f171ad/roles/4af3ffd96e0540dbb20e6ccb08a61f0b => generated 0 bytes in 267 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 28 08:23:52.056004 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58203074-b466-4635-a06c-e303830b51b7 None admin] RBAC: Authorizing `identity:get_user(user_id=98ec5e65337342c9add09e83bd7469e8)` {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:23:52.057989 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58203074-b466-4635-a06c-e303830b51b7 None admin] RBAC: Authorization granted {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:23:52.060523 dv-cinder-851351-1-smb devstack@keystone.service[207601]: [pid: 207601|app: 0|req: 147/291] 10.222.0.42 () {56 vars in 1177 bytes} [Thu Jul 28 08:23:51 2022] GET /identity/v3/users/98ec5e65337342c9add09e83bd7469e8 => generated 297 bytes in 308 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:23:52.066804 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e20c7013-671a-4130-beeb-ab499876dadf None admin] Authenticating user token {{(pid=207600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:23:52.191449 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e20c7013-671a-4130-beeb-ab499876dadf None admin] Validating token access rules against request {{(pid=207600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:23:52.231830 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233f77f0-5a2f-4a42-8335-8f21f9b5422b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:23:52.232922 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233f77f0-5a2f-4a42-8335-8f21f9b5422b None admin] REQUEST_METHOD: `GET` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:23:52.233445 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233f77f0-5a2f-4a42-8335-8f21f9b5422b None admin] SCRIPT_NAME: `/identity` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:23:52.233983 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233f77f0-5a2f-4a42-8335-8f21f9b5422b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:23:52.281850 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG dbcounter [-] [207600] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=207600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:23:52.337831 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-233f77f0-5a2f-4a42-8335-8f21f9b5422b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:23:52.340131 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-233f77f0-5a2f-4a42-8335-8f21f9b5422b None admin] RBAC: Authorization granted {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:23:52.467645 dv-cinder-851351-1-smb devstack@keystone.service[207600]: [pid: 207600|app: 0|req: 145/292] 10.222.0.42 () {58 vars in 1282 bytes} [Thu Jul 28 08:23:52 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 401 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 28 08:23:52.473840 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58203074-b466-4635-a06c-e303830b51b7 None admin] Authenticating user token {{(pid=207601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:23:52.583837 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG dbcounter [-] [207601] Writing DB stats keystone:SELECT=100 {{(pid=207601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:23:52.592321 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58203074-b466-4635-a06c-e303830b51b7 None admin] Validating token access rules against request {{(pid=207601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:23:52.643643 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-882b2de6-7a04-4970-8800-ab8a083d45c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:23:52.644355 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882b2de6-7a04-4970-8800-ab8a083d45c8 None admin] REQUEST_METHOD: `GET` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:23:52.644645 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882b2de6-7a04-4970-8800-ab8a083d45c8 None admin] SCRIPT_NAME: `/identity` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:23:52.644963 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882b2de6-7a04-4970-8800-ab8a083d45c8 None admin] PATH_INFO: `/v3/projects/4a9d64056e4a4c2f805643b31ac7e061` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:23:52.646379 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-882b2de6-7a04-4970-8800-ab8a083d45c8 None admin] RBAC: Authorizing `identity:get_project(project_id=4a9d64056e4a4c2f805643b31ac7e061)` {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:23:52.647931 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-882b2de6-7a04-4970-8800-ab8a083d45c8 None admin] RBAC: Authorization granted {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:23:52.650998 dv-cinder-851351-1-smb devstack@keystone.service[207601]: [pid: 207601|app: 0|req: 148/293] 10.222.0.42 () {56 vars in 1186 bytes} [Thu Jul 28 08:23:52 2022] GET /identity/v3/projects/4a9d64056e4a4c2f805643b31ac7e061 => generated 302 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:23:52.656548 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233f77f0-5a2f-4a42-8335-8f21f9b5422b None admin] Authenticating user token {{(pid=207600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:23:52.775435 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG dbcounter [-] [207600] Writing DB stats keystone:SELECT=100 {{(pid=207600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:23:52.852998 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233f77f0-5a2f-4a42-8335-8f21f9b5422b None admin] Validating token access rules against request {{(pid=207600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:23:52.923257 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39cffac2-38fd-4ad7-b97a-ab4acd9e7ea8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:23:52.923909 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39cffac2-38fd-4ad7-b97a-ab4acd9e7ea8 None admin] REQUEST_METHOD: `GET` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:23:52.924192 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39cffac2-38fd-4ad7-b97a-ab4acd9e7ea8 None admin] SCRIPT_NAME: `/identity` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:23:52.924468 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39cffac2-38fd-4ad7-b97a-ab4acd9e7ea8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:23:52.925400 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39cffac2-38fd-4ad7-b97a-ab4acd9e7ea8 None admin] RBAC: Adding query filter params (role.id=70a2fd2878c549aeb19b16ec37e37164, scope.project.id=4a9d64056e4a4c2f805643b31ac7e061, user.id=98ec5e65337342c9add09e83bd7469e8) {{(pid=207600) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:23:52.925716 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39cffac2-38fd-4ad7-b97a-ab4acd9e7ea8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:23:52.927254 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39cffac2-38fd-4ad7-b97a-ab4acd9e7ea8 None admin] RBAC: Authorization granted {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:23:52.937909 dv-cinder-851351-1-smb devstack@keystone.service[207600]: [pid: 207600|app: 0|req: 146/294] 10.222.0.42 () {56 vars in 1374 bytes} [Thu Jul 28 08:23:52 2022] GET /identity/v3/role_assignments?user.id=98ec5e65337342c9add09e83bd7469e8&scope.project.id=4a9d64056e4a4c2f805643b31ac7e061&role.id=70a2fd2878c549aeb19b16ec37e37164 => generated 608 bytes in 282 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:23:53.303466 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0141725d-d2e3-4392-962a-84f7297c931f None None] REQUEST_METHOD: `GET` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:23:53.304169 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0141725d-d2e3-4392-962a-84f7297c931f None None] SCRIPT_NAME: `/identity` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:23:53.304730 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0141725d-d2e3-4392-962a-84f7297c931f None None] PATH_INFO: `/` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:23:53.306764 dv-cinder-851351-1-smb devstack@keystone.service[207601]: [pid: 207601|app: 0|req: 149/295] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 08:23:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 08:23:53.312410 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07d4b83-54b5-462e-bf33-4ebd5c987bff None None] REQUEST_METHOD: `POST` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:23:53.312957 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07d4b83-54b5-462e-bf33-4ebd5c987bff None None] SCRIPT_NAME: `/identity` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:23:53.313050 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07d4b83-54b5-462e-bf33-4ebd5c987bff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:23:53.335517 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.auth.core [None req-c07d4b83-54b5-462e-bf33-4ebd5c987bff None None] MFA Rules not processed for user `b8110ade874c4aa7af27f5c376df700a`. Rule list: `[]` (Enabled: `True`). {{(pid=207600) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 08:23:53.336784 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.fernet_utils [None req-c07d4b83-54b5-462e-bf33-4ebd5c987bff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=207600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:23:53.413738 dv-cinder-851351-1-smb devstack@keystone.service[207600]: [pid: 207600|app: 0|req: 147/296] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 08:23:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 08:23:53.425649 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7a45de-2db2-493d-a0e4-319fa97e43ed None None] REQUEST_METHOD: `GET` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:23:53.425958 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7a45de-2db2-493d-a0e4-319fa97e43ed None None] SCRIPT_NAME: `/identity` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:23:53.426213 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7a45de-2db2-493d-a0e4-319fa97e43ed None None] PATH_INFO: `/` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:23:53.427738 dv-cinder-851351-1-smb devstack@keystone.service[207601]: [pid: 207601|app: 0|req: 150/297] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 08:23:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 08:23:53.433425 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f26079-0454-40d3-8869-6b5068090699 None None] REQUEST_METHOD: `POST` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:23:53.433718 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f26079-0454-40d3-8869-6b5068090699 None None] SCRIPT_NAME: `/identity` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:23:53.434041 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f26079-0454-40d3-8869-6b5068090699 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:23:53.438522 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c7a45de-2db2-493d-a0e4-319fa97e43ed None None] Authenticating user token {{(pid=207601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:23:53.459582 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.auth.core [None req-89f26079-0454-40d3-8869-6b5068090699 None None] MFA Rules not processed for user `b8110ade874c4aa7af27f5c376df700a`. Rule list: `[]` (Enabled: `True`). {{(pid=207600) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 08:23:53.460950 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.fernet_utils [None req-89f26079-0454-40d3-8869-6b5068090699 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=207600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:23:53.549744 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG dbcounter [-] [207600] Writing DB stats keystone:SELECT=100 {{(pid=207600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:23:53.557916 dv-cinder-851351-1-smb devstack@keystone.service[207600]: [pid: 207600|app: 0|req: 148/298] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 08:23:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 08:23:53.582485 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f26079-0454-40d3-8869-6b5068090699 None None] Authenticating user token {{(pid=207600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:23:53.595882 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c7a45de-2db2-493d-a0e4-319fa97e43ed None None] Validating token access rules against request {{(pid=207601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:23:53.636063 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78147dce-7e55-4a40-ba67-5a0c34f3c2ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:23:53.636811 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78147dce-7e55-4a40-ba67-5a0c34f3c2ad None admin] REQUEST_METHOD: `GET` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:23:53.637146 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78147dce-7e55-4a40-ba67-5a0c34f3c2ad None admin] SCRIPT_NAME: `/identity` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:23:53.637428 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78147dce-7e55-4a40-ba67-5a0c34f3c2ad None admin] PATH_INFO: `/v3/roles/reader` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:23:53.650901 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78147dce-7e55-4a40-ba67-5a0c34f3c2ad None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 08:23:53.664213 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application [None req-78147dce-7e55-4a40-ba67-5a0c34f3c2ad None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 28 08:23:53.664213 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:23:53.664213 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:23:53.664213 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:23:53.664213 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:23:53.664213 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:23:53.664213 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:23:53.664213 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:23:53.664213 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:23:53.664213 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:23:53.664213 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:23:53.664213 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:23:53.664213 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 08:23:53.664213 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 08:23:53.664213 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 08:23:53.664213 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 08:23:53.665306 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 08:23:53.665306 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 08:23:53.665306 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 08:23:53.665306 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 08:23:53.665306 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:23:53.665306 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:23:53.665306 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:23:53.665306 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:23:53.665306 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:23:53.665306 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:23:53.665306 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:23:53.665306 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application with Lock( Jul 28 08:23:53.665306 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:23:53.665306 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:23:53.665306 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:23:53.665306 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:23:53.666201 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:23:53.666201 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:23:53.666201 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:23:53.666201 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:23:53.666201 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 08:23:53.666201 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 08:23:53.666201 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 08:23:53.666201 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 08:23:53.666201 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 08:23:53.666201 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 08:23:53.666201 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 28 08:23:53.666201 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application Jul 28 08:23:53.666201 dv-cinder-851351-1-smb devstack@keystone.service[207601]: [pid: 207601|app: 0|req: 151/299] 10.222.0.42 () {56 vars in 1099 bytes} [Thu Jul 28 08:23:53 2022] GET /identity/v3/roles/reader => generated 84 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 08:23:53.666201 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab80ecfc-8f4e-4782-aacc-acd1d72d561d None None] REQUEST_METHOD: `GET` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:23:53.667010 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab80ecfc-8f4e-4782-aacc-acd1d72d561d None None] SCRIPT_NAME: `/identity` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:23:53.667010 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab80ecfc-8f4e-4782-aacc-acd1d72d561d None None] PATH_INFO: `/` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:23:53.667010 dv-cinder-851351-1-smb devstack@keystone.service[207601]: [pid: 207601|app: 0|req: 152/300] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 08:23:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 08:23:53.667010 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab80ecfc-8f4e-4782-aacc-acd1d72d561d None None] Authenticating user token {{(pid=207601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:23:53.693583 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG dbcounter [-] [207601] Writing DB stats keystone:SELECT=100 {{(pid=207601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:23:53.708379 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f26079-0454-40d3-8869-6b5068090699 None None] Validating token access rules against request {{(pid=207600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:23:53.750313 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e65dc735-48f7-4e14-8038-705c14cd276b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:23:53.751490 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65dc735-48f7-4e14-8038-705c14cd276b None admin] REQUEST_METHOD: `GET` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:23:53.751978 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65dc735-48f7-4e14-8038-705c14cd276b None admin] SCRIPT_NAME: `/identity` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:23:53.752479 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65dc735-48f7-4e14-8038-705c14cd276b None admin] PATH_INFO: `/v3/domains/default` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:23:53.754675 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e65dc735-48f7-4e14-8038-705c14cd276b None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:23:53.756250 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e65dc735-48f7-4e14-8038-705c14cd276b None admin] RBAC: Authorization granted {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:23:53.758140 dv-cinder-851351-1-smb devstack@keystone.service[207600]: [pid: 207600|app: 0|req: 149/301] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 08:23:53 2022] GET /identity/v3/domains/default => generated 199 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 08:23:53.759203 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbfeb633-a2cc-4655-beec-954a7ee5b999 None None] REQUEST_METHOD: `POST` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:23:53.759495 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbfeb633-a2cc-4655-beec-954a7ee5b999 None None] SCRIPT_NAME: `/identity` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:23:53.759764 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbfeb633-a2cc-4655-beec-954a7ee5b999 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:23:53.781704 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.auth.core [None req-bbfeb633-a2cc-4655-beec-954a7ee5b999 None None] MFA Rules not processed for user `b8110ade874c4aa7af27f5c376df700a`. Rule list: `[]` (Enabled: `True`). {{(pid=207600) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 08:23:53.782913 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.fernet_utils [None req-bbfeb633-a2cc-4655-beec-954a7ee5b999 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=207600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:23:53.787769 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab80ecfc-8f4e-4782-aacc-acd1d72d561d None None] Validating token access rules against request {{(pid=207601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:23:53.826471 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4177e15e-53da-495c-91b5-84959157f7b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:23:53.827138 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4177e15e-53da-495c-91b5-84959157f7b8 None admin] REQUEST_METHOD: `GET` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:23:53.827940 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4177e15e-53da-495c-91b5-84959157f7b8 None admin] SCRIPT_NAME: `/identity` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:23:53.828220 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4177e15e-53da-495c-91b5-84959157f7b8 None admin] PATH_INFO: `/v3/roles` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:23:53.829004 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4177e15e-53da-495c-91b5-84959157f7b8 None admin] RBAC: Adding query filter params (name=reader) {{(pid=207601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:23:53.829314 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4177e15e-53da-495c-91b5-84959157f7b8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:23:53.831156 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4177e15e-53da-495c-91b5-84959157f7b8 None admin] RBAC: Authorization granted {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:23:53.843182 dv-cinder-851351-1-smb devstack@keystone.service[207601]: [pid: 207601|app: 0|req: 153/302] 10.222.0.42 () {56 vars in 1101 bytes} [Thu Jul 28 08:23:53 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:23:53.844699 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4177e15e-53da-495c-91b5-84959157f7b8 None admin] Authenticating user token {{(pid=207601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:23:53.847859 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG dbcounter [-] [207600] Writing DB stats keystone:SELECT=100 {{(pid=207600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:23:53.860464 dv-cinder-851351-1-smb devstack@keystone.service[207600]: [pid: 207600|app: 0|req: 150/303] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 08:23:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 08:23:53.865024 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbfeb633-a2cc-4655-beec-954a7ee5b999 None None] Authenticating user token {{(pid=207600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:23:53.960845 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG dbcounter [-] [207601] Writing DB stats keystone:SELECT=100 {{(pid=207601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:23:53.978749 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4177e15e-53da-495c-91b5-84959157f7b8 None admin] Validating token access rules against request {{(pid=207601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:23:53.986025 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbfeb633-a2cc-4655-beec-954a7ee5b999 None None] Validating token access rules against request {{(pid=207600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:23:54.021699 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6d2816-330a-4632-b744-69006703b6ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:23:54.022356 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6d2816-330a-4632-b744-69006703b6ef None admin] REQUEST_METHOD: `POST` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:23:54.022644 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6d2816-330a-4632-b744-69006703b6ef None admin] SCRIPT_NAME: `/identity` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:23:54.022911 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6d2816-330a-4632-b744-69006703b6ef None admin] PATH_INFO: `/v3/groups` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:23:54.023605 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f6d2816-330a-4632-b744-69006703b6ef None admin] RBAC: Authorizing `identity:create_group()` {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:23:54.025159 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f6d2816-330a-4632-b744-69006703b6ef None admin] RBAC: Authorization granted {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:23:54.025438 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a824e436-40ac-494f-bdeb-562cd38aa48d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:23:54.026121 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a824e436-40ac-494f-bdeb-562cd38aa48d None admin] REQUEST_METHOD: `GET` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:23:54.026401 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a824e436-40ac-494f-bdeb-562cd38aa48d None admin] SCRIPT_NAME: `/identity` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:23:54.026673 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a824e436-40ac-494f-bdeb-562cd38aa48d None admin] PATH_INFO: `/v3/users/9070425bcdd24578950be1cf146ddc7c` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:23:54.045291 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a824e436-40ac-494f-bdeb-562cd38aa48d None admin] RBAC: Authorizing `identity:get_user(user_id=9070425bcdd24578950be1cf146ddc7c)` {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:23:54.046829 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a824e436-40ac-494f-bdeb-562cd38aa48d None admin] RBAC: Authorization granted {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:23:54.054566 dv-cinder-851351-1-smb devstack@keystone.service[207600]: [pid: 207600|app: 0|req: 151/304] 10.222.0.42 () {56 vars in 1177 bytes} [Thu Jul 28 08:23:53 2022] GET /identity/v3/users/9070425bcdd24578950be1cf146ddc7c => generated 293 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:23:54.054566 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a824e436-40ac-494f-bdeb-562cd38aa48d None admin] Authenticating user token {{(pid=207600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:23:54.054839 dv-cinder-851351-1-smb devstack@keystone.service[207601]: [pid: 207601|app: 0|req: 154/305] 10.222.0.42 () {60 vars in 1134 bytes} [Thu Jul 28 08:23:53 2022] POST /identity/v3/groups => generated 229 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 08:23:54.055529 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6d2816-330a-4632-b744-69006703b6ef None admin] Authenticating user token {{(pid=207601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:23:54.112545 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG dbcounter [-] [207600] Writing DB stats keystone:SELECT=100 {{(pid=207600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:23:54.179383 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a824e436-40ac-494f-bdeb-562cd38aa48d None admin] Validating token access rules against request {{(pid=207600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:23:54.221820 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab3f26d-ea3a-4d2b-b6be-7da64ee1693f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:23:54.222492 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab3f26d-ea3a-4d2b-b6be-7da64ee1693f None admin] REQUEST_METHOD: `GET` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:23:54.222794 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab3f26d-ea3a-4d2b-b6be-7da64ee1693f None admin] SCRIPT_NAME: `/identity` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:23:54.223107 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab3f26d-ea3a-4d2b-b6be-7da64ee1693f None admin] PATH_INFO: `/v3/roles/member` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:23:54.224845 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6d2816-330a-4632-b744-69006703b6ef None admin] Validating token access rules against request {{(pid=207601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:23:54.241327 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ab3f26d-ea3a-4d2b-b6be-7da64ee1693f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 08:23:54.247013 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application [None req-0ab3f26d-ea3a-4d2b-b6be-7da64ee1693f None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 28 08:23:54.247013 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:23:54.247013 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:23:54.247013 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:23:54.247013 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:23:54.247013 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:23:54.247013 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:23:54.247013 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:23:54.247013 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:23:54.247013 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:23:54.247013 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:23:54.247013 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:23:54.247013 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 08:23:54.247013 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 08:23:54.247013 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 08:23:54.247013 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 08:23:54.248028 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 08:23:54.248028 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 08:23:54.248028 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 08:23:54.248028 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 08:23:54.248028 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:23:54.248028 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:23:54.248028 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:23:54.248028 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:23:54.248028 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:23:54.248028 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:23:54.248028 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:23:54.248028 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application with Lock( Jul 28 08:23:54.248028 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:23:54.248028 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:23:54.248028 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:23:54.248028 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:23:54.249488 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:23:54.249488 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:23:54.249488 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:23:54.249488 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:23:54.249488 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 08:23:54.249488 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 08:23:54.249488 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 08:23:54.249488 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 08:23:54.249488 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 08:23:54.249488 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 08:23:54.249488 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 28 08:23:54.249488 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application Jul 28 08:23:54.249488 dv-cinder-851351-1-smb devstack@keystone.service[207600]: [pid: 207600|app: 0|req: 152/306] 10.222.0.42 () {56 vars in 1099 bytes} [Thu Jul 28 08:23:54 2022] GET /identity/v3/roles/member => generated 84 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:23:54.255046 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab3f26d-ea3a-4d2b-b6be-7da64ee1693f None admin] Authenticating user token {{(pid=207600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:23:54.281380 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7039b39e-bc05-4e7b-905c-c74de50d3f35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:23:54.282299 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7039b39e-bc05-4e7b-905c-c74de50d3f35 None admin] REQUEST_METHOD: `GET` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:23:54.282875 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7039b39e-bc05-4e7b-905c-c74de50d3f35 None admin] SCRIPT_NAME: `/identity` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:23:54.283645 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7039b39e-bc05-4e7b-905c-c74de50d3f35 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:23:54.284968 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7039b39e-bc05-4e7b-905c-c74de50d3f35 None admin] RBAC: Adding query filter params (role.id=4af3ffd96e0540dbb20e6ccb08a61f0b, user.id=9070425bcdd24578950be1cf146ddc7c, scope.system=all) {{(pid=207601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:23:54.285474 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7039b39e-bc05-4e7b-905c-c74de50d3f35 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:23:54.287633 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7039b39e-bc05-4e7b-905c-c74de50d3f35 None admin] RBAC: Authorization granted {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:23:54.294713 dv-cinder-851351-1-smb devstack@keystone.service[207601]: [pid: 207601|app: 0|req: 155/307] 10.222.0.42 () {56 vars in 1308 bytes} [Thu Jul 28 08:23:54 2022] GET /identity/v3/role_assignments?user.id=9070425bcdd24578950be1cf146ddc7c&scope.system=all&role.id=4af3ffd96e0540dbb20e6ccb08a61f0b => generated 226 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:23:54.382970 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab3f26d-ea3a-4d2b-b6be-7da64ee1693f None admin] Validating token access rules against request {{(pid=207600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:23:54.392254 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG dbcounter [-] [207600] Writing DB stats keystone:SELECT=100 {{(pid=207600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:23:54.425518 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1e74d3-b524-4cb2-b22c-444ad528d9b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:23:54.426185 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1e74d3-b524-4cb2-b22c-444ad528d9b4 None admin] REQUEST_METHOD: `GET` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:23:54.426476 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1e74d3-b524-4cb2-b22c-444ad528d9b4 None admin] SCRIPT_NAME: `/identity` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:23:54.426859 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1e74d3-b524-4cb2-b22c-444ad528d9b4 None admin] PATH_INFO: `/v3/roles` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:23:54.427639 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb1e74d3-b524-4cb2-b22c-444ad528d9b4 None admin] RBAC: Adding query filter params (name=member) {{(pid=207600) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:23:54.427955 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb1e74d3-b524-4cb2-b22c-444ad528d9b4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:23:54.429534 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb1e74d3-b524-4cb2-b22c-444ad528d9b4 None admin] RBAC: Authorization granted {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:23:54.440095 dv-cinder-851351-1-smb devstack@keystone.service[207600]: [pid: 207600|app: 0|req: 153/308] 10.222.0.42 () {56 vars in 1101 bytes} [Thu Jul 28 08:23:54 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:23:54.445664 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7039b39e-bc05-4e7b-905c-c74de50d3f35 None admin] Authenticating user token {{(pid=207601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:23:54.459068 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG dbcounter [-] [207601] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=207601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:23:54.560721 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7039b39e-bc05-4e7b-905c-c74de50d3f35 None admin] Validating token access rules against request {{(pid=207601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:23:54.598825 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89274a1b-9032-494f-bbce-a16151f78430 None None] REQUEST_METHOD: `GET` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:23:54.599098 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89274a1b-9032-494f-bbce-a16151f78430 None None] SCRIPT_NAME: `/identity` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:23:54.599418 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89274a1b-9032-494f-bbce-a16151f78430 None None] PATH_INFO: `/` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:23:54.601037 dv-cinder-851351-1-smb devstack@keystone.service[207600]: [pid: 207600|app: 0|req: 154/309] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 08:23:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 08:23:54.602440 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252f7496-d7b7-4339-ace5-6ec46e81b32a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:23:54.603507 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252f7496-d7b7-4339-ace5-6ec46e81b32a None admin] REQUEST_METHOD: `GET` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:23:54.603999 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252f7496-d7b7-4339-ace5-6ec46e81b32a None admin] SCRIPT_NAME: `/identity` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:23:54.604479 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252f7496-d7b7-4339-ace5-6ec46e81b32a None admin] PATH_INFO: `/v3/users/4e00ef2a5d8647efa7744dc2ebcbbcc5` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:23:54.609727 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-252f7496-d7b7-4339-ace5-6ec46e81b32a None admin] RBAC: Authorizing `identity:get_user(user_id=4e00ef2a5d8647efa7744dc2ebcbbcc5)` {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:23:54.610710 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c94fe67-f549-4213-8c3f-80faf6466410 None None] REQUEST_METHOD: `POST` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:23:54.611236 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c94fe67-f549-4213-8c3f-80faf6466410 None None] SCRIPT_NAME: `/identity` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:23:54.611354 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-252f7496-d7b7-4339-ace5-6ec46e81b32a None admin] RBAC: Authorization granted {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:23:54.611821 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c94fe67-f549-4213-8c3f-80faf6466410 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:23:54.613047 dv-cinder-851351-1-smb devstack@keystone.service[207601]: [pid: 207601|app: 0|req: 156/310] 10.222.0.42 () {56 vars in 1177 bytes} [Thu Jul 28 08:23:54 2022] GET /identity/v3/users/4e00ef2a5d8647efa7744dc2ebcbbcc5 => generated 293 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:23:54.619130 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252f7496-d7b7-4339-ace5-6ec46e81b32a None admin] Authenticating user token {{(pid=207601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:23:54.632019 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.auth.core [None req-1c94fe67-f549-4213-8c3f-80faf6466410 None None] MFA Rules not processed for user `b8110ade874c4aa7af27f5c376df700a`. Rule list: `[]` (Enabled: `True`). {{(pid=207600) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 08:23:54.633402 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.fernet_utils [None req-1c94fe67-f549-4213-8c3f-80faf6466410 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=207600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:23:54.718350 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG dbcounter [-] [207601] Writing DB stats keystone:SELECT=100 {{(pid=207601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:23:54.728809 dv-cinder-851351-1-smb devstack@keystone.service[207600]: [pid: 207600|app: 0|req: 155/311] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 08:23:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 28 08:23:54.751478 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252f7496-d7b7-4339-ace5-6ec46e81b32a None admin] Validating token access rules against request {{(pid=207601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:23:54.753252 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c94fe67-f549-4213-8c3f-80faf6466410 None None] Authenticating user token {{(pid=207600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:23:54.796081 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae11dfd-2847-4cb5-a6ad-824501435cca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:23:54.797405 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae11dfd-2847-4cb5-a6ad-824501435cca None admin] REQUEST_METHOD: `PUT` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:23:54.798830 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae11dfd-2847-4cb5-a6ad-824501435cca None admin] SCRIPT_NAME: `/identity` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:23:54.799365 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae11dfd-2847-4cb5-a6ad-824501435cca None admin] PATH_INFO: `/v3/system/users/4e00ef2a5d8647efa7744dc2ebcbbcc5/roles/70a2fd2878c549aeb19b16ec37e37164` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:23:54.801255 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ae11dfd-2847-4cb5-a6ad-824501435cca None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=4e00ef2a5d8647efa7744dc2ebcbbcc5, role_id=70a2fd2878c549aeb19b16ec37e37164)` {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:23:54.802947 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ae11dfd-2847-4cb5-a6ad-824501435cca None admin] RBAC: Authorization granted {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:23:54.824708 dv-cinder-851351-1-smb devstack@keystone.service[207601]: [pid: 207601|app: 0|req: 157/312] 10.222.0.42 () {58 vars in 1334 bytes} [Thu Jul 28 08:23:54 2022] PUT /identity/v3/system/users/4e00ef2a5d8647efa7744dc2ebcbbcc5/roles/70a2fd2878c549aeb19b16ec37e37164 => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 08:23:54.886352 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c94fe67-f549-4213-8c3f-80faf6466410 None None] Validating token access rules against request {{(pid=207600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:23:54.900234 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG dbcounter [-] [207600] Writing DB stats keystone:SELECT=100 {{(pid=207600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:23:54.938372 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2405b64-a67f-4ab2-99f2-8f9b51d86347 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:23:54.939162 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2405b64-a67f-4ab2-99f2-8f9b51d86347 None admin] REQUEST_METHOD: `GET` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:23:54.939517 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2405b64-a67f-4ab2-99f2-8f9b51d86347 None admin] SCRIPT_NAME: `/identity` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:23:54.939967 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2405b64-a67f-4ab2-99f2-8f9b51d86347 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:23:54.954391 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2405b64-a67f-4ab2-99f2-8f9b51d86347 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 08:23:54.957770 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application [None req-e2405b64-a67f-4ab2-99f2-8f9b51d86347 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 28 08:23:54.957770 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:23:54.957770 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:23:54.957770 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:23:54.957770 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:23:54.957770 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:23:54.957770 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:23:54.957770 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:23:54.957770 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:23:54.957770 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:23:54.957770 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:23:54.957770 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:23:54.957770 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 08:23:54.957770 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 08:23:54.957770 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 08:23:54.957770 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 08:23:54.959846 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 08:23:54.959846 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 08:23:54.959846 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 08:23:54.959846 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 08:23:54.959846 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:23:54.959846 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:23:54.959846 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:23:54.959846 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:23:54.959846 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:23:54.959846 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:23:54.959846 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:23:54.959846 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application with Lock( Jul 28 08:23:54.959846 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:23:54.959846 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:23:54.959846 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:23:54.959846 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:23:54.966173 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:23:54.966173 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:23:54.966173 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:23:54.966173 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:23:54.966173 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 08:23:54.966173 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 08:23:54.966173 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 08:23:54.966173 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 08:23:54.966173 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 08:23:54.966173 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 08:23:54.966173 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 28 08:23:54.966173 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application Jul 28 08:23:54.966173 dv-cinder-851351-1-smb devstack@keystone.service[207600]: [pid: 207600|app: 0|req: 156/313] 10.222.0.42 () {56 vars in 1099 bytes} [Thu Jul 28 08:23:54 2022] GET /identity/v3/roles/reader => generated 84 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 08:23:54.967814 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae11dfd-2847-4cb5-a6ad-824501435cca None admin] Authenticating user token {{(pid=207601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:23:55.079087 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae11dfd-2847-4cb5-a6ad-824501435cca None admin] Validating token access rules against request {{(pid=207601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:23:55.115928 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87bd4d11-2521-4c99-89de-ec692e425290 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:23:55.116573 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87bd4d11-2521-4c99-89de-ec692e425290 None admin] REQUEST_METHOD: `GET` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:23:55.116898 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87bd4d11-2521-4c99-89de-ec692e425290 None admin] SCRIPT_NAME: `/identity` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:23:55.117181 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87bd4d11-2521-4c99-89de-ec692e425290 None admin] PATH_INFO: `/v3/roles` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:23:55.117928 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87bd4d11-2521-4c99-89de-ec692e425290 None admin] RBAC: Adding query filter params (name=reader) {{(pid=207601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:23:55.118245 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87bd4d11-2521-4c99-89de-ec692e425290 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:23:55.119643 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87bd4d11-2521-4c99-89de-ec692e425290 None admin] RBAC: Authorization granted {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:23:55.129089 dv-cinder-851351-1-smb devstack@keystone.service[207601]: [pid: 207601|app: 0|req: 158/314] 10.222.0.42 () {56 vars in 1101 bytes} [Thu Jul 28 08:23:54 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 08:23:55.134479 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2405b64-a67f-4ab2-99f2-8f9b51d86347 None admin] Authenticating user token {{(pid=207600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:23:55.245072 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2405b64-a67f-4ab2-99f2-8f9b51d86347 None admin] Validating token access rules against request {{(pid=207600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:23:55.281139 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a1512d-4143-46a6-b0fb-dc8ab507a8f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:23:55.281809 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a1512d-4143-46a6-b0fb-dc8ab507a8f7 None admin] REQUEST_METHOD: `GET` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:23:55.282094 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a1512d-4143-46a6-b0fb-dc8ab507a8f7 None admin] SCRIPT_NAME: `/identity` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:23:55.282371 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a1512d-4143-46a6-b0fb-dc8ab507a8f7 None admin] PATH_INFO: `/v3/users/15e084dadcc347398223908f72f171ad` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:23:55.283600 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07a1512d-4143-46a6-b0fb-dc8ab507a8f7 None admin] RBAC: Authorizing `identity:get_user(user_id=15e084dadcc347398223908f72f171ad)` {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:23:55.285122 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07a1512d-4143-46a6-b0fb-dc8ab507a8f7 None admin] RBAC: Authorization granted {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:23:55.287100 dv-cinder-851351-1-smb devstack@keystone.service[207600]: [pid: 207600|app: 0|req: 157/315] 10.222.0.42 () {56 vars in 1177 bytes} [Thu Jul 28 08:23:55 2022] GET /identity/v3/users/15e084dadcc347398223908f72f171ad => generated 297 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:23:55.292875 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87bd4d11-2521-4c99-89de-ec692e425290 None admin] Authenticating user token {{(pid=207601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:23:55.296378 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG dbcounter [-] [207601] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=207601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:23:55.408068 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87bd4d11-2521-4c99-89de-ec692e425290 None admin] Validating token access rules against request {{(pid=207601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:23:55.444040 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc951c4-0d10-4e72-adb5-57a1de3c65bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:23:55.444698 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc951c4-0d10-4e72-adb5-57a1de3c65bd None admin] REQUEST_METHOD: `GET` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:23:55.444990 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc951c4-0d10-4e72-adb5-57a1de3c65bd None admin] SCRIPT_NAME: `/identity` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:23:55.445268 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc951c4-0d10-4e72-adb5-57a1de3c65bd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:23:55.519779 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc951c4-0d10-4e72-adb5-57a1de3c65bd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:23:55.521225 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc951c4-0d10-4e72-adb5-57a1de3c65bd None admin] RBAC: Authorization granted {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:23:55.523169 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG dbcounter [-] [207601] Writing DB stats keystone:SELECT=100 {{(pid=207601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:23:55.631257 dv-cinder-851351-1-smb devstack@keystone.service[207601]: [pid: 207601|app: 0|req: 159/316] 10.222.0.42 () {58 vars in 1282 bytes} [Thu Jul 28 08:23:55 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 28 08:23:55.636812 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a1512d-4143-46a6-b0fb-dc8ab507a8f7 None admin] Authenticating user token {{(pid=207600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:23:55.665792 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG dbcounter [-] [207600] Writing DB stats keystone:SELECT=100 {{(pid=207600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:23:55.741991 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a1512d-4143-46a6-b0fb-dc8ab507a8f7 None admin] Validating token access rules against request {{(pid=207600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:23:55.775944 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3838ca2-5eff-41b2-860f-c73afc2718d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:23:55.776531 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3838ca2-5eff-41b2-860f-c73afc2718d8 None admin] REQUEST_METHOD: `GET` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:23:55.776858 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3838ca2-5eff-41b2-860f-c73afc2718d8 None admin] SCRIPT_NAME: `/identity` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:23:55.777137 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3838ca2-5eff-41b2-860f-c73afc2718d8 None admin] PATH_INFO: `/v3/projects/4a9d64056e4a4c2f805643b31ac7e061` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:23:55.778349 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3838ca2-5eff-41b2-860f-c73afc2718d8 None admin] RBAC: Authorizing `identity:get_project(project_id=4a9d64056e4a4c2f805643b31ac7e061)` {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:23:55.779830 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3838ca2-5eff-41b2-860f-c73afc2718d8 None admin] RBAC: Authorization granted {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:23:55.781728 dv-cinder-851351-1-smb devstack@keystone.service[207600]: [pid: 207600|app: 0|req: 158/317] 10.222.0.42 () {56 vars in 1186 bytes} [Thu Jul 28 08:23:55 2022] GET /identity/v3/projects/4a9d64056e4a4c2f805643b31ac7e061 => generated 302 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:23:55.787575 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc951c4-0d10-4e72-adb5-57a1de3c65bd None admin] Authenticating user token {{(pid=207601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:23:55.891462 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc951c4-0d10-4e72-adb5-57a1de3c65bd None admin] Validating token access rules against request {{(pid=207601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:23:55.913432 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG dbcounter [-] [207601] Writing DB stats keystone:SELECT=100 {{(pid=207601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:23:55.928523 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10131615-fd53-4bfb-9281-686588dc6547 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:23:55.929206 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10131615-fd53-4bfb-9281-686588dc6547 None admin] REQUEST_METHOD: `GET` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:23:55.929492 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10131615-fd53-4bfb-9281-686588dc6547 None admin] SCRIPT_NAME: `/identity` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:23:55.929771 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10131615-fd53-4bfb-9281-686588dc6547 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:23:55.930665 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10131615-fd53-4bfb-9281-686588dc6547 None admin] RBAC: Adding query filter params (role.id=4af3ffd96e0540dbb20e6ccb08a61f0b, scope.project.id=4a9d64056e4a4c2f805643b31ac7e061, user.id=15e084dadcc347398223908f72f171ad) {{(pid=207601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:23:55.930976 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10131615-fd53-4bfb-9281-686588dc6547 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:23:55.932502 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10131615-fd53-4bfb-9281-686588dc6547 None admin] RBAC: Authorization granted {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:23:55.939348 dv-cinder-851351-1-smb devstack@keystone.service[207601]: [pid: 207601|app: 0|req: 160/318] 10.222.0.42 () {56 vars in 1374 bytes} [Thu Jul 28 08:23:55 2022] GET /identity/v3/role_assignments?user.id=15e084dadcc347398223908f72f171ad&scope.project.id=4a9d64056e4a4c2f805643b31ac7e061&role.id=4af3ffd96e0540dbb20e6ccb08a61f0b => generated 608 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:23:56.228251 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2223a9a6-7717-4f9a-8e4d-3f803616e710 None None] REQUEST_METHOD: `GET` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:23:56.228709 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2223a9a6-7717-4f9a-8e4d-3f803616e710 None None] SCRIPT_NAME: `/identity` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:23:56.228896 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2223a9a6-7717-4f9a-8e4d-3f803616e710 None None] PATH_INFO: `/` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:23:56.230410 dv-cinder-851351-1-smb devstack@keystone.service[207600]: [pid: 207600|app: 0|req: 159/319] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 08:23:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 08:23:56.236084 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55db6bea-25a1-4574-8433-2f7737d0ddbf None None] REQUEST_METHOD: `POST` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:23:56.236386 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55db6bea-25a1-4574-8433-2f7737d0ddbf None None] SCRIPT_NAME: `/identity` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:23:56.236681 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55db6bea-25a1-4574-8433-2f7737d0ddbf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:23:56.257773 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.auth.core [None req-55db6bea-25a1-4574-8433-2f7737d0ddbf None None] MFA Rules not processed for user `b8110ade874c4aa7af27f5c376df700a`. Rule list: `[]` (Enabled: `True`). {{(pid=207601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 08:23:56.259033 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.fernet_utils [None req-55db6bea-25a1-4574-8433-2f7737d0ddbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=207601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:23:56.333740 dv-cinder-851351-1-smb devstack@keystone.service[207601]: [pid: 207601|app: 0|req: 161/320] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 08:23:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 08:23:56.356418 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2223a9a6-7717-4f9a-8e4d-3f803616e710 None None] Authenticating user token {{(pid=207600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:23:56.471581 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1619a019-d5f4-4202-867b-c546e0bc78d2 None None] REQUEST_METHOD: `GET` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:23:56.471794 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG dbcounter [-] [207600] Writing DB stats keystone:SELECT=100 {{(pid=207600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:23:56.472234 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1619a019-d5f4-4202-867b-c546e0bc78d2 None None] SCRIPT_NAME: `/identity` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:23:56.472774 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1619a019-d5f4-4202-867b-c546e0bc78d2 None None] PATH_INFO: `/` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:23:56.474892 dv-cinder-851351-1-smb devstack@keystone.service[207601]: [pid: 207601|app: 0|req: 162/321] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 08:23:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 08:23:56.480057 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4653134-9838-4fd3-ab7d-da349d7dfbf2 None None] REQUEST_METHOD: `POST` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:23:56.480321 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4653134-9838-4fd3-ab7d-da349d7dfbf2 None None] SCRIPT_NAME: `/identity` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:23:56.480608 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4653134-9838-4fd3-ab7d-da349d7dfbf2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:23:56.481305 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2223a9a6-7717-4f9a-8e4d-3f803616e710 None None] Validating token access rules against request {{(pid=207600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:23:56.499999 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.auth.core [None req-f4653134-9838-4fd3-ab7d-da349d7dfbf2 None None] MFA Rules not processed for user `b8110ade874c4aa7af27f5c376df700a`. Rule list: `[]` (Enabled: `True`). {{(pid=207601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 08:23:56.501249 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.fernet_utils [None req-f4653134-9838-4fd3-ab7d-da349d7dfbf2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=207601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:23:56.524896 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b777a7e4-c5b1-46c3-aa00-cb601d2ff907 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:23:56.525587 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b777a7e4-c5b1-46c3-aa00-cb601d2ff907 None admin] REQUEST_METHOD: `GET` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:23:56.525875 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b777a7e4-c5b1-46c3-aa00-cb601d2ff907 None admin] SCRIPT_NAME: `/identity` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:23:56.526156 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b777a7e4-c5b1-46c3-aa00-cb601d2ff907 None admin] PATH_INFO: `/v3/domains/default` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:23:56.527377 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b777a7e4-c5b1-46c3-aa00-cb601d2ff907 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:23:56.528946 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b777a7e4-c5b1-46c3-aa00-cb601d2ff907 None admin] RBAC: Authorization granted {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:23:56.530840 dv-cinder-851351-1-smb devstack@keystone.service[207600]: [pid: 207600|app: 0|req: 160/322] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 08:23:56 2022] GET /identity/v3/domains/default => generated 199 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:23:56.536269 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b777a7e4-c5b1-46c3-aa00-cb601d2ff907 None admin] Authenticating user token {{(pid=207600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:23:56.575443 dv-cinder-851351-1-smb devstack@keystone.service[207601]: [pid: 207601|app: 0|req: 163/323] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 08:23:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 28 08:23:56.597034 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4653134-9838-4fd3-ab7d-da349d7dfbf2 None None] Authenticating user token {{(pid=207601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:23:56.624337 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG dbcounter [-] [207601] Writing DB stats keystone:SELECT=100 {{(pid=207601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:23:56.645074 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b777a7e4-c5b1-46c3-aa00-cb601d2ff907 None admin] Validating token access rules against request {{(pid=207600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:23:56.682182 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b291afb0-7f3e-471c-b050-f4474abef7ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:23:56.682820 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b291afb0-7f3e-471c-b050-f4474abef7ad None admin] REQUEST_METHOD: `POST` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:23:56.683104 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b291afb0-7f3e-471c-b050-f4474abef7ad None admin] SCRIPT_NAME: `/identity` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:23:56.683882 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b291afb0-7f3e-471c-b050-f4474abef7ad None admin] PATH_INFO: `/v3/groups` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:23:56.684568 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b291afb0-7f3e-471c-b050-f4474abef7ad None admin] RBAC: Authorizing `identity:create_group()` {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:23:56.686408 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b291afb0-7f3e-471c-b050-f4474abef7ad None admin] RBAC: Authorization granted {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:23:56.712690 dv-cinder-851351-1-smb devstack@keystone.service[207600]: [pid: 207600|app: 0|req: 161/324] 10.222.0.42 () {60 vars in 1134 bytes} [Thu Jul 28 08:23:56 2022] POST /identity/v3/groups => generated 226 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 28 08:23:56.717237 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4653134-9838-4fd3-ab7d-da349d7dfbf2 None None] Validating token access rules against request {{(pid=207601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:23:56.757194 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ff35fc-58b5-40b8-b4ec-702ce3cc2c64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:23:56.757789 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ff35fc-58b5-40b8-b4ec-702ce3cc2c64 None admin] REQUEST_METHOD: `GET` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:23:56.758071 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ff35fc-58b5-40b8-b4ec-702ce3cc2c64 None admin] SCRIPT_NAME: `/identity` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:23:56.758342 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ff35fc-58b5-40b8-b4ec-702ce3cc2c64 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:23:56.771443 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ff35fc-58b5-40b8-b4ec-702ce3cc2c64 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 08:23:56.776686 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application [None req-05ff35fc-58b5-40b8-b4ec-702ce3cc2c64 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 28 08:23:56.776686 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:23:56.776686 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:23:56.776686 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:23:56.776686 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:23:56.776686 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:23:56.776686 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:23:56.776686 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:23:56.776686 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:23:56.776686 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:23:56.776686 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:23:56.776686 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:23:56.776686 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 08:23:56.776686 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 08:23:56.776686 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 08:23:56.776686 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 08:23:56.777847 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 08:23:56.777847 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 08:23:56.777847 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 08:23:56.777847 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 08:23:56.777847 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:23:56.777847 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:23:56.777847 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:23:56.777847 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:23:56.777847 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:23:56.777847 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:23:56.777847 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:23:56.777847 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application with Lock( Jul 28 08:23:56.777847 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:23:56.777847 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:23:56.777847 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:23:56.777847 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:23:56.778760 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:23:56.778760 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:23:56.778760 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:23:56.778760 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:23:56.778760 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 08:23:56.778760 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 08:23:56.778760 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 08:23:56.778760 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 08:23:56.778760 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 08:23:56.778760 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 08:23:56.778760 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 28 08:23:56.778760 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application Jul 28 08:23:56.781161 dv-cinder-851351-1-smb devstack@keystone.service[207601]: [pid: 207601|app: 0|req: 164/325] 10.222.0.42 () {56 vars in 1099 bytes} [Thu Jul 28 08:23:56 2022] GET /identity/v3/roles/reader => generated 84 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 08:23:56.784132 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b291afb0-7f3e-471c-b050-f4474abef7ad None admin] Authenticating user token {{(pid=207600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:23:56.812996 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG dbcounter [-] [207600] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=207600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:23:56.904478 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b291afb0-7f3e-471c-b050-f4474abef7ad None admin] Validating token access rules against request {{(pid=207600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:23:56.941016 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3521ee4e-2c98-455f-a9dd-02d0ccf9f832 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:23:56.941738 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3521ee4e-2c98-455f-a9dd-02d0ccf9f832 None admin] REQUEST_METHOD: `GET` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:23:56.942024 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3521ee4e-2c98-455f-a9dd-02d0ccf9f832 None admin] SCRIPT_NAME: `/identity` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:23:56.942301 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3521ee4e-2c98-455f-a9dd-02d0ccf9f832 None admin] PATH_INFO: `/v3/roles` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:23:56.943045 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3521ee4e-2c98-455f-a9dd-02d0ccf9f832 None admin] RBAC: Adding query filter params (name=reader) {{(pid=207600) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:23:56.943352 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3521ee4e-2c98-455f-a9dd-02d0ccf9f832 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:23:56.944805 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3521ee4e-2c98-455f-a9dd-02d0ccf9f832 None admin] RBAC: Authorization granted {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:23:56.953848 dv-cinder-851351-1-smb devstack@keystone.service[207600]: [pid: 207600|app: 0|req: 162/326] 10.222.0.42 () {56 vars in 1101 bytes} [Thu Jul 28 08:23:56 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:23:56.959384 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ff35fc-58b5-40b8-b4ec-702ce3cc2c64 None admin] Authenticating user token {{(pid=207601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:23:56.969454 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d2c880-4126-4d8a-8cd1-ef879bdf9fa5 None None] REQUEST_METHOD: `GET` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:23:56.969780 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d2c880-4126-4d8a-8cd1-ef879bdf9fa5 None None] SCRIPT_NAME: `/identity` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:23:56.970463 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d2c880-4126-4d8a-8cd1-ef879bdf9fa5 None None] PATH_INFO: `/` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:23:56.971692 dv-cinder-851351-1-smb devstack@keystone.service[207600]: [pid: 207600|app: 0|req: 163/327] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 08:23:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 08:23:56.977042 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6155a35a-3e16-42ca-a37f-389ffd4397a4 None None] REQUEST_METHOD: `POST` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:23:56.977336 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6155a35a-3e16-42ca-a37f-389ffd4397a4 None None] SCRIPT_NAME: `/identity` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:23:56.977615 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6155a35a-3e16-42ca-a37f-389ffd4397a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:23:57.005786 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.auth.core [None req-6155a35a-3e16-42ca-a37f-389ffd4397a4 None None] MFA Rules not processed for user `b8110ade874c4aa7af27f5c376df700a`. Rule list: `[]` (Enabled: `True`). {{(pid=207600) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 08:23:57.007043 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.fernet_utils [None req-6155a35a-3e16-42ca-a37f-389ffd4397a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=207600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:23:57.070107 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG dbcounter [-] [207601] Writing DB stats keystone:SELECT=100 {{(pid=207601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:23:57.090922 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ff35fc-58b5-40b8-b4ec-702ce3cc2c64 None admin] Validating token access rules against request {{(pid=207601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:23:57.092795 dv-cinder-851351-1-smb devstack@keystone.service[207600]: [pid: 207600|app: 0|req: 164/328] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 08:23:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 28 08:23:57.115295 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6155a35a-3e16-42ca-a37f-389ffd4397a4 None None] Authenticating user token {{(pid=207600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:23:57.134127 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG dbcounter [-] [207600] Writing DB stats keystone:SELECT=100 {{(pid=207600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:23:57.141720 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24249ad8-415f-4e7b-bb0c-0e2bf6cb75e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:23:57.143628 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24249ad8-415f-4e7b-bb0c-0e2bf6cb75e8 None admin] REQUEST_METHOD: `GET` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:23:57.143628 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24249ad8-415f-4e7b-bb0c-0e2bf6cb75e8 None admin] SCRIPT_NAME: `/identity` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:23:57.143628 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24249ad8-415f-4e7b-bb0c-0e2bf6cb75e8 None admin] PATH_INFO: `/v3/users/9070425bcdd24578950be1cf146ddc7c` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:23:57.145097 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24249ad8-415f-4e7b-bb0c-0e2bf6cb75e8 None admin] RBAC: Authorizing `identity:get_user(user_id=9070425bcdd24578950be1cf146ddc7c)` {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:23:57.146769 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24249ad8-415f-4e7b-bb0c-0e2bf6cb75e8 None admin] RBAC: Authorization granted {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:23:57.149381 dv-cinder-851351-1-smb devstack@keystone.service[207601]: [pid: 207601|app: 0|req: 165/329] 10.222.0.42 () {56 vars in 1177 bytes} [Thu Jul 28 08:23:56 2022] GET /identity/v3/users/9070425bcdd24578950be1cf146ddc7c => generated 293 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:23:57.155722 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24249ad8-415f-4e7b-bb0c-0e2bf6cb75e8 None admin] Authenticating user token {{(pid=207601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:23:57.258018 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6155a35a-3e16-42ca-a37f-389ffd4397a4 None None] Validating token access rules against request {{(pid=207600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:23:57.284498 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24249ad8-415f-4e7b-bb0c-0e2bf6cb75e8 None admin] Validating token access rules against request {{(pid=207601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:23:57.295756 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d93d411-79c3-45eb-b286-a3993d02e824 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:23:57.296831 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d93d411-79c3-45eb-b286-a3993d02e824 None admin] REQUEST_METHOD: `GET` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:23:57.297350 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d93d411-79c3-45eb-b286-a3993d02e824 None admin] SCRIPT_NAME: `/identity` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:23:57.297827 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d93d411-79c3-45eb-b286-a3993d02e824 None admin] PATH_INFO: `/v3/roles/member` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:23:57.310905 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d93d411-79c3-45eb-b286-a3993d02e824 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 08:23:57.317895 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application [None req-2d93d411-79c3-45eb-b286-a3993d02e824 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 28 08:23:57.317895 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:23:57.317895 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:23:57.317895 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:23:57.317895 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:23:57.317895 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:23:57.317895 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:23:57.317895 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:23:57.317895 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:23:57.317895 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:23:57.317895 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:23:57.317895 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:23:57.317895 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 08:23:57.317895 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 08:23:57.317895 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 08:23:57.317895 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 08:23:57.319026 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 08:23:57.319026 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 08:23:57.319026 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 08:23:57.319026 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 08:23:57.319026 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:23:57.319026 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:23:57.319026 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:23:57.319026 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:23:57.319026 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:23:57.319026 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:23:57.319026 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:23:57.319026 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application with Lock( Jul 28 08:23:57.319026 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:23:57.319026 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:23:57.319026 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:23:57.319026 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:23:57.319925 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:23:57.319925 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:23:57.319925 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:23:57.319925 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:23:57.319925 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 08:23:57.319925 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 08:23:57.319925 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 08:23:57.319925 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 08:23:57.319925 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 08:23:57.319925 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 08:23:57.319925 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 28 08:23:57.319925 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application Jul 28 08:23:57.322903 dv-cinder-851351-1-smb devstack@keystone.service[207600]: [pid: 207600|app: 0|req: 165/330] 10.222.0.42 () {56 vars in 1099 bytes} [Thu Jul 28 08:23:57 2022] GET /identity/v3/roles/member => generated 84 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 08:23:57.328523 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d93d411-79c3-45eb-b286-a3993d02e824 None admin] Authenticating user token {{(pid=207600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:23:57.334351 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a41e8cd1-8270-4848-8a55-6d05a3e720c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:23:57.335385 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41e8cd1-8270-4848-8a55-6d05a3e720c4 None admin] REQUEST_METHOD: `PUT` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:23:57.335893 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41e8cd1-8270-4848-8a55-6d05a3e720c4 None admin] SCRIPT_NAME: `/identity` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:23:57.336385 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41e8cd1-8270-4848-8a55-6d05a3e720c4 None admin] PATH_INFO: `/v3/system/users/9070425bcdd24578950be1cf146ddc7c/roles/4af3ffd96e0540dbb20e6ccb08a61f0b` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:23:57.338180 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a41e8cd1-8270-4848-8a55-6d05a3e720c4 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=9070425bcdd24578950be1cf146ddc7c, role_id=4af3ffd96e0540dbb20e6ccb08a61f0b)` {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:23:57.340216 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a41e8cd1-8270-4848-8a55-6d05a3e720c4 None admin] RBAC: Authorization granted {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:23:57.350290 dv-cinder-851351-1-smb devstack@keystone.service[207601]: [pid: 207601|app: 0|req: 166/331] 10.222.0.42 () {58 vars in 1334 bytes} [Thu Jul 28 08:23:57 2022] PUT /identity/v3/system/users/9070425bcdd24578950be1cf146ddc7c/roles/4af3ffd96e0540dbb20e6ccb08a61f0b => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 08:23:57.431448 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG dbcounter [-] [207600] Writing DB stats keystone:SELECT=100 {{(pid=207600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:23:57.470991 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d93d411-79c3-45eb-b286-a3993d02e824 None admin] Validating token access rules against request {{(pid=207600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:23:57.518288 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43164f0c-596a-4d91-b4db-c82e7d4acd59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:23:57.518947 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43164f0c-596a-4d91-b4db-c82e7d4acd59 None admin] REQUEST_METHOD: `GET` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:23:57.519234 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43164f0c-596a-4d91-b4db-c82e7d4acd59 None admin] SCRIPT_NAME: `/identity` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:23:57.519511 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43164f0c-596a-4d91-b4db-c82e7d4acd59 None admin] PATH_INFO: `/v3/roles` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:23:57.520269 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43164f0c-596a-4d91-b4db-c82e7d4acd59 None admin] RBAC: Adding query filter params (name=member) {{(pid=207600) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:23:57.520582 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43164f0c-596a-4d91-b4db-c82e7d4acd59 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:23:57.522108 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43164f0c-596a-4d91-b4db-c82e7d4acd59 None admin] RBAC: Authorization granted {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:23:57.535215 dv-cinder-851351-1-smb devstack@keystone.service[207600]: [pid: 207600|app: 0|req: 166/332] 10.222.0.42 () {56 vars in 1101 bytes} [Thu Jul 28 08:23:57 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 08:23:57.541139 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a41e8cd1-8270-4848-8a55-6d05a3e720c4 None admin] Authenticating user token {{(pid=207601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:23:57.564890 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG dbcounter [-] [207601] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=207601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:23:57.662785 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a41e8cd1-8270-4848-8a55-6d05a3e720c4 None admin] Validating token access rules against request {{(pid=207601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:23:57.710218 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec8d3f8-3dba-4f19-9071-29d26208087f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:23:57.711284 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec8d3f8-3dba-4f19-9071-29d26208087f None admin] REQUEST_METHOD: `GET` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:23:57.711781 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec8d3f8-3dba-4f19-9071-29d26208087f None admin] SCRIPT_NAME: `/identity` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:23:57.712272 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec8d3f8-3dba-4f19-9071-29d26208087f None admin] PATH_INFO: `/v3/users/4e00ef2a5d8647efa7744dc2ebcbbcc5` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:23:57.714119 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bec8d3f8-3dba-4f19-9071-29d26208087f None admin] RBAC: Authorizing `identity:get_user(user_id=4e00ef2a5d8647efa7744dc2ebcbbcc5)` {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:23:57.715899 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bec8d3f8-3dba-4f19-9071-29d26208087f None admin] RBAC: Authorization granted {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:23:57.718188 dv-cinder-851351-1-smb devstack@keystone.service[207601]: [pid: 207601|app: 0|req: 167/333] 10.222.0.42 () {56 vars in 1177 bytes} [Thu Jul 28 08:23:57 2022] GET /identity/v3/users/4e00ef2a5d8647efa7744dc2ebcbbcc5 => generated 293 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:23:57.723912 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43164f0c-596a-4d91-b4db-c82e7d4acd59 None admin] Authenticating user token {{(pid=207600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:23:57.869536 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43164f0c-596a-4d91-b4db-c82e7d4acd59 None admin] Validating token access rules against request {{(pid=207600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:23:57.923337 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef74de99-5d4c-4bbf-9c61-df135df7ecaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:23:57.923896 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef74de99-5d4c-4bbf-9c61-df135df7ecaf None admin] REQUEST_METHOD: `GET` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:23:57.924180 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef74de99-5d4c-4bbf-9c61-df135df7ecaf None admin] SCRIPT_NAME: `/identity` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:23:57.924451 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef74de99-5d4c-4bbf-9c61-df135df7ecaf None admin] PATH_INFO: `/v3/role_assignments` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:23:57.925307 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef74de99-5d4c-4bbf-9c61-df135df7ecaf None admin] RBAC: Adding query filter params (role.id=70a2fd2878c549aeb19b16ec37e37164, user.id=4e00ef2a5d8647efa7744dc2ebcbbcc5, scope.system=all) {{(pid=207600) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:23:57.925695 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef74de99-5d4c-4bbf-9c61-df135df7ecaf None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:23:57.927152 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef74de99-5d4c-4bbf-9c61-df135df7ecaf None admin] RBAC: Authorization granted {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:23:57.938815 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG dbcounter [-] [207600] Writing DB stats keystone:SELECT=100 {{(pid=207600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:23:57.943307 dv-cinder-851351-1-smb devstack@keystone.service[207600]: [pid: 207600|app: 0|req: 167/334] 10.222.0.42 () {56 vars in 1308 bytes} [Thu Jul 28 08:23:57 2022] GET /identity/v3/role_assignments?user.id=4e00ef2a5d8647efa7744dc2ebcbbcc5&scope.system=all&role.id=70a2fd2878c549aeb19b16ec37e37164 => generated 510 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:23:59.331053 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f007fa-fb18-40fe-84d9-18821fa26ec8 None None] REQUEST_METHOD: `GET` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:23:59.331586 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f007fa-fb18-40fe-84d9-18821fa26ec8 None None] SCRIPT_NAME: `/identity` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:23:59.332547 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f007fa-fb18-40fe-84d9-18821fa26ec8 None None] PATH_INFO: `/` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:23:59.334148 dv-cinder-851351-1-smb devstack@keystone.service[207601]: [pid: 207601|app: 0|req: 168/335] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 08:23:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 08:23:59.340270 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb68c24b-244d-4ce0-9200-8c7311fac5da None None] REQUEST_METHOD: `POST` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:23:59.340775 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb68c24b-244d-4ce0-9200-8c7311fac5da None None] SCRIPT_NAME: `/identity` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:23:59.341006 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb68c24b-244d-4ce0-9200-8c7311fac5da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:23:59.369832 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.auth.core [None req-fb68c24b-244d-4ce0-9200-8c7311fac5da None None] MFA Rules not processed for user `b8110ade874c4aa7af27f5c376df700a`. Rule list: `[]` (Enabled: `True`). {{(pid=207600) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 08:23:59.371120 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.fernet_utils [None req-fb68c24b-244d-4ce0-9200-8c7311fac5da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=207600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:23:59.455368 dv-cinder-851351-1-smb devstack@keystone.service[207600]: [pid: 207600|app: 0|req: 168/336] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 08:23:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 08:23:59.489678 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74ba56b-5197-401d-ab2d-a1a97669ec5b None None] REQUEST_METHOD: `GET` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:23:59.490264 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74ba56b-5197-401d-ab2d-a1a97669ec5b None None] SCRIPT_NAME: `/identity` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:23:59.490727 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74ba56b-5197-401d-ab2d-a1a97669ec5b None None] PATH_INFO: `/` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:23:59.492487 dv-cinder-851351-1-smb devstack@keystone.service[207601]: [pid: 207601|app: 0|req: 169/337] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 08:23:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 08:23:59.494801 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb68c24b-244d-4ce0-9200-8c7311fac5da None None] Authenticating user token {{(pid=207600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:23:59.497822 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe27aa27-f9af-437f-a438-295d90671b8f None None] REQUEST_METHOD: `POST` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:23:59.498392 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe27aa27-f9af-437f-a438-295d90671b8f None None] SCRIPT_NAME: `/identity` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:23:59.498875 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe27aa27-f9af-437f-a438-295d90671b8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:23:59.545726 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.auth.core [None req-fe27aa27-f9af-437f-a438-295d90671b8f None None] MFA Rules not processed for user `b8110ade874c4aa7af27f5c376df700a`. Rule list: `[]` (Enabled: `True`). {{(pid=207601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 08:23:59.547377 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.fernet_utils [None req-fe27aa27-f9af-437f-a438-295d90671b8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=207601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:23:59.622565 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb68c24b-244d-4ce0-9200-8c7311fac5da None None] Validating token access rules against request {{(pid=207600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:23:59.650167 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG dbcounter [-] [207600] Writing DB stats keystone:SELECT=100 {{(pid=207600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:23:59.675475 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d681e01c-2827-49a3-ac7b-a0561a1eefb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:23:59.676156 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d681e01c-2827-49a3-ac7b-a0561a1eefb7 None admin] REQUEST_METHOD: `GET` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:23:59.676444 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d681e01c-2827-49a3-ac7b-a0561a1eefb7 None admin] SCRIPT_NAME: `/identity` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:23:59.676746 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d681e01c-2827-49a3-ac7b-a0561a1eefb7 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:23:59.702263 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d681e01c-2827-49a3-ac7b-a0561a1eefb7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 08:23:59.707659 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application [None req-d681e01c-2827-49a3-ac7b-a0561a1eefb7 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 28 08:23:59.707659 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:23:59.707659 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:23:59.707659 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:23:59.707659 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:23:59.707659 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:23:59.707659 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:23:59.707659 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:23:59.707659 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:23:59.707659 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:23:59.707659 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:23:59.707659 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:23:59.707659 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 08:23:59.707659 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 08:23:59.707659 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 08:23:59.707659 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 08:23:59.708624 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 08:23:59.708624 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 08:23:59.708624 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 08:23:59.708624 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 08:23:59.708624 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:23:59.708624 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:23:59.708624 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:23:59.708624 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:23:59.708624 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:23:59.708624 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:23:59.708624 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:23:59.708624 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application with Lock( Jul 28 08:23:59.708624 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:23:59.708624 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:23:59.708624 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:23:59.708624 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:23:59.709936 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:23:59.709936 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:23:59.709936 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:23:59.709936 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:23:59.709936 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 08:23:59.709936 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 08:23:59.709936 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 08:23:59.709936 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 08:23:59.709936 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 08:23:59.709936 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 08:23:59.709936 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 28 08:23:59.709936 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application Jul 28 08:23:59.709936 dv-cinder-851351-1-smb devstack@keystone.service[207600]: [pid: 207600|app: 0|req: 169/338] 10.222.0.42 () {56 vars in 1114 bytes} [Thu Jul 28 08:23:59 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:23:59.714736 dv-cinder-851351-1-smb devstack@keystone.service[207601]: [pid: 207601|app: 0|req: 170/339] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 08:23:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 28 08:23:59.717519 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d681e01c-2827-49a3-ac7b-a0561a1eefb7 None admin] Authenticating user token {{(pid=207600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:23:59.751824 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe27aa27-f9af-437f-a438-295d90671b8f None None] Authenticating user token {{(pid=207601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:23:59.782283 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG dbcounter [-] [207601] Writing DB stats keystone:SELECT=100 {{(pid=207601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:23:59.877094 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d681e01c-2827-49a3-ac7b-a0561a1eefb7 None admin] Validating token access rules against request {{(pid=207600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:23:59.931861 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea24645-cb1e-4301-aab2-71cdb6c70954 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:23:59.932520 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea24645-cb1e-4301-aab2-71cdb6c70954 None admin] REQUEST_METHOD: `GET` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:23:59.932906 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea24645-cb1e-4301-aab2-71cdb6c70954 None admin] SCRIPT_NAME: `/identity` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:23:59.933152 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea24645-cb1e-4301-aab2-71cdb6c70954 None admin] PATH_INFO: `/v3/roles` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:23:59.933993 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ea24645-cb1e-4301-aab2-71cdb6c70954 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=207600) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:23:59.934305 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ea24645-cb1e-4301-aab2-71cdb6c70954 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:23:59.935727 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ea24645-cb1e-4301-aab2-71cdb6c70954 None admin] RBAC: Authorization granted {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:23:59.947253 dv-cinder-851351-1-smb devstack@keystone.service[207600]: [pid: 207600|app: 0|req: 170/340] 10.222.0.42 () {56 vars in 1111 bytes} [Thu Jul 28 08:23:59 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:23:59.951973 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe27aa27-f9af-437f-a438-295d90671b8f None None] Validating token access rules against request {{(pid=207601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:23:59.953375 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea24645-cb1e-4301-aab2-71cdb6c70954 None admin] Authenticating user token {{(pid=207600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:24:00.008303 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13eb7854-e022-4a20-a15c-f26558e8ae48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:24:00.009033 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13eb7854-e022-4a20-a15c-f26558e8ae48 None admin] REQUEST_METHOD: `GET` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:24:00.009305 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13eb7854-e022-4a20-a15c-f26558e8ae48 None admin] SCRIPT_NAME: `/identity` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:24:00.009737 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13eb7854-e022-4a20-a15c-f26558e8ae48 None admin] PATH_INFO: `/v3/roles/member` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:24:00.012241 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG dbcounter [-] [207600] Writing DB stats keystone:SELECT=100 {{(pid=207600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:24:00.026903 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13eb7854-e022-4a20-a15c-f26558e8ae48 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 08:24:00.032585 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application [None req-13eb7854-e022-4a20-a15c-f26558e8ae48 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 28 08:24:00.032585 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:24:00.032585 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:24:00.032585 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:24:00.032585 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:24:00.032585 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:24:00.032585 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:24:00.032585 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:24:00.032585 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:24:00.032585 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:24:00.032585 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:24:00.032585 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:24:00.032585 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 08:24:00.032585 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 08:24:00.032585 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 08:24:00.032585 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 08:24:00.037841 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 08:24:00.037841 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 08:24:00.037841 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 08:24:00.037841 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 08:24:00.037841 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:24:00.037841 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:24:00.037841 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:24:00.037841 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:24:00.037841 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:24:00.037841 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:24:00.037841 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:24:00.037841 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application with Lock( Jul 28 08:24:00.037841 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:24:00.037841 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:24:00.037841 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:24:00.037841 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:24:00.038908 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:24:00.038908 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:24:00.038908 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:24:00.038908 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:24:00.038908 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 08:24:00.038908 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 08:24:00.038908 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 08:24:00.038908 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 08:24:00.038908 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 08:24:00.038908 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 08:24:00.038908 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 28 08:24:00.038908 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application Jul 28 08:24:00.041428 dv-cinder-851351-1-smb devstack@keystone.service[207601]: [pid: 207601|app: 0|req: 171/341] 10.222.0.42 () {56 vars in 1099 bytes} [Thu Jul 28 08:23:59 2022] GET /identity/v3/roles/member => generated 84 bytes in 290 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 08:24:00.047792 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13eb7854-e022-4a20-a15c-f26558e8ae48 None admin] Authenticating user token {{(pid=207601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:24:00.084714 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea24645-cb1e-4301-aab2-71cdb6c70954 None admin] Validating token access rules against request {{(pid=207600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:24:00.128734 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c8d2eeb-005d-4b59-bef9-a32bd6c44c2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:24:00.130405 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8d2eeb-005d-4b59-bef9-a32bd6c44c2a None admin] REQUEST_METHOD: `GET` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:24:00.131023 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8d2eeb-005d-4b59-bef9-a32bd6c44c2a None admin] SCRIPT_NAME: `/identity` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:24:00.132991 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8d2eeb-005d-4b59-bef9-a32bd6c44c2a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:24:00.218131 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c8d2eeb-005d-4b59-bef9-a32bd6c44c2a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:24:00.219898 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c8d2eeb-005d-4b59-bef9-a32bd6c44c2a None admin] RBAC: Authorization granted {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:24:00.237046 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG dbcounter [-] [207601] Writing DB stats keystone:SELECT=100 {{(pid=207601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:24:00.276795 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG dbcounter [-] [207600] Writing DB stats keystone:SELECT=100 {{(pid=207600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:24:00.288570 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13eb7854-e022-4a20-a15c-f26558e8ae48 None admin] Validating token access rules against request {{(pid=207601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:24:00.346960 dv-cinder-851351-1-smb devstack@keystone.service[207600]: [pid: 207600|app: 0|req: 171/342] 10.222.0.42 () {58 vars in 1282 bytes} [Thu Jul 28 08:23:59 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 394 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 28 08:24:00.349746 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b488ecd6-c97c-4bd1-babf-d20f0d7143e9 None None] REQUEST_METHOD: `GET` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:24:00.350373 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b488ecd6-c97c-4bd1-babf-d20f0d7143e9 None None] SCRIPT_NAME: `/identity` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:24:00.350834 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b488ecd6-c97c-4bd1-babf-d20f0d7143e9 None None] PATH_INFO: `/` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:24:00.352511 dv-cinder-851351-1-smb devstack@keystone.service[207600]: [pid: 207600|app: 0|req: 172/343] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 08:24:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 08:24:00.353406 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b488ecd6-c97c-4bd1-babf-d20f0d7143e9 None None] Authenticating user token {{(pid=207600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:24:00.373145 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2658db7c-f650-4fd6-910b-80b6e7ebe56e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:24:00.374379 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2658db7c-f650-4fd6-910b-80b6e7ebe56e None admin] REQUEST_METHOD: `GET` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:24:00.374828 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2658db7c-f650-4fd6-910b-80b6e7ebe56e None admin] SCRIPT_NAME: `/identity` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:24:00.375254 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2658db7c-f650-4fd6-910b-80b6e7ebe56e None admin] PATH_INFO: `/v3/roles` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:24:00.376165 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2658db7c-f650-4fd6-910b-80b6e7ebe56e None admin] RBAC: Adding query filter params (name=member) {{(pid=207601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:24:00.376633 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2658db7c-f650-4fd6-910b-80b6e7ebe56e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:24:00.379895 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2658db7c-f650-4fd6-910b-80b6e7ebe56e None admin] RBAC: Authorization granted {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:24:00.401024 dv-cinder-851351-1-smb devstack@keystone.service[207601]: [pid: 207601|app: 0|req: 172/344] 10.222.0.42 () {56 vars in 1101 bytes} [Thu Jul 28 08:24:00 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 354 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 08:24:00.402710 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcacaec8-bf22-4a4b-971c-629253be4704 None None] REQUEST_METHOD: `POST` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:24:00.405132 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcacaec8-bf22-4a4b-971c-629253be4704 None None] SCRIPT_NAME: `/identity` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:24:00.407017 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcacaec8-bf22-4a4b-971c-629253be4704 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:24:00.446699 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.auth.core [None req-fcacaec8-bf22-4a4b-971c-629253be4704 None None] MFA Rules not processed for user `b8110ade874c4aa7af27f5c376df700a`. Rule list: `[]` (Enabled: `True`). {{(pid=207601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 08:24:00.448197 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.fernet_utils [None req-fcacaec8-bf22-4a4b-971c-629253be4704 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=207601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:24:00.535296 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b488ecd6-c97c-4bd1-babf-d20f0d7143e9 None None] Validating token access rules against request {{(pid=207600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:24:00.585094 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e851e8-dac2-4ece-89c5-41ba4b6b8a38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:24:00.586061 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e851e8-dac2-4ece-89c5-41ba4b6b8a38 None admin] REQUEST_METHOD: `GET` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:24:00.586496 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e851e8-dac2-4ece-89c5-41ba4b6b8a38 None admin] SCRIPT_NAME: `/identity` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:24:00.586921 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e851e8-dac2-4ece-89c5-41ba4b6b8a38 None admin] PATH_INFO: `/v3/projects/4a64079f46494355a0aa3aafd9a90c0c` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:24:00.589809 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e851e8-dac2-4ece-89c5-41ba4b6b8a38 None admin] RBAC: Authorizing `identity:get_project(project_id=4a64079f46494355a0aa3aafd9a90c0c)` {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:24:00.591556 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e851e8-dac2-4ece-89c5-41ba4b6b8a38 None admin] RBAC: Authorization granted {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:24:00.594298 dv-cinder-851351-1-smb devstack@keystone.service[207600]: [pid: 207600|app: 0|req: 173/345] 10.222.0.42 () {56 vars in 1186 bytes} [Thu Jul 28 08:24:00 2022] GET /identity/v3/projects/4a64079f46494355a0aa3aafd9a90c0c => generated 298 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:24:00.599448 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e851e8-dac2-4ece-89c5-41ba4b6b8a38 None admin] Authenticating user token {{(pid=207600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:24:00.606197 dv-cinder-851351-1-smb devstack@keystone.service[207601]: [pid: 207601|app: 0|req: 173/346] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 08:24:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 08:24:00.607271 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcacaec8-bf22-4a4b-971c-629253be4704 None None] Authenticating user token {{(pid=207601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:24:00.630303 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG dbcounter [-] [207600] Writing DB stats keystone:SELECT=100 {{(pid=207600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:24:00.696328 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG dbcounter [-] [207601] Writing DB stats keystone:SELECT=100 {{(pid=207601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:24:00.741143 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcacaec8-bf22-4a4b-971c-629253be4704 None None] Validating token access rules against request {{(pid=207601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:24:00.755094 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e851e8-dac2-4ece-89c5-41ba4b6b8a38 None admin] Validating token access rules against request {{(pid=207600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:24:00.791082 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e14d3d-9882-42d2-8ed6-074aeffd0880 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:24:00.792155 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e14d3d-9882-42d2-8ed6-074aeffd0880 None admin] REQUEST_METHOD: `GET` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:24:00.792438 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e14d3d-9882-42d2-8ed6-074aeffd0880 None admin] SCRIPT_NAME: `/identity` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:24:00.792734 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e14d3d-9882-42d2-8ed6-074aeffd0880 None admin] PATH_INFO: `/v3/groups/648e35db40964d1baaa9a887e8198e50` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:24:00.801744 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e14d3d-9882-42d2-8ed6-074aeffd0880 None admin] RBAC: Authorizing `identity:get_group(group_id=648e35db40964d1baaa9a887e8198e50)` {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:24:00.803263 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e14d3d-9882-42d2-8ed6-074aeffd0880 None admin] RBAC: Authorization granted {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:24:00.804852 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24c1b91-011a-48f2-9872-34bff0ac9f5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:24:00.805394 dv-cinder-851351-1-smb devstack@keystone.service[207601]: [pid: 207601|app: 0|req: 174/347] 10.222.0.42 () {56 vars in 1180 bytes} [Thu Jul 28 08:24:00 2022] GET /identity/v3/groups/648e35db40964d1baaa9a887e8198e50 => generated 226 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:24:00.805956 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24c1b91-011a-48f2-9872-34bff0ac9f5a None admin] REQUEST_METHOD: `GET` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:24:00.806429 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24c1b91-011a-48f2-9872-34bff0ac9f5a None admin] SCRIPT_NAME: `/identity` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:24:00.806662 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b14fa2-17f0-4fca-8ec3-123aa9376873 None None] REQUEST_METHOD: `GET` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:24:00.806967 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b14fa2-17f0-4fca-8ec3-123aa9376873 None None] SCRIPT_NAME: `/identity` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:24:00.807200 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24c1b91-011a-48f2-9872-34bff0ac9f5a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:24:00.807325 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b14fa2-17f0-4fca-8ec3-123aa9376873 None None] PATH_INFO: `/` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:24:00.808702 dv-cinder-851351-1-smb devstack@keystone.service[207601]: [pid: 207601|app: 0|req: 175/348] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 08:24:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 08:24:00.809354 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b14fa2-17f0-4fca-8ec3-123aa9376873 None None] Authenticating user token {{(pid=207601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:24:00.909232 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b24c1b91-011a-48f2-9872-34bff0ac9f5a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:24:00.910860 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b24c1b91-011a-48f2-9872-34bff0ac9f5a None admin] RBAC: Authorization granted {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:24:00.933824 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG dbcounter [-] [207600] Writing DB stats keystone:SELECT=100 {{(pid=207600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:24:00.980610 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b14fa2-17f0-4fca-8ec3-123aa9376873 None None] Validating token access rules against request {{(pid=207601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:24:01.028827 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG dbcounter [-] [207601] Writing DB stats keystone:SELECT=100 {{(pid=207601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:24:01.032882 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc523a4-7f6d-451e-b327-e78f215a505a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:24:01.033616 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc523a4-7f6d-451e-b327-e78f215a505a None admin] REQUEST_METHOD: `GET` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:24:01.033900 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc523a4-7f6d-451e-b327-e78f215a505a None admin] SCRIPT_NAME: `/identity` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:24:01.034757 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc523a4-7f6d-451e-b327-e78f215a505a None admin] PATH_INFO: `/v3/roles/reader` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:24:01.051433 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cc523a4-7f6d-451e-b327-e78f215a505a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 08:24:01.056485 dv-cinder-851351-1-smb devstack@keystone.service[207600]: [pid: 207600|app: 0|req: 174/349] 10.222.0.42 () {58 vars in 1282 bytes} [Thu Jul 28 08:24:00 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 457 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 28 08:24:01.057533 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application [None req-1cc523a4-7f6d-451e-b327-e78f215a505a None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 28 08:24:01.057533 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:24:01.057533 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:24:01.057533 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:24:01.057533 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:24:01.057533 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:24:01.057533 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:24:01.057533 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:24:01.057533 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:24:01.057533 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:24:01.057533 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:24:01.057533 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:24:01.057533 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 08:24:01.057533 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 08:24:01.057533 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 08:24:01.057533 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 08:24:01.058584 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 08:24:01.058584 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 08:24:01.058584 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 08:24:01.058584 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 08:24:01.058584 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:24:01.058584 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:24:01.058584 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:24:01.058584 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:24:01.058584 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:24:01.058584 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:24:01.058584 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:24:01.058584 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application with Lock( Jul 28 08:24:01.058584 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:24:01.058584 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:24:01.058584 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:24:01.058584 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:24:01.059468 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:24:01.059468 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:24:01.059468 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:24:01.059468 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:24:01.059468 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 08:24:01.059468 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 08:24:01.059468 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 08:24:01.059468 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 08:24:01.059468 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 08:24:01.059468 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 08:24:01.059468 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 28 08:24:01.059468 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application Jul 28 08:24:01.060128 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dedaf576-785c-45b9-9f7d-52a10f278d71 None None] REQUEST_METHOD: `POST` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:24:01.060128 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dedaf576-785c-45b9-9f7d-52a10f278d71 None None] SCRIPT_NAME: `/identity` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:24:01.060128 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dedaf576-785c-45b9-9f7d-52a10f278d71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:24:01.060326 dv-cinder-851351-1-smb devstack@keystone.service[207601]: [pid: 207601|app: 0|req: 176/350] 10.222.0.42 () {56 vars in 1099 bytes} [Thu Jul 28 08:24:00 2022] GET /identity/v3/roles/reader => generated 84 bytes in 250 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:24:01.060326 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc523a4-7f6d-451e-b327-e78f215a505a None admin] Authenticating user token {{(pid=207601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:24:01.086974 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.auth.core [None req-dedaf576-785c-45b9-9f7d-52a10f278d71 None None] MFA Rules not processed for user `b8110ade874c4aa7af27f5c376df700a`. Rule list: `[]` (Enabled: `True`). {{(pid=207600) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 08:24:01.089213 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.fernet_utils [None req-dedaf576-785c-45b9-9f7d-52a10f278d71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=207600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:24:01.209518 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc523a4-7f6d-451e-b327-e78f215a505a None admin] Validating token access rules against request {{(pid=207601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:24:01.238076 dv-cinder-851351-1-smb devstack@keystone.service[207600]: [pid: 207600|app: 0|req: 175/351] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 08:24:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 08:24:01.238997 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dedaf576-785c-45b9-9f7d-52a10f278d71 None None] Authenticating user token {{(pid=207600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:24:01.266270 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9592157-0e3f-4c61-be17-f147f589a943 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:24:01.266270 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9592157-0e3f-4c61-be17-f147f589a943 None admin] REQUEST_METHOD: `GET` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:24:01.266270 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9592157-0e3f-4c61-be17-f147f589a943 None admin] SCRIPT_NAME: `/identity` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:24:01.266270 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9592157-0e3f-4c61-be17-f147f589a943 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:24:01.270756 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9592157-0e3f-4c61-be17-f147f589a943 None admin] RBAC: Adding query filter params (group.id=648e35db40964d1baaa9a887e8198e50, role.id=e617201b25d44cb1844c9f28bcac91fb, scope.project.id=4a64079f46494355a0aa3aafd9a90c0c) {{(pid=207601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:24:01.270756 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9592157-0e3f-4c61-be17-f147f589a943 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:24:01.270756 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9592157-0e3f-4c61-be17-f147f589a943 None admin] RBAC: Authorization granted {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:24:01.276947 dv-cinder-851351-1-smb devstack@keystone.service[207601]: [pid: 207601|app: 0|req: 177/352] 10.222.0.42 () {56 vars in 1376 bytes} [Thu Jul 28 08:24:01 2022] GET /identity/v3/role_assignments?group.id=648e35db40964d1baaa9a887e8198e50&scope.project.id=4a64079f46494355a0aa3aafd9a90c0c&role.id=e617201b25d44cb1844c9f28bcac91fb => generated 260 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:24:01.276947 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9592157-0e3f-4c61-be17-f147f589a943 None admin] Authenticating user token {{(pid=207601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:24:01.303376 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG dbcounter [-] [207600] Writing DB stats keystone:SELECT=100 {{(pid=207600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:24:01.393380 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dedaf576-785c-45b9-9f7d-52a10f278d71 None None] Validating token access rules against request {{(pid=207600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:24:01.395814 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG dbcounter [-] [207601] Writing DB stats keystone:SELECT=100 {{(pid=207601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:24:01.468877 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92ad20a-e815-49f3-9f0e-4edd46dc7ef2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:24:01.469319 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92ad20a-e815-49f3-9f0e-4edd46dc7ef2 None admin] REQUEST_METHOD: `GET` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:24:01.469649 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92ad20a-e815-49f3-9f0e-4edd46dc7ef2 None admin] SCRIPT_NAME: `/identity` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:24:01.469934 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92ad20a-e815-49f3-9f0e-4edd46dc7ef2 None admin] PATH_INFO: `/v3/roles` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:24:01.470651 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d92ad20a-e815-49f3-9f0e-4edd46dc7ef2 None admin] RBAC: Adding query filter params (name=reader) {{(pid=207600) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:24:01.470966 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d92ad20a-e815-49f3-9f0e-4edd46dc7ef2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:24:01.472407 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d92ad20a-e815-49f3-9f0e-4edd46dc7ef2 None admin] RBAC: Authorization granted {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:24:01.472820 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9592157-0e3f-4c61-be17-f147f589a943 None admin] Validating token access rules against request {{(pid=207601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:24:01.484573 dv-cinder-851351-1-smb devstack@keystone.service[207600]: [pid: 207600|app: 0|req: 176/353] 10.222.0.42 () {56 vars in 1101 bytes} [Thu Jul 28 08:24:01 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:24:01.485990 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee49b9e-1cc4-4481-890c-41aad3a42d0e None None] REQUEST_METHOD: `GET` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:24:01.486236 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee49b9e-1cc4-4481-890c-41aad3a42d0e None None] SCRIPT_NAME: `/identity` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:24:01.486514 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee49b9e-1cc4-4481-890c-41aad3a42d0e None None] PATH_INFO: `/` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:24:01.488180 dv-cinder-851351-1-smb devstack@keystone.service[207600]: [pid: 207600|app: 0|req: 177/354] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 08:24:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 08:24:01.488902 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee49b9e-1cc4-4481-890c-41aad3a42d0e None None] Authenticating user token {{(pid=207600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:24:01.519987 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3655ca0-49dc-4eef-9ec3-91748a57d0ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:24:01.520761 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3655ca0-49dc-4eef-9ec3-91748a57d0ec None admin] REQUEST_METHOD: `GET` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:24:01.521056 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3655ca0-49dc-4eef-9ec3-91748a57d0ec None admin] SCRIPT_NAME: `/identity` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:24:01.521338 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3655ca0-49dc-4eef-9ec3-91748a57d0ec None admin] PATH_INFO: `/v3/projects/4a64079f46494355a0aa3aafd9a90c0c` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:24:01.522737 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3655ca0-49dc-4eef-9ec3-91748a57d0ec None admin] RBAC: Authorizing `identity:get_project(project_id=4a64079f46494355a0aa3aafd9a90c0c)` {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:24:01.524226 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3655ca0-49dc-4eef-9ec3-91748a57d0ec None admin] RBAC: Authorization granted {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:24:01.526229 dv-cinder-851351-1-smb devstack@keystone.service[207601]: [pid: 207601|app: 0|req: 178/355] 10.222.0.42 () {56 vars in 1186 bytes} [Thu Jul 28 08:24:01 2022] GET /identity/v3/projects/4a64079f46494355a0aa3aafd9a90c0c => generated 298 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:24:01.527526 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d6968d-7d6d-42d7-b7cc-09db6dc18c88 None None] REQUEST_METHOD: `POST` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:24:01.527788 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d6968d-7d6d-42d7-b7cc-09db6dc18c88 None None] SCRIPT_NAME: `/identity` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:24:01.528073 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d6968d-7d6d-42d7-b7cc-09db6dc18c88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:24:01.548127 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.auth.core [None req-62d6968d-7d6d-42d7-b7cc-09db6dc18c88 None None] MFA Rules not processed for user `b8110ade874c4aa7af27f5c376df700a`. Rule list: `[]` (Enabled: `True`). {{(pid=207601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 08:24:01.549735 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.fernet_utils [None req-62d6968d-7d6d-42d7-b7cc-09db6dc18c88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=207601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:24:01.632957 dv-cinder-851351-1-smb devstack@keystone.service[207601]: [pid: 207601|app: 0|req: 179/356] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 08:24:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 08:24:01.634184 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d6968d-7d6d-42d7-b7cc-09db6dc18c88 None None] Authenticating user token {{(pid=207601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:24:01.645294 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee49b9e-1cc4-4481-890c-41aad3a42d0e None None] Validating token access rules against request {{(pid=207600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:24:01.652844 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG dbcounter [-] [207600] Writing DB stats keystone:SELECT=100 {{(pid=207600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:24:01.686210 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3929fe8-bca4-476a-a9f3-86ae9f5d8227 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:24:01.686922 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3929fe8-bca4-476a-a9f3-86ae9f5d8227 None admin] REQUEST_METHOD: `GET` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:24:01.687166 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3929fe8-bca4-476a-a9f3-86ae9f5d8227 None admin] SCRIPT_NAME: `/identity` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:24:01.687451 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3929fe8-bca4-476a-a9f3-86ae9f5d8227 None admin] PATH_INFO: `/v3/roles/member` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:24:01.699377 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG dbcounter [-] [207601] Writing DB stats keystone:SELECT=100 {{(pid=207601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:24:01.700692 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3929fe8-bca4-476a-a9f3-86ae9f5d8227 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 08:24:01.705920 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application [None req-d3929fe8-bca4-476a-a9f3-86ae9f5d8227 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 28 08:24:01.705920 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:24:01.705920 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:24:01.705920 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:24:01.705920 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:24:01.705920 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:24:01.705920 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:24:01.705920 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:24:01.705920 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:24:01.705920 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:24:01.705920 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:24:01.705920 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:24:01.705920 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 08:24:01.705920 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 08:24:01.705920 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 08:24:01.705920 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 08:24:01.706948 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 08:24:01.706948 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 08:24:01.706948 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 08:24:01.706948 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 08:24:01.706948 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:24:01.706948 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:24:01.706948 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:24:01.706948 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:24:01.706948 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:24:01.706948 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:24:01.706948 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:24:01.706948 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application with Lock( Jul 28 08:24:01.706948 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:24:01.706948 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:24:01.706948 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:24:01.706948 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:24:01.707855 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:24:01.707855 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:24:01.707855 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:24:01.707855 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:24:01.707855 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 08:24:01.707855 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 08:24:01.707855 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 08:24:01.707855 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 08:24:01.707855 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 08:24:01.707855 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 08:24:01.707855 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 28 08:24:01.707855 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application Jul 28 08:24:01.707855 dv-cinder-851351-1-smb devstack@keystone.service[207600]: [pid: 207600|app: 0|req: 178/357] 10.222.0.42 () {56 vars in 1099 bytes} [Thu Jul 28 08:24:01 2022] GET /identity/v3/roles/member => generated 84 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:24:01.708698 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3929fe8-bca4-476a-a9f3-86ae9f5d8227 None admin] Authenticating user token {{(pid=207600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:24:01.774765 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d6968d-7d6d-42d7-b7cc-09db6dc18c88 None None] Validating token access rules against request {{(pid=207601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:24:01.820833 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f4fc46f-c184-47bc-b2de-dba776c44228 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:24:01.821516 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4fc46f-c184-47bc-b2de-dba776c44228 None admin] REQUEST_METHOD: `GET` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:24:01.821812 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4fc46f-c184-47bc-b2de-dba776c44228 None admin] SCRIPT_NAME: `/identity` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:24:01.822103 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4fc46f-c184-47bc-b2de-dba776c44228 None admin] PATH_INFO: `/v3/users/9070425bcdd24578950be1cf146ddc7c` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:24:01.823339 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f4fc46f-c184-47bc-b2de-dba776c44228 None admin] RBAC: Authorizing `identity:get_user(user_id=9070425bcdd24578950be1cf146ddc7c)` {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:24:01.825112 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f4fc46f-c184-47bc-b2de-dba776c44228 None admin] RBAC: Authorization granted {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:24:01.832029 dv-cinder-851351-1-smb devstack@keystone.service[207601]: [pid: 207601|app: 0|req: 180/358] 10.222.0.42 () {56 vars in 1177 bytes} [Thu Jul 28 08:24:01 2022] GET /identity/v3/users/9070425bcdd24578950be1cf146ddc7c => generated 293 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:24:01.833663 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eaa005e-c600-4570-b132-f24238078b3b None None] REQUEST_METHOD: `GET` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:24:01.834057 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eaa005e-c600-4570-b132-f24238078b3b None None] SCRIPT_NAME: `/identity` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:24:01.834434 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eaa005e-c600-4570-b132-f24238078b3b None None] PATH_INFO: `/` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:24:01.836082 dv-cinder-851351-1-smb devstack@keystone.service[207601]: [pid: 207601|app: 0|req: 181/359] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 08:24:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 08:24:01.840688 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eaa005e-c600-4570-b132-f24238078b3b None None] Authenticating user token {{(pid=207601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:24:01.856757 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3929fe8-bca4-476a-a9f3-86ae9f5d8227 None admin] Validating token access rules against request {{(pid=207600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:24:01.910166 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89fcfd0-134d-451c-b5ff-a58883affed3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:24:01.910166 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89fcfd0-134d-451c-b5ff-a58883affed3 None admin] REQUEST_METHOD: `GET` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:24:01.910467 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89fcfd0-134d-451c-b5ff-a58883affed3 None admin] SCRIPT_NAME: `/identity` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:24:01.910717 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89fcfd0-134d-451c-b5ff-a58883affed3 None admin] PATH_INFO: `/v3/groups/648e35db40964d1baaa9a887e8198e50` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:24:01.914663 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d89fcfd0-134d-451c-b5ff-a58883affed3 None admin] RBAC: Authorizing `identity:get_group(group_id=648e35db40964d1baaa9a887e8198e50)` {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:24:01.914663 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d89fcfd0-134d-451c-b5ff-a58883affed3 None admin] RBAC: Authorization granted {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:24:01.917074 dv-cinder-851351-1-smb devstack@keystone.service[207600]: [pid: 207600|app: 0|req: 179/360] 10.222.0.42 () {56 vars in 1180 bytes} [Thu Jul 28 08:24:01 2022] GET /identity/v3/groups/648e35db40964d1baaa9a887e8198e50 => generated 226 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:24:01.917074 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89fcfd0-134d-451c-b5ff-a58883affed3 None admin] Authenticating user token {{(pid=207600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:24:01.960529 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG dbcounter [-] [207600] Writing DB stats keystone:SELECT=100 {{(pid=207600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:24:01.986430 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eaa005e-c600-4570-b132-f24238078b3b None None] Validating token access rules against request {{(pid=207601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:24:02.019355 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG dbcounter [-] [207601] Writing DB stats keystone:SELECT=100 {{(pid=207601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:24:02.039574 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62b9be4-fa20-4535-bfa2-536f1650a110 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:24:02.041278 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62b9be4-fa20-4535-bfa2-536f1650a110 None admin] REQUEST_METHOD: `GET` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:24:02.041865 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62b9be4-fa20-4535-bfa2-536f1650a110 None admin] SCRIPT_NAME: `/identity` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:24:02.042140 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62b9be4-fa20-4535-bfa2-536f1650a110 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:24:02.054675 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e62b9be4-fa20-4535-bfa2-536f1650a110 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 08:24:02.059953 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application [None req-e62b9be4-fa20-4535-bfa2-536f1650a110 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 28 08:24:02.059953 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:24:02.059953 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:24:02.059953 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:24:02.059953 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:24:02.059953 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:24:02.059953 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:24:02.059953 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:24:02.059953 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:24:02.059953 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:24:02.059953 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:24:02.059953 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:24:02.059953 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 08:24:02.059953 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 08:24:02.059953 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 08:24:02.059953 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 08:24:02.061036 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 08:24:02.061036 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 08:24:02.061036 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 08:24:02.061036 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 08:24:02.061036 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:24:02.061036 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:24:02.061036 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:24:02.061036 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:24:02.061036 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:24:02.061036 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:24:02.061036 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:24:02.061036 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application with Lock( Jul 28 08:24:02.061036 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:24:02.061036 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:24:02.061036 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:24:02.061036 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:24:02.062360 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:24:02.062360 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:24:02.062360 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:24:02.062360 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:24:02.062360 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 08:24:02.062360 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 08:24:02.062360 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 08:24:02.062360 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 08:24:02.062360 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 08:24:02.062360 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 08:24:02.062360 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 28 08:24:02.062360 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application Jul 28 08:24:02.063041 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89fcfd0-134d-451c-b5ff-a58883affed3 None admin] Validating token access rules against request {{(pid=207600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:24:02.063120 dv-cinder-851351-1-smb devstack@keystone.service[207601]: [pid: 207601|app: 0|req: 182/361] 10.222.0.42 () {56 vars in 1114 bytes} [Thu Jul 28 08:24:01 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:24:02.063120 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62b9be4-fa20-4535-bfa2-536f1650a110 None admin] Authenticating user token {{(pid=207601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:24:02.115334 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f72a832-2af3-473d-a6a8-039038fa9f3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:24:02.116093 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f72a832-2af3-473d-a6a8-039038fa9f3e None admin] REQUEST_METHOD: `GET` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:24:02.116450 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f72a832-2af3-473d-a6a8-039038fa9f3e None admin] SCRIPT_NAME: `/identity` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:24:02.116874 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f72a832-2af3-473d-a6a8-039038fa9f3e None admin] PATH_INFO: `/v3/roles` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:24:02.117831 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f72a832-2af3-473d-a6a8-039038fa9f3e None admin] RBAC: Adding query filter params (name=member) {{(pid=207600) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:24:02.118210 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f72a832-2af3-473d-a6a8-039038fa9f3e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:24:02.119741 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f72a832-2af3-473d-a6a8-039038fa9f3e None admin] RBAC: Authorization granted {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:24:02.130316 dv-cinder-851351-1-smb devstack@keystone.service[207600]: [pid: 207600|app: 0|req: 180/362] 10.222.0.42 () {56 vars in 1101 bytes} [Thu Jul 28 08:24:01 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:24:02.135287 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6e7b7e-48a1-404e-acd3-a5e28fcee57a None None] REQUEST_METHOD: `POST` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:24:02.135287 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6e7b7e-48a1-404e-acd3-a5e28fcee57a None None] SCRIPT_NAME: `/identity` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:24:02.135287 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6e7b7e-48a1-404e-acd3-a5e28fcee57a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:24:02.154151 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.auth.core [None req-4d6e7b7e-48a1-404e-acd3-a5e28fcee57a None None] MFA Rules not processed for user `b8110ade874c4aa7af27f5c376df700a`. Rule list: `[]` (Enabled: `True`). {{(pid=207600) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 08:24:02.155389 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.fernet_utils [None req-4d6e7b7e-48a1-404e-acd3-a5e28fcee57a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=207600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:24:02.198794 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62b9be4-fa20-4535-bfa2-536f1650a110 None admin] Validating token access rules against request {{(pid=207601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:24:02.241104 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ac7617-8b70-4c79-9626-2409d534404d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:24:02.241765 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ac7617-8b70-4c79-9626-2409d534404d None admin] REQUEST_METHOD: `GET` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:24:02.242044 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ac7617-8b70-4c79-9626-2409d534404d None admin] SCRIPT_NAME: `/identity` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:24:02.242319 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ac7617-8b70-4c79-9626-2409d534404d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:24:02.243153 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ac7617-8b70-4c79-9626-2409d534404d None admin] RBAC: Adding query filter params (role.id=4af3ffd96e0540dbb20e6ccb08a61f0b, user.id=9070425bcdd24578950be1cf146ddc7c, scope.system=all) {{(pid=207601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:24:02.243462 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ac7617-8b70-4c79-9626-2409d534404d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:24:02.245029 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ac7617-8b70-4c79-9626-2409d534404d None admin] RBAC: Authorization granted {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:24:02.256899 dv-cinder-851351-1-smb devstack@keystone.service[207600]: [pid: 207600|app: 0|req: 181/363] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 08:24:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 08:24:02.258165 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6e7b7e-48a1-404e-acd3-a5e28fcee57a None None] Authenticating user token {{(pid=207600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:24:02.259623 dv-cinder-851351-1-smb devstack@keystone.service[207601]: [pid: 207601|app: 0|req: 183/364] 10.222.0.42 () {56 vars in 1308 bytes} [Thu Jul 28 08:24:02 2022] GET /identity/v3/role_assignments?user.id=9070425bcdd24578950be1cf146ddc7c&scope.system=all&role.id=4af3ffd96e0540dbb20e6ccb08a61f0b => generated 510 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:24:02.260700 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ac7617-8b70-4c79-9626-2409d534404d None admin] Authenticating user token {{(pid=207601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:24:02.319353 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG dbcounter [-] [207601] Writing DB stats keystone:SELECT=100 {{(pid=207601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:24:02.325081 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG dbcounter [-] [207600] Writing DB stats keystone:SELECT=100 {{(pid=207600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:24:02.387307 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6e7b7e-48a1-404e-acd3-a5e28fcee57a None None] Validating token access rules against request {{(pid=207600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:24:02.405342 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ac7617-8b70-4c79-9626-2409d534404d None admin] Validating token access rules against request {{(pid=207601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:24:02.429336 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afacb227-83c3-471b-8868-766adddf0952 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:24:02.429978 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afacb227-83c3-471b-8868-766adddf0952 None admin] REQUEST_METHOD: `GET` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:24:02.430360 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afacb227-83c3-471b-8868-766adddf0952 None admin] SCRIPT_NAME: `/identity` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:24:02.430792 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afacb227-83c3-471b-8868-766adddf0952 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:24:02.431774 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afacb227-83c3-471b-8868-766adddf0952 None admin] RBAC: Adding query filter params (group.id=648e35db40964d1baaa9a887e8198e50, role.id=70a2fd2878c549aeb19b16ec37e37164, scope.project.id=4a64079f46494355a0aa3aafd9a90c0c) {{(pid=207600) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:24:02.432827 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afacb227-83c3-471b-8868-766adddf0952 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:24:02.434749 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afacb227-83c3-471b-8868-766adddf0952 None admin] RBAC: Authorization granted {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:24:02.441457 dv-cinder-851351-1-smb devstack@keystone.service[207600]: [pid: 207600|app: 0|req: 182/365] 10.222.0.42 () {56 vars in 1376 bytes} [Thu Jul 28 08:24:02 2022] GET /identity/v3/role_assignments?group.id=648e35db40964d1baaa9a887e8198e50&scope.project.id=4a64079f46494355a0aa3aafd9a90c0c&role.id=70a2fd2878c549aeb19b16ec37e37164 => generated 260 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:24:02.445914 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afacb227-83c3-471b-8868-766adddf0952 None admin] Authenticating user token {{(pid=207600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:24:02.456065 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b07a0d-ccb4-494f-97c0-451a4db7dd61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:24:02.457180 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b07a0d-ccb4-494f-97c0-451a4db7dd61 None admin] REQUEST_METHOD: `GET` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:24:02.458659 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b07a0d-ccb4-494f-97c0-451a4db7dd61 None admin] SCRIPT_NAME: `/identity` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:24:02.459106 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b07a0d-ccb4-494f-97c0-451a4db7dd61 None admin] PATH_INFO: `/v3/roles` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:24:02.460027 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72b07a0d-ccb4-494f-97c0-451a4db7dd61 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=207601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:24:02.460491 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72b07a0d-ccb4-494f-97c0-451a4db7dd61 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:24:02.462122 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72b07a0d-ccb4-494f-97c0-451a4db7dd61 None admin] RBAC: Authorization granted {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:24:02.473834 dv-cinder-851351-1-smb devstack@keystone.service[207601]: [pid: 207601|app: 0|req: 184/366] 10.222.0.42 () {56 vars in 1111 bytes} [Thu Jul 28 08:24:02 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:24:02.475473 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b07a0d-ccb4-494f-97c0-451a4db7dd61 None admin] Authenticating user token {{(pid=207601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:24:02.622006 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG dbcounter [-] [207600] Writing DB stats keystone:SELECT=100 {{(pid=207600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:24:02.633566 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afacb227-83c3-471b-8868-766adddf0952 None admin] Validating token access rules against request {{(pid=207600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:24:02.636311 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b07a0d-ccb4-494f-97c0-451a4db7dd61 None admin] Validating token access rules against request {{(pid=207601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:24:02.638706 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG dbcounter [-] [207601] Writing DB stats keystone:SELECT=100 {{(pid=207601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:24:02.688746 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1bda833-a7a5-4e54-baf9-635cc0c132fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:24:02.688746 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1bda833-a7a5-4e54-baf9-635cc0c132fa None admin] REQUEST_METHOD: `GET` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:24:02.688746 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1bda833-a7a5-4e54-baf9-635cc0c132fa None admin] SCRIPT_NAME: `/identity` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:24:02.688746 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1bda833-a7a5-4e54-baf9-635cc0c132fa None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:24:02.689201 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5cbbdb3-f438-48d9-b488-c4aea3c1392c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:24:02.689201 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5cbbdb3-f438-48d9-b488-c4aea3c1392c None admin] REQUEST_METHOD: `GET` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:24:02.689201 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5cbbdb3-f438-48d9-b488-c4aea3c1392c None admin] SCRIPT_NAME: `/identity` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:24:02.689201 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5cbbdb3-f438-48d9-b488-c4aea3c1392c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:24:02.703303 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5cbbdb3-f438-48d9-b488-c4aea3c1392c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 08:24:02.710712 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application [None req-e5cbbdb3-f438-48d9-b488-c4aea3c1392c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 08:24:02.710712 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:24:02.710712 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:24:02.710712 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:24:02.710712 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:24:02.710712 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:24:02.710712 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:24:02.710712 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:24:02.710712 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:24:02.710712 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:24:02.710712 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:24:02.710712 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:24:02.710712 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 08:24:02.710712 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 08:24:02.710712 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 08:24:02.710712 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 08:24:02.711744 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 08:24:02.711744 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 08:24:02.711744 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 08:24:02.711744 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 08:24:02.711744 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:24:02.711744 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:24:02.711744 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:24:02.711744 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:24:02.711744 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:24:02.711744 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:24:02.711744 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:24:02.711744 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application with Lock( Jul 28 08:24:02.711744 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:24:02.711744 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:24:02.711744 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:24:02.711744 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:24:02.712647 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:24:02.712647 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:24:02.712647 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:24:02.712647 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:24:02.712647 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 08:24:02.712647 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 08:24:02.712647 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 08:24:02.712647 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 08:24:02.712647 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 08:24:02.712647 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 08:24:02.712647 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 08:24:02.712647 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application Jul 28 08:24:02.712647 dv-cinder-851351-1-smb devstack@keystone.service[207601]: [pid: 207601|app: 0|req: 185/367] 10.222.0.42 () {56 vars in 1096 bytes} [Thu Jul 28 08:24:02 2022] GET /identity/v3/roles/admin => generated 83 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:24:02.713435 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5cbbdb3-f438-48d9-b488-c4aea3c1392c None admin] Authenticating user token {{(pid=207601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:24:02.784027 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1bda833-a7a5-4e54-baf9-635cc0c132fa None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:24:02.785585 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1bda833-a7a5-4e54-baf9-635cc0c132fa None admin] RBAC: Authorization granted {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:24:02.834970 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5cbbdb3-f438-48d9-b488-c4aea3c1392c None admin] Validating token access rules against request {{(pid=207601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:24:02.877938 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-275de8eb-9e3d-4869-99f9-7a881d025e9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:24:02.878517 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275de8eb-9e3d-4869-99f9-7a881d025e9f None admin] REQUEST_METHOD: `GET` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:24:02.878804 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275de8eb-9e3d-4869-99f9-7a881d025e9f None admin] SCRIPT_NAME: `/identity` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:24:02.879082 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275de8eb-9e3d-4869-99f9-7a881d025e9f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:24:02.914522 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG dbcounter [-] [207600] Writing DB stats keystone:SELECT=100 {{(pid=207600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:24:02.927923 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG dbcounter [-] [207601] Writing DB stats keystone:SELECT=100 {{(pid=207601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:24:02.933479 dv-cinder-851351-1-smb devstack@keystone.service[207600]: [pid: 207600|app: 0|req: 183/368] 10.222.0.42 () {58 vars in 1282 bytes} [Thu Jul 28 08:24:02 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 487 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 28 08:24:02.933479 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1bda833-a7a5-4e54-baf9-635cc0c132fa None admin] Authenticating user token {{(pid=207600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:24:03.001770 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-275de8eb-9e3d-4869-99f9-7a881d025e9f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:24:03.004422 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-275de8eb-9e3d-4869-99f9-7a881d025e9f None admin] RBAC: Authorization granted {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:24:03.069815 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1bda833-a7a5-4e54-baf9-635cc0c132fa None admin] Validating token access rules against request {{(pid=207600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:24:03.107523 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aaa8c16-8667-4155-8eed-e648b8e37577 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:24:03.108333 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aaa8c16-8667-4155-8eed-e648b8e37577 None admin] REQUEST_METHOD: `GET` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:24:03.108624 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aaa8c16-8667-4155-8eed-e648b8e37577 None admin] SCRIPT_NAME: `/identity` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:24:03.109058 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aaa8c16-8667-4155-8eed-e648b8e37577 None admin] PATH_INFO: `/v3/roles` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:24:03.109883 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aaa8c16-8667-4155-8eed-e648b8e37577 None admin] RBAC: Adding query filter params (name=admin) {{(pid=207600) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:24:03.110198 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aaa8c16-8667-4155-8eed-e648b8e37577 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:24:03.111872 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aaa8c16-8667-4155-8eed-e648b8e37577 None admin] RBAC: Authorization granted {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:24:03.124466 dv-cinder-851351-1-smb devstack@keystone.service[207600]: [pid: 207600|app: 0|req: 184/369] 10.222.0.42 () {56 vars in 1099 bytes} [Thu Jul 28 08:24:02 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:24:03.124466 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aaa8c16-8667-4155-8eed-e648b8e37577 None admin] Authenticating user token {{(pid=207600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:24:03.144191 dv-cinder-851351-1-smb devstack@keystone.service[207601]: [pid: 207601|app: 0|req: 186/370] 10.222.0.42 () {58 vars in 1282 bytes} [Thu Jul 28 08:24:02 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 427 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 28 08:24:03.145557 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-275de8eb-9e3d-4869-99f9-7a881d025e9f None admin] Authenticating user token {{(pid=207601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:24:03.197123 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG dbcounter [-] [207600] Writing DB stats keystone:SELECT=100 {{(pid=207600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:24:03.221449 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG dbcounter [-] [207601] Writing DB stats keystone:SELECT=100 {{(pid=207601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:24:03.255041 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aaa8c16-8667-4155-8eed-e648b8e37577 None admin] Validating token access rules against request {{(pid=207600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:24:03.275646 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-275de8eb-9e3d-4869-99f9-7a881d025e9f None admin] Validating token access rules against request {{(pid=207601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:24:03.298923 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbed356a-d378-41a6-827f-c0ece1ddb6a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:24:03.300066 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbed356a-d378-41a6-827f-c0ece1ddb6a5 None admin] REQUEST_METHOD: `GET` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:24:03.300563 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbed356a-d378-41a6-827f-c0ece1ddb6a5 None admin] SCRIPT_NAME: `/identity` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:24:03.301106 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbed356a-d378-41a6-827f-c0ece1ddb6a5 None admin] PATH_INFO: `/v3/projects/4a9d64056e4a4c2f805643b31ac7e061` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:24:03.302593 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbed356a-d378-41a6-827f-c0ece1ddb6a5 None admin] RBAC: Authorizing `identity:get_project(project_id=4a9d64056e4a4c2f805643b31ac7e061)` {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:24:03.304309 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbed356a-d378-41a6-827f-c0ece1ddb6a5 None admin] RBAC: Authorization granted {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:24:03.308312 dv-cinder-851351-1-smb devstack@keystone.service[207600]: [pid: 207600|app: 0|req: 185/371] 10.222.0.42 () {56 vars in 1186 bytes} [Thu Jul 28 08:24:03 2022] GET /identity/v3/projects/4a9d64056e4a4c2f805643b31ac7e061 => generated 302 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:24:03.309478 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbed356a-d378-41a6-827f-c0ece1ddb6a5 None admin] Authenticating user token {{(pid=207600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:24:03.324383 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e219fb-b2c5-4a20-a1a5-aeed3f96b980 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:24:03.325129 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e219fb-b2c5-4a20-a1a5-aeed3f96b980 None admin] REQUEST_METHOD: `GET` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:24:03.325424 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e219fb-b2c5-4a20-a1a5-aeed3f96b980 None admin] SCRIPT_NAME: `/identity` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:24:03.325713 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e219fb-b2c5-4a20-a1a5-aeed3f96b980 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:24:03.414165 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92e219fb-b2c5-4a20-a1a5-aeed3f96b980 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:24:03.415572 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92e219fb-b2c5-4a20-a1a5-aeed3f96b980 None admin] RBAC: Authorization granted {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:24:03.440302 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbed356a-d378-41a6-827f-c0ece1ddb6a5 None admin] Validating token access rules against request {{(pid=207600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:24:03.473181 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG dbcounter [-] [207600] Writing DB stats keystone:SELECT=100 {{(pid=207600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:24:03.485326 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6f9eaf-b9da-487c-9493-c3397889c28c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:24:03.486002 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6f9eaf-b9da-487c-9493-c3397889c28c None admin] REQUEST_METHOD: `GET` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:24:03.486296 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6f9eaf-b9da-487c-9493-c3397889c28c None admin] SCRIPT_NAME: `/identity` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:24:03.486581 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6f9eaf-b9da-487c-9493-c3397889c28c None admin] PATH_INFO: `/v3/projects/4a9d64056e4a4c2f805643b31ac7e061` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:24:03.490344 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a6f9eaf-b9da-487c-9493-c3397889c28c None admin] RBAC: Authorizing `identity:get_project(project_id=4a9d64056e4a4c2f805643b31ac7e061)` {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:24:03.492002 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a6f9eaf-b9da-487c-9493-c3397889c28c None admin] RBAC: Authorization granted {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:24:03.498445 dv-cinder-851351-1-smb devstack@keystone.service[207600]: [pid: 207600|app: 0|req: 186/372] 10.222.0.42 () {56 vars in 1186 bytes} [Thu Jul 28 08:24:03 2022] GET /identity/v3/projects/4a9d64056e4a4c2f805643b31ac7e061 => generated 302 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:24:03.498445 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6f9eaf-b9da-487c-9493-c3397889c28c None admin] Authenticating user token {{(pid=207600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:24:03.500482 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG dbcounter [-] [207601] Writing DB stats keystone:SELECT=100 {{(pid=207601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:24:03.563468 dv-cinder-851351-1-smb devstack@keystone.service[207601]: [pid: 207601|app: 0|req: 187/373] 10.222.0.42 () {58 vars in 1282 bytes} [Thu Jul 28 08:24:03 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 418 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 28 08:24:03.564294 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e219fb-b2c5-4a20-a1a5-aeed3f96b980 None admin] Authenticating user token {{(pid=207601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:24:03.645143 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6f9eaf-b9da-487c-9493-c3397889c28c None admin] Validating token access rules against request {{(pid=207600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:24:03.694406 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6acc126f-1221-4c53-bc01-5304eb36d20f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:24:03.695287 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6acc126f-1221-4c53-bc01-5304eb36d20f None admin] REQUEST_METHOD: `GET` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:24:03.695908 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6acc126f-1221-4c53-bc01-5304eb36d20f None admin] SCRIPT_NAME: `/identity` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:24:03.696204 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6acc126f-1221-4c53-bc01-5304eb36d20f None admin] PATH_INFO: `/v3/groups/648e35db40964d1baaa9a887e8198e50` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:24:03.697540 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6acc126f-1221-4c53-bc01-5304eb36d20f None admin] RBAC: Authorizing `identity:get_group(group_id=648e35db40964d1baaa9a887e8198e50)` {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:24:03.698992 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6acc126f-1221-4c53-bc01-5304eb36d20f None admin] RBAC: Authorization granted {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:24:03.701105 dv-cinder-851351-1-smb devstack@keystone.service[207600]: [pid: 207600|app: 0|req: 187/374] 10.222.0.42 () {56 vars in 1180 bytes} [Thu Jul 28 08:24:03 2022] GET /identity/v3/groups/648e35db40964d1baaa9a887e8198e50 => generated 226 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:24:03.701508 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e219fb-b2c5-4a20-a1a5-aeed3f96b980 None admin] Validating token access rules against request {{(pid=207601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:24:03.701928 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6acc126f-1221-4c53-bc01-5304eb36d20f None admin] Authenticating user token {{(pid=207600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:24:03.745657 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf2474e-98dd-4020-ab61-784e9f035b5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:24:03.746857 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf2474e-98dd-4020-ab61-784e9f035b5a None admin] REQUEST_METHOD: `GET` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:24:03.747431 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf2474e-98dd-4020-ab61-784e9f035b5a None admin] SCRIPT_NAME: `/identity` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:24:03.747915 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf2474e-98dd-4020-ab61-784e9f035b5a None admin] PATH_INFO: `/v3/groups/648e35db40964d1baaa9a887e8198e50` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:24:03.749538 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcf2474e-98dd-4020-ab61-784e9f035b5a None admin] RBAC: Authorizing `identity:get_group(group_id=648e35db40964d1baaa9a887e8198e50)` {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:24:03.751160 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcf2474e-98dd-4020-ab61-784e9f035b5a None admin] RBAC: Authorization granted {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:24:03.753132 dv-cinder-851351-1-smb devstack@keystone.service[207601]: [pid: 207601|app: 0|req: 188/375] 10.222.0.42 () {56 vars in 1180 bytes} [Thu Jul 28 08:24:03 2022] GET /identity/v3/groups/648e35db40964d1baaa9a887e8198e50 => generated 226 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:24:03.754533 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6184c3-8a9a-4106-9bf7-9624fd71a911 None None] REQUEST_METHOD: `GET` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:24:03.754824 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6184c3-8a9a-4106-9bf7-9624fd71a911 None None] SCRIPT_NAME: `/identity` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:24:03.755100 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6184c3-8a9a-4106-9bf7-9624fd71a911 None None] PATH_INFO: `/` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:24:03.756649 dv-cinder-851351-1-smb devstack@keystone.service[207601]: [pid: 207601|app: 0|req: 189/376] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 08:24:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 08:24:03.757287 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f6184c3-8a9a-4106-9bf7-9624fd71a911 None None] Authenticating user token {{(pid=207601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:24:03.796980 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG dbcounter [-] [207600] Writing DB stats keystone:SELECT=100 {{(pid=207600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:24:03.801180 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG dbcounter [-] [207601] Writing DB stats keystone:SELECT=100 {{(pid=207601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:24:03.854510 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6acc126f-1221-4c53-bc01-5304eb36d20f None admin] Validating token access rules against request {{(pid=207600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:24:03.901037 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f6184c3-8a9a-4106-9bf7-9624fd71a911 None None] Validating token access rules against request {{(pid=207601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:24:03.911619 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9a207a-c3da-4a97-977c-68f63fd63363 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:24:03.912389 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9a207a-c3da-4a97-977c-68f63fd63363 None admin] REQUEST_METHOD: `GET` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:24:03.912737 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9a207a-c3da-4a97-977c-68f63fd63363 None admin] SCRIPT_NAME: `/identity` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:24:03.912994 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9a207a-c3da-4a97-977c-68f63fd63363 None admin] PATH_INFO: `/v3/projects/ce031eecc2864701bc87b5b179ea31ec` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:24:03.914406 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa9a207a-c3da-4a97-977c-68f63fd63363 None admin] RBAC: Authorizing `identity:get_project(project_id=ce031eecc2864701bc87b5b179ea31ec)` {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:24:03.915905 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa9a207a-c3da-4a97-977c-68f63fd63363 None admin] RBAC: Authorization granted {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:24:03.918196 dv-cinder-851351-1-smb devstack@keystone.service[207600]: [pid: 207600|app: 0|req: 188/377] 10.222.0.42 () {56 vars in 1186 bytes} [Thu Jul 28 08:24:03 2022] GET /identity/v3/projects/ce031eecc2864701bc87b5b179ea31ec => generated 344 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:24:03.919149 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9a207a-c3da-4a97-977c-68f63fd63363 None admin] Authenticating user token {{(pid=207600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:24:03.945714 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc6c913-e5c0-4c9e-b5da-082c8af52eb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:24:03.946336 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc6c913-e5c0-4c9e-b5da-082c8af52eb6 None admin] REQUEST_METHOD: `GET` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:24:03.946472 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc6c913-e5c0-4c9e-b5da-082c8af52eb6 None admin] SCRIPT_NAME: `/identity` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:24:03.947562 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc6c913-e5c0-4c9e-b5da-082c8af52eb6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:24:03.947562 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afc6c913-e5c0-4c9e-b5da-082c8af52eb6 None admin] RBAC: Adding query filter params (group.id=648e35db40964d1baaa9a887e8198e50, role.id=70a2fd2878c549aeb19b16ec37e37164, scope.project.id=4a9d64056e4a4c2f805643b31ac7e061) {{(pid=207601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:24:03.947841 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afc6c913-e5c0-4c9e-b5da-082c8af52eb6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:24:03.949442 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afc6c913-e5c0-4c9e-b5da-082c8af52eb6 None admin] RBAC: Authorization granted {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:24:03.958360 dv-cinder-851351-1-smb devstack@keystone.service[207601]: [pid: 207601|app: 0|req: 190/378] 10.222.0.42 () {56 vars in 1376 bytes} [Thu Jul 28 08:24:03 2022] GET /identity/v3/role_assignments?group.id=648e35db40964d1baaa9a887e8198e50&scope.project.id=4a9d64056e4a4c2f805643b31ac7e061&role.id=70a2fd2878c549aeb19b16ec37e37164 => generated 260 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:24:03.959751 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6391c59b-5306-4b29-92d2-83b546669fb0 None None] REQUEST_METHOD: `POST` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:24:03.960048 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6391c59b-5306-4b29-92d2-83b546669fb0 None None] SCRIPT_NAME: `/identity` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:24:03.960332 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6391c59b-5306-4b29-92d2-83b546669fb0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:24:03.981341 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.auth.core [None req-6391c59b-5306-4b29-92d2-83b546669fb0 None None] MFA Rules not processed for user `b8110ade874c4aa7af27f5c376df700a`. Rule list: `[]` (Enabled: `True`). {{(pid=207601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 08:24:03.982742 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.fernet_utils [None req-6391c59b-5306-4b29-92d2-83b546669fb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=207601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:24:04.063722 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9a207a-c3da-4a97-977c-68f63fd63363 None admin] Validating token access rules against request {{(pid=207600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:24:04.101450 dv-cinder-851351-1-smb devstack@keystone.service[207601]: [pid: 207601|app: 0|req: 191/379] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 08:24:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 08:24:04.102927 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6391c59b-5306-4b29-92d2-83b546669fb0 None None] Authenticating user token {{(pid=207601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:24:04.106823 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG dbcounter [-] [207600] Writing DB stats keystone:SELECT=100 {{(pid=207600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:24:04.123065 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9990103-df5c-4e83-9450-871ae867e26c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:24:04.124188 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9990103-df5c-4e83-9450-871ae867e26c None admin] REQUEST_METHOD: `GET` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:24:04.124732 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9990103-df5c-4e83-9450-871ae867e26c None admin] SCRIPT_NAME: `/identity` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:24:04.125202 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9990103-df5c-4e83-9450-871ae867e26c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:24:04.126364 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9990103-df5c-4e83-9450-871ae867e26c None admin] RBAC: Adding query filter params (group.id=648e35db40964d1baaa9a887e8198e50, role.id=e617201b25d44cb1844c9f28bcac91fb, scope.project.id=4a9d64056e4a4c2f805643b31ac7e061) {{(pid=207600) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:24:04.126893 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9990103-df5c-4e83-9450-871ae867e26c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:24:04.128703 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9990103-df5c-4e83-9450-871ae867e26c None admin] RBAC: Authorization granted {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:24:04.137991 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG dbcounter [-] [207601] Writing DB stats keystone:SELECT=100 {{(pid=207601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:24:04.140870 dv-cinder-851351-1-smb devstack@keystone.service[207600]: [pid: 207600|app: 0|req: 189/380] 10.222.0.42 () {56 vars in 1376 bytes} [Thu Jul 28 08:24:03 2022] GET /identity/v3/role_assignments?group.id=648e35db40964d1baaa9a887e8198e50&scope.project.id=4a9d64056e4a4c2f805643b31ac7e061&role.id=e617201b25d44cb1844c9f28bcac91fb => generated 260 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:24:04.148643 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9990103-df5c-4e83-9450-871ae867e26c None admin] Authenticating user token {{(pid=207600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:24:04.270074 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6391c59b-5306-4b29-92d2-83b546669fb0 None None] Validating token access rules against request {{(pid=207601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:24:04.315380 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b410e2b0-9445-4187-a42c-ecc6f5e6b88e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:24:04.316058 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b410e2b0-9445-4187-a42c-ecc6f5e6b88e None admin] REQUEST_METHOD: `GET` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:24:04.316338 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b410e2b0-9445-4187-a42c-ecc6f5e6b88e None admin] SCRIPT_NAME: `/identity` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:24:04.316452 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9990103-df5c-4e83-9450-871ae867e26c None admin] Validating token access rules against request {{(pid=207600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:24:04.316652 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b410e2b0-9445-4187-a42c-ecc6f5e6b88e None admin] PATH_INFO: `/v3/groups/5ac8509edd914c048d0c8a4daed171b2` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:24:04.333448 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b410e2b0-9445-4187-a42c-ecc6f5e6b88e None admin] RBAC: Authorizing `identity:get_group(group_id=5ac8509edd914c048d0c8a4daed171b2)` {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:24:04.334963 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b410e2b0-9445-4187-a42c-ecc6f5e6b88e None admin] RBAC: Authorization granted {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:24:04.338095 dv-cinder-851351-1-smb devstack@keystone.service[207601]: [pid: 207601|app: 0|req: 192/381] 10.222.0.42 () {56 vars in 1180 bytes} [Thu Jul 28 08:24:04 2022] GET /identity/v3/groups/5ac8509edd914c048d0c8a4daed171b2 => generated 229 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:24:04.343218 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b410e2b0-9445-4187-a42c-ecc6f5e6b88e None admin] Authenticating user token {{(pid=207601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:24:04.379778 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-349e717e-5543-4b64-a787-5a9f40417554 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:24:04.380452 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349e717e-5543-4b64-a787-5a9f40417554 None admin] REQUEST_METHOD: `GET` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:24:04.380775 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349e717e-5543-4b64-a787-5a9f40417554 None admin] SCRIPT_NAME: `/identity` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:24:04.381053 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349e717e-5543-4b64-a787-5a9f40417554 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:24:04.396931 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-349e717e-5543-4b64-a787-5a9f40417554 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 08:24:04.402758 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application [None req-349e717e-5543-4b64-a787-5a9f40417554 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 28 08:24:04.402758 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:24:04.402758 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:24:04.402758 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:24:04.402758 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:24:04.402758 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:24:04.402758 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:24:04.402758 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:24:04.402758 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:24:04.402758 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:24:04.402758 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:24:04.402758 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:24:04.402758 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 08:24:04.402758 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 08:24:04.402758 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 08:24:04.402758 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 08:24:04.403869 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 08:24:04.403869 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 08:24:04.403869 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 08:24:04.403869 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 08:24:04.403869 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:24:04.403869 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:24:04.403869 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:24:04.403869 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:24:04.403869 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:24:04.403869 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:24:04.403869 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:24:04.403869 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application with Lock( Jul 28 08:24:04.403869 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:24:04.403869 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:24:04.403869 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:24:04.403869 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:24:04.404848 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:24:04.404848 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:24:04.404848 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:24:04.404848 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:24:04.404848 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 08:24:04.404848 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 08:24:04.404848 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 08:24:04.404848 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 08:24:04.404848 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 08:24:04.404848 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 08:24:04.404848 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 28 08:24:04.404848 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application Jul 28 08:24:04.405593 dv-cinder-851351-1-smb devstack@keystone.service[207600]: [pid: 207600|app: 0|req: 190/382] 10.222.0.42 () {56 vars in 1114 bytes} [Thu Jul 28 08:24:04 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 257 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 08:24:04.413262 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-349e717e-5543-4b64-a787-5a9f40417554 None admin] Authenticating user token {{(pid=207600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:24:04.486697 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG dbcounter [-] [207600] Writing DB stats keystone:SELECT=100 {{(pid=207600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:24:04.494224 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG dbcounter [-] [207601] Writing DB stats keystone:SELECT=100 {{(pid=207601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:24:04.510772 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b410e2b0-9445-4187-a42c-ecc6f5e6b88e None admin] Validating token access rules against request {{(pid=207601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:24:04.557646 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-145101b4-7e96-46b9-92a9-a0126d7779fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:24:04.559250 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145101b4-7e96-46b9-92a9-a0126d7779fc None admin] REQUEST_METHOD: `GET` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:24:04.559747 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145101b4-7e96-46b9-92a9-a0126d7779fc None admin] SCRIPT_NAME: `/identity` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:24:04.560227 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145101b4-7e96-46b9-92a9-a0126d7779fc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:24:04.560985 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-349e717e-5543-4b64-a787-5a9f40417554 None admin] Validating token access rules against request {{(pid=207600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:24:04.561557 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-145101b4-7e96-46b9-92a9-a0126d7779fc None admin] RBAC: Adding query filter params (group.id=5ac8509edd914c048d0c8a4daed171b2, role.id=d0ce88034c6b41878db755343f5840be, scope.project.id=ce031eecc2864701bc87b5b179ea31ec) {{(pid=207601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:24:04.562089 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-145101b4-7e96-46b9-92a9-a0126d7779fc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:24:04.564858 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-145101b4-7e96-46b9-92a9-a0126d7779fc None admin] RBAC: Authorization granted {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:24:04.573377 dv-cinder-851351-1-smb devstack@keystone.service[207601]: [pid: 207601|app: 0|req: 193/383] 10.222.0.42 () {56 vars in 1376 bytes} [Thu Jul 28 08:24:04 2022] GET /identity/v3/role_assignments?group.id=5ac8509edd914c048d0c8a4daed171b2&scope.project.id=ce031eecc2864701bc87b5b179ea31ec&role.id=d0ce88034c6b41878db755343f5840be => generated 260 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:24:04.609464 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb0a32b-228a-4d5f-a64b-0e9564660233 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:24:04.610560 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb0a32b-228a-4d5f-a64b-0e9564660233 None admin] REQUEST_METHOD: `GET` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:24:04.611062 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb0a32b-228a-4d5f-a64b-0e9564660233 None admin] SCRIPT_NAME: `/identity` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:24:04.611562 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb0a32b-228a-4d5f-a64b-0e9564660233 None admin] PATH_INFO: `/v3/roles` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:24:04.612563 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eb0a32b-228a-4d5f-a64b-0e9564660233 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=207600) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:24:04.613197 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eb0a32b-228a-4d5f-a64b-0e9564660233 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:24:04.614880 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eb0a32b-228a-4d5f-a64b-0e9564660233 None admin] RBAC: Authorization granted {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:24:04.625002 dv-cinder-851351-1-smb devstack@keystone.service[207600]: [pid: 207600|app: 0|req: 191/384] 10.222.0.42 () {56 vars in 1111 bytes} [Thu Jul 28 08:24:04 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:24:04.630530 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-145101b4-7e96-46b9-92a9-a0126d7779fc None admin] Authenticating user token {{(pid=207601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:24:04.760579 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-145101b4-7e96-46b9-92a9-a0126d7779fc None admin] Validating token access rules against request {{(pid=207601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:24:04.800476 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff7279b3-90f4-44d2-88eb-4706d75b7761 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:24:04.801602 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7279b3-90f4-44d2-88eb-4706d75b7761 None admin] REQUEST_METHOD: `GET` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:24:04.802106 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7279b3-90f4-44d2-88eb-4706d75b7761 None admin] SCRIPT_NAME: `/identity` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:24:04.802599 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7279b3-90f4-44d2-88eb-4706d75b7761 None admin] PATH_INFO: `/v3/groups/648e35db40964d1baaa9a887e8198e50` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:24:04.804134 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff7279b3-90f4-44d2-88eb-4706d75b7761 None admin] RBAC: Authorizing `identity:get_group(group_id=648e35db40964d1baaa9a887e8198e50)` {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:24:04.805967 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff7279b3-90f4-44d2-88eb-4706d75b7761 None admin] RBAC: Authorization granted {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:24:04.808337 dv-cinder-851351-1-smb devstack@keystone.service[207601]: [pid: 207601|app: 0|req: 194/385] 10.222.0.42 () {56 vars in 1180 bytes} [Thu Jul 28 08:24:04 2022] GET /identity/v3/groups/648e35db40964d1baaa9a887e8198e50 => generated 226 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:24:04.813813 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb0a32b-228a-4d5f-a64b-0e9564660233 None admin] Authenticating user token {{(pid=207600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:24:04.919271 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4c536a-1cd8-4d7f-ad93-429c507d8b11 None None] REQUEST_METHOD: `GET` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:24:04.919634 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4c536a-1cd8-4d7f-ad93-429c507d8b11 None None] SCRIPT_NAME: `/identity` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:24:04.919834 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4c536a-1cd8-4d7f-ad93-429c507d8b11 None None] PATH_INFO: `/` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:24:04.921379 dv-cinder-851351-1-smb devstack@keystone.service[207601]: [pid: 207601|app: 0|req: 195/386] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 08:24:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 28 08:24:04.932927 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a90838a-a51e-4e67-a793-6f787bd13212 None None] REQUEST_METHOD: `POST` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:24:04.933261 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a90838a-a51e-4e67-a793-6f787bd13212 None None] SCRIPT_NAME: `/identity` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:24:04.933581 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a90838a-a51e-4e67-a793-6f787bd13212 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:24:04.967333 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.auth.core [None req-0a90838a-a51e-4e67-a793-6f787bd13212 None None] MFA Rules not processed for user `b8110ade874c4aa7af27f5c376df700a`. Rule list: `[]` (Enabled: `True`). {{(pid=207601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 08:24:04.968576 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.fernet_utils [None req-0a90838a-a51e-4e67-a793-6f787bd13212 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=207601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:24:04.977321 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb0a32b-228a-4d5f-a64b-0e9564660233 None admin] Validating token access rules against request {{(pid=207600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:24:04.993206 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG dbcounter [-] [207601] Writing DB stats keystone:SELECT=100 {{(pid=207601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:24:04.997052 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG dbcounter [-] [207600] Writing DB stats keystone:SELECT=100 {{(pid=207600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:24:05.043417 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b5ae6f-66c8-4cfe-b828-f45e723208cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:24:05.044090 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b5ae6f-66c8-4cfe-b828-f45e723208cc None admin] REQUEST_METHOD: `GET` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:24:05.044380 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b5ae6f-66c8-4cfe-b828-f45e723208cc None admin] SCRIPT_NAME: `/identity` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:24:05.044674 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b5ae6f-66c8-4cfe-b828-f45e723208cc None admin] PATH_INFO: `/v3/projects/4a64079f46494355a0aa3aafd9a90c0c` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:24:05.048199 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4b5ae6f-66c8-4cfe-b828-f45e723208cc None admin] RBAC: Authorizing `identity:get_project(project_id=4a64079f46494355a0aa3aafd9a90c0c)` {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:24:05.049712 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4b5ae6f-66c8-4cfe-b828-f45e723208cc None admin] RBAC: Authorization granted {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:24:05.051795 dv-cinder-851351-1-smb devstack@keystone.service[207600]: [pid: 207600|app: 0|req: 192/387] 10.222.0.42 () {56 vars in 1186 bytes} [Thu Jul 28 08:24:04 2022] GET /identity/v3/projects/4a64079f46494355a0aa3aafd9a90c0c => generated 298 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:24:05.057360 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b5ae6f-66c8-4cfe-b828-f45e723208cc None admin] Authenticating user token {{(pid=207600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:24:05.097557 dv-cinder-851351-1-smb devstack@keystone.service[207601]: [pid: 207601|app: 0|req: 196/388] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 08:24:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 08:24:05.127730 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a90838a-a51e-4e67-a793-6f787bd13212 None None] Authenticating user token {{(pid=207601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:24:05.232217 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b5ae6f-66c8-4cfe-b828-f45e723208cc None admin] Validating token access rules against request {{(pid=207600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:24:05.266997 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc94d26-1a09-449e-b52c-ce5a14e504b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:24:05.267714 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc94d26-1a09-449e-b52c-ce5a14e504b9 None admin] REQUEST_METHOD: `PUT` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:24:05.267995 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc94d26-1a09-449e-b52c-ce5a14e504b9 None admin] SCRIPT_NAME: `/identity` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:24:05.268277 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc94d26-1a09-449e-b52c-ce5a14e504b9 None admin] PATH_INFO: `/v3/projects/4a64079f46494355a0aa3aafd9a90c0c/groups/648e35db40964d1baaa9a887e8198e50/roles/e617201b25d44cb1844c9f28bcac91fb` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:24:05.270498 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fc94d26-1a09-449e-b52c-ce5a14e504b9 None admin] RBAC: Authorizing `identity:create_grant(project_id=4a64079f46494355a0aa3aafd9a90c0c, group_id=648e35db40964d1baaa9a887e8198e50, role_id=e617201b25d44cb1844c9f28bcac91fb)` {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:24:05.272191 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fc94d26-1a09-449e-b52c-ce5a14e504b9 None admin] RBAC: Authorization granted {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:24:05.295073 dv-cinder-851351-1-smb devstack@keystone.service[207600]: [pid: 207600|app: 0|req: 193/389] 10.222.0.42 () {58 vars in 1442 bytes} [Thu Jul 28 08:24:05 2022] PUT /identity/v3/projects/4a64079f46494355a0aa3aafd9a90c0c/groups/648e35db40964d1baaa9a887e8198e50/roles/e617201b25d44cb1844c9f28bcac91fb => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 08:24:05.342130 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a90838a-a51e-4e67-a793-6f787bd13212 None None] Validating token access rules against request {{(pid=207601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:24:05.402508 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86bad2a1-33af-41de-91be-1d93db63ac34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:24:05.403123 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86bad2a1-33af-41de-91be-1d93db63ac34 None admin] REQUEST_METHOD: `GET` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:24:05.403474 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86bad2a1-33af-41de-91be-1d93db63ac34 None admin] SCRIPT_NAME: `/identity` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:24:05.403684 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86bad2a1-33af-41de-91be-1d93db63ac34 None admin] PATH_INFO: `/v3/roles/member` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:24:05.425480 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86bad2a1-33af-41de-91be-1d93db63ac34 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 08:24:05.430774 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application [None req-86bad2a1-33af-41de-91be-1d93db63ac34 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 28 08:24:05.430774 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:24:05.430774 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:24:05.430774 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:24:05.430774 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:24:05.430774 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:24:05.430774 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:24:05.430774 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:24:05.430774 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:24:05.430774 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:24:05.430774 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:24:05.430774 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:24:05.430774 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 08:24:05.430774 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 08:24:05.430774 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 08:24:05.430774 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 08:24:05.431785 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 08:24:05.431785 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 08:24:05.431785 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 08:24:05.431785 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 08:24:05.431785 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:24:05.431785 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:24:05.431785 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:24:05.431785 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:24:05.431785 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:24:05.431785 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:24:05.431785 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:24:05.431785 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application with Lock( Jul 28 08:24:05.431785 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:24:05.431785 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:24:05.431785 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:24:05.431785 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:24:05.432755 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:24:05.432755 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:24:05.432755 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:24:05.432755 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:24:05.432755 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 08:24:05.432755 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 08:24:05.432755 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 08:24:05.432755 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 08:24:05.432755 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 08:24:05.432755 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 08:24:05.432755 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 28 08:24:05.432755 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application Jul 28 08:24:05.432755 dv-cinder-851351-1-smb devstack@keystone.service[207601]: [pid: 207601|app: 0|req: 197/390] 10.222.0.42 () {56 vars in 1099 bytes} [Thu Jul 28 08:24:05 2022] GET /identity/v3/roles/member => generated 84 bytes in 305 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 08:24:05.440490 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc94d26-1a09-449e-b52c-ce5a14e504b9 None admin] Authenticating user token {{(pid=207600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:24:05.511987 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG dbcounter [-] [207600] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=207600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:24:05.587705 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc94d26-1a09-449e-b52c-ce5a14e504b9 None admin] Validating token access rules against request {{(pid=207600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:24:05.628184 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5518dd49-b758-47e7-8723-5213eac86be0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:24:05.628841 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5518dd49-b758-47e7-8723-5213eac86be0 None admin] REQUEST_METHOD: `GET` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:24:05.629133 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5518dd49-b758-47e7-8723-5213eac86be0 None admin] SCRIPT_NAME: `/identity` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:24:05.629415 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5518dd49-b758-47e7-8723-5213eac86be0 None admin] PATH_INFO: `/v3/roles` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:24:05.630161 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5518dd49-b758-47e7-8723-5213eac86be0 None admin] RBAC: Adding query filter params (name=member) {{(pid=207600) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:24:05.630476 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5518dd49-b758-47e7-8723-5213eac86be0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:24:05.632053 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5518dd49-b758-47e7-8723-5213eac86be0 None admin] RBAC: Authorization granted {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:24:05.641373 dv-cinder-851351-1-smb devstack@keystone.service[207600]: [pid: 207600|app: 0|req: 194/391] 10.222.0.42 () {56 vars in 1101 bytes} [Thu Jul 28 08:24:05 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:24:05.647472 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86bad2a1-33af-41de-91be-1d93db63ac34 None admin] Authenticating user token {{(pid=207601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:24:05.685992 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG dbcounter [-] [207601] Writing DB stats keystone:SELECT=100 {{(pid=207601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:24:05.821922 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86bad2a1-33af-41de-91be-1d93db63ac34 None admin] Validating token access rules against request {{(pid=207601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:24:05.879274 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7abb5d36-9060-40c3-a435-15c6dc307b93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:24:05.879951 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abb5d36-9060-40c3-a435-15c6dc307b93 None admin] REQUEST_METHOD: `GET` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:24:05.880246 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abb5d36-9060-40c3-a435-15c6dc307b93 None admin] SCRIPT_NAME: `/identity` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:24:05.880524 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abb5d36-9060-40c3-a435-15c6dc307b93 None admin] PATH_INFO: `/v3/groups/648e35db40964d1baaa9a887e8198e50` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:24:05.881790 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7abb5d36-9060-40c3-a435-15c6dc307b93 None admin] RBAC: Authorizing `identity:get_group(group_id=648e35db40964d1baaa9a887e8198e50)` {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:24:05.883281 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7abb5d36-9060-40c3-a435-15c6dc307b93 None admin] RBAC: Authorization granted {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:24:05.885286 dv-cinder-851351-1-smb devstack@keystone.service[207601]: [pid: 207601|app: 0|req: 198/392] 10.222.0.42 () {56 vars in 1180 bytes} [Thu Jul 28 08:24:05 2022] GET /identity/v3/groups/648e35db40964d1baaa9a887e8198e50 => generated 226 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:24:05.890841 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5518dd49-b758-47e7-8723-5213eac86be0 None admin] Authenticating user token {{(pid=207600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:24:06.013873 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG dbcounter [-] [207600] Writing DB stats keystone:SELECT=100 {{(pid=207600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:24:06.024088 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5518dd49-b758-47e7-8723-5213eac86be0 None admin] Validating token access rules against request {{(pid=207600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:24:06.074717 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e39071-3eae-4460-8e61-c42a7aa788f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:24:06.075383 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e39071-3eae-4460-8e61-c42a7aa788f7 None admin] REQUEST_METHOD: `GET` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:24:06.075668 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e39071-3eae-4460-8e61-c42a7aa788f7 None admin] SCRIPT_NAME: `/identity` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:24:06.075945 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e39071-3eae-4460-8e61-c42a7aa788f7 None admin] PATH_INFO: `/v3/projects/4a64079f46494355a0aa3aafd9a90c0c` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:24:06.077153 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7e39071-3eae-4460-8e61-c42a7aa788f7 None admin] RBAC: Authorizing `identity:get_project(project_id=4a64079f46494355a0aa3aafd9a90c0c)` {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:24:06.078620 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7e39071-3eae-4460-8e61-c42a7aa788f7 None admin] RBAC: Authorization granted {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:24:06.080737 dv-cinder-851351-1-smb devstack@keystone.service[207600]: [pid: 207600|app: 0|req: 195/393] 10.222.0.42 () {56 vars in 1186 bytes} [Thu Jul 28 08:24:05 2022] GET /identity/v3/projects/4a64079f46494355a0aa3aafd9a90c0c => generated 298 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:24:06.086492 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7abb5d36-9060-40c3-a435-15c6dc307b93 None admin] Authenticating user token {{(pid=207601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:24:06.222386 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG dbcounter [-] [207601] Writing DB stats keystone:SELECT=100 {{(pid=207601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:24:06.247019 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7abb5d36-9060-40c3-a435-15c6dc307b93 None admin] Validating token access rules against request {{(pid=207601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:24:06.283252 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03c222a-66d1-47e5-9f1d-793adfab6564 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:24:06.284311 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03c222a-66d1-47e5-9f1d-793adfab6564 None admin] REQUEST_METHOD: `PUT` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:24:06.284941 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03c222a-66d1-47e5-9f1d-793adfab6564 None admin] SCRIPT_NAME: `/identity` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:24:06.285436 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03c222a-66d1-47e5-9f1d-793adfab6564 None admin] PATH_INFO: `/v3/projects/4a64079f46494355a0aa3aafd9a90c0c/groups/648e35db40964d1baaa9a887e8198e50/roles/70a2fd2878c549aeb19b16ec37e37164` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:24:06.287645 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c03c222a-66d1-47e5-9f1d-793adfab6564 None admin] RBAC: Authorizing `identity:create_grant(project_id=4a64079f46494355a0aa3aafd9a90c0c, group_id=648e35db40964d1baaa9a887e8198e50, role_id=70a2fd2878c549aeb19b16ec37e37164)` {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:24:06.289364 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c03c222a-66d1-47e5-9f1d-793adfab6564 None admin] RBAC: Authorization granted {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:24:06.303675 dv-cinder-851351-1-smb devstack@keystone.service[207601]: [pid: 207601|app: 0|req: 199/394] 10.222.0.42 () {58 vars in 1442 bytes} [Thu Jul 28 08:24:06 2022] PUT /identity/v3/projects/4a64079f46494355a0aa3aafd9a90c0c/groups/648e35db40964d1baaa9a887e8198e50/roles/70a2fd2878c549aeb19b16ec37e37164 => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 08:24:06.562074 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396e7d56-b6ca-4e6f-aed4-2a2f79fa08a2 None None] REQUEST_METHOD: `GET` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:24:06.562591 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396e7d56-b6ca-4e6f-aed4-2a2f79fa08a2 None None] SCRIPT_NAME: `/identity` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:24:06.562591 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396e7d56-b6ca-4e6f-aed4-2a2f79fa08a2 None None] PATH_INFO: `/` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:24:06.564110 dv-cinder-851351-1-smb devstack@keystone.service[207600]: [pid: 207600|app: 0|req: 196/395] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 08:24:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 08:24:06.570902 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c300c992-655e-4fec-87a3-677531323b03 None None] REQUEST_METHOD: `POST` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:24:06.571207 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c300c992-655e-4fec-87a3-677531323b03 None None] SCRIPT_NAME: `/identity` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:24:06.571466 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c300c992-655e-4fec-87a3-677531323b03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:24:06.590966 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.auth.core [None req-c300c992-655e-4fec-87a3-677531323b03 None None] MFA Rules not processed for user `b8110ade874c4aa7af27f5c376df700a`. Rule list: `[]` (Enabled: `True`). {{(pid=207601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 08:24:06.592174 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.fernet_utils [None req-c300c992-655e-4fec-87a3-677531323b03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=207601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:24:06.687389 dv-cinder-851351-1-smb devstack@keystone.service[207601]: [pid: 207601|app: 0|req: 200/396] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 08:24:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 08:24:06.725076 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-396e7d56-b6ca-4e6f-aed4-2a2f79fa08a2 None None] Authenticating user token {{(pid=207600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:24:06.867811 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-396e7d56-b6ca-4e6f-aed4-2a2f79fa08a2 None None] Validating token access rules against request {{(pid=207600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:24:06.922807 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5206960b-ddcc-4de1-ac67-faee4b820a0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:24:06.923470 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5206960b-ddcc-4de1-ac67-faee4b820a0e None admin] REQUEST_METHOD: `GET` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:24:06.923751 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5206960b-ddcc-4de1-ac67-faee4b820a0e None admin] SCRIPT_NAME: `/identity` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:24:06.924026 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5206960b-ddcc-4de1-ac67-faee4b820a0e None admin] PATH_INFO: `/v3/roles/member` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:24:06.945576 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5206960b-ddcc-4de1-ac67-faee4b820a0e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 08:24:06.951218 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application [None req-5206960b-ddcc-4de1-ac67-faee4b820a0e None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 28 08:24:06.951218 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:24:06.951218 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:24:06.951218 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:24:06.951218 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:24:06.951218 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:24:06.951218 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:24:06.951218 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:24:06.951218 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:24:06.951218 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:24:06.951218 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:24:06.951218 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:24:06.951218 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 08:24:06.951218 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 08:24:06.951218 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 08:24:06.951218 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 08:24:06.952236 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 08:24:06.952236 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 08:24:06.952236 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 08:24:06.952236 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 08:24:06.952236 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:24:06.952236 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:24:06.952236 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:24:06.952236 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:24:06.952236 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:24:06.952236 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:24:06.952236 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:24:06.952236 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application with Lock( Jul 28 08:24:06.952236 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:24:06.952236 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:24:06.952236 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:24:06.952236 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:24:06.953171 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:24:06.953171 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:24:06.953171 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:24:06.953171 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:24:06.953171 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 08:24:06.953171 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 08:24:06.953171 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 08:24:06.953171 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 08:24:06.953171 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 08:24:06.953171 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 08:24:06.953171 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 28 08:24:06.953171 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application Jul 28 08:24:06.953171 dv-cinder-851351-1-smb devstack@keystone.service[207600]: [pid: 207600|app: 0|req: 197/397] 10.222.0.42 () {56 vars in 1099 bytes} [Thu Jul 28 08:24:06 2022] GET /identity/v3/roles/member => generated 84 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:24:06.958777 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c300c992-655e-4fec-87a3-677531323b03 None None] Authenticating user token {{(pid=207601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:24:07.090666 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG dbcounter [-] [207601] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=207601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:24:07.133462 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c300c992-655e-4fec-87a3-677531323b03 None None] Validating token access rules against request {{(pid=207601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:24:07.164952 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bee93a4-14a6-4e2e-8a54-e748845ff5e9 None None] REQUEST_METHOD: `GET` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:24:07.165297 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bee93a4-14a6-4e2e-8a54-e748845ff5e9 None None] SCRIPT_NAME: `/identity` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:24:07.165516 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bee93a4-14a6-4e2e-8a54-e748845ff5e9 None None] PATH_INFO: `/` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:24:07.168367 dv-cinder-851351-1-smb devstack@keystone.service[207600]: [pid: 207600|app: 0|req: 198/398] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 08:24:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 08:24:07.173149 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d013a8f-5e94-47c3-85fb-dff0a9e9cba1 None None] REQUEST_METHOD: `POST` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:24:07.173430 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d013a8f-5e94-47c3-85fb-dff0a9e9cba1 None None] SCRIPT_NAME: `/identity` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:24:07.173706 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d013a8f-5e94-47c3-85fb-dff0a9e9cba1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:24:07.198477 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2743d559-1366-4b4f-994d-ac662c64b4c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:24:07.199166 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2743d559-1366-4b4f-994d-ac662c64b4c0 None admin] REQUEST_METHOD: `GET` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:24:07.199448 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2743d559-1366-4b4f-994d-ac662c64b4c0 None admin] SCRIPT_NAME: `/identity` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:24:07.199723 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2743d559-1366-4b4f-994d-ac662c64b4c0 None admin] PATH_INFO: `/v3/roles` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:24:07.200460 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2743d559-1366-4b4f-994d-ac662c64b4c0 None admin] RBAC: Adding query filter params (name=member) {{(pid=207601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:24:07.200787 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2743d559-1366-4b4f-994d-ac662c64b4c0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:24:07.202176 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2743d559-1366-4b4f-994d-ac662c64b4c0 None admin] RBAC: Authorization granted {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:24:07.204376 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.auth.core [None req-1d013a8f-5e94-47c3-85fb-dff0a9e9cba1 None None] MFA Rules not processed for user `b8110ade874c4aa7af27f5c376df700a`. Rule list: `[]` (Enabled: `True`). {{(pid=207600) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 08:24:07.205617 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.fernet_utils [None req-1d013a8f-5e94-47c3-85fb-dff0a9e9cba1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=207600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:24:07.227837 dv-cinder-851351-1-smb devstack@keystone.service[207601]: [pid: 207601|app: 0|req: 201/399] 10.222.0.42 () {56 vars in 1101 bytes} [Thu Jul 28 08:24:06 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:24:07.229437 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2743d559-1366-4b4f-994d-ac662c64b4c0 None admin] Authenticating user token {{(pid=207601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:24:07.264886 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG dbcounter [-] [207600] Writing DB stats keystone:SELECT=100 {{(pid=207600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:24:07.324221 dv-cinder-851351-1-smb devstack@keystone.service[207600]: [pid: 207600|app: 0|req: 199/400] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 08:24:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 28 08:24:07.325931 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31c97e0-791c-485d-8e8c-94b1f295fcac None None] REQUEST_METHOD: `GET` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:24:07.326457 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31c97e0-791c-485d-8e8c-94b1f295fcac None None] SCRIPT_NAME: `/identity` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:24:07.326946 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31c97e0-791c-485d-8e8c-94b1f295fcac None None] PATH_INFO: `/` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:24:07.328434 dv-cinder-851351-1-smb devstack@keystone.service[207600]: [pid: 207600|app: 0|req: 200/401] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 08:24:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 08:24:07.333943 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71224a19-7740-40a4-8107-5b2cf05685e3 None None] REQUEST_METHOD: `POST` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:24:07.334482 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71224a19-7740-40a4-8107-5b2cf05685e3 None None] SCRIPT_NAME: `/identity` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:24:07.334987 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71224a19-7740-40a4-8107-5b2cf05685e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:24:07.362920 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.auth.core [None req-71224a19-7740-40a4-8107-5b2cf05685e3 None None] MFA Rules not processed for user `b8110ade874c4aa7af27f5c376df700a`. Rule list: `[]` (Enabled: `True`). {{(pid=207600) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 08:24:07.364128 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.fernet_utils [None req-71224a19-7740-40a4-8107-5b2cf05685e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=207600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:24:07.369285 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2743d559-1366-4b4f-994d-ac662c64b4c0 None admin] Validating token access rules against request {{(pid=207601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:24:07.409701 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG dbcounter [-] [207601] Writing DB stats keystone:SELECT=100 {{(pid=207601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:24:07.416416 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e81f792-fc9c-4e19-badb-3edef4dfe7e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:24:07.417379 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e81f792-fc9c-4e19-badb-3edef4dfe7e1 None admin] REQUEST_METHOD: `GET` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:24:07.418816 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e81f792-fc9c-4e19-badb-3edef4dfe7e1 None admin] SCRIPT_NAME: `/identity` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:24:07.419263 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e81f792-fc9c-4e19-badb-3edef4dfe7e1 None admin] PATH_INFO: `/v3/groups/648e35db40964d1baaa9a887e8198e50` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:24:07.420602 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e81f792-fc9c-4e19-badb-3edef4dfe7e1 None admin] RBAC: Authorizing `identity:get_group(group_id=648e35db40964d1baaa9a887e8198e50)` {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:24:07.422296 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e81f792-fc9c-4e19-badb-3edef4dfe7e1 None admin] RBAC: Authorization granted {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:24:07.424157 dv-cinder-851351-1-smb devstack@keystone.service[207601]: [pid: 207601|app: 0|req: 202/402] 10.222.0.42 () {56 vars in 1180 bytes} [Thu Jul 28 08:24:07 2022] GET /identity/v3/groups/648e35db40964d1baaa9a887e8198e50 => generated 226 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 08:24:07.429565 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e81f792-fc9c-4e19-badb-3edef4dfe7e1 None admin] Authenticating user token {{(pid=207601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:24:07.442760 dv-cinder-851351-1-smb devstack@keystone.service[207600]: [pid: 207600|app: 0|req: 201/403] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 08:24:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 08:24:07.443643 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71224a19-7740-40a4-8107-5b2cf05685e3 None None] Authenticating user token {{(pid=207600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:24:07.563507 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG dbcounter [-] [207600] Writing DB stats keystone:SELECT=100 {{(pid=207600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:24:07.569389 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e81f792-fc9c-4e19-badb-3edef4dfe7e1 None admin] Validating token access rules against request {{(pid=207601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:24:07.580876 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71224a19-7740-40a4-8107-5b2cf05685e3 None None] Validating token access rules against request {{(pid=207600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:24:07.617117 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8098a2e8-a373-459b-9481-756c138a8594 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:24:07.617919 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8098a2e8-a373-459b-9481-756c138a8594 None admin] REQUEST_METHOD: `GET` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:24:07.618309 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8098a2e8-a373-459b-9481-756c138a8594 None admin] SCRIPT_NAME: `/identity` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:24:07.618622 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8098a2e8-a373-459b-9481-756c138a8594 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:24:07.620333 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8224e8b1-9564-4421-bb82-d62169b755b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:24:07.621525 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8224e8b1-9564-4421-bb82-d62169b755b3 None admin] REQUEST_METHOD: `GET` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:24:07.622053 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8224e8b1-9564-4421-bb82-d62169b755b3 None admin] SCRIPT_NAME: `/identity` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:24:07.622537 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8224e8b1-9564-4421-bb82-d62169b755b3 None admin] PATH_INFO: `/v3/projects/4a9d64056e4a4c2f805643b31ac7e061` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:24:07.624073 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8224e8b1-9564-4421-bb82-d62169b755b3 None admin] RBAC: Authorizing `identity:get_project(project_id=4a9d64056e4a4c2f805643b31ac7e061)` {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:24:07.625946 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8224e8b1-9564-4421-bb82-d62169b755b3 None admin] RBAC: Authorization granted {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:24:07.632877 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8098a2e8-a373-459b-9481-756c138a8594 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 08:24:07.633232 dv-cinder-851351-1-smb devstack@keystone.service[207600]: [pid: 207600|app: 0|req: 202/404] 10.222.0.42 () {56 vars in 1186 bytes} [Thu Jul 28 08:24:07 2022] GET /identity/v3/projects/4a9d64056e4a4c2f805643b31ac7e061 => generated 302 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:24:07.634316 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8224e8b1-9564-4421-bb82-d62169b755b3 None admin] Authenticating user token {{(pid=207600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:24:07.635639 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application [None req-8098a2e8-a373-459b-9481-756c138a8594 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 28 08:24:07.635639 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:24:07.635639 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:24:07.635639 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:24:07.635639 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:24:07.635639 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:24:07.635639 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:24:07.635639 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:24:07.635639 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:24:07.635639 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:24:07.635639 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:24:07.635639 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:24:07.635639 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 08:24:07.635639 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 08:24:07.635639 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 08:24:07.635639 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 08:24:07.636689 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 08:24:07.636689 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 08:24:07.636689 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 08:24:07.636689 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 08:24:07.636689 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:24:07.636689 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:24:07.636689 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:24:07.636689 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:24:07.636689 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:24:07.636689 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:24:07.636689 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:24:07.636689 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application with Lock( Jul 28 08:24:07.636689 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:24:07.636689 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:24:07.636689 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:24:07.636689 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:24:07.641585 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:24:07.641585 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:24:07.641585 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:24:07.641585 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:24:07.641585 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 08:24:07.641585 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 08:24:07.641585 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 08:24:07.641585 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 08:24:07.641585 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 08:24:07.641585 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 08:24:07.641585 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 28 08:24:07.641585 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application Jul 28 08:24:07.641585 dv-cinder-851351-1-smb devstack@keystone.service[207601]: [pid: 207601|app: 0|req: 203/405] 10.222.0.42 () {56 vars in 1114 bytes} [Thu Jul 28 08:24:07 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:24:07.641585 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8098a2e8-a373-459b-9481-756c138a8594 None admin] Authenticating user token {{(pid=207601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:24:07.711753 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG dbcounter [-] [207601] Writing DB stats keystone:SELECT=100 {{(pid=207601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:24:07.754228 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8224e8b1-9564-4421-bb82-d62169b755b3 None admin] Validating token access rules against request {{(pid=207600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:24:07.760127 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8098a2e8-a373-459b-9481-756c138a8594 None admin] Validating token access rules against request {{(pid=207601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:24:07.792702 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42d07ad-5c45-42d4-9a62-2cef5bc7f02f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:24:07.793371 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42d07ad-5c45-42d4-9a62-2cef5bc7f02f None admin] REQUEST_METHOD: `GET` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:24:07.793712 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42d07ad-5c45-42d4-9a62-2cef5bc7f02f None admin] SCRIPT_NAME: `/identity` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:24:07.793991 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42d07ad-5c45-42d4-9a62-2cef5bc7f02f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:24:07.795745 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9416f896-6d05-4f86-b365-a479be02a5a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:24:07.796528 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9416f896-6d05-4f86-b365-a479be02a5a9 None admin] REQUEST_METHOD: `PUT` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:24:07.796843 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9416f896-6d05-4f86-b365-a479be02a5a9 None admin] SCRIPT_NAME: `/identity` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:24:07.797124 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9416f896-6d05-4f86-b365-a479be02a5a9 None admin] PATH_INFO: `/v3/projects/4a9d64056e4a4c2f805643b31ac7e061/groups/648e35db40964d1baaa9a887e8198e50/roles/70a2fd2878c549aeb19b16ec37e37164` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:24:07.799129 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9416f896-6d05-4f86-b365-a479be02a5a9 None admin] RBAC: Authorizing `identity:create_grant(project_id=4a9d64056e4a4c2f805643b31ac7e061, group_id=648e35db40964d1baaa9a887e8198e50, role_id=70a2fd2878c549aeb19b16ec37e37164)` {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:24:07.800617 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9416f896-6d05-4f86-b365-a479be02a5a9 None admin] RBAC: Authorization granted {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:24:07.805992 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e42d07ad-5c45-42d4-9a62-2cef5bc7f02f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 08:24:07.811273 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application [None req-e42d07ad-5c45-42d4-9a62-2cef5bc7f02f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 08:24:07.811273 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:24:07.811273 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:24:07.811273 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:24:07.811273 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:24:07.811273 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:24:07.811273 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:24:07.811273 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:24:07.811273 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:24:07.811273 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:24:07.811273 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:24:07.811273 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:24:07.811273 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 08:24:07.811273 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 08:24:07.811273 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 08:24:07.811273 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 08:24:07.812499 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 08:24:07.812499 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 08:24:07.812499 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 08:24:07.812499 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 08:24:07.812499 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:24:07.812499 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:24:07.812499 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:24:07.812499 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:24:07.812499 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:24:07.812499 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:24:07.812499 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:24:07.812499 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application with Lock( Jul 28 08:24:07.812499 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:24:07.812499 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:24:07.812499 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:24:07.812499 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:24:07.813627 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:24:07.813627 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:24:07.813627 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:24:07.813627 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:24:07.813627 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 08:24:07.813627 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 08:24:07.813627 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 08:24:07.813627 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 08:24:07.813627 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 08:24:07.813627 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 08:24:07.813627 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 08:24:07.813627 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application Jul 28 08:24:07.817284 dv-cinder-851351-1-smb devstack@keystone.service[207600]: [pid: 207600|app: 0|req: 203/406] 10.222.0.42 () {56 vars in 1096 bytes} [Thu Jul 28 08:24:07 2022] GET /identity/v3/roles/admin => generated 83 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:24:07.818142 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42d07ad-5c45-42d4-9a62-2cef5bc7f02f None admin] Authenticating user token {{(pid=207600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:24:07.824802 dv-cinder-851351-1-smb devstack@keystone.service[207601]: [pid: 207601|app: 0|req: 204/407] 10.222.0.42 () {58 vars in 1442 bytes} [Thu Jul 28 08:24:07 2022] PUT /identity/v3/projects/4a9d64056e4a4c2f805643b31ac7e061/groups/648e35db40964d1baaa9a887e8198e50/roles/70a2fd2878c549aeb19b16ec37e37164 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 28 08:24:07.824802 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92df8f64-ee6b-48c5-9e6d-7b0673da48a7 None None] REQUEST_METHOD: `GET` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:24:07.824802 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92df8f64-ee6b-48c5-9e6d-7b0673da48a7 None None] SCRIPT_NAME: `/identity` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:24:07.824802 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92df8f64-ee6b-48c5-9e6d-7b0673da48a7 None None] PATH_INFO: `/` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:24:07.824802 dv-cinder-851351-1-smb devstack@keystone.service[207601]: [pid: 207601|app: 0|req: 205/408] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 08:24:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 08:24:07.824802 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92df8f64-ee6b-48c5-9e6d-7b0673da48a7 None None] Authenticating user token {{(pid=207601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:24:07.850608 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG dbcounter [-] [207600] Writing DB stats keystone:SELECT=100 {{(pid=207600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:24:07.969738 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42d07ad-5c45-42d4-9a62-2cef5bc7f02f None admin] Validating token access rules against request {{(pid=207600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:24:07.984784 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92df8f64-ee6b-48c5-9e6d-7b0673da48a7 None None] Validating token access rules against request {{(pid=207601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:24:08.009054 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG dbcounter [-] [207601] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=207601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:24:08.018914 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff33d62-f135-4035-a244-caa50e2f0d43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:24:08.019562 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff33d62-f135-4035-a244-caa50e2f0d43 None admin] REQUEST_METHOD: `GET` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:24:08.019851 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff33d62-f135-4035-a244-caa50e2f0d43 None admin] SCRIPT_NAME: `/identity` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:24:08.020128 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff33d62-f135-4035-a244-caa50e2f0d43 None admin] PATH_INFO: `/v3/roles` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:24:08.020916 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff33d62-f135-4035-a244-caa50e2f0d43 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=207600) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:24:08.021231 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff33d62-f135-4035-a244-caa50e2f0d43 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:24:08.022661 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff33d62-f135-4035-a244-caa50e2f0d43 None admin] RBAC: Authorization granted {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:24:08.032223 dv-cinder-851351-1-smb devstack@keystone.service[207600]: [pid: 207600|app: 0|req: 204/409] 10.222.0.42 () {56 vars in 1111 bytes} [Thu Jul 28 08:24:07 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:24:08.033597 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164a82d9-f95a-4e83-b501-7d21fc256c03 None None] REQUEST_METHOD: `POST` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:24:08.033726 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164a82d9-f95a-4e83-b501-7d21fc256c03 None None] SCRIPT_NAME: `/identity` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:24:08.034086 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164a82d9-f95a-4e83-b501-7d21fc256c03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:24:08.038504 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2a9f90-30cf-4da6-8db2-ca0ca4440287 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:24:08.039152 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2a9f90-30cf-4da6-8db2-ca0ca4440287 None admin] REQUEST_METHOD: `GET` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:24:08.039448 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2a9f90-30cf-4da6-8db2-ca0ca4440287 None admin] SCRIPT_NAME: `/identity` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:24:08.039720 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2a9f90-30cf-4da6-8db2-ca0ca4440287 None admin] PATH_INFO: `/v3/roles` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:24:08.040724 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c2a9f90-30cf-4da6-8db2-ca0ca4440287 None admin] RBAC: Adding query filter params (name=admin) {{(pid=207601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:24:08.041936 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c2a9f90-30cf-4da6-8db2-ca0ca4440287 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:24:08.043382 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c2a9f90-30cf-4da6-8db2-ca0ca4440287 None admin] RBAC: Authorization granted {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:24:08.051986 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.auth.core [None req-164a82d9-f95a-4e83-b501-7d21fc256c03 None None] MFA Rules not processed for user `b8110ade874c4aa7af27f5c376df700a`. Rule list: `[]` (Enabled: `True`). {{(pid=207600) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 08:24:08.053238 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.fernet_utils [None req-164a82d9-f95a-4e83-b501-7d21fc256c03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=207600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:24:08.053870 dv-cinder-851351-1-smb devstack@keystone.service[207601]: [pid: 207601|app: 0|req: 206/410] 10.222.0.42 () {56 vars in 1099 bytes} [Thu Jul 28 08:24:07 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:24:08.054734 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2a9f90-30cf-4da6-8db2-ca0ca4440287 None admin] Authenticating user token {{(pid=207601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:24:08.137181 dv-cinder-851351-1-smb devstack@keystone.service[207600]: [pid: 207600|app: 0|req: 205/411] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 08:24:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 08:24:08.138138 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-164a82d9-f95a-4e83-b501-7d21fc256c03 None None] Authenticating user token {{(pid=207600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:24:08.163146 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG dbcounter [-] [207600] Writing DB stats keystone:SELECT=100 {{(pid=207600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:24:08.198496 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2a9f90-30cf-4da6-8db2-ca0ca4440287 None admin] Validating token access rules against request {{(pid=207601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:24:08.238448 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf910eb-3e7d-4931-8030-fb21accba17c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:24:08.239039 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf910eb-3e7d-4931-8030-fb21accba17c None admin] REQUEST_METHOD: `GET` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:24:08.239327 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf910eb-3e7d-4931-8030-fb21accba17c None admin] SCRIPT_NAME: `/identity` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:24:08.239607 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf910eb-3e7d-4931-8030-fb21accba17c None admin] PATH_INFO: `/v3/groups/648e35db40964d1baaa9a887e8198e50` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:24:08.241043 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cf910eb-3e7d-4931-8030-fb21accba17c None admin] RBAC: Authorizing `identity:get_group(group_id=648e35db40964d1baaa9a887e8198e50)` {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:24:08.242447 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cf910eb-3e7d-4931-8030-fb21accba17c None admin] RBAC: Authorization granted {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:24:08.244448 dv-cinder-851351-1-smb devstack@keystone.service[207601]: [pid: 207601|app: 0|req: 207/412] 10.222.0.42 () {56 vars in 1180 bytes} [Thu Jul 28 08:24:08 2022] GET /identity/v3/groups/648e35db40964d1baaa9a887e8198e50 => generated 226 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:24:08.245285 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf910eb-3e7d-4931-8030-fb21accba17c None admin] Authenticating user token {{(pid=207601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:24:08.285440 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-164a82d9-f95a-4e83-b501-7d21fc256c03 None None] Validating token access rules against request {{(pid=207600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:24:08.312630 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG dbcounter [-] [207601] Writing DB stats keystone:SELECT=100 {{(pid=207601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:24:08.323393 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6cd52c-2014-47a6-8ef8-42b5b16255db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:24:08.324014 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6cd52c-2014-47a6-8ef8-42b5b16255db None admin] REQUEST_METHOD: `GET` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:24:08.324304 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6cd52c-2014-47a6-8ef8-42b5b16255db None admin] SCRIPT_NAME: `/identity` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:24:08.324587 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6cd52c-2014-47a6-8ef8-42b5b16255db None admin] PATH_INFO: `/v3/groups/5ac8509edd914c048d0c8a4daed171b2` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:24:08.325827 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b6cd52c-2014-47a6-8ef8-42b5b16255db None admin] RBAC: Authorizing `identity:get_group(group_id=5ac8509edd914c048d0c8a4daed171b2)` {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:24:08.327305 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b6cd52c-2014-47a6-8ef8-42b5b16255db None admin] RBAC: Authorization granted {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:24:08.333474 dv-cinder-851351-1-smb devstack@keystone.service[207600]: [pid: 207600|app: 0|req: 206/413] 10.222.0.42 () {56 vars in 1180 bytes} [Thu Jul 28 08:24:08 2022] GET /identity/v3/groups/5ac8509edd914c048d0c8a4daed171b2 => generated 229 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:24:08.333474 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6cd52c-2014-47a6-8ef8-42b5b16255db None admin] Authenticating user token {{(pid=207600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:24:08.390874 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf910eb-3e7d-4931-8030-fb21accba17c None admin] Validating token access rules against request {{(pid=207601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:24:08.415710 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG dbcounter [-] [207600] Writing DB stats keystone:SELECT=100 {{(pid=207600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:24:08.440152 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72420070-0fba-472c-9258-533f8b0e42d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:24:08.441142 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72420070-0fba-472c-9258-533f8b0e42d9 None admin] REQUEST_METHOD: `GET` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:24:08.441596 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72420070-0fba-472c-9258-533f8b0e42d9 None admin] SCRIPT_NAME: `/identity` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:24:08.441907 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6cd52c-2014-47a6-8ef8-42b5b16255db None admin] Validating token access rules against request {{(pid=207600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:24:08.442210 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72420070-0fba-472c-9258-533f8b0e42d9 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:24:08.461313 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72420070-0fba-472c-9258-533f8b0e42d9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 08:24:08.468718 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application [None req-72420070-0fba-472c-9258-533f8b0e42d9 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 28 08:24:08.468718 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:24:08.468718 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:24:08.468718 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:24:08.468718 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:24:08.468718 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:24:08.468718 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:24:08.468718 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:24:08.468718 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:24:08.468718 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:24:08.468718 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:24:08.468718 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:24:08.468718 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 08:24:08.468718 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 08:24:08.468718 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 08:24:08.468718 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 08:24:08.469936 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 08:24:08.469936 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 08:24:08.469936 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 08:24:08.469936 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 08:24:08.469936 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:24:08.469936 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:24:08.469936 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:24:08.469936 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:24:08.469936 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:24:08.469936 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:24:08.469936 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:24:08.469936 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application with Lock( Jul 28 08:24:08.469936 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:24:08.469936 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:24:08.469936 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:24:08.469936 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:24:08.471010 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:24:08.471010 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:24:08.471010 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:24:08.471010 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:24:08.471010 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 08:24:08.471010 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 08:24:08.471010 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 08:24:08.471010 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 08:24:08.471010 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 08:24:08.471010 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 08:24:08.471010 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 28 08:24:08.471010 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application Jul 28 08:24:08.478705 dv-cinder-851351-1-smb devstack@keystone.service[207601]: [pid: 207601|app: 0|req: 208/414] 10.222.0.42 () {56 vars in 1114 bytes} [Thu Jul 28 08:24:08 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:24:08.478705 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72420070-0fba-472c-9258-533f8b0e42d9 None admin] Authenticating user token {{(pid=207601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:24:08.489109 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf43140-9dd5-493d-9feb-a4a5d7438d8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:24:08.490439 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf43140-9dd5-493d-9feb-a4a5d7438d8f None admin] REQUEST_METHOD: `GET` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:24:08.490954 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf43140-9dd5-493d-9feb-a4a5d7438d8f None admin] SCRIPT_NAME: `/identity` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:24:08.491768 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf43140-9dd5-493d-9feb-a4a5d7438d8f None admin] PATH_INFO: `/v3/projects/4a9d64056e4a4c2f805643b31ac7e061` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:24:08.493531 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baf43140-9dd5-493d-9feb-a4a5d7438d8f None admin] RBAC: Authorizing `identity:get_project(project_id=4a9d64056e4a4c2f805643b31ac7e061)` {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:24:08.495761 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baf43140-9dd5-493d-9feb-a4a5d7438d8f None admin] RBAC: Authorization granted {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:24:08.498345 dv-cinder-851351-1-smb devstack@keystone.service[207600]: [pid: 207600|app: 0|req: 207/415] 10.222.0.42 () {56 vars in 1186 bytes} [Thu Jul 28 08:24:08 2022] GET /identity/v3/projects/4a9d64056e4a4c2f805643b31ac7e061 => generated 302 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:24:08.499421 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf43140-9dd5-493d-9feb-a4a5d7438d8f None admin] Authenticating user token {{(pid=207600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:24:08.593037 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72420070-0fba-472c-9258-533f8b0e42d9 None admin] Validating token access rules against request {{(pid=207601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:24:08.603353 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG dbcounter [-] [207601] Writing DB stats keystone:SELECT=100 {{(pid=207601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:24:08.629547 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf43140-9dd5-493d-9feb-a4a5d7438d8f None admin] Validating token access rules against request {{(pid=207600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:24:08.632526 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7f6aeb-53bf-46c3-a6ae-e9c06b222525 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:24:08.633432 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7f6aeb-53bf-46c3-a6ae-e9c06b222525 None admin] REQUEST_METHOD: `GET` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:24:08.633720 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7f6aeb-53bf-46c3-a6ae-e9c06b222525 None admin] SCRIPT_NAME: `/identity` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:24:08.634058 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7f6aeb-53bf-46c3-a6ae-e9c06b222525 None admin] PATH_INFO: `/v3/projects/ce031eecc2864701bc87b5b179ea31ec` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:24:08.635296 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa7f6aeb-53bf-46c3-a6ae-e9c06b222525 None admin] RBAC: Authorizing `identity:get_project(project_id=ce031eecc2864701bc87b5b179ea31ec)` {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:24:08.636878 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa7f6aeb-53bf-46c3-a6ae-e9c06b222525 None admin] RBAC: Authorization granted {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:24:08.644186 dv-cinder-851351-1-smb devstack@keystone.service[207601]: [pid: 207601|app: 0|req: 209/416] 10.222.0.42 () {56 vars in 1186 bytes} [Thu Jul 28 08:24:08 2022] GET /identity/v3/projects/ce031eecc2864701bc87b5b179ea31ec => generated 344 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:24:08.644186 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7f6aeb-53bf-46c3-a6ae-e9c06b222525 None admin] Authenticating user token {{(pid=207601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:24:08.669355 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd41eaf-d8f4-43a8-b4bc-f7aad9f4ab74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:24:08.669994 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd41eaf-d8f4-43a8-b4bc-f7aad9f4ab74 None admin] REQUEST_METHOD: `GET` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:24:08.670297 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd41eaf-d8f4-43a8-b4bc-f7aad9f4ab74 None admin] SCRIPT_NAME: `/identity` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:24:08.670545 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd41eaf-d8f4-43a8-b4bc-f7aad9f4ab74 None admin] PATH_INFO: `/v3/roles` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:24:08.671477 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd41eaf-d8f4-43a8-b4bc-f7aad9f4ab74 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=207600) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:24:08.671591 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd41eaf-d8f4-43a8-b4bc-f7aad9f4ab74 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:24:08.672974 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd41eaf-d8f4-43a8-b4bc-f7aad9f4ab74 None admin] RBAC: Authorization granted {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:24:08.686721 dv-cinder-851351-1-smb devstack@keystone.service[207600]: [pid: 207600|app: 0|req: 208/417] 10.222.0.42 () {56 vars in 1111 bytes} [Thu Jul 28 08:24:08 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:24:08.686721 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e9e135-fb6f-45de-abe8-03d77e41aefc None None] REQUEST_METHOD: `GET` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:24:08.686721 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e9e135-fb6f-45de-abe8-03d77e41aefc None None] SCRIPT_NAME: `/identity` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:24:08.686721 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e9e135-fb6f-45de-abe8-03d77e41aefc None None] PATH_INFO: `/` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:24:08.688923 dv-cinder-851351-1-smb devstack@keystone.service[207600]: [pid: 207600|app: 0|req: 209/418] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 08:24:08 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 08:24:08.689607 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e9e135-fb6f-45de-abe8-03d77e41aefc None None] Authenticating user token {{(pid=207600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:24:08.699445 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG dbcounter [-] [207600] Writing DB stats keystone:SELECT=100 {{(pid=207600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:24:08.753026 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7f6aeb-53bf-46c3-a6ae-e9c06b222525 None admin] Validating token access rules against request {{(pid=207601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:24:08.789181 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c9fe74-be2a-4459-a2a5-fc48d3970441 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:24:08.789878 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c9fe74-be2a-4459-a2a5-fc48d3970441 None admin] REQUEST_METHOD: `PUT` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:24:08.790176 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c9fe74-be2a-4459-a2a5-fc48d3970441 None admin] SCRIPT_NAME: `/identity` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:24:08.790447 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c9fe74-be2a-4459-a2a5-fc48d3970441 None admin] PATH_INFO: `/v3/projects/4a9d64056e4a4c2f805643b31ac7e061/groups/648e35db40964d1baaa9a887e8198e50/roles/e617201b25d44cb1844c9f28bcac91fb` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:24:08.792877 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26c9fe74-be2a-4459-a2a5-fc48d3970441 None admin] RBAC: Authorizing `identity:create_grant(project_id=4a9d64056e4a4c2f805643b31ac7e061, group_id=648e35db40964d1baaa9a887e8198e50, role_id=e617201b25d44cb1844c9f28bcac91fb)` {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:24:08.794350 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26c9fe74-be2a-4459-a2a5-fc48d3970441 None admin] RBAC: Authorization granted {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:24:08.800986 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e9e135-fb6f-45de-abe8-03d77e41aefc None None] Validating token access rules against request {{(pid=207600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:24:08.816708 dv-cinder-851351-1-smb devstack@keystone.service[207601]: [pid: 207601|app: 0|req: 210/419] 10.222.0.42 () {58 vars in 1442 bytes} [Thu Jul 28 08:24:08 2022] PUT /identity/v3/projects/4a9d64056e4a4c2f805643b31ac7e061/groups/648e35db40964d1baaa9a887e8198e50/roles/e617201b25d44cb1844c9f28bcac91fb => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 08:24:08.816708 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c9fe74-be2a-4459-a2a5-fc48d3970441 None admin] Authenticating user token {{(pid=207601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:24:08.852902 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001892ae-a2bf-47ad-a059-88e1df9adb00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:24:08.854548 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001892ae-a2bf-47ad-a059-88e1df9adb00 None admin] REQUEST_METHOD: `PUT` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:24:08.854939 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001892ae-a2bf-47ad-a059-88e1df9adb00 None admin] SCRIPT_NAME: `/identity` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:24:08.855470 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001892ae-a2bf-47ad-a059-88e1df9adb00 None admin] PATH_INFO: `/v3/projects/ce031eecc2864701bc87b5b179ea31ec/groups/5ac8509edd914c048d0c8a4daed171b2/roles/d0ce88034c6b41878db755343f5840be` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:24:08.859292 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-001892ae-a2bf-47ad-a059-88e1df9adb00 None admin] RBAC: Authorizing `identity:create_grant(project_id=ce031eecc2864701bc87b5b179ea31ec, group_id=5ac8509edd914c048d0c8a4daed171b2, role_id=d0ce88034c6b41878db755343f5840be)` {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:24:08.860916 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-001892ae-a2bf-47ad-a059-88e1df9adb00 None admin] RBAC: Authorization granted {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:24:08.863496 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG dbcounter [-] [207601] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=207601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:24:08.889056 dv-cinder-851351-1-smb devstack@keystone.service[207600]: [pid: 207600|app: 0|req: 210/420] 10.222.0.42 () {58 vars in 1442 bytes} [Thu Jul 28 08:24:08 2022] PUT /identity/v3/projects/ce031eecc2864701bc87b5b179ea31ec/groups/5ac8509edd914c048d0c8a4daed171b2/roles/d0ce88034c6b41878db755343f5840be => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 08:24:08.891912 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0dc2e4-9068-402d-9523-b71697731890 None None] REQUEST_METHOD: `POST` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:24:08.892247 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0dc2e4-9068-402d-9523-b71697731890 None None] SCRIPT_NAME: `/identity` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:24:08.892532 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0dc2e4-9068-402d-9523-b71697731890 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:24:08.930524 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.auth.core [None req-9c0dc2e4-9068-402d-9523-b71697731890 None None] MFA Rules not processed for user `b8110ade874c4aa7af27f5c376df700a`. Rule list: `[]` (Enabled: `True`). {{(pid=207600) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 08:24:08.931806 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.fernet_utils [None req-9c0dc2e4-9068-402d-9523-b71697731890 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=207600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:24:09.006243 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c9fe74-be2a-4459-a2a5-fc48d3970441 None admin] Validating token access rules against request {{(pid=207601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:24:09.052153 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG dbcounter [-] [207600] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=207600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:24:09.059128 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c82ce204-a125-4342-ac57-68df5fa63610 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:24:09.061827 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82ce204-a125-4342-ac57-68df5fa63610 None admin] REQUEST_METHOD: `GET` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:24:09.062557 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82ce204-a125-4342-ac57-68df5fa63610 None admin] SCRIPT_NAME: `/identity` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:24:09.063059 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82ce204-a125-4342-ac57-68df5fa63610 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:24:09.068737 dv-cinder-851351-1-smb devstack@keystone.service[207600]: [pid: 207600|app: 0|req: 211/421] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 08:24:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 08:24:09.093498 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0dc2e4-9068-402d-9523-b71697731890 None None] Authenticating user token {{(pid=207600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:24:09.162836 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c82ce204-a125-4342-ac57-68df5fa63610 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:24:09.165312 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c82ce204-a125-4342-ac57-68df5fa63610 None admin] RBAC: Authorization granted {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:24:09.210779 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG dbcounter [-] [207601] Writing DB stats keystone:SELECT=100 {{(pid=207601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:24:09.235840 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0dc2e4-9068-402d-9523-b71697731890 None None] Validating token access rules against request {{(pid=207600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:24:09.275716 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da522dc-564f-4d42-93b5-c6f9a4d52a64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:24:09.276348 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da522dc-564f-4d42-93b5-c6f9a4d52a64 None admin] REQUEST_METHOD: `GET` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:24:09.276639 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da522dc-564f-4d42-93b5-c6f9a4d52a64 None admin] SCRIPT_NAME: `/identity` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:24:09.276995 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da522dc-564f-4d42-93b5-c6f9a4d52a64 None admin] PATH_INFO: `/v3/roles/member` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:24:09.288438 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1da522dc-564f-4d42-93b5-c6f9a4d52a64 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 08:24:09.294433 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application [None req-1da522dc-564f-4d42-93b5-c6f9a4d52a64 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 28 08:24:09.294433 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:24:09.294433 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:24:09.294433 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:24:09.294433 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:24:09.294433 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:24:09.294433 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:24:09.294433 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:24:09.294433 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:24:09.294433 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:24:09.294433 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:24:09.294433 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:24:09.294433 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 08:24:09.294433 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 08:24:09.294433 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 08:24:09.294433 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 08:24:09.295617 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 08:24:09.295617 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 08:24:09.295617 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 08:24:09.295617 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 08:24:09.295617 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:24:09.295617 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:24:09.295617 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:24:09.295617 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:24:09.295617 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:24:09.295617 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:24:09.295617 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:24:09.295617 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application with Lock( Jul 28 08:24:09.295617 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:24:09.295617 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:24:09.295617 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:24:09.295617 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:24:09.296795 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:24:09.296795 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:24:09.296795 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:24:09.296795 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:24:09.296795 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 08:24:09.296795 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 08:24:09.296795 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 08:24:09.296795 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 08:24:09.296795 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 08:24:09.296795 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 08:24:09.296795 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 28 08:24:09.296795 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application Jul 28 08:24:09.296795 dv-cinder-851351-1-smb devstack@keystone.service[207600]: [pid: 207600|app: 0|req: 212/422] 10.222.0.42 () {56 vars in 1099 bytes} [Thu Jul 28 08:24:09 2022] GET /identity/v3/roles/member => generated 84 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 08:24:09.304550 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da522dc-564f-4d42-93b5-c6f9a4d52a64 None admin] Authenticating user token {{(pid=207600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:24:09.372933 dv-cinder-851351-1-smb devstack@keystone.service[207601]: [pid: 207601|app: 0|req: 211/423] 10.222.0.42 () {58 vars in 1282 bytes} [Thu Jul 28 08:24:08 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 565 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 28 08:24:09.378765 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c82ce204-a125-4342-ac57-68df5fa63610 None admin] Authenticating user token {{(pid=207601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:24:09.426078 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG dbcounter [-] [207600] Writing DB stats keystone:SELECT=100 {{(pid=207600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:24:09.501520 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da522dc-564f-4d42-93b5-c6f9a4d52a64 None admin] Validating token access rules against request {{(pid=207600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:24:09.523630 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c82ce204-a125-4342-ac57-68df5fa63610 None admin] Validating token access rules against request {{(pid=207601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:24:09.540260 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29780694-cca4-4050-a259-48885d77768e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:24:09.541242 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29780694-cca4-4050-a259-48885d77768e None admin] REQUEST_METHOD: `GET` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:24:09.541786 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29780694-cca4-4050-a259-48885d77768e None admin] SCRIPT_NAME: `/identity` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:24:09.542251 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29780694-cca4-4050-a259-48885d77768e None admin] PATH_INFO: `/v3/roles` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:24:09.543320 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29780694-cca4-4050-a259-48885d77768e None admin] RBAC: Adding query filter params (name=member) {{(pid=207600) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:24:09.543821 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29780694-cca4-4050-a259-48885d77768e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:24:09.545470 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29780694-cca4-4050-a259-48885d77768e None admin] RBAC: Authorization granted {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:24:09.560807 dv-cinder-851351-1-smb devstack@keystone.service[207600]: [pid: 207600|app: 0|req: 213/424] 10.222.0.42 () {56 vars in 1101 bytes} [Thu Jul 28 08:24:09 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:24:09.570142 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29780694-cca4-4050-a259-48885d77768e None admin] Authenticating user token {{(pid=207600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:24:09.587601 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da8c3b5-686a-4999-950c-52610859a7af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:24:09.589065 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da8c3b5-686a-4999-950c-52610859a7af None admin] REQUEST_METHOD: `GET` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:24:09.589604 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da8c3b5-686a-4999-950c-52610859a7af None admin] SCRIPT_NAME: `/identity` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:24:09.590123 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da8c3b5-686a-4999-950c-52610859a7af None admin] PATH_INFO: `/v3/projects/4a64079f46494355a0aa3aafd9a90c0c` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:24:09.591606 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7da8c3b5-686a-4999-950c-52610859a7af None admin] RBAC: Authorizing `identity:get_project(project_id=4a64079f46494355a0aa3aafd9a90c0c)` {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:24:09.594351 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7da8c3b5-686a-4999-950c-52610859a7af None admin] RBAC: Authorization granted {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:24:09.601434 dv-cinder-851351-1-smb devstack@keystone.service[207601]: [pid: 207601|app: 0|req: 212/425] 10.222.0.42 () {56 vars in 1186 bytes} [Thu Jul 28 08:24:09 2022] GET /identity/v3/projects/4a64079f46494355a0aa3aafd9a90c0c => generated 298 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:24:09.606657 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da8c3b5-686a-4999-950c-52610859a7af None admin] Authenticating user token {{(pid=207601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:24:09.612752 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG dbcounter [-] [207601] Writing DB stats keystone:SELECT=100 {{(pid=207601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:24:09.759838 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da8c3b5-686a-4999-950c-52610859a7af None admin] Validating token access rules against request {{(pid=207601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:24:09.801424 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b744d19d-349a-4395-badf-bf27c27a6218 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:24:09.802826 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b744d19d-349a-4395-badf-bf27c27a6218 None admin] REQUEST_METHOD: `GET` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:24:09.803299 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b744d19d-349a-4395-badf-bf27c27a6218 None admin] SCRIPT_NAME: `/identity` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:24:09.803808 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b744d19d-349a-4395-badf-bf27c27a6218 None admin] PATH_INFO: `/v3/groups/648e35db40964d1baaa9a887e8198e50` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:24:09.805734 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b744d19d-349a-4395-badf-bf27c27a6218 None admin] RBAC: Authorizing `identity:get_group(group_id=648e35db40964d1baaa9a887e8198e50)` {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:24:09.807403 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b744d19d-349a-4395-badf-bf27c27a6218 None admin] RBAC: Authorization granted {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:24:09.809662 dv-cinder-851351-1-smb devstack@keystone.service[207601]: [pid: 207601|app: 0|req: 213/426] 10.222.0.42 () {56 vars in 1180 bytes} [Thu Jul 28 08:24:09 2022] GET /identity/v3/groups/648e35db40964d1baaa9a887e8198e50 => generated 226 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:24:09.815556 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b744d19d-349a-4395-badf-bf27c27a6218 None admin] Authenticating user token {{(pid=207601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:24:09.836759 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29780694-cca4-4050-a259-48885d77768e None admin] Validating token access rules against request {{(pid=207600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:24:09.874224 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG dbcounter [-] [207600] Writing DB stats keystone:SELECT=100 {{(pid=207600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:24:09.905140 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG dbcounter [-] [207601] Writing DB stats keystone:SELECT=100 {{(pid=207601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:24:09.936312 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ecbdf5-3428-4338-afe4-12919466b47f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:24:09.937013 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ecbdf5-3428-4338-afe4-12919466b47f None admin] REQUEST_METHOD: `GET` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:24:09.937306 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ecbdf5-3428-4338-afe4-12919466b47f None admin] SCRIPT_NAME: `/identity` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:24:09.937581 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ecbdf5-3428-4338-afe4-12919466b47f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:24:09.940376 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b744d19d-349a-4395-badf-bf27c27a6218 None admin] Validating token access rules against request {{(pid=207601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:24:09.980772 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73722742-2286-4d77-b67b-1b673662166d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:24:09.981415 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73722742-2286-4d77-b67b-1b673662166d None admin] REQUEST_METHOD: `GET` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:24:09.981811 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73722742-2286-4d77-b67b-1b673662166d None admin] SCRIPT_NAME: `/identity` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:24:09.982086 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73722742-2286-4d77-b67b-1b673662166d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:24:09.982898 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73722742-2286-4d77-b67b-1b673662166d None admin] RBAC: Adding query filter params (group.id=648e35db40964d1baaa9a887e8198e50, role.id=e617201b25d44cb1844c9f28bcac91fb, scope.project.id=4a64079f46494355a0aa3aafd9a90c0c) {{(pid=207601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:24:09.983211 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73722742-2286-4d77-b67b-1b673662166d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:24:09.984699 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73722742-2286-4d77-b67b-1b673662166d None admin] RBAC: Authorization granted {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:24:09.991719 dv-cinder-851351-1-smb devstack@keystone.service[207601]: [pid: 207601|app: 0|req: 214/427] 10.222.0.42 () {56 vars in 1376 bytes} [Thu Jul 28 08:24:09 2022] GET /identity/v3/role_assignments?group.id=648e35db40964d1baaa9a887e8198e50&scope.project.id=4a64079f46494355a0aa3aafd9a90c0c&role.id=e617201b25d44cb1844c9f28bcac91fb => generated 611 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:24:10.048397 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce910f6-5f2b-436c-afbf-3d6f83a1a31a None None] REQUEST_METHOD: `GET` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:24:10.049132 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce910f6-5f2b-436c-afbf-3d6f83a1a31a None None] SCRIPT_NAME: `/identity` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:24:10.049642 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce910f6-5f2b-436c-afbf-3d6f83a1a31a None None] PATH_INFO: `/` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:24:10.051709 dv-cinder-851351-1-smb devstack@keystone.service[207601]: [pid: 207601|app: 0|req: 215/428] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 08:24:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 28 08:24:10.057887 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3631fb66-ded8-43b3-b3ec-63d998126f12 None None] REQUEST_METHOD: `POST` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:24:10.058834 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3631fb66-ded8-43b3-b3ec-63d998126f12 None None] SCRIPT_NAME: `/identity` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:24:10.061060 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3631fb66-ded8-43b3-b3ec-63d998126f12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:24:10.090988 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.auth.core [None req-3631fb66-ded8-43b3-b3ec-63d998126f12 None None] MFA Rules not processed for user `b8110ade874c4aa7af27f5c376df700a`. Rule list: `[]` (Enabled: `True`). {{(pid=207601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 08:24:10.092873 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.fernet_utils [None req-3631fb66-ded8-43b3-b3ec-63d998126f12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=207601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:24:10.110450 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19ecbdf5-3428-4338-afe4-12919466b47f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:24:10.112391 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19ecbdf5-3428-4338-afe4-12919466b47f None admin] RBAC: Authorization granted {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:24:10.221370 dv-cinder-851351-1-smb devstack@keystone.service[207601]: [pid: 207601|app: 0|req: 216/429] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 08:24:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 28 08:24:10.248548 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3631fb66-ded8-43b3-b3ec-63d998126f12 None None] Authenticating user token {{(pid=207601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:24:10.286495 dv-cinder-851351-1-smb devstack@keystone.service[207600]: [pid: 207600|app: 0|req: 214/430] 10.222.0.42 () {58 vars in 1282 bytes} [Thu Jul 28 08:24:09 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 717 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 28 08:24:10.294305 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ecbdf5-3428-4338-afe4-12919466b47f None admin] Authenticating user token {{(pid=207600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:24:10.329656 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG dbcounter [-] [207600] Writing DB stats keystone:SELECT=100 {{(pid=207600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:24:10.352708 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG dbcounter [-] [207601] Writing DB stats keystone:SELECT=100 {{(pid=207601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:24:10.403723 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3631fb66-ded8-43b3-b3ec-63d998126f12 None None] Validating token access rules against request {{(pid=207601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:24:10.434097 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ecbdf5-3428-4338-afe4-12919466b47f None admin] Validating token access rules against request {{(pid=207600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:24:10.449781 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2656c916-5416-409a-b462-e7eb6e40c4c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:24:10.451405 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2656c916-5416-409a-b462-e7eb6e40c4c1 None admin] REQUEST_METHOD: `GET` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:24:10.451978 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2656c916-5416-409a-b462-e7eb6e40c4c1 None admin] SCRIPT_NAME: `/identity` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:24:10.452448 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2656c916-5416-409a-b462-e7eb6e40c4c1 None admin] PATH_INFO: `/v3/roles/member` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:24:10.468808 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2656c916-5416-409a-b462-e7eb6e40c4c1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 08:24:10.472633 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3cfa314-b605-4e91-83db-2f5770a07d93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:24:10.473642 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3cfa314-b605-4e91-83db-2f5770a07d93 None admin] REQUEST_METHOD: `GET` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:24:10.474181 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3cfa314-b605-4e91-83db-2f5770a07d93 None admin] SCRIPT_NAME: `/identity` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:24:10.474710 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3cfa314-b605-4e91-83db-2f5770a07d93 None admin] PATH_INFO: `/v3/projects/4a64079f46494355a0aa3aafd9a90c0c` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:24:10.475301 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application [None req-2656c916-5416-409a-b462-e7eb6e40c4c1 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 28 08:24:10.475301 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:24:10.475301 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:24:10.475301 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:24:10.475301 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:24:10.475301 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:24:10.475301 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:24:10.475301 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:24:10.475301 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:24:10.475301 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:24:10.475301 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:24:10.475301 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:24:10.475301 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 08:24:10.475301 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 08:24:10.475301 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 08:24:10.475301 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 08:24:10.476330 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 08:24:10.476330 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 08:24:10.476330 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 08:24:10.476330 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 08:24:10.476330 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:24:10.476330 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:24:10.476330 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:24:10.476330 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:24:10.476330 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:24:10.476330 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:24:10.476330 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:24:10.476330 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application with Lock( Jul 28 08:24:10.476330 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:24:10.476330 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:24:10.476330 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:24:10.476330 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:24:10.477239 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:24:10.477239 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:24:10.477239 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:24:10.477239 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:24:10.477239 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 08:24:10.477239 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 08:24:10.477239 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 08:24:10.477239 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 08:24:10.477239 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 08:24:10.477239 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 08:24:10.477239 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 28 08:24:10.477239 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application Jul 28 08:24:10.477990 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3cfa314-b605-4e91-83db-2f5770a07d93 None admin] RBAC: Authorizing `identity:get_project(project_id=4a64079f46494355a0aa3aafd9a90c0c)` {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:24:10.477990 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3cfa314-b605-4e91-83db-2f5770a07d93 None admin] RBAC: Authorization granted {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:24:10.480375 dv-cinder-851351-1-smb devstack@keystone.service[207601]: [pid: 207601|app: 0|req: 217/432] 10.222.0.42 () {56 vars in 1099 bytes} [Thu Jul 28 08:24:10 2022] GET /identity/v3/roles/member => generated 84 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 08:24:10.485053 dv-cinder-851351-1-smb devstack@keystone.service[207600]: [pid: 207600|app: 0|req: 215/432] 10.222.0.42 () {56 vars in 1186 bytes} [Thu Jul 28 08:24:10 2022] GET /identity/v3/projects/4a64079f46494355a0aa3aafd9a90c0c => generated 298 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 08:24:10.486451 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2656c916-5416-409a-b462-e7eb6e40c4c1 None admin] Authenticating user token {{(pid=207601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:24:10.486604 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3cfa314-b605-4e91-83db-2f5770a07d93 None admin] Authenticating user token {{(pid=207600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:24:10.593978 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG dbcounter [-] [207600] Writing DB stats keystone:SELECT=100 {{(pid=207600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:24:10.624987 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3cfa314-b605-4e91-83db-2f5770a07d93 None admin] Validating token access rules against request {{(pid=207600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:24:10.626551 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2656c916-5416-409a-b462-e7eb6e40c4c1 None admin] Validating token access rules against request {{(pid=207601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:24:10.656495 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG dbcounter [-] [207601] Writing DB stats keystone:SELECT=100 {{(pid=207601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:24:10.666398 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec5b725-a31d-4bd8-83c5-fd0442ba2f67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:24:10.667228 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec5b725-a31d-4bd8-83c5-fd0442ba2f67 None admin] REQUEST_METHOD: `GET` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:24:10.667627 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec5b725-a31d-4bd8-83c5-fd0442ba2f67 None admin] SCRIPT_NAME: `/identity` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:24:10.668018 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec5b725-a31d-4bd8-83c5-fd0442ba2f67 None admin] PATH_INFO: `/v3/groups/648e35db40964d1baaa9a887e8198e50` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:24:10.669371 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ec5b725-a31d-4bd8-83c5-fd0442ba2f67 None admin] RBAC: Authorizing `identity:get_group(group_id=648e35db40964d1baaa9a887e8198e50)` {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:24:10.670904 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ec5b725-a31d-4bd8-83c5-fd0442ba2f67 None admin] RBAC: Authorization granted {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:24:10.676796 dv-cinder-851351-1-smb devstack@keystone.service[207601]: [pid: 207601|app: 0|req: 218/433] 10.222.0.42 () {56 vars in 1180 bytes} [Thu Jul 28 08:24:10 2022] GET /identity/v3/groups/648e35db40964d1baaa9a887e8198e50 => generated 226 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 08:24:10.679222 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec5b725-a31d-4bd8-83c5-fd0442ba2f67 None admin] Authenticating user token {{(pid=207601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:24:10.686915 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2a5eb4-ac0d-4b7d-af9c-1e0034e8f62d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:24:10.688204 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2a5eb4-ac0d-4b7d-af9c-1e0034e8f62d None admin] REQUEST_METHOD: `GET` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:24:10.688714 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2a5eb4-ac0d-4b7d-af9c-1e0034e8f62d None admin] SCRIPT_NAME: `/identity` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:24:10.689208 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2a5eb4-ac0d-4b7d-af9c-1e0034e8f62d None admin] PATH_INFO: `/v3/roles` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:24:10.690269 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e2a5eb4-ac0d-4b7d-af9c-1e0034e8f62d None admin] RBAC: Adding query filter params (name=member) {{(pid=207600) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:24:10.690790 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e2a5eb4-ac0d-4b7d-af9c-1e0034e8f62d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:24:10.692540 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e2a5eb4-ac0d-4b7d-af9c-1e0034e8f62d None admin] RBAC: Authorization granted {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:24:10.707664 dv-cinder-851351-1-smb devstack@keystone.service[207600]: [pid: 207600|app: 0|req: 216/434] 10.222.0.42 () {56 vars in 1101 bytes} [Thu Jul 28 08:24:10 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:24:10.709256 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2a5eb4-ac0d-4b7d-af9c-1e0034e8f62d None admin] Authenticating user token {{(pid=207600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:24:10.792344 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec5b725-a31d-4bd8-83c5-fd0442ba2f67 None admin] Validating token access rules against request {{(pid=207601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:24:10.822275 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2a5eb4-ac0d-4b7d-af9c-1e0034e8f62d None admin] Validating token access rules against request {{(pid=207600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:24:10.829215 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027c73cd-1aa5-4698-a60e-53a98405d696 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:24:10.829946 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027c73cd-1aa5-4698-a60e-53a98405d696 None admin] REQUEST_METHOD: `GET` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:24:10.830326 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027c73cd-1aa5-4698-a60e-53a98405d696 None admin] SCRIPT_NAME: `/identity` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:24:10.830664 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027c73cd-1aa5-4698-a60e-53a98405d696 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:24:10.831991 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-027c73cd-1aa5-4698-a60e-53a98405d696 None admin] RBAC: Adding query filter params (group.id=648e35db40964d1baaa9a887e8198e50, role.id=70a2fd2878c549aeb19b16ec37e37164, scope.project.id=4a64079f46494355a0aa3aafd9a90c0c) {{(pid=207601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:24:10.831991 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-027c73cd-1aa5-4698-a60e-53a98405d696 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:24:10.833421 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-027c73cd-1aa5-4698-a60e-53a98405d696 None admin] RBAC: Authorization granted {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:24:10.848961 dv-cinder-851351-1-smb devstack@keystone.service[207601]: [pid: 207601|app: 0|req: 219/435] 10.222.0.42 () {56 vars in 1376 bytes} [Thu Jul 28 08:24:10 2022] GET /identity/v3/role_assignments?group.id=648e35db40964d1baaa9a887e8198e50&scope.project.id=4a64079f46494355a0aa3aafd9a90c0c&role.id=70a2fd2878c549aeb19b16ec37e37164 => generated 611 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 08:24:10.866093 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38bf59f3-684c-4237-88e1-19f0a7d92936 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:24:10.867494 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38bf59f3-684c-4237-88e1-19f0a7d92936 None admin] REQUEST_METHOD: `GET` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:24:10.867976 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38bf59f3-684c-4237-88e1-19f0a7d92936 None admin] SCRIPT_NAME: `/identity` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:24:10.868471 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38bf59f3-684c-4237-88e1-19f0a7d92936 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:24:10.916436 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG dbcounter [-] [207600] Writing DB stats keystone:SELECT=100 {{(pid=207600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:24:10.967615 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38bf59f3-684c-4237-88e1-19f0a7d92936 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:24:10.969600 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38bf59f3-684c-4237-88e1-19f0a7d92936 None admin] RBAC: Authorization granted {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:24:11.090721 dv-cinder-851351-1-smb devstack@keystone.service[207600]: [pid: 207600|app: 0|req: 217/436] 10.222.0.42 () {58 vars in 1282 bytes} [Thu Jul 28 08:24:10 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 382 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 28 08:24:11.097094 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027c73cd-1aa5-4698-a60e-53a98405d696 None admin] Authenticating user token {{(pid=207601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:24:11.179953 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG dbcounter [-] [207601] Writing DB stats keystone:SELECT=100 {{(pid=207601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:24:11.214273 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2cdb6a-a385-4b77-8b06-e25128aea11a None None] REQUEST_METHOD: `GET` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:24:11.215054 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2cdb6a-a385-4b77-8b06-e25128aea11a None None] SCRIPT_NAME: `/identity` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:24:11.215871 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2cdb6a-a385-4b77-8b06-e25128aea11a None None] PATH_INFO: `/` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:24:11.219639 dv-cinder-851351-1-smb devstack@keystone.service[207600]: [pid: 207600|app: 0|req: 218/437] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 08:24:11 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 08:24:11.225887 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5cd047-49a1-4d63-a1c2-4751d28d303c None None] REQUEST_METHOD: `POST` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:24:11.226510 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5cd047-49a1-4d63-a1c2-4751d28d303c None None] SCRIPT_NAME: `/identity` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:24:11.227005 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5cd047-49a1-4d63-a1c2-4751d28d303c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:24:11.235714 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027c73cd-1aa5-4698-a60e-53a98405d696 None admin] Validating token access rules against request {{(pid=207601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:24:11.253496 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.auth.core [None req-af5cd047-49a1-4d63-a1c2-4751d28d303c None None] MFA Rules not processed for user `b8110ade874c4aa7af27f5c376df700a`. Rule list: `[]` (Enabled: `True`). {{(pid=207600) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 08:24:11.254749 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.fernet_utils [None req-af5cd047-49a1-4d63-a1c2-4751d28d303c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=207600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:24:11.285541 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f931d60-7d22-4b95-9a85-53f58167dcb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:24:11.286290 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f931d60-7d22-4b95-9a85-53f58167dcb5 None admin] REQUEST_METHOD: `GET` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:24:11.286729 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f931d60-7d22-4b95-9a85-53f58167dcb5 None admin] SCRIPT_NAME: `/identity` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:24:11.287219 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f931d60-7d22-4b95-9a85-53f58167dcb5 None admin] PATH_INFO: `/v3/projects/4a9d64056e4a4c2f805643b31ac7e061` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:24:11.288918 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f931d60-7d22-4b95-9a85-53f58167dcb5 None admin] RBAC: Authorizing `identity:get_project(project_id=4a9d64056e4a4c2f805643b31ac7e061)` {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:24:11.290423 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f931d60-7d22-4b95-9a85-53f58167dcb5 None admin] RBAC: Authorization granted {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:24:11.292327 dv-cinder-851351-1-smb devstack@keystone.service[207601]: [pid: 207601|app: 0|req: 220/438] 10.222.0.42 () {56 vars in 1186 bytes} [Thu Jul 28 08:24:11 2022] GET /identity/v3/projects/4a9d64056e4a4c2f805643b31ac7e061 => generated 302 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:24:11.293537 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2612f080-1295-438b-ac65-b21c6f07f301 None None] REQUEST_METHOD: `GET` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:24:11.293826 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2612f080-1295-438b-ac65-b21c6f07f301 None None] SCRIPT_NAME: `/identity` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:24:11.294104 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2612f080-1295-438b-ac65-b21c6f07f301 None None] PATH_INFO: `/` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:24:11.295468 dv-cinder-851351-1-smb devstack@keystone.service[207601]: [pid: 207601|app: 0|req: 221/439] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 08:24:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 08:24:11.300522 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2612f080-1295-438b-ac65-b21c6f07f301 None None] Authenticating user token {{(pid=207601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:24:11.332344 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG dbcounter [-] [207600] Writing DB stats keystone:SELECT=100 {{(pid=207600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:24:11.366788 dv-cinder-851351-1-smb devstack@keystone.service[207600]: [pid: 207600|app: 0|req: 219/440] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 08:24:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 08:24:11.368433 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9cbcab-4d93-4cd7-b5d9-0a52fd28f4d8 None None] REQUEST_METHOD: `POST` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:24:11.369009 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9cbcab-4d93-4cd7-b5d9-0a52fd28f4d8 None None] SCRIPT_NAME: `/identity` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:24:11.369290 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9cbcab-4d93-4cd7-b5d9-0a52fd28f4d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:24:11.392307 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.auth.core [None req-0b9cbcab-4d93-4cd7-b5d9-0a52fd28f4d8 None None] MFA Rules not processed for user `b8110ade874c4aa7af27f5c376df700a`. Rule list: `[]` (Enabled: `True`). {{(pid=207600) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 08:24:11.393871 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.fernet_utils [None req-0b9cbcab-4d93-4cd7-b5d9-0a52fd28f4d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=207600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:24:11.460845 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2612f080-1295-438b-ac65-b21c6f07f301 None None] Validating token access rules against request {{(pid=207601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:24:11.492700 dv-cinder-851351-1-smb devstack@keystone.service[207600]: [pid: 207600|app: 0|req: 220/441] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 08:24:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 08:24:11.492700 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9cbcab-4d93-4cd7-b5d9-0a52fd28f4d8 None None] Authenticating user token {{(pid=207600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:24:11.498593 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG dbcounter [-] [207601] Writing DB stats keystone:SELECT=100 {{(pid=207601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:24:11.510882 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f165a16d-c76a-4893-ab5c-0615caf86e9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:24:11.512028 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f165a16d-c76a-4893-ab5c-0615caf86e9b None admin] REQUEST_METHOD: `GET` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:24:11.512028 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f165a16d-c76a-4893-ab5c-0615caf86e9b None admin] SCRIPT_NAME: `/identity` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:24:11.512313 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f165a16d-c76a-4893-ab5c-0615caf86e9b None admin] PATH_INFO: `/v3/groups/648e35db40964d1baaa9a887e8198e50` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:24:11.513593 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f165a16d-c76a-4893-ab5c-0615caf86e9b None admin] RBAC: Authorizing `identity:get_group(group_id=648e35db40964d1baaa9a887e8198e50)` {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:24:11.515096 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f165a16d-c76a-4893-ab5c-0615caf86e9b None admin] RBAC: Authorization granted {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:24:11.516956 dv-cinder-851351-1-smb devstack@keystone.service[207601]: [pid: 207601|app: 0|req: 222/442] 10.222.0.42 () {56 vars in 1180 bytes} [Thu Jul 28 08:24:11 2022] GET /identity/v3/groups/648e35db40964d1baaa9a887e8198e50 => generated 226 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:24:11.518164 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f165a16d-c76a-4893-ab5c-0615caf86e9b None admin] Authenticating user token {{(pid=207601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:24:11.611925 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9cbcab-4d93-4cd7-b5d9-0a52fd28f4d8 None None] Validating token access rules against request {{(pid=207600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:24:11.623868 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG dbcounter [-] [207600] Writing DB stats keystone:SELECT=100 {{(pid=207600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:24:11.640315 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f165a16d-c76a-4893-ab5c-0615caf86e9b None admin] Validating token access rules against request {{(pid=207601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:24:11.651495 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19adb192-8ec7-4d86-8c76-14b83ce48f94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:24:11.652517 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19adb192-8ec7-4d86-8c76-14b83ce48f94 None admin] REQUEST_METHOD: `GET` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:24:11.652831 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19adb192-8ec7-4d86-8c76-14b83ce48f94 None admin] SCRIPT_NAME: `/identity` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:24:11.653108 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19adb192-8ec7-4d86-8c76-14b83ce48f94 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:24:11.663476 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19adb192-8ec7-4d86-8c76-14b83ce48f94 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 08:24:11.668572 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application [None req-19adb192-8ec7-4d86-8c76-14b83ce48f94 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 28 08:24:11.668572 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:24:11.668572 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:24:11.668572 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:24:11.668572 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:24:11.668572 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:24:11.668572 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:24:11.668572 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:24:11.668572 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:24:11.668572 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:24:11.668572 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:24:11.668572 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:24:11.668572 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 08:24:11.668572 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 08:24:11.668572 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 08:24:11.668572 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 08:24:11.669707 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 08:24:11.669707 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 08:24:11.669707 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 08:24:11.669707 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 08:24:11.669707 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:24:11.669707 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:24:11.669707 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:24:11.669707 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:24:11.669707 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:24:11.669707 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:24:11.669707 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:24:11.669707 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application with Lock( Jul 28 08:24:11.669707 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:24:11.669707 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:24:11.669707 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:24:11.669707 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:24:11.670627 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:24:11.670627 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:24:11.670627 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:24:11.670627 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:24:11.670627 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 08:24:11.670627 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 08:24:11.670627 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 08:24:11.670627 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 08:24:11.670627 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 08:24:11.670627 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 08:24:11.670627 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 28 08:24:11.670627 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application Jul 28 08:24:11.670627 dv-cinder-851351-1-smb devstack@keystone.service[207600]: [pid: 207600|app: 0|req: 221/443] 10.222.0.42 () {56 vars in 1114 bytes} [Thu Jul 28 08:24:11 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:24:11.670627 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19adb192-8ec7-4d86-8c76-14b83ce48f94 None admin] Authenticating user token {{(pid=207600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:24:11.682011 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd01cc85-e83e-4f77-a62a-530a8f350699 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:24:11.682664 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd01cc85-e83e-4f77-a62a-530a8f350699 None admin] REQUEST_METHOD: `GET` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:24:11.682945 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd01cc85-e83e-4f77-a62a-530a8f350699 None admin] SCRIPT_NAME: `/identity` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:24:11.683273 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd01cc85-e83e-4f77-a62a-530a8f350699 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:24:11.694249 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd01cc85-e83e-4f77-a62a-530a8f350699 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 08:24:11.699940 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application [None req-cd01cc85-e83e-4f77-a62a-530a8f350699 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 08:24:11.699940 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:24:11.699940 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:24:11.699940 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:24:11.699940 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:24:11.699940 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:24:11.699940 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:24:11.699940 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:24:11.699940 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:24:11.699940 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:24:11.699940 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:24:11.699940 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:24:11.699940 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 08:24:11.699940 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 08:24:11.699940 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 08:24:11.699940 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 08:24:11.701180 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 08:24:11.701180 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 08:24:11.701180 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 08:24:11.701180 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 08:24:11.701180 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:24:11.701180 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:24:11.701180 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:24:11.701180 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:24:11.701180 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:24:11.701180 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:24:11.701180 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:24:11.701180 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application with Lock( Jul 28 08:24:11.701180 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:24:11.701180 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:24:11.701180 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:24:11.701180 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:24:11.703921 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:24:11.703921 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:24:11.703921 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:24:11.703921 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:24:11.703921 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 08:24:11.703921 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 08:24:11.703921 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 08:24:11.703921 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 08:24:11.703921 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 08:24:11.703921 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 08:24:11.703921 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 08:24:11.703921 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application Jul 28 08:24:11.703921 dv-cinder-851351-1-smb devstack@keystone.service[207601]: [pid: 207601|app: 0|req: 223/444] 10.222.0.42 () {56 vars in 1096 bytes} [Thu Jul 28 08:24:11 2022] GET /identity/v3/roles/admin => generated 83 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:24:11.703921 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd01cc85-e83e-4f77-a62a-530a8f350699 None admin] Authenticating user token {{(pid=207601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:24:11.781456 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG dbcounter [-] [207601] Writing DB stats keystone:SELECT=100 {{(pid=207601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:24:11.797151 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19adb192-8ec7-4d86-8c76-14b83ce48f94 None admin] Validating token access rules against request {{(pid=207600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:24:11.835654 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71faf8e5-2bc0-40cc-a8a8-a9b5fb560047 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:24:11.836298 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71faf8e5-2bc0-40cc-a8a8-a9b5fb560047 None admin] REQUEST_METHOD: `GET` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:24:11.836585 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71faf8e5-2bc0-40cc-a8a8-a9b5fb560047 None admin] SCRIPT_NAME: `/identity` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:24:11.836896 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71faf8e5-2bc0-40cc-a8a8-a9b5fb560047 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:24:11.837713 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71faf8e5-2bc0-40cc-a8a8-a9b5fb560047 None admin] RBAC: Adding query filter params (group.id=648e35db40964d1baaa9a887e8198e50, role.id=70a2fd2878c549aeb19b16ec37e37164, scope.project.id=4a9d64056e4a4c2f805643b31ac7e061) {{(pid=207600) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:24:11.838031 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71faf8e5-2bc0-40cc-a8a8-a9b5fb560047 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:24:11.839950 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71faf8e5-2bc0-40cc-a8a8-a9b5fb560047 None admin] RBAC: Authorization granted {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:24:11.846236 dv-cinder-851351-1-smb devstack@keystone.service[207600]: [pid: 207600|app: 0|req: 222/445] 10.222.0.42 () {56 vars in 1376 bytes} [Thu Jul 28 08:24:11 2022] GET /identity/v3/role_assignments?group.id=648e35db40964d1baaa9a887e8198e50&scope.project.id=4a9d64056e4a4c2f805643b31ac7e061&role.id=70a2fd2878c549aeb19b16ec37e37164 => generated 611 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:24:11.847069 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71faf8e5-2bc0-40cc-a8a8-a9b5fb560047 None admin] Authenticating user token {{(pid=207600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:24:11.850429 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd01cc85-e83e-4f77-a62a-530a8f350699 None admin] Validating token access rules against request {{(pid=207601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:24:11.901867 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG dbcounter [-] [207600] Writing DB stats keystone:SELECT=100 {{(pid=207600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:24:11.907496 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4597034-b946-4e85-8444-a064098bec89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:24:11.908150 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4597034-b946-4e85-8444-a064098bec89 None admin] REQUEST_METHOD: `GET` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:24:11.908440 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4597034-b946-4e85-8444-a064098bec89 None admin] SCRIPT_NAME: `/identity` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:24:11.908748 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4597034-b946-4e85-8444-a064098bec89 None admin] PATH_INFO: `/v3/roles` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:24:11.909545 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4597034-b946-4e85-8444-a064098bec89 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=207601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:24:11.909866 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4597034-b946-4e85-8444-a064098bec89 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:24:11.911323 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4597034-b946-4e85-8444-a064098bec89 None admin] RBAC: Authorization granted {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:24:11.921919 dv-cinder-851351-1-smb devstack@keystone.service[207601]: [pid: 207601|app: 0|req: 224/446] 10.222.0.42 () {56 vars in 1111 bytes} [Thu Jul 28 08:24:11 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:24:11.928761 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4597034-b946-4e85-8444-a064098bec89 None admin] Authenticating user token {{(pid=207601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:24:11.999926 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71faf8e5-2bc0-40cc-a8a8-a9b5fb560047 None admin] Validating token access rules against request {{(pid=207600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:24:12.044190 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e547fc88-635b-4185-8c6e-7b7c87a4db83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:24:12.044787 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e547fc88-635b-4185-8c6e-7b7c87a4db83 None admin] REQUEST_METHOD: `GET` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:24:12.045075 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e547fc88-635b-4185-8c6e-7b7c87a4db83 None admin] SCRIPT_NAME: `/identity` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:24:12.045350 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e547fc88-635b-4185-8c6e-7b7c87a4db83 None admin] PATH_INFO: `/v3/roles` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:24:12.046270 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e547fc88-635b-4185-8c6e-7b7c87a4db83 None admin] RBAC: Adding query filter params (name=admin) {{(pid=207600) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:24:12.046430 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e547fc88-635b-4185-8c6e-7b7c87a4db83 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:24:12.047918 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e547fc88-635b-4185-8c6e-7b7c87a4db83 None admin] RBAC: Authorization granted {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:24:12.058911 dv-cinder-851351-1-smb devstack@keystone.service[207600]: [pid: 207600|app: 0|req: 223/447] 10.222.0.42 () {56 vars in 1099 bytes} [Thu Jul 28 08:24:11 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:24:12.063765 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4597034-b946-4e85-8444-a064098bec89 None admin] Validating token access rules against request {{(pid=207601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:24:12.065433 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e547fc88-635b-4185-8c6e-7b7c87a4db83 None admin] Authenticating user token {{(pid=207600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:24:12.088846 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG dbcounter [-] [207601] Writing DB stats keystone:SELECT=100 {{(pid=207601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:24:12.118876 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d19501b7-7d2d-4eb4-958a-beb633f283fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:24:12.119524 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19501b7-7d2d-4eb4-958a-beb633f283fd None admin] REQUEST_METHOD: `GET` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:24:12.119811 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19501b7-7d2d-4eb4-958a-beb633f283fd None admin] SCRIPT_NAME: `/identity` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:24:12.120087 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19501b7-7d2d-4eb4-958a-beb633f283fd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:24:12.202392 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG dbcounter [-] [207600] Writing DB stats keystone:SELECT=100 {{(pid=207600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:24:12.209336 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d19501b7-7d2d-4eb4-958a-beb633f283fd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:24:12.210816 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d19501b7-7d2d-4eb4-958a-beb633f283fd None admin] RBAC: Authorization granted {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:24:12.212267 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e547fc88-635b-4185-8c6e-7b7c87a4db83 None admin] Validating token access rules against request {{(pid=207600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:24:12.257122 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-661284a0-d24b-4884-a0b1-5ab426048012 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:24:12.257781 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661284a0-d24b-4884-a0b1-5ab426048012 None admin] REQUEST_METHOD: `GET` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:24:12.258063 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661284a0-d24b-4884-a0b1-5ab426048012 None admin] SCRIPT_NAME: `/identity` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:24:12.258339 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661284a0-d24b-4884-a0b1-5ab426048012 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:24:12.333414 dv-cinder-851351-1-smb devstack@keystone.service[207601]: [pid: 207601|app: 0|req: 225/448] 10.222.0.42 () {58 vars in 1282 bytes} [Thu Jul 28 08:24:11 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 406 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 28 08:24:12.337294 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-661284a0-d24b-4884-a0b1-5ab426048012 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:24:12.339270 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-661284a0-d24b-4884-a0b1-5ab426048012 None admin] RBAC: Authorization granted {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:24:12.339977 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d19501b7-7d2d-4eb4-958a-beb633f283fd None admin] Authenticating user token {{(pid=207601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:24:12.366413 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG dbcounter [-] [207601] Writing DB stats keystone:SELECT=100 {{(pid=207601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:24:12.453542 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG dbcounter [-] [207600] Writing DB stats keystone:SELECT=100 {{(pid=207600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:24:12.458772 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d19501b7-7d2d-4eb4-958a-beb633f283fd None admin] Validating token access rules against request {{(pid=207601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:24:12.464713 dv-cinder-851351-1-smb devstack@keystone.service[207600]: [pid: 207600|app: 0|req: 224/449] 10.222.0.42 () {58 vars in 1282 bytes} [Thu Jul 28 08:24:12 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 400 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 28 08:24:12.470499 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-661284a0-d24b-4884-a0b1-5ab426048012 None admin] Authenticating user token {{(pid=207600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:24:12.503379 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcaaf8e9-cf24-41ff-9dde-b66f9db9cf72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:24:12.504059 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcaaf8e9-cf24-41ff-9dde-b66f9db9cf72 None admin] REQUEST_METHOD: `GET` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:24:12.504340 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcaaf8e9-cf24-41ff-9dde-b66f9db9cf72 None admin] SCRIPT_NAME: `/identity` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:24:12.504618 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcaaf8e9-cf24-41ff-9dde-b66f9db9cf72 None admin] PATH_INFO: `/v3/projects/4a9d64056e4a4c2f805643b31ac7e061` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:24:12.505923 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcaaf8e9-cf24-41ff-9dde-b66f9db9cf72 None admin] RBAC: Authorizing `identity:get_project(project_id=4a9d64056e4a4c2f805643b31ac7e061)` {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:24:12.507405 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcaaf8e9-cf24-41ff-9dde-b66f9db9cf72 None admin] RBAC: Authorization granted {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:24:12.509285 dv-cinder-851351-1-smb devstack@keystone.service[207601]: [pid: 207601|app: 0|req: 226/450] 10.222.0.42 () {56 vars in 1186 bytes} [Thu Jul 28 08:24:12 2022] GET /identity/v3/projects/4a9d64056e4a4c2f805643b31ac7e061 => generated 302 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 08:24:12.514872 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcaaf8e9-cf24-41ff-9dde-b66f9db9cf72 None admin] Authenticating user token {{(pid=207601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:24:12.575180 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-661284a0-d24b-4884-a0b1-5ab426048012 None admin] Validating token access rules against request {{(pid=207600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:24:12.603921 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG dbcounter [-] [207601] Writing DB stats keystone:SELECT=100 {{(pid=207601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:24:12.610532 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28ccee0-9cf8-45eb-ae94-cac2e3cf4308 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:24:12.611322 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28ccee0-9cf8-45eb-ae94-cac2e3cf4308 None admin] REQUEST_METHOD: `GET` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:24:12.611607 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28ccee0-9cf8-45eb-ae94-cac2e3cf4308 None admin] SCRIPT_NAME: `/identity` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:24:12.611885 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28ccee0-9cf8-45eb-ae94-cac2e3cf4308 None admin] PATH_INFO: `/v3/projects/ce031eecc2864701bc87b5b179ea31ec` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:24:12.613130 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a28ccee0-9cf8-45eb-ae94-cac2e3cf4308 None admin] RBAC: Authorizing `identity:get_project(project_id=ce031eecc2864701bc87b5b179ea31ec)` {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:24:12.614629 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a28ccee0-9cf8-45eb-ae94-cac2e3cf4308 None admin] RBAC: Authorization granted {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:24:12.616360 dv-cinder-851351-1-smb devstack@keystone.service[207600]: [pid: 207600|app: 0|req: 225/451] 10.222.0.42 () {56 vars in 1186 bytes} [Thu Jul 28 08:24:12 2022] GET /identity/v3/projects/ce031eecc2864701bc87b5b179ea31ec => generated 344 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 08:24:12.620368 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcaaf8e9-cf24-41ff-9dde-b66f9db9cf72 None admin] Validating token access rules against request {{(pid=207601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:24:12.622345 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28ccee0-9cf8-45eb-ae94-cac2e3cf4308 None admin] Authenticating user token {{(pid=207600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:24:12.656717 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c110befd-443d-431b-afea-53c2c755c2fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:24:12.657498 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c110befd-443d-431b-afea-53c2c755c2fe None admin] REQUEST_METHOD: `GET` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:24:12.657851 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c110befd-443d-431b-afea-53c2c755c2fe None admin] SCRIPT_NAME: `/identity` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:24:12.658197 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c110befd-443d-431b-afea-53c2c755c2fe None admin] PATH_INFO: `/v3/groups/648e35db40964d1baaa9a887e8198e50` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:24:12.659430 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c110befd-443d-431b-afea-53c2c755c2fe None admin] RBAC: Authorizing `identity:get_group(group_id=648e35db40964d1baaa9a887e8198e50)` {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:24:12.660957 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c110befd-443d-431b-afea-53c2c755c2fe None admin] RBAC: Authorization granted {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:24:12.662576 dv-cinder-851351-1-smb devstack@keystone.service[207601]: [pid: 207601|app: 0|req: 227/452] 10.222.0.42 () {56 vars in 1180 bytes} [Thu Jul 28 08:24:12 2022] GET /identity/v3/groups/648e35db40964d1baaa9a887e8198e50 => generated 226 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:24:12.668890 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c110befd-443d-431b-afea-53c2c755c2fe None admin] Authenticating user token {{(pid=207601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:24:12.687378 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG dbcounter [-] [207600] Writing DB stats keystone:SELECT=100 {{(pid=207600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:24:12.728840 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28ccee0-9cf8-45eb-ae94-cac2e3cf4308 None admin] Validating token access rules against request {{(pid=207600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:24:12.764413 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb590a3-cf94-439c-8ac6-c401fd5ad64c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:24:12.765103 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb590a3-cf94-439c-8ac6-c401fd5ad64c None admin] REQUEST_METHOD: `GET` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:24:12.765384 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb590a3-cf94-439c-8ac6-c401fd5ad64c None admin] SCRIPT_NAME: `/identity` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:24:12.765654 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb590a3-cf94-439c-8ac6-c401fd5ad64c None admin] PATH_INFO: `/v3/groups/5ac8509edd914c048d0c8a4daed171b2` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:24:12.766976 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfb590a3-cf94-439c-8ac6-c401fd5ad64c None admin] RBAC: Authorizing `identity:get_group(group_id=5ac8509edd914c048d0c8a4daed171b2)` {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:24:12.768469 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfb590a3-cf94-439c-8ac6-c401fd5ad64c None admin] RBAC: Authorization granted {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:24:12.770167 dv-cinder-851351-1-smb devstack@keystone.service[207600]: [pid: 207600|app: 0|req: 226/453] 10.222.0.42 () {56 vars in 1180 bytes} [Thu Jul 28 08:24:12 2022] GET /identity/v3/groups/5ac8509edd914c048d0c8a4daed171b2 => generated 229 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 08:24:12.776004 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c110befd-443d-431b-afea-53c2c755c2fe None admin] Validating token access rules against request {{(pid=207601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:24:12.776133 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb590a3-cf94-439c-8ac6-c401fd5ad64c None admin] Authenticating user token {{(pid=207600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:24:12.814000 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b18eae-1d96-46e1-a766-cc0794c09155 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:24:12.814642 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b18eae-1d96-46e1-a766-cc0794c09155 None admin] REQUEST_METHOD: `GET` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:24:12.814920 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b18eae-1d96-46e1-a766-cc0794c09155 None admin] SCRIPT_NAME: `/identity` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:24:12.815194 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b18eae-1d96-46e1-a766-cc0794c09155 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:24:12.816004 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65b18eae-1d96-46e1-a766-cc0794c09155 None admin] RBAC: Adding query filter params (group.id=648e35db40964d1baaa9a887e8198e50, role.id=e617201b25d44cb1844c9f28bcac91fb, scope.project.id=4a9d64056e4a4c2f805643b31ac7e061) {{(pid=207601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:24:12.816318 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65b18eae-1d96-46e1-a766-cc0794c09155 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:24:12.817808 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65b18eae-1d96-46e1-a766-cc0794c09155 None admin] RBAC: Authorization granted {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:24:12.824460 dv-cinder-851351-1-smb devstack@keystone.service[207601]: [pid: 207601|app: 0|req: 228/454] 10.222.0.42 () {56 vars in 1376 bytes} [Thu Jul 28 08:24:12 2022] GET /identity/v3/role_assignments?group.id=648e35db40964d1baaa9a887e8198e50&scope.project.id=4a9d64056e4a4c2f805643b31ac7e061&role.id=e617201b25d44cb1844c9f28bcac91fb => generated 611 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:24:12.895957 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb590a3-cf94-439c-8ac6-c401fd5ad64c None admin] Validating token access rules against request {{(pid=207600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:24:12.933290 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG dbcounter [-] [207600] Writing DB stats keystone:SELECT=100 {{(pid=207600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:24:12.940593 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6de40cb-0525-4953-916a-44e727a95e8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:24:12.941288 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6de40cb-0525-4953-916a-44e727a95e8e None admin] REQUEST_METHOD: `GET` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:24:12.941584 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6de40cb-0525-4953-916a-44e727a95e8e None admin] SCRIPT_NAME: `/identity` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:24:12.941864 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6de40cb-0525-4953-916a-44e727a95e8e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:24:12.942722 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6de40cb-0525-4953-916a-44e727a95e8e None admin] RBAC: Adding query filter params (group.id=5ac8509edd914c048d0c8a4daed171b2, role.id=d0ce88034c6b41878db755343f5840be, scope.project.id=ce031eecc2864701bc87b5b179ea31ec) {{(pid=207600) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:24:12.943041 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6de40cb-0525-4953-916a-44e727a95e8e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:24:12.944560 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6de40cb-0525-4953-916a-44e727a95e8e None admin] RBAC: Authorization granted {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:24:12.951787 dv-cinder-851351-1-smb devstack@keystone.service[207600]: [pid: 207600|app: 0|req: 227/455] 10.222.0.42 () {56 vars in 1376 bytes} [Thu Jul 28 08:24:12 2022] GET /identity/v3/role_assignments?group.id=5ac8509edd914c048d0c8a4daed171b2&scope.project.id=ce031eecc2864701bc87b5b179ea31ec&role.id=d0ce88034c6b41878db755343f5840be => generated 611 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 08:24:15.477696 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b96c522-4c66-4051-852b-c6e700930944 None None] REQUEST_METHOD: `GET` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:24:15.478277 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b96c522-4c66-4051-852b-c6e700930944 None None] SCRIPT_NAME: `/identity` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:24:15.478277 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b96c522-4c66-4051-852b-c6e700930944 None None] PATH_INFO: `/` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:24:15.480155 dv-cinder-851351-1-smb devstack@keystone.service[207601]: [pid: 207601|app: 0|req: 229/456] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 08:24:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 08:24:15.486058 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ef73ff-d09f-4061-9aec-d8c1826405ea None None] REQUEST_METHOD: `POST` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:24:15.486543 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ef73ff-d09f-4061-9aec-d8c1826405ea None None] SCRIPT_NAME: `/identity` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:24:15.486633 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ef73ff-d09f-4061-9aec-d8c1826405ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:24:15.516846 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.auth.core [None req-d9ef73ff-d09f-4061-9aec-d8c1826405ea None None] MFA Rules not processed for user `b8110ade874c4aa7af27f5c376df700a`. Rule list: `[]` (Enabled: `True`). {{(pid=207600) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 08:24:15.518052 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.fernet_utils [None req-d9ef73ff-d09f-4061-9aec-d8c1826405ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=207600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:24:15.619405 dv-cinder-851351-1-smb devstack@keystone.service[207600]: [pid: 207600|app: 0|req: 228/457] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 08:24:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 28 08:24:15.655324 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b96c522-4c66-4051-852b-c6e700930944 None None] Authenticating user token {{(pid=207601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:24:15.683553 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG dbcounter [-] [207601] Writing DB stats keystone:SELECT=100 {{(pid=207601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:24:15.780392 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09d0abc-0382-406c-8b5a-2085ee8b4343 None None] REQUEST_METHOD: `GET` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:24:15.780968 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09d0abc-0382-406c-8b5a-2085ee8b4343 None None] SCRIPT_NAME: `/identity` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:24:15.781487 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09d0abc-0382-406c-8b5a-2085ee8b4343 None None] PATH_INFO: `/` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:24:15.784728 dv-cinder-851351-1-smb devstack@keystone.service[207600]: [pid: 207600|app: 0|req: 229/458] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 08:24:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 28 08:24:15.790259 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118214cd-af7a-4f07-9770-682828cb352b None None] REQUEST_METHOD: `POST` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:24:15.791061 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118214cd-af7a-4f07-9770-682828cb352b None None] SCRIPT_NAME: `/identity` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:24:15.792440 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118214cd-af7a-4f07-9770-682828cb352b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:24:15.829411 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b96c522-4c66-4051-852b-c6e700930944 None None] Validating token access rules against request {{(pid=207601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:24:15.829916 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.auth.core [None req-118214cd-af7a-4f07-9770-682828cb352b None None] MFA Rules not processed for user `b8110ade874c4aa7af27f5c376df700a`. Rule list: `[]` (Enabled: `True`). {{(pid=207600) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 08:24:15.831732 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.fernet_utils [None req-118214cd-af7a-4f07-9770-682828cb352b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=207600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:24:15.866513 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a43aeafa-6111-4c66-aaa6-be397f72b694 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:24:15.867178 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43aeafa-6111-4c66-aaa6-be397f72b694 None admin] REQUEST_METHOD: `GET` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:24:15.867459 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43aeafa-6111-4c66-aaa6-be397f72b694 None admin] SCRIPT_NAME: `/identity` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:24:15.867748 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43aeafa-6111-4c66-aaa6-be397f72b694 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:24:15.879847 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a43aeafa-6111-4c66-aaa6-be397f72b694 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:24:15.881467 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a43aeafa-6111-4c66-aaa6-be397f72b694 None admin] RBAC: Authorization granted {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:24:15.898020 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application [None req-a43aeafa-6111-4c66-aaa6-be397f72b694 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 08:24:15.898020 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:24:15.898020 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:24:15.898020 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:24:15.898020 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:24:15.898020 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:24:15.898020 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:24:15.898020 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:24:15.898020 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:24:15.898020 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:24:15.898020 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:24:15.898020 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:24:15.898020 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 08:24:15.898020 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 08:24:15.898020 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 08:24:15.899050 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 08:24:15.899050 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:24:15.899050 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:24:15.899050 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:24:15.899050 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:24:15.899050 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:24:15.899050 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:24:15.899050 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:24:15.899050 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application with Lock( Jul 28 08:24:15.899050 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:24:15.899050 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:24:15.899050 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:24:15.899050 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:24:15.899050 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:24:15.899050 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:24:15.899050 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:24:15.899050 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:24:15.900565 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 08:24:15.900565 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 08:24:15.900565 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 08:24:15.900565 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application Jul 28 08:24:15.908700 dv-cinder-851351-1-smb devstack@keystone.service[207601]: [pid: 207601|app: 0|req: 230/459] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 08:24:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 245 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:24:15.908700 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d241a8a6-6abf-4595-8fb8-62bfea7f14b0 None None] REQUEST_METHOD: `GET` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:24:15.908700 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d241a8a6-6abf-4595-8fb8-62bfea7f14b0 None None] SCRIPT_NAME: `/identity` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:24:15.908700 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d241a8a6-6abf-4595-8fb8-62bfea7f14b0 None None] PATH_INFO: `/` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:24:15.909095 dv-cinder-851351-1-smb devstack@keystone.service[207600]: [pid: 207600|app: 0|req: 230/460] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 08:24:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 08:24:15.909177 dv-cinder-851351-1-smb devstack@keystone.service[207601]: [pid: 207601|app: 0|req: 231/461] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 08:24:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 08:24:15.912645 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-118214cd-af7a-4f07-9770-682828cb352b None None] Authenticating user token {{(pid=207600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:24:15.913061 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9debb6e0-0fe0-47f4-903d-d7cb3eb24c48 None None] REQUEST_METHOD: `POST` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:24:15.913438 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9debb6e0-0fe0-47f4-903d-d7cb3eb24c48 None None] SCRIPT_NAME: `/identity` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:24:15.913766 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9debb6e0-0fe0-47f4-903d-d7cb3eb24c48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:24:15.943121 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.auth.core [None req-9debb6e0-0fe0-47f4-903d-d7cb3eb24c48 None None] MFA Rules not processed for user `b8110ade874c4aa7af27f5c376df700a`. Rule list: `[]` (Enabled: `True`). {{(pid=207601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 08:24:15.944445 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.fernet_utils [None req-9debb6e0-0fe0-47f4-903d-d7cb3eb24c48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=207601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:24:15.972892 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG dbcounter [-] [207600] Writing DB stats keystone:SELECT=100 {{(pid=207600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:24:16.015847 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG dbcounter [-] [207601] Writing DB stats keystone:SELECT=100 {{(pid=207601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:24:16.021704 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-118214cd-af7a-4f07-9770-682828cb352b None None] Validating token access rules against request {{(pid=207600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:24:16.022400 dv-cinder-851351-1-smb devstack@keystone.service[207601]: [pid: 207601|app: 0|req: 232/462] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 08:24:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 08:24:16.023278 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9debb6e0-0fe0-47f4-903d-d7cb3eb24c48 None None] Authenticating user token {{(pid=207601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:24:16.086659 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46858fbf-8cce-4581-9c31-1825bcd8a5d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:24:16.087528 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46858fbf-8cce-4581-9c31-1825bcd8a5d1 None admin] REQUEST_METHOD: `GET` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:24:16.087916 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46858fbf-8cce-4581-9c31-1825bcd8a5d1 None admin] SCRIPT_NAME: `/identity` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:24:16.088647 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46858fbf-8cce-4581-9c31-1825bcd8a5d1 None admin] PATH_INFO: `/v3/domains` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:24:16.089597 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46858fbf-8cce-4581-9c31-1825bcd8a5d1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=207600) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:24:16.090014 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46858fbf-8cce-4581-9c31-1825bcd8a5d1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:24:16.091645 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46858fbf-8cce-4581-9c31-1825bcd8a5d1 None admin] RBAC: Authorization granted {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:24:16.105367 dv-cinder-851351-1-smb devstack@keystone.service[207600]: [pid: 207600|app: 0|req: 231/463] 10.222.0.42 () {56 vars in 1109 bytes} [Thu Jul 28 08:24:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:24:16.106429 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46858fbf-8cce-4581-9c31-1825bcd8a5d1 None admin] Authenticating user token {{(pid=207600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:24:16.175523 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9debb6e0-0fe0-47f4-903d-d7cb3eb24c48 None None] Validating token access rules against request {{(pid=207601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:24:16.222346 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef69498c-6233-48e0-97fc-f7a4b84d0b64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:24:16.223191 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef69498c-6233-48e0-97fc-f7a4b84d0b64 None admin] REQUEST_METHOD: `GET` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:24:16.223733 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef69498c-6233-48e0-97fc-f7a4b84d0b64 None admin] SCRIPT_NAME: `/identity` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:24:16.224112 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef69498c-6233-48e0-97fc-f7a4b84d0b64 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:24:16.233720 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46858fbf-8cce-4581-9c31-1825bcd8a5d1 None admin] Validating token access rules against request {{(pid=207600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:24:16.238582 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef69498c-6233-48e0-97fc-f7a4b84d0b64 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:24:16.240188 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef69498c-6233-48e0-97fc-f7a4b84d0b64 None admin] RBAC: Authorization granted {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:24:16.249311 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG dbcounter [-] [207600] Writing DB stats keystone:SELECT=100 {{(pid=207600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:24:16.259841 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application [None req-ef69498c-6233-48e0-97fc-f7a4b84d0b64 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 08:24:16.259841 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:24:16.259841 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:24:16.259841 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:24:16.259841 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:24:16.259841 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:24:16.259841 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:24:16.259841 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:24:16.259841 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:24:16.259841 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:24:16.259841 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:24:16.259841 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:24:16.259841 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 08:24:16.259841 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 08:24:16.259841 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 08:24:16.262101 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 08:24:16.262101 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:24:16.262101 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:24:16.262101 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:24:16.262101 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:24:16.262101 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:24:16.262101 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:24:16.262101 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:24:16.262101 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application with Lock( Jul 28 08:24:16.262101 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:24:16.262101 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:24:16.262101 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:24:16.262101 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:24:16.262101 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:24:16.262101 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:24:16.262101 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:24:16.262101 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:24:16.264316 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 08:24:16.264316 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 08:24:16.264316 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 08:24:16.264316 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application Jul 28 08:24:16.264316 dv-cinder-851351-1-smb devstack@keystone.service[207601]: [pid: 207601|app: 0|req: 233/464] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 08:24:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:24:16.264316 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef69498c-6233-48e0-97fc-f7a4b84d0b64 None admin] Authenticating user token {{(pid=207601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:24:16.273196 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f0709fa-090f-4878-a85a-816de6a10d08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:24:16.273857 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0709fa-090f-4878-a85a-816de6a10d08 None admin] REQUEST_METHOD: `GET` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:24:16.274140 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0709fa-090f-4878-a85a-816de6a10d08 None admin] SCRIPT_NAME: `/identity` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:24:16.274457 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0709fa-090f-4878-a85a-816de6a10d08 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:24:16.286181 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f0709fa-090f-4878-a85a-816de6a10d08 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:24:16.287676 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f0709fa-090f-4878-a85a-816de6a10d08 None admin] RBAC: Authorization granted {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:24:16.302639 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application [None req-5f0709fa-090f-4878-a85a-816de6a10d08 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 08:24:16.302639 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:24:16.302639 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:24:16.302639 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:24:16.302639 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:24:16.302639 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:24:16.302639 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:24:16.302639 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:24:16.302639 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:24:16.302639 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:24:16.302639 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:24:16.302639 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:24:16.302639 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 08:24:16.302639 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 08:24:16.302639 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 08:24:16.303637 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 08:24:16.303637 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:24:16.303637 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:24:16.303637 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:24:16.303637 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:24:16.303637 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:24:16.303637 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:24:16.303637 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:24:16.303637 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application with Lock( Jul 28 08:24:16.303637 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:24:16.303637 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:24:16.303637 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:24:16.303637 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:24:16.303637 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:24:16.303637 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:24:16.303637 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:24:16.303637 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:24:16.305301 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 08:24:16.305301 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 08:24:16.305301 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 08:24:16.305301 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application Jul 28 08:24:16.305301 dv-cinder-851351-1-smb devstack@keystone.service[207600]: [pid: 207600|app: 0|req: 232/465] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 08:24:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:24:16.310258 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374fdf07-be1d-45ae-8dcf-59e05c34933e None None] REQUEST_METHOD: `GET` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:24:16.310555 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374fdf07-be1d-45ae-8dcf-59e05c34933e None None] SCRIPT_NAME: `/identity` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:24:16.310837 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374fdf07-be1d-45ae-8dcf-59e05c34933e None None] PATH_INFO: `/` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:24:16.312191 dv-cinder-851351-1-smb devstack@keystone.service[207600]: [pid: 207600|app: 0|req: 233/466] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 08:24:16 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 08:24:16.313285 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374fdf07-be1d-45ae-8dcf-59e05c34933e None None] Authenticating user token {{(pid=207600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:24:16.321277 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG dbcounter [-] [207601] Writing DB stats keystone:SELECT=100 {{(pid=207601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:24:16.376739 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef69498c-6233-48e0-97fc-f7a4b84d0b64 None admin] Validating token access rules against request {{(pid=207601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:24:16.413977 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc15619-b36d-4dd4-be1f-b0ab26a0eaa7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:24:16.414666 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc15619-b36d-4dd4-be1f-b0ab26a0eaa7 None admin] REQUEST_METHOD: `POST` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:24:16.414961 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc15619-b36d-4dd4-be1f-b0ab26a0eaa7 None admin] SCRIPT_NAME: `/identity` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:24:16.415236 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc15619-b36d-4dd4-be1f-b0ab26a0eaa7 None admin] PATH_INFO: `/v3/users` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:24:16.416125 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fc15619-b36d-4dd4-be1f-b0ab26a0eaa7 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:24:16.417838 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fc15619-b36d-4dd4-be1f-b0ab26a0eaa7 None admin] RBAC: Authorization granted {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:24:16.422941 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374fdf07-be1d-45ae-8dcf-59e05c34933e None None] Validating token access rules against request {{(pid=207600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:24:16.448706 dv-cinder-851351-1-smb devstack@keystone.service[207601]: [pid: 207601|app: 0|req: 234/467] 10.222.0.42 () {60 vars in 1132 bytes} [Thu Jul 28 08:24:16 2022] POST /identity/v3/users => generated 246 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 08:24:16.448706 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc15619-b36d-4dd4-be1f-b0ab26a0eaa7 None admin] Authenticating user token {{(pid=207601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:24:16.477022 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d19baab-4ac3-49f4-9c3f-fd3f1cfb2246 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:24:16.477982 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d19baab-4ac3-49f4-9c3f-fd3f1cfb2246 None admin] REQUEST_METHOD: `GET` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:24:16.478859 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d19baab-4ac3-49f4-9c3f-fd3f1cfb2246 None admin] SCRIPT_NAME: `/identity` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:24:16.479142 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d19baab-4ac3-49f4-9c3f-fd3f1cfb2246 None admin] PATH_INFO: `/v3/domains` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:24:16.480567 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d19baab-4ac3-49f4-9c3f-fd3f1cfb2246 None admin] RBAC: Adding query filter params (name=Default) {{(pid=207600) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:24:16.480922 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d19baab-4ac3-49f4-9c3f-fd3f1cfb2246 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:24:16.483303 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d19baab-4ac3-49f4-9c3f-fd3f1cfb2246 None admin] RBAC: Authorization granted {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:24:16.500686 dv-cinder-851351-1-smb devstack@keystone.service[207600]: [pid: 207600|app: 0|req: 234/468] 10.222.0.42 () {56 vars in 1109 bytes} [Thu Jul 28 08:24:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:24:16.502124 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce9b1bd-2468-4381-88d9-aca0b6f4f26b None None] REQUEST_METHOD: `POST` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:24:16.502415 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce9b1bd-2468-4381-88d9-aca0b6f4f26b None None] SCRIPT_NAME: `/identity` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:24:16.502687 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce9b1bd-2468-4381-88d9-aca0b6f4f26b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:24:16.530605 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.auth.core [None req-6ce9b1bd-2468-4381-88d9-aca0b6f4f26b None None] MFA Rules not processed for user `b8110ade874c4aa7af27f5c376df700a`. Rule list: `[]` (Enabled: `True`). {{(pid=207600) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 08:24:16.531981 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.fernet_utils [None req-6ce9b1bd-2468-4381-88d9-aca0b6f4f26b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=207600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:24:16.563959 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG dbcounter [-] [207600] Writing DB stats keystone:SELECT=100 {{(pid=207600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:24:16.578133 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc15619-b36d-4dd4-be1f-b0ab26a0eaa7 None admin] Validating token access rules against request {{(pid=207601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:24:16.587003 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG dbcounter [-] [207601] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=207601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:24:16.629234 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-965f62ee-a561-4cbf-84e9-f19cfd9f6ec0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:24:16.629901 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965f62ee-a561-4cbf-84e9-f19cfd9f6ec0 None admin] REQUEST_METHOD: `GET` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:24:16.630283 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965f62ee-a561-4cbf-84e9-f19cfd9f6ec0 None admin] SCRIPT_NAME: `/identity` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:24:16.630630 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965f62ee-a561-4cbf-84e9-f19cfd9f6ec0 None admin] PATH_INFO: `/v3/domains` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:24:16.631449 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-965f62ee-a561-4cbf-84e9-f19cfd9f6ec0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=207601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:24:16.631832 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-965f62ee-a561-4cbf-84e9-f19cfd9f6ec0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:24:16.633523 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-965f62ee-a561-4cbf-84e9-f19cfd9f6ec0 None admin] RBAC: Authorization granted {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:24:16.640649 dv-cinder-851351-1-smb devstack@keystone.service[207600]: [pid: 207600|app: 0|req: 235/469] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 08:24:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 08:24:16.641616 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce9b1bd-2468-4381-88d9-aca0b6f4f26b None None] Authenticating user token {{(pid=207600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:24:16.652840 dv-cinder-851351-1-smb devstack@keystone.service[207601]: [pid: 207601|app: 0|req: 235/470] 10.222.0.42 () {56 vars in 1109 bytes} [Thu Jul 28 08:24:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:24:16.654827 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-965f62ee-a561-4cbf-84e9-f19cfd9f6ec0 None admin] Authenticating user token {{(pid=207601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:24:16.761090 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce9b1bd-2468-4381-88d9-aca0b6f4f26b None None] Validating token access rules against request {{(pid=207600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:24:16.777556 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-965f62ee-a561-4cbf-84e9-f19cfd9f6ec0 None admin] Validating token access rules against request {{(pid=207601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:24:16.810122 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc98c77-c098-4198-81b5-99c6e1fb453f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:24:16.811721 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc98c77-c098-4198-81b5-99c6e1fb453f None admin] REQUEST_METHOD: `POST` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:24:16.812163 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc98c77-c098-4198-81b5-99c6e1fb453f None admin] SCRIPT_NAME: `/identity` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:24:16.812867 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc98c77-c098-4198-81b5-99c6e1fb453f None admin] PATH_INFO: `/v3/users` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:24:16.814010 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc98c77-c098-4198-81b5-99c6e1fb453f None admin] RBAC: Authorizing `identity:create_user()` {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:24:16.816410 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc98c77-c098-4198-81b5-99c6e1fb453f None admin] RBAC: Authorization granted {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:24:16.822567 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a89d218-712f-438b-a825-f1da9398cb3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:24:16.823214 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a89d218-712f-438b-a825-f1da9398cb3f None admin] REQUEST_METHOD: `POST` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:24:16.823570 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a89d218-712f-438b-a825-f1da9398cb3f None admin] SCRIPT_NAME: `/identity` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:24:16.823850 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a89d218-712f-438b-a825-f1da9398cb3f None admin] PATH_INFO: `/v3/users` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:24:16.824566 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a89d218-712f-438b-a825-f1da9398cb3f None admin] RBAC: Authorizing `identity:create_user()` {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:24:16.826042 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a89d218-712f-438b-a825-f1da9398cb3f None admin] RBAC: Authorization granted {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:24:16.844215 dv-cinder-851351-1-smb devstack@keystone.service[207600]: [pid: 207600|app: 0|req: 236/471] 10.222.0.42 () {60 vars in 1132 bytes} [Thu Jul 28 08:24:16 2022] POST /identity/v3/users => generated 248 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 08:24:16.845428 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc98c77-c098-4198-81b5-99c6e1fb453f None admin] Authenticating user token {{(pid=207600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:24:16.866458 dv-cinder-851351-1-smb devstack@keystone.service[207601]: [pid: 207601|app: 0|req: 236/472] 10.222.0.42 () {60 vars in 1132 bytes} [Thu Jul 28 08:24:16 2022] POST /identity/v3/users => generated 248 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 08:24:16.876851 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG dbcounter [-] [207600] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=207600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:24:16.990027 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc98c77-c098-4198-81b5-99c6e1fb453f None admin] Validating token access rules against request {{(pid=207600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:24:17.030469 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759b59a5-b5eb-4c55-a2ee-6dd102c6b629 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:24:17.031154 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759b59a5-b5eb-4c55-a2ee-6dd102c6b629 None admin] REQUEST_METHOD: `GET` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:24:17.031435 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759b59a5-b5eb-4c55-a2ee-6dd102c6b629 None admin] SCRIPT_NAME: `/identity` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:24:17.031708 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759b59a5-b5eb-4c55-a2ee-6dd102c6b629 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:24:17.044818 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-759b59a5-b5eb-4c55-a2ee-6dd102c6b629 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:24:17.046374 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-759b59a5-b5eb-4c55-a2ee-6dd102c6b629 None admin] RBAC: Authorization granted {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:24:17.055139 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a743b09-f77e-4d56-85b9-72763782fa58 None None] REQUEST_METHOD: `GET` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:24:17.055794 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a743b09-f77e-4d56-85b9-72763782fa58 None None] SCRIPT_NAME: `/identity` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:24:17.056335 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a743b09-f77e-4d56-85b9-72763782fa58 None None] PATH_INFO: `/` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:24:17.058450 dv-cinder-851351-1-smb devstack@keystone.service[207601]: [pid: 207601|app: 0|req: 237/473] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 08:24:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 08:24:17.063297 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application [None req-759b59a5-b5eb-4c55-a2ee-6dd102c6b629 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 08:24:17.063297 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:24:17.063297 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:24:17.063297 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:24:17.063297 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:24:17.063297 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:24:17.063297 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:24:17.063297 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:24:17.063297 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:24:17.063297 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:24:17.063297 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:24:17.063297 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:24:17.063297 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 08:24:17.063297 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 08:24:17.063297 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 08:24:17.064324 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 08:24:17.064324 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:24:17.064324 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:24:17.064324 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:24:17.064324 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:24:17.064324 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:24:17.064324 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:24:17.064324 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:24:17.064324 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application with Lock( Jul 28 08:24:17.064324 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:24:17.064324 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:24:17.064324 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:24:17.064324 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:24:17.064324 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:24:17.064324 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:24:17.064324 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:24:17.064324 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:24:17.065321 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 08:24:17.065321 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 08:24:17.065321 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 08:24:17.065321 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application Jul 28 08:24:17.065321 dv-cinder-851351-1-smb devstack@keystone.service[207600]: [pid: 207600|app: 0|req: 237/474] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 08:24:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:24:17.065628 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc0044d-ec4c-4a2e-8b2c-ddaeb04125d5 None None] REQUEST_METHOD: `POST` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:24:17.065628 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc0044d-ec4c-4a2e-8b2c-ddaeb04125d5 None None] SCRIPT_NAME: `/identity` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:24:17.065628 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc0044d-ec4c-4a2e-8b2c-ddaeb04125d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:24:17.070953 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759b59a5-b5eb-4c55-a2ee-6dd102c6b629 None admin] Authenticating user token {{(pid=207600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:24:17.100871 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.auth.core [None req-bcc0044d-ec4c-4a2e-8b2c-ddaeb04125d5 None None] MFA Rules not processed for user `b8110ade874c4aa7af27f5c376df700a`. Rule list: `[]` (Enabled: `True`). {{(pid=207601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 08:24:17.102245 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.fernet_utils [None req-bcc0044d-ec4c-4a2e-8b2c-ddaeb04125d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=207601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:24:17.128994 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG dbcounter [-] [207601] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=207601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:24:17.160763 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG dbcounter [-] [207600] Writing DB stats keystone:SELECT=100 {{(pid=207600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:24:17.199518 dv-cinder-851351-1-smb devstack@keystone.service[207601]: [pid: 207601|app: 0|req: 238/475] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 08:24:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 08:24:17.209727 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759b59a5-b5eb-4c55-a2ee-6dd102c6b629 None admin] Validating token access rules against request {{(pid=207600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:24:17.222745 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc0044d-ec4c-4a2e-8b2c-ddaeb04125d5 None None] Authenticating user token {{(pid=207601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:24:17.254408 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d75ff39-dad6-4afb-9a2b-089e91597b17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:24:17.255836 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d75ff39-dad6-4afb-9a2b-089e91597b17 None admin] REQUEST_METHOD: `GET` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:24:17.256480 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d75ff39-dad6-4afb-9a2b-089e91597b17 None admin] SCRIPT_NAME: `/identity` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:24:17.257101 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d75ff39-dad6-4afb-9a2b-089e91597b17 None admin] PATH_INFO: `/v3/domains` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:24:17.258051 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d75ff39-dad6-4afb-9a2b-089e91597b17 None admin] RBAC: Adding query filter params (name=Default) {{(pid=207600) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:24:17.258733 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d75ff39-dad6-4afb-9a2b-089e91597b17 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:24:17.261037 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d75ff39-dad6-4afb-9a2b-089e91597b17 None admin] RBAC: Authorization granted {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:24:17.277535 dv-cinder-851351-1-smb devstack@keystone.service[207600]: [pid: 207600|app: 0|req: 238/476] 10.222.0.42 () {56 vars in 1109 bytes} [Thu Jul 28 08:24:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 08:24:17.283163 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d75ff39-dad6-4afb-9a2b-089e91597b17 None admin] Authenticating user token {{(pid=207600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:24:17.344116 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc0044d-ec4c-4a2e-8b2c-ddaeb04125d5 None None] Validating token access rules against request {{(pid=207601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:24:17.384048 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-516a942a-1b38-4135-bc9e-f37429ebb4df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:24:17.388783 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516a942a-1b38-4135-bc9e-f37429ebb4df None admin] REQUEST_METHOD: `POST` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:24:17.388783 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516a942a-1b38-4135-bc9e-f37429ebb4df None admin] SCRIPT_NAME: `/identity` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:24:17.388783 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516a942a-1b38-4135-bc9e-f37429ebb4df None admin] PATH_INFO: `/v3/roles` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:24:17.388783 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-516a942a-1b38-4135-bc9e-f37429ebb4df None admin] RBAC: Authorizing `identity:create_role()` {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:24:17.388783 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-516a942a-1b38-4135-bc9e-f37429ebb4df None admin] RBAC: Authorization granted {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:24:17.396371 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.sql.core [None req-516a942a-1b38-4135-bc9e-f37429ebb4df None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jul 28 08:24:17.396371 dv-cinder-851351-1-smb devstack@keystone.service[207601]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Jul 28 08:24:17.396371 dv-cinder-851351-1-smb devstack@keystone.service[207601]: [parameters: {'id': '508155216b5f477db93246937d57975d', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Jul 28 08:24:17.396371 dv-cinder-851351-1-smb devstack@keystone.service[207601]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=207601) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jul 28 08:24:17.408988 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d75ff39-dad6-4afb-9a2b-089e91597b17 None admin] Validating token access rules against request {{(pid=207600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:24:17.414177 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application [None req-516a942a-1b38-4135-bc9e-f37429ebb4df None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Jul 28 08:24:17.414177 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:24:17.414177 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 28 08:24:17.414177 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 28 08:24:17.414177 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 28 08:24:17.414177 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 28 08:24:17.414177 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 28 08:24:17.414177 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application result = self._query(query) Jul 28 08:24:17.414177 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 28 08:24:17.414177 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application conn.query(q) Jul 28 08:24:17.414177 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 28 08:24:17.414177 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 28 08:24:17.414177 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 28 08:24:17.414177 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application result.read() Jul 28 08:24:17.414177 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 28 08:24:17.415156 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 28 08:24:17.415156 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 28 08:24:17.415156 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 28 08:24:17.415156 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 28 08:24:17.415156 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 28 08:24:17.415156 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 28 08:24:17.415156 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 28 08:24:17.415156 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jul 28 08:24:17.415156 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application Jul 28 08:24:17.415156 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jul 28 08:24:17.415156 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application Jul 28 08:24:17.415156 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:24:17.415156 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jul 28 08:24:17.415156 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jul 28 08:24:17.415156 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role Jul 28 08:24:17.415156 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return ref.to_dict() Jul 28 08:24:17.415156 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 28 08:24:17.415156 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application next(self.gen) Jul 28 08:24:17.416457 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jul 28 08:24:17.416457 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application yield resource Jul 28 08:24:17.416457 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 28 08:24:17.416457 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application next(self.gen) Jul 28 08:24:17.416457 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jul 28 08:24:17.416457 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application self.session.rollback() Jul 28 08:24:17.416457 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 28 08:24:17.416457 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application self.force_reraise() Jul 28 08:24:17.416457 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 28 08:24:17.416457 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application raise self.value Jul 28 08:24:17.416457 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jul 28 08:24:17.416457 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jul 28 08:24:17.416457 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jul 28 08:24:17.416457 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application session.commit() Jul 28 08:24:17.416457 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jul 28 08:24:17.416457 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jul 28 08:24:17.416457 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jul 28 08:24:17.417689 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application self._prepare_impl() Jul 28 08:24:17.417689 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jul 28 08:24:17.417689 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application self.session.flush() Jul 28 08:24:17.417689 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jul 28 08:24:17.417689 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application self._flush(objects) Jul 28 08:24:17.417689 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jul 28 08:24:17.417689 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jul 28 08:24:17.417689 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jul 28 08:24:17.417689 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application compat.raise_( Jul 28 08:24:17.417689 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 28 08:24:17.417689 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application raise exception Jul 28 08:24:17.417689 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jul 28 08:24:17.417689 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application flush_context.execute() Jul 28 08:24:17.417689 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jul 28 08:24:17.417689 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application rec.execute(self) Jul 28 08:24:17.417689 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jul 28 08:24:17.417689 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jul 28 08:24:17.418663 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jul 28 08:24:17.418663 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application _emit_insert_statements( Jul 28 08:24:17.418663 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Jul 28 08:24:17.418663 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application c = connection._execute_20( Jul 28 08:24:17.418663 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jul 28 08:24:17.418663 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jul 28 08:24:17.418663 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Jul 28 08:24:17.418663 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jul 28 08:24:17.418663 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jul 28 08:24:17.418663 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application ret = self._execute_context( Jul 28 08:24:17.418663 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jul 28 08:24:17.418663 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jul 28 08:24:17.418663 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jul 28 08:24:17.418663 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jul 28 08:24:17.418663 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 28 08:24:17.418663 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application raise exception Jul 28 08:24:17.419561 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 28 08:24:17.419561 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 28 08:24:17.419561 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 28 08:24:17.419561 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 28 08:24:17.419561 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 28 08:24:17.419561 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application result = self._query(query) Jul 28 08:24:17.419561 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 28 08:24:17.419561 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application conn.query(q) Jul 28 08:24:17.419561 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 28 08:24:17.419561 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 28 08:24:17.419561 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 28 08:24:17.419561 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application result.read() Jul 28 08:24:17.419561 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 28 08:24:17.419561 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 28 08:24:17.419561 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 28 08:24:17.419561 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 28 08:24:17.420436 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 28 08:24:17.420436 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 28 08:24:17.420436 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 28 08:24:17.420436 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 28 08:24:17.420436 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jul 28 08:24:17.420436 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Jul 28 08:24:17.420436 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application [parameters: {'id': '508155216b5f477db93246937d57975d', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Jul 28 08:24:17.420436 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jul 28 08:24:17.420436 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application Jul 28 08:24:17.420436 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 28 08:24:17.420436 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application Jul 28 08:24:17.420436 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:24:17.420436 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:24:17.420436 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:24:17.420436 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:24:17.420436 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:24:17.421420 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:24:17.421420 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:24:17.421420 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:24:17.421420 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:24:17.421420 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:24:17.421420 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:24:17.421420 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post Jul 28 08:24:17.421420 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( Jul 28 08:24:17.421420 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:24:17.421420 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:24:17.421420 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role Jul 28 08:24:17.421420 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) Jul 28 08:24:17.421420 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jul 28 08:24:17.421420 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jul 28 08:24:17.421420 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Jul 28 08:24:17.421420 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application Jul 28 08:24:17.422346 dv-cinder-851351-1-smb devstack@keystone.service[207601]: [pid: 207601|app: 0|req: 239/477] 10.222.0.42 () {60 vars in 1131 bytes} [Thu Jul 28 08:24:17 2022] POST /identity/v3/roles => generated 144 bytes in 194 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Jul 28 08:24:17.425424 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-516a942a-1b38-4135-bc9e-f37429ebb4df None admin] Authenticating user token {{(pid=207601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:24:17.444697 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG dbcounter [-] [207600] Writing DB stats keystone:SELECT=100 {{(pid=207600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:24:17.456314 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG dbcounter [-] [207601] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=207601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:24:17.476984 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d8ce25-3443-47c4-86cd-9f789ca22571 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:24:17.477929 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d8ce25-3443-47c4-86cd-9f789ca22571 None admin] REQUEST_METHOD: `POST` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:24:17.478368 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d8ce25-3443-47c4-86cd-9f789ca22571 None admin] SCRIPT_NAME: `/identity` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:24:17.478807 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d8ce25-3443-47c4-86cd-9f789ca22571 None admin] PATH_INFO: `/v3/users` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:24:17.479811 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28d8ce25-3443-47c4-86cd-9f789ca22571 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:24:17.481515 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28d8ce25-3443-47c4-86cd-9f789ca22571 None admin] RBAC: Authorization granted {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:24:17.538802 dv-cinder-851351-1-smb devstack@keystone.service[207600]: [pid: 207600|app: 0|req: 239/478] 10.222.0.42 () {60 vars in 1132 bytes} [Thu Jul 28 08:24:17 2022] POST /identity/v3/users => generated 249 bytes in 256 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 28 08:24:17.563805 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-516a942a-1b38-4135-bc9e-f37429ebb4df None admin] Validating token access rules against request {{(pid=207601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:24:17.607127 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eeb2a15-1a89-44e9-bc9c-e53ab33c6622 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:24:17.608007 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eeb2a15-1a89-44e9-bc9c-e53ab33c6622 None admin] REQUEST_METHOD: `GET` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:24:17.608451 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eeb2a15-1a89-44e9-bc9c-e53ab33c6622 None admin] SCRIPT_NAME: `/identity` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:24:17.608871 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eeb2a15-1a89-44e9-bc9c-e53ab33c6622 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:24:17.621464 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eeb2a15-1a89-44e9-bc9c-e53ab33c6622 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 08:24:17.627420 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application [None req-7eeb2a15-1a89-44e9-bc9c-e53ab33c6622 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 28 08:24:17.627420 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:24:17.627420 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:24:17.627420 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:24:17.627420 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:24:17.627420 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:24:17.627420 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:24:17.627420 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:24:17.627420 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:24:17.627420 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:24:17.627420 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:24:17.627420 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:24:17.627420 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 08:24:17.627420 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 08:24:17.627420 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 08:24:17.627420 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 08:24:17.628521 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 08:24:17.628521 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 08:24:17.628521 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 08:24:17.628521 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 08:24:17.628521 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:24:17.628521 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:24:17.628521 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:24:17.628521 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:24:17.628521 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:24:17.628521 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:24:17.628521 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:24:17.628521 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application with Lock( Jul 28 08:24:17.628521 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:24:17.628521 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:24:17.628521 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:24:17.628521 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:24:17.629755 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:24:17.629755 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:24:17.629755 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:24:17.629755 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:24:17.629755 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 08:24:17.629755 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 08:24:17.629755 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 08:24:17.629755 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 08:24:17.629755 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 08:24:17.629755 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 08:24:17.629755 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 28 08:24:17.629755 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application Jul 28 08:24:17.629755 dv-cinder-851351-1-smb devstack@keystone.service[207601]: [pid: 207601|app: 0|req: 240/479] 10.222.0.42 () {56 vars in 1114 bytes} [Thu Jul 28 08:24:17 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:24:17.635065 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d8ce25-3443-47c4-86cd-9f789ca22571 None admin] Authenticating user token {{(pid=207600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:24:17.796336 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d8ce25-3443-47c4-86cd-9f789ca22571 None admin] Validating token access rules against request {{(pid=207600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:24:17.833831 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0959dad6-cace-436a-8002-22de2ddad802 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:24:17.834472 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0959dad6-cace-436a-8002-22de2ddad802 None admin] REQUEST_METHOD: `GET` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:24:17.834762 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0959dad6-cace-436a-8002-22de2ddad802 None admin] SCRIPT_NAME: `/identity` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:24:17.835037 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0959dad6-cace-436a-8002-22de2ddad802 None admin] PATH_INFO: `/v3/roles` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:24:17.835789 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0959dad6-cace-436a-8002-22de2ddad802 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=207600) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:24:17.836101 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0959dad6-cace-436a-8002-22de2ddad802 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:24:17.837546 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0959dad6-cace-436a-8002-22de2ddad802 None admin] RBAC: Authorization granted {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:24:17.847267 dv-cinder-851351-1-smb devstack@keystone.service[207600]: [pid: 207600|app: 0|req: 240/480] 10.222.0.42 () {56 vars in 1111 bytes} [Thu Jul 28 08:24:17 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:24:18.943081 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26366a28-385e-4bfc-a290-7e113c3e6e9c None None] REQUEST_METHOD: `GET` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:24:18.943643 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26366a28-385e-4bfc-a290-7e113c3e6e9c None None] SCRIPT_NAME: `/identity` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:24:18.943643 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26366a28-385e-4bfc-a290-7e113c3e6e9c None None] PATH_INFO: `/` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:24:18.945315 dv-cinder-851351-1-smb devstack@keystone.service[207601]: [pid: 207601|app: 0|req: 241/481] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 08:24:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 08:24:18.951426 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0f0db1-1491-4392-be62-03e93da68587 None None] REQUEST_METHOD: `POST` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:24:18.951921 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0f0db1-1491-4392-be62-03e93da68587 None None] SCRIPT_NAME: `/identity` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:24:18.952137 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0f0db1-1491-4392-be62-03e93da68587 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:24:18.983724 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.auth.core [None req-ab0f0db1-1491-4392-be62-03e93da68587 None None] MFA Rules not processed for user `b8110ade874c4aa7af27f5c376df700a`. Rule list: `[]` (Enabled: `True`). {{(pid=207600) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 08:24:18.985408 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.fernet_utils [None req-ab0f0db1-1491-4392-be62-03e93da68587 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=207600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:24:19.054246 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG dbcounter [-] [207600] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=207600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:24:19.110676 dv-cinder-851351-1-smb devstack@keystone.service[207600]: [pid: 207600|app: 0|req: 241/482] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 08:24:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 08:24:19.167481 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26366a28-385e-4bfc-a290-7e113c3e6e9c None None] Authenticating user token {{(pid=207601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:24:19.273540 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG dbcounter [-] [207601] Writing DB stats keystone:SELECT=100 {{(pid=207601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:24:19.294889 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26366a28-385e-4bfc-a290-7e113c3e6e9c None None] Validating token access rules against request {{(pid=207601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:24:19.330179 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b455f226-2a9e-46f2-914a-c653426b50d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:24:19.330847 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b455f226-2a9e-46f2-914a-c653426b50d5 None admin] REQUEST_METHOD: `GET` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:24:19.331137 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b455f226-2a9e-46f2-914a-c653426b50d5 None admin] SCRIPT_NAME: `/identity` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:24:19.331420 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b455f226-2a9e-46f2-914a-c653426b50d5 None admin] PATH_INFO: `/v3/roles/service` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:24:19.343171 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b455f226-2a9e-46f2-914a-c653426b50d5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 08:24:19.348354 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application [None req-b455f226-2a9e-46f2-914a-c653426b50d5 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 28 08:24:19.348354 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:24:19.348354 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:24:19.348354 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:24:19.348354 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:24:19.348354 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:24:19.348354 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:24:19.348354 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:24:19.348354 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:24:19.348354 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:24:19.348354 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:24:19.348354 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:24:19.348354 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 08:24:19.348354 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 08:24:19.348354 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 08:24:19.348354 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 08:24:19.349378 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 08:24:19.349378 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 08:24:19.349378 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 08:24:19.349378 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 08:24:19.349378 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:24:19.349378 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:24:19.349378 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:24:19.349378 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:24:19.349378 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:24:19.349378 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:24:19.349378 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:24:19.349378 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application with Lock( Jul 28 08:24:19.349378 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:24:19.349378 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:24:19.349378 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:24:19.349378 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:24:19.350406 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:24:19.350406 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:24:19.350406 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:24:19.350406 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:24:19.350406 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 08:24:19.350406 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 08:24:19.350406 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 08:24:19.350406 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 08:24:19.350406 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 08:24:19.350406 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 08:24:19.350406 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 28 08:24:19.350406 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application Jul 28 08:24:19.350406 dv-cinder-851351-1-smb devstack@keystone.service[207601]: [pid: 207601|app: 0|req: 242/483] 10.222.0.42 () {56 vars in 1102 bytes} [Thu Jul 28 08:24:19 2022] GET /identity/v3/roles/service => generated 85 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:24:19.355667 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0f0db1-1491-4392-be62-03e93da68587 None None] Authenticating user token {{(pid=207600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:24:19.501898 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0f0db1-1491-4392-be62-03e93da68587 None None] Validating token access rules against request {{(pid=207600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:24:19.552356 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba231b2e-0867-4a1f-85b9-b98329baac2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:24:19.553049 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba231b2e-0867-4a1f-85b9-b98329baac2b None admin] REQUEST_METHOD: `GET` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:24:19.553337 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba231b2e-0867-4a1f-85b9-b98329baac2b None admin] SCRIPT_NAME: `/identity` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:24:19.553613 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba231b2e-0867-4a1f-85b9-b98329baac2b None admin] PATH_INFO: `/v3/roles` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:24:19.554372 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba231b2e-0867-4a1f-85b9-b98329baac2b None admin] RBAC: Adding query filter params (name=service) {{(pid=207600) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:24:19.554682 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba231b2e-0867-4a1f-85b9-b98329baac2b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:24:19.556101 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba231b2e-0867-4a1f-85b9-b98329baac2b None admin] RBAC: Authorization granted {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:24:19.565699 dv-cinder-851351-1-smb devstack@keystone.service[207600]: [pid: 207600|app: 0|req: 242/484] 10.222.0.42 () {56 vars in 1103 bytes} [Thu Jul 28 08:24:19 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:24:19.573985 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b455f226-2a9e-46f2-914a-c653426b50d5 None admin] Authenticating user token {{(pid=207601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:24:19.729090 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b455f226-2a9e-46f2-914a-c653426b50d5 None admin] Validating token access rules against request {{(pid=207601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:24:19.763938 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1234be06-7a93-4dda-96d4-9bd249228b54 None None] REQUEST_METHOD: `GET` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:24:19.764158 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1234be06-7a93-4dda-96d4-9bd249228b54 None None] SCRIPT_NAME: `/identity` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:24:19.764855 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1234be06-7a93-4dda-96d4-9bd249228b54 None None] PATH_INFO: `/` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:24:19.766079 dv-cinder-851351-1-smb devstack@keystone.service[207600]: [pid: 207600|app: 0|req: 243/485] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 08:24:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 08:24:19.771050 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b91bc51-15dd-47cb-b428-b158b453047a None None] REQUEST_METHOD: `POST` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:24:19.771838 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b91bc51-15dd-47cb-b428-b158b453047a None None] SCRIPT_NAME: `/identity` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:24:19.772196 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b91bc51-15dd-47cb-b428-b158b453047a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:24:19.788363 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd8b2ee9-cbc4-49cc-bcc3-37da5da77fac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:24:19.789587 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8b2ee9-cbc4-49cc-bcc3-37da5da77fac None admin] REQUEST_METHOD: `GET` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:24:19.790099 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8b2ee9-cbc4-49cc-bcc3-37da5da77fac None admin] SCRIPT_NAME: `/identity` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:24:19.790630 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8b2ee9-cbc4-49cc-bcc3-37da5da77fac None admin] PATH_INFO: `/v3/domains/Default` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:24:19.797057 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG dbcounter [-] [207601] Writing DB stats keystone:SELECT=100 {{(pid=207601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:24:19.801798 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.auth.core [None req-4b91bc51-15dd-47cb-b428-b158b453047a None None] MFA Rules not processed for user `b8110ade874c4aa7af27f5c376df700a`. Rule list: `[]` (Enabled: `True`). {{(pid=207600) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 08:24:19.809779 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.fernet_utils [None req-4b91bc51-15dd-47cb-b428-b158b453047a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=207600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:24:19.820796 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd8b2ee9-cbc4-49cc-bcc3-37da5da77fac None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:24:19.822606 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd8b2ee9-cbc4-49cc-bcc3-37da5da77fac None admin] RBAC: Authorization granted {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:24:19.844498 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application [None req-bd8b2ee9-cbc4-49cc-bcc3-37da5da77fac None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 08:24:19.844498 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:24:19.844498 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:24:19.844498 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:24:19.844498 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:24:19.844498 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:24:19.844498 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:24:19.844498 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:24:19.844498 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:24:19.844498 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:24:19.844498 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:24:19.844498 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:24:19.844498 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 08:24:19.844498 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 08:24:19.844498 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 08:24:19.845517 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 08:24:19.845517 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:24:19.845517 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:24:19.845517 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:24:19.845517 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:24:19.845517 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:24:19.845517 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:24:19.845517 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:24:19.845517 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application with Lock( Jul 28 08:24:19.845517 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:24:19.845517 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:24:19.845517 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:24:19.845517 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:24:19.845517 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:24:19.845517 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:24:19.845517 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:24:19.845517 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:24:19.846466 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 08:24:19.846466 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 08:24:19.846466 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 08:24:19.846466 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application Jul 28 08:24:19.854766 dv-cinder-851351-1-smb devstack@keystone.service[207601]: [pid: 207601|app: 0|req: 243/486] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 08:24:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 281 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:24:19.860589 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd8b2ee9-cbc4-49cc-bcc3-37da5da77fac None admin] Authenticating user token {{(pid=207601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:24:19.871910 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG dbcounter [-] [207600] Writing DB stats keystone:SELECT=100 {{(pid=207600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:24:19.924288 dv-cinder-851351-1-smb devstack@keystone.service[207600]: [pid: 207600|app: 0|req: 244/487] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 08:24:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 08:24:19.932686 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ee60a4-b068-4790-9347-c48a7e0ba0aa None None] REQUEST_METHOD: `GET` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:24:19.933445 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ee60a4-b068-4790-9347-c48a7e0ba0aa None None] SCRIPT_NAME: `/identity` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:24:19.933953 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ee60a4-b068-4790-9347-c48a7e0ba0aa None None] PATH_INFO: `/` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:24:19.935738 dv-cinder-851351-1-smb devstack@keystone.service[207600]: [pid: 207600|app: 0|req: 245/488] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 08:24:19 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 08:24:19.941674 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efc2ed2-db61-43f5-9d58-d21b2b8477d0 None None] REQUEST_METHOD: `POST` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:24:19.942218 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efc2ed2-db61-43f5-9d58-d21b2b8477d0 None None] SCRIPT_NAME: `/identity` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:24:19.942717 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efc2ed2-db61-43f5-9d58-d21b2b8477d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:24:19.974621 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.auth.core [None req-8efc2ed2-db61-43f5-9d58-d21b2b8477d0 None None] MFA Rules not processed for user `b8110ade874c4aa7af27f5c376df700a`. Rule list: `[]` (Enabled: `True`). {{(pid=207600) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 08:24:19.976767 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.fernet_utils [None req-8efc2ed2-db61-43f5-9d58-d21b2b8477d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=207600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:24:19.988809 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd8b2ee9-cbc4-49cc-bcc3-37da5da77fac None admin] Validating token access rules against request {{(pid=207601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:24:20.027982 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a33671fd-4b1a-4160-9068-ad1d7f11c684 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:24:20.028523 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33671fd-4b1a-4160-9068-ad1d7f11c684 None admin] REQUEST_METHOD: `GET` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:24:20.028936 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33671fd-4b1a-4160-9068-ad1d7f11c684 None admin] SCRIPT_NAME: `/identity` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:24:20.029463 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33671fd-4b1a-4160-9068-ad1d7f11c684 None admin] PATH_INFO: `/v3/domains` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:24:20.030380 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a33671fd-4b1a-4160-9068-ad1d7f11c684 None admin] RBAC: Adding query filter params (name=Default) {{(pid=207601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:24:20.030889 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a33671fd-4b1a-4160-9068-ad1d7f11c684 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:24:20.032612 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a33671fd-4b1a-4160-9068-ad1d7f11c684 None admin] RBAC: Authorization granted {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:24:20.048364 dv-cinder-851351-1-smb devstack@keystone.service[207601]: [pid: 207601|app: 0|req: 244/489] 10.222.0.42 () {56 vars in 1109 bytes} [Thu Jul 28 08:24:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:24:20.049856 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a33671fd-4b1a-4160-9068-ad1d7f11c684 None admin] Authenticating user token {{(pid=207601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:24:20.054568 dv-cinder-851351-1-smb devstack@keystone.service[207600]: [pid: 207600|app: 0|req: 246/490] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 08:24:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 28 08:24:20.055743 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8efc2ed2-db61-43f5-9d58-d21b2b8477d0 None None] Authenticating user token {{(pid=207600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:24:20.130268 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG dbcounter [-] [207601] Writing DB stats keystone:SELECT=100 {{(pid=207601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:24:20.160861 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG dbcounter [-] [207600] Writing DB stats keystone:SELECT=100 {{(pid=207600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:24:20.168797 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8efc2ed2-db61-43f5-9d58-d21b2b8477d0 None None] Validating token access rules against request {{(pid=207600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:24:20.193049 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a33671fd-4b1a-4160-9068-ad1d7f11c684 None admin] Validating token access rules against request {{(pid=207601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:24:20.207888 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb182cd0-a734-4076-903d-afde2c2a6765 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:24:20.209035 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb182cd0-a734-4076-903d-afde2c2a6765 None admin] REQUEST_METHOD: `GET` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:24:20.209587 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb182cd0-a734-4076-903d-afde2c2a6765 None admin] SCRIPT_NAME: `/identity` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:24:20.210090 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb182cd0-a734-4076-903d-afde2c2a6765 None admin] PATH_INFO: `/v3/users/nova` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:24:20.219457 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb182cd0-a734-4076-903d-afde2c2a6765 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:24:20.221693 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb182cd0-a734-4076-903d-afde2c2a6765 None admin] RBAC: Authorization granted {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:24:20.233511 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f31e887-a76d-41be-8af6-3244d86d98e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:24:20.234227 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f31e887-a76d-41be-8af6-3244d86d98e2 None admin] REQUEST_METHOD: `GET` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:24:20.234515 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f31e887-a76d-41be-8af6-3244d86d98e2 None admin] SCRIPT_NAME: `/identity` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:24:20.234799 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f31e887-a76d-41be-8af6-3244d86d98e2 None admin] PATH_INFO: `/v3/roles/service` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:24:20.238549 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application [None req-fb182cd0-a734-4076-903d-afde2c2a6765 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 28 08:24:20.238549 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:24:20.238549 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:24:20.238549 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:24:20.238549 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:24:20.238549 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:24:20.238549 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:24:20.238549 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:24:20.238549 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:24:20.238549 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:24:20.238549 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:24:20.238549 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:24:20.238549 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 28 08:24:20.238549 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 28 08:24:20.238549 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 28 08:24:20.238549 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 28 08:24:20.239629 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:24:20.239629 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:24:20.239629 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 28 08:24:20.239629 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 08:24:20.239629 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 28 08:24:20.239629 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 08:24:20.239629 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:24:20.239629 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:24:20.239629 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:24:20.239629 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:24:20.239629 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:24:20.239629 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application with Lock( Jul 28 08:24:20.239629 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:24:20.239629 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:24:20.239629 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:24:20.239629 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:24:20.239629 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:24:20.239629 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:24:20.240652 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:24:20.240652 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:24:20.240652 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 28 08:24:20.240652 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 28 08:24:20.240652 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 28 08:24:20.240652 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 28 08:24:20.240652 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 28 08:24:20.240652 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 28 08:24:20.240652 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 28 08:24:20.240652 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application Jul 28 08:24:20.243748 dv-cinder-851351-1-smb devstack@keystone.service[207600]: [pid: 207600|app: 0|req: 247/491] 10.222.0.42 () {56 vars in 1093 bytes} [Thu Jul 28 08:24:20 2022] GET /identity/v3/users/nova => generated 82 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:24:20.244930 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb182cd0-a734-4076-903d-afde2c2a6765 None admin] Authenticating user token {{(pid=207600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:24:20.255113 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f31e887-a76d-41be-8af6-3244d86d98e2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 08:24:20.266880 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application [None req-8f31e887-a76d-41be-8af6-3244d86d98e2 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 28 08:24:20.266880 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:24:20.266880 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:24:20.266880 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:24:20.266880 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:24:20.266880 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:24:20.266880 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:24:20.266880 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:24:20.266880 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:24:20.266880 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:24:20.266880 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:24:20.266880 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:24:20.266880 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 08:24:20.266880 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 08:24:20.266880 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 08:24:20.266880 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 08:24:20.268871 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 08:24:20.268871 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 08:24:20.268871 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 08:24:20.268871 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 08:24:20.268871 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:24:20.268871 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:24:20.268871 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:24:20.268871 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:24:20.268871 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:24:20.268871 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:24:20.268871 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:24:20.268871 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application with Lock( Jul 28 08:24:20.268871 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:24:20.268871 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:24:20.268871 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:24:20.268871 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:24:20.270626 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:24:20.270626 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:24:20.270626 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:24:20.270626 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:24:20.270626 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 08:24:20.270626 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 08:24:20.270626 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 08:24:20.270626 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 08:24:20.270626 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 08:24:20.270626 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 08:24:20.270626 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 28 08:24:20.270626 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application Jul 28 08:24:20.275781 dv-cinder-851351-1-smb devstack@keystone.service[207601]: [pid: 207601|app: 0|req: 245/492] 10.222.0.42 () {56 vars in 1102 bytes} [Thu Jul 28 08:24:20 2022] GET /identity/v3/roles/service => generated 85 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:24:20.277020 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f31e887-a76d-41be-8af6-3244d86d98e2 None admin] Authenticating user token {{(pid=207601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:24:20.405951 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb182cd0-a734-4076-903d-afde2c2a6765 None admin] Validating token access rules against request {{(pid=207600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:24:20.420162 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f31e887-a76d-41be-8af6-3244d86d98e2 None admin] Validating token access rules against request {{(pid=207601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:24:20.430634 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG dbcounter [-] [207601] Writing DB stats keystone:SELECT=100 {{(pid=207601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:24:20.460240 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801fea93-efb6-4b80-8709-be6d89d4b9c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:24:20.461367 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801fea93-efb6-4b80-8709-be6d89d4b9c4 None admin] REQUEST_METHOD: `GET` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:24:20.462527 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801fea93-efb6-4b80-8709-be6d89d4b9c4 None admin] SCRIPT_NAME: `/identity` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:24:20.462527 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801fea93-efb6-4b80-8709-be6d89d4b9c4 None admin] PATH_INFO: `/v3/roles/service` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:24:20.463986 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2741e207-e6e6-496d-9782-b6030e9ec165 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:24:20.464648 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2741e207-e6e6-496d-9782-b6030e9ec165 None admin] REQUEST_METHOD: `GET` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:24:20.464948 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2741e207-e6e6-496d-9782-b6030e9ec165 None admin] SCRIPT_NAME: `/identity` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:24:20.465218 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2741e207-e6e6-496d-9782-b6030e9ec165 None admin] PATH_INFO: `/v3/users` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:24:20.466041 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2741e207-e6e6-496d-9782-b6030e9ec165 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=207601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:24:20.466350 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2741e207-e6e6-496d-9782-b6030e9ec165 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:24:20.467829 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2741e207-e6e6-496d-9782-b6030e9ec165 None admin] RBAC: Authorization granted {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:24:20.482921 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-801fea93-efb6-4b80-8709-be6d89d4b9c4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 08:24:20.488799 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application [None req-801fea93-efb6-4b80-8709-be6d89d4b9c4 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 28 08:24:20.488799 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:24:20.488799 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:24:20.488799 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:24:20.488799 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:24:20.488799 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:24:20.488799 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:24:20.488799 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:24:20.488799 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:24:20.488799 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:24:20.488799 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:24:20.488799 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:24:20.488799 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 08:24:20.488799 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 08:24:20.488799 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 08:24:20.488799 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 08:24:20.489884 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 08:24:20.489884 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 08:24:20.489884 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 08:24:20.489884 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 08:24:20.489884 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:24:20.489884 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:24:20.489884 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:24:20.489884 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:24:20.489884 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:24:20.489884 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:24:20.489884 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:24:20.489884 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application with Lock( Jul 28 08:24:20.489884 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:24:20.489884 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:24:20.489884 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:24:20.489884 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:24:20.498821 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:24:20.498821 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:24:20.498821 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:24:20.498821 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:24:20.498821 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 08:24:20.498821 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 08:24:20.498821 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 08:24:20.498821 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 08:24:20.498821 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 08:24:20.498821 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 08:24:20.498821 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 28 08:24:20.498821 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application Jul 28 08:24:20.498821 dv-cinder-851351-1-smb devstack@keystone.service[207600]: [pid: 207600|app: 0|req: 248/493] 10.222.0.42 () {56 vars in 1102 bytes} [Thu Jul 28 08:24:20 2022] GET /identity/v3/roles/service => generated 85 bytes in 246 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:24:20.498821 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801fea93-efb6-4b80-8709-be6d89d4b9c4 None admin] Authenticating user token {{(pid=207600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:24:20.511558 dv-cinder-851351-1-smb devstack@keystone.service[207601]: [pid: 207601|app: 0|req: 246/494] 10.222.0.42 () {56 vars in 1133 bytes} [Thu Jul 28 08:24:20 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:24:20.512750 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5371030e-36c5-4b34-a3bf-ac7cddc7adbc None None] REQUEST_METHOD: `GET` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:24:20.513050 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5371030e-36c5-4b34-a3bf-ac7cddc7adbc None None] SCRIPT_NAME: `/identity` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:24:20.513329 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5371030e-36c5-4b34-a3bf-ac7cddc7adbc None None] PATH_INFO: `/` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:24:20.514821 dv-cinder-851351-1-smb devstack@keystone.service[207601]: [pid: 207601|app: 0|req: 247/495] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 08:24:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 08:24:20.515415 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5371030e-36c5-4b34-a3bf-ac7cddc7adbc None None] Authenticating user token {{(pid=207601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:24:20.523290 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG dbcounter [-] [207600] Writing DB stats keystone:SELECT=100 {{(pid=207600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:24:20.628067 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801fea93-efb6-4b80-8709-be6d89d4b9c4 None admin] Validating token access rules against request {{(pid=207600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:24:20.634884 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5371030e-36c5-4b34-a3bf-ac7cddc7adbc None None] Validating token access rules against request {{(pid=207601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:24:20.664756 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b4bc3c-47d7-4953-9b0e-4d789aaa8621 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:24:20.665398 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b4bc3c-47d7-4953-9b0e-4d789aaa8621 None admin] REQUEST_METHOD: `GET` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:24:20.665687 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b4bc3c-47d7-4953-9b0e-4d789aaa8621 None admin] SCRIPT_NAME: `/identity` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:24:20.665987 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b4bc3c-47d7-4953-9b0e-4d789aaa8621 None admin] PATH_INFO: `/v3/roles` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:24:20.666760 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70b4bc3c-47d7-4953-9b0e-4d789aaa8621 None admin] RBAC: Adding query filter params (name=service) {{(pid=207600) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:24:20.667089 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70b4bc3c-47d7-4953-9b0e-4d789aaa8621 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:24:20.668553 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70b4bc3c-47d7-4953-9b0e-4d789aaa8621 None admin] RBAC: Authorization granted {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:24:20.671930 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ecc4234-6282-48e6-a972-aaa0cd365fb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:24:20.672585 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ecc4234-6282-48e6-a972-aaa0cd365fb8 None admin] REQUEST_METHOD: `GET` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:24:20.672900 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ecc4234-6282-48e6-a972-aaa0cd365fb8 None admin] SCRIPT_NAME: `/identity` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:24:20.673180 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ecc4234-6282-48e6-a972-aaa0cd365fb8 None admin] PATH_INFO: `/v3/roles` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:24:20.673932 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ecc4234-6282-48e6-a972-aaa0cd365fb8 None admin] RBAC: Adding query filter params (name=service) {{(pid=207601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:24:20.674250 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ecc4234-6282-48e6-a972-aaa0cd365fb8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:24:20.675682 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ecc4234-6282-48e6-a972-aaa0cd365fb8 None admin] RBAC: Authorization granted {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:24:20.678523 dv-cinder-851351-1-smb devstack@keystone.service[207600]: [pid: 207600|app: 0|req: 249/496] 10.222.0.42 () {56 vars in 1103 bytes} [Thu Jul 28 08:24:20 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:24:20.679487 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b4bc3c-47d7-4953-9b0e-4d789aaa8621 None admin] Authenticating user token {{(pid=207600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:24:20.687099 dv-cinder-851351-1-smb devstack@keystone.service[207601]: [pid: 207601|app: 0|req: 248/497] 10.222.0.42 () {56 vars in 1103 bytes} [Thu Jul 28 08:24:20 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:24:20.688487 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d591b72e-1c60-4876-8f68-2538be046ddf None None] REQUEST_METHOD: `POST` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:24:20.688819 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d591b72e-1c60-4876-8f68-2538be046ddf None None] SCRIPT_NAME: `/identity` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:24:20.689103 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d591b72e-1c60-4876-8f68-2538be046ddf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:24:20.709924 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.auth.core [None req-d591b72e-1c60-4876-8f68-2538be046ddf None None] MFA Rules not processed for user `b8110ade874c4aa7af27f5c376df700a`. Rule list: `[]` (Enabled: `True`). {{(pid=207601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 08:24:20.711532 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.fernet_utils [None req-d591b72e-1c60-4876-8f68-2538be046ddf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=207601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:24:20.737449 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG dbcounter [-] [207601] Writing DB stats keystone:SELECT=100 {{(pid=207601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:24:20.763970 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG dbcounter [-] [207600] Writing DB stats keystone:SELECT=100 {{(pid=207600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:24:20.789419 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b4bc3c-47d7-4953-9b0e-4d789aaa8621 None admin] Validating token access rules against request {{(pid=207600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:24:20.799962 dv-cinder-851351-1-smb devstack@keystone.service[207601]: [pid: 207601|app: 0|req: 249/498] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 08:24:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 08:24:20.801461 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83db712-eeff-45fc-8324-7b4e35ce1a52 None None] REQUEST_METHOD: `GET` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:24:20.801758 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83db712-eeff-45fc-8324-7b4e35ce1a52 None None] SCRIPT_NAME: `/identity` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:24:20.802136 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83db712-eeff-45fc-8324-7b4e35ce1a52 None None] PATH_INFO: `/` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:24:20.803609 dv-cinder-851351-1-smb devstack@keystone.service[207601]: [pid: 207601|app: 0|req: 250/499] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 08:24:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 08:24:20.803609 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c83db712-eeff-45fc-8324-7b4e35ce1a52 None None] Authenticating user token {{(pid=207601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:24:20.832201 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe6fc2c7-928d-43a5-bf91-496738748dce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:24:20.832987 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6fc2c7-928d-43a5-bf91-496738748dce None admin] REQUEST_METHOD: `GET` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:24:20.833270 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6fc2c7-928d-43a5-bf91-496738748dce None admin] SCRIPT_NAME: `/identity` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:24:20.833548 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6fc2c7-928d-43a5-bf91-496738748dce None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:24:20.908142 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe6fc2c7-928d-43a5-bf91-496738748dce None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:24:20.909694 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe6fc2c7-928d-43a5-bf91-496738748dce None admin] RBAC: Authorization granted {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:24:20.921839 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c83db712-eeff-45fc-8324-7b4e35ce1a52 None None] Validating token access rules against request {{(pid=207601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:24:20.965437 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6190e1b-2401-4db7-993a-619c46af5330 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:24:20.966169 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6190e1b-2401-4db7-993a-619c46af5330 None admin] REQUEST_METHOD: `GET` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:24:20.966514 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6190e1b-2401-4db7-993a-619c46af5330 None admin] SCRIPT_NAME: `/identity` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:24:20.966796 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6190e1b-2401-4db7-993a-619c46af5330 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:24:20.982045 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6190e1b-2401-4db7-993a-619c46af5330 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:24:20.984083 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6190e1b-2401-4db7-993a-619c46af5330 None admin] RBAC: Authorization granted {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:24:20.999292 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG dbcounter [-] [207600] Writing DB stats keystone:SELECT=100 {{(pid=207600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:24:21.002384 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application [None req-d6190e1b-2401-4db7-993a-619c46af5330 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 08:24:21.002384 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:24:21.002384 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:24:21.002384 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:24:21.002384 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:24:21.002384 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:24:21.002384 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:24:21.002384 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:24:21.002384 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:24:21.002384 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:24:21.002384 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:24:21.002384 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:24:21.002384 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 08:24:21.002384 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 08:24:21.002384 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 08:24:21.003594 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 08:24:21.003594 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:24:21.003594 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:24:21.003594 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:24:21.003594 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:24:21.003594 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:24:21.003594 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:24:21.003594 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:24:21.003594 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application with Lock( Jul 28 08:24:21.003594 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:24:21.003594 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:24:21.003594 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:24:21.003594 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:24:21.003594 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:24:21.003594 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:24:21.003594 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:24:21.003594 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:24:21.004508 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 08:24:21.004508 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 08:24:21.004508 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 08:24:21.004508 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application Jul 28 08:24:21.004508 dv-cinder-851351-1-smb devstack@keystone.service[207601]: [pid: 207601|app: 0|req: 251/500] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 08:24:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:24:21.004508 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6190e1b-2401-4db7-993a-619c46af5330 None admin] Authenticating user token {{(pid=207601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:24:21.020981 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG dbcounter [-] [207601] Writing DB stats keystone:SELECT=100 {{(pid=207601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:24:21.024838 dv-cinder-851351-1-smb devstack@keystone.service[207600]: [pid: 207600|app: 0|req: 250/501] 10.222.0.42 () {58 vars in 1282 bytes} [Thu Jul 28 08:24:20 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 346 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 28 08:24:21.026134 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219150b1-7000-460a-8e64-5a4988cdfa54 None None] REQUEST_METHOD: `POST` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:24:21.026490 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219150b1-7000-460a-8e64-5a4988cdfa54 None None] SCRIPT_NAME: `/identity` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:24:21.026765 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219150b1-7000-460a-8e64-5a4988cdfa54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:24:21.045259 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.auth.core [None req-219150b1-7000-460a-8e64-5a4988cdfa54 None None] MFA Rules not processed for user `b8110ade874c4aa7af27f5c376df700a`. Rule list: `[]` (Enabled: `True`). {{(pid=207600) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 08:24:21.046535 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.fernet_utils [None req-219150b1-7000-460a-8e64-5a4988cdfa54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=207600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:24:21.112526 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6190e1b-2401-4db7-993a-619c46af5330 None admin] Validating token access rules against request {{(pid=207601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:24:21.117714 dv-cinder-851351-1-smb devstack@keystone.service[207600]: [pid: 207600|app: 0|req: 251/502] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 08:24:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 08:24:21.118604 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219150b1-7000-460a-8e64-5a4988cdfa54 None None] Authenticating user token {{(pid=207600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:24:21.161333 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9599c4-225b-4124-9216-7350009e5273 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:24:21.161996 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9599c4-225b-4124-9216-7350009e5273 None admin] REQUEST_METHOD: `GET` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:24:21.162282 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9599c4-225b-4124-9216-7350009e5273 None admin] SCRIPT_NAME: `/identity` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:24:21.162555 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9599c4-225b-4124-9216-7350009e5273 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:24:21.174223 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b9599c4-225b-4124-9216-7350009e5273 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:24:21.175607 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b9599c4-225b-4124-9216-7350009e5273 None admin] RBAC: Authorization granted {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:24:21.190705 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application [None req-5b9599c4-225b-4124-9216-7350009e5273 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 08:24:21.190705 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:24:21.190705 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:24:21.190705 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:24:21.190705 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:24:21.190705 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:24:21.190705 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:24:21.190705 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:24:21.190705 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:24:21.190705 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:24:21.190705 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:24:21.190705 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:24:21.190705 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 08:24:21.190705 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 08:24:21.190705 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 08:24:21.191913 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 08:24:21.191913 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:24:21.191913 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:24:21.191913 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:24:21.191913 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:24:21.191913 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:24:21.191913 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:24:21.191913 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:24:21.191913 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application with Lock( Jul 28 08:24:21.191913 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:24:21.191913 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:24:21.191913 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:24:21.191913 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:24:21.191913 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:24:21.191913 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:24:21.191913 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:24:21.191913 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:24:21.192953 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 08:24:21.192953 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 08:24:21.192953 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 08:24:21.192953 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application Jul 28 08:24:21.192953 dv-cinder-851351-1-smb devstack@keystone.service[207601]: [pid: 207601|app: 0|req: 252/503] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 08:24:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:24:21.193240 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9599c4-225b-4124-9216-7350009e5273 None admin] Authenticating user token {{(pid=207601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:24:21.229504 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219150b1-7000-460a-8e64-5a4988cdfa54 None None] Validating token access rules against request {{(pid=207600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:24:21.238472 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG dbcounter [-] [207600] Writing DB stats keystone:SELECT=100 {{(pid=207600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:24:21.266035 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG dbcounter [-] [207601] Writing DB stats keystone:SELECT=100 {{(pid=207601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:24:21.270618 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6a4346-4652-40f1-99a0-25ee1fcba69f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:24:21.271297 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6a4346-4652-40f1-99a0-25ee1fcba69f None admin] REQUEST_METHOD: `GET` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:24:21.271580 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6a4346-4652-40f1-99a0-25ee1fcba69f None admin] SCRIPT_NAME: `/identity` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:24:21.271855 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6a4346-4652-40f1-99a0-25ee1fcba69f None admin] PATH_INFO: `/v3/roles/service` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:24:21.288063 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f6a4346-4652-40f1-99a0-25ee1fcba69f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 08:24:21.296375 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application [None req-1f6a4346-4652-40f1-99a0-25ee1fcba69f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 28 08:24:21.296375 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:24:21.296375 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:24:21.296375 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:24:21.296375 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:24:21.296375 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:24:21.296375 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:24:21.296375 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:24:21.296375 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:24:21.296375 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:24:21.296375 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:24:21.296375 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:24:21.296375 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 08:24:21.296375 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 08:24:21.296375 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 08:24:21.296375 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 08:24:21.297470 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 08:24:21.297470 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 08:24:21.297470 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 08:24:21.297470 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 08:24:21.297470 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:24:21.297470 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:24:21.297470 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:24:21.297470 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:24:21.297470 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:24:21.297470 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:24:21.297470 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:24:21.297470 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application with Lock( Jul 28 08:24:21.297470 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:24:21.297470 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:24:21.297470 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:24:21.297470 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:24:21.298385 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:24:21.298385 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:24:21.298385 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:24:21.298385 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:24:21.298385 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 08:24:21.298385 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 08:24:21.298385 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 08:24:21.298385 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 08:24:21.298385 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 08:24:21.298385 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 08:24:21.298385 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 28 08:24:21.298385 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application Jul 28 08:24:21.300102 dv-cinder-851351-1-smb devstack@keystone.service[207600]: [pid: 207600|app: 0|req: 252/504] 10.222.0.42 () {56 vars in 1102 bytes} [Thu Jul 28 08:24:21 2022] GET /identity/v3/roles/service => generated 85 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:24:21.305470 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6a4346-4652-40f1-99a0-25ee1fcba69f None admin] Authenticating user token {{(pid=207600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:24:21.328045 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9599c4-225b-4124-9216-7350009e5273 None admin] Validating token access rules against request {{(pid=207601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:24:21.367903 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb2ffc17-77ea-41c6-bfd5-4d615e30188c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:24:21.368548 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2ffc17-77ea-41c6-bfd5-4d615e30188c None admin] REQUEST_METHOD: `GET` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:24:21.368874 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2ffc17-77ea-41c6-bfd5-4d615e30188c None admin] SCRIPT_NAME: `/identity` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:24:21.369137 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2ffc17-77ea-41c6-bfd5-4d615e30188c None admin] PATH_INFO: `/v3/domains` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:24:21.369857 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb2ffc17-77ea-41c6-bfd5-4d615e30188c None admin] RBAC: Adding query filter params (name=Default) {{(pid=207601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:24:21.370497 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb2ffc17-77ea-41c6-bfd5-4d615e30188c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:24:21.371611 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb2ffc17-77ea-41c6-bfd5-4d615e30188c None admin] RBAC: Authorization granted {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:24:21.384104 dv-cinder-851351-1-smb devstack@keystone.service[207601]: [pid: 207601|app: 0|req: 253/505] 10.222.0.42 () {56 vars in 1109 bytes} [Thu Jul 28 08:24:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:24:21.384995 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb2ffc17-77ea-41c6-bfd5-4d615e30188c None admin] Authenticating user token {{(pid=207601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:24:21.434597 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6a4346-4652-40f1-99a0-25ee1fcba69f None admin] Validating token access rules against request {{(pid=207600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:24:21.472756 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bae14e2-253d-4d37-b89d-b927b1e7b854 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:24:21.473420 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bae14e2-253d-4d37-b89d-b927b1e7b854 None admin] REQUEST_METHOD: `GET` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:24:21.473705 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bae14e2-253d-4d37-b89d-b927b1e7b854 None admin] SCRIPT_NAME: `/identity` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:24:21.473980 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bae14e2-253d-4d37-b89d-b927b1e7b854 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:24:21.485142 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bae14e2-253d-4d37-b89d-b927b1e7b854 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:24:21.486650 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bae14e2-253d-4d37-b89d-b927b1e7b854 None admin] RBAC: Authorization granted {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:24:21.502642 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb2ffc17-77ea-41c6-bfd5-4d615e30188c None admin] Validating token access rules against request {{(pid=207601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:24:21.506340 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application [None req-8bae14e2-253d-4d37-b89d-b927b1e7b854 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 08:24:21.506340 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:24:21.506340 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:24:21.506340 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:24:21.506340 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:24:21.506340 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:24:21.506340 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:24:21.506340 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:24:21.506340 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:24:21.506340 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:24:21.506340 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:24:21.506340 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:24:21.506340 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 08:24:21.506340 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 08:24:21.506340 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 08:24:21.507600 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 08:24:21.507600 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:24:21.507600 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:24:21.507600 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:24:21.507600 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:24:21.507600 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:24:21.507600 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:24:21.507600 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:24:21.507600 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application with Lock( Jul 28 08:24:21.507600 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:24:21.507600 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:24:21.507600 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:24:21.507600 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:24:21.507600 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:24:21.507600 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:24:21.507600 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:24:21.507600 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:24:21.509187 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 08:24:21.509187 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 08:24:21.509187 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 08:24:21.509187 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application Jul 28 08:24:21.509187 dv-cinder-851351-1-smb devstack@keystone.service[207600]: [pid: 207600|app: 0|req: 253/506] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 08:24:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:24:21.509187 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bae14e2-253d-4d37-b89d-b927b1e7b854 None admin] Authenticating user token {{(pid=207600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:24:21.527820 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG dbcounter [-] [207601] Writing DB stats keystone:SELECT=100 {{(pid=207601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:24:21.533386 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG dbcounter [-] [207600] Writing DB stats keystone:SELECT=100 {{(pid=207600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:24:21.540998 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef835a3f-13c5-453e-a87d-aa7f875141d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:24:21.541673 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef835a3f-13c5-453e-a87d-aa7f875141d7 None admin] REQUEST_METHOD: `GET` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:24:21.542004 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef835a3f-13c5-453e-a87d-aa7f875141d7 None admin] SCRIPT_NAME: `/identity` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:24:21.542602 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef835a3f-13c5-453e-a87d-aa7f875141d7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:24:21.554397 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef835a3f-13c5-453e-a87d-aa7f875141d7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:24:21.555885 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef835a3f-13c5-453e-a87d-aa7f875141d7 None admin] RBAC: Authorization granted {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:24:21.571959 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application [None req-ef835a3f-13c5-453e-a87d-aa7f875141d7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 08:24:21.571959 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:24:21.571959 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:24:21.571959 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:24:21.571959 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:24:21.571959 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:24:21.571959 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:24:21.571959 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:24:21.571959 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:24:21.571959 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:24:21.571959 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:24:21.571959 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:24:21.571959 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 08:24:21.571959 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 08:24:21.571959 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 08:24:21.573877 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 08:24:21.573877 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:24:21.573877 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:24:21.573877 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:24:21.573877 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:24:21.573877 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:24:21.573877 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:24:21.573877 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:24:21.573877 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application with Lock( Jul 28 08:24:21.573877 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:24:21.573877 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:24:21.573877 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:24:21.573877 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:24:21.573877 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:24:21.573877 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:24:21.573877 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:24:21.573877 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:24:21.575089 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 08:24:21.575089 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 08:24:21.575089 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 08:24:21.575089 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application Jul 28 08:24:21.575089 dv-cinder-851351-1-smb devstack@keystone.service[207601]: [pid: 207601|app: 0|req: 254/507] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 08:24:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:24:21.575089 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef835a3f-13c5-453e-a87d-aa7f875141d7 None admin] Authenticating user token {{(pid=207601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:24:21.627630 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bae14e2-253d-4d37-b89d-b927b1e7b854 None admin] Validating token access rules against request {{(pid=207600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:24:21.672301 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c02cea82-d0c7-43d8-9551-12b78d59bd22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:24:21.672978 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02cea82-d0c7-43d8-9551-12b78d59bd22 None admin] REQUEST_METHOD: `GET` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:24:21.673261 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02cea82-d0c7-43d8-9551-12b78d59bd22 None admin] SCRIPT_NAME: `/identity` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:24:21.673538 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02cea82-d0c7-43d8-9551-12b78d59bd22 None admin] PATH_INFO: `/v3/domains` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:24:21.674272 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c02cea82-d0c7-43d8-9551-12b78d59bd22 None admin] RBAC: Adding query filter params (name=Default) {{(pid=207600) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:24:21.674594 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c02cea82-d0c7-43d8-9551-12b78d59bd22 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:24:21.676018 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c02cea82-d0c7-43d8-9551-12b78d59bd22 None admin] RBAC: Authorization granted {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:24:21.689392 dv-cinder-851351-1-smb devstack@keystone.service[207600]: [pid: 207600|app: 0|req: 254/508] 10.222.0.42 () {56 vars in 1109 bytes} [Thu Jul 28 08:24:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:24:21.690238 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c02cea82-d0c7-43d8-9551-12b78d59bd22 None admin] Authenticating user token {{(pid=207600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:24:21.690778 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef835a3f-13c5-453e-a87d-aa7f875141d7 None admin] Validating token access rules against request {{(pid=207601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:24:21.741100 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261674d2-5c76-437e-a1e9-bf96604d5b3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:24:21.741742 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261674d2-5c76-437e-a1e9-bf96604d5b3f None admin] REQUEST_METHOD: `GET` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:24:21.742028 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261674d2-5c76-437e-a1e9-bf96604d5b3f None admin] SCRIPT_NAME: `/identity` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:24:21.742307 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261674d2-5c76-437e-a1e9-bf96604d5b3f None admin] PATH_INFO: `/v3/roles` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:24:21.743054 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-261674d2-5c76-437e-a1e9-bf96604d5b3f None admin] RBAC: Adding query filter params (name=service) {{(pid=207601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:24:21.743364 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-261674d2-5c76-437e-a1e9-bf96604d5b3f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:24:21.744798 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-261674d2-5c76-437e-a1e9-bf96604d5b3f None admin] RBAC: Authorization granted {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:24:21.755210 dv-cinder-851351-1-smb devstack@keystone.service[207601]: [pid: 207601|app: 0|req: 255/509] 10.222.0.42 () {56 vars in 1103 bytes} [Thu Jul 28 08:24:21 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:24:21.756075 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261674d2-5c76-437e-a1e9-bf96604d5b3f None admin] Authenticating user token {{(pid=207601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:24:21.795429 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG dbcounter [-] [207601] Writing DB stats keystone:SELECT=100 {{(pid=207601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:24:21.795736 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG dbcounter [-] [207600] Writing DB stats keystone:SELECT=100 {{(pid=207600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:24:21.826581 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c02cea82-d0c7-43d8-9551-12b78d59bd22 None admin] Validating token access rules against request {{(pid=207600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:24:21.863271 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e4272ac-a074-4dcd-ae4f-dd53b172ce48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:24:21.863928 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4272ac-a074-4dcd-ae4f-dd53b172ce48 None admin] REQUEST_METHOD: `GET` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:24:21.864217 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4272ac-a074-4dcd-ae4f-dd53b172ce48 None admin] SCRIPT_NAME: `/identity` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:24:21.864496 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4272ac-a074-4dcd-ae4f-dd53b172ce48 None admin] PATH_INFO: `/v3/users/glance` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:24:21.864749 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261674d2-5c76-437e-a1e9-bf96604d5b3f None admin] Validating token access rules against request {{(pid=207601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:24:21.872028 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e4272ac-a074-4dcd-ae4f-dd53b172ce48 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:24:21.873546 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e4272ac-a074-4dcd-ae4f-dd53b172ce48 None admin] RBAC: Authorization granted {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:24:21.885756 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application [None req-5e4272ac-a074-4dcd-ae4f-dd53b172ce48 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jul 28 08:24:21.885756 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:24:21.885756 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:24:21.885756 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:24:21.885756 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:24:21.885756 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:24:21.885756 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:24:21.885756 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:24:21.885756 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:24:21.885756 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:24:21.885756 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:24:21.885756 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:24:21.885756 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 28 08:24:21.885756 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 28 08:24:21.885756 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 28 08:24:21.885756 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 28 08:24:21.886846 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:24:21.886846 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:24:21.886846 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 28 08:24:21.886846 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 08:24:21.886846 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 28 08:24:21.886846 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 08:24:21.886846 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:24:21.886846 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:24:21.886846 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:24:21.886846 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:24:21.886846 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:24:21.886846 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application with Lock( Jul 28 08:24:21.886846 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:24:21.886846 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:24:21.886846 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:24:21.886846 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:24:21.886846 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:24:21.886846 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:24:21.887918 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:24:21.887918 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:24:21.887918 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 28 08:24:21.887918 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 28 08:24:21.887918 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 28 08:24:21.887918 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 28 08:24:21.887918 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 28 08:24:21.887918 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 28 08:24:21.887918 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jul 28 08:24:21.887918 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application Jul 28 08:24:21.887918 dv-cinder-851351-1-smb devstack@keystone.service[207600]: [pid: 207600|app: 0|req: 255/510] 10.222.0.42 () {56 vars in 1099 bytes} [Thu Jul 28 08:24:21 2022] GET /identity/v3/users/glance => generated 84 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:24:21.887918 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e4272ac-a074-4dcd-ae4f-dd53b172ce48 None admin] Authenticating user token {{(pid=207600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:24:21.909488 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1673d322-0928-47ee-8cb5-53bf159eaab0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:24:21.910133 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1673d322-0928-47ee-8cb5-53bf159eaab0 None admin] REQUEST_METHOD: `GET` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:24:21.910416 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1673d322-0928-47ee-8cb5-53bf159eaab0 None admin] SCRIPT_NAME: `/identity` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:24:21.910693 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1673d322-0928-47ee-8cb5-53bf159eaab0 None admin] PATH_INFO: `/v3/domains` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:24:21.911401 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1673d322-0928-47ee-8cb5-53bf159eaab0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=207601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:24:21.911710 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1673d322-0928-47ee-8cb5-53bf159eaab0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:24:21.913148 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1673d322-0928-47ee-8cb5-53bf159eaab0 None admin] RBAC: Authorization granted {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:24:21.925352 dv-cinder-851351-1-smb devstack@keystone.service[207601]: [pid: 207601|app: 0|req: 256/511] 10.222.0.42 () {56 vars in 1109 bytes} [Thu Jul 28 08:24:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:24:21.926216 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1673d322-0928-47ee-8cb5-53bf159eaab0 None admin] Authenticating user token {{(pid=207601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:24:21.991459 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e4272ac-a074-4dcd-ae4f-dd53b172ce48 None admin] Validating token access rules against request {{(pid=207600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:24:22.023838 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG dbcounter [-] [207601] Writing DB stats keystone:SELECT=100 {{(pid=207601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:24:22.029499 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c7db80-34dc-4715-89b8-40d4b10d70f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:24:22.030135 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c7db80-34dc-4715-89b8-40d4b10d70f2 None admin] REQUEST_METHOD: `GET` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:24:22.030418 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c7db80-34dc-4715-89b8-40d4b10d70f2 None admin] SCRIPT_NAME: `/identity` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:24:22.030694 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c7db80-34dc-4715-89b8-40d4b10d70f2 None admin] PATH_INFO: `/v3/domains` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:24:22.031143 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1673d322-0928-47ee-8cb5-53bf159eaab0 None admin] Validating token access rules against request {{(pid=207601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:24:22.031399 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30c7db80-34dc-4715-89b8-40d4b10d70f2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=207600) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:24:22.031707 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30c7db80-34dc-4715-89b8-40d4b10d70f2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:24:22.033166 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30c7db80-34dc-4715-89b8-40d4b10d70f2 None admin] RBAC: Authorization granted {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:24:22.040341 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG dbcounter [-] [207600] Writing DB stats keystone:SELECT=100 {{(pid=207600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:24:22.046646 dv-cinder-851351-1-smb devstack@keystone.service[207600]: [pid: 207600|app: 0|req: 256/512] 10.222.0.42 () {56 vars in 1109 bytes} [Thu Jul 28 08:24:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:24:22.047484 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c7db80-34dc-4715-89b8-40d4b10d70f2 None admin] Authenticating user token {{(pid=207600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:24:22.069383 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a2715e2-c8c1-408a-9e72-8e97f51a9766 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:24:22.070051 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2715e2-c8c1-408a-9e72-8e97f51a9766 None admin] REQUEST_METHOD: `GET` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:24:22.070332 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2715e2-c8c1-408a-9e72-8e97f51a9766 None admin] SCRIPT_NAME: `/identity` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:24:22.070588 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2715e2-c8c1-408a-9e72-8e97f51a9766 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:24:22.078653 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a2715e2-c8c1-408a-9e72-8e97f51a9766 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:24:22.080112 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a2715e2-c8c1-408a-9e72-8e97f51a9766 None admin] RBAC: Authorization granted {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:24:22.093913 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application [None req-8a2715e2-c8c1-408a-9e72-8e97f51a9766 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jul 28 08:24:22.093913 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:24:22.093913 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:24:22.093913 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:24:22.093913 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:24:22.093913 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:24:22.093913 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:24:22.093913 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:24:22.093913 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:24:22.093913 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:24:22.093913 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:24:22.093913 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:24:22.093913 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 28 08:24:22.093913 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 28 08:24:22.093913 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 28 08:24:22.093913 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 28 08:24:22.095043 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:24:22.095043 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:24:22.095043 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 28 08:24:22.095043 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 08:24:22.095043 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 28 08:24:22.095043 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 08:24:22.095043 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:24:22.095043 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:24:22.095043 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:24:22.095043 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:24:22.095043 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:24:22.095043 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application with Lock( Jul 28 08:24:22.095043 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:24:22.095043 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:24:22.095043 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:24:22.095043 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:24:22.095043 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:24:22.095043 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:24:22.096035 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:24:22.096035 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:24:22.096035 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 28 08:24:22.096035 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 28 08:24:22.096035 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 28 08:24:22.096035 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 28 08:24:22.096035 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 28 08:24:22.096035 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 28 08:24:22.096035 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jul 28 08:24:22.096035 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application Jul 28 08:24:22.096035 dv-cinder-851351-1-smb devstack@keystone.service[207601]: [pid: 207601|app: 0|req: 257/513] 10.222.0.42 () {56 vars in 1099 bytes} [Thu Jul 28 08:24:21 2022] GET /identity/v3/users/cinder => generated 84 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:24:22.096035 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a2715e2-c8c1-408a-9e72-8e97f51a9766 None admin] Authenticating user token {{(pid=207601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:24:22.157303 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c7db80-34dc-4715-89b8-40d4b10d70f2 None admin] Validating token access rules against request {{(pid=207600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:24:22.193514 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4240fba-6080-4327-9966-2e6b4aefe528 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:24:22.194195 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4240fba-6080-4327-9966-2e6b4aefe528 None admin] REQUEST_METHOD: `GET` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:24:22.194465 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4240fba-6080-4327-9966-2e6b4aefe528 None admin] SCRIPT_NAME: `/identity` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:24:22.194742 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4240fba-6080-4327-9966-2e6b4aefe528 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:24:22.202238 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a2715e2-c8c1-408a-9e72-8e97f51a9766 None admin] Validating token access rules against request {{(pid=207601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:24:22.206373 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4240fba-6080-4327-9966-2e6b4aefe528 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:24:22.207896 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4240fba-6080-4327-9966-2e6b4aefe528 None admin] RBAC: Authorization granted {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:24:22.224603 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application [None req-d4240fba-6080-4327-9966-2e6b4aefe528 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 08:24:22.224603 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:24:22.224603 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:24:22.224603 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:24:22.224603 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:24:22.224603 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:24:22.224603 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:24:22.224603 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:24:22.224603 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:24:22.224603 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:24:22.224603 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:24:22.224603 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:24:22.224603 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 08:24:22.224603 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 08:24:22.224603 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 08:24:22.225762 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 08:24:22.225762 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:24:22.225762 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:24:22.225762 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:24:22.225762 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:24:22.225762 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:24:22.225762 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:24:22.225762 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:24:22.225762 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application with Lock( Jul 28 08:24:22.225762 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:24:22.225762 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:24:22.225762 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:24:22.225762 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:24:22.225762 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:24:22.225762 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:24:22.225762 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:24:22.225762 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:24:22.226738 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 08:24:22.226738 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 08:24:22.226738 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 08:24:22.226738 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application Jul 28 08:24:22.226738 dv-cinder-851351-1-smb devstack@keystone.service[207600]: [pid: 207600|app: 0|req: 257/514] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 08:24:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:24:22.226738 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4240fba-6080-4327-9966-2e6b4aefe528 None admin] Authenticating user token {{(pid=207600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:24:22.240308 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a0b30d-5a7c-4e3d-a2f4-69d9883d9aa9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:24:22.240983 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a0b30d-5a7c-4e3d-a2f4-69d9883d9aa9 None admin] REQUEST_METHOD: `GET` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:24:22.241269 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a0b30d-5a7c-4e3d-a2f4-69d9883d9aa9 None admin] SCRIPT_NAME: `/identity` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:24:22.241601 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a0b30d-5a7c-4e3d-a2f4-69d9883d9aa9 None admin] PATH_INFO: `/v3/users` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:24:22.242370 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a0b30d-5a7c-4e3d-a2f4-69d9883d9aa9 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=207601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:24:22.242683 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a0b30d-5a7c-4e3d-a2f4-69d9883d9aa9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:24:22.244153 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a0b30d-5a7c-4e3d-a2f4-69d9883d9aa9 None admin] RBAC: Authorization granted {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:24:22.263645 dv-cinder-851351-1-smb devstack@keystone.service[207601]: [pid: 207601|app: 0|req: 258/515] 10.222.0.42 () {56 vars in 1137 bytes} [Thu Jul 28 08:24:22 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:24:22.264500 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a0b30d-5a7c-4e3d-a2f4-69d9883d9aa9 None admin] Authenticating user token {{(pid=207601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:24:22.280886 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG dbcounter [-] [207601] Writing DB stats keystone:SELECT=100 {{(pid=207601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:24:22.285713 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG dbcounter [-] [207600] Writing DB stats keystone:SELECT=100 {{(pid=207600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:24:22.339034 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4240fba-6080-4327-9966-2e6b4aefe528 None admin] Validating token access rules against request {{(pid=207600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:24:22.375195 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a0b30d-5a7c-4e3d-a2f4-69d9883d9aa9 None admin] Validating token access rules against request {{(pid=207601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:24:22.378381 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb09f5f-71d2-4b0c-b2e0-a3740f0835d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:24:22.379037 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb09f5f-71d2-4b0c-b2e0-a3740f0835d5 None admin] REQUEST_METHOD: `GET` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:24:22.379320 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb09f5f-71d2-4b0c-b2e0-a3740f0835d5 None admin] SCRIPT_NAME: `/identity` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:24:22.379590 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb09f5f-71d2-4b0c-b2e0-a3740f0835d5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:24:22.386939 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fb09f5f-71d2-4b0c-b2e0-a3740f0835d5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:24:22.388416 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fb09f5f-71d2-4b0c-b2e0-a3740f0835d5 None admin] RBAC: Authorization granted {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:24:22.400994 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application [None req-5fb09f5f-71d2-4b0c-b2e0-a3740f0835d5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 08:24:22.400994 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:24:22.400994 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:24:22.400994 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:24:22.400994 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:24:22.400994 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:24:22.400994 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:24:22.400994 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:24:22.400994 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:24:22.400994 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:24:22.400994 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:24:22.400994 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:24:22.400994 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 28 08:24:22.400994 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 28 08:24:22.400994 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 28 08:24:22.402291 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 28 08:24:22.402291 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:24:22.402291 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:24:22.402291 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:24:22.402291 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:24:22.402291 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:24:22.402291 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:24:22.402291 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:24:22.402291 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application with Lock( Jul 28 08:24:22.402291 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:24:22.402291 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:24:22.402291 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:24:22.402291 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:24:22.402291 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:24:22.402291 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:24:22.402291 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:24:22.402291 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:24:22.403789 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 28 08:24:22.403789 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 28 08:24:22.403789 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 28 08:24:22.403789 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 28 08:24:22.403789 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 28 08:24:22.403789 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 28 08:24:22.403789 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 08:24:22.403789 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application Jul 28 08:24:22.403789 dv-cinder-851351-1-smb devstack@keystone.service[207600]: [pid: 207600|app: 0|req: 258/516] 10.222.0.42 () {56 vars in 1111 bytes} [Thu Jul 28 08:24:22 2022] GET /identity/v3/projects/service => generated 88 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:24:22.403789 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb09f5f-71d2-4b0c-b2e0-a3740f0835d5 None admin] Authenticating user token {{(pid=207600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:24:22.416672 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844b6a8e-be27-45dc-b34c-52dee2e9e713 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:24:22.417375 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844b6a8e-be27-45dc-b34c-52dee2e9e713 None admin] REQUEST_METHOD: `POST` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:24:22.417664 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844b6a8e-be27-45dc-b34c-52dee2e9e713 None admin] SCRIPT_NAME: `/identity` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:24:22.417939 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844b6a8e-be27-45dc-b34c-52dee2e9e713 None admin] PATH_INFO: `/v3/users` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:24:22.418661 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-844b6a8e-be27-45dc-b34c-52dee2e9e713 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:24:22.420135 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-844b6a8e-be27-45dc-b34c-52dee2e9e713 None admin] RBAC: Authorization granted {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:24:22.442265 dv-cinder-851351-1-smb devstack@keystone.service[207601]: [pid: 207601|app: 0|req: 259/517] 10.222.0.42 () {60 vars in 1132 bytes} [Thu Jul 28 08:24:22 2022] POST /identity/v3/users => generated 247 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 08:24:22.443120 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844b6a8e-be27-45dc-b34c-52dee2e9e713 None admin] Authenticating user token {{(pid=207601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:24:22.529891 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG dbcounter [-] [207601] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=207601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:24:22.543190 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb09f5f-71d2-4b0c-b2e0-a3740f0835d5 None admin] Validating token access rules against request {{(pid=207600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:24:22.555543 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG dbcounter [-] [207600] Writing DB stats keystone:SELECT=100 {{(pid=207600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:24:22.567838 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844b6a8e-be27-45dc-b34c-52dee2e9e713 None admin] Validating token access rules against request {{(pid=207601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:24:22.588544 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0abf7582-0035-48f3-a95f-a773e461af46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:24:22.589340 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abf7582-0035-48f3-a95f-a773e461af46 None admin] REQUEST_METHOD: `GET` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:24:22.589548 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abf7582-0035-48f3-a95f-a773e461af46 None admin] SCRIPT_NAME: `/identity` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:24:22.589824 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abf7582-0035-48f3-a95f-a773e461af46 None admin] PATH_INFO: `/v3/users` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:24:22.590671 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0abf7582-0035-48f3-a95f-a773e461af46 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=207600) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:24:22.591043 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0abf7582-0035-48f3-a95f-a773e461af46 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:24:22.592598 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0abf7582-0035-48f3-a95f-a773e461af46 None admin] RBAC: Authorization granted {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:24:22.608757 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d2aebf8-fe20-401c-b62b-47773346a82a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:24:22.609411 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2aebf8-fe20-401c-b62b-47773346a82a None admin] REQUEST_METHOD: `GET` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:24:22.609725 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2aebf8-fe20-401c-b62b-47773346a82a None admin] SCRIPT_NAME: `/identity` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:24:22.610017 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2aebf8-fe20-401c-b62b-47773346a82a None admin] PATH_INFO: `/v3/domains` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:24:22.610726 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d2aebf8-fe20-401c-b62b-47773346a82a None admin] RBAC: Adding query filter params (name=Default) {{(pid=207601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:24:22.611033 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d2aebf8-fe20-401c-b62b-47773346a82a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:24:22.612440 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d2aebf8-fe20-401c-b62b-47773346a82a None admin] RBAC: Authorization granted {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:24:22.626239 dv-cinder-851351-1-smb devstack@keystone.service[207601]: [pid: 207601|app: 0|req: 260/518] 10.222.0.42 () {56 vars in 1109 bytes} [Thu Jul 28 08:24:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:24:22.627239 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d2aebf8-fe20-401c-b62b-47773346a82a None admin] Authenticating user token {{(pid=207601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:24:22.634470 dv-cinder-851351-1-smb devstack@keystone.service[207600]: [pid: 207600|app: 0|req: 259/519] 10.222.0.42 () {56 vars in 1137 bytes} [Thu Jul 28 08:24:22 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:24:22.635402 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0abf7582-0035-48f3-a95f-a773e461af46 None admin] Authenticating user token {{(pid=207600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:24:22.749481 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d2aebf8-fe20-401c-b62b-47773346a82a None admin] Validating token access rules against request {{(pid=207601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:24:22.756342 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0abf7582-0035-48f3-a95f-a773e461af46 None admin] Validating token access rules against request {{(pid=207600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:24:22.782437 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG dbcounter [-] [207601] Writing DB stats keystone:SELECT=100 {{(pid=207601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:24:22.790177 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe4fe30-555e-4929-9c6f-bbba4207bc84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:24:22.790927 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe4fe30-555e-4929-9c6f-bbba4207bc84 None admin] REQUEST_METHOD: `GET` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:24:22.791276 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe4fe30-555e-4929-9c6f-bbba4207bc84 None admin] SCRIPT_NAME: `/identity` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:24:22.791621 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe4fe30-555e-4929-9c6f-bbba4207bc84 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:24:22.800600 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f141105-0aa8-470c-aa31-e3e8db483538 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:24:22.801291 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f141105-0aa8-470c-aa31-e3e8db483538 None admin] REQUEST_METHOD: `GET` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:24:22.801617 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f141105-0aa8-470c-aa31-e3e8db483538 None admin] SCRIPT_NAME: `/identity` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:24:22.801893 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f141105-0aa8-470c-aa31-e3e8db483538 None admin] PATH_INFO: `/v3/projects` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:24:22.802676 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f141105-0aa8-470c-aa31-e3e8db483538 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=207600) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:24:22.802983 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f141105-0aa8-470c-aa31-e3e8db483538 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:24:22.804465 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f141105-0aa8-470c-aa31-e3e8db483538 None admin] RBAC: Authorization granted {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:24:22.830754 dv-cinder-851351-1-smb devstack@keystone.service[207600]: [pid: 207600|app: 0|req: 260/520] 10.222.0.42 () {56 vars in 1148 bytes} [Thu Jul 28 08:24:22 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:24:22.830754 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f141105-0aa8-470c-aa31-e3e8db483538 None admin] Authenticating user token {{(pid=207600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:24:22.861468 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG dbcounter [-] [207600] Writing DB stats keystone:SELECT=100 {{(pid=207600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:24:22.875905 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abe4fe30-555e-4929-9c6f-bbba4207bc84 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:24:22.877546 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abe4fe30-555e-4929-9c6f-bbba4207bc84 None admin] RBAC: Authorization granted {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:24:22.949560 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f141105-0aa8-470c-aa31-e3e8db483538 None admin] Validating token access rules against request {{(pid=207600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:24:22.987634 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020e33fc-76cd-4bfb-a872-e9af9db87cdf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:24:22.988602 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020e33fc-76cd-4bfb-a872-e9af9db87cdf None admin] REQUEST_METHOD: `GET` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:24:22.988998 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020e33fc-76cd-4bfb-a872-e9af9db87cdf None admin] SCRIPT_NAME: `/identity` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:24:22.989275 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020e33fc-76cd-4bfb-a872-e9af9db87cdf None admin] PATH_INFO: `/v3/users/neutron` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:24:22.999160 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-020e33fc-76cd-4bfb-a872-e9af9db87cdf None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:24:23.000679 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-020e33fc-76cd-4bfb-a872-e9af9db87cdf None admin] RBAC: Authorization granted {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:24:23.014558 dv-cinder-851351-1-smb devstack@keystone.service[207601]: [pid: 207601|app: 0|req: 261/521] 10.222.0.42 () {58 vars in 1282 bytes} [Thu Jul 28 08:24:22 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 388 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 28 08:24:23.015472 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application [None req-020e33fc-76cd-4bfb-a872-e9af9db87cdf None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jul 28 08:24:23.015472 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:24:23.015472 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:24:23.015472 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:24:23.015472 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:24:23.015472 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:24:23.015472 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:24:23.015472 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:24:23.015472 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:24:23.015472 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:24:23.015472 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:24:23.015472 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:24:23.015472 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 28 08:24:23.015472 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 28 08:24:23.015472 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 28 08:24:23.015472 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 28 08:24:23.016510 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:24:23.016510 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:24:23.016510 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 28 08:24:23.016510 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 08:24:23.016510 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 28 08:24:23.016510 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 08:24:23.016510 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:24:23.016510 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:24:23.016510 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:24:23.016510 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:24:23.016510 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:24:23.016510 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application with Lock( Jul 28 08:24:23.016510 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:24:23.016510 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:24:23.016510 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:24:23.016510 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:24:23.016510 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:24:23.016510 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:24:23.017849 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:24:23.017849 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:24:23.017849 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 28 08:24:23.017849 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 28 08:24:23.017849 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 28 08:24:23.017849 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 28 08:24:23.017849 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 28 08:24:23.017849 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 28 08:24:23.017849 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jul 28 08:24:23.017849 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application Jul 28 08:24:23.018498 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe4fe30-555e-4929-9c6f-bbba4207bc84 None admin] Authenticating user token {{(pid=207601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:24:23.018578 dv-cinder-851351-1-smb devstack@keystone.service[207600]: [pid: 207600|app: 0|req: 261/522] 10.222.0.42 () {56 vars in 1102 bytes} [Thu Jul 28 08:24:22 2022] GET /identity/v3/users/neutron => generated 85 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:24:23.018578 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020e33fc-76cd-4bfb-a872-e9af9db87cdf None admin] Authenticating user token {{(pid=207600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:24:23.054794 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG dbcounter [-] [207601] Writing DB stats keystone:SELECT=100 {{(pid=207601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:24:23.118458 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG dbcounter [-] [207600] Writing DB stats keystone:SELECT=100 {{(pid=207600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:24:23.132217 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020e33fc-76cd-4bfb-a872-e9af9db87cdf None admin] Validating token access rules against request {{(pid=207600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:24:23.138059 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe4fe30-555e-4929-9c6f-bbba4207bc84 None admin] Validating token access rules against request {{(pid=207601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:24:23.172198 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2536e1b0-37bf-4f8c-a69e-9bc6d3f3a7c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:24:23.172992 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2536e1b0-37bf-4f8c-a69e-9bc6d3f3a7c3 None admin] REQUEST_METHOD: `GET` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:24:23.173349 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2536e1b0-37bf-4f8c-a69e-9bc6d3f3a7c3 None admin] SCRIPT_NAME: `/identity` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:24:23.173670 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2536e1b0-37bf-4f8c-a69e-9bc6d3f3a7c3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:24:23.174437 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2536e1b0-37bf-4f8c-a69e-9bc6d3f3a7c3 None admin] RBAC: Adding query filter params (role.id=b44e7c7aeec24f51b8033df305da133d, scope.project.id=48c5f2b2ae2b48758b957d2b194a7fd1, user.id=03804b1369934a7692da4d5646465bdc) {{(pid=207600) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:24:23.174758 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2536e1b0-37bf-4f8c-a69e-9bc6d3f3a7c3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:24:23.175667 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58aed074-446b-4a1a-880c-9621a920059e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:24:23.176219 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2536e1b0-37bf-4f8c-a69e-9bc6d3f3a7c3 None admin] RBAC: Authorization granted {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:24:23.176322 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58aed074-446b-4a1a-880c-9621a920059e None admin] REQUEST_METHOD: `GET` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:24:23.176585 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58aed074-446b-4a1a-880c-9621a920059e None admin] SCRIPT_NAME: `/identity` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:24:23.176895 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58aed074-446b-4a1a-880c-9621a920059e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:24:23.193071 dv-cinder-851351-1-smb devstack@keystone.service[207600]: [pid: 207600|app: 0|req: 262/523] 10.222.0.42 () {56 vars in 1374 bytes} [Thu Jul 28 08:24:23 2022] GET /identity/v3/role_assignments?user.id=03804b1369934a7692da4d5646465bdc&scope.project.id=48c5f2b2ae2b48758b957d2b194a7fd1&role.id=b44e7c7aeec24f51b8033df305da133d => generated 259 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:24:23.193071 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2536e1b0-37bf-4f8c-a69e-9bc6d3f3a7c3 None admin] Authenticating user token {{(pid=207600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:24:23.269479 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58aed074-446b-4a1a-880c-9621a920059e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:24:23.271378 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58aed074-446b-4a1a-880c-9621a920059e None admin] RBAC: Authorization granted {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:24:23.318187 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG dbcounter [-] [207601] Writing DB stats keystone:SELECT=100 {{(pid=207601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:24:23.326642 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2536e1b0-37bf-4f8c-a69e-9bc6d3f3a7c3 None admin] Validating token access rules against request {{(pid=207600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:24:23.365694 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a3c2cfb-220a-4583-95f1-a16c0b4fd2d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:24:23.366565 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3c2cfb-220a-4583-95f1-a16c0b4fd2d4 None admin] REQUEST_METHOD: `GET` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:24:23.366959 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3c2cfb-220a-4583-95f1-a16c0b4fd2d4 None admin] SCRIPT_NAME: `/identity` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:24:23.367341 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3c2cfb-220a-4583-95f1-a16c0b4fd2d4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:24:23.379795 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a3c2cfb-220a-4583-95f1-a16c0b4fd2d4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:24:23.381343 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a3c2cfb-220a-4583-95f1-a16c0b4fd2d4 None admin] RBAC: Authorization granted {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:24:23.398663 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application [None req-7a3c2cfb-220a-4583-95f1-a16c0b4fd2d4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 08:24:23.398663 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:24:23.398663 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:24:23.398663 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:24:23.398663 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:24:23.398663 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:24:23.398663 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:24:23.398663 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:24:23.398663 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:24:23.398663 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:24:23.398663 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:24:23.398663 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:24:23.398663 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 08:24:23.398663 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 08:24:23.398663 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 08:24:23.399680 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 08:24:23.399680 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:24:23.399680 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:24:23.399680 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:24:23.399680 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:24:23.399680 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:24:23.399680 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:24:23.399680 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:24:23.399680 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application with Lock( Jul 28 08:24:23.399680 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:24:23.399680 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:24:23.399680 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:24:23.399680 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:24:23.399680 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:24:23.399680 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:24:23.399680 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:24:23.399680 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:24:23.400630 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 08:24:23.400630 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 08:24:23.400630 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 08:24:23.400630 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application Jul 28 08:24:23.405833 dv-cinder-851351-1-smb devstack@keystone.service[207600]: [pid: 207600|app: 0|req: 263/524] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 08:24:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:24:23.405979 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a3c2cfb-220a-4583-95f1-a16c0b4fd2d4 None admin] Authenticating user token {{(pid=207600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:24:23.409928 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG dbcounter [-] [207600] Writing DB stats keystone:SELECT=100 {{(pid=207600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:24:23.422158 dv-cinder-851351-1-smb devstack@keystone.service[207601]: [pid: 207601|app: 0|req: 262/525] 10.222.0.42 () {58 vars in 1282 bytes} [Thu Jul 28 08:24:23 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 407 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 28 08:24:23.425939 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58aed074-446b-4a1a-880c-9621a920059e None admin] Authenticating user token {{(pid=207601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:24:23.523281 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a3c2cfb-220a-4583-95f1-a16c0b4fd2d4 None admin] Validating token access rules against request {{(pid=207600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:24:23.543187 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58aed074-446b-4a1a-880c-9621a920059e None admin] Validating token access rules against request {{(pid=207601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:24:23.561329 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3336c79d-cc48-412e-a848-4434c65d0463 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:24:23.562348 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3336c79d-cc48-412e-a848-4434c65d0463 None admin] REQUEST_METHOD: `GET` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:24:23.562826 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3336c79d-cc48-412e-a848-4434c65d0463 None admin] SCRIPT_NAME: `/identity` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:24:23.563385 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3336c79d-cc48-412e-a848-4434c65d0463 None admin] PATH_INFO: `/v3/users` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:24:23.564403 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3336c79d-cc48-412e-a848-4434c65d0463 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=207600) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:24:23.564951 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3336c79d-cc48-412e-a848-4434c65d0463 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:24:23.566724 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3336c79d-cc48-412e-a848-4434c65d0463 None admin] RBAC: Authorization granted {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:24:23.576298 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG dbcounter [-] [207601] Writing DB stats keystone:SELECT=100 {{(pid=207601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:24:23.584210 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb96f90-25a0-4270-8a27-137521bd96c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:24:23.584993 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb96f90-25a0-4270-8a27-137521bd96c3 None admin] REQUEST_METHOD: `GET` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:24:23.585352 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb96f90-25a0-4270-8a27-137521bd96c3 None admin] SCRIPT_NAME: `/identity` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:24:23.585702 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb96f90-25a0-4270-8a27-137521bd96c3 None admin] PATH_INFO: `/v3/domains` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:24:23.586536 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb96f90-25a0-4270-8a27-137521bd96c3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=207601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:24:23.587421 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb96f90-25a0-4270-8a27-137521bd96c3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:24:23.588899 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb96f90-25a0-4270-8a27-137521bd96c3 None admin] RBAC: Authorization granted {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:24:23.591856 dv-cinder-851351-1-smb devstack@keystone.service[207600]: [pid: 207600|app: 0|req: 264/526] 10.222.0.42 () {56 vars in 1139 bytes} [Thu Jul 28 08:24:23 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:24:23.592999 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3336c79d-cc48-412e-a848-4434c65d0463 None admin] Authenticating user token {{(pid=207600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:24:23.612460 dv-cinder-851351-1-smb devstack@keystone.service[207601]: [pid: 207601|app: 0|req: 263/527] 10.222.0.42 () {56 vars in 1109 bytes} [Thu Jul 28 08:24:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:24:23.613760 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb96f90-25a0-4270-8a27-137521bd96c3 None admin] Authenticating user token {{(pid=207601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:24:23.661312 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG dbcounter [-] [207600] Writing DB stats keystone:SELECT=100 {{(pid=207600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:24:23.702130 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3336c79d-cc48-412e-a848-4434c65d0463 None admin] Validating token access rules against request {{(pid=207600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:24:23.730670 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb96f90-25a0-4270-8a27-137521bd96c3 None admin] Validating token access rules against request {{(pid=207601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:24:23.739109 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6238487-e2b8-4fdd-ac0d-3acad5bf0292 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:24:23.740189 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6238487-e2b8-4fdd-ac0d-3acad5bf0292 None admin] REQUEST_METHOD: `GET` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:24:23.740713 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6238487-e2b8-4fdd-ac0d-3acad5bf0292 None admin] SCRIPT_NAME: `/identity` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:24:23.741197 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6238487-e2b8-4fdd-ac0d-3acad5bf0292 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:24:23.752547 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6238487-e2b8-4fdd-ac0d-3acad5bf0292 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:24:23.754477 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6238487-e2b8-4fdd-ac0d-3acad5bf0292 None admin] RBAC: Authorization granted {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:24:23.769631 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d7f6cf-d418-406a-9b41-a0b2c4ce911c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:24:23.770283 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d7f6cf-d418-406a-9b41-a0b2c4ce911c None admin] REQUEST_METHOD: `GET` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:24:23.770572 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d7f6cf-d418-406a-9b41-a0b2c4ce911c None admin] SCRIPT_NAME: `/identity` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:24:23.770891 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d7f6cf-d418-406a-9b41-a0b2c4ce911c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:24:23.773127 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application [None req-c6238487-e2b8-4fdd-ac0d-3acad5bf0292 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 08:24:23.773127 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:24:23.773127 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:24:23.773127 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:24:23.773127 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:24:23.773127 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:24:23.773127 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:24:23.773127 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:24:23.773127 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:24:23.773127 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:24:23.773127 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:24:23.773127 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:24:23.773127 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 08:24:23.773127 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 08:24:23.773127 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 08:24:23.774093 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 08:24:23.774093 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:24:23.774093 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:24:23.774093 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:24:23.774093 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:24:23.774093 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:24:23.774093 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:24:23.774093 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:24:23.774093 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application with Lock( Jul 28 08:24:23.774093 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:24:23.774093 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:24:23.774093 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:24:23.774093 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:24:23.774093 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:24:23.774093 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:24:23.774093 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:24:23.774093 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:24:23.775082 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 08:24:23.775082 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 08:24:23.775082 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 08:24:23.775082 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application Jul 28 08:24:23.777624 dv-cinder-851351-1-smb devstack@keystone.service[207600]: [pid: 207600|app: 0|req: 265/528] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 08:24:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:24:23.778830 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6238487-e2b8-4fdd-ac0d-3acad5bf0292 None admin] Authenticating user token {{(pid=207600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:24:23.850041 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG dbcounter [-] [207601] Writing DB stats keystone:SELECT=100 {{(pid=207601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:24:23.861822 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8d7f6cf-d418-406a-9b41-a0b2c4ce911c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:24:23.864403 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8d7f6cf-d418-406a-9b41-a0b2c4ce911c None admin] RBAC: Authorization granted {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:24:23.891055 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6238487-e2b8-4fdd-ac0d-3acad5bf0292 None admin] Validating token access rules against request {{(pid=207600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:24:23.907195 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG dbcounter [-] [207600] Writing DB stats keystone:SELECT=100 {{(pid=207600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:24:23.930731 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b504fccc-50f7-49f2-9bf8-66aa2dc0702e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:24:23.931777 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b504fccc-50f7-49f2-9bf8-66aa2dc0702e None admin] REQUEST_METHOD: `GET` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:24:23.932267 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b504fccc-50f7-49f2-9bf8-66aa2dc0702e None admin] SCRIPT_NAME: `/identity` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:24:23.932881 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b504fccc-50f7-49f2-9bf8-66aa2dc0702e None admin] PATH_INFO: `/v3/projects/service` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:24:23.941419 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b504fccc-50f7-49f2-9bf8-66aa2dc0702e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:24:23.943535 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b504fccc-50f7-49f2-9bf8-66aa2dc0702e None admin] RBAC: Authorization granted {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:24:23.958699 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application [None req-b504fccc-50f7-49f2-9bf8-66aa2dc0702e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 08:24:23.958699 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:24:23.958699 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:24:23.958699 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:24:23.958699 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:24:23.958699 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:24:23.958699 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:24:23.958699 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:24:23.958699 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:24:23.958699 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:24:23.958699 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:24:23.958699 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:24:23.958699 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 28 08:24:23.958699 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 28 08:24:23.958699 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 28 08:24:23.959941 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 28 08:24:23.959941 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:24:23.959941 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:24:23.959941 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:24:23.959941 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:24:23.959941 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:24:23.959941 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:24:23.959941 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:24:23.959941 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application with Lock( Jul 28 08:24:23.959941 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:24:23.959941 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:24:23.959941 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:24:23.959941 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:24:23.959941 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:24:23.959941 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:24:23.959941 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:24:23.959941 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:24:23.961527 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 28 08:24:23.961527 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 28 08:24:23.961527 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 28 08:24:23.961527 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 28 08:24:23.961527 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 28 08:24:23.961527 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 28 08:24:23.961527 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 08:24:23.961527 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application Jul 28 08:24:23.964560 dv-cinder-851351-1-smb devstack@keystone.service[207600]: [pid: 207600|app: 0|req: 266/529] 10.222.0.42 () {56 vars in 1111 bytes} [Thu Jul 28 08:24:23 2022] GET /identity/v3/projects/service => generated 88 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:24:23.965870 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b504fccc-50f7-49f2-9bf8-66aa2dc0702e None admin] Authenticating user token {{(pid=207600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:24:23.985199 dv-cinder-851351-1-smb devstack@keystone.service[207601]: [pid: 207601|app: 0|req: 264/530] 10.222.0.42 () {58 vars in 1282 bytes} [Thu Jul 28 08:24:23 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 369 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 28 08:24:23.986199 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d7f6cf-d418-406a-9b41-a0b2c4ce911c None admin] Authenticating user token {{(pid=207601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:24:24.076171 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b504fccc-50f7-49f2-9bf8-66aa2dc0702e None admin] Validating token access rules against request {{(pid=207600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:24:24.083178 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG dbcounter [-] [207601] Writing DB stats keystone:SELECT=100 {{(pid=207601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:24:24.095068 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d7f6cf-d418-406a-9b41-a0b2c4ce911c None admin] Validating token access rules against request {{(pid=207601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:24:24.114918 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07cc53b0-37d4-44fb-95e9-8eb4d1cacd79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:24:24.115943 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07cc53b0-37d4-44fb-95e9-8eb4d1cacd79 None admin] REQUEST_METHOD: `GET` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:24:24.116431 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07cc53b0-37d4-44fb-95e9-8eb4d1cacd79 None admin] SCRIPT_NAME: `/identity` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:24:24.116964 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07cc53b0-37d4-44fb-95e9-8eb4d1cacd79 None admin] PATH_INFO: `/v3/domains` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:24:24.117908 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07cc53b0-37d4-44fb-95e9-8eb4d1cacd79 None admin] RBAC: Adding query filter params (name=Default) {{(pid=207600) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:24:24.118504 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07cc53b0-37d4-44fb-95e9-8eb4d1cacd79 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:24:24.120616 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07cc53b0-37d4-44fb-95e9-8eb4d1cacd79 None admin] RBAC: Authorization granted {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:24:24.133359 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b160b4-06ff-4f75-a726-391098518af4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:24:24.134011 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b160b4-06ff-4f75-a726-391098518af4 None admin] REQUEST_METHOD: `GET` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:24:24.134301 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b160b4-06ff-4f75-a726-391098518af4 None admin] SCRIPT_NAME: `/identity` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:24:24.134583 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b160b4-06ff-4f75-a726-391098518af4 None admin] PATH_INFO: `/v3/projects` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:24:24.135363 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1b160b4-06ff-4f75-a726-391098518af4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=207601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:24:24.135746 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1b160b4-06ff-4f75-a726-391098518af4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:24:24.137033 dv-cinder-851351-1-smb devstack@keystone.service[207600]: [pid: 207600|app: 0|req: 267/531] 10.222.0.42 () {56 vars in 1109 bytes} [Thu Jul 28 08:24:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:24:24.138356 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07cc53b0-37d4-44fb-95e9-8eb4d1cacd79 None admin] Authenticating user token {{(pid=207600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:24:24.141753 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1b160b4-06ff-4f75-a726-391098518af4 None admin] RBAC: Authorization granted {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:24:24.166568 dv-cinder-851351-1-smb devstack@keystone.service[207601]: [pid: 207601|app: 0|req: 265/532] 10.222.0.42 () {56 vars in 1148 bytes} [Thu Jul 28 08:24:23 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:24:24.167640 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b160b4-06ff-4f75-a726-391098518af4 None admin] Authenticating user token {{(pid=207601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:24:24.177421 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG dbcounter [-] [207600] Writing DB stats keystone:SELECT=100 {{(pid=207600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:24:24.251355 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07cc53b0-37d4-44fb-95e9-8eb4d1cacd79 None admin] Validating token access rules against request {{(pid=207600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:24:24.276821 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b160b4-06ff-4f75-a726-391098518af4 None admin] Validating token access rules against request {{(pid=207601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:24:24.289642 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11ba549-44c9-4458-aba7-6f44be149d24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:24:24.290715 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11ba549-44c9-4458-aba7-6f44be149d24 None admin] REQUEST_METHOD: `GET` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:24:24.291173 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11ba549-44c9-4458-aba7-6f44be149d24 None admin] SCRIPT_NAME: `/identity` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:24:24.291461 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11ba549-44c9-4458-aba7-6f44be149d24 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:24:24.302807 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e11ba549-44c9-4458-aba7-6f44be149d24 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:24:24.304302 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e11ba549-44c9-4458-aba7-6f44be149d24 None admin] RBAC: Authorization granted {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:24:24.314896 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c9e619f-1afb-4014-949a-c8453e30b799 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:24:24.315572 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9e619f-1afb-4014-949a-c8453e30b799 None admin] REQUEST_METHOD: `GET` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:24:24.315863 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9e619f-1afb-4014-949a-c8453e30b799 None admin] SCRIPT_NAME: `/identity` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:24:24.316140 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9e619f-1afb-4014-949a-c8453e30b799 None admin] PATH_INFO: `/v3/projects/service` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:24:24.320811 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application [None req-e11ba549-44c9-4458-aba7-6f44be149d24 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 08:24:24.320811 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:24:24.320811 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:24:24.320811 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:24:24.320811 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:24:24.320811 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:24:24.320811 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:24:24.320811 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:24:24.320811 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:24:24.320811 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:24:24.320811 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:24:24.320811 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:24:24.320811 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 08:24:24.320811 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 08:24:24.320811 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 08:24:24.321790 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 08:24:24.321790 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:24:24.321790 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:24:24.321790 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:24:24.321790 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:24:24.321790 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:24:24.321790 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:24:24.321790 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:24:24.321790 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application with Lock( Jul 28 08:24:24.321790 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:24:24.321790 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:24:24.321790 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:24:24.321790 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:24:24.321790 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:24:24.321790 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:24:24.321790 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:24:24.321790 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:24:24.322736 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 08:24:24.322736 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 08:24:24.322736 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 08:24:24.322736 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application Jul 28 08:24:24.322736 dv-cinder-851351-1-smb devstack@keystone.service[207600]: [pid: 207600|app: 0|req: 268/533] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 08:24:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:24:24.323540 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11ba549-44c9-4458-aba7-6f44be149d24 None admin] Authenticating user token {{(pid=207600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:24:24.328716 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c9e619f-1afb-4014-949a-c8453e30b799 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:24:24.328716 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c9e619f-1afb-4014-949a-c8453e30b799 None admin] RBAC: Authorization granted {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:24:24.339273 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application [None req-1c9e619f-1afb-4014-949a-c8453e30b799 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 08:24:24.339273 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:24:24.339273 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:24:24.339273 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:24:24.339273 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:24:24.339273 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:24:24.339273 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:24:24.339273 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:24:24.339273 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:24:24.339273 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:24:24.339273 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:24:24.339273 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:24:24.339273 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 28 08:24:24.339273 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 28 08:24:24.339273 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 28 08:24:24.341575 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 28 08:24:24.341575 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:24:24.341575 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:24:24.341575 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:24:24.341575 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:24:24.341575 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:24:24.341575 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:24:24.341575 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:24:24.341575 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application with Lock( Jul 28 08:24:24.341575 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:24:24.341575 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:24:24.341575 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:24:24.341575 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:24:24.341575 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:24:24.341575 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:24:24.341575 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:24:24.341575 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:24:24.343788 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 28 08:24:24.343788 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 28 08:24:24.343788 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 28 08:24:24.343788 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 28 08:24:24.343788 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 28 08:24:24.343788 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 28 08:24:24.343788 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 08:24:24.343788 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application Jul 28 08:24:24.348823 dv-cinder-851351-1-smb devstack@keystone.service[207601]: [pid: 207601|app: 0|req: 266/534] 10.222.0.42 () {56 vars in 1111 bytes} [Thu Jul 28 08:24:24 2022] GET /identity/v3/projects/service => generated 88 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:24:24.348823 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c9e619f-1afb-4014-949a-c8453e30b799 None admin] Authenticating user token {{(pid=207601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:24:24.362435 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG dbcounter [-] [207601] Writing DB stats keystone:SELECT=100 {{(pid=207601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:24:24.421828 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG dbcounter [-] [207600] Writing DB stats keystone:SELECT=100 {{(pid=207600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:24:24.438668 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11ba549-44c9-4458-aba7-6f44be149d24 None admin] Validating token access rules against request {{(pid=207600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:24:24.459989 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c9e619f-1afb-4014-949a-c8453e30b799 None admin] Validating token access rules against request {{(pid=207601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:24:24.478538 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff75261-3b3c-45c7-94c6-68c485e6143e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:24:24.479173 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff75261-3b3c-45c7-94c6-68c485e6143e None admin] REQUEST_METHOD: `GET` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:24:24.479743 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff75261-3b3c-45c7-94c6-68c485e6143e None admin] SCRIPT_NAME: `/identity` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:24:24.479835 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff75261-3b3c-45c7-94c6-68c485e6143e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:24:24.480818 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff75261-3b3c-45c7-94c6-68c485e6143e None admin] RBAC: Adding query filter params (role.id=b44e7c7aeec24f51b8033df305da133d, scope.project.id=48c5f2b2ae2b48758b957d2b194a7fd1, user.id=d085f306b992491d862c5df4567f0083) {{(pid=207600) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:24:24.481136 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff75261-3b3c-45c7-94c6-68c485e6143e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:24:24.482931 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff75261-3b3c-45c7-94c6-68c485e6143e None admin] RBAC: Authorization granted {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:24:24.491429 dv-cinder-851351-1-smb devstack@keystone.service[207600]: [pid: 207600|app: 0|req: 269/535] 10.222.0.42 () {56 vars in 1374 bytes} [Thu Jul 28 08:24:24 2022] GET /identity/v3/role_assignments?user.id=d085f306b992491d862c5df4567f0083&scope.project.id=48c5f2b2ae2b48758b957d2b194a7fd1&role.id=b44e7c7aeec24f51b8033df305da133d => generated 259 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:24:24.491429 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff75261-3b3c-45c7-94c6-68c485e6143e None admin] Authenticating user token {{(pid=207600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:24:24.523138 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dba9c05-f60c-41b5-ae57-9e7e24f9e844 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:24:24.524211 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dba9c05-f60c-41b5-ae57-9e7e24f9e844 None admin] REQUEST_METHOD: `GET` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:24:24.524705 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dba9c05-f60c-41b5-ae57-9e7e24f9e844 None admin] SCRIPT_NAME: `/identity` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:24:24.525174 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dba9c05-f60c-41b5-ae57-9e7e24f9e844 None admin] PATH_INFO: `/v3/domains` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:24:24.526133 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dba9c05-f60c-41b5-ae57-9e7e24f9e844 None admin] RBAC: Adding query filter params (name=Default) {{(pid=207601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:24:24.526659 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dba9c05-f60c-41b5-ae57-9e7e24f9e844 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:24:24.528421 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dba9c05-f60c-41b5-ae57-9e7e24f9e844 None admin] RBAC: Authorization granted {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:24:24.556955 dv-cinder-851351-1-smb devstack@keystone.service[207601]: [pid: 207601|app: 0|req: 267/536] 10.222.0.42 () {56 vars in 1109 bytes} [Thu Jul 28 08:24:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:24:24.562505 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dba9c05-f60c-41b5-ae57-9e7e24f9e844 None admin] Authenticating user token {{(pid=207601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:24:24.648183 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff75261-3b3c-45c7-94c6-68c485e6143e None admin] Validating token access rules against request {{(pid=207600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:24:24.696366 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG dbcounter [-] [207601] Writing DB stats keystone:SELECT=100 {{(pid=207601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:24:24.702010 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b5f515-ded5-446f-93ff-5e819b623511 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:24:24.702658 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b5f515-ded5-446f-93ff-5e819b623511 None admin] REQUEST_METHOD: `GET` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:24:24.702956 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b5f515-ded5-446f-93ff-5e819b623511 None admin] SCRIPT_NAME: `/identity` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:24:24.703233 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b5f515-ded5-446f-93ff-5e819b623511 None admin] PATH_INFO: `/v3/projects` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:24:24.704012 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2b5f515-ded5-446f-93ff-5e819b623511 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=207600) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:24:24.704324 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2b5f515-ded5-446f-93ff-5e819b623511 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:24:24.707017 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2b5f515-ded5-446f-93ff-5e819b623511 None admin] RBAC: Authorization granted {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:24:24.724445 dv-cinder-851351-1-smb devstack@keystone.service[207600]: [pid: 207600|app: 0|req: 270/537] 10.222.0.42 () {56 vars in 1148 bytes} [Thu Jul 28 08:24:24 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:24:24.724445 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac445ace-3657-4c72-861e-107780280b8a None None] REQUEST_METHOD: `GET` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:24:24.724445 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac445ace-3657-4c72-861e-107780280b8a None None] SCRIPT_NAME: `/identity` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:24:24.724445 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac445ace-3657-4c72-861e-107780280b8a None None] PATH_INFO: `/` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:24:24.728417 dv-cinder-851351-1-smb devstack@keystone.service[207600]: [pid: 207600|app: 0|req: 271/538] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 08:24:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 08:24:24.729842 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e05eef1-0524-44b5-bb03-239f6eade16c None None] REQUEST_METHOD: `POST` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:24:24.730125 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e05eef1-0524-44b5-bb03-239f6eade16c None None] SCRIPT_NAME: `/identity` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:24:24.730407 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e05eef1-0524-44b5-bb03-239f6eade16c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:24:24.750868 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.auth.core [None req-6e05eef1-0524-44b5-bb03-239f6eade16c None None] MFA Rules not processed for user `b8110ade874c4aa7af27f5c376df700a`. Rule list: `[]` (Enabled: `True`). {{(pid=207600) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 08:24:24.752076 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.fernet_utils [None req-6e05eef1-0524-44b5-bb03-239f6eade16c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=207600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:24:24.756055 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG dbcounter [-] [207600] Writing DB stats keystone:SELECT=100 {{(pid=207600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:24:24.774315 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dba9c05-f60c-41b5-ae57-9e7e24f9e844 None admin] Validating token access rules against request {{(pid=207601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:24:24.814854 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d88a74fa-b25b-4486-a45a-f2d59f21c7d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:24:24.816091 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88a74fa-b25b-4486-a45a-f2d59f21c7d8 None admin] REQUEST_METHOD: `GET` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:24:24.816647 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88a74fa-b25b-4486-a45a-f2d59f21c7d8 None admin] SCRIPT_NAME: `/identity` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:24:24.817217 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88a74fa-b25b-4486-a45a-f2d59f21c7d8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:24:24.825650 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d88a74fa-b25b-4486-a45a-f2d59f21c7d8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:24:24.827591 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d88a74fa-b25b-4486-a45a-f2d59f21c7d8 None admin] RBAC: Authorization granted {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:24:24.832762 dv-cinder-851351-1-smb devstack@keystone.service[207600]: [pid: 207600|app: 0|req: 272/539] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 08:24:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 28 08:24:24.833693 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e05eef1-0524-44b5-bb03-239f6eade16c None None] Authenticating user token {{(pid=207600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:24:24.841992 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application [None req-d88a74fa-b25b-4486-a45a-f2d59f21c7d8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 08:24:24.841992 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:24:24.841992 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:24:24.841992 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:24:24.841992 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:24:24.841992 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:24:24.841992 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:24:24.841992 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:24:24.841992 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:24:24.841992 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:24:24.841992 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:24:24.841992 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:24:24.841992 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 28 08:24:24.841992 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 28 08:24:24.841992 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 28 08:24:24.842955 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 28 08:24:24.842955 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:24:24.842955 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:24:24.842955 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:24:24.842955 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:24:24.842955 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:24:24.842955 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:24:24.842955 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:24:24.842955 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application with Lock( Jul 28 08:24:24.842955 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:24:24.842955 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:24:24.842955 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:24:24.842955 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:24:24.842955 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:24:24.842955 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:24:24.842955 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:24:24.842955 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:24:24.843870 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 28 08:24:24.843870 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 28 08:24:24.843870 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 28 08:24:24.843870 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 28 08:24:24.843870 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 28 08:24:24.843870 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 28 08:24:24.843870 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 08:24:24.843870 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application Jul 28 08:24:24.846288 dv-cinder-851351-1-smb devstack@keystone.service[207601]: [pid: 207601|app: 0|req: 268/540] 10.222.0.42 () {56 vars in 1111 bytes} [Thu Jul 28 08:24:24 2022] GET /identity/v3/projects/service => generated 88 bytes in 284 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:24:24.856801 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d88a74fa-b25b-4486-a45a-f2d59f21c7d8 None admin] Authenticating user token {{(pid=207601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:24:24.963440 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e05eef1-0524-44b5-bb03-239f6eade16c None None] Validating token access rules against request {{(pid=207600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:24:24.975160 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d88a74fa-b25b-4486-a45a-f2d59f21c7d8 None admin] Validating token access rules against request {{(pid=207601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:24:24.999285 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e398fc30-bb8d-4356-bfc0-4079c5456e93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:24:24.999925 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e398fc30-bb8d-4356-bfc0-4079c5456e93 None admin] REQUEST_METHOD: `GET` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:24:25.000280 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e398fc30-bb8d-4356-bfc0-4079c5456e93 None admin] SCRIPT_NAME: `/identity` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:24:25.000558 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e398fc30-bb8d-4356-bfc0-4079c5456e93 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:24:25.001450 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e398fc30-bb8d-4356-bfc0-4079c5456e93 None admin] RBAC: Adding query filter params (role.id=b44e7c7aeec24f51b8033df305da133d, scope.project.id=48c5f2b2ae2b48758b957d2b194a7fd1, user.id=d73bf33a61c14daa85bf297acf8d0751) {{(pid=207600) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:24:25.001874 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e398fc30-bb8d-4356-bfc0-4079c5456e93 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:24:25.003267 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e398fc30-bb8d-4356-bfc0-4079c5456e93 None admin] RBAC: Authorization granted {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:24:25.015588 dv-cinder-851351-1-smb devstack@keystone.service[207600]: [pid: 207600|app: 0|req: 273/541] 10.222.0.42 () {56 vars in 1374 bytes} [Thu Jul 28 08:24:24 2022] GET /identity/v3/role_assignments?user.id=d73bf33a61c14daa85bf297acf8d0751&scope.project.id=48c5f2b2ae2b48758b957d2b194a7fd1&role.id=b44e7c7aeec24f51b8033df305da133d => generated 259 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:24:25.015588 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e398fc30-bb8d-4356-bfc0-4079c5456e93 None admin] Authenticating user token {{(pid=207600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:24:25.016555 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG dbcounter [-] [207600] Writing DB stats keystone:SELECT=100 {{(pid=207600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:24:25.018895 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG dbcounter [-] [207601] Writing DB stats keystone:SELECT=100 {{(pid=207601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:24:25.028650 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5459cbb3-e798-406b-ad13-b26c0c87b6aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:24:25.029661 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5459cbb3-e798-406b-ad13-b26c0c87b6aa None admin] REQUEST_METHOD: `GET` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:24:25.030231 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5459cbb3-e798-406b-ad13-b26c0c87b6aa None admin] SCRIPT_NAME: `/identity` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:24:25.030734 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5459cbb3-e798-406b-ad13-b26c0c87b6aa None admin] PATH_INFO: `/v3/projects` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:24:25.031860 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5459cbb3-e798-406b-ad13-b26c0c87b6aa None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=207601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:24:25.032363 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5459cbb3-e798-406b-ad13-b26c0c87b6aa None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:24:25.040703 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5459cbb3-e798-406b-ad13-b26c0c87b6aa None admin] RBAC: Authorization granted {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:24:25.065464 dv-cinder-851351-1-smb devstack@keystone.service[207601]: [pid: 207601|app: 0|req: 269/542] 10.222.0.42 () {56 vars in 1148 bytes} [Thu Jul 28 08:24:24 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:24:25.071704 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5459cbb3-e798-406b-ad13-b26c0c87b6aa None admin] Authenticating user token {{(pid=207601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:24:25.180704 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e398fc30-bb8d-4356-bfc0-4079c5456e93 None admin] Validating token access rules against request {{(pid=207600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:24:25.243373 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f711b0-a341-448f-9a67-d0bf61b66156 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:24:25.244303 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f711b0-a341-448f-9a67-d0bf61b66156 None admin] REQUEST_METHOD: `GET` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:24:25.244885 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f711b0-a341-448f-9a67-d0bf61b66156 None admin] SCRIPT_NAME: `/identity` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:24:25.245385 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f711b0-a341-448f-9a67-d0bf61b66156 None admin] PATH_INFO: `/v3/roles/service` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:24:25.264933 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24f711b0-a341-448f-9a67-d0bf61b66156 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 08:24:25.275067 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application [None req-24f711b0-a341-448f-9a67-d0bf61b66156 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 28 08:24:25.275067 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:24:25.275067 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:24:25.275067 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:24:25.275067 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:24:25.275067 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:24:25.275067 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:24:25.275067 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:24:25.275067 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:24:25.275067 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:24:25.275067 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:24:25.275067 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:24:25.275067 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 08:24:25.275067 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 08:24:25.275067 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 08:24:25.275067 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 08:24:25.277124 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 08:24:25.277124 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 08:24:25.277124 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 08:24:25.277124 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 08:24:25.277124 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:24:25.277124 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:24:25.277124 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:24:25.277124 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:24:25.277124 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:24:25.277124 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:24:25.277124 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:24:25.277124 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application with Lock( Jul 28 08:24:25.277124 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:24:25.277124 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:24:25.277124 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:24:25.277124 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:24:25.279141 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:24:25.279141 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:24:25.279141 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:24:25.279141 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:24:25.279141 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 08:24:25.279141 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 08:24:25.279141 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 08:24:25.279141 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 08:24:25.279141 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 08:24:25.279141 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 08:24:25.279141 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 28 08:24:25.279141 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application Jul 28 08:24:25.279141 dv-cinder-851351-1-smb devstack@keystone.service[207600]: [pid: 207600|app: 0|req: 274/543] 10.222.0.42 () {56 vars in 1102 bytes} [Thu Jul 28 08:24:25 2022] GET /identity/v3/roles/service => generated 85 bytes in 267 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:24:25.291097 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f711b0-a341-448f-9a67-d0bf61b66156 None admin] Authenticating user token {{(pid=207600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:24:25.334473 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5459cbb3-e798-406b-ad13-b26c0c87b6aa None admin] Validating token access rules against request {{(pid=207601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:24:25.378923 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba23ce5d-b5f0-48b4-bdb2-a55d6b9fd6af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:24:25.379566 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba23ce5d-b5f0-48b4-bdb2-a55d6b9fd6af None admin] REQUEST_METHOD: `GET` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:24:25.379854 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba23ce5d-b5f0-48b4-bdb2-a55d6b9fd6af None admin] SCRIPT_NAME: `/identity` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:24:25.380133 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba23ce5d-b5f0-48b4-bdb2-a55d6b9fd6af None admin] PATH_INFO: `/v3/role_assignments` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:24:25.380977 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba23ce5d-b5f0-48b4-bdb2-a55d6b9fd6af None admin] RBAC: Adding query filter params (role.id=b44e7c7aeec24f51b8033df305da133d, scope.project.id=48c5f2b2ae2b48758b957d2b194a7fd1, user.id=8d8ee8f8acaf4811addc298a15a4916b) {{(pid=207601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:24:25.381325 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba23ce5d-b5f0-48b4-bdb2-a55d6b9fd6af None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:24:25.383346 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba23ce5d-b5f0-48b4-bdb2-a55d6b9fd6af None admin] RBAC: Authorization granted {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:24:25.391010 dv-cinder-851351-1-smb devstack@keystone.service[207601]: [pid: 207601|app: 0|req: 270/544] 10.222.0.42 () {56 vars in 1374 bytes} [Thu Jul 28 08:24:25 2022] GET /identity/v3/role_assignments?user.id=8d8ee8f8acaf4811addc298a15a4916b&scope.project.id=48c5f2b2ae2b48758b957d2b194a7fd1&role.id=b44e7c7aeec24f51b8033df305da133d => generated 259 bytes in 320 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 08:24:25.392586 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e570da9-0bb7-4a6b-ab49-a86930c0343b None None] REQUEST_METHOD: `GET` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:24:25.392922 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e570da9-0bb7-4a6b-ab49-a86930c0343b None None] SCRIPT_NAME: `/identity` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:24:25.393204 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e570da9-0bb7-4a6b-ab49-a86930c0343b None None] PATH_INFO: `/` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:24:25.398911 dv-cinder-851351-1-smb devstack@keystone.service[207601]: [pid: 207601|app: 0|req: 271/545] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 08:24:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 08:24:25.401315 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787ec0b0-6cba-4a05-a7e6-bd1783933479 None None] REQUEST_METHOD: `POST` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:24:25.401640 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787ec0b0-6cba-4a05-a7e6-bd1783933479 None None] SCRIPT_NAME: `/identity` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:24:25.401928 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787ec0b0-6cba-4a05-a7e6-bd1783933479 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:24:25.416942 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG dbcounter [-] [207600] Writing DB stats keystone:SELECT=100 {{(pid=207600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:24:25.424200 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.auth.core [None req-787ec0b0-6cba-4a05-a7e6-bd1783933479 None None] MFA Rules not processed for user `b8110ade874c4aa7af27f5c376df700a`. Rule list: `[]` (Enabled: `True`). {{(pid=207601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 08:24:25.425501 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.fernet_utils [None req-787ec0b0-6cba-4a05-a7e6-bd1783933479 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=207601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:24:25.485244 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG dbcounter [-] [207601] Writing DB stats keystone:SELECT=100 {{(pid=207601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:24:25.508329 dv-cinder-851351-1-smb devstack@keystone.service[207601]: [pid: 207601|app: 0|req: 272/546] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 08:24:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 28 08:24:25.532794 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787ec0b0-6cba-4a05-a7e6-bd1783933479 None None] Authenticating user token {{(pid=207601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:24:25.562592 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f711b0-a341-448f-9a67-d0bf61b66156 None admin] Validating token access rules against request {{(pid=207600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:24:25.650473 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787ec0b0-6cba-4a05-a7e6-bd1783933479 None None] Validating token access rules against request {{(pid=207601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:24:25.656105 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259649e9-556b-4329-b162-c8d9b20f4942 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:24:25.657175 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259649e9-556b-4329-b162-c8d9b20f4942 None admin] REQUEST_METHOD: `GET` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:24:25.657651 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259649e9-556b-4329-b162-c8d9b20f4942 None admin] SCRIPT_NAME: `/identity` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:24:25.658130 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259649e9-556b-4329-b162-c8d9b20f4942 None admin] PATH_INFO: `/v3/roles` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:24:25.659540 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-259649e9-556b-4329-b162-c8d9b20f4942 None admin] RBAC: Adding query filter params (name=service) {{(pid=207600) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:24:25.660138 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-259649e9-556b-4329-b162-c8d9b20f4942 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:24:25.662642 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-259649e9-556b-4329-b162-c8d9b20f4942 None admin] RBAC: Authorization granted {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:24:25.686290 dv-cinder-851351-1-smb devstack@keystone.service[207600]: [pid: 207600|app: 0|req: 275/547] 10.222.0.42 () {56 vars in 1103 bytes} [Thu Jul 28 08:24:25 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 396 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:24:25.689776 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f91847-238a-4f0c-9ca9-4a65224637a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:24:25.690466 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f91847-238a-4f0c-9ca9-4a65224637a8 None admin] REQUEST_METHOD: `GET` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:24:25.690752 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f91847-238a-4f0c-9ca9-4a65224637a8 None admin] SCRIPT_NAME: `/identity` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:24:25.691032 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f91847-238a-4f0c-9ca9-4a65224637a8 None admin] PATH_INFO: `/v3/roles/service` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:24:25.693572 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259649e9-556b-4329-b162-c8d9b20f4942 None admin] Authenticating user token {{(pid=207600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:24:25.703854 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3f91847-238a-4f0c-9ca9-4a65224637a8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 08:24:25.709280 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application [None req-d3f91847-238a-4f0c-9ca9-4a65224637a8 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 28 08:24:25.709280 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:24:25.709280 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:24:25.709280 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:24:25.709280 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:24:25.709280 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:24:25.709280 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:24:25.709280 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:24:25.709280 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:24:25.709280 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:24:25.709280 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:24:25.709280 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:24:25.709280 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 08:24:25.709280 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 08:24:25.709280 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 08:24:25.709280 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 08:24:25.711740 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 08:24:25.711740 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 08:24:25.711740 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 08:24:25.711740 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 08:24:25.711740 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:24:25.711740 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:24:25.711740 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:24:25.711740 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:24:25.711740 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:24:25.711740 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:24:25.711740 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:24:25.711740 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application with Lock( Jul 28 08:24:25.711740 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:24:25.711740 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:24:25.711740 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:24:25.711740 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:24:25.715005 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:24:25.715005 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:24:25.715005 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:24:25.715005 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:24:25.715005 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 08:24:25.715005 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 08:24:25.715005 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 08:24:25.715005 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 08:24:25.715005 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 08:24:25.715005 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 08:24:25.715005 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 28 08:24:25.715005 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application Jul 28 08:24:25.715005 dv-cinder-851351-1-smb devstack@keystone.service[207601]: [pid: 207601|app: 0|req: 273/548] 10.222.0.42 () {56 vars in 1102 bytes} [Thu Jul 28 08:24:25 2022] GET /identity/v3/roles/service => generated 85 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 08:24:25.721081 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f91847-238a-4f0c-9ca9-4a65224637a8 None admin] Authenticating user token {{(pid=207601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:24:25.809202 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG dbcounter [-] [207601] Writing DB stats keystone:SELECT=100 {{(pid=207601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:24:25.888718 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f91847-238a-4f0c-9ca9-4a65224637a8 None admin] Validating token access rules against request {{(pid=207601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:24:25.911882 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259649e9-556b-4329-b162-c8d9b20f4942 None admin] Validating token access rules against request {{(pid=207600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:24:25.961714 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d73554d2-21d2-4da4-8ab5-b2a27ea0644d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:24:25.962413 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73554d2-21d2-4da4-8ab5-b2a27ea0644d None admin] REQUEST_METHOD: `GET` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:24:25.962702 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73554d2-21d2-4da4-8ab5-b2a27ea0644d None admin] SCRIPT_NAME: `/identity` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:24:25.963340 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73554d2-21d2-4da4-8ab5-b2a27ea0644d None admin] PATH_INFO: `/v3/roles` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:24:25.964173 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d73554d2-21d2-4da4-8ab5-b2a27ea0644d None admin] RBAC: Adding query filter params (name=service) {{(pid=207601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:24:25.964490 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d73554d2-21d2-4da4-8ab5-b2a27ea0644d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:24:25.965957 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d73554d2-21d2-4da4-8ab5-b2a27ea0644d None admin] RBAC: Authorization granted {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:24:25.973049 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG dbcounter [-] [207600] Writing DB stats keystone:SELECT=100 {{(pid=207600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:24:25.983547 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0029bb50-d63f-436d-98af-2b57335a3ac9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:24:25.986361 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0029bb50-d63f-436d-98af-2b57335a3ac9 None admin] REQUEST_METHOD: `GET` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:24:25.986742 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0029bb50-d63f-436d-98af-2b57335a3ac9 None admin] SCRIPT_NAME: `/identity` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:24:25.987026 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0029bb50-d63f-436d-98af-2b57335a3ac9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:24:25.987954 dv-cinder-851351-1-smb devstack@keystone.service[207601]: [pid: 207601|app: 0|req: 274/549] 10.222.0.42 () {56 vars in 1103 bytes} [Thu Jul 28 08:24:25 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:24:25.991772 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d73554d2-21d2-4da4-8ab5-b2a27ea0644d None admin] Authenticating user token {{(pid=207601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:24:26.011325 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0029bb50-d63f-436d-98af-2b57335a3ac9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:24:26.012878 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0029bb50-d63f-436d-98af-2b57335a3ac9 None admin] RBAC: Authorization granted {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:24:26.035978 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application [None req-0029bb50-d63f-436d-98af-2b57335a3ac9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 08:24:26.035978 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:24:26.035978 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:24:26.035978 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:24:26.035978 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:24:26.035978 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:24:26.035978 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:24:26.035978 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:24:26.035978 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:24:26.035978 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:24:26.035978 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:24:26.035978 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:24:26.035978 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 08:24:26.035978 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 08:24:26.035978 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 08:24:26.036992 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 08:24:26.036992 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:24:26.036992 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:24:26.036992 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:24:26.036992 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:24:26.036992 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:24:26.036992 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:24:26.036992 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:24:26.036992 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application with Lock( Jul 28 08:24:26.036992 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:24:26.036992 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:24:26.036992 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:24:26.036992 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:24:26.036992 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:24:26.036992 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:24:26.036992 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:24:26.036992 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:24:26.037932 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 08:24:26.037932 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 08:24:26.037932 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 08:24:26.037932 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application Jul 28 08:24:26.046637 dv-cinder-851351-1-smb devstack@keystone.service[207600]: [pid: 207600|app: 0|req: 276/550] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 08:24:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 350 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 08:24:26.049199 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0029bb50-d63f-436d-98af-2b57335a3ac9 None admin] Authenticating user token {{(pid=207600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:24:26.193559 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d73554d2-21d2-4da4-8ab5-b2a27ea0644d None admin] Validating token access rules against request {{(pid=207601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:24:26.213537 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG dbcounter [-] [207601] Writing DB stats keystone:SELECT=100 {{(pid=207601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:24:26.219000 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0029bb50-d63f-436d-98af-2b57335a3ac9 None admin] Validating token access rules against request {{(pid=207600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:24:26.233594 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10bf4c67-f863-42c6-9451-b9383fcdb5b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:24:26.234281 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10bf4c67-f863-42c6-9451-b9383fcdb5b1 None admin] REQUEST_METHOD: `GET` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:24:26.234572 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10bf4c67-f863-42c6-9451-b9383fcdb5b1 None admin] SCRIPT_NAME: `/identity` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:24:26.234856 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10bf4c67-f863-42c6-9451-b9383fcdb5b1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:24:26.247250 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10bf4c67-f863-42c6-9451-b9383fcdb5b1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:24:26.248828 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10bf4c67-f863-42c6-9451-b9383fcdb5b1 None admin] RBAC: Authorization granted {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:24:26.265656 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application [None req-10bf4c67-f863-42c6-9451-b9383fcdb5b1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 08:24:26.265656 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:24:26.265656 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:24:26.265656 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:24:26.265656 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:24:26.265656 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:24:26.265656 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:24:26.265656 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:24:26.265656 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:24:26.265656 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:24:26.265656 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:24:26.265656 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:24:26.265656 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 08:24:26.265656 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 08:24:26.265656 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 08:24:26.266705 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 08:24:26.266705 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:24:26.266705 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:24:26.266705 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:24:26.266705 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:24:26.266705 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:24:26.266705 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:24:26.266705 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:24:26.266705 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application with Lock( Jul 28 08:24:26.266705 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:24:26.266705 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:24:26.266705 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:24:26.266705 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:24:26.266705 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:24:26.266705 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:24:26.266705 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:24:26.266705 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:24:26.267624 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 08:24:26.267624 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 08:24:26.267624 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 08:24:26.267624 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application Jul 28 08:24:26.267624 dv-cinder-851351-1-smb devstack@keystone.service[207601]: [pid: 207601|app: 0|req: 275/551] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 08:24:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 276 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:24:26.273389 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10bf4c67-f863-42c6-9451-b9383fcdb5b1 None admin] Authenticating user token {{(pid=207601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:24:26.297135 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3901b18d-d02e-4a59-9ee3-2a5fc5e63f0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:24:26.297886 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3901b18d-d02e-4a59-9ee3-2a5fc5e63f0a None admin] REQUEST_METHOD: `GET` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:24:26.298175 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3901b18d-d02e-4a59-9ee3-2a5fc5e63f0a None admin] SCRIPT_NAME: `/identity` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:24:26.298454 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3901b18d-d02e-4a59-9ee3-2a5fc5e63f0a None admin] PATH_INFO: `/v3/domains` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:24:26.299182 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3901b18d-d02e-4a59-9ee3-2a5fc5e63f0a None admin] RBAC: Adding query filter params (name=Default) {{(pid=207600) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:24:26.299497 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3901b18d-d02e-4a59-9ee3-2a5fc5e63f0a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:24:26.300953 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3901b18d-d02e-4a59-9ee3-2a5fc5e63f0a None admin] RBAC: Authorization granted {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:24:26.323639 dv-cinder-851351-1-smb devstack@keystone.service[207600]: [pid: 207600|app: 0|req: 277/552] 10.222.0.42 () {56 vars in 1109 bytes} [Thu Jul 28 08:24:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:24:26.329197 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3901b18d-d02e-4a59-9ee3-2a5fc5e63f0a None admin] Authenticating user token {{(pid=207600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:24:26.379295 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG dbcounter [-] [207600] Writing DB stats keystone:SELECT=100 {{(pid=207600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:24:26.457876 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3901b18d-d02e-4a59-9ee3-2a5fc5e63f0a None admin] Validating token access rules against request {{(pid=207600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:24:26.506614 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10bf4c67-f863-42c6-9451-b9383fcdb5b1 None admin] Validating token access rules against request {{(pid=207601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:24:26.528227 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fafa734-c878-44d8-bb80-6aadea507814 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:24:26.528942 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fafa734-c878-44d8-bb80-6aadea507814 None admin] REQUEST_METHOD: `GET` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:24:26.529229 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fafa734-c878-44d8-bb80-6aadea507814 None admin] SCRIPT_NAME: `/identity` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:24:26.529504 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fafa734-c878-44d8-bb80-6aadea507814 None admin] PATH_INFO: `/v3/users/swift` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:24:26.544956 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fafa734-c878-44d8-bb80-6aadea507814 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:24:26.546447 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fafa734-c878-44d8-bb80-6aadea507814 None admin] RBAC: Authorization granted {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:24:26.571209 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application [None req-0fafa734-c878-44d8-bb80-6aadea507814 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 28 08:24:26.571209 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:24:26.571209 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:24:26.571209 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:24:26.571209 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:24:26.571209 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:24:26.571209 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:24:26.571209 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:24:26.571209 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:24:26.571209 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:24:26.571209 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:24:26.571209 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:24:26.571209 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 28 08:24:26.571209 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 28 08:24:26.571209 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 28 08:24:26.571209 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 28 08:24:26.572280 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:24:26.572280 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:24:26.572280 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 28 08:24:26.572280 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 08:24:26.572280 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 28 08:24:26.572280 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 08:24:26.572280 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:24:26.572280 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:24:26.572280 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:24:26.572280 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:24:26.572280 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:24:26.572280 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application with Lock( Jul 28 08:24:26.572280 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:24:26.572280 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:24:26.572280 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:24:26.572280 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:24:26.572280 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:24:26.572280 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:24:26.573346 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:24:26.573346 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:24:26.573346 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 28 08:24:26.573346 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 28 08:24:26.573346 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 28 08:24:26.573346 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 28 08:24:26.573346 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 28 08:24:26.573346 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 28 08:24:26.573346 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 28 08:24:26.573346 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application Jul 28 08:24:26.573346 dv-cinder-851351-1-smb devstack@keystone.service[207600]: [pid: 207600|app: 0|req: 278/553] 10.222.0.42 () {56 vars in 1096 bytes} [Thu Jul 28 08:24:26 2022] GET /identity/v3/users/swift => generated 83 bytes in 244 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:24:26.579287 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fafa734-c878-44d8-bb80-6aadea507814 None admin] Authenticating user token {{(pid=207600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:24:26.586277 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9bb1ee1-730f-4cf7-851c-3eccffdd2cfa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:24:26.586936 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9bb1ee1-730f-4cf7-851c-3eccffdd2cfa None admin] REQUEST_METHOD: `GET` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:24:26.587215 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9bb1ee1-730f-4cf7-851c-3eccffdd2cfa None admin] SCRIPT_NAME: `/identity` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:24:26.587494 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9bb1ee1-730f-4cf7-851c-3eccffdd2cfa None admin] PATH_INFO: `/v3/domains` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:24:26.588628 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9bb1ee1-730f-4cf7-851c-3eccffdd2cfa None admin] RBAC: Adding query filter params (name=Default) {{(pid=207601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:24:26.588970 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9bb1ee1-730f-4cf7-851c-3eccffdd2cfa None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:24:26.590378 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9bb1ee1-730f-4cf7-851c-3eccffdd2cfa None admin] RBAC: Authorization granted {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:24:26.614486 dv-cinder-851351-1-smb devstack@keystone.service[207601]: [pid: 207601|app: 0|req: 276/554] 10.222.0.42 () {56 vars in 1109 bytes} [Thu Jul 28 08:24:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 342 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 08:24:26.620143 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9bb1ee1-730f-4cf7-851c-3eccffdd2cfa None admin] Authenticating user token {{(pid=207601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:24:26.657450 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG dbcounter [-] [207601] Writing DB stats keystone:SELECT=100 {{(pid=207601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:24:26.758266 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG dbcounter [-] [207600] Writing DB stats keystone:SELECT=100 {{(pid=207600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:24:26.766876 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fafa734-c878-44d8-bb80-6aadea507814 None admin] Validating token access rules against request {{(pid=207600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:24:26.803484 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9bb1ee1-730f-4cf7-851c-3eccffdd2cfa None admin] Validating token access rules against request {{(pid=207601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:24:26.811397 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-113a4f97-0419-4464-96de-beb394c6f576 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:24:26.812041 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113a4f97-0419-4464-96de-beb394c6f576 None admin] REQUEST_METHOD: `GET` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:24:26.812327 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113a4f97-0419-4464-96de-beb394c6f576 None admin] SCRIPT_NAME: `/identity` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:24:26.812606 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113a4f97-0419-4464-96de-beb394c6f576 None admin] PATH_INFO: `/v3/users` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:24:26.814152 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-113a4f97-0419-4464-96de-beb394c6f576 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=207600) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:24:26.814475 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-113a4f97-0419-4464-96de-beb394c6f576 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:24:26.816418 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-113a4f97-0419-4464-96de-beb394c6f576 None admin] RBAC: Authorization granted {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:24:26.841102 dv-cinder-851351-1-smb devstack@keystone.service[207600]: [pid: 207600|app: 0|req: 279/555] 10.222.0.42 () {56 vars in 1135 bytes} [Thu Jul 28 08:24:26 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:24:26.842415 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d70256e-e63c-4ba1-96e6-1e694c4d1695 None None] REQUEST_METHOD: `GET` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:24:26.842834 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d70256e-e63c-4ba1-96e6-1e694c4d1695 None None] SCRIPT_NAME: `/identity` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:24:26.843222 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d70256e-e63c-4ba1-96e6-1e694c4d1695 None None] PATH_INFO: `/` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:24:26.848705 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d73e6dc-19fd-4757-9d01-e5a14bb1fdbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:24:26.848896 dv-cinder-851351-1-smb devstack@keystone.service[207600]: [pid: 207600|app: 0|req: 280/556] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 08:24:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 08:24:26.848896 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d70256e-e63c-4ba1-96e6-1e694c4d1695 None None] Authenticating user token {{(pid=207600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:24:26.850182 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d73e6dc-19fd-4757-9d01-e5a14bb1fdbe None admin] REQUEST_METHOD: `GET` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:24:26.850800 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d73e6dc-19fd-4757-9d01-e5a14bb1fdbe None admin] SCRIPT_NAME: `/identity` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:24:26.851279 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d73e6dc-19fd-4757-9d01-e5a14bb1fdbe None admin] PATH_INFO: `/v3/users/nova` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:24:26.860562 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d73e6dc-19fd-4757-9d01-e5a14bb1fdbe None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:24:26.862589 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d73e6dc-19fd-4757-9d01-e5a14bb1fdbe None admin] RBAC: Authorization granted {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:24:26.876348 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application [None req-7d73e6dc-19fd-4757-9d01-e5a14bb1fdbe None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 28 08:24:26.876348 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:24:26.876348 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:24:26.876348 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:24:26.876348 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:24:26.876348 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:24:26.876348 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:24:26.876348 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:24:26.876348 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:24:26.876348 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:24:26.876348 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:24:26.876348 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:24:26.876348 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 28 08:24:26.876348 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 28 08:24:26.876348 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 28 08:24:26.876348 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 28 08:24:26.877415 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:24:26.877415 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:24:26.877415 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 28 08:24:26.877415 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 08:24:26.877415 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 28 08:24:26.877415 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 08:24:26.877415 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:24:26.877415 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:24:26.877415 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:24:26.877415 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:24:26.877415 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:24:26.877415 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application with Lock( Jul 28 08:24:26.877415 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:24:26.877415 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:24:26.877415 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:24:26.877415 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:24:26.877415 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:24:26.877415 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:24:26.878651 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:24:26.878651 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:24:26.878651 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 28 08:24:26.878651 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 28 08:24:26.878651 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 28 08:24:26.878651 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 28 08:24:26.878651 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 28 08:24:26.878651 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 28 08:24:26.878651 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 28 08:24:26.878651 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application Jul 28 08:24:26.891550 dv-cinder-851351-1-smb devstack@keystone.service[207601]: [pid: 207601|app: 0|req: 277/557] 10.222.0.42 () {56 vars in 1093 bytes} [Thu Jul 28 08:24:26 2022] GET /identity/v3/users/nova => generated 82 bytes in 267 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 08:24:26.893460 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d20a529-18fe-439a-98ec-ebe7fd39b7e9 None None] REQUEST_METHOD: `POST` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:24:26.900209 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d20a529-18fe-439a-98ec-ebe7fd39b7e9 None None] SCRIPT_NAME: `/identity` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:24:26.900833 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d20a529-18fe-439a-98ec-ebe7fd39b7e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:24:26.921008 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.auth.core [None req-8d20a529-18fe-439a-98ec-ebe7fd39b7e9 None None] MFA Rules not processed for user `b8110ade874c4aa7af27f5c376df700a`. Rule list: `[]` (Enabled: `True`). {{(pid=207601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 08:24:26.922650 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.fernet_utils [None req-8d20a529-18fe-439a-98ec-ebe7fd39b7e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=207601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:24:26.983599 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d70256e-e63c-4ba1-96e6-1e694c4d1695 None None] Validating token access rules against request {{(pid=207600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:24:27.018691 dv-cinder-851351-1-smb devstack@keystone.service[207601]: [pid: 207601|app: 0|req: 278/558] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 08:24:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 08:24:27.020613 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d20a529-18fe-439a-98ec-ebe7fd39b7e9 None None] Authenticating user token {{(pid=207601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:24:27.028759 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9f1b8b-ae1c-4f74-adc6-389af146d7c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:24:27.029188 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9f1b8b-ae1c-4f74-adc6-389af146d7c4 None admin] REQUEST_METHOD: `GET` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:24:27.029476 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9f1b8b-ae1c-4f74-adc6-389af146d7c4 None admin] SCRIPT_NAME: `/identity` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:24:27.029755 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9f1b8b-ae1c-4f74-adc6-389af146d7c4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:24:27.043704 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG dbcounter [-] [207601] Writing DB stats keystone:SELECT=100 {{(pid=207601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:24:27.070294 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG dbcounter [-] [207600] Writing DB stats keystone:SELECT=100 {{(pid=207600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:24:27.132392 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d9f1b8b-ae1c-4f74-adc6-389af146d7c4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:24:27.134175 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d9f1b8b-ae1c-4f74-adc6-389af146d7c4 None admin] RBAC: Authorization granted {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:24:27.175613 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d20a529-18fe-439a-98ec-ebe7fd39b7e9 None None] Validating token access rules against request {{(pid=207601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:24:27.229523 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8943c09b-f6b9-47de-8bc9-e665711ce114 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:24:27.230875 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8943c09b-f6b9-47de-8bc9-e665711ce114 None admin] REQUEST_METHOD: `GET` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:24:27.231364 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8943c09b-f6b9-47de-8bc9-e665711ce114 None admin] SCRIPT_NAME: `/identity` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:24:27.232114 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8943c09b-f6b9-47de-8bc9-e665711ce114 None admin] PATH_INFO: `/v3/users` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:24:27.233534 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8943c09b-f6b9-47de-8bc9-e665711ce114 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=207601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:24:27.233855 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8943c09b-f6b9-47de-8bc9-e665711ce114 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:24:27.235333 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8943c09b-f6b9-47de-8bc9-e665711ce114 None admin] RBAC: Authorization granted {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:24:27.259790 dv-cinder-851351-1-smb devstack@keystone.service[207601]: [pid: 207601|app: 0|req: 279/559] 10.222.0.42 () {56 vars in 1133 bytes} [Thu Jul 28 08:24:27 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:24:27.259790 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8943c09b-f6b9-47de-8bc9-e665711ce114 None admin] Authenticating user token {{(pid=207601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:24:27.263942 dv-cinder-851351-1-smb devstack@keystone.service[207600]: [pid: 207600|app: 0|req: 281/560] 10.222.0.42 () {58 vars in 1282 bytes} [Thu Jul 28 08:24:26 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 417 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 28 08:24:27.265602 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9f1b8b-ae1c-4f74-adc6-389af146d7c4 None admin] Authenticating user token {{(pid=207600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:24:27.334059 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG dbcounter [-] [207601] Writing DB stats keystone:SELECT=100 {{(pid=207601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:24:27.347193 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG dbcounter [-] [207600] Writing DB stats keystone:SELECT=100 {{(pid=207600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:24:27.373677 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8943c09b-f6b9-47de-8bc9-e665711ce114 None admin] Validating token access rules against request {{(pid=207601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:24:27.394018 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9f1b8b-ae1c-4f74-adc6-389af146d7c4 None admin] Validating token access rules against request {{(pid=207600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:24:27.413021 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec911ad3-baeb-452a-bcae-ec17e423460d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:24:27.413847 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec911ad3-baeb-452a-bcae-ec17e423460d None admin] REQUEST_METHOD: `GET` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:24:27.414139 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec911ad3-baeb-452a-bcae-ec17e423460d None admin] SCRIPT_NAME: `/identity` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:24:27.414411 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec911ad3-baeb-452a-bcae-ec17e423460d None admin] PATH_INFO: `/v3/roles/service` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:24:27.426228 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec911ad3-baeb-452a-bcae-ec17e423460d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 08:24:27.431450 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application [None req-ec911ad3-baeb-452a-bcae-ec17e423460d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 28 08:24:27.431450 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:24:27.431450 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:24:27.431450 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:24:27.431450 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:24:27.431450 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:24:27.431450 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:24:27.431450 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:24:27.431450 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:24:27.431450 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:24:27.431450 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:24:27.431450 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:24:27.431450 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 08:24:27.431450 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 08:24:27.431450 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 08:24:27.431450 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 08:24:27.432511 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 08:24:27.432511 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 08:24:27.432511 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 08:24:27.432511 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 08:24:27.432511 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:24:27.432511 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:24:27.432511 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:24:27.432511 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:24:27.432511 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:24:27.432511 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:24:27.432511 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:24:27.432511 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application with Lock( Jul 28 08:24:27.432511 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:24:27.432511 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:24:27.432511 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:24:27.432511 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:24:27.433740 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:24:27.433740 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:24:27.433740 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:24:27.433740 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:24:27.433740 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 08:24:27.433740 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 08:24:27.433740 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 08:24:27.433740 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 08:24:27.433740 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 08:24:27.433740 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 08:24:27.433740 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 28 08:24:27.433740 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application Jul 28 08:24:27.434434 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c9c2cf-9628-4045-97fb-924d97a46252 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:24:27.434434 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c9c2cf-9628-4045-97fb-924d97a46252 None admin] REQUEST_METHOD: `GET` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:24:27.434434 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c9c2cf-9628-4045-97fb-924d97a46252 None admin] SCRIPT_NAME: `/identity` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:24:27.434434 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c9c2cf-9628-4045-97fb-924d97a46252 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:24:27.437839 dv-cinder-851351-1-smb devstack@keystone.service[207601]: [pid: 207601|app: 0|req: 280/561] 10.222.0.42 () {56 vars in 1102 bytes} [Thu Jul 28 08:24:27 2022] GET /identity/v3/roles/service => generated 85 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:24:27.438772 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec911ad3-baeb-452a-bcae-ec17e423460d None admin] Authenticating user token {{(pid=207601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:24:27.446379 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04c9c2cf-9628-4045-97fb-924d97a46252 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:24:27.447904 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04c9c2cf-9628-4045-97fb-924d97a46252 None admin] RBAC: Authorization granted {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:24:27.464084 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application [None req-04c9c2cf-9628-4045-97fb-924d97a46252 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 08:24:27.464084 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:24:27.464084 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:24:27.464084 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:24:27.464084 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:24:27.464084 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:24:27.464084 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:24:27.464084 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:24:27.464084 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:24:27.464084 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:24:27.464084 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:24:27.464084 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:24:27.464084 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 08:24:27.464084 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 08:24:27.464084 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 08:24:27.465338 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 08:24:27.465338 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:24:27.465338 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:24:27.465338 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:24:27.465338 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:24:27.465338 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:24:27.465338 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:24:27.465338 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:24:27.465338 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application with Lock( Jul 28 08:24:27.465338 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:24:27.465338 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:24:27.465338 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:24:27.465338 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:24:27.465338 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:24:27.465338 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:24:27.465338 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:24:27.465338 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:24:27.471681 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 08:24:27.471681 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 08:24:27.471681 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 08:24:27.471681 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application Jul 28 08:24:27.471681 dv-cinder-851351-1-smb devstack@keystone.service[207600]: [pid: 207600|app: 0|req: 282/562] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 08:24:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:24:27.471681 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341da7c0-cecc-408d-a211-4f8bc4afadae None None] REQUEST_METHOD: `GET` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:24:27.471681 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341da7c0-cecc-408d-a211-4f8bc4afadae None None] SCRIPT_NAME: `/identity` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:24:27.471681 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341da7c0-cecc-408d-a211-4f8bc4afadae None None] PATH_INFO: `/` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:24:27.471681 dv-cinder-851351-1-smb devstack@keystone.service[207600]: [pid: 207600|app: 0|req: 283/563] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 08:24:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 08:24:27.472725 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-341da7c0-cecc-408d-a211-4f8bc4afadae None None] Authenticating user token {{(pid=207600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:24:27.570589 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec911ad3-baeb-452a-bcae-ec17e423460d None admin] Validating token access rules against request {{(pid=207601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:24:27.592237 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-341da7c0-cecc-408d-a211-4f8bc4afadae None None] Validating token access rules against request {{(pid=207600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:24:27.598613 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG dbcounter [-] [207601] Writing DB stats keystone:SELECT=100 {{(pid=207601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:24:27.601613 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG dbcounter [-] [207600] Writing DB stats keystone:SELECT=100 {{(pid=207600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:24:27.610855 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ed0f69-0171-4356-832b-5813be455213 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:24:27.611527 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ed0f69-0171-4356-832b-5813be455213 None admin] REQUEST_METHOD: `GET` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:24:27.611812 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ed0f69-0171-4356-832b-5813be455213 None admin] SCRIPT_NAME: `/identity` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:24:27.612085 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ed0f69-0171-4356-832b-5813be455213 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:24:27.626222 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5ed0f69-0171-4356-832b-5813be455213 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:24:27.627695 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5ed0f69-0171-4356-832b-5813be455213 None admin] RBAC: Authorization granted {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:24:27.629707 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a07af3-d50e-4bc0-b6ac-63958b3c08ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:24:27.630356 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a07af3-d50e-4bc0-b6ac-63958b3c08ca None admin] REQUEST_METHOD: `GET` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:24:27.630625 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a07af3-d50e-4bc0-b6ac-63958b3c08ca None admin] SCRIPT_NAME: `/identity` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:24:27.630910 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a07af3-d50e-4bc0-b6ac-63958b3c08ca None admin] PATH_INFO: `/v3/roles` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:24:27.631650 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4a07af3-d50e-4bc0-b6ac-63958b3c08ca None admin] RBAC: Adding query filter params (name=service) {{(pid=207600) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:24:27.631961 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4a07af3-d50e-4bc0-b6ac-63958b3c08ca None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:24:27.633391 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4a07af3-d50e-4bc0-b6ac-63958b3c08ca None admin] RBAC: Authorization granted {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:24:27.643167 dv-cinder-851351-1-smb devstack@keystone.service[207600]: [pid: 207600|app: 0|req: 284/564] 10.222.0.42 () {56 vars in 1103 bytes} [Thu Jul 28 08:24:27 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:24:27.644005 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a07af3-d50e-4bc0-b6ac-63958b3c08ca None admin] Authenticating user token {{(pid=207600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:24:27.645642 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application [None req-a5ed0f69-0171-4356-832b-5813be455213 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 08:24:27.645642 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:24:27.645642 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:24:27.645642 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:24:27.645642 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:24:27.645642 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:24:27.645642 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:24:27.645642 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:24:27.645642 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:24:27.645642 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:24:27.645642 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:24:27.645642 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:24:27.645642 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 08:24:27.645642 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 08:24:27.645642 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 08:24:27.646592 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 08:24:27.646592 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:24:27.646592 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:24:27.646592 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:24:27.646592 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:24:27.646592 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:24:27.646592 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:24:27.646592 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:24:27.646592 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application with Lock( Jul 28 08:24:27.646592 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:24:27.646592 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:24:27.646592 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:24:27.646592 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:24:27.646592 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:24:27.646592 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:24:27.646592 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:24:27.646592 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:24:27.647535 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 08:24:27.647535 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 08:24:27.647535 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 08:24:27.647535 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application Jul 28 08:24:27.647535 dv-cinder-851351-1-smb devstack@keystone.service[207601]: [pid: 207601|app: 0|req: 281/565] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 08:24:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:24:27.648317 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128c3921-47ac-4dfc-b243-bbf4d9e7c6f2 None None] REQUEST_METHOD: `POST` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:24:27.648601 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128c3921-47ac-4dfc-b243-bbf4d9e7c6f2 None None] SCRIPT_NAME: `/identity` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:24:27.648912 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128c3921-47ac-4dfc-b243-bbf4d9e7c6f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:24:27.672277 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.auth.core [None req-128c3921-47ac-4dfc-b243-bbf4d9e7c6f2 None None] MFA Rules not processed for user `b8110ade874c4aa7af27f5c376df700a`. Rule list: `[]` (Enabled: `True`). {{(pid=207601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 08:24:27.674020 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.fernet_utils [None req-128c3921-47ac-4dfc-b243-bbf4d9e7c6f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=207601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:24:27.754150 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a07af3-d50e-4bc0-b6ac-63958b3c08ca None admin] Validating token access rules against request {{(pid=207600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:24:27.756113 dv-cinder-851351-1-smb devstack@keystone.service[207601]: [pid: 207601|app: 0|req: 282/566] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 08:24:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 08:24:27.757288 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-128c3921-47ac-4dfc-b243-bbf4d9e7c6f2 None None] Authenticating user token {{(pid=207601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:24:27.806670 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4285dd20-19f6-4368-8b42-c88e484461a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:24:27.807521 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4285dd20-19f6-4368-8b42-c88e484461a3 None admin] REQUEST_METHOD: `GET` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:24:27.807809 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4285dd20-19f6-4368-8b42-c88e484461a3 None admin] SCRIPT_NAME: `/identity` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:24:27.808091 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4285dd20-19f6-4368-8b42-c88e484461a3 None admin] PATH_INFO: `/v3/domains` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:24:27.808833 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4285dd20-19f6-4368-8b42-c88e484461a3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=207600) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:24:27.809172 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4285dd20-19f6-4368-8b42-c88e484461a3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:24:27.810597 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4285dd20-19f6-4368-8b42-c88e484461a3 None admin] RBAC: Authorization granted {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:24:27.828069 dv-cinder-851351-1-smb devstack@keystone.service[207600]: [pid: 207600|app: 0|req: 285/567] 10.222.0.42 () {56 vars in 1109 bytes} [Thu Jul 28 08:24:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:24:27.828069 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4285dd20-19f6-4368-8b42-c88e484461a3 None admin] Authenticating user token {{(pid=207600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:24:27.861673 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG dbcounter [-] [207600] Writing DB stats keystone:SELECT=100 {{(pid=207600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:24:27.870243 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-128c3921-47ac-4dfc-b243-bbf4d9e7c6f2 None None] Validating token access rules against request {{(pid=207601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:24:27.880075 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG dbcounter [-] [207601] Writing DB stats keystone:SELECT=100 {{(pid=207601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:24:27.909089 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc62dc7-8c5c-4f41-8cf0-e48306a0b2c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:24:27.909742 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc62dc7-8c5c-4f41-8cf0-e48306a0b2c0 None admin] REQUEST_METHOD: `GET` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:24:27.910032 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc62dc7-8c5c-4f41-8cf0-e48306a0b2c0 None admin] SCRIPT_NAME: `/identity` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:24:27.910316 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc62dc7-8c5c-4f41-8cf0-e48306a0b2c0 None admin] PATH_INFO: `/v3/domains` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:24:27.911024 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fc62dc7-8c5c-4f41-8cf0-e48306a0b2c0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=207601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:24:27.911337 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fc62dc7-8c5c-4f41-8cf0-e48306a0b2c0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:24:27.912746 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fc62dc7-8c5c-4f41-8cf0-e48306a0b2c0 None admin] RBAC: Authorization granted {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:24:27.924374 dv-cinder-851351-1-smb devstack@keystone.service[207601]: [pid: 207601|app: 0|req: 283/568] 10.222.0.42 () {56 vars in 1109 bytes} [Thu Jul 28 08:24:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:24:27.925250 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc62dc7-8c5c-4f41-8cf0-e48306a0b2c0 None admin] Authenticating user token {{(pid=207601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:24:27.936323 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4285dd20-19f6-4368-8b42-c88e484461a3 None admin] Validating token access rules against request {{(pid=207600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:24:27.970606 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ba71f4-609e-47b8-acf2-b06988b9d785 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:24:27.971261 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ba71f4-609e-47b8-acf2-b06988b9d785 None admin] REQUEST_METHOD: `GET` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:24:27.971545 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ba71f4-609e-47b8-acf2-b06988b9d785 None admin] SCRIPT_NAME: `/identity` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:24:27.971806 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ba71f4-609e-47b8-acf2-b06988b9d785 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:24:27.982774 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ba71f4-609e-47b8-acf2-b06988b9d785 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:24:27.984262 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ba71f4-609e-47b8-acf2-b06988b9d785 None admin] RBAC: Authorization granted {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:24:27.999290 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application [None req-90ba71f4-609e-47b8-acf2-b06988b9d785 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 08:24:27.999290 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:24:27.999290 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:24:27.999290 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:24:27.999290 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:24:27.999290 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:24:27.999290 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:24:27.999290 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:24:27.999290 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:24:27.999290 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:24:27.999290 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:24:27.999290 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:24:27.999290 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 08:24:27.999290 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 08:24:27.999290 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 08:24:28.000304 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 08:24:28.000304 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:24:28.000304 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:24:28.000304 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:24:28.000304 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:24:28.000304 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:24:28.000304 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:24:28.000304 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:24:28.000304 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application with Lock( Jul 28 08:24:28.000304 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:24:28.000304 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:24:28.000304 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:24:28.000304 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:24:28.000304 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:24:28.000304 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:24:28.000304 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:24:28.000304 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:24:28.001285 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 08:24:28.001285 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 08:24:28.001285 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 08:24:28.001285 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application Jul 28 08:24:28.001285 dv-cinder-851351-1-smb devstack@keystone.service[207600]: [pid: 207600|app: 0|req: 286/569] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 08:24:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:24:28.001580 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ba71f4-609e-47b8-acf2-b06988b9d785 None admin] Authenticating user token {{(pid=207600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:24:28.031407 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc62dc7-8c5c-4f41-8cf0-e48306a0b2c0 None admin] Validating token access rules against request {{(pid=207601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:24:28.066320 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c9e1fc4-cbe8-4876-afff-fa156960b096 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:24:28.066984 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9e1fc4-cbe8-4876-afff-fa156960b096 None admin] REQUEST_METHOD: `GET` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:24:28.067269 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9e1fc4-cbe8-4876-afff-fa156960b096 None admin] SCRIPT_NAME: `/identity` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:24:28.067547 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9e1fc4-cbe8-4876-afff-fa156960b096 None admin] PATH_INFO: `/v3/roles/service` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:24:28.077957 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c9e1fc4-cbe8-4876-afff-fa156960b096 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 08:24:28.083530 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application [None req-8c9e1fc4-cbe8-4876-afff-fa156960b096 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 28 08:24:28.083530 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:24:28.083530 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:24:28.083530 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:24:28.083530 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:24:28.083530 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:24:28.083530 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:24:28.083530 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:24:28.083530 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:24:28.083530 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:24:28.083530 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:24:28.083530 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:24:28.083530 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 08:24:28.083530 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 08:24:28.083530 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 08:24:28.083530 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 08:24:28.084584 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 08:24:28.084584 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 08:24:28.084584 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 08:24:28.084584 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 08:24:28.084584 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:24:28.084584 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:24:28.084584 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:24:28.084584 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:24:28.084584 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:24:28.084584 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:24:28.084584 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:24:28.084584 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application with Lock( Jul 28 08:24:28.084584 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:24:28.084584 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:24:28.084584 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:24:28.084584 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:24:28.085556 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:24:28.085556 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:24:28.085556 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:24:28.085556 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:24:28.085556 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 08:24:28.085556 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 08:24:28.085556 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 08:24:28.085556 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 08:24:28.085556 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 08:24:28.085556 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 08:24:28.085556 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 28 08:24:28.085556 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application Jul 28 08:24:28.085556 dv-cinder-851351-1-smb devstack@keystone.service[207601]: [pid: 207601|app: 0|req: 284/570] 10.222.0.42 () {56 vars in 1102 bytes} [Thu Jul 28 08:24:27 2022] GET /identity/v3/roles/service => generated 85 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:24:28.086675 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d213299f-b89d-4de2-b85a-e2d6d2c8eb36 None None] REQUEST_METHOD: `GET` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:24:28.086675 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d213299f-b89d-4de2-b85a-e2d6d2c8eb36 None None] SCRIPT_NAME: `/identity` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:24:28.086967 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d213299f-b89d-4de2-b85a-e2d6d2c8eb36 None None] PATH_INFO: `/` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:24:28.088808 dv-cinder-851351-1-smb devstack@keystone.service[207601]: [pid: 207601|app: 0|req: 285/571] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 08:24:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 08:24:28.089420 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d213299f-b89d-4de2-b85a-e2d6d2c8eb36 None None] Authenticating user token {{(pid=207601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:24:28.091857 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG dbcounter [-] [207600] Writing DB stats keystone:SELECT=100 {{(pid=207600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:24:28.111835 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ba71f4-609e-47b8-acf2-b06988b9d785 None admin] Validating token access rules against request {{(pid=207600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:24:28.117578 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG dbcounter [-] [207601] Writing DB stats keystone:SELECT=100 {{(pid=207601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:24:28.145714 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a33dba49-8460-4167-8dc7-2e80dd480f75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:24:28.146379 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33dba49-8460-4167-8dc7-2e80dd480f75 None admin] REQUEST_METHOD: `GET` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:24:28.146666 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33dba49-8460-4167-8dc7-2e80dd480f75 None admin] SCRIPT_NAME: `/identity` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:24:28.146955 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33dba49-8460-4167-8dc7-2e80dd480f75 None admin] PATH_INFO: `/v3/projects/service` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:24:28.153950 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a33dba49-8460-4167-8dc7-2e80dd480f75 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:24:28.155427 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a33dba49-8460-4167-8dc7-2e80dd480f75 None admin] RBAC: Authorization granted {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:24:28.166916 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application [None req-a33dba49-8460-4167-8dc7-2e80dd480f75 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 08:24:28.166916 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:24:28.166916 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:24:28.166916 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:24:28.166916 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:24:28.166916 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:24:28.166916 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:24:28.166916 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:24:28.166916 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:24:28.166916 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:24:28.166916 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:24:28.166916 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:24:28.166916 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 28 08:24:28.166916 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 28 08:24:28.166916 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 28 08:24:28.168028 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 28 08:24:28.168028 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:24:28.168028 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:24:28.168028 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:24:28.168028 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:24:28.168028 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:24:28.168028 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:24:28.168028 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:24:28.168028 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application with Lock( Jul 28 08:24:28.168028 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:24:28.168028 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:24:28.168028 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:24:28.168028 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:24:28.168028 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:24:28.168028 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:24:28.168028 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:24:28.168028 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:24:28.169393 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 28 08:24:28.169393 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 28 08:24:28.169393 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 28 08:24:28.169393 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 28 08:24:28.169393 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 28 08:24:28.169393 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 28 08:24:28.169393 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 08:24:28.169393 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application Jul 28 08:24:28.169393 dv-cinder-851351-1-smb devstack@keystone.service[207600]: [pid: 207600|app: 0|req: 287/572] 10.222.0.42 () {56 vars in 1111 bytes} [Thu Jul 28 08:24:28 2022] GET /identity/v3/projects/service => generated 88 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:24:28.169393 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a33dba49-8460-4167-8dc7-2e80dd480f75 None admin] Authenticating user token {{(pid=207600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:24:28.193940 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d213299f-b89d-4de2-b85a-e2d6d2c8eb36 None None] Validating token access rules against request {{(pid=207601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:24:28.229171 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa37d801-2a3d-4a5a-9b0a-d4d5cf72e12f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:24:28.229826 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa37d801-2a3d-4a5a-9b0a-d4d5cf72e12f None admin] REQUEST_METHOD: `GET` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:24:28.230105 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa37d801-2a3d-4a5a-9b0a-d4d5cf72e12f None admin] SCRIPT_NAME: `/identity` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:24:28.230399 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa37d801-2a3d-4a5a-9b0a-d4d5cf72e12f None admin] PATH_INFO: `/v3/projects/service` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:24:28.237519 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa37d801-2a3d-4a5a-9b0a-d4d5cf72e12f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:24:28.238999 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa37d801-2a3d-4a5a-9b0a-d4d5cf72e12f None admin] RBAC: Authorization granted {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:24:28.251681 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application [None req-aa37d801-2a3d-4a5a-9b0a-d4d5cf72e12f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 08:24:28.251681 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:24:28.251681 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:24:28.251681 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:24:28.251681 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:24:28.251681 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:24:28.251681 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:24:28.251681 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:24:28.251681 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:24:28.251681 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:24:28.251681 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:24:28.251681 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:24:28.251681 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 28 08:24:28.251681 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 28 08:24:28.251681 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 28 08:24:28.252876 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 28 08:24:28.252876 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:24:28.252876 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:24:28.252876 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:24:28.252876 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:24:28.252876 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:24:28.252876 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:24:28.252876 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:24:28.252876 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application with Lock( Jul 28 08:24:28.252876 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:24:28.252876 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:24:28.252876 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:24:28.252876 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:24:28.252876 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:24:28.252876 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:24:28.252876 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:24:28.252876 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:24:28.254039 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 28 08:24:28.254039 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 28 08:24:28.254039 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 28 08:24:28.254039 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 28 08:24:28.254039 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 28 08:24:28.254039 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 28 08:24:28.254039 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 08:24:28.254039 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application Jul 28 08:24:28.254039 dv-cinder-851351-1-smb devstack@keystone.service[207601]: [pid: 207601|app: 0|req: 286/573] 10.222.0.42 () {56 vars in 1111 bytes} [Thu Jul 28 08:24:28 2022] GET /identity/v3/projects/service => generated 88 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:24:28.254039 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa37d801-2a3d-4a5a-9b0a-d4d5cf72e12f None admin] Authenticating user token {{(pid=207601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:24:28.274549 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a33dba49-8460-4167-8dc7-2e80dd480f75 None admin] Validating token access rules against request {{(pid=207600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:24:28.306975 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc3fac2-4df6-4f15-a7e6-13732e164623 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:24:28.307643 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc3fac2-4df6-4f15-a7e6-13732e164623 None admin] REQUEST_METHOD: `GET` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:24:28.307926 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc3fac2-4df6-4f15-a7e6-13732e164623 None admin] SCRIPT_NAME: `/identity` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:24:28.308204 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc3fac2-4df6-4f15-a7e6-13732e164623 None admin] PATH_INFO: `/v3/domains` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:24:28.308934 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc3fac2-4df6-4f15-a7e6-13732e164623 None admin] RBAC: Adding query filter params (name=Default) {{(pid=207600) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:24:28.309240 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc3fac2-4df6-4f15-a7e6-13732e164623 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:24:28.310684 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc3fac2-4df6-4f15-a7e6-13732e164623 None admin] RBAC: Authorization granted {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:24:28.322104 dv-cinder-851351-1-smb devstack@keystone.service[207600]: [pid: 207600|app: 0|req: 288/574] 10.222.0.42 () {56 vars in 1109 bytes} [Thu Jul 28 08:24:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:24:28.323389 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f981e16-b4db-4df2-98a6-cbbd754e8fce None None] REQUEST_METHOD: `POST` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:24:28.323678 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f981e16-b4db-4df2-98a6-cbbd754e8fce None None] SCRIPT_NAME: `/identity` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:24:28.323953 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f981e16-b4db-4df2-98a6-cbbd754e8fce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:24:28.330243 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG dbcounter [-] [207600] Writing DB stats keystone:SELECT=100 {{(pid=207600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:24:28.345313 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG dbcounter [-] [207601] Writing DB stats keystone:SELECT=100 {{(pid=207601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:24:28.345949 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.auth.core [None req-4f981e16-b4db-4df2-98a6-cbbd754e8fce None None] MFA Rules not processed for user `b8110ade874c4aa7af27f5c376df700a`. Rule list: `[]` (Enabled: `True`). {{(pid=207600) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 08:24:28.346887 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.fernet_utils [None req-4f981e16-b4db-4df2-98a6-cbbd754e8fce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=207600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:24:28.358754 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa37d801-2a3d-4a5a-9b0a-d4d5cf72e12f None admin] Validating token access rules against request {{(pid=207601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:24:28.392528 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802551ac-f95b-4f2b-a2c7-d699d892973e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:24:28.393107 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802551ac-f95b-4f2b-a2c7-d699d892973e None admin] REQUEST_METHOD: `GET` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:24:28.393391 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802551ac-f95b-4f2b-a2c7-d699d892973e None admin] SCRIPT_NAME: `/identity` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:24:28.393664 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802551ac-f95b-4f2b-a2c7-d699d892973e None admin] PATH_INFO: `/v3/roles` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:24:28.394396 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-802551ac-f95b-4f2b-a2c7-d699d892973e None admin] RBAC: Adding query filter params (name=service) {{(pid=207601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:24:28.394700 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-802551ac-f95b-4f2b-a2c7-d699d892973e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:24:28.396072 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-802551ac-f95b-4f2b-a2c7-d699d892973e None admin] RBAC: Authorization granted {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:24:28.404403 dv-cinder-851351-1-smb devstack@keystone.service[207601]: [pid: 207601|app: 0|req: 287/575] 10.222.0.42 () {56 vars in 1103 bytes} [Thu Jul 28 08:24:28 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:24:28.405242 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802551ac-f95b-4f2b-a2c7-d699d892973e None admin] Authenticating user token {{(pid=207601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:24:28.416777 dv-cinder-851351-1-smb devstack@keystone.service[207600]: [pid: 207600|app: 0|req: 289/576] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 08:24:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 08:24:28.417650 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f981e16-b4db-4df2-98a6-cbbd754e8fce None None] Authenticating user token {{(pid=207600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:24:28.513509 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802551ac-f95b-4f2b-a2c7-d699d892973e None admin] Validating token access rules against request {{(pid=207601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:24:28.515558 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f981e16-b4db-4df2-98a6-cbbd754e8fce None None] Validating token access rules against request {{(pid=207600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:24:28.544377 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG dbcounter [-] [207600] Writing DB stats keystone:SELECT=100 {{(pid=207600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:24:28.546856 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c45a610c-90ae-4da9-93e6-235cc509fd2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:24:28.547495 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45a610c-90ae-4da9-93e6-235cc509fd2d None admin] REQUEST_METHOD: `GET` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:24:28.547779 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45a610c-90ae-4da9-93e6-235cc509fd2d None admin] SCRIPT_NAME: `/identity` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:24:28.548053 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45a610c-90ae-4da9-93e6-235cc509fd2d None admin] PATH_INFO: `/v3/projects` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:24:28.548851 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c45a610c-90ae-4da9-93e6-235cc509fd2d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=207601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:24:28.549170 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c45a610c-90ae-4da9-93e6-235cc509fd2d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:24:28.549791 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664840ef-0f70-4c8c-a73f-66cdd376455a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:24:28.550435 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664840ef-0f70-4c8c-a73f-66cdd376455a None admin] REQUEST_METHOD: `GET` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:24:28.550599 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c45a610c-90ae-4da9-93e6-235cc509fd2d None admin] RBAC: Authorization granted {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:24:28.550719 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664840ef-0f70-4c8c-a73f-66cdd376455a None admin] SCRIPT_NAME: `/identity` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:24:28.550984 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664840ef-0f70-4c8c-a73f-66cdd376455a None admin] PATH_INFO: `/v3/projects` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:24:28.551753 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-664840ef-0f70-4c8c-a73f-66cdd376455a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=207600) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:24:28.552066 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-664840ef-0f70-4c8c-a73f-66cdd376455a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:24:28.553537 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-664840ef-0f70-4c8c-a73f-66cdd376455a None admin] RBAC: Authorization granted {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:24:28.562842 dv-cinder-851351-1-smb devstack@keystone.service[207601]: [pid: 207601|app: 0|req: 288/577] 10.222.0.42 () {56 vars in 1148 bytes} [Thu Jul 28 08:24:28 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:24:28.563688 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c45a610c-90ae-4da9-93e6-235cc509fd2d None admin] Authenticating user token {{(pid=207601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:24:28.570300 dv-cinder-851351-1-smb devstack@keystone.service[207600]: [pid: 207600|app: 0|req: 290/578] 10.222.0.42 () {56 vars in 1148 bytes} [Thu Jul 28 08:24:28 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:24:28.571162 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664840ef-0f70-4c8c-a73f-66cdd376455a None admin] Authenticating user token {{(pid=207600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:24:28.575695 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG dbcounter [-] [207601] Writing DB stats keystone:SELECT=100 {{(pid=207601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:24:28.667159 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c45a610c-90ae-4da9-93e6-235cc509fd2d None admin] Validating token access rules against request {{(pid=207601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:24:28.675612 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664840ef-0f70-4c8c-a73f-66cdd376455a None admin] Validating token access rules against request {{(pid=207600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:24:28.703260 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de25d07c-9683-4902-8bd1-af67acf339b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:24:28.703923 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de25d07c-9683-4902-8bd1-af67acf339b9 None admin] REQUEST_METHOD: `GET` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:24:28.704206 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de25d07c-9683-4902-8bd1-af67acf339b9 None admin] SCRIPT_NAME: `/identity` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:24:28.704480 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de25d07c-9683-4902-8bd1-af67acf339b9 None admin] PATH_INFO: `/v3/users/glance` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:24:28.711237 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-367764ed-6d0b-4b55-b467-18b7f78a5dfa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:24:28.711899 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367764ed-6d0b-4b55-b467-18b7f78a5dfa None admin] REQUEST_METHOD: `GET` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:24:28.712184 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367764ed-6d0b-4b55-b467-18b7f78a5dfa None admin] SCRIPT_NAME: `/identity` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:24:28.712282 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de25d07c-9683-4902-8bd1-af67acf339b9 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:24:28.712444 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367764ed-6d0b-4b55-b467-18b7f78a5dfa None admin] PATH_INFO: `/v3/domains/Default` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:24:28.714119 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de25d07c-9683-4902-8bd1-af67acf339b9 None admin] RBAC: Authorization granted {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:24:28.724049 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-367764ed-6d0b-4b55-b467-18b7f78a5dfa None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:24:28.725550 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-367764ed-6d0b-4b55-b467-18b7f78a5dfa None admin] RBAC: Authorization granted {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:24:28.727163 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application [None req-de25d07c-9683-4902-8bd1-af67acf339b9 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jul 28 08:24:28.727163 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:24:28.727163 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:24:28.727163 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:24:28.727163 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:24:28.727163 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:24:28.727163 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:24:28.727163 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:24:28.727163 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:24:28.727163 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:24:28.727163 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:24:28.727163 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:24:28.727163 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 28 08:24:28.727163 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 28 08:24:28.727163 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 28 08:24:28.727163 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 28 08:24:28.728331 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:24:28.728331 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:24:28.728331 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 28 08:24:28.728331 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 08:24:28.728331 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 28 08:24:28.728331 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 08:24:28.728331 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:24:28.728331 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:24:28.728331 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:24:28.728331 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:24:28.728331 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:24:28.728331 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application with Lock( Jul 28 08:24:28.728331 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:24:28.728331 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:24:28.728331 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:24:28.728331 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:24:28.728331 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:24:28.728331 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:24:28.729703 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:24:28.729703 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:24:28.729703 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 28 08:24:28.729703 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 28 08:24:28.729703 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 28 08:24:28.729703 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 28 08:24:28.729703 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 28 08:24:28.729703 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 28 08:24:28.729703 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jul 28 08:24:28.729703 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application Jul 28 08:24:28.729703 dv-cinder-851351-1-smb devstack@keystone.service[207601]: [pid: 207601|app: 0|req: 289/579] 10.222.0.42 () {56 vars in 1099 bytes} [Thu Jul 28 08:24:28 2022] GET /identity/v3/users/glance => generated 84 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:24:28.729703 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de25d07c-9683-4902-8bd1-af67acf339b9 None admin] Authenticating user token {{(pid=207601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:24:28.744591 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application [None req-367764ed-6d0b-4b55-b467-18b7f78a5dfa None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 08:24:28.744591 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:24:28.744591 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:24:28.744591 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:24:28.744591 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:24:28.744591 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:24:28.744591 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:24:28.744591 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:24:28.744591 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:24:28.744591 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:24:28.744591 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:24:28.744591 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:24:28.744591 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 08:24:28.744591 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 08:24:28.744591 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 08:24:28.746029 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 08:24:28.746029 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:24:28.746029 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:24:28.746029 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:24:28.746029 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:24:28.746029 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:24:28.746029 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:24:28.746029 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:24:28.746029 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application with Lock( Jul 28 08:24:28.746029 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:24:28.746029 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:24:28.746029 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:24:28.746029 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:24:28.746029 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:24:28.746029 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:24:28.746029 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:24:28.746029 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:24:28.747426 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 08:24:28.747426 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 08:24:28.747426 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 08:24:28.747426 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application Jul 28 08:24:28.747426 dv-cinder-851351-1-smb devstack@keystone.service[207600]: [pid: 207600|app: 0|req: 291/580] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 08:24:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:24:28.747426 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-367764ed-6d0b-4b55-b467-18b7f78a5dfa None admin] Authenticating user token {{(pid=207600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:24:28.800637 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG dbcounter [-] [207600] Writing DB stats keystone:SELECT=100 {{(pid=207600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:24:28.805775 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG dbcounter [-] [207601] Writing DB stats keystone:SELECT=100 {{(pid=207601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:24:28.838836 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de25d07c-9683-4902-8bd1-af67acf339b9 None admin] Validating token access rules against request {{(pid=207601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:24:28.856220 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-367764ed-6d0b-4b55-b467-18b7f78a5dfa None admin] Validating token access rules against request {{(pid=207600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:24:28.874911 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f4a5992-07b5-4e03-9744-6adc48614b2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:24:28.875694 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4a5992-07b5-4e03-9744-6adc48614b2e None admin] REQUEST_METHOD: `GET` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:24:28.876042 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4a5992-07b5-4e03-9744-6adc48614b2e None admin] SCRIPT_NAME: `/identity` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:24:28.876387 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4a5992-07b5-4e03-9744-6adc48614b2e None admin] PATH_INFO: `/v3/roles/service` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:24:28.889595 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f4a5992-07b5-4e03-9744-6adc48614b2e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 08:24:28.894504 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b38dc0d-8f67-4696-bc3f-c8ad8bc09f54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:24:28.895128 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application [None req-0f4a5992-07b5-4e03-9744-6adc48614b2e None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 28 08:24:28.895128 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:24:28.895128 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:24:28.895128 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:24:28.895128 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:24:28.895128 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:24:28.895128 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:24:28.895128 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:24:28.895128 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:24:28.895128 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:24:28.895128 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:24:28.895128 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:24:28.895128 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 08:24:28.895128 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 08:24:28.895128 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 08:24:28.895128 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 08:24:28.896175 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 08:24:28.896175 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 08:24:28.896175 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 08:24:28.896175 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 08:24:28.896175 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:24:28.896175 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:24:28.896175 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:24:28.896175 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:24:28.896175 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:24:28.896175 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:24:28.896175 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:24:28.896175 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application with Lock( Jul 28 08:24:28.896175 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:24:28.896175 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:24:28.896175 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:24:28.896175 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:24:28.897631 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:24:28.897631 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:24:28.897631 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:24:28.897631 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:24:28.897631 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 08:24:28.897631 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 08:24:28.897631 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 08:24:28.897631 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 08:24:28.897631 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 08:24:28.897631 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 08:24:28.897631 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 28 08:24:28.897631 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application Jul 28 08:24:28.898291 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b38dc0d-8f67-4696-bc3f-c8ad8bc09f54 None admin] REQUEST_METHOD: `PUT` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:24:28.898291 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b38dc0d-8f67-4696-bc3f-c8ad8bc09f54 None admin] SCRIPT_NAME: `/identity` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:24:28.898291 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b38dc0d-8f67-4696-bc3f-c8ad8bc09f54 None admin] PATH_INFO: `/v3/projects/48c5f2b2ae2b48758b957d2b194a7fd1/users/03804b1369934a7692da4d5646465bdc/roles/b44e7c7aeec24f51b8033df305da133d` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:24:28.898494 dv-cinder-851351-1-smb devstack@keystone.service[207601]: [pid: 207601|app: 0|req: 290/581] 10.222.0.42 () {56 vars in 1102 bytes} [Thu Jul 28 08:24:28 2022] GET /identity/v3/roles/service => generated 85 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:24:28.898494 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f4a5992-07b5-4e03-9744-6adc48614b2e None admin] Authenticating user token {{(pid=207601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:24:28.915250 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b38dc0d-8f67-4696-bc3f-c8ad8bc09f54 None admin] RBAC: Authorizing `identity:create_grant(project_id=48c5f2b2ae2b48758b957d2b194a7fd1, user_id=03804b1369934a7692da4d5646465bdc, role_id=b44e7c7aeec24f51b8033df305da133d)` {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:24:28.916825 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b38dc0d-8f67-4696-bc3f-c8ad8bc09f54 None admin] RBAC: Authorization granted {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:24:28.930947 dv-cinder-851351-1-smb devstack@keystone.service[207600]: [pid: 207600|app: 0|req: 292/582] 10.222.0.42 () {58 vars in 1439 bytes} [Thu Jul 28 08:24:28 2022] PUT /identity/v3/projects/48c5f2b2ae2b48758b957d2b194a7fd1/users/03804b1369934a7692da4d5646465bdc/roles/b44e7c7aeec24f51b8033df305da133d => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 08:24:28.932322 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b38dc0d-8f67-4696-bc3f-c8ad8bc09f54 None admin] Authenticating user token {{(pid=207600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:24:29.041208 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f4a5992-07b5-4e03-9744-6adc48614b2e None admin] Validating token access rules against request {{(pid=207601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:24:29.066333 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG dbcounter [-] [207600] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=207600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:24:29.075890 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG dbcounter [-] [207601] Writing DB stats keystone:SELECT=100 {{(pid=207601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:24:29.077520 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b38dc0d-8f67-4696-bc3f-c8ad8bc09f54 None admin] Validating token access rules against request {{(pid=207600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:24:29.083621 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44362843-590d-4399-9135-ae95e7c46d7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:24:29.084275 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44362843-590d-4399-9135-ae95e7c46d7f None admin] REQUEST_METHOD: `GET` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:24:29.084560 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44362843-590d-4399-9135-ae95e7c46d7f None admin] SCRIPT_NAME: `/identity` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:24:29.085044 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44362843-590d-4399-9135-ae95e7c46d7f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:24:29.085870 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44362843-590d-4399-9135-ae95e7c46d7f None admin] RBAC: Adding query filter params (role.id=b44e7c7aeec24f51b8033df305da133d, scope.project.id=48c5f2b2ae2b48758b957d2b194a7fd1, user.id=96e9a6a7c6ea4047a5d8e16babbdeb70) {{(pid=207601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:24:29.086304 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44362843-590d-4399-9135-ae95e7c46d7f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:24:29.088282 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44362843-590d-4399-9135-ae95e7c46d7f None admin] RBAC: Authorization granted {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:24:29.104704 dv-cinder-851351-1-smb devstack@keystone.service[207601]: [pid: 207601|app: 0|req: 291/583] 10.222.0.42 () {56 vars in 1374 bytes} [Thu Jul 28 08:24:28 2022] GET /identity/v3/role_assignments?user.id=96e9a6a7c6ea4047a5d8e16babbdeb70&scope.project.id=48c5f2b2ae2b48758b957d2b194a7fd1&role.id=b44e7c7aeec24f51b8033df305da133d => generated 259 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:24:29.104704 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44362843-590d-4399-9135-ae95e7c46d7f None admin] Authenticating user token {{(pid=207601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:24:29.137144 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5212d9-0fda-4a89-95af-6ab29888c07f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:24:29.138127 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5212d9-0fda-4a89-95af-6ab29888c07f None admin] REQUEST_METHOD: `GET` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:24:29.138550 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5212d9-0fda-4a89-95af-6ab29888c07f None admin] SCRIPT_NAME: `/identity` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:24:29.138956 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5212d9-0fda-4a89-95af-6ab29888c07f None admin] PATH_INFO: `/v3/users` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:24:29.140322 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af5212d9-0fda-4a89-95af-6ab29888c07f None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=207600) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:24:29.140853 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af5212d9-0fda-4a89-95af-6ab29888c07f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:24:29.143395 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af5212d9-0fda-4a89-95af-6ab29888c07f None admin] RBAC: Authorization granted {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:24:29.178852 dv-cinder-851351-1-smb devstack@keystone.service[207600]: [pid: 207600|app: 0|req: 293/584] 10.222.0.42 () {56 vars in 1137 bytes} [Thu Jul 28 08:24:28 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:24:29.180118 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5212d9-0fda-4a89-95af-6ab29888c07f None admin] Authenticating user token {{(pid=207600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:24:29.265744 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44362843-590d-4399-9135-ae95e7c46d7f None admin] Validating token access rules against request {{(pid=207601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:24:29.307705 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edfc87bb-6e5c-443f-a2fd-e1079fd9fb23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:24:29.308406 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfc87bb-6e5c-443f-a2fd-e1079fd9fb23 None admin] REQUEST_METHOD: `GET` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:24:29.308714 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfc87bb-6e5c-443f-a2fd-e1079fd9fb23 None admin] SCRIPT_NAME: `/identity` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:24:29.308992 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfc87bb-6e5c-443f-a2fd-e1079fd9fb23 None admin] PATH_INFO: `/v3/domains` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:24:29.309765 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edfc87bb-6e5c-443f-a2fd-e1079fd9fb23 None admin] RBAC: Adding query filter params (name=Default) {{(pid=207601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:24:29.310055 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edfc87bb-6e5c-443f-a2fd-e1079fd9fb23 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:24:29.311452 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edfc87bb-6e5c-443f-a2fd-e1079fd9fb23 None admin] RBAC: Authorization granted {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:24:29.326641 dv-cinder-851351-1-smb devstack@keystone.service[207601]: [pid: 207601|app: 0|req: 292/585] 10.222.0.42 () {56 vars in 1109 bytes} [Thu Jul 28 08:24:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:24:29.328971 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edfc87bb-6e5c-443f-a2fd-e1079fd9fb23 None admin] Authenticating user token {{(pid=207601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:24:29.343449 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5212d9-0fda-4a89-95af-6ab29888c07f None admin] Validating token access rules against request {{(pid=207600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:24:29.382605 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ada36f1-ddef-431e-8c29-10d7877b91cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:24:29.383269 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ada36f1-ddef-431e-8c29-10d7877b91cd None admin] REQUEST_METHOD: `GET` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:24:29.383551 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ada36f1-ddef-431e-8c29-10d7877b91cd None admin] SCRIPT_NAME: `/identity` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:24:29.383823 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ada36f1-ddef-431e-8c29-10d7877b91cd None admin] PATH_INFO: `/v3/roles` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:24:29.384561 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ada36f1-ddef-431e-8c29-10d7877b91cd None admin] RBAC: Adding query filter params (name=service) {{(pid=207600) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:24:29.384922 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ada36f1-ddef-431e-8c29-10d7877b91cd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:24:29.386413 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ada36f1-ddef-431e-8c29-10d7877b91cd None admin] RBAC: Authorization granted {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:24:29.396172 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG dbcounter [-] [207601] Writing DB stats keystone:SELECT=100 {{(pid=207601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:24:29.400331 dv-cinder-851351-1-smb devstack@keystone.service[207600]: [pid: 207600|app: 0|req: 294/586] 10.222.0.42 () {56 vars in 1103 bytes} [Thu Jul 28 08:24:29 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:24:29.401489 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ada36f1-ddef-431e-8c29-10d7877b91cd None admin] Authenticating user token {{(pid=207600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:24:29.418981 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG dbcounter [-] [207600] Writing DB stats keystone:SELECT=100 {{(pid=207600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:24:29.449465 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edfc87bb-6e5c-443f-a2fd-e1079fd9fb23 None admin] Validating token access rules against request {{(pid=207601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:24:29.493976 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92ad10b-3da2-4fac-9259-f43ae0ebc75a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:24:29.495103 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92ad10b-3da2-4fac-9259-f43ae0ebc75a None admin] REQUEST_METHOD: `GET` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:24:29.495610 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92ad10b-3da2-4fac-9259-f43ae0ebc75a None admin] SCRIPT_NAME: `/identity` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:24:29.496087 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92ad10b-3da2-4fac-9259-f43ae0ebc75a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:24:29.508093 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b92ad10b-3da2-4fac-9259-f43ae0ebc75a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:24:29.509915 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b92ad10b-3da2-4fac-9259-f43ae0ebc75a None admin] RBAC: Authorization granted {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:24:29.516621 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ada36f1-ddef-431e-8c29-10d7877b91cd None admin] Validating token access rules against request {{(pid=207600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:24:29.527169 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application [None req-b92ad10b-3da2-4fac-9259-f43ae0ebc75a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 08:24:29.527169 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:24:29.527169 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:24:29.527169 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:24:29.527169 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:24:29.527169 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:24:29.527169 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:24:29.527169 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:24:29.527169 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:24:29.527169 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:24:29.527169 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:24:29.527169 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:24:29.527169 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 08:24:29.527169 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 08:24:29.527169 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 08:24:29.528197 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 08:24:29.528197 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:24:29.528197 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:24:29.528197 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:24:29.528197 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:24:29.528197 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:24:29.528197 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:24:29.528197 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:24:29.528197 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application with Lock( Jul 28 08:24:29.528197 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:24:29.528197 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:24:29.528197 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:24:29.528197 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:24:29.528197 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:24:29.528197 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:24:29.528197 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:24:29.528197 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:24:29.529302 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 08:24:29.529302 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 08:24:29.529302 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 08:24:29.529302 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application Jul 28 08:24:29.531654 dv-cinder-851351-1-smb devstack@keystone.service[207601]: [pid: 207601|app: 0|req: 293/587] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 08:24:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:24:29.532730 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92ad10b-3da2-4fac-9259-f43ae0ebc75a None admin] Authenticating user token {{(pid=207601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:24:29.558170 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74aeeb8c-d1b9-4235-85c5-6e79c5a6505a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:24:29.558937 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74aeeb8c-d1b9-4235-85c5-6e79c5a6505a None admin] REQUEST_METHOD: `GET` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:24:29.559299 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74aeeb8c-d1b9-4235-85c5-6e79c5a6505a None admin] SCRIPT_NAME: `/identity` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:24:29.559625 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74aeeb8c-d1b9-4235-85c5-6e79c5a6505a None admin] PATH_INFO: `/v3/users/cinder` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:24:29.567899 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74aeeb8c-d1b9-4235-85c5-6e79c5a6505a None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:24:29.569537 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74aeeb8c-d1b9-4235-85c5-6e79c5a6505a None admin] RBAC: Authorization granted {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:24:29.584645 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application [None req-74aeeb8c-d1b9-4235-85c5-6e79c5a6505a None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jul 28 08:24:29.584645 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:24:29.584645 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:24:29.584645 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:24:29.584645 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:24:29.584645 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:24:29.584645 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:24:29.584645 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:24:29.584645 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:24:29.584645 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:24:29.584645 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:24:29.584645 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:24:29.584645 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 28 08:24:29.584645 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 28 08:24:29.584645 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 28 08:24:29.584645 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 28 08:24:29.585763 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:24:29.585763 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:24:29.585763 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 28 08:24:29.585763 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 08:24:29.585763 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 28 08:24:29.585763 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 08:24:29.585763 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:24:29.585763 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:24:29.585763 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:24:29.585763 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:24:29.585763 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:24:29.585763 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application with Lock( Jul 28 08:24:29.585763 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:24:29.585763 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:24:29.585763 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:24:29.585763 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:24:29.585763 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:24:29.585763 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:24:29.586785 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:24:29.586785 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:24:29.586785 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 28 08:24:29.586785 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 28 08:24:29.586785 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 28 08:24:29.586785 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 28 08:24:29.586785 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 28 08:24:29.586785 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 28 08:24:29.586785 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jul 28 08:24:29.586785 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application Jul 28 08:24:29.591299 dv-cinder-851351-1-smb devstack@keystone.service[207600]: [pid: 207600|app: 0|req: 295/588] 10.222.0.42 () {56 vars in 1099 bytes} [Thu Jul 28 08:24:29 2022] GET /identity/v3/users/cinder => generated 84 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:24:29.592345 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74aeeb8c-d1b9-4235-85c5-6e79c5a6505a None admin] Authenticating user token {{(pid=207600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:24:29.647642 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92ad10b-3da2-4fac-9259-f43ae0ebc75a None admin] Validating token access rules against request {{(pid=207601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:24:29.655897 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG dbcounter [-] [207601] Writing DB stats keystone:SELECT=100 {{(pid=207601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:24:29.672465 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG dbcounter [-] [207600] Writing DB stats keystone:SELECT=100 {{(pid=207600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:24:29.686495 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33fed9d2-1d79-44b2-94ce-b6f9dd9c3a4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:24:29.687474 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33fed9d2-1d79-44b2-94ce-b6f9dd9c3a4f None admin] REQUEST_METHOD: `GET` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:24:29.688123 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33fed9d2-1d79-44b2-94ce-b6f9dd9c3a4f None admin] SCRIPT_NAME: `/identity` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:24:29.688744 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33fed9d2-1d79-44b2-94ce-b6f9dd9c3a4f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:24:29.700902 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33fed9d2-1d79-44b2-94ce-b6f9dd9c3a4f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:24:29.701952 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74aeeb8c-d1b9-4235-85c5-6e79c5a6505a None admin] Validating token access rules against request {{(pid=207600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:24:29.702915 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33fed9d2-1d79-44b2-94ce-b6f9dd9c3a4f None admin] RBAC: Authorization granted {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:24:29.719210 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application [None req-33fed9d2-1d79-44b2-94ce-b6f9dd9c3a4f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 08:24:29.719210 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:24:29.719210 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:24:29.719210 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:24:29.719210 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:24:29.719210 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:24:29.719210 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:24:29.719210 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:24:29.719210 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:24:29.719210 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:24:29.719210 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:24:29.719210 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:24:29.719210 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 08:24:29.719210 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 08:24:29.719210 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 08:24:29.720219 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 08:24:29.720219 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:24:29.720219 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:24:29.720219 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:24:29.720219 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:24:29.720219 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:24:29.720219 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:24:29.720219 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:24:29.720219 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application with Lock( Jul 28 08:24:29.720219 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:24:29.720219 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:24:29.720219 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:24:29.720219 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:24:29.720219 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:24:29.720219 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:24:29.720219 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:24:29.720219 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:24:29.721239 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 08:24:29.721239 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 08:24:29.721239 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 08:24:29.721239 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application Jul 28 08:24:29.722816 dv-cinder-851351-1-smb devstack@keystone.service[207601]: [pid: 207601|app: 0|req: 294/589] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 08:24:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:24:29.723752 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33fed9d2-1d79-44b2-94ce-b6f9dd9c3a4f None admin] Authenticating user token {{(pid=207601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:24:29.743811 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a100ec-2592-4195-a4dc-1a7c9925d197 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:24:29.744718 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a100ec-2592-4195-a4dc-1a7c9925d197 None admin] REQUEST_METHOD: `GET` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:24:29.744844 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a100ec-2592-4195-a4dc-1a7c9925d197 None admin] SCRIPT_NAME: `/identity` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:24:29.745147 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a100ec-2592-4195-a4dc-1a7c9925d197 None admin] PATH_INFO: `/v3/domains` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:24:29.745860 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8a100ec-2592-4195-a4dc-1a7c9925d197 None admin] RBAC: Adding query filter params (name=Default) {{(pid=207600) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:24:29.746246 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8a100ec-2592-4195-a4dc-1a7c9925d197 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:24:29.747726 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8a100ec-2592-4195-a4dc-1a7c9925d197 None admin] RBAC: Authorization granted {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:24:29.766425 dv-cinder-851351-1-smb devstack@keystone.service[207600]: [pid: 207600|app: 0|req: 296/590] 10.222.0.42 () {56 vars in 1109 bytes} [Thu Jul 28 08:24:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:24:29.767460 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a100ec-2592-4195-a4dc-1a7c9925d197 None admin] Authenticating user token {{(pid=207600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:24:29.834520 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33fed9d2-1d79-44b2-94ce-b6f9dd9c3a4f None admin] Validating token access rules against request {{(pid=207601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:24:29.874074 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a100ec-2592-4195-a4dc-1a7c9925d197 None admin] Validating token access rules against request {{(pid=207600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:24:29.874976 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842c96e1-5b41-430c-ac5b-fa910c91b395 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:24:29.875821 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842c96e1-5b41-430c-ac5b-fa910c91b395 None admin] REQUEST_METHOD: `GET` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:24:29.876266 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842c96e1-5b41-430c-ac5b-fa910c91b395 None admin] SCRIPT_NAME: `/identity` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:24:29.876729 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842c96e1-5b41-430c-ac5b-fa910c91b395 None admin] PATH_INFO: `/v3/users` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:24:29.877699 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-842c96e1-5b41-430c-ac5b-fa910c91b395 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=207601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:24:29.878208 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-842c96e1-5b41-430c-ac5b-fa910c91b395 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:24:29.879854 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-842c96e1-5b41-430c-ac5b-fa910c91b395 None admin] RBAC: Authorization granted {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:24:29.905461 dv-cinder-851351-1-smb devstack@keystone.service[207601]: [pid: 207601|app: 0|req: 295/591] 10.222.0.42 () {56 vars in 1137 bytes} [Thu Jul 28 08:24:29 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:24:29.906692 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842c96e1-5b41-430c-ac5b-fa910c91b395 None admin] Authenticating user token {{(pid=207601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:24:29.911094 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff64446-ef21-46fe-bb89-7f7d17be7524 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:24:29.912389 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff64446-ef21-46fe-bb89-7f7d17be7524 None admin] REQUEST_METHOD: `GET` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:24:29.912389 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff64446-ef21-46fe-bb89-7f7d17be7524 None admin] SCRIPT_NAME: `/identity` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:24:29.912389 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff64446-ef21-46fe-bb89-7f7d17be7524 None admin] PATH_INFO: `/v3/domains` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:24:29.912990 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff64446-ef21-46fe-bb89-7f7d17be7524 None admin] RBAC: Adding query filter params (name=Default) {{(pid=207600) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:24:29.913350 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff64446-ef21-46fe-bb89-7f7d17be7524 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:24:29.914799 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff64446-ef21-46fe-bb89-7f7d17be7524 None admin] RBAC: Authorization granted {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:24:29.916338 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG dbcounter [-] [207600] Writing DB stats keystone:SELECT=100 {{(pid=207600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:24:29.928174 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG dbcounter [-] [207601] Writing DB stats keystone:SELECT=100 {{(pid=207601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:24:29.932997 dv-cinder-851351-1-smb devstack@keystone.service[207600]: [pid: 207600|app: 0|req: 297/592] 10.222.0.42 () {56 vars in 1109 bytes} [Thu Jul 28 08:24:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:24:29.933984 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff64446-ef21-46fe-bb89-7f7d17be7524 None admin] Authenticating user token {{(pid=207600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:24:30.015558 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842c96e1-5b41-430c-ac5b-fa910c91b395 None admin] Validating token access rules against request {{(pid=207601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:24:30.039572 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff64446-ef21-46fe-bb89-7f7d17be7524 None admin] Validating token access rules against request {{(pid=207600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:24:30.050992 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6f8b81-73a2-44df-9625-01ac96a0bb35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:24:30.051928 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6f8b81-73a2-44df-9625-01ac96a0bb35 None admin] REQUEST_METHOD: `GET` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:24:30.052422 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6f8b81-73a2-44df-9625-01ac96a0bb35 None admin] SCRIPT_NAME: `/identity` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:24:30.052939 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6f8b81-73a2-44df-9625-01ac96a0bb35 None admin] PATH_INFO: `/v3/projects/service` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:24:30.060226 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce6f8b81-73a2-44df-9625-01ac96a0bb35 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:24:30.062046 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce6f8b81-73a2-44df-9625-01ac96a0bb35 None admin] RBAC: Authorization granted {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:24:30.074387 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application [None req-ce6f8b81-73a2-44df-9625-01ac96a0bb35 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 08:24:30.074387 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:24:30.074387 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:24:30.074387 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:24:30.074387 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:24:30.074387 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:24:30.074387 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:24:30.074387 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:24:30.074387 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:24:30.074387 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:24:30.074387 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:24:30.074387 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:24:30.074387 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 28 08:24:30.074387 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 28 08:24:30.074387 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 28 08:24:30.075528 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 28 08:24:30.075528 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:24:30.075528 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:24:30.075528 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:24:30.075528 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:24:30.075528 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:24:30.075528 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:24:30.075528 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:24:30.075528 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application with Lock( Jul 28 08:24:30.075528 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:24:30.075528 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:24:30.075528 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:24:30.075528 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:24:30.075528 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:24:30.075528 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:24:30.075528 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:24:30.075528 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:24:30.076635 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 28 08:24:30.076635 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 28 08:24:30.076635 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 28 08:24:30.076635 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 28 08:24:30.076635 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 28 08:24:30.076635 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 28 08:24:30.076635 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 08:24:30.076635 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application Jul 28 08:24:30.077125 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8d8ef2-38ba-4952-98b8-c9e731ae5a4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:24:30.077125 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8d8ef2-38ba-4952-98b8-c9e731ae5a4c None admin] REQUEST_METHOD: `GET` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:24:30.077125 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8d8ef2-38ba-4952-98b8-c9e731ae5a4c None admin] SCRIPT_NAME: `/identity` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:24:30.077125 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8d8ef2-38ba-4952-98b8-c9e731ae5a4c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:24:30.079790 dv-cinder-851351-1-smb devstack@keystone.service[207601]: [pid: 207601|app: 0|req: 296/593] 10.222.0.42 () {56 vars in 1111 bytes} [Thu Jul 28 08:24:29 2022] GET /identity/v3/projects/service => generated 88 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:24:30.080834 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6f8b81-73a2-44df-9625-01ac96a0bb35 None admin] Authenticating user token {{(pid=207601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:24:30.093783 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e8d8ef2-38ba-4952-98b8-c9e731ae5a4c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:24:30.096448 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e8d8ef2-38ba-4952-98b8-c9e731ae5a4c None admin] RBAC: Authorization granted {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:24:30.111549 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application [None req-8e8d8ef2-38ba-4952-98b8-c9e731ae5a4c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 08:24:30.111549 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:24:30.111549 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:24:30.111549 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:24:30.111549 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:24:30.111549 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:24:30.111549 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:24:30.111549 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:24:30.111549 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:24:30.111549 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:24:30.111549 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:24:30.111549 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:24:30.111549 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 08:24:30.111549 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 08:24:30.111549 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 08:24:30.112604 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 08:24:30.112604 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:24:30.112604 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:24:30.112604 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:24:30.112604 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:24:30.112604 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:24:30.112604 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:24:30.112604 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:24:30.112604 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application with Lock( Jul 28 08:24:30.112604 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:24:30.112604 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:24:30.112604 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:24:30.112604 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:24:30.112604 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:24:30.112604 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:24:30.112604 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:24:30.112604 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:24:30.113923 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 08:24:30.113923 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 08:24:30.113923 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 08:24:30.113923 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application Jul 28 08:24:30.117734 dv-cinder-851351-1-smb devstack@keystone.service[207600]: [pid: 207600|app: 0|req: 298/594] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 08:24:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:24:30.118651 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8d8ef2-38ba-4952-98b8-c9e731ae5a4c None admin] Authenticating user token {{(pid=207600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:24:30.178539 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG dbcounter [-] [207601] Writing DB stats keystone:SELECT=100 {{(pid=207601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:24:30.185347 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG dbcounter [-] [207600] Writing DB stats keystone:SELECT=100 {{(pid=207600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:24:30.209029 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6f8b81-73a2-44df-9625-01ac96a0bb35 None admin] Validating token access rules against request {{(pid=207601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:24:30.232897 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8d8ef2-38ba-4952-98b8-c9e731ae5a4c None admin] Validating token access rules against request {{(pid=207600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:24:30.251210 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714e21d9-1d8e-4319-9c9b-dec3f1fff88b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:24:30.252252 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714e21d9-1d8e-4319-9c9b-dec3f1fff88b None admin] REQUEST_METHOD: `GET` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:24:30.252717 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714e21d9-1d8e-4319-9c9b-dec3f1fff88b None admin] SCRIPT_NAME: `/identity` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:24:30.253147 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714e21d9-1d8e-4319-9c9b-dec3f1fff88b None admin] PATH_INFO: `/v3/users/neutron` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:24:30.263161 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-714e21d9-1d8e-4319-9c9b-dec3f1fff88b None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:24:30.265063 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-714e21d9-1d8e-4319-9c9b-dec3f1fff88b None admin] RBAC: Authorization granted {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:24:30.270889 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e48d7e8-a048-4f35-970f-b13bd31ea032 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:24:30.271562 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e48d7e8-a048-4f35-970f-b13bd31ea032 None admin] REQUEST_METHOD: `GET` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:24:30.271830 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e48d7e8-a048-4f35-970f-b13bd31ea032 None admin] SCRIPT_NAME: `/identity` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:24:30.272104 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e48d7e8-a048-4f35-970f-b13bd31ea032 None admin] PATH_INFO: `/v3/projects` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:24:30.272913 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e48d7e8-a048-4f35-970f-b13bd31ea032 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=207600) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:24:30.273223 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e48d7e8-a048-4f35-970f-b13bd31ea032 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:24:30.274691 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e48d7e8-a048-4f35-970f-b13bd31ea032 None admin] RBAC: Authorization granted {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:24:30.280801 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application [None req-714e21d9-1d8e-4319-9c9b-dec3f1fff88b None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jul 28 08:24:30.280801 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:24:30.280801 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:24:30.280801 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:24:30.280801 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:24:30.280801 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:24:30.280801 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:24:30.280801 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:24:30.280801 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:24:30.280801 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:24:30.280801 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:24:30.280801 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:24:30.280801 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 28 08:24:30.280801 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 28 08:24:30.280801 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 28 08:24:30.280801 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 28 08:24:30.282025 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:24:30.282025 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:24:30.282025 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 28 08:24:30.282025 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 08:24:30.282025 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 28 08:24:30.282025 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 08:24:30.282025 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:24:30.282025 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:24:30.282025 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:24:30.282025 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:24:30.282025 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:24:30.282025 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application with Lock( Jul 28 08:24:30.282025 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:24:30.282025 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:24:30.282025 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:24:30.282025 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:24:30.282025 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:24:30.282025 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:24:30.283253 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:24:30.283253 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:24:30.283253 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 28 08:24:30.283253 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 28 08:24:30.283253 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 28 08:24:30.283253 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 28 08:24:30.283253 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 28 08:24:30.283253 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 28 08:24:30.283253 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jul 28 08:24:30.283253 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application Jul 28 08:24:30.285388 dv-cinder-851351-1-smb devstack@keystone.service[207601]: [pid: 207601|app: 0|req: 297/595] 10.222.0.42 () {56 vars in 1102 bytes} [Thu Jul 28 08:24:30 2022] GET /identity/v3/users/neutron => generated 85 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:24:30.286358 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714e21d9-1d8e-4319-9c9b-dec3f1fff88b None admin] Authenticating user token {{(pid=207601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:24:30.295319 dv-cinder-851351-1-smb devstack@keystone.service[207600]: [pid: 207600|app: 0|req: 299/596] 10.222.0.42 () {56 vars in 1148 bytes} [Thu Jul 28 08:24:30 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:24:30.296191 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e48d7e8-a048-4f35-970f-b13bd31ea032 None admin] Authenticating user token {{(pid=207600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:24:30.400629 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714e21d9-1d8e-4319-9c9b-dec3f1fff88b None admin] Validating token access rules against request {{(pid=207601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:24:30.408984 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e48d7e8-a048-4f35-970f-b13bd31ea032 None admin] Validating token access rules against request {{(pid=207600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:24:30.417075 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG dbcounter [-] [207600] Writing DB stats keystone:SELECT=100 {{(pid=207600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:24:30.440114 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1d9cfb-2e80-463f-88ad-6d142456be8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:24:30.441181 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1d9cfb-2e80-463f-88ad-6d142456be8f None admin] REQUEST_METHOD: `GET` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:24:30.441666 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1d9cfb-2e80-463f-88ad-6d142456be8f None admin] SCRIPT_NAME: `/identity` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:24:30.442090 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1d9cfb-2e80-463f-88ad-6d142456be8f None admin] PATH_INFO: `/v3/domains` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:24:30.442944 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d1d9cfb-2e80-463f-88ad-6d142456be8f None admin] RBAC: Adding query filter params (name=Default) {{(pid=207601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:24:30.443522 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d1d9cfb-2e80-463f-88ad-6d142456be8f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:24:30.445090 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d1d9cfb-2e80-463f-88ad-6d142456be8f None admin] RBAC: Authorization granted {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:24:30.446109 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16748a1a-242b-4849-940a-9934d3c2c34a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:24:30.446865 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16748a1a-242b-4849-940a-9934d3c2c34a None admin] REQUEST_METHOD: `GET` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:24:30.447108 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16748a1a-242b-4849-940a-9934d3c2c34a None admin] SCRIPT_NAME: `/identity` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:24:30.447381 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16748a1a-242b-4849-940a-9934d3c2c34a None admin] PATH_INFO: `/v3/users` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:24:30.448371 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG dbcounter [-] [207601] Writing DB stats keystone:SELECT=100 {{(pid=207601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:24:30.448888 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16748a1a-242b-4849-940a-9934d3c2c34a None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=207600) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:24:30.449408 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16748a1a-242b-4849-940a-9934d3c2c34a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:24:30.450671 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16748a1a-242b-4849-940a-9934d3c2c34a None admin] RBAC: Authorization granted {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:24:30.467093 dv-cinder-851351-1-smb devstack@keystone.service[207601]: [pid: 207601|app: 0|req: 298/597] 10.222.0.42 () {56 vars in 1109 bytes} [Thu Jul 28 08:24:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:24:30.468034 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1d9cfb-2e80-463f-88ad-6d142456be8f None admin] Authenticating user token {{(pid=207601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:24:30.480478 dv-cinder-851351-1-smb devstack@keystone.service[207600]: [pid: 207600|app: 0|req: 300/598] 10.222.0.42 () {56 vars in 1139 bytes} [Thu Jul 28 08:24:30 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:24:30.481771 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16748a1a-242b-4849-940a-9934d3c2c34a None admin] Authenticating user token {{(pid=207600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:24:30.571203 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1d9cfb-2e80-463f-88ad-6d142456be8f None admin] Validating token access rules against request {{(pid=207601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:24:30.595406 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16748a1a-242b-4849-940a-9934d3c2c34a None admin] Validating token access rules against request {{(pid=207600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:24:30.609121 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1909bcaf-34ae-4100-b1d9-9f042079543b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:24:30.609814 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1909bcaf-34ae-4100-b1d9-9f042079543b None admin] REQUEST_METHOD: `PUT` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:24:30.610098 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1909bcaf-34ae-4100-b1d9-9f042079543b None admin] SCRIPT_NAME: `/identity` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:24:30.610375 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1909bcaf-34ae-4100-b1d9-9f042079543b None admin] PATH_INFO: `/v3/projects/48c5f2b2ae2b48758b957d2b194a7fd1/users/d085f306b992491d862c5df4567f0083/roles/b44e7c7aeec24f51b8033df305da133d` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:24:30.627077 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1909bcaf-34ae-4100-b1d9-9f042079543b None admin] RBAC: Authorizing `identity:create_grant(project_id=48c5f2b2ae2b48758b957d2b194a7fd1, user_id=d085f306b992491d862c5df4567f0083, role_id=b44e7c7aeec24f51b8033df305da133d)` {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:24:30.628554 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1909bcaf-34ae-4100-b1d9-9f042079543b None admin] RBAC: Authorization granted {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:24:30.635520 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34e64b3-e473-44e4-a488-83c5af5d24a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:24:30.636696 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34e64b3-e473-44e4-a488-83c5af5d24a0 None admin] REQUEST_METHOD: `GET` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:24:30.637127 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34e64b3-e473-44e4-a488-83c5af5d24a0 None admin] SCRIPT_NAME: `/identity` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:24:30.637493 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34e64b3-e473-44e4-a488-83c5af5d24a0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:24:30.645853 dv-cinder-851351-1-smb devstack@keystone.service[207601]: [pid: 207601|app: 0|req: 299/599] 10.222.0.42 () {58 vars in 1439 bytes} [Thu Jul 28 08:24:30 2022] PUT /identity/v3/projects/48c5f2b2ae2b48758b957d2b194a7fd1/users/d085f306b992491d862c5df4567f0083/roles/b44e7c7aeec24f51b8033df305da133d => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 08:24:30.647122 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1909bcaf-34ae-4100-b1d9-9f042079543b None admin] Authenticating user token {{(pid=207601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:24:30.649016 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d34e64b3-e473-44e4-a488-83c5af5d24a0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:24:30.651298 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d34e64b3-e473-44e4-a488-83c5af5d24a0 None admin] RBAC: Authorization granted {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:24:30.686470 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application [None req-d34e64b3-e473-44e4-a488-83c5af5d24a0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 08:24:30.686470 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:24:30.686470 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:24:30.686470 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:24:30.686470 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:24:30.686470 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:24:30.686470 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:24:30.686470 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:24:30.686470 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:24:30.686470 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:24:30.686470 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:24:30.686470 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:24:30.686470 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 28 08:24:30.686470 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 28 08:24:30.686470 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 28 08:24:30.687505 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 28 08:24:30.687505 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:24:30.687505 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:24:30.687505 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:24:30.687505 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:24:30.687505 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:24:30.687505 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:24:30.687505 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:24:30.687505 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application with Lock( Jul 28 08:24:30.687505 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:24:30.687505 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:24:30.687505 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:24:30.687505 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:24:30.687505 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:24:30.687505 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:24:30.687505 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:24:30.687505 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:24:30.688881 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 28 08:24:30.688881 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 28 08:24:30.688881 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 28 08:24:30.688881 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 28 08:24:30.688881 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 28 08:24:30.688881 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 28 08:24:30.688881 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 08:24:30.688881 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application Jul 28 08:24:30.694782 dv-cinder-851351-1-smb devstack@keystone.service[207600]: [pid: 207600|app: 0|req: 301/600] 10.222.0.42 () {56 vars in 1111 bytes} [Thu Jul 28 08:24:30 2022] GET /identity/v3/projects/service => generated 88 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:24:30.710711 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34e64b3-e473-44e4-a488-83c5af5d24a0 None admin] Authenticating user token {{(pid=207600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:24:30.735956 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG dbcounter [-] [207601] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=207601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:24:30.745089 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG dbcounter [-] [207600] Writing DB stats keystone:SELECT=100 {{(pid=207600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:24:30.840438 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1909bcaf-34ae-4100-b1d9-9f042079543b None admin] Validating token access rules against request {{(pid=207601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:24:30.895046 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db98b9cf-3a16-43c3-b48f-8b3f7ef5438b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:24:30.895659 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db98b9cf-3a16-43c3-b48f-8b3f7ef5438b None admin] REQUEST_METHOD: `GET` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:24:30.895945 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db98b9cf-3a16-43c3-b48f-8b3f7ef5438b None admin] SCRIPT_NAME: `/identity` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:24:30.896223 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db98b9cf-3a16-43c3-b48f-8b3f7ef5438b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:24:30.901080 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34e64b3-e473-44e4-a488-83c5af5d24a0 None admin] Validating token access rules against request {{(pid=207600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:24:30.910375 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db98b9cf-3a16-43c3-b48f-8b3f7ef5438b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:24:30.912300 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db98b9cf-3a16-43c3-b48f-8b3f7ef5438b None admin] RBAC: Authorization granted {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:24:30.934945 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application [None req-db98b9cf-3a16-43c3-b48f-8b3f7ef5438b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 08:24:30.934945 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:24:30.934945 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:24:30.934945 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:24:30.934945 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:24:30.934945 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:24:30.934945 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:24:30.934945 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:24:30.934945 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:24:30.934945 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:24:30.934945 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:24:30.934945 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:24:30.934945 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 08:24:30.934945 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 08:24:30.934945 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 08:24:30.935997 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 08:24:30.935997 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:24:30.935997 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:24:30.935997 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:24:30.935997 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:24:30.935997 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:24:30.935997 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:24:30.935997 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:24:30.935997 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application with Lock( Jul 28 08:24:30.935997 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:24:30.935997 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:24:30.935997 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:24:30.935997 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:24:30.935997 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:24:30.935997 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:24:30.935997 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:24:30.935997 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:24:30.937539 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 08:24:30.937539 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 08:24:30.937539 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 08:24:30.937539 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application Jul 28 08:24:30.937539 dv-cinder-851351-1-smb devstack@keystone.service[207601]: [pid: 207601|app: 0|req: 300/601] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 08:24:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 290 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:24:30.942600 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db98b9cf-3a16-43c3-b48f-8b3f7ef5438b None admin] Authenticating user token {{(pid=207601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:24:30.949886 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b08a3f-37e1-422a-81db-32cb509a7575 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:24:30.950627 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b08a3f-37e1-422a-81db-32cb509a7575 None admin] REQUEST_METHOD: `GET` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:24:30.950982 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b08a3f-37e1-422a-81db-32cb509a7575 None admin] SCRIPT_NAME: `/identity` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:24:30.951328 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b08a3f-37e1-422a-81db-32cb509a7575 None admin] PATH_INFO: `/v3/projects` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:24:30.952175 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85b08a3f-37e1-422a-81db-32cb509a7575 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=207600) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:24:30.952561 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85b08a3f-37e1-422a-81db-32cb509a7575 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:24:30.954268 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85b08a3f-37e1-422a-81db-32cb509a7575 None admin] RBAC: Authorization granted {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:24:30.968088 dv-cinder-851351-1-smb devstack@keystone.service[207600]: [pid: 207600|app: 0|req: 302/602] 10.222.0.42 () {56 vars in 1148 bytes} [Thu Jul 28 08:24:30 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 08:24:30.973860 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b08a3f-37e1-422a-81db-32cb509a7575 None admin] Authenticating user token {{(pid=207600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:24:31.101184 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG dbcounter [-] [207600] Writing DB stats keystone:SELECT=100 {{(pid=207600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:24:31.113818 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b08a3f-37e1-422a-81db-32cb509a7575 None admin] Validating token access rules against request {{(pid=207600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:24:31.167282 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1bc0d25-eb73-4be2-8798-a017a744bb9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:24:31.168160 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1bc0d25-eb73-4be2-8798-a017a744bb9a None admin] REQUEST_METHOD: `PUT` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:24:31.168567 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1bc0d25-eb73-4be2-8798-a017a744bb9a None admin] SCRIPT_NAME: `/identity` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:24:31.168960 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1bc0d25-eb73-4be2-8798-a017a744bb9a None admin] PATH_INFO: `/v3/projects/48c5f2b2ae2b48758b957d2b194a7fd1/users/d73bf33a61c14daa85bf297acf8d0751/roles/b44e7c7aeec24f51b8033df305da133d` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:24:31.202061 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1bc0d25-eb73-4be2-8798-a017a744bb9a None admin] RBAC: Authorizing `identity:create_grant(project_id=48c5f2b2ae2b48758b957d2b194a7fd1, user_id=d73bf33a61c14daa85bf297acf8d0751, role_id=b44e7c7aeec24f51b8033df305da133d)` {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:24:31.205454 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1bc0d25-eb73-4be2-8798-a017a744bb9a None admin] RBAC: Authorization granted {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:24:31.211677 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG dbcounter [-] [207601] Writing DB stats keystone:SELECT=100 {{(pid=207601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:24:31.218651 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db98b9cf-3a16-43c3-b48f-8b3f7ef5438b None admin] Validating token access rules against request {{(pid=207601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:24:31.227316 dv-cinder-851351-1-smb devstack@keystone.service[207600]: [pid: 207600|app: 0|req: 303/603] 10.222.0.42 () {58 vars in 1439 bytes} [Thu Jul 28 08:24:30 2022] PUT /identity/v3/projects/48c5f2b2ae2b48758b957d2b194a7fd1/users/d73bf33a61c14daa85bf297acf8d0751/roles/b44e7c7aeec24f51b8033df305da133d => generated 0 bytes in 254 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 08:24:31.230011 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcfc4941-2fc1-4ac9-a283-ea30ee59068f None None] REQUEST_METHOD: `GET` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:24:31.230769 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcfc4941-2fc1-4ac9-a283-ea30ee59068f None None] SCRIPT_NAME: `/identity` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:24:31.231327 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcfc4941-2fc1-4ac9-a283-ea30ee59068f None None] PATH_INFO: `/` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:24:31.233482 dv-cinder-851351-1-smb devstack@keystone.service[207600]: [pid: 207600|app: 0|req: 304/604] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 08:24:31 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 08:24:31.244691 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24743aa-b514-4c24-8610-056736c57254 None None] REQUEST_METHOD: `POST` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:24:31.244691 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24743aa-b514-4c24-8610-056736c57254 None None] SCRIPT_NAME: `/identity` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:24:31.244691 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24743aa-b514-4c24-8610-056736c57254 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:24:31.266812 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.auth.core [None req-e24743aa-b514-4c24-8610-056736c57254 None None] MFA Rules not processed for user `b8110ade874c4aa7af27f5c376df700a`. Rule list: `[]` (Enabled: `True`). {{(pid=207600) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 08:24:31.268078 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.fernet_utils [None req-e24743aa-b514-4c24-8610-056736c57254 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=207600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:24:31.281835 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa868083-1999-4555-928b-a08fbed3887c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:24:31.282797 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa868083-1999-4555-928b-a08fbed3887c None admin] REQUEST_METHOD: `GET` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:24:31.283083 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa868083-1999-4555-928b-a08fbed3887c None admin] SCRIPT_NAME: `/identity` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:24:31.283356 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa868083-1999-4555-928b-a08fbed3887c None admin] PATH_INFO: `/v3/domains` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:24:31.284103 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa868083-1999-4555-928b-a08fbed3887c None admin] RBAC: Adding query filter params (name=Default) {{(pid=207601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:24:31.284735 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa868083-1999-4555-928b-a08fbed3887c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:24:31.287071 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa868083-1999-4555-928b-a08fbed3887c None admin] RBAC: Authorization granted {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:24:31.308776 dv-cinder-851351-1-smb devstack@keystone.service[207601]: [pid: 207601|app: 0|req: 301/605] 10.222.0.42 () {56 vars in 1109 bytes} [Thu Jul 28 08:24:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 364 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:24:31.310529 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7120a7-b698-4d61-b339-cd4ab1552106 None None] REQUEST_METHOD: `GET` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:24:31.310891 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7120a7-b698-4d61-b339-cd4ab1552106 None None] SCRIPT_NAME: `/identity` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:24:31.311363 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7120a7-b698-4d61-b339-cd4ab1552106 None None] PATH_INFO: `/` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:24:31.313514 dv-cinder-851351-1-smb devstack@keystone.service[207601]: [pid: 207601|app: 0|req: 302/606] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 08:24:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 08:24:31.314430 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7120a7-b698-4d61-b339-cd4ab1552106 None None] Authenticating user token {{(pid=207601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:24:31.368874 dv-cinder-851351-1-smb devstack@keystone.service[207600]: [pid: 207600|app: 0|req: 305/607] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 08:24:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 08:24:31.370490 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a51bc49-ebf5-4b25-83d2-9c05a32e1a7a None None] REQUEST_METHOD: `POST` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:24:31.370778 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a51bc49-ebf5-4b25-83d2-9c05a32e1a7a None None] SCRIPT_NAME: `/identity` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:24:31.371143 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a51bc49-ebf5-4b25-83d2-9c05a32e1a7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:24:31.408435 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.auth.core [None req-3a51bc49-ebf5-4b25-83d2-9c05a32e1a7a None None] MFA Rules not processed for user `b8110ade874c4aa7af27f5c376df700a`. Rule list: `[]` (Enabled: `True`). {{(pid=207600) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 08:24:31.411005 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.fernet_utils [None req-3a51bc49-ebf5-4b25-83d2-9c05a32e1a7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=207600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:24:31.459489 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7120a7-b698-4d61-b339-cd4ab1552106 None None] Validating token access rules against request {{(pid=207601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:24:31.488589 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG dbcounter [-] [207600] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=207600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:24:31.501809 dv-cinder-851351-1-smb devstack@keystone.service[207600]: [pid: 207600|app: 0|req: 306/608] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 08:24:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 08:24:31.502985 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a51bc49-ebf5-4b25-83d2-9c05a32e1a7a None None] Authenticating user token {{(pid=207600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:24:31.511364 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c93e27-92d3-4c47-a0ef-1c7718ad87aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:24:31.512387 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c93e27-92d3-4c47-a0ef-1c7718ad87aa None admin] REQUEST_METHOD: `GET` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:24:31.512910 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c93e27-92d3-4c47-a0ef-1c7718ad87aa None admin] SCRIPT_NAME: `/identity` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:24:31.513383 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c93e27-92d3-4c47-a0ef-1c7718ad87aa None admin] PATH_INFO: `/v3/projects/service` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:24:31.529820 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c93e27-92d3-4c47-a0ef-1c7718ad87aa None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:24:31.531362 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c93e27-92d3-4c47-a0ef-1c7718ad87aa None admin] RBAC: Authorization granted {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:24:31.543980 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application [None req-63c93e27-92d3-4c47-a0ef-1c7718ad87aa None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 08:24:31.543980 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:24:31.543980 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:24:31.543980 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:24:31.543980 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:24:31.543980 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:24:31.543980 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:24:31.543980 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:24:31.543980 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:24:31.543980 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:24:31.543980 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:24:31.543980 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:24:31.543980 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 28 08:24:31.543980 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 28 08:24:31.543980 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 28 08:24:31.545299 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 28 08:24:31.545299 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:24:31.545299 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:24:31.545299 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:24:31.545299 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:24:31.545299 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:24:31.545299 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:24:31.545299 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:24:31.545299 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application with Lock( Jul 28 08:24:31.545299 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:24:31.545299 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:24:31.545299 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:24:31.545299 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:24:31.545299 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:24:31.545299 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:24:31.545299 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:24:31.545299 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:24:31.546526 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 28 08:24:31.546526 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 28 08:24:31.546526 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 28 08:24:31.546526 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 28 08:24:31.546526 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 28 08:24:31.546526 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 28 08:24:31.546526 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 08:24:31.546526 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application Jul 28 08:24:31.546526 dv-cinder-851351-1-smb devstack@keystone.service[207601]: [pid: 207601|app: 0|req: 303/609] 10.222.0.42 () {56 vars in 1111 bytes} [Thu Jul 28 08:24:31 2022] GET /identity/v3/projects/service => generated 88 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:24:31.546526 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c93e27-92d3-4c47-a0ef-1c7718ad87aa None admin] Authenticating user token {{(pid=207601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:24:31.573599 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG dbcounter [-] [207601] Writing DB stats keystone:SELECT=100 {{(pid=207601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:24:31.634566 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a51bc49-ebf5-4b25-83d2-9c05a32e1a7a None None] Validating token access rules against request {{(pid=207600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:24:31.669701 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53be0482-33da-4cc8-9f8c-861d5ac59c18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:24:31.670519 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53be0482-33da-4cc8-9f8c-861d5ac59c18 None admin] REQUEST_METHOD: `GET` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:24:31.670807 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53be0482-33da-4cc8-9f8c-861d5ac59c18 None admin] SCRIPT_NAME: `/identity` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:24:31.671082 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53be0482-33da-4cc8-9f8c-861d5ac59c18 None admin] PATH_INFO: `/v3/roles/service` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:24:31.681533 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c93e27-92d3-4c47-a0ef-1c7718ad87aa None admin] Validating token access rules against request {{(pid=207601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:24:31.683813 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53be0482-33da-4cc8-9f8c-861d5ac59c18 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 08:24:31.690224 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application [None req-53be0482-33da-4cc8-9f8c-861d5ac59c18 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 28 08:24:31.690224 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:24:31.690224 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:24:31.690224 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:24:31.690224 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:24:31.690224 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:24:31.690224 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:24:31.690224 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:24:31.690224 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:24:31.690224 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:24:31.690224 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:24:31.690224 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:24:31.690224 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 08:24:31.690224 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 08:24:31.690224 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 08:24:31.690224 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 08:24:31.691441 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 08:24:31.691441 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 08:24:31.691441 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 08:24:31.691441 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 08:24:31.691441 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:24:31.691441 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:24:31.691441 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:24:31.691441 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:24:31.691441 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:24:31.691441 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:24:31.691441 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:24:31.691441 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application with Lock( Jul 28 08:24:31.691441 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:24:31.691441 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:24:31.691441 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:24:31.691441 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:24:31.692639 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:24:31.692639 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:24:31.692639 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:24:31.692639 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:24:31.692639 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 08:24:31.692639 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 08:24:31.692639 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 08:24:31.692639 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 08:24:31.692639 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 08:24:31.692639 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 08:24:31.692639 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 28 08:24:31.692639 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application Jul 28 08:24:31.696742 dv-cinder-851351-1-smb devstack@keystone.service[207600]: [pid: 207600|app: 0|req: 307/610] 10.222.0.42 () {56 vars in 1102 bytes} [Thu Jul 28 08:24:31 2022] GET /identity/v3/roles/service => generated 85 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:24:31.697712 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53be0482-33da-4cc8-9f8c-861d5ac59c18 None admin] Authenticating user token {{(pid=207600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:24:31.729661 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535f8197-0469-4a4c-acd1-d15015f6341d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:24:31.730763 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535f8197-0469-4a4c-acd1-d15015f6341d None admin] REQUEST_METHOD: `GET` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:24:31.731139 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535f8197-0469-4a4c-acd1-d15015f6341d None admin] SCRIPT_NAME: `/identity` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:24:31.731664 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535f8197-0469-4a4c-acd1-d15015f6341d None admin] PATH_INFO: `/v3/roles/service` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:24:31.746662 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-535f8197-0469-4a4c-acd1-d15015f6341d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 08:24:31.755219 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application [None req-535f8197-0469-4a4c-acd1-d15015f6341d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 28 08:24:31.755219 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:24:31.755219 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:24:31.755219 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:24:31.755219 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:24:31.755219 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:24:31.755219 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:24:31.755219 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:24:31.755219 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:24:31.755219 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:24:31.755219 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:24:31.755219 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:24:31.755219 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 08:24:31.755219 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 08:24:31.755219 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 08:24:31.755219 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 08:24:31.756386 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 08:24:31.756386 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 08:24:31.756386 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 08:24:31.756386 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 08:24:31.756386 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:24:31.756386 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:24:31.756386 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:24:31.756386 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:24:31.756386 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:24:31.756386 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:24:31.756386 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:24:31.756386 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application with Lock( Jul 28 08:24:31.756386 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:24:31.756386 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:24:31.756386 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:24:31.756386 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:24:31.757522 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:24:31.757522 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:24:31.757522 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:24:31.757522 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:24:31.757522 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 08:24:31.757522 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 08:24:31.757522 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 08:24:31.757522 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 08:24:31.757522 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 08:24:31.757522 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 08:24:31.757522 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 28 08:24:31.757522 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application Jul 28 08:24:31.760018 dv-cinder-851351-1-smb devstack@keystone.service[207601]: [pid: 207601|app: 0|req: 304/611] 10.222.0.42 () {56 vars in 1102 bytes} [Thu Jul 28 08:24:31 2022] GET /identity/v3/roles/service => generated 85 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:24:31.761381 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535f8197-0469-4a4c-acd1-d15015f6341d None admin] Authenticating user token {{(pid=207601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:24:31.762235 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG dbcounter [-] [207600] Writing DB stats keystone:SELECT=100 {{(pid=207600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:24:31.819262 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53be0482-33da-4cc8-9f8c-861d5ac59c18 None admin] Validating token access rules against request {{(pid=207600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:24:31.865735 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86405e14-ccf6-4bff-b89d-bc37f8d0742d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:24:31.866479 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86405e14-ccf6-4bff-b89d-bc37f8d0742d None admin] REQUEST_METHOD: `GET` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:24:31.866768 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86405e14-ccf6-4bff-b89d-bc37f8d0742d None admin] SCRIPT_NAME: `/identity` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:24:31.867045 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86405e14-ccf6-4bff-b89d-bc37f8d0742d None admin] PATH_INFO: `/v3/projects` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:24:31.868162 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86405e14-ccf6-4bff-b89d-bc37f8d0742d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=207600) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:24:31.868475 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86405e14-ccf6-4bff-b89d-bc37f8d0742d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:24:31.871281 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86405e14-ccf6-4bff-b89d-bc37f8d0742d None admin] RBAC: Authorization granted {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:24:31.878930 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG dbcounter [-] [207601] Writing DB stats keystone:SELECT=100 {{(pid=207601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:24:31.892932 dv-cinder-851351-1-smb devstack@keystone.service[207600]: [pid: 207600|app: 0|req: 308/612] 10.222.0.42 () {56 vars in 1148 bytes} [Thu Jul 28 08:24:31 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:24:31.895547 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86405e14-ccf6-4bff-b89d-bc37f8d0742d None admin] Authenticating user token {{(pid=207600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:24:31.911261 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535f8197-0469-4a4c-acd1-d15015f6341d None admin] Validating token access rules against request {{(pid=207601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:24:31.951468 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d3d3b96-aac2-49f9-8eb7-a4bcf78f2f73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:24:31.952122 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3d3b96-aac2-49f9-8eb7-a4bcf78f2f73 None admin] REQUEST_METHOD: `GET` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:24:31.952408 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3d3b96-aac2-49f9-8eb7-a4bcf78f2f73 None admin] SCRIPT_NAME: `/identity` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:24:31.952706 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3d3b96-aac2-49f9-8eb7-a4bcf78f2f73 None admin] PATH_INFO: `/v3/roles` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:24:31.953998 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d3d3b96-aac2-49f9-8eb7-a4bcf78f2f73 None admin] RBAC: Adding query filter params (name=service) {{(pid=207601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:24:31.954479 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d3d3b96-aac2-49f9-8eb7-a4bcf78f2f73 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:24:31.956046 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d3d3b96-aac2-49f9-8eb7-a4bcf78f2f73 None admin] RBAC: Authorization granted {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:24:31.968183 dv-cinder-851351-1-smb devstack@keystone.service[207601]: [pid: 207601|app: 0|req: 305/613] 10.222.0.42 () {56 vars in 1103 bytes} [Thu Jul 28 08:24:31 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:24:31.969158 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d3d3b96-aac2-49f9-8eb7-a4bcf78f2f73 None admin] Authenticating user token {{(pid=207601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:24:32.029925 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86405e14-ccf6-4bff-b89d-bc37f8d0742d None admin] Validating token access rules against request {{(pid=207600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:24:32.045888 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG dbcounter [-] [207600] Writing DB stats keystone:SELECT=100 {{(pid=207600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:24:32.068535 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4472fad0-3403-4edd-88d9-5945b12c5134 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:24:32.069202 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4472fad0-3403-4edd-88d9-5945b12c5134 None admin] REQUEST_METHOD: `GET` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:24:32.069488 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4472fad0-3403-4edd-88d9-5945b12c5134 None admin] SCRIPT_NAME: `/identity` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:24:32.069762 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4472fad0-3403-4edd-88d9-5945b12c5134 None admin] PATH_INFO: `/v3/roles` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:24:32.070612 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4472fad0-3403-4edd-88d9-5945b12c5134 None admin] RBAC: Adding query filter params (name=service) {{(pid=207600) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:24:32.070928 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4472fad0-3403-4edd-88d9-5945b12c5134 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:24:32.072420 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4472fad0-3403-4edd-88d9-5945b12c5134 None admin] RBAC: Authorization granted {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:24:32.086753 dv-cinder-851351-1-smb devstack@keystone.service[207600]: [pid: 207600|app: 0|req: 309/614] 10.222.0.42 () {56 vars in 1103 bytes} [Thu Jul 28 08:24:31 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:24:32.087733 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4472fad0-3403-4edd-88d9-5945b12c5134 None admin] Authenticating user token {{(pid=207600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:24:32.093094 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d3d3b96-aac2-49f9-8eb7-a4bcf78f2f73 None admin] Validating token access rules against request {{(pid=207601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:24:32.130789 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc394d8-dd8e-4924-8133-1e5749212861 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:24:32.131861 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc394d8-dd8e-4924-8133-1e5749212861 None admin] REQUEST_METHOD: `PUT` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:24:32.132419 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc394d8-dd8e-4924-8133-1e5749212861 None admin] SCRIPT_NAME: `/identity` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:24:32.132936 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc394d8-dd8e-4924-8133-1e5749212861 None admin] PATH_INFO: `/v3/projects/48c5f2b2ae2b48758b957d2b194a7fd1/users/8d8ee8f8acaf4811addc298a15a4916b/roles/b44e7c7aeec24f51b8033df305da133d` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:24:32.145800 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG dbcounter [-] [207601] Writing DB stats keystone:SELECT=100 {{(pid=207601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:24:32.150623 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdc394d8-dd8e-4924-8133-1e5749212861 None admin] RBAC: Authorizing `identity:create_grant(project_id=48c5f2b2ae2b48758b957d2b194a7fd1, user_id=8d8ee8f8acaf4811addc298a15a4916b, role_id=b44e7c7aeec24f51b8033df305da133d)` {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:24:32.153735 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdc394d8-dd8e-4924-8133-1e5749212861 None admin] RBAC: Authorization granted {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:24:32.177367 dv-cinder-851351-1-smb devstack@keystone.service[207601]: [pid: 207601|app: 0|req: 306/615] 10.222.0.42 () {58 vars in 1439 bytes} [Thu Jul 28 08:24:31 2022] PUT /identity/v3/projects/48c5f2b2ae2b48758b957d2b194a7fd1/users/8d8ee8f8acaf4811addc298a15a4916b/roles/b44e7c7aeec24f51b8033df305da133d => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 08:24:32.179989 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc394d8-dd8e-4924-8133-1e5749212861 None admin] Authenticating user token {{(pid=207601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:24:32.240108 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4472fad0-3403-4edd-88d9-5945b12c5134 None admin] Validating token access rules against request {{(pid=207600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:24:32.317799 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d683c668-6e21-4b0c-af6e-46c76d6e2f15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:24:32.318513 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d683c668-6e21-4b0c-af6e-46c76d6e2f15 None admin] REQUEST_METHOD: `GET` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:24:32.318792 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d683c668-6e21-4b0c-af6e-46c76d6e2f15 None admin] SCRIPT_NAME: `/identity` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:24:32.319064 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d683c668-6e21-4b0c-af6e-46c76d6e2f15 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:24:32.345255 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d683c668-6e21-4b0c-af6e-46c76d6e2f15 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:24:32.346776 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d683c668-6e21-4b0c-af6e-46c76d6e2f15 None admin] RBAC: Authorization granted {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:24:32.365719 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc394d8-dd8e-4924-8133-1e5749212861 None admin] Validating token access rules against request {{(pid=207601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:24:32.375981 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application [None req-d683c668-6e21-4b0c-af6e-46c76d6e2f15 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 08:24:32.375981 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:24:32.375981 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:24:32.375981 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:24:32.375981 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:24:32.375981 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:24:32.375981 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:24:32.375981 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:24:32.375981 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:24:32.375981 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:24:32.375981 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:24:32.375981 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:24:32.375981 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 08:24:32.375981 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 08:24:32.375981 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 08:24:32.377043 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 08:24:32.377043 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:24:32.377043 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:24:32.377043 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:24:32.377043 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:24:32.377043 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:24:32.377043 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:24:32.377043 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:24:32.377043 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application with Lock( Jul 28 08:24:32.377043 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:24:32.377043 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:24:32.377043 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:24:32.377043 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:24:32.377043 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:24:32.377043 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:24:32.377043 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:24:32.377043 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:24:32.377977 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 08:24:32.377977 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 08:24:32.377977 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 08:24:32.377977 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application Jul 28 08:24:32.380853 dv-cinder-851351-1-smb devstack@keystone.service[207600]: [pid: 207600|app: 0|req: 310/616] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 08:24:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 294 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:24:32.385202 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d683c668-6e21-4b0c-af6e-46c76d6e2f15 None admin] Authenticating user token {{(pid=207600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:24:32.425176 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG dbcounter [-] [207600] Writing DB stats keystone:SELECT=100 {{(pid=207600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:24:32.431090 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bcca068-0cbb-4526-9940-c823ec2ff7ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:24:32.431823 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bcca068-0cbb-4526-9940-c823ec2ff7ba None admin] REQUEST_METHOD: `GET` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:24:32.432878 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bcca068-0cbb-4526-9940-c823ec2ff7ba None admin] SCRIPT_NAME: `/identity` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:24:32.433181 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bcca068-0cbb-4526-9940-c823ec2ff7ba None admin] PATH_INFO: `/v3/domains/Default` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:24:32.448277 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bcca068-0cbb-4526-9940-c823ec2ff7ba None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:24:32.450170 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bcca068-0cbb-4526-9940-c823ec2ff7ba None admin] RBAC: Authorization granted {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:24:32.472234 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application [None req-5bcca068-0cbb-4526-9940-c823ec2ff7ba None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 08:24:32.472234 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:24:32.472234 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:24:32.472234 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:24:32.472234 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:24:32.472234 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:24:32.472234 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:24:32.472234 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:24:32.472234 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:24:32.472234 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:24:32.472234 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:24:32.472234 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:24:32.472234 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 08:24:32.472234 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 08:24:32.472234 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 08:24:32.473491 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 08:24:32.473491 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:24:32.473491 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:24:32.473491 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:24:32.473491 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:24:32.473491 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:24:32.473491 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:24:32.473491 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:24:32.473491 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application with Lock( Jul 28 08:24:32.473491 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:24:32.473491 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:24:32.473491 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:24:32.473491 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:24:32.473491 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:24:32.473491 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:24:32.473491 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:24:32.473491 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:24:32.474468 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 08:24:32.474468 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 08:24:32.474468 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 08:24:32.474468 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application Jul 28 08:24:32.474468 dv-cinder-851351-1-smb devstack@keystone.service[207601]: [pid: 207601|app: 0|req: 307/617] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 08:24:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 296 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:24:32.479955 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bcca068-0cbb-4526-9940-c823ec2ff7ba None admin] Authenticating user token {{(pid=207601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:24:32.529159 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d683c668-6e21-4b0c-af6e-46c76d6e2f15 None admin] Validating token access rules against request {{(pid=207600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:24:32.552997 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG dbcounter [-] [207601] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=207601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:24:32.580972 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d03d8b2f-6122-4ff2-b527-448c3d1373ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:24:32.582203 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03d8b2f-6122-4ff2-b527-448c3d1373ec None admin] REQUEST_METHOD: `GET` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:24:32.582691 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03d8b2f-6122-4ff2-b527-448c3d1373ec None admin] SCRIPT_NAME: `/identity` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:24:32.583292 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03d8b2f-6122-4ff2-b527-448c3d1373ec None admin] PATH_INFO: `/v3/domains` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:24:32.584266 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d03d8b2f-6122-4ff2-b527-448c3d1373ec None admin] RBAC: Adding query filter params (name=Default) {{(pid=207600) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:24:32.584867 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d03d8b2f-6122-4ff2-b527-448c3d1373ec None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:24:32.586497 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d03d8b2f-6122-4ff2-b527-448c3d1373ec None admin] RBAC: Authorization granted {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:24:32.602658 dv-cinder-851351-1-smb devstack@keystone.service[207600]: [pid: 207600|app: 0|req: 311/618] 10.222.0.42 () {56 vars in 1109 bytes} [Thu Jul 28 08:24:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 08:24:32.609335 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d03d8b2f-6122-4ff2-b527-448c3d1373ec None admin] Authenticating user token {{(pid=207600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:24:32.713240 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bcca068-0cbb-4526-9940-c823ec2ff7ba None admin] Validating token access rules against request {{(pid=207601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:24:32.749135 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG dbcounter [-] [207600] Writing DB stats keystone:SELECT=100 {{(pid=207600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:24:32.777935 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cfa1c20-3dca-4dc4-b65a-14adf26a993b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:24:32.778756 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cfa1c20-3dca-4dc4-b65a-14adf26a993b None admin] REQUEST_METHOD: `GET` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:24:32.779042 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cfa1c20-3dca-4dc4-b65a-14adf26a993b None admin] SCRIPT_NAME: `/identity` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:24:32.779317 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cfa1c20-3dca-4dc4-b65a-14adf26a993b None admin] PATH_INFO: `/v3/domains` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:24:32.780039 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cfa1c20-3dca-4dc4-b65a-14adf26a993b None admin] RBAC: Adding query filter params (name=Default) {{(pid=207601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:24:32.780344 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cfa1c20-3dca-4dc4-b65a-14adf26a993b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:24:32.781931 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cfa1c20-3dca-4dc4-b65a-14adf26a993b None admin] RBAC: Authorization granted {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:24:32.782841 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d03d8b2f-6122-4ff2-b527-448c3d1373ec None admin] Validating token access rules against request {{(pid=207600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:24:32.797927 dv-cinder-851351-1-smb devstack@keystone.service[207601]: [pid: 207601|app: 0|req: 308/619] 10.222.0.42 () {56 vars in 1109 bytes} [Thu Jul 28 08:24:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 319 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 08:24:32.804364 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cfa1c20-3dca-4dc4-b65a-14adf26a993b None admin] Authenticating user token {{(pid=207601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:24:32.901523 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762ae8b5-5e0b-4fdd-b4e1-cf9e2fe82ff7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:24:32.902219 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762ae8b5-5e0b-4fdd-b4e1-cf9e2fe82ff7 None admin] REQUEST_METHOD: `GET` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:24:32.902516 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762ae8b5-5e0b-4fdd-b4e1-cf9e2fe82ff7 None admin] SCRIPT_NAME: `/identity` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:24:32.902820 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762ae8b5-5e0b-4fdd-b4e1-cf9e2fe82ff7 None admin] PATH_INFO: `/v3/users/nova` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:24:32.925180 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-762ae8b5-5e0b-4fdd-b4e1-cf9e2fe82ff7 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:24:32.927285 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-762ae8b5-5e0b-4fdd-b4e1-cf9e2fe82ff7 None admin] RBAC: Authorization granted {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:24:32.932688 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cfa1c20-3dca-4dc4-b65a-14adf26a993b None admin] Validating token access rules against request {{(pid=207601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:24:32.937309 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG dbcounter [-] [207601] Writing DB stats keystone:SELECT=100 {{(pid=207601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:24:32.949420 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application [None req-762ae8b5-5e0b-4fdd-b4e1-cf9e2fe82ff7 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 28 08:24:32.949420 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:24:32.949420 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:24:32.949420 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:24:32.949420 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:24:32.949420 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:24:32.949420 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:24:32.949420 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:24:32.949420 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:24:32.949420 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:24:32.949420 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:24:32.949420 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:24:32.949420 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 28 08:24:32.949420 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 28 08:24:32.949420 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 28 08:24:32.949420 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 28 08:24:32.950585 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:24:32.950585 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:24:32.950585 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 28 08:24:32.950585 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 08:24:32.950585 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 28 08:24:32.950585 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 08:24:32.950585 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:24:32.950585 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:24:32.950585 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:24:32.950585 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:24:32.950585 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:24:32.950585 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application with Lock( Jul 28 08:24:32.950585 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:24:32.950585 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:24:32.950585 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:24:32.950585 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:24:32.950585 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:24:32.950585 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:24:32.951577 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:24:32.951577 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:24:32.951577 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 28 08:24:32.951577 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 28 08:24:32.951577 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 28 08:24:32.951577 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 28 08:24:32.951577 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 28 08:24:32.951577 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 28 08:24:32.951577 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 28 08:24:32.951577 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application Jul 28 08:24:32.954454 dv-cinder-851351-1-smb devstack@keystone.service[207600]: [pid: 207600|app: 0|req: 312/620] 10.222.0.42 () {56 vars in 1093 bytes} [Thu Jul 28 08:24:32 2022] GET /identity/v3/users/nova => generated 82 bytes in 346 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:24:32.963765 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77705751-8ba6-4842-aa66-be8198b09913 None None] REQUEST_METHOD: `GET` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:24:32.963765 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77705751-8ba6-4842-aa66-be8198b09913 None None] SCRIPT_NAME: `/identity` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:24:32.963765 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77705751-8ba6-4842-aa66-be8198b09913 None None] PATH_INFO: `/` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:24:32.964129 dv-cinder-851351-1-smb devstack@keystone.service[207600]: [pid: 207600|app: 0|req: 313/621] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 08:24:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 08:24:32.964809 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77705751-8ba6-4842-aa66-be8198b09913 None None] Authenticating user token {{(pid=207600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:24:32.986387 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-232aac3c-43f0-4f10-807d-1049e0d4d35d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:24:32.987077 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232aac3c-43f0-4f10-807d-1049e0d4d35d None admin] REQUEST_METHOD: `GET` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:24:32.987499 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232aac3c-43f0-4f10-807d-1049e0d4d35d None admin] SCRIPT_NAME: `/identity` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:24:32.987709 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232aac3c-43f0-4f10-807d-1049e0d4d35d None admin] PATH_INFO: `/v3/users/swift` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:24:32.996703 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-232aac3c-43f0-4f10-807d-1049e0d4d35d None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:24:32.998336 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-232aac3c-43f0-4f10-807d-1049e0d4d35d None admin] RBAC: Authorization granted {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:24:33.013616 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application [None req-232aac3c-43f0-4f10-807d-1049e0d4d35d None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 28 08:24:33.013616 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:24:33.013616 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:24:33.013616 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:24:33.013616 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:24:33.013616 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:24:33.013616 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:24:33.013616 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:24:33.013616 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:24:33.013616 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:24:33.013616 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:24:33.013616 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:24:33.013616 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 28 08:24:33.013616 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 28 08:24:33.013616 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 28 08:24:33.013616 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 28 08:24:33.014727 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:24:33.014727 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:24:33.014727 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 28 08:24:33.014727 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 08:24:33.014727 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 28 08:24:33.014727 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 08:24:33.014727 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:24:33.014727 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:24:33.014727 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:24:33.014727 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:24:33.014727 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:24:33.014727 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application with Lock( Jul 28 08:24:33.014727 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:24:33.014727 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:24:33.014727 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:24:33.014727 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:24:33.014727 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:24:33.014727 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:24:33.015711 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:24:33.015711 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:24:33.015711 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 28 08:24:33.015711 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 28 08:24:33.015711 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 28 08:24:33.015711 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 28 08:24:33.015711 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 28 08:24:33.015711 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 28 08:24:33.015711 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 28 08:24:33.015711 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application Jul 28 08:24:33.015711 dv-cinder-851351-1-smb devstack@keystone.service[207601]: [pid: 207601|app: 0|req: 309/622] 10.222.0.42 () {56 vars in 1096 bytes} [Thu Jul 28 08:24:32 2022] GET /identity/v3/users/swift => generated 83 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:24:33.016897 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf33886-a6ff-4289-9e0d-dbe11128db2d None None] REQUEST_METHOD: `POST` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:24:33.017079 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf33886-a6ff-4289-9e0d-dbe11128db2d None None] SCRIPT_NAME: `/identity` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:24:33.017382 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf33886-a6ff-4289-9e0d-dbe11128db2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:24:33.037994 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.auth.core [None req-bcf33886-a6ff-4289-9e0d-dbe11128db2d None None] MFA Rules not processed for user `b8110ade874c4aa7af27f5c376df700a`. Rule list: `[]` (Enabled: `True`). {{(pid=207601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 08:24:33.039243 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.fernet_utils [None req-bcf33886-a6ff-4289-9e0d-dbe11128db2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=207601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:24:33.091260 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77705751-8ba6-4842-aa66-be8198b09913 None None] Validating token access rules against request {{(pid=207600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:24:33.124700 dv-cinder-851351-1-smb devstack@keystone.service[207601]: [pid: 207601|app: 0|req: 310/623] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 08:24:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 08:24:33.124700 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf33886-a6ff-4289-9e0d-dbe11128db2d None None] Authenticating user token {{(pid=207601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:24:33.142424 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2acd190b-66b6-460a-87bb-4c94fdd702db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:24:33.143496 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2acd190b-66b6-460a-87bb-4c94fdd702db None admin] REQUEST_METHOD: `GET` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:24:33.143983 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2acd190b-66b6-460a-87bb-4c94fdd702db None admin] SCRIPT_NAME: `/identity` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:24:33.144451 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2acd190b-66b6-460a-87bb-4c94fdd702db None admin] PATH_INFO: `/v3/users` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:24:33.145611 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2acd190b-66b6-460a-87bb-4c94fdd702db None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=207600) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:24:33.146277 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2acd190b-66b6-460a-87bb-4c94fdd702db None admin] RBAC: Authorizing `identity:list_users()` {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:24:33.147989 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2acd190b-66b6-460a-87bb-4c94fdd702db None admin] RBAC: Authorization granted {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:24:33.180539 dv-cinder-851351-1-smb devstack@keystone.service[207600]: [pid: 207600|app: 0|req: 314/624] 10.222.0.42 () {56 vars in 1133 bytes} [Thu Jul 28 08:24:32 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:24:33.182058 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2acd190b-66b6-460a-87bb-4c94fdd702db None admin] Authenticating user token {{(pid=207600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:24:33.192354 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG dbcounter [-] [207600] Writing DB stats keystone:SELECT=100 {{(pid=207600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:24:33.231307 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG dbcounter [-] [207601] Writing DB stats keystone:SELECT=100 {{(pid=207601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:24:33.241572 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf33886-a6ff-4289-9e0d-dbe11128db2d None None] Validating token access rules against request {{(pid=207601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:24:33.281537 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b2c972d-55d8-42ee-ab53-ef442c6f552e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:24:33.282307 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2c972d-55d8-42ee-ab53-ef442c6f552e None admin] REQUEST_METHOD: `GET` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:24:33.282695 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2c972d-55d8-42ee-ab53-ef442c6f552e None admin] SCRIPT_NAME: `/identity` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:24:33.283216 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2c972d-55d8-42ee-ab53-ef442c6f552e None admin] PATH_INFO: `/v3/users` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:24:33.284100 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b2c972d-55d8-42ee-ab53-ef442c6f552e None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=207601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:24:33.284517 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b2c972d-55d8-42ee-ab53-ef442c6f552e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:24:33.286269 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b2c972d-55d8-42ee-ab53-ef442c6f552e None admin] RBAC: Authorization granted {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:24:33.300007 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2acd190b-66b6-460a-87bb-4c94fdd702db None admin] Validating token access rules against request {{(pid=207600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:24:33.307876 dv-cinder-851351-1-smb devstack@keystone.service[207601]: [pid: 207601|app: 0|req: 311/625] 10.222.0.42 () {56 vars in 1135 bytes} [Thu Jul 28 08:24:33 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:24:33.309042 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b2c972d-55d8-42ee-ab53-ef442c6f552e None admin] Authenticating user token {{(pid=207601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:24:33.339961 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36696ba9-ac23-4fa1-9b26-16e0dc16c7a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:24:33.340932 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36696ba9-ac23-4fa1-9b26-16e0dc16c7a3 None admin] REQUEST_METHOD: `GET` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:24:33.341362 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36696ba9-ac23-4fa1-9b26-16e0dc16c7a3 None admin] SCRIPT_NAME: `/identity` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:24:33.341783 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36696ba9-ac23-4fa1-9b26-16e0dc16c7a3 None admin] PATH_INFO: `/v3/roles/service` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:24:33.354164 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36696ba9-ac23-4fa1-9b26-16e0dc16c7a3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 08:24:33.359641 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application [None req-36696ba9-ac23-4fa1-9b26-16e0dc16c7a3 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 28 08:24:33.359641 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:24:33.359641 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:24:33.359641 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:24:33.359641 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:24:33.359641 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:24:33.359641 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:24:33.359641 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:24:33.359641 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:24:33.359641 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:24:33.359641 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:24:33.359641 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:24:33.359641 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 08:24:33.359641 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 08:24:33.359641 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 08:24:33.359641 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 08:24:33.360648 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 08:24:33.360648 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 08:24:33.360648 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 08:24:33.360648 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 08:24:33.360648 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:24:33.360648 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:24:33.360648 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:24:33.360648 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:24:33.360648 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:24:33.360648 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:24:33.360648 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:24:33.360648 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application with Lock( Jul 28 08:24:33.360648 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:24:33.360648 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:24:33.360648 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:24:33.360648 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:24:33.361570 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:24:33.361570 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:24:33.361570 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:24:33.361570 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:24:33.361570 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 08:24:33.361570 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 08:24:33.361570 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 08:24:33.361570 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 08:24:33.361570 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 08:24:33.361570 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 08:24:33.361570 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 28 08:24:33.361570 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application Jul 28 08:24:33.369271 dv-cinder-851351-1-smb devstack@keystone.service[207600]: [pid: 207600|app: 0|req: 315/626] 10.222.0.42 () {56 vars in 1102 bytes} [Thu Jul 28 08:24:33 2022] GET /identity/v3/roles/service => generated 85 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:24:33.370698 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36696ba9-ac23-4fa1-9b26-16e0dc16c7a3 None admin] Authenticating user token {{(pid=207600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:24:33.426751 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b2c972d-55d8-42ee-ab53-ef442c6f552e None admin] Validating token access rules against request {{(pid=207601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:24:33.442969 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG dbcounter [-] [207600] Writing DB stats keystone:SELECT=100 {{(pid=207600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:24:33.469222 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d849fc5b-675f-43b6-a407-94d59b7ea219 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:24:33.469627 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d849fc5b-675f-43b6-a407-94d59b7ea219 None admin] REQUEST_METHOD: `GET` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:24:33.469879 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d849fc5b-675f-43b6-a407-94d59b7ea219 None admin] SCRIPT_NAME: `/identity` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:24:33.470163 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d849fc5b-675f-43b6-a407-94d59b7ea219 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:24:33.483289 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36696ba9-ac23-4fa1-9b26-16e0dc16c7a3 None admin] Validating token access rules against request {{(pid=207600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:24:33.492280 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG dbcounter [-] [207601] Writing DB stats keystone:SELECT=100 {{(pid=207601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:24:33.526598 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-effb0798-f47a-467d-bf17-9070a223f3f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:24:33.527280 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-effb0798-f47a-467d-bf17-9070a223f3f6 None admin] REQUEST_METHOD: `GET` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:24:33.527564 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-effb0798-f47a-467d-bf17-9070a223f3f6 None admin] SCRIPT_NAME: `/identity` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:24:33.527842 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-effb0798-f47a-467d-bf17-9070a223f3f6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:24:33.542117 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-effb0798-f47a-467d-bf17-9070a223f3f6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:24:33.542858 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-effb0798-f47a-467d-bf17-9070a223f3f6 None admin] RBAC: Authorization granted {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:24:33.559822 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application [None req-effb0798-f47a-467d-bf17-9070a223f3f6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 08:24:33.559822 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:24:33.559822 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:24:33.559822 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:24:33.559822 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:24:33.559822 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:24:33.559822 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:24:33.559822 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:24:33.559822 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:24:33.559822 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:24:33.559822 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:24:33.559822 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:24:33.559822 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 08:24:33.559822 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 08:24:33.559822 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 08:24:33.560993 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 08:24:33.560993 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:24:33.560993 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:24:33.560993 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:24:33.560993 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:24:33.560993 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:24:33.560993 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:24:33.560993 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:24:33.560993 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application with Lock( Jul 28 08:24:33.560993 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:24:33.560993 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:24:33.560993 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:24:33.560993 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:24:33.560993 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:24:33.560993 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:24:33.560993 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:24:33.560993 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:24:33.561931 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 08:24:33.561931 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 08:24:33.561931 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 08:24:33.561931 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application Jul 28 08:24:33.563693 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d849fc5b-675f-43b6-a407-94d59b7ea219 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:24:33.565277 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d849fc5b-675f-43b6-a407-94d59b7ea219 None admin] RBAC: Authorization granted {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:24:33.565878 dv-cinder-851351-1-smb devstack@keystone.service[207600]: [pid: 207600|app: 0|req: 316/627] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 08:24:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:24:33.566969 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-effb0798-f47a-467d-bf17-9070a223f3f6 None admin] Authenticating user token {{(pid=207600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:24:33.680655 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-effb0798-f47a-467d-bf17-9070a223f3f6 None admin] Validating token access rules against request {{(pid=207600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:24:33.689378 dv-cinder-851351-1-smb devstack@keystone.service[207601]: [pid: 207601|app: 0|req: 312/628] 10.222.0.42 () {58 vars in 1282 bytes} [Thu Jul 28 08:24:33 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 376 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 28 08:24:33.689378 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248e9869-7641-49bd-9542-22943055877c None None] REQUEST_METHOD: `GET` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:24:33.689378 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248e9869-7641-49bd-9542-22943055877c None None] SCRIPT_NAME: `/identity` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:24:33.689378 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248e9869-7641-49bd-9542-22943055877c None None] PATH_INFO: `/` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:24:33.692439 dv-cinder-851351-1-smb devstack@keystone.service[207601]: [pid: 207601|app: 0|req: 313/629] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 08:24:33 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 08:24:33.693390 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248e9869-7641-49bd-9542-22943055877c None None] Authenticating user token {{(pid=207601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:24:33.706363 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG dbcounter [-] [207600] Writing DB stats keystone:SELECT=100 {{(pid=207600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:24:33.722362 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc210175-bec7-4ede-a5b4-b029ce35713e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:24:33.723005 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc210175-bec7-4ede-a5b4-b029ce35713e None admin] REQUEST_METHOD: `GET` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:24:33.723288 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc210175-bec7-4ede-a5b4-b029ce35713e None admin] SCRIPT_NAME: `/identity` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:24:33.723565 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc210175-bec7-4ede-a5b4-b029ce35713e None admin] PATH_INFO: `/v3/roles` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:24:33.724311 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc210175-bec7-4ede-a5b4-b029ce35713e None admin] RBAC: Adding query filter params (name=service) {{(pid=207600) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:24:33.724618 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc210175-bec7-4ede-a5b4-b029ce35713e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:24:33.726062 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc210175-bec7-4ede-a5b4-b029ce35713e None admin] RBAC: Authorization granted {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:24:33.739815 dv-cinder-851351-1-smb devstack@keystone.service[207600]: [pid: 207600|app: 0|req: 317/630] 10.222.0.42 () {56 vars in 1103 bytes} [Thu Jul 28 08:24:33 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:24:33.739815 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc210175-bec7-4ede-a5b4-b029ce35713e None admin] Authenticating user token {{(pid=207600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:24:33.758603 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG dbcounter [-] [207601] Writing DB stats keystone:SELECT=100 {{(pid=207601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:24:33.817994 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248e9869-7641-49bd-9542-22943055877c None None] Validating token access rules against request {{(pid=207601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:24:33.846096 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc210175-bec7-4ede-a5b4-b029ce35713e None admin] Validating token access rules against request {{(pid=207600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:24:33.855195 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bef7a9d-5727-4b31-8ef6-ace19e3da72a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:24:33.855844 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bef7a9d-5727-4b31-8ef6-ace19e3da72a None admin] REQUEST_METHOD: `GET` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:24:33.856126 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bef7a9d-5727-4b31-8ef6-ace19e3da72a None admin] SCRIPT_NAME: `/identity` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:24:33.856603 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bef7a9d-5727-4b31-8ef6-ace19e3da72a None admin] PATH_INFO: `/v3/domains` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:24:33.857146 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bef7a9d-5727-4b31-8ef6-ace19e3da72a None admin] RBAC: Adding query filter params (name=Default) {{(pid=207601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:24:33.857459 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bef7a9d-5727-4b31-8ef6-ace19e3da72a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:24:33.858882 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bef7a9d-5727-4b31-8ef6-ace19e3da72a None admin] RBAC: Authorization granted {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:24:33.875755 dv-cinder-851351-1-smb devstack@keystone.service[207601]: [pid: 207601|app: 0|req: 314/631] 10.222.0.42 () {56 vars in 1109 bytes} [Thu Jul 28 08:24:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:24:33.875755 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f474e7a-cd3b-443a-a8cc-83727a94473a None None] REQUEST_METHOD: `POST` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:24:33.875755 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f474e7a-cd3b-443a-a8cc-83727a94473a None None] SCRIPT_NAME: `/identity` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:24:33.875755 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f474e7a-cd3b-443a-a8cc-83727a94473a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:24:33.893192 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.auth.core [None req-6f474e7a-cd3b-443a-a8cc-83727a94473a None None] MFA Rules not processed for user `b8110ade874c4aa7af27f5c376df700a`. Rule list: `[]` (Enabled: `True`). {{(pid=207601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 08:24:33.894415 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.fernet_utils [None req-6f474e7a-cd3b-443a-a8cc-83727a94473a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=207601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:24:33.896168 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d488af2b-63f4-4f68-8c45-d557eb7e24eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:24:33.896874 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d488af2b-63f4-4f68-8c45-d557eb7e24eb None admin] REQUEST_METHOD: `GET` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:24:33.899993 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d488af2b-63f4-4f68-8c45-d557eb7e24eb None admin] SCRIPT_NAME: `/identity` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:24:33.899993 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d488af2b-63f4-4f68-8c45-d557eb7e24eb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:24:33.909346 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d488af2b-63f4-4f68-8c45-d557eb7e24eb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:24:33.910870 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d488af2b-63f4-4f68-8c45-d557eb7e24eb None admin] RBAC: Authorization granted {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:24:33.926412 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application [None req-d488af2b-63f4-4f68-8c45-d557eb7e24eb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 08:24:33.926412 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:24:33.926412 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:24:33.926412 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:24:33.926412 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:24:33.926412 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:24:33.926412 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:24:33.926412 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:24:33.926412 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:24:33.926412 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:24:33.926412 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:24:33.926412 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:24:33.926412 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 08:24:33.926412 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 08:24:33.926412 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 08:24:33.927524 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 08:24:33.927524 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:24:33.927524 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:24:33.927524 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:24:33.927524 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:24:33.927524 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:24:33.927524 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:24:33.927524 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:24:33.927524 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application with Lock( Jul 28 08:24:33.927524 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:24:33.927524 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:24:33.927524 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:24:33.927524 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:24:33.927524 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:24:33.927524 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:24:33.927524 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:24:33.927524 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:24:33.929254 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 08:24:33.929254 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 08:24:33.929254 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 08:24:33.929254 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application Jul 28 08:24:33.929254 dv-cinder-851351-1-smb devstack@keystone.service[207600]: [pid: 207600|app: 0|req: 318/632] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 08:24:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:24:33.929254 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d488af2b-63f4-4f68-8c45-d557eb7e24eb None admin] Authenticating user token {{(pid=207600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:24:33.965526 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG dbcounter [-] [207600] Writing DB stats keystone:SELECT=100 {{(pid=207600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:24:33.992970 dv-cinder-851351-1-smb devstack@keystone.service[207601]: [pid: 207601|app: 0|req: 315/633] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 08:24:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 08:24:33.992970 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f474e7a-cd3b-443a-a8cc-83727a94473a None None] Authenticating user token {{(pid=207601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:24:34.036960 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG dbcounter [-] [207601] Writing DB stats keystone:SELECT=100 {{(pid=207601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:24:34.061437 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d488af2b-63f4-4f68-8c45-d557eb7e24eb None admin] Validating token access rules against request {{(pid=207600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:24:34.099783 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa8ad6f-fe1f-4116-a987-5994845dc956 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:24:34.100607 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa8ad6f-fe1f-4116-a987-5994845dc956 None admin] REQUEST_METHOD: `GET` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:24:34.100923 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa8ad6f-fe1f-4116-a987-5994845dc956 None admin] SCRIPT_NAME: `/identity` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:24:34.101204 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa8ad6f-fe1f-4116-a987-5994845dc956 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:24:34.102253 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f474e7a-cd3b-443a-a8cc-83727a94473a None None] Validating token access rules against request {{(pid=207601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:24:34.114765 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aa8ad6f-fe1f-4116-a987-5994845dc956 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:24:34.116255 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aa8ad6f-fe1f-4116-a987-5994845dc956 None admin] RBAC: Authorization granted {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:24:34.138783 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application [None req-0aa8ad6f-fe1f-4116-a987-5994845dc956 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 08:24:34.138783 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:24:34.138783 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:24:34.138783 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:24:34.138783 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:24:34.138783 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:24:34.138783 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:24:34.138783 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:24:34.138783 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:24:34.138783 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:24:34.138783 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:24:34.138783 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:24:34.138783 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 08:24:34.138783 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 08:24:34.138783 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 08:24:34.139843 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 08:24:34.139843 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:24:34.139843 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:24:34.139843 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:24:34.139843 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:24:34.139843 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:24:34.139843 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:24:34.139843 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:24:34.139843 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application with Lock( Jul 28 08:24:34.139843 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:24:34.139843 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:24:34.139843 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:24:34.139843 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:24:34.139843 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:24:34.139843 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:24:34.139843 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:24:34.139843 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:24:34.140836 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 08:24:34.140836 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 08:24:34.140836 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 08:24:34.140836 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application Jul 28 08:24:34.141093 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55275853-80e0-4f23-af38-0b22fe236178 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:24:34.141093 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55275853-80e0-4f23-af38-0b22fe236178 None admin] REQUEST_METHOD: `GET` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:24:34.141093 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55275853-80e0-4f23-af38-0b22fe236178 None admin] SCRIPT_NAME: `/identity` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:24:34.141093 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55275853-80e0-4f23-af38-0b22fe236178 None admin] PATH_INFO: `/v3/projects/service` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:24:34.141700 dv-cinder-851351-1-smb devstack@keystone.service[207600]: [pid: 207600|app: 0|req: 319/634] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 08:24:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:24:34.143249 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa8ad6f-fe1f-4116-a987-5994845dc956 None admin] Authenticating user token {{(pid=207600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:24:34.153009 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55275853-80e0-4f23-af38-0b22fe236178 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:24:34.154499 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55275853-80e0-4f23-af38-0b22fe236178 None admin] RBAC: Authorization granted {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:24:34.166694 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application [None req-55275853-80e0-4f23-af38-0b22fe236178 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 08:24:34.166694 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:24:34.166694 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:24:34.166694 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:24:34.166694 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:24:34.166694 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:24:34.166694 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:24:34.166694 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:24:34.166694 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:24:34.166694 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:24:34.166694 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:24:34.166694 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:24:34.166694 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 28 08:24:34.166694 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 28 08:24:34.166694 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 28 08:24:34.167720 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 28 08:24:34.167720 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:24:34.167720 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:24:34.167720 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:24:34.167720 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:24:34.167720 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:24:34.167720 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:24:34.167720 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:24:34.167720 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application with Lock( Jul 28 08:24:34.167720 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:24:34.167720 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:24:34.167720 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:24:34.167720 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:24:34.167720 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:24:34.167720 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:24:34.167720 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:24:34.167720 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:24:34.168713 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 28 08:24:34.168713 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 28 08:24:34.168713 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 28 08:24:34.168713 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 28 08:24:34.168713 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 28 08:24:34.168713 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 28 08:24:34.168713 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 08:24:34.168713 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application Jul 28 08:24:34.168713 dv-cinder-851351-1-smb devstack@keystone.service[207601]: [pid: 207601|app: 0|req: 316/635] 10.222.0.42 () {56 vars in 1111 bytes} [Thu Jul 28 08:24:33 2022] GET /identity/v3/projects/service => generated 88 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:24:34.169238 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55275853-80e0-4f23-af38-0b22fe236178 None admin] Authenticating user token {{(pid=207601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:24:34.278028 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG dbcounter [-] [207601] Writing DB stats keystone:SELECT=100 {{(pid=207601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:24:34.278347 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG dbcounter [-] [207600] Writing DB stats keystone:SELECT=100 {{(pid=207600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:24:34.283393 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55275853-80e0-4f23-af38-0b22fe236178 None admin] Validating token access rules against request {{(pid=207601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:24:34.297319 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa8ad6f-fe1f-4116-a987-5994845dc956 None admin] Validating token access rules against request {{(pid=207600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:24:34.322281 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c34327-6e07-4ed5-ae08-ea4ac35551b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:24:34.322962 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c34327-6e07-4ed5-ae08-ea4ac35551b2 None admin] REQUEST_METHOD: `GET` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:24:34.323248 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c34327-6e07-4ed5-ae08-ea4ac35551b2 None admin] SCRIPT_NAME: `/identity` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:24:34.323527 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c34327-6e07-4ed5-ae08-ea4ac35551b2 None admin] PATH_INFO: `/v3/roles/service` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:24:34.334412 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e91d0d-b0be-4ef6-bc90-b96625a5b82a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:24:34.335050 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e91d0d-b0be-4ef6-bc90-b96625a5b82a None admin] REQUEST_METHOD: `GET` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:24:34.335325 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e91d0d-b0be-4ef6-bc90-b96625a5b82a None admin] SCRIPT_NAME: `/identity` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:24:34.335600 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e91d0d-b0be-4ef6-bc90-b96625a5b82a None admin] PATH_INFO: `/v3/domains` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:24:34.335839 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62c34327-6e07-4ed5-ae08-ea4ac35551b2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 08:24:34.336316 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8e91d0d-b0be-4ef6-bc90-b96625a5b82a None admin] RBAC: Adding query filter params (name=Default) {{(pid=207600) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:24:34.336628 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8e91d0d-b0be-4ef6-bc90-b96625a5b82a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:24:34.338504 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8e91d0d-b0be-4ef6-bc90-b96625a5b82a None admin] RBAC: Authorization granted {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:24:34.341477 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application [None req-62c34327-6e07-4ed5-ae08-ea4ac35551b2 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 28 08:24:34.341477 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:24:34.341477 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:24:34.341477 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:24:34.341477 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:24:34.341477 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:24:34.341477 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:24:34.341477 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:24:34.341477 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:24:34.341477 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:24:34.341477 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:24:34.341477 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:24:34.341477 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 08:24:34.341477 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 08:24:34.341477 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 08:24:34.341477 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 08:24:34.342581 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 08:24:34.342581 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 08:24:34.342581 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 08:24:34.342581 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 08:24:34.342581 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:24:34.342581 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:24:34.342581 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:24:34.342581 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:24:34.342581 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:24:34.342581 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:24:34.342581 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:24:34.342581 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application with Lock( Jul 28 08:24:34.342581 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:24:34.342581 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:24:34.342581 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:24:34.342581 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:24:34.343467 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:24:34.343467 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:24:34.343467 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:24:34.343467 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:24:34.343467 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 08:24:34.343467 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 08:24:34.343467 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 08:24:34.343467 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 08:24:34.343467 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 08:24:34.343467 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 08:24:34.343467 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 28 08:24:34.343467 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application Jul 28 08:24:34.343467 dv-cinder-851351-1-smb devstack@keystone.service[207601]: [pid: 207601|app: 0|req: 317/636] 10.222.0.42 () {56 vars in 1102 bytes} [Thu Jul 28 08:24:34 2022] GET /identity/v3/roles/service => generated 85 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:24:34.344743 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c34327-6e07-4ed5-ae08-ea4ac35551b2 None admin] Authenticating user token {{(pid=207601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:24:34.355425 dv-cinder-851351-1-smb devstack@keystone.service[207600]: [pid: 207600|app: 0|req: 320/637] 10.222.0.42 () {56 vars in 1109 bytes} [Thu Jul 28 08:24:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:24:34.356323 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e91d0d-b0be-4ef6-bc90-b96625a5b82a None admin] Authenticating user token {{(pid=207600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:24:34.471539 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c34327-6e07-4ed5-ae08-ea4ac35551b2 None admin] Validating token access rules against request {{(pid=207601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:24:34.472940 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e91d0d-b0be-4ef6-bc90-b96625a5b82a None admin] Validating token access rules against request {{(pid=207600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:24:34.509786 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0209a3da-c1f1-4885-8de5-0476a5e6461f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:24:34.510253 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d3f8335-a4fa-4d02-9921-0e7b510235de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:24:34.510484 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0209a3da-c1f1-4885-8de5-0476a5e6461f None admin] REQUEST_METHOD: `GET` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:24:34.510771 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0209a3da-c1f1-4885-8de5-0476a5e6461f None admin] SCRIPT_NAME: `/identity` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:24:34.510896 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3f8335-a4fa-4d02-9921-0e7b510235de None admin] REQUEST_METHOD: `GET` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:24:34.511052 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0209a3da-c1f1-4885-8de5-0476a5e6461f None admin] PATH_INFO: `/v3/projects` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:24:34.511158 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3f8335-a4fa-4d02-9921-0e7b510235de None admin] SCRIPT_NAME: `/identity` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:24:34.511472 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3f8335-a4fa-4d02-9921-0e7b510235de None admin] PATH_INFO: `/v3/domains` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:24:34.511824 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0209a3da-c1f1-4885-8de5-0476a5e6461f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=207600) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:24:34.512138 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d3f8335-a4fa-4d02-9921-0e7b510235de None admin] RBAC: Adding query filter params (name=Default) {{(pid=207601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:24:34.512252 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0209a3da-c1f1-4885-8de5-0476a5e6461f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:24:34.512447 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d3f8335-a4fa-4d02-9921-0e7b510235de None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:24:34.513643 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0209a3da-c1f1-4885-8de5-0476a5e6461f None admin] RBAC: Authorization granted {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:24:34.513876 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d3f8335-a4fa-4d02-9921-0e7b510235de None admin] RBAC: Authorization granted {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:24:34.531405 dv-cinder-851351-1-smb devstack@keystone.service[207600]: [pid: 207600|app: 0|req: 321/638] 10.222.0.42 () {56 vars in 1148 bytes} [Thu Jul 28 08:24:34 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:24:34.531613 dv-cinder-851351-1-smb devstack@keystone.service[207601]: [pid: 207601|app: 0|req: 318/639] 10.222.0.42 () {56 vars in 1109 bytes} [Thu Jul 28 08:24:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:24:34.531613 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d3f8335-a4fa-4d02-9921-0e7b510235de None admin] Authenticating user token {{(pid=207601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:24:34.531757 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0209a3da-c1f1-4885-8de5-0476a5e6461f None admin] Authenticating user token {{(pid=207600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:24:34.535589 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG dbcounter [-] [207600] Writing DB stats keystone:SELECT=100 {{(pid=207600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:24:34.551641 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG dbcounter [-] [207601] Writing DB stats keystone:SELECT=100 {{(pid=207601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:24:34.632003 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d3f8335-a4fa-4d02-9921-0e7b510235de None admin] Validating token access rules against request {{(pid=207601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:24:34.637455 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0209a3da-c1f1-4885-8de5-0476a5e6461f None admin] Validating token access rules against request {{(pid=207600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:24:34.668695 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879a969d-75d4-4b53-a694-2f51c13c892f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:24:34.669351 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879a969d-75d4-4b53-a694-2f51c13c892f None admin] REQUEST_METHOD: `GET` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:24:34.669634 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879a969d-75d4-4b53-a694-2f51c13c892f None admin] SCRIPT_NAME: `/identity` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:24:34.669904 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879a969d-75d4-4b53-a694-2f51c13c892f None admin] PATH_INFO: `/v3/projects/service` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:24:34.672119 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a9e2c37-fd3f-4332-983d-906b58c5426a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:24:34.672877 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9e2c37-fd3f-4332-983d-906b58c5426a None admin] REQUEST_METHOD: `GET` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:24:34.673164 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9e2c37-fd3f-4332-983d-906b58c5426a None admin] SCRIPT_NAME: `/identity` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:24:34.673443 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9e2c37-fd3f-4332-983d-906b58c5426a None admin] PATH_INFO: `/v3/roles` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:24:34.674187 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a9e2c37-fd3f-4332-983d-906b58c5426a None admin] RBAC: Adding query filter params (name=service) {{(pid=207600) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:24:34.674494 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a9e2c37-fd3f-4332-983d-906b58c5426a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:24:34.675898 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a9e2c37-fd3f-4332-983d-906b58c5426a None admin] RBAC: Authorization granted {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:24:34.677068 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-879a969d-75d4-4b53-a694-2f51c13c892f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:24:34.678552 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-879a969d-75d4-4b53-a694-2f51c13c892f None admin] RBAC: Authorization granted {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:24:34.684993 dv-cinder-851351-1-smb devstack@keystone.service[207600]: [pid: 207600|app: 0|req: 322/640] 10.222.0.42 () {56 vars in 1103 bytes} [Thu Jul 28 08:24:34 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:24:34.686310 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c102df9e-edb8-4214-9e93-b0bc01a6dae4 None None] REQUEST_METHOD: `GET` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:24:34.686602 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c102df9e-edb8-4214-9e93-b0bc01a6dae4 None None] SCRIPT_NAME: `/identity` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:24:34.686885 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c102df9e-edb8-4214-9e93-b0bc01a6dae4 None None] PATH_INFO: `/` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:24:34.690094 dv-cinder-851351-1-smb devstack@keystone.service[207600]: [pid: 207600|app: 0|req: 323/641] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 08:24:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 08:24:34.690094 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c102df9e-edb8-4214-9e93-b0bc01a6dae4 None None] Authenticating user token {{(pid=207600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:24:34.691261 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application [None req-879a969d-75d4-4b53-a694-2f51c13c892f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 08:24:34.691261 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:24:34.691261 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:24:34.691261 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:24:34.691261 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:24:34.691261 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:24:34.691261 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:24:34.691261 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:24:34.691261 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:24:34.691261 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:24:34.691261 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:24:34.691261 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:24:34.691261 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 28 08:24:34.691261 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 28 08:24:34.691261 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 28 08:24:34.692739 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 28 08:24:34.692739 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:24:34.692739 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:24:34.692739 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:24:34.692739 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:24:34.692739 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:24:34.692739 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:24:34.692739 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:24:34.692739 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application with Lock( Jul 28 08:24:34.692739 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:24:34.692739 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:24:34.692739 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:24:34.692739 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:24:34.692739 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:24:34.692739 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:24:34.692739 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:24:34.692739 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:24:34.693982 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 28 08:24:34.693982 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 28 08:24:34.693982 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 28 08:24:34.693982 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 28 08:24:34.693982 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 28 08:24:34.693982 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 28 08:24:34.693982 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 08:24:34.693982 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application Jul 28 08:24:34.696937 dv-cinder-851351-1-smb devstack@keystone.service[207601]: [pid: 207601|app: 0|req: 319/642] 10.222.0.42 () {56 vars in 1111 bytes} [Thu Jul 28 08:24:34 2022] GET /identity/v3/projects/service => generated 88 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:24:34.698200 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879a969d-75d4-4b53-a694-2f51c13c892f None admin] Authenticating user token {{(pid=207601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:24:34.761035 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG dbcounter [-] [207600] Writing DB stats keystone:SELECT=100 {{(pid=207600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:24:34.783301 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG dbcounter [-] [207601] Writing DB stats keystone:SELECT=100 {{(pid=207601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:24:34.800777 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c102df9e-edb8-4214-9e93-b0bc01a6dae4 None None] Validating token access rules against request {{(pid=207600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:24:34.811162 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879a969d-75d4-4b53-a694-2f51c13c892f None admin] Validating token access rules against request {{(pid=207601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:24:34.837136 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e969b6cc-7d44-4b1a-9060-4cfc5711bad7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:24:34.838246 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e969b6cc-7d44-4b1a-9060-4cfc5711bad7 None admin] REQUEST_METHOD: `GET` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:24:34.838571 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e969b6cc-7d44-4b1a-9060-4cfc5711bad7 None admin] SCRIPT_NAME: `/identity` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:24:34.838892 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e969b6cc-7d44-4b1a-9060-4cfc5711bad7 None admin] PATH_INFO: `/v3/users/glance` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:24:34.847802 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e969b6cc-7d44-4b1a-9060-4cfc5711bad7 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:24:34.849362 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e969b6cc-7d44-4b1a-9060-4cfc5711bad7 None admin] RBAC: Authorization granted {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:24:34.858202 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f0b038-94bd-4790-8069-095d030faf19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:24:34.858880 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f0b038-94bd-4790-8069-095d030faf19 None admin] REQUEST_METHOD: `PUT` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:24:34.859159 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f0b038-94bd-4790-8069-095d030faf19 None admin] SCRIPT_NAME: `/identity` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:24:34.859429 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f0b038-94bd-4790-8069-095d030faf19 None admin] PATH_INFO: `/v3/projects/48c5f2b2ae2b48758b957d2b194a7fd1/users/96e9a6a7c6ea4047a5d8e16babbdeb70/roles/b44e7c7aeec24f51b8033df305da133d` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:24:34.861525 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application [None req-e969b6cc-7d44-4b1a-9060-4cfc5711bad7 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jul 28 08:24:34.861525 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:24:34.861525 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:24:34.861525 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:24:34.861525 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:24:34.861525 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:24:34.861525 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:24:34.861525 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:24:34.861525 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:24:34.861525 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:24:34.861525 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:24:34.861525 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:24:34.861525 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 28 08:24:34.861525 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 28 08:24:34.861525 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 28 08:24:34.861525 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 28 08:24:34.862757 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:24:34.862757 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:24:34.862757 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 28 08:24:34.862757 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 08:24:34.862757 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 28 08:24:34.862757 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 08:24:34.862757 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:24:34.862757 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:24:34.862757 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:24:34.862757 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:24:34.862757 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:24:34.862757 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application with Lock( Jul 28 08:24:34.862757 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:24:34.862757 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:24:34.862757 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:24:34.862757 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:24:34.862757 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:24:34.862757 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:24:34.864074 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:24:34.864074 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:24:34.864074 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 28 08:24:34.864074 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 28 08:24:34.864074 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 28 08:24:34.864074 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 28 08:24:34.864074 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 28 08:24:34.864074 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 28 08:24:34.864074 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jul 28 08:24:34.864074 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application Jul 28 08:24:34.864074 dv-cinder-851351-1-smb devstack@keystone.service[207600]: [pid: 207600|app: 0|req: 324/643] 10.222.0.42 () {56 vars in 1099 bytes} [Thu Jul 28 08:24:34 2022] GET /identity/v3/users/glance => generated 84 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:24:34.864074 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e969b6cc-7d44-4b1a-9060-4cfc5711bad7 None admin] Authenticating user token {{(pid=207600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:24:34.877959 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43f0b038-94bd-4790-8069-095d030faf19 None admin] RBAC: Authorizing `identity:create_grant(project_id=48c5f2b2ae2b48758b957d2b194a7fd1, user_id=96e9a6a7c6ea4047a5d8e16babbdeb70, role_id=b44e7c7aeec24f51b8033df305da133d)` {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:24:34.883266 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43f0b038-94bd-4790-8069-095d030faf19 None admin] RBAC: Authorization granted {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:24:34.895489 dv-cinder-851351-1-smb devstack@keystone.service[207601]: [pid: 207601|app: 0|req: 320/644] 10.222.0.42 () {58 vars in 1439 bytes} [Thu Jul 28 08:24:34 2022] PUT /identity/v3/projects/48c5f2b2ae2b48758b957d2b194a7fd1/users/96e9a6a7c6ea4047a5d8e16babbdeb70/roles/b44e7c7aeec24f51b8033df305da133d => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 08:24:34.896975 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5241ef2-9e99-4db3-89a3-b863779ae1de None None] REQUEST_METHOD: `POST` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:24:34.897323 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5241ef2-9e99-4db3-89a3-b863779ae1de None None] SCRIPT_NAME: `/identity` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:24:34.897609 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5241ef2-9e99-4db3-89a3-b863779ae1de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:24:34.919761 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.auth.core [None req-e5241ef2-9e99-4db3-89a3-b863779ae1de None None] MFA Rules not processed for user `b8110ade874c4aa7af27f5c376df700a`. Rule list: `[]` (Enabled: `True`). {{(pid=207601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 08:24:34.921096 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.fernet_utils [None req-e5241ef2-9e99-4db3-89a3-b863779ae1de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=207601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:24:34.997311 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e969b6cc-7d44-4b1a-9060-4cfc5711bad7 None admin] Validating token access rules against request {{(pid=207600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:24:35.005773 dv-cinder-851351-1-smb devstack@keystone.service[207601]: [pid: 207601|app: 0|req: 321/645] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 08:24:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 08:24:35.007142 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5241ef2-9e99-4db3-89a3-b863779ae1de None None] Authenticating user token {{(pid=207601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:24:35.050563 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG dbcounter [-] [207600] Writing DB stats keystone:SELECT=100 {{(pid=207600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:24:35.066134 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1330e9a0-ac50-4ce7-ab6c-7d2b650b7168 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:24:35.066134 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1330e9a0-ac50-4ce7-ab6c-7d2b650b7168 None admin] REQUEST_METHOD: `GET` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:24:35.066134 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1330e9a0-ac50-4ce7-ab6c-7d2b650b7168 None admin] SCRIPT_NAME: `/identity` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:24:35.066538 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1330e9a0-ac50-4ce7-ab6c-7d2b650b7168 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:24:35.081902 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1330e9a0-ac50-4ce7-ab6c-7d2b650b7168 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:24:35.084109 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1330e9a0-ac50-4ce7-ab6c-7d2b650b7168 None admin] RBAC: Authorization granted {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:24:35.098042 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG dbcounter [-] [207601] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=207601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:24:35.105073 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application [None req-1330e9a0-ac50-4ce7-ab6c-7d2b650b7168 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 08:24:35.105073 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:24:35.105073 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:24:35.105073 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:24:35.105073 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:24:35.105073 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:24:35.105073 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:24:35.105073 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:24:35.105073 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:24:35.105073 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:24:35.105073 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:24:35.105073 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:24:35.105073 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 08:24:35.105073 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 08:24:35.105073 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 08:24:35.106534 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 08:24:35.106534 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:24:35.106534 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:24:35.106534 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:24:35.106534 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:24:35.106534 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:24:35.106534 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:24:35.106534 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:24:35.106534 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application with Lock( Jul 28 08:24:35.106534 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:24:35.106534 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:24:35.106534 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:24:35.106534 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:24:35.106534 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:24:35.106534 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:24:35.106534 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:24:35.106534 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:24:35.107679 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 08:24:35.107679 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 08:24:35.107679 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 08:24:35.107679 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application Jul 28 08:24:35.108171 dv-cinder-851351-1-smb devstack@keystone.service[207600]: [pid: 207600|app: 0|req: 325/646] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 08:24:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 244 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:24:35.113338 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1330e9a0-ac50-4ce7-ab6c-7d2b650b7168 None admin] Authenticating user token {{(pid=207600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:24:35.156558 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5241ef2-9e99-4db3-89a3-b863779ae1de None None] Validating token access rules against request {{(pid=207601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:24:35.206437 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e6fcbb0-cfa0-401e-bc08-3f8d0c984e86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:24:35.207277 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6fcbb0-cfa0-401e-bc08-3f8d0c984e86 None admin] REQUEST_METHOD: `GET` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:24:35.207755 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6fcbb0-cfa0-401e-bc08-3f8d0c984e86 None admin] SCRIPT_NAME: `/identity` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:24:35.208126 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6fcbb0-cfa0-401e-bc08-3f8d0c984e86 None admin] PATH_INFO: `/v3/projects` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:24:35.209225 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e6fcbb0-cfa0-401e-bc08-3f8d0c984e86 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=207601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:24:35.209590 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e6fcbb0-cfa0-401e-bc08-3f8d0c984e86 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:24:35.211204 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e6fcbb0-cfa0-401e-bc08-3f8d0c984e86 None admin] RBAC: Authorization granted {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:24:35.234061 dv-cinder-851351-1-smb devstack@keystone.service[207601]: [pid: 207601|app: 0|req: 322/647] 10.222.0.42 () {56 vars in 1148 bytes} [Thu Jul 28 08:24:35 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:24:35.235755 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e6fcbb0-cfa0-401e-bc08-3f8d0c984e86 None admin] Authenticating user token {{(pid=207601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:24:35.271570 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1330e9a0-ac50-4ce7-ab6c-7d2b650b7168 None admin] Validating token access rules against request {{(pid=207600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:24:35.316493 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d65786ec-3209-4777-903c-467a81c18fbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:24:35.317090 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65786ec-3209-4777-903c-467a81c18fbc None admin] REQUEST_METHOD: `GET` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:24:35.317382 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65786ec-3209-4777-903c-467a81c18fbc None admin] SCRIPT_NAME: `/identity` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:24:35.317640 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65786ec-3209-4777-903c-467a81c18fbc None admin] PATH_INFO: `/v3/users` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:24:35.318479 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d65786ec-3209-4777-903c-467a81c18fbc None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=207600) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:24:35.318787 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d65786ec-3209-4777-903c-467a81c18fbc None admin] RBAC: Authorizing `identity:list_users()` {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:24:35.320266 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d65786ec-3209-4777-903c-467a81c18fbc None admin] RBAC: Authorization granted {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:24:35.345949 dv-cinder-851351-1-smb devstack@keystone.service[207600]: [pid: 207600|app: 0|req: 326/648] 10.222.0.42 () {56 vars in 1137 bytes} [Thu Jul 28 08:24:35 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:24:35.346964 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d65786ec-3209-4777-903c-467a81c18fbc None admin] Authenticating user token {{(pid=207600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:24:35.367400 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e6fcbb0-cfa0-401e-bc08-3f8d0c984e86 None admin] Validating token access rules against request {{(pid=207601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:24:35.393844 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG dbcounter [-] [207600] Writing DB stats keystone:SELECT=100 {{(pid=207600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:24:35.397333 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG dbcounter [-] [207601] Writing DB stats keystone:SELECT=100 {{(pid=207601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:24:35.421987 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43915cc7-c053-4e57-8493-3b120e3574ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:24:35.423055 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43915cc7-c053-4e57-8493-3b120e3574ac None admin] REQUEST_METHOD: `GET` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:24:35.423411 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43915cc7-c053-4e57-8493-3b120e3574ac None admin] SCRIPT_NAME: `/identity` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:24:35.424033 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43915cc7-c053-4e57-8493-3b120e3574ac None admin] PATH_INFO: `/v3/roles/service` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:24:35.436028 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43915cc7-c053-4e57-8493-3b120e3574ac None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 08:24:35.441748 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application [None req-43915cc7-c053-4e57-8493-3b120e3574ac None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 28 08:24:35.441748 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:24:35.441748 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:24:35.441748 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:24:35.441748 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:24:35.441748 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:24:35.441748 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:24:35.441748 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:24:35.441748 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:24:35.441748 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:24:35.441748 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:24:35.441748 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:24:35.441748 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 08:24:35.441748 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 08:24:35.441748 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 08:24:35.441748 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 08:24:35.442768 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 08:24:35.442768 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 08:24:35.442768 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 08:24:35.442768 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 08:24:35.442768 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:24:35.442768 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:24:35.442768 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:24:35.442768 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:24:35.442768 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:24:35.442768 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:24:35.442768 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:24:35.442768 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application with Lock( Jul 28 08:24:35.442768 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:24:35.442768 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:24:35.442768 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:24:35.442768 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:24:35.443672 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:24:35.443672 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:24:35.443672 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:24:35.443672 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:24:35.443672 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 08:24:35.443672 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 08:24:35.443672 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 08:24:35.443672 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 08:24:35.443672 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 08:24:35.443672 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 08:24:35.443672 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 28 08:24:35.443672 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application Jul 28 08:24:35.443672 dv-cinder-851351-1-smb devstack@keystone.service[207601]: [pid: 207601|app: 0|req: 323/649] 10.222.0.42 () {56 vars in 1102 bytes} [Thu Jul 28 08:24:35 2022] GET /identity/v3/roles/service => generated 85 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:24:35.444430 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43915cc7-c053-4e57-8493-3b120e3574ac None admin] Authenticating user token {{(pid=207601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:24:35.492729 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d65786ec-3209-4777-903c-467a81c18fbc None admin] Validating token access rules against request {{(pid=207600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:24:35.532415 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ef963b-8504-45e1-bea3-16112483f042 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:24:35.533075 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ef963b-8504-45e1-bea3-16112483f042 None admin] REQUEST_METHOD: `GET` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:24:35.533359 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ef963b-8504-45e1-bea3-16112483f042 None admin] SCRIPT_NAME: `/identity` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:24:35.533716 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ef963b-8504-45e1-bea3-16112483f042 None admin] PATH_INFO: `/v3/domains` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:24:35.534475 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5ef963b-8504-45e1-bea3-16112483f042 None admin] RBAC: Adding query filter params (name=Default) {{(pid=207600) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:24:35.534778 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5ef963b-8504-45e1-bea3-16112483f042 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:24:35.536192 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5ef963b-8504-45e1-bea3-16112483f042 None admin] RBAC: Authorization granted {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:24:35.548299 dv-cinder-851351-1-smb devstack@keystone.service[207600]: [pid: 207600|app: 0|req: 327/650] 10.222.0.42 () {56 vars in 1109 bytes} [Thu Jul 28 08:24:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:24:35.549237 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ef963b-8504-45e1-bea3-16112483f042 None admin] Authenticating user token {{(pid=207600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:24:35.563396 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43915cc7-c053-4e57-8493-3b120e3574ac None admin] Validating token access rules against request {{(pid=207601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:24:35.601607 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02af6105-2b6d-460a-b66b-21c27c3941df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:24:35.602214 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02af6105-2b6d-460a-b66b-21c27c3941df None admin] REQUEST_METHOD: `GET` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:24:35.602487 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02af6105-2b6d-460a-b66b-21c27c3941df None admin] SCRIPT_NAME: `/identity` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:24:35.602789 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02af6105-2b6d-460a-b66b-21c27c3941df None admin] PATH_INFO: `/v3/role_assignments` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:24:35.603559 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02af6105-2b6d-460a-b66b-21c27c3941df None admin] RBAC: Adding query filter params (role.id=b44e7c7aeec24f51b8033df305da133d, scope.project.id=48c5f2b2ae2b48758b957d2b194a7fd1, user.id=03804b1369934a7692da4d5646465bdc) {{(pid=207601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:24:35.603951 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02af6105-2b6d-460a-b66b-21c27c3941df None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:24:35.605474 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02af6105-2b6d-460a-b66b-21c27c3941df None admin] RBAC: Authorization granted {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:24:35.611786 dv-cinder-851351-1-smb devstack@keystone.service[207601]: [pid: 207601|app: 0|req: 324/651] 10.222.0.42 () {56 vars in 1374 bytes} [Thu Jul 28 08:24:35 2022] GET /identity/v3/role_assignments?user.id=03804b1369934a7692da4d5646465bdc&scope.project.id=48c5f2b2ae2b48758b957d2b194a7fd1&role.id=b44e7c7aeec24f51b8033df305da133d => generated 608 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:24:35.621818 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02af6105-2b6d-460a-b66b-21c27c3941df None admin] Authenticating user token {{(pid=207601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:24:35.658578 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG dbcounter [-] [207600] Writing DB stats keystone:SELECT=100 {{(pid=207600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:24:35.666375 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ef963b-8504-45e1-bea3-16112483f042 None admin] Validating token access rules against request {{(pid=207600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:24:35.699500 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG dbcounter [-] [207601] Writing DB stats keystone:SELECT=100 {{(pid=207601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:24:35.711305 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366e548e-8f14-4dda-8c3f-b3e300e8a6f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:24:35.712320 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366e548e-8f14-4dda-8c3f-b3e300e8a6f3 None admin] REQUEST_METHOD: `GET` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:24:35.713277 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366e548e-8f14-4dda-8c3f-b3e300e8a6f3 None admin] SCRIPT_NAME: `/identity` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:24:35.713731 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366e548e-8f14-4dda-8c3f-b3e300e8a6f3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:24:35.791985 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02af6105-2b6d-460a-b66b-21c27c3941df None admin] Validating token access rules against request {{(pid=207601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:24:35.799363 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-366e548e-8f14-4dda-8c3f-b3e300e8a6f3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:24:35.801373 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-366e548e-8f14-4dda-8c3f-b3e300e8a6f3 None admin] RBAC: Authorization granted {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:24:35.842580 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a45f210e-01ea-4be2-8d94-85e960b1e77c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:24:35.843463 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45f210e-01ea-4be2-8d94-85e960b1e77c None admin] REQUEST_METHOD: `GET` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:24:35.843594 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45f210e-01ea-4be2-8d94-85e960b1e77c None admin] SCRIPT_NAME: `/identity` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:24:35.843817 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45f210e-01ea-4be2-8d94-85e960b1e77c None admin] PATH_INFO: `/v3/roles` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:24:35.844495 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a45f210e-01ea-4be2-8d94-85e960b1e77c None admin] RBAC: Adding query filter params (name=service) {{(pid=207601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:24:35.844899 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a45f210e-01ea-4be2-8d94-85e960b1e77c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:24:35.846291 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a45f210e-01ea-4be2-8d94-85e960b1e77c None admin] RBAC: Authorization granted {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:24:35.855710 dv-cinder-851351-1-smb devstack@keystone.service[207601]: [pid: 207601|app: 0|req: 325/652] 10.222.0.42 () {56 vars in 1103 bytes} [Thu Jul 28 08:24:35 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:24:35.856639 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a45f210e-01ea-4be2-8d94-85e960b1e77c None admin] Authenticating user token {{(pid=207601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:24:35.948627 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG dbcounter [-] [207600] Writing DB stats keystone:SELECT=100 {{(pid=207600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:24:35.956715 dv-cinder-851351-1-smb devstack@keystone.service[207600]: [pid: 207600|app: 0|req: 328/653] 10.222.0.42 () {58 vars in 1282 bytes} [Thu Jul 28 08:24:35 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 408 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 28 08:24:35.957907 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366e548e-8f14-4dda-8c3f-b3e300e8a6f3 None admin] Authenticating user token {{(pid=207600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:24:35.992260 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a45f210e-01ea-4be2-8d94-85e960b1e77c None admin] Validating token access rules against request {{(pid=207601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:24:36.000608 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG dbcounter [-] [207601] Writing DB stats keystone:SELECT=100 {{(pid=207601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:24:36.038292 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8839f5d-ee47-4888-b581-8c6094c85c02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:24:36.039269 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8839f5d-ee47-4888-b581-8c6094c85c02 None admin] REQUEST_METHOD: `GET` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:24:36.039728 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8839f5d-ee47-4888-b581-8c6094c85c02 None admin] SCRIPT_NAME: `/identity` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:24:36.040157 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8839f5d-ee47-4888-b581-8c6094c85c02 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:24:36.051187 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8839f5d-ee47-4888-b581-8c6094c85c02 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:24:36.052687 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8839f5d-ee47-4888-b581-8c6094c85c02 None admin] RBAC: Authorization granted {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:24:36.065966 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application [None req-b8839f5d-ee47-4888-b581-8c6094c85c02 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jul 28 08:24:36.065966 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:24:36.065966 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:24:36.065966 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:24:36.065966 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:24:36.065966 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:24:36.065966 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:24:36.065966 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:24:36.065966 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:24:36.065966 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:24:36.065966 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:24:36.065966 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:24:36.065966 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 28 08:24:36.065966 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 28 08:24:36.065966 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 28 08:24:36.065966 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 28 08:24:36.067281 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:24:36.067281 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:24:36.067281 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 28 08:24:36.067281 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 08:24:36.067281 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 28 08:24:36.067281 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 08:24:36.067281 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:24:36.067281 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:24:36.067281 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:24:36.067281 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:24:36.067281 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:24:36.067281 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application with Lock( Jul 28 08:24:36.067281 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:24:36.067281 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:24:36.067281 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:24:36.067281 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:24:36.067281 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:24:36.067281 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:24:36.068519 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:24:36.068519 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:24:36.068519 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 28 08:24:36.068519 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 28 08:24:36.068519 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 28 08:24:36.068519 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 28 08:24:36.068519 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 28 08:24:36.068519 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 28 08:24:36.068519 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jul 28 08:24:36.068519 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application Jul 28 08:24:36.068519 dv-cinder-851351-1-smb devstack@keystone.service[207601]: [pid: 207601|app: 0|req: 326/654] 10.222.0.42 () {56 vars in 1099 bytes} [Thu Jul 28 08:24:35 2022] GET /identity/v3/users/cinder => generated 84 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:24:36.070077 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8839f5d-ee47-4888-b581-8c6094c85c02 None admin] Authenticating user token {{(pid=207601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:24:36.079889 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366e548e-8f14-4dda-8c3f-b3e300e8a6f3 None admin] Validating token access rules against request {{(pid=207600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:24:36.129830 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca671f8-960f-495a-ac89-b19cbe2dd6cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:24:36.130888 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca671f8-960f-495a-ac89-b19cbe2dd6cd None admin] REQUEST_METHOD: `GET` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:24:36.131335 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca671f8-960f-495a-ac89-b19cbe2dd6cd None admin] SCRIPT_NAME: `/identity` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:24:36.131917 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca671f8-960f-495a-ac89-b19cbe2dd6cd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:24:36.146831 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ca671f8-960f-495a-ac89-b19cbe2dd6cd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:24:36.149412 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ca671f8-960f-495a-ac89-b19cbe2dd6cd None admin] RBAC: Authorization granted {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:24:36.167525 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application [None req-9ca671f8-960f-495a-ac89-b19cbe2dd6cd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 08:24:36.167525 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:24:36.167525 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:24:36.167525 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:24:36.167525 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:24:36.167525 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:24:36.167525 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:24:36.167525 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:24:36.167525 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:24:36.167525 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:24:36.167525 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:24:36.167525 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:24:36.167525 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 08:24:36.167525 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 08:24:36.167525 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 08:24:36.169404 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 08:24:36.169404 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:24:36.169404 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:24:36.169404 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:24:36.169404 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:24:36.169404 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:24:36.169404 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:24:36.169404 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:24:36.169404 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application with Lock( Jul 28 08:24:36.169404 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:24:36.169404 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:24:36.169404 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:24:36.169404 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:24:36.169404 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:24:36.169404 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:24:36.169404 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:24:36.169404 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:24:36.171513 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 08:24:36.171513 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 08:24:36.171513 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 08:24:36.171513 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application Jul 28 08:24:36.175395 dv-cinder-851351-1-smb devstack@keystone.service[207600]: [pid: 207600|app: 0|req: 329/655] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 08:24:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:24:36.178481 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca671f8-960f-495a-ac89-b19cbe2dd6cd None admin] Authenticating user token {{(pid=207600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:24:36.189819 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8839f5d-ee47-4888-b581-8c6094c85c02 None admin] Validating token access rules against request {{(pid=207601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:24:36.231331 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de077c2b-0d42-496c-9450-095f621e250c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:24:36.233624 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de077c2b-0d42-496c-9450-095f621e250c None admin] REQUEST_METHOD: `GET` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:24:36.234923 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de077c2b-0d42-496c-9450-095f621e250c None admin] SCRIPT_NAME: `/identity` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:24:36.235745 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de077c2b-0d42-496c-9450-095f621e250c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:24:36.252494 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de077c2b-0d42-496c-9450-095f621e250c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:24:36.254410 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de077c2b-0d42-496c-9450-095f621e250c None admin] RBAC: Authorization granted {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:24:36.272285 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application [None req-de077c2b-0d42-496c-9450-095f621e250c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 08:24:36.272285 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:24:36.272285 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:24:36.272285 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:24:36.272285 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:24:36.272285 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:24:36.272285 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:24:36.272285 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:24:36.272285 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:24:36.272285 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:24:36.272285 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:24:36.272285 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:24:36.272285 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 08:24:36.272285 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 08:24:36.272285 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 08:24:36.273561 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 08:24:36.273561 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:24:36.273561 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:24:36.273561 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:24:36.273561 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:24:36.273561 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:24:36.273561 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:24:36.273561 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:24:36.273561 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application with Lock( Jul 28 08:24:36.273561 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:24:36.273561 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:24:36.273561 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:24:36.273561 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:24:36.273561 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:24:36.273561 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:24:36.273561 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:24:36.273561 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:24:36.274616 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 08:24:36.274616 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 08:24:36.274616 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 08:24:36.274616 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application Jul 28 08:24:36.276555 dv-cinder-851351-1-smb devstack@keystone.service[207601]: [pid: 207601|app: 0|req: 327/656] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 08:24:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:24:36.277977 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de077c2b-0d42-496c-9450-095f621e250c None admin] Authenticating user token {{(pid=207601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:24:36.290083 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG dbcounter [-] [207600] Writing DB stats keystone:SELECT=100 {{(pid=207600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:24:36.309515 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG dbcounter [-] [207601] Writing DB stats keystone:SELECT=100 {{(pid=207601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:24:36.361602 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca671f8-960f-495a-ac89-b19cbe2dd6cd None admin] Validating token access rules against request {{(pid=207600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:24:36.398441 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-808d3bc6-3614-4e11-bcc7-6fc9ff0bf060 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:24:36.399352 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808d3bc6-3614-4e11-bcc7-6fc9ff0bf060 None admin] REQUEST_METHOD: `GET` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:24:36.399806 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808d3bc6-3614-4e11-bcc7-6fc9ff0bf060 None admin] SCRIPT_NAME: `/identity` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:24:36.400241 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808d3bc6-3614-4e11-bcc7-6fc9ff0bf060 None admin] PATH_INFO: `/v3/users` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:24:36.401764 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-808d3bc6-3614-4e11-bcc7-6fc9ff0bf060 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=207600) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:24:36.402268 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-808d3bc6-3614-4e11-bcc7-6fc9ff0bf060 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:24:36.404002 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-808d3bc6-3614-4e11-bcc7-6fc9ff0bf060 None admin] RBAC: Authorization granted {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:24:36.424049 dv-cinder-851351-1-smb devstack@keystone.service[207600]: [pid: 207600|app: 0|req: 330/657] 10.222.0.42 () {56 vars in 1137 bytes} [Thu Jul 28 08:24:36 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:24:36.425338 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-808d3bc6-3614-4e11-bcc7-6fc9ff0bf060 None admin] Authenticating user token {{(pid=207600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:24:36.469821 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de077c2b-0d42-496c-9450-095f621e250c None admin] Validating token access rules against request {{(pid=207601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:24:36.534034 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab3fdd2-ba08-48eb-8e06-9d15c508b436 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:24:36.535255 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab3fdd2-ba08-48eb-8e06-9d15c508b436 None admin] REQUEST_METHOD: `GET` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:24:36.535832 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab3fdd2-ba08-48eb-8e06-9d15c508b436 None admin] SCRIPT_NAME: `/identity` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:24:36.536076 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-808d3bc6-3614-4e11-bcc7-6fc9ff0bf060 None admin] Validating token access rules against request {{(pid=207600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:24:36.536540 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab3fdd2-ba08-48eb-8e06-9d15c508b436 None admin] PATH_INFO: `/v3/domains` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:24:36.537876 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab3fdd2-ba08-48eb-8e06-9d15c508b436 None admin] RBAC: Adding query filter params (name=Default) {{(pid=207601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:24:36.538750 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab3fdd2-ba08-48eb-8e06-9d15c508b436 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:24:36.541687 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab3fdd2-ba08-48eb-8e06-9d15c508b436 None admin] RBAC: Authorization granted {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:24:36.545810 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG dbcounter [-] [207600] Writing DB stats keystone:SELECT=100 {{(pid=207600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:24:36.566470 dv-cinder-851351-1-smb devstack@keystone.service[207601]: [pid: 207601|app: 0|req: 328/658] 10.222.0.42 () {56 vars in 1109 bytes} [Thu Jul 28 08:24:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 289 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:24:36.568376 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab3fdd2-ba08-48eb-8e06-9d15c508b436 None admin] Authenticating user token {{(pid=207601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:24:36.574679 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e1bdf2-fb0f-46f0-b4f4-860b23d270d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:24:36.575328 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e1bdf2-fb0f-46f0-b4f4-860b23d270d1 None admin] REQUEST_METHOD: `GET` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:24:36.575608 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e1bdf2-fb0f-46f0-b4f4-860b23d270d1 None admin] SCRIPT_NAME: `/identity` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:24:36.575882 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e1bdf2-fb0f-46f0-b4f4-860b23d270d1 None admin] PATH_INFO: `/v3/domains` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:24:36.577852 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e1bdf2-fb0f-46f0-b4f4-860b23d270d1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=207600) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:24:36.577852 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e1bdf2-fb0f-46f0-b4f4-860b23d270d1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:24:36.578455 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e1bdf2-fb0f-46f0-b4f4-860b23d270d1 None admin] RBAC: Authorization granted {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:24:36.592258 dv-cinder-851351-1-smb devstack@keystone.service[207600]: [pid: 207600|app: 0|req: 331/659] 10.222.0.42 () {56 vars in 1109 bytes} [Thu Jul 28 08:24:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:24:36.593329 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e1bdf2-fb0f-46f0-b4f4-860b23d270d1 None admin] Authenticating user token {{(pid=207600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:24:36.706515 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e1bdf2-fb0f-46f0-b4f4-860b23d270d1 None admin] Validating token access rules against request {{(pid=207600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:24:36.737719 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG dbcounter [-] [207601] Writing DB stats keystone:SELECT=100 {{(pid=207601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:24:36.746938 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e56ce09-1533-4bd5-b81b-3457b5e6a6fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:24:36.747919 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e56ce09-1533-4bd5-b81b-3457b5e6a6fc None admin] REQUEST_METHOD: `GET` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:24:36.748379 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e56ce09-1533-4bd5-b81b-3457b5e6a6fc None admin] SCRIPT_NAME: `/identity` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:24:36.748923 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e56ce09-1533-4bd5-b81b-3457b5e6a6fc None admin] PATH_INFO: `/v3/users/neutron` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:24:36.758740 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e56ce09-1533-4bd5-b81b-3457b5e6a6fc None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:24:36.760728 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e56ce09-1533-4bd5-b81b-3457b5e6a6fc None admin] RBAC: Authorization granted {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:24:36.765823 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab3fdd2-ba08-48eb-8e06-9d15c508b436 None admin] Validating token access rules against request {{(pid=207601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:24:36.775405 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application [None req-8e56ce09-1533-4bd5-b81b-3457b5e6a6fc None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jul 28 08:24:36.775405 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:24:36.775405 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:24:36.775405 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:24:36.775405 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:24:36.775405 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:24:36.775405 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:24:36.775405 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:24:36.775405 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:24:36.775405 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:24:36.775405 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:24:36.775405 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:24:36.775405 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 28 08:24:36.775405 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 28 08:24:36.775405 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 28 08:24:36.775405 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 28 08:24:36.776607 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:24:36.776607 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:24:36.776607 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 28 08:24:36.776607 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 08:24:36.776607 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 28 08:24:36.776607 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 08:24:36.776607 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:24:36.776607 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:24:36.776607 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:24:36.776607 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:24:36.776607 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:24:36.776607 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application with Lock( Jul 28 08:24:36.776607 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:24:36.776607 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:24:36.776607 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:24:36.776607 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:24:36.776607 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:24:36.776607 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:24:36.777654 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:24:36.777654 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:24:36.777654 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 28 08:24:36.777654 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 28 08:24:36.777654 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 28 08:24:36.777654 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 28 08:24:36.777654 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 28 08:24:36.777654 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 28 08:24:36.777654 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jul 28 08:24:36.777654 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application Jul 28 08:24:36.780460 dv-cinder-851351-1-smb devstack@keystone.service[207600]: [pid: 207600|app: 0|req: 332/660] 10.222.0.42 () {56 vars in 1102 bytes} [Thu Jul 28 08:24:36 2022] GET /identity/v3/users/neutron => generated 85 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:24:36.781928 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e56ce09-1533-4bd5-b81b-3457b5e6a6fc None admin] Authenticating user token {{(pid=207600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:24:36.809046 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e6ec30-dc54-40a6-9246-1add9a2f9cdc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:24:36.809703 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e6ec30-dc54-40a6-9246-1add9a2f9cdc None admin] REQUEST_METHOD: `GET` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:24:36.810007 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e6ec30-dc54-40a6-9246-1add9a2f9cdc None admin] SCRIPT_NAME: `/identity` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:24:36.810864 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e6ec30-dc54-40a6-9246-1add9a2f9cdc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:24:36.818088 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG dbcounter [-] [207600] Writing DB stats keystone:SELECT=100 {{(pid=207600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:24:36.894878 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e6ec30-dc54-40a6-9246-1add9a2f9cdc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:24:36.896413 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e6ec30-dc54-40a6-9246-1add9a2f9cdc None admin] RBAC: Authorization granted {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:24:36.914674 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e56ce09-1533-4bd5-b81b-3457b5e6a6fc None admin] Validating token access rules against request {{(pid=207600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:24:36.957395 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7c36e2-3e31-4b2b-b7c7-6924aa983dac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:24:36.957992 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7c36e2-3e31-4b2b-b7c7-6924aa983dac None admin] REQUEST_METHOD: `GET` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:24:36.958310 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7c36e2-3e31-4b2b-b7c7-6924aa983dac None admin] SCRIPT_NAME: `/identity` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:24:36.958912 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7c36e2-3e31-4b2b-b7c7-6924aa983dac None admin] PATH_INFO: `/v3/projects/service` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:24:36.967942 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f7c36e2-3e31-4b2b-b7c7-6924aa983dac None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:24:36.969558 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f7c36e2-3e31-4b2b-b7c7-6924aa983dac None admin] RBAC: Authorization granted {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:24:36.984046 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application [None req-1f7c36e2-3e31-4b2b-b7c7-6924aa983dac None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 08:24:36.984046 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:24:36.984046 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:24:36.984046 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:24:36.984046 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:24:36.984046 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:24:36.984046 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:24:36.984046 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:24:36.984046 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:24:36.984046 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:24:36.984046 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:24:36.984046 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:24:36.984046 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 28 08:24:36.984046 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 28 08:24:36.984046 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 28 08:24:36.985145 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 28 08:24:36.985145 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:24:36.985145 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:24:36.985145 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:24:36.985145 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:24:36.985145 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:24:36.985145 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:24:36.985145 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:24:36.985145 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application with Lock( Jul 28 08:24:36.985145 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:24:36.985145 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:24:36.985145 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:24:36.985145 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:24:36.985145 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:24:36.985145 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:24:36.985145 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:24:36.985145 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:24:36.987702 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 28 08:24:36.987702 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 28 08:24:36.987702 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 28 08:24:36.987702 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 28 08:24:36.987702 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 28 08:24:36.987702 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 28 08:24:36.987702 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 08:24:36.987702 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application Jul 28 08:24:36.987702 dv-cinder-851351-1-smb devstack@keystone.service[207600]: [pid: 207600|app: 0|req: 333/661] 10.222.0.42 () {56 vars in 1111 bytes} [Thu Jul 28 08:24:36 2022] GET /identity/v3/projects/service => generated 88 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:24:36.987702 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7c36e2-3e31-4b2b-b7c7-6924aa983dac None admin] Authenticating user token {{(pid=207600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:24:37.012337 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG dbcounter [-] [207601] Writing DB stats keystone:SELECT=100 {{(pid=207601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:24:37.038716 dv-cinder-851351-1-smb devstack@keystone.service[207601]: [pid: 207601|app: 0|req: 329/662] 10.222.0.42 () {58 vars in 1282 bytes} [Thu Jul 28 08:24:36 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 471 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 28 08:24:37.039885 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e6ec30-dc54-40a6-9246-1add9a2f9cdc None admin] Authenticating user token {{(pid=207601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:24:37.092344 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG dbcounter [-] [207600] Writing DB stats keystone:SELECT=100 {{(pid=207600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:24:37.118205 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7c36e2-3e31-4b2b-b7c7-6924aa983dac None admin] Validating token access rules against request {{(pid=207600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:24:37.158123 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901348c7-4a73-4efa-9348-ca8b03227271 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:24:37.158756 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901348c7-4a73-4efa-9348-ca8b03227271 None admin] REQUEST_METHOD: `GET` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:24:37.159041 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901348c7-4a73-4efa-9348-ca8b03227271 None admin] SCRIPT_NAME: `/identity` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:24:37.159317 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901348c7-4a73-4efa-9348-ca8b03227271 None admin] PATH_INFO: `/v3/users` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:24:37.160136 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-901348c7-4a73-4efa-9348-ca8b03227271 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=207600) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:24:37.160450 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-901348c7-4a73-4efa-9348-ca8b03227271 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:24:37.161953 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-901348c7-4a73-4efa-9348-ca8b03227271 None admin] RBAC: Authorization granted {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:24:37.168603 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e6ec30-dc54-40a6-9246-1add9a2f9cdc None admin] Validating token access rules against request {{(pid=207601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:24:37.185863 dv-cinder-851351-1-smb devstack@keystone.service[207600]: [pid: 207600|app: 0|req: 334/663] 10.222.0.42 () {56 vars in 1139 bytes} [Thu Jul 28 08:24:36 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:24:37.185863 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b256ddf-6b60-47dc-b5a5-5401c8472b18 None None] REQUEST_METHOD: `GET` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:24:37.185863 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b256ddf-6b60-47dc-b5a5-5401c8472b18 None None] SCRIPT_NAME: `/identity` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:24:37.185863 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b256ddf-6b60-47dc-b5a5-5401c8472b18 None None] PATH_INFO: `/` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:24:37.185863 dv-cinder-851351-1-smb devstack@keystone.service[207600]: [pid: 207600|app: 0|req: 335/664] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 08:24:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 08:24:37.185863 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b256ddf-6b60-47dc-b5a5-5401c8472b18 None None] Authenticating user token {{(pid=207600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:24:37.217902 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8962ea51-e3a1-41bf-875e-1a51e0dd6b76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:24:37.218459 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8962ea51-e3a1-41bf-875e-1a51e0dd6b76 None admin] REQUEST_METHOD: `GET` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:24:37.218737 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8962ea51-e3a1-41bf-875e-1a51e0dd6b76 None admin] SCRIPT_NAME: `/identity` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:24:37.219006 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8962ea51-e3a1-41bf-875e-1a51e0dd6b76 None admin] PATH_INFO: `/v3/projects` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:24:37.219776 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8962ea51-e3a1-41bf-875e-1a51e0dd6b76 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=207601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:24:37.220086 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8962ea51-e3a1-41bf-875e-1a51e0dd6b76 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:24:37.221573 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8962ea51-e3a1-41bf-875e-1a51e0dd6b76 None admin] RBAC: Authorization granted {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:24:37.235836 dv-cinder-851351-1-smb devstack@keystone.service[207601]: [pid: 207601|app: 0|req: 330/665] 10.222.0.42 () {56 vars in 1148 bytes} [Thu Jul 28 08:24:37 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:24:37.237532 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8962ea51-e3a1-41bf-875e-1a51e0dd6b76 None admin] Authenticating user token {{(pid=207601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:24:37.287819 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG dbcounter [-] [207601] Writing DB stats keystone:SELECT=100 {{(pid=207601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:24:37.305672 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b256ddf-6b60-47dc-b5a5-5401c8472b18 None None] Validating token access rules against request {{(pid=207600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:24:37.347767 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb68dfc-3001-4ce7-8bc4-f23ea80747f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:24:37.349174 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb68dfc-3001-4ce7-8bc4-f23ea80747f9 None admin] REQUEST_METHOD: `GET` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:24:37.349572 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb68dfc-3001-4ce7-8bc4-f23ea80747f9 None admin] SCRIPT_NAME: `/identity` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:24:37.349894 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb68dfc-3001-4ce7-8bc4-f23ea80747f9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:24:37.365835 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb68dfc-3001-4ce7-8bc4-f23ea80747f9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:24:37.367391 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8962ea51-e3a1-41bf-875e-1a51e0dd6b76 None admin] Validating token access rules against request {{(pid=207601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:24:37.367522 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb68dfc-3001-4ce7-8bc4-f23ea80747f9 None admin] RBAC: Authorization granted {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:24:37.371053 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG dbcounter [-] [207600] Writing DB stats keystone:SELECT=100 {{(pid=207600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:24:37.391136 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application [None req-fbb68dfc-3001-4ce7-8bc4-f23ea80747f9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 08:24:37.391136 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:24:37.391136 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:24:37.391136 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:24:37.391136 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:24:37.391136 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:24:37.391136 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:24:37.391136 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:24:37.391136 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:24:37.391136 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:24:37.391136 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:24:37.391136 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:24:37.391136 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 08:24:37.391136 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 08:24:37.391136 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 08:24:37.392265 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 08:24:37.392265 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:24:37.392265 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:24:37.392265 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:24:37.392265 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:24:37.392265 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:24:37.392265 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:24:37.392265 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:24:37.392265 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application with Lock( Jul 28 08:24:37.392265 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:24:37.392265 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:24:37.392265 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:24:37.392265 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:24:37.392265 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:24:37.392265 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:24:37.392265 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:24:37.392265 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:24:37.394170 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 08:24:37.394170 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 08:24:37.394170 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 08:24:37.394170 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application Jul 28 08:24:37.394170 dv-cinder-851351-1-smb devstack@keystone.service[207600]: [pid: 207600|app: 0|req: 336/666] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 08:24:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:24:37.394170 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d81d2c0-dd6e-42b0-a6fb-4ac707aec6a9 None None] REQUEST_METHOD: `POST` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:24:37.394170 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d81d2c0-dd6e-42b0-a6fb-4ac707aec6a9 None None] SCRIPT_NAME: `/identity` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:24:37.394604 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d81d2c0-dd6e-42b0-a6fb-4ac707aec6a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:24:37.413333 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f9d1a7a-a53b-498e-b95c-4373c6a91791 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:24:37.413981 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9d1a7a-a53b-498e-b95c-4373c6a91791 None admin] REQUEST_METHOD: `GET` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:24:37.414265 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9d1a7a-a53b-498e-b95c-4373c6a91791 None admin] SCRIPT_NAME: `/identity` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:24:37.414538 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9d1a7a-a53b-498e-b95c-4373c6a91791 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:24:37.415206 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.auth.core [None req-3d81d2c0-dd6e-42b0-a6fb-4ac707aec6a9 None None] MFA Rules not processed for user `b8110ade874c4aa7af27f5c376df700a`. Rule list: `[]` (Enabled: `True`). {{(pid=207600) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 08:24:37.416526 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.fernet_utils [None req-3d81d2c0-dd6e-42b0-a6fb-4ac707aec6a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=207600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:24:37.490992 dv-cinder-851351-1-smb devstack@keystone.service[207600]: [pid: 207600|app: 0|req: 337/667] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 08:24:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 08:24:37.492059 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d81d2c0-dd6e-42b0-a6fb-4ac707aec6a9 None None] Authenticating user token {{(pid=207600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:24:37.506695 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f9d1a7a-a53b-498e-b95c-4373c6a91791 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:24:37.508943 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f9d1a7a-a53b-498e-b95c-4373c6a91791 None admin] RBAC: Authorization granted {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:24:37.558052 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG dbcounter [-] [207601] Writing DB stats keystone:SELECT=100 {{(pid=207601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:24:37.602003 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d81d2c0-dd6e-42b0-a6fb-4ac707aec6a9 None None] Validating token access rules against request {{(pid=207600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:24:37.626315 dv-cinder-851351-1-smb devstack@keystone.service[207601]: [pid: 207601|app: 0|req: 331/668] 10.222.0.42 () {58 vars in 1282 bytes} [Thu Jul 28 08:24:37 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 390 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 28 08:24:37.627242 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f9d1a7a-a53b-498e-b95c-4373c6a91791 None admin] Authenticating user token {{(pid=207601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:24:37.634883 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG dbcounter [-] [207600] Writing DB stats keystone:SELECT=100 {{(pid=207600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:24:37.645609 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb141cd-f2d3-4112-a57b-86edad05450f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:24:37.646385 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb141cd-f2d3-4112-a57b-86edad05450f None admin] REQUEST_METHOD: `GET` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:24:37.646742 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb141cd-f2d3-4112-a57b-86edad05450f None admin] SCRIPT_NAME: `/identity` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:24:37.647098 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb141cd-f2d3-4112-a57b-86edad05450f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:24:37.648020 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfb141cd-f2d3-4112-a57b-86edad05450f None admin] RBAC: Adding query filter params (role.id=b44e7c7aeec24f51b8033df305da133d, scope.project.id=48c5f2b2ae2b48758b957d2b194a7fd1, user.id=d085f306b992491d862c5df4567f0083) {{(pid=207600) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:24:37.648436 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfb141cd-f2d3-4112-a57b-86edad05450f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:24:37.649947 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfb141cd-f2d3-4112-a57b-86edad05450f None admin] RBAC: Authorization granted {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:24:37.656942 dv-cinder-851351-1-smb devstack@keystone.service[207600]: [pid: 207600|app: 0|req: 338/669] 10.222.0.42 () {56 vars in 1374 bytes} [Thu Jul 28 08:24:37 2022] GET /identity/v3/role_assignments?user.id=d085f306b992491d862c5df4567f0083&scope.project.id=48c5f2b2ae2b48758b957d2b194a7fd1&role.id=b44e7c7aeec24f51b8033df305da133d => generated 608 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:24:37.657751 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb141cd-f2d3-4112-a57b-86edad05450f None admin] Authenticating user token {{(pid=207600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:24:37.761230 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f9d1a7a-a53b-498e-b95c-4373c6a91791 None admin] Validating token access rules against request {{(pid=207601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:24:37.788765 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb141cd-f2d3-4112-a57b-86edad05450f None admin] Validating token access rules against request {{(pid=207600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:24:37.804021 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77db7c0-6ef0-40f9-9aab-b6788b68a1a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:24:37.804762 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77db7c0-6ef0-40f9-9aab-b6788b68a1a6 None admin] REQUEST_METHOD: `GET` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:24:37.805032 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77db7c0-6ef0-40f9-9aab-b6788b68a1a6 None admin] SCRIPT_NAME: `/identity` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:24:37.805308 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77db7c0-6ef0-40f9-9aab-b6788b68a1a6 None admin] PATH_INFO: `/v3/domains` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:24:37.806092 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b77db7c0-6ef0-40f9-9aab-b6788b68a1a6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=207601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:24:37.806403 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b77db7c0-6ef0-40f9-9aab-b6788b68a1a6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:24:37.808177 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b77db7c0-6ef0-40f9-9aab-b6788b68a1a6 None admin] RBAC: Authorization granted {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:24:37.816299 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG dbcounter [-] [207601] Writing DB stats keystone:SELECT=100 {{(pid=207601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:24:37.823379 dv-cinder-851351-1-smb devstack@keystone.service[207601]: [pid: 207601|app: 0|req: 332/670] 10.222.0.42 () {56 vars in 1109 bytes} [Thu Jul 28 08:24:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:24:37.824418 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77db7c0-6ef0-40f9-9aab-b6788b68a1a6 None admin] Authenticating user token {{(pid=207601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:24:37.839312 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae84134e-f1ee-40df-a268-30c8c9ac0345 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:24:37.840351 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae84134e-f1ee-40df-a268-30c8c9ac0345 None admin] REQUEST_METHOD: `GET` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:24:37.840638 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae84134e-f1ee-40df-a268-30c8c9ac0345 None admin] SCRIPT_NAME: `/identity` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:24:37.840950 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae84134e-f1ee-40df-a268-30c8c9ac0345 None admin] PATH_INFO: `/v3/roles/service` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:24:37.854599 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae84134e-f1ee-40df-a268-30c8c9ac0345 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 08:24:37.860612 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application [None req-ae84134e-f1ee-40df-a268-30c8c9ac0345 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 28 08:24:37.860612 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:24:37.860612 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:24:37.860612 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:24:37.860612 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:24:37.860612 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:24:37.860612 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:24:37.860612 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:24:37.860612 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:24:37.860612 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:24:37.860612 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:24:37.860612 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:24:37.860612 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 08:24:37.860612 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 08:24:37.860612 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 08:24:37.860612 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 08:24:37.861881 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 08:24:37.861881 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 08:24:37.861881 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 08:24:37.861881 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 08:24:37.861881 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:24:37.861881 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:24:37.861881 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:24:37.861881 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:24:37.861881 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:24:37.861881 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:24:37.861881 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:24:37.861881 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application with Lock( Jul 28 08:24:37.861881 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:24:37.861881 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:24:37.861881 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:24:37.861881 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:24:37.862839 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:24:37.862839 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:24:37.862839 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:24:37.862839 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:24:37.862839 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 08:24:37.862839 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 08:24:37.862839 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 08:24:37.862839 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 08:24:37.862839 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 08:24:37.862839 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 08:24:37.862839 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 28 08:24:37.862839 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application Jul 28 08:24:37.862839 dv-cinder-851351-1-smb devstack@keystone.service[207600]: [pid: 207600|app: 0|req: 339/671] 10.222.0.42 () {56 vars in 1102 bytes} [Thu Jul 28 08:24:37 2022] GET /identity/v3/roles/service => generated 85 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:24:37.863617 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae84134e-f1ee-40df-a268-30c8c9ac0345 None admin] Authenticating user token {{(pid=207600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:24:37.931505 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG dbcounter [-] [207600] Writing DB stats keystone:SELECT=100 {{(pid=207600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:24:37.965458 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77db7c0-6ef0-40f9-9aab-b6788b68a1a6 None admin] Validating token access rules against request {{(pid=207601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:24:37.993381 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae84134e-f1ee-40df-a268-30c8c9ac0345 None admin] Validating token access rules against request {{(pid=207600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:24:38.004779 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3b2fed-365a-4ddd-9f0a-2456acb702d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:24:38.005450 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3b2fed-365a-4ddd-9f0a-2456acb702d0 None admin] REQUEST_METHOD: `GET` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:24:38.005753 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3b2fed-365a-4ddd-9f0a-2456acb702d0 None admin] SCRIPT_NAME: `/identity` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:24:38.006002 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3b2fed-365a-4ddd-9f0a-2456acb702d0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:24:38.020602 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f3b2fed-365a-4ddd-9f0a-2456acb702d0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:24:38.022162 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f3b2fed-365a-4ddd-9f0a-2456acb702d0 None admin] RBAC: Authorization granted {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:24:38.032870 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b64a560-c10a-45be-9458-6996d2397899 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:24:38.033540 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b64a560-c10a-45be-9458-6996d2397899 None admin] REQUEST_METHOD: `GET` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:24:38.033824 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b64a560-c10a-45be-9458-6996d2397899 None admin] SCRIPT_NAME: `/identity` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:24:38.034128 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b64a560-c10a-45be-9458-6996d2397899 None admin] PATH_INFO: `/v3/projects/service` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:24:38.037806 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application [None req-4f3b2fed-365a-4ddd-9f0a-2456acb702d0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 08:24:38.037806 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:24:38.037806 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:24:38.037806 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:24:38.037806 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:24:38.037806 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:24:38.037806 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:24:38.037806 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:24:38.037806 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:24:38.037806 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:24:38.037806 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:24:38.037806 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:24:38.037806 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 08:24:38.037806 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 08:24:38.037806 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 08:24:38.038822 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 08:24:38.038822 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:24:38.038822 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:24:38.038822 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:24:38.038822 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:24:38.038822 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:24:38.038822 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:24:38.038822 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:24:38.038822 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application with Lock( Jul 28 08:24:38.038822 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:24:38.038822 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:24:38.038822 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:24:38.038822 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:24:38.038822 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:24:38.038822 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:24:38.038822 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:24:38.038822 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:24:38.039785 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 08:24:38.039785 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 08:24:38.039785 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 08:24:38.039785 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application Jul 28 08:24:38.041986 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b64a560-c10a-45be-9458-6996d2397899 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:24:38.043459 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b64a560-c10a-45be-9458-6996d2397899 None admin] RBAC: Authorization granted {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:24:38.043885 dv-cinder-851351-1-smb devstack@keystone.service[207601]: [pid: 207601|app: 0|req: 333/672] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 08:24:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:24:38.045303 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c8bd0e-b61e-4564-b80b-b8d5fa70ad1d None None] REQUEST_METHOD: `GET` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:24:38.045579 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c8bd0e-b61e-4564-b80b-b8d5fa70ad1d None None] SCRIPT_NAME: `/identity` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:24:38.045862 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c8bd0e-b61e-4564-b80b-b8d5fa70ad1d None None] PATH_INFO: `/` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:24:38.047341 dv-cinder-851351-1-smb devstack@keystone.service[207601]: [pid: 207601|app: 0|req: 334/673] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 08:24:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 08:24:38.047888 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c8bd0e-b61e-4564-b80b-b8d5fa70ad1d None None] Authenticating user token {{(pid=207601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:24:38.057441 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application [None req-5b64a560-c10a-45be-9458-6996d2397899 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 08:24:38.057441 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:24:38.057441 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:24:38.057441 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:24:38.057441 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:24:38.057441 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:24:38.057441 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:24:38.057441 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:24:38.057441 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:24:38.057441 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:24:38.057441 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:24:38.057441 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:24:38.057441 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 28 08:24:38.057441 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 28 08:24:38.057441 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 28 08:24:38.058733 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 28 08:24:38.058733 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:24:38.058733 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:24:38.058733 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:24:38.058733 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:24:38.058733 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:24:38.058733 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:24:38.058733 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:24:38.058733 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application with Lock( Jul 28 08:24:38.058733 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:24:38.058733 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:24:38.058733 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:24:38.058733 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:24:38.058733 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:24:38.058733 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:24:38.058733 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:24:38.058733 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:24:38.059899 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 28 08:24:38.059899 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 28 08:24:38.059899 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 28 08:24:38.059899 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 28 08:24:38.059899 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 28 08:24:38.059899 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 28 08:24:38.059899 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 08:24:38.059899 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application Jul 28 08:24:38.061230 dv-cinder-851351-1-smb devstack@keystone.service[207600]: [pid: 207600|app: 0|req: 340/674] 10.222.0.42 () {56 vars in 1111 bytes} [Thu Jul 28 08:24:37 2022] GET /identity/v3/projects/service => generated 88 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:24:38.061875 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b64a560-c10a-45be-9458-6996d2397899 None admin] Authenticating user token {{(pid=207600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:24:38.112857 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG dbcounter [-] [207601] Writing DB stats keystone:SELECT=100 {{(pid=207601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:24:38.168622 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c8bd0e-b61e-4564-b80b-b8d5fa70ad1d None None] Validating token access rules against request {{(pid=207601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:24:38.181384 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b64a560-c10a-45be-9458-6996d2397899 None admin] Validating token access rules against request {{(pid=207600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:24:38.193105 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG dbcounter [-] [207600] Writing DB stats keystone:SELECT=100 {{(pid=207600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:24:38.208824 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835a61e6-dcf1-4d56-8175-f823b2343660 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:24:38.209505 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835a61e6-dcf1-4d56-8175-f823b2343660 None admin] REQUEST_METHOD: `GET` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:24:38.209765 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835a61e6-dcf1-4d56-8175-f823b2343660 None admin] SCRIPT_NAME: `/identity` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:24:38.210040 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835a61e6-dcf1-4d56-8175-f823b2343660 None admin] PATH_INFO: `/v3/roles` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:24:38.210787 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-835a61e6-dcf1-4d56-8175-f823b2343660 None admin] RBAC: Adding query filter params (name=service) {{(pid=207601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:24:38.211117 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-835a61e6-dcf1-4d56-8175-f823b2343660 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:24:38.212514 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-835a61e6-dcf1-4d56-8175-f823b2343660 None admin] RBAC: Authorization granted {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:24:38.222751 dv-cinder-851351-1-smb devstack@keystone.service[207601]: [pid: 207601|app: 0|req: 335/675] 10.222.0.42 () {56 vars in 1103 bytes} [Thu Jul 28 08:24:38 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:24:38.224374 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e96d0f8-c517-41ae-a4f5-5b8b15f2e297 None None] REQUEST_METHOD: `POST` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:24:38.224882 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e96d0f8-c517-41ae-a4f5-5b8b15f2e297 None None] SCRIPT_NAME: `/identity` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:24:38.225469 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e96d0f8-c517-41ae-a4f5-5b8b15f2e297 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:24:38.229240 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e09c6124-2ff0-4781-a868-a3c4e9dba3a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:24:38.229894 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09c6124-2ff0-4781-a868-a3c4e9dba3a8 None admin] REQUEST_METHOD: `GET` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:24:38.230182 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09c6124-2ff0-4781-a868-a3c4e9dba3a8 None admin] SCRIPT_NAME: `/identity` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:24:38.230453 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09c6124-2ff0-4781-a868-a3c4e9dba3a8 None admin] PATH_INFO: `/v3/domains` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:24:38.231168 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e09c6124-2ff0-4781-a868-a3c4e9dba3a8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=207600) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:24:38.231474 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e09c6124-2ff0-4781-a868-a3c4e9dba3a8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:24:38.232909 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e09c6124-2ff0-4781-a868-a3c4e9dba3a8 None admin] RBAC: Authorization granted {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:24:38.246791 dv-cinder-851351-1-smb devstack@keystone.service[207600]: [pid: 207600|app: 0|req: 341/676] 10.222.0.42 () {56 vars in 1109 bytes} [Thu Jul 28 08:24:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:24:38.247747 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e09c6124-2ff0-4781-a868-a3c4e9dba3a8 None admin] Authenticating user token {{(pid=207600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:24:38.248679 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.auth.core [None req-3e96d0f8-c517-41ae-a4f5-5b8b15f2e297 None None] MFA Rules not processed for user `b8110ade874c4aa7af27f5c376df700a`. Rule list: `[]` (Enabled: `True`). {{(pid=207601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 08:24:38.250115 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.fernet_utils [None req-3e96d0f8-c517-41ae-a4f5-5b8b15f2e297 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=207601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:24:38.332921 dv-cinder-851351-1-smb devstack@keystone.service[207601]: [pid: 207601|app: 0|req: 336/677] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 08:24:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 08:24:38.334199 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e96d0f8-c517-41ae-a4f5-5b8b15f2e297 None None] Authenticating user token {{(pid=207601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:24:38.378739 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e09c6124-2ff0-4781-a868-a3c4e9dba3a8 None admin] Validating token access rules against request {{(pid=207600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:24:38.389193 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG dbcounter [-] [207601] Writing DB stats keystone:SELECT=100 {{(pid=207601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:24:38.421536 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da9f30f-beb1-4e21-84eb-f574e28d6009 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:24:38.422178 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da9f30f-beb1-4e21-84eb-f574e28d6009 None admin] REQUEST_METHOD: `GET` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:24:38.422459 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da9f30f-beb1-4e21-84eb-f574e28d6009 None admin] SCRIPT_NAME: `/identity` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:24:38.422733 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da9f30f-beb1-4e21-84eb-f574e28d6009 None admin] PATH_INFO: `/v3/projects` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:24:38.423507 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4da9f30f-beb1-4e21-84eb-f574e28d6009 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=207600) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:24:38.423814 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4da9f30f-beb1-4e21-84eb-f574e28d6009 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:24:38.425321 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4da9f30f-beb1-4e21-84eb-f574e28d6009 None admin] RBAC: Authorization granted {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:24:38.445380 dv-cinder-851351-1-smb devstack@keystone.service[207600]: [pid: 207600|app: 0|req: 342/678] 10.222.0.42 () {56 vars in 1148 bytes} [Thu Jul 28 08:24:38 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:24:38.446456 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da9f30f-beb1-4e21-84eb-f574e28d6009 None admin] Authenticating user token {{(pid=207600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:24:38.463655 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e96d0f8-c517-41ae-a4f5-5b8b15f2e297 None None] Validating token access rules against request {{(pid=207601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:24:38.483124 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG dbcounter [-] [207600] Writing DB stats keystone:SELECT=100 {{(pid=207600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:24:38.504079 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74fa0c69-d582-4797-be23-4ad4404ec38e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:24:38.504794 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74fa0c69-d582-4797-be23-4ad4404ec38e None admin] REQUEST_METHOD: `GET` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:24:38.505151 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74fa0c69-d582-4797-be23-4ad4404ec38e None admin] SCRIPT_NAME: `/identity` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:24:38.505363 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74fa0c69-d582-4797-be23-4ad4404ec38e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:24:38.517260 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74fa0c69-d582-4797-be23-4ad4404ec38e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:24:38.518767 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74fa0c69-d582-4797-be23-4ad4404ec38e None admin] RBAC: Authorization granted {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:24:38.534950 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application [None req-74fa0c69-d582-4797-be23-4ad4404ec38e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 08:24:38.534950 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:24:38.534950 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:24:38.534950 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:24:38.534950 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:24:38.534950 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:24:38.534950 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:24:38.534950 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:24:38.534950 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:24:38.534950 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:24:38.534950 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:24:38.534950 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:24:38.534950 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 08:24:38.534950 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 08:24:38.534950 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 08:24:38.536141 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 08:24:38.536141 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:24:38.536141 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:24:38.536141 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:24:38.536141 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:24:38.536141 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:24:38.536141 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:24:38.536141 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:24:38.536141 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application with Lock( Jul 28 08:24:38.536141 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:24:38.536141 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:24:38.536141 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:24:38.536141 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:24:38.536141 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:24:38.536141 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:24:38.536141 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:24:38.536141 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:24:38.537311 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 08:24:38.537311 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 08:24:38.537311 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 08:24:38.537311 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application Jul 28 08:24:38.539211 dv-cinder-851351-1-smb devstack@keystone.service[207601]: [pid: 207601|app: 0|req: 337/679] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 08:24:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:24:38.540070 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74fa0c69-d582-4797-be23-4ad4404ec38e None admin] Authenticating user token {{(pid=207601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:24:38.570214 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da9f30f-beb1-4e21-84eb-f574e28d6009 None admin] Validating token access rules against request {{(pid=207600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:24:38.609132 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f77dda95-34c6-4437-9eaf-51d2178ca567 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:24:38.609824 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77dda95-34c6-4437-9eaf-51d2178ca567 None admin] REQUEST_METHOD: `GET` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:24:38.609986 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77dda95-34c6-4437-9eaf-51d2178ca567 None admin] SCRIPT_NAME: `/identity` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:24:38.610290 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77dda95-34c6-4437-9eaf-51d2178ca567 None admin] PATH_INFO: `/v3/projects/service` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:24:38.617687 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f77dda95-34c6-4437-9eaf-51d2178ca567 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:24:38.619205 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f77dda95-34c6-4437-9eaf-51d2178ca567 None admin] RBAC: Authorization granted {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:24:38.631462 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application [None req-f77dda95-34c6-4437-9eaf-51d2178ca567 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 08:24:38.631462 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:24:38.631462 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:24:38.631462 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:24:38.631462 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:24:38.631462 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:24:38.631462 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:24:38.631462 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:24:38.631462 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:24:38.631462 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:24:38.631462 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:24:38.631462 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:24:38.631462 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 28 08:24:38.631462 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 28 08:24:38.631462 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 28 08:24:38.632484 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 28 08:24:38.632484 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:24:38.632484 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:24:38.632484 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:24:38.632484 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:24:38.632484 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:24:38.632484 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:24:38.632484 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:24:38.632484 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application with Lock( Jul 28 08:24:38.632484 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:24:38.632484 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:24:38.632484 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:24:38.632484 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:24:38.632484 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:24:38.632484 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:24:38.632484 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:24:38.632484 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:24:38.633452 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 28 08:24:38.633452 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 28 08:24:38.633452 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 28 08:24:38.633452 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 28 08:24:38.633452 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 28 08:24:38.633452 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 28 08:24:38.633452 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 08:24:38.633452 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application Jul 28 08:24:38.633452 dv-cinder-851351-1-smb devstack@keystone.service[207600]: [pid: 207600|app: 0|req: 343/680] 10.222.0.42 () {56 vars in 1111 bytes} [Thu Jul 28 08:24:38 2022] GET /identity/v3/projects/service => generated 88 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:24:38.633976 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f77dda95-34c6-4437-9eaf-51d2178ca567 None admin] Authenticating user token {{(pid=207600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:24:38.659519 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG dbcounter [-] [207601] Writing DB stats keystone:SELECT=100 {{(pid=207601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:24:38.668498 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74fa0c69-d582-4797-be23-4ad4404ec38e None admin] Validating token access rules against request {{(pid=207601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:24:38.714188 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9acdca9-44a9-4320-b0ee-22d97d3adc9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:24:38.714871 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9acdca9-44a9-4320-b0ee-22d97d3adc9e None admin] REQUEST_METHOD: `GET` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:24:38.715151 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9acdca9-44a9-4320-b0ee-22d97d3adc9e None admin] SCRIPT_NAME: `/identity` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:24:38.715425 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9acdca9-44a9-4320-b0ee-22d97d3adc9e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:24:38.727984 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9acdca9-44a9-4320-b0ee-22d97d3adc9e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 08:24:38.733743 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application [None req-d9acdca9-44a9-4320-b0ee-22d97d3adc9e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 08:24:38.733743 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:24:38.733743 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:24:38.733743 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:24:38.733743 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:24:38.733743 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:24:38.733743 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:24:38.733743 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:24:38.733743 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:24:38.733743 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:24:38.733743 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:24:38.733743 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:24:38.733743 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 08:24:38.733743 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 08:24:38.733743 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 08:24:38.733743 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 08:24:38.735748 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 08:24:38.735748 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 08:24:38.735748 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 08:24:38.735748 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 08:24:38.735748 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:24:38.735748 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:24:38.735748 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:24:38.735748 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:24:38.735748 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:24:38.735748 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:24:38.735748 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:24:38.735748 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application with Lock( Jul 28 08:24:38.735748 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:24:38.735748 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:24:38.735748 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:24:38.735748 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:24:38.737619 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:24:38.737619 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:24:38.737619 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:24:38.737619 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:24:38.737619 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 08:24:38.737619 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 08:24:38.737619 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 08:24:38.737619 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 08:24:38.737619 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 08:24:38.737619 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 08:24:38.737619 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 08:24:38.737619 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application Jul 28 08:24:38.737619 dv-cinder-851351-1-smb devstack@keystone.service[207601]: [pid: 207601|app: 0|req: 338/681] 10.222.0.42 () {56 vars in 1096 bytes} [Thu Jul 28 08:24:38 2022] GET /identity/v3/roles/admin => generated 83 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:24:38.737619 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9acdca9-44a9-4320-b0ee-22d97d3adc9e None admin] Authenticating user token {{(pid=207601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:24:38.761314 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG dbcounter [-] [207600] Writing DB stats keystone:SELECT=100 {{(pid=207600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:24:38.772994 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f77dda95-34c6-4437-9eaf-51d2178ca567 None admin] Validating token access rules against request {{(pid=207600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:24:38.823123 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa32afe-996f-4892-92ec-ba4597a23f45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:24:38.823762 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa32afe-996f-4892-92ec-ba4597a23f45 None admin] REQUEST_METHOD: `GET` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:24:38.824056 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa32afe-996f-4892-92ec-ba4597a23f45 None admin] SCRIPT_NAME: `/identity` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:24:38.824342 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa32afe-996f-4892-92ec-ba4597a23f45 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:24:38.825196 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aa32afe-996f-4892-92ec-ba4597a23f45 None admin] RBAC: Adding query filter params (role.id=b44e7c7aeec24f51b8033df305da133d, scope.project.id=48c5f2b2ae2b48758b957d2b194a7fd1, user.id=d73bf33a61c14daa85bf297acf8d0751) {{(pid=207600) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:24:38.825519 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aa32afe-996f-4892-92ec-ba4597a23f45 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:24:38.826995 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aa32afe-996f-4892-92ec-ba4597a23f45 None admin] RBAC: Authorization granted {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:24:38.844705 dv-cinder-851351-1-smb devstack@keystone.service[207600]: [pid: 207600|app: 0|req: 344/682] 10.222.0.42 () {56 vars in 1374 bytes} [Thu Jul 28 08:24:38 2022] GET /identity/v3/role_assignments?user.id=d73bf33a61c14daa85bf297acf8d0751&scope.project.id=48c5f2b2ae2b48758b957d2b194a7fd1&role.id=b44e7c7aeec24f51b8033df305da133d => generated 608 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:24:38.844705 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa32afe-996f-4892-92ec-ba4597a23f45 None admin] Authenticating user token {{(pid=207600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:24:38.875685 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9acdca9-44a9-4320-b0ee-22d97d3adc9e None admin] Validating token access rules against request {{(pid=207601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:24:38.929226 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dafd5c27-a1c8-492b-8e13-672cfa04694e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:24:38.929914 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dafd5c27-a1c8-492b-8e13-672cfa04694e None admin] REQUEST_METHOD: `GET` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:24:38.930211 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dafd5c27-a1c8-492b-8e13-672cfa04694e None admin] SCRIPT_NAME: `/identity` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:24:38.930493 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dafd5c27-a1c8-492b-8e13-672cfa04694e None admin] PATH_INFO: `/v3/domains` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:24:38.931234 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dafd5c27-a1c8-492b-8e13-672cfa04694e None admin] RBAC: Adding query filter params (name=Default) {{(pid=207601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:24:38.931550 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dafd5c27-a1c8-492b-8e13-672cfa04694e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:24:38.934134 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dafd5c27-a1c8-492b-8e13-672cfa04694e None admin] RBAC: Authorization granted {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:24:38.963940 dv-cinder-851351-1-smb devstack@keystone.service[207601]: [pid: 207601|app: 0|req: 339/683] 10.222.0.42 () {56 vars in 1109 bytes} [Thu Jul 28 08:24:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:24:38.965506 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dafd5c27-a1c8-492b-8e13-672cfa04694e None admin] Authenticating user token {{(pid=207601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:24:38.986840 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG dbcounter [-] [207601] Writing DB stats keystone:SELECT=100 {{(pid=207601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:24:39.006488 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa32afe-996f-4892-92ec-ba4597a23f45 None admin] Validating token access rules against request {{(pid=207600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:24:39.051169 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a76aee-51ac-4842-9c57-afdc012a8d0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:24:39.051814 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a76aee-51ac-4842-9c57-afdc012a8d0c None admin] REQUEST_METHOD: `GET` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:24:39.052096 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a76aee-51ac-4842-9c57-afdc012a8d0c None admin] SCRIPT_NAME: `/identity` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:24:39.052364 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a76aee-51ac-4842-9c57-afdc012a8d0c None admin] PATH_INFO: `/v3/projects` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:24:39.053726 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11a76aee-51ac-4842-9c57-afdc012a8d0c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=207600) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:24:39.054044 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11a76aee-51ac-4842-9c57-afdc012a8d0c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:24:39.055829 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11a76aee-51ac-4842-9c57-afdc012a8d0c None admin] RBAC: Authorization granted {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:24:39.080499 dv-cinder-851351-1-smb devstack@keystone.service[207600]: [pid: 207600|app: 0|req: 345/684] 10.222.0.42 () {56 vars in 1148 bytes} [Thu Jul 28 08:24:38 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:24:39.080499 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a76aee-51ac-4842-9c57-afdc012a8d0c None admin] Authenticating user token {{(pid=207600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:24:39.105829 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG dbcounter [-] [207600] Writing DB stats keystone:SELECT=100 {{(pid=207600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:24:39.114162 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dafd5c27-a1c8-492b-8e13-672cfa04694e None admin] Validating token access rules against request {{(pid=207601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:24:39.176550 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259ea98f-f96a-4738-8f6b-0d65f71ab8e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:24:39.177643 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259ea98f-f96a-4738-8f6b-0d65f71ab8e5 None admin] REQUEST_METHOD: `GET` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:24:39.178612 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259ea98f-f96a-4738-8f6b-0d65f71ab8e5 None admin] SCRIPT_NAME: `/identity` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:24:39.179111 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259ea98f-f96a-4738-8f6b-0d65f71ab8e5 None admin] PATH_INFO: `/v3/roles` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:24:39.181318 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-259ea98f-f96a-4738-8f6b-0d65f71ab8e5 None admin] RBAC: Adding query filter params (name=admin) {{(pid=207601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:24:39.181922 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-259ea98f-f96a-4738-8f6b-0d65f71ab8e5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:24:39.185673 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-259ea98f-f96a-4738-8f6b-0d65f71ab8e5 None admin] RBAC: Authorization granted {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:24:39.205424 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a76aee-51ac-4842-9c57-afdc012a8d0c None admin] Validating token access rules against request {{(pid=207600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:24:39.205632 dv-cinder-851351-1-smb devstack@keystone.service[207601]: [pid: 207601|app: 0|req: 340/685] 10.222.0.42 () {56 vars in 1099 bytes} [Thu Jul 28 08:24:38 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:24:39.210552 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259ea98f-f96a-4738-8f6b-0d65f71ab8e5 None admin] Authenticating user token {{(pid=207601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:24:39.261468 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30845b6f-3bee-4151-a059-d58e6286b48e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:24:39.262185 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30845b6f-3bee-4151-a059-d58e6286b48e None admin] REQUEST_METHOD: `GET` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:24:39.262912 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30845b6f-3bee-4151-a059-d58e6286b48e None admin] SCRIPT_NAME: `/identity` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:24:39.263207 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30845b6f-3bee-4151-a059-d58e6286b48e None admin] PATH_INFO: `/v3/users/swift` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:24:39.273803 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30845b6f-3bee-4151-a059-d58e6286b48e None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:24:39.275940 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30845b6f-3bee-4151-a059-d58e6286b48e None admin] RBAC: Authorization granted {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:24:39.293100 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application [None req-30845b6f-3bee-4151-a059-d58e6286b48e None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 28 08:24:39.293100 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:24:39.293100 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:24:39.293100 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:24:39.293100 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:24:39.293100 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:24:39.293100 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:24:39.293100 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:24:39.293100 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:24:39.293100 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:24:39.293100 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:24:39.293100 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:24:39.293100 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 28 08:24:39.293100 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 28 08:24:39.293100 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 28 08:24:39.293100 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 28 08:24:39.294323 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:24:39.294323 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:24:39.294323 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 28 08:24:39.294323 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 08:24:39.294323 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 28 08:24:39.294323 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 08:24:39.294323 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:24:39.294323 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:24:39.294323 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:24:39.294323 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:24:39.294323 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:24:39.294323 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application with Lock( Jul 28 08:24:39.294323 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:24:39.294323 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:24:39.294323 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:24:39.294323 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:24:39.294323 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:24:39.294323 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:24:39.295311 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:24:39.295311 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:24:39.295311 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 28 08:24:39.295311 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 28 08:24:39.295311 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 28 08:24:39.295311 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 28 08:24:39.295311 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 28 08:24:39.295311 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 28 08:24:39.295311 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 28 08:24:39.295311 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application Jul 28 08:24:39.295311 dv-cinder-851351-1-smb devstack@keystone.service[207600]: [pid: 207600|app: 0|req: 346/686] 10.222.0.42 () {56 vars in 1096 bytes} [Thu Jul 28 08:24:39 2022] GET /identity/v3/users/swift => generated 83 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:24:39.295946 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30845b6f-3bee-4151-a059-d58e6286b48e None admin] Authenticating user token {{(pid=207600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:24:39.310738 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG dbcounter [-] [207601] Writing DB stats keystone:SELECT=100 {{(pid=207601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:24:39.355335 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259ea98f-f96a-4738-8f6b-0d65f71ab8e5 None admin] Validating token access rules against request {{(pid=207601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:24:39.401922 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG dbcounter [-] [207600] Writing DB stats keystone:SELECT=100 {{(pid=207600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:24:39.406294 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21cd7f6a-0ec8-4b1f-af15-3905a87b599c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:24:39.406723 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21cd7f6a-0ec8-4b1f-af15-3905a87b599c None admin] REQUEST_METHOD: `GET` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:24:39.407079 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21cd7f6a-0ec8-4b1f-af15-3905a87b599c None admin] SCRIPT_NAME: `/identity` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:24:39.407468 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21cd7f6a-0ec8-4b1f-af15-3905a87b599c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:24:39.408367 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21cd7f6a-0ec8-4b1f-af15-3905a87b599c None admin] RBAC: Adding query filter params (role.id=b44e7c7aeec24f51b8033df305da133d, scope.project.id=48c5f2b2ae2b48758b957d2b194a7fd1, user.id=8d8ee8f8acaf4811addc298a15a4916b) {{(pid=207601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:24:39.408777 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21cd7f6a-0ec8-4b1f-af15-3905a87b599c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:24:39.411354 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21cd7f6a-0ec8-4b1f-af15-3905a87b599c None admin] RBAC: Authorization granted {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:24:39.420782 dv-cinder-851351-1-smb devstack@keystone.service[207601]: [pid: 207601|app: 0|req: 341/687] 10.222.0.42 () {56 vars in 1374 bytes} [Thu Jul 28 08:24:39 2022] GET /identity/v3/role_assignments?user.id=8d8ee8f8acaf4811addc298a15a4916b&scope.project.id=48c5f2b2ae2b48758b957d2b194a7fd1&role.id=b44e7c7aeec24f51b8033df305da133d => generated 608 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:24:39.422955 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21cd7f6a-0ec8-4b1f-af15-3905a87b599c None admin] Authenticating user token {{(pid=207601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:24:39.504169 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30845b6f-3bee-4151-a059-d58e6286b48e None admin] Validating token access rules against request {{(pid=207600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:24:39.578431 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b22555-d9df-45d1-96cf-ef4a2f7d52a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:24:39.579285 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b22555-d9df-45d1-96cf-ef4a2f7d52a4 None admin] REQUEST_METHOD: `GET` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:24:39.579671 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b22555-d9df-45d1-96cf-ef4a2f7d52a4 None admin] SCRIPT_NAME: `/identity` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:24:39.580049 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b22555-d9df-45d1-96cf-ef4a2f7d52a4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:24:39.594646 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23b22555-d9df-45d1-96cf-ef4a2f7d52a4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:24:39.596333 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23b22555-d9df-45d1-96cf-ef4a2f7d52a4 None admin] RBAC: Authorization granted {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:24:39.614545 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application [None req-23b22555-d9df-45d1-96cf-ef4a2f7d52a4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 08:24:39.614545 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:24:39.614545 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:24:39.614545 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:24:39.614545 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:24:39.614545 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:24:39.614545 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:24:39.614545 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:24:39.614545 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:24:39.614545 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:24:39.614545 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:24:39.614545 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:24:39.614545 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 08:24:39.614545 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 08:24:39.614545 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 08:24:39.616227 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 08:24:39.616227 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:24:39.616227 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:24:39.616227 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:24:39.616227 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:24:39.616227 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:24:39.616227 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:24:39.616227 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:24:39.616227 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application with Lock( Jul 28 08:24:39.616227 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:24:39.616227 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:24:39.616227 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:24:39.616227 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:24:39.616227 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:24:39.616227 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:24:39.616227 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:24:39.616227 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:24:39.617432 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 08:24:39.617432 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 08:24:39.617432 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 08:24:39.617432 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application Jul 28 08:24:39.622808 dv-cinder-851351-1-smb devstack@keystone.service[207600]: [pid: 207600|app: 0|req: 347/688] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 08:24:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 323 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:24:39.626293 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b22555-d9df-45d1-96cf-ef4a2f7d52a4 None admin] Authenticating user token {{(pid=207600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:24:39.643784 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21cd7f6a-0ec8-4b1f-af15-3905a87b599c None admin] Validating token access rules against request {{(pid=207601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:24:39.701215 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6906547b-583f-4205-9733-6d68d9bd2d91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:24:39.701890 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6906547b-583f-4205-9733-6d68d9bd2d91 None admin] REQUEST_METHOD: `GET` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:24:39.702157 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6906547b-583f-4205-9733-6d68d9bd2d91 None admin] SCRIPT_NAME: `/identity` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:24:39.702437 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6906547b-583f-4205-9733-6d68d9bd2d91 None admin] PATH_INFO: `/v3/users` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:24:39.703258 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6906547b-583f-4205-9733-6d68d9bd2d91 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=207601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:24:39.703568 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6906547b-583f-4205-9733-6d68d9bd2d91 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:24:39.705910 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6906547b-583f-4205-9733-6d68d9bd2d91 None admin] RBAC: Authorization granted {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:24:39.720121 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG dbcounter [-] [207601] Writing DB stats keystone:SELECT=100 {{(pid=207601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:24:39.730030 dv-cinder-851351-1-smb devstack@keystone.service[207601]: [pid: 207601|app: 0|req: 342/689] 10.222.0.42 () {56 vars in 1135 bytes} [Thu Jul 28 08:24:39 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 308 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:24:39.735762 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6906547b-583f-4205-9733-6d68d9bd2d91 None admin] Authenticating user token {{(pid=207601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:24:39.789989 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b22555-d9df-45d1-96cf-ef4a2f7d52a4 None admin] Validating token access rules against request {{(pid=207600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:24:39.819350 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG dbcounter [-] [207600] Writing DB stats keystone:SELECT=100 {{(pid=207600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:24:39.831240 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c55430f2-e715-4b4c-bda0-9fb74d79ac93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:24:39.831894 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55430f2-e715-4b4c-bda0-9fb74d79ac93 None admin] REQUEST_METHOD: `GET` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:24:39.832180 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55430f2-e715-4b4c-bda0-9fb74d79ac93 None admin] SCRIPT_NAME: `/identity` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:24:39.832459 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55430f2-e715-4b4c-bda0-9fb74d79ac93 None admin] PATH_INFO: `/v3/domains` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:24:39.833396 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c55430f2-e715-4b4c-bda0-9fb74d79ac93 None admin] RBAC: Adding query filter params (name=Default) {{(pid=207600) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:24:39.833688 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c55430f2-e715-4b4c-bda0-9fb74d79ac93 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:24:39.835936 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c55430f2-e715-4b4c-bda0-9fb74d79ac93 None admin] RBAC: Authorization granted {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:24:39.849818 dv-cinder-851351-1-smb devstack@keystone.service[207600]: [pid: 207600|app: 0|req: 348/690] 10.222.0.42 () {56 vars in 1109 bytes} [Thu Jul 28 08:24:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:24:39.851114 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee2e43f-a466-4e27-b6d6-60541b56c253 None None] REQUEST_METHOD: `GET` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:24:39.851410 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee2e43f-a466-4e27-b6d6-60541b56c253 None None] SCRIPT_NAME: `/identity` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:24:39.851685 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee2e43f-a466-4e27-b6d6-60541b56c253 None None] PATH_INFO: `/` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:24:39.853235 dv-cinder-851351-1-smb devstack@keystone.service[207600]: [pid: 207600|app: 0|req: 349/691] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 08:24:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 08:24:39.855220 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6906547b-583f-4205-9733-6d68d9bd2d91 None admin] Validating token access rules against request {{(pid=207601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:24:39.855747 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee2e43f-a466-4e27-b6d6-60541b56c253 None None] Authenticating user token {{(pid=207600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:24:39.910329 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b29030-3543-4049-87c2-a5ebd11ab3d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:24:39.911028 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b29030-3543-4049-87c2-a5ebd11ab3d2 None admin] REQUEST_METHOD: `GET` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:24:39.911322 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b29030-3543-4049-87c2-a5ebd11ab3d2 None admin] SCRIPT_NAME: `/identity` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:24:39.911604 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b29030-3543-4049-87c2-a5ebd11ab3d2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:24:39.984221 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee2e43f-a466-4e27-b6d6-60541b56c253 None None] Validating token access rules against request {{(pid=207600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:24:40.003840 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG dbcounter [-] [207601] Writing DB stats keystone:SELECT=100 {{(pid=207601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:24:40.009403 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37b29030-3543-4049-87c2-a5ebd11ab3d2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:24:40.011176 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37b29030-3543-4049-87c2-a5ebd11ab3d2 None admin] RBAC: Authorization granted {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:24:40.032719 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1860a7-c6b0-44cf-9e79-40287576b6e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:24:40.037084 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1860a7-c6b0-44cf-9e79-40287576b6e0 None admin] REQUEST_METHOD: `GET` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:24:40.037380 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1860a7-c6b0-44cf-9e79-40287576b6e0 None admin] SCRIPT_NAME: `/identity` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:24:40.037659 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1860a7-c6b0-44cf-9e79-40287576b6e0 None admin] PATH_INFO: `/v3/users/nova` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:24:40.049076 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae1860a7-c6b0-44cf-9e79-40287576b6e0 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:24:40.050482 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae1860a7-c6b0-44cf-9e79-40287576b6e0 None admin] RBAC: Authorization granted {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:24:40.067884 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application [None req-ae1860a7-c6b0-44cf-9e79-40287576b6e0 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 28 08:24:40.067884 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:24:40.067884 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:24:40.067884 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:24:40.067884 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:24:40.067884 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:24:40.067884 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:24:40.067884 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:24:40.067884 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:24:40.067884 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:24:40.067884 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:24:40.067884 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:24:40.067884 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 28 08:24:40.067884 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 28 08:24:40.067884 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 28 08:24:40.067884 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 28 08:24:40.069264 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:24:40.069264 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:24:40.069264 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 28 08:24:40.069264 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 08:24:40.069264 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 28 08:24:40.069264 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 08:24:40.069264 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:24:40.069264 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:24:40.069264 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:24:40.069264 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:24:40.069264 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:24:40.069264 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application with Lock( Jul 28 08:24:40.069264 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:24:40.069264 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:24:40.069264 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:24:40.069264 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:24:40.069264 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:24:40.069264 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:24:40.070349 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:24:40.070349 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:24:40.070349 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 28 08:24:40.070349 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 28 08:24:40.070349 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 28 08:24:40.070349 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 28 08:24:40.070349 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 28 08:24:40.070349 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 28 08:24:40.070349 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 28 08:24:40.070349 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application Jul 28 08:24:40.070349 dv-cinder-851351-1-smb devstack@keystone.service[207600]: [pid: 207600|app: 0|req: 350/692] 10.222.0.42 () {56 vars in 1093 bytes} [Thu Jul 28 08:24:39 2022] GET /identity/v3/users/nova => generated 82 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 08:24:40.071003 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e675ee-9a3f-4720-b693-798eda920301 None None] REQUEST_METHOD: `POST` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:24:40.071084 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e675ee-9a3f-4720-b693-798eda920301 None None] SCRIPT_NAME: `/identity` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:24:40.076313 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e675ee-9a3f-4720-b693-798eda920301 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:24:40.100062 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.auth.core [None req-f3e675ee-9a3f-4720-b693-798eda920301 None None] MFA Rules not processed for user `b8110ade874c4aa7af27f5c376df700a`. Rule list: `[]` (Enabled: `True`). {{(pid=207600) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 08:24:40.101635 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.fernet_utils [None req-f3e675ee-9a3f-4720-b693-798eda920301 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=207600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:24:40.152060 dv-cinder-851351-1-smb devstack@keystone.service[207601]: [pid: 207601|app: 0|req: 343/693] 10.222.0.42 () {58 vars in 1282 bytes} [Thu Jul 28 08:24:39 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 412 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 28 08:24:40.153116 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b29030-3543-4049-87c2-a5ebd11ab3d2 None admin] Authenticating user token {{(pid=207601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:24:40.155125 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG dbcounter [-] [207600] Writing DB stats keystone:SELECT=100 {{(pid=207600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:24:40.192933 dv-cinder-851351-1-smb devstack@keystone.service[207600]: [pid: 207600|app: 0|req: 351/694] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 08:24:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 08:24:40.194300 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e675ee-9a3f-4720-b693-798eda920301 None None] Authenticating user token {{(pid=207600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:24:40.270986 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG dbcounter [-] [207601] Writing DB stats keystone:SELECT=100 {{(pid=207601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:24:40.277077 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b29030-3543-4049-87c2-a5ebd11ab3d2 None admin] Validating token access rules against request {{(pid=207601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:24:40.315702 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e8aec5-2b6c-44ab-813c-414fcac5f573 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:24:40.316425 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e8aec5-2b6c-44ab-813c-414fcac5f573 None admin] REQUEST_METHOD: `GET` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:24:40.316838 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e8aec5-2b6c-44ab-813c-414fcac5f573 None admin] SCRIPT_NAME: `/identity` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:24:40.317215 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e8aec5-2b6c-44ab-813c-414fcac5f573 None admin] PATH_INFO: `/v3/users` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:24:40.318174 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97e8aec5-2b6c-44ab-813c-414fcac5f573 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=207601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:24:40.318607 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97e8aec5-2b6c-44ab-813c-414fcac5f573 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:24:40.320209 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97e8aec5-2b6c-44ab-813c-414fcac5f573 None admin] RBAC: Authorization granted {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:24:40.335124 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e675ee-9a3f-4720-b693-798eda920301 None None] Validating token access rules against request {{(pid=207600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:24:40.345075 dv-cinder-851351-1-smb devstack@keystone.service[207601]: [pid: 207601|app: 0|req: 344/695] 10.222.0.42 () {56 vars in 1133 bytes} [Thu Jul 28 08:24:40 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:24:40.346178 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e8aec5-2b6c-44ab-813c-414fcac5f573 None admin] Authenticating user token {{(pid=207601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:24:40.381977 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952b9923-4039-4c99-9f50-3d234ccc32a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:24:40.382941 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952b9923-4039-4c99-9f50-3d234ccc32a5 None admin] REQUEST_METHOD: `GET` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:24:40.383404 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952b9923-4039-4c99-9f50-3d234ccc32a5 None admin] SCRIPT_NAME: `/identity` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:24:40.383841 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952b9923-4039-4c99-9f50-3d234ccc32a5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:24:40.398039 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-952b9923-4039-4c99-9f50-3d234ccc32a5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:24:40.400551 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-952b9923-4039-4c99-9f50-3d234ccc32a5 None admin] RBAC: Authorization granted {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:24:40.421534 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application [None req-952b9923-4039-4c99-9f50-3d234ccc32a5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 08:24:40.421534 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:24:40.421534 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:24:40.421534 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:24:40.421534 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:24:40.421534 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:24:40.421534 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:24:40.421534 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:24:40.421534 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:24:40.421534 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:24:40.421534 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:24:40.421534 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:24:40.421534 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 08:24:40.421534 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 08:24:40.421534 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 08:24:40.422784 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 08:24:40.422784 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:24:40.422784 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:24:40.422784 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:24:40.422784 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:24:40.422784 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:24:40.422784 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:24:40.422784 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:24:40.422784 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application with Lock( Jul 28 08:24:40.422784 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:24:40.422784 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:24:40.422784 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:24:40.422784 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:24:40.422784 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:24:40.422784 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:24:40.422784 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:24:40.422784 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:24:40.424067 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 08:24:40.424067 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 08:24:40.424067 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 08:24:40.424067 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application Jul 28 08:24:40.430872 dv-cinder-851351-1-smb devstack@keystone.service[207600]: [pid: 207600|app: 0|req: 352/696] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 08:24:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:24:40.430872 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952b9923-4039-4c99-9f50-3d234ccc32a5 None admin] Authenticating user token {{(pid=207600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:24:40.467248 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e8aec5-2b6c-44ab-813c-414fcac5f573 None admin] Validating token access rules against request {{(pid=207601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:24:40.471057 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG dbcounter [-] [207600] Writing DB stats keystone:SELECT=100 {{(pid=207600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:24:40.509936 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd4df9b-7675-46a4-a3f4-fd7dcec34c5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:24:40.510668 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd4df9b-7675-46a4-a3f4-fd7dcec34c5c None admin] REQUEST_METHOD: `GET` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:24:40.511242 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd4df9b-7675-46a4-a3f4-fd7dcec34c5c None admin] SCRIPT_NAME: `/identity` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:24:40.511442 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd4df9b-7675-46a4-a3f4-fd7dcec34c5c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:24:40.523062 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbd4df9b-7675-46a4-a3f4-fd7dcec34c5c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:24:40.524720 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbd4df9b-7675-46a4-a3f4-fd7dcec34c5c None admin] RBAC: Authorization granted {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:24:40.541816 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application [None req-dbd4df9b-7675-46a4-a3f4-fd7dcec34c5c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 08:24:40.541816 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:24:40.541816 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:24:40.541816 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:24:40.541816 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:24:40.541816 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:24:40.541816 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:24:40.541816 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:24:40.541816 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:24:40.541816 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:24:40.541816 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:24:40.541816 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:24:40.541816 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 08:24:40.541816 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 08:24:40.541816 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 08:24:40.542851 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 08:24:40.542851 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:24:40.542851 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:24:40.542851 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:24:40.542851 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:24:40.542851 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:24:40.542851 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:24:40.542851 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:24:40.542851 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application with Lock( Jul 28 08:24:40.542851 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:24:40.542851 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:24:40.542851 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:24:40.542851 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:24:40.542851 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:24:40.542851 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:24:40.542851 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:24:40.542851 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:24:40.543801 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 08:24:40.543801 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 08:24:40.543801 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 08:24:40.543801 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application Jul 28 08:24:40.548198 dv-cinder-851351-1-smb devstack@keystone.service[207601]: [pid: 207601|app: 0|req: 345/697] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 08:24:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:24:40.549249 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd4df9b-7675-46a4-a3f4-fd7dcec34c5c None admin] Authenticating user token {{(pid=207601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:24:40.562959 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG dbcounter [-] [207601] Writing DB stats keystone:SELECT=100 {{(pid=207601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:24:40.569758 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952b9923-4039-4c99-9f50-3d234ccc32a5 None admin] Validating token access rules against request {{(pid=207600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:24:40.615589 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bdd9552-a1cd-430b-a29a-513d167b2a85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:24:40.617294 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bdd9552-a1cd-430b-a29a-513d167b2a85 None admin] REQUEST_METHOD: `GET` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:24:40.617765 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bdd9552-a1cd-430b-a29a-513d167b2a85 None admin] SCRIPT_NAME: `/identity` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:24:40.618215 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bdd9552-a1cd-430b-a29a-513d167b2a85 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:24:40.678178 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd4df9b-7675-46a4-a3f4-fd7dcec34c5c None admin] Validating token access rules against request {{(pid=207601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:24:40.699801 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bdd9552-a1cd-430b-a29a-513d167b2a85 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:24:40.701670 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bdd9552-a1cd-430b-a29a-513d167b2a85 None admin] RBAC: Authorization granted {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:24:40.723696 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e254c144-d2b6-4267-a376-35500e7be59e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:24:40.724604 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e254c144-d2b6-4267-a376-35500e7be59e None admin] REQUEST_METHOD: `GET` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:24:40.725120 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e254c144-d2b6-4267-a376-35500e7be59e None admin] SCRIPT_NAME: `/identity` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:24:40.725561 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e254c144-d2b6-4267-a376-35500e7be59e None admin] PATH_INFO: `/v3/domains` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:24:40.726963 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e254c144-d2b6-4267-a376-35500e7be59e None admin] RBAC: Adding query filter params (name=Default) {{(pid=207601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:24:40.727602 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e254c144-d2b6-4267-a376-35500e7be59e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:24:40.729525 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e254c144-d2b6-4267-a376-35500e7be59e None admin] RBAC: Authorization granted {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:24:40.733507 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG dbcounter [-] [207600] Writing DB stats keystone:SELECT=100 {{(pid=207600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:24:40.750963 dv-cinder-851351-1-smb devstack@keystone.service[207601]: [pid: 207601|app: 0|req: 346/698] 10.222.0.42 () {56 vars in 1109 bytes} [Thu Jul 28 08:24:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:24:40.750963 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e254c144-d2b6-4267-a376-35500e7be59e None admin] Authenticating user token {{(pid=207601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:24:40.830195 dv-cinder-851351-1-smb devstack@keystone.service[207600]: [pid: 207600|app: 0|req: 353/699] 10.222.0.42 () {58 vars in 1282 bytes} [Thu Jul 28 08:24:40 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 402 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 28 08:24:40.831172 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bdd9552-a1cd-430b-a29a-513d167b2a85 None admin] Authenticating user token {{(pid=207600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:24:40.858439 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG dbcounter [-] [207601] Writing DB stats keystone:SELECT=100 {{(pid=207601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:24:40.907747 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e254c144-d2b6-4267-a376-35500e7be59e None admin] Validating token access rules against request {{(pid=207601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:24:40.955974 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a510858-0937-4ac8-a98d-87e3e3c23a20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:24:40.957606 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a510858-0937-4ac8-a98d-87e3e3c23a20 None admin] REQUEST_METHOD: `GET` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:24:40.958076 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a510858-0937-4ac8-a98d-87e3e3c23a20 None admin] SCRIPT_NAME: `/identity` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:24:40.958798 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a510858-0937-4ac8-a98d-87e3e3c23a20 None admin] PATH_INFO: `/v3/domains` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:24:40.959689 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a510858-0937-4ac8-a98d-87e3e3c23a20 None admin] RBAC: Adding query filter params (name=Default) {{(pid=207601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:24:40.960417 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a510858-0937-4ac8-a98d-87e3e3c23a20 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:24:40.963263 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a510858-0937-4ac8-a98d-87e3e3c23a20 None admin] RBAC: Authorization granted {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:24:40.968553 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bdd9552-a1cd-430b-a29a-513d167b2a85 None admin] Validating token access rules against request {{(pid=207600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:24:40.987650 dv-cinder-851351-1-smb devstack@keystone.service[207601]: [pid: 207601|app: 0|req: 347/700] 10.222.0.42 () {56 vars in 1109 bytes} [Thu Jul 28 08:24:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:24:40.987650 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a510858-0937-4ac8-a98d-87e3e3c23a20 None admin] Authenticating user token {{(pid=207601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:24:41.005952 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG dbcounter [-] [207600] Writing DB stats keystone:SELECT=100 {{(pid=207600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:24:41.017248 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab2267c3-9485-4c34-9d5c-3d83387094bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:24:41.018156 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2267c3-9485-4c34-9d5c-3d83387094bc None admin] REQUEST_METHOD: `GET` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:24:41.018530 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2267c3-9485-4c34-9d5c-3d83387094bc None admin] SCRIPT_NAME: `/identity` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:24:41.018913 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2267c3-9485-4c34-9d5c-3d83387094bc None admin] PATH_INFO: `/v3/projects/service` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:24:41.027337 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab2267c3-9485-4c34-9d5c-3d83387094bc None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:24:41.029501 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab2267c3-9485-4c34-9d5c-3d83387094bc None admin] RBAC: Authorization granted {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:24:41.042072 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application [None req-ab2267c3-9485-4c34-9d5c-3d83387094bc None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 08:24:41.042072 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:24:41.042072 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:24:41.042072 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:24:41.042072 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:24:41.042072 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:24:41.042072 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:24:41.042072 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:24:41.042072 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:24:41.042072 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:24:41.042072 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:24:41.042072 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:24:41.042072 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 28 08:24:41.042072 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 28 08:24:41.042072 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 28 08:24:41.043137 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 28 08:24:41.043137 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:24:41.043137 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:24:41.043137 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:24:41.043137 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:24:41.043137 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:24:41.043137 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:24:41.043137 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:24:41.043137 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application with Lock( Jul 28 08:24:41.043137 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:24:41.043137 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:24:41.043137 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:24:41.043137 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:24:41.043137 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:24:41.043137 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:24:41.043137 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:24:41.043137 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:24:41.044107 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 28 08:24:41.044107 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 28 08:24:41.044107 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 28 08:24:41.044107 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 28 08:24:41.044107 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 28 08:24:41.044107 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 28 08:24:41.044107 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 08:24:41.044107 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application Jul 28 08:24:41.044107 dv-cinder-851351-1-smb devstack@keystone.service[207600]: [pid: 207600|app: 0|req: 354/701] 10.222.0.42 () {56 vars in 1111 bytes} [Thu Jul 28 08:24:40 2022] GET /identity/v3/projects/service => generated 88 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:24:41.045771 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab2267c3-9485-4c34-9d5c-3d83387094bc None admin] Authenticating user token {{(pid=207600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:24:41.112826 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a510858-0937-4ac8-a98d-87e3e3c23a20 None admin] Validating token access rules against request {{(pid=207601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:24:41.140407 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG dbcounter [-] [207601] Writing DB stats keystone:SELECT=100 {{(pid=207601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:24:41.150205 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7615a7db-c304-467b-b9d1-6c1a6e781174 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:24:41.150944 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7615a7db-c304-467b-b9d1-6c1a6e781174 None admin] REQUEST_METHOD: `GET` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:24:41.151226 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7615a7db-c304-467b-b9d1-6c1a6e781174 None admin] SCRIPT_NAME: `/identity` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:24:41.151499 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7615a7db-c304-467b-b9d1-6c1a6e781174 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:24:41.158575 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab2267c3-9485-4c34-9d5c-3d83387094bc None admin] Validating token access rules against request {{(pid=207600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:24:41.162892 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7615a7db-c304-467b-b9d1-6c1a6e781174 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:24:41.164381 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7615a7db-c304-467b-b9d1-6c1a6e781174 None admin] RBAC: Authorization granted {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:24:41.180726 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application [None req-7615a7db-c304-467b-b9d1-6c1a6e781174 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 08:24:41.180726 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:24:41.180726 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:24:41.180726 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:24:41.180726 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:24:41.180726 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:24:41.180726 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:24:41.180726 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:24:41.180726 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:24:41.180726 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:24:41.180726 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:24:41.180726 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:24:41.180726 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 08:24:41.180726 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 08:24:41.180726 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 08:24:41.181902 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 08:24:41.181902 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:24:41.181902 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:24:41.181902 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:24:41.181902 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:24:41.181902 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:24:41.181902 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:24:41.181902 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:24:41.181902 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application with Lock( Jul 28 08:24:41.181902 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:24:41.181902 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:24:41.181902 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:24:41.181902 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:24:41.181902 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:24:41.181902 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:24:41.181902 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:24:41.181902 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:24:41.183537 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 08:24:41.183537 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 08:24:41.183537 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 08:24:41.183537 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application Jul 28 08:24:41.183537 dv-cinder-851351-1-smb devstack@keystone.service[207601]: [pid: 207601|app: 0|req: 348/702] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 08:24:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:24:41.183985 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a979dc6e-cc74-4915-a42f-a41dd2fa7658 None None] REQUEST_METHOD: `GET` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:24:41.184194 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a979dc6e-cc74-4915-a42f-a41dd2fa7658 None None] SCRIPT_NAME: `/identity` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:24:41.184491 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a979dc6e-cc74-4915-a42f-a41dd2fa7658 None None] PATH_INFO: `/` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:24:41.190137 dv-cinder-851351-1-smb devstack@keystone.service[207601]: [pid: 207601|app: 0|req: 349/703] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 08:24:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 08:24:41.190137 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a979dc6e-cc74-4915-a42f-a41dd2fa7658 None None] Authenticating user token {{(pid=207601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:24:41.309628 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a979dc6e-cc74-4915-a42f-a41dd2fa7658 None None] Validating token access rules against request {{(pid=207601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:24:41.327737 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16a78dd-e9ec-4962-acb6-6182a548bf01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:24:41.328372 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16a78dd-e9ec-4962-acb6-6182a548bf01 None admin] REQUEST_METHOD: `POST` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:24:41.328677 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16a78dd-e9ec-4962-acb6-6182a548bf01 None admin] SCRIPT_NAME: `/identity` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:24:41.328964 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16a78dd-e9ec-4962-acb6-6182a548bf01 None admin] PATH_INFO: `/v3/users` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:24:41.329666 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e16a78dd-e9ec-4962-acb6-6182a548bf01 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:24:41.331134 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e16a78dd-e9ec-4962-acb6-6182a548bf01 None admin] RBAC: Authorization granted {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:24:41.349236 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0634bdcf-eb28-43d3-be54-cd77dbd6eaa2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:24:41.349887 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0634bdcf-eb28-43d3-be54-cd77dbd6eaa2 None admin] REQUEST_METHOD: `GET` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:24:41.350183 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0634bdcf-eb28-43d3-be54-cd77dbd6eaa2 None admin] SCRIPT_NAME: `/identity` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:24:41.350451 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0634bdcf-eb28-43d3-be54-cd77dbd6eaa2 None admin] PATH_INFO: `/v3/projects` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:24:41.351221 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0634bdcf-eb28-43d3-be54-cd77dbd6eaa2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=207601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:24:41.351532 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0634bdcf-eb28-43d3-be54-cd77dbd6eaa2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:24:41.353113 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0634bdcf-eb28-43d3-be54-cd77dbd6eaa2 None admin] RBAC: Authorization granted {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:24:41.365177 dv-cinder-851351-1-smb devstack@keystone.service[207600]: [pid: 207600|app: 0|req: 355/704] 10.222.0.42 () {60 vars in 1132 bytes} [Thu Jul 28 08:24:41 2022] POST /identity/v3/users => generated 254 bytes in 311 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 08:24:41.365177 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16a78dd-e9ec-4962-acb6-6182a548bf01 None admin] Authenticating user token {{(pid=207600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:24:41.372100 dv-cinder-851351-1-smb devstack@keystone.service[207601]: [pid: 207601|app: 0|req: 350/705] 10.222.0.42 () {56 vars in 1148 bytes} [Thu Jul 28 08:24:41 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:24:41.373674 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1de63da-709e-4800-b3ba-5010f321d50a None None] REQUEST_METHOD: `POST` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:24:41.373965 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1de63da-709e-4800-b3ba-5010f321d50a None None] SCRIPT_NAME: `/identity` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:24:41.374248 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1de63da-709e-4800-b3ba-5010f321d50a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:24:41.393841 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.auth.core [None req-c1de63da-709e-4800-b3ba-5010f321d50a None None] MFA Rules not processed for user `b8110ade874c4aa7af27f5c376df700a`. Rule list: `[]` (Enabled: `True`). {{(pid=207601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 08:24:41.395133 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.fernet_utils [None req-c1de63da-709e-4800-b3ba-5010f321d50a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=207601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:24:41.432187 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG dbcounter [-] [207600] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=207600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:24:41.444149 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG dbcounter [-] [207601] Writing DB stats keystone:SELECT=100 {{(pid=207601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:24:41.508783 dv-cinder-851351-1-smb devstack@keystone.service[207601]: [pid: 207601|app: 0|req: 351/706] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 08:24:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 08:24:41.508783 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1de63da-709e-4800-b3ba-5010f321d50a None None] Authenticating user token {{(pid=207601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:24:41.509099 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16a78dd-e9ec-4962-acb6-6182a548bf01 None admin] Validating token access rules against request {{(pid=207600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:24:41.571344 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2eca4f-cf81-4a51-9f03-a1d5b72e4863 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:24:41.571996 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2eca4f-cf81-4a51-9f03-a1d5b72e4863 None admin] REQUEST_METHOD: `GET` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:24:41.572386 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2eca4f-cf81-4a51-9f03-a1d5b72e4863 None admin] SCRIPT_NAME: `/identity` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:24:41.572686 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2eca4f-cf81-4a51-9f03-a1d5b72e4863 None admin] PATH_INFO: `/v3/domains` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:24:41.573436 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf2eca4f-cf81-4a51-9f03-a1d5b72e4863 None admin] RBAC: Adding query filter params (name=Default) {{(pid=207600) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:24:41.573844 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf2eca4f-cf81-4a51-9f03-a1d5b72e4863 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:24:41.575287 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf2eca4f-cf81-4a51-9f03-a1d5b72e4863 None admin] RBAC: Authorization granted {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:24:41.596644 dv-cinder-851351-1-smb devstack@keystone.service[207600]: [pid: 207600|app: 0|req: 356/707] 10.222.0.42 () {56 vars in 1109 bytes} [Thu Jul 28 08:24:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:24:41.596644 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2eca4f-cf81-4a51-9f03-a1d5b72e4863 None admin] Authenticating user token {{(pid=207600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:24:41.678093 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1de63da-709e-4800-b3ba-5010f321d50a None None] Validating token access rules against request {{(pid=207601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:24:41.712445 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2eca4f-cf81-4a51-9f03-a1d5b72e4863 None admin] Validating token access rules against request {{(pid=207600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:24:41.716095 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG dbcounter [-] [207600] Writing DB stats keystone:SELECT=100 {{(pid=207600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:24:41.729683 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3896177-4557-442d-9902-d1bbef898ff1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:24:41.730955 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3896177-4557-442d-9902-d1bbef898ff1 None admin] REQUEST_METHOD: `GET` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:24:41.731446 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3896177-4557-442d-9902-d1bbef898ff1 None admin] SCRIPT_NAME: `/identity` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:24:41.732097 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3896177-4557-442d-9902-d1bbef898ff1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:24:41.733523 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3896177-4557-442d-9902-d1bbef898ff1 None admin] RBAC: Adding query filter params (role.id=b44e7c7aeec24f51b8033df305da133d, scope.project.id=48c5f2b2ae2b48758b957d2b194a7fd1, user.id=96e9a6a7c6ea4047a5d8e16babbdeb70) {{(pid=207601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:24:41.734050 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3896177-4557-442d-9902-d1bbef898ff1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:24:41.736388 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3896177-4557-442d-9902-d1bbef898ff1 None admin] RBAC: Authorization granted {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:24:41.746736 dv-cinder-851351-1-smb devstack@keystone.service[207601]: [pid: 207601|app: 0|req: 352/708] 10.222.0.42 () {56 vars in 1374 bytes} [Thu Jul 28 08:24:41 2022] GET /identity/v3/role_assignments?user.id=96e9a6a7c6ea4047a5d8e16babbdeb70&scope.project.id=48c5f2b2ae2b48758b957d2b194a7fd1&role.id=b44e7c7aeec24f51b8033df305da133d => generated 608 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:24:41.747936 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3896177-4557-442d-9902-d1bbef898ff1 None admin] Authenticating user token {{(pid=207601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:24:41.760027 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c21dc7-8c55-4c14-a6ba-fe12bb54e74f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:24:41.760813 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c21dc7-8c55-4c14-a6ba-fe12bb54e74f None admin] REQUEST_METHOD: `GET` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:24:41.761108 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c21dc7-8c55-4c14-a6ba-fe12bb54e74f None admin] SCRIPT_NAME: `/identity` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:24:41.761390 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c21dc7-8c55-4c14-a6ba-fe12bb54e74f None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:24:41.762081 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c21dc7-8c55-4c14-a6ba-fe12bb54e74f None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:24:41.763546 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c21dc7-8c55-4c14-a6ba-fe12bb54e74f None admin] RBAC: Authorization granted {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:24:41.776047 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application [None req-e6c21dc7-8c55-4c14-a6ba-fe12bb54e74f None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 28 08:24:41.776047 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:24:41.776047 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 28 08:24:41.776047 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 28 08:24:41.776047 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 28 08:24:41.776047 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 28 08:24:41.776047 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 28 08:24:41.776047 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 08:24:41.776047 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 28 08:24:41.776047 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application Jul 28 08:24:41.776047 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 28 08:24:41.776047 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application Jul 28 08:24:41.776047 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:24:41.776047 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:24:41.776047 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:24:41.776047 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:24:41.777233 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:24:41.777233 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:24:41.777233 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:24:41.777233 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:24:41.777233 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:24:41.777233 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:24:41.777233 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:24:41.777233 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 28 08:24:41.777233 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 28 08:24:41.777233 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 28 08:24:41.777233 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 28 08:24:41.777233 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:24:41.777233 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:24:41.777233 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:24:41.777233 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:24:41.777233 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:24:41.778369 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:24:41.778369 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:24:41.778369 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application with Lock( Jul 28 08:24:41.778369 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:24:41.778369 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:24:41.778369 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:24:41.778369 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:24:41.778369 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:24:41.778369 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:24:41.778369 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:24:41.778369 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:24:41.778369 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 28 08:24:41.778369 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 08:24:41.778369 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 28 08:24:41.778369 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application Jul 28 08:24:41.778369 dv-cinder-851351-1-smb devstack@keystone.service[207600]: [pid: 207600|app: 0|req: 357/709] 10.222.0.42 () {56 vars in 1129 bytes} [Thu Jul 28 08:24:41 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:24:41.779617 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ee2dd8-2203-4e7b-81ef-97d6aefa1c0a None None] REQUEST_METHOD: `GET` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:24:41.779617 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ee2dd8-2203-4e7b-81ef-97d6aefa1c0a None None] SCRIPT_NAME: `/identity` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:24:41.779793 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ee2dd8-2203-4e7b-81ef-97d6aefa1c0a None None] PATH_INFO: `/` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:24:41.785540 dv-cinder-851351-1-smb devstack@keystone.service[207600]: [pid: 207600|app: 0|req: 358/710] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 08:24:41 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 08:24:41.786563 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ee2dd8-2203-4e7b-81ef-97d6aefa1c0a None None] Authenticating user token {{(pid=207600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:24:41.800352 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG dbcounter [-] [207601] Writing DB stats keystone:SELECT=100 {{(pid=207601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:24:41.890280 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3896177-4557-442d-9902-d1bbef898ff1 None admin] Validating token access rules against request {{(pid=207601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:24:41.947764 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0ae7d3-6805-45d9-bd19-14b4cf742da9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:24:41.949173 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0ae7d3-6805-45d9-bd19-14b4cf742da9 None admin] REQUEST_METHOD: `GET` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:24:41.949629 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0ae7d3-6805-45d9-bd19-14b4cf742da9 None admin] SCRIPT_NAME: `/identity` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:24:41.950065 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0ae7d3-6805-45d9-bd19-14b4cf742da9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:24:41.959330 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb0ae7d3-6805-45d9-bd19-14b4cf742da9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:24:41.960891 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb0ae7d3-6805-45d9-bd19-14b4cf742da9 None admin] RBAC: Authorization granted {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:24:41.977599 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application [None req-eb0ae7d3-6805-45d9-bd19-14b4cf742da9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 08:24:41.977599 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:24:41.977599 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:24:41.977599 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:24:41.977599 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:24:41.977599 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:24:41.977599 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:24:41.977599 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:24:41.977599 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:24:41.977599 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:24:41.977599 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:24:41.977599 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:24:41.977599 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 28 08:24:41.977599 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 28 08:24:41.977599 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 28 08:24:41.978663 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 28 08:24:41.978663 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:24:41.978663 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:24:41.978663 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:24:41.978663 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:24:41.978663 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:24:41.978663 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:24:41.978663 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:24:41.978663 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application with Lock( Jul 28 08:24:41.978663 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:24:41.978663 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:24:41.978663 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:24:41.978663 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:24:41.978663 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:24:41.978663 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:24:41.978663 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:24:41.978663 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:24:41.979608 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 28 08:24:41.979608 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 28 08:24:41.979608 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 28 08:24:41.979608 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 28 08:24:41.979608 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 28 08:24:41.979608 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 28 08:24:41.979608 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 08:24:41.979608 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application Jul 28 08:24:41.982323 dv-cinder-851351-1-smb devstack@keystone.service[207601]: [pid: 207601|app: 0|req: 353/711] 10.222.0.42 () {56 vars in 1111 bytes} [Thu Jul 28 08:24:41 2022] GET /identity/v3/projects/service => generated 88 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:24:41.983210 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa28b6f-e2a7-45be-a40a-700687a5f839 None None] REQUEST_METHOD: `POST` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:24:41.983493 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa28b6f-e2a7-45be-a40a-700687a5f839 None None] SCRIPT_NAME: `/identity` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:24:41.983767 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa28b6f-e2a7-45be-a40a-700687a5f839 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:24:41.984753 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ee2dd8-2203-4e7b-81ef-97d6aefa1c0a None None] Validating token access rules against request {{(pid=207600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:24:42.010374 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.auth.core [None req-7aa28b6f-e2a7-45be-a40a-700687a5f839 None None] MFA Rules not processed for user `b8110ade874c4aa7af27f5c376df700a`. Rule list: `[]` (Enabled: `True`). {{(pid=207601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 08:24:42.011617 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.fernet_utils [None req-7aa28b6f-e2a7-45be-a40a-700687a5f839 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=207601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:24:42.036351 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e169aa2-0ebf-475a-ba0b-a42ee8aa1f54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:24:42.037056 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e169aa2-0ebf-475a-ba0b-a42ee8aa1f54 None admin] REQUEST_METHOD: `GET` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:24:42.037341 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e169aa2-0ebf-475a-ba0b-a42ee8aa1f54 None admin] SCRIPT_NAME: `/identity` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:24:42.037617 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e169aa2-0ebf-475a-ba0b-a42ee8aa1f54 None admin] PATH_INFO: `/v3/services` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:24:42.038320 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e169aa2-0ebf-475a-ba0b-a42ee8aa1f54 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=207600) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:24:42.038637 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e169aa2-0ebf-475a-ba0b-a42ee8aa1f54 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:24:42.040018 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e169aa2-0ebf-475a-ba0b-a42ee8aa1f54 None admin] RBAC: Authorization granted {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:24:42.048720 dv-cinder-851351-1-smb devstack@keystone.service[207600]: [pid: 207600|app: 0|req: 359/712] 10.222.0.42 () {56 vars in 1124 bytes} [Thu Jul 28 08:24:41 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:24:42.048720 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e169aa2-0ebf-475a-ba0b-a42ee8aa1f54 None admin] Authenticating user token {{(pid=207600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:24:42.088017 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG dbcounter [-] [207600] Writing DB stats keystone:SELECT=100 {{(pid=207600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:24:42.106843 dv-cinder-851351-1-smb devstack@keystone.service[207601]: [pid: 207601|app: 0|req: 354/713] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 08:24:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 08:24:42.108000 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa28b6f-e2a7-45be-a40a-700687a5f839 None None] Authenticating user token {{(pid=207601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:24:42.155671 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG dbcounter [-] [207601] Writing DB stats keystone:SELECT=100 {{(pid=207601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:24:42.165220 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e169aa2-0ebf-475a-ba0b-a42ee8aa1f54 None admin] Validating token access rules against request {{(pid=207600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:24:42.205492 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765b6df2-8409-4c43-b544-59ea24d72667 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:24:42.206447 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765b6df2-8409-4c43-b544-59ea24d72667 None admin] REQUEST_METHOD: `GET` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:24:42.206913 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765b6df2-8409-4c43-b544-59ea24d72667 None admin] SCRIPT_NAME: `/identity` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:24:42.207355 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765b6df2-8409-4c43-b544-59ea24d72667 None admin] PATH_INFO: `/v3/projects` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:24:42.208473 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-765b6df2-8409-4c43-b544-59ea24d72667 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=207600) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:24:42.209116 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-765b6df2-8409-4c43-b544-59ea24d72667 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:24:42.210843 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-765b6df2-8409-4c43-b544-59ea24d72667 None admin] RBAC: Authorization granted {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:24:42.232636 dv-cinder-851351-1-smb devstack@keystone.service[207600]: [pid: 207600|app: 0|req: 360/714] 10.222.0.42 () {56 vars in 1148 bytes} [Thu Jul 28 08:24:42 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:24:42.234043 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765b6df2-8409-4c43-b544-59ea24d72667 None admin] Authenticating user token {{(pid=207600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:24:42.252449 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa28b6f-e2a7-45be-a40a-700687a5f839 None None] Validating token access rules against request {{(pid=207601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:24:42.297796 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e20c78f2-b89c-4c16-bf8a-daad6f7623ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:24:42.298699 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20c78f2-b89c-4c16-bf8a-daad6f7623ca None admin] REQUEST_METHOD: `GET` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:24:42.298995 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20c78f2-b89c-4c16-bf8a-daad6f7623ca None admin] SCRIPT_NAME: `/identity` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:24:42.299280 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20c78f2-b89c-4c16-bf8a-daad6f7623ca None admin] PATH_INFO: `/v3/services` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:24:42.300044 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e20c78f2-b89c-4c16-bf8a-daad6f7623ca None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=207601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:24:42.300825 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e20c78f2-b89c-4c16-bf8a-daad6f7623ca None admin] RBAC: Authorizing `identity:list_services()` {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:24:42.303025 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e20c78f2-b89c-4c16-bf8a-daad6f7623ca None admin] RBAC: Authorization granted {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:24:42.316465 dv-cinder-851351-1-smb devstack@keystone.service[207601]: [pid: 207601|app: 0|req: 355/715] 10.222.0.42 () {56 vars in 1124 bytes} [Thu Jul 28 08:24:42 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:24:42.316465 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e20c78f2-b89c-4c16-bf8a-daad6f7623ca None admin] Authenticating user token {{(pid=207601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:24:42.403871 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG dbcounter [-] [207600] Writing DB stats keystone:SELECT=100 {{(pid=207600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:24:42.422729 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765b6df2-8409-4c43-b544-59ea24d72667 None admin] Validating token access rules against request {{(pid=207600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:24:42.441003 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG dbcounter [-] [207601] Writing DB stats keystone:SELECT=100 {{(pid=207601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:24:42.468726 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e20c78f2-b89c-4c16-bf8a-daad6f7623ca None admin] Validating token access rules against request {{(pid=207601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:24:42.494388 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649c154e-111e-4c7e-a13f-0228e29daac8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:24:42.495213 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649c154e-111e-4c7e-a13f-0228e29daac8 None admin] REQUEST_METHOD: `GET` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:24:42.495697 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649c154e-111e-4c7e-a13f-0228e29daac8 None admin] SCRIPT_NAME: `/identity` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:24:42.496046 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649c154e-111e-4c7e-a13f-0228e29daac8 None admin] PATH_INFO: `/v3/services/network` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:24:42.497418 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-649c154e-111e-4c7e-a13f-0228e29daac8 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:24:42.499834 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-649c154e-111e-4c7e-a13f-0228e29daac8 None admin] RBAC: Authorization granted {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:24:42.519445 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application [None req-649c154e-111e-4c7e-a13f-0228e29daac8 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jul 28 08:24:42.519445 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:24:42.519445 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 28 08:24:42.519445 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 28 08:24:42.519445 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 28 08:24:42.519445 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 28 08:24:42.519445 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 28 08:24:42.519445 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 08:24:42.519445 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 28 08:24:42.519445 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application Jul 28 08:24:42.519445 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 28 08:24:42.519445 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application Jul 28 08:24:42.519445 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:24:42.519445 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:24:42.519445 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:24:42.519445 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:24:42.519445 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:24:42.520582 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:24:42.520582 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:24:42.520582 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:24:42.520582 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:24:42.520582 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:24:42.520582 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:24:42.520582 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 28 08:24:42.520582 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 28 08:24:42.520582 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 28 08:24:42.520582 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 28 08:24:42.520582 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:24:42.520582 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:24:42.520582 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:24:42.520582 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:24:42.520582 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:24:42.520582 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:24:42.521524 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:24:42.521524 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application with Lock( Jul 28 08:24:42.521524 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:24:42.521524 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:24:42.521524 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:24:42.521524 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:24:42.521524 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:24:42.521524 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:24:42.521524 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:24:42.521524 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:24:42.521524 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 28 08:24:42.521524 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 08:24:42.521524 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 28 08:24:42.521524 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application Jul 28 08:24:42.521524 dv-cinder-851351-1-smb devstack@keystone.service[207600]: [pid: 207600|app: 0|req: 361/716] 10.222.0.42 () {56 vars in 1111 bytes} [Thu Jul 28 08:24:42 2022] GET /identity/v3/services/network => generated 88 bytes in 287 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:24:42.530792 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649c154e-111e-4c7e-a13f-0228e29daac8 None admin] Authenticating user token {{(pid=207600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:24:42.537516 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6627868-7d66-409f-a1e8-c9c2aaa9c783 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:24:42.538173 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6627868-7d66-409f-a1e8-c9c2aaa9c783 None admin] REQUEST_METHOD: `GET` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:24:42.538952 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6627868-7d66-409f-a1e8-c9c2aaa9c783 None admin] SCRIPT_NAME: `/identity` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:24:42.539240 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6627868-7d66-409f-a1e8-c9c2aaa9c783 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:24:42.540078 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6627868-7d66-409f-a1e8-c9c2aaa9c783 None admin] RBAC: Adding query filter params (role.id=d0ce88034c6b41878db755343f5840be, scope.project.id=48c5f2b2ae2b48758b957d2b194a7fd1, user.id=03804b1369934a7692da4d5646465bdc) {{(pid=207601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:24:42.545251 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6627868-7d66-409f-a1e8-c9c2aaa9c783 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:24:42.546762 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6627868-7d66-409f-a1e8-c9c2aaa9c783 None admin] RBAC: Authorization granted {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:24:42.561323 dv-cinder-851351-1-smb devstack@keystone.service[207601]: [pid: 207601|app: 0|req: 356/717] 10.222.0.42 () {56 vars in 1374 bytes} [Thu Jul 28 08:24:42 2022] GET /identity/v3/role_assignments?user.id=03804b1369934a7692da4d5646465bdc&scope.project.id=48c5f2b2ae2b48758b957d2b194a7fd1&role.id=d0ce88034c6b41878db755343f5840be => generated 259 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:24:42.687755 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649c154e-111e-4c7e-a13f-0228e29daac8 None admin] Validating token access rules against request {{(pid=207600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:24:42.727398 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd1ef89-fc05-4390-aae5-3cd52870d3ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:24:42.728207 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd1ef89-fc05-4390-aae5-3cd52870d3ae None admin] REQUEST_METHOD: `GET` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:24:42.728207 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd1ef89-fc05-4390-aae5-3cd52870d3ae None admin] SCRIPT_NAME: `/identity` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:24:42.728590 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd1ef89-fc05-4390-aae5-3cd52870d3ae None admin] PATH_INFO: `/v3/services` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:24:42.729296 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cd1ef89-fc05-4390-aae5-3cd52870d3ae None admin] RBAC: Adding query filter params (name=network) {{(pid=207600) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:24:42.729606 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cd1ef89-fc05-4390-aae5-3cd52870d3ae None admin] RBAC: Authorizing `identity:list_services()` {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:24:42.731117 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cd1ef89-fc05-4390-aae5-3cd52870d3ae None admin] RBAC: Authorization granted {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:24:42.741003 dv-cinder-851351-1-smb devstack@keystone.service[207600]: [pid: 207600|app: 0|req: 362/718] 10.222.0.42 () {56 vars in 1112 bytes} [Thu Jul 28 08:24:42 2022] GET /identity/v3/services?name=network => generated 124 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:24:42.743167 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6627868-7d66-409f-a1e8-c9c2aaa9c783 None admin] Authenticating user token {{(pid=207601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:24:42.856205 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6627868-7d66-409f-a1e8-c9c2aaa9c783 None admin] Validating token access rules against request {{(pid=207601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:24:42.893148 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a357a66-e5fe-4f58-9a31-62d8fc132b98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:24:42.894084 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a357a66-e5fe-4f58-9a31-62d8fc132b98 None admin] REQUEST_METHOD: `GET` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:24:42.894084 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a357a66-e5fe-4f58-9a31-62d8fc132b98 None admin] SCRIPT_NAME: `/identity` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:24:42.894439 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a357a66-e5fe-4f58-9a31-62d8fc132b98 None admin] PATH_INFO: `/v3/services` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:24:42.895064 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a357a66-e5fe-4f58-9a31-62d8fc132b98 None admin] RBAC: Adding query filter params (type=network) {{(pid=207601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:24:42.895407 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a357a66-e5fe-4f58-9a31-62d8fc132b98 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:24:42.896819 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a357a66-e5fe-4f58-9a31-62d8fc132b98 None admin] RBAC: Authorization granted {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:24:42.902752 dv-cinder-851351-1-smb devstack@keystone.service[207601]: [pid: 207601|app: 0|req: 357/719] 10.222.0.42 () {56 vars in 1112 bytes} [Thu Jul 28 08:24:42 2022] GET /identity/v3/services?type=network => generated 124 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:24:43.622706 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aec93bf-8cb9-4419-bc31-7a9f7b272747 None None] REQUEST_METHOD: `GET` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:24:43.623144 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aec93bf-8cb9-4419-bc31-7a9f7b272747 None None] SCRIPT_NAME: `/identity` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:24:43.623339 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aec93bf-8cb9-4419-bc31-7a9f7b272747 None None] PATH_INFO: `/` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:24:43.624992 dv-cinder-851351-1-smb devstack@keystone.service[207600]: [pid: 207600|app: 0|req: 363/720] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 08:24:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 08:24:43.631388 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4276903a-7e11-430f-996c-bd1dc85e8cb5 None None] REQUEST_METHOD: `POST` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:24:43.632051 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4276903a-7e11-430f-996c-bd1dc85e8cb5 None None] SCRIPT_NAME: `/identity` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:24:43.632051 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4276903a-7e11-430f-996c-bd1dc85e8cb5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:24:43.657980 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.auth.core [None req-4276903a-7e11-430f-996c-bd1dc85e8cb5 None None] MFA Rules not processed for user `b8110ade874c4aa7af27f5c376df700a`. Rule list: `[]` (Enabled: `True`). {{(pid=207601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 08:24:43.659268 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.fernet_utils [None req-4276903a-7e11-430f-996c-bd1dc85e8cb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=207601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:24:43.672885 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG dbcounter [-] [207601] Writing DB stats keystone:SELECT=100 {{(pid=207601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:24:43.752450 dv-cinder-851351-1-smb devstack@keystone.service[207601]: [pid: 207601|app: 0|req: 358/721] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 08:24:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 08:24:43.792364 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aec93bf-8cb9-4419-bc31-7a9f7b272747 None None] Authenticating user token {{(pid=207600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:24:43.852069 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG dbcounter [-] [207600] Writing DB stats keystone:SELECT=100 {{(pid=207600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:24:44.042655 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aec93bf-8cb9-4419-bc31-7a9f7b272747 None None] Validating token access rules against request {{(pid=207600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:24:44.084191 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8068625d-4c22-4d77-8346-e6a13cd22404 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:24:44.084881 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8068625d-4c22-4d77-8346-e6a13cd22404 None admin] REQUEST_METHOD: `GET` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:24:44.085169 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8068625d-4c22-4d77-8346-e6a13cd22404 None admin] SCRIPT_NAME: `/identity` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:24:44.085446 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8068625d-4c22-4d77-8346-e6a13cd22404 None admin] PATH_INFO: `/v3/roles/service` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:24:44.102037 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8068625d-4c22-4d77-8346-e6a13cd22404 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 08:24:44.107567 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application [None req-8068625d-4c22-4d77-8346-e6a13cd22404 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 28 08:24:44.107567 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:24:44.107567 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:24:44.107567 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:24:44.107567 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:24:44.107567 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:24:44.107567 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:24:44.107567 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:24:44.107567 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:24:44.107567 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:24:44.107567 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:24:44.107567 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:24:44.107567 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 08:24:44.107567 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 08:24:44.107567 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 08:24:44.107567 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 08:24:44.108586 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 08:24:44.108586 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 08:24:44.108586 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 08:24:44.108586 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 08:24:44.108586 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:24:44.108586 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:24:44.108586 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:24:44.108586 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:24:44.108586 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:24:44.108586 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:24:44.108586 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:24:44.108586 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application with Lock( Jul 28 08:24:44.108586 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:24:44.108586 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:24:44.108586 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:24:44.108586 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:24:44.109532 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:24:44.109532 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:24:44.109532 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:24:44.109532 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:24:44.109532 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 08:24:44.109532 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 08:24:44.109532 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 08:24:44.109532 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 08:24:44.109532 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 08:24:44.109532 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 08:24:44.109532 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 28 08:24:44.109532 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application Jul 28 08:24:44.111735 dv-cinder-851351-1-smb devstack@keystone.service[207600]: [pid: 207600|app: 0|req: 364/722] 10.222.0.42 () {56 vars in 1102 bytes} [Thu Jul 28 08:24:43 2022] GET /identity/v3/roles/service => generated 85 bytes in 317 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:24:44.117781 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4276903a-7e11-430f-996c-bd1dc85e8cb5 None None] Authenticating user token {{(pid=207601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:24:44.289670 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4276903a-7e11-430f-996c-bd1dc85e8cb5 None None] Validating token access rules against request {{(pid=207601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:24:44.341940 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb712f41-3310-43c7-a30c-5506212d5ce5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:24:44.342587 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb712f41-3310-43c7-a30c-5506212d5ce5 None admin] REQUEST_METHOD: `GET` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:24:44.342875 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb712f41-3310-43c7-a30c-5506212d5ce5 None admin] SCRIPT_NAME: `/identity` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:24:44.343158 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb712f41-3310-43c7-a30c-5506212d5ce5 None admin] PATH_INFO: `/v3/roles` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:24:44.343905 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb712f41-3310-43c7-a30c-5506212d5ce5 None admin] RBAC: Adding query filter params (name=service) {{(pid=207601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:24:44.344215 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb712f41-3310-43c7-a30c-5506212d5ce5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:24:44.345632 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb712f41-3310-43c7-a30c-5506212d5ce5 None admin] RBAC: Authorization granted {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:24:44.357729 dv-cinder-851351-1-smb devstack@keystone.service[207601]: [pid: 207601|app: 0|req: 359/723] 10.222.0.42 () {56 vars in 1103 bytes} [Thu Jul 28 08:24:44 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 08:24:44.364127 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8068625d-4c22-4d77-8346-e6a13cd22404 None admin] Authenticating user token {{(pid=207600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:24:44.414334 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6dc6bd4-e2c2-40c2-9568-540b3b25a3c9 None None] REQUEST_METHOD: `GET` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:24:44.414676 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6dc6bd4-e2c2-40c2-9568-540b3b25a3c9 None None] SCRIPT_NAME: `/identity` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:24:44.414905 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6dc6bd4-e2c2-40c2-9568-540b3b25a3c9 None None] PATH_INFO: `/` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:24:44.416490 dv-cinder-851351-1-smb devstack@keystone.service[207601]: [pid: 207601|app: 0|req: 360/724] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 08:24:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 28 08:24:44.422041 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd8b769-14a1-4f37-a9e9-f1fead4e0a76 None None] REQUEST_METHOD: `POST` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:24:44.422333 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd8b769-14a1-4f37-a9e9-f1fead4e0a76 None None] SCRIPT_NAME: `/identity` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:24:44.422615 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd8b769-14a1-4f37-a9e9-f1fead4e0a76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:24:44.456437 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.auth.core [None req-0fd8b769-14a1-4f37-a9e9-f1fead4e0a76 None None] MFA Rules not processed for user `b8110ade874c4aa7af27f5c376df700a`. Rule list: `[]` (Enabled: `True`). {{(pid=207601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 08:24:44.460931 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.fernet_utils [None req-0fd8b769-14a1-4f37-a9e9-f1fead4e0a76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=207601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:24:44.465120 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG dbcounter [-] [207601] Writing DB stats keystone:SELECT=100 {{(pid=207601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:24:44.509108 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG dbcounter [-] [207600] Writing DB stats keystone:SELECT=100 {{(pid=207600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:24:44.545959 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8068625d-4c22-4d77-8346-e6a13cd22404 None admin] Validating token access rules against request {{(pid=207600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:24:44.613521 dv-cinder-851351-1-smb devstack@keystone.service[207601]: [pid: 207601|app: 0|req: 361/725] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 08:24:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 08:24:44.627342 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d599c8f3-3b2e-4baf-bfd2-40503fb1ae88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:24:44.628024 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d599c8f3-3b2e-4baf-bfd2-40503fb1ae88 None admin] REQUEST_METHOD: `GET` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:24:44.628312 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d599c8f3-3b2e-4baf-bfd2-40503fb1ae88 None admin] SCRIPT_NAME: `/identity` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:24:44.628591 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d599c8f3-3b2e-4baf-bfd2-40503fb1ae88 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:24:44.644187 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd8b769-14a1-4f37-a9e9-f1fead4e0a76 None None] Authenticating user token {{(pid=207601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:24:44.650706 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d599c8f3-3b2e-4baf-bfd2-40503fb1ae88 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:24:44.652044 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d599c8f3-3b2e-4baf-bfd2-40503fb1ae88 None admin] RBAC: Authorization granted {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:24:44.673110 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application [None req-d599c8f3-3b2e-4baf-bfd2-40503fb1ae88 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 08:24:44.673110 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:24:44.673110 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:24:44.673110 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:24:44.673110 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:24:44.673110 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:24:44.673110 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:24:44.673110 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:24:44.673110 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:24:44.673110 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:24:44.673110 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:24:44.673110 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:24:44.673110 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 08:24:44.673110 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 08:24:44.673110 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 08:24:44.674167 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 08:24:44.674167 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:24:44.674167 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:24:44.674167 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:24:44.674167 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:24:44.674167 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:24:44.674167 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:24:44.674167 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:24:44.674167 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application with Lock( Jul 28 08:24:44.674167 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:24:44.674167 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:24:44.674167 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:24:44.674167 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:24:44.674167 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:24:44.674167 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:24:44.674167 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:24:44.674167 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:24:44.675143 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 08:24:44.675143 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 08:24:44.675143 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 08:24:44.675143 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application Jul 28 08:24:44.675143 dv-cinder-851351-1-smb devstack@keystone.service[207600]: [pid: 207600|app: 0|req: 365/726] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 08:24:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 311 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:24:44.681783 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d599c8f3-3b2e-4baf-bfd2-40503fb1ae88 None admin] Authenticating user token {{(pid=207600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:24:44.759303 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd8b769-14a1-4f37-a9e9-f1fead4e0a76 None None] Validating token access rules against request {{(pid=207601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:24:44.797506 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03418f19-6b79-47c3-8473-b3724b16dd85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:24:44.798113 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03418f19-6b79-47c3-8473-b3724b16dd85 None admin] REQUEST_METHOD: `GET` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:24:44.798451 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03418f19-6b79-47c3-8473-b3724b16dd85 None admin] SCRIPT_NAME: `/identity` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:24:44.798749 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03418f19-6b79-47c3-8473-b3724b16dd85 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:24:44.808376 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG dbcounter [-] [207601] Writing DB stats keystone:SELECT=100 {{(pid=207601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:24:44.813659 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03418f19-6b79-47c3-8473-b3724b16dd85 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 08:24:44.818874 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application [None req-03418f19-6b79-47c3-8473-b3724b16dd85 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 08:24:44.818874 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:24:44.818874 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:24:44.818874 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:24:44.818874 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:24:44.818874 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:24:44.818874 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:24:44.818874 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:24:44.818874 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:24:44.818874 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:24:44.818874 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:24:44.818874 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:24:44.818874 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 08:24:44.818874 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 08:24:44.818874 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 08:24:44.818874 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 08:24:44.821109 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 08:24:44.821109 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 08:24:44.821109 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 08:24:44.821109 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 08:24:44.821109 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:24:44.821109 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:24:44.821109 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:24:44.821109 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:24:44.821109 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:24:44.821109 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:24:44.821109 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:24:44.821109 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application with Lock( Jul 28 08:24:44.821109 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:24:44.821109 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:24:44.821109 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:24:44.821109 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:24:44.823215 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:24:44.823215 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:24:44.823215 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:24:44.823215 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:24:44.823215 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 08:24:44.823215 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 08:24:44.823215 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 08:24:44.823215 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 08:24:44.823215 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 08:24:44.823215 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 08:24:44.823215 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 08:24:44.823215 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application Jul 28 08:24:44.823215 dv-cinder-851351-1-smb devstack@keystone.service[207601]: [pid: 207601|app: 0|req: 362/727] 10.222.0.42 () {56 vars in 1096 bytes} [Thu Jul 28 08:24:44 2022] GET /identity/v3/roles/admin => generated 83 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:24:44.828696 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03418f19-6b79-47c3-8473-b3724b16dd85 None admin] Authenticating user token {{(pid=207601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:24:44.882962 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d599c8f3-3b2e-4baf-bfd2-40503fb1ae88 None admin] Validating token access rules against request {{(pid=207600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:24:44.914943 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG dbcounter [-] [207600] Writing DB stats keystone:SELECT=100 {{(pid=207600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:24:44.926047 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556508e4-6a57-4e4e-a69e-e26748ce57f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:24:44.927246 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556508e4-6a57-4e4e-a69e-e26748ce57f5 None admin] REQUEST_METHOD: `GET` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:24:44.927627 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556508e4-6a57-4e4e-a69e-e26748ce57f5 None admin] SCRIPT_NAME: `/identity` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:24:44.928001 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556508e4-6a57-4e4e-a69e-e26748ce57f5 None admin] PATH_INFO: `/v3/domains` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:24:44.929083 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-556508e4-6a57-4e4e-a69e-e26748ce57f5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=207600) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:24:44.929491 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-556508e4-6a57-4e4e-a69e-e26748ce57f5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:24:44.931405 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-556508e4-6a57-4e4e-a69e-e26748ce57f5 None admin] RBAC: Authorization granted {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:24:44.946761 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03418f19-6b79-47c3-8473-b3724b16dd85 None admin] Validating token access rules against request {{(pid=207601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:24:44.952703 dv-cinder-851351-1-smb devstack@keystone.service[207600]: [pid: 207600|app: 0|req: 366/728] 10.222.0.42 () {56 vars in 1109 bytes} [Thu Jul 28 08:24:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 08:24:44.952703 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee74e22-dba5-42d2-aac0-33cc39f95fad None None] REQUEST_METHOD: `GET` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:24:44.952703 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee74e22-dba5-42d2-aac0-33cc39f95fad None None] SCRIPT_NAME: `/identity` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:24:44.952703 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee74e22-dba5-42d2-aac0-33cc39f95fad None None] PATH_INFO: `/` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:24:44.956767 dv-cinder-851351-1-smb devstack@keystone.service[207600]: [pid: 207600|app: 0|req: 367/729] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 08:24:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 08:24:44.957861 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee74e22-dba5-42d2-aac0-33cc39f95fad None None] Authenticating user token {{(pid=207600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:24:44.992580 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254f0621-45fa-4521-99fc-629b8bdbb4a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:24:44.993295 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254f0621-45fa-4521-99fc-629b8bdbb4a2 None admin] REQUEST_METHOD: `GET` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:24:44.993575 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254f0621-45fa-4521-99fc-629b8bdbb4a2 None admin] SCRIPT_NAME: `/identity` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:24:44.994033 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254f0621-45fa-4521-99fc-629b8bdbb4a2 None admin] PATH_INFO: `/v3/roles` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:24:44.994702 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-254f0621-45fa-4521-99fc-629b8bdbb4a2 None admin] RBAC: Adding query filter params (name=admin) {{(pid=207601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:24:44.995011 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-254f0621-45fa-4521-99fc-629b8bdbb4a2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:24:44.996461 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-254f0621-45fa-4521-99fc-629b8bdbb4a2 None admin] RBAC: Authorization granted {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:24:45.010365 dv-cinder-851351-1-smb devstack@keystone.service[207601]: [pid: 207601|app: 0|req: 363/730] 10.222.0.42 () {56 vars in 1099 bytes} [Thu Jul 28 08:24:44 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:24:45.011740 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ff039a-fd04-4fe6-94d5-fb0520859341 None None] REQUEST_METHOD: `POST` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:24:45.012030 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ff039a-fd04-4fe6-94d5-fb0520859341 None None] SCRIPT_NAME: `/identity` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:24:45.012312 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ff039a-fd04-4fe6-94d5-fb0520859341 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:24:45.030734 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.auth.core [None req-16ff039a-fd04-4fe6-94d5-fb0520859341 None None] MFA Rules not processed for user `b8110ade874c4aa7af27f5c376df700a`. Rule list: `[]` (Enabled: `True`). {{(pid=207601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 08:24:45.031930 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.fernet_utils [None req-16ff039a-fd04-4fe6-94d5-fb0520859341 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=207601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:24:45.078225 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee74e22-dba5-42d2-aac0-33cc39f95fad None None] Validating token access rules against request {{(pid=207600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:24:45.090586 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG dbcounter [-] [207601] Writing DB stats keystone:SELECT=100 {{(pid=207601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:24:45.108687 dv-cinder-851351-1-smb devstack@keystone.service[207601]: [pid: 207601|app: 0|req: 364/731] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 08:24:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 08:24:45.108687 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ff039a-fd04-4fe6-94d5-fb0520859341 None None] Authenticating user token {{(pid=207601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:24:45.130567 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc12914a-638b-4d88-b045-a4138d4f88e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:24:45.131595 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc12914a-638b-4d88-b045-a4138d4f88e2 None admin] REQUEST_METHOD: `GET` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:24:45.132117 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc12914a-638b-4d88-b045-a4138d4f88e2 None admin] SCRIPT_NAME: `/identity` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:24:45.132592 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc12914a-638b-4d88-b045-a4138d4f88e2 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:24:45.147090 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc12914a-638b-4d88-b045-a4138d4f88e2 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:24:45.148978 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc12914a-638b-4d88-b045-a4138d4f88e2 None admin] RBAC: Authorization granted {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:24:45.166036 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application [None req-fc12914a-638b-4d88-b045-a4138d4f88e2 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 28 08:24:45.166036 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:24:45.166036 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:24:45.166036 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:24:45.166036 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:24:45.166036 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:24:45.166036 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:24:45.166036 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:24:45.166036 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:24:45.166036 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:24:45.166036 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:24:45.166036 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:24:45.166036 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 28 08:24:45.166036 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 28 08:24:45.166036 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 28 08:24:45.166036 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 28 08:24:45.167121 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:24:45.167121 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:24:45.167121 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 28 08:24:45.167121 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 08:24:45.167121 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 28 08:24:45.167121 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 08:24:45.167121 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:24:45.167121 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:24:45.167121 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:24:45.167121 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:24:45.167121 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:24:45.167121 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application with Lock( Jul 28 08:24:45.167121 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:24:45.167121 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:24:45.167121 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:24:45.167121 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:24:45.167121 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:24:45.167121 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:24:45.168123 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:24:45.168123 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:24:45.168123 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 28 08:24:45.168123 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 28 08:24:45.168123 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 28 08:24:45.168123 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 28 08:24:45.168123 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 28 08:24:45.168123 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 28 08:24:45.168123 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 28 08:24:45.168123 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application Jul 28 08:24:45.170809 dv-cinder-851351-1-smb devstack@keystone.service[207600]: [pid: 207600|app: 0|req: 368/732] 10.222.0.42 () {56 vars in 1117 bytes} [Thu Jul 28 08:24:44 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:24:45.171795 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc12914a-638b-4d88-b045-a4138d4f88e2 None admin] Authenticating user token {{(pid=207600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:24:45.217941 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ff039a-fd04-4fe6-94d5-fb0520859341 None None] Validating token access rules against request {{(pid=207601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:24:45.231301 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG dbcounter [-] [207600] Writing DB stats keystone:SELECT=100 {{(pid=207600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:24:45.255067 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6805d84e-a4b9-48b1-a4ac-0f7efe227429 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:24:45.255732 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6805d84e-a4b9-48b1-a4ac-0f7efe227429 None admin] REQUEST_METHOD: `GET` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:24:45.256069 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6805d84e-a4b9-48b1-a4ac-0f7efe227429 None admin] SCRIPT_NAME: `/identity` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:24:45.256386 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6805d84e-a4b9-48b1-a4ac-0f7efe227429 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:24:45.267822 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6805d84e-a4b9-48b1-a4ac-0f7efe227429 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:24:45.269321 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6805d84e-a4b9-48b1-a4ac-0f7efe227429 None admin] RBAC: Authorization granted {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:24:45.285330 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc12914a-638b-4d88-b045-a4138d4f88e2 None admin] Validating token access rules against request {{(pid=207600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:24:45.285523 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application [None req-6805d84e-a4b9-48b1-a4ac-0f7efe227429 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 08:24:45.285523 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:24:45.285523 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:24:45.285523 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:24:45.285523 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:24:45.285523 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:24:45.285523 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:24:45.285523 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:24:45.285523 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:24:45.285523 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:24:45.285523 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:24:45.285523 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:24:45.285523 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 08:24:45.285523 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 08:24:45.285523 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 08:24:45.286410 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 08:24:45.286410 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:24:45.286410 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:24:45.286410 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:24:45.286410 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:24:45.286410 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:24:45.286410 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:24:45.286410 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:24:45.286410 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application with Lock( Jul 28 08:24:45.286410 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:24:45.286410 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:24:45.286410 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:24:45.286410 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:24:45.286410 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:24:45.286410 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:24:45.286410 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:24:45.286410 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:24:45.287371 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 08:24:45.287371 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 08:24:45.287371 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 08:24:45.287371 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application Jul 28 08:24:45.287371 dv-cinder-851351-1-smb devstack@keystone.service[207601]: [pid: 207601|app: 0|req: 365/733] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 08:24:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:24:45.292466 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6805d84e-a4b9-48b1-a4ac-0f7efe227429 None admin] Authenticating user token {{(pid=207601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:24:45.329627 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f3554a-2873-46e9-85d1-9dc123dcd611 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:24:45.330615 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f3554a-2873-46e9-85d1-9dc123dcd611 None admin] REQUEST_METHOD: `POST` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:24:45.331100 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f3554a-2873-46e9-85d1-9dc123dcd611 None admin] SCRIPT_NAME: `/identity` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:24:45.331590 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f3554a-2873-46e9-85d1-9dc123dcd611 None admin] PATH_INFO: `/v3/services` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:24:45.332514 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19f3554a-2873-46e9-85d1-9dc123dcd611 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:24:45.334212 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19f3554a-2873-46e9-85d1-9dc123dcd611 None admin] RBAC: Authorization granted {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:24:45.338063 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG dbcounter [-] [207601] Writing DB stats keystone:SELECT=100 {{(pid=207601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:24:45.360853 dv-cinder-851351-1-smb devstack@keystone.service[207600]: [pid: 207600|app: 0|req: 369/734] 10.222.0.42 () {60 vars in 1141 bytes} [Thu Jul 28 08:24:45 2022] POST /identity/v3/services => generated 251 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 08:24:45.360853 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f3554a-2873-46e9-85d1-9dc123dcd611 None admin] Authenticating user token {{(pid=207600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:24:45.425642 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6805d84e-a4b9-48b1-a4ac-0f7efe227429 None admin] Validating token access rules against request {{(pid=207601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:24:45.483718 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-813be259-cf8b-4d6d-aa77-0b7d28c032ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:24:45.484379 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813be259-cf8b-4d6d-aa77-0b7d28c032ef None admin] REQUEST_METHOD: `GET` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:24:45.484685 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813be259-cf8b-4d6d-aa77-0b7d28c032ef None admin] SCRIPT_NAME: `/identity` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:24:45.485067 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813be259-cf8b-4d6d-aa77-0b7d28c032ef None admin] PATH_INFO: `/v3/users` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:24:45.486007 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-813be259-cf8b-4d6d-aa77-0b7d28c032ef None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=207601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:24:45.486327 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-813be259-cf8b-4d6d-aa77-0b7d28c032ef None admin] RBAC: Authorizing `identity:list_users()` {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:24:45.487811 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-813be259-cf8b-4d6d-aa77-0b7d28c032ef None admin] RBAC: Authorization granted {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:24:45.493778 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f3554a-2873-46e9-85d1-9dc123dcd611 None admin] Validating token access rules against request {{(pid=207600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:24:45.512162 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG dbcounter [-] [207600] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=207600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:24:45.513481 dv-cinder-851351-1-smb devstack@keystone.service[207601]: [pid: 207601|app: 0|req: 366/735] 10.222.0.42 () {56 vars in 1149 bytes} [Thu Jul 28 08:24:45 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:24:45.515255 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2736555f-e78d-4292-a315-db3b68be27a5 None None] REQUEST_METHOD: `GET` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:24:45.515779 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2736555f-e78d-4292-a315-db3b68be27a5 None None] SCRIPT_NAME: `/identity` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:24:45.516207 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2736555f-e78d-4292-a315-db3b68be27a5 None None] PATH_INFO: `/` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:24:45.522863 dv-cinder-851351-1-smb devstack@keystone.service[207601]: [pid: 207601|app: 0|req: 367/736] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 08:24:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 08:24:45.524103 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2736555f-e78d-4292-a315-db3b68be27a5 None None] Authenticating user token {{(pid=207601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:24:45.537719 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dca883f-3ef5-4810-8544-443d83b926b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:24:45.538372 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dca883f-3ef5-4810-8544-443d83b926b2 None admin] REQUEST_METHOD: `GET` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:24:45.538664 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dca883f-3ef5-4810-8544-443d83b926b2 None admin] SCRIPT_NAME: `/identity` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:24:45.538943 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dca883f-3ef5-4810-8544-443d83b926b2 None admin] PATH_INFO: `/v3/domains` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:24:45.539663 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dca883f-3ef5-4810-8544-443d83b926b2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=207600) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:24:45.539979 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dca883f-3ef5-4810-8544-443d83b926b2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:24:45.541566 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dca883f-3ef5-4810-8544-443d83b926b2 None admin] RBAC: Authorization granted {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:24:45.555356 dv-cinder-851351-1-smb devstack@keystone.service[207600]: [pid: 207600|app: 0|req: 370/737] 10.222.0.42 () {56 vars in 1109 bytes} [Thu Jul 28 08:24:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:24:45.556948 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e75589-0b13-4ef1-9843-a3144864e9e4 None None] REQUEST_METHOD: `POST` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:24:45.557242 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e75589-0b13-4ef1-9843-a3144864e9e4 None None] SCRIPT_NAME: `/identity` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:24:45.557529 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e75589-0b13-4ef1-9843-a3144864e9e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:24:45.576372 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.auth.core [None req-30e75589-0b13-4ef1-9843-a3144864e9e4 None None] MFA Rules not processed for user `b8110ade874c4aa7af27f5c376df700a`. Rule list: `[]` (Enabled: `True`). {{(pid=207600) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 08:24:45.577807 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.fernet_utils [None req-30e75589-0b13-4ef1-9843-a3144864e9e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=207600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:24:45.643762 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG dbcounter [-] [207601] Writing DB stats keystone:SELECT=100 {{(pid=207601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:24:45.651328 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2736555f-e78d-4292-a315-db3b68be27a5 None None] Validating token access rules against request {{(pid=207601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:24:45.660890 dv-cinder-851351-1-smb devstack@keystone.service[207600]: [pid: 207600|app: 0|req: 371/738] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 08:24:45 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 08:24:45.661780 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e75589-0b13-4ef1-9843-a3144864e9e4 None None] Authenticating user token {{(pid=207600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:24:45.690434 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37557c13-04e6-4558-9a3e-bb4a4a606e94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:24:45.691688 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37557c13-04e6-4558-9a3e-bb4a4a606e94 None admin] REQUEST_METHOD: `GET` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:24:45.692205 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37557c13-04e6-4558-9a3e-bb4a4a606e94 None admin] SCRIPT_NAME: `/identity` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:24:45.692773 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37557c13-04e6-4558-9a3e-bb4a4a606e94 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:24:45.768353 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e75589-0b13-4ef1-9843-a3144864e9e4 None None] Validating token access rules against request {{(pid=207600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:24:45.768771 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37557c13-04e6-4558-9a3e-bb4a4a606e94 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:24:45.770007 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG dbcounter [-] [207600] Writing DB stats keystone:SELECT=100 {{(pid=207600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:24:45.770345 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37557c13-04e6-4558-9a3e-bb4a4a606e94 None admin] RBAC: Authorization granted {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:24:45.805803 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5434bb-e19b-4cbb-b2ba-ff4a6273acf6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:24:45.806505 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5434bb-e19b-4cbb-b2ba-ff4a6273acf6 None admin] REQUEST_METHOD: `GET` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:24:45.806787 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5434bb-e19b-4cbb-b2ba-ff4a6273acf6 None admin] SCRIPT_NAME: `/identity` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:24:45.807072 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5434bb-e19b-4cbb-b2ba-ff4a6273acf6 None admin] PATH_INFO: `/v3/users/swift` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:24:45.814838 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd5434bb-e19b-4cbb-b2ba-ff4a6273acf6 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:24:45.816305 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd5434bb-e19b-4cbb-b2ba-ff4a6273acf6 None admin] RBAC: Authorization granted {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:24:45.828988 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application [None req-fd5434bb-e19b-4cbb-b2ba-ff4a6273acf6 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 28 08:24:45.828988 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:24:45.828988 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:24:45.828988 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:24:45.828988 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:24:45.828988 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:24:45.828988 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:24:45.828988 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:24:45.828988 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:24:45.828988 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:24:45.828988 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:24:45.828988 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:24:45.828988 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 28 08:24:45.828988 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 28 08:24:45.828988 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 28 08:24:45.828988 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 28 08:24:45.830149 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:24:45.830149 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:24:45.830149 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 28 08:24:45.830149 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 08:24:45.830149 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 28 08:24:45.830149 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 08:24:45.830149 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:24:45.830149 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:24:45.830149 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:24:45.830149 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:24:45.830149 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:24:45.830149 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application with Lock( Jul 28 08:24:45.830149 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:24:45.830149 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:24:45.830149 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:24:45.830149 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:24:45.830149 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:24:45.830149 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:24:45.831146 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:24:45.831146 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:24:45.831146 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 28 08:24:45.831146 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 28 08:24:45.831146 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 28 08:24:45.831146 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 28 08:24:45.831146 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 28 08:24:45.831146 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 28 08:24:45.831146 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 28 08:24:45.831146 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application Jul 28 08:24:45.831146 dv-cinder-851351-1-smb devstack@keystone.service[207600]: [pid: 207600|app: 0|req: 372/739] 10.222.0.42 () {56 vars in 1096 bytes} [Thu Jul 28 08:24:45 2022] GET /identity/v3/users/swift => generated 83 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:24:45.831768 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5434bb-e19b-4cbb-b2ba-ff4a6273acf6 None admin] Authenticating user token {{(pid=207600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:24:45.878159 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG dbcounter [-] [207601] Writing DB stats keystone:SELECT=100 {{(pid=207601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:24:45.894391 dv-cinder-851351-1-smb devstack@keystone.service[207601]: [pid: 207601|app: 0|req: 368/740] 10.222.0.42 () {58 vars in 1282 bytes} [Thu Jul 28 08:24:45 2022] GET /identity/v3/auth/tokens => generated 903 bytes in 370 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 28 08:24:45.895766 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9b7ac8-e8aa-4385-a15c-f972c310abc3 None None] REQUEST_METHOD: `GET` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:24:45.896060 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9b7ac8-e8aa-4385-a15c-f972c310abc3 None None] SCRIPT_NAME: `/identity` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:24:45.896343 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9b7ac8-e8aa-4385-a15c-f972c310abc3 None None] PATH_INFO: `/` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:24:45.900868 dv-cinder-851351-1-smb devstack@keystone.service[207601]: [pid: 207601|app: 0|req: 369/741] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 08:24:45 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 08:24:45.902146 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9b7ac8-e8aa-4385-a15c-f972c310abc3 None None] Authenticating user token {{(pid=207601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:24:45.961660 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5434bb-e19b-4cbb-b2ba-ff4a6273acf6 None admin] Validating token access rules against request {{(pid=207600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:24:46.010675 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a44b1f-fd66-42e3-abec-7c70cf05a865 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:24:46.011341 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a44b1f-fd66-42e3-abec-7c70cf05a865 None admin] REQUEST_METHOD: `GET` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:24:46.011626 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a44b1f-fd66-42e3-abec-7c70cf05a865 None admin] SCRIPT_NAME: `/identity` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:24:46.011903 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a44b1f-fd66-42e3-abec-7c70cf05a865 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:24:46.023372 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9a44b1f-fd66-42e3-abec-7c70cf05a865 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 08:24:46.026878 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9b7ac8-e8aa-4385-a15c-f972c310abc3 None None] Validating token access rules against request {{(pid=207601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:24:46.029033 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application [None req-f9a44b1f-fd66-42e3-abec-7c70cf05a865 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 08:24:46.029033 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:24:46.029033 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:24:46.029033 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:24:46.029033 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:24:46.029033 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:24:46.029033 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:24:46.029033 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:24:46.029033 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:24:46.029033 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:24:46.029033 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:24:46.029033 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:24:46.029033 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 08:24:46.029033 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 08:24:46.029033 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 08:24:46.029033 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 08:24:46.030193 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 08:24:46.030193 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 08:24:46.030193 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 08:24:46.030193 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 08:24:46.030193 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:24:46.030193 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:24:46.030193 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:24:46.030193 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:24:46.030193 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:24:46.030193 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:24:46.030193 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:24:46.030193 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application with Lock( Jul 28 08:24:46.030193 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:24:46.030193 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:24:46.030193 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:24:46.030193 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:24:46.031194 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:24:46.031194 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:24:46.031194 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:24:46.031194 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:24:46.031194 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 08:24:46.031194 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 08:24:46.031194 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 08:24:46.031194 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 08:24:46.031194 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 08:24:46.031194 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 08:24:46.031194 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 08:24:46.031194 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application Jul 28 08:24:46.031194 dv-cinder-851351-1-smb devstack@keystone.service[207600]: [pid: 207600|app: 0|req: 373/742] 10.222.0.42 () {56 vars in 1096 bytes} [Thu Jul 28 08:24:45 2022] GET /identity/v3/roles/admin => generated 83 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:24:46.031194 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a44b1f-fd66-42e3-abec-7c70cf05a865 None admin] Authenticating user token {{(pid=207600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:24:46.060565 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG dbcounter [-] [207600] Writing DB stats keystone:SELECT=100 {{(pid=207600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:24:46.071648 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b73a26-3914-47a0-8d94-ce558923af2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:24:46.072352 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b73a26-3914-47a0-8d94-ce558923af2f None admin] REQUEST_METHOD: `GET` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:24:46.072639 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b73a26-3914-47a0-8d94-ce558923af2f None admin] SCRIPT_NAME: `/identity` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:24:46.072955 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b73a26-3914-47a0-8d94-ce558923af2f None admin] PATH_INFO: `/v3/users` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:24:46.073776 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b73a26-3914-47a0-8d94-ce558923af2f None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=207601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:24:46.074093 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b73a26-3914-47a0-8d94-ce558923af2f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:24:46.075558 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b73a26-3914-47a0-8d94-ce558923af2f None admin] RBAC: Authorization granted {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:24:46.099214 dv-cinder-851351-1-smb devstack@keystone.service[207601]: [pid: 207601|app: 0|req: 370/743] 10.222.0.42 () {56 vars in 1135 bytes} [Thu Jul 28 08:24:45 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:24:46.099214 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426df614-28a9-4b23-8264-c7497e16fc6b None None] REQUEST_METHOD: `POST` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:24:46.099214 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426df614-28a9-4b23-8264-c7497e16fc6b None None] SCRIPT_NAME: `/identity` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:24:46.099214 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426df614-28a9-4b23-8264-c7497e16fc6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:24:46.114937 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.auth.core [None req-426df614-28a9-4b23-8264-c7497e16fc6b None None] MFA Rules not processed for user `b8110ade874c4aa7af27f5c376df700a`. Rule list: `[]` (Enabled: `True`). {{(pid=207601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 08:24:46.116166 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.fernet_utils [None req-426df614-28a9-4b23-8264-c7497e16fc6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=207601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:24:46.150606 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a44b1f-fd66-42e3-abec-7c70cf05a865 None admin] Validating token access rules against request {{(pid=207600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:24:46.169653 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG dbcounter [-] [207601] Writing DB stats keystone:SELECT=100 {{(pid=207601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:24:46.187765 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2652874-2ee3-48d9-928a-ccd1acda94cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:24:46.188756 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2652874-2ee3-48d9-928a-ccd1acda94cc None admin] REQUEST_METHOD: `GET` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:24:46.189238 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2652874-2ee3-48d9-928a-ccd1acda94cc None admin] SCRIPT_NAME: `/identity` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:24:46.189674 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2652874-2ee3-48d9-928a-ccd1acda94cc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:24:46.190853 dv-cinder-851351-1-smb devstack@keystone.service[207601]: [pid: 207601|app: 0|req: 371/744] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 08:24:46 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 08:24:46.191718 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426df614-28a9-4b23-8264-c7497e16fc6b None None] Authenticating user token {{(pid=207601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:24:46.211984 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2652874-2ee3-48d9-928a-ccd1acda94cc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:24:46.214221 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2652874-2ee3-48d9-928a-ccd1acda94cc None admin] RBAC: Authorization granted {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:24:46.230713 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application [None req-f2652874-2ee3-48d9-928a-ccd1acda94cc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 08:24:46.230713 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:24:46.230713 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:24:46.230713 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:24:46.230713 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:24:46.230713 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:24:46.230713 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:24:46.230713 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:24:46.230713 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:24:46.230713 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:24:46.230713 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:24:46.230713 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:24:46.230713 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 08:24:46.230713 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 08:24:46.230713 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 08:24:46.231961 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 08:24:46.231961 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:24:46.231961 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:24:46.231961 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:24:46.231961 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:24:46.231961 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:24:46.231961 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:24:46.231961 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:24:46.231961 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application with Lock( Jul 28 08:24:46.231961 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:24:46.231961 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:24:46.231961 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:24:46.231961 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:24:46.231961 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:24:46.231961 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:24:46.231961 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:24:46.231961 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:24:46.233183 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 08:24:46.233183 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 08:24:46.233183 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 08:24:46.233183 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application Jul 28 08:24:46.234780 dv-cinder-851351-1-smb devstack@keystone.service[207600]: [pid: 207600|app: 0|req: 374/745] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 08:24:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:24:46.235758 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2652874-2ee3-48d9-928a-ccd1acda94cc None admin] Authenticating user token {{(pid=207600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:24:46.309768 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426df614-28a9-4b23-8264-c7497e16fc6b None None] Validating token access rules against request {{(pid=207601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:24:46.321560 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG dbcounter [-] [207600] Writing DB stats keystone:SELECT=100 {{(pid=207600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:24:46.369703 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2652874-2ee3-48d9-928a-ccd1acda94cc None admin] Validating token access rules against request {{(pid=207600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:24:46.421489 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89bd9fff-4b59-452c-8f6d-3763dc39f9b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:24:46.422043 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89bd9fff-4b59-452c-8f6d-3763dc39f9b8 None admin] REQUEST_METHOD: `GET` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:24:46.422332 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89bd9fff-4b59-452c-8f6d-3763dc39f9b8 None admin] SCRIPT_NAME: `/identity` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:24:46.422739 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89bd9fff-4b59-452c-8f6d-3763dc39f9b8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:24:46.476380 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d13f3b-90b7-43b4-8a16-31260425b1e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:24:46.477093 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d13f3b-90b7-43b4-8a16-31260425b1e6 None admin] REQUEST_METHOD: `GET` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:24:46.477397 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d13f3b-90b7-43b4-8a16-31260425b1e6 None admin] SCRIPT_NAME: `/identity` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:24:46.477587 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d13f3b-90b7-43b4-8a16-31260425b1e6 None admin] PATH_INFO: `/v3/roles` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:24:46.478492 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18d13f3b-90b7-43b4-8a16-31260425b1e6 None admin] RBAC: Adding query filter params (name=admin) {{(pid=207601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:24:46.478676 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18d13f3b-90b7-43b4-8a16-31260425b1e6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:24:46.480076 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18d13f3b-90b7-43b4-8a16-31260425b1e6 None admin] RBAC: Authorization granted {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:24:46.489480 dv-cinder-851351-1-smb devstack@keystone.service[207601]: [pid: 207601|app: 0|req: 372/746] 10.222.0.42 () {56 vars in 1099 bytes} [Thu Jul 28 08:24:46 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 298 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:24:46.490345 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d13f3b-90b7-43b4-8a16-31260425b1e6 None admin] Authenticating user token {{(pid=207601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:24:46.505882 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89bd9fff-4b59-452c-8f6d-3763dc39f9b8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:24:46.507354 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89bd9fff-4b59-452c-8f6d-3763dc39f9b8 None admin] RBAC: Authorization granted {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:24:46.561437 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG dbcounter [-] [207601] Writing DB stats keystone:SELECT=100 {{(pid=207601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:24:46.611347 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG dbcounter [-] [207600] Writing DB stats keystone:SELECT=100 {{(pid=207600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:24:46.624779 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d13f3b-90b7-43b4-8a16-31260425b1e6 None admin] Validating token access rules against request {{(pid=207601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:24:46.642640 dv-cinder-851351-1-smb devstack@keystone.service[207600]: [pid: 207600|app: 0|req: 375/747] 10.222.0.42 () {58 vars in 1282 bytes} [Thu Jul 28 08:24:46 2022] GET /identity/v3/auth/tokens => generated 903 bytes in 407 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 28 08:24:46.643348 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89bd9fff-4b59-452c-8f6d-3763dc39f9b8 None admin] Authenticating user token {{(pid=207600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:24:46.669093 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b32357-a10f-43e3-aa91-60d37b4655f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:24:46.669950 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b32357-a10f-43e3-aa91-60d37b4655f5 None admin] REQUEST_METHOD: `POST` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:24:46.670100 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b32357-a10f-43e3-aa91-60d37b4655f5 None admin] SCRIPT_NAME: `/identity` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:24:46.670292 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b32357-a10f-43e3-aa91-60d37b4655f5 None admin] PATH_INFO: `/v3/services` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:24:46.670982 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b32357-a10f-43e3-aa91-60d37b4655f5 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:24:46.672449 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b32357-a10f-43e3-aa91-60d37b4655f5 None admin] RBAC: Authorization granted {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:24:46.692793 dv-cinder-851351-1-smb devstack@keystone.service[207601]: [pid: 207601|app: 0|req: 373/748] 10.222.0.42 () {60 vars in 1141 bytes} [Thu Jul 28 08:24:46 2022] POST /identity/v3/services => generated 240 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 08:24:46.702876 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b32357-a10f-43e3-aa91-60d37b4655f5 None admin] Authenticating user token {{(pid=207601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:24:46.786328 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89bd9fff-4b59-452c-8f6d-3763dc39f9b8 None admin] Validating token access rules against request {{(pid=207600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:24:46.835803 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f512bbd-993f-4599-95ef-280eb02c8570 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:24:46.836637 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f512bbd-993f-4599-95ef-280eb02c8570 None admin] REQUEST_METHOD: `GET` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:24:46.837055 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f512bbd-993f-4599-95ef-280eb02c8570 None admin] SCRIPT_NAME: `/identity` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:24:46.837828 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f512bbd-993f-4599-95ef-280eb02c8570 None admin] PATH_INFO: `/v3/domains` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:24:46.838719 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f512bbd-993f-4599-95ef-280eb02c8570 None admin] RBAC: Adding query filter params (name=Default) {{(pid=207600) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:24:46.839197 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f512bbd-993f-4599-95ef-280eb02c8570 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:24:46.840840 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f512bbd-993f-4599-95ef-280eb02c8570 None admin] RBAC: Authorization granted {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:24:46.842974 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b32357-a10f-43e3-aa91-60d37b4655f5 None admin] Validating token access rules against request {{(pid=207601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:24:46.852968 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG dbcounter [-] [207601] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=207601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:24:46.857277 dv-cinder-851351-1-smb devstack@keystone.service[207600]: [pid: 207600|app: 0|req: 376/749] 10.222.0.42 () {56 vars in 1109 bytes} [Thu Jul 28 08:24:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:24:46.859276 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f512bbd-993f-4599-95ef-280eb02c8570 None admin] Authenticating user token {{(pid=207600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:24:46.899889 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b040ba-995c-4635-ac4d-7c5585383e35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:24:46.901430 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b040ba-995c-4635-ac4d-7c5585383e35 None admin] REQUEST_METHOD: `GET` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:24:46.901430 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b040ba-995c-4635-ac4d-7c5585383e35 None admin] SCRIPT_NAME: `/identity` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:24:46.901627 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b040ba-995c-4635-ac4d-7c5585383e35 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:24:46.906029 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG dbcounter [-] [207600] Writing DB stats keystone:SELECT=100 {{(pid=207600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:24:46.914496 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b040ba-995c-4635-ac4d-7c5585383e35 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:24:46.915487 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b040ba-995c-4635-ac4d-7c5585383e35 None admin] RBAC: Authorization granted {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:24:46.935697 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application [None req-50b040ba-995c-4635-ac4d-7c5585383e35 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 08:24:46.935697 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:24:46.935697 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:24:46.935697 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:24:46.935697 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:24:46.935697 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:24:46.935697 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:24:46.935697 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:24:46.935697 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:24:46.935697 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:24:46.935697 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:24:46.935697 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:24:46.935697 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 08:24:46.935697 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 08:24:46.935697 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 08:24:46.936745 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 08:24:46.936745 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:24:46.936745 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:24:46.936745 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:24:46.936745 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:24:46.936745 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:24:46.936745 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:24:46.936745 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:24:46.936745 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application with Lock( Jul 28 08:24:46.936745 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:24:46.936745 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:24:46.936745 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:24:46.936745 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:24:46.936745 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:24:46.936745 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:24:46.936745 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:24:46.936745 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:24:46.937738 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 08:24:46.937738 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 08:24:46.937738 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 08:24:46.937738 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application Jul 28 08:24:46.938980 dv-cinder-851351-1-smb devstack@keystone.service[207601]: [pid: 207601|app: 0|req: 374/750] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 08:24:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 246 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:24:46.944006 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b040ba-995c-4635-ac4d-7c5585383e35 None admin] Authenticating user token {{(pid=207601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:24:47.015784 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f512bbd-993f-4599-95ef-280eb02c8570 None admin] Validating token access rules against request {{(pid=207600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:24:47.057366 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb4f0d0-fb14-4a29-826f-e6d248ef6f3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:24:47.058196 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb4f0d0-fb14-4a29-826f-e6d248ef6f3d None admin] REQUEST_METHOD: `GET` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:24:47.058624 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb4f0d0-fb14-4a29-826f-e6d248ef6f3d None admin] SCRIPT_NAME: `/identity` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:24:47.058906 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb4f0d0-fb14-4a29-826f-e6d248ef6f3d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:24:47.070052 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b040ba-995c-4635-ac4d-7c5585383e35 None admin] Validating token access rules against request {{(pid=207601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:24:47.074348 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb4f0d0-fb14-4a29-826f-e6d248ef6f3d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:24:47.075837 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb4f0d0-fb14-4a29-826f-e6d248ef6f3d None admin] RBAC: Authorization granted {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:24:47.095144 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application [None req-fbb4f0d0-fb14-4a29-826f-e6d248ef6f3d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 08:24:47.095144 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:24:47.095144 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:24:47.095144 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:24:47.095144 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:24:47.095144 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:24:47.095144 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:24:47.095144 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:24:47.095144 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:24:47.095144 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:24:47.095144 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:24:47.095144 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:24:47.095144 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 08:24:47.095144 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 08:24:47.095144 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 08:24:47.096569 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 08:24:47.096569 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:24:47.096569 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:24:47.096569 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:24:47.096569 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:24:47.096569 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:24:47.096569 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:24:47.096569 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:24:47.096569 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application with Lock( Jul 28 08:24:47.096569 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:24:47.096569 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:24:47.096569 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:24:47.096569 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:24:47.096569 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:24:47.096569 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:24:47.096569 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:24:47.096569 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:24:47.097600 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 08:24:47.097600 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 08:24:47.097600 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 08:24:47.097600 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application Jul 28 08:24:47.097600 dv-cinder-851351-1-smb devstack@keystone.service[207600]: [pid: 207600|app: 0|req: 377/751] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 08:24:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:24:47.098210 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb4f0d0-fb14-4a29-826f-e6d248ef6f3d None admin] Authenticating user token {{(pid=207600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:24:47.115609 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c0b299-d9f7-4d0e-8902-5271cd19bd0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:24:47.116789 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c0b299-d9f7-4d0e-8902-5271cd19bd0f None admin] REQUEST_METHOD: `GET` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:24:47.117321 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c0b299-d9f7-4d0e-8902-5271cd19bd0f None admin] SCRIPT_NAME: `/identity` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:24:47.117837 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c0b299-d9f7-4d0e-8902-5271cd19bd0f None admin] PATH_INFO: `/v3/projects/service` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:24:47.126193 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99c0b299-d9f7-4d0e-8902-5271cd19bd0f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:24:47.128043 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99c0b299-d9f7-4d0e-8902-5271cd19bd0f None admin] RBAC: Authorization granted {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:24:47.141686 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application [None req-99c0b299-d9f7-4d0e-8902-5271cd19bd0f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 08:24:47.141686 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:24:47.141686 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:24:47.141686 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:24:47.141686 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:24:47.141686 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:24:47.141686 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:24:47.141686 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:24:47.141686 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:24:47.141686 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:24:47.141686 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:24:47.141686 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:24:47.141686 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 28 08:24:47.141686 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 28 08:24:47.141686 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 28 08:24:47.142789 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 28 08:24:47.142789 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:24:47.142789 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:24:47.142789 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:24:47.142789 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:24:47.142789 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:24:47.142789 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:24:47.142789 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:24:47.142789 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application with Lock( Jul 28 08:24:47.142789 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:24:47.142789 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:24:47.142789 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:24:47.142789 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:24:47.142789 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:24:47.142789 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:24:47.142789 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:24:47.142789 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:24:47.143962 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 28 08:24:47.143962 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 28 08:24:47.143962 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 28 08:24:47.143962 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 28 08:24:47.143962 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 28 08:24:47.143962 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 28 08:24:47.143962 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 08:24:47.143962 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application Jul 28 08:24:47.147344 dv-cinder-851351-1-smb devstack@keystone.service[207601]: [pid: 207601|app: 0|req: 375/752] 10.222.0.42 () {56 vars in 1111 bytes} [Thu Jul 28 08:24:46 2022] GET /identity/v3/projects/service => generated 88 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:24:47.149348 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c0b299-d9f7-4d0e-8902-5271cd19bd0f None admin] Authenticating user token {{(pid=207601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:24:47.176812 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG dbcounter [-] [207601] Writing DB stats keystone:SELECT=100 {{(pid=207601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:24:47.202651 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG dbcounter [-] [207600] Writing DB stats keystone:SELECT=100 {{(pid=207600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:24:47.226497 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb4f0d0-fb14-4a29-826f-e6d248ef6f3d None admin] Validating token access rules against request {{(pid=207600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:24:47.276691 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c65cded-db25-4beb-b11d-2cbbf6ddeb86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:24:47.276691 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c65cded-db25-4beb-b11d-2cbbf6ddeb86 None admin] REQUEST_METHOD: `GET` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:24:47.276691 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c65cded-db25-4beb-b11d-2cbbf6ddeb86 None admin] SCRIPT_NAME: `/identity` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:24:47.276691 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c65cded-db25-4beb-b11d-2cbbf6ddeb86 None admin] PATH_INFO: `/v3/domains` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:24:47.277302 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c65cded-db25-4beb-b11d-2cbbf6ddeb86 None admin] RBAC: Adding query filter params (name=Default) {{(pid=207600) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:24:47.277302 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c65cded-db25-4beb-b11d-2cbbf6ddeb86 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:24:47.277887 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c65cded-db25-4beb-b11d-2cbbf6ddeb86 None admin] RBAC: Authorization granted {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:24:47.295079 dv-cinder-851351-1-smb devstack@keystone.service[207600]: [pid: 207600|app: 0|req: 378/753] 10.222.0.42 () {56 vars in 1109 bytes} [Thu Jul 28 08:24:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:24:47.295318 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c0b299-d9f7-4d0e-8902-5271cd19bd0f None admin] Validating token access rules against request {{(pid=207601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:24:47.295960 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c65cded-db25-4beb-b11d-2cbbf6ddeb86 None admin] Authenticating user token {{(pid=207600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:24:47.332316 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7140f0-1e3f-4d14-98b1-d2a67dd313e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:24:47.333012 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7140f0-1e3f-4d14-98b1-d2a67dd313e3 None admin] REQUEST_METHOD: `GET` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:24:47.333305 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7140f0-1e3f-4d14-98b1-d2a67dd313e3 None admin] SCRIPT_NAME: `/identity` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:24:47.333573 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7140f0-1e3f-4d14-98b1-d2a67dd313e3 None admin] PATH_INFO: `/v3/domains` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:24:47.334350 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b7140f0-1e3f-4d14-98b1-d2a67dd313e3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=207601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:24:47.334667 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b7140f0-1e3f-4d14-98b1-d2a67dd313e3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:24:47.336118 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b7140f0-1e3f-4d14-98b1-d2a67dd313e3 None admin] RBAC: Authorization granted {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:24:47.354434 dv-cinder-851351-1-smb devstack@keystone.service[207601]: [pid: 207601|app: 0|req: 376/754] 10.222.0.42 () {56 vars in 1109 bytes} [Thu Jul 28 08:24:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:24:47.355376 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7140f0-1e3f-4d14-98b1-d2a67dd313e3 None admin] Authenticating user token {{(pid=207601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:24:47.429781 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c65cded-db25-4beb-b11d-2cbbf6ddeb86 None admin] Validating token access rules against request {{(pid=207600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:24:47.440538 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG dbcounter [-] [207601] Writing DB stats keystone:SELECT=100 {{(pid=207601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:24:47.464712 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7140f0-1e3f-4d14-98b1-d2a67dd313e3 None admin] Validating token access rules against request {{(pid=207601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:24:47.479120 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b876a53-b561-4aa1-94d6-375798be8c48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:24:47.479868 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b876a53-b561-4aa1-94d6-375798be8c48 None admin] REQUEST_METHOD: `GET` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:24:47.480209 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b876a53-b561-4aa1-94d6-375798be8c48 None admin] SCRIPT_NAME: `/identity` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:24:47.480542 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b876a53-b561-4aa1-94d6-375798be8c48 None admin] PATH_INFO: `/v3/projects` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:24:47.482640 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b876a53-b561-4aa1-94d6-375798be8c48 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=207600) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:24:47.483019 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b876a53-b561-4aa1-94d6-375798be8c48 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:24:47.484836 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b876a53-b561-4aa1-94d6-375798be8c48 None admin] RBAC: Authorization granted {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:24:47.504696 dv-cinder-851351-1-smb devstack@keystone.service[207600]: [pid: 207600|app: 0|req: 379/755] 10.222.0.42 () {56 vars in 1148 bytes} [Thu Jul 28 08:24:47 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:24:47.504696 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b876a53-b561-4aa1-94d6-375798be8c48 None admin] Authenticating user token {{(pid=207600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:24:47.505001 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG dbcounter [-] [207600] Writing DB stats keystone:SELECT=100 {{(pid=207600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:24:47.511396 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90855476-a249-496d-9ae8-358b6d7aa8ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:24:47.512176 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90855476-a249-496d-9ae8-358b6d7aa8ba None admin] REQUEST_METHOD: `GET` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:24:47.512510 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90855476-a249-496d-9ae8-358b6d7aa8ba None admin] SCRIPT_NAME: `/identity` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:24:47.512865 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90855476-a249-496d-9ae8-358b6d7aa8ba None admin] PATH_INFO: `/v3/users/nova` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:24:47.521891 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90855476-a249-496d-9ae8-358b6d7aa8ba None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:24:47.523584 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90855476-a249-496d-9ae8-358b6d7aa8ba None admin] RBAC: Authorization granted {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:24:47.538387 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application [None req-90855476-a249-496d-9ae8-358b6d7aa8ba None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 28 08:24:47.538387 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:24:47.538387 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:24:47.538387 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:24:47.538387 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:24:47.538387 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:24:47.538387 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:24:47.538387 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:24:47.538387 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:24:47.538387 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:24:47.538387 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:24:47.538387 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:24:47.538387 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 28 08:24:47.538387 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 28 08:24:47.538387 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 28 08:24:47.538387 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 28 08:24:47.539422 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:24:47.539422 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:24:47.539422 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 28 08:24:47.539422 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 08:24:47.539422 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 28 08:24:47.539422 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 08:24:47.539422 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:24:47.539422 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:24:47.539422 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:24:47.539422 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:24:47.539422 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:24:47.539422 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application with Lock( Jul 28 08:24:47.539422 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:24:47.539422 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:24:47.539422 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:24:47.539422 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:24:47.539422 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:24:47.539422 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:24:47.540411 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:24:47.540411 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:24:47.540411 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 28 08:24:47.540411 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 28 08:24:47.540411 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 28 08:24:47.540411 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 28 08:24:47.540411 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 28 08:24:47.540411 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 28 08:24:47.540411 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 28 08:24:47.540411 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application Jul 28 08:24:47.545304 dv-cinder-851351-1-smb devstack@keystone.service[207601]: [pid: 207601|app: 0|req: 377/756] 10.222.0.42 () {56 vars in 1093 bytes} [Thu Jul 28 08:24:47 2022] GET /identity/v3/users/nova => generated 82 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:24:47.546767 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ecd5dee-2a5d-418b-a3ed-160c85856a2c None None] REQUEST_METHOD: `GET` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:24:47.547105 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ecd5dee-2a5d-418b-a3ed-160c85856a2c None None] SCRIPT_NAME: `/identity` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:24:47.547446 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ecd5dee-2a5d-418b-a3ed-160c85856a2c None None] PATH_INFO: `/` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:24:47.552712 dv-cinder-851351-1-smb devstack@keystone.service[207601]: [pid: 207601|app: 0|req: 378/757] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 08:24:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 08:24:47.552712 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ecd5dee-2a5d-418b-a3ed-160c85856a2c None None] Authenticating user token {{(pid=207601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:24:47.619172 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b876a53-b561-4aa1-94d6-375798be8c48 None admin] Validating token access rules against request {{(pid=207600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:24:47.659831 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e84b67e-d932-4fec-af3f-ea19e563d4be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:24:47.660523 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e84b67e-d932-4fec-af3f-ea19e563d4be None admin] REQUEST_METHOD: `GET` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:24:47.660804 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e84b67e-d932-4fec-af3f-ea19e563d4be None admin] SCRIPT_NAME: `/identity` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:24:47.661077 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e84b67e-d932-4fec-af3f-ea19e563d4be None admin] PATH_INFO: `/v3/projects/service` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:24:47.669495 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e84b67e-d932-4fec-af3f-ea19e563d4be None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:24:47.670889 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ecd5dee-2a5d-418b-a3ed-160c85856a2c None None] Validating token access rules against request {{(pid=207601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:24:47.671371 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e84b67e-d932-4fec-af3f-ea19e563d4be None admin] RBAC: Authorization granted {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:24:47.684290 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application [None req-0e84b67e-d932-4fec-af3f-ea19e563d4be None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 08:24:47.684290 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:24:47.684290 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:24:47.684290 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:24:47.684290 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:24:47.684290 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:24:47.684290 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:24:47.684290 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:24:47.684290 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:24:47.684290 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:24:47.684290 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:24:47.684290 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:24:47.684290 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 28 08:24:47.684290 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 28 08:24:47.684290 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 28 08:24:47.685335 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 28 08:24:47.685335 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:24:47.685335 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:24:47.685335 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:24:47.685335 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:24:47.685335 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:24:47.685335 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:24:47.685335 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:24:47.685335 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application with Lock( Jul 28 08:24:47.685335 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:24:47.685335 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:24:47.685335 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:24:47.685335 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:24:47.685335 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:24:47.685335 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:24:47.685335 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:24:47.685335 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:24:47.686306 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 28 08:24:47.686306 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 28 08:24:47.686306 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 28 08:24:47.686306 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 28 08:24:47.686306 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 28 08:24:47.686306 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 28 08:24:47.686306 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 08:24:47.686306 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application Jul 28 08:24:47.689001 dv-cinder-851351-1-smb devstack@keystone.service[207600]: [pid: 207600|app: 0|req: 380/758] 10.222.0.42 () {56 vars in 1111 bytes} [Thu Jul 28 08:24:47 2022] GET /identity/v3/projects/service => generated 88 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:24:47.690378 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e84b67e-d932-4fec-af3f-ea19e563d4be None admin] Authenticating user token {{(pid=207600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:24:47.712349 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e50fc4-79ae-492a-b9ca-2bfee64134ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:24:47.713470 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e50fc4-79ae-492a-b9ca-2bfee64134ec None admin] REQUEST_METHOD: `GET` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:24:47.713806 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e50fc4-79ae-492a-b9ca-2bfee64134ec None admin] SCRIPT_NAME: `/identity` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:24:47.714131 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e50fc4-79ae-492a-b9ca-2bfee64134ec None admin] PATH_INFO: `/v3/role_assignments` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:24:47.715122 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e50fc4-79ae-492a-b9ca-2bfee64134ec None admin] RBAC: Adding query filter params (role.id=b44e7c7aeec24f51b8033df305da133d, scope.project.id=48c5f2b2ae2b48758b957d2b194a7fd1, user.id=601010c3acdf446bb37ff23cbed0dcf1) {{(pid=207601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:24:47.715428 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e50fc4-79ae-492a-b9ca-2bfee64134ec None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:24:47.717176 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e50fc4-79ae-492a-b9ca-2bfee64134ec None admin] RBAC: Authorization granted {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:24:47.723678 dv-cinder-851351-1-smb devstack@keystone.service[207601]: [pid: 207601|app: 0|req: 379/759] 10.222.0.42 () {56 vars in 1374 bytes} [Thu Jul 28 08:24:47 2022] GET /identity/v3/role_assignments?user.id=601010c3acdf446bb37ff23cbed0dcf1&scope.project.id=48c5f2b2ae2b48758b957d2b194a7fd1&role.id=b44e7c7aeec24f51b8033df305da133d => generated 259 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:24:47.725151 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725ffbb4-042b-440e-8474-2b5d036208b3 None None] REQUEST_METHOD: `POST` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:24:47.725511 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725ffbb4-042b-440e-8474-2b5d036208b3 None None] SCRIPT_NAME: `/identity` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:24:47.725846 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725ffbb4-042b-440e-8474-2b5d036208b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:24:47.733510 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG dbcounter [-] [207601] Writing DB stats keystone:SELECT=100 {{(pid=207601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:24:47.748397 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.auth.core [None req-725ffbb4-042b-440e-8474-2b5d036208b3 None None] MFA Rules not processed for user `b8110ade874c4aa7af27f5c376df700a`. Rule list: `[]` (Enabled: `True`). {{(pid=207601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 08:24:47.750736 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.fernet_utils [None req-725ffbb4-042b-440e-8474-2b5d036208b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=207601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:24:47.778316 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG dbcounter [-] [207600] Writing DB stats keystone:SELECT=100 {{(pid=207600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:24:47.829356 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e84b67e-d932-4fec-af3f-ea19e563d4be None admin] Validating token access rules against request {{(pid=207600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:24:47.857664 dv-cinder-851351-1-smb devstack@keystone.service[207601]: [pid: 207601|app: 0|req: 380/760] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 08:24:47 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 08:24:47.858942 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-725ffbb4-042b-440e-8474-2b5d036208b3 None None] Authenticating user token {{(pid=207601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:24:47.894586 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d45364-4e32-4805-8ada-92a472f023d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:24:47.895241 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d45364-4e32-4805-8ada-92a472f023d6 None admin] REQUEST_METHOD: `GET` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:24:47.895524 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d45364-4e32-4805-8ada-92a472f023d6 None admin] SCRIPT_NAME: `/identity` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:24:47.895797 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d45364-4e32-4805-8ada-92a472f023d6 None admin] PATH_INFO: `/v3/users` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:24:47.896641 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d45364-4e32-4805-8ada-92a472f023d6 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=207600) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:24:47.896990 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d45364-4e32-4805-8ada-92a472f023d6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:24:47.898516 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d45364-4e32-4805-8ada-92a472f023d6 None admin] RBAC: Authorization granted {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:24:47.926251 dv-cinder-851351-1-smb devstack@keystone.service[207600]: [pid: 207600|app: 0|req: 381/761] 10.222.0.42 () {56 vars in 1133 bytes} [Thu Jul 28 08:24:47 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:24:47.927631 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d45364-4e32-4805-8ada-92a472f023d6 None admin] Authenticating user token {{(pid=207600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:24:48.000462 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-725ffbb4-042b-440e-8474-2b5d036208b3 None None] Validating token access rules against request {{(pid=207601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:24:48.051128 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG dbcounter [-] [207601] Writing DB stats keystone:SELECT=100 {{(pid=207601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:24:48.057946 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9916bdf6-b860-4970-9c1d-160a7d018e2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:24:48.058597 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9916bdf6-b860-4970-9c1d-160a7d018e2f None admin] REQUEST_METHOD: `GET` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:24:48.058881 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9916bdf6-b860-4970-9c1d-160a7d018e2f None admin] SCRIPT_NAME: `/identity` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:24:48.059154 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9916bdf6-b860-4970-9c1d-160a7d018e2f None admin] PATH_INFO: `/v3/projects` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:24:48.059935 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9916bdf6-b860-4970-9c1d-160a7d018e2f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=207601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:24:48.060246 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9916bdf6-b860-4970-9c1d-160a7d018e2f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:24:48.061733 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9916bdf6-b860-4970-9c1d-160a7d018e2f None admin] RBAC: Authorization granted {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:24:48.075995 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d45364-4e32-4805-8ada-92a472f023d6 None admin] Validating token access rules against request {{(pid=207600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:24:48.079969 dv-cinder-851351-1-smb devstack@keystone.service[207601]: [pid: 207601|app: 0|req: 381/762] 10.222.0.42 () {56 vars in 1148 bytes} [Thu Jul 28 08:24:47 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:24:48.080204 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9916bdf6-b860-4970-9c1d-160a7d018e2f None admin] Authenticating user token {{(pid=207601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:24:48.106333 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG dbcounter [-] [207600] Writing DB stats keystone:SELECT=100 {{(pid=207600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:24:48.127471 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a7bae3c-d9e7-4370-b594-8bad2b674136 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:24:48.128542 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7bae3c-d9e7-4370-b594-8bad2b674136 None admin] REQUEST_METHOD: `GET` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:24:48.129543 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7bae3c-d9e7-4370-b594-8bad2b674136 None admin] SCRIPT_NAME: `/identity` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:24:48.130064 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7bae3c-d9e7-4370-b594-8bad2b674136 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:24:48.131401 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a7bae3c-d9e7-4370-b594-8bad2b674136 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:24:48.133622 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a7bae3c-d9e7-4370-b594-8bad2b674136 None admin] RBAC: Authorization granted {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:24:48.147359 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application [None req-3a7bae3c-d9e7-4370-b594-8bad2b674136 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 28 08:24:48.147359 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:24:48.147359 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 28 08:24:48.147359 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 28 08:24:48.147359 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 28 08:24:48.147359 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 28 08:24:48.147359 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 28 08:24:48.147359 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 08:24:48.147359 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 28 08:24:48.147359 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application Jul 28 08:24:48.147359 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 28 08:24:48.147359 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application Jul 28 08:24:48.147359 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:24:48.147359 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:24:48.147359 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:24:48.147359 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:24:48.148444 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:24:48.148444 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:24:48.148444 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:24:48.148444 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:24:48.148444 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:24:48.148444 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:24:48.148444 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:24:48.148444 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 28 08:24:48.148444 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 28 08:24:48.148444 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 28 08:24:48.148444 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 28 08:24:48.148444 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:24:48.148444 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:24:48.148444 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:24:48.148444 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:24:48.148444 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:24:48.149378 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:24:48.149378 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:24:48.149378 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application with Lock( Jul 28 08:24:48.149378 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:24:48.149378 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:24:48.149378 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:24:48.149378 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:24:48.149378 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:24:48.149378 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:24:48.149378 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:24:48.149378 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:24:48.149378 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 28 08:24:48.149378 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 08:24:48.149378 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 28 08:24:48.149378 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application Jul 28 08:24:48.150963 dv-cinder-851351-1-smb devstack@keystone.service[207600]: [pid: 207600|app: 0|req: 382/763] 10.222.0.42 () {56 vars in 1129 bytes} [Thu Jul 28 08:24:47 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:24:48.151491 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a7bae3c-d9e7-4370-b594-8bad2b674136 None admin] Authenticating user token {{(pid=207600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:24:48.209933 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9916bdf6-b860-4970-9c1d-160a7d018e2f None admin] Validating token access rules against request {{(pid=207601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:24:48.255159 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd40852-8ac0-4879-8d78-ee5569cb703a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:24:48.255704 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd40852-8ac0-4879-8d78-ee5569cb703a None admin] REQUEST_METHOD: `GET` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:24:48.255992 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd40852-8ac0-4879-8d78-ee5569cb703a None admin] SCRIPT_NAME: `/identity` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:24:48.256268 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd40852-8ac0-4879-8d78-ee5569cb703a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:24:48.269863 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd40852-8ac0-4879-8d78-ee5569cb703a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:24:48.270724 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a7bae3c-d9e7-4370-b594-8bad2b674136 None admin] Validating token access rules against request {{(pid=207600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:24:48.271350 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd40852-8ac0-4879-8d78-ee5569cb703a None admin] RBAC: Authorization granted {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:24:48.291142 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application [None req-fcd40852-8ac0-4879-8d78-ee5569cb703a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 08:24:48.291142 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:24:48.291142 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:24:48.291142 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:24:48.291142 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:24:48.291142 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:24:48.291142 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:24:48.291142 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:24:48.291142 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:24:48.291142 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:24:48.291142 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:24:48.291142 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:24:48.291142 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 08:24:48.291142 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 08:24:48.291142 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 08:24:48.292183 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 08:24:48.292183 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:24:48.292183 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:24:48.292183 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:24:48.292183 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:24:48.292183 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:24:48.292183 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:24:48.292183 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:24:48.292183 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application with Lock( Jul 28 08:24:48.292183 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:24:48.292183 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:24:48.292183 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:24:48.292183 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:24:48.292183 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:24:48.292183 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:24:48.292183 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:24:48.292183 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:24:48.293196 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 08:24:48.293196 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 08:24:48.293196 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 08:24:48.293196 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application Jul 28 08:24:48.296841 dv-cinder-851351-1-smb devstack@keystone.service[207601]: [pid: 207601|app: 0|req: 382/764] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 08:24:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:24:48.298149 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd40852-8ac0-4879-8d78-ee5569cb703a None admin] Authenticating user token {{(pid=207601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:24:48.317756 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6d3247-0186-4b5f-9305-4c7d086e2f31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:24:48.318580 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6d3247-0186-4b5f-9305-4c7d086e2f31 None admin] REQUEST_METHOD: `GET` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:24:48.318958 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6d3247-0186-4b5f-9305-4c7d086e2f31 None admin] SCRIPT_NAME: `/identity` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:24:48.319329 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6d3247-0186-4b5f-9305-4c7d086e2f31 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:24:48.320365 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad6d3247-0186-4b5f-9305-4c7d086e2f31 None admin] RBAC: Adding query filter params (role.id=d0ce88034c6b41878db755343f5840be, scope.project.id=48c5f2b2ae2b48758b957d2b194a7fd1, user.id=96e9a6a7c6ea4047a5d8e16babbdeb70) {{(pid=207600) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:24:48.320850 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad6d3247-0186-4b5f-9305-4c7d086e2f31 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:24:48.325298 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad6d3247-0186-4b5f-9305-4c7d086e2f31 None admin] RBAC: Authorization granted {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:24:48.339153 dv-cinder-851351-1-smb devstack@keystone.service[207600]: [pid: 207600|app: 0|req: 383/765] 10.222.0.42 () {56 vars in 1374 bytes} [Thu Jul 28 08:24:48 2022] GET /identity/v3/role_assignments?user.id=96e9a6a7c6ea4047a5d8e16babbdeb70&scope.project.id=48c5f2b2ae2b48758b957d2b194a7fd1&role.id=d0ce88034c6b41878db755343f5840be => generated 259 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:24:48.339153 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6d3247-0186-4b5f-9305-4c7d086e2f31 None admin] Authenticating user token {{(pid=207600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:24:48.402479 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG dbcounter [-] [207601] Writing DB stats keystone:SELECT=100 {{(pid=207601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:24:48.450390 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG dbcounter [-] [207600] Writing DB stats keystone:SELECT=100 {{(pid=207600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:24:48.521182 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd40852-8ac0-4879-8d78-ee5569cb703a None admin] Validating token access rules against request {{(pid=207601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:24:48.550616 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6d3247-0186-4b5f-9305-4c7d086e2f31 None admin] Validating token access rules against request {{(pid=207600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:24:48.567916 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ccf9cbc-3605-47cf-a0c8-3d34f2499a5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:24:48.569057 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ccf9cbc-3605-47cf-a0c8-3d34f2499a5f None admin] REQUEST_METHOD: `GET` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:24:48.569445 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ccf9cbc-3605-47cf-a0c8-3d34f2499a5f None admin] SCRIPT_NAME: `/identity` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:24:48.569818 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ccf9cbc-3605-47cf-a0c8-3d34f2499a5f None admin] PATH_INFO: `/v3/services` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:24:48.570868 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ccf9cbc-3605-47cf-a0c8-3d34f2499a5f None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=207601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:24:48.571279 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ccf9cbc-3605-47cf-a0c8-3d34f2499a5f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:24:48.573237 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ccf9cbc-3605-47cf-a0c8-3d34f2499a5f None admin] RBAC: Authorization granted {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:24:48.580633 dv-cinder-851351-1-smb devstack@keystone.service[207601]: [pid: 207601|app: 0|req: 383/766] 10.222.0.42 () {56 vars in 1124 bytes} [Thu Jul 28 08:24:48 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 283 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:24:48.590625 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ccf9cbc-3605-47cf-a0c8-3d34f2499a5f None admin] Authenticating user token {{(pid=207601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:24:48.604307 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d94718-d682-4e3e-b76d-98747bebacf3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:24:48.605273 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d94718-d682-4e3e-b76d-98747bebacf3 None admin] REQUEST_METHOD: `GET` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:24:48.605725 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d94718-d682-4e3e-b76d-98747bebacf3 None admin] SCRIPT_NAME: `/identity` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:24:48.606146 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d94718-d682-4e3e-b76d-98747bebacf3 None admin] PATH_INFO: `/v3/domains` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:24:48.607170 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0d94718-d682-4e3e-b76d-98747bebacf3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=207600) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:24:48.607638 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0d94718-d682-4e3e-b76d-98747bebacf3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:24:48.611182 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0d94718-d682-4e3e-b76d-98747bebacf3 None admin] RBAC: Authorization granted {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:24:48.638491 dv-cinder-851351-1-smb devstack@keystone.service[207600]: [pid: 207600|app: 0|req: 384/767] 10.222.0.42 () {56 vars in 1109 bytes} [Thu Jul 28 08:24:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 301 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:24:48.641466 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d94718-d682-4e3e-b76d-98747bebacf3 None admin] Authenticating user token {{(pid=207600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:24:48.795866 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ccf9cbc-3605-47cf-a0c8-3d34f2499a5f None admin] Validating token access rules against request {{(pid=207601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:24:48.814056 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG dbcounter [-] [207601] Writing DB stats keystone:SELECT=100 {{(pid=207601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:24:48.843179 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d94718-d682-4e3e-b76d-98747bebacf3 None admin] Validating token access rules against request {{(pid=207600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:24:48.854452 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG dbcounter [-] [207600] Writing DB stats keystone:SELECT=100 {{(pid=207600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:24:48.867791 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-408ca6b8-3df1-429e-9f30-1dd07a381322 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:24:48.868958 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408ca6b8-3df1-429e-9f30-1dd07a381322 None admin] REQUEST_METHOD: `GET` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:24:48.869461 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408ca6b8-3df1-429e-9f30-1dd07a381322 None admin] SCRIPT_NAME: `/identity` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:24:48.874685 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408ca6b8-3df1-429e-9f30-1dd07a381322 None admin] PATH_INFO: `/v3/services` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:24:48.875676 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-408ca6b8-3df1-429e-9f30-1dd07a381322 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=207601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:24:48.876227 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-408ca6b8-3df1-429e-9f30-1dd07a381322 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:24:48.877929 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-408ca6b8-3df1-429e-9f30-1dd07a381322 None admin] RBAC: Authorization granted {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:24:48.888279 dv-cinder-851351-1-smb devstack@keystone.service[207601]: [pid: 207601|app: 0|req: 384/768] 10.222.0.42 () {56 vars in 1124 bytes} [Thu Jul 28 08:24:48 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 299 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:24:48.894056 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d22381-8f1f-4cb4-910d-1ff87ffb64e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:24:48.894742 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d22381-8f1f-4cb4-910d-1ff87ffb64e4 None admin] REQUEST_METHOD: `GET` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:24:48.895025 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d22381-8f1f-4cb4-910d-1ff87ffb64e4 None admin] SCRIPT_NAME: `/identity` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:24:48.895300 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d22381-8f1f-4cb4-910d-1ff87ffb64e4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:24:48.897756 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-408ca6b8-3df1-429e-9f30-1dd07a381322 None admin] Authenticating user token {{(pid=207601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:24:48.918281 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4d22381-8f1f-4cb4-910d-1ff87ffb64e4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:24:48.920062 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4d22381-8f1f-4cb4-910d-1ff87ffb64e4 None admin] RBAC: Authorization granted {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:24:48.942156 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application [None req-b4d22381-8f1f-4cb4-910d-1ff87ffb64e4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 08:24:48.942156 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:24:48.942156 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:24:48.942156 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:24:48.942156 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:24:48.942156 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:24:48.942156 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:24:48.942156 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:24:48.942156 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:24:48.942156 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:24:48.942156 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:24:48.942156 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:24:48.942156 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 28 08:24:48.942156 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 28 08:24:48.942156 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 28 08:24:48.943666 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 28 08:24:48.943666 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:24:48.943666 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:24:48.943666 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:24:48.943666 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:24:48.943666 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:24:48.943666 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:24:48.943666 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:24:48.943666 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application with Lock( Jul 28 08:24:48.943666 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:24:48.943666 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:24:48.943666 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:24:48.943666 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:24:48.943666 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:24:48.943666 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:24:48.943666 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:24:48.943666 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:24:48.944994 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 28 08:24:48.944994 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 28 08:24:48.944994 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 28 08:24:48.944994 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 28 08:24:48.944994 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 28 08:24:48.944994 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 28 08:24:48.944994 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 08:24:48.944994 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application Jul 28 08:24:48.944994 dv-cinder-851351-1-smb devstack@keystone.service[207600]: [pid: 207600|app: 0|req: 385/769] 10.222.0.42 () {56 vars in 1111 bytes} [Thu Jul 28 08:24:48 2022] GET /identity/v3/projects/service => generated 88 bytes in 303 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:24:48.945529 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a487093e-aae3-4cd7-8bf1-1f8c0968a6ea None None] REQUEST_METHOD: `GET` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:24:48.945601 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a487093e-aae3-4cd7-8bf1-1f8c0968a6ea None None] SCRIPT_NAME: `/identity` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:24:48.945979 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a487093e-aae3-4cd7-8bf1-1f8c0968a6ea None None] PATH_INFO: `/` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:24:48.948339 dv-cinder-851351-1-smb devstack@keystone.service[207600]: [pid: 207600|app: 0|req: 386/770] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 08:24:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 08:24:48.952809 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de92525a-edd5-450b-a789-65bde2304701 None None] REQUEST_METHOD: `POST` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:24:48.953095 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de92525a-edd5-450b-a789-65bde2304701 None None] SCRIPT_NAME: `/identity` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:24:48.953370 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de92525a-edd5-450b-a789-65bde2304701 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:24:48.974853 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.auth.core [None req-de92525a-edd5-450b-a789-65bde2304701 None None] MFA Rules not processed for user `b8110ade874c4aa7af27f5c376df700a`. Rule list: `[]` (Enabled: `True`). {{(pid=207600) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 08:24:48.976110 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.fernet_utils [None req-de92525a-edd5-450b-a789-65bde2304701 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=207600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:24:49.023264 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-408ca6b8-3df1-429e-9f30-1dd07a381322 None admin] Validating token access rules against request {{(pid=207601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:24:49.063166 dv-cinder-851351-1-smb devstack@keystone.service[207600]: [pid: 207600|app: 0|req: 387/771] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 08:24:48 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 28 08:24:49.063985 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de92525a-edd5-450b-a789-65bde2304701 None None] Authenticating user token {{(pid=207600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:24:49.073057 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c60c0c-6849-4ef4-a38c-acbb52c13def None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:24:49.074727 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c60c0c-6849-4ef4-a38c-acbb52c13def None admin] REQUEST_METHOD: `GET` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:24:49.075021 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c60c0c-6849-4ef4-a38c-acbb52c13def None admin] SCRIPT_NAME: `/identity` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:24:49.075297 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c60c0c-6849-4ef4-a38c-acbb52c13def None admin] PATH_INFO: `/v3/endpoints` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:24:49.076146 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c60c0c-6849-4ef4-a38c-acbb52c13def None admin] RBAC: Adding query filter params (interface=public, service_id=a832e81dbcb2497e8b375ef118cc76dd, region_id=RegionOne) {{(pid=207601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:24:49.076467 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c60c0c-6849-4ef4-a38c-acbb52c13def None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:24:49.077904 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c60c0c-6849-4ef4-a38c-acbb52c13def None admin] RBAC: Authorization granted {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:24:49.087818 dv-cinder-851351-1-smb devstack@keystone.service[207601]: [pid: 207601|app: 0|req: 385/772] 10.222.0.42 () {56 vars in 1251 bytes} [Thu Jul 28 08:24:48 2022] GET /identity/v3/endpoints?service_id=a832e81dbcb2497e8b375ef118cc76dd&interface=public®ion_id=RegionOne => generated 194 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:24:49.095682 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c60c0c-6849-4ef4-a38c-acbb52c13def None admin] Authenticating user token {{(pid=207601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:24:49.144950 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG dbcounter [-] [207601] Writing DB stats keystone:SELECT=100 {{(pid=207601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:24:49.196868 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG dbcounter [-] [207600] Writing DB stats keystone:SELECT=100 {{(pid=207600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:24:49.202834 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de92525a-edd5-450b-a789-65bde2304701 None None] Validating token access rules against request {{(pid=207600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:24:49.242195 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c60c0c-6849-4ef4-a38c-acbb52c13def None admin] Validating token access rules against request {{(pid=207601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:24:49.254081 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ddf44f-f2b7-4c42-b3d6-06f42e863abe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:24:49.255626 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ddf44f-f2b7-4c42-b3d6-06f42e863abe None admin] REQUEST_METHOD: `GET` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:24:49.256115 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ddf44f-f2b7-4c42-b3d6-06f42e863abe None admin] SCRIPT_NAME: `/identity` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:24:49.256588 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ddf44f-f2b7-4c42-b3d6-06f42e863abe None admin] PATH_INFO: `/v3/projects` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:24:49.257757 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ddf44f-f2b7-4c42-b3d6-06f42e863abe None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=207600) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:24:49.258254 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ddf44f-f2b7-4c42-b3d6-06f42e863abe None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:24:49.260075 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ddf44f-f2b7-4c42-b3d6-06f42e863abe None admin] RBAC: Authorization granted {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:24:49.274702 dv-cinder-851351-1-smb devstack@keystone.service[207600]: [pid: 207600|app: 0|req: 388/773] 10.222.0.42 () {56 vars in 1148 bytes} [Thu Jul 28 08:24:49 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:24:49.275961 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ddf44f-f2b7-4c42-b3d6-06f42e863abe None admin] Authenticating user token {{(pid=207600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:24:49.288109 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b722cc-473e-472f-8f45-536512d6bd7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:24:49.288818 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b722cc-473e-472f-8f45-536512d6bd7e None admin] REQUEST_METHOD: `GET` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:24:49.289546 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b722cc-473e-472f-8f45-536512d6bd7e None admin] SCRIPT_NAME: `/identity` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:24:49.289837 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b722cc-473e-472f-8f45-536512d6bd7e None admin] PATH_INFO: `/v3/services` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:24:49.290553 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0b722cc-473e-472f-8f45-536512d6bd7e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:24:49.292694 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0b722cc-473e-472f-8f45-536512d6bd7e None admin] RBAC: Authorization granted {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:24:49.308700 dv-cinder-851351-1-smb devstack@keystone.service[207601]: [pid: 207601|app: 0|req: 386/774] 10.222.0.42 () {56 vars in 1087 bytes} [Thu Jul 28 08:24:49 2022] GET /identity/v3/services => generated 772 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:24:49.308700 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b722cc-473e-472f-8f45-536512d6bd7e None admin] Authenticating user token {{(pid=207601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:24:49.429397 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG dbcounter [-] [207601] Writing DB stats keystone:SELECT=100 {{(pid=207601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:24:49.434142 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b722cc-473e-472f-8f45-536512d6bd7e None admin] Validating token access rules against request {{(pid=207601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:24:49.476271 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ddf44f-f2b7-4c42-b3d6-06f42e863abe None admin] Validating token access rules against request {{(pid=207600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:24:49.522399 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a33af9-424c-49a2-a428-4d4122f6fa1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:24:49.523093 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a33af9-424c-49a2-a428-4d4122f6fa1b None admin] REQUEST_METHOD: `GET` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:24:49.523382 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a33af9-424c-49a2-a428-4d4122f6fa1b None admin] SCRIPT_NAME: `/identity` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:24:49.523670 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a33af9-424c-49a2-a428-4d4122f6fa1b None admin] PATH_INFO: `/v3/services/network` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:24:49.524341 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53a33af9-424c-49a2-a428-4d4122f6fa1b None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:24:49.526446 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53a33af9-424c-49a2-a428-4d4122f6fa1b None admin] RBAC: Authorization granted {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:24:49.531346 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b68be9-3c2f-4b3f-be87-7cd916f212ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:24:49.532080 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b68be9-3c2f-4b3f-be87-7cd916f212ac None admin] REQUEST_METHOD: `PUT` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:24:49.532374 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b68be9-3c2f-4b3f-be87-7cd916f212ac None admin] SCRIPT_NAME: `/identity` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:24:49.532659 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b68be9-3c2f-4b3f-be87-7cd916f212ac None admin] PATH_INFO: `/v3/projects/48c5f2b2ae2b48758b957d2b194a7fd1/users/03804b1369934a7692da4d5646465bdc/roles/d0ce88034c6b41878db755343f5840be` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:24:49.536964 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application [None req-53a33af9-424c-49a2-a428-4d4122f6fa1b None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jul 28 08:24:49.536964 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:24:49.536964 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 28 08:24:49.536964 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 28 08:24:49.536964 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 28 08:24:49.536964 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 28 08:24:49.536964 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 28 08:24:49.536964 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 08:24:49.536964 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 28 08:24:49.536964 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application Jul 28 08:24:49.536964 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 28 08:24:49.536964 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application Jul 28 08:24:49.536964 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:24:49.536964 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:24:49.536964 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:24:49.536964 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:24:49.536964 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:24:49.538102 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:24:49.538102 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:24:49.538102 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:24:49.538102 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:24:49.538102 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:24:49.538102 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:24:49.538102 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 28 08:24:49.538102 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 28 08:24:49.538102 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 28 08:24:49.538102 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 28 08:24:49.538102 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:24:49.538102 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:24:49.538102 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:24:49.538102 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:24:49.538102 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:24:49.538102 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:24:49.538997 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:24:49.538997 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application with Lock( Jul 28 08:24:49.538997 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:24:49.538997 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:24:49.538997 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:24:49.538997 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:24:49.538997 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:24:49.538997 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:24:49.538997 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:24:49.538997 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:24:49.538997 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 28 08:24:49.538997 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 08:24:49.538997 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 28 08:24:49.538997 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application Jul 28 08:24:49.538997 dv-cinder-851351-1-smb devstack@keystone.service[207600]: [pid: 207600|app: 0|req: 389/775] 10.222.0.42 () {56 vars in 1111 bytes} [Thu Jul 28 08:24:49 2022] GET /identity/v3/services/network => generated 88 bytes in 263 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:24:49.544811 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a33af9-424c-49a2-a428-4d4122f6fa1b None admin] Authenticating user token {{(pid=207600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:24:49.547786 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6b68be9-3c2f-4b3f-be87-7cd916f212ac None admin] RBAC: Authorizing `identity:create_grant(project_id=48c5f2b2ae2b48758b957d2b194a7fd1, user_id=03804b1369934a7692da4d5646465bdc, role_id=d0ce88034c6b41878db755343f5840be)` {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:24:49.549702 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6b68be9-3c2f-4b3f-be87-7cd916f212ac None admin] RBAC: Authorization granted {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:24:49.576478 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG dbcounter [-] [207600] Writing DB stats keystone:SELECT=100 {{(pid=207600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:24:49.576869 dv-cinder-851351-1-smb devstack@keystone.service[207601]: [pid: 207601|app: 0|req: 387/776] 10.222.0.42 () {58 vars in 1439 bytes} [Thu Jul 28 08:24:49 2022] PUT /identity/v3/projects/48c5f2b2ae2b48758b957d2b194a7fd1/users/03804b1369934a7692da4d5646465bdc/roles/d0ce88034c6b41878db755343f5840be => generated 0 bytes in 275 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 08:24:49.682114 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a33af9-424c-49a2-a428-4d4122f6fa1b None admin] Validating token access rules against request {{(pid=207600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:24:49.731292 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-331621f3-a197-4a1c-9f73-29a8b62a998a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:24:49.731956 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331621f3-a197-4a1c-9f73-29a8b62a998a None admin] REQUEST_METHOD: `GET` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:24:49.732246 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331621f3-a197-4a1c-9f73-29a8b62a998a None admin] SCRIPT_NAME: `/identity` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:24:49.732526 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331621f3-a197-4a1c-9f73-29a8b62a998a None admin] PATH_INFO: `/v3/services` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:24:49.733284 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-331621f3-a197-4a1c-9f73-29a8b62a998a None admin] RBAC: Adding query filter params (name=network) {{(pid=207600) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:24:49.733597 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-331621f3-a197-4a1c-9f73-29a8b62a998a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:24:49.735065 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-331621f3-a197-4a1c-9f73-29a8b62a998a None admin] RBAC: Authorization granted {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:24:49.741230 dv-cinder-851351-1-smb devstack@keystone.service[207600]: [pid: 207600|app: 0|req: 390/777] 10.222.0.42 () {56 vars in 1112 bytes} [Thu Jul 28 08:24:49 2022] GET /identity/v3/services?name=network => generated 124 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:24:49.748914 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b68be9-3c2f-4b3f-be87-7cd916f212ac None admin] Authenticating user token {{(pid=207601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:24:49.883066 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b68be9-3c2f-4b3f-be87-7cd916f212ac None admin] Validating token access rules against request {{(pid=207601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:24:49.927610 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aeced33-5564-4737-b437-a50cbcdb552c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:24:49.928256 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aeced33-5564-4737-b437-a50cbcdb552c None admin] REQUEST_METHOD: `GET` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:24:49.928542 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aeced33-5564-4737-b437-a50cbcdb552c None admin] SCRIPT_NAME: `/identity` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:24:49.928919 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aeced33-5564-4737-b437-a50cbcdb552c None admin] PATH_INFO: `/v3/services` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:24:49.929637 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aeced33-5564-4737-b437-a50cbcdb552c None admin] RBAC: Adding query filter params (type=network) {{(pid=207601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:24:49.929970 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aeced33-5564-4737-b437-a50cbcdb552c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:24:49.931464 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aeced33-5564-4737-b437-a50cbcdb552c None admin] RBAC: Authorization granted {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:24:49.938797 dv-cinder-851351-1-smb devstack@keystone.service[207601]: [pid: 207601|app: 0|req: 388/778] 10.222.0.42 () {56 vars in 1112 bytes} [Thu Jul 28 08:24:49 2022] GET /identity/v3/services?type=network => generated 350 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:24:49.945510 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-331621f3-a197-4a1c-9f73-29a8b62a998a None admin] Authenticating user token {{(pid=207600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:24:49.981639 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50ddc83-4641-4050-a658-9f6ec861a19c None None] REQUEST_METHOD: `GET` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:24:49.982000 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50ddc83-4641-4050-a658-9f6ec861a19c None None] SCRIPT_NAME: `/identity` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:24:49.982444 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50ddc83-4641-4050-a658-9f6ec861a19c None None] PATH_INFO: `/` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:24:49.985091 dv-cinder-851351-1-smb devstack@keystone.service[207601]: [pid: 207601|app: 0|req: 389/779] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 08:24:49 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 08:24:49.991902 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f75c23-86bc-481b-92a5-225d17cbac37 None None] REQUEST_METHOD: `POST` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:24:49.992538 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f75c23-86bc-481b-92a5-225d17cbac37 None None] SCRIPT_NAME: `/identity` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:24:49.993067 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f75c23-86bc-481b-92a5-225d17cbac37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:24:50.015913 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.auth.core [None req-c4f75c23-86bc-481b-92a5-225d17cbac37 None None] MFA Rules not processed for user `b8110ade874c4aa7af27f5c376df700a`. Rule list: `[]` (Enabled: `True`). {{(pid=207601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 08:24:50.017602 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.fernet_utils [None req-c4f75c23-86bc-481b-92a5-225d17cbac37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=207601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:24:50.056897 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG dbcounter [-] [207601] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=207601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:24:50.146127 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG dbcounter [-] [207600] Writing DB stats keystone:SELECT=100 {{(pid=207600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:24:50.170469 dv-cinder-851351-1-smb devstack@keystone.service[207601]: [pid: 207601|app: 0|req: 390/780] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 08:24:49 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 08:24:50.174574 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-331621f3-a197-4a1c-9f73-29a8b62a998a None admin] Validating token access rules against request {{(pid=207600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:24:50.210528 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f75c23-86bc-481b-92a5-225d17cbac37 None None] Authenticating user token {{(pid=207601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:24:50.261570 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82745f51-1a46-406f-89f5-6f0a8c23e7b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:24:50.262674 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82745f51-1a46-406f-89f5-6f0a8c23e7b2 None admin] REQUEST_METHOD: `GET` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:24:50.263181 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82745f51-1a46-406f-89f5-6f0a8c23e7b2 None admin] SCRIPT_NAME: `/identity` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:24:50.263683 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82745f51-1a46-406f-89f5-6f0a8c23e7b2 None admin] PATH_INFO: `/v3/endpoints` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:24:50.265204 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82745f51-1a46-406f-89f5-6f0a8c23e7b2 None admin] RBAC: Adding query filter params (interface=public, service_id=c21235413bcc45f19180d196f0d45347, region_id=RegionOne) {{(pid=207600) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:24:50.265766 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82745f51-1a46-406f-89f5-6f0a8c23e7b2 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:24:50.268387 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82745f51-1a46-406f-89f5-6f0a8c23e7b2 None admin] RBAC: Authorization granted {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:24:50.296045 dv-cinder-851351-1-smb devstack@keystone.service[207600]: [pid: 207600|app: 0|req: 391/781] 10.222.0.42 () {56 vars in 1251 bytes} [Thu Jul 28 08:24:49 2022] GET /identity/v3/endpoints?service_id=c21235413bcc45f19180d196f0d45347&interface=public®ion_id=RegionOne => generated 194 bytes in 352 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:24:50.305935 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82745f51-1a46-406f-89f5-6f0a8c23e7b2 None admin] Authenticating user token {{(pid=207600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:24:50.409840 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f75c23-86bc-481b-92a5-225d17cbac37 None None] Validating token access rules against request {{(pid=207601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:24:50.454388 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba1d4bb-9bf0-4c8c-a0b3-da1a25d2efd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:24:50.455064 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba1d4bb-9bf0-4c8c-a0b3-da1a25d2efd6 None admin] REQUEST_METHOD: `GET` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:24:50.455352 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba1d4bb-9bf0-4c8c-a0b3-da1a25d2efd6 None admin] SCRIPT_NAME: `/identity` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:24:50.455631 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba1d4bb-9bf0-4c8c-a0b3-da1a25d2efd6 None admin] PATH_INFO: `/v3/roles/service` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:24:50.485155 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba1d4bb-9bf0-4c8c-a0b3-da1a25d2efd6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 08:24:50.492461 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application [None req-dba1d4bb-9bf0-4c8c-a0b3-da1a25d2efd6 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 28 08:24:50.492461 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:24:50.492461 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:24:50.492461 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:24:50.492461 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:24:50.492461 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:24:50.492461 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:24:50.492461 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:24:50.492461 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:24:50.492461 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:24:50.492461 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:24:50.492461 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:24:50.492461 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 08:24:50.492461 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 08:24:50.492461 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 08:24:50.492461 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 08:24:50.493496 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 08:24:50.493496 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 08:24:50.493496 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 08:24:50.493496 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 08:24:50.493496 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:24:50.493496 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:24:50.493496 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:24:50.493496 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:24:50.493496 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:24:50.493496 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:24:50.493496 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:24:50.493496 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application with Lock( Jul 28 08:24:50.493496 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:24:50.493496 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:24:50.493496 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:24:50.493496 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:24:50.494465 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:24:50.494465 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:24:50.494465 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:24:50.494465 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:24:50.494465 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 08:24:50.494465 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 08:24:50.494465 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 08:24:50.494465 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 08:24:50.494465 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 08:24:50.494465 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 08:24:50.494465 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 28 08:24:50.494465 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application Jul 28 08:24:50.499541 dv-cinder-851351-1-smb devstack@keystone.service[207601]: [pid: 207601|app: 0|req: 391/782] 10.222.0.42 () {56 vars in 1102 bytes} [Thu Jul 28 08:24:50 2022] GET /identity/v3/roles/service => generated 85 bytes in 290 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 08:24:50.505744 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba1d4bb-9bf0-4c8c-a0b3-da1a25d2efd6 None admin] Authenticating user token {{(pid=207601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:24:50.539532 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG dbcounter [-] [207601] Writing DB stats keystone:SELECT=100 {{(pid=207601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:24:50.550979 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82745f51-1a46-406f-89f5-6f0a8c23e7b2 None admin] Validating token access rules against request {{(pid=207600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:24:50.647209 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba1d4bb-9bf0-4c8c-a0b3-da1a25d2efd6 None admin] Validating token access rules against request {{(pid=207601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:24:50.654016 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7325d2-b539-41b7-aa6a-9aafd5927ea6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:24:50.654676 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7325d2-b539-41b7-aa6a-9aafd5927ea6 None admin] REQUEST_METHOD: `GET` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:24:50.654962 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7325d2-b539-41b7-aa6a-9aafd5927ea6 None admin] SCRIPT_NAME: `/identity` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:24:50.655237 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7325d2-b539-41b7-aa6a-9aafd5927ea6 None admin] PATH_INFO: `/v3/services` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:24:50.656020 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e7325d2-b539-41b7-aa6a-9aafd5927ea6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:24:50.657459 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e7325d2-b539-41b7-aa6a-9aafd5927ea6 None admin] RBAC: Authorization granted {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:24:50.663746 dv-cinder-851351-1-smb devstack@keystone.service[207600]: [pid: 207600|app: 0|req: 392/783] 10.222.0.42 () {56 vars in 1087 bytes} [Thu Jul 28 08:24:50 2022] GET /identity/v3/services => generated 772 bytes in 358 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:24:50.665178 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31fadda6-ae4a-4fdd-9fdd-9850a98f5f51 None None] REQUEST_METHOD: `GET` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:24:50.665503 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31fadda6-ae4a-4fdd-9fdd-9850a98f5f51 None None] SCRIPT_NAME: `/identity` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:24:50.665968 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31fadda6-ae4a-4fdd-9fdd-9850a98f5f51 None None] PATH_INFO: `/` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:24:50.668908 dv-cinder-851351-1-smb devstack@keystone.service[207600]: [pid: 207600|app: 0|req: 393/784] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 08:24:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 08:24:50.678566 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9fb4297-71f4-40b1-8728-3ab36df4723e None None] REQUEST_METHOD: `POST` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:24:50.678921 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9fb4297-71f4-40b1-8728-3ab36df4723e None None] SCRIPT_NAME: `/identity` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:24:50.679115 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9fb4297-71f4-40b1-8728-3ab36df4723e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:24:50.730021 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.auth.core [None req-b9fb4297-71f4-40b1-8728-3ab36df4723e None None] MFA Rules not processed for user `b8110ade874c4aa7af27f5c376df700a`. Rule list: `[]` (Enabled: `True`). {{(pid=207600) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 08:24:50.731704 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.fernet_utils [None req-b9fb4297-71f4-40b1-8728-3ab36df4723e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=207600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:24:50.742815 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d331f0bc-0b30-4a73-9133-5a927a7fe427 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:24:50.743436 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d331f0bc-0b30-4a73-9133-5a927a7fe427 None admin] REQUEST_METHOD: `GET` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:24:50.743804 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d331f0bc-0b30-4a73-9133-5a927a7fe427 None admin] SCRIPT_NAME: `/identity` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:24:50.744084 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d331f0bc-0b30-4a73-9133-5a927a7fe427 None admin] PATH_INFO: `/v3/roles` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:24:50.744891 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d331f0bc-0b30-4a73-9133-5a927a7fe427 None admin] RBAC: Adding query filter params (name=service) {{(pid=207601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:24:50.745208 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d331f0bc-0b30-4a73-9133-5a927a7fe427 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:24:50.746727 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d331f0bc-0b30-4a73-9133-5a927a7fe427 None admin] RBAC: Authorization granted {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:24:50.755092 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG dbcounter [-] [207600] Writing DB stats keystone:SELECT=100 {{(pid=207600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:24:50.759195 dv-cinder-851351-1-smb devstack@keystone.service[207601]: [pid: 207601|app: 0|req: 392/785] 10.222.0.42 () {56 vars in 1103 bytes} [Thu Jul 28 08:24:50 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 08:24:50.764993 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d331f0bc-0b30-4a73-9133-5a927a7fe427 None admin] Authenticating user token {{(pid=207601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:24:50.884747 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG dbcounter [-] [207601] Writing DB stats keystone:SELECT=100 {{(pid=207601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:24:50.898467 dv-cinder-851351-1-smb devstack@keystone.service[207600]: [pid: 207600|app: 0|req: 394/786] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 08:24:50 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 28 08:24:50.917722 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d331f0bc-0b30-4a73-9133-5a927a7fe427 None admin] Validating token access rules against request {{(pid=207601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:24:50.921772 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9fb4297-71f4-40b1-8728-3ab36df4723e None None] Authenticating user token {{(pid=207600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:24:50.955275 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9556b13d-9985-4e7b-a1f4-97b22f180d74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:24:50.956111 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9556b13d-9985-4e7b-a1f4-97b22f180d74 None admin] REQUEST_METHOD: `GET` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:24:50.956392 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9556b13d-9985-4e7b-a1f4-97b22f180d74 None admin] SCRIPT_NAME: `/identity` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:24:50.956695 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9556b13d-9985-4e7b-a1f4-97b22f180d74 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:24:50.969819 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9556b13d-9985-4e7b-a1f4-97b22f180d74 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:24:50.971283 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9556b13d-9985-4e7b-a1f4-97b22f180d74 None admin] RBAC: Authorization granted {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:24:50.987380 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application [None req-9556b13d-9985-4e7b-a1f4-97b22f180d74 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 08:24:50.987380 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:24:50.987380 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:24:50.987380 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:24:50.987380 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:24:50.987380 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:24:50.987380 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:24:50.987380 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:24:50.987380 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:24:50.987380 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:24:50.987380 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:24:50.987380 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:24:50.987380 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 08:24:50.987380 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 08:24:50.987380 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 08:24:50.988490 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 08:24:50.988490 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:24:50.988490 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:24:50.988490 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:24:50.988490 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:24:50.988490 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:24:50.988490 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:24:50.988490 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:24:50.988490 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application with Lock( Jul 28 08:24:50.988490 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:24:50.988490 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:24:50.988490 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:24:50.988490 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:24:50.988490 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:24:50.988490 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:24:50.988490 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:24:50.988490 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:24:50.989578 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 08:24:50.989578 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 08:24:50.989578 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 08:24:50.989578 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application Jul 28 08:24:50.993206 dv-cinder-851351-1-smb devstack@keystone.service[207601]: [pid: 207601|app: 0|req: 393/787] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 08:24:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:24:50.994739 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9556b13d-9985-4e7b-a1f4-97b22f180d74 None admin] Authenticating user token {{(pid=207601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:24:51.066975 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9fb4297-71f4-40b1-8728-3ab36df4723e None None] Validating token access rules against request {{(pid=207600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:24:51.129822 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9556b13d-9985-4e7b-a1f4-97b22f180d74 None admin] Validating token access rules against request {{(pid=207601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:24:51.160153 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG dbcounter [-] [207601] Writing DB stats keystone:SELECT=100 {{(pid=207601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:24:51.171871 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa45739-0ba6-4d81-bdf8-235ab2295b13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:24:51.172545 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa45739-0ba6-4d81-bdf8-235ab2295b13 None admin] REQUEST_METHOD: `GET` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:24:51.172842 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa45739-0ba6-4d81-bdf8-235ab2295b13 None admin] SCRIPT_NAME: `/identity` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:24:51.173102 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa45739-0ba6-4d81-bdf8-235ab2295b13 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:24:51.174244 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-990d33f6-04f4-489a-81ab-307882d9390a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:24:51.174884 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990d33f6-04f4-489a-81ab-307882d9390a None admin] REQUEST_METHOD: `GET` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:24:51.175176 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990d33f6-04f4-489a-81ab-307882d9390a None admin] SCRIPT_NAME: `/identity` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:24:51.175411 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990d33f6-04f4-489a-81ab-307882d9390a None admin] PATH_INFO: `/v3/domains` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:24:51.176108 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-990d33f6-04f4-489a-81ab-307882d9390a None admin] RBAC: Adding query filter params (name=Default) {{(pid=207601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:24:51.176414 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-990d33f6-04f4-489a-81ab-307882d9390a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:24:51.177851 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-990d33f6-04f4-489a-81ab-307882d9390a None admin] RBAC: Authorization granted {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:24:51.202701 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaa45739-0ba6-4d81-bdf8-235ab2295b13 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 08:24:51.207631 dv-cinder-851351-1-smb devstack@keystone.service[207601]: [pid: 207601|app: 0|req: 394/788] 10.222.0.42 () {56 vars in 1109 bytes} [Thu Jul 28 08:24:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 08:24:51.208092 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application [None req-aaa45739-0ba6-4d81-bdf8-235ab2295b13 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 08:24:51.208092 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:24:51.208092 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:24:51.208092 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:24:51.208092 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:24:51.208092 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:24:51.208092 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:24:51.208092 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:24:51.208092 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:24:51.208092 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:24:51.208092 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:24:51.208092 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:24:51.208092 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 08:24:51.208092 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 08:24:51.208092 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 08:24:51.208092 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 08:24:51.210912 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 08:24:51.210912 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 08:24:51.210912 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 08:24:51.210912 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 08:24:51.210912 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:24:51.210912 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:24:51.210912 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:24:51.210912 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:24:51.210912 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:24:51.210912 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:24:51.210912 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:24:51.210912 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application with Lock( Jul 28 08:24:51.210912 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:24:51.210912 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:24:51.210912 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:24:51.210912 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:24:51.213588 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:24:51.213588 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:24:51.213588 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:24:51.213588 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:24:51.213588 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 08:24:51.213588 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 08:24:51.213588 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 08:24:51.213588 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 08:24:51.213588 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 08:24:51.213588 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 08:24:51.213588 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 08:24:51.213588 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application Jul 28 08:24:51.213588 dv-cinder-851351-1-smb devstack@keystone.service[207600]: [pid: 207600|app: 0|req: 395/789] 10.222.0.42 () {56 vars in 1096 bytes} [Thu Jul 28 08:24:50 2022] GET /identity/v3/roles/admin => generated 83 bytes in 288 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:24:51.220805 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-990d33f6-04f4-489a-81ab-307882d9390a None admin] Authenticating user token {{(pid=207601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:24:51.221073 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa45739-0ba6-4d81-bdf8-235ab2295b13 None admin] Authenticating user token {{(pid=207600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:24:51.225648 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG dbcounter [-] [207600] Writing DB stats keystone:SELECT=100 {{(pid=207600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:24:51.431666 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-990d33f6-04f4-489a-81ab-307882d9390a None admin] Validating token access rules against request {{(pid=207601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:24:51.442950 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa45739-0ba6-4d81-bdf8-235ab2295b13 None admin] Validating token access rules against request {{(pid=207600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:24:51.471445 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e147a7c-cada-40fa-acc0-8bffb78fe160 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:24:51.474036 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e147a7c-cada-40fa-acc0-8bffb78fe160 None admin] REQUEST_METHOD: `GET` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:24:51.474036 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e147a7c-cada-40fa-acc0-8bffb78fe160 None admin] SCRIPT_NAME: `/identity` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:24:51.474372 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e147a7c-cada-40fa-acc0-8bffb78fe160 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:24:51.482621 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e147a7c-cada-40fa-acc0-8bffb78fe160 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:24:51.484108 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e147a7c-cada-40fa-acc0-8bffb78fe160 None admin] RBAC: Authorization granted {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:24:51.500394 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application [None req-3e147a7c-cada-40fa-acc0-8bffb78fe160 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 28 08:24:51.500394 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:24:51.500394 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:24:51.500394 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:24:51.500394 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:24:51.500394 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:24:51.500394 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:24:51.500394 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:24:51.500394 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:24:51.500394 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:24:51.500394 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:24:51.500394 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:24:51.500394 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 28 08:24:51.500394 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 28 08:24:51.500394 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 28 08:24:51.500394 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 28 08:24:51.506018 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:24:51.506018 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:24:51.506018 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 28 08:24:51.506018 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 08:24:51.506018 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 28 08:24:51.506018 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 08:24:51.506018 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:24:51.506018 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:24:51.506018 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:24:51.506018 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:24:51.506018 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:24:51.506018 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application with Lock( Jul 28 08:24:51.506018 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:24:51.506018 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:24:51.506018 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:24:51.506018 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:24:51.506018 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:24:51.506018 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:24:51.517587 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:24:51.517587 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:24:51.517587 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 28 08:24:51.517587 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 28 08:24:51.517587 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 28 08:24:51.517587 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 28 08:24:51.517587 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 28 08:24:51.517587 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 28 08:24:51.517587 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 28 08:24:51.517587 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application Jul 28 08:24:51.517587 dv-cinder-851351-1-smb devstack@keystone.service[207601]: [pid: 207601|app: 0|req: 395/790] 10.222.0.42 () {56 vars in 1117 bytes} [Thu Jul 28 08:24:51 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 286 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:24:51.517587 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e147a7c-cada-40fa-acc0-8bffb78fe160 None admin] Authenticating user token {{(pid=207601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:24:51.558052 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e11767-c8f7-41cb-9945-77a09ea92139 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:24:51.559636 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e11767-c8f7-41cb-9945-77a09ea92139 None admin] REQUEST_METHOD: `GET` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:24:51.560229 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e11767-c8f7-41cb-9945-77a09ea92139 None admin] SCRIPT_NAME: `/identity` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:24:51.560961 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e11767-c8f7-41cb-9945-77a09ea92139 None admin] PATH_INFO: `/v3/roles` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:24:51.562412 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06e11767-c8f7-41cb-9945-77a09ea92139 None admin] RBAC: Adding query filter params (name=admin) {{(pid=207600) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:24:51.563147 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06e11767-c8f7-41cb-9945-77a09ea92139 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:24:51.565863 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06e11767-c8f7-41cb-9945-77a09ea92139 None admin] RBAC: Authorization granted {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:24:51.572216 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG dbcounter [-] [207601] Writing DB stats keystone:SELECT=100 {{(pid=207601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:24:51.599560 dv-cinder-851351-1-smb devstack@keystone.service[207600]: [pid: 207600|app: 0|req: 396/791] 10.222.0.42 () {56 vars in 1099 bytes} [Thu Jul 28 08:24:51 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 381 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 08:24:51.609440 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e11767-c8f7-41cb-9945-77a09ea92139 None admin] Authenticating user token {{(pid=207600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:24:51.663663 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e147a7c-cada-40fa-acc0-8bffb78fe160 None admin] Validating token access rules against request {{(pid=207601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:24:51.727713 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2365a210-3e9d-4689-8c91-bbaad70a67a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:24:51.729696 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2365a210-3e9d-4689-8c91-bbaad70a67a1 None admin] REQUEST_METHOD: `GET` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:24:51.730227 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2365a210-3e9d-4689-8c91-bbaad70a67a1 None admin] SCRIPT_NAME: `/identity` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:24:51.730722 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2365a210-3e9d-4689-8c91-bbaad70a67a1 None admin] PATH_INFO: `/v3/users` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:24:51.731887 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2365a210-3e9d-4689-8c91-bbaad70a67a1 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=207601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:24:51.732452 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2365a210-3e9d-4689-8c91-bbaad70a67a1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:24:51.734723 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2365a210-3e9d-4689-8c91-bbaad70a67a1 None admin] RBAC: Authorization granted {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:24:51.758084 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG dbcounter [-] [207600] Writing DB stats keystone:SELECT=100 {{(pid=207600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:24:51.775144 dv-cinder-851351-1-smb devstack@keystone.service[207601]: [pid: 207601|app: 0|req: 396/792] 10.222.0.42 () {56 vars in 1149 bytes} [Thu Jul 28 08:24:51 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:24:51.781246 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2365a210-3e9d-4689-8c91-bbaad70a67a1 None admin] Authenticating user token {{(pid=207601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:24:51.804692 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e11767-c8f7-41cb-9945-77a09ea92139 None admin] Validating token access rules against request {{(pid=207600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:24:51.852492 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d57c45-9675-4827-9666-c13f1f2082a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:24:51.854140 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d57c45-9675-4827-9666-c13f1f2082a5 None admin] REQUEST_METHOD: `GET` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:24:51.856599 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d57c45-9675-4827-9666-c13f1f2082a5 None admin] SCRIPT_NAME: `/identity` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:24:51.857342 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d57c45-9675-4827-9666-c13f1f2082a5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:24:51.895219 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5d57c45-9675-4827-9666-c13f1f2082a5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:24:51.897163 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5d57c45-9675-4827-9666-c13f1f2082a5 None admin] RBAC: Authorization granted {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:24:51.932512 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application [None req-a5d57c45-9675-4827-9666-c13f1f2082a5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 08:24:51.932512 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:24:51.932512 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:24:51.932512 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:24:51.932512 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:24:51.932512 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:24:51.932512 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:24:51.932512 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:24:51.932512 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:24:51.932512 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:24:51.932512 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:24:51.932512 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:24:51.932512 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 08:24:51.932512 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 08:24:51.932512 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 08:24:51.934149 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 08:24:51.934149 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:24:51.934149 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:24:51.934149 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:24:51.934149 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:24:51.934149 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:24:51.934149 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:24:51.934149 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:24:51.934149 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application with Lock( Jul 28 08:24:51.934149 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:24:51.934149 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:24:51.934149 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:24:51.934149 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:24:51.934149 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:24:51.934149 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:24:51.934149 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:24:51.934149 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:24:51.935672 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 08:24:51.935672 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 08:24:51.935672 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 08:24:51.935672 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application Jul 28 08:24:51.935672 dv-cinder-851351-1-smb devstack@keystone.service[207600]: [pid: 207600|app: 0|req: 397/793] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 08:24:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 326 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:24:51.935672 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5682ad-4044-4e9b-a483-8d51a4b41a15 None None] REQUEST_METHOD: `GET` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:24:51.936324 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5682ad-4044-4e9b-a483-8d51a4b41a15 None None] SCRIPT_NAME: `/identity` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:24:51.936324 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5682ad-4044-4e9b-a483-8d51a4b41a15 None None] PATH_INFO: `/` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:24:51.942375 dv-cinder-851351-1-smb devstack@keystone.service[207600]: [pid: 207600|app: 0|req: 398/794] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 08:24:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 08:24:51.943440 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5682ad-4044-4e9b-a483-8d51a4b41a15 None None] Authenticating user token {{(pid=207600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:24:52.010337 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2365a210-3e9d-4689-8c91-bbaad70a67a1 None admin] Validating token access rules against request {{(pid=207601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:24:52.024100 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG dbcounter [-] [207601] Writing DB stats keystone:SELECT=100 {{(pid=207601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:24:52.070692 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe8b7ca-35b3-4fff-a639-ac8e5811d8e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:24:52.072151 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe8b7ca-35b3-4fff-a639-ac8e5811d8e8 None admin] REQUEST_METHOD: `GET` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:24:52.072756 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe8b7ca-35b3-4fff-a639-ac8e5811d8e8 None admin] SCRIPT_NAME: `/identity` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:24:52.073317 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe8b7ca-35b3-4fff-a639-ac8e5811d8e8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:24:52.083911 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5682ad-4044-4e9b-a483-8d51a4b41a15 None None] Validating token access rules against request {{(pid=207600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:24:52.092995 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfe8b7ca-35b3-4fff-a639-ac8e5811d8e8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:24:52.095339 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfe8b7ca-35b3-4fff-a639-ac8e5811d8e8 None admin] RBAC: Authorization granted {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:24:52.106547 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG dbcounter [-] [207600] Writing DB stats keystone:SELECT=100 {{(pid=207600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:24:52.121208 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application [None req-cfe8b7ca-35b3-4fff-a639-ac8e5811d8e8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 08:24:52.121208 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:24:52.121208 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:24:52.121208 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:24:52.121208 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:24:52.121208 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:24:52.121208 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:24:52.121208 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:24:52.121208 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:24:52.121208 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:24:52.121208 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:24:52.121208 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:24:52.121208 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 08:24:52.121208 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 08:24:52.121208 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 08:24:52.122232 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 08:24:52.122232 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:24:52.122232 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:24:52.122232 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:24:52.122232 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:24:52.122232 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:24:52.122232 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:24:52.122232 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:24:52.122232 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application with Lock( Jul 28 08:24:52.122232 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:24:52.122232 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:24:52.122232 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:24:52.122232 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:24:52.122232 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:24:52.122232 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:24:52.122232 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:24:52.122232 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:24:52.123185 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 08:24:52.123185 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 08:24:52.123185 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 08:24:52.123185 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application Jul 28 08:24:52.129397 dv-cinder-851351-1-smb devstack@keystone.service[207601]: [pid: 207601|app: 0|req: 397/795] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 08:24:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 343 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:24:52.130068 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ade3d1-8d9c-4db3-afe4-9d0f94478606 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:24:52.130947 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ade3d1-8d9c-4db3-afe4-9d0f94478606 None admin] REQUEST_METHOD: `GET` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:24:52.131408 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ade3d1-8d9c-4db3-afe4-9d0f94478606 None admin] SCRIPT_NAME: `/identity` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:24:52.131859 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ade3d1-8d9c-4db3-afe4-9d0f94478606 None admin] PATH_INFO: `/v3/domains` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:24:52.132398 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33164975-6d45-413b-9e53-c99fbbb27046 None None] REQUEST_METHOD: `POST` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:24:52.132965 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33164975-6d45-413b-9e53-c99fbbb27046 None None] SCRIPT_NAME: `/identity` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:24:52.133186 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4ade3d1-8d9c-4db3-afe4-9d0f94478606 None admin] RBAC: Adding query filter params (name=Default) {{(pid=207600) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:24:52.133578 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33164975-6d45-413b-9e53-c99fbbb27046 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:24:52.133880 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4ade3d1-8d9c-4db3-afe4-9d0f94478606 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:24:52.135605 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4ade3d1-8d9c-4db3-afe4-9d0f94478606 None admin] RBAC: Authorization granted {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:24:52.151926 dv-cinder-851351-1-smb devstack@keystone.service[207600]: [pid: 207600|app: 0|req: 399/796] 10.222.0.42 () {56 vars in 1109 bytes} [Thu Jul 28 08:24:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:24:52.153223 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ade3d1-8d9c-4db3-afe4-9d0f94478606 None admin] Authenticating user token {{(pid=207600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:24:52.165584 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.auth.core [None req-33164975-6d45-413b-9e53-c99fbbb27046 None None] MFA Rules not processed for user `b8110ade874c4aa7af27f5c376df700a`. Rule list: `[]` (Enabled: `True`). {{(pid=207601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 08:24:52.167144 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.fernet_utils [None req-33164975-6d45-413b-9e53-c99fbbb27046 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=207601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:24:52.257118 dv-cinder-851351-1-smb devstack@keystone.service[207601]: [pid: 207601|app: 0|req: 398/797] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 08:24:52 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 08:24:52.258608 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33164975-6d45-413b-9e53-c99fbbb27046 None None] Authenticating user token {{(pid=207601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:24:52.285139 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ade3d1-8d9c-4db3-afe4-9d0f94478606 None admin] Validating token access rules against request {{(pid=207600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:24:52.333039 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ea25f7-c382-4406-8ca2-7217b1cc30e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:24:52.333711 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ea25f7-c382-4406-8ca2-7217b1cc30e1 None admin] REQUEST_METHOD: `GET` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:24:52.333994 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ea25f7-c382-4406-8ca2-7217b1cc30e1 None admin] SCRIPT_NAME: `/identity` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:24:52.334317 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ea25f7-c382-4406-8ca2-7217b1cc30e1 None admin] PATH_INFO: `/v3/domains` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:24:52.335065 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85ea25f7-c382-4406-8ca2-7217b1cc30e1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=207600) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:24:52.335428 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85ea25f7-c382-4406-8ca2-7217b1cc30e1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:24:52.336946 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85ea25f7-c382-4406-8ca2-7217b1cc30e1 None admin] RBAC: Authorization granted {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:24:52.350824 dv-cinder-851351-1-smb devstack@keystone.service[207600]: [pid: 207600|app: 0|req: 400/798] 10.222.0.42 () {56 vars in 1109 bytes} [Thu Jul 28 08:24:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:24:52.352618 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cad6b06-b3c7-464b-beac-1a9a3de965b8 None None] REQUEST_METHOD: `GET` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:24:52.353007 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cad6b06-b3c7-464b-beac-1a9a3de965b8 None None] SCRIPT_NAME: `/identity` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:24:52.353284 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cad6b06-b3c7-464b-beac-1a9a3de965b8 None None] PATH_INFO: `/` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:24:52.354826 dv-cinder-851351-1-smb devstack@keystone.service[207600]: [pid: 207600|app: 0|req: 401/799] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 08:24:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 08:24:52.355415 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cad6b06-b3c7-464b-beac-1a9a3de965b8 None None] Authenticating user token {{(pid=207600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:24:52.405332 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG dbcounter [-] [207600] Writing DB stats keystone:SELECT=100 {{(pid=207600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:24:52.410695 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG dbcounter [-] [207601] Writing DB stats keystone:SELECT=100 {{(pid=207601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:24:52.431058 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33164975-6d45-413b-9e53-c99fbbb27046 None None] Validating token access rules against request {{(pid=207601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:24:52.467798 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a7062f-0908-4ff6-934a-8d1260bbeef5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:24:52.468503 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a7062f-0908-4ff6-934a-8d1260bbeef5 None admin] REQUEST_METHOD: `GET` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:24:52.468941 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a7062f-0908-4ff6-934a-8d1260bbeef5 None admin] SCRIPT_NAME: `/identity` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:24:52.469222 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a7062f-0908-4ff6-934a-8d1260bbeef5 None admin] PATH_INFO: `/v3/users/swift` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:24:52.477017 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a7062f-0908-4ff6-934a-8d1260bbeef5 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:24:52.478722 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a7062f-0908-4ff6-934a-8d1260bbeef5 None admin] RBAC: Authorization granted {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:24:52.479575 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cad6b06-b3c7-464b-beac-1a9a3de965b8 None None] Validating token access rules against request {{(pid=207600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:24:52.491353 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application [None req-62a7062f-0908-4ff6-934a-8d1260bbeef5 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 28 08:24:52.491353 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:24:52.491353 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:24:52.491353 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:24:52.491353 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:24:52.491353 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:24:52.491353 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:24:52.491353 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:24:52.491353 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:24:52.491353 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:24:52.491353 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:24:52.491353 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:24:52.491353 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 28 08:24:52.491353 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 28 08:24:52.491353 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 28 08:24:52.491353 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 28 08:24:52.492608 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:24:52.492608 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:24:52.492608 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 28 08:24:52.492608 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 08:24:52.492608 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 28 08:24:52.492608 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 08:24:52.492608 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:24:52.492608 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:24:52.492608 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:24:52.492608 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:24:52.492608 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:24:52.492608 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application with Lock( Jul 28 08:24:52.492608 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:24:52.492608 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:24:52.492608 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:24:52.492608 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:24:52.492608 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:24:52.492608 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:24:52.493958 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:24:52.493958 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:24:52.493958 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 28 08:24:52.493958 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 28 08:24:52.493958 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 28 08:24:52.493958 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 28 08:24:52.493958 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 28 08:24:52.493958 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 28 08:24:52.493958 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 28 08:24:52.493958 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application Jul 28 08:24:52.497462 dv-cinder-851351-1-smb devstack@keystone.service[207601]: [pid: 207601|app: 0|req: 399/800] 10.222.0.42 () {56 vars in 1096 bytes} [Thu Jul 28 08:24:52 2022] GET /identity/v3/users/swift => generated 83 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:24:52.498684 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a7062f-0908-4ff6-934a-8d1260bbeef5 None admin] Authenticating user token {{(pid=207601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:24:52.520986 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a73cb8-3e80-4230-9fb4-c7cdcd3c641b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:24:52.521739 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a73cb8-3e80-4230-9fb4-c7cdcd3c641b None admin] REQUEST_METHOD: `GET` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:24:52.522539 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a73cb8-3e80-4230-9fb4-c7cdcd3c641b None admin] SCRIPT_NAME: `/identity` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:24:52.522890 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a73cb8-3e80-4230-9fb4-c7cdcd3c641b None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:24:52.523607 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a73cb8-3e80-4230-9fb4-c7cdcd3c641b None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:24:52.525107 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a73cb8-3e80-4230-9fb4-c7cdcd3c641b None admin] RBAC: Authorization granted {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:24:52.544204 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application [None req-24a73cb8-3e80-4230-9fb4-c7cdcd3c641b None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 28 08:24:52.544204 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:24:52.544204 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 28 08:24:52.544204 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 28 08:24:52.544204 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 28 08:24:52.544204 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 28 08:24:52.544204 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 28 08:24:52.544204 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 08:24:52.544204 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 28 08:24:52.544204 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application Jul 28 08:24:52.544204 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 28 08:24:52.544204 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application Jul 28 08:24:52.544204 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:24:52.544204 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:24:52.544204 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:24:52.544204 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:24:52.545475 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:24:52.545475 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:24:52.545475 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:24:52.545475 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:24:52.545475 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:24:52.545475 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:24:52.545475 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:24:52.545475 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 28 08:24:52.545475 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 28 08:24:52.545475 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 28 08:24:52.545475 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 28 08:24:52.545475 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:24:52.545475 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:24:52.545475 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:24:52.545475 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:24:52.545475 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:24:52.546577 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:24:52.546577 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:24:52.546577 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application with Lock( Jul 28 08:24:52.546577 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:24:52.546577 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:24:52.546577 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:24:52.546577 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:24:52.546577 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:24:52.546577 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:24:52.546577 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:24:52.546577 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:24:52.546577 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 28 08:24:52.546577 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 08:24:52.546577 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 28 08:24:52.546577 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application Jul 28 08:24:52.546577 dv-cinder-851351-1-smb devstack@keystone.service[207600]: [pid: 207600|app: 0|req: 402/801] 10.222.0.42 () {56 vars in 1129 bytes} [Thu Jul 28 08:24:52 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:24:52.547581 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f8fdb6-52d6-4e4d-9747-69d0ffac2336 None None] REQUEST_METHOD: `POST` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:24:52.547581 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f8fdb6-52d6-4e4d-9747-69d0ffac2336 None None] SCRIPT_NAME: `/identity` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:24:52.547581 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f8fdb6-52d6-4e4d-9747-69d0ffac2336 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:24:52.560941 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.auth.core [None req-b8f8fdb6-52d6-4e4d-9747-69d0ffac2336 None None] MFA Rules not processed for user `b8110ade874c4aa7af27f5c376df700a`. Rule list: `[]` (Enabled: `True`). {{(pid=207600) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 08:24:52.562238 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.fernet_utils [None req-b8f8fdb6-52d6-4e4d-9747-69d0ffac2336 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=207600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:24:52.634417 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a7062f-0908-4ff6-934a-8d1260bbeef5 None admin] Validating token access rules against request {{(pid=207601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:24:52.660963 dv-cinder-851351-1-smb devstack@keystone.service[207600]: [pid: 207600|app: 0|req: 403/802] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 08:24:52 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 08:24:52.670449 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f8fdb6-52d6-4e4d-9747-69d0ffac2336 None None] Authenticating user token {{(pid=207600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:24:52.679105 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b40d15-f114-48ae-8f98-72836cd0fa02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:24:52.679781 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b40d15-f114-48ae-8f98-72836cd0fa02 None admin] REQUEST_METHOD: `GET` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:24:52.680378 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b40d15-f114-48ae-8f98-72836cd0fa02 None admin] SCRIPT_NAME: `/identity` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:24:52.680984 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b40d15-f114-48ae-8f98-72836cd0fa02 None admin] PATH_INFO: `/v3/projects/service` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:24:52.692574 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79b40d15-f114-48ae-8f98-72836cd0fa02 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:24:52.694577 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79b40d15-f114-48ae-8f98-72836cd0fa02 None admin] RBAC: Authorization granted {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:24:52.709417 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application [None req-79b40d15-f114-48ae-8f98-72836cd0fa02 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 08:24:52.709417 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:24:52.709417 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:24:52.709417 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:24:52.709417 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:24:52.709417 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:24:52.709417 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:24:52.709417 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:24:52.709417 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:24:52.709417 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:24:52.709417 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:24:52.709417 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:24:52.709417 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 28 08:24:52.709417 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 28 08:24:52.709417 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 28 08:24:52.710632 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 28 08:24:52.710632 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:24:52.710632 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:24:52.710632 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:24:52.710632 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:24:52.710632 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:24:52.710632 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:24:52.710632 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:24:52.710632 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application with Lock( Jul 28 08:24:52.710632 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:24:52.710632 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:24:52.710632 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:24:52.710632 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:24:52.710632 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:24:52.710632 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:24:52.710632 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:24:52.710632 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:24:52.711901 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 28 08:24:52.711901 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 28 08:24:52.711901 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 28 08:24:52.711901 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 28 08:24:52.711901 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 28 08:24:52.711901 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 28 08:24:52.711901 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 08:24:52.711901 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application Jul 28 08:24:52.717711 dv-cinder-851351-1-smb devstack@keystone.service[207601]: [pid: 207601|app: 0|req: 400/803] 10.222.0.42 () {56 vars in 1111 bytes} [Thu Jul 28 08:24:52 2022] GET /identity/v3/projects/service => generated 88 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:24:52.718541 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b40d15-f114-48ae-8f98-72836cd0fa02 None admin] Authenticating user token {{(pid=207601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:24:52.725288 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG dbcounter [-] [207600] Writing DB stats keystone:SELECT=100 {{(pid=207600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:24:52.736224 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG dbcounter [-] [207601] Writing DB stats keystone:SELECT=100 {{(pid=207601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:24:52.813069 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f8fdb6-52d6-4e4d-9747-69d0ffac2336 None None] Validating token access rules against request {{(pid=207600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:24:52.847320 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b40d15-f114-48ae-8f98-72836cd0fa02 None admin] Validating token access rules against request {{(pid=207601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:24:52.856124 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b363ee5-551a-4456-bec6-d04fa46f0a4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:24:52.857291 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b363ee5-551a-4456-bec6-d04fa46f0a4d None admin] REQUEST_METHOD: `GET` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:24:52.858149 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b363ee5-551a-4456-bec6-d04fa46f0a4d None admin] SCRIPT_NAME: `/identity` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:24:52.858707 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b363ee5-551a-4456-bec6-d04fa46f0a4d None admin] PATH_INFO: `/v3/users` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:24:52.860294 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b363ee5-551a-4456-bec6-d04fa46f0a4d None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=207600) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:24:52.860875 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b363ee5-551a-4456-bec6-d04fa46f0a4d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:24:52.863595 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b363ee5-551a-4456-bec6-d04fa46f0a4d None admin] RBAC: Authorization granted {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:24:52.903011 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e17025f-c6d1-4fb7-8bb7-af99a4b51d3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:24:52.903288 dv-cinder-851351-1-smb devstack@keystone.service[207600]: [pid: 207600|app: 0|req: 404/804] 10.222.0.42 () {56 vars in 1135 bytes} [Thu Jul 28 08:24:52 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:24:52.904910 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e17025f-c6d1-4fb7-8bb7-af99a4b51d3a None admin] REQUEST_METHOD: `GET` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:24:52.905027 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b363ee5-551a-4456-bec6-d04fa46f0a4d None admin] Authenticating user token {{(pid=207600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:24:52.905505 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e17025f-c6d1-4fb7-8bb7-af99a4b51d3a None admin] SCRIPT_NAME: `/identity` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:24:52.905994 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e17025f-c6d1-4fb7-8bb7-af99a4b51d3a None admin] PATH_INFO: `/v3/services` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:24:52.906924 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e17025f-c6d1-4fb7-8bb7-af99a4b51d3a None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=207601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:24:52.907460 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e17025f-c6d1-4fb7-8bb7-af99a4b51d3a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:24:52.909264 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e17025f-c6d1-4fb7-8bb7-af99a4b51d3a None admin] RBAC: Authorization granted {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:24:52.920828 dv-cinder-851351-1-smb devstack@keystone.service[207601]: [pid: 207601|app: 0|req: 401/805] 10.222.0.42 () {56 vars in 1124 bytes} [Thu Jul 28 08:24:52 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:24:52.922786 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e17025f-c6d1-4fb7-8bb7-af99a4b51d3a None admin] Authenticating user token {{(pid=207601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:24:53.013190 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG dbcounter [-] [207600] Writing DB stats keystone:SELECT=100 {{(pid=207600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:24:53.023497 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b363ee5-551a-4456-bec6-d04fa46f0a4d None admin] Validating token access rules against request {{(pid=207600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:24:53.027935 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG dbcounter [-] [207601] Writing DB stats keystone:SELECT=100 {{(pid=207601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:24:53.059547 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb1cd339-74a7-4030-b9b7-9eca9ba97072 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:24:53.059919 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e17025f-c6d1-4fb7-8bb7-af99a4b51d3a None admin] Validating token access rules against request {{(pid=207601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:24:53.060233 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1cd339-74a7-4030-b9b7-9eca9ba97072 None admin] REQUEST_METHOD: `GET` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:24:53.060513 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1cd339-74a7-4030-b9b7-9eca9ba97072 None admin] SCRIPT_NAME: `/identity` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:24:53.060817 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1cd339-74a7-4030-b9b7-9eca9ba97072 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:24:53.073880 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb1cd339-74a7-4030-b9b7-9eca9ba97072 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 08:24:53.078886 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application [None req-cb1cd339-74a7-4030-b9b7-9eca9ba97072 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 08:24:53.078886 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:24:53.078886 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:24:53.078886 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:24:53.078886 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:24:53.078886 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:24:53.078886 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:24:53.078886 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:24:53.078886 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:24:53.078886 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:24:53.078886 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:24:53.078886 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:24:53.078886 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 08:24:53.078886 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 08:24:53.078886 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 08:24:53.078886 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 08:24:53.079883 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 08:24:53.079883 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 08:24:53.079883 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 08:24:53.079883 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 08:24:53.079883 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:24:53.079883 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:24:53.079883 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:24:53.079883 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:24:53.079883 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:24:53.079883 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:24:53.079883 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:24:53.079883 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application with Lock( Jul 28 08:24:53.079883 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:24:53.079883 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:24:53.079883 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:24:53.079883 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:24:53.081198 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:24:53.081198 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:24:53.081198 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:24:53.081198 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:24:53.081198 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 08:24:53.081198 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 08:24:53.081198 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 08:24:53.081198 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 08:24:53.081198 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 08:24:53.081198 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 08:24:53.081198 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 08:24:53.081198 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application Jul 28 08:24:53.081198 dv-cinder-851351-1-smb devstack@keystone.service[207600]: [pid: 207600|app: 0|req: 405/806] 10.222.0.42 () {56 vars in 1096 bytes} [Thu Jul 28 08:24:52 2022] GET /identity/v3/roles/admin => generated 83 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:24:53.081198 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb1cd339-74a7-4030-b9b7-9eca9ba97072 None admin] Authenticating user token {{(pid=207600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:24:53.100509 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7312323b-7bd6-43ab-8b7a-ff2286fcb210 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:24:53.101194 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7312323b-7bd6-43ab-8b7a-ff2286fcb210 None admin] REQUEST_METHOD: `GET` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:24:53.101479 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7312323b-7bd6-43ab-8b7a-ff2286fcb210 None admin] SCRIPT_NAME: `/identity` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:24:53.101757 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7312323b-7bd6-43ab-8b7a-ff2286fcb210 None admin] PATH_INFO: `/v3/projects` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:24:53.102536 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7312323b-7bd6-43ab-8b7a-ff2286fcb210 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=207601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:24:53.102843 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7312323b-7bd6-43ab-8b7a-ff2286fcb210 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:24:53.104330 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7312323b-7bd6-43ab-8b7a-ff2286fcb210 None admin] RBAC: Authorization granted {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:24:53.117037 dv-cinder-851351-1-smb devstack@keystone.service[207601]: [pid: 207601|app: 0|req: 402/807] 10.222.0.42 () {56 vars in 1148 bytes} [Thu Jul 28 08:24:52 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:24:53.117859 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7312323b-7bd6-43ab-8b7a-ff2286fcb210 None admin] Authenticating user token {{(pid=207601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:24:53.198992 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb1cd339-74a7-4030-b9b7-9eca9ba97072 None admin] Validating token access rules against request {{(pid=207600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:24:53.231066 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7312323b-7bd6-43ab-8b7a-ff2286fcb210 None admin] Validating token access rules against request {{(pid=207601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:24:53.247935 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f29f26-39ad-4334-8dde-a632706417a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:24:53.249264 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f29f26-39ad-4334-8dde-a632706417a3 None admin] REQUEST_METHOD: `GET` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:24:53.249911 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f29f26-39ad-4334-8dde-a632706417a3 None admin] SCRIPT_NAME: `/identity` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:24:53.250570 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f29f26-39ad-4334-8dde-a632706417a3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:24:53.271071 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f29f26-39ad-4334-8dde-a632706417a3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:24:53.273709 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f29f26-39ad-4334-8dde-a632706417a3 None admin] RBAC: Authorization granted {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:24:53.284995 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG dbcounter [-] [207601] Writing DB stats keystone:SELECT=100 {{(pid=207601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:24:53.292715 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2fed6c-ce99-44cc-ad90-acd09873cd96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:24:53.293375 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2fed6c-ce99-44cc-ad90-acd09873cd96 None admin] REQUEST_METHOD: `GET` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:24:53.293690 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2fed6c-ce99-44cc-ad90-acd09873cd96 None admin] SCRIPT_NAME: `/identity` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:24:53.293969 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2fed6c-ce99-44cc-ad90-acd09873cd96 None admin] PATH_INFO: `/v3/services` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:24:53.294687 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f2fed6c-ce99-44cc-ad90-acd09873cd96 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=207601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:24:53.295001 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f2fed6c-ce99-44cc-ad90-acd09873cd96 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:24:53.295104 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application [None req-82f29f26-39ad-4334-8dde-a632706417a3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 08:24:53.295104 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:24:53.295104 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:24:53.295104 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:24:53.295104 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:24:53.295104 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:24:53.295104 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:24:53.295104 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:24:53.295104 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:24:53.295104 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:24:53.295104 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:24:53.295104 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:24:53.295104 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 08:24:53.295104 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 08:24:53.295104 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 08:24:53.295955 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 08:24:53.295955 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:24:53.295955 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:24:53.295955 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:24:53.295955 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:24:53.295955 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:24:53.295955 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:24:53.295955 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:24:53.295955 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application with Lock( Jul 28 08:24:53.295955 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:24:53.295955 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:24:53.295955 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:24:53.295955 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:24:53.295955 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:24:53.295955 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:24:53.295955 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:24:53.295955 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:24:53.297360 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 08:24:53.297360 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 08:24:53.297360 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 08:24:53.297360 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application Jul 28 08:24:53.297360 dv-cinder-851351-1-smb devstack@keystone.service[207600]: [pid: 207600|app: 0|req: 406/808] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 08:24:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:24:53.297670 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f29f26-39ad-4334-8dde-a632706417a3 None admin] Authenticating user token {{(pid=207600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:24:53.300835 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG dbcounter [-] [207600] Writing DB stats keystone:SELECT=100 {{(pid=207600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:24:53.302611 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f2fed6c-ce99-44cc-ad90-acd09873cd96 None admin] RBAC: Authorization granted {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:24:53.310169 dv-cinder-851351-1-smb devstack@keystone.service[207601]: [pid: 207601|app: 0|req: 403/809] 10.222.0.42 () {56 vars in 1124 bytes} [Thu Jul 28 08:24:53 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:24:53.312004 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2fed6c-ce99-44cc-ad90-acd09873cd96 None admin] Authenticating user token {{(pid=207601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:24:53.433770 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f29f26-39ad-4334-8dde-a632706417a3 None admin] Validating token access rules against request {{(pid=207600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:24:53.434902 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2fed6c-ce99-44cc-ad90-acd09873cd96 None admin] Validating token access rules against request {{(pid=207601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:24:53.469624 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a3003b-2b2f-4d81-aa46-7acad5d61268 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:24:53.469909 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d64ada-3c35-4125-8507-46ed9b753679 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:24:53.470261 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a3003b-2b2f-4d81-aa46-7acad5d61268 None admin] REQUEST_METHOD: `GET` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:24:53.470384 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d64ada-3c35-4125-8507-46ed9b753679 None admin] REQUEST_METHOD: `PUT` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:24:53.470554 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a3003b-2b2f-4d81-aa46-7acad5d61268 None admin] SCRIPT_NAME: `/identity` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:24:53.470663 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d64ada-3c35-4125-8507-46ed9b753679 None admin] SCRIPT_NAME: `/identity` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:24:53.470836 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a3003b-2b2f-4d81-aa46-7acad5d61268 None admin] PATH_INFO: `/v3/roles` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:24:53.470943 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d64ada-3c35-4125-8507-46ed9b753679 None admin] PATH_INFO: `/v3/projects/48c5f2b2ae2b48758b957d2b194a7fd1/users/601010c3acdf446bb37ff23cbed0dcf1/roles/b44e7c7aeec24f51b8033df305da133d` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:24:53.471580 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83a3003b-2b2f-4d81-aa46-7acad5d61268 None admin] RBAC: Adding query filter params (name=admin) {{(pid=207600) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:24:53.471902 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83a3003b-2b2f-4d81-aa46-7acad5d61268 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:24:53.473360 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83a3003b-2b2f-4d81-aa46-7acad5d61268 None admin] RBAC: Authorization granted {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:24:53.482327 dv-cinder-851351-1-smb devstack@keystone.service[207600]: [pid: 207600|app: 0|req: 407/810] 10.222.0.42 () {56 vars in 1099 bytes} [Thu Jul 28 08:24:53 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:24:53.483191 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a3003b-2b2f-4d81-aa46-7acad5d61268 None admin] Authenticating user token {{(pid=207600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:24:53.491202 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7d64ada-3c35-4125-8507-46ed9b753679 None admin] RBAC: Authorizing `identity:create_grant(project_id=48c5f2b2ae2b48758b957d2b194a7fd1, user_id=601010c3acdf446bb37ff23cbed0dcf1, role_id=b44e7c7aeec24f51b8033df305da133d)` {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:24:53.492697 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7d64ada-3c35-4125-8507-46ed9b753679 None admin] RBAC: Authorization granted {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:24:53.509395 dv-cinder-851351-1-smb devstack@keystone.service[207601]: [pid: 207601|app: 0|req: 404/811] 10.222.0.42 () {58 vars in 1439 bytes} [Thu Jul 28 08:24:53 2022] PUT /identity/v3/projects/48c5f2b2ae2b48758b957d2b194a7fd1/users/601010c3acdf446bb37ff23cbed0dcf1/roles/b44e7c7aeec24f51b8033df305da133d => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 08:24:53.510423 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d64ada-3c35-4125-8507-46ed9b753679 None admin] Authenticating user token {{(pid=207601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:24:53.557280 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG dbcounter [-] [207600] Writing DB stats keystone:SELECT=100 {{(pid=207600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:24:53.569477 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG dbcounter [-] [207601] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=207601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:24:53.616996 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a3003b-2b2f-4d81-aa46-7acad5d61268 None admin] Validating token access rules against request {{(pid=207600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:24:53.662999 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d64ada-3c35-4125-8507-46ed9b753679 None admin] Validating token access rules against request {{(pid=207601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:24:53.679371 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393a976f-1b85-4635-881f-201100ec5967 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:24:53.679625 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393a976f-1b85-4635-881f-201100ec5967 None admin] REQUEST_METHOD: `GET` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:24:53.680693 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393a976f-1b85-4635-881f-201100ec5967 None admin] SCRIPT_NAME: `/identity` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:24:53.680908 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393a976f-1b85-4635-881f-201100ec5967 None admin] PATH_INFO: `/v3/domains` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:24:53.682632 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-393a976f-1b85-4635-881f-201100ec5967 None admin] RBAC: Adding query filter params (name=Default) {{(pid=207600) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:24:53.683160 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-393a976f-1b85-4635-881f-201100ec5967 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:24:53.685994 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-393a976f-1b85-4635-881f-201100ec5967 None admin] RBAC: Authorization granted {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:24:53.705944 dv-cinder-851351-1-smb devstack@keystone.service[207600]: [pid: 207600|app: 0|req: 408/812] 10.222.0.42 () {56 vars in 1109 bytes} [Thu Jul 28 08:24:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:24:53.708092 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ed9f00-7e4e-4add-840a-7af7db112910 None None] REQUEST_METHOD: `GET` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:24:53.708563 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ed9f00-7e4e-4add-840a-7af7db112910 None None] SCRIPT_NAME: `/identity` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:24:53.713052 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ed9f00-7e4e-4add-840a-7af7db112910 None None] PATH_INFO: `/` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:24:53.719153 dv-cinder-851351-1-smb devstack@keystone.service[207600]: [pid: 207600|app: 0|req: 409/813] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 08:24:53 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 08:24:53.719153 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ed9f00-7e4e-4add-840a-7af7db112910 None None] Authenticating user token {{(pid=207600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:24:53.720876 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c9c0760-911a-476c-8a15-5c1fac07e19d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:24:53.722090 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9c0760-911a-476c-8a15-5c1fac07e19d None admin] REQUEST_METHOD: `POST` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:24:53.722692 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9c0760-911a-476c-8a15-5c1fac07e19d None admin] SCRIPT_NAME: `/identity` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:24:53.723315 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9c0760-911a-476c-8a15-5c1fac07e19d None admin] PATH_INFO: `/v3/endpoints` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:24:53.726330 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c9c0760-911a-476c-8a15-5c1fac07e19d None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:24:53.729230 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c9c0760-911a-476c-8a15-5c1fac07e19d None admin] RBAC: Authorization granted {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:24:53.766682 dv-cinder-851351-1-smb devstack@keystone.service[207601]: [pid: 207601|app: 0|req: 405/814] 10.222.0.42 () {60 vars in 1144 bytes} [Thu Jul 28 08:24:53 2022] POST /identity/v3/endpoints => generated 346 bytes in 257 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 08:24:53.773906 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c9c0760-911a-476c-8a15-5c1fac07e19d None admin] Authenticating user token {{(pid=207601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:24:53.871188 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ed9f00-7e4e-4add-840a-7af7db112910 None None] Validating token access rules against request {{(pid=207600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:24:53.906054 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG dbcounter [-] [207600] Writing DB stats keystone:SELECT=100 {{(pid=207600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:24:53.927837 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28893db-3ab5-4e88-98ac-399656b82c4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:24:53.928637 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28893db-3ab5-4e88-98ac-399656b82c4d None admin] REQUEST_METHOD: `GET` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:24:53.929103 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28893db-3ab5-4e88-98ac-399656b82c4d None admin] SCRIPT_NAME: `/identity` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:24:53.929715 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28893db-3ab5-4e88-98ac-399656b82c4d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:24:53.943944 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c9c0760-911a-476c-8a15-5c1fac07e19d None admin] Validating token access rules against request {{(pid=207601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:24:53.945887 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG dbcounter [-] [207601] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=207601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:24:53.947462 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c28893db-3ab5-4e88-98ac-399656b82c4d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:24:53.949596 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c28893db-3ab5-4e88-98ac-399656b82c4d None admin] RBAC: Authorization granted {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:24:53.968954 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application [None req-c28893db-3ab5-4e88-98ac-399656b82c4d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 08:24:53.968954 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:24:53.968954 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:24:53.968954 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:24:53.968954 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:24:53.968954 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:24:53.968954 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:24:53.968954 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:24:53.968954 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:24:53.968954 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:24:53.968954 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:24:53.968954 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:24:53.968954 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 08:24:53.968954 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 08:24:53.968954 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 08:24:53.969998 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 08:24:53.969998 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:24:53.969998 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:24:53.969998 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:24:53.969998 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:24:53.969998 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:24:53.969998 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:24:53.969998 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:24:53.969998 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application with Lock( Jul 28 08:24:53.969998 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:24:53.969998 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:24:53.969998 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:24:53.969998 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:24:53.969998 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:24:53.969998 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:24:53.969998 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:24:53.969998 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:24:53.970958 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 08:24:53.970958 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 08:24:53.970958 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 08:24:53.970958 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application Jul 28 08:24:53.970958 dv-cinder-851351-1-smb devstack@keystone.service[207600]: [pid: 207600|app: 0|req: 410/815] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 08:24:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 253 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:24:53.971719 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be293494-cf1e-4154-8e01-9a93c4e98441 None None] REQUEST_METHOD: `POST` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:24:53.971892 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be293494-cf1e-4154-8e01-9a93c4e98441 None None] SCRIPT_NAME: `/identity` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:24:53.972043 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be293494-cf1e-4154-8e01-9a93c4e98441 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:24:53.987217 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a3f14c-acf7-4644-b06b-da18fe81fd93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:24:53.987905 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a3f14c-acf7-4644-b06b-da18fe81fd93 None admin] REQUEST_METHOD: `GET` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:24:53.988296 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a3f14c-acf7-4644-b06b-da18fe81fd93 None admin] SCRIPT_NAME: `/identity` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:24:53.988520 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a3f14c-acf7-4644-b06b-da18fe81fd93 None admin] PATH_INFO: `/v3/projects/service` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:24:53.992114 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.auth.core [None req-be293494-cf1e-4154-8e01-9a93c4e98441 None None] MFA Rules not processed for user `b8110ade874c4aa7af27f5c376df700a`. Rule list: `[]` (Enabled: `True`). {{(pid=207600) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 08:24:53.993397 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.fernet_utils [None req-be293494-cf1e-4154-8e01-9a93c4e98441 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=207600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:24:53.996413 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4a3f14c-acf7-4644-b06b-da18fe81fd93 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:24:53.997997 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4a3f14c-acf7-4644-b06b-da18fe81fd93 None admin] RBAC: Authorization granted {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:24:54.012038 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application [None req-c4a3f14c-acf7-4644-b06b-da18fe81fd93 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 08:24:54.012038 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:24:54.012038 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:24:54.012038 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:24:54.012038 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:24:54.012038 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:24:54.012038 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:24:54.012038 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:24:54.012038 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:24:54.012038 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:24:54.012038 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:24:54.012038 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:24:54.012038 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 28 08:24:54.012038 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 28 08:24:54.012038 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 28 08:24:54.013234 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 28 08:24:54.013234 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:24:54.013234 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:24:54.013234 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:24:54.013234 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:24:54.013234 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:24:54.013234 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:24:54.013234 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:24:54.013234 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application with Lock( Jul 28 08:24:54.013234 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:24:54.013234 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:24:54.013234 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:24:54.013234 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:24:54.013234 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:24:54.013234 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:24:54.013234 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:24:54.013234 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:24:54.014190 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 28 08:24:54.014190 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 28 08:24:54.014190 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 28 08:24:54.014190 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 28 08:24:54.014190 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 28 08:24:54.014190 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 28 08:24:54.014190 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 08:24:54.014190 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application Jul 28 08:24:54.014190 dv-cinder-851351-1-smb devstack@keystone.service[207601]: [pid: 207601|app: 0|req: 406/816] 10.222.0.42 () {56 vars in 1111 bytes} [Thu Jul 28 08:24:53 2022] GET /identity/v3/projects/service => generated 88 bytes in 246 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:24:54.014719 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a3f14c-acf7-4644-b06b-da18fe81fd93 None admin] Authenticating user token {{(pid=207601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:24:54.080492 dv-cinder-851351-1-smb devstack@keystone.service[207600]: [pid: 207600|app: 0|req: 411/817] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 08:24:53 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 08:24:54.082462 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be293494-cf1e-4154-8e01-9a93c4e98441 None None] Authenticating user token {{(pid=207600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:24:54.146222 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a3f14c-acf7-4644-b06b-da18fe81fd93 None admin] Validating token access rules against request {{(pid=207601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:24:54.195176 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff96add-0af5-459c-bbf1-3be8d8b65a5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:24:54.195737 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff96add-0af5-459c-bbf1-3be8d8b65a5f None admin] REQUEST_METHOD: `GET` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:24:54.196027 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff96add-0af5-459c-bbf1-3be8d8b65a5f None admin] SCRIPT_NAME: `/identity` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:24:54.196309 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff96add-0af5-459c-bbf1-3be8d8b65a5f None admin] PATH_INFO: `/v3/domains` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:24:54.197311 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff96add-0af5-459c-bbf1-3be8d8b65a5f None admin] RBAC: Adding query filter params (name=Default) {{(pid=207601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:24:54.197429 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff96add-0af5-459c-bbf1-3be8d8b65a5f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:24:54.198853 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff96add-0af5-459c-bbf1-3be8d8b65a5f None admin] RBAC: Authorization granted {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:24:54.208345 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be293494-cf1e-4154-8e01-9a93c4e98441 None None] Validating token access rules against request {{(pid=207600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:24:54.210689 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG dbcounter [-] [207600] Writing DB stats keystone:SELECT=100 {{(pid=207600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:24:54.218779 dv-cinder-851351-1-smb devstack@keystone.service[207601]: [pid: 207601|app: 0|req: 407/818] 10.222.0.42 () {56 vars in 1109 bytes} [Thu Jul 28 08:24:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:24:54.218779 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff96add-0af5-459c-bbf1-3be8d8b65a5f None admin] Authenticating user token {{(pid=207601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:24:54.250946 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bbf3620-2d96-4794-a6e2-2ee58ce0ad23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:24:54.251705 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bbf3620-2d96-4794-a6e2-2ee58ce0ad23 None admin] REQUEST_METHOD: `GET` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:24:54.251999 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bbf3620-2d96-4794-a6e2-2ee58ce0ad23 None admin] SCRIPT_NAME: `/identity` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:24:54.252274 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bbf3620-2d96-4794-a6e2-2ee58ce0ad23 None admin] PATH_INFO: `/v3/projects` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:24:54.253059 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG dbcounter [-] [207601] Writing DB stats keystone:SELECT=100 {{(pid=207601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:24:54.253177 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bbf3620-2d96-4794-a6e2-2ee58ce0ad23 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=207600) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:24:54.253431 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bbf3620-2d96-4794-a6e2-2ee58ce0ad23 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:24:54.255024 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bbf3620-2d96-4794-a6e2-2ee58ce0ad23 None admin] RBAC: Authorization granted {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:24:54.277487 dv-cinder-851351-1-smb devstack@keystone.service[207600]: [pid: 207600|app: 0|req: 412/819] 10.222.0.42 () {56 vars in 1148 bytes} [Thu Jul 28 08:24:54 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:24:54.277720 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bbf3620-2d96-4794-a6e2-2ee58ce0ad23 None admin] Authenticating user token {{(pid=207600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:24:54.349768 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff96add-0af5-459c-bbf1-3be8d8b65a5f None admin] Validating token access rules against request {{(pid=207601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:24:54.395895 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecfc4992-ff42-4bd4-b3da-9e84ce3d3f87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:24:54.397135 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecfc4992-ff42-4bd4-b3da-9e84ce3d3f87 None admin] REQUEST_METHOD: `GET` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:24:54.397614 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecfc4992-ff42-4bd4-b3da-9e84ce3d3f87 None admin] SCRIPT_NAME: `/identity` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:24:54.398101 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecfc4992-ff42-4bd4-b3da-9e84ce3d3f87 None admin] PATH_INFO: `/v3/services/network` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:24:54.398606 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bbf3620-2d96-4794-a6e2-2ee58ce0ad23 None admin] Validating token access rules against request {{(pid=207600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:24:54.399139 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecfc4992-ff42-4bd4-b3da-9e84ce3d3f87 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:24:54.401085 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecfc4992-ff42-4bd4-b3da-9e84ce3d3f87 None admin] RBAC: Authorization granted {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:24:54.416625 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application [None req-ecfc4992-ff42-4bd4-b3da-9e84ce3d3f87 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jul 28 08:24:54.416625 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:24:54.416625 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 28 08:24:54.416625 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 28 08:24:54.416625 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 28 08:24:54.416625 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 28 08:24:54.416625 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 28 08:24:54.416625 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 08:24:54.416625 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 28 08:24:54.416625 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application Jul 28 08:24:54.416625 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 28 08:24:54.416625 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application Jul 28 08:24:54.416625 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:24:54.416625 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:24:54.416625 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:24:54.416625 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:24:54.416625 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:24:54.417787 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:24:54.417787 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:24:54.417787 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:24:54.417787 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:24:54.417787 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:24:54.417787 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:24:54.417787 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 28 08:24:54.417787 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 28 08:24:54.417787 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 28 08:24:54.417787 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 28 08:24:54.417787 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:24:54.417787 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:24:54.417787 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:24:54.417787 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:24:54.417787 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:24:54.417787 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:24:54.418705 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:24:54.418705 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application with Lock( Jul 28 08:24:54.418705 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:24:54.418705 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:24:54.418705 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:24:54.418705 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:24:54.418705 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:24:54.418705 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:24:54.418705 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:24:54.418705 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:24:54.418705 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 28 08:24:54.418705 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 08:24:54.418705 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 28 08:24:54.418705 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application Jul 28 08:24:54.421801 dv-cinder-851351-1-smb devstack@keystone.service[207601]: [pid: 207601|app: 0|req: 408/820] 10.222.0.42 () {56 vars in 1111 bytes} [Thu Jul 28 08:24:54 2022] GET /identity/v3/services/network => generated 88 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:24:54.422837 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecfc4992-ff42-4bd4-b3da-9e84ce3d3f87 None admin] Authenticating user token {{(pid=207601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:24:54.441726 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-814d18a5-339d-4aca-94a0-9acd853d0d3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:24:54.442579 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814d18a5-339d-4aca-94a0-9acd853d0d3d None admin] REQUEST_METHOD: `GET` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:24:54.442966 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814d18a5-339d-4aca-94a0-9acd853d0d3d None admin] SCRIPT_NAME: `/identity` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:24:54.443375 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814d18a5-339d-4aca-94a0-9acd853d0d3d None admin] PATH_INFO: `/v3/users/nova` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:24:54.452211 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-814d18a5-339d-4aca-94a0-9acd853d0d3d None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:24:54.453939 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-814d18a5-339d-4aca-94a0-9acd853d0d3d None admin] RBAC: Authorization granted {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:24:54.466581 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application [None req-814d18a5-339d-4aca-94a0-9acd853d0d3d None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 28 08:24:54.466581 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:24:54.466581 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:24:54.466581 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:24:54.466581 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:24:54.466581 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:24:54.466581 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:24:54.466581 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:24:54.466581 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:24:54.466581 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:24:54.466581 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:24:54.466581 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:24:54.466581 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 28 08:24:54.466581 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 28 08:24:54.466581 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 28 08:24:54.466581 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 28 08:24:54.467811 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:24:54.467811 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:24:54.467811 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 28 08:24:54.467811 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 08:24:54.467811 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 28 08:24:54.467811 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 08:24:54.467811 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:24:54.467811 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:24:54.467811 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:24:54.467811 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:24:54.467811 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:24:54.467811 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application with Lock( Jul 28 08:24:54.467811 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:24:54.467811 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:24:54.467811 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:24:54.467811 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:24:54.467811 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:24:54.467811 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:24:54.469114 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:24:54.469114 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:24:54.469114 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 28 08:24:54.469114 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 28 08:24:54.469114 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 28 08:24:54.469114 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 28 08:24:54.469114 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 28 08:24:54.469114 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 28 08:24:54.469114 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 28 08:24:54.469114 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application Jul 28 08:24:54.475679 dv-cinder-851351-1-smb devstack@keystone.service[207600]: [pid: 207600|app: 0|req: 413/821] 10.222.0.42 () {56 vars in 1093 bytes} [Thu Jul 28 08:24:54 2022] GET /identity/v3/users/nova => generated 82 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:24:54.475679 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-814d18a5-339d-4aca-94a0-9acd853d0d3d None admin] Authenticating user token {{(pid=207600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:24:54.504566 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG dbcounter [-] [207600] Writing DB stats keystone:SELECT=100 {{(pid=207600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:24:54.544042 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG dbcounter [-] [207601] Writing DB stats keystone:SELECT=100 {{(pid=207601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:24:54.569890 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecfc4992-ff42-4bd4-b3da-9e84ce3d3f87 None admin] Validating token access rules against request {{(pid=207601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:24:54.602488 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-814d18a5-339d-4aca-94a0-9acd853d0d3d None admin] Validating token access rules against request {{(pid=207600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:24:54.615920 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807dd6d9-8dab-41d6-a7dd-26c17ac24ed0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:24:54.616647 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807dd6d9-8dab-41d6-a7dd-26c17ac24ed0 None admin] REQUEST_METHOD: `PUT` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:24:54.617092 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807dd6d9-8dab-41d6-a7dd-26c17ac24ed0 None admin] SCRIPT_NAME: `/identity` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:24:54.617493 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807dd6d9-8dab-41d6-a7dd-26c17ac24ed0 None admin] PATH_INFO: `/v3/projects/48c5f2b2ae2b48758b957d2b194a7fd1/users/96e9a6a7c6ea4047a5d8e16babbdeb70/roles/d0ce88034c6b41878db755343f5840be` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:24:54.619867 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-807dd6d9-8dab-41d6-a7dd-26c17ac24ed0 None admin] RBAC: Authorizing `identity:create_grant(project_id=48c5f2b2ae2b48758b957d2b194a7fd1, user_id=96e9a6a7c6ea4047a5d8e16babbdeb70, role_id=d0ce88034c6b41878db755343f5840be)` {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:24:54.622280 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-807dd6d9-8dab-41d6-a7dd-26c17ac24ed0 None admin] RBAC: Authorization granted {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:24:54.643786 dv-cinder-851351-1-smb devstack@keystone.service[207601]: [pid: 207601|app: 0|req: 409/822] 10.222.0.42 () {58 vars in 1439 bytes} [Thu Jul 28 08:24:54 2022] PUT /identity/v3/projects/48c5f2b2ae2b48758b957d2b194a7fd1/users/96e9a6a7c6ea4047a5d8e16babbdeb70/roles/d0ce88034c6b41878db755343f5840be => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 08:24:54.645716 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807dd6d9-8dab-41d6-a7dd-26c17ac24ed0 None admin] Authenticating user token {{(pid=207601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:24:54.664697 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41011c3-a771-4b72-9de1-70e6b0c04b64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:24:54.665900 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41011c3-a771-4b72-9de1-70e6b0c04b64 None admin] REQUEST_METHOD: `GET` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:24:54.666548 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41011c3-a771-4b72-9de1-70e6b0c04b64 None admin] SCRIPT_NAME: `/identity` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:24:54.667068 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41011c3-a771-4b72-9de1-70e6b0c04b64 None admin] PATH_INFO: `/v3/services` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:24:54.668061 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d41011c3-a771-4b72-9de1-70e6b0c04b64 None admin] RBAC: Adding query filter params (name=network) {{(pid=207600) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:24:54.669123 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d41011c3-a771-4b72-9de1-70e6b0c04b64 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:24:54.672271 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d41011c3-a771-4b72-9de1-70e6b0c04b64 None admin] RBAC: Authorization granted {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:24:54.682799 dv-cinder-851351-1-smb devstack@keystone.service[207600]: [pid: 207600|app: 0|req: 414/823] 10.222.0.42 () {56 vars in 1112 bytes} [Thu Jul 28 08:24:54 2022] GET /identity/v3/services?name=network => generated 124 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:24:54.689976 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41011c3-a771-4b72-9de1-70e6b0c04b64 None admin] Authenticating user token {{(pid=207600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:24:54.854642 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG dbcounter [-] [207600] Writing DB stats keystone:SELECT=100 {{(pid=207600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:24:54.865436 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807dd6d9-8dab-41d6-a7dd-26c17ac24ed0 None admin] Validating token access rules against request {{(pid=207601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:24:54.877256 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41011c3-a771-4b72-9de1-70e6b0c04b64 None admin] Validating token access rules against request {{(pid=207600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:24:54.909926 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e589c0e2-1323-4a95-9f45-62f2fcd40aa4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:24:54.910919 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e589c0e2-1323-4a95-9f45-62f2fcd40aa4 None admin] REQUEST_METHOD: `GET` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:24:54.911342 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e589c0e2-1323-4a95-9f45-62f2fcd40aa4 None admin] SCRIPT_NAME: `/identity` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:24:54.911739 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e589c0e2-1323-4a95-9f45-62f2fcd40aa4 None admin] PATH_INFO: `/v3/users` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:24:54.912572 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e589c0e2-1323-4a95-9f45-62f2fcd40aa4 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=207601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:24:54.913065 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e589c0e2-1323-4a95-9f45-62f2fcd40aa4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:24:54.915004 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e589c0e2-1323-4a95-9f45-62f2fcd40aa4 None admin] RBAC: Authorization granted {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:24:54.924379 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54836d4-d776-4bd7-ac66-f1c61a585cc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:24:54.925088 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54836d4-d776-4bd7-ac66-f1c61a585cc5 None admin] REQUEST_METHOD: `GET` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:24:54.925345 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54836d4-d776-4bd7-ac66-f1c61a585cc5 None admin] SCRIPT_NAME: `/identity` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:24:54.925651 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54836d4-d776-4bd7-ac66-f1c61a585cc5 None admin] PATH_INFO: `/v3/services` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:24:54.926480 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d54836d4-d776-4bd7-ac66-f1c61a585cc5 None admin] RBAC: Adding query filter params (type=network) {{(pid=207600) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:24:54.926798 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d54836d4-d776-4bd7-ac66-f1c61a585cc5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:24:54.928380 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d54836d4-d776-4bd7-ac66-f1c61a585cc5 None admin] RBAC: Authorization granted {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:24:54.936514 dv-cinder-851351-1-smb devstack@keystone.service[207601]: [pid: 207601|app: 0|req: 410/825] 10.222.0.42 () {56 vars in 1133 bytes} [Thu Jul 28 08:24:54 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 291 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:24:54.936752 dv-cinder-851351-1-smb devstack@keystone.service[207600]: [pid: 207600|app: 0|req: 415/825] 10.222.0.42 () {56 vars in 1112 bytes} [Thu Jul 28 08:24:54 2022] GET /identity/v3/services?type=network => generated 350 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:24:54.942348 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54836d4-d776-4bd7-ac66-f1c61a585cc5 None admin] Authenticating user token {{(pid=207600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:24:54.942849 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e589c0e2-1323-4a95-9f45-62f2fcd40aa4 None admin] Authenticating user token {{(pid=207601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:24:54.946753 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG dbcounter [-] [207601] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=207601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:24:55.061897 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54836d4-d776-4bd7-ac66-f1c61a585cc5 None admin] Validating token access rules against request {{(pid=207600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:24:55.102802 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa338354-ac59-400c-8a86-60737693fd66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:24:55.103481 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa338354-ac59-400c-8a86-60737693fd66 None admin] REQUEST_METHOD: `POST` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:24:55.103771 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa338354-ac59-400c-8a86-60737693fd66 None admin] SCRIPT_NAME: `/identity` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:24:55.104051 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa338354-ac59-400c-8a86-60737693fd66 None admin] PATH_INFO: `/v3/endpoints` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:24:55.104865 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa338354-ac59-400c-8a86-60737693fd66 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:24:55.108689 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa338354-ac59-400c-8a86-60737693fd66 None admin] RBAC: Authorization granted {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:24:55.136004 dv-cinder-851351-1-smb devstack@keystone.service[207600]: [pid: 207600|app: 0|req: 416/826] 10.222.0.42 () {60 vars in 1144 bytes} [Thu Jul 28 08:24:54 2022] POST /identity/v3/endpoints => generated 327 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 08:24:55.146238 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e589c0e2-1323-4a95-9f45-62f2fcd40aa4 None admin] Validating token access rules against request {{(pid=207601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:24:55.202389 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c178be-7bd7-4361-82d2-780b92a82de3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:24:55.203321 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c178be-7bd7-4361-82d2-780b92a82de3 None admin] REQUEST_METHOD: `GET` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:24:55.203800 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c178be-7bd7-4361-82d2-780b92a82de3 None admin] SCRIPT_NAME: `/identity` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:24:55.204284 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c178be-7bd7-4361-82d2-780b92a82de3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:24:55.293507 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG dbcounter [-] [207601] Writing DB stats keystone:SELECT=100 {{(pid=207601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:24:55.297212 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41c178be-7bd7-4361-82d2-780b92a82de3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:24:55.298982 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41c178be-7bd7-4361-82d2-780b92a82de3 None admin] RBAC: Authorization granted {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:24:55.414345 dv-cinder-851351-1-smb devstack@keystone.service[207601]: [pid: 207601|app: 0|req: 411/827] 10.222.0.42 () {58 vars in 1282 bytes} [Thu Jul 28 08:24:54 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 472 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 28 08:24:55.420438 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa338354-ac59-400c-8a86-60737693fd66 None admin] Authenticating user token {{(pid=207600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:24:55.437651 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG dbcounter [-] [207600] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=207600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:24:55.552044 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa338354-ac59-400c-8a86-60737693fd66 None admin] Validating token access rules against request {{(pid=207600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:24:55.593246 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6901edcf-e6d0-4177-83ac-514ff800d556 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:24:55.593927 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6901edcf-e6d0-4177-83ac-514ff800d556 None admin] REQUEST_METHOD: `GET` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:24:55.594217 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6901edcf-e6d0-4177-83ac-514ff800d556 None admin] SCRIPT_NAME: `/identity` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:24:55.594565 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6901edcf-e6d0-4177-83ac-514ff800d556 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:24:55.608917 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6901edcf-e6d0-4177-83ac-514ff800d556 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:24:55.610526 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6901edcf-e6d0-4177-83ac-514ff800d556 None admin] RBAC: Authorization granted {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:24:55.626256 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application [None req-6901edcf-e6d0-4177-83ac-514ff800d556 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 08:24:55.626256 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:24:55.626256 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:24:55.626256 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:24:55.626256 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:24:55.626256 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:24:55.626256 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:24:55.626256 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:24:55.626256 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:24:55.626256 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:24:55.626256 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:24:55.626256 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:24:55.626256 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 08:24:55.626256 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 08:24:55.626256 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 08:24:55.627306 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 08:24:55.627306 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:24:55.627306 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:24:55.627306 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:24:55.627306 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:24:55.627306 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:24:55.627306 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:24:55.627306 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:24:55.627306 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application with Lock( Jul 28 08:24:55.627306 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:24:55.627306 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:24:55.627306 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:24:55.627306 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:24:55.627306 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:24:55.627306 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:24:55.627306 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:24:55.627306 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:24:55.628251 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 08:24:55.628251 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 08:24:55.628251 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 08:24:55.628251 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application Jul 28 08:24:55.628251 dv-cinder-851351-1-smb devstack@keystone.service[207600]: [pid: 207600|app: 0|req: 417/828] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 08:24:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:24:55.633836 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c178be-7bd7-4361-82d2-780b92a82de3 None admin] Authenticating user token {{(pid=207601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:24:55.745143 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG dbcounter [-] [207601] Writing DB stats keystone:SELECT=100 {{(pid=207601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:24:55.748104 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c178be-7bd7-4361-82d2-780b92a82de3 None admin] Validating token access rules against request {{(pid=207601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:24:55.787267 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc266ca-14ed-4885-a3cd-0ceaf7a19de7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:24:55.788028 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc266ca-14ed-4885-a3cd-0ceaf7a19de7 None admin] REQUEST_METHOD: `GET` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:24:55.788421 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc266ca-14ed-4885-a3cd-0ceaf7a19de7 None admin] SCRIPT_NAME: `/identity` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:24:55.788879 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc266ca-14ed-4885-a3cd-0ceaf7a19de7 None admin] PATH_INFO: `/v3/domains` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:24:55.789718 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc266ca-14ed-4885-a3cd-0ceaf7a19de7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=207601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:24:55.790100 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc266ca-14ed-4885-a3cd-0ceaf7a19de7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:24:55.791645 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc266ca-14ed-4885-a3cd-0ceaf7a19de7 None admin] RBAC: Authorization granted {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:24:55.805094 dv-cinder-851351-1-smb devstack@keystone.service[207601]: [pid: 207601|app: 0|req: 412/829] 10.222.0.42 () {56 vars in 1109 bytes} [Thu Jul 28 08:24:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:24:55.811214 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6901edcf-e6d0-4177-83ac-514ff800d556 None admin] Authenticating user token {{(pid=207600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:24:55.875600 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG dbcounter [-] [207600] Writing DB stats keystone:SELECT=100 {{(pid=207600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:24:55.923950 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba63345-6e11-44ed-b1f2-3e8241297ada None None] REQUEST_METHOD: `GET` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:24:55.924283 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba63345-6e11-44ed-b1f2-3e8241297ada None None] SCRIPT_NAME: `/identity` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:24:55.924609 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba63345-6e11-44ed-b1f2-3e8241297ada None None] PATH_INFO: `/` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:24:55.926546 dv-cinder-851351-1-smb devstack@keystone.service[207601]: [pid: 207601|app: 0|req: 413/830] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 08:24:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 28 08:24:55.931679 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7445f9-21f1-4521-9ea1-f576e250d2f6 None None] REQUEST_METHOD: `POST` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:24:55.931983 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7445f9-21f1-4521-9ea1-f576e250d2f6 None None] SCRIPT_NAME: `/identity` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:24:55.932245 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7445f9-21f1-4521-9ea1-f576e250d2f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:24:55.938605 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6901edcf-e6d0-4177-83ac-514ff800d556 None admin] Validating token access rules against request {{(pid=207600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:24:55.951921 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.auth.core [None req-4c7445f9-21f1-4521-9ea1-f576e250d2f6 None None] MFA Rules not processed for user `b8110ade874c4aa7af27f5c376df700a`. Rule list: `[]` (Enabled: `True`). {{(pid=207601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 08:24:55.953188 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.fernet_utils [None req-4c7445f9-21f1-4521-9ea1-f576e250d2f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=207601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:24:55.987664 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0cb1a02-ed85-4133-8616-ccd3a46c3aca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:24:55.988864 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0cb1a02-ed85-4133-8616-ccd3a46c3aca None admin] REQUEST_METHOD: `GET` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:24:55.989477 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0cb1a02-ed85-4133-8616-ccd3a46c3aca None admin] SCRIPT_NAME: `/identity` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:24:55.990069 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0cb1a02-ed85-4133-8616-ccd3a46c3aca None admin] PATH_INFO: `/v3/projects/service` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:24:55.998179 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0cb1a02-ed85-4133-8616-ccd3a46c3aca None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:24:56.000025 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0cb1a02-ed85-4133-8616-ccd3a46c3aca None admin] RBAC: Authorization granted {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:24:56.012854 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application [None req-f0cb1a02-ed85-4133-8616-ccd3a46c3aca None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 08:24:56.012854 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:24:56.012854 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:24:56.012854 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:24:56.012854 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:24:56.012854 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:24:56.012854 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:24:56.012854 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:24:56.012854 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:24:56.012854 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:24:56.012854 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:24:56.012854 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:24:56.012854 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 28 08:24:56.012854 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 28 08:24:56.012854 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 28 08:24:56.013889 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 28 08:24:56.013889 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:24:56.013889 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:24:56.013889 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:24:56.013889 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:24:56.013889 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:24:56.013889 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:24:56.013889 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:24:56.013889 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application with Lock( Jul 28 08:24:56.013889 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:24:56.013889 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:24:56.013889 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:24:56.013889 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:24:56.013889 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:24:56.013889 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:24:56.013889 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:24:56.013889 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:24:56.014852 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 28 08:24:56.014852 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 28 08:24:56.014852 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 28 08:24:56.014852 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 28 08:24:56.014852 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 28 08:24:56.014852 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 28 08:24:56.014852 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 08:24:56.014852 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application Jul 28 08:24:56.017470 dv-cinder-851351-1-smb devstack@keystone.service[207600]: [pid: 207600|app: 0|req: 418/831] 10.222.0.42 () {56 vars in 1111 bytes} [Thu Jul 28 08:24:55 2022] GET /identity/v3/projects/service => generated 88 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:24:56.023520 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0cb1a02-ed85-4133-8616-ccd3a46c3aca None admin] Authenticating user token {{(pid=207600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:24:56.027438 dv-cinder-851351-1-smb devstack@keystone.service[207601]: [pid: 207601|app: 0|req: 414/832] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 08:24:55 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 28 08:24:56.044139 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803c7f53-2922-48e7-ac55-19df8aba9c66 None None] REQUEST_METHOD: `GET` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:24:56.044139 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803c7f53-2922-48e7-ac55-19df8aba9c66 None None] SCRIPT_NAME: `/identity` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:24:56.044412 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803c7f53-2922-48e7-ac55-19df8aba9c66 None None] PATH_INFO: `/` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:24:56.049874 dv-cinder-851351-1-smb devstack@keystone.service[207601]: [pid: 207601|app: 0|req: 415/833] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 08:24:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 28 08:24:56.051694 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab56694-793b-4427-8e25-49008b644d8f None None] REQUEST_METHOD: `POST` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:24:56.052048 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab56694-793b-4427-8e25-49008b644d8f None None] SCRIPT_NAME: `/identity` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:24:56.052398 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab56694-793b-4427-8e25-49008b644d8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:24:56.071589 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.auth.core [None req-fab56694-793b-4427-8e25-49008b644d8f None None] MFA Rules not processed for user `b8110ade874c4aa7af27f5c376df700a`. Rule list: `[]` (Enabled: `True`). {{(pid=207601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 08:24:56.072858 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.fernet_utils [None req-fab56694-793b-4427-8e25-49008b644d8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=207601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:24:56.141247 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0cb1a02-ed85-4133-8616-ccd3a46c3aca None admin] Validating token access rules against request {{(pid=207600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:24:56.155703 dv-cinder-851351-1-smb devstack@keystone.service[207601]: [pid: 207601|app: 0|req: 416/834] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 08:24:56 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 28 08:24:56.157241 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab56694-793b-4427-8e25-49008b644d8f None None] Authenticating user token {{(pid=207601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:24:56.162285 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG dbcounter [-] [207600] Writing DB stats keystone:SELECT=100 {{(pid=207600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:24:56.183630 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c1afcee-075f-4563-b579-db688490d3a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:24:56.184281 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1afcee-075f-4563-b579-db688490d3a2 None admin] REQUEST_METHOD: `GET` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:24:56.184751 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1afcee-075f-4563-b579-db688490d3a2 None admin] SCRIPT_NAME: `/identity` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:24:56.184887 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1afcee-075f-4563-b579-db688490d3a2 None admin] PATH_INFO: `/v3/projects` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:24:56.185655 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c1afcee-075f-4563-b579-db688490d3a2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=207600) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:24:56.186549 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c1afcee-075f-4563-b579-db688490d3a2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:24:56.187866 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c1afcee-075f-4563-b579-db688490d3a2 None admin] RBAC: Authorization granted {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:24:56.188895 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG dbcounter [-] [207601] Writing DB stats keystone:SELECT=100 {{(pid=207601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:24:56.207123 dv-cinder-851351-1-smb devstack@keystone.service[207600]: [pid: 207600|app: 0|req: 419/835] 10.222.0.42 () {56 vars in 1148 bytes} [Thu Jul 28 08:24:56 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:24:56.207123 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c1afcee-075f-4563-b579-db688490d3a2 None admin] Authenticating user token {{(pid=207600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:24:56.278156 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab56694-793b-4427-8e25-49008b644d8f None None] Validating token access rules against request {{(pid=207601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:24:56.316159 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f45b2c8f-23bc-4674-b870-9b8ca5406ec3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:24:56.316879 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45b2c8f-23bc-4674-b870-9b8ca5406ec3 None admin] REQUEST_METHOD: `GET` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:24:56.317168 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45b2c8f-23bc-4674-b870-9b8ca5406ec3 None admin] SCRIPT_NAME: `/identity` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:24:56.317446 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45b2c8f-23bc-4674-b870-9b8ca5406ec3 None admin] PATH_INFO: `/v3/roles/service` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:24:56.320236 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c1afcee-075f-4563-b579-db688490d3a2 None admin] Validating token access rules against request {{(pid=207600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:24:56.336231 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f45b2c8f-23bc-4674-b870-9b8ca5406ec3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 08:24:56.340383 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application [None req-f45b2c8f-23bc-4674-b870-9b8ca5406ec3 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 28 08:24:56.340383 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:24:56.340383 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:24:56.340383 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:24:56.340383 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:24:56.340383 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:24:56.340383 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:24:56.340383 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:24:56.340383 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:24:56.340383 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:24:56.340383 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:24:56.340383 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:24:56.340383 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 08:24:56.340383 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 08:24:56.340383 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 08:24:56.340383 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 08:24:56.342134 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 08:24:56.342134 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 08:24:56.342134 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 08:24:56.342134 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 08:24:56.342134 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:24:56.342134 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:24:56.342134 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:24:56.342134 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:24:56.342134 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:24:56.342134 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:24:56.342134 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:24:56.342134 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application with Lock( Jul 28 08:24:56.342134 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:24:56.342134 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:24:56.342134 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:24:56.342134 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:24:56.343106 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:24:56.343106 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:24:56.343106 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:24:56.343106 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:24:56.343106 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 08:24:56.343106 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 08:24:56.343106 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 08:24:56.343106 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 08:24:56.343106 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 08:24:56.343106 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 08:24:56.343106 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 28 08:24:56.343106 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application Jul 28 08:24:56.346638 dv-cinder-851351-1-smb devstack@keystone.service[207601]: [pid: 207601|app: 0|req: 417/836] 10.222.0.42 () {56 vars in 1102 bytes} [Thu Jul 28 08:24:56 2022] GET /identity/v3/roles/service => generated 85 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:24:56.347708 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f45b2c8f-23bc-4674-b870-9b8ca5406ec3 None admin] Authenticating user token {{(pid=207601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:24:56.369882 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab314240-805d-464d-ae93-82a11ce75afa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:24:56.370605 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab314240-805d-464d-ae93-82a11ce75afa None admin] REQUEST_METHOD: `GET` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:24:56.370886 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab314240-805d-464d-ae93-82a11ce75afa None admin] SCRIPT_NAME: `/identity` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:24:56.371168 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab314240-805d-464d-ae93-82a11ce75afa None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:24:56.372648 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab314240-805d-464d-ae93-82a11ce75afa None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:24:56.373550 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab314240-805d-464d-ae93-82a11ce75afa None admin] RBAC: Authorization granted {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:24:56.384162 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application [None req-ab314240-805d-464d-ae93-82a11ce75afa None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 28 08:24:56.384162 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:24:56.384162 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 28 08:24:56.384162 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 28 08:24:56.384162 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 28 08:24:56.384162 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 28 08:24:56.384162 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 28 08:24:56.384162 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 08:24:56.384162 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 28 08:24:56.384162 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application Jul 28 08:24:56.384162 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 28 08:24:56.384162 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application Jul 28 08:24:56.384162 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:24:56.384162 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:24:56.384162 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:24:56.384162 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:24:56.384162 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:24:56.385874 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:24:56.385874 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:24:56.385874 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:24:56.385874 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:24:56.385874 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:24:56.385874 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:24:56.385874 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 28 08:24:56.385874 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 28 08:24:56.385874 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 28 08:24:56.385874 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 28 08:24:56.385874 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:24:56.385874 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:24:56.385874 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:24:56.385874 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:24:56.385874 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:24:56.385874 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:24:56.386774 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:24:56.386774 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application with Lock( Jul 28 08:24:56.386774 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:24:56.386774 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:24:56.386774 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:24:56.386774 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:24:56.386774 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:24:56.386774 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:24:56.386774 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:24:56.386774 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:24:56.386774 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 28 08:24:56.386774 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 08:24:56.386774 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 28 08:24:56.386774 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application Jul 28 08:24:56.386774 dv-cinder-851351-1-smb devstack@keystone.service[207600]: [pid: 207600|app: 0|req: 420/837] 10.222.0.42 () {56 vars in 1114 bytes} [Thu Jul 28 08:24:56 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:24:56.387660 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab314240-805d-464d-ae93-82a11ce75afa None admin] Authenticating user token {{(pid=207600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:24:56.458700 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG dbcounter [-] [207600] Writing DB stats keystone:SELECT=100 {{(pid=207600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:24:56.469239 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG dbcounter [-] [207601] Writing DB stats keystone:SELECT=100 {{(pid=207601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:24:56.492711 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f45b2c8f-23bc-4674-b870-9b8ca5406ec3 None admin] Validating token access rules against request {{(pid=207601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:24:56.533879 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89cbf960-ac8d-4d19-8da8-09eb93be3dac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:24:56.534385 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89cbf960-ac8d-4d19-8da8-09eb93be3dac None admin] REQUEST_METHOD: `GET` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:24:56.534697 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89cbf960-ac8d-4d19-8da8-09eb93be3dac None admin] SCRIPT_NAME: `/identity` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:24:56.534998 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89cbf960-ac8d-4d19-8da8-09eb93be3dac None admin] PATH_INFO: `/v3/role_assignments` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:24:56.535828 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89cbf960-ac8d-4d19-8da8-09eb93be3dac None admin] RBAC: Adding query filter params (role.id=d0ce88034c6b41878db755343f5840be, scope.project.id=48c5f2b2ae2b48758b957d2b194a7fd1, user.id=03804b1369934a7692da4d5646465bdc) {{(pid=207601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:24:56.536143 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89cbf960-ac8d-4d19-8da8-09eb93be3dac None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:24:56.537660 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89cbf960-ac8d-4d19-8da8-09eb93be3dac None admin] RBAC: Authorization granted {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:24:56.537854 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab314240-805d-464d-ae93-82a11ce75afa None admin] Validating token access rules against request {{(pid=207600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:24:56.546711 dv-cinder-851351-1-smb devstack@keystone.service[207601]: [pid: 207601|app: 0|req: 418/838] 10.222.0.42 () {56 vars in 1374 bytes} [Thu Jul 28 08:24:56 2022] GET /identity/v3/role_assignments?user.id=03804b1369934a7692da4d5646465bdc&scope.project.id=48c5f2b2ae2b48758b957d2b194a7fd1&role.id=d0ce88034c6b41878db755343f5840be => generated 608 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:24:56.547588 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89cbf960-ac8d-4d19-8da8-09eb93be3dac None admin] Authenticating user token {{(pid=207601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:24:56.605505 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38595abd-2022-4e33-b522-650e4ae927b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:24:56.606855 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38595abd-2022-4e33-b522-650e4ae927b0 None admin] REQUEST_METHOD: `GET` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:24:56.607377 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38595abd-2022-4e33-b522-650e4ae927b0 None admin] SCRIPT_NAME: `/identity` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:24:56.607922 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38595abd-2022-4e33-b522-650e4ae927b0 None admin] PATH_INFO: `/v3/roles` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:24:56.609277 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38595abd-2022-4e33-b522-650e4ae927b0 None admin] RBAC: Adding query filter params (name=service) {{(pid=207600) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:24:56.609856 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38595abd-2022-4e33-b522-650e4ae927b0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:24:56.611704 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38595abd-2022-4e33-b522-650e4ae927b0 None admin] RBAC: Authorization granted {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:24:56.624288 dv-cinder-851351-1-smb devstack@keystone.service[207600]: [pid: 207600|app: 0|req: 421/839] 10.222.0.42 () {56 vars in 1103 bytes} [Thu Jul 28 08:24:56 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:24:56.630632 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38595abd-2022-4e33-b522-650e4ae927b0 None admin] Authenticating user token {{(pid=207600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:24:56.706257 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89cbf960-ac8d-4d19-8da8-09eb93be3dac None admin] Validating token access rules against request {{(pid=207601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:24:56.765038 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f206d7b-448d-47fe-b1c0-eb66f1378420 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:24:56.765841 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f206d7b-448d-47fe-b1c0-eb66f1378420 None admin] REQUEST_METHOD: `GET` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:24:56.766285 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f206d7b-448d-47fe-b1c0-eb66f1378420 None admin] SCRIPT_NAME: `/identity` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:24:56.766571 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f206d7b-448d-47fe-b1c0-eb66f1378420 None admin] PATH_INFO: `/v3/services` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:24:56.767438 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f206d7b-448d-47fe-b1c0-eb66f1378420 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=207601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:24:56.767748 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f206d7b-448d-47fe-b1c0-eb66f1378420 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:24:56.769784 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f206d7b-448d-47fe-b1c0-eb66f1378420 None admin] RBAC: Authorization granted {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:24:56.776794 dv-cinder-851351-1-smb devstack@keystone.service[207601]: [pid: 207601|app: 0|req: 419/840] 10.222.0.42 () {56 vars in 1114 bytes} [Thu Jul 28 08:24:56 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:24:56.785483 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f206d7b-448d-47fe-b1c0-eb66f1378420 None admin] Authenticating user token {{(pid=207601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:24:56.794081 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38595abd-2022-4e33-b522-650e4ae927b0 None admin] Validating token access rules against request {{(pid=207600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:24:56.801230 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG dbcounter [-] [207601] Writing DB stats keystone:SELECT=100 {{(pid=207601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:24:56.805433 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG dbcounter [-] [207600] Writing DB stats keystone:SELECT=100 {{(pid=207600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:24:56.855749 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d2395a-4e5c-4ed9-b72e-56f2a0c49cb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:24:56.856698 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d2395a-4e5c-4ed9-b72e-56f2a0c49cb9 None admin] REQUEST_METHOD: `GET` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:24:56.857108 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d2395a-4e5c-4ed9-b72e-56f2a0c49cb9 None admin] SCRIPT_NAME: `/identity` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:24:56.857542 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d2395a-4e5c-4ed9-b72e-56f2a0c49cb9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:24:56.876436 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27d2395a-4e5c-4ed9-b72e-56f2a0c49cb9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:24:56.878849 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27d2395a-4e5c-4ed9-b72e-56f2a0c49cb9 None admin] RBAC: Authorization granted {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:24:56.914452 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application [None req-27d2395a-4e5c-4ed9-b72e-56f2a0c49cb9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 08:24:56.914452 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:24:56.914452 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:24:56.914452 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:24:56.914452 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:24:56.914452 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:24:56.914452 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:24:56.914452 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:24:56.914452 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:24:56.914452 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:24:56.914452 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:24:56.914452 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:24:56.914452 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 08:24:56.914452 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 08:24:56.914452 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 08:24:56.915832 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 08:24:56.915832 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:24:56.915832 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:24:56.915832 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:24:56.915832 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:24:56.915832 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:24:56.915832 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:24:56.915832 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:24:56.915832 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application with Lock( Jul 28 08:24:56.915832 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:24:56.915832 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:24:56.915832 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:24:56.915832 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:24:56.915832 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:24:56.915832 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:24:56.915832 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:24:56.915832 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:24:56.917032 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 08:24:56.917032 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 08:24:56.917032 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 08:24:56.917032 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application Jul 28 08:24:56.917385 dv-cinder-851351-1-smb devstack@keystone.service[207600]: [pid: 207600|app: 0|req: 422/841] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 08:24:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 287 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:24:56.926712 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d2395a-4e5c-4ed9-b72e-56f2a0c49cb9 None admin] Authenticating user token {{(pid=207600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:24:56.946147 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f206d7b-448d-47fe-b1c0-eb66f1378420 None admin] Validating token access rules against request {{(pid=207601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:24:56.984183 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79aeaa68-fd24-4930-b798-cd950ab74c0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:24:56.984924 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79aeaa68-fd24-4930-b798-cd950ab74c0b None admin] REQUEST_METHOD: `GET` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:24:56.985269 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79aeaa68-fd24-4930-b798-cd950ab74c0b None admin] SCRIPT_NAME: `/identity` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:24:56.985562 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79aeaa68-fd24-4930-b798-cd950ab74c0b None admin] PATH_INFO: `/v3/services` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:24:56.986264 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79aeaa68-fd24-4930-b798-cd950ab74c0b None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=207601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:24:56.986572 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79aeaa68-fd24-4930-b798-cd950ab74c0b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:24:56.988145 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79aeaa68-fd24-4930-b798-cd950ab74c0b None admin] RBAC: Authorization granted {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:24:56.993949 dv-cinder-851351-1-smb devstack@keystone.service[207601]: [pid: 207601|app: 0|req: 420/842] 10.222.0.42 () {56 vars in 1114 bytes} [Thu Jul 28 08:24:56 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:24:57.062416 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efca72e5-70c6-48ce-a529-4f835f9f335f None None] REQUEST_METHOD: `GET` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:24:57.062633 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efca72e5-70c6-48ce-a529-4f835f9f335f None None] SCRIPT_NAME: `/identity` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:24:57.062869 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efca72e5-70c6-48ce-a529-4f835f9f335f None None] PATH_INFO: `/` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:24:57.064512 dv-cinder-851351-1-smb devstack@keystone.service[207601]: [pid: 207601|app: 0|req: 421/843] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 08:24:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 08:24:57.071347 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74131b9e-7c27-411c-8215-44ec16d787ed None None] REQUEST_METHOD: `POST` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:24:57.071766 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74131b9e-7c27-411c-8215-44ec16d787ed None None] SCRIPT_NAME: `/identity` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:24:57.071982 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74131b9e-7c27-411c-8215-44ec16d787ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:24:57.078567 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d2395a-4e5c-4ed9-b72e-56f2a0c49cb9 None admin] Validating token access rules against request {{(pid=207600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:24:57.092971 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.auth.core [None req-74131b9e-7c27-411c-8215-44ec16d787ed None None] MFA Rules not processed for user `b8110ade874c4aa7af27f5c376df700a`. Rule list: `[]` (Enabled: `True`). {{(pid=207601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 08:24:57.094480 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.fernet_utils [None req-74131b9e-7c27-411c-8215-44ec16d787ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=207601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:24:57.118215 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb872f6-2415-412c-afec-7b669b27b2e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:24:57.119308 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb872f6-2415-412c-afec-7b669b27b2e1 None admin] REQUEST_METHOD: `GET` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:24:57.119780 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb872f6-2415-412c-afec-7b669b27b2e1 None admin] SCRIPT_NAME: `/identity` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:24:57.120243 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb872f6-2415-412c-afec-7b669b27b2e1 None admin] PATH_INFO: `/v3/domains` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:24:57.121211 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fb872f6-2415-412c-afec-7b669b27b2e1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=207600) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:24:57.121724 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fb872f6-2415-412c-afec-7b669b27b2e1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:24:57.123513 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fb872f6-2415-412c-afec-7b669b27b2e1 None admin] RBAC: Authorization granted {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:24:57.138083 dv-cinder-851351-1-smb devstack@keystone.service[207600]: [pid: 207600|app: 0|req: 423/844] 10.222.0.42 () {56 vars in 1109 bytes} [Thu Jul 28 08:24:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 08:24:57.143823 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb872f6-2415-412c-afec-7b669b27b2e1 None admin] Authenticating user token {{(pid=207600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:24:57.167858 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG dbcounter [-] [207600] Writing DB stats keystone:SELECT=100 {{(pid=207600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:24:57.189675 dv-cinder-851351-1-smb devstack@keystone.service[207601]: [pid: 207601|app: 0|req: 422/845] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 08:24:57 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 08:24:57.213153 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74131b9e-7c27-411c-8215-44ec16d787ed None None] Authenticating user token {{(pid=207601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:24:57.215523 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG dbcounter [-] [207601] Writing DB stats keystone:SELECT=100 {{(pid=207601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:24:57.265595 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb872f6-2415-412c-afec-7b669b27b2e1 None admin] Validating token access rules against request {{(pid=207600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:24:57.302181 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c9807a6-05fe-4671-836d-f3f8ce69bc0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:24:57.302843 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9807a6-05fe-4671-836d-f3f8ce69bc0f None admin] REQUEST_METHOD: `GET` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:24:57.303128 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9807a6-05fe-4671-836d-f3f8ce69bc0f None admin] SCRIPT_NAME: `/identity` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:24:57.303394 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9807a6-05fe-4671-836d-f3f8ce69bc0f None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:24:57.311174 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c9807a6-05fe-4671-836d-f3f8ce69bc0f None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:24:57.312719 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c9807a6-05fe-4671-836d-f3f8ce69bc0f None admin] RBAC: Authorization granted {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:24:57.323699 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74131b9e-7c27-411c-8215-44ec16d787ed None None] Validating token access rules against request {{(pid=207601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:24:57.325269 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application [None req-6c9807a6-05fe-4671-836d-f3f8ce69bc0f None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 28 08:24:57.325269 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:24:57.325269 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:24:57.325269 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:24:57.325269 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:24:57.325269 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:24:57.325269 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:24:57.325269 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:24:57.325269 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:24:57.325269 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:24:57.325269 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:24:57.325269 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:24:57.325269 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 28 08:24:57.325269 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 28 08:24:57.325269 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 28 08:24:57.325269 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 28 08:24:57.326371 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:24:57.326371 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:24:57.326371 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 28 08:24:57.326371 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 08:24:57.326371 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 28 08:24:57.326371 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 08:24:57.326371 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:24:57.326371 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:24:57.326371 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:24:57.326371 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:24:57.326371 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:24:57.326371 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application with Lock( Jul 28 08:24:57.326371 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:24:57.326371 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:24:57.326371 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:24:57.326371 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:24:57.326371 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:24:57.326371 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:24:57.327423 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:24:57.327423 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:24:57.327423 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 28 08:24:57.327423 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 28 08:24:57.327423 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 28 08:24:57.327423 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 28 08:24:57.327423 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 28 08:24:57.327423 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 28 08:24:57.327423 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 28 08:24:57.327423 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application Jul 28 08:24:57.331336 dv-cinder-851351-1-smb devstack@keystone.service[207600]: [pid: 207600|app: 0|req: 424/846] 10.222.0.42 () {56 vars in 1117 bytes} [Thu Jul 28 08:24:57 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:24:57.332308 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c9807a6-05fe-4671-836d-f3f8ce69bc0f None admin] Authenticating user token {{(pid=207600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:24:57.362323 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc73bfd-af19-454d-a531-dee0a47c52ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:24:57.363103 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc73bfd-af19-454d-a531-dee0a47c52ec None admin] REQUEST_METHOD: `GET` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:24:57.363495 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc73bfd-af19-454d-a531-dee0a47c52ec None admin] SCRIPT_NAME: `/identity` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:24:57.363783 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc73bfd-af19-454d-a531-dee0a47c52ec None admin] PATH_INFO: `/v3/roles/admin` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:24:57.375750 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc73bfd-af19-454d-a531-dee0a47c52ec None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 08:24:57.381553 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application [None req-0bc73bfd-af19-454d-a531-dee0a47c52ec None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 08:24:57.381553 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:24:57.381553 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:24:57.381553 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:24:57.381553 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:24:57.381553 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:24:57.381553 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:24:57.381553 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:24:57.381553 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:24:57.381553 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:24:57.381553 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:24:57.381553 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:24:57.381553 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 08:24:57.381553 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 08:24:57.381553 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 08:24:57.381553 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 08:24:57.382596 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 08:24:57.382596 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 08:24:57.382596 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 08:24:57.382596 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 08:24:57.382596 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:24:57.382596 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:24:57.382596 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:24:57.382596 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:24:57.382596 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:24:57.382596 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:24:57.382596 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:24:57.382596 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application with Lock( Jul 28 08:24:57.382596 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:24:57.382596 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:24:57.382596 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:24:57.382596 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:24:57.383504 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:24:57.383504 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:24:57.383504 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:24:57.383504 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:24:57.383504 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 08:24:57.383504 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 08:24:57.383504 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 08:24:57.383504 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 08:24:57.383504 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 08:24:57.383504 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 08:24:57.383504 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 08:24:57.383504 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application Jul 28 08:24:57.385080 dv-cinder-851351-1-smb devstack@keystone.service[207601]: [pid: 207601|app: 0|req: 423/847] 10.222.0.42 () {56 vars in 1096 bytes} [Thu Jul 28 08:24:57 2022] GET /identity/v3/roles/admin => generated 83 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 08:24:57.389598 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc73bfd-af19-454d-a531-dee0a47c52ec None admin] Authenticating user token {{(pid=207601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:24:57.423189 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG dbcounter [-] [207600] Writing DB stats keystone:SELECT=100 {{(pid=207600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:24:57.456835 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c9807a6-05fe-4671-836d-f3f8ce69bc0f None admin] Validating token access rules against request {{(pid=207600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:24:57.469135 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG dbcounter [-] [207601] Writing DB stats keystone:SELECT=100 {{(pid=207601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:24:57.505274 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439ea2b2-0179-41f3-ad1a-c34da1954934 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:24:57.506269 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439ea2b2-0179-41f3-ad1a-c34da1954934 None admin] REQUEST_METHOD: `GET` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:24:57.506659 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439ea2b2-0179-41f3-ad1a-c34da1954934 None admin] SCRIPT_NAME: `/identity` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:24:57.507355 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439ea2b2-0179-41f3-ad1a-c34da1954934 None admin] PATH_INFO: `/v3/users` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:24:57.508568 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-439ea2b2-0179-41f3-ad1a-c34da1954934 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=207600) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:24:57.509035 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-439ea2b2-0179-41f3-ad1a-c34da1954934 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:24:57.511232 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-439ea2b2-0179-41f3-ad1a-c34da1954934 None admin] RBAC: Authorization granted {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:24:57.512878 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc73bfd-af19-454d-a531-dee0a47c52ec None admin] Validating token access rules against request {{(pid=207601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:24:57.534025 dv-cinder-851351-1-smb devstack@keystone.service[207600]: [pid: 207600|app: 0|req: 425/848] 10.222.0.42 () {56 vars in 1149 bytes} [Thu Jul 28 08:24:57 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:24:57.540819 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439ea2b2-0179-41f3-ad1a-c34da1954934 None admin] Authenticating user token {{(pid=207600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:24:57.554948 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d093efa9-6ecd-4bf4-a499-4272b74b94d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:24:57.555724 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d093efa9-6ecd-4bf4-a499-4272b74b94d9 None admin] REQUEST_METHOD: `GET` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:24:57.556150 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d093efa9-6ecd-4bf4-a499-4272b74b94d9 None admin] SCRIPT_NAME: `/identity` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:24:57.556489 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d093efa9-6ecd-4bf4-a499-4272b74b94d9 None admin] PATH_INFO: `/v3/roles` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:24:57.557430 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d093efa9-6ecd-4bf4-a499-4272b74b94d9 None admin] RBAC: Adding query filter params (name=admin) {{(pid=207601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:24:57.557803 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d093efa9-6ecd-4bf4-a499-4272b74b94d9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:24:57.559336 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d093efa9-6ecd-4bf4-a499-4272b74b94d9 None admin] RBAC: Authorization granted {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:24:57.573525 dv-cinder-851351-1-smb devstack@keystone.service[207601]: [pid: 207601|app: 0|req: 424/849] 10.222.0.42 () {56 vars in 1099 bytes} [Thu Jul 28 08:24:57 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:24:57.574544 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d093efa9-6ecd-4bf4-a499-4272b74b94d9 None admin] Authenticating user token {{(pid=207601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:24:57.649512 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439ea2b2-0179-41f3-ad1a-c34da1954934 None admin] Validating token access rules against request {{(pid=207600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:24:57.682456 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d093efa9-6ecd-4bf4-a499-4272b74b94d9 None admin] Validating token access rules against request {{(pid=207601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:24:57.686739 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-163f515f-23f6-4b22-800b-7ee4a0912829 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:24:57.687478 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163f515f-23f6-4b22-800b-7ee4a0912829 None admin] REQUEST_METHOD: `GET` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:24:57.687839 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163f515f-23f6-4b22-800b-7ee4a0912829 None admin] SCRIPT_NAME: `/identity` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:24:57.688192 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163f515f-23f6-4b22-800b-7ee4a0912829 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:24:57.691773 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG dbcounter [-] [207600] Writing DB stats keystone:SELECT=100 {{(pid=207600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:24:57.711020 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG dbcounter [-] [207601] Writing DB stats keystone:SELECT=100 {{(pid=207601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:24:57.724320 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b340a7-6668-412c-b1a7-a11177ce5913 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:24:57.725147 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b340a7-6668-412c-b1a7-a11177ce5913 None admin] REQUEST_METHOD: `GET` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:24:57.725482 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b340a7-6668-412c-b1a7-a11177ce5913 None admin] SCRIPT_NAME: `/identity` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:24:57.725825 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b340a7-6668-412c-b1a7-a11177ce5913 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:24:57.739218 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5b340a7-6668-412c-b1a7-a11177ce5913 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:24:57.741089 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5b340a7-6668-412c-b1a7-a11177ce5913 None admin] RBAC: Authorization granted {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:24:57.757810 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application [None req-e5b340a7-6668-412c-b1a7-a11177ce5913 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 08:24:57.757810 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:24:57.757810 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:24:57.757810 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:24:57.757810 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:24:57.757810 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:24:57.757810 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:24:57.757810 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:24:57.757810 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:24:57.757810 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:24:57.757810 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:24:57.757810 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:24:57.757810 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 08:24:57.757810 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 08:24:57.757810 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 08:24:57.758877 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 08:24:57.758877 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:24:57.758877 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:24:57.758877 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:24:57.758877 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:24:57.758877 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:24:57.758877 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:24:57.758877 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:24:57.758877 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application with Lock( Jul 28 08:24:57.758877 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:24:57.758877 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:24:57.758877 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:24:57.758877 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:24:57.758877 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:24:57.758877 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:24:57.758877 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:24:57.758877 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:24:57.759945 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 08:24:57.759945 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 08:24:57.759945 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 08:24:57.759945 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application Jul 28 08:24:57.763870 dv-cinder-851351-1-smb devstack@keystone.service[207601]: [pid: 207601|app: 0|req: 425/850] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 08:24:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:24:57.764828 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b340a7-6668-412c-b1a7-a11177ce5913 None admin] Authenticating user token {{(pid=207601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:24:57.778321 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-163f515f-23f6-4b22-800b-7ee4a0912829 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:24:57.780189 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-163f515f-23f6-4b22-800b-7ee4a0912829 None admin] RBAC: Authorization granted {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:24:57.875090 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b340a7-6668-412c-b1a7-a11177ce5913 None admin] Validating token access rules against request {{(pid=207601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:24:57.890183 dv-cinder-851351-1-smb devstack@keystone.service[207600]: [pid: 207600|app: 0|req: 426/851] 10.222.0.42 () {58 vars in 1282 bytes} [Thu Jul 28 08:24:57 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 350 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 28 08:24:57.900368 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-163f515f-23f6-4b22-800b-7ee4a0912829 None admin] Authenticating user token {{(pid=207600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:24:57.933096 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d71ba9c8-d951-4a3e-9b00-32df4173f234 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:24:57.934246 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG dbcounter [-] [207600] Writing DB stats keystone:SELECT=100 {{(pid=207600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:24:57.934700 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71ba9c8-d951-4a3e-9b00-32df4173f234 None admin] REQUEST_METHOD: `GET` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:24:57.935885 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71ba9c8-d951-4a3e-9b00-32df4173f234 None admin] SCRIPT_NAME: `/identity` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:24:57.936373 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71ba9c8-d951-4a3e-9b00-32df4173f234 None admin] PATH_INFO: `/v3/domains` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:24:57.937584 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d71ba9c8-d951-4a3e-9b00-32df4173f234 None admin] RBAC: Adding query filter params (name=Default) {{(pid=207601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:24:57.940982 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d71ba9c8-d951-4a3e-9b00-32df4173f234 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:24:57.940982 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d71ba9c8-d951-4a3e-9b00-32df4173f234 None admin] RBAC: Authorization granted {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:24:57.958966 dv-cinder-851351-1-smb devstack@keystone.service[207601]: [pid: 207601|app: 0|req: 426/852] 10.222.0.42 () {56 vars in 1109 bytes} [Thu Jul 28 08:24:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:24:57.960267 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d71ba9c8-d951-4a3e-9b00-32df4173f234 None admin] Authenticating user token {{(pid=207601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:24:57.998901 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG dbcounter [-] [207601] Writing DB stats keystone:SELECT=100 {{(pid=207601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:24:58.002855 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-163f515f-23f6-4b22-800b-7ee4a0912829 None admin] Validating token access rules against request {{(pid=207600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:24:58.038692 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff8b8be9-bd7b-44ed-a667-6de3b3efbdca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:24:58.039422 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8b8be9-bd7b-44ed-a667-6de3b3efbdca None admin] REQUEST_METHOD: `GET` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:24:58.039626 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8b8be9-bd7b-44ed-a667-6de3b3efbdca None admin] SCRIPT_NAME: `/identity` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:24:58.039904 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8b8be9-bd7b-44ed-a667-6de3b3efbdca None admin] PATH_INFO: `/v3/domains/Default` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:24:58.050713 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff8b8be9-bd7b-44ed-a667-6de3b3efbdca None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:24:58.052195 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff8b8be9-bd7b-44ed-a667-6de3b3efbdca None admin] RBAC: Authorization granted {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:24:58.068379 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application [None req-ff8b8be9-bd7b-44ed-a667-6de3b3efbdca None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 08:24:58.068379 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:24:58.068379 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:24:58.068379 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:24:58.068379 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:24:58.068379 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:24:58.068379 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:24:58.068379 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:24:58.068379 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:24:58.068379 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:24:58.068379 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:24:58.068379 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:24:58.068379 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 08:24:58.068379 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 08:24:58.068379 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 08:24:58.069445 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 08:24:58.069445 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:24:58.069445 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:24:58.069445 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:24:58.069445 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:24:58.069445 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:24:58.069445 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:24:58.069445 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:24:58.069445 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application with Lock( Jul 28 08:24:58.069445 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:24:58.069445 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:24:58.069445 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:24:58.069445 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:24:58.069445 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:24:58.069445 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:24:58.069445 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:24:58.069445 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:24:58.070405 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 08:24:58.070405 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 08:24:58.070405 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 08:24:58.070405 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application Jul 28 08:24:58.074634 dv-cinder-851351-1-smb devstack@keystone.service[207600]: [pid: 207600|app: 0|req: 427/853] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 08:24:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:24:58.075568 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff8b8be9-bd7b-44ed-a667-6de3b3efbdca None admin] Authenticating user token {{(pid=207600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:24:58.079767 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d71ba9c8-d951-4a3e-9b00-32df4173f234 None admin] Validating token access rules against request {{(pid=207601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:24:58.119166 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96547e74-ff61-4fca-84c8-45f990d327cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:24:58.120203 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96547e74-ff61-4fca-84c8-45f990d327cb None admin] REQUEST_METHOD: `GET` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:24:58.120840 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96547e74-ff61-4fca-84c8-45f990d327cb None admin] SCRIPT_NAME: `/identity` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:24:58.121332 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96547e74-ff61-4fca-84c8-45f990d327cb None admin] PATH_INFO: `/v3/users/swift` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:24:58.130088 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96547e74-ff61-4fca-84c8-45f990d327cb None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:24:58.131916 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96547e74-ff61-4fca-84c8-45f990d327cb None admin] RBAC: Authorization granted {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:24:58.146037 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application [None req-96547e74-ff61-4fca-84c8-45f990d327cb None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 28 08:24:58.146037 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:24:58.146037 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:24:58.146037 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:24:58.146037 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:24:58.146037 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:24:58.146037 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:24:58.146037 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:24:58.146037 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:24:58.146037 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:24:58.146037 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:24:58.146037 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:24:58.146037 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 28 08:24:58.146037 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 28 08:24:58.146037 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 28 08:24:58.146037 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 28 08:24:58.147203 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:24:58.147203 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:24:58.147203 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 28 08:24:58.147203 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 08:24:58.147203 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 28 08:24:58.147203 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 08:24:58.147203 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:24:58.147203 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:24:58.147203 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:24:58.147203 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:24:58.147203 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:24:58.147203 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application with Lock( Jul 28 08:24:58.147203 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:24:58.147203 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:24:58.147203 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:24:58.147203 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:24:58.147203 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:24:58.147203 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:24:58.148218 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:24:58.148218 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:24:58.148218 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 28 08:24:58.148218 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 28 08:24:58.148218 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 28 08:24:58.148218 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 28 08:24:58.148218 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 28 08:24:58.148218 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 28 08:24:58.148218 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 28 08:24:58.148218 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application Jul 28 08:24:58.155654 dv-cinder-851351-1-smb devstack@keystone.service[207601]: [pid: 207601|app: 0|req: 427/854] 10.222.0.42 () {56 vars in 1096 bytes} [Thu Jul 28 08:24:57 2022] GET /identity/v3/users/swift => generated 83 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:24:58.163461 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96547e74-ff61-4fca-84c8-45f990d327cb None admin] Authenticating user token {{(pid=207601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:24:58.169100 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG dbcounter [-] [207600] Writing DB stats keystone:SELECT=100 {{(pid=207600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:24:58.184335 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff8b8be9-bd7b-44ed-a667-6de3b3efbdca None admin] Validating token access rules against request {{(pid=207600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:24:58.221641 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c838f34b-f44b-4d5a-8fce-35eceb617be5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:24:58.222333 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c838f34b-f44b-4d5a-8fce-35eceb617be5 None admin] REQUEST_METHOD: `GET` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:24:58.222623 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c838f34b-f44b-4d5a-8fce-35eceb617be5 None admin] SCRIPT_NAME: `/identity` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:24:58.222899 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c838f34b-f44b-4d5a-8fce-35eceb617be5 None admin] PATH_INFO: `/v3/domains` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:24:58.223621 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c838f34b-f44b-4d5a-8fce-35eceb617be5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=207600) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:24:58.223933 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c838f34b-f44b-4d5a-8fce-35eceb617be5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:24:58.225441 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c838f34b-f44b-4d5a-8fce-35eceb617be5 None admin] RBAC: Authorization granted {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:24:58.240609 dv-cinder-851351-1-smb devstack@keystone.service[207600]: [pid: 207600|app: 0|req: 428/855] 10.222.0.42 () {56 vars in 1109 bytes} [Thu Jul 28 08:24:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:24:58.246244 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c838f34b-f44b-4d5a-8fce-35eceb617be5 None admin] Authenticating user token {{(pid=207600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:24:58.287098 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG dbcounter [-] [207601] Writing DB stats keystone:SELECT=100 {{(pid=207601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:24:58.293817 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96547e74-ff61-4fca-84c8-45f990d327cb None admin] Validating token access rules against request {{(pid=207601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:24:58.340076 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ed02b1-d95a-4ca1-ac31-5c029cab7828 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:24:58.341320 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ed02b1-d95a-4ca1-ac31-5c029cab7828 None admin] REQUEST_METHOD: `GET` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:24:58.341728 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ed02b1-d95a-4ca1-ac31-5c029cab7828 None admin] SCRIPT_NAME: `/identity` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:24:58.342380 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ed02b1-d95a-4ca1-ac31-5c029cab7828 None admin] PATH_INFO: `/v3/users` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:24:58.343374 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50ed02b1-d95a-4ca1-ac31-5c029cab7828 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=207601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:24:58.343833 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50ed02b1-d95a-4ca1-ac31-5c029cab7828 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:24:58.346263 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50ed02b1-d95a-4ca1-ac31-5c029cab7828 None admin] RBAC: Authorization granted {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:24:58.369053 dv-cinder-851351-1-smb devstack@keystone.service[207601]: [pid: 207601|app: 0|req: 428/856] 10.222.0.42 () {56 vars in 1135 bytes} [Thu Jul 28 08:24:58 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:24:58.371339 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c838f34b-f44b-4d5a-8fce-35eceb617be5 None admin] Validating token access rules against request {{(pid=207600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:24:58.379461 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ed02b1-d95a-4ca1-ac31-5c029cab7828 None admin] Authenticating user token {{(pid=207601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:24:58.410404 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61cfae36-c7da-40f5-b747-fec5532b154c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:24:58.410996 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61cfae36-c7da-40f5-b747-fec5532b154c None admin] REQUEST_METHOD: `GET` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:24:58.411281 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61cfae36-c7da-40f5-b747-fec5532b154c None admin] SCRIPT_NAME: `/identity` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:24:58.411570 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61cfae36-c7da-40f5-b747-fec5532b154c None admin] PATH_INFO: `/v3/projects/service` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:24:58.419275 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61cfae36-c7da-40f5-b747-fec5532b154c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:24:58.420793 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61cfae36-c7da-40f5-b747-fec5532b154c None admin] RBAC: Authorization granted {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:24:58.433624 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application [None req-61cfae36-c7da-40f5-b747-fec5532b154c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 08:24:58.433624 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:24:58.433624 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:24:58.433624 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:24:58.433624 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:24:58.433624 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:24:58.433624 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:24:58.433624 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:24:58.433624 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:24:58.433624 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:24:58.433624 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:24:58.433624 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:24:58.433624 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 28 08:24:58.433624 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 28 08:24:58.433624 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 28 08:24:58.434651 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 28 08:24:58.434651 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:24:58.434651 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:24:58.434651 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:24:58.434651 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:24:58.434651 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:24:58.434651 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:24:58.434651 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:24:58.434651 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application with Lock( Jul 28 08:24:58.434651 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:24:58.434651 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:24:58.434651 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:24:58.434651 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:24:58.434651 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:24:58.434651 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:24:58.434651 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:24:58.434651 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:24:58.435648 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 28 08:24:58.435648 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 28 08:24:58.435648 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 28 08:24:58.435648 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 28 08:24:58.435648 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 28 08:24:58.435648 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 28 08:24:58.435648 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 08:24:58.435648 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application Jul 28 08:24:58.435648 dv-cinder-851351-1-smb devstack@keystone.service[207600]: [pid: 207600|app: 0|req: 429/857] 10.222.0.42 () {56 vars in 1111 bytes} [Thu Jul 28 08:24:58 2022] GET /identity/v3/projects/service => generated 88 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:24:58.445700 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61cfae36-c7da-40f5-b747-fec5532b154c None admin] Authenticating user token {{(pid=207600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:24:58.455598 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG dbcounter [-] [207600] Writing DB stats keystone:SELECT=100 {{(pid=207600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:24:58.490442 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ed02b1-d95a-4ca1-ac31-5c029cab7828 None admin] Validating token access rules against request {{(pid=207601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:24:58.529454 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb09e83-a7b2-41a2-938f-57187224d06b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:24:58.530523 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb09e83-a7b2-41a2-938f-57187224d06b None admin] REQUEST_METHOD: `GET` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:24:58.531020 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb09e83-a7b2-41a2-938f-57187224d06b None admin] SCRIPT_NAME: `/identity` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:24:58.531503 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb09e83-a7b2-41a2-938f-57187224d06b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:24:58.561709 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG dbcounter [-] [207601] Writing DB stats keystone:SELECT=100 {{(pid=207601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:24:58.584274 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61cfae36-c7da-40f5-b747-fec5532b154c None admin] Validating token access rules against request {{(pid=207600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:24:58.623842 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb09e83-a7b2-41a2-938f-57187224d06b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:24:58.625777 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb09e83-a7b2-41a2-938f-57187224d06b None admin] RBAC: Authorization granted {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:24:58.633633 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d9aa47c-136e-4443-9d7c-c80fe28a7aa8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:24:58.634344 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9aa47c-136e-4443-9d7c-c80fe28a7aa8 None admin] REQUEST_METHOD: `GET` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:24:58.634628 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9aa47c-136e-4443-9d7c-c80fe28a7aa8 None admin] SCRIPT_NAME: `/identity` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:24:58.634902 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9aa47c-136e-4443-9d7c-c80fe28a7aa8 None admin] PATH_INFO: `/v3/projects` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:24:58.635669 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d9aa47c-136e-4443-9d7c-c80fe28a7aa8 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=207600) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:24:58.635979 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d9aa47c-136e-4443-9d7c-c80fe28a7aa8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:24:58.638150 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d9aa47c-136e-4443-9d7c-c80fe28a7aa8 None admin] RBAC: Authorization granted {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:24:58.657048 dv-cinder-851351-1-smb devstack@keystone.service[207600]: [pid: 207600|app: 0|req: 430/858] 10.222.0.42 () {56 vars in 1148 bytes} [Thu Jul 28 08:24:58 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:24:58.662553 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d9aa47c-136e-4443-9d7c-c80fe28a7aa8 None admin] Authenticating user token {{(pid=207600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:24:58.738151 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG dbcounter [-] [207600] Writing DB stats keystone:SELECT=100 {{(pid=207600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:24:58.749983 dv-cinder-851351-1-smb devstack@keystone.service[207601]: [pid: 207601|app: 0|req: 429/859] 10.222.0.42 () {58 vars in 1282 bytes} [Thu Jul 28 08:24:58 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 372 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 28 08:24:58.749983 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f673ad8-3a18-49ad-99d2-4263843ebb78 None None] REQUEST_METHOD: `GET` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:24:58.749983 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f673ad8-3a18-49ad-99d2-4263843ebb78 None None] SCRIPT_NAME: `/identity` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:24:58.749983 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f673ad8-3a18-49ad-99d2-4263843ebb78 None None] PATH_INFO: `/` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:24:58.749983 dv-cinder-851351-1-smb devstack@keystone.service[207601]: [pid: 207601|app: 0|req: 430/860] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 08:24:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 08:24:58.751467 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f673ad8-3a18-49ad-99d2-4263843ebb78 None None] Authenticating user token {{(pid=207601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:24:58.778290 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d9aa47c-136e-4443-9d7c-c80fe28a7aa8 None admin] Validating token access rules against request {{(pid=207600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:24:58.811873 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG dbcounter [-] [207601] Writing DB stats keystone:SELECT=100 {{(pid=207601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:24:58.816635 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef17d93-ae6b-47c9-8e4a-db06a554465e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:24:58.817314 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef17d93-ae6b-47c9-8e4a-db06a554465e None admin] REQUEST_METHOD: `GET` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:24:58.817606 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef17d93-ae6b-47c9-8e4a-db06a554465e None admin] SCRIPT_NAME: `/identity` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:24:58.817883 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef17d93-ae6b-47c9-8e4a-db06a554465e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:24:58.818707 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ef17d93-ae6b-47c9-8e4a-db06a554465e None admin] RBAC: Adding query filter params (role.id=b44e7c7aeec24f51b8033df305da133d, scope.project.id=48c5f2b2ae2b48758b957d2b194a7fd1, user.id=601010c3acdf446bb37ff23cbed0dcf1) {{(pid=207600) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:24:58.819025 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ef17d93-ae6b-47c9-8e4a-db06a554465e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:24:58.820500 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ef17d93-ae6b-47c9-8e4a-db06a554465e None admin] RBAC: Authorization granted {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:24:58.827320 dv-cinder-851351-1-smb devstack@keystone.service[207600]: [pid: 207600|app: 0|req: 431/861] 10.222.0.42 () {56 vars in 1374 bytes} [Thu Jul 28 08:24:58 2022] GET /identity/v3/role_assignments?user.id=601010c3acdf446bb37ff23cbed0dcf1&scope.project.id=48c5f2b2ae2b48758b957d2b194a7fd1&role.id=b44e7c7aeec24f51b8033df305da133d => generated 608 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:24:58.835094 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d31f22-a9f3-4e9f-af33-bfda3ded1fb5 None None] REQUEST_METHOD: `POST` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:24:58.835677 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d31f22-a9f3-4e9f-af33-bfda3ded1fb5 None None] SCRIPT_NAME: `/identity` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:24:58.836110 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d31f22-a9f3-4e9f-af33-bfda3ded1fb5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:24:58.865619 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.auth.core [None req-47d31f22-a9f3-4e9f-af33-bfda3ded1fb5 None None] MFA Rules not processed for user `b8110ade874c4aa7af27f5c376df700a`. Rule list: `[]` (Enabled: `True`). {{(pid=207600) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 08:24:58.866073 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f673ad8-3a18-49ad-99d2-4263843ebb78 None None] Validating token access rules against request {{(pid=207601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:24:58.867418 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.fernet_utils [None req-47d31f22-a9f3-4e9f-af33-bfda3ded1fb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=207600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:24:58.910384 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ab452e-ea2e-4bb4-92b9-4aecf4d08efc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:24:58.911293 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ab452e-ea2e-4bb4-92b9-4aecf4d08efc None admin] REQUEST_METHOD: `GET` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:24:58.911654 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ab452e-ea2e-4bb4-92b9-4aecf4d08efc None admin] SCRIPT_NAME: `/identity` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:24:58.911963 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ab452e-ea2e-4bb4-92b9-4aecf4d08efc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:24:58.927066 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ab452e-ea2e-4bb4-92b9-4aecf4d08efc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:24:58.929952 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ab452e-ea2e-4bb4-92b9-4aecf4d08efc None admin] RBAC: Authorization granted {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:24:58.954640 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application [None req-93ab452e-ea2e-4bb4-92b9-4aecf4d08efc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 08:24:58.954640 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:24:58.954640 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:24:58.954640 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:24:58.954640 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:24:58.954640 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:24:58.954640 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:24:58.954640 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:24:58.954640 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:24:58.954640 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:24:58.954640 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:24:58.954640 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:24:58.954640 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 08:24:58.954640 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 08:24:58.954640 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 08:24:58.955862 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 08:24:58.955862 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:24:58.955862 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:24:58.955862 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:24:58.955862 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:24:58.955862 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:24:58.955862 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:24:58.955862 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:24:58.955862 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application with Lock( Jul 28 08:24:58.955862 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:24:58.955862 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:24:58.955862 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:24:58.955862 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:24:58.955862 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:24:58.955862 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:24:58.955862 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:24:58.955862 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:24:58.957037 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 08:24:58.957037 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 08:24:58.957037 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 08:24:58.957037 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application Jul 28 08:24:58.959099 dv-cinder-851351-1-smb devstack@keystone.service[207601]: [pid: 207601|app: 0|req: 431/862] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 08:24:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 08:24:58.965185 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ab452e-ea2e-4bb4-92b9-4aecf4d08efc None admin] Authenticating user token {{(pid=207601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:24:58.972965 dv-cinder-851351-1-smb devstack@keystone.service[207600]: [pid: 207600|app: 0|req: 432/863] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 08:24:58 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 08:24:58.991193 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d31f22-a9f3-4e9f-af33-bfda3ded1fb5 None None] Authenticating user token {{(pid=207600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:24:59.074161 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG dbcounter [-] [207600] Writing DB stats keystone:SELECT=100 {{(pid=207600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:24:59.093085 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ab452e-ea2e-4bb4-92b9-4aecf4d08efc None admin] Validating token access rules against request {{(pid=207601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:24:59.103859 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG dbcounter [-] [207601] Writing DB stats keystone:SELECT=100 {{(pid=207601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:24:59.121633 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d31f22-a9f3-4e9f-af33-bfda3ded1fb5 None None] Validating token access rules against request {{(pid=207600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:24:59.134289 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a8808d-37c5-4374-8cae-2c6ba6568817 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:24:59.135311 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a8808d-37c5-4374-8cae-2c6ba6568817 None admin] REQUEST_METHOD: `GET` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:24:59.135807 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a8808d-37c5-4374-8cae-2c6ba6568817 None admin] SCRIPT_NAME: `/identity` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:24:59.136307 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a8808d-37c5-4374-8cae-2c6ba6568817 None admin] PATH_INFO: `/v3/domains` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:24:59.137580 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92a8808d-37c5-4374-8cae-2c6ba6568817 None admin] RBAC: Adding query filter params (name=Default) {{(pid=207601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:24:59.138141 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92a8808d-37c5-4374-8cae-2c6ba6568817 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:24:59.139755 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92a8808d-37c5-4374-8cae-2c6ba6568817 None admin] RBAC: Authorization granted {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:24:59.153617 dv-cinder-851351-1-smb devstack@keystone.service[207601]: [pid: 207601|app: 0|req: 432/864] 10.222.0.42 () {56 vars in 1109 bytes} [Thu Jul 28 08:24:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 08:24:59.155201 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d26d43f-816f-42aa-897c-cdeb8d47b543 None None] REQUEST_METHOD: `GET` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:24:59.155494 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d26d43f-816f-42aa-897c-cdeb8d47b543 None None] SCRIPT_NAME: `/identity` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:24:59.155778 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d26d43f-816f-42aa-897c-cdeb8d47b543 None None] PATH_INFO: `/` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:24:59.157393 dv-cinder-851351-1-smb devstack@keystone.service[207601]: [pid: 207601|app: 0|req: 433/865] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 08:24:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 08:24:59.159350 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d26d43f-816f-42aa-897c-cdeb8d47b543 None None] Authenticating user token {{(pid=207601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:24:59.164104 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26829e9a-c584-4bdd-a742-d1e3a702c5bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:24:59.164813 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26829e9a-c584-4bdd-a742-d1e3a702c5bf None admin] REQUEST_METHOD: `GET` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:24:59.165142 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26829e9a-c584-4bdd-a742-d1e3a702c5bf None admin] SCRIPT_NAME: `/identity` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:24:59.165416 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26829e9a-c584-4bdd-a742-d1e3a702c5bf None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:24:59.166069 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26829e9a-c584-4bdd-a742-d1e3a702c5bf None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:24:59.167452 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26829e9a-c584-4bdd-a742-d1e3a702c5bf None admin] RBAC: Authorization granted {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:24:59.177160 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application [None req-26829e9a-c584-4bdd-a742-d1e3a702c5bf None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 28 08:24:59.177160 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:24:59.177160 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 28 08:24:59.177160 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 28 08:24:59.177160 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 28 08:24:59.177160 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 28 08:24:59.177160 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 28 08:24:59.177160 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 08:24:59.177160 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 28 08:24:59.177160 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application Jul 28 08:24:59.177160 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 28 08:24:59.177160 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application Jul 28 08:24:59.177160 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:24:59.177160 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:24:59.177160 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:24:59.177160 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:24:59.178203 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:24:59.178203 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:24:59.178203 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:24:59.178203 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:24:59.178203 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:24:59.178203 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:24:59.178203 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:24:59.178203 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 28 08:24:59.178203 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 28 08:24:59.178203 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 28 08:24:59.178203 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 28 08:24:59.178203 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:24:59.178203 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:24:59.178203 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:24:59.178203 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:24:59.178203 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:24:59.179706 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:24:59.179706 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:24:59.179706 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application with Lock( Jul 28 08:24:59.179706 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:24:59.179706 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:24:59.179706 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:24:59.179706 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:24:59.179706 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:24:59.179706 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:24:59.179706 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:24:59.179706 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:24:59.179706 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 28 08:24:59.179706 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 08:24:59.179706 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 28 08:24:59.179706 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application Jul 28 08:24:59.179706 dv-cinder-851351-1-smb devstack@keystone.service[207600]: [pid: 207600|app: 0|req: 433/866] 10.222.0.42 () {56 vars in 1132 bytes} [Thu Jul 28 08:24:58 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 08:24:59.180616 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab12a0d5-793a-4524-beb8-37f09c1cc537 None None] REQUEST_METHOD: `POST` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:24:59.180616 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab12a0d5-793a-4524-beb8-37f09c1cc537 None None] SCRIPT_NAME: `/identity` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:24:59.180616 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab12a0d5-793a-4524-beb8-37f09c1cc537 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:24:59.198764 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.auth.core [None req-ab12a0d5-793a-4524-beb8-37f09c1cc537 None None] MFA Rules not processed for user `b8110ade874c4aa7af27f5c376df700a`. Rule list: `[]` (Enabled: `True`). {{(pid=207600) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 08:24:59.199965 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.fernet_utils [None req-ab12a0d5-793a-4524-beb8-37f09c1cc537 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=207600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:24:59.280801 dv-cinder-851351-1-smb devstack@keystone.service[207600]: [pid: 207600|app: 0|req: 434/867] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 08:24:59 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 08:24:59.280801 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab12a0d5-793a-4524-beb8-37f09c1cc537 None None] Authenticating user token {{(pid=207600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:24:59.281463 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d26d43f-816f-42aa-897c-cdeb8d47b543 None None] Validating token access rules against request {{(pid=207601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:24:59.322625 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dbc0cce-2f60-469c-a89d-b038e120fe96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:24:59.323312 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbc0cce-2f60-469c-a89d-b038e120fe96 None admin] REQUEST_METHOD: `GET` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:24:59.323825 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbc0cce-2f60-469c-a89d-b038e120fe96 None admin] SCRIPT_NAME: `/identity` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:24:59.323825 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbc0cce-2f60-469c-a89d-b038e120fe96 None admin] PATH_INFO: `/v3/projects/service` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:24:59.331020 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dbc0cce-2f60-469c-a89d-b038e120fe96 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:24:59.332478 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dbc0cce-2f60-469c-a89d-b038e120fe96 None admin] RBAC: Authorization granted {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:24:59.338812 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG dbcounter [-] [207600] Writing DB stats keystone:SELECT=100 {{(pid=207600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:24:59.344521 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application [None req-2dbc0cce-2f60-469c-a89d-b038e120fe96 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 08:24:59.344521 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:24:59.344521 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:24:59.344521 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:24:59.344521 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:24:59.344521 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:24:59.344521 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:24:59.344521 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:24:59.344521 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:24:59.344521 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:24:59.344521 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:24:59.344521 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:24:59.344521 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 28 08:24:59.344521 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 28 08:24:59.344521 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 28 08:24:59.345746 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 28 08:24:59.345746 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:24:59.345746 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:24:59.345746 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:24:59.345746 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:24:59.345746 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:24:59.345746 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:24:59.345746 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:24:59.345746 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application with Lock( Jul 28 08:24:59.345746 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:24:59.345746 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:24:59.345746 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:24:59.345746 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:24:59.345746 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:24:59.345746 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:24:59.345746 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:24:59.345746 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:24:59.346867 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 28 08:24:59.346867 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 28 08:24:59.346867 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 28 08:24:59.346867 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 28 08:24:59.346867 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 28 08:24:59.346867 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 28 08:24:59.346867 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 08:24:59.346867 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application Jul 28 08:24:59.348753 dv-cinder-851351-1-smb devstack@keystone.service[207601]: [pid: 207601|app: 0|req: 434/868] 10.222.0.42 () {56 vars in 1111 bytes} [Thu Jul 28 08:24:59 2022] GET /identity/v3/projects/service => generated 88 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 08:24:59.350081 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dbc0cce-2f60-469c-a89d-b038e120fe96 None admin] Authenticating user token {{(pid=207601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:24:59.380990 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG dbcounter [-] [207601] Writing DB stats keystone:SELECT=100 {{(pid=207601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:24:59.395134 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab12a0d5-793a-4524-beb8-37f09c1cc537 None None] Validating token access rules against request {{(pid=207600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:24:59.432036 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94ddcd8-cc7a-4037-8afe-2795ee39b8ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:24:59.432589 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94ddcd8-cc7a-4037-8afe-2795ee39b8ab None admin] REQUEST_METHOD: `GET` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:24:59.432906 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94ddcd8-cc7a-4037-8afe-2795ee39b8ab None admin] SCRIPT_NAME: `/identity` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:24:59.433173 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94ddcd8-cc7a-4037-8afe-2795ee39b8ab None admin] PATH_INFO: `/v3/services` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:24:59.433884 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b94ddcd8-cc7a-4037-8afe-2795ee39b8ab None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=207600) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:24:59.434194 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b94ddcd8-cc7a-4037-8afe-2795ee39b8ab None admin] RBAC: Authorizing `identity:list_services()` {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:24:59.435588 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b94ddcd8-cc7a-4037-8afe-2795ee39b8ab None admin] RBAC: Authorization granted {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:24:59.445394 dv-cinder-851351-1-smb devstack@keystone.service[207600]: [pid: 207600|app: 0|req: 435/869] 10.222.0.42 () {56 vars in 1126 bytes} [Thu Jul 28 08:24:59 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:24:59.445394 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94ddcd8-cc7a-4037-8afe-2795ee39b8ab None admin] Authenticating user token {{(pid=207600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:24:59.474303 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dbc0cce-2f60-469c-a89d-b038e120fe96 None admin] Validating token access rules against request {{(pid=207601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:24:59.509262 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e463ff2d-7d8b-48e0-9ed2-8ec4dbfab5c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:24:59.509998 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e463ff2d-7d8b-48e0-9ed2-8ec4dbfab5c1 None admin] REQUEST_METHOD: `POST` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:24:59.510347 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e463ff2d-7d8b-48e0-9ed2-8ec4dbfab5c1 None admin] SCRIPT_NAME: `/identity` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:24:59.510685 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e463ff2d-7d8b-48e0-9ed2-8ec4dbfab5c1 None admin] PATH_INFO: `/v3/services` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:24:59.511396 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e463ff2d-7d8b-48e0-9ed2-8ec4dbfab5c1 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:24:59.512813 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e463ff2d-7d8b-48e0-9ed2-8ec4dbfab5c1 None admin] RBAC: Authorization granted {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:24:59.536699 dv-cinder-851351-1-smb devstack@keystone.service[207601]: [pid: 207601|app: 0|req: 435/870] 10.222.0.42 () {60 vars in 1141 bytes} [Thu Jul 28 08:24:59 2022] POST /identity/v3/services => generated 251 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 08:24:59.536699 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e463ff2d-7d8b-48e0-9ed2-8ec4dbfab5c1 None admin] Authenticating user token {{(pid=207601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:24:59.551685 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94ddcd8-cc7a-4037-8afe-2795ee39b8ab None admin] Validating token access rules against request {{(pid=207600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:24:59.577277 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG dbcounter [-] [207600] Writing DB stats keystone:SELECT=100 {{(pid=207600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:24:59.610803 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91bac280-7f92-4c99-9a09-408c184ed877 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:24:59.611995 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91bac280-7f92-4c99-9a09-408c184ed877 None admin] REQUEST_METHOD: `GET` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:24:59.612396 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91bac280-7f92-4c99-9a09-408c184ed877 None admin] SCRIPT_NAME: `/identity` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:24:59.612693 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91bac280-7f92-4c99-9a09-408c184ed877 None admin] PATH_INFO: `/v3/projects` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:24:59.613589 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91bac280-7f92-4c99-9a09-408c184ed877 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=207600) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:24:59.614076 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91bac280-7f92-4c99-9a09-408c184ed877 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:24:59.616355 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91bac280-7f92-4c99-9a09-408c184ed877 None admin] RBAC: Authorization granted {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:24:59.641903 dv-cinder-851351-1-smb devstack@keystone.service[207600]: [pid: 207600|app: 0|req: 436/871] 10.222.0.42 () {56 vars in 1148 bytes} [Thu Jul 28 08:24:59 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:24:59.644525 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91bac280-7f92-4c99-9a09-408c184ed877 None admin] Authenticating user token {{(pid=207600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:24:59.674606 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e463ff2d-7d8b-48e0-9ed2-8ec4dbfab5c1 None admin] Validating token access rules against request {{(pid=207601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:24:59.681180 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG dbcounter [-] [207601] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=207601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:24:59.732953 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a145ee1-8036-4262-b543-ccd5fef4414a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:24:59.733707 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a145ee1-8036-4262-b543-ccd5fef4414a None admin] REQUEST_METHOD: `GET` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:24:59.733998 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a145ee1-8036-4262-b543-ccd5fef4414a None admin] SCRIPT_NAME: `/identity` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:24:59.734281 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a145ee1-8036-4262-b543-ccd5fef4414a None admin] PATH_INFO: `/v3/services` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:24:59.735635 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a145ee1-8036-4262-b543-ccd5fef4414a None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=207601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:24:59.735974 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a145ee1-8036-4262-b543-ccd5fef4414a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:24:59.737689 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a145ee1-8036-4262-b543-ccd5fef4414a None admin] RBAC: Authorization granted {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:24:59.744340 dv-cinder-851351-1-smb devstack@keystone.service[207601]: [pid: 207601|app: 0|req: 436/872] 10.222.0.42 () {56 vars in 1126 bytes} [Thu Jul 28 08:24:59 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:24:59.794649 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91bac280-7f92-4c99-9a09-408c184ed877 None admin] Validating token access rules against request {{(pid=207600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:24:59.838734 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b96cbf4-daec-40e7-9372-40ab6d0a770d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:24:59.839694 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b96cbf4-daec-40e7-9372-40ab6d0a770d None admin] REQUEST_METHOD: `GET` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:24:59.840130 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b96cbf4-daec-40e7-9372-40ab6d0a770d None admin] SCRIPT_NAME: `/identity` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:24:59.840557 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b96cbf4-daec-40e7-9372-40ab6d0a770d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:24:59.841584 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b96cbf4-daec-40e7-9372-40ab6d0a770d None admin] RBAC: Adding query filter params (role.id=d0ce88034c6b41878db755343f5840be, scope.project.id=48c5f2b2ae2b48758b957d2b194a7fd1, user.id=96e9a6a7c6ea4047a5d8e16babbdeb70) {{(pid=207600) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:24:59.842055 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b96cbf4-daec-40e7-9372-40ab6d0a770d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:24:59.843763 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b96cbf4-daec-40e7-9372-40ab6d0a770d None admin] RBAC: Authorization granted {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:24:59.851852 dv-cinder-851351-1-smb devstack@keystone.service[207600]: [pid: 207600|app: 0|req: 437/873] 10.222.0.42 () {56 vars in 1374 bytes} [Thu Jul 28 08:24:59 2022] GET /identity/v3/role_assignments?user.id=96e9a6a7c6ea4047a5d8e16babbdeb70&scope.project.id=48c5f2b2ae2b48758b957d2b194a7fd1&role.id=d0ce88034c6b41878db755343f5840be => generated 608 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:25:00.973789 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea50b729-1f85-413c-9e04-ee08c90a1017 None None] REQUEST_METHOD: `GET` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:25:00.974320 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea50b729-1f85-413c-9e04-ee08c90a1017 None None] SCRIPT_NAME: `/identity` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:25:00.974320 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea50b729-1f85-413c-9e04-ee08c90a1017 None None] PATH_INFO: `/` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:25:00.975994 dv-cinder-851351-1-smb devstack@keystone.service[207601]: [pid: 207601|app: 0|req: 437/874] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 08:25:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 08:25:00.983192 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80bc38ce-4120-44f3-861d-760e4116e3c3 None None] REQUEST_METHOD: `POST` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:25:00.983680 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80bc38ce-4120-44f3-861d-760e4116e3c3 None None] SCRIPT_NAME: `/identity` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:25:00.983765 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80bc38ce-4120-44f3-861d-760e4116e3c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:25:01.004075 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.auth.core [None req-80bc38ce-4120-44f3-861d-760e4116e3c3 None None] MFA Rules not processed for user `b8110ade874c4aa7af27f5c376df700a`. Rule list: `[]` (Enabled: `True`). {{(pid=207600) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 08:25:01.005320 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.fernet_utils [None req-80bc38ce-4120-44f3-861d-760e4116e3c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=207600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:25:01.037144 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG dbcounter [-] [207600] Writing DB stats keystone:SELECT=100 {{(pid=207600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:25:01.076996 dv-cinder-851351-1-smb devstack@keystone.service[207600]: [pid: 207600|app: 0|req: 438/875] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 08:25:00 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 28 08:25:01.099499 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea50b729-1f85-413c-9e04-ee08c90a1017 None None] Authenticating user token {{(pid=207601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:25:01.204181 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea50b729-1f85-413c-9e04-ee08c90a1017 None None] Validating token access rules against request {{(pid=207601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:25:01.243314 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa47d34-dc12-4533-ac7d-07e9c8007363 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:25:01.244254 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa47d34-dc12-4533-ac7d-07e9c8007363 None admin] REQUEST_METHOD: `GET` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:25:01.244761 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa47d34-dc12-4533-ac7d-07e9c8007363 None admin] SCRIPT_NAME: `/identity` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:25:01.245206 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa47d34-dc12-4533-ac7d-07e9c8007363 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:25:01.257035 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa47d34-dc12-4533-ac7d-07e9c8007363 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 08:25:01.262303 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application [None req-0fa47d34-dc12-4533-ac7d-07e9c8007363 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 28 08:25:01.262303 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:25:01.262303 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:25:01.262303 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:25:01.262303 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:25:01.262303 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:25:01.262303 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:25:01.262303 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:25:01.262303 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:25:01.262303 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:25:01.262303 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:25:01.262303 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:25:01.262303 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 08:25:01.262303 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 08:25:01.262303 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 08:25:01.262303 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 08:25:01.263498 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 08:25:01.263498 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 08:25:01.263498 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 08:25:01.263498 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 08:25:01.263498 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:25:01.263498 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:25:01.263498 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:25:01.263498 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:25:01.263498 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:25:01.263498 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:25:01.263498 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:25:01.263498 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application with Lock( Jul 28 08:25:01.263498 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:25:01.263498 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:25:01.263498 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:25:01.263498 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:25:01.264615 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:25:01.264615 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:25:01.264615 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:25:01.264615 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:25:01.264615 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 08:25:01.264615 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 08:25:01.264615 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 08:25:01.264615 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 08:25:01.264615 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 08:25:01.264615 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 08:25:01.264615 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 28 08:25:01.264615 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application Jul 28 08:25:01.267121 dv-cinder-851351-1-smb devstack@keystone.service[207601]: [pid: 207601|app: 0|req: 438/876] 10.222.0.42 () {56 vars in 1120 bytes} [Thu Jul 28 08:25:01 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:25:01.273325 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80bc38ce-4120-44f3-861d-760e4116e3c3 None None] Authenticating user token {{(pid=207600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:25:01.383021 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80bc38ce-4120-44f3-861d-760e4116e3c3 None None] Validating token access rules against request {{(pid=207600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:25:01.422272 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a46e2ddf-a5d3-4fe3-aaca-2bfd700fabda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:25:01.422923 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46e2ddf-a5d3-4fe3-aaca-2bfd700fabda None admin] REQUEST_METHOD: `GET` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:25:01.423226 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46e2ddf-a5d3-4fe3-aaca-2bfd700fabda None admin] SCRIPT_NAME: `/identity` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:25:01.423492 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46e2ddf-a5d3-4fe3-aaca-2bfd700fabda None admin] PATH_INFO: `/v3/roles` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:25:01.424238 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a46e2ddf-a5d3-4fe3-aaca-2bfd700fabda None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=207600) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:25:01.424552 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a46e2ddf-a5d3-4fe3-aaca-2bfd700fabda None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:25:01.425993 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a46e2ddf-a5d3-4fe3-aaca-2bfd700fabda None admin] RBAC: Authorization granted {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:25:01.435906 dv-cinder-851351-1-smb devstack@keystone.service[207600]: [pid: 207600|app: 0|req: 439/877] 10.222.0.42 () {56 vars in 1115 bytes} [Thu Jul 28 08:25:01 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:25:01.441486 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa47d34-dc12-4533-ac7d-07e9c8007363 None admin] Authenticating user token {{(pid=207601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:25:01.455857 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG dbcounter [-] [207601] Writing DB stats keystone:SELECT=100 {{(pid=207601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:25:01.556144 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa47d34-dc12-4533-ac7d-07e9c8007363 None admin] Validating token access rules against request {{(pid=207601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:25:01.598443 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1883a7fa-4002-4f6a-8027-bf43b6af6bdf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:25:01.599138 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1883a7fa-4002-4f6a-8027-bf43b6af6bdf None admin] REQUEST_METHOD: `GET` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:25:01.599420 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1883a7fa-4002-4f6a-8027-bf43b6af6bdf None admin] SCRIPT_NAME: `/identity` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:25:01.599696 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1883a7fa-4002-4f6a-8027-bf43b6af6bdf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:25:01.612075 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1883a7fa-4002-4f6a-8027-bf43b6af6bdf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:25:01.613594 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1883a7fa-4002-4f6a-8027-bf43b6af6bdf None admin] RBAC: Authorization granted {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:25:01.629676 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application [None req-1883a7fa-4002-4f6a-8027-bf43b6af6bdf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 08:25:01.629676 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:25:01.629676 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:25:01.629676 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:25:01.629676 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:25:01.629676 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:25:01.629676 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:25:01.629676 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:25:01.629676 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:25:01.629676 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:25:01.629676 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:25:01.629676 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:25:01.629676 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 08:25:01.629676 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 08:25:01.629676 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 08:25:01.630686 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 08:25:01.630686 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:25:01.630686 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:25:01.630686 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:25:01.630686 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:25:01.630686 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:25:01.630686 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:25:01.630686 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:25:01.630686 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application with Lock( Jul 28 08:25:01.630686 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:25:01.630686 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:25:01.630686 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:25:01.630686 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:25:01.630686 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:25:01.630686 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:25:01.630686 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:25:01.630686 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:25:01.631629 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 08:25:01.631629 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 08:25:01.631629 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 08:25:01.631629 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application Jul 28 08:25:01.631629 dv-cinder-851351-1-smb devstack@keystone.service[207601]: [pid: 207601|app: 0|req: 439/878] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 08:25:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:25:01.638459 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a46e2ddf-a5d3-4fe3-aaca-2bfd700fabda None admin] Authenticating user token {{(pid=207600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:25:01.679596 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG dbcounter [-] [207600] Writing DB stats keystone:SELECT=100 {{(pid=207600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:25:01.734697 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c961b468-994d-49c8-9aa0-9a6b7231fe5a None None] REQUEST_METHOD: `GET` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:25:01.734903 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c961b468-994d-49c8-9aa0-9a6b7231fe5a None None] SCRIPT_NAME: `/identity` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:25:01.735227 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c961b468-994d-49c8-9aa0-9a6b7231fe5a None None] PATH_INFO: `/` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:25:01.736819 dv-cinder-851351-1-smb devstack@keystone.service[207601]: [pid: 207601|app: 0|req: 440/879] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 08:25:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 28 08:25:01.744032 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2438372-c892-426c-9ef9-de82680dbb83 None None] REQUEST_METHOD: `POST` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:25:01.744371 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2438372-c892-426c-9ef9-de82680dbb83 None None] SCRIPT_NAME: `/identity` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:25:01.744602 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2438372-c892-426c-9ef9-de82680dbb83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:25:01.765950 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.auth.core [None req-b2438372-c892-426c-9ef9-de82680dbb83 None None] MFA Rules not processed for user `b8110ade874c4aa7af27f5c376df700a`. Rule list: `[]` (Enabled: `True`). {{(pid=207601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 08:25:01.767399 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.fernet_utils [None req-b2438372-c892-426c-9ef9-de82680dbb83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=207601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:25:01.797942 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a46e2ddf-a5d3-4fe3-aaca-2bfd700fabda None admin] Validating token access rules against request {{(pid=207600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:25:01.845316 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8ad86e-467b-42d7-89a3-aa115f36898d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:25:01.846371 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8ad86e-467b-42d7-89a3-aa115f36898d None admin] REQUEST_METHOD: `GET` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:25:01.846859 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8ad86e-467b-42d7-89a3-aa115f36898d None admin] SCRIPT_NAME: `/identity` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:25:01.847339 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8ad86e-467b-42d7-89a3-aa115f36898d None admin] PATH_INFO: `/v3/domains` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:25:01.848257 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e8ad86e-467b-42d7-89a3-aa115f36898d None admin] RBAC: Adding query filter params (name=Default) {{(pid=207600) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:25:01.848842 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e8ad86e-467b-42d7-89a3-aa115f36898d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:25:01.850002 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG dbcounter [-] [207601] Writing DB stats keystone:SELECT=100 {{(pid=207601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:25:01.850401 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e8ad86e-467b-42d7-89a3-aa115f36898d None admin] RBAC: Authorization granted {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:25:01.870568 dv-cinder-851351-1-smb devstack@keystone.service[207600]: [pid: 207600|app: 0|req: 440/880] 10.222.0.42 () {56 vars in 1109 bytes} [Thu Jul 28 08:25:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:25:01.871785 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8ad86e-467b-42d7-89a3-aa115f36898d None admin] Authenticating user token {{(pid=207600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:25:01.872016 dv-cinder-851351-1-smb devstack@keystone.service[207601]: [pid: 207601|app: 0|req: 441/881] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 08:25:01 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 28 08:25:01.903933 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518b8911-9327-4142-995c-4e7018ab40aa None None] REQUEST_METHOD: `GET` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:25:01.904235 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518b8911-9327-4142-995c-4e7018ab40aa None None] SCRIPT_NAME: `/identity` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:25:01.904511 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518b8911-9327-4142-995c-4e7018ab40aa None None] PATH_INFO: `/` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:25:01.906105 dv-cinder-851351-1-smb devstack@keystone.service[207601]: [pid: 207601|app: 0|req: 442/882] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 08:25:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 28 08:25:01.907314 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21985b51-5a6d-45e2-a5b5-0475f00aa573 None None] REQUEST_METHOD: `GET` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:25:01.907609 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21985b51-5a6d-45e2-a5b5-0475f00aa573 None None] SCRIPT_NAME: `/identity` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:25:01.907886 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21985b51-5a6d-45e2-a5b5-0475f00aa573 None None] PATH_INFO: `/` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:25:01.909241 dv-cinder-851351-1-smb devstack@keystone.service[207601]: [pid: 207601|app: 0|req: 443/883] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 08:25:01 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 08:25:01.910106 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21985b51-5a6d-45e2-a5b5-0475f00aa573 None None] Authenticating user token {{(pid=207601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:25:01.975723 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG dbcounter [-] [207600] Writing DB stats keystone:SELECT=100 {{(pid=207600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:25:01.987679 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8ad86e-467b-42d7-89a3-aa115f36898d None admin] Validating token access rules against request {{(pid=207600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:25:02.020447 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21985b51-5a6d-45e2-a5b5-0475f00aa573 None None] Validating token access rules against request {{(pid=207601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:25:02.024259 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a7eeb5-1aba-45a1-bbde-53d175556a01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:25:02.025064 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a7eeb5-1aba-45a1-bbde-53d175556a01 None admin] REQUEST_METHOD: `GET` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:25:02.025349 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a7eeb5-1aba-45a1-bbde-53d175556a01 None admin] SCRIPT_NAME: `/identity` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:25:02.025626 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a7eeb5-1aba-45a1-bbde-53d175556a01 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:25:02.034206 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3a7eeb5-1aba-45a1-bbde-53d175556a01 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:25:02.035688 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3a7eeb5-1aba-45a1-bbde-53d175556a01 None admin] RBAC: Authorization granted {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:25:02.050597 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application [None req-f3a7eeb5-1aba-45a1-bbde-53d175556a01 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 28 08:25:02.050597 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:25:02.050597 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:25:02.050597 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:25:02.050597 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:25:02.050597 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:25:02.050597 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:25:02.050597 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:25:02.050597 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:25:02.050597 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:25:02.050597 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:25:02.050597 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:25:02.050597 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 28 08:25:02.050597 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 28 08:25:02.050597 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 28 08:25:02.050597 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 28 08:25:02.051683 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:25:02.051683 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:25:02.051683 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 28 08:25:02.051683 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 08:25:02.051683 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 28 08:25:02.051683 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 08:25:02.051683 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:25:02.051683 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:25:02.051683 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:25:02.051683 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:25:02.051683 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:25:02.051683 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application with Lock( Jul 28 08:25:02.051683 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:25:02.051683 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:25:02.051683 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:25:02.051683 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:25:02.051683 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:25:02.051683 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:25:02.053216 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:25:02.053216 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:25:02.053216 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 28 08:25:02.053216 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 28 08:25:02.053216 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 28 08:25:02.053216 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 28 08:25:02.053216 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 28 08:25:02.053216 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 28 08:25:02.053216 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 28 08:25:02.053216 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application Jul 28 08:25:02.053216 dv-cinder-851351-1-smb devstack@keystone.service[207600]: [pid: 207600|app: 0|req: 441/884] 10.222.0.42 () {56 vars in 1117 bytes} [Thu Jul 28 08:25:01 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 08:25:02.053216 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f9f673-9bec-4911-a1cf-acfb54fc495b None None] REQUEST_METHOD: `POST` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:25:02.054041 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f9f673-9bec-4911-a1cf-acfb54fc495b None None] SCRIPT_NAME: `/identity` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:25:02.054041 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f9f673-9bec-4911-a1cf-acfb54fc495b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:25:02.059594 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80517586-560c-4704-bb8b-1f47b0d897e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:25:02.060308 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80517586-560c-4704-bb8b-1f47b0d897e9 None admin] REQUEST_METHOD: `GET` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:25:02.060596 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80517586-560c-4704-bb8b-1f47b0d897e9 None admin] SCRIPT_NAME: `/identity` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:25:02.060908 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80517586-560c-4704-bb8b-1f47b0d897e9 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:25:02.061558 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80517586-560c-4704-bb8b-1f47b0d897e9 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:25:02.062934 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80517586-560c-4704-bb8b-1f47b0d897e9 None admin] RBAC: Authorization granted {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:25:02.072302 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application [None req-80517586-560c-4704-bb8b-1f47b0d897e9 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 28 08:25:02.072302 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:25:02.072302 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 28 08:25:02.072302 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 28 08:25:02.072302 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 28 08:25:02.072302 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 28 08:25:02.072302 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 28 08:25:02.072302 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 08:25:02.072302 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 28 08:25:02.072302 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application Jul 28 08:25:02.072302 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 28 08:25:02.072302 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application Jul 28 08:25:02.072302 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:25:02.072302 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:25:02.072302 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:25:02.072302 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:25:02.072302 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:25:02.074133 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:25:02.074133 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:25:02.074133 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:25:02.074133 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:25:02.074133 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:25:02.074133 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:25:02.074133 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 28 08:25:02.074133 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 28 08:25:02.074133 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 28 08:25:02.074133 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 28 08:25:02.074133 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:25:02.074133 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:25:02.074133 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:25:02.074133 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:25:02.074133 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:25:02.074133 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:25:02.075602 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:25:02.075602 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application with Lock( Jul 28 08:25:02.075602 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:25:02.075602 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:25:02.075602 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:25:02.075602 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:25:02.075602 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:25:02.075602 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:25:02.075602 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:25:02.075602 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:25:02.075602 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 28 08:25:02.075602 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 08:25:02.075602 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 28 08:25:02.075602 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application Jul 28 08:25:02.075602 dv-cinder-851351-1-smb devstack@keystone.service[207601]: [pid: 207601|app: 0|req: 444/885] 10.222.0.42 () {56 vars in 1114 bytes} [Thu Jul 28 08:25:01 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:25:02.077681 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af616267-9816-4994-99ab-89e2a57c15f8 None None] REQUEST_METHOD: `POST` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:25:02.077681 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af616267-9816-4994-99ab-89e2a57c15f8 None None] SCRIPT_NAME: `/identity` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:25:02.077681 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af616267-9816-4994-99ab-89e2a57c15f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:25:02.078199 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.auth.core [None req-99f9f673-9bec-4911-a1cf-acfb54fc495b None None] MFA Rules not processed for user `b8110ade874c4aa7af27f5c376df700a`. Rule list: `[]` (Enabled: `True`). {{(pid=207600) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 08:25:02.079556 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.fernet_utils [None req-99f9f673-9bec-4911-a1cf-acfb54fc495b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=207600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:25:02.097483 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.auth.core [None req-af616267-9816-4994-99ab-89e2a57c15f8 None None] MFA Rules not processed for user `b8110ade874c4aa7af27f5c376df700a`. Rule list: `[]` (Enabled: `True`). {{(pid=207601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 08:25:02.098818 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.fernet_utils [None req-af616267-9816-4994-99ab-89e2a57c15f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=207601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:25:02.172015 dv-cinder-851351-1-smb devstack@keystone.service[207600]: [pid: 207600|app: 0|req: 442/886] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 08:25:02 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 08:25:02.172970 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG dbcounter [-] [207601] Writing DB stats keystone:SELECT=100 {{(pid=207601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:25:02.173253 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f9f673-9bec-4911-a1cf-acfb54fc495b None None] Authenticating user token {{(pid=207600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:25:02.203219 dv-cinder-851351-1-smb devstack@keystone.service[207601]: [pid: 207601|app: 0|req: 445/887] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 08:25:02 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 08:25:02.204399 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af616267-9816-4994-99ab-89e2a57c15f8 None None] Authenticating user token {{(pid=207601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:25:02.276001 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG dbcounter [-] [207600] Writing DB stats keystone:SELECT=100 {{(pid=207600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:25:02.299599 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f9f673-9bec-4911-a1cf-acfb54fc495b None None] Validating token access rules against request {{(pid=207600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:25:02.319956 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af616267-9816-4994-99ab-89e2a57c15f8 None None] Validating token access rules against request {{(pid=207601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:25:02.335483 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae84dcb-b61f-4925-b461-dbcbdf562635 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:25:02.336119 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae84dcb-b61f-4925-b461-dbcbdf562635 None admin] REQUEST_METHOD: `GET` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:25:02.336397 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae84dcb-b61f-4925-b461-dbcbdf562635 None admin] SCRIPT_NAME: `/identity` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:25:02.336682 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae84dcb-b61f-4925-b461-dbcbdf562635 None admin] PATH_INFO: `/v3/users` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:25:02.337886 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ae84dcb-b61f-4925-b461-dbcbdf562635 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=207600) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:25:02.338194 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ae84dcb-b61f-4925-b461-dbcbdf562635 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:25:02.339665 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ae84dcb-b61f-4925-b461-dbcbdf562635 None admin] RBAC: Authorization granted {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:25:02.357571 dv-cinder-851351-1-smb devstack@keystone.service[207600]: [pid: 207600|app: 0|req: 443/888] 10.222.0.42 () {56 vars in 1149 bytes} [Thu Jul 28 08:25:02 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:25:02.358457 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae84dcb-b61f-4925-b461-dbcbdf562635 None admin] Authenticating user token {{(pid=207600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:25:02.360621 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a374309b-edd0-4d7b-bf78-8e709e56420e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:25:02.361477 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a374309b-edd0-4d7b-bf78-8e709e56420e None admin] REQUEST_METHOD: `GET` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:25:02.361910 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a374309b-edd0-4d7b-bf78-8e709e56420e None admin] SCRIPT_NAME: `/identity` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:25:02.362262 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a374309b-edd0-4d7b-bf78-8e709e56420e None admin] PATH_INFO: `/v3/services` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:25:02.363116 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a374309b-edd0-4d7b-bf78-8e709e56420e None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=207601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:25:02.363553 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a374309b-edd0-4d7b-bf78-8e709e56420e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:25:02.365354 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a374309b-edd0-4d7b-bf78-8e709e56420e None admin] RBAC: Authorization granted {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:25:02.371127 dv-cinder-851351-1-smb devstack@keystone.service[207601]: [pid: 207601|app: 0|req: 446/889] 10.222.0.42 () {56 vars in 1114 bytes} [Thu Jul 28 08:25:02 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:25:02.371965 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a374309b-edd0-4d7b-bf78-8e709e56420e None admin] Authenticating user token {{(pid=207601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:25:02.437104 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG dbcounter [-] [207601] Writing DB stats keystone:SELECT=100 {{(pid=207601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:25:02.478469 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae84dcb-b61f-4925-b461-dbcbdf562635 None admin] Validating token access rules against request {{(pid=207600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:25:02.492805 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a374309b-edd0-4d7b-bf78-8e709e56420e None admin] Validating token access rules against request {{(pid=207601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:25:02.516851 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-128a20b3-5f31-4eeb-81c4-a8017827e732 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:25:02.517564 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128a20b3-5f31-4eeb-81c4-a8017827e732 None admin] REQUEST_METHOD: `POST` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:25:02.517936 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128a20b3-5f31-4eeb-81c4-a8017827e732 None admin] SCRIPT_NAME: `/identity` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:25:02.518228 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128a20b3-5f31-4eeb-81c4-a8017827e732 None admin] PATH_INFO: `/v3/services` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:25:02.519018 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-128a20b3-5f31-4eeb-81c4-a8017827e732 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:25:02.520598 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-128a20b3-5f31-4eeb-81c4-a8017827e732 None admin] RBAC: Authorization granted {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:25:02.530529 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d686ce0-3a6e-4200-8c4e-e81419102cb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:25:02.531127 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d686ce0-3a6e-4200-8c4e-e81419102cb7 None admin] REQUEST_METHOD: `GET` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:25:02.531412 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d686ce0-3a6e-4200-8c4e-e81419102cb7 None admin] SCRIPT_NAME: `/identity` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:25:02.531545 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG dbcounter [-] [207600] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=207600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:25:02.531690 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d686ce0-3a6e-4200-8c4e-e81419102cb7 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:25:02.532338 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d686ce0-3a6e-4200-8c4e-e81419102cb7 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:25:02.533835 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d686ce0-3a6e-4200-8c4e-e81419102cb7 None admin] RBAC: Authorization granted {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:25:02.544856 dv-cinder-851351-1-smb devstack@keystone.service[207600]: [pid: 207600|app: 0|req: 444/890] 10.222.0.42 () {60 vars in 1141 bytes} [Thu Jul 28 08:25:02 2022] POST /identity/v3/services => generated 269 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 08:25:02.545953 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-128a20b3-5f31-4eeb-81c4-a8017827e732 None admin] Authenticating user token {{(pid=207600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:25:02.546163 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application [None req-1d686ce0-3a6e-4200-8c4e-e81419102cb7 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 28 08:25:02.546163 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:25:02.546163 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 28 08:25:02.546163 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 28 08:25:02.546163 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 28 08:25:02.546163 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 28 08:25:02.546163 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 28 08:25:02.546163 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 08:25:02.546163 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 28 08:25:02.546163 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application Jul 28 08:25:02.546163 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 28 08:25:02.546163 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application Jul 28 08:25:02.546163 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:25:02.546163 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:25:02.546163 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:25:02.546163 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:25:02.546163 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:25:02.547462 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:25:02.547462 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:25:02.547462 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:25:02.547462 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:25:02.547462 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:25:02.547462 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:25:02.547462 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 28 08:25:02.547462 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 28 08:25:02.547462 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 28 08:25:02.547462 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 28 08:25:02.547462 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:25:02.547462 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:25:02.547462 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:25:02.547462 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:25:02.547462 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:25:02.547462 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:25:02.548613 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:25:02.548613 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application with Lock( Jul 28 08:25:02.548613 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:25:02.548613 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:25:02.548613 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:25:02.548613 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:25:02.548613 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:25:02.548613 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:25:02.548613 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:25:02.548613 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:25:02.548613 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 28 08:25:02.548613 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 08:25:02.548613 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 28 08:25:02.548613 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application Jul 28 08:25:02.548613 dv-cinder-851351-1-smb devstack@keystone.service[207601]: [pid: 207601|app: 0|req: 447/891] 10.222.0.42 () {56 vars in 1126 bytes} [Thu Jul 28 08:25:02 2022] GET /identity/v3/services/object-store => generated 93 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:25:02.550823 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d686ce0-3a6e-4200-8c4e-e81419102cb7 None admin] Authenticating user token {{(pid=207601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:25:02.682049 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d686ce0-3a6e-4200-8c4e-e81419102cb7 None admin] Validating token access rules against request {{(pid=207601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:25:02.698630 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG dbcounter [-] [207601] Writing DB stats keystone:SELECT=100 {{(pid=207601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:25:02.699809 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-128a20b3-5f31-4eeb-81c4-a8017827e732 None admin] Validating token access rules against request {{(pid=207600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:25:02.737665 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a14b7b-d37e-44b2-b857-ce18dac1f6e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:25:02.739576 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a14b7b-d37e-44b2-b857-ce18dac1f6e7 None admin] REQUEST_METHOD: `GET` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:25:02.741055 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a14b7b-d37e-44b2-b857-ce18dac1f6e7 None admin] SCRIPT_NAME: `/identity` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:25:02.743200 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a14b7b-d37e-44b2-b857-ce18dac1f6e7 None admin] PATH_INFO: `/v3/services` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:25:02.744451 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a14b7b-d37e-44b2-b857-ce18dac1f6e7 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=207601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:25:02.746191 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a14b7b-d37e-44b2-b857-ce18dac1f6e7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:25:02.748560 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a09832b3-a8f0-43be-b630-7316970ea2a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:25:02.749257 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09832b3-a8f0-43be-b630-7316970ea2a0 None admin] REQUEST_METHOD: `GET` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:25:02.749535 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09832b3-a8f0-43be-b630-7316970ea2a0 None admin] SCRIPT_NAME: `/identity` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:25:02.749868 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09832b3-a8f0-43be-b630-7316970ea2a0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:25:02.750530 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a14b7b-d37e-44b2-b857-ce18dac1f6e7 None admin] RBAC: Authorization granted {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:25:02.762438 dv-cinder-851351-1-smb devstack@keystone.service[207601]: [pid: 207601|app: 0|req: 448/892] 10.222.0.42 () {56 vars in 1114 bytes} [Thu Jul 28 08:25:02 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:25:02.763257 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a14b7b-d37e-44b2-b857-ce18dac1f6e7 None admin] Authenticating user token {{(pid=207601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:25:02.840625 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG dbcounter [-] [207600] Writing DB stats keystone:SELECT=100 {{(pid=207600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:25:02.851313 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a09832b3-a8f0-43be-b630-7316970ea2a0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:25:02.853490 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a09832b3-a8f0-43be-b630-7316970ea2a0 None admin] RBAC: Authorization granted {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:25:02.884502 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a14b7b-d37e-44b2-b857-ce18dac1f6e7 None admin] Validating token access rules against request {{(pid=207601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:25:02.932721 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9182cd20-63c7-4a73-8985-f2385b75f2c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:25:02.933715 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9182cd20-63c7-4a73-8985-f2385b75f2c4 None admin] REQUEST_METHOD: `GET` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:25:02.934163 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9182cd20-63c7-4a73-8985-f2385b75f2c4 None admin] SCRIPT_NAME: `/identity` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:25:02.934540 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9182cd20-63c7-4a73-8985-f2385b75f2c4 None admin] PATH_INFO: `/v3/services` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:25:02.936790 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9182cd20-63c7-4a73-8985-f2385b75f2c4 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=207601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:25:02.936790 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9182cd20-63c7-4a73-8985-f2385b75f2c4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:25:02.938531 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9182cd20-63c7-4a73-8985-f2385b75f2c4 None admin] RBAC: Authorization granted {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:25:02.952376 dv-cinder-851351-1-smb devstack@keystone.service[207601]: [pid: 207601|app: 0|req: 449/893] 10.222.0.42 () {56 vars in 1122 bytes} [Thu Jul 28 08:25:02 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:25:02.952376 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9182cd20-63c7-4a73-8985-f2385b75f2c4 None admin] Authenticating user token {{(pid=207601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:25:03.007656 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG dbcounter [-] [207601] Writing DB stats keystone:SELECT=100 {{(pid=207601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:25:03.014126 dv-cinder-851351-1-smb devstack@keystone.service[207600]: [pid: 207600|app: 0|req: 445/894] 10.222.0.42 () {58 vars in 1282 bytes} [Thu Jul 28 08:25:02 2022] GET /identity/v3/auth/tokens => generated 1362 bytes in 468 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 28 08:25:03.014957 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a09832b3-a8f0-43be-b630-7316970ea2a0 None admin] Authenticating user token {{(pid=207600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:25:03.095993 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9182cd20-63c7-4a73-8985-f2385b75f2c4 None admin] Validating token access rules against request {{(pid=207601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:25:03.141603 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG dbcounter [-] [207600] Writing DB stats keystone:SELECT=100 {{(pid=207600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:25:03.149365 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a09832b3-a8f0-43be-b630-7316970ea2a0 None admin] Validating token access rules against request {{(pid=207600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:25:03.150462 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b0b109-926c-4f44-ab1c-237b2aad7dd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:25:03.151150 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b0b109-926c-4f44-ab1c-237b2aad7dd4 None admin] REQUEST_METHOD: `GET` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:25:03.151543 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b0b109-926c-4f44-ab1c-237b2aad7dd4 None admin] SCRIPT_NAME: `/identity` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:25:03.153122 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b0b109-926c-4f44-ab1c-237b2aad7dd4 None admin] PATH_INFO: `/v3/endpoints` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:25:03.153268 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b0b109-926c-4f44-ab1c-237b2aad7dd4 None admin] RBAC: Adding query filter params (interface=public, service_id=d3139ed3d54b47af8da8381dbbf066e9, region_id=RegionOne) {{(pid=207601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:25:03.153746 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b0b109-926c-4f44-ab1c-237b2aad7dd4 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:25:03.155864 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b0b109-926c-4f44-ab1c-237b2aad7dd4 None admin] RBAC: Authorization granted {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:25:03.164934 dv-cinder-851351-1-smb devstack@keystone.service[207601]: [pid: 207601|app: 0|req: 450/895] 10.222.0.42 () {56 vars in 1251 bytes} [Thu Jul 28 08:25:02 2022] GET /identity/v3/endpoints?service_id=d3139ed3d54b47af8da8381dbbf066e9&interface=public®ion_id=RegionOne => generated 194 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:25:03.165893 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b0b109-926c-4f44-ab1c-237b2aad7dd4 None admin] Authenticating user token {{(pid=207601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:25:03.194508 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42178124-80f2-40f4-a08f-bda432d9d62a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:25:03.195148 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42178124-80f2-40f4-a08f-bda432d9d62a None admin] REQUEST_METHOD: `GET` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:25:03.195436 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42178124-80f2-40f4-a08f-bda432d9d62a None admin] SCRIPT_NAME: `/identity` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:25:03.195719 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42178124-80f2-40f4-a08f-bda432d9d62a None admin] PATH_INFO: `/v3/services` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:25:03.196493 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42178124-80f2-40f4-a08f-bda432d9d62a None admin] RBAC: Adding query filter params (type=object-store) {{(pid=207600) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:25:03.196848 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42178124-80f2-40f4-a08f-bda432d9d62a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:25:03.198263 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42178124-80f2-40f4-a08f-bda432d9d62a None admin] RBAC: Authorization granted {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:25:03.203832 dv-cinder-851351-1-smb devstack@keystone.service[207600]: [pid: 207600|app: 0|req: 446/896] 10.222.0.42 () {56 vars in 1122 bytes} [Thu Jul 28 08:25:03 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:25:03.204543 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42178124-80f2-40f4-a08f-bda432d9d62a None admin] Authenticating user token {{(pid=207600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:25:03.315544 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b0b109-926c-4f44-ab1c-237b2aad7dd4 None admin] Validating token access rules against request {{(pid=207601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:25:03.324374 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG dbcounter [-] [207601] Writing DB stats keystone:SELECT=100 {{(pid=207601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:25:03.361623 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2fb83f1-8659-4514-b3a0-4f9fb8e14dc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:25:03.362296 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2fb83f1-8659-4514-b3a0-4f9fb8e14dc8 None admin] REQUEST_METHOD: `GET` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:25:03.362584 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2fb83f1-8659-4514-b3a0-4f9fb8e14dc8 None admin] SCRIPT_NAME: `/identity` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:25:03.362863 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2fb83f1-8659-4514-b3a0-4f9fb8e14dc8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:25:03.369422 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42178124-80f2-40f4-a08f-bda432d9d62a None admin] Validating token access rules against request {{(pid=207600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:25:03.376545 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2fb83f1-8659-4514-b3a0-4f9fb8e14dc8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:25:03.378102 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2fb83f1-8659-4514-b3a0-4f9fb8e14dc8 None admin] RBAC: Authorization granted {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:25:03.398034 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application [None req-e2fb83f1-8659-4514-b3a0-4f9fb8e14dc8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 08:25:03.398034 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:25:03.398034 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:25:03.398034 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:25:03.398034 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:25:03.398034 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:25:03.398034 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:25:03.398034 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:25:03.398034 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:25:03.398034 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:25:03.398034 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:25:03.398034 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:25:03.398034 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 08:25:03.398034 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 08:25:03.398034 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 08:25:03.399369 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 08:25:03.399369 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:25:03.399369 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:25:03.399369 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:25:03.399369 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:25:03.399369 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:25:03.399369 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:25:03.399369 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:25:03.399369 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application with Lock( Jul 28 08:25:03.399369 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:25:03.399369 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:25:03.399369 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:25:03.399369 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:25:03.399369 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:25:03.399369 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:25:03.399369 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:25:03.399369 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:25:03.400572 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 08:25:03.400572 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 08:25:03.400572 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 08:25:03.400572 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application Jul 28 08:25:03.400572 dv-cinder-851351-1-smb devstack@keystone.service[207601]: [pid: 207601|app: 0|req: 451/897] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 08:25:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:25:03.406730 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2fb83f1-8659-4514-b3a0-4f9fb8e14dc8 None admin] Authenticating user token {{(pid=207601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:25:03.425142 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9cb488d-2ae2-464c-880d-e2ba72c88ee5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:25:03.426179 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9cb488d-2ae2-464c-880d-e2ba72c88ee5 None admin] REQUEST_METHOD: `GET` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:25:03.426742 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9cb488d-2ae2-464c-880d-e2ba72c88ee5 None admin] SCRIPT_NAME: `/identity` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:25:03.427256 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9cb488d-2ae2-464c-880d-e2ba72c88ee5 None admin] PATH_INFO: `/v3/services` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:25:03.428184 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9cb488d-2ae2-464c-880d-e2ba72c88ee5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:25:03.429994 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9cb488d-2ae2-464c-880d-e2ba72c88ee5 None admin] RBAC: Authorization granted {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:25:03.437469 dv-cinder-851351-1-smb devstack@keystone.service[207600]: [pid: 207600|app: 0|req: 447/898] 10.222.0.42 () {56 vars in 1087 bytes} [Thu Jul 28 08:25:03 2022] GET /identity/v3/services => generated 1268 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 08:25:03.552399 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2fb83f1-8659-4514-b3a0-4f9fb8e14dc8 None admin] Validating token access rules against request {{(pid=207601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:25:03.598478 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8938e0d3-8645-4310-8430-c00c38f1c277 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:25:03.599148 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8938e0d3-8645-4310-8430-c00c38f1c277 None admin] REQUEST_METHOD: `GET` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:25:03.599438 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8938e0d3-8645-4310-8430-c00c38f1c277 None admin] SCRIPT_NAME: `/identity` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:25:03.599744 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8938e0d3-8645-4310-8430-c00c38f1c277 None admin] PATH_INFO: `/v3/domains` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:25:03.600509 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8938e0d3-8645-4310-8430-c00c38f1c277 None admin] RBAC: Adding query filter params (name=Default) {{(pid=207601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:25:03.600880 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8938e0d3-8645-4310-8430-c00c38f1c277 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:25:03.602850 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8938e0d3-8645-4310-8430-c00c38f1c277 None admin] RBAC: Authorization granted {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:25:03.620725 dv-cinder-851351-1-smb devstack@keystone.service[207601]: [pid: 207601|app: 0|req: 452/899] 10.222.0.42 () {56 vars in 1109 bytes} [Thu Jul 28 08:25:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 08:25:03.627225 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9cb488d-2ae2-464c-880d-e2ba72c88ee5 None admin] Authenticating user token {{(pid=207600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:25:03.659025 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG dbcounter [-] [207600] Writing DB stats keystone:SELECT=100 {{(pid=207600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:25:03.747068 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9cb488d-2ae2-464c-880d-e2ba72c88ee5 None admin] Validating token access rules against request {{(pid=207600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:25:03.786203 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aafae65-ceee-4d45-ac36-36f201eb1331 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:25:03.787719 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aafae65-ceee-4d45-ac36-36f201eb1331 None admin] REQUEST_METHOD: `GET` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:25:03.788414 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aafae65-ceee-4d45-ac36-36f201eb1331 None admin] SCRIPT_NAME: `/identity` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:25:03.789070 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aafae65-ceee-4d45-ac36-36f201eb1331 None admin] PATH_INFO: `/v3/projects/service` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:25:03.798104 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aafae65-ceee-4d45-ac36-36f201eb1331 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:25:03.800071 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aafae65-ceee-4d45-ac36-36f201eb1331 None admin] RBAC: Authorization granted {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:25:03.812903 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application [None req-4aafae65-ceee-4d45-ac36-36f201eb1331 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 08:25:03.812903 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:25:03.812903 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:25:03.812903 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:25:03.812903 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:25:03.812903 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:25:03.812903 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:25:03.812903 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:25:03.812903 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:25:03.812903 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:25:03.812903 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:25:03.812903 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:25:03.812903 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 28 08:25:03.812903 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 28 08:25:03.812903 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 28 08:25:03.814018 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 28 08:25:03.814018 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:25:03.814018 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:25:03.814018 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:25:03.814018 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:25:03.814018 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:25:03.814018 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:25:03.814018 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:25:03.814018 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application with Lock( Jul 28 08:25:03.814018 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:25:03.814018 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:25:03.814018 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:25:03.814018 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:25:03.814018 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:25:03.814018 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:25:03.814018 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:25:03.814018 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:25:03.814970 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 28 08:25:03.814970 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 28 08:25:03.814970 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 28 08:25:03.814970 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 28 08:25:03.814970 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 28 08:25:03.814970 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 28 08:25:03.814970 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 08:25:03.814970 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application Jul 28 08:25:03.817623 dv-cinder-851351-1-smb devstack@keystone.service[207600]: [pid: 207600|app: 0|req: 448/900] 10.222.0.42 () {56 vars in 1111 bytes} [Thu Jul 28 08:25:03 2022] GET /identity/v3/projects/service => generated 88 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:25:03.823813 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8938e0d3-8645-4310-8430-c00c38f1c277 None admin] Authenticating user token {{(pid=207601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:25:03.846579 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG dbcounter [-] [207601] Writing DB stats keystone:SELECT=100 {{(pid=207601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:25:03.970146 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8938e0d3-8645-4310-8430-c00c38f1c277 None admin] Validating token access rules against request {{(pid=207601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:25:04.016381 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-865f2bf9-058a-423a-8981-3acb0554f5b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:25:04.017076 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865f2bf9-058a-423a-8981-3acb0554f5b5 None admin] REQUEST_METHOD: `GET` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:25:04.017418 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865f2bf9-058a-423a-8981-3acb0554f5b5 None admin] SCRIPT_NAME: `/identity` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:25:04.017704 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865f2bf9-058a-423a-8981-3acb0554f5b5 None admin] PATH_INFO: `/v3/projects` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:25:04.018684 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-865f2bf9-058a-423a-8981-3acb0554f5b5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=207601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:25:04.019071 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-865f2bf9-058a-423a-8981-3acb0554f5b5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:25:04.020979 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-865f2bf9-058a-423a-8981-3acb0554f5b5 None admin] RBAC: Authorization granted {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:25:04.036417 dv-cinder-851351-1-smb devstack@keystone.service[207601]: [pid: 207601|app: 0|req: 453/901] 10.222.0.42 () {56 vars in 1148 bytes} [Thu Jul 28 08:25:03 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:25:04.042752 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aafae65-ceee-4d45-ac36-36f201eb1331 None admin] Authenticating user token {{(pid=207600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:25:04.134524 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG dbcounter [-] [207600] Writing DB stats keystone:SELECT=100 {{(pid=207600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:25:04.155090 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aafae65-ceee-4d45-ac36-36f201eb1331 None admin] Validating token access rules against request {{(pid=207600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:25:04.193329 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9889076a-1689-4f7a-8c74-64d916445726 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:25:04.194350 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9889076a-1689-4f7a-8c74-64d916445726 None admin] REQUEST_METHOD: `GET` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:25:04.194838 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9889076a-1689-4f7a-8c74-64d916445726 None admin] SCRIPT_NAME: `/identity` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:25:04.195345 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9889076a-1689-4f7a-8c74-64d916445726 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:25:04.196399 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9889076a-1689-4f7a-8c74-64d916445726 None admin] RBAC: Adding query filter params (role.id=a67e4d87d7f74c65a98b947bd4f6c11d, scope.project.id=48c5f2b2ae2b48758b957d2b194a7fd1, user.id=601010c3acdf446bb37ff23cbed0dcf1) {{(pid=207600) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:25:04.197019 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9889076a-1689-4f7a-8c74-64d916445726 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:25:04.198791 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9889076a-1689-4f7a-8c74-64d916445726 None admin] RBAC: Authorization granted {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:25:04.205820 dv-cinder-851351-1-smb devstack@keystone.service[207600]: [pid: 207600|app: 0|req: 449/902] 10.222.0.42 () {56 vars in 1374 bytes} [Thu Jul 28 08:25:04 2022] GET /identity/v3/role_assignments?user.id=601010c3acdf446bb37ff23cbed0dcf1&scope.project.id=48c5f2b2ae2b48758b957d2b194a7fd1&role.id=a67e4d87d7f74c65a98b947bd4f6c11d => generated 259 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:25:04.734915 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4cd3af-2b05-44ca-8c70-e770954d6c3c None None] REQUEST_METHOD: `GET` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:25:04.735472 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4cd3af-2b05-44ca-8c70-e770954d6c3c None None] SCRIPT_NAME: `/identity` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:25:04.735472 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4cd3af-2b05-44ca-8c70-e770954d6c3c None None] PATH_INFO: `/` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:25:04.737096 dv-cinder-851351-1-smb devstack@keystone.service[207601]: [pid: 207601|app: 0|req: 454/903] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 08:25:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 08:25:04.742717 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a3ff12-da86-48ec-a6af-d6cb00eae2b0 None None] REQUEST_METHOD: `POST` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:25:04.743077 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a3ff12-da86-48ec-a6af-d6cb00eae2b0 None None] SCRIPT_NAME: `/identity` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:25:04.743336 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a3ff12-da86-48ec-a6af-d6cb00eae2b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:25:04.762493 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.auth.core [None req-13a3ff12-da86-48ec-a6af-d6cb00eae2b0 None None] MFA Rules not processed for user `b8110ade874c4aa7af27f5c376df700a`. Rule list: `[]` (Enabled: `True`). {{(pid=207600) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 08:25:04.763829 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.fernet_utils [None req-13a3ff12-da86-48ec-a6af-d6cb00eae2b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=207600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:25:04.835106 dv-cinder-851351-1-smb devstack@keystone.service[207600]: [pid: 207600|app: 0|req: 450/904] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 08:25:04 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 08:25:04.857675 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4cd3af-2b05-44ca-8c70-e770954d6c3c None None] Authenticating user token {{(pid=207601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:25:04.953318 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG dbcounter [-] [207601] Writing DB stats keystone:SELECT=100 {{(pid=207601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:25:04.978580 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4cd3af-2b05-44ca-8c70-e770954d6c3c None None] Validating token access rules against request {{(pid=207601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:25:05.015483 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e00c5d-e552-4cc7-8b88-59c9e67b7272 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:25:05.016062 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e00c5d-e552-4cc7-8b88-59c9e67b7272 None admin] REQUEST_METHOD: `GET` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:25:05.016348 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e00c5d-e552-4cc7-8b88-59c9e67b7272 None admin] SCRIPT_NAME: `/identity` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:25:05.016622 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e00c5d-e552-4cc7-8b88-59c9e67b7272 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:25:05.017288 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00e00c5d-e552-4cc7-8b88-59c9e67b7272 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:25:05.018735 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00e00c5d-e552-4cc7-8b88-59c9e67b7272 None admin] RBAC: Authorization granted {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:25:05.028041 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application [None req-00e00c5d-e552-4cc7-8b88-59c9e67b7272 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 28 08:25:05.028041 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:25:05.028041 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 28 08:25:05.028041 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 28 08:25:05.028041 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 28 08:25:05.028041 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 28 08:25:05.028041 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 28 08:25:05.028041 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 08:25:05.028041 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 28 08:25:05.028041 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application Jul 28 08:25:05.028041 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 28 08:25:05.028041 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application Jul 28 08:25:05.028041 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:25:05.028041 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:25:05.028041 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:25:05.028041 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:25:05.029108 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:25:05.029108 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:25:05.029108 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:25:05.029108 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:25:05.029108 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:25:05.029108 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:25:05.029108 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:25:05.029108 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 28 08:25:05.029108 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 28 08:25:05.029108 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 28 08:25:05.029108 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 28 08:25:05.029108 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:25:05.029108 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:25:05.029108 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:25:05.029108 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:25:05.029108 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:25:05.030022 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:25:05.030022 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:25:05.030022 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application with Lock( Jul 28 08:25:05.030022 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:25:05.030022 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:25:05.030022 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:25:05.030022 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:25:05.030022 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:25:05.030022 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:25:05.030022 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:25:05.030022 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:25:05.030022 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 28 08:25:05.030022 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 08:25:05.030022 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 28 08:25:05.030022 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application Jul 28 08:25:05.030022 dv-cinder-851351-1-smb devstack@keystone.service[207601]: [pid: 207601|app: 0|req: 455/905] 10.222.0.42 () {56 vars in 1132 bytes} [Thu Jul 28 08:25:04 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:25:05.035680 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a3ff12-da86-48ec-a6af-d6cb00eae2b0 None None] Authenticating user token {{(pid=207600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:25:05.129730 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG dbcounter [-] [207600] Writing DB stats keystone:SELECT=100 {{(pid=207600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:25:05.159883 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a3ff12-da86-48ec-a6af-d6cb00eae2b0 None None] Validating token access rules against request {{(pid=207600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:25:05.195507 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd68996c-6ea5-4bdd-b855-c372121390ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:25:05.196179 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd68996c-6ea5-4bdd-b855-c372121390ed None admin] REQUEST_METHOD: `GET` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:25:05.196465 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd68996c-6ea5-4bdd-b855-c372121390ed None admin] SCRIPT_NAME: `/identity` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:25:05.196825 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd68996c-6ea5-4bdd-b855-c372121390ed None admin] PATH_INFO: `/v3/services` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:25:05.197529 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd68996c-6ea5-4bdd-b855-c372121390ed None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=207600) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:25:05.197837 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd68996c-6ea5-4bdd-b855-c372121390ed None admin] RBAC: Authorizing `identity:list_services()` {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:25:05.199240 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd68996c-6ea5-4bdd-b855-c372121390ed None admin] RBAC: Authorization granted {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:25:05.204875 dv-cinder-851351-1-smb devstack@keystone.service[207600]: [pid: 207600|app: 0|req: 451/906] 10.222.0.42 () {56 vars in 1126 bytes} [Thu Jul 28 08:25:05 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:25:05.210597 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e00c5d-e552-4cc7-8b88-59c9e67b7272 None admin] Authenticating user token {{(pid=207601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:25:05.317993 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e00c5d-e552-4cc7-8b88-59c9e67b7272 None admin] Validating token access rules against request {{(pid=207601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:25:05.354396 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb1a04e-2c4f-414a-8b0e-65fd1d6a145a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:25:05.355480 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb1a04e-2c4f-414a-8b0e-65fd1d6a145a None admin] REQUEST_METHOD: `GET` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:25:05.355971 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb1a04e-2c4f-414a-8b0e-65fd1d6a145a None admin] SCRIPT_NAME: `/identity` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:25:05.356465 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb1a04e-2c4f-414a-8b0e-65fd1d6a145a None admin] PATH_INFO: `/v3/services` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:25:05.357394 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdb1a04e-2c4f-414a-8b0e-65fd1d6a145a None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=207601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:25:05.357914 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdb1a04e-2c4f-414a-8b0e-65fd1d6a145a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:25:05.359536 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdb1a04e-2c4f-414a-8b0e-65fd1d6a145a None admin] RBAC: Authorization granted {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:25:05.365943 dv-cinder-851351-1-smb devstack@keystone.service[207601]: [pid: 207601|app: 0|req: 456/907] 10.222.0.42 () {56 vars in 1126 bytes} [Thu Jul 28 08:25:05 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:25:05.372493 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd68996c-6ea5-4bdd-b855-c372121390ed None admin] Authenticating user token {{(pid=207600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:25:05.414283 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a265c564-5603-4398-b48d-c303a86741b6 None None] REQUEST_METHOD: `GET` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:25:05.414618 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a265c564-5603-4398-b48d-c303a86741b6 None None] SCRIPT_NAME: `/identity` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:25:05.414934 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a265c564-5603-4398-b48d-c303a86741b6 None None] PATH_INFO: `/` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:25:05.416633 dv-cinder-851351-1-smb devstack@keystone.service[207601]: [pid: 207601|app: 0|req: 457/908] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 08:25:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 28 08:25:05.422725 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9636afc-a8a9-4711-8815-89d7f2ff9114 None None] REQUEST_METHOD: `POST` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:25:05.422725 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9636afc-a8a9-4711-8815-89d7f2ff9114 None None] SCRIPT_NAME: `/identity` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:25:05.422725 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9636afc-a8a9-4711-8815-89d7f2ff9114 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:25:05.437115 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG dbcounter [-] [207601] Writing DB stats keystone:SELECT=100 {{(pid=207601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:25:05.443540 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.auth.core [None req-d9636afc-a8a9-4711-8815-89d7f2ff9114 None None] MFA Rules not processed for user `b8110ade874c4aa7af27f5c376df700a`. Rule list: `[]` (Enabled: `True`). {{(pid=207601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 08:25:05.448329 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.fernet_utils [None req-d9636afc-a8a9-4711-8815-89d7f2ff9114 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=207601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:25:05.500365 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd68996c-6ea5-4bdd-b855-c372121390ed None admin] Validating token access rules against request {{(pid=207600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:25:05.548760 dv-cinder-851351-1-smb devstack@keystone.service[207601]: [pid: 207601|app: 0|req: 458/909] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 08:25:05 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 28 08:25:05.559858 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99950500-afd9-4839-abef-13b63831efa1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:25:05.560796 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99950500-afd9-4839-abef-13b63831efa1 None admin] REQUEST_METHOD: `GET` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:25:05.561284 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99950500-afd9-4839-abef-13b63831efa1 None admin] SCRIPT_NAME: `/identity` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:25:05.561773 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99950500-afd9-4839-abef-13b63831efa1 None admin] PATH_INFO: `/v3/endpoints` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:25:05.562831 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99950500-afd9-4839-abef-13b63831efa1 None admin] RBAC: Adding query filter params (interface=public, service_id=36ab5fc2b8754c9dade32765e3b14915, region_id=RegionOne) {{(pid=207600) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:25:05.563341 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99950500-afd9-4839-abef-13b63831efa1 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:25:05.564959 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99950500-afd9-4839-abef-13b63831efa1 None admin] RBAC: Authorization granted {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:25:05.570408 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9636afc-a8a9-4711-8815-89d7f2ff9114 None None] Authenticating user token {{(pid=207601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:25:05.571283 dv-cinder-851351-1-smb devstack@keystone.service[207600]: [pid: 207600|app: 0|req: 452/910] 10.222.0.42 () {56 vars in 1251 bytes} [Thu Jul 28 08:25:05 2022] GET /identity/v3/endpoints?service_id=36ab5fc2b8754c9dade32765e3b14915&interface=public®ion_id=RegionOne => generated 194 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:25:05.576328 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99950500-afd9-4839-abef-13b63831efa1 None admin] Authenticating user token {{(pid=207600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:25:05.581834 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG dbcounter [-] [207600] Writing DB stats keystone:SELECT=100 {{(pid=207600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:25:05.683441 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99950500-afd9-4839-abef-13b63831efa1 None admin] Validating token access rules against request {{(pid=207600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:25:05.690590 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9636afc-a8a9-4711-8815-89d7f2ff9114 None None] Validating token access rules against request {{(pid=207601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:25:05.723440 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887cac7d-b937-40de-be16-3e4cd0c3a6eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:25:05.724084 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887cac7d-b937-40de-be16-3e4cd0c3a6eb None admin] REQUEST_METHOD: `GET` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:25:05.724377 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887cac7d-b937-40de-be16-3e4cd0c3a6eb None admin] SCRIPT_NAME: `/identity` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:25:05.724655 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887cac7d-b937-40de-be16-3e4cd0c3a6eb None admin] PATH_INFO: `/v3/services` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:25:05.725370 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-887cac7d-b937-40de-be16-3e4cd0c3a6eb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:25:05.726764 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-887cac7d-b937-40de-be16-3e4cd0c3a6eb None admin] RBAC: Authorization granted {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:25:05.730544 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b70eb8a7-53b7-4d11-976f-556a5e74b777 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:25:05.731215 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70eb8a7-53b7-4d11-976f-556a5e74b777 None admin] REQUEST_METHOD: `POST` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:25:05.731470 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70eb8a7-53b7-4d11-976f-556a5e74b777 None admin] SCRIPT_NAME: `/identity` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:25:05.731745 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70eb8a7-53b7-4d11-976f-556a5e74b777 None admin] PATH_INFO: `/v3/services` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:25:05.732453 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b70eb8a7-53b7-4d11-976f-556a5e74b777 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:25:05.733864 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b70eb8a7-53b7-4d11-976f-556a5e74b777 None admin] RBAC: Authorization granted {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:25:05.740941 dv-cinder-851351-1-smb devstack@keystone.service[207600]: [pid: 207600|app: 0|req: 453/911] 10.222.0.42 () {56 vars in 1087 bytes} [Thu Jul 28 08:25:05 2022] GET /identity/v3/services => generated 1268 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 08:25:05.740941 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f938def-5c1d-459f-aa0a-8691792f61db None None] REQUEST_METHOD: `GET` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:25:05.740941 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f938def-5c1d-459f-aa0a-8691792f61db None None] SCRIPT_NAME: `/identity` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:25:05.740941 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f938def-5c1d-459f-aa0a-8691792f61db None None] PATH_INFO: `/` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:25:05.740941 dv-cinder-851351-1-smb devstack@keystone.service[207600]: [pid: 207600|app: 0|req: 454/912] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 08:25:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 08:25:05.746481 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6c09d2-f1e3-48df-929b-e324362f6bfa None None] REQUEST_METHOD: `POST` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:25:05.746951 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6c09d2-f1e3-48df-929b-e324362f6bfa None None] SCRIPT_NAME: `/identity` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:25:05.747393 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6c09d2-f1e3-48df-929b-e324362f6bfa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:25:05.747606 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG dbcounter [-] [207601] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=207601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:25:05.769384 dv-cinder-851351-1-smb devstack@keystone.service[207601]: [pid: 207601|app: 0|req: 459/913] 10.222.0.42 () {60 vars in 1141 bytes} [Thu Jul 28 08:25:05 2022] POST /identity/v3/services => generated 241 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 28 08:25:05.777971 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.auth.core [None req-ae6c09d2-f1e3-48df-929b-e324362f6bfa None None] MFA Rules not processed for user `b8110ade874c4aa7af27f5c376df700a`. Rule list: `[]` (Enabled: `True`). {{(pid=207600) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 08:25:05.780193 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.fernet_utils [None req-ae6c09d2-f1e3-48df-929b-e324362f6bfa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=207600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:25:05.864873 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG dbcounter [-] [207600] Writing DB stats keystone:SELECT=100 {{(pid=207600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:25:05.886799 dv-cinder-851351-1-smb devstack@keystone.service[207600]: [pid: 207600|app: 0|req: 455/914] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 08:25:05 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 08:25:05.915949 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b70eb8a7-53b7-4d11-976f-556a5e74b777 None admin] Authenticating user token {{(pid=207601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:25:06.040713 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b70eb8a7-53b7-4d11-976f-556a5e74b777 None admin] Validating token access rules against request {{(pid=207601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:25:06.079170 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-775344e7-2df7-466f-944b-2363b9ff1d6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:25:06.080361 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775344e7-2df7-466f-944b-2363b9ff1d6f None admin] REQUEST_METHOD: `GET` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:25:06.080887 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775344e7-2df7-466f-944b-2363b9ff1d6f None admin] SCRIPT_NAME: `/identity` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:25:06.081495 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775344e7-2df7-466f-944b-2363b9ff1d6f None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:25:06.082359 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-775344e7-2df7-466f-944b-2363b9ff1d6f None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:25:06.083972 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-775344e7-2df7-466f-944b-2363b9ff1d6f None admin] RBAC: Authorization granted {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:25:06.094705 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application [None req-775344e7-2df7-466f-944b-2363b9ff1d6f None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 28 08:25:06.094705 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:25:06.094705 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 28 08:25:06.094705 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 28 08:25:06.094705 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 28 08:25:06.094705 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 28 08:25:06.094705 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 28 08:25:06.094705 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 08:25:06.094705 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 28 08:25:06.094705 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application Jul 28 08:25:06.094705 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 28 08:25:06.094705 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application Jul 28 08:25:06.094705 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:25:06.094705 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:25:06.094705 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:25:06.094705 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:25:06.094705 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:25:06.095942 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:25:06.095942 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:25:06.095942 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:25:06.095942 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:25:06.095942 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:25:06.095942 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:25:06.095942 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 28 08:25:06.095942 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 28 08:25:06.095942 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 28 08:25:06.095942 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 28 08:25:06.095942 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:25:06.095942 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:25:06.095942 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:25:06.095942 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:25:06.095942 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:25:06.095942 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:25:06.096945 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:25:06.096945 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application with Lock( Jul 28 08:25:06.096945 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:25:06.096945 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:25:06.096945 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:25:06.096945 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:25:06.096945 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:25:06.096945 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:25:06.096945 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:25:06.096945 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:25:06.096945 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 28 08:25:06.096945 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 08:25:06.096945 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 28 08:25:06.096945 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application Jul 28 08:25:06.099730 dv-cinder-851351-1-smb devstack@keystone.service[207601]: [pid: 207601|app: 0|req: 460/915] 10.222.0.42 () {56 vars in 1114 bytes} [Thu Jul 28 08:25:05 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:25:06.106587 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6c09d2-f1e3-48df-929b-e324362f6bfa None None] Authenticating user token {{(pid=207600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:25:06.218427 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6c09d2-f1e3-48df-929b-e324362f6bfa None None] Validating token access rules against request {{(pid=207600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:25:06.257007 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-290eca66-41f3-4ebf-9e73-1ba4a0c3650f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:25:06.258081 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290eca66-41f3-4ebf-9e73-1ba4a0c3650f None admin] REQUEST_METHOD: `GET` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:25:06.258675 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290eca66-41f3-4ebf-9e73-1ba4a0c3650f None admin] SCRIPT_NAME: `/identity` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:25:06.259162 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290eca66-41f3-4ebf-9e73-1ba4a0c3650f None admin] PATH_INFO: `/v3/services` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:25:06.260084 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-290eca66-41f3-4ebf-9e73-1ba4a0c3650f None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=207600) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:25:06.260637 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-290eca66-41f3-4ebf-9e73-1ba4a0c3650f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:25:06.262301 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-290eca66-41f3-4ebf-9e73-1ba4a0c3650f None admin] RBAC: Authorization granted {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:25:06.268399 dv-cinder-851351-1-smb devstack@keystone.service[207600]: [pid: 207600|app: 0|req: 456/916] 10.222.0.42 () {56 vars in 1114 bytes} [Thu Jul 28 08:25:06 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:25:06.274748 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-775344e7-2df7-466f-944b-2363b9ff1d6f None admin] Authenticating user token {{(pid=207601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:25:06.324428 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6dd9b29-ad7b-4cf9-8c1d-2de25e09b96a None None] REQUEST_METHOD: `GET` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:25:06.325102 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6dd9b29-ad7b-4cf9-8c1d-2de25e09b96a None None] SCRIPT_NAME: `/identity` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:25:06.325604 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6dd9b29-ad7b-4cf9-8c1d-2de25e09b96a None None] PATH_INFO: `/` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:25:06.327501 dv-cinder-851351-1-smb devstack@keystone.service[207600]: [pid: 207600|app: 0|req: 457/917] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 08:25:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 08:25:06.334306 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb0b6fa-9a81-480a-87f8-680284d14c0d None None] REQUEST_METHOD: `POST` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:25:06.334622 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb0b6fa-9a81-480a-87f8-680284d14c0d None None] SCRIPT_NAME: `/identity` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:25:06.334863 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb0b6fa-9a81-480a-87f8-680284d14c0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:25:06.347878 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG dbcounter [-] [207601] Writing DB stats keystone:SELECT=100 {{(pid=207601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:25:06.363558 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.auth.core [None req-1bb0b6fa-9a81-480a-87f8-680284d14c0d None None] MFA Rules not processed for user `b8110ade874c4aa7af27f5c376df700a`. Rule list: `[]` (Enabled: `True`). {{(pid=207600) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 08:25:06.364843 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.fernet_utils [None req-1bb0b6fa-9a81-480a-87f8-680284d14c0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=207600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:25:06.396753 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-775344e7-2df7-466f-944b-2363b9ff1d6f None admin] Validating token access rules against request {{(pid=207601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:25:06.434362 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ecf43e-9838-4969-ba2a-b03861022548 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:25:06.435434 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ecf43e-9838-4969-ba2a-b03861022548 None admin] REQUEST_METHOD: `GET` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:25:06.435928 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ecf43e-9838-4969-ba2a-b03861022548 None admin] SCRIPT_NAME: `/identity` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:25:06.436409 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ecf43e-9838-4969-ba2a-b03861022548 None admin] PATH_INFO: `/v3/services` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:25:06.437035 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG dbcounter [-] [207600] Writing DB stats keystone:SELECT=100 {{(pid=207600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:25:06.437575 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29ecf43e-9838-4969-ba2a-b03861022548 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=207601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:25:06.438095 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29ecf43e-9838-4969-ba2a-b03861022548 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:25:06.439686 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29ecf43e-9838-4969-ba2a-b03861022548 None admin] RBAC: Authorization granted {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:25:06.448937 dv-cinder-851351-1-smb devstack@keystone.service[207601]: [pid: 207601|app: 0|req: 461/918] 10.222.0.42 () {56 vars in 1114 bytes} [Thu Jul 28 08:25:06 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:25:06.451333 dv-cinder-851351-1-smb devstack@keystone.service[207600]: [pid: 207600|app: 0|req: 458/919] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 08:25:06 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 28 08:25:06.452656 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ecf43e-9838-4969-ba2a-b03861022548 None admin] Authenticating user token {{(pid=207601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:25:06.481445 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb0b6fa-9a81-480a-87f8-680284d14c0d None None] Authenticating user token {{(pid=207600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:25:06.572808 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ecf43e-9838-4969-ba2a-b03861022548 None admin] Validating token access rules against request {{(pid=207601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:25:06.607765 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG dbcounter [-] [207601] Writing DB stats keystone:SELECT=100 {{(pid=207601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:25:06.608795 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb0b6fa-9a81-480a-87f8-680284d14c0d None None] Validating token access rules against request {{(pid=207600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:25:06.627683 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9317f4-bd09-4b0b-9a33-f7d22dbeadad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:25:06.628338 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9317f4-bd09-4b0b-9a33-f7d22dbeadad None admin] REQUEST_METHOD: `POST` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:25:06.628626 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9317f4-bd09-4b0b-9a33-f7d22dbeadad None admin] SCRIPT_NAME: `/identity` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:25:06.628937 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9317f4-bd09-4b0b-9a33-f7d22dbeadad None admin] PATH_INFO: `/v3/endpoints` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:25:06.629942 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe9317f4-bd09-4b0b-9a33-f7d22dbeadad None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:25:06.631755 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe9317f4-bd09-4b0b-9a33-f7d22dbeadad None admin] RBAC: Authorization granted {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:25:06.648822 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d9f20bf-c442-43db-8589-1a44fdb00c95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:25:06.649932 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9f20bf-c442-43db-8589-1a44fdb00c95 None admin] REQUEST_METHOD: `GET` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:25:06.650319 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9f20bf-c442-43db-8589-1a44fdb00c95 None admin] SCRIPT_NAME: `/identity` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:25:06.650691 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9f20bf-c442-43db-8589-1a44fdb00c95 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:25:06.661336 dv-cinder-851351-1-smb devstack@keystone.service[207601]: [pid: 207601|app: 0|req: 462/920] 10.222.0.42 () {60 vars in 1144 bytes} [Thu Jul 28 08:25:06 2022] POST /identity/v3/endpoints => generated 346 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 08:25:06.674661 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d9f20bf-c442-43db-8589-1a44fdb00c95 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 08:25:06.681724 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application [None req-7d9f20bf-c442-43db-8589-1a44fdb00c95 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 28 08:25:06.681724 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:25:06.681724 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:25:06.681724 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:25:06.681724 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:25:06.681724 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:25:06.681724 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:25:06.681724 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:25:06.681724 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:25:06.681724 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:25:06.681724 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:25:06.681724 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:25:06.681724 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 08:25:06.681724 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 08:25:06.681724 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 08:25:06.681724 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 08:25:06.682853 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 08:25:06.682853 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 08:25:06.682853 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 08:25:06.682853 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 08:25:06.682853 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:25:06.682853 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:25:06.682853 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:25:06.682853 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:25:06.682853 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:25:06.682853 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:25:06.682853 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:25:06.682853 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application with Lock( Jul 28 08:25:06.682853 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:25:06.682853 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:25:06.682853 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:25:06.682853 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:25:06.683811 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:25:06.683811 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:25:06.683811 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:25:06.683811 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:25:06.683811 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 08:25:06.683811 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 08:25:06.683811 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 08:25:06.683811 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 08:25:06.683811 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 08:25:06.683811 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 08:25:06.683811 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 28 08:25:06.683811 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application Jul 28 08:25:06.687273 dv-cinder-851351-1-smb devstack@keystone.service[207600]: [pid: 207600|app: 0|req: 459/921] 10.222.0.42 () {56 vars in 1120 bytes} [Thu Jul 28 08:25:06 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:25:06.693949 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9317f4-bd09-4b0b-9a33-f7d22dbeadad None admin] Authenticating user token {{(pid=207601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:25:06.823384 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9317f4-bd09-4b0b-9a33-f7d22dbeadad None admin] Validating token access rules against request {{(pid=207601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:25:06.859979 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7fc6fa-493c-4fd1-9170-d1e7140e6b98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:25:06.860626 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7fc6fa-493c-4fd1-9170-d1e7140e6b98 None admin] REQUEST_METHOD: `GET` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:25:06.860943 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7fc6fa-493c-4fd1-9170-d1e7140e6b98 None admin] SCRIPT_NAME: `/identity` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:25:06.861222 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7fc6fa-493c-4fd1-9170-d1e7140e6b98 None admin] PATH_INFO: `/v3/roles` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:25:06.861965 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d7fc6fa-493c-4fd1-9170-d1e7140e6b98 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=207601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:25:06.862276 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d7fc6fa-493c-4fd1-9170-d1e7140e6b98 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:25:06.863753 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d7fc6fa-493c-4fd1-9170-d1e7140e6b98 None admin] RBAC: Authorization granted {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:25:06.872872 dv-cinder-851351-1-smb devstack@keystone.service[207601]: [pid: 207601|app: 0|req: 463/922] 10.222.0.42 () {56 vars in 1115 bytes} [Thu Jul 28 08:25:06 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:25:06.878615 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d9f20bf-c442-43db-8589-1a44fdb00c95 None admin] Authenticating user token {{(pid=207600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:25:06.946650 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG dbcounter [-] [207600] Writing DB stats keystone:SELECT=100 {{(pid=207600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:25:07.001900 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d9f20bf-c442-43db-8589-1a44fdb00c95 None admin] Validating token access rules against request {{(pid=207600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:25:07.041615 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa5b91d-4c29-4cba-a1fb-b8efe00400c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:25:07.042294 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa5b91d-4c29-4cba-a1fb-b8efe00400c2 None admin] REQUEST_METHOD: `GET` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:25:07.042580 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa5b91d-4c29-4cba-a1fb-b8efe00400c2 None admin] SCRIPT_NAME: `/identity` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:25:07.042856 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa5b91d-4c29-4cba-a1fb-b8efe00400c2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:25:07.054234 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efa5b91d-4c29-4cba-a1fb-b8efe00400c2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:25:07.055788 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efa5b91d-4c29-4cba-a1fb-b8efe00400c2 None admin] RBAC: Authorization granted {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:25:07.071583 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application [None req-efa5b91d-4c29-4cba-a1fb-b8efe00400c2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 08:25:07.071583 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:25:07.071583 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:25:07.071583 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:25:07.071583 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:25:07.071583 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:25:07.071583 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:25:07.071583 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:25:07.071583 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:25:07.071583 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:25:07.071583 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:25:07.071583 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:25:07.071583 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 08:25:07.071583 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 08:25:07.071583 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 08:25:07.072853 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 08:25:07.072853 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:25:07.072853 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:25:07.072853 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:25:07.072853 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:25:07.072853 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:25:07.072853 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:25:07.072853 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:25:07.072853 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application with Lock( Jul 28 08:25:07.072853 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:25:07.072853 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:25:07.072853 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:25:07.072853 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:25:07.072853 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:25:07.072853 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:25:07.072853 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:25:07.072853 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:25:07.073988 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 08:25:07.073988 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 08:25:07.073988 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 08:25:07.073988 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application Jul 28 08:25:07.073988 dv-cinder-851351-1-smb devstack@keystone.service[207600]: [pid: 207600|app: 0|req: 460/923] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 08:25:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:25:07.080425 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7fc6fa-493c-4fd1-9170-d1e7140e6b98 None admin] Authenticating user token {{(pid=207601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:25:07.127362 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG dbcounter [-] [207601] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=207601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:25:07.197496 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7fc6fa-493c-4fd1-9170-d1e7140e6b98 None admin] Validating token access rules against request {{(pid=207601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:25:07.234219 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca4814d-1003-4669-998d-5eca086ebc25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:25:07.235154 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca4814d-1003-4669-998d-5eca086ebc25 None admin] REQUEST_METHOD: `GET` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:25:07.235606 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca4814d-1003-4669-998d-5eca086ebc25 None admin] SCRIPT_NAME: `/identity` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:25:07.236045 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca4814d-1003-4669-998d-5eca086ebc25 None admin] PATH_INFO: `/v3/domains` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:25:07.236930 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca4814d-1003-4669-998d-5eca086ebc25 None admin] RBAC: Adding query filter params (name=Default) {{(pid=207601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:25:07.237406 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca4814d-1003-4669-998d-5eca086ebc25 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:25:07.238962 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca4814d-1003-4669-998d-5eca086ebc25 None admin] RBAC: Authorization granted {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:25:07.252995 dv-cinder-851351-1-smb devstack@keystone.service[207601]: [pid: 207601|app: 0|req: 464/924] 10.222.0.42 () {56 vars in 1109 bytes} [Thu Jul 28 08:25:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:25:07.259965 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa5b91d-4c29-4cba-a1fb-b8efe00400c2 None admin] Authenticating user token {{(pid=207600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:25:07.364827 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG dbcounter [-] [207600] Writing DB stats keystone:SELECT=100 {{(pid=207600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:25:07.369217 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa5b91d-4c29-4cba-a1fb-b8efe00400c2 None admin] Validating token access rules against request {{(pid=207600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:25:07.407030 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0bbac0-c371-408f-b66a-cfea56add68f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:25:07.407696 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0bbac0-c371-408f-b66a-cfea56add68f None admin] REQUEST_METHOD: `GET` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:25:07.407981 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0bbac0-c371-408f-b66a-cfea56add68f None admin] SCRIPT_NAME: `/identity` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:25:07.408344 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0bbac0-c371-408f-b66a-cfea56add68f None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:25:07.417142 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c0bbac0-c371-408f-b66a-cfea56add68f None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:25:07.418639 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c0bbac0-c371-408f-b66a-cfea56add68f None admin] RBAC: Authorization granted {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:25:07.431565 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application [None req-2c0bbac0-c371-408f-b66a-cfea56add68f None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 28 08:25:07.431565 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:25:07.431565 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:25:07.431565 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:25:07.431565 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:25:07.431565 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:25:07.431565 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:25:07.431565 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:25:07.431565 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:25:07.431565 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:25:07.431565 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:25:07.431565 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:25:07.431565 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 28 08:25:07.431565 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 28 08:25:07.431565 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 28 08:25:07.431565 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 28 08:25:07.432776 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:25:07.432776 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:25:07.432776 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 28 08:25:07.432776 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 08:25:07.432776 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 28 08:25:07.432776 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 08:25:07.432776 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:25:07.432776 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:25:07.432776 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:25:07.432776 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:25:07.432776 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:25:07.432776 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application with Lock( Jul 28 08:25:07.432776 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:25:07.432776 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:25:07.432776 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:25:07.432776 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:25:07.432776 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:25:07.432776 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:25:07.433805 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:25:07.433805 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:25:07.433805 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 28 08:25:07.433805 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 28 08:25:07.433805 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 28 08:25:07.433805 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 28 08:25:07.433805 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 28 08:25:07.433805 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 28 08:25:07.433805 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 28 08:25:07.433805 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application Jul 28 08:25:07.433805 dv-cinder-851351-1-smb devstack@keystone.service[207600]: [pid: 207600|app: 0|req: 461/925] 10.222.0.42 () {56 vars in 1117 bytes} [Thu Jul 28 08:25:07 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:25:07.440963 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca4814d-1003-4669-998d-5eca086ebc25 None admin] Authenticating user token {{(pid=207601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:25:07.552524 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG dbcounter [-] [207601] Writing DB stats keystone:SELECT=100 {{(pid=207601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:25:07.557305 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca4814d-1003-4669-998d-5eca086ebc25 None admin] Validating token access rules against request {{(pid=207601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:25:07.595762 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f983e0d-f410-4309-8c63-141dbecf751e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:25:07.596418 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f983e0d-f410-4309-8c63-141dbecf751e None admin] REQUEST_METHOD: `GET` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:25:07.596731 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f983e0d-f410-4309-8c63-141dbecf751e None admin] SCRIPT_NAME: `/identity` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:25:07.597015 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f983e0d-f410-4309-8c63-141dbecf751e None admin] PATH_INFO: `/v3/users` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:25:07.597853 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f983e0d-f410-4309-8c63-141dbecf751e None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=207601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:25:07.598166 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f983e0d-f410-4309-8c63-141dbecf751e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:25:07.599629 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f983e0d-f410-4309-8c63-141dbecf751e None admin] RBAC: Authorization granted {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:25:07.620418 dv-cinder-851351-1-smb devstack@keystone.service[207601]: [pid: 207601|app: 0|req: 465/926] 10.222.0.42 () {56 vars in 1149 bytes} [Thu Jul 28 08:25:07 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:25:07.626090 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0bbac0-c371-408f-b66a-cfea56add68f None admin] Authenticating user token {{(pid=207600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:25:07.733166 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0bbac0-c371-408f-b66a-cfea56add68f None admin] Validating token access rules against request {{(pid=207600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:25:07.769012 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-805a5be6-5a52-403d-80dd-41fcdc7591bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:25:07.769686 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805a5be6-5a52-403d-80dd-41fcdc7591bb None admin] REQUEST_METHOD: `GET` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:25:07.769973 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805a5be6-5a52-403d-80dd-41fcdc7591bb None admin] SCRIPT_NAME: `/identity` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:25:07.770251 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805a5be6-5a52-403d-80dd-41fcdc7591bb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:25:07.781894 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-805a5be6-5a52-403d-80dd-41fcdc7591bb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:25:07.783391 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-805a5be6-5a52-403d-80dd-41fcdc7591bb None admin] RBAC: Authorization granted {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:25:07.799275 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application [None req-805a5be6-5a52-403d-80dd-41fcdc7591bb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 08:25:07.799275 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:25:07.799275 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:25:07.799275 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:25:07.799275 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:25:07.799275 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:25:07.799275 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:25:07.799275 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:25:07.799275 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:25:07.799275 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:25:07.799275 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:25:07.799275 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:25:07.799275 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 08:25:07.799275 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 08:25:07.799275 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 08:25:07.800336 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 08:25:07.800336 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:25:07.800336 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:25:07.800336 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:25:07.800336 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:25:07.800336 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:25:07.800336 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:25:07.800336 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:25:07.800336 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application with Lock( Jul 28 08:25:07.800336 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:25:07.800336 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:25:07.800336 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:25:07.800336 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:25:07.800336 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:25:07.800336 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:25:07.800336 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:25:07.800336 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:25:07.801316 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 08:25:07.801316 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 08:25:07.801316 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 08:25:07.801316 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application Jul 28 08:25:07.801316 dv-cinder-851351-1-smb devstack@keystone.service[207600]: [pid: 207600|app: 0|req: 462/927] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 08:25:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 08:25:07.808056 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f983e0d-f410-4309-8c63-141dbecf751e None admin] Authenticating user token {{(pid=207601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:25:07.924451 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f983e0d-f410-4309-8c63-141dbecf751e None admin] Validating token access rules against request {{(pid=207601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:25:07.942025 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e26eb1-ff97-4cef-8717-4215d70138bb None None] REQUEST_METHOD: `GET` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:25:07.942379 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e26eb1-ff97-4cef-8717-4215d70138bb None None] SCRIPT_NAME: `/identity` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:25:07.942576 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e26eb1-ff97-4cef-8717-4215d70138bb None None] PATH_INFO: `/` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:25:07.943971 dv-cinder-851351-1-smb devstack@keystone.service[207600]: [pid: 207600|app: 0|req: 463/928] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 08:25:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 08:25:07.949378 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006e72f4-2fbb-4cad-88da-3a5dcdc19837 None None] REQUEST_METHOD: `POST` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:25:07.949661 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006e72f4-2fbb-4cad-88da-3a5dcdc19837 None None] SCRIPT_NAME: `/identity` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:25:07.949942 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006e72f4-2fbb-4cad-88da-3a5dcdc19837 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:25:07.968845 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.auth.core [None req-006e72f4-2fbb-4cad-88da-3a5dcdc19837 None None] MFA Rules not processed for user `b8110ade874c4aa7af27f5c376df700a`. Rule list: `[]` (Enabled: `True`). {{(pid=207600) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 08:25:07.970058 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.fernet_utils [None req-006e72f4-2fbb-4cad-88da-3a5dcdc19837 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=207600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:25:07.970445 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a5b6f2f-c630-4f80-958a-d5c4b4f0033b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:25:07.971095 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5b6f2f-c630-4f80-958a-d5c4b4f0033b None admin] REQUEST_METHOD: `GET` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:25:07.971384 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5b6f2f-c630-4f80-958a-d5c4b4f0033b None admin] SCRIPT_NAME: `/identity` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:25:07.971665 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5b6f2f-c630-4f80-958a-d5c4b4f0033b None admin] PATH_INFO: `/v3/domains` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:25:07.972587 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a5b6f2f-c630-4f80-958a-d5c4b4f0033b None admin] RBAC: Adding query filter params (name=Default) {{(pid=207601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:25:07.972936 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a5b6f2f-c630-4f80-958a-d5c4b4f0033b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:25:07.975408 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a5b6f2f-c630-4f80-958a-d5c4b4f0033b None admin] RBAC: Authorization granted {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:25:07.978324 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG dbcounter [-] [207600] Writing DB stats keystone:SELECT=100 {{(pid=207600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:25:07.991629 dv-cinder-851351-1-smb devstack@keystone.service[207601]: [pid: 207601|app: 0|req: 466/929] 10.222.0.42 () {56 vars in 1109 bytes} [Thu Jul 28 08:25:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 08:25:07.993171 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17df550-a2b6-48a9-9081-aed8406f1160 None None] REQUEST_METHOD: `GET` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:25:07.993539 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17df550-a2b6-48a9-9081-aed8406f1160 None None] SCRIPT_NAME: `/identity` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:25:07.993743 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17df550-a2b6-48a9-9081-aed8406f1160 None None] PATH_INFO: `/` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:25:07.995269 dv-cinder-851351-1-smb devstack@keystone.service[207601]: [pid: 207601|app: 0|req: 467/930] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 08:25:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 08:25:07.997232 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d17df550-a2b6-48a9-9081-aed8406f1160 None None] Authenticating user token {{(pid=207601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:25:08.017108 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG dbcounter [-] [207601] Writing DB stats keystone:SELECT=100 {{(pid=207601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:25:08.052110 dv-cinder-851351-1-smb devstack@keystone.service[207600]: [pid: 207600|app: 0|req: 464/931] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 08:25:07 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 28 08:25:08.053455 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82d0d25-46e9-4c77-b702-bc352cd9905a None None] REQUEST_METHOD: `POST` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:25:08.053748 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82d0d25-46e9-4c77-b702-bc352cd9905a None None] SCRIPT_NAME: `/identity` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:25:08.054027 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82d0d25-46e9-4c77-b702-bc352cd9905a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:25:08.078193 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.auth.core [None req-a82d0d25-46e9-4c77-b702-bc352cd9905a None None] MFA Rules not processed for user `b8110ade874c4aa7af27f5c376df700a`. Rule list: `[]` (Enabled: `True`). {{(pid=207600) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 08:25:08.079434 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.fernet_utils [None req-a82d0d25-46e9-4c77-b702-bc352cd9905a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=207600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:25:08.114749 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d17df550-a2b6-48a9-9081-aed8406f1160 None None] Validating token access rules against request {{(pid=207601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:25:08.151600 dv-cinder-851351-1-smb devstack@keystone.service[207600]: [pid: 207600|app: 0|req: 465/932] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 08:25:08 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 08:25:08.160717 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a82d0d25-46e9-4c77-b702-bc352cd9905a None None] Authenticating user token {{(pid=207600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:25:08.163429 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8090c17b-fd0d-423e-bb37-62d210acc559 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:25:08.164342 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8090c17b-fd0d-423e-bb37-62d210acc559 None admin] REQUEST_METHOD: `GET` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:25:08.164885 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8090c17b-fd0d-423e-bb37-62d210acc559 None admin] SCRIPT_NAME: `/identity` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:25:08.165424 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8090c17b-fd0d-423e-bb37-62d210acc559 None admin] PATH_INFO: `/v3/projects/service` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:25:08.174004 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8090c17b-fd0d-423e-bb37-62d210acc559 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:25:08.175574 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8090c17b-fd0d-423e-bb37-62d210acc559 None admin] RBAC: Authorization granted {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:25:08.188591 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application [None req-8090c17b-fd0d-423e-bb37-62d210acc559 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 08:25:08.188591 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:25:08.188591 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:25:08.188591 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:25:08.188591 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:25:08.188591 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:25:08.188591 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:25:08.188591 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:25:08.188591 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:25:08.188591 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:25:08.188591 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:25:08.188591 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:25:08.188591 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 28 08:25:08.188591 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 28 08:25:08.188591 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 28 08:25:08.189744 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 28 08:25:08.189744 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:25:08.189744 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:25:08.189744 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:25:08.189744 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:25:08.189744 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:25:08.189744 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:25:08.189744 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:25:08.189744 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application with Lock( Jul 28 08:25:08.189744 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:25:08.189744 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:25:08.189744 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:25:08.189744 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:25:08.189744 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:25:08.189744 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:25:08.189744 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:25:08.189744 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:25:08.190705 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 28 08:25:08.190705 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 28 08:25:08.190705 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 28 08:25:08.190705 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 28 08:25:08.190705 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 28 08:25:08.190705 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 28 08:25:08.190705 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 08:25:08.190705 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application Jul 28 08:25:08.190705 dv-cinder-851351-1-smb devstack@keystone.service[207601]: [pid: 207601|app: 0|req: 468/933] 10.222.0.42 () {56 vars in 1111 bytes} [Thu Jul 28 08:25:07 2022] GET /identity/v3/projects/service => generated 88 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 08:25:08.190705 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8090c17b-fd0d-423e-bb37-62d210acc559 None admin] Authenticating user token {{(pid=207601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:25:08.236066 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG dbcounter [-] [207600] Writing DB stats keystone:SELECT=100 {{(pid=207600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:25:08.268779 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a82d0d25-46e9-4c77-b702-bc352cd9905a None None] Validating token access rules against request {{(pid=207600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:25:08.287585 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG dbcounter [-] [207601] Writing DB stats keystone:SELECT=100 {{(pid=207601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:25:08.305222 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae733a5-1fdf-4914-848b-975b57d5edf7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:25:08.305922 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae733a5-1fdf-4914-848b-975b57d5edf7 None admin] REQUEST_METHOD: `GET` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:25:08.306207 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae733a5-1fdf-4914-848b-975b57d5edf7 None admin] SCRIPT_NAME: `/identity` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:25:08.306483 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae733a5-1fdf-4914-848b-975b57d5edf7 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:25:08.307128 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ae733a5-1fdf-4914-848b-975b57d5edf7 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:25:08.308532 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ae733a5-1fdf-4914-848b-975b57d5edf7 None admin] RBAC: Authorization granted {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:25:08.316224 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8090c17b-fd0d-423e-bb37-62d210acc559 None admin] Validating token access rules against request {{(pid=207601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:25:08.317614 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application [None req-1ae733a5-1fdf-4914-848b-975b57d5edf7 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 28 08:25:08.317614 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:25:08.317614 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 28 08:25:08.317614 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 28 08:25:08.317614 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 28 08:25:08.317614 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 28 08:25:08.317614 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 28 08:25:08.317614 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 08:25:08.317614 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 28 08:25:08.317614 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application Jul 28 08:25:08.317614 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 28 08:25:08.317614 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application Jul 28 08:25:08.317614 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:25:08.317614 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:25:08.317614 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:25:08.317614 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:25:08.318631 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:25:08.318631 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:25:08.318631 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:25:08.318631 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:25:08.318631 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:25:08.318631 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:25:08.318631 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:25:08.318631 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 28 08:25:08.318631 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 28 08:25:08.318631 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 28 08:25:08.318631 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 28 08:25:08.318631 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:25:08.318631 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:25:08.318631 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:25:08.318631 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:25:08.318631 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:25:08.319527 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:25:08.319527 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:25:08.319527 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application with Lock( Jul 28 08:25:08.319527 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:25:08.319527 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:25:08.319527 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:25:08.319527 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:25:08.319527 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:25:08.319527 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:25:08.319527 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:25:08.319527 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:25:08.319527 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 28 08:25:08.319527 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 08:25:08.319527 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 28 08:25:08.319527 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application Jul 28 08:25:08.319527 dv-cinder-851351-1-smb devstack@keystone.service[207600]: [pid: 207600|app: 0|req: 466/934] 10.222.0.42 () {56 vars in 1132 bytes} [Thu Jul 28 08:25:08 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:25:08.320435 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae733a5-1fdf-4914-848b-975b57d5edf7 None admin] Authenticating user token {{(pid=207600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:25:08.360304 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be97380c-3f91-4529-b67f-02277f33440e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:25:08.360999 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be97380c-3f91-4529-b67f-02277f33440e None admin] REQUEST_METHOD: `GET` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:25:08.361328 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be97380c-3f91-4529-b67f-02277f33440e None admin] SCRIPT_NAME: `/identity` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:25:08.361721 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be97380c-3f91-4529-b67f-02277f33440e None admin] PATH_INFO: `/v3/services/object-store` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:25:08.362310 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be97380c-3f91-4529-b67f-02277f33440e None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:25:08.363720 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be97380c-3f91-4529-b67f-02277f33440e None admin] RBAC: Authorization granted {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:25:08.373624 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application [None req-be97380c-3f91-4529-b67f-02277f33440e None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 28 08:25:08.373624 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:25:08.373624 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 28 08:25:08.373624 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 28 08:25:08.373624 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 28 08:25:08.373624 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 28 08:25:08.373624 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 28 08:25:08.373624 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 08:25:08.373624 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 28 08:25:08.373624 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application Jul 28 08:25:08.373624 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 28 08:25:08.373624 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application Jul 28 08:25:08.373624 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:25:08.373624 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:25:08.373624 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:25:08.373624 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:25:08.373624 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:25:08.374707 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:25:08.374707 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:25:08.374707 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:25:08.374707 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:25:08.374707 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:25:08.374707 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:25:08.374707 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 28 08:25:08.374707 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 28 08:25:08.374707 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 28 08:25:08.374707 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 28 08:25:08.374707 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:25:08.374707 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:25:08.374707 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:25:08.374707 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:25:08.374707 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:25:08.374707 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:25:08.375594 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:25:08.375594 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application with Lock( Jul 28 08:25:08.375594 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:25:08.375594 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:25:08.375594 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:25:08.375594 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:25:08.375594 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:25:08.375594 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:25:08.375594 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:25:08.375594 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:25:08.375594 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 28 08:25:08.375594 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 08:25:08.375594 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 28 08:25:08.375594 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application Jul 28 08:25:08.375594 dv-cinder-851351-1-smb devstack@keystone.service[207601]: [pid: 207601|app: 0|req: 469/935] 10.222.0.42 () {56 vars in 1126 bytes} [Thu Jul 28 08:25:08 2022] GET /identity/v3/services/object-store => generated 93 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:25:08.376436 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be97380c-3f91-4529-b67f-02277f33440e None admin] Authenticating user token {{(pid=207601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:25:08.441648 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae733a5-1fdf-4914-848b-975b57d5edf7 None admin] Validating token access rules against request {{(pid=207600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:25:08.477039 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-474db4a2-4b0c-4c77-ae19-ec7e3e12dea3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:25:08.477952 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474db4a2-4b0c-4c77-ae19-ec7e3e12dea3 None admin] REQUEST_METHOD: `GET` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:25:08.478239 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474db4a2-4b0c-4c77-ae19-ec7e3e12dea3 None admin] SCRIPT_NAME: `/identity` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:25:08.478554 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474db4a2-4b0c-4c77-ae19-ec7e3e12dea3 None admin] PATH_INFO: `/v3/projects` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:25:08.479425 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-474db4a2-4b0c-4c77-ae19-ec7e3e12dea3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=207600) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:25:08.479617 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-474db4a2-4b0c-4c77-ae19-ec7e3e12dea3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:25:08.481077 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-474db4a2-4b0c-4c77-ae19-ec7e3e12dea3 None admin] RBAC: Authorization granted {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:25:08.484544 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG dbcounter [-] [207600] Writing DB stats keystone:SELECT=100 {{(pid=207600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:25:08.485727 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be97380c-3f91-4529-b67f-02277f33440e None admin] Validating token access rules against request {{(pid=207601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:25:08.495543 dv-cinder-851351-1-smb devstack@keystone.service[207600]: [pid: 207600|app: 0|req: 467/936] 10.222.0.42 () {56 vars in 1148 bytes} [Thu Jul 28 08:25:08 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:25:08.496995 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-474db4a2-4b0c-4c77-ae19-ec7e3e12dea3 None admin] Authenticating user token {{(pid=207600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:25:08.528047 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a02d84b7-e81f-469f-9b92-6c782d8022bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:25:08.528709 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02d84b7-e81f-469f-9b92-6c782d8022bc None admin] REQUEST_METHOD: `GET` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:25:08.529003 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02d84b7-e81f-469f-9b92-6c782d8022bc None admin] SCRIPT_NAME: `/identity` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:25:08.529286 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02d84b7-e81f-469f-9b92-6c782d8022bc None admin] PATH_INFO: `/v3/services` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:25:08.529981 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a02d84b7-e81f-469f-9b92-6c782d8022bc None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=207601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:25:08.530296 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a02d84b7-e81f-469f-9b92-6c782d8022bc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:25:08.531691 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a02d84b7-e81f-469f-9b92-6c782d8022bc None admin] RBAC: Authorization granted {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:25:08.536812 dv-cinder-851351-1-smb devstack@keystone.service[207601]: [pid: 207601|app: 0|req: 470/937] 10.222.0.42 () {56 vars in 1126 bytes} [Thu Jul 28 08:25:08 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:25:08.537623 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a02d84b7-e81f-469f-9b92-6c782d8022bc None admin] Authenticating user token {{(pid=207601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:25:08.544503 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG dbcounter [-] [207601] Writing DB stats keystone:SELECT=100 {{(pid=207601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:25:08.619377 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-474db4a2-4b0c-4c77-ae19-ec7e3e12dea3 None admin] Validating token access rules against request {{(pid=207600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:25:08.657280 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a02d84b7-e81f-469f-9b92-6c782d8022bc None admin] Validating token access rules against request {{(pid=207601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:25:08.662648 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c0b83f-d718-4055-b5e5-1d49ce06c343 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:25:08.663324 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c0b83f-d718-4055-b5e5-1d49ce06c343 None admin] REQUEST_METHOD: `GET` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:25:08.663612 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c0b83f-d718-4055-b5e5-1d49ce06c343 None admin] SCRIPT_NAME: `/identity` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:25:08.663887 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c0b83f-d718-4055-b5e5-1d49ce06c343 None admin] PATH_INFO: `/v3/services` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:25:08.664717 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c0b83f-d718-4055-b5e5-1d49ce06c343 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=207600) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:25:08.665204 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c0b83f-d718-4055-b5e5-1d49ce06c343 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:25:08.666357 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c0b83f-d718-4055-b5e5-1d49ce06c343 None admin] RBAC: Authorization granted {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:25:08.671510 dv-cinder-851351-1-smb devstack@keystone.service[207600]: [pid: 207600|app: 0|req: 468/938] 10.222.0.42 () {56 vars in 1122 bytes} [Thu Jul 28 08:25:08 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:25:08.673567 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c0b83f-d718-4055-b5e5-1d49ce06c343 None admin] Authenticating user token {{(pid=207600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:25:08.699262 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2383235a-19d4-4afa-806d-33bf887ea2c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:25:08.700365 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2383235a-19d4-4afa-806d-33bf887ea2c3 None admin] REQUEST_METHOD: `PUT` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:25:08.700680 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2383235a-19d4-4afa-806d-33bf887ea2c3 None admin] SCRIPT_NAME: `/identity` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:25:08.700961 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2383235a-19d4-4afa-806d-33bf887ea2c3 None admin] PATH_INFO: `/v3/projects/48c5f2b2ae2b48758b957d2b194a7fd1/users/601010c3acdf446bb37ff23cbed0dcf1/roles/a67e4d87d7f74c65a98b947bd4f6c11d` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:25:08.703229 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2383235a-19d4-4afa-806d-33bf887ea2c3 None admin] RBAC: Authorizing `identity:create_grant(project_id=48c5f2b2ae2b48758b957d2b194a7fd1, user_id=601010c3acdf446bb37ff23cbed0dcf1, role_id=a67e4d87d7f74c65a98b947bd4f6c11d)` {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:25:08.704712 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2383235a-19d4-4afa-806d-33bf887ea2c3 None admin] RBAC: Authorization granted {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:25:08.721528 dv-cinder-851351-1-smb devstack@keystone.service[207601]: [pid: 207601|app: 0|req: 471/939] 10.222.0.42 () {58 vars in 1439 bytes} [Thu Jul 28 08:25:08 2022] PUT /identity/v3/projects/48c5f2b2ae2b48758b957d2b194a7fd1/users/601010c3acdf446bb37ff23cbed0dcf1/roles/a67e4d87d7f74c65a98b947bd4f6c11d => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 08:25:08.722411 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2383235a-19d4-4afa-806d-33bf887ea2c3 None admin] Authenticating user token {{(pid=207601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:25:08.762828 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG dbcounter [-] [207600] Writing DB stats keystone:SELECT=100 {{(pid=207600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:25:08.817483 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG dbcounter [-] [207601] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=207601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:25:08.831517 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c0b83f-d718-4055-b5e5-1d49ce06c343 None admin] Validating token access rules against request {{(pid=207600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:25:08.875074 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2383235a-19d4-4afa-806d-33bf887ea2c3 None admin] Validating token access rules against request {{(pid=207601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:25:08.878680 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b9ef8ad-84ed-48f4-af05-506437c6b064 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:25:08.879333 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9ef8ad-84ed-48f4-af05-506437c6b064 None admin] REQUEST_METHOD: `GET` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:25:08.879616 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9ef8ad-84ed-48f4-af05-506437c6b064 None admin] SCRIPT_NAME: `/identity` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:25:08.879918 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9ef8ad-84ed-48f4-af05-506437c6b064 None admin] PATH_INFO: `/v3/services` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:25:08.880625 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b9ef8ad-84ed-48f4-af05-506437c6b064 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=207600) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:25:08.880966 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b9ef8ad-84ed-48f4-af05-506437c6b064 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:25:08.882415 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b9ef8ad-84ed-48f4-af05-506437c6b064 None admin] RBAC: Authorization granted {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:25:08.888336 dv-cinder-851351-1-smb devstack@keystone.service[207600]: [pid: 207600|app: 0|req: 469/940] 10.222.0.42 () {56 vars in 1126 bytes} [Thu Jul 28 08:25:08 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:25:08.889703 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969c3d96-559a-4916-96c5-6bd84804874f None None] REQUEST_METHOD: `GET` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:25:08.889992 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969c3d96-559a-4916-96c5-6bd84804874f None None] SCRIPT_NAME: `/identity` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:25:08.890261 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969c3d96-559a-4916-96c5-6bd84804874f None None] PATH_INFO: `/` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:25:08.891780 dv-cinder-851351-1-smb devstack@keystone.service[207600]: [pid: 207600|app: 0|req: 470/941] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 08:25:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 08:25:08.897714 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969c3d96-559a-4916-96c5-6bd84804874f None None] Authenticating user token {{(pid=207600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:25:08.925848 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2aaebc-4a48-4795-bb2f-adeb42a0303c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:25:08.926488 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2aaebc-4a48-4795-bb2f-adeb42a0303c None admin] REQUEST_METHOD: `GET` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:25:08.926789 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2aaebc-4a48-4795-bb2f-adeb42a0303c None admin] SCRIPT_NAME: `/identity` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:25:08.927084 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2aaebc-4a48-4795-bb2f-adeb42a0303c None admin] PATH_INFO: `/v3/services` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:25:08.927775 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee2aaebc-4a48-4795-bb2f-adeb42a0303c None admin] RBAC: Adding query filter params (type=object-store) {{(pid=207601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:25:08.928090 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee2aaebc-4a48-4795-bb2f-adeb42a0303c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:25:08.931002 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee2aaebc-4a48-4795-bb2f-adeb42a0303c None admin] RBAC: Authorization granted {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:25:08.937068 dv-cinder-851351-1-smb devstack@keystone.service[207601]: [pid: 207601|app: 0|req: 472/942] 10.222.0.42 () {56 vars in 1122 bytes} [Thu Jul 28 08:25:08 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:25:08.940185 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d553b87-fc9a-48cb-9c13-fd555bf66dfa None None] REQUEST_METHOD: `POST` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:25:08.940474 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d553b87-fc9a-48cb-9c13-fd555bf66dfa None None] SCRIPT_NAME: `/identity` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:25:08.940779 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d553b87-fc9a-48cb-9c13-fd555bf66dfa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:25:08.960079 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.auth.core [None req-0d553b87-fc9a-48cb-9c13-fd555bf66dfa None None] MFA Rules not processed for user `b8110ade874c4aa7af27f5c376df700a`. Rule list: `[]` (Enabled: `True`). {{(pid=207601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 08:25:08.961293 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.fernet_utils [None req-0d553b87-fc9a-48cb-9c13-fd555bf66dfa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=207601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:25:09.022916 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969c3d96-559a-4916-96c5-6bd84804874f None None] Validating token access rules against request {{(pid=207600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:25:09.038524 dv-cinder-851351-1-smb devstack@keystone.service[207601]: [pid: 207601|app: 0|req: 473/943] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 08:25:08 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 08:25:09.038524 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d553b87-fc9a-48cb-9c13-fd555bf66dfa None None] Authenticating user token {{(pid=207601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:25:09.055585 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG dbcounter [-] [207600] Writing DB stats keystone:SELECT=100 {{(pid=207600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:25:09.069165 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdfef0d0-9157-428d-9aaf-363610a1286d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:25:09.069865 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdfef0d0-9157-428d-9aaf-363610a1286d None admin] REQUEST_METHOD: `POST` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:25:09.070083 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdfef0d0-9157-428d-9aaf-363610a1286d None admin] SCRIPT_NAME: `/identity` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:25:09.070361 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdfef0d0-9157-428d-9aaf-363610a1286d None admin] PATH_INFO: `/v3/endpoints` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:25:09.071384 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdfef0d0-9157-428d-9aaf-363610a1286d None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:25:09.072581 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdfef0d0-9157-428d-9aaf-363610a1286d None admin] RBAC: Authorization granted {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:25:09.095154 dv-cinder-851351-1-smb devstack@keystone.service[207600]: [pid: 207600|app: 0|req: 471/944] 10.222.0.42 () {60 vars in 1144 bytes} [Thu Jul 28 08:25:08 2022] POST /identity/v3/endpoints => generated 347 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 08:25:09.095975 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdfef0d0-9157-428d-9aaf-363610a1286d None admin] Authenticating user token {{(pid=207600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:25:09.108716 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG dbcounter [-] [207601] Writing DB stats keystone:SELECT=100 {{(pid=207601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:25:09.179741 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d553b87-fc9a-48cb-9c13-fd555bf66dfa None None] Validating token access rules against request {{(pid=207601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:25:09.243975 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f93352-27de-452a-977d-1853d6026b58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:25:09.244230 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdfef0d0-9157-428d-9aaf-363610a1286d None admin] Validating token access rules against request {{(pid=207600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:25:09.245076 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f93352-27de-452a-977d-1853d6026b58 None admin] REQUEST_METHOD: `GET` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:25:09.245531 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f93352-27de-452a-977d-1853d6026b58 None admin] SCRIPT_NAME: `/identity` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:25:09.246333 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f93352-27de-452a-977d-1853d6026b58 None admin] PATH_INFO: `/v3/endpoints` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:25:09.248389 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56f93352-27de-452a-977d-1853d6026b58 None admin] RBAC: Adding query filter params (interface=public, service_id=190e9bb6c95846f5b0c28f4cecf329b9, region_id=RegionOne) {{(pid=207601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:25:09.248936 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56f93352-27de-452a-977d-1853d6026b58 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:25:09.250615 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56f93352-27de-452a-977d-1853d6026b58 None admin] RBAC: Authorization granted {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:25:09.258316 dv-cinder-851351-1-smb devstack@keystone.service[207601]: [pid: 207601|app: 0|req: 474/945] 10.222.0.42 () {56 vars in 1251 bytes} [Thu Jul 28 08:25:09 2022] GET /identity/v3/endpoints?service_id=190e9bb6c95846f5b0c28f4cecf329b9&interface=public®ion_id=RegionOne => generated 194 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:25:09.263932 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f93352-27de-452a-977d-1853d6026b58 None admin] Authenticating user token {{(pid=207601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:25:09.287718 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85658973-fa03-4d1e-b497-108bf158f51f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:25:09.288429 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85658973-fa03-4d1e-b497-108bf158f51f None admin] REQUEST_METHOD: `POST` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:25:09.288642 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85658973-fa03-4d1e-b497-108bf158f51f None admin] SCRIPT_NAME: `/identity` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:25:09.289007 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85658973-fa03-4d1e-b497-108bf158f51f None admin] PATH_INFO: `/v3/projects` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:25:09.289796 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85658973-fa03-4d1e-b497-108bf158f51f None admin] RBAC: Authorizing `identity:create_project()` {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:25:09.291257 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85658973-fa03-4d1e-b497-108bf158f51f None admin] RBAC: Authorization granted {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:25:09.294743 dv-cinder-851351-1-smb devstack@keystone.service[207600]: WARNING keystone.server.flask.common [None req-85658973-fa03-4d1e-b497-108bf158f51f None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Jul 28 08:25:09.323037 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.sql.core [None req-85658973-fa03-4d1e-b497-108bf158f51f None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jul 28 08:25:09.323037 dv-cinder-851351-1-smb devstack@keystone.service[207600]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Jul 28 08:25:09.323037 dv-cinder-851351-1-smb devstack@keystone.service[207600]: [parameters: {'id': 'b51bf1d3a58d41279da74e18166757a4', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Jul 28 08:25:09.323037 dv-cinder-851351-1-smb devstack@keystone.service[207600]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=207600) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jul 28 08:25:09.339898 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application [None req-85658973-fa03-4d1e-b497-108bf158f51f None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id b51bf1d3a58d41279da74e18166757a4.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id b51bf1d3a58d41279da74e18166757a4. Jul 28 08:25:09.339898 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:25:09.339898 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 28 08:25:09.339898 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 28 08:25:09.339898 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 28 08:25:09.339898 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 28 08:25:09.339898 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 28 08:25:09.339898 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application result = self._query(query) Jul 28 08:25:09.339898 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 28 08:25:09.339898 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application conn.query(q) Jul 28 08:25:09.339898 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 28 08:25:09.339898 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 28 08:25:09.339898 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 28 08:25:09.340985 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application result.read() Jul 28 08:25:09.340985 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 28 08:25:09.340985 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 28 08:25:09.340985 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 28 08:25:09.340985 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 28 08:25:09.340985 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 28 08:25:09.340985 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 28 08:25:09.340985 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 28 08:25:09.340985 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 28 08:25:09.340985 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jul 28 08:25:09.340985 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application Jul 28 08:25:09.340985 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jul 28 08:25:09.340985 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application Jul 28 08:25:09.340985 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:25:09.340985 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jul 28 08:25:09.340985 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jul 28 08:25:09.340985 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Jul 28 08:25:09.340985 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return project_ref.to_dict() Jul 28 08:25:09.342072 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 28 08:25:09.342072 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application next(self.gen) Jul 28 08:25:09.342072 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jul 28 08:25:09.342072 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application yield resource Jul 28 08:25:09.342072 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 28 08:25:09.342072 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application next(self.gen) Jul 28 08:25:09.342072 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jul 28 08:25:09.342072 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application self.session.rollback() Jul 28 08:25:09.342072 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 28 08:25:09.342072 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application self.force_reraise() Jul 28 08:25:09.342072 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 28 08:25:09.342072 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application raise self.value Jul 28 08:25:09.342072 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jul 28 08:25:09.342072 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jul 28 08:25:09.342072 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jul 28 08:25:09.342072 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application session.commit() Jul 28 08:25:09.342072 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jul 28 08:25:09.343063 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jul 28 08:25:09.343063 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jul 28 08:25:09.343063 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application self._prepare_impl() Jul 28 08:25:09.343063 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jul 28 08:25:09.343063 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application self.session.flush() Jul 28 08:25:09.343063 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jul 28 08:25:09.343063 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application self._flush(objects) Jul 28 08:25:09.343063 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jul 28 08:25:09.343063 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jul 28 08:25:09.343063 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jul 28 08:25:09.343063 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application compat.raise_( Jul 28 08:25:09.343063 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 28 08:25:09.343063 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application raise exception Jul 28 08:25:09.343063 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jul 28 08:25:09.343063 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application flush_context.execute() Jul 28 08:25:09.343063 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jul 28 08:25:09.343063 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application rec.execute(self) Jul 28 08:25:09.344129 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jul 28 08:25:09.344129 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jul 28 08:25:09.344129 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jul 28 08:25:09.344129 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application _emit_insert_statements( Jul 28 08:25:09.344129 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Jul 28 08:25:09.344129 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application c = connection._execute_20( Jul 28 08:25:09.344129 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jul 28 08:25:09.344129 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jul 28 08:25:09.344129 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Jul 28 08:25:09.344129 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jul 28 08:25:09.344129 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jul 28 08:25:09.344129 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application ret = self._execute_context( Jul 28 08:25:09.344129 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jul 28 08:25:09.344129 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jul 28 08:25:09.344129 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jul 28 08:25:09.345066 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jul 28 08:25:09.345066 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 28 08:25:09.345066 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application raise exception Jul 28 08:25:09.345066 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 28 08:25:09.345066 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 28 08:25:09.345066 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 28 08:25:09.345066 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 28 08:25:09.345066 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 28 08:25:09.345066 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application result = self._query(query) Jul 28 08:25:09.345066 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 28 08:25:09.345066 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application conn.query(q) Jul 28 08:25:09.345066 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 28 08:25:09.345066 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 28 08:25:09.345066 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 28 08:25:09.345066 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application result.read() Jul 28 08:25:09.345066 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 28 08:25:09.345066 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 28 08:25:09.346012 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 28 08:25:09.346012 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 28 08:25:09.346012 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 28 08:25:09.346012 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 28 08:25:09.346012 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 28 08:25:09.346012 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 28 08:25:09.346012 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jul 28 08:25:09.346012 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Jul 28 08:25:09.346012 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application [parameters: {'id': 'b51bf1d3a58d41279da74e18166757a4', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Jul 28 08:25:09.346012 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jul 28 08:25:09.346012 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application Jul 28 08:25:09.346012 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 28 08:25:09.346012 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application Jul 28 08:25:09.346012 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:25:09.346012 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Jul 28 08:25:09.346890 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Jul 28 08:25:09.346890 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jul 28 08:25:09.346890 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jul 28 08:25:09.346890 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Jul 28 08:25:09.346890 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application Jul 28 08:25:09.346890 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 28 08:25:09.346890 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application Jul 28 08:25:09.346890 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:25:09.346890 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:25:09.346890 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:25:09.346890 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:25:09.346890 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:25:09.346890 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:25:09.346890 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:25:09.346890 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:25:09.346890 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:25:09.346890 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:25:09.347868 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:25:09.347868 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Jul 28 08:25:09.347868 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Jul 28 08:25:09.347868 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:25:09.347868 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:25:09.347868 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Jul 28 08:25:09.347868 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application raise exception.Conflict( Jul 28 08:25:09.347868 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id b51bf1d3a58d41279da74e18166757a4. Jul 28 08:25:09.347868 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application Jul 28 08:25:09.347868 dv-cinder-851351-1-smb devstack@keystone.service[207600]: [pid: 207600|app: 0|req: 472/946] 10.222.0.42 () {60 vars in 1140 bytes} [Thu Jul 28 08:25:09 2022] POST /identity/v3/projects => generated 262 bytes in 246 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:25:09.352413 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85658973-fa03-4d1e-b497-108bf158f51f None admin] Authenticating user token {{(pid=207600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:25:09.390894 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG dbcounter [-] [207600] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=207600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:25:09.394423 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f93352-27de-452a-977d-1853d6026b58 None admin] Validating token access rules against request {{(pid=207601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:25:09.413964 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG dbcounter [-] [207601] Writing DB stats keystone:SELECT=100 {{(pid=207601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:25:09.432257 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d52a390-fc28-43f6-85f0-63cbfd4e43d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:25:09.432971 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d52a390-fc28-43f6-85f0-63cbfd4e43d0 None admin] REQUEST_METHOD: `GET` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:25:09.433428 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d52a390-fc28-43f6-85f0-63cbfd4e43d0 None admin] SCRIPT_NAME: `/identity` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:25:09.433709 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d52a390-fc28-43f6-85f0-63cbfd4e43d0 None admin] PATH_INFO: `/v3/services` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:25:09.434381 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d52a390-fc28-43f6-85f0-63cbfd4e43d0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:25:09.435767 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d52a390-fc28-43f6-85f0-63cbfd4e43d0 None admin] RBAC: Authorization granted {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:25:09.442492 dv-cinder-851351-1-smb devstack@keystone.service[207601]: [pid: 207601|app: 0|req: 475/947] 10.222.0.42 () {56 vars in 1087 bytes} [Thu Jul 28 08:25:09 2022] GET /identity/v3/services => generated 1497 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 08:25:09.472018 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85658973-fa03-4d1e-b497-108bf158f51f None admin] Validating token access rules against request {{(pid=207600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:25:09.512556 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf1c4d1-c370-423f-8964-3d7887cb0b1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:25:09.513425 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf1c4d1-c370-423f-8964-3d7887cb0b1a None admin] REQUEST_METHOD: `GET` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:25:09.513708 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf1c4d1-c370-423f-8964-3d7887cb0b1a None admin] SCRIPT_NAME: `/identity` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:25:09.514035 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf1c4d1-c370-423f-8964-3d7887cb0b1a None admin] PATH_INFO: `/v3/projects/service` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:25:09.522350 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcf1c4d1-c370-423f-8964-3d7887cb0b1a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:25:09.524189 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcf1c4d1-c370-423f-8964-3d7887cb0b1a None admin] RBAC: Authorization granted {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:25:09.537749 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application [None req-dcf1c4d1-c370-423f-8964-3d7887cb0b1a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 08:25:09.537749 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:25:09.537749 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:25:09.537749 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:25:09.537749 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:25:09.537749 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:25:09.537749 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:25:09.537749 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:25:09.537749 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:25:09.537749 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:25:09.537749 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:25:09.537749 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:25:09.537749 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 28 08:25:09.537749 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 28 08:25:09.537749 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 28 08:25:09.539966 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 28 08:25:09.539966 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:25:09.539966 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:25:09.539966 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:25:09.539966 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:25:09.539966 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:25:09.539966 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:25:09.539966 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:25:09.539966 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application with Lock( Jul 28 08:25:09.539966 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:25:09.539966 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:25:09.539966 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:25:09.539966 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:25:09.539966 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:25:09.539966 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:25:09.539966 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:25:09.539966 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:25:09.542226 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 28 08:25:09.542226 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 28 08:25:09.542226 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 28 08:25:09.542226 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 28 08:25:09.542226 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 28 08:25:09.542226 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 28 08:25:09.542226 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 08:25:09.542226 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application Jul 28 08:25:09.542226 dv-cinder-851351-1-smb devstack@keystone.service[207600]: [pid: 207600|app: 0|req: 473/948] 10.222.0.42 () {56 vars in 1111 bytes} [Thu Jul 28 08:25:09 2022] GET /identity/v3/projects/service => generated 88 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:25:09.545580 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d52a390-fc28-43f6-85f0-63cbfd4e43d0 None admin] Authenticating user token {{(pid=207601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:25:09.660628 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d52a390-fc28-43f6-85f0-63cbfd4e43d0 None admin] Validating token access rules against request {{(pid=207601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:25:09.702395 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb494dd4-1959-4a50-8848-b13bc5df2d45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:25:09.703469 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb494dd4-1959-4a50-8848-b13bc5df2d45 None admin] REQUEST_METHOD: `GET` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:25:09.703985 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb494dd4-1959-4a50-8848-b13bc5df2d45 None admin] SCRIPT_NAME: `/identity` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:25:09.704522 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb494dd4-1959-4a50-8848-b13bc5df2d45 None admin] PATH_INFO: `/v3/projects` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:25:09.705499 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb494dd4-1959-4a50-8848-b13bc5df2d45 None admin] RBAC: Adding query filter params (name=service) {{(pid=207601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:25:09.706077 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb494dd4-1959-4a50-8848-b13bc5df2d45 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:25:09.707774 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb494dd4-1959-4a50-8848-b13bc5df2d45 None admin] RBAC: Authorization granted {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:25:09.727901 dv-cinder-851351-1-smb devstack@keystone.service[207601]: [pid: 207601|app: 0|req: 476/949] 10.222.0.42 () {56 vars in 1112 bytes} [Thu Jul 28 08:25:09 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:25:10.846959 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6232347-ed30-4cf2-9e84-1098b9138b79 None None] REQUEST_METHOD: `GET` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:25:10.847557 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6232347-ed30-4cf2-9e84-1098b9138b79 None None] SCRIPT_NAME: `/identity` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:25:10.847557 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6232347-ed30-4cf2-9e84-1098b9138b79 None None] PATH_INFO: `/` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:25:10.852282 dv-cinder-851351-1-smb devstack@keystone.service[207600]: [pid: 207600|app: 0|req: 474/950] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 08:25:10 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 08:25:10.858391 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dacf073d-40a3-4179-9676-af997ff41873 None None] REQUEST_METHOD: `POST` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:25:10.858967 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dacf073d-40a3-4179-9676-af997ff41873 None None] SCRIPT_NAME: `/identity` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:25:10.858967 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dacf073d-40a3-4179-9676-af997ff41873 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:25:10.878757 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.auth.core [None req-dacf073d-40a3-4179-9676-af997ff41873 None None] MFA Rules not processed for user `b8110ade874c4aa7af27f5c376df700a`. Rule list: `[]` (Enabled: `True`). {{(pid=207601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 08:25:10.880024 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.fernet_utils [None req-dacf073d-40a3-4179-9676-af997ff41873 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=207601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:25:10.926893 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG dbcounter [-] [207601] Writing DB stats keystone:SELECT=100 {{(pid=207601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:25:10.965900 dv-cinder-851351-1-smb devstack@keystone.service[207601]: [pid: 207601|app: 0|req: 477/951] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 08:25:10 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 28 08:25:10.989147 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6232347-ed30-4cf2-9e84-1098b9138b79 None None] Authenticating user token {{(pid=207600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:25:11.097378 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG dbcounter [-] [207600] Writing DB stats keystone:SELECT=100 {{(pid=207600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:25:11.108198 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6232347-ed30-4cf2-9e84-1098b9138b79 None None] Validating token access rules against request {{(pid=207600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:25:11.145215 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0790279a-43f5-4574-bcc7-22ebcdddb826 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:25:11.145905 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0790279a-43f5-4574-bcc7-22ebcdddb826 None admin] REQUEST_METHOD: `GET` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:25:11.146193 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0790279a-43f5-4574-bcc7-22ebcdddb826 None admin] SCRIPT_NAME: `/identity` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:25:11.146475 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0790279a-43f5-4574-bcc7-22ebcdddb826 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:25:11.159392 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0790279a-43f5-4574-bcc7-22ebcdddb826 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 08:25:11.164828 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application [None req-0790279a-43f5-4574-bcc7-22ebcdddb826 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 28 08:25:11.164828 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:25:11.164828 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:25:11.164828 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:25:11.164828 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:25:11.164828 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:25:11.164828 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:25:11.164828 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:25:11.164828 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:25:11.164828 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:25:11.164828 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:25:11.164828 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:25:11.164828 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 08:25:11.164828 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 08:25:11.164828 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 08:25:11.164828 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 08:25:11.167135 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 08:25:11.167135 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 08:25:11.167135 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 08:25:11.167135 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 08:25:11.167135 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:25:11.167135 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:25:11.167135 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:25:11.167135 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:25:11.167135 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:25:11.167135 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:25:11.167135 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:25:11.167135 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application with Lock( Jul 28 08:25:11.167135 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:25:11.167135 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:25:11.167135 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:25:11.167135 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:25:11.169256 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:25:11.169256 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:25:11.169256 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:25:11.169256 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:25:11.169256 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 08:25:11.169256 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 08:25:11.169256 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 08:25:11.169256 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 08:25:11.169256 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 08:25:11.169256 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 08:25:11.169256 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 28 08:25:11.169256 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application Jul 28 08:25:11.169256 dv-cinder-851351-1-smb devstack@keystone.service[207600]: [pid: 207600|app: 0|req: 475/952] 10.222.0.42 () {56 vars in 1120 bytes} [Thu Jul 28 08:25:10 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:25:11.176710 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dacf073d-40a3-4179-9676-af997ff41873 None None] Authenticating user token {{(pid=207601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:25:11.263144 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1392f2-d52f-418b-9276-1d7b02c50441 None None] REQUEST_METHOD: `GET` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:25:11.263529 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1392f2-d52f-418b-9276-1d7b02c50441 None None] SCRIPT_NAME: `/identity` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:25:11.263704 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1392f2-d52f-418b-9276-1d7b02c50441 None None] PATH_INFO: `/` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:25:11.265462 dv-cinder-851351-1-smb devstack@keystone.service[207600]: [pid: 207600|app: 0|req: 476/953] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 08:25:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 08:25:11.270850 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e900e401-67f7-4d13-b695-0933b25aff20 None None] REQUEST_METHOD: `POST` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:25:11.271112 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e900e401-67f7-4d13-b695-0933b25aff20 None None] SCRIPT_NAME: `/identity` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:25:11.271387 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e900e401-67f7-4d13-b695-0933b25aff20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:25:11.280414 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dacf073d-40a3-4179-9676-af997ff41873 None None] Validating token access rules against request {{(pid=207601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:25:11.291653 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.auth.core [None req-e900e401-67f7-4d13-b695-0933b25aff20 None None] MFA Rules not processed for user `b8110ade874c4aa7af27f5c376df700a`. Rule list: `[]` (Enabled: `True`). {{(pid=207600) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 08:25:11.293375 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.fernet_utils [None req-e900e401-67f7-4d13-b695-0933b25aff20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=207600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:25:11.322535 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f21fb19c-8d9d-40d7-b0dc-3603d36b7d2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:25:11.323500 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21fb19c-8d9d-40d7-b0dc-3603d36b7d2c None admin] REQUEST_METHOD: `GET` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:25:11.324046 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21fb19c-8d9d-40d7-b0dc-3603d36b7d2c None admin] SCRIPT_NAME: `/identity` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:25:11.324327 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21fb19c-8d9d-40d7-b0dc-3603d36b7d2c None admin] PATH_INFO: `/v3/roles` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:25:11.325099 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f21fb19c-8d9d-40d7-b0dc-3603d36b7d2c None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=207601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:25:11.325556 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f21fb19c-8d9d-40d7-b0dc-3603d36b7d2c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:25:11.327538 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f21fb19c-8d9d-40d7-b0dc-3603d36b7d2c None admin] RBAC: Authorization granted {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:25:11.342060 dv-cinder-851351-1-smb devstack@keystone.service[207601]: [pid: 207601|app: 0|req: 478/954] 10.222.0.42 () {56 vars in 1115 bytes} [Thu Jul 28 08:25:11 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:25:11.349680 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f21fb19c-8d9d-40d7-b0dc-3603d36b7d2c None admin] Authenticating user token {{(pid=207601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:25:11.380913 dv-cinder-851351-1-smb devstack@keystone.service[207600]: [pid: 207600|app: 0|req: 477/955] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 08:25:11 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 28 08:25:11.390070 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG dbcounter [-] [207601] Writing DB stats keystone:SELECT=100 {{(pid=207601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:25:11.399759 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e900e401-67f7-4d13-b695-0933b25aff20 None None] Authenticating user token {{(pid=207600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:25:11.472719 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f21fb19c-8d9d-40d7-b0dc-3603d36b7d2c None admin] Validating token access rules against request {{(pid=207601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:25:11.490832 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG dbcounter [-] [207600] Writing DB stats keystone:SELECT=100 {{(pid=207600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:25:11.515015 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e900e401-67f7-4d13-b695-0933b25aff20 None None] Validating token access rules against request {{(pid=207600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:25:11.516344 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd27bf88-e440-4f20-afc8-6ed3ba5c22a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:25:11.517057 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd27bf88-e440-4f20-afc8-6ed3ba5c22a0 None admin] REQUEST_METHOD: `GET` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:25:11.517338 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd27bf88-e440-4f20-afc8-6ed3ba5c22a0 None admin] SCRIPT_NAME: `/identity` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:25:11.517617 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd27bf88-e440-4f20-afc8-6ed3ba5c22a0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:25:11.534165 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd27bf88-e440-4f20-afc8-6ed3ba5c22a0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:25:11.536144 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd27bf88-e440-4f20-afc8-6ed3ba5c22a0 None admin] RBAC: Authorization granted {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:25:11.556202 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application [None req-cd27bf88-e440-4f20-afc8-6ed3ba5c22a0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 08:25:11.556202 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:25:11.556202 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:25:11.556202 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:25:11.556202 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:25:11.556202 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:25:11.556202 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:25:11.556202 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:25:11.556202 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:25:11.556202 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:25:11.556202 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:25:11.556202 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:25:11.556202 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 08:25:11.556202 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 08:25:11.556202 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 08:25:11.557543 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 08:25:11.557543 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:25:11.557543 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:25:11.557543 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:25:11.557543 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:25:11.557543 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:25:11.557543 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:25:11.557543 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:25:11.557543 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application with Lock( Jul 28 08:25:11.557543 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:25:11.557543 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:25:11.557543 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:25:11.557543 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:25:11.557543 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:25:11.557543 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:25:11.557543 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:25:11.557543 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:25:11.558483 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 08:25:11.558483 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 08:25:11.558483 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 08:25:11.558483 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application Jul 28 08:25:11.562247 dv-cinder-851351-1-smb devstack@keystone.service[207601]: [pid: 207601|app: 0|req: 479/956] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 08:25:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:25:11.563135 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d7a13f-7aaa-4523-9ab9-c2a5c525a7f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:25:11.563278 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd27bf88-e440-4f20-afc8-6ed3ba5c22a0 None admin] Authenticating user token {{(pid=207601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:25:11.564160 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d7a13f-7aaa-4523-9ab9-c2a5c525a7f5 None admin] REQUEST_METHOD: `GET` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:25:11.564684 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d7a13f-7aaa-4523-9ab9-c2a5c525a7f5 None admin] SCRIPT_NAME: `/identity` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:25:11.565183 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d7a13f-7aaa-4523-9ab9-c2a5c525a7f5 None admin] PATH_INFO: `/v3/services/compute` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:25:11.566141 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d7a13f-7aaa-4523-9ab9-c2a5c525a7f5 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:25:11.567947 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d7a13f-7aaa-4523-9ab9-c2a5c525a7f5 None admin] RBAC: Authorization granted {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:25:11.578451 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application [None req-a8d7a13f-7aaa-4523-9ab9-c2a5c525a7f5 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jul 28 08:25:11.578451 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:25:11.578451 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 28 08:25:11.578451 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 28 08:25:11.578451 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 28 08:25:11.578451 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 28 08:25:11.578451 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 28 08:25:11.578451 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 08:25:11.578451 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 28 08:25:11.578451 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application Jul 28 08:25:11.578451 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 28 08:25:11.578451 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application Jul 28 08:25:11.578451 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:25:11.578451 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:25:11.578451 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:25:11.578451 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:25:11.578451 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:25:11.579567 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:25:11.579567 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:25:11.579567 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:25:11.579567 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:25:11.579567 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:25:11.579567 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:25:11.579567 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 28 08:25:11.579567 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 28 08:25:11.579567 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 28 08:25:11.579567 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 28 08:25:11.579567 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:25:11.579567 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:25:11.579567 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:25:11.579567 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:25:11.579567 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:25:11.579567 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:25:11.580516 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:25:11.580516 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application with Lock( Jul 28 08:25:11.580516 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:25:11.580516 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:25:11.580516 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:25:11.580516 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:25:11.580516 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:25:11.580516 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:25:11.580516 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:25:11.580516 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:25:11.580516 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 28 08:25:11.580516 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 08:25:11.580516 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 28 08:25:11.580516 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application Jul 28 08:25:11.588937 dv-cinder-851351-1-smb devstack@keystone.service[207600]: [pid: 207600|app: 0|req: 478/957] 10.222.0.42 () {56 vars in 1111 bytes} [Thu Jul 28 08:25:11 2022] GET /identity/v3/services/compute => generated 88 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 08:25:11.590537 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d7a13f-7aaa-4523-9ab9-c2a5c525a7f5 None admin] Authenticating user token {{(pid=207600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:25:11.661578 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG dbcounter [-] [207601] Writing DB stats keystone:SELECT=100 {{(pid=207601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:25:11.676917 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd27bf88-e440-4f20-afc8-6ed3ba5c22a0 None admin] Validating token access rules against request {{(pid=207601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:25:11.710078 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d7a13f-7aaa-4523-9ab9-c2a5c525a7f5 None admin] Validating token access rules against request {{(pid=207600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:25:11.731034 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef4fb8b2-f130-4078-a4bb-bfab61348f1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:25:11.731752 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4fb8b2-f130-4078-a4bb-bfab61348f1a None admin] REQUEST_METHOD: `GET` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:25:11.732149 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4fb8b2-f130-4078-a4bb-bfab61348f1a None admin] SCRIPT_NAME: `/identity` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:25:11.732587 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4fb8b2-f130-4078-a4bb-bfab61348f1a None admin] PATH_INFO: `/v3/domains` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:25:11.733365 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef4fb8b2-f130-4078-a4bb-bfab61348f1a None admin] RBAC: Adding query filter params (name=Default) {{(pid=207601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:25:11.733738 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef4fb8b2-f130-4078-a4bb-bfab61348f1a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:25:11.735535 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef4fb8b2-f130-4078-a4bb-bfab61348f1a None admin] RBAC: Authorization granted {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:25:11.758098 dv-cinder-851351-1-smb devstack@keystone.service[207601]: [pid: 207601|app: 0|req: 480/958] 10.222.0.42 () {56 vars in 1109 bytes} [Thu Jul 28 08:25:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 08:25:11.759869 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66fdac26-7eed-478a-8dd3-85687ed8cbc9 None None] REQUEST_METHOD: `GET` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:25:11.760156 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15aa65a8-928e-4e66-86d5-25fbc207595a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:25:11.760289 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66fdac26-7eed-478a-8dd3-85687ed8cbc9 None None] SCRIPT_NAME: `/identity` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:25:11.760497 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66fdac26-7eed-478a-8dd3-85687ed8cbc9 None None] PATH_INFO: `/` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:25:11.761396 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15aa65a8-928e-4e66-86d5-25fbc207595a None admin] REQUEST_METHOD: `GET` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:25:11.761877 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15aa65a8-928e-4e66-86d5-25fbc207595a None admin] SCRIPT_NAME: `/identity` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:25:11.762336 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15aa65a8-928e-4e66-86d5-25fbc207595a None admin] PATH_INFO: `/v3/services` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:25:11.762495 dv-cinder-851351-1-smb devstack@keystone.service[207601]: [pid: 207601|app: 0|req: 481/959] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 08:25:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 08:25:11.763600 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15aa65a8-928e-4e66-86d5-25fbc207595a None admin] RBAC: Adding query filter params (name=compute) {{(pid=207600) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:25:11.763929 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15aa65a8-928e-4e66-86d5-25fbc207595a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:25:11.767059 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15aa65a8-928e-4e66-86d5-25fbc207595a None admin] RBAC: Authorization granted {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:25:11.767955 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66fdac26-7eed-478a-8dd3-85687ed8cbc9 None None] Authenticating user token {{(pid=207601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:25:11.773695 dv-cinder-851351-1-smb devstack@keystone.service[207600]: [pid: 207600|app: 0|req: 479/960] 10.222.0.42 () {56 vars in 1112 bytes} [Thu Jul 28 08:25:11 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 08:25:11.779839 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f1fcef-6247-457e-8137-95bede64004c None None] REQUEST_METHOD: `POST` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:25:11.780134 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f1fcef-6247-457e-8137-95bede64004c None None] SCRIPT_NAME: `/identity` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:25:11.780500 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f1fcef-6247-457e-8137-95bede64004c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:25:11.805798 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.auth.core [None req-02f1fcef-6247-457e-8137-95bede64004c None None] MFA Rules not processed for user `b8110ade874c4aa7af27f5c376df700a`. Rule list: `[]` (Enabled: `True`). {{(pid=207600) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 08:25:11.807365 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.fernet_utils [None req-02f1fcef-6247-457e-8137-95bede64004c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=207600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:25:11.810872 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG dbcounter [-] [207600] Writing DB stats keystone:SELECT=100 {{(pid=207600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:25:11.883387 dv-cinder-851351-1-smb devstack@keystone.service[207600]: [pid: 207600|app: 0|req: 480/961] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 08:25:11 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 08:25:11.885022 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f1fcef-6247-457e-8137-95bede64004c None None] Authenticating user token {{(pid=207600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:25:11.893768 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66fdac26-7eed-478a-8dd3-85687ed8cbc9 None None] Validating token access rules against request {{(pid=207601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:25:11.929775 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da533b5c-15d3-4da1-8cb0-2d9ee2962360 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:25:11.930515 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da533b5c-15d3-4da1-8cb0-2d9ee2962360 None admin] REQUEST_METHOD: `GET` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:25:11.930804 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da533b5c-15d3-4da1-8cb0-2d9ee2962360 None admin] SCRIPT_NAME: `/identity` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:25:11.931098 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da533b5c-15d3-4da1-8cb0-2d9ee2962360 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:25:11.938589 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da533b5c-15d3-4da1-8cb0-2d9ee2962360 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:25:11.940053 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da533b5c-15d3-4da1-8cb0-2d9ee2962360 None admin] RBAC: Authorization granted {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:25:11.952212 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application [None req-da533b5c-15d3-4da1-8cb0-2d9ee2962360 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 28 08:25:11.952212 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:25:11.952212 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:25:11.952212 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:25:11.952212 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:25:11.952212 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:25:11.952212 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:25:11.952212 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:25:11.952212 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:25:11.952212 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:25:11.952212 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:25:11.952212 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:25:11.952212 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 28 08:25:11.952212 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 28 08:25:11.952212 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 28 08:25:11.952212 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 28 08:25:11.953478 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:25:11.953478 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:25:11.953478 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 28 08:25:11.953478 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 08:25:11.953478 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 28 08:25:11.953478 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 08:25:11.953478 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:25:11.953478 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:25:11.953478 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:25:11.953478 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:25:11.953478 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:25:11.953478 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application with Lock( Jul 28 08:25:11.953478 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:25:11.953478 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:25:11.953478 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:25:11.953478 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:25:11.953478 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:25:11.953478 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:25:11.954488 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:25:11.954488 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:25:11.954488 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 28 08:25:11.954488 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 28 08:25:11.954488 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 28 08:25:11.954488 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 28 08:25:11.954488 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 28 08:25:11.954488 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 28 08:25:11.954488 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 28 08:25:11.954488 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application Jul 28 08:25:11.954488 dv-cinder-851351-1-smb devstack@keystone.service[207601]: [pid: 207601|app: 0|req: 482/962] 10.222.0.42 () {56 vars in 1117 bytes} [Thu Jul 28 08:25:11 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 08:25:11.955139 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03b8598-d59b-4853-9062-14ce0e9e9514 None None] REQUEST_METHOD: `GET` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:25:11.955217 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03b8598-d59b-4853-9062-14ce0e9e9514 None None] SCRIPT_NAME: `/identity` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:25:11.955447 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03b8598-d59b-4853-9062-14ce0e9e9514 None None] PATH_INFO: `/` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:25:11.957079 dv-cinder-851351-1-smb devstack@keystone.service[207601]: [pid: 207601|app: 0|req: 483/963] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 08:25:11 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 08:25:11.957429 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03b8598-d59b-4853-9062-14ce0e9e9514 None None] Authenticating user token {{(pid=207601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:25:11.970831 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG dbcounter [-] [207601] Writing DB stats keystone:SELECT=100 {{(pid=207601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:25:11.991154 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f1fcef-6247-457e-8137-95bede64004c None None] Validating token access rules against request {{(pid=207600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:25:12.026332 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa16861-5890-4e55-990c-68d257f17413 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:25:12.026963 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa16861-5890-4e55-990c-68d257f17413 None admin] REQUEST_METHOD: `GET` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:25:12.027250 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa16861-5890-4e55-990c-68d257f17413 None admin] SCRIPT_NAME: `/identity` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:25:12.027527 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa16861-5890-4e55-990c-68d257f17413 None admin] PATH_INFO: `/v3/services` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:25:12.028219 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fa16861-5890-4e55-990c-68d257f17413 None admin] RBAC: Adding query filter params (type=compute) {{(pid=207600) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:25:12.028526 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fa16861-5890-4e55-990c-68d257f17413 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:25:12.029958 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fa16861-5890-4e55-990c-68d257f17413 None admin] RBAC: Authorization granted {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:25:12.034455 dv-cinder-851351-1-smb devstack@keystone.service[207600]: [pid: 207600|app: 0|req: 481/964] 10.222.0.42 () {56 vars in 1112 bytes} [Thu Jul 28 08:25:11 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:25:12.035244 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa16861-5890-4e55-990c-68d257f17413 None admin] Authenticating user token {{(pid=207600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:25:12.038771 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG dbcounter [-] [207600] Writing DB stats keystone:SELECT=100 {{(pid=207600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:25:12.068309 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03b8598-d59b-4853-9062-14ce0e9e9514 None None] Validating token access rules against request {{(pid=207601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:25:12.112490 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8dcfb8-a7c0-4465-8971-25e0890d6011 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:25:12.113219 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8dcfb8-a7c0-4465-8971-25e0890d6011 None admin] REQUEST_METHOD: `GET` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:25:12.113504 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8dcfb8-a7c0-4465-8971-25e0890d6011 None admin] SCRIPT_NAME: `/identity` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:25:12.113781 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8dcfb8-a7c0-4465-8971-25e0890d6011 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:25:12.114454 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de8dcfb8-a7c0-4465-8971-25e0890d6011 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:25:12.115895 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de8dcfb8-a7c0-4465-8971-25e0890d6011 None admin] RBAC: Authorization granted {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:25:12.126805 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application [None req-de8dcfb8-a7c0-4465-8971-25e0890d6011 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 28 08:25:12.126805 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:25:12.126805 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 28 08:25:12.126805 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 28 08:25:12.126805 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 28 08:25:12.126805 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 28 08:25:12.126805 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 28 08:25:12.126805 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 08:25:12.126805 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 28 08:25:12.126805 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application Jul 28 08:25:12.126805 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 28 08:25:12.126805 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application Jul 28 08:25:12.126805 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:25:12.126805 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:25:12.126805 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:25:12.126805 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:25:12.126805 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:25:12.128979 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:25:12.128979 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:25:12.128979 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:25:12.128979 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:25:12.128979 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:25:12.128979 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:25:12.128979 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 28 08:25:12.128979 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 28 08:25:12.128979 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 28 08:25:12.128979 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 28 08:25:12.128979 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:25:12.128979 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:25:12.128979 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:25:12.128979 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:25:12.128979 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:25:12.128979 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:25:12.130138 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:25:12.130138 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application with Lock( Jul 28 08:25:12.130138 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:25:12.130138 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:25:12.130138 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:25:12.130138 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:25:12.130138 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:25:12.130138 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:25:12.130138 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:25:12.130138 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:25:12.130138 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 28 08:25:12.130138 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 08:25:12.130138 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 28 08:25:12.130138 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application Jul 28 08:25:12.134090 dv-cinder-851351-1-smb devstack@keystone.service[207601]: [pid: 207601|app: 0|req: 484/965] 10.222.0.42 () {56 vars in 1126 bytes} [Thu Jul 28 08:25:11 2022] GET /identity/v3/services/object-store => generated 93 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:25:12.135883 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f45e09-a647-473c-b46e-cc9c87c2d915 None None] REQUEST_METHOD: `POST` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:25:12.136179 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f45e09-a647-473c-b46e-cc9c87c2d915 None None] SCRIPT_NAME: `/identity` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:25:12.136464 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f45e09-a647-473c-b46e-cc9c87c2d915 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:25:12.156924 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.auth.core [None req-73f45e09-a647-473c-b46e-cc9c87c2d915 None None] MFA Rules not processed for user `b8110ade874c4aa7af27f5c376df700a`. Rule list: `[]` (Enabled: `True`). {{(pid=207601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 08:25:12.158508 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.fernet_utils [None req-73f45e09-a647-473c-b46e-cc9c87c2d915 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=207601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:25:12.171940 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa16861-5890-4e55-990c-68d257f17413 None admin] Validating token access rules against request {{(pid=207600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:25:12.217257 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5dd579-1014-4fc3-abc5-32bbc4b50248 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:25:12.218273 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5dd579-1014-4fc3-abc5-32bbc4b50248 None admin] REQUEST_METHOD: `GET` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:25:12.218770 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5dd579-1014-4fc3-abc5-32bbc4b50248 None admin] SCRIPT_NAME: `/identity` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:25:12.219237 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5dd579-1014-4fc3-abc5-32bbc4b50248 None admin] PATH_INFO: `/v3/users` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:25:12.220062 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb5dd579-1014-4fc3-abc5-32bbc4b50248 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=207600) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:25:12.220372 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb5dd579-1014-4fc3-abc5-32bbc4b50248 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:25:12.222001 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb5dd579-1014-4fc3-abc5-32bbc4b50248 None admin] RBAC: Authorization granted {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:25:12.240766 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG dbcounter [-] [207601] Writing DB stats keystone:SELECT=100 {{(pid=207601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:25:12.250660 dv-cinder-851351-1-smb devstack@keystone.service[207600]: [pid: 207600|app: 0|req: 482/966] 10.222.0.42 () {56 vars in 1149 bytes} [Thu Jul 28 08:25:12 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:25:12.250660 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5dd579-1014-4fc3-abc5-32bbc4b50248 None admin] Authenticating user token {{(pid=207600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:25:12.252832 dv-cinder-851351-1-smb devstack@keystone.service[207601]: [pid: 207601|app: 0|req: 485/967] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 08:25:12 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 08:25:12.255115 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f45e09-a647-473c-b46e-cc9c87c2d915 None None] Authenticating user token {{(pid=207601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:25:12.326694 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG dbcounter [-] [207600] Writing DB stats keystone:SELECT=100 {{(pid=207600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:25:12.370081 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5dd579-1014-4fc3-abc5-32bbc4b50248 None admin] Validating token access rules against request {{(pid=207600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:25:12.391172 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f45e09-a647-473c-b46e-cc9c87c2d915 None None] Validating token access rules against request {{(pid=207601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:25:12.410639 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28da1076-0422-4508-8972-25b603b82935 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:25:12.411280 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28da1076-0422-4508-8972-25b603b82935 None admin] REQUEST_METHOD: `GET` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:25:12.411568 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28da1076-0422-4508-8972-25b603b82935 None admin] SCRIPT_NAME: `/identity` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:25:12.411841 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28da1076-0422-4508-8972-25b603b82935 None admin] PATH_INFO: `/v3/services` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:25:12.412546 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28da1076-0422-4508-8972-25b603b82935 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=207600) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:25:12.412898 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28da1076-0422-4508-8972-25b603b82935 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:25:12.414308 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28da1076-0422-4508-8972-25b603b82935 None admin] RBAC: Authorization granted {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:25:12.424474 dv-cinder-851351-1-smb devstack@keystone.service[207600]: [pid: 207600|app: 0|req: 483/968] 10.222.0.42 () {56 vars in 1122 bytes} [Thu Jul 28 08:25:12 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:25:12.424474 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28da1076-0422-4508-8972-25b603b82935 None admin] Authenticating user token {{(pid=207600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:25:12.439988 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-571d8387-1bee-4039-b600-6f66985bad81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:25:12.440607 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571d8387-1bee-4039-b600-6f66985bad81 None admin] REQUEST_METHOD: `GET` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:25:12.440967 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571d8387-1bee-4039-b600-6f66985bad81 None admin] SCRIPT_NAME: `/identity` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:25:12.441293 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571d8387-1bee-4039-b600-6f66985bad81 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:25:12.524715 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG dbcounter [-] [207601] Writing DB stats keystone:SELECT=100 {{(pid=207601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:25:12.527526 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-571d8387-1bee-4039-b600-6f66985bad81 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:25:12.529534 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-571d8387-1bee-4039-b600-6f66985bad81 None admin] RBAC: Authorization granted {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:25:12.545280 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28da1076-0422-4508-8972-25b603b82935 None admin] Validating token access rules against request {{(pid=207600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:25:12.573389 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG dbcounter [-] [207600] Writing DB stats keystone:SELECT=100 {{(pid=207600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:25:12.584960 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d269dae8-5c90-434f-ba94-9215246675d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:25:12.585977 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d269dae8-5c90-434f-ba94-9215246675d2 None admin] REQUEST_METHOD: `POST` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:25:12.586258 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d269dae8-5c90-434f-ba94-9215246675d2 None admin] SCRIPT_NAME: `/identity` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:25:12.586846 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d269dae8-5c90-434f-ba94-9215246675d2 None admin] PATH_INFO: `/v3/users` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:25:12.587843 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d269dae8-5c90-434f-ba94-9215246675d2 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:25:12.589816 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d269dae8-5c90-434f-ba94-9215246675d2 None admin] RBAC: Authorization granted {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:25:12.609403 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.sql.core [None req-d269dae8-5c90-434f-ba94-9215246675d2 None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jul 28 08:25:12.609403 dv-cinder-851351-1-smb devstack@keystone.service[207600]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Jul 28 08:25:12.609403 dv-cinder-851351-1-smb devstack@keystone.service[207600]: [parameters: {'user_id': '3d7793e9c16143d68490266277419f93', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Jul 28 08:25:12.609403 dv-cinder-851351-1-smb devstack@keystone.service[207600]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=207600) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jul 28 08:25:12.616470 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application [None req-d269dae8-5c90-434f-ba94-9215246675d2 None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Jul 28 08:25:12.616470 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:25:12.616470 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 28 08:25:12.616470 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 28 08:25:12.616470 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 28 08:25:12.616470 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 28 08:25:12.616470 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 28 08:25:12.616470 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application result = self._query(query) Jul 28 08:25:12.616470 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 28 08:25:12.616470 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application conn.query(q) Jul 28 08:25:12.616470 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 28 08:25:12.616470 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 28 08:25:12.616470 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 28 08:25:12.616470 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application result.read() Jul 28 08:25:12.616470 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 28 08:25:12.617482 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 28 08:25:12.617482 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 28 08:25:12.617482 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 28 08:25:12.617482 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 28 08:25:12.617482 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 28 08:25:12.617482 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 28 08:25:12.617482 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 28 08:25:12.617482 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jul 28 08:25:12.617482 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application Jul 28 08:25:12.617482 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jul 28 08:25:12.617482 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application Jul 28 08:25:12.617482 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:25:12.617482 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jul 28 08:25:12.617482 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jul 28 08:25:12.617482 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Jul 28 08:25:12.617482 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Jul 28 08:25:12.617482 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 28 08:25:12.617482 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application next(self.gen) Jul 28 08:25:12.618624 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jul 28 08:25:12.618624 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application yield resource Jul 28 08:25:12.618624 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 28 08:25:12.618624 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application next(self.gen) Jul 28 08:25:12.618624 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jul 28 08:25:12.618624 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application self.session.rollback() Jul 28 08:25:12.618624 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 28 08:25:12.618624 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application self.force_reraise() Jul 28 08:25:12.618624 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 28 08:25:12.618624 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application raise self.value Jul 28 08:25:12.618624 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jul 28 08:25:12.618624 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jul 28 08:25:12.618624 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jul 28 08:25:12.618624 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application session.commit() Jul 28 08:25:12.618624 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jul 28 08:25:12.618624 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jul 28 08:25:12.618624 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jul 28 08:25:12.619607 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application self._prepare_impl() Jul 28 08:25:12.619607 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jul 28 08:25:12.619607 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application self.session.flush() Jul 28 08:25:12.619607 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jul 28 08:25:12.619607 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application self._flush(objects) Jul 28 08:25:12.619607 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jul 28 08:25:12.619607 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jul 28 08:25:12.619607 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jul 28 08:25:12.619607 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application compat.raise_( Jul 28 08:25:12.619607 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 28 08:25:12.619607 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application raise exception Jul 28 08:25:12.619607 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jul 28 08:25:12.619607 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application flush_context.execute() Jul 28 08:25:12.619607 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jul 28 08:25:12.619607 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application rec.execute(self) Jul 28 08:25:12.619607 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jul 28 08:25:12.619607 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jul 28 08:25:12.620547 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jul 28 08:25:12.620547 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application _emit_insert_statements( Jul 28 08:25:12.620547 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Jul 28 08:25:12.620547 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application result = connection._execute_20( Jul 28 08:25:12.620547 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jul 28 08:25:12.620547 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jul 28 08:25:12.620547 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Jul 28 08:25:12.620547 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jul 28 08:25:12.620547 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jul 28 08:25:12.620547 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application ret = self._execute_context( Jul 28 08:25:12.620547 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jul 28 08:25:12.620547 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jul 28 08:25:12.620547 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jul 28 08:25:12.620547 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jul 28 08:25:12.620547 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 28 08:25:12.620547 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application raise exception Jul 28 08:25:12.624940 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 28 08:25:12.624940 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 28 08:25:12.624940 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 28 08:25:12.624940 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 28 08:25:12.624940 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 28 08:25:12.624940 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application result = self._query(query) Jul 28 08:25:12.624940 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 28 08:25:12.624940 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application conn.query(q) Jul 28 08:25:12.624940 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 28 08:25:12.624940 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 28 08:25:12.624940 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 28 08:25:12.624940 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application result.read() Jul 28 08:25:12.624940 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 28 08:25:12.624940 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 28 08:25:12.624940 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 28 08:25:12.624940 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 28 08:25:12.627654 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 28 08:25:12.627654 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 28 08:25:12.627654 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 28 08:25:12.627654 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 28 08:25:12.627654 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jul 28 08:25:12.627654 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Jul 28 08:25:12.627654 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application [parameters: {'user_id': '3d7793e9c16143d68490266277419f93', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Jul 28 08:25:12.627654 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jul 28 08:25:12.627654 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application Jul 28 08:25:12.627654 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 28 08:25:12.627654 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application Jul 28 08:25:12.627654 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:25:12.627654 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:25:12.627654 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:25:12.627654 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:25:12.630184 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:25:12.630184 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:25:12.630184 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:25:12.630184 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:25:12.630184 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:25:12.630184 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:25:12.630184 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:25:12.630184 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Jul 28 08:25:12.630184 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Jul 28 08:25:12.630184 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:25:12.630184 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:25:12.630184 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 28 08:25:12.630184 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 08:25:12.630184 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 28 08:25:12.630184 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 08:25:12.630184 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Jul 28 08:25:12.630184 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Jul 28 08:25:12.633628 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Jul 28 08:25:12.633628 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Jul 28 08:25:12.633628 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jul 28 08:25:12.633628 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jul 28 08:25:12.633628 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Jul 28 08:25:12.633628 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application Jul 28 08:25:12.633628 dv-cinder-851351-1-smb devstack@keystone.service[207600]: [pid: 207600|app: 0|req: 484/969] 10.222.0.42 () {60 vars in 1131 bytes} [Thu Jul 28 08:25:12 2022] POST /identity/v3/users => generated 160 bytes in 197 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:25:12.633628 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d269dae8-5c90-434f-ba94-9215246675d2 None admin] Authenticating user token {{(pid=207600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:25:12.655915 dv-cinder-851351-1-smb devstack@keystone.service[207601]: [pid: 207601|app: 0|req: 486/970] 10.222.0.42 () {58 vars in 1282 bytes} [Thu Jul 28 08:25:12 2022] GET /identity/v3/auth/tokens => generated 1464 bytes in 399 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 28 08:25:12.655915 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-571d8387-1bee-4039-b600-6f66985bad81 None admin] Authenticating user token {{(pid=207601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:25:12.743403 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d269dae8-5c90-434f-ba94-9215246675d2 None admin] Validating token access rules against request {{(pid=207600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:25:12.789323 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4659058d-829a-45f2-8ee4-0309a8400832 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:25:12.790282 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4659058d-829a-45f2-8ee4-0309a8400832 None admin] REQUEST_METHOD: `GET` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:25:12.790750 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4659058d-829a-45f2-8ee4-0309a8400832 None admin] SCRIPT_NAME: `/identity` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:25:12.790998 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4659058d-829a-45f2-8ee4-0309a8400832 None admin] PATH_INFO: `/v3/services` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:25:12.791716 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4659058d-829a-45f2-8ee4-0309a8400832 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=207600) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:25:12.792029 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4659058d-829a-45f2-8ee4-0309a8400832 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:25:12.793706 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4659058d-829a-45f2-8ee4-0309a8400832 None admin] RBAC: Authorization granted {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:25:12.794563 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG dbcounter [-] [207601] Writing DB stats keystone:SELECT=100 {{(pid=207601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:25:12.798206 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-571d8387-1bee-4039-b600-6f66985bad81 None admin] Validating token access rules against request {{(pid=207601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:25:12.807700 dv-cinder-851351-1-smb devstack@keystone.service[207600]: [pid: 207600|app: 0|req: 485/971] 10.222.0.42 () {56 vars in 1122 bytes} [Thu Jul 28 08:25:12 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:25:12.807700 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4659058d-829a-45f2-8ee4-0309a8400832 None admin] Authenticating user token {{(pid=207600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:25:12.843916 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4608aa3c-b5da-4195-9ba9-8b2466cb5fd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:25:12.844582 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4608aa3c-b5da-4195-9ba9-8b2466cb5fd7 None admin] REQUEST_METHOD: `GET` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:25:12.844969 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4608aa3c-b5da-4195-9ba9-8b2466cb5fd7 None admin] SCRIPT_NAME: `/identity` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:25:12.845247 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4608aa3c-b5da-4195-9ba9-8b2466cb5fd7 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:25:12.854196 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4608aa3c-b5da-4195-9ba9-8b2466cb5fd7 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:25:12.855813 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4608aa3c-b5da-4195-9ba9-8b2466cb5fd7 None admin] RBAC: Authorization granted {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:25:12.869020 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application [None req-4608aa3c-b5da-4195-9ba9-8b2466cb5fd7 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jul 28 08:25:12.869020 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:25:12.869020 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:25:12.869020 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:25:12.869020 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:25:12.869020 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:25:12.869020 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:25:12.869020 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:25:12.869020 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:25:12.869020 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:25:12.869020 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:25:12.869020 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:25:12.869020 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 28 08:25:12.869020 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 28 08:25:12.869020 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 28 08:25:12.869020 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 28 08:25:12.870263 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:25:12.870263 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:25:12.870263 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 28 08:25:12.870263 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 08:25:12.870263 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 28 08:25:12.870263 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 08:25:12.870263 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:25:12.870263 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:25:12.870263 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:25:12.870263 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:25:12.870263 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:25:12.870263 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application with Lock( Jul 28 08:25:12.870263 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:25:12.870263 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:25:12.870263 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:25:12.870263 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:25:12.870263 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:25:12.870263 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:25:12.871923 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:25:12.871923 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:25:12.871923 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 28 08:25:12.871923 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 28 08:25:12.871923 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 28 08:25:12.871923 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 28 08:25:12.871923 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 28 08:25:12.871923 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 28 08:25:12.871923 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jul 28 08:25:12.871923 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application Jul 28 08:25:12.872600 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG dbcounter [-] [207600] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=207600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:25:12.872711 dv-cinder-851351-1-smb devstack@keystone.service[207601]: [pid: 207601|app: 0|req: 487/972] 10.222.0.42 () {56 vars in 1099 bytes} [Thu Jul 28 08:25:12 2022] GET /identity/v3/users/cinder => generated 84 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:25:12.876717 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4608aa3c-b5da-4195-9ba9-8b2466cb5fd7 None admin] Authenticating user token {{(pid=207601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:25:12.941307 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4659058d-829a-45f2-8ee4-0309a8400832 None admin] Validating token access rules against request {{(pid=207600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:25:12.979235 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e978c6a0-9461-4d30-86d1-2cd4c78b872c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:25:12.979903 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e978c6a0-9461-4d30-86d1-2cd4c78b872c None admin] REQUEST_METHOD: `GET` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:25:12.980194 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e978c6a0-9461-4d30-86d1-2cd4c78b872c None admin] SCRIPT_NAME: `/identity` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:25:12.980466 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e978c6a0-9461-4d30-86d1-2cd4c78b872c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:25:12.993073 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e978c6a0-9461-4d30-86d1-2cd4c78b872c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:25:12.994352 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4608aa3c-b5da-4195-9ba9-8b2466cb5fd7 None admin] Validating token access rules against request {{(pid=207601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:25:12.994796 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e978c6a0-9461-4d30-86d1-2cd4c78b872c None admin] RBAC: Authorization granted {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:25:13.010367 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application [None req-e978c6a0-9461-4d30-86d1-2cd4c78b872c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 08:25:13.010367 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:25:13.010367 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:25:13.010367 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:25:13.010367 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:25:13.010367 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:25:13.010367 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:25:13.010367 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:25:13.010367 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:25:13.010367 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:25:13.010367 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:25:13.010367 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:25:13.010367 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 08:25:13.010367 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 08:25:13.010367 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 08:25:13.011378 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 08:25:13.011378 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:25:13.011378 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:25:13.011378 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:25:13.011378 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:25:13.011378 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:25:13.011378 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:25:13.011378 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:25:13.011378 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application with Lock( Jul 28 08:25:13.011378 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:25:13.011378 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:25:13.011378 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:25:13.011378 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:25:13.011378 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:25:13.011378 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:25:13.011378 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:25:13.011378 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:25:13.012404 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 08:25:13.012404 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 08:25:13.012404 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 08:25:13.012404 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application Jul 28 08:25:13.012404 dv-cinder-851351-1-smb devstack@keystone.service[207600]: [pid: 207600|app: 0|req: 486/973] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 08:25:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:25:13.012752 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e978c6a0-9461-4d30-86d1-2cd4c78b872c None admin] Authenticating user token {{(pid=207600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:25:13.042177 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-577531e2-74ad-43a6-b969-67238843d3e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:25:13.043171 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577531e2-74ad-43a6-b969-67238843d3e4 None admin] REQUEST_METHOD: `POST` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:25:13.043493 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577531e2-74ad-43a6-b969-67238843d3e4 None admin] SCRIPT_NAME: `/identity` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:25:13.043948 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577531e2-74ad-43a6-b969-67238843d3e4 None admin] PATH_INFO: `/v3/endpoints` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:25:13.044509 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-577531e2-74ad-43a6-b969-67238843d3e4 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:25:13.046032 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-577531e2-74ad-43a6-b969-67238843d3e4 None admin] RBAC: Authorization granted {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:25:13.071897 dv-cinder-851351-1-smb devstack@keystone.service[207601]: [pid: 207601|app: 0|req: 488/974] 10.222.0.42 () {60 vars in 1144 bytes} [Thu Jul 28 08:25:12 2022] POST /identity/v3/endpoints => generated 349 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 08:25:13.073389 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-577531e2-74ad-43a6-b969-67238843d3e4 None admin] Authenticating user token {{(pid=207601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:25:13.097048 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG dbcounter [-] [207601] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=207601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:25:13.147177 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e978c6a0-9461-4d30-86d1-2cd4c78b872c None admin] Validating token access rules against request {{(pid=207600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:25:13.151558 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG dbcounter [-] [207600] Writing DB stats keystone:SELECT=100 {{(pid=207600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:25:13.216546 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e19e9d-8632-4c2e-b688-3c3c19fb89d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:25:13.217234 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e19e9d-8632-4c2e-b688-3c3c19fb89d6 None admin] REQUEST_METHOD: `GET` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:25:13.217519 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e19e9d-8632-4c2e-b688-3c3c19fb89d6 None admin] SCRIPT_NAME: `/identity` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:25:13.217797 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e19e9d-8632-4c2e-b688-3c3c19fb89d6 None admin] PATH_INFO: `/v3/users` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:25:13.218602 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02e19e9d-8632-4c2e-b688-3c3c19fb89d6 None admin] RBAC: Adding query filter params (name=cinder) {{(pid=207600) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:25:13.218912 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02e19e9d-8632-4c2e-b688-3c3c19fb89d6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:25:13.220765 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02e19e9d-8632-4c2e-b688-3c3c19fb89d6 None admin] RBAC: Authorization granted {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:25:13.221696 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-577531e2-74ad-43a6-b969-67238843d3e4 None admin] Validating token access rules against request {{(pid=207601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:25:13.269479 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3505ef88-e78a-443e-8439-4b7f347c2053 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:25:13.270061 dv-cinder-851351-1-smb devstack@keystone.service[207600]: [pid: 207600|app: 0|req: 487/975] 10.222.0.42 () {56 vars in 1101 bytes} [Thu Jul 28 08:25:13 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:25:13.270814 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3505ef88-e78a-443e-8439-4b7f347c2053 None admin] REQUEST_METHOD: `GET` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:25:13.271299 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3505ef88-e78a-443e-8439-4b7f347c2053 None admin] SCRIPT_NAME: `/identity` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:25:13.271791 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3505ef88-e78a-443e-8439-4b7f347c2053 None admin] PATH_INFO: `/v3/domains` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:25:13.272795 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3505ef88-e78a-443e-8439-4b7f347c2053 None admin] RBAC: Adding query filter params (name=Default) {{(pid=207601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:25:13.273318 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3505ef88-e78a-443e-8439-4b7f347c2053 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:25:13.275139 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3505ef88-e78a-443e-8439-4b7f347c2053 None admin] RBAC: Authorization granted {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:25:13.289979 dv-cinder-851351-1-smb devstack@keystone.service[207601]: [pid: 207601|app: 0|req: 489/976] 10.222.0.42 () {56 vars in 1109 bytes} [Thu Jul 28 08:25:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:25:13.296303 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e19e9d-8632-4c2e-b688-3c3c19fb89d6 None admin] Authenticating user token {{(pid=207600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:25:13.420240 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e19e9d-8632-4c2e-b688-3c3c19fb89d6 None admin] Validating token access rules against request {{(pid=207600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:25:13.460041 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50cffdba-76f0-4161-b2f3-14dca9b4ebcf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:25:13.461260 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50cffdba-76f0-4161-b2f3-14dca9b4ebcf None admin] REQUEST_METHOD: `GET` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:25:13.461260 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50cffdba-76f0-4161-b2f3-14dca9b4ebcf None admin] SCRIPT_NAME: `/identity` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:25:13.461523 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50cffdba-76f0-4161-b2f3-14dca9b4ebcf None admin] PATH_INFO: `/v3/projects/service` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:25:13.469511 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50cffdba-76f0-4161-b2f3-14dca9b4ebcf None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:25:13.470943 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50cffdba-76f0-4161-b2f3-14dca9b4ebcf None admin] RBAC: Authorization granted {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:25:13.483115 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application [None req-50cffdba-76f0-4161-b2f3-14dca9b4ebcf None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 08:25:13.483115 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:25:13.483115 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:25:13.483115 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:25:13.483115 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:25:13.483115 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:25:13.483115 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:25:13.483115 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:25:13.483115 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:25:13.483115 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:25:13.483115 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:25:13.483115 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:25:13.483115 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 28 08:25:13.483115 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 28 08:25:13.483115 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 28 08:25:13.484100 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 28 08:25:13.484100 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:25:13.484100 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:25:13.484100 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:25:13.484100 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:25:13.484100 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:25:13.484100 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:25:13.484100 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:25:13.484100 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application with Lock( Jul 28 08:25:13.484100 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:25:13.484100 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:25:13.484100 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:25:13.484100 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:25:13.484100 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:25:13.484100 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:25:13.484100 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:25:13.484100 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:25:13.485086 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 28 08:25:13.485086 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 28 08:25:13.485086 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 28 08:25:13.485086 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 28 08:25:13.485086 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 28 08:25:13.485086 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 28 08:25:13.485086 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 08:25:13.485086 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application Jul 28 08:25:13.485086 dv-cinder-851351-1-smb devstack@keystone.service[207600]: [pid: 207600|app: 0|req: 488/977] 10.222.0.42 () {56 vars in 1111 bytes} [Thu Jul 28 08:25:13 2022] GET /identity/v3/projects/service => generated 88 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:25:13.492058 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3505ef88-e78a-443e-8439-4b7f347c2053 None admin] Authenticating user token {{(pid=207601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:25:13.577495 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG dbcounter [-] [207601] Writing DB stats keystone:SELECT=100 {{(pid=207601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:25:13.610237 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3505ef88-e78a-443e-8439-4b7f347c2053 None admin] Validating token access rules against request {{(pid=207601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:25:13.649358 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e259a3-b131-445f-ae2c-ba94c9d8b1ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:25:13.650019 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e259a3-b131-445f-ae2c-ba94c9d8b1ef None admin] REQUEST_METHOD: `GET` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:25:13.650303 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e259a3-b131-445f-ae2c-ba94c9d8b1ef None admin] SCRIPT_NAME: `/identity` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:25:13.650580 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e259a3-b131-445f-ae2c-ba94c9d8b1ef None admin] PATH_INFO: `/v3/projects` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:25:13.651364 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22e259a3-b131-445f-ae2c-ba94c9d8b1ef None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=207601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:25:13.651676 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22e259a3-b131-445f-ae2c-ba94c9d8b1ef None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:25:13.653183 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22e259a3-b131-445f-ae2c-ba94c9d8b1ef None admin] RBAC: Authorization granted {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:25:13.671968 dv-cinder-851351-1-smb devstack@keystone.service[207601]: [pid: 207601|app: 0|req: 490/978] 10.222.0.42 () {56 vars in 1148 bytes} [Thu Jul 28 08:25:13 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:25:13.673706 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50cffdba-76f0-4161-b2f3-14dca9b4ebcf None admin] Authenticating user token {{(pid=207600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:25:13.695234 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG dbcounter [-] [207600] Writing DB stats keystone:SELECT=100 {{(pid=207600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:25:13.782373 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50cffdba-76f0-4161-b2f3-14dca9b4ebcf None admin] Validating token access rules against request {{(pid=207600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:25:13.819140 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b964e1cd-c209-49b2-9f14-c0b9525d2933 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:25:13.819860 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b964e1cd-c209-49b2-9f14-c0b9525d2933 None admin] REQUEST_METHOD: `GET` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:25:13.820209 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b964e1cd-c209-49b2-9f14-c0b9525d2933 None admin] SCRIPT_NAME: `/identity` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:25:13.820554 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b964e1cd-c209-49b2-9f14-c0b9525d2933 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:25:13.821548 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b964e1cd-c209-49b2-9f14-c0b9525d2933 None admin] RBAC: Adding query filter params (role.id=a67e4d87d7f74c65a98b947bd4f6c11d, scope.project.id=48c5f2b2ae2b48758b957d2b194a7fd1, user.id=601010c3acdf446bb37ff23cbed0dcf1) {{(pid=207600) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:25:13.821926 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b964e1cd-c209-49b2-9f14-c0b9525d2933 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:25:13.823440 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b964e1cd-c209-49b2-9f14-c0b9525d2933 None admin] RBAC: Authorization granted {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:25:13.830199 dv-cinder-851351-1-smb devstack@keystone.service[207600]: [pid: 207600|app: 0|req: 489/979] 10.222.0.42 () {56 vars in 1374 bytes} [Thu Jul 28 08:25:13 2022] GET /identity/v3/role_assignments?user.id=601010c3acdf446bb37ff23cbed0dcf1&scope.project.id=48c5f2b2ae2b48758b957d2b194a7fd1&role.id=a67e4d87d7f74c65a98b947bd4f6c11d => generated 608 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:25:14.086772 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4369fca6-062d-4c97-a034-15155354b57f None None] REQUEST_METHOD: `GET` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:25:14.087662 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4369fca6-062d-4c97-a034-15155354b57f None None] SCRIPT_NAME: `/identity` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:25:14.087662 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4369fca6-062d-4c97-a034-15155354b57f None None] PATH_INFO: `/` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:25:14.088968 dv-cinder-851351-1-smb devstack@keystone.service[207601]: [pid: 207601|app: 0|req: 491/980] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 08:25:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 08:25:14.094714 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c387c5f1-fb33-46b7-b264-561c567fe714 None None] REQUEST_METHOD: `POST` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:25:14.095185 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c387c5f1-fb33-46b7-b264-561c567fe714 None None] SCRIPT_NAME: `/identity` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:25:14.095275 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c387c5f1-fb33-46b7-b264-561c567fe714 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:25:14.114728 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.auth.core [None req-c387c5f1-fb33-46b7-b264-561c567fe714 None None] MFA Rules not processed for user `b8110ade874c4aa7af27f5c376df700a`. Rule list: `[]` (Enabled: `True`). {{(pid=207600) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 08:25:14.116287 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.fernet_utils [None req-c387c5f1-fb33-46b7-b264-561c567fe714 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=207600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:25:14.189835 dv-cinder-851351-1-smb devstack@keystone.service[207600]: [pid: 207600|app: 0|req: 490/981] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 08:25:14 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 08:25:14.212975 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4369fca6-062d-4c97-a034-15155354b57f None None] Authenticating user token {{(pid=207601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:25:14.325038 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4369fca6-062d-4c97-a034-15155354b57f None None] Validating token access rules against request {{(pid=207601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:25:14.357038 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG dbcounter [-] [207601] Writing DB stats keystone:SELECT=100 {{(pid=207601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:25:14.362917 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2195d299-1b3a-4b61-b785-6e3a488ef6c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:25:14.363958 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2195d299-1b3a-4b61-b785-6e3a488ef6c4 None admin] REQUEST_METHOD: `POST` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:25:14.364604 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2195d299-1b3a-4b61-b785-6e3a488ef6c4 None admin] SCRIPT_NAME: `/identity` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:25:14.364924 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2195d299-1b3a-4b61-b785-6e3a488ef6c4 None admin] PATH_INFO: `/v3/services` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:25:14.365645 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2195d299-1b3a-4b61-b785-6e3a488ef6c4 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:25:14.367039 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2195d299-1b3a-4b61-b785-6e3a488ef6c4 None admin] RBAC: Authorization granted {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:25:14.388547 dv-cinder-851351-1-smb devstack@keystone.service[207601]: [pid: 207601|app: 0|req: 492/982] 10.222.0.42 () {60 vars in 1141 bytes} [Thu Jul 28 08:25:14 2022] POST /identity/v3/services => generated 242 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 28 08:25:15.145392 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8464c8-9dd6-44e1-b4a6-d51235f23187 None None] REQUEST_METHOD: `GET` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:25:15.145982 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8464c8-9dd6-44e1-b4a6-d51235f23187 None None] SCRIPT_NAME: `/identity` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:25:15.145982 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8464c8-9dd6-44e1-b4a6-d51235f23187 None None] PATH_INFO: `/` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:25:15.148402 dv-cinder-851351-1-smb devstack@keystone.service[207600]: [pid: 207600|app: 0|req: 491/983] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 08:25:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 08:25:15.153335 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12f7d0c-e359-4435-81d8-f8ad58170a85 None None] REQUEST_METHOD: `POST` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:25:15.153770 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12f7d0c-e359-4435-81d8-f8ad58170a85 None None] SCRIPT_NAME: `/identity` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:25:15.153770 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12f7d0c-e359-4435-81d8-f8ad58170a85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:25:15.172911 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.auth.core [None req-f12f7d0c-e359-4435-81d8-f8ad58170a85 None None] MFA Rules not processed for user `b8110ade874c4aa7af27f5c376df700a`. Rule list: `[]` (Enabled: `True`). {{(pid=207601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 08:25:15.174112 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.fernet_utils [None req-f12f7d0c-e359-4435-81d8-f8ad58170a85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=207601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:25:15.260697 dv-cinder-851351-1-smb devstack@keystone.service[207601]: [pid: 207601|app: 0|req: 493/984] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 08:25:15 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 08:25:15.275789 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8464c8-9dd6-44e1-b4a6-d51235f23187 None None] Authenticating user token {{(pid=207600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:25:15.292312 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG dbcounter [-] [207600] Writing DB stats keystone:SELECT=100 {{(pid=207600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:25:15.385073 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8464c8-9dd6-44e1-b4a6-d51235f23187 None None] Validating token access rules against request {{(pid=207600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:25:15.420196 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4046c73-f49a-4008-9607-f83cfa4dd753 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:25:15.420802 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4046c73-f49a-4008-9607-f83cfa4dd753 None admin] REQUEST_METHOD: `GET` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:25:15.421092 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4046c73-f49a-4008-9607-f83cfa4dd753 None admin] SCRIPT_NAME: `/identity` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:25:15.421371 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4046c73-f49a-4008-9607-f83cfa4dd753 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:25:15.422015 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4046c73-f49a-4008-9607-f83cfa4dd753 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:25:15.423408 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4046c73-f49a-4008-9607-f83cfa4dd753 None admin] RBAC: Authorization granted {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:25:15.432892 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application [None req-c4046c73-f49a-4008-9607-f83cfa4dd753 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 28 08:25:15.432892 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:25:15.432892 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 28 08:25:15.432892 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 28 08:25:15.432892 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 28 08:25:15.432892 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 28 08:25:15.432892 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 28 08:25:15.432892 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 08:25:15.432892 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 28 08:25:15.432892 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application Jul 28 08:25:15.432892 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 28 08:25:15.432892 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application Jul 28 08:25:15.432892 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:25:15.432892 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:25:15.432892 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:25:15.432892 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:25:15.432892 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:25:15.433941 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:25:15.433941 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:25:15.433941 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:25:15.433941 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:25:15.433941 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:25:15.433941 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:25:15.433941 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 28 08:25:15.433941 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 28 08:25:15.433941 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 28 08:25:15.433941 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 28 08:25:15.433941 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:25:15.433941 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:25:15.433941 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:25:15.433941 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:25:15.433941 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:25:15.433941 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:25:15.434923 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:25:15.434923 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application with Lock( Jul 28 08:25:15.434923 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:25:15.434923 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:25:15.434923 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:25:15.434923 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:25:15.434923 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:25:15.434923 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:25:15.434923 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:25:15.434923 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:25:15.434923 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 28 08:25:15.434923 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 08:25:15.434923 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 28 08:25:15.434923 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application Jul 28 08:25:15.436764 dv-cinder-851351-1-smb devstack@keystone.service[207600]: [pid: 207600|app: 0|req: 492/985] 10.222.0.42 () {56 vars in 1126 bytes} [Thu Jul 28 08:25:15 2022] GET /identity/v3/services/object-store => generated 93 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:25:15.440755 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12f7d0c-e359-4435-81d8-f8ad58170a85 None None] Authenticating user token {{(pid=207601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:25:15.551065 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12f7d0c-e359-4435-81d8-f8ad58170a85 None None] Validating token access rules against request {{(pid=207601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:25:15.572246 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG dbcounter [-] [207601] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=207601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:25:15.594966 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd54c5ca-2bfd-47f9-9093-5843d8d5fb11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:25:15.595702 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd54c5ca-2bfd-47f9-9093-5843d8d5fb11 None admin] REQUEST_METHOD: `GET` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:25:15.595984 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd54c5ca-2bfd-47f9-9093-5843d8d5fb11 None admin] SCRIPT_NAME: `/identity` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:25:15.596257 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd54c5ca-2bfd-47f9-9093-5843d8d5fb11 None admin] PATH_INFO: `/v3/services` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:25:15.597092 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd54c5ca-2bfd-47f9-9093-5843d8d5fb11 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=207601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:25:15.597413 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd54c5ca-2bfd-47f9-9093-5843d8d5fb11 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:25:15.598827 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd54c5ca-2bfd-47f9-9093-5843d8d5fb11 None admin] RBAC: Authorization granted {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:25:15.609713 dv-cinder-851351-1-smb devstack@keystone.service[207601]: [pid: 207601|app: 0|req: 494/986] 10.222.0.42 () {56 vars in 1122 bytes} [Thu Jul 28 08:25:15 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:25:15.610822 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4046c73-f49a-4008-9607-f83cfa4dd753 None admin] Authenticating user token {{(pid=207600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:25:15.700205 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG dbcounter [-] [207600] Writing DB stats keystone:SELECT=100 {{(pid=207600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:25:15.726633 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4046c73-f49a-4008-9607-f83cfa4dd753 None admin] Validating token access rules against request {{(pid=207600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:25:15.762671 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2594badb-edf7-4602-a245-64c9e47c0698 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:25:15.763322 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2594badb-edf7-4602-a245-64c9e47c0698 None admin] REQUEST_METHOD: `GET` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:25:15.763602 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2594badb-edf7-4602-a245-64c9e47c0698 None admin] SCRIPT_NAME: `/identity` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:25:15.763874 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2594badb-edf7-4602-a245-64c9e47c0698 None admin] PATH_INFO: `/v3/services` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:25:15.764583 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2594badb-edf7-4602-a245-64c9e47c0698 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=207600) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:25:15.764921 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2594badb-edf7-4602-a245-64c9e47c0698 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:25:15.766350 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2594badb-edf7-4602-a245-64c9e47c0698 None admin] RBAC: Authorization granted {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:25:15.772434 dv-cinder-851351-1-smb devstack@keystone.service[207600]: [pid: 207600|app: 0|req: 493/987] 10.222.0.42 () {56 vars in 1122 bytes} [Thu Jul 28 08:25:15 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:25:15.778654 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd54c5ca-2bfd-47f9-9093-5843d8d5fb11 None admin] Authenticating user token {{(pid=207601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:25:15.883385 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae59340-39f0-4628-8b8a-16a1b20e2627 None None] REQUEST_METHOD: `GET` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:25:15.884006 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae59340-39f0-4628-8b8a-16a1b20e2627 None None] SCRIPT_NAME: `/identity` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:25:15.884291 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae59340-39f0-4628-8b8a-16a1b20e2627 None None] PATH_INFO: `/` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:25:15.886131 dv-cinder-851351-1-smb devstack@keystone.service[207600]: [pid: 207600|app: 0|req: 494/988] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 08:25:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 08:25:15.891497 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34ba06b-1c7b-447a-9c0e-aec458ee3d5e None None] REQUEST_METHOD: `POST` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:25:15.891878 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34ba06b-1c7b-447a-9c0e-aec458ee3d5e None None] SCRIPT_NAME: `/identity` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:25:15.892056 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34ba06b-1c7b-447a-9c0e-aec458ee3d5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:25:15.898202 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd54c5ca-2bfd-47f9-9093-5843d8d5fb11 None admin] Validating token access rules against request {{(pid=207601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:25:15.919178 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.auth.core [None req-a34ba06b-1c7b-447a-9c0e-aec458ee3d5e None None] MFA Rules not processed for user `b8110ade874c4aa7af27f5c376df700a`. Rule list: `[]` (Enabled: `True`). {{(pid=207600) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 08:25:15.920429 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.fernet_utils [None req-a34ba06b-1c7b-447a-9c0e-aec458ee3d5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=207600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:25:15.936006 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33e337b-e8d0-43c7-ab20-45d133690624 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:25:15.936652 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33e337b-e8d0-43c7-ab20-45d133690624 None admin] REQUEST_METHOD: `GET` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:25:15.937232 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33e337b-e8d0-43c7-ab20-45d133690624 None admin] SCRIPT_NAME: `/identity` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:25:15.937232 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33e337b-e8d0-43c7-ab20-45d133690624 None admin] PATH_INFO: `/v3/endpoints` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:25:15.938042 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f33e337b-e8d0-43c7-ab20-45d133690624 None admin] RBAC: Adding query filter params (interface=admin, service_id=190e9bb6c95846f5b0c28f4cecf329b9, region_id=RegionOne) {{(pid=207601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:25:15.938311 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f33e337b-e8d0-43c7-ab20-45d133690624 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:25:15.939700 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f33e337b-e8d0-43c7-ab20-45d133690624 None admin] RBAC: Authorization granted {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:25:15.946761 dv-cinder-851351-1-smb devstack@keystone.service[207601]: [pid: 207601|app: 0|req: 495/989] 10.222.0.42 () {56 vars in 1249 bytes} [Thu Jul 28 08:25:15 2022] GET /identity/v3/endpoints?service_id=190e9bb6c95846f5b0c28f4cecf329b9&interface=admin®ion_id=RegionOne => generated 193 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:25:15.952329 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33e337b-e8d0-43c7-ab20-45d133690624 None admin] Authenticating user token {{(pid=207601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:25:16.001113 dv-cinder-851351-1-smb devstack@keystone.service[207600]: [pid: 207600|app: 0|req: 495/990] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 08:25:15 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 28 08:25:16.011186 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG dbcounter [-] [207601] Writing DB stats keystone:SELECT=100 {{(pid=207601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:25:16.025211 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a34ba06b-1c7b-447a-9c0e-aec458ee3d5e None None] Authenticating user token {{(pid=207600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:25:16.070178 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33e337b-e8d0-43c7-ab20-45d133690624 None admin] Validating token access rules against request {{(pid=207601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:25:16.102248 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG dbcounter [-] [207600] Writing DB stats keystone:SELECT=100 {{(pid=207600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:25:16.110581 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5705f9-2241-461d-a7a9-dbaa73ae6509 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:25:16.111236 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5705f9-2241-461d-a7a9-dbaa73ae6509 None admin] REQUEST_METHOD: `GET` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:25:16.111523 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5705f9-2241-461d-a7a9-dbaa73ae6509 None admin] SCRIPT_NAME: `/identity` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:25:16.111802 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5705f9-2241-461d-a7a9-dbaa73ae6509 None admin] PATH_INFO: `/v3/services` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:25:16.112473 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc5705f9-2241-461d-a7a9-dbaa73ae6509 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:25:16.113925 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc5705f9-2241-461d-a7a9-dbaa73ae6509 None admin] RBAC: Authorization granted {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:25:16.121018 dv-cinder-851351-1-smb devstack@keystone.service[207601]: [pid: 207601|app: 0|req: 496/991] 10.222.0.42 () {56 vars in 1087 bytes} [Thu Jul 28 08:25:15 2022] GET /identity/v3/services => generated 1727 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 28 08:25:16.146588 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a34ba06b-1c7b-447a-9c0e-aec458ee3d5e None None] Validating token access rules against request {{(pid=207600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:25:16.196475 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c97ccb-82b1-43e9-a548-ac429cc38316 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:25:16.197639 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c97ccb-82b1-43e9-a548-ac429cc38316 None admin] REQUEST_METHOD: `GET` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:25:16.198113 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c97ccb-82b1-43e9-a548-ac429cc38316 None admin] SCRIPT_NAME: `/identity` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:25:16.198506 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c97ccb-82b1-43e9-a548-ac429cc38316 None admin] PATH_INFO: `/v3/services/image` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:25:16.199574 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02c97ccb-82b1-43e9-a548-ac429cc38316 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:25:16.201543 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02c97ccb-82b1-43e9-a548-ac429cc38316 None admin] RBAC: Authorization granted {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:25:16.213038 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application [None req-02c97ccb-82b1-43e9-a548-ac429cc38316 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jul 28 08:25:16.213038 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:25:16.213038 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 28 08:25:16.213038 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 28 08:25:16.213038 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 28 08:25:16.213038 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 28 08:25:16.213038 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 28 08:25:16.213038 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 08:25:16.213038 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 28 08:25:16.213038 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application Jul 28 08:25:16.213038 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 28 08:25:16.213038 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application Jul 28 08:25:16.213038 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:25:16.213038 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:25:16.213038 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:25:16.213038 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:25:16.213038 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:25:16.214231 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:25:16.214231 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:25:16.214231 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:25:16.214231 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:25:16.214231 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:25:16.214231 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:25:16.214231 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 28 08:25:16.214231 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 28 08:25:16.214231 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 28 08:25:16.214231 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 28 08:25:16.214231 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:25:16.214231 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:25:16.214231 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:25:16.214231 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:25:16.214231 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:25:16.214231 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:25:16.215176 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:25:16.215176 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application with Lock( Jul 28 08:25:16.215176 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:25:16.215176 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:25:16.215176 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:25:16.215176 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:25:16.215176 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:25:16.215176 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:25:16.215176 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:25:16.215176 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:25:16.215176 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 28 08:25:16.215176 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 08:25:16.215176 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 28 08:25:16.215176 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application Jul 28 08:25:16.216842 dv-cinder-851351-1-smb devstack@keystone.service[207600]: [pid: 207600|app: 0|req: 496/992] 10.222.0.42 () {56 vars in 1105 bytes} [Thu Jul 28 08:25:16 2022] GET /identity/v3/services/image => generated 86 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 08:25:16.221270 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5705f9-2241-461d-a7a9-dbaa73ae6509 None admin] Authenticating user token {{(pid=207601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:25:16.347178 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5705f9-2241-461d-a7a9-dbaa73ae6509 None admin] Validating token access rules against request {{(pid=207601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:25:16.360002 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG dbcounter [-] [207601] Writing DB stats keystone:SELECT=100 {{(pid=207601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:25:16.398940 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b4c8fc-6a10-4d4c-b55f-3a71e89319dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:25:16.399628 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b4c8fc-6a10-4d4c-b55f-3a71e89319dc None admin] REQUEST_METHOD: `GET` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:25:16.399898 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b4c8fc-6a10-4d4c-b55f-3a71e89319dc None admin] SCRIPT_NAME: `/identity` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:25:16.400435 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b4c8fc-6a10-4d4c-b55f-3a71e89319dc None admin] PATH_INFO: `/v3/services` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:25:16.400975 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49b4c8fc-6a10-4d4c-b55f-3a71e89319dc None admin] RBAC: Adding query filter params (name=image) {{(pid=207601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:25:16.401208 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49b4c8fc-6a10-4d4c-b55f-3a71e89319dc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:25:16.402604 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49b4c8fc-6a10-4d4c-b55f-3a71e89319dc None admin] RBAC: Authorization granted {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:25:16.412868 dv-cinder-851351-1-smb devstack@keystone.service[207601]: [pid: 207601|app: 0|req: 497/993] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 08:25:16 2022] GET /identity/v3/services?name=image => generated 122 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 08:25:16.415085 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c97ccb-82b1-43e9-a548-ac429cc38316 None admin] Authenticating user token {{(pid=207600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:25:16.424946 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1dd2de-0c1a-47cb-add4-b7f5a4b343da None None] REQUEST_METHOD: `GET` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:25:16.425265 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1dd2de-0c1a-47cb-add4-b7f5a4b343da None None] SCRIPT_NAME: `/identity` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:25:16.425517 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1dd2de-0c1a-47cb-add4-b7f5a4b343da None None] PATH_INFO: `/` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:25:16.426903 dv-cinder-851351-1-smb devstack@keystone.service[207601]: [pid: 207601|app: 0|req: 498/994] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 08:25:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 28 08:25:16.433211 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e033fb74-719e-402b-b51e-a9a508e1a382 None None] REQUEST_METHOD: `POST` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:25:16.433620 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e033fb74-719e-402b-b51e-a9a508e1a382 None None] SCRIPT_NAME: `/identity` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:25:16.434373 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e033fb74-719e-402b-b51e-a9a508e1a382 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:25:16.455977 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.auth.core [None req-e033fb74-719e-402b-b51e-a9a508e1a382 None None] MFA Rules not processed for user `b8110ade874c4aa7af27f5c376df700a`. Rule list: `[]` (Enabled: `True`). {{(pid=207601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 08:25:16.457256 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.fernet_utils [None req-e033fb74-719e-402b-b51e-a9a508e1a382 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=207601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:25:16.550572 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c97ccb-82b1-43e9-a548-ac429cc38316 None admin] Validating token access rules against request {{(pid=207600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:25:16.556340 dv-cinder-851351-1-smb devstack@keystone.service[207601]: [pid: 207601|app: 0|req: 499/995] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 08:25:16 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 28 08:25:16.579600 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e033fb74-719e-402b-b51e-a9a508e1a382 None None] Authenticating user token {{(pid=207601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:25:16.603020 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b585ee9f-f5dd-4d08-b96d-a819d80b7cf9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:25:16.603654 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b585ee9f-f5dd-4d08-b96d-a819d80b7cf9 None admin] REQUEST_METHOD: `GET` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:25:16.604504 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b585ee9f-f5dd-4d08-b96d-a819d80b7cf9 None admin] SCRIPT_NAME: `/identity` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:25:16.604504 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b585ee9f-f5dd-4d08-b96d-a819d80b7cf9 None admin] PATH_INFO: `/v3/services` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:25:16.604951 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b585ee9f-f5dd-4d08-b96d-a819d80b7cf9 None admin] RBAC: Adding query filter params (type=image) {{(pid=207600) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:25:16.605257 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b585ee9f-f5dd-4d08-b96d-a819d80b7cf9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:25:16.606678 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b585ee9f-f5dd-4d08-b96d-a819d80b7cf9 None admin] RBAC: Authorization granted {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:25:16.608255 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG dbcounter [-] [207600] Writing DB stats keystone:SELECT=100 {{(pid=207600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:25:16.618461 dv-cinder-851351-1-smb devstack@keystone.service[207600]: [pid: 207600|app: 0|req: 497/996] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 08:25:16 2022] GET /identity/v3/services?type=image => generated 122 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:25:16.717203 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e033fb74-719e-402b-b51e-a9a508e1a382 None None] Validating token access rules against request {{(pid=207601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:25:16.720046 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG dbcounter [-] [207601] Writing DB stats keystone:SELECT=100 {{(pid=207601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:25:16.759215 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c1fe19-c1d5-478d-a08d-d0839136717c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:25:16.760262 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c1fe19-c1d5-478d-a08d-d0839136717c None admin] REQUEST_METHOD: `GET` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:25:16.760774 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c1fe19-c1d5-478d-a08d-d0839136717c None admin] SCRIPT_NAME: `/identity` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:25:16.761260 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c1fe19-c1d5-478d-a08d-d0839136717c None admin] PATH_INFO: `/v3/services/compute` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:25:16.762154 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c1fe19-c1d5-478d-a08d-d0839136717c None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:25:16.763843 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c1fe19-c1d5-478d-a08d-d0839136717c None admin] RBAC: Authorization granted {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:25:16.774948 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application [None req-d1c1fe19-c1d5-478d-a08d-d0839136717c None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jul 28 08:25:16.774948 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:25:16.774948 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 28 08:25:16.774948 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 28 08:25:16.774948 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 28 08:25:16.774948 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 28 08:25:16.774948 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 28 08:25:16.774948 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 08:25:16.774948 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 28 08:25:16.774948 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application Jul 28 08:25:16.774948 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 28 08:25:16.774948 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application Jul 28 08:25:16.774948 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:25:16.774948 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:25:16.774948 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:25:16.774948 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:25:16.774948 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:25:16.776116 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:25:16.776116 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:25:16.776116 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:25:16.776116 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:25:16.776116 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:25:16.776116 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:25:16.776116 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 28 08:25:16.776116 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 28 08:25:16.776116 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 28 08:25:16.776116 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 28 08:25:16.776116 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:25:16.776116 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:25:16.776116 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:25:16.776116 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:25:16.776116 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:25:16.776116 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:25:16.777077 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:25:16.777077 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application with Lock( Jul 28 08:25:16.777077 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:25:16.777077 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:25:16.777077 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:25:16.777077 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:25:16.777077 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:25:16.777077 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:25:16.777077 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:25:16.777077 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:25:16.777077 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 28 08:25:16.777077 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 08:25:16.777077 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 28 08:25:16.777077 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application Jul 28 08:25:16.777077 dv-cinder-851351-1-smb devstack@keystone.service[207601]: [pid: 207601|app: 0|req: 500/997] 10.222.0.42 () {56 vars in 1111 bytes} [Thu Jul 28 08:25:16 2022] GET /identity/v3/services/compute => generated 88 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:25:16.794113 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b585ee9f-f5dd-4d08-b96d-a819d80b7cf9 None admin] Authenticating user token {{(pid=207600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:25:16.936695 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b585ee9f-f5dd-4d08-b96d-a819d80b7cf9 None admin] Validating token access rules against request {{(pid=207600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:25:16.973244 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890a5c05-3c09-4a94-929c-296726779a33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:25:16.973888 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890a5c05-3c09-4a94-929c-296726779a33 None admin] REQUEST_METHOD: `GET` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:25:16.974171 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890a5c05-3c09-4a94-929c-296726779a33 None admin] SCRIPT_NAME: `/identity` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:25:16.976686 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890a5c05-3c09-4a94-929c-296726779a33 None admin] PATH_INFO: `/v3/services` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:25:16.976686 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-890a5c05-3c09-4a94-929c-296726779a33 None admin] RBAC: Adding query filter params (name=compute) {{(pid=207600) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:25:16.976686 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-890a5c05-3c09-4a94-929c-296726779a33 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:25:16.977094 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-890a5c05-3c09-4a94-929c-296726779a33 None admin] RBAC: Authorization granted {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:25:16.982639 dv-cinder-851351-1-smb devstack@keystone.service[207600]: [pid: 207600|app: 0|req: 498/998] 10.222.0.42 () {56 vars in 1112 bytes} [Thu Jul 28 08:25:16 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:25:16.989982 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c1fe19-c1d5-478d-a08d-d0839136717c None admin] Authenticating user token {{(pid=207601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:25:17.104104 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c1fe19-c1d5-478d-a08d-d0839136717c None admin] Validating token access rules against request {{(pid=207601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:25:17.150593 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b98130a4-55c6-45b5-858e-f0d66c2f9a5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:25:17.151593 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98130a4-55c6-45b5-858e-f0d66c2f9a5b None admin] REQUEST_METHOD: `GET` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:25:17.152109 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98130a4-55c6-45b5-858e-f0d66c2f9a5b None admin] SCRIPT_NAME: `/identity` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:25:17.152390 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98130a4-55c6-45b5-858e-f0d66c2f9a5b None admin] PATH_INFO: `/v3/services` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:25:17.155479 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b98130a4-55c6-45b5-858e-f0d66c2f9a5b None admin] RBAC: Adding query filter params (type=compute) {{(pid=207601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:25:17.155479 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b98130a4-55c6-45b5-858e-f0d66c2f9a5b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:25:17.155479 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b98130a4-55c6-45b5-858e-f0d66c2f9a5b None admin] RBAC: Authorization granted {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:25:17.165765 dv-cinder-851351-1-smb devstack@keystone.service[207601]: [pid: 207601|app: 0|req: 501/999] 10.222.0.42 () {56 vars in 1112 bytes} [Thu Jul 28 08:25:16 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:25:17.169819 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890a5c05-3c09-4a94-929c-296726779a33 None admin] Authenticating user token {{(pid=207600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:25:17.244189 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG dbcounter [-] [207600] Writing DB stats keystone:SELECT=100 {{(pid=207600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:25:17.314019 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890a5c05-3c09-4a94-929c-296726779a33 None admin] Validating token access rules against request {{(pid=207600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:25:17.351478 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527ed6ab-b25f-4eb2-95c9-5a26cd567e11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:25:17.352143 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527ed6ab-b25f-4eb2-95c9-5a26cd567e11 None admin] REQUEST_METHOD: `GET` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:25:17.352424 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527ed6ab-b25f-4eb2-95c9-5a26cd567e11 None admin] SCRIPT_NAME: `/identity` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:25:17.352716 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527ed6ab-b25f-4eb2-95c9-5a26cd567e11 None admin] PATH_INFO: `/v3/endpoints` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:25:17.353542 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-527ed6ab-b25f-4eb2-95c9-5a26cd567e11 None admin] RBAC: Adding query filter params (interface=public, service_id=d4d86027fb764852a2e2142d6f6806ff, region_id=RegionOne) {{(pid=207600) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:25:17.353858 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-527ed6ab-b25f-4eb2-95c9-5a26cd567e11 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:25:17.355255 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-527ed6ab-b25f-4eb2-95c9-5a26cd567e11 None admin] RBAC: Authorization granted {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:25:17.365194 dv-cinder-851351-1-smb devstack@keystone.service[207600]: [pid: 207600|app: 0|req: 499/1000] 10.222.0.42 () {56 vars in 1251 bytes} [Thu Jul 28 08:25:17 2022] GET /identity/v3/endpoints?service_id=d4d86027fb764852a2e2142d6f6806ff&interface=public®ion_id=RegionOne => generated 194 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:25:17.366890 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b98130a4-55c6-45b5-858e-f0d66c2f9a5b None admin] Authenticating user token {{(pid=207601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:25:17.400175 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG dbcounter [-] [207601] Writing DB stats keystone:SELECT=100 {{(pid=207601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:25:17.472101 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b98130a4-55c6-45b5-858e-f0d66c2f9a5b None admin] Validating token access rules against request {{(pid=207601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:25:17.508724 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff4db3c-c194-4e14-9f74-ef10f6c8001f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:25:17.509407 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff4db3c-c194-4e14-9f74-ef10f6c8001f None admin] REQUEST_METHOD: `GET` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:25:17.509709 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff4db3c-c194-4e14-9f74-ef10f6c8001f None admin] SCRIPT_NAME: `/identity` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:25:17.509974 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff4db3c-c194-4e14-9f74-ef10f6c8001f None admin] PATH_INFO: `/v3/services` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:25:17.510637 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ff4db3c-c194-4e14-9f74-ef10f6c8001f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:25:17.512062 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ff4db3c-c194-4e14-9f74-ef10f6c8001f None admin] RBAC: Authorization granted {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:25:17.524759 dv-cinder-851351-1-smb devstack@keystone.service[207601]: [pid: 207601|app: 0|req: 502/1001] 10.222.0.42 () {56 vars in 1087 bytes} [Thu Jul 28 08:25:17 2022] GET /identity/v3/services => generated 1727 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 28 08:25:18.186989 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce6b612-f3c7-4d0e-b365-c49c7547db83 None None] REQUEST_METHOD: `GET` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:25:18.187522 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce6b612-f3c7-4d0e-b365-c49c7547db83 None None] SCRIPT_NAME: `/identity` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:25:18.187522 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce6b612-f3c7-4d0e-b365-c49c7547db83 None None] PATH_INFO: `/` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:25:18.192709 dv-cinder-851351-1-smb devstack@keystone.service[207600]: [pid: 207600|app: 0|req: 500/1002] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 08:25:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 08:25:18.194530 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5364a8aa-4e86-45c3-9a29-dc9aa8649ecb None None] REQUEST_METHOD: `POST` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:25:18.194825 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5364a8aa-4e86-45c3-9a29-dc9aa8649ecb None None] SCRIPT_NAME: `/identity` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:25:18.195105 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5364a8aa-4e86-45c3-9a29-dc9aa8649ecb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:25:18.214406 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.auth.core [None req-5364a8aa-4e86-45c3-9a29-dc9aa8649ecb None None] MFA Rules not processed for user `b8110ade874c4aa7af27f5c376df700a`. Rule list: `[]` (Enabled: `True`). {{(pid=207601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 08:25:18.215649 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.fernet_utils [None req-5364a8aa-4e86-45c3-9a29-dc9aa8649ecb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=207601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:25:18.297521 dv-cinder-851351-1-smb devstack@keystone.service[207601]: [pid: 207601|app: 0|req: 503/1003] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 08:25:18 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 08:25:18.320255 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce6b612-f3c7-4d0e-b365-c49c7547db83 None None] Authenticating user token {{(pid=207600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:25:18.434286 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce6b612-f3c7-4d0e-b365-c49c7547db83 None None] Validating token access rules against request {{(pid=207600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:25:18.460650 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG dbcounter [-] [207600] Writing DB stats keystone:SELECT=100 {{(pid=207600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:25:18.470642 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38de6caa-2c07-4f3c-8fbe-97ce15e7ddf2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:25:18.471307 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38de6caa-2c07-4f3c-8fbe-97ce15e7ddf2 None admin] REQUEST_METHOD: `GET` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:25:18.471585 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38de6caa-2c07-4f3c-8fbe-97ce15e7ddf2 None admin] SCRIPT_NAME: `/identity` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:25:18.471856 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38de6caa-2c07-4f3c-8fbe-97ce15e7ddf2 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:25:18.472499 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38de6caa-2c07-4f3c-8fbe-97ce15e7ddf2 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:25:18.473921 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38de6caa-2c07-4f3c-8fbe-97ce15e7ddf2 None admin] RBAC: Authorization granted {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:25:18.483809 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application [None req-38de6caa-2c07-4f3c-8fbe-97ce15e7ddf2 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 28 08:25:18.483809 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:25:18.483809 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 28 08:25:18.483809 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 28 08:25:18.483809 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 28 08:25:18.483809 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 28 08:25:18.483809 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 28 08:25:18.483809 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 08:25:18.483809 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 28 08:25:18.483809 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application Jul 28 08:25:18.483809 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 28 08:25:18.483809 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application Jul 28 08:25:18.483809 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:25:18.483809 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:25:18.483809 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:25:18.483809 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:25:18.483809 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:25:18.484988 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:25:18.484988 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:25:18.484988 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:25:18.484988 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:25:18.484988 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:25:18.484988 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:25:18.484988 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 28 08:25:18.484988 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 28 08:25:18.484988 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 28 08:25:18.484988 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 28 08:25:18.484988 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:25:18.484988 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:25:18.484988 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:25:18.484988 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:25:18.484988 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:25:18.484988 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:25:18.491117 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:25:18.491117 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application with Lock( Jul 28 08:25:18.491117 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:25:18.491117 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:25:18.491117 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:25:18.491117 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:25:18.491117 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:25:18.491117 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:25:18.491117 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:25:18.491117 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:25:18.491117 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 28 08:25:18.491117 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 08:25:18.491117 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 28 08:25:18.491117 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application Jul 28 08:25:18.491117 dv-cinder-851351-1-smb devstack@keystone.service[207600]: [pid: 207600|app: 0|req: 501/1004] 10.222.0.42 () {56 vars in 1126 bytes} [Thu Jul 28 08:25:18 2022] GET /identity/v3/services/object-store => generated 93 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:25:18.493835 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5364a8aa-4e86-45c3-9a29-dc9aa8649ecb None None] Authenticating user token {{(pid=207601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:25:18.527055 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG dbcounter [-] [207601] Writing DB stats keystone:SELECT=100 {{(pid=207601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:25:18.615418 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5364a8aa-4e86-45c3-9a29-dc9aa8649ecb None None] Validating token access rules against request {{(pid=207601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:25:18.654622 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f06ca9-2037-4998-aee0-e91a54de46cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:25:18.655285 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f06ca9-2037-4998-aee0-e91a54de46cc None admin] REQUEST_METHOD: `GET` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:25:18.655568 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f06ca9-2037-4998-aee0-e91a54de46cc None admin] SCRIPT_NAME: `/identity` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:25:18.655840 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f06ca9-2037-4998-aee0-e91a54de46cc None admin] PATH_INFO: `/v3/services` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:25:18.656545 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99f06ca9-2037-4998-aee0-e91a54de46cc None admin] RBAC: Adding query filter params (name=object-store) {{(pid=207601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:25:18.656909 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99f06ca9-2037-4998-aee0-e91a54de46cc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:25:18.658304 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99f06ca9-2037-4998-aee0-e91a54de46cc None admin] RBAC: Authorization granted {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:25:18.668571 dv-cinder-851351-1-smb devstack@keystone.service[207601]: [pid: 207601|app: 0|req: 504/1005] 10.222.0.42 () {56 vars in 1122 bytes} [Thu Jul 28 08:25:18 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:25:18.670271 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38de6caa-2c07-4f3c-8fbe-97ce15e7ddf2 None admin] Authenticating user token {{(pid=207600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:25:18.730675 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722f23d3-9eb3-4a22-a4fa-e4484ca92fc1 None None] REQUEST_METHOD: `GET` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:25:18.730869 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722f23d3-9eb3-4a22-a4fa-e4484ca92fc1 None None] SCRIPT_NAME: `/identity` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:25:18.731150 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722f23d3-9eb3-4a22-a4fa-e4484ca92fc1 None None] PATH_INFO: `/` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:25:18.732513 dv-cinder-851351-1-smb devstack@keystone.service[207601]: [pid: 207601|app: 0|req: 505/1006] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 08:25:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 28 08:25:18.738017 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f3c836-c601-47c5-9a62-a6a328ed2228 None None] REQUEST_METHOD: `POST` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:25:18.738294 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f3c836-c601-47c5-9a62-a6a328ed2228 None None] SCRIPT_NAME: `/identity` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:25:18.738585 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f3c836-c601-47c5-9a62-a6a328ed2228 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:25:18.757072 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.auth.core [None req-59f3c836-c601-47c5-9a62-a6a328ed2228 None None] MFA Rules not processed for user `b8110ade874c4aa7af27f5c376df700a`. Rule list: `[]` (Enabled: `True`). {{(pid=207601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 08:25:18.758746 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.fernet_utils [None req-59f3c836-c601-47c5-9a62-a6a328ed2228 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=207601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:25:18.789430 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38de6caa-2c07-4f3c-8fbe-97ce15e7ddf2 None admin] Validating token access rules against request {{(pid=207600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:25:18.826488 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da021650-0be6-44d0-9c39-4967b736583f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:25:18.827136 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da021650-0be6-44d0-9c39-4967b736583f None admin] REQUEST_METHOD: `GET` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:25:18.827450 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da021650-0be6-44d0-9c39-4967b736583f None admin] SCRIPT_NAME: `/identity` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:25:18.827695 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da021650-0be6-44d0-9c39-4967b736583f None admin] PATH_INFO: `/v3/services` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:25:18.828436 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da021650-0be6-44d0-9c39-4967b736583f None admin] RBAC: Adding query filter params (type=object-store) {{(pid=207600) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:25:18.828749 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da021650-0be6-44d0-9c39-4967b736583f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:25:18.830196 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da021650-0be6-44d0-9c39-4967b736583f None admin] RBAC: Authorization granted {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:25:18.833202 dv-cinder-851351-1-smb devstack@keystone.service[207601]: [pid: 207601|app: 0|req: 506/1007] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 08:25:18 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 28 08:25:18.840432 dv-cinder-851351-1-smb devstack@keystone.service[207600]: [pid: 207600|app: 0|req: 502/1008] 10.222.0.42 () {56 vars in 1122 bytes} [Thu Jul 28 08:25:18 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:25:18.842201 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f3c836-c601-47c5-9a62-a6a328ed2228 None None] Authenticating user token {{(pid=207601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:25:18.856014 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da021650-0be6-44d0-9c39-4967b736583f None admin] Authenticating user token {{(pid=207600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:25:18.867535 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG dbcounter [-] [207601] Writing DB stats keystone:SELECT=100 {{(pid=207601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:25:18.922904 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG dbcounter [-] [207600] Writing DB stats keystone:SELECT=100 {{(pid=207600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:25:18.962431 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f3c836-c601-47c5-9a62-a6a328ed2228 None None] Validating token access rules against request {{(pid=207601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:25:18.980937 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da021650-0be6-44d0-9c39-4967b736583f None admin] Validating token access rules against request {{(pid=207600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:25:18.999612 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2404e2c9-c700-4d24-bbb8-5f7251b62202 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:25:19.000245 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2404e2c9-c700-4d24-bbb8-5f7251b62202 None admin] REQUEST_METHOD: `POST` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:25:19.000530 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2404e2c9-c700-4d24-bbb8-5f7251b62202 None admin] SCRIPT_NAME: `/identity` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:25:19.000834 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2404e2c9-c700-4d24-bbb8-5f7251b62202 None admin] PATH_INFO: `/v3/endpoints` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:25:19.001579 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2404e2c9-c700-4d24-bbb8-5f7251b62202 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:25:19.002968 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2404e2c9-c700-4d24-bbb8-5f7251b62202 None admin] RBAC: Authorization granted {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:25:19.021804 dv-cinder-851351-1-smb devstack@keystone.service[207601]: [pid: 207601|app: 0|req: 507/1009] 10.222.0.42 () {60 vars in 1144 bytes} [Thu Jul 28 08:25:18 2022] POST /identity/v3/endpoints => generated 325 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 08:25:19.034128 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4291c67d-e047-4cfc-8c03-6551097e9b88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:25:19.035159 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4291c67d-e047-4cfc-8c03-6551097e9b88 None admin] REQUEST_METHOD: `POST` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:25:19.035449 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4291c67d-e047-4cfc-8c03-6551097e9b88 None admin] SCRIPT_NAME: `/identity` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:25:19.035730 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4291c67d-e047-4cfc-8c03-6551097e9b88 None admin] PATH_INFO: `/v3/services` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:25:19.036500 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4291c67d-e047-4cfc-8c03-6551097e9b88 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:25:19.038007 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4291c67d-e047-4cfc-8c03-6551097e9b88 None admin] RBAC: Authorization granted {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:25:19.056371 dv-cinder-851351-1-smb devstack@keystone.service[207600]: [pid: 207600|app: 0|req: 503/1010] 10.222.0.42 () {60 vars in 1141 bytes} [Thu Jul 28 08:25:18 2022] POST /identity/v3/services => generated 242 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 08:25:19.566702 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa955ab-82a4-480d-aaf6-14eaa8d0e7de None None] REQUEST_METHOD: `GET` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:25:19.567298 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa955ab-82a4-480d-aaf6-14eaa8d0e7de None None] SCRIPT_NAME: `/identity` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:25:19.567298 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa955ab-82a4-480d-aaf6-14eaa8d0e7de None None] PATH_INFO: `/` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:25:19.568875 dv-cinder-851351-1-smb devstack@keystone.service[207601]: [pid: 207601|app: 0|req: 508/1011] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 08:25:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 08:25:19.574392 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76b0638-6c72-4712-a011-f5daf6699675 None None] REQUEST_METHOD: `POST` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:25:19.574922 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76b0638-6c72-4712-a011-f5daf6699675 None None] SCRIPT_NAME: `/identity` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:25:19.574922 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76b0638-6c72-4712-a011-f5daf6699675 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:25:19.595259 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.auth.core [None req-d76b0638-6c72-4712-a011-f5daf6699675 None None] MFA Rules not processed for user `b8110ade874c4aa7af27f5c376df700a`. Rule list: `[]` (Enabled: `True`). {{(pid=207600) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 08:25:19.597057 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.fernet_utils [None req-d76b0638-6c72-4712-a011-f5daf6699675 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=207600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:25:19.683662 dv-cinder-851351-1-smb devstack@keystone.service[207600]: [pid: 207600|app: 0|req: 504/1012] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 08:25:19 2022] POST /identity/v3/auth/tokens => generated 1803 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 28 08:25:19.706055 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa955ab-82a4-480d-aaf6-14eaa8d0e7de None None] Authenticating user token {{(pid=207601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:25:19.798520 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG dbcounter [-] [207601] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=207601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:25:19.822690 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa955ab-82a4-480d-aaf6-14eaa8d0e7de None None] Validating token access rules against request {{(pid=207601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:25:19.859839 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-324b46de-e994-40ad-8f9a-918f548dd0ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:25:19.860520 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324b46de-e994-40ad-8f9a-918f548dd0ac None admin] REQUEST_METHOD: `GET` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:25:19.860874 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324b46de-e994-40ad-8f9a-918f548dd0ac None admin] SCRIPT_NAME: `/identity` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:25:19.861145 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324b46de-e994-40ad-8f9a-918f548dd0ac None admin] PATH_INFO: `/v3/services/compute` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:25:19.861791 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-324b46de-e994-40ad-8f9a-918f548dd0ac None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:25:19.863180 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-324b46de-e994-40ad-8f9a-918f548dd0ac None admin] RBAC: Authorization granted {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:25:19.873157 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application [None req-324b46de-e994-40ad-8f9a-918f548dd0ac None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jul 28 08:25:19.873157 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:25:19.873157 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 28 08:25:19.873157 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 28 08:25:19.873157 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 28 08:25:19.873157 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 28 08:25:19.873157 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 28 08:25:19.873157 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 08:25:19.873157 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 28 08:25:19.873157 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application Jul 28 08:25:19.873157 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 28 08:25:19.873157 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application Jul 28 08:25:19.873157 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:25:19.873157 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:25:19.873157 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:25:19.873157 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:25:19.873157 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:25:19.874306 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:25:19.874306 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:25:19.874306 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:25:19.874306 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:25:19.874306 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:25:19.874306 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:25:19.874306 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 28 08:25:19.874306 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 28 08:25:19.874306 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 28 08:25:19.874306 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 28 08:25:19.874306 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:25:19.874306 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:25:19.874306 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:25:19.874306 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:25:19.874306 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:25:19.874306 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:25:19.880297 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:25:19.880297 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application with Lock( Jul 28 08:25:19.880297 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:25:19.880297 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:25:19.880297 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:25:19.880297 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:25:19.880297 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:25:19.880297 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:25:19.880297 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:25:19.880297 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:25:19.880297 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 28 08:25:19.880297 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 08:25:19.880297 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 28 08:25:19.880297 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application Jul 28 08:25:19.880297 dv-cinder-851351-1-smb devstack@keystone.service[207601]: [pid: 207601|app: 0|req: 509/1013] 10.222.0.42 () {56 vars in 1111 bytes} [Thu Jul 28 08:25:19 2022] GET /identity/v3/services/compute => generated 88 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:25:19.882824 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76b0638-6c72-4712-a011-f5daf6699675 None None] Authenticating user token {{(pid=207600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:25:19.922604 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG dbcounter [-] [207600] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=207600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:25:20.005971 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76b0638-6c72-4712-a011-f5daf6699675 None None] Validating token access rules against request {{(pid=207600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:25:20.043536 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede72ebb-fc28-4a5c-89ea-613215672f5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:25:20.044160 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede72ebb-fc28-4a5c-89ea-613215672f5e None admin] REQUEST_METHOD: `GET` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:25:20.044443 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede72ebb-fc28-4a5c-89ea-613215672f5e None admin] SCRIPT_NAME: `/identity` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:25:20.044810 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede72ebb-fc28-4a5c-89ea-613215672f5e None admin] PATH_INFO: `/v3/services` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:25:20.045504 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ede72ebb-fc28-4a5c-89ea-613215672f5e None admin] RBAC: Adding query filter params (name=compute) {{(pid=207600) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:25:20.045806 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ede72ebb-fc28-4a5c-89ea-613215672f5e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:25:20.047179 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ede72ebb-fc28-4a5c-89ea-613215672f5e None admin] RBAC: Authorization granted {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:25:20.053512 dv-cinder-851351-1-smb devstack@keystone.service[207600]: [pid: 207600|app: 0|req: 505/1014] 10.222.0.42 () {56 vars in 1112 bytes} [Thu Jul 28 08:25:19 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:25:20.058468 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-324b46de-e994-40ad-8f9a-918f548dd0ac None admin] Authenticating user token {{(pid=207601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:25:20.164943 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-324b46de-e994-40ad-8f9a-918f548dd0ac None admin] Validating token access rules against request {{(pid=207601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:25:20.201555 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcdf49e3-7f88-4b84-9e26-38bf66342fd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:25:20.202194 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcdf49e3-7f88-4b84-9e26-38bf66342fd3 None admin] REQUEST_METHOD: `GET` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:25:20.202475 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcdf49e3-7f88-4b84-9e26-38bf66342fd3 None admin] SCRIPT_NAME: `/identity` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:25:20.202748 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcdf49e3-7f88-4b84-9e26-38bf66342fd3 None admin] PATH_INFO: `/v3/services` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:25:20.203428 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcdf49e3-7f88-4b84-9e26-38bf66342fd3 None admin] RBAC: Adding query filter params (type=compute) {{(pid=207601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:25:20.203735 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcdf49e3-7f88-4b84-9e26-38bf66342fd3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:25:20.205241 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcdf49e3-7f88-4b84-9e26-38bf66342fd3 None admin] RBAC: Authorization granted {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:25:20.215559 dv-cinder-851351-1-smb devstack@keystone.service[207601]: [pid: 207601|app: 0|req: 510/1015] 10.222.0.42 () {56 vars in 1112 bytes} [Thu Jul 28 08:25:20 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:25:20.216869 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede72ebb-fc28-4a5c-89ea-613215672f5e None admin] Authenticating user token {{(pid=207600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:25:20.321116 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG dbcounter [-] [207600] Writing DB stats keystone:SELECT=100 {{(pid=207600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:25:20.324812 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede72ebb-fc28-4a5c-89ea-613215672f5e None admin] Validating token access rules against request {{(pid=207600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:25:20.362422 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9878c4f-f6c9-4817-9f78-22ce65d71254 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:25:20.363112 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9878c4f-f6c9-4817-9f78-22ce65d71254 None admin] REQUEST_METHOD: `POST` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:25:20.363391 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9878c4f-f6c9-4817-9f78-22ce65d71254 None admin] SCRIPT_NAME: `/identity` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:25:20.363662 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9878c4f-f6c9-4817-9f78-22ce65d71254 None admin] PATH_INFO: `/v3/endpoints` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:25:20.364443 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9878c4f-f6c9-4817-9f78-22ce65d71254 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:25:20.365858 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9878c4f-f6c9-4817-9f78-22ce65d71254 None admin] RBAC: Authorization granted {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:25:20.393506 dv-cinder-851351-1-smb devstack@keystone.service[207600]: [pid: 207600|app: 0|req: 506/1016] 10.222.0.42 () {60 vars in 1144 bytes} [Thu Jul 28 08:25:20 2022] POST /identity/v3/endpoints => generated 334 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 28 08:25:21.072092 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875e36ad-65c2-4051-9cc4-47131ad14d1a None None] REQUEST_METHOD: `GET` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:25:21.072902 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875e36ad-65c2-4051-9cc4-47131ad14d1a None None] SCRIPT_NAME: `/identity` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:25:21.073052 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875e36ad-65c2-4051-9cc4-47131ad14d1a None None] PATH_INFO: `/` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:25:21.076807 dv-cinder-851351-1-smb devstack@keystone.service[207601]: [pid: 207601|app: 0|req: 511/1017] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 08:25:21 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 08:25:21.082938 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e15f18-0552-4c2d-b727-13894952b6db None None] REQUEST_METHOD: `POST` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:25:21.083850 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e15f18-0552-4c2d-b727-13894952b6db None None] SCRIPT_NAME: `/identity` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:25:21.084353 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e15f18-0552-4c2d-b727-13894952b6db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:25:21.103944 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.auth.core [None req-60e15f18-0552-4c2d-b727-13894952b6db None None] MFA Rules not processed for user `b8110ade874c4aa7af27f5c376df700a`. Rule list: `[]` (Enabled: `True`). {{(pid=207600) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 08:25:21.105166 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.fernet_utils [None req-60e15f18-0552-4c2d-b727-13894952b6db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=207600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:25:21.157876 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8461b161-ddab-4236-a7bd-f49cc8959716 None None] REQUEST_METHOD: `GET` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:25:21.158067 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8461b161-ddab-4236-a7bd-f49cc8959716 None None] SCRIPT_NAME: `/identity` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:25:21.158350 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8461b161-ddab-4236-a7bd-f49cc8959716 None None] PATH_INFO: `/` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:25:21.159729 dv-cinder-851351-1-smb devstack@keystone.service[207601]: [pid: 207601|app: 0|req: 512/1018] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 08:25:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 08:25:21.165547 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4327f1ad-cb51-4576-862a-b7e481f22510 None None] REQUEST_METHOD: `POST` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:25:21.165838 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4327f1ad-cb51-4576-862a-b7e481f22510 None None] SCRIPT_NAME: `/identity` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:25:21.166133 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4327f1ad-cb51-4576-862a-b7e481f22510 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:25:21.185849 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.auth.core [None req-4327f1ad-cb51-4576-862a-b7e481f22510 None None] MFA Rules not processed for user `b8110ade874c4aa7af27f5c376df700a`. Rule list: `[]` (Enabled: `True`). {{(pid=207601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 08:25:21.187188 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.fernet_utils [None req-4327f1ad-cb51-4576-862a-b7e481f22510 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=207601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:25:21.187583 dv-cinder-851351-1-smb devstack@keystone.service[207600]: [pid: 207600|app: 0|req: 507/1019] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 08:25:21 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 28 08:25:21.195554 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG dbcounter [-] [207601] Writing DB stats keystone:SELECT=100 {{(pid=207601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:25:21.210250 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e15f18-0552-4c2d-b727-13894952b6db None None] Authenticating user token {{(pid=207600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:25:21.261610 dv-cinder-851351-1-smb devstack@keystone.service[207601]: [pid: 207601|app: 0|req: 513/1020] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 08:25:21 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 08:25:21.285743 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4327f1ad-cb51-4576-862a-b7e481f22510 None None] Authenticating user token {{(pid=207601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:25:21.313033 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG dbcounter [-] [207600] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=207600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:25:21.336005 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e15f18-0552-4c2d-b727-13894952b6db None None] Validating token access rules against request {{(pid=207600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:25:21.372933 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5069c3-1f55-455b-b219-c66f54ee1d93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:25:21.373904 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5069c3-1f55-455b-b219-c66f54ee1d93 None admin] REQUEST_METHOD: `GET` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:25:21.374368 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5069c3-1f55-455b-b219-c66f54ee1d93 None admin] SCRIPT_NAME: `/identity` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:25:21.374788 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5069c3-1f55-455b-b219-c66f54ee1d93 None admin] PATH_INFO: `/v3/domains/default` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:25:21.376120 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db5069c3-1f55-455b-b219-c66f54ee1d93 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:25:21.377796 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db5069c3-1f55-455b-b219-c66f54ee1d93 None admin] RBAC: Authorization granted {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:25:21.379622 dv-cinder-851351-1-smb devstack@keystone.service[207600]: [pid: 207600|app: 0|req: 508/1021] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 08:25:21 2022] GET /identity/v3/domains/default => generated 199 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:25:21.386055 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5069c3-1f55-455b-b219-c66f54ee1d93 None admin] Authenticating user token {{(pid=207600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:25:21.391261 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4327f1ad-cb51-4576-862a-b7e481f22510 None None] Validating token access rules against request {{(pid=207601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:25:21.427575 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a7949e5-ef39-4874-bf1e-807d61f1f250 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:25:21.428146 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7949e5-ef39-4874-bf1e-807d61f1f250 None admin] REQUEST_METHOD: `GET` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:25:21.428423 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7949e5-ef39-4874-bf1e-807d61f1f250 None admin] SCRIPT_NAME: `/identity` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:25:21.428712 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7949e5-ef39-4874-bf1e-807d61f1f250 None admin] PATH_INFO: `/v3/services/image` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:25:21.429353 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a7949e5-ef39-4874-bf1e-807d61f1f250 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:25:21.430811 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a7949e5-ef39-4874-bf1e-807d61f1f250 None admin] RBAC: Authorization granted {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:25:21.439783 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application [None req-4a7949e5-ef39-4874-bf1e-807d61f1f250 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jul 28 08:25:21.439783 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:25:21.439783 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 28 08:25:21.439783 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 28 08:25:21.439783 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 28 08:25:21.439783 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 28 08:25:21.439783 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 28 08:25:21.439783 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 08:25:21.439783 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 28 08:25:21.439783 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application Jul 28 08:25:21.439783 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 28 08:25:21.439783 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application Jul 28 08:25:21.439783 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:25:21.439783 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:25:21.439783 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:25:21.439783 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:25:21.439783 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:25:21.440926 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:25:21.440926 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:25:21.440926 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:25:21.440926 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:25:21.440926 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:25:21.440926 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:25:21.440926 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 28 08:25:21.440926 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 28 08:25:21.440926 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 28 08:25:21.440926 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 28 08:25:21.440926 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:25:21.440926 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:25:21.440926 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:25:21.440926 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:25:21.440926 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:25:21.440926 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:25:21.442093 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:25:21.442093 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application with Lock( Jul 28 08:25:21.442093 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:25:21.442093 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:25:21.442093 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:25:21.442093 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:25:21.442093 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:25:21.442093 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:25:21.442093 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:25:21.442093 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:25:21.442093 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 28 08:25:21.442093 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 08:25:21.442093 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 28 08:25:21.442093 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application Jul 28 08:25:21.446137 dv-cinder-851351-1-smb devstack@keystone.service[207601]: [pid: 207601|app: 0|req: 514/1022] 10.222.0.42 () {56 vars in 1105 bytes} [Thu Jul 28 08:25:21 2022] GET /identity/v3/services/image => generated 86 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 08:25:21.447060 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a7949e5-ef39-4874-bf1e-807d61f1f250 None admin] Authenticating user token {{(pid=207601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:25:21.450005 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG dbcounter [-] [207601] Writing DB stats keystone:SELECT=100 {{(pid=207601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:25:21.500979 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5069c3-1f55-455b-b219-c66f54ee1d93 None admin] Validating token access rules against request {{(pid=207600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:25:21.538605 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e2139e0-5167-4aef-8ce7-1f57b811db76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:25:21.539277 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2139e0-5167-4aef-8ce7-1f57b811db76 None admin] REQUEST_METHOD: `POST` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:25:21.539914 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2139e0-5167-4aef-8ce7-1f57b811db76 None admin] SCRIPT_NAME: `/identity` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:25:21.539914 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2139e0-5167-4aef-8ce7-1f57b811db76 None admin] PATH_INFO: `/v3/projects` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:25:21.540526 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e2139e0-5167-4aef-8ce7-1f57b811db76 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:25:21.542026 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e2139e0-5167-4aef-8ce7-1f57b811db76 None admin] RBAC: Authorization granted {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:25:21.561639 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a7949e5-ef39-4874-bf1e-807d61f1f250 None admin] Validating token access rules against request {{(pid=207601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:25:21.573112 dv-cinder-851351-1-smb devstack@keystone.service[207600]: [pid: 207600|app: 0|req: 509/1023] 10.222.0.42 () {60 vars in 1141 bytes} [Thu Jul 28 08:25:21 2022] POST /identity/v3/projects => generated 311 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 28 08:25:21.614735 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef5ff37-65a0-4ebe-b6f9-481b5e5b12da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:25:21.615484 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef5ff37-65a0-4ebe-b6f9-481b5e5b12da None admin] REQUEST_METHOD: `GET` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:25:21.615709 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef5ff37-65a0-4ebe-b6f9-481b5e5b12da None admin] SCRIPT_NAME: `/identity` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:25:21.615967 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef5ff37-65a0-4ebe-b6f9-481b5e5b12da None admin] PATH_INFO: `/v3/services` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:25:21.616738 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ef5ff37-65a0-4ebe-b6f9-481b5e5b12da None admin] RBAC: Adding query filter params (name=image) {{(pid=207601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:25:21.617058 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ef5ff37-65a0-4ebe-b6f9-481b5e5b12da None admin] RBAC: Authorizing `identity:list_services()` {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:25:21.618553 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ef5ff37-65a0-4ebe-b6f9-481b5e5b12da None admin] RBAC: Authorization granted {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:25:21.624823 dv-cinder-851351-1-smb devstack@keystone.service[207601]: [pid: 207601|app: 0|req: 515/1024] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 08:25:21 2022] GET /identity/v3/services?name=image => generated 122 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 08:25:21.631048 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e2139e0-5167-4aef-8ce7-1f57b811db76 None admin] Authenticating user token {{(pid=207600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:25:21.634698 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG dbcounter [-] [207600] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=207600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:25:21.751120 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e2139e0-5167-4aef-8ce7-1f57b811db76 None admin] Validating token access rules against request {{(pid=207600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:25:21.786371 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d878eb-270f-4c09-b597-9048756fb917 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:25:21.787014 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d878eb-270f-4c09-b597-9048756fb917 None admin] REQUEST_METHOD: `GET` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:25:21.787309 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d878eb-270f-4c09-b597-9048756fb917 None admin] SCRIPT_NAME: `/identity` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:25:21.787597 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d878eb-270f-4c09-b597-9048756fb917 None admin] PATH_INFO: `/v3/services` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:25:21.788278 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d878eb-270f-4c09-b597-9048756fb917 None admin] RBAC: Adding query filter params (type=image) {{(pid=207600) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:25:21.788598 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d878eb-270f-4c09-b597-9048756fb917 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:25:21.790505 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d878eb-270f-4c09-b597-9048756fb917 None admin] RBAC: Authorization granted {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:25:21.800744 dv-cinder-851351-1-smb devstack@keystone.service[207600]: [pid: 207600|app: 0|req: 510/1025] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 08:25:21 2022] GET /identity/v3/services?type=image => generated 350 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:25:21.802286 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef5ff37-65a0-4ebe-b6f9-481b5e5b12da None admin] Authenticating user token {{(pid=207601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:25:21.871439 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG dbcounter [-] [207601] Writing DB stats keystone:SELECT=100 {{(pid=207601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:25:21.916807 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef5ff37-65a0-4ebe-b6f9-481b5e5b12da None admin] Validating token access rules against request {{(pid=207601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:25:21.952026 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2714bd-1144-43e9-86fc-41eb756e1262 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:25:21.952684 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2714bd-1144-43e9-86fc-41eb756e1262 None admin] REQUEST_METHOD: `GET` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:25:21.952978 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2714bd-1144-43e9-86fc-41eb756e1262 None admin] SCRIPT_NAME: `/identity` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:25:21.953255 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2714bd-1144-43e9-86fc-41eb756e1262 None admin] PATH_INFO: `/v3/endpoints` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:25:21.954030 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d2714bd-1144-43e9-86fc-41eb756e1262 None admin] RBAC: Adding query filter params (interface=public, service_id=bc77cc5f177d46daa7e6774b2f1c09cc, region_id=RegionOne) {{(pid=207601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:25:21.954346 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d2714bd-1144-43e9-86fc-41eb756e1262 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:25:21.955731 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d2714bd-1144-43e9-86fc-41eb756e1262 None admin] RBAC: Authorization granted {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:25:21.966358 dv-cinder-851351-1-smb devstack@keystone.service[207601]: [pid: 207601|app: 0|req: 516/1026] 10.222.0.42 () {56 vars in 1251 bytes} [Thu Jul 28 08:25:21 2022] GET /identity/v3/endpoints?service_id=bc77cc5f177d46daa7e6774b2f1c09cc&interface=public®ion_id=RegionOne => generated 194 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:25:21.968018 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d878eb-270f-4c09-b597-9048756fb917 None admin] Authenticating user token {{(pid=207600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:25:22.035835 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG dbcounter [-] [207600] Writing DB stats keystone:SELECT=100 {{(pid=207600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:25:22.072366 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d878eb-270f-4c09-b597-9048756fb917 None admin] Validating token access rules against request {{(pid=207600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:25:22.108923 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e6e677-3226-45f8-8133-b035aa805786 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:25:22.110318 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e6e677-3226-45f8-8133-b035aa805786 None admin] REQUEST_METHOD: `GET` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:25:22.110812 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e6e677-3226-45f8-8133-b035aa805786 None admin] SCRIPT_NAME: `/identity` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:25:22.112162 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e6e677-3226-45f8-8133-b035aa805786 None admin] PATH_INFO: `/v3/services` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:25:22.112897 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9e6e677-3226-45f8-8133-b035aa805786 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:25:22.114636 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9e6e677-3226-45f8-8133-b035aa805786 None admin] RBAC: Authorization granted {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:25:22.121851 dv-cinder-851351-1-smb devstack@keystone.service[207600]: [pid: 207600|app: 0|req: 511/1027] 10.222.0.42 () {56 vars in 1087 bytes} [Thu Jul 28 08:25:21 2022] GET /identity/v3/services => generated 1957 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 08:25:22.541790 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1c902a-7482-478d-93ac-d07c1ba2dce2 None None] REQUEST_METHOD: `GET` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:25:22.542356 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1c902a-7482-478d-93ac-d07c1ba2dce2 None None] SCRIPT_NAME: `/identity` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:25:22.542356 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1c902a-7482-478d-93ac-d07c1ba2dce2 None None] PATH_INFO: `/` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:25:22.543885 dv-cinder-851351-1-smb devstack@keystone.service[207601]: [pid: 207601|app: 0|req: 517/1028] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 08:25:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 08:25:22.549184 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f080ec-3b7e-44aa-982c-bb09b225c5bf None None] REQUEST_METHOD: `POST` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:25:22.549446 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f080ec-3b7e-44aa-982c-bb09b225c5bf None None] SCRIPT_NAME: `/identity` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:25:22.549744 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f080ec-3b7e-44aa-982c-bb09b225c5bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:25:22.568781 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.auth.core [None req-a9f080ec-3b7e-44aa-982c-bb09b225c5bf None None] MFA Rules not processed for user `b8110ade874c4aa7af27f5c376df700a`. Rule list: `[]` (Enabled: `True`). {{(pid=207600) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 08:25:22.570014 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.fernet_utils [None req-a9f080ec-3b7e-44aa-982c-bb09b225c5bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=207600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:25:22.644735 dv-cinder-851351-1-smb devstack@keystone.service[207600]: [pid: 207600|app: 0|req: 512/1029] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 08:25:22 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 08:25:22.667407 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb1c902a-7482-478d-93ac-d07c1ba2dce2 None None] Authenticating user token {{(pid=207601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:25:22.784718 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb1c902a-7482-478d-93ac-d07c1ba2dce2 None None] Validating token access rules against request {{(pid=207601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:25:22.815428 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG dbcounter [-] [207601] Writing DB stats keystone:SELECT=100 {{(pid=207601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:25:22.822495 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa2ab56b-f334-43c6-9221-7f68b9a9cf53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:25:22.823187 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2ab56b-f334-43c6-9221-7f68b9a9cf53 None admin] REQUEST_METHOD: `GET` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:25:22.823453 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2ab56b-f334-43c6-9221-7f68b9a9cf53 None admin] SCRIPT_NAME: `/identity` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:25:22.823727 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2ab56b-f334-43c6-9221-7f68b9a9cf53 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:25:22.835473 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa2ab56b-f334-43c6-9221-7f68b9a9cf53 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 08:25:22.840930 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application [None req-fa2ab56b-f334-43c6-9221-7f68b9a9cf53 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 28 08:25:22.840930 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:25:22.840930 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:25:22.840930 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:25:22.840930 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:25:22.840930 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:25:22.840930 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:25:22.840930 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:25:22.840930 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:25:22.840930 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:25:22.840930 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:25:22.840930 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:25:22.840930 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 08:25:22.840930 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 08:25:22.840930 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 08:25:22.840930 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 08:25:22.841949 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 08:25:22.841949 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 08:25:22.841949 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 08:25:22.841949 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 08:25:22.841949 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:25:22.841949 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:25:22.841949 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:25:22.841949 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:25:22.841949 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:25:22.841949 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:25:22.841949 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:25:22.841949 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application with Lock( Jul 28 08:25:22.841949 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:25:22.841949 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:25:22.841949 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:25:22.841949 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:25:22.843396 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:25:22.843396 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:25:22.843396 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:25:22.843396 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:25:22.843396 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 08:25:22.843396 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 08:25:22.843396 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 08:25:22.843396 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 08:25:22.843396 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 08:25:22.843396 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 08:25:22.843396 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 28 08:25:22.843396 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application Jul 28 08:25:22.843396 dv-cinder-851351-1-smb devstack@keystone.service[207601]: [pid: 207601|app: 0|req: 518/1030] 10.222.0.42 () {56 vars in 1120 bytes} [Thu Jul 28 08:25:22 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:25:22.848702 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f080ec-3b7e-44aa-982c-bb09b225c5bf None None] Authenticating user token {{(pid=207600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:25:22.915136 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG dbcounter [-] [207600] Writing DB stats keystone:SELECT=100 {{(pid=207600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:25:22.958756 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f080ec-3b7e-44aa-982c-bb09b225c5bf None None] Validating token access rules against request {{(pid=207600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:25:22.994841 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ebabf54-520f-4956-9fa8-c7f1e8847965 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:25:22.995476 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebabf54-520f-4956-9fa8-c7f1e8847965 None admin] REQUEST_METHOD: `GET` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:25:22.995755 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebabf54-520f-4956-9fa8-c7f1e8847965 None admin] SCRIPT_NAME: `/identity` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:25:22.996038 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebabf54-520f-4956-9fa8-c7f1e8847965 None admin] PATH_INFO: `/v3/roles` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:25:22.996789 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ebabf54-520f-4956-9fa8-c7f1e8847965 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=207600) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:25:22.997112 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ebabf54-520f-4956-9fa8-c7f1e8847965 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:25:22.998503 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ebabf54-520f-4956-9fa8-c7f1e8847965 None admin] RBAC: Authorization granted {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:25:23.008553 dv-cinder-851351-1-smb devstack@keystone.service[207600]: [pid: 207600|app: 0|req: 513/1031] 10.222.0.42 () {56 vars in 1115 bytes} [Thu Jul 28 08:25:22 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:25:23.013605 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa2ab56b-f334-43c6-9221-7f68b9a9cf53 None admin] Authenticating user token {{(pid=207601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:25:23.131606 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa2ab56b-f334-43c6-9221-7f68b9a9cf53 None admin] Validating token access rules against request {{(pid=207601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:25:23.173168 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57452c3a-6148-4919-b1b7-c5c5e63d29bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:25:23.173832 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57452c3a-6148-4919-b1b7-c5c5e63d29bc None admin] REQUEST_METHOD: `GET` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:25:23.174111 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57452c3a-6148-4919-b1b7-c5c5e63d29bc None admin] SCRIPT_NAME: `/identity` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:25:23.174382 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57452c3a-6148-4919-b1b7-c5c5e63d29bc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:25:23.188713 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57452c3a-6148-4919-b1b7-c5c5e63d29bc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:25:23.190288 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57452c3a-6148-4919-b1b7-c5c5e63d29bc None admin] RBAC: Authorization granted {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:25:23.209063 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application [None req-57452c3a-6148-4919-b1b7-c5c5e63d29bc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 08:25:23.209063 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:25:23.209063 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:25:23.209063 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:25:23.209063 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:25:23.209063 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:25:23.209063 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:25:23.209063 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:25:23.209063 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:25:23.209063 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:25:23.209063 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:25:23.209063 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:25:23.209063 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 08:25:23.209063 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 08:25:23.209063 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 08:25:23.210299 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 08:25:23.210299 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:25:23.210299 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:25:23.210299 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:25:23.210299 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:25:23.210299 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:25:23.210299 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:25:23.210299 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:25:23.210299 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application with Lock( Jul 28 08:25:23.210299 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:25:23.210299 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:25:23.210299 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:25:23.210299 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:25:23.210299 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:25:23.210299 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:25:23.210299 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:25:23.210299 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:25:23.211402 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 08:25:23.211402 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 08:25:23.211402 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 08:25:23.211402 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application Jul 28 08:25:23.212926 dv-cinder-851351-1-smb devstack@keystone.service[207601]: [pid: 207601|app: 0|req: 519/1032] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 08:25:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:25:23.217472 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ebabf54-520f-4956-9fa8-c7f1e8847965 None admin] Authenticating user token {{(pid=207600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:25:23.335227 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ebabf54-520f-4956-9fa8-c7f1e8847965 None admin] Validating token access rules against request {{(pid=207600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:25:23.359254 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG dbcounter [-] [207600] Writing DB stats keystone:SELECT=100 {{(pid=207600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:25:23.374999 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14440045-c9e6-4c4c-9320-2e5a286d5974 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:25:23.375651 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14440045-c9e6-4c4c-9320-2e5a286d5974 None admin] REQUEST_METHOD: `GET` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:25:23.375938 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14440045-c9e6-4c4c-9320-2e5a286d5974 None admin] SCRIPT_NAME: `/identity` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:25:23.376217 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14440045-c9e6-4c4c-9320-2e5a286d5974 None admin] PATH_INFO: `/v3/domains` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:25:23.377010 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14440045-c9e6-4c4c-9320-2e5a286d5974 None admin] RBAC: Adding query filter params (name=Default) {{(pid=207600) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:25:23.377328 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14440045-c9e6-4c4c-9320-2e5a286d5974 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:25:23.378737 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14440045-c9e6-4c4c-9320-2e5a286d5974 None admin] RBAC: Authorization granted {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:25:23.397143 dv-cinder-851351-1-smb devstack@keystone.service[207600]: [pid: 207600|app: 0|req: 514/1033] 10.222.0.42 () {56 vars in 1109 bytes} [Thu Jul 28 08:25:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:25:23.398621 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57452c3a-6148-4919-b1b7-c5c5e63d29bc None admin] Authenticating user token {{(pid=207601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:25:23.467469 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG dbcounter [-] [207601] Writing DB stats keystone:SELECT=100 {{(pid=207601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:25:23.557028 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57452c3a-6148-4919-b1b7-c5c5e63d29bc None admin] Validating token access rules against request {{(pid=207601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:25:23.595473 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f49e07-1c7e-4e7e-9497-fb4f56d8c570 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:25:23.596210 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f49e07-1c7e-4e7e-9497-fb4f56d8c570 None admin] REQUEST_METHOD: `GET` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:25:23.596500 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f49e07-1c7e-4e7e-9497-fb4f56d8c570 None admin] SCRIPT_NAME: `/identity` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:25:23.596907 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f49e07-1c7e-4e7e-9497-fb4f56d8c570 None admin] PATH_INFO: `/v3/users/nova` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:25:23.606077 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3f49e07-1c7e-4e7e-9497-fb4f56d8c570 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:25:23.607558 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3f49e07-1c7e-4e7e-9497-fb4f56d8c570 None admin] RBAC: Authorization granted {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:25:23.620281 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application [None req-d3f49e07-1c7e-4e7e-9497-fb4f56d8c570 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 28 08:25:23.620281 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:25:23.620281 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:25:23.620281 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:25:23.620281 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:25:23.620281 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:25:23.620281 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:25:23.620281 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:25:23.620281 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:25:23.620281 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:25:23.620281 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:25:23.620281 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:25:23.620281 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 28 08:25:23.620281 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 28 08:25:23.620281 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 28 08:25:23.620281 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 28 08:25:23.626241 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:25:23.626241 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:25:23.626241 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 28 08:25:23.626241 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 08:25:23.626241 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 28 08:25:23.626241 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 08:25:23.626241 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:25:23.626241 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:25:23.626241 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:25:23.626241 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:25:23.626241 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:25:23.626241 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application with Lock( Jul 28 08:25:23.626241 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:25:23.626241 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:25:23.626241 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:25:23.626241 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:25:23.626241 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:25:23.626241 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:25:23.627299 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:25:23.627299 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:25:23.627299 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 28 08:25:23.627299 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 28 08:25:23.627299 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 28 08:25:23.627299 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 28 08:25:23.627299 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 28 08:25:23.627299 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 28 08:25:23.627299 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 28 08:25:23.627299 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application Jul 28 08:25:23.627299 dv-cinder-851351-1-smb devstack@keystone.service[207601]: [pid: 207601|app: 0|req: 520/1034] 10.222.0.42 () {56 vars in 1093 bytes} [Thu Jul 28 08:25:23 2022] GET /identity/v3/users/nova => generated 82 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:25:23.627961 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14440045-c9e6-4c4c-9320-2e5a286d5974 None admin] Authenticating user token {{(pid=207600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:25:23.683692 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e491ca-e22b-4349-9578-55727c62c79f None None] REQUEST_METHOD: `GET` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:25:23.683890 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e491ca-e22b-4349-9578-55727c62c79f None None] SCRIPT_NAME: `/identity` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:25:23.684084 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e491ca-e22b-4349-9578-55727c62c79f None None] PATH_INFO: `/` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:25:23.685623 dv-cinder-851351-1-smb devstack@keystone.service[207601]: [pid: 207601|app: 0|req: 521/1035] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 08:25:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 28 08:25:23.691013 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae037390-967d-457f-9d31-65bf40ae38eb None None] REQUEST_METHOD: `POST` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:25:23.691304 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae037390-967d-457f-9d31-65bf40ae38eb None None] SCRIPT_NAME: `/identity` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:25:23.691585 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae037390-967d-457f-9d31-65bf40ae38eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:25:23.710960 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.auth.core [None req-ae037390-967d-457f-9d31-65bf40ae38eb None None] MFA Rules not processed for user `b8110ade874c4aa7af27f5c376df700a`. Rule list: `[]` (Enabled: `True`). {{(pid=207601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 08:25:23.712540 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.fernet_utils [None req-ae037390-967d-457f-9d31-65bf40ae38eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=207601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:25:23.746543 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14440045-c9e6-4c4c-9320-2e5a286d5974 None admin] Validating token access rules against request {{(pid=207600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:25:23.786269 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abff6e71-9730-468d-8979-9baa5078d3c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:25:23.786915 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abff6e71-9730-468d-8979-9baa5078d3c1 None admin] REQUEST_METHOD: `GET` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:25:23.787204 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abff6e71-9730-468d-8979-9baa5078d3c1 None admin] SCRIPT_NAME: `/identity` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:25:23.792951 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abff6e71-9730-468d-8979-9baa5078d3c1 None admin] PATH_INFO: `/v3/users` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:25:23.793133 dv-cinder-851351-1-smb devstack@keystone.service[207601]: [pid: 207601|app: 0|req: 522/1036] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 08:25:23 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 28 08:25:23.793256 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abff6e71-9730-468d-8979-9baa5078d3c1 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=207600) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:25:23.793256 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abff6e71-9730-468d-8979-9baa5078d3c1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:25:23.793256 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abff6e71-9730-468d-8979-9baa5078d3c1 None admin] RBAC: Authorization granted {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:25:23.816350 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae037390-967d-457f-9d31-65bf40ae38eb None None] Authenticating user token {{(pid=207601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:25:23.816566 dv-cinder-851351-1-smb devstack@keystone.service[207600]: [pid: 207600|app: 0|req: 515/1037] 10.222.0.42 () {56 vars in 1133 bytes} [Thu Jul 28 08:25:23 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 08:25:23.821621 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abff6e71-9730-468d-8979-9baa5078d3c1 None admin] Authenticating user token {{(pid=207600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:25:23.847142 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG dbcounter [-] [207601] Writing DB stats keystone:SELECT=100 {{(pid=207601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:25:23.871555 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG dbcounter [-] [207600] Writing DB stats keystone:SELECT=100 {{(pid=207600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:25:23.934739 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae037390-967d-457f-9d31-65bf40ae38eb None None] Validating token access rules against request {{(pid=207601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:25:23.942902 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abff6e71-9730-468d-8979-9baa5078d3c1 None admin] Validating token access rules against request {{(pid=207600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:25:23.976948 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82da06be-bcdb-45b2-9501-9f7f28a0f352 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:25:23.977624 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82da06be-bcdb-45b2-9501-9f7f28a0f352 None admin] REQUEST_METHOD: `GET` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:25:23.977908 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82da06be-bcdb-45b2-9501-9f7f28a0f352 None admin] SCRIPT_NAME: `/identity` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:25:23.978185 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82da06be-bcdb-45b2-9501-9f7f28a0f352 None admin] PATH_INFO: `/v3/domains/default` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:25:23.979418 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82da06be-bcdb-45b2-9501-9f7f28a0f352 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:25:23.980917 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82da06be-bcdb-45b2-9501-9f7f28a0f352 None admin] RBAC: Authorization granted {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:25:23.982652 dv-cinder-851351-1-smb devstack@keystone.service[207601]: [pid: 207601|app: 0|req: 523/1038] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 08:25:23 2022] GET /identity/v3/domains/default => generated 199 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 08:25:23.985795 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44bb5a66-034c-453e-97c2-84a2227eea35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:25:23.986446 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44bb5a66-034c-453e-97c2-84a2227eea35 None admin] REQUEST_METHOD: `GET` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:25:23.986733 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44bb5a66-034c-453e-97c2-84a2227eea35 None admin] SCRIPT_NAME: `/identity` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:25:23.987012 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44bb5a66-034c-453e-97c2-84a2227eea35 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:25:23.988350 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82da06be-bcdb-45b2-9501-9f7f28a0f352 None admin] Authenticating user token {{(pid=207601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:25:24.062978 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44bb5a66-034c-453e-97c2-84a2227eea35 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:25:24.064883 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44bb5a66-034c-453e-97c2-84a2227eea35 None admin] RBAC: Authorization granted {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:25:24.109721 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG dbcounter [-] [207601] Writing DB stats keystone:SELECT=100 {{(pid=207601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:25:24.113533 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82da06be-bcdb-45b2-9501-9f7f28a0f352 None admin] Validating token access rules against request {{(pid=207601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:25:24.116427 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG dbcounter [-] [207600] Writing DB stats keystone:SELECT=100 {{(pid=207600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:25:24.157475 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4f0391-a65b-4708-a160-8bec92d55294 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:25:24.158123 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4f0391-a65b-4708-a160-8bec92d55294 None admin] REQUEST_METHOD: `POST` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:25:24.158412 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4f0391-a65b-4708-a160-8bec92d55294 None admin] SCRIPT_NAME: `/identity` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:25:24.158692 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4f0391-a65b-4708-a160-8bec92d55294 None admin] PATH_INFO: `/v3/users` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:25:24.159409 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b4f0391-a65b-4708-a160-8bec92d55294 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:25:24.160899 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b4f0391-a65b-4708-a160-8bec92d55294 None admin] RBAC: Authorization granted {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:25:24.184148 dv-cinder-851351-1-smb devstack@keystone.service[207601]: [pid: 207601|app: 0|req: 524/1039] 10.222.0.42 () {60 vars in 1132 bytes} [Thu Jul 28 08:25:23 2022] POST /identity/v3/users => generated 285 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 08:25:24.185688 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a75eac-ae83-42e4-8682-b55f20d93f5e None None] REQUEST_METHOD: `GET` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:25:24.185859 dv-cinder-851351-1-smb devstack@keystone.service[207600]: [pid: 207600|app: 0|req: 516/1040] 10.222.0.42 () {58 vars in 1282 bytes} [Thu Jul 28 08:25:23 2022] GET /identity/v3/auth/tokens => generated 1959 bytes in 368 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 28 08:25:24.186039 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a75eac-ae83-42e4-8682-b55f20d93f5e None None] SCRIPT_NAME: `/identity` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:25:24.186219 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a75eac-ae83-42e4-8682-b55f20d93f5e None None] PATH_INFO: `/` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:25:24.187540 dv-cinder-851351-1-smb devstack@keystone.service[207601]: [pid: 207601|app: 0|req: 525/1041] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 08:25:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 08:25:24.193968 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1dd7ef4-adf6-40fd-a63f-03077d75841f None None] REQUEST_METHOD: `POST` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:25:24.194258 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1dd7ef4-adf6-40fd-a63f-03077d75841f None None] SCRIPT_NAME: `/identity` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:25:24.194572 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1dd7ef4-adf6-40fd-a63f-03077d75841f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:25:24.199260 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a75eac-ae83-42e4-8682-b55f20d93f5e None None] Authenticating user token {{(pid=207601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:25:24.216247 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.auth.core [None req-a1dd7ef4-adf6-40fd-a63f-03077d75841f None None] MFA Rules not processed for user `b8110ade874c4aa7af27f5c376df700a`. Rule list: `[]` (Enabled: `True`). {{(pid=207600) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 08:25:24.217570 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.fernet_utils [None req-a1dd7ef4-adf6-40fd-a63f-03077d75841f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=207600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:25:24.313097 dv-cinder-851351-1-smb devstack@keystone.service[207600]: [pid: 207600|app: 0|req: 517/1042] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 08:25:24 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 08:25:24.327948 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1dd7ef4-adf6-40fd-a63f-03077d75841f None None] Authenticating user token {{(pid=207600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:25:24.331798 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a75eac-ae83-42e4-8682-b55f20d93f5e None None] Validating token access rules against request {{(pid=207601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:25:24.371631 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1edc9c-40ec-4baa-bbb5-ba7bc0f350fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:25:24.372308 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1edc9c-40ec-4baa-bbb5-ba7bc0f350fe None admin] REQUEST_METHOD: `GET` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:25:24.372596 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1edc9c-40ec-4baa-bbb5-ba7bc0f350fe None admin] SCRIPT_NAME: `/identity` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:25:24.372909 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1edc9c-40ec-4baa-bbb5-ba7bc0f350fe None admin] PATH_INFO: `/v3/domains/Default` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:25:24.384963 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd1edc9c-40ec-4baa-bbb5-ba7bc0f350fe None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:25:24.386738 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd1edc9c-40ec-4baa-bbb5-ba7bc0f350fe None admin] RBAC: Authorization granted {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:25:24.402987 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application [None req-fd1edc9c-40ec-4baa-bbb5-ba7bc0f350fe None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 08:25:24.402987 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:25:24.402987 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:25:24.402987 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:25:24.402987 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:25:24.402987 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:25:24.402987 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:25:24.402987 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:25:24.402987 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:25:24.402987 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:25:24.402987 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:25:24.402987 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:25:24.402987 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 08:25:24.402987 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 08:25:24.402987 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 08:25:24.404039 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 08:25:24.404039 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:25:24.404039 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:25:24.404039 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:25:24.404039 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:25:24.404039 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:25:24.404039 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:25:24.404039 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:25:24.404039 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application with Lock( Jul 28 08:25:24.404039 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:25:24.404039 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:25:24.404039 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:25:24.404039 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:25:24.404039 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:25:24.404039 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:25:24.404039 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:25:24.404039 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:25:24.405093 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 08:25:24.405093 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 08:25:24.405093 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 08:25:24.405093 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application Jul 28 08:25:24.405093 dv-cinder-851351-1-smb devstack@keystone.service[207601]: [pid: 207601|app: 0|req: 526/1043] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 08:25:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 08:25:24.409003 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG dbcounter [-] [207600] Writing DB stats keystone:SELECT=100 {{(pid=207600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:25:24.410250 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1edc9c-40ec-4baa-bbb5-ba7bc0f350fe None admin] Authenticating user token {{(pid=207601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:25:24.422502 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG dbcounter [-] [207601] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=207601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:25:24.451655 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1dd7ef4-adf6-40fd-a63f-03077d75841f None None] Validating token access rules against request {{(pid=207600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:25:24.488319 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35996ee7-f3ac-4a70-a18a-461a607062cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:25:24.489029 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35996ee7-f3ac-4a70-a18a-461a607062cb None admin] REQUEST_METHOD: `GET` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:25:24.489311 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35996ee7-f3ac-4a70-a18a-461a607062cb None admin] SCRIPT_NAME: `/identity` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:25:24.489583 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35996ee7-f3ac-4a70-a18a-461a607062cb None admin] PATH_INFO: `/v3/services/image` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:25:24.490222 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35996ee7-f3ac-4a70-a18a-461a607062cb None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:25:24.491620 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35996ee7-f3ac-4a70-a18a-461a607062cb None admin] RBAC: Authorization granted {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:25:24.501299 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application [None req-35996ee7-f3ac-4a70-a18a-461a607062cb None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jul 28 08:25:24.501299 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:25:24.501299 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 28 08:25:24.501299 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 28 08:25:24.501299 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 28 08:25:24.501299 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 28 08:25:24.501299 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 28 08:25:24.501299 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 08:25:24.501299 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 28 08:25:24.501299 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application Jul 28 08:25:24.501299 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 28 08:25:24.501299 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application Jul 28 08:25:24.501299 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:25:24.501299 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:25:24.501299 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:25:24.501299 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:25:24.501299 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:25:24.502432 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:25:24.502432 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:25:24.502432 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:25:24.502432 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:25:24.502432 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:25:24.502432 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:25:24.502432 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 28 08:25:24.502432 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 28 08:25:24.502432 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 28 08:25:24.502432 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 28 08:25:24.502432 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:25:24.502432 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:25:24.502432 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:25:24.502432 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:25:24.502432 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:25:24.502432 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:25:24.503390 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:25:24.503390 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application with Lock( Jul 28 08:25:24.503390 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:25:24.503390 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:25:24.503390 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:25:24.503390 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:25:24.503390 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:25:24.503390 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:25:24.503390 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:25:24.503390 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:25:24.503390 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 28 08:25:24.503390 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 08:25:24.503390 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 28 08:25:24.503390 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application Jul 28 08:25:24.503390 dv-cinder-851351-1-smb devstack@keystone.service[207600]: [pid: 207600|app: 0|req: 518/1044] 10.222.0.42 () {56 vars in 1105 bytes} [Thu Jul 28 08:25:24 2022] GET /identity/v3/services/image => generated 86 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 08:25:24.509046 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35996ee7-f3ac-4a70-a18a-461a607062cb None admin] Authenticating user token {{(pid=207600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:25:24.535687 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1edc9c-40ec-4baa-bbb5-ba7bc0f350fe None admin] Validating token access rules against request {{(pid=207601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:25:24.573052 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ef765c-8220-48e2-b26b-eda6e3e12ed0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:25:24.573724 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ef765c-8220-48e2-b26b-eda6e3e12ed0 None admin] REQUEST_METHOD: `GET` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:25:24.573984 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ef765c-8220-48e2-b26b-eda6e3e12ed0 None admin] SCRIPT_NAME: `/identity` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:25:24.574199 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ef765c-8220-48e2-b26b-eda6e3e12ed0 None admin] PATH_INFO: `/v3/domains` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:25:24.574917 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ef765c-8220-48e2-b26b-eda6e3e12ed0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=207601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:25:24.575218 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ef765c-8220-48e2-b26b-eda6e3e12ed0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:25:24.576601 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ef765c-8220-48e2-b26b-eda6e3e12ed0 None admin] RBAC: Authorization granted {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:25:24.594922 dv-cinder-851351-1-smb devstack@keystone.service[207601]: [pid: 207601|app: 0|req: 527/1045] 10.222.0.42 () {56 vars in 1109 bytes} [Thu Jul 28 08:25:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:25:24.596096 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ef765c-8220-48e2-b26b-eda6e3e12ed0 None admin] Authenticating user token {{(pid=207601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:25:24.627191 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35996ee7-f3ac-4a70-a18a-461a607062cb None admin] Validating token access rules against request {{(pid=207600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:25:24.663533 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79fc551e-50ff-4498-ab37-c5b67f5e50e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:25:24.664204 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79fc551e-50ff-4498-ab37-c5b67f5e50e9 None admin] REQUEST_METHOD: `GET` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:25:24.664492 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79fc551e-50ff-4498-ab37-c5b67f5e50e9 None admin] SCRIPT_NAME: `/identity` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:25:24.664800 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79fc551e-50ff-4498-ab37-c5b67f5e50e9 None admin] PATH_INFO: `/v3/services` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:25:24.665495 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79fc551e-50ff-4498-ab37-c5b67f5e50e9 None admin] RBAC: Adding query filter params (name=image) {{(pid=207600) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:25:24.665807 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79fc551e-50ff-4498-ab37-c5b67f5e50e9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:25:24.667209 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79fc551e-50ff-4498-ab37-c5b67f5e50e9 None admin] RBAC: Authorization granted {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:25:24.667983 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG dbcounter [-] [207601] Writing DB stats keystone:SELECT=100 {{(pid=207601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:25:24.668984 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG dbcounter [-] [207600] Writing DB stats keystone:SELECT=100 {{(pid=207600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:25:24.674836 dv-cinder-851351-1-smb devstack@keystone.service[207600]: [pid: 207600|app: 0|req: 519/1046] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 08:25:24 2022] GET /identity/v3/services?name=image => generated 122 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 08:25:24.680244 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79fc551e-50ff-4498-ab37-c5b67f5e50e9 None admin] Authenticating user token {{(pid=207600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:25:24.711508 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ef765c-8220-48e2-b26b-eda6e3e12ed0 None admin] Validating token access rules against request {{(pid=207601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:25:24.764768 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cde2347-a020-45b7-8714-088c92a06182 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:25:24.765747 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cde2347-a020-45b7-8714-088c92a06182 None admin] REQUEST_METHOD: `GET` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:25:24.766028 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cde2347-a020-45b7-8714-088c92a06182 None admin] SCRIPT_NAME: `/identity` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:25:24.766485 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cde2347-a020-45b7-8714-088c92a06182 None admin] PATH_INFO: `/v3/projects/service` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:25:24.774086 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cde2347-a020-45b7-8714-088c92a06182 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:25:24.775549 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cde2347-a020-45b7-8714-088c92a06182 None admin] RBAC: Authorization granted {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:25:24.788511 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application [None req-4cde2347-a020-45b7-8714-088c92a06182 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 08:25:24.788511 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:25:24.788511 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:25:24.788511 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:25:24.788511 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:25:24.788511 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:25:24.788511 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:25:24.788511 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:25:24.788511 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:25:24.788511 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:25:24.788511 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:25:24.788511 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:25:24.788511 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 28 08:25:24.788511 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 28 08:25:24.788511 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 28 08:25:24.789835 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 28 08:25:24.789835 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:25:24.789835 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:25:24.789835 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:25:24.789835 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:25:24.789835 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:25:24.789835 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:25:24.789835 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:25:24.789835 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application with Lock( Jul 28 08:25:24.789835 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:25:24.789835 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:25:24.789835 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:25:24.789835 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:25:24.789835 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:25:24.789835 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:25:24.789835 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:25:24.789835 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:25:24.790832 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 28 08:25:24.790832 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 28 08:25:24.790832 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 28 08:25:24.790832 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 28 08:25:24.790832 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 28 08:25:24.790832 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 28 08:25:24.790832 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 08:25:24.790832 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application Jul 28 08:25:24.790832 dv-cinder-851351-1-smb devstack@keystone.service[207601]: [pid: 207601|app: 0|req: 528/1047] 10.222.0.42 () {56 vars in 1111 bytes} [Thu Jul 28 08:25:24 2022] GET /identity/v3/projects/service => generated 88 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:25:24.795627 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cde2347-a020-45b7-8714-088c92a06182 None admin] Authenticating user token {{(pid=207601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:25:24.818924 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79fc551e-50ff-4498-ab37-c5b67f5e50e9 None admin] Validating token access rules against request {{(pid=207600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:25:24.860324 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba3100b-402f-4634-96ae-8a32d2b6fcbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:25:24.861459 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba3100b-402f-4634-96ae-8a32d2b6fcbe None admin] REQUEST_METHOD: `GET` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:25:24.861954 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba3100b-402f-4634-96ae-8a32d2b6fcbe None admin] SCRIPT_NAME: `/identity` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:25:24.862453 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba3100b-402f-4634-96ae-8a32d2b6fcbe None admin] PATH_INFO: `/v3/services` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:25:24.863321 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ba3100b-402f-4634-96ae-8a32d2b6fcbe None admin] RBAC: Adding query filter params (type=image) {{(pid=207600) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:25:24.863736 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ba3100b-402f-4634-96ae-8a32d2b6fcbe None admin] RBAC: Authorizing `identity:list_services()` {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:25:24.865223 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ba3100b-402f-4634-96ae-8a32d2b6fcbe None admin] RBAC: Authorization granted {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:25:24.877590 dv-cinder-851351-1-smb devstack@keystone.service[207600]: [pid: 207600|app: 0|req: 520/1048] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 08:25:24 2022] GET /identity/v3/services?type=image => generated 350 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 08:25:24.884272 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba3100b-402f-4634-96ae-8a32d2b6fcbe None admin] Authenticating user token {{(pid=207600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:25:24.916540 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cde2347-a020-45b7-8714-088c92a06182 None admin] Validating token access rules against request {{(pid=207601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:25:24.944387 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG dbcounter [-] [207601] Writing DB stats keystone:SELECT=100 {{(pid=207601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:25:24.953256 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72e5621-9ef0-46e4-8e2a-1929e59c6ee2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:25:24.953978 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72e5621-9ef0-46e4-8e2a-1929e59c6ee2 None admin] REQUEST_METHOD: `GET` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:25:24.954345 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72e5621-9ef0-46e4-8e2a-1929e59c6ee2 None admin] SCRIPT_NAME: `/identity` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:25:24.954697 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72e5621-9ef0-46e4-8e2a-1929e59c6ee2 None admin] PATH_INFO: `/v3/projects` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:25:24.955543 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e72e5621-9ef0-46e4-8e2a-1929e59c6ee2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=207601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:25:24.955933 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e72e5621-9ef0-46e4-8e2a-1929e59c6ee2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:25:24.956581 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG dbcounter [-] [207600] Writing DB stats keystone:SELECT=100 {{(pid=207600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:25:24.958009 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e72e5621-9ef0-46e4-8e2a-1929e59c6ee2 None admin] RBAC: Authorization granted {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:25:24.973114 dv-cinder-851351-1-smb devstack@keystone.service[207601]: [pid: 207601|app: 0|req: 529/1049] 10.222.0.42 () {56 vars in 1148 bytes} [Thu Jul 28 08:25:24 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 08:25:24.979005 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72e5621-9ef0-46e4-8e2a-1929e59c6ee2 None admin] Authenticating user token {{(pid=207601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:25:25.005824 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba3100b-402f-4634-96ae-8a32d2b6fcbe None admin] Validating token access rules against request {{(pid=207600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:25:25.047953 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8875e6-38cb-4a35-9b10-80816285bd7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:25:25.048604 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8875e6-38cb-4a35-9b10-80816285bd7f None admin] REQUEST_METHOD: `POST` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:25:25.049076 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8875e6-38cb-4a35-9b10-80816285bd7f None admin] SCRIPT_NAME: `/identity` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:25:25.049354 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8875e6-38cb-4a35-9b10-80816285bd7f None admin] PATH_INFO: `/v3/endpoints` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:25:25.050573 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e8875e6-38cb-4a35-9b10-80816285bd7f None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:25:25.051965 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e8875e6-38cb-4a35-9b10-80816285bd7f None admin] RBAC: Authorization granted {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:25:25.074256 dv-cinder-851351-1-smb devstack@keystone.service[207600]: [pid: 207600|app: 0|req: 521/1050] 10.222.0.42 () {60 vars in 1144 bytes} [Thu Jul 28 08:25:24 2022] POST /identity/v3/endpoints => generated 327 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 28 08:25:25.095613 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72e5621-9ef0-46e4-8e2a-1929e59c6ee2 None admin] Validating token access rules against request {{(pid=207601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:25:25.151654 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b4726e-3f59-498c-abed-c6bac8f76b8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:25:25.152510 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b4726e-3f59-498c-abed-c6bac8f76b8a None admin] REQUEST_METHOD: `GET` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:25:25.152972 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b4726e-3f59-498c-abed-c6bac8f76b8a None admin] SCRIPT_NAME: `/identity` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:25:25.153252 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b4726e-3f59-498c-abed-c6bac8f76b8a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:25:25.154070 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0b4726e-3f59-498c-abed-c6bac8f76b8a None admin] RBAC: Adding query filter params (role.id=a67e4d87d7f74c65a98b947bd4f6c11d, scope.project.id=48c5f2b2ae2b48758b957d2b194a7fd1, user.id=03804b1369934a7692da4d5646465bdc) {{(pid=207601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:25:25.154381 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0b4726e-3f59-498c-abed-c6bac8f76b8a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:25:25.156315 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0b4726e-3f59-498c-abed-c6bac8f76b8a None admin] RBAC: Authorization granted {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:25:25.164430 dv-cinder-851351-1-smb devstack@keystone.service[207601]: [pid: 207601|app: 0|req: 530/1051] 10.222.0.42 () {56 vars in 1374 bytes} [Thu Jul 28 08:25:24 2022] GET /identity/v3/role_assignments?user.id=03804b1369934a7692da4d5646465bdc&scope.project.id=48c5f2b2ae2b48758b957d2b194a7fd1&role.id=a67e4d87d7f74c65a98b947bd4f6c11d => generated 259 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 08:25:26.319570 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f080f8-8f3d-46f3-a436-9434dc0c682b None None] REQUEST_METHOD: `GET` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:25:26.320123 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f080f8-8f3d-46f3-a436-9434dc0c682b None None] SCRIPT_NAME: `/identity` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:25:26.320123 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f080f8-8f3d-46f3-a436-9434dc0c682b None None] PATH_INFO: `/` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:25:26.321718 dv-cinder-851351-1-smb devstack@keystone.service[207600]: [pid: 207600|app: 0|req: 522/1052] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 08:25:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 08:25:26.326896 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8d325c-0bc5-42d4-88fc-d4c4b0974c70 None None] REQUEST_METHOD: `POST` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:25:26.327327 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8d325c-0bc5-42d4-88fc-d4c4b0974c70 None None] SCRIPT_NAME: `/identity` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:25:26.327408 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8d325c-0bc5-42d4-88fc-d4c4b0974c70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:25:26.347513 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.auth.core [None req-6d8d325c-0bc5-42d4-88fc-d4c4b0974c70 None None] MFA Rules not processed for user `b8110ade874c4aa7af27f5c376df700a`. Rule list: `[]` (Enabled: `True`). {{(pid=207601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 08:25:26.348730 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.fernet_utils [None req-6d8d325c-0bc5-42d4-88fc-d4c4b0974c70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=207601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:25:26.396401 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG dbcounter [-] [207601] Writing DB stats keystone:SELECT=100 {{(pid=207601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:25:26.422504 dv-cinder-851351-1-smb devstack@keystone.service[207601]: [pid: 207601|app: 0|req: 531/1053] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 08:25:26 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 08:25:26.445487 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f080f8-8f3d-46f3-a436-9434dc0c682b None None] Authenticating user token {{(pid=207600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:25:26.557672 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f080f8-8f3d-46f3-a436-9434dc0c682b None None] Validating token access rules against request {{(pid=207600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:25:26.578227 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG dbcounter [-] [207600] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=207600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:25:26.601946 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2304d950-1c12-4556-820e-ce5af3a1f0f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:25:26.602632 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2304d950-1c12-4556-820e-ce5af3a1f0f3 None admin] REQUEST_METHOD: `GET` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:25:26.602916 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2304d950-1c12-4556-820e-ce5af3a1f0f3 None admin] SCRIPT_NAME: `/identity` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:25:26.603184 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2304d950-1c12-4556-820e-ce5af3a1f0f3 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:25:26.616301 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2304d950-1c12-4556-820e-ce5af3a1f0f3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 08:25:26.621527 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application [None req-2304d950-1c12-4556-820e-ce5af3a1f0f3 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 08:25:26.621527 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:25:26.621527 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:25:26.621527 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:25:26.621527 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:25:26.621527 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:25:26.621527 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:25:26.621527 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:25:26.621527 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:25:26.621527 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:25:26.621527 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:25:26.621527 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:25:26.621527 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 08:25:26.621527 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 08:25:26.621527 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 08:25:26.621527 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 08:25:26.622551 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 08:25:26.622551 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 08:25:26.622551 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 08:25:26.622551 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 08:25:26.622551 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:25:26.622551 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:25:26.622551 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:25:26.622551 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:25:26.622551 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:25:26.622551 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:25:26.622551 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:25:26.622551 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application with Lock( Jul 28 08:25:26.622551 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:25:26.622551 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:25:26.622551 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:25:26.622551 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:25:26.623494 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:25:26.623494 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:25:26.623494 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:25:26.623494 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:25:26.623494 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 08:25:26.623494 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 08:25:26.623494 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 08:25:26.623494 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 08:25:26.623494 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 08:25:26.623494 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 08:25:26.623494 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 08:25:26.623494 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application Jul 28 08:25:26.628126 dv-cinder-851351-1-smb devstack@keystone.service[207600]: [pid: 207600|app: 0|req: 523/1054] 10.222.0.42 () {56 vars in 1096 bytes} [Thu Jul 28 08:25:26 2022] GET /identity/v3/roles/admin => generated 83 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:25:26.629016 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d8d325c-0bc5-42d4-88fc-d4c4b0974c70 None None] Authenticating user token {{(pid=207601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:25:26.732557 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d8d325c-0bc5-42d4-88fc-d4c4b0974c70 None None] Validating token access rules against request {{(pid=207601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:25:26.768823 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-458cc10b-2619-448c-800f-936b2ddf459f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:25:26.769463 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458cc10b-2619-448c-800f-936b2ddf459f None admin] REQUEST_METHOD: `GET` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:25:26.769748 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458cc10b-2619-448c-800f-936b2ddf459f None admin] SCRIPT_NAME: `/identity` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:25:26.770023 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458cc10b-2619-448c-800f-936b2ddf459f None admin] PATH_INFO: `/v3/roles` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:25:26.770758 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-458cc10b-2619-448c-800f-936b2ddf459f None admin] RBAC: Adding query filter params (name=admin) {{(pid=207601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:25:26.771068 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-458cc10b-2619-448c-800f-936b2ddf459f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:25:26.772451 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-458cc10b-2619-448c-800f-936b2ddf459f None admin] RBAC: Authorization granted {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:25:26.781654 dv-cinder-851351-1-smb devstack@keystone.service[207601]: [pid: 207601|app: 0|req: 532/1055] 10.222.0.42 () {56 vars in 1099 bytes} [Thu Jul 28 08:25:26 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:25:26.787354 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2304d950-1c12-4556-820e-ce5af3a1f0f3 None admin] Authenticating user token {{(pid=207600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:25:26.901983 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2304d950-1c12-4556-820e-ce5af3a1f0f3 None admin] Validating token access rules against request {{(pid=207600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:25:26.938361 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f61e9dc-f828-40de-8012-39aa0208faec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:25:26.939048 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f61e9dc-f828-40de-8012-39aa0208faec None admin] REQUEST_METHOD: `GET` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:25:26.939297 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f61e9dc-f828-40de-8012-39aa0208faec None admin] SCRIPT_NAME: `/identity` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:25:26.939590 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f61e9dc-f828-40de-8012-39aa0208faec None admin] PATH_INFO: `/v3/users/146d0f186fe844a9bf7239a8d4d3e8aa` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:25:26.954136 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f61e9dc-f828-40de-8012-39aa0208faec None admin] RBAC: Authorizing `identity:get_user(user_id=146d0f186fe844a9bf7239a8d4d3e8aa)` {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:25:26.955607 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f61e9dc-f828-40de-8012-39aa0208faec None admin] RBAC: Authorization granted {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:25:26.957567 dv-cinder-851351-1-smb devstack@keystone.service[207600]: [pid: 207600|app: 0|req: 524/1056] 10.222.0.42 () {56 vars in 1177 bytes} [Thu Jul 28 08:25:26 2022] GET /identity/v3/users/146d0f186fe844a9bf7239a8d4d3e8aa => generated 285 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:25:26.963833 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-458cc10b-2619-448c-800f-936b2ddf459f None admin] Authenticating user token {{(pid=207601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:25:27.011272 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG dbcounter [-] [207601] Writing DB stats keystone:SELECT=100 {{(pid=207601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:25:27.074166 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-458cc10b-2619-448c-800f-936b2ddf459f None admin] Validating token access rules against request {{(pid=207601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:25:27.109818 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13662811-96d2-4635-b2f4-d12e0850d960 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:25:27.110459 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13662811-96d2-4635-b2f4-d12e0850d960 None admin] REQUEST_METHOD: `GET` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:25:27.110742 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13662811-96d2-4635-b2f4-d12e0850d960 None admin] SCRIPT_NAME: `/identity` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:25:27.111014 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13662811-96d2-4635-b2f4-d12e0850d960 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:25:27.129529 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfdf6c5e-ef09-433d-9198-93d77c94e195 None None] REQUEST_METHOD: `GET` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:25:27.129828 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfdf6c5e-ef09-433d-9198-93d77c94e195 None None] SCRIPT_NAME: `/identity` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:25:27.130090 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfdf6c5e-ef09-433d-9198-93d77c94e195 None None] PATH_INFO: `/` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:25:27.131630 dv-cinder-851351-1-smb devstack@keystone.service[207600]: [pid: 207600|app: 0|req: 525/1057] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 08:25:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 28 08:25:27.136649 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b218aa-a8f3-4474-b7cc-25fc92dcaa46 None None] REQUEST_METHOD: `POST` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:25:27.136961 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b218aa-a8f3-4474-b7cc-25fc92dcaa46 None None] SCRIPT_NAME: `/identity` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:25:27.137230 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b218aa-a8f3-4474-b7cc-25fc92dcaa46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:25:27.155703 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.auth.core [None req-d5b218aa-a8f3-4474-b7cc-25fc92dcaa46 None None] MFA Rules not processed for user `b8110ade874c4aa7af27f5c376df700a`. Rule list: `[]` (Enabled: `True`). {{(pid=207600) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 08:25:27.156867 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.fernet_utils [None req-d5b218aa-a8f3-4474-b7cc-25fc92dcaa46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=207600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:25:27.182651 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13662811-96d2-4635-b2f4-d12e0850d960 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:25:27.184119 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13662811-96d2-4635-b2f4-d12e0850d960 None admin] RBAC: Authorization granted {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:25:27.187908 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG dbcounter [-] [207600] Writing DB stats keystone:SELECT=100 {{(pid=207600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:25:27.227183 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG dbcounter [-] [207601] Writing DB stats keystone:SELECT=100 {{(pid=207601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:25:27.228022 dv-cinder-851351-1-smb devstack@keystone.service[207600]: [pid: 207600|app: 0|req: 526/1058] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 08:25:27 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 28 08:25:27.229579 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b421dec2-769e-4ce2-8be7-764322522374 None None] REQUEST_METHOD: `GET` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:25:27.229908 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b421dec2-769e-4ce2-8be7-764322522374 None None] SCRIPT_NAME: `/identity` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:25:27.230194 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b421dec2-769e-4ce2-8be7-764322522374 None None] PATH_INFO: `/` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:25:27.231683 dv-cinder-851351-1-smb devstack@keystone.service[207600]: [pid: 207600|app: 0|req: 527/1059] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 08:25:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 08:25:27.236960 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d225483-3481-4e10-9698-34d3af6941c6 None None] REQUEST_METHOD: `POST` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:25:27.237253 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d225483-3481-4e10-9698-34d3af6941c6 None None] SCRIPT_NAME: `/identity` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:25:27.237534 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d225483-3481-4e10-9698-34d3af6941c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:25:27.256595 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.auth.core [None req-2d225483-3481-4e10-9698-34d3af6941c6 None None] MFA Rules not processed for user `b8110ade874c4aa7af27f5c376df700a`. Rule list: `[]` (Enabled: `True`). {{(pid=207600) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 08:25:27.257995 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.fernet_utils [None req-2d225483-3481-4e10-9698-34d3af6941c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=207600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:25:27.290388 dv-cinder-851351-1-smb devstack@keystone.service[207601]: [pid: 207601|app: 0|req: 533/1060] 10.222.0.42 () {58 vars in 1282 bytes} [Thu Jul 28 08:25:26 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 28 08:25:27.291370 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13662811-96d2-4635-b2f4-d12e0850d960 None admin] Authenticating user token {{(pid=207601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:25:27.324614 dv-cinder-851351-1-smb devstack@keystone.service[207600]: [pid: 207600|app: 0|req: 528/1061] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 08:25:27 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 08:25:27.325500 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d225483-3481-4e10-9698-34d3af6941c6 None None] Authenticating user token {{(pid=207600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:25:27.395022 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13662811-96d2-4635-b2f4-d12e0850d960 None admin] Validating token access rules against request {{(pid=207601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:25:27.419827 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG dbcounter [-] [207600] Writing DB stats keystone:SELECT=100 {{(pid=207600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:25:27.425923 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d225483-3481-4e10-9698-34d3af6941c6 None None] Validating token access rules against request {{(pid=207600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:25:27.430433 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc0ef56c-d98b-4ce2-9848-3c3c1a6123a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:25:27.431071 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0ef56c-d98b-4ce2-9848-3c3c1a6123a3 None admin] REQUEST_METHOD: `GET` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:25:27.431355 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0ef56c-d98b-4ce2-9848-3c3c1a6123a3 None admin] SCRIPT_NAME: `/identity` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:25:27.431632 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0ef56c-d98b-4ce2-9848-3c3c1a6123a3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:25:27.442509 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG dbcounter [-] [207601] Writing DB stats keystone:SELECT=100 {{(pid=207601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:25:27.462425 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb5438a-3902-48a7-a9ff-8ccd9db43532 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:25:27.463087 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb5438a-3902-48a7-a9ff-8ccd9db43532 None admin] REQUEST_METHOD: `GET` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:25:27.463366 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb5438a-3902-48a7-a9ff-8ccd9db43532 None admin] SCRIPT_NAME: `/identity` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:25:27.463645 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb5438a-3902-48a7-a9ff-8ccd9db43532 None admin] PATH_INFO: `/v3/projects/04123529b032481fbb9473b506dea8b6` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:25:27.464895 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fb5438a-3902-48a7-a9ff-8ccd9db43532 None admin] RBAC: Authorizing `identity:get_project(project_id=04123529b032481fbb9473b506dea8b6)` {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:25:27.466356 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fb5438a-3902-48a7-a9ff-8ccd9db43532 None admin] RBAC: Authorization granted {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:25:27.468059 dv-cinder-851351-1-smb devstack@keystone.service[207600]: [pid: 207600|app: 0|req: 529/1062] 10.222.0.42 () {56 vars in 1186 bytes} [Thu Jul 28 08:25:27 2022] GET /identity/v3/projects/04123529b032481fbb9473b506dea8b6 => generated 311 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:25:27.468955 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb5438a-3902-48a7-a9ff-8ccd9db43532 None admin] Authenticating user token {{(pid=207600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:25:27.510739 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc0ef56c-d98b-4ce2-9848-3c3c1a6123a3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:25:27.512376 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc0ef56c-d98b-4ce2-9848-3c3c1a6123a3 None admin] RBAC: Authorization granted {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:25:27.585537 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb5438a-3902-48a7-a9ff-8ccd9db43532 None admin] Validating token access rules against request {{(pid=207600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:25:27.622630 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46c4bf3-7722-4737-ad90-2160506d1468 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:25:27.623292 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46c4bf3-7722-4737-ad90-2160506d1468 None admin] REQUEST_METHOD: `GET` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:25:27.623634 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46c4bf3-7722-4737-ad90-2160506d1468 None admin] SCRIPT_NAME: `/identity` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:25:27.623839 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46c4bf3-7722-4737-ad90-2160506d1468 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:25:27.631733 dv-cinder-851351-1-smb devstack@keystone.service[207601]: [pid: 207601|app: 0|req: 534/1063] 10.222.0.42 () {58 vars in 1282 bytes} [Thu Jul 28 08:25:27 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 335 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 28 08:25:27.631733 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc0ef56c-d98b-4ce2-9848-3c3c1a6123a3 None admin] Authenticating user token {{(pid=207601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:25:27.634828 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b46c4bf3-7722-4737-ad90-2160506d1468 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 08:25:27.639946 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application [None req-b46c4bf3-7722-4737-ad90-2160506d1468 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 28 08:25:27.639946 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:25:27.639946 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:25:27.639946 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:25:27.639946 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:25:27.639946 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:25:27.639946 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:25:27.639946 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:25:27.639946 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:25:27.639946 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:25:27.639946 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:25:27.639946 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:25:27.639946 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 08:25:27.639946 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 08:25:27.639946 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 08:25:27.639946 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 08:25:27.641029 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 08:25:27.641029 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 08:25:27.641029 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 08:25:27.641029 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 08:25:27.641029 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:25:27.641029 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:25:27.641029 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:25:27.641029 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:25:27.641029 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:25:27.641029 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:25:27.641029 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:25:27.641029 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application with Lock( Jul 28 08:25:27.641029 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:25:27.641029 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:25:27.641029 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:25:27.641029 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:25:27.642356 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:25:27.642356 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:25:27.642356 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:25:27.642356 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:25:27.642356 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 08:25:27.642356 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 08:25:27.642356 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 08:25:27.642356 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 08:25:27.642356 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 08:25:27.642356 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 08:25:27.642356 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 28 08:25:27.642356 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application Jul 28 08:25:27.642356 dv-cinder-851351-1-smb devstack@keystone.service[207600]: [pid: 207600|app: 0|req: 530/1064] 10.222.0.42 () {56 vars in 1120 bytes} [Thu Jul 28 08:25:27 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:25:27.642356 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46c4bf3-7722-4737-ad90-2160506d1468 None admin] Authenticating user token {{(pid=207600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:25:27.671105 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG dbcounter [-] [207600] Writing DB stats keystone:SELECT=100 {{(pid=207600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:25:27.675125 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG dbcounter [-] [207601] Writing DB stats keystone:SELECT=100 {{(pid=207601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:25:27.734875 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc0ef56c-d98b-4ce2-9848-3c3c1a6123a3 None admin] Validating token access rules against request {{(pid=207601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:25:27.750093 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46c4bf3-7722-4737-ad90-2160506d1468 None admin] Validating token access rules against request {{(pid=207600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:25:27.770309 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67e718a-8367-4ee9-bb4b-c05d59ed52d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:25:27.770944 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67e718a-8367-4ee9-bb4b-c05d59ed52d7 None admin] REQUEST_METHOD: `GET` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:25:27.771231 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67e718a-8367-4ee9-bb4b-c05d59ed52d7 None admin] SCRIPT_NAME: `/identity` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:25:27.771509 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67e718a-8367-4ee9-bb4b-c05d59ed52d7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:25:27.772316 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d67e718a-8367-4ee9-bb4b-c05d59ed52d7 None admin] RBAC: Adding query filter params (role.id=d0ce88034c6b41878db755343f5840be, scope.project.id=04123529b032481fbb9473b506dea8b6, user.id=146d0f186fe844a9bf7239a8d4d3e8aa) {{(pid=207601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:25:27.772632 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d67e718a-8367-4ee9-bb4b-c05d59ed52d7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:25:27.774378 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d67e718a-8367-4ee9-bb4b-c05d59ed52d7 None admin] RBAC: Authorization granted {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:25:27.780093 dv-cinder-851351-1-smb devstack@keystone.service[207601]: [pid: 207601|app: 0|req: 535/1065] 10.222.0.42 () {56 vars in 1374 bytes} [Thu Jul 28 08:25:27 2022] GET /identity/v3/role_assignments?user.id=146d0f186fe844a9bf7239a8d4d3e8aa&scope.project.id=04123529b032481fbb9473b506dea8b6&role.id=d0ce88034c6b41878db755343f5840be => generated 259 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:25:27.780926 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67e718a-8367-4ee9-bb4b-c05d59ed52d7 None admin] Authenticating user token {{(pid=207601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:25:27.793897 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f0f5268-1169-4983-84a3-de02c39786ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:25:27.794931 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0f5268-1169-4983-84a3-de02c39786ea None admin] REQUEST_METHOD: `GET` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:25:27.795527 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0f5268-1169-4983-84a3-de02c39786ea None admin] SCRIPT_NAME: `/identity` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:25:27.795818 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0f5268-1169-4983-84a3-de02c39786ea None admin] PATH_INFO: `/v3/domains/Default` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:25:27.809307 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f0f5268-1169-4983-84a3-de02c39786ea None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:25:27.810926 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f0f5268-1169-4983-84a3-de02c39786ea None admin] RBAC: Authorization granted {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:25:27.829175 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application [None req-7f0f5268-1169-4983-84a3-de02c39786ea None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 08:25:27.829175 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:25:27.829175 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:25:27.829175 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:25:27.829175 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:25:27.829175 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:25:27.829175 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:25:27.829175 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:25:27.829175 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:25:27.829175 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:25:27.829175 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:25:27.829175 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:25:27.829175 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 08:25:27.829175 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 08:25:27.829175 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 08:25:27.830259 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 08:25:27.830259 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:25:27.830259 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:25:27.830259 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:25:27.830259 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:25:27.830259 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:25:27.830259 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:25:27.830259 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:25:27.830259 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application with Lock( Jul 28 08:25:27.830259 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:25:27.830259 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:25:27.830259 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:25:27.830259 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:25:27.830259 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:25:27.830259 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:25:27.830259 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:25:27.830259 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:25:27.831256 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 08:25:27.831256 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 08:25:27.831256 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 08:25:27.831256 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application Jul 28 08:25:27.831256 dv-cinder-851351-1-smb devstack@keystone.service[207600]: [pid: 207600|app: 0|req: 531/1066] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 08:25:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:25:27.843320 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f0f5268-1169-4983-84a3-de02c39786ea None admin] Authenticating user token {{(pid=207600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:25:27.907922 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67e718a-8367-4ee9-bb4b-c05d59ed52d7 None admin] Validating token access rules against request {{(pid=207601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:25:27.911787 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG dbcounter [-] [207601] Writing DB stats keystone:SELECT=100 {{(pid=207601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:25:27.938655 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG dbcounter [-] [207600] Writing DB stats keystone:SELECT=100 {{(pid=207600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:25:27.952297 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36773c3c-9bb8-4ec6-9d9f-ad01f9ab2a25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:25:27.952967 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36773c3c-9bb8-4ec6-9d9f-ad01f9ab2a25 None admin] REQUEST_METHOD: `GET` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:25:27.953256 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36773c3c-9bb8-4ec6-9d9f-ad01f9ab2a25 None admin] SCRIPT_NAME: `/identity` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:25:27.953539 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36773c3c-9bb8-4ec6-9d9f-ad01f9ab2a25 None admin] PATH_INFO: `/v3/roles` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:25:27.960766 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36773c3c-9bb8-4ec6-9d9f-ad01f9ab2a25 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=207601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:25:27.960766 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36773c3c-9bb8-4ec6-9d9f-ad01f9ab2a25 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:25:27.960766 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36773c3c-9bb8-4ec6-9d9f-ad01f9ab2a25 None admin] RBAC: Authorization granted {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:25:27.965131 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f0f5268-1169-4983-84a3-de02c39786ea None admin] Validating token access rules against request {{(pid=207600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:25:27.970273 dv-cinder-851351-1-smb devstack@keystone.service[207601]: [pid: 207601|app: 0|req: 536/1067] 10.222.0.42 () {56 vars in 1115 bytes} [Thu Jul 28 08:25:27 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:25:27.971223 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36773c3c-9bb8-4ec6-9d9f-ad01f9ab2a25 None admin] Authenticating user token {{(pid=207601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:25:28.001166 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fdfe85a-9930-4e95-ba4a-a368c195703d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:25:28.001831 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fdfe85a-9930-4e95-ba4a-a368c195703d None admin] REQUEST_METHOD: `GET` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:25:28.002118 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fdfe85a-9930-4e95-ba4a-a368c195703d None admin] SCRIPT_NAME: `/identity` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:25:28.002405 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fdfe85a-9930-4e95-ba4a-a368c195703d None admin] PATH_INFO: `/v3/domains` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:25:28.003116 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fdfe85a-9930-4e95-ba4a-a368c195703d None admin] RBAC: Adding query filter params (name=Default) {{(pid=207600) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:25:28.003442 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fdfe85a-9930-4e95-ba4a-a368c195703d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:25:28.004858 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fdfe85a-9930-4e95-ba4a-a368c195703d None admin] RBAC: Authorization granted {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:25:28.028709 dv-cinder-851351-1-smb devstack@keystone.service[207600]: [pid: 207600|app: 0|req: 532/1068] 10.222.0.42 () {56 vars in 1109 bytes} [Thu Jul 28 08:25:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 08:25:28.086297 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36773c3c-9bb8-4ec6-9d9f-ad01f9ab2a25 None admin] Validating token access rules against request {{(pid=207601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:25:28.126140 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3fa4293-93ea-4643-bb65-4ca58063fe7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:25:28.126825 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3fa4293-93ea-4643-bb65-4ca58063fe7b None admin] REQUEST_METHOD: `GET` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:25:28.127113 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3fa4293-93ea-4643-bb65-4ca58063fe7b None admin] SCRIPT_NAME: `/identity` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:25:28.127392 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3fa4293-93ea-4643-bb65-4ca58063fe7b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:25:28.140123 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3fa4293-93ea-4643-bb65-4ca58063fe7b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:25:28.141663 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3fa4293-93ea-4643-bb65-4ca58063fe7b None admin] RBAC: Authorization granted {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:25:28.158365 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application [None req-f3fa4293-93ea-4643-bb65-4ca58063fe7b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 08:25:28.158365 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:25:28.158365 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:25:28.158365 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:25:28.158365 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:25:28.158365 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:25:28.158365 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:25:28.158365 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:25:28.158365 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:25:28.158365 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:25:28.158365 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:25:28.158365 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:25:28.158365 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 08:25:28.158365 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 08:25:28.158365 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 08:25:28.159513 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 08:25:28.159513 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:25:28.159513 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:25:28.159513 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:25:28.159513 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:25:28.159513 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:25:28.159513 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:25:28.159513 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:25:28.159513 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application with Lock( Jul 28 08:25:28.159513 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:25:28.159513 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:25:28.159513 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:25:28.159513 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:25:28.159513 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:25:28.159513 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:25:28.159513 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:25:28.159513 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:25:28.161842 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 08:25:28.161842 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 08:25:28.161842 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 08:25:28.161842 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application Jul 28 08:25:28.161842 dv-cinder-851351-1-smb devstack@keystone.service[207601]: [pid: 207601|app: 0|req: 537/1069] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 08:25:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:25:28.165822 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fdfe85a-9930-4e95-ba4a-a368c195703d None admin] Authenticating user token {{(pid=207600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:25:28.273592 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fdfe85a-9930-4e95-ba4a-a368c195703d None admin] Validating token access rules against request {{(pid=207600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:25:28.309943 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e8d897-e03e-4b8a-af8a-3a71e485ad43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:25:28.310582 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e8d897-e03e-4b8a-af8a-3a71e485ad43 None admin] REQUEST_METHOD: `GET` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:25:28.310869 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e8d897-e03e-4b8a-af8a-3a71e485ad43 None admin] SCRIPT_NAME: `/identity` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:25:28.311147 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e8d897-e03e-4b8a-af8a-3a71e485ad43 None admin] PATH_INFO: `/v3/domains` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:25:28.311867 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99e8d897-e03e-4b8a-af8a-3a71e485ad43 None admin] RBAC: Adding query filter params (name=Default) {{(pid=207600) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:25:28.312176 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99e8d897-e03e-4b8a-af8a-3a71e485ad43 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:25:28.313606 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99e8d897-e03e-4b8a-af8a-3a71e485ad43 None admin] RBAC: Authorization granted {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:25:28.316135 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG dbcounter [-] [207600] Writing DB stats keystone:SELECT=100 {{(pid=207600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:25:28.326800 dv-cinder-851351-1-smb devstack@keystone.service[207600]: [pid: 207600|app: 0|req: 533/1070] 10.222.0.42 () {56 vars in 1109 bytes} [Thu Jul 28 08:25:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 08:25:28.332595 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3fa4293-93ea-4643-bb65-4ca58063fe7b None admin] Authenticating user token {{(pid=207601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:25:28.352972 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG dbcounter [-] [207601] Writing DB stats keystone:SELECT=100 {{(pid=207601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:25:28.436289 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3fa4293-93ea-4643-bb65-4ca58063fe7b None admin] Validating token access rules against request {{(pid=207601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:25:28.472353 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5eea4ec-d150-4a15-8899-61e1195ac336 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:25:28.473037 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5eea4ec-d150-4a15-8899-61e1195ac336 None admin] REQUEST_METHOD: `GET` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:25:28.473319 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5eea4ec-d150-4a15-8899-61e1195ac336 None admin] SCRIPT_NAME: `/identity` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:25:28.473593 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5eea4ec-d150-4a15-8899-61e1195ac336 None admin] PATH_INFO: `/v3/users/nova` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:25:28.482037 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5eea4ec-d150-4a15-8899-61e1195ac336 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:25:28.483473 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5eea4ec-d150-4a15-8899-61e1195ac336 None admin] RBAC: Authorization granted {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:25:28.495432 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application [None req-f5eea4ec-d150-4a15-8899-61e1195ac336 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 28 08:25:28.495432 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:25:28.495432 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:25:28.495432 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:25:28.495432 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:25:28.495432 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:25:28.495432 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:25:28.495432 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:25:28.495432 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:25:28.495432 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:25:28.495432 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:25:28.495432 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:25:28.495432 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 28 08:25:28.495432 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 28 08:25:28.495432 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 28 08:25:28.495432 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 28 08:25:28.496515 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:25:28.496515 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:25:28.496515 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 28 08:25:28.496515 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 08:25:28.496515 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 28 08:25:28.496515 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 08:25:28.496515 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:25:28.496515 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:25:28.496515 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:25:28.496515 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:25:28.496515 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:25:28.496515 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application with Lock( Jul 28 08:25:28.496515 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:25:28.496515 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:25:28.496515 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:25:28.496515 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:25:28.496515 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:25:28.496515 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:25:28.497579 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:25:28.497579 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:25:28.497579 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 28 08:25:28.497579 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 28 08:25:28.497579 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 28 08:25:28.497579 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 28 08:25:28.497579 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 28 08:25:28.497579 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 28 08:25:28.497579 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 28 08:25:28.497579 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application Jul 28 08:25:28.497579 dv-cinder-851351-1-smb devstack@keystone.service[207601]: [pid: 207601|app: 0|req: 538/1071] 10.222.0.42 () {56 vars in 1093 bytes} [Thu Jul 28 08:25:28 2022] GET /identity/v3/users/nova => generated 82 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:25:28.503029 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e8d897-e03e-4b8a-af8a-3a71e485ad43 None admin] Authenticating user token {{(pid=207600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:25:28.607975 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e8d897-e03e-4b8a-af8a-3a71e485ad43 None admin] Validating token access rules against request {{(pid=207600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:25:28.646172 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11fd06eb-c396-4ff1-b927-8bfd61c0e0be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:25:28.646820 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11fd06eb-c396-4ff1-b927-8bfd61c0e0be None admin] REQUEST_METHOD: `GET` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:25:28.647104 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11fd06eb-c396-4ff1-b927-8bfd61c0e0be None admin] SCRIPT_NAME: `/identity` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:25:28.647380 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11fd06eb-c396-4ff1-b927-8bfd61c0e0be None admin] PATH_INFO: `/v3/users` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:25:28.648252 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11fd06eb-c396-4ff1-b927-8bfd61c0e0be None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=207600) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:25:28.648566 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11fd06eb-c396-4ff1-b927-8bfd61c0e0be None admin] RBAC: Authorizing `identity:list_users()` {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:25:28.650125 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11fd06eb-c396-4ff1-b927-8bfd61c0e0be None admin] RBAC: Authorization granted {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:25:28.670728 dv-cinder-851351-1-smb devstack@keystone.service[207600]: [pid: 207600|app: 0|req: 534/1072] 10.222.0.42 () {56 vars in 1133 bytes} [Thu Jul 28 08:25:28 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:25:28.676999 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5eea4ec-d150-4a15-8899-61e1195ac336 None admin] Authenticating user token {{(pid=207601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:25:28.765783 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG dbcounter [-] [207601] Writing DB stats keystone:SELECT=100 {{(pid=207601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:25:28.789132 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5eea4ec-d150-4a15-8899-61e1195ac336 None admin] Validating token access rules against request {{(pid=207601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:25:28.823865 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de54759-1f8f-4210-8c75-ff472b1d7127 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:25:28.824533 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de54759-1f8f-4210-8c75-ff472b1d7127 None admin] REQUEST_METHOD: `GET` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:25:28.824860 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de54759-1f8f-4210-8c75-ff472b1d7127 None admin] SCRIPT_NAME: `/identity` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:25:28.825137 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de54759-1f8f-4210-8c75-ff472b1d7127 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:25:28.837398 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de54759-1f8f-4210-8c75-ff472b1d7127 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:25:28.838867 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de54759-1f8f-4210-8c75-ff472b1d7127 None admin] RBAC: Authorization granted {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:25:28.854412 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application [None req-7de54759-1f8f-4210-8c75-ff472b1d7127 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 08:25:28.854412 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:25:28.854412 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:25:28.854412 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:25:28.854412 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:25:28.854412 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:25:28.854412 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:25:28.854412 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:25:28.854412 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:25:28.854412 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:25:28.854412 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:25:28.854412 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:25:28.854412 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 08:25:28.854412 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 08:25:28.854412 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 08:25:28.855620 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 08:25:28.855620 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:25:28.855620 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:25:28.855620 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:25:28.855620 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:25:28.855620 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:25:28.855620 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:25:28.855620 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:25:28.855620 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application with Lock( Jul 28 08:25:28.855620 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:25:28.855620 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:25:28.855620 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:25:28.855620 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:25:28.855620 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:25:28.855620 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:25:28.855620 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:25:28.855620 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:25:28.856809 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 08:25:28.856809 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 08:25:28.856809 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 08:25:28.856809 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application Jul 28 08:25:28.856809 dv-cinder-851351-1-smb devstack@keystone.service[207601]: [pid: 207601|app: 0|req: 539/1073] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 08:25:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:25:28.861826 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11fd06eb-c396-4ff1-b927-8bfd61c0e0be None admin] Authenticating user token {{(pid=207600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:25:28.923725 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG dbcounter [-] [207600] Writing DB stats keystone:SELECT=100 {{(pid=207600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:25:28.970851 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11fd06eb-c396-4ff1-b927-8bfd61c0e0be None admin] Validating token access rules against request {{(pid=207600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:25:29.007995 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f76dbf-ce12-4a2d-8833-6e6dc71eeb69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:25:29.008627 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f76dbf-ce12-4a2d-8833-6e6dc71eeb69 None admin] REQUEST_METHOD: `GET` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:25:29.008938 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f76dbf-ce12-4a2d-8833-6e6dc71eeb69 None admin] SCRIPT_NAME: `/identity` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:25:29.009214 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f76dbf-ce12-4a2d-8833-6e6dc71eeb69 None admin] PATH_INFO: `/v3/domains` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:25:29.009920 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f76dbf-ce12-4a2d-8833-6e6dc71eeb69 None admin] RBAC: Adding query filter params (name=Default) {{(pid=207600) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:25:29.010232 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f76dbf-ce12-4a2d-8833-6e6dc71eeb69 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:25:29.011640 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f76dbf-ce12-4a2d-8833-6e6dc71eeb69 None admin] RBAC: Authorization granted {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:25:29.023939 dv-cinder-851351-1-smb devstack@keystone.service[207600]: [pid: 207600|app: 0|req: 535/1074] 10.222.0.42 () {56 vars in 1109 bytes} [Thu Jul 28 08:25:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:25:29.029846 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de54759-1f8f-4210-8c75-ff472b1d7127 None admin] Authenticating user token {{(pid=207601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:25:29.137731 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de54759-1f8f-4210-8c75-ff472b1d7127 None admin] Validating token access rules against request {{(pid=207601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:25:29.167746 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG dbcounter [-] [207601] Writing DB stats keystone:SELECT=100 {{(pid=207601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:25:29.174007 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df13946f-d37c-487a-8f2a-6dfa5c8aac61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:25:29.174672 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df13946f-d37c-487a-8f2a-6dfa5c8aac61 None admin] REQUEST_METHOD: `GET` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:25:29.174958 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df13946f-d37c-487a-8f2a-6dfa5c8aac61 None admin] SCRIPT_NAME: `/identity` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:25:29.175237 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df13946f-d37c-487a-8f2a-6dfa5c8aac61 None admin] PATH_INFO: `/v3/projects/service` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:25:29.182367 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df13946f-d37c-487a-8f2a-6dfa5c8aac61 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:25:29.183837 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df13946f-d37c-487a-8f2a-6dfa5c8aac61 None admin] RBAC: Authorization granted {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:25:29.195426 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application [None req-df13946f-d37c-487a-8f2a-6dfa5c8aac61 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 08:25:29.195426 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:25:29.195426 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:25:29.195426 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:25:29.195426 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:25:29.195426 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:25:29.195426 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:25:29.195426 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:25:29.195426 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:25:29.195426 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:25:29.195426 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:25:29.195426 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:25:29.195426 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 28 08:25:29.195426 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 28 08:25:29.195426 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 28 08:25:29.196448 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 28 08:25:29.196448 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:25:29.196448 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:25:29.196448 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:25:29.196448 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:25:29.196448 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:25:29.196448 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:25:29.196448 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:25:29.196448 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application with Lock( Jul 28 08:25:29.196448 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:25:29.196448 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:25:29.196448 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:25:29.196448 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:25:29.196448 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:25:29.196448 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:25:29.196448 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:25:29.196448 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:25:29.198109 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 28 08:25:29.198109 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 28 08:25:29.198109 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 28 08:25:29.198109 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 28 08:25:29.198109 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 28 08:25:29.198109 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 28 08:25:29.198109 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 08:25:29.198109 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application Jul 28 08:25:29.198109 dv-cinder-851351-1-smb devstack@keystone.service[207601]: [pid: 207601|app: 0|req: 540/1075] 10.222.0.42 () {56 vars in 1111 bytes} [Thu Jul 28 08:25:29 2022] GET /identity/v3/projects/service => generated 88 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:25:29.204552 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f76dbf-ce12-4a2d-8833-6e6dc71eeb69 None admin] Authenticating user token {{(pid=207600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:25:29.313371 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f76dbf-ce12-4a2d-8833-6e6dc71eeb69 None admin] Validating token access rules against request {{(pid=207600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:25:29.328088 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG dbcounter [-] [207600] Writing DB stats keystone:SELECT=100 {{(pid=207600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:25:29.350590 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-632dcf9f-4392-4087-8bdc-5fc08b6e2694 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:25:29.351223 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632dcf9f-4392-4087-8bdc-5fc08b6e2694 None admin] REQUEST_METHOD: `GET` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:25:29.351558 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632dcf9f-4392-4087-8bdc-5fc08b6e2694 None admin] SCRIPT_NAME: `/identity` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:25:29.351817 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632dcf9f-4392-4087-8bdc-5fc08b6e2694 None admin] PATH_INFO: `/v3/projects` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:25:29.352594 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-632dcf9f-4392-4087-8bdc-5fc08b6e2694 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=207600) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:25:29.352940 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-632dcf9f-4392-4087-8bdc-5fc08b6e2694 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:25:29.354403 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-632dcf9f-4392-4087-8bdc-5fc08b6e2694 None admin] RBAC: Authorization granted {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:25:29.367347 dv-cinder-851351-1-smb devstack@keystone.service[207600]: [pid: 207600|app: 0|req: 536/1076] 10.222.0.42 () {56 vars in 1148 bytes} [Thu Jul 28 08:25:29 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:25:29.373869 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df13946f-d37c-487a-8f2a-6dfa5c8aac61 None admin] Authenticating user token {{(pid=207601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:25:29.497164 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df13946f-d37c-487a-8f2a-6dfa5c8aac61 None admin] Validating token access rules against request {{(pid=207601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:25:29.535802 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d521d11-c786-4a76-bbb5-e165f3be59ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:25:29.536518 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d521d11-c786-4a76-bbb5-e165f3be59ff None admin] REQUEST_METHOD: `PUT` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:25:29.536852 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d521d11-c786-4a76-bbb5-e165f3be59ff None admin] SCRIPT_NAME: `/identity` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:25:29.537121 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d521d11-c786-4a76-bbb5-e165f3be59ff None admin] PATH_INFO: `/v3/projects/48c5f2b2ae2b48758b957d2b194a7fd1/users/03804b1369934a7692da4d5646465bdc/roles/a67e4d87d7f74c65a98b947bd4f6c11d` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:25:29.539515 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d521d11-c786-4a76-bbb5-e165f3be59ff None admin] RBAC: Authorizing `identity:create_grant(project_id=48c5f2b2ae2b48758b957d2b194a7fd1, user_id=03804b1369934a7692da4d5646465bdc, role_id=a67e4d87d7f74c65a98b947bd4f6c11d)` {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:25:29.541036 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d521d11-c786-4a76-bbb5-e165f3be59ff None admin] RBAC: Authorization granted {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:25:29.556203 dv-cinder-851351-1-smb devstack@keystone.service[207601]: [pid: 207601|app: 0|req: 541/1077] 10.222.0.42 () {58 vars in 1439 bytes} [Thu Jul 28 08:25:29 2022] PUT /identity/v3/projects/48c5f2b2ae2b48758b957d2b194a7fd1/users/03804b1369934a7692da4d5646465bdc/roles/a67e4d87d7f74c65a98b947bd4f6c11d => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 08:25:29.807304 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965db3aa-b57a-4087-af6f-c2b9bd93248e None None] REQUEST_METHOD: `GET` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:25:29.807618 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965db3aa-b57a-4087-af6f-c2b9bd93248e None None] SCRIPT_NAME: `/identity` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:25:29.807915 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965db3aa-b57a-4087-af6f-c2b9bd93248e None None] PATH_INFO: `/` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:25:29.809400 dv-cinder-851351-1-smb devstack@keystone.service[207600]: [pid: 207600|app: 0|req: 537/1078] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 08:25:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 08:25:29.815651 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471798ea-8c26-4b35-9cbc-7e93a63e547b None None] REQUEST_METHOD: `POST` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:25:29.816031 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471798ea-8c26-4b35-9cbc-7e93a63e547b None None] SCRIPT_NAME: `/identity` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:25:29.816379 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471798ea-8c26-4b35-9cbc-7e93a63e547b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:25:29.836008 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.auth.core [None req-471798ea-8c26-4b35-9cbc-7e93a63e547b None None] MFA Rules not processed for user `b8110ade874c4aa7af27f5c376df700a`. Rule list: `[]` (Enabled: `True`). {{(pid=207601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 08:25:29.837627 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.fernet_utils [None req-471798ea-8c26-4b35-9cbc-7e93a63e547b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=207601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:25:29.891195 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG dbcounter [-] [207601] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=207601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:25:29.918287 dv-cinder-851351-1-smb devstack@keystone.service[207601]: [pid: 207601|app: 0|req: 542/1079] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 08:25:29 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 08:25:29.943626 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-965db3aa-b57a-4087-af6f-c2b9bd93248e None None] Authenticating user token {{(pid=207600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:25:30.050621 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-965db3aa-b57a-4087-af6f-c2b9bd93248e None None] Validating token access rules against request {{(pid=207600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:25:30.084993 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78af08d-e5ec-4a24-9e81-e3f9ecaedde8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:25:30.085673 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78af08d-e5ec-4a24-9e81-e3f9ecaedde8 None admin] REQUEST_METHOD: `GET` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:25:30.085955 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78af08d-e5ec-4a24-9e81-e3f9ecaedde8 None admin] SCRIPT_NAME: `/identity` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:25:30.086221 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78af08d-e5ec-4a24-9e81-e3f9ecaedde8 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:25:30.097214 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e78af08d-e5ec-4a24-9e81-e3f9ecaedde8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 08:25:30.102254 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application [None req-e78af08d-e5ec-4a24-9e81-e3f9ecaedde8 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 08:25:30.102254 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:25:30.102254 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:25:30.102254 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:25:30.102254 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:25:30.102254 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:25:30.102254 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:25:30.102254 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:25:30.102254 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:25:30.102254 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:25:30.102254 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:25:30.102254 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:25:30.102254 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 08:25:30.102254 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 08:25:30.102254 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 08:25:30.102254 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 08:25:30.103344 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 08:25:30.103344 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 08:25:30.103344 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 08:25:30.103344 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 08:25:30.103344 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:25:30.103344 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:25:30.103344 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:25:30.103344 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:25:30.103344 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:25:30.103344 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:25:30.103344 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:25:30.103344 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application with Lock( Jul 28 08:25:30.103344 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:25:30.103344 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:25:30.103344 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:25:30.103344 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:25:30.104852 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:25:30.104852 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:25:30.104852 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:25:30.104852 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:25:30.104852 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 08:25:30.104852 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 08:25:30.104852 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 08:25:30.104852 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 08:25:30.104852 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 08:25:30.104852 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 08:25:30.104852 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 08:25:30.104852 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application Jul 28 08:25:30.104852 dv-cinder-851351-1-smb devstack@keystone.service[207600]: [pid: 207600|app: 0|req: 538/1080] 10.222.0.42 () {56 vars in 1096 bytes} [Thu Jul 28 08:25:29 2022] GET /identity/v3/roles/admin => generated 83 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:25:30.109896 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-471798ea-8c26-4b35-9cbc-7e93a63e547b None None] Authenticating user token {{(pid=207601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:25:30.217173 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-471798ea-8c26-4b35-9cbc-7e93a63e547b None None] Validating token access rules against request {{(pid=207601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:25:30.253407 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ee297a-40fa-480b-85c9-1ec1ac1c0fd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:25:30.254044 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ee297a-40fa-480b-85c9-1ec1ac1c0fd9 None admin] REQUEST_METHOD: `GET` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:25:30.254334 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ee297a-40fa-480b-85c9-1ec1ac1c0fd9 None admin] SCRIPT_NAME: `/identity` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:25:30.254610 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ee297a-40fa-480b-85c9-1ec1ac1c0fd9 None admin] PATH_INFO: `/v3/roles` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:25:30.255353 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65ee297a-40fa-480b-85c9-1ec1ac1c0fd9 None admin] RBAC: Adding query filter params (name=admin) {{(pid=207601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:25:30.255661 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65ee297a-40fa-480b-85c9-1ec1ac1c0fd9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:25:30.257086 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65ee297a-40fa-480b-85c9-1ec1ac1c0fd9 None admin] RBAC: Authorization granted {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:25:30.266086 dv-cinder-851351-1-smb devstack@keystone.service[207601]: [pid: 207601|app: 0|req: 543/1081] 10.222.0.42 () {56 vars in 1099 bytes} [Thu Jul 28 08:25:30 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:25:30.272187 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78af08d-e5ec-4a24-9e81-e3f9ecaedde8 None admin] Authenticating user token {{(pid=207600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:25:30.308075 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG dbcounter [-] [207600] Writing DB stats keystone:SELECT=100 {{(pid=207600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:25:30.377671 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78af08d-e5ec-4a24-9e81-e3f9ecaedde8 None admin] Validating token access rules against request {{(pid=207600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:25:30.412877 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-956ea34a-6243-407a-87d6-a00edc2054a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:25:30.413523 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956ea34a-6243-407a-87d6-a00edc2054a6 None admin] REQUEST_METHOD: `GET` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:25:30.413786 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956ea34a-6243-407a-87d6-a00edc2054a6 None admin] SCRIPT_NAME: `/identity` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:25:30.414091 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956ea34a-6243-407a-87d6-a00edc2054a6 None admin] PATH_INFO: `/v3/users/146d0f186fe844a9bf7239a8d4d3e8aa` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:25:30.415320 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-956ea34a-6243-407a-87d6-a00edc2054a6 None admin] RBAC: Authorizing `identity:get_user(user_id=146d0f186fe844a9bf7239a8d4d3e8aa)` {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:25:30.416809 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-956ea34a-6243-407a-87d6-a00edc2054a6 None admin] RBAC: Authorization granted {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:25:30.418394 dv-cinder-851351-1-smb devstack@keystone.service[207600]: [pid: 207600|app: 0|req: 539/1082] 10.222.0.42 () {56 vars in 1177 bytes} [Thu Jul 28 08:25:30 2022] GET /identity/v3/users/146d0f186fe844a9bf7239a8d4d3e8aa => generated 285 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:25:30.425003 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ee297a-40fa-480b-85c9-1ec1ac1c0fd9 None admin] Authenticating user token {{(pid=207601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:25:30.476495 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG dbcounter [-] [207601] Writing DB stats keystone:SELECT=100 {{(pid=207601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:25:30.536094 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ee297a-40fa-480b-85c9-1ec1ac1c0fd9 None admin] Validating token access rules against request {{(pid=207601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:25:30.573828 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d95e4d82-0e52-44f3-af02-7bcec5202719 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:25:30.574485 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95e4d82-0e52-44f3-af02-7bcec5202719 None admin] REQUEST_METHOD: `GET` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:25:30.574771 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95e4d82-0e52-44f3-af02-7bcec5202719 None admin] SCRIPT_NAME: `/identity` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:25:30.575046 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95e4d82-0e52-44f3-af02-7bcec5202719 None admin] PATH_INFO: `/v3/projects/04123529b032481fbb9473b506dea8b6` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:25:30.576270 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d95e4d82-0e52-44f3-af02-7bcec5202719 None admin] RBAC: Authorizing `identity:get_project(project_id=04123529b032481fbb9473b506dea8b6)` {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:25:30.577781 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d95e4d82-0e52-44f3-af02-7bcec5202719 None admin] RBAC: Authorization granted {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:25:30.579473 dv-cinder-851351-1-smb devstack@keystone.service[207601]: [pid: 207601|app: 0|req: 544/1083] 10.222.0.42 () {56 vars in 1186 bytes} [Thu Jul 28 08:25:30 2022] GET /identity/v3/projects/04123529b032481fbb9473b506dea8b6 => generated 311 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:25:30.585809 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-956ea34a-6243-407a-87d6-a00edc2054a6 None admin] Authenticating user token {{(pid=207600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:25:30.693547 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-956ea34a-6243-407a-87d6-a00edc2054a6 None admin] Validating token access rules against request {{(pid=207600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:25:30.695084 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG dbcounter [-] [207600] Writing DB stats keystone:SELECT=100 {{(pid=207600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:25:30.731127 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c28a52-fc0c-4a56-acf9-e844a25596b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:25:30.731806 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c28a52-fc0c-4a56-acf9-e844a25596b4 None admin] REQUEST_METHOD: `PUT` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:25:30.732086 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c28a52-fc0c-4a56-acf9-e844a25596b4 None admin] SCRIPT_NAME: `/identity` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:25:30.732356 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c28a52-fc0c-4a56-acf9-e844a25596b4 None admin] PATH_INFO: `/v3/projects/04123529b032481fbb9473b506dea8b6/users/146d0f186fe844a9bf7239a8d4d3e8aa/roles/d0ce88034c6b41878db755343f5840be` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:25:30.734342 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c28a52-fc0c-4a56-acf9-e844a25596b4 None admin] RBAC: Authorizing `identity:create_grant(project_id=04123529b032481fbb9473b506dea8b6, user_id=146d0f186fe844a9bf7239a8d4d3e8aa, role_id=d0ce88034c6b41878db755343f5840be)` {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:25:30.735798 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c28a52-fc0c-4a56-acf9-e844a25596b4 None admin] RBAC: Authorization granted {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:25:30.749953 dv-cinder-851351-1-smb devstack@keystone.service[207600]: [pid: 207600|app: 0|req: 540/1084] 10.222.0.42 () {58 vars in 1439 bytes} [Thu Jul 28 08:25:30 2022] PUT /identity/v3/projects/04123529b032481fbb9473b506dea8b6/users/146d0f186fe844a9bf7239a8d4d3e8aa/roles/d0ce88034c6b41878db755343f5840be => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 08:25:31.564715 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320df102-0205-4638-83cb-cae4f8ef60fc None None] REQUEST_METHOD: `GET` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:25:31.565291 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320df102-0205-4638-83cb-cae4f8ef60fc None None] SCRIPT_NAME: `/identity` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:25:31.565291 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320df102-0205-4638-83cb-cae4f8ef60fc None None] PATH_INFO: `/` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:25:31.566647 dv-cinder-851351-1-smb devstack@keystone.service[207601]: [pid: 207601|app: 0|req: 545/1085] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 08:25:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 08:25:31.572041 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb52f5fd-8062-4780-8758-2493a92185d3 None None] REQUEST_METHOD: `POST` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:25:31.572515 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb52f5fd-8062-4780-8758-2493a92185d3 None None] SCRIPT_NAME: `/identity` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:25:31.572613 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb52f5fd-8062-4780-8758-2493a92185d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:25:31.591765 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.auth.core [None req-fb52f5fd-8062-4780-8758-2493a92185d3 None None] MFA Rules not processed for user `b8110ade874c4aa7af27f5c376df700a`. Rule list: `[]` (Enabled: `True`). {{(pid=207600) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 08:25:31.592987 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.fernet_utils [None req-fb52f5fd-8062-4780-8758-2493a92185d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=207600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:25:31.663335 dv-cinder-851351-1-smb devstack@keystone.service[207600]: [pid: 207600|app: 0|req: 541/1086] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 08:25:31 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 08:25:31.686651 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320df102-0205-4638-83cb-cae4f8ef60fc None None] Authenticating user token {{(pid=207601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:25:31.795125 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320df102-0205-4638-83cb-cae4f8ef60fc None None] Validating token access rules against request {{(pid=207601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:25:31.806353 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG dbcounter [-] [207601] Writing DB stats keystone:SELECT=100 {{(pid=207601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:25:31.831489 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a8aa71-4c2d-43a6-85a5-01318e6b24f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:25:31.832180 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a8aa71-4c2d-43a6-85a5-01318e6b24f8 None admin] REQUEST_METHOD: `GET` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:25:31.832461 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a8aa71-4c2d-43a6-85a5-01318e6b24f8 None admin] SCRIPT_NAME: `/identity` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:25:31.832779 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a8aa71-4c2d-43a6-85a5-01318e6b24f8 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:25:31.846638 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8a8aa71-4c2d-43a6-85a5-01318e6b24f8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 08:25:31.851865 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application [None req-f8a8aa71-4c2d-43a6-85a5-01318e6b24f8 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 28 08:25:31.851865 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:25:31.851865 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:25:31.851865 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:25:31.851865 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:25:31.851865 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:25:31.851865 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:25:31.851865 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:25:31.851865 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:25:31.851865 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:25:31.851865 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:25:31.851865 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:25:31.851865 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 08:25:31.851865 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 08:25:31.851865 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 08:25:31.851865 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 08:25:31.853208 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 08:25:31.853208 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 08:25:31.853208 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 08:25:31.853208 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 08:25:31.853208 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:25:31.853208 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:25:31.853208 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:25:31.853208 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:25:31.853208 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:25:31.853208 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:25:31.853208 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:25:31.853208 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application with Lock( Jul 28 08:25:31.853208 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:25:31.853208 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:25:31.853208 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:25:31.853208 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:25:31.854200 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:25:31.854200 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:25:31.854200 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:25:31.854200 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:25:31.854200 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 08:25:31.854200 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 08:25:31.854200 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 08:25:31.854200 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 08:25:31.854200 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 08:25:31.854200 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 08:25:31.854200 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 28 08:25:31.854200 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application Jul 28 08:25:31.854200 dv-cinder-851351-1-smb devstack@keystone.service[207601]: [pid: 207601|app: 0|req: 546/1087] 10.222.0.42 () {56 vars in 1120 bytes} [Thu Jul 28 08:25:31 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:25:31.859217 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb52f5fd-8062-4780-8758-2493a92185d3 None None] Authenticating user token {{(pid=207600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:25:31.968068 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG dbcounter [-] [207600] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=207600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:25:31.979094 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb52f5fd-8062-4780-8758-2493a92185d3 None None] Validating token access rules against request {{(pid=207600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:25:32.014110 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c99feed-1665-4f2f-ba04-9c3534f8df23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:25:32.014753 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c99feed-1665-4f2f-ba04-9c3534f8df23 None admin] REQUEST_METHOD: `GET` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:25:32.015034 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c99feed-1665-4f2f-ba04-9c3534f8df23 None admin] SCRIPT_NAME: `/identity` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:25:32.015308 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c99feed-1665-4f2f-ba04-9c3534f8df23 None admin] PATH_INFO: `/v3/roles` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:25:32.016047 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c99feed-1665-4f2f-ba04-9c3534f8df23 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=207600) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:25:32.016355 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c99feed-1665-4f2f-ba04-9c3534f8df23 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:25:32.017839 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c99feed-1665-4f2f-ba04-9c3534f8df23 None admin] RBAC: Authorization granted {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:25:32.026514 dv-cinder-851351-1-smb devstack@keystone.service[207600]: [pid: 207600|app: 0|req: 542/1088] 10.222.0.42 () {56 vars in 1115 bytes} [Thu Jul 28 08:25:31 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:25:32.032539 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a8aa71-4c2d-43a6-85a5-01318e6b24f8 None admin] Authenticating user token {{(pid=207601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:25:32.140300 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a8aa71-4c2d-43a6-85a5-01318e6b24f8 None admin] Validating token access rules against request {{(pid=207601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:25:32.177786 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f237125-2078-47ca-8b28-bfb98febf457 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:25:32.178445 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f237125-2078-47ca-8b28-bfb98febf457 None admin] REQUEST_METHOD: `GET` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:25:32.178733 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f237125-2078-47ca-8b28-bfb98febf457 None admin] SCRIPT_NAME: `/identity` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:25:32.179010 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f237125-2078-47ca-8b28-bfb98febf457 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:25:32.190187 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f237125-2078-47ca-8b28-bfb98febf457 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:25:32.191646 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f237125-2078-47ca-8b28-bfb98febf457 None admin] RBAC: Authorization granted {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:25:32.206849 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application [None req-8f237125-2078-47ca-8b28-bfb98febf457 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 08:25:32.206849 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:25:32.206849 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:25:32.206849 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:25:32.206849 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:25:32.206849 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:25:32.206849 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:25:32.206849 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:25:32.206849 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:25:32.206849 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:25:32.206849 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:25:32.206849 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:25:32.206849 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 08:25:32.206849 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 08:25:32.206849 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 08:25:32.207890 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 08:25:32.207890 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:25:32.207890 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:25:32.207890 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:25:32.207890 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:25:32.207890 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:25:32.207890 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:25:32.207890 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:25:32.207890 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application with Lock( Jul 28 08:25:32.207890 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:25:32.207890 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:25:32.207890 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:25:32.207890 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:25:32.207890 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:25:32.207890 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:25:32.207890 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:25:32.207890 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:25:32.208922 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 08:25:32.208922 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 08:25:32.208922 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 08:25:32.208922 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application Jul 28 08:25:32.208922 dv-cinder-851351-1-smb devstack@keystone.service[207601]: [pid: 207601|app: 0|req: 547/1089] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 08:25:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 08:25:32.214673 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c99feed-1665-4f2f-ba04-9c3534f8df23 None admin] Authenticating user token {{(pid=207600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:25:32.323498 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c99feed-1665-4f2f-ba04-9c3534f8df23 None admin] Validating token access rules against request {{(pid=207600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:25:32.360451 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7c75ab-5e54-40a9-abcd-41a9c223dad7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:25:32.361129 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7c75ab-5e54-40a9-abcd-41a9c223dad7 None admin] REQUEST_METHOD: `GET` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:25:32.361413 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7c75ab-5e54-40a9-abcd-41a9c223dad7 None admin] SCRIPT_NAME: `/identity` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:25:32.361691 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7c75ab-5e54-40a9-abcd-41a9c223dad7 None admin] PATH_INFO: `/v3/domains` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:25:32.362405 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c7c75ab-5e54-40a9-abcd-41a9c223dad7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=207600) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:25:32.362722 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c7c75ab-5e54-40a9-abcd-41a9c223dad7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:25:32.364108 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c7c75ab-5e54-40a9-abcd-41a9c223dad7 None admin] RBAC: Authorization granted {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:25:32.376420 dv-cinder-851351-1-smb devstack@keystone.service[207600]: [pid: 207600|app: 0|req: 543/1090] 10.222.0.42 () {56 vars in 1109 bytes} [Thu Jul 28 08:25:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:25:32.382319 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f237125-2078-47ca-8b28-bfb98febf457 None admin] Authenticating user token {{(pid=207601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:25:32.409093 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG dbcounter [-] [207601] Writing DB stats keystone:SELECT=100 {{(pid=207601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:25:32.489033 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f237125-2078-47ca-8b28-bfb98febf457 None admin] Validating token access rules against request {{(pid=207601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:25:32.526463 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eef4d8d-e951-4e22-85a4-db184e914ffd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:25:32.527123 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eef4d8d-e951-4e22-85a4-db184e914ffd None admin] REQUEST_METHOD: `GET` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:25:32.527410 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eef4d8d-e951-4e22-85a4-db184e914ffd None admin] SCRIPT_NAME: `/identity` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:25:32.527688 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eef4d8d-e951-4e22-85a4-db184e914ffd None admin] PATH_INFO: `/v3/users/nova` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:25:32.535683 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eef4d8d-e951-4e22-85a4-db184e914ffd None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:25:32.537194 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eef4d8d-e951-4e22-85a4-db184e914ffd None admin] RBAC: Authorization granted {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:25:32.550322 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application [None req-6eef4d8d-e951-4e22-85a4-db184e914ffd None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 28 08:25:32.550322 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:25:32.550322 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:25:32.550322 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:25:32.550322 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:25:32.550322 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:25:32.550322 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:25:32.550322 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:25:32.550322 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:25:32.550322 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:25:32.550322 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:25:32.550322 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:25:32.550322 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 28 08:25:32.550322 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 28 08:25:32.550322 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 28 08:25:32.550322 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 28 08:25:32.551427 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:25:32.551427 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:25:32.551427 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 28 08:25:32.551427 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 08:25:32.551427 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 28 08:25:32.551427 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 08:25:32.551427 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:25:32.551427 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:25:32.551427 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:25:32.551427 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:25:32.551427 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:25:32.551427 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application with Lock( Jul 28 08:25:32.551427 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:25:32.551427 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:25:32.551427 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:25:32.551427 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:25:32.551427 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:25:32.551427 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:25:32.552464 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:25:32.552464 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:25:32.552464 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 28 08:25:32.552464 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 28 08:25:32.552464 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 28 08:25:32.552464 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 28 08:25:32.552464 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 28 08:25:32.552464 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 28 08:25:32.552464 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 28 08:25:32.552464 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application Jul 28 08:25:32.552464 dv-cinder-851351-1-smb devstack@keystone.service[207601]: [pid: 207601|app: 0|req: 548/1091] 10.222.0.42 () {56 vars in 1093 bytes} [Thu Jul 28 08:25:32 2022] GET /identity/v3/users/nova => generated 82 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:25:32.557630 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7c75ab-5e54-40a9-abcd-41a9c223dad7 None admin] Authenticating user token {{(pid=207600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:25:32.574254 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG dbcounter [-] [207600] Writing DB stats keystone:SELECT=100 {{(pid=207600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:25:32.664439 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7c75ab-5e54-40a9-abcd-41a9c223dad7 None admin] Validating token access rules against request {{(pid=207600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:25:32.699545 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52678f5c-1882-49dc-9689-c50e5395104d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:25:32.700184 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52678f5c-1882-49dc-9689-c50e5395104d None admin] REQUEST_METHOD: `GET` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:25:32.700498 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52678f5c-1882-49dc-9689-c50e5395104d None admin] SCRIPT_NAME: `/identity` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:25:32.700780 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52678f5c-1882-49dc-9689-c50e5395104d None admin] PATH_INFO: `/v3/users` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:25:32.701594 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52678f5c-1882-49dc-9689-c50e5395104d None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=207600) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:25:32.701905 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52678f5c-1882-49dc-9689-c50e5395104d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:25:32.703369 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52678f5c-1882-49dc-9689-c50e5395104d None admin] RBAC: Authorization granted {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:25:32.726852 dv-cinder-851351-1-smb devstack@keystone.service[207600]: [pid: 207600|app: 0|req: 544/1092] 10.222.0.42 () {56 vars in 1133 bytes} [Thu Jul 28 08:25:32 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:25:32.728149 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eef4d8d-e951-4e22-85a4-db184e914ffd None admin] Authenticating user token {{(pid=207601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:25:32.735356 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3537636c-30c8-4e1b-98fd-9846ceae8174 None None] REQUEST_METHOD: `GET` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:25:32.735645 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3537636c-30c8-4e1b-98fd-9846ceae8174 None None] SCRIPT_NAME: `/identity` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:25:32.735930 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3537636c-30c8-4e1b-98fd-9846ceae8174 None None] PATH_INFO: `/` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:25:32.737310 dv-cinder-851351-1-smb devstack@keystone.service[207600]: [pid: 207600|app: 0|req: 545/1093] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 08:25:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 28 08:25:32.742316 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2aac327-8b44-4d36-8a17-3e5bd1207654 None None] REQUEST_METHOD: `POST` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:25:32.742580 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2aac327-8b44-4d36-8a17-3e5bd1207654 None None] SCRIPT_NAME: `/identity` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:25:32.742870 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2aac327-8b44-4d36-8a17-3e5bd1207654 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:25:32.760702 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.auth.core [None req-b2aac327-8b44-4d36-8a17-3e5bd1207654 None None] MFA Rules not processed for user `b8110ade874c4aa7af27f5c376df700a`. Rule list: `[]` (Enabled: `True`). {{(pid=207600) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 08:25:32.761894 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.fernet_utils [None req-b2aac327-8b44-4d36-8a17-3e5bd1207654 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=207600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:25:32.823074 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG dbcounter [-] [207601] Writing DB stats keystone:SELECT=100 {{(pid=207601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:25:32.837932 dv-cinder-851351-1-smb devstack@keystone.service[207600]: [pid: 207600|app: 0|req: 546/1094] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 08:25:32 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 28 08:25:32.844269 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eef4d8d-e951-4e22-85a4-db184e914ffd None admin] Validating token access rules against request {{(pid=207601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:25:32.861174 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2aac327-8b44-4d36-8a17-3e5bd1207654 None None] Authenticating user token {{(pid=207600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:25:32.863514 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG dbcounter [-] [207600] Writing DB stats keystone:SELECT=100 {{(pid=207600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:25:32.881401 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee5b24b-fd70-4bf0-9e31-4ad77667d631 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:25:32.882231 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee5b24b-fd70-4bf0-9e31-4ad77667d631 None admin] REQUEST_METHOD: `GET` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:25:32.882836 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee5b24b-fd70-4bf0-9e31-4ad77667d631 None admin] SCRIPT_NAME: `/identity` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:25:32.883126 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee5b24b-fd70-4bf0-9e31-4ad77667d631 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:25:32.959443 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ee5b24b-fd70-4bf0-9e31-4ad77667d631 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:25:32.960955 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ee5b24b-fd70-4bf0-9e31-4ad77667d631 None admin] RBAC: Authorization granted {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:25:32.970037 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2aac327-8b44-4d36-8a17-3e5bd1207654 None None] Validating token access rules against request {{(pid=207600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:25:33.006088 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1940042-bf1a-413b-b176-6301046310d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:25:33.006750 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1940042-bf1a-413b-b176-6301046310d4 None admin] REQUEST_METHOD: `GET` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:25:33.007030 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1940042-bf1a-413b-b176-6301046310d4 None admin] SCRIPT_NAME: `/identity` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:25:33.007289 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1940042-bf1a-413b-b176-6301046310d4 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:25:33.017673 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1940042-bf1a-413b-b176-6301046310d4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 08:25:33.022694 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application [None req-f1940042-bf1a-413b-b176-6301046310d4 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 08:25:33.022694 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:25:33.022694 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:25:33.022694 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:25:33.022694 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:25:33.022694 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:25:33.022694 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:25:33.022694 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:25:33.022694 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:25:33.022694 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:25:33.022694 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:25:33.022694 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:25:33.022694 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 08:25:33.022694 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 08:25:33.022694 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 08:25:33.022694 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 08:25:33.023845 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 08:25:33.023845 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 08:25:33.023845 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 08:25:33.023845 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 08:25:33.023845 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:25:33.023845 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:25:33.023845 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:25:33.023845 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:25:33.023845 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:25:33.023845 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:25:33.023845 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:25:33.023845 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application with Lock( Jul 28 08:25:33.023845 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:25:33.023845 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:25:33.023845 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:25:33.023845 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:25:33.024788 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:25:33.024788 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:25:33.024788 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:25:33.024788 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:25:33.024788 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 08:25:33.024788 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 08:25:33.024788 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 08:25:33.024788 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 08:25:33.024788 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 08:25:33.024788 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 08:25:33.024788 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 08:25:33.024788 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application Jul 28 08:25:33.024788 dv-cinder-851351-1-smb devstack@keystone.service[207600]: [pid: 207600|app: 0|req: 547/1095] 10.222.0.42 () {56 vars in 1096 bytes} [Thu Jul 28 08:25:32 2022] GET /identity/v3/roles/admin => generated 83 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:25:33.030664 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1940042-bf1a-413b-b176-6301046310d4 None admin] Authenticating user token {{(pid=207600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:25:33.046402 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG dbcounter [-] [207601] Writing DB stats keystone:SELECT=100 {{(pid=207601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:25:33.066162 dv-cinder-851351-1-smb devstack@keystone.service[207601]: [pid: 207601|app: 0|req: 549/1096] 10.222.0.42 () {58 vars in 1282 bytes} [Thu Jul 28 08:25:32 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 28 08:25:33.072266 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee5b24b-fd70-4bf0-9e31-4ad77667d631 None admin] Authenticating user token {{(pid=207601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:25:33.094065 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG dbcounter [-] [207600] Writing DB stats keystone:SELECT=100 {{(pid=207600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:25:33.134641 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1940042-bf1a-413b-b176-6301046310d4 None admin] Validating token access rules against request {{(pid=207600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:25:33.169691 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15481f77-40d5-4a42-bb07-a7d1dac55427 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:25:33.170636 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15481f77-40d5-4a42-bb07-a7d1dac55427 None admin] REQUEST_METHOD: `GET` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:25:33.170914 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15481f77-40d5-4a42-bb07-a7d1dac55427 None admin] SCRIPT_NAME: `/identity` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:25:33.171211 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15481f77-40d5-4a42-bb07-a7d1dac55427 None admin] PATH_INFO: `/v3/roles` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:25:33.171956 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15481f77-40d5-4a42-bb07-a7d1dac55427 None admin] RBAC: Adding query filter params (name=admin) {{(pid=207600) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:25:33.172277 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15481f77-40d5-4a42-bb07-a7d1dac55427 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:25:33.173711 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15481f77-40d5-4a42-bb07-a7d1dac55427 None admin] RBAC: Authorization granted {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:25:33.174907 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee5b24b-fd70-4bf0-9e31-4ad77667d631 None admin] Validating token access rules against request {{(pid=207601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:25:33.182664 dv-cinder-851351-1-smb devstack@keystone.service[207600]: [pid: 207600|app: 0|req: 548/1097] 10.222.0.42 () {56 vars in 1099 bytes} [Thu Jul 28 08:25:33 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 08:25:33.188614 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15481f77-40d5-4a42-bb07-a7d1dac55427 None admin] Authenticating user token {{(pid=207600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:25:33.210349 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02eff807-f423-457d-a31e-7743f9a0a4f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:25:33.210970 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02eff807-f423-457d-a31e-7743f9a0a4f6 None admin] REQUEST_METHOD: `GET` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:25:33.211258 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02eff807-f423-457d-a31e-7743f9a0a4f6 None admin] SCRIPT_NAME: `/identity` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:25:33.211901 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02eff807-f423-457d-a31e-7743f9a0a4f6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:25:33.222457 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02eff807-f423-457d-a31e-7743f9a0a4f6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:25:33.223975 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02eff807-f423-457d-a31e-7743f9a0a4f6 None admin] RBAC: Authorization granted {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:25:33.240911 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application [None req-02eff807-f423-457d-a31e-7743f9a0a4f6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 08:25:33.240911 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:25:33.240911 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:25:33.240911 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:25:33.240911 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:25:33.240911 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:25:33.240911 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:25:33.240911 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:25:33.240911 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:25:33.240911 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:25:33.240911 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:25:33.240911 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:25:33.240911 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 08:25:33.240911 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 08:25:33.240911 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 08:25:33.241990 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 08:25:33.241990 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:25:33.241990 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:25:33.241990 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:25:33.241990 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:25:33.241990 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:25:33.241990 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:25:33.241990 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:25:33.241990 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application with Lock( Jul 28 08:25:33.241990 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:25:33.241990 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:25:33.241990 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:25:33.241990 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:25:33.241990 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:25:33.241990 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:25:33.241990 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:25:33.241990 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:25:33.243475 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 08:25:33.243475 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 08:25:33.243475 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 08:25:33.243475 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application Jul 28 08:25:33.243475 dv-cinder-851351-1-smb devstack@keystone.service[207601]: [pid: 207601|app: 0|req: 550/1098] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 08:25:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 08:25:33.248018 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02eff807-f423-457d-a31e-7743f9a0a4f6 None admin] Authenticating user token {{(pid=207601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:25:33.284045 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG dbcounter [-] [207601] Writing DB stats keystone:SELECT=100 {{(pid=207601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:25:33.295750 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15481f77-40d5-4a42-bb07-a7d1dac55427 None admin] Validating token access rules against request {{(pid=207600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:25:33.319293 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG dbcounter [-] [207600] Writing DB stats keystone:SELECT=100 {{(pid=207600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:25:33.330567 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c349d1-a6d4-461a-83a2-773a53f49b39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:25:33.331226 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c349d1-a6d4-461a-83a2-773a53f49b39 None admin] REQUEST_METHOD: `GET` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:25:33.331518 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c349d1-a6d4-461a-83a2-773a53f49b39 None admin] SCRIPT_NAME: `/identity` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:25:33.331846 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c349d1-a6d4-461a-83a2-773a53f49b39 None admin] PATH_INFO: `/v3/users/146d0f186fe844a9bf7239a8d4d3e8aa` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:25:33.333084 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c349d1-a6d4-461a-83a2-773a53f49b39 None admin] RBAC: Authorizing `identity:get_user(user_id=146d0f186fe844a9bf7239a8d4d3e8aa)` {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:25:33.334543 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c349d1-a6d4-461a-83a2-773a53f49b39 None admin] RBAC: Authorization granted {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:25:33.338887 dv-cinder-851351-1-smb devstack@keystone.service[207600]: [pid: 207600|app: 0|req: 549/1099] 10.222.0.42 () {56 vars in 1177 bytes} [Thu Jul 28 08:25:33 2022] GET /identity/v3/users/146d0f186fe844a9bf7239a8d4d3e8aa => generated 285 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:25:33.342254 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c349d1-a6d4-461a-83a2-773a53f49b39 None admin] Authenticating user token {{(pid=207600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:25:33.357360 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02eff807-f423-457d-a31e-7743f9a0a4f6 None admin] Validating token access rules against request {{(pid=207601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:25:33.391072 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e2be1e7-5406-41da-90a2-935434902c58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:25:33.391704 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2be1e7-5406-41da-90a2-935434902c58 None admin] REQUEST_METHOD: `GET` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:25:33.391985 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2be1e7-5406-41da-90a2-935434902c58 None admin] SCRIPT_NAME: `/identity` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:25:33.392257 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2be1e7-5406-41da-90a2-935434902c58 None admin] PATH_INFO: `/v3/domains` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:25:33.392997 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e2be1e7-5406-41da-90a2-935434902c58 None admin] RBAC: Adding query filter params (name=Default) {{(pid=207601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:25:33.393349 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e2be1e7-5406-41da-90a2-935434902c58 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:25:33.394675 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e2be1e7-5406-41da-90a2-935434902c58 None admin] RBAC: Authorization granted {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:25:33.406498 dv-cinder-851351-1-smb devstack@keystone.service[207601]: [pid: 207601|app: 0|req: 551/1100] 10.222.0.42 () {56 vars in 1109 bytes} [Thu Jul 28 08:25:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 08:25:33.412277 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e2be1e7-5406-41da-90a2-935434902c58 None admin] Authenticating user token {{(pid=207601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:25:33.441394 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c349d1-a6d4-461a-83a2-773a53f49b39 None admin] Validating token access rules against request {{(pid=207600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:25:33.477869 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8abd9959-d2c5-413d-93c8-ebc77d0d9806 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:25:33.478409 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8abd9959-d2c5-413d-93c8-ebc77d0d9806 None admin] REQUEST_METHOD: `GET` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:25:33.478748 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8abd9959-d2c5-413d-93c8-ebc77d0d9806 None admin] SCRIPT_NAME: `/identity` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:25:33.479042 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8abd9959-d2c5-413d-93c8-ebc77d0d9806 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:25:33.507118 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG dbcounter [-] [207601] Writing DB stats keystone:SELECT=100 {{(pid=207601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:25:33.513952 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e2be1e7-5406-41da-90a2-935434902c58 None admin] Validating token access rules against request {{(pid=207601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:25:33.540792 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG dbcounter [-] [207600] Writing DB stats keystone:SELECT=100 {{(pid=207600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:25:33.551203 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8abd9959-d2c5-413d-93c8-ebc77d0d9806 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:25:33.551887 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8372c3bd-f877-4790-bc37-e36de562313f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:25:33.552556 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8372c3bd-f877-4790-bc37-e36de562313f None admin] REQUEST_METHOD: `GET` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:25:33.552681 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8abd9959-d2c5-413d-93c8-ebc77d0d9806 None admin] RBAC: Authorization granted {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:25:33.552875 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8372c3bd-f877-4790-bc37-e36de562313f None admin] SCRIPT_NAME: `/identity` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:25:33.553148 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8372c3bd-f877-4790-bc37-e36de562313f None admin] PATH_INFO: `/v3/projects/service` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:25:33.560285 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8372c3bd-f877-4790-bc37-e36de562313f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:25:33.561768 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8372c3bd-f877-4790-bc37-e36de562313f None admin] RBAC: Authorization granted {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:25:33.574356 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application [None req-8372c3bd-f877-4790-bc37-e36de562313f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 08:25:33.574356 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:25:33.574356 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:25:33.574356 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:25:33.574356 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:25:33.574356 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:25:33.574356 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:25:33.574356 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:25:33.574356 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:25:33.574356 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:25:33.574356 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:25:33.574356 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:25:33.574356 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 28 08:25:33.574356 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 28 08:25:33.574356 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 28 08:25:33.575386 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 28 08:25:33.575386 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:25:33.575386 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:25:33.575386 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:25:33.575386 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:25:33.575386 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:25:33.575386 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:25:33.575386 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:25:33.575386 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application with Lock( Jul 28 08:25:33.575386 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:25:33.575386 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:25:33.575386 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:25:33.575386 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:25:33.575386 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:25:33.575386 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:25:33.575386 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:25:33.575386 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:25:33.576360 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 28 08:25:33.576360 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 28 08:25:33.576360 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 28 08:25:33.576360 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 28 08:25:33.576360 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 28 08:25:33.576360 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 28 08:25:33.576360 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 08:25:33.576360 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application Jul 28 08:25:33.576360 dv-cinder-851351-1-smb devstack@keystone.service[207601]: [pid: 207601|app: 0|req: 552/1101] 10.222.0.42 () {56 vars in 1111 bytes} [Thu Jul 28 08:25:33 2022] GET /identity/v3/projects/service => generated 88 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 08:25:33.581594 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8372c3bd-f877-4790-bc37-e36de562313f None admin] Authenticating user token {{(pid=207601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:25:33.654072 dv-cinder-851351-1-smb devstack@keystone.service[207600]: [pid: 207600|app: 0|req: 550/1102] 10.222.0.42 () {58 vars in 1282 bytes} [Thu Jul 28 08:25:33 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jul 28 08:25:33.665238 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8abd9959-d2c5-413d-93c8-ebc77d0d9806 None admin] Authenticating user token {{(pid=207600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:25:33.683473 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8372c3bd-f877-4790-bc37-e36de562313f None admin] Validating token access rules against request {{(pid=207601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:25:33.719587 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bae9750-030e-4999-85ab-6faea8828eb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:25:33.720238 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bae9750-030e-4999-85ab-6faea8828eb1 None admin] REQUEST_METHOD: `GET` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:25:33.720524 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bae9750-030e-4999-85ab-6faea8828eb1 None admin] SCRIPT_NAME: `/identity` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:25:33.720836 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bae9750-030e-4999-85ab-6faea8828eb1 None admin] PATH_INFO: `/v3/projects` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:25:33.721603 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bae9750-030e-4999-85ab-6faea8828eb1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=207601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:25:33.721918 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bae9750-030e-4999-85ab-6faea8828eb1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:25:33.723372 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bae9750-030e-4999-85ab-6faea8828eb1 None admin] RBAC: Authorization granted {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:25:33.735184 dv-cinder-851351-1-smb devstack@keystone.service[207601]: [pid: 207601|app: 0|req: 553/1103] 10.222.0.42 () {56 vars in 1148 bytes} [Thu Jul 28 08:25:33 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 08:25:33.741321 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bae9750-030e-4999-85ab-6faea8828eb1 None admin] Authenticating user token {{(pid=207601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:25:33.758211 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG dbcounter [-] [207601] Writing DB stats keystone:SELECT=100 {{(pid=207601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:25:33.764902 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG dbcounter [-] [207600] Writing DB stats keystone:SELECT=100 {{(pid=207600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:25:33.774722 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8abd9959-d2c5-413d-93c8-ebc77d0d9806 None admin] Validating token access rules against request {{(pid=207600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:25:33.810363 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f2d636-091d-437b-8198-36ca0f08e73e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:25:33.811018 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f2d636-091d-437b-8198-36ca0f08e73e None admin] REQUEST_METHOD: `GET` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:25:33.811304 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f2d636-091d-437b-8198-36ca0f08e73e None admin] SCRIPT_NAME: `/identity` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:25:33.811576 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f2d636-091d-437b-8198-36ca0f08e73e None admin] PATH_INFO: `/v3/projects/04123529b032481fbb9473b506dea8b6` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:25:33.812807 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2f2d636-091d-437b-8198-36ca0f08e73e None admin] RBAC: Authorizing `identity:get_project(project_id=04123529b032481fbb9473b506dea8b6)` {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:25:33.814262 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2f2d636-091d-437b-8198-36ca0f08e73e None admin] RBAC: Authorization granted {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:25:33.815985 dv-cinder-851351-1-smb devstack@keystone.service[207600]: [pid: 207600|app: 0|req: 551/1104] 10.222.0.42 () {56 vars in 1186 bytes} [Thu Jul 28 08:25:33 2022] GET /identity/v3/projects/04123529b032481fbb9473b506dea8b6 => generated 311 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 08:25:33.822437 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f2d636-091d-437b-8198-36ca0f08e73e None admin] Authenticating user token {{(pid=207600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:25:33.846896 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bae9750-030e-4999-85ab-6faea8828eb1 None admin] Validating token access rules against request {{(pid=207601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:25:33.885500 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8646a9-bbcc-40a2-b224-d9775b522b9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:25:33.886148 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8646a9-bbcc-40a2-b224-d9775b522b9e None admin] REQUEST_METHOD: `GET` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:25:33.886431 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8646a9-bbcc-40a2-b224-d9775b522b9e None admin] SCRIPT_NAME: `/identity` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:25:33.886711 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8646a9-bbcc-40a2-b224-d9775b522b9e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:25:33.887538 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb8646a9-bbcc-40a2-b224-d9775b522b9e None admin] RBAC: Adding query filter params (role.id=a67e4d87d7f74c65a98b947bd4f6c11d, scope.project.id=48c5f2b2ae2b48758b957d2b194a7fd1, user.id=03804b1369934a7692da4d5646465bdc) {{(pid=207601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:25:33.887863 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb8646a9-bbcc-40a2-b224-d9775b522b9e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:25:33.889362 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb8646a9-bbcc-40a2-b224-d9775b522b9e None admin] RBAC: Authorization granted {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:25:33.896957 dv-cinder-851351-1-smb devstack@keystone.service[207601]: [pid: 207601|app: 0|req: 554/1105] 10.222.0.42 () {56 vars in 1374 bytes} [Thu Jul 28 08:25:33 2022] GET /identity/v3/role_assignments?user.id=03804b1369934a7692da4d5646465bdc&scope.project.id=48c5f2b2ae2b48758b957d2b194a7fd1&role.id=a67e4d87d7f74c65a98b947bd4f6c11d => generated 608 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 08:25:33.930354 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f2d636-091d-437b-8198-36ca0f08e73e None admin] Validating token access rules against request {{(pid=207600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:25:33.972611 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b3f867-24ce-4f1f-b0f2-a0ec3cf7385f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:25:33.973262 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b3f867-24ce-4f1f-b0f2-a0ec3cf7385f None admin] REQUEST_METHOD: `GET` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:25:33.973573 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b3f867-24ce-4f1f-b0f2-a0ec3cf7385f None admin] SCRIPT_NAME: `/identity` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:25:33.973852 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b3f867-24ce-4f1f-b0f2-a0ec3cf7385f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:25:33.974679 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b3f867-24ce-4f1f-b0f2-a0ec3cf7385f None admin] RBAC: Adding query filter params (role.id=d0ce88034c6b41878db755343f5840be, scope.project.id=04123529b032481fbb9473b506dea8b6, user.id=146d0f186fe844a9bf7239a8d4d3e8aa) {{(pid=207600) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:25:33.974981 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b3f867-24ce-4f1f-b0f2-a0ec3cf7385f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:25:33.976575 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b3f867-24ce-4f1f-b0f2-a0ec3cf7385f None admin] RBAC: Authorization granted {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:25:33.983905 dv-cinder-851351-1-smb devstack@keystone.service[207600]: [pid: 207600|app: 0|req: 552/1106] 10.222.0.42 () {56 vars in 1374 bytes} [Thu Jul 28 08:25:33 2022] GET /identity/v3/role_assignments?user.id=146d0f186fe844a9bf7239a8d4d3e8aa&scope.project.id=04123529b032481fbb9473b506dea8b6&role.id=d0ce88034c6b41878db755343f5840be => generated 608 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 08:25:36.031634 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d4f0a2-dcf0-46d1-9e2f-c93388cbc9dd None None] REQUEST_METHOD: `GET` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:25:36.032236 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d4f0a2-dcf0-46d1-9e2f-c93388cbc9dd None None] SCRIPT_NAME: `/identity` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:25:36.032236 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d4f0a2-dcf0-46d1-9e2f-c93388cbc9dd None None] PATH_INFO: `/` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:25:36.033552 dv-cinder-851351-1-smb devstack@keystone.service[207601]: [pid: 207601|app: 0|req: 555/1107] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 08:25:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 08:25:36.039138 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8422107-7b55-4356-ab05-3d6e5bb97ff7 None None] REQUEST_METHOD: `POST` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:25:36.039590 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8422107-7b55-4356-ab05-3d6e5bb97ff7 None None] SCRIPT_NAME: `/identity` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:25:36.039709 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8422107-7b55-4356-ab05-3d6e5bb97ff7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:25:36.058342 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.auth.core [None req-a8422107-7b55-4356-ab05-3d6e5bb97ff7 None None] MFA Rules not processed for user `b8110ade874c4aa7af27f5c376df700a`. Rule list: `[]` (Enabled: `True`). {{(pid=207600) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 08:25:36.059561 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.fernet_utils [None req-a8422107-7b55-4356-ab05-3d6e5bb97ff7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=207600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:25:36.079229 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG dbcounter [-] [207600] Writing DB stats keystone:SELECT=100 {{(pid=207600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:25:36.135111 dv-cinder-851351-1-smb devstack@keystone.service[207600]: [pid: 207600|app: 0|req: 553/1108] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 08:25:36 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 28 08:25:36.159915 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d4f0a2-dcf0-46d1-9e2f-c93388cbc9dd None None] Authenticating user token {{(pid=207601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:25:36.248458 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG dbcounter [-] [207601] Writing DB stats keystone:SELECT=100 {{(pid=207601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:25:36.272401 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d4f0a2-dcf0-46d1-9e2f-c93388cbc9dd None None] Validating token access rules against request {{(pid=207601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:25:36.307152 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791868d9-c6a9-4c50-804f-2a09b8fe6610 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:25:36.307798 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791868d9-c6a9-4c50-804f-2a09b8fe6610 None admin] REQUEST_METHOD: `GET` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:25:36.308079 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791868d9-c6a9-4c50-804f-2a09b8fe6610 None admin] SCRIPT_NAME: `/identity` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:25:36.308354 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791868d9-c6a9-4c50-804f-2a09b8fe6610 None admin] PATH_INFO: `/v3/domains/default` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:25:36.309598 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-791868d9-c6a9-4c50-804f-2a09b8fe6610 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:25:36.311044 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-791868d9-c6a9-4c50-804f-2a09b8fe6610 None admin] RBAC: Authorization granted {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:25:36.312678 dv-cinder-851351-1-smb devstack@keystone.service[207601]: [pid: 207601|app: 0|req: 556/1109] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 08:25:36 2022] GET /identity/v3/domains/default => generated 199 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:25:36.318949 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8422107-7b55-4356-ab05-3d6e5bb97ff7 None None] Authenticating user token {{(pid=207600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:25:36.424056 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8422107-7b55-4356-ab05-3d6e5bb97ff7 None None] Validating token access rules against request {{(pid=207600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:25:36.459837 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e87a32ce-fec8-4498-bc43-ad20adf3d433 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:25:36.460528 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87a32ce-fec8-4498-bc43-ad20adf3d433 None admin] REQUEST_METHOD: `POST` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:25:36.460843 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87a32ce-fec8-4498-bc43-ad20adf3d433 None admin] SCRIPT_NAME: `/identity` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:25:36.461128 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87a32ce-fec8-4498-bc43-ad20adf3d433 None admin] PATH_INFO: `/v3/users` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:25:36.462193 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e87a32ce-fec8-4498-bc43-ad20adf3d433 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:25:36.463659 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e87a32ce-fec8-4498-bc43-ad20adf3d433 None admin] RBAC: Authorization granted {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:25:36.486416 dv-cinder-851351-1-smb devstack@keystone.service[207600]: [pid: 207600|app: 0|req: 554/1110] 10.222.0.42 () {60 vars in 1132 bytes} [Thu Jul 28 08:25:36 2022] POST /identity/v3/users => generated 286 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 08:25:38.575071 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec43bd1-30f0-474c-8189-b6d2ff307a06 None None] REQUEST_METHOD: `GET` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:25:38.575727 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec43bd1-30f0-474c-8189-b6d2ff307a06 None None] SCRIPT_NAME: `/identity` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:25:38.575727 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec43bd1-30f0-474c-8189-b6d2ff307a06 None None] PATH_INFO: `/` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:25:38.576997 dv-cinder-851351-1-smb devstack@keystone.service[207601]: [pid: 207601|app: 0|req: 557/1111] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 08:25:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 08:25:38.582704 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48a64f7-6baf-4bd9-91bc-4b7031959cca None None] REQUEST_METHOD: `POST` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:25:38.583249 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48a64f7-6baf-4bd9-91bc-4b7031959cca None None] SCRIPT_NAME: `/identity` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:25:38.583479 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48a64f7-6baf-4bd9-91bc-4b7031959cca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:25:38.604403 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.auth.core [None req-c48a64f7-6baf-4bd9-91bc-4b7031959cca None None] MFA Rules not processed for user `b8110ade874c4aa7af27f5c376df700a`. Rule list: `[]` (Enabled: `True`). {{(pid=207600) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 08:25:38.605697 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.fernet_utils [None req-c48a64f7-6baf-4bd9-91bc-4b7031959cca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=207600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:25:38.608945 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG dbcounter [-] [207600] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=207600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:25:38.681700 dv-cinder-851351-1-smb devstack@keystone.service[207600]: [pid: 207600|app: 0|req: 555/1112] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 08:25:38 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 08:25:38.705926 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec43bd1-30f0-474c-8189-b6d2ff307a06 None None] Authenticating user token {{(pid=207601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:25:38.828631 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec43bd1-30f0-474c-8189-b6d2ff307a06 None None] Validating token access rules against request {{(pid=207601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:25:38.866830 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-179dc6e3-a4f8-4665-95ac-17f0723e53c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:25:38.867506 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179dc6e3-a4f8-4665-95ac-17f0723e53c8 None admin] REQUEST_METHOD: `GET` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:25:38.867790 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179dc6e3-a4f8-4665-95ac-17f0723e53c8 None admin] SCRIPT_NAME: `/identity` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:25:38.868072 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179dc6e3-a4f8-4665-95ac-17f0723e53c8 None admin] PATH_INFO: `/v3/roles/e617201b25d44cb1844c9f28bcac91fb` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:25:38.869698 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-179dc6e3-a4f8-4665-95ac-17f0723e53c8 None admin] RBAC: Authorizing `identity:get_role(role_id=e617201b25d44cb1844c9f28bcac91fb)` {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:25:38.871106 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-179dc6e3-a4f8-4665-95ac-17f0723e53c8 None admin] RBAC: Authorization granted {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:25:38.872525 dv-cinder-851351-1-smb devstack@keystone.service[207601]: [pid: 207601|app: 0|req: 558/1113] 10.222.0.42 () {56 vars in 1177 bytes} [Thu Jul 28 08:25:38 2022] GET /identity/v3/roles/e617201b25d44cb1844c9f28bcac91fb => generated 223 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 08:25:38.878818 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48a64f7-6baf-4bd9-91bc-4b7031959cca None None] Authenticating user token {{(pid=207600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:25:38.986563 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48a64f7-6baf-4bd9-91bc-4b7031959cca None None] Validating token access rules against request {{(pid=207600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:25:39.022886 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c997b29f-9e32-40af-ab04-62b3c8f6f327 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:25:39.023538 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c997b29f-9e32-40af-ab04-62b3c8f6f327 None admin] REQUEST_METHOD: `GET` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:25:39.023824 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c997b29f-9e32-40af-ab04-62b3c8f6f327 None admin] SCRIPT_NAME: `/identity` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:25:39.024102 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c997b29f-9e32-40af-ab04-62b3c8f6f327 None admin] PATH_INFO: `/v3/users/06862d7e7c9b4fd98059dd61e0119a9d` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:25:39.035769 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG dbcounter [-] [207600] Writing DB stats keystone:SELECT=100 {{(pid=207600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:25:39.040479 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c997b29f-9e32-40af-ab04-62b3c8f6f327 None admin] RBAC: Authorizing `identity:get_user(user_id=06862d7e7c9b4fd98059dd61e0119a9d)` {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:25:39.042023 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c997b29f-9e32-40af-ab04-62b3c8f6f327 None admin] RBAC: Authorization granted {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:25:39.043818 dv-cinder-851351-1-smb devstack@keystone.service[207600]: [pid: 207600|app: 0|req: 556/1114] 10.222.0.42 () {56 vars in 1177 bytes} [Thu Jul 28 08:25:38 2022] GET /identity/v3/users/06862d7e7c9b4fd98059dd61e0119a9d => generated 286 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:25:39.052935 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-179dc6e3-a4f8-4665-95ac-17f0723e53c8 None admin] Authenticating user token {{(pid=207601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:25:39.076433 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG dbcounter [-] [207601] Writing DB stats keystone:SELECT=100 {{(pid=207601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:25:39.181855 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-179dc6e3-a4f8-4665-95ac-17f0723e53c8 None admin] Validating token access rules against request {{(pid=207601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:25:39.221091 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e65adbe-d829-4c88-83cb-3213c35cea62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:25:39.221743 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e65adbe-d829-4c88-83cb-3213c35cea62 None admin] REQUEST_METHOD: `GET` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:25:39.222034 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e65adbe-d829-4c88-83cb-3213c35cea62 None admin] SCRIPT_NAME: `/identity` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:25:39.222310 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e65adbe-d829-4c88-83cb-3213c35cea62 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:25:39.299317 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e65adbe-d829-4c88-83cb-3213c35cea62 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:25:39.300823 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e65adbe-d829-4c88-83cb-3213c35cea62 None admin] RBAC: Authorization granted {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:25:39.317327 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG dbcounter [-] [207601] Writing DB stats keystone:SELECT=100 {{(pid=207601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:25:39.412691 dv-cinder-851351-1-smb devstack@keystone.service[207601]: [pid: 207601|app: 0|req: 559/1115] 10.222.0.42 () {58 vars in 1282 bytes} [Thu Jul 28 08:25:39 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 360 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 28 08:25:39.422929 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c997b29f-9e32-40af-ab04-62b3c8f6f327 None admin] Authenticating user token {{(pid=207600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:25:39.535846 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c997b29f-9e32-40af-ab04-62b3c8f6f327 None admin] Validating token access rules against request {{(pid=207600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:25:39.573040 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6f21f1-9e49-43de-a676-894fe6fd2fd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:25:39.573726 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6f21f1-9e49-43de-a676-894fe6fd2fd2 None admin] REQUEST_METHOD: `GET` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:25:39.574015 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6f21f1-9e49-43de-a676-894fe6fd2fd2 None admin] SCRIPT_NAME: `/identity` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:25:39.574292 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6f21f1-9e49-43de-a676-894fe6fd2fd2 None admin] PATH_INFO: `/v3/projects/04123529b032481fbb9473b506dea8b6` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:25:39.575552 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d6f21f1-9e49-43de-a676-894fe6fd2fd2 None admin] RBAC: Authorizing `identity:get_project(project_id=04123529b032481fbb9473b506dea8b6)` {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:25:39.577074 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d6f21f1-9e49-43de-a676-894fe6fd2fd2 None admin] RBAC: Authorization granted {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:25:39.578821 dv-cinder-851351-1-smb devstack@keystone.service[207600]: [pid: 207600|app: 0|req: 557/1116] 10.222.0.42 () {56 vars in 1186 bytes} [Thu Jul 28 08:25:39 2022] GET /identity/v3/projects/04123529b032481fbb9473b506dea8b6 => generated 311 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:25:39.586050 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e65adbe-d829-4c88-83cb-3213c35cea62 None admin] Authenticating user token {{(pid=207601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:25:39.754914 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e65adbe-d829-4c88-83cb-3213c35cea62 None admin] Validating token access rules against request {{(pid=207601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:25:39.780092 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG dbcounter [-] [207601] Writing DB stats keystone:SELECT=100 {{(pid=207601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:25:39.814847 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b20d379-3c78-4ebe-a18e-489b9df8c85e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:25:39.815779 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b20d379-3c78-4ebe-a18e-489b9df8c85e None admin] REQUEST_METHOD: `GET` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:25:39.816270 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b20d379-3c78-4ebe-a18e-489b9df8c85e None admin] SCRIPT_NAME: `/identity` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:25:39.816764 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b20d379-3c78-4ebe-a18e-489b9df8c85e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:25:39.818325 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b20d379-3c78-4ebe-a18e-489b9df8c85e None admin] RBAC: Adding query filter params (role.id=e617201b25d44cb1844c9f28bcac91fb, scope.project.id=04123529b032481fbb9473b506dea8b6, user.id=06862d7e7c9b4fd98059dd61e0119a9d) {{(pid=207601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:25:39.818877 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b20d379-3c78-4ebe-a18e-489b9df8c85e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:25:39.821833 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b20d379-3c78-4ebe-a18e-489b9df8c85e None admin] RBAC: Authorization granted {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:25:39.831881 dv-cinder-851351-1-smb devstack@keystone.service[207601]: [pid: 207601|app: 0|req: 560/1117] 10.222.0.42 () {56 vars in 1374 bytes} [Thu Jul 28 08:25:39 2022] GET /identity/v3/role_assignments?user.id=06862d7e7c9b4fd98059dd61e0119a9d&scope.project.id=04123529b032481fbb9473b506dea8b6&role.id=e617201b25d44cb1844c9f28bcac91fb => generated 259 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:25:41.882988 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2684dd5-41d5-4c06-a81d-62ccee8ff39f None None] REQUEST_METHOD: `GET` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:25:41.883844 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2684dd5-41d5-4c06-a81d-62ccee8ff39f None None] SCRIPT_NAME: `/identity` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:25:41.883844 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2684dd5-41d5-4c06-a81d-62ccee8ff39f None None] PATH_INFO: `/` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:25:41.885022 dv-cinder-851351-1-smb devstack@keystone.service[207600]: [pid: 207600|app: 0|req: 558/1118] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 08:25:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 08:25:41.891819 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca92cfcd-09a1-414e-82ba-fb6d420d41b7 None None] REQUEST_METHOD: `POST` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:25:41.892468 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca92cfcd-09a1-414e-82ba-fb6d420d41b7 None None] SCRIPT_NAME: `/identity` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:25:41.892468 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca92cfcd-09a1-414e-82ba-fb6d420d41b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:25:41.913349 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.auth.core [None req-ca92cfcd-09a1-414e-82ba-fb6d420d41b7 None None] MFA Rules not processed for user `b8110ade874c4aa7af27f5c376df700a`. Rule list: `[]` (Enabled: `True`). {{(pid=207601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 08:25:41.914703 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.fernet_utils [None req-ca92cfcd-09a1-414e-82ba-fb6d420d41b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=207601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:25:41.996606 dv-cinder-851351-1-smb devstack@keystone.service[207601]: [pid: 207601|app: 0|req: 561/1119] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 08:25:41 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 08:25:42.020122 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2684dd5-41d5-4c06-a81d-62ccee8ff39f None None] Authenticating user token {{(pid=207600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:25:42.105143 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG dbcounter [-] [207600] Writing DB stats keystone:SELECT=100 {{(pid=207600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:25:42.148397 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2684dd5-41d5-4c06-a81d-62ccee8ff39f None None] Validating token access rules against request {{(pid=207600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:25:42.188029 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f57f2b3d-7ad6-437c-84db-a090597efcf6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:25:42.188711 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57f2b3d-7ad6-437c-84db-a090597efcf6 None admin] REQUEST_METHOD: `GET` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:25:42.189077 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57f2b3d-7ad6-437c-84db-a090597efcf6 None admin] SCRIPT_NAME: `/identity` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:25:42.189351 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57f2b3d-7ad6-437c-84db-a090597efcf6 None admin] PATH_INFO: `/v3/roles/e617201b25d44cb1844c9f28bcac91fb` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:25:42.190858 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f57f2b3d-7ad6-437c-84db-a090597efcf6 None admin] RBAC: Authorizing `identity:get_role(role_id=e617201b25d44cb1844c9f28bcac91fb)` {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:25:42.192228 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f57f2b3d-7ad6-437c-84db-a090597efcf6 None admin] RBAC: Authorization granted {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:25:42.193673 dv-cinder-851351-1-smb devstack@keystone.service[207600]: [pid: 207600|app: 0|req: 559/1120] 10.222.0.42 () {56 vars in 1177 bytes} [Thu Jul 28 08:25:42 2022] GET /identity/v3/roles/e617201b25d44cb1844c9f28bcac91fb => generated 223 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 08:25:42.200198 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca92cfcd-09a1-414e-82ba-fb6d420d41b7 None None] Authenticating user token {{(pid=207601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:25:42.311231 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca92cfcd-09a1-414e-82ba-fb6d420d41b7 None None] Validating token access rules against request {{(pid=207601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:25:42.323429 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG dbcounter [-] [207601] Writing DB stats keystone:SELECT=100 {{(pid=207601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:25:42.355932 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ffd99d-3d2f-4542-bbc1-e4c42d1821b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:25:42.356625 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ffd99d-3d2f-4542-bbc1-e4c42d1821b3 None admin] REQUEST_METHOD: `GET` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:25:42.356950 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ffd99d-3d2f-4542-bbc1-e4c42d1821b3 None admin] SCRIPT_NAME: `/identity` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:25:42.357225 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ffd99d-3d2f-4542-bbc1-e4c42d1821b3 None admin] PATH_INFO: `/v3/users/06862d7e7c9b4fd98059dd61e0119a9d` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:25:42.358626 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16ffd99d-3d2f-4542-bbc1-e4c42d1821b3 None admin] RBAC: Authorizing `identity:get_user(user_id=06862d7e7c9b4fd98059dd61e0119a9d)` {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:25:42.360173 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16ffd99d-3d2f-4542-bbc1-e4c42d1821b3 None admin] RBAC: Authorization granted {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:25:42.362099 dv-cinder-851351-1-smb devstack@keystone.service[207601]: [pid: 207601|app: 0|req: 562/1121] 10.222.0.42 () {56 vars in 1177 bytes} [Thu Jul 28 08:25:42 2022] GET /identity/v3/users/06862d7e7c9b4fd98059dd61e0119a9d => generated 286 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:25:42.368720 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f57f2b3d-7ad6-437c-84db-a090597efcf6 None admin] Authenticating user token {{(pid=207600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:25:42.493293 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f57f2b3d-7ad6-437c-84db-a090597efcf6 None admin] Validating token access rules against request {{(pid=207600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:25:42.531027 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e09ead07-d17e-412e-920a-9bfea94d6074 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:25:42.531696 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09ead07-d17e-412e-920a-9bfea94d6074 None admin] REQUEST_METHOD: `GET` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:25:42.531981 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09ead07-d17e-412e-920a-9bfea94d6074 None admin] SCRIPT_NAME: `/identity` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:25:42.532260 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09ead07-d17e-412e-920a-9bfea94d6074 None admin] PATH_INFO: `/v3/projects/04123529b032481fbb9473b506dea8b6` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:25:42.533496 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e09ead07-d17e-412e-920a-9bfea94d6074 None admin] RBAC: Authorizing `identity:get_project(project_id=04123529b032481fbb9473b506dea8b6)` {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:25:42.534988 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e09ead07-d17e-412e-920a-9bfea94d6074 None admin] RBAC: Authorization granted {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:25:42.536793 dv-cinder-851351-1-smb devstack@keystone.service[207600]: [pid: 207600|app: 0|req: 560/1122] 10.222.0.42 () {56 vars in 1186 bytes} [Thu Jul 28 08:25:42 2022] GET /identity/v3/projects/04123529b032481fbb9473b506dea8b6 => generated 311 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:25:42.543502 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ffd99d-3d2f-4542-bbc1-e4c42d1821b3 None admin] Authenticating user token {{(pid=207601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:25:42.650447 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ffd99d-3d2f-4542-bbc1-e4c42d1821b3 None admin] Validating token access rules against request {{(pid=207601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:25:42.687050 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316fbca2-9a58-4ea7-8286-c4356beb1abb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:25:42.687742 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316fbca2-9a58-4ea7-8286-c4356beb1abb None admin] REQUEST_METHOD: `PUT` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:25:42.688026 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316fbca2-9a58-4ea7-8286-c4356beb1abb None admin] SCRIPT_NAME: `/identity` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:25:42.688302 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316fbca2-9a58-4ea7-8286-c4356beb1abb None admin] PATH_INFO: `/v3/projects/04123529b032481fbb9473b506dea8b6/users/06862d7e7c9b4fd98059dd61e0119a9d/roles/e617201b25d44cb1844c9f28bcac91fb` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:25:42.690810 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-316fbca2-9a58-4ea7-8286-c4356beb1abb None admin] RBAC: Authorizing `identity:create_grant(project_id=04123529b032481fbb9473b506dea8b6, user_id=06862d7e7c9b4fd98059dd61e0119a9d, role_id=e617201b25d44cb1844c9f28bcac91fb)` {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:25:42.692271 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-316fbca2-9a58-4ea7-8286-c4356beb1abb None admin] RBAC: Authorization granted {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:25:42.706732 dv-cinder-851351-1-smb devstack@keystone.service[207601]: [pid: 207601|app: 0|req: 563/1123] 10.222.0.42 () {58 vars in 1439 bytes} [Thu Jul 28 08:25:42 2022] PUT /identity/v3/projects/04123529b032481fbb9473b506dea8b6/users/06862d7e7c9b4fd98059dd61e0119a9d/roles/e617201b25d44cb1844c9f28bcac91fb => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 08:25:44.687770 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b06fdf8-07df-4cc2-bc5e-1f21c19e4b14 None None] REQUEST_METHOD: `GET` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:25:44.688377 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b06fdf8-07df-4cc2-bc5e-1f21c19e4b14 None None] SCRIPT_NAME: `/identity` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:25:44.688377 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b06fdf8-07df-4cc2-bc5e-1f21c19e4b14 None None] PATH_INFO: `/` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:25:44.689741 dv-cinder-851351-1-smb devstack@keystone.service[207600]: [pid: 207600|app: 0|req: 561/1124] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 08:25:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 08:25:44.695334 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72df3c4-767b-42f9-9249-f327d6be552a None None] REQUEST_METHOD: `POST` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:25:44.695844 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72df3c4-767b-42f9-9249-f327d6be552a None None] SCRIPT_NAME: `/identity` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:25:44.695844 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72df3c4-767b-42f9-9249-f327d6be552a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:25:44.716088 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.auth.core [None req-a72df3c4-767b-42f9-9249-f327d6be552a None None] MFA Rules not processed for user `b8110ade874c4aa7af27f5c376df700a`. Rule list: `[]` (Enabled: `True`). {{(pid=207601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 08:25:44.717378 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.fernet_utils [None req-a72df3c4-767b-42f9-9249-f327d6be552a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=207601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:25:44.751826 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG dbcounter [-] [207601] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=207601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:25:44.794377 dv-cinder-851351-1-smb devstack@keystone.service[207601]: [pid: 207601|app: 0|req: 564/1125] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 08:25:44 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 08:25:44.818021 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b06fdf8-07df-4cc2-bc5e-1f21c19e4b14 None None] Authenticating user token {{(pid=207600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:25:44.821205 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG dbcounter [-] [207600] Writing DB stats keystone:SELECT=100 {{(pid=207600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:25:44.929703 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b06fdf8-07df-4cc2-bc5e-1f21c19e4b14 None None] Validating token access rules against request {{(pid=207600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:25:44.967458 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db941a74-8bb8-46bc-852a-1650766fa1cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:25:44.968015 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db941a74-8bb8-46bc-852a-1650766fa1cc None admin] REQUEST_METHOD: `GET` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:25:44.968294 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db941a74-8bb8-46bc-852a-1650766fa1cc None admin] SCRIPT_NAME: `/identity` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:25:44.968567 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db941a74-8bb8-46bc-852a-1650766fa1cc None admin] PATH_INFO: `/v3/roles/e617201b25d44cb1844c9f28bcac91fb` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:25:44.970111 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db941a74-8bb8-46bc-852a-1650766fa1cc None admin] RBAC: Authorizing `identity:get_role(role_id=e617201b25d44cb1844c9f28bcac91fb)` {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:25:44.971514 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db941a74-8bb8-46bc-852a-1650766fa1cc None admin] RBAC: Authorization granted {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:25:44.972950 dv-cinder-851351-1-smb devstack@keystone.service[207600]: [pid: 207600|app: 0|req: 562/1126] 10.222.0.42 () {56 vars in 1177 bytes} [Thu Jul 28 08:25:44 2022] GET /identity/v3/roles/e617201b25d44cb1844c9f28bcac91fb => generated 223 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:25:44.979894 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a72df3c4-767b-42f9-9249-f327d6be552a None None] Authenticating user token {{(pid=207601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:25:45.091197 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a72df3c4-767b-42f9-9249-f327d6be552a None None] Validating token access rules against request {{(pid=207601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:25:45.126089 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f4cb43-5ed7-47ea-810d-4d11cbfba95b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:25:45.126755 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f4cb43-5ed7-47ea-810d-4d11cbfba95b None admin] REQUEST_METHOD: `GET` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:25:45.127036 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f4cb43-5ed7-47ea-810d-4d11cbfba95b None admin] SCRIPT_NAME: `/identity` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:25:45.127315 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f4cb43-5ed7-47ea-810d-4d11cbfba95b None admin] PATH_INFO: `/v3/users/06862d7e7c9b4fd98059dd61e0119a9d` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:25:45.128533 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f4cb43-5ed7-47ea-810d-4d11cbfba95b None admin] RBAC: Authorizing `identity:get_user(user_id=06862d7e7c9b4fd98059dd61e0119a9d)` {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:25:45.130041 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f4cb43-5ed7-47ea-810d-4d11cbfba95b None admin] RBAC: Authorization granted {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:25:45.131709 dv-cinder-851351-1-smb devstack@keystone.service[207601]: [pid: 207601|app: 0|req: 565/1127] 10.222.0.42 () {56 vars in 1177 bytes} [Thu Jul 28 08:25:44 2022] GET /identity/v3/users/06862d7e7c9b4fd98059dd61e0119a9d => generated 286 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:25:45.138178 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db941a74-8bb8-46bc-852a-1650766fa1cc None admin] Authenticating user token {{(pid=207600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:25:45.211781 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG dbcounter [-] [207600] Writing DB stats keystone:SELECT=100 {{(pid=207600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:25:45.244296 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db941a74-8bb8-46bc-852a-1650766fa1cc None admin] Validating token access rules against request {{(pid=207600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:25:45.279584 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d921bc8d-660e-4e53-916c-ac3691d3ca78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:25:45.280250 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d921bc8d-660e-4e53-916c-ac3691d3ca78 None admin] REQUEST_METHOD: `GET` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:25:45.280639 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d921bc8d-660e-4e53-916c-ac3691d3ca78 None admin] SCRIPT_NAME: `/identity` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:25:45.281126 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d921bc8d-660e-4e53-916c-ac3691d3ca78 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:25:45.371556 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d921bc8d-660e-4e53-916c-ac3691d3ca78 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:25:45.373162 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d921bc8d-660e-4e53-916c-ac3691d3ca78 None admin] RBAC: Authorization granted {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:25:45.459068 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG dbcounter [-] [207600] Writing DB stats keystone:SELECT=100 {{(pid=207600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:25:45.498591 dv-cinder-851351-1-smb devstack@keystone.service[207600]: [pid: 207600|app: 0|req: 563/1128] 10.222.0.42 () {58 vars in 1282 bytes} [Thu Jul 28 08:25:45 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 361 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 28 08:25:45.505186 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f4cb43-5ed7-47ea-810d-4d11cbfba95b None admin] Authenticating user token {{(pid=207601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:25:45.542895 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG dbcounter [-] [207601] Writing DB stats keystone:SELECT=100 {{(pid=207601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:25:45.616924 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f4cb43-5ed7-47ea-810d-4d11cbfba95b None admin] Validating token access rules against request {{(pid=207601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:25:45.656438 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d05844c-b8be-4fe2-9267-2f9907020cdd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:25:45.657324 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d05844c-b8be-4fe2-9267-2f9907020cdd None admin] REQUEST_METHOD: `GET` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:25:45.657577 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d05844c-b8be-4fe2-9267-2f9907020cdd None admin] SCRIPT_NAME: `/identity` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:25:45.658100 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d05844c-b8be-4fe2-9267-2f9907020cdd None admin] PATH_INFO: `/v3/projects/04123529b032481fbb9473b506dea8b6` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:25:45.661541 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d05844c-b8be-4fe2-9267-2f9907020cdd None admin] RBAC: Authorizing `identity:get_project(project_id=04123529b032481fbb9473b506dea8b6)` {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:25:45.661777 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d05844c-b8be-4fe2-9267-2f9907020cdd None admin] RBAC: Authorization granted {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:25:45.663762 dv-cinder-851351-1-smb devstack@keystone.service[207601]: [pid: 207601|app: 0|req: 566/1129] 10.222.0.42 () {56 vars in 1186 bytes} [Thu Jul 28 08:25:45 2022] GET /identity/v3/projects/04123529b032481fbb9473b506dea8b6 => generated 311 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:25:45.670503 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d921bc8d-660e-4e53-916c-ac3691d3ca78 None admin] Authenticating user token {{(pid=207600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:25:45.775250 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d921bc8d-660e-4e53-916c-ac3691d3ca78 None admin] Validating token access rules against request {{(pid=207600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:25:45.811367 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80025e5a-838d-4756-86d5-e498ab079a18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:25:45.811995 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80025e5a-838d-4756-86d5-e498ab079a18 None admin] REQUEST_METHOD: `GET` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:25:45.812241 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80025e5a-838d-4756-86d5-e498ab079a18 None admin] SCRIPT_NAME: `/identity` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:25:45.812541 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80025e5a-838d-4756-86d5-e498ab079a18 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:25:45.813372 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80025e5a-838d-4756-86d5-e498ab079a18 None admin] RBAC: Adding query filter params (role.id=e617201b25d44cb1844c9f28bcac91fb, scope.project.id=04123529b032481fbb9473b506dea8b6, user.id=06862d7e7c9b4fd98059dd61e0119a9d) {{(pid=207600) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:25:45.813691 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80025e5a-838d-4756-86d5-e498ab079a18 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:25:45.815144 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80025e5a-838d-4756-86d5-e498ab079a18 None admin] RBAC: Authorization granted {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:25:45.821311 dv-cinder-851351-1-smb devstack@keystone.service[207600]: [pid: 207600|app: 0|req: 564/1130] 10.222.0.42 () {56 vars in 1374 bytes} [Thu Jul 28 08:25:45 2022] GET /identity/v3/role_assignments?user.id=06862d7e7c9b4fd98059dd61e0119a9d&scope.project.id=04123529b032481fbb9473b506dea8b6&role.id=e617201b25d44cb1844c9f28bcac91fb => generated 608 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:25:47.814012 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690fd26b-a023-4122-9c7a-2f58e0bb4621 None None] REQUEST_METHOD: `GET` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:25:47.814605 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690fd26b-a023-4122-9c7a-2f58e0bb4621 None None] SCRIPT_NAME: `/identity` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:25:47.814605 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690fd26b-a023-4122-9c7a-2f58e0bb4621 None None] PATH_INFO: `/` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:25:47.815927 dv-cinder-851351-1-smb devstack@keystone.service[207601]: [pid: 207601|app: 0|req: 567/1131] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 08:25:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 08:25:47.821455 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39cbfcdc-7a9b-461f-bfbe-540bf0f4b93b None None] REQUEST_METHOD: `POST` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:25:47.821948 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39cbfcdc-7a9b-461f-bfbe-540bf0f4b93b None None] SCRIPT_NAME: `/identity` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:25:47.822043 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39cbfcdc-7a9b-461f-bfbe-540bf0f4b93b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:25:47.842175 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.auth.core [None req-39cbfcdc-7a9b-461f-bfbe-540bf0f4b93b None None] MFA Rules not processed for user `b8110ade874c4aa7af27f5c376df700a`. Rule list: `[]` (Enabled: `True`). {{(pid=207600) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 08:25:47.843414 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.fernet_utils [None req-39cbfcdc-7a9b-461f-bfbe-540bf0f4b93b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=207600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:25:47.873262 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG dbcounter [-] [207600] Writing DB stats keystone:SELECT=100 {{(pid=207600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:25:47.921301 dv-cinder-851351-1-smb devstack@keystone.service[207600]: [pid: 207600|app: 0|req: 565/1132] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 08:25:47 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 08:25:47.945213 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690fd26b-a023-4122-9c7a-2f58e0bb4621 None None] Authenticating user token {{(pid=207601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:25:48.072453 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690fd26b-a023-4122-9c7a-2f58e0bb4621 None None] Validating token access rules against request {{(pid=207601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:25:48.074270 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG dbcounter [-] [207601] Writing DB stats keystone:SELECT=100 {{(pid=207601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:25:48.114808 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9e22db-e80d-4e93-8309-fd1bb7516057 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:25:48.115592 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9e22db-e80d-4e93-8309-fd1bb7516057 None admin] REQUEST_METHOD: `GET` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:25:48.115874 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9e22db-e80d-4e93-8309-fd1bb7516057 None admin] SCRIPT_NAME: `/identity` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:25:48.116254 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9e22db-e80d-4e93-8309-fd1bb7516057 None admin] PATH_INFO: `/v3/domains/default` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:25:48.117562 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a9e22db-e80d-4e93-8309-fd1bb7516057 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:25:48.119062 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a9e22db-e80d-4e93-8309-fd1bb7516057 None admin] RBAC: Authorization granted {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:25:48.120690 dv-cinder-851351-1-smb devstack@keystone.service[207601]: [pid: 207601|app: 0|req: 568/1133] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 08:25:47 2022] GET /identity/v3/domains/default => generated 199 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:25:48.130056 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39cbfcdc-7a9b-461f-bfbe-540bf0f4b93b None None] Authenticating user token {{(pid=207600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:25:48.238683 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39cbfcdc-7a9b-461f-bfbe-540bf0f4b93b None None] Validating token access rules against request {{(pid=207600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:25:48.274763 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbce98e4-a9ff-44fe-9c60-2a9d231ea028 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:25:48.275388 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbce98e4-a9ff-44fe-9c60-2a9d231ea028 None admin] REQUEST_METHOD: `POST` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:25:48.275669 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbce98e4-a9ff-44fe-9c60-2a9d231ea028 None admin] SCRIPT_NAME: `/identity` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:25:48.275940 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbce98e4-a9ff-44fe-9c60-2a9d231ea028 None admin] PATH_INFO: `/v3/projects` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:25:48.276631 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbce98e4-a9ff-44fe-9c60-2a9d231ea028 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:25:48.278114 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbce98e4-a9ff-44fe-9c60-2a9d231ea028 None admin] RBAC: Authorization granted {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:25:48.309434 dv-cinder-851351-1-smb devstack@keystone.service[207600]: [pid: 207600|app: 0|req: 566/1134] 10.222.0.42 () {60 vars in 1141 bytes} [Thu Jul 28 08:25:48 2022] POST /identity/v3/projects => generated 311 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 08:25:50.355923 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e02f512-edd5-4cb2-8474-2fae84abed54 None None] REQUEST_METHOD: `GET` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:25:50.356546 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e02f512-edd5-4cb2-8474-2fae84abed54 None None] SCRIPT_NAME: `/identity` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:25:50.356546 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e02f512-edd5-4cb2-8474-2fae84abed54 None None] PATH_INFO: `/` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:25:50.357851 dv-cinder-851351-1-smb devstack@keystone.service[207601]: [pid: 207601|app: 0|req: 569/1135] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 08:25:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 08:25:50.363534 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84726f6c-17f6-4c2c-8613-320c26ab8354 None None] REQUEST_METHOD: `POST` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:25:50.364039 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84726f6c-17f6-4c2c-8613-320c26ab8354 None None] SCRIPT_NAME: `/identity` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:25:50.364039 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84726f6c-17f6-4c2c-8613-320c26ab8354 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:25:50.383153 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.auth.core [None req-84726f6c-17f6-4c2c-8613-320c26ab8354 None None] MFA Rules not processed for user `b8110ade874c4aa7af27f5c376df700a`. Rule list: `[]` (Enabled: `True`). {{(pid=207600) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 08:25:50.385477 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.fernet_utils [None req-84726f6c-17f6-4c2c-8613-320c26ab8354 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=207600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:25:50.398267 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG dbcounter [-] [207600] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=207600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:25:50.500617 dv-cinder-851351-1-smb devstack@keystone.service[207600]: [pid: 207600|app: 0|req: 567/1136] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 08:25:50 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 28 08:25:50.546079 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e02f512-edd5-4cb2-8474-2fae84abed54 None None] Authenticating user token {{(pid=207601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:25:50.702466 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e02f512-edd5-4cb2-8474-2fae84abed54 None None] Validating token access rules against request {{(pid=207601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:25:50.740031 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-419c0eeb-409e-450d-abca-4eb0b0e780f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:25:50.740836 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419c0eeb-409e-450d-abca-4eb0b0e780f5 None admin] REQUEST_METHOD: `GET` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:25:50.741224 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419c0eeb-409e-450d-abca-4eb0b0e780f5 None admin] SCRIPT_NAME: `/identity` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:25:50.741545 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419c0eeb-409e-450d-abca-4eb0b0e780f5 None admin] PATH_INFO: `/v3/domains/default` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:25:50.742802 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-419c0eeb-409e-450d-abca-4eb0b0e780f5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:25:50.744303 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-419c0eeb-409e-450d-abca-4eb0b0e780f5 None admin] RBAC: Authorization granted {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:25:50.746037 dv-cinder-851351-1-smb devstack@keystone.service[207601]: [pid: 207601|app: 0|req: 570/1137] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 08:25:50 2022] GET /identity/v3/domains/default => generated 199 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:25:50.752371 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84726f6c-17f6-4c2c-8613-320c26ab8354 None None] Authenticating user token {{(pid=207600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:25:50.861180 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84726f6c-17f6-4c2c-8613-320c26ab8354 None None] Validating token access rules against request {{(pid=207600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:25:50.898467 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03bcd716-5a02-49d5-8163-8f455a4b9fe9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:25:50.899332 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03bcd716-5a02-49d5-8163-8f455a4b9fe9 None admin] REQUEST_METHOD: `POST` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:25:50.899721 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03bcd716-5a02-49d5-8163-8f455a4b9fe9 None admin] SCRIPT_NAME: `/identity` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:25:50.900109 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03bcd716-5a02-49d5-8163-8f455a4b9fe9 None admin] PATH_INFO: `/v3/users` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:25:50.900960 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03bcd716-5a02-49d5-8163-8f455a4b9fe9 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:25:50.902563 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03bcd716-5a02-49d5-8163-8f455a4b9fe9 None admin] RBAC: Authorization granted {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:25:50.927326 dv-cinder-851351-1-smb devstack@keystone.service[207600]: [pid: 207600|app: 0|req: 568/1138] 10.222.0.42 () {60 vars in 1132 bytes} [Thu Jul 28 08:25:50 2022] POST /identity/v3/users => generated 286 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 08:25:52.982947 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7da8ac-2003-40ea-9532-8218716938bf None None] REQUEST_METHOD: `GET` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:25:52.983548 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7da8ac-2003-40ea-9532-8218716938bf None None] SCRIPT_NAME: `/identity` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:25:52.983548 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7da8ac-2003-40ea-9532-8218716938bf None None] PATH_INFO: `/` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:25:52.984899 dv-cinder-851351-1-smb devstack@keystone.service[207601]: [pid: 207601|app: 0|req: 571/1139] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 08:25:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 08:25:52.990429 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe9be39-c45d-496c-9fc1-04bd58cdf5b3 None None] REQUEST_METHOD: `POST` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:25:52.990955 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe9be39-c45d-496c-9fc1-04bd58cdf5b3 None None] SCRIPT_NAME: `/identity` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:25:52.991061 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe9be39-c45d-496c-9fc1-04bd58cdf5b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:25:52.997988 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG dbcounter [-] [207600] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=207600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:25:53.013568 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.auth.core [None req-dfe9be39-c45d-496c-9fc1-04bd58cdf5b3 None None] MFA Rules not processed for user `b8110ade874c4aa7af27f5c376df700a`. Rule list: `[]` (Enabled: `True`). {{(pid=207600) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 08:25:53.014814 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.fernet_utils [None req-dfe9be39-c45d-496c-9fc1-04bd58cdf5b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=207600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:25:53.092647 dv-cinder-851351-1-smb devstack@keystone.service[207600]: [pid: 207600|app: 0|req: 569/1140] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 08:25:52 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 08:25:53.116462 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7da8ac-2003-40ea-9532-8218716938bf None None] Authenticating user token {{(pid=207601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:25:53.161114 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG dbcounter [-] [207601] Writing DB stats keystone:SELECT=100 {{(pid=207601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:25:53.224398 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7da8ac-2003-40ea-9532-8218716938bf None None] Validating token access rules against request {{(pid=207601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:25:53.261158 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b8c545-1b31-4650-b0e1-f4ae21aee1b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:25:53.261842 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b8c545-1b31-4650-b0e1-f4ae21aee1b9 None admin] REQUEST_METHOD: `GET` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:25:53.262133 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b8c545-1b31-4650-b0e1-f4ae21aee1b9 None admin] SCRIPT_NAME: `/identity` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:25:53.262411 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b8c545-1b31-4650-b0e1-f4ae21aee1b9 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:25:53.275925 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92b8c545-1b31-4650-b0e1-f4ae21aee1b9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 08:25:53.281348 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application [None req-92b8c545-1b31-4650-b0e1-f4ae21aee1b9 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 08:25:53.281348 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:25:53.281348 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:25:53.281348 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:25:53.281348 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:25:53.281348 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:25:53.281348 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:25:53.281348 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:25:53.281348 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:25:53.281348 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:25:53.281348 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:25:53.281348 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:25:53.281348 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 08:25:53.281348 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 08:25:53.281348 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 08:25:53.281348 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 08:25:53.283231 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 08:25:53.283231 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 08:25:53.283231 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 08:25:53.283231 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 08:25:53.283231 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:25:53.283231 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:25:53.283231 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:25:53.283231 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:25:53.283231 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:25:53.283231 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:25:53.283231 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:25:53.283231 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application with Lock( Jul 28 08:25:53.283231 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:25:53.283231 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:25:53.283231 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:25:53.283231 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:25:53.284267 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:25:53.284267 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:25:53.284267 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:25:53.284267 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:25:53.284267 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 08:25:53.284267 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 08:25:53.284267 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 08:25:53.284267 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 08:25:53.284267 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 08:25:53.284267 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 08:25:53.284267 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 08:25:53.284267 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application Jul 28 08:25:53.284267 dv-cinder-851351-1-smb devstack@keystone.service[207601]: [pid: 207601|app: 0|req: 572/1141] 10.222.0.42 () {56 vars in 1096 bytes} [Thu Jul 28 08:25:53 2022] GET /identity/v3/roles/admin => generated 83 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:25:53.289562 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe9be39-c45d-496c-9fc1-04bd58cdf5b3 None None] Authenticating user token {{(pid=207600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:25:53.413479 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe9be39-c45d-496c-9fc1-04bd58cdf5b3 None None] Validating token access rules against request {{(pid=207600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:25:53.444944 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG dbcounter [-] [207600] Writing DB stats keystone:SELECT=100 {{(pid=207600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:25:53.452133 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1991eeb6-250d-449d-b8e5-fe61556e288b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:25:53.453344 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1991eeb6-250d-449d-b8e5-fe61556e288b None admin] REQUEST_METHOD: `GET` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:25:53.453861 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1991eeb6-250d-449d-b8e5-fe61556e288b None admin] SCRIPT_NAME: `/identity` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:25:53.454364 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1991eeb6-250d-449d-b8e5-fe61556e288b None admin] PATH_INFO: `/v3/roles` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:25:53.455709 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1991eeb6-250d-449d-b8e5-fe61556e288b None admin] RBAC: Adding query filter params (name=admin) {{(pid=207600) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:25:53.456262 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1991eeb6-250d-449d-b8e5-fe61556e288b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:25:53.458937 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1991eeb6-250d-449d-b8e5-fe61556e288b None admin] RBAC: Authorization granted {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:25:53.475708 dv-cinder-851351-1-smb devstack@keystone.service[207600]: [pid: 207600|app: 0|req: 570/1142] 10.222.0.42 () {56 vars in 1099 bytes} [Thu Jul 28 08:25:53 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:25:53.481884 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b8c545-1b31-4650-b0e1-f4ae21aee1b9 None admin] Authenticating user token {{(pid=207601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:25:53.596409 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG dbcounter [-] [207601] Writing DB stats keystone:SELECT=100 {{(pid=207601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:25:53.601771 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b8c545-1b31-4650-b0e1-f4ae21aee1b9 None admin] Validating token access rules against request {{(pid=207601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:25:53.646725 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8806dd61-480d-46fa-9e79-40bb31658491 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:25:53.647571 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8806dd61-480d-46fa-9e79-40bb31658491 None admin] REQUEST_METHOD: `GET` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:25:53.647852 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8806dd61-480d-46fa-9e79-40bb31658491 None admin] SCRIPT_NAME: `/identity` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:25:53.648125 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8806dd61-480d-46fa-9e79-40bb31658491 None admin] PATH_INFO: `/v3/users/08d54090ba6142648a867eb249fc8b33` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:25:53.665898 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8806dd61-480d-46fa-9e79-40bb31658491 None admin] RBAC: Authorizing `identity:get_user(user_id=08d54090ba6142648a867eb249fc8b33)` {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:25:53.667323 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8806dd61-480d-46fa-9e79-40bb31658491 None admin] RBAC: Authorization granted {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:25:53.669245 dv-cinder-851351-1-smb devstack@keystone.service[207601]: [pid: 207601|app: 0|req: 573/1143] 10.222.0.42 () {56 vars in 1177 bytes} [Thu Jul 28 08:25:53 2022] GET /identity/v3/users/08d54090ba6142648a867eb249fc8b33 => generated 286 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:25:53.675816 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1991eeb6-250d-449d-b8e5-fe61556e288b None admin] Authenticating user token {{(pid=207600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:25:53.794282 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1991eeb6-250d-449d-b8e5-fe61556e288b None admin] Validating token access rules against request {{(pid=207600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:25:53.832230 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e27496-6f59-4ad9-8f4d-b8f3d9c64750 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:25:53.832905 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e27496-6f59-4ad9-8f4d-b8f3d9c64750 None admin] REQUEST_METHOD: `GET` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:25:53.833189 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e27496-6f59-4ad9-8f4d-b8f3d9c64750 None admin] SCRIPT_NAME: `/identity` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:25:53.833463 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e27496-6f59-4ad9-8f4d-b8f3d9c64750 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:25:53.908713 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG dbcounter [-] [207600] Writing DB stats keystone:SELECT=100 {{(pid=207600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:25:53.917769 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1e27496-6f59-4ad9-8f4d-b8f3d9c64750 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:25:53.919228 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1e27496-6f59-4ad9-8f4d-b8f3d9c64750 None admin] RBAC: Authorization granted {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:25:54.029413 dv-cinder-851351-1-smb devstack@keystone.service[207600]: [pid: 207600|app: 0|req: 571/1144] 10.222.0.42 () {58 vars in 1282 bytes} [Thu Jul 28 08:25:53 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 354 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 28 08:25:54.035960 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8806dd61-480d-46fa-9e79-40bb31658491 None admin] Authenticating user token {{(pid=207601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:25:54.156514 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8806dd61-480d-46fa-9e79-40bb31658491 None admin] Validating token access rules against request {{(pid=207601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:25:54.221615 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a951f830-72f8-4b69-998f-9b19ae48fdd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:25:54.222543 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a951f830-72f8-4b69-998f-9b19ae48fdd7 None admin] REQUEST_METHOD: `GET` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:25:54.223017 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a951f830-72f8-4b69-998f-9b19ae48fdd7 None admin] SCRIPT_NAME: `/identity` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:25:54.223464 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a951f830-72f8-4b69-998f-9b19ae48fdd7 None admin] PATH_INFO: `/v3/projects/dee9397d926e4761982fa517fc2f9aeb` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:25:54.225435 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a951f830-72f8-4b69-998f-9b19ae48fdd7 None admin] RBAC: Authorizing `identity:get_project(project_id=dee9397d926e4761982fa517fc2f9aeb)` {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:25:54.227448 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a951f830-72f8-4b69-998f-9b19ae48fdd7 None admin] RBAC: Authorization granted {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:25:54.229524 dv-cinder-851351-1-smb devstack@keystone.service[207601]: [pid: 207601|app: 0|req: 574/1145] 10.222.0.42 () {56 vars in 1186 bytes} [Thu Jul 28 08:25:54 2022] GET /identity/v3/projects/dee9397d926e4761982fa517fc2f9aeb => generated 311 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:25:54.236794 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e27496-6f59-4ad9-8f4d-b8f3d9c64750 None admin] Authenticating user token {{(pid=207600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:25:54.348838 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG dbcounter [-] [207600] Writing DB stats keystone:SELECT=100 {{(pid=207600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:25:54.358448 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e27496-6f59-4ad9-8f4d-b8f3d9c64750 None admin] Validating token access rules against request {{(pid=207600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:25:54.405424 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c411e6e-8584-4bff-8d75-1526073079eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:25:54.406066 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c411e6e-8584-4bff-8d75-1526073079eb None admin] REQUEST_METHOD: `GET` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:25:54.406347 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c411e6e-8584-4bff-8d75-1526073079eb None admin] SCRIPT_NAME: `/identity` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:25:54.406618 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c411e6e-8584-4bff-8d75-1526073079eb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:25:54.407444 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c411e6e-8584-4bff-8d75-1526073079eb None admin] RBAC: Adding query filter params (role.id=d0ce88034c6b41878db755343f5840be, scope.project.id=dee9397d926e4761982fa517fc2f9aeb, user.id=08d54090ba6142648a867eb249fc8b33) {{(pid=207600) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:25:54.407753 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c411e6e-8584-4bff-8d75-1526073079eb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:25:54.409322 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c411e6e-8584-4bff-8d75-1526073079eb None admin] RBAC: Authorization granted {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:25:54.416256 dv-cinder-851351-1-smb devstack@keystone.service[207600]: [pid: 207600|app: 0|req: 572/1146] 10.222.0.42 () {56 vars in 1374 bytes} [Thu Jul 28 08:25:54 2022] GET /identity/v3/role_assignments?user.id=08d54090ba6142648a867eb249fc8b33&scope.project.id=dee9397d926e4761982fa517fc2f9aeb&role.id=d0ce88034c6b41878db755343f5840be => generated 259 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:25:56.458583 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5400f4a2-1c05-435a-9e14-467c772707b5 None None] REQUEST_METHOD: `GET` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:25:56.459246 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5400f4a2-1c05-435a-9e14-467c772707b5 None None] SCRIPT_NAME: `/identity` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:25:56.459246 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5400f4a2-1c05-435a-9e14-467c772707b5 None None] PATH_INFO: `/` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:25:56.460790 dv-cinder-851351-1-smb devstack@keystone.service[207601]: [pid: 207601|app: 0|req: 575/1147] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 08:25:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 08:25:56.467337 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d05aa6-1f4a-441c-a7f3-6c5c5e470447 None None] REQUEST_METHOD: `POST` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:25:56.467919 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d05aa6-1f4a-441c-a7f3-6c5c5e470447 None None] SCRIPT_NAME: `/identity` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:25:56.467919 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d05aa6-1f4a-441c-a7f3-6c5c5e470447 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:25:56.487772 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.auth.core [None req-f3d05aa6-1f4a-441c-a7f3-6c5c5e470447 None None] MFA Rules not processed for user `b8110ade874c4aa7af27f5c376df700a`. Rule list: `[]` (Enabled: `True`). {{(pid=207600) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 08:25:56.489057 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.fernet_utils [None req-f3d05aa6-1f4a-441c-a7f3-6c5c5e470447 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=207600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:25:56.569068 dv-cinder-851351-1-smb devstack@keystone.service[207600]: [pid: 207600|app: 0|req: 573/1148] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 08:25:56 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 28 08:25:56.592329 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5400f4a2-1c05-435a-9e14-467c772707b5 None None] Authenticating user token {{(pid=207601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:25:56.620246 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG dbcounter [-] [207601] Writing DB stats keystone:SELECT=100 {{(pid=207601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:25:56.704021 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5400f4a2-1c05-435a-9e14-467c772707b5 None None] Validating token access rules against request {{(pid=207601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:25:56.741942 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2883119f-5d54-4ae8-8866-3c0c61b800e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:25:56.742508 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2883119f-5d54-4ae8-8866-3c0c61b800e7 None admin] REQUEST_METHOD: `GET` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:25:56.742791 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2883119f-5d54-4ae8-8866-3c0c61b800e7 None admin] SCRIPT_NAME: `/identity` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:25:56.743069 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2883119f-5d54-4ae8-8866-3c0c61b800e7 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:25:56.756072 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2883119f-5d54-4ae8-8866-3c0c61b800e7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 08:25:56.761485 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application [None req-2883119f-5d54-4ae8-8866-3c0c61b800e7 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 08:25:56.761485 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:25:56.761485 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:25:56.761485 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:25:56.761485 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:25:56.761485 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:25:56.761485 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:25:56.761485 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:25:56.761485 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:25:56.761485 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:25:56.761485 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:25:56.761485 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:25:56.761485 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 08:25:56.761485 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 08:25:56.761485 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 08:25:56.761485 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 08:25:56.763465 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 08:25:56.763465 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 08:25:56.763465 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 08:25:56.763465 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 08:25:56.763465 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:25:56.763465 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:25:56.763465 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:25:56.763465 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:25:56.763465 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:25:56.763465 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:25:56.763465 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:25:56.763465 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application with Lock( Jul 28 08:25:56.763465 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:25:56.763465 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:25:56.763465 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:25:56.763465 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:25:56.765262 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:25:56.765262 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:25:56.765262 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:25:56.765262 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:25:56.765262 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 08:25:56.765262 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 08:25:56.765262 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 08:25:56.765262 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 08:25:56.765262 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 08:25:56.765262 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 08:25:56.765262 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 08:25:56.765262 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application Jul 28 08:25:56.765262 dv-cinder-851351-1-smb devstack@keystone.service[207601]: [pid: 207601|app: 0|req: 576/1149] 10.222.0.42 () {56 vars in 1096 bytes} [Thu Jul 28 08:25:56 2022] GET /identity/v3/roles/admin => generated 83 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:25:56.769505 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d05aa6-1f4a-441c-a7f3-6c5c5e470447 None None] Authenticating user token {{(pid=207600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:25:56.863299 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG dbcounter [-] [207600] Writing DB stats keystone:SELECT=100 {{(pid=207600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:25:56.876924 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d05aa6-1f4a-441c-a7f3-6c5c5e470447 None None] Validating token access rules against request {{(pid=207600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:25:56.918168 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ea52b3-64a9-4cc7-864e-fe18ff0f4784 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:25:56.918883 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ea52b3-64a9-4cc7-864e-fe18ff0f4784 None admin] REQUEST_METHOD: `GET` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:25:56.919166 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ea52b3-64a9-4cc7-864e-fe18ff0f4784 None admin] SCRIPT_NAME: `/identity` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:25:56.919437 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ea52b3-64a9-4cc7-864e-fe18ff0f4784 None admin] PATH_INFO: `/v3/roles` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:25:56.920186 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4ea52b3-64a9-4cc7-864e-fe18ff0f4784 None admin] RBAC: Adding query filter params (name=admin) {{(pid=207600) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:25:56.920495 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4ea52b3-64a9-4cc7-864e-fe18ff0f4784 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:25:56.921938 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4ea52b3-64a9-4cc7-864e-fe18ff0f4784 None admin] RBAC: Authorization granted {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:25:56.932088 dv-cinder-851351-1-smb devstack@keystone.service[207600]: [pid: 207600|app: 0|req: 574/1150] 10.222.0.42 () {56 vars in 1099 bytes} [Thu Jul 28 08:25:56 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:25:56.938415 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2883119f-5d54-4ae8-8866-3c0c61b800e7 None admin] Authenticating user token {{(pid=207601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:25:57.035816 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG dbcounter [-] [207601] Writing DB stats keystone:SELECT=100 {{(pid=207601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:25:57.053614 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2883119f-5d54-4ae8-8866-3c0c61b800e7 None admin] Validating token access rules against request {{(pid=207601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:25:57.092334 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03bc4e44-a3d0-4b3c-b5dd-cc10bfc8bf82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:25:57.093039 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03bc4e44-a3d0-4b3c-b5dd-cc10bfc8bf82 None admin] REQUEST_METHOD: `GET` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:25:57.093322 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03bc4e44-a3d0-4b3c-b5dd-cc10bfc8bf82 None admin] SCRIPT_NAME: `/identity` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:25:57.093597 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03bc4e44-a3d0-4b3c-b5dd-cc10bfc8bf82 None admin] PATH_INFO: `/v3/users/08d54090ba6142648a867eb249fc8b33` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:25:57.094827 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03bc4e44-a3d0-4b3c-b5dd-cc10bfc8bf82 None admin] RBAC: Authorizing `identity:get_user(user_id=08d54090ba6142648a867eb249fc8b33)` {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:25:57.096289 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03bc4e44-a3d0-4b3c-b5dd-cc10bfc8bf82 None admin] RBAC: Authorization granted {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:25:57.097966 dv-cinder-851351-1-smb devstack@keystone.service[207601]: [pid: 207601|app: 0|req: 577/1151] 10.222.0.42 () {56 vars in 1177 bytes} [Thu Jul 28 08:25:56 2022] GET /identity/v3/users/08d54090ba6142648a867eb249fc8b33 => generated 286 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:25:57.104194 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ea52b3-64a9-4cc7-864e-fe18ff0f4784 None admin] Authenticating user token {{(pid=207600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:25:57.213894 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ea52b3-64a9-4cc7-864e-fe18ff0f4784 None admin] Validating token access rules against request {{(pid=207600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:25:57.251493 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4edc4b9-258a-4b19-aea3-8aca7dc1f3dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:25:57.252168 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4edc4b9-258a-4b19-aea3-8aca7dc1f3dc None admin] REQUEST_METHOD: `GET` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:25:57.252435 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4edc4b9-258a-4b19-aea3-8aca7dc1f3dc None admin] SCRIPT_NAME: `/identity` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:25:57.252754 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4edc4b9-258a-4b19-aea3-8aca7dc1f3dc None admin] PATH_INFO: `/v3/projects/dee9397d926e4761982fa517fc2f9aeb` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:25:57.253983 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4edc4b9-258a-4b19-aea3-8aca7dc1f3dc None admin] RBAC: Authorizing `identity:get_project(project_id=dee9397d926e4761982fa517fc2f9aeb)` {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:25:57.255456 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4edc4b9-258a-4b19-aea3-8aca7dc1f3dc None admin] RBAC: Authorization granted {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:25:57.257291 dv-cinder-851351-1-smb devstack@keystone.service[207600]: [pid: 207600|app: 0|req: 575/1152] 10.222.0.42 () {56 vars in 1186 bytes} [Thu Jul 28 08:25:57 2022] GET /identity/v3/projects/dee9397d926e4761982fa517fc2f9aeb => generated 311 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:25:57.263872 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03bc4e44-a3d0-4b3c-b5dd-cc10bfc8bf82 None admin] Authenticating user token {{(pid=207601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:25:57.387604 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03bc4e44-a3d0-4b3c-b5dd-cc10bfc8bf82 None admin] Validating token access rules against request {{(pid=207601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:25:57.430013 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9613f3-b33a-49d9-a72b-969742c5a9a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:25:57.430731 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9613f3-b33a-49d9-a72b-969742c5a9a7 None admin] REQUEST_METHOD: `PUT` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:25:57.431017 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9613f3-b33a-49d9-a72b-969742c5a9a7 None admin] SCRIPT_NAME: `/identity` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:25:57.431296 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9613f3-b33a-49d9-a72b-969742c5a9a7 None admin] PATH_INFO: `/v3/projects/dee9397d926e4761982fa517fc2f9aeb/users/08d54090ba6142648a867eb249fc8b33/roles/d0ce88034c6b41878db755343f5840be` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:25:57.433488 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d9613f3-b33a-49d9-a72b-969742c5a9a7 None admin] RBAC: Authorizing `identity:create_grant(project_id=dee9397d926e4761982fa517fc2f9aeb, user_id=08d54090ba6142648a867eb249fc8b33, role_id=d0ce88034c6b41878db755343f5840be)` {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:25:57.435024 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d9613f3-b33a-49d9-a72b-969742c5a9a7 None admin] RBAC: Authorization granted {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:25:57.451501 dv-cinder-851351-1-smb devstack@keystone.service[207601]: [pid: 207601|app: 0|req: 578/1153] 10.222.0.42 () {58 vars in 1439 bytes} [Thu Jul 28 08:25:57 2022] PUT /identity/v3/projects/dee9397d926e4761982fa517fc2f9aeb/users/08d54090ba6142648a867eb249fc8b33/roles/d0ce88034c6b41878db755343f5840be => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 08:25:59.514540 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02246f55-6ffe-4501-9e1b-02bca8a10884 None None] REQUEST_METHOD: `GET` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:25:59.515211 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02246f55-6ffe-4501-9e1b-02bca8a10884 None None] SCRIPT_NAME: `/identity` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:25:59.515211 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02246f55-6ffe-4501-9e1b-02bca8a10884 None None] PATH_INFO: `/` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:25:59.516630 dv-cinder-851351-1-smb devstack@keystone.service[207600]: [pid: 207600|app: 0|req: 576/1154] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 08:25:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 08:25:59.523339 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4393ddc4-3f8b-487f-8285-2f9966fb6581 None None] REQUEST_METHOD: `POST` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:25:59.523943 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4393ddc4-3f8b-487f-8285-2f9966fb6581 None None] SCRIPT_NAME: `/identity` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:25:59.523943 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4393ddc4-3f8b-487f-8285-2f9966fb6581 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:25:59.544883 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.auth.core [None req-4393ddc4-3f8b-487f-8285-2f9966fb6581 None None] MFA Rules not processed for user `b8110ade874c4aa7af27f5c376df700a`. Rule list: `[]` (Enabled: `True`). {{(pid=207601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 08:25:59.546224 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.fernet_utils [None req-4393ddc4-3f8b-487f-8285-2f9966fb6581 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=207601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:25:59.555769 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG dbcounter [-] [207601] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=207601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:25:59.632024 dv-cinder-851351-1-smb devstack@keystone.service[207601]: [pid: 207601|app: 0|req: 579/1155] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 08:25:59 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 08:25:59.657037 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02246f55-6ffe-4501-9e1b-02bca8a10884 None None] Authenticating user token {{(pid=207600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:25:59.692405 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG dbcounter [-] [207600] Writing DB stats keystone:SELECT=100 {{(pid=207600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:25:59.848137 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02246f55-6ffe-4501-9e1b-02bca8a10884 None None] Validating token access rules against request {{(pid=207600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:25:59.908645 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0c598a-aaa0-4e4c-a0cd-aa978031728f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:25:59.909702 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0c598a-aaa0-4e4c-a0cd-aa978031728f None admin] REQUEST_METHOD: `GET` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:25:59.910153 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0c598a-aaa0-4e4c-a0cd-aa978031728f None admin] SCRIPT_NAME: `/identity` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:25:59.910614 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0c598a-aaa0-4e4c-a0cd-aa978031728f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:25:59.930888 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a0c598a-aaa0-4e4c-a0cd-aa978031728f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 08:25:59.939777 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application [None req-2a0c598a-aaa0-4e4c-a0cd-aa978031728f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 08:25:59.939777 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:25:59.939777 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:25:59.939777 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:25:59.939777 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:25:59.939777 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:25:59.939777 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:25:59.939777 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:25:59.939777 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:25:59.939777 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:25:59.939777 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:25:59.939777 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:25:59.939777 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 08:25:59.939777 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 08:25:59.939777 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 08:25:59.939777 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 08:25:59.941131 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 08:25:59.941131 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 08:25:59.941131 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 08:25:59.941131 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 08:25:59.941131 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:25:59.941131 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:25:59.941131 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:25:59.941131 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:25:59.941131 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:25:59.941131 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:25:59.941131 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:25:59.941131 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application with Lock( Jul 28 08:25:59.941131 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:25:59.941131 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:25:59.941131 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:25:59.941131 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:25:59.942345 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:25:59.942345 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:25:59.942345 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:25:59.942345 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:25:59.942345 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 08:25:59.942345 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 08:25:59.942345 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 08:25:59.942345 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 08:25:59.942345 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 08:25:59.942345 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 08:25:59.942345 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 08:25:59.942345 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application Jul 28 08:25:59.942345 dv-cinder-851351-1-smb devstack@keystone.service[207600]: [pid: 207600|app: 0|req: 577/1156] 10.222.0.42 () {56 vars in 1096 bytes} [Thu Jul 28 08:25:59 2022] GET /identity/v3/roles/admin => generated 83 bytes in 286 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:25:59.951335 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4393ddc4-3f8b-487f-8285-2f9966fb6581 None None] Authenticating user token {{(pid=207601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:26:00.122342 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4393ddc4-3f8b-487f-8285-2f9966fb6581 None None] Validating token access rules against request {{(pid=207601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:26:00.163561 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad27d36-577b-483d-a6db-b8f40ef2fc7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:26:00.164262 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad27d36-577b-483d-a6db-b8f40ef2fc7c None admin] REQUEST_METHOD: `GET` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:26:00.164590 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad27d36-577b-483d-a6db-b8f40ef2fc7c None admin] SCRIPT_NAME: `/identity` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:26:00.165086 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad27d36-577b-483d-a6db-b8f40ef2fc7c None admin] PATH_INFO: `/v3/roles` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:26:00.166013 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad27d36-577b-483d-a6db-b8f40ef2fc7c None admin] RBAC: Adding query filter params (name=admin) {{(pid=207601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:26:00.166546 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad27d36-577b-483d-a6db-b8f40ef2fc7c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:26:00.168844 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad27d36-577b-483d-a6db-b8f40ef2fc7c None admin] RBAC: Authorization granted {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:26:00.180700 dv-cinder-851351-1-smb devstack@keystone.service[207601]: [pid: 207601|app: 0|req: 580/1157] 10.222.0.42 () {56 vars in 1099 bytes} [Thu Jul 28 08:25:59 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:26:00.187774 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0c598a-aaa0-4e4c-a0cd-aa978031728f None admin] Authenticating user token {{(pid=207600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:26:00.338643 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG dbcounter [-] [207600] Writing DB stats keystone:SELECT=100 {{(pid=207600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:26:00.379946 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0c598a-aaa0-4e4c-a0cd-aa978031728f None admin] Validating token access rules against request {{(pid=207600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:26:00.442720 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb401db0-4231-4ad4-86b4-3c51bb47fa14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:26:00.443894 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb401db0-4231-4ad4-86b4-3c51bb47fa14 None admin] REQUEST_METHOD: `GET` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:26:00.444395 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb401db0-4231-4ad4-86b4-3c51bb47fa14 None admin] SCRIPT_NAME: `/identity` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:26:00.444935 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb401db0-4231-4ad4-86b4-3c51bb47fa14 None admin] PATH_INFO: `/v3/users/08d54090ba6142648a867eb249fc8b33` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:26:00.447121 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb401db0-4231-4ad4-86b4-3c51bb47fa14 None admin] RBAC: Authorizing `identity:get_user(user_id=08d54090ba6142648a867eb249fc8b33)` {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:26:00.449902 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb401db0-4231-4ad4-86b4-3c51bb47fa14 None admin] RBAC: Authorization granted {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:26:00.453078 dv-cinder-851351-1-smb devstack@keystone.service[207600]: [pid: 207600|app: 0|req: 578/1158] 10.222.0.42 () {56 vars in 1177 bytes} [Thu Jul 28 08:26:00 2022] GET /identity/v3/users/08d54090ba6142648a867eb249fc8b33 => generated 286 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:26:00.459522 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad27d36-577b-483d-a6db-b8f40ef2fc7c None admin] Authenticating user token {{(pid=207601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:26:00.464493 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG dbcounter [-] [207601] Writing DB stats keystone:SELECT=100 {{(pid=207601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:26:00.581072 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad27d36-577b-483d-a6db-b8f40ef2fc7c None admin] Validating token access rules against request {{(pid=207601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:26:00.622502 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afcbc913-eba0-4c87-9c4e-70473e98e78f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:26:00.623445 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afcbc913-eba0-4c87-9c4e-70473e98e78f None admin] REQUEST_METHOD: `GET` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:26:00.623635 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afcbc913-eba0-4c87-9c4e-70473e98e78f None admin] SCRIPT_NAME: `/identity` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:26:00.623771 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afcbc913-eba0-4c87-9c4e-70473e98e78f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:26:00.702305 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afcbc913-eba0-4c87-9c4e-70473e98e78f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:26:00.703765 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afcbc913-eba0-4c87-9c4e-70473e98e78f None admin] RBAC: Authorization granted {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:26:00.707150 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG dbcounter [-] [207601] Writing DB stats keystone:SELECT=100 {{(pid=207601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:26:00.882350 dv-cinder-851351-1-smb devstack@keystone.service[207601]: [pid: 207601|app: 0|req: 581/1159] 10.222.0.42 () {58 vars in 1282 bytes} [Thu Jul 28 08:26:00 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 423 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 28 08:26:00.890066 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb401db0-4231-4ad4-86b4-3c51bb47fa14 None admin] Authenticating user token {{(pid=207600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:26:01.007578 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb401db0-4231-4ad4-86b4-3c51bb47fa14 None admin] Validating token access rules against request {{(pid=207600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:26:01.045531 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d304fc09-d68e-4ec2-96e3-81dc10d15c96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:26:01.046190 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d304fc09-d68e-4ec2-96e3-81dc10d15c96 None admin] REQUEST_METHOD: `GET` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:26:01.046468 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d304fc09-d68e-4ec2-96e3-81dc10d15c96 None admin] SCRIPT_NAME: `/identity` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:26:01.046743 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d304fc09-d68e-4ec2-96e3-81dc10d15c96 None admin] PATH_INFO: `/v3/projects/dee9397d926e4761982fa517fc2f9aeb` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:26:01.047968 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d304fc09-d68e-4ec2-96e3-81dc10d15c96 None admin] RBAC: Authorizing `identity:get_project(project_id=dee9397d926e4761982fa517fc2f9aeb)` {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:26:01.049477 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d304fc09-d68e-4ec2-96e3-81dc10d15c96 None admin] RBAC: Authorization granted {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:26:01.051187 dv-cinder-851351-1-smb devstack@keystone.service[207600]: [pid: 207600|app: 0|req: 579/1160] 10.222.0.42 () {56 vars in 1186 bytes} [Thu Jul 28 08:26:00 2022] GET /identity/v3/projects/dee9397d926e4761982fa517fc2f9aeb => generated 311 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:26:01.058059 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afcbc913-eba0-4c87-9c4e-70473e98e78f None admin] Authenticating user token {{(pid=207601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:26:01.168903 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afcbc913-eba0-4c87-9c4e-70473e98e78f None admin] Validating token access rules against request {{(pid=207601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:26:01.171608 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG dbcounter [-] [207601] Writing DB stats keystone:SELECT=100 {{(pid=207601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:26:01.207846 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3493a4a2-1e16-4b71-83dd-2d19ee59f139 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:26:01.208491 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3493a4a2-1e16-4b71-83dd-2d19ee59f139 None admin] REQUEST_METHOD: `GET` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:26:01.208812 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3493a4a2-1e16-4b71-83dd-2d19ee59f139 None admin] SCRIPT_NAME: `/identity` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:26:01.209091 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3493a4a2-1e16-4b71-83dd-2d19ee59f139 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:26:01.209978 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3493a4a2-1e16-4b71-83dd-2d19ee59f139 None admin] RBAC: Adding query filter params (role.id=d0ce88034c6b41878db755343f5840be, scope.project.id=dee9397d926e4761982fa517fc2f9aeb, user.id=08d54090ba6142648a867eb249fc8b33) {{(pid=207601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:26:01.210296 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3493a4a2-1e16-4b71-83dd-2d19ee59f139 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:26:01.212134 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3493a4a2-1e16-4b71-83dd-2d19ee59f139 None admin] RBAC: Authorization granted {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:26:01.219029 dv-cinder-851351-1-smb devstack@keystone.service[207601]: [pid: 207601|app: 0|req: 582/1161] 10.222.0.42 () {56 vars in 1374 bytes} [Thu Jul 28 08:26:01 2022] GET /identity/v3/role_assignments?user.id=08d54090ba6142648a867eb249fc8b33&scope.project.id=dee9397d926e4761982fa517fc2f9aeb&role.id=d0ce88034c6b41878db755343f5840be => generated 608 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:26:03.293159 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1aaa5d5-014d-4914-a0cc-9596cf22a1a3 None None] REQUEST_METHOD: `GET` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:26:03.294012 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1aaa5d5-014d-4914-a0cc-9596cf22a1a3 None None] SCRIPT_NAME: `/identity` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:26:03.294012 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1aaa5d5-014d-4914-a0cc-9596cf22a1a3 None None] PATH_INFO: `/` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:26:03.295130 dv-cinder-851351-1-smb devstack@keystone.service[207600]: [pid: 207600|app: 0|req: 580/1162] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 08:26:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 08:26:03.301506 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e354346-834f-4eae-8966-88ddf608e6e6 None None] REQUEST_METHOD: `POST` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:26:03.302311 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e354346-834f-4eae-8966-88ddf608e6e6 None None] SCRIPT_NAME: `/identity` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:26:03.302311 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e354346-834f-4eae-8966-88ddf608e6e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:26:03.323094 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.auth.core [None req-3e354346-834f-4eae-8966-88ddf608e6e6 None None] MFA Rules not processed for user `b8110ade874c4aa7af27f5c376df700a`. Rule list: `[]` (Enabled: `True`). {{(pid=207601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 08:26:03.324463 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.fernet_utils [None req-3e354346-834f-4eae-8966-88ddf608e6e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=207601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:26:03.407451 dv-cinder-851351-1-smb devstack@keystone.service[207601]: [pid: 207601|app: 0|req: 583/1163] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 08:26:03 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 28 08:26:03.430172 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1aaa5d5-014d-4914-a0cc-9596cf22a1a3 None None] Authenticating user token {{(pid=207600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:26:03.449304 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG dbcounter [-] [207600] Writing DB stats keystone:SELECT=100 {{(pid=207600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:26:03.552061 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1aaa5d5-014d-4914-a0cc-9596cf22a1a3 None None] Validating token access rules against request {{(pid=207600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:26:03.591255 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec1bbc9-4491-4515-b186-7192b761e1af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:26:03.591897 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec1bbc9-4491-4515-b186-7192b761e1af None admin] REQUEST_METHOD: `GET` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:26:03.592177 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec1bbc9-4491-4515-b186-7192b761e1af None admin] SCRIPT_NAME: `/identity` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:26:03.592448 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec1bbc9-4491-4515-b186-7192b761e1af None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:26:03.673129 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ec1bbc9-4491-4515-b186-7192b761e1af None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:26:03.677520 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ec1bbc9-4491-4515-b186-7192b761e1af None admin] RBAC: Authorization granted {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:26:03.699302 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG dbcounter [-] [207600] Writing DB stats keystone:SELECT=100 {{(pid=207600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:26:03.801485 dv-cinder-851351-1-smb devstack@keystone.service[207600]: [pid: 207600|app: 0|req: 581/1164] 10.222.0.42 () {58 vars in 1282 bytes} [Thu Jul 28 08:26:03 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 372 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 28 08:26:03.808396 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e354346-834f-4eae-8966-88ddf608e6e6 None None] Authenticating user token {{(pid=207601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:26:03.921397 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG dbcounter [-] [207601] Writing DB stats keystone:SELECT=100 {{(pid=207601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:26:03.926516 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e354346-834f-4eae-8966-88ddf608e6e6 None None] Validating token access rules against request {{(pid=207601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:26:03.966081 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a334578-eef2-4f5e-8fe7-6d2e3dba84bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:26:03.966784 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a334578-eef2-4f5e-8fe7-6d2e3dba84bb None admin] REQUEST_METHOD: `GET` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:26:03.967070 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a334578-eef2-4f5e-8fe7-6d2e3dba84bb None admin] SCRIPT_NAME: `/identity` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:26:03.967347 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a334578-eef2-4f5e-8fe7-6d2e3dba84bb None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:26:03.975640 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a334578-eef2-4f5e-8fe7-6d2e3dba84bb None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:26:03.977196 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a334578-eef2-4f5e-8fe7-6d2e3dba84bb None admin] RBAC: Authorization granted {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:26:03.990503 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application [None req-9a334578-eef2-4f5e-8fe7-6d2e3dba84bb None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Jul 28 08:26:03.990503 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:26:03.990503 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Jul 28 08:26:03.990503 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Jul 28 08:26:03.990503 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 28 08:26:03.990503 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 28 08:26:03.990503 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 28 08:26:03.990503 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 28 08:26:03.990503 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. Jul 28 08:26:03.990503 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application Jul 28 08:26:03.990503 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 28 08:26:03.990503 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application Jul 28 08:26:03.990503 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:26:03.990503 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:26:03.990503 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:26:03.990503 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:26:03.990503 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:26:03.992756 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:26:03.992756 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:26:03.992756 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:26:03.992756 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:26:03.992756 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:26:03.992756 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:26:03.992756 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 08:26:03.992756 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 08:26:03.992756 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 08:26:03.992756 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 08:26:03.992756 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:26:03.992756 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:26:03.992756 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:26:03.992756 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:26:03.992756 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:26:03.992756 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:26:03.994812 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:26:03.994812 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application with Lock( Jul 28 08:26:03.994812 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:26:03.994812 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:26:03.994812 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:26:03.994812 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:26:03.994812 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:26:03.994812 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:26:03.994812 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:26:03.994812 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:26:03.994812 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Jul 28 08:26:03.994812 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 08:26:03.994812 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. Jul 28 08:26:03.994812 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application Jul 28 08:26:03.994812 dv-cinder-851351-1-smb devstack@keystone.service[207601]: [pid: 207601|app: 0|req: 584/1165] 10.222.0.42 () {56 vars in 1117 bytes} [Thu Jul 28 08:26:03 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:26:04.000407 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec1bbc9-4491-4515-b186-7192b761e1af None admin] Authenticating user token {{(pid=207600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:26:04.130619 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec1bbc9-4491-4515-b186-7192b761e1af None admin] Validating token access rules against request {{(pid=207600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:26:04.146522 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG dbcounter [-] [207600] Writing DB stats keystone:SELECT=100 {{(pid=207600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:26:04.168944 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737d2317-4c6d-439e-b41a-ea80645633af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:26:04.169631 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737d2317-4c6d-439e-b41a-ea80645633af None admin] REQUEST_METHOD: `GET` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:26:04.169948 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737d2317-4c6d-439e-b41a-ea80645633af None admin] SCRIPT_NAME: `/identity` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:26:04.170259 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737d2317-4c6d-439e-b41a-ea80645633af None admin] PATH_INFO: `/v3/domains` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:26:04.171016 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-737d2317-4c6d-439e-b41a-ea80645633af None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=207600) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:26:04.171388 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-737d2317-4c6d-439e-b41a-ea80645633af None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:26:04.172897 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-737d2317-4c6d-439e-b41a-ea80645633af None admin] RBAC: Authorization granted {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:26:04.181237 dv-cinder-851351-1-smb devstack@keystone.service[207600]: [pid: 207600|app: 0|req: 582/1166] 10.222.0.42 () {56 vars in 1115 bytes} [Thu Jul 28 08:26:03 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:26:06.260174 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3605e157-230c-4fb1-8607-cf100d8c4541 None None] REQUEST_METHOD: `GET` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:26:06.260769 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3605e157-230c-4fb1-8607-cf100d8c4541 None None] SCRIPT_NAME: `/identity` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:26:06.260769 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3605e157-230c-4fb1-8607-cf100d8c4541 None None] PATH_INFO: `/` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:26:06.262055 dv-cinder-851351-1-smb devstack@keystone.service[207601]: [pid: 207601|app: 0|req: 585/1167] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 08:26:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 08:26:06.268985 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9c242f-ab2e-4330-a7c7-b3019259936c None None] REQUEST_METHOD: `POST` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:26:06.269445 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9c242f-ab2e-4330-a7c7-b3019259936c None None] SCRIPT_NAME: `/identity` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:26:06.269615 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9c242f-ab2e-4330-a7c7-b3019259936c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:26:06.289655 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.auth.core [None req-ac9c242f-ab2e-4330-a7c7-b3019259936c None None] MFA Rules not processed for user `b8110ade874c4aa7af27f5c376df700a`. Rule list: `[]` (Enabled: `True`). {{(pid=207600) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 08:26:06.290951 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.fernet_utils [None req-ac9c242f-ab2e-4330-a7c7-b3019259936c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=207600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:26:06.371808 dv-cinder-851351-1-smb devstack@keystone.service[207600]: [pid: 207600|app: 0|req: 583/1168] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 08:26:06 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 08:26:06.395225 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3605e157-230c-4fb1-8607-cf100d8c4541 None None] Authenticating user token {{(pid=207601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:26:06.507841 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3605e157-230c-4fb1-8607-cf100d8c4541 None None] Validating token access rules against request {{(pid=207601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:26:06.544404 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de0e724c-7773-4482-aa20-4fb16f817c62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:26:06.544981 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0e724c-7773-4482-aa20-4fb16f817c62 None admin] REQUEST_METHOD: `POST` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:26:06.545287 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0e724c-7773-4482-aa20-4fb16f817c62 None admin] SCRIPT_NAME: `/identity` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:26:06.545562 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0e724c-7773-4482-aa20-4fb16f817c62 None admin] PATH_INFO: `/v3/domains` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:26:06.546293 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de0e724c-7773-4482-aa20-4fb16f817c62 None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:26:06.547688 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de0e724c-7773-4482-aa20-4fb16f817c62 None admin] RBAC: Authorization granted {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:26:06.566723 dv-cinder-851351-1-smb devstack@keystone.service[207601]: [pid: 207601|app: 0|req: 586/1169] 10.222.0.42 () {60 vars in 1138 bytes} [Thu Jul 28 08:26:06 2022] POST /identity/v3/domains => generated 267 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 08:26:08.644393 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e301ed1-fbbb-415c-abe6-8091effbb7d0 None None] REQUEST_METHOD: `GET` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:26:08.645200 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e301ed1-fbbb-415c-abe6-8091effbb7d0 None None] SCRIPT_NAME: `/identity` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:26:08.645200 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e301ed1-fbbb-415c-abe6-8091effbb7d0 None None] PATH_INFO: `/` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:26:08.646736 dv-cinder-851351-1-smb devstack@keystone.service[207600]: [pid: 207600|app: 0|req: 584/1170] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 08:26:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 08:26:08.653111 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525cddc0-7bda-4e9f-b869-8cc170ed0ae2 None None] REQUEST_METHOD: `POST` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:26:08.653769 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525cddc0-7bda-4e9f-b869-8cc170ed0ae2 None None] SCRIPT_NAME: `/identity` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:26:08.653769 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525cddc0-7bda-4e9f-b869-8cc170ed0ae2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:26:08.674467 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.auth.core [None req-525cddc0-7bda-4e9f-b869-8cc170ed0ae2 None None] MFA Rules not processed for user `b8110ade874c4aa7af27f5c376df700a`. Rule list: `[]` (Enabled: `True`). {{(pid=207601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 08:26:08.675753 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.fernet_utils [None req-525cddc0-7bda-4e9f-b869-8cc170ed0ae2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=207601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:26:08.692591 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG dbcounter [-] [207601] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=207601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:26:08.763905 dv-cinder-851351-1-smb devstack@keystone.service[207601]: [pid: 207601|app: 0|req: 587/1171] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 08:26:08 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 28 08:26:08.788132 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e301ed1-fbbb-415c-abe6-8091effbb7d0 None None] Authenticating user token {{(pid=207600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:26:08.983063 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e301ed1-fbbb-415c-abe6-8091effbb7d0 None None] Validating token access rules against request {{(pid=207600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:26:09.001507 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG dbcounter [-] [207600] Writing DB stats keystone:SELECT=100 {{(pid=207600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:26:09.035856 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c9feec9-eef8-4fb5-9dc1-8b75d677ae56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:26:09.036591 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9feec9-eef8-4fb5-9dc1-8b75d677ae56 None admin] REQUEST_METHOD: `GET` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:26:09.036967 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9feec9-eef8-4fb5-9dc1-8b75d677ae56 None admin] SCRIPT_NAME: `/identity` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:26:09.037374 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9feec9-eef8-4fb5-9dc1-8b75d677ae56 None admin] PATH_INFO: `/v3/domains/c3d5392252a146e0974c56731f713b76` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:26:09.050784 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c9feec9-eef8-4fb5-9dc1-8b75d677ae56 None admin] RBAC: Authorizing `identity:get_domain(domain_id=c3d5392252a146e0974c56731f713b76)` {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:26:09.052441 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c9feec9-eef8-4fb5-9dc1-8b75d677ae56 None admin] RBAC: Authorization granted {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:26:09.054417 dv-cinder-851351-1-smb devstack@keystone.service[207600]: [pid: 207600|app: 0|req: 585/1172] 10.222.0.42 () {56 vars in 1183 bytes} [Thu Jul 28 08:26:08 2022] GET /identity/v3/domains/c3d5392252a146e0974c56731f713b76 => generated 267 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:26:09.061261 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-525cddc0-7bda-4e9f-b869-8cc170ed0ae2 None None] Authenticating user token {{(pid=207601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:26:09.187736 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-525cddc0-7bda-4e9f-b869-8cc170ed0ae2 None None] Validating token access rules against request {{(pid=207601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:26:09.227341 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a8a29f9-c961-4872-9e6f-5f222ddf6f52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:26:09.227992 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8a29f9-c961-4872-9e6f-5f222ddf6f52 None admin] REQUEST_METHOD: `POST` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:26:09.228272 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8a29f9-c961-4872-9e6f-5f222ddf6f52 None admin] SCRIPT_NAME: `/identity` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:26:09.228533 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8a29f9-c961-4872-9e6f-5f222ddf6f52 None admin] PATH_INFO: `/v3/projects` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:26:09.229273 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a8a29f9-c961-4872-9e6f-5f222ddf6f52 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:26:09.230723 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a8a29f9-c961-4872-9e6f-5f222ddf6f52 None admin] RBAC: Authorization granted {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:26:09.254097 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG dbcounter [-] [207601] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=207601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:26:09.262633 dv-cinder-851351-1-smb devstack@keystone.service[207601]: [pid: 207601|app: 0|req: 588/1173] 10.222.0.42 () {60 vars in 1141 bytes} [Thu Jul 28 08:26:09 2022] POST /identity/v3/projects => generated 361 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 08:26:11.350494 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07cc5d3c-c04c-4f69-8b40-92f133b30ba0 None None] REQUEST_METHOD: `GET` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:26:11.351171 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07cc5d3c-c04c-4f69-8b40-92f133b30ba0 None None] SCRIPT_NAME: `/identity` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:26:11.351171 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07cc5d3c-c04c-4f69-8b40-92f133b30ba0 None None] PATH_INFO: `/` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:26:11.352413 dv-cinder-851351-1-smb devstack@keystone.service[207600]: [pid: 207600|app: 0|req: 586/1174] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 08:26:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 08:26:11.358638 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95e98e0-21ed-48cd-a2f3-63efdc8a7e65 None None] REQUEST_METHOD: `POST` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:26:11.359242 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95e98e0-21ed-48cd-a2f3-63efdc8a7e65 None None] SCRIPT_NAME: `/identity` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:26:11.359242 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95e98e0-21ed-48cd-a2f3-63efdc8a7e65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:26:11.379937 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.auth.core [None req-e95e98e0-21ed-48cd-a2f3-63efdc8a7e65 None None] MFA Rules not processed for user `b8110ade874c4aa7af27f5c376df700a`. Rule list: `[]` (Enabled: `True`). {{(pid=207601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 08:26:11.381427 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.fernet_utils [None req-e95e98e0-21ed-48cd-a2f3-63efdc8a7e65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=207601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:26:11.458122 dv-cinder-851351-1-smb devstack@keystone.service[207601]: [pid: 207601|app: 0|req: 589/1175] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 08:26:11 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 08:26:11.484038 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07cc5d3c-c04c-4f69-8b40-92f133b30ba0 None None] Authenticating user token {{(pid=207600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:26:11.596950 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07cc5d3c-c04c-4f69-8b40-92f133b30ba0 None None] Validating token access rules against request {{(pid=207600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:26:11.634312 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd13ac52-2cc2-4df1-8636-f5b615a7f944 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:26:11.634899 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd13ac52-2cc2-4df1-8636-f5b615a7f944 None admin] REQUEST_METHOD: `GET` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:26:11.635185 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd13ac52-2cc2-4df1-8636-f5b615a7f944 None admin] SCRIPT_NAME: `/identity` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:26:11.635462 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd13ac52-2cc2-4df1-8636-f5b615a7f944 None admin] PATH_INFO: `/v3/domains/c3d5392252a146e0974c56731f713b76` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:26:11.636838 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd13ac52-2cc2-4df1-8636-f5b615a7f944 None admin] RBAC: Authorizing `identity:get_domain(domain_id=c3d5392252a146e0974c56731f713b76)` {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:26:11.638336 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd13ac52-2cc2-4df1-8636-f5b615a7f944 None admin] RBAC: Authorization granted {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:26:11.640030 dv-cinder-851351-1-smb devstack@keystone.service[207600]: [pid: 207600|app: 0|req: 587/1176] 10.222.0.42 () {56 vars in 1183 bytes} [Thu Jul 28 08:26:11 2022] GET /identity/v3/domains/c3d5392252a146e0974c56731f713b76 => generated 267 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:26:11.646333 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95e98e0-21ed-48cd-a2f3-63efdc8a7e65 None None] Authenticating user token {{(pid=207601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:26:11.756051 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95e98e0-21ed-48cd-a2f3-63efdc8a7e65 None None] Validating token access rules against request {{(pid=207601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:26:11.789537 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG dbcounter [-] [207601] Writing DB stats keystone:SELECT=100 {{(pid=207601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:26:11.796559 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb584e3d-fd8f-40ad-9a26-518ac6a82720 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:26:11.797311 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb584e3d-fd8f-40ad-9a26-518ac6a82720 None admin] REQUEST_METHOD: `POST` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:26:11.797629 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb584e3d-fd8f-40ad-9a26-518ac6a82720 None admin] SCRIPT_NAME: `/identity` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:26:11.797945 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb584e3d-fd8f-40ad-9a26-518ac6a82720 None admin] PATH_INFO: `/v3/users` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:26:11.798712 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb584e3d-fd8f-40ad-9a26-518ac6a82720 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:26:11.800291 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb584e3d-fd8f-40ad-9a26-518ac6a82720 None admin] RBAC: Authorization granted {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:26:11.829454 dv-cinder-851351-1-smb devstack@keystone.service[207601]: [pid: 207601|app: 0|req: 590/1177] 10.222.0.42 () {60 vars in 1132 bytes} [Thu Jul 28 08:26:11 2022] POST /identity/v3/users => generated 311 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 28 08:26:13.950273 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4897977d-e549-4b87-8350-1db389af9b31 None None] REQUEST_METHOD: `GET` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:26:13.950917 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4897977d-e549-4b87-8350-1db389af9b31 None None] SCRIPT_NAME: `/identity` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:26:13.950917 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4897977d-e549-4b87-8350-1db389af9b31 None None] PATH_INFO: `/` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:26:13.952230 dv-cinder-851351-1-smb devstack@keystone.service[207600]: [pid: 207600|app: 0|req: 588/1178] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 08:26:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 08:26:13.958416 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c29e803-82ff-428a-9619-67a79abe3f23 None None] REQUEST_METHOD: `POST` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:26:13.959214 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c29e803-82ff-428a-9619-67a79abe3f23 None None] SCRIPT_NAME: `/identity` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:26:13.959214 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c29e803-82ff-428a-9619-67a79abe3f23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:26:13.979431 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.auth.core [None req-3c29e803-82ff-428a-9619-67a79abe3f23 None None] MFA Rules not processed for user `b8110ade874c4aa7af27f5c376df700a`. Rule list: `[]` (Enabled: `True`). {{(pid=207601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 08:26:13.980715 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.fernet_utils [None req-3c29e803-82ff-428a-9619-67a79abe3f23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=207601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:26:14.057922 dv-cinder-851351-1-smb devstack@keystone.service[207601]: [pid: 207601|app: 0|req: 591/1179] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 08:26:13 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 08:26:14.081723 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4897977d-e549-4b87-8350-1db389af9b31 None None] Authenticating user token {{(pid=207600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:26:14.133785 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG dbcounter [-] [207600] Writing DB stats keystone:SELECT=100 {{(pid=207600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:26:14.265152 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4897977d-e549-4b87-8350-1db389af9b31 None None] Validating token access rules against request {{(pid=207600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:26:14.326335 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2274e5-ba62-4d07-8e2e-a25bc6c25533 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:26:14.327374 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2274e5-ba62-4d07-8e2e-a25bc6c25533 None admin] REQUEST_METHOD: `GET` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:26:14.327801 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2274e5-ba62-4d07-8e2e-a25bc6c25533 None admin] SCRIPT_NAME: `/identity` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:26:14.328301 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2274e5-ba62-4d07-8e2e-a25bc6c25533 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:26:14.349616 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c2274e5-ba62-4d07-8e2e-a25bc6c25533 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 08:26:14.359842 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application [None req-6c2274e5-ba62-4d07-8e2e-a25bc6c25533 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 08:26:14.359842 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:26:14.359842 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:26:14.359842 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:26:14.359842 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:26:14.359842 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:26:14.359842 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:26:14.359842 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:26:14.359842 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:26:14.359842 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:26:14.359842 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:26:14.359842 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:26:14.359842 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 08:26:14.359842 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 08:26:14.359842 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 08:26:14.359842 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 08:26:14.361645 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 08:26:14.361645 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 08:26:14.361645 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 08:26:14.361645 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 08:26:14.361645 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:26:14.361645 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:26:14.361645 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:26:14.361645 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:26:14.361645 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:26:14.361645 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:26:14.361645 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:26:14.361645 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application with Lock( Jul 28 08:26:14.361645 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:26:14.361645 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:26:14.361645 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:26:14.361645 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:26:14.363686 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:26:14.363686 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:26:14.363686 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:26:14.363686 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:26:14.363686 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 08:26:14.363686 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 08:26:14.363686 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 08:26:14.363686 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 08:26:14.363686 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 08:26:14.363686 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 08:26:14.363686 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 08:26:14.363686 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application Jul 28 08:26:14.363686 dv-cinder-851351-1-smb devstack@keystone.service[207600]: [pid: 207600|app: 0|req: 589/1180] 10.222.0.42 () {56 vars in 1096 bytes} [Thu Jul 28 08:26:14 2022] GET /identity/v3/roles/admin => generated 83 bytes in 281 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 08:26:14.370023 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c29e803-82ff-428a-9619-67a79abe3f23 None None] Authenticating user token {{(pid=207601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:26:14.507696 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c29e803-82ff-428a-9619-67a79abe3f23 None None] Validating token access rules against request {{(pid=207601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:26:14.539533 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG dbcounter [-] [207601] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=207601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:26:14.573440 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa3dbda-790a-43be-961e-50b8e30e76de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:26:14.574504 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa3dbda-790a-43be-961e-50b8e30e76de None admin] REQUEST_METHOD: `GET` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:26:14.574985 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa3dbda-790a-43be-961e-50b8e30e76de None admin] SCRIPT_NAME: `/identity` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:26:14.575494 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa3dbda-790a-43be-961e-50b8e30e76de None admin] PATH_INFO: `/v3/roles` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:26:14.576922 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfa3dbda-790a-43be-961e-50b8e30e76de None admin] RBAC: Adding query filter params (name=admin) {{(pid=207601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:26:14.577485 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfa3dbda-790a-43be-961e-50b8e30e76de None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:26:14.580101 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfa3dbda-790a-43be-961e-50b8e30e76de None admin] RBAC: Authorization granted {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:26:14.596804 dv-cinder-851351-1-smb devstack@keystone.service[207601]: [pid: 207601|app: 0|req: 592/1181] 10.222.0.42 () {56 vars in 1099 bytes} [Thu Jul 28 08:26:14 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:26:14.605844 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2274e5-ba62-4d07-8e2e-a25bc6c25533 None admin] Authenticating user token {{(pid=207600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:26:14.727167 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG dbcounter [-] [207600] Writing DB stats keystone:SELECT=100 {{(pid=207600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:26:14.735606 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2274e5-ba62-4d07-8e2e-a25bc6c25533 None admin] Validating token access rules against request {{(pid=207600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:26:14.780344 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d556d2-74b4-4b71-8445-f3356bd45f79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:26:14.781274 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d556d2-74b4-4b71-8445-f3356bd45f79 None admin] REQUEST_METHOD: `GET` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:26:14.781627 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d556d2-74b4-4b71-8445-f3356bd45f79 None admin] SCRIPT_NAME: `/identity` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:26:14.781948 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d556d2-74b4-4b71-8445-f3356bd45f79 None admin] PATH_INFO: `/v3/users/f659e419a7e1485c9591004df1885792` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:26:14.799001 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68d556d2-74b4-4b71-8445-f3356bd45f79 None admin] RBAC: Authorizing `identity:get_user(user_id=f659e419a7e1485c9591004df1885792)` {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:26:14.800580 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68d556d2-74b4-4b71-8445-f3356bd45f79 None admin] RBAC: Authorization granted {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:26:14.802398 dv-cinder-851351-1-smb devstack@keystone.service[207600]: [pid: 207600|app: 0|req: 590/1182] 10.222.0.42 () {56 vars in 1177 bytes} [Thu Jul 28 08:26:14 2022] GET /identity/v3/users/f659e419a7e1485c9591004df1885792 => generated 311 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:26:14.808836 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa3dbda-790a-43be-961e-50b8e30e76de None admin] Authenticating user token {{(pid=207601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:26:14.937440 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa3dbda-790a-43be-961e-50b8e30e76de None admin] Validating token access rules against request {{(pid=207601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:26:14.980006 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c651e6-c03e-4b08-a0b6-ef909029f44c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:26:14.980821 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c651e6-c03e-4b08-a0b6-ef909029f44c None admin] REQUEST_METHOD: `GET` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:26:14.980981 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c651e6-c03e-4b08-a0b6-ef909029f44c None admin] SCRIPT_NAME: `/identity` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:26:14.981201 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c651e6-c03e-4b08-a0b6-ef909029f44c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:26:15.052444 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG dbcounter [-] [207601] Writing DB stats keystone:SELECT=100 {{(pid=207601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:26:15.083271 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c651e6-c03e-4b08-a0b6-ef909029f44c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:26:15.084874 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c651e6-c03e-4b08-a0b6-ef909029f44c None admin] RBAC: Authorization granted {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:26:15.228390 dv-cinder-851351-1-smb devstack@keystone.service[207601]: [pid: 207601|app: 0|req: 593/1183] 10.222.0.42 () {58 vars in 1282 bytes} [Thu Jul 28 08:26:14 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 420 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jul 28 08:26:15.234800 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d556d2-74b4-4b71-8445-f3356bd45f79 None admin] Authenticating user token {{(pid=207600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:26:15.348137 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d556d2-74b4-4b71-8445-f3356bd45f79 None admin] Validating token access rules against request {{(pid=207600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:26:15.387497 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b18dbd6-efaf-4b70-a0c2-70460aa4f9ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:26:15.388166 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b18dbd6-efaf-4b70-a0c2-70460aa4f9ed None admin] REQUEST_METHOD: `GET` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:26:15.388447 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b18dbd6-efaf-4b70-a0c2-70460aa4f9ed None admin] SCRIPT_NAME: `/identity` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:26:15.388749 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b18dbd6-efaf-4b70-a0c2-70460aa4f9ed None admin] PATH_INFO: `/v3/projects/a9b9f1ec8db141b981f1b1d7a4422104` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:26:15.389987 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b18dbd6-efaf-4b70-a0c2-70460aa4f9ed None admin] RBAC: Authorizing `identity:get_project(project_id=a9b9f1ec8db141b981f1b1d7a4422104)` {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:26:15.391459 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b18dbd6-efaf-4b70-a0c2-70460aa4f9ed None admin] RBAC: Authorization granted {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:26:15.393227 dv-cinder-851351-1-smb devstack@keystone.service[207600]: [pid: 207600|app: 0|req: 591/1184] 10.222.0.42 () {56 vars in 1186 bytes} [Thu Jul 28 08:26:15 2022] GET /identity/v3/projects/a9b9f1ec8db141b981f1b1d7a4422104 => generated 361 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:26:15.399934 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c651e6-c03e-4b08-a0b6-ef909029f44c None admin] Authenticating user token {{(pid=207601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:26:15.484904 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG dbcounter [-] [207601] Writing DB stats keystone:SELECT=100 {{(pid=207601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:26:15.510364 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c651e6-c03e-4b08-a0b6-ef909029f44c None admin] Validating token access rules against request {{(pid=207601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:26:15.547177 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e898f82d-603e-4941-9792-5f7f551960b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:26:15.547828 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e898f82d-603e-4941-9792-5f7f551960b9 None admin] REQUEST_METHOD: `GET` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:26:15.548115 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e898f82d-603e-4941-9792-5f7f551960b9 None admin] SCRIPT_NAME: `/identity` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:26:15.548391 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e898f82d-603e-4941-9792-5f7f551960b9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:26:15.549235 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e898f82d-603e-4941-9792-5f7f551960b9 None admin] RBAC: Adding query filter params (role.id=d0ce88034c6b41878db755343f5840be, scope.project.id=a9b9f1ec8db141b981f1b1d7a4422104, user.id=f659e419a7e1485c9591004df1885792) {{(pid=207601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:26:15.549553 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e898f82d-603e-4941-9792-5f7f551960b9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:26:15.551014 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e898f82d-603e-4941-9792-5f7f551960b9 None admin] RBAC: Authorization granted {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:26:15.557569 dv-cinder-851351-1-smb devstack@keystone.service[207601]: [pid: 207601|app: 0|req: 594/1185] 10.222.0.42 () {56 vars in 1374 bytes} [Thu Jul 28 08:26:15 2022] GET /identity/v3/role_assignments?user.id=f659e419a7e1485c9591004df1885792&scope.project.id=a9b9f1ec8db141b981f1b1d7a4422104&role.id=d0ce88034c6b41878db755343f5840be => generated 259 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:26:17.574547 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7afed694-ea2d-4fb3-9aeb-a951af70a458 None None] REQUEST_METHOD: `GET` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:26:17.575211 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7afed694-ea2d-4fb3-9aeb-a951af70a458 None None] SCRIPT_NAME: `/identity` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:26:17.575211 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7afed694-ea2d-4fb3-9aeb-a951af70a458 None None] PATH_INFO: `/` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:26:17.576516 dv-cinder-851351-1-smb devstack@keystone.service[207600]: [pid: 207600|app: 0|req: 592/1186] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 08:26:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 08:26:17.582736 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c02872-cdfc-4e0e-8335-6e77ccb008ee None None] REQUEST_METHOD: `POST` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:26:17.583519 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c02872-cdfc-4e0e-8335-6e77ccb008ee None None] SCRIPT_NAME: `/identity` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:26:17.583519 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c02872-cdfc-4e0e-8335-6e77ccb008ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:26:17.605632 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.auth.core [None req-e5c02872-cdfc-4e0e-8335-6e77ccb008ee None None] MFA Rules not processed for user `b8110ade874c4aa7af27f5c376df700a`. Rule list: `[]` (Enabled: `True`). {{(pid=207601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 08:26:17.606905 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.fernet_utils [None req-e5c02872-cdfc-4e0e-8335-6e77ccb008ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=207601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:26:17.687892 dv-cinder-851351-1-smb devstack@keystone.service[207601]: [pid: 207601|app: 0|req: 595/1187] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 08:26:17 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 08:26:17.711361 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7afed694-ea2d-4fb3-9aeb-a951af70a458 None None] Authenticating user token {{(pid=207600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:26:17.739001 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG dbcounter [-] [207600] Writing DB stats keystone:SELECT=100 {{(pid=207600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:26:17.825885 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7afed694-ea2d-4fb3-9aeb-a951af70a458 None None] Validating token access rules against request {{(pid=207600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:26:17.864428 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aaf78f2-aab4-4ec9-9b16-372471d84838 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:26:17.865404 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aaf78f2-aab4-4ec9-9b16-372471d84838 None admin] REQUEST_METHOD: `GET` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:26:17.865781 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aaf78f2-aab4-4ec9-9b16-372471d84838 None admin] SCRIPT_NAME: `/identity` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:26:17.866148 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aaf78f2-aab4-4ec9-9b16-372471d84838 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:26:17.878335 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aaf78f2-aab4-4ec9-9b16-372471d84838 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 08:26:17.883546 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application [None req-7aaf78f2-aab4-4ec9-9b16-372471d84838 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 08:26:17.883546 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:26:17.883546 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:26:17.883546 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:26:17.883546 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:26:17.883546 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:26:17.883546 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:26:17.883546 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:26:17.883546 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:26:17.883546 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:26:17.883546 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:26:17.883546 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:26:17.883546 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 08:26:17.883546 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 08:26:17.883546 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 08:26:17.883546 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 08:26:17.884653 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 08:26:17.884653 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 08:26:17.884653 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 08:26:17.884653 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 08:26:17.884653 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:26:17.884653 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:26:17.884653 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:26:17.884653 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:26:17.884653 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:26:17.884653 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:26:17.884653 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:26:17.884653 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application with Lock( Jul 28 08:26:17.884653 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:26:17.884653 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:26:17.884653 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:26:17.884653 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:26:17.885701 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:26:17.885701 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:26:17.885701 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:26:17.885701 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:26:17.885701 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 08:26:17.885701 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 08:26:17.885701 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 08:26:17.885701 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 08:26:17.885701 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 08:26:17.885701 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 08:26:17.885701 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 08:26:17.885701 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application Jul 28 08:26:17.885701 dv-cinder-851351-1-smb devstack@keystone.service[207600]: [pid: 207600|app: 0|req: 593/1188] 10.222.0.42 () {56 vars in 1096 bytes} [Thu Jul 28 08:26:17 2022] GET /identity/v3/roles/admin => generated 83 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 08:26:17.891189 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c02872-cdfc-4e0e-8335-6e77ccb008ee None None] Authenticating user token {{(pid=207601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:26:17.966293 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG dbcounter [-] [207601] Writing DB stats keystone:SELECT=100 {{(pid=207601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:26:18.005289 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c02872-cdfc-4e0e-8335-6e77ccb008ee None None] Validating token access rules against request {{(pid=207601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:26:18.039972 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f3a8d5-d08b-482f-8e15-996647887e99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:26:18.040628 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f3a8d5-d08b-482f-8e15-996647887e99 None admin] REQUEST_METHOD: `GET` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:26:18.040981 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f3a8d5-d08b-482f-8e15-996647887e99 None admin] SCRIPT_NAME: `/identity` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:26:18.041260 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f3a8d5-d08b-482f-8e15-996647887e99 None admin] PATH_INFO: `/v3/roles` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:26:18.042029 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f3a8d5-d08b-482f-8e15-996647887e99 None admin] RBAC: Adding query filter params (name=admin) {{(pid=207601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:26:18.042341 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f3a8d5-d08b-482f-8e15-996647887e99 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:26:18.043803 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f3a8d5-d08b-482f-8e15-996647887e99 None admin] RBAC: Authorization granted {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:26:18.054192 dv-cinder-851351-1-smb devstack@keystone.service[207601]: [pid: 207601|app: 0|req: 596/1189] 10.222.0.42 () {56 vars in 1099 bytes} [Thu Jul 28 08:26:17 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:26:18.060798 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aaf78f2-aab4-4ec9-9b16-372471d84838 None admin] Authenticating user token {{(pid=207600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:26:18.161552 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG dbcounter [-] [207600] Writing DB stats keystone:SELECT=100 {{(pid=207600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:26:18.187919 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aaf78f2-aab4-4ec9-9b16-372471d84838 None admin] Validating token access rules against request {{(pid=207600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:26:18.237719 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98988744-9c5e-4a83-8218-64d6a4cb24fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:26:18.238766 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98988744-9c5e-4a83-8218-64d6a4cb24fa None admin] REQUEST_METHOD: `GET` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:26:18.239229 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98988744-9c5e-4a83-8218-64d6a4cb24fa None admin] SCRIPT_NAME: `/identity` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:26:18.239572 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98988744-9c5e-4a83-8218-64d6a4cb24fa None admin] PATH_INFO: `/v3/users/f659e419a7e1485c9591004df1885792` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:26:18.242856 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98988744-9c5e-4a83-8218-64d6a4cb24fa None admin] RBAC: Authorizing `identity:get_user(user_id=f659e419a7e1485c9591004df1885792)` {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:26:18.244974 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98988744-9c5e-4a83-8218-64d6a4cb24fa None admin] RBAC: Authorization granted {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:26:18.246742 dv-cinder-851351-1-smb devstack@keystone.service[207600]: [pid: 207600|app: 0|req: 594/1190] 10.222.0.42 () {56 vars in 1177 bytes} [Thu Jul 28 08:26:18 2022] GET /identity/v3/users/f659e419a7e1485c9591004df1885792 => generated 311 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:26:18.256360 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f3a8d5-d08b-482f-8e15-996647887e99 None admin] Authenticating user token {{(pid=207601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:26:18.418241 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f3a8d5-d08b-482f-8e15-996647887e99 None admin] Validating token access rules against request {{(pid=207601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:26:18.458097 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6681100-8a20-4770-8a89-c0a8d3c6ce9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:26:18.458869 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6681100-8a20-4770-8a89-c0a8d3c6ce9c None admin] REQUEST_METHOD: `GET` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:26:18.459150 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6681100-8a20-4770-8a89-c0a8d3c6ce9c None admin] SCRIPT_NAME: `/identity` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:26:18.459431 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6681100-8a20-4770-8a89-c0a8d3c6ce9c None admin] PATH_INFO: `/v3/projects/a9b9f1ec8db141b981f1b1d7a4422104` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:26:18.461031 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6681100-8a20-4770-8a89-c0a8d3c6ce9c None admin] RBAC: Authorizing `identity:get_project(project_id=a9b9f1ec8db141b981f1b1d7a4422104)` {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:26:18.462486 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6681100-8a20-4770-8a89-c0a8d3c6ce9c None admin] RBAC: Authorization granted {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:26:18.464272 dv-cinder-851351-1-smb devstack@keystone.service[207601]: [pid: 207601|app: 0|req: 597/1191] 10.222.0.42 () {56 vars in 1186 bytes} [Thu Jul 28 08:26:18 2022] GET /identity/v3/projects/a9b9f1ec8db141b981f1b1d7a4422104 => generated 361 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:26:18.470664 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98988744-9c5e-4a83-8218-64d6a4cb24fa None admin] Authenticating user token {{(pid=207600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:26:18.579949 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98988744-9c5e-4a83-8218-64d6a4cb24fa None admin] Validating token access rules against request {{(pid=207600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:26:18.621085 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9398b0f7-30e6-486b-b17a-713f32ff18da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:26:18.621792 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9398b0f7-30e6-486b-b17a-713f32ff18da None admin] REQUEST_METHOD: `PUT` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:26:18.622077 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9398b0f7-30e6-486b-b17a-713f32ff18da None admin] SCRIPT_NAME: `/identity` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:26:18.622352 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9398b0f7-30e6-486b-b17a-713f32ff18da None admin] PATH_INFO: `/v3/projects/a9b9f1ec8db141b981f1b1d7a4422104/users/f659e419a7e1485c9591004df1885792/roles/d0ce88034c6b41878db755343f5840be` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:26:18.624441 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9398b0f7-30e6-486b-b17a-713f32ff18da None admin] RBAC: Authorizing `identity:create_grant(project_id=a9b9f1ec8db141b981f1b1d7a4422104, user_id=f659e419a7e1485c9591004df1885792, role_id=d0ce88034c6b41878db755343f5840be)` {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:26:18.625984 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9398b0f7-30e6-486b-b17a-713f32ff18da None admin] RBAC: Authorization granted {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:26:18.641641 dv-cinder-851351-1-smb devstack@keystone.service[207600]: [pid: 207600|app: 0|req: 595/1192] 10.222.0.42 () {58 vars in 1439 bytes} [Thu Jul 28 08:26:18 2022] PUT /identity/v3/projects/a9b9f1ec8db141b981f1b1d7a4422104/users/f659e419a7e1485c9591004df1885792/roles/d0ce88034c6b41878db755343f5840be => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 28 08:26:20.758583 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002c1248-a9b0-432a-b952-b7ce47db246b None None] REQUEST_METHOD: `GET` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:26:20.759465 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002c1248-a9b0-432a-b952-b7ce47db246b None None] SCRIPT_NAME: `/identity` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:26:20.759465 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002c1248-a9b0-432a-b952-b7ce47db246b None None] PATH_INFO: `/` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:26:20.760512 dv-cinder-851351-1-smb devstack@keystone.service[207601]: [pid: 207601|app: 0|req: 598/1193] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 08:26:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 28 08:26:20.769297 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac505f8a-9b62-4b7d-8ea6-bc70a9be148f None None] REQUEST_METHOD: `POST` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:26:20.770074 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac505f8a-9b62-4b7d-8ea6-bc70a9be148f None None] SCRIPT_NAME: `/identity` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:26:20.770262 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac505f8a-9b62-4b7d-8ea6-bc70a9be148f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:26:20.793529 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.auth.core [None req-ac505f8a-9b62-4b7d-8ea6-bc70a9be148f None None] MFA Rules not processed for user `b8110ade874c4aa7af27f5c376df700a`. Rule list: `[]` (Enabled: `True`). {{(pid=207600) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 08:26:20.794827 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.fernet_utils [None req-ac505f8a-9b62-4b7d-8ea6-bc70a9be148f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=207600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:26:20.798150 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG dbcounter [-] [207600] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=207600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:26:20.896741 dv-cinder-851351-1-smb devstack@keystone.service[207600]: [pid: 207600|app: 0|req: 596/1194] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 08:26:20 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 08:26:20.921765 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002c1248-a9b0-432a-b952-b7ce47db246b None None] Authenticating user token {{(pid=207601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:26:20.926598 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG dbcounter [-] [207601] Writing DB stats keystone:SELECT=100 {{(pid=207601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:26:21.105207 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002c1248-a9b0-432a-b952-b7ce47db246b None None] Validating token access rules against request {{(pid=207601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:26:21.165277 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0b0ccc-b2fb-4eaa-a4f0-677692d439c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:26:21.166394 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0b0ccc-b2fb-4eaa-a4f0-677692d439c4 None admin] REQUEST_METHOD: `GET` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:26:21.166883 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0b0ccc-b2fb-4eaa-a4f0-677692d439c4 None admin] SCRIPT_NAME: `/identity` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:26:21.167337 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0b0ccc-b2fb-4eaa-a4f0-677692d439c4 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:26:21.186877 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb0b0ccc-b2fb-4eaa-a4f0-677692d439c4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 08:26:21.196466 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application [None req-eb0b0ccc-b2fb-4eaa-a4f0-677692d439c4 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 08:26:21.196466 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:26:21.196466 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:26:21.196466 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:26:21.196466 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:26:21.196466 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:26:21.196466 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:26:21.196466 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:26:21.196466 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:26:21.196466 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:26:21.196466 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:26:21.196466 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:26:21.196466 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 08:26:21.196466 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 08:26:21.196466 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 08:26:21.196466 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 08:26:21.197827 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 08:26:21.197827 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 08:26:21.197827 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 08:26:21.197827 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 08:26:21.197827 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:26:21.197827 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:26:21.197827 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:26:21.197827 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:26:21.197827 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:26:21.197827 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:26:21.197827 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:26:21.197827 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application with Lock( Jul 28 08:26:21.197827 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:26:21.197827 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:26:21.197827 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:26:21.197827 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:26:21.198953 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:26:21.198953 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:26:21.198953 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:26:21.198953 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:26:21.198953 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 08:26:21.198953 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 08:26:21.198953 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 08:26:21.198953 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 08:26:21.198953 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 08:26:21.198953 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 08:26:21.198953 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 08:26:21.198953 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application Jul 28 08:26:21.198953 dv-cinder-851351-1-smb devstack@keystone.service[207601]: [pid: 207601|app: 0|req: 599/1195] 10.222.0.42 () {56 vars in 1096 bytes} [Thu Jul 28 08:26:20 2022] GET /identity/v3/roles/admin => generated 83 bytes in 278 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:26:21.208998 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac505f8a-9b62-4b7d-8ea6-bc70a9be148f None None] Authenticating user token {{(pid=207600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:26:21.325310 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac505f8a-9b62-4b7d-8ea6-bc70a9be148f None None] Validating token access rules against request {{(pid=207600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:26:21.367170 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4338d7b-431c-4da7-b957-97aec03d0d67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:26:21.367714 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4338d7b-431c-4da7-b957-97aec03d0d67 None admin] REQUEST_METHOD: `GET` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:26:21.367997 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4338d7b-431c-4da7-b957-97aec03d0d67 None admin] SCRIPT_NAME: `/identity` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:26:21.368280 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4338d7b-431c-4da7-b957-97aec03d0d67 None admin] PATH_INFO: `/v3/roles` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:26:21.369072 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4338d7b-431c-4da7-b957-97aec03d0d67 None admin] RBAC: Adding query filter params (name=admin) {{(pid=207600) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:26:21.369386 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4338d7b-431c-4da7-b957-97aec03d0d67 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:26:21.370813 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4338d7b-431c-4da7-b957-97aec03d0d67 None admin] RBAC: Authorization granted {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:26:21.381021 dv-cinder-851351-1-smb devstack@keystone.service[207600]: [pid: 207600|app: 0|req: 597/1196] 10.222.0.42 () {56 vars in 1099 bytes} [Thu Jul 28 08:26:21 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:26:21.387814 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0b0ccc-b2fb-4eaa-a4f0-677692d439c4 None admin] Authenticating user token {{(pid=207601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:26:21.480258 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG dbcounter [-] [207601] Writing DB stats keystone:SELECT=100 {{(pid=207601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:26:21.526332 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0b0ccc-b2fb-4eaa-a4f0-677692d439c4 None admin] Validating token access rules against request {{(pid=207601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:26:21.565771 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b59f73-4ef3-426e-80bd-e09b1f7b8e4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:26:21.566453 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b59f73-4ef3-426e-80bd-e09b1f7b8e4d None admin] REQUEST_METHOD: `GET` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:26:21.566734 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b59f73-4ef3-426e-80bd-e09b1f7b8e4d None admin] SCRIPT_NAME: `/identity` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:26:21.567005 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b59f73-4ef3-426e-80bd-e09b1f7b8e4d None admin] PATH_INFO: `/v3/users/f659e419a7e1485c9591004df1885792` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:26:21.568397 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10b59f73-4ef3-426e-80bd-e09b1f7b8e4d None admin] RBAC: Authorizing `identity:get_user(user_id=f659e419a7e1485c9591004df1885792)` {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:26:21.569928 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10b59f73-4ef3-426e-80bd-e09b1f7b8e4d None admin] RBAC: Authorization granted {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:26:21.571658 dv-cinder-851351-1-smb devstack@keystone.service[207601]: [pid: 207601|app: 0|req: 600/1197] 10.222.0.42 () {56 vars in 1177 bytes} [Thu Jul 28 08:26:21 2022] GET /identity/v3/users/f659e419a7e1485c9591004df1885792 => generated 311 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 08:26:21.577998 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4338d7b-431c-4da7-b957-97aec03d0d67 None admin] Authenticating user token {{(pid=207600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:26:21.581143 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG dbcounter [-] [207600] Writing DB stats keystone:SELECT=100 {{(pid=207600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:26:21.697194 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4338d7b-431c-4da7-b957-97aec03d0d67 None admin] Validating token access rules against request {{(pid=207600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:26:21.735260 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f16b0b-3248-4bc3-9793-c09a688b20d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:26:21.735903 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f16b0b-3248-4bc3-9793-c09a688b20d2 None admin] REQUEST_METHOD: `GET` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:26:21.736187 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f16b0b-3248-4bc3-9793-c09a688b20d2 None admin] SCRIPT_NAME: `/identity` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:26:21.736456 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f16b0b-3248-4bc3-9793-c09a688b20d2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:26:21.810901 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91f16b0b-3248-4bc3-9793-c09a688b20d2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:26:21.812386 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91f16b0b-3248-4bc3-9793-c09a688b20d2 None admin] RBAC: Authorization granted {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:26:21.814576 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG dbcounter [-] [207600] Writing DB stats keystone:SELECT=100 {{(pid=207600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:26:21.928092 dv-cinder-851351-1-smb devstack@keystone.service[207600]: [pid: 207600|app: 0|req: 598/1198] 10.222.0.42 () {58 vars in 1282 bytes} [Thu Jul 28 08:26:21 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 351 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 28 08:26:21.934829 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b59f73-4ef3-426e-80bd-e09b1f7b8e4d None admin] Authenticating user token {{(pid=207601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:26:22.060776 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b59f73-4ef3-426e-80bd-e09b1f7b8e4d None admin] Validating token access rules against request {{(pid=207601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:26:22.092838 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG dbcounter [-] [207601] Writing DB stats keystone:SELECT=100 {{(pid=207601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:26:22.100614 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6811080b-c107-413e-85e7-32fbc537032f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:26:22.101393 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6811080b-c107-413e-85e7-32fbc537032f None admin] REQUEST_METHOD: `GET` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:26:22.101722 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6811080b-c107-413e-85e7-32fbc537032f None admin] SCRIPT_NAME: `/identity` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:26:22.102038 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6811080b-c107-413e-85e7-32fbc537032f None admin] PATH_INFO: `/v3/projects/a9b9f1ec8db141b981f1b1d7a4422104` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:26:22.103332 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6811080b-c107-413e-85e7-32fbc537032f None admin] RBAC: Authorizing `identity:get_project(project_id=a9b9f1ec8db141b981f1b1d7a4422104)` {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:26:22.104942 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6811080b-c107-413e-85e7-32fbc537032f None admin] RBAC: Authorization granted {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:26:22.106715 dv-cinder-851351-1-smb devstack@keystone.service[207601]: [pid: 207601|app: 0|req: 601/1199] 10.222.0.42 () {56 vars in 1186 bytes} [Thu Jul 28 08:26:21 2022] GET /identity/v3/projects/a9b9f1ec8db141b981f1b1d7a4422104 => generated 361 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 08:26:22.113504 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f16b0b-3248-4bc3-9793-c09a688b20d2 None admin] Authenticating user token {{(pid=207600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:26:22.223749 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f16b0b-3248-4bc3-9793-c09a688b20d2 None admin] Validating token access rules against request {{(pid=207600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:26:22.225602 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG dbcounter [-] [207600] Writing DB stats keystone:SELECT=100 {{(pid=207600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:26:22.264159 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e312d2-36be-4bd8-9d8b-b73d7f9d54de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:26:22.264829 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e312d2-36be-4bd8-9d8b-b73d7f9d54de None admin] REQUEST_METHOD: `GET` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:26:22.265110 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e312d2-36be-4bd8-9d8b-b73d7f9d54de None admin] SCRIPT_NAME: `/identity` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:26:22.265393 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e312d2-36be-4bd8-9d8b-b73d7f9d54de None admin] PATH_INFO: `/v3/role_assignments` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:26:22.266207 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2e312d2-36be-4bd8-9d8b-b73d7f9d54de None admin] RBAC: Adding query filter params (role.id=d0ce88034c6b41878db755343f5840be, scope.project.id=a9b9f1ec8db141b981f1b1d7a4422104, user.id=f659e419a7e1485c9591004df1885792) {{(pid=207600) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:26:22.266519 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2e312d2-36be-4bd8-9d8b-b73d7f9d54de None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:26:22.267987 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2e312d2-36be-4bd8-9d8b-b73d7f9d54de None admin] RBAC: Authorization granted {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:26:22.275046 dv-cinder-851351-1-smb devstack@keystone.service[207600]: [pid: 207600|app: 0|req: 599/1200] 10.222.0.42 () {56 vars in 1374 bytes} [Thu Jul 28 08:26:22 2022] GET /identity/v3/role_assignments?user.id=f659e419a7e1485c9591004df1885792&scope.project.id=a9b9f1ec8db141b981f1b1d7a4422104&role.id=d0ce88034c6b41878db755343f5840be => generated 608 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:26:32.098341 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG dbcounter [-] [207601] Writing DB stats keystone:SELECT=1 {{(pid=207601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:26:32.271916 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG dbcounter [-] [207600] Writing DB stats keystone:SELECT=17 {{(pid=207600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:27:21.143634 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459cd7bf-4fa4-43e7-99ab-1088333c37b5 None None] REQUEST_METHOD: `GET` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:27:21.144613 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459cd7bf-4fa4-43e7-99ab-1088333c37b5 None None] SCRIPT_NAME: `/identity` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:27:21.144613 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459cd7bf-4fa4-43e7-99ab-1088333c37b5 None None] PATH_INFO: `/` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:27:21.148734 dv-cinder-851351-1-smb devstack@keystone.service[207601]: [pid: 207601|app: 0|req: 602/1201] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 08:27:21 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 08:27:21.157224 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59ec12a-cbb5-4ad3-9462-cfea11676bfb None None] REQUEST_METHOD: `POST` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:27:21.158063 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59ec12a-cbb5-4ad3-9462-cfea11676bfb None None] SCRIPT_NAME: `/identity` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:27:21.158063 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59ec12a-cbb5-4ad3-9462-cfea11676bfb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:27:21.194029 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.auth.core [None req-b59ec12a-cbb5-4ad3-9462-cfea11676bfb None None] MFA Rules not processed for user `b8110ade874c4aa7af27f5c376df700a`. Rule list: `[]` (Enabled: `True`). {{(pid=207600) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 08:27:21.196318 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.fernet_utils [None req-b59ec12a-cbb5-4ad3-9462-cfea11676bfb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=207600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:27:21.319960 dv-cinder-851351-1-smb devstack@keystone.service[207600]: [pid: 207600|app: 0|req: 600/1202] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 08:27:21 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 08:27:21.354047 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-459cd7bf-4fa4-43e7-99ab-1088333c37b5 None None] Authenticating user token {{(pid=207601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:27:21.552337 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-459cd7bf-4fa4-43e7-99ab-1088333c37b5 None None] Validating token access rules against request {{(pid=207601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:27:21.623977 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fdc131c-fed7-4c02-a79a-7113496686b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:27:21.624928 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fdc131c-fed7-4c02-a79a-7113496686b4 None admin] REQUEST_METHOD: `GET` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:27:21.625340 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fdc131c-fed7-4c02-a79a-7113496686b4 None admin] SCRIPT_NAME: `/identity` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:27:21.625806 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fdc131c-fed7-4c02-a79a-7113496686b4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:27:21.642239 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fdc131c-fed7-4c02-a79a-7113496686b4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:27:21.644426 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fdc131c-fed7-4c02-a79a-7113496686b4 None admin] RBAC: Authorization granted {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:27:21.665791 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application [None req-5fdc131c-fed7-4c02-a79a-7113496686b4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 08:27:21.665791 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:27:21.665791 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:27:21.665791 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:27:21.665791 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:27:21.665791 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:27:21.665791 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:27:21.665791 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:27:21.665791 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:27:21.665791 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:27:21.665791 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:27:21.665791 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:27:21.665791 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 08:27:21.665791 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 08:27:21.665791 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 08:27:21.668942 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 08:27:21.668942 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:27:21.668942 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:27:21.668942 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:27:21.668942 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:27:21.668942 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:27:21.668942 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:27:21.668942 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:27:21.668942 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application with Lock( Jul 28 08:27:21.668942 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:27:21.668942 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:27:21.668942 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:27:21.668942 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:27:21.668942 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:27:21.668942 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:27:21.668942 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:27:21.668942 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:27:21.671019 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 08:27:21.671019 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 08:27:21.671019 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 08:27:21.671019 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application Jul 28 08:27:21.671019 dv-cinder-851351-1-smb devstack@keystone.service[207601]: [pid: 207601|app: 0|req: 603/1203] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 08:27:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 315 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:27:21.675880 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b59ec12a-cbb5-4ad3-9462-cfea11676bfb None None] Authenticating user token {{(pid=207600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:27:21.836272 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b59ec12a-cbb5-4ad3-9462-cfea11676bfb None None] Validating token access rules against request {{(pid=207600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:27:21.879851 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG dbcounter [-] [207600] Writing DB stats keystone:SELECT=100 {{(pid=207600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:27:21.889538 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b13b376-8954-46f7-b81e-ec88d350a8cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:27:21.890292 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b13b376-8954-46f7-b81e-ec88d350a8cf None admin] REQUEST_METHOD: `GET` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:27:21.891129 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b13b376-8954-46f7-b81e-ec88d350a8cf None admin] SCRIPT_NAME: `/identity` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:27:21.898931 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b13b376-8954-46f7-b81e-ec88d350a8cf None admin] PATH_INFO: `/v3/domains` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:27:21.900359 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b13b376-8954-46f7-b81e-ec88d350a8cf None admin] RBAC: Adding query filter params (name=Default) {{(pid=207600) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:27:21.900924 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b13b376-8954-46f7-b81e-ec88d350a8cf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:27:21.902965 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b13b376-8954-46f7-b81e-ec88d350a8cf None admin] RBAC: Authorization granted {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:27:21.924174 dv-cinder-851351-1-smb devstack@keystone.service[207600]: [pid: 207600|app: 0|req: 601/1204] 10.222.0.42 () {56 vars in 1109 bytes} [Thu Jul 28 08:27:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 08:27:21.932046 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fdc131c-fed7-4c02-a79a-7113496686b4 None admin] Authenticating user token {{(pid=207601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:27:22.010864 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG dbcounter [-] [207601] Writing DB stats keystone:SELECT=100 {{(pid=207601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:27:22.076857 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fdc131c-fed7-4c02-a79a-7113496686b4 None admin] Validating token access rules against request {{(pid=207601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:27:22.138669 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb94b3b-baaa-4be5-bd5d-6c936c38b266 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:27:22.139228 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb94b3b-baaa-4be5-bd5d-6c936c38b266 None admin] REQUEST_METHOD: `POST` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:27:22.139530 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb94b3b-baaa-4be5-bd5d-6c936c38b266 None admin] SCRIPT_NAME: `/identity` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:27:22.139807 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb94b3b-baaa-4be5-bd5d-6c936c38b266 None admin] PATH_INFO: `/v3/users` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:27:22.140642 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb94b3b-baaa-4be5-bd5d-6c936c38b266 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:27:22.142899 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb94b3b-baaa-4be5-bd5d-6c936c38b266 None admin] RBAC: Authorization granted {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:27:22.170004 dv-cinder-851351-1-smb devstack@keystone.service[207601]: [pid: 207601|app: 0|req: 604/1205] 10.222.0.42 () {60 vars in 1132 bytes} [Thu Jul 28 08:27:21 2022] POST /identity/v3/users => generated 251 bytes in 238 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 08:27:24.592550 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d8b617-8879-4182-b110-e364b07dcd62 None None] REQUEST_METHOD: `GET` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:27:24.593198 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d8b617-8879-4182-b110-e364b07dcd62 None None] SCRIPT_NAME: `/identity` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:27:24.593301 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d8b617-8879-4182-b110-e364b07dcd62 None None] PATH_INFO: `/` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:27:24.594827 dv-cinder-851351-1-smb devstack@keystone.service[207600]: [pid: 207600|app: 0|req: 602/1206] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 08:27:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 08:27:24.601843 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3aeeca-54fe-416b-896a-3f859420fe12 None None] REQUEST_METHOD: `POST` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:27:24.602511 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3aeeca-54fe-416b-896a-3f859420fe12 None None] SCRIPT_NAME: `/identity` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:27:24.602760 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3aeeca-54fe-416b-896a-3f859420fe12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:27:24.631748 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.auth.core [None req-1a3aeeca-54fe-416b-896a-3f859420fe12 None None] MFA Rules not processed for user `b8110ade874c4aa7af27f5c376df700a`. Rule list: `[]` (Enabled: `True`). {{(pid=207601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 08:27:24.633256 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.fernet_utils [None req-1a3aeeca-54fe-416b-896a-3f859420fe12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=207601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:27:24.751410 dv-cinder-851351-1-smb devstack@keystone.service[207601]: [pid: 207601|app: 0|req: 605/1207] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 08:27:24 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 08:27:24.775262 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d8b617-8879-4182-b110-e364b07dcd62 None None] Authenticating user token {{(pid=207600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:27:24.967453 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d8b617-8879-4182-b110-e364b07dcd62 None None] Validating token access rules against request {{(pid=207600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:27:25.035445 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f1ac52-7158-4a04-95d9-550e4fa8e98b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:27:25.036186 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f1ac52-7158-4a04-95d9-550e4fa8e98b None admin] REQUEST_METHOD: `GET` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:27:25.036456 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f1ac52-7158-4a04-95d9-550e4fa8e98b None admin] SCRIPT_NAME: `/identity` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:27:25.036777 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f1ac52-7158-4a04-95d9-550e4fa8e98b None admin] PATH_INFO: `/v3/roles/service` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:27:25.053793 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2f1ac52-7158-4a04-95d9-550e4fa8e98b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 08:27:25.062481 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application [None req-e2f1ac52-7158-4a04-95d9-550e4fa8e98b None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 28 08:27:25.062481 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:27:25.062481 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:27:25.062481 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:27:25.062481 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:27:25.062481 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:27:25.062481 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:27:25.062481 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:27:25.062481 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:27:25.062481 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:27:25.062481 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:27:25.062481 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:27:25.062481 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 08:27:25.062481 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 08:27:25.062481 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 08:27:25.062481 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 08:27:25.064553 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 08:27:25.064553 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 08:27:25.064553 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 08:27:25.064553 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 08:27:25.064553 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:27:25.064553 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:27:25.064553 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:27:25.064553 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:27:25.064553 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:27:25.064553 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:27:25.064553 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:27:25.064553 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application with Lock( Jul 28 08:27:25.064553 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:27:25.064553 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:27:25.064553 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:27:25.064553 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:27:25.066493 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:27:25.066493 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:27:25.066493 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:27:25.066493 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:27:25.066493 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 08:27:25.066493 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 08:27:25.066493 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 08:27:25.066493 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 08:27:25.066493 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 08:27:25.066493 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 08:27:25.066493 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 28 08:27:25.066493 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application Jul 28 08:27:25.069498 dv-cinder-851351-1-smb devstack@keystone.service[207600]: [pid: 207600|app: 0|req: 603/1208] 10.222.0.42 () {56 vars in 1102 bytes} [Thu Jul 28 08:27:24 2022] GET /identity/v3/roles/service => generated 85 bytes in 294 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 08:27:25.071434 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3aeeca-54fe-416b-896a-3f859420fe12 None None] Authenticating user token {{(pid=207601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:27:25.138076 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG dbcounter [-] [207601] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=207601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:27:25.228339 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3aeeca-54fe-416b-896a-3f859420fe12 None None] Validating token access rules against request {{(pid=207601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:27:25.271104 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc6a7dd9-e954-496f-91e8-20e636b3b03d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:27:25.271776 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6a7dd9-e954-496f-91e8-20e636b3b03d None admin] REQUEST_METHOD: `GET` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:27:25.272061 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6a7dd9-e954-496f-91e8-20e636b3b03d None admin] SCRIPT_NAME: `/identity` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:27:25.272341 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6a7dd9-e954-496f-91e8-20e636b3b03d None admin] PATH_INFO: `/v3/roles` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:27:25.273285 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc6a7dd9-e954-496f-91e8-20e636b3b03d None admin] RBAC: Adding query filter params (name=service) {{(pid=207601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:27:25.273742 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc6a7dd9-e954-496f-91e8-20e636b3b03d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:27:25.275416 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc6a7dd9-e954-496f-91e8-20e636b3b03d None admin] RBAC: Authorization granted {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:27:25.293381 dv-cinder-851351-1-smb devstack@keystone.service[207601]: [pid: 207601|app: 0|req: 606/1209] 10.222.0.42 () {56 vars in 1103 bytes} [Thu Jul 28 08:27:25 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 08:27:25.302058 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f1ac52-7158-4a04-95d9-550e4fa8e98b None admin] Authenticating user token {{(pid=207600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:27:25.396022 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG dbcounter [-] [207600] Writing DB stats keystone:SELECT=100 {{(pid=207600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:27:25.500371 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f1ac52-7158-4a04-95d9-550e4fa8e98b None admin] Validating token access rules against request {{(pid=207600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:27:25.566512 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e686b9d9-7af5-4a9f-91b1-fa14b02fe214 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:27:25.567584 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e686b9d9-7af5-4a9f-91b1-fa14b02fe214 None admin] REQUEST_METHOD: `GET` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:27:25.567972 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e686b9d9-7af5-4a9f-91b1-fa14b02fe214 None admin] SCRIPT_NAME: `/identity` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:27:25.568344 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e686b9d9-7af5-4a9f-91b1-fa14b02fe214 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:27:25.589702 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e686b9d9-7af5-4a9f-91b1-fa14b02fe214 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:27:25.593035 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e686b9d9-7af5-4a9f-91b1-fa14b02fe214 None admin] RBAC: Authorization granted {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:27:25.614077 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application [None req-e686b9d9-7af5-4a9f-91b1-fa14b02fe214 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 08:27:25.614077 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:27:25.614077 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:27:25.614077 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:27:25.614077 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:27:25.614077 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:27:25.614077 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:27:25.614077 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:27:25.614077 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:27:25.614077 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:27:25.614077 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:27:25.614077 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:27:25.614077 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 08:27:25.614077 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 08:27:25.614077 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 08:27:25.616033 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 08:27:25.616033 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:27:25.616033 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:27:25.616033 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:27:25.616033 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:27:25.616033 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:27:25.616033 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:27:25.616033 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:27:25.616033 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application with Lock( Jul 28 08:27:25.616033 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:27:25.616033 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:27:25.616033 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:27:25.616033 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:27:25.616033 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:27:25.616033 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:27:25.616033 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:27:25.616033 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:27:25.617943 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 08:27:25.617943 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 08:27:25.617943 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 08:27:25.617943 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application Jul 28 08:27:25.617943 dv-cinder-851351-1-smb devstack@keystone.service[207600]: [pid: 207600|app: 0|req: 604/1210] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 08:27:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 315 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:27:25.623196 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc6a7dd9-e954-496f-91e8-20e636b3b03d None admin] Authenticating user token {{(pid=207601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:27:25.779359 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG dbcounter [-] [207601] Writing DB stats keystone:SELECT=100 {{(pid=207601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:27:25.784297 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc6a7dd9-e954-496f-91e8-20e636b3b03d None admin] Validating token access rules against request {{(pid=207601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:27:25.841874 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598986ab-ae95-405b-89ec-7d8810147373 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:27:25.842729 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598986ab-ae95-405b-89ec-7d8810147373 None admin] REQUEST_METHOD: `GET` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:27:25.843278 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598986ab-ae95-405b-89ec-7d8810147373 None admin] SCRIPT_NAME: `/identity` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:27:25.843545 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598986ab-ae95-405b-89ec-7d8810147373 None admin] PATH_INFO: `/v3/domains` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:27:25.844612 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-598986ab-ae95-405b-89ec-7d8810147373 None admin] RBAC: Adding query filter params (name=Default) {{(pid=207601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:27:25.845129 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-598986ab-ae95-405b-89ec-7d8810147373 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:27:25.846959 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-598986ab-ae95-405b-89ec-7d8810147373 None admin] RBAC: Authorization granted {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:27:25.866163 dv-cinder-851351-1-smb devstack@keystone.service[207601]: [pid: 207601|app: 0|req: 607/1211] 10.222.0.42 () {56 vars in 1109 bytes} [Thu Jul 28 08:27:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 08:27:25.877075 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e686b9d9-7af5-4a9f-91b1-fa14b02fe214 None admin] Authenticating user token {{(pid=207600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:27:26.066457 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e686b9d9-7af5-4a9f-91b1-fa14b02fe214 None admin] Validating token access rules against request {{(pid=207600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:27:26.068456 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG dbcounter [-] [207600] Writing DB stats keystone:SELECT=100 {{(pid=207600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:27:26.131786 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15d2590-249d-4f7e-8855-f5d767b90791 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:27:26.132930 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15d2590-249d-4f7e-8855-f5d767b90791 None admin] REQUEST_METHOD: `GET` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:27:26.133393 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15d2590-249d-4f7e-8855-f5d767b90791 None admin] SCRIPT_NAME: `/identity` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:27:26.133849 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15d2590-249d-4f7e-8855-f5d767b90791 None admin] PATH_INFO: `/v3/users/placement` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:27:26.149406 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d15d2590-249d-4f7e-8855-f5d767b90791 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:27:26.152090 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d15d2590-249d-4f7e-8855-f5d767b90791 None admin] RBAC: Authorization granted {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:27:26.175383 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application [None req-d15d2590-249d-4f7e-8855-f5d767b90791 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 28 08:27:26.175383 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:27:26.175383 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:27:26.175383 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:27:26.175383 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:27:26.175383 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:27:26.175383 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:27:26.175383 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:27:26.175383 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:27:26.175383 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:27:26.175383 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:27:26.175383 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:27:26.175383 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 28 08:27:26.175383 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 28 08:27:26.175383 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 28 08:27:26.175383 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 28 08:27:26.176759 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:27:26.176759 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:27:26.176759 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 28 08:27:26.176759 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 08:27:26.176759 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 28 08:27:26.176759 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 08:27:26.176759 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:27:26.176759 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:27:26.176759 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:27:26.176759 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:27:26.176759 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:27:26.176759 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application with Lock( Jul 28 08:27:26.176759 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:27:26.176759 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:27:26.176759 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:27:26.176759 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:27:26.176759 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:27:26.176759 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:27:26.178026 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:27:26.178026 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:27:26.178026 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 28 08:27:26.178026 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 28 08:27:26.178026 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 28 08:27:26.178026 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 28 08:27:26.178026 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 28 08:27:26.178026 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 28 08:27:26.178026 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 28 08:27:26.178026 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application Jul 28 08:27:26.184940 dv-cinder-851351-1-smb devstack@keystone.service[207600]: [pid: 207600|app: 0|req: 605/1212] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 08:27:25 2022] GET /identity/v3/users/placement => generated 87 bytes in 309 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:27:26.187326 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598986ab-ae95-405b-89ec-7d8810147373 None admin] Authenticating user token {{(pid=207601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:27:26.348190 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598986ab-ae95-405b-89ec-7d8810147373 None admin] Validating token access rules against request {{(pid=207601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:27:26.409250 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d451bb7-e158-4951-a329-051babde5690 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:27:26.410552 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d451bb7-e158-4951-a329-051babde5690 None admin] REQUEST_METHOD: `GET` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:27:26.411220 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d451bb7-e158-4951-a329-051babde5690 None admin] SCRIPT_NAME: `/identity` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:27:26.411913 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d451bb7-e158-4951-a329-051babde5690 None admin] PATH_INFO: `/v3/users` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:27:26.413570 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d451bb7-e158-4951-a329-051babde5690 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=207601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:27:26.414232 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d451bb7-e158-4951-a329-051babde5690 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:27:26.417044 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d451bb7-e158-4951-a329-051babde5690 None admin] RBAC: Authorization granted {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:27:26.453950 dv-cinder-851351-1-smb devstack@keystone.service[207601]: [pid: 207601|app: 0|req: 608/1213] 10.222.0.42 () {56 vars in 1143 bytes} [Thu Jul 28 08:27:26 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 08:27:26.472351 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15d2590-249d-4f7e-8855-f5d767b90791 None admin] Authenticating user token {{(pid=207600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:27:26.645037 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15d2590-249d-4f7e-8855-f5d767b90791 None admin] Validating token access rules against request {{(pid=207600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:27:26.688502 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-914301ed-6aca-4124-b0fc-14ff1c463fbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:27:26.689215 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914301ed-6aca-4124-b0fc-14ff1c463fbb None admin] REQUEST_METHOD: `GET` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:27:26.689501 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914301ed-6aca-4124-b0fc-14ff1c463fbb None admin] SCRIPT_NAME: `/identity` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:27:26.689777 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914301ed-6aca-4124-b0fc-14ff1c463fbb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:27:26.734047 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG dbcounter [-] [207600] Writing DB stats keystone:SELECT=100 {{(pid=207600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:27:26.788864 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-914301ed-6aca-4124-b0fc-14ff1c463fbb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:27:26.789241 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-914301ed-6aca-4124-b0fc-14ff1c463fbb None admin] RBAC: Authorization granted {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:27:26.929481 dv-cinder-851351-1-smb devstack@keystone.service[207600]: [pid: 207600|app: 0|req: 606/1214] 10.222.0.42 () {58 vars in 1282 bytes} [Thu Jul 28 08:27:26 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 458 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 28 08:27:26.936005 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d451bb7-e158-4951-a329-051babde5690 None admin] Authenticating user token {{(pid=207601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:27:26.962214 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG dbcounter [-] [207601] Writing DB stats keystone:SELECT=100 {{(pid=207601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:27:27.076580 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d451bb7-e158-4951-a329-051babde5690 None admin] Validating token access rules against request {{(pid=207601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:27:27.132330 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9851335b-c7c9-46fa-8170-d4931b4a8c64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:27:27.133145 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9851335b-c7c9-46fa-8170-d4931b4a8c64 None admin] REQUEST_METHOD: `GET` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:27:27.133460 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9851335b-c7c9-46fa-8170-d4931b4a8c64 None admin] SCRIPT_NAME: `/identity` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:27:27.133800 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9851335b-c7c9-46fa-8170-d4931b4a8c64 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:27:27.148390 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9851335b-c7c9-46fa-8170-d4931b4a8c64 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:27:27.152135 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9851335b-c7c9-46fa-8170-d4931b4a8c64 None admin] RBAC: Authorization granted {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:27:27.170762 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application [None req-9851335b-c7c9-46fa-8170-d4931b4a8c64 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 08:27:27.170762 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:27:27.170762 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:27:27.170762 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:27:27.170762 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:27:27.170762 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:27:27.170762 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:27:27.170762 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:27:27.170762 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:27:27.170762 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:27:27.170762 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:27:27.170762 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:27:27.170762 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 08:27:27.170762 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 08:27:27.170762 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 08:27:27.181262 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 08:27:27.181262 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:27:27.181262 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:27:27.181262 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:27:27.181262 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:27:27.181262 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:27:27.181262 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:27:27.181262 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:27:27.181262 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application with Lock( Jul 28 08:27:27.181262 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:27:27.181262 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:27:27.181262 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:27:27.181262 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:27:27.181262 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:27:27.181262 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:27:27.181262 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:27:27.181262 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:27:27.183596 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 08:27:27.183596 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 08:27:27.183596 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 08:27:27.183596 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application Jul 28 08:27:27.183596 dv-cinder-851351-1-smb devstack@keystone.service[207601]: [pid: 207601|app: 0|req: 609/1215] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 08:27:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 08:27:27.184300 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-914301ed-6aca-4124-b0fc-14ff1c463fbb None admin] Authenticating user token {{(pid=207600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:27:27.284610 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG dbcounter [-] [207600] Writing DB stats keystone:SELECT=100 {{(pid=207600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:27:27.351132 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-914301ed-6aca-4124-b0fc-14ff1c463fbb None admin] Validating token access rules against request {{(pid=207600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:27:27.402000 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13bdfe16-85bb-4db1-8dc9-ccd136615d07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:27:27.402918 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13bdfe16-85bb-4db1-8dc9-ccd136615d07 None admin] REQUEST_METHOD: `GET` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:27:27.403278 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13bdfe16-85bb-4db1-8dc9-ccd136615d07 None admin] SCRIPT_NAME: `/identity` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:27:27.403788 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13bdfe16-85bb-4db1-8dc9-ccd136615d07 None admin] PATH_INFO: `/v3/domains` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:27:27.404658 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13bdfe16-85bb-4db1-8dc9-ccd136615d07 None admin] RBAC: Adding query filter params (name=Default) {{(pid=207600) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:27:27.405092 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13bdfe16-85bb-4db1-8dc9-ccd136615d07 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:27:27.406919 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13bdfe16-85bb-4db1-8dc9-ccd136615d07 None admin] RBAC: Authorization granted {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:27:27.422675 dv-cinder-851351-1-smb devstack@keystone.service[207600]: [pid: 207600|app: 0|req: 607/1216] 10.222.0.42 () {56 vars in 1109 bytes} [Thu Jul 28 08:27:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 08:27:27.430337 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9851335b-c7c9-46fa-8170-d4931b4a8c64 None admin] Authenticating user token {{(pid=207601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:27:27.527020 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG dbcounter [-] [207601] Writing DB stats keystone:SELECT=100 {{(pid=207601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:27:27.574361 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9851335b-c7c9-46fa-8170-d4931b4a8c64 None admin] Validating token access rules against request {{(pid=207601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:27:27.614388 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1889d0ac-4b38-49e4-9e26-93aeb5259f4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:27:27.615100 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1889d0ac-4b38-49e4-9e26-93aeb5259f4a None admin] REQUEST_METHOD: `GET` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:27:27.615369 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1889d0ac-4b38-49e4-9e26-93aeb5259f4a None admin] SCRIPT_NAME: `/identity` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:27:27.615647 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1889d0ac-4b38-49e4-9e26-93aeb5259f4a None admin] PATH_INFO: `/v3/projects/service` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:27:27.624638 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1889d0ac-4b38-49e4-9e26-93aeb5259f4a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:27:27.627058 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1889d0ac-4b38-49e4-9e26-93aeb5259f4a None admin] RBAC: Authorization granted {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:27:27.646675 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application [None req-1889d0ac-4b38-49e4-9e26-93aeb5259f4a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 08:27:27.646675 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:27:27.646675 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:27:27.646675 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:27:27.646675 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:27:27.646675 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:27:27.646675 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:27:27.646675 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:27:27.646675 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:27:27.646675 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:27:27.646675 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:27:27.646675 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:27:27.646675 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 28 08:27:27.646675 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 28 08:27:27.646675 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 28 08:27:27.648626 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 28 08:27:27.648626 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:27:27.648626 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:27:27.648626 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:27:27.648626 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:27:27.648626 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:27:27.648626 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:27:27.648626 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:27:27.648626 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application with Lock( Jul 28 08:27:27.648626 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:27:27.648626 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:27:27.648626 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:27:27.648626 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:27:27.648626 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:27:27.648626 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:27:27.648626 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:27:27.648626 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:27:27.650295 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 28 08:27:27.650295 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 28 08:27:27.650295 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 28 08:27:27.650295 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 28 08:27:27.650295 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 28 08:27:27.650295 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 28 08:27:27.650295 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 08:27:27.650295 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application Jul 28 08:27:27.650295 dv-cinder-851351-1-smb devstack@keystone.service[207601]: [pid: 207601|app: 0|req: 610/1217] 10.222.0.42 () {56 vars in 1111 bytes} [Thu Jul 28 08:27:27 2022] GET /identity/v3/projects/service => generated 88 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:27:27.655400 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13bdfe16-85bb-4db1-8dc9-ccd136615d07 None admin] Authenticating user token {{(pid=207600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:27:27.821563 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13bdfe16-85bb-4db1-8dc9-ccd136615d07 None admin] Validating token access rules against request {{(pid=207600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:27:27.857221 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG dbcounter [-] [207600] Writing DB stats keystone:SELECT=100 {{(pid=207600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:27:27.872700 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b915504-0e3f-428e-85de-6e3770ab98cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:27:27.873240 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b915504-0e3f-428e-85de-6e3770ab98cd None admin] REQUEST_METHOD: `GET` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:27:27.873529 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b915504-0e3f-428e-85de-6e3770ab98cd None admin] SCRIPT_NAME: `/identity` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:27:27.873781 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b915504-0e3f-428e-85de-6e3770ab98cd None admin] PATH_INFO: `/v3/projects` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:27:27.874547 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b915504-0e3f-428e-85de-6e3770ab98cd None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=207600) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:27:27.874894 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b915504-0e3f-428e-85de-6e3770ab98cd None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:27:27.876418 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b915504-0e3f-428e-85de-6e3770ab98cd None admin] RBAC: Authorization granted {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:27:27.891666 dv-cinder-851351-1-smb devstack@keystone.service[207600]: [pid: 207600|app: 0|req: 608/1218] 10.222.0.42 () {56 vars in 1148 bytes} [Thu Jul 28 08:27:27 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 08:27:27.898691 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1889d0ac-4b38-49e4-9e26-93aeb5259f4a None admin] Authenticating user token {{(pid=207601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:27:28.071437 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1889d0ac-4b38-49e4-9e26-93aeb5259f4a None admin] Validating token access rules against request {{(pid=207601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:27:28.116446 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG dbcounter [-] [207601] Writing DB stats keystone:SELECT=100 {{(pid=207601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:27:28.123228 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225dbb6e-5a12-40a3-b6ce-01702c3c8585 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:27:28.123864 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225dbb6e-5a12-40a3-b6ce-01702c3c8585 None admin] REQUEST_METHOD: `GET` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:27:28.124137 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225dbb6e-5a12-40a3-b6ce-01702c3c8585 None admin] SCRIPT_NAME: `/identity` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:27:28.124405 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225dbb6e-5a12-40a3-b6ce-01702c3c8585 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:27:28.125242 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-225dbb6e-5a12-40a3-b6ce-01702c3c8585 None admin] RBAC: Adding query filter params (role.id=b44e7c7aeec24f51b8033df305da133d, scope.project.id=48c5f2b2ae2b48758b957d2b194a7fd1, user.id=954803a75b6c4c46b7ab8818fc89c275) {{(pid=207601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:27:28.125551 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-225dbb6e-5a12-40a3-b6ce-01702c3c8585 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:27:28.127010 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-225dbb6e-5a12-40a3-b6ce-01702c3c8585 None admin] RBAC: Authorization granted {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:27:28.133530 dv-cinder-851351-1-smb devstack@keystone.service[207601]: [pid: 207601|app: 0|req: 611/1219] 10.222.0.42 () {56 vars in 1374 bytes} [Thu Jul 28 08:27:27 2022] GET /identity/v3/role_assignments?user.id=954803a75b6c4c46b7ab8818fc89c275&scope.project.id=48c5f2b2ae2b48758b957d2b194a7fd1&role.id=b44e7c7aeec24f51b8033df305da133d => generated 259 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 08:27:30.289686 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a897086-599a-47b6-abb1-f059b572863d None None] REQUEST_METHOD: `GET` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:27:30.290293 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a897086-599a-47b6-abb1-f059b572863d None None] SCRIPT_NAME: `/identity` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:27:30.290293 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a897086-599a-47b6-abb1-f059b572863d None None] PATH_INFO: `/` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:27:30.292000 dv-cinder-851351-1-smb devstack@keystone.service[207600]: [pid: 207600|app: 0|req: 609/1220] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 08:27:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 08:27:30.298515 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694c5c53-f829-4ee5-a7ad-7228fd9d6d1c None None] REQUEST_METHOD: `POST` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:27:30.299347 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694c5c53-f829-4ee5-a7ad-7228fd9d6d1c None None] SCRIPT_NAME: `/identity` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:27:30.299532 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694c5c53-f829-4ee5-a7ad-7228fd9d6d1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:27:30.327661 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.auth.core [None req-694c5c53-f829-4ee5-a7ad-7228fd9d6d1c None None] MFA Rules not processed for user `b8110ade874c4aa7af27f5c376df700a`. Rule list: `[]` (Enabled: `True`). {{(pid=207601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 08:27:30.329816 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.fernet_utils [None req-694c5c53-f829-4ee5-a7ad-7228fd9d6d1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=207601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:27:30.436718 dv-cinder-851351-1-smb devstack@keystone.service[207601]: [pid: 207601|app: 0|req: 612/1221] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 08:27:30 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 08:27:30.462126 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a897086-599a-47b6-abb1-f059b572863d None None] Authenticating user token {{(pid=207600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:27:30.618283 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a897086-599a-47b6-abb1-f059b572863d None None] Validating token access rules against request {{(pid=207600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:27:30.667892 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f75f660-af2d-47e9-b84b-9c9de7086709 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:27:30.668609 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f75f660-af2d-47e9-b84b-9c9de7086709 None admin] REQUEST_METHOD: `GET` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:27:30.669003 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f75f660-af2d-47e9-b84b-9c9de7086709 None admin] SCRIPT_NAME: `/identity` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:27:30.669273 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f75f660-af2d-47e9-b84b-9c9de7086709 None admin] PATH_INFO: `/v3/roles/service` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:27:30.684155 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f75f660-af2d-47e9-b84b-9c9de7086709 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 08:27:30.690140 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application [None req-0f75f660-af2d-47e9-b84b-9c9de7086709 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 28 08:27:30.690140 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:27:30.690140 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:27:30.690140 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:27:30.690140 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:27:30.690140 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:27:30.690140 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:27:30.690140 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:27:30.690140 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:27:30.690140 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:27:30.690140 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:27:30.690140 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:27:30.690140 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 08:27:30.690140 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 08:27:30.690140 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 08:27:30.690140 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 08:27:30.692823 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 08:27:30.692823 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 08:27:30.692823 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 08:27:30.692823 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 08:27:30.692823 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:27:30.692823 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:27:30.692823 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:27:30.692823 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:27:30.692823 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:27:30.692823 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:27:30.692823 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:27:30.692823 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application with Lock( Jul 28 08:27:30.692823 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:27:30.692823 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:27:30.692823 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:27:30.692823 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:27:30.694991 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:27:30.694991 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:27:30.694991 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:27:30.694991 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:27:30.694991 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 08:27:30.694991 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 08:27:30.694991 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 08:27:30.694991 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 08:27:30.694991 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 08:27:30.694991 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 08:27:30.694991 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 28 08:27:30.694991 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application Jul 28 08:27:30.694991 dv-cinder-851351-1-smb devstack@keystone.service[207600]: [pid: 207600|app: 0|req: 610/1222] 10.222.0.42 () {56 vars in 1102 bytes} [Thu Jul 28 08:27:30 2022] GET /identity/v3/roles/service => generated 85 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:27:30.698934 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694c5c53-f829-4ee5-a7ad-7228fd9d6d1c None None] Authenticating user token {{(pid=207601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:27:30.854020 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694c5c53-f829-4ee5-a7ad-7228fd9d6d1c None None] Validating token access rules against request {{(pid=207601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:27:30.894105 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG dbcounter [-] [207601] Writing DB stats keystone:SELECT=100 {{(pid=207601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:27:30.911335 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c4dc49-dfc6-48ba-acc8-dbeeb7b2c2c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:27:30.913418 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c4dc49-dfc6-48ba-acc8-dbeeb7b2c2c0 None admin] REQUEST_METHOD: `GET` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:27:30.913716 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c4dc49-dfc6-48ba-acc8-dbeeb7b2c2c0 None admin] SCRIPT_NAME: `/identity` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:27:30.915257 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c4dc49-dfc6-48ba-acc8-dbeeb7b2c2c0 None admin] PATH_INFO: `/v3/roles` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:27:30.915548 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65c4dc49-dfc6-48ba-acc8-dbeeb7b2c2c0 None admin] RBAC: Adding query filter params (name=service) {{(pid=207601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:27:30.915866 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65c4dc49-dfc6-48ba-acc8-dbeeb7b2c2c0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:27:30.918201 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65c4dc49-dfc6-48ba-acc8-dbeeb7b2c2c0 None admin] RBAC: Authorization granted {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:27:30.930438 dv-cinder-851351-1-smb devstack@keystone.service[207601]: [pid: 207601|app: 0|req: 613/1223] 10.222.0.42 () {56 vars in 1103 bytes} [Thu Jul 28 08:27:30 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:27:30.940710 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f75f660-af2d-47e9-b84b-9c9de7086709 None admin] Authenticating user token {{(pid=207600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:27:31.016552 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG dbcounter [-] [207600] Writing DB stats keystone:SELECT=100 {{(pid=207600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:27:31.103550 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f75f660-af2d-47e9-b84b-9c9de7086709 None admin] Validating token access rules against request {{(pid=207600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:27:31.153779 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34023e6c-ba55-4a42-98f1-ae394d6ad3e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:27:31.154782 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34023e6c-ba55-4a42-98f1-ae394d6ad3e6 None admin] REQUEST_METHOD: `GET` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:27:31.155247 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34023e6c-ba55-4a42-98f1-ae394d6ad3e6 None admin] SCRIPT_NAME: `/identity` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:27:31.155816 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34023e6c-ba55-4a42-98f1-ae394d6ad3e6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:27:31.178331 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34023e6c-ba55-4a42-98f1-ae394d6ad3e6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:27:31.181726 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34023e6c-ba55-4a42-98f1-ae394d6ad3e6 None admin] RBAC: Authorization granted {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:27:31.216875 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application [None req-34023e6c-ba55-4a42-98f1-ae394d6ad3e6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 08:27:31.216875 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:27:31.216875 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:27:31.216875 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:27:31.216875 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:27:31.216875 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:27:31.216875 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:27:31.216875 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:27:31.216875 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:27:31.216875 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:27:31.216875 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:27:31.216875 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:27:31.216875 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 08:27:31.216875 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 08:27:31.216875 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 08:27:31.218740 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 08:27:31.218740 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:27:31.218740 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:27:31.218740 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:27:31.218740 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:27:31.218740 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:27:31.218740 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:27:31.218740 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:27:31.218740 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application with Lock( Jul 28 08:27:31.218740 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:27:31.218740 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:27:31.218740 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:27:31.218740 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:27:31.218740 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:27:31.218740 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:27:31.218740 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:27:31.218740 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:27:31.224886 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 08:27:31.224886 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 08:27:31.224886 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 08:27:31.224886 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application Jul 28 08:27:31.224886 dv-cinder-851351-1-smb devstack@keystone.service[207600]: [pid: 207600|app: 0|req: 611/1224] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 08:27:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 280 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:27:31.225898 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c4dc49-dfc6-48ba-acc8-dbeeb7b2c2c0 None admin] Authenticating user token {{(pid=207601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:27:31.364262 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c4dc49-dfc6-48ba-acc8-dbeeb7b2c2c0 None admin] Validating token access rules against request {{(pid=207601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:27:31.427243 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c25698-9774-4b0f-b52e-ecb00cbab71e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:27:31.428017 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c25698-9774-4b0f-b52e-ecb00cbab71e None admin] REQUEST_METHOD: `GET` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:27:31.428416 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c25698-9774-4b0f-b52e-ecb00cbab71e None admin] SCRIPT_NAME: `/identity` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:27:31.428842 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c25698-9774-4b0f-b52e-ecb00cbab71e None admin] PATH_INFO: `/v3/domains` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:27:31.429974 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85c25698-9774-4b0f-b52e-ecb00cbab71e None admin] RBAC: Adding query filter params (name=Default) {{(pid=207601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:27:31.430418 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85c25698-9774-4b0f-b52e-ecb00cbab71e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:27:31.432107 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85c25698-9774-4b0f-b52e-ecb00cbab71e None admin] RBAC: Authorization granted {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:27:31.450100 dv-cinder-851351-1-smb devstack@keystone.service[207601]: [pid: 207601|app: 0|req: 614/1225] 10.222.0.42 () {56 vars in 1109 bytes} [Thu Jul 28 08:27:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:27:31.458115 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34023e6c-ba55-4a42-98f1-ae394d6ad3e6 None admin] Authenticating user token {{(pid=207600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:27:31.598613 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG dbcounter [-] [207600] Writing DB stats keystone:SELECT=100 {{(pid=207600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:27:31.612107 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34023e6c-ba55-4a42-98f1-ae394d6ad3e6 None admin] Validating token access rules against request {{(pid=207600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:27:31.668569 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799a8ebe-73fe-44eb-83b7-414628bfd0d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:27:31.669510 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799a8ebe-73fe-44eb-83b7-414628bfd0d9 None admin] REQUEST_METHOD: `GET` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:27:31.669988 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799a8ebe-73fe-44eb-83b7-414628bfd0d9 None admin] SCRIPT_NAME: `/identity` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:27:31.670480 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799a8ebe-73fe-44eb-83b7-414628bfd0d9 None admin] PATH_INFO: `/v3/users/placement` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:27:31.682583 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-799a8ebe-73fe-44eb-83b7-414628bfd0d9 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:27:31.684265 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-799a8ebe-73fe-44eb-83b7-414628bfd0d9 None admin] RBAC: Authorization granted {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:27:31.701684 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application [None req-799a8ebe-73fe-44eb-83b7-414628bfd0d9 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 28 08:27:31.701684 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:27:31.701684 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:27:31.701684 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:27:31.701684 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:27:31.701684 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:27:31.701684 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:27:31.701684 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:27:31.701684 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:27:31.701684 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:27:31.701684 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:27:31.701684 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:27:31.701684 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 28 08:27:31.701684 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 28 08:27:31.701684 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 28 08:27:31.701684 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 28 08:27:31.704462 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:27:31.704462 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:27:31.704462 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 28 08:27:31.704462 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 08:27:31.704462 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 28 08:27:31.704462 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 08:27:31.704462 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:27:31.704462 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:27:31.704462 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:27:31.704462 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:27:31.704462 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:27:31.704462 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application with Lock( Jul 28 08:27:31.704462 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:27:31.704462 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:27:31.704462 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:27:31.704462 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:27:31.704462 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:27:31.704462 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:27:31.707056 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:27:31.707056 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:27:31.707056 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 28 08:27:31.707056 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 28 08:27:31.707056 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 28 08:27:31.707056 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 28 08:27:31.707056 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 28 08:27:31.707056 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 28 08:27:31.707056 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 28 08:27:31.707056 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application Jul 28 08:27:31.711323 dv-cinder-851351-1-smb devstack@keystone.service[207600]: [pid: 207600|app: 0|req: 612/1226] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 08:27:31 2022] GET /identity/v3/users/placement => generated 87 bytes in 254 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:27:31.712788 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c25698-9774-4b0f-b52e-ecb00cbab71e None admin] Authenticating user token {{(pid=207601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:27:31.777106 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG dbcounter [-] [207601] Writing DB stats keystone:SELECT=100 {{(pid=207601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:27:31.873878 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c25698-9774-4b0f-b52e-ecb00cbab71e None admin] Validating token access rules against request {{(pid=207601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:27:31.935255 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ce6515-7986-473e-8b00-344091dbfe91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:27:31.936036 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ce6515-7986-473e-8b00-344091dbfe91 None admin] REQUEST_METHOD: `GET` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:27:31.936482 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ce6515-7986-473e-8b00-344091dbfe91 None admin] SCRIPT_NAME: `/identity` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:27:31.936929 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ce6515-7986-473e-8b00-344091dbfe91 None admin] PATH_INFO: `/v3/users` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:27:31.937964 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ce6515-7986-473e-8b00-344091dbfe91 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=207601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:27:31.938387 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ce6515-7986-473e-8b00-344091dbfe91 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:27:31.940391 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ce6515-7986-473e-8b00-344091dbfe91 None admin] RBAC: Authorization granted {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:27:31.961828 dv-cinder-851351-1-smb devstack@keystone.service[207601]: [pid: 207601|app: 0|req: 615/1227] 10.222.0.42 () {56 vars in 1143 bytes} [Thu Jul 28 08:27:31 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:27:31.970622 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799a8ebe-73fe-44eb-83b7-414628bfd0d9 None admin] Authenticating user token {{(pid=207600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:27:32.113925 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799a8ebe-73fe-44eb-83b7-414628bfd0d9 None admin] Validating token access rules against request {{(pid=207600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:27:32.161853 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44074a81-a7eb-468a-bc83-0e67310e914b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:27:32.163004 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44074a81-a7eb-468a-bc83-0e67310e914b None admin] REQUEST_METHOD: `GET` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:27:32.163385 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44074a81-a7eb-468a-bc83-0e67310e914b None admin] SCRIPT_NAME: `/identity` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:27:32.163796 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44074a81-a7eb-468a-bc83-0e67310e914b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:27:32.178499 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44074a81-a7eb-468a-bc83-0e67310e914b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:27:32.180155 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44074a81-a7eb-468a-bc83-0e67310e914b None admin] RBAC: Authorization granted {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:27:32.207933 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application [None req-44074a81-a7eb-468a-bc83-0e67310e914b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 08:27:32.207933 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:27:32.207933 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:27:32.207933 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:27:32.207933 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:27:32.207933 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:27:32.207933 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:27:32.207933 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:27:32.207933 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:27:32.207933 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:27:32.207933 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:27:32.207933 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:27:32.207933 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 08:27:32.207933 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 08:27:32.207933 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 08:27:32.210058 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 08:27:32.210058 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:27:32.210058 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:27:32.210058 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:27:32.210058 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:27:32.210058 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:27:32.210058 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:27:32.210058 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:27:32.210058 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application with Lock( Jul 28 08:27:32.210058 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:27:32.210058 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:27:32.210058 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:27:32.210058 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:27:32.210058 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:27:32.210058 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:27:32.210058 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:27:32.210058 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:27:32.211458 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 08:27:32.211458 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 08:27:32.211458 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 08:27:32.211458 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application Jul 28 08:27:32.211458 dv-cinder-851351-1-smb devstack@keystone.service[207600]: [pid: 207600|app: 0|req: 613/1228] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 08:27:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:27:32.222156 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ce6515-7986-473e-8b00-344091dbfe91 None admin] Authenticating user token {{(pid=207601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:27:32.387137 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ce6515-7986-473e-8b00-344091dbfe91 None admin] Validating token access rules against request {{(pid=207601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:27:32.392051 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG dbcounter [-] [207601] Writing DB stats keystone:SELECT=100 {{(pid=207601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:27:32.432313 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62930c07-2a27-4d30-8db1-353dcc2bbb46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:27:32.433154 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62930c07-2a27-4d30-8db1-353dcc2bbb46 None admin] REQUEST_METHOD: `GET` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:27:32.433557 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62930c07-2a27-4d30-8db1-353dcc2bbb46 None admin] SCRIPT_NAME: `/identity` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:27:32.433934 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62930c07-2a27-4d30-8db1-353dcc2bbb46 None admin] PATH_INFO: `/v3/domains` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:27:32.434758 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62930c07-2a27-4d30-8db1-353dcc2bbb46 None admin] RBAC: Adding query filter params (name=Default) {{(pid=207601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:27:32.435164 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62930c07-2a27-4d30-8db1-353dcc2bbb46 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:27:32.436799 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62930c07-2a27-4d30-8db1-353dcc2bbb46 None admin] RBAC: Authorization granted {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:27:32.453495 dv-cinder-851351-1-smb devstack@keystone.service[207601]: [pid: 207601|app: 0|req: 616/1229] 10.222.0.42 () {56 vars in 1109 bytes} [Thu Jul 28 08:27:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:27:32.463003 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44074a81-a7eb-468a-bc83-0e67310e914b None admin] Authenticating user token {{(pid=207600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:27:32.476151 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG dbcounter [-] [207600] Writing DB stats keystone:SELECT=100 {{(pid=207600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:27:32.624695 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44074a81-a7eb-468a-bc83-0e67310e914b None admin] Validating token access rules against request {{(pid=207600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:27:32.667133 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d88373-cc42-4e1f-9e26-affd015f31f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:27:32.667863 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d88373-cc42-4e1f-9e26-affd015f31f5 None admin] REQUEST_METHOD: `GET` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:27:32.668207 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d88373-cc42-4e1f-9e26-affd015f31f5 None admin] SCRIPT_NAME: `/identity` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:27:32.668553 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d88373-cc42-4e1f-9e26-affd015f31f5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:27:32.676354 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0d88373-cc42-4e1f-9e26-affd015f31f5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:27:32.677891 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0d88373-cc42-4e1f-9e26-affd015f31f5 None admin] RBAC: Authorization granted {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:27:32.690507 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application [None req-b0d88373-cc42-4e1f-9e26-affd015f31f5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 08:27:32.690507 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:27:32.690507 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:27:32.690507 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:27:32.690507 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:27:32.690507 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:27:32.690507 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:27:32.690507 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:27:32.690507 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:27:32.690507 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:27:32.690507 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:27:32.690507 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:27:32.690507 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 28 08:27:32.690507 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 28 08:27:32.690507 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 28 08:27:32.697484 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 28 08:27:32.697484 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:27:32.697484 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:27:32.697484 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:27:32.697484 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:27:32.697484 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:27:32.697484 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:27:32.697484 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:27:32.697484 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application with Lock( Jul 28 08:27:32.697484 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:27:32.697484 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:27:32.697484 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:27:32.697484 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:27:32.697484 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:27:32.697484 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:27:32.697484 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:27:32.697484 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:27:32.698697 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 28 08:27:32.698697 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 28 08:27:32.698697 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 28 08:27:32.698697 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 28 08:27:32.698697 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 28 08:27:32.698697 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 28 08:27:32.698697 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 08:27:32.698697 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application Jul 28 08:27:32.698697 dv-cinder-851351-1-smb devstack@keystone.service[207600]: [pid: 207600|app: 0|req: 614/1230] 10.222.0.42 () {56 vars in 1111 bytes} [Thu Jul 28 08:27:32 2022] GET /identity/v3/projects/service => generated 88 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:27:32.699329 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62930c07-2a27-4d30-8db1-353dcc2bbb46 None admin] Authenticating user token {{(pid=207601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:27:32.841483 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62930c07-2a27-4d30-8db1-353dcc2bbb46 None admin] Validating token access rules against request {{(pid=207601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:27:32.895003 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d887c480-8199-46de-b92a-7bc0e670c63c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:27:32.896104 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d887c480-8199-46de-b92a-7bc0e670c63c None admin] REQUEST_METHOD: `GET` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:27:32.896610 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d887c480-8199-46de-b92a-7bc0e670c63c None admin] SCRIPT_NAME: `/identity` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:27:32.897151 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d887c480-8199-46de-b92a-7bc0e670c63c None admin] PATH_INFO: `/v3/projects` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:27:32.898640 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d887c480-8199-46de-b92a-7bc0e670c63c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=207601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:27:32.899846 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d887c480-8199-46de-b92a-7bc0e670c63c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:27:32.902273 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d887c480-8199-46de-b92a-7bc0e670c63c None admin] RBAC: Authorization granted {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:27:32.926343 dv-cinder-851351-1-smb devstack@keystone.service[207601]: [pid: 207601|app: 0|req: 617/1231] 10.222.0.42 () {56 vars in 1148 bytes} [Thu Jul 28 08:27:32 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:27:32.933082 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d88373-cc42-4e1f-9e26-affd015f31f5 None admin] Authenticating user token {{(pid=207600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:27:33.021146 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG dbcounter [-] [207600] Writing DB stats keystone:SELECT=100 {{(pid=207600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:27:33.084968 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d88373-cc42-4e1f-9e26-affd015f31f5 None admin] Validating token access rules against request {{(pid=207600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:27:33.140757 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa20fff-bb37-4a2c-b712-2d4faa9ee362 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:27:33.141598 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa20fff-bb37-4a2c-b712-2d4faa9ee362 None admin] REQUEST_METHOD: `PUT` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:27:33.142102 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa20fff-bb37-4a2c-b712-2d4faa9ee362 None admin] SCRIPT_NAME: `/identity` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:27:33.142532 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa20fff-bb37-4a2c-b712-2d4faa9ee362 None admin] PATH_INFO: `/v3/projects/48c5f2b2ae2b48758b957d2b194a7fd1/users/954803a75b6c4c46b7ab8818fc89c275/roles/b44e7c7aeec24f51b8033df305da133d` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:27:33.164114 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aa20fff-bb37-4a2c-b712-2d4faa9ee362 None admin] RBAC: Authorizing `identity:create_grant(project_id=48c5f2b2ae2b48758b957d2b194a7fd1, user_id=954803a75b6c4c46b7ab8818fc89c275, role_id=b44e7c7aeec24f51b8033df305da133d)` {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:27:33.167688 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aa20fff-bb37-4a2c-b712-2d4faa9ee362 None admin] RBAC: Authorization granted {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:27:33.187809 dv-cinder-851351-1-smb devstack@keystone.service[207600]: [pid: 207600|app: 0|req: 615/1232] 10.222.0.42 () {58 vars in 1439 bytes} [Thu Jul 28 08:27:32 2022] PUT /identity/v3/projects/48c5f2b2ae2b48758b957d2b194a7fd1/users/954803a75b6c4c46b7ab8818fc89c275/roles/b44e7c7aeec24f51b8033df305da133d => generated 0 bytes in 255 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 08:27:35.637752 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03bd5fb5-b016-4475-9df2-de209d649689 None None] REQUEST_METHOD: `GET` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:27:35.638649 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03bd5fb5-b016-4475-9df2-de209d649689 None None] SCRIPT_NAME: `/identity` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:27:35.638649 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03bd5fb5-b016-4475-9df2-de209d649689 None None] PATH_INFO: `/` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:27:35.640358 dv-cinder-851351-1-smb devstack@keystone.service[207601]: [pid: 207601|app: 0|req: 618/1233] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 08:27:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 28 08:27:35.647317 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d467d9-9c95-4e02-ac2a-161e958ea4de None None] REQUEST_METHOD: `POST` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:27:35.648154 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d467d9-9c95-4e02-ac2a-161e958ea4de None None] SCRIPT_NAME: `/identity` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:27:35.648342 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d467d9-9c95-4e02-ac2a-161e958ea4de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:27:35.670483 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.auth.core [None req-a9d467d9-9c95-4e02-ac2a-161e958ea4de None None] MFA Rules not processed for user `b8110ade874c4aa7af27f5c376df700a`. Rule list: `[]` (Enabled: `True`). {{(pid=207600) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 08:27:35.672554 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.fernet_utils [None req-a9d467d9-9c95-4e02-ac2a-161e958ea4de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=207600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:27:35.765854 dv-cinder-851351-1-smb devstack@keystone.service[207600]: [pid: 207600|app: 0|req: 616/1234] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 08:27:35 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 08:27:35.805787 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03bd5fb5-b016-4475-9df2-de209d649689 None None] Authenticating user token {{(pid=207601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:27:35.853575 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG dbcounter [-] [207601] Writing DB stats keystone:SELECT=100 {{(pid=207601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:27:35.976509 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03bd5fb5-b016-4475-9df2-de209d649689 None None] Validating token access rules against request {{(pid=207601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:27:36.026463 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800cfc53-8a73-4890-be13-60be119fcdc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:27:36.027156 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800cfc53-8a73-4890-be13-60be119fcdc3 None admin] REQUEST_METHOD: `GET` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:27:36.027439 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800cfc53-8a73-4890-be13-60be119fcdc3 None admin] SCRIPT_NAME: `/identity` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:27:36.027733 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800cfc53-8a73-4890-be13-60be119fcdc3 None admin] PATH_INFO: `/v3/roles/service` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:27:36.042302 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-800cfc53-8a73-4890-be13-60be119fcdc3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 08:27:36.047759 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application [None req-800cfc53-8a73-4890-be13-60be119fcdc3 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 28 08:27:36.047759 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:27:36.047759 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:27:36.047759 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:27:36.047759 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:27:36.047759 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:27:36.047759 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:27:36.047759 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:27:36.047759 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:27:36.047759 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:27:36.047759 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:27:36.047759 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:27:36.047759 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 08:27:36.047759 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 08:27:36.047759 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 08:27:36.047759 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 08:27:36.050145 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 08:27:36.050145 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 08:27:36.050145 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 08:27:36.050145 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 08:27:36.050145 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:27:36.050145 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:27:36.050145 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:27:36.050145 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:27:36.050145 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:27:36.050145 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:27:36.050145 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:27:36.050145 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application with Lock( Jul 28 08:27:36.050145 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:27:36.050145 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:27:36.050145 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:27:36.050145 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:27:36.052584 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:27:36.052584 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:27:36.052584 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:27:36.052584 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:27:36.052584 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 08:27:36.052584 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 08:27:36.052584 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 08:27:36.052584 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 08:27:36.052584 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 08:27:36.052584 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 08:27:36.052584 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 28 08:27:36.052584 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application Jul 28 08:27:36.052584 dv-cinder-851351-1-smb devstack@keystone.service[207601]: [pid: 207601|app: 0|req: 619/1235] 10.222.0.42 () {56 vars in 1102 bytes} [Thu Jul 28 08:27:35 2022] GET /identity/v3/roles/service => generated 85 bytes in 245 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 08:27:36.060594 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d467d9-9c95-4e02-ac2a-161e958ea4de None None] Authenticating user token {{(pid=207600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:27:36.149700 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG dbcounter [-] [207600] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=207600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:27:36.238187 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d467d9-9c95-4e02-ac2a-161e958ea4de None None] Validating token access rules against request {{(pid=207600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:27:36.313070 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a64174-331d-4f4e-9865-6c7119edd40a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:27:36.314246 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a64174-331d-4f4e-9865-6c7119edd40a None admin] REQUEST_METHOD: `GET` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:27:36.314835 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a64174-331d-4f4e-9865-6c7119edd40a None admin] SCRIPT_NAME: `/identity` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:27:36.315318 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a64174-331d-4f4e-9865-6c7119edd40a None admin] PATH_INFO: `/v3/roles` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:27:36.316753 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a64174-331d-4f4e-9865-6c7119edd40a None admin] RBAC: Adding query filter params (name=service) {{(pid=207600) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:27:36.317319 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a64174-331d-4f4e-9865-6c7119edd40a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:27:36.320224 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a64174-331d-4f4e-9865-6c7119edd40a None admin] RBAC: Authorization granted {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:27:36.340180 dv-cinder-851351-1-smb devstack@keystone.service[207600]: [pid: 207600|app: 0|req: 617/1236] 10.222.0.42 () {56 vars in 1103 bytes} [Thu Jul 28 08:27:36 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 285 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:27:36.346808 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800cfc53-8a73-4890-be13-60be119fcdc3 None admin] Authenticating user token {{(pid=207601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:27:36.482565 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG dbcounter [-] [207601] Writing DB stats keystone:SELECT=100 {{(pid=207601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:27:36.504375 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800cfc53-8a73-4890-be13-60be119fcdc3 None admin] Validating token access rules against request {{(pid=207601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:27:36.562001 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dde2662-8c23-4f74-a712-4640fcb6d266 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:27:36.562746 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dde2662-8c23-4f74-a712-4640fcb6d266 None admin] REQUEST_METHOD: `GET` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:27:36.563013 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dde2662-8c23-4f74-a712-4640fcb6d266 None admin] SCRIPT_NAME: `/identity` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:27:36.563300 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dde2662-8c23-4f74-a712-4640fcb6d266 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:27:36.583211 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dde2662-8c23-4f74-a712-4640fcb6d266 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:27:36.585909 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dde2662-8c23-4f74-a712-4640fcb6d266 None admin] RBAC: Authorization granted {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:27:36.614588 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application [None req-6dde2662-8c23-4f74-a712-4640fcb6d266 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 08:27:36.614588 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:27:36.614588 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:27:36.614588 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:27:36.614588 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:27:36.614588 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:27:36.614588 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:27:36.614588 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:27:36.614588 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:27:36.614588 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:27:36.614588 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:27:36.614588 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:27:36.614588 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 08:27:36.614588 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 08:27:36.614588 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 08:27:36.616613 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 08:27:36.616613 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:27:36.616613 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:27:36.616613 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:27:36.616613 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:27:36.616613 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:27:36.616613 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:27:36.616613 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:27:36.616613 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application with Lock( Jul 28 08:27:36.616613 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:27:36.616613 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:27:36.616613 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:27:36.616613 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:27:36.616613 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:27:36.616613 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:27:36.616613 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:27:36.616613 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:27:36.623664 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 08:27:36.623664 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 08:27:36.623664 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 08:27:36.623664 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application Jul 28 08:27:36.623664 dv-cinder-851351-1-smb devstack@keystone.service[207601]: [pid: 207601|app: 0|req: 620/1237] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 08:27:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 271 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:27:36.624485 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a64174-331d-4f4e-9865-6c7119edd40a None admin] Authenticating user token {{(pid=207600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:27:36.768872 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a64174-331d-4f4e-9865-6c7119edd40a None admin] Validating token access rules against request {{(pid=207600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:27:36.785794 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG dbcounter [-] [207600] Writing DB stats keystone:SELECT=100 {{(pid=207600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:27:36.818068 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-480244a2-5cda-428b-ab64-7a6a9a743201 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:27:36.819055 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480244a2-5cda-428b-ab64-7a6a9a743201 None admin] REQUEST_METHOD: `GET` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:27:36.819497 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480244a2-5cda-428b-ab64-7a6a9a743201 None admin] SCRIPT_NAME: `/identity` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:27:36.819922 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480244a2-5cda-428b-ab64-7a6a9a743201 None admin] PATH_INFO: `/v3/domains` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:27:36.821038 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-480244a2-5cda-428b-ab64-7a6a9a743201 None admin] RBAC: Adding query filter params (name=Default) {{(pid=207600) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:27:36.821587 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-480244a2-5cda-428b-ab64-7a6a9a743201 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:27:36.823454 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-480244a2-5cda-428b-ab64-7a6a9a743201 None admin] RBAC: Authorization granted {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:27:36.840551 dv-cinder-851351-1-smb devstack@keystone.service[207600]: [pid: 207600|app: 0|req: 618/1238] 10.222.0.42 () {56 vars in 1109 bytes} [Thu Jul 28 08:27:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:27:36.848025 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dde2662-8c23-4f74-a712-4640fcb6d266 None admin] Authenticating user token {{(pid=207601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:27:36.988385 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dde2662-8c23-4f74-a712-4640fcb6d266 None admin] Validating token access rules against request {{(pid=207601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:27:37.049724 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee4fc6b-9df1-4179-a09b-74f2314a5d1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:27:37.050683 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee4fc6b-9df1-4179-a09b-74f2314a5d1f None admin] REQUEST_METHOD: `GET` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:27:37.051155 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee4fc6b-9df1-4179-a09b-74f2314a5d1f None admin] SCRIPT_NAME: `/identity` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:27:37.051625 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee4fc6b-9df1-4179-a09b-74f2314a5d1f None admin] PATH_INFO: `/v3/users/placement` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:27:37.056348 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG dbcounter [-] [207601] Writing DB stats keystone:SELECT=100 {{(pid=207601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:27:37.063861 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ee4fc6b-9df1-4179-a09b-74f2314a5d1f None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:27:37.066295 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ee4fc6b-9df1-4179-a09b-74f2314a5d1f None admin] RBAC: Authorization granted {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:27:37.088700 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application [None req-6ee4fc6b-9df1-4179-a09b-74f2314a5d1f None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 28 08:27:37.088700 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:27:37.088700 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:27:37.088700 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:27:37.088700 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:27:37.088700 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:27:37.088700 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:27:37.088700 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:27:37.088700 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:27:37.088700 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:27:37.088700 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:27:37.088700 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:27:37.088700 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 28 08:27:37.088700 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 28 08:27:37.088700 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 28 08:27:37.088700 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 28 08:27:37.090068 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:27:37.090068 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:27:37.090068 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 28 08:27:37.090068 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 08:27:37.090068 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 28 08:27:37.090068 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 08:27:37.090068 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:27:37.090068 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:27:37.090068 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:27:37.090068 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:27:37.090068 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:27:37.090068 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application with Lock( Jul 28 08:27:37.090068 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:27:37.090068 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:27:37.090068 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:27:37.090068 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:27:37.090068 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:27:37.090068 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:27:37.091741 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:27:37.091741 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:27:37.091741 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 28 08:27:37.091741 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 28 08:27:37.091741 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 28 08:27:37.091741 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 28 08:27:37.091741 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 28 08:27:37.091741 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 28 08:27:37.091741 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 28 08:27:37.091741 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application Jul 28 08:27:37.091741 dv-cinder-851351-1-smb devstack@keystone.service[207601]: [pid: 207601|app: 0|req: 621/1239] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 08:27:36 2022] GET /identity/v3/users/placement => generated 87 bytes in 244 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:27:37.100850 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-480244a2-5cda-428b-ab64-7a6a9a743201 None admin] Authenticating user token {{(pid=207600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:27:37.237379 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-480244a2-5cda-428b-ab64-7a6a9a743201 None admin] Validating token access rules against request {{(pid=207600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:27:37.289181 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be2a03c-bd93-48a6-80e4-425e780c18c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:27:37.290152 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be2a03c-bd93-48a6-80e4-425e780c18c1 None admin] REQUEST_METHOD: `GET` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:27:37.290646 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be2a03c-bd93-48a6-80e4-425e780c18c1 None admin] SCRIPT_NAME: `/identity` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:27:37.291116 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be2a03c-bd93-48a6-80e4-425e780c18c1 None admin] PATH_INFO: `/v3/users` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:27:37.292445 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3be2a03c-bd93-48a6-80e4-425e780c18c1 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=207600) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:27:37.292855 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3be2a03c-bd93-48a6-80e4-425e780c18c1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:27:37.295132 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3be2a03c-bd93-48a6-80e4-425e780c18c1 None admin] RBAC: Authorization granted {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:27:37.319595 dv-cinder-851351-1-smb devstack@keystone.service[207600]: [pid: 207600|app: 0|req: 619/1240] 10.222.0.42 () {56 vars in 1143 bytes} [Thu Jul 28 08:27:37 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 08:27:37.325795 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee4fc6b-9df1-4179-a09b-74f2314a5d1f None admin] Authenticating user token {{(pid=207601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:27:37.469248 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee4fc6b-9df1-4179-a09b-74f2314a5d1f None admin] Validating token access rules against request {{(pid=207601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:27:37.524395 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32615cf1-2240-4333-982e-9317fee1b99f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:27:37.525548 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32615cf1-2240-4333-982e-9317fee1b99f None admin] REQUEST_METHOD: `GET` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:27:37.525964 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32615cf1-2240-4333-982e-9317fee1b99f None admin] SCRIPT_NAME: `/identity` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:27:37.526401 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32615cf1-2240-4333-982e-9317fee1b99f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:27:37.633016 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG dbcounter [-] [207601] Writing DB stats keystone:SELECT=100 {{(pid=207601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:27:37.641142 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32615cf1-2240-4333-982e-9317fee1b99f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:27:37.642857 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32615cf1-2240-4333-982e-9317fee1b99f None admin] RBAC: Authorization granted {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:27:37.774334 dv-cinder-851351-1-smb devstack@keystone.service[207601]: [pid: 207601|app: 0|req: 622/1241] 10.222.0.42 () {58 vars in 1282 bytes} [Thu Jul 28 08:27:37 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 449 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jul 28 08:27:37.780699 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be2a03c-bd93-48a6-80e4-425e780c18c1 None admin] Authenticating user token {{(pid=207600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:27:37.828598 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG dbcounter [-] [207600] Writing DB stats keystone:SELECT=100 {{(pid=207600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:27:37.955820 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be2a03c-bd93-48a6-80e4-425e780c18c1 None admin] Validating token access rules against request {{(pid=207600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:27:38.017271 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5e25e6-ca28-4097-997c-a507e08953e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:27:38.017994 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5e25e6-ca28-4097-997c-a507e08953e4 None admin] REQUEST_METHOD: `GET` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:27:38.018274 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5e25e6-ca28-4097-997c-a507e08953e4 None admin] SCRIPT_NAME: `/identity` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:27:38.018577 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5e25e6-ca28-4097-997c-a507e08953e4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:27:38.032308 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c5e25e6-ca28-4097-997c-a507e08953e4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:27:38.034127 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c5e25e6-ca28-4097-997c-a507e08953e4 None admin] RBAC: Authorization granted {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:27:38.052355 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application [None req-1c5e25e6-ca28-4097-997c-a507e08953e4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 08:27:38.052355 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:27:38.052355 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:27:38.052355 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:27:38.052355 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:27:38.052355 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:27:38.052355 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:27:38.052355 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:27:38.052355 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:27:38.052355 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:27:38.052355 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:27:38.052355 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:27:38.052355 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 08:27:38.052355 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 08:27:38.052355 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 08:27:38.053721 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 08:27:38.053721 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:27:38.053721 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:27:38.053721 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:27:38.053721 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:27:38.053721 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:27:38.053721 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:27:38.053721 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:27:38.053721 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application with Lock( Jul 28 08:27:38.053721 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:27:38.053721 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:27:38.053721 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:27:38.053721 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:27:38.053721 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:27:38.053721 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:27:38.053721 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:27:38.053721 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:27:38.055001 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 08:27:38.055001 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 08:27:38.055001 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 08:27:38.055001 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application Jul 28 08:27:38.055001 dv-cinder-851351-1-smb devstack@keystone.service[207600]: [pid: 207600|app: 0|req: 620/1242] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 08:27:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 274 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 08:27:38.060217 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32615cf1-2240-4333-982e-9317fee1b99f None admin] Authenticating user token {{(pid=207601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:27:38.233129 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG dbcounter [-] [207601] Writing DB stats keystone:SELECT=100 {{(pid=207601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:27:38.243047 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32615cf1-2240-4333-982e-9317fee1b99f None admin] Validating token access rules against request {{(pid=207601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:27:38.295732 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ff20aa-7796-4d0c-a11f-cf1e7ada5fe0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:27:38.296556 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ff20aa-7796-4d0c-a11f-cf1e7ada5fe0 None admin] REQUEST_METHOD: `GET` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:27:38.296917 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ff20aa-7796-4d0c-a11f-cf1e7ada5fe0 None admin] SCRIPT_NAME: `/identity` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:27:38.297194 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ff20aa-7796-4d0c-a11f-cf1e7ada5fe0 None admin] PATH_INFO: `/v3/domains` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:27:38.297938 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18ff20aa-7796-4d0c-a11f-cf1e7ada5fe0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=207601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:27:38.298252 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18ff20aa-7796-4d0c-a11f-cf1e7ada5fe0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:27:38.299919 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18ff20aa-7796-4d0c-a11f-cf1e7ada5fe0 None admin] RBAC: Authorization granted {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:27:38.324267 dv-cinder-851351-1-smb devstack@keystone.service[207601]: [pid: 207601|app: 0|req: 623/1243] 10.222.0.42 () {56 vars in 1109 bytes} [Thu Jul 28 08:27:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:27:38.325863 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5e25e6-ca28-4097-997c-a507e08953e4 None admin] Authenticating user token {{(pid=207600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:27:38.452475 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG dbcounter [-] [207600] Writing DB stats keystone:SELECT=100 {{(pid=207600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:27:38.493104 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5e25e6-ca28-4097-997c-a507e08953e4 None admin] Validating token access rules against request {{(pid=207600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:27:38.553392 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4034f1-a056-4116-9478-5db44a5b32bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:27:38.554115 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4034f1-a056-4116-9478-5db44a5b32bf None admin] REQUEST_METHOD: `GET` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:27:38.554549 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4034f1-a056-4116-9478-5db44a5b32bf None admin] SCRIPT_NAME: `/identity` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:27:38.555019 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4034f1-a056-4116-9478-5db44a5b32bf None admin] PATH_INFO: `/v3/projects/service` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:27:38.566108 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a4034f1-a056-4116-9478-5db44a5b32bf None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:27:38.567832 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a4034f1-a056-4116-9478-5db44a5b32bf None admin] RBAC: Authorization granted {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:27:38.582944 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application [None req-7a4034f1-a056-4116-9478-5db44a5b32bf None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 08:27:38.582944 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:27:38.582944 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:27:38.582944 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:27:38.582944 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:27:38.582944 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:27:38.582944 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:27:38.582944 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:27:38.582944 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:27:38.582944 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:27:38.582944 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:27:38.582944 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:27:38.582944 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 28 08:27:38.582944 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 28 08:27:38.582944 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 28 08:27:38.585432 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 28 08:27:38.585432 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:27:38.585432 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:27:38.585432 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:27:38.585432 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:27:38.585432 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:27:38.585432 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:27:38.585432 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:27:38.585432 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application with Lock( Jul 28 08:27:38.585432 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:27:38.585432 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:27:38.585432 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:27:38.585432 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:27:38.585432 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:27:38.585432 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:27:38.585432 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:27:38.585432 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:27:38.587549 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 28 08:27:38.587549 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 28 08:27:38.587549 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 28 08:27:38.587549 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 28 08:27:38.587549 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 28 08:27:38.587549 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 28 08:27:38.587549 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 08:27:38.587549 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application Jul 28 08:27:38.590143 dv-cinder-851351-1-smb devstack@keystone.service[207600]: [pid: 207600|app: 0|req: 621/1244] 10.222.0.42 () {56 vars in 1111 bytes} [Thu Jul 28 08:27:38 2022] GET /identity/v3/projects/service => generated 88 bytes in 265 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:27:38.592223 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ff20aa-7796-4d0c-a11f-cf1e7ada5fe0 None admin] Authenticating user token {{(pid=207601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:27:38.752541 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ff20aa-7796-4d0c-a11f-cf1e7ada5fe0 None admin] Validating token access rules against request {{(pid=207601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:27:38.797775 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e58bbd-06c0-4e51-920b-d6289ada2c4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:27:38.798430 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e58bbd-06c0-4e51-920b-d6289ada2c4f None admin] REQUEST_METHOD: `GET` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:27:38.798762 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e58bbd-06c0-4e51-920b-d6289ada2c4f None admin] SCRIPT_NAME: `/identity` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:27:38.799093 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e58bbd-06c0-4e51-920b-d6289ada2c4f None admin] PATH_INFO: `/v3/projects` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:27:38.799889 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43e58bbd-06c0-4e51-920b-d6289ada2c4f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=207601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:27:38.800218 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43e58bbd-06c0-4e51-920b-d6289ada2c4f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:27:38.801786 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43e58bbd-06c0-4e51-920b-d6289ada2c4f None admin] RBAC: Authorization granted {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:27:38.815488 dv-cinder-851351-1-smb devstack@keystone.service[207601]: [pid: 207601|app: 0|req: 624/1245] 10.222.0.42 () {56 vars in 1148 bytes} [Thu Jul 28 08:27:38 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:27:38.822677 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4034f1-a056-4116-9478-5db44a5b32bf None admin] Authenticating user token {{(pid=207600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:27:38.949972 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4034f1-a056-4116-9478-5db44a5b32bf None admin] Validating token access rules against request {{(pid=207600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:27:39.015009 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc03c1e0-7cd6-4a6a-885a-60f97f8759a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:27:39.016115 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc03c1e0-7cd6-4a6a-885a-60f97f8759a3 None admin] REQUEST_METHOD: `GET` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:27:39.016589 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc03c1e0-7cd6-4a6a-885a-60f97f8759a3 None admin] SCRIPT_NAME: `/identity` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:27:39.017087 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc03c1e0-7cd6-4a6a-885a-60f97f8759a3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:27:39.018806 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc03c1e0-7cd6-4a6a-885a-60f97f8759a3 None admin] RBAC: Adding query filter params (role.id=b44e7c7aeec24f51b8033df305da133d, scope.project.id=48c5f2b2ae2b48758b957d2b194a7fd1, user.id=954803a75b6c4c46b7ab8818fc89c275) {{(pid=207600) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:27:39.019327 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc03c1e0-7cd6-4a6a-885a-60f97f8759a3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:27:39.022107 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc03c1e0-7cd6-4a6a-885a-60f97f8759a3 None admin] RBAC: Authorization granted {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:27:39.031630 dv-cinder-851351-1-smb devstack@keystone.service[207600]: [pid: 207600|app: 0|req: 622/1246] 10.222.0.42 () {56 vars in 1374 bytes} [Thu Jul 28 08:27:38 2022] GET /identity/v3/role_assignments?user.id=954803a75b6c4c46b7ab8818fc89c275&scope.project.id=48c5f2b2ae2b48758b957d2b194a7fd1&role.id=b44e7c7aeec24f51b8033df305da133d => generated 608 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:27:41.299852 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7a9e57-ca4f-417b-98dd-0a106d0b786d None None] REQUEST_METHOD: `GET` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:27:41.300734 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7a9e57-ca4f-417b-98dd-0a106d0b786d None None] SCRIPT_NAME: `/identity` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:27:41.300734 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7a9e57-ca4f-417b-98dd-0a106d0b786d None None] PATH_INFO: `/` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:27:41.301810 dv-cinder-851351-1-smb devstack@keystone.service[207601]: [pid: 207601|app: 0|req: 625/1247] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 08:27:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 08:27:41.309317 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d01acc7-5fdf-483b-b724-9616c0d20dd4 None None] REQUEST_METHOD: `POST` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:27:41.310173 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d01acc7-5fdf-483b-b724-9616c0d20dd4 None None] SCRIPT_NAME: `/identity` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:27:41.310543 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d01acc7-5fdf-483b-b724-9616c0d20dd4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:27:41.321113 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG dbcounter [-] [207600] Writing DB stats keystone:SELECT=100 {{(pid=207600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:27:41.340281 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.auth.core [None req-6d01acc7-5fdf-483b-b724-9616c0d20dd4 None None] MFA Rules not processed for user `b8110ade874c4aa7af27f5c376df700a`. Rule list: `[]` (Enabled: `True`). {{(pid=207600) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 08:27:41.342546 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.fernet_utils [None req-6d01acc7-5fdf-483b-b724-9616c0d20dd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=207600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:27:41.468387 dv-cinder-851351-1-smb devstack@keystone.service[207600]: [pid: 207600|app: 0|req: 623/1248] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 08:27:41 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 28 08:27:41.515528 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a7a9e57-ca4f-417b-98dd-0a106d0b786d None None] Authenticating user token {{(pid=207601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:27:41.545353 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG dbcounter [-] [207601] Writing DB stats keystone:SELECT=100 {{(pid=207601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:27:41.700307 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a7a9e57-ca4f-417b-98dd-0a106d0b786d None None] Validating token access rules against request {{(pid=207601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:27:41.763536 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b103fda-309b-4045-872a-fa3274f1654c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:27:41.764472 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b103fda-309b-4045-872a-fa3274f1654c None admin] REQUEST_METHOD: `GET` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:27:41.764925 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b103fda-309b-4045-872a-fa3274f1654c None admin] SCRIPT_NAME: `/identity` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:27:41.765336 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b103fda-309b-4045-872a-fa3274f1654c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:27:41.783805 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b103fda-309b-4045-872a-fa3274f1654c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 08:27:41.790098 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application [None req-1b103fda-309b-4045-872a-fa3274f1654c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 08:27:41.790098 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:27:41.790098 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:27:41.790098 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:27:41.790098 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:27:41.790098 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:27:41.790098 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:27:41.790098 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:27:41.790098 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:27:41.790098 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:27:41.790098 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:27:41.790098 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:27:41.790098 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 08:27:41.790098 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 08:27:41.790098 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 08:27:41.790098 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 08:27:41.792269 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 08:27:41.792269 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 08:27:41.792269 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 08:27:41.792269 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 08:27:41.792269 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:27:41.792269 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:27:41.792269 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:27:41.792269 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:27:41.792269 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:27:41.792269 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:27:41.792269 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:27:41.792269 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application with Lock( Jul 28 08:27:41.792269 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:27:41.792269 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:27:41.792269 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:27:41.792269 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:27:41.794973 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:27:41.794973 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:27:41.794973 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:27:41.794973 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:27:41.794973 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 08:27:41.794973 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 08:27:41.794973 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 08:27:41.794973 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 08:27:41.794973 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 08:27:41.794973 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 08:27:41.794973 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 08:27:41.794973 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application Jul 28 08:27:41.794973 dv-cinder-851351-1-smb devstack@keystone.service[207601]: [pid: 207601|app: 0|req: 626/1249] 10.222.0.42 () {56 vars in 1096 bytes} [Thu Jul 28 08:27:41 2022] GET /identity/v3/roles/admin => generated 83 bytes in 277 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 08:27:41.802446 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d01acc7-5fdf-483b-b724-9616c0d20dd4 None None] Authenticating user token {{(pid=207600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:27:41.986782 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d01acc7-5fdf-483b-b724-9616c0d20dd4 None None] Validating token access rules against request {{(pid=207600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:27:42.025459 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG dbcounter [-] [207600] Writing DB stats keystone:SELECT=100 {{(pid=207600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:27:42.033054 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c9eb16-9255-4113-8e37-0c8914005140 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:27:42.033948 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c9eb16-9255-4113-8e37-0c8914005140 None admin] REQUEST_METHOD: `GET` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:27:42.034357 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c9eb16-9255-4113-8e37-0c8914005140 None admin] SCRIPT_NAME: `/identity` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:27:42.034690 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c9eb16-9255-4113-8e37-0c8914005140 None admin] PATH_INFO: `/v3/roles` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:27:42.035522 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31c9eb16-9255-4113-8e37-0c8914005140 None admin] RBAC: Adding query filter params (name=admin) {{(pid=207600) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:27:42.035876 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31c9eb16-9255-4113-8e37-0c8914005140 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:27:42.037732 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31c9eb16-9255-4113-8e37-0c8914005140 None admin] RBAC: Authorization granted {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:27:42.049410 dv-cinder-851351-1-smb devstack@keystone.service[207600]: [pid: 207600|app: 0|req: 624/1250] 10.222.0.42 () {56 vars in 1099 bytes} [Thu Jul 28 08:27:41 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:27:42.055982 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b103fda-309b-4045-872a-fa3274f1654c None admin] Authenticating user token {{(pid=207601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:27:42.154276 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG dbcounter [-] [207601] Writing DB stats keystone:SELECT=100 {{(pid=207601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:27:42.190708 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b103fda-309b-4045-872a-fa3274f1654c None admin] Validating token access rules against request {{(pid=207601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:27:42.236501 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-013074a7-50e9-408c-b4b0-93030b4f750d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:27:42.237270 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013074a7-50e9-408c-b4b0-93030b4f750d None admin] REQUEST_METHOD: `GET` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:27:42.237489 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013074a7-50e9-408c-b4b0-93030b4f750d None admin] SCRIPT_NAME: `/identity` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:27:42.237762 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013074a7-50e9-408c-b4b0-93030b4f750d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:27:42.250694 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-013074a7-50e9-408c-b4b0-93030b4f750d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:27:42.255384 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-013074a7-50e9-408c-b4b0-93030b4f750d None admin] RBAC: Authorization granted {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:27:42.272093 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application [None req-013074a7-50e9-408c-b4b0-93030b4f750d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 08:27:42.272093 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:27:42.272093 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:27:42.272093 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:27:42.272093 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:27:42.272093 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:27:42.272093 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:27:42.272093 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:27:42.272093 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:27:42.272093 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:27:42.272093 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:27:42.272093 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:27:42.272093 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 08:27:42.272093 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 08:27:42.272093 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 08:27:42.273962 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 08:27:42.273962 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:27:42.273962 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:27:42.273962 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:27:42.273962 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:27:42.273962 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:27:42.273962 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:27:42.273962 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:27:42.273962 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application with Lock( Jul 28 08:27:42.273962 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:27:42.273962 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:27:42.273962 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:27:42.273962 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:27:42.273962 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:27:42.273962 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:27:42.273962 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:27:42.273962 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:27:42.275352 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 08:27:42.275352 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 08:27:42.275352 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 08:27:42.275352 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application Jul 28 08:27:42.275352 dv-cinder-851351-1-smb devstack@keystone.service[207601]: [pid: 207601|app: 0|req: 627/1251] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 08:27:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:27:42.284480 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c9eb16-9255-4113-8e37-0c8914005140 None admin] Authenticating user token {{(pid=207600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:27:42.450695 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c9eb16-9255-4113-8e37-0c8914005140 None admin] Validating token access rules against request {{(pid=207600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:27:42.506062 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab14dbdb-ae1c-4173-b5da-8cddc00ec363 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:27:42.506954 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab14dbdb-ae1c-4173-b5da-8cddc00ec363 None admin] REQUEST_METHOD: `GET` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:27:42.507450 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab14dbdb-ae1c-4173-b5da-8cddc00ec363 None admin] SCRIPT_NAME: `/identity` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:27:42.507785 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab14dbdb-ae1c-4173-b5da-8cddc00ec363 None admin] PATH_INFO: `/v3/domains` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:27:42.508631 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab14dbdb-ae1c-4173-b5da-8cddc00ec363 None admin] RBAC: Adding query filter params (name=Default) {{(pid=207600) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:27:42.509086 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab14dbdb-ae1c-4173-b5da-8cddc00ec363 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:27:42.511246 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab14dbdb-ae1c-4173-b5da-8cddc00ec363 None admin] RBAC: Authorization granted {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:27:42.532354 dv-cinder-851351-1-smb devstack@keystone.service[207600]: [pid: 207600|app: 0|req: 625/1252] 10.222.0.42 () {56 vars in 1109 bytes} [Thu Jul 28 08:27:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:27:42.539832 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-013074a7-50e9-408c-b4b0-93030b4f750d None admin] Authenticating user token {{(pid=207601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:27:42.703677 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-013074a7-50e9-408c-b4b0-93030b4f750d None admin] Validating token access rules against request {{(pid=207601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:27:42.749160 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG dbcounter [-] [207601] Writing DB stats keystone:SELECT=100 {{(pid=207601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:27:42.762006 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47b1933-9640-42c9-b36d-82dc84d5073c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:27:42.762975 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47b1933-9640-42c9-b36d-82dc84d5073c None admin] REQUEST_METHOD: `GET` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:27:42.763429 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47b1933-9640-42c9-b36d-82dc84d5073c None admin] SCRIPT_NAME: `/identity` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:27:42.763870 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47b1933-9640-42c9-b36d-82dc84d5073c None admin] PATH_INFO: `/v3/users/placement` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:27:42.779512 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e47b1933-9640-42c9-b36d-82dc84d5073c None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:27:42.781221 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e47b1933-9640-42c9-b36d-82dc84d5073c None admin] RBAC: Authorization granted {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:27:42.795293 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application [None req-e47b1933-9640-42c9-b36d-82dc84d5073c None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 28 08:27:42.795293 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:27:42.795293 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:27:42.795293 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:27:42.795293 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:27:42.795293 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:27:42.795293 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:27:42.795293 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:27:42.795293 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:27:42.795293 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:27:42.795293 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:27:42.795293 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:27:42.795293 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 28 08:27:42.795293 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 28 08:27:42.795293 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 28 08:27:42.795293 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 28 08:27:42.797386 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:27:42.797386 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:27:42.797386 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 28 08:27:42.797386 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 08:27:42.797386 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 28 08:27:42.797386 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 08:27:42.797386 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:27:42.797386 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:27:42.797386 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:27:42.797386 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:27:42.797386 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:27:42.797386 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application with Lock( Jul 28 08:27:42.797386 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:27:42.797386 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:27:42.797386 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:27:42.797386 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:27:42.797386 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:27:42.797386 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:27:42.799509 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:27:42.799509 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:27:42.799509 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 28 08:27:42.799509 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 28 08:27:42.799509 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 28 08:27:42.799509 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 28 08:27:42.799509 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 28 08:27:42.799509 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 28 08:27:42.799509 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 28 08:27:42.799509 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application Jul 28 08:27:42.799509 dv-cinder-851351-1-smb devstack@keystone.service[207601]: [pid: 207601|app: 0|req: 628/1253] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 08:27:42 2022] GET /identity/v3/users/placement => generated 87 bytes in 258 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:27:42.803812 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab14dbdb-ae1c-4173-b5da-8cddc00ec363 None admin] Authenticating user token {{(pid=207600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:27:42.888136 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG dbcounter [-] [207600] Writing DB stats keystone:SELECT=100 {{(pid=207600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:27:42.959602 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab14dbdb-ae1c-4173-b5da-8cddc00ec363 None admin] Validating token access rules against request {{(pid=207600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:27:43.023861 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702433d6-44b8-4d56-b1de-d4fe063d62e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:27:43.024791 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702433d6-44b8-4d56-b1de-d4fe063d62e4 None admin] REQUEST_METHOD: `GET` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:27:43.025247 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702433d6-44b8-4d56-b1de-d4fe063d62e4 None admin] SCRIPT_NAME: `/identity` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:27:43.025690 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702433d6-44b8-4d56-b1de-d4fe063d62e4 None admin] PATH_INFO: `/v3/users` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:27:43.026974 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-702433d6-44b8-4d56-b1de-d4fe063d62e4 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=207600) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:27:43.027425 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-702433d6-44b8-4d56-b1de-d4fe063d62e4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:27:43.032653 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-702433d6-44b8-4d56-b1de-d4fe063d62e4 None admin] RBAC: Authorization granted {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:27:43.056125 dv-cinder-851351-1-smb devstack@keystone.service[207600]: [pid: 207600|app: 0|req: 626/1254] 10.222.0.42 () {56 vars in 1143 bytes} [Thu Jul 28 08:27:42 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:27:43.065903 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47b1933-9640-42c9-b36d-82dc84d5073c None admin] Authenticating user token {{(pid=207601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:27:43.239483 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47b1933-9640-42c9-b36d-82dc84d5073c None admin] Validating token access rules against request {{(pid=207601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:27:43.302418 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-babc1a9d-7aff-4d81-b07c-493a21b0b319 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:27:43.303458 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babc1a9d-7aff-4d81-b07c-493a21b0b319 None admin] REQUEST_METHOD: `GET` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:27:43.303960 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babc1a9d-7aff-4d81-b07c-493a21b0b319 None admin] SCRIPT_NAME: `/identity` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:27:43.305195 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babc1a9d-7aff-4d81-b07c-493a21b0b319 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:27:43.382185 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG dbcounter [-] [207601] Writing DB stats keystone:SELECT=100 {{(pid=207601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:27:43.400200 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-babc1a9d-7aff-4d81-b07c-493a21b0b319 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:27:43.402365 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-babc1a9d-7aff-4d81-b07c-493a21b0b319 None admin] RBAC: Authorization granted {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:27:43.567675 dv-cinder-851351-1-smb devstack@keystone.service[207601]: [pid: 207601|app: 0|req: 629/1255] 10.222.0.42 () {58 vars in 1282 bytes} [Thu Jul 28 08:27:43 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 502 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jul 28 08:27:43.574514 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702433d6-44b8-4d56-b1de-d4fe063d62e4 None admin] Authenticating user token {{(pid=207600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:27:43.732320 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702433d6-44b8-4d56-b1de-d4fe063d62e4 None admin] Validating token access rules against request {{(pid=207600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:27:43.751204 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG dbcounter [-] [207600] Writing DB stats keystone:SELECT=100 {{(pid=207600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:27:43.782419 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3bcc17b-fcf1-45eb-a7a4-4ae0cf830102 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:27:43.783642 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3bcc17b-fcf1-45eb-a7a4-4ae0cf830102 None admin] REQUEST_METHOD: `GET` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:27:43.784146 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3bcc17b-fcf1-45eb-a7a4-4ae0cf830102 None admin] SCRIPT_NAME: `/identity` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:27:43.784636 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3bcc17b-fcf1-45eb-a7a4-4ae0cf830102 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:27:43.806609 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3bcc17b-fcf1-45eb-a7a4-4ae0cf830102 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:27:43.809556 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3bcc17b-fcf1-45eb-a7a4-4ae0cf830102 None admin] RBAC: Authorization granted {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:27:43.841335 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application [None req-b3bcc17b-fcf1-45eb-a7a4-4ae0cf830102 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 08:27:43.841335 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:27:43.841335 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:27:43.841335 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:27:43.841335 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:27:43.841335 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:27:43.841335 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:27:43.841335 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:27:43.841335 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:27:43.841335 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:27:43.841335 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:27:43.841335 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:27:43.841335 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 08:27:43.841335 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 08:27:43.841335 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 08:27:43.842665 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 08:27:43.842665 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:27:43.842665 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:27:43.842665 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:27:43.842665 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:27:43.842665 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:27:43.842665 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:27:43.842665 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:27:43.842665 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application with Lock( Jul 28 08:27:43.842665 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:27:43.842665 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:27:43.842665 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:27:43.842665 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:27:43.842665 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:27:43.842665 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:27:43.842665 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:27:43.842665 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:27:43.843665 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 08:27:43.843665 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 08:27:43.843665 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 08:27:43.843665 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application Jul 28 08:27:43.843665 dv-cinder-851351-1-smb devstack@keystone.service[207600]: [pid: 207600|app: 0|req: 627/1256] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 08:27:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 270 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:27:43.850606 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-babc1a9d-7aff-4d81-b07c-493a21b0b319 None admin] Authenticating user token {{(pid=207601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:27:43.991159 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG dbcounter [-] [207601] Writing DB stats keystone:SELECT=100 {{(pid=207601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:27:44.009617 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-babc1a9d-7aff-4d81-b07c-493a21b0b319 None admin] Validating token access rules against request {{(pid=207601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:27:44.052089 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec03755-17aa-477d-91bc-fd007f005ffb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:27:44.052787 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec03755-17aa-477d-91bc-fd007f005ffb None admin] REQUEST_METHOD: `GET` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:27:44.053067 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec03755-17aa-477d-91bc-fd007f005ffb None admin] SCRIPT_NAME: `/identity` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:27:44.054367 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec03755-17aa-477d-91bc-fd007f005ffb None admin] PATH_INFO: `/v3/domains` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:27:44.055111 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ec03755-17aa-477d-91bc-fd007f005ffb None admin] RBAC: Adding query filter params (name=Default) {{(pid=207601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:27:44.055421 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ec03755-17aa-477d-91bc-fd007f005ffb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:27:44.056966 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ec03755-17aa-477d-91bc-fd007f005ffb None admin] RBAC: Authorization granted {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:27:44.071393 dv-cinder-851351-1-smb devstack@keystone.service[207601]: [pid: 207601|app: 0|req: 630/1257] 10.222.0.42 () {56 vars in 1109 bytes} [Thu Jul 28 08:27:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:27:44.078511 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3bcc17b-fcf1-45eb-a7a4-4ae0cf830102 None admin] Authenticating user token {{(pid=207600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:27:44.212104 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3bcc17b-fcf1-45eb-a7a4-4ae0cf830102 None admin] Validating token access rules against request {{(pid=207600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:27:44.258675 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5d48c0-be60-4b6e-8795-f42826122344 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:27:44.259405 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5d48c0-be60-4b6e-8795-f42826122344 None admin] REQUEST_METHOD: `GET` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:27:44.259696 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5d48c0-be60-4b6e-8795-f42826122344 None admin] SCRIPT_NAME: `/identity` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:27:44.260001 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5d48c0-be60-4b6e-8795-f42826122344 None admin] PATH_INFO: `/v3/projects/service` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:27:44.268380 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b5d48c0-be60-4b6e-8795-f42826122344 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:27:44.270098 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b5d48c0-be60-4b6e-8795-f42826122344 None admin] RBAC: Authorization granted {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:27:44.287686 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application [None req-1b5d48c0-be60-4b6e-8795-f42826122344 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 08:27:44.287686 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:27:44.287686 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:27:44.287686 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:27:44.287686 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:27:44.287686 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:27:44.287686 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:27:44.287686 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:27:44.287686 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:27:44.287686 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:27:44.287686 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:27:44.287686 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:27:44.287686 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 28 08:27:44.287686 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 28 08:27:44.287686 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 28 08:27:44.289619 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 28 08:27:44.289619 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:27:44.289619 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:27:44.289619 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:27:44.289619 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:27:44.289619 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:27:44.289619 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:27:44.289619 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:27:44.289619 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application with Lock( Jul 28 08:27:44.289619 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:27:44.289619 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:27:44.289619 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:27:44.289619 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:27:44.289619 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:27:44.289619 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:27:44.289619 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:27:44.289619 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:27:44.292140 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 28 08:27:44.292140 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 28 08:27:44.292140 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 28 08:27:44.292140 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 28 08:27:44.292140 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 28 08:27:44.292140 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 28 08:27:44.292140 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 08:27:44.292140 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application Jul 28 08:27:44.292140 dv-cinder-851351-1-smb devstack@keystone.service[207600]: [pid: 207600|app: 0|req: 628/1258] 10.222.0.42 () {56 vars in 1111 bytes} [Thu Jul 28 08:27:44 2022] GET /identity/v3/projects/service => generated 88 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 08:27:44.295437 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec03755-17aa-477d-91bc-fd007f005ffb None admin] Authenticating user token {{(pid=207601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:27:44.437553 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec03755-17aa-477d-91bc-fd007f005ffb None admin] Validating token access rules against request {{(pid=207601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:27:44.493956 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79afb52a-07df-409e-ac26-9fc8212bf323 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:27:44.494918 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79afb52a-07df-409e-ac26-9fc8212bf323 None admin] REQUEST_METHOD: `GET` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:27:44.495399 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79afb52a-07df-409e-ac26-9fc8212bf323 None admin] SCRIPT_NAME: `/identity` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:27:44.495874 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79afb52a-07df-409e-ac26-9fc8212bf323 None admin] PATH_INFO: `/v3/projects` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:27:44.497262 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79afb52a-07df-409e-ac26-9fc8212bf323 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=207601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:27:44.497816 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79afb52a-07df-409e-ac26-9fc8212bf323 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:27:44.500540 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79afb52a-07df-409e-ac26-9fc8212bf323 None admin] RBAC: Authorization granted {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:27:44.522024 dv-cinder-851351-1-smb devstack@keystone.service[207601]: [pid: 207601|app: 0|req: 631/1259] 10.222.0.42 () {56 vars in 1148 bytes} [Thu Jul 28 08:27:44 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:27:44.529057 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5d48c0-be60-4b6e-8795-f42826122344 None admin] Authenticating user token {{(pid=207600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:27:44.565381 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG dbcounter [-] [207600] Writing DB stats keystone:SELECT=100 {{(pid=207600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:27:44.680900 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5d48c0-be60-4b6e-8795-f42826122344 None admin] Validating token access rules against request {{(pid=207600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:27:44.748647 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7538599e-a3b7-435f-86f5-598f2d468f37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:27:44.749809 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7538599e-a3b7-435f-86f5-598f2d468f37 None admin] REQUEST_METHOD: `GET` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:27:44.750403 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7538599e-a3b7-435f-86f5-598f2d468f37 None admin] SCRIPT_NAME: `/identity` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:27:44.750982 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7538599e-a3b7-435f-86f5-598f2d468f37 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:27:44.753696 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7538599e-a3b7-435f-86f5-598f2d468f37 None admin] RBAC: Adding query filter params (role.id=d0ce88034c6b41878db755343f5840be, scope.project.id=48c5f2b2ae2b48758b957d2b194a7fd1, user.id=954803a75b6c4c46b7ab8818fc89c275) {{(pid=207600) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:27:44.754200 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7538599e-a3b7-435f-86f5-598f2d468f37 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:27:44.756569 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7538599e-a3b7-435f-86f5-598f2d468f37 None admin] RBAC: Authorization granted {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:27:44.764702 dv-cinder-851351-1-smb devstack@keystone.service[207600]: [pid: 207600|app: 0|req: 629/1260] 10.222.0.42 () {56 vars in 1374 bytes} [Thu Jul 28 08:27:44 2022] GET /identity/v3/role_assignments?user.id=954803a75b6c4c46b7ab8818fc89c275&scope.project.id=48c5f2b2ae2b48758b957d2b194a7fd1&role.id=d0ce88034c6b41878db755343f5840be => generated 259 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:27:47.045879 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76974720-6d63-48c4-85b2-af6bf00fd6af None None] REQUEST_METHOD: `GET` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:27:47.046494 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76974720-6d63-48c4-85b2-af6bf00fd6af None None] SCRIPT_NAME: `/identity` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:27:47.046494 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76974720-6d63-48c4-85b2-af6bf00fd6af None None] PATH_INFO: `/` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:27:47.047778 dv-cinder-851351-1-smb devstack@keystone.service[207601]: [pid: 207601|app: 0|req: 632/1261] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 08:27:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 08:27:47.053796 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4418e08b-4c27-4165-b841-f5d85f6a0b6a None None] REQUEST_METHOD: `POST` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:27:47.054366 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4418e08b-4c27-4165-b841-f5d85f6a0b6a None None] SCRIPT_NAME: `/identity` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:27:47.054366 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4418e08b-4c27-4165-b841-f5d85f6a0b6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:27:47.075836 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.auth.core [None req-4418e08b-4c27-4165-b841-f5d85f6a0b6a None None] MFA Rules not processed for user `b8110ade874c4aa7af27f5c376df700a`. Rule list: `[]` (Enabled: `True`). {{(pid=207600) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 08:27:47.077139 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.fernet_utils [None req-4418e08b-4c27-4165-b841-f5d85f6a0b6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=207600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:27:47.152182 dv-cinder-851351-1-smb devstack@keystone.service[207600]: [pid: 207600|app: 0|req: 630/1262] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 08:27:47 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 08:27:47.175360 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76974720-6d63-48c4-85b2-af6bf00fd6af None None] Authenticating user token {{(pid=207601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:27:47.187543 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG dbcounter [-] [207601] Writing DB stats keystone:SELECT=100 {{(pid=207601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:27:47.345007 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76974720-6d63-48c4-85b2-af6bf00fd6af None None] Validating token access rules against request {{(pid=207601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:27:47.403678 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d318c6-2262-4bd1-95dd-78405f6e24c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:27:47.404640 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d318c6-2262-4bd1-95dd-78405f6e24c1 None admin] REQUEST_METHOD: `GET` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:27:47.405194 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d318c6-2262-4bd1-95dd-78405f6e24c1 None admin] SCRIPT_NAME: `/identity` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:27:47.405643 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d318c6-2262-4bd1-95dd-78405f6e24c1 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:27:47.424643 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10d318c6-2262-4bd1-95dd-78405f6e24c1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 08:27:47.433779 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application [None req-10d318c6-2262-4bd1-95dd-78405f6e24c1 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 08:27:47.433779 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:27:47.433779 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:27:47.433779 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:27:47.433779 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:27:47.433779 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:27:47.433779 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:27:47.433779 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:27:47.433779 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:27:47.433779 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:27:47.433779 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:27:47.433779 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:27:47.433779 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 08:27:47.433779 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 08:27:47.433779 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 08:27:47.433779 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 08:27:47.434997 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 08:27:47.434997 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 08:27:47.434997 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 08:27:47.434997 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 08:27:47.434997 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:27:47.434997 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:27:47.434997 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:27:47.434997 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:27:47.434997 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:27:47.434997 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:27:47.434997 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:27:47.434997 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application with Lock( Jul 28 08:27:47.434997 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:27:47.434997 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:27:47.434997 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:27:47.434997 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:27:47.436182 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:27:47.436182 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:27:47.436182 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:27:47.436182 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:27:47.436182 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 08:27:47.436182 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 08:27:47.436182 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 08:27:47.436182 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 08:27:47.436182 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 08:27:47.436182 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 08:27:47.436182 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 08:27:47.436182 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application Jul 28 08:27:47.436182 dv-cinder-851351-1-smb devstack@keystone.service[207601]: [pid: 207601|app: 0|req: 633/1263] 10.222.0.42 () {56 vars in 1096 bytes} [Thu Jul 28 08:27:47 2022] GET /identity/v3/roles/admin => generated 83 bytes in 261 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:27:47.442374 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4418e08b-4c27-4165-b841-f5d85f6a0b6a None None] Authenticating user token {{(pid=207600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:27:47.465708 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG dbcounter [-] [207600] Writing DB stats keystone:SELECT=100 {{(pid=207600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:27:47.566601 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4418e08b-4c27-4165-b841-f5d85f6a0b6a None None] Validating token access rules against request {{(pid=207600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:27:47.606924 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c22606f-b834-4391-ba1b-a327b9b9e013 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:27:47.607554 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c22606f-b834-4391-ba1b-a327b9b9e013 None admin] REQUEST_METHOD: `GET` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:27:47.607834 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c22606f-b834-4391-ba1b-a327b9b9e013 None admin] SCRIPT_NAME: `/identity` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:27:47.608106 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c22606f-b834-4391-ba1b-a327b9b9e013 None admin] PATH_INFO: `/v3/roles` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:27:47.608879 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c22606f-b834-4391-ba1b-a327b9b9e013 None admin] RBAC: Adding query filter params (name=admin) {{(pid=207600) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:27:47.609170 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c22606f-b834-4391-ba1b-a327b9b9e013 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:27:47.610565 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c22606f-b834-4391-ba1b-a327b9b9e013 None admin] RBAC: Authorization granted {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:27:47.620542 dv-cinder-851351-1-smb devstack@keystone.service[207600]: [pid: 207600|app: 0|req: 631/1264] 10.222.0.42 () {56 vars in 1099 bytes} [Thu Jul 28 08:27:47 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:27:47.626701 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d318c6-2262-4bd1-95dd-78405f6e24c1 None admin] Authenticating user token {{(pid=207601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:27:47.699236 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG dbcounter [-] [207601] Writing DB stats keystone:SELECT=100 {{(pid=207601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:27:47.736189 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d318c6-2262-4bd1-95dd-78405f6e24c1 None admin] Validating token access rules against request {{(pid=207601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:27:47.773183 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd8d3bd-b94b-42dd-be2b-3a9111d39061 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:27:47.773836 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd8d3bd-b94b-42dd-be2b-3a9111d39061 None admin] REQUEST_METHOD: `GET` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:27:47.774121 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd8d3bd-b94b-42dd-be2b-3a9111d39061 None admin] SCRIPT_NAME: `/identity` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:27:47.774380 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd8d3bd-b94b-42dd-be2b-3a9111d39061 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:27:47.786007 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fd8d3bd-b94b-42dd-be2b-3a9111d39061 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:27:47.787996 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fd8d3bd-b94b-42dd-be2b-3a9111d39061 None admin] RBAC: Authorization granted {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:27:47.804244 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application [None req-5fd8d3bd-b94b-42dd-be2b-3a9111d39061 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 08:27:47.804244 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:27:47.804244 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:27:47.804244 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:27:47.804244 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:27:47.804244 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:27:47.804244 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:27:47.804244 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:27:47.804244 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:27:47.804244 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:27:47.804244 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:27:47.804244 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:27:47.804244 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 08:27:47.804244 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 08:27:47.804244 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 08:27:47.811450 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 08:27:47.811450 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:27:47.811450 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:27:47.811450 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:27:47.811450 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:27:47.811450 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:27:47.811450 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:27:47.811450 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:27:47.811450 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application with Lock( Jul 28 08:27:47.811450 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:27:47.811450 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:27:47.811450 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:27:47.811450 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:27:47.811450 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:27:47.811450 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:27:47.811450 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:27:47.811450 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:27:47.812695 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 08:27:47.812695 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 08:27:47.812695 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 08:27:47.812695 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application Jul 28 08:27:47.812695 dv-cinder-851351-1-smb devstack@keystone.service[207601]: [pid: 207601|app: 0|req: 634/1265] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 08:27:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:27:47.813084 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c22606f-b834-4391-ba1b-a327b9b9e013 None admin] Authenticating user token {{(pid=207600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:27:47.910549 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG dbcounter [-] [207600] Writing DB stats keystone:SELECT=100 {{(pid=207600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:27:47.930890 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c22606f-b834-4391-ba1b-a327b9b9e013 None admin] Validating token access rules against request {{(pid=207600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:27:47.967037 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5966d79-b406-4bbc-b077-3dac74c3d1e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:27:47.967583 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5966d79-b406-4bbc-b077-3dac74c3d1e7 None admin] REQUEST_METHOD: `GET` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:27:47.967865 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5966d79-b406-4bbc-b077-3dac74c3d1e7 None admin] SCRIPT_NAME: `/identity` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:27:47.968138 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5966d79-b406-4bbc-b077-3dac74c3d1e7 None admin] PATH_INFO: `/v3/domains` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:27:47.968875 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5966d79-b406-4bbc-b077-3dac74c3d1e7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=207600) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:27:47.969219 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5966d79-b406-4bbc-b077-3dac74c3d1e7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:27:47.970726 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5966d79-b406-4bbc-b077-3dac74c3d1e7 None admin] RBAC: Authorization granted {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:27:47.983177 dv-cinder-851351-1-smb devstack@keystone.service[207600]: [pid: 207600|app: 0|req: 632/1266] 10.222.0.42 () {56 vars in 1109 bytes} [Thu Jul 28 08:27:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 08:27:47.989440 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd8d3bd-b94b-42dd-be2b-3a9111d39061 None admin] Authenticating user token {{(pid=207601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:27:48.096014 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd8d3bd-b94b-42dd-be2b-3a9111d39061 None admin] Validating token access rules against request {{(pid=207601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:27:48.117290 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG dbcounter [-] [207601] Writing DB stats keystone:SELECT=100 {{(pid=207601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:27:48.133263 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-385ad0a5-64cc-4e2f-a338-d4456224f020 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:27:48.133940 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385ad0a5-64cc-4e2f-a338-d4456224f020 None admin] REQUEST_METHOD: `GET` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:27:48.134225 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385ad0a5-64cc-4e2f-a338-d4456224f020 None admin] SCRIPT_NAME: `/identity` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:27:48.134496 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385ad0a5-64cc-4e2f-a338-d4456224f020 None admin] PATH_INFO: `/v3/users/placement` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:27:48.143475 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-385ad0a5-64cc-4e2f-a338-d4456224f020 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:27:48.144948 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-385ad0a5-64cc-4e2f-a338-d4456224f020 None admin] RBAC: Authorization granted {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:27:48.157313 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application [None req-385ad0a5-64cc-4e2f-a338-d4456224f020 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 28 08:27:48.157313 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:27:48.157313 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:27:48.157313 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:27:48.157313 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:27:48.157313 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:27:48.157313 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:27:48.157313 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:27:48.157313 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:27:48.157313 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:27:48.157313 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:27:48.157313 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:27:48.157313 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 28 08:27:48.157313 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 28 08:27:48.157313 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 28 08:27:48.157313 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 28 08:27:48.159171 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:27:48.159171 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:27:48.159171 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 28 08:27:48.159171 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 08:27:48.159171 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 28 08:27:48.159171 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 08:27:48.159171 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:27:48.159171 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:27:48.159171 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:27:48.159171 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:27:48.159171 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:27:48.159171 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application with Lock( Jul 28 08:27:48.159171 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:27:48.159171 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:27:48.159171 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:27:48.159171 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:27:48.159171 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:27:48.159171 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:27:48.161145 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:27:48.161145 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:27:48.161145 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 28 08:27:48.161145 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 28 08:27:48.161145 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 28 08:27:48.161145 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 28 08:27:48.161145 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 28 08:27:48.161145 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 28 08:27:48.161145 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 28 08:27:48.161145 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application Jul 28 08:27:48.161145 dv-cinder-851351-1-smb devstack@keystone.service[207601]: [pid: 207601|app: 0|req: 635/1267] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 08:27:47 2022] GET /identity/v3/users/placement => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:27:48.164789 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5966d79-b406-4bbc-b077-3dac74c3d1e7 None admin] Authenticating user token {{(pid=207600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:27:48.269953 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5966d79-b406-4bbc-b077-3dac74c3d1e7 None admin] Validating token access rules against request {{(pid=207600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:27:48.306412 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81a000c-11f6-46ef-81ae-49fe56765b82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:27:48.307046 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81a000c-11f6-46ef-81ae-49fe56765b82 None admin] REQUEST_METHOD: `GET` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:27:48.307330 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81a000c-11f6-46ef-81ae-49fe56765b82 None admin] SCRIPT_NAME: `/identity` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:27:48.307602 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81a000c-11f6-46ef-81ae-49fe56765b82 None admin] PATH_INFO: `/v3/users` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:27:48.308426 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e81a000c-11f6-46ef-81ae-49fe56765b82 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=207600) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:27:48.308769 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e81a000c-11f6-46ef-81ae-49fe56765b82 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:27:48.310233 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e81a000c-11f6-46ef-81ae-49fe56765b82 None admin] RBAC: Authorization granted {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:27:48.320880 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG dbcounter [-] [207600] Writing DB stats keystone:SELECT=100 {{(pid=207600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:27:48.336977 dv-cinder-851351-1-smb devstack@keystone.service[207600]: [pid: 207600|app: 0|req: 633/1268] 10.222.0.42 () {56 vars in 1143 bytes} [Thu Jul 28 08:27:48 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:27:48.343113 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-385ad0a5-64cc-4e2f-a338-d4456224f020 None admin] Authenticating user token {{(pid=207601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:27:48.448775 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-385ad0a5-64cc-4e2f-a338-d4456224f020 None admin] Validating token access rules against request {{(pid=207601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:27:48.487291 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5763b5-469e-46ea-9c96-cbc8567d5360 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:27:48.487952 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5763b5-469e-46ea-9c96-cbc8567d5360 None admin] REQUEST_METHOD: `GET` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:27:48.488231 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5763b5-469e-46ea-9c96-cbc8567d5360 None admin] SCRIPT_NAME: `/identity` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:27:48.488500 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5763b5-469e-46ea-9c96-cbc8567d5360 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:27:48.499816 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f5763b5-469e-46ea-9c96-cbc8567d5360 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:27:48.501324 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f5763b5-469e-46ea-9c96-cbc8567d5360 None admin] RBAC: Authorization granted {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:27:48.516032 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application [None req-1f5763b5-469e-46ea-9c96-cbc8567d5360 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 08:27:48.516032 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:27:48.516032 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:27:48.516032 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:27:48.516032 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:27:48.516032 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:27:48.516032 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:27:48.516032 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:27:48.516032 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:27:48.516032 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:27:48.516032 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:27:48.516032 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:27:48.516032 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 08:27:48.516032 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 08:27:48.516032 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 08:27:48.517470 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 08:27:48.517470 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:27:48.517470 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:27:48.517470 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:27:48.517470 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:27:48.517470 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:27:48.517470 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:27:48.517470 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:27:48.517470 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application with Lock( Jul 28 08:27:48.517470 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:27:48.517470 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:27:48.517470 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:27:48.517470 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:27:48.517470 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:27:48.517470 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:27:48.517470 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:27:48.517470 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:27:48.519268 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 08:27:48.519268 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 08:27:48.519268 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 08:27:48.519268 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application Jul 28 08:27:48.519268 dv-cinder-851351-1-smb devstack@keystone.service[207601]: [pid: 207601|app: 0|req: 636/1269] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 08:27:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:27:48.525132 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81a000c-11f6-46ef-81ae-49fe56765b82 None admin] Authenticating user token {{(pid=207600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:27:48.646840 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81a000c-11f6-46ef-81ae-49fe56765b82 None admin] Validating token access rules against request {{(pid=207600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:27:48.683087 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd777b9-1322-4710-9d18-d60f3cf1225f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:27:48.683718 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd777b9-1322-4710-9d18-d60f3cf1225f None admin] REQUEST_METHOD: `GET` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:27:48.684003 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd777b9-1322-4710-9d18-d60f3cf1225f None admin] SCRIPT_NAME: `/identity` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:27:48.684264 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd777b9-1322-4710-9d18-d60f3cf1225f None admin] PATH_INFO: `/v3/domains` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:27:48.685008 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccd777b9-1322-4710-9d18-d60f3cf1225f None admin] RBAC: Adding query filter params (name=Default) {{(pid=207600) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:27:48.685317 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccd777b9-1322-4710-9d18-d60f3cf1225f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:27:48.686710 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccd777b9-1322-4710-9d18-d60f3cf1225f None admin] RBAC: Authorization granted {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:27:48.698663 dv-cinder-851351-1-smb devstack@keystone.service[207600]: [pid: 207600|app: 0|req: 634/1270] 10.222.0.42 () {56 vars in 1109 bytes} [Thu Jul 28 08:27:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:27:48.704831 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5763b5-469e-46ea-9c96-cbc8567d5360 None admin] Authenticating user token {{(pid=207601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:27:48.740533 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG dbcounter [-] [207601] Writing DB stats keystone:SELECT=100 {{(pid=207601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:27:48.814498 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5763b5-469e-46ea-9c96-cbc8567d5360 None admin] Validating token access rules against request {{(pid=207601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:27:48.852092 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a40a53-5fe0-4346-a0e3-091c2bc4389e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:27:48.852773 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a40a53-5fe0-4346-a0e3-091c2bc4389e None admin] REQUEST_METHOD: `GET` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:27:48.853068 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a40a53-5fe0-4346-a0e3-091c2bc4389e None admin] SCRIPT_NAME: `/identity` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:27:48.853321 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a40a53-5fe0-4346-a0e3-091c2bc4389e None admin] PATH_INFO: `/v3/projects/service` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:27:48.860705 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5a40a53-5fe0-4346-a0e3-091c2bc4389e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:27:48.862207 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5a40a53-5fe0-4346-a0e3-091c2bc4389e None admin] RBAC: Authorization granted {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:27:48.874257 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application [None req-b5a40a53-5fe0-4346-a0e3-091c2bc4389e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 08:27:48.874257 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:27:48.874257 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:27:48.874257 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:27:48.874257 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:27:48.874257 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:27:48.874257 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:27:48.874257 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:27:48.874257 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:27:48.874257 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:27:48.874257 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:27:48.874257 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:27:48.874257 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 28 08:27:48.874257 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 28 08:27:48.874257 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 28 08:27:48.875456 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 28 08:27:48.875456 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:27:48.875456 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:27:48.875456 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:27:48.875456 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:27:48.875456 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:27:48.875456 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:27:48.875456 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:27:48.875456 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application with Lock( Jul 28 08:27:48.875456 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:27:48.875456 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:27:48.875456 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:27:48.875456 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:27:48.875456 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:27:48.875456 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:27:48.875456 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:27:48.875456 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:27:48.876636 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 28 08:27:48.876636 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 28 08:27:48.876636 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 28 08:27:48.876636 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 28 08:27:48.876636 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 28 08:27:48.876636 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 28 08:27:48.876636 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 08:27:48.876636 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application Jul 28 08:27:48.876636 dv-cinder-851351-1-smb devstack@keystone.service[207601]: [pid: 207601|app: 0|req: 637/1271] 10.222.0.42 () {56 vars in 1111 bytes} [Thu Jul 28 08:27:48 2022] GET /identity/v3/projects/service => generated 88 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:27:48.883217 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd777b9-1322-4710-9d18-d60f3cf1225f None admin] Authenticating user token {{(pid=207600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:27:48.947277 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG dbcounter [-] [207600] Writing DB stats keystone:SELECT=100 {{(pid=207600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:27:48.994066 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd777b9-1322-4710-9d18-d60f3cf1225f None admin] Validating token access rules against request {{(pid=207600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:27:49.031484 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0920267-4dd1-4ff7-8184-9978d7e355ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:27:49.032121 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0920267-4dd1-4ff7-8184-9978d7e355ec None admin] REQUEST_METHOD: `GET` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:27:49.032406 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0920267-4dd1-4ff7-8184-9978d7e355ec None admin] SCRIPT_NAME: `/identity` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:27:49.032718 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0920267-4dd1-4ff7-8184-9978d7e355ec None admin] PATH_INFO: `/v3/projects` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:27:49.033613 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0920267-4dd1-4ff7-8184-9978d7e355ec None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=207600) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:27:49.033925 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0920267-4dd1-4ff7-8184-9978d7e355ec None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:27:49.035422 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0920267-4dd1-4ff7-8184-9978d7e355ec None admin] RBAC: Authorization granted {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:27:49.048364 dv-cinder-851351-1-smb devstack@keystone.service[207600]: [pid: 207600|app: 0|req: 635/1272] 10.222.0.42 () {56 vars in 1148 bytes} [Thu Jul 28 08:27:48 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:27:49.054990 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a40a53-5fe0-4346-a0e3-091c2bc4389e None admin] Authenticating user token {{(pid=207601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:27:49.163033 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG dbcounter [-] [207601] Writing DB stats keystone:SELECT=100 {{(pid=207601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:27:49.173756 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a40a53-5fe0-4346-a0e3-091c2bc4389e None admin] Validating token access rules against request {{(pid=207601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:27:49.213601 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f16087-dae7-45f5-b6e6-cbc54502a5ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:27:49.214302 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f16087-dae7-45f5-b6e6-cbc54502a5ce None admin] REQUEST_METHOD: `PUT` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:27:49.214590 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f16087-dae7-45f5-b6e6-cbc54502a5ce None admin] SCRIPT_NAME: `/identity` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:27:49.214867 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f16087-dae7-45f5-b6e6-cbc54502a5ce None admin] PATH_INFO: `/v3/projects/48c5f2b2ae2b48758b957d2b194a7fd1/users/954803a75b6c4c46b7ab8818fc89c275/roles/d0ce88034c6b41878db755343f5840be` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:27:49.216991 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f16087-dae7-45f5-b6e6-cbc54502a5ce None admin] RBAC: Authorizing `identity:create_grant(project_id=48c5f2b2ae2b48758b957d2b194a7fd1, user_id=954803a75b6c4c46b7ab8818fc89c275, role_id=d0ce88034c6b41878db755343f5840be)` {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:27:49.218458 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f16087-dae7-45f5-b6e6-cbc54502a5ce None admin] RBAC: Authorization granted {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:27:49.236921 dv-cinder-851351-1-smb devstack@keystone.service[207601]: [pid: 207601|app: 0|req: 638/1273] 10.222.0.42 () {58 vars in 1439 bytes} [Thu Jul 28 08:27:49 2022] PUT /identity/v3/projects/48c5f2b2ae2b48758b957d2b194a7fd1/users/954803a75b6c4c46b7ab8818fc89c275/roles/d0ce88034c6b41878db755343f5840be => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 08:27:51.267917 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7103483-10e4-4639-bd57-18ddfe135c5b None None] REQUEST_METHOD: `GET` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:27:51.268470 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7103483-10e4-4639-bd57-18ddfe135c5b None None] SCRIPT_NAME: `/identity` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:27:51.268470 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7103483-10e4-4639-bd57-18ddfe135c5b None None] PATH_INFO: `/` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:27:51.269835 dv-cinder-851351-1-smb devstack@keystone.service[207600]: [pid: 207600|app: 0|req: 636/1274] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 08:27:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 08:27:51.275659 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90e7d8f-66ec-4106-961e-b1dd23a3fd21 None None] REQUEST_METHOD: `POST` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:27:51.276178 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90e7d8f-66ec-4106-961e-b1dd23a3fd21 None None] SCRIPT_NAME: `/identity` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:27:51.276320 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90e7d8f-66ec-4106-961e-b1dd23a3fd21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:27:51.297022 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.auth.core [None req-a90e7d8f-66ec-4106-961e-b1dd23a3fd21 None None] MFA Rules not processed for user `b8110ade874c4aa7af27f5c376df700a`. Rule list: `[]` (Enabled: `True`). {{(pid=207601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 08:27:51.298243 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.fernet_utils [None req-a90e7d8f-66ec-4106-961e-b1dd23a3fd21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=207601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:27:51.370540 dv-cinder-851351-1-smb devstack@keystone.service[207601]: [pid: 207601|app: 0|req: 639/1275] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 08:27:51 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 08:27:51.412509 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7103483-10e4-4639-bd57-18ddfe135c5b None None] Authenticating user token {{(pid=207600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:27:51.523064 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7103483-10e4-4639-bd57-18ddfe135c5b None None] Validating token access rules against request {{(pid=207600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:27:51.543967 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG dbcounter [-] [207600] Writing DB stats keystone:SELECT=100 {{(pid=207600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:27:51.566229 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53760a08-d2a1-4328-8481-bcaad131ce45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:27:51.567286 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53760a08-d2a1-4328-8481-bcaad131ce45 None admin] REQUEST_METHOD: `GET` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:27:51.567771 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53760a08-d2a1-4328-8481-bcaad131ce45 None admin] SCRIPT_NAME: `/identity` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:27:51.568202 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53760a08-d2a1-4328-8481-bcaad131ce45 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:27:51.584875 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53760a08-d2a1-4328-8481-bcaad131ce45 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 08:27:51.592330 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application [None req-53760a08-d2a1-4328-8481-bcaad131ce45 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 08:27:51.592330 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:27:51.592330 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:27:51.592330 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:27:51.592330 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:27:51.592330 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:27:51.592330 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:27:51.592330 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:27:51.592330 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:27:51.592330 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:27:51.592330 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:27:51.592330 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:27:51.592330 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 08:27:51.592330 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 08:27:51.592330 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 08:27:51.592330 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 08:27:51.593514 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 08:27:51.593514 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 08:27:51.593514 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 08:27:51.593514 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 08:27:51.593514 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:27:51.593514 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:27:51.593514 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:27:51.593514 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:27:51.593514 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:27:51.593514 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:27:51.593514 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:27:51.593514 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application with Lock( Jul 28 08:27:51.593514 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:27:51.593514 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:27:51.593514 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:27:51.593514 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:27:51.594738 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:27:51.594738 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:27:51.594738 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:27:51.594738 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:27:51.594738 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 08:27:51.594738 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 08:27:51.594738 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 08:27:51.594738 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 08:27:51.594738 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 08:27:51.594738 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 08:27:51.594738 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 08:27:51.594738 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application Jul 28 08:27:51.594738 dv-cinder-851351-1-smb devstack@keystone.service[207600]: [pid: 207600|app: 0|req: 637/1276] 10.222.0.42 () {56 vars in 1096 bytes} [Thu Jul 28 08:27:51 2022] GET /identity/v3/roles/admin => generated 83 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:27:51.601156 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a90e7d8f-66ec-4106-961e-b1dd23a3fd21 None None] Authenticating user token {{(pid=207601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:27:51.694015 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG dbcounter [-] [207601] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=207601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:27:51.716999 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a90e7d8f-66ec-4106-961e-b1dd23a3fd21 None None] Validating token access rules against request {{(pid=207601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:27:51.753957 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b689616-7f56-457d-b651-92651943d4d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:27:51.754617 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b689616-7f56-457d-b651-92651943d4d6 None admin] REQUEST_METHOD: `GET` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:27:51.754903 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b689616-7f56-457d-b651-92651943d4d6 None admin] SCRIPT_NAME: `/identity` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:27:51.755226 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b689616-7f56-457d-b651-92651943d4d6 None admin] PATH_INFO: `/v3/roles` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:27:51.756004 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b689616-7f56-457d-b651-92651943d4d6 None admin] RBAC: Adding query filter params (name=admin) {{(pid=207601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:27:51.756316 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b689616-7f56-457d-b651-92651943d4d6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:27:51.757756 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b689616-7f56-457d-b651-92651943d4d6 None admin] RBAC: Authorization granted {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:27:51.767101 dv-cinder-851351-1-smb devstack@keystone.service[207601]: [pid: 207601|app: 0|req: 640/1277] 10.222.0.42 () {56 vars in 1099 bytes} [Thu Jul 28 08:27:51 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 08:27:51.773198 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53760a08-d2a1-4328-8481-bcaad131ce45 None admin] Authenticating user token {{(pid=207600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:27:51.882169 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53760a08-d2a1-4328-8481-bcaad131ce45 None admin] Validating token access rules against request {{(pid=207600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:27:51.919472 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a51112-a788-4ebf-a145-f40eb3794c17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:27:51.920113 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a51112-a788-4ebf-a145-f40eb3794c17 None admin] REQUEST_METHOD: `GET` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:27:51.920383 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a51112-a788-4ebf-a145-f40eb3794c17 None admin] SCRIPT_NAME: `/identity` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:27:51.920678 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a51112-a788-4ebf-a145-f40eb3794c17 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:27:51.932360 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91a51112-a788-4ebf-a145-f40eb3794c17 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:27:51.934090 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91a51112-a788-4ebf-a145-f40eb3794c17 None admin] RBAC: Authorization granted {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:27:51.950096 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application [None req-91a51112-a788-4ebf-a145-f40eb3794c17 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 08:27:51.950096 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:27:51.950096 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:27:51.950096 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:27:51.950096 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:27:51.950096 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:27:51.950096 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:27:51.950096 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:27:51.950096 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:27:51.950096 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:27:51.950096 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:27:51.950096 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:27:51.950096 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 08:27:51.950096 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 08:27:51.950096 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 08:27:51.951338 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 08:27:51.951338 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:27:51.951338 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:27:51.951338 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:27:51.951338 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:27:51.951338 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:27:51.951338 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:27:51.951338 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:27:51.951338 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application with Lock( Jul 28 08:27:51.951338 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:27:51.951338 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:27:51.951338 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:27:51.951338 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:27:51.951338 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:27:51.951338 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:27:51.951338 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:27:51.951338 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:27:51.952325 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 08:27:51.952325 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 08:27:51.952325 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 08:27:51.952325 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application Jul 28 08:27:51.952325 dv-cinder-851351-1-smb devstack@keystone.service[207600]: [pid: 207600|app: 0|req: 638/1278] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 08:27:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:27:51.958487 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b689616-7f56-457d-b651-92651943d4d6 None admin] Authenticating user token {{(pid=207601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:27:52.074468 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b689616-7f56-457d-b651-92651943d4d6 None admin] Validating token access rules against request {{(pid=207601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:27:52.114374 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4a270a-90c3-4b83-86ed-8f2dc493ec13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:27:52.115035 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4a270a-90c3-4b83-86ed-8f2dc493ec13 None admin] REQUEST_METHOD: `GET` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:27:52.115318 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4a270a-90c3-4b83-86ed-8f2dc493ec13 None admin] SCRIPT_NAME: `/identity` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:27:52.115597 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4a270a-90c3-4b83-86ed-8f2dc493ec13 None admin] PATH_INFO: `/v3/domains` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:27:52.116309 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b4a270a-90c3-4b83-86ed-8f2dc493ec13 None admin] RBAC: Adding query filter params (name=Default) {{(pid=207601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:27:52.116628 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b4a270a-90c3-4b83-86ed-8f2dc493ec13 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:27:52.118070 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b4a270a-90c3-4b83-86ed-8f2dc493ec13 None admin] RBAC: Authorization granted {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:27:52.131834 dv-cinder-851351-1-smb devstack@keystone.service[207601]: [pid: 207601|app: 0|req: 641/1279] 10.222.0.42 () {56 vars in 1109 bytes} [Thu Jul 28 08:27:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:27:52.139010 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a51112-a788-4ebf-a145-f40eb3794c17 None admin] Authenticating user token {{(pid=207600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:27:52.174393 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG dbcounter [-] [207600] Writing DB stats keystone:SELECT=100 {{(pid=207600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:27:52.263041 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a51112-a788-4ebf-a145-f40eb3794c17 None admin] Validating token access rules against request {{(pid=207600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:27:52.298251 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa74cf72-63af-48fa-80d0-9e740a36cb22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:27:52.299063 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa74cf72-63af-48fa-80d0-9e740a36cb22 None admin] REQUEST_METHOD: `GET` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:27:52.299240 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa74cf72-63af-48fa-80d0-9e740a36cb22 None admin] SCRIPT_NAME: `/identity` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:27:52.299515 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa74cf72-63af-48fa-80d0-9e740a36cb22 None admin] PATH_INFO: `/v3/users/placement` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:27:52.308158 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa74cf72-63af-48fa-80d0-9e740a36cb22 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:27:52.309675 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa74cf72-63af-48fa-80d0-9e740a36cb22 None admin] RBAC: Authorization granted {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:27:52.321908 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application [None req-aa74cf72-63af-48fa-80d0-9e740a36cb22 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 28 08:27:52.321908 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:27:52.321908 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:27:52.321908 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:27:52.321908 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:27:52.321908 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:27:52.321908 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:27:52.321908 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:27:52.321908 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:27:52.321908 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:27:52.321908 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:27:52.321908 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:27:52.321908 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 28 08:27:52.321908 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 28 08:27:52.321908 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 28 08:27:52.321908 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 28 08:27:52.323869 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:27:52.323869 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:27:52.323869 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 28 08:27:52.323869 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 08:27:52.323869 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 28 08:27:52.323869 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 08:27:52.323869 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:27:52.323869 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:27:52.323869 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:27:52.323869 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:27:52.323869 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:27:52.323869 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application with Lock( Jul 28 08:27:52.323869 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:27:52.323869 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:27:52.323869 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:27:52.323869 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:27:52.323869 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:27:52.323869 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:27:52.325973 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:27:52.325973 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:27:52.325973 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 28 08:27:52.325973 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 28 08:27:52.325973 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 28 08:27:52.325973 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 28 08:27:52.325973 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 28 08:27:52.325973 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 28 08:27:52.325973 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 28 08:27:52.325973 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application Jul 28 08:27:52.325973 dv-cinder-851351-1-smb devstack@keystone.service[207600]: [pid: 207600|app: 0|req: 639/1280] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 08:27:52 2022] GET /identity/v3/users/placement => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:27:52.330503 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4a270a-90c3-4b83-86ed-8f2dc493ec13 None admin] Authenticating user token {{(pid=207601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:27:52.336274 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG dbcounter [-] [207601] Writing DB stats keystone:SELECT=100 {{(pid=207601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:27:52.443483 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4a270a-90c3-4b83-86ed-8f2dc493ec13 None admin] Validating token access rules against request {{(pid=207601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:27:52.483795 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e84a94-74d7-45b5-8e82-72280c27ef6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:27:52.484469 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e84a94-74d7-45b5-8e82-72280c27ef6a None admin] REQUEST_METHOD: `GET` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:27:52.484792 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e84a94-74d7-45b5-8e82-72280c27ef6a None admin] SCRIPT_NAME: `/identity` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:27:52.485071 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e84a94-74d7-45b5-8e82-72280c27ef6a None admin] PATH_INFO: `/v3/users` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:27:52.485934 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e84a94-74d7-45b5-8e82-72280c27ef6a None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=207601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:27:52.486350 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e84a94-74d7-45b5-8e82-72280c27ef6a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:27:52.487932 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e84a94-74d7-45b5-8e82-72280c27ef6a None admin] RBAC: Authorization granted {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:27:52.509768 dv-cinder-851351-1-smb devstack@keystone.service[207601]: [pid: 207601|app: 0|req: 642/1281] 10.222.0.42 () {56 vars in 1143 bytes} [Thu Jul 28 08:27:52 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:27:52.516159 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa74cf72-63af-48fa-80d0-9e740a36cb22 None admin] Authenticating user token {{(pid=207600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:27:52.638761 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG dbcounter [-] [207600] Writing DB stats keystone:SELECT=100 {{(pid=207600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:27:52.649743 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa74cf72-63af-48fa-80d0-9e740a36cb22 None admin] Validating token access rules against request {{(pid=207600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:27:52.688018 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd5c07b-d953-4426-939c-bb25675aa709 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:27:52.688633 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd5c07b-d953-4426-939c-bb25675aa709 None admin] REQUEST_METHOD: `GET` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:27:52.688952 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd5c07b-d953-4426-939c-bb25675aa709 None admin] SCRIPT_NAME: `/identity` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:27:52.689299 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd5c07b-d953-4426-939c-bb25675aa709 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:27:52.765694 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd5c07b-d953-4426-939c-bb25675aa709 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:27:52.767224 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd5c07b-d953-4426-939c-bb25675aa709 None admin] RBAC: Authorization granted {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:27:52.872084 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG dbcounter [-] [207600] Writing DB stats keystone:SELECT=100 {{(pid=207600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:27:52.887221 dv-cinder-851351-1-smb devstack@keystone.service[207600]: [pid: 207600|app: 0|req: 640/1282] 10.222.0.42 () {58 vars in 1282 bytes} [Thu Jul 28 08:27:52 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 372 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 28 08:27:52.893815 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e84a94-74d7-45b5-8e82-72280c27ef6a None admin] Authenticating user token {{(pid=207601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:27:52.967113 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG dbcounter [-] [207601] Writing DB stats keystone:SELECT=100 {{(pid=207601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:27:53.009459 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e84a94-74d7-45b5-8e82-72280c27ef6a None admin] Validating token access rules against request {{(pid=207601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:27:53.045378 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac806d19-265b-4d86-9ed0-c6617acee52e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:27:53.046033 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac806d19-265b-4d86-9ed0-c6617acee52e None admin] REQUEST_METHOD: `GET` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:27:53.046313 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac806d19-265b-4d86-9ed0-c6617acee52e None admin] SCRIPT_NAME: `/identity` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:27:53.046585 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac806d19-265b-4d86-9ed0-c6617acee52e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:27:53.057437 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac806d19-265b-4d86-9ed0-c6617acee52e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:27:53.058896 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac806d19-265b-4d86-9ed0-c6617acee52e None admin] RBAC: Authorization granted {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:27:53.074235 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application [None req-ac806d19-265b-4d86-9ed0-c6617acee52e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 08:27:53.074235 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:27:53.074235 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:27:53.074235 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:27:53.074235 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:27:53.074235 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:27:53.074235 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:27:53.074235 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:27:53.074235 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:27:53.074235 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:27:53.074235 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:27:53.074235 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:27:53.074235 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 08:27:53.074235 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 08:27:53.074235 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 08:27:53.075410 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 08:27:53.075410 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:27:53.075410 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:27:53.075410 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:27:53.075410 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:27:53.075410 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:27:53.075410 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:27:53.075410 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:27:53.075410 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application with Lock( Jul 28 08:27:53.075410 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:27:53.075410 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:27:53.075410 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:27:53.075410 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:27:53.075410 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:27:53.075410 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:27:53.075410 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:27:53.075410 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:27:53.076387 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 08:27:53.076387 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 08:27:53.076387 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 08:27:53.076387 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application Jul 28 08:27:53.076387 dv-cinder-851351-1-smb devstack@keystone.service[207601]: [pid: 207601|app: 0|req: 643/1283] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 08:27:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:27:53.081546 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd5c07b-d953-4426-939c-bb25675aa709 None admin] Authenticating user token {{(pid=207600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:27:53.183992 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd5c07b-d953-4426-939c-bb25675aa709 None admin] Validating token access rules against request {{(pid=207600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:27:53.221962 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849de019-590f-4fec-9288-0f3b4f2018d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:27:53.222584 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849de019-590f-4fec-9288-0f3b4f2018d7 None admin] REQUEST_METHOD: `GET` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:27:53.222854 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849de019-590f-4fec-9288-0f3b4f2018d7 None admin] SCRIPT_NAME: `/identity` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:27:53.223125 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849de019-590f-4fec-9288-0f3b4f2018d7 None admin] PATH_INFO: `/v3/domains` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:27:53.223831 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-849de019-590f-4fec-9288-0f3b4f2018d7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=207600) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:27:53.224135 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-849de019-590f-4fec-9288-0f3b4f2018d7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:27:53.225555 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-849de019-590f-4fec-9288-0f3b4f2018d7 None admin] RBAC: Authorization granted {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:27:53.237673 dv-cinder-851351-1-smb devstack@keystone.service[207600]: [pid: 207600|app: 0|req: 641/1284] 10.222.0.42 () {56 vars in 1109 bytes} [Thu Jul 28 08:27:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:27:53.243695 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac806d19-265b-4d86-9ed0-c6617acee52e None admin] Authenticating user token {{(pid=207601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:27:53.353491 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac806d19-265b-4d86-9ed0-c6617acee52e None admin] Validating token access rules against request {{(pid=207601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:27:53.368155 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG dbcounter [-] [207601] Writing DB stats keystone:SELECT=100 {{(pid=207601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:27:53.390871 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f15e553-71c6-43d2-b3b5-8f73331175f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:27:53.391545 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f15e553-71c6-43d2-b3b5-8f73331175f7 None admin] REQUEST_METHOD: `GET` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:27:53.391818 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f15e553-71c6-43d2-b3b5-8f73331175f7 None admin] SCRIPT_NAME: `/identity` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:27:53.392097 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f15e553-71c6-43d2-b3b5-8f73331175f7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:27:53.399339 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f15e553-71c6-43d2-b3b5-8f73331175f7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:27:53.400841 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f15e553-71c6-43d2-b3b5-8f73331175f7 None admin] RBAC: Authorization granted {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:27:53.413433 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application [None req-5f15e553-71c6-43d2-b3b5-8f73331175f7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 08:27:53.413433 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:27:53.413433 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:27:53.413433 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:27:53.413433 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:27:53.413433 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:27:53.413433 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:27:53.413433 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:27:53.413433 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:27:53.413433 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:27:53.413433 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:27:53.413433 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:27:53.413433 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 28 08:27:53.413433 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 28 08:27:53.413433 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 28 08:27:53.414506 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 28 08:27:53.414506 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:27:53.414506 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:27:53.414506 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:27:53.414506 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:27:53.414506 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:27:53.414506 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:27:53.414506 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:27:53.414506 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application with Lock( Jul 28 08:27:53.414506 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:27:53.414506 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:27:53.414506 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:27:53.414506 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:27:53.414506 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:27:53.414506 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:27:53.414506 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:27:53.414506 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:27:53.415566 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 28 08:27:53.415566 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 28 08:27:53.415566 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 28 08:27:53.415566 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 28 08:27:53.415566 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 28 08:27:53.415566 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 28 08:27:53.415566 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 08:27:53.415566 dv-cinder-851351-1-smb devstack@keystone.service[207601]: ERROR keystone.server.flask.application Jul 28 08:27:53.415566 dv-cinder-851351-1-smb devstack@keystone.service[207601]: [pid: 207601|app: 0|req: 644/1285] 10.222.0.42 () {56 vars in 1111 bytes} [Thu Jul 28 08:27:53 2022] GET /identity/v3/projects/service => generated 88 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:27:53.420955 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849de019-590f-4fec-9288-0f3b4f2018d7 None admin] Authenticating user token {{(pid=207600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:27:53.472043 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG dbcounter [-] [207600] Writing DB stats keystone:SELECT=100 {{(pid=207600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:27:53.525764 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849de019-590f-4fec-9288-0f3b4f2018d7 None admin] Validating token access rules against request {{(pid=207600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:27:53.570648 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76831912-040a-45d0-9982-9c25ff22daa1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:27:53.571281 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76831912-040a-45d0-9982-9c25ff22daa1 None admin] REQUEST_METHOD: `GET` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:27:53.571565 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76831912-040a-45d0-9982-9c25ff22daa1 None admin] SCRIPT_NAME: `/identity` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:27:53.571836 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76831912-040a-45d0-9982-9c25ff22daa1 None admin] PATH_INFO: `/v3/projects` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:27:53.572602 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76831912-040a-45d0-9982-9c25ff22daa1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=207600) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:27:53.572947 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76831912-040a-45d0-9982-9c25ff22daa1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:27:53.574407 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76831912-040a-45d0-9982-9c25ff22daa1 None admin] RBAC: Authorization granted {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:27:53.587732 dv-cinder-851351-1-smb devstack@keystone.service[207600]: [pid: 207600|app: 0|req: 642/1286] 10.222.0.42 () {56 vars in 1148 bytes} [Thu Jul 28 08:27:53 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:27:53.594533 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f15e553-71c6-43d2-b3b5-8f73331175f7 None admin] Authenticating user token {{(pid=207601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:27:53.703684 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f15e553-71c6-43d2-b3b5-8f73331175f7 None admin] Validating token access rules against request {{(pid=207601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:27:53.742035 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e928d1f-c6e3-4eab-8fea-58f77a37e77d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:27:53.742567 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e928d1f-c6e3-4eab-8fea-58f77a37e77d None admin] REQUEST_METHOD: `GET` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:27:53.742849 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e928d1f-c6e3-4eab-8fea-58f77a37e77d None admin] SCRIPT_NAME: `/identity` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:27:53.743121 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e928d1f-c6e3-4eab-8fea-58f77a37e77d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:27:53.743921 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e928d1f-c6e3-4eab-8fea-58f77a37e77d None admin] RBAC: Adding query filter params (role.id=d0ce88034c6b41878db755343f5840be, scope.project.id=48c5f2b2ae2b48758b957d2b194a7fd1, user.id=954803a75b6c4c46b7ab8818fc89c275) {{(pid=207601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:27:53.744231 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e928d1f-c6e3-4eab-8fea-58f77a37e77d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:27:53.745707 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e928d1f-c6e3-4eab-8fea-58f77a37e77d None admin] RBAC: Authorization granted {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:27:53.751792 dv-cinder-851351-1-smb devstack@keystone.service[207601]: [pid: 207601|app: 0|req: 645/1287] 10.222.0.42 () {56 vars in 1374 bytes} [Thu Jul 28 08:27:53 2022] GET /identity/v3/role_assignments?user.id=954803a75b6c4c46b7ab8818fc89c275&scope.project.id=48c5f2b2ae2b48758b957d2b194a7fd1&role.id=d0ce88034c6b41878db755343f5840be => generated 608 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:27:55.796320 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91049bd-4150-4287-ab17-f5f129065878 None None] REQUEST_METHOD: `GET` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:27:55.797103 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91049bd-4150-4287-ab17-f5f129065878 None None] SCRIPT_NAME: `/identity` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:27:55.797103 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91049bd-4150-4287-ab17-f5f129065878 None None] PATH_INFO: `/` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:27:55.798326 dv-cinder-851351-1-smb devstack@keystone.service[207600]: [pid: 207600|app: 0|req: 643/1288] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 08:27:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 08:27:55.804375 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbf7274-92dd-48fc-8710-b80abcba9288 None None] REQUEST_METHOD: `POST` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:27:55.804963 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbf7274-92dd-48fc-8710-b80abcba9288 None None] SCRIPT_NAME: `/identity` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:27:55.804963 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbf7274-92dd-48fc-8710-b80abcba9288 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:27:55.826127 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.auth.core [None req-adbf7274-92dd-48fc-8710-b80abcba9288 None None] MFA Rules not processed for user `b8110ade874c4aa7af27f5c376df700a`. Rule list: `[]` (Enabled: `True`). {{(pid=207601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 08:27:55.827413 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.fernet_utils [None req-adbf7274-92dd-48fc-8710-b80abcba9288 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=207601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:27:55.882509 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG dbcounter [-] [207601] Writing DB stats keystone:SELECT=100 {{(pid=207601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:27:55.925619 dv-cinder-851351-1-smb devstack@keystone.service[207601]: [pid: 207601|app: 0|req: 646/1289] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 08:27:55 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 08:27:55.948290 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91049bd-4150-4287-ab17-f5f129065878 None None] Authenticating user token {{(pid=207600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:27:56.058869 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91049bd-4150-4287-ab17-f5f129065878 None None] Validating token access rules against request {{(pid=207600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:27:56.070589 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG dbcounter [-] [207600] Writing DB stats keystone:SELECT=100 {{(pid=207600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:27:56.096153 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860b22a1-f7e7-4559-b3c2-f61b6bad5d90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:27:56.096833 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860b22a1-f7e7-4559-b3c2-f61b6bad5d90 None admin] REQUEST_METHOD: `GET` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:27:56.097115 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860b22a1-f7e7-4559-b3c2-f61b6bad5d90 None admin] SCRIPT_NAME: `/identity` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:27:56.097385 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860b22a1-f7e7-4559-b3c2-f61b6bad5d90 None admin] PATH_INFO: `/v3/services/placement` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:27:56.098019 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-860b22a1-f7e7-4559-b3c2-f61b6bad5d90 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:27:56.099413 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-860b22a1-f7e7-4559-b3c2-f61b6bad5d90 None admin] RBAC: Authorization granted {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:27:56.110660 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application [None req-860b22a1-f7e7-4559-b3c2-f61b6bad5d90 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jul 28 08:27:56.110660 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:27:56.110660 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 28 08:27:56.110660 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 28 08:27:56.110660 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 28 08:27:56.110660 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 28 08:27:56.110660 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 28 08:27:56.110660 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 08:27:56.110660 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 28 08:27:56.110660 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application Jul 28 08:27:56.110660 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 28 08:27:56.110660 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application Jul 28 08:27:56.110660 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:27:56.110660 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:27:56.110660 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:27:56.110660 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:27:56.110660 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:27:56.112202 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:27:56.112202 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:27:56.112202 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:27:56.112202 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:27:56.112202 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:27:56.112202 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:27:56.112202 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 28 08:27:56.112202 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 28 08:27:56.112202 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 28 08:27:56.112202 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 28 08:27:56.112202 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:27:56.112202 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:27:56.112202 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:27:56.112202 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:27:56.112202 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:27:56.112202 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:27:56.113423 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:27:56.113423 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application with Lock( Jul 28 08:27:56.113423 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:27:56.113423 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:27:56.113423 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:27:56.113423 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:27:56.113423 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:27:56.113423 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:27:56.113423 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:27:56.113423 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:27:56.113423 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 28 08:27:56.113423 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 08:27:56.113423 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 28 08:27:56.113423 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application Jul 28 08:27:56.113423 dv-cinder-851351-1-smb devstack@keystone.service[207600]: [pid: 207600|app: 0|req: 644/1290] 10.222.0.42 () {56 vars in 1117 bytes} [Thu Jul 28 08:27:55 2022] GET /identity/v3/services/placement => generated 90 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:27:56.118698 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adbf7274-92dd-48fc-8710-b80abcba9288 None None] Authenticating user token {{(pid=207601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:27:56.229816 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adbf7274-92dd-48fc-8710-b80abcba9288 None None] Validating token access rules against request {{(pid=207601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:27:56.266776 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2549f50c-19db-49a4-a5bb-7ac646e0e161 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:27:56.267464 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2549f50c-19db-49a4-a5bb-7ac646e0e161 None admin] REQUEST_METHOD: `GET` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:27:56.267747 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2549f50c-19db-49a4-a5bb-7ac646e0e161 None admin] SCRIPT_NAME: `/identity` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:27:56.268025 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2549f50c-19db-49a4-a5bb-7ac646e0e161 None admin] PATH_INFO: `/v3/services` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:27:56.268769 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2549f50c-19db-49a4-a5bb-7ac646e0e161 None admin] RBAC: Adding query filter params (name=placement) {{(pid=207601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:27:56.269086 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2549f50c-19db-49a4-a5bb-7ac646e0e161 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:27:56.270499 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2549f50c-19db-49a4-a5bb-7ac646e0e161 None admin] RBAC: Authorization granted {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:27:56.276161 dv-cinder-851351-1-smb devstack@keystone.service[207601]: [pid: 207601|app: 0|req: 647/1291] 10.222.0.42 () {56 vars in 1116 bytes} [Thu Jul 28 08:27:56 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:27:56.285579 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860b22a1-f7e7-4559-b3c2-f61b6bad5d90 None admin] Authenticating user token {{(pid=207600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:27:56.393443 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860b22a1-f7e7-4559-b3c2-f61b6bad5d90 None admin] Validating token access rules against request {{(pid=207600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:27:56.431893 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7000693b-4c93-42ce-8451-bcfed55c4b24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:27:56.432523 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7000693b-4c93-42ce-8451-bcfed55c4b24 None admin] REQUEST_METHOD: `GET` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:27:56.432834 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7000693b-4c93-42ce-8451-bcfed55c4b24 None admin] SCRIPT_NAME: `/identity` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:27:56.433112 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7000693b-4c93-42ce-8451-bcfed55c4b24 None admin] PATH_INFO: `/v3/services` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:27:56.433814 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7000693b-4c93-42ce-8451-bcfed55c4b24 None admin] RBAC: Adding query filter params (type=placement) {{(pid=207600) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:27:56.434126 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7000693b-4c93-42ce-8451-bcfed55c4b24 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:27:56.435531 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7000693b-4c93-42ce-8451-bcfed55c4b24 None admin] RBAC: Authorization granted {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:27:56.440838 dv-cinder-851351-1-smb devstack@keystone.service[207600]: [pid: 207600|app: 0|req: 645/1292] 10.222.0.42 () {56 vars in 1116 bytes} [Thu Jul 28 08:27:56 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:27:58.509739 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498d68c3-f957-450d-bf37-b46003389e67 None None] REQUEST_METHOD: `GET` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:27:58.510381 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498d68c3-f957-450d-bf37-b46003389e67 None None] SCRIPT_NAME: `/identity` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:27:58.510381 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498d68c3-f957-450d-bf37-b46003389e67 None None] PATH_INFO: `/` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:27:58.513457 dv-cinder-851351-1-smb devstack@keystone.service[207601]: [pid: 207601|app: 0|req: 648/1293] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 08:27:58 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 08:27:58.520817 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf89ab6-5e56-4c09-88e2-1fa9c2da5571 None None] REQUEST_METHOD: `POST` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:27:58.521442 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf89ab6-5e56-4c09-88e2-1fa9c2da5571 None None] SCRIPT_NAME: `/identity` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:27:58.521442 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf89ab6-5e56-4c09-88e2-1fa9c2da5571 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:27:58.541863 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.auth.core [None req-8bf89ab6-5e56-4c09-88e2-1fa9c2da5571 None None] MFA Rules not processed for user `b8110ade874c4aa7af27f5c376df700a`. Rule list: `[]` (Enabled: `True`). {{(pid=207600) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 08:27:58.543106 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.fernet_utils [None req-8bf89ab6-5e56-4c09-88e2-1fa9c2da5571 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=207600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:27:58.576366 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG dbcounter [-] [207600] Writing DB stats keystone:SELECT=100 {{(pid=207600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:27:58.625118 dv-cinder-851351-1-smb devstack@keystone.service[207600]: [pid: 207600|app: 0|req: 646/1294] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 08:27:58 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 28 08:27:58.648441 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-498d68c3-f957-450d-bf37-b46003389e67 None None] Authenticating user token {{(pid=207601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:27:58.689944 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG dbcounter [-] [207601] Writing DB stats keystone:SELECT=100 {{(pid=207601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:27:58.774027 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-498d68c3-f957-450d-bf37-b46003389e67 None None] Validating token access rules against request {{(pid=207601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:27:58.811529 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99fe063-4da8-41c7-92fe-97ccbcafc21b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:27:58.812167 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99fe063-4da8-41c7-92fe-97ccbcafc21b None admin] REQUEST_METHOD: `POST` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:27:58.812446 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99fe063-4da8-41c7-92fe-97ccbcafc21b None admin] SCRIPT_NAME: `/identity` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:27:58.812703 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99fe063-4da8-41c7-92fe-97ccbcafc21b None admin] PATH_INFO: `/v3/services` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:27:58.813450 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d99fe063-4da8-41c7-92fe-97ccbcafc21b None admin] RBAC: Authorizing `identity:create_service()` {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:27:58.814924 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d99fe063-4da8-41c7-92fe-97ccbcafc21b None admin] RBAC: Authorization granted {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:27:58.831911 dv-cinder-851351-1-smb devstack@keystone.service[207601]: [pid: 207601|app: 0|req: 649/1295] 10.222.0.42 () {60 vars in 1141 bytes} [Thu Jul 28 08:27:58 2022] POST /identity/v3/services => generated 246 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 08:28:00.874808 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9c04fc-33d1-419c-bc3b-35c48503820d None None] REQUEST_METHOD: `GET` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:28:00.875392 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9c04fc-33d1-419c-bc3b-35c48503820d None None] SCRIPT_NAME: `/identity` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:28:00.875392 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9c04fc-33d1-419c-bc3b-35c48503820d None None] PATH_INFO: `/` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:28:00.876950 dv-cinder-851351-1-smb devstack@keystone.service[207600]: [pid: 207600|app: 0|req: 647/1296] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 08:28:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 08:28:00.882929 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbb3950-c84d-4494-96e4-b3187a47ef81 None None] REQUEST_METHOD: `POST` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:28:00.883546 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbb3950-c84d-4494-96e4-b3187a47ef81 None None] SCRIPT_NAME: `/identity` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:28:00.883546 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbb3950-c84d-4494-96e4-b3187a47ef81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:28:00.902525 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.auth.core [None req-1fbb3950-c84d-4494-96e4-b3187a47ef81 None None] MFA Rules not processed for user `b8110ade874c4aa7af27f5c376df700a`. Rule list: `[]` (Enabled: `True`). {{(pid=207601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 08:28:00.903752 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.fernet_utils [None req-1fbb3950-c84d-4494-96e4-b3187a47ef81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=207601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:28:00.980917 dv-cinder-851351-1-smb devstack@keystone.service[207601]: [pid: 207601|app: 0|req: 650/1297] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 08:28:00 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 28 08:28:01.003910 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9c04fc-33d1-419c-bc3b-35c48503820d None None] Authenticating user token {{(pid=207600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:28:01.121723 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9c04fc-33d1-419c-bc3b-35c48503820d None None] Validating token access rules against request {{(pid=207600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:28:01.173646 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c83c031-2885-4c9b-9840-9bf8dd3d1929 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:28:01.174249 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c83c031-2885-4c9b-9840-9bf8dd3d1929 None admin] REQUEST_METHOD: `GET` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:28:01.174534 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c83c031-2885-4c9b-9840-9bf8dd3d1929 None admin] SCRIPT_NAME: `/identity` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:28:01.174807 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c83c031-2885-4c9b-9840-9bf8dd3d1929 None admin] PATH_INFO: `/v3/services/placement` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:28:01.175501 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c83c031-2885-4c9b-9840-9bf8dd3d1929 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:28:01.179870 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c83c031-2885-4c9b-9840-9bf8dd3d1929 None admin] RBAC: Authorization granted {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:28:01.190423 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application [None req-7c83c031-2885-4c9b-9840-9bf8dd3d1929 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jul 28 08:28:01.190423 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:28:01.190423 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 28 08:28:01.190423 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 28 08:28:01.190423 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 28 08:28:01.190423 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 28 08:28:01.190423 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 28 08:28:01.190423 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 08:28:01.190423 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 28 08:28:01.190423 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application Jul 28 08:28:01.190423 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 28 08:28:01.190423 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application Jul 28 08:28:01.190423 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:28:01.190423 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:28:01.190423 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:28:01.190423 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:28:01.190423 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:28:01.191838 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:28:01.191838 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:28:01.191838 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:28:01.191838 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:28:01.191838 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:28:01.191838 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:28:01.191838 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 28 08:28:01.191838 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 28 08:28:01.191838 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 28 08:28:01.191838 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 28 08:28:01.191838 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:28:01.191838 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:28:01.191838 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:28:01.191838 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:28:01.191838 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:28:01.191838 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:28:01.193183 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:28:01.193183 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application with Lock( Jul 28 08:28:01.193183 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:28:01.193183 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:28:01.193183 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:28:01.193183 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:28:01.193183 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:28:01.193183 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:28:01.193183 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:28:01.193183 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:28:01.193183 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 28 08:28:01.193183 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 08:28:01.193183 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 28 08:28:01.193183 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application Jul 28 08:28:01.193183 dv-cinder-851351-1-smb devstack@keystone.service[207600]: [pid: 207600|app: 0|req: 648/1298] 10.222.0.42 () {56 vars in 1117 bytes} [Thu Jul 28 08:28:01 2022] GET /identity/v3/services/placement => generated 90 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:28:01.202091 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fbb3950-c84d-4494-96e4-b3187a47ef81 None None] Authenticating user token {{(pid=207601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:28:01.229088 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG dbcounter [-] [207601] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=207601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:28:01.353878 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fbb3950-c84d-4494-96e4-b3187a47ef81 None None] Validating token access rules against request {{(pid=207601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:28:01.414659 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da18e49-7b6e-405b-88b8-7dd6b76ba190 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:28:01.415744 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da18e49-7b6e-405b-88b8-7dd6b76ba190 None admin] REQUEST_METHOD: `GET` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:28:01.416265 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da18e49-7b6e-405b-88b8-7dd6b76ba190 None admin] SCRIPT_NAME: `/identity` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:28:01.416808 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da18e49-7b6e-405b-88b8-7dd6b76ba190 None admin] PATH_INFO: `/v3/services` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:28:01.418140 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4da18e49-7b6e-405b-88b8-7dd6b76ba190 None admin] RBAC: Adding query filter params (name=placement) {{(pid=207601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:28:01.418711 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4da18e49-7b6e-405b-88b8-7dd6b76ba190 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:28:01.421566 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4da18e49-7b6e-405b-88b8-7dd6b76ba190 None admin] RBAC: Authorization granted {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:28:01.432090 dv-cinder-851351-1-smb devstack@keystone.service[207601]: [pid: 207601|app: 0|req: 651/1299] 10.222.0.42 () {56 vars in 1116 bytes} [Thu Jul 28 08:28:01 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 08:28:01.438251 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c83c031-2885-4c9b-9840-9bf8dd3d1929 None admin] Authenticating user token {{(pid=207600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:28:01.476208 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG dbcounter [-] [207600] Writing DB stats keystone:SELECT=100 {{(pid=207600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:28:01.555577 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c83c031-2885-4c9b-9840-9bf8dd3d1929 None admin] Validating token access rules against request {{(pid=207600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:28:01.597935 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a3db9a-d1a6-42ff-9557-3ea775c4cd08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:28:01.598571 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a3db9a-d1a6-42ff-9557-3ea775c4cd08 None admin] REQUEST_METHOD: `GET` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:28:01.598846 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a3db9a-d1a6-42ff-9557-3ea775c4cd08 None admin] SCRIPT_NAME: `/identity` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:28:01.599118 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a3db9a-d1a6-42ff-9557-3ea775c4cd08 None admin] PATH_INFO: `/v3/endpoints` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:28:01.599930 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5a3db9a-d1a6-42ff-9557-3ea775c4cd08 None admin] RBAC: Adding query filter params (interface=public, service_id=117d9b88755e4938949a873af1cdf867, region_id=RegionOne) {{(pid=207600) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:28:01.600239 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5a3db9a-d1a6-42ff-9557-3ea775c4cd08 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:28:01.601662 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5a3db9a-d1a6-42ff-9557-3ea775c4cd08 None admin] RBAC: Authorization granted {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:28:01.607357 dv-cinder-851351-1-smb devstack@keystone.service[207600]: [pid: 207600|app: 0|req: 649/1300] 10.222.0.42 () {56 vars in 1251 bytes} [Thu Jul 28 08:28:01 2022] GET /identity/v3/endpoints?service_id=117d9b88755e4938949a873af1cdf867&interface=public®ion_id=RegionOne => generated 194 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:28:01.613567 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da18e49-7b6e-405b-88b8-7dd6b76ba190 None admin] Authenticating user token {{(pid=207601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:28:01.714235 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG dbcounter [-] [207601] Writing DB stats keystone:SELECT=100 {{(pid=207601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:28:01.735714 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da18e49-7b6e-405b-88b8-7dd6b76ba190 None admin] Validating token access rules against request {{(pid=207601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:28:01.776356 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fec602c-7d16-4df4-bfaf-104635f16a26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:28:01.777049 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fec602c-7d16-4df4-bfaf-104635f16a26 None admin] REQUEST_METHOD: `GET` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:28:01.777334 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fec602c-7d16-4df4-bfaf-104635f16a26 None admin] SCRIPT_NAME: `/identity` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:28:01.777612 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fec602c-7d16-4df4-bfaf-104635f16a26 None admin] PATH_INFO: `/v3/services` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:28:01.778295 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fec602c-7d16-4df4-bfaf-104635f16a26 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:28:01.779729 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fec602c-7d16-4df4-bfaf-104635f16a26 None admin] RBAC: Authorization granted {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:28:01.787719 dv-cinder-851351-1-smb devstack@keystone.service[207601]: [pid: 207601|app: 0|req: 652/1301] 10.222.0.42 () {56 vars in 1087 bytes} [Thu Jul 28 08:28:01 2022] GET /identity/v3/services => generated 2191 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 08:28:03.807189 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f15549-474e-4c92-9147-eb037b514c60 None None] REQUEST_METHOD: `GET` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:28:03.807816 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f15549-474e-4c92-9147-eb037b514c60 None None] SCRIPT_NAME: `/identity` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:28:03.807816 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f15549-474e-4c92-9147-eb037b514c60 None None] PATH_INFO: `/` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:28:03.809173 dv-cinder-851351-1-smb devstack@keystone.service[207600]: [pid: 207600|app: 0|req: 650/1302] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 08:28:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 08:28:03.820282 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7854c421-1cb1-429d-a3b7-51d1edfe566a None None] REQUEST_METHOD: `POST` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:28:03.820852 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7854c421-1cb1-429d-a3b7-51d1edfe566a None None] SCRIPT_NAME: `/identity` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:28:03.820852 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7854c421-1cb1-429d-a3b7-51d1edfe566a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:28:03.841047 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.auth.core [None req-7854c421-1cb1-429d-a3b7-51d1edfe566a None None] MFA Rules not processed for user `b8110ade874c4aa7af27f5c376df700a`. Rule list: `[]` (Enabled: `True`). {{(pid=207601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 08:28:03.842277 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.fernet_utils [None req-7854c421-1cb1-429d-a3b7-51d1edfe566a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=207601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:28:03.920889 dv-cinder-851351-1-smb devstack@keystone.service[207601]: [pid: 207601|app: 0|req: 653/1303] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 08:28:03 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 08:28:03.943908 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f15549-474e-4c92-9147-eb037b514c60 None None] Authenticating user token {{(pid=207600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:28:04.042251 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG dbcounter [-] [207600] Writing DB stats keystone:SELECT=100 {{(pid=207600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:28:04.049870 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f15549-474e-4c92-9147-eb037b514c60 None None] Validating token access rules against request {{(pid=207600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:28:04.085846 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4022557d-30c9-417a-a7bc-cf075f27a803 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:28:04.086505 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4022557d-30c9-417a-a7bc-cf075f27a803 None admin] REQUEST_METHOD: `GET` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:28:04.086765 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4022557d-30c9-417a-a7bc-cf075f27a803 None admin] SCRIPT_NAME: `/identity` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:28:04.087032 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4022557d-30c9-417a-a7bc-cf075f27a803 None admin] PATH_INFO: `/v3/services/placement` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:28:04.087662 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4022557d-30c9-417a-a7bc-cf075f27a803 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:28:04.089095 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4022557d-30c9-417a-a7bc-cf075f27a803 None admin] RBAC: Authorization granted {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:28:04.098638 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application [None req-4022557d-30c9-417a-a7bc-cf075f27a803 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jul 28 08:28:04.098638 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:28:04.098638 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 28 08:28:04.098638 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 28 08:28:04.098638 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 28 08:28:04.098638 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 28 08:28:04.098638 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 28 08:28:04.098638 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 08:28:04.098638 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 28 08:28:04.098638 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application Jul 28 08:28:04.098638 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 28 08:28:04.098638 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application Jul 28 08:28:04.098638 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:28:04.098638 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:28:04.098638 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:28:04.098638 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:28:04.098638 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:28:04.100008 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:28:04.100008 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:28:04.100008 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:28:04.100008 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:28:04.100008 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:28:04.100008 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:28:04.100008 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 28 08:28:04.100008 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 28 08:28:04.100008 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 28 08:28:04.100008 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 28 08:28:04.100008 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:28:04.100008 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:28:04.100008 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:28:04.100008 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:28:04.100008 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:28:04.100008 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:28:04.101209 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:28:04.101209 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application with Lock( Jul 28 08:28:04.101209 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:28:04.101209 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:28:04.101209 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:28:04.101209 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:28:04.101209 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:28:04.101209 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:28:04.101209 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:28:04.101209 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:28:04.101209 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 28 08:28:04.101209 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 08:28:04.101209 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 28 08:28:04.101209 dv-cinder-851351-1-smb devstack@keystone.service[207600]: ERROR keystone.server.flask.application Jul 28 08:28:04.101209 dv-cinder-851351-1-smb devstack@keystone.service[207600]: [pid: 207600|app: 0|req: 651/1304] 10.222.0.42 () {56 vars in 1117 bytes} [Thu Jul 28 08:28:03 2022] GET /identity/v3/services/placement => generated 90 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:28:04.106188 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7854c421-1cb1-429d-a3b7-51d1edfe566a None None] Authenticating user token {{(pid=207601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:28:04.189992 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG dbcounter [-] [207601] Writing DB stats keystone:SELECT=100 {{(pid=207601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:28:04.215955 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7854c421-1cb1-429d-a3b7-51d1edfe566a None None] Validating token access rules against request {{(pid=207601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:28:04.256923 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b5fa0d-b59c-44f5-b7ab-08f583a22793 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:28:04.257556 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b5fa0d-b59c-44f5-b7ab-08f583a22793 None admin] REQUEST_METHOD: `GET` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:28:04.257841 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b5fa0d-b59c-44f5-b7ab-08f583a22793 None admin] SCRIPT_NAME: `/identity` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:28:04.258109 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b5fa0d-b59c-44f5-b7ab-08f583a22793 None admin] PATH_INFO: `/v3/services` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:28:04.258800 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7b5fa0d-b59c-44f5-b7ab-08f583a22793 None admin] RBAC: Adding query filter params (name=placement) {{(pid=207601) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:28:04.259114 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7b5fa0d-b59c-44f5-b7ab-08f583a22793 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:28:04.260490 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7b5fa0d-b59c-44f5-b7ab-08f583a22793 None admin] RBAC: Authorization granted {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:28:04.266088 dv-cinder-851351-1-smb devstack@keystone.service[207601]: [pid: 207601|app: 0|req: 654/1305] 10.222.0.42 () {56 vars in 1116 bytes} [Thu Jul 28 08:28:04 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:28:04.272404 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4022557d-30c9-417a-a7bc-cf075f27a803 None admin] Authenticating user token {{(pid=207600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:28:04.377424 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4022557d-30c9-417a-a7bc-cf075f27a803 None admin] Validating token access rules against request {{(pid=207600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:28:04.417309 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab71d30e-719c-4026-86c5-1909778e2827 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8110ade874c4aa7af27f5c376df700a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:28:04.417914 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab71d30e-719c-4026-86c5-1909778e2827 None admin] REQUEST_METHOD: `POST` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:28:04.418207 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab71d30e-719c-4026-86c5-1909778e2827 None admin] SCRIPT_NAME: `/identity` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:28:04.418475 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab71d30e-719c-4026-86c5-1909778e2827 None admin] PATH_INFO: `/v3/endpoints` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:28:04.419182 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab71d30e-719c-4026-86c5-1909778e2827 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:28:04.420593 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab71d30e-719c-4026-86c5-1909778e2827 None admin] RBAC: Authorization granted {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:28:04.448810 dv-cinder-851351-1-smb devstack@keystone.service[207600]: [pid: 207600|app: 0|req: 652/1306] 10.222.0.42 () {60 vars in 1144 bytes} [Thu Jul 28 08:28:04 2022] POST /identity/v3/endpoints => generated 331 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 08:28:14.262902 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG dbcounter [-] [207601] Writing DB stats keystone:SELECT=30 {{(pid=207601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:28:14.443767 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG dbcounter [-] [207600] Writing DB stats keystone:SELECT=91,keystone:INSERT=1 {{(pid=207600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:29:10.315370 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35de278a-1a9f-4506-8cbb-a51bf5402a6e None None] REQUEST_METHOD: `GET` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:29:10.315952 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35de278a-1a9f-4506-8cbb-a51bf5402a6e None None] SCRIPT_NAME: `/identity` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:29:10.315952 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35de278a-1a9f-4506-8cbb-a51bf5402a6e None None] PATH_INFO: `/` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:29:10.321849 dv-cinder-851351-1-smb devstack@keystone.service[207601]: [pid: 207601|app: 0|req: 655/1307] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 08:29:10 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 08:29:10.323599 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b342e84-bcbe-441d-8c52-603fc1ebeb98 None None] REQUEST_METHOD: `POST` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:29:10.324114 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b342e84-bcbe-441d-8c52-603fc1ebeb98 None None] SCRIPT_NAME: `/identity` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:29:10.324200 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b342e84-bcbe-441d-8c52-603fc1ebeb98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:29:10.485456 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.auth.core [None req-0b342e84-bcbe-441d-8c52-603fc1ebeb98 None None] MFA Rules not processed for user `b8110ade874c4aa7af27f5c376df700a`. Rule list: `[]` (Enabled: `True`). {{(pid=207600) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 08:29:10.486684 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.fernet_utils [None req-0b342e84-bcbe-441d-8c52-603fc1ebeb98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=207600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:29:10.644712 dv-cinder-851351-1-smb devstack@keystone.service[207600]: [pid: 207600|app: 0|req: 653/1308] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 08:29:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 322 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 08:29:10.698311 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3881b9fb-e104-4355-96d6-61e0f2be1dcf None None] REQUEST_METHOD: `GET` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:29:10.698969 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3881b9fb-e104-4355-96d6-61e0f2be1dcf None None] SCRIPT_NAME: `/identity` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:29:10.699463 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3881b9fb-e104-4355-96d6-61e0f2be1dcf None None] PATH_INFO: `/` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:29:10.701090 dv-cinder-851351-1-smb devstack@keystone.service[207601]: [pid: 207601|app: 0|req: 656/1309] 10.222.0.42 () {54 vars in 965 bytes} [Thu Jul 28 08:29:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 08:29:10.708110 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0babe97-ebb8-456d-b750-cf5ccf4a9179 None None] REQUEST_METHOD: `POST` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:29:10.708405 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0babe97-ebb8-456d-b750-cf5ccf4a9179 None None] SCRIPT_NAME: `/identity` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:29:10.708693 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0babe97-ebb8-456d-b750-cf5ccf4a9179 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:29:10.806611 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.auth.core [None req-f0babe97-ebb8-456d-b750-cf5ccf4a9179 None None] MFA Rules not processed for user `8d8ee8f8acaf4811addc298a15a4916b`. Rule list: `[]` (Enabled: `True`). {{(pid=207600) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 08:29:10.807939 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.fernet_utils [None req-f0babe97-ebb8-456d-b750-cf5ccf4a9179 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=207600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:29:10.830899 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG dbcounter [-] [207600] Writing DB stats keystone:SELECT=100 {{(pid=207600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:29:10.909756 dv-cinder-851351-1-smb devstack@keystone.service[207600]: [pid: 207600|app: 0|req: 654/1310] 10.222.0.42 () {58 vars in 1062 bytes} [Thu Jul 28 08:29:10 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 08:29:10.911468 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3881b9fb-e104-4355-96d6-61e0f2be1dcf None None] Authenticating user token {{(pid=207601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:29:10.913716 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.fernet_utils [None req-3881b9fb-e104-4355-96d6-61e0f2be1dcf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=207601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:29:11.152031 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3881b9fb-e104-4355-96d6-61e0f2be1dcf None None] Validating token access rules against request {{(pid=207601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:29:11.267308 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31be4c13-699c-49bc-8de4-0d9911dc43fa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d8ee8f8acaf4811addc298a15a4916b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48c5f2b2ae2b48758b957d2b194a7fd1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:29:11.268108 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31be4c13-699c-49bc-8de4-0d9911dc43fa service neutron] REQUEST_METHOD: `GET` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:29:11.268458 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31be4c13-699c-49bc-8de4-0d9911dc43fa service neutron] SCRIPT_NAME: `/identity` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:29:11.268857 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31be4c13-699c-49bc-8de4-0d9911dc43fa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:29:11.271030 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.fernet_utils [None req-31be4c13-699c-49bc-8de4-0d9911dc43fa service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=207601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:29:11.349595 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG dbcounter [-] [207601] Writing DB stats keystone:SELECT=100 {{(pid=207601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:29:11.424865 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31be4c13-699c-49bc-8de4-0d9911dc43fa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:29:11.426502 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31be4c13-699c-49bc-8de4-0d9911dc43fa service neutron] RBAC: Authorization granted {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:29:11.451252 dv-cinder-851351-1-smb devstack@keystone.service[207601]: [pid: 207601|app: 0|req: 657/1311] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Jul 28 08:29:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 541 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 28 08:29:13.797514 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ea2078-87b2-4bfc-a20f-d6fabc7506fa None None] REQUEST_METHOD: `GET` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:29:13.798160 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ea2078-87b2-4bfc-a20f-d6fabc7506fa None None] SCRIPT_NAME: `/identity` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:29:13.798160 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ea2078-87b2-4bfc-a20f-d6fabc7506fa None None] PATH_INFO: `/` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:29:13.799474 dv-cinder-851351-1-smb devstack@keystone.service[207600]: [pid: 207600|app: 0|req: 655/1312] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 08:29:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 08:29:13.805270 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ffc48e0-8b42-48e2-9df5-a3699d5469c0 None None] REQUEST_METHOD: `POST` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:29:13.805763 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ffc48e0-8b42-48e2-9df5-a3699d5469c0 None None] SCRIPT_NAME: `/identity` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:29:13.805881 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ffc48e0-8b42-48e2-9df5-a3699d5469c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:29:13.900737 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.auth.core [None req-7ffc48e0-8b42-48e2-9df5-a3699d5469c0 None None] MFA Rules not processed for user `b8110ade874c4aa7af27f5c376df700a`. Rule list: `[]` (Enabled: `True`). {{(pid=207601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 08:29:13.902059 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.fernet_utils [None req-7ffc48e0-8b42-48e2-9df5-a3699d5469c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=207601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:29:14.009432 dv-cinder-851351-1-smb devstack@keystone.service[207601]: [pid: 207601|app: 0|req: 658/1313] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 08:29:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 08:29:14.064376 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e5bc4a-2d14-4a3a-930f-9f69a88d900e None None] REQUEST_METHOD: `GET` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:29:14.064609 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e5bc4a-2d14-4a3a-930f-9f69a88d900e None None] SCRIPT_NAME: `/identity` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:29:14.064911 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e5bc4a-2d14-4a3a-930f-9f69a88d900e None None] PATH_INFO: `/` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:29:14.066871 dv-cinder-851351-1-smb devstack@keystone.service[207600]: [pid: 207600|app: 0|req: 656/1314] 10.222.0.42 () {54 vars in 965 bytes} [Thu Jul 28 08:29:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 08:29:14.074316 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc635072-e38d-48a0-9774-5ce649838f90 None None] REQUEST_METHOD: `POST` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:29:14.074553 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc635072-e38d-48a0-9774-5ce649838f90 None None] SCRIPT_NAME: `/identity` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:29:14.075049 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc635072-e38d-48a0-9774-5ce649838f90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:29:14.088307 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG dbcounter [-] [207601] Writing DB stats keystone:SELECT=100 {{(pid=207601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:29:14.163255 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.auth.core [None req-bc635072-e38d-48a0-9774-5ce649838f90 None None] MFA Rules not processed for user `8d8ee8f8acaf4811addc298a15a4916b`. Rule list: `[]` (Enabled: `True`). {{(pid=207601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 08:29:14.164687 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.fernet_utils [None req-bc635072-e38d-48a0-9774-5ce649838f90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=207601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:29:14.270452 dv-cinder-851351-1-smb devstack@keystone.service[207601]: [pid: 207601|app: 0|req: 659/1315] 10.222.0.42 () {58 vars in 1062 bytes} [Thu Jul 28 08:29:14 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 08:29:14.279592 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e5bc4a-2d14-4a3a-930f-9f69a88d900e None None] Authenticating user token {{(pid=207600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:29:14.281254 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.fernet_utils [None req-12e5bc4a-2d14-4a3a-930f-9f69a88d900e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=207600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:29:14.399695 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e5bc4a-2d14-4a3a-930f-9f69a88d900e None None] Validating token access rules against request {{(pid=207600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:29:14.487025 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG dbcounter [-] [207600] Writing DB stats keystone:SELECT=100 {{(pid=207600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:29:14.490213 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d413bb-e7a4-448b-9520-60a35a352016 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d8ee8f8acaf4811addc298a15a4916b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48c5f2b2ae2b48758b957d2b194a7fd1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:29:14.490899 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d413bb-e7a4-448b-9520-60a35a352016 service neutron] REQUEST_METHOD: `GET` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:29:14.491454 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d413bb-e7a4-448b-9520-60a35a352016 service neutron] SCRIPT_NAME: `/identity` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:29:14.491945 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d413bb-e7a4-448b-9520-60a35a352016 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:29:14.494078 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.fernet_utils [None req-d5d413bb-e7a4-448b-9520-60a35a352016 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=207600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:29:14.612451 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5d413bb-e7a4-448b-9520-60a35a352016 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:29:14.613990 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5d413bb-e7a4-448b-9520-60a35a352016 service neutron] RBAC: Authorization granted {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:29:14.633672 dv-cinder-851351-1-smb devstack@keystone.service[207600]: [pid: 207600|app: 0|req: 657/1316] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Jul 28 08:29:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 355 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 08:29:17.183663 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29c64f0-ca15-4749-a5d1-799870f0b161 None None] REQUEST_METHOD: `GET` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:29:17.184212 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29c64f0-ca15-4749-a5d1-799870f0b161 None None] SCRIPT_NAME: `/identity` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:29:17.184212 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29c64f0-ca15-4749-a5d1-799870f0b161 None None] PATH_INFO: `/` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:29:17.185495 dv-cinder-851351-1-smb devstack@keystone.service[207601]: [pid: 207601|app: 0|req: 660/1317] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 08:29:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 08:29:17.190844 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8cd5c56-1a48-436a-a4b9-f4fc68820ef2 None None] REQUEST_METHOD: `POST` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:29:17.191293 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8cd5c56-1a48-436a-a4b9-f4fc68820ef2 None None] SCRIPT_NAME: `/identity` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:29:17.191403 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8cd5c56-1a48-436a-a4b9-f4fc68820ef2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:29:17.264906 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.auth.core [None req-a8cd5c56-1a48-436a-a4b9-f4fc68820ef2 None None] MFA Rules not processed for user `8c28b8a46b2e45fdbcbb20dfc58d7f41`. Rule list: `[]` (Enabled: `True`). {{(pid=207600) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 08:29:17.266681 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.fernet_utils [None req-a8cd5c56-1a48-436a-a4b9-f4fc68820ef2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=207600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:29:17.327830 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG dbcounter [-] [207600] Writing DB stats keystone:SELECT=100 {{(pid=207600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:29:17.378132 dv-cinder-851351-1-smb devstack@keystone.service[207600]: [pid: 207600|app: 0|req: 658/1318] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 08:29:17 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 08:29:17.419642 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29c64f0-ca15-4749-a5d1-799870f0b161 None None] Authenticating user token {{(pid=207601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:29:17.421253 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.fernet_utils [None req-f29c64f0-ca15-4749-a5d1-799870f0b161 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=207601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:29:17.532087 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29c64f0-ca15-4749-a5d1-799870f0b161 None None] Validating token access rules against request {{(pid=207601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:29:17.534952 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG dbcounter [-] [207601] Writing DB stats keystone:SELECT=100 {{(pid=207601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:29:17.618981 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b2fbc3-7855-4e89-8caf-8e33acbd0c6c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d8ee8f8acaf4811addc298a15a4916b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48c5f2b2ae2b48758b957d2b194a7fd1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:29:17.619615 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b2fbc3-7855-4e89-8caf-8e33acbd0c6c service neutron] REQUEST_METHOD: `GET` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:29:17.619895 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b2fbc3-7855-4e89-8caf-8e33acbd0c6c service neutron] SCRIPT_NAME: `/identity` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:29:17.620170 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b2fbc3-7855-4e89-8caf-8e33acbd0c6c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:29:17.621847 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.fernet_utils [None req-c9b2fbc3-7855-4e89-8caf-8e33acbd0c6c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=207601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:29:17.742477 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b2fbc3-7855-4e89-8caf-8e33acbd0c6c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:29:17.743923 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b2fbc3-7855-4e89-8caf-8e33acbd0c6c service neutron] RBAC: Authorization granted {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:29:17.763331 dv-cinder-851351-1-smb devstack@keystone.service[207601]: [pid: 207601|app: 0|req: 661/1319] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Jul 28 08:29:17 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 344 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 08:29:20.393935 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966302eb-d3f7-4e46-83ac-8ac01c3739c5 None None] REQUEST_METHOD: `GET` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:29:20.394564 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966302eb-d3f7-4e46-83ac-8ac01c3739c5 None None] SCRIPT_NAME: `/identity` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:29:20.394564 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966302eb-d3f7-4e46-83ac-8ac01c3739c5 None None] PATH_INFO: `/` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:29:20.395882 dv-cinder-851351-1-smb devstack@keystone.service[207600]: [pid: 207600|app: 0|req: 659/1320] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 08:29:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 08:29:20.401940 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbe0f66-7867-4977-8851-85e85c3b34ba None None] REQUEST_METHOD: `POST` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:29:20.402561 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbe0f66-7867-4977-8851-85e85c3b34ba None None] SCRIPT_NAME: `/identity` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:29:20.402561 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbe0f66-7867-4977-8851-85e85c3b34ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:29:20.450361 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG dbcounter [-] [207601] Writing DB stats keystone:SELECT=100 {{(pid=207601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:29:20.486834 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.auth.core [None req-6bbe0f66-7867-4977-8851-85e85c3b34ba None None] MFA Rules not processed for user `b8110ade874c4aa7af27f5c376df700a`. Rule list: `[]` (Enabled: `True`). {{(pid=207601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 08:29:20.488089 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.fernet_utils [None req-6bbe0f66-7867-4977-8851-85e85c3b34ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=207601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:29:20.591757 dv-cinder-851351-1-smb devstack@keystone.service[207601]: [pid: 207601|app: 0|req: 662/1321] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 08:29:20 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 08:29:20.630822 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966302eb-d3f7-4e46-83ac-8ac01c3739c5 None None] Authenticating user token {{(pid=207600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:29:20.632403 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.fernet_utils [None req-966302eb-d3f7-4e46-83ac-8ac01c3739c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=207600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:29:20.739624 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966302eb-d3f7-4e46-83ac-8ac01c3739c5 None None] Validating token access rules against request {{(pid=207600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:29:20.818456 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03692db5-9248-4e84-af04-47c4995576a8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d8ee8f8acaf4811addc298a15a4916b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48c5f2b2ae2b48758b957d2b194a7fd1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:29:20.819099 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03692db5-9248-4e84-af04-47c4995576a8 service neutron] REQUEST_METHOD: `GET` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:29:20.819447 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03692db5-9248-4e84-af04-47c4995576a8 service neutron] SCRIPT_NAME: `/identity` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:29:20.819718 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03692db5-9248-4e84-af04-47c4995576a8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:29:20.821448 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.fernet_utils [None req-03692db5-9248-4e84-af04-47c4995576a8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=207600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:29:20.829999 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG dbcounter [-] [207600] Writing DB stats keystone:SELECT=100 {{(pid=207600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:29:20.941891 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03692db5-9248-4e84-af04-47c4995576a8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:29:20.943349 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03692db5-9248-4e84-af04-47c4995576a8 service neutron] RBAC: Authorization granted {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:29:20.962397 dv-cinder-851351-1-smb devstack@keystone.service[207600]: [pid: 207600|app: 0|req: 660/1322] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Jul 28 08:29:20 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 08:29:23.924494 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35e2168-82c5-4edb-b93f-9643e1f6a378 None None] REQUEST_METHOD: `GET` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:29:23.925125 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35e2168-82c5-4edb-b93f-9643e1f6a378 None None] SCRIPT_NAME: `/identity` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:29:23.925125 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35e2168-82c5-4edb-b93f-9643e1f6a378 None None] PATH_INFO: `/` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:29:23.926445 dv-cinder-851351-1-smb devstack@keystone.service[207601]: [pid: 207601|app: 0|req: 663/1323] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 08:29:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 08:29:23.931907 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43dc329f-ce0e-4610-bec0-f832dcae7e0a None None] REQUEST_METHOD: `POST` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:29:23.932388 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43dc329f-ce0e-4610-bec0-f832dcae7e0a None None] SCRIPT_NAME: `/identity` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:29:23.932486 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43dc329f-ce0e-4610-bec0-f832dcae7e0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:29:24.004793 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.auth.core [None req-43dc329f-ce0e-4610-bec0-f832dcae7e0a None None] MFA Rules not processed for user `b8110ade874c4aa7af27f5c376df700a`. Rule list: `[]` (Enabled: `True`). {{(pid=207600) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 08:29:24.006015 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.fernet_utils [None req-43dc329f-ce0e-4610-bec0-f832dcae7e0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=207600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:29:24.068590 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG dbcounter [-] [207600] Writing DB stats keystone:SELECT=100 {{(pid=207600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:29:24.117797 dv-cinder-851351-1-smb devstack@keystone.service[207600]: [pid: 207600|app: 0|req: 661/1324] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 08:29:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 08:29:24.156008 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35e2168-82c5-4edb-b93f-9643e1f6a378 None None] Authenticating user token {{(pid=207601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:29:24.157661 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.fernet_utils [None req-c35e2168-82c5-4edb-b93f-9643e1f6a378 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=207601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:29:24.282605 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35e2168-82c5-4edb-b93f-9643e1f6a378 None None] Validating token access rules against request {{(pid=207601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:29:24.304020 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG dbcounter [-] [207601] Writing DB stats keystone:SELECT=100 {{(pid=207601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:29:24.416723 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b3c818-8d56-4007-8942-cc5dfa40bf42 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d8ee8f8acaf4811addc298a15a4916b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48c5f2b2ae2b48758b957d2b194a7fd1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:29:24.417687 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b3c818-8d56-4007-8942-cc5dfa40bf42 service neutron] REQUEST_METHOD: `GET` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:29:24.418176 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b3c818-8d56-4007-8942-cc5dfa40bf42 service neutron] SCRIPT_NAME: `/identity` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:29:24.418661 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b3c818-8d56-4007-8942-cc5dfa40bf42 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:29:24.421683 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.fernet_utils [None req-39b3c818-8d56-4007-8942-cc5dfa40bf42 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=207601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:29:24.602655 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b3c818-8d56-4007-8942-cc5dfa40bf42 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:29:24.604150 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b3c818-8d56-4007-8942-cc5dfa40bf42 service neutron] RBAC: Authorization granted {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:29:24.624605 dv-cinder-851351-1-smb devstack@keystone.service[207601]: [pid: 207601|app: 0|req: 664/1325] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Jul 28 08:29:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 469 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 08:29:26.709664 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b1b301-5ba4-472d-bc2a-f200dd5ec1b5 None None] REQUEST_METHOD: `GET` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:29:26.710224 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b1b301-5ba4-472d-bc2a-f200dd5ec1b5 None None] SCRIPT_NAME: `/identity` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:29:26.710224 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b1b301-5ba4-472d-bc2a-f200dd5ec1b5 None None] PATH_INFO: `/` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:29:26.711479 dv-cinder-851351-1-smb devstack@keystone.service[207600]: [pid: 207600|app: 0|req: 662/1326] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 08:29:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 28 08:29:26.716999 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb89a2eb-5f59-45e2-903d-d97480cf0989 None None] REQUEST_METHOD: `POST` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:29:26.717447 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb89a2eb-5f59-45e2-903d-d97480cf0989 None None] SCRIPT_NAME: `/identity` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:29:26.717447 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb89a2eb-5f59-45e2-903d-d97480cf0989 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:29:26.773267 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG dbcounter [-] [207601] Writing DB stats keystone:SELECT=100 {{(pid=207601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:29:26.793372 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.auth.core [None req-eb89a2eb-5f59-45e2-903d-d97480cf0989 None None] MFA Rules not processed for user `b8110ade874c4aa7af27f5c376df700a`. Rule list: `[]` (Enabled: `True`). {{(pid=207601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 08:29:26.794643 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.fernet_utils [None req-eb89a2eb-5f59-45e2-903d-d97480cf0989 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=207601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:29:26.922150 dv-cinder-851351-1-smb devstack@keystone.service[207601]: [pid: 207601|app: 0|req: 665/1327] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 08:29:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 08:29:26.961802 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b1b301-5ba4-472d-bc2a-f200dd5ec1b5 None None] Authenticating user token {{(pid=207600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:29:26.963389 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.fernet_utils [None req-e9b1b301-5ba4-472d-bc2a-f200dd5ec1b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=207600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:29:27.071521 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b1b301-5ba4-472d-bc2a-f200dd5ec1b5 None None] Validating token access rules against request {{(pid=207600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:29:27.156507 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03919417-4682-4a52-8ee1-343db64dd3a3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d8ee8f8acaf4811addc298a15a4916b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48c5f2b2ae2b48758b957d2b194a7fd1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:29:27.157314 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03919417-4682-4a52-8ee1-343db64dd3a3 service neutron] REQUEST_METHOD: `GET` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:29:27.157602 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03919417-4682-4a52-8ee1-343db64dd3a3 service neutron] SCRIPT_NAME: `/identity` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:29:27.157879 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03919417-4682-4a52-8ee1-343db64dd3a3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:29:27.159568 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.fernet_utils [None req-03919417-4682-4a52-8ee1-343db64dd3a3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=207600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:29:27.177372 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG dbcounter [-] [207600] Writing DB stats keystone:SELECT=100 {{(pid=207600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:29:27.279459 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03919417-4682-4a52-8ee1-343db64dd3a3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:29:27.280910 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03919417-4682-4a52-8ee1-343db64dd3a3 service neutron] RBAC: Authorization granted {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:29:27.300537 dv-cinder-851351-1-smb devstack@keystone.service[207600]: [pid: 207600|app: 0|req: 663/1328] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Jul 28 08:29:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 08:29:29.350729 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13aed982-81dc-4e45-ad5c-df2db79ae2a1 None None] REQUEST_METHOD: `GET` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:29:29.351345 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13aed982-81dc-4e45-ad5c-df2db79ae2a1 None None] SCRIPT_NAME: `/identity` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:29:29.351345 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13aed982-81dc-4e45-ad5c-df2db79ae2a1 None None] PATH_INFO: `/` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:29:29.352703 dv-cinder-851351-1-smb devstack@keystone.service[207601]: [pid: 207601|app: 0|req: 666/1329] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 08:29:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 08:29:29.358427 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1149c716-9358-482e-8b63-8b24e3716d3a None None] REQUEST_METHOD: `POST` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:29:29.358930 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1149c716-9358-482e-8b63-8b24e3716d3a None None] SCRIPT_NAME: `/identity` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:29:29.358930 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1149c716-9358-482e-8b63-8b24e3716d3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:29:29.436046 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.auth.core [None req-1149c716-9358-482e-8b63-8b24e3716d3a None None] MFA Rules not processed for user `8c28b8a46b2e45fdbcbb20dfc58d7f41`. Rule list: `[]` (Enabled: `True`). {{(pid=207600) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 08:29:29.437336 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.fernet_utils [None req-1149c716-9358-482e-8b63-8b24e3716d3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=207600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:29:29.518625 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG dbcounter [-] [207600] Writing DB stats keystone:SELECT=100 {{(pid=207600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:29:29.558094 dv-cinder-851351-1-smb devstack@keystone.service[207600]: [pid: 207600|app: 0|req: 664/1330] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 08:29:29 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 08:29:29.597600 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13aed982-81dc-4e45-ad5c-df2db79ae2a1 None None] Authenticating user token {{(pid=207601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:29:29.599233 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.fernet_utils [None req-13aed982-81dc-4e45-ad5c-df2db79ae2a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=207601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:29:29.722237 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13aed982-81dc-4e45-ad5c-df2db79ae2a1 None None] Validating token access rules against request {{(pid=207601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:29:29.743828 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG dbcounter [-] [207601] Writing DB stats keystone:SELECT=100 {{(pid=207601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:29:29.810169 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f80c285d-136c-4516-90b7-670885321b02 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d8ee8f8acaf4811addc298a15a4916b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48c5f2b2ae2b48758b957d2b194a7fd1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:29:29.810834 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80c285d-136c-4516-90b7-670885321b02 service neutron] REQUEST_METHOD: `GET` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:29:29.811142 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80c285d-136c-4516-90b7-670885321b02 service neutron] SCRIPT_NAME: `/identity` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:29:29.811420 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80c285d-136c-4516-90b7-670885321b02 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:29:29.814144 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.fernet_utils [None req-f80c285d-136c-4516-90b7-670885321b02 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=207601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:29:29.943774 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f80c285d-136c-4516-90b7-670885321b02 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:29:29.945281 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f80c285d-136c-4516-90b7-670885321b02 service neutron] RBAC: Authorization granted {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:29:29.964584 dv-cinder-851351-1-smb devstack@keystone.service[207601]: [pid: 207601|app: 0|req: 667/1331] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Jul 28 08:29:29 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 368 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 08:29:32.260784 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc079012-491d-45aa-82b7-dba746b9ec13 None None] REQUEST_METHOD: `GET` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:29:32.261340 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc079012-491d-45aa-82b7-dba746b9ec13 None None] SCRIPT_NAME: `/identity` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:29:32.261340 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc079012-491d-45aa-82b7-dba746b9ec13 None None] PATH_INFO: `/` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:29:32.262683 dv-cinder-851351-1-smb devstack@keystone.service[207600]: [pid: 207600|app: 0|req: 665/1332] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 08:29:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 08:29:32.268699 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4fa886-038a-46b4-b89b-3ee244275a55 None None] REQUEST_METHOD: `POST` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:29:32.269195 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4fa886-038a-46b4-b89b-3ee244275a55 None None] SCRIPT_NAME: `/identity` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:29:32.269753 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4fa886-038a-46b4-b89b-3ee244275a55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:29:32.342453 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG dbcounter [-] [207601] Writing DB stats keystone:SELECT=100 {{(pid=207601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:29:32.346026 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.auth.core [None req-cc4fa886-038a-46b4-b89b-3ee244275a55 None None] MFA Rules not processed for user `b8110ade874c4aa7af27f5c376df700a`. Rule list: `[]` (Enabled: `True`). {{(pid=207601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 08:29:32.348201 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.fernet_utils [None req-cc4fa886-038a-46b4-b89b-3ee244275a55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=207601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:29:32.453165 dv-cinder-851351-1-smb devstack@keystone.service[207601]: [pid: 207601|app: 0|req: 668/1333] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 08:29:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 08:29:32.489944 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc079012-491d-45aa-82b7-dba746b9ec13 None None] Authenticating user token {{(pid=207600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:29:32.491553 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.fernet_utils [None req-fc079012-491d-45aa-82b7-dba746b9ec13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=207600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:29:32.607396 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc079012-491d-45aa-82b7-dba746b9ec13 None None] Validating token access rules against request {{(pid=207600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:29:32.685597 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4510665e-2f42-4cb9-9180-5cec32d3d9e2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d8ee8f8acaf4811addc298a15a4916b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48c5f2b2ae2b48758b957d2b194a7fd1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:29:32.686227 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4510665e-2f42-4cb9-9180-5cec32d3d9e2 service neutron] REQUEST_METHOD: `GET` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:29:32.686513 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4510665e-2f42-4cb9-9180-5cec32d3d9e2 service neutron] SCRIPT_NAME: `/identity` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:29:32.686773 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4510665e-2f42-4cb9-9180-5cec32d3d9e2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:29:32.688452 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.fernet_utils [None req-4510665e-2f42-4cb9-9180-5cec32d3d9e2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=207600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:29:32.717914 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG dbcounter [-] [207600] Writing DB stats keystone:SELECT=100 {{(pid=207600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:29:32.810578 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4510665e-2f42-4cb9-9180-5cec32d3d9e2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:29:32.812033 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4510665e-2f42-4cb9-9180-5cec32d3d9e2 service neutron] RBAC: Authorization granted {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:29:32.830813 dv-cinder-851351-1-smb devstack@keystone.service[207600]: [pid: 207600|app: 0|req: 666/1334] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Jul 28 08:29:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 08:29:34.888723 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269c5655-3ac7-4693-8ecc-2ea8f8aaddea None None] REQUEST_METHOD: `GET` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:29:34.889295 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269c5655-3ac7-4693-8ecc-2ea8f8aaddea None None] SCRIPT_NAME: `/identity` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:29:34.889295 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269c5655-3ac7-4693-8ecc-2ea8f8aaddea None None] PATH_INFO: `/` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:29:34.890694 dv-cinder-851351-1-smb devstack@keystone.service[207601]: [pid: 207601|app: 0|req: 669/1335] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 08:29:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 08:29:34.896842 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5ddbb1-4fe1-4fe3-a8d1-13c89794d196 None None] REQUEST_METHOD: `POST` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:29:34.897362 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5ddbb1-4fe1-4fe3-a8d1-13c89794d196 None None] SCRIPT_NAME: `/identity` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:29:34.897362 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5ddbb1-4fe1-4fe3-a8d1-13c89794d196 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:29:34.972201 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.auth.core [None req-6d5ddbb1-4fe1-4fe3-a8d1-13c89794d196 None None] MFA Rules not processed for user `b8110ade874c4aa7af27f5c376df700a`. Rule list: `[]` (Enabled: `True`). {{(pid=207600) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 08:29:34.973480 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.fernet_utils [None req-6d5ddbb1-4fe1-4fe3-a8d1-13c89794d196 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=207600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:29:35.062979 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG dbcounter [-] [207600] Writing DB stats keystone:SELECT=100 {{(pid=207600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:29:35.087785 dv-cinder-851351-1-smb devstack@keystone.service[207600]: [pid: 207600|app: 0|req: 667/1336] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 08:29:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 08:29:35.133057 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269c5655-3ac7-4693-8ecc-2ea8f8aaddea None None] Authenticating user token {{(pid=207601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:29:35.134657 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.fernet_utils [None req-269c5655-3ac7-4693-8ecc-2ea8f8aaddea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=207601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:29:35.253567 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269c5655-3ac7-4693-8ecc-2ea8f8aaddea None None] Validating token access rules against request {{(pid=207601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:29:35.284342 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG dbcounter [-] [207601] Writing DB stats keystone:SELECT=100 {{(pid=207601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:29:35.335026 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94498294-bf67-4d31-b782-6b77cc41accd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d8ee8f8acaf4811addc298a15a4916b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48c5f2b2ae2b48758b957d2b194a7fd1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:29:35.335678 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94498294-bf67-4d31-b782-6b77cc41accd service neutron] REQUEST_METHOD: `GET` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:29:35.335956 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94498294-bf67-4d31-b782-6b77cc41accd service neutron] SCRIPT_NAME: `/identity` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:29:35.336227 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94498294-bf67-4d31-b782-6b77cc41accd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:29:35.337963 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.fernet_utils [None req-94498294-bf67-4d31-b782-6b77cc41accd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=207601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:29:35.459552 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94498294-bf67-4d31-b782-6b77cc41accd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:29:35.461048 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94498294-bf67-4d31-b782-6b77cc41accd service neutron] RBAC: Authorization granted {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:29:35.480383 dv-cinder-851351-1-smb devstack@keystone.service[207601]: [pid: 207601|app: 0|req: 670/1337] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Jul 28 08:29:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 348 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 08:29:37.864799 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f7d07c-d54b-400c-a933-6a64249833ae None None] REQUEST_METHOD: `GET` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:29:37.865383 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f7d07c-d54b-400c-a933-6a64249833ae None None] SCRIPT_NAME: `/identity` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:29:37.865383 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f7d07c-d54b-400c-a933-6a64249833ae None None] PATH_INFO: `/` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:29:37.866749 dv-cinder-851351-1-smb devstack@keystone.service[207600]: [pid: 207600|app: 0|req: 668/1338] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 08:29:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 08:29:37.872147 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cbe7a6b-5a0f-47d8-834c-3b9974d7c7be None None] REQUEST_METHOD: `POST` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:29:37.872599 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cbe7a6b-5a0f-47d8-834c-3b9974d7c7be None None] SCRIPT_NAME: `/identity` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:29:37.872727 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cbe7a6b-5a0f-47d8-834c-3b9974d7c7be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:29:37.945644 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.auth.core [None req-7cbe7a6b-5a0f-47d8-834c-3b9974d7c7be None None] MFA Rules not processed for user `b8110ade874c4aa7af27f5c376df700a`. Rule list: `[]` (Enabled: `True`). {{(pid=207601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 08:29:37.946906 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.fernet_utils [None req-7cbe7a6b-5a0f-47d8-834c-3b9974d7c7be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=207601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:29:37.955917 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG dbcounter [-] [207601] Writing DB stats keystone:SELECT=100 {{(pid=207601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:29:38.050197 dv-cinder-851351-1-smb devstack@keystone.service[207601]: [pid: 207601|app: 0|req: 671/1339] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 08:29:37 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 08:29:38.087238 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f7d07c-d54b-400c-a933-6a64249833ae None None] Authenticating user token {{(pid=207600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:29:38.088835 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.fernet_utils [None req-98f7d07c-d54b-400c-a933-6a64249833ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=207600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:29:38.197213 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f7d07c-d54b-400c-a933-6a64249833ae None None] Validating token access rules against request {{(pid=207600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:29:38.275750 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c23ee2d-e406-4aa1-ae24-a80d7de38eec service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d8ee8f8acaf4811addc298a15a4916b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48c5f2b2ae2b48758b957d2b194a7fd1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:29:38.276373 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c23ee2d-e406-4aa1-ae24-a80d7de38eec service neutron] REQUEST_METHOD: `GET` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:29:38.276649 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c23ee2d-e406-4aa1-ae24-a80d7de38eec service neutron] SCRIPT_NAME: `/identity` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:29:38.276949 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c23ee2d-e406-4aa1-ae24-a80d7de38eec service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:29:38.278592 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.fernet_utils [None req-6c23ee2d-e406-4aa1-ae24-a80d7de38eec service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=207600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:29:38.318683 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG dbcounter [-] [207600] Writing DB stats keystone:SELECT=100 {{(pid=207600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:29:38.403575 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c23ee2d-e406-4aa1-ae24-a80d7de38eec service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:29:38.405251 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c23ee2d-e406-4aa1-ae24-a80d7de38eec service neutron] RBAC: Authorization granted {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:29:38.426840 dv-cinder-851351-1-smb devstack@keystone.service[207600]: [pid: 207600|app: 0|req: 669/1340] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Jul 28 08:29:38 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 340 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 08:29:42.611594 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6ecdaf-547d-4ff9-a044-87cb5f331b23 None None] REQUEST_METHOD: `GET` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:29:42.612473 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6ecdaf-547d-4ff9-a044-87cb5f331b23 None None] SCRIPT_NAME: `/identity` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:29:42.612473 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6ecdaf-547d-4ff9-a044-87cb5f331b23 None None] PATH_INFO: `/` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:29:42.613906 dv-cinder-851351-1-smb devstack@keystone.service[207601]: [pid: 207601|app: 0|req: 672/1341] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 08:29:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 28 08:29:42.620972 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139fd1e1-e96e-4cbe-9b31-0466f20a45ff None None] REQUEST_METHOD: `POST` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:29:42.621946 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139fd1e1-e96e-4cbe-9b31-0466f20a45ff None None] SCRIPT_NAME: `/identity` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:29:42.621946 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139fd1e1-e96e-4cbe-9b31-0466f20a45ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:29:42.714060 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.auth.core [None req-139fd1e1-e96e-4cbe-9b31-0466f20a45ff None None] MFA Rules not processed for user `b8110ade874c4aa7af27f5c376df700a`. Rule list: `[]` (Enabled: `True`). {{(pid=207600) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 08:29:42.715405 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.fernet_utils [None req-139fd1e1-e96e-4cbe-9b31-0466f20a45ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=207600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:29:42.832763 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG dbcounter [-] [207600] Writing DB stats keystone:SELECT=100 {{(pid=207600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:29:42.848725 dv-cinder-851351-1-smb devstack@keystone.service[207600]: [pid: 207600|app: 0|req: 670/1342] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 08:29:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 230 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 08:29:42.899359 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6ecdaf-547d-4ff9-a044-87cb5f331b23 None None] Authenticating user token {{(pid=207601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:29:42.900986 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.fernet_utils [None req-2d6ecdaf-547d-4ff9-a044-87cb5f331b23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=207601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:29:43.064139 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6ecdaf-547d-4ff9-a044-87cb5f331b23 None None] Validating token access rules against request {{(pid=207601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:29:43.113211 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG dbcounter [-] [207601] Writing DB stats keystone:SELECT=100 {{(pid=207601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:29:43.159310 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76c86cf-d6df-4ad5-a3e0-cd1ee86e1943 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d8ee8f8acaf4811addc298a15a4916b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48c5f2b2ae2b48758b957d2b194a7fd1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:29:43.159986 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76c86cf-d6df-4ad5-a3e0-cd1ee86e1943 service neutron] REQUEST_METHOD: `GET` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:29:43.160270 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76c86cf-d6df-4ad5-a3e0-cd1ee86e1943 service neutron] SCRIPT_NAME: `/identity` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:29:43.160571 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76c86cf-d6df-4ad5-a3e0-cd1ee86e1943 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:29:43.162366 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.fernet_utils [None req-d76c86cf-d6df-4ad5-a3e0-cd1ee86e1943 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=207601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:29:43.302104 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d76c86cf-d6df-4ad5-a3e0-cd1ee86e1943 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:29:43.303485 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d76c86cf-d6df-4ad5-a3e0-cd1ee86e1943 service neutron] RBAC: Authorization granted {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:29:43.325061 dv-cinder-851351-1-smb devstack@keystone.service[207601]: [pid: 207601|app: 0|req: 673/1343] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Jul 28 08:29:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 426 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 08:29:46.411064 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330b7d64-297e-4da4-871b-4a167037d416 None None] REQUEST_METHOD: `GET` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:29:46.411657 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330b7d64-297e-4da4-871b-4a167037d416 None None] SCRIPT_NAME: `/identity` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:29:46.411782 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330b7d64-297e-4da4-871b-4a167037d416 None None] PATH_INFO: `/` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:29:46.413333 dv-cinder-851351-1-smb devstack@keystone.service[207600]: [pid: 207600|app: 0|req: 671/1344] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 08:29:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 08:29:46.419513 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2622043-9f6a-4be0-bf2e-61f83a1f1f73 None None] REQUEST_METHOD: `POST` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:29:46.420286 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2622043-9f6a-4be0-bf2e-61f83a1f1f73 None None] SCRIPT_NAME: `/identity` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:29:46.420286 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2622043-9f6a-4be0-bf2e-61f83a1f1f73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:29:46.512628 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.auth.core [None req-f2622043-9f6a-4be0-bf2e-61f83a1f1f73 None None] MFA Rules not processed for user `b8110ade874c4aa7af27f5c376df700a`. Rule list: `[]` (Enabled: `True`). {{(pid=207601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 08:29:46.514604 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.fernet_utils [None req-f2622043-9f6a-4be0-bf2e-61f83a1f1f73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=207601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:29:46.546528 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG dbcounter [-] [207601] Writing DB stats keystone:SELECT=100 {{(pid=207601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:29:46.673360 dv-cinder-851351-1-smb devstack@keystone.service[207601]: [pid: 207601|app: 0|req: 674/1345] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 08:29:46 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 255 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 08:29:46.714814 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330b7d64-297e-4da4-871b-4a167037d416 None None] Authenticating user token {{(pid=207600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:29:46.716557 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.fernet_utils [None req-330b7d64-297e-4da4-871b-4a167037d416 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=207600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:29:46.846511 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330b7d64-297e-4da4-871b-4a167037d416 None None] Validating token access rules against request {{(pid=207600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:29:46.941486 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db484adb-32c1-4941-8681-d0233c1c85e9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d8ee8f8acaf4811addc298a15a4916b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48c5f2b2ae2b48758b957d2b194a7fd1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:29:46.942021 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db484adb-32c1-4941-8681-d0233c1c85e9 service neutron] REQUEST_METHOD: `GET` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:29:46.942286 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db484adb-32c1-4941-8681-d0233c1c85e9 service neutron] SCRIPT_NAME: `/identity` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:29:46.942562 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db484adb-32c1-4941-8681-d0233c1c85e9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:29:46.944305 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.fernet_utils [None req-db484adb-32c1-4941-8681-d0233c1c85e9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=207600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:29:46.994459 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG dbcounter [-] [207600] Writing DB stats keystone:SELECT=100 {{(pid=207600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:29:47.070055 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db484adb-32c1-4941-8681-d0233c1c85e9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:29:47.071427 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db484adb-32c1-4941-8681-d0233c1c85e9 service neutron] RBAC: Authorization granted {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:29:47.092246 dv-cinder-851351-1-smb devstack@keystone.service[207600]: [pid: 207600|app: 0|req: 672/1346] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Jul 28 08:29:46 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 378 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 08:29:51.731714 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5105ef2f-c925-4cce-acbe-68be0b2b16f8 None None] REQUEST_METHOD: `GET` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:29:51.732370 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5105ef2f-c925-4cce-acbe-68be0b2b16f8 None None] SCRIPT_NAME: `/identity` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:29:51.732798 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5105ef2f-c925-4cce-acbe-68be0b2b16f8 None None] PATH_INFO: `/` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:29:51.735276 dv-cinder-851351-1-smb devstack@keystone.service[207601]: [pid: 207601|app: 0|req: 675/1347] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 08:29:51 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 08:29:51.742419 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b6f3b6-b84f-4726-a13e-e554b6f039e9 None None] REQUEST_METHOD: `POST` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:29:51.742962 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b6f3b6-b84f-4726-a13e-e554b6f039e9 None None] SCRIPT_NAME: `/identity` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:29:51.742962 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b6f3b6-b84f-4726-a13e-e554b6f039e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:29:51.831601 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.auth.core [None req-59b6f3b6-b84f-4726-a13e-e554b6f039e9 None None] MFA Rules not processed for user `b8110ade874c4aa7af27f5c376df700a`. Rule list: `[]` (Enabled: `True`). {{(pid=207600) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 08:29:51.833489 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.fernet_utils [None req-59b6f3b6-b84f-4726-a13e-e554b6f039e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=207600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:29:52.010313 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG dbcounter [-] [207600] Writing DB stats keystone:SELECT=100 {{(pid=207600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:29:52.015674 dv-cinder-851351-1-smb devstack@keystone.service[207600]: [pid: 207600|app: 0|req: 673/1348] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 08:29:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 274 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 08:29:52.058078 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5105ef2f-c925-4cce-acbe-68be0b2b16f8 None None] Authenticating user token {{(pid=207601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:29:52.059751 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.fernet_utils [None req-5105ef2f-c925-4cce-acbe-68be0b2b16f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=207601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:29:52.196993 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5105ef2f-c925-4cce-acbe-68be0b2b16f8 None None] Validating token access rules against request {{(pid=207601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:29:52.275774 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG dbcounter [-] [207601] Writing DB stats keystone:SELECT=100 {{(pid=207601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:29:52.318123 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0861541-bd09-4883-9ef9-5a009ef11a62 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8d8ee8f8acaf4811addc298a15a4916b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48c5f2b2ae2b48758b957d2b194a7fd1', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:29:52.319205 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0861541-bd09-4883-9ef9-5a009ef11a62 service neutron] REQUEST_METHOD: `GET` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:29:52.319705 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0861541-bd09-4883-9ef9-5a009ef11a62 service neutron] SCRIPT_NAME: `/identity` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:29:52.320214 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0861541-bd09-4883-9ef9-5a009ef11a62 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:29:52.323564 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.fernet_utils [None req-b0861541-bd09-4883-9ef9-5a009ef11a62 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=207601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:29:52.501615 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0861541-bd09-4883-9ef9-5a009ef11a62 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:29:52.504389 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0861541-bd09-4883-9ef9-5a009ef11a62 service neutron] RBAC: Authorization granted {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:29:52.534083 dv-cinder-851351-1-smb devstack@keystone.service[207601]: [pid: 207601|app: 0|req: 676/1349] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Jul 28 08:29:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 477 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 08:29:57.935873 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bfc1f02-4994-4817-9b21-5a57144f94a5 None None] REQUEST_METHOD: `GET` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:29:57.935873 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bfc1f02-4994-4817-9b21-5a57144f94a5 None None] SCRIPT_NAME: `/identity` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:29:57.935873 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bfc1f02-4994-4817-9b21-5a57144f94a5 None None] PATH_INFO: `/` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:29:57.938886 dv-cinder-851351-1-smb devstack@keystone.service[207600]: [pid: 207600|app: 0|req: 674/1350] 10.222.0.42 () {54 vars in 921 bytes} [Thu Jul 28 08:29:57 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 08:29:57.945174 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b6630b-7a7d-404b-aae1-1fb72610ef7e None None] REQUEST_METHOD: `POST` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:29:57.946183 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b6630b-7a7d-404b-aae1-1fb72610ef7e None None] SCRIPT_NAME: `/identity` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:29:57.946729 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b6630b-7a7d-404b-aae1-1fb72610ef7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:29:58.066010 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.auth.core [None req-77b6630b-7a7d-404b-aae1-1fb72610ef7e None None] MFA Rules not processed for user `954803a75b6c4c46b7ab8818fc89c275`. Rule list: `[]` (Enabled: `True`). {{(pid=207601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 08:29:58.067318 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.fernet_utils [None req-77b6630b-7a7d-404b-aae1-1fb72610ef7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=207601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:29:58.093059 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG dbcounter [-] [207601] Writing DB stats keystone:SELECT=100 {{(pid=207601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:29:58.219249 dv-cinder-851351-1-smb devstack@keystone.service[207601]: [pid: 207601|app: 0|req: 677/1351] 10.222.0.42 () {58 vars in 1018 bytes} [Thu Jul 28 08:29:57 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 275 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 08:30:03.155166 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38857185-43ca-4dbc-9683-b590b913f2be None None] REQUEST_METHOD: `GET` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:30:03.155678 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38857185-43ca-4dbc-9683-b590b913f2be None None] SCRIPT_NAME: `/identity` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:30:03.155678 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38857185-43ca-4dbc-9683-b590b913f2be None None] PATH_INFO: `/` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:30:03.157222 dv-cinder-851351-1-smb devstack@keystone.service[207600]: [pid: 207600|app: 0|req: 675/1352] 10.222.0.42 () {54 vars in 921 bytes} [Thu Jul 28 08:30:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 08:30:03.166819 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ed357f-ccd7-4c9e-acb8-2da4a0d7d7a0 None None] REQUEST_METHOD: `POST` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:30:03.167675 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ed357f-ccd7-4c9e-acb8-2da4a0d7d7a0 None None] SCRIPT_NAME: `/identity` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:30:03.168087 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ed357f-ccd7-4c9e-acb8-2da4a0d7d7a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:30:03.289209 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.auth.core [None req-c3ed357f-ccd7-4c9e-acb8-2da4a0d7d7a0 None None] MFA Rules not processed for user `954803a75b6c4c46b7ab8818fc89c275`. Rule list: `[]` (Enabled: `True`). {{(pid=207601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 08:30:03.290717 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.fernet_utils [None req-c3ed357f-ccd7-4c9e-acb8-2da4a0d7d7a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=207601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:30:03.416238 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG dbcounter [-] [207601] Writing DB stats keystone:SELECT=100 {{(pid=207601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:30:03.490298 dv-cinder-851351-1-smb devstack@keystone.service[207601]: [pid: 207601|app: 0|req: 678/1353] 10.222.0.42 () {58 vars in 1018 bytes} [Thu Jul 28 08:30:03 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 326 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 08:30:04.996544 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cdd0a10-a06c-4f80-b9f7-7e4c4cceeedd None None] REQUEST_METHOD: `GET` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:30:04.997676 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cdd0a10-a06c-4f80-b9f7-7e4c4cceeedd None None] SCRIPT_NAME: `/identity` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:30:04.997676 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cdd0a10-a06c-4f80-b9f7-7e4c4cceeedd None None] PATH_INFO: `/` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:30:04.999514 dv-cinder-851351-1-smb devstack@keystone.service[207600]: [pid: 207600|app: 0|req: 676/1354] 10.222.0.42 () {54 vars in 921 bytes} [Thu Jul 28 08:30:04 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 28 08:30:05.005672 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee72d0d3-a1d3-4ddc-9eb3-5f4724cc1c67 None None] REQUEST_METHOD: `POST` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:30:05.006191 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee72d0d3-a1d3-4ddc-9eb3-5f4724cc1c67 None None] SCRIPT_NAME: `/identity` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:30:05.006273 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee72d0d3-a1d3-4ddc-9eb3-5f4724cc1c67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:30:05.103658 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.auth.core [None req-ee72d0d3-a1d3-4ddc-9eb3-5f4724cc1c67 None None] MFA Rules not processed for user `954803a75b6c4c46b7ab8818fc89c275`. Rule list: `[]` (Enabled: `True`). {{(pid=207601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 08:30:05.104955 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.fernet_utils [None req-ee72d0d3-a1d3-4ddc-9eb3-5f4724cc1c67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=207601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:30:05.233985 dv-cinder-851351-1-smb devstack@keystone.service[207601]: [pid: 207601|app: 0|req: 679/1355] 10.222.0.42 () {58 vars in 1018 bytes} [Thu Jul 28 08:30:05 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 229 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 08:30:08.827073 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055b5d45-90f9-4db6-973c-0e8d067f71a6 None None] REQUEST_METHOD: `GET` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:30:08.827932 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055b5d45-90f9-4db6-973c-0e8d067f71a6 None None] SCRIPT_NAME: `/identity` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:30:08.827932 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055b5d45-90f9-4db6-973c-0e8d067f71a6 None None] PATH_INFO: `/` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:30:08.829245 dv-cinder-851351-1-smb devstack@keystone.service[207600]: [pid: 207600|app: 0|req: 677/1356] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 08:30:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 28 08:30:08.835833 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26f89de-ffb2-43a1-b98c-e87d803499d2 None None] REQUEST_METHOD: `POST` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:30:08.836336 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26f89de-ffb2-43a1-b98c-e87d803499d2 None None] SCRIPT_NAME: `/identity` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:30:08.836498 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26f89de-ffb2-43a1-b98c-e87d803499d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:30:08.879970 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG dbcounter [-] [207601] Writing DB stats keystone:SELECT=100 {{(pid=207601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:30:08.931308 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.auth.core [None req-d26f89de-ffb2-43a1-b98c-e87d803499d2 None None] MFA Rules not processed for user `b8110ade874c4aa7af27f5c376df700a`. Rule list: `[]` (Enabled: `True`). {{(pid=207601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 08:30:08.932725 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.fernet_utils [None req-d26f89de-ffb2-43a1-b98c-e87d803499d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=207601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:30:09.080068 dv-cinder-851351-1-smb devstack@keystone.service[207601]: [pid: 207601|app: 0|req: 680/1357] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 08:30:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 245 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 08:30:09.145597 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96aea9a9-844a-43d0-957e-0281a5b20055 None None] REQUEST_METHOD: `GET` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:30:09.146539 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96aea9a9-844a-43d0-957e-0281a5b20055 None None] SCRIPT_NAME: `/identity` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:30:09.147804 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96aea9a9-844a-43d0-957e-0281a5b20055 None None] PATH_INFO: `/` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:30:09.151257 dv-cinder-851351-1-smb devstack@keystone.service[207600]: [pid: 207600|app: 0|req: 678/1358] 10.222.0.42 () {54 vars in 962 bytes} [Thu Jul 28 08:30:09 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 08:30:09.171630 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa89ef8-3632-4f1c-a880-50042ca38432 None None] REQUEST_METHOD: `POST` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:30:09.173800 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa89ef8-3632-4f1c-a880-50042ca38432 None None] SCRIPT_NAME: `/identity` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:30:09.174568 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa89ef8-3632-4f1c-a880-50042ca38432 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:30:09.313372 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.auth.core [None req-daa89ef8-3632-4f1c-a880-50042ca38432 None None] MFA Rules not processed for user `03804b1369934a7692da4d5646465bdc`. Rule list: `[]` (Enabled: `True`). {{(pid=207601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 08:30:09.315731 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.fernet_utils [None req-daa89ef8-3632-4f1c-a880-50042ca38432 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=207601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:30:09.387247 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG dbcounter [-] [207601] Writing DB stats keystone:SELECT=100 {{(pid=207601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:30:09.523329 dv-cinder-851351-1-smb devstack@keystone.service[207601]: [pid: 207601|app: 0|req: 681/1359] 10.222.0.42 () {58 vars in 1059 bytes} [Thu Jul 28 08:30:09 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 354 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 08:30:09.536760 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96aea9a9-844a-43d0-957e-0281a5b20055 None None] Authenticating user token {{(pid=207600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:30:09.541162 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.fernet_utils [None req-96aea9a9-844a-43d0-957e-0281a5b20055 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=207600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:30:09.745986 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96aea9a9-844a-43d0-957e-0281a5b20055 None None] Validating token access rules against request {{(pid=207600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:30:09.847043 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG dbcounter [-] [207600] Writing DB stats keystone:SELECT=100 {{(pid=207600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:30:09.906990 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e7ee4b-2af1-48bf-8571-d3d8aa0867b5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03804b1369934a7692da4d5646465bdc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48c5f2b2ae2b48758b957d2b194a7fd1', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:30:09.907783 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e7ee4b-2af1-48bf-8571-d3d8aa0867b5 service nova] REQUEST_METHOD: `GET` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:30:09.908067 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e7ee4b-2af1-48bf-8571-d3d8aa0867b5 service nova] SCRIPT_NAME: `/identity` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:30:09.908527 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e7ee4b-2af1-48bf-8571-d3d8aa0867b5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:30:09.911948 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.fernet_utils [None req-75e7ee4b-2af1-48bf-8571-d3d8aa0867b5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=207600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:30:10.020483 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75e7ee4b-2af1-48bf-8571-d3d8aa0867b5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:30:10.022211 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75e7ee4b-2af1-48bf-8571-d3d8aa0867b5 service nova] RBAC: Authorization granted {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:30:10.045658 dv-cinder-851351-1-smb devstack@keystone.service[207600]: [pid: 207600|app: 0|req: 679/1360] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Jul 28 08:30:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 510 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 08:30:12.408778 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa34d2ee-a8ce-49bb-aef9-03de09059787 None None] REQUEST_METHOD: `GET` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:30:12.409536 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa34d2ee-a8ce-49bb-aef9-03de09059787 None None] SCRIPT_NAME: `/identity` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:30:12.409628 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa34d2ee-a8ce-49bb-aef9-03de09059787 None None] PATH_INFO: `/` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:30:12.412263 dv-cinder-851351-1-smb devstack@keystone.service[207601]: [pid: 207601|app: 0|req: 682/1361] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 08:30:12 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 08:30:12.417965 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef5b0e0-46ae-48fd-8b4e-b78de5664f6f None None] REQUEST_METHOD: `POST` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:30:12.418595 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef5b0e0-46ae-48fd-8b4e-b78de5664f6f None None] SCRIPT_NAME: `/identity` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:30:12.418595 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef5b0e0-46ae-48fd-8b4e-b78de5664f6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:30:12.503024 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.auth.core [None req-aef5b0e0-46ae-48fd-8b4e-b78de5664f6f None None] MFA Rules not processed for user `b8110ade874c4aa7af27f5c376df700a`. Rule list: `[]` (Enabled: `True`). {{(pid=207600) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 08:30:12.504914 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.fernet_utils [None req-aef5b0e0-46ae-48fd-8b4e-b78de5664f6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=207600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:30:12.548076 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG dbcounter [-] [207600] Writing DB stats keystone:SELECT=100 {{(pid=207600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:30:12.637222 dv-cinder-851351-1-smb devstack@keystone.service[207600]: [pid: 207600|app: 0|req: 680/1362] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 08:30:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 08:30:12.672920 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa34d2ee-a8ce-49bb-aef9-03de09059787 None None] Authenticating user token {{(pid=207601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:30:12.676294 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.fernet_utils [None req-fa34d2ee-a8ce-49bb-aef9-03de09059787 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=207601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:30:12.957455 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa34d2ee-a8ce-49bb-aef9-03de09059787 None None] Validating token access rules against request {{(pid=207601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:30:12.971432 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG dbcounter [-] [207601] Writing DB stats keystone:SELECT=100 {{(pid=207601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:30:13.090660 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ae59f0-7850-4682-b4f4-ea1016b290a6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03804b1369934a7692da4d5646465bdc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48c5f2b2ae2b48758b957d2b194a7fd1', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:30:13.091751 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ae59f0-7850-4682-b4f4-ea1016b290a6 service nova] REQUEST_METHOD: `GET` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:30:13.092281 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ae59f0-7850-4682-b4f4-ea1016b290a6 service nova] SCRIPT_NAME: `/identity` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:30:13.092833 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ae59f0-7850-4682-b4f4-ea1016b290a6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:30:13.094774 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.fernet_utils [None req-b6ae59f0-7850-4682-b4f4-ea1016b290a6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=207601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:30:13.221595 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6ae59f0-7850-4682-b4f4-ea1016b290a6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:30:13.223792 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6ae59f0-7850-4682-b4f4-ea1016b290a6 service nova] RBAC: Authorization granted {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:30:13.248195 dv-cinder-851351-1-smb devstack@keystone.service[207601]: [pid: 207601|app: 0|req: 683/1363] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Jul 28 08:30:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 576 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 28 08:30:15.916742 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eab45f5-ce2c-4f56-8333-9287b1bb7919 None None] REQUEST_METHOD: `GET` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:30:15.917637 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eab45f5-ce2c-4f56-8333-9287b1bb7919 None None] SCRIPT_NAME: `/identity` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:30:15.917637 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eab45f5-ce2c-4f56-8333-9287b1bb7919 None None] PATH_INFO: `/` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:30:15.921724 dv-cinder-851351-1-smb devstack@keystone.service[207600]: [pid: 207600|app: 0|req: 681/1364] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 08:30:15 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 08:30:15.928938 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0997531-9ced-4ee8-8348-e2690043fc50 None None] REQUEST_METHOD: `POST` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:30:15.929715 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0997531-9ced-4ee8-8348-e2690043fc50 None None] SCRIPT_NAME: `/identity` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:30:15.929715 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0997531-9ced-4ee8-8348-e2690043fc50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:30:15.958193 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG dbcounter [-] [207601] Writing DB stats keystone:SELECT=100 {{(pid=207601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:30:16.047268 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.auth.core [None req-a0997531-9ced-4ee8-8348-e2690043fc50 None None] MFA Rules not processed for user `b8110ade874c4aa7af27f5c376df700a`. Rule list: `[]` (Enabled: `True`). {{(pid=207601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 08:30:16.049059 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.fernet_utils [None req-a0997531-9ced-4ee8-8348-e2690043fc50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=207601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:30:16.189359 dv-cinder-851351-1-smb devstack@keystone.service[207601]: [pid: 207601|app: 0|req: 684/1365] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 08:30:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 261 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 08:30:16.237383 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa44c20-c462-4f8e-8176-b636b4bee04e None None] REQUEST_METHOD: `GET` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:30:16.237675 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa44c20-c462-4f8e-8176-b636b4bee04e None None] SCRIPT_NAME: `/identity` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:30:16.238406 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa44c20-c462-4f8e-8176-b636b4bee04e None None] PATH_INFO: `/` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:30:16.239905 dv-cinder-851351-1-smb devstack@keystone.service[207600]: [pid: 207600|app: 0|req: 682/1366] 10.222.0.42 () {54 vars in 962 bytes} [Thu Jul 28 08:30:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 08:30:16.245784 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522b802f-185b-43af-86a3-599540ea2416 None None] REQUEST_METHOD: `POST` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:30:16.246078 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522b802f-185b-43af-86a3-599540ea2416 None None] SCRIPT_NAME: `/identity` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:30:16.246399 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522b802f-185b-43af-86a3-599540ea2416 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:30:16.333641 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.auth.core [None req-522b802f-185b-43af-86a3-599540ea2416 None None] MFA Rules not processed for user `03804b1369934a7692da4d5646465bdc`. Rule list: `[]` (Enabled: `True`). {{(pid=207601) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 08:30:16.335973 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.fernet_utils [None req-522b802f-185b-43af-86a3-599540ea2416 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=207601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:30:16.373413 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG dbcounter [-] [207601] Writing DB stats keystone:SELECT=100 {{(pid=207601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:30:16.464646 dv-cinder-851351-1-smb devstack@keystone.service[207601]: [pid: 207601|app: 0|req: 685/1367] 10.222.0.42 () {58 vars in 1059 bytes} [Thu Jul 28 08:30:16 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 08:30:16.473981 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa44c20-c462-4f8e-8176-b636b4bee04e None None] Authenticating user token {{(pid=207600) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:30:16.478953 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.fernet_utils [None req-7aa44c20-c462-4f8e-8176-b636b4bee04e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=207600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:30:16.643190 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa44c20-c462-4f8e-8176-b636b4bee04e None None] Validating token access rules against request {{(pid=207600) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:30:16.666266 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG dbcounter [-] [207600] Writing DB stats keystone:SELECT=100 {{(pid=207600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:30:16.786245 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec44762-3ecb-4461-8fc2-d985fbcf31f5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03804b1369934a7692da4d5646465bdc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48c5f2b2ae2b48758b957d2b194a7fd1', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207600) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:30:16.787042 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec44762-3ecb-4461-8fc2-d985fbcf31f5 service nova] REQUEST_METHOD: `GET` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:30:16.787355 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec44762-3ecb-4461-8fc2-d985fbcf31f5 service nova] SCRIPT_NAME: `/identity` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:30:16.787629 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec44762-3ecb-4461-8fc2-d985fbcf31f5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:30:16.789720 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.fernet_utils [None req-7ec44762-3ecb-4461-8fc2-d985fbcf31f5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=207600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:30:16.894358 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ec44762-3ecb-4461-8fc2-d985fbcf31f5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:30:16.896004 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ec44762-3ecb-4461-8fc2-d985fbcf31f5 service nova] RBAC: Authorization granted {{(pid=207600) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:30:16.918010 dv-cinder-851351-1-smb devstack@keystone.service[207600]: [pid: 207600|app: 0|req: 683/1368] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Jul 28 08:30:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 445 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 28 08:30:18.055361 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb0f051-af8e-421c-ab39-3e7c2ffddd30 None None] REQUEST_METHOD: `GET` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:30:18.056575 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb0f051-af8e-421c-ab39-3e7c2ffddd30 None None] SCRIPT_NAME: `/identity` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:30:18.057197 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb0f051-af8e-421c-ab39-3e7c2ffddd30 None None] PATH_INFO: `/` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:30:18.058892 dv-cinder-851351-1-smb devstack@keystone.service[207601]: [pid: 207601|app: 0|req: 686/1369] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 08:30:18 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 08:30:18.064827 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf1ab1e-5232-4dea-899f-ed7fd79dbb28 None None] REQUEST_METHOD: `POST` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:30:18.065366 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf1ab1e-5232-4dea-899f-ed7fd79dbb28 None None] SCRIPT_NAME: `/identity` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:30:18.065366 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf1ab1e-5232-4dea-899f-ed7fd79dbb28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:30:18.102813 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG dbcounter [-] [207600] Writing DB stats keystone:SELECT=100 {{(pid=207600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:30:18.152065 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.auth.core [None req-7cf1ab1e-5232-4dea-899f-ed7fd79dbb28 None None] MFA Rules not processed for user `b8110ade874c4aa7af27f5c376df700a`. Rule list: `[]` (Enabled: `True`). {{(pid=207600) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 08:30:18.153592 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.fernet_utils [None req-7cf1ab1e-5232-4dea-899f-ed7fd79dbb28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=207600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:30:18.298454 dv-cinder-851351-1-smb devstack@keystone.service[207600]: [pid: 207600|app: 0|req: 684/1370] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 08:30:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 235 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 08:30:19.107974 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f90f323-7ba1-4eda-a613-b0f3527d0186 None None] REQUEST_METHOD: `GET` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:30:19.108612 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f90f323-7ba1-4eda-a613-b0f3527d0186 None None] SCRIPT_NAME: `/identity` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:30:19.108909 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f90f323-7ba1-4eda-a613-b0f3527d0186 None None] PATH_INFO: `/` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:30:19.110917 dv-cinder-851351-1-smb devstack@keystone.service[207601]: [pid: 207601|app: 0|req: 687/1371] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 08:30:19 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 08:30:19.117601 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e8802e-1529-4077-a8d6-c55f86533836 None None] REQUEST_METHOD: `POST` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:30:19.118176 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e8802e-1529-4077-a8d6-c55f86533836 None None] SCRIPT_NAME: `/identity` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:30:19.118176 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e8802e-1529-4077-a8d6-c55f86533836 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=207600) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:30:19.212711 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.auth.core [None req-60e8802e-1529-4077-a8d6-c55f86533836 None None] MFA Rules not processed for user `b8110ade874c4aa7af27f5c376df700a`. Rule list: `[]` (Enabled: `True`). {{(pid=207600) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 08:30:19.214806 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG keystone.common.fernet_utils [None req-60e8802e-1529-4077-a8d6-c55f86533836 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=207600) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:30:19.286801 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG dbcounter [-] [207600] Writing DB stats keystone:SELECT=100 {{(pid=207600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:30:19.371930 dv-cinder-851351-1-smb devstack@keystone.service[207600]: [pid: 207600|app: 0|req: 685/1372] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 08:30:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 255 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 08:30:19.424553 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f90f323-7ba1-4eda-a613-b0f3527d0186 None None] Authenticating user token {{(pid=207601) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:30:19.426750 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.fernet_utils [None req-2f90f323-7ba1-4eda-a613-b0f3527d0186 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=207601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:30:19.635959 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG dbcounter [-] [207601] Writing DB stats keystone:SELECT=100 {{(pid=207601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:30:19.642493 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f90f323-7ba1-4eda-a613-b0f3527d0186 None None] Validating token access rules against request {{(pid=207601) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:30:19.796532 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-363c2d71-80be-4ec3-8c46-91176b429a65 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '03804b1369934a7692da4d5646465bdc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '48c5f2b2ae2b48758b957d2b194a7fd1', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=207601) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:30:19.797214 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363c2d71-80be-4ec3-8c46-91176b429a65 service nova] REQUEST_METHOD: `GET` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:30:19.797510 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363c2d71-80be-4ec3-8c46-91176b429a65 service nova] SCRIPT_NAME: `/identity` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:30:19.797790 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363c2d71-80be-4ec3-8c46-91176b429a65 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=207601) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:30:19.799889 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.fernet_utils [None req-363c2d71-80be-4ec3-8c46-91176b429a65 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=207601) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:30:19.908153 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-363c2d71-80be-4ec3-8c46-91176b429a65 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:30:19.910103 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-363c2d71-80be-4ec3-8c46-91176b429a65 service nova] RBAC: Authorization granted {{(pid=207601) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:30:19.927114 dv-cinder-851351-1-smb devstack@keystone.service[207601]: DEBUG dbcounter [-] [207601] Writing DB stats keystone:SELECT=100 {{(pid=207601) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:30:19.930660 dv-cinder-851351-1-smb devstack@keystone.service[207601]: [pid: 207601|app: 0|req: 688/1373] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Jul 28 08:30:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 507 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 08:30:29.367435 dv-cinder-851351-1-smb devstack@keystone.service[207600]: DEBUG dbcounter [-] [207600] Writing DB stats keystone:SELECT=19 {{(pid=207600) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:30:40.671864 dv-cinder-851351-1-smb systemd[1]: Stopping Devstack devstack@keystone.service... Jul 28 08:30:40.672588 dv-cinder-851351-1-smb devstack@keystone.service[207588]: Thu Jul 28 08:30:40 2022 - graceful shutdown triggered... Jul 28 08:30:40.673138 dv-cinder-851351-1-smb devstack@keystone.service[207600]: Gracefully killing worker 1 (pid: 207600)... Jul 28 08:30:40.673507 dv-cinder-851351-1-smb devstack@keystone.service[207601]: Gracefully killing worker 2 (pid: 207601)... Jul 28 08:30:41.673738 dv-cinder-851351-1-smb devstack@keystone.service[207588]: worker 1 buried after 1 seconds Jul 28 08:30:41.673738 dv-cinder-851351-1-smb devstack@keystone.service[207588]: worker 2 buried after 1 seconds Jul 28 08:30:41.673738 dv-cinder-851351-1-smb devstack@keystone.service[207588]: goodbye to uWSGI. Jul 28 08:30:41.675459 dv-cinder-851351-1-smb systemd[1]: devstack@keystone.service: Succeeded. Jul 28 08:30:41.676017 dv-cinder-851351-1-smb systemd[1]: Stopped Devstack devstack@keystone.service. Jul 28 08:35:23.146360 dv-cinder-851351-1-smb systemd[1]: Starting Devstack devstack@keystone.service... Jul 28 08:35:23.154850 dv-cinder-851351-1-smb devstack@keystone.service[282889]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Jul 28 08:35:23.157125 dv-cinder-851351-1-smb devstack@keystone.service[282889]: *** Starting uWSGI 2.0.18-debian (64bit) on [Thu Jul 28 08:35:23 2022] *** Jul 28 08:35:23.157125 dv-cinder-851351-1-smb devstack@keystone.service[282889]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jul 28 08:35:23.157125 dv-cinder-851351-1-smb devstack@keystone.service[282889]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jul 28 08:35:23.157125 dv-cinder-851351-1-smb devstack@keystone.service[282889]: nodename: dv-cinder-851351-1-smb Jul 28 08:35:23.157125 dv-cinder-851351-1-smb devstack@keystone.service[282889]: machine: x86_64 Jul 28 08:35:23.157125 dv-cinder-851351-1-smb devstack@keystone.service[282889]: clock source: unix Jul 28 08:35:23.157125 dv-cinder-851351-1-smb devstack@keystone.service[282889]: pcre jit disabled Jul 28 08:35:23.157125 dv-cinder-851351-1-smb devstack@keystone.service[282889]: detected number of CPU cores: 4 Jul 28 08:35:23.157125 dv-cinder-851351-1-smb devstack@keystone.service[282889]: current working directory: / Jul 28 08:35:23.157125 dv-cinder-851351-1-smb devstack@keystone.service[282889]: detected binary path: /usr/bin/uwsgi-core Jul 28 08:35:23.157125 dv-cinder-851351-1-smb devstack@keystone.service[282889]: your processes number limit is 47680 Jul 28 08:35:23.157125 dv-cinder-851351-1-smb devstack@keystone.service[282889]: your memory page size is 4096 bytes Jul 28 08:35:23.158092 dv-cinder-851351-1-smb devstack@keystone.service[282889]: detected max file descriptor number: 2048 Jul 28 08:35:23.158092 dv-cinder-851351-1-smb devstack@keystone.service[282889]: lock engine: pthread robust mutexes Jul 28 08:35:23.158092 dv-cinder-851351-1-smb devstack@keystone.service[282889]: thunder lock: enabled Jul 28 08:35:23.158092 dv-cinder-851351-1-smb devstack@keystone.service[282889]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Jul 28 08:35:23.158092 dv-cinder-851351-1-smb devstack@keystone.service[282889]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Jul 28 08:35:23.196177 dv-cinder-851351-1-smb devstack@keystone.service[282889]: Python main interpreter initialized at 0x55ca4ca939c0 Jul 28 08:35:23.196177 dv-cinder-851351-1-smb devstack@keystone.service[282889]: python threads support enabled Jul 28 08:35:23.196177 dv-cinder-851351-1-smb devstack@keystone.service[282889]: your server socket listen backlog is limited to 100 connections Jul 28 08:35:23.196177 dv-cinder-851351-1-smb devstack@keystone.service[282889]: your mercy for graceful operations on workers is 90 seconds Jul 28 08:35:23.196618 dv-cinder-851351-1-smb devstack@keystone.service[282889]: mapped 403077 bytes (393 KB) for 2 cores Jul 28 08:35:23.196618 dv-cinder-851351-1-smb devstack@keystone.service[282889]: *** Operational MODE: preforking *** Jul 28 08:35:23.196882 dv-cinder-851351-1-smb devstack@keystone.service[282889]: *** uWSGI is running in multiple interpreter mode *** Jul 28 08:35:23.196882 dv-cinder-851351-1-smb devstack@keystone.service[282889]: spawned uWSGI master process (pid: 282889) Jul 28 08:35:23.197041 dv-cinder-851351-1-smb systemd[1]: Started Devstack devstack@keystone.service. Jul 28 08:35:23.198433 dv-cinder-851351-1-smb devstack@keystone.service[282889]: spawned uWSGI worker 1 (pid: 282898, cores: 1) Jul 28 08:35:23.199007 dv-cinder-851351-1-smb devstack@keystone.service[282889]: spawned uWSGI worker 2 (pid: 282899, cores: 1) Jul 28 08:35:23.200645 dv-cinder-851351-1-smb devstack@keystone.service[282889]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jul 28 08:35:28.699977 dv-cinder-851351-1-smb devstack@keystone.service[282898]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 28 08:35:28.699977 dv-cinder-851351-1-smb devstack@keystone.service[282898]: from cryptography.utils import int_from_bytes Jul 28 08:35:28.700994 dv-cinder-851351-1-smb devstack@keystone.service[282898]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 28 08:35:28.700994 dv-cinder-851351-1-smb devstack@keystone.service[282898]: from cryptography.utils import int_from_bytes Jul 28 08:35:28.701230 dv-cinder-851351-1-smb devstack@keystone.service[282899]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 28 08:35:28.701230 dv-cinder-851351-1-smb devstack@keystone.service[282899]: from cryptography.utils import int_from_bytes Jul 28 08:35:28.701790 dv-cinder-851351-1-smb devstack@keystone.service[282899]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 28 08:35:28.701790 dv-cinder-851351-1-smb devstack@keystone.service[282899]: from cryptography.utils import int_from_bytes Jul 28 08:35:28.751188 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=282898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 28 08:35:28.751444 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=282898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 28 08:35:28.751555 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG uwsgi [-] command line args: [] {{(pid=282898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 28 08:35:28.751655 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=282899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 28 08:35:28.751748 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=282899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 28 08:35:28.751826 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=282898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 28 08:35:28.751982 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG uwsgi [-] command line args: [] {{(pid=282899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 28 08:35:28.752162 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG uwsgi [-] ================================================================================ {{(pid=282898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 28 08:35:28.752264 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG uwsgi [-] admin_token = **** {{(pid=282898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 08:35:28.752359 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=282899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 28 08:35:28.752359 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG uwsgi [-] ================================================================================ {{(pid=282899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 28 08:35:28.752504 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG uwsgi [-] config_dir = [] {{(pid=282898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 08:35:28.752757 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=282898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 08:35:28.752925 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG uwsgi [-] admin_token = **** {{(pid=282899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 08:35:28.753027 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG uwsgi [-] config_source = [] {{(pid=282898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 08:35:28.753129 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG uwsgi [-] config_dir = [] {{(pid=282899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 08:35:28.753209 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG uwsgi [-] debug = True {{(pid=282898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 08:35:28.753292 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=282899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 08:35:28.753472 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=282898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 08:35:28.753783 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG uwsgi [-] config_source = [] {{(pid=282899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 08:35:28.753783 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG uwsgi [-] debug = True {{(pid=282899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 08:35:28.753966 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=282898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 08:35:28.754056 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=282899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 08:35:28.754165 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG uwsgi [-] insecure_debug = False {{(pid=282898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 08:35:28.754240 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=282899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 08:35:28.754316 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=282898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 08:35:28.754399 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG uwsgi [-] insecure_debug = False {{(pid=282899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 08:35:28.754477 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=282898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 08:35:28.754571 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=282899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 08:35:28.754650 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG uwsgi [-] list_limit = None {{(pid=282898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 08:35:28.754727 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=282899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 08:35:28.754804 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG uwsgi [-] log_config_append = None {{(pid=282898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 08:35:28.754881 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG uwsgi [-] list_limit = None {{(pid=282899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 08:35:28.754958 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=282898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 08:35:28.755041 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG uwsgi [-] log_config_append = None {{(pid=282899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 08:35:28.755123 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG uwsgi [-] log_dir = None {{(pid=282898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 08:35:28.755201 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=282899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 08:35:28.755277 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG uwsgi [-] log_file = None {{(pid=282898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 08:35:28.755353 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG uwsgi [-] log_dir = None {{(pid=282899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 08:35:28.755430 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=282898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 08:35:28.755513 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG uwsgi [-] log_file = None {{(pid=282899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 08:35:28.755596 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=282899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 08:35:28.755673 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=282898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 08:35:28.755915 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=282899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 08:35:28.756010 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=282898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 08:35:28.756088 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=282899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 08:35:28.756234 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=282898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 08:35:28.756234 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=282898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 08:35:28.756429 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=282899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 08:35:28.756568 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=282898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 08:35:28.756678 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=282899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 08:35:28.756678 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=282899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 08:35:28.756867 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=282898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 08:35:28.756958 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=282899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 08:35:28.757095 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=282898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 08:35:28.757231 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=282899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 08:35:28.757324 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=282898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 08:35:28.757476 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=282899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 08:35:28.757565 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=282898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 08:35:28.757654 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=282899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 08:35:28.757754 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=282898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 08:35:28.757843 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=282899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 08:35:28.757989 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=282898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 08:35:28.758090 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=282899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 08:35:28.758180 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=282898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 08:35:28.758276 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=282899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 08:35:28.758367 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG uwsgi [-] notification_format = cadf {{(pid=282898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 08:35:28.758456 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG uwsgi [-] notification_format = cadf {{(pid=282899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 08:35:28.758557 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=282898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 08:35:28.758709 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=282899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 08:35:28.759057 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.42/identity {{(pid=282898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 08:35:28.759228 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.42/identity {{(pid=282899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 08:35:28.759331 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG uwsgi [-] publish_errors = False {{(pid=282898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 08:35:28.759433 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG uwsgi [-] publish_errors = False {{(pid=282899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 08:35:28.759524 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=282898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 08:35:28.759616 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=282899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 08:35:28.759717 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=282898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 08:35:28.759807 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=282899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 08:35:28.759901 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=282898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 08:35:28.760000 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=282899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 08:35:28.760091 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=282898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 08:35:28.760259 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=282899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 08:35:28.760416 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=282898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 08:35:28.760529 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=282899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 08:35:28.760630 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG uwsgi [-] standard_threads = False {{(pid=282898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 08:35:28.760762 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG uwsgi [-] standard_threads = False {{(pid=282899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 08:35:28.760857 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG uwsgi [-] strict_password_check = False {{(pid=282898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 08:35:28.760962 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG uwsgi [-] strict_password_check = False {{(pid=282899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 08:35:28.761046 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=282898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 08:35:28.761135 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG uwsgi [-] use_eventlog = False {{(pid=282898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 08:35:28.761225 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=282899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 08:35:28.761322 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG uwsgi [-] use_journal = False {{(pid=282898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 08:35:28.761412 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG uwsgi [-] use_eventlog = False {{(pid=282899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 08:35:28.761512 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG uwsgi [-] use_json = False {{(pid=282898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 08:35:28.761602 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG uwsgi [-] use_journal = False {{(pid=282899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 08:35:28.761691 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG uwsgi [-] use_stderr = False {{(pid=282898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 08:35:28.761781 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG uwsgi [-] use_json = False {{(pid=282899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 08:35:28.761885 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG uwsgi [-] use_syslog = False {{(pid=282898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 08:35:28.761992 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG uwsgi [-] use_stderr = False {{(pid=282899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 08:35:28.761992 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG uwsgi [-] use_syslog = False {{(pid=282899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 08:35:28.762166 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG uwsgi [-] watch_log_file = False {{(pid=282898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 08:35:28.762397 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG uwsgi [-] watch_log_file = False {{(pid=282899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 08:35:28.762488 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=282898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:35:28.762587 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=282899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:35:28.762685 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=282898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:35:28.762777 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=282899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:35:28.762874 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=282898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:35:28.762965 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=282899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:35:28.763106 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=282898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:35:28.763213 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=282899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:35:28.763304 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=282898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:35:28.763403 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=282899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:35:28.763494 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=282898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:35:28.763579 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=282899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:35:28.763715 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=282898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:35:28.763817 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=282899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:35:28.763908 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=282898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:35:28.764083 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=282899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:35:28.764222 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=282898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:35:28.764314 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=282899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:35:28.764409 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=282898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:35:28.764555 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=282899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:35:28.764685 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=282898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:35:28.764824 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=282899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:35:28.764933 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=282898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:35:28.765060 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=282899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:35:28.765174 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=282898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:35:28.765342 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=282899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:35:28.765493 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=282898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:35:28.765593 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=282899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:35:28.765686 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=282898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:35:28.765777 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=282899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:35:28.765916 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=282898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:35:28.766012 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=282899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:35:28.766121 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=282898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:35:28.766235 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=282899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:35:28.766387 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=282898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:35:28.766484 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=282899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:35:28.766584 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=282898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:35:28.766748 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=282899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:35:28.766898 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=282898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:35:28.767012 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=282899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:35:28.767107 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=282898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:35:28.767198 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=282899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:35:28.767295 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=282898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:35:28.767433 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=282899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:35:28.767535 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=282898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:35:28.767713 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=282899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:35:28.767864 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=282898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:35:28.767963 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=282899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:35:28.768076 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=282898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:35:28.768170 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=282899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:35:28.768263 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=282898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:35:28.768431 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=282899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:35:28.768581 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=282898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:35:28.768713 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=282899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:35:28.768825 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=282898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:35:28.768919 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=282899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:35:28.769011 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=282898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:35:28.769099 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=282899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:35:28.769187 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=282898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:35:28.769370 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=282899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:35:28.769528 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=282898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:35:28.769629 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=282899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:35:28.769723 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=282898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:35:28.769823 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=282899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:35:28.769915 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=282898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:35:28.770037 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=282899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:35:28.770150 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=282898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:35:28.770316 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=282899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:35:28.770455 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=282898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:35:28.770559 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=282898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:35:28.770652 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=282899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:35:28.770743 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=282899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:35:28.770936 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=282898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:35:28.771029 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=282898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:35:28.771110 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=282899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:35:28.771302 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=282898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:35:28.771452 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=282899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:35:28.771552 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=282899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:35:28.771664 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=282898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:35:28.771835 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=282899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:35:28.771936 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=282898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:35:28.772039 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=282899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:35:28.772134 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=282898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:35:28.772225 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=282899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:35:28.772324 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=282898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:35:28.772415 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=282899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:35:28.772509 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=282898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:35:28.772600 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=282899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:35:28.772718 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=282898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:35:28.772859 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=282899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:35:28.772961 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=282898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:35:28.773140 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=282899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:35:28.773293 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=282898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:35:28.773405 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=282899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:35:28.773495 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=282898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:35:28.773691 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=282899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:35:28.773780 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=282898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:35:28.773879 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=282899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:35:28.773970 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=282898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:35:28.774061 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=282899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:35:28.774310 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=282898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:35:28.774411 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=282899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:35:28.774503 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=282898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:35:28.774593 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=282899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:35:28.774676 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=282898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:35:28.774764 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=282899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:35:28.774853 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=282898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:35:28.774949 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=282899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:35:28.775040 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=282898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:35:28.775130 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=282899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:35:28.775221 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=282898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:35:28.775387 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=282899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:35:28.775537 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=282898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:35:28.775648 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=282899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:35:28.775742 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=282898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:35:28.775827 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=282899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:35:28.775917 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=282898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:35:28.776042 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=282899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:35:28.776157 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=282898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:35:28.776266 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=282899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:35:28.776358 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=282898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:35:28.776532 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=282899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:35:28.776697 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=282898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:35:28.776825 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=282899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:35:28.776922 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=282898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:35:28.777019 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=282899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:35:28.777106 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=282898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:35:28.777237 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=282899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:35:28.777335 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=282898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:35:28.777505 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=282899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:35:28.777656 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=282898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:35:28.777766 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=282899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:35:28.777861 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=282898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:35:28.777954 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=282899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:35:28.778045 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=282898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:35:28.778136 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=282899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:35:28.778242 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=282898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:35:28.778441 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=282899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:35:28.778582 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=282898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:35:28.778695 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=282899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:35:28.778790 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=282898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:35:28.778875 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=282899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:35:28.778964 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=282898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:35:28.779155 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=282899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:35:28.779295 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=282898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:35:28.779411 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=282899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:35:28.779500 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=282898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:35:28.779590 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=282899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:35:28.779681 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=282898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:35:28.779817 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=282899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:35:28.779919 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG uwsgi [-] cache.enabled = True {{(pid=282898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:35:28.780087 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG uwsgi [-] cache.enabled = True {{(pid=282899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:35:28.780249 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=282898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:35:28.780343 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=282898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:35:28.780427 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=282899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:35:28.780526 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=282899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:35:28.780625 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=282898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:35:28.780801 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=282898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:35:28.780887 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=282899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:35:28.781022 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=282898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:35:28.781130 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=282899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:35:28.781253 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=282898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:35:28.781348 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=282899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:35:28.781525 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=282898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:35:28.781665 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=282899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:35:28.781769 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=282898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:35:28.781862 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=282899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:35:28.781964 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=282899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:35:28.782064 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=282898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:35:28.782246 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=282898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:35:28.782394 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=282899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:35:28.782495 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=282899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:35:28.782587 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=282898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:35:28.782693 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=282899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:35:28.782779 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=282898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:35:28.782904 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=282899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:35:28.783050 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=282898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:35:28.783146 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=282898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:35:28.783239 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=282899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:35:28.783375 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=282898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:35:28.783473 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=282899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:35:28.783609 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=282899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:35:28.783705 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=282898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:35:28.783843 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=282898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:35:28.783940 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=282899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:35:28.784073 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=282899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:35:28.784169 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=282898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:35:28.784301 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=282899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:35:28.784393 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=282898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:35:28.784521 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=282899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:35:28.784636 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=282898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:35:28.784796 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=282898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:35:28.784896 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=282899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:35:28.784988 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=282899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:35:28.785078 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=282898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:35:28.785227 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=282899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:35:28.785331 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=282898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:35:28.785464 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=282899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:35:28.785565 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=282898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:35:28.785710 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=282898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:35:28.785805 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=282899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:35:28.785944 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=282899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:35:28.786046 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=282898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:35:28.786199 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=282899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:35:28.786308 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=282898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:35:28.786503 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=282899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:35:28.786645 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=282898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:35:28.786740 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=282899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:35:28.786878 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG uwsgi [-] auth.external = None {{(pid=282898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:35:28.786986 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG uwsgi [-] auth.external = None {{(pid=282899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:35:28.787118 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG uwsgi [-] auth.mapped = None {{(pid=282898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:35:28.787215 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG uwsgi [-] auth.mapped = None {{(pid=282899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:35:28.787424 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=282898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:35:28.787526 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=282899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:35:28.787662 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=282898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:35:28.787754 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=282899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:35:28.787900 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG uwsgi [-] auth.password = None {{(pid=282898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:35:28.787992 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG uwsgi [-] auth.password = None {{(pid=282899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:35:28.788130 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG uwsgi [-] auth.token = None {{(pid=282899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:35:28.788220 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG uwsgi [-] auth.token = None {{(pid=282898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:35:28.788369 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=282899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:35:28.788483 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=282898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:35:28.788609 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG uwsgi [-] catalog.caching = True {{(pid=282898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:35:28.788762 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG uwsgi [-] catalog.caching = True {{(pid=282899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:35:28.788882 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=282899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:35:28.788973 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=282898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:35:28.789114 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=282899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:35:28.789233 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=282898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:35:28.789363 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=282899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:35:28.789454 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=282898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:35:28.789611 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=282899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:35:28.789706 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=282898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:35:28.789844 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=282899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:35:28.789957 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=282898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:35:28.790085 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG uwsgi [-] credential.caching = True {{(pid=282898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:35:28.790176 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG uwsgi [-] credential.caching = True {{(pid=282899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:35:28.790332 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG uwsgi [-] credential.driver = sql {{(pid=282899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:35:28.790436 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG uwsgi [-] credential.driver = sql {{(pid=282898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:35:28.790582 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=282899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:35:28.790682 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=282898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:35:28.790830 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=282899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:35:28.790932 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=282898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:35:28.791070 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=282898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:35:28.791158 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=282899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:35:28.791316 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=282899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:35:28.791418 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=282898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:35:28.791553 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=282899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:35:28.791660 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=282898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:35:28.791824 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=282899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:35:28.791920 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=282898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:35:28.792080 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=282898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:35:28.792179 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=282899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:35:28.792318 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=282899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:35:28.792408 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=282898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:35:28.792609 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=282898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:35:28.792774 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=282899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:35:28.792889 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=282899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:35:28.793009 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=282898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:35:28.793138 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=282899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:35:28.793260 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=282898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:35:28.793372 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=282899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:35:28.793480 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=282898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:35:28.793588 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=282899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:35:28.793794 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=282898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:35:28.793924 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=282899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:35:28.794047 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=282898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:35:28.794164 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG uwsgi [-] federation.caching = True {{(pid=282899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:35:28.794288 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG uwsgi [-] federation.caching = True {{(pid=282898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:35:28.794405 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=282899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:35:28.794523 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=282898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:35:28.794641 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG uwsgi [-] federation.driver = sql {{(pid=282899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:35:28.794762 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG uwsgi [-] federation.driver = sql {{(pid=282898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:35:28.794872 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=282899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:35:28.794989 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=282898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:35:28.795107 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=282899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:35:28.795243 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=282898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:35:28.795367 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=282899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:35:28.795478 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=282898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:35:28.795593 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=282899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:35:28.795703 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=282898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:35:28.795816 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=282899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:35:28.795938 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=282898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:35:28.796048 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=282899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:35:28.796162 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=282898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:35:28.796278 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=282899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:35:28.796394 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=282898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:35:28.796510 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=282899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:35:28.796640 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=282898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:35:28.796809 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=282899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:35:28.796929 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=282898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:35:28.797045 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG uwsgi [-] identity.caching = True {{(pid=282899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:35:28.797154 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG uwsgi [-] identity.caching = True {{(pid=282898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:35:28.797276 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=282899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:35:28.797400 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=282898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:35:28.797511 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=282899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:35:28.797625 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=282898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:35:28.797735 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=282899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:35:28.797887 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=282898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:35:28.797990 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=282899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:35:28.798076 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=282898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:35:28.798166 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG uwsgi [-] identity.driver = sql {{(pid=282899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:35:28.798267 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG uwsgi [-] identity.driver = sql {{(pid=282898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:35:28.798358 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=282899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:35:28.798442 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=282898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:35:28.798536 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=282899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:35:28.798627 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=282898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:35:28.798717 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=282899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:35:28.798808 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=282898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:35:28.798972 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=282899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:35:28.799077 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=282898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:35:28.799208 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=282899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:35:28.799305 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=282898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:35:28.799442 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=282899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:35:28.799539 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=282898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:35:28.799679 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=282899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:35:28.799777 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=282898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:35:28.799927 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=282899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:35:28.800034 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=282898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:35:28.800193 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=282899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:35:28.800361 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=282898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:35:28.800465 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=282899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:35:28.800559 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=282898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:35:28.800695 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=282899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:35:28.800800 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=282898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:35:28.800965 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=282899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:35:28.801142 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=282898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:35:28.801240 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=282899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:35:28.801335 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=282898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:35:28.801434 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=282899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:35:28.801521 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=282898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:35:28.801664 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=282899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:35:28.801779 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=282898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:35:28.801961 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=282899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:35:28.802064 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=282898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:35:28.802308 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=282899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:35:28.802438 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=282898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:35:28.802576 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=282899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:35:28.802694 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=282898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:35:28.802798 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=282899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:35:28.802934 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=282898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:35:28.803069 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=282899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:35:28.803200 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=282898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:35:28.803326 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=282899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:35:28.803449 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=282898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:35:28.803587 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=282899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:35:28.803717 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=282898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:35:28.803860 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=282899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:35:28.803975 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=282898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:35:28.804119 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=282899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:35:28.804246 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=282898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:35:28.804372 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=282899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:35:28.804490 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=282898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:35:28.804622 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=282899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:35:28.804843 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=282898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:35:28.804965 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=282899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:35:28.805102 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=282898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:35:28.805228 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=282899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:35:28.805361 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=282898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:35:28.805510 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=282899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:35:28.805609 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=282898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:35:28.805703 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=282899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:35:28.805791 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=282898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:35:28.805874 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG uwsgi [-] ldap.password = **** {{(pid=282899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:35:28.805956 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG uwsgi [-] ldap.password = **** {{(pid=282898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:35:28.806061 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=282899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:35:28.806151 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=282898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:35:28.806250 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=282899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:35:28.806345 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=282898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:35:28.806429 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=282899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:35:28.806524 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=282898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:35:28.806618 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=282899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:35:28.806702 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=282898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:35:28.806790 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=282899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:35:28.806880 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=282898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:35:28.806970 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=282899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:35:28.807070 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=282898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:35:28.807167 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=282899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:35:28.807251 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=282898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:35:28.807334 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=282899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:35:28.807423 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=282898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:35:28.807514 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=282899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:35:28.807611 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=282898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:35:28.807702 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=282899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:35:28.807792 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=282898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:35:28.807908 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=282899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:35:28.808015 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=282898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:35:28.808145 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=282899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:35:28.808250 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=282898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:35:28.808382 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=282899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:35:28.808794 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=282898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:35:28.808888 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=282899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:35:28.808978 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=282898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:35:28.809068 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG uwsgi [-] ldap.user = None {{(pid=282899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:35:28.809161 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG uwsgi [-] ldap.user = None {{(pid=282898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:35:28.809253 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=282899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:35:28.809353 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=282898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:35:28.809444 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=282899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:35:28.809542 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=282898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:35:28.809633 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=282899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:35:28.809743 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=282898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:35:28.809829 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=282899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:35:28.809912 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=282898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:35:28.810039 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=282899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:35:28.810130 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=282898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:35:28.810289 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=282899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:35:28.810394 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=282898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:35:28.810598 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=282899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:35:28.810709 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=282898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:35:28.810795 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=282899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:35:28.810878 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=282898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:35:28.810984 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=282899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:35:28.811089 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=282898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:35:28.811227 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=282899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:35:28.811345 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=282898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:35:28.811462 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=282899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:35:28.811578 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=282898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:35:28.811688 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=282899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:35:28.811815 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=282898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:35:28.811940 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=282899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:35:28.812052 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=282898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:35:28.812178 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=282899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:35:28.812294 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=282898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:35:28.812404 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=282899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:35:28.812521 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=282898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:35:28.812771 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=282899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:35:28.812951 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=282898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:35:28.813104 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=282899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:35:28.813221 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=282898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:35:28.813338 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=282899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:35:28.813458 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=282898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:35:28.813585 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=282899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:35:28.813695 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=282898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:35:28.813814 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=282899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:35:28.813945 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=282898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:35:28.814056 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=282899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:35:28.814176 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=282898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:35:28.814286 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=282899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:35:28.814407 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=282898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:35:28.814517 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=282899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:35:28.814625 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=282898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:35:28.814734 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=282899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:35:28.814854 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=282898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:35:28.814981 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=282899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:35:28.815098 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=282898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:35:28.815225 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=282899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:35:28.815342 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=282898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:35:28.815458 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG uwsgi [-] policy.driver = sql {{(pid=282899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:35:28.815728 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG uwsgi [-] policy.driver = sql {{(pid=282898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:35:28.815828 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=282899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:35:28.815914 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=282898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:35:28.816017 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=282899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:35:28.816102 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=282898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:35:28.816278 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=282899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:35:28.816366 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=282898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:35:28.816444 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG uwsgi [-] receipt.caching = True {{(pid=282899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:35:28.816527 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG uwsgi [-] receipt.caching = True {{(pid=282898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:35:28.816616 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=282899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:35:28.816737 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=282898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:35:28.816843 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=282899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:35:28.816930 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=282898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:35:28.817013 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=282899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:35:28.817103 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=282898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:35:28.817193 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=282899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:35:28.817283 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=282898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:35:28.817382 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=282899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:35:28.817508 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=282898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:35:28.817599 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG uwsgi [-] resource.caching = True {{(pid=282899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:35:28.817813 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG uwsgi [-] resource.caching = True {{(pid=282898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:35:28.817903 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=282899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:35:28.818074 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=282898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:35:28.818177 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG uwsgi [-] resource.driver = sql {{(pid=282899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:35:28.818329 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG uwsgi [-] resource.driver = sql {{(pid=282898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:35:28.818427 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=282899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:35:28.818588 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=282898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:35:28.818755 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=282899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:35:28.818851 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=282898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:35:28.818952 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=282899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:35:28.819042 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG uwsgi [-] revoke.caching = True {{(pid=282899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:35:28.819140 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=282898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:35:28.819326 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=282899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:35:28.819479 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG uwsgi [-] revoke.caching = True {{(pid=282898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:35:28.819593 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=282899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:35:28.819697 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=282898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:35:28.819798 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG uwsgi [-] role.cache_time = None {{(pid=282899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:35:28.819885 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=282898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:35:28.819970 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG uwsgi [-] role.caching = True {{(pid=282899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:35:28.820054 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG uwsgi [-] role.cache_time = None {{(pid=282898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:35:28.820247 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG uwsgi [-] role.driver = sql {{(pid=282899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:35:28.820389 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG uwsgi [-] role.caching = True {{(pid=282898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:35:28.820495 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG uwsgi [-] role.list_limit = None {{(pid=282899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:35:28.820590 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG uwsgi [-] role.driver = sql {{(pid=282898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:35:28.820731 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG uwsgi [-] role.list_limit = None {{(pid=282898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:35:28.820882 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=282899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:35:28.820976 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=282898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:35:28.821058 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=282899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:35:28.821219 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=282898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:35:28.821346 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=282899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:35:28.821426 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=282899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:35:28.821509 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=282898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:35:28.821701 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=282899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:35:28.821838 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=282898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:35:28.821920 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=282898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:35:28.822076 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=282899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:35:28.822218 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=282898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:35:28.822426 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=282898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:35:28.822586 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=282899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:35:28.822683 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=282898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:35:28.822908 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=282898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:35:28.823048 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=282899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:35:28.823154 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=282898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:35:28.823401 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=282898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:35:28.823559 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=282899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:35:28.823650 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=282898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:35:28.823740 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=282899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:35:28.823892 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=282898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:35:28.824044 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=282899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:35:28.824290 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=282899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:35:28.824446 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=282898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:35:28.824551 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=282899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:35:28.824655 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=282898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:35:28.824833 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=282898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:35:28.824973 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=282899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:35:28.825090 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=282898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:35:28.825189 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=282899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:35:28.825350 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=282898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:35:28.825512 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=282899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:35:28.825631 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=282898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:35:28.825731 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=282899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:35:28.825833 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=282898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:35:28.825998 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=282899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:35:28.826145 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=282898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:35:28.826228 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=282899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:35:28.826301 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=282898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:35:28.826462 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=282899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:35:28.826564 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=282898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:35:28.826720 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=282899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:35:28.826835 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=282898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:35:28.826972 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=282899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:35:28.827058 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=282898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:35:28.827213 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=282898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:35:28.827309 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=282899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:35:28.827547 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=282898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:35:28.827664 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=282899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:35:28.827763 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=282898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:35:28.827965 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=282898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:35:28.828067 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=282899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:35:28.828215 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=282898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:35:28.828311 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=282899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:35:28.828448 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=282898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:35:28.828563 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=282899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:35:28.828656 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG uwsgi [-] token.cache_time = None {{(pid=282898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:35:28.828823 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=282899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:35:28.828938 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG uwsgi [-] token.caching = True {{(pid=282898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:35:28.829078 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=282899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:35:28.829174 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=282898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:35:28.829321 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=282899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:35:28.829434 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG uwsgi [-] token.provider = fernet {{(pid=282898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:35:28.829908 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=282899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:35:28.830017 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=282898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:35:28.830150 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG uwsgi [-] token.cache_time = None {{(pid=282899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:35:28.830254 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=282898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:35:28.830397 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG uwsgi [-] token.caching = True {{(pid=282899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:35:28.830494 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=282898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:35:28.830636 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=282899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:35:28.830745 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=282898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:35:28.830930 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=282898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:35:28.831039 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG uwsgi [-] token.provider = fernet {{(pid=282899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:35:28.831182 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=282898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:35:28.831395 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=282899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:35:28.831492 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG uwsgi [-] trust.driver = sql {{(pid=282898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:35:28.831656 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=282898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:35:28.831874 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=282899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:35:28.831971 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=282898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:35:28.832130 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=282898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:35:28.832298 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=282899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:35:28.832394 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=282898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:35:28.832621 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=282898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:35:28.832748 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=282899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:35:28.832850 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=282898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:35:28.833101 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=282898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:35:28.833208 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=282899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:35:28.833432 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=282898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:35:28.833542 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=282899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:35:28.833701 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG uwsgi [-] database.connection = **** {{(pid=282898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:35:28.833894 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG uwsgi [-] trust.driver = sql {{(pid=282899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:35:28.833999 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=282898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:35:28.834138 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=282899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:35:28.834241 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=282898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:35:28.834384 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=282899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:35:28.834490 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=282898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:35:28.834626 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=282899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:35:28.834726 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=282898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:35:28.834878 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=282899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:35:28.835024 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=282898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:35:28.835158 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=282898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:35:28.835253 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=282899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:35:28.835340 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=282898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:35:28.835424 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=282899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:35:28.835568 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=282898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:35:28.835667 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=282899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:35:28.835822 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=282898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:35:28.835921 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=282899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:35:28.836080 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=282898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:35:28.836185 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG uwsgi [-] database.connection = **** {{(pid=282899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:35:28.836310 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=282898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:35:28.836412 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=282899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:35:28.836551 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=282898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:35:28.836761 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=282899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:35:28.836861 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=282898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:35:28.836947 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=282899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:35:28.837054 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=282898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:35:28.837146 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=282899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:35:28.837304 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=282898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:35:28.837416 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=282899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:35:28.837542 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=282899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:35:28.837641 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=282898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:35:28.837779 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=282899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:35:28.837877 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=282898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:35:28.838016 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=282899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:35:28.838119 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=282898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:35:28.838206 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=282898) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 28 08:35:28.838289 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=282899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:35:28.838483 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=282899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:35:28.838728 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=282899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:35:28.838965 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=282899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:35:28.839214 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=282899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:35:28.839451 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=282899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:35:28.839698 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=282899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:35:28.839933 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=282899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:35:28.840176 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=282899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:35:28.840416 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=282899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:35:28.840587 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=282899) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 28 08:35:28.867970 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=282898) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 08:35:28.868191 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=282898) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 08:35:28.868418 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=282898) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 08:35:28.869651 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=282899) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 08:35:28.869884 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=282899) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 08:35:28.870106 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=282899) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 08:35:28.877028 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=282898) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 08:35:28.878579 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=282899) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 08:35:28.907247 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=282898) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 08:35:28.907504 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=282898) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 08:35:28.908510 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=282899) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 08:35:28.908765 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=282899) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 08:35:28.960034 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=282899) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 08:35:28.960369 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=282898) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 08:35:29.010154 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=282899) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 08:35:29.010380 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=282899) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 08:35:29.011264 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=282898) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 08:35:29.011507 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=282898) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 08:35:29.074639 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=282899) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 08:35:29.074853 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=282899) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 08:35:29.075078 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=282899) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 08:35:29.075236 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=282898) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 08:35:29.075336 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=282899) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 08:35:29.075423 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=282898) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 08:35:29.075497 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=282899) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 08:35:29.075668 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=282898) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 08:35:29.075819 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=282899) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 08:35:29.075918 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=282898) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 08:35:29.076087 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=282898) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 08:35:29.076326 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=282898) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 08:35:29.098687 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=282899) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 08:35:29.099024 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=282899) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 08:35:29.099169 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=282899) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 08:35:29.099421 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=282899) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 08:35:29.099619 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=282899) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 08:35:29.099865 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=282899) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 08:35:29.100033 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=282898) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 08:35:29.100147 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=282899) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 08:35:29.100245 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=282898) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 08:35:29.100334 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=282898) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 08:35:29.100594 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=282898) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 08:35:29.100837 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=282898) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 08:35:29.101065 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=282898) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 08:35:29.101294 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=282898) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 08:35:29.111084 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=282899) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 08:35:29.111655 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=282898) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 08:35:29.123733 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=282899) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 08:35:29.124051 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=282899) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 08:35:29.124224 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=282899) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 08:35:29.124304 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=282898) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 08:35:29.124414 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=282899) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 08:35:29.124528 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=282898) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 08:35:29.124622 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=282899) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 08:35:29.124749 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=282898) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 08:35:29.124839 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=282899) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 08:35:29.124913 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=282898) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 08:35:29.124999 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=282899) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 08:35:29.125099 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=282898) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 08:35:29.125336 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=282898) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 08:35:29.125526 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=282898) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 08:35:29.141893 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=282899) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 08:35:29.142145 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=282899) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jul 28 08:35:29.142258 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=282898) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 08:35:29.142384 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=282898) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jul 28 08:35:29.142487 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=282899) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 08:35:29.142561 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=282899) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jul 28 08:35:29.142753 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=282898) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 08:35:29.142910 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=282899) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 08:35:29.143029 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=282898) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jul 28 08:35:29.143126 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=282899) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 08:35:29.143200 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=282898) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 08:35:29.143355 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=282899) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 08:35:29.143507 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=282898) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 08:35:29.143976 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=282899) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 08:35:29.144059 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=282898) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 08:35:29.144059 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=282898) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 08:35:29.153279 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=282899) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 08:35:29.153558 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=282899) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 08:35:29.153695 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=282898) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 08:35:29.153809 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=282899) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 08:35:29.154001 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=282898) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 08:35:29.154141 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=282899) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 08:35:29.154249 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=282898) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 08:35:29.154564 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=282898) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 08:35:29.160954 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=282899) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 28 08:35:29.161591 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=282898) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 28 08:35:29.165767 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=282899) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 28 08:35:29.166041 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=282899) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 08:35:29.166324 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=282899) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 08:35:29.166481 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=282898) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 28 08:35:29.166578 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=282899) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 08:35:29.166665 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=282898) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 08:35:29.166878 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=282899) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 08:35:29.167018 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=282898) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 08:35:29.167099 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=282899) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 08:35:29.167201 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=282898) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 08:35:29.167365 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=282899) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 08:35:29.167538 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=282898) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 08:35:29.167636 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=282899) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 08:35:29.167720 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=282898) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 08:35:29.167913 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=282899) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 08:35:29.168054 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=282898) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 08:35:29.168156 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=282899) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 08:35:29.168246 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=282898) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 08:35:29.168435 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=282899) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 08:35:29.168602 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=282898) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 08:35:29.168799 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=282898) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 08:35:29.169070 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=282898) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 08:35:29.191283 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=282899) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 08:35:29.192099 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=282898) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 08:35:29.192806 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=282899) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 28 08:35:29.193090 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=282899) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 08:35:29.193652 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=282898) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 28 08:35:29.193938 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=282898) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 08:35:29.197701 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=282899) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 28 08:35:29.197981 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=282899) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 08:35:29.198260 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=282899) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 08:35:29.198585 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=282898) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 28 08:35:29.198868 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=282898) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 08:35:29.199149 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=282898) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 08:35:29.205235 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=282899) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 28 08:35:29.205514 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=282899) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 08:35:29.206215 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=282898) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 28 08:35:29.206502 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=282898) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 08:35:29.209765 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=282899) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 28 08:35:29.210110 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=282899) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 08:35:29.210330 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=282899) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 08:35:29.210618 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=282899) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 08:35:29.210776 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=282898) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 28 08:35:29.210877 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=282899) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 08:35:29.210976 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=282898) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 08:35:29.211178 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=282899) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 08:35:29.211335 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=282898) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 08:35:29.211437 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=282899) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 08:35:29.211545 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=282898) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 08:35:29.211681 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=282899) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 08:35:29.211786 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=282898) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 08:35:29.212111 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=282898) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 08:35:29.212367 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=282898) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 08:35:29.212797 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=282898) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 08:35:29.227649 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=282899) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 08:35:29.227924 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=282899) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 08:35:29.228760 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=282898) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 08:35:29.229029 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=282898) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 08:35:29.231868 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=282899) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 28 08:35:29.232997 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=282898) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 28 08:35:29.235052 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=282899) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 08:35:29.235345 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=282899) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 08:35:29.236186 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=282898) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 08:35:29.236484 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=282898) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 08:35:29.239788 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=282899) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 28 08:35:29.240990 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=282898) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 28 08:35:29.242972 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=282899) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 28 08:35:29.244183 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=282898) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 28 08:35:29.246243 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=282899) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 08:35:29.246542 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=282899) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 08:35:29.246823 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=282899) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 08:35:29.247107 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=282899) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 08:35:29.247392 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=282899) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 08:35:29.247543 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=282898) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 08:35:29.247654 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=282899) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 08:35:29.247756 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=282898) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 08:35:29.247979 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=282898) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 08:35:29.248292 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=282898) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 08:35:29.248566 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=282898) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 08:35:29.248884 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=282898) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 08:35:29.263787 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=282899) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 28 08:35:29.264040 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=282899) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 08:35:29.264337 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=282899) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 08:35:29.264759 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=282899) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 08:35:29.265155 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=282898) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 28 08:35:29.265458 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=282898) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 08:35:29.265704 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=282898) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 08:35:29.265995 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=282898) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 08:35:29.271923 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=282899) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 08:35:29.273237 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=282898) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 08:35:29.273546 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=282899) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 08:35:29.273786 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=282899) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 08:35:29.274861 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=282898) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 08:35:29.275165 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=282898) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 08:35:29.276749 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=282899) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 28 08:35:29.277009 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=282899) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 08:35:29.277315 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=282899) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 08:35:29.277595 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=282899) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 08:35:29.277882 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=282899) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 08:35:29.278091 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=282898) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 28 08:35:29.278386 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=282898) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 08:35:29.278709 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=282898) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 08:35:29.278990 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=282898) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 08:35:29.279291 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=282898) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 08:35:29.289598 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=282899) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 28 08:35:29.289878 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=282899) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 08:35:29.290160 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=282899) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 08:35:29.290435 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=282899) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 08:35:29.290715 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=282899) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 08:35:29.290873 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=282898) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 28 08:35:29.290973 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=282899) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 08:35:29.291169 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=282898) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 08:35:29.291295 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=282899) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 08:35:29.291475 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=282898) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 08:35:29.291758 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=282898) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 08:35:29.292042 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=282898) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 08:35:29.292320 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=282898) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 08:35:29.292608 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=282898) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 08:35:29.306848 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=282899) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 28 08:35:29.308353 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=282898) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 28 08:35:29.309838 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=282899) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 28 08:35:29.311421 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=282898) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 28 08:35:29.312800 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=282899) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 08:35:29.314430 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=282898) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 08:35:29.315428 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=282899) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 08:35:29.316975 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=282899) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 28 08:35:29.317143 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=282898) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 08:35:29.317262 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=282899) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 08:35:29.317505 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=282899) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 08:35:29.318736 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=282898) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 28 08:35:29.319025 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=282898) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 08:35:29.319310 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=282898) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 08:35:29.324017 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=282899) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 08:35:29.325634 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=282899) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 28 08:35:29.325874 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=282898) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 08:35:29.327490 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=282898) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 28 08:35:29.328558 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=282899) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 08:35:29.328872 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=282899) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 08:35:29.329159 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=282899) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 08:35:29.329436 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=282899) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 08:35:29.330827 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=282898) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 08:35:29.331125 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=282898) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 08:35:29.331414 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=282898) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 08:35:29.331693 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=282898) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 08:35:29.337915 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=282899) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 28 08:35:29.338207 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=282899) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 08:35:29.338486 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=282899) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 08:35:29.339927 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=282898) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 28 08:35:29.340225 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=282898) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 08:35:29.340512 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=282898) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 08:35:29.345356 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=282899) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 28 08:35:29.345637 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=282899) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 08:35:29.345918 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=282899) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 08:35:29.346194 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=282899) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 08:35:29.346476 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=282899) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 08:35:29.346753 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=282899) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 08:35:29.347022 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=282899) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 08:35:29.347299 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=282899) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 08:35:29.347438 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=282898) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 28 08:35:29.347668 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=282899) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 08:35:29.347809 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=282898) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 08:35:29.347904 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=282899) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 08:35:29.348010 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=282898) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 08:35:29.348210 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=282899) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 08:35:29.348316 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=282898) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 08:35:29.348472 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=282899) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 08:35:29.348575 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=282898) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 08:35:29.348768 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=282899) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 08:35:29.348882 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=282898) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 08:35:29.349056 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=282899) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 08:35:29.349154 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=282898) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 08:35:29.349338 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=282898) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 08:35:29.349728 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=282898) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 08:35:29.350015 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=282898) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 08:35:29.350302 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=282898) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 08:35:29.350571 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=282898) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 08:35:29.350852 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=282898) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 08:35:29.351100 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=282898) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 08:35:29.382385 dv-cinder-851351-1-smb devstack@keystone.service[282899]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55ca4ca939c0 pid: 282899 (default app) Jul 28 08:35:29.384769 dv-cinder-851351-1-smb devstack@keystone.service[282898]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55ca4ca939c0 pid: 282898 (default app) Jul 28 08:35:29.385775 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c346d350-2cfb-4b18-9c6b-6a37b6da1c96 None None] REQUEST_METHOD: `GET` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:35:29.386066 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c346d350-2cfb-4b18-9c6b-6a37b6da1c96 None None] SCRIPT_NAME: `/identity` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:35:29.386345 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c346d350-2cfb-4b18-9c6b-6a37b6da1c96 None None] PATH_INFO: `/v3` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:35:29.390687 dv-cinder-851351-1-smb devstack@keystone.service[282899]: [pid: 282899|app: 0|req: 1/1] 10.222.0.42 () {50 vars in 791 bytes} [Thu Jul 28 08:35:29 2022] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:35:37.037242 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c4ab29-4ed1-47c7-b51e-c8386f5e0fa4 None None] REQUEST_METHOD: `GET` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:35:37.037909 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c4ab29-4ed1-47c7-b51e-c8386f5e0fa4 None None] SCRIPT_NAME: `/identity` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:35:37.037909 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c4ab29-4ed1-47c7-b51e-c8386f5e0fa4 None None] PATH_INFO: `/` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:35:37.042246 dv-cinder-851351-1-smb devstack@keystone.service[282898]: [pid: 282898|app: 0|req: 1/2] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 08:35:37 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 28 08:35:37.048402 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa796968-a523-46f0-81a9-c742b08fdf0b None None] REQUEST_METHOD: `POST` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:35:37.048954 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa796968-a523-46f0-81a9-c742b08fdf0b None None] SCRIPT_NAME: `/identity` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:35:37.048954 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa796968-a523-46f0-81a9-c742b08fdf0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:35:37.121106 dv-cinder-851351-1-smb devstack@keystone.service[282899]: INFO dbcounter [None req-aa796968-a523-46f0-81a9-c742b08fdf0b None None] Registered counter for database keystone Jul 28 08:35:37.144728 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG oslo_db.sqlalchemy.engines [None req-aa796968-a523-46f0-81a9-c742b08fdf0b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=282899) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 28 08:35:37.152503 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG dbcounter [-] [282899] Writer thread running {{(pid=282899) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 28 08:35:37.337831 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG passlib.handlers.bcrypt [None req-aa796968-a523-46f0-81a9-c742b08fdf0b None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=282899) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Jul 28 08:35:37.338228 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG passlib.handlers.bcrypt [None req-aa796968-a523-46f0-81a9-c742b08fdf0b None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=282899) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Jul 28 08:35:37.396314 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.auth.core [None req-aa796968-a523-46f0-81a9-c742b08fdf0b None None] MFA Rules not processed for user `2be990a66857410a87ffa7609aec4f7b`. Rule list: `[]` (Enabled: `True`). {{(pid=282899) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 08:35:37.397920 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.fernet_utils [None req-aa796968-a523-46f0-81a9-c742b08fdf0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=282899) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:35:37.530770 dv-cinder-851351-1-smb devstack@keystone.service[282899]: [pid: 282899|app: 0|req: 2/3] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 08:35:37 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 483 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jul 28 08:35:37.554775 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c4ab29-4ed1-47c7-b51e-c8386f5e0fa4 None None] Authenticating user token {{(pid=282898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:35:37.634730 dv-cinder-851351-1-smb devstack@keystone.service[282898]: INFO dbcounter [None req-30c4ab29-4ed1-47c7-b51e-c8386f5e0fa4 None None] Registered counter for database keystone Jul 28 08:35:37.655024 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG oslo_db.sqlalchemy.engines [None req-30c4ab29-4ed1-47c7-b51e-c8386f5e0fa4 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=282898) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 28 08:35:37.662040 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG dbcounter [-] [282898] Writer thread running {{(pid=282898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 28 08:35:37.783903 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c4ab29-4ed1-47c7-b51e-c8386f5e0fa4 None None] Validating token access rules against request {{(pid=282898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:35:37.788794 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-270a17e1-9cfe-4fac-a549-6f607c5c35d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c423333fe4246a29efc0aa6050bba26', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:35:37.789462 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270a17e1-9cfe-4fac-a549-6f607c5c35d9 admin admin] REQUEST_METHOD: `GET` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:35:37.789746 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270a17e1-9cfe-4fac-a549-6f607c5c35d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:35:37.790025 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270a17e1-9cfe-4fac-a549-6f607c5c35d9 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:35:37.799914 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-270a17e1-9cfe-4fac-a549-6f607c5c35d9 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:35:37.851514 dv-cinder-851351-1-smb devstack@keystone.service[282898]: WARNING keystone.common.rbac_enforcer.enforcer [None req-270a17e1-9cfe-4fac-a549-6f607c5c35d9 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Jul 28 08:35:37.851865 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-270a17e1-9cfe-4fac-a549-6f607c5c35d9 admin admin] RBAC: Authorization granted {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:35:37.862749 dv-cinder-851351-1-smb devstack@keystone.service[282898]: [pid: 282898|app: 0|req: 2/4] 10.222.0.42 () {58 vars in 1324 bytes} [Thu Jul 28 08:35:37 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 28 08:35:37.870386 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa796968-a523-46f0-81a9-c742b08fdf0b None None] Authenticating user token {{(pid=282899) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:35:37.887729 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa796968-a523-46f0-81a9-c742b08fdf0b None None] Validating token access rules against request {{(pid=282899) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:35:37.892583 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5becb4c4-9b29-41c9-ba9e-0f3efc742835 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c423333fe4246a29efc0aa6050bba26', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282899) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:35:37.893770 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5becb4c4-9b29-41c9-ba9e-0f3efc742835 admin admin] REQUEST_METHOD: `GET` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:35:37.894061 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5becb4c4-9b29-41c9-ba9e-0f3efc742835 admin admin] SCRIPT_NAME: `/identity` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:35:37.894337 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5becb4c4-9b29-41c9-ba9e-0f3efc742835 admin admin] PATH_INFO: `/v3/projects/0c423333fe4246a29efc0aa6050bba26` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:35:37.895853 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5becb4c4-9b29-41c9-ba9e-0f3efc742835 admin admin] RBAC: Authorizing `identity:get_project(project_id=0c423333fe4246a29efc0aa6050bba26)` {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:35:37.946611 dv-cinder-851351-1-smb devstack@keystone.service[282899]: WARNING keystone.common.rbac_enforcer.enforcer [None req-5becb4c4-9b29-41c9-ba9e-0f3efc742835 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Jul 28 08:35:37.946823 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5becb4c4-9b29-41c9-ba9e-0f3efc742835 admin admin] RBAC: Authorization granted {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:35:37.951703 dv-cinder-851351-1-smb devstack@keystone.service[282899]: [pid: 282899|app: 0|req: 3/5] 10.222.0.42 () {56 vars in 1207 bytes} [Thu Jul 28 08:35:37 2022] GET /identity/v3/projects/0c423333fe4246a29efc0aa6050bba26 => generated 344 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:35:39.941326 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6f20b1-ba05-458b-9ff5-330a8929d552 None None] REQUEST_METHOD: `GET` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:35:39.941929 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6f20b1-ba05-458b-9ff5-330a8929d552 None None] SCRIPT_NAME: `/identity` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:35:39.941929 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6f20b1-ba05-458b-9ff5-330a8929d552 None None] PATH_INFO: `/` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:35:39.946123 dv-cinder-851351-1-smb devstack@keystone.service[282898]: [pid: 282898|app: 0|req: 3/6] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 08:35:39 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 08:35:39.952142 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2665e5d-db10-41bd-8de7-d5c53bec3f6b None None] REQUEST_METHOD: `POST` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:35:39.952698 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2665e5d-db10-41bd-8de7-d5c53bec3f6b None None] SCRIPT_NAME: `/identity` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:35:39.952698 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2665e5d-db10-41bd-8de7-d5c53bec3f6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:35:39.974598 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.auth.core [None req-d2665e5d-db10-41bd-8de7-d5c53bec3f6b None None] MFA Rules not processed for user `2be990a66857410a87ffa7609aec4f7b`. Rule list: `[]` (Enabled: `True`). {{(pid=282899) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 08:35:39.976186 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.fernet_utils [None req-d2665e5d-db10-41bd-8de7-d5c53bec3f6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=282899) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:35:39.984981 dv-cinder-851351-1-smb devstack@keystone.service[282899]: [pid: 282899|app: 0|req: 4/7] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 08:35:39 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jul 28 08:35:40.006889 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6f20b1-ba05-458b-9ff5-330a8929d552 None None] Authenticating user token {{(pid=282898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:35:40.021162 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6f20b1-ba05-458b-9ff5-330a8929d552 None None] Validating token access rules against request {{(pid=282898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:35:40.025572 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2a13f8-1c62-4c15-bb89-cdfd779fc69a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c423333fe4246a29efc0aa6050bba26', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:35:40.026198 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2a13f8-1c62-4c15-bb89-cdfd779fc69a admin admin] REQUEST_METHOD: `GET` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:35:40.026479 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2a13f8-1c62-4c15-bb89-cdfd779fc69a admin admin] SCRIPT_NAME: `/identity` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:35:40.026757 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2a13f8-1c62-4c15-bb89-cdfd779fc69a admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:35:40.035131 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a2a13f8-1c62-4c15-bb89-cdfd779fc69a admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:35:40.037004 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a2a13f8-1c62-4c15-bb89-cdfd779fc69a admin admin] RBAC: Authorization granted {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:35:40.046163 dv-cinder-851351-1-smb devstack@keystone.service[282898]: [pid: 282898|app: 0|req: 4/8] 10.222.0.42 () {58 vars in 1324 bytes} [Thu Jul 28 08:35:40 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 28 08:35:40.053097 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2665e5d-db10-41bd-8de7-d5c53bec3f6b None None] Authenticating user token {{(pid=282899) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:35:40.062498 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2665e5d-db10-41bd-8de7-d5c53bec3f6b None None] Validating token access rules against request {{(pid=282899) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:35:40.067985 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de385d95-3059-4ea3-971a-0b85b437bdf4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0c423333fe4246a29efc0aa6050bba26', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282899) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:35:40.068572 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de385d95-3059-4ea3-971a-0b85b437bdf4 admin admin] REQUEST_METHOD: `GET` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:35:40.068885 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de385d95-3059-4ea3-971a-0b85b437bdf4 admin admin] SCRIPT_NAME: `/identity` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:35:40.069147 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de385d95-3059-4ea3-971a-0b85b437bdf4 admin admin] PATH_INFO: `/v3/users/2be990a66857410a87ffa7609aec4f7b` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:35:40.070666 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de385d95-3059-4ea3-971a-0b85b437bdf4 admin admin] RBAC: Authorizing `identity:get_user(user_id=2be990a66857410a87ffa7609aec4f7b)` {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:35:40.072528 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de385d95-3059-4ea3-971a-0b85b437bdf4 admin admin] RBAC: Authorization granted {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:35:40.074188 dv-cinder-851351-1-smb devstack@keystone.service[282899]: [pid: 282899|app: 0|req: 5/9] 10.222.0.42 () {56 vars in 1198 bytes} [Thu Jul 28 08:35:40 2022] GET /identity/v3/users/2be990a66857410a87ffa7609aec4f7b => generated 247 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:35:42.135800 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dbc00c8-e2cf-4398-8418-38d21d4cbf66 None None] REQUEST_METHOD: `GET` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:35:42.136407 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dbc00c8-e2cf-4398-8418-38d21d4cbf66 None None] SCRIPT_NAME: `/identity` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:35:42.136407 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dbc00c8-e2cf-4398-8418-38d21d4cbf66 None None] PATH_INFO: `/` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:35:42.137733 dv-cinder-851351-1-smb devstack@keystone.service[282898]: [pid: 282898|app: 0|req: 5/10] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 08:35:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 08:35:42.143047 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c998737-bb5d-4f38-b97f-69da6dcbff2a None None] REQUEST_METHOD: `POST` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:35:42.143514 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c998737-bb5d-4f38-b97f-69da6dcbff2a None None] SCRIPT_NAME: `/identity` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:35:42.143623 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c998737-bb5d-4f38-b97f-69da6dcbff2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:35:42.164740 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.auth.core [None req-4c998737-bb5d-4f38-b97f-69da6dcbff2a None None] MFA Rules not processed for user `2be990a66857410a87ffa7609aec4f7b`. Rule list: `[]` (Enabled: `True`). {{(pid=282899) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 08:35:42.165979 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.fernet_utils [None req-4c998737-bb5d-4f38-b97f-69da6dcbff2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=282899) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:35:42.181336 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a7688a-a092-4217-ac28-1d6e4447aff0 None None] REQUEST_METHOD: `GET` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:35:42.181587 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a7688a-a092-4217-ac28-1d6e4447aff0 None None] SCRIPT_NAME: `/identity` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:35:42.181856 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a7688a-a092-4217-ac28-1d6e4447aff0 None None] PATH_INFO: `/` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:35:42.183234 dv-cinder-851351-1-smb devstack@keystone.service[282898]: [pid: 282898|app: 0|req: 6/11] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 08:35:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 28 08:35:42.188264 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55544242-d46f-42eb-903d-64855954456e None None] REQUEST_METHOD: `POST` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:35:42.188535 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55544242-d46f-42eb-903d-64855954456e None None] SCRIPT_NAME: `/identity` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:35:42.188881 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55544242-d46f-42eb-903d-64855954456e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:35:42.231939 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG passlib.handlers.bcrypt [None req-55544242-d46f-42eb-903d-64855954456e None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=282898) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Jul 28 08:35:42.232343 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG passlib.handlers.bcrypt [None req-55544242-d46f-42eb-903d-64855954456e None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=282898) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Jul 28 08:35:42.255373 dv-cinder-851351-1-smb devstack@keystone.service[282899]: [pid: 282899|app: 0|req: 6/12] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 08:35:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 08:35:42.277675 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.auth.core [None req-55544242-d46f-42eb-903d-64855954456e None None] MFA Rules not processed for user `2be990a66857410a87ffa7609aec4f7b`. Rule list: `[]` (Enabled: `True`). {{(pid=282898) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 08:35:42.279367 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.fernet_utils [None req-55544242-d46f-42eb-903d-64855954456e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=282898) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:35:42.279546 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c998737-bb5d-4f38-b97f-69da6dcbff2a None None] Authenticating user token {{(pid=282899) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:35:42.305763 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG dbcounter [-] [282899] Writing DB stats keystone:SELECT=100 {{(pid=282899) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:35:42.388694 dv-cinder-851351-1-smb devstack@keystone.service[282898]: [pid: 282898|app: 0|req: 7/13] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 08:35:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 28 08:35:42.391812 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c998737-bb5d-4f38-b97f-69da6dcbff2a None None] Validating token access rules against request {{(pid=282899) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:35:42.409784 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55544242-d46f-42eb-903d-64855954456e None None] Authenticating user token {{(pid=282898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:35:42.430220 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-113f2d59-0f0b-4e1f-89f1-692781b0fc8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282899) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:35:42.430885 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113f2d59-0f0b-4e1f-89f1-692781b0fc8d None admin] REQUEST_METHOD: `GET` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:35:42.431165 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113f2d59-0f0b-4e1f-89f1-692781b0fc8d None admin] SCRIPT_NAME: `/identity` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:35:42.431444 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113f2d59-0f0b-4e1f-89f1-692781b0fc8d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:35:42.443499 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-113f2d59-0f0b-4e1f-89f1-692781b0fc8d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 08:35:42.452273 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application [None req-113f2d59-0f0b-4e1f-89f1-692781b0fc8d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 08:35:42.452273 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:35:42.452273 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:35:42.452273 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:35:42.452273 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:35:42.452273 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:35:42.452273 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:35:42.452273 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:35:42.452273 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:35:42.452273 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:35:42.452273 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:35:42.452273 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:35:42.452273 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 08:35:42.452273 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 08:35:42.452273 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 08:35:42.452273 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 08:35:42.453577 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 08:35:42.453577 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 08:35:42.453577 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 08:35:42.453577 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 08:35:42.453577 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:35:42.453577 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:35:42.453577 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:35:42.453577 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:35:42.453577 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:35:42.453577 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:35:42.453577 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:35:42.453577 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application with Lock( Jul 28 08:35:42.453577 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:35:42.453577 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:35:42.453577 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:35:42.453577 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:35:42.455379 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:35:42.455379 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:35:42.455379 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:35:42.455379 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:35:42.455379 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 08:35:42.455379 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 08:35:42.455379 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 08:35:42.455379 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 08:35:42.455379 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 08:35:42.455379 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 08:35:42.455379 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 08:35:42.455379 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application Jul 28 08:35:42.455379 dv-cinder-851351-1-smb devstack@keystone.service[282899]: [pid: 282899|app: 0|req: 7/14] 10.222.0.42 () {56 vars in 1096 bytes} [Thu Jul 28 08:35:42 2022] GET /identity/v3/roles/admin => generated 83 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 08:35:42.460109 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-113f2d59-0f0b-4e1f-89f1-692781b0fc8d None admin] Authenticating user token {{(pid=282899) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:35:42.515651 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55544242-d46f-42eb-903d-64855954456e None None] Validating token access rules against request {{(pid=282898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:35:42.518022 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG dbcounter [-] [282898] Writing DB stats keystone:SELECT=100 {{(pid=282898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:35:42.546375 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG dbcounter [-] [282899] Writing DB stats keystone:SELECT=100 {{(pid=282899) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:35:42.555407 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f02cf18-4386-4296-b679-205907b04f75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:35:42.556314 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f02cf18-4386-4296-b679-205907b04f75 None admin] REQUEST_METHOD: `GET` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:35:42.556605 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f02cf18-4386-4296-b679-205907b04f75 None admin] SCRIPT_NAME: `/identity` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:35:42.556914 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f02cf18-4386-4296-b679-205907b04f75 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:35:42.564948 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-113f2d59-0f0b-4e1f-89f1-692781b0fc8d None admin] Validating token access rules against request {{(pid=282899) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:35:42.600992 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be089f66-214b-4749-b4c1-9dc985cf8d89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282899) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:35:42.601636 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be089f66-214b-4749-b4c1-9dc985cf8d89 None admin] REQUEST_METHOD: `GET` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:35:42.601915 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be089f66-214b-4749-b4c1-9dc985cf8d89 None admin] SCRIPT_NAME: `/identity` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:35:42.602189 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be089f66-214b-4749-b4c1-9dc985cf8d89 None admin] PATH_INFO: `/v3/roles` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:35:42.602931 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be089f66-214b-4749-b4c1-9dc985cf8d89 None admin] RBAC: Adding query filter params (name=admin) {{(pid=282899) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:35:42.603240 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be089f66-214b-4749-b4c1-9dc985cf8d89 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:35:42.604686 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be089f66-214b-4749-b4c1-9dc985cf8d89 None admin] RBAC: Authorization granted {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:35:42.618538 dv-cinder-851351-1-smb devstack@keystone.service[282899]: [pid: 282899|app: 0|req: 8/15] 10.222.0.42 () {56 vars in 1099 bytes} [Thu Jul 28 08:35:42 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 08:35:42.624378 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be089f66-214b-4749-b4c1-9dc985cf8d89 None admin] Authenticating user token {{(pid=282899) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:35:42.628072 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f02cf18-4386-4296-b679-205907b04f75 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:35:42.629677 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f02cf18-4386-4296-b679-205907b04f75 None admin] RBAC: Authorization granted {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:35:42.744281 dv-cinder-851351-1-smb devstack@keystone.service[282898]: [pid: 282898|app: 0|req: 8/16] 10.222.0.42 () {58 vars in 1282 bytes} [Thu Jul 28 08:35:42 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 335 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 28 08:35:42.750524 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f02cf18-4386-4296-b679-205907b04f75 None admin] Authenticating user token {{(pid=282898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:35:42.754008 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG dbcounter [-] [282898] Writing DB stats keystone:SELECT=100 {{(pid=282898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:35:42.843238 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be089f66-214b-4749-b4c1-9dc985cf8d89 None admin] Validating token access rules against request {{(pid=282899) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:35:42.856865 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f02cf18-4386-4296-b679-205907b04f75 None admin] Validating token access rules against request {{(pid=282898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:35:42.879379 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba5c838-8901-41d8-8578-0a1a9fa46732 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282899) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:35:42.880069 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba5c838-8901-41d8-8578-0a1a9fa46732 None admin] REQUEST_METHOD: `GET` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:35:42.880360 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba5c838-8901-41d8-8578-0a1a9fa46732 None admin] SCRIPT_NAME: `/identity` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:35:42.880642 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba5c838-8901-41d8-8578-0a1a9fa46732 None admin] PATH_INFO: `/v3/users/2be990a66857410a87ffa7609aec4f7b` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:35:42.881920 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ba5c838-8901-41d8-8578-0a1a9fa46732 None admin] RBAC: Authorizing `identity:get_user(user_id=2be990a66857410a87ffa7609aec4f7b)` {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:35:42.883413 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ba5c838-8901-41d8-8578-0a1a9fa46732 None admin] RBAC: Authorization granted {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:35:42.885104 dv-cinder-851351-1-smb devstack@keystone.service[282899]: [pid: 282899|app: 0|req: 9/17] 10.222.0.42 () {56 vars in 1177 bytes} [Thu Jul 28 08:35:42 2022] GET /identity/v3/users/2be990a66857410a87ffa7609aec4f7b => generated 247 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 08:35:42.890794 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba5c838-8901-41d8-8578-0a1a9fa46732 None admin] Authenticating user token {{(pid=282899) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:35:42.892741 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2022844-9e6d-43c1-8188-5c3f31a55172 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:35:42.893608 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2022844-9e6d-43c1-8188-5c3f31a55172 None admin] REQUEST_METHOD: `GET` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:35:42.893893 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2022844-9e6d-43c1-8188-5c3f31a55172 None admin] SCRIPT_NAME: `/identity` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:35:42.894183 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2022844-9e6d-43c1-8188-5c3f31a55172 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:35:42.906117 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG dbcounter [-] [282899] Writing DB stats keystone:SELECT=100 {{(pid=282899) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:35:42.914035 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2022844-9e6d-43c1-8188-5c3f31a55172 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:35:42.916133 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2022844-9e6d-43c1-8188-5c3f31a55172 None admin] RBAC: Authorization granted {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:35:42.935896 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application [None req-f2022844-9e6d-43c1-8188-5c3f31a55172 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 08:35:42.935896 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:35:42.935896 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:35:42.935896 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:35:42.935896 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:35:42.935896 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:35:42.935896 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:35:42.935896 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:35:42.935896 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:35:42.935896 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:35:42.935896 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:35:42.935896 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:35:42.935896 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 08:35:42.935896 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 08:35:42.935896 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 08:35:42.937183 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 08:35:42.937183 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:35:42.937183 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:35:42.937183 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:35:42.937183 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:35:42.937183 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:35:42.937183 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:35:42.937183 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:35:42.937183 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application with Lock( Jul 28 08:35:42.937183 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:35:42.937183 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:35:42.937183 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:35:42.937183 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:35:42.937183 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:35:42.937183 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:35:42.937183 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:35:42.937183 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:35:42.938194 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 08:35:42.938194 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 08:35:42.938194 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 08:35:42.938194 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application Jul 28 08:35:42.938194 dv-cinder-851351-1-smb devstack@keystone.service[282898]: [pid: 282898|app: 0|req: 9/18] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 08:35:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 08:35:42.943224 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2022844-9e6d-43c1-8188-5c3f31a55172 None admin] Authenticating user token {{(pid=282898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:35:42.998185 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba5c838-8901-41d8-8578-0a1a9fa46732 None admin] Validating token access rules against request {{(pid=282899) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:35:42.999556 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG dbcounter [-] [282898] Writing DB stats keystone:SELECT=100 {{(pid=282898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:35:43.033848 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebcabc41-287e-4040-88bb-c23169c64970 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282899) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:35:43.034532 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebcabc41-287e-4040-88bb-c23169c64970 None admin] REQUEST_METHOD: `GET` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:35:43.034821 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebcabc41-287e-4040-88bb-c23169c64970 None admin] SCRIPT_NAME: `/identity` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:35:43.035106 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebcabc41-287e-4040-88bb-c23169c64970 None admin] PATH_INFO: `/v3/domains/default` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:35:43.036328 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebcabc41-287e-4040-88bb-c23169c64970 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:35:43.037870 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebcabc41-287e-4040-88bb-c23169c64970 None admin] RBAC: Authorization granted {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:35:43.039517 dv-cinder-851351-1-smb devstack@keystone.service[282899]: [pid: 282899|app: 0|req: 10/19] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 08:35:42 2022] GET /identity/v3/domains/default => generated 199 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 08:35:43.045472 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebcabc41-287e-4040-88bb-c23169c64970 None admin] Authenticating user token {{(pid=282899) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:35:43.046279 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2022844-9e6d-43c1-8188-5c3f31a55172 None admin] Validating token access rules against request {{(pid=282898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:35:43.080731 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f89473-85f7-420d-9ac3-e29d1275e159 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:35:43.081371 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f89473-85f7-420d-9ac3-e29d1275e159 None admin] REQUEST_METHOD: `GET` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:35:43.081659 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f89473-85f7-420d-9ac3-e29d1275e159 None admin] SCRIPT_NAME: `/identity` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:35:43.081937 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f89473-85f7-420d-9ac3-e29d1275e159 None admin] PATH_INFO: `/v3/domains` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:35:43.082656 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85f89473-85f7-420d-9ac3-e29d1275e159 None admin] RBAC: Adding query filter params (name=Default) {{(pid=282898) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:35:43.082976 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85f89473-85f7-420d-9ac3-e29d1275e159 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:35:43.084415 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85f89473-85f7-420d-9ac3-e29d1275e159 None admin] RBAC: Authorization granted {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:35:43.102964 dv-cinder-851351-1-smb devstack@keystone.service[282898]: [pid: 282898|app: 0|req: 10/20] 10.222.0.42 () {56 vars in 1109 bytes} [Thu Jul 28 08:35:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 08:35:43.131132 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG dbcounter [-] [282899] Writing DB stats keystone:SELECT=100 {{(pid=282899) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:35:43.152869 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebcabc41-287e-4040-88bb-c23169c64970 None admin] Validating token access rules against request {{(pid=282899) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:35:43.193031 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2945f079-cfd8-4d9b-9023-601e5ff4653b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282899) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:35:43.193688 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2945f079-cfd8-4d9b-9023-601e5ff4653b None admin] REQUEST_METHOD: `GET` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:35:43.193976 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2945f079-cfd8-4d9b-9023-601e5ff4653b None admin] SCRIPT_NAME: `/identity` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:35:43.194258 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2945f079-cfd8-4d9b-9023-601e5ff4653b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:35:43.195085 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2945f079-cfd8-4d9b-9023-601e5ff4653b None admin] RBAC: Adding query filter params (role.id=a0e2a00bf94d40f38629d6b5293e3aee, scope.domain.id=default, user.id=2be990a66857410a87ffa7609aec4f7b) {{(pid=282899) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:35:43.195401 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2945f079-cfd8-4d9b-9023-601e5ff4653b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:35:43.196956 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2945f079-cfd8-4d9b-9023-601e5ff4653b None admin] RBAC: Authorization granted {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:35:43.205407 dv-cinder-851351-1-smb devstack@keystone.service[282899]: [pid: 282899|app: 0|req: 11/21] 10.222.0.42 () {56 vars in 1322 bytes} [Thu Jul 28 08:35:43 2022] GET /identity/v3/role_assignments?user.id=2be990a66857410a87ffa7609aec4f7b&scope.domain.id=default&role.id=a0e2a00bf94d40f38629d6b5293e3aee => generated 233 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:35:45.436397 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac044edd-9abe-47d4-9118-058bbd8f5b68 None None] REQUEST_METHOD: `GET` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:35:45.437508 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac044edd-9abe-47d4-9118-058bbd8f5b68 None None] SCRIPT_NAME: `/identity` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:35:45.438012 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac044edd-9abe-47d4-9118-058bbd8f5b68 None None] PATH_INFO: `/` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:35:45.439634 dv-cinder-851351-1-smb devstack@keystone.service[282898]: [pid: 282898|app: 0|req: 11/22] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 08:35:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 08:35:45.445511 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e3ee4d-b6d8-4c7d-91c8-c61e07dda02b None None] REQUEST_METHOD: `POST` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:35:45.446466 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e3ee4d-b6d8-4c7d-91c8-c61e07dda02b None None] SCRIPT_NAME: `/identity` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:35:45.446969 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e3ee4d-b6d8-4c7d-91c8-c61e07dda02b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:35:45.474513 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.auth.core [None req-70e3ee4d-b6d8-4c7d-91c8-c61e07dda02b None None] MFA Rules not processed for user `2be990a66857410a87ffa7609aec4f7b`. Rule list: `[]` (Enabled: `True`). {{(pid=282899) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 08:35:45.476157 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.fernet_utils [None req-70e3ee4d-b6d8-4c7d-91c8-c61e07dda02b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=282899) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:35:45.575071 dv-cinder-851351-1-smb devstack@keystone.service[282899]: [pid: 282899|app: 0|req: 12/23] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 08:35:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 08:35:45.609968 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac044edd-9abe-47d4-9118-058bbd8f5b68 None None] Authenticating user token {{(pid=282898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:35:45.697069 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe50dd5c-3d27-46d5-90aa-dbe399c24f9c None None] REQUEST_METHOD: `GET` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:35:45.697276 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe50dd5c-3d27-46d5-90aa-dbe399c24f9c None None] SCRIPT_NAME: `/identity` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:35:45.697543 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe50dd5c-3d27-46d5-90aa-dbe399c24f9c None None] PATH_INFO: `/` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:35:45.699217 dv-cinder-851351-1-smb devstack@keystone.service[282899]: [pid: 282899|app: 0|req: 13/24] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 08:35:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 08:35:45.704396 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4e786a-498e-4757-b6ba-7e47b4faea14 None None] REQUEST_METHOD: `POST` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:35:45.705075 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4e786a-498e-4757-b6ba-7e47b4faea14 None None] SCRIPT_NAME: `/identity` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:35:45.705357 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4e786a-498e-4757-b6ba-7e47b4faea14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:35:45.741141 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.auth.core [None req-ac4e786a-498e-4757-b6ba-7e47b4faea14 None None] MFA Rules not processed for user `2be990a66857410a87ffa7609aec4f7b`. Rule list: `[]` (Enabled: `True`). {{(pid=282899) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 08:35:45.742403 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.fernet_utils [None req-ac4e786a-498e-4757-b6ba-7e47b4faea14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=282899) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:35:45.773452 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac044edd-9abe-47d4-9118-058bbd8f5b68 None None] Validating token access rules against request {{(pid=282898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:35:45.816385 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG dbcounter [-] [282898] Writing DB stats keystone:SELECT=100 {{(pid=282898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:35:45.821385 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d54227d-ad4d-4357-a6d0-f6328c9951ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:35:45.822082 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d54227d-ad4d-4357-a6d0-f6328c9951ab None admin] REQUEST_METHOD: `GET` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:35:45.822375 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d54227d-ad4d-4357-a6d0-f6328c9951ab None admin] SCRIPT_NAME: `/identity` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:35:45.822658 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d54227d-ad4d-4357-a6d0-f6328c9951ab None admin] PATH_INFO: `/v3/domains/Default` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:35:45.842553 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d54227d-ad4d-4357-a6d0-f6328c9951ab None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:35:45.845895 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d54227d-ad4d-4357-a6d0-f6328c9951ab None admin] RBAC: Authorization granted {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:35:45.875238 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application [None req-1d54227d-ad4d-4357-a6d0-f6328c9951ab None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 08:35:45.875238 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:35:45.875238 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:35:45.875238 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:35:45.875238 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:35:45.875238 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:35:45.875238 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:35:45.875238 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:35:45.875238 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:35:45.875238 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:35:45.875238 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:35:45.875238 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:35:45.875238 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 08:35:45.875238 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 08:35:45.875238 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 08:35:45.876319 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 08:35:45.876319 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:35:45.876319 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:35:45.876319 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:35:45.876319 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:35:45.876319 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:35:45.876319 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:35:45.876319 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:35:45.876319 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application with Lock( Jul 28 08:35:45.876319 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:35:45.876319 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:35:45.876319 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:35:45.876319 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:35:45.876319 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:35:45.876319 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:35:45.876319 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:35:45.876319 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:35:45.877376 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 08:35:45.877376 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 08:35:45.877376 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 08:35:45.877376 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application Jul 28 08:35:45.879557 dv-cinder-851351-1-smb devstack@keystone.service[282898]: [pid: 282898|app: 0|req: 12/25] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 08:35:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 270 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:35:45.885545 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f18c12b-de8b-4e3b-96b4-b623d8943d0c None None] REQUEST_METHOD: `GET` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:35:45.886169 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f18c12b-de8b-4e3b-96b4-b623d8943d0c None None] SCRIPT_NAME: `/identity` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:35:45.886661 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f18c12b-de8b-4e3b-96b4-b623d8943d0c None None] PATH_INFO: `/` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:35:45.888575 dv-cinder-851351-1-smb devstack@keystone.service[282898]: [pid: 282898|app: 0|req: 13/26] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 08:35:45 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 08:35:45.890737 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f18c12b-de8b-4e3b-96b4-b623d8943d0c None None] Authenticating user token {{(pid=282898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:35:45.897227 dv-cinder-851351-1-smb devstack@keystone.service[282899]: [pid: 282899|app: 0|req: 14/27] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 08:35:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 08:35:45.898555 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3cd32c-bf59-41fb-96f0-fc3b9c083ac3 None None] REQUEST_METHOD: `POST` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:35:45.898851 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3cd32c-bf59-41fb-96f0-fc3b9c083ac3 None None] SCRIPT_NAME: `/identity` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:35:45.899135 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3cd32c-bf59-41fb-96f0-fc3b9c083ac3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:35:45.921024 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG dbcounter [-] [282899] Writing DB stats keystone:SELECT=100 {{(pid=282899) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:35:45.949890 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.auth.core [None req-fb3cd32c-bf59-41fb-96f0-fc3b9c083ac3 None None] MFA Rules not processed for user `2be990a66857410a87ffa7609aec4f7b`. Rule list: `[]` (Enabled: `True`). {{(pid=282899) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 08:35:45.951078 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.fernet_utils [None req-fb3cd32c-bf59-41fb-96f0-fc3b9c083ac3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=282899) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:35:46.069030 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f18c12b-de8b-4e3b-96b4-b623d8943d0c None None] Validating token access rules against request {{(pid=282898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:35:46.074015 dv-cinder-851351-1-smb devstack@keystone.service[282899]: [pid: 282899|app: 0|req: 15/28] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 08:35:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 08:35:46.074964 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3cd32c-bf59-41fb-96f0-fc3b9c083ac3 None None] Authenticating user token {{(pid=282899) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:35:46.128635 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63dcf2ff-c66d-49bc-8331-db076faad9f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:35:46.129855 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63dcf2ff-c66d-49bc-8331-db076faad9f2 None admin] REQUEST_METHOD: `GET` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:35:46.130321 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63dcf2ff-c66d-49bc-8331-db076faad9f2 None admin] SCRIPT_NAME: `/identity` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:35:46.131164 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63dcf2ff-c66d-49bc-8331-db076faad9f2 None admin] PATH_INFO: `/v3/domains` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:35:46.132359 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63dcf2ff-c66d-49bc-8331-db076faad9f2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=282898) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:35:46.132873 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63dcf2ff-c66d-49bc-8331-db076faad9f2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:35:46.135065 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63dcf2ff-c66d-49bc-8331-db076faad9f2 None admin] RBAC: Authorization granted {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:35:46.151908 dv-cinder-851351-1-smb devstack@keystone.service[282898]: [pid: 282898|app: 0|req: 14/29] 10.222.0.42 () {56 vars in 1109 bytes} [Thu Jul 28 08:35:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:35:46.153701 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5082a0-0ac1-4e96-b5a1-b4ab1e20bbaf None None] REQUEST_METHOD: `GET` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:35:46.154176 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5082a0-0ac1-4e96-b5a1-b4ab1e20bbaf None None] SCRIPT_NAME: `/identity` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:35:46.154608 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5082a0-0ac1-4e96-b5a1-b4ab1e20bbaf None None] PATH_INFO: `/` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:35:46.157236 dv-cinder-851351-1-smb devstack@keystone.service[282898]: [pid: 282898|app: 0|req: 15/30] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 08:35:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 08:35:46.162509 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5082a0-0ac1-4e96-b5a1-b4ab1e20bbaf None None] Authenticating user token {{(pid=282898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:35:46.199362 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3cd32c-bf59-41fb-96f0-fc3b9c083ac3 None None] Validating token access rules against request {{(pid=282899) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:35:46.246581 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5842a29f-cbc9-4b4d-9b2d-cc00beea2060 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282899) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:35:46.247545 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5842a29f-cbc9-4b4d-9b2d-cc00beea2060 None admin] REQUEST_METHOD: `GET` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:35:46.247998 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5842a29f-cbc9-4b4d-9b2d-cc00beea2060 None admin] SCRIPT_NAME: `/identity` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:35:46.248453 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5842a29f-cbc9-4b4d-9b2d-cc00beea2060 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:35:46.251063 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG dbcounter [-] [282899] Writing DB stats keystone:SELECT=100 {{(pid=282899) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:35:46.262798 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5842a29f-cbc9-4b4d-9b2d-cc00beea2060 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 08:35:46.269241 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application [None req-5842a29f-cbc9-4b4d-9b2d-cc00beea2060 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 08:35:46.269241 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:35:46.269241 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:35:46.269241 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:35:46.269241 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:35:46.269241 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:35:46.269241 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:35:46.269241 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:35:46.269241 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:35:46.269241 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:35:46.269241 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:35:46.269241 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:35:46.269241 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 08:35:46.269241 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 08:35:46.269241 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 08:35:46.269241 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 08:35:46.270632 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 08:35:46.270632 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 08:35:46.270632 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 08:35:46.270632 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 08:35:46.270632 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:35:46.270632 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:35:46.270632 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:35:46.270632 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:35:46.270632 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:35:46.270632 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:35:46.270632 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:35:46.270632 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application with Lock( Jul 28 08:35:46.270632 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:35:46.270632 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:35:46.270632 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:35:46.270632 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:35:46.271718 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:35:46.271718 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:35:46.271718 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:35:46.271718 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:35:46.271718 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 08:35:46.271718 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 08:35:46.271718 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 08:35:46.271718 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 08:35:46.271718 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 08:35:46.271718 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 08:35:46.271718 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 08:35:46.271718 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application Jul 28 08:35:46.274142 dv-cinder-851351-1-smb devstack@keystone.service[282899]: [pid: 282899|app: 0|req: 16/31] 10.222.0.42 () {56 vars in 1096 bytes} [Thu Jul 28 08:35:46 2022] GET /identity/v3/roles/admin => generated 83 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:35:46.280109 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5842a29f-cbc9-4b4d-9b2d-cc00beea2060 None admin] Authenticating user token {{(pid=282899) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:35:46.323948 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG dbcounter [-] [282898] Writing DB stats keystone:SELECT=100 {{(pid=282898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:35:46.405328 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5842a29f-cbc9-4b4d-9b2d-cc00beea2060 None admin] Validating token access rules against request {{(pid=282899) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:35:46.408729 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5082a0-0ac1-4e96-b5a1-b4ab1e20bbaf None None] Validating token access rules against request {{(pid=282898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:35:46.451872 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd5a126-6d90-43a6-9f80-909c74713c2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282899) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:35:46.452565 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd5a126-6d90-43a6-9f80-909c74713c2c None admin] REQUEST_METHOD: `POST` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:35:46.453105 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd5a126-6d90-43a6-9f80-909c74713c2c None admin] SCRIPT_NAME: `/identity` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:35:46.453576 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd5a126-6d90-43a6-9f80-909c74713c2c None admin] PATH_INFO: `/v3/projects` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:35:46.454377 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd5a126-6d90-43a6-9f80-909c74713c2c None admin] RBAC: Authorizing `identity:create_project()` {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:35:46.455454 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c97cd18-40a3-4121-a2ab-5130e2b78de4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:35:46.456397 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd5a126-6d90-43a6-9f80-909c74713c2c None admin] RBAC: Authorization granted {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:35:46.456943 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c97cd18-40a3-4121-a2ab-5130e2b78de4 None admin] REQUEST_METHOD: `POST` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:35:46.457429 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c97cd18-40a3-4121-a2ab-5130e2b78de4 None admin] SCRIPT_NAME: `/identity` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:35:46.457966 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c97cd18-40a3-4121-a2ab-5130e2b78de4 None admin] PATH_INFO: `/v3/roles` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:35:46.458972 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c97cd18-40a3-4121-a2ab-5130e2b78de4 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:35:46.460611 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c97cd18-40a3-4121-a2ab-5130e2b78de4 None admin] RBAC: Authorization granted {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:35:46.594372 dv-cinder-851351-1-smb devstack@keystone.service[282898]: [pid: 282898|app: 0|req: 16/32] 10.222.0.42 () {60 vars in 1131 bytes} [Thu Jul 28 08:35:46 2022] POST /identity/v3/roles => generated 219 bytes in 432 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 08:35:46.600986 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc500e5-a384-4bf4-8f84-e900a5a0e6ed None None] REQUEST_METHOD: `POST` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:35:46.601537 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc500e5-a384-4bf4-8f84-e900a5a0e6ed None None] SCRIPT_NAME: `/identity` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:35:46.601982 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc500e5-a384-4bf4-8f84-e900a5a0e6ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:35:46.610595 dv-cinder-851351-1-smb devstack@keystone.service[282899]: [pid: 282899|app: 0|req: 17/33] 10.222.0.42 () {60 vars in 1141 bytes} [Thu Jul 28 08:35:46 2022] POST /identity/v3/projects => generated 301 bytes in 327 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 08:35:46.610595 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd5a126-6d90-43a6-9f80-909c74713c2c None admin] Authenticating user token {{(pid=282899) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:35:46.638840 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.auth.core [None req-4fc500e5-a384-4bf4-8f84-e900a5a0e6ed None None] MFA Rules not processed for user `2be990a66857410a87ffa7609aec4f7b`. Rule list: `[]` (Enabled: `True`). {{(pid=282898) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 08:35:46.641012 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.fernet_utils [None req-4fc500e5-a384-4bf4-8f84-e900a5a0e6ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=282898) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:35:46.665307 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG dbcounter [-] [282899] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=282899) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:35:46.730653 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd5a126-6d90-43a6-9f80-909c74713c2c None admin] Validating token access rules against request {{(pid=282899) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:35:46.754791 dv-cinder-851351-1-smb devstack@keystone.service[282898]: [pid: 282898|app: 0|req: 17/34] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 08:35:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 08:35:46.795776 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc71a196-0c90-4218-8c08-f983a30790cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282899) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:35:46.796784 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc71a196-0c90-4218-8c08-f983a30790cb None admin] REQUEST_METHOD: `GET` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:35:46.797252 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc71a196-0c90-4218-8c08-f983a30790cb None admin] SCRIPT_NAME: `/identity` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:35:46.797774 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc71a196-0c90-4218-8c08-f983a30790cb None admin] PATH_INFO: `/v3/roles` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:35:46.798736 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc71a196-0c90-4218-8c08-f983a30790cb None admin] RBAC: Adding query filter params (name=admin) {{(pid=282899) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:35:46.799237 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc71a196-0c90-4218-8c08-f983a30790cb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:35:46.801136 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc71a196-0c90-4218-8c08-f983a30790cb None admin] RBAC: Authorization granted {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:35:46.816804 dv-cinder-851351-1-smb devstack@keystone.service[282899]: [pid: 282899|app: 0|req: 18/35] 10.222.0.42 () {56 vars in 1099 bytes} [Thu Jul 28 08:35:46 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:35:46.823871 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc500e5-a384-4bf4-8f84-e900a5a0e6ed None None] Authenticating user token {{(pid=282898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:35:46.843350 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc71a196-0c90-4218-8c08-f983a30790cb None admin] Authenticating user token {{(pid=282899) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:35:46.858795 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG dbcounter [-] [282898] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=282898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:35:46.984528 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc500e5-a384-4bf4-8f84-e900a5a0e6ed None None] Validating token access rules against request {{(pid=282898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:35:46.993023 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc71a196-0c90-4218-8c08-f983a30790cb None admin] Validating token access rules against request {{(pid=282899) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:35:47.005227 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG dbcounter [-] [282899] Writing DB stats keystone:SELECT=100 {{(pid=282899) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:35:47.028653 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2afdbb5-56d1-4573-959f-82801028e812 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:35:47.029621 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2afdbb5-56d1-4573-959f-82801028e812 None admin] REQUEST_METHOD: `GET` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:35:47.029983 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2afdbb5-56d1-4573-959f-82801028e812 None admin] SCRIPT_NAME: `/identity` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:35:47.030264 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2afdbb5-56d1-4573-959f-82801028e812 None admin] PATH_INFO: `/v3/users/2be990a66857410a87ffa7609aec4f7b` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:35:47.031920 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2afdbb5-56d1-4573-959f-82801028e812 None admin] RBAC: Authorizing `identity:get_user(user_id=2be990a66857410a87ffa7609aec4f7b)` {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:35:47.033685 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2afdbb5-56d1-4573-959f-82801028e812 None admin] RBAC: Authorization granted {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:35:47.035682 dv-cinder-851351-1-smb devstack@keystone.service[282898]: [pid: 282898|app: 0|req: 18/36] 10.222.0.42 () {56 vars in 1177 bytes} [Thu Jul 28 08:35:46 2022] GET /identity/v3/users/2be990a66857410a87ffa7609aec4f7b => generated 247 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:35:47.040702 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e90d06f-e615-4d9a-9ea4-c8ed09f5b831 None None] REQUEST_METHOD: `GET` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:35:47.040702 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e90d06f-e615-4d9a-9ea4-c8ed09f5b831 None None] SCRIPT_NAME: `/identity` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:35:47.040702 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e90d06f-e615-4d9a-9ea4-c8ed09f5b831 None None] PATH_INFO: `/` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:35:47.040702 dv-cinder-851351-1-smb devstack@keystone.service[282898]: [pid: 282898|app: 0|req: 19/37] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 08:35:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 08:35:47.041134 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c6edf8-3ee4-4691-8026-712a7fc5cabd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282899) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:35:47.041134 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c6edf8-3ee4-4691-8026-712a7fc5cabd None admin] REQUEST_METHOD: `POST` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:35:47.041134 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c6edf8-3ee4-4691-8026-712a7fc5cabd None admin] SCRIPT_NAME: `/identity` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:35:47.041134 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c6edf8-3ee4-4691-8026-712a7fc5cabd None admin] PATH_INFO: `/v3/roles` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:35:47.041469 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27c6edf8-3ee4-4691-8026-712a7fc5cabd None admin] RBAC: Authorizing `identity:create_role()` {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:35:47.042762 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27c6edf8-3ee4-4691-8026-712a7fc5cabd None admin] RBAC: Authorization granted {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:35:47.045630 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e90d06f-e615-4d9a-9ea4-c8ed09f5b831 None None] Authenticating user token {{(pid=282898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:35:47.063660 dv-cinder-851351-1-smb devstack@keystone.service[282899]: [pid: 282899|app: 0|req: 19/38] 10.222.0.42 () {60 vars in 1131 bytes} [Thu Jul 28 08:35:46 2022] POST /identity/v3/roles => generated 225 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 08:35:47.063660 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff2ae0f-b569-4c7e-a3b3-e76514e62ba2 None None] REQUEST_METHOD: `POST` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:35:47.063660 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff2ae0f-b569-4c7e-a3b3-e76514e62ba2 None None] SCRIPT_NAME: `/identity` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:35:47.063660 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff2ae0f-b569-4c7e-a3b3-e76514e62ba2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:35:47.083345 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.auth.core [None req-eff2ae0f-b569-4c7e-a3b3-e76514e62ba2 None None] MFA Rules not processed for user `2be990a66857410a87ffa7609aec4f7b`. Rule list: `[]` (Enabled: `True`). {{(pid=282899) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 08:35:47.085053 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.fernet_utils [None req-eff2ae0f-b569-4c7e-a3b3-e76514e62ba2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=282899) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:35:47.160285 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG dbcounter [-] [282898] Writing DB stats keystone:SELECT=100 {{(pid=282898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:35:47.166098 dv-cinder-851351-1-smb devstack@keystone.service[282899]: [pid: 282899|app: 0|req: 20/39] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 08:35:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 08:35:47.180750 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e90d06f-e615-4d9a-9ea4-c8ed09f5b831 None None] Validating token access rules against request {{(pid=282898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:35:47.189785 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff2ae0f-b569-4c7e-a3b3-e76514e62ba2 None None] Authenticating user token {{(pid=282899) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:35:47.219921 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619b50c9-79b4-497d-9f5b-e1e161448a17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:35:47.220599 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619b50c9-79b4-497d-9f5b-e1e161448a17 None admin] REQUEST_METHOD: `GET` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:35:47.220917 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619b50c9-79b4-497d-9f5b-e1e161448a17 None admin] SCRIPT_NAME: `/identity` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:35:47.221193 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619b50c9-79b4-497d-9f5b-e1e161448a17 None admin] PATH_INFO: `/v3/domains/default` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:35:47.222446 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-619b50c9-79b4-497d-9f5b-e1e161448a17 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:35:47.224015 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-619b50c9-79b4-497d-9f5b-e1e161448a17 None admin] RBAC: Authorization granted {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:35:47.225976 dv-cinder-851351-1-smb devstack@keystone.service[282898]: [pid: 282898|app: 0|req: 20/40] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 08:35:47 2022] GET /identity/v3/domains/default => generated 199 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:35:47.227236 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b599665-08dc-4e49-96a2-b83d8b0eff9c None None] REQUEST_METHOD: `GET` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:35:47.227364 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b599665-08dc-4e49-96a2-b83d8b0eff9c None None] SCRIPT_NAME: `/identity` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:35:47.229192 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b599665-08dc-4e49-96a2-b83d8b0eff9c None None] PATH_INFO: `/` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:35:47.229192 dv-cinder-851351-1-smb devstack@keystone.service[282898]: [pid: 282898|app: 0|req: 21/41] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 08:35:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 08:35:47.234139 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b599665-08dc-4e49-96a2-b83d8b0eff9c None None] Authenticating user token {{(pid=282898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:35:47.306251 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG dbcounter [-] [282899] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=282899) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:35:47.311579 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff2ae0f-b569-4c7e-a3b3-e76514e62ba2 None None] Validating token access rules against request {{(pid=282899) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:35:47.348036 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a90ddbaa-7d7a-49be-b4c2-e81c1c8d70b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282899) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:35:47.348768 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90ddbaa-7d7a-49be-b4c2-e81c1c8d70b8 None admin] REQUEST_METHOD: `POST` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:35:47.349105 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90ddbaa-7d7a-49be-b4c2-e81c1c8d70b8 None admin] SCRIPT_NAME: `/identity` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:35:47.349424 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90ddbaa-7d7a-49be-b4c2-e81c1c8d70b8 None admin] PATH_INFO: `/v3/roles` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:35:47.350138 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a90ddbaa-7d7a-49be-b4c2-e81c1c8d70b8 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:35:47.351640 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a90ddbaa-7d7a-49be-b4c2-e81c1c8d70b8 None admin] RBAC: Authorization granted {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:35:47.354686 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b599665-08dc-4e49-96a2-b83d8b0eff9c None None] Validating token access rules against request {{(pid=282898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:35:47.366502 dv-cinder-851351-1-smb devstack@keystone.service[282899]: [pid: 282899|app: 0|req: 21/42] 10.222.0.42 () {60 vars in 1131 bytes} [Thu Jul 28 08:35:47 2022] POST /identity/v3/roles => generated 223 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 28 08:35:47.370519 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f297e7cf-7a12-462d-bf0a-428bc2d0e465 None None] REQUEST_METHOD: `POST` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:35:47.370879 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f297e7cf-7a12-462d-bf0a-428bc2d0e465 None None] SCRIPT_NAME: `/identity` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:35:47.371091 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f297e7cf-7a12-462d-bf0a-428bc2d0e465 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:35:47.390370 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.auth.core [None req-f297e7cf-7a12-462d-bf0a-428bc2d0e465 None None] MFA Rules not processed for user `2be990a66857410a87ffa7609aec4f7b`. Rule list: `[]` (Enabled: `True`). {{(pid=282899) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 08:35:47.391640 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.fernet_utils [None req-f297e7cf-7a12-462d-bf0a-428bc2d0e465 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=282899) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:35:47.395375 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd8b536-4440-47f3-87b4-c10d94fd5d3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:35:47.396105 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd8b536-4440-47f3-87b4-c10d94fd5d3e None admin] REQUEST_METHOD: `PUT` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:35:47.396404 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd8b536-4440-47f3-87b4-c10d94fd5d3e None admin] SCRIPT_NAME: `/identity` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:35:47.396714 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd8b536-4440-47f3-87b4-c10d94fd5d3e None admin] PATH_INFO: `/v3/domains/default/users/2be990a66857410a87ffa7609aec4f7b/roles/a0e2a00bf94d40f38629d6b5293e3aee` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:35:47.398866 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acd8b536-4440-47f3-87b4-c10d94fd5d3e None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=2be990a66857410a87ffa7609aec4f7b, role_id=a0e2a00bf94d40f38629d6b5293e3aee)` {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:35:47.400426 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acd8b536-4440-47f3-87b4-c10d94fd5d3e None admin] RBAC: Authorization granted {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:35:47.418271 dv-cinder-851351-1-smb devstack@keystone.service[282898]: [pid: 282898|app: 0|req: 22/43] 10.222.0.42 () {58 vars in 1361 bytes} [Thu Jul 28 08:35:47 2022] PUT /identity/v3/domains/default/users/2be990a66857410a87ffa7609aec4f7b/roles/a0e2a00bf94d40f38629d6b5293e3aee => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 08:35:47.478958 dv-cinder-851351-1-smb devstack@keystone.service[282899]: [pid: 282899|app: 0|req: 22/44] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 08:35:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 08:35:47.503444 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd8b536-4440-47f3-87b4-c10d94fd5d3e None admin] Authenticating user token {{(pid=282898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:35:47.525004 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG dbcounter [-] [282898] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=282898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:35:47.630139 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd8b536-4440-47f3-87b4-c10d94fd5d3e None admin] Validating token access rules against request {{(pid=282898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:35:47.665976 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f246983-6d41-44d3-905d-81c6c7120b09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:35:47.666644 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f246983-6d41-44d3-905d-81c6c7120b09 None admin] REQUEST_METHOD: `GET` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:35:47.666934 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f246983-6d41-44d3-905d-81c6c7120b09 None admin] SCRIPT_NAME: `/identity` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:35:47.667214 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f246983-6d41-44d3-905d-81c6c7120b09 None admin] PATH_INFO: `/v3/domains/default` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:35:47.668481 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f246983-6d41-44d3-905d-81c6c7120b09 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:35:47.669939 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f246983-6d41-44d3-905d-81c6c7120b09 None admin] RBAC: Authorization granted {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:35:47.671553 dv-cinder-851351-1-smb devstack@keystone.service[282898]: [pid: 282898|app: 0|req: 23/45] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 08:35:47 2022] GET /identity/v3/domains/default => generated 199 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:35:47.677720 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f297e7cf-7a12-462d-bf0a-428bc2d0e465 None None] Authenticating user token {{(pid=282899) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:35:47.770677 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG dbcounter [-] [282899] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=282899) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:35:47.784284 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f297e7cf-7a12-462d-bf0a-428bc2d0e465 None None] Validating token access rules against request {{(pid=282899) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:35:47.826802 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fde2cc8-47da-491e-89e6-d8e279cadfb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282899) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:35:47.827455 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fde2cc8-47da-491e-89e6-d8e279cadfb0 None admin] REQUEST_METHOD: `POST` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:35:47.827745 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fde2cc8-47da-491e-89e6-d8e279cadfb0 None admin] SCRIPT_NAME: `/identity` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:35:47.828020 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fde2cc8-47da-491e-89e6-d8e279cadfb0 None admin] PATH_INFO: `/v3/projects` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:35:47.828718 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fde2cc8-47da-491e-89e6-d8e279cadfb0 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:35:47.830632 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fde2cc8-47da-491e-89e6-d8e279cadfb0 None admin] RBAC: Authorization granted {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:35:47.858398 dv-cinder-851351-1-smb devstack@keystone.service[282899]: [pid: 282899|app: 0|req: 23/46] 10.222.0.42 () {60 vars in 1141 bytes} [Thu Jul 28 08:35:47 2022] POST /identity/v3/projects => generated 312 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 08:35:49.473783 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540c3c86-b104-41e8-adfc-8115186fbf3f None None] REQUEST_METHOD: `GET` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:35:49.474418 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540c3c86-b104-41e8-adfc-8115186fbf3f None None] SCRIPT_NAME: `/identity` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:35:49.474418 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540c3c86-b104-41e8-adfc-8115186fbf3f None None] PATH_INFO: `/` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:35:49.475699 dv-cinder-851351-1-smb devstack@keystone.service[282898]: [pid: 282898|app: 0|req: 24/47] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 08:35:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 08:35:49.481113 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e467a1dc-ef51-4e10-a2b7-3e13f836adcf None None] REQUEST_METHOD: `POST` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:35:49.481589 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e467a1dc-ef51-4e10-a2b7-3e13f836adcf None None] SCRIPT_NAME: `/identity` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:35:49.481713 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e467a1dc-ef51-4e10-a2b7-3e13f836adcf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:35:49.501263 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.auth.core [None req-e467a1dc-ef51-4e10-a2b7-3e13f836adcf None None] MFA Rules not processed for user `2be990a66857410a87ffa7609aec4f7b`. Rule list: `[]` (Enabled: `True`). {{(pid=282899) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 08:35:49.502676 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.fernet_utils [None req-e467a1dc-ef51-4e10-a2b7-3e13f836adcf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=282899) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:35:49.573085 dv-cinder-851351-1-smb devstack@keystone.service[282899]: [pid: 282899|app: 0|req: 24/48] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 08:35:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 08:35:49.596180 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540c3c86-b104-41e8-adfc-8115186fbf3f None None] Authenticating user token {{(pid=282898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:35:49.688172 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG dbcounter [-] [282898] Writing DB stats keystone:SELECT=100 {{(pid=282898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:35:49.708717 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540c3c86-b104-41e8-adfc-8115186fbf3f None None] Validating token access rules against request {{(pid=282898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:35:49.744270 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e9829fe-ad8e-48f6-a2a1-29f4c0189343 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:35:49.744863 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9829fe-ad8e-48f6-a2a1-29f4c0189343 None admin] REQUEST_METHOD: `GET` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:35:49.745150 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9829fe-ad8e-48f6-a2a1-29f4c0189343 None admin] SCRIPT_NAME: `/identity` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:35:49.745424 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9829fe-ad8e-48f6-a2a1-29f4c0189343 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:35:49.757928 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e9829fe-ad8e-48f6-a2a1-29f4c0189343 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 08:35:49.764072 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application [None req-2e9829fe-ad8e-48f6-a2a1-29f4c0189343 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 08:35:49.764072 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:35:49.764072 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:35:49.764072 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:35:49.764072 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:35:49.764072 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:35:49.764072 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:35:49.764072 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:35:49.764072 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:35:49.764072 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:35:49.764072 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:35:49.764072 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:35:49.764072 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 08:35:49.764072 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 08:35:49.764072 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 08:35:49.764072 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 08:35:49.765208 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 08:35:49.765208 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 08:35:49.765208 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 08:35:49.765208 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 08:35:49.765208 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:35:49.765208 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:35:49.765208 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:35:49.765208 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:35:49.765208 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:35:49.765208 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:35:49.765208 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:35:49.765208 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application with Lock( Jul 28 08:35:49.765208 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:35:49.765208 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:35:49.765208 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:35:49.765208 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:35:49.766135 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:35:49.766135 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:35:49.766135 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:35:49.766135 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:35:49.766135 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 08:35:49.766135 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 08:35:49.766135 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 08:35:49.766135 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 08:35:49.766135 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 08:35:49.766135 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 08:35:49.766135 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 08:35:49.766135 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application Jul 28 08:35:49.766135 dv-cinder-851351-1-smb devstack@keystone.service[282898]: [pid: 282898|app: 0|req: 25/49] 10.222.0.42 () {56 vars in 1096 bytes} [Thu Jul 28 08:35:49 2022] GET /identity/v3/roles/admin => generated 83 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:35:49.773510 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e467a1dc-ef51-4e10-a2b7-3e13f836adcf None None] Authenticating user token {{(pid=282899) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:35:49.848301 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG dbcounter [-] [282899] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=282899) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:35:49.877956 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad5dac2-244e-49e7-a3fe-dcbc7593f705 None None] REQUEST_METHOD: `GET` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:35:49.878249 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad5dac2-244e-49e7-a3fe-dcbc7593f705 None None] SCRIPT_NAME: `/identity` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:35:49.878522 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad5dac2-244e-49e7-a3fe-dcbc7593f705 None None] PATH_INFO: `/` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:35:49.879980 dv-cinder-851351-1-smb devstack@keystone.service[282898]: [pid: 282898|app: 0|req: 26/50] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 08:35:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 28 08:35:49.883338 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e467a1dc-ef51-4e10-a2b7-3e13f836adcf None None] Validating token access rules against request {{(pid=282899) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:35:49.885264 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8f00d7-a256-4636-8448-8e02c8bd87ab None None] REQUEST_METHOD: `POST` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:35:49.886335 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8f00d7-a256-4636-8448-8e02c8bd87ab None None] SCRIPT_NAME: `/identity` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:35:49.886637 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8f00d7-a256-4636-8448-8e02c8bd87ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:35:49.905240 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.auth.core [None req-fd8f00d7-a256-4636-8448-8e02c8bd87ab None None] MFA Rules not processed for user `2be990a66857410a87ffa7609aec4f7b`. Rule list: `[]` (Enabled: `True`). {{(pid=282898) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 08:35:49.906487 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.fernet_utils [None req-fd8f00d7-a256-4636-8448-8e02c8bd87ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=282898) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:35:49.917805 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3de6a65-de02-4305-b635-5d97ec9f99ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282899) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:35:49.918460 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3de6a65-de02-4305-b635-5d97ec9f99ba None admin] REQUEST_METHOD: `GET` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:35:49.918752 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3de6a65-de02-4305-b635-5d97ec9f99ba None admin] SCRIPT_NAME: `/identity` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:35:49.919036 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3de6a65-de02-4305-b635-5d97ec9f99ba None admin] PATH_INFO: `/v3/roles` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:35:49.919790 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3de6a65-de02-4305-b635-5d97ec9f99ba None admin] RBAC: Adding query filter params (name=admin) {{(pid=282899) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:35:49.920107 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3de6a65-de02-4305-b635-5d97ec9f99ba None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:35:49.921551 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3de6a65-de02-4305-b635-5d97ec9f99ba None admin] RBAC: Authorization granted {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:35:49.929957 dv-cinder-851351-1-smb devstack@keystone.service[282899]: [pid: 282899|app: 0|req: 25/51] 10.222.0.42 () {56 vars in 1099 bytes} [Thu Jul 28 08:35:49 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:35:49.935724 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3de6a65-de02-4305-b635-5d97ec9f99ba None admin] Authenticating user token {{(pid=282899) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:35:49.975285 dv-cinder-851351-1-smb devstack@keystone.service[282898]: [pid: 282898|app: 0|req: 27/52] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 08:35:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 28 08:35:49.998851 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8f00d7-a256-4636-8448-8e02c8bd87ab None None] Authenticating user token {{(pid=282898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:35:50.039042 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3de6a65-de02-4305-b635-5d97ec9f99ba None admin] Validating token access rules against request {{(pid=282899) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:35:50.069121 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG dbcounter [-] [282899] Writing DB stats keystone:SELECT=100 {{(pid=282899) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:35:50.074339 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG dbcounter [-] [282898] Writing DB stats keystone:SELECT=100 {{(pid=282898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:35:50.074574 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45dd3b98-2ac1-4fc7-9d56-b73efe26a933 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282899) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:35:50.075272 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45dd3b98-2ac1-4fc7-9d56-b73efe26a933 None admin] REQUEST_METHOD: `GET` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:35:50.075533 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45dd3b98-2ac1-4fc7-9d56-b73efe26a933 None admin] SCRIPT_NAME: `/identity` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:35:50.075824 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45dd3b98-2ac1-4fc7-9d56-b73efe26a933 None admin] PATH_INFO: `/v3/users/2be990a66857410a87ffa7609aec4f7b` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:35:50.077315 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45dd3b98-2ac1-4fc7-9d56-b73efe26a933 None admin] RBAC: Authorizing `identity:get_user(user_id=2be990a66857410a87ffa7609aec4f7b)` {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:35:50.078777 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45dd3b98-2ac1-4fc7-9d56-b73efe26a933 None admin] RBAC: Authorization granted {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:35:50.080814 dv-cinder-851351-1-smb devstack@keystone.service[282899]: [pid: 282899|app: 0|req: 26/53] 10.222.0.42 () {56 vars in 1177 bytes} [Thu Jul 28 08:35:49 2022] GET /identity/v3/users/2be990a66857410a87ffa7609aec4f7b => generated 247 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 08:35:50.086475 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45dd3b98-2ac1-4fc7-9d56-b73efe26a933 None admin] Authenticating user token {{(pid=282899) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:35:50.105234 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8f00d7-a256-4636-8448-8e02c8bd87ab None None] Validating token access rules against request {{(pid=282898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:35:50.141746 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6422f38-ff33-4e1c-85a3-6c467113fc40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:35:50.142411 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6422f38-ff33-4e1c-85a3-6c467113fc40 None admin] REQUEST_METHOD: `GET` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:35:50.142700 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6422f38-ff33-4e1c-85a3-6c467113fc40 None admin] SCRIPT_NAME: `/identity` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:35:50.142983 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6422f38-ff33-4e1c-85a3-6c467113fc40 None admin] PATH_INFO: `/v3/domains/default` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:35:50.144153 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6422f38-ff33-4e1c-85a3-6c467113fc40 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:35:50.145711 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6422f38-ff33-4e1c-85a3-6c467113fc40 None admin] RBAC: Authorization granted {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:35:50.147357 dv-cinder-851351-1-smb devstack@keystone.service[282898]: [pid: 282898|app: 0|req: 28/54] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 08:35:49 2022] GET /identity/v3/domains/default => generated 199 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:35:50.153119 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6422f38-ff33-4e1c-85a3-6c467113fc40 None admin] Authenticating user token {{(pid=282898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:35:50.188295 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45dd3b98-2ac1-4fc7-9d56-b73efe26a933 None admin] Validating token access rules against request {{(pid=282899) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:35:50.223102 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27318d6d-67ac-477a-9763-fc21ae9948ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282899) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:35:50.223802 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27318d6d-67ac-477a-9763-fc21ae9948ba None admin] REQUEST_METHOD: `GET` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:35:50.224086 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27318d6d-67ac-477a-9763-fc21ae9948ba None admin] SCRIPT_NAME: `/identity` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:35:50.224374 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27318d6d-67ac-477a-9763-fc21ae9948ba None admin] PATH_INFO: `/v3/domains/default` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:35:50.225731 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27318d6d-67ac-477a-9763-fc21ae9948ba None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:35:50.227226 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27318d6d-67ac-477a-9763-fc21ae9948ba None admin] RBAC: Authorization granted {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:35:50.228907 dv-cinder-851351-1-smb devstack@keystone.service[282899]: [pid: 282899|app: 0|req: 27/55] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 08:35:50 2022] GET /identity/v3/domains/default => generated 199 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 08:35:50.234774 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27318d6d-67ac-477a-9763-fc21ae9948ba None admin] Authenticating user token {{(pid=282899) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:35:50.257041 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6422f38-ff33-4e1c-85a3-6c467113fc40 None admin] Validating token access rules against request {{(pid=282898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:35:50.294215 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee77b19-8aff-483c-915f-6e1e0fb554cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:35:50.294864 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee77b19-8aff-483c-915f-6e1e0fb554cf None admin] REQUEST_METHOD: `POST` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:35:50.295152 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee77b19-8aff-483c-915f-6e1e0fb554cf None admin] SCRIPT_NAME: `/identity` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:35:50.295440 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee77b19-8aff-483c-915f-6e1e0fb554cf None admin] PATH_INFO: `/v3/projects` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:35:50.296159 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bee77b19-8aff-483c-915f-6e1e0fb554cf None admin] RBAC: Authorizing `identity:create_project()` {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:35:50.297700 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bee77b19-8aff-483c-915f-6e1e0fb554cf None admin] RBAC: Authorization granted {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:35:50.305207 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG dbcounter [-] [282899] Writing DB stats keystone:SELECT=100 {{(pid=282899) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:35:50.310263 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG dbcounter [-] [282898] Writing DB stats keystone:SELECT=100 {{(pid=282898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:35:50.330210 dv-cinder-851351-1-smb devstack@keystone.service[282898]: [pid: 282898|app: 0|req: 29/56] 10.222.0.42 () {60 vars in 1140 bytes} [Thu Jul 28 08:35:50 2022] POST /identity/v3/projects => generated 298 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 28 08:35:50.345327 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27318d6d-67ac-477a-9763-fc21ae9948ba None admin] Validating token access rules against request {{(pid=282899) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:35:50.386245 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f38ad6-91d3-479b-8f9f-5b956bb85957 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282899) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:35:50.386908 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f38ad6-91d3-479b-8f9f-5b956bb85957 None admin] REQUEST_METHOD: `GET` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:35:50.387195 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f38ad6-91d3-479b-8f9f-5b956bb85957 None admin] SCRIPT_NAME: `/identity` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:35:50.387477 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f38ad6-91d3-479b-8f9f-5b956bb85957 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:35:50.388325 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7f38ad6-91d3-479b-8f9f-5b956bb85957 None admin] RBAC: Adding query filter params (role.id=a0e2a00bf94d40f38629d6b5293e3aee, scope.domain.id=default, user.id=2be990a66857410a87ffa7609aec4f7b) {{(pid=282899) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:35:50.388640 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7f38ad6-91d3-479b-8f9f-5b956bb85957 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:35:50.390210 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7f38ad6-91d3-479b-8f9f-5b956bb85957 None admin] RBAC: Authorization granted {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:35:50.397172 dv-cinder-851351-1-smb devstack@keystone.service[282899]: [pid: 282899|app: 0|req: 28/57] 10.222.0.42 () {56 vars in 1322 bytes} [Thu Jul 28 08:35:50 2022] GET /identity/v3/role_assignments?user.id=2be990a66857410a87ffa7609aec4f7b&scope.domain.id=default&role.id=a0e2a00bf94d40f38629d6b5293e3aee => generated 530 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 08:35:52.376563 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d3efc9-913f-49f8-ace7-3ccda2388693 None None] REQUEST_METHOD: `GET` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:35:52.377175 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d3efc9-913f-49f8-ace7-3ccda2388693 None None] SCRIPT_NAME: `/identity` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:35:52.377175 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d3efc9-913f-49f8-ace7-3ccda2388693 None None] PATH_INFO: `/` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:35:52.378533 dv-cinder-851351-1-smb devstack@keystone.service[282898]: [pid: 282898|app: 0|req: 30/58] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 08:35:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 08:35:52.384260 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2e9435-4c4e-49ec-a1ac-3496342cad8f None None] REQUEST_METHOD: `POST` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:35:52.384738 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2e9435-4c4e-49ec-a1ac-3496342cad8f None None] SCRIPT_NAME: `/identity` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:35:52.384855 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2e9435-4c4e-49ec-a1ac-3496342cad8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:35:52.404014 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.auth.core [None req-2b2e9435-4c4e-49ec-a1ac-3496342cad8f None None] MFA Rules not processed for user `2be990a66857410a87ffa7609aec4f7b`. Rule list: `[]` (Enabled: `True`). {{(pid=282899) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 08:35:52.405285 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.fernet_utils [None req-2b2e9435-4c4e-49ec-a1ac-3496342cad8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=282899) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:35:52.483511 dv-cinder-851351-1-smb devstack@keystone.service[282899]: [pid: 282899|app: 0|req: 29/59] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 08:35:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 08:35:52.508748 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d3efc9-913f-49f8-ace7-3ccda2388693 None None] Authenticating user token {{(pid=282898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:35:52.634515 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d3efc9-913f-49f8-ace7-3ccda2388693 None None] Validating token access rules against request {{(pid=282898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:35:52.671911 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8fda6a8-ad05-447a-8faa-45c042d4a16a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:35:52.672564 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8fda6a8-ad05-447a-8faa-45c042d4a16a None admin] REQUEST_METHOD: `GET` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:35:52.672880 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8fda6a8-ad05-447a-8faa-45c042d4a16a None admin] SCRIPT_NAME: `/identity` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:35:52.673162 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8fda6a8-ad05-447a-8faa-45c042d4a16a None admin] PATH_INFO: `/v3/domains/default` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:35:52.674414 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8fda6a8-ad05-447a-8faa-45c042d4a16a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:35:52.675905 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8fda6a8-ad05-447a-8faa-45c042d4a16a None admin] RBAC: Authorization granted {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:35:52.677639 dv-cinder-851351-1-smb devstack@keystone.service[282898]: [pid: 282898|app: 0|req: 31/60] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 08:35:52 2022] GET /identity/v3/domains/default => generated 199 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:35:52.684381 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2e9435-4c4e-49ec-a1ac-3496342cad8f None None] Authenticating user token {{(pid=282899) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:35:52.755630 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG dbcounter [-] [282899] Writing DB stats keystone:SELECT=100 {{(pid=282899) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:35:52.796206 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2e9435-4c4e-49ec-a1ac-3496342cad8f None None] Validating token access rules against request {{(pid=282899) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:35:52.834283 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a09ca50e-a071-40c2-91c4-eb353508528a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282899) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:35:52.834927 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09ca50e-a071-40c2-91c4-eb353508528a None admin] REQUEST_METHOD: `POST` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:35:52.835213 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09ca50e-a071-40c2-91c4-eb353508528a None admin] SCRIPT_NAME: `/identity` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:35:52.835488 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09ca50e-a071-40c2-91c4-eb353508528a None admin] PATH_INFO: `/v3/users` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:35:52.836184 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a09ca50e-a071-40c2-91c4-eb353508528a None admin] RBAC: Authorizing `identity:create_user()` {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:35:52.837687 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a09ca50e-a071-40c2-91c4-eb353508528a None admin] RBAC: Authorization granted {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:35:52.866694 dv-cinder-851351-1-smb devstack@keystone.service[282899]: [pid: 282899|app: 0|req: 30/61] 10.222.0.42 () {60 vars in 1132 bytes} [Thu Jul 28 08:35:52 2022] POST /identity/v3/users => generated 275 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 08:35:56.230562 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8ee856-d72e-4ac2-b752-c75de44af475 None None] REQUEST_METHOD: `GET` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:35:56.231708 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8ee856-d72e-4ac2-b752-c75de44af475 None None] SCRIPT_NAME: `/identity` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:35:56.232213 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8ee856-d72e-4ac2-b752-c75de44af475 None None] PATH_INFO: `/` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:35:56.233860 dv-cinder-851351-1-smb devstack@keystone.service[282898]: [pid: 282898|app: 0|req: 32/62] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 08:35:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 08:35:56.239512 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49783066-69be-45d3-b215-4f09e93eeb82 None None] REQUEST_METHOD: `POST` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:35:56.240407 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49783066-69be-45d3-b215-4f09e93eeb82 None None] SCRIPT_NAME: `/identity` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:35:56.240952 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49783066-69be-45d3-b215-4f09e93eeb82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:35:56.264710 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.auth.core [None req-49783066-69be-45d3-b215-4f09e93eeb82 None None] MFA Rules not processed for user `2be990a66857410a87ffa7609aec4f7b`. Rule list: `[]` (Enabled: `True`). {{(pid=282899) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 08:35:56.266297 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.fernet_utils [None req-49783066-69be-45d3-b215-4f09e93eeb82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=282899) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:35:56.367331 dv-cinder-851351-1-smb devstack@keystone.service[282899]: [pid: 282899|app: 0|req: 31/63] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 08:35:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 08:35:56.397361 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8ee856-d72e-4ac2-b752-c75de44af475 None None] Authenticating user token {{(pid=282898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:35:56.491965 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG dbcounter [-] [282898] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=282898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:35:56.557729 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8ee856-d72e-4ac2-b752-c75de44af475 None None] Validating token access rules against request {{(pid=282898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:35:56.604509 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e311e0ab-a42a-4c4d-a90c-484011b230d4 None None] REQUEST_METHOD: `GET` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:35:56.604894 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e311e0ab-a42a-4c4d-a90c-484011b230d4 None None] SCRIPT_NAME: `/identity` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:35:56.605133 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e311e0ab-a42a-4c4d-a90c-484011b230d4 None None] PATH_INFO: `/` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:35:56.606652 dv-cinder-851351-1-smb devstack@keystone.service[282899]: [pid: 282899|app: 0|req: 32/64] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 08:35:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 28 08:35:56.607073 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e200d026-25fa-4e72-b90a-d0ca51546219 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:35:56.607745 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e200d026-25fa-4e72-b90a-d0ca51546219 None admin] REQUEST_METHOD: `GET` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:35:56.608039 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e200d026-25fa-4e72-b90a-d0ca51546219 None admin] SCRIPT_NAME: `/identity` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:35:56.608322 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e200d026-25fa-4e72-b90a-d0ca51546219 None admin] PATH_INFO: `/v3/roles/member` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:35:56.611773 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f9449a-9776-460a-b143-159442259152 None None] REQUEST_METHOD: `POST` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:35:56.612388 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f9449a-9776-460a-b143-159442259152 None None] SCRIPT_NAME: `/identity` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:35:56.612943 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f9449a-9776-460a-b143-159442259152 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:35:56.624686 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e200d026-25fa-4e72-b90a-d0ca51546219 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 08:35:56.627413 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application [None req-e200d026-25fa-4e72-b90a-d0ca51546219 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 28 08:35:56.627413 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:35:56.627413 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:35:56.627413 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:35:56.627413 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:35:56.627413 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:35:56.627413 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:35:56.627413 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:35:56.627413 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:35:56.627413 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:35:56.627413 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:35:56.627413 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:35:56.627413 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 08:35:56.627413 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 08:35:56.627413 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 08:35:56.627413 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 08:35:56.628437 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 08:35:56.628437 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 08:35:56.628437 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 08:35:56.628437 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 08:35:56.628437 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:35:56.628437 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:35:56.628437 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:35:56.628437 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:35:56.628437 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:35:56.628437 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:35:56.628437 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:35:56.628437 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application with Lock( Jul 28 08:35:56.628437 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:35:56.628437 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:35:56.628437 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:35:56.628437 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:35:56.629504 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:35:56.629504 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:35:56.629504 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:35:56.629504 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:35:56.629504 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 08:35:56.629504 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 08:35:56.629504 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 08:35:56.629504 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 08:35:56.629504 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 08:35:56.629504 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 08:35:56.629504 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 28 08:35:56.629504 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application Jul 28 08:35:56.629504 dv-cinder-851351-1-smb devstack@keystone.service[282898]: [pid: 282898|app: 0|req: 33/65] 10.222.0.42 () {56 vars in 1099 bytes} [Thu Jul 28 08:35:56 2022] GET /identity/v3/roles/member => generated 84 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:35:56.637037 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e200d026-25fa-4e72-b90a-d0ca51546219 None admin] Authenticating user token {{(pid=282898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:35:56.656366 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.auth.core [None req-e5f9449a-9776-460a-b143-159442259152 None None] MFA Rules not processed for user `2be990a66857410a87ffa7609aec4f7b`. Rule list: `[]` (Enabled: `True`). {{(pid=282899) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 08:35:56.658621 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.fernet_utils [None req-e5f9449a-9776-460a-b143-159442259152 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=282899) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:35:56.721729 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG dbcounter [-] [282899] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=282899) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:35:56.760051 dv-cinder-851351-1-smb devstack@keystone.service[282899]: [pid: 282899|app: 0|req: 33/66] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 08:35:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 28 08:35:56.761455 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93977f41-32cc-4621-af3e-70109343c216 None None] REQUEST_METHOD: `GET` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:35:56.761809 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93977f41-32cc-4621-af3e-70109343c216 None None] SCRIPT_NAME: `/identity` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:35:56.762149 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93977f41-32cc-4621-af3e-70109343c216 None None] PATH_INFO: `/` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:35:56.763777 dv-cinder-851351-1-smb devstack@keystone.service[282899]: [pid: 282899|app: 0|req: 34/67] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 08:35:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 08:35:56.769501 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f4976e-9f6c-4b2b-9471-ca9a14801417 None None] REQUEST_METHOD: `POST` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:35:56.769795 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f4976e-9f6c-4b2b-9471-ca9a14801417 None None] SCRIPT_NAME: `/identity` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:35:56.770110 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f4976e-9f6c-4b2b-9471-ca9a14801417 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:35:56.772083 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e200d026-25fa-4e72-b90a-d0ca51546219 None admin] Validating token access rules against request {{(pid=282898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:35:56.791870 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.auth.core [None req-92f4976e-9f6c-4b2b-9471-ca9a14801417 None None] MFA Rules not processed for user `2be990a66857410a87ffa7609aec4f7b`. Rule list: `[]` (Enabled: `True`). {{(pid=282899) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 08:35:56.793184 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.fernet_utils [None req-92f4976e-9f6c-4b2b-9471-ca9a14801417 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=282899) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:35:56.820604 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG dbcounter [-] [282898] Writing DB stats keystone:SELECT=100 {{(pid=282898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:35:56.838445 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f219cbb6-6fa8-4376-909f-fbcbb42ee892 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:35:56.839222 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f219cbb6-6fa8-4376-909f-fbcbb42ee892 None admin] REQUEST_METHOD: `GET` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:35:56.839420 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f219cbb6-6fa8-4376-909f-fbcbb42ee892 None admin] SCRIPT_NAME: `/identity` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:35:56.839703 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f219cbb6-6fa8-4376-909f-fbcbb42ee892 None admin] PATH_INFO: `/v3/roles` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:35:56.840464 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f219cbb6-6fa8-4376-909f-fbcbb42ee892 None admin] RBAC: Adding query filter params (name=member) {{(pid=282898) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:35:56.840813 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f219cbb6-6fa8-4376-909f-fbcbb42ee892 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:35:56.842429 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f219cbb6-6fa8-4376-909f-fbcbb42ee892 None admin] RBAC: Authorization granted {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:35:56.856324 dv-cinder-851351-1-smb devstack@keystone.service[282898]: [pid: 282898|app: 0|req: 34/68] 10.222.0.42 () {56 vars in 1101 bytes} [Thu Jul 28 08:35:56 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 08:35:56.857295 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f219cbb6-6fa8-4376-909f-fbcbb42ee892 None admin] Authenticating user token {{(pid=282898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:35:56.891747 dv-cinder-851351-1-smb devstack@keystone.service[282899]: [pid: 282899|app: 0|req: 35/69] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 08:35:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 08:35:56.898003 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f4976e-9f6c-4b2b-9471-ca9a14801417 None None] Authenticating user token {{(pid=282899) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:35:56.985211 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f219cbb6-6fa8-4376-909f-fbcbb42ee892 None admin] Validating token access rules against request {{(pid=282898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:35:57.023582 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01fe79d7-b192-42e6-b34e-709f6e6ab170 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:35:57.024158 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01fe79d7-b192-42e6-b34e-709f6e6ab170 None admin] REQUEST_METHOD: `GET` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:35:57.024447 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01fe79d7-b192-42e6-b34e-709f6e6ab170 None admin] SCRIPT_NAME: `/identity` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:35:57.024768 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01fe79d7-b192-42e6-b34e-709f6e6ab170 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:35:57.036980 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01fe79d7-b192-42e6-b34e-709f6e6ab170 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 08:35:57.041180 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f4976e-9f6c-4b2b-9471-ca9a14801417 None None] Validating token access rules against request {{(pid=282899) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:35:57.042356 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application [None req-01fe79d7-b192-42e6-b34e-709f6e6ab170 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 08:35:57.042356 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:35:57.042356 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:35:57.042356 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:35:57.042356 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:35:57.042356 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:35:57.042356 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:35:57.042356 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:35:57.042356 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:35:57.042356 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:35:57.042356 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:35:57.042356 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:35:57.042356 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 08:35:57.042356 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 08:35:57.042356 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 08:35:57.042356 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 08:35:57.043421 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 08:35:57.043421 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 08:35:57.043421 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 08:35:57.043421 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 08:35:57.043421 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:35:57.043421 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:35:57.043421 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:35:57.043421 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:35:57.043421 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:35:57.043421 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:35:57.043421 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:35:57.043421 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application with Lock( Jul 28 08:35:57.043421 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:35:57.043421 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:35:57.043421 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:35:57.043421 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:35:57.044383 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:35:57.044383 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:35:57.044383 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:35:57.044383 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:35:57.044383 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 08:35:57.044383 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 08:35:57.044383 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 08:35:57.044383 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 08:35:57.044383 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 08:35:57.044383 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 08:35:57.044383 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 08:35:57.044383 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application Jul 28 08:35:57.044383 dv-cinder-851351-1-smb devstack@keystone.service[282898]: [pid: 282898|app: 0|req: 35/70] 10.222.0.42 () {56 vars in 1096 bytes} [Thu Jul 28 08:35:56 2022] GET /identity/v3/roles/admin => generated 83 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:35:57.045201 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01fe79d7-b192-42e6-b34e-709f6e6ab170 None admin] Authenticating user token {{(pid=282898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:35:57.057035 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG dbcounter [-] [282899] Writing DB stats keystone:SELECT=100 {{(pid=282899) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:35:57.092109 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea9b6ef-6630-464a-848e-edf7da66e052 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282899) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:35:57.093200 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea9b6ef-6630-464a-848e-edf7da66e052 None admin] REQUEST_METHOD: `GET` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:35:57.093735 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea9b6ef-6630-464a-848e-edf7da66e052 None admin] SCRIPT_NAME: `/identity` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:35:57.094233 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea9b6ef-6630-464a-848e-edf7da66e052 None admin] PATH_INFO: `/v3/users/ff1f8d5551c44d2781c7ed09cd18be32` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:35:57.101010 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG dbcounter [-] [282898] Writing DB stats keystone:SELECT=100 {{(pid=282898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:35:57.112735 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ea9b6ef-6630-464a-848e-edf7da66e052 None admin] RBAC: Authorizing `identity:get_user(user_id=ff1f8d5551c44d2781c7ed09cd18be32)` {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:35:57.114333 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ea9b6ef-6630-464a-848e-edf7da66e052 None admin] RBAC: Authorization granted {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:35:57.116292 dv-cinder-851351-1-smb devstack@keystone.service[282899]: [pid: 282899|app: 0|req: 36/71] 10.222.0.42 () {56 vars in 1177 bytes} [Thu Jul 28 08:35:56 2022] GET /identity/v3/users/ff1f8d5551c44d2781c7ed09cd18be32 => generated 275 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:35:57.117142 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea9b6ef-6630-464a-848e-edf7da66e052 None admin] Authenticating user token {{(pid=282899) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:35:57.176127 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01fe79d7-b192-42e6-b34e-709f6e6ab170 None admin] Validating token access rules against request {{(pid=282898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:35:57.211424 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e701a3fb-3a25-4e26-84ba-368e4654ccc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:35:57.212084 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e701a3fb-3a25-4e26-84ba-368e4654ccc8 None admin] REQUEST_METHOD: `GET` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:35:57.212371 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e701a3fb-3a25-4e26-84ba-368e4654ccc8 None admin] SCRIPT_NAME: `/identity` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:35:57.212655 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e701a3fb-3a25-4e26-84ba-368e4654ccc8 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:35:57.220605 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea9b6ef-6630-464a-848e-edf7da66e052 None admin] Validating token access rules against request {{(pid=282899) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:35:57.223092 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e701a3fb-3a25-4e26-84ba-368e4654ccc8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 08:35:57.228161 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application [None req-e701a3fb-3a25-4e26-84ba-368e4654ccc8 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 28 08:35:57.228161 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:35:57.228161 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:35:57.228161 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:35:57.228161 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:35:57.228161 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:35:57.228161 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:35:57.228161 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:35:57.228161 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:35:57.228161 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:35:57.228161 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:35:57.228161 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:35:57.228161 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 08:35:57.228161 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 08:35:57.228161 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 08:35:57.228161 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 08:35:57.229188 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 08:35:57.229188 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 08:35:57.229188 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 08:35:57.229188 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 08:35:57.229188 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:35:57.229188 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:35:57.229188 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:35:57.229188 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:35:57.229188 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:35:57.229188 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:35:57.229188 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:35:57.229188 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application with Lock( Jul 28 08:35:57.229188 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:35:57.229188 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:35:57.229188 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:35:57.229188 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:35:57.230134 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:35:57.230134 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:35:57.230134 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:35:57.230134 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:35:57.230134 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 08:35:57.230134 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 08:35:57.230134 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 08:35:57.230134 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 08:35:57.230134 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 08:35:57.230134 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 08:35:57.230134 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 28 08:35:57.230134 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application Jul 28 08:35:57.230134 dv-cinder-851351-1-smb devstack@keystone.service[282898]: [pid: 282898|app: 0|req: 36/72] 10.222.0.42 () {56 vars in 1114 bytes} [Thu Jul 28 08:35:57 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:35:57.231525 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e701a3fb-3a25-4e26-84ba-368e4654ccc8 None admin] Authenticating user token {{(pid=282898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:35:57.258632 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b5d308-16d2-4414-afed-bc43a9a1b1c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282899) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:35:57.259284 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b5d308-16d2-4414-afed-bc43a9a1b1c2 None admin] REQUEST_METHOD: `GET` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:35:57.259613 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b5d308-16d2-4414-afed-bc43a9a1b1c2 None admin] SCRIPT_NAME: `/identity` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:35:57.259865 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b5d308-16d2-4414-afed-bc43a9a1b1c2 None admin] PATH_INFO: `/v3/roles` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:35:57.260635 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40b5d308-16d2-4414-afed-bc43a9a1b1c2 None admin] RBAC: Adding query filter params (name=admin) {{(pid=282899) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:35:57.260977 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40b5d308-16d2-4414-afed-bc43a9a1b1c2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:35:57.262448 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40b5d308-16d2-4414-afed-bc43a9a1b1c2 None admin] RBAC: Authorization granted {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:35:57.270971 dv-cinder-851351-1-smb devstack@keystone.service[282899]: [pid: 282899|app: 0|req: 37/73] 10.222.0.42 () {56 vars in 1099 bytes} [Thu Jul 28 08:35:57 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:35:57.273462 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78354b1a-0052-4b90-903e-aa145d6d7a69 None None] REQUEST_METHOD: `GET` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:35:57.273869 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78354b1a-0052-4b90-903e-aa145d6d7a69 None None] SCRIPT_NAME: `/identity` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:35:57.274092 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78354b1a-0052-4b90-903e-aa145d6d7a69 None None] PATH_INFO: `/` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:35:57.275419 dv-cinder-851351-1-smb devstack@keystone.service[282899]: [pid: 282899|app: 0|req: 38/74] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 08:35:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 08:35:57.276799 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e4fb18-c5ac-4eef-80d8-2fb472c0b49a None None] REQUEST_METHOD: `GET` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:35:57.277062 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e4fb18-c5ac-4eef-80d8-2fb472c0b49a None None] SCRIPT_NAME: `/identity` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:35:57.277343 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e4fb18-c5ac-4eef-80d8-2fb472c0b49a None None] PATH_INFO: `/` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:35:57.279727 dv-cinder-851351-1-smb devstack@keystone.service[282899]: [pid: 282899|app: 0|req: 39/75] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 08:35:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 08:35:57.279727 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e4fb18-c5ac-4eef-80d8-2fb472c0b49a None None] Authenticating user token {{(pid=282899) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:35:57.308284 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG dbcounter [-] [282899] Writing DB stats keystone:SELECT=100 {{(pid=282899) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:35:57.340029 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e701a3fb-3a25-4e26-84ba-368e4654ccc8 None admin] Validating token access rules against request {{(pid=282898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:35:57.341660 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG dbcounter [-] [282898] Writing DB stats keystone:SELECT=100 {{(pid=282898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:35:57.376877 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f129f84f-e1fe-4004-8597-0441dbe32c37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:35:57.377520 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f129f84f-e1fe-4004-8597-0441dbe32c37 None admin] REQUEST_METHOD: `GET` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:35:57.377809 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f129f84f-e1fe-4004-8597-0441dbe32c37 None admin] SCRIPT_NAME: `/identity` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:35:57.378099 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f129f84f-e1fe-4004-8597-0441dbe32c37 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:35:57.383937 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e4fb18-c5ac-4eef-80d8-2fb472c0b49a None None] Validating token access rules against request {{(pid=282899) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:35:57.418938 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c168444-e522-488e-bc62-660fe01b1b92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282899) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:35:57.419576 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c168444-e522-488e-bc62-660fe01b1b92 None admin] REQUEST_METHOD: `GET` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:35:57.419865 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c168444-e522-488e-bc62-660fe01b1b92 None admin] SCRIPT_NAME: `/identity` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:35:57.420147 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c168444-e522-488e-bc62-660fe01b1b92 None admin] PATH_INFO: `/v3/roles` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:35:57.420920 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c168444-e522-488e-bc62-660fe01b1b92 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=282899) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:35:57.421239 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c168444-e522-488e-bc62-660fe01b1b92 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:35:57.422665 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c168444-e522-488e-bc62-660fe01b1b92 None admin] RBAC: Authorization granted {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:35:57.430979 dv-cinder-851351-1-smb devstack@keystone.service[282899]: [pid: 282899|app: 0|req: 40/76] 10.222.0.42 () {56 vars in 1111 bytes} [Thu Jul 28 08:35:57 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:35:57.431806 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c168444-e522-488e-bc62-660fe01b1b92 None admin] Authenticating user token {{(pid=282899) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:35:57.451591 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f129f84f-e1fe-4004-8597-0441dbe32c37 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:35:57.453128 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f129f84f-e1fe-4004-8597-0441dbe32c37 None admin] RBAC: Authorization granted {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:35:57.532704 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG dbcounter [-] [282899] Writing DB stats keystone:SELECT=100 {{(pid=282899) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:35:57.545026 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c168444-e522-488e-bc62-660fe01b1b92 None admin] Validating token access rules against request {{(pid=282899) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:35:57.562361 dv-cinder-851351-1-smb devstack@keystone.service[282898]: [pid: 282898|app: 0|req: 37/77] 10.222.0.42 () {58 vars in 1282 bytes} [Thu Jul 28 08:35:57 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 28 08:35:57.563478 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7982deb4-e395-471c-b57b-a690a45c0cfa None None] REQUEST_METHOD: `POST` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:35:57.563777 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7982deb4-e395-471c-b57b-a690a45c0cfa None None] SCRIPT_NAME: `/identity` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:35:57.564058 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7982deb4-e395-471c-b57b-a690a45c0cfa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:35:57.571013 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG dbcounter [-] [282898] Writing DB stats keystone:SELECT=100 {{(pid=282898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:35:57.585118 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.auth.core [None req-7982deb4-e395-471c-b57b-a690a45c0cfa None None] MFA Rules not processed for user `2be990a66857410a87ffa7609aec4f7b`. Rule list: `[]` (Enabled: `True`). {{(pid=282898) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 08:35:57.585398 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f98cf0-a26d-461c-b941-d9690c1163d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282899) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:35:57.586066 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f98cf0-a26d-461c-b941-d9690c1163d4 None admin] REQUEST_METHOD: `GET` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:35:57.586351 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f98cf0-a26d-461c-b941-d9690c1163d4 None admin] SCRIPT_NAME: `/identity` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:35:57.586456 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.fernet_utils [None req-7982deb4-e395-471c-b57b-a690a45c0cfa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=282898) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:35:57.586630 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f98cf0-a26d-461c-b941-d9690c1163d4 None admin] PATH_INFO: `/v3/users/2be990a66857410a87ffa7609aec4f7b` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:35:57.587827 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81f98cf0-a26d-461c-b941-d9690c1163d4 None admin] RBAC: Authorizing `identity:get_user(user_id=2be990a66857410a87ffa7609aec4f7b)` {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:35:57.589320 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81f98cf0-a26d-461c-b941-d9690c1163d4 None admin] RBAC: Authorization granted {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:35:57.590985 dv-cinder-851351-1-smb devstack@keystone.service[282899]: [pid: 282899|app: 0|req: 41/78] 10.222.0.42 () {56 vars in 1177 bytes} [Thu Jul 28 08:35:57 2022] GET /identity/v3/users/2be990a66857410a87ffa7609aec4f7b => generated 247 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:35:57.592311 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be158d5-4aaa-4264-be17-51eb9878357c None None] REQUEST_METHOD: `POST` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:35:57.592580 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be158d5-4aaa-4264-be17-51eb9878357c None None] SCRIPT_NAME: `/identity` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:35:57.592887 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be158d5-4aaa-4264-be17-51eb9878357c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:35:57.610828 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.auth.core [None req-6be158d5-4aaa-4264-be17-51eb9878357c None None] MFA Rules not processed for user `2be990a66857410a87ffa7609aec4f7b`. Rule list: `[]` (Enabled: `True`). {{(pid=282899) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 08:35:57.612046 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.fernet_utils [None req-6be158d5-4aaa-4264-be17-51eb9878357c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=282899) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:35:57.667419 dv-cinder-851351-1-smb devstack@keystone.service[282898]: [pid: 282898|app: 0|req: 38/79] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 08:35:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 08:35:57.668307 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7982deb4-e395-471c-b57b-a690a45c0cfa None None] Authenticating user token {{(pid=282898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:35:57.693183 dv-cinder-851351-1-smb devstack@keystone.service[282899]: [pid: 282899|app: 0|req: 42/80] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 08:35:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 08:35:57.694390 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be158d5-4aaa-4264-be17-51eb9878357c None None] Authenticating user token {{(pid=282899) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:35:57.772371 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7982deb4-e395-471c-b57b-a690a45c0cfa None None] Validating token access rules against request {{(pid=282898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:35:57.789739 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG dbcounter [-] [282899] Writing DB stats keystone:SELECT=100 {{(pid=282899) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:35:57.804381 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG dbcounter [-] [282898] Writing DB stats keystone:SELECT=100 {{(pid=282898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:35:57.805362 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be158d5-4aaa-4264-be17-51eb9878357c None None] Validating token access rules against request {{(pid=282899) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:35:57.810257 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e526d954-fe39-4121-a35d-f34e8309ff31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:35:57.810924 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e526d954-fe39-4121-a35d-f34e8309ff31 None admin] REQUEST_METHOD: `GET` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:35:57.811214 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e526d954-fe39-4121-a35d-f34e8309ff31 None admin] SCRIPT_NAME: `/identity` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:35:57.814083 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e526d954-fe39-4121-a35d-f34e8309ff31 None admin] PATH_INFO: `/v3/users/ff1f8d5551c44d2781c7ed09cd18be32` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:35:57.814083 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e526d954-fe39-4121-a35d-f34e8309ff31 None admin] RBAC: Authorizing `identity:get_user(user_id=ff1f8d5551c44d2781c7ed09cd18be32)` {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:35:57.814304 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e526d954-fe39-4121-a35d-f34e8309ff31 None admin] RBAC: Authorization granted {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:35:57.816021 dv-cinder-851351-1-smb devstack@keystone.service[282898]: [pid: 282898|app: 0|req: 39/81] 10.222.0.42 () {56 vars in 1177 bytes} [Thu Jul 28 08:35:57 2022] GET /identity/v3/users/ff1f8d5551c44d2781c7ed09cd18be32 => generated 275 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:35:57.816622 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e526d954-fe39-4121-a35d-f34e8309ff31 None admin] Authenticating user token {{(pid=282898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:35:57.844476 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3147be03-36c2-46a7-9792-94c2011b40ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282899) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:35:57.845169 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3147be03-36c2-46a7-9792-94c2011b40ef None admin] REQUEST_METHOD: `GET` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:35:57.845460 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3147be03-36c2-46a7-9792-94c2011b40ef None admin] SCRIPT_NAME: `/identity` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:35:57.845741 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3147be03-36c2-46a7-9792-94c2011b40ef None admin] PATH_INFO: `/v3/projects/c089873b22dd43e8a9de1c83b1355842` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:35:57.847001 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3147be03-36c2-46a7-9792-94c2011b40ef None admin] RBAC: Authorizing `identity:get_project(project_id=c089873b22dd43e8a9de1c83b1355842)` {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:35:57.848383 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3147be03-36c2-46a7-9792-94c2011b40ef None admin] RBAC: Authorization granted {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:35:57.850111 dv-cinder-851351-1-smb devstack@keystone.service[282899]: [pid: 282899|app: 0|req: 43/82] 10.222.0.42 () {56 vars in 1186 bytes} [Thu Jul 28 08:35:57 2022] GET /identity/v3/projects/c089873b22dd43e8a9de1c83b1355842 => generated 298 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:35:57.850880 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3147be03-36c2-46a7-9792-94c2011b40ef None admin] Authenticating user token {{(pid=282899) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:35:57.920360 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e526d954-fe39-4121-a35d-f34e8309ff31 None admin] Validating token access rules against request {{(pid=282898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:35:57.950472 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3147be03-36c2-46a7-9792-94c2011b40ef None admin] Validating token access rules against request {{(pid=282899) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:35:57.953346 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c8fadd-6b11-44f7-a3b8-1d0737d81dcf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:35:57.953975 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c8fadd-6b11-44f7-a3b8-1d0737d81dcf None admin] REQUEST_METHOD: `GET` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:35:57.954259 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c8fadd-6b11-44f7-a3b8-1d0737d81dcf None admin] SCRIPT_NAME: `/identity` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:35:57.954896 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c8fadd-6b11-44f7-a3b8-1d0737d81dcf None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:35:57.984372 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a126354-f117-4582-8210-50414d83cf98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282899) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:35:57.985063 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a126354-f117-4582-8210-50414d83cf98 None admin] REQUEST_METHOD: `GET` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:35:57.985357 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a126354-f117-4582-8210-50414d83cf98 None admin] SCRIPT_NAME: `/identity` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:35:57.985630 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a126354-f117-4582-8210-50414d83cf98 None admin] PATH_INFO: `/v3/roles/member` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:35:57.995854 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a126354-f117-4582-8210-50414d83cf98 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 08:35:58.001320 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application [None req-1a126354-f117-4582-8210-50414d83cf98 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 28 08:35:58.001320 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:35:58.001320 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:35:58.001320 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:35:58.001320 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:35:58.001320 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:35:58.001320 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:35:58.001320 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:35:58.001320 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:35:58.001320 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:35:58.001320 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:35:58.001320 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:35:58.001320 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 08:35:58.001320 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 08:35:58.001320 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 08:35:58.001320 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 08:35:58.002425 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 08:35:58.002425 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 08:35:58.002425 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 08:35:58.002425 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 08:35:58.002425 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:35:58.002425 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:35:58.002425 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:35:58.002425 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:35:58.002425 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:35:58.002425 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:35:58.002425 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:35:58.002425 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application with Lock( Jul 28 08:35:58.002425 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:35:58.002425 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:35:58.002425 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:35:58.002425 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:35:58.003373 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:35:58.003373 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:35:58.003373 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:35:58.003373 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:35:58.003373 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 08:35:58.003373 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 08:35:58.003373 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 08:35:58.003373 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 08:35:58.003373 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 08:35:58.003373 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 08:35:58.003373 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 28 08:35:58.003373 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application Jul 28 08:35:58.003373 dv-cinder-851351-1-smb devstack@keystone.service[282899]: [pid: 282899|app: 0|req: 44/83] 10.222.0.42 () {56 vars in 1099 bytes} [Thu Jul 28 08:35:57 2022] GET /identity/v3/roles/member => generated 84 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:35:58.004167 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a126354-f117-4582-8210-50414d83cf98 None admin] Authenticating user token {{(pid=282899) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:35:58.021709 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG dbcounter [-] [282899] Writing DB stats keystone:SELECT=100 {{(pid=282899) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:35:58.022996 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG dbcounter [-] [282898] Writing DB stats keystone:SELECT=100 {{(pid=282898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:35:58.025727 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50c8fadd-6b11-44f7-a3b8-1d0737d81dcf None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:35:58.027664 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50c8fadd-6b11-44f7-a3b8-1d0737d81dcf None admin] RBAC: Authorization granted {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:35:58.112123 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a126354-f117-4582-8210-50414d83cf98 None admin] Validating token access rules against request {{(pid=282899) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:35:58.131580 dv-cinder-851351-1-smb devstack@keystone.service[282898]: [pid: 282898|app: 0|req: 40/84] 10.222.0.42 () {58 vars in 1282 bytes} [Thu Jul 28 08:35:57 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 28 08:35:58.132510 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c8fadd-6b11-44f7-a3b8-1d0737d81dcf None admin] Authenticating user token {{(pid=282898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:35:58.149732 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6321c276-a8eb-407f-8c73-6353e324ff8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282899) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:35:58.150405 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6321c276-a8eb-407f-8c73-6353e324ff8e None admin] REQUEST_METHOD: `GET` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:35:58.150689 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6321c276-a8eb-407f-8c73-6353e324ff8e None admin] SCRIPT_NAME: `/identity` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:35:58.150967 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6321c276-a8eb-407f-8c73-6353e324ff8e None admin] PATH_INFO: `/v3/domains/default` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:35:58.152137 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6321c276-a8eb-407f-8c73-6353e324ff8e None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:35:58.153656 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6321c276-a8eb-407f-8c73-6353e324ff8e None admin] RBAC: Authorization granted {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:35:58.155275 dv-cinder-851351-1-smb devstack@keystone.service[282899]: [pid: 282899|app: 0|req: 45/85] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 08:35:58 2022] GET /identity/v3/domains/default => generated 199 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:35:58.156036 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6321c276-a8eb-407f-8c73-6353e324ff8e None admin] Authenticating user token {{(pid=282899) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:35:58.234992 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG dbcounter [-] [282898] Writing DB stats keystone:SELECT=100 {{(pid=282898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:35:58.238199 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c8fadd-6b11-44f7-a3b8-1d0737d81dcf None admin] Validating token access rules against request {{(pid=282898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:35:58.238515 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG dbcounter [-] [282899] Writing DB stats keystone:SELECT=100 {{(pid=282899) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:35:58.254249 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6321c276-a8eb-407f-8c73-6353e324ff8e None admin] Validating token access rules against request {{(pid=282899) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:35:58.273607 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49122aea-df24-49aa-afd4-f7bc66d9a71e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:35:58.274245 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49122aea-df24-49aa-afd4-f7bc66d9a71e None admin] REQUEST_METHOD: `GET` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:35:58.274542 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49122aea-df24-49aa-afd4-f7bc66d9a71e None admin] SCRIPT_NAME: `/identity` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:35:58.274818 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49122aea-df24-49aa-afd4-f7bc66d9a71e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:35:58.288093 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def50da5-142c-4b26-bf3a-bfd40b734326 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282899) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:35:58.288766 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def50da5-142c-4b26-bf3a-bfd40b734326 None admin] REQUEST_METHOD: `GET` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:35:58.289052 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def50da5-142c-4b26-bf3a-bfd40b734326 None admin] SCRIPT_NAME: `/identity` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:35:58.289335 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def50da5-142c-4b26-bf3a-bfd40b734326 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:35:58.290134 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-def50da5-142c-4b26-bf3a-bfd40b734326 None admin] RBAC: Adding query filter params (role.id=eaeb4674b16f497f8afb3384e7e9a3c6, scope.project.id=c089873b22dd43e8a9de1c83b1355842, user.id=ff1f8d5551c44d2781c7ed09cd18be32) {{(pid=282899) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:35:58.290446 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-def50da5-142c-4b26-bf3a-bfd40b734326 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:35:58.291912 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-def50da5-142c-4b26-bf3a-bfd40b734326 None admin] RBAC: Authorization granted {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:35:58.297521 dv-cinder-851351-1-smb devstack@keystone.service[282899]: [pid: 282899|app: 0|req: 46/86] 10.222.0.42 () {56 vars in 1374 bytes} [Thu Jul 28 08:35:58 2022] GET /identity/v3/role_assignments?user.id=ff1f8d5551c44d2781c7ed09cd18be32&scope.project.id=c089873b22dd43e8a9de1c83b1355842&role.id=eaeb4674b16f497f8afb3384e7e9a3c6 => generated 259 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:35:58.298217 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def50da5-142c-4b26-bf3a-bfd40b734326 None admin] Authenticating user token {{(pid=282899) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:35:58.355631 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49122aea-df24-49aa-afd4-f7bc66d9a71e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:35:58.357235 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49122aea-df24-49aa-afd4-f7bc66d9a71e None admin] RBAC: Authorization granted {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:35:58.417370 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def50da5-142c-4b26-bf3a-bfd40b734326 None admin] Validating token access rules against request {{(pid=282899) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:35:58.459141 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37756c45-e748-49e4-b0cd-166f673cbf8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282899) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:35:58.459900 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37756c45-e748-49e4-b0cd-166f673cbf8d None admin] REQUEST_METHOD: `GET` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:35:58.460301 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37756c45-e748-49e4-b0cd-166f673cbf8d None admin] SCRIPT_NAME: `/identity` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:35:58.460588 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37756c45-e748-49e4-b0cd-166f673cbf8d None admin] PATH_INFO: `/v3/roles` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:35:58.461368 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37756c45-e748-49e4-b0cd-166f673cbf8d None admin] RBAC: Adding query filter params (name=member) {{(pid=282899) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:35:58.461687 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37756c45-e748-49e4-b0cd-166f673cbf8d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:35:58.463306 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37756c45-e748-49e4-b0cd-166f673cbf8d None admin] RBAC: Authorization granted {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:35:58.473557 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG dbcounter [-] [282898] Writing DB stats keystone:SELECT=100 {{(pid=282898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:35:58.474491 dv-cinder-851351-1-smb devstack@keystone.service[282899]: [pid: 282899|app: 0|req: 47/87] 10.222.0.42 () {56 vars in 1101 bytes} [Thu Jul 28 08:35:58 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:35:58.475809 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37756c45-e748-49e4-b0cd-166f673cbf8d None admin] Authenticating user token {{(pid=282899) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:35:58.481999 dv-cinder-851351-1-smb devstack@keystone.service[282898]: [pid: 282898|app: 0|req: 41/88] 10.222.0.42 () {58 vars in 1282 bytes} [Thu Jul 28 08:35:58 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 350 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 28 08:35:58.482914 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49122aea-df24-49aa-afd4-f7bc66d9a71e None admin] Authenticating user token {{(pid=282898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:35:58.491926 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG dbcounter [-] [282899] Writing DB stats keystone:SELECT=100 {{(pid=282899) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:35:58.590518 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49122aea-df24-49aa-afd4-f7bc66d9a71e None admin] Validating token access rules against request {{(pid=282898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:35:58.591348 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37756c45-e748-49e4-b0cd-166f673cbf8d None admin] Validating token access rules against request {{(pid=282899) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:35:58.626004 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d901fe3-3383-42f4-b33f-80fef73424eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:35:58.626632 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d901fe3-3383-42f4-b33f-80fef73424eb None admin] REQUEST_METHOD: `POST` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:35:58.626920 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d901fe3-3383-42f4-b33f-80fef73424eb None admin] SCRIPT_NAME: `/identity` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:35:58.627193 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d901fe3-3383-42f4-b33f-80fef73424eb None admin] PATH_INFO: `/v3/users` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:35:58.627897 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d901fe3-3383-42f4-b33f-80fef73424eb None admin] RBAC: Authorizing `identity:create_user()` {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:35:58.629105 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0940b5a7-069b-479c-b52b-f6969216ec16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282899) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:35:58.629448 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d901fe3-3383-42f4-b33f-80fef73424eb None admin] RBAC: Authorization granted {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:35:58.630201 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0940b5a7-069b-479c-b52b-f6969216ec16 None admin] REQUEST_METHOD: `GET` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:35:58.630678 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0940b5a7-069b-479c-b52b-f6969216ec16 None admin] SCRIPT_NAME: `/identity` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:35:58.631160 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0940b5a7-069b-479c-b52b-f6969216ec16 None admin] PATH_INFO: `/v3/projects/c089873b22dd43e8a9de1c83b1355842` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:35:58.632598 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0940b5a7-069b-479c-b52b-f6969216ec16 None admin] RBAC: Authorizing `identity:get_project(project_id=c089873b22dd43e8a9de1c83b1355842)` {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:35:58.634252 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0940b5a7-069b-479c-b52b-f6969216ec16 None admin] RBAC: Authorization granted {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:35:58.636153 dv-cinder-851351-1-smb devstack@keystone.service[282899]: [pid: 282899|app: 0|req: 48/89] 10.222.0.42 () {56 vars in 1186 bytes} [Thu Jul 28 08:35:58 2022] GET /identity/v3/projects/c089873b22dd43e8a9de1c83b1355842 => generated 298 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:35:58.637151 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0940b5a7-069b-479c-b52b-f6969216ec16 None admin] Authenticating user token {{(pid=282899) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:35:58.664413 dv-cinder-851351-1-smb devstack@keystone.service[282898]: [pid: 282898|app: 0|req: 42/90] 10.222.0.42 () {60 vars in 1132 bytes} [Thu Jul 28 08:35:58 2022] POST /identity/v3/users => generated 289 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 08:35:58.664413 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d901fe3-3383-42f4-b33f-80fef73424eb None admin] Authenticating user token {{(pid=282898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:35:58.737271 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG dbcounter [-] [282898] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=282898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:35:58.744040 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG dbcounter [-] [282899] Writing DB stats keystone:SELECT=100 {{(pid=282899) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:35:58.772731 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0940b5a7-069b-479c-b52b-f6969216ec16 None admin] Validating token access rules against request {{(pid=282899) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:35:58.788702 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d901fe3-3383-42f4-b33f-80fef73424eb None admin] Validating token access rules against request {{(pid=282898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:35:58.813559 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7fad33f-2419-48d9-9314-2a24fbd22267 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282899) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:35:58.814382 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7fad33f-2419-48d9-9314-2a24fbd22267 None admin] REQUEST_METHOD: `GET` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:35:58.814639 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7fad33f-2419-48d9-9314-2a24fbd22267 None admin] SCRIPT_NAME: `/identity` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:35:58.814926 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7fad33f-2419-48d9-9314-2a24fbd22267 None admin] PATH_INFO: `/v3/users/ff1f8d5551c44d2781c7ed09cd18be32` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:35:58.816210 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7fad33f-2419-48d9-9314-2a24fbd22267 None admin] RBAC: Authorizing `identity:get_user(user_id=ff1f8d5551c44d2781c7ed09cd18be32)` {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:35:58.817911 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7fad33f-2419-48d9-9314-2a24fbd22267 None admin] RBAC: Authorization granted {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:35:58.820077 dv-cinder-851351-1-smb devstack@keystone.service[282899]: [pid: 282899|app: 0|req: 49/91] 10.222.0.42 () {56 vars in 1177 bytes} [Thu Jul 28 08:35:58 2022] GET /identity/v3/users/ff1f8d5551c44d2781c7ed09cd18be32 => generated 275 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:35:58.821087 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7fad33f-2419-48d9-9314-2a24fbd22267 None admin] Authenticating user token {{(pid=282899) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:35:58.836772 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf7e5438-16c2-4350-81dc-0da7fb9304b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:35:58.838000 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7e5438-16c2-4350-81dc-0da7fb9304b1 None admin] REQUEST_METHOD: `GET` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:35:58.838500 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7e5438-16c2-4350-81dc-0da7fb9304b1 None admin] SCRIPT_NAME: `/identity` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:35:58.839004 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7e5438-16c2-4350-81dc-0da7fb9304b1 None admin] PATH_INFO: `/v3/projects/c089873b22dd43e8a9de1c83b1355842` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:35:58.840607 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf7e5438-16c2-4350-81dc-0da7fb9304b1 None admin] RBAC: Authorizing `identity:get_project(project_id=c089873b22dd43e8a9de1c83b1355842)` {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:35:58.842490 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf7e5438-16c2-4350-81dc-0da7fb9304b1 None admin] RBAC: Authorization granted {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:35:58.845013 dv-cinder-851351-1-smb devstack@keystone.service[282898]: [pid: 282898|app: 0|req: 43/92] 10.222.0.42 () {56 vars in 1186 bytes} [Thu Jul 28 08:35:58 2022] GET /identity/v3/projects/c089873b22dd43e8a9de1c83b1355842 => generated 298 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:35:58.846209 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf7e5438-16c2-4350-81dc-0da7fb9304b1 None admin] Authenticating user token {{(pid=282898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:35:58.958210 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7fad33f-2419-48d9-9314-2a24fbd22267 None admin] Validating token access rules against request {{(pid=282899) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:35:58.980967 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf7e5438-16c2-4350-81dc-0da7fb9304b1 None admin] Validating token access rules against request {{(pid=282898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:35:59.008118 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d022d8c1-1149-460d-ad09-1ed0bfd21552 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282899) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:35:59.008711 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d022d8c1-1149-460d-ad09-1ed0bfd21552 None admin] REQUEST_METHOD: `GET` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:35:59.009001 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d022d8c1-1149-460d-ad09-1ed0bfd21552 None admin] SCRIPT_NAME: `/identity` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:35:59.009291 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d022d8c1-1149-460d-ad09-1ed0bfd21552 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:35:59.010374 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d022d8c1-1149-460d-ad09-1ed0bfd21552 None admin] RBAC: Adding query filter params (role.id=a0e2a00bf94d40f38629d6b5293e3aee, scope.project.id=c089873b22dd43e8a9de1c83b1355842, user.id=2be990a66857410a87ffa7609aec4f7b) {{(pid=282899) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:35:59.010695 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d022d8c1-1149-460d-ad09-1ed0bfd21552 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:35:59.011916 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG dbcounter [-] [282898] Writing DB stats keystone:SELECT=100 {{(pid=282898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:35:59.012184 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d022d8c1-1149-460d-ad09-1ed0bfd21552 None admin] RBAC: Authorization granted {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:35:59.018897 dv-cinder-851351-1-smb devstack@keystone.service[282899]: [pid: 282899|app: 0|req: 50/93] 10.222.0.42 () {56 vars in 1374 bytes} [Thu Jul 28 08:35:58 2022] GET /identity/v3/role_assignments?user.id=2be990a66857410a87ffa7609aec4f7b&scope.project.id=c089873b22dd43e8a9de1c83b1355842&role.id=a0e2a00bf94d40f38629d6b5293e3aee => generated 259 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:35:59.024733 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d022d8c1-1149-460d-ad09-1ed0bfd21552 None admin] Authenticating user token {{(pid=282899) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:35:59.031296 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37990ae-8f67-42e5-80b7-6b9d7d892a8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:35:59.032081 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37990ae-8f67-42e5-80b7-6b9d7d892a8a None admin] REQUEST_METHOD: `GET` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:35:59.032386 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37990ae-8f67-42e5-80b7-6b9d7d892a8a None admin] SCRIPT_NAME: `/identity` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:35:59.032687 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37990ae-8f67-42e5-80b7-6b9d7d892a8a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:35:59.033810 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG dbcounter [-] [282899] Writing DB stats keystone:SELECT=100 {{(pid=282899) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:35:59.122031 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c37990ae-8f67-42e5-80b7-6b9d7d892a8a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:35:59.123670 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c37990ae-8f67-42e5-80b7-6b9d7d892a8a None admin] RBAC: Authorization granted {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:35:59.143461 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d022d8c1-1149-460d-ad09-1ed0bfd21552 None admin] Validating token access rules against request {{(pid=282899) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:35:59.181970 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b641c93-77cf-4cdf-867d-776be228ae02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282899) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:35:59.182621 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b641c93-77cf-4cdf-867d-776be228ae02 None admin] REQUEST_METHOD: `GET` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:35:59.182907 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b641c93-77cf-4cdf-867d-776be228ae02 None admin] SCRIPT_NAME: `/identity` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:35:59.183187 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b641c93-77cf-4cdf-867d-776be228ae02 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:35:59.184603 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b641c93-77cf-4cdf-867d-776be228ae02 None admin] RBAC: Adding query filter params (role.id=d76677105be344cc83022cbde8a22d8d, scope.project.id=c089873b22dd43e8a9de1c83b1355842, user.id=ff1f8d5551c44d2781c7ed09cd18be32) {{(pid=282899) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:35:59.184971 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b641c93-77cf-4cdf-867d-776be228ae02 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:35:59.186512 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b641c93-77cf-4cdf-867d-776be228ae02 None admin] RBAC: Authorization granted {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:35:59.192875 dv-cinder-851351-1-smb devstack@keystone.service[282899]: [pid: 282899|app: 0|req: 51/94] 10.222.0.42 () {56 vars in 1374 bytes} [Thu Jul 28 08:35:59 2022] GET /identity/v3/role_assignments?user.id=ff1f8d5551c44d2781c7ed09cd18be32&scope.project.id=c089873b22dd43e8a9de1c83b1355842&role.id=d76677105be344cc83022cbde8a22d8d => generated 259 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:35:59.251787 dv-cinder-851351-1-smb devstack@keystone.service[282898]: [pid: 282898|app: 0|req: 44/95] 10.222.0.42 () {58 vars in 1282 bytes} [Thu Jul 28 08:35:58 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 406 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 28 08:35:59.258732 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b641c93-77cf-4cdf-867d-776be228ae02 None admin] Authenticating user token {{(pid=282899) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:35:59.355010 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG dbcounter [-] [282899] Writing DB stats keystone:SELECT=100 {{(pid=282899) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:35:59.384566 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b641c93-77cf-4cdf-867d-776be228ae02 None admin] Validating token access rules against request {{(pid=282899) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:35:59.421782 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5616c59b-dc8a-4dc2-ac83-a76e4db02b79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282899) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:35:59.422471 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5616c59b-dc8a-4dc2-ac83-a76e4db02b79 None admin] REQUEST_METHOD: `GET` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:35:59.422758 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5616c59b-dc8a-4dc2-ac83-a76e4db02b79 None admin] SCRIPT_NAME: `/identity` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:35:59.423034 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5616c59b-dc8a-4dc2-ac83-a76e4db02b79 None admin] PATH_INFO: `/v3/projects/2e5945424520462faafca339c1faf342` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:35:59.424329 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5616c59b-dc8a-4dc2-ac83-a76e4db02b79 None admin] RBAC: Authorizing `identity:get_project(project_id=2e5945424520462faafca339c1faf342)` {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:35:59.425875 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5616c59b-dc8a-4dc2-ac83-a76e4db02b79 None admin] RBAC: Authorization granted {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:35:59.427824 dv-cinder-851351-1-smb devstack@keystone.service[282899]: [pid: 282899|app: 0|req: 52/96] 10.222.0.42 () {56 vars in 1186 bytes} [Thu Jul 28 08:35:59 2022] GET /identity/v3/projects/2e5945424520462faafca339c1faf342 => generated 312 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:35:59.433983 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37990ae-8f67-42e5-80b7-6b9d7d892a8a None admin] Authenticating user token {{(pid=282898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:35:59.475957 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG dbcounter [-] [282898] Writing DB stats keystone:SELECT=100 {{(pid=282898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:35:59.581375 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37990ae-8f67-42e5-80b7-6b9d7d892a8a None admin] Validating token access rules against request {{(pid=282898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:35:59.632381 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eeef44d-510c-4f39-8e35-4841198e360c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:35:59.633467 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eeef44d-510c-4f39-8e35-4841198e360c None admin] REQUEST_METHOD: `GET` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:35:59.633988 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eeef44d-510c-4f39-8e35-4841198e360c None admin] SCRIPT_NAME: `/identity` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:35:59.634480 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eeef44d-510c-4f39-8e35-4841198e360c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:35:59.635542 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eeef44d-510c-4f39-8e35-4841198e360c None admin] RBAC: Adding query filter params (role.id=eaeb4674b16f497f8afb3384e7e9a3c6, scope.project.id=2e5945424520462faafca339c1faf342, user.id=ff1f8d5551c44d2781c7ed09cd18be32) {{(pid=282898) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:35:59.636077 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eeef44d-510c-4f39-8e35-4841198e360c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:35:59.637879 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eeef44d-510c-4f39-8e35-4841198e360c None admin] RBAC: Authorization granted {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:35:59.646965 dv-cinder-851351-1-smb devstack@keystone.service[282898]: [pid: 282898|app: 0|req: 45/97] 10.222.0.42 () {56 vars in 1374 bytes} [Thu Jul 28 08:35:59 2022] GET /identity/v3/role_assignments?user.id=ff1f8d5551c44d2781c7ed09cd18be32&scope.project.id=2e5945424520462faafca339c1faf342&role.id=eaeb4674b16f497f8afb3384e7e9a3c6 => generated 259 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:36:00.558453 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b74461-5a33-4053-84d4-efa1db8a4573 None None] REQUEST_METHOD: `GET` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:36:00.559020 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b74461-5a33-4053-84d4-efa1db8a4573 None None] SCRIPT_NAME: `/identity` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:36:00.559020 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b74461-5a33-4053-84d4-efa1db8a4573 None None] PATH_INFO: `/` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:36:00.560895 dv-cinder-851351-1-smb devstack@keystone.service[282899]: [pid: 282899|app: 0|req: 53/98] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 08:36:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 08:36:00.567852 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab6c0bc-b2db-4429-926f-2e7295816350 None None] REQUEST_METHOD: `POST` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:36:00.568901 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab6c0bc-b2db-4429-926f-2e7295816350 None None] SCRIPT_NAME: `/identity` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:36:00.569388 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab6c0bc-b2db-4429-926f-2e7295816350 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:36:00.597799 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.auth.core [None req-2ab6c0bc-b2db-4429-926f-2e7295816350 None None] MFA Rules not processed for user `2be990a66857410a87ffa7609aec4f7b`. Rule list: `[]` (Enabled: `True`). {{(pid=282898) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 08:36:00.599580 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.fernet_utils [None req-2ab6c0bc-b2db-4429-926f-2e7295816350 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=282898) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:36:00.687384 dv-cinder-851351-1-smb devstack@keystone.service[282898]: [pid: 282898|app: 0|req: 46/99] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 08:36:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 28 08:36:00.715137 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b74461-5a33-4053-84d4-efa1db8a4573 None None] Authenticating user token {{(pid=282899) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:36:00.870257 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b74461-5a33-4053-84d4-efa1db8a4573 None None] Validating token access rules against request {{(pid=282899) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:36:00.922732 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21005fdd-4d29-4512-8158-71e944964875 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282899) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:36:00.923408 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21005fdd-4d29-4512-8158-71e944964875 None admin] REQUEST_METHOD: `GET` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:36:00.923701 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21005fdd-4d29-4512-8158-71e944964875 None admin] SCRIPT_NAME: `/identity` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:36:00.923983 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21005fdd-4d29-4512-8158-71e944964875 None admin] PATH_INFO: `/v3/roles/member` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:36:00.938947 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21005fdd-4d29-4512-8158-71e944964875 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 08:36:00.944100 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application [None req-21005fdd-4d29-4512-8158-71e944964875 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 28 08:36:00.944100 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:36:00.944100 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:36:00.944100 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:36:00.944100 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:36:00.944100 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:36:00.944100 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:36:00.944100 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:36:00.944100 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:36:00.944100 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:36:00.944100 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:36:00.944100 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:36:00.944100 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 08:36:00.944100 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 08:36:00.944100 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 08:36:00.944100 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 08:36:00.945257 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 08:36:00.945257 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 08:36:00.945257 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 08:36:00.945257 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 08:36:00.945257 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:36:00.945257 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:36:00.945257 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:36:00.945257 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:36:00.945257 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:36:00.945257 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:36:00.945257 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:36:00.945257 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application with Lock( Jul 28 08:36:00.945257 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:36:00.945257 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:36:00.945257 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:36:00.945257 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:36:00.946291 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:36:00.946291 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:36:00.946291 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:36:00.946291 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:36:00.946291 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 08:36:00.946291 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 08:36:00.946291 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 08:36:00.946291 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 08:36:00.946291 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 08:36:00.946291 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 08:36:00.946291 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 28 08:36:00.946291 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application Jul 28 08:36:00.946291 dv-cinder-851351-1-smb devstack@keystone.service[282899]: [pid: 282899|app: 0|req: 54/100] 10.222.0.42 () {56 vars in 1099 bytes} [Thu Jul 28 08:36:00 2022] GET /identity/v3/roles/member => generated 84 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:36:00.955889 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab6c0bc-b2db-4429-926f-2e7295816350 None None] Authenticating user token {{(pid=282898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:36:00.983380 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG dbcounter [-] [282898] Writing DB stats keystone:SELECT=100 {{(pid=282898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:36:01.074392 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab6c0bc-b2db-4429-926f-2e7295816350 None None] Validating token access rules against request {{(pid=282898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:36:01.115566 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5735f6ad-ec94-4277-b617-610ddcc106c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:36:01.116656 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5735f6ad-ec94-4277-b617-610ddcc106c7 None admin] REQUEST_METHOD: `GET` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:36:01.117188 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5735f6ad-ec94-4277-b617-610ddcc106c7 None admin] SCRIPT_NAME: `/identity` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:36:01.117762 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5735f6ad-ec94-4277-b617-610ddcc106c7 None admin] PATH_INFO: `/v3/roles` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:36:01.118827 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5735f6ad-ec94-4277-b617-610ddcc106c7 None admin] RBAC: Adding query filter params (name=member) {{(pid=282898) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:36:01.119367 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5735f6ad-ec94-4277-b617-610ddcc106c7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:36:01.121152 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5735f6ad-ec94-4277-b617-610ddcc106c7 None admin] RBAC: Authorization granted {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:36:01.133945 dv-cinder-851351-1-smb devstack@keystone.service[282898]: [pid: 282898|app: 0|req: 47/101] 10.222.0.42 () {56 vars in 1101 bytes} [Thu Jul 28 08:36:00 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:36:01.139962 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21005fdd-4d29-4512-8158-71e944964875 None admin] Authenticating user token {{(pid=282899) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:36:01.143487 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG dbcounter [-] [282899] Writing DB stats keystone:SELECT=100 {{(pid=282899) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:36:01.281062 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21005fdd-4d29-4512-8158-71e944964875 None admin] Validating token access rules against request {{(pid=282899) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:36:01.330065 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc15a70d-eb82-4916-a6e4-2eb1b09c29e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282899) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:36:01.330647 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc15a70d-eb82-4916-a6e4-2eb1b09c29e6 None admin] REQUEST_METHOD: `GET` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:36:01.330939 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc15a70d-eb82-4916-a6e4-2eb1b09c29e6 None admin] SCRIPT_NAME: `/identity` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:36:01.331225 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc15a70d-eb82-4916-a6e4-2eb1b09c29e6 None admin] PATH_INFO: `/v3/users/ff1f8d5551c44d2781c7ed09cd18be32` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:36:01.337421 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc15a70d-eb82-4916-a6e4-2eb1b09c29e6 None admin] RBAC: Authorizing `identity:get_user(user_id=ff1f8d5551c44d2781c7ed09cd18be32)` {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:36:01.338924 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc15a70d-eb82-4916-a6e4-2eb1b09c29e6 None admin] RBAC: Authorization granted {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:36:01.340827 dv-cinder-851351-1-smb devstack@keystone.service[282899]: [pid: 282899|app: 0|req: 55/102] 10.222.0.42 () {56 vars in 1177 bytes} [Thu Jul 28 08:36:01 2022] GET /identity/v3/users/ff1f8d5551c44d2781c7ed09cd18be32 => generated 275 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:36:01.346843 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5735f6ad-ec94-4277-b617-610ddcc106c7 None admin] Authenticating user token {{(pid=282898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:36:01.443234 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG dbcounter [-] [282898] Writing DB stats keystone:SELECT=100 {{(pid=282898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:36:01.465439 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5735f6ad-ec94-4277-b617-610ddcc106c7 None admin] Validating token access rules against request {{(pid=282898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:36:01.513363 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2556daf-e4b4-4db5-96eb-400bce01ff2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:36:01.514455 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2556daf-e4b4-4db5-96eb-400bce01ff2f None admin] REQUEST_METHOD: `GET` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:36:01.514955 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2556daf-e4b4-4db5-96eb-400bce01ff2f None admin] SCRIPT_NAME: `/identity` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:36:01.515454 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2556daf-e4b4-4db5-96eb-400bce01ff2f None admin] PATH_INFO: `/v3/projects/c089873b22dd43e8a9de1c83b1355842` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:36:01.517398 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2556daf-e4b4-4db5-96eb-400bce01ff2f None admin] RBAC: Authorizing `identity:get_project(project_id=c089873b22dd43e8a9de1c83b1355842)` {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:36:01.519120 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2556daf-e4b4-4db5-96eb-400bce01ff2f None admin] RBAC: Authorization granted {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:36:01.521605 dv-cinder-851351-1-smb devstack@keystone.service[282898]: [pid: 282898|app: 0|req: 48/103] 10.222.0.42 () {56 vars in 1186 bytes} [Thu Jul 28 08:36:01 2022] GET /identity/v3/projects/c089873b22dd43e8a9de1c83b1355842 => generated 298 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:36:01.527341 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc15a70d-eb82-4916-a6e4-2eb1b09c29e6 None admin] Authenticating user token {{(pid=282899) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:36:01.631587 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG dbcounter [-] [282899] Writing DB stats keystone:SELECT=100 {{(pid=282899) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:36:01.665572 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc15a70d-eb82-4916-a6e4-2eb1b09c29e6 None admin] Validating token access rules against request {{(pid=282899) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:36:01.701209 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b53e80e-d832-45bc-8ec7-eae19292e5f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282899) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:36:01.701911 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b53e80e-d832-45bc-8ec7-eae19292e5f0 None admin] REQUEST_METHOD: `PUT` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:36:01.702193 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b53e80e-d832-45bc-8ec7-eae19292e5f0 None admin] SCRIPT_NAME: `/identity` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:36:01.702474 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b53e80e-d832-45bc-8ec7-eae19292e5f0 None admin] PATH_INFO: `/v3/projects/c089873b22dd43e8a9de1c83b1355842/users/ff1f8d5551c44d2781c7ed09cd18be32/roles/eaeb4674b16f497f8afb3384e7e9a3c6` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:36:01.704891 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b53e80e-d832-45bc-8ec7-eae19292e5f0 None admin] RBAC: Authorizing `identity:create_grant(project_id=c089873b22dd43e8a9de1c83b1355842, user_id=ff1f8d5551c44d2781c7ed09cd18be32, role_id=eaeb4674b16f497f8afb3384e7e9a3c6)` {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:36:01.706373 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b53e80e-d832-45bc-8ec7-eae19292e5f0 None admin] RBAC: Authorization granted {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:36:01.723062 dv-cinder-851351-1-smb devstack@keystone.service[282899]: [pid: 282899|app: 0|req: 56/104] 10.222.0.42 () {58 vars in 1439 bytes} [Thu Jul 28 08:36:01 2022] PUT /identity/v3/projects/c089873b22dd43e8a9de1c83b1355842/users/ff1f8d5551c44d2781c7ed09cd18be32/roles/eaeb4674b16f497f8afb3384e7e9a3c6 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 08:36:02.137708 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664c56ac-6646-497f-a6bf-a4b83f811e4d None None] REQUEST_METHOD: `GET` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:36:02.138299 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664c56ac-6646-497f-a6bf-a4b83f811e4d None None] SCRIPT_NAME: `/identity` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:36:02.138299 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664c56ac-6646-497f-a6bf-a4b83f811e4d None None] PATH_INFO: `/` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:36:02.139868 dv-cinder-851351-1-smb devstack@keystone.service[282898]: [pid: 282898|app: 0|req: 49/105] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 08:36:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 08:36:02.146416 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2d8990-e33f-4068-b9a6-d937c471f295 None None] REQUEST_METHOD: `POST` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:36:02.146712 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2d8990-e33f-4068-b9a6-d937c471f295 None None] SCRIPT_NAME: `/identity` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:36:02.147001 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2d8990-e33f-4068-b9a6-d937c471f295 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:36:02.154833 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2cffc6d-b6ed-4fce-a780-cd97bc7fbc9b None None] REQUEST_METHOD: `GET` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:36:02.155118 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2cffc6d-b6ed-4fce-a780-cd97bc7fbc9b None None] SCRIPT_NAME: `/identity` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:36:02.155397 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2cffc6d-b6ed-4fce-a780-cd97bc7fbc9b None None] PATH_INFO: `/` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:36:02.157031 dv-cinder-851351-1-smb devstack@keystone.service[282898]: [pid: 282898|app: 0|req: 50/106] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 08:36:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 08:36:02.162177 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1abf6b0-8e72-41b1-87ea-f26f46f53384 None None] REQUEST_METHOD: `POST` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:36:02.162464 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1abf6b0-8e72-41b1-87ea-f26f46f53384 None None] SCRIPT_NAME: `/identity` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:36:02.162746 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1abf6b0-8e72-41b1-87ea-f26f46f53384 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:36:02.176801 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.auth.core [None req-ed2d8990-e33f-4068-b9a6-d937c471f295 None None] MFA Rules not processed for user `2be990a66857410a87ffa7609aec4f7b`. Rule list: `[]` (Enabled: `True`). {{(pid=282899) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 08:36:02.178035 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.fernet_utils [None req-ed2d8990-e33f-4068-b9a6-d937c471f295 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=282899) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:36:02.184907 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.auth.core [None req-f1abf6b0-8e72-41b1-87ea-f26f46f53384 None None] MFA Rules not processed for user `2be990a66857410a87ffa7609aec4f7b`. Rule list: `[]` (Enabled: `True`). {{(pid=282898) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 08:36:02.186632 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.fernet_utils [None req-f1abf6b0-8e72-41b1-87ea-f26f46f53384 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=282898) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:36:02.256232 dv-cinder-851351-1-smb devstack@keystone.service[282899]: [pid: 282899|app: 0|req: 57/107] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 08:36:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 08:36:02.276231 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661de549-85e3-4724-87ca-5ee9740d2916 None None] REQUEST_METHOD: `GET` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:36:02.276519 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661de549-85e3-4724-87ca-5ee9740d2916 None None] SCRIPT_NAME: `/identity` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:36:02.276835 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661de549-85e3-4724-87ca-5ee9740d2916 None None] PATH_INFO: `/` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:36:02.278365 dv-cinder-851351-1-smb devstack@keystone.service[282899]: [pid: 282899|app: 0|req: 58/108] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 08:36:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 28 08:36:02.283440 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-661de549-85e3-4724-87ca-5ee9740d2916 None None] Authenticating user token {{(pid=282899) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:36:02.307311 dv-cinder-851351-1-smb devstack@keystone.service[282898]: [pid: 282898|app: 0|req: 51/109] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 08:36:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 28 08:36:02.308795 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df9ccf4-f07b-42bd-a7d7-f326c61b495c None None] REQUEST_METHOD: `POST` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:36:02.309172 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df9ccf4-f07b-42bd-a7d7-f326c61b495c None None] SCRIPT_NAME: `/identity` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:36:02.309452 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df9ccf4-f07b-42bd-a7d7-f326c61b495c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:36:02.335921 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.auth.core [None req-7df9ccf4-f07b-42bd-a7d7-f326c61b495c None None] MFA Rules not processed for user `2be990a66857410a87ffa7609aec4f7b`. Rule list: `[]` (Enabled: `True`). {{(pid=282898) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 08:36:02.338849 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.fernet_utils [None req-7df9ccf4-f07b-42bd-a7d7-f326c61b495c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=282898) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:36:02.380433 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG dbcounter [-] [282899] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=282899) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:36:02.427549 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-661de549-85e3-4724-87ca-5ee9740d2916 None None] Validating token access rules against request {{(pid=282899) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:36:02.433787 dv-cinder-851351-1-smb devstack@keystone.service[282898]: [pid: 282898|app: 0|req: 52/110] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 08:36:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 08:36:02.434475 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df9ccf4-f07b-42bd-a7d7-f326c61b495c None None] Authenticating user token {{(pid=282898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:36:02.448028 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG dbcounter [-] [282898] Writing DB stats keystone:SELECT=100 {{(pid=282898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:36:02.497047 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437fd722-2537-4b67-8f6e-4468f9b7d385 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282899) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:36:02.498152 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437fd722-2537-4b67-8f6e-4468f9b7d385 None admin] REQUEST_METHOD: `GET` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:36:02.498688 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437fd722-2537-4b67-8f6e-4468f9b7d385 None admin] SCRIPT_NAME: `/identity` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:36:02.499293 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437fd722-2537-4b67-8f6e-4468f9b7d385 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:36:02.529762 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-437fd722-2537-4b67-8f6e-4468f9b7d385 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 08:36:02.535675 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application [None req-437fd722-2537-4b67-8f6e-4468f9b7d385 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 08:36:02.535675 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:36:02.535675 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:36:02.535675 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:36:02.535675 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:36:02.535675 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:36:02.535675 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:36:02.535675 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:36:02.535675 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:36:02.535675 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:36:02.535675 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:36:02.535675 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:36:02.535675 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 08:36:02.535675 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 08:36:02.535675 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 08:36:02.535675 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 08:36:02.536808 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 08:36:02.536808 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 08:36:02.536808 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 08:36:02.536808 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 08:36:02.536808 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:36:02.536808 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:36:02.536808 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:36:02.536808 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:36:02.536808 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:36:02.536808 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:36:02.536808 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:36:02.536808 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application with Lock( Jul 28 08:36:02.536808 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:36:02.536808 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:36:02.536808 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:36:02.536808 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:36:02.537766 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:36:02.537766 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:36:02.537766 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:36:02.537766 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:36:02.537766 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 08:36:02.537766 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 08:36:02.537766 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 08:36:02.537766 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 08:36:02.537766 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 08:36:02.537766 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 08:36:02.537766 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 08:36:02.537766 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application Jul 28 08:36:02.540020 dv-cinder-851351-1-smb devstack@keystone.service[282899]: [pid: 282899|app: 0|req: 59/111] 10.222.0.42 () {56 vars in 1096 bytes} [Thu Jul 28 08:36:02 2022] GET /identity/v3/roles/admin => generated 83 bytes in 257 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:36:02.541141 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437fd722-2537-4b67-8f6e-4468f9b7d385 None admin] Authenticating user token {{(pid=282899) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:36:02.554201 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df9ccf4-f07b-42bd-a7d7-f326c61b495c None None] Validating token access rules against request {{(pid=282898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:36:02.601751 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4208d5b3-11b5-44e9-94e7-8dff8705814e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:36:02.602427 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4208d5b3-11b5-44e9-94e7-8dff8705814e None admin] REQUEST_METHOD: `GET` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:36:02.602963 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4208d5b3-11b5-44e9-94e7-8dff8705814e None admin] SCRIPT_NAME: `/identity` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:36:02.603246 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4208d5b3-11b5-44e9-94e7-8dff8705814e None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:36:02.618089 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4208d5b3-11b5-44e9-94e7-8dff8705814e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 08:36:02.623647 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application [None req-4208d5b3-11b5-44e9-94e7-8dff8705814e None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 28 08:36:02.623647 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:36:02.623647 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:36:02.623647 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:36:02.623647 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:36:02.623647 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:36:02.623647 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:36:02.623647 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:36:02.623647 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:36:02.623647 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:36:02.623647 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:36:02.623647 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:36:02.623647 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 08:36:02.623647 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 08:36:02.623647 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 08:36:02.623647 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 08:36:02.624761 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 08:36:02.624761 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 08:36:02.624761 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 08:36:02.624761 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 08:36:02.624761 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:36:02.624761 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:36:02.624761 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:36:02.624761 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:36:02.624761 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:36:02.624761 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:36:02.624761 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:36:02.624761 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application with Lock( Jul 28 08:36:02.624761 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:36:02.624761 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:36:02.624761 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:36:02.624761 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:36:02.625708 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:36:02.625708 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:36:02.625708 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:36:02.625708 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:36:02.625708 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 08:36:02.625708 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 08:36:02.625708 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 08:36:02.625708 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 08:36:02.625708 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 08:36:02.625708 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 08:36:02.625708 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 28 08:36:02.625708 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application Jul 28 08:36:02.625708 dv-cinder-851351-1-smb devstack@keystone.service[282898]: [pid: 282898|app: 0|req: 53/112] 10.222.0.42 () {56 vars in 1114 bytes} [Thu Jul 28 08:36:02 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:36:02.630350 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2500d26-a81f-4166-baea-0ce0626e2f67 None None] REQUEST_METHOD: `GET` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:36:02.630938 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2500d26-a81f-4166-baea-0ce0626e2f67 None None] SCRIPT_NAME: `/identity` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:36:02.631229 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2500d26-a81f-4166-baea-0ce0626e2f67 None None] PATH_INFO: `/` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:36:02.632766 dv-cinder-851351-1-smb devstack@keystone.service[282898]: [pid: 282898|app: 0|req: 54/113] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 08:36:02 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 08:36:02.633353 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2500d26-a81f-4166-baea-0ce0626e2f67 None None] Authenticating user token {{(pid=282898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:36:02.668136 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437fd722-2537-4b67-8f6e-4468f9b7d385 None admin] Validating token access rules against request {{(pid=282899) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:36:02.697140 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG dbcounter [-] [282899] Writing DB stats keystone:SELECT=100 {{(pid=282899) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:36:02.715680 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG dbcounter [-] [282898] Writing DB stats keystone:SELECT=100 {{(pid=282898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:36:02.718628 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56cc5656-d4c2-4093-b252-f5c429bde4e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282899) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:36:02.719499 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56cc5656-d4c2-4093-b252-f5c429bde4e5 None admin] REQUEST_METHOD: `GET` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:36:02.720144 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56cc5656-d4c2-4093-b252-f5c429bde4e5 None admin] SCRIPT_NAME: `/identity` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:36:02.720576 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56cc5656-d4c2-4093-b252-f5c429bde4e5 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:36:02.734453 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56cc5656-d4c2-4093-b252-f5c429bde4e5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 08:36:02.740954 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application [None req-56cc5656-d4c2-4093-b252-f5c429bde4e5 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 28 08:36:02.740954 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:36:02.740954 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:36:02.740954 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:36:02.740954 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:36:02.740954 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:36:02.740954 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:36:02.740954 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:36:02.740954 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:36:02.740954 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:36:02.740954 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:36:02.740954 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:36:02.740954 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 08:36:02.740954 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 08:36:02.740954 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 08:36:02.740954 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 08:36:02.742047 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 08:36:02.742047 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 08:36:02.742047 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 08:36:02.742047 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 08:36:02.742047 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:36:02.742047 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:36:02.742047 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:36:02.742047 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:36:02.742047 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:36:02.742047 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:36:02.742047 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:36:02.742047 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application with Lock( Jul 28 08:36:02.742047 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:36:02.742047 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:36:02.742047 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:36:02.742047 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:36:02.742996 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:36:02.742996 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:36:02.742996 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:36:02.742996 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:36:02.742996 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 08:36:02.742996 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 08:36:02.742996 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 08:36:02.742996 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 08:36:02.742996 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 08:36:02.742996 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 08:36:02.742996 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 28 08:36:02.742996 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application Jul 28 08:36:02.745842 dv-cinder-851351-1-smb devstack@keystone.service[282899]: [pid: 282899|app: 0|req: 60/114] 10.222.0.42 () {56 vars in 1099 bytes} [Thu Jul 28 08:36:02 2022] GET /identity/v3/roles/reader => generated 84 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:36:02.746860 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56cc5656-d4c2-4093-b252-f5c429bde4e5 None admin] Authenticating user token {{(pid=282899) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:36:02.759599 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2500d26-a81f-4166-baea-0ce0626e2f67 None None] Validating token access rules against request {{(pid=282898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:36:02.809834 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb4692f-7fb9-4018-8684-0d82cd843fa6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:36:02.810774 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb4692f-7fb9-4018-8684-0d82cd843fa6 None admin] REQUEST_METHOD: `GET` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:36:02.811232 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb4692f-7fb9-4018-8684-0d82cd843fa6 None admin] SCRIPT_NAME: `/identity` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:36:02.811684 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb4692f-7fb9-4018-8684-0d82cd843fa6 None admin] PATH_INFO: `/v3/roles` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:36:02.812594 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdb4692f-7fb9-4018-8684-0d82cd843fa6 None admin] RBAC: Adding query filter params (name=admin) {{(pid=282898) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:36:02.813086 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdb4692f-7fb9-4018-8684-0d82cd843fa6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:36:02.814655 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdb4692f-7fb9-4018-8684-0d82cd843fa6 None admin] RBAC: Authorization granted {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:36:02.826880 dv-cinder-851351-1-smb devstack@keystone.service[282898]: [pid: 282898|app: 0|req: 55/115] 10.222.0.42 () {56 vars in 1099 bytes} [Thu Jul 28 08:36:02 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:36:02.832084 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a0de2a-11e5-4f56-bda0-f5713c8c46bb None None] REQUEST_METHOD: `POST` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:36:02.832084 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a0de2a-11e5-4f56-bda0-f5713c8c46bb None None] SCRIPT_NAME: `/identity` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:36:02.832084 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a0de2a-11e5-4f56-bda0-f5713c8c46bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:36:02.854864 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.auth.core [None req-a4a0de2a-11e5-4f56-bda0-f5713c8c46bb None None] MFA Rules not processed for user `2be990a66857410a87ffa7609aec4f7b`. Rule list: `[]` (Enabled: `True`). {{(pid=282898) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 08:36:02.857232 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.fernet_utils [None req-a4a0de2a-11e5-4f56-bda0-f5713c8c46bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=282898) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:36:02.877886 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56cc5656-d4c2-4093-b252-f5c429bde4e5 None admin] Validating token access rules against request {{(pid=282899) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:36:02.916328 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc3b9ce-d72a-49fd-9fba-1b7fdf13c8eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282899) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:36:02.917083 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc3b9ce-d72a-49fd-9fba-1b7fdf13c8eb None admin] REQUEST_METHOD: `GET` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:36:02.917423 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc3b9ce-d72a-49fd-9fba-1b7fdf13c8eb None admin] SCRIPT_NAME: `/identity` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:36:02.917713 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc3b9ce-d72a-49fd-9fba-1b7fdf13c8eb None admin] PATH_INFO: `/v3/roles` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:36:02.918471 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bc3b9ce-d72a-49fd-9fba-1b7fdf13c8eb None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=282899) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:36:02.918804 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bc3b9ce-d72a-49fd-9fba-1b7fdf13c8eb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:36:02.920613 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bc3b9ce-d72a-49fd-9fba-1b7fdf13c8eb None admin] RBAC: Authorization granted {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:36:02.929808 dv-cinder-851351-1-smb devstack@keystone.service[282899]: [pid: 282899|app: 0|req: 61/116] 10.222.0.42 () {56 vars in 1111 bytes} [Thu Jul 28 08:36:02 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:36:02.930556 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc3b9ce-d72a-49fd-9fba-1b7fdf13c8eb None admin] Authenticating user token {{(pid=282899) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:36:02.952869 dv-cinder-851351-1-smb devstack@keystone.service[282898]: [pid: 282898|app: 0|req: 56/117] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 08:36:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 08:36:02.953496 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a0de2a-11e5-4f56-bda0-f5713c8c46bb None None] Authenticating user token {{(pid=282898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:36:02.989260 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG dbcounter [-] [282899] Writing DB stats keystone:SELECT=100 {{(pid=282899) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:36:03.022238 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG dbcounter [-] [282898] Writing DB stats keystone:SELECT=100 {{(pid=282898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:36:03.055862 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc3b9ce-d72a-49fd-9fba-1b7fdf13c8eb None admin] Validating token access rules against request {{(pid=282899) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:36:03.068073 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a0de2a-11e5-4f56-bda0-f5713c8c46bb None None] Validating token access rules against request {{(pid=282898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:36:03.092253 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca111c7-a93f-4d44-818f-fb0eb96c56f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282899) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:36:03.092939 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca111c7-a93f-4d44-818f-fb0eb96c56f4 None admin] REQUEST_METHOD: `GET` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:36:03.093229 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca111c7-a93f-4d44-818f-fb0eb96c56f4 None admin] SCRIPT_NAME: `/identity` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:36:03.093519 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca111c7-a93f-4d44-818f-fb0eb96c56f4 None admin] PATH_INFO: `/v3/roles` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:36:03.094265 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eca111c7-a93f-4d44-818f-fb0eb96c56f4 None admin] RBAC: Adding query filter params (name=reader) {{(pid=282899) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:36:03.094582 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eca111c7-a93f-4d44-818f-fb0eb96c56f4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:36:03.096007 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eca111c7-a93f-4d44-818f-fb0eb96c56f4 None admin] RBAC: Authorization granted {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:36:03.104499 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e739dd3a-96a4-4f40-adca-92054f55a949 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:36:03.105067 dv-cinder-851351-1-smb devstack@keystone.service[282899]: [pid: 282899|app: 0|req: 62/118] 10.222.0.42 () {56 vars in 1101 bytes} [Thu Jul 28 08:36:02 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:36:03.105285 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e739dd3a-96a4-4f40-adca-92054f55a949 None admin] REQUEST_METHOD: `GET` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:36:03.105581 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e739dd3a-96a4-4f40-adca-92054f55a949 None admin] SCRIPT_NAME: `/identity` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:36:03.105865 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e739dd3a-96a4-4f40-adca-92054f55a949 None admin] PATH_INFO: `/v3/users/2be990a66857410a87ffa7609aec4f7b` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:36:03.107129 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e739dd3a-96a4-4f40-adca-92054f55a949 None admin] RBAC: Authorizing `identity:get_user(user_id=2be990a66857410a87ffa7609aec4f7b)` {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:36:03.108607 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e739dd3a-96a4-4f40-adca-92054f55a949 None admin] RBAC: Authorization granted {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:36:03.110497 dv-cinder-851351-1-smb devstack@keystone.service[282898]: [pid: 282898|app: 0|req: 57/119] 10.222.0.42 () {56 vars in 1177 bytes} [Thu Jul 28 08:36:02 2022] GET /identity/v3/users/2be990a66857410a87ffa7609aec4f7b => generated 247 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:36:03.110620 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48e2d84-3417-4cdf-a107-ed99c6f14a6a None None] REQUEST_METHOD: `GET` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:36:03.110862 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48e2d84-3417-4cdf-a107-ed99c6f14a6a None None] SCRIPT_NAME: `/identity` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:36:03.111153 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48e2d84-3417-4cdf-a107-ed99c6f14a6a None None] PATH_INFO: `/` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:36:03.111286 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e739dd3a-96a4-4f40-adca-92054f55a949 None admin] Authenticating user token {{(pid=282898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:36:03.112569 dv-cinder-851351-1-smb devstack@keystone.service[282899]: [pid: 282899|app: 0|req: 63/120] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 08:36:03 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 08:36:03.117335 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48e2d84-3417-4cdf-a107-ed99c6f14a6a None None] Authenticating user token {{(pid=282899) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:36:03.217996 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e739dd3a-96a4-4f40-adca-92054f55a949 None admin] Validating token access rules against request {{(pid=282898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:36:03.220486 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48e2d84-3417-4cdf-a107-ed99c6f14a6a None None] Validating token access rules against request {{(pid=282899) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:36:03.222972 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG dbcounter [-] [282899] Writing DB stats keystone:SELECT=100 {{(pid=282899) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:36:03.248189 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG dbcounter [-] [282898] Writing DB stats keystone:SELECT=100 {{(pid=282898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:36:03.257185 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58f20f3-89ce-4f00-bdf0-0ed9048fe452 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282899) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:36:03.257856 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58f20f3-89ce-4f00-bdf0-0ed9048fe452 None admin] REQUEST_METHOD: `GET` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:36:03.258148 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58f20f3-89ce-4f00-bdf0-0ed9048fe452 None admin] SCRIPT_NAME: `/identity` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:36:03.258278 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed023d28-9c14-4921-b59e-2b9274788308 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:36:03.258478 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58f20f3-89ce-4f00-bdf0-0ed9048fe452 None admin] PATH_INFO: `/v3/domains/default` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:36:03.258975 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed023d28-9c14-4921-b59e-2b9274788308 None admin] REQUEST_METHOD: `GET` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:36:03.259213 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed023d28-9c14-4921-b59e-2b9274788308 None admin] SCRIPT_NAME: `/identity` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:36:03.259494 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed023d28-9c14-4921-b59e-2b9274788308 None admin] PATH_INFO: `/v3/users/ff1f8d5551c44d2781c7ed09cd18be32` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:36:03.259596 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c58f20f3-89ce-4f00-bdf0-0ed9048fe452 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:36:03.260716 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed023d28-9c14-4921-b59e-2b9274788308 None admin] RBAC: Authorizing `identity:get_user(user_id=ff1f8d5551c44d2781c7ed09cd18be32)` {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:36:03.261105 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c58f20f3-89ce-4f00-bdf0-0ed9048fe452 None admin] RBAC: Authorization granted {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:36:03.262259 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed023d28-9c14-4921-b59e-2b9274788308 None admin] RBAC: Authorization granted {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:36:03.262999 dv-cinder-851351-1-smb devstack@keystone.service[282899]: [pid: 282899|app: 0|req: 64/121] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 08:36:03 2022] GET /identity/v3/domains/default => generated 199 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:36:03.263571 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58f20f3-89ce-4f00-bdf0-0ed9048fe452 None admin] Authenticating user token {{(pid=282899) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:36:03.270376 dv-cinder-851351-1-smb devstack@keystone.service[282898]: [pid: 282898|app: 0|req: 58/122] 10.222.0.42 () {56 vars in 1177 bytes} [Thu Jul 28 08:36:03 2022] GET /identity/v3/users/ff1f8d5551c44d2781c7ed09cd18be32 => generated 275 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:36:03.271218 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed023d28-9c14-4921-b59e-2b9274788308 None admin] Authenticating user token {{(pid=282898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:36:03.375045 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58f20f3-89ce-4f00-bdf0-0ed9048fe452 None admin] Validating token access rules against request {{(pid=282899) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:36:03.381976 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed023d28-9c14-4921-b59e-2b9274788308 None admin] Validating token access rules against request {{(pid=282898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:36:03.410119 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d8d001-8cf2-49db-bc63-5446c70511d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282899) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:36:03.410852 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d8d001-8cf2-49db-bc63-5446c70511d4 None admin] REQUEST_METHOD: `GET` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:36:03.411136 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d8d001-8cf2-49db-bc63-5446c70511d4 None admin] SCRIPT_NAME: `/identity` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:36:03.411415 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d8d001-8cf2-49db-bc63-5446c70511d4 None admin] PATH_INFO: `/v3/users/aada0588d55b4592af9d57baa4a887fb` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:36:03.416651 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-436144c9-87ab-41da-9a62-5eca4b878aac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:36:03.417336 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436144c9-87ab-41da-9a62-5eca4b878aac None admin] REQUEST_METHOD: `GET` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:36:03.417625 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436144c9-87ab-41da-9a62-5eca4b878aac None admin] SCRIPT_NAME: `/identity` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:36:03.417907 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436144c9-87ab-41da-9a62-5eca4b878aac None admin] PATH_INFO: `/v3/projects/c089873b22dd43e8a9de1c83b1355842` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:36:03.419095 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-436144c9-87ab-41da-9a62-5eca4b878aac None admin] RBAC: Authorizing `identity:get_project(project_id=c089873b22dd43e8a9de1c83b1355842)` {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:36:03.420587 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-436144c9-87ab-41da-9a62-5eca4b878aac None admin] RBAC: Authorization granted {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:36:03.422372 dv-cinder-851351-1-smb devstack@keystone.service[282898]: [pid: 282898|app: 0|req: 59/123] 10.222.0.42 () {56 vars in 1186 bytes} [Thu Jul 28 08:36:03 2022] GET /identity/v3/projects/c089873b22dd43e8a9de1c83b1355842 => generated 298 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:36:03.423693 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2908fea-1fb6-4403-b34f-b650f5abdbc0 None None] REQUEST_METHOD: `POST` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:36:03.423969 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2908fea-1fb6-4403-b34f-b650f5abdbc0 None None] SCRIPT_NAME: `/identity` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:36:03.424277 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2908fea-1fb6-4403-b34f-b650f5abdbc0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:36:03.428168 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48d8d001-8cf2-49db-bc63-5446c70511d4 None admin] RBAC: Authorizing `identity:get_user(user_id=aada0588d55b4592af9d57baa4a887fb)` {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:36:03.429922 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48d8d001-8cf2-49db-bc63-5446c70511d4 None admin] RBAC: Authorization granted {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:36:03.432949 dv-cinder-851351-1-smb devstack@keystone.service[282899]: [pid: 282899|app: 0|req: 65/124] 10.222.0.42 () {56 vars in 1177 bytes} [Thu Jul 28 08:36:03 2022] GET /identity/v3/users/aada0588d55b4592af9d57baa4a887fb => generated 289 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:36:03.437542 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d8d001-8cf2-49db-bc63-5446c70511d4 None admin] Authenticating user token {{(pid=282899) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:36:03.443949 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.auth.core [None req-e2908fea-1fb6-4403-b34f-b650f5abdbc0 None None] MFA Rules not processed for user `2be990a66857410a87ffa7609aec4f7b`. Rule list: `[]` (Enabled: `True`). {{(pid=282898) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 08:36:03.445206 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.fernet_utils [None req-e2908fea-1fb6-4403-b34f-b650f5abdbc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=282898) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:36:03.473191 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG dbcounter [-] [282899] Writing DB stats keystone:SELECT=100 {{(pid=282899) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:36:03.508839 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG dbcounter [-] [282898] Writing DB stats keystone:SELECT=100 {{(pid=282898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:36:03.517876 dv-cinder-851351-1-smb devstack@keystone.service[282898]: [pid: 282898|app: 0|req: 60/125] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 08:36:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 08:36:03.518578 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2908fea-1fb6-4403-b34f-b650f5abdbc0 None None] Authenticating user token {{(pid=282898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:36:03.557381 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d8d001-8cf2-49db-bc63-5446c70511d4 None admin] Validating token access rules against request {{(pid=282899) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:36:03.594980 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c11e9100-78a3-4bfa-9791-fa9d4d77f5e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282899) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:36:03.595898 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11e9100-78a3-4bfa-9791-fa9d4d77f5e7 None admin] REQUEST_METHOD: `POST` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:36:03.596186 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11e9100-78a3-4bfa-9791-fa9d4d77f5e7 None admin] SCRIPT_NAME: `/identity` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:36:03.596471 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11e9100-78a3-4bfa-9791-fa9d4d77f5e7 None admin] PATH_INFO: `/v3/projects` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:36:03.597271 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c11e9100-78a3-4bfa-9791-fa9d4d77f5e7 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:36:03.598801 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c11e9100-78a3-4bfa-9791-fa9d4d77f5e7 None admin] RBAC: Authorization granted {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:36:03.622159 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2908fea-1fb6-4403-b34f-b650f5abdbc0 None None] Validating token access rules against request {{(pid=282898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:36:03.632698 dv-cinder-851351-1-smb devstack@keystone.service[282899]: [pid: 282899|app: 0|req: 66/126] 10.222.0.42 () {60 vars in 1141 bytes} [Thu Jul 28 08:36:03 2022] POST /identity/v3/projects => generated 302 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 08:36:03.632698 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c11e9100-78a3-4bfa-9791-fa9d4d77f5e7 None admin] Authenticating user token {{(pid=282899) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:36:03.669309 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf894f2-e953-4fb7-bc4f-8dd65c8f5720 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:36:03.670061 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf894f2-e953-4fb7-bc4f-8dd65c8f5720 None admin] REQUEST_METHOD: `GET` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:36:03.670352 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf894f2-e953-4fb7-bc4f-8dd65c8f5720 None admin] SCRIPT_NAME: `/identity` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:36:03.670635 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf894f2-e953-4fb7-bc4f-8dd65c8f5720 None admin] PATH_INFO: `/v3/projects/c089873b22dd43e8a9de1c83b1355842` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:36:03.671975 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bf894f2-e953-4fb7-bc4f-8dd65c8f5720 None admin] RBAC: Authorizing `identity:get_project(project_id=c089873b22dd43e8a9de1c83b1355842)` {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:36:03.673701 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bf894f2-e953-4fb7-bc4f-8dd65c8f5720 None admin] RBAC: Authorization granted {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:36:03.675821 dv-cinder-851351-1-smb devstack@keystone.service[282898]: [pid: 282898|app: 0|req: 61/127] 10.222.0.42 () {56 vars in 1186 bytes} [Thu Jul 28 08:36:03 2022] GET /identity/v3/projects/c089873b22dd43e8a9de1c83b1355842 => generated 298 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:36:03.677040 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf894f2-e953-4fb7-bc4f-8dd65c8f5720 None admin] Authenticating user token {{(pid=282898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:36:03.755056 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG dbcounter [-] [282898] Writing DB stats keystone:SELECT=100 {{(pid=282898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:36:03.760902 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG dbcounter [-] [282899] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=282899) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:36:03.774337 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c11e9100-78a3-4bfa-9791-fa9d4d77f5e7 None admin] Validating token access rules against request {{(pid=282899) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:36:03.809391 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf894f2-e953-4fb7-bc4f-8dd65c8f5720 None admin] Validating token access rules against request {{(pid=282898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:36:03.813696 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ebae04-4951-42f9-ada9-f1fb7f9b2559 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282899) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:36:03.814417 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ebae04-4951-42f9-ada9-f1fb7f9b2559 None admin] REQUEST_METHOD: `PUT` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:36:03.814713 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ebae04-4951-42f9-ada9-f1fb7f9b2559 None admin] SCRIPT_NAME: `/identity` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:36:03.815002 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ebae04-4951-42f9-ada9-f1fb7f9b2559 None admin] PATH_INFO: `/v3/projects/c089873b22dd43e8a9de1c83b1355842/users/2be990a66857410a87ffa7609aec4f7b/roles/a0e2a00bf94d40f38629d6b5293e3aee` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:36:03.817170 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ebae04-4951-42f9-ada9-f1fb7f9b2559 None admin] RBAC: Authorizing `identity:create_grant(project_id=c089873b22dd43e8a9de1c83b1355842, user_id=2be990a66857410a87ffa7609aec4f7b, role_id=a0e2a00bf94d40f38629d6b5293e3aee)` {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:36:03.819045 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ebae04-4951-42f9-ada9-f1fb7f9b2559 None admin] RBAC: Authorization granted {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:36:03.837685 dv-cinder-851351-1-smb devstack@keystone.service[282899]: [pid: 282899|app: 0|req: 67/128] 10.222.0.42 () {58 vars in 1439 bytes} [Thu Jul 28 08:36:03 2022] PUT /identity/v3/projects/c089873b22dd43e8a9de1c83b1355842/users/2be990a66857410a87ffa7609aec4f7b/roles/a0e2a00bf94d40f38629d6b5293e3aee => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 08:36:03.841768 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ebae04-4951-42f9-ada9-f1fb7f9b2559 None admin] Authenticating user token {{(pid=282899) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:36:03.859306 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e52de75-6242-4840-bf3c-af694b740fc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:36:03.859959 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e52de75-6242-4840-bf3c-af694b740fc9 None admin] REQUEST_METHOD: `GET` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:36:03.860246 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e52de75-6242-4840-bf3c-af694b740fc9 None admin] SCRIPT_NAME: `/identity` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:36:03.860525 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e52de75-6242-4840-bf3c-af694b740fc9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:36:03.968245 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e52de75-6242-4840-bf3c-af694b740fc9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:36:03.970508 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e52de75-6242-4840-bf3c-af694b740fc9 None admin] RBAC: Authorization granted {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:36:04.006074 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ebae04-4951-42f9-ada9-f1fb7f9b2559 None admin] Validating token access rules against request {{(pid=282899) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:36:04.052901 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d843bf1-a2f3-4af8-8e09-ab30b0799040 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282899) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:36:04.054609 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d843bf1-a2f3-4af8-8e09-ab30b0799040 None admin] REQUEST_METHOD: `GET` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:36:04.055713 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d843bf1-a2f3-4af8-8e09-ab30b0799040 None admin] SCRIPT_NAME: `/identity` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:36:04.056248 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d843bf1-a2f3-4af8-8e09-ab30b0799040 None admin] PATH_INFO: `/v3/roles/member` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:36:04.061153 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG dbcounter [-] [282898] Writing DB stats keystone:SELECT=100 {{(pid=282898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:36:04.071578 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d843bf1-a2f3-4af8-8e09-ab30b0799040 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 08:36:04.077163 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application [None req-6d843bf1-a2f3-4af8-8e09-ab30b0799040 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 28 08:36:04.077163 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:36:04.077163 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:36:04.077163 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:36:04.077163 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:36:04.077163 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:36:04.077163 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:36:04.077163 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:36:04.077163 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:36:04.077163 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:36:04.077163 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:36:04.077163 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:36:04.077163 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 08:36:04.077163 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 08:36:04.077163 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 08:36:04.077163 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 08:36:04.078222 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 08:36:04.078222 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 08:36:04.078222 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 08:36:04.078222 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 08:36:04.078222 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:36:04.078222 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:36:04.078222 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:36:04.078222 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:36:04.078222 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:36:04.078222 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:36:04.078222 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:36:04.078222 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application with Lock( Jul 28 08:36:04.078222 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:36:04.078222 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:36:04.078222 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:36:04.078222 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:36:04.079182 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:36:04.079182 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:36:04.079182 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:36:04.079182 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:36:04.079182 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 08:36:04.079182 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 08:36:04.079182 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 08:36:04.079182 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 08:36:04.079182 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 08:36:04.079182 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 08:36:04.079182 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 28 08:36:04.079182 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application Jul 28 08:36:04.079182 dv-cinder-851351-1-smb devstack@keystone.service[282899]: [pid: 282899|app: 0|req: 68/129] 10.222.0.42 () {56 vars in 1099 bytes} [Thu Jul 28 08:36:03 2022] GET /identity/v3/roles/member => generated 84 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:36:04.080298 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d843bf1-a2f3-4af8-8e09-ab30b0799040 None admin] Authenticating user token {{(pid=282899) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:36:04.086215 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG dbcounter [-] [282899] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=282899) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:36:04.122617 dv-cinder-851351-1-smb devstack@keystone.service[282898]: [pid: 282898|app: 0|req: 62/130] 10.222.0.42 () {58 vars in 1282 bytes} [Thu Jul 28 08:36:03 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 446 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 28 08:36:04.123864 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e52de75-6242-4840-bf3c-af694b740fc9 None admin] Authenticating user token {{(pid=282898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:36:04.206752 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d843bf1-a2f3-4af8-8e09-ab30b0799040 None admin] Validating token access rules against request {{(pid=282899) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:36:04.247501 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7b5e70-b672-4568-9e3a-fe241493b021 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282899) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:36:04.248272 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7b5e70-b672-4568-9e3a-fe241493b021 None admin] REQUEST_METHOD: `PUT` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:36:04.248568 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7b5e70-b672-4568-9e3a-fe241493b021 None admin] SCRIPT_NAME: `/identity` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:36:04.248982 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7b5e70-b672-4568-9e3a-fe241493b021 None admin] PATH_INFO: `/v3/projects/c089873b22dd43e8a9de1c83b1355842/users/ff1f8d5551c44d2781c7ed09cd18be32/roles/d76677105be344cc83022cbde8a22d8d` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:36:04.251511 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c7b5e70-b672-4568-9e3a-fe241493b021 None admin] RBAC: Authorizing `identity:create_grant(project_id=c089873b22dd43e8a9de1c83b1355842, user_id=ff1f8d5551c44d2781c7ed09cd18be32, role_id=d76677105be344cc83022cbde8a22d8d)` {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:36:04.253180 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c7b5e70-b672-4568-9e3a-fe241493b021 None admin] RBAC: Authorization granted {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:36:04.257301 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e52de75-6242-4840-bf3c-af694b740fc9 None admin] Validating token access rules against request {{(pid=282898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:36:04.270179 dv-cinder-851351-1-smb devstack@keystone.service[282899]: [pid: 282899|app: 0|req: 69/131] 10.222.0.42 () {58 vars in 1439 bytes} [Thu Jul 28 08:36:04 2022] PUT /identity/v3/projects/c089873b22dd43e8a9de1c83b1355842/users/ff1f8d5551c44d2781c7ed09cd18be32/roles/d76677105be344cc83022cbde8a22d8d => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 08:36:04.271473 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7b5e70-b672-4568-9e3a-fe241493b021 None admin] Authenticating user token {{(pid=282899) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:36:04.317048 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-301b19c5-4554-492f-9177-b6066183d2ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:36:04.317987 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301b19c5-4554-492f-9177-b6066183d2ae None admin] REQUEST_METHOD: `GET` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:36:04.318468 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301b19c5-4554-492f-9177-b6066183d2ae None admin] SCRIPT_NAME: `/identity` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:36:04.324703 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301b19c5-4554-492f-9177-b6066183d2ae None admin] PATH_INFO: `/v3/roles` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:36:04.326040 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-301b19c5-4554-492f-9177-b6066183d2ae None admin] RBAC: Adding query filter params (name=member) {{(pid=282898) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:36:04.326515 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-301b19c5-4554-492f-9177-b6066183d2ae None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:36:04.328163 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-301b19c5-4554-492f-9177-b6066183d2ae None admin] RBAC: Authorization granted {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:36:04.344649 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG dbcounter [-] [282899] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=282899) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:36:04.349224 dv-cinder-851351-1-smb devstack@keystone.service[282898]: [pid: 282898|app: 0|req: 63/132] 10.222.0.42 () {56 vars in 1101 bytes} [Thu Jul 28 08:36:04 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:36:04.366800 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ed76d7-22b6-4337-a30c-26b03b56cfdd None None] REQUEST_METHOD: `GET` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:36:04.367018 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ed76d7-22b6-4337-a30c-26b03b56cfdd None None] SCRIPT_NAME: `/identity` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:36:04.367267 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ed76d7-22b6-4337-a30c-26b03b56cfdd None None] PATH_INFO: `/` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:36:04.368620 dv-cinder-851351-1-smb devstack@keystone.service[282898]: [pid: 282898|app: 0|req: 64/133] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 08:36:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 28 08:36:04.369455 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ed76d7-22b6-4337-a30c-26b03b56cfdd None None] Authenticating user token {{(pid=282898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:36:04.408714 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7b5e70-b672-4568-9e3a-fe241493b021 None admin] Validating token access rules against request {{(pid=282899) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:36:04.423357 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG dbcounter [-] [282898] Writing DB stats keystone:SELECT=100 {{(pid=282898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:36:04.451857 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e636d0e-f293-4a5e-a3d8-fd4db3ac3bca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282899) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:36:04.453088 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e636d0e-f293-4a5e-a3d8-fd4db3ac3bca None admin] REQUEST_METHOD: `GET` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:36:04.453605 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e636d0e-f293-4a5e-a3d8-fd4db3ac3bca None admin] SCRIPT_NAME: `/identity` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:36:04.454179 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e636d0e-f293-4a5e-a3d8-fd4db3ac3bca None admin] PATH_INFO: `/v3/projects/c089873b22dd43e8a9de1c83b1355842` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:36:04.456163 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e636d0e-f293-4a5e-a3d8-fd4db3ac3bca None admin] RBAC: Authorizing `identity:get_project(project_id=c089873b22dd43e8a9de1c83b1355842)` {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:36:04.458084 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e636d0e-f293-4a5e-a3d8-fd4db3ac3bca None admin] RBAC: Authorization granted {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:36:04.460355 dv-cinder-851351-1-smb devstack@keystone.service[282899]: [pid: 282899|app: 0|req: 70/134] 10.222.0.42 () {56 vars in 1186 bytes} [Thu Jul 28 08:36:04 2022] GET /identity/v3/projects/c089873b22dd43e8a9de1c83b1355842 => generated 298 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:36:04.462238 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94855208-0960-4fec-acb3-057b14bf9f97 None None] REQUEST_METHOD: `POST` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:36:04.462811 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94855208-0960-4fec-acb3-057b14bf9f97 None None] SCRIPT_NAME: `/identity` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:36:04.463298 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94855208-0960-4fec-acb3-057b14bf9f97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:36:04.486823 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.auth.core [None req-94855208-0960-4fec-acb3-057b14bf9f97 None None] MFA Rules not processed for user `2be990a66857410a87ffa7609aec4f7b`. Rule list: `[]` (Enabled: `True`). {{(pid=282899) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 08:36:04.488639 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.fernet_utils [None req-94855208-0960-4fec-acb3-057b14bf9f97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=282899) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:36:04.553931 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ed76d7-22b6-4337-a30c-26b03b56cfdd None None] Validating token access rules against request {{(pid=282898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:36:04.567134 dv-cinder-851351-1-smb devstack@keystone.service[282899]: [pid: 282899|app: 0|req: 71/135] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 08:36:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 08:36:04.568520 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94855208-0960-4fec-acb3-057b14bf9f97 None None] Authenticating user token {{(pid=282899) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:36:04.591709 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7bd8dc2-d3a6-4a27-8cc3-951c0600a5aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:36:04.592372 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7bd8dc2-d3a6-4a27-8cc3-951c0600a5aa None admin] REQUEST_METHOD: `GET` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:36:04.592676 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7bd8dc2-d3a6-4a27-8cc3-951c0600a5aa None admin] SCRIPT_NAME: `/identity` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:36:04.592973 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7bd8dc2-d3a6-4a27-8cc3-951c0600a5aa None admin] PATH_INFO: `/v3/users/ff1f8d5551c44d2781c7ed09cd18be32` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:36:04.594263 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7bd8dc2-d3a6-4a27-8cc3-951c0600a5aa None admin] RBAC: Authorizing `identity:get_user(user_id=ff1f8d5551c44d2781c7ed09cd18be32)` {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:36:04.595745 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7bd8dc2-d3a6-4a27-8cc3-951c0600a5aa None admin] RBAC: Authorization granted {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:36:04.597548 dv-cinder-851351-1-smb devstack@keystone.service[282898]: [pid: 282898|app: 0|req: 65/136] 10.222.0.42 () {56 vars in 1177 bytes} [Thu Jul 28 08:36:04 2022] GET /identity/v3/users/ff1f8d5551c44d2781c7ed09cd18be32 => generated 275 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:36:04.603398 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7bd8dc2-d3a6-4a27-8cc3-951c0600a5aa None admin] Authenticating user token {{(pid=282898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:36:04.635332 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG dbcounter [-] [282899] Writing DB stats keystone:SELECT=100 {{(pid=282899) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:36:04.680646 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94855208-0960-4fec-acb3-057b14bf9f97 None None] Validating token access rules against request {{(pid=282899) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:36:04.716862 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7bd8dc2-d3a6-4a27-8cc3-951c0600a5aa None admin] Validating token access rules against request {{(pid=282898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:36:04.721729 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG dbcounter [-] [282898] Writing DB stats keystone:SELECT=100 {{(pid=282898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:36:04.740284 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a7780db-31a4-4af6-8f48-e73b0ea88f5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282899) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:36:04.741163 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7780db-31a4-4af6-8f48-e73b0ea88f5c None admin] REQUEST_METHOD: `GET` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:36:04.741594 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7780db-31a4-4af6-8f48-e73b0ea88f5c None admin] SCRIPT_NAME: `/identity` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:36:04.741975 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7780db-31a4-4af6-8f48-e73b0ea88f5c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:36:04.742902 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a7780db-31a4-4af6-8f48-e73b0ea88f5c None admin] RBAC: Adding query filter params (role.id=34c6ec459a944c46a4265d15a06e348d, scope.project.id=c089873b22dd43e8a9de1c83b1355842, user.id=aada0588d55b4592af9d57baa4a887fb) {{(pid=282899) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:36:04.743321 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a7780db-31a4-4af6-8f48-e73b0ea88f5c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:36:04.745035 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a7780db-31a4-4af6-8f48-e73b0ea88f5c None admin] RBAC: Authorization granted {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:36:04.748376 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cceccd8-e281-4bac-a143-63b9d649ee82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:36:04.749259 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cceccd8-e281-4bac-a143-63b9d649ee82 None admin] REQUEST_METHOD: `GET` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:36:04.749698 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cceccd8-e281-4bac-a143-63b9d649ee82 None admin] SCRIPT_NAME: `/identity` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:36:04.750121 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cceccd8-e281-4bac-a143-63b9d649ee82 None admin] PATH_INFO: `/v3/projects/2e5945424520462faafca339c1faf342` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:36:04.751446 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cceccd8-e281-4bac-a143-63b9d649ee82 None admin] RBAC: Authorizing `identity:get_project(project_id=2e5945424520462faafca339c1faf342)` {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:36:04.753079 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cceccd8-e281-4bac-a143-63b9d649ee82 None admin] RBAC: Authorization granted {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:36:04.754965 dv-cinder-851351-1-smb devstack@keystone.service[282898]: [pid: 282898|app: 0|req: 66/137] 10.222.0.42 () {56 vars in 1186 bytes} [Thu Jul 28 08:36:04 2022] GET /identity/v3/projects/2e5945424520462faafca339c1faf342 => generated 312 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 08:36:04.755877 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cceccd8-e281-4bac-a143-63b9d649ee82 None admin] Authenticating user token {{(pid=282898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:36:04.760727 dv-cinder-851351-1-smb devstack@keystone.service[282899]: [pid: 282899|app: 0|req: 72/138] 10.222.0.42 () {56 vars in 1374 bytes} [Thu Jul 28 08:36:04 2022] GET /identity/v3/role_assignments?user.id=aada0588d55b4592af9d57baa4a887fb&scope.project.id=c089873b22dd43e8a9de1c83b1355842&role.id=34c6ec459a944c46a4265d15a06e348d => generated 259 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:36:04.770857 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a7780db-31a4-4af6-8f48-e73b0ea88f5c None admin] Authenticating user token {{(pid=282899) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:36:04.931801 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cceccd8-e281-4bac-a143-63b9d649ee82 None admin] Validating token access rules against request {{(pid=282898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:36:04.989381 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceadee19-8ceb-4a5d-bfd9-c92262b938f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:36:04.990354 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceadee19-8ceb-4a5d-bfd9-c92262b938f8 None admin] REQUEST_METHOD: `GET` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:36:04.990817 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceadee19-8ceb-4a5d-bfd9-c92262b938f8 None admin] SCRIPT_NAME: `/identity` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:36:04.991254 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceadee19-8ceb-4a5d-bfd9-c92262b938f8 None admin] PATH_INFO: `/v3/roles/member` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:36:05.003543 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceadee19-8ceb-4a5d-bfd9-c92262b938f8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 08:36:05.009740 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application [None req-ceadee19-8ceb-4a5d-bfd9-c92262b938f8 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 28 08:36:05.009740 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:36:05.009740 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:36:05.009740 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:36:05.009740 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:36:05.009740 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:36:05.009740 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:36:05.009740 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:36:05.009740 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:36:05.009740 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:36:05.009740 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:36:05.009740 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:36:05.009740 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 08:36:05.009740 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 08:36:05.009740 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 08:36:05.009740 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 08:36:05.010967 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 08:36:05.010967 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 08:36:05.010967 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 08:36:05.010967 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 08:36:05.010967 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:36:05.010967 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:36:05.010967 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:36:05.010967 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:36:05.010967 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:36:05.010967 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:36:05.010967 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:36:05.010967 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application with Lock( Jul 28 08:36:05.010967 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:36:05.010967 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:36:05.010967 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:36:05.010967 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:36:05.012063 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:36:05.012063 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:36:05.012063 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:36:05.012063 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:36:05.012063 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 08:36:05.012063 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 08:36:05.012063 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 08:36:05.012063 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 08:36:05.012063 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 08:36:05.012063 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 08:36:05.012063 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 28 08:36:05.012063 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application Jul 28 08:36:05.014531 dv-cinder-851351-1-smb devstack@keystone.service[282898]: [pid: 282898|app: 0|req: 67/139] 10.222.0.42 () {56 vars in 1099 bytes} [Thu Jul 28 08:36:04 2022] GET /identity/v3/roles/member => generated 84 bytes in 259 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:36:05.014670 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a7780db-31a4-4af6-8f48-e73b0ea88f5c None admin] Validating token access rules against request {{(pid=282899) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:36:05.023632 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceadee19-8ceb-4a5d-bfd9-c92262b938f8 None admin] Authenticating user token {{(pid=282898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:36:05.053174 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG dbcounter [-] [282899] Writing DB stats keystone:SELECT=100 {{(pid=282899) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:36:05.057017 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG dbcounter [-] [282898] Writing DB stats keystone:SELECT=100 {{(pid=282898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:36:05.069451 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2854a3-ef01-47c2-8972-e8367ea41503 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282899) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:36:05.070421 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2854a3-ef01-47c2-8972-e8367ea41503 None admin] REQUEST_METHOD: `PUT` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:36:05.071143 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2854a3-ef01-47c2-8972-e8367ea41503 None admin] SCRIPT_NAME: `/identity` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:36:05.071728 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2854a3-ef01-47c2-8972-e8367ea41503 None admin] PATH_INFO: `/v3/projects/2e5945424520462faafca339c1faf342/users/ff1f8d5551c44d2781c7ed09cd18be32/roles/eaeb4674b16f497f8afb3384e7e9a3c6` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:36:05.074244 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc2854a3-ef01-47c2-8972-e8367ea41503 None admin] RBAC: Authorizing `identity:create_grant(project_id=2e5945424520462faafca339c1faf342, user_id=ff1f8d5551c44d2781c7ed09cd18be32, role_id=eaeb4674b16f497f8afb3384e7e9a3c6)` {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:36:05.075921 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc2854a3-ef01-47c2-8972-e8367ea41503 None admin] RBAC: Authorization granted {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:36:05.092731 dv-cinder-851351-1-smb devstack@keystone.service[282899]: [pid: 282899|app: 0|req: 73/140] 10.222.0.42 () {58 vars in 1439 bytes} [Thu Jul 28 08:36:04 2022] PUT /identity/v3/projects/2e5945424520462faafca339c1faf342/users/ff1f8d5551c44d2781c7ed09cd18be32/roles/eaeb4674b16f497f8afb3384e7e9a3c6 => generated 0 bytes in 322 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 28 08:36:05.215124 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceadee19-8ceb-4a5d-bfd9-c92262b938f8 None admin] Validating token access rules against request {{(pid=282898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:36:05.258181 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a6dd9b-9bb9-41d9-bed0-8fed36af22b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:36:05.258868 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a6dd9b-9bb9-41d9-bed0-8fed36af22b6 None admin] REQUEST_METHOD: `GET` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:36:05.259106 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a6dd9b-9bb9-41d9-bed0-8fed36af22b6 None admin] SCRIPT_NAME: `/identity` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:36:05.259378 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a6dd9b-9bb9-41d9-bed0-8fed36af22b6 None admin] PATH_INFO: `/v3/roles` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:36:05.260205 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3a6dd9b-9bb9-41d9-bed0-8fed36af22b6 None admin] RBAC: Adding query filter params (name=member) {{(pid=282898) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:36:05.260521 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3a6dd9b-9bb9-41d9-bed0-8fed36af22b6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:36:05.262019 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3a6dd9b-9bb9-41d9-bed0-8fed36af22b6 None admin] RBAC: Authorization granted {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:36:05.272087 dv-cinder-851351-1-smb devstack@keystone.service[282898]: [pid: 282898|app: 0|req: 68/141] 10.222.0.42 () {56 vars in 1101 bytes} [Thu Jul 28 08:36:05 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:36:05.277605 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2854a3-ef01-47c2-8972-e8367ea41503 None admin] Authenticating user token {{(pid=282899) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:36:05.438139 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2854a3-ef01-47c2-8972-e8367ea41503 None admin] Validating token access rules against request {{(pid=282899) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:36:05.476205 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b71f490-7a7d-4398-9fee-47020759e5c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282899) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:36:05.476908 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b71f490-7a7d-4398-9fee-47020759e5c3 None admin] REQUEST_METHOD: `GET` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:36:05.477193 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b71f490-7a7d-4398-9fee-47020759e5c3 None admin] SCRIPT_NAME: `/identity` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:36:05.477466 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b71f490-7a7d-4398-9fee-47020759e5c3 None admin] PATH_INFO: `/v3/users/ff1f8d5551c44d2781c7ed09cd18be32` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:36:05.478672 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b71f490-7a7d-4398-9fee-47020759e5c3 None admin] RBAC: Authorizing `identity:get_user(user_id=ff1f8d5551c44d2781c7ed09cd18be32)` {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:36:05.480151 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b71f490-7a7d-4398-9fee-47020759e5c3 None admin] RBAC: Authorization granted {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:36:05.482257 dv-cinder-851351-1-smb devstack@keystone.service[282899]: [pid: 282899|app: 0|req: 74/142] 10.222.0.42 () {56 vars in 1177 bytes} [Thu Jul 28 08:36:05 2022] GET /identity/v3/users/ff1f8d5551c44d2781c7ed09cd18be32 => generated 275 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:36:05.487921 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a6dd9b-9bb9-41d9-bed0-8fed36af22b6 None admin] Authenticating user token {{(pid=282898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:36:05.584387 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG dbcounter [-] [282898] Writing DB stats keystone:SELECT=100 {{(pid=282898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:36:05.605080 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a6dd9b-9bb9-41d9-bed0-8fed36af22b6 None admin] Validating token access rules against request {{(pid=282898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:36:05.650293 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2975966c-931c-4f37-bd8f-40072924ee2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:36:05.650949 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2975966c-931c-4f37-bd8f-40072924ee2b None admin] REQUEST_METHOD: `GET` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:36:05.651239 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2975966c-931c-4f37-bd8f-40072924ee2b None admin] SCRIPT_NAME: `/identity` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:36:05.651519 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2975966c-931c-4f37-bd8f-40072924ee2b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:36:05.732630 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2975966c-931c-4f37-bd8f-40072924ee2b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:36:05.734157 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2975966c-931c-4f37-bd8f-40072924ee2b None admin] RBAC: Authorization granted {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:36:05.833722 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG dbcounter [-] [282898] Writing DB stats keystone:SELECT=100 {{(pid=282898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:36:05.857185 dv-cinder-851351-1-smb devstack@keystone.service[282898]: [pid: 282898|app: 0|req: 69/143] 10.222.0.42 () {58 vars in 1282 bytes} [Thu Jul 28 08:36:05 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 370 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 28 08:36:05.863098 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b71f490-7a7d-4398-9fee-47020759e5c3 None admin] Authenticating user token {{(pid=282899) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:36:05.947870 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG dbcounter [-] [282899] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=282899) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:36:06.009113 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b71f490-7a7d-4398-9fee-47020759e5c3 None admin] Validating token access rules against request {{(pid=282899) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:36:06.049624 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3ddaa2-7ad0-425b-99e7-2ad09088aa1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282899) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:36:06.050290 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3ddaa2-7ad0-425b-99e7-2ad09088aa1e None admin] REQUEST_METHOD: `GET` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:36:06.050573 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3ddaa2-7ad0-425b-99e7-2ad09088aa1e None admin] SCRIPT_NAME: `/identity` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:36:06.050849 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3ddaa2-7ad0-425b-99e7-2ad09088aa1e None admin] PATH_INFO: `/v3/projects/c089873b22dd43e8a9de1c83b1355842` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:36:06.052113 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc3ddaa2-7ad0-425b-99e7-2ad09088aa1e None admin] RBAC: Authorizing `identity:get_project(project_id=c089873b22dd43e8a9de1c83b1355842)` {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:36:06.053610 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc3ddaa2-7ad0-425b-99e7-2ad09088aa1e None admin] RBAC: Authorization granted {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:36:06.055310 dv-cinder-851351-1-smb devstack@keystone.service[282899]: [pid: 282899|app: 0|req: 75/144] 10.222.0.42 () {56 vars in 1186 bytes} [Thu Jul 28 08:36:05 2022] GET /identity/v3/projects/c089873b22dd43e8a9de1c83b1355842 => generated 298 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:36:06.061247 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2975966c-931c-4f37-bd8f-40072924ee2b None admin] Authenticating user token {{(pid=282898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:36:06.175932 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2975966c-931c-4f37-bd8f-40072924ee2b None admin] Validating token access rules against request {{(pid=282898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:36:06.211116 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f0d1707-4bf0-46db-b146-06738d9f9c22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:36:06.211752 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0d1707-4bf0-46db-b146-06738d9f9c22 None admin] REQUEST_METHOD: `GET` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:36:06.212035 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0d1707-4bf0-46db-b146-06738d9f9c22 None admin] SCRIPT_NAME: `/identity` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:36:06.212310 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0d1707-4bf0-46db-b146-06738d9f9c22 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:36:06.213153 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f0d1707-4bf0-46db-b146-06738d9f9c22 None admin] RBAC: Adding query filter params (role.id=eaeb4674b16f497f8afb3384e7e9a3c6, scope.project.id=c089873b22dd43e8a9de1c83b1355842, user.id=ff1f8d5551c44d2781c7ed09cd18be32) {{(pid=282898) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:36:06.213465 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f0d1707-4bf0-46db-b146-06738d9f9c22 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:36:06.215008 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f0d1707-4bf0-46db-b146-06738d9f9c22 None admin] RBAC: Authorization granted {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:36:06.221243 dv-cinder-851351-1-smb devstack@keystone.service[282898]: [pid: 282898|app: 0|req: 70/145] 10.222.0.42 () {56 vars in 1374 bytes} [Thu Jul 28 08:36:06 2022] GET /identity/v3/role_assignments?user.id=ff1f8d5551c44d2781c7ed09cd18be32&scope.project.id=c089873b22dd43e8a9de1c83b1355842&role.id=eaeb4674b16f497f8afb3384e7e9a3c6 => generated 608 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:36:06.582684 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21986b3b-6457-49fd-a5b3-0cf625b060ba None None] REQUEST_METHOD: `GET` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:36:06.582972 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21986b3b-6457-49fd-a5b3-0cf625b060ba None None] SCRIPT_NAME: `/identity` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:36:06.583257 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21986b3b-6457-49fd-a5b3-0cf625b060ba None None] PATH_INFO: `/` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:36:06.584954 dv-cinder-851351-1-smb devstack@keystone.service[282899]: [pid: 282899|app: 0|req: 76/146] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 08:36:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 08:36:06.591109 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090e0116-9406-4e66-9dcd-65ddda1b2011 None None] REQUEST_METHOD: `POST` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:36:06.591705 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090e0116-9406-4e66-9dcd-65ddda1b2011 None None] SCRIPT_NAME: `/identity` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:36:06.591705 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090e0116-9406-4e66-9dcd-65ddda1b2011 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:36:06.611014 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.auth.core [None req-090e0116-9406-4e66-9dcd-65ddda1b2011 None None] MFA Rules not processed for user `2be990a66857410a87ffa7609aec4f7b`. Rule list: `[]` (Enabled: `True`). {{(pid=282898) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 08:36:06.612250 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.fernet_utils [None req-090e0116-9406-4e66-9dcd-65ddda1b2011 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=282898) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:36:06.667526 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG dbcounter [-] [282898] Writing DB stats keystone:SELECT=100 {{(pid=282898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:36:06.703083 dv-cinder-851351-1-smb devstack@keystone.service[282898]: [pid: 282898|app: 0|req: 71/147] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 08:36:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 08:36:06.729179 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21986b3b-6457-49fd-a5b3-0cf625b060ba None None] Authenticating user token {{(pid=282899) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:36:06.869778 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21986b3b-6457-49fd-a5b3-0cf625b060ba None None] Validating token access rules against request {{(pid=282899) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:36:06.905049 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG dbcounter [-] [282899] Writing DB stats keystone:SELECT=100 {{(pid=282899) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:36:06.926499 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8672b59-3b7f-48ee-9334-f7d03eb2155c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282899) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:36:06.927191 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8672b59-3b7f-48ee-9334-f7d03eb2155c None admin] REQUEST_METHOD: `GET` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:36:06.927471 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8672b59-3b7f-48ee-9334-f7d03eb2155c None admin] SCRIPT_NAME: `/identity` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:36:06.927748 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8672b59-3b7f-48ee-9334-f7d03eb2155c None admin] PATH_INFO: `/v3/domains/default` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:36:06.929015 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8672b59-3b7f-48ee-9334-f7d03eb2155c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:36:06.930485 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8672b59-3b7f-48ee-9334-f7d03eb2155c None admin] RBAC: Authorization granted {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:36:06.932491 dv-cinder-851351-1-smb devstack@keystone.service[282899]: [pid: 282899|app: 0|req: 77/148] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 08:36:06 2022] GET /identity/v3/domains/default => generated 199 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:36:06.937928 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090e0116-9406-4e66-9dcd-65ddda1b2011 None None] Authenticating user token {{(pid=282898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:36:07.067728 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090e0116-9406-4e66-9dcd-65ddda1b2011 None None] Validating token access rules against request {{(pid=282898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:36:07.090247 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09dedd11-e302-43b7-a7ee-015dff609d85 None None] REQUEST_METHOD: `GET` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:36:07.090593 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09dedd11-e302-43b7-a7ee-015dff609d85 None None] SCRIPT_NAME: `/identity` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:36:07.090794 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09dedd11-e302-43b7-a7ee-015dff609d85 None None] PATH_INFO: `/` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:36:07.092167 dv-cinder-851351-1-smb devstack@keystone.service[282899]: [pid: 282899|app: 0|req: 78/149] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 08:36:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 08:36:07.098682 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ba5c0b-0597-423e-8755-bfcec3541223 None None] REQUEST_METHOD: `POST` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:36:07.098997 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ba5c0b-0597-423e-8755-bfcec3541223 None None] SCRIPT_NAME: `/identity` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:36:07.099251 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ba5c0b-0597-423e-8755-bfcec3541223 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:36:07.120030 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e6eaa4-648d-4768-8ca9-63c90a9ebc35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:36:07.120602 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e6eaa4-648d-4768-8ca9-63c90a9ebc35 None admin] REQUEST_METHOD: `POST` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:36:07.120911 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e6eaa4-648d-4768-8ca9-63c90a9ebc35 None admin] SCRIPT_NAME: `/identity` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:36:07.121185 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e6eaa4-648d-4768-8ca9-63c90a9ebc35 None admin] PATH_INFO: `/v3/users` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:36:07.121913 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e6eaa4-648d-4768-8ca9-63c90a9ebc35 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:36:07.123392 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e6eaa4-648d-4768-8ca9-63c90a9ebc35 None admin] RBAC: Authorization granted {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:36:07.133091 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.auth.core [None req-67ba5c0b-0597-423e-8755-bfcec3541223 None None] MFA Rules not processed for user `2be990a66857410a87ffa7609aec4f7b`. Rule list: `[]` (Enabled: `True`). {{(pid=282899) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 08:36:07.134513 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.fernet_utils [None req-67ba5c0b-0597-423e-8755-bfcec3541223 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=282899) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:36:07.152293 dv-cinder-851351-1-smb devstack@keystone.service[282898]: [pid: 282898|app: 0|req: 72/150] 10.222.0.42 () {60 vars in 1132 bytes} [Thu Jul 28 08:36:06 2022] POST /identity/v3/users => generated 283 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 28 08:36:07.249788 dv-cinder-851351-1-smb devstack@keystone.service[282899]: [pid: 282899|app: 0|req: 79/151] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 08:36:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 08:36:07.275205 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5fdcf7-ec97-4d6e-86da-114a009af1c9 None None] REQUEST_METHOD: `GET` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:36:07.275615 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5fdcf7-ec97-4d6e-86da-114a009af1c9 None None] SCRIPT_NAME: `/identity` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:36:07.275787 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5fdcf7-ec97-4d6e-86da-114a009af1c9 None None] PATH_INFO: `/` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:36:07.277549 dv-cinder-851351-1-smb devstack@keystone.service[282898]: [pid: 282898|app: 0|req: 73/152] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 08:36:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 08:36:07.283694 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b5fdcf7-ec97-4d6e-86da-114a009af1c9 None None] Authenticating user token {{(pid=282898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:36:07.284502 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ba7582-d72d-4af9-9614-e9a61be24033 None None] REQUEST_METHOD: `POST` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:36:07.285117 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ba7582-d72d-4af9-9614-e9a61be24033 None None] SCRIPT_NAME: `/identity` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:36:07.285898 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ba7582-d72d-4af9-9614-e9a61be24033 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:36:07.314393 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.auth.core [None req-93ba7582-d72d-4af9-9614-e9a61be24033 None None] MFA Rules not processed for user `2be990a66857410a87ffa7609aec4f7b`. Rule list: `[]` (Enabled: `True`). {{(pid=282899) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 08:36:07.319385 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.fernet_utils [None req-93ba7582-d72d-4af9-9614-e9a61be24033 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=282899) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:36:07.355431 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG dbcounter [-] [282898] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=282898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:36:07.450257 dv-cinder-851351-1-smb devstack@keystone.service[282899]: [pid: 282899|app: 0|req: 80/153] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 08:36:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 08:36:07.464397 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b5fdcf7-ec97-4d6e-86da-114a009af1c9 None None] Validating token access rules against request {{(pid=282898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:36:07.476560 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ba7582-d72d-4af9-9614-e9a61be24033 None None] Authenticating user token {{(pid=282899) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:36:07.525726 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140938c7-1b0a-4be5-9e95-7e6ab2b4a5a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:36:07.526398 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140938c7-1b0a-4be5-9e95-7e6ab2b4a5a7 None admin] REQUEST_METHOD: `GET` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:36:07.526685 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140938c7-1b0a-4be5-9e95-7e6ab2b4a5a7 None admin] SCRIPT_NAME: `/identity` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:36:07.526969 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140938c7-1b0a-4be5-9e95-7e6ab2b4a5a7 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:36:07.544963 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-140938c7-1b0a-4be5-9e95-7e6ab2b4a5a7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 08:36:07.549111 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG dbcounter [-] [282899] Writing DB stats keystone:SELECT=100 {{(pid=282899) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:36:07.552331 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application [None req-140938c7-1b0a-4be5-9e95-7e6ab2b4a5a7 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 28 08:36:07.552331 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:36:07.552331 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:36:07.552331 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:36:07.552331 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:36:07.552331 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:36:07.552331 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:36:07.552331 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:36:07.552331 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:36:07.552331 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:36:07.552331 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:36:07.552331 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:36:07.552331 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 08:36:07.552331 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 08:36:07.552331 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 08:36:07.552331 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 08:36:07.553462 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 08:36:07.553462 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 08:36:07.553462 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 08:36:07.553462 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 08:36:07.553462 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:36:07.553462 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:36:07.553462 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:36:07.553462 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:36:07.553462 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:36:07.553462 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:36:07.553462 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:36:07.553462 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application with Lock( Jul 28 08:36:07.553462 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:36:07.553462 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:36:07.553462 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:36:07.553462 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:36:07.554449 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:36:07.554449 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:36:07.554449 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:36:07.554449 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:36:07.554449 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 08:36:07.554449 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 08:36:07.554449 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 08:36:07.554449 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 08:36:07.554449 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 08:36:07.554449 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 08:36:07.554449 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 28 08:36:07.554449 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application Jul 28 08:36:07.554449 dv-cinder-851351-1-smb devstack@keystone.service[282898]: [pid: 282898|app: 0|req: 74/154] 10.222.0.42 () {56 vars in 1114 bytes} [Thu Jul 28 08:36:07 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 270 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:36:07.560263 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140938c7-1b0a-4be5-9e95-7e6ab2b4a5a7 None admin] Authenticating user token {{(pid=282898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:36:07.599424 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ba7582-d72d-4af9-9614-e9a61be24033 None None] Validating token access rules against request {{(pid=282899) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:36:07.640860 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c780a3-95e6-4e01-b313-c5674cfb3fd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282899) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:36:07.641796 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c780a3-95e6-4e01-b313-c5674cfb3fd5 None admin] REQUEST_METHOD: `GET` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:36:07.642083 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c780a3-95e6-4e01-b313-c5674cfb3fd5 None admin] SCRIPT_NAME: `/identity` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:36:07.642359 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c780a3-95e6-4e01-b313-c5674cfb3fd5 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:36:07.657171 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c780a3-95e6-4e01-b313-c5674cfb3fd5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 08:36:07.664110 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application [None req-40c780a3-95e6-4e01-b313-c5674cfb3fd5 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 08:36:07.664110 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:36:07.664110 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:36:07.664110 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:36:07.664110 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:36:07.664110 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:36:07.664110 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:36:07.664110 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:36:07.664110 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:36:07.664110 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:36:07.664110 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:36:07.664110 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:36:07.664110 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 08:36:07.664110 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 08:36:07.664110 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 08:36:07.664110 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 08:36:07.665295 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 08:36:07.665295 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 08:36:07.665295 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 08:36:07.665295 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 08:36:07.665295 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:36:07.665295 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:36:07.665295 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:36:07.665295 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:36:07.665295 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:36:07.665295 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:36:07.665295 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:36:07.665295 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application with Lock( Jul 28 08:36:07.665295 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:36:07.665295 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:36:07.665295 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:36:07.665295 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:36:07.666754 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:36:07.666754 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:36:07.666754 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:36:07.666754 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:36:07.666754 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 08:36:07.666754 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 08:36:07.666754 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 08:36:07.666754 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 08:36:07.666754 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 08:36:07.666754 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 08:36:07.666754 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 08:36:07.666754 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application Jul 28 08:36:07.666754 dv-cinder-851351-1-smb devstack@keystone.service[282899]: [pid: 282899|app: 0|req: 81/155] 10.222.0.42 () {56 vars in 1096 bytes} [Thu Jul 28 08:36:07 2022] GET /identity/v3/roles/admin => generated 83 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 08:36:07.673881 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c780a3-95e6-4e01-b313-c5674cfb3fd5 None admin] Authenticating user token {{(pid=282899) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:36:07.681107 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG dbcounter [-] [282898] Writing DB stats keystone:SELECT=100 {{(pid=282898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:36:07.696452 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140938c7-1b0a-4be5-9e95-7e6ab2b4a5a7 None admin] Validating token access rules against request {{(pid=282898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:36:07.738735 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85af52c7-e156-4eac-863e-b6f4853a0a27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:36:07.739754 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85af52c7-e156-4eac-863e-b6f4853a0a27 None admin] REQUEST_METHOD: `GET` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:36:07.740193 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85af52c7-e156-4eac-863e-b6f4853a0a27 None admin] SCRIPT_NAME: `/identity` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:36:07.740691 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85af52c7-e156-4eac-863e-b6f4853a0a27 None admin] PATH_INFO: `/v3/roles` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:36:07.741734 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85af52c7-e156-4eac-863e-b6f4853a0a27 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=282898) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:36:07.742196 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85af52c7-e156-4eac-863e-b6f4853a0a27 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:36:07.743912 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85af52c7-e156-4eac-863e-b6f4853a0a27 None admin] RBAC: Authorization granted {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:36:07.754032 dv-cinder-851351-1-smb devstack@keystone.service[282898]: [pid: 282898|app: 0|req: 75/156] 10.222.0.42 () {56 vars in 1111 bytes} [Thu Jul 28 08:36:07 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:36:07.755733 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fafbfa13-ed8f-40c3-ae74-eb5c9ff6133c None None] REQUEST_METHOD: `GET` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:36:07.756229 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fafbfa13-ed8f-40c3-ae74-eb5c9ff6133c None None] SCRIPT_NAME: `/identity` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:36:07.756755 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fafbfa13-ed8f-40c3-ae74-eb5c9ff6133c None None] PATH_INFO: `/` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:36:07.758326 dv-cinder-851351-1-smb devstack@keystone.service[282898]: [pid: 282898|app: 0|req: 76/157] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 08:36:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 08:36:07.764207 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d465320f-241b-4346-bce1-3478a42b6cb5 None None] REQUEST_METHOD: `POST` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:36:07.764894 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d465320f-241b-4346-bce1-3478a42b6cb5 None None] SCRIPT_NAME: `/identity` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:36:07.765360 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d465320f-241b-4346-bce1-3478a42b6cb5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:36:07.787106 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.auth.core [None req-d465320f-241b-4346-bce1-3478a42b6cb5 None None] MFA Rules not processed for user `2be990a66857410a87ffa7609aec4f7b`. Rule list: `[]` (Enabled: `True`). {{(pid=282898) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 08:36:07.788704 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.fernet_utils [None req-d465320f-241b-4346-bce1-3478a42b6cb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=282898) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:36:07.788954 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c780a3-95e6-4e01-b313-c5674cfb3fd5 None admin] Validating token access rules against request {{(pid=282899) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:36:07.804532 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG dbcounter [-] [282899] Writing DB stats keystone:SELECT=100 {{(pid=282899) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:36:07.837127 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a5c1f32-2bbb-44fd-8129-cf141d89391c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282899) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:36:07.838072 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5c1f32-2bbb-44fd-8129-cf141d89391c None admin] REQUEST_METHOD: `GET` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:36:07.838527 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5c1f32-2bbb-44fd-8129-cf141d89391c None admin] SCRIPT_NAME: `/identity` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:36:07.838955 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5c1f32-2bbb-44fd-8129-cf141d89391c None admin] PATH_INFO: `/v3/roles` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:36:07.839853 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a5c1f32-2bbb-44fd-8129-cf141d89391c None admin] RBAC: Adding query filter params (name=admin) {{(pid=282899) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:36:07.840320 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a5c1f32-2bbb-44fd-8129-cf141d89391c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:36:07.841923 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a5c1f32-2bbb-44fd-8129-cf141d89391c None admin] RBAC: Authorization granted {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:36:07.851165 dv-cinder-851351-1-smb devstack@keystone.service[282899]: [pid: 282899|app: 0|req: 82/158] 10.222.0.42 () {56 vars in 1099 bytes} [Thu Jul 28 08:36:07 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:36:07.852474 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a5c1f32-2bbb-44fd-8129-cf141d89391c None admin] Authenticating user token {{(pid=282899) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:36:07.870044 dv-cinder-851351-1-smb devstack@keystone.service[282898]: [pid: 282898|app: 0|req: 77/159] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 08:36:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 28 08:36:07.871028 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d465320f-241b-4346-bce1-3478a42b6cb5 None None] Authenticating user token {{(pid=282898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:36:07.965879 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG dbcounter [-] [282898] Writing DB stats keystone:SELECT=100 {{(pid=282898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:36:07.985439 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d465320f-241b-4346-bce1-3478a42b6cb5 None None] Validating token access rules against request {{(pid=282898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:36:07.988711 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a5c1f32-2bbb-44fd-8129-cf141d89391c None admin] Validating token access rules against request {{(pid=282899) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:36:08.023777 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff11f487-4da9-4fe0-9e76-250987a20fff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:36:08.024357 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff11f487-4da9-4fe0-9e76-250987a20fff None admin] REQUEST_METHOD: `GET` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:36:08.024648 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff11f487-4da9-4fe0-9e76-250987a20fff None admin] SCRIPT_NAME: `/identity` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:36:08.024956 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff11f487-4da9-4fe0-9e76-250987a20fff None admin] PATH_INFO: `/v3/users/2be990a66857410a87ffa7609aec4f7b` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:36:08.026168 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff11f487-4da9-4fe0-9e76-250987a20fff None admin] RBAC: Authorizing `identity:get_user(user_id=2be990a66857410a87ffa7609aec4f7b)` {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:36:08.026906 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e62ea2-f140-4e98-a7a8-b0328ca84497 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282899) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:36:08.027574 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e62ea2-f140-4e98-a7a8-b0328ca84497 None admin] REQUEST_METHOD: `GET` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:36:08.027691 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff11f487-4da9-4fe0-9e76-250987a20fff None admin] RBAC: Authorization granted {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:36:08.027861 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e62ea2-f140-4e98-a7a8-b0328ca84497 None admin] SCRIPT_NAME: `/identity` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:36:08.028124 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e62ea2-f140-4e98-a7a8-b0328ca84497 None admin] PATH_INFO: `/v3/users/ff1f8d5551c44d2781c7ed09cd18be32` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:36:08.029324 dv-cinder-851351-1-smb devstack@keystone.service[282898]: [pid: 282898|app: 0|req: 78/160] 10.222.0.42 () {56 vars in 1177 bytes} [Thu Jul 28 08:36:07 2022] GET /identity/v3/users/2be990a66857410a87ffa7609aec4f7b => generated 247 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:36:08.029686 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e62ea2-f140-4e98-a7a8-b0328ca84497 None admin] RBAC: Authorizing `identity:get_user(user_id=ff1f8d5551c44d2781c7ed09cd18be32)` {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:36:08.030107 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff11f487-4da9-4fe0-9e76-250987a20fff None admin] Authenticating user token {{(pid=282898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:36:08.031304 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e62ea2-f140-4e98-a7a8-b0328ca84497 None admin] RBAC: Authorization granted {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:36:08.033003 dv-cinder-851351-1-smb devstack@keystone.service[282899]: [pid: 282899|app: 0|req: 83/161] 10.222.0.42 () {56 vars in 1177 bytes} [Thu Jul 28 08:36:07 2022] GET /identity/v3/users/ff1f8d5551c44d2781c7ed09cd18be32 => generated 275 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:36:08.042868 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e62ea2-f140-4e98-a7a8-b0328ca84497 None admin] Authenticating user token {{(pid=282899) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:36:08.102979 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG dbcounter [-] [282899] Writing DB stats keystone:SELECT=100 {{(pid=282899) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:36:08.147847 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff11f487-4da9-4fe0-9e76-250987a20fff None admin] Validating token access rules against request {{(pid=282898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:36:08.189729 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a0d1ca-dfe7-49c2-ad65-bbe9df7040fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:36:08.190408 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a0d1ca-dfe7-49c2-ad65-bbe9df7040fe None admin] REQUEST_METHOD: `GET` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:36:08.190690 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a0d1ca-dfe7-49c2-ad65-bbe9df7040fe None admin] SCRIPT_NAME: `/identity` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:36:08.190970 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a0d1ca-dfe7-49c2-ad65-bbe9df7040fe None admin] PATH_INFO: `/v3/roles/reader` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:36:08.192309 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e62ea2-f140-4e98-a7a8-b0328ca84497 None admin] Validating token access rules against request {{(pid=282899) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:36:08.205332 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33a0d1ca-dfe7-49c2-ad65-bbe9df7040fe None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 08:36:08.211485 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application [None req-33a0d1ca-dfe7-49c2-ad65-bbe9df7040fe None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 28 08:36:08.211485 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:36:08.211485 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:36:08.211485 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:36:08.211485 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:36:08.211485 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:36:08.211485 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:36:08.211485 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:36:08.211485 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:36:08.211485 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:36:08.211485 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:36:08.211485 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:36:08.211485 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 08:36:08.211485 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 08:36:08.211485 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 08:36:08.211485 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 08:36:08.213813 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 08:36:08.213813 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 08:36:08.213813 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 08:36:08.213813 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 08:36:08.213813 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:36:08.213813 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:36:08.213813 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:36:08.213813 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:36:08.213813 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:36:08.213813 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:36:08.213813 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:36:08.213813 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application with Lock( Jul 28 08:36:08.213813 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:36:08.213813 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:36:08.213813 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:36:08.213813 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:36:08.215957 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:36:08.215957 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:36:08.215957 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:36:08.215957 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:36:08.215957 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 08:36:08.215957 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 08:36:08.215957 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 08:36:08.215957 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 08:36:08.215957 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 08:36:08.215957 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 08:36:08.215957 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 28 08:36:08.215957 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application Jul 28 08:36:08.215957 dv-cinder-851351-1-smb devstack@keystone.service[282898]: [pid: 282898|app: 0|req: 79/162] 10.222.0.42 () {56 vars in 1099 bytes} [Thu Jul 28 08:36:08 2022] GET /identity/v3/roles/reader => generated 84 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:36:08.215957 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a0d1ca-dfe7-49c2-ad65-bbe9df7040fe None admin] Authenticating user token {{(pid=282898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:36:08.231150 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG dbcounter [-] [282898] Writing DB stats keystone:SELECT=100 {{(pid=282898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:36:08.239880 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b768ff-8abd-4f46-ad75-f75d2010a50b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282899) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:36:08.240703 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b768ff-8abd-4f46-ad75-f75d2010a50b None admin] REQUEST_METHOD: `GET` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:36:08.240994 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b768ff-8abd-4f46-ad75-f75d2010a50b None admin] SCRIPT_NAME: `/identity` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:36:08.241591 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b768ff-8abd-4f46-ad75-f75d2010a50b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:36:08.341275 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a0d1ca-dfe7-49c2-ad65-bbe9df7040fe None admin] Validating token access rules against request {{(pid=282898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:36:08.343279 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40b768ff-8abd-4f46-ad75-f75d2010a50b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:36:08.347291 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40b768ff-8abd-4f46-ad75-f75d2010a50b None admin] RBAC: Authorization granted {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:36:08.398230 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8792dc37-0f86-4bb2-a059-34de80532ea1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:36:08.399057 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG dbcounter [-] [282899] Writing DB stats keystone:SELECT=100 {{(pid=282899) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:36:08.400532 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8792dc37-0f86-4bb2-a059-34de80532ea1 None admin] REQUEST_METHOD: `GET` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:36:08.401256 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8792dc37-0f86-4bb2-a059-34de80532ea1 None admin] SCRIPT_NAME: `/identity` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:36:08.401748 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8792dc37-0f86-4bb2-a059-34de80532ea1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:36:08.507932 dv-cinder-851351-1-smb devstack@keystone.service[282899]: [pid: 282899|app: 0|req: 84/163] 10.222.0.42 () {58 vars in 1282 bytes} [Thu Jul 28 08:36:08 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 466 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 28 08:36:08.508854 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b768ff-8abd-4f46-ad75-f75d2010a50b None admin] Authenticating user token {{(pid=282899) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:36:08.551210 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8792dc37-0f86-4bb2-a059-34de80532ea1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:36:08.553235 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8792dc37-0f86-4bb2-a059-34de80532ea1 None admin] RBAC: Authorization granted {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:36:08.582542 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG dbcounter [-] [282898] Writing DB stats keystone:SELECT=100 {{(pid=282898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:36:08.631677 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b768ff-8abd-4f46-ad75-f75d2010a50b None admin] Validating token access rules against request {{(pid=282899) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:36:08.670097 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24612c22-9103-4c73-9ec2-bdbe8202619f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282899) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:36:08.670746 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24612c22-9103-4c73-9ec2-bdbe8202619f None admin] REQUEST_METHOD: `GET` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:36:08.671030 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24612c22-9103-4c73-9ec2-bdbe8202619f None admin] SCRIPT_NAME: `/identity` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:36:08.671306 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24612c22-9103-4c73-9ec2-bdbe8202619f None admin] PATH_INFO: `/v3/roles` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:36:08.672045 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24612c22-9103-4c73-9ec2-bdbe8202619f None admin] RBAC: Adding query filter params (name=reader) {{(pid=282899) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:36:08.672354 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24612c22-9103-4c73-9ec2-bdbe8202619f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:36:08.674006 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24612c22-9103-4c73-9ec2-bdbe8202619f None admin] RBAC: Authorization granted {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:36:08.685446 dv-cinder-851351-1-smb devstack@keystone.service[282899]: [pid: 282899|app: 0|req: 85/164] 10.222.0.42 () {56 vars in 1101 bytes} [Thu Jul 28 08:36:08 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:36:08.687045 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305a924e-4e55-40ed-acc2-b67a1a23eba5 None None] REQUEST_METHOD: `GET` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:36:08.687700 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305a924e-4e55-40ed-acc2-b67a1a23eba5 None None] SCRIPT_NAME: `/identity` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:36:08.687997 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305a924e-4e55-40ed-acc2-b67a1a23eba5 None None] PATH_INFO: `/` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:36:08.689801 dv-cinder-851351-1-smb devstack@keystone.service[282899]: [pid: 282899|app: 0|req: 86/165] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 08:36:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 08:36:08.690880 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-305a924e-4e55-40ed-acc2-b67a1a23eba5 None None] Authenticating user token {{(pid=282899) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:36:08.693147 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG dbcounter [-] [282899] Writing DB stats keystone:SELECT=100 {{(pid=282899) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:36:08.732691 dv-cinder-851351-1-smb devstack@keystone.service[282898]: [pid: 282898|app: 0|req: 80/166] 10.222.0.42 () {58 vars in 1282 bytes} [Thu Jul 28 08:36:08 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 519 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 28 08:36:08.734037 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c640f510-e714-4b62-acbb-9ce688d8b492 None None] REQUEST_METHOD: `POST` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:36:08.734321 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c640f510-e714-4b62-acbb-9ce688d8b492 None None] SCRIPT_NAME: `/identity` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:36:08.734595 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c640f510-e714-4b62-acbb-9ce688d8b492 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:36:08.753926 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.auth.core [None req-c640f510-e714-4b62-acbb-9ce688d8b492 None None] MFA Rules not processed for user `2be990a66857410a87ffa7609aec4f7b`. Rule list: `[]` (Enabled: `True`). {{(pid=282898) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 08:36:08.755282 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.fernet_utils [None req-c640f510-e714-4b62-acbb-9ce688d8b492 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=282898) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:36:08.886498 dv-cinder-851351-1-smb devstack@keystone.service[282898]: [pid: 282898|app: 0|req: 81/167] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 08:36:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 08:36:08.887831 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c640f510-e714-4b62-acbb-9ce688d8b492 None None] Authenticating user token {{(pid=282898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:36:08.897367 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-305a924e-4e55-40ed-acc2-b67a1a23eba5 None None] Validating token access rules against request {{(pid=282899) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:36:08.941296 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2e9c85-791b-447c-9ae6-0c10bbb3db83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282899) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:36:08.941996 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2e9c85-791b-447c-9ae6-0c10bbb3db83 None admin] REQUEST_METHOD: `GET` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:36:08.942281 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2e9c85-791b-447c-9ae6-0c10bbb3db83 None admin] SCRIPT_NAME: `/identity` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:36:08.942556 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2e9c85-791b-447c-9ae6-0c10bbb3db83 None admin] PATH_INFO: `/v3/projects/c089873b22dd43e8a9de1c83b1355842` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:36:08.944542 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b2e9c85-791b-447c-9ae6-0c10bbb3db83 None admin] RBAC: Authorizing `identity:get_project(project_id=c089873b22dd43e8a9de1c83b1355842)` {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:36:08.946950 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b2e9c85-791b-447c-9ae6-0c10bbb3db83 None admin] RBAC: Authorization granted {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:36:08.952319 dv-cinder-851351-1-smb devstack@keystone.service[282899]: [pid: 282899|app: 0|req: 87/168] 10.222.0.42 () {56 vars in 1186 bytes} [Thu Jul 28 08:36:08 2022] GET /identity/v3/projects/c089873b22dd43e8a9de1c83b1355842 => generated 298 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:36:08.956746 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2e9c85-791b-447c-9ae6-0c10bbb3db83 None admin] Authenticating user token {{(pid=282899) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:36:08.970321 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG dbcounter [-] [282898] Writing DB stats keystone:SELECT=100 {{(pid=282898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:36:09.080729 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c640f510-e714-4b62-acbb-9ce688d8b492 None None] Validating token access rules against request {{(pid=282898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:36:09.086660 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG dbcounter [-] [282899] Writing DB stats keystone:SELECT=100 {{(pid=282899) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:36:09.150515 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2e9c85-791b-447c-9ae6-0c10bbb3db83 None admin] Validating token access rules against request {{(pid=282899) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:36:09.154869 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867bacdc-223b-4d19-b295-f1f335c0446d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:36:09.155601 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867bacdc-223b-4d19-b295-f1f335c0446d None admin] REQUEST_METHOD: `GET` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:36:09.155918 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867bacdc-223b-4d19-b295-f1f335c0446d None admin] SCRIPT_NAME: `/identity` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:36:09.156188 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867bacdc-223b-4d19-b295-f1f335c0446d None admin] PATH_INFO: `/v3/users/aada0588d55b4592af9d57baa4a887fb` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:36:09.162825 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-867bacdc-223b-4d19-b295-f1f335c0446d None admin] RBAC: Authorizing `identity:get_user(user_id=aada0588d55b4592af9d57baa4a887fb)` {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:36:09.164704 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-867bacdc-223b-4d19-b295-f1f335c0446d None admin] RBAC: Authorization granted {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:36:09.166658 dv-cinder-851351-1-smb devstack@keystone.service[282898]: [pid: 282898|app: 0|req: 82/169] 10.222.0.42 () {56 vars in 1177 bytes} [Thu Jul 28 08:36:08 2022] GET /identity/v3/users/aada0588d55b4592af9d57baa4a887fb => generated 289 bytes in 279 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:36:09.167280 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867bacdc-223b-4d19-b295-f1f335c0446d None admin] Authenticating user token {{(pid=282898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:36:09.199200 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a042a871-617f-4344-988e-93afe9cc4794 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282899) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:36:09.199882 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a042a871-617f-4344-988e-93afe9cc4794 None admin] REQUEST_METHOD: `GET` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:36:09.200171 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a042a871-617f-4344-988e-93afe9cc4794 None admin] SCRIPT_NAME: `/identity` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:36:09.200453 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a042a871-617f-4344-988e-93afe9cc4794 None admin] PATH_INFO: `/v3/projects/c089873b22dd43e8a9de1c83b1355842` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:36:09.201798 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a042a871-617f-4344-988e-93afe9cc4794 None admin] RBAC: Authorizing `identity:get_project(project_id=c089873b22dd43e8a9de1c83b1355842)` {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:36:09.204268 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a042a871-617f-4344-988e-93afe9cc4794 None admin] RBAC: Authorization granted {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:36:09.210468 dv-cinder-851351-1-smb devstack@keystone.service[282899]: [pid: 282899|app: 0|req: 88/170] 10.222.0.42 () {56 vars in 1186 bytes} [Thu Jul 28 08:36:08 2022] GET /identity/v3/projects/c089873b22dd43e8a9de1c83b1355842 => generated 298 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:36:09.212148 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a042a871-617f-4344-988e-93afe9cc4794 None admin] Authenticating user token {{(pid=282899) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:36:09.372387 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867bacdc-223b-4d19-b295-f1f335c0446d None admin] Validating token access rules against request {{(pid=282898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:36:09.393749 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG dbcounter [-] [282898] Writing DB stats keystone:SELECT=100 {{(pid=282898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:36:09.410543 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a042a871-617f-4344-988e-93afe9cc4794 None admin] Validating token access rules against request {{(pid=282899) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:36:09.442900 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a86fc4-5534-4770-bfa4-10a5a897a7b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:36:09.443583 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a86fc4-5534-4770-bfa4-10a5a897a7b1 None admin] REQUEST_METHOD: `GET` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:36:09.443867 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a86fc4-5534-4770-bfa4-10a5a897a7b1 None admin] SCRIPT_NAME: `/identity` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:36:09.444144 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a86fc4-5534-4770-bfa4-10a5a897a7b1 None admin] PATH_INFO: `/v3/roles/member` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:36:09.463589 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1a86fc4-5534-4770-bfa4-10a5a897a7b1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 08:36:09.468729 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application [None req-a1a86fc4-5534-4770-bfa4-10a5a897a7b1 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 28 08:36:09.468729 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:36:09.468729 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:36:09.468729 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:36:09.468729 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:36:09.468729 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:36:09.468729 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:36:09.468729 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:36:09.468729 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:36:09.468729 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:36:09.468729 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:36:09.468729 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:36:09.468729 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 08:36:09.468729 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 08:36:09.468729 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 08:36:09.468729 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 08:36:09.469748 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 08:36:09.469748 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 08:36:09.469748 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 08:36:09.469748 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 08:36:09.469748 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:36:09.469748 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:36:09.469748 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:36:09.469748 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:36:09.469748 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:36:09.469748 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:36:09.469748 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:36:09.469748 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application with Lock( Jul 28 08:36:09.469748 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:36:09.469748 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:36:09.469748 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:36:09.469748 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:36:09.470696 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:36:09.470696 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:36:09.470696 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:36:09.470696 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:36:09.470696 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 08:36:09.470696 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 08:36:09.470696 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 08:36:09.470696 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 08:36:09.470696 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 08:36:09.470696 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 08:36:09.470696 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 28 08:36:09.470696 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application Jul 28 08:36:09.470696 dv-cinder-851351-1-smb devstack@keystone.service[282898]: [pid: 282898|app: 0|req: 83/171] 10.222.0.42 () {56 vars in 1099 bytes} [Thu Jul 28 08:36:09 2022] GET /identity/v3/roles/member => generated 84 bytes in 303 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:36:09.471551 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a86fc4-5534-4770-bfa4-10a5a897a7b1 None admin] Authenticating user token {{(pid=282898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:36:09.478857 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45dc211c-93be-4f29-bafa-21f6977833d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282899) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:36:09.479562 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45dc211c-93be-4f29-bafa-21f6977833d0 None admin] REQUEST_METHOD: `GET` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:36:09.479855 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45dc211c-93be-4f29-bafa-21f6977833d0 None admin] SCRIPT_NAME: `/identity` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:36:09.480138 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45dc211c-93be-4f29-bafa-21f6977833d0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:36:09.480982 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45dc211c-93be-4f29-bafa-21f6977833d0 None admin] RBAC: Adding query filter params (role.id=a0e2a00bf94d40f38629d6b5293e3aee, scope.project.id=c089873b22dd43e8a9de1c83b1355842, user.id=2be990a66857410a87ffa7609aec4f7b) {{(pid=282899) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:36:09.481302 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45dc211c-93be-4f29-bafa-21f6977833d0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:36:09.482776 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45dc211c-93be-4f29-bafa-21f6977833d0 None admin] RBAC: Authorization granted {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:36:09.489076 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG dbcounter [-] [282899] Writing DB stats keystone:SELECT=100 {{(pid=282899) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:36:09.496416 dv-cinder-851351-1-smb devstack@keystone.service[282899]: [pid: 282899|app: 0|req: 89/172] 10.222.0.42 () {56 vars in 1374 bytes} [Thu Jul 28 08:36:09 2022] GET /identity/v3/role_assignments?user.id=2be990a66857410a87ffa7609aec4f7b&scope.project.id=c089873b22dd43e8a9de1c83b1355842&role.id=a0e2a00bf94d40f38629d6b5293e3aee => generated 608 bytes in 285 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:36:09.497395 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45dc211c-93be-4f29-bafa-21f6977833d0 None admin] Authenticating user token {{(pid=282899) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:36:09.703796 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a86fc4-5534-4770-bfa4-10a5a897a7b1 None admin] Validating token access rules against request {{(pid=282898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:36:09.731734 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45dc211c-93be-4f29-bafa-21f6977833d0 None admin] Validating token access rules against request {{(pid=282899) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:36:09.798657 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda523e8-034b-4a30-87e2-1e630b67ad1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:36:09.799339 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda523e8-034b-4a30-87e2-1e630b67ad1a None admin] REQUEST_METHOD: `GET` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:36:09.799598 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda523e8-034b-4a30-87e2-1e630b67ad1a None admin] SCRIPT_NAME: `/identity` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:36:09.799875 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda523e8-034b-4a30-87e2-1e630b67ad1a None admin] PATH_INFO: `/v3/projects/c089873b22dd43e8a9de1c83b1355842` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:36:09.804363 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda523e8-034b-4a30-87e2-1e630b67ad1a None admin] RBAC: Authorizing `identity:get_project(project_id=c089873b22dd43e8a9de1c83b1355842)` {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:36:09.804363 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda523e8-034b-4a30-87e2-1e630b67ad1a None admin] RBAC: Authorization granted {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:36:09.807391 dv-cinder-851351-1-smb devstack@keystone.service[282898]: [pid: 282898|app: 0|req: 84/173] 10.222.0.42 () {56 vars in 1186 bytes} [Thu Jul 28 08:36:09 2022] GET /identity/v3/projects/c089873b22dd43e8a9de1c83b1355842 => generated 298 bytes in 337 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:36:09.808181 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda523e8-034b-4a30-87e2-1e630b67ad1a None admin] Authenticating user token {{(pid=282898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:36:09.817149 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3aec7c-5c9c-402f-9073-12b90cc4182b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282899) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:36:09.817802 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3aec7c-5c9c-402f-9073-12b90cc4182b None admin] REQUEST_METHOD: `GET` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:36:09.818096 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3aec7c-5c9c-402f-9073-12b90cc4182b None admin] SCRIPT_NAME: `/identity` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:36:09.818369 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3aec7c-5c9c-402f-9073-12b90cc4182b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:36:09.819612 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec3aec7c-5c9c-402f-9073-12b90cc4182b None admin] RBAC: Adding query filter params (role.id=d76677105be344cc83022cbde8a22d8d, scope.project.id=c089873b22dd43e8a9de1c83b1355842, user.id=ff1f8d5551c44d2781c7ed09cd18be32) {{(pid=282899) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:36:09.819612 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec3aec7c-5c9c-402f-9073-12b90cc4182b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:36:09.824704 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec3aec7c-5c9c-402f-9073-12b90cc4182b None admin] RBAC: Authorization granted {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:36:09.836264 dv-cinder-851351-1-smb devstack@keystone.service[282899]: [pid: 282899|app: 0|req: 90/174] 10.222.0.42 () {56 vars in 1374 bytes} [Thu Jul 28 08:36:09 2022] GET /identity/v3/role_assignments?user.id=ff1f8d5551c44d2781c7ed09cd18be32&scope.project.id=c089873b22dd43e8a9de1c83b1355842&role.id=d76677105be344cc83022cbde8a22d8d => generated 608 bytes in 339 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:36:09.837219 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3aec7c-5c9c-402f-9073-12b90cc4182b None admin] Authenticating user token {{(pid=282899) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:36:09.892181 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG dbcounter [-] [282898] Writing DB stats keystone:SELECT=100 {{(pid=282898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:36:09.973615 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG dbcounter [-] [282899] Writing DB stats keystone:SELECT=100 {{(pid=282899) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:36:10.037651 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda523e8-034b-4a30-87e2-1e630b67ad1a None admin] Validating token access rules against request {{(pid=282898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:36:10.063164 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3aec7c-5c9c-402f-9073-12b90cc4182b None admin] Validating token access rules against request {{(pid=282899) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:36:10.114852 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06fe1e89-372f-4f5e-943c-f17ccc41c704 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:36:10.115908 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06fe1e89-372f-4f5e-943c-f17ccc41c704 None admin] REQUEST_METHOD: `GET` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:36:10.116406 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06fe1e89-372f-4f5e-943c-f17ccc41c704 None admin] SCRIPT_NAME: `/identity` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:36:10.117037 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06fe1e89-372f-4f5e-943c-f17ccc41c704 None admin] PATH_INFO: `/v3/roles` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:36:10.117998 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06fe1e89-372f-4f5e-943c-f17ccc41c704 None admin] RBAC: Adding query filter params (name=member) {{(pid=282898) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:36:10.118518 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06fe1e89-372f-4f5e-943c-f17ccc41c704 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:36:10.120128 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06fe1e89-372f-4f5e-943c-f17ccc41c704 None admin] RBAC: Authorization granted {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:36:10.131227 dv-cinder-851351-1-smb devstack@keystone.service[282898]: [pid: 282898|app: 0|req: 85/175] 10.222.0.42 () {56 vars in 1101 bytes} [Thu Jul 28 08:36:09 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 323 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:36:10.133048 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e71a60-4a7e-4527-a914-b34924236cc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282899) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:36:10.133774 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e71a60-4a7e-4527-a914-b34924236cc7 None admin] REQUEST_METHOD: `PUT` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:36:10.133971 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ce0585-0f69-44ff-b24e-34de2989520c None None] REQUEST_METHOD: `GET` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:36:10.134085 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e71a60-4a7e-4527-a914-b34924236cc7 None admin] SCRIPT_NAME: `/identity` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:36:10.134339 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e71a60-4a7e-4527-a914-b34924236cc7 None admin] PATH_INFO: `/v3/projects/c089873b22dd43e8a9de1c83b1355842/users/aada0588d55b4592af9d57baa4a887fb/roles/34c6ec459a944c46a4265d15a06e348d` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:36:10.134794 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ce0585-0f69-44ff-b24e-34de2989520c None None] SCRIPT_NAME: `/identity` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:36:10.135275 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ce0585-0f69-44ff-b24e-34de2989520c None None] PATH_INFO: `/` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:36:10.137132 dv-cinder-851351-1-smb devstack@keystone.service[282898]: [pid: 282898|app: 0|req: 86/176] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 08:36:10 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 08:36:10.142357 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ce0585-0f69-44ff-b24e-34de2989520c None None] Authenticating user token {{(pid=282898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:36:10.143434 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75e71a60-4a7e-4527-a914-b34924236cc7 None admin] RBAC: Authorizing `identity:create_grant(project_id=c089873b22dd43e8a9de1c83b1355842, user_id=aada0588d55b4592af9d57baa4a887fb, role_id=34c6ec459a944c46a4265d15a06e348d)` {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:36:10.145090 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75e71a60-4a7e-4527-a914-b34924236cc7 None admin] RBAC: Authorization granted {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:36:10.178778 dv-cinder-851351-1-smb devstack@keystone.service[282899]: [pid: 282899|app: 0|req: 91/177] 10.222.0.42 () {58 vars in 1439 bytes} [Thu Jul 28 08:36:09 2022] PUT /identity/v3/projects/c089873b22dd43e8a9de1c83b1355842/users/aada0588d55b4592af9d57baa4a887fb/roles/34c6ec459a944c46a4265d15a06e348d => generated 0 bytes in 342 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 08:36:10.180206 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138f1096-6237-4b35-853c-e2572f1f1a69 None None] REQUEST_METHOD: `POST` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:36:10.180512 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138f1096-6237-4b35-853c-e2572f1f1a69 None None] SCRIPT_NAME: `/identity` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:36:10.183525 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138f1096-6237-4b35-853c-e2572f1f1a69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:36:10.216296 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.auth.core [None req-138f1096-6237-4b35-853c-e2572f1f1a69 None None] MFA Rules not processed for user `2be990a66857410a87ffa7609aec4f7b`. Rule list: `[]` (Enabled: `True`). {{(pid=282899) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 08:36:10.217883 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.fernet_utils [None req-138f1096-6237-4b35-853c-e2572f1f1a69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=282899) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:36:10.264541 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG dbcounter [-] [282898] Writing DB stats keystone:SELECT=100 {{(pid=282898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:36:10.270052 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ce0585-0f69-44ff-b24e-34de2989520c None None] Validating token access rules against request {{(pid=282898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:36:10.310346 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1dbfe4-81a6-4004-a8cb-8bf1e8d227d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:36:10.311463 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1dbfe4-81a6-4004-a8cb-8bf1e8d227d0 None admin] REQUEST_METHOD: `GET` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:36:10.311953 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1dbfe4-81a6-4004-a8cb-8bf1e8d227d0 None admin] SCRIPT_NAME: `/identity` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:36:10.316717 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1dbfe4-81a6-4004-a8cb-8bf1e8d227d0 None admin] PATH_INFO: `/v3/users/ff1f8d5551c44d2781c7ed09cd18be32` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:36:10.318485 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b1dbfe4-81a6-4004-a8cb-8bf1e8d227d0 None admin] RBAC: Authorizing `identity:get_user(user_id=ff1f8d5551c44d2781c7ed09cd18be32)` {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:36:10.320050 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b1dbfe4-81a6-4004-a8cb-8bf1e8d227d0 None admin] RBAC: Authorization granted {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:36:10.322792 dv-cinder-851351-1-smb devstack@keystone.service[282899]: [pid: 282899|app: 0|req: 92/178] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 08:36:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 08:36:10.324118 dv-cinder-851351-1-smb devstack@keystone.service[282898]: [pid: 282898|app: 0|req: 87/179] 10.222.0.42 () {56 vars in 1177 bytes} [Thu Jul 28 08:36:10 2022] GET /identity/v3/users/ff1f8d5551c44d2781c7ed09cd18be32 => generated 275 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:36:10.330542 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138f1096-6237-4b35-853c-e2572f1f1a69 None None] Authenticating user token {{(pid=282899) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:36:10.350810 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1dbfe4-81a6-4004-a8cb-8bf1e8d227d0 None admin] Authenticating user token {{(pid=282898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:36:10.438034 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG dbcounter [-] [282899] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=282899) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:36:10.521919 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1dbfe4-81a6-4004-a8cb-8bf1e8d227d0 None admin] Validating token access rules against request {{(pid=282898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:36:10.547770 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138f1096-6237-4b35-853c-e2572f1f1a69 None None] Validating token access rules against request {{(pid=282899) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:36:10.559117 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9901f656-aa92-40b6-b5d2-29329400cab1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:36:10.560144 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9901f656-aa92-40b6-b5d2-29329400cab1 None admin] REQUEST_METHOD: `GET` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:36:10.560696 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9901f656-aa92-40b6-b5d2-29329400cab1 None admin] SCRIPT_NAME: `/identity` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:36:10.561232 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9901f656-aa92-40b6-b5d2-29329400cab1 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:36:10.572985 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9901f656-aa92-40b6-b5d2-29329400cab1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 08:36:10.586856 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8168d5f5-b287-449c-8c3d-05979f576f74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282899) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:36:10.588173 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8168d5f5-b287-449c-8c3d-05979f576f74 None admin] REQUEST_METHOD: `GET` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:36:10.588698 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8168d5f5-b287-449c-8c3d-05979f576f74 None admin] SCRIPT_NAME: `/identity` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:36:10.589210 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8168d5f5-b287-449c-8c3d-05979f576f74 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:36:10.591551 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application [None req-9901f656-aa92-40b6-b5d2-29329400cab1 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 08:36:10.591551 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:36:10.591551 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:36:10.591551 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:36:10.591551 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:36:10.591551 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:36:10.591551 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:36:10.591551 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:36:10.591551 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:36:10.591551 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:36:10.591551 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:36:10.591551 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:36:10.591551 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 08:36:10.591551 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 08:36:10.591551 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 08:36:10.591551 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 08:36:10.597303 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 08:36:10.597303 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 08:36:10.597303 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 08:36:10.597303 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 08:36:10.597303 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:36:10.597303 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:36:10.597303 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:36:10.597303 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:36:10.597303 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:36:10.597303 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:36:10.597303 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:36:10.597303 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application with Lock( Jul 28 08:36:10.597303 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:36:10.597303 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:36:10.597303 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:36:10.597303 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:36:10.598427 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:36:10.598427 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:36:10.598427 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:36:10.598427 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:36:10.598427 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 08:36:10.598427 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 08:36:10.598427 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 08:36:10.598427 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 08:36:10.598427 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 08:36:10.598427 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 08:36:10.598427 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 08:36:10.598427 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application Jul 28 08:36:10.598427 dv-cinder-851351-1-smb devstack@keystone.service[282898]: [pid: 282898|app: 0|req: 88/180] 10.222.0.42 () {56 vars in 1096 bytes} [Thu Jul 28 08:36:10 2022] GET /identity/v3/roles/admin => generated 83 bytes in 243 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:36:10.617779 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9901f656-aa92-40b6-b5d2-29329400cab1 None admin] Authenticating user token {{(pid=282898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:36:10.660520 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG dbcounter [-] [282898] Writing DB stats keystone:SELECT=100 {{(pid=282898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:36:10.675202 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8168d5f5-b287-449c-8c3d-05979f576f74 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:36:10.677179 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8168d5f5-b287-449c-8c3d-05979f576f74 None admin] RBAC: Authorization granted {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:36:10.734412 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG dbcounter [-] [282899] Writing DB stats keystone:SELECT=100 {{(pid=282899) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:36:10.764878 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9901f656-aa92-40b6-b5d2-29329400cab1 None admin] Validating token access rules against request {{(pid=282898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:36:10.783195 dv-cinder-851351-1-smb devstack@keystone.service[282899]: [pid: 282899|app: 0|req: 93/181] 10.222.0.42 () {58 vars in 1282 bytes} [Thu Jul 28 08:36:10 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 454 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 28 08:36:10.785099 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e27c9f-28db-4d3f-83a0-908f43b1122e None None] REQUEST_METHOD: `GET` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:36:10.785713 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e27c9f-28db-4d3f-83a0-908f43b1122e None None] SCRIPT_NAME: `/identity` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:36:10.786191 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e27c9f-28db-4d3f-83a0-908f43b1122e None None] PATH_INFO: `/` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:36:10.788122 dv-cinder-851351-1-smb devstack@keystone.service[282899]: [pid: 282899|app: 0|req: 94/182] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 08:36:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 08:36:10.789177 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e27c9f-28db-4d3f-83a0-908f43b1122e None None] Authenticating user token {{(pid=282899) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:36:10.822352 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-299bc857-a4bc-4135-8467-fcccdc8ab1d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:36:10.823074 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299bc857-a4bc-4135-8467-fcccdc8ab1d2 None admin] REQUEST_METHOD: `GET` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:36:10.823428 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299bc857-a4bc-4135-8467-fcccdc8ab1d2 None admin] SCRIPT_NAME: `/identity` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:36:10.823773 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299bc857-a4bc-4135-8467-fcccdc8ab1d2 None admin] PATH_INFO: `/v3/roles` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:36:10.826071 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-299bc857-a4bc-4135-8467-fcccdc8ab1d2 None admin] RBAC: Adding query filter params (name=admin) {{(pid=282898) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:36:10.826406 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-299bc857-a4bc-4135-8467-fcccdc8ab1d2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:36:10.827835 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-299bc857-a4bc-4135-8467-fcccdc8ab1d2 None admin] RBAC: Authorization granted {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:36:10.837327 dv-cinder-851351-1-smb devstack@keystone.service[282898]: [pid: 282898|app: 0|req: 89/183] 10.222.0.42 () {56 vars in 1099 bytes} [Thu Jul 28 08:36:10 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:36:10.841983 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b448db1-642e-4971-bef2-d9425beb0b9e None None] REQUEST_METHOD: `POST` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:36:10.842922 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b448db1-642e-4971-bef2-d9425beb0b9e None None] SCRIPT_NAME: `/identity` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:36:10.843908 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b448db1-642e-4971-bef2-d9425beb0b9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:36:10.864917 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.auth.core [None req-9b448db1-642e-4971-bef2-d9425beb0b9e None None] MFA Rules not processed for user `2be990a66857410a87ffa7609aec4f7b`. Rule list: `[]` (Enabled: `True`). {{(pid=282898) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 08:36:10.866217 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.fernet_utils [None req-9b448db1-642e-4971-bef2-d9425beb0b9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=282898) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:36:10.922115 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e27c9f-28db-4d3f-83a0-908f43b1122e None None] Validating token access rules against request {{(pid=282899) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:36:10.948964 dv-cinder-851351-1-smb devstack@keystone.service[282898]: [pid: 282898|app: 0|req: 90/184] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 08:36:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 08:36:10.949766 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b448db1-642e-4971-bef2-d9425beb0b9e None None] Authenticating user token {{(pid=282898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:36:10.960976 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d471f3-a3e1-459f-b28d-420a196e8612 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282899) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:36:10.961292 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d471f3-a3e1-459f-b28d-420a196e8612 None admin] REQUEST_METHOD: `GET` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:36:10.961552 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d471f3-a3e1-459f-b28d-420a196e8612 None admin] SCRIPT_NAME: `/identity` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:36:10.961833 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d471f3-a3e1-459f-b28d-420a196e8612 None admin] PATH_INFO: `/v3/projects/2e5945424520462faafca339c1faf342` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:36:10.963223 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49d471f3-a3e1-459f-b28d-420a196e8612 None admin] RBAC: Authorizing `identity:get_project(project_id=2e5945424520462faafca339c1faf342)` {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:36:10.964791 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49d471f3-a3e1-459f-b28d-420a196e8612 None admin] RBAC: Authorization granted {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:36:10.966600 dv-cinder-851351-1-smb devstack@keystone.service[282899]: [pid: 282899|app: 0|req: 95/185] 10.222.0.42 () {56 vars in 1186 bytes} [Thu Jul 28 08:36:10 2022] GET /identity/v3/projects/2e5945424520462faafca339c1faf342 => generated 312 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:36:10.967862 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d45952-c11a-4d2b-a96a-4b74405246ba None None] REQUEST_METHOD: `GET` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:36:10.968430 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d45952-c11a-4d2b-a96a-4b74405246ba None None] SCRIPT_NAME: `/identity` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:36:10.968430 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d45952-c11a-4d2b-a96a-4b74405246ba None None] PATH_INFO: `/` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:36:10.969836 dv-cinder-851351-1-smb devstack@keystone.service[282899]: [pid: 282899|app: 0|req: 96/186] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 08:36:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 08:36:10.976250 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78ff04a-c7e1-4dbf-8771-6425870df916 None None] REQUEST_METHOD: `POST` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:36:10.976250 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78ff04a-c7e1-4dbf-8771-6425870df916 None None] SCRIPT_NAME: `/identity` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:36:10.976250 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78ff04a-c7e1-4dbf-8771-6425870df916 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:36:10.978406 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG dbcounter [-] [282898] Writing DB stats keystone:SELECT=100 {{(pid=282898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:36:10.996139 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.auth.core [None req-b78ff04a-c7e1-4dbf-8771-6425870df916 None None] MFA Rules not processed for user `2be990a66857410a87ffa7609aec4f7b`. Rule list: `[]` (Enabled: `True`). {{(pid=282899) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 08:36:10.997425 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.fernet_utils [None req-b78ff04a-c7e1-4dbf-8771-6425870df916 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=282899) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:36:11.018236 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG dbcounter [-] [282899] Writing DB stats keystone:SELECT=100 {{(pid=282899) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:36:11.066399 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b448db1-642e-4971-bef2-d9425beb0b9e None None] Validating token access rules against request {{(pid=282898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:36:11.080762 dv-cinder-851351-1-smb devstack@keystone.service[282899]: [pid: 282899|app: 0|req: 97/187] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 08:36:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 28 08:36:11.081904 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b78ff04a-c7e1-4dbf-8771-6425870df916 None None] Authenticating user token {{(pid=282899) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:36:11.113874 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011113cc-8169-476b-9bac-1746812f76d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:36:11.114538 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011113cc-8169-476b-9bac-1746812f76d0 None admin] REQUEST_METHOD: `GET` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:36:11.114822 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011113cc-8169-476b-9bac-1746812f76d0 None admin] SCRIPT_NAME: `/identity` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:36:11.115095 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011113cc-8169-476b-9bac-1746812f76d0 None admin] PATH_INFO: `/v3/users/a7a46e4205fe48debb9e2eb8469bc7c2` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:36:11.131176 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-011113cc-8169-476b-9bac-1746812f76d0 None admin] RBAC: Authorizing `identity:get_user(user_id=a7a46e4205fe48debb9e2eb8469bc7c2)` {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:36:11.132645 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-011113cc-8169-476b-9bac-1746812f76d0 None admin] RBAC: Authorization granted {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:36:11.138928 dv-cinder-851351-1-smb devstack@keystone.service[282898]: [pid: 282898|app: 0|req: 91/188] 10.222.0.42 () {56 vars in 1177 bytes} [Thu Jul 28 08:36:10 2022] GET /identity/v3/users/a7a46e4205fe48debb9e2eb8469bc7c2 => generated 283 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:36:11.138928 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011113cc-8169-476b-9bac-1746812f76d0 None admin] Authenticating user token {{(pid=282898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:36:11.200228 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b78ff04a-c7e1-4dbf-8771-6425870df916 None None] Validating token access rules against request {{(pid=282899) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:36:11.222512 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG dbcounter [-] [282898] Writing DB stats keystone:SELECT=100 {{(pid=282898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:36:11.237358 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c2d4a9-d43f-4a7f-8201-521234b3abb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282899) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:36:11.237997 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c2d4a9-d43f-4a7f-8201-521234b3abb9 None admin] REQUEST_METHOD: `GET` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:36:11.238289 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c2d4a9-d43f-4a7f-8201-521234b3abb9 None admin] SCRIPT_NAME: `/identity` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:36:11.238644 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c2d4a9-d43f-4a7f-8201-521234b3abb9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:36:11.239744 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9c2d4a9-d43f-4a7f-8201-521234b3abb9 None admin] RBAC: Adding query filter params (role.id=eaeb4674b16f497f8afb3384e7e9a3c6, scope.project.id=2e5945424520462faafca339c1faf342, user.id=ff1f8d5551c44d2781c7ed09cd18be32) {{(pid=282899) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:36:11.240402 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9c2d4a9-d43f-4a7f-8201-521234b3abb9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:36:11.241592 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9c2d4a9-d43f-4a7f-8201-521234b3abb9 None admin] RBAC: Authorization granted {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:36:11.246550 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011113cc-8169-476b-9bac-1746812f76d0 None admin] Validating token access rules against request {{(pid=282898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:36:11.256700 dv-cinder-851351-1-smb devstack@keystone.service[282899]: [pid: 282899|app: 0|req: 98/189] 10.222.0.42 () {56 vars in 1374 bytes} [Thu Jul 28 08:36:11 2022] GET /identity/v3/role_assignments?user.id=ff1f8d5551c44d2781c7ed09cd18be32&scope.project.id=2e5945424520462faafca339c1faf342&role.id=eaeb4674b16f497f8afb3384e7e9a3c6 => generated 608 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:36:11.256700 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c2d4a9-d43f-4a7f-8201-521234b3abb9 None admin] Authenticating user token {{(pid=282899) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:36:11.277176 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG dbcounter [-] [282899] Writing DB stats keystone:SELECT=100 {{(pid=282899) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:36:11.298094 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a91ecd-1714-4b84-84cb-0d123fcb556e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:36:11.298948 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a91ecd-1714-4b84-84cb-0d123fcb556e None admin] REQUEST_METHOD: `GET` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:36:11.299336 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a91ecd-1714-4b84-84cb-0d123fcb556e None admin] SCRIPT_NAME: `/identity` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:36:11.299716 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a91ecd-1714-4b84-84cb-0d123fcb556e None admin] PATH_INFO: `/v3/domains/default` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:36:11.301253 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a91ecd-1714-4b84-84cb-0d123fcb556e None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:36:11.302913 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a91ecd-1714-4b84-84cb-0d123fcb556e None admin] RBAC: Authorization granted {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:36:11.304948 dv-cinder-851351-1-smb devstack@keystone.service[282898]: [pid: 282898|app: 0|req: 92/190] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 08:36:11 2022] GET /identity/v3/domains/default => generated 199 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:36:11.305878 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a91ecd-1714-4b84-84cb-0d123fcb556e None admin] Authenticating user token {{(pid=282898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:36:11.380604 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c2d4a9-d43f-4a7f-8201-521234b3abb9 None admin] Validating token access rules against request {{(pid=282899) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:36:11.430949 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51dfcef8-41cf-490b-85fd-641d21842d95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282899) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:36:11.432292 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51dfcef8-41cf-490b-85fd-641d21842d95 None admin] REQUEST_METHOD: `GET` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:36:11.432585 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51dfcef8-41cf-490b-85fd-641d21842d95 None admin] SCRIPT_NAME: `/identity` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:36:11.433082 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51dfcef8-41cf-490b-85fd-641d21842d95 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:36:11.449973 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51dfcef8-41cf-490b-85fd-641d21842d95 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 08:36:11.451075 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a91ecd-1714-4b84-84cb-0d123fcb556e None admin] Validating token access rules against request {{(pid=282898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:36:11.457350 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application [None req-51dfcef8-41cf-490b-85fd-641d21842d95 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 28 08:36:11.457350 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:36:11.457350 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:36:11.457350 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:36:11.457350 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:36:11.457350 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:36:11.457350 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:36:11.457350 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:36:11.457350 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:36:11.457350 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:36:11.457350 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:36:11.457350 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:36:11.457350 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 08:36:11.457350 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 08:36:11.457350 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 08:36:11.457350 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 08:36:11.458590 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 08:36:11.458590 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 08:36:11.458590 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 08:36:11.458590 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 08:36:11.458590 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:36:11.458590 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:36:11.458590 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:36:11.458590 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:36:11.458590 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:36:11.458590 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:36:11.458590 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:36:11.458590 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application with Lock( Jul 28 08:36:11.458590 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:36:11.458590 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:36:11.458590 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:36:11.458590 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:36:11.459579 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:36:11.459579 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:36:11.459579 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:36:11.459579 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:36:11.459579 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 08:36:11.459579 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 08:36:11.459579 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 08:36:11.459579 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 08:36:11.459579 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 08:36:11.459579 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 08:36:11.459579 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 28 08:36:11.459579 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application Jul 28 08:36:11.459579 dv-cinder-851351-1-smb devstack@keystone.service[282899]: [pid: 282899|app: 0|req: 99/191] 10.222.0.42 () {56 vars in 1114 bytes} [Thu Jul 28 08:36:11 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:36:11.459579 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51dfcef8-41cf-490b-85fd-641d21842d95 None admin] Authenticating user token {{(pid=282899) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:36:11.507309 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05416b0-06da-4dcc-b4f3-b5c6ec01fcd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:36:11.507954 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05416b0-06da-4dcc-b4f3-b5c6ec01fcd8 None admin] REQUEST_METHOD: `GET` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:36:11.508236 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05416b0-06da-4dcc-b4f3-b5c6ec01fcd8 None admin] SCRIPT_NAME: `/identity` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:36:11.508509 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05416b0-06da-4dcc-b4f3-b5c6ec01fcd8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:36:11.526256 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG dbcounter [-] [282898] Writing DB stats keystone:SELECT=100 {{(pid=282898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:36:11.566031 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG dbcounter [-] [282899] Writing DB stats keystone:SELECT=100 {{(pid=282899) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:36:11.589321 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51dfcef8-41cf-490b-85fd-641d21842d95 None admin] Validating token access rules against request {{(pid=282899) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:36:11.598504 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e05416b0-06da-4dcc-b4f3-b5c6ec01fcd8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:36:11.600287 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e05416b0-06da-4dcc-b4f3-b5c6ec01fcd8 None admin] RBAC: Authorization granted {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:36:11.628415 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf874f6d-669d-417a-a75b-529e1c336f81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282899) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:36:11.629234 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf874f6d-669d-417a-a75b-529e1c336f81 None admin] REQUEST_METHOD: `POST` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:36:11.629476 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf874f6d-669d-417a-a75b-529e1c336f81 None admin] SCRIPT_NAME: `/identity` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:36:11.629754 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf874f6d-669d-417a-a75b-529e1c336f81 None admin] PATH_INFO: `/v3/users` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:36:11.630449 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf874f6d-669d-417a-a75b-529e1c336f81 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:36:11.631970 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf874f6d-669d-417a-a75b-529e1c336f81 None admin] RBAC: Authorization granted {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:36:11.654159 dv-cinder-851351-1-smb devstack@keystone.service[282899]: [pid: 282899|app: 0|req: 100/192] 10.222.0.42 () {60 vars in 1132 bytes} [Thu Jul 28 08:36:11 2022] POST /identity/v3/users => generated 297 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 08:36:11.655103 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf874f6d-669d-417a-a75b-529e1c336f81 None admin] Authenticating user token {{(pid=282899) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:36:11.718178 dv-cinder-851351-1-smb devstack@keystone.service[282898]: [pid: 282898|app: 0|req: 93/193] 10.222.0.42 () {58 vars in 1282 bytes} [Thu Jul 28 08:36:11 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 413 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 28 08:36:11.732716 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05416b0-06da-4dcc-b4f3-b5c6ec01fcd8 None admin] Authenticating user token {{(pid=282898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:36:11.792892 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG dbcounter [-] [282898] Writing DB stats keystone:SELECT=100 {{(pid=282898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:36:11.803100 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf874f6d-669d-417a-a75b-529e1c336f81 None admin] Validating token access rules against request {{(pid=282899) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:36:11.854278 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG dbcounter [-] [282899] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=282899) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:36:11.862627 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e922cb-778a-4d2b-b367-d65fe25b7482 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282899) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:36:11.863591 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e922cb-778a-4d2b-b367-d65fe25b7482 None admin] REQUEST_METHOD: `GET` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:36:11.864249 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e922cb-778a-4d2b-b367-d65fe25b7482 None admin] SCRIPT_NAME: `/identity` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:36:11.864389 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e922cb-778a-4d2b-b367-d65fe25b7482 None admin] PATH_INFO: `/v3/roles` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:36:11.865194 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4e922cb-778a-4d2b-b367-d65fe25b7482 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=282899) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:36:11.865905 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4e922cb-778a-4d2b-b367-d65fe25b7482 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:36:11.867915 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4e922cb-778a-4d2b-b367-d65fe25b7482 None admin] RBAC: Authorization granted {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:36:11.872884 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05416b0-06da-4dcc-b4f3-b5c6ec01fcd8 None admin] Validating token access rules against request {{(pid=282898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:36:11.877462 dv-cinder-851351-1-smb devstack@keystone.service[282899]: [pid: 282899|app: 0|req: 101/194] 10.222.0.42 () {56 vars in 1111 bytes} [Thu Jul 28 08:36:11 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:36:11.882869 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e922cb-778a-4d2b-b367-d65fe25b7482 None admin] Authenticating user token {{(pid=282899) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:36:11.915341 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e08d3b7-620f-48e2-8e1e-df60707c4ec5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:36:11.916007 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e08d3b7-620f-48e2-8e1e-df60707c4ec5 None admin] REQUEST_METHOD: `GET` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:36:11.916389 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e08d3b7-620f-48e2-8e1e-df60707c4ec5 None admin] SCRIPT_NAME: `/identity` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:36:11.916682 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e08d3b7-620f-48e2-8e1e-df60707c4ec5 None admin] PATH_INFO: `/v3/projects/305114c1888a404186311d18de60f67f` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:36:11.918063 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e08d3b7-620f-48e2-8e1e-df60707c4ec5 None admin] RBAC: Authorizing `identity:get_project(project_id=305114c1888a404186311d18de60f67f)` {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:36:11.919539 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e08d3b7-620f-48e2-8e1e-df60707c4ec5 None admin] RBAC: Authorization granted {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:36:11.921699 dv-cinder-851351-1-smb devstack@keystone.service[282898]: [pid: 282898|app: 0|req: 94/195] 10.222.0.42 () {56 vars in 1186 bytes} [Thu Jul 28 08:36:11 2022] GET /identity/v3/projects/305114c1888a404186311d18de60f67f => generated 302 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:36:11.929429 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e08d3b7-620f-48e2-8e1e-df60707c4ec5 None admin] Authenticating user token {{(pid=282898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:36:12.018149 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e922cb-778a-4d2b-b367-d65fe25b7482 None admin] Validating token access rules against request {{(pid=282899) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:36:12.059461 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20fb6911-2a7d-49d9-ba4c-527f6a035cbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282899) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:36:12.060138 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20fb6911-2a7d-49d9-ba4c-527f6a035cbf None admin] REQUEST_METHOD: `GET` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:36:12.060441 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20fb6911-2a7d-49d9-ba4c-527f6a035cbf None admin] SCRIPT_NAME: `/identity` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:36:12.060752 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20fb6911-2a7d-49d9-ba4c-527f6a035cbf None admin] PATH_INFO: `/v3/users/a7a46e4205fe48debb9e2eb8469bc7c2` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:36:12.061631 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e08d3b7-620f-48e2-8e1e-df60707c4ec5 None admin] Validating token access rules against request {{(pid=282898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:36:12.061991 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20fb6911-2a7d-49d9-ba4c-527f6a035cbf None admin] RBAC: Authorizing `identity:get_user(user_id=a7a46e4205fe48debb9e2eb8469bc7c2)` {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:36:12.063535 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20fb6911-2a7d-49d9-ba4c-527f6a035cbf None admin] RBAC: Authorization granted {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:36:12.065556 dv-cinder-851351-1-smb devstack@keystone.service[282899]: [pid: 282899|app: 0|req: 102/196] 10.222.0.42 () {56 vars in 1177 bytes} [Thu Jul 28 08:36:11 2022] GET /identity/v3/users/a7a46e4205fe48debb9e2eb8469bc7c2 => generated 283 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 08:36:12.072724 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20fb6911-2a7d-49d9-ba4c-527f6a035cbf None admin] Authenticating user token {{(pid=282899) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:36:12.078928 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG dbcounter [-] [282898] Writing DB stats keystone:SELECT=100 {{(pid=282898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:36:12.111339 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fbd4354-7541-4c0a-88b7-5d14a353a1ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:36:12.112263 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbd4354-7541-4c0a-88b7-5d14a353a1ac None admin] REQUEST_METHOD: `GET` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:36:12.112550 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbd4354-7541-4c0a-88b7-5d14a353a1ac None admin] SCRIPT_NAME: `/identity` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:36:12.112852 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbd4354-7541-4c0a-88b7-5d14a353a1ac None admin] PATH_INFO: `/v3/role_assignments` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:36:12.113745 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fbd4354-7541-4c0a-88b7-5d14a353a1ac None admin] RBAC: Adding query filter params (role.id=a0e2a00bf94d40f38629d6b5293e3aee, scope.project.id=305114c1888a404186311d18de60f67f, user.id=a7a46e4205fe48debb9e2eb8469bc7c2) {{(pid=282898) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:36:12.114230 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fbd4354-7541-4c0a-88b7-5d14a353a1ac None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:36:12.116599 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fbd4354-7541-4c0a-88b7-5d14a353a1ac None admin] RBAC: Authorization granted {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:36:12.124123 dv-cinder-851351-1-smb devstack@keystone.service[282898]: [pid: 282898|app: 0|req: 95/197] 10.222.0.42 () {56 vars in 1374 bytes} [Thu Jul 28 08:36:11 2022] GET /identity/v3/role_assignments?user.id=a7a46e4205fe48debb9e2eb8469bc7c2&scope.project.id=305114c1888a404186311d18de60f67f&role.id=a0e2a00bf94d40f38629d6b5293e3aee => generated 259 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:36:12.158977 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG dbcounter [-] [282899] Writing DB stats keystone:SELECT=100 {{(pid=282899) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:36:12.217445 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20fb6911-2a7d-49d9-ba4c-527f6a035cbf None admin] Validating token access rules against request {{(pid=282899) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:36:12.272602 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45eab967-8e95-49ee-b67e-0b81d51a9219 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282899) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:36:12.273299 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45eab967-8e95-49ee-b67e-0b81d51a9219 None admin] REQUEST_METHOD: `GET` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:36:12.273579 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45eab967-8e95-49ee-b67e-0b81d51a9219 None admin] SCRIPT_NAME: `/identity` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:36:12.273858 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45eab967-8e95-49ee-b67e-0b81d51a9219 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:36:12.372894 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45eab967-8e95-49ee-b67e-0b81d51a9219 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:36:12.374420 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45eab967-8e95-49ee-b67e-0b81d51a9219 None admin] RBAC: Authorization granted {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:36:12.420337 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf55b9c4-6fce-43e8-8c82-02840c276170 None None] REQUEST_METHOD: `GET` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:36:12.420529 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf55b9c4-6fce-43e8-8c82-02840c276170 None None] SCRIPT_NAME: `/identity` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:36:12.420830 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf55b9c4-6fce-43e8-8c82-02840c276170 None None] PATH_INFO: `/` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:36:12.422495 dv-cinder-851351-1-smb devstack@keystone.service[282898]: [pid: 282898|app: 0|req: 96/198] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 08:36:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 28 08:36:12.442307 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31241ffc-808a-4c34-9532-28bed809ad44 None None] REQUEST_METHOD: `POST` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:36:12.442658 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31241ffc-808a-4c34-9532-28bed809ad44 None None] SCRIPT_NAME: `/identity` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:36:12.443748 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31241ffc-808a-4c34-9532-28bed809ad44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:36:12.473337 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG dbcounter [-] [282899] Writing DB stats keystone:SELECT=100 {{(pid=282899) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:36:12.490159 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.auth.core [None req-31241ffc-808a-4c34-9532-28bed809ad44 None None] MFA Rules not processed for user `2be990a66857410a87ffa7609aec4f7b`. Rule list: `[]` (Enabled: `True`). {{(pid=282898) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 08:36:12.491404 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.fernet_utils [None req-31241ffc-808a-4c34-9532-28bed809ad44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=282898) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:36:12.516520 dv-cinder-851351-1-smb devstack@keystone.service[282899]: [pid: 282899|app: 0|req: 103/199] 10.222.0.42 () {58 vars in 1282 bytes} [Thu Jul 28 08:36:12 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 444 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 28 08:36:12.526295 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45eab967-8e95-49ee-b67e-0b81d51a9219 None admin] Authenticating user token {{(pid=282899) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:36:12.579923 dv-cinder-851351-1-smb devstack@keystone.service[282898]: [pid: 282898|app: 0|req: 97/200] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 08:36:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 28 08:36:12.659437 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31241ffc-808a-4c34-9532-28bed809ad44 None None] Authenticating user token {{(pid=282898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:36:12.660236 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45eab967-8e95-49ee-b67e-0b81d51a9219 None admin] Validating token access rules against request {{(pid=282899) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:36:12.700266 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a12ecde-34a9-49f3-ac41-1cffbe0e8721 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282899) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:36:12.700887 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a12ecde-34a9-49f3-ac41-1cffbe0e8721 None admin] REQUEST_METHOD: `GET` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:36:12.701174 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a12ecde-34a9-49f3-ac41-1cffbe0e8721 None admin] SCRIPT_NAME: `/identity` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:36:12.701449 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a12ecde-34a9-49f3-ac41-1cffbe0e8721 None admin] PATH_INFO: `/v3/projects/305114c1888a404186311d18de60f67f` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:36:12.702652 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a12ecde-34a9-49f3-ac41-1cffbe0e8721 None admin] RBAC: Authorizing `identity:get_project(project_id=305114c1888a404186311d18de60f67f)` {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:36:12.704118 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a12ecde-34a9-49f3-ac41-1cffbe0e8721 None admin] RBAC: Authorization granted {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:36:12.706291 dv-cinder-851351-1-smb devstack@keystone.service[282899]: [pid: 282899|app: 0|req: 104/201] 10.222.0.42 () {56 vars in 1186 bytes} [Thu Jul 28 08:36:12 2022] GET /identity/v3/projects/305114c1888a404186311d18de60f67f => generated 302 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:36:12.722235 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a12ecde-34a9-49f3-ac41-1cffbe0e8721 None admin] Authenticating user token {{(pid=282899) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:36:12.784947 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31241ffc-808a-4c34-9532-28bed809ad44 None None] Validating token access rules against request {{(pid=282898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:36:12.813262 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG dbcounter [-] [282898] Writing DB stats keystone:SELECT=100 {{(pid=282898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:36:12.827849 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG dbcounter [-] [282899] Writing DB stats keystone:SELECT=100 {{(pid=282899) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:36:12.841406 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7ada9f-9ea3-4f30-bda0-f3e358fb8d69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:36:12.842071 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7ada9f-9ea3-4f30-bda0-f3e358fb8d69 None admin] REQUEST_METHOD: `GET` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:36:12.842347 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7ada9f-9ea3-4f30-bda0-f3e358fb8d69 None admin] SCRIPT_NAME: `/identity` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:36:12.842616 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7ada9f-9ea3-4f30-bda0-f3e358fb8d69 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:36:12.860902 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac7ada9f-9ea3-4f30-bda0-f3e358fb8d69 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 08:36:12.865950 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application [None req-ac7ada9f-9ea3-4f30-bda0-f3e358fb8d69 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 28 08:36:12.865950 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:36:12.865950 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:36:12.865950 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:36:12.865950 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:36:12.865950 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:36:12.865950 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:36:12.865950 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:36:12.865950 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:36:12.865950 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:36:12.865950 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:36:12.865950 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:36:12.865950 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 08:36:12.865950 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 08:36:12.865950 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 08:36:12.865950 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 08:36:12.867023 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 08:36:12.867023 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 08:36:12.867023 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 08:36:12.867023 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 08:36:12.867023 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:36:12.867023 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:36:12.867023 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:36:12.867023 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:36:12.867023 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:36:12.867023 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:36:12.867023 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:36:12.867023 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application with Lock( Jul 28 08:36:12.867023 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:36:12.867023 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:36:12.867023 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:36:12.867023 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:36:12.867985 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:36:12.867985 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:36:12.867985 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:36:12.867985 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:36:12.867985 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 08:36:12.867985 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 08:36:12.867985 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 08:36:12.867985 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 08:36:12.867985 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 08:36:12.867985 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 08:36:12.867985 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 28 08:36:12.867985 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application Jul 28 08:36:12.868731 dv-cinder-851351-1-smb devstack@keystone.service[282898]: [pid: 282898|app: 0|req: 98/202] 10.222.0.42 () {56 vars in 1099 bytes} [Thu Jul 28 08:36:12 2022] GET /identity/v3/roles/reader => generated 84 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:36:12.875821 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7ada9f-9ea3-4f30-bda0-f3e358fb8d69 None admin] Authenticating user token {{(pid=282898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:36:12.952492 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a12ecde-34a9-49f3-ac41-1cffbe0e8721 None admin] Validating token access rules against request {{(pid=282899) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:36:13.011297 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd0b780-21b4-47d2-be04-30b7c4f89041 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282899) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:36:13.011297 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd0b780-21b4-47d2-be04-30b7c4f89041 None admin] REQUEST_METHOD: `GET` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:36:13.011297 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd0b780-21b4-47d2-be04-30b7c4f89041 None admin] SCRIPT_NAME: `/identity` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:36:13.011297 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd0b780-21b4-47d2-be04-30b7c4f89041 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:36:13.011809 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acd0b780-21b4-47d2-be04-30b7c4f89041 None admin] RBAC: Adding query filter params (role.id=d76677105be344cc83022cbde8a22d8d, scope.project.id=305114c1888a404186311d18de60f67f, user.id=a7a46e4205fe48debb9e2eb8469bc7c2) {{(pid=282899) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:36:13.011809 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acd0b780-21b4-47d2-be04-30b7c4f89041 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:36:13.011809 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acd0b780-21b4-47d2-be04-30b7c4f89041 None admin] RBAC: Authorization granted {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:36:13.023709 dv-cinder-851351-1-smb devstack@keystone.service[282899]: [pid: 282899|app: 0|req: 105/203] 10.222.0.42 () {56 vars in 1374 bytes} [Thu Jul 28 08:36:12 2022] GET /identity/v3/role_assignments?user.id=a7a46e4205fe48debb9e2eb8469bc7c2&scope.project.id=305114c1888a404186311d18de60f67f&role.id=d76677105be344cc83022cbde8a22d8d => generated 259 bytes in 302 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 08:36:13.061077 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7ada9f-9ea3-4f30-bda0-f3e358fb8d69 None admin] Validating token access rules against request {{(pid=282898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:36:13.124224 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b761e9-47dc-4586-9a6d-e51602fb2019 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:36:13.125357 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b761e9-47dc-4586-9a6d-e51602fb2019 None admin] REQUEST_METHOD: `GET` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:36:13.125893 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b761e9-47dc-4586-9a6d-e51602fb2019 None admin] SCRIPT_NAME: `/identity` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:36:13.126414 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b761e9-47dc-4586-9a6d-e51602fb2019 None admin] PATH_INFO: `/v3/roles` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:36:13.127421 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83b761e9-47dc-4586-9a6d-e51602fb2019 None admin] RBAC: Adding query filter params (name=reader) {{(pid=282898) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:36:13.127978 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83b761e9-47dc-4586-9a6d-e51602fb2019 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:36:13.130021 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83b761e9-47dc-4586-9a6d-e51602fb2019 None admin] RBAC: Authorization granted {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:36:13.145161 dv-cinder-851351-1-smb devstack@keystone.service[282898]: [pid: 282898|app: 0|req: 99/204] 10.222.0.42 () {56 vars in 1101 bytes} [Thu Jul 28 08:36:12 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:36:13.150921 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd0b780-21b4-47d2-be04-30b7c4f89041 None admin] Authenticating user token {{(pid=282899) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:36:13.296787 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG dbcounter [-] [282899] Writing DB stats keystone:SELECT=100 {{(pid=282899) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:36:13.305554 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd0b780-21b4-47d2-be04-30b7c4f89041 None admin] Validating token access rules against request {{(pid=282899) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:36:13.353902 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62d56ed-9045-41b3-bc43-0e686c37be0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282899) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:36:13.354998 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62d56ed-9045-41b3-bc43-0e686c37be0c None admin] REQUEST_METHOD: `GET` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:36:13.355526 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62d56ed-9045-41b3-bc43-0e686c37be0c None admin] SCRIPT_NAME: `/identity` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:36:13.356183 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62d56ed-9045-41b3-bc43-0e686c37be0c None admin] PATH_INFO: `/v3/users/aada0588d55b4592af9d57baa4a887fb` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:36:13.359566 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f62d56ed-9045-41b3-bc43-0e686c37be0c None admin] RBAC: Authorizing `identity:get_user(user_id=aada0588d55b4592af9d57baa4a887fb)` {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:36:13.361531 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f62d56ed-9045-41b3-bc43-0e686c37be0c None admin] RBAC: Authorization granted {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:36:13.363576 dv-cinder-851351-1-smb devstack@keystone.service[282899]: [pid: 282899|app: 0|req: 106/205] 10.222.0.42 () {56 vars in 1177 bytes} [Thu Jul 28 08:36:13 2022] GET /identity/v3/users/aada0588d55b4592af9d57baa4a887fb => generated 289 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:36:13.369825 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b761e9-47dc-4586-9a6d-e51602fb2019 None admin] Authenticating user token {{(pid=282898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:36:13.420292 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG dbcounter [-] [282898] Writing DB stats keystone:SELECT=100 {{(pid=282898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:36:13.516609 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b761e9-47dc-4586-9a6d-e51602fb2019 None admin] Validating token access rules against request {{(pid=282898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:36:13.552282 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7a07e3-ca7a-4539-a808-2b9c7b80a1c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:36:13.552867 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7a07e3-ca7a-4539-a808-2b9c7b80a1c9 None admin] REQUEST_METHOD: `GET` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:36:13.553153 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7a07e3-ca7a-4539-a808-2b9c7b80a1c9 None admin] SCRIPT_NAME: `/identity` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:36:13.553427 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7a07e3-ca7a-4539-a808-2b9c7b80a1c9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:36:13.625883 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f7a07e3-ca7a-4539-a808-2b9c7b80a1c9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:36:13.625883 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f7a07e3-ca7a-4539-a808-2b9c7b80a1c9 None admin] RBAC: Authorization granted {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:36:13.665507 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG dbcounter [-] [282898] Writing DB stats keystone:SELECT=100 {{(pid=282898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:36:13.762098 dv-cinder-851351-1-smb devstack@keystone.service[282898]: [pid: 282898|app: 0|req: 100/206] 10.222.0.42 () {58 vars in 1282 bytes} [Thu Jul 28 08:36:13 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 393 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 28 08:36:13.767455 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62d56ed-9045-41b3-bc43-0e686c37be0c None admin] Authenticating user token {{(pid=282899) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:36:13.900473 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62d56ed-9045-41b3-bc43-0e686c37be0c None admin] Validating token access rules against request {{(pid=282899) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:36:13.947074 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f2758b6-74f9-41dd-a854-42d1d42a7610 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282899) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:36:13.947742 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2758b6-74f9-41dd-a854-42d1d42a7610 None admin] REQUEST_METHOD: `GET` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:36:13.948028 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2758b6-74f9-41dd-a854-42d1d42a7610 None admin] SCRIPT_NAME: `/identity` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:36:13.948310 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2758b6-74f9-41dd-a854-42d1d42a7610 None admin] PATH_INFO: `/v3/projects/c089873b22dd43e8a9de1c83b1355842` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:36:13.953409 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f2758b6-74f9-41dd-a854-42d1d42a7610 None admin] RBAC: Authorizing `identity:get_project(project_id=c089873b22dd43e8a9de1c83b1355842)` {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:36:13.955272 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f2758b6-74f9-41dd-a854-42d1d42a7610 None admin] RBAC: Authorization granted {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:36:13.957397 dv-cinder-851351-1-smb devstack@keystone.service[282899]: [pid: 282899|app: 0|req: 107/207] 10.222.0.42 () {56 vars in 1186 bytes} [Thu Jul 28 08:36:13 2022] GET /identity/v3/projects/c089873b22dd43e8a9de1c83b1355842 => generated 298 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:36:13.963010 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7a07e3-ca7a-4539-a808-2b9c7b80a1c9 None admin] Authenticating user token {{(pid=282898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:36:14.081163 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7a07e3-ca7a-4539-a808-2b9c7b80a1c9 None admin] Validating token access rules against request {{(pid=282898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:36:14.110799 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG dbcounter [-] [282898] Writing DB stats keystone:SELECT=100 {{(pid=282898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:36:14.121024 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1010c30b-5c8e-4603-aacb-8e4a05ada4fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:36:14.121694 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1010c30b-5c8e-4603-aacb-8e4a05ada4fc None admin] REQUEST_METHOD: `GET` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:36:14.123159 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1010c30b-5c8e-4603-aacb-8e4a05ada4fc None admin] SCRIPT_NAME: `/identity` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:36:14.123159 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1010c30b-5c8e-4603-aacb-8e4a05ada4fc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:36:14.123159 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1010c30b-5c8e-4603-aacb-8e4a05ada4fc None admin] RBAC: Adding query filter params (role.id=34c6ec459a944c46a4265d15a06e348d, scope.project.id=c089873b22dd43e8a9de1c83b1355842, user.id=aada0588d55b4592af9d57baa4a887fb) {{(pid=282898) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:36:14.123655 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1010c30b-5c8e-4603-aacb-8e4a05ada4fc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:36:14.125023 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1010c30b-5c8e-4603-aacb-8e4a05ada4fc None admin] RBAC: Authorization granted {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:36:14.137751 dv-cinder-851351-1-smb devstack@keystone.service[282898]: [pid: 282898|app: 0|req: 101/208] 10.222.0.42 () {56 vars in 1374 bytes} [Thu Jul 28 08:36:13 2022] GET /identity/v3/role_assignments?user.id=aada0588d55b4592af9d57baa4a887fb&scope.project.id=c089873b22dd43e8a9de1c83b1355842&role.id=34c6ec459a944c46a4265d15a06e348d => generated 608 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:36:14.288825 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec935b3-4147-4490-9f79-6692163b9fe8 None None] REQUEST_METHOD: `GET` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:36:14.289175 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec935b3-4147-4490-9f79-6692163b9fe8 None None] SCRIPT_NAME: `/identity` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:36:14.289382 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec935b3-4147-4490-9f79-6692163b9fe8 None None] PATH_INFO: `/` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:36:14.291060 dv-cinder-851351-1-smb devstack@keystone.service[282899]: [pid: 282899|app: 0|req: 108/209] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 08:36:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 08:36:14.296595 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9821d1be-71e0-4aa0-8c8f-3c79ae0a8ad1 None None] REQUEST_METHOD: `POST` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:36:14.296940 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9821d1be-71e0-4aa0-8c8f-3c79ae0a8ad1 None None] SCRIPT_NAME: `/identity` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:36:14.297180 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9821d1be-71e0-4aa0-8c8f-3c79ae0a8ad1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:36:14.320931 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.auth.core [None req-9821d1be-71e0-4aa0-8c8f-3c79ae0a8ad1 None None] MFA Rules not processed for user `2be990a66857410a87ffa7609aec4f7b`. Rule list: `[]` (Enabled: `True`). {{(pid=282898) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 08:36:14.322150 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.fernet_utils [None req-9821d1be-71e0-4aa0-8c8f-3c79ae0a8ad1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=282898) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:36:14.436096 dv-cinder-851351-1-smb devstack@keystone.service[282898]: [pid: 282898|app: 0|req: 102/210] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 08:36:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 08:36:14.473540 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec935b3-4147-4490-9f79-6692163b9fe8 None None] Authenticating user token {{(pid=282899) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:36:14.509275 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG dbcounter [-] [282899] Writing DB stats keystone:SELECT=100 {{(pid=282899) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:36:14.601659 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec935b3-4147-4490-9f79-6692163b9fe8 None None] Validating token access rules against request {{(pid=282899) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:36:14.632409 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd57956-341b-454a-9893-50d2c2080bfd None None] REQUEST_METHOD: `GET` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:36:14.632770 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd57956-341b-454a-9893-50d2c2080bfd None None] SCRIPT_NAME: `/identity` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:36:14.632998 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd57956-341b-454a-9893-50d2c2080bfd None None] PATH_INFO: `/` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:36:14.634537 dv-cinder-851351-1-smb devstack@keystone.service[282898]: [pid: 282898|app: 0|req: 103/211] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 08:36:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 08:36:14.641158 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05cd9709-935f-4faf-8530-a5501b4a4d24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282899) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:36:14.641876 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05cd9709-935f-4faf-8530-a5501b4a4d24 None admin] REQUEST_METHOD: `GET` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:36:14.642153 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05cd9709-935f-4faf-8530-a5501b4a4d24 None admin] SCRIPT_NAME: `/identity` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:36:14.642478 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05cd9709-935f-4faf-8530-a5501b4a4d24 None admin] PATH_INFO: `/v3/domains/default` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:36:14.642921 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b651d2-a6f4-4bd0-afea-6a9e1fef40a3 None None] REQUEST_METHOD: `POST` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:36:14.643419 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b651d2-a6f4-4bd0-afea-6a9e1fef40a3 None None] SCRIPT_NAME: `/identity` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:36:14.643646 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05cd9709-935f-4faf-8530-a5501b4a4d24 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:36:14.644124 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b651d2-a6f4-4bd0-afea-6a9e1fef40a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:36:14.645248 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05cd9709-935f-4faf-8530-a5501b4a4d24 None admin] RBAC: Authorization granted {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:36:14.652601 dv-cinder-851351-1-smb devstack@keystone.service[282899]: [pid: 282899|app: 0|req: 109/212] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 08:36:14 2022] GET /identity/v3/domains/default => generated 199 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:36:14.653965 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05cd9709-935f-4faf-8530-a5501b4a4d24 None admin] Authenticating user token {{(pid=282899) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:36:14.672239 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.auth.core [None req-57b651d2-a6f4-4bd0-afea-6a9e1fef40a3 None None] MFA Rules not processed for user `2be990a66857410a87ffa7609aec4f7b`. Rule list: `[]` (Enabled: `True`). {{(pid=282898) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 08:36:14.674293 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.fernet_utils [None req-57b651d2-a6f4-4bd0-afea-6a9e1fef40a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=282898) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:36:14.762990 dv-cinder-851351-1-smb devstack@keystone.service[282898]: [pid: 282898|app: 0|req: 104/213] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 08:36:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 08:36:14.774344 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG dbcounter [-] [282899] Writing DB stats keystone:SELECT=100 {{(pid=282899) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:36:14.779975 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05cd9709-935f-4faf-8530-a5501b4a4d24 None admin] Validating token access rules against request {{(pid=282899) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:36:14.790119 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b651d2-a6f4-4bd0-afea-6a9e1fef40a3 None None] Authenticating user token {{(pid=282898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:36:14.821444 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8963161-6acd-4a95-85bf-9ae3a91ca332 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282899) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:36:14.822099 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8963161-6acd-4a95-85bf-9ae3a91ca332 None admin] REQUEST_METHOD: `POST` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:36:14.822391 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8963161-6acd-4a95-85bf-9ae3a91ca332 None admin] SCRIPT_NAME: `/identity` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:36:14.822770 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8963161-6acd-4a95-85bf-9ae3a91ca332 None admin] PATH_INFO: `/v3/users` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:36:14.823584 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8963161-6acd-4a95-85bf-9ae3a91ca332 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:36:14.825194 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8963161-6acd-4a95-85bf-9ae3a91ca332 None admin] RBAC: Authorization granted {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:36:14.852522 dv-cinder-851351-1-smb devstack@keystone.service[282899]: [pid: 282899|app: 0|req: 110/214] 10.222.0.42 () {60 vars in 1132 bytes} [Thu Jul 28 08:36:14 2022] POST /identity/v3/users => generated 297 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 08:36:14.860856 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG dbcounter [-] [282898] Writing DB stats keystone:SELECT=100 {{(pid=282898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:36:14.866820 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc620562-b62d-4f4b-98b0-84156b4f765c None None] REQUEST_METHOD: `GET` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:36:14.867160 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc620562-b62d-4f4b-98b0-84156b4f765c None None] SCRIPT_NAME: `/identity` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:36:14.867388 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc620562-b62d-4f4b-98b0-84156b4f765c None None] PATH_INFO: `/` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:36:14.868866 dv-cinder-851351-1-smb devstack@keystone.service[282899]: [pid: 282899|app: 0|req: 111/215] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 08:36:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 28 08:36:14.874912 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2fd841-fac5-4a9e-bbd8-eb65e79bbc9b None None] REQUEST_METHOD: `POST` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:36:14.875292 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2fd841-fac5-4a9e-bbd8-eb65e79bbc9b None None] SCRIPT_NAME: `/identity` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:36:14.875637 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2fd841-fac5-4a9e-bbd8-eb65e79bbc9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:36:14.895127 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.auth.core [None req-7b2fd841-fac5-4a9e-bbd8-eb65e79bbc9b None None] MFA Rules not processed for user `2be990a66857410a87ffa7609aec4f7b`. Rule list: `[]` (Enabled: `True`). {{(pid=282899) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 08:36:14.896513 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.fernet_utils [None req-7b2fd841-fac5-4a9e-bbd8-eb65e79bbc9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=282899) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:36:14.918720 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b651d2-a6f4-4bd0-afea-6a9e1fef40a3 None None] Validating token access rules against request {{(pid=282898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:36:14.959916 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55eae65c-9f3b-4ca0-a462-254cc3fa9abc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:36:14.960590 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55eae65c-9f3b-4ca0-a462-254cc3fa9abc None admin] REQUEST_METHOD: `GET` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:36:14.961074 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55eae65c-9f3b-4ca0-a462-254cc3fa9abc None admin] SCRIPT_NAME: `/identity` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:36:14.961616 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55eae65c-9f3b-4ca0-a462-254cc3fa9abc None admin] PATH_INFO: `/v3/roles/member` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:36:14.974033 dv-cinder-851351-1-smb devstack@keystone.service[282899]: [pid: 282899|app: 0|req: 112/216] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 08:36:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 28 08:36:14.980936 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55eae65c-9f3b-4ca0-a462-254cc3fa9abc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 08:36:14.980936 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application [None req-55eae65c-9f3b-4ca0-a462-254cc3fa9abc None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 28 08:36:14.980936 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:36:14.980936 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:36:14.980936 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:36:14.980936 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:36:14.980936 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:36:14.980936 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:36:14.980936 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:36:14.980936 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:36:14.980936 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:36:14.980936 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:36:14.980936 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:36:14.980936 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 08:36:14.982178 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 08:36:14.982178 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 08:36:14.982178 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 08:36:14.982178 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 08:36:14.982178 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 08:36:14.982178 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 08:36:14.982178 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 08:36:14.982178 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:36:14.982178 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:36:14.982178 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:36:14.982178 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:36:14.982178 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:36:14.982178 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:36:14.982178 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:36:14.982178 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application with Lock( Jul 28 08:36:14.982178 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:36:14.982178 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:36:14.983196 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:36:14.983196 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:36:14.983196 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:36:14.983196 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:36:14.983196 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:36:14.983196 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:36:14.983196 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 08:36:14.983196 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 08:36:14.983196 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 08:36:14.983196 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 08:36:14.983196 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 08:36:14.983196 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 08:36:14.983196 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 28 08:36:14.983196 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application Jul 28 08:36:14.983196 dv-cinder-851351-1-smb devstack@keystone.service[282898]: [pid: 282898|app: 0|req: 105/217] 10.222.0.42 () {56 vars in 1099 bytes} [Thu Jul 28 08:36:14 2022] GET /identity/v3/roles/member => generated 84 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 08:36:14.987490 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55eae65c-9f3b-4ca0-a462-254cc3fa9abc None admin] Authenticating user token {{(pid=282898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:36:15.001536 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2fd841-fac5-4a9e-bbd8-eb65e79bbc9b None None] Authenticating user token {{(pid=282899) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:36:15.106980 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG dbcounter [-] [282899] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=282899) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:36:15.125343 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2fd841-fac5-4a9e-bbd8-eb65e79bbc9b None None] Validating token access rules against request {{(pid=282899) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:36:15.136969 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55eae65c-9f3b-4ca0-a462-254cc3fa9abc None admin] Validating token access rules against request {{(pid=282898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:36:15.154508 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG dbcounter [-] [282898] Writing DB stats keystone:SELECT=100 {{(pid=282898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:36:15.175145 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2322386-46b4-4d80-8d6c-8e7d5ecd5595 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282899) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:36:15.175895 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2322386-46b4-4d80-8d6c-8e7d5ecd5595 None admin] REQUEST_METHOD: `GET` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:36:15.176181 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2322386-46b4-4d80-8d6c-8e7d5ecd5595 None admin] SCRIPT_NAME: `/identity` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:36:15.176457 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2322386-46b4-4d80-8d6c-8e7d5ecd5595 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:36:15.179033 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5da328c-a5e2-411f-b663-06951cd99d11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:36:15.179671 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5da328c-a5e2-411f-b663-06951cd99d11 None admin] REQUEST_METHOD: `GET` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:36:15.179958 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5da328c-a5e2-411f-b663-06951cd99d11 None admin] SCRIPT_NAME: `/identity` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:36:15.180530 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5da328c-a5e2-411f-b663-06951cd99d11 None admin] PATH_INFO: `/v3/roles` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:36:15.181025 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5da328c-a5e2-411f-b663-06951cd99d11 None admin] RBAC: Adding query filter params (name=member) {{(pid=282898) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:36:15.181338 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5da328c-a5e2-411f-b663-06951cd99d11 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:36:15.182752 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5da328c-a5e2-411f-b663-06951cd99d11 None admin] RBAC: Authorization granted {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:36:15.189716 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2322386-46b4-4d80-8d6c-8e7d5ecd5595 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 08:36:15.192242 dv-cinder-851351-1-smb devstack@keystone.service[282898]: [pid: 282898|app: 0|req: 106/218] 10.222.0.42 () {56 vars in 1101 bytes} [Thu Jul 28 08:36:14 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:36:15.195963 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application [None req-d2322386-46b4-4d80-8d6c-8e7d5ecd5595 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 08:36:15.195963 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:36:15.195963 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:36:15.195963 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:36:15.195963 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:36:15.195963 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:36:15.195963 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:36:15.195963 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:36:15.195963 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:36:15.195963 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:36:15.195963 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:36:15.195963 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:36:15.195963 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 08:36:15.195963 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 08:36:15.195963 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 08:36:15.195963 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 08:36:15.197058 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 08:36:15.197058 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 08:36:15.197058 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 08:36:15.197058 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 08:36:15.197058 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:36:15.197058 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:36:15.197058 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:36:15.197058 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:36:15.197058 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:36:15.197058 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:36:15.197058 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:36:15.197058 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application with Lock( Jul 28 08:36:15.197058 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:36:15.197058 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:36:15.197058 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:36:15.197058 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:36:15.198022 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:36:15.198022 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:36:15.198022 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:36:15.198022 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:36:15.198022 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 08:36:15.198022 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 08:36:15.198022 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 08:36:15.198022 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 08:36:15.198022 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 08:36:15.198022 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 08:36:15.198022 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 08:36:15.198022 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application Jul 28 08:36:15.198022 dv-cinder-851351-1-smb devstack@keystone.service[282899]: [pid: 282899|app: 0|req: 113/219] 10.222.0.42 () {56 vars in 1096 bytes} [Thu Jul 28 08:36:15 2022] GET /identity/v3/roles/admin => generated 83 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:36:15.198797 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5da328c-a5e2-411f-b663-06951cd99d11 None admin] Authenticating user token {{(pid=282898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:36:15.205317 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2322386-46b4-4d80-8d6c-8e7d5ecd5595 None admin] Authenticating user token {{(pid=282899) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:36:15.311301 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5da328c-a5e2-411f-b663-06951cd99d11 None admin] Validating token access rules against request {{(pid=282898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:36:15.328653 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2322386-46b4-4d80-8d6c-8e7d5ecd5595 None admin] Validating token access rules against request {{(pid=282899) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:36:15.364331 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b8f6a3-0d29-4914-a9d4-fcc488eb208f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:36:15.365987 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b8f6a3-0d29-4914-a9d4-fcc488eb208f None admin] REQUEST_METHOD: `GET` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:36:15.366723 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b8f6a3-0d29-4914-a9d4-fcc488eb208f None admin] SCRIPT_NAME: `/identity` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:36:15.367198 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b8f6a3-0d29-4914-a9d4-fcc488eb208f None admin] PATH_INFO: `/v3/users/f904ed0dbba148a880c3e595f699694a` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:36:15.370619 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26aa3a6-9023-4b95-84a8-a5c473833578 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282899) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:36:15.371854 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26aa3a6-9023-4b95-84a8-a5c473833578 None admin] REQUEST_METHOD: `GET` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:36:15.371854 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26aa3a6-9023-4b95-84a8-a5c473833578 None admin] SCRIPT_NAME: `/identity` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:36:15.372082 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26aa3a6-9023-4b95-84a8-a5c473833578 None admin] PATH_INFO: `/v3/roles` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:36:15.372926 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a26aa3a6-9023-4b95-84a8-a5c473833578 None admin] RBAC: Adding query filter params (name=admin) {{(pid=282899) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:36:15.373331 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a26aa3a6-9023-4b95-84a8-a5c473833578 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:36:15.374862 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a26aa3a6-9023-4b95-84a8-a5c473833578 None admin] RBAC: Authorization granted {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:36:15.386171 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b8f6a3-0d29-4914-a9d4-fcc488eb208f None admin] RBAC: Authorizing `identity:get_user(user_id=f904ed0dbba148a880c3e595f699694a)` {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:36:15.387915 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b8f6a3-0d29-4914-a9d4-fcc488eb208f None admin] RBAC: Authorization granted {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:36:15.390197 dv-cinder-851351-1-smb devstack@keystone.service[282899]: [pid: 282899|app: 0|req: 114/221] 10.222.0.42 () {56 vars in 1099 bytes} [Thu Jul 28 08:36:15 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 08:36:15.390351 dv-cinder-851351-1-smb devstack@keystone.service[282898]: [pid: 282898|app: 0|req: 107/221] 10.222.0.42 () {56 vars in 1177 bytes} [Thu Jul 28 08:36:15 2022] GET /identity/v3/users/f904ed0dbba148a880c3e595f699694a => generated 297 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:36:15.396466 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b8f6a3-0d29-4914-a9d4-fcc488eb208f None admin] Authenticating user token {{(pid=282898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:36:15.396654 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26aa3a6-9023-4b95-84a8-a5c473833578 None admin] Authenticating user token {{(pid=282899) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:36:15.407606 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG dbcounter [-] [282899] Writing DB stats keystone:SELECT=100 {{(pid=282899) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:36:15.444560 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG dbcounter [-] [282898] Writing DB stats keystone:SELECT=100 {{(pid=282898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:36:15.515200 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26aa3a6-9023-4b95-84a8-a5c473833578 None admin] Validating token access rules against request {{(pid=282899) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:36:15.524505 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b8f6a3-0d29-4914-a9d4-fcc488eb208f None admin] Validating token access rules against request {{(pid=282898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:36:15.551153 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e78e0c-a526-4f2b-8ac8-b666274d94e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282899) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:36:15.551963 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e78e0c-a526-4f2b-8ac8-b666274d94e5 None admin] REQUEST_METHOD: `GET` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:36:15.552349 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e78e0c-a526-4f2b-8ac8-b666274d94e5 None admin] SCRIPT_NAME: `/identity` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:36:15.552751 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e78e0c-a526-4f2b-8ac8-b666274d94e5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:36:15.565056 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4db3103-1432-4bb8-98e3-de853c524dcf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:36:15.566116 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4db3103-1432-4bb8-98e3-de853c524dcf None admin] REQUEST_METHOD: `GET` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:36:15.566698 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4db3103-1432-4bb8-98e3-de853c524dcf None admin] SCRIPT_NAME: `/identity` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:36:15.567186 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4db3103-1432-4bb8-98e3-de853c524dcf None admin] PATH_INFO: `/v3/users/a7a46e4205fe48debb9e2eb8469bc7c2` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:36:15.568645 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4db3103-1432-4bb8-98e3-de853c524dcf None admin] RBAC: Authorizing `identity:get_user(user_id=a7a46e4205fe48debb9e2eb8469bc7c2)` {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:36:15.570555 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4db3103-1432-4bb8-98e3-de853c524dcf None admin] RBAC: Authorization granted {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:36:15.572581 dv-cinder-851351-1-smb devstack@keystone.service[282898]: [pid: 282898|app: 0|req: 108/222] 10.222.0.42 () {56 vars in 1177 bytes} [Thu Jul 28 08:36:15 2022] GET /identity/v3/users/a7a46e4205fe48debb9e2eb8469bc7c2 => generated 283 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:36:15.574008 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f407f5-0aec-4503-ad1c-46f115d7132b None None] REQUEST_METHOD: `GET` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:36:15.574513 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f407f5-0aec-4503-ad1c-46f115d7132b None None] SCRIPT_NAME: `/identity` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:36:15.575016 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f407f5-0aec-4503-ad1c-46f115d7132b None None] PATH_INFO: `/` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:36:15.576515 dv-cinder-851351-1-smb devstack@keystone.service[282898]: [pid: 282898|app: 0|req: 109/223] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 08:36:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 08:36:15.583114 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4127299-12b8-42bc-acd8-d3f8cde76aa7 None None] REQUEST_METHOD: `POST` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:36:15.583736 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4127299-12b8-42bc-acd8-d3f8cde76aa7 None None] SCRIPT_NAME: `/identity` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:36:15.584241 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4127299-12b8-42bc-acd8-d3f8cde76aa7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:36:15.606478 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.auth.core [None req-f4127299-12b8-42bc-acd8-d3f8cde76aa7 None None] MFA Rules not processed for user `2be990a66857410a87ffa7609aec4f7b`. Rule list: `[]` (Enabled: `True`). {{(pid=282898) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 08:36:15.608259 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.fernet_utils [None req-f4127299-12b8-42bc-acd8-d3f8cde76aa7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=282898) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:36:15.630670 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0e78e0c-a526-4f2b-8ac8-b666274d94e5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:36:15.632108 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0e78e0c-a526-4f2b-8ac8-b666274d94e5 None admin] RBAC: Authorization granted {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:36:15.640840 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG dbcounter [-] [282899] Writing DB stats keystone:SELECT=100 {{(pid=282899) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:36:15.700512 dv-cinder-851351-1-smb devstack@keystone.service[282898]: [pid: 282898|app: 0|req: 110/224] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 08:36:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 08:36:15.701954 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4127299-12b8-42bc-acd8-d3f8cde76aa7 None None] Authenticating user token {{(pid=282898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:36:15.743317 dv-cinder-851351-1-smb devstack@keystone.service[282899]: [pid: 282899|app: 0|req: 115/225] 10.222.0.42 () {58 vars in 1282 bytes} [Thu Jul 28 08:36:15 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 343 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 28 08:36:15.744290 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e78e0c-a526-4f2b-8ac8-b666274d94e5 None admin] Authenticating user token {{(pid=282899) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:36:15.753423 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG dbcounter [-] [282898] Writing DB stats keystone:SELECT=100 {{(pid=282898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:36:15.845758 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4127299-12b8-42bc-acd8-d3f8cde76aa7 None None] Validating token access rules against request {{(pid=282898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:36:15.858265 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e78e0c-a526-4f2b-8ac8-b666274d94e5 None admin] Validating token access rules against request {{(pid=282899) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:36:15.866657 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG dbcounter [-] [282899] Writing DB stats keystone:SELECT=100 {{(pid=282899) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:36:15.888182 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e051064c-3710-479d-92ed-9ddc50aaaa20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:36:15.889480 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e051064c-3710-479d-92ed-9ddc50aaaa20 None admin] REQUEST_METHOD: `GET` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:36:15.889983 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e051064c-3710-479d-92ed-9ddc50aaaa20 None admin] SCRIPT_NAME: `/identity` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:36:15.890482 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e051064c-3710-479d-92ed-9ddc50aaaa20 None admin] PATH_INFO: `/v3/projects/305114c1888a404186311d18de60f67f` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:36:15.892056 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e051064c-3710-479d-92ed-9ddc50aaaa20 None admin] RBAC: Authorizing `identity:get_project(project_id=305114c1888a404186311d18de60f67f)` {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:36:15.894019 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e051064c-3710-479d-92ed-9ddc50aaaa20 None admin] RBAC: Authorization granted {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:36:15.894343 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5698bd10-6e9c-4e50-a3cd-9d700ffa01d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282899) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:36:15.895134 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5698bd10-6e9c-4e50-a3cd-9d700ffa01d8 None admin] REQUEST_METHOD: `GET` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:36:15.895419 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5698bd10-6e9c-4e50-a3cd-9d700ffa01d8 None admin] SCRIPT_NAME: `/identity` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:36:15.895699 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5698bd10-6e9c-4e50-a3cd-9d700ffa01d8 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:36:15.897611 dv-cinder-851351-1-smb devstack@keystone.service[282898]: [pid: 282898|app: 0|req: 111/226] 10.222.0.42 () {56 vars in 1186 bytes} [Thu Jul 28 08:36:15 2022] GET /identity/v3/projects/305114c1888a404186311d18de60f67f => generated 302 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:36:15.898691 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e051064c-3710-479d-92ed-9ddc50aaaa20 None admin] Authenticating user token {{(pid=282898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:36:15.912872 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5698bd10-6e9c-4e50-a3cd-9d700ffa01d8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 08:36:15.917998 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application [None req-5698bd10-6e9c-4e50-a3cd-9d700ffa01d8 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 28 08:36:15.917998 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:36:15.917998 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:36:15.917998 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:36:15.917998 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:36:15.917998 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:36:15.917998 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:36:15.917998 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:36:15.917998 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:36:15.917998 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:36:15.917998 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:36:15.917998 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:36:15.917998 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 08:36:15.917998 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 08:36:15.917998 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 08:36:15.917998 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 08:36:15.919041 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 08:36:15.919041 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 08:36:15.919041 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 08:36:15.919041 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 08:36:15.919041 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:36:15.919041 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:36:15.919041 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:36:15.919041 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:36:15.919041 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:36:15.919041 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:36:15.919041 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:36:15.919041 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application with Lock( Jul 28 08:36:15.919041 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:36:15.919041 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:36:15.919041 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:36:15.919041 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:36:15.920050 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:36:15.920050 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:36:15.920050 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:36:15.920050 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:36:15.920050 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 08:36:15.920050 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 08:36:15.920050 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 08:36:15.920050 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 08:36:15.920050 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 08:36:15.920050 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 08:36:15.920050 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 28 08:36:15.920050 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application Jul 28 08:36:15.920050 dv-cinder-851351-1-smb devstack@keystone.service[282899]: [pid: 282899|app: 0|req: 116/227] 10.222.0.42 () {56 vars in 1114 bytes} [Thu Jul 28 08:36:15 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:36:15.920856 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5698bd10-6e9c-4e50-a3cd-9d700ffa01d8 None admin] Authenticating user token {{(pid=282899) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:36:16.011873 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG dbcounter [-] [282898] Writing DB stats keystone:SELECT=100 {{(pid=282898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:36:16.016639 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e051064c-3710-479d-92ed-9ddc50aaaa20 None admin] Validating token access rules against request {{(pid=282898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:36:16.024476 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5698bd10-6e9c-4e50-a3cd-9d700ffa01d8 None admin] Validating token access rules against request {{(pid=282899) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:36:16.056266 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8d2571-41e8-4226-a9cf-0da2853da480 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:36:16.057532 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8d2571-41e8-4226-a9cf-0da2853da480 None admin] REQUEST_METHOD: `GET` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:36:16.058032 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8d2571-41e8-4226-a9cf-0da2853da480 None admin] SCRIPT_NAME: `/identity` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:36:16.058644 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8d2571-41e8-4226-a9cf-0da2853da480 None admin] PATH_INFO: `/v3/projects/305114c1888a404186311d18de60f67f` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:36:16.059138 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c41e3d9-4f31-4f61-a7ba-1eb15ab259a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282899) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:36:16.059821 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c41e3d9-4f31-4f61-a7ba-1eb15ab259a8 None admin] REQUEST_METHOD: `PUT` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:36:16.060105 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c41e3d9-4f31-4f61-a7ba-1eb15ab259a8 None admin] SCRIPT_NAME: `/identity` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:36:16.060384 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c41e3d9-4f31-4f61-a7ba-1eb15ab259a8 None admin] PATH_INFO: `/v3/projects/305114c1888a404186311d18de60f67f/users/a7a46e4205fe48debb9e2eb8469bc7c2/roles/a0e2a00bf94d40f38629d6b5293e3aee` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:36:16.061051 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee8d2571-41e8-4226-a9cf-0da2853da480 None admin] RBAC: Authorizing `identity:get_project(project_id=305114c1888a404186311d18de60f67f)` {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:36:16.062695 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c41e3d9-4f31-4f61-a7ba-1eb15ab259a8 None admin] RBAC: Authorizing `identity:create_grant(project_id=305114c1888a404186311d18de60f67f, user_id=a7a46e4205fe48debb9e2eb8469bc7c2, role_id=a0e2a00bf94d40f38629d6b5293e3aee)` {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:36:16.063179 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee8d2571-41e8-4226-a9cf-0da2853da480 None admin] RBAC: Authorization granted {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:36:16.064154 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c41e3d9-4f31-4f61-a7ba-1eb15ab259a8 None admin] RBAC: Authorization granted {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:36:16.065378 dv-cinder-851351-1-smb devstack@keystone.service[282898]: [pid: 282898|app: 0|req: 112/228] 10.222.0.42 () {56 vars in 1186 bytes} [Thu Jul 28 08:36:15 2022] GET /identity/v3/projects/305114c1888a404186311d18de60f67f => generated 302 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:36:16.066445 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8d2571-41e8-4226-a9cf-0da2853da480 None admin] Authenticating user token {{(pid=282898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:36:16.093042 dv-cinder-851351-1-smb devstack@keystone.service[282899]: [pid: 282899|app: 0|req: 117/229] 10.222.0.42 () {58 vars in 1439 bytes} [Thu Jul 28 08:36:15 2022] PUT /identity/v3/projects/305114c1888a404186311d18de60f67f/users/a7a46e4205fe48debb9e2eb8469bc7c2/roles/a0e2a00bf94d40f38629d6b5293e3aee => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 08:36:16.094014 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c41e3d9-4f31-4f61-a7ba-1eb15ab259a8 None admin] Authenticating user token {{(pid=282899) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:36:16.143737 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG dbcounter [-] [282899] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=282899) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:36:16.187225 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8d2571-41e8-4226-a9cf-0da2853da480 None admin] Validating token access rules against request {{(pid=282898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:36:16.237911 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343363bc-b98d-4b1d-a0a2-d2df89f0b8b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:36:16.239349 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343363bc-b98d-4b1d-a0a2-d2df89f0b8b7 None admin] REQUEST_METHOD: `GET` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:36:16.239869 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343363bc-b98d-4b1d-a0a2-d2df89f0b8b7 None admin] SCRIPT_NAME: `/identity` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:36:16.240377 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343363bc-b98d-4b1d-a0a2-d2df89f0b8b7 None admin] PATH_INFO: `/v3/roles` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:36:16.241412 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-343363bc-b98d-4b1d-a0a2-d2df89f0b8b7 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=282898) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:36:16.242011 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-343363bc-b98d-4b1d-a0a2-d2df89f0b8b7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:36:16.243740 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-343363bc-b98d-4b1d-a0a2-d2df89f0b8b7 None admin] RBAC: Authorization granted {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:36:16.262931 dv-cinder-851351-1-smb devstack@keystone.service[282898]: [pid: 282898|app: 0|req: 113/230] 10.222.0.42 () {56 vars in 1111 bytes} [Thu Jul 28 08:36:16 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:36:16.269933 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343363bc-b98d-4b1d-a0a2-d2df89f0b8b7 None admin] Authenticating user token {{(pid=282898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:36:16.297667 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c41e3d9-4f31-4f61-a7ba-1eb15ab259a8 None admin] Validating token access rules against request {{(pid=282899) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:36:16.358492 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG dbcounter [-] [282898] Writing DB stats keystone:SELECT=100 {{(pid=282898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:36:16.372481 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a747056d-bada-43f3-af0d-c1168af95c0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282899) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:36:16.373164 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a747056d-bada-43f3-af0d-c1168af95c0b None admin] REQUEST_METHOD: `GET` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:36:16.373449 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a747056d-bada-43f3-af0d-c1168af95c0b None admin] SCRIPT_NAME: `/identity` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:36:16.373719 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a747056d-bada-43f3-af0d-c1168af95c0b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:36:16.374534 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a747056d-bada-43f3-af0d-c1168af95c0b None admin] RBAC: Adding query filter params (role.id=eaeb4674b16f497f8afb3384e7e9a3c6, scope.project.id=305114c1888a404186311d18de60f67f, user.id=f904ed0dbba148a880c3e595f699694a) {{(pid=282899) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:36:16.374947 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a747056d-bada-43f3-af0d-c1168af95c0b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:36:16.377765 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a747056d-bada-43f3-af0d-c1168af95c0b None admin] RBAC: Authorization granted {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:36:16.384626 dv-cinder-851351-1-smb devstack@keystone.service[282899]: [pid: 282899|app: 0|req: 118/231] 10.222.0.42 () {56 vars in 1374 bytes} [Thu Jul 28 08:36:16 2022] GET /identity/v3/role_assignments?user.id=f904ed0dbba148a880c3e595f699694a&scope.project.id=305114c1888a404186311d18de60f67f&role.id=eaeb4674b16f497f8afb3384e7e9a3c6 => generated 259 bytes in 291 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:36:16.449786 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343363bc-b98d-4b1d-a0a2-d2df89f0b8b7 None admin] Validating token access rules against request {{(pid=282898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:36:16.495599 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa478b8-1f89-42dd-9087-edc2e8978d84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:36:16.496283 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa478b8-1f89-42dd-9087-edc2e8978d84 None admin] REQUEST_METHOD: `GET` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:36:16.496571 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa478b8-1f89-42dd-9087-edc2e8978d84 None admin] SCRIPT_NAME: `/identity` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:36:16.496888 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa478b8-1f89-42dd-9087-edc2e8978d84 None admin] PATH_INFO: `/v3/users/a7a46e4205fe48debb9e2eb8469bc7c2` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:36:16.498146 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa478b8-1f89-42dd-9087-edc2e8978d84 None admin] RBAC: Authorizing `identity:get_user(user_id=a7a46e4205fe48debb9e2eb8469bc7c2)` {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:36:16.499618 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa478b8-1f89-42dd-9087-edc2e8978d84 None admin] RBAC: Authorization granted {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:36:16.502308 dv-cinder-851351-1-smb devstack@keystone.service[282898]: [pid: 282898|app: 0|req: 114/232] 10.222.0.42 () {56 vars in 1177 bytes} [Thu Jul 28 08:36:16 2022] GET /identity/v3/users/a7a46e4205fe48debb9e2eb8469bc7c2 => generated 283 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:36:16.506953 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a747056d-bada-43f3-af0d-c1168af95c0b None admin] Authenticating user token {{(pid=282899) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:36:16.621782 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG dbcounter [-] [282899] Writing DB stats keystone:SELECT=100 {{(pid=282899) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:36:16.632595 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a747056d-bada-43f3-af0d-c1168af95c0b None admin] Validating token access rules against request {{(pid=282899) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:36:16.669248 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd573fb-e3fb-4605-8cea-a081446504ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282899) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:36:16.669920 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd573fb-e3fb-4605-8cea-a081446504ed None admin] REQUEST_METHOD: `GET` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:36:16.670208 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd573fb-e3fb-4605-8cea-a081446504ed None admin] SCRIPT_NAME: `/identity` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:36:16.670484 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd573fb-e3fb-4605-8cea-a081446504ed None admin] PATH_INFO: `/v3/projects/305114c1888a404186311d18de60f67f` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:36:16.671673 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd573fb-e3fb-4605-8cea-a081446504ed None admin] RBAC: Authorizing `identity:get_project(project_id=305114c1888a404186311d18de60f67f)` {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:36:16.673181 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd573fb-e3fb-4605-8cea-a081446504ed None admin] RBAC: Authorization granted {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:36:16.675280 dv-cinder-851351-1-smb devstack@keystone.service[282899]: [pid: 282899|app: 0|req: 119/233] 10.222.0.42 () {56 vars in 1186 bytes} [Thu Jul 28 08:36:16 2022] GET /identity/v3/projects/305114c1888a404186311d18de60f67f => generated 302 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:36:16.686931 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa478b8-1f89-42dd-9087-edc2e8978d84 None admin] Authenticating user token {{(pid=282898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:36:16.822320 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG dbcounter [-] [282898] Writing DB stats keystone:SELECT=100 {{(pid=282898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:36:16.831314 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa478b8-1f89-42dd-9087-edc2e8978d84 None admin] Validating token access rules against request {{(pid=282898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:36:16.902421 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d95f0f-7b0c-4b16-a3bb-acc597a8810c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:36:16.903137 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d95f0f-7b0c-4b16-a3bb-acc597a8810c None admin] REQUEST_METHOD: `PUT` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:36:16.903419 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d95f0f-7b0c-4b16-a3bb-acc597a8810c None admin] SCRIPT_NAME: `/identity` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:36:16.903705 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d95f0f-7b0c-4b16-a3bb-acc597a8810c None admin] PATH_INFO: `/v3/projects/305114c1888a404186311d18de60f67f/users/a7a46e4205fe48debb9e2eb8469bc7c2/roles/d76677105be344cc83022cbde8a22d8d` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:36:16.908981 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43d95f0f-7b0c-4b16-a3bb-acc597a8810c None admin] RBAC: Authorizing `identity:create_grant(project_id=305114c1888a404186311d18de60f67f, user_id=a7a46e4205fe48debb9e2eb8469bc7c2, role_id=d76677105be344cc83022cbde8a22d8d)` {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:36:16.910568 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43d95f0f-7b0c-4b16-a3bb-acc597a8810c None admin] RBAC: Authorization granted {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:36:16.949546 dv-cinder-851351-1-smb devstack@keystone.service[282898]: [pid: 282898|app: 0|req: 115/234] 10.222.0.42 () {58 vars in 1439 bytes} [Thu Jul 28 08:36:16 2022] PUT /identity/v3/projects/305114c1888a404186311d18de60f67f/users/a7a46e4205fe48debb9e2eb8469bc7c2/roles/d76677105be344cc83022cbde8a22d8d => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 08:36:17.222332 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0328e69a-7534-44dd-a926-2612e13898d6 None None] REQUEST_METHOD: `GET` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:36:17.222790 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0328e69a-7534-44dd-a926-2612e13898d6 None None] SCRIPT_NAME: `/identity` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:36:17.222975 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0328e69a-7534-44dd-a926-2612e13898d6 None None] PATH_INFO: `/` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:36:17.224608 dv-cinder-851351-1-smb devstack@keystone.service[282899]: [pid: 282899|app: 0|req: 120/235] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 08:36:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 08:36:17.230264 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5790d3c-aa87-47d0-a09e-05951f5456b0 None None] REQUEST_METHOD: `POST` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:36:17.230787 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5790d3c-aa87-47d0-a09e-05951f5456b0 None None] SCRIPT_NAME: `/identity` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:36:17.230880 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5790d3c-aa87-47d0-a09e-05951f5456b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:36:17.251046 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.auth.core [None req-b5790d3c-aa87-47d0-a09e-05951f5456b0 None None] MFA Rules not processed for user `2be990a66857410a87ffa7609aec4f7b`. Rule list: `[]` (Enabled: `True`). {{(pid=282898) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 08:36:17.252289 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.fernet_utils [None req-b5790d3c-aa87-47d0-a09e-05951f5456b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=282898) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:36:17.327893 dv-cinder-851351-1-smb devstack@keystone.service[282898]: [pid: 282898|app: 0|req: 116/236] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 08:36:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 28 08:36:17.351231 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0328e69a-7534-44dd-a926-2612e13898d6 None None] Authenticating user token {{(pid=282899) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:36:17.468079 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0328e69a-7534-44dd-a926-2612e13898d6 None None] Validating token access rules against request {{(pid=282899) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:36:17.512128 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5affd365-95d8-490c-b676-250bf5b638c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282899) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:36:17.512760 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5affd365-95d8-490c-b676-250bf5b638c7 None admin] REQUEST_METHOD: `GET` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:36:17.513093 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5affd365-95d8-490c-b676-250bf5b638c7 None admin] SCRIPT_NAME: `/identity` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:36:17.513377 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5affd365-95d8-490c-b676-250bf5b638c7 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:36:17.524153 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5affd365-95d8-490c-b676-250bf5b638c7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 08:36:17.529318 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application [None req-5affd365-95d8-490c-b676-250bf5b638c7 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 28 08:36:17.529318 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:36:17.529318 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:36:17.529318 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:36:17.529318 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:36:17.529318 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:36:17.529318 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:36:17.529318 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:36:17.529318 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:36:17.529318 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:36:17.529318 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:36:17.529318 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:36:17.529318 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 08:36:17.529318 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 08:36:17.529318 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 08:36:17.529318 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 08:36:17.530378 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 08:36:17.530378 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 08:36:17.530378 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 08:36:17.530378 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 08:36:17.530378 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:36:17.530378 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:36:17.530378 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:36:17.530378 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:36:17.530378 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:36:17.530378 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:36:17.530378 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:36:17.530378 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application with Lock( Jul 28 08:36:17.530378 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:36:17.530378 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:36:17.530378 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:36:17.530378 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:36:17.531319 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:36:17.531319 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:36:17.531319 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:36:17.531319 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:36:17.531319 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 08:36:17.531319 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 08:36:17.531319 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 08:36:17.531319 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 08:36:17.531319 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 08:36:17.531319 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 08:36:17.531319 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 28 08:36:17.531319 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application Jul 28 08:36:17.531319 dv-cinder-851351-1-smb devstack@keystone.service[282899]: [pid: 282899|app: 0|req: 121/237] 10.222.0.42 () {56 vars in 1099 bytes} [Thu Jul 28 08:36:17 2022] GET /identity/v3/roles/reader => generated 84 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:36:17.536871 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5790d3c-aa87-47d0-a09e-05951f5456b0 None None] Authenticating user token {{(pid=282898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:36:17.618131 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c49f7d-ac25-4717-a605-54630f1b1ea5 None None] REQUEST_METHOD: `GET` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:36:17.618476 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c49f7d-ac25-4717-a605-54630f1b1ea5 None None] SCRIPT_NAME: `/identity` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:36:17.618694 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c49f7d-ac25-4717-a605-54630f1b1ea5 None None] PATH_INFO: `/` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:36:17.620233 dv-cinder-851351-1-smb devstack@keystone.service[282899]: [pid: 282899|app: 0|req: 122/238] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 08:36:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 08:36:17.626957 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d057ff9d-999d-4953-9aaf-451135a899f1 None None] REQUEST_METHOD: `POST` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:36:17.627608 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d057ff9d-999d-4953-9aaf-451135a899f1 None None] SCRIPT_NAME: `/identity` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:36:17.627608 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d057ff9d-999d-4953-9aaf-451135a899f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:36:17.664210 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.auth.core [None req-d057ff9d-999d-4953-9aaf-451135a899f1 None None] MFA Rules not processed for user `2be990a66857410a87ffa7609aec4f7b`. Rule list: `[]` (Enabled: `True`). {{(pid=282899) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 08:36:17.665481 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.fernet_utils [None req-d057ff9d-999d-4953-9aaf-451135a899f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=282899) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:36:17.680442 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG dbcounter [-] [282898] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=282898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:36:17.708203 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5790d3c-aa87-47d0-a09e-05951f5456b0 None None] Validating token access rules against request {{(pid=282898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:36:17.717069 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG dbcounter [-] [282899] Writing DB stats keystone:SELECT=100 {{(pid=282899) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:36:17.788878 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34304e12-5400-43b6-a88c-4fd8d8aae76c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:36:17.789425 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34304e12-5400-43b6-a88c-4fd8d8aae76c None admin] REQUEST_METHOD: `GET` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:36:17.789705 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34304e12-5400-43b6-a88c-4fd8d8aae76c None admin] SCRIPT_NAME: `/identity` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:36:17.789978 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34304e12-5400-43b6-a88c-4fd8d8aae76c None admin] PATH_INFO: `/v3/roles` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:36:17.790718 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34304e12-5400-43b6-a88c-4fd8d8aae76c None admin] RBAC: Adding query filter params (name=reader) {{(pid=282898) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:36:17.791021 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34304e12-5400-43b6-a88c-4fd8d8aae76c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:36:17.792434 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34304e12-5400-43b6-a88c-4fd8d8aae76c None admin] RBAC: Authorization granted {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:36:17.815047 dv-cinder-851351-1-smb devstack@keystone.service[282898]: [pid: 282898|app: 0|req: 117/239] 10.222.0.42 () {56 vars in 1101 bytes} [Thu Jul 28 08:36:17 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:36:17.820806 dv-cinder-851351-1-smb devstack@keystone.service[282899]: [pid: 282899|app: 0|req: 123/240] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 08:36:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 28 08:36:17.822494 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34304e12-5400-43b6-a88c-4fd8d8aae76c None admin] Authenticating user token {{(pid=282898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:36:17.878730 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d057ff9d-999d-4953-9aaf-451135a899f1 None None] Authenticating user token {{(pid=282899) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:36:17.970901 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34304e12-5400-43b6-a88c-4fd8d8aae76c None admin] Validating token access rules against request {{(pid=282898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:36:17.986814 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d057ff9d-999d-4953-9aaf-451135a899f1 None None] Validating token access rules against request {{(pid=282899) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:36:18.023950 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b11854-654a-4b45-adc3-e247586fc300 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282899) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:36:18.024613 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b11854-654a-4b45-adc3-e247586fc300 None admin] REQUEST_METHOD: `GET` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:36:18.024971 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b11854-654a-4b45-adc3-e247586fc300 None admin] SCRIPT_NAME: `/identity` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:36:18.025219 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b11854-654a-4b45-adc3-e247586fc300 None admin] PATH_INFO: `/v3/domains/default` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:36:18.026377 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8b11854-654a-4b45-adc3-e247586fc300 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:36:18.027853 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8b11854-654a-4b45-adc3-e247586fc300 None admin] RBAC: Authorization granted {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:36:18.034252 dv-cinder-851351-1-smb devstack@keystone.service[282899]: [pid: 282899|app: 0|req: 124/241] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 08:36:17 2022] GET /identity/v3/domains/default => generated 199 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:36:18.035586 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b11854-654a-4b45-adc3-e247586fc300 None admin] Authenticating user token {{(pid=282899) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:36:18.040839 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe51faa1-6cb5-497b-946a-199084409262 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:36:18.041542 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe51faa1-6cb5-497b-946a-199084409262 None admin] REQUEST_METHOD: `GET` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:36:18.041834 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe51faa1-6cb5-497b-946a-199084409262 None admin] SCRIPT_NAME: `/identity` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:36:18.042119 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe51faa1-6cb5-497b-946a-199084409262 None admin] PATH_INFO: `/v3/users/eff961182252439e895cf4ef507802c4` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:36:18.059710 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG dbcounter [-] [282899] Writing DB stats keystone:SELECT=100 {{(pid=282899) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:36:18.077413 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe51faa1-6cb5-497b-946a-199084409262 None admin] RBAC: Authorizing `identity:get_user(user_id=eff961182252439e895cf4ef507802c4)` {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:36:18.077981 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe51faa1-6cb5-497b-946a-199084409262 None admin] RBAC: Authorization granted {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:36:18.081047 dv-cinder-851351-1-smb devstack@keystone.service[282898]: [pid: 282898|app: 0|req: 118/242] 10.222.0.42 () {56 vars in 1177 bytes} [Thu Jul 28 08:36:17 2022] GET /identity/v3/users/eff961182252439e895cf4ef507802c4 => generated 297 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 08:36:18.090705 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe51faa1-6cb5-497b-946a-199084409262 None admin] Authenticating user token {{(pid=282898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:36:18.121157 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG dbcounter [-] [282898] Writing DB stats keystone:SELECT=100 {{(pid=282898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:36:18.152285 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b11854-654a-4b45-adc3-e247586fc300 None admin] Validating token access rules against request {{(pid=282899) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:36:18.187129 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb10480-ffe1-451b-8ae1-d132517dcab6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282899) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:36:18.187776 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb10480-ffe1-451b-8ae1-d132517dcab6 None admin] REQUEST_METHOD: `POST` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:36:18.188055 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb10480-ffe1-451b-8ae1-d132517dcab6 None admin] SCRIPT_NAME: `/identity` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:36:18.188328 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb10480-ffe1-451b-8ae1-d132517dcab6 None admin] PATH_INFO: `/v3/users` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:36:18.189147 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb10480-ffe1-451b-8ae1-d132517dcab6 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:36:18.190712 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb10480-ffe1-451b-8ae1-d132517dcab6 None admin] RBAC: Authorization granted {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:36:18.220996 dv-cinder-851351-1-smb devstack@keystone.service[282899]: [pid: 282899|app: 0|req: 125/243] 10.222.0.42 () {60 vars in 1132 bytes} [Thu Jul 28 08:36:18 2022] POST /identity/v3/users => generated 293 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 08:36:18.298175 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe51faa1-6cb5-497b-946a-199084409262 None admin] Validating token access rules against request {{(pid=282898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:36:18.339983 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b789ed3-fbb2-4048-9e5f-075eef87edf1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:36:18.341098 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b789ed3-fbb2-4048-9e5f-075eef87edf1 None admin] REQUEST_METHOD: `GET` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:36:18.341615 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b789ed3-fbb2-4048-9e5f-075eef87edf1 None admin] SCRIPT_NAME: `/identity` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:36:18.342091 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b789ed3-fbb2-4048-9e5f-075eef87edf1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:36:18.421765 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b789ed3-fbb2-4048-9e5f-075eef87edf1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:36:18.425014 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b789ed3-fbb2-4048-9e5f-075eef87edf1 None admin] RBAC: Authorization granted {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:36:18.438252 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG dbcounter [-] [282898] Writing DB stats keystone:SELECT=100 {{(pid=282898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:36:18.594690 dv-cinder-851351-1-smb devstack@keystone.service[282898]: [pid: 282898|app: 0|req: 119/244] 10.222.0.42 () {58 vars in 1282 bytes} [Thu Jul 28 08:36:18 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 504 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 28 08:36:18.600706 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb10480-ffe1-451b-8ae1-d132517dcab6 None admin] Authenticating user token {{(pid=282899) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:36:18.683138 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG dbcounter [-] [282899] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=282899) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:36:18.720288 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b540f6f5-8772-44dd-bfde-1dbb2e1d514f None None] REQUEST_METHOD: `GET` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:36:18.720779 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b540f6f5-8772-44dd-bfde-1dbb2e1d514f None None] SCRIPT_NAME: `/identity` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:36:18.720909 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b540f6f5-8772-44dd-bfde-1dbb2e1d514f None None] PATH_INFO: `/` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:36:18.722433 dv-cinder-851351-1-smb devstack@keystone.service[282898]: [pid: 282898|app: 0|req: 120/245] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 08:36:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 28 08:36:18.723195 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb10480-ffe1-451b-8ae1-d132517dcab6 None admin] Validating token access rules against request {{(pid=282899) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:36:18.731218 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fee1969-4aa2-44f8-a7e7-c59a91a4c5eb None None] REQUEST_METHOD: `POST` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:36:18.731840 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fee1969-4aa2-44f8-a7e7-c59a91a4c5eb None None] SCRIPT_NAME: `/identity` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:36:18.732334 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fee1969-4aa2-44f8-a7e7-c59a91a4c5eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:36:18.761619 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.auth.core [None req-6fee1969-4aa2-44f8-a7e7-c59a91a4c5eb None None] MFA Rules not processed for user `2be990a66857410a87ffa7609aec4f7b`. Rule list: `[]` (Enabled: `True`). {{(pid=282898) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 08:36:18.765537 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.fernet_utils [None req-6fee1969-4aa2-44f8-a7e7-c59a91a4c5eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=282898) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:36:18.768742 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a27305-ab10-4e1f-8f76-58c3ea48ea69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282899) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:36:18.770302 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a27305-ab10-4e1f-8f76-58c3ea48ea69 None admin] REQUEST_METHOD: `GET` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:36:18.770302 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a27305-ab10-4e1f-8f76-58c3ea48ea69 None admin] SCRIPT_NAME: `/identity` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:36:18.770302 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a27305-ab10-4e1f-8f76-58c3ea48ea69 None admin] PATH_INFO: `/v3/projects/305114c1888a404186311d18de60f67f` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:36:18.771393 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95a27305-ab10-4e1f-8f76-58c3ea48ea69 None admin] RBAC: Authorizing `identity:get_project(project_id=305114c1888a404186311d18de60f67f)` {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:36:18.772920 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95a27305-ab10-4e1f-8f76-58c3ea48ea69 None admin] RBAC: Authorization granted {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:36:18.774969 dv-cinder-851351-1-smb devstack@keystone.service[282899]: [pid: 282899|app: 0|req: 126/246] 10.222.0.42 () {56 vars in 1186 bytes} [Thu Jul 28 08:36:18 2022] GET /identity/v3/projects/305114c1888a404186311d18de60f67f => generated 302 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:36:18.781590 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a27305-ab10-4e1f-8f76-58c3ea48ea69 None admin] Authenticating user token {{(pid=282899) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:36:18.856476 dv-cinder-851351-1-smb devstack@keystone.service[282898]: [pid: 282898|app: 0|req: 121/247] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 08:36:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 08:36:18.887381 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fee1969-4aa2-44f8-a7e7-c59a91a4c5eb None None] Authenticating user token {{(pid=282898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:36:18.929789 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a27305-ab10-4e1f-8f76-58c3ea48ea69 None admin] Validating token access rules against request {{(pid=282899) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:36:18.938154 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG dbcounter [-] [282898] Writing DB stats keystone:SELECT=100 {{(pid=282898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:36:18.973069 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6741d95-9bb0-4fb2-a8c7-435cd4b03bc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282899) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:36:18.974037 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6741d95-9bb0-4fb2-a8c7-435cd4b03bc0 None admin] REQUEST_METHOD: `GET` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:36:18.974480 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6741d95-9bb0-4fb2-a8c7-435cd4b03bc0 None admin] SCRIPT_NAME: `/identity` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:36:18.974928 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6741d95-9bb0-4fb2-a8c7-435cd4b03bc0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:36:18.975919 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6741d95-9bb0-4fb2-a8c7-435cd4b03bc0 None admin] RBAC: Adding query filter params (role.id=34c6ec459a944c46a4265d15a06e348d, scope.project.id=305114c1888a404186311d18de60f67f, user.id=eff961182252439e895cf4ef507802c4) {{(pid=282899) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:36:18.976415 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6741d95-9bb0-4fb2-a8c7-435cd4b03bc0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:36:18.978382 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6741d95-9bb0-4fb2-a8c7-435cd4b03bc0 None admin] RBAC: Authorization granted {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:36:18.987150 dv-cinder-851351-1-smb devstack@keystone.service[282899]: [pid: 282899|app: 0|req: 127/248] 10.222.0.42 () {56 vars in 1374 bytes} [Thu Jul 28 08:36:18 2022] GET /identity/v3/role_assignments?user.id=eff961182252439e895cf4ef507802c4&scope.project.id=305114c1888a404186311d18de60f67f&role.id=34c6ec459a944c46a4265d15a06e348d => generated 259 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:36:18.988952 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf50657-2a17-40ba-80f8-756c3f5a18d0 None None] REQUEST_METHOD: `GET` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:36:18.989441 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf50657-2a17-40ba-80f8-756c3f5a18d0 None None] SCRIPT_NAME: `/identity` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:36:18.989929 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf50657-2a17-40ba-80f8-756c3f5a18d0 None None] PATH_INFO: `/` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:36:18.991765 dv-cinder-851351-1-smb devstack@keystone.service[282899]: [pid: 282899|app: 0|req: 128/249] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 08:36:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 08:36:18.997070 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ef00bf-64be-42bb-9aee-79989fc00ef6 None None] REQUEST_METHOD: `POST` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:36:18.997632 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ef00bf-64be-42bb-9aee-79989fc00ef6 None None] SCRIPT_NAME: `/identity` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:36:18.998143 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ef00bf-64be-42bb-9aee-79989fc00ef6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:36:19.022539 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fee1969-4aa2-44f8-a7e7-c59a91a4c5eb None None] Validating token access rules against request {{(pid=282898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:36:19.025061 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG dbcounter [-] [282899] Writing DB stats keystone:SELECT=100 {{(pid=282899) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:36:19.034178 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.auth.core [None req-27ef00bf-64be-42bb-9aee-79989fc00ef6 None None] MFA Rules not processed for user `2be990a66857410a87ffa7609aec4f7b`. Rule list: `[]` (Enabled: `True`). {{(pid=282899) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 08:36:19.036702 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.fernet_utils [None req-27ef00bf-64be-42bb-9aee-79989fc00ef6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=282899) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:36:19.094250 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f008442d-62a0-49bb-bcfe-efcda7ba28d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:36:19.095526 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f008442d-62a0-49bb-bcfe-efcda7ba28d2 None admin] REQUEST_METHOD: `GET` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:36:19.097018 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f008442d-62a0-49bb-bcfe-efcda7ba28d2 None admin] SCRIPT_NAME: `/identity` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:36:19.098344 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f008442d-62a0-49bb-bcfe-efcda7ba28d2 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:36:19.124839 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f008442d-62a0-49bb-bcfe-efcda7ba28d2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 08:36:19.130811 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application [None req-f008442d-62a0-49bb-bcfe-efcda7ba28d2 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 08:36:19.130811 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:36:19.130811 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:36:19.130811 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:36:19.130811 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:36:19.130811 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:36:19.130811 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:36:19.130811 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:36:19.130811 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:36:19.130811 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:36:19.130811 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:36:19.130811 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:36:19.130811 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 08:36:19.130811 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 08:36:19.130811 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 08:36:19.130811 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 08:36:19.131919 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 08:36:19.131919 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 08:36:19.131919 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 08:36:19.131919 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 08:36:19.131919 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:36:19.131919 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:36:19.131919 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:36:19.131919 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:36:19.131919 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:36:19.131919 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:36:19.131919 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:36:19.131919 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application with Lock( Jul 28 08:36:19.131919 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:36:19.131919 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:36:19.131919 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:36:19.131919 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:36:19.132895 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:36:19.132895 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:36:19.132895 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:36:19.132895 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:36:19.132895 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 08:36:19.132895 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 08:36:19.132895 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 08:36:19.132895 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 08:36:19.132895 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 08:36:19.132895 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 08:36:19.132895 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 08:36:19.132895 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application Jul 28 08:36:19.137550 dv-cinder-851351-1-smb devstack@keystone.service[282898]: [pid: 282898|app: 0|req: 122/250] 10.222.0.42 () {56 vars in 1096 bytes} [Thu Jul 28 08:36:18 2022] GET /identity/v3/roles/admin => generated 83 bytes in 251 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 08:36:19.144860 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f008442d-62a0-49bb-bcfe-efcda7ba28d2 None admin] Authenticating user token {{(pid=282898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:36:19.199402 dv-cinder-851351-1-smb devstack@keystone.service[282899]: [pid: 282899|app: 0|req: 129/251] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 08:36:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 28 08:36:19.229437 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ef00bf-64be-42bb-9aee-79989fc00ef6 None None] Authenticating user token {{(pid=282899) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:36:19.294025 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG dbcounter [-] [282898] Writing DB stats keystone:SELECT=100 {{(pid=282898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:36:19.297881 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f008442d-62a0-49bb-bcfe-efcda7ba28d2 None admin] Validating token access rules against request {{(pid=282898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:36:19.340691 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81b1901-b022-4e4c-930a-9dd207b9ced1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:36:19.340691 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81b1901-b022-4e4c-930a-9dd207b9ced1 None admin] REQUEST_METHOD: `GET` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:36:19.340691 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81b1901-b022-4e4c-930a-9dd207b9ced1 None admin] SCRIPT_NAME: `/identity` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:36:19.340691 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81b1901-b022-4e4c-930a-9dd207b9ced1 None admin] PATH_INFO: `/v3/roles` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:36:19.341636 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b81b1901-b022-4e4c-930a-9dd207b9ced1 None admin] RBAC: Adding query filter params (name=admin) {{(pid=282898) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:36:19.341636 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b81b1901-b022-4e4c-930a-9dd207b9ced1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:36:19.341636 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b81b1901-b022-4e4c-930a-9dd207b9ced1 None admin] RBAC: Authorization granted {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:36:19.350051 dv-cinder-851351-1-smb devstack@keystone.service[282898]: [pid: 282898|app: 0|req: 123/252] 10.222.0.42 () {56 vars in 1099 bytes} [Thu Jul 28 08:36:19 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:36:19.356010 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81b1901-b022-4e4c-930a-9dd207b9ced1 None admin] Authenticating user token {{(pid=282898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:36:19.472540 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ef00bf-64be-42bb-9aee-79989fc00ef6 None None] Validating token access rules against request {{(pid=282899) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:36:19.473844 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81b1901-b022-4e4c-930a-9dd207b9ced1 None admin] Validating token access rules against request {{(pid=282898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:36:19.529962 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14261a11-8a40-4c92-9977-e6bbdac184d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282899) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:36:19.530649 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14261a11-8a40-4c92-9977-e6bbdac184d0 None admin] REQUEST_METHOD: `GET` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:36:19.530929 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14261a11-8a40-4c92-9977-e6bbdac184d0 None admin] SCRIPT_NAME: `/identity` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:36:19.531208 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14261a11-8a40-4c92-9977-e6bbdac184d0 None admin] PATH_INFO: `/v3/roles/member` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:36:19.532309 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91855242-68ca-437b-824a-b3d46b167ae8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:36:19.532996 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91855242-68ca-437b-824a-b3d46b167ae8 None admin] REQUEST_METHOD: `GET` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:36:19.533271 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91855242-68ca-437b-824a-b3d46b167ae8 None admin] SCRIPT_NAME: `/identity` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:36:19.533542 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91855242-68ca-437b-824a-b3d46b167ae8 None admin] PATH_INFO: `/v3/users/a7a46e4205fe48debb9e2eb8469bc7c2` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:36:19.534859 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91855242-68ca-437b-824a-b3d46b167ae8 None admin] RBAC: Authorizing `identity:get_user(user_id=a7a46e4205fe48debb9e2eb8469bc7c2)` {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:36:19.536370 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91855242-68ca-437b-824a-b3d46b167ae8 None admin] RBAC: Authorization granted {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:36:19.538033 dv-cinder-851351-1-smb devstack@keystone.service[282898]: [pid: 282898|app: 0|req: 124/253] 10.222.0.42 () {56 vars in 1177 bytes} [Thu Jul 28 08:36:19 2022] GET /identity/v3/users/a7a46e4205fe48debb9e2eb8469bc7c2 => generated 283 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:36:19.539859 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG dbcounter [-] [282899] Writing DB stats keystone:SELECT=100 {{(pid=282899) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:36:19.548686 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91855242-68ca-437b-824a-b3d46b167ae8 None admin] Authenticating user token {{(pid=282898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:36:19.554604 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14261a11-8a40-4c92-9977-e6bbdac184d0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 08:36:19.560010 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application [None req-14261a11-8a40-4c92-9977-e6bbdac184d0 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 28 08:36:19.560010 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:36:19.560010 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:36:19.560010 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:36:19.560010 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:36:19.560010 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:36:19.560010 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:36:19.560010 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:36:19.560010 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:36:19.560010 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:36:19.560010 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:36:19.560010 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:36:19.560010 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 08:36:19.560010 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 08:36:19.560010 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 08:36:19.560010 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 08:36:19.561098 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 08:36:19.561098 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 08:36:19.561098 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 08:36:19.561098 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 08:36:19.561098 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:36:19.561098 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:36:19.561098 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:36:19.561098 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:36:19.561098 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:36:19.561098 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:36:19.561098 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:36:19.561098 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application with Lock( Jul 28 08:36:19.561098 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:36:19.561098 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:36:19.561098 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:36:19.561098 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:36:19.562059 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:36:19.562059 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:36:19.562059 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:36:19.562059 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:36:19.562059 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 08:36:19.562059 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 08:36:19.562059 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 08:36:19.562059 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 08:36:19.562059 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 08:36:19.562059 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 08:36:19.562059 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 28 08:36:19.562059 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application Jul 28 08:36:19.564911 dv-cinder-851351-1-smb devstack@keystone.service[282899]: [pid: 282899|app: 0|req: 130/254] 10.222.0.42 () {56 vars in 1099 bytes} [Thu Jul 28 08:36:19 2022] GET /identity/v3/roles/member => generated 84 bytes in 336 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 08:36:19.581844 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14261a11-8a40-4c92-9977-e6bbdac184d0 None admin] Authenticating user token {{(pid=282899) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:36:19.628156 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG dbcounter [-] [282898] Writing DB stats keystone:SELECT=100 {{(pid=282898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:36:19.683803 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91855242-68ca-437b-824a-b3d46b167ae8 None admin] Validating token access rules against request {{(pid=282898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:36:19.703215 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14261a11-8a40-4c92-9977-e6bbdac184d0 None admin] Validating token access rules against request {{(pid=282899) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:36:19.748379 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9914096e-2eb8-4f99-b9e5-880952a06a70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282899) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:36:19.749644 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9914096e-2eb8-4f99-b9e5-880952a06a70 None admin] REQUEST_METHOD: `GET` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:36:19.750146 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9914096e-2eb8-4f99-b9e5-880952a06a70 None admin] SCRIPT_NAME: `/identity` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:36:19.750655 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9914096e-2eb8-4f99-b9e5-880952a06a70 None admin] PATH_INFO: `/v3/roles` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:36:19.750785 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7a8a47-7261-4029-beff-e924c7c69759 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:36:19.751324 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7a8a47-7261-4029-beff-e924c7c69759 None admin] REQUEST_METHOD: `GET` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:36:19.751605 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7a8a47-7261-4029-beff-e924c7c69759 None admin] SCRIPT_NAME: `/identity` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:36:19.751880 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7a8a47-7261-4029-beff-e924c7c69759 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:36:19.752539 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9914096e-2eb8-4f99-b9e5-880952a06a70 None admin] RBAC: Adding query filter params (name=member) {{(pid=282899) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:36:19.753091 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9914096e-2eb8-4f99-b9e5-880952a06a70 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:36:19.754769 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9914096e-2eb8-4f99-b9e5-880952a06a70 None admin] RBAC: Authorization granted {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:36:19.772677 dv-cinder-851351-1-smb devstack@keystone.service[282899]: [pid: 282899|app: 0|req: 131/255] 10.222.0.42 () {56 vars in 1101 bytes} [Thu Jul 28 08:36:19 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 08:36:19.778368 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9914096e-2eb8-4f99-b9e5-880952a06a70 None admin] Authenticating user token {{(pid=282899) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:36:19.899143 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be7a8a47-7261-4029-beff-e924c7c69759 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:36:19.901029 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be7a8a47-7261-4029-beff-e924c7c69759 None admin] RBAC: Authorization granted {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:36:19.907410 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG dbcounter [-] [282899] Writing DB stats keystone:SELECT=100 {{(pid=282899) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:36:19.959097 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG dbcounter [-] [282898] Writing DB stats keystone:SELECT=100 {{(pid=282898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:36:19.960825 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9914096e-2eb8-4f99-b9e5-880952a06a70 None admin] Validating token access rules against request {{(pid=282899) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:36:19.999811 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd0f5a5-6285-471c-bd5f-2ece58bec908 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282899) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:36:20.000951 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd0f5a5-6285-471c-bd5f-2ece58bec908 None admin] REQUEST_METHOD: `GET` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:36:20.001473 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd0f5a5-6285-471c-bd5f-2ece58bec908 None admin] SCRIPT_NAME: `/identity` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:36:20.001999 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd0f5a5-6285-471c-bd5f-2ece58bec908 None admin] PATH_INFO: `/v3/users/f904ed0dbba148a880c3e595f699694a` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:36:20.003447 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bd0f5a5-6285-471c-bd5f-2ece58bec908 None admin] RBAC: Authorizing `identity:get_user(user_id=f904ed0dbba148a880c3e595f699694a)` {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:36:20.005261 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bd0f5a5-6285-471c-bd5f-2ece58bec908 None admin] RBAC: Authorization granted {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:36:20.007560 dv-cinder-851351-1-smb devstack@keystone.service[282899]: [pid: 282899|app: 0|req: 132/256] 10.222.0.42 () {56 vars in 1177 bytes} [Thu Jul 28 08:36:19 2022] GET /identity/v3/users/f904ed0dbba148a880c3e595f699694a => generated 297 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 08:36:20.009128 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62aa6c37-61a1-461a-b984-f662bc086f1c None None] REQUEST_METHOD: `GET` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:36:20.009638 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62aa6c37-61a1-461a-b984-f662bc086f1c None None] SCRIPT_NAME: `/identity` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:36:20.010130 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62aa6c37-61a1-461a-b984-f662bc086f1c None None] PATH_INFO: `/` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:36:20.011820 dv-cinder-851351-1-smb devstack@keystone.service[282899]: [pid: 282899|app: 0|req: 133/257] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 08:36:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 08:36:20.017085 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62aa6c37-61a1-461a-b984-f662bc086f1c None None] Authenticating user token {{(pid=282899) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:36:20.131698 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62aa6c37-61a1-461a-b984-f662bc086f1c None None] Validating token access rules against request {{(pid=282899) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:36:20.159329 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG dbcounter [-] [282899] Writing DB stats keystone:SELECT=100 {{(pid=282899) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:36:20.173765 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4612062-6126-4fdd-a26b-453f2cec297c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282899) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:36:20.174821 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4612062-6126-4fdd-a26b-453f2cec297c None admin] REQUEST_METHOD: `GET` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:36:20.175368 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4612062-6126-4fdd-a26b-453f2cec297c None admin] SCRIPT_NAME: `/identity` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:36:20.175688 dv-cinder-851351-1-smb devstack@keystone.service[282898]: [pid: 282898|app: 0|req: 125/258] 10.222.0.42 () {58 vars in 1282 bytes} [Thu Jul 28 08:36:19 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 628 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 28 08:36:20.176155 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4612062-6126-4fdd-a26b-453f2cec297c None admin] PATH_INFO: `/v3/projects/305114c1888a404186311d18de60f67f` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:36:20.181462 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f9dcf7-b3b6-4201-abf3-7b38a4d45655 None None] REQUEST_METHOD: `POST` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:36:20.181462 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f9dcf7-b3b6-4201-abf3-7b38a4d45655 None None] SCRIPT_NAME: `/identity` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:36:20.181854 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f9dcf7-b3b6-4201-abf3-7b38a4d45655 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:36:20.182844 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4612062-6126-4fdd-a26b-453f2cec297c None admin] RBAC: Authorizing `identity:get_project(project_id=305114c1888a404186311d18de60f67f)` {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:36:20.184561 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4612062-6126-4fdd-a26b-453f2cec297c None admin] RBAC: Authorization granted {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:36:20.186966 dv-cinder-851351-1-smb devstack@keystone.service[282899]: [pid: 282899|app: 0|req: 134/259] 10.222.0.42 () {56 vars in 1186 bytes} [Thu Jul 28 08:36:20 2022] GET /identity/v3/projects/305114c1888a404186311d18de60f67f => generated 302 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:36:20.188033 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4612062-6126-4fdd-a26b-453f2cec297c None admin] Authenticating user token {{(pid=282899) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:36:20.214542 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.auth.core [None req-55f9dcf7-b3b6-4201-abf3-7b38a4d45655 None None] MFA Rules not processed for user `2be990a66857410a87ffa7609aec4f7b`. Rule list: `[]` (Enabled: `True`). {{(pid=282898) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 08:36:20.215745 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.fernet_utils [None req-55f9dcf7-b3b6-4201-abf3-7b38a4d45655 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=282898) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:36:20.305154 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4612062-6126-4fdd-a26b-453f2cec297c None admin] Validating token access rules against request {{(pid=282899) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:36:20.342283 dv-cinder-851351-1-smb devstack@keystone.service[282898]: [pid: 282898|app: 0|req: 126/260] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 08:36:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 08:36:20.344297 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f9dcf7-b3b6-4201-abf3-7b38a4d45655 None None] Authenticating user token {{(pid=282898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:36:20.348062 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b3cb17-9254-45c7-9e61-fea75bc43c4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282899) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:36:20.349009 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b3cb17-9254-45c7-9e61-fea75bc43c4e None admin] REQUEST_METHOD: `GET` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:36:20.349508 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b3cb17-9254-45c7-9e61-fea75bc43c4e None admin] SCRIPT_NAME: `/identity` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:36:20.350013 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b3cb17-9254-45c7-9e61-fea75bc43c4e None admin] PATH_INFO: `/v3/projects/305114c1888a404186311d18de60f67f` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:36:20.351467 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01b3cb17-9254-45c7-9e61-fea75bc43c4e None admin] RBAC: Authorizing `identity:get_project(project_id=305114c1888a404186311d18de60f67f)` {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:36:20.354420 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01b3cb17-9254-45c7-9e61-fea75bc43c4e None admin] RBAC: Authorization granted {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:36:20.360442 dv-cinder-851351-1-smb devstack@keystone.service[282899]: [pid: 282899|app: 0|req: 135/261] 10.222.0.42 () {56 vars in 1186 bytes} [Thu Jul 28 08:36:20 2022] GET /identity/v3/projects/305114c1888a404186311d18de60f67f => generated 302 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:36:20.367977 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b3cb17-9254-45c7-9e61-fea75bc43c4e None admin] Authenticating user token {{(pid=282899) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:36:20.445223 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG dbcounter [-] [282898] Writing DB stats keystone:SELECT=100 {{(pid=282898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:36:20.509852 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG dbcounter [-] [282899] Writing DB stats keystone:SELECT=100 {{(pid=282899) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:36:20.519191 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f9dcf7-b3b6-4201-abf3-7b38a4d45655 None None] Validating token access rules against request {{(pid=282898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:36:20.572537 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a8f84a2-c8bb-4d9e-8024-e77731ccb26a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:36:20.573571 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8f84a2-c8bb-4d9e-8024-e77731ccb26a None admin] REQUEST_METHOD: `PUT` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:36:20.574029 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8f84a2-c8bb-4d9e-8024-e77731ccb26a None admin] SCRIPT_NAME: `/identity` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:36:20.574472 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8f84a2-c8bb-4d9e-8024-e77731ccb26a None admin] PATH_INFO: `/v3/projects/305114c1888a404186311d18de60f67f/users/f904ed0dbba148a880c3e595f699694a/roles/eaeb4674b16f497f8afb3384e7e9a3c6` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:36:20.576896 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a8f84a2-c8bb-4d9e-8024-e77731ccb26a None admin] RBAC: Authorizing `identity:create_grant(project_id=305114c1888a404186311d18de60f67f, user_id=f904ed0dbba148a880c3e595f699694a, role_id=eaeb4674b16f497f8afb3384e7e9a3c6)` {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:36:20.578780 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a8f84a2-c8bb-4d9e-8024-e77731ccb26a None admin] RBAC: Authorization granted {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:36:20.593649 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b3cb17-9254-45c7-9e61-fea75bc43c4e None admin] Validating token access rules against request {{(pid=282899) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:36:20.611213 dv-cinder-851351-1-smb devstack@keystone.service[282898]: [pid: 282898|app: 0|req: 127/262] 10.222.0.42 () {58 vars in 1439 bytes} [Thu Jul 28 08:36:20 2022] PUT /identity/v3/projects/305114c1888a404186311d18de60f67f/users/f904ed0dbba148a880c3e595f699694a/roles/eaeb4674b16f497f8afb3384e7e9a3c6 => generated 0 bytes in 267 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 08:36:20.612340 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a8f84a2-c8bb-4d9e-8024-e77731ccb26a None admin] Authenticating user token {{(pid=282898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:36:20.662490 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a8e62f-c146-40da-baba-15d4f8b1cabc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282899) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:36:20.663164 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a8e62f-c146-40da-baba-15d4f8b1cabc None admin] REQUEST_METHOD: `GET` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:36:20.663447 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a8e62f-c146-40da-baba-15d4f8b1cabc None admin] SCRIPT_NAME: `/identity` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:36:20.663725 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a8e62f-c146-40da-baba-15d4f8b1cabc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:36:20.664562 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1a8e62f-c146-40da-baba-15d4f8b1cabc None admin] RBAC: Adding query filter params (role.id=a0e2a00bf94d40f38629d6b5293e3aee, scope.project.id=305114c1888a404186311d18de60f67f, user.id=a7a46e4205fe48debb9e2eb8469bc7c2) {{(pid=282899) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:36:20.664911 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1a8e62f-c146-40da-baba-15d4f8b1cabc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:36:20.666421 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1a8e62f-c146-40da-baba-15d4f8b1cabc None admin] RBAC: Authorization granted {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:36:20.679511 dv-cinder-851351-1-smb devstack@keystone.service[282899]: [pid: 282899|app: 0|req: 136/263] 10.222.0.42 () {56 vars in 1374 bytes} [Thu Jul 28 08:36:20 2022] GET /identity/v3/role_assignments?user.id=a7a46e4205fe48debb9e2eb8469bc7c2&scope.project.id=305114c1888a404186311d18de60f67f&role.id=a0e2a00bf94d40f38629d6b5293e3aee => generated 608 bytes in 312 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:36:20.742377 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a8f84a2-c8bb-4d9e-8024-e77731ccb26a None admin] Validating token access rules against request {{(pid=282898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:36:20.781116 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG dbcounter [-] [282898] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=282898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:36:20.801670 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-396cacc9-4e2b-4bb4-b007-d9a922f43d0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:36:20.802767 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396cacc9-4e2b-4bb4-b007-d9a922f43d0e None admin] REQUEST_METHOD: `GET` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:36:20.803257 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396cacc9-4e2b-4bb4-b007-d9a922f43d0e None admin] SCRIPT_NAME: `/identity` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:36:20.803737 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396cacc9-4e2b-4bb4-b007-d9a922f43d0e None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:36:20.836925 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-396cacc9-4e2b-4bb4-b007-d9a922f43d0e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 08:36:20.842008 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application [None req-396cacc9-4e2b-4bb4-b007-d9a922f43d0e None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 28 08:36:20.842008 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:36:20.842008 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:36:20.842008 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:36:20.842008 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:36:20.842008 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:36:20.842008 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:36:20.842008 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:36:20.842008 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:36:20.842008 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:36:20.842008 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:36:20.842008 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:36:20.842008 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 08:36:20.842008 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 08:36:20.842008 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 08:36:20.842008 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 08:36:20.843297 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 08:36:20.843297 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 08:36:20.843297 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 08:36:20.843297 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 08:36:20.843297 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:36:20.843297 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:36:20.843297 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:36:20.843297 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:36:20.843297 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:36:20.843297 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:36:20.843297 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:36:20.843297 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application with Lock( Jul 28 08:36:20.843297 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:36:20.843297 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:36:20.843297 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:36:20.843297 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:36:20.844543 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:36:20.844543 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:36:20.844543 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:36:20.844543 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:36:20.844543 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 08:36:20.844543 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 08:36:20.844543 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 08:36:20.844543 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 08:36:20.844543 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 08:36:20.844543 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 08:36:20.844543 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 28 08:36:20.844543 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application Jul 28 08:36:20.847303 dv-cinder-851351-1-smb devstack@keystone.service[282898]: [pid: 282898|app: 0|req: 128/264] 10.222.0.42 () {56 vars in 1114 bytes} [Thu Jul 28 08:36:20 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:36:20.853369 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a8e62f-c146-40da-baba-15d4f8b1cabc None admin] Authenticating user token {{(pid=282899) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:36:20.977399 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a8e62f-c146-40da-baba-15d4f8b1cabc None admin] Validating token access rules against request {{(pid=282899) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:36:21.001845 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG dbcounter [-] [282899] Writing DB stats keystone:SELECT=100 {{(pid=282899) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:36:21.014175 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ba6a6f-28f3-439b-a28e-9dd6d6f25ff8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282899) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:36:21.014819 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ba6a6f-28f3-439b-a28e-9dd6d6f25ff8 None admin] REQUEST_METHOD: `GET` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:36:21.015105 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ba6a6f-28f3-439b-a28e-9dd6d6f25ff8 None admin] SCRIPT_NAME: `/identity` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:36:21.015387 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ba6a6f-28f3-439b-a28e-9dd6d6f25ff8 None admin] PATH_INFO: `/v3/roles` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:36:21.016132 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5ba6a6f-28f3-439b-a28e-9dd6d6f25ff8 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=282899) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:36:21.016447 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5ba6a6f-28f3-439b-a28e-9dd6d6f25ff8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:36:21.017913 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5ba6a6f-28f3-439b-a28e-9dd6d6f25ff8 None admin] RBAC: Authorization granted {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:36:21.026746 dv-cinder-851351-1-smb devstack@keystone.service[282899]: [pid: 282899|app: 0|req: 137/265] 10.222.0.42 () {56 vars in 1111 bytes} [Thu Jul 28 08:36:20 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:36:21.032164 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-396cacc9-4e2b-4bb4-b007-d9a922f43d0e None admin] Authenticating user token {{(pid=282898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:36:21.157143 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-396cacc9-4e2b-4bb4-b007-d9a922f43d0e None admin] Validating token access rules against request {{(pid=282898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:36:21.194975 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c326b4b-2278-4760-acdc-c78b581c27f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:36:21.195645 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c326b4b-2278-4760-acdc-c78b581c27f6 None admin] REQUEST_METHOD: `GET` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:36:21.195932 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c326b4b-2278-4760-acdc-c78b581c27f6 None admin] SCRIPT_NAME: `/identity` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:36:21.196222 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c326b4b-2278-4760-acdc-c78b581c27f6 None admin] PATH_INFO: `/v3/users/a7a46e4205fe48debb9e2eb8469bc7c2` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:36:21.199475 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c326b4b-2278-4760-acdc-c78b581c27f6 None admin] RBAC: Authorizing `identity:get_user(user_id=a7a46e4205fe48debb9e2eb8469bc7c2)` {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:36:21.201006 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c326b4b-2278-4760-acdc-c78b581c27f6 None admin] RBAC: Authorization granted {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:36:21.203040 dv-cinder-851351-1-smb devstack@keystone.service[282898]: [pid: 282898|app: 0|req: 129/266] 10.222.0.42 () {56 vars in 1177 bytes} [Thu Jul 28 08:36:21 2022] GET /identity/v3/users/a7a46e4205fe48debb9e2eb8469bc7c2 => generated 283 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 08:36:21.208974 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ba6a6f-28f3-439b-a28e-9dd6d6f25ff8 None admin] Authenticating user token {{(pid=282899) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:36:21.343147 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ba6a6f-28f3-439b-a28e-9dd6d6f25ff8 None admin] Validating token access rules against request {{(pid=282899) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:36:21.395367 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8fd50aa-f64e-480c-bbca-b3273327edc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282899) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:36:21.396074 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8fd50aa-f64e-480c-bbca-b3273327edc5 None admin] REQUEST_METHOD: `GET` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:36:21.396367 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8fd50aa-f64e-480c-bbca-b3273327edc5 None admin] SCRIPT_NAME: `/identity` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:36:21.396646 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8fd50aa-f64e-480c-bbca-b3273327edc5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:36:21.471817 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG dbcounter [-] [282899] Writing DB stats keystone:SELECT=100 {{(pid=282899) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:36:21.486209 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8fd50aa-f64e-480c-bbca-b3273327edc5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:36:21.487989 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8fd50aa-f64e-480c-bbca-b3273327edc5 None admin] RBAC: Authorization granted {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:36:21.641165 dv-cinder-851351-1-smb devstack@keystone.service[282899]: [pid: 282899|app: 0|req: 138/267] 10.222.0.42 () {58 vars in 1282 bytes} [Thu Jul 28 08:36:21 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 433 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 28 08:36:21.648019 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c326b4b-2278-4760-acdc-c78b581c27f6 None admin] Authenticating user token {{(pid=282898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:36:21.719790 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG dbcounter [-] [282898] Writing DB stats keystone:SELECT=100 {{(pid=282898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:36:21.760911 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e00033-d3d6-4b0b-b966-b1b3ab48f710 None None] REQUEST_METHOD: `GET` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:36:21.761475 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e00033-d3d6-4b0b-b966-b1b3ab48f710 None None] SCRIPT_NAME: `/identity` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:36:21.761932 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e00033-d3d6-4b0b-b966-b1b3ab48f710 None None] PATH_INFO: `/` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:36:21.763839 dv-cinder-851351-1-smb devstack@keystone.service[282899]: [pid: 282899|app: 0|req: 139/268] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 08:36:21 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 08:36:21.770213 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead5315e-ea37-40bd-9735-d01b98e77de8 None None] REQUEST_METHOD: `GET` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:36:21.770733 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead5315e-ea37-40bd-9735-d01b98e77de8 None None] SCRIPT_NAME: `/identity` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:36:21.771087 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead5315e-ea37-40bd-9735-d01b98e77de8 None None] PATH_INFO: `/` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:36:21.772624 dv-cinder-851351-1-smb devstack@keystone.service[282899]: [pid: 282899|app: 0|req: 140/269] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 08:36:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 08:36:21.773621 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1be2de-f90f-475a-9aad-5f4409853ebf None None] REQUEST_METHOD: `POST` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:36:21.773906 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1be2de-f90f-475a-9aad-5f4409853ebf None None] SCRIPT_NAME: `/identity` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:36:21.774185 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1be2de-f90f-475a-9aad-5f4409853ebf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:36:21.797318 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.auth.core [None req-0b1be2de-f90f-475a-9aad-5f4409853ebf None None] MFA Rules not processed for user `2be990a66857410a87ffa7609aec4f7b`. Rule list: `[]` (Enabled: `True`). {{(pid=282899) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 08:36:21.798720 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.fernet_utils [None req-0b1be2de-f90f-475a-9aad-5f4409853ebf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=282899) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:36:21.800739 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c326b4b-2278-4760-acdc-c78b581c27f6 None admin] Validating token access rules against request {{(pid=282898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:36:21.850351 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68fbcd52-c32a-4e95-af0a-4aa265023263 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:36:21.851073 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fbcd52-c32a-4e95-af0a-4aa265023263 None admin] REQUEST_METHOD: `GET` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:36:21.851363 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fbcd52-c32a-4e95-af0a-4aa265023263 None admin] SCRIPT_NAME: `/identity` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:36:21.851644 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fbcd52-c32a-4e95-af0a-4aa265023263 None admin] PATH_INFO: `/v3/projects/305114c1888a404186311d18de60f67f` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:36:21.853009 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68fbcd52-c32a-4e95-af0a-4aa265023263 None admin] RBAC: Authorizing `identity:get_project(project_id=305114c1888a404186311d18de60f67f)` {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:36:21.854505 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68fbcd52-c32a-4e95-af0a-4aa265023263 None admin] RBAC: Authorization granted {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:36:21.856271 dv-cinder-851351-1-smb devstack@keystone.service[282898]: [pid: 282898|app: 0|req: 130/270] 10.222.0.42 () {56 vars in 1186 bytes} [Thu Jul 28 08:36:21 2022] GET /identity/v3/projects/305114c1888a404186311d18de60f67f => generated 302 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:36:21.857581 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7aad60-ab48-4b45-a13f-8cebee685902 None None] REQUEST_METHOD: `POST` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:36:21.857875 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7aad60-ab48-4b45-a13f-8cebee685902 None None] SCRIPT_NAME: `/identity` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:36:21.858207 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7aad60-ab48-4b45-a13f-8cebee685902 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:36:21.879120 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.auth.core [None req-cc7aad60-ab48-4b45-a13f-8cebee685902 None None] MFA Rules not processed for user `2be990a66857410a87ffa7609aec4f7b`. Rule list: `[]` (Enabled: `True`). {{(pid=282898) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 08:36:21.880514 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.fernet_utils [None req-cc7aad60-ab48-4b45-a13f-8cebee685902 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=282898) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:36:21.898228 dv-cinder-851351-1-smb devstack@keystone.service[282899]: [pid: 282899|app: 0|req: 141/271] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 08:36:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 08:36:21.898228 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b1be2de-f90f-475a-9aad-5f4409853ebf None None] Authenticating user token {{(pid=282899) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:36:21.919015 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG dbcounter [-] [282899] Writing DB stats keystone:SELECT=100 {{(pid=282899) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:36:21.969934 dv-cinder-851351-1-smb devstack@keystone.service[282898]: [pid: 282898|app: 0|req: 131/272] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 08:36:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 08:36:21.972309 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3f6eeb-5d65-4bcc-873a-7b07105be736 None None] REQUEST_METHOD: `GET` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:36:21.973444 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3f6eeb-5d65-4bcc-873a-7b07105be736 None None] SCRIPT_NAME: `/identity` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:36:21.973444 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3f6eeb-5d65-4bcc-873a-7b07105be736 None None] PATH_INFO: `/` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:36:21.976082 dv-cinder-851351-1-smb devstack@keystone.service[282898]: [pid: 282898|app: 0|req: 132/273] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 08:36:21 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 08:36:21.977557 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3f6eeb-5d65-4bcc-873a-7b07105be736 None None] Authenticating user token {{(pid=282898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:36:22.030550 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b1be2de-f90f-475a-9aad-5f4409853ebf None None] Validating token access rules against request {{(pid=282899) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:36:22.045873 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG dbcounter [-] [282898] Writing DB stats keystone:SELECT=100 {{(pid=282898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:36:22.075159 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ccb8cbb-d7b6-4a48-977e-c69275bf4850 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282899) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:36:22.076145 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ccb8cbb-d7b6-4a48-977e-c69275bf4850 None admin] REQUEST_METHOD: `GET` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:36:22.076624 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ccb8cbb-d7b6-4a48-977e-c69275bf4850 None admin] SCRIPT_NAME: `/identity` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:36:22.077252 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ccb8cbb-d7b6-4a48-977e-c69275bf4850 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:36:22.078264 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ccb8cbb-d7b6-4a48-977e-c69275bf4850 None admin] RBAC: Adding query filter params (role.id=d76677105be344cc83022cbde8a22d8d, scope.project.id=305114c1888a404186311d18de60f67f, user.id=a7a46e4205fe48debb9e2eb8469bc7c2) {{(pid=282899) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:36:22.078803 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ccb8cbb-d7b6-4a48-977e-c69275bf4850 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:36:22.080905 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ccb8cbb-d7b6-4a48-977e-c69275bf4850 None admin] RBAC: Authorization granted {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:36:22.087773 dv-cinder-851351-1-smb devstack@keystone.service[282899]: [pid: 282899|app: 0|req: 142/274] 10.222.0.42 () {56 vars in 1374 bytes} [Thu Jul 28 08:36:21 2022] GET /identity/v3/role_assignments?user.id=a7a46e4205fe48debb9e2eb8469bc7c2&scope.project.id=305114c1888a404186311d18de60f67f&role.id=d76677105be344cc83022cbde8a22d8d => generated 608 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:36:22.089093 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f8aa08-4312-42ce-96c5-5b2b4fd95d22 None None] REQUEST_METHOD: `POST` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:36:22.089386 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f8aa08-4312-42ce-96c5-5b2b4fd95d22 None None] SCRIPT_NAME: `/identity` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:36:22.089673 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f8aa08-4312-42ce-96c5-5b2b4fd95d22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:36:22.111961 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.auth.core [None req-54f8aa08-4312-42ce-96c5-5b2b4fd95d22 None None] MFA Rules not processed for user `2be990a66857410a87ffa7609aec4f7b`. Rule list: `[]` (Enabled: `True`). {{(pid=282899) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 08:36:22.113490 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.fernet_utils [None req-54f8aa08-4312-42ce-96c5-5b2b4fd95d22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=282899) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:36:22.139597 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3f6eeb-5d65-4bcc-873a-7b07105be736 None None] Validating token access rules against request {{(pid=282898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:36:22.191816 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e55e4f-dbaf-4645-abb1-9a6026e56f4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:36:22.193179 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e55e4f-dbaf-4645-abb1-9a6026e56f4f None admin] REQUEST_METHOD: `GET` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:36:22.194159 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e55e4f-dbaf-4645-abb1-9a6026e56f4f None admin] SCRIPT_NAME: `/identity` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:36:22.194669 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e55e4f-dbaf-4645-abb1-9a6026e56f4f None admin] PATH_INFO: `/v3/domains/default` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:36:22.196694 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3e55e4f-dbaf-4645-abb1-9a6026e56f4f None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:36:22.199273 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3e55e4f-dbaf-4645-abb1-9a6026e56f4f None admin] RBAC: Authorization granted {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:36:22.201649 dv-cinder-851351-1-smb devstack@keystone.service[282898]: [pid: 282898|app: 0|req: 133/275] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 08:36:21 2022] GET /identity/v3/domains/default => generated 199 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:36:22.202615 dv-cinder-851351-1-smb devstack@keystone.service[282899]: [pid: 282899|app: 0|req: 143/276] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 08:36:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 08:36:22.202828 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e55e4f-dbaf-4645-abb1-9a6026e56f4f None admin] Authenticating user token {{(pid=282898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:36:22.208606 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f8aa08-4312-42ce-96c5-5b2b4fd95d22 None None] Authenticating user token {{(pid=282899) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:36:22.234807 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG dbcounter [-] [282899] Writing DB stats keystone:SELECT=100 {{(pid=282899) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:36:22.335036 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e55e4f-dbaf-4645-abb1-9a6026e56f4f None admin] Validating token access rules against request {{(pid=282898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:36:22.355673 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG dbcounter [-] [282898] Writing DB stats keystone:SELECT=100 {{(pid=282898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:36:22.378316 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f8aa08-4312-42ce-96c5-5b2b4fd95d22 None None] Validating token access rules against request {{(pid=282899) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:36:22.392683 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d672f5b-613a-4759-a184-566edf9237a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:36:22.393602 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d672f5b-613a-4759-a184-566edf9237a3 None admin] REQUEST_METHOD: `GET` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:36:22.393957 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d672f5b-613a-4759-a184-566edf9237a3 None admin] SCRIPT_NAME: `/identity` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:36:22.394231 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d672f5b-613a-4759-a184-566edf9237a3 None admin] PATH_INFO: `/v3/roles/member` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:36:22.407508 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d672f5b-613a-4759-a184-566edf9237a3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 08:36:22.412500 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application [None req-4d672f5b-613a-4759-a184-566edf9237a3 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 28 08:36:22.412500 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:36:22.412500 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:36:22.412500 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:36:22.412500 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:36:22.412500 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:36:22.412500 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:36:22.412500 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:36:22.412500 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:36:22.412500 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:36:22.412500 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:36:22.412500 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:36:22.412500 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 08:36:22.412500 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 08:36:22.412500 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 08:36:22.412500 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 08:36:22.414111 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 08:36:22.414111 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 08:36:22.414111 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 08:36:22.414111 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 08:36:22.414111 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:36:22.414111 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:36:22.414111 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:36:22.414111 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:36:22.414111 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:36:22.414111 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:36:22.414111 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:36:22.414111 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application with Lock( Jul 28 08:36:22.414111 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:36:22.414111 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:36:22.414111 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:36:22.414111 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:36:22.415079 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:36:22.415079 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:36:22.415079 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:36:22.415079 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:36:22.415079 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 08:36:22.415079 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 08:36:22.415079 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 08:36:22.415079 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 08:36:22.415079 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 08:36:22.415079 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 08:36:22.415079 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 28 08:36:22.415079 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application Jul 28 08:36:22.415079 dv-cinder-851351-1-smb devstack@keystone.service[282898]: [pid: 282898|app: 0|req: 134/277] 10.222.0.42 () {56 vars in 1099 bytes} [Thu Jul 28 08:36:22 2022] GET /identity/v3/roles/member => generated 84 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:36:22.415079 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d672f5b-613a-4759-a184-566edf9237a3 None admin] Authenticating user token {{(pid=282898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:36:22.432222 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1007eb2a-a96d-4206-b544-2bff5ae6670e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282899) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:36:22.432901 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1007eb2a-a96d-4206-b544-2bff5ae6670e None admin] REQUEST_METHOD: `POST` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:36:22.433190 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1007eb2a-a96d-4206-b544-2bff5ae6670e None admin] SCRIPT_NAME: `/identity` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:36:22.433442 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1007eb2a-a96d-4206-b544-2bff5ae6670e None admin] PATH_INFO: `/v3/users` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:36:22.434162 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1007eb2a-a96d-4206-b544-2bff5ae6670e None admin] RBAC: Authorizing `identity:create_user()` {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:36:22.435643 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1007eb2a-a96d-4206-b544-2bff5ae6670e None admin] RBAC: Authorization granted {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:36:22.459313 dv-cinder-851351-1-smb devstack@keystone.service[282899]: [pid: 282899|app: 0|req: 144/278] 10.222.0.42 () {60 vars in 1132 bytes} [Thu Jul 28 08:36:22 2022] POST /identity/v3/users => generated 293 bytes in 251 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 08:36:22.459978 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1007eb2a-a96d-4206-b544-2bff5ae6670e None admin] Authenticating user token {{(pid=282899) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:36:22.561226 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d672f5b-613a-4759-a184-566edf9237a3 None admin] Validating token access rules against request {{(pid=282898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:36:22.573160 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG dbcounter [-] [282899] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=282899) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:36:22.615019 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c965378-6c61-495f-9906-8d9da0a37b54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:36:22.616417 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c965378-6c61-495f-9906-8d9da0a37b54 None admin] REQUEST_METHOD: `GET` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:36:22.616857 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c965378-6c61-495f-9906-8d9da0a37b54 None admin] SCRIPT_NAME: `/identity` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:36:22.617138 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c965378-6c61-495f-9906-8d9da0a37b54 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:36:22.623340 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1007eb2a-a96d-4206-b544-2bff5ae6670e None admin] Validating token access rules against request {{(pid=282899) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:36:22.632605 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c965378-6c61-495f-9906-8d9da0a37b54 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 08:36:22.644339 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application [None req-2c965378-6c61-495f-9906-8d9da0a37b54 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 28 08:36:22.644339 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:36:22.644339 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:36:22.644339 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:36:22.644339 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:36:22.644339 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:36:22.644339 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:36:22.644339 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:36:22.644339 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:36:22.644339 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:36:22.644339 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:36:22.644339 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:36:22.644339 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 08:36:22.644339 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 08:36:22.644339 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 08:36:22.644339 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 08:36:22.647350 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 08:36:22.647350 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 08:36:22.647350 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 08:36:22.647350 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 08:36:22.647350 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:36:22.647350 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:36:22.647350 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:36:22.647350 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:36:22.647350 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:36:22.647350 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:36:22.647350 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:36:22.647350 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application with Lock( Jul 28 08:36:22.647350 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:36:22.647350 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:36:22.647350 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:36:22.647350 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:36:22.649560 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:36:22.649560 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:36:22.649560 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:36:22.649560 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:36:22.649560 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 08:36:22.649560 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 08:36:22.649560 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 08:36:22.649560 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 08:36:22.649560 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 08:36:22.649560 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 08:36:22.649560 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 28 08:36:22.649560 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application Jul 28 08:36:22.649560 dv-cinder-851351-1-smb devstack@keystone.service[282898]: [pid: 282898|app: 0|req: 135/279] 10.222.0.42 () {56 vars in 1099 bytes} [Thu Jul 28 08:36:22 2022] GET /identity/v3/roles/reader => generated 84 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:36:22.654077 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c965378-6c61-495f-9906-8d9da0a37b54 None admin] Authenticating user token {{(pid=282898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:36:22.675965 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79b0395-d9a2-43c0-b348-0604d465e27a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282899) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:36:22.677038 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79b0395-d9a2-43c0-b348-0604d465e27a None admin] REQUEST_METHOD: `GET` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:36:22.677550 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79b0395-d9a2-43c0-b348-0604d465e27a None admin] SCRIPT_NAME: `/identity` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:36:22.678197 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79b0395-d9a2-43c0-b348-0604d465e27a None admin] PATH_INFO: `/v3/roles` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:36:22.679949 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b79b0395-d9a2-43c0-b348-0604d465e27a None admin] RBAC: Adding query filter params (name=member) {{(pid=282899) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:36:22.680394 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b79b0395-d9a2-43c0-b348-0604d465e27a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:36:22.682014 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b79b0395-d9a2-43c0-b348-0604d465e27a None admin] RBAC: Authorization granted {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:36:22.692488 dv-cinder-851351-1-smb devstack@keystone.service[282899]: [pid: 282899|app: 0|req: 145/280] 10.222.0.42 () {56 vars in 1101 bytes} [Thu Jul 28 08:36:22 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:36:22.698870 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79b0395-d9a2-43c0-b348-0604d465e27a None admin] Authenticating user token {{(pid=282899) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:36:22.700382 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG dbcounter [-] [282898] Writing DB stats keystone:SELECT=100 {{(pid=282898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:36:22.814406 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c965378-6c61-495f-9906-8d9da0a37b54 None admin] Validating token access rules against request {{(pid=282898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:36:22.848726 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79b0395-d9a2-43c0-b348-0604d465e27a None admin] Validating token access rules against request {{(pid=282899) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:36:22.869293 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc33d676-fc19-4428-a8b2-e166dff4c91d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:36:22.870304 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc33d676-fc19-4428-a8b2-e166dff4c91d None admin] REQUEST_METHOD: `GET` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:36:22.870787 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc33d676-fc19-4428-a8b2-e166dff4c91d None admin] SCRIPT_NAME: `/identity` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:36:22.871251 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc33d676-fc19-4428-a8b2-e166dff4c91d None admin] PATH_INFO: `/v3/roles` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:36:22.872324 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc33d676-fc19-4428-a8b2-e166dff4c91d None admin] RBAC: Adding query filter params (name=reader) {{(pid=282898) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:36:22.872949 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc33d676-fc19-4428-a8b2-e166dff4c91d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:36:22.874596 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc33d676-fc19-4428-a8b2-e166dff4c91d None admin] RBAC: Authorization granted {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:36:22.885339 dv-cinder-851351-1-smb devstack@keystone.service[282898]: [pid: 282898|app: 0|req: 136/281] 10.222.0.42 () {56 vars in 1101 bytes} [Thu Jul 28 08:36:22 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 08:36:22.889827 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG dbcounter [-] [282899] Writing DB stats keystone:SELECT=100 {{(pid=282899) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:36:22.891416 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc33d676-fc19-4428-a8b2-e166dff4c91d None admin] Authenticating user token {{(pid=282898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:36:22.901159 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-669fec4e-a481-4261-b0e6-3ab9fb6ce46e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282899) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:36:22.901820 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669fec4e-a481-4261-b0e6-3ab9fb6ce46e None admin] REQUEST_METHOD: `GET` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:36:22.902114 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669fec4e-a481-4261-b0e6-3ab9fb6ce46e None admin] SCRIPT_NAME: `/identity` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:36:22.902393 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669fec4e-a481-4261-b0e6-3ab9fb6ce46e None admin] PATH_INFO: `/v3/users/9d3500196c1b4304b23df2b21d23f28f` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:36:22.917843 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-669fec4e-a481-4261-b0e6-3ab9fb6ce46e None admin] RBAC: Authorizing `identity:get_user(user_id=9d3500196c1b4304b23df2b21d23f28f)` {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:36:22.919351 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-669fec4e-a481-4261-b0e6-3ab9fb6ce46e None admin] RBAC: Authorization granted {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:36:22.921516 dv-cinder-851351-1-smb devstack@keystone.service[282899]: [pid: 282899|app: 0|req: 146/282] 10.222.0.42 () {56 vars in 1177 bytes} [Thu Jul 28 08:36:22 2022] GET /identity/v3/users/9d3500196c1b4304b23df2b21d23f28f => generated 293 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:36:22.929591 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-669fec4e-a481-4261-b0e6-3ab9fb6ce46e None admin] Authenticating user token {{(pid=282899) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:36:23.022516 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG dbcounter [-] [282898] Writing DB stats keystone:SELECT=100 {{(pid=282898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:36:23.045623 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc33d676-fc19-4428-a8b2-e166dff4c91d None admin] Validating token access rules against request {{(pid=282898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:36:23.080210 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-669fec4e-a481-4261-b0e6-3ab9fb6ce46e None admin] Validating token access rules against request {{(pid=282899) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:36:23.119463 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36bbb811-d7d7-4203-bb41-a3a4aa37d8a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282899) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:36:23.120452 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36bbb811-d7d7-4203-bb41-a3a4aa37d8a5 None admin] REQUEST_METHOD: `GET` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:36:23.120947 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36bbb811-d7d7-4203-bb41-a3a4aa37d8a5 None admin] SCRIPT_NAME: `/identity` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:36:23.121441 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36bbb811-d7d7-4203-bb41-a3a4aa37d8a5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:36:23.122455 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36bbb811-d7d7-4203-bb41-a3a4aa37d8a5 None admin] RBAC: Adding query filter params (role.id=eaeb4674b16f497f8afb3384e7e9a3c6, user.id=9d3500196c1b4304b23df2b21d23f28f, scope.system=all) {{(pid=282899) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:36:23.122958 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36bbb811-d7d7-4203-bb41-a3a4aa37d8a5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:36:23.125455 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36bbb811-d7d7-4203-bb41-a3a4aa37d8a5 None admin] RBAC: Authorization granted {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:36:23.132063 dv-cinder-851351-1-smb devstack@keystone.service[282899]: [pid: 282899|app: 0|req: 147/283] 10.222.0.42 () {56 vars in 1308 bytes} [Thu Jul 28 08:36:22 2022] GET /identity/v3/role_assignments?user.id=9d3500196c1b4304b23df2b21d23f28f&scope.system=all&role.id=eaeb4674b16f497f8afb3384e7e9a3c6 => generated 226 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 08:36:23.164499 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ff7c19-6355-477d-b4b2-1bc98c2ca92a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:36:23.165221 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ff7c19-6355-477d-b4b2-1bc98c2ca92a None admin] REQUEST_METHOD: `GET` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:36:23.165508 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ff7c19-6355-477d-b4b2-1bc98c2ca92a None admin] SCRIPT_NAME: `/identity` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:36:23.165786 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ff7c19-6355-477d-b4b2-1bc98c2ca92a None admin] PATH_INFO: `/v3/users/eff961182252439e895cf4ef507802c4` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:36:23.169580 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ff7c19-6355-477d-b4b2-1bc98c2ca92a None admin] RBAC: Authorizing `identity:get_user(user_id=eff961182252439e895cf4ef507802c4)` {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:36:23.171087 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ff7c19-6355-477d-b4b2-1bc98c2ca92a None admin] RBAC: Authorization granted {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:36:23.173209 dv-cinder-851351-1-smb devstack@keystone.service[282898]: [pid: 282898|app: 0|req: 137/284] 10.222.0.42 () {56 vars in 1177 bytes} [Thu Jul 28 08:36:22 2022] GET /identity/v3/users/eff961182252439e895cf4ef507802c4 => generated 297 bytes in 282 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:36:23.179511 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36bbb811-d7d7-4203-bb41-a3a4aa37d8a5 None admin] Authenticating user token {{(pid=282899) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:36:23.277087 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG dbcounter [-] [282899] Writing DB stats keystone:SELECT=100 {{(pid=282899) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:36:23.350692 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eab2879-3a08-4c13-88af-ef79a0e11fd8 None None] REQUEST_METHOD: `GET` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:36:23.350692 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eab2879-3a08-4c13-88af-ef79a0e11fd8 None None] SCRIPT_NAME: `/identity` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:36:23.351023 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eab2879-3a08-4c13-88af-ef79a0e11fd8 None None] PATH_INFO: `/` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:36:23.352533 dv-cinder-851351-1-smb devstack@keystone.service[282898]: [pid: 282898|app: 0|req: 138/285] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 08:36:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 08:36:23.358651 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36bbb811-d7d7-4203-bb41-a3a4aa37d8a5 None admin] Validating token access rules against request {{(pid=282899) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:36:23.360412 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e9a786-16dd-4f18-ab3c-4ea4da94c8d7 None None] REQUEST_METHOD: `POST` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:36:23.361366 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e9a786-16dd-4f18-ab3c-4ea4da94c8d7 None None] SCRIPT_NAME: `/identity` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:36:23.361914 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e9a786-16dd-4f18-ab3c-4ea4da94c8d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:36:23.384400 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.auth.core [None req-69e9a786-16dd-4f18-ab3c-4ea4da94c8d7 None None] MFA Rules not processed for user `2be990a66857410a87ffa7609aec4f7b`. Rule list: `[]` (Enabled: `True`). {{(pid=282898) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 08:36:23.386775 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.fernet_utils [None req-69e9a786-16dd-4f18-ab3c-4ea4da94c8d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=282898) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:36:23.419713 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0cbeb0-388a-43ef-a2ab-5d8747bce737 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282899) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:36:23.421249 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0cbeb0-388a-43ef-a2ab-5d8747bce737 None admin] REQUEST_METHOD: `GET` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:36:23.422015 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0cbeb0-388a-43ef-a2ab-5d8747bce737 None admin] SCRIPT_NAME: `/identity` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:36:23.422534 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0cbeb0-388a-43ef-a2ab-5d8747bce737 None admin] PATH_INFO: `/v3/projects/305114c1888a404186311d18de60f67f` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:36:23.424106 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d0cbeb0-388a-43ef-a2ab-5d8747bce737 None admin] RBAC: Authorizing `identity:get_project(project_id=305114c1888a404186311d18de60f67f)` {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:36:23.426011 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d0cbeb0-388a-43ef-a2ab-5d8747bce737 None admin] RBAC: Authorization granted {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:36:23.428376 dv-cinder-851351-1-smb devstack@keystone.service[282899]: [pid: 282899|app: 0|req: 148/286] 10.222.0.42 () {56 vars in 1186 bytes} [Thu Jul 28 08:36:23 2022] GET /identity/v3/projects/305114c1888a404186311d18de60f67f => generated 302 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:36:23.435441 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0cbeb0-388a-43ef-a2ab-5d8747bce737 None admin] Authenticating user token {{(pid=282899) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:36:23.523624 dv-cinder-851351-1-smb devstack@keystone.service[282898]: [pid: 282898|app: 0|req: 139/287] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 08:36:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 28 08:36:23.590935 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e9a786-16dd-4f18-ab3c-4ea4da94c8d7 None None] Authenticating user token {{(pid=282898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:36:23.623231 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0cbeb0-388a-43ef-a2ab-5d8747bce737 None admin] Validating token access rules against request {{(pid=282899) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:36:23.652530 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG dbcounter [-] [282899] Writing DB stats keystone:SELECT=100 {{(pid=282899) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:36:23.671600 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa8eb9b-7e04-466a-ac0c-32f7d1508387 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282899) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:36:23.673643 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa8eb9b-7e04-466a-ac0c-32f7d1508387 None admin] REQUEST_METHOD: `PUT` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:36:23.675485 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa8eb9b-7e04-466a-ac0c-32f7d1508387 None admin] SCRIPT_NAME: `/identity` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:36:23.676039 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa8eb9b-7e04-466a-ac0c-32f7d1508387 None admin] PATH_INFO: `/v3/projects/305114c1888a404186311d18de60f67f/users/eff961182252439e895cf4ef507802c4/roles/34c6ec459a944c46a4265d15a06e348d` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:36:23.679217 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fa8eb9b-7e04-466a-ac0c-32f7d1508387 None admin] RBAC: Authorizing `identity:create_grant(project_id=305114c1888a404186311d18de60f67f, user_id=eff961182252439e895cf4ef507802c4, role_id=34c6ec459a944c46a4265d15a06e348d)` {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:36:23.681096 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fa8eb9b-7e04-466a-ac0c-32f7d1508387 None admin] RBAC: Authorization granted {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:36:23.705905 dv-cinder-851351-1-smb devstack@keystone.service[282899]: [pid: 282899|app: 0|req: 149/288] 10.222.0.42 () {58 vars in 1439 bytes} [Thu Jul 28 08:36:23 2022] PUT /identity/v3/projects/305114c1888a404186311d18de60f67f/users/eff961182252439e895cf4ef507802c4/roles/34c6ec459a944c46a4265d15a06e348d => generated 0 bytes in 272 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 08:36:23.746411 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG dbcounter [-] [282898] Writing DB stats keystone:SELECT=100 {{(pid=282898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:36:23.757906 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e9a786-16dd-4f18-ab3c-4ea4da94c8d7 None None] Validating token access rules against request {{(pid=282898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:36:23.809141 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9c4604-3d5e-4c03-b956-def2ecc52ffc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:36:23.809852 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9c4604-3d5e-4c03-b956-def2ecc52ffc None admin] REQUEST_METHOD: `GET` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:36:23.810134 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9c4604-3d5e-4c03-b956-def2ecc52ffc None admin] SCRIPT_NAME: `/identity` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:36:23.810414 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9c4604-3d5e-4c03-b956-def2ecc52ffc None admin] PATH_INFO: `/v3/roles/member` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:36:23.837925 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d9c4604-3d5e-4c03-b956-def2ecc52ffc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 08:36:23.843124 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application [None req-2d9c4604-3d5e-4c03-b956-def2ecc52ffc None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 28 08:36:23.843124 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:36:23.843124 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:36:23.843124 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:36:23.843124 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:36:23.843124 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:36:23.843124 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:36:23.843124 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:36:23.843124 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:36:23.843124 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:36:23.843124 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:36:23.843124 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:36:23.843124 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 08:36:23.843124 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 08:36:23.843124 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 08:36:23.843124 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 08:36:23.844247 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 08:36:23.844247 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 08:36:23.844247 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 08:36:23.844247 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 08:36:23.844247 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:36:23.844247 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:36:23.844247 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:36:23.844247 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:36:23.844247 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:36:23.844247 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:36:23.844247 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:36:23.844247 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application with Lock( Jul 28 08:36:23.844247 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:36:23.844247 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:36:23.844247 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:36:23.844247 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:36:23.845229 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:36:23.845229 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:36:23.845229 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:36:23.845229 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:36:23.845229 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 08:36:23.845229 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 08:36:23.845229 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 08:36:23.845229 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 08:36:23.845229 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 08:36:23.845229 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 08:36:23.845229 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 28 08:36:23.845229 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application Jul 28 08:36:23.847672 dv-cinder-851351-1-smb devstack@keystone.service[282898]: [pid: 282898|app: 0|req: 140/289] 10.222.0.42 () {56 vars in 1099 bytes} [Thu Jul 28 08:36:23 2022] GET /identity/v3/roles/member => generated 84 bytes in 254 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:36:23.853268 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa8eb9b-7e04-466a-ac0c-32f7d1508387 None admin] Authenticating user token {{(pid=282899) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:36:23.991617 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa8eb9b-7e04-466a-ac0c-32f7d1508387 None admin] Validating token access rules against request {{(pid=282899) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:36:24.037983 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-008fd0f1-da1d-43c6-9b6a-28117bff176b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282899) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:36:24.039048 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008fd0f1-da1d-43c6-9b6a-28117bff176b None admin] REQUEST_METHOD: `GET` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:36:24.039564 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008fd0f1-da1d-43c6-9b6a-28117bff176b None admin] SCRIPT_NAME: `/identity` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:36:24.040081 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008fd0f1-da1d-43c6-9b6a-28117bff176b None admin] PATH_INFO: `/v3/roles` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:36:24.041087 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-008fd0f1-da1d-43c6-9b6a-28117bff176b None admin] RBAC: Adding query filter params (name=member) {{(pid=282899) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:36:24.041613 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-008fd0f1-da1d-43c6-9b6a-28117bff176b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:36:24.043234 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-008fd0f1-da1d-43c6-9b6a-28117bff176b None admin] RBAC: Authorization granted {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:36:24.053338 dv-cinder-851351-1-smb devstack@keystone.service[282899]: [pid: 282899|app: 0|req: 150/290] 10.222.0.42 () {56 vars in 1101 bytes} [Thu Jul 28 08:36:23 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:36:24.059526 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9c4604-3d5e-4c03-b956-def2ecc52ffc None admin] Authenticating user token {{(pid=282898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:36:24.215644 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9c4604-3d5e-4c03-b956-def2ecc52ffc None admin] Validating token access rules against request {{(pid=282898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:36:24.264937 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef76e1f3-de92-4f20-ae0e-ab3c9664ed84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:36:24.265608 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef76e1f3-de92-4f20-ae0e-ab3c9664ed84 None admin] REQUEST_METHOD: `GET` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:36:24.265894 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef76e1f3-de92-4f20-ae0e-ab3c9664ed84 None admin] SCRIPT_NAME: `/identity` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:36:24.266172 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef76e1f3-de92-4f20-ae0e-ab3c9664ed84 None admin] PATH_INFO: `/v3/users/f904ed0dbba148a880c3e595f699694a` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:36:24.273526 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef76e1f3-de92-4f20-ae0e-ab3c9664ed84 None admin] RBAC: Authorizing `identity:get_user(user_id=f904ed0dbba148a880c3e595f699694a)` {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:36:24.275045 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef76e1f3-de92-4f20-ae0e-ab3c9664ed84 None admin] RBAC: Authorization granted {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:36:24.277162 dv-cinder-851351-1-smb devstack@keystone.service[282898]: [pid: 282898|app: 0|req: 141/291] 10.222.0.42 () {56 vars in 1177 bytes} [Thu Jul 28 08:36:24 2022] GET /identity/v3/users/f904ed0dbba148a880c3e595f699694a => generated 297 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:36:24.283057 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-008fd0f1-da1d-43c6-9b6a-28117bff176b None admin] Authenticating user token {{(pid=282899) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:36:24.386616 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG dbcounter [-] [282899] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=282899) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:36:24.458132 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-008fd0f1-da1d-43c6-9b6a-28117bff176b None admin] Validating token access rules against request {{(pid=282899) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:36:24.498395 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2126d72-f331-4890-994c-8989f1741289 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282899) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:36:24.499171 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2126d72-f331-4890-994c-8989f1741289 None admin] REQUEST_METHOD: `GET` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:36:24.499455 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2126d72-f331-4890-994c-8989f1741289 None admin] SCRIPT_NAME: `/identity` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:36:24.499730 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2126d72-f331-4890-994c-8989f1741289 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:36:24.581168 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2126d72-f331-4890-994c-8989f1741289 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:36:24.583470 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2126d72-f331-4890-994c-8989f1741289 None admin] RBAC: Authorization granted {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:36:24.629024 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG dbcounter [-] [282899] Writing DB stats keystone:SELECT=100 {{(pid=282899) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:36:24.704690 dv-cinder-851351-1-smb devstack@keystone.service[282899]: [pid: 282899|app: 0|req: 151/292] 10.222.0.42 () {58 vars in 1282 bytes} [Thu Jul 28 08:36:24 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 422 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 28 08:36:24.710491 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef76e1f3-de92-4f20-ae0e-ab3c9664ed84 None admin] Authenticating user token {{(pid=282898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:36:24.762548 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG dbcounter [-] [282898] Writing DB stats keystone:SELECT=100 {{(pid=282898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:36:24.911886 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef76e1f3-de92-4f20-ae0e-ab3c9664ed84 None admin] Validating token access rules against request {{(pid=282898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:36:24.950363 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa19d94d-a08a-4148-bbb3-3cbea4c8ccc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:36:24.951027 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa19d94d-a08a-4148-bbb3-3cbea4c8ccc6 None admin] REQUEST_METHOD: `GET` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:36:24.951310 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa19d94d-a08a-4148-bbb3-3cbea4c8ccc6 None admin] SCRIPT_NAME: `/identity` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:36:24.951593 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa19d94d-a08a-4148-bbb3-3cbea4c8ccc6 None admin] PATH_INFO: `/v3/projects/305114c1888a404186311d18de60f67f` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:36:24.952881 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa19d94d-a08a-4148-bbb3-3cbea4c8ccc6 None admin] RBAC: Authorizing `identity:get_project(project_id=305114c1888a404186311d18de60f67f)` {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:36:24.955231 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa19d94d-a08a-4148-bbb3-3cbea4c8ccc6 None admin] RBAC: Authorization granted {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:36:24.957478 dv-cinder-851351-1-smb devstack@keystone.service[282898]: [pid: 282898|app: 0|req: 142/293] 10.222.0.42 () {56 vars in 1186 bytes} [Thu Jul 28 08:36:24 2022] GET /identity/v3/projects/305114c1888a404186311d18de60f67f => generated 302 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:36:24.963561 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2126d72-f331-4890-994c-8989f1741289 None admin] Authenticating user token {{(pid=282899) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:36:25.111061 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2126d72-f331-4890-994c-8989f1741289 None admin] Validating token access rules against request {{(pid=282899) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:36:25.154216 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65d9693-0cb4-4e65-ba1e-2d3012d498c1 None None] REQUEST_METHOD: `GET` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:36:25.154574 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65d9693-0cb4-4e65-ba1e-2d3012d498c1 None None] SCRIPT_NAME: `/identity` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:36:25.154772 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65d9693-0cb4-4e65-ba1e-2d3012d498c1 None None] PATH_INFO: `/` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:36:25.156474 dv-cinder-851351-1-smb devstack@keystone.service[282898]: [pid: 282898|app: 0|req: 143/294] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 08:36:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 28 08:36:25.163861 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50093a3e-fe35-4f5d-ab2a-2a19182d4bff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282899) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:36:25.164456 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50093a3e-fe35-4f5d-ab2a-2a19182d4bff None admin] REQUEST_METHOD: `GET` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:36:25.164763 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50093a3e-fe35-4f5d-ab2a-2a19182d4bff None admin] SCRIPT_NAME: `/identity` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:36:25.165042 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50093a3e-fe35-4f5d-ab2a-2a19182d4bff None admin] PATH_INFO: `/v3/role_assignments` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:36:25.165860 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50093a3e-fe35-4f5d-ab2a-2a19182d4bff None admin] RBAC: Adding query filter params (role.id=eaeb4674b16f497f8afb3384e7e9a3c6, scope.project.id=305114c1888a404186311d18de60f67f, user.id=f904ed0dbba148a880c3e595f699694a) {{(pid=282899) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:36:25.166172 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50093a3e-fe35-4f5d-ab2a-2a19182d4bff None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:36:25.167802 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50093a3e-fe35-4f5d-ab2a-2a19182d4bff None admin] RBAC: Authorization granted {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:36:25.170816 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b633921-f246-4f60-9150-f357f326fa9d None None] REQUEST_METHOD: `POST` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:36:25.171103 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b633921-f246-4f60-9150-f357f326fa9d None None] SCRIPT_NAME: `/identity` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:36:25.171386 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b633921-f246-4f60-9150-f357f326fa9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:36:25.175845 dv-cinder-851351-1-smb devstack@keystone.service[282899]: [pid: 282899|app: 0|req: 152/295] 10.222.0.42 () {56 vars in 1374 bytes} [Thu Jul 28 08:36:24 2022] GET /identity/v3/role_assignments?user.id=f904ed0dbba148a880c3e595f699694a&scope.project.id=305114c1888a404186311d18de60f67f&role.id=eaeb4674b16f497f8afb3384e7e9a3c6 => generated 608 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:36:25.213987 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.auth.core [None req-5b633921-f246-4f60-9150-f357f326fa9d None None] MFA Rules not processed for user `2be990a66857410a87ffa7609aec4f7b`. Rule list: `[]` (Enabled: `True`). {{(pid=282898) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 08:36:25.215251 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.fernet_utils [None req-5b633921-f246-4f60-9150-f357f326fa9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=282898) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:36:25.326191 dv-cinder-851351-1-smb devstack@keystone.service[282898]: [pid: 282898|app: 0|req: 144/296] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 08:36:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 08:36:25.353783 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7dc3c7-610c-4876-a444-ac1cafde77b5 None None] REQUEST_METHOD: `GET` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:36:25.354374 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7dc3c7-610c-4876-a444-ac1cafde77b5 None None] SCRIPT_NAME: `/identity` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:36:25.354814 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7dc3c7-610c-4876-a444-ac1cafde77b5 None None] PATH_INFO: `/` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:36:25.357389 dv-cinder-851351-1-smb devstack@keystone.service[282899]: [pid: 282899|app: 0|req: 153/297] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 08:36:25 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 08:36:25.363477 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b633921-f246-4f60-9150-f357f326fa9d None None] Authenticating user token {{(pid=282898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:36:25.363719 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a9fcd6-1a2f-4e32-88a2-6affc635b224 None None] REQUEST_METHOD: `POST` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:36:25.363941 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a9fcd6-1a2f-4e32-88a2-6affc635b224 None None] SCRIPT_NAME: `/identity` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:36:25.364379 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a9fcd6-1a2f-4e32-88a2-6affc635b224 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:36:25.378368 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG dbcounter [-] [282899] Writing DB stats keystone:SELECT=100 {{(pid=282899) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:36:25.387953 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG dbcounter [-] [282898] Writing DB stats keystone:SELECT=100 {{(pid=282898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:36:25.394872 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.auth.core [None req-20a9fcd6-1a2f-4e32-88a2-6affc635b224 None None] MFA Rules not processed for user `2be990a66857410a87ffa7609aec4f7b`. Rule list: `[]` (Enabled: `True`). {{(pid=282899) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 08:36:25.396119 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.fernet_utils [None req-20a9fcd6-1a2f-4e32-88a2-6affc635b224 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=282899) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:36:25.475666 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b633921-f246-4f60-9150-f357f326fa9d None None] Validating token access rules against request {{(pid=282898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:36:25.510649 dv-cinder-851351-1-smb devstack@keystone.service[282899]: [pid: 282899|app: 0|req: 154/298] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 08:36:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 08:36:25.521700 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0bfcdd-32f0-48b6-bdbd-9a7f196fd419 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:36:25.522384 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0bfcdd-32f0-48b6-bdbd-9a7f196fd419 None admin] REQUEST_METHOD: `GET` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:36:25.522649 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0bfcdd-32f0-48b6-bdbd-9a7f196fd419 None admin] SCRIPT_NAME: `/identity` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:36:25.522917 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0bfcdd-32f0-48b6-bdbd-9a7f196fd419 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:36:25.534703 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb0bfcdd-32f0-48b6-bdbd-9a7f196fd419 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 08:36:25.538847 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a9fcd6-1a2f-4e32-88a2-6affc635b224 None None] Authenticating user token {{(pid=282899) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:36:25.539890 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application [None req-cb0bfcdd-32f0-48b6-bdbd-9a7f196fd419 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 28 08:36:25.539890 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:36:25.539890 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:36:25.539890 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:36:25.539890 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:36:25.539890 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:36:25.539890 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:36:25.539890 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:36:25.539890 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:36:25.539890 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:36:25.539890 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:36:25.539890 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:36:25.539890 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 08:36:25.539890 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 08:36:25.539890 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 08:36:25.539890 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 08:36:25.541298 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 08:36:25.541298 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 08:36:25.541298 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 08:36:25.541298 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 08:36:25.541298 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:36:25.541298 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:36:25.541298 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:36:25.541298 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:36:25.541298 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:36:25.541298 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:36:25.541298 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:36:25.541298 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application with Lock( Jul 28 08:36:25.541298 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:36:25.541298 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:36:25.541298 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:36:25.541298 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:36:25.542565 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:36:25.542565 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:36:25.542565 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:36:25.542565 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:36:25.542565 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 08:36:25.542565 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 08:36:25.542565 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 08:36:25.542565 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 08:36:25.542565 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 08:36:25.542565 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 08:36:25.542565 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 28 08:36:25.542565 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application Jul 28 08:36:25.545760 dv-cinder-851351-1-smb devstack@keystone.service[282898]: [pid: 282898|app: 0|req: 145/299] 10.222.0.42 () {56 vars in 1099 bytes} [Thu Jul 28 08:36:25 2022] GET /identity/v3/roles/reader => generated 84 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:36:25.547293 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0bfcdd-32f0-48b6-bdbd-9a7f196fd419 None admin] Authenticating user token {{(pid=282898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:36:25.658526 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG dbcounter [-] [282898] Writing DB stats keystone:SELECT=100 {{(pid=282898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:36:25.693338 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0bfcdd-32f0-48b6-bdbd-9a7f196fd419 None admin] Validating token access rules against request {{(pid=282898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:36:25.700815 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a9fcd6-1a2f-4e32-88a2-6affc635b224 None None] Validating token access rules against request {{(pid=282899) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:36:25.733984 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a022143-2bd0-4b6c-a641-8e9029c1dcc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:36:25.734537 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a022143-2bd0-4b6c-a641-8e9029c1dcc5 None admin] REQUEST_METHOD: `GET` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:36:25.734858 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a022143-2bd0-4b6c-a641-8e9029c1dcc5 None admin] SCRIPT_NAME: `/identity` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:36:25.735127 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a022143-2bd0-4b6c-a641-8e9029c1dcc5 None admin] PATH_INFO: `/v3/roles` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:36:25.735873 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a022143-2bd0-4b6c-a641-8e9029c1dcc5 None admin] RBAC: Adding query filter params (name=reader) {{(pid=282898) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:36:25.736217 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a022143-2bd0-4b6c-a641-8e9029c1dcc5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:36:25.737711 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a022143-2bd0-4b6c-a641-8e9029c1dcc5 None admin] RBAC: Authorization granted {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:36:25.748951 dv-cinder-851351-1-smb devstack@keystone.service[282898]: [pid: 282898|app: 0|req: 146/300] 10.222.0.42 () {56 vars in 1101 bytes} [Thu Jul 28 08:36:25 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 08:36:25.753414 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072c942d-7807-448b-bd7e-02a7c499abed None None] REQUEST_METHOD: `GET` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:36:25.753414 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072c942d-7807-448b-bd7e-02a7c499abed None None] SCRIPT_NAME: `/identity` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:36:25.753414 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072c942d-7807-448b-bd7e-02a7c499abed None None] PATH_INFO: `/` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:36:25.753414 dv-cinder-851351-1-smb devstack@keystone.service[282898]: [pid: 282898|app: 0|req: 147/301] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 08:36:25 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 08:36:25.755700 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072c942d-7807-448b-bd7e-02a7c499abed None None] Authenticating user token {{(pid=282898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:36:25.757390 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b8cc64a-7f04-45ca-9850-4b79c10f4c08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282899) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:36:25.758144 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8cc64a-7f04-45ca-9850-4b79c10f4c08 None admin] REQUEST_METHOD: `GET` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:36:25.758444 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8cc64a-7f04-45ca-9850-4b79c10f4c08 None admin] SCRIPT_NAME: `/identity` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:36:25.758765 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8cc64a-7f04-45ca-9850-4b79c10f4c08 None admin] PATH_INFO: `/v3/domains/default` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:36:25.761251 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b8cc64a-7f04-45ca-9850-4b79c10f4c08 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:36:25.766301 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b8cc64a-7f04-45ca-9850-4b79c10f4c08 None admin] RBAC: Authorization granted {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:36:25.773324 dv-cinder-851351-1-smb devstack@keystone.service[282899]: [pid: 282899|app: 0|req: 155/302] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 08:36:25 2022] GET /identity/v3/domains/default => generated 199 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 08:36:25.773324 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f0a989-2465-4885-b0d5-fe3f987ca371 None None] REQUEST_METHOD: `POST` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:36:25.773324 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f0a989-2465-4885-b0d5-fe3f987ca371 None None] SCRIPT_NAME: `/identity` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:36:25.773324 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f0a989-2465-4885-b0d5-fe3f987ca371 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:36:25.779482 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG dbcounter [-] [282899] Writing DB stats keystone:SELECT=100 {{(pid=282899) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:36:25.798072 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.auth.core [None req-01f0a989-2465-4885-b0d5-fe3f987ca371 None None] MFA Rules not processed for user `2be990a66857410a87ffa7609aec4f7b`. Rule list: `[]` (Enabled: `True`). {{(pid=282899) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 08:36:25.799284 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.fernet_utils [None req-01f0a989-2465-4885-b0d5-fe3f987ca371 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=282899) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:36:25.872261 dv-cinder-851351-1-smb devstack@keystone.service[282899]: [pid: 282899|app: 0|req: 156/303] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 08:36:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 08:36:25.876899 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f0a989-2465-4885-b0d5-fe3f987ca371 None None] Authenticating user token {{(pid=282899) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:36:25.897077 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072c942d-7807-448b-bd7e-02a7c499abed None None] Validating token access rules against request {{(pid=282898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:36:25.934634 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b8db21-98be-4ad0-8790-db1722c310f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:36:25.935466 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b8db21-98be-4ad0-8790-db1722c310f4 None admin] REQUEST_METHOD: `GET` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:36:25.936107 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b8db21-98be-4ad0-8790-db1722c310f4 None admin] SCRIPT_NAME: `/identity` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:36:25.936107 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b8db21-98be-4ad0-8790-db1722c310f4 None admin] PATH_INFO: `/v3/users/0f43fc4793db4630b3e45a5928ede2eb` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:36:25.952416 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG dbcounter [-] [282898] Writing DB stats keystone:SELECT=100 {{(pid=282898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:36:25.957853 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75b8db21-98be-4ad0-8790-db1722c310f4 None admin] RBAC: Authorizing `identity:get_user(user_id=0f43fc4793db4630b3e45a5928ede2eb)` {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:36:25.959627 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75b8db21-98be-4ad0-8790-db1722c310f4 None admin] RBAC: Authorization granted {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:36:25.961909 dv-cinder-851351-1-smb devstack@keystone.service[282898]: [pid: 282898|app: 0|req: 148/304] 10.222.0.42 () {56 vars in 1177 bytes} [Thu Jul 28 08:36:25 2022] GET /identity/v3/users/0f43fc4793db4630b3e45a5928ede2eb => generated 293 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:36:25.963690 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b8db21-98be-4ad0-8790-db1722c310f4 None admin] Authenticating user token {{(pid=282898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:36:25.996743 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f0a989-2465-4885-b0d5-fe3f987ca371 None None] Validating token access rules against request {{(pid=282899) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:36:26.038106 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG dbcounter [-] [282899] Writing DB stats keystone:SELECT=100 {{(pid=282899) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:36:26.046633 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25219895-bd07-4090-b572-395060ab103b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282899) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:36:26.047272 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25219895-bd07-4090-b572-395060ab103b None admin] REQUEST_METHOD: `POST` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:36:26.047556 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25219895-bd07-4090-b572-395060ab103b None admin] SCRIPT_NAME: `/identity` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:36:26.047834 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25219895-bd07-4090-b572-395060ab103b None admin] PATH_INFO: `/v3/groups` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:36:26.048516 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25219895-bd07-4090-b572-395060ab103b None admin] RBAC: Authorizing `identity:create_group()` {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:36:26.050023 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25219895-bd07-4090-b572-395060ab103b None admin] RBAC: Authorization granted {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:36:26.074910 dv-cinder-851351-1-smb devstack@keystone.service[282899]: [pid: 282899|app: 0|req: 157/305] 10.222.0.42 () {60 vars in 1134 bytes} [Thu Jul 28 08:36:25 2022] POST /identity/v3/groups => generated 229 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 08:36:26.075949 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25219895-bd07-4090-b572-395060ab103b None admin] Authenticating user token {{(pid=282899) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:36:26.106196 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b8db21-98be-4ad0-8790-db1722c310f4 None admin] Validating token access rules against request {{(pid=282898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:36:26.164890 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6756e67-263b-4b1b-a969-7ec9599c80b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:36:26.166003 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6756e67-263b-4b1b-a969-7ec9599c80b0 None admin] REQUEST_METHOD: `GET` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:36:26.166303 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6756e67-263b-4b1b-a969-7ec9599c80b0 None admin] SCRIPT_NAME: `/identity` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:36:26.166584 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6756e67-263b-4b1b-a969-7ec9599c80b0 None admin] PATH_INFO: `/v3/roles/member` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:36:26.179704 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6756e67-263b-4b1b-a969-7ec9599c80b0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 08:36:26.185054 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application [None req-a6756e67-263b-4b1b-a969-7ec9599c80b0 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 28 08:36:26.185054 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:36:26.185054 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:36:26.185054 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:36:26.185054 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:36:26.185054 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:36:26.185054 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:36:26.185054 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:36:26.185054 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:36:26.185054 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:36:26.185054 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:36:26.185054 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:36:26.185054 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 08:36:26.185054 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 08:36:26.185054 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 08:36:26.185054 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 08:36:26.186198 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 08:36:26.186198 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 08:36:26.186198 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 08:36:26.186198 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 08:36:26.186198 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:36:26.186198 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:36:26.186198 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:36:26.186198 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:36:26.186198 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:36:26.186198 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:36:26.186198 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:36:26.186198 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application with Lock( Jul 28 08:36:26.186198 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:36:26.186198 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:36:26.186198 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:36:26.186198 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:36:26.187159 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:36:26.187159 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:36:26.187159 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:36:26.187159 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:36:26.187159 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 08:36:26.187159 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 08:36:26.187159 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 08:36:26.187159 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 08:36:26.187159 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 08:36:26.187159 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 08:36:26.187159 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 28 08:36:26.187159 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application Jul 28 08:36:26.187159 dv-cinder-851351-1-smb devstack@keystone.service[282898]: [pid: 282898|app: 0|req: 149/306] 10.222.0.42 () {56 vars in 1099 bytes} [Thu Jul 28 08:36:25 2022] GET /identity/v3/roles/member => generated 84 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:36:26.192886 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6756e67-263b-4b1b-a969-7ec9599c80b0 None admin] Authenticating user token {{(pid=282898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:36:26.234088 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25219895-bd07-4090-b572-395060ab103b None admin] Validating token access rules against request {{(pid=282899) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:36:26.275438 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG dbcounter [-] [282898] Writing DB stats keystone:SELECT=100 {{(pid=282898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:36:26.288093 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1270b3-ab0c-4d49-9d96-0aa97273280f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282899) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:36:26.288775 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1270b3-ab0c-4d49-9d96-0aa97273280f None admin] REQUEST_METHOD: `GET` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:36:26.289059 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1270b3-ab0c-4d49-9d96-0aa97273280f None admin] SCRIPT_NAME: `/identity` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:36:26.289448 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1270b3-ab0c-4d49-9d96-0aa97273280f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:36:26.290413 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b1270b3-ab0c-4d49-9d96-0aa97273280f None admin] RBAC: Adding query filter params (role.id=34c6ec459a944c46a4265d15a06e348d, user.id=0f43fc4793db4630b3e45a5928ede2eb, scope.system=all) {{(pid=282899) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:36:26.290702 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b1270b3-ab0c-4d49-9d96-0aa97273280f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:36:26.292192 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b1270b3-ab0c-4d49-9d96-0aa97273280f None admin] RBAC: Authorization granted {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:36:26.299431 dv-cinder-851351-1-smb devstack@keystone.service[282899]: [pid: 282899|app: 0|req: 158/307] 10.222.0.42 () {56 vars in 1308 bytes} [Thu Jul 28 08:36:26 2022] GET /identity/v3/role_assignments?user.id=0f43fc4793db4630b3e45a5928ede2eb&scope.system=all&role.id=34c6ec459a944c46a4265d15a06e348d => generated 226 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:36:26.333437 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6756e67-263b-4b1b-a969-7ec9599c80b0 None admin] Validating token access rules against request {{(pid=282898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:36:26.382212 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18060217-92f2-415c-9a7e-8ae6b903ea9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:36:26.383255 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18060217-92f2-415c-9a7e-8ae6b903ea9e None admin] REQUEST_METHOD: `GET` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:36:26.383694 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18060217-92f2-415c-9a7e-8ae6b903ea9e None admin] SCRIPT_NAME: `/identity` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:36:26.384176 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18060217-92f2-415c-9a7e-8ae6b903ea9e None admin] PATH_INFO: `/v3/roles` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:36:26.385154 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18060217-92f2-415c-9a7e-8ae6b903ea9e None admin] RBAC: Adding query filter params (name=member) {{(pid=282898) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:36:26.385644 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18060217-92f2-415c-9a7e-8ae6b903ea9e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:36:26.387418 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18060217-92f2-415c-9a7e-8ae6b903ea9e None admin] RBAC: Authorization granted {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:36:26.398416 dv-cinder-851351-1-smb devstack@keystone.service[282898]: [pid: 282898|app: 0|req: 150/308] 10.222.0.42 () {56 vars in 1101 bytes} [Thu Jul 28 08:36:26 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:36:26.404840 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1270b3-ab0c-4d49-9d96-0aa97273280f None admin] Authenticating user token {{(pid=282899) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:36:26.477238 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG dbcounter [-] [282899] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=282899) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:36:26.534805 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1270b3-ab0c-4d49-9d96-0aa97273280f None admin] Validating token access rules against request {{(pid=282899) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:36:26.547093 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9267c0a-4504-41f7-9333-df4e41b12653 None None] REQUEST_METHOD: `GET` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:36:26.547428 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9267c0a-4504-41f7-9333-df4e41b12653 None None] SCRIPT_NAME: `/identity` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:36:26.547665 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9267c0a-4504-41f7-9333-df4e41b12653 None None] PATH_INFO: `/` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:36:26.549587 dv-cinder-851351-1-smb devstack@keystone.service[282898]: [pid: 282898|app: 0|req: 151/309] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 08:36:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 08:36:26.557556 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ae874b-b155-4acb-a5f4-94d67f6681ce None None] REQUEST_METHOD: `POST` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:36:26.557975 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ae874b-b155-4acb-a5f4-94d67f6681ce None None] SCRIPT_NAME: `/identity` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:36:26.558396 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ae874b-b155-4acb-a5f4-94d67f6681ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:36:26.579946 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd9deac-3fb4-4c62-9dbf-73de804eb241 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282899) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:36:26.580930 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.auth.core [None req-d4ae874b-b155-4acb-a5f4-94d67f6681ce None None] MFA Rules not processed for user `2be990a66857410a87ffa7609aec4f7b`. Rule list: `[]` (Enabled: `True`). {{(pid=282898) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 08:36:26.581125 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd9deac-3fb4-4c62-9dbf-73de804eb241 None admin] REQUEST_METHOD: `GET` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:36:26.581567 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd9deac-3fb4-4c62-9dbf-73de804eb241 None admin] SCRIPT_NAME: `/identity` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:36:26.582066 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd9deac-3fb4-4c62-9dbf-73de804eb241 None admin] PATH_INFO: `/v3/users/9d3500196c1b4304b23df2b21d23f28f` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:36:26.582735 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.fernet_utils [None req-d4ae874b-b155-4acb-a5f4-94d67f6681ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=282898) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:36:26.583721 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bd9deac-3fb4-4c62-9dbf-73de804eb241 None admin] RBAC: Authorizing `identity:get_user(user_id=9d3500196c1b4304b23df2b21d23f28f)` {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:36:26.585434 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bd9deac-3fb4-4c62-9dbf-73de804eb241 None admin] RBAC: Authorization granted {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:36:26.591682 dv-cinder-851351-1-smb devstack@keystone.service[282899]: [pid: 282899|app: 0|req: 159/310] 10.222.0.42 () {56 vars in 1177 bytes} [Thu Jul 28 08:36:26 2022] GET /identity/v3/users/9d3500196c1b4304b23df2b21d23f28f => generated 293 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:36:26.593317 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd9deac-3fb4-4c62-9dbf-73de804eb241 None admin] Authenticating user token {{(pid=282899) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:36:26.672714 dv-cinder-851351-1-smb devstack@keystone.service[282898]: [pid: 282898|app: 0|req: 152/311] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 08:36:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 08:36:26.695937 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ae874b-b155-4acb-a5f4-94d67f6681ce None None] Authenticating user token {{(pid=282898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:36:26.717527 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd9deac-3fb4-4c62-9dbf-73de804eb241 None admin] Validating token access rules against request {{(pid=282899) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:36:26.751221 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG dbcounter [-] [282899] Writing DB stats keystone:SELECT=100 {{(pid=282899) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:36:26.766853 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5912bf-919b-40da-8cce-446f4ee41daa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282899) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:36:26.767817 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5912bf-919b-40da-8cce-446f4ee41daa None admin] REQUEST_METHOD: `PUT` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:36:26.768200 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5912bf-919b-40da-8cce-446f4ee41daa None admin] SCRIPT_NAME: `/identity` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:36:26.768560 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5912bf-919b-40da-8cce-446f4ee41daa None admin] PATH_INFO: `/v3/system/users/9d3500196c1b4304b23df2b21d23f28f/roles/eaeb4674b16f497f8afb3384e7e9a3c6` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:36:26.770338 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb5912bf-919b-40da-8cce-446f4ee41daa None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=9d3500196c1b4304b23df2b21d23f28f, role_id=eaeb4674b16f497f8afb3384e7e9a3c6)` {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:36:26.771993 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb5912bf-919b-40da-8cce-446f4ee41daa None admin] RBAC: Authorization granted {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:36:26.780349 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG dbcounter [-] [282898] Writing DB stats keystone:SELECT=100 {{(pid=282898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:36:26.787364 dv-cinder-851351-1-smb devstack@keystone.service[282899]: [pid: 282899|app: 0|req: 160/312] 10.222.0.42 () {58 vars in 1334 bytes} [Thu Jul 28 08:36:26 2022] PUT /identity/v3/system/users/9d3500196c1b4304b23df2b21d23f28f/roles/eaeb4674b16f497f8afb3384e7e9a3c6 => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 28 08:36:26.884184 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ae874b-b155-4acb-a5f4-94d67f6681ce None None] Validating token access rules against request {{(pid=282898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:36:26.926195 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4196ef-2f20-4768-a655-4788626bd05e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:36:26.926905 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4196ef-2f20-4768-a655-4788626bd05e None admin] REQUEST_METHOD: `GET` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:36:26.927156 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4196ef-2f20-4768-a655-4788626bd05e None admin] SCRIPT_NAME: `/identity` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:36:26.927429 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4196ef-2f20-4768-a655-4788626bd05e None admin] PATH_INFO: `/v3/roles/reader` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:36:26.940819 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff4196ef-2f20-4768-a655-4788626bd05e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 08:36:26.946283 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application [None req-ff4196ef-2f20-4768-a655-4788626bd05e None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 28 08:36:26.946283 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:36:26.946283 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:36:26.946283 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:36:26.946283 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:36:26.946283 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:36:26.946283 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:36:26.946283 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:36:26.946283 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:36:26.946283 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:36:26.946283 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:36:26.946283 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:36:26.946283 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 08:36:26.946283 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 08:36:26.946283 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 08:36:26.946283 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 08:36:26.947410 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 08:36:26.947410 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 08:36:26.947410 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 08:36:26.947410 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 08:36:26.947410 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:36:26.947410 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:36:26.947410 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:36:26.947410 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:36:26.947410 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:36:26.947410 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:36:26.947410 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:36:26.947410 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application with Lock( Jul 28 08:36:26.947410 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:36:26.947410 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:36:26.947410 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:36:26.947410 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:36:26.948368 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:36:26.948368 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:36:26.948368 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:36:26.948368 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:36:26.948368 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 08:36:26.948368 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 08:36:26.948368 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 08:36:26.948368 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 08:36:26.948368 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 08:36:26.948368 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 08:36:26.948368 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 28 08:36:26.948368 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application Jul 28 08:36:26.952750 dv-cinder-851351-1-smb devstack@keystone.service[282898]: [pid: 282898|app: 0|req: 153/313] 10.222.0.42 () {56 vars in 1099 bytes} [Thu Jul 28 08:36:26 2022] GET /identity/v3/roles/reader => generated 84 bytes in 253 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:36:26.954619 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5912bf-919b-40da-8cce-446f4ee41daa None admin] Authenticating user token {{(pid=282899) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:36:27.070180 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5912bf-919b-40da-8cce-446f4ee41daa None admin] Validating token access rules against request {{(pid=282899) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:36:27.106605 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa54231d-e3f2-478c-9ffb-d80181ec006c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282899) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:36:27.107262 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa54231d-e3f2-478c-9ffb-d80181ec006c None admin] REQUEST_METHOD: `GET` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:36:27.107551 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa54231d-e3f2-478c-9ffb-d80181ec006c None admin] SCRIPT_NAME: `/identity` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:36:27.107831 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa54231d-e3f2-478c-9ffb-d80181ec006c None admin] PATH_INFO: `/v3/roles` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:36:27.108603 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa54231d-e3f2-478c-9ffb-d80181ec006c None admin] RBAC: Adding query filter params (name=reader) {{(pid=282899) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:36:27.108942 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa54231d-e3f2-478c-9ffb-d80181ec006c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:36:27.110409 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa54231d-e3f2-478c-9ffb-d80181ec006c None admin] RBAC: Authorization granted {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:36:27.124788 dv-cinder-851351-1-smb devstack@keystone.service[282899]: [pid: 282899|app: 0|req: 161/314] 10.222.0.42 () {56 vars in 1101 bytes} [Thu Jul 28 08:36:26 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:36:27.127146 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4196ef-2f20-4768-a655-4788626bd05e None admin] Authenticating user token {{(pid=282898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:36:27.241672 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4196ef-2f20-4768-a655-4788626bd05e None admin] Validating token access rules against request {{(pid=282898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:36:27.253463 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG dbcounter [-] [282898] Writing DB stats keystone:SELECT=100 {{(pid=282898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:36:27.280477 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5303e510-fd8a-469a-8cc3-d791b0bddd53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:36:27.281180 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5303e510-fd8a-469a-8cc3-d791b0bddd53 None admin] REQUEST_METHOD: `GET` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:36:27.281467 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5303e510-fd8a-469a-8cc3-d791b0bddd53 None admin] SCRIPT_NAME: `/identity` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:36:27.281751 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5303e510-fd8a-469a-8cc3-d791b0bddd53 None admin] PATH_INFO: `/v3/users/eff961182252439e895cf4ef507802c4` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:36:27.282979 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5303e510-fd8a-469a-8cc3-d791b0bddd53 None admin] RBAC: Authorizing `identity:get_user(user_id=eff961182252439e895cf4ef507802c4)` {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:36:27.284448 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5303e510-fd8a-469a-8cc3-d791b0bddd53 None admin] RBAC: Authorization granted {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:36:27.290900 dv-cinder-851351-1-smb devstack@keystone.service[282898]: [pid: 282898|app: 0|req: 154/315] 10.222.0.42 () {56 vars in 1177 bytes} [Thu Jul 28 08:36:27 2022] GET /identity/v3/users/eff961182252439e895cf4ef507802c4 => generated 297 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:36:27.292365 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa54231d-e3f2-478c-9ffb-d80181ec006c None admin] Authenticating user token {{(pid=282899) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:36:27.361290 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG dbcounter [-] [282899] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=282899) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:36:27.408158 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa54231d-e3f2-478c-9ffb-d80181ec006c None admin] Validating token access rules against request {{(pid=282899) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:36:27.445140 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8ec75f-5e58-47f3-9d5e-f1dd2f5c4945 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282899) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:36:27.445799 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8ec75f-5e58-47f3-9d5e-f1dd2f5c4945 None admin] REQUEST_METHOD: `GET` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:36:27.446137 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8ec75f-5e58-47f3-9d5e-f1dd2f5c4945 None admin] SCRIPT_NAME: `/identity` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:36:27.446427 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8ec75f-5e58-47f3-9d5e-f1dd2f5c4945 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:36:27.522889 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f8ec75f-5e58-47f3-9d5e-f1dd2f5c4945 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:36:27.524568 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f8ec75f-5e58-47f3-9d5e-f1dd2f5c4945 None admin] RBAC: Authorization granted {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:36:27.576276 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG dbcounter [-] [282899] Writing DB stats keystone:SELECT=100 {{(pid=282899) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:36:27.631129 dv-cinder-851351-1-smb devstack@keystone.service[282899]: [pid: 282899|app: 0|req: 162/316] 10.222.0.42 () {58 vars in 1282 bytes} [Thu Jul 28 08:36:27 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 28 08:36:27.637030 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5303e510-fd8a-469a-8cc3-d791b0bddd53 None admin] Authenticating user token {{(pid=282898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:36:27.753732 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5303e510-fd8a-469a-8cc3-d791b0bddd53 None admin] Validating token access rules against request {{(pid=282898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:36:27.790163 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-174bab21-bf6a-4c86-b8fa-d2747091f358 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:36:27.790831 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174bab21-bf6a-4c86-b8fa-d2747091f358 None admin] REQUEST_METHOD: `GET` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:36:27.791118 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174bab21-bf6a-4c86-b8fa-d2747091f358 None admin] SCRIPT_NAME: `/identity` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:36:27.791393 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174bab21-bf6a-4c86-b8fa-d2747091f358 None admin] PATH_INFO: `/v3/projects/305114c1888a404186311d18de60f67f` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:36:27.792605 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-174bab21-bf6a-4c86-b8fa-d2747091f358 None admin] RBAC: Authorizing `identity:get_project(project_id=305114c1888a404186311d18de60f67f)` {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:36:27.794106 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-174bab21-bf6a-4c86-b8fa-d2747091f358 None admin] RBAC: Authorization granted {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:36:27.796178 dv-cinder-851351-1-smb devstack@keystone.service[282898]: [pid: 282898|app: 0|req: 155/317] 10.222.0.42 () {56 vars in 1186 bytes} [Thu Jul 28 08:36:27 2022] GET /identity/v3/projects/305114c1888a404186311d18de60f67f => generated 302 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:36:27.802296 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8ec75f-5e58-47f3-9d5e-f1dd2f5c4945 None admin] Authenticating user token {{(pid=282899) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:36:27.915207 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8ec75f-5e58-47f3-9d5e-f1dd2f5c4945 None admin] Validating token access rules against request {{(pid=282899) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:36:27.952996 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ef37e9-d147-4acb-b256-22e9bb918160 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282899) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:36:27.954063 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ef37e9-d147-4acb-b256-22e9bb918160 None admin] REQUEST_METHOD: `GET` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:36:27.954936 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ef37e9-d147-4acb-b256-22e9bb918160 None admin] SCRIPT_NAME: `/identity` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:36:27.955456 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ef37e9-d147-4acb-b256-22e9bb918160 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:36:27.956481 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69ef37e9-d147-4acb-b256-22e9bb918160 None admin] RBAC: Adding query filter params (role.id=34c6ec459a944c46a4265d15a06e348d, scope.project.id=305114c1888a404186311d18de60f67f, user.id=eff961182252439e895cf4ef507802c4) {{(pid=282899) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:36:27.957139 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69ef37e9-d147-4acb-b256-22e9bb918160 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:36:27.958849 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69ef37e9-d147-4acb-b256-22e9bb918160 None admin] RBAC: Authorization granted {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:36:27.972814 dv-cinder-851351-1-smb devstack@keystone.service[282899]: [pid: 282899|app: 0|req: 163/318] 10.222.0.42 () {56 vars in 1374 bytes} [Thu Jul 28 08:36:27 2022] GET /identity/v3/role_assignments?user.id=eff961182252439e895cf4ef507802c4&scope.project.id=305114c1888a404186311d18de60f67f&role.id=34c6ec459a944c46a4265d15a06e348d => generated 608 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:36:28.280128 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8127a3-2f95-4740-b7f4-f29c7c4d537c None None] REQUEST_METHOD: `GET` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:36:28.280692 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8127a3-2f95-4740-b7f4-f29c7c4d537c None None] SCRIPT_NAME: `/identity` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:36:28.280692 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8127a3-2f95-4740-b7f4-f29c7c4d537c None None] PATH_INFO: `/` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:36:28.281978 dv-cinder-851351-1-smb devstack@keystone.service[282898]: [pid: 282898|app: 0|req: 156/319] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 08:36:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 08:36:28.287837 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85df1e77-5ec3-47da-9e4b-24792dc27ff6 None None] REQUEST_METHOD: `POST` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:36:28.288114 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85df1e77-5ec3-47da-9e4b-24792dc27ff6 None None] SCRIPT_NAME: `/identity` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:36:28.288405 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85df1e77-5ec3-47da-9e4b-24792dc27ff6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:36:28.307185 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.auth.core [None req-85df1e77-5ec3-47da-9e4b-24792dc27ff6 None None] MFA Rules not processed for user `2be990a66857410a87ffa7609aec4f7b`. Rule list: `[]` (Enabled: `True`). {{(pid=282899) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 08:36:28.308490 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.fernet_utils [None req-85df1e77-5ec3-47da-9e4b-24792dc27ff6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=282899) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:36:28.318857 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG dbcounter [-] [282899] Writing DB stats keystone:SELECT=100 {{(pid=282899) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:36:28.377079 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9983d2d-ca2c-4276-bf3d-e4b3c3fd58a4 None None] REQUEST_METHOD: `GET` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:36:28.377363 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9983d2d-ca2c-4276-bf3d-e4b3c3fd58a4 None None] SCRIPT_NAME: `/identity` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:36:28.377637 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9983d2d-ca2c-4276-bf3d-e4b3c3fd58a4 None None] PATH_INFO: `/` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:36:28.379165 dv-cinder-851351-1-smb devstack@keystone.service[282898]: [pid: 282898|app: 0|req: 157/320] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 08:36:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 08:36:28.385038 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b642f747-50fc-473a-a8a9-01cc8fa86957 None None] REQUEST_METHOD: `POST` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:36:28.385330 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b642f747-50fc-473a-a8a9-01cc8fa86957 None None] SCRIPT_NAME: `/identity` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:36:28.385603 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b642f747-50fc-473a-a8a9-01cc8fa86957 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:36:28.388624 dv-cinder-851351-1-smb devstack@keystone.service[282899]: [pid: 282899|app: 0|req: 164/321] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 08:36:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 08:36:28.409752 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.auth.core [None req-b642f747-50fc-473a-a8a9-01cc8fa86957 None None] MFA Rules not processed for user `2be990a66857410a87ffa7609aec4f7b`. Rule list: `[]` (Enabled: `True`). {{(pid=282898) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 08:36:28.411905 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.fernet_utils [None req-b642f747-50fc-473a-a8a9-01cc8fa86957 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=282898) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:36:28.412141 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85df1e77-5ec3-47da-9e4b-24792dc27ff6 None None] Authenticating user token {{(pid=282899) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:36:28.463541 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG dbcounter [-] [282898] Writing DB stats keystone:SELECT=100 {{(pid=282898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:36:28.495024 dv-cinder-851351-1-smb devstack@keystone.service[282898]: [pid: 282898|app: 0|req: 158/322] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 08:36:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 08:36:28.516633 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b642f747-50fc-473a-a8a9-01cc8fa86957 None None] Authenticating user token {{(pid=282898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:36:28.528941 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85df1e77-5ec3-47da-9e4b-24792dc27ff6 None None] Validating token access rules against request {{(pid=282899) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:36:28.567563 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41740532-43a0-4399-8baf-6cc3f8404a06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282899) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:36:28.568162 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41740532-43a0-4399-8baf-6cc3f8404a06 None admin] REQUEST_METHOD: `GET` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:36:28.568445 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41740532-43a0-4399-8baf-6cc3f8404a06 None admin] SCRIPT_NAME: `/identity` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:36:28.568760 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41740532-43a0-4399-8baf-6cc3f8404a06 None admin] PATH_INFO: `/v3/domains/default` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:36:28.570026 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41740532-43a0-4399-8baf-6cc3f8404a06 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:36:28.571530 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41740532-43a0-4399-8baf-6cc3f8404a06 None admin] RBAC: Authorization granted {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:36:28.573486 dv-cinder-851351-1-smb devstack@keystone.service[282899]: [pid: 282899|app: 0|req: 165/323] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 08:36:28 2022] GET /identity/v3/domains/default => generated 199 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 08:36:28.579046 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41740532-43a0-4399-8baf-6cc3f8404a06 None admin] Authenticating user token {{(pid=282899) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:36:28.596369 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG dbcounter [-] [282899] Writing DB stats keystone:SELECT=100 {{(pid=282899) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:36:28.634155 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b642f747-50fc-473a-a8a9-01cc8fa86957 None None] Validating token access rules against request {{(pid=282898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:36:28.677268 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54643db0-7436-47aa-8b38-537691720dfc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:36:28.678056 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54643db0-7436-47aa-8b38-537691720dfc None admin] REQUEST_METHOD: `GET` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:36:28.678332 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54643db0-7436-47aa-8b38-537691720dfc None admin] SCRIPT_NAME: `/identity` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:36:28.678601 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54643db0-7436-47aa-8b38-537691720dfc None admin] PATH_INFO: `/v3/roles/reader` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:36:28.690851 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54643db0-7436-47aa-8b38-537691720dfc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 08:36:28.696011 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application [None req-54643db0-7436-47aa-8b38-537691720dfc None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 28 08:36:28.696011 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:36:28.696011 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:36:28.696011 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:36:28.696011 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:36:28.696011 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:36:28.696011 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:36:28.696011 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:36:28.696011 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:36:28.696011 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:36:28.696011 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:36:28.696011 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:36:28.696011 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 08:36:28.696011 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 08:36:28.696011 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 08:36:28.696011 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 08:36:28.698616 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 08:36:28.698616 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 08:36:28.698616 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 08:36:28.698616 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 08:36:28.698616 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:36:28.698616 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:36:28.698616 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:36:28.698616 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:36:28.698616 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:36:28.698616 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:36:28.698616 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:36:28.698616 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application with Lock( Jul 28 08:36:28.698616 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:36:28.698616 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:36:28.698616 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:36:28.698616 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:36:28.701477 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:36:28.701477 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:36:28.701477 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:36:28.701477 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:36:28.701477 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 08:36:28.701477 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 08:36:28.701477 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 08:36:28.701477 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 08:36:28.701477 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 08:36:28.701477 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 08:36:28.701477 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 28 08:36:28.701477 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application Jul 28 08:36:28.701477 dv-cinder-851351-1-smb devstack@keystone.service[282898]: [pid: 282898|app: 0|req: 159/324] 10.222.0.42 () {56 vars in 1099 bytes} [Thu Jul 28 08:36:28 2022] GET /identity/v3/roles/reader => generated 84 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 08:36:28.705258 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54643db0-7436-47aa-8b38-537691720dfc None admin] Authenticating user token {{(pid=282898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:36:28.710094 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41740532-43a0-4399-8baf-6cc3f8404a06 None admin] Validating token access rules against request {{(pid=282899) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:36:28.743577 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG dbcounter [-] [282898] Writing DB stats keystone:SELECT=100 {{(pid=282898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:36:28.757014 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b4102e-ecba-4357-8bef-ba646ac048d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282899) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:36:28.757655 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b4102e-ecba-4357-8bef-ba646ac048d4 None admin] REQUEST_METHOD: `POST` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:36:28.757935 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b4102e-ecba-4357-8bef-ba646ac048d4 None admin] SCRIPT_NAME: `/identity` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:36:28.758208 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b4102e-ecba-4357-8bef-ba646ac048d4 None admin] PATH_INFO: `/v3/groups` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:36:28.758890 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19b4102e-ecba-4357-8bef-ba646ac048d4 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:36:28.760351 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19b4102e-ecba-4357-8bef-ba646ac048d4 None admin] RBAC: Authorization granted {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:36:28.779934 dv-cinder-851351-1-smb devstack@keystone.service[282899]: [pid: 282899|app: 0|req: 166/325] 10.222.0.42 () {60 vars in 1134 bytes} [Thu Jul 28 08:36:28 2022] POST /identity/v3/groups => generated 226 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 28 08:36:28.850077 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54643db0-7436-47aa-8b38-537691720dfc None admin] Validating token access rules against request {{(pid=282898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:36:28.890822 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc091fc-ce1b-4396-bbbe-87330dcf33c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:36:28.891521 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc091fc-ce1b-4396-bbbe-87330dcf33c5 None admin] REQUEST_METHOD: `GET` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:36:28.891940 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc091fc-ce1b-4396-bbbe-87330dcf33c5 None admin] SCRIPT_NAME: `/identity` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:36:28.892067 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc091fc-ce1b-4396-bbbe-87330dcf33c5 None admin] PATH_INFO: `/v3/roles` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:36:28.892867 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dc091fc-ce1b-4396-bbbe-87330dcf33c5 None admin] RBAC: Adding query filter params (name=reader) {{(pid=282898) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:36:28.893176 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dc091fc-ce1b-4396-bbbe-87330dcf33c5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:36:28.894649 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dc091fc-ce1b-4396-bbbe-87330dcf33c5 None admin] RBAC: Authorization granted {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:36:28.904772 dv-cinder-851351-1-smb devstack@keystone.service[282898]: [pid: 282898|app: 0|req: 160/326] 10.222.0.42 () {56 vars in 1101 bytes} [Thu Jul 28 08:36:28 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 08:36:28.910639 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b4102e-ecba-4357-8bef-ba646ac048d4 None admin] Authenticating user token {{(pid=282899) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:36:28.971821 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f9940b-9374-4e39-9a40-3a71eea49a0e None None] REQUEST_METHOD: `GET` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:36:28.972161 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f9940b-9374-4e39-9a40-3a71eea49a0e None None] SCRIPT_NAME: `/identity` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:36:28.972470 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f9940b-9374-4e39-9a40-3a71eea49a0e None None] PATH_INFO: `/` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:36:28.974481 dv-cinder-851351-1-smb devstack@keystone.service[282898]: [pid: 282898|app: 0|req: 161/327] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 08:36:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 28 08:36:28.980431 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4811f9a9-2b23-441f-a5ca-8b708df3b7c8 None None] REQUEST_METHOD: `POST` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:36:28.980771 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4811f9a9-2b23-441f-a5ca-8b708df3b7c8 None None] SCRIPT_NAME: `/identity` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:36:28.981024 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4811f9a9-2b23-441f-a5ca-8b708df3b7c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:36:29.000219 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG dbcounter [-] [282899] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=282899) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:36:29.003220 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.auth.core [None req-4811f9a9-2b23-441f-a5ca-8b708df3b7c8 None None] MFA Rules not processed for user `2be990a66857410a87ffa7609aec4f7b`. Rule list: `[]` (Enabled: `True`). {{(pid=282898) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 08:36:29.004508 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.fernet_utils [None req-4811f9a9-2b23-441f-a5ca-8b708df3b7c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=282898) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:36:29.037252 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b4102e-ecba-4357-8bef-ba646ac048d4 None admin] Validating token access rules against request {{(pid=282899) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:36:29.080324 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3cd030b-6f54-44b3-ac1b-f7cc9aaebe40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282899) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:36:29.081125 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3cd030b-6f54-44b3-ac1b-f7cc9aaebe40 None admin] REQUEST_METHOD: `GET` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:36:29.081407 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3cd030b-6f54-44b3-ac1b-f7cc9aaebe40 None admin] SCRIPT_NAME: `/identity` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:36:29.081745 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3cd030b-6f54-44b3-ac1b-f7cc9aaebe40 None admin] PATH_INFO: `/v3/users/0f43fc4793db4630b3e45a5928ede2eb` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:36:29.082946 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3cd030b-6f54-44b3-ac1b-f7cc9aaebe40 None admin] RBAC: Authorizing `identity:get_user(user_id=0f43fc4793db4630b3e45a5928ede2eb)` {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:36:29.084417 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3cd030b-6f54-44b3-ac1b-f7cc9aaebe40 None admin] RBAC: Authorization granted {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:36:29.086179 dv-cinder-851351-1-smb devstack@keystone.service[282899]: [pid: 282899|app: 0|req: 167/328] 10.222.0.42 () {56 vars in 1177 bytes} [Thu Jul 28 08:36:28 2022] GET /identity/v3/users/0f43fc4793db4630b3e45a5928ede2eb => generated 293 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:36:29.093952 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3cd030b-6f54-44b3-ac1b-f7cc9aaebe40 None admin] Authenticating user token {{(pid=282899) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:36:29.096009 dv-cinder-851351-1-smb devstack@keystone.service[282898]: [pid: 282898|app: 0|req: 162/329] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 08:36:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 08:36:29.123447 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4811f9a9-2b23-441f-a5ca-8b708df3b7c8 None None] Authenticating user token {{(pid=282898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:36:29.154765 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG dbcounter [-] [282898] Writing DB stats keystone:SELECT=100 {{(pid=282898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:36:29.231201 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3cd030b-6f54-44b3-ac1b-f7cc9aaebe40 None admin] Validating token access rules against request {{(pid=282899) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:36:29.253777 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4811f9a9-2b23-441f-a5ca-8b708df3b7c8 None None] Validating token access rules against request {{(pid=282898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:36:29.283066 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea80276f-5fac-4c1a-824a-f20e0058da32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282899) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:36:29.284070 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea80276f-5fac-4c1a-824a-f20e0058da32 None admin] REQUEST_METHOD: `PUT` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:36:29.284364 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea80276f-5fac-4c1a-824a-f20e0058da32 None admin] SCRIPT_NAME: `/identity` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:36:29.284649 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea80276f-5fac-4c1a-824a-f20e0058da32 None admin] PATH_INFO: `/v3/system/users/0f43fc4793db4630b3e45a5928ede2eb/roles/34c6ec459a944c46a4265d15a06e348d` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:36:29.287229 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea80276f-5fac-4c1a-824a-f20e0058da32 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=0f43fc4793db4630b3e45a5928ede2eb, role_id=34c6ec459a944c46a4265d15a06e348d)` {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:36:29.289084 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea80276f-5fac-4c1a-824a-f20e0058da32 None admin] RBAC: Authorization granted {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:36:29.299358 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ddd391b-1d52-4738-aaec-40e42a1a7b92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:36:29.300098 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ddd391b-1d52-4738-aaec-40e42a1a7b92 None admin] REQUEST_METHOD: `GET` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:36:29.300468 dv-cinder-851351-1-smb devstack@keystone.service[282899]: [pid: 282899|app: 0|req: 168/330] 10.222.0.42 () {58 vars in 1334 bytes} [Thu Jul 28 08:36:29 2022] PUT /identity/v3/system/users/0f43fc4793db4630b3e45a5928ede2eb/roles/34c6ec459a944c46a4265d15a06e348d => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 08:36:29.300705 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ddd391b-1d52-4738-aaec-40e42a1a7b92 None admin] SCRIPT_NAME: `/identity` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:36:29.301011 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ddd391b-1d52-4738-aaec-40e42a1a7b92 None admin] PATH_INFO: `/v3/roles/member` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:36:29.315234 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ddd391b-1d52-4738-aaec-40e42a1a7b92 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 08:36:29.320985 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application [None req-9ddd391b-1d52-4738-aaec-40e42a1a7b92 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 28 08:36:29.320985 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:36:29.320985 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:36:29.320985 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:36:29.320985 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:36:29.320985 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:36:29.320985 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:36:29.320985 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:36:29.320985 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:36:29.320985 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:36:29.320985 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:36:29.320985 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:36:29.320985 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 08:36:29.320985 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 08:36:29.320985 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 08:36:29.320985 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 08:36:29.322292 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 08:36:29.322292 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 08:36:29.322292 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 08:36:29.322292 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 08:36:29.322292 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:36:29.322292 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:36:29.322292 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:36:29.322292 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:36:29.322292 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:36:29.322292 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:36:29.322292 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:36:29.322292 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application with Lock( Jul 28 08:36:29.322292 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:36:29.322292 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:36:29.322292 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:36:29.322292 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:36:29.323291 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:36:29.323291 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:36:29.323291 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:36:29.323291 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:36:29.323291 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 08:36:29.323291 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 08:36:29.323291 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 08:36:29.323291 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 08:36:29.323291 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 08:36:29.323291 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 08:36:29.323291 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 28 08:36:29.323291 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application Jul 28 08:36:29.323291 dv-cinder-851351-1-smb devstack@keystone.service[282898]: [pid: 282898|app: 0|req: 163/331] 10.222.0.42 () {56 vars in 1099 bytes} [Thu Jul 28 08:36:29 2022] GET /identity/v3/roles/member => generated 84 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 08:36:29.328619 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea80276f-5fac-4c1a-824a-f20e0058da32 None admin] Authenticating user token {{(pid=282899) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:36:29.342855 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG dbcounter [-] [282899] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=282899) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:36:29.453968 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea80276f-5fac-4c1a-824a-f20e0058da32 None admin] Validating token access rules against request {{(pid=282899) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:36:29.495848 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cfd58b5-e0a7-4185-8cbe-fe703cc9c77f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282899) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:36:29.496504 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cfd58b5-e0a7-4185-8cbe-fe703cc9c77f None admin] REQUEST_METHOD: `GET` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:36:29.496817 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cfd58b5-e0a7-4185-8cbe-fe703cc9c77f None admin] SCRIPT_NAME: `/identity` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:36:29.497097 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cfd58b5-e0a7-4185-8cbe-fe703cc9c77f None admin] PATH_INFO: `/v3/roles` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:36:29.497864 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cfd58b5-e0a7-4185-8cbe-fe703cc9c77f None admin] RBAC: Adding query filter params (name=member) {{(pid=282899) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:36:29.498177 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cfd58b5-e0a7-4185-8cbe-fe703cc9c77f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:36:29.499643 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cfd58b5-e0a7-4185-8cbe-fe703cc9c77f None admin] RBAC: Authorization granted {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:36:29.510172 dv-cinder-851351-1-smb devstack@keystone.service[282899]: [pid: 282899|app: 0|req: 169/332] 10.222.0.42 () {56 vars in 1101 bytes} [Thu Jul 28 08:36:29 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:36:29.516169 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ddd391b-1d52-4738-aaec-40e42a1a7b92 None admin] Authenticating user token {{(pid=282898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:36:29.624372 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG dbcounter [-] [282898] Writing DB stats keystone:SELECT=100 {{(pid=282898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:36:29.640439 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ddd391b-1d52-4738-aaec-40e42a1a7b92 None admin] Validating token access rules against request {{(pid=282898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:36:29.681266 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b78e82db-8145-4ba1-8ebb-c46d8e841fd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:36:29.681936 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78e82db-8145-4ba1-8ebb-c46d8e841fd0 None admin] REQUEST_METHOD: `GET` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:36:29.682218 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78e82db-8145-4ba1-8ebb-c46d8e841fd0 None admin] SCRIPT_NAME: `/identity` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:36:29.682567 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78e82db-8145-4ba1-8ebb-c46d8e841fd0 None admin] PATH_INFO: `/v3/users/9d3500196c1b4304b23df2b21d23f28f` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:36:29.684882 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b78e82db-8145-4ba1-8ebb-c46d8e841fd0 None admin] RBAC: Authorizing `identity:get_user(user_id=9d3500196c1b4304b23df2b21d23f28f)` {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:36:29.686479 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b78e82db-8145-4ba1-8ebb-c46d8e841fd0 None admin] RBAC: Authorization granted {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:36:29.688647 dv-cinder-851351-1-smb devstack@keystone.service[282898]: [pid: 282898|app: 0|req: 164/333] 10.222.0.42 () {56 vars in 1177 bytes} [Thu Jul 28 08:36:29 2022] GET /identity/v3/users/9d3500196c1b4304b23df2b21d23f28f => generated 293 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:36:29.695040 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cfd58b5-e0a7-4185-8cbe-fe703cc9c77f None admin] Authenticating user token {{(pid=282899) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:36:29.774388 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG dbcounter [-] [282899] Writing DB stats keystone:SELECT=100 {{(pid=282899) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:36:29.815258 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cfd58b5-e0a7-4185-8cbe-fe703cc9c77f None admin] Validating token access rules against request {{(pid=282899) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:36:29.853144 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a8f85e3-e538-4d6b-8bc1-62b114316f81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282899) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:36:29.855076 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8f85e3-e538-4d6b-8bc1-62b114316f81 None admin] REQUEST_METHOD: `GET` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:36:29.855361 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8f85e3-e538-4d6b-8bc1-62b114316f81 None admin] SCRIPT_NAME: `/identity` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:36:29.855643 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8f85e3-e538-4d6b-8bc1-62b114316f81 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:36:29.856482 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a8f85e3-e538-4d6b-8bc1-62b114316f81 None admin] RBAC: Adding query filter params (role.id=eaeb4674b16f497f8afb3384e7e9a3c6, user.id=9d3500196c1b4304b23df2b21d23f28f, scope.system=all) {{(pid=282899) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:36:29.856840 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a8f85e3-e538-4d6b-8bc1-62b114316f81 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:36:29.858370 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a8f85e3-e538-4d6b-8bc1-62b114316f81 None admin] RBAC: Authorization granted {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:36:29.875023 dv-cinder-851351-1-smb devstack@keystone.service[282899]: [pid: 282899|app: 0|req: 170/334] 10.222.0.42 () {56 vars in 1308 bytes} [Thu Jul 28 08:36:29 2022] GET /identity/v3/role_assignments?user.id=9d3500196c1b4304b23df2b21d23f28f&scope.system=all&role.id=eaeb4674b16f497f8afb3384e7e9a3c6 => generated 510 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:36:31.322296 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3417b1-afb9-45da-a30d-b2f05ce447be None None] REQUEST_METHOD: `GET` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:36:31.322870 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3417b1-afb9-45da-a30d-b2f05ce447be None None] SCRIPT_NAME: `/identity` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:36:31.322870 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3417b1-afb9-45da-a30d-b2f05ce447be None None] PATH_INFO: `/` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:36:31.324501 dv-cinder-851351-1-smb devstack@keystone.service[282898]: [pid: 282898|app: 0|req: 165/335] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 08:36:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 08:36:31.338716 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e8bda4-e3a0-47ee-943e-bfa87327df62 None None] REQUEST_METHOD: `POST` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:36:31.339288 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e8bda4-e3a0-47ee-943e-bfa87327df62 None None] SCRIPT_NAME: `/identity` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:36:31.339288 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e8bda4-e3a0-47ee-943e-bfa87327df62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:36:31.364627 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.auth.core [None req-c6e8bda4-e3a0-47ee-943e-bfa87327df62 None None] MFA Rules not processed for user `2be990a66857410a87ffa7609aec4f7b`. Rule list: `[]` (Enabled: `True`). {{(pid=282899) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 08:36:31.365892 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.fernet_utils [None req-c6e8bda4-e3a0-47ee-943e-bfa87327df62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=282899) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:36:31.462897 dv-cinder-851351-1-smb devstack@keystone.service[282899]: [pid: 282899|app: 0|req: 171/336] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 08:36:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 08:36:31.497188 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3417b1-afb9-45da-a30d-b2f05ce447be None None] Authenticating user token {{(pid=282898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:36:31.637392 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3417b1-afb9-45da-a30d-b2f05ce447be None None] Validating token access rules against request {{(pid=282898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:36:31.677262 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d37429a-8660-49e3-98cd-6b4720ec1cd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:36:31.677928 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d37429a-8660-49e3-98cd-6b4720ec1cd0 None admin] REQUEST_METHOD: `GET` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:36:31.678210 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d37429a-8660-49e3-98cd-6b4720ec1cd0 None admin] SCRIPT_NAME: `/identity` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:36:31.678482 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d37429a-8660-49e3-98cd-6b4720ec1cd0 None admin] PATH_INFO: `/v3/roles/member` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:36:31.696166 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d37429a-8660-49e3-98cd-6b4720ec1cd0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 08:36:31.701241 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application [None req-5d37429a-8660-49e3-98cd-6b4720ec1cd0 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 28 08:36:31.701241 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:36:31.701241 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:36:31.701241 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:36:31.701241 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:36:31.701241 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:36:31.701241 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:36:31.701241 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:36:31.701241 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:36:31.701241 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:36:31.701241 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:36:31.701241 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:36:31.701241 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 08:36:31.701241 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 08:36:31.701241 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 08:36:31.701241 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 08:36:31.702425 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 08:36:31.702425 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 08:36:31.702425 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 08:36:31.702425 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 08:36:31.702425 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:36:31.702425 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:36:31.702425 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:36:31.702425 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:36:31.702425 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:36:31.702425 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:36:31.702425 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:36:31.702425 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application with Lock( Jul 28 08:36:31.702425 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:36:31.702425 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:36:31.702425 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:36:31.702425 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:36:31.703480 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:36:31.703480 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:36:31.703480 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:36:31.703480 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:36:31.703480 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 08:36:31.703480 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 08:36:31.703480 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 08:36:31.703480 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 08:36:31.703480 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 08:36:31.703480 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 08:36:31.703480 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 28 08:36:31.703480 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application Jul 28 08:36:31.703480 dv-cinder-851351-1-smb devstack@keystone.service[282898]: [pid: 282898|app: 0|req: 166/337] 10.222.0.42 () {56 vars in 1099 bytes} [Thu Jul 28 08:36:31 2022] GET /identity/v3/roles/member => generated 84 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:36:31.709162 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e8bda4-e3a0-47ee-943e-bfa87327df62 None None] Authenticating user token {{(pid=282899) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:36:31.803775 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG dbcounter [-] [282899] Writing DB stats keystone:SELECT=100 {{(pid=282899) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:36:31.866969 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e8bda4-e3a0-47ee-943e-bfa87327df62 None None] Validating token access rules against request {{(pid=282899) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:36:31.910807 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b45f9d0-3c96-4cfd-a2a9-b4ff35e58ceb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282899) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:36:31.911380 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b45f9d0-3c96-4cfd-a2a9-b4ff35e58ceb None admin] REQUEST_METHOD: `GET` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:36:31.911672 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b45f9d0-3c96-4cfd-a2a9-b4ff35e58ceb None admin] SCRIPT_NAME: `/identity` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:36:31.911954 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b45f9d0-3c96-4cfd-a2a9-b4ff35e58ceb None admin] PATH_INFO: `/v3/roles` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:36:31.912728 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b45f9d0-3c96-4cfd-a2a9-b4ff35e58ceb None admin] RBAC: Adding query filter params (name=member) {{(pid=282899) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:36:31.913047 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b45f9d0-3c96-4cfd-a2a9-b4ff35e58ceb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:36:31.914460 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b45f9d0-3c96-4cfd-a2a9-b4ff35e58ceb None admin] RBAC: Authorization granted {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:36:31.928332 dv-cinder-851351-1-smb devstack@keystone.service[282899]: [pid: 282899|app: 0|req: 172/338] 10.222.0.42 () {56 vars in 1101 bytes} [Thu Jul 28 08:36:31 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:36:31.933874 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d37429a-8660-49e3-98cd-6b4720ec1cd0 None admin] Authenticating user token {{(pid=282898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:36:31.971569 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG dbcounter [-] [282898] Writing DB stats keystone:SELECT=100 {{(pid=282898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:36:32.074706 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1939e9a-1856-4f11-969c-08c332fe3372 None None] REQUEST_METHOD: `GET` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:36:32.075404 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1939e9a-1856-4f11-969c-08c332fe3372 None None] SCRIPT_NAME: `/identity` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:36:32.075918 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1939e9a-1856-4f11-969c-08c332fe3372 None None] PATH_INFO: `/` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:36:32.081346 dv-cinder-851351-1-smb devstack@keystone.service[282899]: [pid: 282899|app: 0|req: 173/339] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 08:36:32 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 08:36:32.083934 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a1c268-dcb3-4ac1-b5a0-fb54d2f5e871 None None] REQUEST_METHOD: `POST` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:36:32.084465 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a1c268-dcb3-4ac1-b5a0-fb54d2f5e871 None None] SCRIPT_NAME: `/identity` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:36:32.085405 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a1c268-dcb3-4ac1-b5a0-fb54d2f5e871 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:36:32.122198 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.auth.core [None req-25a1c268-dcb3-4ac1-b5a0-fb54d2f5e871 None None] MFA Rules not processed for user `2be990a66857410a87ffa7609aec4f7b`. Rule list: `[]` (Enabled: `True`). {{(pid=282899) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 08:36:32.124229 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.fernet_utils [None req-25a1c268-dcb3-4ac1-b5a0-fb54d2f5e871 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=282899) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:36:32.139982 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d37429a-8660-49e3-98cd-6b4720ec1cd0 None admin] Validating token access rules against request {{(pid=282898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:36:32.223764 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4452fbe-94e8-451e-abb5-8e2117bed2c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:36:32.224816 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4452fbe-94e8-451e-abb5-8e2117bed2c0 None admin] REQUEST_METHOD: `GET` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:36:32.225352 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4452fbe-94e8-451e-abb5-8e2117bed2c0 None admin] SCRIPT_NAME: `/identity` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:36:32.225855 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4452fbe-94e8-451e-abb5-8e2117bed2c0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:36:32.256614 dv-cinder-851351-1-smb devstack@keystone.service[282899]: [pid: 282899|app: 0|req: 174/340] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 08:36:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 08:36:32.293824 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a1c268-dcb3-4ac1-b5a0-fb54d2f5e871 None None] Authenticating user token {{(pid=282899) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:36:32.364697 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG dbcounter [-] [282899] Writing DB stats keystone:SELECT=100 {{(pid=282899) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:36:32.382662 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4452fbe-94e8-451e-abb5-8e2117bed2c0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:36:32.384201 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4452fbe-94e8-451e-abb5-8e2117bed2c0 None admin] RBAC: Authorization granted {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:36:32.413485 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG dbcounter [-] [282898] Writing DB stats keystone:SELECT=100 {{(pid=282898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:36:32.474415 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a1c268-dcb3-4ac1-b5a0-fb54d2f5e871 None None] Validating token access rules against request {{(pid=282899) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:36:32.541784 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-636a9972-8ef9-4ad7-95b2-e768fd126869 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282899) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:36:32.542462 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636a9972-8ef9-4ad7-95b2-e768fd126869 None admin] REQUEST_METHOD: `GET` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:36:32.542742 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636a9972-8ef9-4ad7-95b2-e768fd126869 None admin] SCRIPT_NAME: `/identity` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:36:32.543020 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636a9972-8ef9-4ad7-95b2-e768fd126869 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:36:32.560900 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-636a9972-8ef9-4ad7-95b2-e768fd126869 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 08:36:32.572835 dv-cinder-851351-1-smb devstack@keystone.service[282898]: [pid: 282898|app: 0|req: 167/341] 10.222.0.42 () {58 vars in 1282 bytes} [Thu Jul 28 08:36:31 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 639 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 28 08:36:32.574244 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d283734-4504-4413-89d2-e9f87c31a9e4 None None] REQUEST_METHOD: `GET` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:36:32.574538 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d283734-4504-4413-89d2-e9f87c31a9e4 None None] SCRIPT_NAME: `/identity` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:36:32.574820 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d283734-4504-4413-89d2-e9f87c31a9e4 None None] PATH_INFO: `/` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:36:32.574931 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application [None req-636a9972-8ef9-4ad7-95b2-e768fd126869 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 28 08:36:32.574931 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:36:32.574931 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:36:32.574931 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:36:32.574931 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:36:32.574931 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:36:32.574931 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:36:32.574931 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:36:32.574931 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:36:32.574931 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:36:32.574931 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:36:32.574931 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:36:32.574931 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 08:36:32.574931 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 08:36:32.574931 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 08:36:32.574931 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 08:36:32.575931 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 08:36:32.575931 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 08:36:32.575931 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 08:36:32.575931 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 08:36:32.575931 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:36:32.575931 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:36:32.575931 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:36:32.575931 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:36:32.575931 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:36:32.575931 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:36:32.575931 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:36:32.575931 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application with Lock( Jul 28 08:36:32.575931 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:36:32.575931 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:36:32.575931 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:36:32.575931 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:36:32.577409 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:36:32.577409 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:36:32.577409 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:36:32.577409 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:36:32.577409 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 08:36:32.577409 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 08:36:32.577409 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 08:36:32.577409 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 08:36:32.577409 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 08:36:32.577409 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 08:36:32.577409 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 28 08:36:32.577409 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application Jul 28 08:36:32.577409 dv-cinder-851351-1-smb devstack@keystone.service[282899]: [pid: 282899|app: 0|req: 175/343] 10.222.0.42 () {56 vars in 1099 bytes} [Thu Jul 28 08:36:32 2022] GET /identity/v3/roles/reader => generated 84 bytes in 283 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:36:32.578735 dv-cinder-851351-1-smb devstack@keystone.service[282898]: [pid: 282898|app: 0|req: 168/343] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 08:36:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 08:36:32.580930 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-636a9972-8ef9-4ad7-95b2-e768fd126869 None admin] Authenticating user token {{(pid=282899) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:36:32.582795 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd96ee39-0947-4952-b0a3-5256ffb4a188 None None] REQUEST_METHOD: `POST` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:36:32.583086 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd96ee39-0947-4952-b0a3-5256ffb4a188 None None] SCRIPT_NAME: `/identity` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:36:32.583357 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd96ee39-0947-4952-b0a3-5256ffb4a188 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:36:32.608855 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.auth.core [None req-dd96ee39-0947-4952-b0a3-5256ffb4a188 None None] MFA Rules not processed for user `2be990a66857410a87ffa7609aec4f7b`. Rule list: `[]` (Enabled: `True`). {{(pid=282898) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 08:36:32.610089 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.fernet_utils [None req-dd96ee39-0947-4952-b0a3-5256ffb4a188 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=282898) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:36:32.692311 dv-cinder-851351-1-smb devstack@keystone.service[282898]: [pid: 282898|app: 0|req: 169/344] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 08:36:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 28 08:36:32.693234 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd96ee39-0947-4952-b0a3-5256ffb4a188 None None] Authenticating user token {{(pid=282898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:36:32.716881 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-636a9972-8ef9-4ad7-95b2-e768fd126869 None admin] Validating token access rules against request {{(pid=282899) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:36:32.730292 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG dbcounter [-] [282899] Writing DB stats keystone:SELECT=100 {{(pid=282899) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:36:32.750300 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG dbcounter [-] [282898] Writing DB stats keystone:SELECT=100 {{(pid=282898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:36:32.769203 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c240748-9863-45fa-9961-d33a1d38887c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282899) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:36:32.770282 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c240748-9863-45fa-9961-d33a1d38887c None admin] REQUEST_METHOD: `GET` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:36:32.771082 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c240748-9863-45fa-9961-d33a1d38887c None admin] SCRIPT_NAME: `/identity` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:36:32.771824 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c240748-9863-45fa-9961-d33a1d38887c None admin] PATH_INFO: `/v3/projects/c089873b22dd43e8a9de1c83b1355842` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:36:32.773316 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c240748-9863-45fa-9961-d33a1d38887c None admin] RBAC: Authorizing `identity:get_project(project_id=c089873b22dd43e8a9de1c83b1355842)` {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:36:32.775207 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c240748-9863-45fa-9961-d33a1d38887c None admin] RBAC: Authorization granted {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:36:32.782761 dv-cinder-851351-1-smb devstack@keystone.service[282899]: [pid: 282899|app: 0|req: 176/345] 10.222.0.42 () {56 vars in 1186 bytes} [Thu Jul 28 08:36:32 2022] GET /identity/v3/projects/c089873b22dd43e8a9de1c83b1355842 => generated 298 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:36:32.785105 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59a5976-ef32-4386-9c30-2594bd9da68d None None] REQUEST_METHOD: `GET` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:36:32.785396 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59a5976-ef32-4386-9c30-2594bd9da68d None None] SCRIPT_NAME: `/identity` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:36:32.785687 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59a5976-ef32-4386-9c30-2594bd9da68d None None] PATH_INFO: `/` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:36:32.787234 dv-cinder-851351-1-smb devstack@keystone.service[282899]: [pid: 282899|app: 0|req: 177/346] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 08:36:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 08:36:32.787803 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e59a5976-ef32-4386-9c30-2594bd9da68d None None] Authenticating user token {{(pid=282899) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:36:32.835283 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd96ee39-0947-4952-b0a3-5256ffb4a188 None None] Validating token access rules against request {{(pid=282898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:36:32.875112 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d30c5ca5-49c8-4594-8891-92aee96ad00c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:36:32.876266 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30c5ca5-49c8-4594-8891-92aee96ad00c None admin] REQUEST_METHOD: `GET` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:36:32.876848 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30c5ca5-49c8-4594-8891-92aee96ad00c None admin] SCRIPT_NAME: `/identity` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:36:32.877362 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30c5ca5-49c8-4594-8891-92aee96ad00c None admin] PATH_INFO: `/v3/roles` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:36:32.878318 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d30c5ca5-49c8-4594-8891-92aee96ad00c None admin] RBAC: Adding query filter params (name=reader) {{(pid=282898) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:36:32.878931 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d30c5ca5-49c8-4594-8891-92aee96ad00c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:36:32.880602 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d30c5ca5-49c8-4594-8891-92aee96ad00c None admin] RBAC: Authorization granted {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:36:32.890592 dv-cinder-851351-1-smb devstack@keystone.service[282898]: [pid: 282898|app: 0|req: 170/347] 10.222.0.42 () {56 vars in 1101 bytes} [Thu Jul 28 08:36:32 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:36:32.892065 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d30c5ca5-49c8-4594-8891-92aee96ad00c None admin] Authenticating user token {{(pid=282898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:36:32.912270 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e59a5976-ef32-4386-9c30-2594bd9da68d None None] Validating token access rules against request {{(pid=282899) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:36:32.950217 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd07a2de-5d49-45d8-88cc-823c2a548127 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282899) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:36:32.951042 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd07a2de-5d49-45d8-88cc-823c2a548127 None admin] REQUEST_METHOD: `GET` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:36:32.951334 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd07a2de-5d49-45d8-88cc-823c2a548127 None admin] SCRIPT_NAME: `/identity` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:36:32.951616 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd07a2de-5d49-45d8-88cc-823c2a548127 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:36:32.963754 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd07a2de-5d49-45d8-88cc-823c2a548127 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 08:36:32.970299 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application [None req-dd07a2de-5d49-45d8-88cc-823c2a548127 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 28 08:36:32.970299 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:36:32.970299 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:36:32.970299 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:36:32.970299 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:36:32.970299 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:36:32.970299 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:36:32.970299 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:36:32.970299 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:36:32.970299 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:36:32.970299 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:36:32.970299 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:36:32.970299 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 08:36:32.970299 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 08:36:32.970299 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 08:36:32.970299 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 08:36:32.971393 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 08:36:32.971393 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 08:36:32.971393 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 08:36:32.971393 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 08:36:32.971393 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:36:32.971393 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:36:32.971393 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:36:32.971393 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:36:32.971393 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:36:32.971393 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:36:32.971393 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:36:32.971393 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application with Lock( Jul 28 08:36:32.971393 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:36:32.971393 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:36:32.971393 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:36:32.971393 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:36:32.973042 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:36:32.973042 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:36:32.973042 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:36:32.973042 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:36:32.973042 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 08:36:32.973042 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 08:36:32.973042 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 08:36:32.973042 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 08:36:32.973042 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 08:36:32.973042 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 08:36:32.973042 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 28 08:36:32.973042 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application Jul 28 08:36:32.973042 dv-cinder-851351-1-smb devstack@keystone.service[282899]: [pid: 282899|app: 0|req: 178/348] 10.222.0.42 () {56 vars in 1114 bytes} [Thu Jul 28 08:36:32 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:36:32.973857 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e086cb8e-8e20-4a9c-b016-70c9eecfa23f None None] REQUEST_METHOD: `POST` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:36:32.973857 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e086cb8e-8e20-4a9c-b016-70c9eecfa23f None None] SCRIPT_NAME: `/identity` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:36:32.973857 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e086cb8e-8e20-4a9c-b016-70c9eecfa23f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:36:32.994465 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.auth.core [None req-e086cb8e-8e20-4a9c-b016-70c9eecfa23f None None] MFA Rules not processed for user `2be990a66857410a87ffa7609aec4f7b`. Rule list: `[]` (Enabled: `True`). {{(pid=282899) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 08:36:32.995618 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.fernet_utils [None req-e086cb8e-8e20-4a9c-b016-70c9eecfa23f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=282899) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:36:33.010588 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d30c5ca5-49c8-4594-8891-92aee96ad00c None admin] Validating token access rules against request {{(pid=282898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:36:33.021494 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG dbcounter [-] [282898] Writing DB stats keystone:SELECT=100 {{(pid=282898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:36:33.031847 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG dbcounter [-] [282899] Writing DB stats keystone:SELECT=100 {{(pid=282899) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:36:33.054272 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66fea391-b3ba-47ad-be9e-076f8e46d9ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:36:33.055416 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66fea391-b3ba-47ad-be9e-076f8e46d9ca None admin] REQUEST_METHOD: `GET` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:36:33.056040 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66fea391-b3ba-47ad-be9e-076f8e46d9ca None admin] SCRIPT_NAME: `/identity` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:36:33.056554 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66fea391-b3ba-47ad-be9e-076f8e46d9ca None admin] PATH_INFO: `/v3/groups/020da76b12ff4fd9bbcc6cfc67cc96f2` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:36:33.065048 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66fea391-b3ba-47ad-be9e-076f8e46d9ca None admin] RBAC: Authorizing `identity:get_group(group_id=020da76b12ff4fd9bbcc6cfc67cc96f2)` {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:36:33.066979 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66fea391-b3ba-47ad-be9e-076f8e46d9ca None admin] RBAC: Authorization granted {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:36:33.069149 dv-cinder-851351-1-smb devstack@keystone.service[282898]: [pid: 282898|app: 0|req: 171/349] 10.222.0.42 () {56 vars in 1180 bytes} [Thu Jul 28 08:36:32 2022] GET /identity/v3/groups/020da76b12ff4fd9bbcc6cfc67cc96f2 => generated 226 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:36:33.070263 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66fea391-b3ba-47ad-be9e-076f8e46d9ca None admin] Authenticating user token {{(pid=282898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:36:33.091153 dv-cinder-851351-1-smb devstack@keystone.service[282899]: [pid: 282899|app: 0|req: 179/350] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 08:36:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 08:36:33.092144 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e086cb8e-8e20-4a9c-b016-70c9eecfa23f None None] Authenticating user token {{(pid=282899) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:36:33.188441 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66fea391-b3ba-47ad-be9e-076f8e46d9ca None admin] Validating token access rules against request {{(pid=282898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:36:33.234852 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7bd30a3-64e6-47c7-81b1-54ec507d1e8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:36:33.235771 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7bd30a3-64e6-47c7-81b1-54ec507d1e8a None admin] REQUEST_METHOD: `GET` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:36:33.235771 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7bd30a3-64e6-47c7-81b1-54ec507d1e8a None admin] SCRIPT_NAME: `/identity` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:36:33.236048 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7bd30a3-64e6-47c7-81b1-54ec507d1e8a None admin] PATH_INFO: `/v3/users/0f43fc4793db4630b3e45a5928ede2eb` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:36:33.237281 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7bd30a3-64e6-47c7-81b1-54ec507d1e8a None admin] RBAC: Authorizing `identity:get_user(user_id=0f43fc4793db4630b3e45a5928ede2eb)` {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:36:33.238810 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e086cb8e-8e20-4a9c-b016-70c9eecfa23f None None] Validating token access rules against request {{(pid=282899) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:36:33.238946 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7bd30a3-64e6-47c7-81b1-54ec507d1e8a None admin] RBAC: Authorization granted {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:36:33.245591 dv-cinder-851351-1-smb devstack@keystone.service[282898]: [pid: 282898|app: 0|req: 172/351] 10.222.0.42 () {56 vars in 1177 bytes} [Thu Jul 28 08:36:33 2022] GET /identity/v3/users/0f43fc4793db4630b3e45a5928ede2eb => generated 293 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:36:33.246441 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7bd30a3-64e6-47c7-81b1-54ec507d1e8a None admin] Authenticating user token {{(pid=282898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:36:33.283731 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c10d86-a2b9-4aa5-bee0-68a26c46b55f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282899) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:36:33.284991 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c10d86-a2b9-4aa5-bee0-68a26c46b55f None admin] REQUEST_METHOD: `GET` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:36:33.285503 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c10d86-a2b9-4aa5-bee0-68a26c46b55f None admin] SCRIPT_NAME: `/identity` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:36:33.285842 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c10d86-a2b9-4aa5-bee0-68a26c46b55f None admin] PATH_INFO: `/v3/roles` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:36:33.286662 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9c10d86-a2b9-4aa5-bee0-68a26c46b55f None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=282899) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:36:33.287043 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9c10d86-a2b9-4aa5-bee0-68a26c46b55f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:36:33.288553 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9c10d86-a2b9-4aa5-bee0-68a26c46b55f None admin] RBAC: Authorization granted {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:36:33.299577 dv-cinder-851351-1-smb devstack@keystone.service[282899]: [pid: 282899|app: 0|req: 180/352] 10.222.0.42 () {56 vars in 1111 bytes} [Thu Jul 28 08:36:33 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:36:33.300592 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c10d86-a2b9-4aa5-bee0-68a26c46b55f None admin] Authenticating user token {{(pid=282899) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:36:33.302503 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG dbcounter [-] [282898] Writing DB stats keystone:SELECT=100 {{(pid=282898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:36:33.337085 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG dbcounter [-] [282899] Writing DB stats keystone:SELECT=100 {{(pid=282899) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:36:33.392158 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7bd30a3-64e6-47c7-81b1-54ec507d1e8a None admin] Validating token access rules against request {{(pid=282898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:36:33.442442 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c10d86-a2b9-4aa5-bee0-68a26c46b55f None admin] Validating token access rules against request {{(pid=282899) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:36:33.446975 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52caed32-586d-40bf-aad0-be787f04c221 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:36:33.447628 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52caed32-586d-40bf-aad0-be787f04c221 None admin] REQUEST_METHOD: `GET` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:36:33.447918 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52caed32-586d-40bf-aad0-be787f04c221 None admin] SCRIPT_NAME: `/identity` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:36:33.448198 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52caed32-586d-40bf-aad0-be787f04c221 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:36:33.449058 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52caed32-586d-40bf-aad0-be787f04c221 None admin] RBAC: Adding query filter params (group.id=020da76b12ff4fd9bbcc6cfc67cc96f2, role.id=eaeb4674b16f497f8afb3384e7e9a3c6, scope.project.id=c089873b22dd43e8a9de1c83b1355842) {{(pid=282898) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:36:33.449381 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52caed32-586d-40bf-aad0-be787f04c221 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:36:33.450886 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52caed32-586d-40bf-aad0-be787f04c221 None admin] RBAC: Authorization granted {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:36:33.458636 dv-cinder-851351-1-smb devstack@keystone.service[282898]: [pid: 282898|app: 0|req: 173/353] 10.222.0.42 () {56 vars in 1376 bytes} [Thu Jul 28 08:36:33 2022] GET /identity/v3/role_assignments?group.id=020da76b12ff4fd9bbcc6cfc67cc96f2&scope.project.id=c089873b22dd43e8a9de1c83b1355842&role.id=eaeb4674b16f497f8afb3384e7e9a3c6 => generated 260 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:36:33.459866 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0936d1c4-be5c-44dc-8a2b-227b42658a24 None None] REQUEST_METHOD: `GET` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:36:33.460174 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0936d1c4-be5c-44dc-8a2b-227b42658a24 None None] SCRIPT_NAME: `/identity` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:36:33.460570 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0936d1c4-be5c-44dc-8a2b-227b42658a24 None None] PATH_INFO: `/` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:36:33.461922 dv-cinder-851351-1-smb devstack@keystone.service[282898]: [pid: 282898|app: 0|req: 174/354] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 08:36:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 08:36:33.462479 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0936d1c4-be5c-44dc-8a2b-227b42658a24 None None] Authenticating user token {{(pid=282898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:36:33.483880 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8d1fb6-1b9a-4bd3-accb-acf0ba630884 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282899) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:36:33.484571 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8d1fb6-1b9a-4bd3-accb-acf0ba630884 None admin] REQUEST_METHOD: `GET` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:36:33.484884 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8d1fb6-1b9a-4bd3-accb-acf0ba630884 None admin] SCRIPT_NAME: `/identity` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:36:33.485167 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8d1fb6-1b9a-4bd3-accb-acf0ba630884 None admin] PATH_INFO: `/v3/roles/member` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:36:33.501469 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd8d1fb6-1b9a-4bd3-accb-acf0ba630884 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 08:36:33.507634 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application [None req-fd8d1fb6-1b9a-4bd3-accb-acf0ba630884 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 28 08:36:33.507634 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:36:33.507634 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:36:33.507634 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:36:33.507634 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:36:33.507634 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:36:33.507634 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:36:33.507634 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:36:33.507634 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:36:33.507634 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:36:33.507634 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:36:33.507634 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:36:33.507634 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 08:36:33.507634 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 08:36:33.507634 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 08:36:33.507634 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 08:36:33.508829 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 08:36:33.508829 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 08:36:33.508829 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 08:36:33.508829 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 08:36:33.508829 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:36:33.508829 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:36:33.508829 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:36:33.508829 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:36:33.508829 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:36:33.508829 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:36:33.508829 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:36:33.508829 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application with Lock( Jul 28 08:36:33.508829 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:36:33.508829 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:36:33.508829 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:36:33.508829 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:36:33.509792 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:36:33.509792 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:36:33.509792 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:36:33.509792 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:36:33.509792 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 08:36:33.509792 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 08:36:33.509792 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 08:36:33.509792 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 08:36:33.509792 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 08:36:33.509792 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 08:36:33.509792 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 28 08:36:33.509792 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application Jul 28 08:36:33.509792 dv-cinder-851351-1-smb devstack@keystone.service[282899]: [pid: 282899|app: 0|req: 181/355] 10.222.0.42 () {56 vars in 1099 bytes} [Thu Jul 28 08:36:33 2022] GET /identity/v3/roles/member => generated 84 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:36:33.509792 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8d1fb6-1b9a-4bd3-accb-acf0ba630884 None admin] Authenticating user token {{(pid=282899) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:36:33.608145 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0936d1c4-be5c-44dc-8a2b-227b42658a24 None None] Validating token access rules against request {{(pid=282898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:36:33.611128 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG dbcounter [-] [282898] Writing DB stats keystone:SELECT=100 {{(pid=282898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:36:33.617055 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG dbcounter [-] [282899] Writing DB stats keystone:SELECT=100 {{(pid=282899) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:36:33.635576 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8d1fb6-1b9a-4bd3-accb-acf0ba630884 None admin] Validating token access rules against request {{(pid=282899) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:36:33.658885 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd57101b-7a59-407b-ab6c-af75dd21246c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:36:33.659572 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd57101b-7a59-407b-ab6c-af75dd21246c None admin] REQUEST_METHOD: `GET` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:36:33.659935 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd57101b-7a59-407b-ab6c-af75dd21246c None admin] SCRIPT_NAME: `/identity` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:36:33.660210 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd57101b-7a59-407b-ab6c-af75dd21246c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:36:33.661669 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd57101b-7a59-407b-ab6c-af75dd21246c None admin] RBAC: Adding query filter params (role.id=34c6ec459a944c46a4265d15a06e348d, user.id=0f43fc4793db4630b3e45a5928ede2eb, scope.system=all) {{(pid=282898) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:36:33.662041 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd57101b-7a59-407b-ab6c-af75dd21246c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:36:33.663853 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd57101b-7a59-407b-ab6c-af75dd21246c None admin] RBAC: Authorization granted {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:36:33.677572 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b94765-6c6c-4a11-973a-93611b556dac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282899) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:36:33.677572 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b94765-6c6c-4a11-973a-93611b556dac None admin] REQUEST_METHOD: `GET` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:36:33.677910 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b94765-6c6c-4a11-973a-93611b556dac None admin] SCRIPT_NAME: `/identity` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:36:33.677999 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b94765-6c6c-4a11-973a-93611b556dac None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:36:33.680927 dv-cinder-851351-1-smb devstack@keystone.service[282898]: [pid: 282898|app: 0|req: 175/356] 10.222.0.42 () {56 vars in 1308 bytes} [Thu Jul 28 08:36:33 2022] GET /identity/v3/role_assignments?user.id=0f43fc4793db4630b3e45a5928ede2eb&scope.system=all&role.id=34c6ec459a944c46a4265d15a06e348d => generated 510 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:36:33.682138 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58694fad-4645-463d-9f5f-38587d89229b None None] REQUEST_METHOD: `GET` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:36:33.682424 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58694fad-4645-463d-9f5f-38587d89229b None None] SCRIPT_NAME: `/identity` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:36:33.682703 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58694fad-4645-463d-9f5f-38587d89229b None None] PATH_INFO: `/` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:36:33.684001 dv-cinder-851351-1-smb devstack@keystone.service[282898]: [pid: 282898|app: 0|req: 176/357] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 08:36:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 08:36:33.687281 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f20fcf-d522-43c5-92b2-db9496c4df61 None None] REQUEST_METHOD: `POST` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:36:33.687608 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f20fcf-d522-43c5-92b2-db9496c4df61 None None] SCRIPT_NAME: `/identity` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:36:33.687858 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f20fcf-d522-43c5-92b2-db9496c4df61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:36:33.713939 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.auth.core [None req-27f20fcf-d522-43c5-92b2-db9496c4df61 None None] MFA Rules not processed for user `2be990a66857410a87ffa7609aec4f7b`. Rule list: `[]` (Enabled: `True`). {{(pid=282898) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 08:36:33.715900 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.fernet_utils [None req-27f20fcf-d522-43c5-92b2-db9496c4df61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=282898) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:36:33.787493 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87b94765-6c6c-4a11-973a-93611b556dac None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:36:33.789002 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87b94765-6c6c-4a11-973a-93611b556dac None admin] RBAC: Authorization granted {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:36:33.831119 dv-cinder-851351-1-smb devstack@keystone.service[282898]: [pid: 282898|app: 0|req: 177/358] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 08:36:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 08:36:33.832210 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f20fcf-d522-43c5-92b2-db9496c4df61 None None] Authenticating user token {{(pid=282898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:36:33.933227 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG dbcounter [-] [282899] Writing DB stats keystone:SELECT=100 {{(pid=282899) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:36:33.952116 dv-cinder-851351-1-smb devstack@keystone.service[282899]: [pid: 282899|app: 0|req: 182/359] 10.222.0.42 () {58 vars in 1282 bytes} [Thu Jul 28 08:36:33 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 442 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 28 08:36:33.954790 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5585402-44e9-4197-8c06-2afd31b12193 None None] REQUEST_METHOD: `POST` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:36:33.955078 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5585402-44e9-4197-8c06-2afd31b12193 None None] SCRIPT_NAME: `/identity` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:36:33.955355 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5585402-44e9-4197-8c06-2afd31b12193 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:36:33.982394 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.auth.core [None req-f5585402-44e9-4197-8c06-2afd31b12193 None None] MFA Rules not processed for user `2be990a66857410a87ffa7609aec4f7b`. Rule list: `[]` (Enabled: `True`). {{(pid=282899) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 08:36:33.984007 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.fernet_utils [None req-f5585402-44e9-4197-8c06-2afd31b12193 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=282899) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:36:33.993445 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG dbcounter [-] [282898] Writing DB stats keystone:SELECT=100 {{(pid=282898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:36:34.010759 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f20fcf-d522-43c5-92b2-db9496c4df61 None None] Validating token access rules against request {{(pid=282898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:36:34.063495 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74cf5e1f-1c3d-4280-a5ac-087deca746fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:36:34.064250 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74cf5e1f-1c3d-4280-a5ac-087deca746fa None admin] REQUEST_METHOD: `GET` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:36:34.064541 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74cf5e1f-1c3d-4280-a5ac-087deca746fa None admin] SCRIPT_NAME: `/identity` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:36:34.065088 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74cf5e1f-1c3d-4280-a5ac-087deca746fa None admin] PATH_INFO: `/v3/roles` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:36:34.065608 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74cf5e1f-1c3d-4280-a5ac-087deca746fa None admin] RBAC: Adding query filter params (name=member) {{(pid=282898) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:36:34.067852 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74cf5e1f-1c3d-4280-a5ac-087deca746fa None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:36:34.067852 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74cf5e1f-1c3d-4280-a5ac-087deca746fa None admin] RBAC: Authorization granted {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:36:34.080090 dv-cinder-851351-1-smb devstack@keystone.service[282898]: [pid: 282898|app: 0|req: 178/360] 10.222.0.42 () {56 vars in 1101 bytes} [Thu Jul 28 08:36:33 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:36:34.080817 dv-cinder-851351-1-smb devstack@keystone.service[282899]: [pid: 282899|app: 0|req: 183/361] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 08:36:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 08:36:34.081046 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74cf5e1f-1c3d-4280-a5ac-087deca746fa None admin] Authenticating user token {{(pid=282898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:36:34.082748 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5585402-44e9-4197-8c06-2afd31b12193 None None] Authenticating user token {{(pid=282899) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:36:34.222163 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74cf5e1f-1c3d-4280-a5ac-087deca746fa None admin] Validating token access rules against request {{(pid=282898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:36:34.234475 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5585402-44e9-4197-8c06-2afd31b12193 None None] Validating token access rules against request {{(pid=282899) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:36:34.255899 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG dbcounter [-] [282899] Writing DB stats keystone:SELECT=100 {{(pid=282899) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:36:34.267508 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b579ed6-ad07-4505-b9ef-b898fd489092 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:36:34.268167 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b579ed6-ad07-4505-b9ef-b898fd489092 None admin] REQUEST_METHOD: `GET` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:36:34.268448 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b579ed6-ad07-4505-b9ef-b898fd489092 None admin] SCRIPT_NAME: `/identity` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:36:34.268759 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b579ed6-ad07-4505-b9ef-b898fd489092 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:36:34.281067 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ce2d4a-ac29-4bba-bf61-4f2c30c100a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282899) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:36:34.281838 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ce2d4a-ac29-4bba-bf61-4f2c30c100a4 None admin] REQUEST_METHOD: `GET` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:36:34.282185 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ce2d4a-ac29-4bba-bf61-4f2c30c100a4 None admin] SCRIPT_NAME: `/identity` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:36:34.282530 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ce2d4a-ac29-4bba-bf61-4f2c30c100a4 None admin] PATH_INFO: `/v3/projects/c089873b22dd43e8a9de1c83b1355842` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:36:34.283590 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b579ed6-ad07-4505-b9ef-b898fd489092 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 08:36:34.285903 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ce2d4a-ac29-4bba-bf61-4f2c30c100a4 None admin] RBAC: Authorizing `identity:get_project(project_id=c089873b22dd43e8a9de1c83b1355842)` {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:36:34.287660 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ce2d4a-ac29-4bba-bf61-4f2c30c100a4 None admin] RBAC: Authorization granted {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:36:34.289438 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application [None req-8b579ed6-ad07-4505-b9ef-b898fd489092 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 28 08:36:34.289438 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:36:34.289438 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:36:34.289438 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:36:34.289438 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:36:34.289438 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:36:34.289438 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:36:34.289438 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:36:34.289438 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:36:34.289438 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:36:34.289438 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:36:34.289438 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:36:34.289438 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 08:36:34.289438 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 08:36:34.289438 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 08:36:34.289438 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 08:36:34.290439 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 08:36:34.290439 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 08:36:34.290439 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 08:36:34.290439 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 08:36:34.290439 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:36:34.290439 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:36:34.290439 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:36:34.290439 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:36:34.290439 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:36:34.290439 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:36:34.290439 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:36:34.290439 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application with Lock( Jul 28 08:36:34.290439 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:36:34.290439 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:36:34.290439 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:36:34.290439 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:36:34.292159 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:36:34.292159 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:36:34.292159 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:36:34.292159 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:36:34.292159 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 08:36:34.292159 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 08:36:34.292159 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 08:36:34.292159 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 08:36:34.292159 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 08:36:34.292159 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 08:36:34.292159 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 28 08:36:34.292159 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application Jul 28 08:36:34.292954 dv-cinder-851351-1-smb devstack@keystone.service[282899]: [pid: 282899|app: 0|req: 184/362] 10.222.0.42 () {56 vars in 1186 bytes} [Thu Jul 28 08:36:34 2022] GET /identity/v3/projects/c089873b22dd43e8a9de1c83b1355842 => generated 298 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:36:34.293033 dv-cinder-851351-1-smb devstack@keystone.service[282898]: [pid: 282898|app: 0|req: 179/363] 10.222.0.42 () {56 vars in 1114 bytes} [Thu Jul 28 08:36:34 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:36:34.293134 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ce2d4a-ac29-4bba-bf61-4f2c30c100a4 None admin] Authenticating user token {{(pid=282899) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:36:34.293600 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b579ed6-ad07-4505-b9ef-b898fd489092 None admin] Authenticating user token {{(pid=282898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:36:34.314018 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG dbcounter [-] [282898] Writing DB stats keystone:SELECT=100 {{(pid=282898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:36:34.426629 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b579ed6-ad07-4505-b9ef-b898fd489092 None admin] Validating token access rules against request {{(pid=282898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:36:34.430158 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ce2d4a-ac29-4bba-bf61-4f2c30c100a4 None admin] Validating token access rules against request {{(pid=282899) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:36:34.476365 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddacafb3-c94d-4594-af38-fbc178778e2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:36:34.477063 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddacafb3-c94d-4594-af38-fbc178778e2f None admin] REQUEST_METHOD: `GET` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:36:34.477376 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddacafb3-c94d-4594-af38-fbc178778e2f None admin] SCRIPT_NAME: `/identity` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:36:34.477653 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddacafb3-c94d-4594-af38-fbc178778e2f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:36:34.480944 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99d32f9-d10e-48af-b851-95604e5dcc36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282899) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:36:34.481603 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99d32f9-d10e-48af-b851-95604e5dcc36 None admin] REQUEST_METHOD: `GET` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:36:34.481896 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99d32f9-d10e-48af-b851-95604e5dcc36 None admin] SCRIPT_NAME: `/identity` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:36:34.482181 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99d32f9-d10e-48af-b851-95604e5dcc36 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:36:34.492623 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddacafb3-c94d-4594-af38-fbc178778e2f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 08:36:34.498559 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application [None req-ddacafb3-c94d-4594-af38-fbc178778e2f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 08:36:34.498559 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:36:34.498559 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:36:34.498559 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:36:34.498559 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:36:34.498559 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:36:34.498559 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:36:34.498559 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:36:34.498559 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:36:34.498559 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:36:34.498559 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:36:34.498559 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:36:34.498559 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 08:36:34.498559 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 08:36:34.498559 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 08:36:34.498559 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 08:36:34.499720 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 08:36:34.499720 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 08:36:34.499720 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 08:36:34.499720 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 08:36:34.499720 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:36:34.499720 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:36:34.499720 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:36:34.499720 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:36:34.499720 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:36:34.499720 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:36:34.499720 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:36:34.499720 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application with Lock( Jul 28 08:36:34.499720 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:36:34.499720 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:36:34.499720 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:36:34.499720 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:36:34.500658 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:36:34.500658 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:36:34.500658 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:36:34.500658 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:36:34.500658 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 08:36:34.500658 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 08:36:34.500658 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 08:36:34.500658 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 08:36:34.500658 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 08:36:34.500658 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 08:36:34.500658 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 08:36:34.500658 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application Jul 28 08:36:34.503725 dv-cinder-851351-1-smb devstack@keystone.service[282898]: [pid: 282898|app: 0|req: 180/364] 10.222.0.42 () {56 vars in 1096 bytes} [Thu Jul 28 08:36:34 2022] GET /identity/v3/roles/admin => generated 83 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:36:34.504635 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddacafb3-c94d-4594-af38-fbc178778e2f None admin] Authenticating user token {{(pid=282898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:36:34.552130 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG dbcounter [-] [282899] Writing DB stats keystone:SELECT=100 {{(pid=282899) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:36:34.577185 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c99d32f9-d10e-48af-b851-95604e5dcc36 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:36:34.579675 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c99d32f9-d10e-48af-b851-95604e5dcc36 None admin] RBAC: Authorization granted {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:36:34.600069 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG dbcounter [-] [282898] Writing DB stats keystone:SELECT=100 {{(pid=282898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:36:34.635891 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddacafb3-c94d-4594-af38-fbc178778e2f None admin] Validating token access rules against request {{(pid=282898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:36:34.679329 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d957e59d-bbcd-441b-80ab-02e4404229c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:36:34.680843 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d957e59d-bbcd-441b-80ab-02e4404229c8 None admin] REQUEST_METHOD: `GET` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:36:34.681132 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d957e59d-bbcd-441b-80ab-02e4404229c8 None admin] SCRIPT_NAME: `/identity` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:36:34.681412 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d957e59d-bbcd-441b-80ab-02e4404229c8 None admin] PATH_INFO: `/v3/roles` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:36:34.682192 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d957e59d-bbcd-441b-80ab-02e4404229c8 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=282898) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:36:34.682501 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d957e59d-bbcd-441b-80ab-02e4404229c8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:36:34.685205 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d957e59d-bbcd-441b-80ab-02e4404229c8 None admin] RBAC: Authorization granted {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:36:34.701982 dv-cinder-851351-1-smb devstack@keystone.service[282898]: [pid: 282898|app: 0|req: 181/365] 10.222.0.42 () {56 vars in 1111 bytes} [Thu Jul 28 08:36:34 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:36:34.701982 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d957e59d-bbcd-441b-80ab-02e4404229c8 None admin] Authenticating user token {{(pid=282898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:36:34.722733 dv-cinder-851351-1-smb devstack@keystone.service[282899]: [pid: 282899|app: 0|req: 185/366] 10.222.0.42 () {58 vars in 1282 bytes} [Thu Jul 28 08:36:34 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 432 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 28 08:36:34.723994 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99d32f9-d10e-48af-b851-95604e5dcc36 None admin] Authenticating user token {{(pid=282899) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:36:34.838939 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d957e59d-bbcd-441b-80ab-02e4404229c8 None admin] Validating token access rules against request {{(pid=282898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:36:34.843553 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG dbcounter [-] [282899] Writing DB stats keystone:SELECT=100 {{(pid=282899) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:36:34.863715 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99d32f9-d10e-48af-b851-95604e5dcc36 None admin] Validating token access rules against request {{(pid=282899) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:36:34.893772 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1609dafb-0791-4936-869c-f691627c08ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:36:34.894482 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1609dafb-0791-4936-869c-f691627c08ba None admin] REQUEST_METHOD: `GET` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:36:34.894769 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1609dafb-0791-4936-869c-f691627c08ba None admin] SCRIPT_NAME: `/identity` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:36:34.895049 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1609dafb-0791-4936-869c-f691627c08ba None admin] PATH_INFO: `/v3/groups/020da76b12ff4fd9bbcc6cfc67cc96f2` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:36:34.896248 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1609dafb-0791-4936-869c-f691627c08ba None admin] RBAC: Authorizing `identity:get_group(group_id=020da76b12ff4fd9bbcc6cfc67cc96f2)` {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:36:34.897811 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1609dafb-0791-4936-869c-f691627c08ba None admin] RBAC: Authorization granted {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:36:34.899629 dv-cinder-851351-1-smb devstack@keystone.service[282898]: [pid: 282898|app: 0|req: 182/367] 10.222.0.42 () {56 vars in 1180 bytes} [Thu Jul 28 08:36:34 2022] GET /identity/v3/groups/020da76b12ff4fd9bbcc6cfc67cc96f2 => generated 226 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:36:34.900244 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1609dafb-0791-4936-869c-f691627c08ba None admin] Authenticating user token {{(pid=282898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:36:34.906981 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG dbcounter [-] [282898] Writing DB stats keystone:SELECT=100 {{(pid=282898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:36:34.908464 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de04816-0b2b-4bfc-9dc2-ff3743ad4b71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282899) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:36:34.909390 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de04816-0b2b-4bfc-9dc2-ff3743ad4b71 None admin] REQUEST_METHOD: `GET` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:36:34.909907 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de04816-0b2b-4bfc-9dc2-ff3743ad4b71 None admin] SCRIPT_NAME: `/identity` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:36:34.910250 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de04816-0b2b-4bfc-9dc2-ff3743ad4b71 None admin] PATH_INFO: `/v3/roles` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:36:34.910980 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5de04816-0b2b-4bfc-9dc2-ff3743ad4b71 None admin] RBAC: Adding query filter params (name=admin) {{(pid=282899) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:36:34.911288 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5de04816-0b2b-4bfc-9dc2-ff3743ad4b71 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:36:34.912774 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5de04816-0b2b-4bfc-9dc2-ff3743ad4b71 None admin] RBAC: Authorization granted {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:36:34.924007 dv-cinder-851351-1-smb devstack@keystone.service[282899]: [pid: 282899|app: 0|req: 186/368] 10.222.0.42 () {56 vars in 1099 bytes} [Thu Jul 28 08:36:34 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:36:34.924866 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de04816-0b2b-4bfc-9dc2-ff3743ad4b71 None admin] Authenticating user token {{(pid=282899) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:36:35.037325 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1609dafb-0791-4936-869c-f691627c08ba None admin] Validating token access rules against request {{(pid=282898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:36:35.053267 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de04816-0b2b-4bfc-9dc2-ff3743ad4b71 None admin] Validating token access rules against request {{(pid=282899) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:36:35.078753 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a03a28c-0b6d-475a-9e78-b24764c739d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:36:35.079766 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a03a28c-0b6d-475a-9e78-b24764c739d2 None admin] REQUEST_METHOD: `GET` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:36:35.080049 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a03a28c-0b6d-475a-9e78-b24764c739d2 None admin] SCRIPT_NAME: `/identity` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:36:35.080323 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a03a28c-0b6d-475a-9e78-b24764c739d2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:36:35.097237 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f83d51-fb95-415d-99fa-8b964b659cc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282899) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:36:35.098207 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f83d51-fb95-415d-99fa-8b964b659cc9 None admin] REQUEST_METHOD: `GET` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:36:35.098770 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f83d51-fb95-415d-99fa-8b964b659cc9 None admin] SCRIPT_NAME: `/identity` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:36:35.099052 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f83d51-fb95-415d-99fa-8b964b659cc9 None admin] PATH_INFO: `/v3/projects/305114c1888a404186311d18de60f67f` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:36:35.101269 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f83d51-fb95-415d-99fa-8b964b659cc9 None admin] RBAC: Authorizing `identity:get_project(project_id=305114c1888a404186311d18de60f67f)` {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:36:35.102806 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f83d51-fb95-415d-99fa-8b964b659cc9 None admin] RBAC: Authorization granted {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:36:35.107009 dv-cinder-851351-1-smb devstack@keystone.service[282899]: [pid: 282899|app: 0|req: 187/369] 10.222.0.42 () {56 vars in 1186 bytes} [Thu Jul 28 08:36:34 2022] GET /identity/v3/projects/305114c1888a404186311d18de60f67f => generated 302 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:36:35.107874 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f83d51-fb95-415d-99fa-8b964b659cc9 None admin] Authenticating user token {{(pid=282899) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:36:35.129189 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG dbcounter [-] [282899] Writing DB stats keystone:SELECT=100 {{(pid=282899) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:36:35.177724 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a03a28c-0b6d-475a-9e78-b24764c739d2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:36:35.179218 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a03a28c-0b6d-475a-9e78-b24764c739d2 None admin] RBAC: Authorization granted {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:36:35.182164 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG dbcounter [-] [282898] Writing DB stats keystone:SELECT=100 {{(pid=282898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:36:35.242257 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f83d51-fb95-415d-99fa-8b964b659cc9 None admin] Validating token access rules against request {{(pid=282899) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:36:35.289790 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e6a1151-c380-41f2-b138-372ac0593d8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282899) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:36:35.290838 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6a1151-c380-41f2-b138-372ac0593d8d None admin] REQUEST_METHOD: `GET` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:36:35.291347 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6a1151-c380-41f2-b138-372ac0593d8d None admin] SCRIPT_NAME: `/identity` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:36:35.291836 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6a1151-c380-41f2-b138-372ac0593d8d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:36:35.292924 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e6a1151-c380-41f2-b138-372ac0593d8d None admin] RBAC: Adding query filter params (group.id=020da76b12ff4fd9bbcc6cfc67cc96f2, role.id=d76677105be344cc83022cbde8a22d8d, scope.project.id=c089873b22dd43e8a9de1c83b1355842) {{(pid=282899) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:36:35.293501 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e6a1151-c380-41f2-b138-372ac0593d8d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:36:35.295055 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e6a1151-c380-41f2-b138-372ac0593d8d None admin] RBAC: Authorization granted {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:36:35.303223 dv-cinder-851351-1-smb devstack@keystone.service[282899]: [pid: 282899|app: 0|req: 188/370] 10.222.0.42 () {56 vars in 1376 bytes} [Thu Jul 28 08:36:35 2022] GET /identity/v3/role_assignments?group.id=020da76b12ff4fd9bbcc6cfc67cc96f2&scope.project.id=c089873b22dd43e8a9de1c83b1355842&role.id=d76677105be344cc83022cbde8a22d8d => generated 260 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:36:35.304308 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e6a1151-c380-41f2-b138-372ac0593d8d None admin] Authenticating user token {{(pid=282899) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:36:35.311239 dv-cinder-851351-1-smb devstack@keystone.service[282898]: [pid: 282898|app: 0|req: 183/371] 10.222.0.42 () {58 vars in 1282 bytes} [Thu Jul 28 08:36:34 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 411 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 28 08:36:35.311946 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a03a28c-0b6d-475a-9e78-b24764c739d2 None admin] Authenticating user token {{(pid=282898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:36:35.431204 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG dbcounter [-] [282899] Writing DB stats keystone:SELECT=100 {{(pid=282899) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:36:35.445990 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a03a28c-0b6d-475a-9e78-b24764c739d2 None admin] Validating token access rules against request {{(pid=282898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:36:35.451378 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG dbcounter [-] [282898] Writing DB stats keystone:SELECT=100 {{(pid=282898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:36:35.469666 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e6a1151-c380-41f2-b138-372ac0593d8d None admin] Validating token access rules against request {{(pid=282899) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:36:35.495153 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de55f27-889b-42be-a304-b310fa63c4ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:36:35.496230 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de55f27-889b-42be-a304-b310fa63c4ae None admin] REQUEST_METHOD: `GET` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:36:35.496774 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de55f27-889b-42be-a304-b310fa63c4ae None admin] SCRIPT_NAME: `/identity` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:36:35.497289 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de55f27-889b-42be-a304-b310fa63c4ae None admin] PATH_INFO: `/v3/groups/020da76b12ff4fd9bbcc6cfc67cc96f2` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:36:35.498739 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9de55f27-889b-42be-a304-b310fa63c4ae None admin] RBAC: Authorizing `identity:get_group(group_id=020da76b12ff4fd9bbcc6cfc67cc96f2)` {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:36:35.500471 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9de55f27-889b-42be-a304-b310fa63c4ae None admin] RBAC: Authorization granted {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:36:35.503561 dv-cinder-851351-1-smb devstack@keystone.service[282898]: [pid: 282898|app: 0|req: 184/372] 10.222.0.42 () {56 vars in 1180 bytes} [Thu Jul 28 08:36:35 2022] GET /identity/v3/groups/020da76b12ff4fd9bbcc6cfc67cc96f2 => generated 226 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:36:35.504877 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de55f27-889b-42be-a304-b310fa63c4ae None admin] Authenticating user token {{(pid=282898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:36:35.518493 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f9aba9b-f006-455e-bc7c-ab3cddb97266 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282899) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:36:35.518493 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9aba9b-f006-455e-bc7c-ab3cddb97266 None admin] REQUEST_METHOD: `GET` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:36:35.518493 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9aba9b-f006-455e-bc7c-ab3cddb97266 None admin] SCRIPT_NAME: `/identity` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:36:35.518493 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9aba9b-f006-455e-bc7c-ab3cddb97266 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:36:35.609652 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f9aba9b-f006-455e-bc7c-ab3cddb97266 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:36:35.611145 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f9aba9b-f006-455e-bc7c-ab3cddb97266 None admin] RBAC: Authorization granted {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:36:35.628565 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de55f27-889b-42be-a304-b310fa63c4ae None admin] Validating token access rules against request {{(pid=282898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:36:35.669723 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58feb5c-a190-4a14-b0d6-4fd600d0e717 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:36:35.670406 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58feb5c-a190-4a14-b0d6-4fd600d0e717 None admin] REQUEST_METHOD: `GET` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:36:35.670688 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58feb5c-a190-4a14-b0d6-4fd600d0e717 None admin] SCRIPT_NAME: `/identity` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:36:35.670972 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58feb5c-a190-4a14-b0d6-4fd600d0e717 None admin] PATH_INFO: `/v3/projects/305114c1888a404186311d18de60f67f` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:36:35.672258 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c58feb5c-a190-4a14-b0d6-4fd600d0e717 None admin] RBAC: Authorizing `identity:get_project(project_id=305114c1888a404186311d18de60f67f)` {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:36:35.673833 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c58feb5c-a190-4a14-b0d6-4fd600d0e717 None admin] RBAC: Authorization granted {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:36:35.676008 dv-cinder-851351-1-smb devstack@keystone.service[282898]: [pid: 282898|app: 0|req: 185/373] 10.222.0.42 () {56 vars in 1186 bytes} [Thu Jul 28 08:36:35 2022] GET /identity/v3/projects/305114c1888a404186311d18de60f67f => generated 302 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:36:35.676862 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58feb5c-a190-4a14-b0d6-4fd600d0e717 None admin] Authenticating user token {{(pid=282898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:36:35.708488 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG dbcounter [-] [282899] Writing DB stats keystone:SELECT=100 {{(pid=282899) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:36:35.736572 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG dbcounter [-] [282898] Writing DB stats keystone:SELECT=100 {{(pid=282898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:36:35.738487 dv-cinder-851351-1-smb devstack@keystone.service[282899]: [pid: 282899|app: 0|req: 189/374] 10.222.0.42 () {58 vars in 1282 bytes} [Thu Jul 28 08:36:35 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 435 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 28 08:36:35.744459 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22847896-ba19-4827-8be4-5fd2c366e225 None None] REQUEST_METHOD: `GET` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:36:35.744780 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22847896-ba19-4827-8be4-5fd2c366e225 None None] SCRIPT_NAME: `/identity` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:36:35.745019 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22847896-ba19-4827-8be4-5fd2c366e225 None None] PATH_INFO: `/` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:36:35.746703 dv-cinder-851351-1-smb devstack@keystone.service[282899]: [pid: 282899|app: 0|req: 190/375] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 08:36:35 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 08:36:35.747441 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22847896-ba19-4827-8be4-5fd2c366e225 None None] Authenticating user token {{(pid=282899) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:36:35.831684 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58feb5c-a190-4a14-b0d6-4fd600d0e717 None admin] Validating token access rules against request {{(pid=282898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:36:35.872571 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2618c756-f7fb-4d8d-8506-efd31a901d7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:36:35.873281 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2618c756-f7fb-4d8d-8506-efd31a901d7a None admin] REQUEST_METHOD: `GET` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:36:35.873521 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2618c756-f7fb-4d8d-8506-efd31a901d7a None admin] SCRIPT_NAME: `/identity` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:36:35.873881 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2618c756-f7fb-4d8d-8506-efd31a901d7a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:36:35.874610 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2618c756-f7fb-4d8d-8506-efd31a901d7a None admin] RBAC: Adding query filter params (group.id=020da76b12ff4fd9bbcc6cfc67cc96f2, role.id=eaeb4674b16f497f8afb3384e7e9a3c6, scope.project.id=305114c1888a404186311d18de60f67f) {{(pid=282898) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:36:35.874927 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2618c756-f7fb-4d8d-8506-efd31a901d7a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:36:35.876438 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2618c756-f7fb-4d8d-8506-efd31a901d7a None admin] RBAC: Authorization granted {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:36:35.877168 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22847896-ba19-4827-8be4-5fd2c366e225 None None] Validating token access rules against request {{(pid=282899) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:36:35.883540 dv-cinder-851351-1-smb devstack@keystone.service[282898]: [pid: 282898|app: 0|req: 186/376] 10.222.0.42 () {56 vars in 1376 bytes} [Thu Jul 28 08:36:35 2022] GET /identity/v3/role_assignments?group.id=020da76b12ff4fd9bbcc6cfc67cc96f2&scope.project.id=305114c1888a404186311d18de60f67f&role.id=eaeb4674b16f497f8afb3384e7e9a3c6 => generated 260 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:36:35.884922 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9d68af-7fe6-43f9-a988-339cb6564a23 None None] REQUEST_METHOD: `POST` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:36:35.885215 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9d68af-7fe6-43f9-a988-339cb6564a23 None None] SCRIPT_NAME: `/identity` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:36:35.885506 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9d68af-7fe6-43f9-a988-339cb6564a23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:36:35.909939 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.auth.core [None req-4b9d68af-7fe6-43f9-a988-339cb6564a23 None None] MFA Rules not processed for user `2be990a66857410a87ffa7609aec4f7b`. Rule list: `[]` (Enabled: `True`). {{(pid=282898) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 08:36:35.911239 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.fernet_utils [None req-4b9d68af-7fe6-43f9-a988-339cb6564a23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=282898) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:36:35.929790 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b05995-6edc-4630-ae81-63b364d85c3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282899) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:36:35.930901 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b05995-6edc-4630-ae81-63b364d85c3d None admin] REQUEST_METHOD: `GET` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:36:35.931409 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b05995-6edc-4630-ae81-63b364d85c3d None admin] SCRIPT_NAME: `/identity` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:36:35.931905 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b05995-6edc-4630-ae81-63b364d85c3d None admin] PATH_INFO: `/v3/groups/020da76b12ff4fd9bbcc6cfc67cc96f2` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:36:35.933412 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2b05995-6edc-4630-ae81-63b364d85c3d None admin] RBAC: Authorizing `identity:get_group(group_id=020da76b12ff4fd9bbcc6cfc67cc96f2)` {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:36:35.935178 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2b05995-6edc-4630-ae81-63b364d85c3d None admin] RBAC: Authorization granted {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:36:35.943234 dv-cinder-851351-1-smb devstack@keystone.service[282899]: [pid: 282899|app: 0|req: 191/377] 10.222.0.42 () {56 vars in 1180 bytes} [Thu Jul 28 08:36:35 2022] GET /identity/v3/groups/020da76b12ff4fd9bbcc6cfc67cc96f2 => generated 226 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:36:35.944278 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b05995-6edc-4630-ae81-63b364d85c3d None admin] Authenticating user token {{(pid=282899) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:36:36.022727 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG dbcounter [-] [282899] Writing DB stats keystone:SELECT=100 {{(pid=282899) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:36:36.034325 dv-cinder-851351-1-smb devstack@keystone.service[282898]: [pid: 282898|app: 0|req: 187/378] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 08:36:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 08:36:36.035604 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b9d68af-7fe6-43f9-a988-339cb6564a23 None None] Authenticating user token {{(pid=282898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:36:36.083039 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG dbcounter [-] [282898] Writing DB stats keystone:SELECT=100 {{(pid=282898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:36:36.122631 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b05995-6edc-4630-ae81-63b364d85c3d None admin] Validating token access rules against request {{(pid=282899) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:36:36.173870 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b9d68af-7fe6-43f9-a988-339cb6564a23 None None] Validating token access rules against request {{(pid=282898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:36:36.185711 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ff696b-de18-4d94-93d0-470b843342fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282899) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:36:36.186996 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ff696b-de18-4d94-93d0-470b843342fa None admin] REQUEST_METHOD: `GET` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:36:36.187658 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ff696b-de18-4d94-93d0-470b843342fa None admin] SCRIPT_NAME: `/identity` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:36:36.188078 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ff696b-de18-4d94-93d0-470b843342fa None admin] PATH_INFO: `/v3/projects/0c423333fe4246a29efc0aa6050bba26` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:36:36.189686 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84ff696b-de18-4d94-93d0-470b843342fa None admin] RBAC: Authorizing `identity:get_project(project_id=0c423333fe4246a29efc0aa6050bba26)` {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:36:36.192117 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84ff696b-de18-4d94-93d0-470b843342fa None admin] RBAC: Authorization granted {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:36:36.194663 dv-cinder-851351-1-smb devstack@keystone.service[282899]: [pid: 282899|app: 0|req: 192/379] 10.222.0.42 () {56 vars in 1186 bytes} [Thu Jul 28 08:36:35 2022] GET /identity/v3/projects/0c423333fe4246a29efc0aa6050bba26 => generated 344 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:36:36.195547 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ff696b-de18-4d94-93d0-470b843342fa None admin] Authenticating user token {{(pid=282899) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:36:36.216558 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46314aa-d947-4ade-95d6-2ee8d70b34b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:36:36.217282 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46314aa-d947-4ade-95d6-2ee8d70b34b2 None admin] REQUEST_METHOD: `GET` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:36:36.217569 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46314aa-d947-4ade-95d6-2ee8d70b34b2 None admin] SCRIPT_NAME: `/identity` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:36:36.217842 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46314aa-d947-4ade-95d6-2ee8d70b34b2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:36:36.218704 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b46314aa-d947-4ade-95d6-2ee8d70b34b2 None admin] RBAC: Adding query filter params (group.id=020da76b12ff4fd9bbcc6cfc67cc96f2, role.id=d76677105be344cc83022cbde8a22d8d, scope.project.id=305114c1888a404186311d18de60f67f) {{(pid=282898) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:36:36.219024 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b46314aa-d947-4ade-95d6-2ee8d70b34b2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:36:36.220544 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b46314aa-d947-4ade-95d6-2ee8d70b34b2 None admin] RBAC: Authorization granted {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:36:36.227231 dv-cinder-851351-1-smb devstack@keystone.service[282898]: [pid: 282898|app: 0|req: 188/380] 10.222.0.42 () {56 vars in 1376 bytes} [Thu Jul 28 08:36:36 2022] GET /identity/v3/role_assignments?group.id=020da76b12ff4fd9bbcc6cfc67cc96f2&scope.project.id=305114c1888a404186311d18de60f67f&role.id=d76677105be344cc83022cbde8a22d8d => generated 260 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:36:36.228074 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46314aa-d947-4ade-95d6-2ee8d70b34b2 None admin] Authenticating user token {{(pid=282898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:36:36.342154 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG dbcounter [-] [282898] Writing DB stats keystone:SELECT=100 {{(pid=282898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:36:36.345583 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ff696b-de18-4d94-93d0-470b843342fa None admin] Validating token access rules against request {{(pid=282899) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:36:36.347103 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46314aa-d947-4ade-95d6-2ee8d70b34b2 None admin] Validating token access rules against request {{(pid=282898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:36:36.364628 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG dbcounter [-] [282899] Writing DB stats keystone:SELECT=100 {{(pid=282899) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:36:36.418202 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b199fda-8ec4-4bcc-bf3b-adf25dc035c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282899) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:36:36.419086 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caba41a1-3732-4984-a601-f7af52631ad6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:36:36.420337 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b199fda-8ec4-4bcc-bf3b-adf25dc035c6 None admin] REQUEST_METHOD: `GET` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:36:36.421056 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caba41a1-3732-4984-a601-f7af52631ad6 None admin] REQUEST_METHOD: `GET` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:36:36.421567 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caba41a1-3732-4984-a601-f7af52631ad6 None admin] SCRIPT_NAME: `/identity` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:36:36.422088 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b199fda-8ec4-4bcc-bf3b-adf25dc035c6 None admin] SCRIPT_NAME: `/identity` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:36:36.422576 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caba41a1-3732-4984-a601-f7af52631ad6 None admin] PATH_INFO: `/v3/groups/3313e717dec84a479129e19f12df1137` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:36:36.423068 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b199fda-8ec4-4bcc-bf3b-adf25dc035c6 None admin] PATH_INFO: `/v3/roles/member` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:36:36.435256 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caba41a1-3732-4984-a601-f7af52631ad6 None admin] RBAC: Authorizing `identity:get_group(group_id=3313e717dec84a479129e19f12df1137)` {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:36:36.438100 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caba41a1-3732-4984-a601-f7af52631ad6 None admin] RBAC: Authorization granted {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:36:36.447878 dv-cinder-851351-1-smb devstack@keystone.service[282898]: [pid: 282898|app: 0|req: 189/381] 10.222.0.42 () {56 vars in 1180 bytes} [Thu Jul 28 08:36:36 2022] GET /identity/v3/groups/3313e717dec84a479129e19f12df1137 => generated 229 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:36:36.452562 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caba41a1-3732-4984-a601-f7af52631ad6 None admin] Authenticating user token {{(pid=282898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:36:36.456586 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b199fda-8ec4-4bcc-bf3b-adf25dc035c6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 08:36:36.466277 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application [None req-8b199fda-8ec4-4bcc-bf3b-adf25dc035c6 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 28 08:36:36.466277 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:36:36.466277 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:36:36.466277 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:36:36.466277 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:36:36.466277 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:36:36.466277 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:36:36.466277 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:36:36.466277 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:36:36.466277 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:36:36.466277 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:36:36.466277 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:36:36.466277 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 08:36:36.466277 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 08:36:36.466277 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 08:36:36.466277 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 08:36:36.467369 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 08:36:36.467369 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 08:36:36.467369 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 08:36:36.467369 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 08:36:36.467369 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:36:36.467369 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:36:36.467369 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:36:36.467369 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:36:36.467369 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:36:36.467369 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:36:36.467369 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:36:36.467369 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application with Lock( Jul 28 08:36:36.467369 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:36:36.467369 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:36:36.467369 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:36:36.467369 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:36:36.469062 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:36:36.469062 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:36:36.469062 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:36:36.469062 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:36:36.469062 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 08:36:36.469062 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 08:36:36.469062 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 08:36:36.469062 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 08:36:36.469062 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 08:36:36.469062 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 08:36:36.469062 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 28 08:36:36.469062 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application Jul 28 08:36:36.469062 dv-cinder-851351-1-smb devstack@keystone.service[282899]: [pid: 282899|app: 0|req: 193/382] 10.222.0.42 () {56 vars in 1099 bytes} [Thu Jul 28 08:36:36 2022] GET /identity/v3/roles/member => generated 84 bytes in 272 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:36:36.474903 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b199fda-8ec4-4bcc-bf3b-adf25dc035c6 None admin] Authenticating user token {{(pid=282899) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:36:36.577372 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caba41a1-3732-4984-a601-f7af52631ad6 None admin] Validating token access rules against request {{(pid=282898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:36:36.624471 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c866bcd0-a6ca-4b27-99c5-00530d6d84cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:36:36.625529 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c866bcd0-a6ca-4b27-99c5-00530d6d84cf None admin] REQUEST_METHOD: `GET` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:36:36.626038 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c866bcd0-a6ca-4b27-99c5-00530d6d84cf None admin] SCRIPT_NAME: `/identity` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:36:36.626526 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c866bcd0-a6ca-4b27-99c5-00530d6d84cf None admin] PATH_INFO: `/v3/role_assignments` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:36:36.627570 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c866bcd0-a6ca-4b27-99c5-00530d6d84cf None admin] RBAC: Adding query filter params (group.id=3313e717dec84a479129e19f12df1137, role.id=a0e2a00bf94d40f38629d6b5293e3aee, scope.project.id=0c423333fe4246a29efc0aa6050bba26) {{(pid=282898) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:36:36.628092 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c866bcd0-a6ca-4b27-99c5-00530d6d84cf None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:36:36.629867 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c866bcd0-a6ca-4b27-99c5-00530d6d84cf None admin] RBAC: Authorization granted {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:36:36.640787 dv-cinder-851351-1-smb devstack@keystone.service[282898]: [pid: 282898|app: 0|req: 190/383] 10.222.0.42 () {56 vars in 1376 bytes} [Thu Jul 28 08:36:36 2022] GET /identity/v3/role_assignments?group.id=3313e717dec84a479129e19f12df1137&scope.project.id=0c423333fe4246a29efc0aa6050bba26&role.id=a0e2a00bf94d40f38629d6b5293e3aee => generated 260 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:36:36.652246 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b199fda-8ec4-4bcc-bf3b-adf25dc035c6 None admin] Validating token access rules against request {{(pid=282899) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:36:36.726608 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e542c7c-8a73-4a7a-8b51-9295660374e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282899) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:36:36.727290 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e542c7c-8a73-4a7a-8b51-9295660374e4 None admin] REQUEST_METHOD: `GET` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:36:36.727582 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e542c7c-8a73-4a7a-8b51-9295660374e4 None admin] SCRIPT_NAME: `/identity` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:36:36.727866 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e542c7c-8a73-4a7a-8b51-9295660374e4 None admin] PATH_INFO: `/v3/roles` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:36:36.728645 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e542c7c-8a73-4a7a-8b51-9295660374e4 None admin] RBAC: Adding query filter params (name=member) {{(pid=282899) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:36:36.728993 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e542c7c-8a73-4a7a-8b51-9295660374e4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:36:36.730485 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e542c7c-8a73-4a7a-8b51-9295660374e4 None admin] RBAC: Authorization granted {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:36:36.741172 dv-cinder-851351-1-smb devstack@keystone.service[282899]: [pid: 282899|app: 0|req: 194/384] 10.222.0.42 () {56 vars in 1101 bytes} [Thu Jul 28 08:36:36 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:36:36.746597 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c866bcd0-a6ca-4b27-99c5-00530d6d84cf None admin] Authenticating user token {{(pid=282898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:36:36.806721 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG dbcounter [-] [282898] Writing DB stats keystone:SELECT=100 {{(pid=282898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:36:36.911623 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c866bcd0-a6ca-4b27-99c5-00530d6d84cf None admin] Validating token access rules against request {{(pid=282898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:36:36.956586 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c0c71d-74aa-4eac-ba1f-ebaca566c90f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:36:36.957567 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c0c71d-74aa-4eac-ba1f-ebaca566c90f None admin] REQUEST_METHOD: `GET` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:36:36.958014 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c0c71d-74aa-4eac-ba1f-ebaca566c90f None admin] SCRIPT_NAME: `/identity` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:36:36.958439 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c0c71d-74aa-4eac-ba1f-ebaca566c90f None admin] PATH_INFO: `/v3/groups/020da76b12ff4fd9bbcc6cfc67cc96f2` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:36:36.962746 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c0c71d-74aa-4eac-ba1f-ebaca566c90f None admin] RBAC: Authorizing `identity:get_group(group_id=020da76b12ff4fd9bbcc6cfc67cc96f2)` {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:36:36.964415 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c0c71d-74aa-4eac-ba1f-ebaca566c90f None admin] RBAC: Authorization granted {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:36:36.966269 dv-cinder-851351-1-smb devstack@keystone.service[282898]: [pid: 282898|app: 0|req: 191/385] 10.222.0.42 () {56 vars in 1180 bytes} [Thu Jul 28 08:36:36 2022] GET /identity/v3/groups/020da76b12ff4fd9bbcc6cfc67cc96f2 => generated 226 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:36:36.975769 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e542c7c-8a73-4a7a-8b51-9295660374e4 None admin] Authenticating user token {{(pid=282899) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:36:37.020696 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG dbcounter [-] [282899] Writing DB stats keystone:SELECT=100 {{(pid=282899) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:36:37.117114 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e542c7c-8a73-4a7a-8b51-9295660374e4 None admin] Validating token access rules against request {{(pid=282899) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:36:37.164264 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f072e8-b5c8-437f-a0b4-4e3d75963658 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282899) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:36:37.164888 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f072e8-b5c8-437f-a0b4-4e3d75963658 None admin] REQUEST_METHOD: `GET` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:36:37.165179 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f072e8-b5c8-437f-a0b4-4e3d75963658 None admin] SCRIPT_NAME: `/identity` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:36:37.165461 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f072e8-b5c8-437f-a0b4-4e3d75963658 None admin] PATH_INFO: `/v3/projects/c089873b22dd43e8a9de1c83b1355842` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:36:37.166679 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f072e8-b5c8-437f-a0b4-4e3d75963658 None admin] RBAC: Authorizing `identity:get_project(project_id=c089873b22dd43e8a9de1c83b1355842)` {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:36:37.168159 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f072e8-b5c8-437f-a0b4-4e3d75963658 None admin] RBAC: Authorization granted {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:36:37.170251 dv-cinder-851351-1-smb devstack@keystone.service[282899]: [pid: 282899|app: 0|req: 195/386] 10.222.0.42 () {56 vars in 1186 bytes} [Thu Jul 28 08:36:36 2022] GET /identity/v3/projects/c089873b22dd43e8a9de1c83b1355842 => generated 298 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:36:37.175855 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c0c71d-74aa-4eac-ba1f-ebaca566c90f None admin] Authenticating user token {{(pid=282898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:36:37.359793 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG dbcounter [-] [282898] Writing DB stats keystone:SELECT=100 {{(pid=282898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:36:37.371585 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c0c71d-74aa-4eac-ba1f-ebaca566c90f None admin] Validating token access rules against request {{(pid=282898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:36:37.409575 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2efecba6-223c-4ccb-96dd-cf86057e05c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:36:37.410359 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2efecba6-223c-4ccb-96dd-cf86057e05c0 None admin] REQUEST_METHOD: `PUT` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:36:37.410642 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2efecba6-223c-4ccb-96dd-cf86057e05c0 None admin] SCRIPT_NAME: `/identity` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:36:37.410973 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2efecba6-223c-4ccb-96dd-cf86057e05c0 None admin] PATH_INFO: `/v3/projects/c089873b22dd43e8a9de1c83b1355842/groups/020da76b12ff4fd9bbcc6cfc67cc96f2/roles/eaeb4674b16f497f8afb3384e7e9a3c6` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:36:37.412998 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2efecba6-223c-4ccb-96dd-cf86057e05c0 None admin] RBAC: Authorizing `identity:create_grant(project_id=c089873b22dd43e8a9de1c83b1355842, group_id=020da76b12ff4fd9bbcc6cfc67cc96f2, role_id=eaeb4674b16f497f8afb3384e7e9a3c6)` {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:36:37.414533 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2efecba6-223c-4ccb-96dd-cf86057e05c0 None admin] RBAC: Authorization granted {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:36:37.436902 dv-cinder-851351-1-smb devstack@keystone.service[282898]: [pid: 282898|app: 0|req: 192/387] 10.222.0.42 () {58 vars in 1442 bytes} [Thu Jul 28 08:36:37 2022] PUT /identity/v3/projects/c089873b22dd43e8a9de1c83b1355842/groups/020da76b12ff4fd9bbcc6cfc67cc96f2/roles/eaeb4674b16f497f8afb3384e7e9a3c6 => generated 0 bytes in 257 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 08:36:37.761265 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ab66f4-19de-454e-a9f8-33c3710fc17e None None] REQUEST_METHOD: `GET` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:36:37.761808 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ab66f4-19de-454e-a9f8-33c3710fc17e None None] SCRIPT_NAME: `/identity` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:36:37.761808 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ab66f4-19de-454e-a9f8-33c3710fc17e None None] PATH_INFO: `/` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:36:37.763405 dv-cinder-851351-1-smb devstack@keystone.service[282899]: [pid: 282899|app: 0|req: 196/388] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 08:36:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 08:36:37.769453 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50cf5803-c84e-4dc0-8505-ea405e8826bb None None] REQUEST_METHOD: `POST` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:36:37.769995 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50cf5803-c84e-4dc0-8505-ea405e8826bb None None] SCRIPT_NAME: `/identity` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:36:37.769995 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50cf5803-c84e-4dc0-8505-ea405e8826bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:36:37.800689 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.auth.core [None req-50cf5803-c84e-4dc0-8505-ea405e8826bb None None] MFA Rules not processed for user `2be990a66857410a87ffa7609aec4f7b`. Rule list: `[]` (Enabled: `True`). {{(pid=282898) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 08:36:37.800689 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.fernet_utils [None req-50cf5803-c84e-4dc0-8505-ea405e8826bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=282898) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:36:37.902756 dv-cinder-851351-1-smb devstack@keystone.service[282898]: [pid: 282898|app: 0|req: 193/389] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 08:36:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 28 08:36:37.942249 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ab66f4-19de-454e-a9f8-33c3710fc17e None None] Authenticating user token {{(pid=282899) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:36:38.077941 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ab66f4-19de-454e-a9f8-33c3710fc17e None None] Validating token access rules against request {{(pid=282899) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:36:38.080892 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG dbcounter [-] [282899] Writing DB stats keystone:SELECT=100 {{(pid=282899) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:36:38.125859 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97032385-7a9f-447b-9b65-88ddb7573d55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282899) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:36:38.126596 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97032385-7a9f-447b-9b65-88ddb7573d55 None admin] REQUEST_METHOD: `GET` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:36:38.126878 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97032385-7a9f-447b-9b65-88ddb7573d55 None admin] SCRIPT_NAME: `/identity` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:36:38.127162 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97032385-7a9f-447b-9b65-88ddb7573d55 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:36:38.144133 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97032385-7a9f-447b-9b65-88ddb7573d55 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 08:36:38.149272 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application [None req-97032385-7a9f-447b-9b65-88ddb7573d55 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 28 08:36:38.149272 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:36:38.149272 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:36:38.149272 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:36:38.149272 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:36:38.149272 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:36:38.149272 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:36:38.149272 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:36:38.149272 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:36:38.149272 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:36:38.149272 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:36:38.149272 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:36:38.149272 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 08:36:38.149272 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 08:36:38.149272 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 08:36:38.149272 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 08:36:38.150305 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 08:36:38.150305 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 08:36:38.150305 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 08:36:38.150305 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 08:36:38.150305 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:36:38.150305 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:36:38.150305 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:36:38.150305 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:36:38.150305 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:36:38.150305 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:36:38.150305 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:36:38.150305 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application with Lock( Jul 28 08:36:38.150305 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:36:38.150305 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:36:38.150305 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:36:38.150305 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:36:38.151862 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:36:38.151862 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:36:38.151862 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:36:38.151862 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:36:38.151862 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 08:36:38.151862 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 08:36:38.151862 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 08:36:38.151862 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 08:36:38.151862 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 08:36:38.151862 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 08:36:38.151862 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 28 08:36:38.151862 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application Jul 28 08:36:38.151862 dv-cinder-851351-1-smb devstack@keystone.service[282899]: [pid: 282899|app: 0|req: 197/390] 10.222.0.42 () {56 vars in 1114 bytes} [Thu Jul 28 08:36:37 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:36:38.156765 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50cf5803-c84e-4dc0-8505-ea405e8826bb None None] Authenticating user token {{(pid=282898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:36:38.290850 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG dbcounter [-] [282898] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=282898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:36:38.313700 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50cf5803-c84e-4dc0-8505-ea405e8826bb None None] Validating token access rules against request {{(pid=282898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:36:38.321724 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1d8bea-9925-41ae-ac16-226084498953 None None] REQUEST_METHOD: `GET` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:36:38.322024 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1d8bea-9925-41ae-ac16-226084498953 None None] SCRIPT_NAME: `/identity` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:36:38.322292 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1d8bea-9925-41ae-ac16-226084498953 None None] PATH_INFO: `/` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:36:38.323968 dv-cinder-851351-1-smb devstack@keystone.service[282899]: [pid: 282899|app: 0|req: 198/391] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 08:36:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 08:36:38.332682 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b152b7bc-6dfb-49eb-a653-66f2247871bf None None] REQUEST_METHOD: `POST` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:36:38.332951 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b152b7bc-6dfb-49eb-a653-66f2247871bf None None] SCRIPT_NAME: `/identity` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:36:38.333198 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b152b7bc-6dfb-49eb-a653-66f2247871bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:36:38.356444 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.auth.core [None req-b152b7bc-6dfb-49eb-a653-66f2247871bf None None] MFA Rules not processed for user `2be990a66857410a87ffa7609aec4f7b`. Rule list: `[]` (Enabled: `True`). {{(pid=282899) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 08:36:38.357963 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.fernet_utils [None req-b152b7bc-6dfb-49eb-a653-66f2247871bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=282899) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:36:38.362431 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2c5a8f-347e-4a46-9cc4-61d739c3ae5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:36:38.364006 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2c5a8f-347e-4a46-9cc4-61d739c3ae5e None admin] REQUEST_METHOD: `GET` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:36:38.364803 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2c5a8f-347e-4a46-9cc4-61d739c3ae5e None admin] SCRIPT_NAME: `/identity` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:36:38.365630 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2c5a8f-347e-4a46-9cc4-61d739c3ae5e None admin] PATH_INFO: `/v3/roles` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:36:38.367430 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb2c5a8f-347e-4a46-9cc4-61d739c3ae5e None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=282898) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:36:38.368290 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb2c5a8f-347e-4a46-9cc4-61d739c3ae5e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:36:38.370064 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb2c5a8f-347e-4a46-9cc4-61d739c3ae5e None admin] RBAC: Authorization granted {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:36:38.389608 dv-cinder-851351-1-smb devstack@keystone.service[282898]: [pid: 282898|app: 0|req: 194/392] 10.222.0.42 () {56 vars in 1111 bytes} [Thu Jul 28 08:36:38 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:36:38.395749 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2c5a8f-347e-4a46-9cc4-61d739c3ae5e None admin] Authenticating user token {{(pid=282898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:36:38.478151 dv-cinder-851351-1-smb devstack@keystone.service[282899]: [pid: 282899|app: 0|req: 199/393] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 08:36:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 08:36:38.515219 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b152b7bc-6dfb-49eb-a653-66f2247871bf None None] Authenticating user token {{(pid=282899) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:36:38.581021 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2c5a8f-347e-4a46-9cc4-61d739c3ae5e None admin] Validating token access rules against request {{(pid=282898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:36:38.618584 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG dbcounter [-] [282899] Writing DB stats keystone:SELECT=100 {{(pid=282899) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:36:38.627468 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b152b7bc-6dfb-49eb-a653-66f2247871bf None None] Validating token access rules against request {{(pid=282899) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:36:38.663792 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643bc371-ee7e-416b-8a0f-486f8cfbf491 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282899) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:36:38.665217 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643bc371-ee7e-416b-8a0f-486f8cfbf491 None admin] REQUEST_METHOD: `GET` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:36:38.665718 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643bc371-ee7e-416b-8a0f-486f8cfbf491 None admin] SCRIPT_NAME: `/identity` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:36:38.666190 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643bc371-ee7e-416b-8a0f-486f8cfbf491 None admin] PATH_INFO: `/v3/roles/member` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:36:38.666781 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab6532c-65d0-4fe2-8985-5b363e4c80f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:36:38.667512 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab6532c-65d0-4fe2-8985-5b363e4c80f4 None admin] REQUEST_METHOD: `GET` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:36:38.667864 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab6532c-65d0-4fe2-8985-5b363e4c80f4 None admin] SCRIPT_NAME: `/identity` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:36:38.668205 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab6532c-65d0-4fe2-8985-5b363e4c80f4 None admin] PATH_INFO: `/v3/groups/020da76b12ff4fd9bbcc6cfc67cc96f2` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:36:38.673374 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dab6532c-65d0-4fe2-8985-5b363e4c80f4 None admin] RBAC: Authorizing `identity:get_group(group_id=020da76b12ff4fd9bbcc6cfc67cc96f2)` {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:36:38.674938 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dab6532c-65d0-4fe2-8985-5b363e4c80f4 None admin] RBAC: Authorization granted {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:36:38.676937 dv-cinder-851351-1-smb devstack@keystone.service[282898]: [pid: 282898|app: 0|req: 195/394] 10.222.0.42 () {56 vars in 1180 bytes} [Thu Jul 28 08:36:38 2022] GET /identity/v3/groups/020da76b12ff4fd9bbcc6cfc67cc96f2 => generated 226 bytes in 281 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:36:38.684244 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-643bc371-ee7e-416b-8a0f-486f8cfbf491 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 08:36:38.685553 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab6532c-65d0-4fe2-8985-5b363e4c80f4 None admin] Authenticating user token {{(pid=282898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:36:38.690023 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application [None req-643bc371-ee7e-416b-8a0f-486f8cfbf491 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 28 08:36:38.690023 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:36:38.690023 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:36:38.690023 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:36:38.690023 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:36:38.690023 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:36:38.690023 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:36:38.690023 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:36:38.690023 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:36:38.690023 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:36:38.690023 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:36:38.690023 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:36:38.690023 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 08:36:38.690023 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 08:36:38.690023 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 08:36:38.690023 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 08:36:38.691173 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 08:36:38.691173 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 08:36:38.691173 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 08:36:38.691173 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 08:36:38.691173 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:36:38.691173 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:36:38.691173 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:36:38.691173 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:36:38.691173 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:36:38.691173 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:36:38.691173 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:36:38.691173 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application with Lock( Jul 28 08:36:38.691173 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:36:38.691173 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:36:38.691173 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:36:38.691173 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:36:38.692109 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:36:38.692109 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:36:38.692109 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:36:38.692109 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:36:38.692109 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 08:36:38.692109 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 08:36:38.692109 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 08:36:38.692109 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 08:36:38.692109 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 08:36:38.692109 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 08:36:38.692109 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 28 08:36:38.692109 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application Jul 28 08:36:38.694961 dv-cinder-851351-1-smb devstack@keystone.service[282899]: [pid: 282899|app: 0|req: 200/395] 10.222.0.42 () {56 vars in 1099 bytes} [Thu Jul 28 08:36:38 2022] GET /identity/v3/roles/member => generated 84 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 08:36:38.704689 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643bc371-ee7e-416b-8a0f-486f8cfbf491 None admin] Authenticating user token {{(pid=282899) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:36:38.718518 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG dbcounter [-] [282898] Writing DB stats keystone:SELECT=100 {{(pid=282898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:36:38.853998 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab6532c-65d0-4fe2-8985-5b363e4c80f4 None admin] Validating token access rules against request {{(pid=282898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:36:38.929196 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887704c6-21dd-49b2-a733-551f8629f1da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:36:38.930332 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887704c6-21dd-49b2-a733-551f8629f1da None admin] REQUEST_METHOD: `GET` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:36:38.930841 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887704c6-21dd-49b2-a733-551f8629f1da None admin] SCRIPT_NAME: `/identity` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:36:38.931410 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887704c6-21dd-49b2-a733-551f8629f1da None admin] PATH_INFO: `/v3/projects/c089873b22dd43e8a9de1c83b1355842` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:36:38.936265 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-887704c6-21dd-49b2-a733-551f8629f1da None admin] RBAC: Authorizing `identity:get_project(project_id=c089873b22dd43e8a9de1c83b1355842)` {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:36:38.936265 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-887704c6-21dd-49b2-a733-551f8629f1da None admin] RBAC: Authorization granted {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:36:38.942261 dv-cinder-851351-1-smb devstack@keystone.service[282898]: [pid: 282898|app: 0|req: 196/396] 10.222.0.42 () {56 vars in 1186 bytes} [Thu Jul 28 08:36:38 2022] GET /identity/v3/projects/c089873b22dd43e8a9de1c83b1355842 => generated 298 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:36:38.943954 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643bc371-ee7e-416b-8a0f-486f8cfbf491 None admin] Validating token access rules against request {{(pid=282899) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:36:38.944815 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2587cb16-1b5e-495e-abbf-0feb92478aed None None] REQUEST_METHOD: `GET` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:36:38.945320 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2587cb16-1b5e-495e-abbf-0feb92478aed None None] SCRIPT_NAME: `/identity` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:36:38.945832 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2587cb16-1b5e-495e-abbf-0feb92478aed None None] PATH_INFO: `/` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:36:38.947877 dv-cinder-851351-1-smb devstack@keystone.service[282898]: [pid: 282898|app: 0|req: 197/397] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 08:36:38 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 08:36:38.948930 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2587cb16-1b5e-495e-abbf-0feb92478aed None None] Authenticating user token {{(pid=282898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:36:38.997889 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa617cd-70c3-44f6-9a50-8c2dbcf8ca25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282899) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:36:38.998623 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa617cd-70c3-44f6-9a50-8c2dbcf8ca25 None admin] REQUEST_METHOD: `GET` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:36:38.998912 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa617cd-70c3-44f6-9a50-8c2dbcf8ca25 None admin] SCRIPT_NAME: `/identity` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:36:38.999186 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa617cd-70c3-44f6-9a50-8c2dbcf8ca25 None admin] PATH_INFO: `/v3/roles` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:36:38.999938 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa617cd-70c3-44f6-9a50-8c2dbcf8ca25 None admin] RBAC: Adding query filter params (name=member) {{(pid=282899) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:36:39.000248 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa617cd-70c3-44f6-9a50-8c2dbcf8ca25 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:36:39.002335 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa617cd-70c3-44f6-9a50-8c2dbcf8ca25 None admin] RBAC: Authorization granted {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:36:39.017074 dv-cinder-851351-1-smb devstack@keystone.service[282899]: [pid: 282899|app: 0|req: 201/398] 10.222.0.42 () {56 vars in 1101 bytes} [Thu Jul 28 08:36:38 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 312 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:36:39.019359 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608cba6d-7340-4678-bea0-59a61d4583bb None None] REQUEST_METHOD: `POST` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:36:39.019359 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608cba6d-7340-4678-bea0-59a61d4583bb None None] SCRIPT_NAME: `/identity` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:36:39.019359 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608cba6d-7340-4678-bea0-59a61d4583bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:36:39.040886 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.auth.core [None req-608cba6d-7340-4678-bea0-59a61d4583bb None None] MFA Rules not processed for user `2be990a66857410a87ffa7609aec4f7b`. Rule list: `[]` (Enabled: `True`). {{(pid=282899) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 08:36:39.042807 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.fernet_utils [None req-608cba6d-7340-4678-bea0-59a61d4583bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=282899) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:36:39.060539 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG dbcounter [-] [282899] Writing DB stats keystone:SELECT=100 {{(pid=282899) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:36:39.074489 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG dbcounter [-] [282898] Writing DB stats keystone:SELECT=100 {{(pid=282898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:36:39.098900 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2587cb16-1b5e-495e-abbf-0feb92478aed None None] Validating token access rules against request {{(pid=282898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:36:39.145903 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce31897d-c006-4d89-a454-8935593c4d47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:36:39.146598 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce31897d-c006-4d89-a454-8935593c4d47 None admin] REQUEST_METHOD: `PUT` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:36:39.146887 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce31897d-c006-4d89-a454-8935593c4d47 None admin] SCRIPT_NAME: `/identity` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:36:39.147162 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce31897d-c006-4d89-a454-8935593c4d47 None admin] PATH_INFO: `/v3/projects/c089873b22dd43e8a9de1c83b1355842/groups/020da76b12ff4fd9bbcc6cfc67cc96f2/roles/d76677105be344cc83022cbde8a22d8d` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:36:39.149378 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce31897d-c006-4d89-a454-8935593c4d47 None admin] RBAC: Authorizing `identity:create_grant(project_id=c089873b22dd43e8a9de1c83b1355842, group_id=020da76b12ff4fd9bbcc6cfc67cc96f2, role_id=d76677105be344cc83022cbde8a22d8d)` {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:36:39.150844 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce31897d-c006-4d89-a454-8935593c4d47 None admin] RBAC: Authorization granted {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:36:39.154341 dv-cinder-851351-1-smb devstack@keystone.service[282899]: [pid: 282899|app: 0|req: 202/399] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 08:36:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 08:36:39.155746 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f69a1c-c639-44df-ab64-66a39067a09e None None] REQUEST_METHOD: `GET` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:36:39.155935 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f69a1c-c639-44df-ab64-66a39067a09e None None] SCRIPT_NAME: `/identity` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:36:39.156301 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f69a1c-c639-44df-ab64-66a39067a09e None None] PATH_INFO: `/` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:36:39.157871 dv-cinder-851351-1-smb devstack@keystone.service[282899]: [pid: 282899|app: 0|req: 203/400] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 08:36:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 08:36:39.162707 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f69a1c-c639-44df-ab64-66a39067a09e None None] Authenticating user token {{(pid=282899) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:36:39.182363 dv-cinder-851351-1-smb devstack@keystone.service[282898]: [pid: 282898|app: 0|req: 198/401] 10.222.0.42 () {58 vars in 1442 bytes} [Thu Jul 28 08:36:38 2022] PUT /identity/v3/projects/c089873b22dd43e8a9de1c83b1355842/groups/020da76b12ff4fd9bbcc6cfc67cc96f2/roles/d76677105be344cc83022cbde8a22d8d => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 08:36:39.183335 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1a2a8d-3772-480d-b7cc-fd35e6f76fac None None] REQUEST_METHOD: `POST` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:36:39.183628 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1a2a8d-3772-480d-b7cc-fd35e6f76fac None None] SCRIPT_NAME: `/identity` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:36:39.183960 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1a2a8d-3772-480d-b7cc-fd35e6f76fac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:36:39.229473 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.auth.core [None req-2e1a2a8d-3772-480d-b7cc-fd35e6f76fac None None] MFA Rules not processed for user `2be990a66857410a87ffa7609aec4f7b`. Rule list: `[]` (Enabled: `True`). {{(pid=282898) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 08:36:39.232808 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.fernet_utils [None req-2e1a2a8d-3772-480d-b7cc-fd35e6f76fac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=282898) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:36:39.370560 dv-cinder-851351-1-smb devstack@keystone.service[282898]: [pid: 282898|app: 0|req: 199/402] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 08:36:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 08:36:39.376981 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f69a1c-c639-44df-ab64-66a39067a09e None None] Validating token access rules against request {{(pid=282899) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:36:39.377086 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1a2a8d-3772-480d-b7cc-fd35e6f76fac None None] Authenticating user token {{(pid=282898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:36:39.411514 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97db6772-5988-4baf-9fcf-5910baf319bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282899) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:36:39.412176 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97db6772-5988-4baf-9fcf-5910baf319bb None admin] REQUEST_METHOD: `GET` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:36:39.412463 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97db6772-5988-4baf-9fcf-5910baf319bb None admin] SCRIPT_NAME: `/identity` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:36:39.414089 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97db6772-5988-4baf-9fcf-5910baf319bb None admin] PATH_INFO: `/v3/groups/020da76b12ff4fd9bbcc6cfc67cc96f2` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:36:39.414089 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97db6772-5988-4baf-9fcf-5910baf319bb None admin] RBAC: Authorizing `identity:get_group(group_id=020da76b12ff4fd9bbcc6cfc67cc96f2)` {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:36:39.415626 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97db6772-5988-4baf-9fcf-5910baf319bb None admin] RBAC: Authorization granted {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:36:39.417204 dv-cinder-851351-1-smb devstack@keystone.service[282899]: [pid: 282899|app: 0|req: 204/403] 10.222.0.42 () {56 vars in 1180 bytes} [Thu Jul 28 08:36:39 2022] GET /identity/v3/groups/020da76b12ff4fd9bbcc6cfc67cc96f2 => generated 226 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:36:39.417891 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97db6772-5988-4baf-9fcf-5910baf319bb None admin] Authenticating user token {{(pid=282899) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:36:39.437076 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG dbcounter [-] [282899] Writing DB stats keystone:SELECT=100 {{(pid=282899) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:36:39.462751 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG dbcounter [-] [282898] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=282898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:36:39.498976 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1a2a8d-3772-480d-b7cc-fd35e6f76fac None None] Validating token access rules against request {{(pid=282898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:36:39.531615 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97db6772-5988-4baf-9fcf-5910baf319bb None admin] Validating token access rules against request {{(pid=282899) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:36:39.535394 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ed5e00-df4c-490d-bf66-c53d8f553b10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:36:39.535967 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ed5e00-df4c-490d-bf66-c53d8f553b10 None admin] REQUEST_METHOD: `GET` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:36:39.536320 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ed5e00-df4c-490d-bf66-c53d8f553b10 None admin] SCRIPT_NAME: `/identity` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:36:39.536684 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ed5e00-df4c-490d-bf66-c53d8f553b10 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:36:39.548141 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3ed5e00-df4c-490d-bf66-c53d8f553b10 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 08:36:39.553495 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application [None req-e3ed5e00-df4c-490d-bf66-c53d8f553b10 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 28 08:36:39.553495 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:36:39.553495 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:36:39.553495 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:36:39.553495 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:36:39.553495 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:36:39.553495 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:36:39.553495 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:36:39.553495 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:36:39.553495 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:36:39.553495 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:36:39.553495 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:36:39.553495 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 08:36:39.553495 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 08:36:39.553495 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 08:36:39.553495 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 08:36:39.554604 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 08:36:39.554604 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 08:36:39.554604 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 08:36:39.554604 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 08:36:39.554604 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:36:39.554604 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:36:39.554604 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:36:39.554604 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:36:39.554604 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:36:39.554604 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:36:39.554604 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:36:39.554604 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application with Lock( Jul 28 08:36:39.554604 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:36:39.554604 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:36:39.554604 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:36:39.554604 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:36:39.555569 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:36:39.555569 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:36:39.555569 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:36:39.555569 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:36:39.555569 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 08:36:39.555569 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 08:36:39.555569 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 08:36:39.555569 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 08:36:39.555569 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 08:36:39.555569 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 08:36:39.555569 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 28 08:36:39.555569 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application Jul 28 08:36:39.555569 dv-cinder-851351-1-smb devstack@keystone.service[282898]: [pid: 282898|app: 0|req: 200/404] 10.222.0.42 () {56 vars in 1114 bytes} [Thu Jul 28 08:36:39 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:36:39.560981 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ed5e00-df4c-490d-bf66-c53d8f553b10 None admin] Authenticating user token {{(pid=282898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:36:39.575064 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc30f0e-4493-456f-a376-9d81b87ff692 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282899) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:36:39.576079 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc30f0e-4493-456f-a376-9d81b87ff692 None admin] REQUEST_METHOD: `GET` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:36:39.576584 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc30f0e-4493-456f-a376-9d81b87ff692 None admin] SCRIPT_NAME: `/identity` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:36:39.577098 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc30f0e-4493-456f-a376-9d81b87ff692 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:36:39.589511 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bc30f0e-4493-456f-a376-9d81b87ff692 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 08:36:39.597483 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application [None req-4bc30f0e-4493-456f-a376-9d81b87ff692 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 08:36:39.597483 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:36:39.597483 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:36:39.597483 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:36:39.597483 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:36:39.597483 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:36:39.597483 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:36:39.597483 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:36:39.597483 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:36:39.597483 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:36:39.597483 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:36:39.597483 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:36:39.597483 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 08:36:39.597483 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 08:36:39.597483 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 08:36:39.597483 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 08:36:39.598574 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 08:36:39.598574 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 08:36:39.598574 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 08:36:39.598574 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 08:36:39.598574 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:36:39.598574 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:36:39.598574 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:36:39.598574 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:36:39.598574 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:36:39.598574 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:36:39.598574 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:36:39.598574 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application with Lock( Jul 28 08:36:39.598574 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:36:39.598574 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:36:39.598574 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:36:39.598574 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:36:39.599522 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:36:39.599522 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:36:39.599522 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:36:39.599522 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:36:39.599522 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 08:36:39.599522 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 08:36:39.599522 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 08:36:39.599522 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 08:36:39.599522 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 08:36:39.599522 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 08:36:39.599522 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 08:36:39.599522 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application Jul 28 08:36:39.608368 dv-cinder-851351-1-smb devstack@keystone.service[282899]: [pid: 282899|app: 0|req: 205/405] 10.222.0.42 () {56 vars in 1096 bytes} [Thu Jul 28 08:36:39 2022] GET /identity/v3/roles/admin => generated 83 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:36:39.609689 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc30f0e-4493-456f-a376-9d81b87ff692 None admin] Authenticating user token {{(pid=282899) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:36:39.679212 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ed5e00-df4c-490d-bf66-c53d8f553b10 None admin] Validating token access rules against request {{(pid=282898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:36:39.711545 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG dbcounter [-] [282898] Writing DB stats keystone:SELECT=100 {{(pid=282898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:36:39.721452 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e510b21-836f-493b-b1cd-fc3f9fb55a55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:36:39.722696 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG dbcounter [-] [282899] Writing DB stats keystone:SELECT=100 {{(pid=282899) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:36:39.723923 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e510b21-836f-493b-b1cd-fc3f9fb55a55 None admin] REQUEST_METHOD: `GET` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:36:39.724384 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e510b21-836f-493b-b1cd-fc3f9fb55a55 None admin] SCRIPT_NAME: `/identity` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:36:39.724851 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e510b21-836f-493b-b1cd-fc3f9fb55a55 None admin] PATH_INFO: `/v3/projects/305114c1888a404186311d18de60f67f` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:36:39.727067 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e510b21-836f-493b-b1cd-fc3f9fb55a55 None admin] RBAC: Authorizing `identity:get_project(project_id=305114c1888a404186311d18de60f67f)` {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:36:39.729069 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e510b21-836f-493b-b1cd-fc3f9fb55a55 None admin] RBAC: Authorization granted {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:36:39.732860 dv-cinder-851351-1-smb devstack@keystone.service[282898]: [pid: 282898|app: 0|req: 201/406] 10.222.0.42 () {56 vars in 1186 bytes} [Thu Jul 28 08:36:39 2022] GET /identity/v3/projects/305114c1888a404186311d18de60f67f => generated 302 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:36:39.733940 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e510b21-836f-493b-b1cd-fc3f9fb55a55 None admin] Authenticating user token {{(pid=282898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:36:39.758251 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc30f0e-4493-456f-a376-9d81b87ff692 None admin] Validating token access rules against request {{(pid=282899) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:36:39.809188 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4884c2d-5bce-42fb-907c-aa6f115bc842 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282899) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:36:39.810526 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4884c2d-5bce-42fb-907c-aa6f115bc842 None admin] REQUEST_METHOD: `GET` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:36:39.811001 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4884c2d-5bce-42fb-907c-aa6f115bc842 None admin] SCRIPT_NAME: `/identity` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:36:39.811965 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4884c2d-5bce-42fb-907c-aa6f115bc842 None admin] PATH_INFO: `/v3/roles` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:36:39.812926 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4884c2d-5bce-42fb-907c-aa6f115bc842 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=282899) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:36:39.813414 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4884c2d-5bce-42fb-907c-aa6f115bc842 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:36:39.819765 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4884c2d-5bce-42fb-907c-aa6f115bc842 None admin] RBAC: Authorization granted {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:36:39.833729 dv-cinder-851351-1-smb devstack@keystone.service[282899]: [pid: 282899|app: 0|req: 206/407] 10.222.0.42 () {56 vars in 1111 bytes} [Thu Jul 28 08:36:39 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:36:39.835057 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4884c2d-5bce-42fb-907c-aa6f115bc842 None admin] Authenticating user token {{(pid=282899) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:36:39.880602 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e510b21-836f-493b-b1cd-fc3f9fb55a55 None admin] Validating token access rules against request {{(pid=282898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:36:39.928616 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f83ce38-bf5f-48d5-aa6f-24b0c041e1fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:36:39.929716 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f83ce38-bf5f-48d5-aa6f-24b0c041e1fd None admin] REQUEST_METHOD: `GET` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:36:39.930651 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f83ce38-bf5f-48d5-aa6f-24b0c041e1fd None admin] SCRIPT_NAME: `/identity` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:36:39.931173 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f83ce38-bf5f-48d5-aa6f-24b0c041e1fd None admin] PATH_INFO: `/v3/roles` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:36:39.932532 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f83ce38-bf5f-48d5-aa6f-24b0c041e1fd None admin] RBAC: Adding query filter params (name=admin) {{(pid=282898) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:36:39.933042 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f83ce38-bf5f-48d5-aa6f-24b0c041e1fd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:36:39.934729 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f83ce38-bf5f-48d5-aa6f-24b0c041e1fd None admin] RBAC: Authorization granted {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:36:39.944342 dv-cinder-851351-1-smb devstack@keystone.service[282898]: [pid: 282898|app: 0|req: 202/408] 10.222.0.42 () {56 vars in 1099 bytes} [Thu Jul 28 08:36:39 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:36:39.945714 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f83ce38-bf5f-48d5-aa6f-24b0c041e1fd None admin] Authenticating user token {{(pid=282898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:36:39.955941 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4884c2d-5bce-42fb-907c-aa6f115bc842 None admin] Validating token access rules against request {{(pid=282899) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:36:39.992568 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da3d692e-01d5-4b1d-84eb-523a344b1d7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282899) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:36:39.993209 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3d692e-01d5-4b1d-84eb-523a344b1d7c None admin] REQUEST_METHOD: `PUT` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:36:39.993504 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3d692e-01d5-4b1d-84eb-523a344b1d7c None admin] SCRIPT_NAME: `/identity` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:36:39.993786 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3d692e-01d5-4b1d-84eb-523a344b1d7c None admin] PATH_INFO: `/v3/projects/305114c1888a404186311d18de60f67f/groups/020da76b12ff4fd9bbcc6cfc67cc96f2/roles/eaeb4674b16f497f8afb3384e7e9a3c6` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:36:39.995797 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da3d692e-01d5-4b1d-84eb-523a344b1d7c None admin] RBAC: Authorizing `identity:create_grant(project_id=305114c1888a404186311d18de60f67f, group_id=020da76b12ff4fd9bbcc6cfc67cc96f2, role_id=eaeb4674b16f497f8afb3384e7e9a3c6)` {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:36:39.997327 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da3d692e-01d5-4b1d-84eb-523a344b1d7c None admin] RBAC: Authorization granted {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:36:40.001039 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG dbcounter [-] [282899] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=282899) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:36:40.013540 dv-cinder-851351-1-smb devstack@keystone.service[282899]: [pid: 282899|app: 0|req: 207/409] 10.222.0.42 () {58 vars in 1442 bytes} [Thu Jul 28 08:36:39 2022] PUT /identity/v3/projects/305114c1888a404186311d18de60f67f/groups/020da76b12ff4fd9bbcc6cfc67cc96f2/roles/eaeb4674b16f497f8afb3384e7e9a3c6 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 08:36:40.015541 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG dbcounter [-] [282898] Writing DB stats keystone:SELECT=100 {{(pid=282898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:36:40.023553 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da3d692e-01d5-4b1d-84eb-523a344b1d7c None admin] Authenticating user token {{(pid=282899) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:36:40.065535 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f83ce38-bf5f-48d5-aa6f-24b0c041e1fd None admin] Validating token access rules against request {{(pid=282898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:36:40.116501 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb7eabb7-95f6-46e0-96b5-e3bf13749d29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:36:40.118201 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7eabb7-95f6-46e0-96b5-e3bf13749d29 None admin] REQUEST_METHOD: `GET` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:36:40.118682 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7eabb7-95f6-46e0-96b5-e3bf13749d29 None admin] SCRIPT_NAME: `/identity` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:36:40.119411 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7eabb7-95f6-46e0-96b5-e3bf13749d29 None admin] PATH_INFO: `/v3/groups/020da76b12ff4fd9bbcc6cfc67cc96f2` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:36:40.120914 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb7eabb7-95f6-46e0-96b5-e3bf13749d29 None admin] RBAC: Authorizing `identity:get_group(group_id=020da76b12ff4fd9bbcc6cfc67cc96f2)` {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:36:40.122941 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb7eabb7-95f6-46e0-96b5-e3bf13749d29 None admin] RBAC: Authorization granted {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:36:40.126309 dv-cinder-851351-1-smb devstack@keystone.service[282898]: [pid: 282898|app: 0|req: 203/410] 10.222.0.42 () {56 vars in 1180 bytes} [Thu Jul 28 08:36:39 2022] GET /identity/v3/groups/020da76b12ff4fd9bbcc6cfc67cc96f2 => generated 226 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:36:40.129372 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a428588-ebf2-41de-81f6-d8946b96aabf None None] REQUEST_METHOD: `GET` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:36:40.129866 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a428588-ebf2-41de-81f6-d8946b96aabf None None] SCRIPT_NAME: `/identity` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:36:40.130332 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a428588-ebf2-41de-81f6-d8946b96aabf None None] PATH_INFO: `/` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:36:40.136988 dv-cinder-851351-1-smb devstack@keystone.service[282898]: [pid: 282898|app: 0|req: 204/411] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 08:36:40 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 08:36:40.138240 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a428588-ebf2-41de-81f6-d8946b96aabf None None] Authenticating user token {{(pid=282898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:36:40.175653 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da3d692e-01d5-4b1d-84eb-523a344b1d7c None admin] Validating token access rules against request {{(pid=282899) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:36:40.219924 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af7a5001-a438-4b92-b4d8-bcd37fe88f92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282899) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:36:40.220598 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7a5001-a438-4b92-b4d8-bcd37fe88f92 None admin] REQUEST_METHOD: `GET` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:36:40.220925 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7a5001-a438-4b92-b4d8-bcd37fe88f92 None admin] SCRIPT_NAME: `/identity` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:36:40.221200 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7a5001-a438-4b92-b4d8-bcd37fe88f92 None admin] PATH_INFO: `/v3/groups/3313e717dec84a479129e19f12df1137` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:36:40.222494 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af7a5001-a438-4b92-b4d8-bcd37fe88f92 None admin] RBAC: Authorizing `identity:get_group(group_id=3313e717dec84a479129e19f12df1137)` {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:36:40.223991 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af7a5001-a438-4b92-b4d8-bcd37fe88f92 None admin] RBAC: Authorization granted {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:36:40.225963 dv-cinder-851351-1-smb devstack@keystone.service[282899]: [pid: 282899|app: 0|req: 208/412] 10.222.0.42 () {56 vars in 1180 bytes} [Thu Jul 28 08:36:40 2022] GET /identity/v3/groups/3313e717dec84a479129e19f12df1137 => generated 229 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:36:40.227174 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750a68f7-f00f-4fa1-8133-cc1e5ece853b None None] REQUEST_METHOD: `POST` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:36:40.227464 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750a68f7-f00f-4fa1-8133-cc1e5ece853b None None] SCRIPT_NAME: `/identity` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:36:40.227742 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750a68f7-f00f-4fa1-8133-cc1e5ece853b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:36:40.253910 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.auth.core [None req-750a68f7-f00f-4fa1-8133-cc1e5ece853b None None] MFA Rules not processed for user `2be990a66857410a87ffa7609aec4f7b`. Rule list: `[]` (Enabled: `True`). {{(pid=282899) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 08:36:40.255685 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.fernet_utils [None req-750a68f7-f00f-4fa1-8133-cc1e5ece853b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=282899) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:36:40.261479 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a428588-ebf2-41de-81f6-d8946b96aabf None None] Validating token access rules against request {{(pid=282898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:36:40.293321 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG dbcounter [-] [282898] Writing DB stats keystone:SELECT=100 {{(pid=282898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:36:40.299790 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9cf9c3-40be-456c-b015-929b11e6e443 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:36:40.300635 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9cf9c3-40be-456c-b015-929b11e6e443 None admin] REQUEST_METHOD: `GET` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:36:40.301047 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9cf9c3-40be-456c-b015-929b11e6e443 None admin] SCRIPT_NAME: `/identity` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:36:40.301388 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9cf9c3-40be-456c-b015-929b11e6e443 None admin] PATH_INFO: `/v3/projects/305114c1888a404186311d18de60f67f` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:36:40.302879 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf9cf9c3-40be-456c-b015-929b11e6e443 None admin] RBAC: Authorizing `identity:get_project(project_id=305114c1888a404186311d18de60f67f)` {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:36:40.304455 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf9cf9c3-40be-456c-b015-929b11e6e443 None admin] RBAC: Authorization granted {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:36:40.306693 dv-cinder-851351-1-smb devstack@keystone.service[282898]: [pid: 282898|app: 0|req: 205/413] 10.222.0.42 () {56 vars in 1186 bytes} [Thu Jul 28 08:36:40 2022] GET /identity/v3/projects/305114c1888a404186311d18de60f67f => generated 302 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:36:40.307869 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9cf9c3-40be-456c-b015-929b11e6e443 None admin] Authenticating user token {{(pid=282898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:36:40.331898 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG dbcounter [-] [282899] Writing DB stats keystone:SELECT=100 {{(pid=282899) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:36:40.342566 dv-cinder-851351-1-smb devstack@keystone.service[282899]: [pid: 282899|app: 0|req: 209/414] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 08:36:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 08:36:40.343722 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-750a68f7-f00f-4fa1-8133-cc1e5ece853b None None] Authenticating user token {{(pid=282899) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:36:40.455330 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9cf9c3-40be-456c-b015-929b11e6e443 None admin] Validating token access rules against request {{(pid=282898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:36:40.463076 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-750a68f7-f00f-4fa1-8133-cc1e5ece853b None None] Validating token access rules against request {{(pid=282899) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:36:40.493199 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-301eae31-c98f-44fd-9e62-43e6faa255ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:36:40.494287 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301eae31-c98f-44fd-9e62-43e6faa255ab None admin] REQUEST_METHOD: `GET` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:36:40.494832 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301eae31-c98f-44fd-9e62-43e6faa255ab None admin] SCRIPT_NAME: `/identity` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:36:40.495421 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301eae31-c98f-44fd-9e62-43e6faa255ab None admin] PATH_INFO: `/v3/projects/0c423333fe4246a29efc0aa6050bba26` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:36:40.496899 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-301eae31-c98f-44fd-9e62-43e6faa255ab None admin] RBAC: Authorizing `identity:get_project(project_id=0c423333fe4246a29efc0aa6050bba26)` {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:36:40.498608 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-301eae31-c98f-44fd-9e62-43e6faa255ab None admin] RBAC: Authorization granted {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:36:40.504809 dv-cinder-851351-1-smb devstack@keystone.service[282898]: [pid: 282898|app: 0|req: 206/415] 10.222.0.42 () {56 vars in 1186 bytes} [Thu Jul 28 08:36:40 2022] GET /identity/v3/projects/0c423333fe4246a29efc0aa6050bba26 => generated 344 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:36:40.505888 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-301eae31-c98f-44fd-9e62-43e6faa255ab None admin] Authenticating user token {{(pid=282898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:36:40.507273 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aaa94d6-23d5-4ed6-be26-cd285c43eb42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282899) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:36:40.507728 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aaa94d6-23d5-4ed6-be26-cd285c43eb42 None admin] REQUEST_METHOD: `PUT` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:36:40.507842 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aaa94d6-23d5-4ed6-be26-cd285c43eb42 None admin] SCRIPT_NAME: `/identity` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:36:40.508107 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aaa94d6-23d5-4ed6-be26-cd285c43eb42 None admin] PATH_INFO: `/v3/projects/305114c1888a404186311d18de60f67f/groups/020da76b12ff4fd9bbcc6cfc67cc96f2/roles/d76677105be344cc83022cbde8a22d8d` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:36:40.510832 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aaa94d6-23d5-4ed6-be26-cd285c43eb42 None admin] RBAC: Authorizing `identity:create_grant(project_id=305114c1888a404186311d18de60f67f, group_id=020da76b12ff4fd9bbcc6cfc67cc96f2, role_id=d76677105be344cc83022cbde8a22d8d)` {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:36:40.513394 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aaa94d6-23d5-4ed6-be26-cd285c43eb42 None admin] RBAC: Authorization granted {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:36:40.539357 dv-cinder-851351-1-smb devstack@keystone.service[282899]: [pid: 282899|app: 0|req: 210/416] 10.222.0.42 () {58 vars in 1442 bytes} [Thu Jul 28 08:36:40 2022] PUT /identity/v3/projects/305114c1888a404186311d18de60f67f/groups/020da76b12ff4fd9bbcc6cfc67cc96f2/roles/d76677105be344cc83022cbde8a22d8d => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 08:36:40.546490 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aaa94d6-23d5-4ed6-be26-cd285c43eb42 None admin] Authenticating user token {{(pid=282899) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:36:40.637069 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG dbcounter [-] [282898] Writing DB stats keystone:SELECT=100 {{(pid=282898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:36:40.665885 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG dbcounter [-] [282899] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=282899) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:36:40.717884 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-301eae31-c98f-44fd-9e62-43e6faa255ab None admin] Validating token access rules against request {{(pid=282898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:36:40.744844 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aaa94d6-23d5-4ed6-be26-cd285c43eb42 None admin] Validating token access rules against request {{(pid=282899) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:36:40.763573 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7cbb36-e948-4216-9741-bf5a89cc3270 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:36:40.764229 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7cbb36-e948-4216-9741-bf5a89cc3270 None admin] REQUEST_METHOD: `GET` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:36:40.764517 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7cbb36-e948-4216-9741-bf5a89cc3270 None admin] SCRIPT_NAME: `/identity` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:36:40.765337 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7cbb36-e948-4216-9741-bf5a89cc3270 None admin] PATH_INFO: `/v3/roles/member` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:36:40.776569 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b7cbb36-e948-4216-9741-bf5a89cc3270 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 08:36:40.782154 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application [None req-0b7cbb36-e948-4216-9741-bf5a89cc3270 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 28 08:36:40.782154 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:36:40.782154 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:36:40.782154 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:36:40.782154 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:36:40.782154 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:36:40.782154 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:36:40.782154 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:36:40.782154 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:36:40.782154 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:36:40.782154 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:36:40.782154 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:36:40.782154 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 08:36:40.782154 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 08:36:40.782154 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 08:36:40.782154 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 08:36:40.783410 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 08:36:40.783410 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 08:36:40.783410 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 08:36:40.783410 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 08:36:40.783410 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:36:40.783410 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:36:40.783410 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:36:40.783410 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:36:40.783410 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:36:40.783410 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:36:40.783410 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:36:40.783410 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application with Lock( Jul 28 08:36:40.783410 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:36:40.783410 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:36:40.783410 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:36:40.783410 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:36:40.784772 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:36:40.784772 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:36:40.784772 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:36:40.784772 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:36:40.784772 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 08:36:40.784772 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 08:36:40.784772 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 08:36:40.784772 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 08:36:40.784772 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 08:36:40.784772 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 08:36:40.784772 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 28 08:36:40.784772 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application Jul 28 08:36:40.784772 dv-cinder-851351-1-smb devstack@keystone.service[282898]: [pid: 282898|app: 0|req: 207/417] 10.222.0.42 () {56 vars in 1099 bytes} [Thu Jul 28 08:36:40 2022] GET /identity/v3/roles/member => generated 84 bytes in 278 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:36:40.790283 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7cbb36-e948-4216-9741-bf5a89cc3270 None admin] Authenticating user token {{(pid=282898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:36:40.790743 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4977fe3-f76b-4144-9f46-880a634a3368 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282899) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:36:40.791648 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4977fe3-f76b-4144-9f46-880a634a3368 None admin] REQUEST_METHOD: `PUT` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:36:40.792092 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4977fe3-f76b-4144-9f46-880a634a3368 None admin] SCRIPT_NAME: `/identity` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:36:40.792526 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4977fe3-f76b-4144-9f46-880a634a3368 None admin] PATH_INFO: `/v3/projects/0c423333fe4246a29efc0aa6050bba26/groups/3313e717dec84a479129e19f12df1137/roles/a0e2a00bf94d40f38629d6b5293e3aee` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:36:40.798499 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4977fe3-f76b-4144-9f46-880a634a3368 None admin] RBAC: Authorizing `identity:create_grant(project_id=0c423333fe4246a29efc0aa6050bba26, group_id=3313e717dec84a479129e19f12df1137, role_id=a0e2a00bf94d40f38629d6b5293e3aee)` {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:36:40.800485 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4977fe3-f76b-4144-9f46-880a634a3368 None admin] RBAC: Authorization granted {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:36:40.817238 dv-cinder-851351-1-smb devstack@keystone.service[282899]: [pid: 282899|app: 0|req: 211/418] 10.222.0.42 () {58 vars in 1442 bytes} [Thu Jul 28 08:36:40 2022] PUT /identity/v3/projects/0c423333fe4246a29efc0aa6050bba26/groups/3313e717dec84a479129e19f12df1137/roles/a0e2a00bf94d40f38629d6b5293e3aee => generated 0 bytes in 277 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 08:36:40.938679 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7cbb36-e948-4216-9741-bf5a89cc3270 None admin] Validating token access rules against request {{(pid=282898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:36:40.968062 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG dbcounter [-] [282898] Writing DB stats keystone:SELECT=100 {{(pid=282898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:36:40.984311 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3c7242-5fc8-47b3-a1be-905d46aa0be0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:36:40.984991 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3c7242-5fc8-47b3-a1be-905d46aa0be0 None admin] REQUEST_METHOD: `GET` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:36:40.985274 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3c7242-5fc8-47b3-a1be-905d46aa0be0 None admin] SCRIPT_NAME: `/identity` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:36:40.985551 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3c7242-5fc8-47b3-a1be-905d46aa0be0 None admin] PATH_INFO: `/v3/roles` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:36:40.986307 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de3c7242-5fc8-47b3-a1be-905d46aa0be0 None admin] RBAC: Adding query filter params (name=member) {{(pid=282898) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:36:40.986616 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de3c7242-5fc8-47b3-a1be-905d46aa0be0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:36:40.988217 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de3c7242-5fc8-47b3-a1be-905d46aa0be0 None admin] RBAC: Authorization granted {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:36:40.998101 dv-cinder-851351-1-smb devstack@keystone.service[282898]: [pid: 282898|app: 0|req: 208/419] 10.222.0.42 () {56 vars in 1101 bytes} [Thu Jul 28 08:36:40 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 08:36:41.004039 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4977fe3-f76b-4144-9f46-880a634a3368 None admin] Authenticating user token {{(pid=282899) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:36:41.123219 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4977fe3-f76b-4144-9f46-880a634a3368 None admin] Validating token access rules against request {{(pid=282899) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:36:41.139016 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG dbcounter [-] [282899] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=282899) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:36:41.161307 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd3e1bb-bb33-4bbe-9c24-cfc1769bb7e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282899) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:36:41.162283 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd3e1bb-bb33-4bbe-9c24-cfc1769bb7e4 None admin] REQUEST_METHOD: `GET` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:36:41.162636 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd3e1bb-bb33-4bbe-9c24-cfc1769bb7e4 None admin] SCRIPT_NAME: `/identity` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:36:41.163071 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd3e1bb-bb33-4bbe-9c24-cfc1769bb7e4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:36:41.250100 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fd3e1bb-bb33-4bbe-9c24-cfc1769bb7e4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:36:41.251621 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fd3e1bb-bb33-4bbe-9c24-cfc1769bb7e4 None admin] RBAC: Authorization granted {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:36:41.363053 dv-cinder-851351-1-smb devstack@keystone.service[282899]: [pid: 282899|app: 0|req: 212/420] 10.222.0.42 () {58 vars in 1282 bytes} [Thu Jul 28 08:36:41 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 359 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 28 08:36:41.369230 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3c7242-5fc8-47b3-a1be-905d46aa0be0 None admin] Authenticating user token {{(pid=282898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:36:41.410531 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3343927-4ea5-49d6-9eea-be36662bb3e3 None None] REQUEST_METHOD: `GET` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:36:41.410531 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3343927-4ea5-49d6-9eea-be36662bb3e3 None None] SCRIPT_NAME: `/identity` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:36:41.410531 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3343927-4ea5-49d6-9eea-be36662bb3e3 None None] PATH_INFO: `/` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:36:41.410531 dv-cinder-851351-1-smb devstack@keystone.service[282899]: [pid: 282899|app: 0|req: 213/421] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 08:36:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 08:36:41.415733 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5596cec-d0fd-4f7c-82a2-d24a6346a7eb None None] REQUEST_METHOD: `POST` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:36:41.415993 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5596cec-d0fd-4f7c-82a2-d24a6346a7eb None None] SCRIPT_NAME: `/identity` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:36:41.416280 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5596cec-d0fd-4f7c-82a2-d24a6346a7eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:36:41.435570 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.auth.core [None req-d5596cec-d0fd-4f7c-82a2-d24a6346a7eb None None] MFA Rules not processed for user `2be990a66857410a87ffa7609aec4f7b`. Rule list: `[]` (Enabled: `True`). {{(pid=282899) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 08:36:41.436739 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.fernet_utils [None req-d5596cec-d0fd-4f7c-82a2-d24a6346a7eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=282899) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:36:41.447063 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG dbcounter [-] [282899] Writing DB stats keystone:SELECT=100 {{(pid=282899) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:36:41.530318 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3c7242-5fc8-47b3-a1be-905d46aa0be0 None admin] Validating token access rules against request {{(pid=282898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:36:41.567999 dv-cinder-851351-1-smb devstack@keystone.service[282899]: [pid: 282899|app: 0|req: 214/422] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 08:36:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 28 08:36:41.574359 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072dc2dc-b6c8-40cd-bb36-8b6f68348e05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:36:41.575034 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072dc2dc-b6c8-40cd-bb36-8b6f68348e05 None admin] REQUEST_METHOD: `GET` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:36:41.575319 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072dc2dc-b6c8-40cd-bb36-8b6f68348e05 None admin] SCRIPT_NAME: `/identity` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:36:41.575596 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072dc2dc-b6c8-40cd-bb36-8b6f68348e05 None admin] PATH_INFO: `/v3/projects/c089873b22dd43e8a9de1c83b1355842` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:36:41.576841 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-072dc2dc-b6c8-40cd-bb36-8b6f68348e05 None admin] RBAC: Authorizing `identity:get_project(project_id=c089873b22dd43e8a9de1c83b1355842)` {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:36:41.578377 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-072dc2dc-b6c8-40cd-bb36-8b6f68348e05 None admin] RBAC: Authorization granted {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:36:41.580815 dv-cinder-851351-1-smb devstack@keystone.service[282898]: [pid: 282898|app: 0|req: 209/423] 10.222.0.42 () {56 vars in 1186 bytes} [Thu Jul 28 08:36:41 2022] GET /identity/v3/projects/c089873b22dd43e8a9de1c83b1355842 => generated 298 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:36:41.586280 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5596cec-d0fd-4f7c-82a2-d24a6346a7eb None None] Authenticating user token {{(pid=282899) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:36:41.641913 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072dc2dc-b6c8-40cd-bb36-8b6f68348e05 None admin] Authenticating user token {{(pid=282898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:36:41.734722 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5596cec-d0fd-4f7c-82a2-d24a6346a7eb None None] Validating token access rules against request {{(pid=282899) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:36:41.748886 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG dbcounter [-] [282898] Writing DB stats keystone:SELECT=100 {{(pid=282898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:36:41.798285 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0296540c-71c1-4121-b48b-77ebb2d53559 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282899) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:36:41.799417 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0296540c-71c1-4121-b48b-77ebb2d53559 None admin] REQUEST_METHOD: `GET` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:36:41.799948 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0296540c-71c1-4121-b48b-77ebb2d53559 None admin] SCRIPT_NAME: `/identity` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:36:41.800474 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0296540c-71c1-4121-b48b-77ebb2d53559 None admin] PATH_INFO: `/v3/groups/020da76b12ff4fd9bbcc6cfc67cc96f2` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:36:41.805438 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0296540c-71c1-4121-b48b-77ebb2d53559 None admin] RBAC: Authorizing `identity:get_group(group_id=020da76b12ff4fd9bbcc6cfc67cc96f2)` {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:36:41.807294 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0296540c-71c1-4121-b48b-77ebb2d53559 None admin] RBAC: Authorization granted {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:36:41.811419 dv-cinder-851351-1-smb devstack@keystone.service[282899]: [pid: 282899|app: 0|req: 215/424] 10.222.0.42 () {56 vars in 1180 bytes} [Thu Jul 28 08:36:41 2022] GET /identity/v3/groups/020da76b12ff4fd9bbcc6cfc67cc96f2 => generated 226 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:36:41.816970 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0296540c-71c1-4121-b48b-77ebb2d53559 None admin] Authenticating user token {{(pid=282899) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:36:41.843565 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072dc2dc-b6c8-40cd-bb36-8b6f68348e05 None admin] Validating token access rules against request {{(pid=282898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:36:41.847090 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG dbcounter [-] [282899] Writing DB stats keystone:SELECT=100 {{(pid=282899) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:36:41.895089 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53f10b5-3037-4da7-89e8-c2a61f5bbe3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:36:41.895755 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53f10b5-3037-4da7-89e8-c2a61f5bbe3b None admin] REQUEST_METHOD: `GET` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:36:41.896041 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53f10b5-3037-4da7-89e8-c2a61f5bbe3b None admin] SCRIPT_NAME: `/identity` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:36:41.896321 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53f10b5-3037-4da7-89e8-c2a61f5bbe3b None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:36:41.908761 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b53f10b5-3037-4da7-89e8-c2a61f5bbe3b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 08:36:41.915430 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application [None req-b53f10b5-3037-4da7-89e8-c2a61f5bbe3b None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 28 08:36:41.915430 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:36:41.915430 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:36:41.915430 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:36:41.915430 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:36:41.915430 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:36:41.915430 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:36:41.915430 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:36:41.915430 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:36:41.915430 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:36:41.915430 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:36:41.915430 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:36:41.915430 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 08:36:41.915430 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 08:36:41.915430 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 08:36:41.915430 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 08:36:41.916543 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 08:36:41.916543 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 08:36:41.916543 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 08:36:41.916543 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 08:36:41.916543 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:36:41.916543 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:36:41.916543 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:36:41.916543 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:36:41.916543 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:36:41.916543 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:36:41.916543 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:36:41.916543 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application with Lock( Jul 28 08:36:41.916543 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:36:41.916543 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:36:41.916543 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:36:41.916543 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:36:41.917531 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:36:41.917531 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:36:41.917531 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:36:41.917531 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:36:41.917531 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 08:36:41.917531 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 08:36:41.917531 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 08:36:41.917531 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 08:36:41.917531 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 08:36:41.917531 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 08:36:41.917531 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 28 08:36:41.917531 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application Jul 28 08:36:41.917531 dv-cinder-851351-1-smb devstack@keystone.service[282898]: [pid: 282898|app: 0|req: 210/425] 10.222.0.42 () {56 vars in 1114 bytes} [Thu Jul 28 08:36:41 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 275 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 08:36:41.924429 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53f10b5-3037-4da7-89e8-c2a61f5bbe3b None admin] Authenticating user token {{(pid=282898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:36:42.023138 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0296540c-71c1-4121-b48b-77ebb2d53559 None admin] Validating token access rules against request {{(pid=282899) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:36:42.088837 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53f10b5-3037-4da7-89e8-c2a61f5bbe3b None admin] Validating token access rules against request {{(pid=282898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:36:42.094898 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8165ad55-1620-4a39-a4a7-ef049616db1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282899) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:36:42.095564 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8165ad55-1620-4a39-a4a7-ef049616db1f None admin] REQUEST_METHOD: `GET` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:36:42.095851 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8165ad55-1620-4a39-a4a7-ef049616db1f None admin] SCRIPT_NAME: `/identity` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:36:42.096130 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8165ad55-1620-4a39-a4a7-ef049616db1f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:36:42.097028 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8165ad55-1620-4a39-a4a7-ef049616db1f None admin] RBAC: Adding query filter params (group.id=020da76b12ff4fd9bbcc6cfc67cc96f2, role.id=eaeb4674b16f497f8afb3384e7e9a3c6, scope.project.id=c089873b22dd43e8a9de1c83b1355842) {{(pid=282899) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:36:42.097407 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8165ad55-1620-4a39-a4a7-ef049616db1f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:36:42.099015 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8165ad55-1620-4a39-a4a7-ef049616db1f None admin] RBAC: Authorization granted {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:36:42.112057 dv-cinder-851351-1-smb devstack@keystone.service[282899]: [pid: 282899|app: 0|req: 216/426] 10.222.0.42 () {56 vars in 1376 bytes} [Thu Jul 28 08:36:41 2022] GET /identity/v3/role_assignments?group.id=020da76b12ff4fd9bbcc6cfc67cc96f2&scope.project.id=c089873b22dd43e8a9de1c83b1355842&role.id=eaeb4674b16f497f8afb3384e7e9a3c6 => generated 611 bytes in 296 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:36:42.114723 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG dbcounter [-] [282898] Writing DB stats keystone:SELECT=100 {{(pid=282898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:36:42.136477 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4475b08-3b33-4156-95ec-62cc55f16dde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:36:42.137161 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4475b08-3b33-4156-95ec-62cc55f16dde None admin] REQUEST_METHOD: `GET` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:36:42.137446 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4475b08-3b33-4156-95ec-62cc55f16dde None admin] SCRIPT_NAME: `/identity` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:36:42.137724 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4475b08-3b33-4156-95ec-62cc55f16dde None admin] PATH_INFO: `/v3/roles` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:36:42.138526 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4475b08-3b33-4156-95ec-62cc55f16dde None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=282898) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:36:42.138841 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4475b08-3b33-4156-95ec-62cc55f16dde None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:36:42.140278 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4475b08-3b33-4156-95ec-62cc55f16dde None admin] RBAC: Authorization granted {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:36:42.150573 dv-cinder-851351-1-smb devstack@keystone.service[282898]: [pid: 282898|app: 0|req: 211/427] 10.222.0.42 () {56 vars in 1111 bytes} [Thu Jul 28 08:36:41 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:36:42.158299 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8165ad55-1620-4a39-a4a7-ef049616db1f None admin] Authenticating user token {{(pid=282899) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:36:42.210912 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36edfde4-589c-4e4c-89ff-ce53dcbfabf9 None None] REQUEST_METHOD: `GET` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:36:42.211246 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36edfde4-589c-4e4c-89ff-ce53dcbfabf9 None None] SCRIPT_NAME: `/identity` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:36:42.211483 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36edfde4-589c-4e4c-89ff-ce53dcbfabf9 None None] PATH_INFO: `/` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:36:42.212893 dv-cinder-851351-1-smb devstack@keystone.service[282898]: [pid: 282898|app: 0|req: 212/428] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 08:36:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 28 08:36:42.227884 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96ca26d-60ad-4bb6-86fa-aaeb66a28daf None None] REQUEST_METHOD: `POST` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:36:42.228231 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96ca26d-60ad-4bb6-86fa-aaeb66a28daf None None] SCRIPT_NAME: `/identity` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:36:42.228451 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96ca26d-60ad-4bb6-86fa-aaeb66a28daf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:36:42.263586 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG dbcounter [-] [282899] Writing DB stats keystone:SELECT=100 {{(pid=282899) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:36:42.265903 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.auth.core [None req-f96ca26d-60ad-4bb6-86fa-aaeb66a28daf None None] MFA Rules not processed for user `2be990a66857410a87ffa7609aec4f7b`. Rule list: `[]` (Enabled: `True`). {{(pid=282898) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 08:36:42.267241 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.fernet_utils [None req-f96ca26d-60ad-4bb6-86fa-aaeb66a28daf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=282898) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:36:42.288251 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8165ad55-1620-4a39-a4a7-ef049616db1f None admin] Validating token access rules against request {{(pid=282899) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:36:42.330527 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505324d5-4718-4170-94da-d89023a58a42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282899) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:36:42.331197 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505324d5-4718-4170-94da-d89023a58a42 None admin] REQUEST_METHOD: `GET` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:36:42.331533 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505324d5-4718-4170-94da-d89023a58a42 None admin] SCRIPT_NAME: `/identity` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:36:42.331814 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505324d5-4718-4170-94da-d89023a58a42 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:36:42.416002 dv-cinder-851351-1-smb devstack@keystone.service[282898]: [pid: 282898|app: 0|req: 213/429] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 08:36:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 08:36:42.440784 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-505324d5-4718-4170-94da-d89023a58a42 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:36:42.442304 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-505324d5-4718-4170-94da-d89023a58a42 None admin] RBAC: Authorization granted {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:36:42.445576 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96ca26d-60ad-4bb6-86fa-aaeb66a28daf None None] Authenticating user token {{(pid=282898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:36:42.540888 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG dbcounter [-] [282899] Writing DB stats keystone:SELECT=100 {{(pid=282899) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:36:42.575104 dv-cinder-851351-1-smb devstack@keystone.service[282899]: [pid: 282899|app: 0|req: 217/430] 10.222.0.42 () {58 vars in 1282 bytes} [Thu Jul 28 08:36:42 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 417 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 28 08:36:42.581511 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505324d5-4718-4170-94da-d89023a58a42 None admin] Authenticating user token {{(pid=282899) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:36:42.586575 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96ca26d-60ad-4bb6-86fa-aaeb66a28daf None None] Validating token access rules against request {{(pid=282898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:36:42.599672 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG dbcounter [-] [282898] Writing DB stats keystone:SELECT=100 {{(pid=282898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:36:42.640840 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d210a6e4-d9a2-4c2e-8f3e-f2a9741db6fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:36:42.641516 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d210a6e4-d9a2-4c2e-8f3e-f2a9741db6fe None admin] REQUEST_METHOD: `GET` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:36:42.641800 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d210a6e4-d9a2-4c2e-8f3e-f2a9741db6fe None admin] SCRIPT_NAME: `/identity` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:36:42.642075 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d210a6e4-d9a2-4c2e-8f3e-f2a9741db6fe None admin] PATH_INFO: `/v3/roles/member` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:36:42.655896 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d210a6e4-d9a2-4c2e-8f3e-f2a9741db6fe None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 08:36:42.662310 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application [None req-d210a6e4-d9a2-4c2e-8f3e-f2a9741db6fe None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 28 08:36:42.662310 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:36:42.662310 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:36:42.662310 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:36:42.662310 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:36:42.662310 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:36:42.662310 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:36:42.662310 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:36:42.662310 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:36:42.662310 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:36:42.662310 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:36:42.662310 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:36:42.662310 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 08:36:42.662310 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 08:36:42.662310 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 08:36:42.662310 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 08:36:42.663373 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 08:36:42.663373 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 08:36:42.663373 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 08:36:42.663373 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 08:36:42.663373 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:36:42.663373 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:36:42.663373 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:36:42.663373 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:36:42.663373 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:36:42.663373 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:36:42.663373 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:36:42.663373 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application with Lock( Jul 28 08:36:42.663373 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:36:42.663373 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:36:42.663373 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:36:42.663373 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:36:42.664429 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:36:42.664429 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:36:42.664429 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:36:42.664429 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:36:42.664429 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 08:36:42.664429 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 08:36:42.664429 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 08:36:42.664429 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 08:36:42.664429 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 08:36:42.664429 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 08:36:42.664429 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 28 08:36:42.664429 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application Jul 28 08:36:42.664429 dv-cinder-851351-1-smb devstack@keystone.service[282898]: [pid: 282898|app: 0|req: 214/431] 10.222.0.42 () {56 vars in 1099 bytes} [Thu Jul 28 08:36:42 2022] GET /identity/v3/roles/member => generated 84 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:36:42.670171 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d210a6e4-d9a2-4c2e-8f3e-f2a9741db6fe None admin] Authenticating user token {{(pid=282898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:36:42.729083 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505324d5-4718-4170-94da-d89023a58a42 None admin] Validating token access rules against request {{(pid=282899) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:36:42.802837 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f72807cd-512d-45d9-8629-04c43e2f7d5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282899) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:36:42.803466 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72807cd-512d-45d9-8629-04c43e2f7d5f None admin] REQUEST_METHOD: `GET` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:36:42.804031 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72807cd-512d-45d9-8629-04c43e2f7d5f None admin] SCRIPT_NAME: `/identity` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:36:42.804316 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72807cd-512d-45d9-8629-04c43e2f7d5f None admin] PATH_INFO: `/v3/projects/c089873b22dd43e8a9de1c83b1355842` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:36:42.805863 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f72807cd-512d-45d9-8629-04c43e2f7d5f None admin] RBAC: Authorizing `identity:get_project(project_id=c089873b22dd43e8a9de1c83b1355842)` {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:36:42.808115 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f72807cd-512d-45d9-8629-04c43e2f7d5f None admin] RBAC: Authorization granted {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:36:42.812610 dv-cinder-851351-1-smb devstack@keystone.service[282899]: [pid: 282899|app: 0|req: 218/432] 10.222.0.42 () {56 vars in 1186 bytes} [Thu Jul 28 08:36:42 2022] GET /identity/v3/projects/c089873b22dd43e8a9de1c83b1355842 => generated 298 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:36:42.817720 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d210a6e4-d9a2-4c2e-8f3e-f2a9741db6fe None admin] Validating token access rules against request {{(pid=282898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:36:42.819112 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f72807cd-512d-45d9-8629-04c43e2f7d5f None admin] Authenticating user token {{(pid=282899) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:36:42.854849 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d90076b-044e-44e5-8b10-a4f4504065ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:36:42.855490 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d90076b-044e-44e5-8b10-a4f4504065ed None admin] REQUEST_METHOD: `GET` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:36:42.855774 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d90076b-044e-44e5-8b10-a4f4504065ed None admin] SCRIPT_NAME: `/identity` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:36:42.856049 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d90076b-044e-44e5-8b10-a4f4504065ed None admin] PATH_INFO: `/v3/roles` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:36:42.856829 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d90076b-044e-44e5-8b10-a4f4504065ed None admin] RBAC: Adding query filter params (name=member) {{(pid=282898) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:36:42.857141 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d90076b-044e-44e5-8b10-a4f4504065ed None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:36:42.858549 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d90076b-044e-44e5-8b10-a4f4504065ed None admin] RBAC: Authorization granted {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:36:42.869100 dv-cinder-851351-1-smb devstack@keystone.service[282898]: [pid: 282898|app: 0|req: 215/433] 10.222.0.42 () {56 vars in 1101 bytes} [Thu Jul 28 08:36:42 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:36:42.874757 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d90076b-044e-44e5-8b10-a4f4504065ed None admin] Authenticating user token {{(pid=282898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:36:42.881041 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG dbcounter [-] [282899] Writing DB stats keystone:SELECT=100 {{(pid=282899) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:36:42.908104 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG dbcounter [-] [282898] Writing DB stats keystone:SELECT=100 {{(pid=282898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:36:42.945963 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f72807cd-512d-45d9-8629-04c43e2f7d5f None admin] Validating token access rules against request {{(pid=282899) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:36:42.984181 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec25ae9-3946-44c2-9c8a-b82db6b021fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282899) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:36:42.984994 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec25ae9-3946-44c2-9c8a-b82db6b021fc None admin] REQUEST_METHOD: `GET` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:36:42.985286 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec25ae9-3946-44c2-9c8a-b82db6b021fc None admin] SCRIPT_NAME: `/identity` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:36:42.985568 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec25ae9-3946-44c2-9c8a-b82db6b021fc None admin] PATH_INFO: `/v3/groups/020da76b12ff4fd9bbcc6cfc67cc96f2` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:36:42.986754 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cec25ae9-3946-44c2-9c8a-b82db6b021fc None admin] RBAC: Authorizing `identity:get_group(group_id=020da76b12ff4fd9bbcc6cfc67cc96f2)` {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:36:42.987905 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d90076b-044e-44e5-8b10-a4f4504065ed None admin] Validating token access rules against request {{(pid=282898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:36:42.988375 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cec25ae9-3946-44c2-9c8a-b82db6b021fc None admin] RBAC: Authorization granted {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:36:42.990549 dv-cinder-851351-1-smb devstack@keystone.service[282899]: [pid: 282899|app: 0|req: 219/434] 10.222.0.42 () {56 vars in 1180 bytes} [Thu Jul 28 08:36:42 2022] GET /identity/v3/groups/020da76b12ff4fd9bbcc6cfc67cc96f2 => generated 226 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:36:42.996324 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec25ae9-3946-44c2-9c8a-b82db6b021fc None admin] Authenticating user token {{(pid=282899) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:36:43.024075 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38579136-0d8e-4f0e-975c-b9c453bcfe6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:36:43.024790 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38579136-0d8e-4f0e-975c-b9c453bcfe6e None admin] REQUEST_METHOD: `GET` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:36:43.025092 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38579136-0d8e-4f0e-975c-b9c453bcfe6e None admin] SCRIPT_NAME: `/identity` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:36:43.025361 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38579136-0d8e-4f0e-975c-b9c453bcfe6e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:36:43.103319 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38579136-0d8e-4f0e-975c-b9c453bcfe6e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:36:43.104836 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38579136-0d8e-4f0e-975c-b9c453bcfe6e None admin] RBAC: Authorization granted {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:36:43.108150 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec25ae9-3946-44c2-9c8a-b82db6b021fc None admin] Validating token access rules against request {{(pid=282899) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:36:43.135841 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG dbcounter [-] [282898] Writing DB stats keystone:SELECT=100 {{(pid=282898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:36:43.136392 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG dbcounter [-] [282899] Writing DB stats keystone:SELECT=100 {{(pid=282899) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:36:43.146425 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635988a7-4156-470e-8725-4d3112968c08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282899) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:36:43.148066 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635988a7-4156-470e-8725-4d3112968c08 None admin] REQUEST_METHOD: `GET` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:36:43.148416 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635988a7-4156-470e-8725-4d3112968c08 None admin] SCRIPT_NAME: `/identity` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:36:43.148851 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635988a7-4156-470e-8725-4d3112968c08 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:36:43.149955 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-635988a7-4156-470e-8725-4d3112968c08 None admin] RBAC: Adding query filter params (group.id=020da76b12ff4fd9bbcc6cfc67cc96f2, role.id=d76677105be344cc83022cbde8a22d8d, scope.project.id=c089873b22dd43e8a9de1c83b1355842) {{(pid=282899) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:36:43.150352 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-635988a7-4156-470e-8725-4d3112968c08 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:36:43.152024 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-635988a7-4156-470e-8725-4d3112968c08 None admin] RBAC: Authorization granted {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:36:43.159765 dv-cinder-851351-1-smb devstack@keystone.service[282899]: [pid: 282899|app: 0|req: 220/435] 10.222.0.42 () {56 vars in 1376 bytes} [Thu Jul 28 08:36:42 2022] GET /identity/v3/role_assignments?group.id=020da76b12ff4fd9bbcc6cfc67cc96f2&scope.project.id=c089873b22dd43e8a9de1c83b1355842&role.id=d76677105be344cc83022cbde8a22d8d => generated 611 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 08:36:43.217574 dv-cinder-851351-1-smb devstack@keystone.service[282898]: [pid: 282898|app: 0|req: 216/436] 10.222.0.42 () {58 vars in 1282 bytes} [Thu Jul 28 08:36:42 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 343 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 28 08:36:43.223487 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7870701a-96a8-4152-bf04-aa81f7370e08 None None] REQUEST_METHOD: `GET` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:36:43.223740 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38579136-0d8e-4f0e-975c-b9c453bcfe6e None admin] Authenticating user token {{(pid=282898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:36:43.223833 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7870701a-96a8-4152-bf04-aa81f7370e08 None None] SCRIPT_NAME: `/identity` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:36:43.224053 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7870701a-96a8-4152-bf04-aa81f7370e08 None None] PATH_INFO: `/` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:36:43.225838 dv-cinder-851351-1-smb devstack@keystone.service[282899]: [pid: 282899|app: 0|req: 221/437] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 08:36:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 08:36:43.231563 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e708f4da-8653-4056-9519-95f39d592e5f None None] REQUEST_METHOD: `POST` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:36:43.231893 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e708f4da-8653-4056-9519-95f39d592e5f None None] SCRIPT_NAME: `/identity` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:36:43.232279 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e708f4da-8653-4056-9519-95f39d592e5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:36:43.253112 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.auth.core [None req-e708f4da-8653-4056-9519-95f39d592e5f None None] MFA Rules not processed for user `2be990a66857410a87ffa7609aec4f7b`. Rule list: `[]` (Enabled: `True`). {{(pid=282899) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 08:36:43.254700 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.fernet_utils [None req-e708f4da-8653-4056-9519-95f39d592e5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=282899) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:36:43.333909 dv-cinder-851351-1-smb devstack@keystone.service[282899]: [pid: 282899|app: 0|req: 222/438] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 08:36:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 28 08:36:43.335246 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38579136-0d8e-4f0e-975c-b9c453bcfe6e None admin] Validating token access rules against request {{(pid=282898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:36:43.357711 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e708f4da-8653-4056-9519-95f39d592e5f None None] Authenticating user token {{(pid=282899) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:36:43.374032 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG dbcounter [-] [282898] Writing DB stats keystone:SELECT=100 {{(pid=282898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:36:43.382871 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4446bb16-f91e-4814-a815-d901f4182ea3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:36:43.383853 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4446bb16-f91e-4814-a815-d901f4182ea3 None admin] REQUEST_METHOD: `GET` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:36:43.384304 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4446bb16-f91e-4814-a815-d901f4182ea3 None admin] SCRIPT_NAME: `/identity` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:36:43.384799 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4446bb16-f91e-4814-a815-d901f4182ea3 None admin] PATH_INFO: `/v3/projects/305114c1888a404186311d18de60f67f` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:36:43.386162 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4446bb16-f91e-4814-a815-d901f4182ea3 None admin] RBAC: Authorizing `identity:get_project(project_id=305114c1888a404186311d18de60f67f)` {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:36:43.387923 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4446bb16-f91e-4814-a815-d901f4182ea3 None admin] RBAC: Authorization granted {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:36:43.389843 dv-cinder-851351-1-smb devstack@keystone.service[282898]: [pid: 282898|app: 0|req: 217/439] 10.222.0.42 () {56 vars in 1186 bytes} [Thu Jul 28 08:36:43 2022] GET /identity/v3/projects/305114c1888a404186311d18de60f67f => generated 302 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 08:36:43.397820 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4446bb16-f91e-4814-a815-d901f4182ea3 None admin] Authenticating user token {{(pid=282898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:36:43.492194 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e708f4da-8653-4056-9519-95f39d592e5f None None] Validating token access rules against request {{(pid=282899) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:36:43.502422 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG dbcounter [-] [282899] Writing DB stats keystone:SELECT=100 {{(pid=282899) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:36:43.518332 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4446bb16-f91e-4814-a815-d901f4182ea3 None admin] Validating token access rules against request {{(pid=282898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:36:43.533721 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901d10a6-d6b7-4c19-a548-6edaf2cdec4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282899) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:36:43.534426 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901d10a6-d6b7-4c19-a548-6edaf2cdec4c None admin] REQUEST_METHOD: `GET` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:36:43.534716 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901d10a6-d6b7-4c19-a548-6edaf2cdec4c None admin] SCRIPT_NAME: `/identity` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:36:43.534992 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901d10a6-d6b7-4c19-a548-6edaf2cdec4c None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:36:43.549401 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-901d10a6-d6b7-4c19-a548-6edaf2cdec4c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 08:36:43.554831 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application [None req-901d10a6-d6b7-4c19-a548-6edaf2cdec4c None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 28 08:36:43.554831 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:36:43.554831 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:36:43.554831 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:36:43.554831 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:36:43.554831 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:36:43.554831 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:36:43.554831 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:36:43.554831 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:36:43.554831 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:36:43.554831 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:36:43.554831 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:36:43.554831 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 08:36:43.554831 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 08:36:43.554831 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 08:36:43.554831 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 08:36:43.557118 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 08:36:43.557118 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 08:36:43.557118 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 08:36:43.557118 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 08:36:43.557118 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:36:43.557118 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:36:43.557118 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:36:43.557118 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:36:43.557118 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:36:43.557118 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:36:43.557118 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:36:43.557118 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application with Lock( Jul 28 08:36:43.557118 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:36:43.557118 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:36:43.557118 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:36:43.557118 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:36:43.558077 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:36:43.558077 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:36:43.558077 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:36:43.558077 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:36:43.558077 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 08:36:43.558077 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 08:36:43.558077 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 08:36:43.558077 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 08:36:43.558077 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 08:36:43.558077 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 08:36:43.558077 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 28 08:36:43.558077 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application Jul 28 08:36:43.558801 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d78314-666f-4ba9-81c7-853489ee4639 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:36:43.558801 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d78314-666f-4ba9-81c7-853489ee4639 None admin] REQUEST_METHOD: `GET` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:36:43.558970 dv-cinder-851351-1-smb devstack@keystone.service[282899]: [pid: 282899|app: 0|req: 223/440] 10.222.0.42 () {56 vars in 1114 bytes} [Thu Jul 28 08:36:43 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:36:43.559045 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d78314-666f-4ba9-81c7-853489ee4639 None admin] SCRIPT_NAME: `/identity` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:36:43.559045 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d78314-666f-4ba9-81c7-853489ee4639 None admin] PATH_INFO: `/v3/groups/020da76b12ff4fd9bbcc6cfc67cc96f2` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:36:43.559231 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5551c95b-60f8-40b5-a0a3-3dd82b5ae3c6 None None] REQUEST_METHOD: `GET` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:36:43.559231 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5551c95b-60f8-40b5-a0a3-3dd82b5ae3c6 None None] SCRIPT_NAME: `/identity` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:36:43.559231 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5551c95b-60f8-40b5-a0a3-3dd82b5ae3c6 None None] PATH_INFO: `/` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:36:43.559231 dv-cinder-851351-1-smb devstack@keystone.service[282899]: [pid: 282899|app: 0|req: 224/441] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 08:36:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 08:36:43.560317 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8d78314-666f-4ba9-81c7-853489ee4639 None admin] RBAC: Authorizing `identity:get_group(group_id=020da76b12ff4fd9bbcc6cfc67cc96f2)` {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:36:43.561957 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8d78314-666f-4ba9-81c7-853489ee4639 None admin] RBAC: Authorization granted {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:36:43.563586 dv-cinder-851351-1-smb devstack@keystone.service[282898]: [pid: 282898|app: 0|req: 218/442] 10.222.0.42 () {56 vars in 1180 bytes} [Thu Jul 28 08:36:43 2022] GET /identity/v3/groups/020da76b12ff4fd9bbcc6cfc67cc96f2 => generated 226 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 08:36:43.564304 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5551c95b-60f8-40b5-a0a3-3dd82b5ae3c6 None None] Authenticating user token {{(pid=282899) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:36:43.567844 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f120bdd8-cc48-4ac9-b3d4-ca80327705f4 None None] REQUEST_METHOD: `POST` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:36:43.568144 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f120bdd8-cc48-4ac9-b3d4-ca80327705f4 None None] SCRIPT_NAME: `/identity` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:36:43.568421 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f120bdd8-cc48-4ac9-b3d4-ca80327705f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:36:43.589139 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.auth.core [None req-f120bdd8-cc48-4ac9-b3d4-ca80327705f4 None None] MFA Rules not processed for user `2be990a66857410a87ffa7609aec4f7b`. Rule list: `[]` (Enabled: `True`). {{(pid=282898) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 08:36:43.590380 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.fernet_utils [None req-f120bdd8-cc48-4ac9-b3d4-ca80327705f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=282898) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:36:43.650329 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG dbcounter [-] [282898] Writing DB stats keystone:SELECT=100 {{(pid=282898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:36:43.658365 dv-cinder-851351-1-smb devstack@keystone.service[282898]: [pid: 282898|app: 0|req: 219/443] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 08:36:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 08:36:43.659184 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f120bdd8-cc48-4ac9-b3d4-ca80327705f4 None None] Authenticating user token {{(pid=282898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:36:43.680247 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5551c95b-60f8-40b5-a0a3-3dd82b5ae3c6 None None] Validating token access rules against request {{(pid=282899) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:36:43.714461 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27436db-a9a1-4ac9-bd3e-22812e5a724d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282899) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:36:43.715097 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27436db-a9a1-4ac9-bd3e-22812e5a724d None admin] REQUEST_METHOD: `GET` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:36:43.715385 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27436db-a9a1-4ac9-bd3e-22812e5a724d None admin] SCRIPT_NAME: `/identity` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:36:43.715670 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27436db-a9a1-4ac9-bd3e-22812e5a724d None admin] PATH_INFO: `/v3/roles` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:36:43.716408 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a27436db-a9a1-4ac9-bd3e-22812e5a724d None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=282899) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:36:43.716757 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a27436db-a9a1-4ac9-bd3e-22812e5a724d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:36:43.718173 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a27436db-a9a1-4ac9-bd3e-22812e5a724d None admin] RBAC: Authorization granted {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:36:43.726313 dv-cinder-851351-1-smb devstack@keystone.service[282899]: [pid: 282899|app: 0|req: 225/444] 10.222.0.42 () {56 vars in 1111 bytes} [Thu Jul 28 08:36:43 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:36:43.727118 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27436db-a9a1-4ac9-bd3e-22812e5a724d None admin] Authenticating user token {{(pid=282899) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:36:43.754655 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG dbcounter [-] [282899] Writing DB stats keystone:SELECT=100 {{(pid=282899) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:36:43.761428 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f120bdd8-cc48-4ac9-b3d4-ca80327705f4 None None] Validating token access rules against request {{(pid=282898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:36:43.796687 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fdfde24-c3bf-4625-92dd-b801a1eb81b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:36:43.797529 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fdfde24-c3bf-4625-92dd-b801a1eb81b4 None admin] REQUEST_METHOD: `GET` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:36:43.797813 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fdfde24-c3bf-4625-92dd-b801a1eb81b4 None admin] SCRIPT_NAME: `/identity` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:36:43.798086 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fdfde24-c3bf-4625-92dd-b801a1eb81b4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:36:43.798893 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fdfde24-c3bf-4625-92dd-b801a1eb81b4 None admin] RBAC: Adding query filter params (group.id=020da76b12ff4fd9bbcc6cfc67cc96f2, role.id=eaeb4674b16f497f8afb3384e7e9a3c6, scope.project.id=305114c1888a404186311d18de60f67f) {{(pid=282898) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:36:43.799206 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fdfde24-c3bf-4625-92dd-b801a1eb81b4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:36:43.800802 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fdfde24-c3bf-4625-92dd-b801a1eb81b4 None admin] RBAC: Authorization granted {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:36:43.807319 dv-cinder-851351-1-smb devstack@keystone.service[282898]: [pid: 282898|app: 0|req: 220/445] 10.222.0.42 () {56 vars in 1376 bytes} [Thu Jul 28 08:36:43 2022] GET /identity/v3/role_assignments?group.id=020da76b12ff4fd9bbcc6cfc67cc96f2&scope.project.id=305114c1888a404186311d18de60f67f&role.id=eaeb4674b16f497f8afb3384e7e9a3c6 => generated 611 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:36:43.808194 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fdfde24-c3bf-4625-92dd-b801a1eb81b4 None admin] Authenticating user token {{(pid=282898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:36:43.836479 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27436db-a9a1-4ac9-bd3e-22812e5a724d None admin] Validating token access rules against request {{(pid=282899) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:36:43.884967 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e87891-2e78-48c1-b979-b5ef36a6c923 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282899) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:36:43.885647 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e87891-2e78-48c1-b979-b5ef36a6c923 None admin] REQUEST_METHOD: `GET` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:36:43.885929 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e87891-2e78-48c1-b979-b5ef36a6c923 None admin] SCRIPT_NAME: `/identity` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:36:43.886208 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e87891-2e78-48c1-b979-b5ef36a6c923 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:36:43.890453 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG dbcounter [-] [282898] Writing DB stats keystone:SELECT=100 {{(pid=282898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:36:43.899277 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3e87891-2e78-48c1-b979-b5ef36a6c923 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 08:36:43.905217 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application [None req-b3e87891-2e78-48c1-b979-b5ef36a6c923 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 08:36:43.905217 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:36:43.905217 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:36:43.905217 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:36:43.905217 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:36:43.905217 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:36:43.905217 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:36:43.905217 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:36:43.905217 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:36:43.905217 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:36:43.905217 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:36:43.905217 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:36:43.905217 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 08:36:43.905217 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 08:36:43.905217 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 08:36:43.905217 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 08:36:43.906409 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 08:36:43.906409 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 08:36:43.906409 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 08:36:43.906409 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 08:36:43.906409 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:36:43.906409 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:36:43.906409 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:36:43.906409 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:36:43.906409 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:36:43.906409 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:36:43.906409 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:36:43.906409 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application with Lock( Jul 28 08:36:43.906409 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:36:43.906409 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:36:43.906409 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:36:43.906409 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:36:43.907367 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:36:43.907367 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:36:43.907367 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:36:43.907367 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:36:43.907367 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 08:36:43.907367 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 08:36:43.907367 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 08:36:43.907367 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 08:36:43.907367 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 08:36:43.907367 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 08:36:43.907367 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 08:36:43.907367 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application Jul 28 08:36:43.907367 dv-cinder-851351-1-smb devstack@keystone.service[282899]: [pid: 282899|app: 0|req: 226/446] 10.222.0.42 () {56 vars in 1096 bytes} [Thu Jul 28 08:36:43 2022] GET /identity/v3/roles/admin => generated 83 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:36:43.913433 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e87891-2e78-48c1-b979-b5ef36a6c923 None admin] Authenticating user token {{(pid=282899) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:36:43.941417 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fdfde24-c3bf-4625-92dd-b801a1eb81b4 None admin] Validating token access rules against request {{(pid=282898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:36:43.980844 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842ae10d-e9e1-4ea9-8331-6c6d9b02b1d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:36:43.981481 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842ae10d-e9e1-4ea9-8331-6c6d9b02b1d7 None admin] REQUEST_METHOD: `GET` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:36:43.981769 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842ae10d-e9e1-4ea9-8331-6c6d9b02b1d7 None admin] SCRIPT_NAME: `/identity` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:36:43.982043 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842ae10d-e9e1-4ea9-8331-6c6d9b02b1d7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:36:44.025711 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG dbcounter [-] [282899] Writing DB stats keystone:SELECT=100 {{(pid=282899) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:36:44.041012 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e87891-2e78-48c1-b979-b5ef36a6c923 None admin] Validating token access rules against request {{(pid=282899) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:36:44.082230 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf8e16f-722f-4d11-8673-e83aa1f47f5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282899) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:36:44.083196 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf8e16f-722f-4d11-8673-e83aa1f47f5b None admin] REQUEST_METHOD: `GET` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:36:44.083624 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf8e16f-722f-4d11-8673-e83aa1f47f5b None admin] SCRIPT_NAME: `/identity` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:36:44.084016 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf8e16f-722f-4d11-8673-e83aa1f47f5b None admin] PATH_INFO: `/v3/roles` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:36:44.084789 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cf8e16f-722f-4d11-8673-e83aa1f47f5b None admin] RBAC: Adding query filter params (name=admin) {{(pid=282899) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:36:44.085103 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cf8e16f-722f-4d11-8673-e83aa1f47f5b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:36:44.086680 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cf8e16f-722f-4d11-8673-e83aa1f47f5b None admin] RBAC: Authorization granted {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:36:44.089485 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-842ae10d-e9e1-4ea9-8331-6c6d9b02b1d7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:36:44.091335 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-842ae10d-e9e1-4ea9-8331-6c6d9b02b1d7 None admin] RBAC: Authorization granted {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:36:44.097103 dv-cinder-851351-1-smb devstack@keystone.service[282899]: [pid: 282899|app: 0|req: 227/447] 10.222.0.42 () {56 vars in 1099 bytes} [Thu Jul 28 08:36:43 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 08:36:44.102826 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf8e16f-722f-4d11-8673-e83aa1f47f5b None admin] Authenticating user token {{(pid=282899) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:36:44.164469 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG dbcounter [-] [282898] Writing DB stats keystone:SELECT=100 {{(pid=282898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:36:44.216272 dv-cinder-851351-1-smb devstack@keystone.service[282898]: [pid: 282898|app: 0|req: 221/448] 10.222.0.42 () {58 vars in 1282 bytes} [Thu Jul 28 08:36:43 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 408 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 28 08:36:44.222118 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842ae10d-e9e1-4ea9-8331-6c6d9b02b1d7 None admin] Authenticating user token {{(pid=282898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:36:44.223069 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf8e16f-722f-4d11-8673-e83aa1f47f5b None admin] Validating token access rules against request {{(pid=282899) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:36:44.256057 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-581e16b9-c3c8-4dff-b7e7-f59845a4fee1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282899) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:36:44.256726 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581e16b9-c3c8-4dff-b7e7-f59845a4fee1 None admin] REQUEST_METHOD: `GET` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:36:44.257013 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581e16b9-c3c8-4dff-b7e7-f59845a4fee1 None admin] SCRIPT_NAME: `/identity` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:36:44.257287 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581e16b9-c3c8-4dff-b7e7-f59845a4fee1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:36:44.275500 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG dbcounter [-] [282899] Writing DB stats keystone:SELECT=100 {{(pid=282899) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:36:44.320907 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842ae10d-e9e1-4ea9-8331-6c6d9b02b1d7 None admin] Validating token access rules against request {{(pid=282898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:36:44.326504 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-581e16b9-c3c8-4dff-b7e7-f59845a4fee1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:36:44.327996 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-581e16b9-c3c8-4dff-b7e7-f59845a4fee1 None admin] RBAC: Authorization granted {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:36:44.356061 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce943d35-f143-400b-87c6-fec13dff5cc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:36:44.356716 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce943d35-f143-400b-87c6-fec13dff5cc5 None admin] REQUEST_METHOD: `GET` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:36:44.356998 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce943d35-f143-400b-87c6-fec13dff5cc5 None admin] SCRIPT_NAME: `/identity` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:36:44.357269 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce943d35-f143-400b-87c6-fec13dff5cc5 None admin] PATH_INFO: `/v3/projects/305114c1888a404186311d18de60f67f` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:36:44.358454 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce943d35-f143-400b-87c6-fec13dff5cc5 None admin] RBAC: Authorizing `identity:get_project(project_id=305114c1888a404186311d18de60f67f)` {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:36:44.359948 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce943d35-f143-400b-87c6-fec13dff5cc5 None admin] RBAC: Authorization granted {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:36:44.361653 dv-cinder-851351-1-smb devstack@keystone.service[282898]: [pid: 282898|app: 0|req: 222/449] 10.222.0.42 () {56 vars in 1186 bytes} [Thu Jul 28 08:36:44 2022] GET /identity/v3/projects/305114c1888a404186311d18de60f67f => generated 302 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 08:36:44.367348 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce943d35-f143-400b-87c6-fec13dff5cc5 None admin] Authenticating user token {{(pid=282898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:36:44.394696 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG dbcounter [-] [282898] Writing DB stats keystone:SELECT=100 {{(pid=282898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:36:44.435165 dv-cinder-851351-1-smb devstack@keystone.service[282899]: [pid: 282899|app: 0|req: 228/450] 10.222.0.42 () {58 vars in 1282 bytes} [Thu Jul 28 08:36:44 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 28 08:36:44.441317 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-581e16b9-c3c8-4dff-b7e7-f59845a4fee1 None admin] Authenticating user token {{(pid=282899) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:36:44.466804 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce943d35-f143-400b-87c6-fec13dff5cc5 None admin] Validating token access rules against request {{(pid=282898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:36:44.492165 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG dbcounter [-] [282899] Writing DB stats keystone:SELECT=100 {{(pid=282899) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:36:44.503095 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64231de9-761a-4024-aa2b-e4ee38ce224b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:36:44.503788 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64231de9-761a-4024-aa2b-e4ee38ce224b None admin] REQUEST_METHOD: `GET` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:36:44.504066 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64231de9-761a-4024-aa2b-e4ee38ce224b None admin] SCRIPT_NAME: `/identity` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:36:44.504338 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64231de9-761a-4024-aa2b-e4ee38ce224b None admin] PATH_INFO: `/v3/groups/020da76b12ff4fd9bbcc6cfc67cc96f2` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:36:44.505577 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64231de9-761a-4024-aa2b-e4ee38ce224b None admin] RBAC: Authorizing `identity:get_group(group_id=020da76b12ff4fd9bbcc6cfc67cc96f2)` {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:36:44.507040 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64231de9-761a-4024-aa2b-e4ee38ce224b None admin] RBAC: Authorization granted {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:36:44.508688 dv-cinder-851351-1-smb devstack@keystone.service[282898]: [pid: 282898|app: 0|req: 223/451] 10.222.0.42 () {56 vars in 1180 bytes} [Thu Jul 28 08:36:44 2022] GET /identity/v3/groups/020da76b12ff4fd9bbcc6cfc67cc96f2 => generated 226 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 08:36:44.514826 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64231de9-761a-4024-aa2b-e4ee38ce224b None admin] Authenticating user token {{(pid=282898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:36:44.542673 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-581e16b9-c3c8-4dff-b7e7-f59845a4fee1 None admin] Validating token access rules against request {{(pid=282899) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:36:44.585163 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c19cc6a-5c19-4d7f-83a0-219861453655 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282899) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:36:44.585868 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c19cc6a-5c19-4d7f-83a0-219861453655 None admin] REQUEST_METHOD: `GET` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:36:44.586148 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c19cc6a-5c19-4d7f-83a0-219861453655 None admin] SCRIPT_NAME: `/identity` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:36:44.586433 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c19cc6a-5c19-4d7f-83a0-219861453655 None admin] PATH_INFO: `/v3/projects/0c423333fe4246a29efc0aa6050bba26` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:36:44.587647 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c19cc6a-5c19-4d7f-83a0-219861453655 None admin] RBAC: Authorizing `identity:get_project(project_id=0c423333fe4246a29efc0aa6050bba26)` {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:36:44.589152 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c19cc6a-5c19-4d7f-83a0-219861453655 None admin] RBAC: Authorization granted {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:36:44.591012 dv-cinder-851351-1-smb devstack@keystone.service[282899]: [pid: 282899|app: 0|req: 229/452] 10.222.0.42 () {56 vars in 1186 bytes} [Thu Jul 28 08:36:44 2022] GET /identity/v3/projects/0c423333fe4246a29efc0aa6050bba26 => generated 344 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:36:44.597175 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c19cc6a-5c19-4d7f-83a0-219861453655 None admin] Authenticating user token {{(pid=282899) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:36:44.613798 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG dbcounter [-] [282898] Writing DB stats keystone:SELECT=100 {{(pid=282898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:36:44.620407 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64231de9-761a-4024-aa2b-e4ee38ce224b None admin] Validating token access rules against request {{(pid=282898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:36:44.655509 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0a3f26-56b3-4c2e-bf06-a5546bdb2a66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:36:44.656369 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0a3f26-56b3-4c2e-bf06-a5546bdb2a66 None admin] REQUEST_METHOD: `GET` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:36:44.656651 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0a3f26-56b3-4c2e-bf06-a5546bdb2a66 None admin] SCRIPT_NAME: `/identity` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:36:44.656952 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0a3f26-56b3-4c2e-bf06-a5546bdb2a66 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:36:44.657747 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d0a3f26-56b3-4c2e-bf06-a5546bdb2a66 None admin] RBAC: Adding query filter params (group.id=020da76b12ff4fd9bbcc6cfc67cc96f2, role.id=d76677105be344cc83022cbde8a22d8d, scope.project.id=305114c1888a404186311d18de60f67f) {{(pid=282898) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:36:44.658054 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d0a3f26-56b3-4c2e-bf06-a5546bdb2a66 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:36:44.659605 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d0a3f26-56b3-4c2e-bf06-a5546bdb2a66 None admin] RBAC: Authorization granted {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:36:44.665609 dv-cinder-851351-1-smb devstack@keystone.service[282898]: [pid: 282898|app: 0|req: 224/453] 10.222.0.42 () {56 vars in 1376 bytes} [Thu Jul 28 08:36:44 2022] GET /identity/v3/role_assignments?group.id=020da76b12ff4fd9bbcc6cfc67cc96f2&scope.project.id=305114c1888a404186311d18de60f67f&role.id=d76677105be344cc83022cbde8a22d8d => generated 611 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 08:36:44.701054 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c19cc6a-5c19-4d7f-83a0-219861453655 None admin] Validating token access rules against request {{(pid=282899) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:36:44.720249 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG dbcounter [-] [282899] Writing DB stats keystone:SELECT=100 {{(pid=282899) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:36:44.740828 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55033238-abba-4678-8ed9-cf500a8a1f73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282899) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:36:44.741508 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55033238-abba-4678-8ed9-cf500a8a1f73 None admin] REQUEST_METHOD: `GET` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:36:44.741796 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55033238-abba-4678-8ed9-cf500a8a1f73 None admin] SCRIPT_NAME: `/identity` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:36:44.742075 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55033238-abba-4678-8ed9-cf500a8a1f73 None admin] PATH_INFO: `/v3/groups/3313e717dec84a479129e19f12df1137` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:36:44.743336 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55033238-abba-4678-8ed9-cf500a8a1f73 None admin] RBAC: Authorizing `identity:get_group(group_id=3313e717dec84a479129e19f12df1137)` {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:36:44.744891 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55033238-abba-4678-8ed9-cf500a8a1f73 None admin] RBAC: Authorization granted {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:36:44.746641 dv-cinder-851351-1-smb devstack@keystone.service[282899]: [pid: 282899|app: 0|req: 230/454] 10.222.0.42 () {56 vars in 1180 bytes} [Thu Jul 28 08:36:44 2022] GET /identity/v3/groups/3313e717dec84a479129e19f12df1137 => generated 229 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 08:36:44.753218 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0a3f26-56b3-4c2e-bf06-a5546bdb2a66 None admin] Authenticating user token {{(pid=282898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:36:44.870349 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0a3f26-56b3-4c2e-bf06-a5546bdb2a66 None admin] Validating token access rules against request {{(pid=282898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:36:44.907172 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668b9a52-d989-4714-8d9f-248302086cdd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:36:44.907806 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668b9a52-d989-4714-8d9f-248302086cdd None admin] REQUEST_METHOD: `GET` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:36:44.908088 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668b9a52-d989-4714-8d9f-248302086cdd None admin] SCRIPT_NAME: `/identity` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:36:44.908365 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668b9a52-d989-4714-8d9f-248302086cdd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:36:44.909249 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-668b9a52-d989-4714-8d9f-248302086cdd None admin] RBAC: Adding query filter params (group.id=3313e717dec84a479129e19f12df1137, role.id=a0e2a00bf94d40f38629d6b5293e3aee, scope.project.id=0c423333fe4246a29efc0aa6050bba26) {{(pid=282898) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:36:44.909636 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-668b9a52-d989-4714-8d9f-248302086cdd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:36:44.911162 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-668b9a52-d989-4714-8d9f-248302086cdd None admin] RBAC: Authorization granted {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:36:44.917338 dv-cinder-851351-1-smb devstack@keystone.service[282898]: [pid: 282898|app: 0|req: 225/455] 10.222.0.42 () {56 vars in 1376 bytes} [Thu Jul 28 08:36:44 2022] GET /identity/v3/role_assignments?group.id=3313e717dec84a479129e19f12df1137&scope.project.id=0c423333fe4246a29efc0aa6050bba26&role.id=a0e2a00bf94d40f38629d6b5293e3aee => generated 611 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:36:47.293779 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0d2b69-205e-4fac-a17c-2304b555da10 None None] REQUEST_METHOD: `GET` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:36:47.294881 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0d2b69-205e-4fac-a17c-2304b555da10 None None] SCRIPT_NAME: `/identity` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:36:47.295404 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0d2b69-205e-4fac-a17c-2304b555da10 None None] PATH_INFO: `/` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:36:47.297404 dv-cinder-851351-1-smb devstack@keystone.service[282899]: [pid: 282899|app: 0|req: 231/456] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 08:36:47 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 08:36:47.303078 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a9554e-0379-471a-a871-3b6ab0814663 None None] REQUEST_METHOD: `POST` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:36:47.304033 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a9554e-0379-471a-a871-3b6ab0814663 None None] SCRIPT_NAME: `/identity` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:36:47.304539 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a9554e-0379-471a-a871-3b6ab0814663 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:36:47.327470 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.auth.core [None req-b9a9554e-0379-471a-a871-3b6ab0814663 None None] MFA Rules not processed for user `2be990a66857410a87ffa7609aec4f7b`. Rule list: `[]` (Enabled: `True`). {{(pid=282898) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 08:36:47.329057 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.fernet_utils [None req-b9a9554e-0379-471a-a871-3b6ab0814663 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=282898) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:36:47.357791 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG dbcounter [-] [282898] Writing DB stats keystone:SELECT=100 {{(pid=282898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:36:47.431022 dv-cinder-851351-1-smb devstack@keystone.service[282898]: [pid: 282898|app: 0|req: 226/457] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 08:36:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 28 08:36:47.455522 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd0d2b69-205e-4fac-a17c-2304b555da10 None None] Authenticating user token {{(pid=282899) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:36:47.621507 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd0d2b69-205e-4fac-a17c-2304b555da10 None None] Validating token access rules against request {{(pid=282899) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:36:47.665584 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6aad747-3480-4e6d-bfac-0e16c3e64dc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282899) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:36:47.666308 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6aad747-3480-4e6d-bfac-0e16c3e64dc6 None admin] REQUEST_METHOD: `GET` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:36:47.666596 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6aad747-3480-4e6d-bfac-0e16c3e64dc6 None admin] SCRIPT_NAME: `/identity` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:36:47.666874 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6aad747-3480-4e6d-bfac-0e16c3e64dc6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:36:47.680238 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6aad747-3480-4e6d-bfac-0e16c3e64dc6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:36:47.681761 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6aad747-3480-4e6d-bfac-0e16c3e64dc6 None admin] RBAC: Authorization granted {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:36:47.686335 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919621db-b94b-42fc-850e-8a3ec7f34ebd None None] REQUEST_METHOD: `GET` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:36:47.686624 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919621db-b94b-42fc-850e-8a3ec7f34ebd None None] SCRIPT_NAME: `/identity` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:36:47.686898 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919621db-b94b-42fc-850e-8a3ec7f34ebd None None] PATH_INFO: `/` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:36:47.688446 dv-cinder-851351-1-smb devstack@keystone.service[282898]: [pid: 282898|app: 0|req: 227/458] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 08:36:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 08:36:47.702452 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a022ee-0eb5-4c39-ba7e-5fc3990e6260 None None] REQUEST_METHOD: `POST` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:36:47.703026 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a022ee-0eb5-4c39-ba7e-5fc3990e6260 None None] SCRIPT_NAME: `/identity` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:36:47.703486 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a022ee-0eb5-4c39-ba7e-5fc3990e6260 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:36:47.711696 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application [None req-f6aad747-3480-4e6d-bfac-0e16c3e64dc6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 08:36:47.711696 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:36:47.711696 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:36:47.711696 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:36:47.711696 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:36:47.711696 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:36:47.711696 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:36:47.711696 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:36:47.711696 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:36:47.711696 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:36:47.711696 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:36:47.711696 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:36:47.711696 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 08:36:47.711696 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 08:36:47.711696 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 08:36:47.713017 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 08:36:47.713017 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:36:47.713017 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:36:47.713017 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:36:47.713017 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:36:47.713017 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:36:47.713017 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:36:47.713017 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:36:47.713017 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application with Lock( Jul 28 08:36:47.713017 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:36:47.713017 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:36:47.713017 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:36:47.713017 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:36:47.713017 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:36:47.713017 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:36:47.713017 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:36:47.713017 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:36:47.714254 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 08:36:47.714254 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 08:36:47.714254 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 08:36:47.714254 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application Jul 28 08:36:47.714254 dv-cinder-851351-1-smb devstack@keystone.service[282899]: [pid: 282899|app: 0|req: 232/459] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 08:36:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 256 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:36:47.716849 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6aad747-3480-4e6d-bfac-0e16c3e64dc6 None admin] Authenticating user token {{(pid=282899) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:36:47.753892 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.auth.core [None req-a2a022ee-0eb5-4c39-ba7e-5fc3990e6260 None None] MFA Rules not processed for user `2be990a66857410a87ffa7609aec4f7b`. Rule list: `[]` (Enabled: `True`). {{(pid=282898) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 08:36:47.755152 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.fernet_utils [None req-a2a022ee-0eb5-4c39-ba7e-5fc3990e6260 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=282898) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:36:47.789041 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG dbcounter [-] [282899] Writing DB stats keystone:SELECT=100 {{(pid=282899) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:36:47.865766 dv-cinder-851351-1-smb devstack@keystone.service[282898]: [pid: 282898|app: 0|req: 228/460] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 08:36:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 08:36:47.877199 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75185006-f5b9-4056-ace9-c1a1290337bf None None] REQUEST_METHOD: `GET` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:36:47.877844 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75185006-f5b9-4056-ace9-c1a1290337bf None None] SCRIPT_NAME: `/identity` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:36:47.878394 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75185006-f5b9-4056-ace9-c1a1290337bf None None] PATH_INFO: `/` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:36:47.880407 dv-cinder-851351-1-smb devstack@keystone.service[282898]: [pid: 282898|app: 0|req: 229/461] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 08:36:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 08:36:47.889405 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c92bb57-c5f5-4c95-9b9c-ae6ca32d9738 None None] REQUEST_METHOD: `POST` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:36:47.890479 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c92bb57-c5f5-4c95-9b9c-ae6ca32d9738 None None] SCRIPT_NAME: `/identity` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:36:47.891176 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c92bb57-c5f5-4c95-9b9c-ae6ca32d9738 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:36:47.896746 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6aad747-3480-4e6d-bfac-0e16c3e64dc6 None admin] Validating token access rules against request {{(pid=282899) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:36:47.914503 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.auth.core [None req-6c92bb57-c5f5-4c95-9b9c-ae6ca32d9738 None None] MFA Rules not processed for user `2be990a66857410a87ffa7609aec4f7b`. Rule list: `[]` (Enabled: `True`). {{(pid=282898) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 08:36:47.916612 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.fernet_utils [None req-6c92bb57-c5f5-4c95-9b9c-ae6ca32d9738 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=282898) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:36:47.939149 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e64fbf8-4883-4f1c-8595-962a535b36fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282899) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:36:47.940192 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e64fbf8-4883-4f1c-8595-962a535b36fe None admin] REQUEST_METHOD: `GET` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:36:47.940736 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e64fbf8-4883-4f1c-8595-962a535b36fe None admin] SCRIPT_NAME: `/identity` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:36:47.941294 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e64fbf8-4883-4f1c-8595-962a535b36fe None admin] PATH_INFO: `/v3/domains` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:36:47.942223 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e64fbf8-4883-4f1c-8595-962a535b36fe None admin] RBAC: Adding query filter params (name=Default) {{(pid=282899) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:36:47.942731 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e64fbf8-4883-4f1c-8595-962a535b36fe None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:36:47.944494 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e64fbf8-4883-4f1c-8595-962a535b36fe None admin] RBAC: Authorization granted {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:36:47.971590 dv-cinder-851351-1-smb devstack@keystone.service[282899]: [pid: 282899|app: 0|req: 233/462] 10.222.0.42 () {56 vars in 1109 bytes} [Thu Jul 28 08:36:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:36:47.973370 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e64fbf8-4883-4f1c-8595-962a535b36fe None admin] Authenticating user token {{(pid=282899) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:36:48.002696 dv-cinder-851351-1-smb devstack@keystone.service[282898]: [pid: 282898|app: 0|req: 230/463] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 08:36:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 08:36:48.003857 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c92bb57-c5f5-4c95-9b9c-ae6ca32d9738 None None] Authenticating user token {{(pid=282898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:36:48.024597 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG dbcounter [-] [282898] Writing DB stats keystone:SELECT=100 {{(pid=282898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:36:48.108801 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG dbcounter [-] [282899] Writing DB stats keystone:SELECT=100 {{(pid=282899) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:36:48.113081 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e64fbf8-4883-4f1c-8595-962a535b36fe None admin] Validating token access rules against request {{(pid=282899) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:36:48.150309 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c92bb57-c5f5-4c95-9b9c-ae6ca32d9738 None None] Validating token access rules against request {{(pid=282898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:36:48.165889 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce04a738-91f3-454f-a5fe-2ecd4f3a6908 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282899) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:36:48.166687 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce04a738-91f3-454f-a5fe-2ecd4f3a6908 None admin] REQUEST_METHOD: `GET` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:36:48.167042 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce04a738-91f3-454f-a5fe-2ecd4f3a6908 None admin] SCRIPT_NAME: `/identity` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:36:48.167535 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce04a738-91f3-454f-a5fe-2ecd4f3a6908 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:36:48.181548 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce04a738-91f3-454f-a5fe-2ecd4f3a6908 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:36:48.183186 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce04a738-91f3-454f-a5fe-2ecd4f3a6908 None admin] RBAC: Authorization granted {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:36:48.197795 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09fa1ae3-a368-4c2e-8e65-5f225e4e722c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:36:48.198450 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09fa1ae3-a368-4c2e-8e65-5f225e4e722c None admin] REQUEST_METHOD: `POST` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:36:48.198743 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09fa1ae3-a368-4c2e-8e65-5f225e4e722c None admin] SCRIPT_NAME: `/identity` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:36:48.199027 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09fa1ae3-a368-4c2e-8e65-5f225e4e722c None admin] PATH_INFO: `/v3/users` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:36:48.199589 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application [None req-ce04a738-91f3-454f-a5fe-2ecd4f3a6908 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 08:36:48.199589 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:36:48.199589 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:36:48.199589 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:36:48.199589 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:36:48.199589 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:36:48.199589 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:36:48.199589 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:36:48.199589 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:36:48.199589 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:36:48.199589 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:36:48.199589 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:36:48.199589 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 08:36:48.199589 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 08:36:48.199589 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 08:36:48.209896 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 08:36:48.209896 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:36:48.209896 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:36:48.209896 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:36:48.209896 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:36:48.209896 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:36:48.209896 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:36:48.209896 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:36:48.209896 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application with Lock( Jul 28 08:36:48.209896 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:36:48.209896 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:36:48.209896 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:36:48.209896 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:36:48.209896 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:36:48.209896 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:36:48.209896 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:36:48.209896 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:36:48.211985 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 08:36:48.211985 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 08:36:48.211985 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 08:36:48.211985 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application Jul 28 08:36:48.212355 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09fa1ae3-a368-4c2e-8e65-5f225e4e722c None admin] RBAC: Authorizing `identity:create_user()` {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:36:48.212472 dv-cinder-851351-1-smb devstack@keystone.service[282899]: [pid: 282899|app: 0|req: 234/464] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 08:36:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:36:48.212563 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09fa1ae3-a368-4c2e-8e65-5f225e4e722c None admin] RBAC: Authorization granted {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:36:48.212650 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9347207-1670-427f-9584-7e6dd50e2ede None None] REQUEST_METHOD: `GET` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:36:48.212650 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9347207-1670-427f-9584-7e6dd50e2ede None None] SCRIPT_NAME: `/identity` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:36:48.212650 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9347207-1670-427f-9584-7e6dd50e2ede None None] PATH_INFO: `/` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:36:48.212650 dv-cinder-851351-1-smb devstack@keystone.service[282899]: [pid: 282899|app: 0|req: 235/465] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 08:36:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 08:36:48.212650 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9347207-1670-427f-9584-7e6dd50e2ede None None] Authenticating user token {{(pid=282899) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:36:48.233673 dv-cinder-851351-1-smb devstack@keystone.service[282898]: [pid: 282898|app: 0|req: 231/466] 10.222.0.42 () {60 vars in 1132 bytes} [Thu Jul 28 08:36:48 2022] POST /identity/v3/users => generated 246 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 08:36:48.234900 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09fa1ae3-a368-4c2e-8e65-5f225e4e722c None admin] Authenticating user token {{(pid=282898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:36:48.335571 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG dbcounter [-] [282898] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=282898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:36:48.373476 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9347207-1670-427f-9584-7e6dd50e2ede None None] Validating token access rules against request {{(pid=282899) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:36:48.391693 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09fa1ae3-a368-4c2e-8e65-5f225e4e722c None admin] Validating token access rules against request {{(pid=282898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:36:48.415057 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0026b662-c9ef-4558-99e6-f63594b56663 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282899) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:36:48.416241 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0026b662-c9ef-4558-99e6-f63594b56663 None admin] REQUEST_METHOD: `GET` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:36:48.416806 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0026b662-c9ef-4558-99e6-f63594b56663 None admin] SCRIPT_NAME: `/identity` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:36:48.417354 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0026b662-c9ef-4558-99e6-f63594b56663 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:36:48.433290 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0026b662-c9ef-4558-99e6-f63594b56663 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:36:48.434921 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0026b662-c9ef-4558-99e6-f63594b56663 None admin] RBAC: Authorization granted {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:36:48.442139 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c627dcfc-0cb7-4f14-9924-1ee0406d5f96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:36:48.442787 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c627dcfc-0cb7-4f14-9924-1ee0406d5f96 None admin] REQUEST_METHOD: `GET` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:36:48.443074 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c627dcfc-0cb7-4f14-9924-1ee0406d5f96 None admin] SCRIPT_NAME: `/identity` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:36:48.443383 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c627dcfc-0cb7-4f14-9924-1ee0406d5f96 None admin] PATH_INFO: `/v3/domains` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:36:48.444084 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c627dcfc-0cb7-4f14-9924-1ee0406d5f96 None admin] RBAC: Adding query filter params (name=Default) {{(pid=282898) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:36:48.444443 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c627dcfc-0cb7-4f14-9924-1ee0406d5f96 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:36:48.445921 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c627dcfc-0cb7-4f14-9924-1ee0406d5f96 None admin] RBAC: Authorization granted {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:36:48.455939 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application [None req-0026b662-c9ef-4558-99e6-f63594b56663 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 08:36:48.455939 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:36:48.455939 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:36:48.455939 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:36:48.455939 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:36:48.455939 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:36:48.455939 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:36:48.455939 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:36:48.455939 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:36:48.455939 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:36:48.455939 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:36:48.455939 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:36:48.455939 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 08:36:48.455939 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 08:36:48.455939 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 08:36:48.457151 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 08:36:48.457151 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:36:48.457151 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:36:48.457151 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:36:48.457151 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:36:48.457151 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:36:48.457151 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:36:48.457151 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:36:48.457151 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application with Lock( Jul 28 08:36:48.457151 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:36:48.457151 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:36:48.457151 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:36:48.457151 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:36:48.457151 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:36:48.457151 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:36:48.457151 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:36:48.457151 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:36:48.458191 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 08:36:48.458191 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 08:36:48.458191 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 08:36:48.458191 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application Jul 28 08:36:48.458191 dv-cinder-851351-1-smb devstack@keystone.service[282899]: [pid: 282899|app: 0|req: 236/467] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 08:36:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 252 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:36:48.458973 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0bdc39-dc30-4c1f-b191-9dce19812c6e None None] REQUEST_METHOD: `POST` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:36:48.459145 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0bdc39-dc30-4c1f-b191-9dce19812c6e None None] SCRIPT_NAME: `/identity` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:36:48.459815 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0bdc39-dc30-4c1f-b191-9dce19812c6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:36:48.466366 dv-cinder-851351-1-smb devstack@keystone.service[282898]: [pid: 282898|app: 0|req: 232/468] 10.222.0.42 () {56 vars in 1109 bytes} [Thu Jul 28 08:36:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:36:48.467268 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c627dcfc-0cb7-4f14-9924-1ee0406d5f96 None admin] Authenticating user token {{(pid=282898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:36:48.467979 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG dbcounter [-] [282899] Writing DB stats keystone:SELECT=100 {{(pid=282899) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:36:48.491731 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.auth.core [None req-0c0bdc39-dc30-4c1f-b191-9dce19812c6e None None] MFA Rules not processed for user `2be990a66857410a87ffa7609aec4f7b`. Rule list: `[]` (Enabled: `True`). {{(pid=282899) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 08:36:48.493011 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.fernet_utils [None req-0c0bdc39-dc30-4c1f-b191-9dce19812c6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=282899) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:36:48.594104 dv-cinder-851351-1-smb devstack@keystone.service[282899]: [pid: 282899|app: 0|req: 237/469] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 08:36:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 08:36:48.595482 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c0bdc39-dc30-4c1f-b191-9dce19812c6e None None] Authenticating user token {{(pid=282899) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:36:48.637701 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c627dcfc-0cb7-4f14-9924-1ee0406d5f96 None admin] Validating token access rules against request {{(pid=282898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:36:48.673386 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG dbcounter [-] [282898] Writing DB stats keystone:SELECT=100 {{(pid=282898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:36:48.684917 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4799583d-5b80-4b01-9c67-779c1f5120b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:36:48.685585 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4799583d-5b80-4b01-9c67-779c1f5120b1 None admin] REQUEST_METHOD: `GET` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:36:48.685871 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4799583d-5b80-4b01-9c67-779c1f5120b1 None admin] SCRIPT_NAME: `/identity` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:36:48.686147 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4799583d-5b80-4b01-9c67-779c1f5120b1 None admin] PATH_INFO: `/v3/domains` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:36:48.686880 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4799583d-5b80-4b01-9c67-779c1f5120b1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=282898) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:36:48.687200 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4799583d-5b80-4b01-9c67-779c1f5120b1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:36:48.688632 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4799583d-5b80-4b01-9c67-779c1f5120b1 None admin] RBAC: Authorization granted {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:36:48.703202 dv-cinder-851351-1-smb devstack@keystone.service[282898]: [pid: 282898|app: 0|req: 233/470] 10.222.0.42 () {56 vars in 1109 bytes} [Thu Jul 28 08:36:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:36:48.704145 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4799583d-5b80-4b01-9c67-779c1f5120b1 None admin] Authenticating user token {{(pid=282898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:36:48.755294 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c0bdc39-dc30-4c1f-b191-9dce19812c6e None None] Validating token access rules against request {{(pid=282899) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:36:48.799272 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG dbcounter [-] [282899] Writing DB stats keystone:SELECT=100 {{(pid=282899) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:36:48.803111 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b03cf86d-bf45-4659-a21e-2eadc9b17a05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282899) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:36:48.803985 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03cf86d-bf45-4659-a21e-2eadc9b17a05 None admin] REQUEST_METHOD: `POST` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:36:48.804292 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03cf86d-bf45-4659-a21e-2eadc9b17a05 None admin] SCRIPT_NAME: `/identity` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:36:48.804580 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03cf86d-bf45-4659-a21e-2eadc9b17a05 None admin] PATH_INFO: `/v3/users` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:36:48.805347 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b03cf86d-bf45-4659-a21e-2eadc9b17a05 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:36:48.808333 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b03cf86d-bf45-4659-a21e-2eadc9b17a05 None admin] RBAC: Authorization granted {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:36:48.838478 dv-cinder-851351-1-smb devstack@keystone.service[282899]: [pid: 282899|app: 0|req: 238/471] 10.222.0.42 () {60 vars in 1132 bytes} [Thu Jul 28 08:36:48 2022] POST /identity/v3/users => generated 248 bytes in 243 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 08:36:48.839659 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b03cf86d-bf45-4659-a21e-2eadc9b17a05 None admin] Authenticating user token {{(pid=282899) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:36:48.883247 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4799583d-5b80-4b01-9c67-779c1f5120b1 None admin] Validating token access rules against request {{(pid=282898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:36:48.958739 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee6d330-4af9-48bb-881b-b617331d84e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:36:48.959313 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee6d330-4af9-48bb-881b-b617331d84e9 None admin] REQUEST_METHOD: `GET` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:36:48.959602 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee6d330-4af9-48bb-881b-b617331d84e9 None admin] SCRIPT_NAME: `/identity` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:36:48.959883 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee6d330-4af9-48bb-881b-b617331d84e9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:36:48.969184 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b03cf86d-bf45-4659-a21e-2eadc9b17a05 None admin] Validating token access rules against request {{(pid=282899) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:36:48.986116 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee6d330-4af9-48bb-881b-b617331d84e9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:36:48.987728 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee6d330-4af9-48bb-881b-b617331d84e9 None admin] RBAC: Authorization granted {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:36:49.016843 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d95884e7-185b-4436-a67c-6c1ef8838af6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282899) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:36:49.017883 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95884e7-185b-4436-a67c-6c1ef8838af6 None admin] REQUEST_METHOD: `POST` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:36:49.018351 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95884e7-185b-4436-a67c-6c1ef8838af6 None admin] SCRIPT_NAME: `/identity` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:36:49.018476 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application [None req-1ee6d330-4af9-48bb-881b-b617331d84e9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 08:36:49.018476 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:36:49.018476 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:36:49.018476 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:36:49.018476 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:36:49.018476 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:36:49.018476 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:36:49.018476 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:36:49.018476 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:36:49.018476 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:36:49.018476 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:36:49.018476 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:36:49.018476 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 08:36:49.018476 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 08:36:49.018476 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 08:36:49.019657 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 08:36:49.019657 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:36:49.019657 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:36:49.019657 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:36:49.019657 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:36:49.019657 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:36:49.019657 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:36:49.019657 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:36:49.019657 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application with Lock( Jul 28 08:36:49.019657 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:36:49.019657 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:36:49.019657 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:36:49.019657 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:36:49.019657 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:36:49.019657 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:36:49.019657 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:36:49.019657 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:36:49.020872 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 08:36:49.020872 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 08:36:49.020872 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 08:36:49.020872 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application Jul 28 08:36:49.020872 dv-cinder-851351-1-smb devstack@keystone.service[282898]: [pid: 282898|app: 0|req: 234/472] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 08:36:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 316 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:36:49.021710 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95884e7-185b-4436-a67c-6c1ef8838af6 None admin] PATH_INFO: `/v3/users` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:36:49.022690 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d95884e7-185b-4436-a67c-6c1ef8838af6 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:36:49.024333 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d95884e7-185b-4436-a67c-6c1ef8838af6 None admin] RBAC: Authorization granted {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:36:49.025633 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee6d330-4af9-48bb-881b-b617331d84e9 None admin] Authenticating user token {{(pid=282898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:36:49.054439 dv-cinder-851351-1-smb devstack@keystone.service[282899]: [pid: 282899|app: 0|req: 239/473] 10.222.0.42 () {60 vars in 1132 bytes} [Thu Jul 28 08:36:48 2022] POST /identity/v3/users => generated 248 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 08:36:49.056391 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ff63dd-8055-41b3-bffc-193ffafdbdc3 None None] REQUEST_METHOD: `GET` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:36:49.056913 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ff63dd-8055-41b3-bffc-193ffafdbdc3 None None] SCRIPT_NAME: `/identity` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:36:49.057338 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ff63dd-8055-41b3-bffc-193ffafdbdc3 None None] PATH_INFO: `/` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:36:49.059529 dv-cinder-851351-1-smb devstack@keystone.service[282899]: [pid: 282899|app: 0|req: 240/474] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 08:36:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 08:36:49.075628 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e482d3f-5246-4328-b4d6-613c9bbb73e0 None None] REQUEST_METHOD: `POST` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:36:49.076231 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e482d3f-5246-4328-b4d6-613c9bbb73e0 None None] SCRIPT_NAME: `/identity` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:36:49.076705 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e482d3f-5246-4328-b4d6-613c9bbb73e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:36:49.114473 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.auth.core [None req-3e482d3f-5246-4328-b4d6-613c9bbb73e0 None None] MFA Rules not processed for user `2be990a66857410a87ffa7609aec4f7b`. Rule list: `[]` (Enabled: `True`). {{(pid=282899) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 08:36:49.118752 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.fernet_utils [None req-3e482d3f-5246-4328-b4d6-613c9bbb73e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=282899) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:36:49.139318 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG dbcounter [-] [282898] Writing DB stats keystone:SELECT=100 {{(pid=282898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:36:49.196728 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG dbcounter [-] [282899] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=282899) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:36:49.240096 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee6d330-4af9-48bb-881b-b617331d84e9 None admin] Validating token access rules against request {{(pid=282898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:36:49.240599 dv-cinder-851351-1-smb devstack@keystone.service[282899]: [pid: 282899|app: 0|req: 241/475] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 08:36:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 08:36:49.265723 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e482d3f-5246-4328-b4d6-613c9bbb73e0 None None] Authenticating user token {{(pid=282899) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:36:49.285237 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81783b4a-4f7e-4790-9966-f14b22014de8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:36:49.285890 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81783b4a-4f7e-4790-9966-f14b22014de8 None admin] REQUEST_METHOD: `GET` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:36:49.286176 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81783b4a-4f7e-4790-9966-f14b22014de8 None admin] SCRIPT_NAME: `/identity` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:36:49.286455 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81783b4a-4f7e-4790-9966-f14b22014de8 None admin] PATH_INFO: `/v3/domains` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:36:49.287194 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81783b4a-4f7e-4790-9966-f14b22014de8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=282898) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:36:49.287504 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81783b4a-4f7e-4790-9966-f14b22014de8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:36:49.289059 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81783b4a-4f7e-4790-9966-f14b22014de8 None admin] RBAC: Authorization granted {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:36:49.307342 dv-cinder-851351-1-smb devstack@keystone.service[282898]: [pid: 282898|app: 0|req: 235/476] 10.222.0.42 () {56 vars in 1109 bytes} [Thu Jul 28 08:36:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 282 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:36:49.313466 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81783b4a-4f7e-4790-9966-f14b22014de8 None admin] Authenticating user token {{(pid=282898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:36:49.410126 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e482d3f-5246-4328-b4d6-613c9bbb73e0 None None] Validating token access rules against request {{(pid=282899) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:36:49.456936 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81783b4a-4f7e-4790-9966-f14b22014de8 None admin] Validating token access rules against request {{(pid=282898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:36:49.459059 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG dbcounter [-] [282898] Writing DB stats keystone:SELECT=100 {{(pid=282898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:36:49.460746 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-239d4119-2342-4627-bb92-2b3e7619a63a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282899) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:36:49.462081 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239d4119-2342-4627-bb92-2b3e7619a63a None admin] REQUEST_METHOD: `POST` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:36:49.462081 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239d4119-2342-4627-bb92-2b3e7619a63a None admin] SCRIPT_NAME: `/identity` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:36:49.462650 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239d4119-2342-4627-bb92-2b3e7619a63a None admin] PATH_INFO: `/v3/roles` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:36:49.463626 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-239d4119-2342-4627-bb92-2b3e7619a63a None admin] RBAC: Authorizing `identity:create_role()` {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:36:49.466391 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-239d4119-2342-4627-bb92-2b3e7619a63a None admin] RBAC: Authorization granted {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:36:49.476967 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.sql.core [None req-239d4119-2342-4627-bb92-2b3e7619a63a None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jul 28 08:36:49.476967 dv-cinder-851351-1-smb devstack@keystone.service[282899]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Jul 28 08:36:49.476967 dv-cinder-851351-1-smb devstack@keystone.service[282899]: [parameters: {'id': 'ba9b140ef377467b8252ead6dcd6a80d', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Jul 28 08:36:49.476967 dv-cinder-851351-1-smb devstack@keystone.service[282899]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=282899) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jul 28 08:36:49.495634 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application [None req-239d4119-2342-4627-bb92-2b3e7619a63a None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Jul 28 08:36:49.495634 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:36:49.495634 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 28 08:36:49.495634 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 28 08:36:49.495634 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 28 08:36:49.495634 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 28 08:36:49.495634 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 28 08:36:49.495634 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application result = self._query(query) Jul 28 08:36:49.495634 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 28 08:36:49.495634 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application conn.query(q) Jul 28 08:36:49.495634 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 28 08:36:49.495634 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 28 08:36:49.495634 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 28 08:36:49.495634 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application result.read() Jul 28 08:36:49.495634 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 28 08:36:49.496862 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 28 08:36:49.496862 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 28 08:36:49.496862 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 28 08:36:49.496862 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 28 08:36:49.496862 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 28 08:36:49.496862 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 28 08:36:49.496862 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 28 08:36:49.496862 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jul 28 08:36:49.496862 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application Jul 28 08:36:49.496862 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jul 28 08:36:49.496862 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application Jul 28 08:36:49.496862 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:36:49.496862 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jul 28 08:36:49.496862 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jul 28 08:36:49.496862 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role Jul 28 08:36:49.496862 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return ref.to_dict() Jul 28 08:36:49.496862 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 28 08:36:49.496862 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application next(self.gen) Jul 28 08:36:49.498024 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jul 28 08:36:49.498024 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application yield resource Jul 28 08:36:49.498024 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 28 08:36:49.498024 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application next(self.gen) Jul 28 08:36:49.498024 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jul 28 08:36:49.498024 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application self.session.rollback() Jul 28 08:36:49.498024 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 28 08:36:49.498024 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application self.force_reraise() Jul 28 08:36:49.498024 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 28 08:36:49.498024 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application raise self.value Jul 28 08:36:49.498024 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jul 28 08:36:49.498024 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jul 28 08:36:49.498024 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jul 28 08:36:49.498024 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application session.commit() Jul 28 08:36:49.498024 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jul 28 08:36:49.498024 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jul 28 08:36:49.498024 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jul 28 08:36:49.499079 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application self._prepare_impl() Jul 28 08:36:49.499079 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jul 28 08:36:49.499079 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application self.session.flush() Jul 28 08:36:49.499079 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jul 28 08:36:49.499079 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application self._flush(objects) Jul 28 08:36:49.499079 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jul 28 08:36:49.499079 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jul 28 08:36:49.499079 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jul 28 08:36:49.499079 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application compat.raise_( Jul 28 08:36:49.499079 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 28 08:36:49.499079 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application raise exception Jul 28 08:36:49.499079 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jul 28 08:36:49.499079 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application flush_context.execute() Jul 28 08:36:49.499079 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jul 28 08:36:49.499079 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application rec.execute(self) Jul 28 08:36:49.499079 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jul 28 08:36:49.499079 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jul 28 08:36:49.500166 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jul 28 08:36:49.500166 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application _emit_insert_statements( Jul 28 08:36:49.500166 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Jul 28 08:36:49.500166 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application c = connection._execute_20( Jul 28 08:36:49.500166 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jul 28 08:36:49.500166 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jul 28 08:36:49.500166 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Jul 28 08:36:49.500166 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jul 28 08:36:49.500166 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jul 28 08:36:49.500166 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application ret = self._execute_context( Jul 28 08:36:49.500166 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jul 28 08:36:49.500166 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jul 28 08:36:49.500166 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jul 28 08:36:49.500166 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jul 28 08:36:49.500166 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 28 08:36:49.500166 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application raise exception Jul 28 08:36:49.501398 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 28 08:36:49.501398 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 28 08:36:49.501398 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 28 08:36:49.501398 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 28 08:36:49.501398 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 28 08:36:49.501398 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application result = self._query(query) Jul 28 08:36:49.501398 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 28 08:36:49.501398 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application conn.query(q) Jul 28 08:36:49.501398 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 28 08:36:49.501398 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 28 08:36:49.501398 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 28 08:36:49.501398 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application result.read() Jul 28 08:36:49.501398 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 28 08:36:49.501398 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 28 08:36:49.501398 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 28 08:36:49.501398 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 28 08:36:49.504980 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 28 08:36:49.504980 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 28 08:36:49.504980 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 28 08:36:49.504980 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 28 08:36:49.504980 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jul 28 08:36:49.504980 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Jul 28 08:36:49.504980 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application [parameters: {'id': 'ba9b140ef377467b8252ead6dcd6a80d', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Jul 28 08:36:49.504980 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jul 28 08:36:49.504980 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application Jul 28 08:36:49.504980 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 28 08:36:49.504980 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application Jul 28 08:36:49.504980 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:36:49.504980 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:36:49.504980 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:36:49.504980 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:36:49.504980 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:36:49.507297 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:36:49.507297 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:36:49.507297 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:36:49.507297 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:36:49.507297 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:36:49.507297 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:36:49.507297 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post Jul 28 08:36:49.507297 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( Jul 28 08:36:49.507297 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:36:49.507297 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:36:49.507297 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role Jul 28 08:36:49.507297 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) Jul 28 08:36:49.507297 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jul 28 08:36:49.507297 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jul 28 08:36:49.507297 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Jul 28 08:36:49.507297 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application Jul 28 08:36:49.509476 dv-cinder-851351-1-smb devstack@keystone.service[282899]: [pid: 282899|app: 0|req: 242/477] 10.222.0.42 () {60 vars in 1131 bytes} [Thu Jul 28 08:36:49 2022] POST /identity/v3/roles => generated 144 bytes in 238 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:36:49.509629 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4031db2d-0764-4c4a-8218-640010b39cc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:36:49.509629 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4031db2d-0764-4c4a-8218-640010b39cc9 None admin] REQUEST_METHOD: `POST` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:36:49.509629 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4031db2d-0764-4c4a-8218-640010b39cc9 None admin] SCRIPT_NAME: `/identity` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:36:49.509629 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4031db2d-0764-4c4a-8218-640010b39cc9 None admin] PATH_INFO: `/v3/users` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:36:49.510235 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4031db2d-0764-4c4a-8218-640010b39cc9 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:36:49.511672 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4031db2d-0764-4c4a-8218-640010b39cc9 None admin] RBAC: Authorization granted {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:36:49.518108 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-239d4119-2342-4627-bb92-2b3e7619a63a None admin] Authenticating user token {{(pid=282899) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:36:49.552748 dv-cinder-851351-1-smb devstack@keystone.service[282898]: [pid: 282898|app: 0|req: 236/478] 10.222.0.42 () {60 vars in 1132 bytes} [Thu Jul 28 08:36:49 2022] POST /identity/v3/users => generated 249 bytes in 240 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 08:36:49.590060 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG dbcounter [-] [282899] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=282899) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:36:49.661229 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-239d4119-2342-4627-bb92-2b3e7619a63a None admin] Validating token access rules against request {{(pid=282899) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:36:49.703138 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed3d718-93d1-4c3d-ab0f-f48eb9b7e17c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282899) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:36:49.704627 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed3d718-93d1-4c3d-ab0f-f48eb9b7e17c None admin] REQUEST_METHOD: `GET` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:36:49.705165 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed3d718-93d1-4c3d-ab0f-f48eb9b7e17c None admin] SCRIPT_NAME: `/identity` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:36:49.705681 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed3d718-93d1-4c3d-ab0f-f48eb9b7e17c None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:36:49.718647 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ed3d718-93d1-4c3d-ab0f-f48eb9b7e17c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 08:36:49.724360 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application [None req-7ed3d718-93d1-4c3d-ab0f-f48eb9b7e17c None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 28 08:36:49.724360 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:36:49.724360 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:36:49.724360 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:36:49.724360 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:36:49.724360 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:36:49.724360 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:36:49.724360 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:36:49.724360 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:36:49.724360 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:36:49.724360 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:36:49.724360 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:36:49.724360 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 08:36:49.724360 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 08:36:49.724360 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 08:36:49.724360 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 08:36:49.725501 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 08:36:49.725501 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 08:36:49.725501 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 08:36:49.725501 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 08:36:49.725501 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:36:49.725501 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:36:49.725501 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:36:49.725501 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:36:49.725501 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:36:49.725501 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:36:49.725501 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:36:49.725501 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application with Lock( Jul 28 08:36:49.725501 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:36:49.725501 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:36:49.725501 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:36:49.725501 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:36:49.726480 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:36:49.726480 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:36:49.726480 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:36:49.726480 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:36:49.726480 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 08:36:49.726480 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 08:36:49.726480 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 08:36:49.726480 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 08:36:49.726480 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 08:36:49.726480 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 08:36:49.726480 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 28 08:36:49.726480 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application Jul 28 08:36:49.734267 dv-cinder-851351-1-smb devstack@keystone.service[282899]: [pid: 282899|app: 0|req: 243/479] 10.222.0.42 () {56 vars in 1114 bytes} [Thu Jul 28 08:36:49 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 08:36:49.736427 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4031db2d-0764-4c4a-8218-640010b39cc9 None admin] Authenticating user token {{(pid=282898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:36:49.880308 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4031db2d-0764-4c4a-8218-640010b39cc9 None admin] Validating token access rules against request {{(pid=282898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:36:49.920364 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9299e29c-0986-4660-bc2c-94c3c76e8133 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:36:49.921040 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9299e29c-0986-4660-bc2c-94c3c76e8133 None admin] REQUEST_METHOD: `GET` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:36:49.921329 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9299e29c-0986-4660-bc2c-94c3c76e8133 None admin] SCRIPT_NAME: `/identity` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:36:49.921609 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9299e29c-0986-4660-bc2c-94c3c76e8133 None admin] PATH_INFO: `/v3/roles` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:36:49.922365 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9299e29c-0986-4660-bc2c-94c3c76e8133 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=282898) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:36:49.922680 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9299e29c-0986-4660-bc2c-94c3c76e8133 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:36:49.924095 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9299e29c-0986-4660-bc2c-94c3c76e8133 None admin] RBAC: Authorization granted {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:36:49.933931 dv-cinder-851351-1-smb devstack@keystone.service[282898]: [pid: 282898|app: 0|req: 237/480] 10.222.0.42 () {56 vars in 1111 bytes} [Thu Jul 28 08:36:49 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 08:36:50.553822 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca913fa-b21f-4a9d-9286-832d614bdbcc None None] REQUEST_METHOD: `GET` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:36:50.554482 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca913fa-b21f-4a9d-9286-832d614bdbcc None None] SCRIPT_NAME: `/identity` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:36:50.554482 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca913fa-b21f-4a9d-9286-832d614bdbcc None None] PATH_INFO: `/` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:36:50.556095 dv-cinder-851351-1-smb devstack@keystone.service[282899]: [pid: 282899|app: 0|req: 244/481] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 08:36:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 08:36:50.564519 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926dde0f-ca0b-4bd5-a005-afe155880bd1 None None] REQUEST_METHOD: `POST` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:36:50.564519 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926dde0f-ca0b-4bd5-a005-afe155880bd1 None None] SCRIPT_NAME: `/identity` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:36:50.564519 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926dde0f-ca0b-4bd5-a005-afe155880bd1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:36:50.589940 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.auth.core [None req-926dde0f-ca0b-4bd5-a005-afe155880bd1 None None] MFA Rules not processed for user `2be990a66857410a87ffa7609aec4f7b`. Rule list: `[]` (Enabled: `True`). {{(pid=282898) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 08:36:50.591562 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.fernet_utils [None req-926dde0f-ca0b-4bd5-a005-afe155880bd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=282898) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:36:50.607905 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG dbcounter [-] [282898] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=282898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:36:50.665150 dv-cinder-851351-1-smb devstack@keystone.service[282898]: [pid: 282898|app: 0|req: 238/482] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 08:36:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 28 08:36:50.688045 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca913fa-b21f-4a9d-9286-832d614bdbcc None None] Authenticating user token {{(pid=282899) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:36:50.842445 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG dbcounter [-] [282899] Writing DB stats keystone:SELECT=100 {{(pid=282899) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:36:50.848968 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca913fa-b21f-4a9d-9286-832d614bdbcc None None] Validating token access rules against request {{(pid=282899) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:36:50.898302 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7221424d-e66d-483b-b2e1-35db14e65201 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282899) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:36:50.898979 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7221424d-e66d-483b-b2e1-35db14e65201 None admin] REQUEST_METHOD: `GET` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:36:50.899267 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7221424d-e66d-483b-b2e1-35db14e65201 None admin] SCRIPT_NAME: `/identity` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:36:50.899549 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7221424d-e66d-483b-b2e1-35db14e65201 None admin] PATH_INFO: `/v3/roles/service` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:36:50.917570 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7221424d-e66d-483b-b2e1-35db14e65201 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 08:36:50.922713 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application [None req-7221424d-e66d-483b-b2e1-35db14e65201 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 28 08:36:50.922713 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:36:50.922713 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:36:50.922713 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:36:50.922713 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:36:50.922713 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:36:50.922713 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:36:50.922713 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:36:50.922713 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:36:50.922713 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:36:50.922713 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:36:50.922713 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:36:50.922713 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 08:36:50.922713 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 08:36:50.922713 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 08:36:50.922713 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 08:36:50.923780 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 08:36:50.923780 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 08:36:50.923780 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 08:36:50.923780 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 08:36:50.923780 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:36:50.923780 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:36:50.923780 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:36:50.923780 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:36:50.923780 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:36:50.923780 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:36:50.923780 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:36:50.923780 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application with Lock( Jul 28 08:36:50.923780 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:36:50.923780 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:36:50.923780 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:36:50.923780 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:36:50.924765 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:36:50.924765 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:36:50.924765 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:36:50.924765 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:36:50.924765 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 08:36:50.924765 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 08:36:50.924765 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 08:36:50.924765 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 08:36:50.924765 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 08:36:50.924765 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 08:36:50.924765 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 28 08:36:50.924765 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application Jul 28 08:36:50.924765 dv-cinder-851351-1-smb devstack@keystone.service[282899]: [pid: 282899|app: 0|req: 245/483] 10.222.0.42 () {56 vars in 1102 bytes} [Thu Jul 28 08:36:50 2022] GET /identity/v3/roles/service => generated 85 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:36:50.930069 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926dde0f-ca0b-4bd5-a005-afe155880bd1 None None] Authenticating user token {{(pid=282898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:36:51.031896 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926dde0f-ca0b-4bd5-a005-afe155880bd1 None None] Validating token access rules against request {{(pid=282898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:36:51.066459 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f2da68-2155-4fd5-9dbd-ff4d0e7bc1e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:36:51.067023 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f2da68-2155-4fd5-9dbd-ff4d0e7bc1e9 None admin] REQUEST_METHOD: `GET` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:36:51.067305 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f2da68-2155-4fd5-9dbd-ff4d0e7bc1e9 None admin] SCRIPT_NAME: `/identity` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:36:51.067582 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f2da68-2155-4fd5-9dbd-ff4d0e7bc1e9 None admin] PATH_INFO: `/v3/roles` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:36:51.068326 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f2da68-2155-4fd5-9dbd-ff4d0e7bc1e9 None admin] RBAC: Adding query filter params (name=service) {{(pid=282898) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:36:51.068634 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f2da68-2155-4fd5-9dbd-ff4d0e7bc1e9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:36:51.070059 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f2da68-2155-4fd5-9dbd-ff4d0e7bc1e9 None admin] RBAC: Authorization granted {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:36:51.079021 dv-cinder-851351-1-smb devstack@keystone.service[282898]: [pid: 282898|app: 0|req: 239/484] 10.222.0.42 () {56 vars in 1103 bytes} [Thu Jul 28 08:36:50 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:36:51.085126 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7221424d-e66d-483b-b2e1-35db14e65201 None admin] Authenticating user token {{(pid=282899) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:36:51.212865 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7221424d-e66d-483b-b2e1-35db14e65201 None admin] Validating token access rules against request {{(pid=282899) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:36:51.252752 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d95d45-edbb-438d-beed-496ed27aa6e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282899) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:36:51.253475 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d95d45-edbb-438d-beed-496ed27aa6e1 None admin] REQUEST_METHOD: `GET` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:36:51.253762 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d95d45-edbb-438d-beed-496ed27aa6e1 None admin] SCRIPT_NAME: `/identity` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:36:51.254043 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d95d45-edbb-438d-beed-496ed27aa6e1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:36:51.269900 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23d95d45-edbb-438d-beed-496ed27aa6e1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:36:51.271386 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23d95d45-edbb-438d-beed-496ed27aa6e1 None admin] RBAC: Authorization granted {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:36:51.292993 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application [None req-23d95d45-edbb-438d-beed-496ed27aa6e1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 08:36:51.292993 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:36:51.292993 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:36:51.292993 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:36:51.292993 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:36:51.292993 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:36:51.292993 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:36:51.292993 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:36:51.292993 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:36:51.292993 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:36:51.292993 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:36:51.292993 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:36:51.292993 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 08:36:51.292993 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 08:36:51.292993 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 08:36:51.295155 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 08:36:51.295155 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:36:51.295155 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:36:51.295155 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:36:51.295155 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:36:51.295155 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:36:51.295155 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:36:51.295155 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:36:51.295155 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application with Lock( Jul 28 08:36:51.295155 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:36:51.295155 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:36:51.295155 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:36:51.295155 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:36:51.295155 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:36:51.295155 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:36:51.295155 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:36:51.295155 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:36:51.297469 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 08:36:51.297469 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 08:36:51.297469 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 08:36:51.297469 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application Jul 28 08:36:51.297469 dv-cinder-851351-1-smb devstack@keystone.service[282899]: [pid: 282899|app: 0|req: 246/485] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 08:36:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:36:51.300163 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f2da68-2155-4fd5-9dbd-ff4d0e7bc1e9 None admin] Authenticating user token {{(pid=282898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:36:51.321223 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG dbcounter [-] [282898] Writing DB stats keystone:SELECT=100 {{(pid=282898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:36:51.420634 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f2da68-2155-4fd5-9dbd-ff4d0e7bc1e9 None admin] Validating token access rules against request {{(pid=282898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:36:51.455821 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3253df3-fcd3-4d9e-92a4-ccb8bb0089ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:36:51.456526 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3253df3-fcd3-4d9e-92a4-ccb8bb0089ef None admin] REQUEST_METHOD: `GET` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:36:51.456844 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3253df3-fcd3-4d9e-92a4-ccb8bb0089ef None admin] SCRIPT_NAME: `/identity` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:36:51.457127 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3253df3-fcd3-4d9e-92a4-ccb8bb0089ef None admin] PATH_INFO: `/v3/domains` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:36:51.457909 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3253df3-fcd3-4d9e-92a4-ccb8bb0089ef None admin] RBAC: Adding query filter params (name=Default) {{(pid=282898) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:36:51.458230 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3253df3-fcd3-4d9e-92a4-ccb8bb0089ef None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:36:51.459636 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3253df3-fcd3-4d9e-92a4-ccb8bb0089ef None admin] RBAC: Authorization granted {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:36:51.473959 dv-cinder-851351-1-smb devstack@keystone.service[282898]: [pid: 282898|app: 0|req: 240/486] 10.222.0.42 () {56 vars in 1109 bytes} [Thu Jul 28 08:36:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:36:51.479627 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d95d45-edbb-438d-beed-496ed27aa6e1 None admin] Authenticating user token {{(pid=282899) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:36:51.493388 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG dbcounter [-] [282899] Writing DB stats keystone:SELECT=100 {{(pid=282899) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:36:51.591409 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d95d45-edbb-438d-beed-496ed27aa6e1 None admin] Validating token access rules against request {{(pid=282899) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:36:51.628844 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db08757-8152-4d16-94f7-9452a42f5311 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282899) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:36:51.629529 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db08757-8152-4d16-94f7-9452a42f5311 None admin] REQUEST_METHOD: `GET` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:36:51.629811 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db08757-8152-4d16-94f7-9452a42f5311 None admin] SCRIPT_NAME: `/identity` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:36:51.630088 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db08757-8152-4d16-94f7-9452a42f5311 None admin] PATH_INFO: `/v3/users/nova` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:36:51.640095 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db08757-8152-4d16-94f7-9452a42f5311 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:36:51.640915 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7b3d15-9c89-45b7-8f67-9ee466b57b64 None None] REQUEST_METHOD: `GET` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:36:51.641465 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7b3d15-9c89-45b7-8f67-9ee466b57b64 None None] SCRIPT_NAME: `/identity` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:36:51.641465 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7b3d15-9c89-45b7-8f67-9ee466b57b64 None None] PATH_INFO: `/` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:36:51.641792 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db08757-8152-4d16-94f7-9452a42f5311 None admin] RBAC: Authorization granted {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:36:51.643253 dv-cinder-851351-1-smb devstack@keystone.service[282898]: [pid: 282898|app: 0|req: 241/487] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 08:36:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 28 08:36:51.656649 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application [None req-3db08757-8152-4d16-94f7-9452a42f5311 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 28 08:36:51.656649 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:36:51.656649 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:36:51.656649 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:36:51.656649 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:36:51.656649 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:36:51.656649 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:36:51.656649 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:36:51.656649 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:36:51.656649 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:36:51.656649 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:36:51.656649 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:36:51.656649 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 28 08:36:51.656649 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 28 08:36:51.656649 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 28 08:36:51.656649 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 28 08:36:51.659131 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:36:51.659131 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:36:51.659131 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 28 08:36:51.659131 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 08:36:51.659131 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 28 08:36:51.659131 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 08:36:51.659131 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:36:51.659131 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:36:51.659131 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:36:51.659131 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:36:51.659131 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:36:51.659131 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application with Lock( Jul 28 08:36:51.659131 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:36:51.659131 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:36:51.659131 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:36:51.659131 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:36:51.659131 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:36:51.659131 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:36:51.661676 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:36:51.661676 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:36:51.661676 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 28 08:36:51.661676 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 28 08:36:51.661676 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 28 08:36:51.661676 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 28 08:36:51.661676 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 28 08:36:51.661676 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 28 08:36:51.661676 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 28 08:36:51.661676 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application Jul 28 08:36:51.661676 dv-cinder-851351-1-smb devstack@keystone.service[282899]: [pid: 282899|app: 0|req: 247/488] 10.222.0.42 () {56 vars in 1093 bytes} [Thu Jul 28 08:36:51 2022] GET /identity/v3/users/nova => generated 82 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:36:51.663330 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db31076-0f1e-44a2-927b-541bfa4aff84 None None] REQUEST_METHOD: `POST` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:36:51.663330 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db31076-0f1e-44a2-927b-541bfa4aff84 None None] SCRIPT_NAME: `/identity` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:36:51.663330 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db31076-0f1e-44a2-927b-541bfa4aff84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:36:51.668693 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db08757-8152-4d16-94f7-9452a42f5311 None admin] Authenticating user token {{(pid=282899) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:36:51.700135 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.auth.core [None req-5db31076-0f1e-44a2-927b-541bfa4aff84 None None] MFA Rules not processed for user `2be990a66857410a87ffa7609aec4f7b`. Rule list: `[]` (Enabled: `True`). {{(pid=282898) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 08:36:51.701513 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.fernet_utils [None req-5db31076-0f1e-44a2-927b-541bfa4aff84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=282898) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:36:51.780002 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG dbcounter [-] [282899] Writing DB stats keystone:SELECT=100 {{(pid=282899) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:36:51.843863 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db08757-8152-4d16-94f7-9452a42f5311 None admin] Validating token access rules against request {{(pid=282899) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:36:51.855638 dv-cinder-851351-1-smb devstack@keystone.service[282898]: [pid: 282898|app: 0|req: 242/489] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 08:36:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 363 bytes (3 switches on core 0) Jul 28 08:36:51.879399 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db31076-0f1e-44a2-927b-541bfa4aff84 None None] Authenticating user token {{(pid=282898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:36:51.884992 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG dbcounter [-] [282898] Writing DB stats keystone:SELECT=100 {{(pid=282898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:36:51.899067 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c26ce9-cb1f-4dcb-8a27-189392287797 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282899) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:36:51.900088 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c26ce9-cb1f-4dcb-8a27-189392287797 None admin] REQUEST_METHOD: `GET` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:36:51.900607 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c26ce9-cb1f-4dcb-8a27-189392287797 None admin] SCRIPT_NAME: `/identity` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:36:51.901149 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c26ce9-cb1f-4dcb-8a27-189392287797 None admin] PATH_INFO: `/v3/users` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:36:51.902181 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6c26ce9-cb1f-4dcb-8a27-189392287797 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=282899) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:36:51.903178 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6c26ce9-cb1f-4dcb-8a27-189392287797 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:36:51.905705 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6c26ce9-cb1f-4dcb-8a27-189392287797 None admin] RBAC: Authorization granted {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:36:51.976940 dv-cinder-851351-1-smb devstack@keystone.service[282899]: [pid: 282899|app: 0|req: 248/490] 10.222.0.42 () {56 vars in 1133 bytes} [Thu Jul 28 08:36:51 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 309 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:36:51.978960 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c26ce9-cb1f-4dcb-8a27-189392287797 None admin] Authenticating user token {{(pid=282899) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:36:52.086647 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db31076-0f1e-44a2-927b-541bfa4aff84 None None] Validating token access rules against request {{(pid=282898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:36:52.126544 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71534cb2-2c30-4e69-9a82-110f3eacd6ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:36:52.127614 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71534cb2-2c30-4e69-9a82-110f3eacd6ec None admin] REQUEST_METHOD: `GET` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:36:52.128168 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71534cb2-2c30-4e69-9a82-110f3eacd6ec None admin] SCRIPT_NAME: `/identity` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:36:52.128604 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71534cb2-2c30-4e69-9a82-110f3eacd6ec None admin] PATH_INFO: `/v3/roles/service` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:36:52.141059 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71534cb2-2c30-4e69-9a82-110f3eacd6ec None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 08:36:52.146783 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application [None req-71534cb2-2c30-4e69-9a82-110f3eacd6ec None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 28 08:36:52.146783 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:36:52.146783 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:36:52.146783 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:36:52.146783 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:36:52.146783 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:36:52.146783 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:36:52.146783 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:36:52.146783 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:36:52.146783 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:36:52.146783 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:36:52.146783 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:36:52.146783 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 08:36:52.146783 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 08:36:52.146783 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 08:36:52.146783 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 08:36:52.148070 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 08:36:52.148070 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 08:36:52.148070 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 08:36:52.148070 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 08:36:52.148070 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:36:52.148070 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:36:52.148070 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:36:52.148070 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:36:52.148070 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:36:52.148070 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:36:52.148070 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:36:52.148070 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application with Lock( Jul 28 08:36:52.148070 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:36:52.148070 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:36:52.148070 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:36:52.148070 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:36:52.149334 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:36:52.149334 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:36:52.149334 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:36:52.149334 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:36:52.149334 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 08:36:52.149334 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 08:36:52.149334 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 08:36:52.149334 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 08:36:52.149334 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 08:36:52.149334 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 08:36:52.149334 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 28 08:36:52.149334 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application Jul 28 08:36:52.150211 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c26ce9-cb1f-4dcb-8a27-189392287797 None admin] Validating token access rules against request {{(pid=282899) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:36:52.151760 dv-cinder-851351-1-smb devstack@keystone.service[282898]: [pid: 282898|app: 0|req: 243/491] 10.222.0.42 () {56 vars in 1102 bytes} [Thu Jul 28 08:36:51 2022] GET /identity/v3/roles/service => generated 85 bytes in 273 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 08:36:52.153438 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473ff5c5-e57e-4a27-a9e6-8829b578c3ac None None] REQUEST_METHOD: `GET` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:36:52.153955 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473ff5c5-e57e-4a27-a9e6-8829b578c3ac None None] SCRIPT_NAME: `/identity` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:36:52.154456 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473ff5c5-e57e-4a27-a9e6-8829b578c3ac None None] PATH_INFO: `/` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:36:52.156259 dv-cinder-851351-1-smb devstack@keystone.service[282898]: [pid: 282898|app: 0|req: 244/492] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 08:36:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 08:36:52.163342 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473ff5c5-e57e-4a27-a9e6-8829b578c3ac None None] Authenticating user token {{(pid=282898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:36:52.193564 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG dbcounter [-] [282899] Writing DB stats keystone:SELECT=100 {{(pid=282899) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:36:52.202588 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2794efdc-856c-403b-b510-c09b6a283f4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282899) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:36:52.203327 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2794efdc-856c-403b-b510-c09b6a283f4e None admin] REQUEST_METHOD: `GET` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:36:52.203679 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2794efdc-856c-403b-b510-c09b6a283f4e None admin] SCRIPT_NAME: `/identity` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:36:52.204035 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2794efdc-856c-403b-b510-c09b6a283f4e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:36:52.246891 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG dbcounter [-] [282898] Writing DB stats keystone:SELECT=100 {{(pid=282898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:36:52.283040 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2794efdc-856c-403b-b510-c09b6a283f4e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:36:52.285007 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2794efdc-856c-403b-b510-c09b6a283f4e None admin] RBAC: Authorization granted {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:36:52.305023 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473ff5c5-e57e-4a27-a9e6-8829b578c3ac None None] Validating token access rules against request {{(pid=282898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:36:52.346935 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079d9518-399f-41e0-84ce-c3d9d6495c12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:36:52.347883 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079d9518-399f-41e0-84ce-c3d9d6495c12 None admin] REQUEST_METHOD: `GET` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:36:52.348347 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079d9518-399f-41e0-84ce-c3d9d6495c12 None admin] SCRIPT_NAME: `/identity` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:36:52.348880 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079d9518-399f-41e0-84ce-c3d9d6495c12 None admin] PATH_INFO: `/v3/roles` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:36:52.349899 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-079d9518-399f-41e0-84ce-c3d9d6495c12 None admin] RBAC: Adding query filter params (name=service) {{(pid=282898) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:36:52.350387 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-079d9518-399f-41e0-84ce-c3d9d6495c12 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:36:52.351966 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-079d9518-399f-41e0-84ce-c3d9d6495c12 None admin] RBAC: Authorization granted {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:36:52.363190 dv-cinder-851351-1-smb devstack@keystone.service[282898]: [pid: 282898|app: 0|req: 245/493] 10.222.0.42 () {56 vars in 1103 bytes} [Thu Jul 28 08:36:52 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:36:52.365267 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109ac3e9-2f3e-42ff-939c-dc945cc66370 None None] REQUEST_METHOD: `POST` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:36:52.365756 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109ac3e9-2f3e-42ff-939c-dc945cc66370 None None] SCRIPT_NAME: `/identity` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:36:52.366191 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109ac3e9-2f3e-42ff-939c-dc945cc66370 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:36:52.386830 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.auth.core [None req-109ac3e9-2f3e-42ff-939c-dc945cc66370 None None] MFA Rules not processed for user `2be990a66857410a87ffa7609aec4f7b`. Rule list: `[]` (Enabled: `True`). {{(pid=282898) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 08:36:52.387985 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.fernet_utils [None req-109ac3e9-2f3e-42ff-939c-dc945cc66370 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=282898) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:36:52.413018 dv-cinder-851351-1-smb devstack@keystone.service[282899]: [pid: 282899|app: 0|req: 249/494] 10.222.0.42 () {58 vars in 1282 bytes} [Thu Jul 28 08:36:51 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 434 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 28 08:36:52.413912 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2794efdc-856c-403b-b510-c09b6a283f4e None admin] Authenticating user token {{(pid=282899) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:36:52.442780 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG dbcounter [-] [282899] Writing DB stats keystone:SELECT=100 {{(pid=282899) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:36:52.469080 dv-cinder-851351-1-smb devstack@keystone.service[282898]: [pid: 282898|app: 0|req: 246/495] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 08:36:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 08:36:52.469080 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6da3cc5-e177-4c01-b233-fe1b844b4e29 None None] REQUEST_METHOD: `GET` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:36:52.469080 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6da3cc5-e177-4c01-b233-fe1b844b4e29 None None] SCRIPT_NAME: `/identity` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:36:52.469080 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6da3cc5-e177-4c01-b233-fe1b844b4e29 None None] PATH_INFO: `/` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:36:52.469080 dv-cinder-851351-1-smb devstack@keystone.service[282898]: [pid: 282898|app: 0|req: 247/496] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 08:36:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 08:36:52.469080 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6da3cc5-e177-4c01-b233-fe1b844b4e29 None None] Authenticating user token {{(pid=282898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:36:52.528762 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2794efdc-856c-403b-b510-c09b6a283f4e None admin] Validating token access rules against request {{(pid=282899) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:36:52.540860 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG dbcounter [-] [282898] Writing DB stats keystone:SELECT=100 {{(pid=282898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:36:52.565015 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4f92c2-9d99-4f41-9009-400f5769abfb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282899) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:36:52.566033 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4f92c2-9d99-4f41-9009-400f5769abfb None admin] REQUEST_METHOD: `GET` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:36:52.566494 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4f92c2-9d99-4f41-9009-400f5769abfb None admin] SCRIPT_NAME: `/identity` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:36:52.566929 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4f92c2-9d99-4f41-9009-400f5769abfb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:36:52.578048 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db4f92c2-9d99-4f41-9009-400f5769abfb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:36:52.580163 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db4f92c2-9d99-4f41-9009-400f5769abfb None admin] RBAC: Authorization granted {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:36:52.590927 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6da3cc5-e177-4c01-b233-fe1b844b4e29 None None] Validating token access rules against request {{(pid=282898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:36:52.597018 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application [None req-db4f92c2-9d99-4f41-9009-400f5769abfb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 08:36:52.597018 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:36:52.597018 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:36:52.597018 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:36:52.597018 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:36:52.597018 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:36:52.597018 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:36:52.597018 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:36:52.597018 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:36:52.597018 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:36:52.597018 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:36:52.597018 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:36:52.597018 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 08:36:52.597018 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 08:36:52.597018 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 08:36:52.603782 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 08:36:52.603782 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:36:52.603782 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:36:52.603782 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:36:52.603782 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:36:52.603782 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:36:52.603782 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:36:52.603782 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:36:52.603782 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application with Lock( Jul 28 08:36:52.603782 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:36:52.603782 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:36:52.603782 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:36:52.603782 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:36:52.603782 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:36:52.603782 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:36:52.603782 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:36:52.603782 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:36:52.604898 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 08:36:52.604898 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 08:36:52.604898 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 08:36:52.604898 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application Jul 28 08:36:52.604898 dv-cinder-851351-1-smb devstack@keystone.service[282899]: [pid: 282899|app: 0|req: 250/497] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 08:36:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:36:52.604898 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734d1dde-8bff-4585-b94e-8099badc7ad1 None None] REQUEST_METHOD: `POST` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:36:52.604898 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734d1dde-8bff-4585-b94e-8099badc7ad1 None None] SCRIPT_NAME: `/identity` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:36:52.604898 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734d1dde-8bff-4585-b94e-8099badc7ad1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:36:52.626238 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.auth.core [None req-734d1dde-8bff-4585-b94e-8099badc7ad1 None None] MFA Rules not processed for user `2be990a66857410a87ffa7609aec4f7b`. Rule list: `[]` (Enabled: `True`). {{(pid=282899) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 08:36:52.627620 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.fernet_utils [None req-734d1dde-8bff-4585-b94e-8099badc7ad1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=282899) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:36:52.633433 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e431c72e-eb09-4e26-95e8-6ee0b6cc3128 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:36:52.634264 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e431c72e-eb09-4e26-95e8-6ee0b6cc3128 None admin] REQUEST_METHOD: `GET` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:36:52.634679 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e431c72e-eb09-4e26-95e8-6ee0b6cc3128 None admin] SCRIPT_NAME: `/identity` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:36:52.635095 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e431c72e-eb09-4e26-95e8-6ee0b6cc3128 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:36:52.647010 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e431c72e-eb09-4e26-95e8-6ee0b6cc3128 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:36:52.648584 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e431c72e-eb09-4e26-95e8-6ee0b6cc3128 None admin] RBAC: Authorization granted {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:36:52.666078 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application [None req-e431c72e-eb09-4e26-95e8-6ee0b6cc3128 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 08:36:52.666078 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:36:52.666078 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:36:52.666078 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:36:52.666078 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:36:52.666078 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:36:52.666078 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:36:52.666078 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:36:52.666078 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:36:52.666078 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:36:52.666078 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:36:52.666078 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:36:52.666078 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 08:36:52.666078 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 08:36:52.666078 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 08:36:52.667339 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 08:36:52.667339 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:36:52.667339 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:36:52.667339 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:36:52.667339 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:36:52.667339 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:36:52.667339 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:36:52.667339 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:36:52.667339 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application with Lock( Jul 28 08:36:52.667339 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:36:52.667339 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:36:52.667339 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:36:52.667339 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:36:52.667339 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:36:52.667339 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:36:52.667339 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:36:52.667339 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:36:52.668377 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 08:36:52.668377 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 08:36:52.668377 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 08:36:52.668377 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application Jul 28 08:36:52.668377 dv-cinder-851351-1-smb devstack@keystone.service[282898]: [pid: 282898|app: 0|req: 248/498] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 08:36:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:36:52.668377 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e431c72e-eb09-4e26-95e8-6ee0b6cc3128 None admin] Authenticating user token {{(pid=282898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:36:52.706895 dv-cinder-851351-1-smb devstack@keystone.service[282899]: [pid: 282899|app: 0|req: 251/499] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 08:36:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 08:36:52.708091 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-734d1dde-8bff-4585-b94e-8099badc7ad1 None None] Authenticating user token {{(pid=282899) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:36:52.720310 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG dbcounter [-] [282899] Writing DB stats keystone:SELECT=100 {{(pid=282899) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:36:52.775036 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e431c72e-eb09-4e26-95e8-6ee0b6cc3128 None admin] Validating token access rules against request {{(pid=282898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:36:52.782195 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG dbcounter [-] [282898] Writing DB stats keystone:SELECT=100 {{(pid=282898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:36:52.813340 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9698c2fe-39dc-474e-a9b7-486026ad7cce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:36:52.813974 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-734d1dde-8bff-4585-b94e-8099badc7ad1 None None] Validating token access rules against request {{(pid=282899) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:36:52.814110 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9698c2fe-39dc-474e-a9b7-486026ad7cce None admin] REQUEST_METHOD: `GET` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:36:52.814288 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9698c2fe-39dc-474e-a9b7-486026ad7cce None admin] SCRIPT_NAME: `/identity` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:36:52.814553 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9698c2fe-39dc-474e-a9b7-486026ad7cce None admin] PATH_INFO: `/v3/roles/service` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:36:52.826044 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9698c2fe-39dc-474e-a9b7-486026ad7cce None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 08:36:52.831913 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application [None req-9698c2fe-39dc-474e-a9b7-486026ad7cce None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 28 08:36:52.831913 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:36:52.831913 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:36:52.831913 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:36:52.831913 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:36:52.831913 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:36:52.831913 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:36:52.831913 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:36:52.831913 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:36:52.831913 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:36:52.831913 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:36:52.831913 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:36:52.831913 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 08:36:52.831913 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 08:36:52.831913 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 08:36:52.831913 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 08:36:52.833155 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 08:36:52.833155 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 08:36:52.833155 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 08:36:52.833155 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 08:36:52.833155 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:36:52.833155 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:36:52.833155 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:36:52.833155 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:36:52.833155 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:36:52.833155 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:36:52.833155 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:36:52.833155 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application with Lock( Jul 28 08:36:52.833155 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:36:52.833155 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:36:52.833155 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:36:52.833155 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:36:52.834143 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:36:52.834143 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:36:52.834143 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:36:52.834143 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:36:52.834143 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 08:36:52.834143 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 08:36:52.834143 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 08:36:52.834143 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 08:36:52.834143 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 08:36:52.834143 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 08:36:52.834143 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 28 08:36:52.834143 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application Jul 28 08:36:52.834143 dv-cinder-851351-1-smb devstack@keystone.service[282898]: [pid: 282898|app: 0|req: 249/500] 10.222.0.42 () {56 vars in 1102 bytes} [Thu Jul 28 08:36:52 2022] GET /identity/v3/roles/service => generated 85 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:36:52.835338 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbda605d-20f2-46a3-83b6-6e455f48ecf7 None None] REQUEST_METHOD: `GET` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:36:52.835338 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbda605d-20f2-46a3-83b6-6e455f48ecf7 None None] SCRIPT_NAME: `/identity` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:36:52.835338 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbda605d-20f2-46a3-83b6-6e455f48ecf7 None None] PATH_INFO: `/` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:36:52.836102 dv-cinder-851351-1-smb devstack@keystone.service[282898]: [pid: 282898|app: 0|req: 250/501] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 08:36:52 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 08:36:52.837571 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbda605d-20f2-46a3-83b6-6e455f48ecf7 None None] Authenticating user token {{(pid=282898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:36:52.852989 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e24e0d-429c-4230-a549-14906e8a677c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282899) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:36:52.853638 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e24e0d-429c-4230-a549-14906e8a677c None admin] REQUEST_METHOD: `GET` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:36:52.853925 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e24e0d-429c-4230-a549-14906e8a677c None admin] SCRIPT_NAME: `/identity` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:36:52.854207 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e24e0d-429c-4230-a549-14906e8a677c None admin] PATH_INFO: `/v3/domains` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:36:52.854932 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e24e0d-429c-4230-a549-14906e8a677c None admin] RBAC: Adding query filter params (name=Default) {{(pid=282899) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:36:52.855245 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e24e0d-429c-4230-a549-14906e8a677c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:36:52.856653 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e24e0d-429c-4230-a549-14906e8a677c None admin] RBAC: Authorization granted {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:36:52.868353 dv-cinder-851351-1-smb devstack@keystone.service[282899]: [pid: 282899|app: 0|req: 252/502] 10.222.0.42 () {56 vars in 1109 bytes} [Thu Jul 28 08:36:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:36:52.869245 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e24e0d-429c-4230-a549-14906e8a677c None admin] Authenticating user token {{(pid=282899) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:36:52.938141 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG dbcounter [-] [282899] Writing DB stats keystone:SELECT=100 {{(pid=282899) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:36:52.944456 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbda605d-20f2-46a3-83b6-6e455f48ecf7 None None] Validating token access rules against request {{(pid=282898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:36:52.970175 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e24e0d-429c-4230-a549-14906e8a677c None admin] Validating token access rules against request {{(pid=282899) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:36:52.980705 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a580a9ce-e5c7-4291-86cc-fe3a03e8fb2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:36:52.981706 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a580a9ce-e5c7-4291-86cc-fe3a03e8fb2d None admin] REQUEST_METHOD: `GET` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:36:52.981984 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a580a9ce-e5c7-4291-86cc-fe3a03e8fb2d None admin] SCRIPT_NAME: `/identity` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:36:52.982280 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a580a9ce-e5c7-4291-86cc-fe3a03e8fb2d None admin] PATH_INFO: `/v3/domains` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:36:52.982971 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a580a9ce-e5c7-4291-86cc-fe3a03e8fb2d None admin] RBAC: Adding query filter params (name=Default) {{(pid=282898) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:36:52.983295 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a580a9ce-e5c7-4291-86cc-fe3a03e8fb2d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:36:52.984699 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a580a9ce-e5c7-4291-86cc-fe3a03e8fb2d None admin] RBAC: Authorization granted {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:36:52.997253 dv-cinder-851351-1-smb devstack@keystone.service[282898]: [pid: 282898|app: 0|req: 251/503] 10.222.0.42 () {56 vars in 1109 bytes} [Thu Jul 28 08:36:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:36:52.998086 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a580a9ce-e5c7-4291-86cc-fe3a03e8fb2d None admin] Authenticating user token {{(pid=282898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:36:53.010516 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5589f65-5cde-4c7c-9918-49d37bc355bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282899) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:36:53.011187 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5589f65-5cde-4c7c-9918-49d37bc355bb None admin] REQUEST_METHOD: `GET` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:36:53.011481 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5589f65-5cde-4c7c-9918-49d37bc355bb None admin] SCRIPT_NAME: `/identity` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:36:53.011761 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5589f65-5cde-4c7c-9918-49d37bc355bb None admin] PATH_INFO: `/v3/roles/service` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:36:53.022532 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5589f65-5cde-4c7c-9918-49d37bc355bb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 08:36:53.026599 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG dbcounter [-] [282898] Writing DB stats keystone:SELECT=100 {{(pid=282898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:36:53.028043 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application [None req-f5589f65-5cde-4c7c-9918-49d37bc355bb None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 28 08:36:53.028043 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:36:53.028043 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:36:53.028043 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:36:53.028043 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:36:53.028043 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:36:53.028043 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:36:53.028043 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:36:53.028043 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:36:53.028043 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:36:53.028043 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:36:53.028043 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:36:53.028043 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 08:36:53.028043 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 08:36:53.028043 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 08:36:53.028043 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 08:36:53.029126 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 08:36:53.029126 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 08:36:53.029126 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 08:36:53.029126 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 08:36:53.029126 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:36:53.029126 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:36:53.029126 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:36:53.029126 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:36:53.029126 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:36:53.029126 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:36:53.029126 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:36:53.029126 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application with Lock( Jul 28 08:36:53.029126 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:36:53.029126 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:36:53.029126 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:36:53.029126 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:36:53.030061 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:36:53.030061 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:36:53.030061 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:36:53.030061 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:36:53.030061 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 08:36:53.030061 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 08:36:53.030061 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 08:36:53.030061 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 08:36:53.030061 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 08:36:53.030061 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 08:36:53.030061 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 28 08:36:53.030061 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application Jul 28 08:36:53.030061 dv-cinder-851351-1-smb devstack@keystone.service[282899]: [pid: 282899|app: 0|req: 253/504] 10.222.0.42 () {56 vars in 1102 bytes} [Thu Jul 28 08:36:52 2022] GET /identity/v3/roles/service => generated 85 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:36:53.030841 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0611409-8b2c-4dbd-a0d0-dac194f42855 None None] REQUEST_METHOD: `POST` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:36:53.031398 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0611409-8b2c-4dbd-a0d0-dac194f42855 None None] SCRIPT_NAME: `/identity` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:36:53.031398 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0611409-8b2c-4dbd-a0d0-dac194f42855 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:36:53.049181 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.auth.core [None req-c0611409-8b2c-4dbd-a0d0-dac194f42855 None None] MFA Rules not processed for user `2be990a66857410a87ffa7609aec4f7b`. Rule list: `[]` (Enabled: `True`). {{(pid=282899) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 08:36:53.050519 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.fernet_utils [None req-c0611409-8b2c-4dbd-a0d0-dac194f42855 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=282899) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:36:53.107544 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a580a9ce-e5c7-4291-86cc-fe3a03e8fb2d None admin] Validating token access rules against request {{(pid=282898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:36:53.124059 dv-cinder-851351-1-smb devstack@keystone.service[282899]: [pid: 282899|app: 0|req: 254/505] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 08:36:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 08:36:53.124965 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0611409-8b2c-4dbd-a0d0-dac194f42855 None None] Authenticating user token {{(pid=282899) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:36:53.144129 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123eb2c6-89d4-4f68-b761-a4a5b3cbeeab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:36:53.145069 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123eb2c6-89d4-4f68-b761-a4a5b3cbeeab None admin] REQUEST_METHOD: `GET` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:36:53.145517 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123eb2c6-89d4-4f68-b761-a4a5b3cbeeab None admin] SCRIPT_NAME: `/identity` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:36:53.146063 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123eb2c6-89d4-4f68-b761-a4a5b3cbeeab None admin] PATH_INFO: `/v3/roles` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:36:53.146803 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-123eb2c6-89d4-4f68-b761-a4a5b3cbeeab None admin] RBAC: Adding query filter params (name=service) {{(pid=282898) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:36:53.147377 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-123eb2c6-89d4-4f68-b761-a4a5b3cbeeab None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:36:53.148577 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-123eb2c6-89d4-4f68-b761-a4a5b3cbeeab None admin] RBAC: Authorization granted {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:36:53.157063 dv-cinder-851351-1-smb devstack@keystone.service[282898]: [pid: 282898|app: 0|req: 252/506] 10.222.0.42 () {56 vars in 1103 bytes} [Thu Jul 28 08:36:52 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:36:53.157851 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123eb2c6-89d4-4f68-b761-a4a5b3cbeeab None admin] Authenticating user token {{(pid=282898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:36:53.190779 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG dbcounter [-] [282899] Writing DB stats keystone:SELECT=100 {{(pid=282899) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:36:53.244231 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0611409-8b2c-4dbd-a0d0-dac194f42855 None None] Validating token access rules against request {{(pid=282899) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:36:53.253360 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG dbcounter [-] [282898] Writing DB stats keystone:SELECT=100 {{(pid=282898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:36:53.267525 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123eb2c6-89d4-4f68-b761-a4a5b3cbeeab None admin] Validating token access rules against request {{(pid=282898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:36:53.282077 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02809de2-52fb-419a-a30f-5283eccb64f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282899) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:36:53.282734 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02809de2-52fb-419a-a30f-5283eccb64f7 None admin] REQUEST_METHOD: `GET` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:36:53.283019 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02809de2-52fb-419a-a30f-5283eccb64f7 None admin] SCRIPT_NAME: `/identity` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:36:53.283295 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02809de2-52fb-419a-a30f-5283eccb64f7 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:36:53.290779 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02809de2-52fb-419a-a30f-5283eccb64f7 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:36:53.292259 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02809de2-52fb-419a-a30f-5283eccb64f7 None admin] RBAC: Authorization granted {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:36:53.302659 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae97ee8f-e35c-41cc-8d40-897e1a43b686 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:36:53.303299 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae97ee8f-e35c-41cc-8d40-897e1a43b686 None admin] REQUEST_METHOD: `GET` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:36:53.303590 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae97ee8f-e35c-41cc-8d40-897e1a43b686 None admin] SCRIPT_NAME: `/identity` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:36:53.303866 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae97ee8f-e35c-41cc-8d40-897e1a43b686 None admin] PATH_INFO: `/v3/projects/service` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:36:53.305192 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application [None req-02809de2-52fb-419a-a30f-5283eccb64f7 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jul 28 08:36:53.305192 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:36:53.305192 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:36:53.305192 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:36:53.305192 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:36:53.305192 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:36:53.305192 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:36:53.305192 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:36:53.305192 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:36:53.305192 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:36:53.305192 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:36:53.305192 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:36:53.305192 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 28 08:36:53.305192 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 28 08:36:53.305192 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 28 08:36:53.305192 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 28 08:36:53.306224 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:36:53.306224 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:36:53.306224 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 28 08:36:53.306224 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 08:36:53.306224 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 28 08:36:53.306224 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 08:36:53.306224 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:36:53.306224 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:36:53.306224 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:36:53.306224 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:36:53.306224 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:36:53.306224 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application with Lock( Jul 28 08:36:53.306224 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:36:53.306224 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:36:53.306224 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:36:53.306224 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:36:53.306224 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:36:53.306224 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:36:53.307265 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:36:53.307265 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:36:53.307265 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 28 08:36:53.307265 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 28 08:36:53.307265 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 28 08:36:53.307265 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 28 08:36:53.307265 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 28 08:36:53.307265 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 28 08:36:53.307265 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jul 28 08:36:53.307265 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application Jul 28 08:36:53.307265 dv-cinder-851351-1-smb devstack@keystone.service[282899]: [pid: 282899|app: 0|req: 255/507] 10.222.0.42 () {56 vars in 1099 bytes} [Thu Jul 28 08:36:53 2022] GET /identity/v3/users/cinder => generated 84 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:36:53.307265 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02809de2-52fb-419a-a30f-5283eccb64f7 None admin] Authenticating user token {{(pid=282899) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:36:53.316145 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae97ee8f-e35c-41cc-8d40-897e1a43b686 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:36:53.317753 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae97ee8f-e35c-41cc-8d40-897e1a43b686 None admin] RBAC: Authorization granted {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:36:53.330650 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application [None req-ae97ee8f-e35c-41cc-8d40-897e1a43b686 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 08:36:53.330650 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:36:53.330650 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:36:53.330650 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:36:53.330650 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:36:53.330650 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:36:53.330650 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:36:53.330650 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:36:53.330650 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:36:53.330650 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:36:53.330650 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:36:53.330650 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:36:53.330650 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 28 08:36:53.330650 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 28 08:36:53.330650 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 28 08:36:53.331821 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 28 08:36:53.331821 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:36:53.331821 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:36:53.331821 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:36:53.331821 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:36:53.331821 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:36:53.331821 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:36:53.331821 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:36:53.331821 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application with Lock( Jul 28 08:36:53.331821 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:36:53.331821 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:36:53.331821 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:36:53.331821 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:36:53.331821 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:36:53.331821 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:36:53.331821 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:36:53.331821 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:36:53.332883 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 28 08:36:53.332883 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 28 08:36:53.332883 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 28 08:36:53.332883 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 28 08:36:53.332883 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 28 08:36:53.332883 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 28 08:36:53.332883 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 08:36:53.332883 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application Jul 28 08:36:53.332883 dv-cinder-851351-1-smb devstack@keystone.service[282898]: [pid: 282898|app: 0|req: 253/508] 10.222.0.42 () {56 vars in 1111 bytes} [Thu Jul 28 08:36:53 2022] GET /identity/v3/projects/service => generated 88 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:36:53.333987 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae97ee8f-e35c-41cc-8d40-897e1a43b686 None admin] Authenticating user token {{(pid=282898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:36:53.408974 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02809de2-52fb-419a-a30f-5283eccb64f7 None admin] Validating token access rules against request {{(pid=282899) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:36:53.428741 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG dbcounter [-] [282899] Writing DB stats keystone:SELECT=100 {{(pid=282899) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:36:53.443887 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4e2c00-35b5-4a4a-b6c7-6b2d39b2acf5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282899) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:36:53.444395 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae97ee8f-e35c-41cc-8d40-897e1a43b686 None admin] Validating token access rules against request {{(pid=282898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:36:53.444545 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4e2c00-35b5-4a4a-b6c7-6b2d39b2acf5 None admin] REQUEST_METHOD: `GET` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:36:53.444728 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4e2c00-35b5-4a4a-b6c7-6b2d39b2acf5 None admin] SCRIPT_NAME: `/identity` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:36:53.445015 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4e2c00-35b5-4a4a-b6c7-6b2d39b2acf5 None admin] PATH_INFO: `/v3/roles` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:36:53.445741 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa4e2c00-35b5-4a4a-b6c7-6b2d39b2acf5 None admin] RBAC: Adding query filter params (name=service) {{(pid=282899) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:36:53.446055 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa4e2c00-35b5-4a4a-b6c7-6b2d39b2acf5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:36:53.447459 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa4e2c00-35b5-4a4a-b6c7-6b2d39b2acf5 None admin] RBAC: Authorization granted {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:36:53.460772 dv-cinder-851351-1-smb devstack@keystone.service[282899]: [pid: 282899|app: 0|req: 256/509] 10.222.0.42 () {56 vars in 1103 bytes} [Thu Jul 28 08:36:53 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:36:53.460772 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4e2c00-35b5-4a4a-b6c7-6b2d39b2acf5 None admin] Authenticating user token {{(pid=282899) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:36:53.479516 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b609a1-8f52-46e0-a773-544fa5efbb6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:36:53.480155 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b609a1-8f52-46e0-a773-544fa5efbb6a None admin] REQUEST_METHOD: `GET` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:36:53.480437 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b609a1-8f52-46e0-a773-544fa5efbb6a None admin] SCRIPT_NAME: `/identity` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:36:53.480746 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b609a1-8f52-46e0-a773-544fa5efbb6a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:36:53.491952 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7b609a1-8f52-46e0-a773-544fa5efbb6a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:36:53.493582 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7b609a1-8f52-46e0-a773-544fa5efbb6a None admin] RBAC: Authorization granted {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:36:53.502047 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG dbcounter [-] [282898] Writing DB stats keystone:SELECT=100 {{(pid=282898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:36:53.509845 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application [None req-f7b609a1-8f52-46e0-a773-544fa5efbb6a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 08:36:53.509845 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:36:53.509845 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:36:53.509845 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:36:53.509845 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:36:53.509845 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:36:53.509845 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:36:53.509845 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:36:53.509845 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:36:53.509845 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:36:53.509845 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:36:53.509845 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:36:53.509845 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 08:36:53.509845 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 08:36:53.509845 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 08:36:53.511050 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 08:36:53.511050 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:36:53.511050 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:36:53.511050 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:36:53.511050 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:36:53.511050 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:36:53.511050 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:36:53.511050 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:36:53.511050 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application with Lock( Jul 28 08:36:53.511050 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:36:53.511050 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:36:53.511050 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:36:53.511050 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:36:53.511050 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:36:53.511050 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:36:53.511050 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:36:53.511050 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:36:53.512048 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 08:36:53.512048 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 08:36:53.512048 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 08:36:53.512048 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application Jul 28 08:36:53.516128 dv-cinder-851351-1-smb devstack@keystone.service[282898]: [pid: 282898|app: 0|req: 254/510] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 08:36:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:36:53.517032 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b609a1-8f52-46e0-a773-544fa5efbb6a None admin] Authenticating user token {{(pid=282898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:36:53.563025 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4e2c00-35b5-4a4a-b6c7-6b2d39b2acf5 None admin] Validating token access rules against request {{(pid=282899) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:36:53.598808 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a284eefb-66b6-489e-8754-335564abb550 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282899) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:36:53.599534 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a284eefb-66b6-489e-8754-335564abb550 None admin] REQUEST_METHOD: `GET` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:36:53.599708 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a284eefb-66b6-489e-8754-335564abb550 None admin] SCRIPT_NAME: `/identity` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:36:53.599987 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a284eefb-66b6-489e-8754-335564abb550 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:36:53.611212 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a284eefb-66b6-489e-8754-335564abb550 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:36:53.612760 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a284eefb-66b6-489e-8754-335564abb550 None admin] RBAC: Authorization granted {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:36:53.620903 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b609a1-8f52-46e0-a773-544fa5efbb6a None admin] Validating token access rules against request {{(pid=282898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:36:53.628978 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application [None req-a284eefb-66b6-489e-8754-335564abb550 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 08:36:53.628978 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:36:53.628978 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:36:53.628978 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:36:53.628978 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:36:53.628978 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:36:53.628978 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:36:53.628978 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:36:53.628978 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:36:53.628978 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:36:53.628978 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:36:53.628978 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:36:53.628978 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 08:36:53.628978 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 08:36:53.628978 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 08:36:53.629988 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 08:36:53.629988 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:36:53.629988 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:36:53.629988 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:36:53.629988 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:36:53.629988 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:36:53.629988 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:36:53.629988 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:36:53.629988 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application with Lock( Jul 28 08:36:53.629988 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:36:53.629988 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:36:53.629988 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:36:53.629988 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:36:53.629988 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:36:53.629988 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:36:53.629988 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:36:53.629988 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:36:53.631033 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 08:36:53.631033 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 08:36:53.631033 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 08:36:53.631033 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application Jul 28 08:36:53.631033 dv-cinder-851351-1-smb devstack@keystone.service[282899]: [pid: 282899|app: 0|req: 257/511] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 08:36:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:36:53.631661 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a284eefb-66b6-489e-8754-335564abb550 None admin] Authenticating user token {{(pid=282899) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:36:53.655154 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21a98b1-1b80-4e66-9e8e-b272a4d5b363 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:36:53.655806 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21a98b1-1b80-4e66-9e8e-b272a4d5b363 None admin] REQUEST_METHOD: `GET` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:36:53.656104 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21a98b1-1b80-4e66-9e8e-b272a4d5b363 None admin] SCRIPT_NAME: `/identity` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:36:53.656369 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21a98b1-1b80-4e66-9e8e-b272a4d5b363 None admin] PATH_INFO: `/v3/users` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:36:53.657204 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a21a98b1-1b80-4e66-9e8e-b272a4d5b363 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=282898) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:36:53.657518 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a21a98b1-1b80-4e66-9e8e-b272a4d5b363 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:36:53.658999 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a21a98b1-1b80-4e66-9e8e-b272a4d5b363 None admin] RBAC: Authorization granted {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:36:53.671711 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG dbcounter [-] [282899] Writing DB stats keystone:SELECT=100 {{(pid=282899) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:36:53.697161 dv-cinder-851351-1-smb devstack@keystone.service[282898]: [pid: 282898|app: 0|req: 255/512] 10.222.0.42 () {56 vars in 1137 bytes} [Thu Jul 28 08:36:53 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:36:53.698028 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21a98b1-1b80-4e66-9e8e-b272a4d5b363 None admin] Authenticating user token {{(pid=282898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:36:53.741650 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a284eefb-66b6-489e-8754-335564abb550 None admin] Validating token access rules against request {{(pid=282899) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:36:53.759687 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG dbcounter [-] [282898] Writing DB stats keystone:SELECT=100 {{(pid=282898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:36:53.775832 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6edf0124-0132-4cef-9078-4358157335a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282899) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:36:53.776466 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6edf0124-0132-4cef-9078-4358157335a1 None admin] REQUEST_METHOD: `GET` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:36:53.776788 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6edf0124-0132-4cef-9078-4358157335a1 None admin] SCRIPT_NAME: `/identity` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:36:53.777071 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6edf0124-0132-4cef-9078-4358157335a1 None admin] PATH_INFO: `/v3/projects` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:36:53.777836 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6edf0124-0132-4cef-9078-4358157335a1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=282899) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:36:53.778143 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6edf0124-0132-4cef-9078-4358157335a1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:36:53.779594 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6edf0124-0132-4cef-9078-4358157335a1 None admin] RBAC: Authorization granted {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:36:53.797540 dv-cinder-851351-1-smb devstack@keystone.service[282899]: [pid: 282899|app: 0|req: 258/513] 10.222.0.42 () {56 vars in 1148 bytes} [Thu Jul 28 08:36:53 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:36:53.798423 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6edf0124-0132-4cef-9078-4358157335a1 None admin] Authenticating user token {{(pid=282899) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:36:53.809546 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21a98b1-1b80-4e66-9e8e-b272a4d5b363 None admin] Validating token access rules against request {{(pid=282898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:36:53.846247 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc4e34c0-eee9-4036-9e51-1706d20c072a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:36:53.846947 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4e34c0-eee9-4036-9e51-1706d20c072a None admin] REQUEST_METHOD: `GET` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:36:53.847229 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4e34c0-eee9-4036-9e51-1706d20c072a None admin] SCRIPT_NAME: `/identity` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:36:53.847499 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4e34c0-eee9-4036-9e51-1706d20c072a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:36:53.857957 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc4e34c0-eee9-4036-9e51-1706d20c072a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:36:53.859476 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc4e34c0-eee9-4036-9e51-1706d20c072a None admin] RBAC: Authorization granted {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:36:53.874911 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application [None req-bc4e34c0-eee9-4036-9e51-1706d20c072a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 08:36:53.874911 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:36:53.874911 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:36:53.874911 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:36:53.874911 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:36:53.874911 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:36:53.874911 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:36:53.874911 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:36:53.874911 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:36:53.874911 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:36:53.874911 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:36:53.874911 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:36:53.874911 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 08:36:53.874911 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 08:36:53.874911 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 08:36:53.876102 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 08:36:53.876102 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:36:53.876102 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:36:53.876102 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:36:53.876102 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:36:53.876102 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:36:53.876102 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:36:53.876102 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:36:53.876102 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application with Lock( Jul 28 08:36:53.876102 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:36:53.876102 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:36:53.876102 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:36:53.876102 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:36:53.876102 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:36:53.876102 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:36:53.876102 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:36:53.876102 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:36:53.877312 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 08:36:53.877312 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 08:36:53.877312 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 08:36:53.877312 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application Jul 28 08:36:53.880844 dv-cinder-851351-1-smb devstack@keystone.service[282898]: [pid: 282898|app: 0|req: 256/514] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 08:36:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:36:53.881722 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc4e34c0-eee9-4036-9e51-1706d20c072a None admin] Authenticating user token {{(pid=282898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:36:53.896753 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG dbcounter [-] [282899] Writing DB stats keystone:SELECT=100 {{(pid=282899) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:36:53.904311 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6edf0124-0132-4cef-9078-4358157335a1 None admin] Validating token access rules against request {{(pid=282899) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:36:53.939747 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b55b22-58f3-4944-a302-17f52e0faa6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282899) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:36:53.940446 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b55b22-58f3-4944-a302-17f52e0faa6f None admin] REQUEST_METHOD: `GET` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:36:53.940759 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b55b22-58f3-4944-a302-17f52e0faa6f None admin] SCRIPT_NAME: `/identity` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:36:53.941016 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b55b22-58f3-4944-a302-17f52e0faa6f None admin] PATH_INFO: `/v3/domains` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:36:53.941735 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b55b22-58f3-4944-a302-17f52e0faa6f None admin] RBAC: Adding query filter params (name=Default) {{(pid=282899) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:36:53.942049 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b55b22-58f3-4944-a302-17f52e0faa6f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:36:53.943476 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b55b22-58f3-4944-a302-17f52e0faa6f None admin] RBAC: Authorization granted {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:36:53.955926 dv-cinder-851351-1-smb devstack@keystone.service[282899]: [pid: 282899|app: 0|req: 259/515] 10.222.0.42 () {56 vars in 1109 bytes} [Thu Jul 28 08:36:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:36:53.956793 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b55b22-58f3-4944-a302-17f52e0faa6f None admin] Authenticating user token {{(pid=282899) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:36:53.984857 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc4e34c0-eee9-4036-9e51-1706d20c072a None admin] Validating token access rules against request {{(pid=282898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:36:53.995527 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG dbcounter [-] [282898] Writing DB stats keystone:SELECT=100 {{(pid=282898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:36:54.021411 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506a6a78-2be9-45c9-a701-707ee1b28b8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:36:54.022035 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506a6a78-2be9-45c9-a701-707ee1b28b8e None admin] REQUEST_METHOD: `GET` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:36:54.022313 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506a6a78-2be9-45c9-a701-707ee1b28b8e None admin] SCRIPT_NAME: `/identity` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:36:54.022587 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506a6a78-2be9-45c9-a701-707ee1b28b8e None admin] PATH_INFO: `/v3/domains` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:36:54.023289 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-506a6a78-2be9-45c9-a701-707ee1b28b8e None admin] RBAC: Adding query filter params (name=Default) {{(pid=282898) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:36:54.023594 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-506a6a78-2be9-45c9-a701-707ee1b28b8e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:36:54.025006 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-506a6a78-2be9-45c9-a701-707ee1b28b8e None admin] RBAC: Authorization granted {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:36:54.038292 dv-cinder-851351-1-smb devstack@keystone.service[282898]: [pid: 282898|app: 0|req: 257/516] 10.222.0.42 () {56 vars in 1109 bytes} [Thu Jul 28 08:36:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:36:54.039124 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506a6a78-2be9-45c9-a701-707ee1b28b8e None admin] Authenticating user token {{(pid=282898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:36:54.066659 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b55b22-58f3-4944-a302-17f52e0faa6f None admin] Validating token access rules against request {{(pid=282899) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:36:54.102536 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f28f658e-8b5d-425f-b86a-244ca052987f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282899) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:36:54.103171 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28f658e-8b5d-425f-b86a-244ca052987f None admin] REQUEST_METHOD: `GET` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:36:54.103459 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28f658e-8b5d-425f-b86a-244ca052987f None admin] SCRIPT_NAME: `/identity` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:36:54.103743 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28f658e-8b5d-425f-b86a-244ca052987f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:36:54.128124 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG dbcounter [-] [282899] Writing DB stats keystone:SELECT=100 {{(pid=282899) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:36:54.138708 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506a6a78-2be9-45c9-a701-707ee1b28b8e None admin] Validating token access rules against request {{(pid=282898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:36:54.172158 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa0e7440-67da-49b0-b6bd-21fb11cf84ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:36:54.172805 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0e7440-67da-49b0-b6bd-21fb11cf84ab None admin] REQUEST_METHOD: `GET` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:36:54.173086 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0e7440-67da-49b0-b6bd-21fb11cf84ab None admin] SCRIPT_NAME: `/identity` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:36:54.173384 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0e7440-67da-49b0-b6bd-21fb11cf84ab None admin] PATH_INFO: `/v3/role_assignments` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:36:54.174182 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa0e7440-67da-49b0-b6bd-21fb11cf84ab None admin] RBAC: Adding query filter params (role.id=aa4daecf3ff74fa1b7d53041a4659723, scope.project.id=5cde68cbfb9042dc9f36af3aacea2473, user.id=5e192fe026ef4f109b9a1099815c5926) {{(pid=282898) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:36:54.174494 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa0e7440-67da-49b0-b6bd-21fb11cf84ab None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:36:54.175998 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa0e7440-67da-49b0-b6bd-21fb11cf84ab None admin] RBAC: Authorization granted {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:36:54.177083 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f28f658e-8b5d-425f-b86a-244ca052987f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:36:54.178563 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f28f658e-8b5d-425f-b86a-244ca052987f None admin] RBAC: Authorization granted {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:36:54.181544 dv-cinder-851351-1-smb devstack@keystone.service[282898]: [pid: 282898|app: 0|req: 258/517] 10.222.0.42 () {56 vars in 1374 bytes} [Thu Jul 28 08:36:54 2022] GET /identity/v3/role_assignments?user.id=5e192fe026ef4f109b9a1099815c5926&scope.project.id=5cde68cbfb9042dc9f36af3aacea2473&role.id=aa4daecf3ff74fa1b7d53041a4659723 => generated 259 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:36:54.182344 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa0e7440-67da-49b0-b6bd-21fb11cf84ab None admin] Authenticating user token {{(pid=282898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:36:54.233421 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG dbcounter [-] [282898] Writing DB stats keystone:SELECT=100 {{(pid=282898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:36:54.294091 dv-cinder-851351-1-smb devstack@keystone.service[282899]: [pid: 282899|app: 0|req: 260/518] 10.222.0.42 () {58 vars in 1282 bytes} [Thu Jul 28 08:36:53 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 338 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 28 08:36:54.295007 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f28f658e-8b5d-425f-b86a-244ca052987f None admin] Authenticating user token {{(pid=282899) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:36:54.318540 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa0e7440-67da-49b0-b6bd-21fb11cf84ab None admin] Validating token access rules against request {{(pid=282898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:36:54.363198 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c557ee-6bd4-4fd2-bf70-f7c500edc0f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:36:54.363447 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG dbcounter [-] [282899] Writing DB stats keystone:SELECT=100 {{(pid=282899) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:36:54.363845 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c557ee-6bd4-4fd2-bf70-f7c500edc0f9 None admin] REQUEST_METHOD: `GET` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:36:54.364134 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c557ee-6bd4-4fd2-bf70-f7c500edc0f9 None admin] SCRIPT_NAME: `/identity` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:36:54.364415 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c557ee-6bd4-4fd2-bf70-f7c500edc0f9 None admin] PATH_INFO: `/v3/domains` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:36:54.365177 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c557ee-6bd4-4fd2-bf70-f7c500edc0f9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=282898) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:36:54.365487 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c557ee-6bd4-4fd2-bf70-f7c500edc0f9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:36:54.366897 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c557ee-6bd4-4fd2-bf70-f7c500edc0f9 None admin] RBAC: Authorization granted {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:36:54.380208 dv-cinder-851351-1-smb devstack@keystone.service[282898]: [pid: 282898|app: 0|req: 259/519] 10.222.0.42 () {56 vars in 1109 bytes} [Thu Jul 28 08:36:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:36:54.381113 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c557ee-6bd4-4fd2-bf70-f7c500edc0f9 None admin] Authenticating user token {{(pid=282898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:36:54.419501 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f28f658e-8b5d-425f-b86a-244ca052987f None admin] Validating token access rules against request {{(pid=282899) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:36:54.457533 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1490a726-282d-4880-8984-638868667f7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282899) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:36:54.458170 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1490a726-282d-4880-8984-638868667f7e None admin] REQUEST_METHOD: `POST` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:36:54.458458 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1490a726-282d-4880-8984-638868667f7e None admin] SCRIPT_NAME: `/identity` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:36:54.458731 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1490a726-282d-4880-8984-638868667f7e None admin] PATH_INFO: `/v3/users` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:36:54.459431 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1490a726-282d-4880-8984-638868667f7e None admin] RBAC: Authorizing `identity:create_user()` {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:36:54.460922 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1490a726-282d-4880-8984-638868667f7e None admin] RBAC: Authorization granted {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:36:54.492799 dv-cinder-851351-1-smb devstack@keystone.service[282899]: [pid: 282899|app: 0|req: 261/520] 10.222.0.42 () {60 vars in 1132 bytes} [Thu Jul 28 08:36:54 2022] POST /identity/v3/users => generated 247 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 08:36:54.492799 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1490a726-282d-4880-8984-638868667f7e None admin] Authenticating user token {{(pid=282899) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:36:54.495955 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG dbcounter [-] [282898] Writing DB stats keystone:SELECT=100 {{(pid=282898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:36:54.506741 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c557ee-6bd4-4fd2-bf70-f7c500edc0f9 None admin] Validating token access rules against request {{(pid=282898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:36:54.563596 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a849d72-fbb3-4a56-acaf-da05d7f5a34b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:36:54.564468 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a849d72-fbb3-4a56-acaf-da05d7f5a34b None admin] REQUEST_METHOD: `GET` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:36:54.564884 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a849d72-fbb3-4a56-acaf-da05d7f5a34b None admin] SCRIPT_NAME: `/identity` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:36:54.565290 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a849d72-fbb3-4a56-acaf-da05d7f5a34b None admin] PATH_INFO: `/v3/users/glance` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:36:54.574999 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a849d72-fbb3-4a56-acaf-da05d7f5a34b None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:36:54.576925 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a849d72-fbb3-4a56-acaf-da05d7f5a34b None admin] RBAC: Authorization granted {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:36:54.594493 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application [None req-9a849d72-fbb3-4a56-acaf-da05d7f5a34b None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jul 28 08:36:54.594493 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:36:54.594493 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:36:54.594493 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:36:54.594493 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:36:54.594493 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:36:54.594493 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:36:54.594493 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:36:54.594493 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:36:54.594493 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:36:54.594493 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:36:54.594493 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:36:54.594493 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 28 08:36:54.594493 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 28 08:36:54.594493 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 28 08:36:54.594493 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 28 08:36:54.595727 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:36:54.595727 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:36:54.595727 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 28 08:36:54.595727 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 08:36:54.595727 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 28 08:36:54.595727 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 08:36:54.595727 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:36:54.595727 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:36:54.595727 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:36:54.595727 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:36:54.595727 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:36:54.595727 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application with Lock( Jul 28 08:36:54.595727 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:36:54.595727 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:36:54.595727 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:36:54.595727 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:36:54.595727 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:36:54.595727 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:36:54.597592 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:36:54.597592 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:36:54.597592 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 28 08:36:54.597592 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 28 08:36:54.597592 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 28 08:36:54.597592 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 28 08:36:54.597592 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 28 08:36:54.597592 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 28 08:36:54.597592 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jul 28 08:36:54.597592 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application Jul 28 08:36:54.603591 dv-cinder-851351-1-smb devstack@keystone.service[282898]: [pid: 282898|app: 0|req: 260/521] 10.222.0.42 () {56 vars in 1099 bytes} [Thu Jul 28 08:36:54 2022] GET /identity/v3/users/glance => generated 84 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:36:54.603591 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a849d72-fbb3-4a56-acaf-da05d7f5a34b None admin] Authenticating user token {{(pid=282898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:36:54.646480 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1490a726-282d-4880-8984-638868667f7e None admin] Validating token access rules against request {{(pid=282899) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:36:54.662872 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG dbcounter [-] [282899] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=282899) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:36:54.702644 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70db9ac7-1388-48bf-90ec-6ae99113344e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282899) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:36:54.703331 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70db9ac7-1388-48bf-90ec-6ae99113344e None admin] REQUEST_METHOD: `GET` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:36:54.704008 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70db9ac7-1388-48bf-90ec-6ae99113344e None admin] SCRIPT_NAME: `/identity` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:36:54.704696 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70db9ac7-1388-48bf-90ec-6ae99113344e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:36:54.720881 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70db9ac7-1388-48bf-90ec-6ae99113344e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:36:54.723878 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70db9ac7-1388-48bf-90ec-6ae99113344e None admin] RBAC: Authorization granted {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:36:54.757685 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application [None req-70db9ac7-1388-48bf-90ec-6ae99113344e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 08:36:54.757685 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:36:54.757685 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:36:54.757685 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:36:54.757685 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:36:54.757685 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:36:54.757685 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:36:54.757685 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:36:54.757685 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:36:54.757685 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:36:54.757685 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:36:54.757685 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:36:54.757685 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 08:36:54.757685 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 08:36:54.757685 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 08:36:54.758839 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 08:36:54.758839 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:36:54.758839 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:36:54.758839 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:36:54.758839 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:36:54.758839 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:36:54.758839 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:36:54.758839 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:36:54.758839 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application with Lock( Jul 28 08:36:54.758839 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:36:54.758839 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:36:54.758839 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:36:54.758839 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:36:54.758839 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:36:54.758839 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:36:54.758839 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:36:54.758839 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:36:54.759847 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 08:36:54.759847 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 08:36:54.759847 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 08:36:54.759847 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application Jul 28 08:36:54.759847 dv-cinder-851351-1-smb devstack@keystone.service[282899]: [pid: 282899|app: 0|req: 262/522] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 08:36:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 276 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:36:54.765386 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70db9ac7-1388-48bf-90ec-6ae99113344e None admin] Authenticating user token {{(pid=282899) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:36:54.809661 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a849d72-fbb3-4a56-acaf-da05d7f5a34b None admin] Validating token access rules against request {{(pid=282898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:36:54.854891 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-088692a8-c30a-49d4-aec2-5974794e2244 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:36:54.855580 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088692a8-c30a-49d4-aec2-5974794e2244 None admin] REQUEST_METHOD: `GET` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:36:54.855865 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088692a8-c30a-49d4-aec2-5974794e2244 None admin] SCRIPT_NAME: `/identity` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:36:54.856144 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088692a8-c30a-49d4-aec2-5974794e2244 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:36:54.866125 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-088692a8-c30a-49d4-aec2-5974794e2244 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:36:54.867659 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-088692a8-c30a-49d4-aec2-5974794e2244 None admin] RBAC: Authorization granted {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:36:54.883639 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application [None req-088692a8-c30a-49d4-aec2-5974794e2244 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jul 28 08:36:54.883639 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:36:54.883639 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:36:54.883639 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:36:54.883639 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:36:54.883639 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:36:54.883639 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:36:54.883639 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:36:54.883639 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:36:54.883639 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:36:54.883639 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:36:54.883639 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:36:54.883639 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 28 08:36:54.883639 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 28 08:36:54.883639 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 28 08:36:54.883639 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 28 08:36:54.884807 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:36:54.884807 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:36:54.884807 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 28 08:36:54.884807 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 08:36:54.884807 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 28 08:36:54.884807 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 08:36:54.884807 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:36:54.884807 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:36:54.884807 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:36:54.884807 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:36:54.884807 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:36:54.884807 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application with Lock( Jul 28 08:36:54.884807 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:36:54.884807 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:36:54.884807 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:36:54.884807 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:36:54.884807 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:36:54.884807 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:36:54.885861 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:36:54.885861 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:36:54.885861 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 28 08:36:54.885861 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 28 08:36:54.885861 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 28 08:36:54.885861 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 28 08:36:54.885861 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 28 08:36:54.885861 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 28 08:36:54.885861 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jul 28 08:36:54.885861 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application Jul 28 08:36:54.885861 dv-cinder-851351-1-smb devstack@keystone.service[282898]: [pid: 282898|app: 0|req: 261/523] 10.222.0.42 () {56 vars in 1102 bytes} [Thu Jul 28 08:36:54 2022] GET /identity/v3/users/neutron => generated 85 bytes in 281 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:36:54.889610 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-088692a8-c30a-49d4-aec2-5974794e2244 None admin] Authenticating user token {{(pid=282898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:36:54.908911 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG dbcounter [-] [282898] Writing DB stats keystone:SELECT=100 {{(pid=282898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:36:54.933963 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70db9ac7-1388-48bf-90ec-6ae99113344e None admin] Validating token access rules against request {{(pid=282899) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:36:54.979574 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ed4d09-36ce-4e3c-b604-9152ca3c9023 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282899) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:36:54.980767 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ed4d09-36ce-4e3c-b604-9152ca3c9023 None admin] REQUEST_METHOD: `GET` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:36:54.981124 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ed4d09-36ce-4e3c-b604-9152ca3c9023 None admin] SCRIPT_NAME: `/identity` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:36:54.981466 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ed4d09-36ce-4e3c-b604-9152ca3c9023 None admin] PATH_INFO: `/v3/users` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:36:54.983041 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ed4d09-36ce-4e3c-b604-9152ca3c9023 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=282899) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:36:54.983426 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ed4d09-36ce-4e3c-b604-9152ca3c9023 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:36:54.985225 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ed4d09-36ce-4e3c-b604-9152ca3c9023 None admin] RBAC: Authorization granted {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:36:55.011795 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-088692a8-c30a-49d4-aec2-5974794e2244 None admin] Validating token access rules against request {{(pid=282898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:36:55.022898 dv-cinder-851351-1-smb devstack@keystone.service[282899]: [pid: 282899|app: 0|req: 263/524] 10.222.0.42 () {56 vars in 1137 bytes} [Thu Jul 28 08:36:54 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:36:55.022898 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ed4d09-36ce-4e3c-b604-9152ca3c9023 None admin] Authenticating user token {{(pid=282899) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:36:55.051740 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG dbcounter [-] [282899] Writing DB stats keystone:SELECT=100 {{(pid=282899) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:36:55.068846 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db29ec7-d978-4abd-b373-6cb4a2fec571 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:36:55.070404 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db29ec7-d978-4abd-b373-6cb4a2fec571 None admin] REQUEST_METHOD: `GET` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:36:55.071115 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db29ec7-d978-4abd-b373-6cb4a2fec571 None admin] SCRIPT_NAME: `/identity` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:36:55.072006 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db29ec7-d978-4abd-b373-6cb4a2fec571 None admin] PATH_INFO: `/v3/domains` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:36:55.073403 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4db29ec7-d978-4abd-b373-6cb4a2fec571 None admin] RBAC: Adding query filter params (name=Default) {{(pid=282898) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:36:55.073666 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4db29ec7-d978-4abd-b373-6cb4a2fec571 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:36:55.075031 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4db29ec7-d978-4abd-b373-6cb4a2fec571 None admin] RBAC: Authorization granted {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:36:55.089312 dv-cinder-851351-1-smb devstack@keystone.service[282898]: [pid: 282898|app: 0|req: 262/525] 10.222.0.42 () {56 vars in 1109 bytes} [Thu Jul 28 08:36:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:36:55.090351 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db29ec7-d978-4abd-b373-6cb4a2fec571 None admin] Authenticating user token {{(pid=282898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:36:55.167410 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ed4d09-36ce-4e3c-b604-9152ca3c9023 None admin] Validating token access rules against request {{(pid=282899) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:36:55.181053 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG dbcounter [-] [282898] Writing DB stats keystone:SELECT=100 {{(pid=282898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:36:55.205535 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2ff23e-4480-4238-ada7-00bf28e1b592 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282899) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:36:55.206613 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2ff23e-4480-4238-ada7-00bf28e1b592 None admin] REQUEST_METHOD: `GET` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:36:55.206959 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2ff23e-4480-4238-ada7-00bf28e1b592 None admin] SCRIPT_NAME: `/identity` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:36:55.207309 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2ff23e-4480-4238-ada7-00bf28e1b592 None admin] PATH_INFO: `/v3/users` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:36:55.208199 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a2ff23e-4480-4238-ada7-00bf28e1b592 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=282899) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:36:55.208576 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a2ff23e-4480-4238-ada7-00bf28e1b592 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:36:55.209244 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db29ec7-d978-4abd-b373-6cb4a2fec571 None admin] Validating token access rules against request {{(pid=282898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:36:55.210697 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a2ff23e-4480-4238-ada7-00bf28e1b592 None admin] RBAC: Authorization granted {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:36:55.236704 dv-cinder-851351-1-smb devstack@keystone.service[282899]: [pid: 282899|app: 0|req: 264/526] 10.222.0.42 () {56 vars in 1139 bytes} [Thu Jul 28 08:36:55 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:36:55.236704 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2ff23e-4480-4238-ada7-00bf28e1b592 None admin] Authenticating user token {{(pid=282899) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:36:55.269199 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9fe2f4-6a2d-4323-b8ad-533e71eb41eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:36:55.269961 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9fe2f4-6a2d-4323-b8ad-533e71eb41eb None admin] REQUEST_METHOD: `GET` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:36:55.270452 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9fe2f4-6a2d-4323-b8ad-533e71eb41eb None admin] SCRIPT_NAME: `/identity` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:36:55.270802 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9fe2f4-6a2d-4323-b8ad-533e71eb41eb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:36:55.333264 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG dbcounter [-] [282899] Writing DB stats keystone:SELECT=100 {{(pid=282899) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:36:55.361644 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2ff23e-4480-4238-ada7-00bf28e1b592 None admin] Validating token access rules against request {{(pid=282899) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:36:55.368124 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb9fe2f4-6a2d-4323-b8ad-533e71eb41eb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:36:55.369714 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb9fe2f4-6a2d-4323-b8ad-533e71eb41eb None admin] RBAC: Authorization granted {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:36:55.402077 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a4dbd53-6fc1-465c-8670-7d4798d9dbdc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282899) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:36:55.402747 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4dbd53-6fc1-465c-8670-7d4798d9dbdc None admin] REQUEST_METHOD: `GET` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:36:55.403078 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4dbd53-6fc1-465c-8670-7d4798d9dbdc None admin] SCRIPT_NAME: `/identity` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:36:55.403369 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4dbd53-6fc1-465c-8670-7d4798d9dbdc None admin] PATH_INFO: `/v3/projects/service` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:36:55.411345 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a4dbd53-6fc1-465c-8670-7d4798d9dbdc None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:36:55.413170 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a4dbd53-6fc1-465c-8670-7d4798d9dbdc None admin] RBAC: Authorization granted {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:36:55.426479 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application [None req-6a4dbd53-6fc1-465c-8670-7d4798d9dbdc None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 08:36:55.426479 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:36:55.426479 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:36:55.426479 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:36:55.426479 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:36:55.426479 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:36:55.426479 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:36:55.426479 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:36:55.426479 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:36:55.426479 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:36:55.426479 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:36:55.426479 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:36:55.426479 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 28 08:36:55.426479 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 28 08:36:55.426479 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 28 08:36:55.427524 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 28 08:36:55.427524 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:36:55.427524 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:36:55.427524 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:36:55.427524 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:36:55.427524 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:36:55.427524 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:36:55.427524 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:36:55.427524 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application with Lock( Jul 28 08:36:55.427524 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:36:55.427524 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:36:55.427524 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:36:55.427524 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:36:55.427524 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:36:55.427524 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:36:55.427524 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:36:55.427524 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:36:55.429135 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 28 08:36:55.429135 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 28 08:36:55.429135 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 28 08:36:55.429135 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 28 08:36:55.429135 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 28 08:36:55.429135 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 28 08:36:55.429135 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 08:36:55.429135 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application Jul 28 08:36:55.429135 dv-cinder-851351-1-smb devstack@keystone.service[282899]: [pid: 282899|app: 0|req: 265/527] 10.222.0.42 () {56 vars in 1111 bytes} [Thu Jul 28 08:36:55 2022] GET /identity/v3/projects/service => generated 88 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:36:55.429135 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a4dbd53-6fc1-465c-8670-7d4798d9dbdc None admin] Authenticating user token {{(pid=282899) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:36:55.462527 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG dbcounter [-] [282898] Writing DB stats keystone:SELECT=100 {{(pid=282898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:36:55.496116 dv-cinder-851351-1-smb devstack@keystone.service[282898]: [pid: 282898|app: 0|req: 263/528] 10.222.0.42 () {58 vars in 1282 bytes} [Thu Jul 28 08:36:55 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 406 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 28 08:36:55.497424 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9fe2f4-6a2d-4323-b8ad-533e71eb41eb None admin] Authenticating user token {{(pid=282898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:36:55.542112 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a4dbd53-6fc1-465c-8670-7d4798d9dbdc None admin] Validating token access rules against request {{(pid=282899) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:36:55.592404 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49d1f3a-1eb5-4ccf-9368-7368a74442fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282899) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:36:55.593492 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49d1f3a-1eb5-4ccf-9368-7368a74442fc None admin] REQUEST_METHOD: `GET` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:36:55.593994 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49d1f3a-1eb5-4ccf-9368-7368a74442fc None admin] SCRIPT_NAME: `/identity` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:36:55.594835 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49d1f3a-1eb5-4ccf-9368-7368a74442fc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:36:55.605944 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG dbcounter [-] [282899] Writing DB stats keystone:SELECT=100 {{(pid=282899) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:36:55.631599 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9fe2f4-6a2d-4323-b8ad-533e71eb41eb None admin] Validating token access rules against request {{(pid=282898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:36:55.676378 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c914c3-faf6-4eff-9aa3-01ed25942dee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:36:55.677293 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c914c3-faf6-4eff-9aa3-01ed25942dee None admin] REQUEST_METHOD: `GET` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:36:55.677698 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c914c3-faf6-4eff-9aa3-01ed25942dee None admin] SCRIPT_NAME: `/identity` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:36:55.678097 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c914c3-faf6-4eff-9aa3-01ed25942dee None admin] PATH_INFO: `/v3/projects` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:36:55.679200 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c914c3-faf6-4eff-9aa3-01ed25942dee None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=282898) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:36:55.679645 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c914c3-faf6-4eff-9aa3-01ed25942dee None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:36:55.681662 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c914c3-faf6-4eff-9aa3-01ed25942dee None admin] RBAC: Authorization granted {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:36:55.683144 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e49d1f3a-1eb5-4ccf-9368-7368a74442fc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:36:55.685427 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e49d1f3a-1eb5-4ccf-9368-7368a74442fc None admin] RBAC: Authorization granted {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:36:55.706623 dv-cinder-851351-1-smb devstack@keystone.service[282898]: [pid: 282898|app: 0|req: 264/529] 10.222.0.42 () {56 vars in 1148 bytes} [Thu Jul 28 08:36:55 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:36:55.707914 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c914c3-faf6-4eff-9aa3-01ed25942dee None admin] Authenticating user token {{(pid=282898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:36:55.764122 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG dbcounter [-] [282898] Writing DB stats keystone:SELECT=100 {{(pid=282898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:36:55.802163 dv-cinder-851351-1-smb devstack@keystone.service[282899]: [pid: 282899|app: 0|req: 266/530] 10.222.0.42 () {58 vars in 1282 bytes} [Thu Jul 28 08:36:55 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 373 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 28 08:36:55.803566 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49d1f3a-1eb5-4ccf-9368-7368a74442fc None admin] Authenticating user token {{(pid=282899) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:36:55.849852 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c914c3-faf6-4eff-9aa3-01ed25942dee None admin] Validating token access rules against request {{(pid=282898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:36:55.865863 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG dbcounter [-] [282899] Writing DB stats keystone:SELECT=100 {{(pid=282899) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:36:55.889000 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d3db06-4210-40a2-aeb8-9906f877d074 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:36:55.890158 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d3db06-4210-40a2-aeb8-9906f877d074 None admin] REQUEST_METHOD: `GET` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:36:55.890601 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d3db06-4210-40a2-aeb8-9906f877d074 None admin] SCRIPT_NAME: `/identity` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:36:55.891187 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d3db06-4210-40a2-aeb8-9906f877d074 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:36:55.907304 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75d3db06-4210-40a2-aeb8-9906f877d074 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:36:55.908876 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75d3db06-4210-40a2-aeb8-9906f877d074 None admin] RBAC: Authorization granted {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:36:55.926167 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application [None req-75d3db06-4210-40a2-aeb8-9906f877d074 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 08:36:55.926167 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:36:55.926167 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:36:55.926167 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:36:55.926167 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:36:55.926167 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:36:55.926167 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:36:55.926167 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:36:55.926167 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:36:55.926167 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:36:55.926167 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:36:55.926167 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:36:55.926167 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 08:36:55.926167 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 08:36:55.926167 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 08:36:55.927444 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 08:36:55.927444 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:36:55.927444 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:36:55.927444 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:36:55.927444 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:36:55.927444 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:36:55.927444 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:36:55.927444 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:36:55.927444 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application with Lock( Jul 28 08:36:55.927444 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:36:55.927444 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:36:55.927444 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:36:55.927444 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:36:55.927444 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:36:55.927444 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:36:55.927444 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:36:55.927444 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:36:55.928634 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 08:36:55.928634 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 08:36:55.928634 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 08:36:55.928634 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application Jul 28 08:36:55.930481 dv-cinder-851351-1-smb devstack@keystone.service[282898]: [pid: 282898|app: 0|req: 265/531] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 08:36:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:36:55.931889 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d3db06-4210-40a2-aeb8-9906f877d074 None admin] Authenticating user token {{(pid=282898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:36:55.947708 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49d1f3a-1eb5-4ccf-9368-7368a74442fc None admin] Validating token access rules against request {{(pid=282899) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:36:55.996197 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b98c5da-8687-4e5b-8da6-07137c9db3ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282899) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:36:55.997380 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b98c5da-8687-4e5b-8da6-07137c9db3ed None admin] REQUEST_METHOD: `GET` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:36:55.998089 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b98c5da-8687-4e5b-8da6-07137c9db3ed None admin] SCRIPT_NAME: `/identity` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:36:55.998532 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b98c5da-8687-4e5b-8da6-07137c9db3ed None admin] PATH_INFO: `/v3/role_assignments` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:36:56.000271 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b98c5da-8687-4e5b-8da6-07137c9db3ed None admin] RBAC: Adding query filter params (role.id=aa4daecf3ff74fa1b7d53041a4659723, scope.project.id=5cde68cbfb9042dc9f36af3aacea2473, user.id=3ca765453caf411782368f0070282436) {{(pid=282899) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:36:56.000797 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b98c5da-8687-4e5b-8da6-07137c9db3ed None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:36:56.003452 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b98c5da-8687-4e5b-8da6-07137c9db3ed None admin] RBAC: Authorization granted {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:36:56.012576 dv-cinder-851351-1-smb devstack@keystone.service[282899]: [pid: 282899|app: 0|req: 267/532] 10.222.0.42 () {56 vars in 1374 bytes} [Thu Jul 28 08:36:55 2022] GET /identity/v3/role_assignments?user.id=3ca765453caf411782368f0070282436&scope.project.id=5cde68cbfb9042dc9f36af3aacea2473&role.id=aa4daecf3ff74fa1b7d53041a4659723 => generated 259 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:36:56.013837 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b98c5da-8687-4e5b-8da6-07137c9db3ed None admin] Authenticating user token {{(pid=282899) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:36:56.053746 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG dbcounter [-] [282898] Writing DB stats keystone:SELECT=100 {{(pid=282898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:36:56.090493 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d3db06-4210-40a2-aeb8-9906f877d074 None admin] Validating token access rules against request {{(pid=282898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:36:56.167115 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9533c674-958e-4d34-999f-806c4798780b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:36:56.167812 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9533c674-958e-4d34-999f-806c4798780b None admin] REQUEST_METHOD: `GET` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:36:56.168094 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9533c674-958e-4d34-999f-806c4798780b None admin] SCRIPT_NAME: `/identity` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:36:56.168371 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9533c674-958e-4d34-999f-806c4798780b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:36:56.204596 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9533c674-958e-4d34-999f-806c4798780b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:36:56.205332 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9533c674-958e-4d34-999f-806c4798780b None admin] RBAC: Authorization granted {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:36:56.216098 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b98c5da-8687-4e5b-8da6-07137c9db3ed None admin] Validating token access rules against request {{(pid=282899) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:36:56.221473 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG dbcounter [-] [282899] Writing DB stats keystone:SELECT=100 {{(pid=282899) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:36:56.226102 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application [None req-9533c674-958e-4d34-999f-806c4798780b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 08:36:56.226102 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:36:56.226102 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:36:56.226102 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:36:56.226102 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:36:56.226102 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:36:56.226102 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:36:56.226102 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:36:56.226102 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:36:56.226102 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:36:56.226102 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:36:56.226102 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:36:56.226102 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 08:36:56.226102 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 08:36:56.226102 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 08:36:56.227167 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 08:36:56.227167 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:36:56.227167 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:36:56.227167 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:36:56.227167 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:36:56.227167 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:36:56.227167 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:36:56.227167 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:36:56.227167 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application with Lock( Jul 28 08:36:56.227167 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:36:56.227167 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:36:56.227167 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:36:56.227167 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:36:56.227167 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:36:56.227167 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:36:56.227167 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:36:56.227167 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:36:56.228215 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 08:36:56.228215 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 08:36:56.228215 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 08:36:56.228215 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application Jul 28 08:36:56.228215 dv-cinder-851351-1-smb devstack@keystone.service[282898]: [pid: 282898|app: 0|req: 266/533] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 08:36:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 296 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:36:56.237257 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9533c674-958e-4d34-999f-806c4798780b None admin] Authenticating user token {{(pid=282898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:36:56.262690 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3d3158-3a2a-41e3-b063-5263c50a7986 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282899) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:36:56.263351 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3d3158-3a2a-41e3-b063-5263c50a7986 None admin] REQUEST_METHOD: `GET` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:36:56.263637 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3d3158-3a2a-41e3-b063-5263c50a7986 None admin] SCRIPT_NAME: `/identity` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:36:56.263914 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3d3158-3a2a-41e3-b063-5263c50a7986 None admin] PATH_INFO: `/v3/domains` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:36:56.264793 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b3d3158-3a2a-41e3-b063-5263c50a7986 None admin] RBAC: Adding query filter params (name=Default) {{(pid=282899) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:36:56.265108 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b3d3158-3a2a-41e3-b063-5263c50a7986 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:36:56.266640 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b3d3158-3a2a-41e3-b063-5263c50a7986 None admin] RBAC: Authorization granted {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:36:56.280109 dv-cinder-851351-1-smb devstack@keystone.service[282899]: [pid: 282899|app: 0|req: 268/534] 10.222.0.42 () {56 vars in 1109 bytes} [Thu Jul 28 08:36:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:36:56.286067 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3d3158-3a2a-41e3-b063-5263c50a7986 None admin] Authenticating user token {{(pid=282899) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:36:56.369285 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9533c674-958e-4d34-999f-806c4798780b None admin] Validating token access rules against request {{(pid=282898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:36:56.401731 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3d3158-3a2a-41e3-b063-5263c50a7986 None admin] Validating token access rules against request {{(pid=282899) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:36:56.411635 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cebe28d-67cf-4e54-9565-5bcdc705fd84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:36:56.412869 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cebe28d-67cf-4e54-9565-5bcdc705fd84 None admin] REQUEST_METHOD: `GET` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:36:56.413378 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cebe28d-67cf-4e54-9565-5bcdc705fd84 None admin] SCRIPT_NAME: `/identity` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:36:56.413892 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cebe28d-67cf-4e54-9565-5bcdc705fd84 None admin] PATH_INFO: `/v3/domains` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:36:56.414944 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cebe28d-67cf-4e54-9565-5bcdc705fd84 None admin] RBAC: Adding query filter params (name=Default) {{(pid=282898) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:36:56.415497 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cebe28d-67cf-4e54-9565-5bcdc705fd84 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:36:56.417297 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cebe28d-67cf-4e54-9565-5bcdc705fd84 None admin] RBAC: Authorization granted {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:36:56.426386 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG dbcounter [-] [282898] Writing DB stats keystone:SELECT=100 {{(pid=282898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:36:56.436976 dv-cinder-851351-1-smb devstack@keystone.service[282898]: [pid: 282898|app: 0|req: 267/535] 10.222.0.42 () {56 vars in 1109 bytes} [Thu Jul 28 08:36:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:36:56.439039 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1554d80-5a54-45ef-974f-df73173de952 None None] REQUEST_METHOD: `GET` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:36:56.439585 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1554d80-5a54-45ef-974f-df73173de952 None None] SCRIPT_NAME: `/identity` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:36:56.440090 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1554d80-5a54-45ef-974f-df73173de952 None None] PATH_INFO: `/` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:36:56.444822 dv-cinder-851351-1-smb devstack@keystone.service[282898]: [pid: 282898|app: 0|req: 268/536] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 08:36:56 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 08:36:56.445952 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1554d80-5a54-45ef-974f-df73173de952 None None] Authenticating user token {{(pid=282898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:36:56.447596 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98159c74-f328-48ae-bb3e-fb6e5748725b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282899) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:36:56.448530 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98159c74-f328-48ae-bb3e-fb6e5748725b None admin] REQUEST_METHOD: `GET` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:36:56.449054 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98159c74-f328-48ae-bb3e-fb6e5748725b None admin] SCRIPT_NAME: `/identity` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:36:56.449522 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98159c74-f328-48ae-bb3e-fb6e5748725b None admin] PATH_INFO: `/v3/projects/service` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:36:56.459212 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98159c74-f328-48ae-bb3e-fb6e5748725b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:36:56.461168 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98159c74-f328-48ae-bb3e-fb6e5748725b None admin] RBAC: Authorization granted {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:36:56.475437 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application [None req-98159c74-f328-48ae-bb3e-fb6e5748725b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 08:36:56.475437 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:36:56.475437 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:36:56.475437 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:36:56.475437 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:36:56.475437 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:36:56.475437 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:36:56.475437 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:36:56.475437 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:36:56.475437 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:36:56.475437 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:36:56.475437 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:36:56.475437 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 28 08:36:56.475437 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 28 08:36:56.475437 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 28 08:36:56.476532 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 28 08:36:56.476532 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:36:56.476532 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:36:56.476532 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:36:56.476532 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:36:56.476532 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:36:56.476532 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:36:56.476532 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:36:56.476532 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application with Lock( Jul 28 08:36:56.476532 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:36:56.476532 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:36:56.476532 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:36:56.476532 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:36:56.476532 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:36:56.476532 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:36:56.476532 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:36:56.476532 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:36:56.477631 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 28 08:36:56.477631 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 28 08:36:56.477631 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 28 08:36:56.477631 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 28 08:36:56.477631 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 28 08:36:56.477631 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 28 08:36:56.477631 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 08:36:56.477631 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application Jul 28 08:36:56.480359 dv-cinder-851351-1-smb devstack@keystone.service[282899]: [pid: 282899|app: 0|req: 269/537] 10.222.0.42 () {56 vars in 1111 bytes} [Thu Jul 28 08:36:56 2022] GET /identity/v3/projects/service => generated 88 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 08:36:56.486875 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4664f01b-da10-4d4e-8435-5135d2617a24 None None] REQUEST_METHOD: `POST` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:36:56.487586 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4664f01b-da10-4d4e-8435-5135d2617a24 None None] SCRIPT_NAME: `/identity` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:36:56.488077 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4664f01b-da10-4d4e-8435-5135d2617a24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:36:56.509541 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.auth.core [None req-4664f01b-da10-4d4e-8435-5135d2617a24 None None] MFA Rules not processed for user `2be990a66857410a87ffa7609aec4f7b`. Rule list: `[]` (Enabled: `True`). {{(pid=282899) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 08:36:56.511172 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.fernet_utils [None req-4664f01b-da10-4d4e-8435-5135d2617a24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=282899) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:36:56.531828 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG dbcounter [-] [282899] Writing DB stats keystone:SELECT=100 {{(pid=282899) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:36:56.572830 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1554d80-5a54-45ef-974f-df73173de952 None None] Validating token access rules against request {{(pid=282898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:36:56.601215 dv-cinder-851351-1-smb devstack@keystone.service[282899]: [pid: 282899|app: 0|req: 270/538] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 08:36:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 08:36:56.602574 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4664f01b-da10-4d4e-8435-5135d2617a24 None None] Authenticating user token {{(pid=282899) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:36:56.634214 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd89edb6-2b42-4b49-bcc5-b1e66fd3ce85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:36:56.634828 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd89edb6-2b42-4b49-bcc5-b1e66fd3ce85 None admin] REQUEST_METHOD: `GET` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:36:56.635117 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd89edb6-2b42-4b49-bcc5-b1e66fd3ce85 None admin] SCRIPT_NAME: `/identity` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:36:56.635398 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd89edb6-2b42-4b49-bcc5-b1e66fd3ce85 None admin] PATH_INFO: `/v3/projects/service` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:36:56.645539 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd89edb6-2b42-4b49-bcc5-b1e66fd3ce85 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:36:56.647099 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd89edb6-2b42-4b49-bcc5-b1e66fd3ce85 None admin] RBAC: Authorization granted {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:36:56.664337 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application [None req-fd89edb6-2b42-4b49-bcc5-b1e66fd3ce85 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 08:36:56.664337 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:36:56.664337 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:36:56.664337 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:36:56.664337 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:36:56.664337 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:36:56.664337 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:36:56.664337 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:36:56.664337 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:36:56.664337 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:36:56.664337 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:36:56.664337 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:36:56.664337 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 28 08:36:56.664337 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 28 08:36:56.664337 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 28 08:36:56.665641 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 28 08:36:56.665641 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:36:56.665641 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:36:56.665641 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:36:56.665641 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:36:56.665641 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:36:56.665641 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:36:56.665641 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:36:56.665641 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application with Lock( Jul 28 08:36:56.665641 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:36:56.665641 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:36:56.665641 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:36:56.665641 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:36:56.665641 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:36:56.665641 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:36:56.665641 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:36:56.665641 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:36:56.667155 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 28 08:36:56.667155 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 28 08:36:56.667155 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 28 08:36:56.667155 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 28 08:36:56.667155 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 28 08:36:56.667155 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 28 08:36:56.667155 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 08:36:56.667155 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application Jul 28 08:36:56.670516 dv-cinder-851351-1-smb devstack@keystone.service[282898]: [pid: 282898|app: 0|req: 269/539] 10.222.0.42 () {56 vars in 1111 bytes} [Thu Jul 28 08:36:56 2022] GET /identity/v3/projects/service => generated 88 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:36:56.671592 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd89edb6-2b42-4b49-bcc5-b1e66fd3ce85 None admin] Authenticating user token {{(pid=282898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:36:56.735467 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4664f01b-da10-4d4e-8435-5135d2617a24 None None] Validating token access rules against request {{(pid=282899) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:36:56.738640 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG dbcounter [-] [282898] Writing DB stats keystone:SELECT=100 {{(pid=282898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:36:56.780308 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f79a26-ef26-4e78-8348-d779579e2c40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282899) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:36:56.781158 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f79a26-ef26-4e78-8348-d779579e2c40 None admin] REQUEST_METHOD: `GET` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:36:56.781463 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f79a26-ef26-4e78-8348-d779579e2c40 None admin] SCRIPT_NAME: `/identity` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:36:56.781806 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f79a26-ef26-4e78-8348-d779579e2c40 None admin] PATH_INFO: `/v3/projects` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:36:56.782617 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f79a26-ef26-4e78-8348-d779579e2c40 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=282899) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:36:56.782931 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f79a26-ef26-4e78-8348-d779579e2c40 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:36:56.784694 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f79a26-ef26-4e78-8348-d779579e2c40 None admin] RBAC: Authorization granted {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:36:56.788462 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd89edb6-2b42-4b49-bcc5-b1e66fd3ce85 None admin] Validating token access rules against request {{(pid=282898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:36:56.800303 dv-cinder-851351-1-smb devstack@keystone.service[282899]: [pid: 282899|app: 0|req: 271/540] 10.222.0.42 () {56 vars in 1148 bytes} [Thu Jul 28 08:36:56 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:36:56.805044 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f79a26-ef26-4e78-8348-d779579e2c40 None admin] Authenticating user token {{(pid=282899) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:36:56.823022 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG dbcounter [-] [282899] Writing DB stats keystone:SELECT=100 {{(pid=282899) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:36:56.837682 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b683b27a-2e7d-4acd-9573-97fabd60c3c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:36:56.838624 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b683b27a-2e7d-4acd-9573-97fabd60c3c6 None admin] REQUEST_METHOD: `GET` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:36:56.839068 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b683b27a-2e7d-4acd-9573-97fabd60c3c6 None admin] SCRIPT_NAME: `/identity` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:36:56.839500 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b683b27a-2e7d-4acd-9573-97fabd60c3c6 None admin] PATH_INFO: `/v3/roles/service` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:36:56.852288 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b683b27a-2e7d-4acd-9573-97fabd60c3c6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 08:36:56.858790 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application [None req-b683b27a-2e7d-4acd-9573-97fabd60c3c6 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 28 08:36:56.858790 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:36:56.858790 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:36:56.858790 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:36:56.858790 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:36:56.858790 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:36:56.858790 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:36:56.858790 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:36:56.858790 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:36:56.858790 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:36:56.858790 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:36:56.858790 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:36:56.858790 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 08:36:56.858790 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 08:36:56.858790 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 08:36:56.858790 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 08:36:56.860126 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 08:36:56.860126 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 08:36:56.860126 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 08:36:56.860126 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 08:36:56.860126 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:36:56.860126 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:36:56.860126 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:36:56.860126 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:36:56.860126 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:36:56.860126 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:36:56.860126 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:36:56.860126 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application with Lock( Jul 28 08:36:56.860126 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:36:56.860126 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:36:56.860126 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:36:56.860126 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:36:56.861323 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:36:56.861323 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:36:56.861323 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:36:56.861323 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:36:56.861323 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 08:36:56.861323 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 08:36:56.861323 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 08:36:56.861323 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 08:36:56.861323 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 08:36:56.861323 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 08:36:56.861323 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 28 08:36:56.861323 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application Jul 28 08:36:56.868509 dv-cinder-851351-1-smb devstack@keystone.service[282898]: [pid: 282898|app: 0|req: 270/541] 10.222.0.42 () {56 vars in 1102 bytes} [Thu Jul 28 08:36:56 2022] GET /identity/v3/roles/service => generated 85 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:36:56.869739 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b683b27a-2e7d-4acd-9573-97fabd60c3c6 None admin] Authenticating user token {{(pid=282898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:36:56.928804 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f79a26-ef26-4e78-8348-d779579e2c40 None admin] Validating token access rules against request {{(pid=282899) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:36:56.971080 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2998b8-d0f0-4b94-99ec-09eeaf1f457d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282899) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:36:56.971920 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2998b8-d0f0-4b94-99ec-09eeaf1f457d None admin] REQUEST_METHOD: `GET` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:36:56.972077 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2998b8-d0f0-4b94-99ec-09eeaf1f457d None admin] SCRIPT_NAME: `/identity` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:36:56.972309 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2998b8-d0f0-4b94-99ec-09eeaf1f457d None admin] PATH_INFO: `/v3/projects` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:36:56.973136 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad2998b8-d0f0-4b94-99ec-09eeaf1f457d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=282899) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:36:56.973510 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad2998b8-d0f0-4b94-99ec-09eeaf1f457d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:36:56.974983 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad2998b8-d0f0-4b94-99ec-09eeaf1f457d None admin] RBAC: Authorization granted {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:36:56.982870 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b683b27a-2e7d-4acd-9573-97fabd60c3c6 None admin] Validating token access rules against request {{(pid=282898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:36:56.988699 dv-cinder-851351-1-smb devstack@keystone.service[282899]: [pid: 282899|app: 0|req: 272/542] 10.222.0.42 () {56 vars in 1148 bytes} [Thu Jul 28 08:36:56 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:36:56.989259 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2998b8-d0f0-4b94-99ec-09eeaf1f457d None admin] Authenticating user token {{(pid=282899) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:36:57.009033 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG dbcounter [-] [282898] Writing DB stats keystone:SELECT=100 {{(pid=282898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:36:57.029942 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f0d479-d5e3-446a-b2ff-5e5f4d3b72c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:36:57.030586 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f0d479-d5e3-446a-b2ff-5e5f4d3b72c8 None admin] REQUEST_METHOD: `GET` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:36:57.030880 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f0d479-d5e3-446a-b2ff-5e5f4d3b72c8 None admin] SCRIPT_NAME: `/identity` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:36:57.031163 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f0d479-d5e3-446a-b2ff-5e5f4d3b72c8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:36:57.031994 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08f0d479-d5e3-446a-b2ff-5e5f4d3b72c8 None admin] RBAC: Adding query filter params (role.id=aa4daecf3ff74fa1b7d53041a4659723, scope.project.id=5cde68cbfb9042dc9f36af3aacea2473, user.id=e179a9d6bf024305ad96e6fe539413e6) {{(pid=282898) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:36:57.032312 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08f0d479-d5e3-446a-b2ff-5e5f4d3b72c8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:36:57.033849 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08f0d479-d5e3-446a-b2ff-5e5f4d3b72c8 None admin] RBAC: Authorization granted {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:36:57.040311 dv-cinder-851351-1-smb devstack@keystone.service[282898]: [pid: 282898|app: 0|req: 271/543] 10.222.0.42 () {56 vars in 1374 bytes} [Thu Jul 28 08:36:56 2022] GET /identity/v3/role_assignments?user.id=e179a9d6bf024305ad96e6fe539413e6&scope.project.id=5cde68cbfb9042dc9f36af3aacea2473&role.id=aa4daecf3ff74fa1b7d53041a4659723 => generated 259 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:36:57.041618 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ad4102-5dce-4173-804a-46699042e206 None None] REQUEST_METHOD: `GET` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:36:57.041912 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ad4102-5dce-4173-804a-46699042e206 None None] SCRIPT_NAME: `/identity` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:36:57.042192 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ad4102-5dce-4173-804a-46699042e206 None None] PATH_INFO: `/` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:36:57.048086 dv-cinder-851351-1-smb devstack@keystone.service[282898]: [pid: 282898|app: 0|req: 272/544] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 08:36:57 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 08:36:57.048968 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ad4102-5dce-4173-804a-46699042e206 None None] Authenticating user token {{(pid=282898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:36:57.082276 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG dbcounter [-] [282899] Writing DB stats keystone:SELECT=100 {{(pid=282899) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:36:57.127043 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2998b8-d0f0-4b94-99ec-09eeaf1f457d None admin] Validating token access rules against request {{(pid=282899) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:36:57.171169 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1bbb981-28b8-40e1-8a59-d1a937f7af89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282899) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:36:57.172647 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1bbb981-28b8-40e1-8a59-d1a937f7af89 None admin] REQUEST_METHOD: `GET` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:36:57.173225 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1bbb981-28b8-40e1-8a59-d1a937f7af89 None admin] SCRIPT_NAME: `/identity` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:36:57.174025 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1bbb981-28b8-40e1-8a59-d1a937f7af89 None admin] PATH_INFO: `/v3/roles` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:36:57.175705 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1bbb981-28b8-40e1-8a59-d1a937f7af89 None admin] RBAC: Adding query filter params (name=service) {{(pid=282899) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:36:57.176535 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1bbb981-28b8-40e1-8a59-d1a937f7af89 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:36:57.179082 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1bbb981-28b8-40e1-8a59-d1a937f7af89 None admin] RBAC: Authorization granted {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:36:57.186662 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ad4102-5dce-4173-804a-46699042e206 None None] Validating token access rules against request {{(pid=282898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:36:57.191778 dv-cinder-851351-1-smb devstack@keystone.service[282899]: [pid: 282899|app: 0|req: 273/545] 10.222.0.42 () {56 vars in 1103 bytes} [Thu Jul 28 08:36:56 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:36:57.193544 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f63ea5-9702-4f91-81f1-a44567d041d6 None None] REQUEST_METHOD: `POST` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:36:57.194069 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f63ea5-9702-4f91-81f1-a44567d041d6 None None] SCRIPT_NAME: `/identity` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:36:57.194536 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f63ea5-9702-4f91-81f1-a44567d041d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:36:57.224493 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.auth.core [None req-59f63ea5-9702-4f91-81f1-a44567d041d6 None None] MFA Rules not processed for user `2be990a66857410a87ffa7609aec4f7b`. Rule list: `[]` (Enabled: `True`). {{(pid=282899) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 08:36:57.225887 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.fernet_utils [None req-59f63ea5-9702-4f91-81f1-a44567d041d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=282899) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:36:57.232977 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d91afb-10e6-4231-9b72-b55aaf76d772 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:36:57.233827 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d91afb-10e6-4231-9b72-b55aaf76d772 None admin] REQUEST_METHOD: `GET` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:36:57.234212 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d91afb-10e6-4231-9b72-b55aaf76d772 None admin] SCRIPT_NAME: `/identity` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:36:57.234597 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d91afb-10e6-4231-9b72-b55aaf76d772 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:36:57.235656 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d91afb-10e6-4231-9b72-b55aaf76d772 None admin] RBAC: Adding query filter params (role.id=aa4daecf3ff74fa1b7d53041a4659723, scope.project.id=5cde68cbfb9042dc9f36af3aacea2473, user.id=7a2fa5c253dc4112bca7074204f01b0a) {{(pid=282898) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:36:57.236144 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d91afb-10e6-4231-9b72-b55aaf76d772 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:36:57.238310 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d91afb-10e6-4231-9b72-b55aaf76d772 None admin] RBAC: Authorization granted {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:36:57.247785 dv-cinder-851351-1-smb devstack@keystone.service[282898]: [pid: 282898|app: 0|req: 273/546] 10.222.0.42 () {56 vars in 1374 bytes} [Thu Jul 28 08:36:57 2022] GET /identity/v3/role_assignments?user.id=7a2fa5c253dc4112bca7074204f01b0a&scope.project.id=5cde68cbfb9042dc9f36af3aacea2473&role.id=aa4daecf3ff74fa1b7d53041a4659723 => generated 259 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:36:57.248833 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d91afb-10e6-4231-9b72-b55aaf76d772 None admin] Authenticating user token {{(pid=282898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:36:57.321815 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG dbcounter [-] [282898] Writing DB stats keystone:SELECT=100 {{(pid=282898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:36:57.327083 dv-cinder-851351-1-smb devstack@keystone.service[282899]: [pid: 282899|app: 0|req: 274/547] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 08:36:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 08:36:57.359964 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f63ea5-9702-4f91-81f1-a44567d041d6 None None] Authenticating user token {{(pid=282899) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:36:57.442279 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d91afb-10e6-4231-9b72-b55aaf76d772 None admin] Validating token access rules against request {{(pid=282898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:36:57.482201 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG dbcounter [-] [282899] Writing DB stats keystone:SELECT=100 {{(pid=282899) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:36:57.498659 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b1e46be-a695-43bf-8654-2d10429b2667 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:36:57.499329 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1e46be-a695-43bf-8654-2d10429b2667 None admin] REQUEST_METHOD: `GET` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:36:57.499615 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1e46be-a695-43bf-8654-2d10429b2667 None admin] SCRIPT_NAME: `/identity` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:36:57.499890 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1e46be-a695-43bf-8654-2d10429b2667 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:36:57.530417 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b1e46be-a695-43bf-8654-2d10429b2667 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:36:57.532938 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b1e46be-a695-43bf-8654-2d10429b2667 None admin] RBAC: Authorization granted {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:36:57.537440 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f63ea5-9702-4f91-81f1-a44567d041d6 None None] Validating token access rules against request {{(pid=282899) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:36:57.554848 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application [None req-8b1e46be-a695-43bf-8654-2d10429b2667 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 08:36:57.554848 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:36:57.554848 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:36:57.554848 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:36:57.554848 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:36:57.554848 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:36:57.554848 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:36:57.554848 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:36:57.554848 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:36:57.554848 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:36:57.554848 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:36:57.554848 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:36:57.554848 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 08:36:57.554848 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 08:36:57.554848 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 08:36:57.555961 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 08:36:57.555961 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:36:57.555961 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:36:57.555961 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:36:57.555961 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:36:57.555961 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:36:57.555961 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:36:57.555961 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:36:57.555961 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application with Lock( Jul 28 08:36:57.555961 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:36:57.555961 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:36:57.555961 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:36:57.555961 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:36:57.555961 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:36:57.555961 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:36:57.555961 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:36:57.555961 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:36:57.557016 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 08:36:57.557016 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 08:36:57.557016 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 08:36:57.557016 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application Jul 28 08:36:57.557016 dv-cinder-851351-1-smb devstack@keystone.service[282898]: [pid: 282898|app: 0|req: 274/548] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 08:36:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 308 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:36:57.563756 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b1e46be-a695-43bf-8654-2d10429b2667 None admin] Authenticating user token {{(pid=282898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:36:57.599377 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8cbf612-bf78-4633-bd15-a04d1bd105fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282899) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:36:57.600473 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8cbf612-bf78-4633-bd15-a04d1bd105fc None admin] REQUEST_METHOD: `GET` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:36:57.600995 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8cbf612-bf78-4633-bd15-a04d1bd105fc None admin] SCRIPT_NAME: `/identity` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:36:57.601508 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8cbf612-bf78-4633-bd15-a04d1bd105fc None admin] PATH_INFO: `/v3/roles/service` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:36:57.624009 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8cbf612-bf78-4633-bd15-a04d1bd105fc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 08:36:57.629835 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application [None req-e8cbf612-bf78-4633-bd15-a04d1bd105fc None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 28 08:36:57.629835 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:36:57.629835 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:36:57.629835 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:36:57.629835 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:36:57.629835 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:36:57.629835 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:36:57.629835 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:36:57.629835 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:36:57.629835 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:36:57.629835 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:36:57.629835 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:36:57.629835 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 08:36:57.629835 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 08:36:57.629835 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 08:36:57.629835 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 08:36:57.630975 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 08:36:57.630975 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 08:36:57.630975 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 08:36:57.630975 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 08:36:57.630975 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:36:57.630975 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:36:57.630975 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:36:57.630975 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:36:57.630975 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:36:57.630975 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:36:57.630975 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:36:57.630975 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application with Lock( Jul 28 08:36:57.630975 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:36:57.630975 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:36:57.630975 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:36:57.630975 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:36:57.631913 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:36:57.631913 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:36:57.631913 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:36:57.631913 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:36:57.631913 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 08:36:57.631913 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 08:36:57.631913 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 08:36:57.631913 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 08:36:57.631913 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 08:36:57.631913 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 08:36:57.631913 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 28 08:36:57.631913 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application Jul 28 08:36:57.634846 dv-cinder-851351-1-smb devstack@keystone.service[282899]: [pid: 282899|app: 0|req: 275/549] 10.222.0.42 () {56 vars in 1102 bytes} [Thu Jul 28 08:36:57 2022] GET /identity/v3/roles/service => generated 85 bytes in 275 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:36:57.642040 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8cbf612-bf78-4633-bd15-a04d1bd105fc None admin] Authenticating user token {{(pid=282899) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:36:57.709190 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG dbcounter [-] [282898] Writing DB stats keystone:SELECT=100 {{(pid=282898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:36:57.724804 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b1e46be-a695-43bf-8654-2d10429b2667 None admin] Validating token access rules against request {{(pid=282898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:36:57.822196 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c94728d-7a63-469f-ac89-0d846557a004 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:36:57.822939 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c94728d-7a63-469f-ac89-0d846557a004 None admin] REQUEST_METHOD: `GET` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:36:57.823226 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c94728d-7a63-469f-ac89-0d846557a004 None admin] SCRIPT_NAME: `/identity` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:36:57.823502 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c94728d-7a63-469f-ac89-0d846557a004 None admin] PATH_INFO: `/v3/domains` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:36:57.824363 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c94728d-7a63-469f-ac89-0d846557a004 None admin] RBAC: Adding query filter params (name=Default) {{(pid=282898) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:36:57.824693 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c94728d-7a63-469f-ac89-0d846557a004 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:36:57.826330 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c94728d-7a63-469f-ac89-0d846557a004 None admin] RBAC: Authorization granted {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:36:57.830921 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8cbf612-bf78-4633-bd15-a04d1bd105fc None admin] Validating token access rules against request {{(pid=282899) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:36:57.859018 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG dbcounter [-] [282899] Writing DB stats keystone:SELECT=100 {{(pid=282899) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:36:57.861099 dv-cinder-851351-1-smb devstack@keystone.service[282898]: [pid: 282898|app: 0|req: 275/550] 10.222.0.42 () {56 vars in 1109 bytes} [Thu Jul 28 08:36:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 298 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:36:57.869793 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c94728d-7a63-469f-ac89-0d846557a004 None admin] Authenticating user token {{(pid=282898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:36:57.879778 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc335e12-d6ea-4942-9cb9-b1f3ba161d4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282899) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:36:57.880609 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc335e12-d6ea-4942-9cb9-b1f3ba161d4f None admin] REQUEST_METHOD: `GET` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:36:57.881135 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc335e12-d6ea-4942-9cb9-b1f3ba161d4f None admin] SCRIPT_NAME: `/identity` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:36:57.881667 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc335e12-d6ea-4942-9cb9-b1f3ba161d4f None admin] PATH_INFO: `/v3/roles` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:36:57.882954 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc335e12-d6ea-4942-9cb9-b1f3ba161d4f None admin] RBAC: Adding query filter params (name=service) {{(pid=282899) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:36:57.883467 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc335e12-d6ea-4942-9cb9-b1f3ba161d4f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:36:57.885335 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc335e12-d6ea-4942-9cb9-b1f3ba161d4f None admin] RBAC: Authorization granted {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:36:57.901481 dv-cinder-851351-1-smb devstack@keystone.service[282899]: [pid: 282899|app: 0|req: 276/551] 10.222.0.42 () {56 vars in 1103 bytes} [Thu Jul 28 08:36:57 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 08:36:57.908613 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc335e12-d6ea-4942-9cb9-b1f3ba161d4f None admin] Authenticating user token {{(pid=282899) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:36:58.035223 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc335e12-d6ea-4942-9cb9-b1f3ba161d4f None admin] Validating token access rules against request {{(pid=282899) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:36:58.085445 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d287640-05b3-44a9-8f9e-9166878c60c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282899) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:36:58.086126 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d287640-05b3-44a9-8f9e-9166878c60c4 None admin] REQUEST_METHOD: `GET` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:36:58.086408 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d287640-05b3-44a9-8f9e-9166878c60c4 None admin] SCRIPT_NAME: `/identity` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:36:58.086684 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d287640-05b3-44a9-8f9e-9166878c60c4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:36:58.106322 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d287640-05b3-44a9-8f9e-9166878c60c4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:36:58.107829 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d287640-05b3-44a9-8f9e-9166878c60c4 None admin] RBAC: Authorization granted {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:36:58.137008 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application [None req-6d287640-05b3-44a9-8f9e-9166878c60c4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 08:36:58.137008 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:36:58.137008 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:36:58.137008 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:36:58.137008 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:36:58.137008 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:36:58.137008 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:36:58.137008 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:36:58.137008 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:36:58.137008 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:36:58.137008 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:36:58.137008 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:36:58.137008 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 08:36:58.137008 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 08:36:58.137008 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 08:36:58.138092 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 08:36:58.138092 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:36:58.138092 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:36:58.138092 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:36:58.138092 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:36:58.138092 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:36:58.138092 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:36:58.138092 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:36:58.138092 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application with Lock( Jul 28 08:36:58.138092 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:36:58.138092 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:36:58.138092 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:36:58.138092 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:36:58.138092 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:36:58.138092 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:36:58.138092 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:36:58.138092 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:36:58.139090 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 08:36:58.139090 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 08:36:58.139090 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 08:36:58.139090 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application Jul 28 08:36:58.139090 dv-cinder-851351-1-smb devstack@keystone.service[282899]: [pid: 282899|app: 0|req: 277/552] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 08:36:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 08:36:58.145721 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d287640-05b3-44a9-8f9e-9166878c60c4 None admin] Authenticating user token {{(pid=282899) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:36:58.148016 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c94728d-7a63-469f-ac89-0d846557a004 None admin] Validating token access rules against request {{(pid=282898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:36:58.192318 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG dbcounter [-] [282899] Writing DB stats keystone:SELECT=100 {{(pid=282899) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:36:58.226889 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f459133-bf21-42dd-9d6d-2b5542eb2282 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:36:58.227569 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f459133-bf21-42dd-9d6d-2b5542eb2282 None admin] REQUEST_METHOD: `GET` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:36:58.227856 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f459133-bf21-42dd-9d6d-2b5542eb2282 None admin] SCRIPT_NAME: `/identity` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:36:58.228132 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f459133-bf21-42dd-9d6d-2b5542eb2282 None admin] PATH_INFO: `/v3/users/nova` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:36:58.240724 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f459133-bf21-42dd-9d6d-2b5542eb2282 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:36:58.250482 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f459133-bf21-42dd-9d6d-2b5542eb2282 None admin] RBAC: Authorization granted {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:36:58.265392 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d287640-05b3-44a9-8f9e-9166878c60c4 None admin] Validating token access rules against request {{(pid=282899) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:36:58.276160 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application [None req-8f459133-bf21-42dd-9d6d-2b5542eb2282 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 28 08:36:58.276160 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:36:58.276160 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:36:58.276160 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:36:58.276160 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:36:58.276160 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:36:58.276160 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:36:58.276160 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:36:58.276160 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:36:58.276160 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:36:58.276160 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:36:58.276160 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:36:58.276160 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 28 08:36:58.276160 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 28 08:36:58.276160 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 28 08:36:58.276160 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 28 08:36:58.277355 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:36:58.277355 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:36:58.277355 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 28 08:36:58.277355 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 08:36:58.277355 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 28 08:36:58.277355 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 08:36:58.277355 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:36:58.277355 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:36:58.277355 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:36:58.277355 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:36:58.277355 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:36:58.277355 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application with Lock( Jul 28 08:36:58.277355 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:36:58.277355 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:36:58.277355 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:36:58.277355 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:36:58.277355 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:36:58.277355 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:36:58.278412 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:36:58.278412 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:36:58.278412 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 28 08:36:58.278412 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 28 08:36:58.278412 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 28 08:36:58.278412 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 28 08:36:58.278412 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 28 08:36:58.278412 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 28 08:36:58.278412 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 28 08:36:58.278412 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application Jul 28 08:36:58.281905 dv-cinder-851351-1-smb devstack@keystone.service[282898]: [pid: 282898|app: 0|req: 276/553] 10.222.0.42 () {56 vars in 1093 bytes} [Thu Jul 28 08:36:57 2022] GET /identity/v3/users/nova => generated 82 bytes in 408 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:36:58.283127 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f459133-bf21-42dd-9d6d-2b5542eb2282 None admin] Authenticating user token {{(pid=282898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:36:58.320141 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f91f7a-b513-4a48-b256-9a848fb8a024 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282899) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:36:58.321220 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f91f7a-b513-4a48-b256-9a848fb8a024 None admin] REQUEST_METHOD: `GET` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:36:58.321738 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f91f7a-b513-4a48-b256-9a848fb8a024 None admin] SCRIPT_NAME: `/identity` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:36:58.322275 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f91f7a-b513-4a48-b256-9a848fb8a024 None admin] PATH_INFO: `/v3/domains` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:36:58.323248 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f91f7a-b513-4a48-b256-9a848fb8a024 None admin] RBAC: Adding query filter params (name=Default) {{(pid=282899) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:36:58.323791 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f91f7a-b513-4a48-b256-9a848fb8a024 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:36:58.325503 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f91f7a-b513-4a48-b256-9a848fb8a024 None admin] RBAC: Authorization granted {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:36:58.327393 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG dbcounter [-] [282898] Writing DB stats keystone:SELECT=100 {{(pid=282898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:36:58.354475 dv-cinder-851351-1-smb devstack@keystone.service[282899]: [pid: 282899|app: 0|req: 278/554] 10.222.0.42 () {56 vars in 1109 bytes} [Thu Jul 28 08:36:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:36:58.361408 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f91f7a-b513-4a48-b256-9a848fb8a024 None admin] Authenticating user token {{(pid=282899) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:36:58.456189 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f459133-bf21-42dd-9d6d-2b5542eb2282 None admin] Validating token access rules against request {{(pid=282898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:36:58.503426 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG dbcounter [-] [282899] Writing DB stats keystone:SELECT=100 {{(pid=282899) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:36:58.507838 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f37317-e883-42a5-a03f-97d17ba7deb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:36:58.508622 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f37317-e883-42a5-a03f-97d17ba7deb6 None admin] REQUEST_METHOD: `GET` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:36:58.508942 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f37317-e883-42a5-a03f-97d17ba7deb6 None admin] SCRIPT_NAME: `/identity` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:36:58.509220 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f37317-e883-42a5-a03f-97d17ba7deb6 None admin] PATH_INFO: `/v3/users` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:36:58.510109 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f37317-e883-42a5-a03f-97d17ba7deb6 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=282898) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:36:58.510426 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f37317-e883-42a5-a03f-97d17ba7deb6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:36:58.511197 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f91f7a-b513-4a48-b256-9a848fb8a024 None admin] Validating token access rules against request {{(pid=282899) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:36:58.512304 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f37317-e883-42a5-a03f-97d17ba7deb6 None admin] RBAC: Authorization granted {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:36:58.540754 dv-cinder-851351-1-smb devstack@keystone.service[282898]: [pid: 282898|app: 0|req: 277/555] 10.222.0.42 () {56 vars in 1133 bytes} [Thu Jul 28 08:36:58 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:36:58.542583 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d28bb7-5c49-4ae3-b1ba-fb4b1d8a9970 None None] REQUEST_METHOD: `GET` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:36:58.542878 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d28bb7-5c49-4ae3-b1ba-fb4b1d8a9970 None None] SCRIPT_NAME: `/identity` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:36:58.543164 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d28bb7-5c49-4ae3-b1ba-fb4b1d8a9970 None None] PATH_INFO: `/` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:36:58.544694 dv-cinder-851351-1-smb devstack@keystone.service[282898]: [pid: 282898|app: 0|req: 278/556] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 08:36:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 08:36:58.546728 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d28bb7-5c49-4ae3-b1ba-fb4b1d8a9970 None None] Authenticating user token {{(pid=282898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:36:58.560207 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d8ffec-82ab-41c6-81e0-17e4d96aa8f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282899) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:36:58.560923 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d8ffec-82ab-41c6-81e0-17e4d96aa8f8 None admin] REQUEST_METHOD: `GET` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:36:58.561256 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d8ffec-82ab-41c6-81e0-17e4d96aa8f8 None admin] SCRIPT_NAME: `/identity` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:36:58.561599 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d8ffec-82ab-41c6-81e0-17e4d96aa8f8 None admin] PATH_INFO: `/v3/users/swift` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:36:58.572000 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d8ffec-82ab-41c6-81e0-17e4d96aa8f8 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:36:58.574300 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d8ffec-82ab-41c6-81e0-17e4d96aa8f8 None admin] RBAC: Authorization granted {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:36:58.588734 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application [None req-88d8ffec-82ab-41c6-81e0-17e4d96aa8f8 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 28 08:36:58.588734 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:36:58.588734 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:36:58.588734 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:36:58.588734 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:36:58.588734 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:36:58.588734 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:36:58.588734 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:36:58.588734 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:36:58.588734 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:36:58.588734 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:36:58.588734 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:36:58.588734 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 28 08:36:58.588734 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 28 08:36:58.588734 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 28 08:36:58.588734 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 28 08:36:58.589920 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:36:58.589920 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:36:58.589920 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 28 08:36:58.589920 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 08:36:58.589920 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 28 08:36:58.589920 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 08:36:58.589920 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:36:58.589920 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:36:58.589920 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:36:58.589920 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:36:58.589920 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:36:58.589920 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application with Lock( Jul 28 08:36:58.589920 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:36:58.589920 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:36:58.589920 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:36:58.589920 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:36:58.589920 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:36:58.589920 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:36:58.591227 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:36:58.591227 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:36:58.591227 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 28 08:36:58.591227 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 28 08:36:58.591227 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 28 08:36:58.591227 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 28 08:36:58.591227 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 28 08:36:58.591227 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 28 08:36:58.591227 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 28 08:36:58.591227 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application Jul 28 08:36:58.595013 dv-cinder-851351-1-smb devstack@keystone.service[282899]: [pid: 282899|app: 0|req: 279/557] 10.222.0.42 () {56 vars in 1096 bytes} [Thu Jul 28 08:36:58 2022] GET /identity/v3/users/swift => generated 83 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 08:36:58.596569 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae62675-e9f7-4267-b2a6-ce47912c25e5 None None] REQUEST_METHOD: `POST` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:36:58.596951 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae62675-e9f7-4267-b2a6-ce47912c25e5 None None] SCRIPT_NAME: `/identity` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:36:58.597297 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae62675-e9f7-4267-b2a6-ce47912c25e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:36:58.618855 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.auth.core [None req-1ae62675-e9f7-4267-b2a6-ce47912c25e5 None None] MFA Rules not processed for user `2be990a66857410a87ffa7609aec4f7b`. Rule list: `[]` (Enabled: `True`). {{(pid=282899) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 08:36:58.620103 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.fernet_utils [None req-1ae62675-e9f7-4267-b2a6-ce47912c25e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=282899) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:36:58.652448 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG dbcounter [-] [282898] Writing DB stats keystone:SELECT=100 {{(pid=282898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:36:58.684198 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d28bb7-5c49-4ae3-b1ba-fb4b1d8a9970 None None] Validating token access rules against request {{(pid=282898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:36:58.711731 dv-cinder-851351-1-smb devstack@keystone.service[282899]: [pid: 282899|app: 0|req: 280/558] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 08:36:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 08:36:58.712952 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae62675-e9f7-4267-b2a6-ce47912c25e5 None None] Authenticating user token {{(pid=282899) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:36:58.738476 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5dde38d-8262-4987-993d-cf8afb012015 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:36:58.739247 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5dde38d-8262-4987-993d-cf8afb012015 None admin] REQUEST_METHOD: `GET` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:36:58.739646 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5dde38d-8262-4987-993d-cf8afb012015 None admin] SCRIPT_NAME: `/identity` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:36:58.740271 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5dde38d-8262-4987-993d-cf8afb012015 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:36:58.758513 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5dde38d-8262-4987-993d-cf8afb012015 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:36:58.760264 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5dde38d-8262-4987-993d-cf8afb012015 None admin] RBAC: Authorization granted {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:36:58.782176 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application [None req-b5dde38d-8262-4987-993d-cf8afb012015 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 08:36:58.782176 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:36:58.782176 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:36:58.782176 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:36:58.782176 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:36:58.782176 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:36:58.782176 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:36:58.782176 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:36:58.782176 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:36:58.782176 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:36:58.782176 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:36:58.782176 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:36:58.782176 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 08:36:58.782176 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 08:36:58.782176 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 08:36:58.783488 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 08:36:58.783488 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:36:58.783488 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:36:58.783488 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:36:58.783488 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:36:58.783488 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:36:58.783488 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:36:58.783488 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:36:58.783488 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application with Lock( Jul 28 08:36:58.783488 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:36:58.783488 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:36:58.783488 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:36:58.783488 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:36:58.783488 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:36:58.783488 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:36:58.783488 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:36:58.783488 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:36:58.784861 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 08:36:58.784861 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 08:36:58.784861 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 08:36:58.784861 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application Jul 28 08:36:58.787320 dv-cinder-851351-1-smb devstack@keystone.service[282898]: [pid: 282898|app: 0|req: 279/559] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 08:36:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 242 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:36:58.788470 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5dde38d-8262-4987-993d-cf8afb012015 None admin] Authenticating user token {{(pid=282898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:36:58.838631 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG dbcounter [-] [282899] Writing DB stats keystone:SELECT=100 {{(pid=282899) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:36:58.854459 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae62675-e9f7-4267-b2a6-ce47912c25e5 None None] Validating token access rules against request {{(pid=282899) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:36:58.892075 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-915fa265-9dce-47ba-91b2-c93d90a19b25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282899) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:36:58.892821 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915fa265-9dce-47ba-91b2-c93d90a19b25 None admin] REQUEST_METHOD: `GET` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:36:58.893104 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915fa265-9dce-47ba-91b2-c93d90a19b25 None admin] SCRIPT_NAME: `/identity` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:36:58.893426 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915fa265-9dce-47ba-91b2-c93d90a19b25 None admin] PATH_INFO: `/v3/users` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:36:58.894432 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-915fa265-9dce-47ba-91b2-c93d90a19b25 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=282899) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:36:58.894745 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-915fa265-9dce-47ba-91b2-c93d90a19b25 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:36:58.897321 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-915fa265-9dce-47ba-91b2-c93d90a19b25 None admin] RBAC: Authorization granted {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:36:58.924858 dv-cinder-851351-1-smb devstack@keystone.service[282899]: [pid: 282899|app: 0|req: 281/560] 10.222.0.42 () {56 vars in 1135 bytes} [Thu Jul 28 08:36:58 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:36:58.926302 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-915fa265-9dce-47ba-91b2-c93d90a19b25 None admin] Authenticating user token {{(pid=282899) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:36:58.943097 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5dde38d-8262-4987-993d-cf8afb012015 None admin] Validating token access rules against request {{(pid=282898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:36:58.975245 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG dbcounter [-] [282898] Writing DB stats keystone:SELECT=100 {{(pid=282898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:36:58.985836 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61bbf959-f996-4009-8124-f8923f5cf939 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:36:58.986754 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61bbf959-f996-4009-8124-f8923f5cf939 None admin] REQUEST_METHOD: `GET` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:36:58.986875 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61bbf959-f996-4009-8124-f8923f5cf939 None admin] SCRIPT_NAME: `/identity` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:36:58.987176 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61bbf959-f996-4009-8124-f8923f5cf939 None admin] PATH_INFO: `/v3/roles/service` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:36:58.999732 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61bbf959-f996-4009-8124-f8923f5cf939 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 08:36:59.006559 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application [None req-61bbf959-f996-4009-8124-f8923f5cf939 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 28 08:36:59.006559 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:36:59.006559 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:36:59.006559 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:36:59.006559 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:36:59.006559 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:36:59.006559 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:36:59.006559 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:36:59.006559 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:36:59.006559 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:36:59.006559 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:36:59.006559 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:36:59.006559 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 08:36:59.006559 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 08:36:59.006559 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 08:36:59.006559 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 08:36:59.007650 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 08:36:59.007650 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 08:36:59.007650 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 08:36:59.007650 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 08:36:59.007650 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:36:59.007650 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:36:59.007650 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:36:59.007650 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:36:59.007650 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:36:59.007650 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:36:59.007650 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:36:59.007650 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application with Lock( Jul 28 08:36:59.007650 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:36:59.007650 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:36:59.007650 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:36:59.007650 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:36:59.008724 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:36:59.008724 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:36:59.008724 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:36:59.008724 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:36:59.008724 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 08:36:59.008724 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 08:36:59.008724 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 08:36:59.008724 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 08:36:59.008724 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 08:36:59.008724 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 08:36:59.008724 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 28 08:36:59.008724 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application Jul 28 08:36:59.013584 dv-cinder-851351-1-smb devstack@keystone.service[282898]: [pid: 282898|app: 0|req: 280/561] 10.222.0.42 () {56 vars in 1102 bytes} [Thu Jul 28 08:36:58 2022] GET /identity/v3/roles/service => generated 85 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:36:59.013864 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61bbf959-f996-4009-8124-f8923f5cf939 None admin] Authenticating user token {{(pid=282898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:36:59.045582 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-915fa265-9dce-47ba-91b2-c93d90a19b25 None admin] Validating token access rules against request {{(pid=282899) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:36:59.085972 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af061d1-070c-4b84-a134-e1bac8c0934c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282899) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:36:59.087035 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af061d1-070c-4b84-a134-e1bac8c0934c None admin] REQUEST_METHOD: `GET` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:36:59.087534 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af061d1-070c-4b84-a134-e1bac8c0934c None admin] SCRIPT_NAME: `/identity` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:36:59.088081 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af061d1-070c-4b84-a134-e1bac8c0934c None admin] PATH_INFO: `/v3/domains` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:36:59.089106 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af061d1-070c-4b84-a134-e1bac8c0934c None admin] RBAC: Adding query filter params (name=Default) {{(pid=282899) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:36:59.089652 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af061d1-070c-4b84-a134-e1bac8c0934c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:36:59.091285 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af061d1-070c-4b84-a134-e1bac8c0934c None admin] RBAC: Authorization granted {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:36:59.104560 dv-cinder-851351-1-smb devstack@keystone.service[282899]: [pid: 282899|app: 0|req: 282/562] 10.222.0.42 () {56 vars in 1109 bytes} [Thu Jul 28 08:36:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:36:59.105896 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af061d1-070c-4b84-a134-e1bac8c0934c None admin] Authenticating user token {{(pid=282899) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:36:59.118315 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG dbcounter [-] [282899] Writing DB stats keystone:SELECT=100 {{(pid=282899) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:36:59.142006 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61bbf959-f996-4009-8124-f8923f5cf939 None admin] Validating token access rules against request {{(pid=282898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:36:59.180046 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb42320d-e7c1-4d1f-b0d0-eb44a8f9eb24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:36:59.181085 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb42320d-e7c1-4d1f-b0d0-eb44a8f9eb24 None admin] REQUEST_METHOD: `GET` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:36:59.181547 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb42320d-e7c1-4d1f-b0d0-eb44a8f9eb24 None admin] SCRIPT_NAME: `/identity` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:36:59.182062 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb42320d-e7c1-4d1f-b0d0-eb44a8f9eb24 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:36:59.244567 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG dbcounter [-] [282898] Writing DB stats keystone:SELECT=100 {{(pid=282898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:36:59.246224 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af061d1-070c-4b84-a134-e1bac8c0934c None admin] Validating token access rules against request {{(pid=282899) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:36:59.260776 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb42320d-e7c1-4d1f-b0d0-eb44a8f9eb24 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:36:59.262833 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb42320d-e7c1-4d1f-b0d0-eb44a8f9eb24 None admin] RBAC: Authorization granted {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:36:59.304465 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f604a6c2-53c6-4d35-89f2-2c1115174be2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282899) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:36:59.305724 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f604a6c2-53c6-4d35-89f2-2c1115174be2 None admin] REQUEST_METHOD: `GET` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:36:59.306443 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f604a6c2-53c6-4d35-89f2-2c1115174be2 None admin] SCRIPT_NAME: `/identity` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:36:59.306887 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f604a6c2-53c6-4d35-89f2-2c1115174be2 None admin] PATH_INFO: `/v3/roles` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:36:59.308367 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f604a6c2-53c6-4d35-89f2-2c1115174be2 None admin] RBAC: Adding query filter params (name=service) {{(pid=282899) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:36:59.309165 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f604a6c2-53c6-4d35-89f2-2c1115174be2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:36:59.311657 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f604a6c2-53c6-4d35-89f2-2c1115174be2 None admin] RBAC: Authorization granted {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:36:59.332184 dv-cinder-851351-1-smb devstack@keystone.service[282899]: [pid: 282899|app: 0|req: 283/563] 10.222.0.42 () {56 vars in 1103 bytes} [Thu Jul 28 08:36:59 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:36:59.332184 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f604a6c2-53c6-4d35-89f2-2c1115174be2 None admin] Authenticating user token {{(pid=282899) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:36:59.385156 dv-cinder-851351-1-smb devstack@keystone.service[282898]: [pid: 282898|app: 0|req: 281/564] 10.222.0.42 () {58 vars in 1282 bytes} [Thu Jul 28 08:36:59 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 371 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 28 08:36:59.386418 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb42320d-e7c1-4d1f-b0d0-eb44a8f9eb24 None admin] Authenticating user token {{(pid=282898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:36:59.409278 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG dbcounter [-] [282899] Writing DB stats keystone:SELECT=100 {{(pid=282899) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:36:59.439918 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f604a6c2-53c6-4d35-89f2-2c1115174be2 None admin] Validating token access rules against request {{(pid=282899) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:36:59.475099 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e14c8cd-e133-4a43-8166-7ce1921c858a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282899) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:36:59.475885 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e14c8cd-e133-4a43-8166-7ce1921c858a None admin] REQUEST_METHOD: `GET` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:36:59.476228 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e14c8cd-e133-4a43-8166-7ce1921c858a None admin] SCRIPT_NAME: `/identity` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:36:59.476574 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e14c8cd-e133-4a43-8166-7ce1921c858a None admin] PATH_INFO: `/v3/projects/service` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:36:59.483881 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG dbcounter [-] [282898] Writing DB stats keystone:SELECT=100 {{(pid=282898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:36:59.484274 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e14c8cd-e133-4a43-8166-7ce1921c858a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:36:59.485864 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e14c8cd-e133-4a43-8166-7ce1921c858a None admin] RBAC: Authorization granted {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:36:59.498985 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb42320d-e7c1-4d1f-b0d0-eb44a8f9eb24 None admin] Validating token access rules against request {{(pid=282898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:36:59.499577 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application [None req-0e14c8cd-e133-4a43-8166-7ce1921c858a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 08:36:59.499577 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:36:59.499577 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:36:59.499577 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:36:59.499577 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:36:59.499577 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:36:59.499577 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:36:59.499577 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:36:59.499577 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:36:59.499577 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:36:59.499577 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:36:59.499577 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:36:59.499577 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 28 08:36:59.499577 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 28 08:36:59.499577 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 28 08:36:59.500603 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 28 08:36:59.500603 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:36:59.500603 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:36:59.500603 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:36:59.500603 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:36:59.500603 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:36:59.500603 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:36:59.500603 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:36:59.500603 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application with Lock( Jul 28 08:36:59.500603 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:36:59.500603 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:36:59.500603 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:36:59.500603 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:36:59.500603 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:36:59.500603 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:36:59.500603 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:36:59.500603 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:36:59.501693 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 28 08:36:59.501693 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 28 08:36:59.501693 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 28 08:36:59.501693 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 28 08:36:59.501693 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 28 08:36:59.501693 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 28 08:36:59.501693 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 08:36:59.501693 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application Jul 28 08:36:59.501693 dv-cinder-851351-1-smb devstack@keystone.service[282899]: [pid: 282899|app: 0|req: 284/565] 10.222.0.42 () {56 vars in 1111 bytes} [Thu Jul 28 08:36:59 2022] GET /identity/v3/projects/service => generated 88 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:36:59.502276 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e14c8cd-e133-4a43-8166-7ce1921c858a None admin] Authenticating user token {{(pid=282899) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:36:59.540477 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88060c53-0645-4532-ab90-c6e49a926359 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:36:59.541174 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88060c53-0645-4532-ab90-c6e49a926359 None admin] REQUEST_METHOD: `GET` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:36:59.541456 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88060c53-0645-4532-ab90-c6e49a926359 None admin] SCRIPT_NAME: `/identity` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:36:59.541730 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88060c53-0645-4532-ab90-c6e49a926359 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:36:59.552928 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88060c53-0645-4532-ab90-c6e49a926359 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:36:59.554464 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88060c53-0645-4532-ab90-c6e49a926359 None admin] RBAC: Authorization granted {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:36:59.573209 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application [None req-88060c53-0645-4532-ab90-c6e49a926359 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 08:36:59.573209 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:36:59.573209 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:36:59.573209 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:36:59.573209 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:36:59.573209 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:36:59.573209 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:36:59.573209 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:36:59.573209 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:36:59.573209 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:36:59.573209 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:36:59.573209 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:36:59.573209 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 08:36:59.573209 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 08:36:59.573209 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 08:36:59.574314 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 08:36:59.574314 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:36:59.574314 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:36:59.574314 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:36:59.574314 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:36:59.574314 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:36:59.574314 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:36:59.574314 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:36:59.574314 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application with Lock( Jul 28 08:36:59.574314 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:36:59.574314 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:36:59.574314 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:36:59.574314 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:36:59.574314 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:36:59.574314 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:36:59.574314 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:36:59.574314 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:36:59.575349 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 08:36:59.575349 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 08:36:59.575349 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 08:36:59.575349 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application Jul 28 08:36:59.575349 dv-cinder-851351-1-smb devstack@keystone.service[282898]: [pid: 282898|app: 0|req: 282/566] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 08:36:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:36:59.576286 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad957670-6781-44c1-9ee4-ad9bacd3aebf None None] REQUEST_METHOD: `GET` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:36:59.576286 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad957670-6781-44c1-9ee4-ad9bacd3aebf None None] SCRIPT_NAME: `/identity` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:36:59.576286 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad957670-6781-44c1-9ee4-ad9bacd3aebf None None] PATH_INFO: `/` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:36:59.580720 dv-cinder-851351-1-smb devstack@keystone.service[282898]: [pid: 282898|app: 0|req: 283/567] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 08:36:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 08:36:59.580720 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad957670-6781-44c1-9ee4-ad9bacd3aebf None None] Authenticating user token {{(pid=282898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:36:59.626101 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e14c8cd-e133-4a43-8166-7ce1921c858a None admin] Validating token access rules against request {{(pid=282899) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:36:59.656103 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG dbcounter [-] [282899] Writing DB stats keystone:SELECT=100 {{(pid=282899) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:36:59.670399 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29e67b9-a21c-4ac5-828f-857630c821c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282899) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:36:59.671064 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29e67b9-a21c-4ac5-828f-857630c821c6 None admin] REQUEST_METHOD: `GET` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:36:59.671349 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29e67b9-a21c-4ac5-828f-857630c821c6 None admin] SCRIPT_NAME: `/identity` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:36:59.671626 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29e67b9-a21c-4ac5-828f-857630c821c6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:36:59.683758 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b29e67b9-a21c-4ac5-828f-857630c821c6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:36:59.685296 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b29e67b9-a21c-4ac5-828f-857630c821c6 None admin] RBAC: Authorization granted {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:36:59.700145 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application [None req-b29e67b9-a21c-4ac5-828f-857630c821c6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 08:36:59.700145 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:36:59.700145 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:36:59.700145 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:36:59.700145 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:36:59.700145 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:36:59.700145 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:36:59.700145 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:36:59.700145 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:36:59.700145 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:36:59.700145 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:36:59.700145 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:36:59.700145 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 08:36:59.700145 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 08:36:59.700145 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 08:36:59.701417 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 08:36:59.701417 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:36:59.701417 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:36:59.701417 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:36:59.701417 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:36:59.701417 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:36:59.701417 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:36:59.701417 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:36:59.701417 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application with Lock( Jul 28 08:36:59.701417 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:36:59.701417 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:36:59.701417 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:36:59.701417 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:36:59.701417 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:36:59.701417 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:36:59.701417 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:36:59.701417 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:36:59.702627 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 08:36:59.702627 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 08:36:59.702627 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 08:36:59.702627 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application Jul 28 08:36:59.702627 dv-cinder-851351-1-smb devstack@keystone.service[282899]: [pid: 282899|app: 0|req: 285/568] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 08:36:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:36:59.702627 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29e67b9-a21c-4ac5-828f-857630c821c6 None admin] Authenticating user token {{(pid=282899) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:36:59.704843 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad957670-6781-44c1-9ee4-ad9bacd3aebf None None] Validating token access rules against request {{(pid=282898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:36:59.741383 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b0286e-a4ae-472e-873f-ac46429f2677 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:36:59.742005 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b0286e-a4ae-472e-873f-ac46429f2677 None admin] REQUEST_METHOD: `GET` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:36:59.742285 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b0286e-a4ae-472e-873f-ac46429f2677 None admin] SCRIPT_NAME: `/identity` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:36:59.742554 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b0286e-a4ae-472e-873f-ac46429f2677 None admin] PATH_INFO: `/v3/projects` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:36:59.743315 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53b0286e-a4ae-472e-873f-ac46429f2677 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=282898) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:36:59.743624 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53b0286e-a4ae-472e-873f-ac46429f2677 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:36:59.745116 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53b0286e-a4ae-472e-873f-ac46429f2677 None admin] RBAC: Authorization granted {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:36:59.754622 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG dbcounter [-] [282898] Writing DB stats keystone:SELECT=100 {{(pid=282898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:36:59.761076 dv-cinder-851351-1-smb devstack@keystone.service[282898]: [pid: 282898|app: 0|req: 284/569] 10.222.0.42 () {56 vars in 1148 bytes} [Thu Jul 28 08:36:59 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:36:59.762349 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811f1ee4-f504-45cb-af3b-320424b27303 None None] REQUEST_METHOD: `POST` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:36:59.762642 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811f1ee4-f504-45cb-af3b-320424b27303 None None] SCRIPT_NAME: `/identity` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:36:59.762921 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811f1ee4-f504-45cb-af3b-320424b27303 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:36:59.782694 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.auth.core [None req-811f1ee4-f504-45cb-af3b-320424b27303 None None] MFA Rules not processed for user `2be990a66857410a87ffa7609aec4f7b`. Rule list: `[]` (Enabled: `True`). {{(pid=282898) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 08:36:59.784009 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.fernet_utils [None req-811f1ee4-f504-45cb-af3b-320424b27303 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=282898) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:36:59.814279 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29e67b9-a21c-4ac5-828f-857630c821c6 None admin] Validating token access rules against request {{(pid=282899) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:36:59.852221 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6cbd677-0448-4b27-97d4-14a639faeb9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282899) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:36:59.852974 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6cbd677-0448-4b27-97d4-14a639faeb9d None admin] REQUEST_METHOD: `GET` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:36:59.853160 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6cbd677-0448-4b27-97d4-14a639faeb9d None admin] SCRIPT_NAME: `/identity` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:36:59.853439 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6cbd677-0448-4b27-97d4-14a639faeb9d None admin] PATH_INFO: `/v3/domains` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:36:59.854156 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6cbd677-0448-4b27-97d4-14a639faeb9d None admin] RBAC: Adding query filter params (name=Default) {{(pid=282899) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:36:59.854462 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6cbd677-0448-4b27-97d4-14a639faeb9d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:36:59.855857 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6cbd677-0448-4b27-97d4-14a639faeb9d None admin] RBAC: Authorization granted {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:36:59.861339 dv-cinder-851351-1-smb devstack@keystone.service[282898]: [pid: 282898|app: 0|req: 285/570] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 08:36:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 08:36:59.862723 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087b984d-70be-41d4-811d-6e554ce6b89f None None] REQUEST_METHOD: `GET` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:36:59.863019 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087b984d-70be-41d4-811d-6e554ce6b89f None None] SCRIPT_NAME: `/identity` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:36:59.863300 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087b984d-70be-41d4-811d-6e554ce6b89f None None] PATH_INFO: `/` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:36:59.869111 dv-cinder-851351-1-smb devstack@keystone.service[282898]: [pid: 282898|app: 0|req: 286/571] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 08:36:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 08:36:59.869111 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087b984d-70be-41d4-811d-6e554ce6b89f None None] Authenticating user token {{(pid=282898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:36:59.869412 dv-cinder-851351-1-smb devstack@keystone.service[282899]: [pid: 282899|app: 0|req: 286/572] 10.222.0.42 () {56 vars in 1109 bytes} [Thu Jul 28 08:36:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:36:59.869412 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6cbd677-0448-4b27-97d4-14a639faeb9d None admin] Authenticating user token {{(pid=282899) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:36:59.913314 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG dbcounter [-] [282899] Writing DB stats keystone:SELECT=100 {{(pid=282899) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:36:59.974745 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6cbd677-0448-4b27-97d4-14a639faeb9d None admin] Validating token access rules against request {{(pid=282899) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:36:59.987714 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087b984d-70be-41d4-811d-6e554ce6b89f None None] Validating token access rules against request {{(pid=282898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:37:00.013216 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc69123a-969b-40c8-b478-1cf7b5c2ff39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282899) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:37:00.013912 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc69123a-969b-40c8-b478-1cf7b5c2ff39 None admin] REQUEST_METHOD: `PUT` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:37:00.014197 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc69123a-969b-40c8-b478-1cf7b5c2ff39 None admin] SCRIPT_NAME: `/identity` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:37:00.014474 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc69123a-969b-40c8-b478-1cf7b5c2ff39 None admin] PATH_INFO: `/v3/projects/5cde68cbfb9042dc9f36af3aacea2473/users/5e192fe026ef4f109b9a1099815c5926/roles/aa4daecf3ff74fa1b7d53041a4659723` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:37:00.018950 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG dbcounter [-] [282898] Writing DB stats keystone:SELECT=100 {{(pid=282898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:37:00.025856 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66dc003-abb3-43e3-b323-2152f6f247a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:37:00.026490 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66dc003-abb3-43e3-b323-2152f6f247a9 None admin] REQUEST_METHOD: `GET` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:37:00.026773 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66dc003-abb3-43e3-b323-2152f6f247a9 None admin] SCRIPT_NAME: `/identity` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:37:00.027054 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66dc003-abb3-43e3-b323-2152f6f247a9 None admin] PATH_INFO: `/v3/domains` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:37:00.027764 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f66dc003-abb3-43e3-b323-2152f6f247a9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=282898) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:37:00.028073 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f66dc003-abb3-43e3-b323-2152f6f247a9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:37:00.029512 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f66dc003-abb3-43e3-b323-2152f6f247a9 None admin] RBAC: Authorization granted {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:37:00.029849 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc69123a-969b-40c8-b478-1cf7b5c2ff39 None admin] RBAC: Authorizing `identity:create_grant(project_id=5cde68cbfb9042dc9f36af3aacea2473, user_id=5e192fe026ef4f109b9a1099815c5926, role_id=aa4daecf3ff74fa1b7d53041a4659723)` {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:37:00.031310 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc69123a-969b-40c8-b478-1cf7b5c2ff39 None admin] RBAC: Authorization granted {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:37:00.042151 dv-cinder-851351-1-smb devstack@keystone.service[282898]: [pid: 282898|app: 0|req: 287/573] 10.222.0.42 () {56 vars in 1109 bytes} [Thu Jul 28 08:36:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:37:00.043540 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d11c983-d71c-4ff7-b263-663bc5b4ef2f None None] REQUEST_METHOD: `POST` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:37:00.043749 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d11c983-d71c-4ff7-b263-663bc5b4ef2f None None] SCRIPT_NAME: `/identity` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:37:00.044028 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d11c983-d71c-4ff7-b263-663bc5b4ef2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:37:00.056865 dv-cinder-851351-1-smb devstack@keystone.service[282899]: [pid: 282899|app: 0|req: 287/574] 10.222.0.42 () {58 vars in 1439 bytes} [Thu Jul 28 08:36:59 2022] PUT /identity/v3/projects/5cde68cbfb9042dc9f36af3aacea2473/users/5e192fe026ef4f109b9a1099815c5926/roles/aa4daecf3ff74fa1b7d53041a4659723 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 08:37:00.056865 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc69123a-969b-40c8-b478-1cf7b5c2ff39 None admin] Authenticating user token {{(pid=282899) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:37:00.080416 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.auth.core [None req-8d11c983-d71c-4ff7-b263-663bc5b4ef2f None None] MFA Rules not processed for user `2be990a66857410a87ffa7609aec4f7b`. Rule list: `[]` (Enabled: `True`). {{(pid=282898) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 08:37:00.081875 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.fernet_utils [None req-8d11c983-d71c-4ff7-b263-663bc5b4ef2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=282898) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:37:00.165389 dv-cinder-851351-1-smb devstack@keystone.service[282898]: [pid: 282898|app: 0|req: 288/575] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 08:37:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 08:37:00.166207 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d11c983-d71c-4ff7-b263-663bc5b4ef2f None None] Authenticating user token {{(pid=282898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:37:00.171027 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG dbcounter [-] [282899] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=282899) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:37:00.187256 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc69123a-969b-40c8-b478-1cf7b5c2ff39 None admin] Validating token access rules against request {{(pid=282899) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:37:00.229359 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434f679a-e6af-4cd5-906c-2a367bbb7360 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282899) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:37:00.230034 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434f679a-e6af-4cd5-906c-2a367bbb7360 None admin] REQUEST_METHOD: `GET` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:37:00.230317 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434f679a-e6af-4cd5-906c-2a367bbb7360 None admin] SCRIPT_NAME: `/identity` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:37:00.230597 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434f679a-e6af-4cd5-906c-2a367bbb7360 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:37:00.239113 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-434f679a-e6af-4cd5-906c-2a367bbb7360 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:37:00.240617 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-434f679a-e6af-4cd5-906c-2a367bbb7360 None admin] RBAC: Authorization granted {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:37:00.253199 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application [None req-434f679a-e6af-4cd5-906c-2a367bbb7360 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jul 28 08:37:00.253199 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:37:00.253199 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:37:00.253199 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:37:00.253199 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:37:00.253199 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:37:00.253199 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:37:00.253199 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:37:00.253199 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:37:00.253199 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:37:00.253199 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:37:00.253199 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:37:00.253199 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 28 08:37:00.253199 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 28 08:37:00.253199 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 28 08:37:00.253199 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 28 08:37:00.254334 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:37:00.254334 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:37:00.254334 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 28 08:37:00.254334 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 08:37:00.254334 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 28 08:37:00.254334 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 08:37:00.254334 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:37:00.254334 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:37:00.254334 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:37:00.254334 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:37:00.254334 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:37:00.254334 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application with Lock( Jul 28 08:37:00.254334 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:37:00.254334 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:37:00.254334 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:37:00.254334 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:37:00.254334 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:37:00.254334 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:37:00.255454 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:37:00.255454 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:37:00.255454 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 28 08:37:00.255454 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 28 08:37:00.255454 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 28 08:37:00.255454 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 28 08:37:00.255454 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 28 08:37:00.255454 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 28 08:37:00.255454 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jul 28 08:37:00.255454 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application Jul 28 08:37:00.255454 dv-cinder-851351-1-smb devstack@keystone.service[282899]: [pid: 282899|app: 0|req: 288/576] 10.222.0.42 () {56 vars in 1099 bytes} [Thu Jul 28 08:37:00 2022] GET /identity/v3/users/cinder => generated 84 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:37:00.256123 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434f679a-e6af-4cd5-906c-2a367bbb7360 None admin] Authenticating user token {{(pid=282899) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:37:00.306638 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d11c983-d71c-4ff7-b263-663bc5b4ef2f None None] Validating token access rules against request {{(pid=282898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:37:00.333294 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG dbcounter [-] [282898] Writing DB stats keystone:SELECT=100 {{(pid=282898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:37:00.351837 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02cdc26f-223c-4338-a71d-9fd6dc149d04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:37:00.352541 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02cdc26f-223c-4338-a71d-9fd6dc149d04 None admin] REQUEST_METHOD: `GET` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:37:00.352856 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02cdc26f-223c-4338-a71d-9fd6dc149d04 None admin] SCRIPT_NAME: `/identity` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:37:00.353132 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02cdc26f-223c-4338-a71d-9fd6dc149d04 None admin] PATH_INFO: `/v3/roles/service` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:37:00.365211 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02cdc26f-223c-4338-a71d-9fd6dc149d04 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 08:37:00.369556 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434f679a-e6af-4cd5-906c-2a367bbb7360 None admin] Validating token access rules against request {{(pid=282899) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:37:00.370430 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application [None req-02cdc26f-223c-4338-a71d-9fd6dc149d04 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 28 08:37:00.370430 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:37:00.370430 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:37:00.370430 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:37:00.370430 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:37:00.370430 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:37:00.370430 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:37:00.370430 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:37:00.370430 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:37:00.370430 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:37:00.370430 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:37:00.370430 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:37:00.370430 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 08:37:00.370430 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 08:37:00.370430 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 08:37:00.370430 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 08:37:00.371484 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 08:37:00.371484 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 08:37:00.371484 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 08:37:00.371484 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 08:37:00.371484 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:37:00.371484 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:37:00.371484 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:37:00.371484 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:37:00.371484 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:37:00.371484 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:37:00.371484 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:37:00.371484 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application with Lock( Jul 28 08:37:00.371484 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:37:00.371484 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:37:00.371484 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:37:00.371484 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:37:00.372563 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:37:00.372563 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:37:00.372563 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:37:00.372563 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:37:00.372563 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 08:37:00.372563 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 08:37:00.372563 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 08:37:00.372563 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 08:37:00.372563 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 08:37:00.372563 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 08:37:00.372563 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 28 08:37:00.372563 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application Jul 28 08:37:00.372563 dv-cinder-851351-1-smb devstack@keystone.service[282898]: [pid: 282898|app: 0|req: 289/577] 10.222.0.42 () {56 vars in 1102 bytes} [Thu Jul 28 08:37:00 2022] GET /identity/v3/roles/service => generated 85 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:37:00.372563 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02cdc26f-223c-4338-a71d-9fd6dc149d04 None admin] Authenticating user token {{(pid=282898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:37:00.415132 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6e35f5-e671-4845-a337-b9773ebbe747 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282899) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:37:00.416331 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6e35f5-e671-4845-a337-b9773ebbe747 None admin] REQUEST_METHOD: `GET` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:37:00.416568 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6e35f5-e671-4845-a337-b9773ebbe747 None admin] SCRIPT_NAME: `/identity` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:37:00.416878 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6e35f5-e671-4845-a337-b9773ebbe747 None admin] PATH_INFO: `/v3/projects/service` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:37:00.425008 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c6e35f5-e671-4845-a337-b9773ebbe747 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:37:00.426481 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c6e35f5-e671-4845-a337-b9773ebbe747 None admin] RBAC: Authorization granted {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:37:00.439825 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application [None req-9c6e35f5-e671-4845-a337-b9773ebbe747 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 08:37:00.439825 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:37:00.439825 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:37:00.439825 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:37:00.439825 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:37:00.439825 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:37:00.439825 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:37:00.439825 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:37:00.439825 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:37:00.439825 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:37:00.439825 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:37:00.439825 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:37:00.439825 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 28 08:37:00.439825 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 28 08:37:00.439825 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 28 08:37:00.441046 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 28 08:37:00.441046 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:37:00.441046 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:37:00.441046 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:37:00.441046 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:37:00.441046 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:37:00.441046 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:37:00.441046 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:37:00.441046 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application with Lock( Jul 28 08:37:00.441046 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:37:00.441046 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:37:00.441046 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:37:00.441046 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:37:00.441046 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:37:00.441046 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:37:00.441046 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:37:00.441046 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:37:00.442081 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 28 08:37:00.442081 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 28 08:37:00.442081 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 28 08:37:00.442081 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 28 08:37:00.442081 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 28 08:37:00.442081 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 28 08:37:00.442081 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 08:37:00.442081 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application Jul 28 08:37:00.442081 dv-cinder-851351-1-smb devstack@keystone.service[282899]: [pid: 282899|app: 0|req: 289/578] 10.222.0.42 () {56 vars in 1111 bytes} [Thu Jul 28 08:37:00 2022] GET /identity/v3/projects/service => generated 88 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:37:00.442081 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6e35f5-e671-4845-a337-b9773ebbe747 None admin] Authenticating user token {{(pid=282899) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:37:00.457640 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG dbcounter [-] [282899] Writing DB stats keystone:SELECT=100 {{(pid=282899) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:37:00.487269 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02cdc26f-223c-4338-a71d-9fd6dc149d04 None admin] Validating token access rules against request {{(pid=282898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:37:00.525396 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c87ab8c-d4eb-45de-bba6-6d57f94f7c35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:37:00.526049 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c87ab8c-d4eb-45de-bba6-6d57f94f7c35 None admin] REQUEST_METHOD: `GET` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:37:00.526328 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c87ab8c-d4eb-45de-bba6-6d57f94f7c35 None admin] SCRIPT_NAME: `/identity` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:37:00.526710 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c87ab8c-d4eb-45de-bba6-6d57f94f7c35 None admin] PATH_INFO: `/v3/roles/service` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:37:00.538062 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c87ab8c-d4eb-45de-bba6-6d57f94f7c35 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 08:37:00.543333 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application [None req-6c87ab8c-d4eb-45de-bba6-6d57f94f7c35 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 28 08:37:00.543333 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:37:00.543333 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:37:00.543333 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:37:00.543333 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:37:00.543333 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:37:00.543333 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:37:00.543333 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:37:00.543333 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:37:00.543333 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:37:00.543333 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:37:00.543333 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:37:00.543333 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 08:37:00.543333 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 08:37:00.543333 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 08:37:00.543333 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 08:37:00.544399 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 08:37:00.544399 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 08:37:00.544399 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 08:37:00.544399 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 08:37:00.544399 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:37:00.544399 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:37:00.544399 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:37:00.544399 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:37:00.544399 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:37:00.544399 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:37:00.544399 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:37:00.544399 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application with Lock( Jul 28 08:37:00.544399 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:37:00.544399 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:37:00.544399 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:37:00.544399 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:37:00.545836 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:37:00.545836 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:37:00.545836 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:37:00.545836 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:37:00.545836 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 08:37:00.545836 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 08:37:00.545836 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 08:37:00.545836 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 08:37:00.545836 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 08:37:00.545836 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 08:37:00.545836 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 28 08:37:00.545836 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application Jul 28 08:37:00.545836 dv-cinder-851351-1-smb devstack@keystone.service[282898]: [pid: 282898|app: 0|req: 290/579] 10.222.0.42 () {56 vars in 1102 bytes} [Thu Jul 28 08:37:00 2022] GET /identity/v3/roles/service => generated 85 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:37:00.545836 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c87ab8c-d4eb-45de-bba6-6d57f94f7c35 None admin] Authenticating user token {{(pid=282898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:37:00.558772 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6e35f5-e671-4845-a337-b9773ebbe747 None admin] Validating token access rules against request {{(pid=282899) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:37:00.593284 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG dbcounter [-] [282898] Writing DB stats keystone:SELECT=100 {{(pid=282898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:37:00.603208 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1253c2-1c94-4c3a-a6c6-5b7d2247d127 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282899) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:37:00.603931 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1253c2-1c94-4c3a-a6c6-5b7d2247d127 None admin] REQUEST_METHOD: `GET` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:37:00.604330 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1253c2-1c94-4c3a-a6c6-5b7d2247d127 None admin] SCRIPT_NAME: `/identity` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:37:00.604613 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1253c2-1c94-4c3a-a6c6-5b7d2247d127 None admin] PATH_INFO: `/v3/users` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:37:00.605638 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e1253c2-1c94-4c3a-a6c6-5b7d2247d127 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=282899) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:37:00.605985 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e1253c2-1c94-4c3a-a6c6-5b7d2247d127 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:37:00.607697 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e1253c2-1c94-4c3a-a6c6-5b7d2247d127 None admin] RBAC: Authorization granted {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:37:00.628755 dv-cinder-851351-1-smb devstack@keystone.service[282899]: [pid: 282899|app: 0|req: 290/580] 10.222.0.42 () {56 vars in 1137 bytes} [Thu Jul 28 08:37:00 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:37:00.629893 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1253c2-1c94-4c3a-a6c6-5b7d2247d127 None admin] Authenticating user token {{(pid=282899) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:37:00.662532 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c87ab8c-d4eb-45de-bba6-6d57f94f7c35 None admin] Validating token access rules against request {{(pid=282898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:37:00.697570 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b20b180-3b2c-4517-93e3-5092ce4ad9d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:37:00.698271 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b20b180-3b2c-4517-93e3-5092ce4ad9d1 None admin] REQUEST_METHOD: `GET` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:37:00.698654 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b20b180-3b2c-4517-93e3-5092ce4ad9d1 None admin] SCRIPT_NAME: `/identity` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:37:00.699026 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b20b180-3b2c-4517-93e3-5092ce4ad9d1 None admin] PATH_INFO: `/v3/roles` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:37:00.699886 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b20b180-3b2c-4517-93e3-5092ce4ad9d1 None admin] RBAC: Adding query filter params (name=service) {{(pid=282898) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:37:00.700193 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b20b180-3b2c-4517-93e3-5092ce4ad9d1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:37:00.701610 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b20b180-3b2c-4517-93e3-5092ce4ad9d1 None admin] RBAC: Authorization granted {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:37:00.714995 dv-cinder-851351-1-smb devstack@keystone.service[282898]: [pid: 282898|app: 0|req: 291/581] 10.222.0.42 () {56 vars in 1103 bytes} [Thu Jul 28 08:37:00 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:37:00.714995 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b20b180-3b2c-4517-93e3-5092ce4ad9d1 None admin] Authenticating user token {{(pid=282898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:37:00.717092 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG dbcounter [-] [282899] Writing DB stats keystone:SELECT=100 {{(pid=282899) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:37:00.756785 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1253c2-1c94-4c3a-a6c6-5b7d2247d127 None admin] Validating token access rules against request {{(pid=282899) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:37:00.800615 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ddde5fe-138c-4469-a995-7fabc57f1806 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282899) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:37:00.801468 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ddde5fe-138c-4469-a995-7fabc57f1806 None admin] REQUEST_METHOD: `GET` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:37:00.801844 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ddde5fe-138c-4469-a995-7fabc57f1806 None admin] SCRIPT_NAME: `/identity` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:37:00.802257 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ddde5fe-138c-4469-a995-7fabc57f1806 None admin] PATH_INFO: `/v3/projects` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:37:00.803089 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ddde5fe-138c-4469-a995-7fabc57f1806 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=282899) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:37:00.803417 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ddde5fe-138c-4469-a995-7fabc57f1806 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:37:00.805041 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ddde5fe-138c-4469-a995-7fabc57f1806 None admin] RBAC: Authorization granted {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:37:00.824952 dv-cinder-851351-1-smb devstack@keystone.service[282899]: [pid: 282899|app: 0|req: 291/582] 10.222.0.42 () {56 vars in 1148 bytes} [Thu Jul 28 08:37:00 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:37:00.824952 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ddde5fe-138c-4469-a995-7fabc57f1806 None admin] Authenticating user token {{(pid=282899) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:37:00.832377 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b20b180-3b2c-4517-93e3-5092ce4ad9d1 None admin] Validating token access rules against request {{(pid=282898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:37:00.834191 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG dbcounter [-] [282898] Writing DB stats keystone:SELECT=100 {{(pid=282898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:37:00.868085 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ad1916-abdf-49dd-85a2-b63811e37648 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:37:00.868734 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ad1916-abdf-49dd-85a2-b63811e37648 None admin] REQUEST_METHOD: `GET` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:37:00.869019 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ad1916-abdf-49dd-85a2-b63811e37648 None admin] SCRIPT_NAME: `/identity` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:37:00.869287 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ad1916-abdf-49dd-85a2-b63811e37648 None admin] PATH_INFO: `/v3/roles` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:37:00.870024 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31ad1916-abdf-49dd-85a2-b63811e37648 None admin] RBAC: Adding query filter params (name=service) {{(pid=282898) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:37:00.870329 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31ad1916-abdf-49dd-85a2-b63811e37648 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:37:00.871714 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31ad1916-abdf-49dd-85a2-b63811e37648 None admin] RBAC: Authorization granted {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:37:00.881020 dv-cinder-851351-1-smb devstack@keystone.service[282898]: [pid: 282898|app: 0|req: 292/583] 10.222.0.42 () {56 vars in 1103 bytes} [Thu Jul 28 08:37:00 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:37:00.882193 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ad1916-abdf-49dd-85a2-b63811e37648 None admin] Authenticating user token {{(pid=282898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:37:00.940990 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ddde5fe-138c-4469-a995-7fabc57f1806 None admin] Validating token access rules against request {{(pid=282899) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:37:00.968954 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG dbcounter [-] [282899] Writing DB stats keystone:SELECT=100 {{(pid=282899) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:37:00.978015 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65478fc3-48b1-45e8-b379-a6546c991b34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282899) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:37:00.978685 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65478fc3-48b1-45e8-b379-a6546c991b34 None admin] REQUEST_METHOD: `GET` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:37:00.978974 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65478fc3-48b1-45e8-b379-a6546c991b34 None admin] SCRIPT_NAME: `/identity` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:37:00.979254 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65478fc3-48b1-45e8-b379-a6546c991b34 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:37:00.990394 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65478fc3-48b1-45e8-b379-a6546c991b34 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:37:00.991426 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ad1916-abdf-49dd-85a2-b63811e37648 None admin] Validating token access rules against request {{(pid=282898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:37:00.991910 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65478fc3-48b1-45e8-b379-a6546c991b34 None admin] RBAC: Authorization granted {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:37:01.006737 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application [None req-65478fc3-48b1-45e8-b379-a6546c991b34 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 08:37:01.006737 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:37:01.006737 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:37:01.006737 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:37:01.006737 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:37:01.006737 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:37:01.006737 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:37:01.006737 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:37:01.006737 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:37:01.006737 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:37:01.006737 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:37:01.006737 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:37:01.006737 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 08:37:01.006737 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 08:37:01.006737 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 08:37:01.007972 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 08:37:01.007972 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:37:01.007972 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:37:01.007972 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:37:01.007972 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:37:01.007972 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:37:01.007972 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:37:01.007972 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:37:01.007972 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application with Lock( Jul 28 08:37:01.007972 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:37:01.007972 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:37:01.007972 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:37:01.007972 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:37:01.007972 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:37:01.007972 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:37:01.007972 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:37:01.007972 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:37:01.009549 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 08:37:01.009549 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 08:37:01.009549 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 08:37:01.009549 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application Jul 28 08:37:01.009549 dv-cinder-851351-1-smb devstack@keystone.service[282899]: [pid: 282899|app: 0|req: 292/584] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 08:37:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:37:01.009549 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65478fc3-48b1-45e8-b379-a6546c991b34 None admin] Authenticating user token {{(pid=282899) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:37:01.033608 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e72db38-ab0c-460d-90e5-87a7982142bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:37:01.034312 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e72db38-ab0c-460d-90e5-87a7982142bb None admin] REQUEST_METHOD: `GET` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:37:01.034608 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e72db38-ab0c-460d-90e5-87a7982142bb None admin] SCRIPT_NAME: `/identity` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:37:01.034859 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e72db38-ab0c-460d-90e5-87a7982142bb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:37:01.046065 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e72db38-ab0c-460d-90e5-87a7982142bb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:37:01.047537 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e72db38-ab0c-460d-90e5-87a7982142bb None admin] RBAC: Authorization granted {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:37:01.062328 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application [None req-1e72db38-ab0c-460d-90e5-87a7982142bb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 08:37:01.062328 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:37:01.062328 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:37:01.062328 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:37:01.062328 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:37:01.062328 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:37:01.062328 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:37:01.062328 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:37:01.062328 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:37:01.062328 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:37:01.062328 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:37:01.062328 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:37:01.062328 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 08:37:01.062328 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 08:37:01.062328 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 08:37:01.068503 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 08:37:01.068503 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:37:01.068503 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:37:01.068503 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:37:01.068503 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:37:01.068503 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:37:01.068503 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:37:01.068503 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:37:01.068503 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application with Lock( Jul 28 08:37:01.068503 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:37:01.068503 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:37:01.068503 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:37:01.068503 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:37:01.068503 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:37:01.068503 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:37:01.068503 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:37:01.068503 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:37:01.069882 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 08:37:01.069882 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 08:37:01.069882 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 08:37:01.069882 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application Jul 28 08:37:01.069882 dv-cinder-851351-1-smb devstack@keystone.service[282898]: [pid: 282898|app: 0|req: 293/585] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 08:37:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:37:01.069882 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e72db38-ab0c-460d-90e5-87a7982142bb None admin] Authenticating user token {{(pid=282898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:37:01.087476 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG dbcounter [-] [282898] Writing DB stats keystone:SELECT=100 {{(pid=282898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:37:01.126731 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65478fc3-48b1-45e8-b379-a6546c991b34 None admin] Validating token access rules against request {{(pid=282899) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:37:01.162210 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86788161-3ffe-4991-905f-62032806a457 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282899) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:37:01.162854 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86788161-3ffe-4991-905f-62032806a457 None admin] REQUEST_METHOD: `GET` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:37:01.163137 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86788161-3ffe-4991-905f-62032806a457 None admin] SCRIPT_NAME: `/identity` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:37:01.163416 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86788161-3ffe-4991-905f-62032806a457 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:37:01.164327 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86788161-3ffe-4991-905f-62032806a457 None admin] RBAC: Adding query filter params (role.id=aa4daecf3ff74fa1b7d53041a4659723, scope.project.id=5cde68cbfb9042dc9f36af3aacea2473, user.id=f3a6183fd2c040079951febe23234356) {{(pid=282899) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:37:01.164640 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86788161-3ffe-4991-905f-62032806a457 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:37:01.166403 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86788161-3ffe-4991-905f-62032806a457 None admin] RBAC: Authorization granted {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:37:01.184710 dv-cinder-851351-1-smb devstack@keystone.service[282899]: [pid: 282899|app: 0|req: 293/586] 10.222.0.42 () {56 vars in 1374 bytes} [Thu Jul 28 08:37:01 2022] GET /identity/v3/role_assignments?user.id=f3a6183fd2c040079951febe23234356&scope.project.id=5cde68cbfb9042dc9f36af3aacea2473&role.id=aa4daecf3ff74fa1b7d53041a4659723 => generated 259 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:37:01.184710 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86788161-3ffe-4991-905f-62032806a457 None admin] Authenticating user token {{(pid=282899) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:37:01.187739 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e72db38-ab0c-460d-90e5-87a7982142bb None admin] Validating token access rules against request {{(pid=282898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:37:01.230558 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f71678b-f04c-4353-bb67-e28a36ca91d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:37:01.231219 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f71678b-f04c-4353-bb67-e28a36ca91d7 None admin] REQUEST_METHOD: `GET` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:37:01.231674 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f71678b-f04c-4353-bb67-e28a36ca91d7 None admin] SCRIPT_NAME: `/identity` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:37:01.231854 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f71678b-f04c-4353-bb67-e28a36ca91d7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:37:01.244702 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f71678b-f04c-4353-bb67-e28a36ca91d7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:37:01.246349 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f71678b-f04c-4353-bb67-e28a36ca91d7 None admin] RBAC: Authorization granted {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:37:01.247356 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG dbcounter [-] [282899] Writing DB stats keystone:SELECT=100 {{(pid=282899) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:37:01.263650 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application [None req-5f71678b-f04c-4353-bb67-e28a36ca91d7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 08:37:01.263650 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:37:01.263650 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:37:01.263650 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:37:01.263650 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:37:01.263650 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:37:01.263650 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:37:01.263650 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:37:01.263650 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:37:01.263650 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:37:01.263650 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:37:01.263650 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:37:01.263650 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 08:37:01.263650 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 08:37:01.263650 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 08:37:01.265916 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 08:37:01.265916 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:37:01.265916 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:37:01.265916 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:37:01.265916 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:37:01.265916 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:37:01.265916 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:37:01.265916 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:37:01.265916 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application with Lock( Jul 28 08:37:01.265916 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:37:01.265916 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:37:01.265916 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:37:01.265916 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:37:01.265916 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:37:01.265916 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:37:01.265916 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:37:01.265916 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:37:01.268171 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 08:37:01.268171 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 08:37:01.268171 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 08:37:01.268171 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application Jul 28 08:37:01.270446 dv-cinder-851351-1-smb devstack@keystone.service[282898]: [pid: 282898|app: 0|req: 294/587] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 08:37:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:37:01.272850 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f71678b-f04c-4353-bb67-e28a36ca91d7 None admin] Authenticating user token {{(pid=282898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:37:01.325726 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86788161-3ffe-4991-905f-62032806a457 None admin] Validating token access rules against request {{(pid=282899) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:37:01.358506 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG dbcounter [-] [282898] Writing DB stats keystone:SELECT=100 {{(pid=282898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:37:01.376934 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9faa8c15-c24b-431d-aa28-bca0ea4f45fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282899) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:37:01.378475 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9faa8c15-c24b-431d-aa28-bca0ea4f45fd None admin] REQUEST_METHOD: `GET` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:37:01.379634 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9faa8c15-c24b-431d-aa28-bca0ea4f45fd None admin] SCRIPT_NAME: `/identity` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:37:01.380188 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9faa8c15-c24b-431d-aa28-bca0ea4f45fd None admin] PATH_INFO: `/v3/domains` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:37:01.383496 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9faa8c15-c24b-431d-aa28-bca0ea4f45fd None admin] RBAC: Adding query filter params (name=Default) {{(pid=282899) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:37:01.385404 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9faa8c15-c24b-431d-aa28-bca0ea4f45fd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:37:01.387179 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9faa8c15-c24b-431d-aa28-bca0ea4f45fd None admin] RBAC: Authorization granted {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:37:01.402720 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f71678b-f04c-4353-bb67-e28a36ca91d7 None admin] Validating token access rules against request {{(pid=282898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:37:01.416818 dv-cinder-851351-1-smb devstack@keystone.service[282899]: [pid: 282899|app: 0|req: 294/588] 10.222.0.42 () {56 vars in 1109 bytes} [Thu Jul 28 08:37:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:37:01.418105 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9faa8c15-c24b-431d-aa28-bca0ea4f45fd None admin] Authenticating user token {{(pid=282899) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:37:01.442564 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97bfcad-da86-44dd-ad27-92f5f4d1d4d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:37:01.443270 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97bfcad-da86-44dd-ad27-92f5f4d1d4d9 None admin] REQUEST_METHOD: `GET` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:37:01.443664 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97bfcad-da86-44dd-ad27-92f5f4d1d4d9 None admin] SCRIPT_NAME: `/identity` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:37:01.444009 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97bfcad-da86-44dd-ad27-92f5f4d1d4d9 None admin] PATH_INFO: `/v3/domains` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:37:01.444831 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d97bfcad-da86-44dd-ad27-92f5f4d1d4d9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=282898) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:37:01.445212 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d97bfcad-da86-44dd-ad27-92f5f4d1d4d9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:37:01.446742 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d97bfcad-da86-44dd-ad27-92f5f4d1d4d9 None admin] RBAC: Authorization granted {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:37:01.461482 dv-cinder-851351-1-smb devstack@keystone.service[282898]: [pid: 282898|app: 0|req: 295/589] 10.222.0.42 () {56 vars in 1109 bytes} [Thu Jul 28 08:37:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:37:01.462600 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97bfcad-da86-44dd-ad27-92f5f4d1d4d9 None admin] Authenticating user token {{(pid=282898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:37:01.537354 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9faa8c15-c24b-431d-aa28-bca0ea4f45fd None admin] Validating token access rules against request {{(pid=282899) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:37:01.540452 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG dbcounter [-] [282899] Writing DB stats keystone:SELECT=100 {{(pid=282899) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:37:01.573307 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97bfcad-da86-44dd-ad27-92f5f4d1d4d9 None admin] Validating token access rules against request {{(pid=282898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:37:01.576381 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67873f27-7bcd-41a4-adbc-e0431f6793c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282899) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:37:01.577269 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67873f27-7bcd-41a4-adbc-e0431f6793c0 None admin] REQUEST_METHOD: `GET` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:37:01.577745 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67873f27-7bcd-41a4-adbc-e0431f6793c0 None admin] SCRIPT_NAME: `/identity` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:37:01.578172 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67873f27-7bcd-41a4-adbc-e0431f6793c0 None admin] PATH_INFO: `/v3/domains` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:37:01.579041 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67873f27-7bcd-41a4-adbc-e0431f6793c0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=282899) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:37:01.579863 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67873f27-7bcd-41a4-adbc-e0431f6793c0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:37:01.581593 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67873f27-7bcd-41a4-adbc-e0431f6793c0 None admin] RBAC: Authorization granted {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:37:01.594770 dv-cinder-851351-1-smb devstack@keystone.service[282899]: [pid: 282899|app: 0|req: 295/590] 10.222.0.42 () {56 vars in 1109 bytes} [Thu Jul 28 08:37:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:37:01.595898 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67873f27-7bcd-41a4-adbc-e0431f6793c0 None admin] Authenticating user token {{(pid=282899) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:37:01.608818 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG dbcounter [-] [282898] Writing DB stats keystone:SELECT=100 {{(pid=282898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:37:01.620040 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203bcf24-5778-44f3-a589-59531ab52943 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:37:01.620785 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203bcf24-5778-44f3-a589-59531ab52943 None admin] REQUEST_METHOD: `GET` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:37:01.621069 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203bcf24-5778-44f3-a589-59531ab52943 None admin] SCRIPT_NAME: `/identity` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:37:01.621346 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203bcf24-5778-44f3-a589-59531ab52943 None admin] PATH_INFO: `/v3/projects/service` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:37:01.632300 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-203bcf24-5778-44f3-a589-59531ab52943 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:37:01.634166 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-203bcf24-5778-44f3-a589-59531ab52943 None admin] RBAC: Authorization granted {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:37:01.651592 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application [None req-203bcf24-5778-44f3-a589-59531ab52943 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 08:37:01.651592 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:37:01.651592 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:37:01.651592 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:37:01.651592 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:37:01.651592 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:37:01.651592 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:37:01.651592 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:37:01.651592 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:37:01.651592 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:37:01.651592 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:37:01.651592 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:37:01.651592 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 28 08:37:01.651592 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 28 08:37:01.651592 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 28 08:37:01.652833 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 28 08:37:01.652833 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:37:01.652833 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:37:01.652833 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:37:01.652833 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:37:01.652833 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:37:01.652833 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:37:01.652833 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:37:01.652833 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application with Lock( Jul 28 08:37:01.652833 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:37:01.652833 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:37:01.652833 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:37:01.652833 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:37:01.652833 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:37:01.652833 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:37:01.652833 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:37:01.652833 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:37:01.653869 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 28 08:37:01.653869 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 28 08:37:01.653869 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 28 08:37:01.653869 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 28 08:37:01.653869 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 28 08:37:01.653869 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 28 08:37:01.653869 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 08:37:01.653869 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application Jul 28 08:37:01.656200 dv-cinder-851351-1-smb devstack@keystone.service[282898]: [pid: 282898|app: 0|req: 296/591] 10.222.0.42 () {56 vars in 1111 bytes} [Thu Jul 28 08:37:01 2022] GET /identity/v3/projects/service => generated 88 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:37:01.657521 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203bcf24-5778-44f3-a589-59531ab52943 None admin] Authenticating user token {{(pid=282898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:37:01.733549 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67873f27-7bcd-41a4-adbc-e0431f6793c0 None admin] Validating token access rules against request {{(pid=282899) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:37:01.782383 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6aacc3f-7e4a-4def-b7ad-8ab3d4976100 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282899) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:37:01.783626 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6aacc3f-7e4a-4def-b7ad-8ab3d4976100 None admin] REQUEST_METHOD: `GET` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:37:01.784240 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6aacc3f-7e4a-4def-b7ad-8ab3d4976100 None admin] SCRIPT_NAME: `/identity` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:37:01.784617 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6aacc3f-7e4a-4def-b7ad-8ab3d4976100 None admin] PATH_INFO: `/v3/users/glance` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:37:01.800603 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6aacc3f-7e4a-4def-b7ad-8ab3d4976100 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:37:01.802410 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6aacc3f-7e4a-4def-b7ad-8ab3d4976100 None admin] RBAC: Authorization granted {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:37:01.807231 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203bcf24-5778-44f3-a589-59531ab52943 None admin] Validating token access rules against request {{(pid=282898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:37:01.823450 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application [None req-b6aacc3f-7e4a-4def-b7ad-8ab3d4976100 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jul 28 08:37:01.823450 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:37:01.823450 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:37:01.823450 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:37:01.823450 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:37:01.823450 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:37:01.823450 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:37:01.823450 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:37:01.823450 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:37:01.823450 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:37:01.823450 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:37:01.823450 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:37:01.823450 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 28 08:37:01.823450 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 28 08:37:01.823450 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 28 08:37:01.823450 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 28 08:37:01.824790 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:37:01.824790 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:37:01.824790 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 28 08:37:01.824790 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 08:37:01.824790 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 28 08:37:01.824790 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 08:37:01.824790 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:37:01.824790 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:37:01.824790 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:37:01.824790 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:37:01.824790 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:37:01.824790 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application with Lock( Jul 28 08:37:01.824790 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:37:01.824790 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:37:01.824790 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:37:01.824790 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:37:01.824790 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:37:01.824790 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:37:01.826093 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:37:01.826093 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:37:01.826093 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 28 08:37:01.826093 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 28 08:37:01.826093 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 28 08:37:01.826093 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 28 08:37:01.826093 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 28 08:37:01.826093 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 28 08:37:01.826093 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jul 28 08:37:01.826093 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application Jul 28 08:37:01.832715 dv-cinder-851351-1-smb devstack@keystone.service[282899]: [pid: 282899|app: 0|req: 296/592] 10.222.0.42 () {56 vars in 1099 bytes} [Thu Jul 28 08:37:01 2022] GET /identity/v3/users/glance => generated 84 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:37:01.832715 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6aacc3f-7e4a-4def-b7ad-8ab3d4976100 None admin] Authenticating user token {{(pid=282899) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:37:01.865103 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG dbcounter [-] [282899] Writing DB stats keystone:SELECT=100 {{(pid=282899) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:37:01.871065 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce7173e2-3241-4dad-8581-cfdba1f2a543 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:37:01.872730 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7173e2-3241-4dad-8581-cfdba1f2a543 None admin] REQUEST_METHOD: `GET` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:37:01.873714 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7173e2-3241-4dad-8581-cfdba1f2a543 None admin] SCRIPT_NAME: `/identity` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:37:01.874192 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7173e2-3241-4dad-8581-cfdba1f2a543 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:37:01.885873 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce7173e2-3241-4dad-8581-cfdba1f2a543 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:37:01.888116 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce7173e2-3241-4dad-8581-cfdba1f2a543 None admin] RBAC: Authorization granted {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:37:01.903827 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application [None req-ce7173e2-3241-4dad-8581-cfdba1f2a543 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jul 28 08:37:01.903827 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:37:01.903827 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:37:01.903827 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:37:01.903827 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:37:01.903827 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:37:01.903827 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:37:01.903827 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:37:01.903827 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:37:01.903827 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:37:01.903827 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:37:01.903827 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:37:01.903827 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 28 08:37:01.903827 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 28 08:37:01.903827 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 28 08:37:01.903827 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 28 08:37:01.905184 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:37:01.905184 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:37:01.905184 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 28 08:37:01.905184 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 08:37:01.905184 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 28 08:37:01.905184 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 08:37:01.905184 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:37:01.905184 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:37:01.905184 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:37:01.905184 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:37:01.905184 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:37:01.905184 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application with Lock( Jul 28 08:37:01.905184 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:37:01.905184 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:37:01.905184 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:37:01.905184 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:37:01.905184 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:37:01.905184 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:37:01.906349 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:37:01.906349 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:37:01.906349 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 28 08:37:01.906349 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 28 08:37:01.906349 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 28 08:37:01.906349 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 28 08:37:01.906349 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 28 08:37:01.906349 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 28 08:37:01.906349 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jul 28 08:37:01.906349 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application Jul 28 08:37:01.907173 dv-cinder-851351-1-smb devstack@keystone.service[282898]: [pid: 282898|app: 0|req: 297/593] 10.222.0.42 () {56 vars in 1102 bytes} [Thu Jul 28 08:37:01 2022] GET /identity/v3/users/neutron => generated 85 bytes in 250 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:37:01.907880 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce7173e2-3241-4dad-8581-cfdba1f2a543 None admin] Authenticating user token {{(pid=282898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:37:01.960414 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG dbcounter [-] [282898] Writing DB stats keystone:SELECT=100 {{(pid=282898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:37:01.965813 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6aacc3f-7e4a-4def-b7ad-8ab3d4976100 None admin] Validating token access rules against request {{(pid=282899) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:37:02.008434 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ca4dc2-7a24-4ded-8530-62ff0a1d88c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282899) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:37:02.009555 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ca4dc2-7a24-4ded-8530-62ff0a1d88c9 None admin] REQUEST_METHOD: `GET` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:37:02.010130 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ca4dc2-7a24-4ded-8530-62ff0a1d88c9 None admin] SCRIPT_NAME: `/identity` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:37:02.010673 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ca4dc2-7a24-4ded-8530-62ff0a1d88c9 None admin] PATH_INFO: `/v3/projects` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:37:02.012025 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35ca4dc2-7a24-4ded-8530-62ff0a1d88c9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=282899) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:37:02.012905 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35ca4dc2-7a24-4ded-8530-62ff0a1d88c9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:37:02.014949 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35ca4dc2-7a24-4ded-8530-62ff0a1d88c9 None admin] RBAC: Authorization granted {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:37:02.018923 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce7173e2-3241-4dad-8581-cfdba1f2a543 None admin] Validating token access rules against request {{(pid=282898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:37:02.030932 dv-cinder-851351-1-smb devstack@keystone.service[282899]: [pid: 282899|app: 0|req: 297/594] 10.222.0.42 () {56 vars in 1148 bytes} [Thu Jul 28 08:37:01 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:37:02.032267 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ca4dc2-7a24-4ded-8530-62ff0a1d88c9 None admin] Authenticating user token {{(pid=282899) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:37:02.061323 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f056c5be-0726-4e64-8d62-c474537d2558 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:37:02.061864 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f056c5be-0726-4e64-8d62-c474537d2558 None admin] REQUEST_METHOD: `GET` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:37:02.062152 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f056c5be-0726-4e64-8d62-c474537d2558 None admin] SCRIPT_NAME: `/identity` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:37:02.062423 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f056c5be-0726-4e64-8d62-c474537d2558 None admin] PATH_INFO: `/v3/users` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:37:02.063447 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f056c5be-0726-4e64-8d62-c474537d2558 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=282898) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:37:02.063565 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f056c5be-0726-4e64-8d62-c474537d2558 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:37:02.065058 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f056c5be-0726-4e64-8d62-c474537d2558 None admin] RBAC: Authorization granted {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:37:02.089120 dv-cinder-851351-1-smb devstack@keystone.service[282898]: [pid: 282898|app: 0|req: 298/595] 10.222.0.42 () {56 vars in 1137 bytes} [Thu Jul 28 08:37:01 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:37:02.089120 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f056c5be-0726-4e64-8d62-c474537d2558 None admin] Authenticating user token {{(pid=282898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:37:02.136542 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG dbcounter [-] [282899] Writing DB stats keystone:SELECT=100 {{(pid=282899) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:37:02.156468 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ca4dc2-7a24-4ded-8530-62ff0a1d88c9 None admin] Validating token access rules against request {{(pid=282899) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:37:02.193619 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f056c5be-0726-4e64-8d62-c474537d2558 None admin] Validating token access rules against request {{(pid=282898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:37:02.197162 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a901b0eb-a38f-4d22-8117-0fc4bd993f8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282899) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:37:02.197564 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a901b0eb-a38f-4d22-8117-0fc4bd993f8a None admin] REQUEST_METHOD: `GET` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:37:02.197848 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a901b0eb-a38f-4d22-8117-0fc4bd993f8a None admin] SCRIPT_NAME: `/identity` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:37:02.198129 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a901b0eb-a38f-4d22-8117-0fc4bd993f8a None admin] PATH_INFO: `/v3/users` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:37:02.198958 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a901b0eb-a38f-4d22-8117-0fc4bd993f8a None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=282899) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:37:02.199274 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a901b0eb-a38f-4d22-8117-0fc4bd993f8a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:37:02.200786 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a901b0eb-a38f-4d22-8117-0fc4bd993f8a None admin] RBAC: Authorization granted {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:37:02.203058 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG dbcounter [-] [282898] Writing DB stats keystone:SELECT=100 {{(pid=282898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:37:02.226378 dv-cinder-851351-1-smb devstack@keystone.service[282899]: [pid: 282899|app: 0|req: 298/596] 10.222.0.42 () {56 vars in 1139 bytes} [Thu Jul 28 08:37:02 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:37:02.226378 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a901b0eb-a38f-4d22-8117-0fc4bd993f8a None admin] Authenticating user token {{(pid=282899) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:37:02.239574 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336830e4-5767-4f47-868c-831c04750fa7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:37:02.240368 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336830e4-5767-4f47-868c-831c04750fa7 None admin] REQUEST_METHOD: `PUT` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:37:02.240747 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336830e4-5767-4f47-868c-831c04750fa7 None admin] SCRIPT_NAME: `/identity` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:37:02.241093 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336830e4-5767-4f47-868c-831c04750fa7 None admin] PATH_INFO: `/v3/projects/5cde68cbfb9042dc9f36af3aacea2473/users/3ca765453caf411782368f0070282436/roles/aa4daecf3ff74fa1b7d53041a4659723` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:37:02.258388 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-336830e4-5767-4f47-868c-831c04750fa7 None admin] RBAC: Authorizing `identity:create_grant(project_id=5cde68cbfb9042dc9f36af3aacea2473, user_id=3ca765453caf411782368f0070282436, role_id=aa4daecf3ff74fa1b7d53041a4659723)` {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:37:02.259973 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-336830e4-5767-4f47-868c-831c04750fa7 None admin] RBAC: Authorization granted {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:37:02.275165 dv-cinder-851351-1-smb devstack@keystone.service[282898]: [pid: 282898|app: 0|req: 299/597] 10.222.0.42 () {58 vars in 1439 bytes} [Thu Jul 28 08:37:02 2022] PUT /identity/v3/projects/5cde68cbfb9042dc9f36af3aacea2473/users/3ca765453caf411782368f0070282436/roles/aa4daecf3ff74fa1b7d53041a4659723 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 08:37:02.278408 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e8d509-bdc7-48a1-b185-7b19b2fa733b None None] REQUEST_METHOD: `GET` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:37:02.279005 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e8d509-bdc7-48a1-b185-7b19b2fa733b None None] SCRIPT_NAME: `/identity` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:37:02.279401 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e8d509-bdc7-48a1-b185-7b19b2fa733b None None] PATH_INFO: `/` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:37:02.286416 dv-cinder-851351-1-smb devstack@keystone.service[282898]: [pid: 282898|app: 0|req: 300/598] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 08:37:02 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 08:37:02.286416 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e8d509-bdc7-48a1-b185-7b19b2fa733b None None] Authenticating user token {{(pid=282898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:37:02.366515 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a901b0eb-a38f-4d22-8117-0fc4bd993f8a None admin] Validating token access rules against request {{(pid=282899) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:37:02.408069 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267cf559-75ee-4298-9ead-8e51f7f680b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282899) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:37:02.409248 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267cf559-75ee-4298-9ead-8e51f7f680b1 None admin] REQUEST_METHOD: `GET` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:37:02.409756 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267cf559-75ee-4298-9ead-8e51f7f680b1 None admin] SCRIPT_NAME: `/identity` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:37:02.410200 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267cf559-75ee-4298-9ead-8e51f7f680b1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:37:02.422878 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-267cf559-75ee-4298-9ead-8e51f7f680b1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:37:02.424951 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-267cf559-75ee-4298-9ead-8e51f7f680b1 None admin] RBAC: Authorization granted {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:37:02.428342 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG dbcounter [-] [282899] Writing DB stats keystone:SELECT=100 {{(pid=282899) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:37:02.435752 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e8d509-bdc7-48a1-b185-7b19b2fa733b None None] Validating token access rules against request {{(pid=282898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:37:02.444888 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application [None req-267cf559-75ee-4298-9ead-8e51f7f680b1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 08:37:02.444888 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:37:02.444888 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:37:02.444888 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:37:02.444888 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:37:02.444888 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:37:02.444888 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:37:02.444888 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:37:02.444888 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:37:02.444888 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:37:02.444888 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:37:02.444888 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:37:02.444888 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 08:37:02.444888 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 08:37:02.444888 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 08:37:02.446295 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 08:37:02.446295 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:37:02.446295 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:37:02.446295 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:37:02.446295 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:37:02.446295 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:37:02.446295 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:37:02.446295 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:37:02.446295 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application with Lock( Jul 28 08:37:02.446295 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:37:02.446295 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:37:02.446295 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:37:02.446295 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:37:02.446295 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:37:02.446295 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:37:02.446295 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:37:02.446295 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:37:02.447640 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 08:37:02.447640 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 08:37:02.447640 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 08:37:02.447640 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application Jul 28 08:37:02.449827 dv-cinder-851351-1-smb devstack@keystone.service[282899]: [pid: 282899|app: 0|req: 299/599] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 08:37:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:37:02.451440 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d3460a-0c5c-47a2-986e-acb1480104d9 None None] REQUEST_METHOD: `POST` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:37:02.451952 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d3460a-0c5c-47a2-986e-acb1480104d9 None None] SCRIPT_NAME: `/identity` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:37:02.452390 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d3460a-0c5c-47a2-986e-acb1480104d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:37:02.473692 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.auth.core [None req-c9d3460a-0c5c-47a2-986e-acb1480104d9 None None] MFA Rules not processed for user `2be990a66857410a87ffa7609aec4f7b`. Rule list: `[]` (Enabled: `True`). {{(pid=282899) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 08:37:02.475324 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.fernet_utils [None req-c9d3460a-0c5c-47a2-986e-acb1480104d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=282899) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:37:02.487105 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eea68a4-74fa-44e8-9d6a-ba4e6c77adf5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:37:02.487883 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eea68a4-74fa-44e8-9d6a-ba4e6c77adf5 None admin] REQUEST_METHOD: `GET` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:37:02.488287 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eea68a4-74fa-44e8-9d6a-ba4e6c77adf5 None admin] SCRIPT_NAME: `/identity` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:37:02.488703 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eea68a4-74fa-44e8-9d6a-ba4e6c77adf5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:37:02.501253 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eea68a4-74fa-44e8-9d6a-ba4e6c77adf5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:37:02.503081 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eea68a4-74fa-44e8-9d6a-ba4e6c77adf5 None admin] RBAC: Authorization granted {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:37:02.521302 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application [None req-3eea68a4-74fa-44e8-9d6a-ba4e6c77adf5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 08:37:02.521302 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:37:02.521302 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:37:02.521302 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:37:02.521302 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:37:02.521302 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:37:02.521302 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:37:02.521302 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:37:02.521302 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:37:02.521302 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:37:02.521302 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:37:02.521302 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:37:02.521302 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 08:37:02.521302 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 08:37:02.521302 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 08:37:02.522565 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 08:37:02.522565 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:37:02.522565 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:37:02.522565 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:37:02.522565 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:37:02.522565 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:37:02.522565 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:37:02.522565 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:37:02.522565 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application with Lock( Jul 28 08:37:02.522565 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:37:02.522565 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:37:02.522565 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:37:02.522565 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:37:02.522565 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:37:02.522565 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:37:02.522565 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:37:02.522565 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:37:02.523750 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 08:37:02.523750 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 08:37:02.523750 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 08:37:02.523750 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application Jul 28 08:37:02.526355 dv-cinder-851351-1-smb devstack@keystone.service[282898]: [pid: 282898|app: 0|req: 301/600] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 08:37:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 242 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:37:02.527359 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eea68a4-74fa-44e8-9d6a-ba4e6c77adf5 None admin] Authenticating user token {{(pid=282898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:37:02.542135 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG dbcounter [-] [282898] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=282898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:37:02.554309 dv-cinder-851351-1-smb devstack@keystone.service[282899]: [pid: 282899|app: 0|req: 300/601] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 08:37:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 08:37:02.554762 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d3460a-0c5c-47a2-986e-acb1480104d9 None None] Authenticating user token {{(pid=282899) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:37:02.647890 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eea68a4-74fa-44e8-9d6a-ba4e6c77adf5 None admin] Validating token access rules against request {{(pid=282898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:37:02.686882 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d3460a-0c5c-47a2-986e-acb1480104d9 None None] Validating token access rules against request {{(pid=282899) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:37:02.701365 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4264698-365e-482d-956f-78dee4b863b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:37:02.702864 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4264698-365e-482d-956f-78dee4b863b7 None admin] REQUEST_METHOD: `GET` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:37:02.704483 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4264698-365e-482d-956f-78dee4b863b7 None admin] SCRIPT_NAME: `/identity` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:37:02.705702 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4264698-365e-482d-956f-78dee4b863b7 None admin] PATH_INFO: `/v3/domains` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:37:02.707013 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4264698-365e-482d-956f-78dee4b863b7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=282898) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:37:02.707564 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4264698-365e-482d-956f-78dee4b863b7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:37:02.709977 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4264698-365e-482d-956f-78dee4b863b7 None admin] RBAC: Authorization granted {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:37:02.717076 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG dbcounter [-] [282899] Writing DB stats keystone:SELECT=100 {{(pid=282899) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:37:02.730041 dv-cinder-851351-1-smb devstack@keystone.service[282898]: [pid: 282898|app: 0|req: 302/602] 10.222.0.42 () {56 vars in 1109 bytes} [Thu Jul 28 08:37:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:37:02.730041 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4264698-365e-482d-956f-78dee4b863b7 None admin] Authenticating user token {{(pid=282898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:37:02.737797 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93df71b-72b9-4d4f-b51d-f14f47120f12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282899) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:37:02.738500 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93df71b-72b9-4d4f-b51d-f14f47120f12 None admin] REQUEST_METHOD: `GET` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:37:02.738788 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93df71b-72b9-4d4f-b51d-f14f47120f12 None admin] SCRIPT_NAME: `/identity` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:37:02.739068 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93df71b-72b9-4d4f-b51d-f14f47120f12 None admin] PATH_INFO: `/v3/domains` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:37:02.739845 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b93df71b-72b9-4d4f-b51d-f14f47120f12 None admin] RBAC: Adding query filter params (name=Default) {{(pid=282899) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:37:02.740215 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b93df71b-72b9-4d4f-b51d-f14f47120f12 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:37:02.741698 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b93df71b-72b9-4d4f-b51d-f14f47120f12 None admin] RBAC: Authorization granted {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:37:02.759619 dv-cinder-851351-1-smb devstack@keystone.service[282899]: [pid: 282899|app: 0|req: 301/603] 10.222.0.42 () {56 vars in 1109 bytes} [Thu Jul 28 08:37:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:37:02.759619 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93df71b-72b9-4d4f-b51d-f14f47120f12 None admin] Authenticating user token {{(pid=282899) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:37:02.828317 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG dbcounter [-] [282898] Writing DB stats keystone:SELECT=100 {{(pid=282898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:37:02.877144 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4264698-365e-482d-956f-78dee4b863b7 None admin] Validating token access rules against request {{(pid=282898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:37:02.878698 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93df71b-72b9-4d4f-b51d-f14f47120f12 None admin] Validating token access rules against request {{(pid=282899) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:37:02.916614 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d287a80-0666-4583-97fb-e4e17593d4bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282899) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:37:02.917370 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d287a80-0666-4583-97fb-e4e17593d4bc None admin] REQUEST_METHOD: `GET` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:37:02.917726 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d287a80-0666-4583-97fb-e4e17593d4bc None admin] SCRIPT_NAME: `/identity` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:37:02.918076 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d287a80-0666-4583-97fb-e4e17593d4bc None admin] PATH_INFO: `/v3/projects/service` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:37:02.925028 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-928ee301-fcee-404f-b1ad-841fe66f0264 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:37:02.926254 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928ee301-fcee-404f-b1ad-841fe66f0264 None admin] REQUEST_METHOD: `GET` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:37:02.926572 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d287a80-0666-4583-97fb-e4e17593d4bc None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:37:02.926954 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928ee301-fcee-404f-b1ad-841fe66f0264 None admin] SCRIPT_NAME: `/identity` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:37:02.927416 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928ee301-fcee-404f-b1ad-841fe66f0264 None admin] PATH_INFO: `/v3/roles/service` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:37:02.928483 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d287a80-0666-4583-97fb-e4e17593d4bc None admin] RBAC: Authorization granted {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:37:02.940306 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-928ee301-fcee-404f-b1ad-841fe66f0264 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 08:37:02.942293 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application [None req-6d287a80-0666-4583-97fb-e4e17593d4bc None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 08:37:02.942293 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:37:02.942293 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:37:02.942293 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:37:02.942293 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:37:02.942293 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:37:02.942293 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:37:02.942293 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:37:02.942293 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:37:02.942293 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:37:02.942293 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:37:02.942293 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:37:02.942293 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 28 08:37:02.942293 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 28 08:37:02.942293 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 28 08:37:02.943311 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 28 08:37:02.943311 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:37:02.943311 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:37:02.943311 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:37:02.943311 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:37:02.943311 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:37:02.943311 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:37:02.943311 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:37:02.943311 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application with Lock( Jul 28 08:37:02.943311 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:37:02.943311 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:37:02.943311 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:37:02.943311 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:37:02.943311 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:37:02.943311 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:37:02.943311 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:37:02.943311 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:37:02.944341 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 28 08:37:02.944341 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 28 08:37:02.944341 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 28 08:37:02.944341 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 28 08:37:02.944341 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 28 08:37:02.944341 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 28 08:37:02.944341 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 08:37:02.944341 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application Jul 28 08:37:02.948404 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application [None req-928ee301-fcee-404f-b1ad-841fe66f0264 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 28 08:37:02.948404 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:37:02.948404 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:37:02.948404 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:37:02.948404 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:37:02.948404 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:37:02.948404 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:37:02.948404 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:37:02.948404 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:37:02.948404 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:37:02.948404 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:37:02.948404 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:37:02.948404 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 08:37:02.948404 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 08:37:02.948404 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 08:37:02.948404 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 08:37:02.949884 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 08:37:02.949884 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 08:37:02.949884 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 08:37:02.949884 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 08:37:02.949884 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:37:02.949884 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:37:02.949884 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:37:02.949884 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:37:02.949884 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:37:02.949884 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:37:02.949884 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:37:02.949884 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application with Lock( Jul 28 08:37:02.949884 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:37:02.949884 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:37:02.949884 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:37:02.949884 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:37:02.950882 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:37:02.950882 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:37:02.950882 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:37:02.950882 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:37:02.950882 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 08:37:02.950882 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 08:37:02.950882 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 08:37:02.950882 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 08:37:02.950882 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 08:37:02.950882 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 08:37:02.950882 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 28 08:37:02.950882 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application Jul 28 08:37:02.951645 dv-cinder-851351-1-smb devstack@keystone.service[282899]: [pid: 282899|app: 0|req: 302/604] 10.222.0.42 () {56 vars in 1111 bytes} [Thu Jul 28 08:37:02 2022] GET /identity/v3/projects/service => generated 88 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:37:02.951731 dv-cinder-851351-1-smb devstack@keystone.service[282898]: [pid: 282898|app: 0|req: 303/605] 10.222.0.42 () {56 vars in 1102 bytes} [Thu Jul 28 08:37:02 2022] GET /identity/v3/roles/service => generated 85 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:37:02.951813 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d287a80-0666-4583-97fb-e4e17593d4bc None admin] Authenticating user token {{(pid=282899) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:37:02.951905 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-928ee301-fcee-404f-b1ad-841fe66f0264 None admin] Authenticating user token {{(pid=282898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:37:03.026818 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG dbcounter [-] [282899] Writing DB stats keystone:SELECT=100 {{(pid=282899) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:37:03.069536 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-928ee301-fcee-404f-b1ad-841fe66f0264 None admin] Validating token access rules against request {{(pid=282898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:37:03.091091 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d287a80-0666-4583-97fb-e4e17593d4bc None admin] Validating token access rules against request {{(pid=282899) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:37:03.100502 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG dbcounter [-] [282898] Writing DB stats keystone:SELECT=100 {{(pid=282898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:37:03.110393 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f023b37f-6f27-4d6f-bcc9-ed4e857cb8c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:37:03.111594 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f023b37f-6f27-4d6f-bcc9-ed4e857cb8c9 None admin] REQUEST_METHOD: `GET` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:37:03.112012 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f023b37f-6f27-4d6f-bcc9-ed4e857cb8c9 None admin] SCRIPT_NAME: `/identity` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:37:03.112457 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f023b37f-6f27-4d6f-bcc9-ed4e857cb8c9 None admin] PATH_INFO: `/v3/projects` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:37:03.113660 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f023b37f-6f27-4d6f-bcc9-ed4e857cb8c9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=282898) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:37:03.114083 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f023b37f-6f27-4d6f-bcc9-ed4e857cb8c9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:37:03.115693 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f023b37f-6f27-4d6f-bcc9-ed4e857cb8c9 None admin] RBAC: Authorization granted {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:37:03.132838 dv-cinder-851351-1-smb devstack@keystone.service[282898]: [pid: 282898|app: 0|req: 304/606] 10.222.0.42 () {56 vars in 1148 bytes} [Thu Jul 28 08:37:02 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:37:03.134039 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f023b37f-6f27-4d6f-bcc9-ed4e857cb8c9 None admin] Authenticating user token {{(pid=282898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:37:03.137169 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0723af4-04c2-4c8d-a99c-6a79aaadf952 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282899) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:37:03.138163 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0723af4-04c2-4c8d-a99c-6a79aaadf952 None admin] REQUEST_METHOD: `GET` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:37:03.138625 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0723af4-04c2-4c8d-a99c-6a79aaadf952 None admin] SCRIPT_NAME: `/identity` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:37:03.139158 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0723af4-04c2-4c8d-a99c-6a79aaadf952 None admin] PATH_INFO: `/v3/projects/service` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:37:03.147820 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0723af4-04c2-4c8d-a99c-6a79aaadf952 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:37:03.149992 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0723af4-04c2-4c8d-a99c-6a79aaadf952 None admin] RBAC: Authorization granted {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:37:03.163636 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application [None req-b0723af4-04c2-4c8d-a99c-6a79aaadf952 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 08:37:03.163636 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:37:03.163636 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:37:03.163636 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:37:03.163636 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:37:03.163636 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:37:03.163636 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:37:03.163636 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:37:03.163636 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:37:03.163636 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:37:03.163636 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:37:03.163636 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:37:03.163636 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 28 08:37:03.163636 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 28 08:37:03.163636 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 28 08:37:03.164705 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 28 08:37:03.164705 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:37:03.164705 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:37:03.164705 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:37:03.164705 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:37:03.164705 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:37:03.164705 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:37:03.164705 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:37:03.164705 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application with Lock( Jul 28 08:37:03.164705 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:37:03.164705 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:37:03.164705 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:37:03.164705 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:37:03.164705 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:37:03.164705 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:37:03.164705 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:37:03.164705 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:37:03.165740 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 28 08:37:03.165740 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 28 08:37:03.165740 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 28 08:37:03.165740 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 28 08:37:03.165740 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 28 08:37:03.165740 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 28 08:37:03.165740 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 08:37:03.165740 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application Jul 28 08:37:03.172951 dv-cinder-851351-1-smb devstack@keystone.service[282899]: [pid: 282899|app: 0|req: 303/607] 10.222.0.42 () {56 vars in 1111 bytes} [Thu Jul 28 08:37:02 2022] GET /identity/v3/projects/service => generated 88 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:37:03.174276 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0723af4-04c2-4c8d-a99c-6a79aaadf952 None admin] Authenticating user token {{(pid=282899) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:37:03.245244 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f023b37f-6f27-4d6f-bcc9-ed4e857cb8c9 None admin] Validating token access rules against request {{(pid=282898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:37:03.282650 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd2ff2be-9e66-4dbc-9356-bcbe04ab4630 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:37:03.283318 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2ff2be-9e66-4dbc-9356-bcbe04ab4630 None admin] REQUEST_METHOD: `GET` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:37:03.283609 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2ff2be-9e66-4dbc-9356-bcbe04ab4630 None admin] SCRIPT_NAME: `/identity` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:37:03.283939 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2ff2be-9e66-4dbc-9356-bcbe04ab4630 None admin] PATH_INFO: `/v3/roles` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:37:03.284692 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd2ff2be-9e66-4dbc-9356-bcbe04ab4630 None admin] RBAC: Adding query filter params (name=service) {{(pid=282898) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:37:03.285091 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd2ff2be-9e66-4dbc-9356-bcbe04ab4630 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:37:03.285375 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0723af4-04c2-4c8d-a99c-6a79aaadf952 None admin] Validating token access rules against request {{(pid=282899) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:37:03.286498 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd2ff2be-9e66-4dbc-9356-bcbe04ab4630 None admin] RBAC: Authorization granted {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:37:03.288650 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG dbcounter [-] [282899] Writing DB stats keystone:SELECT=100 {{(pid=282899) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:37:03.302665 dv-cinder-851351-1-smb devstack@keystone.service[282898]: [pid: 282898|app: 0|req: 305/608] 10.222.0.42 () {56 vars in 1103 bytes} [Thu Jul 28 08:37:03 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:37:03.304852 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd2ff2be-9e66-4dbc-9356-bcbe04ab4630 None admin] Authenticating user token {{(pid=282898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:37:03.327794 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62656cf-2571-42f1-83e1-f73070664fb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282899) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:37:03.328547 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62656cf-2571-42f1-83e1-f73070664fb1 None admin] REQUEST_METHOD: `PUT` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:37:03.328959 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62656cf-2571-42f1-83e1-f73070664fb1 None admin] SCRIPT_NAME: `/identity` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:37:03.329724 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62656cf-2571-42f1-83e1-f73070664fb1 None admin] PATH_INFO: `/v3/projects/5cde68cbfb9042dc9f36af3aacea2473/users/e179a9d6bf024305ad96e6fe539413e6/roles/aa4daecf3ff74fa1b7d53041a4659723` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:37:03.347806 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b62656cf-2571-42f1-83e1-f73070664fb1 None admin] RBAC: Authorizing `identity:create_grant(project_id=5cde68cbfb9042dc9f36af3aacea2473, user_id=e179a9d6bf024305ad96e6fe539413e6, role_id=aa4daecf3ff74fa1b7d53041a4659723)` {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:37:03.349060 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b62656cf-2571-42f1-83e1-f73070664fb1 None admin] RBAC: Authorization granted {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:37:03.372702 dv-cinder-851351-1-smb devstack@keystone.service[282899]: [pid: 282899|app: 0|req: 304/609] 10.222.0.42 () {58 vars in 1439 bytes} [Thu Jul 28 08:37:03 2022] PUT /identity/v3/projects/5cde68cbfb9042dc9f36af3aacea2473/users/e179a9d6bf024305ad96e6fe539413e6/roles/aa4daecf3ff74fa1b7d53041a4659723 => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 08:37:03.372702 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62656cf-2571-42f1-83e1-f73070664fb1 None admin] Authenticating user token {{(pid=282899) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:37:03.373482 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG dbcounter [-] [282898] Writing DB stats keystone:SELECT=100 {{(pid=282898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:37:03.505082 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd2ff2be-9e66-4dbc-9356-bcbe04ab4630 None admin] Validating token access rules against request {{(pid=282898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:37:03.581431 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a0eef60-99d0-43d6-998e-147a96823c21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:37:03.582186 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0eef60-99d0-43d6-998e-147a96823c21 None admin] REQUEST_METHOD: `GET` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:37:03.582476 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0eef60-99d0-43d6-998e-147a96823c21 None admin] SCRIPT_NAME: `/identity` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:37:03.582755 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0eef60-99d0-43d6-998e-147a96823c21 None admin] PATH_INFO: `/v3/projects` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:37:03.584154 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a0eef60-99d0-43d6-998e-147a96823c21 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=282898) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:37:03.584154 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a0eef60-99d0-43d6-998e-147a96823c21 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:37:03.586811 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a0eef60-99d0-43d6-998e-147a96823c21 None admin] RBAC: Authorization granted {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:37:03.597857 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62656cf-2571-42f1-83e1-f73070664fb1 None admin] Validating token access rules against request {{(pid=282899) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:37:03.601208 dv-cinder-851351-1-smb devstack@keystone.service[282898]: [pid: 282898|app: 0|req: 306/610] 10.222.0.42 () {56 vars in 1148 bytes} [Thu Jul 28 08:37:03 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 297 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:37:03.602589 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ae1729-3851-4ce1-839f-8687e229790d None None] REQUEST_METHOD: `GET` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:37:03.602886 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ae1729-3851-4ce1-839f-8687e229790d None None] SCRIPT_NAME: `/identity` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:37:03.603210 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ae1729-3851-4ce1-839f-8687e229790d None None] PATH_INFO: `/` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:37:03.604871 dv-cinder-851351-1-smb devstack@keystone.service[282898]: [pid: 282898|app: 0|req: 307/611] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 08:37:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 08:37:03.610481 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7fe829-43f3-4926-85b5-0e6c3d5a3d6c None None] REQUEST_METHOD: `POST` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:37:03.610776 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7fe829-43f3-4926-85b5-0e6c3d5a3d6c None None] SCRIPT_NAME: `/identity` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:37:03.611044 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7fe829-43f3-4926-85b5-0e6c3d5a3d6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:37:03.631332 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.auth.core [None req-2f7fe829-43f3-4926-85b5-0e6c3d5a3d6c None None] MFA Rules not processed for user `2be990a66857410a87ffa7609aec4f7b`. Rule list: `[]` (Enabled: `True`). {{(pid=282898) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 08:37:03.632573 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.fernet_utils [None req-2f7fe829-43f3-4926-85b5-0e6c3d5a3d6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=282898) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:37:03.647961 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-899430d7-af9b-4141-aa42-2cc8acea1f61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282899) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:37:03.648649 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899430d7-af9b-4141-aa42-2cc8acea1f61 None admin] REQUEST_METHOD: `GET` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:37:03.648968 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899430d7-af9b-4141-aa42-2cc8acea1f61 None admin] SCRIPT_NAME: `/identity` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:37:03.649256 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899430d7-af9b-4141-aa42-2cc8acea1f61 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:37:03.661139 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-899430d7-af9b-4141-aa42-2cc8acea1f61 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:37:03.663754 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-899430d7-af9b-4141-aa42-2cc8acea1f61 None admin] RBAC: Authorization granted {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:37:03.684008 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application [None req-899430d7-af9b-4141-aa42-2cc8acea1f61 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 08:37:03.684008 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:37:03.684008 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:37:03.684008 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:37:03.684008 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:37:03.684008 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:37:03.684008 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:37:03.684008 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:37:03.684008 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:37:03.684008 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:37:03.684008 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:37:03.684008 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:37:03.684008 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 08:37:03.684008 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 08:37:03.684008 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 08:37:03.685160 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 08:37:03.685160 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:37:03.685160 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:37:03.685160 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:37:03.685160 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:37:03.685160 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:37:03.685160 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:37:03.685160 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:37:03.685160 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application with Lock( Jul 28 08:37:03.685160 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:37:03.685160 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:37:03.685160 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:37:03.685160 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:37:03.685160 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:37:03.685160 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:37:03.685160 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:37:03.685160 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:37:03.686765 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 08:37:03.686765 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 08:37:03.686765 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 08:37:03.686765 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application Jul 28 08:37:03.686765 dv-cinder-851351-1-smb devstack@keystone.service[282899]: [pid: 282899|app: 0|req: 305/612] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 08:37:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 317 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:37:03.686765 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-899430d7-af9b-4141-aa42-2cc8acea1f61 None admin] Authenticating user token {{(pid=282899) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:37:03.700625 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG dbcounter [-] [282899] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=282899) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:37:03.753065 dv-cinder-851351-1-smb devstack@keystone.service[282898]: [pid: 282898|app: 0|req: 308/613] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 08:37:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 28 08:37:03.753972 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f7fe829-43f3-4926-85b5-0e6c3d5a3d6c None None] Authenticating user token {{(pid=282898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:37:03.804691 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG dbcounter [-] [282898] Writing DB stats keystone:SELECT=100 {{(pid=282898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:37:03.826592 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-899430d7-af9b-4141-aa42-2cc8acea1f61 None admin] Validating token access rules against request {{(pid=282899) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:37:03.864155 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ae54ed-e11c-498c-b58b-686e31519c61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282899) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:37:03.865131 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ae54ed-e11c-498c-b58b-686e31519c61 None admin] REQUEST_METHOD: `PUT` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:37:03.865769 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ae54ed-e11c-498c-b58b-686e31519c61 None admin] SCRIPT_NAME: `/identity` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:37:03.866119 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ae54ed-e11c-498c-b58b-686e31519c61 None admin] PATH_INFO: `/v3/projects/5cde68cbfb9042dc9f36af3aacea2473/users/7a2fa5c253dc4112bca7074204f01b0a/roles/aa4daecf3ff74fa1b7d53041a4659723` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:37:03.877362 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f7fe829-43f3-4926-85b5-0e6c3d5a3d6c None None] Validating token access rules against request {{(pid=282898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:37:03.890121 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82ae54ed-e11c-498c-b58b-686e31519c61 None admin] RBAC: Authorizing `identity:create_grant(project_id=5cde68cbfb9042dc9f36af3aacea2473, user_id=7a2fa5c253dc4112bca7074204f01b0a, role_id=aa4daecf3ff74fa1b7d53041a4659723)` {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:37:03.891912 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82ae54ed-e11c-498c-b58b-686e31519c61 None admin] RBAC: Authorization granted {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:37:03.920701 dv-cinder-851351-1-smb devstack@keystone.service[282899]: [pid: 282899|app: 0|req: 306/614] 10.222.0.42 () {58 vars in 1439 bytes} [Thu Jul 28 08:37:03 2022] PUT /identity/v3/projects/5cde68cbfb9042dc9f36af3aacea2473/users/7a2fa5c253dc4112bca7074204f01b0a/roles/aa4daecf3ff74fa1b7d53041a4659723 => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 08:37:03.920701 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ae54ed-e11c-498c-b58b-686e31519c61 None admin] Authenticating user token {{(pid=282899) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:37:03.924345 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c45c7843-5112-4661-8d6d-59a7a474ba41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:37:03.925420 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45c7843-5112-4661-8d6d-59a7a474ba41 None admin] REQUEST_METHOD: `GET` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:37:03.925975 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45c7843-5112-4661-8d6d-59a7a474ba41 None admin] SCRIPT_NAME: `/identity` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:37:03.926476 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45c7843-5112-4661-8d6d-59a7a474ba41 None admin] PATH_INFO: `/v3/domains` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:37:03.927500 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c45c7843-5112-4661-8d6d-59a7a474ba41 None admin] RBAC: Adding query filter params (name=Default) {{(pid=282898) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:37:03.928036 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c45c7843-5112-4661-8d6d-59a7a474ba41 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:37:03.929820 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c45c7843-5112-4661-8d6d-59a7a474ba41 None admin] RBAC: Authorization granted {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:37:03.967207 dv-cinder-851351-1-smb devstack@keystone.service[282898]: [pid: 282898|app: 0|req: 309/615] 10.222.0.42 () {56 vars in 1109 bytes} [Thu Jul 28 08:37:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:37:03.973050 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c45c7843-5112-4661-8d6d-59a7a474ba41 None admin] Authenticating user token {{(pid=282898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:37:03.989462 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG dbcounter [-] [282899] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=282899) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:37:04.050025 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ae54ed-e11c-498c-b58b-686e31519c61 None admin] Validating token access rules against request {{(pid=282899) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:37:04.094657 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa57311-ddf9-44e6-96de-49187bf2449f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282899) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:37:04.095506 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa57311-ddf9-44e6-96de-49187bf2449f None admin] REQUEST_METHOD: `GET` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:37:04.095849 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa57311-ddf9-44e6-96de-49187bf2449f None admin] SCRIPT_NAME: `/identity` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:37:04.096195 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa57311-ddf9-44e6-96de-49187bf2449f None admin] PATH_INFO: `/v3/roles/service` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:37:04.112803 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daa57311-ddf9-44e6-96de-49187bf2449f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 08:37:04.118812 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application [None req-daa57311-ddf9-44e6-96de-49187bf2449f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 28 08:37:04.118812 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:37:04.118812 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:37:04.118812 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:37:04.118812 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:37:04.118812 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:37:04.118812 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:37:04.118812 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:37:04.118812 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:37:04.118812 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:37:04.118812 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:37:04.118812 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:37:04.118812 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 08:37:04.118812 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 08:37:04.118812 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 08:37:04.118812 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 08:37:04.119908 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 08:37:04.119908 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 08:37:04.119908 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 08:37:04.119908 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 08:37:04.119908 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:37:04.119908 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:37:04.119908 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:37:04.119908 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:37:04.119908 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:37:04.119908 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:37:04.119908 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:37:04.119908 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application with Lock( Jul 28 08:37:04.119908 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:37:04.119908 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:37:04.119908 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:37:04.119908 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:37:04.120895 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:37:04.120895 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:37:04.120895 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:37:04.120895 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:37:04.120895 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 08:37:04.120895 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 08:37:04.120895 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 08:37:04.120895 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 08:37:04.120895 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 08:37:04.120895 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 08:37:04.120895 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 28 08:37:04.120895 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application Jul 28 08:37:04.123855 dv-cinder-851351-1-smb devstack@keystone.service[282899]: [pid: 282899|app: 0|req: 307/616] 10.222.0.42 () {56 vars in 1102 bytes} [Thu Jul 28 08:37:03 2022] GET /identity/v3/roles/service => generated 85 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:37:04.131613 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa57311-ddf9-44e6-96de-49187bf2449f None admin] Authenticating user token {{(pid=282899) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:37:04.173968 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG dbcounter [-] [282898] Writing DB stats keystone:SELECT=100 {{(pid=282898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:37:04.178885 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c45c7843-5112-4661-8d6d-59a7a474ba41 None admin] Validating token access rules against request {{(pid=282898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:37:04.223886 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e7e1dd-a43d-445f-b6b0-e76835429214 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:37:04.224600 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e7e1dd-a43d-445f-b6b0-e76835429214 None admin] REQUEST_METHOD: `GET` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:37:04.224895 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e7e1dd-a43d-445f-b6b0-e76835429214 None admin] SCRIPT_NAME: `/identity` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:37:04.225175 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e7e1dd-a43d-445f-b6b0-e76835429214 None admin] PATH_INFO: `/v3/users/nova` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:37:04.235443 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67e7e1dd-a43d-445f-b6b0-e76835429214 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:37:04.237734 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67e7e1dd-a43d-445f-b6b0-e76835429214 None admin] RBAC: Authorization granted {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:37:04.256149 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application [None req-67e7e1dd-a43d-445f-b6b0-e76835429214 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 28 08:37:04.256149 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:37:04.256149 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:37:04.256149 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:37:04.256149 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:37:04.256149 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:37:04.256149 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:37:04.256149 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:37:04.256149 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:37:04.256149 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:37:04.256149 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:37:04.256149 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:37:04.256149 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 28 08:37:04.256149 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 28 08:37:04.256149 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 28 08:37:04.256149 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 28 08:37:04.257384 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:37:04.257384 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:37:04.257384 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 28 08:37:04.257384 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 08:37:04.257384 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 28 08:37:04.257384 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 08:37:04.257384 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:37:04.257384 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:37:04.257384 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:37:04.257384 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:37:04.257384 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:37:04.257384 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application with Lock( Jul 28 08:37:04.257384 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:37:04.257384 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:37:04.257384 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:37:04.257384 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:37:04.257384 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:37:04.257384 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:37:04.258480 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:37:04.258480 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:37:04.258480 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 28 08:37:04.258480 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 28 08:37:04.258480 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 28 08:37:04.258480 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 28 08:37:04.258480 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 28 08:37:04.258480 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 28 08:37:04.258480 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 28 08:37:04.258480 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application Jul 28 08:37:04.258480 dv-cinder-851351-1-smb devstack@keystone.service[282898]: [pid: 282898|app: 0|req: 310/617] 10.222.0.42 () {56 vars in 1093 bytes} [Thu Jul 28 08:37:03 2022] GET /identity/v3/users/nova => generated 82 bytes in 285 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 08:37:04.263486 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e7e1dd-a43d-445f-b6b0-e76835429214 None admin] Authenticating user token {{(pid=282898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:37:04.268122 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa57311-ddf9-44e6-96de-49187bf2449f None admin] Validating token access rules against request {{(pid=282899) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:37:04.298590 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG dbcounter [-] [282899] Writing DB stats keystone:SELECT=100 {{(pid=282899) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:37:04.336474 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dea4a35-a383-4736-b779-878274644c70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282899) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:37:04.337324 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dea4a35-a383-4736-b779-878274644c70 None admin] REQUEST_METHOD: `GET` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:37:04.337711 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dea4a35-a383-4736-b779-878274644c70 None admin] SCRIPT_NAME: `/identity` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:37:04.338091 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dea4a35-a383-4736-b779-878274644c70 None admin] PATH_INFO: `/v3/roles` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:37:04.338954 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dea4a35-a383-4736-b779-878274644c70 None admin] RBAC: Adding query filter params (name=service) {{(pid=282899) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:37:04.339410 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dea4a35-a383-4736-b779-878274644c70 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:37:04.340929 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dea4a35-a383-4736-b779-878274644c70 None admin] RBAC: Authorization granted {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:37:04.364866 dv-cinder-851351-1-smb devstack@keystone.service[282899]: [pid: 282899|app: 0|req: 308/618] 10.222.0.42 () {56 vars in 1103 bytes} [Thu Jul 28 08:37:04 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 08:37:04.373716 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dea4a35-a383-4736-b779-878274644c70 None admin] Authenticating user token {{(pid=282899) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:37:04.402782 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e7e1dd-a43d-445f-b6b0-e76835429214 None admin] Validating token access rules against request {{(pid=282898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:37:04.443879 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf1ed87-ad40-47e6-acec-6c5acd7a4d51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:37:04.445183 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf1ed87-ad40-47e6-acec-6c5acd7a4d51 None admin] REQUEST_METHOD: `GET` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:37:04.445665 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf1ed87-ad40-47e6-acec-6c5acd7a4d51 None admin] SCRIPT_NAME: `/identity` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:37:04.445943 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf1ed87-ad40-47e6-acec-6c5acd7a4d51 None admin] PATH_INFO: `/v3/users` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:37:04.447389 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf1ed87-ad40-47e6-acec-6c5acd7a4d51 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=282898) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:37:04.447824 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf1ed87-ad40-47e6-acec-6c5acd7a4d51 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:37:04.449343 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf1ed87-ad40-47e6-acec-6c5acd7a4d51 None admin] RBAC: Authorization granted {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:37:04.474647 dv-cinder-851351-1-smb devstack@keystone.service[282898]: [pid: 282898|app: 0|req: 311/619] 10.222.0.42 () {56 vars in 1133 bytes} [Thu Jul 28 08:37:04 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:37:04.476925 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032f1410-71ab-44a5-835d-7ad94ce0aec4 None None] REQUEST_METHOD: `GET` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:37:04.477336 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032f1410-71ab-44a5-835d-7ad94ce0aec4 None None] SCRIPT_NAME: `/identity` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:37:04.477719 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032f1410-71ab-44a5-835d-7ad94ce0aec4 None None] PATH_INFO: `/` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:37:04.479408 dv-cinder-851351-1-smb devstack@keystone.service[282898]: [pid: 282898|app: 0|req: 312/620] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 08:37:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 08:37:04.482194 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-032f1410-71ab-44a5-835d-7ad94ce0aec4 None None] Authenticating user token {{(pid=282898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:37:04.506622 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG dbcounter [-] [282898] Writing DB stats keystone:SELECT=100 {{(pid=282898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:37:04.551122 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dea4a35-a383-4736-b779-878274644c70 None admin] Validating token access rules against request {{(pid=282899) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:37:04.599090 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e00fd21-32ed-461b-bb53-bed304cf2dc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282899) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:37:04.599354 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-032f1410-71ab-44a5-835d-7ad94ce0aec4 None None] Validating token access rules against request {{(pid=282898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:37:04.600235 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e00fd21-32ed-461b-bb53-bed304cf2dc5 None admin] REQUEST_METHOD: `GET` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:37:04.600718 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e00fd21-32ed-461b-bb53-bed304cf2dc5 None admin] SCRIPT_NAME: `/identity` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:37:04.601446 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e00fd21-32ed-461b-bb53-bed304cf2dc5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:37:04.617031 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e00fd21-32ed-461b-bb53-bed304cf2dc5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:37:04.619832 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e00fd21-32ed-461b-bb53-bed304cf2dc5 None admin] RBAC: Authorization granted {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:37:04.639362 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4021b15c-f8de-4210-bd23-0e2aa28a84f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:37:04.640313 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4021b15c-f8de-4210-bd23-0e2aa28a84f6 None admin] REQUEST_METHOD: `GET` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:37:04.640600 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4021b15c-f8de-4210-bd23-0e2aa28a84f6 None admin] SCRIPT_NAME: `/identity` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:37:04.640923 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4021b15c-f8de-4210-bd23-0e2aa28a84f6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:37:04.641604 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application [None req-4e00fd21-32ed-461b-bb53-bed304cf2dc5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 08:37:04.641604 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:37:04.641604 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:37:04.641604 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:37:04.641604 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:37:04.641604 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:37:04.641604 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:37:04.641604 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:37:04.641604 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:37:04.641604 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:37:04.641604 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:37:04.641604 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:37:04.641604 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 08:37:04.641604 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 08:37:04.641604 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 08:37:04.642787 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 08:37:04.642787 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:37:04.642787 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:37:04.642787 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:37:04.642787 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:37:04.642787 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:37:04.642787 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:37:04.642787 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:37:04.642787 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application with Lock( Jul 28 08:37:04.642787 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:37:04.642787 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:37:04.642787 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:37:04.642787 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:37:04.642787 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:37:04.642787 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:37:04.642787 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:37:04.642787 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:37:04.644013 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 08:37:04.644013 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 08:37:04.644013 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 08:37:04.644013 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application Jul 28 08:37:04.653013 dv-cinder-851351-1-smb devstack@keystone.service[282899]: [pid: 282899|app: 0|req: 309/621] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 08:37:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 280 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:37:04.654782 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b60e01-1eca-4132-8225-3f0ab5d23c7a None None] REQUEST_METHOD: `POST` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:37:04.655741 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b60e01-1eca-4132-8225-3f0ab5d23c7a None None] SCRIPT_NAME: `/identity` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:37:04.656299 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b60e01-1eca-4132-8225-3f0ab5d23c7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:37:04.686159 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.auth.core [None req-d4b60e01-1eca-4132-8225-3f0ab5d23c7a None None] MFA Rules not processed for user `2be990a66857410a87ffa7609aec4f7b`. Rule list: `[]` (Enabled: `True`). {{(pid=282899) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 08:37:04.687759 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.fernet_utils [None req-d4b60e01-1eca-4132-8225-3f0ab5d23c7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=282899) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:37:04.715739 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG dbcounter [-] [282899] Writing DB stats keystone:SELECT=100 {{(pid=282899) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:37:04.723356 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4021b15c-f8de-4210-bd23-0e2aa28a84f6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:37:04.724900 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4021b15c-f8de-4210-bd23-0e2aa28a84f6 None admin] RBAC: Authorization granted {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:37:04.744298 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG dbcounter [-] [282898] Writing DB stats keystone:SELECT=100 {{(pid=282898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:37:04.767345 dv-cinder-851351-1-smb devstack@keystone.service[282899]: [pid: 282899|app: 0|req: 310/622] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 08:37:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 08:37:04.768607 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b60e01-1eca-4132-8225-3f0ab5d23c7a None None] Authenticating user token {{(pid=282899) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:37:04.843233 dv-cinder-851351-1-smb devstack@keystone.service[282898]: [pid: 282898|app: 0|req: 313/623] 10.222.0.42 () {58 vars in 1282 bytes} [Thu Jul 28 08:37:04 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 361 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 28 08:37:04.848196 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4021b15c-f8de-4210-bd23-0e2aa28a84f6 None admin] Authenticating user token {{(pid=282898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:37:04.886633 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b60e01-1eca-4132-8225-3f0ab5d23c7a None None] Validating token access rules against request {{(pid=282899) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:37:04.927694 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6c7ca4-cce9-4138-969e-54dba592eedb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282899) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:37:04.928752 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6c7ca4-cce9-4138-969e-54dba592eedb None admin] REQUEST_METHOD: `GET` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:37:04.929252 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6c7ca4-cce9-4138-969e-54dba592eedb None admin] SCRIPT_NAME: `/identity` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:37:04.929711 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6c7ca4-cce9-4138-969e-54dba592eedb None admin] PATH_INFO: `/v3/domains` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:37:04.930597 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad6c7ca4-cce9-4138-969e-54dba592eedb None admin] RBAC: Adding query filter params (name=Default) {{(pid=282899) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:37:04.931074 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad6c7ca4-cce9-4138-969e-54dba592eedb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:37:04.932643 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad6c7ca4-cce9-4138-969e-54dba592eedb None admin] RBAC: Authorization granted {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:37:04.950378 dv-cinder-851351-1-smb devstack@keystone.service[282899]: [pid: 282899|app: 0|req: 311/624] 10.222.0.42 () {56 vars in 1109 bytes} [Thu Jul 28 08:37:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:37:04.951587 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6c7ca4-cce9-4138-969e-54dba592eedb None admin] Authenticating user token {{(pid=282899) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:37:04.956657 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4021b15c-f8de-4210-bd23-0e2aa28a84f6 None admin] Validating token access rules against request {{(pid=282898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:37:04.975824 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG dbcounter [-] [282898] Writing DB stats keystone:SELECT=100 {{(pid=282898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:37:04.977091 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG dbcounter [-] [282899] Writing DB stats keystone:SELECT=100 {{(pid=282899) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:37:04.996808 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baef4dfd-c09d-4601-ba32-15d974980b57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:37:04.997470 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baef4dfd-c09d-4601-ba32-15d974980b57 None admin] REQUEST_METHOD: `GET` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:37:04.997755 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baef4dfd-c09d-4601-ba32-15d974980b57 None admin] SCRIPT_NAME: `/identity` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:37:04.998043 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baef4dfd-c09d-4601-ba32-15d974980b57 None admin] PATH_INFO: `/v3/roles/service` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:37:05.009920 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baef4dfd-c09d-4601-ba32-15d974980b57 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 08:37:05.015012 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application [None req-baef4dfd-c09d-4601-ba32-15d974980b57 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 28 08:37:05.015012 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:37:05.015012 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:37:05.015012 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:37:05.015012 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:37:05.015012 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:37:05.015012 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:37:05.015012 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:37:05.015012 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:37:05.015012 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:37:05.015012 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:37:05.015012 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:37:05.015012 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 08:37:05.015012 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 08:37:05.015012 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 08:37:05.015012 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 08:37:05.016308 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 08:37:05.016308 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 08:37:05.016308 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 08:37:05.016308 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 08:37:05.016308 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:37:05.016308 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:37:05.016308 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:37:05.016308 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:37:05.016308 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:37:05.016308 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:37:05.016308 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:37:05.016308 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application with Lock( Jul 28 08:37:05.016308 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:37:05.016308 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:37:05.016308 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:37:05.016308 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:37:05.017330 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:37:05.017330 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:37:05.017330 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:37:05.017330 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:37:05.017330 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 08:37:05.017330 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 08:37:05.017330 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 08:37:05.017330 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 08:37:05.017330 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 08:37:05.017330 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 08:37:05.017330 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 28 08:37:05.017330 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application Jul 28 08:37:05.017330 dv-cinder-851351-1-smb devstack@keystone.service[282898]: [pid: 282898|app: 0|req: 314/625] 10.222.0.42 () {56 vars in 1102 bytes} [Thu Jul 28 08:37:04 2022] GET /identity/v3/roles/service => generated 85 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:37:05.018151 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baef4dfd-c09d-4601-ba32-15d974980b57 None admin] Authenticating user token {{(pid=282898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:37:05.068096 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6c7ca4-cce9-4138-969e-54dba592eedb None admin] Validating token access rules against request {{(pid=282899) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:37:05.106668 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565be784-383d-41a5-a3c0-79522d2854b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282899) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:37:05.107931 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565be784-383d-41a5-a3c0-79522d2854b7 None admin] REQUEST_METHOD: `GET` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:37:05.108402 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565be784-383d-41a5-a3c0-79522d2854b7 None admin] SCRIPT_NAME: `/identity` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:37:05.109001 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565be784-383d-41a5-a3c0-79522d2854b7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:37:05.124128 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-565be784-383d-41a5-a3c0-79522d2854b7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:37:05.125395 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baef4dfd-c09d-4601-ba32-15d974980b57 None admin] Validating token access rules against request {{(pid=282898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:37:05.126141 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-565be784-383d-41a5-a3c0-79522d2854b7 None admin] RBAC: Authorization granted {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:37:05.145669 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application [None req-565be784-383d-41a5-a3c0-79522d2854b7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 08:37:05.145669 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:37:05.145669 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:37:05.145669 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:37:05.145669 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:37:05.145669 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:37:05.145669 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:37:05.145669 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:37:05.145669 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:37:05.145669 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:37:05.145669 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:37:05.145669 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:37:05.145669 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 08:37:05.145669 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 08:37:05.145669 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 08:37:05.146935 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 08:37:05.146935 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:37:05.146935 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:37:05.146935 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:37:05.146935 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:37:05.146935 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:37:05.146935 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:37:05.146935 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:37:05.146935 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application with Lock( Jul 28 08:37:05.146935 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:37:05.146935 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:37:05.146935 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:37:05.146935 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:37:05.146935 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:37:05.146935 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:37:05.146935 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:37:05.146935 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:37:05.148174 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 08:37:05.148174 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 08:37:05.148174 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 08:37:05.148174 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application Jul 28 08:37:05.155190 dv-cinder-851351-1-smb devstack@keystone.service[282899]: [pid: 282899|app: 0|req: 312/626] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 08:37:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:37:05.155190 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565be784-383d-41a5-a3c0-79522d2854b7 None admin] Authenticating user token {{(pid=282899) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:37:05.174796 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb72808-fba9-4706-9a92-d5a42704e6a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:37:05.176644 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb72808-fba9-4706-9a92-d5a42704e6a8 None admin] REQUEST_METHOD: `GET` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:37:05.177215 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb72808-fba9-4706-9a92-d5a42704e6a8 None admin] SCRIPT_NAME: `/identity` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:37:05.177712 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb72808-fba9-4706-9a92-d5a42704e6a8 None admin] PATH_INFO: `/v3/users/swift` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:37:05.189633 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdb72808-fba9-4706-9a92-d5a42704e6a8 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:37:05.191856 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdb72808-fba9-4706-9a92-d5a42704e6a8 None admin] RBAC: Authorization granted {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:37:05.209706 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application [None req-cdb72808-fba9-4706-9a92-d5a42704e6a8 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 28 08:37:05.209706 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:37:05.209706 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:37:05.209706 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:37:05.209706 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:37:05.209706 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:37:05.209706 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:37:05.209706 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:37:05.209706 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:37:05.209706 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:37:05.209706 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:37:05.209706 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:37:05.209706 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 28 08:37:05.209706 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 28 08:37:05.209706 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 28 08:37:05.209706 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 28 08:37:05.210842 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:37:05.210842 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:37:05.210842 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 28 08:37:05.210842 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 08:37:05.210842 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 28 08:37:05.210842 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 08:37:05.210842 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:37:05.210842 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:37:05.210842 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:37:05.210842 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:37:05.210842 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:37:05.210842 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application with Lock( Jul 28 08:37:05.210842 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:37:05.210842 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:37:05.210842 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:37:05.210842 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:37:05.210842 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:37:05.210842 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:37:05.211984 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:37:05.211984 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:37:05.211984 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 28 08:37:05.211984 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 28 08:37:05.211984 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 28 08:37:05.211984 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 28 08:37:05.211984 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 28 08:37:05.211984 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 28 08:37:05.211984 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 28 08:37:05.211984 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application Jul 28 08:37:05.219483 dv-cinder-851351-1-smb devstack@keystone.service[282898]: [pid: 282898|app: 0|req: 315/627] 10.222.0.42 () {56 vars in 1096 bytes} [Thu Jul 28 08:37:05 2022] GET /identity/v3/users/swift => generated 83 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:37:05.219483 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb72808-fba9-4706-9a92-d5a42704e6a8 None admin] Authenticating user token {{(pid=282898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:37:05.249046 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG dbcounter [-] [282899] Writing DB stats keystone:SELECT=100 {{(pid=282899) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:37:05.265894 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG dbcounter [-] [282898] Writing DB stats keystone:SELECT=100 {{(pid=282898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:37:05.294490 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565be784-383d-41a5-a3c0-79522d2854b7 None admin] Validating token access rules against request {{(pid=282899) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:37:05.340977 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1e3010-a087-4b07-bac2-febb1ababd35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282899) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:37:05.341382 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1e3010-a087-4b07-bac2-febb1ababd35 None admin] REQUEST_METHOD: `GET` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:37:05.341674 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1e3010-a087-4b07-bac2-febb1ababd35 None admin] SCRIPT_NAME: `/identity` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:37:05.341978 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1e3010-a087-4b07-bac2-febb1ababd35 None admin] PATH_INFO: `/v3/roles` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:37:05.342713 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e1e3010-a087-4b07-bac2-febb1ababd35 None admin] RBAC: Adding query filter params (name=service) {{(pid=282899) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:37:05.343032 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e1e3010-a087-4b07-bac2-febb1ababd35 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:37:05.344495 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e1e3010-a087-4b07-bac2-febb1ababd35 None admin] RBAC: Authorization granted {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:37:05.345969 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb72808-fba9-4706-9a92-d5a42704e6a8 None admin] Validating token access rules against request {{(pid=282898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:37:05.354977 dv-cinder-851351-1-smb devstack@keystone.service[282899]: [pid: 282899|app: 0|req: 313/628] 10.222.0.42 () {56 vars in 1103 bytes} [Thu Jul 28 08:37:05 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:37:05.355901 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1e3010-a087-4b07-bac2-febb1ababd35 None admin] Authenticating user token {{(pid=282899) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:37:05.391152 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c061f69-2ac9-4a51-8095-2ac850ec477d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:37:05.391734 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c061f69-2ac9-4a51-8095-2ac850ec477d None admin] REQUEST_METHOD: `GET` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:37:05.392028 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c061f69-2ac9-4a51-8095-2ac850ec477d None admin] SCRIPT_NAME: `/identity` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:37:05.392332 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c061f69-2ac9-4a51-8095-2ac850ec477d None admin] PATH_INFO: `/v3/domains` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:37:05.393093 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c061f69-2ac9-4a51-8095-2ac850ec477d None admin] RBAC: Adding query filter params (name=Default) {{(pid=282898) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:37:05.393486 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c061f69-2ac9-4a51-8095-2ac850ec477d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:37:05.394979 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c061f69-2ac9-4a51-8095-2ac850ec477d None admin] RBAC: Authorization granted {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:37:05.413513 dv-cinder-851351-1-smb devstack@keystone.service[282898]: [pid: 282898|app: 0|req: 316/629] 10.222.0.42 () {56 vars in 1109 bytes} [Thu Jul 28 08:37:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:37:05.413513 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c061f69-2ac9-4a51-8095-2ac850ec477d None admin] Authenticating user token {{(pid=282898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:37:05.500301 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1e3010-a087-4b07-bac2-febb1ababd35 None admin] Validating token access rules against request {{(pid=282899) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:37:05.539690 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG dbcounter [-] [282898] Writing DB stats keystone:SELECT=100 {{(pid=282898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:37:05.545110 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c061f69-2ac9-4a51-8095-2ac850ec477d None admin] Validating token access rules against request {{(pid=282898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:37:05.553388 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b82ed17-9b80-412b-82c2-de4c9fdf0c7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282899) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:37:05.554363 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b82ed17-9b80-412b-82c2-de4c9fdf0c7d None admin] REQUEST_METHOD: `GET` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:37:05.554827 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b82ed17-9b80-412b-82c2-de4c9fdf0c7d None admin] SCRIPT_NAME: `/identity` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:37:05.555260 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b82ed17-9b80-412b-82c2-de4c9fdf0c7d None admin] PATH_INFO: `/v3/users` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:37:05.556566 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b82ed17-9b80-412b-82c2-de4c9fdf0c7d None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=282899) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:37:05.557098 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b82ed17-9b80-412b-82c2-de4c9fdf0c7d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:37:05.559802 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b82ed17-9b80-412b-82c2-de4c9fdf0c7d None admin] RBAC: Authorization granted {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:37:05.562997 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG dbcounter [-] [282899] Writing DB stats keystone:SELECT=100 {{(pid=282899) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:37:05.592383 dv-cinder-851351-1-smb devstack@keystone.service[282899]: [pid: 282899|app: 0|req: 314/630] 10.222.0.42 () {56 vars in 1135 bytes} [Thu Jul 28 08:37:05 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:37:05.592383 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b82ed17-9b80-412b-82c2-de4c9fdf0c7d None admin] Authenticating user token {{(pid=282899) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:37:05.597030 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbff3d8f-c2f1-48b2-bde7-eaf3b7f5c7db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:37:05.597993 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbff3d8f-c2f1-48b2-bde7-eaf3b7f5c7db None admin] REQUEST_METHOD: `GET` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:37:05.598517 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbff3d8f-c2f1-48b2-bde7-eaf3b7f5c7db None admin] SCRIPT_NAME: `/identity` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:37:05.599017 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbff3d8f-c2f1-48b2-bde7-eaf3b7f5c7db None admin] PATH_INFO: `/v3/domains/Default` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:37:05.613788 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbff3d8f-c2f1-48b2-bde7-eaf3b7f5c7db None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:37:05.615959 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbff3d8f-c2f1-48b2-bde7-eaf3b7f5c7db None admin] RBAC: Authorization granted {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:37:05.637009 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application [None req-fbff3d8f-c2f1-48b2-bde7-eaf3b7f5c7db None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 08:37:05.637009 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:37:05.637009 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:37:05.637009 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:37:05.637009 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:37:05.637009 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:37:05.637009 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:37:05.637009 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:37:05.637009 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:37:05.637009 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:37:05.637009 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:37:05.637009 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:37:05.637009 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 08:37:05.637009 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 08:37:05.637009 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 08:37:05.638105 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 08:37:05.638105 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:37:05.638105 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:37:05.638105 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:37:05.638105 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:37:05.638105 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:37:05.638105 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:37:05.638105 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:37:05.638105 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application with Lock( Jul 28 08:37:05.638105 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:37:05.638105 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:37:05.638105 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:37:05.638105 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:37:05.638105 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:37:05.638105 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:37:05.638105 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:37:05.638105 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:37:05.639129 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 08:37:05.639129 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 08:37:05.639129 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 08:37:05.639129 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application Jul 28 08:37:05.642598 dv-cinder-851351-1-smb devstack@keystone.service[282898]: [pid: 282898|app: 0|req: 317/631] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 08:37:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:37:05.643704 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbff3d8f-c2f1-48b2-bde7-eaf3b7f5c7db None admin] Authenticating user token {{(pid=282898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:37:05.726713 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b82ed17-9b80-412b-82c2-de4c9fdf0c7d None admin] Validating token access rules against request {{(pid=282899) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:37:05.779390 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb3c2c2-5616-4abf-a2a4-255e4f7b8c8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282899) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:37:05.780060 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb3c2c2-5616-4abf-a2a4-255e4f7b8c8b None admin] REQUEST_METHOD: `GET` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:37:05.780346 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb3c2c2-5616-4abf-a2a4-255e4f7b8c8b None admin] SCRIPT_NAME: `/identity` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:37:05.780632 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb3c2c2-5616-4abf-a2a4-255e4f7b8c8b None admin] PATH_INFO: `/v3/projects/service` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:37:05.787905 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eb3c2c2-5616-4abf-a2a4-255e4f7b8c8b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:37:05.789493 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eb3c2c2-5616-4abf-a2a4-255e4f7b8c8b None admin] RBAC: Authorization granted {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:37:05.802753 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application [None req-2eb3c2c2-5616-4abf-a2a4-255e4f7b8c8b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 08:37:05.802753 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:37:05.802753 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:37:05.802753 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:37:05.802753 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:37:05.802753 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:37:05.802753 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:37:05.802753 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:37:05.802753 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:37:05.802753 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:37:05.802753 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:37:05.802753 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:37:05.802753 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 28 08:37:05.802753 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 28 08:37:05.802753 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 28 08:37:05.809334 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 28 08:37:05.809334 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:37:05.809334 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:37:05.809334 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:37:05.809334 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:37:05.809334 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:37:05.809334 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:37:05.809334 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:37:05.809334 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application with Lock( Jul 28 08:37:05.809334 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:37:05.809334 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:37:05.809334 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:37:05.809334 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:37:05.809334 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:37:05.809334 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:37:05.809334 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:37:05.809334 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:37:05.810583 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 28 08:37:05.810583 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 28 08:37:05.810583 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 28 08:37:05.810583 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 28 08:37:05.810583 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 28 08:37:05.810583 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 28 08:37:05.810583 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 08:37:05.810583 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application Jul 28 08:37:05.810583 dv-cinder-851351-1-smb devstack@keystone.service[282899]: [pid: 282899|app: 0|req: 315/632] 10.222.0.42 () {56 vars in 1111 bytes} [Thu Jul 28 08:37:05 2022] GET /identity/v3/projects/service => generated 88 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:37:05.810583 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb3c2c2-5616-4abf-a2a4-255e4f7b8c8b None admin] Authenticating user token {{(pid=282899) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:37:05.821182 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbff3d8f-c2f1-48b2-bde7-eaf3b7f5c7db None admin] Validating token access rules against request {{(pid=282898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:37:05.861520 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595c8682-332c-46f5-9f7a-65bf42c83d73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:37:05.862340 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595c8682-332c-46f5-9f7a-65bf42c83d73 None admin] REQUEST_METHOD: `GET` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:37:05.862620 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595c8682-332c-46f5-9f7a-65bf42c83d73 None admin] SCRIPT_NAME: `/identity` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:37:05.862891 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595c8682-332c-46f5-9f7a-65bf42c83d73 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:37:05.875794 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-595c8682-332c-46f5-9f7a-65bf42c83d73 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:37:05.877375 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-595c8682-332c-46f5-9f7a-65bf42c83d73 None admin] RBAC: Authorization granted {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:37:05.894391 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application [None req-595c8682-332c-46f5-9f7a-65bf42c83d73 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 08:37:05.894391 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:37:05.894391 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:37:05.894391 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:37:05.894391 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:37:05.894391 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:37:05.894391 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:37:05.894391 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:37:05.894391 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:37:05.894391 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:37:05.894391 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:37:05.894391 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:37:05.894391 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 08:37:05.894391 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 08:37:05.894391 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 08:37:05.895681 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 08:37:05.895681 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:37:05.895681 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:37:05.895681 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:37:05.895681 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:37:05.895681 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:37:05.895681 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:37:05.895681 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:37:05.895681 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application with Lock( Jul 28 08:37:05.895681 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:37:05.895681 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:37:05.895681 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:37:05.895681 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:37:05.895681 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:37:05.895681 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:37:05.895681 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:37:05.895681 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:37:05.897094 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 08:37:05.897094 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 08:37:05.897094 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 08:37:05.897094 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application Jul 28 08:37:05.900624 dv-cinder-851351-1-smb devstack@keystone.service[282898]: [pid: 282898|app: 0|req: 318/633] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 08:37:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 257 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:37:05.902085 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746cf6b6-2cba-4f90-a257-65d1af0be781 None None] REQUEST_METHOD: `GET` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:37:05.902406 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746cf6b6-2cba-4f90-a257-65d1af0be781 None None] SCRIPT_NAME: `/identity` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:37:05.902684 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746cf6b6-2cba-4f90-a257-65d1af0be781 None None] PATH_INFO: `/` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:37:05.908986 dv-cinder-851351-1-smb devstack@keystone.service[282898]: [pid: 282898|app: 0|req: 319/634] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 08:37:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 08:37:05.908986 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746cf6b6-2cba-4f90-a257-65d1af0be781 None None] Authenticating user token {{(pid=282898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:37:05.912651 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG dbcounter [-] [282898] Writing DB stats keystone:SELECT=100 {{(pid=282898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:37:05.994677 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG dbcounter [-] [282899] Writing DB stats keystone:SELECT=100 {{(pid=282899) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:37:06.030062 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746cf6b6-2cba-4f90-a257-65d1af0be781 None None] Validating token access rules against request {{(pid=282898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:37:06.049407 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb3c2c2-5616-4abf-a2a4-255e4f7b8c8b None admin] Validating token access rules against request {{(pid=282899) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:37:06.067355 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac52eb6-c7c2-46ab-8ca4-3c6e8a4618a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:37:06.067988 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac52eb6-c7c2-46ab-8ca4-3c6e8a4618a5 None admin] REQUEST_METHOD: `GET` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:37:06.068266 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac52eb6-c7c2-46ab-8ca4-3c6e8a4618a5 None admin] SCRIPT_NAME: `/identity` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:37:06.068543 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac52eb6-c7c2-46ab-8ca4-3c6e8a4618a5 None admin] PATH_INFO: `/v3/projects` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:37:06.069355 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ac52eb6-c7c2-46ab-8ca4-3c6e8a4618a5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=282898) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:37:06.069660 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ac52eb6-c7c2-46ab-8ca4-3c6e8a4618a5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:37:06.071221 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ac52eb6-c7c2-46ab-8ca4-3c6e8a4618a5 None admin] RBAC: Authorization granted {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:37:06.090536 dv-cinder-851351-1-smb devstack@keystone.service[282898]: [pid: 282898|app: 0|req: 320/635] 10.222.0.42 () {56 vars in 1148 bytes} [Thu Jul 28 08:37:05 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:37:06.090536 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac52eb6-c7c2-46ab-8ca4-3c6e8a4618a5 None admin] Authenticating user token {{(pid=282898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:37:06.094058 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501130dd-e640-4501-b975-f9f024d8cc6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282899) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:37:06.095705 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501130dd-e640-4501-b975-f9f024d8cc6f None admin] REQUEST_METHOD: `GET` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:37:06.096016 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501130dd-e640-4501-b975-f9f024d8cc6f None admin] SCRIPT_NAME: `/identity` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:37:06.096358 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501130dd-e640-4501-b975-f9f024d8cc6f None admin] PATH_INFO: `/v3/domains` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:37:06.097151 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-501130dd-e640-4501-b975-f9f024d8cc6f None admin] RBAC: Adding query filter params (name=Default) {{(pid=282899) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:37:06.097437 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-501130dd-e640-4501-b975-f9f024d8cc6f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:37:06.098901 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-501130dd-e640-4501-b975-f9f024d8cc6f None admin] RBAC: Authorization granted {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:37:06.116751 dv-cinder-851351-1-smb devstack@keystone.service[282899]: [pid: 282899|app: 0|req: 316/636] 10.222.0.42 () {56 vars in 1109 bytes} [Thu Jul 28 08:37:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 308 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:37:06.116751 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2944d3fc-67b1-4e4f-9ee1-314a5e0cc0c3 None None] REQUEST_METHOD: `POST` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:37:06.116751 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2944d3fc-67b1-4e4f-9ee1-314a5e0cc0c3 None None] SCRIPT_NAME: `/identity` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:37:06.116751 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2944d3fc-67b1-4e4f-9ee1-314a5e0cc0c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:37:06.135140 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.auth.core [None req-2944d3fc-67b1-4e4f-9ee1-314a5e0cc0c3 None None] MFA Rules not processed for user `2be990a66857410a87ffa7609aec4f7b`. Rule list: `[]` (Enabled: `True`). {{(pid=282899) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 08:37:06.136373 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.fernet_utils [None req-2944d3fc-67b1-4e4f-9ee1-314a5e0cc0c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=282899) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:37:06.174062 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG dbcounter [-] [282898] Writing DB stats keystone:SELECT=100 {{(pid=282898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:37:06.211705 dv-cinder-851351-1-smb devstack@keystone.service[282899]: [pid: 282899|app: 0|req: 317/637] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 08:37:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 08:37:06.212568 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2944d3fc-67b1-4e4f-9ee1-314a5e0cc0c3 None None] Authenticating user token {{(pid=282899) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:37:06.229112 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac52eb6-c7c2-46ab-8ca4-3c6e8a4618a5 None admin] Validating token access rules against request {{(pid=282898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:37:06.263922 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG dbcounter [-] [282899] Writing DB stats keystone:SELECT=100 {{(pid=282899) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:37:06.267288 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82cdd724-3cf6-422a-b3fe-8232d2b80f20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:37:06.267932 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82cdd724-3cf6-422a-b3fe-8232d2b80f20 None admin] REQUEST_METHOD: `GET` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:37:06.268327 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82cdd724-3cf6-422a-b3fe-8232d2b80f20 None admin] SCRIPT_NAME: `/identity` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:37:06.268860 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82cdd724-3cf6-422a-b3fe-8232d2b80f20 None admin] PATH_INFO: `/v3/domains` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:37:06.270111 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82cdd724-3cf6-422a-b3fe-8232d2b80f20 None admin] RBAC: Adding query filter params (name=Default) {{(pid=282898) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:37:06.270410 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82cdd724-3cf6-422a-b3fe-8232d2b80f20 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:37:06.271806 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82cdd724-3cf6-422a-b3fe-8232d2b80f20 None admin] RBAC: Authorization granted {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:37:06.283277 dv-cinder-851351-1-smb devstack@keystone.service[282898]: [pid: 282898|app: 0|req: 321/638] 10.222.0.42 () {56 vars in 1109 bytes} [Thu Jul 28 08:37:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:37:06.284121 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82cdd724-3cf6-422a-b3fe-8232d2b80f20 None admin] Authenticating user token {{(pid=282898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:37:06.324240 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2944d3fc-67b1-4e4f-9ee1-314a5e0cc0c3 None None] Validating token access rules against request {{(pid=282899) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:37:06.358691 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eabc08c-0896-4143-a194-38e99e03b362 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282899) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:37:06.359328 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eabc08c-0896-4143-a194-38e99e03b362 None admin] REQUEST_METHOD: `GET` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:37:06.359612 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eabc08c-0896-4143-a194-38e99e03b362 None admin] SCRIPT_NAME: `/identity` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:37:06.359894 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eabc08c-0896-4143-a194-38e99e03b362 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:37:06.360707 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eabc08c-0896-4143-a194-38e99e03b362 None admin] RBAC: Adding query filter params (role.id=aa4daecf3ff74fa1b7d53041a4659723, scope.project.id=5cde68cbfb9042dc9f36af3aacea2473, user.id=5e192fe026ef4f109b9a1099815c5926) {{(pid=282899) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:37:06.361025 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eabc08c-0896-4143-a194-38e99e03b362 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:37:06.362531 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eabc08c-0896-4143-a194-38e99e03b362 None admin] RBAC: Authorization granted {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:37:06.368534 dv-cinder-851351-1-smb devstack@keystone.service[282899]: [pid: 282899|app: 0|req: 318/639] 10.222.0.42 () {56 vars in 1374 bytes} [Thu Jul 28 08:37:06 2022] GET /identity/v3/role_assignments?user.id=5e192fe026ef4f109b9a1099815c5926&scope.project.id=5cde68cbfb9042dc9f36af3aacea2473&role.id=aa4daecf3ff74fa1b7d53041a4659723 => generated 608 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:37:06.369187 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eabc08c-0896-4143-a194-38e99e03b362 None admin] Authenticating user token {{(pid=282899) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:37:06.402981 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82cdd724-3cf6-422a-b3fe-8232d2b80f20 None admin] Validating token access rules against request {{(pid=282898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:37:06.430769 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG dbcounter [-] [282898] Writing DB stats keystone:SELECT=100 {{(pid=282898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:37:06.443743 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-009578df-a1fc-436a-b83c-07fcf6fff29e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:37:06.444424 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009578df-a1fc-436a-b83c-07fcf6fff29e None admin] REQUEST_METHOD: `GET` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:37:06.444734 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009578df-a1fc-436a-b83c-07fcf6fff29e None admin] SCRIPT_NAME: `/identity` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:37:06.445012 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009578df-a1fc-436a-b83c-07fcf6fff29e None admin] PATH_INFO: `/v3/users/cinder` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:37:06.453939 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-009578df-a1fc-436a-b83c-07fcf6fff29e None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:37:06.455898 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-009578df-a1fc-436a-b83c-07fcf6fff29e None admin] RBAC: Authorization granted {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:37:06.470456 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application [None req-009578df-a1fc-436a-b83c-07fcf6fff29e None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jul 28 08:37:06.470456 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:37:06.470456 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:37:06.470456 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:37:06.470456 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:37:06.470456 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:37:06.470456 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:37:06.470456 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:37:06.470456 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:37:06.470456 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:37:06.470456 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:37:06.470456 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:37:06.470456 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 28 08:37:06.470456 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 28 08:37:06.470456 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 28 08:37:06.470456 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 28 08:37:06.471890 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:37:06.471890 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:37:06.471890 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 28 08:37:06.471890 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 08:37:06.471890 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 28 08:37:06.471890 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 08:37:06.471890 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:37:06.471890 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:37:06.471890 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:37:06.471890 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:37:06.471890 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:37:06.471890 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application with Lock( Jul 28 08:37:06.471890 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:37:06.471890 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:37:06.471890 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:37:06.471890 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:37:06.471890 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:37:06.471890 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:37:06.473061 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:37:06.473061 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:37:06.473061 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 28 08:37:06.473061 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 28 08:37:06.473061 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 28 08:37:06.473061 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 28 08:37:06.473061 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 28 08:37:06.473061 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 28 08:37:06.473061 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jul 28 08:37:06.473061 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application Jul 28 08:37:06.473061 dv-cinder-851351-1-smb devstack@keystone.service[282898]: [pid: 282898|app: 0|req: 322/640] 10.222.0.42 () {56 vars in 1099 bytes} [Thu Jul 28 08:37:06 2022] GET /identity/v3/users/cinder => generated 84 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:37:06.473763 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c895518-f81a-47e2-8252-241294133f9c None None] REQUEST_METHOD: `GET` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:37:06.473763 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c895518-f81a-47e2-8252-241294133f9c None None] SCRIPT_NAME: `/identity` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:37:06.474014 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c895518-f81a-47e2-8252-241294133f9c None None] PATH_INFO: `/` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:37:06.475748 dv-cinder-851351-1-smb devstack@keystone.service[282898]: [pid: 282898|app: 0|req: 323/641] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 08:37:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 08:37:06.480691 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c895518-f81a-47e2-8252-241294133f9c None None] Authenticating user token {{(pid=282898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:37:06.495970 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eabc08c-0896-4143-a194-38e99e03b362 None admin] Validating token access rules against request {{(pid=282899) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:37:06.505067 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG dbcounter [-] [282899] Writing DB stats keystone:SELECT=100 {{(pid=282899) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:37:06.541262 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bccbfff9-379a-41d8-aed5-aecf0099706f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282899) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:37:06.541917 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bccbfff9-379a-41d8-aed5-aecf0099706f None admin] REQUEST_METHOD: `GET` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:37:06.542203 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bccbfff9-379a-41d8-aed5-aecf0099706f None admin] SCRIPT_NAME: `/identity` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:37:06.542481 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bccbfff9-379a-41d8-aed5-aecf0099706f None admin] PATH_INFO: `/v3/roles/service` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:37:06.559382 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bccbfff9-379a-41d8-aed5-aecf0099706f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 08:37:06.564867 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application [None req-bccbfff9-379a-41d8-aed5-aecf0099706f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 28 08:37:06.564867 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:37:06.564867 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:37:06.564867 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:37:06.564867 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:37:06.564867 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:37:06.564867 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:37:06.564867 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:37:06.564867 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:37:06.564867 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:37:06.564867 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:37:06.564867 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:37:06.564867 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 08:37:06.564867 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 08:37:06.564867 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 08:37:06.564867 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 08:37:06.566651 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 08:37:06.566651 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 08:37:06.566651 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 08:37:06.566651 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 08:37:06.566651 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:37:06.566651 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:37:06.566651 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:37:06.566651 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:37:06.566651 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:37:06.566651 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:37:06.566651 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:37:06.566651 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application with Lock( Jul 28 08:37:06.566651 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:37:06.566651 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:37:06.566651 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:37:06.566651 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:37:06.567925 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:37:06.567925 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:37:06.567925 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:37:06.567925 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:37:06.567925 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 08:37:06.567925 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 08:37:06.567925 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 08:37:06.567925 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 08:37:06.567925 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 08:37:06.567925 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 08:37:06.567925 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 28 08:37:06.567925 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application Jul 28 08:37:06.567925 dv-cinder-851351-1-smb devstack@keystone.service[282899]: [pid: 282899|app: 0|req: 319/642] 10.222.0.42 () {56 vars in 1102 bytes} [Thu Jul 28 08:37:06 2022] GET /identity/v3/roles/service => generated 85 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:37:06.567925 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bccbfff9-379a-41d8-aed5-aecf0099706f None admin] Authenticating user token {{(pid=282899) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:37:06.611356 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c895518-f81a-47e2-8252-241294133f9c None None] Validating token access rules against request {{(pid=282898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:37:06.648683 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2ec5ea-fbbc-498b-b8a2-b002d522b155 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:37:06.649391 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2ec5ea-fbbc-498b-b8a2-b002d522b155 None admin] REQUEST_METHOD: `GET` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:37:06.649680 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2ec5ea-fbbc-498b-b8a2-b002d522b155 None admin] SCRIPT_NAME: `/identity` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:37:06.650021 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2ec5ea-fbbc-498b-b8a2-b002d522b155 None admin] PATH_INFO: `/v3/projects/service` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:37:06.658099 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c2ec5ea-fbbc-498b-b8a2-b002d522b155 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:37:06.659657 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c2ec5ea-fbbc-498b-b8a2-b002d522b155 None admin] RBAC: Authorization granted {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:37:06.672367 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application [None req-5c2ec5ea-fbbc-498b-b8a2-b002d522b155 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 08:37:06.672367 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:37:06.672367 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:37:06.672367 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:37:06.672367 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:37:06.672367 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:37:06.672367 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:37:06.672367 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:37:06.672367 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:37:06.672367 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:37:06.672367 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:37:06.672367 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:37:06.672367 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 28 08:37:06.672367 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 28 08:37:06.672367 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 28 08:37:06.673806 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 28 08:37:06.673806 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:37:06.673806 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:37:06.673806 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:37:06.673806 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:37:06.673806 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:37:06.673806 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:37:06.673806 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:37:06.673806 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application with Lock( Jul 28 08:37:06.673806 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:37:06.673806 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:37:06.673806 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:37:06.673806 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:37:06.673806 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:37:06.673806 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:37:06.673806 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:37:06.673806 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:37:06.675012 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 28 08:37:06.675012 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 28 08:37:06.675012 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 28 08:37:06.675012 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 28 08:37:06.675012 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 28 08:37:06.675012 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 28 08:37:06.675012 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 08:37:06.675012 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application Jul 28 08:37:06.675012 dv-cinder-851351-1-smb devstack@keystone.service[282898]: [pid: 282898|app: 0|req: 324/643] 10.222.0.42 () {56 vars in 1111 bytes} [Thu Jul 28 08:37:06 2022] GET /identity/v3/projects/service => generated 88 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:37:06.675012 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9220765d-6bfc-4105-8077-05cb63c6052d None None] REQUEST_METHOD: `POST` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:37:06.675735 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9220765d-6bfc-4105-8077-05cb63c6052d None None] SCRIPT_NAME: `/identity` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:37:06.675735 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9220765d-6bfc-4105-8077-05cb63c6052d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:37:06.681565 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bccbfff9-379a-41d8-aed5-aecf0099706f None admin] Validating token access rules against request {{(pid=282899) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:37:06.694647 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.auth.core [None req-9220765d-6bfc-4105-8077-05cb63c6052d None None] MFA Rules not processed for user `2be990a66857410a87ffa7609aec4f7b`. Rule list: `[]` (Enabled: `True`). {{(pid=282898) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 08:37:06.695998 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.fernet_utils [None req-9220765d-6bfc-4105-8077-05cb63c6052d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=282898) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:37:06.720482 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac549dfa-0f8f-48a8-9909-e20f6f636c66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282899) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:37:06.721181 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac549dfa-0f8f-48a8-9909-e20f6f636c66 None admin] REQUEST_METHOD: `GET` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:37:06.721494 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac549dfa-0f8f-48a8-9909-e20f6f636c66 None admin] SCRIPT_NAME: `/identity` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:37:06.721764 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac549dfa-0f8f-48a8-9909-e20f6f636c66 None admin] PATH_INFO: `/v3/users` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:37:06.722578 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac549dfa-0f8f-48a8-9909-e20f6f636c66 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=282899) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:37:06.722895 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac549dfa-0f8f-48a8-9909-e20f6f636c66 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:37:06.724370 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac549dfa-0f8f-48a8-9909-e20f6f636c66 None admin] RBAC: Authorization granted {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:37:06.742770 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG dbcounter [-] [282898] Writing DB stats keystone:SELECT=100 {{(pid=282898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:37:06.751035 dv-cinder-851351-1-smb devstack@keystone.service[282899]: [pid: 282899|app: 0|req: 320/644] 10.222.0.42 () {56 vars in 1137 bytes} [Thu Jul 28 08:37:06 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:37:06.751035 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac549dfa-0f8f-48a8-9909-e20f6f636c66 None admin] Authenticating user token {{(pid=282899) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:37:06.779335 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG dbcounter [-] [282899] Writing DB stats keystone:SELECT=100 {{(pid=282899) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:37:06.796780 dv-cinder-851351-1-smb devstack@keystone.service[282898]: [pid: 282898|app: 0|req: 325/645] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 08:37:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 08:37:06.796780 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9220765d-6bfc-4105-8077-05cb63c6052d None None] Authenticating user token {{(pid=282898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:37:06.869406 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac549dfa-0f8f-48a8-9909-e20f6f636c66 None admin] Validating token access rules against request {{(pid=282899) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:37:06.905315 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34258607-4176-4e54-ad5d-3aa630697e76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282899) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:37:06.905954 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34258607-4176-4e54-ad5d-3aa630697e76 None admin] REQUEST_METHOD: `GET` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:37:06.906238 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34258607-4176-4e54-ad5d-3aa630697e76 None admin] SCRIPT_NAME: `/identity` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:37:06.906516 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34258607-4176-4e54-ad5d-3aa630697e76 None admin] PATH_INFO: `/v3/roles` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:37:06.907260 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34258607-4176-4e54-ad5d-3aa630697e76 None admin] RBAC: Adding query filter params (name=service) {{(pid=282899) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:37:06.907570 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34258607-4176-4e54-ad5d-3aa630697e76 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:37:06.907988 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9220765d-6bfc-4105-8077-05cb63c6052d None None] Validating token access rules against request {{(pid=282898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:37:06.909039 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34258607-4176-4e54-ad5d-3aa630697e76 None admin] RBAC: Authorization granted {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:37:06.922300 dv-cinder-851351-1-smb devstack@keystone.service[282899]: [pid: 282899|app: 0|req: 321/646] 10.222.0.42 () {56 vars in 1103 bytes} [Thu Jul 28 08:37:06 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:37:06.922300 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34258607-4176-4e54-ad5d-3aa630697e76 None admin] Authenticating user token {{(pid=282899) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:37:06.944982 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd5846c-84d7-4552-9055-8c6cbae00b88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:37:06.945782 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd5846c-84d7-4552-9055-8c6cbae00b88 None admin] REQUEST_METHOD: `GET` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:37:06.946167 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd5846c-84d7-4552-9055-8c6cbae00b88 None admin] SCRIPT_NAME: `/identity` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:37:06.946520 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd5846c-84d7-4552-9055-8c6cbae00b88 None admin] PATH_INFO: `/v3/projects` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:37:06.947294 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efd5846c-84d7-4552-9055-8c6cbae00b88 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=282898) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:37:06.947608 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efd5846c-84d7-4552-9055-8c6cbae00b88 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:37:06.949098 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efd5846c-84d7-4552-9055-8c6cbae00b88 None admin] RBAC: Authorization granted {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:37:06.962606 dv-cinder-851351-1-smb devstack@keystone.service[282898]: [pid: 282898|app: 0|req: 326/647] 10.222.0.42 () {56 vars in 1148 bytes} [Thu Jul 28 08:37:06 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:37:06.963467 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd5846c-84d7-4552-9055-8c6cbae00b88 None admin] Authenticating user token {{(pid=282898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:37:06.998278 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG dbcounter [-] [282898] Writing DB stats keystone:SELECT=100 {{(pid=282898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:37:07.017185 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG dbcounter [-] [282899] Writing DB stats keystone:SELECT=100 {{(pid=282899) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:37:07.034187 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34258607-4176-4e54-ad5d-3aa630697e76 None admin] Validating token access rules against request {{(pid=282899) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:37:07.070903 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd5846c-84d7-4552-9055-8c6cbae00b88 None admin] Validating token access rules against request {{(pid=282898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:37:07.073157 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8c38af-16e2-4eb1-836e-e6f380f29655 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282899) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:37:07.074101 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8c38af-16e2-4eb1-836e-e6f380f29655 None admin] REQUEST_METHOD: `GET` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:37:07.074256 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8c38af-16e2-4eb1-836e-e6f380f29655 None admin] SCRIPT_NAME: `/identity` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:37:07.074559 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8c38af-16e2-4eb1-836e-e6f380f29655 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:37:07.108885 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a89e7b56-6330-465e-bda9-9cc1aae54667 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:37:07.109548 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89e7b56-6330-465e-bda9-9cc1aae54667 None admin] REQUEST_METHOD: `GET` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:37:07.109835 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89e7b56-6330-465e-bda9-9cc1aae54667 None admin] SCRIPT_NAME: `/identity` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:37:07.110115 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89e7b56-6330-465e-bda9-9cc1aae54667 None admin] PATH_INFO: `/v3/roles/service` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:37:07.123443 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a89e7b56-6330-465e-bda9-9cc1aae54667 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 08:37:07.129108 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application [None req-a89e7b56-6330-465e-bda9-9cc1aae54667 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 28 08:37:07.129108 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:37:07.129108 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:37:07.129108 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:37:07.129108 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:37:07.129108 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:37:07.129108 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:37:07.129108 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:37:07.129108 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:37:07.129108 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:37:07.129108 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:37:07.129108 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:37:07.129108 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 08:37:07.129108 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 08:37:07.129108 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 08:37:07.129108 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 08:37:07.130232 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 08:37:07.130232 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 08:37:07.130232 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 08:37:07.130232 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 08:37:07.130232 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:37:07.130232 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:37:07.130232 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:37:07.130232 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:37:07.130232 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:37:07.130232 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:37:07.130232 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:37:07.130232 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application with Lock( Jul 28 08:37:07.130232 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:37:07.130232 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:37:07.130232 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:37:07.130232 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:37:07.131866 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:37:07.131866 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:37:07.131866 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:37:07.131866 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:37:07.131866 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 08:37:07.131866 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 08:37:07.131866 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 08:37:07.131866 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 08:37:07.131866 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 08:37:07.131866 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 08:37:07.131866 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 28 08:37:07.131866 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application Jul 28 08:37:07.131866 dv-cinder-851351-1-smb devstack@keystone.service[282898]: [pid: 282898|app: 0|req: 327/648] 10.222.0.42 () {56 vars in 1102 bytes} [Thu Jul 28 08:37:06 2022] GET /identity/v3/roles/service => generated 85 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:37:07.131866 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a89e7b56-6330-465e-bda9-9cc1aae54667 None admin] Authenticating user token {{(pid=282898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:37:07.157865 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e8c38af-16e2-4eb1-836e-e6f380f29655 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:37:07.159533 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e8c38af-16e2-4eb1-836e-e6f380f29655 None admin] RBAC: Authorization granted {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:37:07.233220 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG dbcounter [-] [282898] Writing DB stats keystone:SELECT=100 {{(pid=282898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:37:07.244709 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a89e7b56-6330-465e-bda9-9cc1aae54667 None admin] Validating token access rules against request {{(pid=282898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:37:07.249725 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG dbcounter [-] [282899] Writing DB stats keystone:SELECT=100 {{(pid=282899) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:37:07.268563 dv-cinder-851351-1-smb devstack@keystone.service[282899]: [pid: 282899|app: 0|req: 322/649] 10.222.0.42 () {58 vars in 1282 bytes} [Thu Jul 28 08:37:06 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 350 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 28 08:37:07.269434 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8c38af-16e2-4eb1-836e-e6f380f29655 None admin] Authenticating user token {{(pid=282899) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:37:07.286257 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d6cfc5-41e6-4d8a-904b-d92fb2c4ba8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:37:07.287554 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d6cfc5-41e6-4d8a-904b-d92fb2c4ba8a None admin] REQUEST_METHOD: `GET` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:37:07.288422 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d6cfc5-41e6-4d8a-904b-d92fb2c4ba8a None admin] SCRIPT_NAME: `/identity` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:37:07.288949 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d6cfc5-41e6-4d8a-904b-d92fb2c4ba8a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:37:07.304373 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42d6cfc5-41e6-4d8a-904b-d92fb2c4ba8a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:37:07.306133 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42d6cfc5-41e6-4d8a-904b-d92fb2c4ba8a None admin] RBAC: Authorization granted {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:37:07.321138 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application [None req-42d6cfc5-41e6-4d8a-904b-d92fb2c4ba8a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 08:37:07.321138 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:37:07.321138 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:37:07.321138 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:37:07.321138 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:37:07.321138 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:37:07.321138 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:37:07.321138 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:37:07.321138 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:37:07.321138 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:37:07.321138 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:37:07.321138 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:37:07.321138 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 08:37:07.321138 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 08:37:07.321138 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 08:37:07.322343 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 08:37:07.322343 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:37:07.322343 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:37:07.322343 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:37:07.322343 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:37:07.322343 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:37:07.322343 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:37:07.322343 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:37:07.322343 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application with Lock( Jul 28 08:37:07.322343 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:37:07.322343 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:37:07.322343 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:37:07.322343 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:37:07.322343 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:37:07.322343 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:37:07.322343 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:37:07.322343 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:37:07.323598 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 08:37:07.323598 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 08:37:07.323598 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 08:37:07.323598 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application Jul 28 08:37:07.325122 dv-cinder-851351-1-smb devstack@keystone.service[282898]: [pid: 282898|app: 0|req: 328/650] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 08:37:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:37:07.326087 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d6cfc5-41e6-4d8a-904b-d92fb2c4ba8a None admin] Authenticating user token {{(pid=282898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:37:07.378339 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8c38af-16e2-4eb1-836e-e6f380f29655 None admin] Validating token access rules against request {{(pid=282899) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:37:07.415608 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ea904c-c724-4c05-83c2-cb3fb58673c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282899) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:37:07.416305 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ea904c-c724-4c05-83c2-cb3fb58673c4 None admin] REQUEST_METHOD: `PUT` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:37:07.416589 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ea904c-c724-4c05-83c2-cb3fb58673c4 None admin] SCRIPT_NAME: `/identity` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:37:07.416916 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ea904c-c724-4c05-83c2-cb3fb58673c4 None admin] PATH_INFO: `/v3/projects/5cde68cbfb9042dc9f36af3aacea2473/users/f3a6183fd2c040079951febe23234356/roles/aa4daecf3ff74fa1b7d53041a4659723` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:37:07.434919 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ea904c-c724-4c05-83c2-cb3fb58673c4 None admin] RBAC: Authorizing `identity:create_grant(project_id=5cde68cbfb9042dc9f36af3aacea2473, user_id=f3a6183fd2c040079951febe23234356, role_id=aa4daecf3ff74fa1b7d53041a4659723)` {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:37:07.436392 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ea904c-c724-4c05-83c2-cb3fb58673c4 None admin] RBAC: Authorization granted {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:37:07.443129 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d6cfc5-41e6-4d8a-904b-d92fb2c4ba8a None admin] Validating token access rules against request {{(pid=282898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:37:07.451383 dv-cinder-851351-1-smb devstack@keystone.service[282899]: [pid: 282899|app: 0|req: 323/651] 10.222.0.42 () {58 vars in 1439 bytes} [Thu Jul 28 08:37:07 2022] PUT /identity/v3/projects/5cde68cbfb9042dc9f36af3aacea2473/users/f3a6183fd2c040079951febe23234356/roles/aa4daecf3ff74fa1b7d53041a4659723 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 08:37:07.452140 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ea904c-c724-4c05-83c2-cb3fb58673c4 None admin] Authenticating user token {{(pid=282899) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:37:07.496437 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG dbcounter [-] [282899] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=282899) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:37:07.508471 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c746b5f7-4ab8-40bb-87db-0707347f2940 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:37:07.510074 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c746b5f7-4ab8-40bb-87db-0707347f2940 None admin] REQUEST_METHOD: `GET` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:37:07.510897 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c746b5f7-4ab8-40bb-87db-0707347f2940 None admin] SCRIPT_NAME: `/identity` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:37:07.511421 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c746b5f7-4ab8-40bb-87db-0707347f2940 None admin] PATH_INFO: `/v3/roles` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:37:07.513406 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c746b5f7-4ab8-40bb-87db-0707347f2940 None admin] RBAC: Adding query filter params (name=service) {{(pid=282898) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:37:07.514061 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c746b5f7-4ab8-40bb-87db-0707347f2940 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:37:07.516776 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c746b5f7-4ab8-40bb-87db-0707347f2940 None admin] RBAC: Authorization granted {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:37:07.530138 dv-cinder-851351-1-smb devstack@keystone.service[282898]: [pid: 282898|app: 0|req: 329/652] 10.222.0.42 () {56 vars in 1103 bytes} [Thu Jul 28 08:37:07 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:37:07.532038 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c746b5f7-4ab8-40bb-87db-0707347f2940 None admin] Authenticating user token {{(pid=282898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:37:07.546822 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG dbcounter [-] [282898] Writing DB stats keystone:SELECT=100 {{(pid=282898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:37:07.601206 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ea904c-c724-4c05-83c2-cb3fb58673c4 None admin] Validating token access rules against request {{(pid=282899) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:37:07.649880 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d60e09-607c-41c5-b705-a21fef50e74d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282899) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:37:07.650851 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d60e09-607c-41c5-b705-a21fef50e74d None admin] REQUEST_METHOD: `GET` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:37:07.651889 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d60e09-607c-41c5-b705-a21fef50e74d None admin] SCRIPT_NAME: `/identity` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:37:07.651889 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d60e09-607c-41c5-b705-a21fef50e74d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:37:07.666027 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d60e09-607c-41c5-b705-a21fef50e74d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:37:07.668310 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d60e09-607c-41c5-b705-a21fef50e74d None admin] RBAC: Authorization granted {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:37:07.687753 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c746b5f7-4ab8-40bb-87db-0707347f2940 None admin] Validating token access rules against request {{(pid=282898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:37:07.688374 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application [None req-88d60e09-607c-41c5-b705-a21fef50e74d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 08:37:07.688374 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:37:07.688374 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:37:07.688374 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:37:07.688374 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:37:07.688374 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:37:07.688374 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:37:07.688374 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:37:07.688374 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:37:07.688374 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:37:07.688374 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:37:07.688374 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:37:07.688374 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 08:37:07.688374 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 08:37:07.688374 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 08:37:07.689423 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 08:37:07.689423 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:37:07.689423 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:37:07.689423 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:37:07.689423 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:37:07.689423 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:37:07.689423 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:37:07.689423 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:37:07.689423 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application with Lock( Jul 28 08:37:07.689423 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:37:07.689423 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:37:07.689423 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:37:07.689423 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:37:07.689423 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:37:07.689423 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:37:07.689423 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:37:07.689423 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:37:07.690547 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 08:37:07.690547 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 08:37:07.690547 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 08:37:07.690547 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application Jul 28 08:37:07.693063 dv-cinder-851351-1-smb devstack@keystone.service[282899]: [pid: 282899|app: 0|req: 324/653] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 08:37:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:37:07.694259 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d60e09-607c-41c5-b705-a21fef50e74d None admin] Authenticating user token {{(pid=282899) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:37:07.733861 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4230b58-7425-4491-aaf2-47c9872de60d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:37:07.735408 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4230b58-7425-4491-aaf2-47c9872de60d None admin] REQUEST_METHOD: `GET` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:37:07.735699 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4230b58-7425-4491-aaf2-47c9872de60d None admin] SCRIPT_NAME: `/identity` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:37:07.735977 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4230b58-7425-4491-aaf2-47c9872de60d None admin] PATH_INFO: `/v3/domains` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:37:07.736717 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4230b58-7425-4491-aaf2-47c9872de60d None admin] RBAC: Adding query filter params (name=Default) {{(pid=282898) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:37:07.737104 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4230b58-7425-4491-aaf2-47c9872de60d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:37:07.738511 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4230b58-7425-4491-aaf2-47c9872de60d None admin] RBAC: Authorization granted {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:37:07.756192 dv-cinder-851351-1-smb devstack@keystone.service[282898]: [pid: 282898|app: 0|req: 330/654] 10.222.0.42 () {56 vars in 1109 bytes} [Thu Jul 28 08:37:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:37:07.757119 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4230b58-7425-4491-aaf2-47c9872de60d None admin] Authenticating user token {{(pid=282898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:37:07.800253 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG dbcounter [-] [282899] Writing DB stats keystone:SELECT=100 {{(pid=282899) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:37:07.817384 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d60e09-607c-41c5-b705-a21fef50e74d None admin] Validating token access rules against request {{(pid=282899) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:37:07.846179 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG dbcounter [-] [282898] Writing DB stats keystone:SELECT=100 {{(pid=282898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:37:07.867496 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1299e9be-e9c2-47b2-bf3d-9ee1feb6f70d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282899) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:37:07.868528 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1299e9be-e9c2-47b2-bf3d-9ee1feb6f70d None admin] REQUEST_METHOD: `GET` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:37:07.869075 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1299e9be-e9c2-47b2-bf3d-9ee1feb6f70d None admin] SCRIPT_NAME: `/identity` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:37:07.869664 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1299e9be-e9c2-47b2-bf3d-9ee1feb6f70d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:37:07.883155 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1299e9be-e9c2-47b2-bf3d-9ee1feb6f70d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:37:07.885135 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1299e9be-e9c2-47b2-bf3d-9ee1feb6f70d None admin] RBAC: Authorization granted {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:37:07.889303 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4230b58-7425-4491-aaf2-47c9872de60d None admin] Validating token access rules against request {{(pid=282898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:37:07.901288 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application [None req-1299e9be-e9c2-47b2-bf3d-9ee1feb6f70d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 08:37:07.901288 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:37:07.901288 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:37:07.901288 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:37:07.901288 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:37:07.901288 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:37:07.901288 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:37:07.901288 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:37:07.901288 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:37:07.901288 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:37:07.901288 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:37:07.901288 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:37:07.901288 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 08:37:07.901288 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 08:37:07.901288 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 08:37:07.902405 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 08:37:07.902405 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:37:07.902405 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:37:07.902405 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:37:07.902405 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:37:07.902405 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:37:07.902405 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:37:07.902405 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:37:07.902405 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application with Lock( Jul 28 08:37:07.902405 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:37:07.902405 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:37:07.902405 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:37:07.902405 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:37:07.902405 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:37:07.902405 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:37:07.902405 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:37:07.902405 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:37:07.903552 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 08:37:07.903552 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 08:37:07.903552 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 08:37:07.903552 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application Jul 28 08:37:07.906087 dv-cinder-851351-1-smb devstack@keystone.service[282899]: [pid: 282899|app: 0|req: 325/655] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 08:37:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:37:07.907408 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1299e9be-e9c2-47b2-bf3d-9ee1feb6f70d None admin] Authenticating user token {{(pid=282899) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:37:07.929176 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c1d4b1c-9543-4350-a2fc-4697b524e621 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:37:07.930302 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1d4b1c-9543-4350-a2fc-4697b524e621 None admin] REQUEST_METHOD: `GET` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:37:07.930808 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1d4b1c-9543-4350-a2fc-4697b524e621 None admin] SCRIPT_NAME: `/identity` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:37:07.931358 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1d4b1c-9543-4350-a2fc-4697b524e621 None admin] PATH_INFO: `/v3/domains` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:37:07.932414 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c1d4b1c-9543-4350-a2fc-4697b524e621 None admin] RBAC: Adding query filter params (name=Default) {{(pid=282898) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:37:07.932975 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c1d4b1c-9543-4350-a2fc-4697b524e621 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:37:07.934639 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c1d4b1c-9543-4350-a2fc-4697b524e621 None admin] RBAC: Authorization granted {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:37:07.948108 dv-cinder-851351-1-smb devstack@keystone.service[282898]: [pid: 282898|app: 0|req: 331/656] 10.222.0.42 () {56 vars in 1109 bytes} [Thu Jul 28 08:37:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:37:07.949474 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c1d4b1c-9543-4350-a2fc-4697b524e621 None admin] Authenticating user token {{(pid=282898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:37:08.027648 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1299e9be-e9c2-47b2-bf3d-9ee1feb6f70d None admin] Validating token access rules against request {{(pid=282899) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:37:08.064731 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89083a3a-2380-4ac5-903e-77416ce28c01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282899) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:37:08.065478 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89083a3a-2380-4ac5-903e-77416ce28c01 None admin] REQUEST_METHOD: `GET` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:37:08.065767 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89083a3a-2380-4ac5-903e-77416ce28c01 None admin] SCRIPT_NAME: `/identity` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:37:08.066050 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89083a3a-2380-4ac5-903e-77416ce28c01 None admin] PATH_INFO: `/v3/users/glance` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:37:08.075237 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89083a3a-2380-4ac5-903e-77416ce28c01 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:37:08.076440 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89083a3a-2380-4ac5-903e-77416ce28c01 None admin] RBAC: Authorization granted {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:37:08.080361 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG dbcounter [-] [282899] Writing DB stats keystone:SELECT=100 {{(pid=282899) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:37:08.091615 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application [None req-89083a3a-2380-4ac5-903e-77416ce28c01 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jul 28 08:37:08.091615 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:37:08.091615 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:37:08.091615 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:37:08.091615 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:37:08.091615 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:37:08.091615 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:37:08.091615 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:37:08.091615 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:37:08.091615 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:37:08.091615 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:37:08.091615 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:37:08.091615 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 28 08:37:08.091615 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 28 08:37:08.091615 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 28 08:37:08.091615 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 28 08:37:08.092894 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:37:08.092894 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:37:08.092894 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 28 08:37:08.092894 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 08:37:08.092894 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 28 08:37:08.092894 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 08:37:08.092894 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:37:08.092894 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:37:08.092894 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:37:08.092894 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:37:08.092894 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:37:08.092894 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application with Lock( Jul 28 08:37:08.092894 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:37:08.092894 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:37:08.092894 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:37:08.092894 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:37:08.092894 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:37:08.092894 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:37:08.094438 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:37:08.094438 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:37:08.094438 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 28 08:37:08.094438 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 28 08:37:08.094438 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 28 08:37:08.094438 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 28 08:37:08.094438 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 28 08:37:08.094438 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 28 08:37:08.094438 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jul 28 08:37:08.094438 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application Jul 28 08:37:08.094438 dv-cinder-851351-1-smb devstack@keystone.service[282899]: [pid: 282899|app: 0|req: 326/657] 10.222.0.42 () {56 vars in 1099 bytes} [Thu Jul 28 08:37:07 2022] GET /identity/v3/users/glance => generated 84 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:37:08.094438 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89083a3a-2380-4ac5-903e-77416ce28c01 None admin] Authenticating user token {{(pid=282899) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:37:08.099129 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c1d4b1c-9543-4350-a2fc-4697b524e621 None admin] Validating token access rules against request {{(pid=282898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:37:08.140747 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG dbcounter [-] [282898] Writing DB stats keystone:SELECT=100 {{(pid=282898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:37:08.154347 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb2d245-6120-45e7-a9b6-cde00e0132d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:37:08.155411 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb2d245-6120-45e7-a9b6-cde00e0132d8 None admin] REQUEST_METHOD: `GET` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:37:08.156104 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb2d245-6120-45e7-a9b6-cde00e0132d8 None admin] SCRIPT_NAME: `/identity` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:37:08.156633 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb2d245-6120-45e7-a9b6-cde00e0132d8 None admin] PATH_INFO: `/v3/domains` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:37:08.158337 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdb2d245-6120-45e7-a9b6-cde00e0132d8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=282898) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:37:08.158975 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdb2d245-6120-45e7-a9b6-cde00e0132d8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:37:08.161186 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdb2d245-6120-45e7-a9b6-cde00e0132d8 None admin] RBAC: Authorization granted {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:37:08.178597 dv-cinder-851351-1-smb devstack@keystone.service[282898]: [pid: 282898|app: 0|req: 332/658] 10.222.0.42 () {56 vars in 1109 bytes} [Thu Jul 28 08:37:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:37:08.179896 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb2d245-6120-45e7-a9b6-cde00e0132d8 None admin] Authenticating user token {{(pid=282898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:37:08.231909 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89083a3a-2380-4ac5-903e-77416ce28c01 None admin] Validating token access rules against request {{(pid=282899) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:37:08.268548 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec7f39dc-d594-4f1f-b3c3-472524d7ed8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282899) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:37:08.269275 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7f39dc-d594-4f1f-b3c3-472524d7ed8c None admin] REQUEST_METHOD: `GET` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:37:08.269704 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7f39dc-d594-4f1f-b3c3-472524d7ed8c None admin] SCRIPT_NAME: `/identity` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:37:08.269897 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7f39dc-d594-4f1f-b3c3-472524d7ed8c None admin] PATH_INFO: `/v3/projects/service` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:37:08.277610 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec7f39dc-d594-4f1f-b3c3-472524d7ed8c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:37:08.279105 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec7f39dc-d594-4f1f-b3c3-472524d7ed8c None admin] RBAC: Authorization granted {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:37:08.293743 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application [None req-ec7f39dc-d594-4f1f-b3c3-472524d7ed8c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 08:37:08.293743 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:37:08.293743 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:37:08.293743 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:37:08.293743 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:37:08.293743 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:37:08.293743 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:37:08.293743 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:37:08.293743 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:37:08.293743 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:37:08.293743 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:37:08.293743 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:37:08.293743 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 28 08:37:08.293743 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 28 08:37:08.293743 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 28 08:37:08.294907 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 28 08:37:08.294907 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:37:08.294907 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:37:08.294907 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:37:08.294907 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:37:08.294907 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:37:08.294907 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:37:08.294907 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:37:08.294907 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application with Lock( Jul 28 08:37:08.294907 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:37:08.294907 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:37:08.294907 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:37:08.294907 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:37:08.294907 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:37:08.294907 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:37:08.294907 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:37:08.294907 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:37:08.296429 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 28 08:37:08.296429 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 28 08:37:08.296429 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 28 08:37:08.296429 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 28 08:37:08.296429 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 28 08:37:08.296429 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 28 08:37:08.296429 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 08:37:08.296429 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application Jul 28 08:37:08.299741 dv-cinder-851351-1-smb devstack@keystone.service[282899]: [pid: 282899|app: 0|req: 327/659] 10.222.0.42 () {56 vars in 1111 bytes} [Thu Jul 28 08:37:08 2022] GET /identity/v3/projects/service => generated 88 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:37:08.300886 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec7f39dc-d594-4f1f-b3c3-472524d7ed8c None admin] Authenticating user token {{(pid=282899) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:37:08.313285 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb2d245-6120-45e7-a9b6-cde00e0132d8 None admin] Validating token access rules against request {{(pid=282898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:37:08.363341 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8567e5-5aa6-4fc5-9f69-733250cd6e4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:37:08.364312 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8567e5-5aa6-4fc5-9f69-733250cd6e4b None admin] REQUEST_METHOD: `GET` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:37:08.365311 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8567e5-5aa6-4fc5-9f69-733250cd6e4b None admin] SCRIPT_NAME: `/identity` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:37:08.365772 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8567e5-5aa6-4fc5-9f69-733250cd6e4b None admin] PATH_INFO: `/v3/users` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:37:08.367008 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc8567e5-5aa6-4fc5-9f69-733250cd6e4b None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=282898) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:37:08.368041 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc8567e5-5aa6-4fc5-9f69-733250cd6e4b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:37:08.370309 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc8567e5-5aa6-4fc5-9f69-733250cd6e4b None admin] RBAC: Authorization granted {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:37:08.372650 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG dbcounter [-] [282899] Writing DB stats keystone:SELECT=100 {{(pid=282899) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:37:08.399041 dv-cinder-851351-1-smb devstack@keystone.service[282898]: [pid: 282898|app: 0|req: 333/660] 10.222.0.42 () {56 vars in 1137 bytes} [Thu Jul 28 08:37:08 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:37:08.400121 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8567e5-5aa6-4fc5-9f69-733250cd6e4b None admin] Authenticating user token {{(pid=282898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:37:08.424819 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec7f39dc-d594-4f1f-b3c3-472524d7ed8c None admin] Validating token access rules against request {{(pid=282899) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:37:08.462561 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9ebc3a-7c87-4141-bbec-1f1be350cdeb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282899) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:37:08.462906 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG dbcounter [-] [282898] Writing DB stats keystone:SELECT=100 {{(pid=282898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:37:08.463879 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9ebc3a-7c87-4141-bbec-1f1be350cdeb None admin] REQUEST_METHOD: `GET` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:37:08.464533 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9ebc3a-7c87-4141-bbec-1f1be350cdeb None admin] SCRIPT_NAME: `/identity` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:37:08.465083 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9ebc3a-7c87-4141-bbec-1f1be350cdeb None admin] PATH_INFO: `/v3/users/neutron` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:37:08.475471 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef9ebc3a-7c87-4141-bbec-1f1be350cdeb None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:37:08.477284 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef9ebc3a-7c87-4141-bbec-1f1be350cdeb None admin] RBAC: Authorization granted {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:37:08.493243 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application [None req-ef9ebc3a-7c87-4141-bbec-1f1be350cdeb None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jul 28 08:37:08.493243 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:37:08.493243 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:37:08.493243 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:37:08.493243 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:37:08.493243 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:37:08.493243 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:37:08.493243 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:37:08.493243 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:37:08.493243 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:37:08.493243 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:37:08.493243 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:37:08.493243 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 28 08:37:08.493243 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 28 08:37:08.493243 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 28 08:37:08.493243 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 28 08:37:08.494389 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:37:08.494389 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:37:08.494389 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 28 08:37:08.494389 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 08:37:08.494389 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 28 08:37:08.494389 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 08:37:08.494389 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:37:08.494389 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:37:08.494389 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:37:08.494389 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:37:08.494389 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:37:08.494389 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application with Lock( Jul 28 08:37:08.494389 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:37:08.494389 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:37:08.494389 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:37:08.494389 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:37:08.494389 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:37:08.494389 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:37:08.495530 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:37:08.495530 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:37:08.495530 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 28 08:37:08.495530 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 28 08:37:08.495530 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 28 08:37:08.495530 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 28 08:37:08.495530 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 28 08:37:08.495530 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 28 08:37:08.495530 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jul 28 08:37:08.495530 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application Jul 28 08:37:08.496842 dv-cinder-851351-1-smb devstack@keystone.service[282899]: [pid: 282899|app: 0|req: 328/661] 10.222.0.42 () {56 vars in 1102 bytes} [Thu Jul 28 08:37:08 2022] GET /identity/v3/users/neutron => generated 85 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:37:08.497783 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9ebc3a-7c87-4141-bbec-1f1be350cdeb None admin] Authenticating user token {{(pid=282899) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:37:08.526501 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8567e5-5aa6-4fc5-9f69-733250cd6e4b None admin] Validating token access rules against request {{(pid=282898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:37:08.564178 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2dc48c-5835-455a-9741-fdd1a85125f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:37:08.564841 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2dc48c-5835-455a-9741-fdd1a85125f3 None admin] REQUEST_METHOD: `GET` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:37:08.565202 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2dc48c-5835-455a-9741-fdd1a85125f3 None admin] SCRIPT_NAME: `/identity` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:37:08.565485 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2dc48c-5835-455a-9741-fdd1a85125f3 None admin] PATH_INFO: `/v3/projects` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:37:08.566261 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef2dc48c-5835-455a-9741-fdd1a85125f3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=282898) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:37:08.566595 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef2dc48c-5835-455a-9741-fdd1a85125f3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:37:08.568028 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef2dc48c-5835-455a-9741-fdd1a85125f3 None admin] RBAC: Authorization granted {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:37:08.581297 dv-cinder-851351-1-smb devstack@keystone.service[282898]: [pid: 282898|app: 0|req: 334/662] 10.222.0.42 () {56 vars in 1148 bytes} [Thu Jul 28 08:37:08 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:37:08.582652 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d4bf64-5fc4-40f1-a81e-963dc5afbcce None None] REQUEST_METHOD: `GET` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:37:08.582947 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d4bf64-5fc4-40f1-a81e-963dc5afbcce None None] SCRIPT_NAME: `/identity` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:37:08.583227 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d4bf64-5fc4-40f1-a81e-963dc5afbcce None None] PATH_INFO: `/` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:37:08.584640 dv-cinder-851351-1-smb devstack@keystone.service[282898]: [pid: 282898|app: 0|req: 335/663] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 08:37:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 08:37:08.585255 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d4bf64-5fc4-40f1-a81e-963dc5afbcce None None] Authenticating user token {{(pid=282898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:37:08.617307 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9ebc3a-7c87-4141-bbec-1f1be350cdeb None admin] Validating token access rules against request {{(pid=282899) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:37:08.642029 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG dbcounter [-] [282899] Writing DB stats keystone:SELECT=100 {{(pid=282899) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:37:08.659648 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbea530b-ec0d-4afc-a5ca-743fca73c152 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282899) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:37:08.660203 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbea530b-ec0d-4afc-a5ca-743fca73c152 None admin] REQUEST_METHOD: `GET` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:37:08.660497 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbea530b-ec0d-4afc-a5ca-743fca73c152 None admin] SCRIPT_NAME: `/identity` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:37:08.660811 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbea530b-ec0d-4afc-a5ca-743fca73c152 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:37:08.700640 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d4bf64-5fc4-40f1-a81e-963dc5afbcce None None] Validating token access rules against request {{(pid=282898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:37:08.704474 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG dbcounter [-] [282898] Writing DB stats keystone:SELECT=100 {{(pid=282898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:37:08.738687 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbea530b-ec0d-4afc-a5ca-743fca73c152 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:37:08.740266 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbea530b-ec0d-4afc-a5ca-743fca73c152 None admin] RBAC: Authorization granted {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:37:08.741648 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a8e8be-771d-48c3-afc2-5100e7e7021f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:37:08.742283 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a8e8be-771d-48c3-afc2-5100e7e7021f None admin] REQUEST_METHOD: `GET` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:37:08.742566 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a8e8be-771d-48c3-afc2-5100e7e7021f None admin] SCRIPT_NAME: `/identity` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:37:08.742844 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a8e8be-771d-48c3-afc2-5100e7e7021f None admin] PATH_INFO: `/v3/users` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:37:08.743662 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a8e8be-771d-48c3-afc2-5100e7e7021f None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=282898) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:37:08.743985 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a8e8be-771d-48c3-afc2-5100e7e7021f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:37:08.745450 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a8e8be-771d-48c3-afc2-5100e7e7021f None admin] RBAC: Authorization granted {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:37:08.766150 dv-cinder-851351-1-smb devstack@keystone.service[282898]: [pid: 282898|app: 0|req: 336/664] 10.222.0.42 () {56 vars in 1139 bytes} [Thu Jul 28 08:37:08 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:37:08.767022 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a8e8be-771d-48c3-afc2-5100e7e7021f None admin] Authenticating user token {{(pid=282898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:37:08.868983 dv-cinder-851351-1-smb devstack@keystone.service[282899]: [pid: 282899|app: 0|req: 329/665] 10.222.0.42 () {58 vars in 1282 bytes} [Thu Jul 28 08:37:08 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 371 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 28 08:37:08.870430 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73f5f89-3555-49c9-9d32-9e49288358c1 None None] REQUEST_METHOD: `POST` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:37:08.870901 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73f5f89-3555-49c9-9d32-9e49288358c1 None None] SCRIPT_NAME: `/identity` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:37:08.871021 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73f5f89-3555-49c9-9d32-9e49288358c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:37:08.888419 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a8e8be-771d-48c3-afc2-5100e7e7021f None admin] Validating token access rules against request {{(pid=282898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:37:08.890512 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.auth.core [None req-e73f5f89-3555-49c9-9d32-9e49288358c1 None None] MFA Rules not processed for user `2be990a66857410a87ffa7609aec4f7b`. Rule list: `[]` (Enabled: `True`). {{(pid=282899) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 08:37:08.891891 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.fernet_utils [None req-e73f5f89-3555-49c9-9d32-9e49288358c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=282899) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:37:08.908040 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG dbcounter [-] [282899] Writing DB stats keystone:SELECT=100 {{(pid=282899) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:37:08.926527 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8994c825-78c6-42e9-869c-c16d73b90960 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:37:08.927052 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8994c825-78c6-42e9-869c-c16d73b90960 None admin] REQUEST_METHOD: `GET` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:37:08.927340 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8994c825-78c6-42e9-869c-c16d73b90960 None admin] SCRIPT_NAME: `/identity` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:37:08.927611 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8994c825-78c6-42e9-869c-c16d73b90960 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:37:08.928433 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8994c825-78c6-42e9-869c-c16d73b90960 None admin] RBAC: Adding query filter params (role.id=aa4daecf3ff74fa1b7d53041a4659723, scope.project.id=5cde68cbfb9042dc9f36af3aacea2473, user.id=3ca765453caf411782368f0070282436) {{(pid=282898) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:37:08.928789 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8994c825-78c6-42e9-869c-c16d73b90960 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:37:08.930256 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8994c825-78c6-42e9-869c-c16d73b90960 None admin] RBAC: Authorization granted {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:37:08.937160 dv-cinder-851351-1-smb devstack@keystone.service[282898]: [pid: 282898|app: 0|req: 337/666] 10.222.0.42 () {56 vars in 1374 bytes} [Thu Jul 28 08:37:08 2022] GET /identity/v3/role_assignments?user.id=3ca765453caf411782368f0070282436&scope.project.id=5cde68cbfb9042dc9f36af3aacea2473&role.id=aa4daecf3ff74fa1b7d53041a4659723 => generated 608 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:37:08.938040 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8994c825-78c6-42e9-869c-c16d73b90960 None admin] Authenticating user token {{(pid=282898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:37:08.978143 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG dbcounter [-] [282898] Writing DB stats keystone:SELECT=100 {{(pid=282898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:37:08.994311 dv-cinder-851351-1-smb devstack@keystone.service[282899]: [pid: 282899|app: 0|req: 330/667] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 08:37:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 08:37:08.996346 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73f5f89-3555-49c9-9d32-9e49288358c1 None None] Authenticating user token {{(pid=282899) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:37:09.080488 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8994c825-78c6-42e9-869c-c16d73b90960 None admin] Validating token access rules against request {{(pid=282898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:37:09.132227 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f6035e-9642-4fa7-8818-f6693b7a3e49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:37:09.133041 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f6035e-9642-4fa7-8818-f6693b7a3e49 None admin] REQUEST_METHOD: `GET` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:37:09.133411 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f6035e-9642-4fa7-8818-f6693b7a3e49 None admin] SCRIPT_NAME: `/identity` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:37:09.133743 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f6035e-9642-4fa7-8818-f6693b7a3e49 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:37:09.135359 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73f5f89-3555-49c9-9d32-9e49288358c1 None None] Validating token access rules against request {{(pid=282899) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:37:09.183277 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1e73f0-2f81-4001-b784-2c5ddd999e66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282899) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:37:09.184365 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1e73f0-2f81-4001-b784-2c5ddd999e66 None admin] REQUEST_METHOD: `GET` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:37:09.184865 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1e73f0-2f81-4001-b784-2c5ddd999e66 None admin] SCRIPT_NAME: `/identity` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:37:09.185333 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1e73f0-2f81-4001-b784-2c5ddd999e66 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:37:09.199486 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df1e73f0-2f81-4001-b784-2c5ddd999e66 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:37:09.201801 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df1e73f0-2f81-4001-b784-2c5ddd999e66 None admin] RBAC: Authorization granted {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:37:09.220315 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application [None req-df1e73f0-2f81-4001-b784-2c5ddd999e66 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 08:37:09.220315 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:37:09.220315 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:37:09.220315 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:37:09.220315 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:37:09.220315 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:37:09.220315 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:37:09.220315 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:37:09.220315 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:37:09.220315 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:37:09.220315 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:37:09.220315 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:37:09.220315 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 08:37:09.220315 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 08:37:09.220315 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 08:37:09.221550 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 08:37:09.221550 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:37:09.221550 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:37:09.221550 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:37:09.221550 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:37:09.221550 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:37:09.221550 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:37:09.221550 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:37:09.221550 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application with Lock( Jul 28 08:37:09.221550 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:37:09.221550 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:37:09.221550 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:37:09.221550 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:37:09.221550 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:37:09.221550 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:37:09.221550 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:37:09.221550 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:37:09.222650 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 08:37:09.222650 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 08:37:09.222650 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 08:37:09.222650 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application Jul 28 08:37:09.222909 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91f6035e-9642-4fa7-8818-f6693b7a3e49 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:37:09.223674 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91f6035e-9642-4fa7-8818-f6693b7a3e49 None admin] RBAC: Authorization granted {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:37:09.228692 dv-cinder-851351-1-smb devstack@keystone.service[282899]: [pid: 282899|app: 0|req: 331/668] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 08:37:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:37:09.228692 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1e73f0-2f81-4001-b784-2c5ddd999e66 None admin] Authenticating user token {{(pid=282899) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:37:09.232575 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG dbcounter [-] [282899] Writing DB stats keystone:SELECT=100 {{(pid=282899) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:37:09.254974 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG dbcounter [-] [282898] Writing DB stats keystone:SELECT=100 {{(pid=282898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:37:09.346305 dv-cinder-851351-1-smb devstack@keystone.service[282898]: [pid: 282898|app: 0|req: 338/669] 10.222.0.42 () {58 vars in 1282 bytes} [Thu Jul 28 08:37:08 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 408 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 28 08:37:09.347608 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f6035e-9642-4fa7-8818-f6693b7a3e49 None admin] Authenticating user token {{(pid=282898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:37:09.363987 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1e73f0-2f81-4001-b784-2c5ddd999e66 None admin] Validating token access rules against request {{(pid=282899) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:37:09.405186 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39be4ba-1515-42c4-834a-e27d86da0175 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282899) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:37:09.405972 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39be4ba-1515-42c4-834a-e27d86da0175 None admin] REQUEST_METHOD: `GET` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:37:09.406353 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39be4ba-1515-42c4-834a-e27d86da0175 None admin] SCRIPT_NAME: `/identity` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:37:09.406700 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39be4ba-1515-42c4-834a-e27d86da0175 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:37:09.419913 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e39be4ba-1515-42c4-834a-e27d86da0175 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 08:37:09.426265 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application [None req-e39be4ba-1515-42c4-834a-e27d86da0175 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 08:37:09.426265 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:37:09.426265 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:37:09.426265 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:37:09.426265 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:37:09.426265 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:37:09.426265 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:37:09.426265 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:37:09.426265 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:37:09.426265 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:37:09.426265 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:37:09.426265 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:37:09.426265 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 08:37:09.426265 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 08:37:09.426265 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 08:37:09.426265 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 08:37:09.427453 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 08:37:09.427453 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 08:37:09.427453 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 08:37:09.427453 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 08:37:09.427453 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:37:09.427453 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:37:09.427453 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:37:09.427453 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:37:09.427453 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:37:09.427453 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:37:09.427453 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:37:09.427453 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application with Lock( Jul 28 08:37:09.427453 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:37:09.427453 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:37:09.427453 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:37:09.427453 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:37:09.428707 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:37:09.428707 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:37:09.428707 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:37:09.428707 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:37:09.428707 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 08:37:09.428707 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 08:37:09.428707 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 08:37:09.428707 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 08:37:09.428707 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 08:37:09.428707 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 08:37:09.428707 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 08:37:09.428707 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application Jul 28 08:37:09.428707 dv-cinder-851351-1-smb devstack@keystone.service[282899]: [pid: 282899|app: 0|req: 332/670] 10.222.0.42 () {56 vars in 1096 bytes} [Thu Jul 28 08:37:09 2022] GET /identity/v3/roles/admin => generated 83 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:37:09.430484 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39be4ba-1515-42c4-834a-e27d86da0175 None admin] Authenticating user token {{(pid=282899) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:37:09.468358 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f6035e-9642-4fa7-8818-f6693b7a3e49 None admin] Validating token access rules against request {{(pid=282898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:37:09.497074 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG dbcounter [-] [282898] Writing DB stats keystone:SELECT=100 {{(pid=282898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:37:09.501941 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG dbcounter [-] [282899] Writing DB stats keystone:SELECT=100 {{(pid=282899) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:37:09.506776 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b342fb-cb0b-442b-b58a-7f8ccf9ad10f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:37:09.507457 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b342fb-cb0b-442b-b58a-7f8ccf9ad10f None admin] REQUEST_METHOD: `GET` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:37:09.507747 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b342fb-cb0b-442b-b58a-7f8ccf9ad10f None admin] SCRIPT_NAME: `/identity` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:37:09.508026 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b342fb-cb0b-442b-b58a-7f8ccf9ad10f None admin] PATH_INFO: `/v3/domains` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:37:09.508804 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29b342fb-cb0b-442b-b58a-7f8ccf9ad10f None admin] RBAC: Adding query filter params (name=Default) {{(pid=282898) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:37:09.509122 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29b342fb-cb0b-442b-b58a-7f8ccf9ad10f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:37:09.511310 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29b342fb-cb0b-442b-b58a-7f8ccf9ad10f None admin] RBAC: Authorization granted {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:37:09.524508 dv-cinder-851351-1-smb devstack@keystone.service[282898]: [pid: 282898|app: 0|req: 339/671] 10.222.0.42 () {56 vars in 1109 bytes} [Thu Jul 28 08:37:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:37:09.525546 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b342fb-cb0b-442b-b58a-7f8ccf9ad10f None admin] Authenticating user token {{(pid=282898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:37:09.552752 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39be4ba-1515-42c4-834a-e27d86da0175 None admin] Validating token access rules against request {{(pid=282899) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:37:09.595675 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6372a0-e7a0-4d47-9730-e8641d524ebd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282899) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:37:09.596435 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6372a0-e7a0-4d47-9730-e8641d524ebd None admin] REQUEST_METHOD: `GET` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:37:09.596746 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6372a0-e7a0-4d47-9730-e8641d524ebd None admin] SCRIPT_NAME: `/identity` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:37:09.597024 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6372a0-e7a0-4d47-9730-e8641d524ebd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:37:09.608997 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e6372a0-e7a0-4d47-9730-e8641d524ebd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:37:09.610507 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e6372a0-e7a0-4d47-9730-e8641d524ebd None admin] RBAC: Authorization granted {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:37:09.627628 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application [None req-0e6372a0-e7a0-4d47-9730-e8641d524ebd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 08:37:09.627628 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:37:09.627628 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:37:09.627628 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:37:09.627628 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:37:09.627628 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:37:09.627628 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:37:09.627628 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:37:09.627628 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:37:09.627628 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:37:09.627628 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:37:09.627628 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:37:09.627628 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 08:37:09.627628 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 08:37:09.627628 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 08:37:09.628892 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 08:37:09.628892 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:37:09.628892 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:37:09.628892 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:37:09.628892 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:37:09.628892 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:37:09.628892 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:37:09.628892 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:37:09.628892 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application with Lock( Jul 28 08:37:09.628892 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:37:09.628892 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:37:09.628892 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:37:09.628892 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:37:09.628892 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:37:09.628892 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:37:09.628892 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:37:09.628892 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:37:09.629947 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 08:37:09.629947 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 08:37:09.629947 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 08:37:09.629947 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application Jul 28 08:37:09.629947 dv-cinder-851351-1-smb devstack@keystone.service[282899]: [pid: 282899|app: 0|req: 333/672] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 08:37:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:37:09.629947 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6372a0-e7a0-4d47-9730-e8641d524ebd None admin] Authenticating user token {{(pid=282899) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:37:09.643969 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b342fb-cb0b-442b-b58a-7f8ccf9ad10f None admin] Validating token access rules against request {{(pid=282898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:37:09.685571 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603d4f2a-ae1e-432d-9fe0-ba673a5ee551 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:37:09.686212 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603d4f2a-ae1e-432d-9fe0-ba673a5ee551 None admin] REQUEST_METHOD: `GET` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:37:09.686583 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603d4f2a-ae1e-432d-9fe0-ba673a5ee551 None admin] SCRIPT_NAME: `/identity` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:37:09.686892 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603d4f2a-ae1e-432d-9fe0-ba673a5ee551 None admin] PATH_INFO: `/v3/roles` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:37:09.687620 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-603d4f2a-ae1e-432d-9fe0-ba673a5ee551 None admin] RBAC: Adding query filter params (name=admin) {{(pid=282898) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:37:09.687930 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-603d4f2a-ae1e-432d-9fe0-ba673a5ee551 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:37:09.689420 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-603d4f2a-ae1e-432d-9fe0-ba673a5ee551 None admin] RBAC: Authorization granted {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:37:09.703306 dv-cinder-851351-1-smb devstack@keystone.service[282898]: [pid: 282898|app: 0|req: 340/673] 10.222.0.42 () {56 vars in 1099 bytes} [Thu Jul 28 08:37:09 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:37:09.703306 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c393d926-2108-43fa-a6a4-2c25ffa26b9a None None] REQUEST_METHOD: `GET` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:37:09.703306 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c393d926-2108-43fa-a6a4-2c25ffa26b9a None None] SCRIPT_NAME: `/identity` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:37:09.703306 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c393d926-2108-43fa-a6a4-2c25ffa26b9a None None] PATH_INFO: `/` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:37:09.703306 dv-cinder-851351-1-smb devstack@keystone.service[282898]: [pid: 282898|app: 0|req: 341/674] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 08:37:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 08:37:09.703306 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c393d926-2108-43fa-a6a4-2c25ffa26b9a None None] Authenticating user token {{(pid=282898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:37:09.760595 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6372a0-e7a0-4d47-9730-e8641d524ebd None admin] Validating token access rules against request {{(pid=282899) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:37:09.762414 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG dbcounter [-] [282898] Writing DB stats keystone:SELECT=100 {{(pid=282898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:37:09.776078 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG dbcounter [-] [282899] Writing DB stats keystone:SELECT=100 {{(pid=282899) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:37:09.801021 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342e9d33-1a1c-4cdf-a72e-158281a39b6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282899) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:37:09.801707 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342e9d33-1a1c-4cdf-a72e-158281a39b6b None admin] REQUEST_METHOD: `GET` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:37:09.801986 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342e9d33-1a1c-4cdf-a72e-158281a39b6b None admin] SCRIPT_NAME: `/identity` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:37:09.802261 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342e9d33-1a1c-4cdf-a72e-158281a39b6b None admin] PATH_INFO: `/v3/projects/service` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:37:09.809814 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-342e9d33-1a1c-4cdf-a72e-158281a39b6b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:37:09.811299 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-342e9d33-1a1c-4cdf-a72e-158281a39b6b None admin] RBAC: Authorization granted {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:37:09.826283 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c393d926-2108-43fa-a6a4-2c25ffa26b9a None None] Validating token access rules against request {{(pid=282898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:37:09.827491 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application [None req-342e9d33-1a1c-4cdf-a72e-158281a39b6b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 08:37:09.827491 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:37:09.827491 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:37:09.827491 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:37:09.827491 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:37:09.827491 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:37:09.827491 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:37:09.827491 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:37:09.827491 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:37:09.827491 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:37:09.827491 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:37:09.827491 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:37:09.827491 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 28 08:37:09.827491 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 28 08:37:09.827491 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 28 08:37:09.828608 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 28 08:37:09.828608 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:37:09.828608 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:37:09.828608 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:37:09.828608 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:37:09.828608 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:37:09.828608 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:37:09.828608 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:37:09.828608 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application with Lock( Jul 28 08:37:09.828608 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:37:09.828608 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:37:09.828608 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:37:09.828608 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:37:09.828608 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:37:09.828608 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:37:09.828608 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:37:09.828608 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:37:09.830069 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 28 08:37:09.830069 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 28 08:37:09.830069 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 28 08:37:09.830069 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 28 08:37:09.830069 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 28 08:37:09.830069 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 28 08:37:09.830069 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 08:37:09.830069 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application Jul 28 08:37:09.832882 dv-cinder-851351-1-smb devstack@keystone.service[282899]: [pid: 282899|app: 0|req: 334/675] 10.222.0.42 () {56 vars in 1111 bytes} [Thu Jul 28 08:37:09 2022] GET /identity/v3/projects/service => generated 88 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:37:09.834112 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342e9d33-1a1c-4cdf-a72e-158281a39b6b None admin] Authenticating user token {{(pid=282899) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:37:09.867787 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f2ee133-0a2c-4213-8cf9-648948a30dff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:37:09.868419 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2ee133-0a2c-4213-8cf9-648948a30dff None admin] REQUEST_METHOD: `GET` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:37:09.868731 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2ee133-0a2c-4213-8cf9-648948a30dff None admin] SCRIPT_NAME: `/identity` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:37:09.869011 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2ee133-0a2c-4213-8cf9-648948a30dff None admin] PATH_INFO: `/v3/domains` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:37:09.869764 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f2ee133-0a2c-4213-8cf9-648948a30dff None admin] RBAC: Adding query filter params (name=Default) {{(pid=282898) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:37:09.870080 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f2ee133-0a2c-4213-8cf9-648948a30dff None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:37:09.871495 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f2ee133-0a2c-4213-8cf9-648948a30dff None admin] RBAC: Authorization granted {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:37:09.885094 dv-cinder-851351-1-smb devstack@keystone.service[282898]: [pid: 282898|app: 0|req: 342/676] 10.222.0.42 () {56 vars in 1109 bytes} [Thu Jul 28 08:37:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:37:09.891255 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4927adc3-d228-43ab-88ba-5b32777d8493 None None] REQUEST_METHOD: `POST` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:37:09.891629 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4927adc3-d228-43ab-88ba-5b32777d8493 None None] SCRIPT_NAME: `/identity` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:37:09.891834 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4927adc3-d228-43ab-88ba-5b32777d8493 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:37:09.910538 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.auth.core [None req-4927adc3-d228-43ab-88ba-5b32777d8493 None None] MFA Rules not processed for user `2be990a66857410a87ffa7609aec4f7b`. Rule list: `[]` (Enabled: `True`). {{(pid=282898) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 08:37:09.911904 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.fernet_utils [None req-4927adc3-d228-43ab-88ba-5b32777d8493 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=282898) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:37:09.957489 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342e9d33-1a1c-4cdf-a72e-158281a39b6b None admin] Validating token access rules against request {{(pid=282899) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:37:09.992712 dv-cinder-851351-1-smb devstack@keystone.service[282898]: [pid: 282898|app: 0|req: 343/677] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 08:37:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 08:37:09.992712 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4927adc3-d228-43ab-88ba-5b32777d8493 None None] Authenticating user token {{(pid=282898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:37:10.020644 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99285867-56d8-418a-a9f6-d3c5d21cb79b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282899) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:37:10.021352 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99285867-56d8-418a-a9f6-d3c5d21cb79b None admin] REQUEST_METHOD: `GET` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:37:10.021635 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99285867-56d8-418a-a9f6-d3c5d21cb79b None admin] SCRIPT_NAME: `/identity` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:37:10.021908 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99285867-56d8-418a-a9f6-d3c5d21cb79b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:37:10.033312 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99285867-56d8-418a-a9f6-d3c5d21cb79b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:37:10.034838 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99285867-56d8-418a-a9f6-d3c5d21cb79b None admin] RBAC: Authorization granted {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:37:10.046220 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG dbcounter [-] [282898] Writing DB stats keystone:SELECT=100 {{(pid=282898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:37:10.050265 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application [None req-99285867-56d8-418a-a9f6-d3c5d21cb79b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 08:37:10.050265 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:37:10.050265 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:37:10.050265 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:37:10.050265 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:37:10.050265 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:37:10.050265 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:37:10.050265 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:37:10.050265 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:37:10.050265 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:37:10.050265 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:37:10.050265 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:37:10.050265 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 08:37:10.050265 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 08:37:10.050265 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 08:37:10.051622 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 08:37:10.051622 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:37:10.051622 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:37:10.051622 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:37:10.051622 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:37:10.051622 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:37:10.051622 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:37:10.051622 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:37:10.051622 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application with Lock( Jul 28 08:37:10.051622 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:37:10.051622 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:37:10.051622 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:37:10.051622 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:37:10.051622 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:37:10.051622 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:37:10.051622 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:37:10.051622 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:37:10.052909 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 08:37:10.052909 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 08:37:10.052909 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 08:37:10.052909 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application Jul 28 08:37:10.056233 dv-cinder-851351-1-smb devstack@keystone.service[282899]: [pid: 282899|app: 0|req: 335/678] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 08:37:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:37:10.057055 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99285867-56d8-418a-a9f6-d3c5d21cb79b None admin] Authenticating user token {{(pid=282899) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:37:10.088204 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG dbcounter [-] [282899] Writing DB stats keystone:SELECT=100 {{(pid=282899) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:37:10.120291 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4927adc3-d228-43ab-88ba-5b32777d8493 None None] Validating token access rules against request {{(pid=282898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:37:10.165895 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74bae947-ac5a-4642-b813-92400e772cb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:37:10.166536 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74bae947-ac5a-4642-b813-92400e772cb5 None admin] REQUEST_METHOD: `GET` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:37:10.166819 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74bae947-ac5a-4642-b813-92400e772cb5 None admin] SCRIPT_NAME: `/identity` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:37:10.167095 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74bae947-ac5a-4642-b813-92400e772cb5 None admin] PATH_INFO: `/v3/projects` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:37:10.167215 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99285867-56d8-418a-a9f6-d3c5d21cb79b None admin] Validating token access rules against request {{(pid=282899) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:37:10.167869 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74bae947-ac5a-4642-b813-92400e772cb5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=282898) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:37:10.168183 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74bae947-ac5a-4642-b813-92400e772cb5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:37:10.170304 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74bae947-ac5a-4642-b813-92400e772cb5 None admin] RBAC: Authorization granted {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:37:10.182842 dv-cinder-851351-1-smb devstack@keystone.service[282898]: [pid: 282898|app: 0|req: 344/679] 10.222.0.42 () {56 vars in 1148 bytes} [Thu Jul 28 08:37:09 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:37:10.183718 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74bae947-ac5a-4642-b813-92400e772cb5 None admin] Authenticating user token {{(pid=282898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:37:10.211745 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9527b188-1f23-452a-8eb6-73bf8636223b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282899) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:37:10.212442 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9527b188-1f23-452a-8eb6-73bf8636223b None admin] REQUEST_METHOD: `GET` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:37:10.212761 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9527b188-1f23-452a-8eb6-73bf8636223b None admin] SCRIPT_NAME: `/identity` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:37:10.213045 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9527b188-1f23-452a-8eb6-73bf8636223b None admin] PATH_INFO: `/v3/projects/service` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:37:10.221347 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9527b188-1f23-452a-8eb6-73bf8636223b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:37:10.222920 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9527b188-1f23-452a-8eb6-73bf8636223b None admin] RBAC: Authorization granted {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:37:10.235857 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application [None req-9527b188-1f23-452a-8eb6-73bf8636223b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 08:37:10.235857 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:37:10.235857 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:37:10.235857 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:37:10.235857 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:37:10.235857 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:37:10.235857 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:37:10.235857 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:37:10.235857 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:37:10.235857 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:37:10.235857 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:37:10.235857 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:37:10.235857 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 28 08:37:10.235857 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 28 08:37:10.235857 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 28 08:37:10.237613 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 28 08:37:10.237613 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:37:10.237613 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:37:10.237613 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:37:10.237613 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:37:10.237613 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:37:10.237613 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:37:10.237613 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:37:10.237613 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application with Lock( Jul 28 08:37:10.237613 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:37:10.237613 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:37:10.237613 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:37:10.237613 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:37:10.237613 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:37:10.237613 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:37:10.237613 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:37:10.237613 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:37:10.238667 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 28 08:37:10.238667 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 28 08:37:10.238667 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 28 08:37:10.238667 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 28 08:37:10.238667 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 28 08:37:10.238667 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 28 08:37:10.238667 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 08:37:10.238667 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application Jul 28 08:37:10.238667 dv-cinder-851351-1-smb devstack@keystone.service[282899]: [pid: 282899|app: 0|req: 336/680] 10.222.0.42 () {56 vars in 1111 bytes} [Thu Jul 28 08:37:10 2022] GET /identity/v3/projects/service => generated 88 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:37:10.238667 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9527b188-1f23-452a-8eb6-73bf8636223b None admin] Authenticating user token {{(pid=282899) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:37:10.298369 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG dbcounter [-] [282898] Writing DB stats keystone:SELECT=100 {{(pid=282898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:37:10.304215 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74bae947-ac5a-4642-b813-92400e772cb5 None admin] Validating token access rules against request {{(pid=282898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:37:10.335497 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG dbcounter [-] [282899] Writing DB stats keystone:SELECT=100 {{(pid=282899) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:37:10.351977 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9527b188-1f23-452a-8eb6-73bf8636223b None admin] Validating token access rules against request {{(pid=282899) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:37:10.352254 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c32941-21fa-473b-8248-5d082da146a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:37:10.352917 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c32941-21fa-473b-8248-5d082da146a7 None admin] REQUEST_METHOD: `GET` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:37:10.353093 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c32941-21fa-473b-8248-5d082da146a7 None admin] SCRIPT_NAME: `/identity` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:37:10.353368 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c32941-21fa-473b-8248-5d082da146a7 None admin] PATH_INFO: `/v3/roles/service` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:37:10.365265 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83c32941-21fa-473b-8248-5d082da146a7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 08:37:10.371529 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application [None req-83c32941-21fa-473b-8248-5d082da146a7 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 28 08:37:10.371529 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:37:10.371529 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:37:10.371529 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:37:10.371529 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:37:10.371529 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:37:10.371529 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:37:10.371529 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:37:10.371529 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:37:10.371529 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:37:10.371529 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:37:10.371529 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:37:10.371529 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 08:37:10.371529 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 08:37:10.371529 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 08:37:10.371529 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 08:37:10.372639 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 08:37:10.372639 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 08:37:10.372639 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 08:37:10.372639 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 08:37:10.372639 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:37:10.372639 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:37:10.372639 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:37:10.372639 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:37:10.372639 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:37:10.372639 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:37:10.372639 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:37:10.372639 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application with Lock( Jul 28 08:37:10.372639 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:37:10.372639 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:37:10.372639 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:37:10.372639 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:37:10.373686 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:37:10.373686 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:37:10.373686 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:37:10.373686 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:37:10.373686 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 08:37:10.373686 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 08:37:10.373686 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 08:37:10.373686 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 08:37:10.373686 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 08:37:10.373686 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 08:37:10.373686 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 28 08:37:10.373686 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application Jul 28 08:37:10.373686 dv-cinder-851351-1-smb devstack@keystone.service[282898]: [pid: 282898|app: 0|req: 345/681] 10.222.0.42 () {56 vars in 1102 bytes} [Thu Jul 28 08:37:10 2022] GET /identity/v3/roles/service => generated 85 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:37:10.374521 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c32941-21fa-473b-8248-5d082da146a7 None admin] Authenticating user token {{(pid=282898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:37:10.393213 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2a0504-4194-493f-8e3f-d5056cdc9fe3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282899) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:37:10.393851 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2a0504-4194-493f-8e3f-d5056cdc9fe3 None admin] REQUEST_METHOD: `GET` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:37:10.394132 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2a0504-4194-493f-8e3f-d5056cdc9fe3 None admin] SCRIPT_NAME: `/identity` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:37:10.394405 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2a0504-4194-493f-8e3f-d5056cdc9fe3 None admin] PATH_INFO: `/v3/domains` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:37:10.395113 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc2a0504-4194-493f-8e3f-d5056cdc9fe3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=282899) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:37:10.395417 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc2a0504-4194-493f-8e3f-d5056cdc9fe3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:37:10.396820 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc2a0504-4194-493f-8e3f-d5056cdc9fe3 None admin] RBAC: Authorization granted {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:37:10.414257 dv-cinder-851351-1-smb devstack@keystone.service[282899]: [pid: 282899|app: 0|req: 337/682] 10.222.0.42 () {56 vars in 1109 bytes} [Thu Jul 28 08:37:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:37:10.415234 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2a0504-4194-493f-8e3f-d5056cdc9fe3 None admin] Authenticating user token {{(pid=282899) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:37:10.483920 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c32941-21fa-473b-8248-5d082da146a7 None admin] Validating token access rules against request {{(pid=282898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:37:10.524841 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e039450-ff17-437f-99f0-131f69cb55ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:37:10.525805 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e039450-ff17-437f-99f0-131f69cb55ab None admin] REQUEST_METHOD: `GET` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:37:10.526083 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e039450-ff17-437f-99f0-131f69cb55ab None admin] SCRIPT_NAME: `/identity` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:37:10.526354 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e039450-ff17-437f-99f0-131f69cb55ab None admin] PATH_INFO: `/v3/role_assignments` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:37:10.526811 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2a0504-4194-493f-8e3f-d5056cdc9fe3 None admin] Validating token access rules against request {{(pid=282899) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:37:10.527165 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e039450-ff17-437f-99f0-131f69cb55ab None admin] RBAC: Adding query filter params (role.id=aa4daecf3ff74fa1b7d53041a4659723, scope.project.id=5cde68cbfb9042dc9f36af3aacea2473, user.id=e179a9d6bf024305ad96e6fe539413e6) {{(pid=282898) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:37:10.527480 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e039450-ff17-437f-99f0-131f69cb55ab None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:37:10.528993 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e039450-ff17-437f-99f0-131f69cb55ab None admin] RBAC: Authorization granted {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:37:10.536047 dv-cinder-851351-1-smb devstack@keystone.service[282898]: [pid: 282898|app: 0|req: 346/683] 10.222.0.42 () {56 vars in 1374 bytes} [Thu Jul 28 08:37:10 2022] GET /identity/v3/role_assignments?user.id=e179a9d6bf024305ad96e6fe539413e6&scope.project.id=5cde68cbfb9042dc9f36af3aacea2473&role.id=aa4daecf3ff74fa1b7d53041a4659723 => generated 608 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:37:10.537694 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e039450-ff17-437f-99f0-131f69cb55ab None admin] Authenticating user token {{(pid=282898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:37:10.569475 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-520b596b-5bb0-425a-8a8e-33bbdbb382b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282899) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:37:10.570492 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520b596b-5bb0-425a-8a8e-33bbdbb382b6 None admin] REQUEST_METHOD: `GET` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:37:10.570492 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520b596b-5bb0-425a-8a8e-33bbdbb382b6 None admin] SCRIPT_NAME: `/identity` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:37:10.570699 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520b596b-5bb0-425a-8a8e-33bbdbb382b6 None admin] PATH_INFO: `/v3/projects` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:37:10.571448 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-520b596b-5bb0-425a-8a8e-33bbdbb382b6 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=282899) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:37:10.571759 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-520b596b-5bb0-425a-8a8e-33bbdbb382b6 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:37:10.573466 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-520b596b-5bb0-425a-8a8e-33bbdbb382b6 None admin] RBAC: Authorization granted {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:37:10.585707 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG dbcounter [-] [282898] Writing DB stats keystone:SELECT=100 {{(pid=282898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:37:10.590166 dv-cinder-851351-1-smb devstack@keystone.service[282899]: [pid: 282899|app: 0|req: 338/684] 10.222.0.42 () {56 vars in 1148 bytes} [Thu Jul 28 08:37:10 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:37:10.590166 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-520b596b-5bb0-425a-8a8e-33bbdbb382b6 None admin] Authenticating user token {{(pid=282899) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:37:10.610994 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG dbcounter [-] [282899] Writing DB stats keystone:SELECT=100 {{(pid=282899) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:37:10.689843 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e039450-ff17-437f-99f0-131f69cb55ab None admin] Validating token access rules against request {{(pid=282898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:37:10.731612 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b221e0fe-8e95-4478-93f4-4dc60e664243 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:37:10.732251 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b221e0fe-8e95-4478-93f4-4dc60e664243 None admin] REQUEST_METHOD: `GET` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:37:10.732536 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b221e0fe-8e95-4478-93f4-4dc60e664243 None admin] SCRIPT_NAME: `/identity` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:37:10.732854 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b221e0fe-8e95-4478-93f4-4dc60e664243 None admin] PATH_INFO: `/v3/roles` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:37:10.733638 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b221e0fe-8e95-4478-93f4-4dc60e664243 None admin] RBAC: Adding query filter params (name=service) {{(pid=282898) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:37:10.733907 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b221e0fe-8e95-4478-93f4-4dc60e664243 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:37:10.735321 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b221e0fe-8e95-4478-93f4-4dc60e664243 None admin] RBAC: Authorization granted {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:37:10.738308 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-520b596b-5bb0-425a-8a8e-33bbdbb382b6 None admin] Validating token access rules against request {{(pid=282899) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:37:10.749747 dv-cinder-851351-1-smb devstack@keystone.service[282898]: [pid: 282898|app: 0|req: 347/685] 10.222.0.42 () {56 vars in 1103 bytes} [Thu Jul 28 08:37:10 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:37:10.749747 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b221e0fe-8e95-4478-93f4-4dc60e664243 None admin] Authenticating user token {{(pid=282898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:37:10.790814 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5cbe31a-81b3-47d2-9a51-0fc465feb5aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282899) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:37:10.791370 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5cbe31a-81b3-47d2-9a51-0fc465feb5aa None admin] REQUEST_METHOD: `GET` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:37:10.791604 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5cbe31a-81b3-47d2-9a51-0fc465feb5aa None admin] SCRIPT_NAME: `/identity` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:37:10.791870 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5cbe31a-81b3-47d2-9a51-0fc465feb5aa None admin] PATH_INFO: `/v3/users/nova` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:37:10.805495 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5cbe31a-81b3-47d2-9a51-0fc465feb5aa None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:37:10.806977 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5cbe31a-81b3-47d2-9a51-0fc465feb5aa None admin] RBAC: Authorization granted {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:37:10.820590 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application [None req-c5cbe31a-81b3-47d2-9a51-0fc465feb5aa None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 28 08:37:10.820590 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:37:10.820590 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:37:10.820590 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:37:10.820590 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:37:10.820590 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:37:10.820590 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:37:10.820590 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:37:10.820590 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:37:10.820590 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:37:10.820590 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:37:10.820590 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:37:10.820590 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 28 08:37:10.820590 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 28 08:37:10.820590 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 28 08:37:10.820590 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 28 08:37:10.821756 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:37:10.821756 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:37:10.821756 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 28 08:37:10.821756 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 08:37:10.821756 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 28 08:37:10.821756 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 08:37:10.821756 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:37:10.821756 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:37:10.821756 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:37:10.821756 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:37:10.821756 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:37:10.821756 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application with Lock( Jul 28 08:37:10.821756 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:37:10.821756 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:37:10.821756 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:37:10.821756 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:37:10.821756 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:37:10.821756 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:37:10.822898 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:37:10.822898 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:37:10.822898 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 28 08:37:10.822898 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 28 08:37:10.822898 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 28 08:37:10.822898 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 28 08:37:10.822898 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 28 08:37:10.822898 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 28 08:37:10.822898 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 28 08:37:10.822898 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application Jul 28 08:37:10.823557 dv-cinder-851351-1-smb devstack@keystone.service[282899]: [pid: 282899|app: 0|req: 339/686] 10.222.0.42 () {56 vars in 1093 bytes} [Thu Jul 28 08:37:10 2022] GET /identity/v3/users/nova => generated 82 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:37:10.823986 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5cbe31a-81b3-47d2-9a51-0fc465feb5aa None admin] Authenticating user token {{(pid=282899) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:37:10.886499 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG dbcounter [-] [282898] Writing DB stats keystone:SELECT=100 {{(pid=282898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:37:10.907310 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG dbcounter [-] [282899] Writing DB stats keystone:SELECT=100 {{(pid=282899) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:37:10.927860 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b221e0fe-8e95-4478-93f4-4dc60e664243 None admin] Validating token access rules against request {{(pid=282898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:37:10.954891 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5cbe31a-81b3-47d2-9a51-0fc465feb5aa None admin] Validating token access rules against request {{(pid=282899) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:37:10.989350 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f32c93ce-e873-40ea-a433-f69527f4b747 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:37:10.990006 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32c93ce-e873-40ea-a433-f69527f4b747 None admin] REQUEST_METHOD: `GET` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:37:10.990289 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32c93ce-e873-40ea-a433-f69527f4b747 None admin] SCRIPT_NAME: `/identity` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:37:10.990563 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32c93ce-e873-40ea-a433-f69527f4b747 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:37:10.991385 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f32c93ce-e873-40ea-a433-f69527f4b747 None admin] RBAC: Adding query filter params (role.id=aa4daecf3ff74fa1b7d53041a4659723, scope.project.id=5cde68cbfb9042dc9f36af3aacea2473, user.id=7a2fa5c253dc4112bca7074204f01b0a) {{(pid=282898) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:37:10.991726 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f32c93ce-e873-40ea-a433-f69527f4b747 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:37:10.993191 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f32c93ce-e873-40ea-a433-f69527f4b747 None admin] RBAC: Authorization granted {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:37:10.993322 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2513a802-f7ee-4e44-929d-c1c1f2488fec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282899) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:37:10.993961 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2513a802-f7ee-4e44-929d-c1c1f2488fec None admin] REQUEST_METHOD: `GET` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:37:10.994244 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2513a802-f7ee-4e44-929d-c1c1f2488fec None admin] SCRIPT_NAME: `/identity` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:37:10.994518 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2513a802-f7ee-4e44-929d-c1c1f2488fec None admin] PATH_INFO: `/v3/domains/Default` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:37:11.001079 dv-cinder-851351-1-smb devstack@keystone.service[282898]: [pid: 282898|app: 0|req: 348/687] 10.222.0.42 () {56 vars in 1374 bytes} [Thu Jul 28 08:37:10 2022] GET /identity/v3/role_assignments?user.id=7a2fa5c253dc4112bca7074204f01b0a&scope.project.id=5cde68cbfb9042dc9f36af3aacea2473&role.id=aa4daecf3ff74fa1b7d53041a4659723 => generated 608 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:37:11.001963 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f32c93ce-e873-40ea-a433-f69527f4b747 None admin] Authenticating user token {{(pid=282898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:37:11.019954 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2513a802-f7ee-4e44-929d-c1c1f2488fec None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:37:11.021668 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2513a802-f7ee-4e44-929d-c1c1f2488fec None admin] RBAC: Authorization granted {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:37:11.050944 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application [None req-2513a802-f7ee-4e44-929d-c1c1f2488fec None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 08:37:11.050944 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:37:11.050944 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:37:11.050944 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:37:11.050944 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:37:11.050944 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:37:11.050944 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:37:11.050944 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:37:11.050944 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:37:11.050944 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:37:11.050944 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:37:11.050944 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:37:11.050944 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 08:37:11.050944 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 08:37:11.050944 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 08:37:11.053333 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 08:37:11.053333 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:37:11.053333 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:37:11.053333 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:37:11.053333 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:37:11.053333 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:37:11.053333 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:37:11.053333 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:37:11.053333 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application with Lock( Jul 28 08:37:11.053333 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:37:11.053333 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:37:11.053333 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:37:11.053333 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:37:11.053333 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:37:11.053333 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:37:11.053333 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:37:11.053333 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:37:11.055652 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 08:37:11.055652 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 08:37:11.055652 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 08:37:11.055652 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application Jul 28 08:37:11.055652 dv-cinder-851351-1-smb devstack@keystone.service[282899]: [pid: 282899|app: 0|req: 340/688] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 08:37:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:37:11.066099 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2513a802-f7ee-4e44-929d-c1c1f2488fec None admin] Authenticating user token {{(pid=282899) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:37:11.226002 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f32c93ce-e873-40ea-a433-f69527f4b747 None admin] Validating token access rules against request {{(pid=282898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:37:11.248909 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2513a802-f7ee-4e44-929d-c1c1f2488fec None admin] Validating token access rules against request {{(pid=282899) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:37:11.271817 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea393d5-f768-4706-a1e0-c573df1e88ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:37:11.273032 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG dbcounter [-] [282899] Writing DB stats keystone:SELECT=100 {{(pid=282899) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:37:11.273702 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea393d5-f768-4706-a1e0-c573df1e88ba None admin] REQUEST_METHOD: `GET` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:37:11.273702 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea393d5-f768-4706-a1e0-c573df1e88ba None admin] SCRIPT_NAME: `/identity` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:37:11.273936 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea393d5-f768-4706-a1e0-c573df1e88ba None admin] PATH_INFO: `/v3/users` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:37:11.274877 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ea393d5-f768-4706-a1e0-c573df1e88ba None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=282898) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:37:11.276578 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ea393d5-f768-4706-a1e0-c573df1e88ba None admin] RBAC: Authorizing `identity:list_users()` {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:37:11.278106 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ea393d5-f768-4706-a1e0-c573df1e88ba None admin] RBAC: Authorization granted {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:37:11.294448 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa7afa9-e1c4-43b4-8a72-78ee3fc52a2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282899) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:37:11.295092 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa7afa9-e1c4-43b4-8a72-78ee3fc52a2e None admin] REQUEST_METHOD: `GET` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:37:11.295376 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa7afa9-e1c4-43b4-8a72-78ee3fc52a2e None admin] SCRIPT_NAME: `/identity` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:37:11.295655 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa7afa9-e1c4-43b4-8a72-78ee3fc52a2e None admin] PATH_INFO: `/v3/domains` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:37:11.296393 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa7afa9-e1c4-43b4-8a72-78ee3fc52a2e None admin] RBAC: Adding query filter params (name=Default) {{(pid=282899) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:37:11.296726 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa7afa9-e1c4-43b4-8a72-78ee3fc52a2e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:37:11.298177 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa7afa9-e1c4-43b4-8a72-78ee3fc52a2e None admin] RBAC: Authorization granted {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:37:11.304698 dv-cinder-851351-1-smb devstack@keystone.service[282898]: [pid: 282898|app: 0|req: 349/689] 10.222.0.42 () {56 vars in 1133 bytes} [Thu Jul 28 08:37:11 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 303 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:37:11.307236 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b681b419-a6c3-48a5-a0eb-4a2b673d6e90 None None] REQUEST_METHOD: `GET` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:37:11.307806 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b681b419-a6c3-48a5-a0eb-4a2b673d6e90 None None] SCRIPT_NAME: `/identity` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:37:11.308313 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b681b419-a6c3-48a5-a0eb-4a2b673d6e90 None None] PATH_INFO: `/` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:37:11.311075 dv-cinder-851351-1-smb devstack@keystone.service[282898]: [pid: 282898|app: 0|req: 350/690] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 08:37:11 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 08:37:11.312113 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b681b419-a6c3-48a5-a0eb-4a2b673d6e90 None None] Authenticating user token {{(pid=282898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:37:11.320705 dv-cinder-851351-1-smb devstack@keystone.service[282899]: [pid: 282899|app: 0|req: 341/691] 10.222.0.42 () {56 vars in 1109 bytes} [Thu Jul 28 08:37:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 08:37:11.320705 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a18177e-391f-4f15-93b1-c0997fbfe09c None None] REQUEST_METHOD: `POST` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:37:11.320705 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a18177e-391f-4f15-93b1-c0997fbfe09c None None] SCRIPT_NAME: `/identity` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:37:11.320705 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a18177e-391f-4f15-93b1-c0997fbfe09c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:37:11.326342 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG dbcounter [-] [282898] Writing DB stats keystone:SELECT=100 {{(pid=282898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:37:11.341583 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.auth.core [None req-1a18177e-391f-4f15-93b1-c0997fbfe09c None None] MFA Rules not processed for user `2be990a66857410a87ffa7609aec4f7b`. Rule list: `[]` (Enabled: `True`). {{(pid=282899) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 08:37:11.342882 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.fernet_utils [None req-1a18177e-391f-4f15-93b1-c0997fbfe09c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=282899) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:37:11.448045 dv-cinder-851351-1-smb devstack@keystone.service[282899]: [pid: 282899|app: 0|req: 342/692] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 08:37:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 08:37:11.449524 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a18177e-391f-4f15-93b1-c0997fbfe09c None None] Authenticating user token {{(pid=282899) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:37:11.469439 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b681b419-a6c3-48a5-a0eb-4a2b673d6e90 None None] Validating token access rules against request {{(pid=282898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:37:11.520114 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aede9e24-70cd-4a6f-a131-edd17e4bc6d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:37:11.521292 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aede9e24-70cd-4a6f-a131-edd17e4bc6d8 None admin] REQUEST_METHOD: `GET` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:37:11.521803 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aede9e24-70cd-4a6f-a131-edd17e4bc6d8 None admin] SCRIPT_NAME: `/identity` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:37:11.522379 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aede9e24-70cd-4a6f-a131-edd17e4bc6d8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:37:11.571774 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a18177e-391f-4f15-93b1-c0997fbfe09c None None] Validating token access rules against request {{(pid=282899) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:37:11.583904 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG dbcounter [-] [282899] Writing DB stats keystone:SELECT=100 {{(pid=282899) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:37:11.605741 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aede9e24-70cd-4a6f-a131-edd17e4bc6d8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:37:11.608305 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aede9e24-70cd-4a6f-a131-edd17e4bc6d8 None admin] RBAC: Authorization granted {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:37:11.614656 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28cc8a3e-288a-4405-985e-a1a796626958 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282899) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:37:11.615460 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28cc8a3e-288a-4405-985e-a1a796626958 None admin] REQUEST_METHOD: `GET` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:37:11.615851 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28cc8a3e-288a-4405-985e-a1a796626958 None admin] SCRIPT_NAME: `/identity` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:37:11.616229 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28cc8a3e-288a-4405-985e-a1a796626958 None admin] PATH_INFO: `/v3/users/swift` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:37:11.619154 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG dbcounter [-] [282898] Writing DB stats keystone:SELECT=100 {{(pid=282898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:37:11.625539 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28cc8a3e-288a-4405-985e-a1a796626958 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:37:11.627240 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28cc8a3e-288a-4405-985e-a1a796626958 None admin] RBAC: Authorization granted {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:37:11.642188 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application [None req-28cc8a3e-288a-4405-985e-a1a796626958 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 28 08:37:11.642188 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:37:11.642188 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:37:11.642188 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:37:11.642188 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:37:11.642188 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:37:11.642188 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:37:11.642188 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:37:11.642188 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:37:11.642188 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:37:11.642188 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:37:11.642188 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:37:11.642188 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 28 08:37:11.642188 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 28 08:37:11.642188 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 28 08:37:11.642188 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 28 08:37:11.644044 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:37:11.644044 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:37:11.644044 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 28 08:37:11.644044 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 08:37:11.644044 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 28 08:37:11.644044 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 08:37:11.644044 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:37:11.644044 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:37:11.644044 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:37:11.644044 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:37:11.644044 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:37:11.644044 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application with Lock( Jul 28 08:37:11.644044 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:37:11.644044 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:37:11.644044 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:37:11.644044 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:37:11.644044 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:37:11.644044 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:37:11.646751 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:37:11.646751 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:37:11.646751 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 28 08:37:11.646751 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 28 08:37:11.646751 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 28 08:37:11.646751 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 28 08:37:11.646751 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 28 08:37:11.646751 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 28 08:37:11.646751 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 28 08:37:11.646751 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application Jul 28 08:37:11.651004 dv-cinder-851351-1-smb devstack@keystone.service[282899]: [pid: 282899|app: 0|req: 343/693] 10.222.0.42 () {56 vars in 1096 bytes} [Thu Jul 28 08:37:11 2022] GET /identity/v3/users/swift => generated 83 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:37:11.651956 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28cc8a3e-288a-4405-985e-a1a796626958 None admin] Authenticating user token {{(pid=282899) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:37:11.757524 dv-cinder-851351-1-smb devstack@keystone.service[282898]: [pid: 282898|app: 0|req: 351/694] 10.222.0.42 () {58 vars in 1282 bytes} [Thu Jul 28 08:37:11 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 445 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 28 08:37:11.758325 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aede9e24-70cd-4a6f-a131-edd17e4bc6d8 None admin] Authenticating user token {{(pid=282898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:37:11.773279 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28cc8a3e-288a-4405-985e-a1a796626958 None admin] Validating token access rules against request {{(pid=282899) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:37:11.821292 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e7e787-9e62-4ff7-9889-1e33f6dcb7b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282899) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:37:11.822421 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e7e787-9e62-4ff7-9889-1e33f6dcb7b3 None admin] REQUEST_METHOD: `GET` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:37:11.822940 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e7e787-9e62-4ff7-9889-1e33f6dcb7b3 None admin] SCRIPT_NAME: `/identity` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:37:11.823442 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e7e787-9e62-4ff7-9889-1e33f6dcb7b3 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:37:11.824333 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46e7e787-9e62-4ff7-9889-1e33f6dcb7b3 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:37:11.826103 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46e7e787-9e62-4ff7-9889-1e33f6dcb7b3 None admin] RBAC: Authorization granted {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:37:11.839638 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application [None req-46e7e787-9e62-4ff7-9889-1e33f6dcb7b3 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 28 08:37:11.839638 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:37:11.839638 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 28 08:37:11.839638 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 28 08:37:11.839638 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 28 08:37:11.839638 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 28 08:37:11.839638 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 28 08:37:11.839638 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 08:37:11.839638 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 28 08:37:11.839638 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application Jul 28 08:37:11.839638 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 28 08:37:11.839638 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application Jul 28 08:37:11.839638 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:37:11.839638 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:37:11.839638 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:37:11.839638 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:37:11.841026 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:37:11.841026 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:37:11.841026 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:37:11.841026 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:37:11.841026 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:37:11.841026 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:37:11.841026 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:37:11.841026 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 28 08:37:11.841026 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 28 08:37:11.841026 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 28 08:37:11.841026 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 28 08:37:11.841026 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:37:11.841026 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:37:11.841026 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:37:11.841026 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:37:11.841026 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:37:11.842049 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:37:11.842049 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:37:11.842049 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application with Lock( Jul 28 08:37:11.842049 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:37:11.842049 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:37:11.842049 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:37:11.842049 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:37:11.842049 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:37:11.842049 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:37:11.842049 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:37:11.842049 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:37:11.842049 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 28 08:37:11.842049 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 08:37:11.842049 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 28 08:37:11.842049 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application Jul 28 08:37:11.850026 dv-cinder-851351-1-smb devstack@keystone.service[282899]: [pid: 282899|app: 0|req: 344/695] 10.222.0.42 () {56 vars in 1129 bytes} [Thu Jul 28 08:37:11 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:37:11.850026 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e7e787-9e62-4ff7-9889-1e33f6dcb7b3 None admin] Authenticating user token {{(pid=282899) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:37:11.889936 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG dbcounter [-] [282899] Writing DB stats keystone:SELECT=100 {{(pid=282899) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:37:11.992688 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e7e787-9e62-4ff7-9889-1e33f6dcb7b3 None admin] Validating token access rules against request {{(pid=282899) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:37:12.012594 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aede9e24-70cd-4a6f-a131-edd17e4bc6d8 None admin] Validating token access rules against request {{(pid=282898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:37:12.021075 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG dbcounter [-] [282898] Writing DB stats keystone:SELECT=100 {{(pid=282898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:37:12.043488 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17831de8-34a0-4a70-ba80-5980ff5e27d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282899) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:37:12.044956 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17831de8-34a0-4a70-ba80-5980ff5e27d1 None admin] REQUEST_METHOD: `GET` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:37:12.045726 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17831de8-34a0-4a70-ba80-5980ff5e27d1 None admin] SCRIPT_NAME: `/identity` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:37:12.046218 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17831de8-34a0-4a70-ba80-5980ff5e27d1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:37:12.052754 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711e1f99-19e0-489e-b498-a3e9601d8804 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:37:12.053471 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711e1f99-19e0-489e-b498-a3e9601d8804 None admin] REQUEST_METHOD: `GET` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:37:12.053866 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711e1f99-19e0-489e-b498-a3e9601d8804 None admin] SCRIPT_NAME: `/identity` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:37:12.054361 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711e1f99-19e0-489e-b498-a3e9601d8804 None admin] PATH_INFO: `/v3/users` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:37:12.055570 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-711e1f99-19e0-489e-b498-a3e9601d8804 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=282898) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:37:12.055955 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-711e1f99-19e0-489e-b498-a3e9601d8804 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:37:12.058362 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-711e1f99-19e0-489e-b498-a3e9601d8804 None admin] RBAC: Authorization granted {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:37:12.064583 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17831de8-34a0-4a70-ba80-5980ff5e27d1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:37:12.066915 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17831de8-34a0-4a70-ba80-5980ff5e27d1 None admin] RBAC: Authorization granted {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:37:12.080190 dv-cinder-851351-1-smb devstack@keystone.service[282898]: [pid: 282898|app: 0|req: 352/696] 10.222.0.42 () {56 vars in 1135 bytes} [Thu Jul 28 08:37:11 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 322 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:37:12.086029 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711e1f99-19e0-489e-b498-a3e9601d8804 None admin] Authenticating user token {{(pid=282898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:37:12.092851 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application [None req-17831de8-34a0-4a70-ba80-5980ff5e27d1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 08:37:12.092851 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:37:12.092851 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:37:12.092851 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:37:12.092851 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:37:12.092851 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:37:12.092851 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:37:12.092851 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:37:12.092851 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:37:12.092851 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:37:12.092851 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:37:12.092851 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:37:12.092851 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 08:37:12.092851 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 08:37:12.092851 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 08:37:12.093994 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 08:37:12.093994 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:37:12.093994 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:37:12.093994 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:37:12.093994 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:37:12.093994 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:37:12.093994 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:37:12.093994 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:37:12.093994 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application with Lock( Jul 28 08:37:12.093994 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:37:12.093994 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:37:12.093994 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:37:12.093994 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:37:12.093994 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:37:12.093994 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:37:12.093994 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:37:12.093994 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:37:12.095044 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 08:37:12.095044 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 08:37:12.095044 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 08:37:12.095044 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application Jul 28 08:37:12.098256 dv-cinder-851351-1-smb devstack@keystone.service[282899]: [pid: 282899|app: 0|req: 345/697] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 08:37:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 249 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:37:12.100072 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17831de8-34a0-4a70-ba80-5980ff5e27d1 None admin] Authenticating user token {{(pid=282899) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:37:12.202211 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711e1f99-19e0-489e-b498-a3e9601d8804 None admin] Validating token access rules against request {{(pid=282898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:37:12.218993 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG dbcounter [-] [282899] Writing DB stats keystone:SELECT=100 {{(pid=282899) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:37:12.244985 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17831de8-34a0-4a70-ba80-5980ff5e27d1 None admin] Validating token access rules against request {{(pid=282899) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:37:12.247643 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ecbca3-a30e-4ff4-866e-8f013fe65f87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:37:12.248629 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ecbca3-a30e-4ff4-866e-8f013fe65f87 None admin] REQUEST_METHOD: `GET` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:37:12.249194 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ecbca3-a30e-4ff4-866e-8f013fe65f87 None admin] SCRIPT_NAME: `/identity` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:37:12.249669 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ecbca3-a30e-4ff4-866e-8f013fe65f87 None admin] PATH_INFO: `/v3/services` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:37:12.250652 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ecbca3-a30e-4ff4-866e-8f013fe65f87 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=282898) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:37:12.251170 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ecbca3-a30e-4ff4-866e-8f013fe65f87 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:37:12.252927 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ecbca3-a30e-4ff4-866e-8f013fe65f87 None admin] RBAC: Authorization granted {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:37:12.263503 dv-cinder-851351-1-smb devstack@keystone.service[282898]: [pid: 282898|app: 0|req: 353/698] 10.222.0.42 () {56 vars in 1124 bytes} [Thu Jul 28 08:37:12 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:37:12.264968 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ecbca3-a30e-4ff4-866e-8f013fe65f87 None admin] Authenticating user token {{(pid=282898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:37:12.287447 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc00996-06e8-4aab-8b03-b54c00ac3ab5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282899) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:37:12.288150 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc00996-06e8-4aab-8b03-b54c00ac3ab5 None admin] REQUEST_METHOD: `GET` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:37:12.288562 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc00996-06e8-4aab-8b03-b54c00ac3ab5 None admin] SCRIPT_NAME: `/identity` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:37:12.288949 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc00996-06e8-4aab-8b03-b54c00ac3ab5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:37:12.297573 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG dbcounter [-] [282898] Writing DB stats keystone:SELECT=100 {{(pid=282898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:37:12.376844 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc00996-06e8-4aab-8b03-b54c00ac3ab5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:37:12.378957 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc00996-06e8-4aab-8b03-b54c00ac3ab5 None admin] RBAC: Authorization granted {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:37:12.380154 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ecbca3-a30e-4ff4-866e-8f013fe65f87 None admin] Validating token access rules against request {{(pid=282898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:37:12.416704 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c83857fe-36fe-4f9c-8aa8-1dc9dd5cac95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:37:12.417451 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83857fe-36fe-4f9c-8aa8-1dc9dd5cac95 None admin] REQUEST_METHOD: `GET` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:37:12.417805 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83857fe-36fe-4f9c-8aa8-1dc9dd5cac95 None admin] SCRIPT_NAME: `/identity` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:37:12.418151 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83857fe-36fe-4f9c-8aa8-1dc9dd5cac95 None admin] PATH_INFO: `/v3/domains` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:37:12.418935 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c83857fe-36fe-4f9c-8aa8-1dc9dd5cac95 None admin] RBAC: Adding query filter params (name=Default) {{(pid=282898) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:37:12.419314 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c83857fe-36fe-4f9c-8aa8-1dc9dd5cac95 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:37:12.420805 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c83857fe-36fe-4f9c-8aa8-1dc9dd5cac95 None admin] RBAC: Authorization granted {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:37:12.433404 dv-cinder-851351-1-smb devstack@keystone.service[282898]: [pid: 282898|app: 0|req: 354/699] 10.222.0.42 () {56 vars in 1109 bytes} [Thu Jul 28 08:37:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:37:12.434384 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c83857fe-36fe-4f9c-8aa8-1dc9dd5cac95 None admin] Authenticating user token {{(pid=282898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:37:12.528277 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG dbcounter [-] [282898] Writing DB stats keystone:SELECT=100 {{(pid=282898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:37:12.541668 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c83857fe-36fe-4f9c-8aa8-1dc9dd5cac95 None admin] Validating token access rules against request {{(pid=282898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:37:12.545998 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG dbcounter [-] [282899] Writing DB stats keystone:SELECT=100 {{(pid=282899) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:37:12.579876 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5b7ab0-8bad-4d83-ae37-9c08b5ffc39b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:37:12.580829 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5b7ab0-8bad-4d83-ae37-9c08b5ffc39b None admin] REQUEST_METHOD: `GET` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:37:12.581025 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5b7ab0-8bad-4d83-ae37-9c08b5ffc39b None admin] SCRIPT_NAME: `/identity` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:37:12.582587 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5b7ab0-8bad-4d83-ae37-9c08b5ffc39b None admin] PATH_INFO: `/v3/services` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:37:12.582587 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db5b7ab0-8bad-4d83-ae37-9c08b5ffc39b None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=282898) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:37:12.582587 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db5b7ab0-8bad-4d83-ae37-9c08b5ffc39b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:37:12.587770 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db5b7ab0-8bad-4d83-ae37-9c08b5ffc39b None admin] RBAC: Authorization granted {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:37:12.588205 dv-cinder-851351-1-smb devstack@keystone.service[282899]: [pid: 282899|app: 0|req: 346/700] 10.222.0.42 () {58 vars in 1282 bytes} [Thu Jul 28 08:37:12 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 484 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 28 08:37:12.590331 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc00996-06e8-4aab-8b03-b54c00ac3ab5 None admin] Authenticating user token {{(pid=282899) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:37:12.596834 dv-cinder-851351-1-smb devstack@keystone.service[282898]: [pid: 282898|app: 0|req: 355/701] 10.222.0.42 () {56 vars in 1124 bytes} [Thu Jul 28 08:37:12 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:37:12.603359 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5b7ab0-8bad-4d83-ae37-9c08b5ffc39b None admin] Authenticating user token {{(pid=282898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:37:12.730943 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc00996-06e8-4aab-8b03-b54c00ac3ab5 None admin] Validating token access rules against request {{(pid=282899) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:37:12.744368 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5b7ab0-8bad-4d83-ae37-9c08b5ffc39b None admin] Validating token access rules against request {{(pid=282898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:37:12.774127 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a61f03-9655-4ea7-a04b-c08d6ed9f9ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282899) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:37:12.775307 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a61f03-9655-4ea7-a04b-c08d6ed9f9ce None admin] REQUEST_METHOD: `GET` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:37:12.775812 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a61f03-9655-4ea7-a04b-c08d6ed9f9ce None admin] SCRIPT_NAME: `/identity` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:37:12.776315 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a61f03-9655-4ea7-a04b-c08d6ed9f9ce None admin] PATH_INFO: `/v3/projects/service` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:37:12.784826 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e58dc6-ddc5-4b9c-a728-dc0c4264fdf6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:37:12.785365 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2a61f03-9655-4ea7-a04b-c08d6ed9f9ce None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:37:12.785628 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e58dc6-ddc5-4b9c-a728-dc0c4264fdf6 None admin] REQUEST_METHOD: `GET` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:37:12.785977 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e58dc6-ddc5-4b9c-a728-dc0c4264fdf6 None admin] SCRIPT_NAME: `/identity` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:37:12.786316 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e58dc6-ddc5-4b9c-a728-dc0c4264fdf6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:37:12.787694 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2a61f03-9655-4ea7-a04b-c08d6ed9f9ce None admin] RBAC: Authorization granted {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:37:12.798886 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93e58dc6-ddc5-4b9c-a728-dc0c4264fdf6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:37:12.801045 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93e58dc6-ddc5-4b9c-a728-dc0c4264fdf6 None admin] RBAC: Authorization granted {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:37:12.808146 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application [None req-a2a61f03-9655-4ea7-a04b-c08d6ed9f9ce None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 08:37:12.808146 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:37:12.808146 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:37:12.808146 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:37:12.808146 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:37:12.808146 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:37:12.808146 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:37:12.808146 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:37:12.808146 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:37:12.808146 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:37:12.808146 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:37:12.808146 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:37:12.808146 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 28 08:37:12.808146 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 28 08:37:12.808146 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 28 08:37:12.809437 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 28 08:37:12.809437 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:37:12.809437 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:37:12.809437 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:37:12.809437 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:37:12.809437 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:37:12.809437 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:37:12.809437 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:37:12.809437 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application with Lock( Jul 28 08:37:12.809437 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:37:12.809437 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:37:12.809437 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:37:12.809437 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:37:12.809437 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:37:12.809437 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:37:12.809437 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:37:12.809437 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:37:12.810523 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 28 08:37:12.810523 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 28 08:37:12.810523 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 28 08:37:12.810523 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 28 08:37:12.810523 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 28 08:37:12.810523 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 28 08:37:12.810523 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 08:37:12.810523 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application Jul 28 08:37:12.816094 dv-cinder-851351-1-smb devstack@keystone.service[282899]: [pid: 282899|app: 0|req: 347/702] 10.222.0.42 () {56 vars in 1111 bytes} [Thu Jul 28 08:37:12 2022] GET /identity/v3/projects/service => generated 88 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:37:12.822853 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a61f03-9655-4ea7-a04b-c08d6ed9f9ce None admin] Authenticating user token {{(pid=282899) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:37:12.825658 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application [None req-93e58dc6-ddc5-4b9c-a728-dc0c4264fdf6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 08:37:12.825658 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:37:12.825658 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:37:12.825658 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:37:12.825658 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:37:12.825658 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:37:12.825658 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:37:12.825658 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:37:12.825658 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:37:12.825658 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:37:12.825658 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:37:12.825658 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:37:12.825658 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 08:37:12.825658 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 08:37:12.825658 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 08:37:12.826712 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 08:37:12.826712 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:37:12.826712 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:37:12.826712 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:37:12.826712 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:37:12.826712 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:37:12.826712 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:37:12.826712 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:37:12.826712 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application with Lock( Jul 28 08:37:12.826712 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:37:12.826712 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:37:12.826712 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:37:12.826712 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:37:12.826712 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:37:12.826712 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:37:12.826712 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:37:12.826712 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:37:12.828194 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 08:37:12.828194 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 08:37:12.828194 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 08:37:12.828194 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application Jul 28 08:37:12.828194 dv-cinder-851351-1-smb devstack@keystone.service[282898]: [pid: 282898|app: 0|req: 356/703] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 08:37:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:37:12.836366 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e58dc6-ddc5-4b9c-a728-dc0c4264fdf6 None admin] Authenticating user token {{(pid=282898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:37:12.844735 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG dbcounter [-] [282898] Writing DB stats keystone:SELECT=100 {{(pid=282898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:37:12.900386 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG dbcounter [-] [282899] Writing DB stats keystone:SELECT=100 {{(pid=282899) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:37:12.969710 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e58dc6-ddc5-4b9c-a728-dc0c4264fdf6 None admin] Validating token access rules against request {{(pid=282898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:37:12.978126 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a61f03-9655-4ea7-a04b-c08d6ed9f9ce None admin] Validating token access rules against request {{(pid=282899) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:37:13.017843 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95da4a0d-3832-436d-ad10-b1d09fca0605 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:37:13.018570 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95da4a0d-3832-436d-ad10-b1d09fca0605 None admin] REQUEST_METHOD: `GET` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:37:13.018882 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95da4a0d-3832-436d-ad10-b1d09fca0605 None admin] SCRIPT_NAME: `/identity` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:37:13.019182 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95da4a0d-3832-436d-ad10-b1d09fca0605 None admin] PATH_INFO: `/v3/domains` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:37:13.019684 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65162d95-2cc0-4642-9ee8-71d956cb3ddd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282899) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:37:13.019926 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95da4a0d-3832-436d-ad10-b1d09fca0605 None admin] RBAC: Adding query filter params (name=Default) {{(pid=282898) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:37:13.020239 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95da4a0d-3832-436d-ad10-b1d09fca0605 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:37:13.021102 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65162d95-2cc0-4642-9ee8-71d956cb3ddd None admin] REQUEST_METHOD: `GET` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:37:13.021687 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65162d95-2cc0-4642-9ee8-71d956cb3ddd None admin] SCRIPT_NAME: `/identity` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:37:13.021886 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95da4a0d-3832-436d-ad10-b1d09fca0605 None admin] RBAC: Authorization granted {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:37:13.022406 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65162d95-2cc0-4642-9ee8-71d956cb3ddd None admin] PATH_INFO: `/v3/projects` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:37:13.023520 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65162d95-2cc0-4642-9ee8-71d956cb3ddd None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=282899) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:37:13.024080 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65162d95-2cc0-4642-9ee8-71d956cb3ddd None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:37:13.025933 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65162d95-2cc0-4642-9ee8-71d956cb3ddd None admin] RBAC: Authorization granted {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:37:13.040756 dv-cinder-851351-1-smb devstack@keystone.service[282898]: [pid: 282898|app: 0|req: 357/704] 10.222.0.42 () {56 vars in 1109 bytes} [Thu Jul 28 08:37:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 08:37:13.042608 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577ade4d-c31f-44fc-a65f-83fc6e50d8ef None None] REQUEST_METHOD: `GET` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:37:13.042897 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577ade4d-c31f-44fc-a65f-83fc6e50d8ef None None] SCRIPT_NAME: `/identity` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:37:13.043171 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577ade4d-c31f-44fc-a65f-83fc6e50d8ef None None] PATH_INFO: `/` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:37:13.044709 dv-cinder-851351-1-smb devstack@keystone.service[282898]: [pid: 282898|app: 0|req: 358/705] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 08:37:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 08:37:13.045261 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-577ade4d-c31f-44fc-a65f-83fc6e50d8ef None None] Authenticating user token {{(pid=282898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:37:13.048407 dv-cinder-851351-1-smb devstack@keystone.service[282899]: [pid: 282899|app: 0|req: 348/706] 10.222.0.42 () {56 vars in 1148 bytes} [Thu Jul 28 08:37:12 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:37:13.052688 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2159be39-d4c1-4415-a561-bd2574609376 None None] REQUEST_METHOD: `POST` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:37:13.052688 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2159be39-d4c1-4415-a561-bd2574609376 None None] SCRIPT_NAME: `/identity` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:37:13.052688 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2159be39-d4c1-4415-a561-bd2574609376 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:37:13.080369 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.auth.core [None req-2159be39-d4c1-4415-a561-bd2574609376 None None] MFA Rules not processed for user `2be990a66857410a87ffa7609aec4f7b`. Rule list: `[]` (Enabled: `True`). {{(pid=282899) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 08:37:13.082465 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.fernet_utils [None req-2159be39-d4c1-4415-a561-bd2574609376 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=282899) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:37:13.138512 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG dbcounter [-] [282898] Writing DB stats keystone:SELECT=100 {{(pid=282898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:37:13.166407 dv-cinder-851351-1-smb devstack@keystone.service[282899]: [pid: 282899|app: 0|req: 349/707] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 08:37:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 28 08:37:13.167331 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2159be39-d4c1-4415-a561-bd2574609376 None None] Authenticating user token {{(pid=282899) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:37:13.198472 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-577ade4d-c31f-44fc-a65f-83fc6e50d8ef None None] Validating token access rules against request {{(pid=282898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:37:13.210259 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG dbcounter [-] [282899] Writing DB stats keystone:SELECT=100 {{(pid=282899) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:37:13.247837 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c91b6a-4218-4522-a113-1e57df25c9d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:37:13.248513 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c91b6a-4218-4522-a113-1e57df25c9d1 None admin] REQUEST_METHOD: `GET` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:37:13.248829 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c91b6a-4218-4522-a113-1e57df25c9d1 None admin] SCRIPT_NAME: `/identity` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:37:13.249105 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c91b6a-4218-4522-a113-1e57df25c9d1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:37:13.258728 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c91b6a-4218-4522-a113-1e57df25c9d1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:37:13.258728 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c91b6a-4218-4522-a113-1e57df25c9d1 None admin] RBAC: Authorization granted {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:37:13.272061 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application [None req-96c91b6a-4218-4522-a113-1e57df25c9d1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 08:37:13.272061 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:37:13.272061 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:37:13.272061 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:37:13.272061 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:37:13.272061 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:37:13.272061 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:37:13.272061 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:37:13.272061 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:37:13.272061 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:37:13.272061 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:37:13.272061 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:37:13.272061 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 28 08:37:13.272061 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 28 08:37:13.272061 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 28 08:37:13.273327 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 28 08:37:13.273327 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:37:13.273327 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:37:13.273327 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:37:13.273327 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:37:13.273327 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:37:13.273327 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:37:13.273327 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:37:13.273327 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application with Lock( Jul 28 08:37:13.273327 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:37:13.273327 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:37:13.273327 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:37:13.273327 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:37:13.273327 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:37:13.273327 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:37:13.273327 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:37:13.273327 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:37:13.275235 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 28 08:37:13.275235 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 28 08:37:13.275235 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 28 08:37:13.275235 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 28 08:37:13.275235 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 28 08:37:13.275235 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 28 08:37:13.275235 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 08:37:13.275235 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application Jul 28 08:37:13.275235 dv-cinder-851351-1-smb devstack@keystone.service[282898]: [pid: 282898|app: 0|req: 359/708] 10.222.0.42 () {56 vars in 1111 bytes} [Thu Jul 28 08:37:13 2022] GET /identity/v3/projects/service => generated 88 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:37:13.275235 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c91b6a-4218-4522-a113-1e57df25c9d1 None admin] Authenticating user token {{(pid=282898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:37:13.306353 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2159be39-d4c1-4415-a561-bd2574609376 None None] Validating token access rules against request {{(pid=282899) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:37:13.347081 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d493d4f-e298-4ea1-a20d-3e1fc2fb849a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282899) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:37:13.347847 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d493d4f-e298-4ea1-a20d-3e1fc2fb849a None admin] REQUEST_METHOD: `GET` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:37:13.348129 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d493d4f-e298-4ea1-a20d-3e1fc2fb849a None admin] SCRIPT_NAME: `/identity` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:37:13.348404 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d493d4f-e298-4ea1-a20d-3e1fc2fb849a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:37:13.349251 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d493d4f-e298-4ea1-a20d-3e1fc2fb849a None admin] RBAC: Adding query filter params (role.id=a0e2a00bf94d40f38629d6b5293e3aee, scope.project.id=5cde68cbfb9042dc9f36af3aacea2473, user.id=5e192fe026ef4f109b9a1099815c5926) {{(pid=282899) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:37:13.349562 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d493d4f-e298-4ea1-a20d-3e1fc2fb849a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:37:13.351152 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d493d4f-e298-4ea1-a20d-3e1fc2fb849a None admin] RBAC: Authorization granted {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:37:13.364710 dv-cinder-851351-1-smb devstack@keystone.service[282899]: [pid: 282899|app: 0|req: 350/709] 10.222.0.42 () {56 vars in 1374 bytes} [Thu Jul 28 08:37:13 2022] GET /identity/v3/role_assignments?user.id=5e192fe026ef4f109b9a1099815c5926&scope.project.id=5cde68cbfb9042dc9f36af3aacea2473&role.id=a0e2a00bf94d40f38629d6b5293e3aee => generated 259 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:37:13.364710 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05648e48-23c8-451d-959c-15df7e606287 None None] REQUEST_METHOD: `GET` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:37:13.364710 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05648e48-23c8-451d-959c-15df7e606287 None None] SCRIPT_NAME: `/identity` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:37:13.364710 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05648e48-23c8-451d-959c-15df7e606287 None None] PATH_INFO: `/` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:37:13.365481 dv-cinder-851351-1-smb devstack@keystone.service[282899]: [pid: 282899|app: 0|req: 351/710] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 08:37:13 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 08:37:13.366487 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05648e48-23c8-451d-959c-15df7e606287 None None] Authenticating user token {{(pid=282899) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:37:13.404767 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c91b6a-4218-4522-a113-1e57df25c9d1 None admin] Validating token access rules against request {{(pid=282898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:37:13.436250 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG dbcounter [-] [282898] Writing DB stats keystone:SELECT=100 {{(pid=282898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:37:13.452842 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6614e1-c7d9-42c0-9a40-82469234e29d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:37:13.453871 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6614e1-c7d9-42c0-9a40-82469234e29d None admin] REQUEST_METHOD: `GET` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:37:13.454866 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6614e1-c7d9-42c0-9a40-82469234e29d None admin] SCRIPT_NAME: `/identity` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:37:13.455357 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6614e1-c7d9-42c0-9a40-82469234e29d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:37:13.470636 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da6614e1-c7d9-42c0-9a40-82469234e29d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:37:13.473064 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da6614e1-c7d9-42c0-9a40-82469234e29d None admin] RBAC: Authorization granted {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:37:13.491526 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application [None req-da6614e1-c7d9-42c0-9a40-82469234e29d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 08:37:13.491526 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:37:13.491526 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:37:13.491526 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:37:13.491526 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:37:13.491526 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:37:13.491526 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:37:13.491526 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:37:13.491526 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:37:13.491526 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:37:13.491526 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:37:13.491526 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:37:13.491526 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 08:37:13.491526 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 08:37:13.491526 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 08:37:13.492738 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 08:37:13.492738 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:37:13.492738 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:37:13.492738 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:37:13.492738 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:37:13.492738 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:37:13.492738 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:37:13.492738 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:37:13.492738 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application with Lock( Jul 28 08:37:13.492738 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:37:13.492738 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:37:13.492738 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:37:13.492738 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:37:13.492738 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:37:13.492738 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:37:13.492738 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:37:13.492738 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:37:13.493834 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 08:37:13.493834 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 08:37:13.493834 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 08:37:13.493834 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application Jul 28 08:37:13.496241 dv-cinder-851351-1-smb devstack@keystone.service[282898]: [pid: 282898|app: 0|req: 360/711] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 08:37:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:37:13.497971 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4258b8-31c9-42a1-9090-958cdccffe7d None None] REQUEST_METHOD: `POST` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:37:13.498460 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4258b8-31c9-42a1-9090-958cdccffe7d None None] SCRIPT_NAME: `/identity` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:37:13.498912 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4258b8-31c9-42a1-9090-958cdccffe7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:37:13.514030 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG dbcounter [-] [282899] Writing DB stats keystone:SELECT=100 {{(pid=282899) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:37:13.520963 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.auth.core [None req-8a4258b8-31c9-42a1-9090-958cdccffe7d None None] MFA Rules not processed for user `2be990a66857410a87ffa7609aec4f7b`. Rule list: `[]` (Enabled: `True`). {{(pid=282898) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 08:37:13.521223 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05648e48-23c8-451d-959c-15df7e606287 None None] Validating token access rules against request {{(pid=282899) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:37:13.522718 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.fernet_utils [None req-8a4258b8-31c9-42a1-9090-958cdccffe7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=282898) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:37:13.576346 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce6415b-b138-4477-bccd-b58969875efe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282899) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:37:13.577058 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce6415b-b138-4477-bccd-b58969875efe None admin] REQUEST_METHOD: `GET` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:37:13.577340 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce6415b-b138-4477-bccd-b58969875efe None admin] SCRIPT_NAME: `/identity` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:37:13.577613 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce6415b-b138-4477-bccd-b58969875efe None admin] PATH_INFO: `/v3/projects` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:37:13.578386 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce6415b-b138-4477-bccd-b58969875efe None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=282899) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:37:13.579607 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce6415b-b138-4477-bccd-b58969875efe None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:37:13.581201 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce6415b-b138-4477-bccd-b58969875efe None admin] RBAC: Authorization granted {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:37:13.597579 dv-cinder-851351-1-smb devstack@keystone.service[282899]: [pid: 282899|app: 0|req: 352/712] 10.222.0.42 () {56 vars in 1148 bytes} [Thu Jul 28 08:37:13 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:37:13.598714 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce6415b-b138-4477-bccd-b58969875efe None admin] Authenticating user token {{(pid=282899) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:37:13.619753 dv-cinder-851351-1-smb devstack@keystone.service[282898]: [pid: 282898|app: 0|req: 361/713] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 08:37:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 08:37:13.620892 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4258b8-31c9-42a1-9090-958cdccffe7d None None] Authenticating user token {{(pid=282898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:37:13.738711 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce6415b-b138-4477-bccd-b58969875efe None admin] Validating token access rules against request {{(pid=282899) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:37:13.756809 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4258b8-31c9-42a1-9090-958cdccffe7d None None] Validating token access rules against request {{(pid=282898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:37:13.767290 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG dbcounter [-] [282898] Writing DB stats keystone:SELECT=100 {{(pid=282898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:37:13.780823 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8cf43aa-4116-4168-bbcd-de9616cf7724 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282899) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:37:13.781487 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8cf43aa-4116-4168-bbcd-de9616cf7724 None admin] REQUEST_METHOD: `GET` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:37:13.781769 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8cf43aa-4116-4168-bbcd-de9616cf7724 None admin] SCRIPT_NAME: `/identity` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:37:13.782052 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8cf43aa-4116-4168-bbcd-de9616cf7724 None admin] PATH_INFO: `/v3/domains` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:37:13.783128 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8cf43aa-4116-4168-bbcd-de9616cf7724 None admin] RBAC: Adding query filter params (name=Default) {{(pid=282899) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:37:13.783360 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8cf43aa-4116-4168-bbcd-de9616cf7724 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:37:13.784896 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8cf43aa-4116-4168-bbcd-de9616cf7724 None admin] RBAC: Authorization granted {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:37:13.799751 dv-cinder-851351-1-smb devstack@keystone.service[282899]: [pid: 282899|app: 0|req: 353/714] 10.222.0.42 () {56 vars in 1109 bytes} [Thu Jul 28 08:37:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:37:13.800105 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8cf43aa-4116-4168-bbcd-de9616cf7724 None admin] Authenticating user token {{(pid=282899) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:37:13.802959 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e64bcef-9897-4c47-b5ff-9a8cb0f7c048 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:37:13.808710 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e64bcef-9897-4c47-b5ff-9a8cb0f7c048 None admin] REQUEST_METHOD: `GET` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:37:13.808710 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e64bcef-9897-4c47-b5ff-9a8cb0f7c048 None admin] SCRIPT_NAME: `/identity` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:37:13.808710 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e64bcef-9897-4c47-b5ff-9a8cb0f7c048 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:37:13.808710 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e64bcef-9897-4c47-b5ff-9a8cb0f7c048 None admin] RBAC: Adding query filter params (role.id=aa4daecf3ff74fa1b7d53041a4659723, scope.project.id=5cde68cbfb9042dc9f36af3aacea2473, user.id=f3a6183fd2c040079951febe23234356) {{(pid=282898) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:37:13.808710 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e64bcef-9897-4c47-b5ff-9a8cb0f7c048 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:37:13.809270 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e64bcef-9897-4c47-b5ff-9a8cb0f7c048 None admin] RBAC: Authorization granted {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:37:13.816711 dv-cinder-851351-1-smb devstack@keystone.service[282898]: [pid: 282898|app: 0|req: 362/715] 10.222.0.42 () {56 vars in 1374 bytes} [Thu Jul 28 08:37:13 2022] GET /identity/v3/role_assignments?user.id=f3a6183fd2c040079951febe23234356&scope.project.id=5cde68cbfb9042dc9f36af3aacea2473&role.id=aa4daecf3ff74fa1b7d53041a4659723 => generated 608 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:37:13.816711 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e64bcef-9897-4c47-b5ff-9a8cb0f7c048 None admin] Authenticating user token {{(pid=282898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:37:13.842074 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG dbcounter [-] [282899] Writing DB stats keystone:SELECT=100 {{(pid=282899) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:37:14.026803 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e64bcef-9897-4c47-b5ff-9a8cb0f7c048 None admin] Validating token access rules against request {{(pid=282898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:37:14.054859 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8cf43aa-4116-4168-bbcd-de9616cf7724 None admin] Validating token access rules against request {{(pid=282899) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:37:14.065356 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aababdb-17b0-4d16-8666-a7f8219a39cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:37:14.066333 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aababdb-17b0-4d16-8666-a7f8219a39cc None admin] REQUEST_METHOD: `POST` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:37:14.066825 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aababdb-17b0-4d16-8666-a7f8219a39cc None admin] SCRIPT_NAME: `/identity` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:37:14.067283 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aababdb-17b0-4d16-8666-a7f8219a39cc None admin] PATH_INFO: `/v3/users` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:37:14.068189 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aababdb-17b0-4d16-8666-a7f8219a39cc None admin] RBAC: Authorizing `identity:create_user()` {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:37:14.069893 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aababdb-17b0-4d16-8666-a7f8219a39cc None admin] RBAC: Authorization granted {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:37:14.099460 dv-cinder-851351-1-smb devstack@keystone.service[282898]: [pid: 282898|app: 0|req: 363/716] 10.222.0.42 () {60 vars in 1132 bytes} [Thu Jul 28 08:37:13 2022] POST /identity/v3/users => generated 254 bytes in 284 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 08:37:14.109531 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3039ce-f362-4145-8953-a39a7a4c3aa3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282899) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:37:14.110245 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3039ce-f362-4145-8953-a39a7a4c3aa3 None admin] REQUEST_METHOD: `GET` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:37:14.110526 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3039ce-f362-4145-8953-a39a7a4c3aa3 None admin] SCRIPT_NAME: `/identity` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:37:14.110810 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3039ce-f362-4145-8953-a39a7a4c3aa3 None admin] PATH_INFO: `/v3/services/network` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:37:14.111488 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d3039ce-f362-4145-8953-a39a7a4c3aa3 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:37:14.114644 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d3039ce-f362-4145-8953-a39a7a4c3aa3 None admin] RBAC: Authorization granted {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:37:14.126445 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application [None req-6d3039ce-f362-4145-8953-a39a7a4c3aa3 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jul 28 08:37:14.126445 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:37:14.126445 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 28 08:37:14.126445 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 28 08:37:14.126445 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 28 08:37:14.126445 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 28 08:37:14.126445 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 28 08:37:14.126445 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 08:37:14.126445 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 28 08:37:14.126445 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application Jul 28 08:37:14.126445 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 28 08:37:14.126445 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application Jul 28 08:37:14.126445 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:37:14.126445 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:37:14.126445 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:37:14.126445 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:37:14.126445 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:37:14.128096 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:37:14.128096 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:37:14.128096 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:37:14.128096 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:37:14.128096 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:37:14.128096 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:37:14.128096 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 28 08:37:14.128096 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 28 08:37:14.128096 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 28 08:37:14.128096 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 28 08:37:14.128096 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:37:14.128096 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:37:14.128096 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:37:14.128096 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:37:14.128096 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:37:14.128096 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:37:14.129499 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:37:14.129499 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application with Lock( Jul 28 08:37:14.129499 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:37:14.129499 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:37:14.129499 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:37:14.129499 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:37:14.129499 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:37:14.129499 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:37:14.129499 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:37:14.129499 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:37:14.129499 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 28 08:37:14.129499 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 08:37:14.129499 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 28 08:37:14.129499 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application Jul 28 08:37:14.132456 dv-cinder-851351-1-smb devstack@keystone.service[282899]: [pid: 282899|app: 0|req: 354/717] 10.222.0.42 () {56 vars in 1111 bytes} [Thu Jul 28 08:37:13 2022] GET /identity/v3/services/network => generated 88 bytes in 333 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:37:14.138958 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aababdb-17b0-4d16-8666-a7f8219a39cc None admin] Authenticating user token {{(pid=282898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:37:14.173320 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG dbcounter [-] [282898] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=282898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:37:14.258776 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aababdb-17b0-4d16-8666-a7f8219a39cc None admin] Validating token access rules against request {{(pid=282898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:37:14.296006 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b5abe4-285f-42d9-a246-83dae8daceeb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:37:14.296556 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b5abe4-285f-42d9-a246-83dae8daceeb None admin] REQUEST_METHOD: `GET` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:37:14.296865 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b5abe4-285f-42d9-a246-83dae8daceeb None admin] SCRIPT_NAME: `/identity` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:37:14.297137 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b5abe4-285f-42d9-a246-83dae8daceeb None admin] PATH_INFO: `/v3/services` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:37:14.297836 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8b5abe4-285f-42d9-a246-83dae8daceeb None admin] RBAC: Adding query filter params (name=network) {{(pid=282898) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:37:14.298139 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8b5abe4-285f-42d9-a246-83dae8daceeb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:37:14.299606 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8b5abe4-285f-42d9-a246-83dae8daceeb None admin] RBAC: Authorization granted {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:37:14.304565 dv-cinder-851351-1-smb devstack@keystone.service[282898]: [pid: 282898|app: 0|req: 364/718] 10.222.0.42 () {56 vars in 1112 bytes} [Thu Jul 28 08:37:14 2022] GET /identity/v3/services?name=network => generated 124 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:37:14.310526 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3039ce-f362-4145-8953-a39a7a4c3aa3 None admin] Authenticating user token {{(pid=282899) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:37:14.409030 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG dbcounter [-] [282899] Writing DB stats keystone:SELECT=100 {{(pid=282899) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:37:14.430281 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3039ce-f362-4145-8953-a39a7a4c3aa3 None admin] Validating token access rules against request {{(pid=282899) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:37:14.467351 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8872324-277d-4da1-a3e4-33aa871dfa27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282899) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:37:14.467990 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8872324-277d-4da1-a3e4-33aa871dfa27 None admin] REQUEST_METHOD: `GET` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:37:14.468275 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8872324-277d-4da1-a3e4-33aa871dfa27 None admin] SCRIPT_NAME: `/identity` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:37:14.468547 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8872324-277d-4da1-a3e4-33aa871dfa27 None admin] PATH_INFO: `/v3/services` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:37:14.469290 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8872324-277d-4da1-a3e4-33aa871dfa27 None admin] RBAC: Adding query filter params (type=network) {{(pid=282899) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:37:14.469589 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8872324-277d-4da1-a3e4-33aa871dfa27 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:37:14.470992 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8872324-277d-4da1-a3e4-33aa871dfa27 None admin] RBAC: Authorization granted {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:37:14.478322 dv-cinder-851351-1-smb devstack@keystone.service[282899]: [pid: 282899|app: 0|req: 355/719] 10.222.0.42 () {56 vars in 1112 bytes} [Thu Jul 28 08:37:14 2022] GET /identity/v3/services?type=network => generated 124 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:37:14.961176 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb1bf02-971c-4fc0-91c0-034c00c7a6a8 None None] REQUEST_METHOD: `GET` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:37:14.962262 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb1bf02-971c-4fc0-91c0-034c00c7a6a8 None None] SCRIPT_NAME: `/identity` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:37:14.962837 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb1bf02-971c-4fc0-91c0-034c00c7a6a8 None None] PATH_INFO: `/` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:37:14.964731 dv-cinder-851351-1-smb devstack@keystone.service[282898]: [pid: 282898|app: 0|req: 365/720] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 08:37:14 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 08:37:14.977008 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb232c5e-75d3-4905-b2d3-76e4045f19e3 None None] REQUEST_METHOD: `POST` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:37:14.977674 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb232c5e-75d3-4905-b2d3-76e4045f19e3 None None] SCRIPT_NAME: `/identity` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:37:14.978199 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb232c5e-75d3-4905-b2d3-76e4045f19e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:37:15.005691 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.auth.core [None req-eb232c5e-75d3-4905-b2d3-76e4045f19e3 None None] MFA Rules not processed for user `2be990a66857410a87ffa7609aec4f7b`. Rule list: `[]` (Enabled: `True`). {{(pid=282899) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 08:37:15.006974 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.fernet_utils [None req-eb232c5e-75d3-4905-b2d3-76e4045f19e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=282899) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:37:15.099096 dv-cinder-851351-1-smb devstack@keystone.service[282899]: [pid: 282899|app: 0|req: 356/721] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 08:37:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 08:37:15.144828 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb1bf02-971c-4fc0-91c0-034c00c7a6a8 None None] Authenticating user token {{(pid=282898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:37:15.254692 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG dbcounter [-] [282898] Writing DB stats keystone:SELECT=100 {{(pid=282898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:37:15.266038 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb1bf02-971c-4fc0-91c0-034c00c7a6a8 None None] Validating token access rules against request {{(pid=282898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:37:15.316820 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd4081f-b336-4701-9213-8c45b2420e1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:37:15.317462 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd4081f-b336-4701-9213-8c45b2420e1c None admin] REQUEST_METHOD: `POST` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:37:15.317751 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd4081f-b336-4701-9213-8c45b2420e1c None admin] SCRIPT_NAME: `/identity` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:37:15.318027 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd4081f-b336-4701-9213-8c45b2420e1c None admin] PATH_INFO: `/v3/services` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:37:15.318742 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cd4081f-b336-4701-9213-8c45b2420e1c None admin] RBAC: Authorizing `identity:create_service()` {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:37:15.320158 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cd4081f-b336-4701-9213-8c45b2420e1c None admin] RBAC: Authorization granted {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:37:15.343273 dv-cinder-851351-1-smb devstack@keystone.service[282898]: [pid: 282898|app: 0|req: 366/722] 10.222.0.42 () {60 vars in 1141 bytes} [Thu Jul 28 08:37:15 2022] POST /identity/v3/services => generated 251 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 08:37:15.750268 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ddf58f-06bf-4489-8ff9-e560d54a0cc8 None None] REQUEST_METHOD: `GET` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:37:15.750942 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ddf58f-06bf-4489-8ff9-e560d54a0cc8 None None] SCRIPT_NAME: `/identity` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:37:15.751357 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ddf58f-06bf-4489-8ff9-e560d54a0cc8 None None] PATH_INFO: `/` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:37:15.753281 dv-cinder-851351-1-smb devstack@keystone.service[282899]: [pid: 282899|app: 0|req: 357/723] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 08:37:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 08:37:15.760049 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca21a58-aba6-494b-9105-e596a4642592 None None] REQUEST_METHOD: `POST` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:37:15.760477 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca21a58-aba6-494b-9105-e596a4642592 None None] SCRIPT_NAME: `/identity` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:37:15.760886 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca21a58-aba6-494b-9105-e596a4642592 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:37:15.781055 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.auth.core [None req-fca21a58-aba6-494b-9105-e596a4642592 None None] MFA Rules not processed for user `2be990a66857410a87ffa7609aec4f7b`. Rule list: `[]` (Enabled: `True`). {{(pid=282898) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 08:37:15.782485 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.fernet_utils [None req-fca21a58-aba6-494b-9105-e596a4642592 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=282898) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:37:15.876053 dv-cinder-851351-1-smb devstack@keystone.service[282898]: [pid: 282898|app: 0|req: 367/724] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 08:37:15 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 08:37:15.911112 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ddf58f-06bf-4489-8ff9-e560d54a0cc8 None None] Authenticating user token {{(pid=282899) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:37:16.025163 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG dbcounter [-] [282899] Writing DB stats keystone:SELECT=100 {{(pid=282899) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:37:16.058369 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ddf58f-06bf-4489-8ff9-e560d54a0cc8 None None] Validating token access rules against request {{(pid=282899) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:37:16.110427 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02611692-580e-4891-aa13-c429e0f538cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282899) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:37:16.111114 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02611692-580e-4891-aa13-c429e0f538cb None admin] REQUEST_METHOD: `GET` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:37:16.111405 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02611692-580e-4891-aa13-c429e0f538cb None admin] SCRIPT_NAME: `/identity` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:37:16.111726 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02611692-580e-4891-aa13-c429e0f538cb None admin] PATH_INFO: `/v3/roles/admin` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:37:16.124208 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02611692-580e-4891-aa13-c429e0f538cb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 08:37:16.136341 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application [None req-02611692-580e-4891-aa13-c429e0f538cb None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 08:37:16.136341 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:37:16.136341 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:37:16.136341 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:37:16.136341 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:37:16.136341 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:37:16.136341 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:37:16.136341 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:37:16.136341 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:37:16.136341 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:37:16.136341 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:37:16.136341 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:37:16.136341 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 08:37:16.136341 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 08:37:16.136341 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 08:37:16.136341 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 08:37:16.138699 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 08:37:16.138699 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 08:37:16.138699 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 08:37:16.138699 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 08:37:16.138699 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:37:16.138699 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:37:16.138699 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:37:16.138699 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:37:16.138699 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:37:16.138699 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:37:16.138699 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:37:16.138699 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application with Lock( Jul 28 08:37:16.138699 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:37:16.138699 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:37:16.138699 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:37:16.138699 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:37:16.140108 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:37:16.140108 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:37:16.140108 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:37:16.140108 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:37:16.140108 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 08:37:16.140108 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 08:37:16.140108 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 08:37:16.140108 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 08:37:16.140108 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 08:37:16.140108 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 08:37:16.140108 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 08:37:16.140108 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application Jul 28 08:37:16.140108 dv-cinder-851351-1-smb devstack@keystone.service[282899]: [pid: 282899|app: 0|req: 358/725] 10.222.0.42 () {56 vars in 1096 bytes} [Thu Jul 28 08:37:15 2022] GET /identity/v3/roles/admin => generated 83 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:37:16.151632 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca21a58-aba6-494b-9105-e596a4642592 None None] Authenticating user token {{(pid=282898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:37:16.297325 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG dbcounter [-] [282898] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=282898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:37:16.339966 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca21a58-aba6-494b-9105-e596a4642592 None None] Validating token access rules against request {{(pid=282898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:37:16.402072 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef601083-7260-4bcb-97d9-7a4c3923216a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:37:16.403704 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef601083-7260-4bcb-97d9-7a4c3923216a None admin] REQUEST_METHOD: `GET` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:37:16.404488 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef601083-7260-4bcb-97d9-7a4c3923216a None admin] SCRIPT_NAME: `/identity` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:37:16.405368 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef601083-7260-4bcb-97d9-7a4c3923216a None admin] PATH_INFO: `/v3/roles` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:37:16.407228 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef601083-7260-4bcb-97d9-7a4c3923216a None admin] RBAC: Adding query filter params (name=admin) {{(pid=282898) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:37:16.408113 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef601083-7260-4bcb-97d9-7a4c3923216a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:37:16.411359 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef601083-7260-4bcb-97d9-7a4c3923216a None admin] RBAC: Authorization granted {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:37:16.429536 dv-cinder-851351-1-smb devstack@keystone.service[282898]: [pid: 282898|app: 0|req: 368/726] 10.222.0.42 () {56 vars in 1099 bytes} [Thu Jul 28 08:37:16 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:37:16.439366 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02611692-580e-4891-aa13-c429e0f538cb None admin] Authenticating user token {{(pid=282899) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:37:16.604190 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8aac3ce-63f2-4d80-9657-901ff85652ff None None] REQUEST_METHOD: `GET` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:37:16.605085 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8aac3ce-63f2-4d80-9657-901ff85652ff None None] SCRIPT_NAME: `/identity` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:37:16.605384 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8aac3ce-63f2-4d80-9657-901ff85652ff None None] PATH_INFO: `/` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:37:16.607069 dv-cinder-851351-1-smb devstack@keystone.service[282898]: [pid: 282898|app: 0|req: 369/727] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 08:37:16 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 08:37:16.612351 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9bb47d-e972-4f69-966e-7a34438c1b3b None None] REQUEST_METHOD: `POST` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:37:16.612737 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9bb47d-e972-4f69-966e-7a34438c1b3b None None] SCRIPT_NAME: `/identity` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:37:16.612937 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9bb47d-e972-4f69-966e-7a34438c1b3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:37:16.655108 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02611692-580e-4891-aa13-c429e0f538cb None admin] Validating token access rules against request {{(pid=282899) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:37:16.664983 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.auth.core [None req-1c9bb47d-e972-4f69-966e-7a34438c1b3b None None] MFA Rules not processed for user `2be990a66857410a87ffa7609aec4f7b`. Rule list: `[]` (Enabled: `True`). {{(pid=282898) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 08:37:16.666245 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.fernet_utils [None req-1c9bb47d-e972-4f69-966e-7a34438c1b3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=282898) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:37:16.727974 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ffae05b-ee7c-4a15-a9ea-98e9362ba764 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282899) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:37:16.729159 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffae05b-ee7c-4a15-a9ea-98e9362ba764 None admin] REQUEST_METHOD: `GET` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:37:16.730567 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffae05b-ee7c-4a15-a9ea-98e9362ba764 None admin] SCRIPT_NAME: `/identity` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:37:16.732126 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffae05b-ee7c-4a15-a9ea-98e9362ba764 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:37:16.739178 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG dbcounter [-] [282899] Writing DB stats keystone:SELECT=100 {{(pid=282899) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:37:16.758506 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ffae05b-ee7c-4a15-a9ea-98e9362ba764 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:37:16.762288 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ffae05b-ee7c-4a15-a9ea-98e9362ba764 None admin] RBAC: Authorization granted {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:37:16.800686 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application [None req-4ffae05b-ee7c-4a15-a9ea-98e9362ba764 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 08:37:16.800686 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:37:16.800686 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:37:16.800686 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:37:16.800686 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:37:16.800686 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:37:16.800686 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:37:16.800686 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:37:16.800686 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:37:16.800686 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:37:16.800686 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:37:16.800686 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:37:16.800686 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 08:37:16.800686 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 08:37:16.800686 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 08:37:16.801828 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 08:37:16.801828 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:37:16.801828 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:37:16.801828 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:37:16.801828 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:37:16.801828 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:37:16.801828 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:37:16.801828 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:37:16.801828 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application with Lock( Jul 28 08:37:16.801828 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:37:16.801828 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:37:16.801828 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:37:16.801828 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:37:16.801828 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:37:16.801828 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:37:16.801828 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:37:16.801828 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:37:16.802884 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 08:37:16.802884 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 08:37:16.802884 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 08:37:16.802884 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application Jul 28 08:37:16.802884 dv-cinder-851351-1-smb devstack@keystone.service[282899]: [pid: 282899|app: 0|req: 359/728] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 08:37:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 358 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:37:16.802884 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ffae05b-ee7c-4a15-a9ea-98e9362ba764 None admin] Authenticating user token {{(pid=282899) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:37:16.806860 dv-cinder-851351-1-smb devstack@keystone.service[282898]: [pid: 282898|app: 0|req: 370/729] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 08:37:16 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 28 08:37:16.842313 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c9bb47d-e972-4f69-966e-7a34438c1b3b None None] Authenticating user token {{(pid=282898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:37:16.939125 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ffae05b-ee7c-4a15-a9ea-98e9362ba764 None admin] Validating token access rules against request {{(pid=282899) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:37:16.962413 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG dbcounter [-] [282898] Writing DB stats keystone:SELECT=100 {{(pid=282898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:37:16.982754 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-165e9e9d-eb6e-4660-aefc-4b86c226c308 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282899) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:37:16.983880 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165e9e9d-eb6e-4660-aefc-4b86c226c308 None admin] REQUEST_METHOD: `GET` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:37:16.984373 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165e9e9d-eb6e-4660-aefc-4b86c226c308 None admin] SCRIPT_NAME: `/identity` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:37:16.985003 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165e9e9d-eb6e-4660-aefc-4b86c226c308 None admin] PATH_INFO: `/v3/domains` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:37:16.985934 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-165e9e9d-eb6e-4660-aefc-4b86c226c308 None admin] RBAC: Adding query filter params (name=Default) {{(pid=282899) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:37:16.986662 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-165e9e9d-eb6e-4660-aefc-4b86c226c308 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:37:16.988329 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-165e9e9d-eb6e-4660-aefc-4b86c226c308 None admin] RBAC: Authorization granted {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:37:16.999367 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c9bb47d-e972-4f69-966e-7a34438c1b3b None None] Validating token access rules against request {{(pid=282898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:37:17.003167 dv-cinder-851351-1-smb devstack@keystone.service[282899]: [pid: 282899|app: 0|req: 360/730] 10.222.0.42 () {56 vars in 1109 bytes} [Thu Jul 28 08:37:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 08:37:17.004784 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28fe0d4c-4f7a-4318-882d-844f120b010b None None] REQUEST_METHOD: `GET` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:37:17.005312 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28fe0d4c-4f7a-4318-882d-844f120b010b None None] SCRIPT_NAME: `/identity` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:37:17.005879 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28fe0d4c-4f7a-4318-882d-844f120b010b None None] PATH_INFO: `/` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:37:17.011705 dv-cinder-851351-1-smb devstack@keystone.service[282899]: [pid: 282899|app: 0|req: 361/731] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 08:37:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 08:37:17.012976 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28fe0d4c-4f7a-4318-882d-844f120b010b None None] Authenticating user token {{(pid=282899) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:37:17.037671 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0946daf3-05bd-41a6-b16f-e3c5f50320ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:37:17.038348 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0946daf3-05bd-41a6-b16f-e3c5f50320ff None admin] REQUEST_METHOD: `GET` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:37:17.038630 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0946daf3-05bd-41a6-b16f-e3c5f50320ff None admin] SCRIPT_NAME: `/identity` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:37:17.038904 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0946daf3-05bd-41a6-b16f-e3c5f50320ff None admin] PATH_INFO: `/v3/roles/admin` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:37:17.052119 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0946daf3-05bd-41a6-b16f-e3c5f50320ff None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 08:37:17.057668 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application [None req-0946daf3-05bd-41a6-b16f-e3c5f50320ff None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 08:37:17.057668 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:37:17.057668 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:37:17.057668 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:37:17.057668 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:37:17.057668 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:37:17.057668 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:37:17.057668 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:37:17.057668 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:37:17.057668 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:37:17.057668 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:37:17.057668 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:37:17.057668 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 08:37:17.057668 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 08:37:17.057668 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 08:37:17.057668 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 08:37:17.058852 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 08:37:17.058852 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 08:37:17.058852 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 08:37:17.058852 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 08:37:17.058852 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:37:17.058852 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:37:17.058852 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:37:17.058852 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:37:17.058852 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:37:17.058852 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:37:17.058852 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:37:17.058852 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application with Lock( Jul 28 08:37:17.058852 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:37:17.058852 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:37:17.058852 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:37:17.058852 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:37:17.059872 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:37:17.059872 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:37:17.059872 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:37:17.059872 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:37:17.059872 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 08:37:17.059872 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 08:37:17.059872 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 08:37:17.059872 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 08:37:17.059872 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 08:37:17.059872 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 08:37:17.059872 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 08:37:17.059872 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application Jul 28 08:37:17.059872 dv-cinder-851351-1-smb devstack@keystone.service[282898]: [pid: 282898|app: 0|req: 371/732] 10.222.0.42 () {56 vars in 1096 bytes} [Thu Jul 28 08:37:16 2022] GET /identity/v3/roles/admin => generated 83 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 08:37:17.060770 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da51419-bd1f-473e-bb27-2dcb9ea41454 None None] REQUEST_METHOD: `POST` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:37:17.061374 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da51419-bd1f-473e-bb27-2dcb9ea41454 None None] SCRIPT_NAME: `/identity` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:37:17.061374 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da51419-bd1f-473e-bb27-2dcb9ea41454 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:37:17.080332 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.auth.core [None req-2da51419-bd1f-473e-bb27-2dcb9ea41454 None None] MFA Rules not processed for user `2be990a66857410a87ffa7609aec4f7b`. Rule list: `[]` (Enabled: `True`). {{(pid=282898) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 08:37:17.081645 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.fernet_utils [None req-2da51419-bd1f-473e-bb27-2dcb9ea41454 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=282898) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:37:17.082104 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG dbcounter [-] [282899] Writing DB stats keystone:SELECT=100 {{(pid=282899) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:37:17.141615 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28fe0d4c-4f7a-4318-882d-844f120b010b None None] Validating token access rules against request {{(pid=282899) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:37:17.160695 dv-cinder-851351-1-smb devstack@keystone.service[282898]: [pid: 282898|app: 0|req: 372/733] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 08:37:17 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 08:37:17.160695 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da51419-bd1f-473e-bb27-2dcb9ea41454 None None] Authenticating user token {{(pid=282898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:37:17.204499 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091df965-e19b-4edd-b3da-1165e10902de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282899) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:37:17.205867 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091df965-e19b-4edd-b3da-1165e10902de None admin] REQUEST_METHOD: `GET` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:37:17.206428 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091df965-e19b-4edd-b3da-1165e10902de None admin] SCRIPT_NAME: `/identity` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:37:17.206961 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091df965-e19b-4edd-b3da-1165e10902de None admin] PATH_INFO: `/v3/users/nova` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:37:17.213799 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG dbcounter [-] [282898] Writing DB stats keystone:SELECT=100 {{(pid=282898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:37:17.218303 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-091df965-e19b-4edd-b3da-1165e10902de None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:37:17.220040 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-091df965-e19b-4edd-b3da-1165e10902de None admin] RBAC: Authorization granted {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:37:17.234683 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application [None req-091df965-e19b-4edd-b3da-1165e10902de None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 28 08:37:17.234683 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:37:17.234683 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:37:17.234683 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:37:17.234683 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:37:17.234683 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:37:17.234683 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:37:17.234683 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:37:17.234683 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:37:17.234683 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:37:17.234683 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:37:17.234683 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:37:17.234683 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 28 08:37:17.234683 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 28 08:37:17.234683 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 28 08:37:17.234683 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 28 08:37:17.235871 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:37:17.235871 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:37:17.235871 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 28 08:37:17.235871 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 08:37:17.235871 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 28 08:37:17.235871 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 08:37:17.235871 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:37:17.235871 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:37:17.235871 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:37:17.235871 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:37:17.235871 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:37:17.235871 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application with Lock( Jul 28 08:37:17.235871 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:37:17.235871 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:37:17.235871 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:37:17.235871 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:37:17.235871 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:37:17.235871 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:37:17.237161 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:37:17.237161 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:37:17.237161 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 28 08:37:17.237161 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 28 08:37:17.237161 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 28 08:37:17.237161 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 28 08:37:17.237161 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 28 08:37:17.237161 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 28 08:37:17.237161 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 28 08:37:17.237161 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application Jul 28 08:37:17.240007 dv-cinder-851351-1-smb devstack@keystone.service[282899]: [pid: 282899|app: 0|req: 362/734] 10.222.0.42 () {56 vars in 1093 bytes} [Thu Jul 28 08:37:17 2022] GET /identity/v3/users/nova => generated 82 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:37:17.241077 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091df965-e19b-4edd-b3da-1165e10902de None admin] Authenticating user token {{(pid=282899) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:37:17.257997 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da51419-bd1f-473e-bb27-2dcb9ea41454 None None] Validating token access rules against request {{(pid=282898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:37:17.293327 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-030cf169-259b-40d4-8cf2-a64357e84ce9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:37:17.293727 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030cf169-259b-40d4-8cf2-a64357e84ce9 None admin] REQUEST_METHOD: `GET` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:37:17.294009 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030cf169-259b-40d4-8cf2-a64357e84ce9 None admin] SCRIPT_NAME: `/identity` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:37:17.294287 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030cf169-259b-40d4-8cf2-a64357e84ce9 None admin] PATH_INFO: `/v3/roles` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:37:17.295025 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-030cf169-259b-40d4-8cf2-a64357e84ce9 None admin] RBAC: Adding query filter params (name=admin) {{(pid=282898) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:37:17.295457 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-030cf169-259b-40d4-8cf2-a64357e84ce9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:37:17.296805 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-030cf169-259b-40d4-8cf2-a64357e84ce9 None admin] RBAC: Authorization granted {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:37:17.306500 dv-cinder-851351-1-smb devstack@keystone.service[282898]: [pid: 282898|app: 0|req: 373/735] 10.222.0.42 () {56 vars in 1099 bytes} [Thu Jul 28 08:37:17 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:37:17.307337 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-030cf169-259b-40d4-8cf2-a64357e84ce9 None admin] Authenticating user token {{(pid=282898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:37:17.354280 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091df965-e19b-4edd-b3da-1165e10902de None admin] Validating token access rules against request {{(pid=282899) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:37:17.364690 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG dbcounter [-] [282899] Writing DB stats keystone:SELECT=100 {{(pid=282899) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:37:17.393473 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739461c0-e779-4b7c-a340-7ce40dcb2a46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282899) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:37:17.394139 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739461c0-e779-4b7c-a340-7ce40dcb2a46 None admin] REQUEST_METHOD: `GET` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:37:17.394463 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739461c0-e779-4b7c-a340-7ce40dcb2a46 None admin] SCRIPT_NAME: `/identity` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:37:17.394691 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739461c0-e779-4b7c-a340-7ce40dcb2a46 None admin] PATH_INFO: `/v3/roles/service` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:37:17.405479 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-739461c0-e779-4b7c-a340-7ce40dcb2a46 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 08:37:17.411352 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application [None req-739461c0-e779-4b7c-a340-7ce40dcb2a46 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 28 08:37:17.411352 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:37:17.411352 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:37:17.411352 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:37:17.411352 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:37:17.411352 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:37:17.411352 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:37:17.411352 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:37:17.411352 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:37:17.411352 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:37:17.411352 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:37:17.411352 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:37:17.411352 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 08:37:17.411352 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 08:37:17.411352 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 08:37:17.411352 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 08:37:17.412499 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 08:37:17.412499 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 08:37:17.412499 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 08:37:17.412499 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 08:37:17.412499 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:37:17.412499 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:37:17.412499 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:37:17.412499 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:37:17.412499 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:37:17.412499 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:37:17.412499 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:37:17.412499 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application with Lock( Jul 28 08:37:17.412499 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:37:17.412499 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:37:17.412499 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:37:17.412499 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:37:17.414571 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:37:17.414571 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:37:17.414571 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:37:17.414571 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:37:17.414571 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 08:37:17.414571 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 08:37:17.414571 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 08:37:17.414571 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 08:37:17.414571 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 08:37:17.414571 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 08:37:17.414571 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 28 08:37:17.414571 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application Jul 28 08:37:17.414571 dv-cinder-851351-1-smb devstack@keystone.service[282899]: [pid: 282899|app: 0|req: 363/736] 10.222.0.42 () {56 vars in 1102 bytes} [Thu Jul 28 08:37:17 2022] GET /identity/v3/roles/service => generated 85 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:37:17.414571 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739461c0-e779-4b7c-a340-7ce40dcb2a46 None admin] Authenticating user token {{(pid=282899) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:37:17.420225 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-030cf169-259b-40d4-8cf2-a64357e84ce9 None admin] Validating token access rules against request {{(pid=282898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:37:17.444900 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG dbcounter [-] [282898] Writing DB stats keystone:SELECT=100 {{(pid=282898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:37:17.461738 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36103908-f8f3-4124-8041-5579f8d32b7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:37:17.462596 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36103908-f8f3-4124-8041-5579f8d32b7d None admin] REQUEST_METHOD: `GET` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:37:17.462885 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36103908-f8f3-4124-8041-5579f8d32b7d None admin] SCRIPT_NAME: `/identity` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:37:17.463163 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36103908-f8f3-4124-8041-5579f8d32b7d None admin] PATH_INFO: `/v3/users` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:37:17.463994 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36103908-f8f3-4124-8041-5579f8d32b7d None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=282898) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:37:17.464305 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36103908-f8f3-4124-8041-5579f8d32b7d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:37:17.465825 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36103908-f8f3-4124-8041-5579f8d32b7d None admin] RBAC: Authorization granted {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:37:17.485565 dv-cinder-851351-1-smb devstack@keystone.service[282898]: [pid: 282898|app: 0|req: 374/737] 10.222.0.42 () {56 vars in 1133 bytes} [Thu Jul 28 08:37:17 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:37:17.491476 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862e9ab7-ac3e-40f6-848f-241fe5c44e70 None None] REQUEST_METHOD: `GET` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:37:17.491821 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862e9ab7-ac3e-40f6-848f-241fe5c44e70 None None] SCRIPT_NAME: `/identity` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:37:17.492037 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862e9ab7-ac3e-40f6-848f-241fe5c44e70 None None] PATH_INFO: `/` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:37:17.494637 dv-cinder-851351-1-smb devstack@keystone.service[282898]: [pid: 282898|app: 0|req: 375/738] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 08:37:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 08:37:17.494637 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862e9ab7-ac3e-40f6-848f-241fe5c44e70 None None] Authenticating user token {{(pid=282898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:37:17.533606 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739461c0-e779-4b7c-a340-7ce40dcb2a46 None admin] Validating token access rules against request {{(pid=282899) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:37:17.573167 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5979c5ac-1295-4954-9ca7-be2761c38e47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282899) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:37:17.573858 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5979c5ac-1295-4954-9ca7-be2761c38e47 None admin] REQUEST_METHOD: `GET` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:37:17.574151 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5979c5ac-1295-4954-9ca7-be2761c38e47 None admin] SCRIPT_NAME: `/identity` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:37:17.574430 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5979c5ac-1295-4954-9ca7-be2761c38e47 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:37:17.586873 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5979c5ac-1295-4954-9ca7-be2761c38e47 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:37:17.588255 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5979c5ac-1295-4954-9ca7-be2761c38e47 None admin] RBAC: Authorization granted {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:37:17.613817 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862e9ab7-ac3e-40f6-848f-241fe5c44e70 None None] Validating token access rules against request {{(pid=282898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:37:17.614201 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application [None req-5979c5ac-1295-4954-9ca7-be2761c38e47 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 08:37:17.614201 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:37:17.614201 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:37:17.614201 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:37:17.614201 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:37:17.614201 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:37:17.614201 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:37:17.614201 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:37:17.614201 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:37:17.614201 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:37:17.614201 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:37:17.614201 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:37:17.614201 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 08:37:17.614201 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 08:37:17.614201 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 08:37:17.615181 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 08:37:17.615181 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:37:17.615181 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:37:17.615181 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:37:17.615181 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:37:17.615181 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:37:17.615181 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:37:17.615181 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:37:17.615181 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application with Lock( Jul 28 08:37:17.615181 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:37:17.615181 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:37:17.615181 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:37:17.615181 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:37:17.615181 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:37:17.615181 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:37:17.615181 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:37:17.615181 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:37:17.616281 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 08:37:17.616281 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 08:37:17.616281 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 08:37:17.616281 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application Jul 28 08:37:17.616281 dv-cinder-851351-1-smb devstack@keystone.service[282899]: [pid: 282899|app: 0|req: 364/739] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 08:37:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:37:17.616628 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5979c5ac-1295-4954-9ca7-be2761c38e47 None admin] Authenticating user token {{(pid=282899) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:37:17.642906 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG dbcounter [-] [282899] Writing DB stats keystone:SELECT=100 {{(pid=282899) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:37:17.658194 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85754243-3ed0-4f40-9204-66b67b054be5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:37:17.658913 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85754243-3ed0-4f40-9204-66b67b054be5 None admin] REQUEST_METHOD: `GET` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:37:17.659227 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85754243-3ed0-4f40-9204-66b67b054be5 None admin] SCRIPT_NAME: `/identity` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:37:17.659508 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85754243-3ed0-4f40-9204-66b67b054be5 None admin] PATH_INFO: `/v3/roles` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:37:17.660256 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85754243-3ed0-4f40-9204-66b67b054be5 None admin] RBAC: Adding query filter params (name=service) {{(pid=282898) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:37:17.660569 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85754243-3ed0-4f40-9204-66b67b054be5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:37:17.662023 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85754243-3ed0-4f40-9204-66b67b054be5 None admin] RBAC: Authorization granted {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:37:17.671575 dv-cinder-851351-1-smb devstack@keystone.service[282898]: [pid: 282898|app: 0|req: 376/740] 10.222.0.42 () {56 vars in 1103 bytes} [Thu Jul 28 08:37:17 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:37:17.673011 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c157dd88-b653-488b-80d8-3fe9b40f09d8 None None] REQUEST_METHOD: `POST` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:37:17.673299 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c157dd88-b653-488b-80d8-3fe9b40f09d8 None None] SCRIPT_NAME: `/identity` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:37:17.673574 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c157dd88-b653-488b-80d8-3fe9b40f09d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:37:17.692309 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.auth.core [None req-c157dd88-b653-488b-80d8-3fe9b40f09d8 None None] MFA Rules not processed for user `2be990a66857410a87ffa7609aec4f7b`. Rule list: `[]` (Enabled: `True`). {{(pid=282898) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 08:37:17.693573 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.fernet_utils [None req-c157dd88-b653-488b-80d8-3fe9b40f09d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=282898) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:37:17.731057 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG dbcounter [-] [282898] Writing DB stats keystone:SELECT=100 {{(pid=282898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:37:17.742475 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5979c5ac-1295-4954-9ca7-be2761c38e47 None admin] Validating token access rules against request {{(pid=282899) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:37:17.768512 dv-cinder-851351-1-smb devstack@keystone.service[282898]: [pid: 282898|app: 0|req: 377/741] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 08:37:17 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 08:37:17.769645 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c157dd88-b653-488b-80d8-3fe9b40f09d8 None None] Authenticating user token {{(pid=282898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:37:17.789289 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7435595a-5ab3-4d62-b134-4367ed93453e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282899) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:37:17.790207 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7435595a-5ab3-4d62-b134-4367ed93453e None admin] REQUEST_METHOD: `GET` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:37:17.790504 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7435595a-5ab3-4d62-b134-4367ed93453e None admin] SCRIPT_NAME: `/identity` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:37:17.790784 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7435595a-5ab3-4d62-b134-4367ed93453e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:37:17.803105 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7435595a-5ab3-4d62-b134-4367ed93453e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:37:17.804603 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7435595a-5ab3-4d62-b134-4367ed93453e None admin] RBAC: Authorization granted {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:37:17.822316 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application [None req-7435595a-5ab3-4d62-b134-4367ed93453e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 08:37:17.822316 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:37:17.822316 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:37:17.822316 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:37:17.822316 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:37:17.822316 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:37:17.822316 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:37:17.822316 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:37:17.822316 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:37:17.822316 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:37:17.822316 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:37:17.822316 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:37:17.822316 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 08:37:17.822316 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 08:37:17.822316 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 08:37:17.823446 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 08:37:17.823446 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:37:17.823446 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:37:17.823446 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:37:17.823446 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:37:17.823446 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:37:17.823446 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:37:17.823446 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:37:17.823446 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application with Lock( Jul 28 08:37:17.823446 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:37:17.823446 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:37:17.823446 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:37:17.823446 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:37:17.823446 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:37:17.823446 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:37:17.823446 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:37:17.823446 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:37:17.825134 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 08:37:17.825134 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 08:37:17.825134 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 08:37:17.825134 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application Jul 28 08:37:17.825134 dv-cinder-851351-1-smb devstack@keystone.service[282899]: [pid: 282899|app: 0|req: 365/742] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 08:37:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:37:17.825134 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7435595a-5ab3-4d62-b134-4367ed93453e None admin] Authenticating user token {{(pid=282899) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:37:17.898165 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG dbcounter [-] [282899] Writing DB stats keystone:SELECT=100 {{(pid=282899) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:37:17.913543 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c157dd88-b653-488b-80d8-3fe9b40f09d8 None None] Validating token access rules against request {{(pid=282898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:37:17.931873 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7435595a-5ab3-4d62-b134-4367ed93453e None admin] Validating token access rules against request {{(pid=282899) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:37:17.950853 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b2749f-68c8-493c-8253-c999137ef62d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:37:17.951489 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b2749f-68c8-493c-8253-c999137ef62d None admin] REQUEST_METHOD: `GET` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:37:17.951770 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b2749f-68c8-493c-8253-c999137ef62d None admin] SCRIPT_NAME: `/identity` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:37:17.952049 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b2749f-68c8-493c-8253-c999137ef62d None admin] PATH_INFO: `/v3/domains` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:37:17.952785 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43b2749f-68c8-493c-8253-c999137ef62d None admin] RBAC: Adding query filter params (name=Default) {{(pid=282898) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:37:17.953207 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43b2749f-68c8-493c-8253-c999137ef62d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:37:17.954964 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43b2749f-68c8-493c-8253-c999137ef62d None admin] RBAC: Authorization granted {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:37:17.967330 dv-cinder-851351-1-smb devstack@keystone.service[282898]: [pid: 282898|app: 0|req: 378/743] 10.222.0.42 () {56 vars in 1109 bytes} [Thu Jul 28 08:37:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:37:17.968162 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b2749f-68c8-493c-8253-c999137ef62d None admin] Authenticating user token {{(pid=282898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:37:17.970478 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b0b5ea-ddb2-44c8-bdff-bae3177284b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282899) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:37:17.971169 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b0b5ea-ddb2-44c8-bdff-bae3177284b8 None admin] REQUEST_METHOD: `GET` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:37:17.971451 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b0b5ea-ddb2-44c8-bdff-bae3177284b8 None admin] SCRIPT_NAME: `/identity` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:37:17.971730 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b0b5ea-ddb2-44c8-bdff-bae3177284b8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:37:17.983129 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51b0b5ea-ddb2-44c8-bdff-bae3177284b8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:37:17.984647 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51b0b5ea-ddb2-44c8-bdff-bae3177284b8 None admin] RBAC: Authorization granted {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:37:17.998768 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG dbcounter [-] [282898] Writing DB stats keystone:SELECT=100 {{(pid=282898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:37:17.999723 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application [None req-51b0b5ea-ddb2-44c8-bdff-bae3177284b8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 08:37:17.999723 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:37:17.999723 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:37:17.999723 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:37:17.999723 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:37:17.999723 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:37:17.999723 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:37:17.999723 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:37:17.999723 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:37:17.999723 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:37:17.999723 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:37:17.999723 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:37:17.999723 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 08:37:17.999723 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 08:37:17.999723 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 08:37:18.001060 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 08:37:18.001060 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:37:18.001060 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:37:18.001060 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:37:18.001060 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:37:18.001060 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:37:18.001060 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:37:18.001060 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:37:18.001060 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application with Lock( Jul 28 08:37:18.001060 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:37:18.001060 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:37:18.001060 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:37:18.001060 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:37:18.001060 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:37:18.001060 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:37:18.001060 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:37:18.001060 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:37:18.002110 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 08:37:18.002110 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 08:37:18.002110 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 08:37:18.002110 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application Jul 28 08:37:18.002110 dv-cinder-851351-1-smb devstack@keystone.service[282899]: [pid: 282899|app: 0|req: 366/744] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 08:37:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:37:18.002110 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b0b5ea-ddb2-44c8-bdff-bae3177284b8 None admin] Authenticating user token {{(pid=282899) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:37:18.074157 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b2749f-68c8-493c-8253-c999137ef62d None admin] Validating token access rules against request {{(pid=282898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:37:18.101412 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b0b5ea-ddb2-44c8-bdff-bae3177284b8 None admin] Validating token access rules against request {{(pid=282899) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:37:18.109495 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7493df3-ea9e-4d5e-875b-3b2821d1251d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:37:18.110125 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7493df3-ea9e-4d5e-875b-3b2821d1251d None admin] REQUEST_METHOD: `POST` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:37:18.110411 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7493df3-ea9e-4d5e-875b-3b2821d1251d None admin] SCRIPT_NAME: `/identity` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:37:18.110689 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7493df3-ea9e-4d5e-875b-3b2821d1251d None admin] PATH_INFO: `/v3/services` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:37:18.111398 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7493df3-ea9e-4d5e-875b-3b2821d1251d None admin] RBAC: Authorizing `identity:create_service()` {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:37:18.112947 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7493df3-ea9e-4d5e-875b-3b2821d1251d None admin] RBAC: Authorization granted {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:37:18.127396 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG dbcounter [-] [282899] Writing DB stats keystone:SELECT=100 {{(pid=282899) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:37:18.128928 dv-cinder-851351-1-smb devstack@keystone.service[282898]: [pid: 282898|app: 0|req: 379/745] 10.222.0.42 () {60 vars in 1141 bytes} [Thu Jul 28 08:37:17 2022] POST /identity/v3/services => generated 240 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 08:37:18.129975 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9942cd1-f5cf-4920-9716-69647edcceaf None None] REQUEST_METHOD: `GET` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:37:18.130263 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9942cd1-f5cf-4920-9716-69647edcceaf None None] SCRIPT_NAME: `/identity` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:37:18.130538 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9942cd1-f5cf-4920-9716-69647edcceaf None None] PATH_INFO: `/` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:37:18.131783 dv-cinder-851351-1-smb devstack@keystone.service[282898]: [pid: 282898|app: 0|req: 380/746] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 08:37:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 08:37:18.132495 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9942cd1-f5cf-4920-9716-69647edcceaf None None] Authenticating user token {{(pid=282898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:37:18.153713 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd2c827-020e-4fc0-b1ef-b66468f32700 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282899) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:37:18.154730 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd2c827-020e-4fc0-b1ef-b66468f32700 None admin] REQUEST_METHOD: `GET` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:37:18.155214 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd2c827-020e-4fc0-b1ef-b66468f32700 None admin] SCRIPT_NAME: `/identity` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:37:18.155742 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd2c827-020e-4fc0-b1ef-b66468f32700 None admin] PATH_INFO: `/v3/domains` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:37:18.156708 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bd2c827-020e-4fc0-b1ef-b66468f32700 None admin] RBAC: Adding query filter params (name=Default) {{(pid=282899) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:37:18.157231 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bd2c827-020e-4fc0-b1ef-b66468f32700 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:37:18.158931 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bd2c827-020e-4fc0-b1ef-b66468f32700 None admin] RBAC: Authorization granted {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:37:18.173303 dv-cinder-851351-1-smb devstack@keystone.service[282899]: [pid: 282899|app: 0|req: 367/747] 10.222.0.42 () {56 vars in 1109 bytes} [Thu Jul 28 08:37:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:37:18.174535 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd2c827-020e-4fc0-b1ef-b66468f32700 None admin] Authenticating user token {{(pid=282899) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:37:18.260549 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG dbcounter [-] [282898] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=282898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:37:18.273734 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9942cd1-f5cf-4920-9716-69647edcceaf None None] Validating token access rules against request {{(pid=282898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:37:18.299414 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd2c827-020e-4fc0-b1ef-b66468f32700 None admin] Validating token access rules against request {{(pid=282899) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:37:18.313998 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-395aee34-9042-4857-bc89-eacb924b8bd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:37:18.314659 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395aee34-9042-4857-bc89-eacb924b8bd7 None admin] REQUEST_METHOD: `GET` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:37:18.315059 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395aee34-9042-4857-bc89-eacb924b8bd7 None admin] SCRIPT_NAME: `/identity` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:37:18.315335 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395aee34-9042-4857-bc89-eacb924b8bd7 None admin] PATH_INFO: `/v3/users/swift` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:37:18.325363 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-395aee34-9042-4857-bc89-eacb924b8bd7 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:37:18.326157 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-395aee34-9042-4857-bc89-eacb924b8bd7 None admin] RBAC: Authorization granted {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:37:18.339020 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e64c77-a37c-4d16-8271-a66a8607eb07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282899) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:37:18.339631 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e64c77-a37c-4d16-8271-a66a8607eb07 None admin] REQUEST_METHOD: `GET` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:37:18.339913 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e64c77-a37c-4d16-8271-a66a8607eb07 None admin] SCRIPT_NAME: `/identity` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:37:18.340187 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e64c77-a37c-4d16-8271-a66a8607eb07 None admin] PATH_INFO: `/v3/domains` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:37:18.340527 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application [None req-395aee34-9042-4857-bc89-eacb924b8bd7 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 28 08:37:18.340527 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:37:18.340527 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:37:18.340527 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:37:18.340527 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:37:18.340527 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:37:18.340527 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:37:18.340527 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:37:18.340527 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:37:18.340527 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:37:18.340527 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:37:18.340527 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:37:18.340527 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 28 08:37:18.340527 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 28 08:37:18.340527 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 28 08:37:18.340527 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 28 08:37:18.341661 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:37:18.341661 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:37:18.341661 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 28 08:37:18.341661 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 08:37:18.341661 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 28 08:37:18.341661 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 08:37:18.341661 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:37:18.341661 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:37:18.341661 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:37:18.341661 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:37:18.341661 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:37:18.341661 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application with Lock( Jul 28 08:37:18.341661 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:37:18.341661 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:37:18.341661 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:37:18.341661 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:37:18.341661 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:37:18.341661 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:37:18.342800 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:37:18.342800 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:37:18.342800 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 28 08:37:18.342800 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 28 08:37:18.342800 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 28 08:37:18.342800 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 28 08:37:18.342800 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 28 08:37:18.342800 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 28 08:37:18.342800 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 28 08:37:18.342800 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application Jul 28 08:37:18.343469 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e64c77-a37c-4d16-8271-a66a8607eb07 None admin] RBAC: Adding query filter params (name=Default) {{(pid=282899) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:37:18.343469 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e64c77-a37c-4d16-8271-a66a8607eb07 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:37:18.343469 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e64c77-a37c-4d16-8271-a66a8607eb07 None admin] RBAC: Authorization granted {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:37:18.344824 dv-cinder-851351-1-smb devstack@keystone.service[282898]: [pid: 282898|app: 0|req: 381/748] 10.222.0.42 () {56 vars in 1096 bytes} [Thu Jul 28 08:37:18 2022] GET /identity/v3/users/swift => generated 83 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:37:18.346240 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588ea942-bb51-4d7d-a9dd-76501f54c239 None None] REQUEST_METHOD: `POST` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:37:18.346522 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588ea942-bb51-4d7d-a9dd-76501f54c239 None None] SCRIPT_NAME: `/identity` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:37:18.346793 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588ea942-bb51-4d7d-a9dd-76501f54c239 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:37:18.360222 dv-cinder-851351-1-smb devstack@keystone.service[282899]: [pid: 282899|app: 0|req: 368/749] 10.222.0.42 () {56 vars in 1109 bytes} [Thu Jul 28 08:37:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:37:18.361022 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e64c77-a37c-4d16-8271-a66a8607eb07 None admin] Authenticating user token {{(pid=282899) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:37:18.371423 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.auth.core [None req-588ea942-bb51-4d7d-a9dd-76501f54c239 None None] MFA Rules not processed for user `2be990a66857410a87ffa7609aec4f7b`. Rule list: `[]` (Enabled: `True`). {{(pid=282898) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 08:37:18.372702 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.fernet_utils [None req-588ea942-bb51-4d7d-a9dd-76501f54c239 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=282898) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:37:18.407502 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG dbcounter [-] [282899] Writing DB stats keystone:SELECT=100 {{(pid=282899) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:37:18.448219 dv-cinder-851351-1-smb devstack@keystone.service[282898]: [pid: 282898|app: 0|req: 382/750] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 08:37:18 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 08:37:18.449643 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-588ea942-bb51-4d7d-a9dd-76501f54c239 None None] Authenticating user token {{(pid=282898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:37:18.482994 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e64c77-a37c-4d16-8271-a66a8607eb07 None admin] Validating token access rules against request {{(pid=282899) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:37:18.521716 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdcb94d4-3fc8-43f8-a741-3df34bd95ca4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282899) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:37:18.522303 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdcb94d4-3fc8-43f8-a741-3df34bd95ca4 None admin] REQUEST_METHOD: `GET` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:37:18.522596 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdcb94d4-3fc8-43f8-a741-3df34bd95ca4 None admin] SCRIPT_NAME: `/identity` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:37:18.522931 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdcb94d4-3fc8-43f8-a741-3df34bd95ca4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:37:18.530462 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdcb94d4-3fc8-43f8-a741-3df34bd95ca4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:37:18.531948 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdcb94d4-3fc8-43f8-a741-3df34bd95ca4 None admin] RBAC: Authorization granted {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:37:18.545723 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application [None req-fdcb94d4-3fc8-43f8-a741-3df34bd95ca4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 08:37:18.545723 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:37:18.545723 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:37:18.545723 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:37:18.545723 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:37:18.545723 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:37:18.545723 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:37:18.545723 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:37:18.545723 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:37:18.545723 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:37:18.545723 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:37:18.545723 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:37:18.545723 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 28 08:37:18.545723 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 28 08:37:18.545723 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 28 08:37:18.547090 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 28 08:37:18.547090 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:37:18.547090 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:37:18.547090 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:37:18.547090 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:37:18.547090 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:37:18.547090 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:37:18.547090 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:37:18.547090 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application with Lock( Jul 28 08:37:18.547090 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:37:18.547090 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:37:18.547090 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:37:18.547090 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:37:18.547090 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:37:18.547090 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:37:18.547090 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:37:18.547090 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:37:18.548332 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 28 08:37:18.548332 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 28 08:37:18.548332 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 28 08:37:18.548332 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 28 08:37:18.548332 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 28 08:37:18.548332 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 28 08:37:18.548332 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 08:37:18.548332 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application Jul 28 08:37:18.548895 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG dbcounter [-] [282898] Writing DB stats keystone:SELECT=100 {{(pid=282898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:37:18.548982 dv-cinder-851351-1-smb devstack@keystone.service[282899]: [pid: 282899|app: 0|req: 369/751] 10.222.0.42 () {56 vars in 1111 bytes} [Thu Jul 28 08:37:18 2022] GET /identity/v3/projects/service => generated 88 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:37:18.548982 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdcb94d4-3fc8-43f8-a741-3df34bd95ca4 None admin] Authenticating user token {{(pid=282899) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:37:18.573750 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-588ea942-bb51-4d7d-a9dd-76501f54c239 None None] Validating token access rules against request {{(pid=282898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:37:18.612043 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a560e918-2472-4432-8d35-41f1b6c37edd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:37:18.612688 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a560e918-2472-4432-8d35-41f1b6c37edd None admin] REQUEST_METHOD: `GET` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:37:18.612989 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a560e918-2472-4432-8d35-41f1b6c37edd None admin] SCRIPT_NAME: `/identity` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:37:18.613265 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a560e918-2472-4432-8d35-41f1b6c37edd None admin] PATH_INFO: `/v3/users` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:37:18.614495 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a560e918-2472-4432-8d35-41f1b6c37edd None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=282898) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:37:18.614495 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a560e918-2472-4432-8d35-41f1b6c37edd None admin] RBAC: Authorizing `identity:list_users()` {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:37:18.615851 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a560e918-2472-4432-8d35-41f1b6c37edd None admin] RBAC: Authorization granted {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:37:18.648282 dv-cinder-851351-1-smb devstack@keystone.service[282898]: [pid: 282898|app: 0|req: 383/752] 10.222.0.42 () {56 vars in 1135 bytes} [Thu Jul 28 08:37:18 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:37:18.649175 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a560e918-2472-4432-8d35-41f1b6c37edd None admin] Authenticating user token {{(pid=282898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:37:18.676475 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG dbcounter [-] [282899] Writing DB stats keystone:SELECT=100 {{(pid=282899) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:37:18.679897 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdcb94d4-3fc8-43f8-a741-3df34bd95ca4 None admin] Validating token access rules against request {{(pid=282899) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:37:18.723494 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89de8f8e-f74e-4554-a593-68b42170643d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282899) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:37:18.724139 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89de8f8e-f74e-4554-a593-68b42170643d None admin] REQUEST_METHOD: `GET` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:37:18.724455 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89de8f8e-f74e-4554-a593-68b42170643d None admin] SCRIPT_NAME: `/identity` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:37:18.724754 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89de8f8e-f74e-4554-a593-68b42170643d None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:37:18.733258 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89de8f8e-f74e-4554-a593-68b42170643d None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:37:18.734751 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89de8f8e-f74e-4554-a593-68b42170643d None admin] RBAC: Authorization granted {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:37:18.749724 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application [None req-89de8f8e-f74e-4554-a593-68b42170643d None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 28 08:37:18.749724 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:37:18.749724 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:37:18.749724 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:37:18.749724 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:37:18.749724 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:37:18.749724 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:37:18.749724 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:37:18.749724 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:37:18.749724 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:37:18.749724 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:37:18.749724 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:37:18.749724 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 28 08:37:18.749724 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 28 08:37:18.749724 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 28 08:37:18.749724 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 28 08:37:18.750911 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:37:18.750911 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:37:18.750911 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 28 08:37:18.750911 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 08:37:18.750911 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 28 08:37:18.750911 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 08:37:18.750911 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:37:18.750911 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:37:18.750911 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:37:18.750911 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:37:18.750911 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:37:18.750911 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application with Lock( Jul 28 08:37:18.750911 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:37:18.750911 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:37:18.750911 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:37:18.750911 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:37:18.750911 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:37:18.750911 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:37:18.752073 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:37:18.752073 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:37:18.752073 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 28 08:37:18.752073 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 28 08:37:18.752073 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 28 08:37:18.752073 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 28 08:37:18.752073 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 28 08:37:18.752073 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 28 08:37:18.752073 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 28 08:37:18.752073 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application Jul 28 08:37:18.752073 dv-cinder-851351-1-smb devstack@keystone.service[282899]: [pid: 282899|app: 0|req: 370/753] 10.222.0.42 () {56 vars in 1117 bytes} [Thu Jul 28 08:37:18 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:37:18.754061 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89de8f8e-f74e-4554-a593-68b42170643d None admin] Authenticating user token {{(pid=282899) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:37:18.787121 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a560e918-2472-4432-8d35-41f1b6c37edd None admin] Validating token access rules against request {{(pid=282898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:37:18.836392 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc23e82d-d50e-490e-b352-18f7711d35f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:37:18.837080 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc23e82d-d50e-490e-b352-18f7711d35f4 None admin] REQUEST_METHOD: `GET` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:37:18.837364 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc23e82d-d50e-490e-b352-18f7711d35f4 None admin] SCRIPT_NAME: `/identity` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:37:18.837640 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc23e82d-d50e-490e-b352-18f7711d35f4 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:37:18.838291 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc23e82d-d50e-490e-b352-18f7711d35f4 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:37:18.839685 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc23e82d-d50e-490e-b352-18f7711d35f4 None admin] RBAC: Authorization granted {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:37:18.850752 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application [None req-bc23e82d-d50e-490e-b352-18f7711d35f4 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 28 08:37:18.850752 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:37:18.850752 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 28 08:37:18.850752 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 28 08:37:18.850752 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 28 08:37:18.850752 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 28 08:37:18.850752 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 28 08:37:18.850752 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 08:37:18.850752 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 28 08:37:18.850752 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application Jul 28 08:37:18.850752 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 28 08:37:18.850752 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application Jul 28 08:37:18.850752 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:37:18.850752 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:37:18.850752 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:37:18.850752 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:37:18.851934 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:37:18.851934 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:37:18.851934 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:37:18.851934 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:37:18.851934 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:37:18.851934 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:37:18.851934 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:37:18.851934 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 28 08:37:18.851934 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 28 08:37:18.851934 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 28 08:37:18.851934 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 28 08:37:18.851934 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:37:18.851934 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:37:18.851934 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:37:18.851934 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:37:18.851934 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:37:18.852965 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:37:18.852965 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:37:18.852965 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application with Lock( Jul 28 08:37:18.852965 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:37:18.852965 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:37:18.852965 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:37:18.852965 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:37:18.852965 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:37:18.852965 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:37:18.852965 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:37:18.852965 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:37:18.852965 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 28 08:37:18.852965 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 08:37:18.852965 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 28 08:37:18.852965 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application Jul 28 08:37:18.852965 dv-cinder-851351-1-smb devstack@keystone.service[282898]: [pid: 282898|app: 0|req: 384/754] 10.222.0.42 () {56 vars in 1129 bytes} [Thu Jul 28 08:37:18 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:37:18.854002 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc23e82d-d50e-490e-b352-18f7711d35f4 None admin] Authenticating user token {{(pid=282898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:37:18.857739 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG dbcounter [-] [282898] Writing DB stats keystone:SELECT=100 {{(pid=282898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:37:18.889149 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89de8f8e-f74e-4554-a593-68b42170643d None admin] Validating token access rules against request {{(pid=282899) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:37:18.931046 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fdcfcd2-a570-4ad7-81a9-fc1d3743a162 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282899) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:37:18.931883 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fdcfcd2-a570-4ad7-81a9-fc1d3743a162 None admin] REQUEST_METHOD: `GET` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:37:18.933051 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fdcfcd2-a570-4ad7-81a9-fc1d3743a162 None admin] SCRIPT_NAME: `/identity` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:37:18.933051 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fdcfcd2-a570-4ad7-81a9-fc1d3743a162 None admin] PATH_INFO: `/v3/projects` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:37:18.933575 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fdcfcd2-a570-4ad7-81a9-fc1d3743a162 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=282899) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:37:18.933951 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fdcfcd2-a570-4ad7-81a9-fc1d3743a162 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:37:18.935469 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fdcfcd2-a570-4ad7-81a9-fc1d3743a162 None admin] RBAC: Authorization granted {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:37:18.954821 dv-cinder-851351-1-smb devstack@keystone.service[282899]: [pid: 282899|app: 0|req: 371/755] 10.222.0.42 () {56 vars in 1148 bytes} [Thu Jul 28 08:37:18 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:37:18.955938 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fdcfcd2-a570-4ad7-81a9-fc1d3743a162 None admin] Authenticating user token {{(pid=282899) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:37:18.966308 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc23e82d-d50e-490e-b352-18f7711d35f4 None admin] Validating token access rules against request {{(pid=282898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:37:18.980425 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG dbcounter [-] [282899] Writing DB stats keystone:SELECT=100 {{(pid=282899) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:37:19.003691 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1df6bd-2223-428c-8dae-674996cdfbe1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:37:19.004405 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1df6bd-2223-428c-8dae-674996cdfbe1 None admin] REQUEST_METHOD: `GET` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:37:19.004778 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1df6bd-2223-428c-8dae-674996cdfbe1 None admin] SCRIPT_NAME: `/identity` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:37:19.005165 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1df6bd-2223-428c-8dae-674996cdfbe1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:37:19.062017 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fdcfcd2-a570-4ad7-81a9-fc1d3743a162 None admin] Validating token access rules against request {{(pid=282899) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:37:19.082111 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f1df6bd-2223-428c-8dae-674996cdfbe1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:37:19.084304 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f1df6bd-2223-428c-8dae-674996cdfbe1 None admin] RBAC: Authorization granted {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:37:19.087048 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG dbcounter [-] [282898] Writing DB stats keystone:SELECT=100 {{(pid=282898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:37:19.100488 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a6d56a-392f-46f1-b627-db19adb5fd23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282899) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:37:19.101577 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a6d56a-392f-46f1-b627-db19adb5fd23 None admin] REQUEST_METHOD: `GET` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:37:19.102166 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a6d56a-392f-46f1-b627-db19adb5fd23 None admin] SCRIPT_NAME: `/identity` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:37:19.102530 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a6d56a-392f-46f1-b627-db19adb5fd23 None admin] PATH_INFO: `/v3/users` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:37:19.103481 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34a6d56a-392f-46f1-b627-db19adb5fd23 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=282899) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:37:19.103851 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34a6d56a-392f-46f1-b627-db19adb5fd23 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:37:19.105347 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34a6d56a-392f-46f1-b627-db19adb5fd23 None admin] RBAC: Authorization granted {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:37:19.123670 dv-cinder-851351-1-smb devstack@keystone.service[282899]: [pid: 282899|app: 0|req: 372/756] 10.222.0.42 () {56 vars in 1149 bytes} [Thu Jul 28 08:37:18 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:37:19.124508 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a6d56a-392f-46f1-b627-db19adb5fd23 None admin] Authenticating user token {{(pid=282899) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:37:19.200133 dv-cinder-851351-1-smb devstack@keystone.service[282898]: [pid: 282898|app: 0|req: 385/757] 10.222.0.42 () {58 vars in 1282 bytes} [Thu Jul 28 08:37:18 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 348 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 28 08:37:19.201099 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1df6bd-2223-428c-8dae-674996cdfbe1 None admin] Authenticating user token {{(pid=282898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:37:19.216003 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG dbcounter [-] [282899] Writing DB stats keystone:SELECT=100 {{(pid=282899) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:37:19.241755 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a6d56a-392f-46f1-b627-db19adb5fd23 None admin] Validating token access rules against request {{(pid=282899) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:37:19.289874 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d17793b-b0d7-4912-9c49-1f4879a24155 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282899) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:37:19.290867 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d17793b-b0d7-4912-9c49-1f4879a24155 None admin] REQUEST_METHOD: `GET` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:37:19.291214 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d17793b-b0d7-4912-9c49-1f4879a24155 None admin] SCRIPT_NAME: `/identity` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:37:19.291575 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d17793b-b0d7-4912-9c49-1f4879a24155 None admin] PATH_INFO: `/v3/services` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:37:19.293215 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d17793b-b0d7-4912-9c49-1f4879a24155 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=282899) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:37:19.293528 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d17793b-b0d7-4912-9c49-1f4879a24155 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:37:19.294932 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d17793b-b0d7-4912-9c49-1f4879a24155 None admin] RBAC: Authorization granted {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:37:19.306225 dv-cinder-851351-1-smb devstack@keystone.service[282899]: [pid: 282899|app: 0|req: 373/758] 10.222.0.42 () {56 vars in 1124 bytes} [Thu Jul 28 08:37:19 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:37:19.306225 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d17793b-b0d7-4912-9c49-1f4879a24155 None admin] Authenticating user token {{(pid=282899) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:37:19.324614 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1df6bd-2223-428c-8dae-674996cdfbe1 None admin] Validating token access rules against request {{(pid=282898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:37:19.326654 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG dbcounter [-] [282898] Writing DB stats keystone:SELECT=100 {{(pid=282898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:37:19.363377 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f5e9ed3-bfdc-43fa-afba-cabc0db78966 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:37:19.364222 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5e9ed3-bfdc-43fa-afba-cabc0db78966 None admin] REQUEST_METHOD: `PUT` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:37:19.364504 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5e9ed3-bfdc-43fa-afba-cabc0db78966 None admin] SCRIPT_NAME: `/identity` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:37:19.364810 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5e9ed3-bfdc-43fa-afba-cabc0db78966 None admin] PATH_INFO: `/v3/projects/5cde68cbfb9042dc9f36af3aacea2473/users/5e192fe026ef4f109b9a1099815c5926/roles/a0e2a00bf94d40f38629d6b5293e3aee` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:37:19.367290 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f5e9ed3-bfdc-43fa-afba-cabc0db78966 None admin] RBAC: Authorizing `identity:create_grant(project_id=5cde68cbfb9042dc9f36af3aacea2473, user_id=5e192fe026ef4f109b9a1099815c5926, role_id=a0e2a00bf94d40f38629d6b5293e3aee)` {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:37:19.369093 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f5e9ed3-bfdc-43fa-afba-cabc0db78966 None admin] RBAC: Authorization granted {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:37:19.385103 dv-cinder-851351-1-smb devstack@keystone.service[282898]: [pid: 282898|app: 0|req: 386/759] 10.222.0.42 () {58 vars in 1439 bytes} [Thu Jul 28 08:37:19 2022] PUT /identity/v3/projects/5cde68cbfb9042dc9f36af3aacea2473/users/5e192fe026ef4f109b9a1099815c5926/roles/a0e2a00bf94d40f38629d6b5293e3aee => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 08:37:19.397712 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f5e9ed3-bfdc-43fa-afba-cabc0db78966 None admin] Authenticating user token {{(pid=282898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:37:19.437370 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d17793b-b0d7-4912-9c49-1f4879a24155 None admin] Validating token access rules against request {{(pid=282899) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:37:19.490585 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf588cb-8696-4681-a83e-2601876d7cb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282899) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:37:19.491701 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf588cb-8696-4681-a83e-2601876d7cb9 None admin] REQUEST_METHOD: `GET` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:37:19.492200 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf588cb-8696-4681-a83e-2601876d7cb9 None admin] SCRIPT_NAME: `/identity` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:37:19.493069 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf588cb-8696-4681-a83e-2601876d7cb9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:37:19.511534 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG dbcounter [-] [282899] Writing DB stats keystone:SELECT=100 {{(pid=282899) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:37:19.530698 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f5e9ed3-bfdc-43fa-afba-cabc0db78966 None admin] Validating token access rules against request {{(pid=282898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:37:19.580688 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c138156-c5f5-41b4-bc5d-078cecf4d6a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:37:19.581269 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c138156-c5f5-41b4-bc5d-078cecf4d6a0 None admin] REQUEST_METHOD: `GET` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:37:19.581557 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c138156-c5f5-41b4-bc5d-078cecf4d6a0 None admin] SCRIPT_NAME: `/identity` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:37:19.581843 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c138156-c5f5-41b4-bc5d-078cecf4d6a0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:37:19.593453 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf588cb-8696-4681-a83e-2601876d7cb9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:37:19.593816 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c138156-c5f5-41b4-bc5d-078cecf4d6a0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:37:19.594962 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf588cb-8696-4681-a83e-2601876d7cb9 None admin] RBAC: Authorization granted {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:37:19.595242 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c138156-c5f5-41b4-bc5d-078cecf4d6a0 None admin] RBAC: Authorization granted {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:37:19.612925 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application [None req-8c138156-c5f5-41b4-bc5d-078cecf4d6a0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 08:37:19.612925 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:37:19.612925 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:37:19.612925 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:37:19.612925 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:37:19.612925 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:37:19.612925 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:37:19.612925 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:37:19.612925 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:37:19.612925 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:37:19.612925 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:37:19.612925 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:37:19.612925 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 08:37:19.612925 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 08:37:19.612925 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 08:37:19.614088 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 08:37:19.614088 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:37:19.614088 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:37:19.614088 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:37:19.614088 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:37:19.614088 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:37:19.614088 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:37:19.614088 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:37:19.614088 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application with Lock( Jul 28 08:37:19.614088 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:37:19.614088 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:37:19.614088 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:37:19.614088 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:37:19.614088 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:37:19.614088 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:37:19.614088 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:37:19.614088 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:37:19.615576 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 08:37:19.615576 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 08:37:19.615576 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 08:37:19.615576 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application Jul 28 08:37:19.615576 dv-cinder-851351-1-smb devstack@keystone.service[282898]: [pid: 282898|app: 0|req: 387/760] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 08:37:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:37:19.615576 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c138156-c5f5-41b4-bc5d-078cecf4d6a0 None admin] Authenticating user token {{(pid=282898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:37:19.632558 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG dbcounter [-] [282898] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=282898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:37:19.728844 dv-cinder-851351-1-smb devstack@keystone.service[282899]: [pid: 282899|app: 0|req: 374/761] 10.222.0.42 () {58 vars in 1282 bytes} [Thu Jul 28 08:37:19 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 427 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 28 08:37:19.729748 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf588cb-8696-4681-a83e-2601876d7cb9 None admin] Authenticating user token {{(pid=282899) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:37:19.734568 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c138156-c5f5-41b4-bc5d-078cecf4d6a0 None admin] Validating token access rules against request {{(pid=282898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:37:19.779304 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7178c3c-2b35-465c-ad50-37cedb5f0905 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:37:19.780328 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7178c3c-2b35-465c-ad50-37cedb5f0905 None admin] REQUEST_METHOD: `GET` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:37:19.780486 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG dbcounter [-] [282899] Writing DB stats keystone:SELECT=100 {{(pid=282899) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:37:19.781304 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7178c3c-2b35-465c-ad50-37cedb5f0905 None admin] SCRIPT_NAME: `/identity` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:37:19.781950 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7178c3c-2b35-465c-ad50-37cedb5f0905 None admin] PATH_INFO: `/v3/services` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:37:19.783007 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7178c3c-2b35-465c-ad50-37cedb5f0905 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=282898) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:37:19.783761 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7178c3c-2b35-465c-ad50-37cedb5f0905 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:37:19.787065 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7178c3c-2b35-465c-ad50-37cedb5f0905 None admin] RBAC: Authorization granted {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:37:19.804501 dv-cinder-851351-1-smb devstack@keystone.service[282898]: [pid: 282898|app: 0|req: 388/762] 10.222.0.42 () {56 vars in 1124 bytes} [Thu Jul 28 08:37:19 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:37:19.804501 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7178c3c-2b35-465c-ad50-37cedb5f0905 None admin] Authenticating user token {{(pid=282898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:37:19.877790 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf588cb-8696-4681-a83e-2601876d7cb9 None admin] Validating token access rules against request {{(pid=282899) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:37:19.904039 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG dbcounter [-] [282898] Writing DB stats keystone:SELECT=100 {{(pid=282898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:37:19.925968 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-062e1265-039c-4176-bf35-7a842f7ad46c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282899) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:37:19.927929 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062e1265-039c-4176-bf35-7a842f7ad46c None admin] REQUEST_METHOD: `GET` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:37:19.928424 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062e1265-039c-4176-bf35-7a842f7ad46c None admin] SCRIPT_NAME: `/identity` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:37:19.928939 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062e1265-039c-4176-bf35-7a842f7ad46c None admin] PATH_INFO: `/v3/domains` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:37:19.929837 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-062e1265-039c-4176-bf35-7a842f7ad46c None admin] RBAC: Adding query filter params (name=Default) {{(pid=282899) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:37:19.929972 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7178c3c-2b35-465c-ad50-37cedb5f0905 None admin] Validating token access rules against request {{(pid=282898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:37:19.930459 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-062e1265-039c-4176-bf35-7a842f7ad46c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:37:19.932263 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-062e1265-039c-4176-bf35-7a842f7ad46c None admin] RBAC: Authorization granted {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:37:19.953369 dv-cinder-851351-1-smb devstack@keystone.service[282899]: [pid: 282899|app: 0|req: 375/763] 10.222.0.42 () {56 vars in 1109 bytes} [Thu Jul 28 08:37:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:37:19.955066 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-062e1265-039c-4176-bf35-7a842f7ad46c None admin] Authenticating user token {{(pid=282899) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:37:19.979889 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d4f67e-9b11-4cef-82bb-bc233f6019d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:37:19.981158 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d4f67e-9b11-4cef-82bb-bc233f6019d9 None admin] REQUEST_METHOD: `GET` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:37:19.981710 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d4f67e-9b11-4cef-82bb-bc233f6019d9 None admin] SCRIPT_NAME: `/identity` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:37:19.982830 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d4f67e-9b11-4cef-82bb-bc233f6019d9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:37:20.001778 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59d4f67e-9b11-4cef-82bb-bc233f6019d9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:37:20.004964 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59d4f67e-9b11-4cef-82bb-bc233f6019d9 None admin] RBAC: Authorization granted {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:37:20.026016 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application [None req-59d4f67e-9b11-4cef-82bb-bc233f6019d9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 08:37:20.026016 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:37:20.026016 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:37:20.026016 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:37:20.026016 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:37:20.026016 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:37:20.026016 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:37:20.026016 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:37:20.026016 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:37:20.026016 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:37:20.026016 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:37:20.026016 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:37:20.026016 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 08:37:20.026016 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 08:37:20.026016 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 08:37:20.027155 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 08:37:20.027155 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:37:20.027155 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:37:20.027155 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:37:20.027155 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:37:20.027155 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:37:20.027155 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:37:20.027155 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:37:20.027155 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application with Lock( Jul 28 08:37:20.027155 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:37:20.027155 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:37:20.027155 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:37:20.027155 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:37:20.027155 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:37:20.027155 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:37:20.027155 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:37:20.027155 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:37:20.028291 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 08:37:20.028291 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 08:37:20.028291 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 08:37:20.028291 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application Jul 28 08:37:20.030840 dv-cinder-851351-1-smb devstack@keystone.service[282898]: [pid: 282898|app: 0|req: 389/764] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 08:37:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:37:20.032001 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d4f67e-9b11-4cef-82bb-bc233f6019d9 None admin] Authenticating user token {{(pid=282898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:37:20.072248 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-062e1265-039c-4176-bf35-7a842f7ad46c None admin] Validating token access rules against request {{(pid=282899) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:37:20.073990 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG dbcounter [-] [282899] Writing DB stats keystone:SELECT=100 {{(pid=282899) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:37:20.114976 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db81d86d-2b7b-4a81-bcd6-f261364af55f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282899) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:37:20.116484 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db81d86d-2b7b-4a81-bcd6-f261364af55f None admin] REQUEST_METHOD: `GET` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:37:20.117040 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db81d86d-2b7b-4a81-bcd6-f261364af55f None admin] SCRIPT_NAME: `/identity` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:37:20.117570 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db81d86d-2b7b-4a81-bcd6-f261364af55f None admin] PATH_INFO: `/v3/endpoints` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:37:20.118634 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db81d86d-2b7b-4a81-bcd6-f261364af55f None admin] RBAC: Adding query filter params (interface=public, service_id=408750ccd69d4646b0bf8194c0c0ee8f, region_id=RegionOne) {{(pid=282899) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:37:20.119198 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db81d86d-2b7b-4a81-bcd6-f261364af55f None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:37:20.120997 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db81d86d-2b7b-4a81-bcd6-f261364af55f None admin] RBAC: Authorization granted {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:37:20.132941 dv-cinder-851351-1-smb devstack@keystone.service[282899]: [pid: 282899|app: 0|req: 376/765] 10.222.0.42 () {56 vars in 1251 bytes} [Thu Jul 28 08:37:19 2022] GET /identity/v3/endpoints?service_id=408750ccd69d4646b0bf8194c0c0ee8f&interface=public®ion_id=RegionOne => generated 194 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:37:20.134209 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db81d86d-2b7b-4a81-bcd6-f261364af55f None admin] Authenticating user token {{(pid=282899) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:37:20.187536 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d4f67e-9b11-4cef-82bb-bc233f6019d9 None admin] Validating token access rules against request {{(pid=282898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:37:20.221925 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG dbcounter [-] [282898] Writing DB stats keystone:SELECT=100 {{(pid=282898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:37:20.230275 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdca0c1f-164f-4d41-8023-25232619163b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:37:20.231265 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdca0c1f-164f-4d41-8023-25232619163b None admin] REQUEST_METHOD: `GET` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:37:20.231797 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdca0c1f-164f-4d41-8023-25232619163b None admin] SCRIPT_NAME: `/identity` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:37:20.232428 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdca0c1f-164f-4d41-8023-25232619163b None admin] PATH_INFO: `/v3/projects/service` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:37:20.240399 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdca0c1f-164f-4d41-8023-25232619163b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:37:20.242319 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdca0c1f-164f-4d41-8023-25232619163b None admin] RBAC: Authorization granted {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:37:20.255275 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application [None req-fdca0c1f-164f-4d41-8023-25232619163b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 08:37:20.255275 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:37:20.255275 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:37:20.255275 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:37:20.255275 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:37:20.255275 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:37:20.255275 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:37:20.255275 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:37:20.255275 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:37:20.255275 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:37:20.255275 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:37:20.255275 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:37:20.255275 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 28 08:37:20.255275 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 28 08:37:20.255275 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 28 08:37:20.256427 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 28 08:37:20.256427 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:37:20.256427 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:37:20.256427 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:37:20.256427 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:37:20.256427 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:37:20.256427 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:37:20.256427 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:37:20.256427 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application with Lock( Jul 28 08:37:20.256427 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:37:20.256427 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:37:20.256427 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:37:20.256427 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:37:20.256427 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:37:20.256427 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:37:20.256427 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:37:20.256427 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:37:20.257647 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 28 08:37:20.257647 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 28 08:37:20.257647 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 28 08:37:20.257647 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 28 08:37:20.257647 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 28 08:37:20.257647 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 28 08:37:20.257647 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 08:37:20.257647 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application Jul 28 08:37:20.257647 dv-cinder-851351-1-smb devstack@keystone.service[282898]: [pid: 282898|app: 0|req: 390/766] 10.222.0.42 () {56 vars in 1111 bytes} [Thu Jul 28 08:37:20 2022] GET /identity/v3/projects/service => generated 88 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:37:20.257647 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdca0c1f-164f-4d41-8023-25232619163b None admin] Authenticating user token {{(pid=282898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:37:20.271709 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db81d86d-2b7b-4a81-bcd6-f261364af55f None admin] Validating token access rules against request {{(pid=282899) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:37:20.310212 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8faf248-491f-4ff8-837b-35f80bafe92d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282899) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:37:20.310924 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8faf248-491f-4ff8-837b-35f80bafe92d None admin] REQUEST_METHOD: `GET` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:37:20.311204 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8faf248-491f-4ff8-837b-35f80bafe92d None admin] SCRIPT_NAME: `/identity` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:37:20.311611 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8faf248-491f-4ff8-837b-35f80bafe92d None admin] PATH_INFO: `/v3/domains` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:37:20.312335 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8faf248-491f-4ff8-837b-35f80bafe92d None admin] RBAC: Adding query filter params (name=Default) {{(pid=282899) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:37:20.312650 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8faf248-491f-4ff8-837b-35f80bafe92d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:37:20.314072 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8faf248-491f-4ff8-837b-35f80bafe92d None admin] RBAC: Authorization granted {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:37:20.326724 dv-cinder-851351-1-smb devstack@keystone.service[282899]: [pid: 282899|app: 0|req: 377/767] 10.222.0.42 () {56 vars in 1109 bytes} [Thu Jul 28 08:37:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:37:20.327791 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab40a3ad-6c85-4b69-be30-767150bae2cb None None] REQUEST_METHOD: `GET` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:37:20.328081 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab40a3ad-6c85-4b69-be30-767150bae2cb None None] SCRIPT_NAME: `/identity` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:37:20.328362 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab40a3ad-6c85-4b69-be30-767150bae2cb None None] PATH_INFO: `/` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:37:20.330259 dv-cinder-851351-1-smb devstack@keystone.service[282899]: [pid: 282899|app: 0|req: 378/768] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 08:37:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 08:37:20.331445 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab40a3ad-6c85-4b69-be30-767150bae2cb None None] Authenticating user token {{(pid=282899) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:37:20.360477 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG dbcounter [-] [282899] Writing DB stats keystone:SELECT=100 {{(pid=282899) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:37:20.382366 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdca0c1f-164f-4d41-8023-25232619163b None admin] Validating token access rules against request {{(pid=282898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:37:20.422956 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3056123d-480d-4e78-b5fc-29aa9299f996 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:37:20.423533 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3056123d-480d-4e78-b5fc-29aa9299f996 None admin] REQUEST_METHOD: `GET` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:37:20.423816 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3056123d-480d-4e78-b5fc-29aa9299f996 None admin] SCRIPT_NAME: `/identity` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:37:20.424171 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3056123d-480d-4e78-b5fc-29aa9299f996 None admin] PATH_INFO: `/v3/services` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:37:20.424839 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3056123d-480d-4e78-b5fc-29aa9299f996 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:37:20.426233 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3056123d-480d-4e78-b5fc-29aa9299f996 None admin] RBAC: Authorization granted {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:37:20.431989 dv-cinder-851351-1-smb devstack@keystone.service[282898]: [pid: 282898|app: 0|req: 391/769] 10.222.0.42 () {56 vars in 1087 bytes} [Thu Jul 28 08:37:20 2022] GET /identity/v3/services => generated 772 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:37:20.432899 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3056123d-480d-4e78-b5fc-29aa9299f996 None admin] Authenticating user token {{(pid=282898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:37:20.454391 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab40a3ad-6c85-4b69-be30-767150bae2cb None None] Validating token access rules against request {{(pid=282899) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:37:20.496477 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1dd6472-8a92-41dd-b64a-9bae63b1e3bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282899) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:37:20.497178 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1dd6472-8a92-41dd-b64a-9bae63b1e3bc None admin] REQUEST_METHOD: `GET` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:37:20.497462 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1dd6472-8a92-41dd-b64a-9bae63b1e3bc None admin] SCRIPT_NAME: `/identity` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:37:20.497740 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1dd6472-8a92-41dd-b64a-9bae63b1e3bc None admin] PATH_INFO: `/v3/projects` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:37:20.498781 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1dd6472-8a92-41dd-b64a-9bae63b1e3bc None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=282899) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:37:20.498943 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1dd6472-8a92-41dd-b64a-9bae63b1e3bc None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:37:20.500472 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1dd6472-8a92-41dd-b64a-9bae63b1e3bc None admin] RBAC: Authorization granted {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:37:20.514481 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG dbcounter [-] [282898] Writing DB stats keystone:SELECT=100 {{(pid=282898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:37:20.514836 dv-cinder-851351-1-smb devstack@keystone.service[282899]: [pid: 282899|app: 0|req: 379/770] 10.222.0.42 () {56 vars in 1148 bytes} [Thu Jul 28 08:37:20 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:37:20.516213 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0047c7c-f701-4328-9971-b384b0fe581e None None] REQUEST_METHOD: `POST` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:37:20.516512 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0047c7c-f701-4328-9971-b384b0fe581e None None] SCRIPT_NAME: `/identity` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:37:20.516842 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0047c7c-f701-4328-9971-b384b0fe581e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:37:20.537410 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.auth.core [None req-c0047c7c-f701-4328-9971-b384b0fe581e None None] MFA Rules not processed for user `2be990a66857410a87ffa7609aec4f7b`. Rule list: `[]` (Enabled: `True`). {{(pid=282899) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 08:37:20.538683 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.fernet_utils [None req-c0047c7c-f701-4328-9971-b384b0fe581e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=282899) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:37:20.574130 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3056123d-480d-4e78-b5fc-29aa9299f996 None admin] Validating token access rules against request {{(pid=282898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:37:20.626162 dv-cinder-851351-1-smb devstack@keystone.service[282899]: [pid: 282899|app: 0|req: 380/771] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 08:37:20 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 08:37:20.626162 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0047c7c-f701-4328-9971-b384b0fe581e None None] Authenticating user token {{(pid=282899) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:37:20.633111 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96902034-bedd-4976-8ab4-9fda24d7823a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:37:20.633806 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96902034-bedd-4976-8ab4-9fda24d7823a None admin] REQUEST_METHOD: `GET` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:37:20.634098 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96902034-bedd-4976-8ab4-9fda24d7823a None admin] SCRIPT_NAME: `/identity` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:37:20.634398 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96902034-bedd-4976-8ab4-9fda24d7823a None admin] PATH_INFO: `/v3/projects/service` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:37:20.642600 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96902034-bedd-4976-8ab4-9fda24d7823a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:37:20.644657 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96902034-bedd-4976-8ab4-9fda24d7823a None admin] RBAC: Authorization granted {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:37:20.656552 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG dbcounter [-] [282899] Writing DB stats keystone:SELECT=100 {{(pid=282899) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:37:20.660202 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application [None req-96902034-bedd-4976-8ab4-9fda24d7823a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 08:37:20.660202 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:37:20.660202 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:37:20.660202 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:37:20.660202 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:37:20.660202 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:37:20.660202 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:37:20.660202 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:37:20.660202 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:37:20.660202 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:37:20.660202 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:37:20.660202 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:37:20.660202 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 28 08:37:20.660202 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 28 08:37:20.660202 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 28 08:37:20.661463 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 28 08:37:20.661463 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:37:20.661463 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:37:20.661463 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:37:20.661463 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:37:20.661463 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:37:20.661463 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:37:20.661463 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:37:20.661463 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application with Lock( Jul 28 08:37:20.661463 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:37:20.661463 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:37:20.661463 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:37:20.661463 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:37:20.661463 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:37:20.661463 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:37:20.661463 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:37:20.661463 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:37:20.662594 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 28 08:37:20.662594 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 28 08:37:20.662594 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 28 08:37:20.662594 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 28 08:37:20.662594 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 28 08:37:20.662594 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 28 08:37:20.662594 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 08:37:20.662594 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application Jul 28 08:37:20.662594 dv-cinder-851351-1-smb devstack@keystone.service[282898]: [pid: 282898|app: 0|req: 392/772] 10.222.0.42 () {56 vars in 1111 bytes} [Thu Jul 28 08:37:20 2022] GET /identity/v3/projects/service => generated 88 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:37:20.663643 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96902034-bedd-4976-8ab4-9fda24d7823a None admin] Authenticating user token {{(pid=282898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:37:20.750435 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0047c7c-f701-4328-9971-b384b0fe581e None None] Validating token access rules against request {{(pid=282899) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:37:20.788708 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-062cc2ef-016c-4dec-9300-8ec4c3b03a9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282899) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:37:20.789055 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062cc2ef-016c-4dec-9300-8ec4c3b03a9e None admin] REQUEST_METHOD: `GET` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:37:20.789347 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062cc2ef-016c-4dec-9300-8ec4c3b03a9e None admin] SCRIPT_NAME: `/identity` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:37:20.789735 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062cc2ef-016c-4dec-9300-8ec4c3b03a9e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:37:20.790645 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-062cc2ef-016c-4dec-9300-8ec4c3b03a9e None admin] RBAC: Adding query filter params (role.id=a0e2a00bf94d40f38629d6b5293e3aee, scope.project.id=5cde68cbfb9042dc9f36af3aacea2473, user.id=f3a6183fd2c040079951febe23234356) {{(pid=282899) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:37:20.791030 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-062cc2ef-016c-4dec-9300-8ec4c3b03a9e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:37:20.792740 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-062cc2ef-016c-4dec-9300-8ec4c3b03a9e None admin] RBAC: Authorization granted {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:37:20.799198 dv-cinder-851351-1-smb devstack@keystone.service[282899]: [pid: 282899|app: 0|req: 381/773] 10.222.0.42 () {56 vars in 1374 bytes} [Thu Jul 28 08:37:20 2022] GET /identity/v3/role_assignments?user.id=f3a6183fd2c040079951febe23234356&scope.project.id=5cde68cbfb9042dc9f36af3aacea2473&role.id=a0e2a00bf94d40f38629d6b5293e3aee => generated 259 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:37:20.800148 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-062cc2ef-016c-4dec-9300-8ec4c3b03a9e None admin] Authenticating user token {{(pid=282899) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:37:20.863789 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96902034-bedd-4976-8ab4-9fda24d7823a None admin] Validating token access rules against request {{(pid=282898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:37:20.893750 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG dbcounter [-] [282898] Writing DB stats keystone:SELECT=100 {{(pid=282898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:37:20.917096 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG dbcounter [-] [282899] Writing DB stats keystone:SELECT=100 {{(pid=282899) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:37:20.933348 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-062cc2ef-016c-4dec-9300-8ec4c3b03a9e None admin] Validating token access rules against request {{(pid=282899) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:37:20.961473 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60479128-d750-4b45-a31e-a07d30f33383 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:37:20.962158 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60479128-d750-4b45-a31e-a07d30f33383 None admin] REQUEST_METHOD: `GET` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:37:20.962450 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60479128-d750-4b45-a31e-a07d30f33383 None admin] SCRIPT_NAME: `/identity` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:37:20.962721 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60479128-d750-4b45-a31e-a07d30f33383 None admin] PATH_INFO: `/v3/services/network` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:37:20.963443 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60479128-d750-4b45-a31e-a07d30f33383 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:37:20.964826 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60479128-d750-4b45-a31e-a07d30f33383 None admin] RBAC: Authorization granted {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:37:20.976594 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3bad34-f96a-40ff-8e6c-8568d531f4e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282899) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:37:20.977105 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3bad34-f96a-40ff-8e6c-8568d531f4e0 None admin] REQUEST_METHOD: `GET` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:37:20.977395 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3bad34-f96a-40ff-8e6c-8568d531f4e0 None admin] SCRIPT_NAME: `/identity` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:37:20.977674 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3bad34-f96a-40ff-8e6c-8568d531f4e0 None admin] PATH_INFO: `/v3/projects` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:37:20.978469 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef3bad34-f96a-40ff-8e6c-8568d531f4e0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=282899) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:37:20.978773 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef3bad34-f96a-40ff-8e6c-8568d531f4e0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:37:20.980264 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef3bad34-f96a-40ff-8e6c-8568d531f4e0 None admin] RBAC: Authorization granted {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:37:20.986239 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application [None req-60479128-d750-4b45-a31e-a07d30f33383 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jul 28 08:37:20.986239 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:37:20.986239 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 28 08:37:20.986239 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 28 08:37:20.986239 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 28 08:37:20.986239 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 28 08:37:20.986239 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 28 08:37:20.986239 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 08:37:20.986239 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 28 08:37:20.986239 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application Jul 28 08:37:20.986239 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 28 08:37:20.986239 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application Jul 28 08:37:20.986239 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:37:20.986239 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:37:20.986239 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:37:20.986239 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:37:20.986239 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:37:20.987562 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:37:20.987562 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:37:20.987562 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:37:20.987562 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:37:20.987562 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:37:20.987562 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:37:20.987562 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 28 08:37:20.987562 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 28 08:37:20.987562 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 28 08:37:20.987562 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 28 08:37:20.987562 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:37:20.987562 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:37:20.987562 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:37:20.987562 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:37:20.987562 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:37:20.987562 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:37:20.988551 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:37:20.988551 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application with Lock( Jul 28 08:37:20.988551 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:37:20.988551 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:37:20.988551 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:37:20.988551 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:37:20.988551 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:37:20.988551 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:37:20.988551 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:37:20.988551 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:37:20.988551 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 28 08:37:20.988551 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 08:37:20.988551 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 28 08:37:20.988551 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application Jul 28 08:37:20.988551 dv-cinder-851351-1-smb devstack@keystone.service[282898]: [pid: 282898|app: 0|req: 393/774] 10.222.0.42 () {56 vars in 1111 bytes} [Thu Jul 28 08:37:20 2022] GET /identity/v3/services/network => generated 88 bytes in 325 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:37:20.993609 dv-cinder-851351-1-smb devstack@keystone.service[282899]: [pid: 282899|app: 0|req: 382/775] 10.222.0.42 () {56 vars in 1148 bytes} [Thu Jul 28 08:37:20 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:37:20.997715 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60479128-d750-4b45-a31e-a07d30f33383 None admin] Authenticating user token {{(pid=282898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:37:20.999375 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3bad34-f96a-40ff-8e6c-8568d531f4e0 None admin] Authenticating user token {{(pid=282899) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:37:21.108969 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3bad34-f96a-40ff-8e6c-8568d531f4e0 None admin] Validating token access rules against request {{(pid=282899) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:37:21.182204 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e2860ec-9f8e-473c-861c-0b1a06f33e1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282899) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:37:21.183264 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2860ec-9f8e-473c-861c-0b1a06f33e1c None admin] REQUEST_METHOD: `GET` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:37:21.183768 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2860ec-9f8e-473c-861c-0b1a06f33e1c None admin] SCRIPT_NAME: `/identity` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:37:21.184283 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2860ec-9f8e-473c-861c-0b1a06f33e1c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:37:21.185877 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e2860ec-9f8e-473c-861c-0b1a06f33e1c None admin] RBAC: Adding query filter params (role.id=aa4daecf3ff74fa1b7d53041a4659723, scope.project.id=5cde68cbfb9042dc9f36af3aacea2473, user.id=f4a66540de9f46a2bc490af024cc37cd) {{(pid=282899) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:37:21.186468 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e2860ec-9f8e-473c-861c-0b1a06f33e1c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:37:21.189310 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e2860ec-9f8e-473c-861c-0b1a06f33e1c None admin] RBAC: Authorization granted {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:37:21.216187 dv-cinder-851351-1-smb devstack@keystone.service[282899]: [pid: 282899|app: 0|req: 383/776] 10.222.0.42 () {56 vars in 1374 bytes} [Thu Jul 28 08:37:20 2022] GET /identity/v3/role_assignments?user.id=f4a66540de9f46a2bc490af024cc37cd&scope.project.id=5cde68cbfb9042dc9f36af3aacea2473&role.id=aa4daecf3ff74fa1b7d53041a4659723 => generated 259 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 08:37:21.223190 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60479128-d750-4b45-a31e-a07d30f33383 None admin] Validating token access rules against request {{(pid=282898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:37:21.290363 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d38389-543a-45ad-a094-4ce74b8d6843 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:37:21.291458 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d38389-543a-45ad-a094-4ce74b8d6843 None admin] REQUEST_METHOD: `GET` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:37:21.291965 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d38389-543a-45ad-a094-4ce74b8d6843 None admin] SCRIPT_NAME: `/identity` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:37:21.292478 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d38389-543a-45ad-a094-4ce74b8d6843 None admin] PATH_INFO: `/v3/services` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:37:21.293868 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5d38389-543a-45ad-a094-4ce74b8d6843 None admin] RBAC: Adding query filter params (name=network) {{(pid=282898) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:37:21.294442 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5d38389-543a-45ad-a094-4ce74b8d6843 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:37:21.297196 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5d38389-543a-45ad-a094-4ce74b8d6843 None admin] RBAC: Authorization granted {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:37:21.306981 dv-cinder-851351-1-smb devstack@keystone.service[282898]: [pid: 282898|app: 0|req: 394/777] 10.222.0.42 () {56 vars in 1112 bytes} [Thu Jul 28 08:37:20 2022] GET /identity/v3/services?name=network => generated 124 bytes in 309 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:37:21.316955 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e2860ec-9f8e-473c-861c-0b1a06f33e1c None admin] Authenticating user token {{(pid=282899) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:37:21.333874 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG dbcounter [-] [282899] Writing DB stats keystone:SELECT=100 {{(pid=282899) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:37:21.523537 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e2860ec-9f8e-473c-861c-0b1a06f33e1c None admin] Validating token access rules against request {{(pid=282899) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:37:21.591143 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2d14bd-767d-4bea-bb9d-9a028dadf6c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282899) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:37:21.591803 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2d14bd-767d-4bea-bb9d-9a028dadf6c7 None admin] REQUEST_METHOD: `GET` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:37:21.592091 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2d14bd-767d-4bea-bb9d-9a028dadf6c7 None admin] SCRIPT_NAME: `/identity` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:37:21.592370 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2d14bd-767d-4bea-bb9d-9a028dadf6c7 None admin] PATH_INFO: `/v3/services` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:37:21.593111 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f2d14bd-767d-4bea-bb9d-9a028dadf6c7 None admin] RBAC: Adding query filter params (type=network) {{(pid=282899) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:37:21.593428 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f2d14bd-767d-4bea-bb9d-9a028dadf6c7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:37:21.594838 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f2d14bd-767d-4bea-bb9d-9a028dadf6c7 None admin] RBAC: Authorization granted {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:37:21.601587 dv-cinder-851351-1-smb devstack@keystone.service[282899]: [pid: 282899|app: 0|req: 384/778] 10.222.0.42 () {56 vars in 1112 bytes} [Thu Jul 28 08:37:21 2022] GET /identity/v3/services?type=network => generated 350 bytes in 286 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:37:21.611375 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d38389-543a-45ad-a094-4ce74b8d6843 None admin] Authenticating user token {{(pid=282898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:37:21.677965 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG dbcounter [-] [282898] Writing DB stats keystone:SELECT=100 {{(pid=282898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:37:21.787251 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d38389-543a-45ad-a094-4ce74b8d6843 None admin] Validating token access rules against request {{(pid=282898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:37:21.851545 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cfa6552-143e-4ce1-b5dd-a34700d0f024 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:37:21.852639 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cfa6552-143e-4ce1-b5dd-a34700d0f024 None admin] REQUEST_METHOD: `GET` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:37:21.853177 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cfa6552-143e-4ce1-b5dd-a34700d0f024 None admin] SCRIPT_NAME: `/identity` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:37:21.853679 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cfa6552-143e-4ce1-b5dd-a34700d0f024 None admin] PATH_INFO: `/v3/endpoints` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:37:21.855170 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cfa6552-143e-4ce1-b5dd-a34700d0f024 None admin] RBAC: Adding query filter params (interface=public, service_id=60978dd9fbd24539b45f183407d2d865, region_id=RegionOne) {{(pid=282898) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:37:21.855738 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cfa6552-143e-4ce1-b5dd-a34700d0f024 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:37:21.858497 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cfa6552-143e-4ce1-b5dd-a34700d0f024 None admin] RBAC: Authorization granted {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:37:21.873843 dv-cinder-851351-1-smb devstack@keystone.service[282898]: [pid: 282898|app: 0|req: 395/779] 10.222.0.42 () {56 vars in 1251 bytes} [Thu Jul 28 08:37:21 2022] GET /identity/v3/endpoints?service_id=60978dd9fbd24539b45f183407d2d865&interface=public®ion_id=RegionOne => generated 194 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:37:21.883494 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2d14bd-767d-4bea-bb9d-9a028dadf6c7 None admin] Authenticating user token {{(pid=282899) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:37:22.030196 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG dbcounter [-] [282899] Writing DB stats keystone:SELECT=100 {{(pid=282899) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:37:22.059075 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce28fa2-cc60-4ddb-8d74-c22584c4bdca None None] REQUEST_METHOD: `GET` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:37:22.059463 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce28fa2-cc60-4ddb-8d74-c22584c4bdca None None] SCRIPT_NAME: `/identity` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:37:22.059945 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce28fa2-cc60-4ddb-8d74-c22584c4bdca None None] PATH_INFO: `/` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:37:22.062479 dv-cinder-851351-1-smb devstack@keystone.service[282898]: [pid: 282898|app: 0|req: 396/780] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 08:37:22 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 08:37:22.070243 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a593881-f57c-4d81-9b3d-8e4debbf5b69 None None] REQUEST_METHOD: `POST` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:37:22.070700 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a593881-f57c-4d81-9b3d-8e4debbf5b69 None None] SCRIPT_NAME: `/identity` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:37:22.072090 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a593881-f57c-4d81-9b3d-8e4debbf5b69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:37:22.084884 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2d14bd-767d-4bea-bb9d-9a028dadf6c7 None admin] Validating token access rules against request {{(pid=282899) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:37:22.107808 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.auth.core [None req-6a593881-f57c-4d81-9b3d-8e4debbf5b69 None None] MFA Rules not processed for user `2be990a66857410a87ffa7609aec4f7b`. Rule list: `[]` (Enabled: `True`). {{(pid=282898) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 08:37:22.110474 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.fernet_utils [None req-6a593881-f57c-4d81-9b3d-8e4debbf5b69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=282898) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:37:22.198167 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e81427-767e-4e9f-851d-237ebd609904 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282899) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:37:22.199257 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e81427-767e-4e9f-851d-237ebd609904 None admin] REQUEST_METHOD: `GET` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:37:22.199762 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e81427-767e-4e9f-851d-237ebd609904 None admin] SCRIPT_NAME: `/identity` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:37:22.200281 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e81427-767e-4e9f-851d-237ebd609904 None admin] PATH_INFO: `/v3/services` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:37:22.201218 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7e81427-767e-4e9f-851d-237ebd609904 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:37:22.202907 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7e81427-767e-4e9f-851d-237ebd609904 None admin] RBAC: Authorization granted {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:37:22.219903 dv-cinder-851351-1-smb devstack@keystone.service[282899]: [pid: 282899|app: 0|req: 385/781] 10.222.0.42 () {56 vars in 1087 bytes} [Thu Jul 28 08:37:21 2022] GET /identity/v3/services => generated 772 bytes in 337 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:37:22.262090 dv-cinder-851351-1-smb devstack@keystone.service[282898]: [pid: 282898|app: 0|req: 397/782] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 08:37:22 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 08:37:22.303487 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e81427-767e-4e9f-851d-237ebd609904 None admin] Authenticating user token {{(pid=282899) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:37:22.476910 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e81427-767e-4e9f-851d-237ebd609904 None admin] Validating token access rules against request {{(pid=282899) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:37:22.515520 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG dbcounter [-] [282899] Writing DB stats keystone:SELECT=100 {{(pid=282899) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:37:22.521541 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6adb849-98f1-452e-9acb-a9c2df95f3d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282899) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:37:22.522700 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6adb849-98f1-452e-9acb-a9c2df95f3d9 None admin] REQUEST_METHOD: `GET` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:37:22.523241 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6adb849-98f1-452e-9acb-a9c2df95f3d9 None admin] SCRIPT_NAME: `/identity` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:37:22.523753 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6adb849-98f1-452e-9acb-a9c2df95f3d9 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:37:22.535809 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6adb849-98f1-452e-9acb-a9c2df95f3d9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 08:37:22.541743 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application [None req-a6adb849-98f1-452e-9acb-a9c2df95f3d9 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 08:37:22.541743 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:37:22.541743 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:37:22.541743 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:37:22.541743 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:37:22.541743 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:37:22.541743 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:37:22.541743 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:37:22.541743 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:37:22.541743 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:37:22.541743 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:37:22.541743 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:37:22.541743 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 08:37:22.541743 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 08:37:22.541743 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 08:37:22.541743 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 08:37:22.542869 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 08:37:22.542869 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 08:37:22.542869 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 08:37:22.542869 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 08:37:22.542869 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:37:22.542869 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:37:22.542869 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:37:22.542869 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:37:22.542869 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:37:22.542869 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:37:22.542869 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:37:22.542869 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application with Lock( Jul 28 08:37:22.542869 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:37:22.542869 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:37:22.542869 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:37:22.542869 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:37:22.543982 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:37:22.543982 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:37:22.543982 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:37:22.543982 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:37:22.543982 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 08:37:22.543982 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 08:37:22.543982 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 08:37:22.543982 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 08:37:22.543982 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 08:37:22.543982 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 08:37:22.543982 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 08:37:22.543982 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application Jul 28 08:37:22.547016 dv-cinder-851351-1-smb devstack@keystone.service[282899]: [pid: 282899|app: 0|req: 386/783] 10.222.0.42 () {56 vars in 1096 bytes} [Thu Jul 28 08:37:22 2022] GET /identity/v3/roles/admin => generated 83 bytes in 244 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 08:37:22.553494 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a593881-f57c-4d81-9b3d-8e4debbf5b69 None None] Authenticating user token {{(pid=282898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:37:22.598093 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG dbcounter [-] [282898] Writing DB stats keystone:SELECT=100 {{(pid=282898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:37:22.692945 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a593881-f57c-4d81-9b3d-8e4debbf5b69 None None] Validating token access rules against request {{(pid=282898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:37:22.739061 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8512a14-b3db-4af1-b33e-61dfbc88f31e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:37:22.740093 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8512a14-b3db-4af1-b33e-61dfbc88f31e None admin] REQUEST_METHOD: `GET` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:37:22.740617 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8512a14-b3db-4af1-b33e-61dfbc88f31e None admin] SCRIPT_NAME: `/identity` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:37:22.741139 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8512a14-b3db-4af1-b33e-61dfbc88f31e None admin] PATH_INFO: `/v3/roles` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:37:22.742101 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8512a14-b3db-4af1-b33e-61dfbc88f31e None admin] RBAC: Adding query filter params (name=admin) {{(pid=282898) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:37:22.742647 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8512a14-b3db-4af1-b33e-61dfbc88f31e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:37:22.744370 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8512a14-b3db-4af1-b33e-61dfbc88f31e None admin] RBAC: Authorization granted {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:37:22.760166 dv-cinder-851351-1-smb devstack@keystone.service[282898]: [pid: 282898|app: 0|req: 398/784] 10.222.0.42 () {56 vars in 1099 bytes} [Thu Jul 28 08:37:22 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:37:22.766094 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6adb849-98f1-452e-9acb-a9c2df95f3d9 None admin] Authenticating user token {{(pid=282899) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:37:22.916723 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6adb849-98f1-452e-9acb-a9c2df95f3d9 None admin] Validating token access rules against request {{(pid=282899) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:37:22.965770 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed69152e-cacd-4fde-b9a8-007152c42441 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282899) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:37:22.966531 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed69152e-cacd-4fde-b9a8-007152c42441 None admin] REQUEST_METHOD: `GET` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:37:22.966821 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed69152e-cacd-4fde-b9a8-007152c42441 None admin] SCRIPT_NAME: `/identity` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:37:22.967152 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed69152e-cacd-4fde-b9a8-007152c42441 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:37:22.986694 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed69152e-cacd-4fde-b9a8-007152c42441 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:37:22.988256 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed69152e-cacd-4fde-b9a8-007152c42441 None admin] RBAC: Authorization granted {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:37:23.010531 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application [None req-ed69152e-cacd-4fde-b9a8-007152c42441 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 08:37:23.010531 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:37:23.010531 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:37:23.010531 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:37:23.010531 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:37:23.010531 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:37:23.010531 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:37:23.010531 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:37:23.010531 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:37:23.010531 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:37:23.010531 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:37:23.010531 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:37:23.010531 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 08:37:23.010531 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 08:37:23.010531 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 08:37:23.012412 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 08:37:23.012412 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:37:23.012412 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:37:23.012412 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:37:23.012412 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:37:23.012412 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:37:23.012412 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:37:23.012412 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:37:23.012412 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application with Lock( Jul 28 08:37:23.012412 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:37:23.012412 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:37:23.012412 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:37:23.012412 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:37:23.012412 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:37:23.012412 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:37:23.012412 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:37:23.012412 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:37:23.014441 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 08:37:23.014441 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 08:37:23.014441 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 08:37:23.014441 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application Jul 28 08:37:23.014441 dv-cinder-851351-1-smb devstack@keystone.service[282899]: [pid: 282899|app: 0|req: 387/785] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 08:37:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 246 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:37:23.020956 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8512a14-b3db-4af1-b33e-61dfbc88f31e None admin] Authenticating user token {{(pid=282898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:37:23.089535 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23be2b7-617f-4696-8d19-ae74db4cbc23 None None] REQUEST_METHOD: `GET` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:37:23.090411 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23be2b7-617f-4696-8d19-ae74db4cbc23 None None] SCRIPT_NAME: `/identity` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:37:23.090411 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23be2b7-617f-4696-8d19-ae74db4cbc23 None None] PATH_INFO: `/` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:37:23.092771 dv-cinder-851351-1-smb devstack@keystone.service[282899]: [pid: 282899|app: 0|req: 388/786] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 08:37:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 28 08:37:23.114186 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea6ded3-eddb-4c2e-884d-372b9002c5cc None None] REQUEST_METHOD: `POST` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:37:23.114506 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea6ded3-eddb-4c2e-884d-372b9002c5cc None None] SCRIPT_NAME: `/identity` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:37:23.114816 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea6ded3-eddb-4c2e-884d-372b9002c5cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:37:23.146181 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.auth.core [None req-eea6ded3-eddb-4c2e-884d-372b9002c5cc None None] MFA Rules not processed for user `2be990a66857410a87ffa7609aec4f7b`. Rule list: `[]` (Enabled: `True`). {{(pid=282899) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 08:37:23.147437 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.fernet_utils [None req-eea6ded3-eddb-4c2e-884d-372b9002c5cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=282899) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:37:23.234119 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG dbcounter [-] [282898] Writing DB stats keystone:SELECT=100 {{(pid=282898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:37:23.243876 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG dbcounter [-] [282899] Writing DB stats keystone:SELECT=100 {{(pid=282899) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:37:23.256853 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8512a14-b3db-4af1-b33e-61dfbc88f31e None admin] Validating token access rules against request {{(pid=282898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:37:23.343153 dv-cinder-851351-1-smb devstack@keystone.service[282899]: [pid: 282899|app: 0|req: 389/787] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 08:37:23 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 230 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 28 08:37:23.373318 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc71204c-972f-4a3d-bcf7-054c613c17e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:37:23.375335 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc71204c-972f-4a3d-bcf7-054c613c17e5 None admin] REQUEST_METHOD: `GET` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:37:23.377286 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc71204c-972f-4a3d-bcf7-054c613c17e5 None admin] SCRIPT_NAME: `/identity` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:37:23.379718 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc71204c-972f-4a3d-bcf7-054c613c17e5 None admin] PATH_INFO: `/v3/domains` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:37:23.381714 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc71204c-972f-4a3d-bcf7-054c613c17e5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=282898) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:37:23.382572 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc71204c-972f-4a3d-bcf7-054c613c17e5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:37:23.385741 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc71204c-972f-4a3d-bcf7-054c613c17e5 None admin] RBAC: Authorization granted {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:37:23.421290 dv-cinder-851351-1-smb devstack@keystone.service[282898]: [pid: 282898|app: 0|req: 399/788] 10.222.0.42 () {56 vars in 1109 bytes} [Thu Jul 28 08:37:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 402 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 08:37:23.426828 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea6ded3-eddb-4c2e-884d-372b9002c5cc None None] Authenticating user token {{(pid=282899) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:37:23.439423 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc71204c-972f-4a3d-bcf7-054c613c17e5 None admin] Authenticating user token {{(pid=282898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:37:23.559238 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea6ded3-eddb-4c2e-884d-372b9002c5cc None None] Validating token access rules against request {{(pid=282899) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:37:23.594987 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b86552d-91a9-4e01-9658-f8bc824fab9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282899) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:37:23.595984 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b86552d-91a9-4e01-9658-f8bc824fab9f None admin] REQUEST_METHOD: `GET` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:37:23.596449 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b86552d-91a9-4e01-9658-f8bc824fab9f None admin] SCRIPT_NAME: `/identity` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:37:23.596927 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b86552d-91a9-4e01-9658-f8bc824fab9f None admin] PATH_INFO: `/v3/users/nova` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:37:23.605080 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b86552d-91a9-4e01-9658-f8bc824fab9f None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:37:23.606803 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b86552d-91a9-4e01-9658-f8bc824fab9f None admin] RBAC: Authorization granted {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:37:23.619811 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application [None req-8b86552d-91a9-4e01-9658-f8bc824fab9f None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 28 08:37:23.619811 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:37:23.619811 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:37:23.619811 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:37:23.619811 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:37:23.619811 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:37:23.619811 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:37:23.619811 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:37:23.619811 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:37:23.619811 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:37:23.619811 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:37:23.619811 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:37:23.619811 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 28 08:37:23.619811 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 28 08:37:23.619811 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 28 08:37:23.619811 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 28 08:37:23.621236 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:37:23.621236 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:37:23.621236 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 28 08:37:23.621236 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 08:37:23.621236 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 28 08:37:23.621236 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 08:37:23.621236 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:37:23.621236 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:37:23.621236 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:37:23.621236 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:37:23.621236 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:37:23.621236 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application with Lock( Jul 28 08:37:23.621236 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:37:23.621236 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:37:23.621236 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:37:23.621236 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:37:23.621236 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:37:23.621236 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:37:23.622600 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:37:23.622600 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:37:23.622600 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 28 08:37:23.622600 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 28 08:37:23.622600 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 28 08:37:23.622600 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 28 08:37:23.622600 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 28 08:37:23.622600 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 28 08:37:23.622600 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 28 08:37:23.622600 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application Jul 28 08:37:23.625285 dv-cinder-851351-1-smb devstack@keystone.service[282899]: [pid: 282899|app: 0|req: 390/789] 10.222.0.42 () {56 vars in 1093 bytes} [Thu Jul 28 08:37:23 2022] GET /identity/v3/users/nova => generated 82 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:37:23.626805 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1964b6d0-f9d0-49fa-a9a3-3cd1b8f48a28 None None] REQUEST_METHOD: `GET` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:37:23.627371 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1964b6d0-f9d0-49fa-a9a3-3cd1b8f48a28 None None] SCRIPT_NAME: `/identity` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:37:23.627859 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1964b6d0-f9d0-49fa-a9a3-3cd1b8f48a28 None None] PATH_INFO: `/` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:37:23.629664 dv-cinder-851351-1-smb devstack@keystone.service[282899]: [pid: 282899|app: 0|req: 391/790] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 08:37:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 08:37:23.630643 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1964b6d0-f9d0-49fa-a9a3-3cd1b8f48a28 None None] Authenticating user token {{(pid=282899) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:37:23.631089 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc71204c-972f-4a3d-bcf7-054c613c17e5 None admin] Validating token access rules against request {{(pid=282898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:37:23.667884 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG dbcounter [-] [282899] Writing DB stats keystone:SELECT=100 {{(pid=282899) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:37:23.672627 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82bf8fba-2bb4-4be0-a622-b5f18070fa0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:37:23.673409 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82bf8fba-2bb4-4be0-a622-b5f18070fa0d None admin] REQUEST_METHOD: `GET` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:37:23.673755 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82bf8fba-2bb4-4be0-a622-b5f18070fa0d None admin] SCRIPT_NAME: `/identity` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:37:23.674130 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82bf8fba-2bb4-4be0-a622-b5f18070fa0d None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:37:23.674840 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82bf8fba-2bb4-4be0-a622-b5f18070fa0d None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:37:23.676298 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82bf8fba-2bb4-4be0-a622-b5f18070fa0d None admin] RBAC: Authorization granted {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:37:23.687315 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application [None req-82bf8fba-2bb4-4be0-a622-b5f18070fa0d None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 28 08:37:23.687315 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:37:23.687315 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 28 08:37:23.687315 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 28 08:37:23.687315 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 28 08:37:23.687315 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 28 08:37:23.687315 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 28 08:37:23.687315 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 08:37:23.687315 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 28 08:37:23.687315 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application Jul 28 08:37:23.687315 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 28 08:37:23.687315 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application Jul 28 08:37:23.687315 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:37:23.687315 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:37:23.687315 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:37:23.687315 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:37:23.688530 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:37:23.688530 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:37:23.688530 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:37:23.688530 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:37:23.688530 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:37:23.688530 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:37:23.688530 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:37:23.688530 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 28 08:37:23.688530 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 28 08:37:23.688530 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 28 08:37:23.688530 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 28 08:37:23.688530 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:37:23.688530 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:37:23.688530 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:37:23.688530 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:37:23.688530 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:37:23.689996 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:37:23.689996 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:37:23.689996 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application with Lock( Jul 28 08:37:23.689996 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:37:23.689996 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:37:23.689996 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:37:23.689996 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:37:23.689996 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:37:23.689996 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:37:23.689996 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:37:23.689996 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:37:23.689996 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 28 08:37:23.689996 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 08:37:23.689996 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 28 08:37:23.689996 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application Jul 28 08:37:23.698345 dv-cinder-851351-1-smb devstack@keystone.service[282898]: [pid: 282898|app: 0|req: 400/791] 10.222.0.42 () {56 vars in 1129 bytes} [Thu Jul 28 08:37:23 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 255 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:37:23.700847 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb1add8-c5a8-4d81-941a-19af78783345 None None] REQUEST_METHOD: `POST` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:37:23.701448 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb1add8-c5a8-4d81-941a-19af78783345 None None] SCRIPT_NAME: `/identity` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:37:23.701951 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb1add8-c5a8-4d81-941a-19af78783345 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:37:23.725687 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.auth.core [None req-5fb1add8-c5a8-4d81-941a-19af78783345 None None] MFA Rules not processed for user `2be990a66857410a87ffa7609aec4f7b`. Rule list: `[]` (Enabled: `True`). {{(pid=282898) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 08:37:23.727463 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.fernet_utils [None req-5fb1add8-c5a8-4d81-941a-19af78783345 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=282898) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:37:23.744004 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1964b6d0-f9d0-49fa-a9a3-3cd1b8f48a28 None None] Validating token access rules against request {{(pid=282899) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:37:23.747020 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG dbcounter [-] [282898] Writing DB stats keystone:SELECT=100 {{(pid=282898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:37:23.783337 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d8aaec-182b-4d84-907e-4c577b588375 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282899) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:37:23.783337 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d8aaec-182b-4d84-907e-4c577b588375 None admin] REQUEST_METHOD: `GET` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:37:23.783337 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d8aaec-182b-4d84-907e-4c577b588375 None admin] SCRIPT_NAME: `/identity` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:37:23.791393 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d8aaec-182b-4d84-907e-4c577b588375 None admin] PATH_INFO: `/v3/users` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:37:23.791393 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d8aaec-182b-4d84-907e-4c577b588375 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=282899) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:37:23.791393 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d8aaec-182b-4d84-907e-4c577b588375 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:37:23.791393 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d8aaec-182b-4d84-907e-4c577b588375 None admin] RBAC: Authorization granted {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:37:23.808950 dv-cinder-851351-1-smb devstack@keystone.service[282899]: [pid: 282899|app: 0|req: 392/792] 10.222.0.42 () {56 vars in 1133 bytes} [Thu Jul 28 08:37:23 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:37:23.808950 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d8aaec-182b-4d84-907e-4c577b588375 None admin] Authenticating user token {{(pid=282899) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:37:23.824190 dv-cinder-851351-1-smb devstack@keystone.service[282898]: [pid: 282898|app: 0|req: 401/793] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 08:37:23 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 08:37:23.825823 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f779391-acfa-43ec-9b4b-1015480b077a None None] REQUEST_METHOD: `GET` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:37:23.826286 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f779391-acfa-43ec-9b4b-1015480b077a None None] SCRIPT_NAME: `/identity` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:37:23.826713 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f779391-acfa-43ec-9b4b-1015480b077a None None] PATH_INFO: `/` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:37:23.828396 dv-cinder-851351-1-smb devstack@keystone.service[282898]: [pid: 282898|app: 0|req: 402/794] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 08:37:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 08:37:23.829728 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f779391-acfa-43ec-9b4b-1015480b077a None None] Authenticating user token {{(pid=282898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:37:23.918731 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG dbcounter [-] [282899] Writing DB stats keystone:SELECT=100 {{(pid=282899) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:37:23.928484 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d8aaec-182b-4d84-907e-4c577b588375 None admin] Validating token access rules against request {{(pid=282899) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:37:23.954521 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f779391-acfa-43ec-9b4b-1015480b077a None None] Validating token access rules against request {{(pid=282898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:37:23.965086 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1071896-d00b-4848-bf8c-f03190fb4701 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282899) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:37:23.965724 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1071896-d00b-4848-bf8c-f03190fb4701 None admin] REQUEST_METHOD: `GET` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:37:23.966014 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1071896-d00b-4848-bf8c-f03190fb4701 None admin] SCRIPT_NAME: `/identity` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:37:23.966324 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1071896-d00b-4848-bf8c-f03190fb4701 None admin] PATH_INFO: `/v3/services` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:37:23.967035 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1071896-d00b-4848-bf8c-f03190fb4701 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=282899) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:37:23.967348 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1071896-d00b-4848-bf8c-f03190fb4701 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:37:23.968768 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1071896-d00b-4848-bf8c-f03190fb4701 None admin] RBAC: Authorization granted {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:37:23.973723 dv-cinder-851351-1-smb devstack@keystone.service[282899]: [pid: 282899|app: 0|req: 393/795] 10.222.0.42 () {56 vars in 1124 bytes} [Thu Jul 28 08:37:23 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:37:23.974914 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e9b077-4140-4e32-9280-332d2b12822a None None] REQUEST_METHOD: `POST` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:37:23.975203 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e9b077-4140-4e32-9280-332d2b12822a None None] SCRIPT_NAME: `/identity` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:37:23.975481 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e9b077-4140-4e32-9280-332d2b12822a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:37:23.994348 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.auth.core [None req-66e9b077-4140-4e32-9280-332d2b12822a None None] MFA Rules not processed for user `2be990a66857410a87ffa7609aec4f7b`. Rule list: `[]` (Enabled: `True`). {{(pid=282899) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 08:37:23.995555 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.fernet_utils [None req-66e9b077-4140-4e32-9280-332d2b12822a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=282899) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:37:24.000938 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b6e46f-8e11-44e9-9358-09c2e0685eba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:37:24.001811 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b6e46f-8e11-44e9-9358-09c2e0685eba None admin] REQUEST_METHOD: `GET` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:37:24.002323 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b6e46f-8e11-44e9-9358-09c2e0685eba None admin] SCRIPT_NAME: `/identity` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:37:24.002806 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b6e46f-8e11-44e9-9358-09c2e0685eba None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:37:24.028870 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG dbcounter [-] [282898] Writing DB stats keystone:SELECT=100 {{(pid=282898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:37:24.067426 dv-cinder-851351-1-smb devstack@keystone.service[282899]: [pid: 282899|app: 0|req: 394/796] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 08:37:23 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 08:37:24.068408 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e9b077-4140-4e32-9280-332d2b12822a None None] Authenticating user token {{(pid=282899) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:37:24.086481 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58b6e46f-8e11-44e9-9358-09c2e0685eba None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:37:24.088292 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58b6e46f-8e11-44e9-9358-09c2e0685eba None admin] RBAC: Authorization granted {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:37:24.171569 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG dbcounter [-] [282899] Writing DB stats keystone:SELECT=100 {{(pid=282899) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:37:24.190899 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e9b077-4140-4e32-9280-332d2b12822a None None] Validating token access rules against request {{(pid=282899) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:37:24.196005 dv-cinder-851351-1-smb devstack@keystone.service[282898]: [pid: 282898|app: 0|req: 403/797] 10.222.0.42 () {58 vars in 1282 bytes} [Thu Jul 28 08:37:23 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 367 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 28 08:37:24.196908 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b6e46f-8e11-44e9-9358-09c2e0685eba None admin] Authenticating user token {{(pid=282898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:37:24.232858 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e89e05-2db7-4722-9bf8-4ae6fa8692e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282899) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:37:24.234174 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e89e05-2db7-4722-9bf8-4ae6fa8692e9 None admin] REQUEST_METHOD: `GET` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:37:24.234855 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e89e05-2db7-4722-9bf8-4ae6fa8692e9 None admin] SCRIPT_NAME: `/identity` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:37:24.235215 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e89e05-2db7-4722-9bf8-4ae6fa8692e9 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:37:24.248129 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e89e05-2db7-4722-9bf8-4ae6fa8692e9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 08:37:24.253502 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application [None req-d0e89e05-2db7-4722-9bf8-4ae6fa8692e9 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 08:37:24.253502 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:37:24.253502 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:37:24.253502 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:37:24.253502 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:37:24.253502 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:37:24.253502 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:37:24.253502 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:37:24.253502 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:37:24.253502 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:37:24.253502 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:37:24.253502 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:37:24.253502 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 08:37:24.253502 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 08:37:24.253502 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 08:37:24.253502 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 08:37:24.254785 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 08:37:24.254785 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 08:37:24.254785 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 08:37:24.254785 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 08:37:24.254785 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:37:24.254785 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:37:24.254785 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:37:24.254785 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:37:24.254785 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:37:24.254785 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:37:24.254785 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:37:24.254785 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application with Lock( Jul 28 08:37:24.254785 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:37:24.254785 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:37:24.254785 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:37:24.254785 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:37:24.255774 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:37:24.255774 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:37:24.255774 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:37:24.255774 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:37:24.255774 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 08:37:24.255774 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 08:37:24.255774 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 08:37:24.255774 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 08:37:24.255774 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 08:37:24.255774 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 08:37:24.255774 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 08:37:24.255774 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application Jul 28 08:37:24.255774 dv-cinder-851351-1-smb devstack@keystone.service[282899]: [pid: 282899|app: 0|req: 395/798] 10.222.0.42 () {56 vars in 1096 bytes} [Thu Jul 28 08:37:24 2022] GET /identity/v3/roles/admin => generated 83 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:37:24.255774 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e89e05-2db7-4722-9bf8-4ae6fa8692e9 None admin] Authenticating user token {{(pid=282899) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:37:24.266083 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG dbcounter [-] [282898] Writing DB stats keystone:SELECT=100 {{(pid=282898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:37:24.325416 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b6e46f-8e11-44e9-9358-09c2e0685eba None admin] Validating token access rules against request {{(pid=282898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:37:24.366158 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e89e05-2db7-4722-9bf8-4ae6fa8692e9 None admin] Validating token access rules against request {{(pid=282899) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:37:24.366676 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6092b8dc-a545-46d3-a43c-aebe75e0a120 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:37:24.367602 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6092b8dc-a545-46d3-a43c-aebe75e0a120 None admin] REQUEST_METHOD: `GET` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:37:24.368062 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6092b8dc-a545-46d3-a43c-aebe75e0a120 None admin] SCRIPT_NAME: `/identity` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:37:24.368474 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6092b8dc-a545-46d3-a43c-aebe75e0a120 None admin] PATH_INFO: `/v3/services` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:37:24.369663 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6092b8dc-a545-46d3-a43c-aebe75e0a120 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=282898) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:37:24.370066 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6092b8dc-a545-46d3-a43c-aebe75e0a120 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:37:24.371902 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6092b8dc-a545-46d3-a43c-aebe75e0a120 None admin] RBAC: Authorization granted {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:37:24.382761 dv-cinder-851351-1-smb devstack@keystone.service[282898]: [pid: 282898|app: 0|req: 404/799] 10.222.0.42 () {56 vars in 1124 bytes} [Thu Jul 28 08:37:24 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:37:24.382761 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6092b8dc-a545-46d3-a43c-aebe75e0a120 None admin] Authenticating user token {{(pid=282898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:37:24.410541 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa87a5e1-b087-440b-937d-ffee8a1c2d1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282899) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:37:24.411196 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa87a5e1-b087-440b-937d-ffee8a1c2d1d None admin] REQUEST_METHOD: `GET` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:37:24.411479 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa87a5e1-b087-440b-937d-ffee8a1c2d1d None admin] SCRIPT_NAME: `/identity` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:37:24.411751 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa87a5e1-b087-440b-937d-ffee8a1c2d1d None admin] PATH_INFO: `/v3/roles/service` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:37:24.423940 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa87a5e1-b087-440b-937d-ffee8a1c2d1d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 08:37:24.428924 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application [None req-fa87a5e1-b087-440b-937d-ffee8a1c2d1d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 28 08:37:24.428924 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:37:24.428924 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:37:24.428924 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:37:24.428924 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:37:24.428924 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:37:24.428924 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:37:24.428924 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:37:24.428924 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:37:24.428924 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:37:24.428924 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:37:24.428924 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:37:24.428924 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 08:37:24.428924 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 08:37:24.428924 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 08:37:24.428924 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 08:37:24.430016 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 08:37:24.430016 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 08:37:24.430016 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 08:37:24.430016 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 08:37:24.430016 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:37:24.430016 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:37:24.430016 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:37:24.430016 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:37:24.430016 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:37:24.430016 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:37:24.430016 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:37:24.430016 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application with Lock( Jul 28 08:37:24.430016 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:37:24.430016 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:37:24.430016 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:37:24.430016 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:37:24.431040 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:37:24.431040 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:37:24.431040 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:37:24.431040 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:37:24.431040 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 08:37:24.431040 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 08:37:24.431040 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 08:37:24.431040 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 08:37:24.431040 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 08:37:24.431040 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 08:37:24.431040 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 28 08:37:24.431040 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application Jul 28 08:37:24.431040 dv-cinder-851351-1-smb devstack@keystone.service[282899]: [pid: 282899|app: 0|req: 396/800] 10.222.0.42 () {56 vars in 1102 bytes} [Thu Jul 28 08:37:24 2022] GET /identity/v3/roles/service => generated 85 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:37:24.431040 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa87a5e1-b087-440b-937d-ffee8a1c2d1d None admin] Authenticating user token {{(pid=282899) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:37:24.442250 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG dbcounter [-] [282899] Writing DB stats keystone:SELECT=100 {{(pid=282899) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:37:24.499113 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6092b8dc-a545-46d3-a43c-aebe75e0a120 None admin] Validating token access rules against request {{(pid=282898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:37:24.517198 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG dbcounter [-] [282898] Writing DB stats keystone:SELECT=100 {{(pid=282898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:37:24.540514 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85675e3f-3b6c-4032-8022-46a2a3d87c1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:37:24.541224 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85675e3f-3b6c-4032-8022-46a2a3d87c1f None admin] REQUEST_METHOD: `GET` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:37:24.541588 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85675e3f-3b6c-4032-8022-46a2a3d87c1f None admin] SCRIPT_NAME: `/identity` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:37:24.541882 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85675e3f-3b6c-4032-8022-46a2a3d87c1f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:37:24.544521 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa87a5e1-b087-440b-937d-ffee8a1c2d1d None admin] Validating token access rules against request {{(pid=282899) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:37:24.553408 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85675e3f-3b6c-4032-8022-46a2a3d87c1f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:37:24.554998 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85675e3f-3b6c-4032-8022-46a2a3d87c1f None admin] RBAC: Authorization granted {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:37:24.571065 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application [None req-85675e3f-3b6c-4032-8022-46a2a3d87c1f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 08:37:24.571065 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:37:24.571065 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:37:24.571065 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:37:24.571065 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:37:24.571065 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:37:24.571065 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:37:24.571065 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:37:24.571065 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:37:24.571065 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:37:24.571065 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:37:24.571065 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:37:24.571065 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 08:37:24.571065 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 08:37:24.571065 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 08:37:24.572361 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 08:37:24.572361 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:37:24.572361 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:37:24.572361 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:37:24.572361 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:37:24.572361 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:37:24.572361 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:37:24.572361 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:37:24.572361 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application with Lock( Jul 28 08:37:24.572361 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:37:24.572361 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:37:24.572361 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:37:24.572361 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:37:24.572361 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:37:24.572361 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:37:24.572361 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:37:24.572361 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:37:24.573474 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 08:37:24.573474 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 08:37:24.573474 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 08:37:24.573474 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application Jul 28 08:37:24.573474 dv-cinder-851351-1-smb devstack@keystone.service[282898]: [pid: 282898|app: 0|req: 405/801] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 08:37:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:37:24.573474 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85675e3f-3b6c-4032-8022-46a2a3d87c1f None admin] Authenticating user token {{(pid=282898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:37:24.585583 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8637fc3-a687-436d-a4e3-a5f808ed55de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282899) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:37:24.586231 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8637fc3-a687-436d-a4e3-a5f808ed55de None admin] REQUEST_METHOD: `GET` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:37:24.586502 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8637fc3-a687-436d-a4e3-a5f808ed55de None admin] SCRIPT_NAME: `/identity` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:37:24.586782 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8637fc3-a687-436d-a4e3-a5f808ed55de None admin] PATH_INFO: `/v3/roles` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:37:24.587536 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8637fc3-a687-436d-a4e3-a5f808ed55de None admin] RBAC: Adding query filter params (name=admin) {{(pid=282899) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:37:24.587849 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8637fc3-a687-436d-a4e3-a5f808ed55de None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:37:24.589302 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8637fc3-a687-436d-a4e3-a5f808ed55de None admin] RBAC: Authorization granted {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:37:24.602948 dv-cinder-851351-1-smb devstack@keystone.service[282899]: [pid: 282899|app: 0|req: 397/802] 10.222.0.42 () {56 vars in 1099 bytes} [Thu Jul 28 08:37:24 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:37:24.603858 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8637fc3-a687-436d-a4e3-a5f808ed55de None admin] Authenticating user token {{(pid=282899) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:37:24.672188 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG dbcounter [-] [282899] Writing DB stats keystone:SELECT=100 {{(pid=282899) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:37:24.683849 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85675e3f-3b6c-4032-8022-46a2a3d87c1f None admin] Validating token access rules against request {{(pid=282898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:37:24.709262 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8637fc3-a687-436d-a4e3-a5f808ed55de None admin] Validating token access rules against request {{(pid=282899) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:37:24.719194 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-302dc4e1-b316-485e-b57b-4e9e849780a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:37:24.719795 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302dc4e1-b316-485e-b57b-4e9e849780a9 None admin] REQUEST_METHOD: `POST` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:37:24.720079 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302dc4e1-b316-485e-b57b-4e9e849780a9 None admin] SCRIPT_NAME: `/identity` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:37:24.720356 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302dc4e1-b316-485e-b57b-4e9e849780a9 None admin] PATH_INFO: `/v3/endpoints` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:37:24.721154 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-302dc4e1-b316-485e-b57b-4e9e849780a9 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:37:24.722542 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-302dc4e1-b316-485e-b57b-4e9e849780a9 None admin] RBAC: Authorization granted {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:37:24.746115 dv-cinder-851351-1-smb devstack@keystone.service[282898]: [pid: 282898|app: 0|req: 406/803] 10.222.0.42 () {60 vars in 1144 bytes} [Thu Jul 28 08:37:24 2022] POST /identity/v3/endpoints => generated 346 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 08:37:24.747037 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-302dc4e1-b316-485e-b57b-4e9e849780a9 None admin] Authenticating user token {{(pid=282898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:37:24.758487 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42e250f-900f-4b5d-be00-2b4a9c2ef468 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282899) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:37:24.759159 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42e250f-900f-4b5d-be00-2b4a9c2ef468 None admin] REQUEST_METHOD: `GET` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:37:24.759446 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42e250f-900f-4b5d-be00-2b4a9c2ef468 None admin] SCRIPT_NAME: `/identity` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:37:24.759724 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42e250f-900f-4b5d-be00-2b4a9c2ef468 None admin] PATH_INFO: `/v3/roles` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:37:24.760513 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c42e250f-900f-4b5d-be00-2b4a9c2ef468 None admin] RBAC: Adding query filter params (name=service) {{(pid=282899) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:37:24.760862 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c42e250f-900f-4b5d-be00-2b4a9c2ef468 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:37:24.762346 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c42e250f-900f-4b5d-be00-2b4a9c2ef468 None admin] RBAC: Authorization granted {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:37:24.778183 dv-cinder-851351-1-smb devstack@keystone.service[282899]: [pid: 282899|app: 0|req: 398/804] 10.222.0.42 () {56 vars in 1103 bytes} [Thu Jul 28 08:37:24 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:37:24.778183 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42e250f-900f-4b5d-be00-2b4a9c2ef468 None admin] Authenticating user token {{(pid=282899) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:37:24.802077 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG dbcounter [-] [282898] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=282898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:37:24.911191 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42e250f-900f-4b5d-be00-2b4a9c2ef468 None admin] Validating token access rules against request {{(pid=282899) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:37:24.913898 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-302dc4e1-b316-485e-b57b-4e9e849780a9 None admin] Validating token access rules against request {{(pid=282898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:37:24.964339 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG dbcounter [-] [282899] Writing DB stats keystone:SELECT=100 {{(pid=282899) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:37:24.971061 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b182f54-75d3-4823-a2f5-b60f511f2d5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:37:24.972294 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b182f54-75d3-4823-a2f5-b60f511f2d5d None admin] REQUEST_METHOD: `GET` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:37:24.972642 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b182f54-75d3-4823-a2f5-b60f511f2d5d None admin] SCRIPT_NAME: `/identity` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:37:24.972957 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b182f54-75d3-4823-a2f5-b60f511f2d5d None admin] PATH_INFO: `/v3/domains` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:37:24.973748 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b182f54-75d3-4823-a2f5-b60f511f2d5d None admin] RBAC: Adding query filter params (name=Default) {{(pid=282898) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:37:24.974371 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b182f54-75d3-4823-a2f5-b60f511f2d5d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:37:24.975822 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b182f54-75d3-4823-a2f5-b60f511f2d5d None admin] RBAC: Authorization granted {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:37:24.979878 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eeb6bc1-bdaf-4861-b99c-7c09bfa16d5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282899) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:37:24.981029 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eeb6bc1-bdaf-4861-b99c-7c09bfa16d5c None admin] REQUEST_METHOD: `GET` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:37:24.981029 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eeb6bc1-bdaf-4861-b99c-7c09bfa16d5c None admin] SCRIPT_NAME: `/identity` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:37:24.981338 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eeb6bc1-bdaf-4861-b99c-7c09bfa16d5c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:37:24.995421 dv-cinder-851351-1-smb devstack@keystone.service[282898]: [pid: 282898|app: 0|req: 407/805] 10.222.0.42 () {56 vars in 1109 bytes} [Thu Jul 28 08:37:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:37:24.996766 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c85bf6-3b65-44a3-88ca-ec34cd2827ea None None] REQUEST_METHOD: `GET` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:37:24.997063 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c85bf6-3b65-44a3-88ca-ec34cd2827ea None None] SCRIPT_NAME: `/identity` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:37:24.998044 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c85bf6-3b65-44a3-88ca-ec34cd2827ea None None] PATH_INFO: `/` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:37:25.000340 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eeb6bc1-bdaf-4861-b99c-7c09bfa16d5c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:37:25.000514 dv-cinder-851351-1-smb devstack@keystone.service[282898]: [pid: 282898|app: 0|req: 408/806] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 08:37:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 08:37:25.002207 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eeb6bc1-bdaf-4861-b99c-7c09bfa16d5c None admin] RBAC: Authorization granted {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:37:25.003980 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c85bf6-3b65-44a3-88ca-ec34cd2827ea None None] Authenticating user token {{(pid=282898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:37:25.025566 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application [None req-1eeb6bc1-bdaf-4861-b99c-7c09bfa16d5c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 08:37:25.025566 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:37:25.025566 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:37:25.025566 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:37:25.025566 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:37:25.025566 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:37:25.025566 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:37:25.025566 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:37:25.025566 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:37:25.025566 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:37:25.025566 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:37:25.025566 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:37:25.025566 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 08:37:25.025566 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 08:37:25.025566 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 08:37:25.027696 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 08:37:25.027696 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:37:25.027696 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:37:25.027696 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:37:25.027696 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:37:25.027696 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:37:25.027696 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:37:25.027696 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:37:25.027696 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application with Lock( Jul 28 08:37:25.027696 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:37:25.027696 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:37:25.027696 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:37:25.027696 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:37:25.027696 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:37:25.027696 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:37:25.027696 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:37:25.027696 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:37:25.030161 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 08:37:25.030161 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 08:37:25.030161 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 08:37:25.030161 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application Jul 28 08:37:25.031678 dv-cinder-851351-1-smb devstack@keystone.service[282899]: [pid: 282899|app: 0|req: 399/807] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 08:37:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 253 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:37:25.032906 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eeb6bc1-bdaf-4861-b99c-7c09bfa16d5c None admin] Authenticating user token {{(pid=282899) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:37:25.110013 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG dbcounter [-] [282898] Writing DB stats keystone:SELECT=100 {{(pid=282898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:37:25.133454 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c85bf6-3b65-44a3-88ca-ec34cd2827ea None None] Validating token access rules against request {{(pid=282898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:37:25.175125 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eaa909d-66b3-42b5-9f98-5fecb4504adf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:37:25.175802 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eaa909d-66b3-42b5-9f98-5fecb4504adf None admin] REQUEST_METHOD: `GET` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:37:25.176089 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eaa909d-66b3-42b5-9f98-5fecb4504adf None admin] SCRIPT_NAME: `/identity` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:37:25.176370 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eaa909d-66b3-42b5-9f98-5fecb4504adf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:37:25.177876 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eeb6bc1-bdaf-4861-b99c-7c09bfa16d5c None admin] Validating token access rules against request {{(pid=282899) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:37:25.188967 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eaa909d-66b3-42b5-9f98-5fecb4504adf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:37:25.190592 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eaa909d-66b3-42b5-9f98-5fecb4504adf None admin] RBAC: Authorization granted {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:37:25.209815 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application [None req-1eaa909d-66b3-42b5-9f98-5fecb4504adf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 08:37:25.209815 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:37:25.209815 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:37:25.209815 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:37:25.209815 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:37:25.209815 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:37:25.209815 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:37:25.209815 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:37:25.209815 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:37:25.209815 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:37:25.209815 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:37:25.209815 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:37:25.209815 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 08:37:25.209815 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 08:37:25.209815 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 08:37:25.211932 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 08:37:25.211932 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:37:25.211932 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:37:25.211932 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:37:25.211932 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:37:25.211932 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:37:25.211932 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:37:25.211932 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:37:25.211932 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application with Lock( Jul 28 08:37:25.211932 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:37:25.211932 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:37:25.211932 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:37:25.211932 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:37:25.211932 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:37:25.211932 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:37:25.211932 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:37:25.211932 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:37:25.213089 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 08:37:25.213089 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 08:37:25.213089 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 08:37:25.213089 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application Jul 28 08:37:25.213089 dv-cinder-851351-1-smb devstack@keystone.service[282898]: [pid: 282898|app: 0|req: 409/808] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 08:37:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:37:25.213089 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04e6ff9-56d1-44bd-8eb8-a211e63321e9 None None] REQUEST_METHOD: `POST` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:37:25.213089 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04e6ff9-56d1-44bd-8eb8-a211e63321e9 None None] SCRIPT_NAME: `/identity` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:37:25.213573 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04e6ff9-56d1-44bd-8eb8-a211e63321e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:37:25.233037 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.auth.core [None req-c04e6ff9-56d1-44bd-8eb8-a211e63321e9 None None] MFA Rules not processed for user `2be990a66857410a87ffa7609aec4f7b`. Rule list: `[]` (Enabled: `True`). {{(pid=282898) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 08:37:25.234196 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.fernet_utils [None req-c04e6ff9-56d1-44bd-8eb8-a211e63321e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=282898) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:37:25.234562 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0a46f3-ac86-474c-a2b3-beaca5a701b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282899) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:37:25.235491 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0a46f3-ac86-474c-a2b3-beaca5a701b7 None admin] REQUEST_METHOD: `GET` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:37:25.235979 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0a46f3-ac86-474c-a2b3-beaca5a701b7 None admin] SCRIPT_NAME: `/identity` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:37:25.236498 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0a46f3-ac86-474c-a2b3-beaca5a701b7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:37:25.247406 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d0a46f3-ac86-474c-a2b3-beaca5a701b7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:37:25.249995 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d0a46f3-ac86-474c-a2b3-beaca5a701b7 None admin] RBAC: Authorization granted {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:37:25.266030 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application [None req-1d0a46f3-ac86-474c-a2b3-beaca5a701b7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 08:37:25.266030 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:37:25.266030 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:37:25.266030 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:37:25.266030 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:37:25.266030 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:37:25.266030 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:37:25.266030 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:37:25.266030 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:37:25.266030 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:37:25.266030 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:37:25.266030 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:37:25.266030 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 28 08:37:25.266030 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 28 08:37:25.266030 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 28 08:37:25.267283 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 28 08:37:25.267283 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:37:25.267283 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:37:25.267283 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:37:25.267283 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:37:25.267283 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:37:25.267283 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:37:25.267283 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:37:25.267283 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application with Lock( Jul 28 08:37:25.267283 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:37:25.267283 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:37:25.267283 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:37:25.267283 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:37:25.267283 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:37:25.267283 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:37:25.267283 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:37:25.267283 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:37:25.268398 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 28 08:37:25.268398 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 28 08:37:25.268398 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 28 08:37:25.268398 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 28 08:37:25.268398 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 28 08:37:25.268398 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 28 08:37:25.268398 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 08:37:25.268398 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application Jul 28 08:37:25.268398 dv-cinder-851351-1-smb devstack@keystone.service[282899]: [pid: 282899|app: 0|req: 400/809] 10.222.0.42 () {56 vars in 1111 bytes} [Thu Jul 28 08:37:25 2022] GET /identity/v3/projects/service => generated 88 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:37:25.269716 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0a46f3-ac86-474c-a2b3-beaca5a701b7 None admin] Authenticating user token {{(pid=282899) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:37:25.324873 dv-cinder-851351-1-smb devstack@keystone.service[282898]: [pid: 282898|app: 0|req: 410/810] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 08:37:25 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 08:37:25.328506 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04e6ff9-56d1-44bd-8eb8-a211e63321e9 None None] Authenticating user token {{(pid=282898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:37:25.336322 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG dbcounter [-] [282899] Writing DB stats keystone:SELECT=100 {{(pid=282899) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:37:25.407766 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0a46f3-ac86-474c-a2b3-beaca5a701b7 None admin] Validating token access rules against request {{(pid=282899) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:37:25.421163 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG dbcounter [-] [282898] Writing DB stats keystone:SELECT=100 {{(pid=282898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:37:25.448652 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c1a66a-4c74-4d2d-b4ab-2ed7c55cb34c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282899) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:37:25.449327 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c1a66a-4c74-4d2d-b4ab-2ed7c55cb34c None admin] REQUEST_METHOD: `GET` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:37:25.449603 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c1a66a-4c74-4d2d-b4ab-2ed7c55cb34c None admin] SCRIPT_NAME: `/identity` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:37:25.449971 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c1a66a-4c74-4d2d-b4ab-2ed7c55cb34c None admin] PATH_INFO: `/v3/domains` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:37:25.449971 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c1a66a-4c74-4d2d-b4ab-2ed7c55cb34c None admin] RBAC: Adding query filter params (name=Default) {{(pid=282899) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:37:25.449971 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c1a66a-4c74-4d2d-b4ab-2ed7c55cb34c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:37:25.452373 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c1a66a-4c74-4d2d-b4ab-2ed7c55cb34c None admin] RBAC: Authorization granted {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:37:25.465082 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04e6ff9-56d1-44bd-8eb8-a211e63321e9 None None] Validating token access rules against request {{(pid=282898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:37:25.467754 dv-cinder-851351-1-smb devstack@keystone.service[282899]: [pid: 282899|app: 0|req: 401/811] 10.222.0.42 () {56 vars in 1109 bytes} [Thu Jul 28 08:37:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:37:25.473038 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c1a66a-4c74-4d2d-b4ab-2ed7c55cb34c None admin] Authenticating user token {{(pid=282899) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:37:25.513791 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8bc3636-3ca6-4e32-82c1-af79f1b0831d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:37:25.516041 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8bc3636-3ca6-4e32-82c1-af79f1b0831d None admin] REQUEST_METHOD: `GET` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:37:25.516041 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8bc3636-3ca6-4e32-82c1-af79f1b0831d None admin] SCRIPT_NAME: `/identity` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:37:25.516041 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8bc3636-3ca6-4e32-82c1-af79f1b0831d None admin] PATH_INFO: `/v3/domains` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:37:25.516041 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8bc3636-3ca6-4e32-82c1-af79f1b0831d None admin] RBAC: Adding query filter params (name=Default) {{(pid=282898) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:37:25.516041 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8bc3636-3ca6-4e32-82c1-af79f1b0831d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:37:25.517585 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8bc3636-3ca6-4e32-82c1-af79f1b0831d None admin] RBAC: Authorization granted {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:37:25.535079 dv-cinder-851351-1-smb devstack@keystone.service[282898]: [pid: 282898|app: 0|req: 411/812] 10.222.0.42 () {56 vars in 1109 bytes} [Thu Jul 28 08:37:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:37:25.535079 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8bc3636-3ca6-4e32-82c1-af79f1b0831d None admin] Authenticating user token {{(pid=282898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:37:25.606647 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG dbcounter [-] [282899] Writing DB stats keystone:SELECT=100 {{(pid=282899) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:37:25.611454 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c1a66a-4c74-4d2d-b4ab-2ed7c55cb34c None admin] Validating token access rules against request {{(pid=282899) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:37:25.648294 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d9519ce-d0a1-4805-8e6e-a74cea564601 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282899) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:37:25.649017 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9519ce-d0a1-4805-8e6e-a74cea564601 None admin] REQUEST_METHOD: `GET` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:37:25.649308 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9519ce-d0a1-4805-8e6e-a74cea564601 None admin] SCRIPT_NAME: `/identity` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:37:25.649574 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9519ce-d0a1-4805-8e6e-a74cea564601 None admin] PATH_INFO: `/v3/projects` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:37:25.650365 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d9519ce-d0a1-4805-8e6e-a74cea564601 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=282899) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:37:25.650679 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d9519ce-d0a1-4805-8e6e-a74cea564601 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:37:25.652161 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d9519ce-d0a1-4805-8e6e-a74cea564601 None admin] RBAC: Authorization granted {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:37:25.656469 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8bc3636-3ca6-4e32-82c1-af79f1b0831d None admin] Validating token access rules against request {{(pid=282898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:37:25.670797 dv-cinder-851351-1-smb devstack@keystone.service[282899]: [pid: 282899|app: 0|req: 402/813] 10.222.0.42 () {56 vars in 1148 bytes} [Thu Jul 28 08:37:25 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:37:25.670797 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d9519ce-d0a1-4805-8e6e-a74cea564601 None admin] Authenticating user token {{(pid=282899) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:37:25.690273 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG dbcounter [-] [282898] Writing DB stats keystone:SELECT=100 {{(pid=282898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:37:25.701721 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf65e4d-90b6-47cb-945e-f708314270ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:37:25.702383 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf65e4d-90b6-47cb-945e-f708314270ab None admin] REQUEST_METHOD: `GET` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:37:25.702661 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf65e4d-90b6-47cb-945e-f708314270ab None admin] SCRIPT_NAME: `/identity` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:37:25.702933 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf65e4d-90b6-47cb-945e-f708314270ab None admin] PATH_INFO: `/v3/services/network` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:37:25.703575 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cf65e4d-90b6-47cb-945e-f708314270ab None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:37:25.705545 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cf65e4d-90b6-47cb-945e-f708314270ab None admin] RBAC: Authorization granted {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:37:25.714969 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application [None req-3cf65e4d-90b6-47cb-945e-f708314270ab None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jul 28 08:37:25.714969 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:37:25.714969 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 28 08:37:25.714969 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 28 08:37:25.714969 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 28 08:37:25.714969 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 28 08:37:25.714969 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 28 08:37:25.714969 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 08:37:25.714969 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 28 08:37:25.714969 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application Jul 28 08:37:25.714969 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 28 08:37:25.714969 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application Jul 28 08:37:25.714969 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:37:25.714969 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:37:25.714969 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:37:25.714969 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:37:25.714969 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:37:25.716207 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:37:25.716207 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:37:25.716207 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:37:25.716207 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:37:25.716207 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:37:25.716207 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:37:25.716207 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 28 08:37:25.716207 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 28 08:37:25.716207 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 28 08:37:25.716207 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 28 08:37:25.716207 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:37:25.716207 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:37:25.716207 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:37:25.716207 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:37:25.716207 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:37:25.716207 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:37:25.717403 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:37:25.717403 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application with Lock( Jul 28 08:37:25.717403 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:37:25.717403 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:37:25.717403 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:37:25.717403 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:37:25.717403 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:37:25.717403 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:37:25.717403 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:37:25.717403 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:37:25.717403 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 28 08:37:25.717403 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 08:37:25.717403 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 28 08:37:25.717403 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application Jul 28 08:37:25.723481 dv-cinder-851351-1-smb devstack@keystone.service[282898]: [pid: 282898|app: 0|req: 412/814] 10.222.0.42 () {56 vars in 1111 bytes} [Thu Jul 28 08:37:25 2022] GET /identity/v3/services/network => generated 88 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:37:25.724133 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf65e4d-90b6-47cb-945e-f708314270ab None admin] Authenticating user token {{(pid=282898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:37:25.791464 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d9519ce-d0a1-4805-8e6e-a74cea564601 None admin] Validating token access rules against request {{(pid=282899) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:37:25.839800 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050b9881-7c18-48e0-9562-a0389a2b5709 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282899) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:37:25.840609 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050b9881-7c18-48e0-9562-a0389a2b5709 None admin] REQUEST_METHOD: `GET` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:37:25.840931 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050b9881-7c18-48e0-9562-a0389a2b5709 None admin] SCRIPT_NAME: `/identity` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:37:25.841423 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050b9881-7c18-48e0-9562-a0389a2b5709 None admin] PATH_INFO: `/v3/users/swift` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:37:25.855427 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-050b9881-7c18-48e0-9562-a0389a2b5709 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:37:25.855715 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf65e4d-90b6-47cb-945e-f708314270ab None admin] Validating token access rules against request {{(pid=282898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:37:25.857730 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-050b9881-7c18-48e0-9562-a0389a2b5709 None admin] RBAC: Authorization granted {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:37:25.873652 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application [None req-050b9881-7c18-48e0-9562-a0389a2b5709 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 28 08:37:25.873652 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:37:25.873652 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:37:25.873652 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:37:25.873652 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:37:25.873652 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:37:25.873652 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:37:25.873652 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:37:25.873652 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:37:25.873652 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:37:25.873652 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:37:25.873652 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:37:25.873652 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 28 08:37:25.873652 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 28 08:37:25.873652 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 28 08:37:25.873652 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 28 08:37:25.875164 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:37:25.875164 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:37:25.875164 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 28 08:37:25.875164 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 08:37:25.875164 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 28 08:37:25.875164 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 08:37:25.875164 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:37:25.875164 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:37:25.875164 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:37:25.875164 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:37:25.875164 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:37:25.875164 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application with Lock( Jul 28 08:37:25.875164 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:37:25.875164 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:37:25.875164 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:37:25.875164 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:37:25.875164 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:37:25.875164 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:37:25.876292 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:37:25.876292 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:37:25.876292 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 28 08:37:25.876292 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 28 08:37:25.876292 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 28 08:37:25.876292 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 28 08:37:25.876292 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 28 08:37:25.876292 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 28 08:37:25.876292 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 28 08:37:25.876292 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application Jul 28 08:37:25.876292 dv-cinder-851351-1-smb devstack@keystone.service[282899]: [pid: 282899|app: 0|req: 403/815] 10.222.0.42 () {56 vars in 1096 bytes} [Thu Jul 28 08:37:25 2022] GET /identity/v3/users/swift => generated 83 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:37:25.876292 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050b9881-7c18-48e0-9562-a0389a2b5709 None admin] Authenticating user token {{(pid=282899) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:37:25.899234 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG dbcounter [-] [282899] Writing DB stats keystone:SELECT=100 {{(pid=282899) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:37:25.911717 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ddd0ec-771d-4803-90ad-8911866d88e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:37:25.912723 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ddd0ec-771d-4803-90ad-8911866d88e9 None admin] REQUEST_METHOD: `GET` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:37:25.913167 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ddd0ec-771d-4803-90ad-8911866d88e9 None admin] SCRIPT_NAME: `/identity` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:37:25.913614 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ddd0ec-771d-4803-90ad-8911866d88e9 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:37:25.925728 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65ddd0ec-771d-4803-90ad-8911866d88e9 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:37:25.927472 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65ddd0ec-771d-4803-90ad-8911866d88e9 None admin] RBAC: Authorization granted {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:37:25.940343 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application [None req-65ddd0ec-771d-4803-90ad-8911866d88e9 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 28 08:37:25.940343 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:37:25.940343 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:37:25.940343 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:37:25.940343 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:37:25.940343 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:37:25.940343 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:37:25.940343 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:37:25.940343 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:37:25.940343 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:37:25.940343 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:37:25.940343 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:37:25.940343 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 28 08:37:25.940343 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 28 08:37:25.940343 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 28 08:37:25.940343 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 28 08:37:25.941790 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:37:25.941790 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:37:25.941790 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 28 08:37:25.941790 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 08:37:25.941790 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 28 08:37:25.941790 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 08:37:25.941790 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:37:25.941790 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:37:25.941790 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:37:25.941790 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:37:25.941790 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:37:25.941790 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application with Lock( Jul 28 08:37:25.941790 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:37:25.941790 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:37:25.941790 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:37:25.941790 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:37:25.941790 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:37:25.941790 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:37:25.942926 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:37:25.942926 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:37:25.942926 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 28 08:37:25.942926 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 28 08:37:25.942926 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 28 08:37:25.942926 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 28 08:37:25.942926 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 28 08:37:25.942926 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 28 08:37:25.942926 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 28 08:37:25.942926 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application Jul 28 08:37:25.942926 dv-cinder-851351-1-smb devstack@keystone.service[282898]: [pid: 282898|app: 0|req: 413/816] 10.222.0.42 () {56 vars in 1117 bytes} [Thu Jul 28 08:37:25 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:37:25.942926 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ddd0ec-771d-4803-90ad-8911866d88e9 None admin] Authenticating user token {{(pid=282898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:37:26.006673 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG dbcounter [-] [282898] Writing DB stats keystone:SELECT=100 {{(pid=282898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:37:26.009706 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050b9881-7c18-48e0-9562-a0389a2b5709 None admin] Validating token access rules against request {{(pid=282899) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:37:26.047805 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d68873-8c59-4040-983e-70678803ffbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282899) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:37:26.048450 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d68873-8c59-4040-983e-70678803ffbf None admin] REQUEST_METHOD: `GET` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:37:26.048784 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d68873-8c59-4040-983e-70678803ffbf None admin] SCRIPT_NAME: `/identity` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:37:26.049101 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d68873-8c59-4040-983e-70678803ffbf None admin] PATH_INFO: `/v3/role_assignments` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:37:26.049916 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d68873-8c59-4040-983e-70678803ffbf None admin] RBAC: Adding query filter params (role.id=a0e2a00bf94d40f38629d6b5293e3aee, scope.project.id=5cde68cbfb9042dc9f36af3aacea2473, user.id=5e192fe026ef4f109b9a1099815c5926) {{(pid=282899) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:37:26.050238 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d68873-8c59-4040-983e-70678803ffbf None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:37:26.051714 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d68873-8c59-4040-983e-70678803ffbf None admin] RBAC: Authorization granted {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:37:26.058172 dv-cinder-851351-1-smb devstack@keystone.service[282899]: [pid: 282899|app: 0|req: 404/817] 10.222.0.42 () {56 vars in 1374 bytes} [Thu Jul 28 08:37:25 2022] GET /identity/v3/role_assignments?user.id=5e192fe026ef4f109b9a1099815c5926&scope.project.id=5cde68cbfb9042dc9f36af3aacea2473&role.id=a0e2a00bf94d40f38629d6b5293e3aee => generated 608 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:37:26.059035 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d68873-8c59-4040-983e-70678803ffbf None admin] Authenticating user token {{(pid=282899) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:37:26.078680 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ddd0ec-771d-4803-90ad-8911866d88e9 None admin] Validating token access rules against request {{(pid=282898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:37:26.133449 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104252fd-ebea-4b91-baee-d58aa98be290 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:37:26.134460 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104252fd-ebea-4b91-baee-d58aa98be290 None admin] REQUEST_METHOD: `GET` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:37:26.134961 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104252fd-ebea-4b91-baee-d58aa98be290 None admin] SCRIPT_NAME: `/identity` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:37:26.135432 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104252fd-ebea-4b91-baee-d58aa98be290 None admin] PATH_INFO: `/v3/services` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:37:26.136380 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-104252fd-ebea-4b91-baee-d58aa98be290 None admin] RBAC: Adding query filter params (name=network) {{(pid=282898) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:37:26.136934 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-104252fd-ebea-4b91-baee-d58aa98be290 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:37:26.138594 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-104252fd-ebea-4b91-baee-d58aa98be290 None admin] RBAC: Authorization granted {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:37:26.147012 dv-cinder-851351-1-smb devstack@keystone.service[282898]: [pid: 282898|app: 0|req: 414/818] 10.222.0.42 () {56 vars in 1112 bytes} [Thu Jul 28 08:37:25 2022] GET /identity/v3/services?name=network => generated 124 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:37:26.149252 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104252fd-ebea-4b91-baee-d58aa98be290 None admin] Authenticating user token {{(pid=282898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:37:26.204855 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG dbcounter [-] [282899] Writing DB stats keystone:SELECT=100 {{(pid=282899) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:37:26.229909 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d68873-8c59-4040-983e-70678803ffbf None admin] Validating token access rules against request {{(pid=282899) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:37:26.269224 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def11f11-1f89-4a32-aa26-cd15370721f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282899) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:37:26.270272 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def11f11-1f89-4a32-aa26-cd15370721f6 None admin] REQUEST_METHOD: `GET` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:37:26.270753 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def11f11-1f89-4a32-aa26-cd15370721f6 None admin] SCRIPT_NAME: `/identity` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:37:26.271257 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def11f11-1f89-4a32-aa26-cd15370721f6 None admin] PATH_INFO: `/v3/users` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:37:26.272273 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-def11f11-1f89-4a32-aa26-cd15370721f6 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=282899) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:37:26.272803 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-def11f11-1f89-4a32-aa26-cd15370721f6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:37:26.274483 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-def11f11-1f89-4a32-aa26-cd15370721f6 None admin] RBAC: Authorization granted {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:37:26.283867 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104252fd-ebea-4b91-baee-d58aa98be290 None admin] Validating token access rules against request {{(pid=282898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:37:26.295028 dv-cinder-851351-1-smb devstack@keystone.service[282899]: [pid: 282899|app: 0|req: 405/819] 10.222.0.42 () {56 vars in 1135 bytes} [Thu Jul 28 08:37:26 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:37:26.296185 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def11f11-1f89-4a32-aa26-cd15370721f6 None admin] Authenticating user token {{(pid=282899) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:37:26.299562 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG dbcounter [-] [282898] Writing DB stats keystone:SELECT=100 {{(pid=282898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:37:26.330983 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-814ea7df-d8ae-44cb-88af-4e5b862d5f5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:37:26.332081 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814ea7df-d8ae-44cb-88af-4e5b862d5f5c None admin] REQUEST_METHOD: `GET` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:37:26.332533 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814ea7df-d8ae-44cb-88af-4e5b862d5f5c None admin] SCRIPT_NAME: `/identity` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:37:26.332941 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814ea7df-d8ae-44cb-88af-4e5b862d5f5c None admin] PATH_INFO: `/v3/users` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:37:26.333773 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-814ea7df-d8ae-44cb-88af-4e5b862d5f5c None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=282898) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:37:26.334082 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-814ea7df-d8ae-44cb-88af-4e5b862d5f5c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:37:26.335579 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-814ea7df-d8ae-44cb-88af-4e5b862d5f5c None admin] RBAC: Authorization granted {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:37:26.357826 dv-cinder-851351-1-smb devstack@keystone.service[282898]: [pid: 282898|app: 0|req: 415/820] 10.222.0.42 () {56 vars in 1149 bytes} [Thu Jul 28 08:37:26 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:37:26.359720 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-814ea7df-d8ae-44cb-88af-4e5b862d5f5c None admin] Authenticating user token {{(pid=282898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:37:26.435070 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def11f11-1f89-4a32-aa26-cd15370721f6 None admin] Validating token access rules against request {{(pid=282899) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:37:26.477155 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44f0d34-dca9-483a-9869-39c101dd382d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282899) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:37:26.477799 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44f0d34-dca9-483a-9869-39c101dd382d None admin] REQUEST_METHOD: `GET` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:37:26.478079 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44f0d34-dca9-483a-9869-39c101dd382d None admin] SCRIPT_NAME: `/identity` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:37:26.478356 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44f0d34-dca9-483a-9869-39c101dd382d None admin] PATH_INFO: `/v3/services` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:37:26.479060 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f44f0d34-dca9-483a-9869-39c101dd382d None admin] RBAC: Adding query filter params (type=network) {{(pid=282899) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:37:26.479366 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f44f0d34-dca9-483a-9869-39c101dd382d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:37:26.480908 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f44f0d34-dca9-483a-9869-39c101dd382d None admin] RBAC: Authorization granted {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:37:26.486907 dv-cinder-851351-1-smb devstack@keystone.service[282899]: [pid: 282899|app: 0|req: 406/821] 10.222.0.42 () {56 vars in 1112 bytes} [Thu Jul 28 08:37:26 2022] GET /identity/v3/services?type=network => generated 350 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:37:26.487839 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44f0d34-dca9-483a-9869-39c101dd382d None admin] Authenticating user token {{(pid=282899) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:37:26.497697 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG dbcounter [-] [282899] Writing DB stats keystone:SELECT=100 {{(pid=282899) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:37:26.540120 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-814ea7df-d8ae-44cb-88af-4e5b862d5f5c None admin] Validating token access rules against request {{(pid=282898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:37:26.599564 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3f751f-50bb-4cce-8a2c-d1f10c1f0e24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:37:26.599976 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44f0d34-dca9-483a-9869-39c101dd382d None admin] Validating token access rules against request {{(pid=282899) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:37:26.600353 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3f751f-50bb-4cce-8a2c-d1f10c1f0e24 None admin] REQUEST_METHOD: `GET` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:37:26.600788 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3f751f-50bb-4cce-8a2c-d1f10c1f0e24 None admin] SCRIPT_NAME: `/identity` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:37:26.601238 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3f751f-50bb-4cce-8a2c-d1f10c1f0e24 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:37:26.617525 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b3f751f-50bb-4cce-8a2c-d1f10c1f0e24 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:37:26.619488 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b3f751f-50bb-4cce-8a2c-d1f10c1f0e24 None admin] RBAC: Authorization granted {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:37:26.636389 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14308f58-24ea-4c45-9574-76aed5d0e501 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282899) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:37:26.637105 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14308f58-24ea-4c45-9574-76aed5d0e501 None admin] REQUEST_METHOD: `GET` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:37:26.637386 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14308f58-24ea-4c45-9574-76aed5d0e501 None admin] SCRIPT_NAME: `/identity` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:37:26.637660 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14308f58-24ea-4c45-9574-76aed5d0e501 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:37:26.644699 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application [None req-3b3f751f-50bb-4cce-8a2c-d1f10c1f0e24 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 08:37:26.644699 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:37:26.644699 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:37:26.644699 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:37:26.644699 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:37:26.644699 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:37:26.644699 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:37:26.644699 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:37:26.644699 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:37:26.644699 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:37:26.644699 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:37:26.644699 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:37:26.644699 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 08:37:26.644699 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 08:37:26.644699 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 08:37:26.645823 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 08:37:26.645823 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:37:26.645823 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:37:26.645823 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:37:26.645823 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:37:26.645823 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:37:26.645823 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:37:26.645823 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:37:26.645823 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application with Lock( Jul 28 08:37:26.645823 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:37:26.645823 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:37:26.645823 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:37:26.645823 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:37:26.645823 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:37:26.645823 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:37:26.645823 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:37:26.645823 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:37:26.646907 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 08:37:26.646907 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 08:37:26.646907 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 08:37:26.646907 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application Jul 28 08:37:26.649698 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14308f58-24ea-4c45-9574-76aed5d0e501 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:37:26.650971 dv-cinder-851351-1-smb devstack@keystone.service[282898]: [pid: 282898|app: 0|req: 416/822] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 08:37:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 288 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:37:26.651550 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14308f58-24ea-4c45-9574-76aed5d0e501 None admin] RBAC: Authorization granted {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:37:26.652464 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3f751f-50bb-4cce-8a2c-d1f10c1f0e24 None admin] Authenticating user token {{(pid=282898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:37:26.667697 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application [None req-14308f58-24ea-4c45-9574-76aed5d0e501 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 08:37:26.667697 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:37:26.667697 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:37:26.667697 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:37:26.667697 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:37:26.667697 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:37:26.667697 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:37:26.667697 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:37:26.667697 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:37:26.667697 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:37:26.667697 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:37:26.667697 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:37:26.667697 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 08:37:26.667697 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 08:37:26.667697 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 08:37:26.670156 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 08:37:26.670156 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:37:26.670156 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:37:26.670156 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:37:26.670156 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:37:26.670156 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:37:26.670156 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:37:26.670156 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:37:26.670156 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application with Lock( Jul 28 08:37:26.670156 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:37:26.670156 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:37:26.670156 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:37:26.670156 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:37:26.670156 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:37:26.670156 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:37:26.670156 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:37:26.670156 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:37:26.672551 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 08:37:26.672551 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 08:37:26.672551 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 08:37:26.672551 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application Jul 28 08:37:26.672551 dv-cinder-851351-1-smb devstack@keystone.service[282899]: [pid: 282899|app: 0|req: 407/823] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 08:37:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:37:26.672551 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14308f58-24ea-4c45-9574-76aed5d0e501 None admin] Authenticating user token {{(pid=282899) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:37:26.692342 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG dbcounter [-] [282898] Writing DB stats keystone:SELECT=100 {{(pid=282898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:37:26.736526 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG dbcounter [-] [282899] Writing DB stats keystone:SELECT=100 {{(pid=282899) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:37:26.803169 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3f751f-50bb-4cce-8a2c-d1f10c1f0e24 None admin] Validating token access rules against request {{(pid=282898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:37:26.804264 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14308f58-24ea-4c45-9574-76aed5d0e501 None admin] Validating token access rules against request {{(pid=282899) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:37:26.857774 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1644124-ccf3-47ce-932c-386186b0b382 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:37:26.858810 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1644124-ccf3-47ce-932c-386186b0b382 None admin] REQUEST_METHOD: `POST` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:37:26.859320 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1644124-ccf3-47ce-932c-386186b0b382 None admin] SCRIPT_NAME: `/identity` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:37:26.859809 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1644124-ccf3-47ce-932c-386186b0b382 None admin] PATH_INFO: `/v3/endpoints` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:37:26.860440 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd2f3e6-62b5-47c5-892d-4780ddefa65c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282899) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:37:26.861130 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1644124-ccf3-47ce-932c-386186b0b382 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:37:26.861457 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd2f3e6-62b5-47c5-892d-4780ddefa65c None admin] REQUEST_METHOD: `GET` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:37:26.861747 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd2f3e6-62b5-47c5-892d-4780ddefa65c None admin] SCRIPT_NAME: `/identity` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:37:26.862026 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd2f3e6-62b5-47c5-892d-4780ddefa65c None admin] PATH_INFO: `/v3/domains` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:37:26.862749 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecd2f3e6-62b5-47c5-892d-4780ddefa65c None admin] RBAC: Adding query filter params (name=Default) {{(pid=282899) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:37:26.863056 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecd2f3e6-62b5-47c5-892d-4780ddefa65c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:37:26.863924 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1644124-ccf3-47ce-932c-386186b0b382 None admin] RBAC: Authorization granted {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:37:26.864466 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecd2f3e6-62b5-47c5-892d-4780ddefa65c None admin] RBAC: Authorization granted {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:37:26.887844 dv-cinder-851351-1-smb devstack@keystone.service[282899]: [pid: 282899|app: 0|req: 408/824] 10.222.0.42 () {56 vars in 1109 bytes} [Thu Jul 28 08:37:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:37:26.887844 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd2f3e6-62b5-47c5-892d-4780ddefa65c None admin] Authenticating user token {{(pid=282899) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:37:26.904066 dv-cinder-851351-1-smb devstack@keystone.service[282898]: [pid: 282898|app: 0|req: 417/825] 10.222.0.42 () {60 vars in 1144 bytes} [Thu Jul 28 08:37:26 2022] POST /identity/v3/endpoints => generated 327 bytes in 250 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 08:37:26.904066 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1644124-ccf3-47ce-932c-386186b0b382 None admin] Authenticating user token {{(pid=282898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:37:27.033425 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd2f3e6-62b5-47c5-892d-4780ddefa65c None admin] Validating token access rules against request {{(pid=282899) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:37:27.064104 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG dbcounter [-] [282899] Writing DB stats keystone:SELECT=100 {{(pid=282899) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:37:27.065122 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG dbcounter [-] [282898] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=282898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:37:27.096026 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e654df90-55fa-4723-a969-75ff1e2ef15c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282899) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:37:27.096704 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e654df90-55fa-4723-a969-75ff1e2ef15c None admin] REQUEST_METHOD: `GET` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:37:27.097012 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e654df90-55fa-4723-a969-75ff1e2ef15c None admin] SCRIPT_NAME: `/identity` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:37:27.097257 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e654df90-55fa-4723-a969-75ff1e2ef15c None admin] PATH_INFO: `/v3/domains` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:37:27.097985 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e654df90-55fa-4723-a969-75ff1e2ef15c None admin] RBAC: Adding query filter params (name=Default) {{(pid=282899) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:37:27.098293 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e654df90-55fa-4723-a969-75ff1e2ef15c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:37:27.099860 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e654df90-55fa-4723-a969-75ff1e2ef15c None admin] RBAC: Authorization granted {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:37:27.100849 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1644124-ccf3-47ce-932c-386186b0b382 None admin] Validating token access rules against request {{(pid=282898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:37:27.117755 dv-cinder-851351-1-smb devstack@keystone.service[282899]: [pid: 282899|app: 0|req: 409/826] 10.222.0.42 () {56 vars in 1109 bytes} [Thu Jul 28 08:37:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:37:27.120026 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2efe5cce-be02-4a2c-92d2-7c37dbef6273 None None] REQUEST_METHOD: `GET` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:37:27.120316 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2efe5cce-be02-4a2c-92d2-7c37dbef6273 None None] SCRIPT_NAME: `/identity` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:37:27.120600 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2efe5cce-be02-4a2c-92d2-7c37dbef6273 None None] PATH_INFO: `/` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:37:27.122743 dv-cinder-851351-1-smb devstack@keystone.service[282899]: [pid: 282899|app: 0|req: 410/827] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 08:37:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 08:37:27.123524 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2efe5cce-be02-4a2c-92d2-7c37dbef6273 None None] Authenticating user token {{(pid=282899) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:37:27.153722 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f93cff2-6026-4d67-9f12-cd758c2c098e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:37:27.154818 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f93cff2-6026-4d67-9f12-cd758c2c098e None admin] REQUEST_METHOD: `GET` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:37:27.155883 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f93cff2-6026-4d67-9f12-cd758c2c098e None admin] SCRIPT_NAME: `/identity` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:37:27.156475 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f93cff2-6026-4d67-9f12-cd758c2c098e None admin] PATH_INFO: `/v3/projects/service` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:37:27.170458 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f93cff2-6026-4d67-9f12-cd758c2c098e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:37:27.173097 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f93cff2-6026-4d67-9f12-cd758c2c098e None admin] RBAC: Authorization granted {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:37:27.190277 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application [None req-1f93cff2-6026-4d67-9f12-cd758c2c098e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 08:37:27.190277 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:37:27.190277 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:37:27.190277 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:37:27.190277 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:37:27.190277 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:37:27.190277 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:37:27.190277 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:37:27.190277 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:37:27.190277 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:37:27.190277 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:37:27.190277 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:37:27.190277 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 28 08:37:27.190277 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 28 08:37:27.190277 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 28 08:37:27.191414 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 28 08:37:27.191414 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:37:27.191414 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:37:27.191414 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:37:27.191414 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:37:27.191414 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:37:27.191414 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:37:27.191414 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:37:27.191414 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application with Lock( Jul 28 08:37:27.191414 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:37:27.191414 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:37:27.191414 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:37:27.191414 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:37:27.191414 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:37:27.191414 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:37:27.191414 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:37:27.191414 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:37:27.193119 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 28 08:37:27.193119 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 28 08:37:27.193119 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 28 08:37:27.193119 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 28 08:37:27.193119 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 28 08:37:27.193119 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 28 08:37:27.193119 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 08:37:27.193119 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application Jul 28 08:37:27.193119 dv-cinder-851351-1-smb devstack@keystone.service[282898]: [pid: 282898|app: 0|req: 418/828] 10.222.0.42 () {56 vars in 1111 bytes} [Thu Jul 28 08:37:26 2022] GET /identity/v3/projects/service => generated 88 bytes in 290 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:37:27.193709 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59fc4ed-254c-4f14-afdf-fe2f81493e10 None None] REQUEST_METHOD: `POST` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:37:27.193709 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59fc4ed-254c-4f14-afdf-fe2f81493e10 None None] SCRIPT_NAME: `/identity` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:37:27.193854 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59fc4ed-254c-4f14-afdf-fe2f81493e10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:37:27.215086 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.auth.core [None req-d59fc4ed-254c-4f14-afdf-fe2f81493e10 None None] MFA Rules not processed for user `2be990a66857410a87ffa7609aec4f7b`. Rule list: `[]` (Enabled: `True`). {{(pid=282898) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 08:37:27.216764 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.fernet_utils [None req-d59fc4ed-254c-4f14-afdf-fe2f81493e10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=282898) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:37:27.266007 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2efe5cce-be02-4a2c-92d2-7c37dbef6273 None None] Validating token access rules against request {{(pid=282899) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:37:27.304699 dv-cinder-851351-1-smb devstack@keystone.service[282898]: [pid: 282898|app: 0|req: 419/829] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 08:37:27 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 08:37:27.304699 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d59fc4ed-254c-4f14-afdf-fe2f81493e10 None None] Authenticating user token {{(pid=282898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:37:27.308974 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3809aa8-db5b-48ff-af93-3ed205b7b8a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282899) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:37:27.309652 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3809aa8-db5b-48ff-af93-3ed205b7b8a1 None admin] REQUEST_METHOD: `GET` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:37:27.309987 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3809aa8-db5b-48ff-af93-3ed205b7b8a1 None admin] SCRIPT_NAME: `/identity` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:37:27.310713 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3809aa8-db5b-48ff-af93-3ed205b7b8a1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:37:27.319791 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3809aa8-db5b-48ff-af93-3ed205b7b8a1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:37:27.321304 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3809aa8-db5b-48ff-af93-3ed205b7b8a1 None admin] RBAC: Authorization granted {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:37:27.334620 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application [None req-f3809aa8-db5b-48ff-af93-3ed205b7b8a1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 08:37:27.334620 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:37:27.334620 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:37:27.334620 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:37:27.334620 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:37:27.334620 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:37:27.334620 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:37:27.334620 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:37:27.334620 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:37:27.334620 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:37:27.334620 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:37:27.334620 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:37:27.334620 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 28 08:37:27.334620 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 28 08:37:27.334620 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 28 08:37:27.335730 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 28 08:37:27.335730 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:37:27.335730 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:37:27.335730 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:37:27.335730 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:37:27.335730 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:37:27.335730 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:37:27.335730 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:37:27.335730 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application with Lock( Jul 28 08:37:27.335730 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:37:27.335730 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:37:27.335730 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:37:27.335730 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:37:27.335730 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:37:27.335730 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:37:27.335730 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:37:27.335730 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:37:27.337010 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 28 08:37:27.337010 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 28 08:37:27.337010 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 28 08:37:27.337010 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 28 08:37:27.337010 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 28 08:37:27.337010 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 28 08:37:27.337010 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 08:37:27.337010 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application Jul 28 08:37:27.337010 dv-cinder-851351-1-smb devstack@keystone.service[282899]: [pid: 282899|app: 0|req: 411/830] 10.222.0.42 () {56 vars in 1111 bytes} [Thu Jul 28 08:37:27 2022] GET /identity/v3/projects/service => generated 88 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:37:27.337010 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3809aa8-db5b-48ff-af93-3ed205b7b8a1 None admin] Authenticating user token {{(pid=282899) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:37:27.372869 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG dbcounter [-] [282899] Writing DB stats keystone:SELECT=100 {{(pid=282899) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:37:27.382356 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG dbcounter [-] [282898] Writing DB stats keystone:SELECT=100 {{(pid=282898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:37:27.419157 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d59fc4ed-254c-4f14-afdf-fe2f81493e10 None None] Validating token access rules against request {{(pid=282898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:37:27.461239 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3809aa8-db5b-48ff-af93-3ed205b7b8a1 None admin] Validating token access rules against request {{(pid=282899) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:37:27.463934 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fcd588d-10ea-49cb-bb42-c1d70018274e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:37:27.464697 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fcd588d-10ea-49cb-bb42-c1d70018274e None admin] REQUEST_METHOD: `GET` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:37:27.465084 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fcd588d-10ea-49cb-bb42-c1d70018274e None admin] SCRIPT_NAME: `/identity` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:37:27.465361 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fcd588d-10ea-49cb-bb42-c1d70018274e None admin] PATH_INFO: `/v3/projects` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:37:27.466135 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fcd588d-10ea-49cb-bb42-c1d70018274e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=282898) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:37:27.466445 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fcd588d-10ea-49cb-bb42-c1d70018274e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:37:27.467917 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fcd588d-10ea-49cb-bb42-c1d70018274e None admin] RBAC: Authorization granted {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:37:27.486512 dv-cinder-851351-1-smb devstack@keystone.service[282898]: [pid: 282898|app: 0|req: 420/831] 10.222.0.42 () {56 vars in 1148 bytes} [Thu Jul 28 08:37:27 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:37:27.486512 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fcd588d-10ea-49cb-bb42-c1d70018274e None admin] Authenticating user token {{(pid=282898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:37:27.517625 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cceaab7-2d12-416d-b9e5-d8a353d56002 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282899) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:37:27.519214 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cceaab7-2d12-416d-b9e5-d8a353d56002 None admin] REQUEST_METHOD: `GET` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:37:27.519682 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cceaab7-2d12-416d-b9e5-d8a353d56002 None admin] SCRIPT_NAME: `/identity` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:37:27.520152 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cceaab7-2d12-416d-b9e5-d8a353d56002 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:37:27.521454 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cceaab7-2d12-416d-b9e5-d8a353d56002 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:37:27.525889 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cceaab7-2d12-416d-b9e5-d8a353d56002 None admin] RBAC: Authorization granted {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:37:27.538423 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application [None req-5cceaab7-2d12-416d-b9e5-d8a353d56002 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 28 08:37:27.538423 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:37:27.538423 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 28 08:37:27.538423 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 28 08:37:27.538423 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 28 08:37:27.538423 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 28 08:37:27.538423 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 28 08:37:27.538423 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 08:37:27.538423 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 28 08:37:27.538423 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application Jul 28 08:37:27.538423 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 28 08:37:27.538423 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application Jul 28 08:37:27.538423 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:37:27.538423 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:37:27.538423 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:37:27.538423 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:37:27.538423 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:37:27.539910 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:37:27.539910 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:37:27.539910 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:37:27.539910 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:37:27.539910 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:37:27.539910 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:37:27.539910 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 28 08:37:27.539910 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 28 08:37:27.539910 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 28 08:37:27.539910 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 28 08:37:27.539910 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:37:27.539910 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:37:27.539910 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:37:27.539910 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:37:27.539910 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:37:27.539910 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:37:27.541146 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:37:27.541146 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application with Lock( Jul 28 08:37:27.541146 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:37:27.541146 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:37:27.541146 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:37:27.541146 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:37:27.541146 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:37:27.541146 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:37:27.541146 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:37:27.541146 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:37:27.541146 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 28 08:37:27.541146 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 08:37:27.541146 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 28 08:37:27.541146 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application Jul 28 08:37:27.544850 dv-cinder-851351-1-smb devstack@keystone.service[282899]: [pid: 282899|app: 0|req: 412/832] 10.222.0.42 () {56 vars in 1114 bytes} [Thu Jul 28 08:37:27 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:37:27.545707 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cceaab7-2d12-416d-b9e5-d8a353d56002 None admin] Authenticating user token {{(pid=282899) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:37:27.625307 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fcd588d-10ea-49cb-bb42-c1d70018274e None admin] Validating token access rules against request {{(pid=282898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:37:27.658120 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG dbcounter [-] [282899] Writing DB stats keystone:SELECT=100 {{(pid=282899) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:37:27.663532 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG dbcounter [-] [282898] Writing DB stats keystone:SELECT=100 {{(pid=282898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:37:27.665890 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cceaab7-2d12-416d-b9e5-d8a353d56002 None admin] Validating token access rules against request {{(pid=282899) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:37:27.675574 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60ac98a-3ee2-43a8-9731-044075cd71f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:37:27.676605 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60ac98a-3ee2-43a8-9731-044075cd71f6 None admin] REQUEST_METHOD: `GET` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:37:27.676605 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60ac98a-3ee2-43a8-9731-044075cd71f6 None admin] SCRIPT_NAME: `/identity` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:37:27.677008 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60ac98a-3ee2-43a8-9731-044075cd71f6 None admin] PATH_INFO: `/v3/projects` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:37:27.677793 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a60ac98a-3ee2-43a8-9731-044075cd71f6 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=282898) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:37:27.678107 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a60ac98a-3ee2-43a8-9731-044075cd71f6 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:37:27.679568 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a60ac98a-3ee2-43a8-9731-044075cd71f6 None admin] RBAC: Authorization granted {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:37:27.694186 dv-cinder-851351-1-smb devstack@keystone.service[282898]: [pid: 282898|app: 0|req: 421/833] 10.222.0.42 () {56 vars in 1148 bytes} [Thu Jul 28 08:37:27 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:37:27.694800 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60ac98a-3ee2-43a8-9731-044075cd71f6 None admin] Authenticating user token {{(pid=282898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:37:27.728229 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1782ee9a-2842-4641-b7d6-69f5e40c7130 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282899) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:37:27.729278 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1782ee9a-2842-4641-b7d6-69f5e40c7130 None admin] REQUEST_METHOD: `PUT` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:37:27.729567 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1782ee9a-2842-4641-b7d6-69f5e40c7130 None admin] SCRIPT_NAME: `/identity` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:37:27.729851 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1782ee9a-2842-4641-b7d6-69f5e40c7130 None admin] PATH_INFO: `/v3/projects/5cde68cbfb9042dc9f36af3aacea2473/users/f3a6183fd2c040079951febe23234356/roles/a0e2a00bf94d40f38629d6b5293e3aee` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:37:27.731981 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1782ee9a-2842-4641-b7d6-69f5e40c7130 None admin] RBAC: Authorizing `identity:create_grant(project_id=5cde68cbfb9042dc9f36af3aacea2473, user_id=f3a6183fd2c040079951febe23234356, role_id=a0e2a00bf94d40f38629d6b5293e3aee)` {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:37:27.733508 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1782ee9a-2842-4641-b7d6-69f5e40c7130 None admin] RBAC: Authorization granted {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:37:27.747914 dv-cinder-851351-1-smb devstack@keystone.service[282899]: [pid: 282899|app: 0|req: 413/834] 10.222.0.42 () {58 vars in 1439 bytes} [Thu Jul 28 08:37:27 2022] PUT /identity/v3/projects/5cde68cbfb9042dc9f36af3aacea2473/users/f3a6183fd2c040079951febe23234356/roles/a0e2a00bf94d40f38629d6b5293e3aee => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 08:37:27.750066 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1782ee9a-2842-4641-b7d6-69f5e40c7130 None admin] Authenticating user token {{(pid=282899) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:37:27.881435 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60ac98a-3ee2-43a8-9731-044075cd71f6 None admin] Validating token access rules against request {{(pid=282898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:37:27.898986 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1782ee9a-2842-4641-b7d6-69f5e40c7130 None admin] Validating token access rules against request {{(pid=282899) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:37:27.928642 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a9436a-85f1-4113-85f0-813592b91329 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:37:27.929335 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a9436a-85f1-4113-85f0-813592b91329 None admin] REQUEST_METHOD: `GET` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:37:27.929910 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a9436a-85f1-4113-85f0-813592b91329 None admin] SCRIPT_NAME: `/identity` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:37:27.930208 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a9436a-85f1-4113-85f0-813592b91329 None admin] PATH_INFO: `/v3/services` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:37:27.930930 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6a9436a-85f1-4113-85f0-813592b91329 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=282898) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:37:27.931245 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6a9436a-85f1-4113-85f0-813592b91329 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:37:27.932658 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6a9436a-85f1-4113-85f0-813592b91329 None admin] RBAC: Authorization granted {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:37:27.938030 dv-cinder-851351-1-smb devstack@keystone.service[282898]: [pid: 282898|app: 0|req: 422/835] 10.222.0.42 () {56 vars in 1114 bytes} [Thu Jul 28 08:37:27 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:37:27.945304 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a9436a-85f1-4113-85f0-813592b91329 None admin] Authenticating user token {{(pid=282898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:37:27.949591 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47a9b5e-1c86-4dd7-940f-9009b02ce204 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282899) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:37:27.950300 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47a9b5e-1c86-4dd7-940f-9009b02ce204 None admin] REQUEST_METHOD: `PUT` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:37:27.950584 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47a9b5e-1c86-4dd7-940f-9009b02ce204 None admin] SCRIPT_NAME: `/identity` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:37:27.950866 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47a9b5e-1c86-4dd7-940f-9009b02ce204 None admin] PATH_INFO: `/v3/projects/5cde68cbfb9042dc9f36af3aacea2473/users/f4a66540de9f46a2bc490af024cc37cd/roles/aa4daecf3ff74fa1b7d53041a4659723` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:37:27.969443 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c47a9b5e-1c86-4dd7-940f-9009b02ce204 None admin] RBAC: Authorizing `identity:create_grant(project_id=5cde68cbfb9042dc9f36af3aacea2473, user_id=f4a66540de9f46a2bc490af024cc37cd, role_id=aa4daecf3ff74fa1b7d53041a4659723)` {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:37:27.970964 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c47a9b5e-1c86-4dd7-940f-9009b02ce204 None admin] RBAC: Authorization granted {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:37:27.989527 dv-cinder-851351-1-smb devstack@keystone.service[282899]: [pid: 282899|app: 0|req: 414/836] 10.222.0.42 () {58 vars in 1439 bytes} [Thu Jul 28 08:37:27 2022] PUT /identity/v3/projects/5cde68cbfb9042dc9f36af3aacea2473/users/f4a66540de9f46a2bc490af024cc37cd/roles/aa4daecf3ff74fa1b7d53041a4659723 => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 08:37:28.025086 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG dbcounter [-] [282898] Writing DB stats keystone:SELECT=100 {{(pid=282898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:37:28.082228 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a9436a-85f1-4113-85f0-813592b91329 None admin] Validating token access rules against request {{(pid=282898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:37:28.135825 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de9059e1-c4a1-4ff5-a6e8-65168cc94e95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:37:28.136825 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9059e1-c4a1-4ff5-a6e8-65168cc94e95 None admin] REQUEST_METHOD: `GET` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:37:28.137312 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9059e1-c4a1-4ff5-a6e8-65168cc94e95 None admin] SCRIPT_NAME: `/identity` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:37:28.137769 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9059e1-c4a1-4ff5-a6e8-65168cc94e95 None admin] PATH_INFO: `/v3/services` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:37:28.138564 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de9059e1-c4a1-4ff5-a6e8-65168cc94e95 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=282898) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:37:28.138936 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de9059e1-c4a1-4ff5-a6e8-65168cc94e95 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:37:28.141401 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de9059e1-c4a1-4ff5-a6e8-65168cc94e95 None admin] RBAC: Authorization granted {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:37:28.149864 dv-cinder-851351-1-smb devstack@keystone.service[282898]: [pid: 282898|app: 0|req: 423/837] 10.222.0.42 () {56 vars in 1114 bytes} [Thu Jul 28 08:37:27 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:37:28.423164 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3a4419-039e-4180-a56c-add977a4e4e8 None None] REQUEST_METHOD: `GET` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:37:28.424041 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3a4419-039e-4180-a56c-add977a4e4e8 None None] SCRIPT_NAME: `/identity` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:37:28.424041 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3a4419-039e-4180-a56c-add977a4e4e8 None None] PATH_INFO: `/` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:37:28.425454 dv-cinder-851351-1-smb devstack@keystone.service[282899]: [pid: 282899|app: 0|req: 415/838] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 08:37:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 08:37:28.431446 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e21d433-d4f2-4841-916f-00a5ad0763e3 None None] REQUEST_METHOD: `POST` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:37:28.431736 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e21d433-d4f2-4841-916f-00a5ad0763e3 None None] SCRIPT_NAME: `/identity` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:37:28.432015 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e21d433-d4f2-4841-916f-00a5ad0763e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:37:28.453449 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.auth.core [None req-0e21d433-d4f2-4841-916f-00a5ad0763e3 None None] MFA Rules not processed for user `2be990a66857410a87ffa7609aec4f7b`. Rule list: `[]` (Enabled: `True`). {{(pid=282898) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 08:37:28.455108 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.fernet_utils [None req-0e21d433-d4f2-4841-916f-00a5ad0763e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=282898) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:37:28.532792 dv-cinder-851351-1-smb devstack@keystone.service[282898]: [pid: 282898|app: 0|req: 424/839] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 08:37:28 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 08:37:28.555318 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3a4419-039e-4180-a56c-add977a4e4e8 None None] Authenticating user token {{(pid=282899) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:37:28.566640 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG dbcounter [-] [282899] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=282899) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:37:28.723007 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3a4419-039e-4180-a56c-add977a4e4e8 None None] Validating token access rules against request {{(pid=282899) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:37:28.760924 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee5b21f-88af-4fd6-a49f-83c9e521b8b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282899) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:37:28.762209 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee5b21f-88af-4fd6-a49f-83c9e521b8b5 None admin] REQUEST_METHOD: `GET` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:37:28.762737 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee5b21f-88af-4fd6-a49f-83c9e521b8b5 None admin] SCRIPT_NAME: `/identity` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:37:28.763244 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee5b21f-88af-4fd6-a49f-83c9e521b8b5 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:37:28.764104 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ee5b21f-88af-4fd6-a49f-83c9e521b8b5 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:37:28.765837 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ee5b21f-88af-4fd6-a49f-83c9e521b8b5 None admin] RBAC: Authorization granted {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:37:28.776061 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application [None req-2ee5b21f-88af-4fd6-a49f-83c9e521b8b5 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 28 08:37:28.776061 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:37:28.776061 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 28 08:37:28.776061 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 28 08:37:28.776061 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 28 08:37:28.776061 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 28 08:37:28.776061 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 28 08:37:28.776061 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 08:37:28.776061 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 28 08:37:28.776061 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application Jul 28 08:37:28.776061 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 28 08:37:28.776061 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application Jul 28 08:37:28.776061 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:37:28.776061 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:37:28.776061 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:37:28.776061 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:37:28.777302 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:37:28.777302 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:37:28.777302 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:37:28.777302 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:37:28.777302 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:37:28.777302 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:37:28.777302 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:37:28.777302 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 28 08:37:28.777302 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 28 08:37:28.777302 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 28 08:37:28.777302 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 28 08:37:28.777302 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:37:28.777302 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:37:28.777302 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:37:28.777302 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:37:28.777302 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:37:28.778317 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:37:28.778317 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:37:28.778317 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application with Lock( Jul 28 08:37:28.778317 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:37:28.778317 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:37:28.778317 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:37:28.778317 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:37:28.778317 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:37:28.778317 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:37:28.778317 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:37:28.778317 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:37:28.778317 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 28 08:37:28.778317 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 08:37:28.778317 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 28 08:37:28.778317 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application Jul 28 08:37:28.784776 dv-cinder-851351-1-smb devstack@keystone.service[282899]: [pid: 282899|app: 0|req: 416/840] 10.222.0.42 () {56 vars in 1132 bytes} [Thu Jul 28 08:37:28 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:37:28.786566 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e21d433-d4f2-4841-916f-00a5ad0763e3 None None] Authenticating user token {{(pid=282898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:37:28.861684 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG dbcounter [-] [282898] Writing DB stats keystone:SELECT=100 {{(pid=282898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:37:28.916706 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e21d433-d4f2-4841-916f-00a5ad0763e3 None None] Validating token access rules against request {{(pid=282898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:37:28.953265 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e697972f-e729-4679-9361-1ae1022faa14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:37:28.953916 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e697972f-e729-4679-9361-1ae1022faa14 None admin] REQUEST_METHOD: `GET` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:37:28.954562 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e697972f-e729-4679-9361-1ae1022faa14 None admin] SCRIPT_NAME: `/identity` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:37:28.954837 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e697972f-e729-4679-9361-1ae1022faa14 None admin] PATH_INFO: `/v3/services` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:37:28.955590 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e697972f-e729-4679-9361-1ae1022faa14 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=282898) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:37:28.955901 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e697972f-e729-4679-9361-1ae1022faa14 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:37:28.957336 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e697972f-e729-4679-9361-1ae1022faa14 None admin] RBAC: Authorization granted {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:37:28.962798 dv-cinder-851351-1-smb devstack@keystone.service[282898]: [pid: 282898|app: 0|req: 425/841] 10.222.0.42 () {56 vars in 1126 bytes} [Thu Jul 28 08:37:28 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:37:28.970085 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee5b21f-88af-4fd6-a49f-83c9e521b8b5 None admin] Authenticating user token {{(pid=282899) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:37:29.069121 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG dbcounter [-] [282899] Writing DB stats keystone:SELECT=100 {{(pid=282899) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:37:29.121334 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee5b21f-88af-4fd6-a49f-83c9e521b8b5 None admin] Validating token access rules against request {{(pid=282899) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:37:29.162433 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1f9fb3-302b-4183-9fab-02baed709ab9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282899) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:37:29.163330 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1f9fb3-302b-4183-9fab-02baed709ab9 None admin] REQUEST_METHOD: `GET` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:37:29.163787 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1f9fb3-302b-4183-9fab-02baed709ab9 None admin] SCRIPT_NAME: `/identity` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:37:29.164161 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1f9fb3-302b-4183-9fab-02baed709ab9 None admin] PATH_INFO: `/v3/services` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:37:29.165251 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb1f9fb3-302b-4183-9fab-02baed709ab9 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=282899) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:37:29.165654 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb1f9fb3-302b-4183-9fab-02baed709ab9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:37:29.167573 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb1f9fb3-302b-4183-9fab-02baed709ab9 None admin] RBAC: Authorization granted {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:37:29.175162 dv-cinder-851351-1-smb devstack@keystone.service[282899]: [pid: 282899|app: 0|req: 417/842] 10.222.0.42 () {56 vars in 1126 bytes} [Thu Jul 28 08:37:28 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:37:30.146475 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7cccc65-3da0-4e7b-98c5-280c4e7fd291 None None] REQUEST_METHOD: `GET` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:37:30.147055 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7cccc65-3da0-4e7b-98c5-280c4e7fd291 None None] SCRIPT_NAME: `/identity` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:37:30.147055 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7cccc65-3da0-4e7b-98c5-280c4e7fd291 None None] PATH_INFO: `/` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:37:30.148612 dv-cinder-851351-1-smb devstack@keystone.service[282898]: [pid: 282898|app: 0|req: 426/843] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 08:37:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 08:37:30.157678 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe87d92-c408-423d-ba26-718d7fd5de0a None None] REQUEST_METHOD: `POST` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:37:30.158938 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe87d92-c408-423d-ba26-718d7fd5de0a None None] SCRIPT_NAME: `/identity` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:37:30.159503 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe87d92-c408-423d-ba26-718d7fd5de0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:37:30.179461 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.auth.core [None req-0fe87d92-c408-423d-ba26-718d7fd5de0a None None] MFA Rules not processed for user `2be990a66857410a87ffa7609aec4f7b`. Rule list: `[]` (Enabled: `True`). {{(pid=282899) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 08:37:30.181099 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.fernet_utils [None req-0fe87d92-c408-423d-ba26-718d7fd5de0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=282899) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:37:30.205991 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3694c677-0afb-495c-8a54-cba398be9eb4 None None] REQUEST_METHOD: `GET` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:37:30.206351 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3694c677-0afb-495c-8a54-cba398be9eb4 None None] SCRIPT_NAME: `/identity` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:37:30.206546 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3694c677-0afb-495c-8a54-cba398be9eb4 None None] PATH_INFO: `/` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:37:30.208216 dv-cinder-851351-1-smb devstack@keystone.service[282898]: [pid: 282898|app: 0|req: 427/844] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 08:37:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 28 08:37:30.213414 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89a152f-67c0-4ac9-87d2-113db0c08b5d None None] REQUEST_METHOD: `POST` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:37:30.213701 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89a152f-67c0-4ac9-87d2-113db0c08b5d None None] SCRIPT_NAME: `/identity` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:37:30.213978 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89a152f-67c0-4ac9-87d2-113db0c08b5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:37:30.236214 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.auth.core [None req-a89a152f-67c0-4ac9-87d2-113db0c08b5d None None] MFA Rules not processed for user `2be990a66857410a87ffa7609aec4f7b`. Rule list: `[]` (Enabled: `True`). {{(pid=282898) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 08:37:30.238302 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.fernet_utils [None req-a89a152f-67c0-4ac9-87d2-113db0c08b5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=282898) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:37:30.267899 dv-cinder-851351-1-smb devstack@keystone.service[282899]: [pid: 282899|app: 0|req: 418/845] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 08:37:30 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 08:37:30.291584 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe87d92-c408-423d-ba26-718d7fd5de0a None None] Authenticating user token {{(pid=282899) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:37:30.344832 dv-cinder-851351-1-smb devstack@keystone.service[282898]: [pid: 282898|app: 0|req: 428/846] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 08:37:30 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 28 08:37:30.365015 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a89a152f-67c0-4ac9-87d2-113db0c08b5d None None] Authenticating user token {{(pid=282898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:37:30.406135 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG dbcounter [-] [282899] Writing DB stats keystone:SELECT=100 {{(pid=282899) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:37:30.425538 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG dbcounter [-] [282898] Writing DB stats keystone:SELECT=100 {{(pid=282898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:37:30.462254 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe87d92-c408-423d-ba26-718d7fd5de0a None None] Validating token access rules against request {{(pid=282899) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:37:30.499161 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a89a152f-67c0-4ac9-87d2-113db0c08b5d None None] Validating token access rules against request {{(pid=282898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:37:30.502899 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b94af37-a2fc-417f-a01f-78f0f6fe4930 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282899) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:37:30.503851 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b94af37-a2fc-417f-a01f-78f0f6fe4930 None admin] REQUEST_METHOD: `GET` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:37:30.504367 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b94af37-a2fc-417f-a01f-78f0f6fe4930 None admin] SCRIPT_NAME: `/identity` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:37:30.504906 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b94af37-a2fc-417f-a01f-78f0f6fe4930 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:37:30.518508 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b94af37-a2fc-417f-a01f-78f0f6fe4930 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 08:37:30.523434 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application [None req-2b94af37-a2fc-417f-a01f-78f0f6fe4930 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 08:37:30.523434 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:37:30.523434 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:37:30.523434 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:37:30.523434 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:37:30.523434 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:37:30.523434 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:37:30.523434 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:37:30.523434 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:37:30.523434 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:37:30.523434 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:37:30.523434 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:37:30.523434 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 08:37:30.523434 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 08:37:30.523434 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 08:37:30.523434 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 08:37:30.524563 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 08:37:30.524563 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 08:37:30.524563 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 08:37:30.524563 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 08:37:30.524563 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:37:30.524563 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:37:30.524563 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:37:30.524563 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:37:30.524563 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:37:30.524563 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:37:30.524563 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:37:30.524563 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application with Lock( Jul 28 08:37:30.524563 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:37:30.524563 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:37:30.524563 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:37:30.524563 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:37:30.526113 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:37:30.526113 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:37:30.526113 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:37:30.526113 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:37:30.526113 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 08:37:30.526113 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 08:37:30.526113 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 08:37:30.526113 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 08:37:30.526113 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 08:37:30.526113 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 08:37:30.526113 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 08:37:30.526113 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application Jul 28 08:37:30.526113 dv-cinder-851351-1-smb devstack@keystone.service[282899]: [pid: 282899|app: 0|req: 419/847] 10.222.0.42 () {56 vars in 1096 bytes} [Thu Jul 28 08:37:30 2022] GET /identity/v3/roles/admin => generated 83 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:37:30.526113 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543a3447-f617-4da7-903e-0a517f84e364 None None] REQUEST_METHOD: `GET` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:37:30.527014 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543a3447-f617-4da7-903e-0a517f84e364 None None] SCRIPT_NAME: `/identity` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:37:30.527014 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543a3447-f617-4da7-903e-0a517f84e364 None None] PATH_INFO: `/` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:37:30.527816 dv-cinder-851351-1-smb devstack@keystone.service[282899]: [pid: 282899|app: 0|req: 420/848] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 08:37:30 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 08:37:30.532470 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-543a3447-f617-4da7-903e-0a517f84e364 None None] Authenticating user token {{(pid=282899) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:37:30.543123 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88bf299a-221d-426d-a188-d035c527990f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:37:30.544610 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88bf299a-221d-426d-a188-d035c527990f None admin] REQUEST_METHOD: `GET` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:37:30.545117 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88bf299a-221d-426d-a188-d035c527990f None admin] SCRIPT_NAME: `/identity` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:37:30.545557 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88bf299a-221d-426d-a188-d035c527990f None admin] PATH_INFO: `/v3/roles/service` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:37:30.562042 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88bf299a-221d-426d-a188-d035c527990f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 08:37:30.569026 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application [None req-88bf299a-221d-426d-a188-d035c527990f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 28 08:37:30.569026 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:37:30.569026 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:37:30.569026 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:37:30.569026 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:37:30.569026 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:37:30.569026 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:37:30.569026 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:37:30.569026 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:37:30.569026 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:37:30.569026 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:37:30.569026 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:37:30.569026 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 08:37:30.569026 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 08:37:30.569026 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 08:37:30.569026 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 08:37:30.570284 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 08:37:30.570284 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 08:37:30.570284 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 08:37:30.570284 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 08:37:30.570284 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:37:30.570284 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:37:30.570284 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:37:30.570284 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:37:30.570284 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:37:30.570284 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:37:30.570284 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:37:30.570284 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application with Lock( Jul 28 08:37:30.570284 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:37:30.570284 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:37:30.570284 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:37:30.570284 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:37:30.571283 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:37:30.571283 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:37:30.571283 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:37:30.571283 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:37:30.571283 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 08:37:30.571283 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 08:37:30.571283 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 08:37:30.571283 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 08:37:30.571283 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 08:37:30.571283 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 08:37:30.571283 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 28 08:37:30.571283 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application Jul 28 08:37:30.571283 dv-cinder-851351-1-smb devstack@keystone.service[282898]: [pid: 282898|app: 0|req: 429/849] 10.222.0.42 () {56 vars in 1102 bytes} [Thu Jul 28 08:37:30 2022] GET /identity/v3/roles/service => generated 85 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 08:37:30.572893 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8603463-f830-4c02-a49e-2dd4c19537b4 None None] REQUEST_METHOD: `POST` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:37:30.573189 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8603463-f830-4c02-a49e-2dd4c19537b4 None None] SCRIPT_NAME: `/identity` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:37:30.573510 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8603463-f830-4c02-a49e-2dd4c19537b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:37:30.593276 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.auth.core [None req-a8603463-f830-4c02-a49e-2dd4c19537b4 None None] MFA Rules not processed for user `2be990a66857410a87ffa7609aec4f7b`. Rule list: `[]` (Enabled: `True`). {{(pid=282898) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 08:37:30.594530 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.fernet_utils [None req-a8603463-f830-4c02-a49e-2dd4c19537b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=282898) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:37:30.657833 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-543a3447-f617-4da7-903e-0a517f84e364 None None] Validating token access rules against request {{(pid=282899) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:37:30.680697 dv-cinder-851351-1-smb devstack@keystone.service[282898]: [pid: 282898|app: 0|req: 430/850] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 08:37:30 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 08:37:30.680697 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8603463-f830-4c02-a49e-2dd4c19537b4 None None] Authenticating user token {{(pid=282898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:37:30.698972 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG dbcounter [-] [282899] Writing DB stats keystone:SELECT=100 {{(pid=282899) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:37:30.713317 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f617f509-1402-4f8c-bbee-91023ffcc3d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282899) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:37:30.713964 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f617f509-1402-4f8c-bbee-91023ffcc3d2 None admin] REQUEST_METHOD: `GET` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:37:30.714253 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f617f509-1402-4f8c-bbee-91023ffcc3d2 None admin] SCRIPT_NAME: `/identity` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:37:30.714532 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f617f509-1402-4f8c-bbee-91023ffcc3d2 None admin] PATH_INFO: `/v3/roles` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:37:30.715251 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f617f509-1402-4f8c-bbee-91023ffcc3d2 None admin] RBAC: Adding query filter params (name=admin) {{(pid=282899) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:37:30.715567 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f617f509-1402-4f8c-bbee-91023ffcc3d2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:37:30.717007 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f617f509-1402-4f8c-bbee-91023ffcc3d2 None admin] RBAC: Authorization granted {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:37:30.722863 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG dbcounter [-] [282898] Writing DB stats keystone:SELECT=100 {{(pid=282898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:37:30.728049 dv-cinder-851351-1-smb devstack@keystone.service[282899]: [pid: 282899|app: 0|req: 421/851] 10.222.0.42 () {56 vars in 1099 bytes} [Thu Jul 28 08:37:30 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:37:30.729239 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f617f509-1402-4f8c-bbee-91023ffcc3d2 None admin] Authenticating user token {{(pid=282899) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:37:30.830765 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8603463-f830-4c02-a49e-2dd4c19537b4 None None] Validating token access rules against request {{(pid=282898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:37:30.863727 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f617f509-1402-4f8c-bbee-91023ffcc3d2 None admin] Validating token access rules against request {{(pid=282899) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:37:30.868288 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea9b3b77-b879-4e42-825a-0d966ab04ce9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:37:30.868955 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9b3b77-b879-4e42-825a-0d966ab04ce9 None admin] REQUEST_METHOD: `GET` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:37:30.869243 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9b3b77-b879-4e42-825a-0d966ab04ce9 None admin] SCRIPT_NAME: `/identity` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:37:30.869585 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9b3b77-b879-4e42-825a-0d966ab04ce9 None admin] PATH_INFO: `/v3/roles` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:37:30.870334 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea9b3b77-b879-4e42-825a-0d966ab04ce9 None admin] RBAC: Adding query filter params (name=service) {{(pid=282898) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:37:30.870646 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea9b3b77-b879-4e42-825a-0d966ab04ce9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:37:30.872079 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea9b3b77-b879-4e42-825a-0d966ab04ce9 None admin] RBAC: Authorization granted {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:37:30.886034 dv-cinder-851351-1-smb devstack@keystone.service[282898]: [pid: 282898|app: 0|req: 431/852] 10.222.0.42 () {56 vars in 1103 bytes} [Thu Jul 28 08:37:30 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:37:30.886769 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea9b3b77-b879-4e42-825a-0d966ab04ce9 None admin] Authenticating user token {{(pid=282898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:37:30.900262 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d70ccdc2-1bdb-4c75-bc38-b1f27cc3fbe3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282899) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:37:30.901010 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70ccdc2-1bdb-4c75-bc38-b1f27cc3fbe3 None admin] REQUEST_METHOD: `POST` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:37:30.901321 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70ccdc2-1bdb-4c75-bc38-b1f27cc3fbe3 None admin] SCRIPT_NAME: `/identity` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:37:30.901599 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70ccdc2-1bdb-4c75-bc38-b1f27cc3fbe3 None admin] PATH_INFO: `/v3/services` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:37:30.902317 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d70ccdc2-1bdb-4c75-bc38-b1f27cc3fbe3 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:37:30.903724 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d70ccdc2-1bdb-4c75-bc38-b1f27cc3fbe3 None admin] RBAC: Authorization granted {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:37:30.922819 dv-cinder-851351-1-smb devstack@keystone.service[282899]: [pid: 282899|app: 0|req: 422/853] 10.222.0.42 () {60 vars in 1141 bytes} [Thu Jul 28 08:37:30 2022] POST /identity/v3/services => generated 251 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 08:37:30.923647 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d70ccdc2-1bdb-4c75-bc38-b1f27cc3fbe3 None admin] Authenticating user token {{(pid=282899) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:37:30.990390 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG dbcounter [-] [282899] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=282899) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:37:31.008437 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG dbcounter [-] [282898] Writing DB stats keystone:SELECT=100 {{(pid=282898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:37:31.017085 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea9b3b77-b879-4e42-825a-0d966ab04ce9 None admin] Validating token access rules against request {{(pid=282898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:37:31.063699 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44af0647-0ca0-44d3-9dd0-9d0daf49d06c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:37:31.064427 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44af0647-0ca0-44d3-9dd0-9d0daf49d06c None admin] REQUEST_METHOD: `GET` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:37:31.064752 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44af0647-0ca0-44d3-9dd0-9d0daf49d06c None admin] SCRIPT_NAME: `/identity` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:37:31.065029 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44af0647-0ca0-44d3-9dd0-9d0daf49d06c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:37:31.065303 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d70ccdc2-1bdb-4c75-bc38-b1f27cc3fbe3 None admin] Validating token access rules against request {{(pid=282899) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:37:31.078140 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44af0647-0ca0-44d3-9dd0-9d0daf49d06c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:37:31.080127 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44af0647-0ca0-44d3-9dd0-9d0daf49d06c None admin] RBAC: Authorization granted {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:37:31.102511 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application [None req-44af0647-0ca0-44d3-9dd0-9d0daf49d06c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 08:37:31.102511 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:37:31.102511 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:37:31.102511 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:37:31.102511 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:37:31.102511 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:37:31.102511 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:37:31.102511 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:37:31.102511 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:37:31.102511 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:37:31.102511 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:37:31.102511 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:37:31.102511 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 08:37:31.102511 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 08:37:31.102511 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 08:37:31.103657 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 08:37:31.103657 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:37:31.103657 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:37:31.103657 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:37:31.103657 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:37:31.103657 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:37:31.103657 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:37:31.103657 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:37:31.103657 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application with Lock( Jul 28 08:37:31.103657 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:37:31.103657 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:37:31.103657 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:37:31.103657 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:37:31.103657 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:37:31.103657 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:37:31.103657 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:37:31.103657 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:37:31.104782 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 08:37:31.104782 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 08:37:31.104782 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 08:37:31.104782 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application Jul 28 08:37:31.105073 dv-cinder-851351-1-smb devstack@keystone.service[282898]: [pid: 282898|app: 0|req: 432/854] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 08:37:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:37:31.110709 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44af0647-0ca0-44d3-9dd0-9d0daf49d06c None admin] Authenticating user token {{(pid=282898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:37:31.115883 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae01800-be2d-4b46-81e1-d807d7c36edb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282899) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:37:31.117443 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae01800-be2d-4b46-81e1-d807d7c36edb None admin] REQUEST_METHOD: `GET` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:37:31.117443 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae01800-be2d-4b46-81e1-d807d7c36edb None admin] SCRIPT_NAME: `/identity` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:37:31.117443 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae01800-be2d-4b46-81e1-d807d7c36edb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:37:31.129131 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae01800-be2d-4b46-81e1-d807d7c36edb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:37:31.130642 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae01800-be2d-4b46-81e1-d807d7c36edb None admin] RBAC: Authorization granted {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:37:31.149958 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application [None req-4ae01800-be2d-4b46-81e1-d807d7c36edb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 08:37:31.149958 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:37:31.149958 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:37:31.149958 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:37:31.149958 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:37:31.149958 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:37:31.149958 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:37:31.149958 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:37:31.149958 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:37:31.149958 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:37:31.149958 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:37:31.149958 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:37:31.149958 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 08:37:31.149958 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 08:37:31.149958 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 08:37:31.151121 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 08:37:31.151121 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:37:31.151121 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:37:31.151121 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:37:31.151121 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:37:31.151121 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:37:31.151121 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:37:31.151121 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:37:31.151121 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application with Lock( Jul 28 08:37:31.151121 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:37:31.151121 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:37:31.151121 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:37:31.151121 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:37:31.151121 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:37:31.151121 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:37:31.151121 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:37:31.151121 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:37:31.152195 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 08:37:31.152195 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 08:37:31.152195 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 08:37:31.152195 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application Jul 28 08:37:31.152195 dv-cinder-851351-1-smb devstack@keystone.service[282899]: [pid: 282899|app: 0|req: 423/855] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 08:37:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:37:31.157359 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae01800-be2d-4b46-81e1-d807d7c36edb None admin] Authenticating user token {{(pid=282899) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:37:31.243321 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44af0647-0ca0-44d3-9dd0-9d0daf49d06c None admin] Validating token access rules against request {{(pid=282898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:37:31.280506 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e32125-407d-477d-8d69-b611401770f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:37:31.281368 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e32125-407d-477d-8d69-b611401770f4 None admin] REQUEST_METHOD: `GET` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:37:31.281608 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG dbcounter [-] [282899] Writing DB stats keystone:SELECT=100 {{(pid=282899) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:37:31.282061 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e32125-407d-477d-8d69-b611401770f4 None admin] SCRIPT_NAME: `/identity` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:37:31.282501 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e32125-407d-477d-8d69-b611401770f4 None admin] PATH_INFO: `/v3/domains` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:37:31.283302 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85e32125-407d-477d-8d69-b611401770f4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=282898) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:37:31.283771 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85e32125-407d-477d-8d69-b611401770f4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:37:31.285332 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85e32125-407d-477d-8d69-b611401770f4 None admin] RBAC: Authorization granted {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:37:31.289650 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae01800-be2d-4b46-81e1-d807d7c36edb None admin] Validating token access rules against request {{(pid=282899) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:37:31.300053 dv-cinder-851351-1-smb devstack@keystone.service[282898]: [pid: 282898|app: 0|req: 433/856] 10.222.0.42 () {56 vars in 1109 bytes} [Thu Jul 28 08:37:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:37:31.305674 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e32125-407d-477d-8d69-b611401770f4 None admin] Authenticating user token {{(pid=282898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:37:31.308969 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG dbcounter [-] [282898] Writing DB stats keystone:SELECT=100 {{(pid=282898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:37:31.333489 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84279343-3ba6-4b12-b314-ac817dd35c8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282899) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:37:31.334144 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84279343-3ba6-4b12-b314-ac817dd35c8f None admin] REQUEST_METHOD: `GET` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:37:31.334428 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84279343-3ba6-4b12-b314-ac817dd35c8f None admin] SCRIPT_NAME: `/identity` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:37:31.334705 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84279343-3ba6-4b12-b314-ac817dd35c8f None admin] PATH_INFO: `/v3/domains` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:37:31.335423 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84279343-3ba6-4b12-b314-ac817dd35c8f None admin] RBAC: Adding query filter params (name=Default) {{(pid=282899) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:37:31.335735 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84279343-3ba6-4b12-b314-ac817dd35c8f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:37:31.337928 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84279343-3ba6-4b12-b314-ac817dd35c8f None admin] RBAC: Authorization granted {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:37:31.354858 dv-cinder-851351-1-smb devstack@keystone.service[282899]: [pid: 282899|app: 0|req: 424/857] 10.222.0.42 () {56 vars in 1109 bytes} [Thu Jul 28 08:37:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 08:37:31.360610 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84279343-3ba6-4b12-b314-ac817dd35c8f None admin] Authenticating user token {{(pid=282899) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:37:31.436207 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e32125-407d-477d-8d69-b611401770f4 None admin] Validating token access rules against request {{(pid=282898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:37:31.476876 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84279343-3ba6-4b12-b314-ac817dd35c8f None admin] Validating token access rules against request {{(pid=282899) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:37:31.484099 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bbaf9a6-f56a-499d-9d47-d1a18e7a24ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:37:31.485234 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbaf9a6-f56a-499d-9d47-d1a18e7a24ea None admin] REQUEST_METHOD: `GET` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:37:31.485527 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbaf9a6-f56a-499d-9d47-d1a18e7a24ea None admin] SCRIPT_NAME: `/identity` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:37:31.485823 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbaf9a6-f56a-499d-9d47-d1a18e7a24ea None admin] PATH_INFO: `/v3/users/swift` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:37:31.494418 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bbaf9a6-f56a-499d-9d47-d1a18e7a24ea None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:37:31.495836 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bbaf9a6-f56a-499d-9d47-d1a18e7a24ea None admin] RBAC: Authorization granted {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:37:31.508256 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application [None req-9bbaf9a6-f56a-499d-9d47-d1a18e7a24ea None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 28 08:37:31.508256 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:37:31.508256 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:37:31.508256 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:37:31.508256 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:37:31.508256 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:37:31.508256 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:37:31.508256 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:37:31.508256 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:37:31.508256 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:37:31.508256 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:37:31.508256 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:37:31.508256 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 28 08:37:31.508256 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 28 08:37:31.508256 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 28 08:37:31.508256 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 28 08:37:31.509628 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:37:31.509628 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:37:31.509628 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 28 08:37:31.509628 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 08:37:31.509628 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 28 08:37:31.509628 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 08:37:31.509628 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:37:31.509628 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:37:31.509628 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:37:31.509628 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:37:31.509628 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:37:31.509628 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application with Lock( Jul 28 08:37:31.509628 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:37:31.509628 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:37:31.509628 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:37:31.509628 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:37:31.509628 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:37:31.509628 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:37:31.510759 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:37:31.510759 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:37:31.510759 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 28 08:37:31.510759 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 28 08:37:31.510759 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 28 08:37:31.510759 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 28 08:37:31.510759 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 28 08:37:31.510759 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 28 08:37:31.510759 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 28 08:37:31.510759 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application Jul 28 08:37:31.510759 dv-cinder-851351-1-smb devstack@keystone.service[282898]: [pid: 282898|app: 0|req: 434/858] 10.222.0.42 () {56 vars in 1096 bytes} [Thu Jul 28 08:37:31 2022] GET /identity/v3/users/swift => generated 83 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:37:31.510759 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0007d459-72eb-408b-b9d4-6b077c1ea5a1 None None] REQUEST_METHOD: `GET` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:37:31.511513 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0007d459-72eb-408b-b9d4-6b077c1ea5a1 None None] SCRIPT_NAME: `/identity` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:37:31.511513 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0007d459-72eb-408b-b9d4-6b077c1ea5a1 None None] PATH_INFO: `/` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:37:31.512656 dv-cinder-851351-1-smb devstack@keystone.service[282898]: [pid: 282898|app: 0|req: 435/859] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 08:37:31 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 08:37:31.517700 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0007d459-72eb-408b-b9d4-6b077c1ea5a1 None None] Authenticating user token {{(pid=282898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:37:31.520117 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9009521-35b5-4d50-a18c-c5f092e91515 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282899) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:37:31.520818 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9009521-35b5-4d50-a18c-c5f092e91515 None admin] REQUEST_METHOD: `GET` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:37:31.521106 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9009521-35b5-4d50-a18c-c5f092e91515 None admin] SCRIPT_NAME: `/identity` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:37:31.522178 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9009521-35b5-4d50-a18c-c5f092e91515 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:37:31.529695 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9009521-35b5-4d50-a18c-c5f092e91515 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:37:31.531026 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9009521-35b5-4d50-a18c-c5f092e91515 None admin] RBAC: Authorization granted {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:37:31.543621 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application [None req-a9009521-35b5-4d50-a18c-c5f092e91515 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 28 08:37:31.543621 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:37:31.543621 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:37:31.543621 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:37:31.543621 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:37:31.543621 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:37:31.543621 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:37:31.543621 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:37:31.543621 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:37:31.543621 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:37:31.543621 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:37:31.543621 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:37:31.543621 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 28 08:37:31.543621 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 28 08:37:31.543621 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 28 08:37:31.543621 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 28 08:37:31.544788 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:37:31.544788 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:37:31.544788 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 28 08:37:31.544788 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 08:37:31.544788 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 28 08:37:31.544788 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 08:37:31.544788 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:37:31.544788 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:37:31.544788 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:37:31.544788 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:37:31.544788 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:37:31.544788 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application with Lock( Jul 28 08:37:31.544788 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:37:31.544788 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:37:31.544788 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:37:31.544788 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:37:31.544788 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:37:31.544788 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:37:31.545907 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:37:31.545907 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:37:31.545907 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 28 08:37:31.545907 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 28 08:37:31.545907 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 28 08:37:31.545907 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 28 08:37:31.545907 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 28 08:37:31.545907 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 28 08:37:31.545907 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 28 08:37:31.545907 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application Jul 28 08:37:31.545907 dv-cinder-851351-1-smb devstack@keystone.service[282899]: [pid: 282899|app: 0|req: 425/860] 10.222.0.42 () {56 vars in 1117 bytes} [Thu Jul 28 08:37:31 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:37:31.546631 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837464cb-0209-49bb-926d-581e0ad9b1eb None None] REQUEST_METHOD: `POST` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:37:31.546631 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837464cb-0209-49bb-926d-581e0ad9b1eb None None] SCRIPT_NAME: `/identity` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:37:31.546631 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837464cb-0209-49bb-926d-581e0ad9b1eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:37:31.569468 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.auth.core [None req-837464cb-0209-49bb-926d-581e0ad9b1eb None None] MFA Rules not processed for user `2be990a66857410a87ffa7609aec4f7b`. Rule list: `[]` (Enabled: `True`). {{(pid=282899) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 08:37:31.571334 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.fernet_utils [None req-837464cb-0209-49bb-926d-581e0ad9b1eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=282899) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:37:31.586028 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG dbcounter [-] [282899] Writing DB stats keystone:SELECT=100 {{(pid=282899) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:37:31.594700 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG dbcounter [-] [282898] Writing DB stats keystone:SELECT=100 {{(pid=282898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:37:31.651540 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0007d459-72eb-408b-b9d4-6b077c1ea5a1 None None] Validating token access rules against request {{(pid=282898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:37:31.663960 dv-cinder-851351-1-smb devstack@keystone.service[282899]: [pid: 282899|app: 0|req: 426/861] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 08:37:31 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 08:37:31.665660 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837464cb-0209-49bb-926d-581e0ad9b1eb None None] Authenticating user token {{(pid=282899) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:37:31.709819 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5835e60e-a4e7-4020-b82a-dda4b3e1f57c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:37:31.710886 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5835e60e-a4e7-4020-b82a-dda4b3e1f57c None admin] REQUEST_METHOD: `GET` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:37:31.711399 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5835e60e-a4e7-4020-b82a-dda4b3e1f57c None admin] SCRIPT_NAME: `/identity` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:37:31.712440 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5835e60e-a4e7-4020-b82a-dda4b3e1f57c None admin] PATH_INFO: `/v3/users` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:37:31.713527 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5835e60e-a4e7-4020-b82a-dda4b3e1f57c None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=282898) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:37:31.714513 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5835e60e-a4e7-4020-b82a-dda4b3e1f57c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:37:31.716856 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5835e60e-a4e7-4020-b82a-dda4b3e1f57c None admin] RBAC: Authorization granted {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:37:31.747202 dv-cinder-851351-1-smb devstack@keystone.service[282898]: [pid: 282898|app: 0|req: 436/862] 10.222.0.42 () {56 vars in 1135 bytes} [Thu Jul 28 08:37:31 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:37:31.748856 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5835e60e-a4e7-4020-b82a-dda4b3e1f57c None admin] Authenticating user token {{(pid=282898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:37:31.774146 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837464cb-0209-49bb-926d-581e0ad9b1eb None None] Validating token access rules against request {{(pid=282899) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:37:31.823585 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de93d0e-c83a-423b-8745-5aca27e8db62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282899) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:37:31.824233 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de93d0e-c83a-423b-8745-5aca27e8db62 None admin] REQUEST_METHOD: `GET` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:37:31.824516 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de93d0e-c83a-423b-8745-5aca27e8db62 None admin] SCRIPT_NAME: `/identity` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:37:31.824952 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de93d0e-c83a-423b-8745-5aca27e8db62 None admin] PATH_INFO: `/v3/users` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:37:31.825675 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de93d0e-c83a-423b-8745-5aca27e8db62 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=282899) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:37:31.825989 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de93d0e-c83a-423b-8745-5aca27e8db62 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:37:31.827455 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de93d0e-c83a-423b-8745-5aca27e8db62 None admin] RBAC: Authorization granted {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:37:31.852330 dv-cinder-851351-1-smb devstack@keystone.service[282899]: [pid: 282899|app: 0|req: 427/863] 10.222.0.42 () {56 vars in 1149 bytes} [Thu Jul 28 08:37:31 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:37:31.852330 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de93d0e-c83a-423b-8745-5aca27e8db62 None admin] Authenticating user token {{(pid=282899) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:37:31.853651 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG dbcounter [-] [282899] Writing DB stats keystone:SELECT=100 {{(pid=282899) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:37:31.863238 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5835e60e-a4e7-4020-b82a-dda4b3e1f57c None admin] Validating token access rules against request {{(pid=282898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:37:31.889734 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG dbcounter [-] [282898] Writing DB stats keystone:SELECT=100 {{(pid=282898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:37:31.909922 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-145563c4-b626-4197-adbb-9945e4bed0e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:37:31.910976 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145563c4-b626-4197-adbb-9945e4bed0e7 None admin] REQUEST_METHOD: `POST` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:37:31.911374 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145563c4-b626-4197-adbb-9945e4bed0e7 None admin] SCRIPT_NAME: `/identity` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:37:31.911867 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145563c4-b626-4197-adbb-9945e4bed0e7 None admin] PATH_INFO: `/v3/services` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:37:31.912823 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-145563c4-b626-4197-adbb-9945e4bed0e7 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:37:31.914451 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-145563c4-b626-4197-adbb-9945e4bed0e7 None admin] RBAC: Authorization granted {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:37:31.932142 dv-cinder-851351-1-smb devstack@keystone.service[282898]: [pid: 282898|app: 0|req: 437/864] 10.222.0.42 () {60 vars in 1141 bytes} [Thu Jul 28 08:37:31 2022] POST /identity/v3/services => generated 269 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 08:37:31.933144 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-145563c4-b626-4197-adbb-9945e4bed0e7 None admin] Authenticating user token {{(pid=282898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:37:32.005573 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de93d0e-c83a-423b-8745-5aca27e8db62 None admin] Validating token access rules against request {{(pid=282899) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:37:32.065911 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-145563c4-b626-4197-adbb-9945e4bed0e7 None admin] Validating token access rules against request {{(pid=282898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:37:32.074217 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e322060a-9019-45c6-a11a-5cac1f44b08f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282899) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:37:32.075307 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e322060a-9019-45c6-a11a-5cac1f44b08f None admin] REQUEST_METHOD: `GET` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:37:32.076256 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e322060a-9019-45c6-a11a-5cac1f44b08f None admin] SCRIPT_NAME: `/identity` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:37:32.076460 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e322060a-9019-45c6-a11a-5cac1f44b08f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:37:32.107798 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da32b5be-7d1e-4f11-a7a0-fd6e49106ba0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:37:32.108869 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da32b5be-7d1e-4f11-a7a0-fd6e49106ba0 None admin] REQUEST_METHOD: `GET` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:37:32.109466 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da32b5be-7d1e-4f11-a7a0-fd6e49106ba0 None admin] SCRIPT_NAME: `/identity` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:37:32.109974 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da32b5be-7d1e-4f11-a7a0-fd6e49106ba0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:37:32.161930 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG dbcounter [-] [282898] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=282898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:37:32.194181 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da32b5be-7d1e-4f11-a7a0-fd6e49106ba0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:37:32.197059 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da32b5be-7d1e-4f11-a7a0-fd6e49106ba0 None admin] RBAC: Authorization granted {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:37:32.206902 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e322060a-9019-45c6-a11a-5cac1f44b08f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:37:32.208435 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e322060a-9019-45c6-a11a-5cac1f44b08f None admin] RBAC: Authorization granted {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:37:32.210882 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG dbcounter [-] [282899] Writing DB stats keystone:SELECT=100 {{(pid=282899) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:37:32.330104 dv-cinder-851351-1-smb devstack@keystone.service[282899]: [pid: 282899|app: 0|req: 428/865] 10.222.0.42 () {58 vars in 1282 bytes} [Thu Jul 28 08:37:31 2022] GET /identity/v3/auth/tokens => generated 1362 bytes in 482 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 28 08:37:32.336751 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e322060a-9019-45c6-a11a-5cac1f44b08f None admin] Authenticating user token {{(pid=282899) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:37:32.356821 dv-cinder-851351-1-smb devstack@keystone.service[282898]: [pid: 282898|app: 0|req: 438/866] 10.222.0.42 () {58 vars in 1282 bytes} [Thu Jul 28 08:37:31 2022] GET /identity/v3/auth/tokens => generated 1362 bytes in 420 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 28 08:37:32.363516 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da32b5be-7d1e-4f11-a7a0-fd6e49106ba0 None admin] Authenticating user token {{(pid=282898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:37:32.478291 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e322060a-9019-45c6-a11a-5cac1f44b08f None admin] Validating token access rules against request {{(pid=282899) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:37:32.480602 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG dbcounter [-] [282899] Writing DB stats keystone:SELECT=100 {{(pid=282899) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:37:32.484009 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG dbcounter [-] [282898] Writing DB stats keystone:SELECT=100 {{(pid=282898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:37:32.515261 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da32b5be-7d1e-4f11-a7a0-fd6e49106ba0 None admin] Validating token access rules against request {{(pid=282898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:37:32.519433 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d7a0a9-d890-4248-87db-4a665120e430 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282899) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:37:32.520376 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d7a0a9-d890-4248-87db-4a665120e430 None admin] REQUEST_METHOD: `GET` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:37:32.520925 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d7a0a9-d890-4248-87db-4a665120e430 None admin] SCRIPT_NAME: `/identity` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:37:32.521463 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d7a0a9-d890-4248-87db-4a665120e430 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:37:32.533409 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6d7a0a9-d890-4248-87db-4a665120e430 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:37:32.535344 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6d7a0a9-d890-4248-87db-4a665120e430 None admin] RBAC: Authorization granted {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:37:32.552320 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application [None req-f6d7a0a9-d890-4248-87db-4a665120e430 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 08:37:32.552320 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:37:32.552320 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:37:32.552320 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:37:32.552320 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:37:32.552320 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:37:32.552320 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:37:32.552320 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:37:32.552320 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:37:32.552320 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:37:32.552320 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:37:32.552320 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:37:32.552320 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 08:37:32.552320 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 08:37:32.552320 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 08:37:32.553488 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 08:37:32.553488 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:37:32.553488 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:37:32.553488 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:37:32.553488 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:37:32.553488 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:37:32.553488 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:37:32.553488 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:37:32.553488 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application with Lock( Jul 28 08:37:32.553488 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:37:32.553488 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:37:32.553488 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:37:32.553488 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:37:32.553488 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:37:32.553488 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:37:32.553488 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:37:32.553488 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:37:32.554561 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 08:37:32.554561 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 08:37:32.554561 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 08:37:32.554561 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application Jul 28 08:37:32.561375 dv-cinder-851351-1-smb devstack@keystone.service[282899]: [pid: 282899|app: 0|req: 429/867] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 08:37:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 08:37:32.563069 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d7a0a9-d890-4248-87db-4a665120e430 None admin] Authenticating user token {{(pid=282899) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:37:32.564074 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae550b3-0dde-4cdc-8203-8af524c2e1f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:37:32.564860 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae550b3-0dde-4cdc-8203-8af524c2e1f4 None admin] REQUEST_METHOD: `GET` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:37:32.565137 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae550b3-0dde-4cdc-8203-8af524c2e1f4 None admin] SCRIPT_NAME: `/identity` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:37:32.565406 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae550b3-0dde-4cdc-8203-8af524c2e1f4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:37:32.579518 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ae550b3-0dde-4cdc-8203-8af524c2e1f4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:37:32.581436 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ae550b3-0dde-4cdc-8203-8af524c2e1f4 None admin] RBAC: Authorization granted {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:37:32.601150 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application [None req-3ae550b3-0dde-4cdc-8203-8af524c2e1f4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 08:37:32.601150 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:37:32.601150 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:37:32.601150 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:37:32.601150 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:37:32.601150 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:37:32.601150 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:37:32.601150 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:37:32.601150 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:37:32.601150 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:37:32.601150 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:37:32.601150 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:37:32.601150 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 08:37:32.601150 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 08:37:32.601150 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 08:37:32.602374 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 08:37:32.602374 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:37:32.602374 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:37:32.602374 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:37:32.602374 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:37:32.602374 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:37:32.602374 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:37:32.602374 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:37:32.602374 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application with Lock( Jul 28 08:37:32.602374 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:37:32.602374 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:37:32.602374 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:37:32.602374 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:37:32.602374 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:37:32.602374 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:37:32.602374 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:37:32.602374 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:37:32.603446 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 08:37:32.603446 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 08:37:32.603446 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 08:37:32.603446 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application Jul 28 08:37:32.610457 dv-cinder-851351-1-smb devstack@keystone.service[282898]: [pid: 282898|app: 0|req: 439/868] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 08:37:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 248 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:37:32.612098 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae550b3-0dde-4cdc-8203-8af524c2e1f4 None admin] Authenticating user token {{(pid=282898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:37:32.696289 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d7a0a9-d890-4248-87db-4a665120e430 None admin] Validating token access rules against request {{(pid=282899) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:37:32.724218 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae550b3-0dde-4cdc-8203-8af524c2e1f4 None admin] Validating token access rules against request {{(pid=282898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:37:32.740295 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4950e3a4-d28a-4c71-bacc-2fe7c65b929a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282899) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:37:32.740972 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4950e3a4-d28a-4c71-bacc-2fe7c65b929a None admin] REQUEST_METHOD: `GET` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:37:32.741666 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4950e3a4-d28a-4c71-bacc-2fe7c65b929a None admin] SCRIPT_NAME: `/identity` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:37:32.741943 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4950e3a4-d28a-4c71-bacc-2fe7c65b929a None admin] PATH_INFO: `/v3/domains` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:37:32.742667 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4950e3a4-d28a-4c71-bacc-2fe7c65b929a None admin] RBAC: Adding query filter params (name=Default) {{(pid=282899) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:37:32.742977 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4950e3a4-d28a-4c71-bacc-2fe7c65b929a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:37:32.744753 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4950e3a4-d28a-4c71-bacc-2fe7c65b929a None admin] RBAC: Authorization granted {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:37:32.756204 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG dbcounter [-] [282898] Writing DB stats keystone:SELECT=100 {{(pid=282898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:37:32.765956 dv-cinder-851351-1-smb devstack@keystone.service[282899]: [pid: 282899|app: 0|req: 430/869] 10.222.0.42 () {56 vars in 1109 bytes} [Thu Jul 28 08:37:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:37:32.769301 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4950e3a4-d28a-4c71-bacc-2fe7c65b929a None admin] Authenticating user token {{(pid=282899) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:37:32.774305 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f27cc5a0-81e7-4f0b-96a7-042bede9341b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:37:32.775231 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27cc5a0-81e7-4f0b-96a7-042bede9341b None admin] REQUEST_METHOD: `GET` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:37:32.775729 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27cc5a0-81e7-4f0b-96a7-042bede9341b None admin] SCRIPT_NAME: `/identity` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:37:32.776215 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27cc5a0-81e7-4f0b-96a7-042bede9341b None admin] PATH_INFO: `/v3/domains` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:37:32.777171 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f27cc5a0-81e7-4f0b-96a7-042bede9341b None admin] RBAC: Adding query filter params (name=Default) {{(pid=282898) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:37:32.777772 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f27cc5a0-81e7-4f0b-96a7-042bede9341b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:37:32.779537 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f27cc5a0-81e7-4f0b-96a7-042bede9341b None admin] RBAC: Authorization granted {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:37:32.786464 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG dbcounter [-] [282899] Writing DB stats keystone:SELECT=100 {{(pid=282899) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:37:32.799747 dv-cinder-851351-1-smb devstack@keystone.service[282898]: [pid: 282898|app: 0|req: 440/870] 10.222.0.42 () {56 vars in 1109 bytes} [Thu Jul 28 08:37:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 08:37:32.802366 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f27cc5a0-81e7-4f0b-96a7-042bede9341b None admin] Authenticating user token {{(pid=282898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:37:32.894457 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4950e3a4-d28a-4c71-bacc-2fe7c65b929a None admin] Validating token access rules against request {{(pid=282899) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:37:32.930128 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f27cc5a0-81e7-4f0b-96a7-042bede9341b None admin] Validating token access rules against request {{(pid=282898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:37:32.933848 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d88ef8-dde6-45a9-abdc-936c911e0a2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282899) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:37:32.934846 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d88ef8-dde6-45a9-abdc-936c911e0a2e None admin] REQUEST_METHOD: `GET` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:37:32.935410 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d88ef8-dde6-45a9-abdc-936c911e0a2e None admin] SCRIPT_NAME: `/identity` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:37:32.935900 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d88ef8-dde6-45a9-abdc-936c911e0a2e None admin] PATH_INFO: `/v3/projects/service` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:37:32.945675 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79d88ef8-dde6-45a9-abdc-936c911e0a2e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:37:32.947602 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79d88ef8-dde6-45a9-abdc-936c911e0a2e None admin] RBAC: Authorization granted {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:37:32.961483 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application [None req-79d88ef8-dde6-45a9-abdc-936c911e0a2e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 08:37:32.961483 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:37:32.961483 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:37:32.961483 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:37:32.961483 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:37:32.961483 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:37:32.961483 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:37:32.961483 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:37:32.961483 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:37:32.961483 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:37:32.961483 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:37:32.961483 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:37:32.961483 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 28 08:37:32.961483 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 28 08:37:32.961483 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 28 08:37:32.962575 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 28 08:37:32.962575 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:37:32.962575 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:37:32.962575 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:37:32.962575 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:37:32.962575 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:37:32.962575 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:37:32.962575 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:37:32.962575 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application with Lock( Jul 28 08:37:32.962575 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:37:32.962575 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:37:32.962575 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:37:32.962575 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:37:32.962575 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:37:32.962575 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:37:32.962575 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:37:32.962575 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:37:32.963651 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 28 08:37:32.963651 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 28 08:37:32.963651 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 28 08:37:32.963651 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 28 08:37:32.963651 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 28 08:37:32.963651 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 28 08:37:32.963651 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 08:37:32.963651 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application Jul 28 08:37:32.970863 dv-cinder-851351-1-smb devstack@keystone.service[282899]: [pid: 282899|app: 0|req: 431/871] 10.222.0.42 () {56 vars in 1111 bytes} [Thu Jul 28 08:37:32 2022] GET /identity/v3/projects/service => generated 88 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:37:32.972738 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d88ef8-dde6-45a9-abdc-936c911e0a2e None admin] Authenticating user token {{(pid=282899) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:37:32.975196 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8386454-23f7-473b-ab66-889f5f50fb62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:37:32.976230 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8386454-23f7-473b-ab66-889f5f50fb62 None admin] REQUEST_METHOD: `GET` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:37:32.976805 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8386454-23f7-473b-ab66-889f5f50fb62 None admin] SCRIPT_NAME: `/identity` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:37:32.977345 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8386454-23f7-473b-ab66-889f5f50fb62 None admin] PATH_INFO: `/v3/projects/service` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:37:32.985401 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8386454-23f7-473b-ab66-889f5f50fb62 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:37:32.987645 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8386454-23f7-473b-ab66-889f5f50fb62 None admin] RBAC: Authorization granted {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:37:33.001018 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application [None req-f8386454-23f7-473b-ab66-889f5f50fb62 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 08:37:33.001018 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:37:33.001018 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:37:33.001018 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:37:33.001018 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:37:33.001018 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:37:33.001018 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:37:33.001018 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:37:33.001018 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:37:33.001018 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:37:33.001018 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:37:33.001018 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:37:33.001018 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 28 08:37:33.001018 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 28 08:37:33.001018 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 28 08:37:33.002189 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 28 08:37:33.002189 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:37:33.002189 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:37:33.002189 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:37:33.002189 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:37:33.002189 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:37:33.002189 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:37:33.002189 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:37:33.002189 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application with Lock( Jul 28 08:37:33.002189 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:37:33.002189 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:37:33.002189 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:37:33.002189 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:37:33.002189 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:37:33.002189 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:37:33.002189 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:37:33.002189 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:37:33.003245 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 28 08:37:33.003245 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 28 08:37:33.003245 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 28 08:37:33.003245 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 28 08:37:33.003245 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 28 08:37:33.003245 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 28 08:37:33.003245 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 08:37:33.003245 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application Jul 28 08:37:33.010753 dv-cinder-851351-1-smb devstack@keystone.service[282898]: [pid: 282898|app: 0|req: 441/872] 10.222.0.42 () {56 vars in 1111 bytes} [Thu Jul 28 08:37:32 2022] GET /identity/v3/projects/service => generated 88 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:37:33.012465 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8386454-23f7-473b-ab66-889f5f50fb62 None admin] Authenticating user token {{(pid=282898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:37:33.061254 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG dbcounter [-] [282899] Writing DB stats keystone:SELECT=100 {{(pid=282899) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:37:33.081750 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG dbcounter [-] [282898] Writing DB stats keystone:SELECT=100 {{(pid=282898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:37:33.088407 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d88ef8-dde6-45a9-abdc-936c911e0a2e None admin] Validating token access rules against request {{(pid=282899) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:37:33.129620 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6838691-dfec-45bd-b021-bf477cd2548a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282899) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:37:33.130297 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6838691-dfec-45bd-b021-bf477cd2548a None admin] REQUEST_METHOD: `GET` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:37:33.130590 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6838691-dfec-45bd-b021-bf477cd2548a None admin] SCRIPT_NAME: `/identity` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:37:33.130925 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6838691-dfec-45bd-b021-bf477cd2548a None admin] PATH_INFO: `/v3/projects` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:37:33.132045 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6838691-dfec-45bd-b021-bf477cd2548a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=282899) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:37:33.132045 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6838691-dfec-45bd-b021-bf477cd2548a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:37:33.133575 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6838691-dfec-45bd-b021-bf477cd2548a None admin] RBAC: Authorization granted {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:37:33.142619 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8386454-23f7-473b-ab66-889f5f50fb62 None admin] Validating token access rules against request {{(pid=282898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:37:33.154798 dv-cinder-851351-1-smb devstack@keystone.service[282899]: [pid: 282899|app: 0|req: 432/873] 10.222.0.42 () {56 vars in 1148 bytes} [Thu Jul 28 08:37:32 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:37:33.154798 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfeade8-fec2-41a4-aede-13cf5fd83bf4 None None] REQUEST_METHOD: `GET` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:37:33.154798 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfeade8-fec2-41a4-aede-13cf5fd83bf4 None None] SCRIPT_NAME: `/identity` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:37:33.154798 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfeade8-fec2-41a4-aede-13cf5fd83bf4 None None] PATH_INFO: `/` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:37:33.154798 dv-cinder-851351-1-smb devstack@keystone.service[282899]: [pid: 282899|app: 0|req: 433/874] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 08:37:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 08:37:33.156460 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcfeade8-fec2-41a4-aede-13cf5fd83bf4 None None] Authenticating user token {{(pid=282899) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:37:33.184576 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffebaca3-6e95-42a8-b4cf-9ff1c7f9ba17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:37:33.185421 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffebaca3-6e95-42a8-b4cf-9ff1c7f9ba17 None admin] REQUEST_METHOD: `GET` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:37:33.185770 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffebaca3-6e95-42a8-b4cf-9ff1c7f9ba17 None admin] SCRIPT_NAME: `/identity` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:37:33.186123 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffebaca3-6e95-42a8-b4cf-9ff1c7f9ba17 None admin] PATH_INFO: `/v3/projects` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:37:33.186967 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffebaca3-6e95-42a8-b4cf-9ff1c7f9ba17 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=282898) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:37:33.187347 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffebaca3-6e95-42a8-b4cf-9ff1c7f9ba17 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:37:33.188857 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffebaca3-6e95-42a8-b4cf-9ff1c7f9ba17 None admin] RBAC: Authorization granted {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:37:33.205119 dv-cinder-851351-1-smb devstack@keystone.service[282898]: [pid: 282898|app: 0|req: 442/875] 10.222.0.42 () {56 vars in 1148 bytes} [Thu Jul 28 08:37:33 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 08:37:33.206448 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410fa4b7-bf47-4f96-9534-04b2b5f834ef None None] REQUEST_METHOD: `POST` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:37:33.206735 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410fa4b7-bf47-4f96-9534-04b2b5f834ef None None] SCRIPT_NAME: `/identity` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:37:33.207013 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410fa4b7-bf47-4f96-9534-04b2b5f834ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:37:33.225258 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.auth.core [None req-410fa4b7-bf47-4f96-9534-04b2b5f834ef None None] MFA Rules not processed for user `2be990a66857410a87ffa7609aec4f7b`. Rule list: `[]` (Enabled: `True`). {{(pid=282898) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 08:37:33.226493 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.fernet_utils [None req-410fa4b7-bf47-4f96-9534-04b2b5f834ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=282898) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:37:33.278362 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcfeade8-fec2-41a4-aede-13cf5fd83bf4 None None] Validating token access rules against request {{(pid=282899) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:37:33.308834 dv-cinder-851351-1-smb devstack@keystone.service[282898]: [pid: 282898|app: 0|req: 443/876] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 08:37:33 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 08:37:33.309905 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410fa4b7-bf47-4f96-9534-04b2b5f834ef None None] Authenticating user token {{(pid=282898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:37:33.319526 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ad63b9-66c0-4870-be4e-9ba1e989c5cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282899) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:37:33.320179 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ad63b9-66c0-4870-be4e-9ba1e989c5cd None admin] REQUEST_METHOD: `GET` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:37:33.320466 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ad63b9-66c0-4870-be4e-9ba1e989c5cd None admin] SCRIPT_NAME: `/identity` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:37:33.321164 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ad63b9-66c0-4870-be4e-9ba1e989c5cd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:37:33.321604 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ad63b9-66c0-4870-be4e-9ba1e989c5cd None admin] RBAC: Adding query filter params (role.id=a0e2a00bf94d40f38629d6b5293e3aee, scope.project.id=5cde68cbfb9042dc9f36af3aacea2473, user.id=f3a6183fd2c040079951febe23234356) {{(pid=282899) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:37:33.321905 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ad63b9-66c0-4870-be4e-9ba1e989c5cd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:37:33.323367 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ad63b9-66c0-4870-be4e-9ba1e989c5cd None admin] RBAC: Authorization granted {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:37:33.325864 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG dbcounter [-] [282899] Writing DB stats keystone:SELECT=100 {{(pid=282899) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:37:33.341051 dv-cinder-851351-1-smb devstack@keystone.service[282899]: [pid: 282899|app: 0|req: 434/877] 10.222.0.42 () {56 vars in 1374 bytes} [Thu Jul 28 08:37:33 2022] GET /identity/v3/role_assignments?user.id=f3a6183fd2c040079951febe23234356&scope.project.id=5cde68cbfb9042dc9f36af3aacea2473&role.id=a0e2a00bf94d40f38629d6b5293e3aee => generated 608 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:37:33.341905 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ad63b9-66c0-4870-be4e-9ba1e989c5cd None admin] Authenticating user token {{(pid=282899) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:37:33.360407 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG dbcounter [-] [282898] Writing DB stats keystone:SELECT=100 {{(pid=282898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:37:33.483813 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410fa4b7-bf47-4f96-9534-04b2b5f834ef None None] Validating token access rules against request {{(pid=282898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:37:33.528428 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ad63b9-66c0-4870-be4e-9ba1e989c5cd None admin] Validating token access rules against request {{(pid=282899) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:37:33.543268 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9749f81-dacb-4289-b1cc-3ca7e8ecb2a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:37:33.543869 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9749f81-dacb-4289-b1cc-3ca7e8ecb2a8 None admin] REQUEST_METHOD: `GET` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:37:33.544166 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9749f81-dacb-4289-b1cc-3ca7e8ecb2a8 None admin] SCRIPT_NAME: `/identity` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:37:33.544440 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9749f81-dacb-4289-b1cc-3ca7e8ecb2a8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:37:33.546676 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9749f81-dacb-4289-b1cc-3ca7e8ecb2a8 None admin] RBAC: Adding query filter params (role.id=aa4daecf3ff74fa1b7d53041a4659723, scope.project.id=5cde68cbfb9042dc9f36af3aacea2473, user.id=f4a66540de9f46a2bc490af024cc37cd) {{(pid=282898) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:37:33.546676 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9749f81-dacb-4289-b1cc-3ca7e8ecb2a8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:37:33.547169 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9749f81-dacb-4289-b1cc-3ca7e8ecb2a8 None admin] RBAC: Authorization granted {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:37:33.557595 dv-cinder-851351-1-smb devstack@keystone.service[282898]: [pid: 282898|app: 0|req: 444/878] 10.222.0.42 () {56 vars in 1374 bytes} [Thu Jul 28 08:37:33 2022] GET /identity/v3/role_assignments?user.id=f4a66540de9f46a2bc490af024cc37cd&scope.project.id=5cde68cbfb9042dc9f36af3aacea2473&role.id=aa4daecf3ff74fa1b7d53041a4659723 => generated 608 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:37:33.585780 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651f87f9-186f-4872-b905-a7db342f6643 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282899) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:37:33.586586 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651f87f9-186f-4872-b905-a7db342f6643 None admin] REQUEST_METHOD: `GET` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:37:33.586877 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651f87f9-186f-4872-b905-a7db342f6643 None admin] SCRIPT_NAME: `/identity` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:37:33.587251 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651f87f9-186f-4872-b905-a7db342f6643 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:37:33.588043 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-651f87f9-186f-4872-b905-a7db342f6643 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:37:33.589810 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-651f87f9-186f-4872-b905-a7db342f6643 None admin] RBAC: Authorization granted {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:37:33.606088 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application [None req-651f87f9-186f-4872-b905-a7db342f6643 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 28 08:37:33.606088 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:37:33.606088 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 28 08:37:33.606088 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 28 08:37:33.606088 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 28 08:37:33.606088 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 28 08:37:33.606088 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 28 08:37:33.606088 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 08:37:33.606088 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 28 08:37:33.606088 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application Jul 28 08:37:33.606088 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 28 08:37:33.606088 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application Jul 28 08:37:33.606088 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:37:33.606088 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:37:33.606088 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:37:33.606088 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:37:33.606088 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:37:33.607729 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:37:33.607729 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:37:33.607729 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:37:33.607729 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:37:33.607729 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:37:33.607729 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:37:33.607729 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 28 08:37:33.607729 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 28 08:37:33.607729 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 28 08:37:33.607729 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 28 08:37:33.607729 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:37:33.607729 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:37:33.607729 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:37:33.607729 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:37:33.607729 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:37:33.607729 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:37:33.609944 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:37:33.609944 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application with Lock( Jul 28 08:37:33.609944 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:37:33.609944 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:37:33.609944 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:37:33.609944 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:37:33.609944 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:37:33.609944 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:37:33.609944 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:37:33.609944 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:37:33.609944 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 28 08:37:33.609944 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 08:37:33.609944 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 28 08:37:33.609944 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application Jul 28 08:37:33.609944 dv-cinder-851351-1-smb devstack@keystone.service[282899]: [pid: 282899|app: 0|req: 435/879] 10.222.0.42 () {56 vars in 1114 bytes} [Thu Jul 28 08:37:33 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 266 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:37:33.615821 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9749f81-dacb-4289-b1cc-3ca7e8ecb2a8 None admin] Authenticating user token {{(pid=282898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:37:33.773103 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9749f81-dacb-4289-b1cc-3ca7e8ecb2a8 None admin] Validating token access rules against request {{(pid=282898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:37:33.775801 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG dbcounter [-] [282898] Writing DB stats keystone:SELECT=100 {{(pid=282898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:37:33.832905 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56459e49-96b6-413a-aaa7-d6db65dbe1ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:37:33.833572 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56459e49-96b6-413a-aaa7-d6db65dbe1ac None admin] REQUEST_METHOD: `GET` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:37:33.833854 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56459e49-96b6-413a-aaa7-d6db65dbe1ac None admin] SCRIPT_NAME: `/identity` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:37:33.834125 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56459e49-96b6-413a-aaa7-d6db65dbe1ac None admin] PATH_INFO: `/v3/services` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:37:33.834898 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56459e49-96b6-413a-aaa7-d6db65dbe1ac None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=282898) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:37:33.835194 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56459e49-96b6-413a-aaa7-d6db65dbe1ac None admin] RBAC: Authorizing `identity:list_services()` {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:37:33.836688 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56459e49-96b6-413a-aaa7-d6db65dbe1ac None admin] RBAC: Authorization granted {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:37:33.843133 dv-cinder-851351-1-smb devstack@keystone.service[282898]: [pid: 282898|app: 0|req: 445/880] 10.222.0.42 () {56 vars in 1114 bytes} [Thu Jul 28 08:37:33 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:37:33.849987 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651f87f9-186f-4872-b905-a7db342f6643 None admin] Authenticating user token {{(pid=282899) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:37:33.929461 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG dbcounter [-] [282899] Writing DB stats keystone:SELECT=100 {{(pid=282899) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:37:33.983952 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651f87f9-186f-4872-b905-a7db342f6643 None admin] Validating token access rules against request {{(pid=282899) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:37:34.022521 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9910fb4-7194-489e-91d0-1cd3384262a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282899) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:37:34.023232 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9910fb4-7194-489e-91d0-1cd3384262a3 None admin] REQUEST_METHOD: `GET` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:37:34.023461 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9910fb4-7194-489e-91d0-1cd3384262a3 None admin] SCRIPT_NAME: `/identity` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:37:34.023741 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9910fb4-7194-489e-91d0-1cd3384262a3 None admin] PATH_INFO: `/v3/services` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:37:34.024446 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9910fb4-7194-489e-91d0-1cd3384262a3 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=282899) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:37:34.024782 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9910fb4-7194-489e-91d0-1cd3384262a3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:37:34.026186 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9910fb4-7194-489e-91d0-1cd3384262a3 None admin] RBAC: Authorization granted {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:37:34.032283 dv-cinder-851351-1-smb devstack@keystone.service[282899]: [pid: 282899|app: 0|req: 436/881] 10.222.0.42 () {56 vars in 1114 bytes} [Thu Jul 28 08:37:33 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:37:34.038541 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56459e49-96b6-413a-aaa7-d6db65dbe1ac None admin] Authenticating user token {{(pid=282898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:37:34.152120 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56459e49-96b6-413a-aaa7-d6db65dbe1ac None admin] Validating token access rules against request {{(pid=282898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:37:34.155328 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19519b43-7570-46c1-994f-85167e4a68d6 None None] REQUEST_METHOD: `GET` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:37:34.155620 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19519b43-7570-46c1-994f-85167e4a68d6 None None] SCRIPT_NAME: `/identity` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:37:34.155905 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19519b43-7570-46c1-994f-85167e4a68d6 None None] PATH_INFO: `/` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:37:34.157594 dv-cinder-851351-1-smb devstack@keystone.service[282899]: [pid: 282899|app: 0|req: 437/882] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 08:37:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 08:37:34.166242 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42453bd0-527d-44a8-8f6d-2e2eff3f9a82 None None] REQUEST_METHOD: `POST` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:37:34.166582 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42453bd0-527d-44a8-8f6d-2e2eff3f9a82 None None] SCRIPT_NAME: `/identity` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:37:34.166802 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42453bd0-527d-44a8-8f6d-2e2eff3f9a82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:37:34.185439 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.auth.core [None req-42453bd0-527d-44a8-8f6d-2e2eff3f9a82 None None] MFA Rules not processed for user `2be990a66857410a87ffa7609aec4f7b`. Rule list: `[]` (Enabled: `True`). {{(pid=282899) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 08:37:34.186702 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.fernet_utils [None req-42453bd0-527d-44a8-8f6d-2e2eff3f9a82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=282899) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:37:34.195657 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f195119-fd76-4338-a1d0-808c0f87a8e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:37:34.196706 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f195119-fd76-4338-a1d0-808c0f87a8e9 None admin] REQUEST_METHOD: `GET` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:37:34.197344 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f195119-fd76-4338-a1d0-808c0f87a8e9 None admin] SCRIPT_NAME: `/identity` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:37:34.197864 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f195119-fd76-4338-a1d0-808c0f87a8e9 None admin] PATH_INFO: `/v3/endpoints` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:37:34.198992 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f195119-fd76-4338-a1d0-808c0f87a8e9 None admin] RBAC: Adding query filter params (interface=public, service_id=8fe3ab4c75fd468fa34acd5ea387df1b, region_id=RegionOne) {{(pid=282898) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:37:34.199553 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f195119-fd76-4338-a1d0-808c0f87a8e9 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:37:34.201337 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f195119-fd76-4338-a1d0-808c0f87a8e9 None admin] RBAC: Authorization granted {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:37:34.208317 dv-cinder-851351-1-smb devstack@keystone.service[282898]: [pid: 282898|app: 0|req: 446/883] 10.222.0.42 () {56 vars in 1251 bytes} [Thu Jul 28 08:37:34 2022] GET /identity/v3/endpoints?service_id=8fe3ab4c75fd468fa34acd5ea387df1b&interface=public®ion_id=RegionOne => generated 194 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:37:34.214317 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f195119-fd76-4338-a1d0-808c0f87a8e9 None admin] Authenticating user token {{(pid=282898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:37:34.250081 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG dbcounter [-] [282898] Writing DB stats keystone:SELECT=100 {{(pid=282898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:37:34.280777 dv-cinder-851351-1-smb devstack@keystone.service[282899]: [pid: 282899|app: 0|req: 438/884] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 08:37:34 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 28 08:37:34.298698 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42453bd0-527d-44a8-8f6d-2e2eff3f9a82 None None] Authenticating user token {{(pid=282899) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:37:34.334736 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f195119-fd76-4338-a1d0-808c0f87a8e9 None admin] Validating token access rules against request {{(pid=282898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:37:34.370015 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG dbcounter [-] [282899] Writing DB stats keystone:SELECT=100 {{(pid=282899) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:37:34.372385 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b58aca-1a86-445e-bbf0-156548979cd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:37:34.373087 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b58aca-1a86-445e-bbf0-156548979cd5 None admin] REQUEST_METHOD: `GET` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:37:34.373371 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b58aca-1a86-445e-bbf0-156548979cd5 None admin] SCRIPT_NAME: `/identity` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:37:34.373650 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b58aca-1a86-445e-bbf0-156548979cd5 None admin] PATH_INFO: `/v3/services` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:37:34.374359 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b58aca-1a86-445e-bbf0-156548979cd5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:37:34.375719 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b58aca-1a86-445e-bbf0-156548979cd5 None admin] RBAC: Authorization granted {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:37:34.388707 dv-cinder-851351-1-smb devstack@keystone.service[282898]: [pid: 282898|app: 0|req: 447/885] 10.222.0.42 () {56 vars in 1087 bytes} [Thu Jul 28 08:37:34 2022] GET /identity/v3/services => generated 1268 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 28 08:37:34.431371 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42453bd0-527d-44a8-8f6d-2e2eff3f9a82 None None] Validating token access rules against request {{(pid=282899) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:37:34.472158 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df909e40-0f74-40de-9e1c-c8cbe8bf97e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282899) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:37:34.472925 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df909e40-0f74-40de-9e1c-c8cbe8bf97e5 None admin] REQUEST_METHOD: `GET` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:37:34.473213 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df909e40-0f74-40de-9e1c-c8cbe8bf97e5 None admin] SCRIPT_NAME: `/identity` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:37:34.473492 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df909e40-0f74-40de-9e1c-c8cbe8bf97e5 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:37:34.474150 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df909e40-0f74-40de-9e1c-c8cbe8bf97e5 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:37:34.475567 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df909e40-0f74-40de-9e1c-c8cbe8bf97e5 None admin] RBAC: Authorization granted {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:37:34.485956 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application [None req-df909e40-0f74-40de-9e1c-c8cbe8bf97e5 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 28 08:37:34.485956 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:37:34.485956 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 28 08:37:34.485956 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 28 08:37:34.485956 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 28 08:37:34.485956 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 28 08:37:34.485956 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 28 08:37:34.485956 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 08:37:34.485956 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 28 08:37:34.485956 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application Jul 28 08:37:34.485956 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 28 08:37:34.485956 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application Jul 28 08:37:34.485956 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:37:34.485956 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:37:34.485956 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:37:34.485956 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:37:34.487241 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:37:34.487241 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:37:34.487241 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:37:34.487241 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:37:34.487241 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:37:34.487241 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:37:34.487241 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:37:34.487241 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 28 08:37:34.487241 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 28 08:37:34.487241 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 28 08:37:34.487241 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 28 08:37:34.487241 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:37:34.487241 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:37:34.487241 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:37:34.487241 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:37:34.487241 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:37:34.488244 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:37:34.488244 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:37:34.488244 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application with Lock( Jul 28 08:37:34.488244 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:37:34.488244 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:37:34.488244 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:37:34.488244 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:37:34.488244 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:37:34.488244 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:37:34.488244 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:37:34.488244 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:37:34.488244 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 28 08:37:34.488244 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 08:37:34.488244 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 28 08:37:34.488244 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application Jul 28 08:37:34.488244 dv-cinder-851351-1-smb devstack@keystone.service[282899]: [pid: 282899|app: 0|req: 439/886] 10.222.0.42 () {56 vars in 1132 bytes} [Thu Jul 28 08:37:34 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 08:37:34.498073 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b58aca-1a86-445e-bbf0-156548979cd5 None admin] Authenticating user token {{(pid=282898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:37:34.608941 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG dbcounter [-] [282898] Writing DB stats keystone:SELECT=100 {{(pid=282898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:37:34.617484 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b58aca-1a86-445e-bbf0-156548979cd5 None admin] Validating token access rules against request {{(pid=282898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:37:34.654208 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c173095-6558-4192-ad25-68ace21b57dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:37:34.655294 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c173095-6558-4192-ad25-68ace21b57dc None admin] REQUEST_METHOD: `GET` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:37:34.655811 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c173095-6558-4192-ad25-68ace21b57dc None admin] SCRIPT_NAME: `/identity` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:37:34.656313 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c173095-6558-4192-ad25-68ace21b57dc None admin] PATH_INFO: `/v3/services` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:37:34.657341 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c173095-6558-4192-ad25-68ace21b57dc None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=282898) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:37:34.657920 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c173095-6558-4192-ad25-68ace21b57dc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:37:34.659724 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c173095-6558-4192-ad25-68ace21b57dc None admin] RBAC: Authorization granted {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:37:34.666549 dv-cinder-851351-1-smb devstack@keystone.service[282898]: [pid: 282898|app: 0|req: 448/887] 10.222.0.42 () {56 vars in 1126 bytes} [Thu Jul 28 08:37:34 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:37:34.673944 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df909e40-0f74-40de-9e1c-c8cbe8bf97e5 None admin] Authenticating user token {{(pid=282899) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:37:34.784505 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df909e40-0f74-40de-9e1c-c8cbe8bf97e5 None admin] Validating token access rules against request {{(pid=282899) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:37:34.808888 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG dbcounter [-] [282899] Writing DB stats keystone:SELECT=100 {{(pid=282899) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:37:34.824476 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35461564-7472-46bd-8fa2-452acba1c33c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282899) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:37:34.825157 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35461564-7472-46bd-8fa2-452acba1c33c None admin] REQUEST_METHOD: `GET` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:37:34.825447 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35461564-7472-46bd-8fa2-452acba1c33c None admin] SCRIPT_NAME: `/identity` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:37:34.825732 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35461564-7472-46bd-8fa2-452acba1c33c None admin] PATH_INFO: `/v3/services` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:37:34.826440 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35461564-7472-46bd-8fa2-452acba1c33c None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=282899) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:37:34.826755 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35461564-7472-46bd-8fa2-452acba1c33c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:37:34.828173 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35461564-7472-46bd-8fa2-452acba1c33c None admin] RBAC: Authorization granted {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:37:34.834377 dv-cinder-851351-1-smb devstack@keystone.service[282899]: [pid: 282899|app: 0|req: 440/888] 10.222.0.42 () {56 vars in 1126 bytes} [Thu Jul 28 08:37:34 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:37:34.840421 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c173095-6558-4192-ad25-68ace21b57dc None admin] Authenticating user token {{(pid=282898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:37:34.960590 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c173095-6558-4192-ad25-68ace21b57dc None admin] Validating token access rules against request {{(pid=282898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:37:34.996963 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-481e2fbb-ca48-48fb-96ac-c0ae8d8b5178 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:37:34.997606 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481e2fbb-ca48-48fb-96ac-c0ae8d8b5178 None admin] REQUEST_METHOD: `GET` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:37:34.997894 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481e2fbb-ca48-48fb-96ac-c0ae8d8b5178 None admin] SCRIPT_NAME: `/identity` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:37:34.998174 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481e2fbb-ca48-48fb-96ac-c0ae8d8b5178 None admin] PATH_INFO: `/v3/endpoints` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:37:34.999026 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-481e2fbb-ca48-48fb-96ac-c0ae8d8b5178 None admin] RBAC: Adding query filter params (interface=public, service_id=fd177179db544405b2d0d6f1fb743225, region_id=RegionOne) {{(pid=282898) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:37:34.999341 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-481e2fbb-ca48-48fb-96ac-c0ae8d8b5178 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:37:35.000832 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-481e2fbb-ca48-48fb-96ac-c0ae8d8b5178 None admin] RBAC: Authorization granted {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:37:35.006791 dv-cinder-851351-1-smb devstack@keystone.service[282898]: [pid: 282898|app: 0|req: 449/889] 10.222.0.42 () {56 vars in 1251 bytes} [Thu Jul 28 08:37:34 2022] GET /identity/v3/endpoints?service_id=fd177179db544405b2d0d6f1fb743225&interface=public®ion_id=RegionOne => generated 194 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:37:35.013858 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35461564-7472-46bd-8fa2-452acba1c33c None admin] Authenticating user token {{(pid=282899) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:37:35.123626 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35461564-7472-46bd-8fa2-452acba1c33c None admin] Validating token access rules against request {{(pid=282899) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:37:35.159279 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54056016-8cfd-4b69-92e2-c57828f3d04d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282899) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:37:35.159929 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54056016-8cfd-4b69-92e2-c57828f3d04d None admin] REQUEST_METHOD: `GET` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:37:35.160211 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54056016-8cfd-4b69-92e2-c57828f3d04d None admin] SCRIPT_NAME: `/identity` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:37:35.160494 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54056016-8cfd-4b69-92e2-c57828f3d04d None admin] PATH_INFO: `/v3/services` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:37:35.161203 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54056016-8cfd-4b69-92e2-c57828f3d04d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:37:35.162603 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54056016-8cfd-4b69-92e2-c57828f3d04d None admin] RBAC: Authorization granted {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:37:35.168847 dv-cinder-851351-1-smb devstack@keystone.service[282899]: [pid: 282899|app: 0|req: 441/890] 10.222.0.42 () {56 vars in 1087 bytes} [Thu Jul 28 08:37:35 2022] GET /identity/v3/services => generated 1268 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 08:37:35.580518 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279d718e-f5ea-43ac-9dee-234b0d6c10b9 None None] REQUEST_METHOD: `GET` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:37:35.581127 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279d718e-f5ea-43ac-9dee-234b0d6c10b9 None None] SCRIPT_NAME: `/identity` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:37:35.581127 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279d718e-f5ea-43ac-9dee-234b0d6c10b9 None None] PATH_INFO: `/` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:37:35.582742 dv-cinder-851351-1-smb devstack@keystone.service[282898]: [pid: 282898|app: 0|req: 450/891] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 08:37:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 08:37:35.588236 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f4109b-deeb-49be-87c8-5be3167c0b6a None None] REQUEST_METHOD: `POST` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:37:35.588715 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f4109b-deeb-49be-87c8-5be3167c0b6a None None] SCRIPT_NAME: `/identity` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:37:35.588824 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f4109b-deeb-49be-87c8-5be3167c0b6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:37:35.607818 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.auth.core [None req-78f4109b-deeb-49be-87c8-5be3167c0b6a None None] MFA Rules not processed for user `2be990a66857410a87ffa7609aec4f7b`. Rule list: `[]` (Enabled: `True`). {{(pid=282899) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 08:37:35.609135 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.fernet_utils [None req-78f4109b-deeb-49be-87c8-5be3167c0b6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=282899) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:37:35.660352 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG dbcounter [-] [282899] Writing DB stats keystone:SELECT=100 {{(pid=282899) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:37:35.685920 dv-cinder-851351-1-smb devstack@keystone.service[282899]: [pid: 282899|app: 0|req: 442/892] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 08:37:35 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 28 08:37:35.708061 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279d718e-f5ea-43ac-9dee-234b0d6c10b9 None None] Authenticating user token {{(pid=282898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:37:35.737718 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG dbcounter [-] [282898] Writing DB stats keystone:SELECT=100 {{(pid=282898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:37:35.791752 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5c482f-8de2-4b83-8416-ac4a944704f4 None None] REQUEST_METHOD: `GET` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:37:35.792020 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5c482f-8de2-4b83-8416-ac4a944704f4 None None] SCRIPT_NAME: `/identity` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:37:35.792301 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5c482f-8de2-4b83-8416-ac4a944704f4 None None] PATH_INFO: `/` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:37:35.803069 dv-cinder-851351-1-smb devstack@keystone.service[282899]: [pid: 282899|app: 0|req: 443/893] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 08:37:35 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 08:37:35.804867 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2675b865-e181-4636-bfea-33e534d439fb None None] REQUEST_METHOD: `POST` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:37:35.805166 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2675b865-e181-4636-bfea-33e534d439fb None None] SCRIPT_NAME: `/identity` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:37:35.805427 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2675b865-e181-4636-bfea-33e534d439fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:37:35.823227 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279d718e-f5ea-43ac-9dee-234b0d6c10b9 None None] Validating token access rules against request {{(pid=282898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:37:35.831211 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.auth.core [None req-2675b865-e181-4636-bfea-33e534d439fb None None] MFA Rules not processed for user `2be990a66857410a87ffa7609aec4f7b`. Rule list: `[]` (Enabled: `True`). {{(pid=282899) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 08:37:35.832776 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.fernet_utils [None req-2675b865-e181-4636-bfea-33e534d439fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=282899) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:37:35.865130 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3ab996-1afa-43fb-a3a1-f379ad0aea3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:37:35.866237 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3ab996-1afa-43fb-a3a1-f379ad0aea3f None admin] REQUEST_METHOD: `GET` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:37:35.866750 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3ab996-1afa-43fb-a3a1-f379ad0aea3f None admin] SCRIPT_NAME: `/identity` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:37:35.867237 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3ab996-1afa-43fb-a3a1-f379ad0aea3f None admin] PATH_INFO: `/v3/services/object-store` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:37:35.868098 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c3ab996-1afa-43fb-a3a1-f379ad0aea3f None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:37:35.869749 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c3ab996-1afa-43fb-a3a1-f379ad0aea3f None admin] RBAC: Authorization granted {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:37:35.880115 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application [None req-9c3ab996-1afa-43fb-a3a1-f379ad0aea3f None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 28 08:37:35.880115 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:37:35.880115 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 28 08:37:35.880115 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 28 08:37:35.880115 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 28 08:37:35.880115 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 28 08:37:35.880115 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 28 08:37:35.880115 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 08:37:35.880115 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 28 08:37:35.880115 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application Jul 28 08:37:35.880115 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 28 08:37:35.880115 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application Jul 28 08:37:35.880115 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:37:35.880115 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:37:35.880115 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:37:35.880115 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:37:35.880115 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:37:35.881387 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:37:35.881387 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:37:35.881387 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:37:35.881387 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:37:35.881387 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:37:35.881387 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:37:35.881387 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 28 08:37:35.881387 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 28 08:37:35.881387 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 28 08:37:35.881387 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 28 08:37:35.881387 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:37:35.881387 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:37:35.881387 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:37:35.881387 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:37:35.881387 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:37:35.881387 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:37:35.882384 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:37:35.882384 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application with Lock( Jul 28 08:37:35.882384 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:37:35.882384 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:37:35.882384 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:37:35.882384 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:37:35.882384 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:37:35.882384 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:37:35.882384 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:37:35.882384 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:37:35.882384 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 28 08:37:35.882384 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 08:37:35.882384 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 28 08:37:35.882384 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application Jul 28 08:37:35.885522 dv-cinder-851351-1-smb devstack@keystone.service[282898]: [pid: 282898|app: 0|req: 451/894] 10.222.0.42 () {56 vars in 1126 bytes} [Thu Jul 28 08:37:35 2022] GET /identity/v3/services/object-store => generated 93 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:37:35.892717 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3ab996-1afa-43fb-a3a1-f379ad0aea3f None admin] Authenticating user token {{(pid=282898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:37:35.935587 dv-cinder-851351-1-smb devstack@keystone.service[282899]: [pid: 282899|app: 0|req: 444/895] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 08:37:35 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 08:37:35.959500 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2675b865-e181-4636-bfea-33e534d439fb None None] Authenticating user token {{(pid=282899) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:37:36.007432 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG dbcounter [-] [282898] Writing DB stats keystone:SELECT=100 {{(pid=282898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:37:36.024483 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3ab996-1afa-43fb-a3a1-f379ad0aea3f None admin] Validating token access rules against request {{(pid=282898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:37:36.060301 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ee763d-c7e1-4d1d-bf44-f9bae5a52f9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:37:36.061316 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ee763d-c7e1-4d1d-bf44-f9bae5a52f9e None admin] REQUEST_METHOD: `GET` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:37:36.061805 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ee763d-c7e1-4d1d-bf44-f9bae5a52f9e None admin] SCRIPT_NAME: `/identity` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:37:36.062294 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ee763d-c7e1-4d1d-bf44-f9bae5a52f9e None admin] PATH_INFO: `/v3/services` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:37:36.063209 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3ee763d-c7e1-4d1d-bf44-f9bae5a52f9e None admin] RBAC: Adding query filter params (name=object-store) {{(pid=282898) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:37:36.063715 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3ee763d-c7e1-4d1d-bf44-f9bae5a52f9e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:37:36.065456 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3ee763d-c7e1-4d1d-bf44-f9bae5a52f9e None admin] RBAC: Authorization granted {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:37:36.071157 dv-cinder-851351-1-smb devstack@keystone.service[282898]: [pid: 282898|app: 0|req: 452/896] 10.222.0.42 () {56 vars in 1122 bytes} [Thu Jul 28 08:37:35 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 08:37:36.076865 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ee763d-c7e1-4d1d-bf44-f9bae5a52f9e None admin] Authenticating user token {{(pid=282898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:37:36.096928 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2675b865-e181-4636-bfea-33e534d439fb None None] Validating token access rules against request {{(pid=282899) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:37:36.110548 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG dbcounter [-] [282899] Writing DB stats keystone:SELECT=100 {{(pid=282899) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:37:36.146208 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0cd886-742c-495e-b105-1e36e471a193 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282899) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:37:36.147315 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0cd886-742c-495e-b105-1e36e471a193 None admin] REQUEST_METHOD: `GET` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:37:36.147720 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0cd886-742c-495e-b105-1e36e471a193 None admin] SCRIPT_NAME: `/identity` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:37:36.148697 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0cd886-742c-495e-b105-1e36e471a193 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:37:36.162816 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e0cd886-742c-495e-b105-1e36e471a193 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 08:37:36.169408 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application [None req-9e0cd886-742c-495e-b105-1e36e471a193 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 28 08:37:36.169408 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:37:36.169408 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:37:36.169408 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:37:36.169408 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:37:36.169408 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:37:36.169408 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:37:36.169408 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:37:36.169408 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:37:36.169408 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:37:36.169408 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:37:36.169408 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:37:36.169408 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 08:37:36.169408 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 08:37:36.169408 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 08:37:36.169408 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 08:37:36.170725 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 08:37:36.170725 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 08:37:36.170725 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 08:37:36.170725 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 08:37:36.170725 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:37:36.170725 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:37:36.170725 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:37:36.170725 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:37:36.170725 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:37:36.170725 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:37:36.170725 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:37:36.170725 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application with Lock( Jul 28 08:37:36.170725 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:37:36.170725 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:37:36.170725 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:37:36.170725 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:37:36.171913 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:37:36.171913 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:37:36.171913 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:37:36.171913 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:37:36.171913 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 08:37:36.171913 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 08:37:36.171913 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 08:37:36.171913 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 08:37:36.171913 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 08:37:36.171913 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 08:37:36.171913 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 28 08:37:36.171913 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application Jul 28 08:37:36.178511 dv-cinder-851351-1-smb devstack@keystone.service[282899]: [pid: 282899|app: 0|req: 445/897] 10.222.0.42 () {56 vars in 1120 bytes} [Thu Jul 28 08:37:35 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 08:37:36.180274 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0cd886-742c-495e-b105-1e36e471a193 None admin] Authenticating user token {{(pid=282899) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:37:36.192905 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ee763d-c7e1-4d1d-bf44-f9bae5a52f9e None admin] Validating token access rules against request {{(pid=282898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:37:36.231727 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-698e587f-a28d-4396-8019-e6e51c54304e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:37:36.232796 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698e587f-a28d-4396-8019-e6e51c54304e None admin] REQUEST_METHOD: `GET` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:37:36.233334 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698e587f-a28d-4396-8019-e6e51c54304e None admin] SCRIPT_NAME: `/identity` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:37:36.233824 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698e587f-a28d-4396-8019-e6e51c54304e None admin] PATH_INFO: `/v3/services` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:37:36.234753 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-698e587f-a28d-4396-8019-e6e51c54304e None admin] RBAC: Adding query filter params (type=object-store) {{(pid=282898) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:37:36.235124 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-698e587f-a28d-4396-8019-e6e51c54304e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:37:36.236689 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-698e587f-a28d-4396-8019-e6e51c54304e None admin] RBAC: Authorization granted {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:37:36.246172 dv-cinder-851351-1-smb devstack@keystone.service[282898]: [pid: 282898|app: 0|req: 453/898] 10.222.0.42 () {56 vars in 1122 bytes} [Thu Jul 28 08:37:36 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:37:36.312322 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0cd886-742c-495e-b105-1e36e471a193 None admin] Validating token access rules against request {{(pid=282899) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:37:36.354456 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5305f7ef-46d5-4bc1-a613-5a07d17fc039 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282899) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:37:36.355037 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5305f7ef-46d5-4bc1-a613-5a07d17fc039 None admin] REQUEST_METHOD: `GET` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:37:36.355322 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5305f7ef-46d5-4bc1-a613-5a07d17fc039 None admin] SCRIPT_NAME: `/identity` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:37:36.355610 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5305f7ef-46d5-4bc1-a613-5a07d17fc039 None admin] PATH_INFO: `/v3/roles` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:37:36.356381 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5305f7ef-46d5-4bc1-a613-5a07d17fc039 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=282899) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:37:36.356716 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5305f7ef-46d5-4bc1-a613-5a07d17fc039 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:37:36.358205 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5305f7ef-46d5-4bc1-a613-5a07d17fc039 None admin] RBAC: Authorization granted {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:37:36.368893 dv-cinder-851351-1-smb devstack@keystone.service[282899]: [pid: 282899|app: 0|req: 446/899] 10.222.0.42 () {56 vars in 1115 bytes} [Thu Jul 28 08:37:36 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:37:36.374542 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-698e587f-a28d-4396-8019-e6e51c54304e None admin] Authenticating user token {{(pid=282898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:37:36.393109 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG dbcounter [-] [282898] Writing DB stats keystone:SELECT=100 {{(pid=282898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:37:36.487677 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-698e587f-a28d-4396-8019-e6e51c54304e None admin] Validating token access rules against request {{(pid=282898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:37:36.523572 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a0e0f5-4d38-4d93-934d-b98df42b86d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:37:36.524229 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a0e0f5-4d38-4d93-934d-b98df42b86d9 None admin] REQUEST_METHOD: `GET` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:37:36.524508 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a0e0f5-4d38-4d93-934d-b98df42b86d9 None admin] SCRIPT_NAME: `/identity` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:37:36.524883 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a0e0f5-4d38-4d93-934d-b98df42b86d9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:37:36.536550 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2a0e0f5-4d38-4d93-934d-b98df42b86d9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:37:36.538086 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2a0e0f5-4d38-4d93-934d-b98df42b86d9 None admin] RBAC: Authorization granted {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:37:36.553286 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application [None req-e2a0e0f5-4d38-4d93-934d-b98df42b86d9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 08:37:36.553286 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:37:36.553286 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:37:36.553286 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:37:36.553286 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:37:36.553286 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:37:36.553286 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:37:36.553286 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:37:36.553286 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:37:36.553286 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:37:36.553286 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:37:36.553286 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:37:36.553286 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 08:37:36.553286 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 08:37:36.553286 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 08:37:36.554421 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 08:37:36.554421 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:37:36.554421 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:37:36.554421 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:37:36.554421 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:37:36.554421 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:37:36.554421 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:37:36.554421 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:37:36.554421 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application with Lock( Jul 28 08:37:36.554421 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:37:36.554421 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:37:36.554421 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:37:36.554421 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:37:36.554421 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:37:36.554421 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:37:36.554421 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:37:36.554421 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:37:36.555526 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 08:37:36.555526 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 08:37:36.555526 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 08:37:36.555526 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application Jul 28 08:37:36.559374 dv-cinder-851351-1-smb devstack@keystone.service[282898]: [pid: 282898|app: 0|req: 454/900] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 08:37:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:37:36.561805 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5305f7ef-46d5-4bc1-a613-5a07d17fc039 None admin] Authenticating user token {{(pid=282899) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:37:36.596920 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG dbcounter [-] [282899] Writing DB stats keystone:SELECT=100 {{(pid=282899) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:37:36.615289 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2c9296-1b68-4f4a-9cd0-f5837969aff4 None None] REQUEST_METHOD: `GET` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:37:36.615853 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2c9296-1b68-4f4a-9cd0-f5837969aff4 None None] SCRIPT_NAME: `/identity` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:37:36.615853 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2c9296-1b68-4f4a-9cd0-f5837969aff4 None None] PATH_INFO: `/` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:37:36.617518 dv-cinder-851351-1-smb devstack@keystone.service[282898]: [pid: 282898|app: 0|req: 455/901] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 08:37:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 28 08:37:36.624448 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1addc1d4-dc3b-4c43-96e2-1bb77ea2c328 None None] REQUEST_METHOD: `POST` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:37:36.625239 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1addc1d4-dc3b-4c43-96e2-1bb77ea2c328 None None] SCRIPT_NAME: `/identity` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:37:36.625618 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1addc1d4-dc3b-4c43-96e2-1bb77ea2c328 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:37:36.648964 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.auth.core [None req-1addc1d4-dc3b-4c43-96e2-1bb77ea2c328 None None] MFA Rules not processed for user `2be990a66857410a87ffa7609aec4f7b`. Rule list: `[]` (Enabled: `True`). {{(pid=282898) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 08:37:36.650402 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.fernet_utils [None req-1addc1d4-dc3b-4c43-96e2-1bb77ea2c328 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=282898) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:37:36.685698 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5305f7ef-46d5-4bc1-a613-5a07d17fc039 None admin] Validating token access rules against request {{(pid=282899) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:37:36.736636 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4575a9df-7fa6-4d68-8f4a-fcf5031114cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282899) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:37:36.737549 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4575a9df-7fa6-4d68-8f4a-fcf5031114cb None admin] REQUEST_METHOD: `GET` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:37:36.737959 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4575a9df-7fa6-4d68-8f4a-fcf5031114cb None admin] SCRIPT_NAME: `/identity` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:37:36.738436 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4575a9df-7fa6-4d68-8f4a-fcf5031114cb None admin] PATH_INFO: `/v3/domains` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:37:36.739290 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4575a9df-7fa6-4d68-8f4a-fcf5031114cb None admin] RBAC: Adding query filter params (name=Default) {{(pid=282899) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:37:36.739767 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4575a9df-7fa6-4d68-8f4a-fcf5031114cb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:37:36.741665 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4575a9df-7fa6-4d68-8f4a-fcf5031114cb None admin] RBAC: Authorization granted {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:37:36.743367 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG dbcounter [-] [282898] Writing DB stats keystone:SELECT=100 {{(pid=282898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:37:36.760779 dv-cinder-851351-1-smb devstack@keystone.service[282898]: [pid: 282898|app: 0|req: 456/902] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 08:37:36 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 28 08:37:36.775130 dv-cinder-851351-1-smb devstack@keystone.service[282899]: [pid: 282899|app: 0|req: 447/903] 10.222.0.42 () {56 vars in 1109 bytes} [Thu Jul 28 08:37:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:37:36.777061 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1addc1d4-dc3b-4c43-96e2-1bb77ea2c328 None None] Authenticating user token {{(pid=282898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:37:36.782728 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4575a9df-7fa6-4d68-8f4a-fcf5031114cb None admin] Authenticating user token {{(pid=282899) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:37:36.898363 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1addc1d4-dc3b-4c43-96e2-1bb77ea2c328 None None] Validating token access rules against request {{(pid=282898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:37:36.911058 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG dbcounter [-] [282899] Writing DB stats keystone:SELECT=100 {{(pid=282899) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:37:36.926200 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4575a9df-7fa6-4d68-8f4a-fcf5031114cb None admin] Validating token access rules against request {{(pid=282899) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:37:36.946315 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e1b741-3e7a-4321-9539-40b05f68f9e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:37:36.947349 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e1b741-3e7a-4321-9539-40b05f68f9e4 None admin] REQUEST_METHOD: `GET` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:37:36.947842 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e1b741-3e7a-4321-9539-40b05f68f9e4 None admin] SCRIPT_NAME: `/identity` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:37:36.948888 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e1b741-3e7a-4321-9539-40b05f68f9e4 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:37:36.960711 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9e1b741-3e7a-4321-9539-40b05f68f9e4 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:37:36.964526 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9e1b741-3e7a-4321-9539-40b05f68f9e4 None admin] RBAC: Authorization granted {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:37:36.968561 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b73fa736-a534-4512-a9ba-49873089e021 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282899) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:37:36.969452 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73fa736-a534-4512-a9ba-49873089e021 None admin] REQUEST_METHOD: `GET` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:37:36.969662 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73fa736-a534-4512-a9ba-49873089e021 None admin] SCRIPT_NAME: `/identity` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:37:36.969931 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73fa736-a534-4512-a9ba-49873089e021 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:37:36.971674 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b73fa736-a534-4512-a9ba-49873089e021 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:37:36.974940 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b73fa736-a534-4512-a9ba-49873089e021 None admin] RBAC: Authorization granted {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:37:36.982488 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application [None req-c9e1b741-3e7a-4321-9539-40b05f68f9e4 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 28 08:37:36.982488 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:37:36.982488 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:37:36.982488 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:37:36.982488 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:37:36.982488 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:37:36.982488 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:37:36.982488 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:37:36.982488 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:37:36.982488 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:37:36.982488 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:37:36.982488 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:37:36.982488 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 28 08:37:36.982488 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 28 08:37:36.982488 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 28 08:37:36.982488 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 28 08:37:36.983649 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:37:36.983649 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:37:36.983649 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 28 08:37:36.983649 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 08:37:36.983649 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 28 08:37:36.983649 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 08:37:36.983649 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:37:36.983649 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:37:36.983649 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:37:36.983649 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:37:36.983649 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:37:36.983649 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application with Lock( Jul 28 08:37:36.983649 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:37:36.983649 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:37:36.983649 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:37:36.983649 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:37:36.983649 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:37:36.983649 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:37:36.984816 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:37:36.984816 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:37:36.984816 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 28 08:37:36.984816 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 28 08:37:36.984816 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 28 08:37:36.984816 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 28 08:37:36.984816 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 28 08:37:36.984816 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 28 08:37:36.984816 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 28 08:37:36.984816 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application Jul 28 08:37:36.988820 dv-cinder-851351-1-smb devstack@keystone.service[282898]: [pid: 282898|app: 0|req: 457/904] 10.222.0.42 () {56 vars in 1117 bytes} [Thu Jul 28 08:37:36 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:37:36.989479 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application [None req-b73fa736-a534-4512-a9ba-49873089e021 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 28 08:37:36.989479 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:37:36.989479 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 28 08:37:36.989479 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 28 08:37:36.989479 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 28 08:37:36.989479 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 28 08:37:36.989479 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 28 08:37:36.989479 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 08:37:36.989479 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 28 08:37:36.989479 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application Jul 28 08:37:36.989479 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 28 08:37:36.989479 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application Jul 28 08:37:36.989479 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:37:36.989479 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:37:36.989479 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:37:36.989479 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:37:36.989479 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:37:36.990619 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:37:36.990619 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:37:36.990619 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:37:36.990619 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:37:36.990619 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:37:36.990619 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:37:36.990619 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 28 08:37:36.990619 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 28 08:37:36.990619 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 28 08:37:36.990619 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 28 08:37:36.990619 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:37:36.990619 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:37:36.990619 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:37:36.990619 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:37:36.990619 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:37:36.990619 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:37:36.991603 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:37:36.991603 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application with Lock( Jul 28 08:37:36.991603 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:37:36.991603 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:37:36.991603 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:37:36.991603 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:37:36.991603 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:37:36.991603 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:37:36.991603 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:37:36.991603 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:37:36.991603 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 28 08:37:36.991603 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 08:37:36.991603 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 28 08:37:36.991603 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application Jul 28 08:37:36.992483 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e1b741-3e7a-4321-9539-40b05f68f9e4 None admin] Authenticating user token {{(pid=282898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:37:36.999520 dv-cinder-851351-1-smb devstack@keystone.service[282899]: [pid: 282899|app: 0|req: 448/905] 10.222.0.42 () {56 vars in 1114 bytes} [Thu Jul 28 08:37:36 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:37:37.001401 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b73fa736-a534-4512-a9ba-49873089e021 None admin] Authenticating user token {{(pid=282899) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:37:37.067384 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG dbcounter [-] [282898] Writing DB stats keystone:SELECT=100 {{(pid=282898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:37:37.113380 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b73fa736-a534-4512-a9ba-49873089e021 None admin] Validating token access rules against request {{(pid=282899) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:37:37.116465 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e1b741-3e7a-4321-9539-40b05f68f9e4 None admin] Validating token access rules against request {{(pid=282898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:37:37.150088 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d14730-180e-44d6-8130-f7eb312bdea5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282899) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:37:37.150640 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d14730-180e-44d6-8130-f7eb312bdea5 None admin] REQUEST_METHOD: `GET` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:37:37.150926 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d14730-180e-44d6-8130-f7eb312bdea5 None admin] SCRIPT_NAME: `/identity` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:37:37.151199 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d14730-180e-44d6-8130-f7eb312bdea5 None admin] PATH_INFO: `/v3/services` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:37:37.151890 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49d14730-180e-44d6-8130-f7eb312bdea5 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=282899) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:37:37.152198 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49d14730-180e-44d6-8130-f7eb312bdea5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:37:37.153613 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49d14730-180e-44d6-8130-f7eb312bdea5 None admin] RBAC: Authorization granted {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:37:37.155567 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f27f3f57-7c70-46b4-a049-39775d6214bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:37:37.156445 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27f3f57-7c70-46b4-a049-39775d6214bc None admin] REQUEST_METHOD: `GET` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:37:37.156971 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27f3f57-7c70-46b4-a049-39775d6214bc None admin] SCRIPT_NAME: `/identity` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:37:37.157467 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27f3f57-7c70-46b4-a049-39775d6214bc None admin] PATH_INFO: `/v3/users` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:37:37.158614 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f27f3f57-7c70-46b4-a049-39775d6214bc None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=282898) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:37:37.159169 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f27f3f57-7c70-46b4-a049-39775d6214bc None admin] RBAC: Authorizing `identity:list_users()` {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:37:37.160920 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f27f3f57-7c70-46b4-a049-39775d6214bc None admin] RBAC: Authorization granted {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:37:37.163710 dv-cinder-851351-1-smb devstack@keystone.service[282899]: [pid: 282899|app: 0|req: 449/906] 10.222.0.42 () {56 vars in 1114 bytes} [Thu Jul 28 08:37:36 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:37:37.165155 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d14730-180e-44d6-8130-f7eb312bdea5 None admin] Authenticating user token {{(pid=282899) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:37:37.181722 dv-cinder-851351-1-smb devstack@keystone.service[282898]: [pid: 282898|app: 0|req: 458/907] 10.222.0.42 () {56 vars in 1149 bytes} [Thu Jul 28 08:37:36 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:37:37.189762 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f27f3f57-7c70-46b4-a049-39775d6214bc None admin] Authenticating user token {{(pid=282898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:37:37.191594 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG dbcounter [-] [282899] Writing DB stats keystone:SELECT=100 {{(pid=282899) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:37:37.281469 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d14730-180e-44d6-8130-f7eb312bdea5 None admin] Validating token access rules against request {{(pid=282899) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:37:37.298764 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f27f3f57-7c70-46b4-a049-39775d6214bc None admin] Validating token access rules against request {{(pid=282898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:37:37.314941 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG dbcounter [-] [282898] Writing DB stats keystone:SELECT=100 {{(pid=282898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:37:37.318721 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3307db78-a279-4c9c-ade0-85c17f702e02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282899) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:37:37.319362 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3307db78-a279-4c9c-ade0-85c17f702e02 None admin] REQUEST_METHOD: `GET` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:37:37.319656 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3307db78-a279-4c9c-ade0-85c17f702e02 None admin] SCRIPT_NAME: `/identity` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:37:37.319930 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3307db78-a279-4c9c-ade0-85c17f702e02 None admin] PATH_INFO: `/v3/services` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:37:37.320621 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3307db78-a279-4c9c-ade0-85c17f702e02 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=282899) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:37:37.320965 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3307db78-a279-4c9c-ade0-85c17f702e02 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:37:37.322362 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3307db78-a279-4c9c-ade0-85c17f702e02 None admin] RBAC: Authorization granted {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:37:37.327553 dv-cinder-851351-1-smb devstack@keystone.service[282899]: [pid: 282899|app: 0|req: 450/908] 10.222.0.42 () {56 vars in 1114 bytes} [Thu Jul 28 08:37:37 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:37:37.329582 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57c399f-b5d4-448f-9018-ea28175c3c71 None None] REQUEST_METHOD: `GET` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:37:37.329582 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57c399f-b5d4-448f-9018-ea28175c3c71 None None] SCRIPT_NAME: `/identity` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:37:37.329800 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57c399f-b5d4-448f-9018-ea28175c3c71 None None] PATH_INFO: `/` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:37:37.331245 dv-cinder-851351-1-smb devstack@keystone.service[282899]: [pid: 282899|app: 0|req: 451/909] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 08:37:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 08:37:37.333562 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57c399f-b5d4-448f-9018-ea28175c3c71 None None] Authenticating user token {{(pid=282899) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:37:37.342394 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2847f6e7-d58f-43d8-abbb-a2b46272aa7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:37:37.343271 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2847f6e7-d58f-43d8-abbb-a2b46272aa7e None admin] REQUEST_METHOD: `GET` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:37:37.343774 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2847f6e7-d58f-43d8-abbb-a2b46272aa7e None admin] SCRIPT_NAME: `/identity` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:37:37.344280 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2847f6e7-d58f-43d8-abbb-a2b46272aa7e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:37:37.417132 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2847f6e7-d58f-43d8-abbb-a2b46272aa7e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:37:37.418556 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2847f6e7-d58f-43d8-abbb-a2b46272aa7e None admin] RBAC: Authorization granted {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:37:37.426493 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG dbcounter [-] [282899] Writing DB stats keystone:SELECT=100 {{(pid=282899) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:37:37.448773 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57c399f-b5d4-448f-9018-ea28175c3c71 None None] Validating token access rules against request {{(pid=282899) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:37:37.488652 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc9b360c-1bde-4454-bb97-1fe8525d90e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282899) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:37:37.489315 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9b360c-1bde-4454-bb97-1fe8525d90e5 None admin] REQUEST_METHOD: `POST` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:37:37.489992 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9b360c-1bde-4454-bb97-1fe8525d90e5 None admin] SCRIPT_NAME: `/identity` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:37:37.489992 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9b360c-1bde-4454-bb97-1fe8525d90e5 None admin] PATH_INFO: `/v3/endpoints` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:37:37.490579 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc9b360c-1bde-4454-bb97-1fe8525d90e5 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:37:37.492042 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc9b360c-1bde-4454-bb97-1fe8525d90e5 None admin] RBAC: Authorization granted {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:37:37.514580 dv-cinder-851351-1-smb devstack@keystone.service[282899]: [pid: 282899|app: 0|req: 452/910] 10.222.0.42 () {60 vars in 1144 bytes} [Thu Jul 28 08:37:37 2022] POST /identity/v3/endpoints => generated 346 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 08:37:37.515744 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128847c4-22a1-4af8-a1f5-d71ee19923eb None None] REQUEST_METHOD: `POST` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:37:37.516032 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128847c4-22a1-4af8-a1f5-d71ee19923eb None None] SCRIPT_NAME: `/identity` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:37:37.516312 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128847c4-22a1-4af8-a1f5-d71ee19923eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:37:37.536387 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.auth.core [None req-128847c4-22a1-4af8-a1f5-d71ee19923eb None None] MFA Rules not processed for user `2be990a66857410a87ffa7609aec4f7b`. Rule list: `[]` (Enabled: `True`). {{(pid=282899) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 08:37:37.538445 dv-cinder-851351-1-smb devstack@keystone.service[282898]: [pid: 282898|app: 0|req: 459/911] 10.222.0.42 () {58 vars in 1282 bytes} [Thu Jul 28 08:37:37 2022] GET /identity/v3/auth/tokens => generated 1362 bytes in 349 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 28 08:37:37.538610 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.fernet_utils [None req-128847c4-22a1-4af8-a1f5-d71ee19923eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=282899) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:37:37.549819 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2847f6e7-d58f-43d8-abbb-a2b46272aa7e None admin] Authenticating user token {{(pid=282898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:37:37.571161 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG dbcounter [-] [282898] Writing DB stats keystone:SELECT=100 {{(pid=282898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:37:37.633107 dv-cinder-851351-1-smb devstack@keystone.service[282899]: [pid: 282899|app: 0|req: 453/912] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 08:37:37 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 08:37:37.655912 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-128847c4-22a1-4af8-a1f5-d71ee19923eb None None] Authenticating user token {{(pid=282899) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:37:37.711205 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2847f6e7-d58f-43d8-abbb-a2b46272aa7e None admin] Validating token access rules against request {{(pid=282898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:37:37.738070 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG dbcounter [-] [282899] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=282899) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:37:37.762774 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb203077-0132-4392-a88c-20d432005f13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:37:37.763420 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb203077-0132-4392-a88c-20d432005f13 None admin] REQUEST_METHOD: `GET` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:37:37.763705 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb203077-0132-4392-a88c-20d432005f13 None admin] SCRIPT_NAME: `/identity` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:37:37.763979 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb203077-0132-4392-a88c-20d432005f13 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:37:37.777543 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb203077-0132-4392-a88c-20d432005f13 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:37:37.778568 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb203077-0132-4392-a88c-20d432005f13 None admin] RBAC: Authorization granted {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:37:37.793672 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application [None req-fb203077-0132-4392-a88c-20d432005f13 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 08:37:37.793672 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:37:37.793672 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:37:37.793672 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:37:37.793672 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:37:37.793672 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:37:37.793672 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:37:37.793672 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:37:37.793672 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:37:37.793672 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:37:37.793672 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:37:37.793672 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:37:37.793672 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 08:37:37.793672 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 08:37:37.793672 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 08:37:37.794789 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 08:37:37.794789 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:37:37.794789 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:37:37.794789 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:37:37.794789 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:37:37.794789 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:37:37.794789 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:37:37.794789 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:37:37.794789 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application with Lock( Jul 28 08:37:37.794789 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:37:37.794789 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:37:37.794789 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:37:37.794789 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:37:37.794789 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:37:37.794789 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:37:37.794789 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:37:37.794789 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:37:37.795942 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 08:37:37.795942 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 08:37:37.795942 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 08:37:37.795942 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application Jul 28 08:37:37.795942 dv-cinder-851351-1-smb devstack@keystone.service[282898]: [pid: 282898|app: 0|req: 460/913] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 08:37:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 250 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:37:37.803171 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb203077-0132-4392-a88c-20d432005f13 None admin] Authenticating user token {{(pid=282898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:37:37.805350 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-128847c4-22a1-4af8-a1f5-d71ee19923eb None None] Validating token access rules against request {{(pid=282899) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:37:37.860316 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c199356-785c-4585-b82a-278ec4cb7b4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282899) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:37:37.861445 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c199356-785c-4585-b82a-278ec4cb7b4f None admin] REQUEST_METHOD: `GET` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:37:37.861954 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c199356-785c-4585-b82a-278ec4cb7b4f None admin] SCRIPT_NAME: `/identity` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:37:37.862575 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c199356-785c-4585-b82a-278ec4cb7b4f None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:37:37.863418 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c199356-785c-4585-b82a-278ec4cb7b4f None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:37:37.865053 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c199356-785c-4585-b82a-278ec4cb7b4f None admin] RBAC: Authorization granted {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:37:37.874935 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application [None req-2c199356-785c-4585-b82a-278ec4cb7b4f None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 28 08:37:37.874935 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:37:37.874935 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 28 08:37:37.874935 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 28 08:37:37.874935 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 28 08:37:37.874935 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 28 08:37:37.874935 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 28 08:37:37.874935 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 08:37:37.874935 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 28 08:37:37.874935 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application Jul 28 08:37:37.874935 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 28 08:37:37.874935 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application Jul 28 08:37:37.874935 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:37:37.874935 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:37:37.874935 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:37:37.874935 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:37:37.876086 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:37:37.876086 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:37:37.876086 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:37:37.876086 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:37:37.876086 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:37:37.876086 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:37:37.876086 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:37:37.876086 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 28 08:37:37.876086 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 28 08:37:37.876086 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 28 08:37:37.876086 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 28 08:37:37.876086 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:37:37.876086 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:37:37.876086 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:37:37.876086 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:37:37.876086 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:37:37.877663 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:37:37.877663 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:37:37.877663 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application with Lock( Jul 28 08:37:37.877663 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:37:37.877663 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:37:37.877663 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:37:37.877663 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:37:37.877663 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:37:37.877663 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:37:37.877663 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:37:37.877663 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:37:37.877663 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 28 08:37:37.877663 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 08:37:37.877663 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 28 08:37:37.877663 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application Jul 28 08:37:37.878682 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG dbcounter [-] [282898] Writing DB stats keystone:SELECT=100 {{(pid=282898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:37:37.880836 dv-cinder-851351-1-smb devstack@keystone.service[282899]: [pid: 282899|app: 0|req: 454/914] 10.222.0.42 () {56 vars in 1132 bytes} [Thu Jul 28 08:37:37 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:37:37.887009 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c199356-785c-4585-b82a-278ec4cb7b4f None admin] Authenticating user token {{(pid=282899) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:37:37.919763 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb203077-0132-4392-a88c-20d432005f13 None admin] Validating token access rules against request {{(pid=282898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:37:37.955862 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f618c97-5196-4ed9-ba32-e8f230e261b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:37:37.956499 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f618c97-5196-4ed9-ba32-e8f230e261b2 None admin] REQUEST_METHOD: `GET` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:37:37.956831 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f618c97-5196-4ed9-ba32-e8f230e261b2 None admin] SCRIPT_NAME: `/identity` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:37:37.957124 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f618c97-5196-4ed9-ba32-e8f230e261b2 None admin] PATH_INFO: `/v3/domains` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:37:37.957922 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f618c97-5196-4ed9-ba32-e8f230e261b2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=282898) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:37:37.958286 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f618c97-5196-4ed9-ba32-e8f230e261b2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:37:37.960554 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f618c97-5196-4ed9-ba32-e8f230e261b2 None admin] RBAC: Authorization granted {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:37:37.975791 dv-cinder-851351-1-smb devstack@keystone.service[282898]: [pid: 282898|app: 0|req: 461/915] 10.222.0.42 () {56 vars in 1109 bytes} [Thu Jul 28 08:37:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:37:37.982830 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f618c97-5196-4ed9-ba32-e8f230e261b2 None admin] Authenticating user token {{(pid=282898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:37:38.038272 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c199356-785c-4585-b82a-278ec4cb7b4f None admin] Validating token access rules against request {{(pid=282899) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:37:38.078116 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG dbcounter [-] [282899] Writing DB stats keystone:SELECT=100 {{(pid=282899) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:37:38.092442 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aebc54a6-c7be-429f-b7f1-24977784f612 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282899) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:37:38.093682 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebc54a6-c7be-429f-b7f1-24977784f612 None admin] REQUEST_METHOD: `GET` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:37:38.094580 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebc54a6-c7be-429f-b7f1-24977784f612 None admin] SCRIPT_NAME: `/identity` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:37:38.095021 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebc54a6-c7be-429f-b7f1-24977784f612 None admin] PATH_INFO: `/v3/services` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:37:38.096245 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aebc54a6-c7be-429f-b7f1-24977784f612 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=282899) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:37:38.096746 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aebc54a6-c7be-429f-b7f1-24977784f612 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:37:38.099026 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aebc54a6-c7be-429f-b7f1-24977784f612 None admin] RBAC: Authorization granted {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:37:38.105134 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f618c97-5196-4ed9-ba32-e8f230e261b2 None admin] Validating token access rules against request {{(pid=282898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:37:38.106204 dv-cinder-851351-1-smb devstack@keystone.service[282899]: [pid: 282899|app: 0|req: 455/916] 10.222.0.42 () {56 vars in 1126 bytes} [Thu Jul 28 08:37:37 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 08:37:38.112732 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aebc54a6-c7be-429f-b7f1-24977784f612 None admin] Authenticating user token {{(pid=282899) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:37:38.136720 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG dbcounter [-] [282898] Writing DB stats keystone:SELECT=100 {{(pid=282898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:37:38.153814 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c78fa795-259a-4887-bff1-f3fddbf11ebd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:37:38.155497 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78fa795-259a-4887-bff1-f3fddbf11ebd None admin] REQUEST_METHOD: `GET` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:37:38.156023 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78fa795-259a-4887-bff1-f3fddbf11ebd None admin] SCRIPT_NAME: `/identity` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:37:38.156502 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78fa795-259a-4887-bff1-f3fddbf11ebd None admin] PATH_INFO: `/v3/projects/service` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:37:38.166896 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c78fa795-259a-4887-bff1-f3fddbf11ebd None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:37:38.169467 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c78fa795-259a-4887-bff1-f3fddbf11ebd None admin] RBAC: Authorization granted {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:37:38.186289 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application [None req-c78fa795-259a-4887-bff1-f3fddbf11ebd None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 08:37:38.186289 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:37:38.186289 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:37:38.186289 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:37:38.186289 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:37:38.186289 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:37:38.186289 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:37:38.186289 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:37:38.186289 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:37:38.186289 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:37:38.186289 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:37:38.186289 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:37:38.186289 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 28 08:37:38.186289 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 28 08:37:38.186289 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 28 08:37:38.187430 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 28 08:37:38.187430 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:37:38.187430 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:37:38.187430 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:37:38.187430 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:37:38.187430 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:37:38.187430 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:37:38.187430 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:37:38.187430 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application with Lock( Jul 28 08:37:38.187430 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:37:38.187430 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:37:38.187430 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:37:38.187430 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:37:38.187430 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:37:38.187430 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:37:38.187430 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:37:38.187430 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:37:38.188496 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 28 08:37:38.188496 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 28 08:37:38.188496 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 28 08:37:38.188496 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 28 08:37:38.188496 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 28 08:37:38.188496 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 28 08:37:38.188496 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 08:37:38.188496 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application Jul 28 08:37:38.195109 dv-cinder-851351-1-smb devstack@keystone.service[282898]: [pid: 282898|app: 0|req: 462/917] 10.222.0.42 () {56 vars in 1111 bytes} [Thu Jul 28 08:37:37 2022] GET /identity/v3/projects/service => generated 88 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 08:37:38.196643 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c78fa795-259a-4887-bff1-f3fddbf11ebd None admin] Authenticating user token {{(pid=282898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:37:38.250358 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aebc54a6-c7be-429f-b7f1-24977784f612 None admin] Validating token access rules against request {{(pid=282899) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:37:38.291268 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c02f8b-748f-43c2-98bc-c66cfdc0a369 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282899) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:37:38.291926 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c02f8b-748f-43c2-98bc-c66cfdc0a369 None admin] REQUEST_METHOD: `GET` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:37:38.292217 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c02f8b-748f-43c2-98bc-c66cfdc0a369 None admin] SCRIPT_NAME: `/identity` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:37:38.292503 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c02f8b-748f-43c2-98bc-c66cfdc0a369 None admin] PATH_INFO: `/v3/services` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:37:38.293255 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c02f8b-748f-43c2-98bc-c66cfdc0a369 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=282899) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:37:38.293943 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c02f8b-748f-43c2-98bc-c66cfdc0a369 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:37:38.295708 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c02f8b-748f-43c2-98bc-c66cfdc0a369 None admin] RBAC: Authorization granted {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:37:38.302888 dv-cinder-851351-1-smb devstack@keystone.service[282899]: [pid: 282899|app: 0|req: 456/918] 10.222.0.42 () {56 vars in 1126 bytes} [Thu Jul 28 08:37:38 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:37:38.308465 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c02f8b-748f-43c2-98bc-c66cfdc0a369 None admin] Authenticating user token {{(pid=282899) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:37:38.324005 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c78fa795-259a-4887-bff1-f3fddbf11ebd None admin] Validating token access rules against request {{(pid=282898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:37:38.371336 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe94b53-0666-4f00-89b6-cd86cfffa5f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:37:38.372641 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe94b53-0666-4f00-89b6-cd86cfffa5f1 None admin] REQUEST_METHOD: `GET` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:37:38.373233 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe94b53-0666-4f00-89b6-cd86cfffa5f1 None admin] SCRIPT_NAME: `/identity` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:37:38.374265 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe94b53-0666-4f00-89b6-cd86cfffa5f1 None admin] PATH_INFO: `/v3/projects` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:37:38.375535 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbe94b53-0666-4f00-89b6-cd86cfffa5f1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=282898) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:37:38.376075 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbe94b53-0666-4f00-89b6-cd86cfffa5f1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:37:38.378463 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbe94b53-0666-4f00-89b6-cd86cfffa5f1 None admin] RBAC: Authorization granted {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:37:38.385764 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG dbcounter [-] [282899] Writing DB stats keystone:SELECT=100 {{(pid=282899) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:37:38.403068 dv-cinder-851351-1-smb devstack@keystone.service[282898]: [pid: 282898|app: 0|req: 463/919] 10.222.0.42 () {56 vars in 1148 bytes} [Thu Jul 28 08:37:38 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 08:37:38.405039 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe94b53-0666-4f00-89b6-cd86cfffa5f1 None admin] Authenticating user token {{(pid=282898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:37:38.442398 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c02f8b-748f-43c2-98bc-c66cfdc0a369 None admin] Validating token access rules against request {{(pid=282899) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:37:38.456198 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG dbcounter [-] [282898] Writing DB stats keystone:SELECT=100 {{(pid=282898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:37:38.478823 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c170bc-2222-4a90-8ef9-233b2768f1d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282899) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:37:38.479534 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c170bc-2222-4a90-8ef9-233b2768f1d4 None admin] REQUEST_METHOD: `POST` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:37:38.479866 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c170bc-2222-4a90-8ef9-233b2768f1d4 None admin] SCRIPT_NAME: `/identity` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:37:38.480147 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c170bc-2222-4a90-8ef9-233b2768f1d4 None admin] PATH_INFO: `/v3/endpoints` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:37:38.480891 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31c170bc-2222-4a90-8ef9-233b2768f1d4 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:37:38.482282 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31c170bc-2222-4a90-8ef9-233b2768f1d4 None admin] RBAC: Authorization granted {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:37:38.512580 dv-cinder-851351-1-smb devstack@keystone.service[282899]: [pid: 282899|app: 0|req: 457/920] 10.222.0.42 () {60 vars in 1144 bytes} [Thu Jul 28 08:37:38 2022] POST /identity/v3/endpoints => generated 347 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 08:37:38.512580 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098c5a01-cb86-4cdf-b482-9c20098246f0 None None] REQUEST_METHOD: `GET` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:37:38.512580 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098c5a01-cb86-4cdf-b482-9c20098246f0 None None] SCRIPT_NAME: `/identity` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:37:38.512580 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098c5a01-cb86-4cdf-b482-9c20098246f0 None None] PATH_INFO: `/` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:37:38.512580 dv-cinder-851351-1-smb devstack@keystone.service[282899]: [pid: 282899|app: 0|req: 458/921] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 08:37:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 08:37:38.515660 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370f1a2f-99ff-4b58-a859-c90c05286473 None None] REQUEST_METHOD: `POST` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:37:38.515922 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370f1a2f-99ff-4b58-a859-c90c05286473 None None] SCRIPT_NAME: `/identity` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:37:38.516224 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370f1a2f-99ff-4b58-a859-c90c05286473 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:37:38.530630 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe94b53-0666-4f00-89b6-cd86cfffa5f1 None admin] Validating token access rules against request {{(pid=282898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:37:38.540068 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.auth.core [None req-370f1a2f-99ff-4b58-a859-c90c05286473 None None] MFA Rules not processed for user `2be990a66857410a87ffa7609aec4f7b`. Rule list: `[]` (Enabled: `True`). {{(pid=282899) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 08:37:38.541720 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.fernet_utils [None req-370f1a2f-99ff-4b58-a859-c90c05286473 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=282899) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:37:38.595910 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c00c58-cedf-4190-84e4-f2390816b942 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:37:38.596953 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c00c58-cedf-4190-84e4-f2390816b942 None admin] REQUEST_METHOD: `GET` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:37:38.597483 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c00c58-cedf-4190-84e4-f2390816b942 None admin] SCRIPT_NAME: `/identity` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:37:38.598647 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c00c58-cedf-4190-84e4-f2390816b942 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:37:38.599775 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0c00c58-cedf-4190-84e4-f2390816b942 None admin] RBAC: Adding query filter params (role.id=f33deecb73a247c0b6c50fe050d1ef3a, scope.project.id=5cde68cbfb9042dc9f36af3aacea2473, user.id=f4a66540de9f46a2bc490af024cc37cd) {{(pid=282898) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:37:38.600817 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0c00c58-cedf-4190-84e4-f2390816b942 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:37:38.602368 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0c00c58-cedf-4190-84e4-f2390816b942 None admin] RBAC: Authorization granted {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:37:38.620703 dv-cinder-851351-1-smb devstack@keystone.service[282898]: [pid: 282898|app: 0|req: 464/922] 10.222.0.42 () {56 vars in 1374 bytes} [Thu Jul 28 08:37:38 2022] GET /identity/v3/role_assignments?user.id=f4a66540de9f46a2bc490af024cc37cd&scope.project.id=5cde68cbfb9042dc9f36af3aacea2473&role.id=f33deecb73a247c0b6c50fe050d1ef3a => generated 259 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:37:38.647453 dv-cinder-851351-1-smb devstack@keystone.service[282899]: [pid: 282899|app: 0|req: 459/923] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 08:37:38 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 08:37:38.672607 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c00c58-cedf-4190-84e4-f2390816b942 None admin] Authenticating user token {{(pid=282898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:37:38.798332 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c00c58-cedf-4190-84e4-f2390816b942 None admin] Validating token access rules against request {{(pid=282898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:37:38.815046 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG dbcounter [-] [282898] Writing DB stats keystone:SELECT=100 {{(pid=282898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:37:38.838343 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07daa0b7-d6a1-4743-924c-da9abc72837b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:37:38.839080 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07daa0b7-d6a1-4743-924c-da9abc72837b None admin] REQUEST_METHOD: `POST` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:37:38.839430 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07daa0b7-d6a1-4743-924c-da9abc72837b None admin] SCRIPT_NAME: `/identity` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:37:38.839774 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07daa0b7-d6a1-4743-924c-da9abc72837b None admin] PATH_INFO: `/v3/services` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:37:38.840562 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07daa0b7-d6a1-4743-924c-da9abc72837b None admin] RBAC: Authorizing `identity:create_service()` {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:37:38.842189 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07daa0b7-d6a1-4743-924c-da9abc72837b None admin] RBAC: Authorization granted {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:37:38.864883 dv-cinder-851351-1-smb devstack@keystone.service[282898]: [pid: 282898|app: 0|req: 465/924] 10.222.0.42 () {60 vars in 1141 bytes} [Thu Jul 28 08:37:38 2022] POST /identity/v3/services => generated 241 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 08:37:39.749611 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd3a5c9-7672-49af-bdd0-32cde7cbfc45 None None] REQUEST_METHOD: `GET` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:37:39.750263 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd3a5c9-7672-49af-bdd0-32cde7cbfc45 None None] SCRIPT_NAME: `/identity` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:37:39.750263 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd3a5c9-7672-49af-bdd0-32cde7cbfc45 None None] PATH_INFO: `/` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:37:39.751746 dv-cinder-851351-1-smb devstack@keystone.service[282899]: [pid: 282899|app: 0|req: 460/925] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 08:37:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 08:37:39.757869 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe9796b-4a58-41d5-88f3-8d9d9f081f3a None None] REQUEST_METHOD: `POST` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:37:39.758176 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe9796b-4a58-41d5-88f3-8d9d9f081f3a None None] SCRIPT_NAME: `/identity` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:37:39.758442 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe9796b-4a58-41d5-88f3-8d9d9f081f3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:37:39.784469 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.auth.core [None req-cbe9796b-4a58-41d5-88f3-8d9d9f081f3a None None] MFA Rules not processed for user `2be990a66857410a87ffa7609aec4f7b`. Rule list: `[]` (Enabled: `True`). {{(pid=282898) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 08:37:39.785779 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.fernet_utils [None req-cbe9796b-4a58-41d5-88f3-8d9d9f081f3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=282898) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:37:39.888796 dv-cinder-851351-1-smb devstack@keystone.service[282898]: [pid: 282898|app: 0|req: 466/926] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 08:37:39 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 08:37:39.906834 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd3a5c9-7672-49af-bdd0-32cde7cbfc45 None None] Authenticating user token {{(pid=282899) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:37:39.982760 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG dbcounter [-] [282899] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=282899) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:37:40.108056 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd3a5c9-7672-49af-bdd0-32cde7cbfc45 None None] Validating token access rules against request {{(pid=282899) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:37:40.154861 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0259769b-66ed-4300-94f3-01a1f7ca8e9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282899) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:37:40.156390 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0259769b-66ed-4300-94f3-01a1f7ca8e9a None admin] REQUEST_METHOD: `POST` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:37:40.156941 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0259769b-66ed-4300-94f3-01a1f7ca8e9a None admin] SCRIPT_NAME: `/identity` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:37:40.157697 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0259769b-66ed-4300-94f3-01a1f7ca8e9a None admin] PATH_INFO: `/v3/projects` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:37:40.159340 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0259769b-66ed-4300-94f3-01a1f7ca8e9a None admin] RBAC: Authorizing `identity:create_project()` {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:37:40.161079 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0259769b-66ed-4300-94f3-01a1f7ca8e9a None admin] RBAC: Authorization granted {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:37:40.164082 dv-cinder-851351-1-smb devstack@keystone.service[282899]: WARNING keystone.server.flask.common [None req-0259769b-66ed-4300-94f3-01a1f7ca8e9a None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Jul 28 08:37:40.189922 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.sql.core [None req-0259769b-66ed-4300-94f3-01a1f7ca8e9a None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jul 28 08:37:40.189922 dv-cinder-851351-1-smb devstack@keystone.service[282899]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Jul 28 08:37:40.189922 dv-cinder-851351-1-smb devstack@keystone.service[282899]: [parameters: {'id': '72f1b20125d44fe09fe66deb78ef1526', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Jul 28 08:37:40.189922 dv-cinder-851351-1-smb devstack@keystone.service[282899]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=282899) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jul 28 08:37:40.199429 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application [None req-0259769b-66ed-4300-94f3-01a1f7ca8e9a None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 72f1b20125d44fe09fe66deb78ef1526.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 72f1b20125d44fe09fe66deb78ef1526. Jul 28 08:37:40.199429 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:37:40.199429 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 28 08:37:40.199429 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 28 08:37:40.199429 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 28 08:37:40.199429 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 28 08:37:40.199429 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 28 08:37:40.199429 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application result = self._query(query) Jul 28 08:37:40.199429 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 28 08:37:40.199429 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application conn.query(q) Jul 28 08:37:40.199429 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 28 08:37:40.199429 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 28 08:37:40.199429 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 28 08:37:40.200540 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application result.read() Jul 28 08:37:40.200540 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 28 08:37:40.200540 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 28 08:37:40.200540 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 28 08:37:40.200540 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 28 08:37:40.200540 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 28 08:37:40.200540 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 28 08:37:40.200540 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 28 08:37:40.200540 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 28 08:37:40.200540 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jul 28 08:37:40.200540 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application Jul 28 08:37:40.200540 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jul 28 08:37:40.200540 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application Jul 28 08:37:40.200540 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:37:40.200540 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jul 28 08:37:40.200540 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jul 28 08:37:40.200540 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Jul 28 08:37:40.200540 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return project_ref.to_dict() Jul 28 08:37:40.201742 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 28 08:37:40.201742 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application next(self.gen) Jul 28 08:37:40.201742 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jul 28 08:37:40.201742 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application yield resource Jul 28 08:37:40.201742 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 28 08:37:40.201742 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application next(self.gen) Jul 28 08:37:40.201742 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jul 28 08:37:40.201742 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application self.session.rollback() Jul 28 08:37:40.201742 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 28 08:37:40.201742 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application self.force_reraise() Jul 28 08:37:40.201742 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 28 08:37:40.201742 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application raise self.value Jul 28 08:37:40.201742 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jul 28 08:37:40.201742 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jul 28 08:37:40.201742 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jul 28 08:37:40.201742 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application session.commit() Jul 28 08:37:40.201742 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jul 28 08:37:40.202850 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jul 28 08:37:40.202850 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jul 28 08:37:40.202850 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application self._prepare_impl() Jul 28 08:37:40.202850 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jul 28 08:37:40.202850 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application self.session.flush() Jul 28 08:37:40.202850 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jul 28 08:37:40.202850 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application self._flush(objects) Jul 28 08:37:40.202850 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jul 28 08:37:40.202850 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jul 28 08:37:40.202850 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jul 28 08:37:40.202850 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application compat.raise_( Jul 28 08:37:40.202850 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 28 08:37:40.202850 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application raise exception Jul 28 08:37:40.202850 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jul 28 08:37:40.202850 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application flush_context.execute() Jul 28 08:37:40.202850 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jul 28 08:37:40.202850 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application rec.execute(self) Jul 28 08:37:40.205321 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jul 28 08:37:40.205321 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jul 28 08:37:40.205321 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jul 28 08:37:40.205321 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application _emit_insert_statements( Jul 28 08:37:40.205321 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Jul 28 08:37:40.205321 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application c = connection._execute_20( Jul 28 08:37:40.205321 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jul 28 08:37:40.205321 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jul 28 08:37:40.205321 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Jul 28 08:37:40.205321 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jul 28 08:37:40.205321 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jul 28 08:37:40.205321 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application ret = self._execute_context( Jul 28 08:37:40.205321 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jul 28 08:37:40.205321 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jul 28 08:37:40.205321 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jul 28 08:37:40.206332 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jul 28 08:37:40.206332 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 28 08:37:40.206332 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application raise exception Jul 28 08:37:40.206332 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 28 08:37:40.206332 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 28 08:37:40.206332 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 28 08:37:40.206332 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 28 08:37:40.206332 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 28 08:37:40.206332 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application result = self._query(query) Jul 28 08:37:40.206332 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 28 08:37:40.206332 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application conn.query(q) Jul 28 08:37:40.206332 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 28 08:37:40.206332 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 28 08:37:40.206332 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 28 08:37:40.206332 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application result.read() Jul 28 08:37:40.206332 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 28 08:37:40.206332 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 28 08:37:40.208285 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 28 08:37:40.208285 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 28 08:37:40.208285 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 28 08:37:40.208285 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 28 08:37:40.208285 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 28 08:37:40.208285 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 28 08:37:40.208285 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jul 28 08:37:40.208285 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Jul 28 08:37:40.208285 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application [parameters: {'id': '72f1b20125d44fe09fe66deb78ef1526', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Jul 28 08:37:40.208285 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jul 28 08:37:40.208285 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application Jul 28 08:37:40.208285 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 28 08:37:40.208285 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application Jul 28 08:37:40.208285 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:37:40.208285 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Jul 28 08:37:40.210403 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Jul 28 08:37:40.210403 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jul 28 08:37:40.210403 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jul 28 08:37:40.210403 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Jul 28 08:37:40.210403 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application Jul 28 08:37:40.210403 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 28 08:37:40.210403 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application Jul 28 08:37:40.210403 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:37:40.210403 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:37:40.210403 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:37:40.210403 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:37:40.210403 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:37:40.210403 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:37:40.210403 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:37:40.210403 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:37:40.210403 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:37:40.210403 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:37:40.214575 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:37:40.214575 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Jul 28 08:37:40.214575 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Jul 28 08:37:40.214575 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:37:40.214575 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:37:40.214575 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Jul 28 08:37:40.214575 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application raise exception.Conflict( Jul 28 08:37:40.214575 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 72f1b20125d44fe09fe66deb78ef1526. Jul 28 08:37:40.214575 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application Jul 28 08:37:40.214575 dv-cinder-851351-1-smb devstack@keystone.service[282899]: [pid: 282899|app: 0|req: 461/927] 10.222.0.42 () {60 vars in 1140 bytes} [Thu Jul 28 08:37:39 2022] POST /identity/v3/projects => generated 262 bytes in 307 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:37:40.220745 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe9796b-4a58-41d5-88f3-8d9d9f081f3a None None] Authenticating user token {{(pid=282898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:37:40.326032 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG dbcounter [-] [282898] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=282898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:37:40.336784 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe9796b-4a58-41d5-88f3-8d9d9f081f3a None None] Validating token access rules against request {{(pid=282898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:37:40.379187 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4f41c7-3288-46a5-859f-d4021f2d5dfd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:37:40.379887 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4f41c7-3288-46a5-859f-d4021f2d5dfd None admin] REQUEST_METHOD: `GET` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:37:40.380166 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4f41c7-3288-46a5-859f-d4021f2d5dfd None admin] SCRIPT_NAME: `/identity` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:37:40.380486 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4f41c7-3288-46a5-859f-d4021f2d5dfd None admin] PATH_INFO: `/v3/projects/service` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:37:40.388554 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a4f41c7-3288-46a5-859f-d4021f2d5dfd None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:37:40.390334 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a4f41c7-3288-46a5-859f-d4021f2d5dfd None admin] RBAC: Authorization granted {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:37:40.403777 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application [None req-2a4f41c7-3288-46a5-859f-d4021f2d5dfd None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 08:37:40.403777 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:37:40.403777 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:37:40.403777 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:37:40.403777 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:37:40.403777 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:37:40.403777 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:37:40.403777 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:37:40.403777 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:37:40.403777 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:37:40.403777 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:37:40.403777 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:37:40.403777 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 28 08:37:40.403777 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 28 08:37:40.403777 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 28 08:37:40.404917 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 28 08:37:40.404917 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:37:40.404917 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:37:40.404917 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:37:40.404917 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:37:40.404917 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:37:40.404917 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:37:40.404917 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:37:40.404917 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application with Lock( Jul 28 08:37:40.404917 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:37:40.404917 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:37:40.404917 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:37:40.404917 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:37:40.404917 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:37:40.404917 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:37:40.404917 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:37:40.404917 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:37:40.406012 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 28 08:37:40.406012 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 28 08:37:40.406012 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 28 08:37:40.406012 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 28 08:37:40.406012 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 28 08:37:40.406012 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 28 08:37:40.406012 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 08:37:40.406012 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application Jul 28 08:37:40.408770 dv-cinder-851351-1-smb devstack@keystone.service[282898]: [pid: 282898|app: 0|req: 467/928] 10.222.0.42 () {56 vars in 1111 bytes} [Thu Jul 28 08:37:40 2022] GET /identity/v3/projects/service => generated 88 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:37:40.412332 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0259769b-66ed-4300-94f3-01a1f7ca8e9a None admin] Authenticating user token {{(pid=282899) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:37:40.524146 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG dbcounter [-] [282899] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=282899) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:37:40.529551 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0259769b-66ed-4300-94f3-01a1f7ca8e9a None admin] Validating token access rules against request {{(pid=282899) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:37:40.568586 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae77d08-4433-4f46-9f0a-f8a395fdddcb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282899) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:37:40.569430 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae77d08-4433-4f46-9f0a-f8a395fdddcb None admin] REQUEST_METHOD: `GET` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:37:40.569814 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae77d08-4433-4f46-9f0a-f8a395fdddcb None admin] SCRIPT_NAME: `/identity` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:37:40.570194 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae77d08-4433-4f46-9f0a-f8a395fdddcb None admin] PATH_INFO: `/v3/projects` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:37:40.571048 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ae77d08-4433-4f46-9f0a-f8a395fdddcb None admin] RBAC: Adding query filter params (name=service) {{(pid=282899) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:37:40.571478 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ae77d08-4433-4f46-9f0a-f8a395fdddcb None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:37:40.573299 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ae77d08-4433-4f46-9f0a-f8a395fdddcb None admin] RBAC: Authorization granted {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:37:40.596702 dv-cinder-851351-1-smb devstack@keystone.service[282899]: [pid: 282899|app: 0|req: 462/929] 10.222.0.42 () {56 vars in 1112 bytes} [Thu Jul 28 08:37:40 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:37:40.877551 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324b91b7-97e4-4758-8166-dd9e79ff4716 None None] REQUEST_METHOD: `GET` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:37:40.877972 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324b91b7-97e4-4758-8166-dd9e79ff4716 None None] SCRIPT_NAME: `/identity` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:37:40.878470 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324b91b7-97e4-4758-8166-dd9e79ff4716 None None] PATH_INFO: `/` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:37:40.881445 dv-cinder-851351-1-smb devstack@keystone.service[282898]: [pid: 282898|app: 0|req: 468/930] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 08:37:40 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 08:37:40.887316 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84be233e-e356-4757-9938-c99c251302e6 None None] REQUEST_METHOD: `POST` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:37:40.887897 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84be233e-e356-4757-9938-c99c251302e6 None None] SCRIPT_NAME: `/identity` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:37:40.888018 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84be233e-e356-4757-9938-c99c251302e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:37:40.908898 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.auth.core [None req-84be233e-e356-4757-9938-c99c251302e6 None None] MFA Rules not processed for user `2be990a66857410a87ffa7609aec4f7b`. Rule list: `[]` (Enabled: `True`). {{(pid=282899) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 08:37:40.910467 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.fernet_utils [None req-84be233e-e356-4757-9938-c99c251302e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=282899) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:37:40.983551 dv-cinder-851351-1-smb devstack@keystone.service[282899]: [pid: 282899|app: 0|req: 463/931] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 08:37:40 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 08:37:41.005649 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-324b91b7-97e4-4758-8166-dd9e79ff4716 None None] Authenticating user token {{(pid=282898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:37:41.100595 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf0c1ff-8f92-438a-9e40-6e50ef5c04c7 None None] REQUEST_METHOD: `GET` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:37:41.100991 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf0c1ff-8f92-438a-9e40-6e50ef5c04c7 None None] SCRIPT_NAME: `/identity` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:37:41.101176 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf0c1ff-8f92-438a-9e40-6e50ef5c04c7 None None] PATH_INFO: `/` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:37:41.107467 dv-cinder-851351-1-smb devstack@keystone.service[282899]: [pid: 282899|app: 0|req: 464/932] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 08:37:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 08:37:41.109408 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd15502-7d01-4daa-be29-c1580edeafea None None] REQUEST_METHOD: `POST` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:37:41.109946 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd15502-7d01-4daa-be29-c1580edeafea None None] SCRIPT_NAME: `/identity` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:37:41.110375 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd15502-7d01-4daa-be29-c1580edeafea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:37:41.128703 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-324b91b7-97e4-4758-8166-dd9e79ff4716 None None] Validating token access rules against request {{(pid=282898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:37:41.134655 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.auth.core [None req-1dd15502-7d01-4daa-be29-c1580edeafea None None] MFA Rules not processed for user `2be990a66857410a87ffa7609aec4f7b`. Rule list: `[]` (Enabled: `True`). {{(pid=282899) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 08:37:41.136274 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.fernet_utils [None req-1dd15502-7d01-4daa-be29-c1580edeafea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=282899) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:37:41.183478 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14bd587-349f-4938-bc95-050e7e01c5d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:37:41.185315 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14bd587-349f-4938-bc95-050e7e01c5d6 None admin] REQUEST_METHOD: `GET` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:37:41.186177 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14bd587-349f-4938-bc95-050e7e01c5d6 None admin] SCRIPT_NAME: `/identity` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:37:41.186928 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14bd587-349f-4938-bc95-050e7e01c5d6 None admin] PATH_INFO: `/v3/services/compute` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:37:41.188361 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c14bd587-349f-4938-bc95-050e7e01c5d6 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:37:41.191461 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c14bd587-349f-4938-bc95-050e7e01c5d6 None admin] RBAC: Authorization granted {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:37:41.209268 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application [None req-c14bd587-349f-4938-bc95-050e7e01c5d6 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jul 28 08:37:41.209268 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:37:41.209268 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 28 08:37:41.209268 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 28 08:37:41.209268 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 28 08:37:41.209268 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 28 08:37:41.209268 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 28 08:37:41.209268 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 08:37:41.209268 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 28 08:37:41.209268 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application Jul 28 08:37:41.209268 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 28 08:37:41.209268 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application Jul 28 08:37:41.209268 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:37:41.209268 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:37:41.209268 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:37:41.209268 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:37:41.209268 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:37:41.211992 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:37:41.211992 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:37:41.211992 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:37:41.211992 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:37:41.211992 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:37:41.211992 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:37:41.211992 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 28 08:37:41.211992 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 28 08:37:41.211992 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 28 08:37:41.211992 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 28 08:37:41.211992 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:37:41.211992 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:37:41.211992 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:37:41.211992 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:37:41.211992 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:37:41.211992 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:37:41.213584 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:37:41.213584 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application with Lock( Jul 28 08:37:41.213584 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:37:41.213584 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:37:41.213584 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:37:41.213584 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:37:41.213584 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:37:41.213584 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:37:41.213584 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:37:41.213584 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:37:41.213584 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 28 08:37:41.213584 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 08:37:41.213584 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 28 08:37:41.213584 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application Jul 28 08:37:41.216790 dv-cinder-851351-1-smb devstack@keystone.service[282898]: [pid: 282898|app: 0|req: 469/933] 10.222.0.42 () {56 vars in 1111 bytes} [Thu Jul 28 08:37:41 2022] GET /identity/v3/services/compute => generated 88 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:37:41.223148 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14bd587-349f-4938-bc95-050e7e01c5d6 None admin] Authenticating user token {{(pid=282898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:37:41.226927 dv-cinder-851351-1-smb devstack@keystone.service[282899]: [pid: 282899|app: 0|req: 465/934] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 08:37:41 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 08:37:41.243816 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG dbcounter [-] [282898] Writing DB stats keystone:SELECT=100 {{(pid=282898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:37:41.250064 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd15502-7d01-4daa-be29-c1580edeafea None None] Authenticating user token {{(pid=282899) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:37:41.272396 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG dbcounter [-] [282899] Writing DB stats keystone:SELECT=100 {{(pid=282899) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:37:41.335044 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14bd587-349f-4938-bc95-050e7e01c5d6 None admin] Validating token access rules against request {{(pid=282898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:37:41.362457 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd15502-7d01-4daa-be29-c1580edeafea None None] Validating token access rules against request {{(pid=282899) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:37:41.371824 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9766fd5-2e80-4ced-9ce9-f0d5a39eac97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:37:41.372464 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9766fd5-2e80-4ced-9ce9-f0d5a39eac97 None admin] REQUEST_METHOD: `GET` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:37:41.372785 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9766fd5-2e80-4ced-9ce9-f0d5a39eac97 None admin] SCRIPT_NAME: `/identity` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:37:41.373057 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9766fd5-2e80-4ced-9ce9-f0d5a39eac97 None admin] PATH_INFO: `/v3/services` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:37:41.373852 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9766fd5-2e80-4ced-9ce9-f0d5a39eac97 None admin] RBAC: Adding query filter params (name=compute) {{(pid=282898) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:37:41.374162 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9766fd5-2e80-4ced-9ce9-f0d5a39eac97 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:37:41.375565 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9766fd5-2e80-4ced-9ce9-f0d5a39eac97 None admin] RBAC: Authorization granted {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:37:41.381031 dv-cinder-851351-1-smb devstack@keystone.service[282898]: [pid: 282898|app: 0|req: 470/935] 10.222.0.42 () {56 vars in 1112 bytes} [Thu Jul 28 08:37:41 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:37:41.386922 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb391f14-5ddf-4be5-84a8-ea1a976404db None None] REQUEST_METHOD: `GET` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:37:41.387209 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb391f14-5ddf-4be5-84a8-ea1a976404db None None] SCRIPT_NAME: `/identity` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:37:41.387489 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb391f14-5ddf-4be5-84a8-ea1a976404db None None] PATH_INFO: `/` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:37:41.392741 dv-cinder-851351-1-smb devstack@keystone.service[282898]: [pid: 282898|app: 0|req: 471/936] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 08:37:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 08:37:41.392741 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb391f14-5ddf-4be5-84a8-ea1a976404db None None] Authenticating user token {{(pid=282898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:37:41.405636 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade5237c-bb6f-4e74-a2fe-96918c133700 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282899) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:37:41.406374 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade5237c-bb6f-4e74-a2fe-96918c133700 None admin] REQUEST_METHOD: `GET` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:37:41.406659 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade5237c-bb6f-4e74-a2fe-96918c133700 None admin] SCRIPT_NAME: `/identity` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:37:41.406947 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade5237c-bb6f-4e74-a2fe-96918c133700 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:37:41.418367 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ade5237c-bb6f-4e74-a2fe-96918c133700 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 08:37:41.423374 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application [None req-ade5237c-bb6f-4e74-a2fe-96918c133700 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 28 08:37:41.423374 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:37:41.423374 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:37:41.423374 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:37:41.423374 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:37:41.423374 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:37:41.423374 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:37:41.423374 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:37:41.423374 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:37:41.423374 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:37:41.423374 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:37:41.423374 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:37:41.423374 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 08:37:41.423374 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 08:37:41.423374 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 08:37:41.423374 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 08:37:41.424577 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 08:37:41.424577 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 08:37:41.424577 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 08:37:41.424577 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 08:37:41.424577 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:37:41.424577 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:37:41.424577 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:37:41.424577 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:37:41.424577 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:37:41.424577 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:37:41.424577 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:37:41.424577 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application with Lock( Jul 28 08:37:41.424577 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:37:41.424577 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:37:41.424577 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:37:41.424577 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:37:41.425792 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:37:41.425792 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:37:41.425792 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:37:41.425792 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:37:41.425792 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 08:37:41.425792 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 08:37:41.425792 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 08:37:41.425792 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 08:37:41.425792 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 08:37:41.425792 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 08:37:41.425792 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 28 08:37:41.425792 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application Jul 28 08:37:41.425792 dv-cinder-851351-1-smb devstack@keystone.service[282899]: [pid: 282899|app: 0|req: 466/937] 10.222.0.42 () {56 vars in 1120 bytes} [Thu Jul 28 08:37:41 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:37:41.427335 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf6aefb-0988-415f-90af-c0a72539b1f4 None None] REQUEST_METHOD: `POST` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:37:41.427335 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf6aefb-0988-415f-90af-c0a72539b1f4 None None] SCRIPT_NAME: `/identity` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:37:41.427335 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf6aefb-0988-415f-90af-c0a72539b1f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:37:41.446644 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.auth.core [None req-9bf6aefb-0988-415f-90af-c0a72539b1f4 None None] MFA Rules not processed for user `2be990a66857410a87ffa7609aec4f7b`. Rule list: `[]` (Enabled: `True`). {{(pid=282899) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 08:37:41.447866 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.fernet_utils [None req-9bf6aefb-0988-415f-90af-c0a72539b1f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=282899) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:37:41.487407 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG dbcounter [-] [282898] Writing DB stats keystone:SELECT=100 {{(pid=282898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:37:41.511661 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb391f14-5ddf-4be5-84a8-ea1a976404db None None] Validating token access rules against request {{(pid=282898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:37:41.528688 dv-cinder-851351-1-smb devstack@keystone.service[282899]: [pid: 282899|app: 0|req: 467/938] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 08:37:41 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 08:37:41.528688 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf6aefb-0988-415f-90af-c0a72539b1f4 None None] Authenticating user token {{(pid=282899) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:37:41.541158 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG dbcounter [-] [282899] Writing DB stats keystone:SELECT=100 {{(pid=282899) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:37:41.558937 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecac79a1-e489-4b66-b4f8-7ccc8d41211a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:37:41.559876 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecac79a1-e489-4b66-b4f8-7ccc8d41211a None admin] REQUEST_METHOD: `GET` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:37:41.560163 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecac79a1-e489-4b66-b4f8-7ccc8d41211a None admin] SCRIPT_NAME: `/identity` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:37:41.560440 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecac79a1-e489-4b66-b4f8-7ccc8d41211a None admin] PATH_INFO: `/v3/services` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:37:41.561172 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecac79a1-e489-4b66-b4f8-7ccc8d41211a None admin] RBAC: Adding query filter params (type=compute) {{(pid=282898) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:37:41.561486 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecac79a1-e489-4b66-b4f8-7ccc8d41211a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:37:41.562902 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecac79a1-e489-4b66-b4f8-7ccc8d41211a None admin] RBAC: Authorization granted {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:37:41.567883 dv-cinder-851351-1-smb devstack@keystone.service[282898]: [pid: 282898|app: 0|req: 472/939] 10.222.0.42 () {56 vars in 1112 bytes} [Thu Jul 28 08:37:41 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:37:41.568800 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecac79a1-e489-4b66-b4f8-7ccc8d41211a None admin] Authenticating user token {{(pid=282898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:37:41.670617 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf6aefb-0988-415f-90af-c0a72539b1f4 None None] Validating token access rules against request {{(pid=282899) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:37:41.699640 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecac79a1-e489-4b66-b4f8-7ccc8d41211a None admin] Validating token access rules against request {{(pid=282898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:37:41.725047 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a85208-41fb-45a4-8b8b-f7d03d7a19c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282899) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:37:41.725822 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a85208-41fb-45a4-8b8b-f7d03d7a19c2 None admin] REQUEST_METHOD: `GET` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:37:41.726174 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a85208-41fb-45a4-8b8b-f7d03d7a19c2 None admin] SCRIPT_NAME: `/identity` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:37:41.726527 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a85208-41fb-45a4-8b8b-f7d03d7a19c2 None admin] PATH_INFO: `/v3/roles` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:37:41.727376 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1a85208-41fb-45a4-8b8b-f7d03d7a19c2 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=282899) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:37:41.728285 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1a85208-41fb-45a4-8b8b-f7d03d7a19c2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:37:41.730122 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1a85208-41fb-45a4-8b8b-f7d03d7a19c2 None admin] RBAC: Authorization granted {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:37:41.746297 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc49a20-a4d0-4566-bbea-4d501224fa41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:37:41.747063 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc49a20-a4d0-4566-bbea-4d501224fa41 None admin] REQUEST_METHOD: `GET` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:37:41.747712 dv-cinder-851351-1-smb devstack@keystone.service[282899]: [pid: 282899|app: 0|req: 468/940] 10.222.0.42 () {56 vars in 1115 bytes} [Thu Jul 28 08:37:41 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:37:41.748022 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc49a20-a4d0-4566-bbea-4d501224fa41 None admin] SCRIPT_NAME: `/identity` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:37:41.748522 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc49a20-a4d0-4566-bbea-4d501224fa41 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:37:41.748744 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a85208-41fb-45a4-8b8b-f7d03d7a19c2 None admin] Authenticating user token {{(pid=282899) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:37:41.749778 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cc49a20-a4d0-4566-bbea-4d501224fa41 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:37:41.751259 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cc49a20-a4d0-4566-bbea-4d501224fa41 None admin] RBAC: Authorization granted {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:37:41.768011 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application [None req-7cc49a20-a4d0-4566-bbea-4d501224fa41 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 28 08:37:41.768011 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:37:41.768011 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 28 08:37:41.768011 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 28 08:37:41.768011 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 28 08:37:41.768011 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 28 08:37:41.768011 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 28 08:37:41.768011 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 08:37:41.768011 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 28 08:37:41.768011 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application Jul 28 08:37:41.768011 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 28 08:37:41.768011 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application Jul 28 08:37:41.768011 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:37:41.768011 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:37:41.768011 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:37:41.768011 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:37:41.768011 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:37:41.770202 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:37:41.770202 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:37:41.770202 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:37:41.770202 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:37:41.770202 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:37:41.770202 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:37:41.770202 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 28 08:37:41.770202 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 28 08:37:41.770202 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 28 08:37:41.770202 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 28 08:37:41.770202 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:37:41.770202 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:37:41.770202 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:37:41.770202 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:37:41.770202 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:37:41.770202 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:37:41.772028 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:37:41.772028 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application with Lock( Jul 28 08:37:41.772028 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:37:41.772028 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:37:41.772028 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:37:41.772028 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:37:41.772028 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:37:41.772028 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:37:41.772028 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:37:41.772028 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:37:41.772028 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 28 08:37:41.772028 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 08:37:41.772028 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 28 08:37:41.772028 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application Jul 28 08:37:41.772028 dv-cinder-851351-1-smb devstack@keystone.service[282898]: [pid: 282898|app: 0|req: 473/941] 10.222.0.42 () {56 vars in 1126 bytes} [Thu Jul 28 08:37:41 2022] GET /identity/v3/services/object-store => generated 93 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:37:41.776624 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc49a20-a4d0-4566-bbea-4d501224fa41 None admin] Authenticating user token {{(pid=282898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:37:41.789028 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG dbcounter [-] [282898] Writing DB stats keystone:SELECT=100 {{(pid=282898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:37:41.852381 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG dbcounter [-] [282899] Writing DB stats keystone:SELECT=100 {{(pid=282899) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:37:41.896608 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a85208-41fb-45a4-8b8b-f7d03d7a19c2 None admin] Validating token access rules against request {{(pid=282899) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:37:41.912653 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc49a20-a4d0-4566-bbea-4d501224fa41 None admin] Validating token access rules against request {{(pid=282898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:37:41.938949 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5559b3-8485-48ad-bfba-e74f816fb482 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282899) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:37:41.939634 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5559b3-8485-48ad-bfba-e74f816fb482 None admin] REQUEST_METHOD: `GET` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:37:41.939942 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5559b3-8485-48ad-bfba-e74f816fb482 None admin] SCRIPT_NAME: `/identity` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:37:41.940231 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5559b3-8485-48ad-bfba-e74f816fb482 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:37:41.951760 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f38a55d3-4542-4ba9-9d32-f129d853318f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:37:41.952550 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38a55d3-4542-4ba9-9d32-f129d853318f None admin] REQUEST_METHOD: `GET` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:37:41.953123 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38a55d3-4542-4ba9-9d32-f129d853318f None admin] SCRIPT_NAME: `/identity` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:37:41.953450 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38a55d3-4542-4ba9-9d32-f129d853318f None admin] PATH_INFO: `/v3/services` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:37:41.953743 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b5559b3-8485-48ad-bfba-e74f816fb482 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:37:41.954516 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f38a55d3-4542-4ba9-9d32-f129d853318f None admin] RBAC: Adding query filter params (name=object-store) {{(pid=282898) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:37:41.954863 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f38a55d3-4542-4ba9-9d32-f129d853318f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:37:41.955979 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b5559b3-8485-48ad-bfba-e74f816fb482 None admin] RBAC: Authorization granted {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:37:41.956343 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f38a55d3-4542-4ba9-9d32-f129d853318f None admin] RBAC: Authorization granted {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:37:41.962810 dv-cinder-851351-1-smb devstack@keystone.service[282898]: [pid: 282898|app: 0|req: 474/942] 10.222.0.42 () {56 vars in 1122 bytes} [Thu Jul 28 08:37:41 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:37:41.969606 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f38a55d3-4542-4ba9-9d32-f129d853318f None admin] Authenticating user token {{(pid=282898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:37:41.976964 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application [None req-1b5559b3-8485-48ad-bfba-e74f816fb482 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 08:37:41.976964 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:37:41.976964 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:37:41.976964 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:37:41.976964 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:37:41.976964 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:37:41.976964 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:37:41.976964 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:37:41.976964 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:37:41.976964 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:37:41.976964 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:37:41.976964 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:37:41.976964 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 08:37:41.976964 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 08:37:41.976964 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 08:37:41.978383 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 08:37:41.978383 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:37:41.978383 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:37:41.978383 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:37:41.978383 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:37:41.978383 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:37:41.978383 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:37:41.978383 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:37:41.978383 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application with Lock( Jul 28 08:37:41.978383 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:37:41.978383 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:37:41.978383 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:37:41.978383 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:37:41.978383 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:37:41.978383 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:37:41.978383 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:37:41.978383 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:37:41.979506 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 08:37:41.979506 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 08:37:41.979506 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 08:37:41.979506 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application Jul 28 08:37:41.983176 dv-cinder-851351-1-smb devstack@keystone.service[282899]: [pid: 282899|app: 0|req: 469/943] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 08:37:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:37:41.986242 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5559b3-8485-48ad-bfba-e74f816fb482 None admin] Authenticating user token {{(pid=282899) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:37:42.060986 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG dbcounter [-] [282898] Writing DB stats keystone:SELECT=100 {{(pid=282898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:37:42.096781 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f38a55d3-4542-4ba9-9d32-f129d853318f None admin] Validating token access rules against request {{(pid=282898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:37:42.112815 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5559b3-8485-48ad-bfba-e74f816fb482 None admin] Validating token access rules against request {{(pid=282899) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:37:42.133775 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2f75d9-3bc0-4cd7-b412-de417d4623d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:37:42.134530 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2f75d9-3bc0-4cd7-b412-de417d4623d2 None admin] REQUEST_METHOD: `GET` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:37:42.134813 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2f75d9-3bc0-4cd7-b412-de417d4623d2 None admin] SCRIPT_NAME: `/identity` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:37:42.135090 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2f75d9-3bc0-4cd7-b412-de417d4623d2 None admin] PATH_INFO: `/v3/services` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:37:42.135776 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb2f75d9-3bc0-4cd7-b412-de417d4623d2 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=282898) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:37:42.136079 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb2f75d9-3bc0-4cd7-b412-de417d4623d2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:37:42.137561 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG dbcounter [-] [282899] Writing DB stats keystone:SELECT=100 {{(pid=282899) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:37:42.138336 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb2f75d9-3bc0-4cd7-b412-de417d4623d2 None admin] RBAC: Authorization granted {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:37:42.145624 dv-cinder-851351-1-smb devstack@keystone.service[282898]: [pid: 282898|app: 0|req: 475/944] 10.222.0.42 () {56 vars in 1122 bytes} [Thu Jul 28 08:37:41 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 08:37:42.151223 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2f75d9-3bc0-4cd7-b412-de417d4623d2 None admin] Authenticating user token {{(pid=282898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:37:42.153993 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83db9b9-72a6-4b7f-a20f-1a9465ec2733 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282899) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:37:42.156129 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83db9b9-72a6-4b7f-a20f-1a9465ec2733 None admin] REQUEST_METHOD: `GET` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:37:42.156129 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83db9b9-72a6-4b7f-a20f-1a9465ec2733 None admin] SCRIPT_NAME: `/identity` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:37:42.156129 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83db9b9-72a6-4b7f-a20f-1a9465ec2733 None admin] PATH_INFO: `/v3/domains` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:37:42.156129 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d83db9b9-72a6-4b7f-a20f-1a9465ec2733 None admin] RBAC: Adding query filter params (name=Default) {{(pid=282899) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:37:42.156853 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d83db9b9-72a6-4b7f-a20f-1a9465ec2733 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:37:42.158811 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d83db9b9-72a6-4b7f-a20f-1a9465ec2733 None admin] RBAC: Authorization granted {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:37:42.175427 dv-cinder-851351-1-smb devstack@keystone.service[282899]: [pid: 282899|app: 0|req: 470/945] 10.222.0.42 () {56 vars in 1109 bytes} [Thu Jul 28 08:37:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:37:42.184645 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83db9b9-72a6-4b7f-a20f-1a9465ec2733 None admin] Authenticating user token {{(pid=282899) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:37:42.281808 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2f75d9-3bc0-4cd7-b412-de417d4623d2 None admin] Validating token access rules against request {{(pid=282898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:37:42.289727 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83db9b9-72a6-4b7f-a20f-1a9465ec2733 None admin] Validating token access rules against request {{(pid=282899) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:37:42.329351 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db51fbd5-6acb-4ce8-9570-fb50da3cebc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:37:42.330047 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db51fbd5-6acb-4ce8-9570-fb50da3cebc4 None admin] REQUEST_METHOD: `GET` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:37:42.330332 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db51fbd5-6acb-4ce8-9570-fb50da3cebc4 None admin] SCRIPT_NAME: `/identity` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:37:42.330611 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db51fbd5-6acb-4ce8-9570-fb50da3cebc4 None admin] PATH_INFO: `/v3/endpoints` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:37:42.331580 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db51fbd5-6acb-4ce8-9570-fb50da3cebc4 None admin] RBAC: Adding query filter params (interface=public, service_id=19a96342187147f18afff556f253dfec, region_id=RegionOne) {{(pid=282898) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:37:42.331896 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db51fbd5-6acb-4ce8-9570-fb50da3cebc4 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:37:42.332479 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b902df8b-689f-4a14-9273-a876a90c5bd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282899) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:37:42.333276 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b902df8b-689f-4a14-9273-a876a90c5bd3 None admin] REQUEST_METHOD: `GET` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:37:42.333417 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db51fbd5-6acb-4ce8-9570-fb50da3cebc4 None admin] RBAC: Authorization granted {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:37:42.333735 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b902df8b-689f-4a14-9273-a876a90c5bd3 None admin] SCRIPT_NAME: `/identity` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:37:42.334116 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b902df8b-689f-4a14-9273-a876a90c5bd3 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:37:42.336290 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG dbcounter [-] [282898] Writing DB stats keystone:SELECT=100 {{(pid=282898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:37:42.341168 dv-cinder-851351-1-smb devstack@keystone.service[282898]: [pid: 282898|app: 0|req: 476/946] 10.222.0.42 () {56 vars in 1251 bytes} [Thu Jul 28 08:37:42 2022] GET /identity/v3/endpoints?service_id=19a96342187147f18afff556f253dfec&interface=public®ion_id=RegionOne => generated 194 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 08:37:42.345521 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b902df8b-689f-4a14-9273-a876a90c5bd3 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:37:42.347012 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b902df8b-689f-4a14-9273-a876a90c5bd3 None admin] RBAC: Authorization granted {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:37:42.349462 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db51fbd5-6acb-4ce8-9570-fb50da3cebc4 None admin] Authenticating user token {{(pid=282898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:37:42.361094 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application [None req-b902df8b-689f-4a14-9273-a876a90c5bd3 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 28 08:37:42.361094 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:37:42.361094 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:37:42.361094 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:37:42.361094 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:37:42.361094 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:37:42.361094 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:37:42.361094 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:37:42.361094 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:37:42.361094 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:37:42.361094 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:37:42.361094 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:37:42.361094 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 28 08:37:42.361094 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 28 08:37:42.361094 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 28 08:37:42.361094 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 28 08:37:42.363189 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:37:42.363189 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:37:42.363189 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 28 08:37:42.363189 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 08:37:42.363189 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 28 08:37:42.363189 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 08:37:42.363189 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:37:42.363189 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:37:42.363189 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:37:42.363189 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:37:42.363189 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:37:42.363189 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application with Lock( Jul 28 08:37:42.363189 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:37:42.363189 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:37:42.363189 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:37:42.363189 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:37:42.363189 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:37:42.363189 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:37:42.365821 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:37:42.365821 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:37:42.365821 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 28 08:37:42.365821 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 28 08:37:42.365821 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 28 08:37:42.365821 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 28 08:37:42.365821 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 28 08:37:42.365821 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 28 08:37:42.365821 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 28 08:37:42.365821 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application Jul 28 08:37:42.367601 dv-cinder-851351-1-smb devstack@keystone.service[282899]: [pid: 282899|app: 0|req: 471/947] 10.222.0.42 () {56 vars in 1117 bytes} [Thu Jul 28 08:37:42 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:37:42.369307 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b902df8b-689f-4a14-9273-a876a90c5bd3 None admin] Authenticating user token {{(pid=282899) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:37:42.429310 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG dbcounter [-] [282899] Writing DB stats keystone:SELECT=100 {{(pid=282899) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:37:42.503192 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db51fbd5-6acb-4ce8-9570-fb50da3cebc4 None admin] Validating token access rules against request {{(pid=282898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:37:42.503462 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b902df8b-689f-4a14-9273-a876a90c5bd3 None admin] Validating token access rules against request {{(pid=282899) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:37:42.543449 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b50828f-0ff6-4b21-ba93-9759327eb101 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282899) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:37:42.544099 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b50828f-0ff6-4b21-ba93-9759327eb101 None admin] REQUEST_METHOD: `GET` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:37:42.544397 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b50828f-0ff6-4b21-ba93-9759327eb101 None admin] SCRIPT_NAME: `/identity` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:37:42.544846 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b50828f-0ff6-4b21-ba93-9759327eb101 None admin] PATH_INFO: `/v3/users` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:37:42.546003 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b50828f-0ff6-4b21-ba93-9759327eb101 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=282899) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:37:42.546379 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b50828f-0ff6-4b21-ba93-9759327eb101 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:37:42.548173 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b50828f-0ff6-4b21-ba93-9759327eb101 None admin] RBAC: Authorization granted {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:37:42.562489 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b078d9d-75ec-4e79-a081-12199e74be6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:37:42.563212 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b078d9d-75ec-4e79-a081-12199e74be6f None admin] REQUEST_METHOD: `GET` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:37:42.563560 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b078d9d-75ec-4e79-a081-12199e74be6f None admin] SCRIPT_NAME: `/identity` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:37:42.563904 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b078d9d-75ec-4e79-a081-12199e74be6f None admin] PATH_INFO: `/v3/services` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:37:42.564753 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b078d9d-75ec-4e79-a081-12199e74be6f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:37:42.566216 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b078d9d-75ec-4e79-a081-12199e74be6f None admin] RBAC: Authorization granted {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:37:42.571535 dv-cinder-851351-1-smb devstack@keystone.service[282899]: [pid: 282899|app: 0|req: 472/948] 10.222.0.42 () {56 vars in 1149 bytes} [Thu Jul 28 08:37:42 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 08:37:42.577585 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b50828f-0ff6-4b21-ba93-9759327eb101 None admin] Authenticating user token {{(pid=282899) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:37:42.578500 dv-cinder-851351-1-smb devstack@keystone.service[282898]: [pid: 282898|app: 0|req: 477/949] 10.222.0.42 () {56 vars in 1087 bytes} [Thu Jul 28 08:37:42 2022] GET /identity/v3/services => generated 1497 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 08:37:42.702487 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG dbcounter [-] [282899] Writing DB stats keystone:SELECT=100 {{(pid=282899) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:37:42.707037 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b50828f-0ff6-4b21-ba93-9759327eb101 None admin] Validating token access rules against request {{(pid=282899) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:37:42.748069 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d1bfb96-b9e4-4711-b898-684aa11db28a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282899) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:37:42.748781 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1bfb96-b9e4-4711-b898-684aa11db28a None admin] REQUEST_METHOD: `GET` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:37:42.749069 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1bfb96-b9e4-4711-b898-684aa11db28a None admin] SCRIPT_NAME: `/identity` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:37:42.749394 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1bfb96-b9e4-4711-b898-684aa11db28a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:37:42.761666 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d1bfb96-b9e4-4711-b898-684aa11db28a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:37:42.763216 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d1bfb96-b9e4-4711-b898-684aa11db28a None admin] RBAC: Authorization granted {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:37:42.780862 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application [None req-6d1bfb96-b9e4-4711-b898-684aa11db28a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 08:37:42.780862 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:37:42.780862 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:37:42.780862 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:37:42.780862 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:37:42.780862 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:37:42.780862 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:37:42.780862 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:37:42.780862 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:37:42.780862 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:37:42.780862 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:37:42.780862 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:37:42.780862 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 08:37:42.780862 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 08:37:42.780862 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 08:37:42.782014 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 08:37:42.782014 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:37:42.782014 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:37:42.782014 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:37:42.782014 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:37:42.782014 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:37:42.782014 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:37:42.782014 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:37:42.782014 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application with Lock( Jul 28 08:37:42.782014 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:37:42.782014 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:37:42.782014 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:37:42.782014 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:37:42.782014 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:37:42.782014 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:37:42.782014 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:37:42.782014 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:37:42.783340 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 08:37:42.783340 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 08:37:42.783340 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 08:37:42.783340 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application Jul 28 08:37:42.783340 dv-cinder-851351-1-smb devstack@keystone.service[282899]: [pid: 282899|app: 0|req: 473/950] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 08:37:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:37:42.788281 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b078d9d-75ec-4e79-a081-12199e74be6f None admin] Authenticating user token {{(pid=282898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:37:42.874757 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG dbcounter [-] [282898] Writing DB stats keystone:SELECT=100 {{(pid=282898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:37:42.889133 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c510beef-e385-439a-af48-babe58059635 None None] REQUEST_METHOD: `GET` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:37:42.889438 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c510beef-e385-439a-af48-babe58059635 None None] SCRIPT_NAME: `/identity` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:37:42.889698 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c510beef-e385-439a-af48-babe58059635 None None] PATH_INFO: `/` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:37:42.891441 dv-cinder-851351-1-smb devstack@keystone.service[282899]: [pid: 282899|app: 0|req: 474/951] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 08:37:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 08:37:42.897501 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e22171-dc26-410c-aad6-50d2e2696ba7 None None] REQUEST_METHOD: `POST` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:37:42.898166 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e22171-dc26-410c-aad6-50d2e2696ba7 None None] SCRIPT_NAME: `/identity` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:37:42.898166 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e22171-dc26-410c-aad6-50d2e2696ba7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:37:42.917326 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.auth.core [None req-a3e22171-dc26-410c-aad6-50d2e2696ba7 None None] MFA Rules not processed for user `2be990a66857410a87ffa7609aec4f7b`. Rule list: `[]` (Enabled: `True`). {{(pid=282899) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 08:37:42.918600 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.fernet_utils [None req-a3e22171-dc26-410c-aad6-50d2e2696ba7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=282899) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:37:42.926343 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b078d9d-75ec-4e79-a081-12199e74be6f None admin] Validating token access rules against request {{(pid=282898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:37:42.968623 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2739cc19-1618-46bb-ae2b-19c59860228b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:37:42.969810 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2739cc19-1618-46bb-ae2b-19c59860228b None admin] REQUEST_METHOD: `GET` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:37:42.970385 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2739cc19-1618-46bb-ae2b-19c59860228b None admin] SCRIPT_NAME: `/identity` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:37:42.971019 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2739cc19-1618-46bb-ae2b-19c59860228b None admin] PATH_INFO: `/v3/domains` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:37:42.971989 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2739cc19-1618-46bb-ae2b-19c59860228b None admin] RBAC: Adding query filter params (name=Default) {{(pid=282898) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:37:42.972577 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2739cc19-1618-46bb-ae2b-19c59860228b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:37:42.974407 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2739cc19-1618-46bb-ae2b-19c59860228b None admin] RBAC: Authorization granted {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:37:42.990053 dv-cinder-851351-1-smb devstack@keystone.service[282898]: [pid: 282898|app: 0|req: 478/952] 10.222.0.42 () {56 vars in 1109 bytes} [Thu Jul 28 08:37:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:37:42.996215 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2739cc19-1618-46bb-ae2b-19c59860228b None admin] Authenticating user token {{(pid=282898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:37:43.008846 dv-cinder-851351-1-smb devstack@keystone.service[282899]: [pid: 282899|app: 0|req: 475/953] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 08:37:42 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 08:37:43.027631 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e22171-dc26-410c-aad6-50d2e2696ba7 None None] Authenticating user token {{(pid=282899) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:37:43.118133 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2739cc19-1618-46bb-ae2b-19c59860228b None admin] Validating token access rules against request {{(pid=282898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:37:43.129841 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG dbcounter [-] [282899] Writing DB stats keystone:SELECT=100 {{(pid=282899) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:37:43.149184 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG dbcounter [-] [282898] Writing DB stats keystone:SELECT=100 {{(pid=282898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:37:43.160417 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e22171-dc26-410c-aad6-50d2e2696ba7 None None] Validating token access rules against request {{(pid=282899) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:37:43.165738 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2dd4b21-e0ba-4f2f-8184-0237a86f0f4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:37:43.166780 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2dd4b21-e0ba-4f2f-8184-0237a86f0f4a None admin] REQUEST_METHOD: `GET` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:37:43.167314 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2dd4b21-e0ba-4f2f-8184-0237a86f0f4a None admin] SCRIPT_NAME: `/identity` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:37:43.167818 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2dd4b21-e0ba-4f2f-8184-0237a86f0f4a None admin] PATH_INFO: `/v3/projects/service` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:37:43.176286 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2dd4b21-e0ba-4f2f-8184-0237a86f0f4a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:37:43.178416 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2dd4b21-e0ba-4f2f-8184-0237a86f0f4a None admin] RBAC: Authorization granted {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:37:43.196793 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application [None req-d2dd4b21-e0ba-4f2f-8184-0237a86f0f4a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 08:37:43.196793 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:37:43.196793 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:37:43.196793 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:37:43.196793 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:37:43.196793 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:37:43.196793 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:37:43.196793 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:37:43.196793 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:37:43.196793 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:37:43.196793 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:37:43.196793 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:37:43.196793 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 28 08:37:43.196793 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 28 08:37:43.196793 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 28 08:37:43.197984 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 28 08:37:43.197984 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:37:43.197984 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:37:43.197984 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:37:43.197984 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:37:43.197984 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:37:43.197984 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:37:43.197984 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:37:43.197984 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application with Lock( Jul 28 08:37:43.197984 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:37:43.197984 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:37:43.197984 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:37:43.197984 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:37:43.197984 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:37:43.197984 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:37:43.197984 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:37:43.197984 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:37:43.199191 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 28 08:37:43.199191 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 28 08:37:43.199191 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 28 08:37:43.199191 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 28 08:37:43.199191 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 28 08:37:43.199191 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 28 08:37:43.199191 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 08:37:43.199191 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application Jul 28 08:37:43.202963 dv-cinder-851351-1-smb devstack@keystone.service[282898]: [pid: 282898|app: 0|req: 479/954] 10.222.0.42 () {56 vars in 1111 bytes} [Thu Jul 28 08:37:42 2022] GET /identity/v3/projects/service => generated 88 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 08:37:43.204465 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2dd4b21-e0ba-4f2f-8184-0237a86f0f4a None admin] Authenticating user token {{(pid=282898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:37:43.210100 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-312d7966-04e4-4e33-bf25-15809d974a62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282899) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:37:43.211194 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312d7966-04e4-4e33-bf25-15809d974a62 None admin] REQUEST_METHOD: `POST` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:37:43.211708 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312d7966-04e4-4e33-bf25-15809d974a62 None admin] SCRIPT_NAME: `/identity` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:37:43.212206 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312d7966-04e4-4e33-bf25-15809d974a62 None admin] PATH_INFO: `/v3/users` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:37:43.213165 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-312d7966-04e4-4e33-bf25-15809d974a62 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:37:43.214936 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-312d7966-04e4-4e33-bf25-15809d974a62 None admin] RBAC: Authorization granted {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:37:43.232553 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.sql.core [None req-312d7966-04e4-4e33-bf25-15809d974a62 None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jul 28 08:37:43.232553 dv-cinder-851351-1-smb devstack@keystone.service[282899]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Jul 28 08:37:43.232553 dv-cinder-851351-1-smb devstack@keystone.service[282899]: [parameters: {'user_id': '62064024d9064635a53c8f22e81a8ab2', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Jul 28 08:37:43.232553 dv-cinder-851351-1-smb devstack@keystone.service[282899]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=282899) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jul 28 08:37:43.242114 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application [None req-312d7966-04e4-4e33-bf25-15809d974a62 None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Jul 28 08:37:43.242114 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:37:43.242114 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 28 08:37:43.242114 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 28 08:37:43.242114 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 28 08:37:43.242114 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 28 08:37:43.242114 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 28 08:37:43.242114 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application result = self._query(query) Jul 28 08:37:43.242114 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 28 08:37:43.242114 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application conn.query(q) Jul 28 08:37:43.242114 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 28 08:37:43.242114 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 28 08:37:43.242114 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 28 08:37:43.242114 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application result.read() Jul 28 08:37:43.242114 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 28 08:37:43.243319 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 28 08:37:43.243319 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 28 08:37:43.243319 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 28 08:37:43.243319 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 28 08:37:43.243319 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 28 08:37:43.243319 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 28 08:37:43.243319 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 28 08:37:43.243319 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jul 28 08:37:43.243319 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application Jul 28 08:37:43.243319 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jul 28 08:37:43.243319 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application Jul 28 08:37:43.243319 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:37:43.243319 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jul 28 08:37:43.243319 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jul 28 08:37:43.243319 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Jul 28 08:37:43.243319 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Jul 28 08:37:43.243319 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 28 08:37:43.243319 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application next(self.gen) Jul 28 08:37:43.244524 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jul 28 08:37:43.244524 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application yield resource Jul 28 08:37:43.244524 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 28 08:37:43.244524 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application next(self.gen) Jul 28 08:37:43.244524 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jul 28 08:37:43.244524 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application self.session.rollback() Jul 28 08:37:43.244524 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 28 08:37:43.244524 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application self.force_reraise() Jul 28 08:37:43.244524 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 28 08:37:43.244524 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application raise self.value Jul 28 08:37:43.244524 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jul 28 08:37:43.244524 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jul 28 08:37:43.244524 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jul 28 08:37:43.244524 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application session.commit() Jul 28 08:37:43.244524 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jul 28 08:37:43.244524 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jul 28 08:37:43.244524 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jul 28 08:37:43.245620 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application self._prepare_impl() Jul 28 08:37:43.245620 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jul 28 08:37:43.245620 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application self.session.flush() Jul 28 08:37:43.245620 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jul 28 08:37:43.245620 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application self._flush(objects) Jul 28 08:37:43.245620 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jul 28 08:37:43.245620 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jul 28 08:37:43.245620 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jul 28 08:37:43.245620 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application compat.raise_( Jul 28 08:37:43.245620 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 28 08:37:43.245620 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application raise exception Jul 28 08:37:43.245620 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jul 28 08:37:43.245620 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application flush_context.execute() Jul 28 08:37:43.245620 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jul 28 08:37:43.245620 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application rec.execute(self) Jul 28 08:37:43.245620 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jul 28 08:37:43.245620 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jul 28 08:37:43.246736 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jul 28 08:37:43.246736 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application _emit_insert_statements( Jul 28 08:37:43.246736 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Jul 28 08:37:43.246736 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application result = connection._execute_20( Jul 28 08:37:43.246736 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jul 28 08:37:43.246736 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jul 28 08:37:43.246736 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Jul 28 08:37:43.246736 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jul 28 08:37:43.246736 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jul 28 08:37:43.246736 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application ret = self._execute_context( Jul 28 08:37:43.246736 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jul 28 08:37:43.246736 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jul 28 08:37:43.246736 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jul 28 08:37:43.246736 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jul 28 08:37:43.246736 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 28 08:37:43.246736 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application raise exception Jul 28 08:37:43.247792 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 28 08:37:43.247792 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 28 08:37:43.247792 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 28 08:37:43.247792 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 28 08:37:43.247792 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 28 08:37:43.247792 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application result = self._query(query) Jul 28 08:37:43.247792 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 28 08:37:43.247792 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application conn.query(q) Jul 28 08:37:43.247792 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 28 08:37:43.247792 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 28 08:37:43.247792 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 28 08:37:43.247792 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application result.read() Jul 28 08:37:43.247792 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 28 08:37:43.247792 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 28 08:37:43.247792 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 28 08:37:43.247792 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 28 08:37:43.250018 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 28 08:37:43.250018 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 28 08:37:43.250018 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 28 08:37:43.250018 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 28 08:37:43.250018 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jul 28 08:37:43.250018 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Jul 28 08:37:43.250018 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application [parameters: {'user_id': '62064024d9064635a53c8f22e81a8ab2', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Jul 28 08:37:43.250018 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jul 28 08:37:43.250018 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application Jul 28 08:37:43.250018 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 28 08:37:43.250018 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application Jul 28 08:37:43.250018 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:37:43.250018 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:37:43.250018 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:37:43.250018 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:37:43.252283 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:37:43.252283 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:37:43.252283 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:37:43.252283 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:37:43.252283 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:37:43.252283 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:37:43.252283 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:37:43.252283 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Jul 28 08:37:43.252283 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Jul 28 08:37:43.252283 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:37:43.252283 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:37:43.252283 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 28 08:37:43.252283 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 08:37:43.252283 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 28 08:37:43.252283 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 08:37:43.252283 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Jul 28 08:37:43.252283 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Jul 28 08:37:43.256609 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Jul 28 08:37:43.256609 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Jul 28 08:37:43.256609 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jul 28 08:37:43.256609 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jul 28 08:37:43.256609 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Jul 28 08:37:43.256609 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application Jul 28 08:37:43.257604 dv-cinder-851351-1-smb devstack@keystone.service[282899]: [pid: 282899|app: 0|req: 476/955] 10.222.0.42 () {60 vars in 1131 bytes} [Thu Jul 28 08:37:43 2022] POST /identity/v3/users => generated 160 bytes in 229 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:37:43.262416 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-312d7966-04e4-4e33-bf25-15809d974a62 None admin] Authenticating user token {{(pid=282899) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:37:43.321128 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2dd4b21-e0ba-4f2f-8184-0237a86f0f4a None admin] Validating token access rules against request {{(pid=282898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:37:43.358938 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d7a96f-7ed6-4a8d-8bf7-6a079e818bcd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:37:43.359582 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d7a96f-7ed6-4a8d-8bf7-6a079e818bcd None admin] REQUEST_METHOD: `GET` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:37:43.359861 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d7a96f-7ed6-4a8d-8bf7-6a079e818bcd None admin] SCRIPT_NAME: `/identity` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:37:43.360208 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d7a96f-7ed6-4a8d-8bf7-6a079e818bcd None admin] PATH_INFO: `/v3/projects` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:37:43.360974 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43d7a96f-7ed6-4a8d-8bf7-6a079e818bcd None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=282898) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:37:43.361295 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43d7a96f-7ed6-4a8d-8bf7-6a079e818bcd None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:37:43.362864 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43d7a96f-7ed6-4a8d-8bf7-6a079e818bcd None admin] RBAC: Authorization granted {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:37:43.381033 dv-cinder-851351-1-smb devstack@keystone.service[282898]: [pid: 282898|app: 0|req: 480/956] 10.222.0.42 () {56 vars in 1148 bytes} [Thu Jul 28 08:37:43 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:37:43.382013 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d7a96f-7ed6-4a8d-8bf7-6a079e818bcd None admin] Authenticating user token {{(pid=282898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:37:43.384703 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-312d7966-04e4-4e33-bf25-15809d974a62 None admin] Validating token access rules against request {{(pid=282899) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:37:43.423892 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e8dd50-d17a-47e8-b82a-d5527ca8a113 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282899) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:37:43.425016 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e8dd50-d17a-47e8-b82a-d5527ca8a113 None admin] REQUEST_METHOD: `GET` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:37:43.425623 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e8dd50-d17a-47e8-b82a-d5527ca8a113 None admin] SCRIPT_NAME: `/identity` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:37:43.426123 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e8dd50-d17a-47e8-b82a-d5527ca8a113 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:37:43.432072 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG dbcounter [-] [282898] Writing DB stats keystone:SELECT=100 {{(pid=282898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:37:43.436483 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4e8dd50-d17a-47e8-b82a-d5527ca8a113 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:37:43.438687 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4e8dd50-d17a-47e8-b82a-d5527ca8a113 None admin] RBAC: Authorization granted {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:37:43.454366 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application [None req-b4e8dd50-d17a-47e8-b82a-d5527ca8a113 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jul 28 08:37:43.454366 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:37:43.454366 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:37:43.454366 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:37:43.454366 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:37:43.454366 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:37:43.454366 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:37:43.454366 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:37:43.454366 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:37:43.454366 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:37:43.454366 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:37:43.454366 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:37:43.454366 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 28 08:37:43.454366 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 28 08:37:43.454366 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 28 08:37:43.454366 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 28 08:37:43.455652 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:37:43.455652 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:37:43.455652 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 28 08:37:43.455652 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 08:37:43.455652 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 28 08:37:43.455652 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 08:37:43.455652 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:37:43.455652 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:37:43.455652 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:37:43.455652 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:37:43.455652 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:37:43.455652 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application with Lock( Jul 28 08:37:43.455652 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:37:43.455652 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:37:43.455652 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:37:43.455652 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:37:43.455652 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:37:43.455652 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:37:43.456856 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:37:43.456856 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:37:43.456856 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 28 08:37:43.456856 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 28 08:37:43.456856 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 28 08:37:43.456856 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 28 08:37:43.456856 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 28 08:37:43.456856 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 28 08:37:43.456856 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jul 28 08:37:43.456856 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application Jul 28 08:37:43.459782 dv-cinder-851351-1-smb devstack@keystone.service[282899]: [pid: 282899|app: 0|req: 477/957] 10.222.0.42 () {56 vars in 1099 bytes} [Thu Jul 28 08:37:43 2022] GET /identity/v3/users/cinder => generated 84 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:37:43.465349 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e8dd50-d17a-47e8-b82a-d5527ca8a113 None admin] Authenticating user token {{(pid=282899) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:37:43.470897 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG dbcounter [-] [282899] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=282899) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:37:43.503270 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d7a96f-7ed6-4a8d-8bf7-6a079e818bcd None admin] Validating token access rules against request {{(pid=282898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:37:43.547245 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ad7bff-02e1-4b2a-91dd-929e5086b439 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:37:43.548192 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ad7bff-02e1-4b2a-91dd-929e5086b439 None admin] REQUEST_METHOD: `PUT` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:37:43.548685 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ad7bff-02e1-4b2a-91dd-929e5086b439 None admin] SCRIPT_NAME: `/identity` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:37:43.549224 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ad7bff-02e1-4b2a-91dd-929e5086b439 None admin] PATH_INFO: `/v3/projects/5cde68cbfb9042dc9f36af3aacea2473/users/f4a66540de9f46a2bc490af024cc37cd/roles/f33deecb73a247c0b6c50fe050d1ef3a` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:37:43.552302 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56ad7bff-02e1-4b2a-91dd-929e5086b439 None admin] RBAC: Authorizing `identity:create_grant(project_id=5cde68cbfb9042dc9f36af3aacea2473, user_id=f4a66540de9f46a2bc490af024cc37cd, role_id=f33deecb73a247c0b6c50fe050d1ef3a)` {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:37:43.553964 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56ad7bff-02e1-4b2a-91dd-929e5086b439 None admin] RBAC: Authorization granted {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:37:43.576700 dv-cinder-851351-1-smb devstack@keystone.service[282898]: [pid: 282898|app: 0|req: 481/958] 10.222.0.42 () {58 vars in 1439 bytes} [Thu Jul 28 08:37:43 2022] PUT /identity/v3/projects/5cde68cbfb9042dc9f36af3aacea2473/users/f4a66540de9f46a2bc490af024cc37cd/roles/f33deecb73a247c0b6c50fe050d1ef3a => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 08:37:43.610128 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e8dd50-d17a-47e8-b82a-d5527ca8a113 None admin] Validating token access rules against request {{(pid=282899) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:37:43.654477 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab54a0b8-5104-4537-9cae-8e836d7374b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282899) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:37:43.655026 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab54a0b8-5104-4537-9cae-8e836d7374b1 None admin] REQUEST_METHOD: `GET` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:37:43.655316 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab54a0b8-5104-4537-9cae-8e836d7374b1 None admin] SCRIPT_NAME: `/identity` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:37:43.655601 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab54a0b8-5104-4537-9cae-8e836d7374b1 None admin] PATH_INFO: `/v3/users` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:37:43.656428 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab54a0b8-5104-4537-9cae-8e836d7374b1 None admin] RBAC: Adding query filter params (name=cinder) {{(pid=282899) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:37:43.656779 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab54a0b8-5104-4537-9cae-8e836d7374b1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:37:43.658340 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab54a0b8-5104-4537-9cae-8e836d7374b1 None admin] RBAC: Authorization granted {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:37:43.704523 dv-cinder-851351-1-smb devstack@keystone.service[282899]: [pid: 282899|app: 0|req: 478/959] 10.222.0.42 () {56 vars in 1101 bytes} [Thu Jul 28 08:37:43 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 08:37:43.922568 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e05680-b0e0-49c6-8819-81fa9863566b None None] REQUEST_METHOD: `GET` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:37:43.922769 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e05680-b0e0-49c6-8819-81fa9863566b None None] SCRIPT_NAME: `/identity` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:37:43.923054 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e05680-b0e0-49c6-8819-81fa9863566b None None] PATH_INFO: `/` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:37:43.924707 dv-cinder-851351-1-smb devstack@keystone.service[282898]: [pid: 282898|app: 0|req: 482/960] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 08:37:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 08:37:43.930670 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56292d1f-4eb4-43dd-a326-0380d8d4fcd6 None None] REQUEST_METHOD: `POST` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:37:43.931623 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56292d1f-4eb4-43dd-a326-0380d8d4fcd6 None None] SCRIPT_NAME: `/identity` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:37:43.932117 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56292d1f-4eb4-43dd-a326-0380d8d4fcd6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:37:43.952166 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.auth.core [None req-56292d1f-4eb4-43dd-a326-0380d8d4fcd6 None None] MFA Rules not processed for user `2be990a66857410a87ffa7609aec4f7b`. Rule list: `[]` (Enabled: `True`). {{(pid=282899) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 08:37:43.953945 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.fernet_utils [None req-56292d1f-4eb4-43dd-a326-0380d8d4fcd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=282899) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:37:44.020165 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG dbcounter [-] [282899] Writing DB stats keystone:SELECT=100 {{(pid=282899) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:37:44.032153 dv-cinder-851351-1-smb devstack@keystone.service[282899]: [pid: 282899|app: 0|req: 479/961] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 08:37:43 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 08:37:44.054525 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e05680-b0e0-49c6-8819-81fa9863566b None None] Authenticating user token {{(pid=282898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:37:44.171427 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e05680-b0e0-49c6-8819-81fa9863566b None None] Validating token access rules against request {{(pid=282898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:37:44.174348 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG dbcounter [-] [282898] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=282898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:37:44.210788 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d18dd7-c818-49e6-866a-c6cedbbb922d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:37:44.211563 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d18dd7-c818-49e6-866a-c6cedbbb922d None admin] REQUEST_METHOD: `POST` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:37:44.211917 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d18dd7-c818-49e6-866a-c6cedbbb922d None admin] SCRIPT_NAME: `/identity` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:37:44.212260 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d18dd7-c818-49e6-866a-c6cedbbb922d None admin] PATH_INFO: `/v3/services` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:37:44.213087 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8d18dd7-c818-49e6-866a-c6cedbbb922d None admin] RBAC: Authorizing `identity:create_service()` {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:37:44.214590 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8d18dd7-c818-49e6-866a-c6cedbbb922d None admin] RBAC: Authorization granted {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:37:44.230697 dv-cinder-851351-1-smb devstack@keystone.service[282898]: [pid: 282898|app: 0|req: 483/962] 10.222.0.42 () {60 vars in 1141 bytes} [Thu Jul 28 08:37:44 2022] POST /identity/v3/services => generated 242 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 08:37:44.710563 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9a5396-e76f-4f3d-a9d8-755ad549d113 None None] REQUEST_METHOD: `GET` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:37:44.710845 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9a5396-e76f-4f3d-a9d8-755ad549d113 None None] SCRIPT_NAME: `/identity` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:37:44.711109 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9a5396-e76f-4f3d-a9d8-755ad549d113 None None] PATH_INFO: `/` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:37:44.712518 dv-cinder-851351-1-smb devstack@keystone.service[282899]: [pid: 282899|app: 0|req: 480/963] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 08:37:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 08:37:44.718311 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7b8e6f-177c-44aa-af0f-3c2fde4735b8 None None] REQUEST_METHOD: `POST` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:37:44.718687 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7b8e6f-177c-44aa-af0f-3c2fde4735b8 None None] SCRIPT_NAME: `/identity` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:37:44.719012 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7b8e6f-177c-44aa-af0f-3c2fde4735b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:37:44.739094 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.auth.core [None req-7a7b8e6f-177c-44aa-af0f-3c2fde4735b8 None None] MFA Rules not processed for user `2be990a66857410a87ffa7609aec4f7b`. Rule list: `[]` (Enabled: `True`). {{(pid=282898) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 08:37:44.740475 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.fernet_utils [None req-7a7b8e6f-177c-44aa-af0f-3c2fde4735b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=282898) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:37:44.831033 dv-cinder-851351-1-smb devstack@keystone.service[282898]: [pid: 282898|app: 0|req: 484/964] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 08:37:44 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 08:37:44.853761 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9a5396-e76f-4f3d-a9d8-755ad549d113 None None] Authenticating user token {{(pid=282899) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:37:44.974892 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9a5396-e76f-4f3d-a9d8-755ad549d113 None None] Validating token access rules against request {{(pid=282899) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:37:45.010291 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-221bc2ee-5408-4c74-a4b8-1e3ddf3f2db7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282899) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:37:45.010962 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221bc2ee-5408-4c74-a4b8-1e3ddf3f2db7 None admin] REQUEST_METHOD: `GET` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:37:45.011251 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221bc2ee-5408-4c74-a4b8-1e3ddf3f2db7 None admin] SCRIPT_NAME: `/identity` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:37:45.011536 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221bc2ee-5408-4c74-a4b8-1e3ddf3f2db7 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:37:45.012181 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-221bc2ee-5408-4c74-a4b8-1e3ddf3f2db7 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:37:45.013624 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-221bc2ee-5408-4c74-a4b8-1e3ddf3f2db7 None admin] RBAC: Authorization granted {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:37:45.024039 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application [None req-221bc2ee-5408-4c74-a4b8-1e3ddf3f2db7 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 28 08:37:45.024039 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:37:45.024039 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 28 08:37:45.024039 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 28 08:37:45.024039 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 28 08:37:45.024039 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 28 08:37:45.024039 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 28 08:37:45.024039 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 08:37:45.024039 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 28 08:37:45.024039 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application Jul 28 08:37:45.024039 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 28 08:37:45.024039 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application Jul 28 08:37:45.024039 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:37:45.024039 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:37:45.024039 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:37:45.024039 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:37:45.024039 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:37:45.026093 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:37:45.026093 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:37:45.026093 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:37:45.026093 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:37:45.026093 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:37:45.026093 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:37:45.026093 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 28 08:37:45.026093 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 28 08:37:45.026093 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 28 08:37:45.026093 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 28 08:37:45.026093 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:37:45.026093 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:37:45.026093 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:37:45.026093 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:37:45.026093 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:37:45.026093 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:37:45.027093 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:37:45.027093 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application with Lock( Jul 28 08:37:45.027093 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:37:45.027093 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:37:45.027093 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:37:45.027093 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:37:45.027093 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:37:45.027093 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:37:45.027093 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:37:45.027093 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:37:45.027093 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 28 08:37:45.027093 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 08:37:45.027093 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 28 08:37:45.027093 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application Jul 28 08:37:45.030536 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a7b8e6f-177c-44aa-af0f-3c2fde4735b8 None None] Authenticating user token {{(pid=282898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:37:45.035293 dv-cinder-851351-1-smb devstack@keystone.service[282899]: [pid: 282899|app: 0|req: 481/965] 10.222.0.42 () {56 vars in 1126 bytes} [Thu Jul 28 08:37:44 2022] GET /identity/v3/services/object-store => generated 93 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:37:45.131280 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG dbcounter [-] [282898] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=282898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:37:45.143557 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a7b8e6f-177c-44aa-af0f-3c2fde4735b8 None None] Validating token access rules against request {{(pid=282898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:37:45.179859 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4389cb-8292-47ca-a6f2-6128881fcd0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:37:45.180847 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4389cb-8292-47ca-a6f2-6128881fcd0e None admin] REQUEST_METHOD: `GET` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:37:45.180847 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4389cb-8292-47ca-a6f2-6128881fcd0e None admin] SCRIPT_NAME: `/identity` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:37:45.181050 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4389cb-8292-47ca-a6f2-6128881fcd0e None admin] PATH_INFO: `/v3/services` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:37:45.181750 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a4389cb-8292-47ca-a6f2-6128881fcd0e None admin] RBAC: Adding query filter params (name=object-store) {{(pid=282898) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:37:45.182059 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a4389cb-8292-47ca-a6f2-6128881fcd0e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:37:45.183458 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a4389cb-8292-47ca-a6f2-6128881fcd0e None admin] RBAC: Authorization granted {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:37:45.188842 dv-cinder-851351-1-smb devstack@keystone.service[282898]: [pid: 282898|app: 0|req: 485/966] 10.222.0.42 () {56 vars in 1122 bytes} [Thu Jul 28 08:37:45 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:37:45.194689 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-221bc2ee-5408-4c74-a4b8-1e3ddf3f2db7 None admin] Authenticating user token {{(pid=282899) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:37:45.255275 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG dbcounter [-] [282899] Writing DB stats keystone:SELECT=100 {{(pid=282899) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:37:45.303346 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-221bc2ee-5408-4c74-a4b8-1e3ddf3f2db7 None admin] Validating token access rules against request {{(pid=282899) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:37:45.339914 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e329160-b996-436c-852a-c87fe4e2d50f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282899) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:37:45.340727 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e329160-b996-436c-852a-c87fe4e2d50f None admin] REQUEST_METHOD: `GET` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:37:45.341136 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e329160-b996-436c-852a-c87fe4e2d50f None admin] SCRIPT_NAME: `/identity` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:37:45.341531 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e329160-b996-436c-852a-c87fe4e2d50f None admin] PATH_INFO: `/v3/services` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:37:45.342342 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e329160-b996-436c-852a-c87fe4e2d50f None admin] RBAC: Adding query filter params (type=object-store) {{(pid=282899) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:37:45.342751 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e329160-b996-436c-852a-c87fe4e2d50f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:37:45.344283 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e329160-b996-436c-852a-c87fe4e2d50f None admin] RBAC: Authorization granted {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:37:45.350914 dv-cinder-851351-1-smb devstack@keystone.service[282899]: [pid: 282899|app: 0|req: 482/967] 10.222.0.42 () {56 vars in 1122 bytes} [Thu Jul 28 08:37:45 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:37:45.356895 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4389cb-8292-47ca-a6f2-6128881fcd0e None admin] Authenticating user token {{(pid=282898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:37:45.464286 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4389cb-8292-47ca-a6f2-6128881fcd0e None admin] Validating token access rules against request {{(pid=282898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:37:45.499466 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf4d8c0-a560-4ccf-9117-193356d58ab1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:37:45.500284 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf4d8c0-a560-4ccf-9117-193356d58ab1 None admin] REQUEST_METHOD: `POST` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:37:45.500655 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf4d8c0-a560-4ccf-9117-193356d58ab1 None admin] SCRIPT_NAME: `/identity` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:37:45.501055 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf4d8c0-a560-4ccf-9117-193356d58ab1 None admin] PATH_INFO: `/v3/endpoints` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:37:45.501956 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bf4d8c0-a560-4ccf-9117-193356d58ab1 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:37:45.503444 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bf4d8c0-a560-4ccf-9117-193356d58ab1 None admin] RBAC: Authorization granted {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:37:45.524552 dv-cinder-851351-1-smb devstack@keystone.service[282898]: [pid: 282898|app: 0|req: 486/968] 10.222.0.42 () {60 vars in 1144 bytes} [Thu Jul 28 08:37:45 2022] POST /identity/v3/endpoints => generated 349 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 08:37:45.655378 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569c0343-c565-4fa7-9d97-7e8479439f53 None None] REQUEST_METHOD: `GET` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:37:45.655652 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569c0343-c565-4fa7-9d97-7e8479439f53 None None] SCRIPT_NAME: `/identity` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:37:45.655913 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569c0343-c565-4fa7-9d97-7e8479439f53 None None] PATH_INFO: `/` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:37:45.657641 dv-cinder-851351-1-smb devstack@keystone.service[282899]: [pid: 282899|app: 0|req: 483/969] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 08:37:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 08:37:45.663547 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9b3288-d171-441e-995a-17f01f0f23af None None] REQUEST_METHOD: `POST` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:37:45.663831 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9b3288-d171-441e-995a-17f01f0f23af None None] SCRIPT_NAME: `/identity` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:37:45.664109 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9b3288-d171-441e-995a-17f01f0f23af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:37:45.686565 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.auth.core [None req-3b9b3288-d171-441e-995a-17f01f0f23af None None] MFA Rules not processed for user `2be990a66857410a87ffa7609aec4f7b`. Rule list: `[]` (Enabled: `True`). {{(pid=282898) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 08:37:45.687793 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.fernet_utils [None req-3b9b3288-d171-441e-995a-17f01f0f23af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=282898) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:37:45.691672 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG dbcounter [-] [282898] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=282898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:37:45.781088 dv-cinder-851351-1-smb devstack@keystone.service[282898]: [pid: 282898|app: 0|req: 487/970] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 08:37:45 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 28 08:37:45.807585 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569c0343-c565-4fa7-9d97-7e8479439f53 None None] Authenticating user token {{(pid=282899) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:37:45.925092 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569c0343-c565-4fa7-9d97-7e8479439f53 None None] Validating token access rules against request {{(pid=282899) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:37:45.946029 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG dbcounter [-] [282899] Writing DB stats keystone:SELECT=100 {{(pid=282899) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:37:45.962115 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6249ec4-e152-45c7-9beb-5e5357d7eed4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282899) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:37:45.962851 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6249ec4-e152-45c7-9beb-5e5357d7eed4 None admin] REQUEST_METHOD: `GET` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:37:45.963226 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6249ec4-e152-45c7-9beb-5e5357d7eed4 None admin] SCRIPT_NAME: `/identity` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:37:45.963563 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6249ec4-e152-45c7-9beb-5e5357d7eed4 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:37:45.974266 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6249ec4-e152-45c7-9beb-5e5357d7eed4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 08:37:45.979267 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application [None req-a6249ec4-e152-45c7-9beb-5e5357d7eed4 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 28 08:37:45.979267 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:37:45.979267 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:37:45.979267 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:37:45.979267 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:37:45.979267 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:37:45.979267 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:37:45.979267 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:37:45.979267 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:37:45.979267 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:37:45.979267 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:37:45.979267 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:37:45.979267 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 08:37:45.979267 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 08:37:45.979267 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 08:37:45.979267 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 08:37:45.980842 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 08:37:45.980842 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 08:37:45.980842 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 08:37:45.980842 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 08:37:45.980842 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:37:45.980842 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:37:45.980842 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:37:45.980842 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:37:45.980842 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:37:45.980842 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:37:45.980842 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:37:45.980842 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application with Lock( Jul 28 08:37:45.980842 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:37:45.980842 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:37:45.980842 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:37:45.980842 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:37:45.981883 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:37:45.981883 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:37:45.981883 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:37:45.981883 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:37:45.981883 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 08:37:45.981883 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 08:37:45.981883 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 08:37:45.981883 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 08:37:45.981883 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 08:37:45.981883 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 08:37:45.981883 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 28 08:37:45.981883 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application Jul 28 08:37:45.984764 dv-cinder-851351-1-smb devstack@keystone.service[282899]: [pid: 282899|app: 0|req: 484/971] 10.222.0.42 () {56 vars in 1120 bytes} [Thu Jul 28 08:37:45 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:37:45.986723 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b9b3288-d171-441e-995a-17f01f0f23af None None] Authenticating user token {{(pid=282898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:37:46.092513 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b9b3288-d171-441e-995a-17f01f0f23af None None] Validating token access rules against request {{(pid=282898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:37:46.127728 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b3e3567-5aeb-4747-8c40-992b82d890db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:37:46.128359 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3e3567-5aeb-4747-8c40-992b82d890db None admin] REQUEST_METHOD: `GET` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:37:46.128647 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3e3567-5aeb-4747-8c40-992b82d890db None admin] SCRIPT_NAME: `/identity` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:37:46.128940 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3e3567-5aeb-4747-8c40-992b82d890db None admin] PATH_INFO: `/v3/roles` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:37:46.129695 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b3e3567-5aeb-4747-8c40-992b82d890db None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=282898) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:37:46.130065 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b3e3567-5aeb-4747-8c40-992b82d890db None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:37:46.131405 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b3e3567-5aeb-4747-8c40-992b82d890db None admin] RBAC: Authorization granted {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:37:46.133818 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG dbcounter [-] [282898] Writing DB stats keystone:SELECT=100 {{(pid=282898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:37:46.145934 dv-cinder-851351-1-smb devstack@keystone.service[282898]: [pid: 282898|app: 0|req: 488/972] 10.222.0.42 () {56 vars in 1115 bytes} [Thu Jul 28 08:37:45 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:37:46.147494 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6249ec4-e152-45c7-9beb-5e5357d7eed4 None admin] Authenticating user token {{(pid=282899) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:37:46.251600 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6249ec4-e152-45c7-9beb-5e5357d7eed4 None admin] Validating token access rules against request {{(pid=282899) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:37:46.269372 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203cf07d-87ed-469b-be74-3a274c63b61a None None] REQUEST_METHOD: `GET` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:37:46.269940 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203cf07d-87ed-469b-be74-3a274c63b61a None None] SCRIPT_NAME: `/identity` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:37:46.269940 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203cf07d-87ed-469b-be74-3a274c63b61a None None] PATH_INFO: `/` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:37:46.272545 dv-cinder-851351-1-smb devstack@keystone.service[282898]: [pid: 282898|app: 0|req: 489/973] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 08:37:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 28 08:37:46.276551 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77ba3c8-0484-43ad-99b6-5eb0986e39e7 None None] REQUEST_METHOD: `POST` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:37:46.276872 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77ba3c8-0484-43ad-99b6-5eb0986e39e7 None None] SCRIPT_NAME: `/identity` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:37:46.277149 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77ba3c8-0484-43ad-99b6-5eb0986e39e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:37:46.289120 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6dad380-8f07-482e-a01f-0ebd9e658e99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282899) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:37:46.289786 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6dad380-8f07-482e-a01f-0ebd9e658e99 None admin] REQUEST_METHOD: `GET` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:37:46.290081 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6dad380-8f07-482e-a01f-0ebd9e658e99 None admin] SCRIPT_NAME: `/identity` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:37:46.290366 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6dad380-8f07-482e-a01f-0ebd9e658e99 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:37:46.295813 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.auth.core [None req-f77ba3c8-0484-43ad-99b6-5eb0986e39e7 None None] MFA Rules not processed for user `2be990a66857410a87ffa7609aec4f7b`. Rule list: `[]` (Enabled: `True`). {{(pid=282898) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 08:37:46.297037 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.fernet_utils [None req-f77ba3c8-0484-43ad-99b6-5eb0986e39e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=282898) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:37:46.301747 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6dad380-8f07-482e-a01f-0ebd9e658e99 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:37:46.303243 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6dad380-8f07-482e-a01f-0ebd9e658e99 None admin] RBAC: Authorization granted {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:37:46.319761 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application [None req-b6dad380-8f07-482e-a01f-0ebd9e658e99 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 08:37:46.319761 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:37:46.319761 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:37:46.319761 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:37:46.319761 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:37:46.319761 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:37:46.319761 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:37:46.319761 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:37:46.319761 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:37:46.319761 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:37:46.319761 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:37:46.319761 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:37:46.319761 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 08:37:46.319761 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 08:37:46.319761 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 08:37:46.320939 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 08:37:46.320939 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:37:46.320939 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:37:46.320939 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:37:46.320939 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:37:46.320939 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:37:46.320939 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:37:46.320939 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:37:46.320939 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application with Lock( Jul 28 08:37:46.320939 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:37:46.320939 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:37:46.320939 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:37:46.320939 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:37:46.320939 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:37:46.320939 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:37:46.320939 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:37:46.320939 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:37:46.322061 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 08:37:46.322061 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 08:37:46.322061 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 08:37:46.322061 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application Jul 28 08:37:46.322061 dv-cinder-851351-1-smb devstack@keystone.service[282899]: [pid: 282899|app: 0|req: 485/974] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 08:37:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 08:37:46.326869 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6dad380-8f07-482e-a01f-0ebd9e658e99 None admin] Authenticating user token {{(pid=282899) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:37:46.366573 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG dbcounter [-] [282899] Writing DB stats keystone:SELECT=100 {{(pid=282899) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:37:46.381197 dv-cinder-851351-1-smb devstack@keystone.service[282898]: [pid: 282898|app: 0|req: 490/975] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 08:37:46 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 28 08:37:46.403756 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f77ba3c8-0484-43ad-99b6-5eb0986e39e7 None None] Authenticating user token {{(pid=282898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:37:46.438228 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6dad380-8f07-482e-a01f-0ebd9e658e99 None admin] Validating token access rules against request {{(pid=282899) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:37:46.473268 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef4d02e-8f7e-405a-b46a-f009c3a2c3e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282899) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:37:46.473895 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef4d02e-8f7e-405a-b46a-f009c3a2c3e1 None admin] REQUEST_METHOD: `GET` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:37:46.474175 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef4d02e-8f7e-405a-b46a-f009c3a2c3e1 None admin] SCRIPT_NAME: `/identity` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:37:46.474456 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef4d02e-8f7e-405a-b46a-f009c3a2c3e1 None admin] PATH_INFO: `/v3/domains` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:37:46.475158 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ef4d02e-8f7e-405a-b46a-f009c3a2c3e1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=282899) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:37:46.475464 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ef4d02e-8f7e-405a-b46a-f009c3a2c3e1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:37:46.476867 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ef4d02e-8f7e-405a-b46a-f009c3a2c3e1 None admin] RBAC: Authorization granted {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:37:46.489348 dv-cinder-851351-1-smb devstack@keystone.service[282899]: [pid: 282899|app: 0|req: 486/976] 10.222.0.42 () {56 vars in 1109 bytes} [Thu Jul 28 08:37:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:37:46.494658 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef4d02e-8f7e-405a-b46a-f009c3a2c3e1 None admin] Authenticating user token {{(pid=282899) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:37:46.510880 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f77ba3c8-0484-43ad-99b6-5eb0986e39e7 None None] Validating token access rules against request {{(pid=282898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:37:46.538475 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG dbcounter [-] [282898] Writing DB stats keystone:SELECT=100 {{(pid=282898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:37:46.547760 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-522e0415-e49e-409a-996d-1fecb2118c81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:37:46.548576 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522e0415-e49e-409a-996d-1fecb2118c81 None admin] REQUEST_METHOD: `GET` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:37:46.548887 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522e0415-e49e-409a-996d-1fecb2118c81 None admin] SCRIPT_NAME: `/identity` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:37:46.549164 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522e0415-e49e-409a-996d-1fecb2118c81 None admin] PATH_INFO: `/v3/services/compute` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:37:46.549807 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-522e0415-e49e-409a-996d-1fecb2118c81 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:37:46.551211 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-522e0415-e49e-409a-996d-1fecb2118c81 None admin] RBAC: Authorization granted {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:37:46.560258 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application [None req-522e0415-e49e-409a-996d-1fecb2118c81 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jul 28 08:37:46.560258 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:37:46.560258 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 28 08:37:46.560258 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 28 08:37:46.560258 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 28 08:37:46.560258 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 28 08:37:46.560258 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 28 08:37:46.560258 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 08:37:46.560258 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 28 08:37:46.560258 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application Jul 28 08:37:46.560258 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 28 08:37:46.560258 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application Jul 28 08:37:46.560258 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:37:46.560258 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:37:46.560258 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:37:46.560258 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:37:46.560258 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:37:46.561589 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:37:46.561589 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:37:46.561589 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:37:46.561589 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:37:46.561589 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:37:46.561589 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:37:46.561589 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 28 08:37:46.561589 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 28 08:37:46.561589 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 28 08:37:46.561589 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 28 08:37:46.561589 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:37:46.561589 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:37:46.561589 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:37:46.561589 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:37:46.561589 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:37:46.561589 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:37:46.562818 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:37:46.562818 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application with Lock( Jul 28 08:37:46.562818 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:37:46.562818 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:37:46.562818 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:37:46.562818 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:37:46.562818 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:37:46.562818 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:37:46.562818 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:37:46.562818 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:37:46.562818 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 28 08:37:46.562818 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 08:37:46.562818 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 28 08:37:46.562818 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application Jul 28 08:37:46.566845 dv-cinder-851351-1-smb devstack@keystone.service[282898]: [pid: 282898|app: 0|req: 491/977] 10.222.0.42 () {56 vars in 1111 bytes} [Thu Jul 28 08:37:46 2022] GET /identity/v3/services/compute => generated 88 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 08:37:46.567771 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-522e0415-e49e-409a-996d-1fecb2118c81 None admin] Authenticating user token {{(pid=282898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:37:46.602662 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG dbcounter [-] [282899] Writing DB stats keystone:SELECT=100 {{(pid=282899) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:37:46.615910 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef4d02e-8f7e-405a-b46a-f009c3a2c3e1 None admin] Validating token access rules against request {{(pid=282899) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:37:46.653811 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1937f7c-5434-458d-97ce-62b55b09d26b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282899) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:37:46.654391 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1937f7c-5434-458d-97ce-62b55b09d26b None admin] REQUEST_METHOD: `GET` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:37:46.654680 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1937f7c-5434-458d-97ce-62b55b09d26b None admin] SCRIPT_NAME: `/identity` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:37:46.654962 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1937f7c-5434-458d-97ce-62b55b09d26b None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:37:46.663680 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1937f7c-5434-458d-97ce-62b55b09d26b None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:37:46.665313 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1937f7c-5434-458d-97ce-62b55b09d26b None admin] RBAC: Authorization granted {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:37:46.679230 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application [None req-c1937f7c-5434-458d-97ce-62b55b09d26b None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 28 08:37:46.679230 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:37:46.679230 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:37:46.679230 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:37:46.679230 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:37:46.679230 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:37:46.679230 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:37:46.679230 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:37:46.679230 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:37:46.679230 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:37:46.679230 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:37:46.679230 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:37:46.679230 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 28 08:37:46.679230 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 28 08:37:46.679230 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 28 08:37:46.679230 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 28 08:37:46.680829 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:37:46.680829 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:37:46.680829 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 28 08:37:46.680829 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 08:37:46.680829 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 28 08:37:46.680829 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 08:37:46.680829 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:37:46.680829 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:37:46.680829 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:37:46.680829 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:37:46.680829 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:37:46.680829 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application with Lock( Jul 28 08:37:46.680829 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:37:46.680829 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:37:46.680829 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:37:46.680829 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:37:46.680829 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:37:46.680829 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:37:46.682100 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:37:46.682100 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:37:46.682100 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 28 08:37:46.682100 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 28 08:37:46.682100 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 28 08:37:46.682100 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 28 08:37:46.682100 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 28 08:37:46.682100 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 28 08:37:46.682100 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 28 08:37:46.682100 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application Jul 28 08:37:46.682100 dv-cinder-851351-1-smb devstack@keystone.service[282899]: [pid: 282899|app: 0|req: 487/978] 10.222.0.42 () {56 vars in 1117 bytes} [Thu Jul 28 08:37:46 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 08:37:46.686747 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1937f7c-5434-458d-97ce-62b55b09d26b None admin] Authenticating user token {{(pid=282899) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:37:46.694990 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-522e0415-e49e-409a-996d-1fecb2118c81 None admin] Validating token access rules against request {{(pid=282898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:37:46.738854 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34cbcfd-ec59-453e-a36c-385c70869d5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:37:46.739560 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34cbcfd-ec59-453e-a36c-385c70869d5a None admin] REQUEST_METHOD: `GET` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:37:46.740043 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34cbcfd-ec59-453e-a36c-385c70869d5a None admin] SCRIPT_NAME: `/identity` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:37:46.740397 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34cbcfd-ec59-453e-a36c-385c70869d5a None admin] PATH_INFO: `/v3/services` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:37:46.741539 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b34cbcfd-ec59-453e-a36c-385c70869d5a None admin] RBAC: Adding query filter params (name=compute) {{(pid=282898) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:37:46.741850 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b34cbcfd-ec59-453e-a36c-385c70869d5a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:37:46.743333 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b34cbcfd-ec59-453e-a36c-385c70869d5a None admin] RBAC: Authorization granted {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:37:46.749378 dv-cinder-851351-1-smb devstack@keystone.service[282898]: [pid: 282898|app: 0|req: 492/979] 10.222.0.42 () {56 vars in 1112 bytes} [Thu Jul 28 08:37:46 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 08:37:46.756080 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34cbcfd-ec59-453e-a36c-385c70869d5a None admin] Authenticating user token {{(pid=282898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:37:46.812540 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1937f7c-5434-458d-97ce-62b55b09d26b None admin] Validating token access rules against request {{(pid=282899) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:37:46.820251 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG dbcounter [-] [282898] Writing DB stats keystone:SELECT=100 {{(pid=282898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:37:46.853680 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b6b6be-c88d-4e29-84aa-14c385445fb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282899) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:37:46.854323 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b6b6be-c88d-4e29-84aa-14c385445fb5 None admin] REQUEST_METHOD: `GET` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:37:46.854608 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b6b6be-c88d-4e29-84aa-14c385445fb5 None admin] SCRIPT_NAME: `/identity` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:37:46.854887 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b6b6be-c88d-4e29-84aa-14c385445fb5 None admin] PATH_INFO: `/v3/users` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:37:46.855699 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2b6b6be-c88d-4e29-84aa-14c385445fb5 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=282899) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:37:46.856011 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2b6b6be-c88d-4e29-84aa-14c385445fb5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:37:46.857503 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2b6b6be-c88d-4e29-84aa-14c385445fb5 None admin] RBAC: Authorization granted {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:37:46.868968 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34cbcfd-ec59-453e-a36c-385c70869d5a None admin] Validating token access rules against request {{(pid=282898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:37:46.876008 dv-cinder-851351-1-smb devstack@keystone.service[282899]: [pid: 282899|app: 0|req: 488/980] 10.222.0.42 () {56 vars in 1149 bytes} [Thu Jul 28 08:37:46 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 08:37:46.881711 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b6b6be-c88d-4e29-84aa-14c385445fb5 None admin] Authenticating user token {{(pid=282899) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:37:46.894314 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG dbcounter [-] [282899] Writing DB stats keystone:SELECT=100 {{(pid=282899) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:37:46.905433 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f40d99-7c8e-446d-8ba8-ad895a1d1002 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:37:46.906093 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f40d99-7c8e-446d-8ba8-ad895a1d1002 None admin] REQUEST_METHOD: `GET` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:37:46.906458 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f40d99-7c8e-446d-8ba8-ad895a1d1002 None admin] SCRIPT_NAME: `/identity` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:37:46.906804 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f40d99-7c8e-446d-8ba8-ad895a1d1002 None admin] PATH_INFO: `/v3/services` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:37:46.907575 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f40d99-7c8e-446d-8ba8-ad895a1d1002 None admin] RBAC: Adding query filter params (type=compute) {{(pid=282898) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:37:46.908023 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f40d99-7c8e-446d-8ba8-ad895a1d1002 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:37:46.909544 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f40d99-7c8e-446d-8ba8-ad895a1d1002 None admin] RBAC: Authorization granted {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:37:46.919643 dv-cinder-851351-1-smb devstack@keystone.service[282898]: [pid: 282898|app: 0|req: 493/981] 10.222.0.42 () {56 vars in 1112 bytes} [Thu Jul 28 08:37:46 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:37:46.920632 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f40d99-7c8e-446d-8ba8-ad895a1d1002 None admin] Authenticating user token {{(pid=282898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:37:46.998179 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b6b6be-c88d-4e29-84aa-14c385445fb5 None admin] Validating token access rules against request {{(pid=282899) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:37:47.021596 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f40d99-7c8e-446d-8ba8-ad895a1d1002 None admin] Validating token access rules against request {{(pid=282898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:37:47.036888 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b388dfc-adcc-4231-bb1f-b36803326c7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282899) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:37:47.037883 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b388dfc-adcc-4231-bb1f-b36803326c7e None admin] REQUEST_METHOD: `GET` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:37:47.038230 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b388dfc-adcc-4231-bb1f-b36803326c7e None admin] SCRIPT_NAME: `/identity` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:37:47.038514 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b388dfc-adcc-4231-bb1f-b36803326c7e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:37:47.042817 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG dbcounter [-] [282898] Writing DB stats keystone:SELECT=100 {{(pid=282898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:37:47.059455 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8fa533b-ff21-4abb-ad6d-c215417bd841 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:37:47.060096 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fa533b-ff21-4abb-ad6d-c215417bd841 None admin] REQUEST_METHOD: `GET` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:37:47.060380 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fa533b-ff21-4abb-ad6d-c215417bd841 None admin] SCRIPT_NAME: `/identity` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:37:47.060655 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fa533b-ff21-4abb-ad6d-c215417bd841 None admin] PATH_INFO: `/v3/endpoints` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:37:47.061459 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8fa533b-ff21-4abb-ad6d-c215417bd841 None admin] RBAC: Adding query filter params (interface=public, service_id=91bb53c6d39a474f93a6a4db04733107, region_id=RegionOne) {{(pid=282898) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:37:47.061775 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8fa533b-ff21-4abb-ad6d-c215417bd841 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:37:47.063191 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8fa533b-ff21-4abb-ad6d-c215417bd841 None admin] RBAC: Authorization granted {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:37:47.073773 dv-cinder-851351-1-smb devstack@keystone.service[282898]: [pid: 282898|app: 0|req: 494/982] 10.222.0.42 () {56 vars in 1251 bytes} [Thu Jul 28 08:37:46 2022] GET /identity/v3/endpoints?service_id=91bb53c6d39a474f93a6a4db04733107&interface=public®ion_id=RegionOne => generated 194 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:37:47.074782 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8fa533b-ff21-4abb-ad6d-c215417bd841 None admin] Authenticating user token {{(pid=282898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:37:47.118319 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b388dfc-adcc-4231-bb1f-b36803326c7e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:37:47.119947 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b388dfc-adcc-4231-bb1f-b36803326c7e None admin] RBAC: Authorization granted {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:37:47.131465 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG dbcounter [-] [282899] Writing DB stats keystone:SELECT=100 {{(pid=282899) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:37:47.184312 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8fa533b-ff21-4abb-ad6d-c215417bd841 None admin] Validating token access rules against request {{(pid=282898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:37:47.224255 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282e5280-1902-4160-9fc1-8aa42a8d7c4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:37:47.224991 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282e5280-1902-4160-9fc1-8aa42a8d7c4f None admin] REQUEST_METHOD: `GET` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:37:47.225308 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282e5280-1902-4160-9fc1-8aa42a8d7c4f None admin] SCRIPT_NAME: `/identity` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:37:47.225667 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282e5280-1902-4160-9fc1-8aa42a8d7c4f None admin] PATH_INFO: `/v3/services` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:37:47.226258 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-282e5280-1902-4160-9fc1-8aa42a8d7c4f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:37:47.227849 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-282e5280-1902-4160-9fc1-8aa42a8d7c4f None admin] RBAC: Authorization granted {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:37:47.231582 dv-cinder-851351-1-smb devstack@keystone.service[282899]: [pid: 282899|app: 0|req: 489/983] 10.222.0.42 () {58 vars in 1282 bytes} [Thu Jul 28 08:37:46 2022] GET /identity/v3/auth/tokens => generated 1560 bytes in 350 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jul 28 08:37:47.235167 dv-cinder-851351-1-smb devstack@keystone.service[282898]: [pid: 282898|app: 0|req: 495/984] 10.222.0.42 () {56 vars in 1087 bytes} [Thu Jul 28 08:37:47 2022] GET /identity/v3/services => generated 1727 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 28 08:37:47.237692 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b388dfc-adcc-4231-bb1f-b36803326c7e None admin] Authenticating user token {{(pid=282899) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:37:47.356345 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b388dfc-adcc-4231-bb1f-b36803326c7e None admin] Validating token access rules against request {{(pid=282899) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:37:47.369368 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG dbcounter [-] [282899] Writing DB stats keystone:SELECT=100 {{(pid=282899) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:37:47.398203 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e7048b-3131-49f0-896b-40bf61ff1437 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282899) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:37:47.398871 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e7048b-3131-49f0-896b-40bf61ff1437 None admin] REQUEST_METHOD: `GET` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:37:47.399155 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e7048b-3131-49f0-896b-40bf61ff1437 None admin] SCRIPT_NAME: `/identity` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:37:47.399434 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e7048b-3131-49f0-896b-40bf61ff1437 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:37:47.410747 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34e7048b-3131-49f0-896b-40bf61ff1437 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:37:47.412234 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34e7048b-3131-49f0-896b-40bf61ff1437 None admin] RBAC: Authorization granted {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:37:47.428987 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application [None req-34e7048b-3131-49f0-896b-40bf61ff1437 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 08:37:47.428987 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:37:47.428987 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:37:47.428987 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:37:47.428987 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:37:47.428987 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:37:47.428987 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:37:47.428987 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:37:47.428987 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:37:47.428987 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:37:47.428987 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:37:47.428987 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:37:47.428987 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 08:37:47.428987 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 08:37:47.428987 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 08:37:47.430092 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 08:37:47.430092 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:37:47.430092 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:37:47.430092 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:37:47.430092 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:37:47.430092 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:37:47.430092 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:37:47.430092 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:37:47.430092 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application with Lock( Jul 28 08:37:47.430092 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:37:47.430092 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:37:47.430092 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:37:47.430092 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:37:47.430092 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:37:47.430092 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:37:47.430092 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:37:47.430092 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:37:47.431300 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 08:37:47.431300 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 08:37:47.431300 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 08:37:47.431300 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application Jul 28 08:37:47.431300 dv-cinder-851351-1-smb devstack@keystone.service[282899]: [pid: 282899|app: 0|req: 490/985] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 08:37:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:37:47.436235 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282e5280-1902-4160-9fc1-8aa42a8d7c4f None admin] Authenticating user token {{(pid=282898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:37:47.491886 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG dbcounter [-] [282898] Writing DB stats keystone:SELECT=100 {{(pid=282898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:37:47.547230 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282e5280-1902-4160-9fc1-8aa42a8d7c4f None admin] Validating token access rules against request {{(pid=282898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:37:47.583074 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbd899a-22d8-45ac-8c91-0afbf296f634 None None] REQUEST_METHOD: `GET` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:37:47.583295 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5703b797-dd73-4a4e-929c-f91198e67d97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:37:47.583436 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbd899a-22d8-45ac-8c91-0afbf296f634 None None] SCRIPT_NAME: `/identity` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:37:47.583708 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbd899a-22d8-45ac-8c91-0afbf296f634 None None] PATH_INFO: `/` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:37:47.583819 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5703b797-dd73-4a4e-929c-f91198e67d97 None admin] REQUEST_METHOD: `GET` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:37:47.584047 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5703b797-dd73-4a4e-929c-f91198e67d97 None admin] SCRIPT_NAME: `/identity` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:37:47.584329 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5703b797-dd73-4a4e-929c-f91198e67d97 None admin] PATH_INFO: `/v3/domains` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:37:47.585178 dv-cinder-851351-1-smb devstack@keystone.service[282899]: [pid: 282899|app: 0|req: 491/986] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 08:37:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 08:37:47.585307 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5703b797-dd73-4a4e-929c-f91198e67d97 None admin] RBAC: Adding query filter params (name=Default) {{(pid=282898) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:37:47.585403 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5703b797-dd73-4a4e-929c-f91198e67d97 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:37:47.586759 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5703b797-dd73-4a4e-929c-f91198e67d97 None admin] RBAC: Authorization granted {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:37:47.590086 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5afe11ef-2b5a-401e-afaf-41f30eac3304 None None] REQUEST_METHOD: `POST` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:37:47.590375 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5afe11ef-2b5a-401e-afaf-41f30eac3304 None None] SCRIPT_NAME: `/identity` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:37:47.590651 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5afe11ef-2b5a-401e-afaf-41f30eac3304 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:37:47.604728 dv-cinder-851351-1-smb devstack@keystone.service[282898]: [pid: 282898|app: 0|req: 496/987] 10.222.0.42 () {56 vars in 1109 bytes} [Thu Jul 28 08:37:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:37:47.606297 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5703b797-dd73-4a4e-929c-f91198e67d97 None admin] Authenticating user token {{(pid=282898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:37:47.609574 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.auth.core [None req-5afe11ef-2b5a-401e-afaf-41f30eac3304 None None] MFA Rules not processed for user `2be990a66857410a87ffa7609aec4f7b`. Rule list: `[]` (Enabled: `True`). {{(pid=282899) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 08:37:47.611647 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.fernet_utils [None req-5afe11ef-2b5a-401e-afaf-41f30eac3304 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=282899) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:37:47.704538 dv-cinder-851351-1-smb devstack@keystone.service[282899]: [pid: 282899|app: 0|req: 492/988] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 08:37:47 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 28 08:37:47.723461 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5703b797-dd73-4a4e-929c-f91198e67d97 None admin] Validating token access rules against request {{(pid=282898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:37:47.728239 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5afe11ef-2b5a-401e-afaf-41f30eac3304 None None] Authenticating user token {{(pid=282899) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:37:47.735718 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG dbcounter [-] [282898] Writing DB stats keystone:SELECT=100 {{(pid=282898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:37:47.765120 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d289f21a-c98f-48d5-ad7a-89ff008197e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:37:47.765751 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d289f21a-c98f-48d5-ad7a-89ff008197e9 None admin] REQUEST_METHOD: `GET` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:37:47.766068 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d289f21a-c98f-48d5-ad7a-89ff008197e9 None admin] SCRIPT_NAME: `/identity` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:37:47.766394 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d289f21a-c98f-48d5-ad7a-89ff008197e9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:37:47.774708 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d289f21a-c98f-48d5-ad7a-89ff008197e9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:37:47.776285 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d289f21a-c98f-48d5-ad7a-89ff008197e9 None admin] RBAC: Authorization granted {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:37:47.788956 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application [None req-d289f21a-c98f-48d5-ad7a-89ff008197e9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 08:37:47.788956 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:37:47.788956 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:37:47.788956 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:37:47.788956 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:37:47.788956 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:37:47.788956 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:37:47.788956 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:37:47.788956 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:37:47.788956 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:37:47.788956 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:37:47.788956 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:37:47.788956 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 28 08:37:47.788956 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 28 08:37:47.788956 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 28 08:37:47.790097 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 28 08:37:47.790097 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:37:47.790097 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:37:47.790097 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:37:47.790097 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:37:47.790097 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:37:47.790097 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:37:47.790097 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:37:47.790097 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application with Lock( Jul 28 08:37:47.790097 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:37:47.790097 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:37:47.790097 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:37:47.790097 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:37:47.790097 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:37:47.790097 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:37:47.790097 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:37:47.790097 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:37:47.791301 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 28 08:37:47.791301 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 28 08:37:47.791301 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 28 08:37:47.791301 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 28 08:37:47.791301 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 28 08:37:47.791301 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 28 08:37:47.791301 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 08:37:47.791301 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application Jul 28 08:37:47.791301 dv-cinder-851351-1-smb devstack@keystone.service[282898]: [pid: 282898|app: 0|req: 497/989] 10.222.0.42 () {56 vars in 1111 bytes} [Thu Jul 28 08:37:47 2022] GET /identity/v3/projects/service => generated 88 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 08:37:47.796074 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d289f21a-c98f-48d5-ad7a-89ff008197e9 None admin] Authenticating user token {{(pid=282898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:37:47.846280 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG dbcounter [-] [282899] Writing DB stats keystone:SELECT=100 {{(pid=282899) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:37:47.858858 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5afe11ef-2b5a-401e-afaf-41f30eac3304 None None] Validating token access rules against request {{(pid=282899) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:37:47.898077 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44640433-bf67-42aa-b3d0-d7818e20a55e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282899) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:37:47.898743 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44640433-bf67-42aa-b3d0-d7818e20a55e None admin] REQUEST_METHOD: `GET` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:37:47.899034 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44640433-bf67-42aa-b3d0-d7818e20a55e None admin] SCRIPT_NAME: `/identity` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:37:47.899316 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44640433-bf67-42aa-b3d0-d7818e20a55e None admin] PATH_INFO: `/v3/services/object-store` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:37:47.899973 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44640433-bf67-42aa-b3d0-d7818e20a55e None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:37:47.901427 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44640433-bf67-42aa-b3d0-d7818e20a55e None admin] RBAC: Authorization granted {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:37:47.911280 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application [None req-44640433-bf67-42aa-b3d0-d7818e20a55e None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 28 08:37:47.911280 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:37:47.911280 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 28 08:37:47.911280 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 28 08:37:47.911280 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 28 08:37:47.911280 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 28 08:37:47.911280 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 28 08:37:47.911280 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 08:37:47.911280 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 28 08:37:47.911280 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application Jul 28 08:37:47.911280 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 28 08:37:47.911280 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application Jul 28 08:37:47.911280 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:37:47.911280 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:37:47.911280 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:37:47.911280 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:37:47.911280 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:37:47.912565 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:37:47.912565 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:37:47.912565 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:37:47.912565 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:37:47.912565 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:37:47.912565 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:37:47.912565 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 28 08:37:47.912565 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 28 08:37:47.912565 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 28 08:37:47.912565 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 28 08:37:47.912565 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:37:47.912565 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:37:47.912565 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:37:47.912565 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:37:47.912565 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:37:47.912565 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:37:47.913631 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:37:47.913631 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application with Lock( Jul 28 08:37:47.913631 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:37:47.913631 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:37:47.913631 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:37:47.913631 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:37:47.913631 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:37:47.913631 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:37:47.913631 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:37:47.913631 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:37:47.913631 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 28 08:37:47.913631 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 08:37:47.913631 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 28 08:37:47.913631 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application Jul 28 08:37:47.913631 dv-cinder-851351-1-smb devstack@keystone.service[282899]: [pid: 282899|app: 0|req: 493/990] 10.222.0.42 () {56 vars in 1126 bytes} [Thu Jul 28 08:37:47 2022] GET /identity/v3/services/object-store => generated 93 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:37:47.918818 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44640433-bf67-42aa-b3d0-d7818e20a55e None admin] Authenticating user token {{(pid=282899) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:37:47.920697 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d289f21a-c98f-48d5-ad7a-89ff008197e9 None admin] Validating token access rules against request {{(pid=282898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:37:47.963408 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc1e952c-1f02-4ac8-b2a5-dbd293b796e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:37:47.964032 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1e952c-1f02-4ac8-b2a5-dbd293b796e0 None admin] REQUEST_METHOD: `GET` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:37:47.964283 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1e952c-1f02-4ac8-b2a5-dbd293b796e0 None admin] SCRIPT_NAME: `/identity` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:37:47.964568 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1e952c-1f02-4ac8-b2a5-dbd293b796e0 None admin] PATH_INFO: `/v3/projects` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:37:47.965411 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc1e952c-1f02-4ac8-b2a5-dbd293b796e0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=282898) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:37:47.965722 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc1e952c-1f02-4ac8-b2a5-dbd293b796e0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:37:47.967257 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc1e952c-1f02-4ac8-b2a5-dbd293b796e0 None admin] RBAC: Authorization granted {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:37:47.981136 dv-cinder-851351-1-smb devstack@keystone.service[282898]: [pid: 282898|app: 0|req: 498/991] 10.222.0.42 () {56 vars in 1148 bytes} [Thu Jul 28 08:37:47 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:37:47.987133 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc1e952c-1f02-4ac8-b2a5-dbd293b796e0 None admin] Authenticating user token {{(pid=282898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:37:48.020117 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG dbcounter [-] [282898] Writing DB stats keystone:SELECT=100 {{(pid=282898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:37:48.046838 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44640433-bf67-42aa-b3d0-d7818e20a55e None admin] Validating token access rules against request {{(pid=282899) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:37:48.085627 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b104ba16-ffc3-49c6-9b05-fc2f8e2a8cef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282899) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:37:48.086280 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b104ba16-ffc3-49c6-9b05-fc2f8e2a8cef None admin] REQUEST_METHOD: `GET` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:37:48.086565 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b104ba16-ffc3-49c6-9b05-fc2f8e2a8cef None admin] SCRIPT_NAME: `/identity` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:37:48.086842 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b104ba16-ffc3-49c6-9b05-fc2f8e2a8cef None admin] PATH_INFO: `/v3/services` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:37:48.087551 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b104ba16-ffc3-49c6-9b05-fc2f8e2a8cef None admin] RBAC: Adding query filter params (name=object-store) {{(pid=282899) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:37:48.087863 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b104ba16-ffc3-49c6-9b05-fc2f8e2a8cef None admin] RBAC: Authorizing `identity:list_services()` {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:37:48.089357 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b104ba16-ffc3-49c6-9b05-fc2f8e2a8cef None admin] RBAC: Authorization granted {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:37:48.095249 dv-cinder-851351-1-smb devstack@keystone.service[282899]: [pid: 282899|app: 0|req: 494/992] 10.222.0.42 () {56 vars in 1122 bytes} [Thu Jul 28 08:37:47 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 08:37:48.100994 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b104ba16-ffc3-49c6-9b05-fc2f8e2a8cef None admin] Authenticating user token {{(pid=282899) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:37:48.109738 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc1e952c-1f02-4ac8-b2a5-dbd293b796e0 None admin] Validating token access rules against request {{(pid=282898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:37:48.128579 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG dbcounter [-] [282899] Writing DB stats keystone:SELECT=100 {{(pid=282899) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:37:48.152960 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2daa5ba9-8982-464e-8c49-585d5f32d545 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:37:48.153367 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2daa5ba9-8982-464e-8c49-585d5f32d545 None admin] REQUEST_METHOD: `GET` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:37:48.153656 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2daa5ba9-8982-464e-8c49-585d5f32d545 None admin] SCRIPT_NAME: `/identity` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:37:48.153930 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2daa5ba9-8982-464e-8c49-585d5f32d545 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:37:48.154754 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2daa5ba9-8982-464e-8c49-585d5f32d545 None admin] RBAC: Adding query filter params (role.id=f33deecb73a247c0b6c50fe050d1ef3a, scope.project.id=5cde68cbfb9042dc9f36af3aacea2473, user.id=f4a66540de9f46a2bc490af024cc37cd) {{(pid=282898) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:37:48.155071 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2daa5ba9-8982-464e-8c49-585d5f32d545 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:37:48.156560 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2daa5ba9-8982-464e-8c49-585d5f32d545 None admin] RBAC: Authorization granted {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:37:48.172859 dv-cinder-851351-1-smb devstack@keystone.service[282898]: [pid: 282898|app: 0|req: 499/993] 10.222.0.42 () {56 vars in 1374 bytes} [Thu Jul 28 08:37:47 2022] GET /identity/v3/role_assignments?user.id=f4a66540de9f46a2bc490af024cc37cd&scope.project.id=5cde68cbfb9042dc9f36af3aacea2473&role.id=f33deecb73a247c0b6c50fe050d1ef3a => generated 608 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 08:37:48.232984 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b104ba16-ffc3-49c6-9b05-fc2f8e2a8cef None admin] Validating token access rules against request {{(pid=282899) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:37:48.271820 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebac6cf2-2267-45e4-9bd9-79c5711489e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282899) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:37:48.272481 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebac6cf2-2267-45e4-9bd9-79c5711489e8 None admin] REQUEST_METHOD: `GET` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:37:48.272851 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebac6cf2-2267-45e4-9bd9-79c5711489e8 None admin] SCRIPT_NAME: `/identity` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:37:48.273145 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebac6cf2-2267-45e4-9bd9-79c5711489e8 None admin] PATH_INFO: `/v3/services` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:37:48.273890 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebac6cf2-2267-45e4-9bd9-79c5711489e8 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=282899) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:37:48.274213 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebac6cf2-2267-45e4-9bd9-79c5711489e8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:37:48.275631 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebac6cf2-2267-45e4-9bd9-79c5711489e8 None admin] RBAC: Authorization granted {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:37:48.287196 dv-cinder-851351-1-smb devstack@keystone.service[282899]: [pid: 282899|app: 0|req: 495/994] 10.222.0.42 () {56 vars in 1122 bytes} [Thu Jul 28 08:37:48 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:37:48.288284 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2daa5ba9-8982-464e-8c49-585d5f32d545 None admin] Authenticating user token {{(pid=282898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:37:48.395172 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG dbcounter [-] [282898] Writing DB stats keystone:SELECT=100 {{(pid=282898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:37:48.405282 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2daa5ba9-8982-464e-8c49-585d5f32d545 None admin] Validating token access rules against request {{(pid=282898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:37:48.443301 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e985650-e5f0-48bd-8544-0dbbc1a395a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:37:48.444002 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e985650-e5f0-48bd-8544-0dbbc1a395a6 None admin] REQUEST_METHOD: `GET` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:37:48.444261 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e985650-e5f0-48bd-8544-0dbbc1a395a6 None admin] SCRIPT_NAME: `/identity` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:37:48.444562 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e985650-e5f0-48bd-8544-0dbbc1a395a6 None admin] PATH_INFO: `/v3/endpoints` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:37:48.445364 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e985650-e5f0-48bd-8544-0dbbc1a395a6 None admin] RBAC: Adding query filter params (interface=admin, service_id=19a96342187147f18afff556f253dfec, region_id=RegionOne) {{(pid=282898) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:37:48.445681 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e985650-e5f0-48bd-8544-0dbbc1a395a6 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:37:48.447052 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e985650-e5f0-48bd-8544-0dbbc1a395a6 None admin] RBAC: Authorization granted {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:37:48.453171 dv-cinder-851351-1-smb devstack@keystone.service[282898]: [pid: 282898|app: 0|req: 500/995] 10.222.0.42 () {56 vars in 1249 bytes} [Thu Jul 28 08:37:48 2022] GET /identity/v3/endpoints?service_id=19a96342187147f18afff556f253dfec&interface=admin®ion_id=RegionOne => generated 193 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:37:48.459238 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebac6cf2-2267-45e4-9bd9-79c5711489e8 None admin] Authenticating user token {{(pid=282899) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:37:48.551426 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG dbcounter [-] [282899] Writing DB stats keystone:SELECT=100 {{(pid=282899) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:37:48.569754 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebac6cf2-2267-45e4-9bd9-79c5711489e8 None admin] Validating token access rules against request {{(pid=282899) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:37:48.608907 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8752ed08-3545-42c3-8d0a-11ee3d5a8f49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282899) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:37:48.609545 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8752ed08-3545-42c3-8d0a-11ee3d5a8f49 None admin] REQUEST_METHOD: `GET` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:37:48.609825 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8752ed08-3545-42c3-8d0a-11ee3d5a8f49 None admin] SCRIPT_NAME: `/identity` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:37:48.610097 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8752ed08-3545-42c3-8d0a-11ee3d5a8f49 None admin] PATH_INFO: `/v3/services` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:37:48.610761 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8752ed08-3545-42c3-8d0a-11ee3d5a8f49 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:37:48.612201 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8752ed08-3545-42c3-8d0a-11ee3d5a8f49 None admin] RBAC: Authorization granted {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:37:48.624695 dv-cinder-851351-1-smb devstack@keystone.service[282899]: [pid: 282899|app: 0|req: 496/996] 10.222.0.42 () {56 vars in 1087 bytes} [Thu Jul 28 08:37:48 2022] GET /identity/v3/services => generated 1727 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 08:37:49.289380 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4edcf4-6c49-4b86-8a01-81b8f3d7f10a None None] REQUEST_METHOD: `GET` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:37:49.289629 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4edcf4-6c49-4b86-8a01-81b8f3d7f10a None None] SCRIPT_NAME: `/identity` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:37:49.289919 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4edcf4-6c49-4b86-8a01-81b8f3d7f10a None None] PATH_INFO: `/` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:37:49.291472 dv-cinder-851351-1-smb devstack@keystone.service[282898]: [pid: 282898|app: 0|req: 501/997] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 08:37:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 08:37:49.297026 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79373cf8-bcdc-43e4-a76f-6a0446f2107d None None] REQUEST_METHOD: `POST` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:37:49.297676 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79373cf8-bcdc-43e4-a76f-6a0446f2107d None None] SCRIPT_NAME: `/identity` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:37:49.297676 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79373cf8-bcdc-43e4-a76f-6a0446f2107d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:37:49.316631 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.auth.core [None req-79373cf8-bcdc-43e4-a76f-6a0446f2107d None None] MFA Rules not processed for user `2be990a66857410a87ffa7609aec4f7b`. Rule list: `[]` (Enabled: `True`). {{(pid=282899) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 08:37:49.317883 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.fernet_utils [None req-79373cf8-bcdc-43e4-a76f-6a0446f2107d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=282899) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:37:49.393458 dv-cinder-851351-1-smb devstack@keystone.service[282899]: [pid: 282899|app: 0|req: 497/998] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 08:37:49 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 08:37:49.415841 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd4edcf4-6c49-4b86-8a01-81b8f3d7f10a None None] Authenticating user token {{(pid=282898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:37:49.522393 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd4edcf4-6c49-4b86-8a01-81b8f3d7f10a None None] Validating token access rules against request {{(pid=282898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:37:49.556324 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a977705-8386-4624-87ef-3cff06cfcc67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:37:49.556914 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a977705-8386-4624-87ef-3cff06cfcc67 None admin] REQUEST_METHOD: `GET` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:37:49.557197 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a977705-8386-4624-87ef-3cff06cfcc67 None admin] SCRIPT_NAME: `/identity` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:37:49.557491 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a977705-8386-4624-87ef-3cff06cfcc67 None admin] PATH_INFO: `/v3/services/compute` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:37:49.558092 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a977705-8386-4624-87ef-3cff06cfcc67 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:37:49.559477 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a977705-8386-4624-87ef-3cff06cfcc67 None admin] RBAC: Authorization granted {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:37:49.568886 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application [None req-6a977705-8386-4624-87ef-3cff06cfcc67 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jul 28 08:37:49.568886 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:37:49.568886 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 28 08:37:49.568886 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 28 08:37:49.568886 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 28 08:37:49.568886 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 28 08:37:49.568886 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 28 08:37:49.568886 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 08:37:49.568886 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 28 08:37:49.568886 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application Jul 28 08:37:49.568886 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 28 08:37:49.568886 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application Jul 28 08:37:49.568886 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:37:49.568886 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:37:49.568886 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:37:49.568886 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:37:49.568886 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:37:49.570053 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:37:49.570053 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:37:49.570053 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:37:49.570053 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:37:49.570053 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:37:49.570053 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:37:49.570053 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 28 08:37:49.570053 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 28 08:37:49.570053 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 28 08:37:49.570053 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 28 08:37:49.570053 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:37:49.570053 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:37:49.570053 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:37:49.570053 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:37:49.570053 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:37:49.570053 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:37:49.571064 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:37:49.571064 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application with Lock( Jul 28 08:37:49.571064 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:37:49.571064 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:37:49.571064 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:37:49.571064 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:37:49.571064 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:37:49.571064 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:37:49.571064 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:37:49.571064 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:37:49.571064 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 28 08:37:49.571064 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 08:37:49.571064 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 28 08:37:49.571064 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application Jul 28 08:37:49.573013 dv-cinder-851351-1-smb devstack@keystone.service[282898]: [pid: 282898|app: 0|req: 502/999] 10.222.0.42 () {56 vars in 1111 bytes} [Thu Jul 28 08:37:49 2022] GET /identity/v3/services/compute => generated 88 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:37:49.576395 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79373cf8-bcdc-43e4-a76f-6a0446f2107d None None] Authenticating user token {{(pid=282899) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:37:49.659060 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG dbcounter [-] [282899] Writing DB stats keystone:SELECT=100 {{(pid=282899) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:37:49.690526 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79373cf8-bcdc-43e4-a76f-6a0446f2107d None None] Validating token access rules against request {{(pid=282899) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:37:49.740835 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7545e12-5662-4b38-8535-3b492b321778 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282899) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:37:49.741483 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7545e12-5662-4b38-8535-3b492b321778 None admin] REQUEST_METHOD: `GET` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:37:49.741765 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7545e12-5662-4b38-8535-3b492b321778 None admin] SCRIPT_NAME: `/identity` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:37:49.742038 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7545e12-5662-4b38-8535-3b492b321778 None admin] PATH_INFO: `/v3/services` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:37:49.742740 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7545e12-5662-4b38-8535-3b492b321778 None admin] RBAC: Adding query filter params (name=compute) {{(pid=282899) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:37:49.743048 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7545e12-5662-4b38-8535-3b492b321778 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:37:49.744444 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7545e12-5662-4b38-8535-3b492b321778 None admin] RBAC: Authorization granted {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:37:49.755282 dv-cinder-851351-1-smb devstack@keystone.service[282899]: [pid: 282899|app: 0|req: 498/1000] 10.222.0.42 () {56 vars in 1112 bytes} [Thu Jul 28 08:37:49 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:37:49.756453 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a977705-8386-4624-87ef-3cff06cfcc67 None admin] Authenticating user token {{(pid=282898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:37:49.780848 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG dbcounter [-] [282898] Writing DB stats keystone:SELECT=100 {{(pid=282898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:37:49.877141 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a977705-8386-4624-87ef-3cff06cfcc67 None admin] Validating token access rules against request {{(pid=282898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:37:49.913151 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00dc4179-924a-46eb-b829-e8d89bd0ed0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:37:49.913776 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00dc4179-924a-46eb-b829-e8d89bd0ed0f None admin] REQUEST_METHOD: `GET` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:37:49.914054 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00dc4179-924a-46eb-b829-e8d89bd0ed0f None admin] SCRIPT_NAME: `/identity` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:37:49.914327 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00dc4179-924a-46eb-b829-e8d89bd0ed0f None admin] PATH_INFO: `/v3/services` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:37:49.915014 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00dc4179-924a-46eb-b829-e8d89bd0ed0f None admin] RBAC: Adding query filter params (type=compute) {{(pid=282898) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:37:49.915316 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00dc4179-924a-46eb-b829-e8d89bd0ed0f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:37:49.916694 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00dc4179-924a-46eb-b829-e8d89bd0ed0f None admin] RBAC: Authorization granted {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:37:49.922031 dv-cinder-851351-1-smb devstack@keystone.service[282898]: [pid: 282898|app: 0|req: 503/1001] 10.222.0.42 () {56 vars in 1112 bytes} [Thu Jul 28 08:37:49 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:37:49.927724 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7545e12-5662-4b38-8535-3b492b321778 None admin] Authenticating user token {{(pid=282899) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:37:50.030213 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7545e12-5662-4b38-8535-3b492b321778 None admin] Validating token access rules against request {{(pid=282899) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:37:50.066750 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97cbe828-76be-4ec3-9b5c-3edd6e4fbf54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282899) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:37:50.067302 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97cbe828-76be-4ec3-9b5c-3edd6e4fbf54 None admin] REQUEST_METHOD: `POST` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:37:50.067582 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97cbe828-76be-4ec3-9b5c-3edd6e4fbf54 None admin] SCRIPT_NAME: `/identity` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:37:50.067857 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97cbe828-76be-4ec3-9b5c-3edd6e4fbf54 None admin] PATH_INFO: `/v3/endpoints` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:37:50.068591 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97cbe828-76be-4ec3-9b5c-3edd6e4fbf54 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:37:50.070002 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97cbe828-76be-4ec3-9b5c-3edd6e4fbf54 None admin] RBAC: Authorization granted {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:37:50.087441 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG dbcounter [-] [282899] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=282899) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:37:50.100716 dv-cinder-851351-1-smb devstack@keystone.service[282899]: [pid: 282899|app: 0|req: 499/1002] 10.222.0.42 () {60 vars in 1144 bytes} [Thu Jul 28 08:37:49 2022] POST /identity/v3/endpoints => generated 334 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 08:37:50.245195 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ccb6a6-ea8f-4754-ab0a-3b162a0cb5bb None None] REQUEST_METHOD: `GET` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:37:50.245478 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ccb6a6-ea8f-4754-ab0a-3b162a0cb5bb None None] SCRIPT_NAME: `/identity` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:37:50.245714 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ccb6a6-ea8f-4754-ab0a-3b162a0cb5bb None None] PATH_INFO: `/` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:37:50.247295 dv-cinder-851351-1-smb devstack@keystone.service[282898]: [pid: 282898|app: 0|req: 504/1003] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 08:37:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 08:37:50.253007 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f2cb1b-c289-49bb-8ca9-6acb385ecffc None None] REQUEST_METHOD: `POST` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:37:50.253286 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f2cb1b-c289-49bb-8ca9-6acb385ecffc None None] SCRIPT_NAME: `/identity` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:37:50.253581 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f2cb1b-c289-49bb-8ca9-6acb385ecffc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:37:50.274993 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.auth.core [None req-a3f2cb1b-c289-49bb-8ca9-6acb385ecffc None None] MFA Rules not processed for user `2be990a66857410a87ffa7609aec4f7b`. Rule list: `[]` (Enabled: `True`). {{(pid=282899) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 08:37:50.276526 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.fernet_utils [None req-a3f2cb1b-c289-49bb-8ca9-6acb385ecffc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=282899) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:37:50.353686 dv-cinder-851351-1-smb devstack@keystone.service[282899]: [pid: 282899|app: 0|req: 500/1004] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 08:37:50 2022] POST /identity/v3/auth/tokens => generated 1716 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 08:37:50.377424 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ccb6a6-ea8f-4754-ab0a-3b162a0cb5bb None None] Authenticating user token {{(pid=282898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:37:50.470842 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG dbcounter [-] [282898] Writing DB stats keystone:SELECT=100 {{(pid=282898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:37:50.489647 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ccb6a6-ea8f-4754-ab0a-3b162a0cb5bb None None] Validating token access rules against request {{(pid=282898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:37:50.525396 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d5053f-21de-4131-baae-7e1c9089d977 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:37:50.526107 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d5053f-21de-4131-baae-7e1c9089d977 None admin] REQUEST_METHOD: `GET` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:37:50.526377 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d5053f-21de-4131-baae-7e1c9089d977 None admin] SCRIPT_NAME: `/identity` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:37:50.526581 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d5053f-21de-4131-baae-7e1c9089d977 None admin] PATH_INFO: `/v3/services/image` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:37:50.527215 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d5053f-21de-4131-baae-7e1c9089d977 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:37:50.528592 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d5053f-21de-4131-baae-7e1c9089d977 None admin] RBAC: Authorization granted {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:37:50.537905 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application [None req-88d5053f-21de-4131-baae-7e1c9089d977 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jul 28 08:37:50.537905 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:37:50.537905 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 28 08:37:50.537905 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 28 08:37:50.537905 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 28 08:37:50.537905 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 28 08:37:50.537905 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 28 08:37:50.537905 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 08:37:50.537905 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 28 08:37:50.537905 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application Jul 28 08:37:50.537905 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 28 08:37:50.537905 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application Jul 28 08:37:50.537905 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:37:50.537905 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:37:50.537905 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:37:50.537905 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:37:50.537905 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:37:50.539141 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:37:50.539141 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:37:50.539141 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:37:50.539141 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:37:50.539141 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:37:50.539141 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:37:50.539141 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 28 08:37:50.539141 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 28 08:37:50.539141 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 28 08:37:50.539141 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 28 08:37:50.539141 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:37:50.539141 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:37:50.539141 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:37:50.539141 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:37:50.539141 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:37:50.539141 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:37:50.540165 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:37:50.540165 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application with Lock( Jul 28 08:37:50.540165 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:37:50.540165 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:37:50.540165 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:37:50.540165 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:37:50.540165 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:37:50.540165 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:37:50.540165 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:37:50.540165 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:37:50.540165 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 28 08:37:50.540165 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 08:37:50.540165 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 28 08:37:50.540165 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application Jul 28 08:37:50.540165 dv-cinder-851351-1-smb devstack@keystone.service[282898]: [pid: 282898|app: 0|req: 505/1005] 10.222.0.42 () {56 vars in 1105 bytes} [Thu Jul 28 08:37:50 2022] GET /identity/v3/services/image => generated 86 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:37:50.547394 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f2cb1b-c289-49bb-8ca9-6acb385ecffc None None] Authenticating user token {{(pid=282899) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:37:50.658011 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f2cb1b-c289-49bb-8ca9-6acb385ecffc None None] Validating token access rules against request {{(pid=282899) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:37:50.659182 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c312a3e-4a4f-4cd9-b475-678649b4f11f None None] REQUEST_METHOD: `GET` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:37:50.659579 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c312a3e-4a4f-4cd9-b475-678649b4f11f None None] SCRIPT_NAME: `/identity` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:37:50.659943 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c312a3e-4a4f-4cd9-b475-678649b4f11f None None] PATH_INFO: `/` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:37:50.664708 dv-cinder-851351-1-smb devstack@keystone.service[282898]: [pid: 282898|app: 0|req: 506/1006] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 08:37:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 28 08:37:50.667282 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795e47f2-a6ea-4f32-b4c2-6342579ca895 None None] REQUEST_METHOD: `POST` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:37:50.667567 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795e47f2-a6ea-4f32-b4c2-6342579ca895 None None] SCRIPT_NAME: `/identity` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:37:50.667838 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795e47f2-a6ea-4f32-b4c2-6342579ca895 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:37:50.686890 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.auth.core [None req-795e47f2-a6ea-4f32-b4c2-6342579ca895 None None] MFA Rules not processed for user `2be990a66857410a87ffa7609aec4f7b`. Rule list: `[]` (Enabled: `True`). {{(pid=282898) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 08:37:50.688086 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.fernet_utils [None req-795e47f2-a6ea-4f32-b4c2-6342579ca895 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=282898) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:37:50.689699 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG dbcounter [-] [282899] Writing DB stats keystone:SELECT=100 {{(pid=282899) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:37:50.703645 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703919e9-0f44-4af9-a100-a3419d806368 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282899) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:37:50.705102 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703919e9-0f44-4af9-a100-a3419d806368 None admin] REQUEST_METHOD: `GET` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:37:50.705634 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703919e9-0f44-4af9-a100-a3419d806368 None admin] SCRIPT_NAME: `/identity` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:37:50.705847 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703919e9-0f44-4af9-a100-a3419d806368 None admin] PATH_INFO: `/v3/services` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:37:50.706527 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-703919e9-0f44-4af9-a100-a3419d806368 None admin] RBAC: Adding query filter params (name=image) {{(pid=282899) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:37:50.706822 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-703919e9-0f44-4af9-a100-a3419d806368 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:37:50.708239 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-703919e9-0f44-4af9-a100-a3419d806368 None admin] RBAC: Authorization granted {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:37:50.715606 dv-cinder-851351-1-smb devstack@keystone.service[282899]: [pid: 282899|app: 0|req: 501/1007] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 08:37:50 2022] GET /identity/v3/services?name=image => generated 122 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:37:50.721034 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703919e9-0f44-4af9-a100-a3419d806368 None admin] Authenticating user token {{(pid=282899) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:37:50.763383 dv-cinder-851351-1-smb devstack@keystone.service[282898]: [pid: 282898|app: 0|req: 507/1008] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 08:37:50 2022] POST /identity/v3/auth/tokens => generated 1716 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 28 08:37:50.785841 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-795e47f2-a6ea-4f32-b4c2-6342579ca895 None None] Authenticating user token {{(pid=282898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:37:50.835290 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703919e9-0f44-4af9-a100-a3419d806368 None admin] Validating token access rules against request {{(pid=282899) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:37:50.869126 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff14696b-a9f1-4176-8842-dc9c6e74c2be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282899) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:37:50.869854 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff14696b-a9f1-4176-8842-dc9c6e74c2be None admin] REQUEST_METHOD: `GET` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:37:50.870136 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff14696b-a9f1-4176-8842-dc9c6e74c2be None admin] SCRIPT_NAME: `/identity` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:37:50.870506 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff14696b-a9f1-4176-8842-dc9c6e74c2be None admin] PATH_INFO: `/v3/services` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:37:50.871195 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff14696b-a9f1-4176-8842-dc9c6e74c2be None admin] RBAC: Adding query filter params (type=image) {{(pid=282899) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:37:50.871502 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff14696b-a9f1-4176-8842-dc9c6e74c2be None admin] RBAC: Authorizing `identity:list_services()` {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:37:50.872918 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff14696b-a9f1-4176-8842-dc9c6e74c2be None admin] RBAC: Authorization granted {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:37:50.888698 dv-cinder-851351-1-smb devstack@keystone.service[282899]: [pid: 282899|app: 0|req: 502/1009] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 08:37:50 2022] GET /identity/v3/services?type=image => generated 122 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 08:37:50.888935 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG dbcounter [-] [282898] Writing DB stats keystone:SELECT=100 {{(pid=282898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:37:50.913056 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-795e47f2-a6ea-4f32-b4c2-6342579ca895 None None] Validating token access rules against request {{(pid=282898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:37:50.953707 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa4971d-bf80-4476-8aee-8e1ec352421b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:37:50.954816 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa4971d-bf80-4476-8aee-8e1ec352421b None admin] REQUEST_METHOD: `GET` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:37:50.955104 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa4971d-bf80-4476-8aee-8e1ec352421b None admin] SCRIPT_NAME: `/identity` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:37:50.955377 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa4971d-bf80-4476-8aee-8e1ec352421b None admin] PATH_INFO: `/v3/services/object-store` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:37:50.956024 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa4971d-bf80-4476-8aee-8e1ec352421b None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:37:50.957457 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa4971d-bf80-4476-8aee-8e1ec352421b None admin] RBAC: Authorization granted {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:37:50.967515 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application [None req-caa4971d-bf80-4476-8aee-8e1ec352421b None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 28 08:37:50.967515 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:37:50.967515 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 28 08:37:50.967515 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 28 08:37:50.967515 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 28 08:37:50.967515 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 28 08:37:50.967515 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 28 08:37:50.967515 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 08:37:50.967515 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 28 08:37:50.967515 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application Jul 28 08:37:50.967515 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 28 08:37:50.967515 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application Jul 28 08:37:50.967515 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:37:50.967515 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:37:50.967515 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:37:50.967515 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:37:50.967515 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:37:50.968837 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:37:50.968837 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:37:50.968837 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:37:50.968837 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:37:50.968837 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:37:50.968837 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:37:50.968837 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 28 08:37:50.968837 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 28 08:37:50.968837 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 28 08:37:50.968837 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 28 08:37:50.968837 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:37:50.968837 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:37:50.968837 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:37:50.968837 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:37:50.968837 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:37:50.968837 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:37:50.970914 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:37:50.970914 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application with Lock( Jul 28 08:37:50.970914 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:37:50.970914 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:37:50.970914 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:37:50.970914 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:37:50.970914 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:37:50.970914 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:37:50.970914 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:37:50.970914 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:37:50.970914 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 28 08:37:50.970914 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 08:37:50.970914 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 28 08:37:50.970914 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application Jul 28 08:37:50.970914 dv-cinder-851351-1-smb devstack@keystone.service[282898]: [pid: 282898|app: 0|req: 508/1010] 10.222.0.42 () {56 vars in 1126 bytes} [Thu Jul 28 08:37:50 2022] GET /identity/v3/services/object-store => generated 93 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:37:50.975247 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff14696b-a9f1-4176-8842-dc9c6e74c2be None admin] Authenticating user token {{(pid=282899) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:37:51.035210 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG dbcounter [-] [282899] Writing DB stats keystone:SELECT=100 {{(pid=282899) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:37:51.092464 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff14696b-a9f1-4176-8842-dc9c6e74c2be None admin] Validating token access rules against request {{(pid=282899) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:37:51.127507 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29109839-3670-4d1a-bab4-f56f9430eb14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282899) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:37:51.128142 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29109839-3670-4d1a-bab4-f56f9430eb14 None admin] REQUEST_METHOD: `GET` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:37:51.128423 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29109839-3670-4d1a-bab4-f56f9430eb14 None admin] SCRIPT_NAME: `/identity` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:37:51.128718 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29109839-3670-4d1a-bab4-f56f9430eb14 None admin] PATH_INFO: `/v3/services` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:37:51.129416 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29109839-3670-4d1a-bab4-f56f9430eb14 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=282899) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:37:51.129725 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29109839-3670-4d1a-bab4-f56f9430eb14 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:37:51.131108 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29109839-3670-4d1a-bab4-f56f9430eb14 None admin] RBAC: Authorization granted {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:37:51.136031 dv-cinder-851351-1-smb devstack@keystone.service[282899]: [pid: 282899|app: 0|req: 503/1011] 10.222.0.42 () {56 vars in 1122 bytes} [Thu Jul 28 08:37:50 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:37:51.141906 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa4971d-bf80-4476-8aee-8e1ec352421b None admin] Authenticating user token {{(pid=282898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:37:51.243417 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa4971d-bf80-4476-8aee-8e1ec352421b None admin] Validating token access rules against request {{(pid=282898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:37:51.277359 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14559c70-69c2-433c-a7e6-b0d5ec04fbbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:37:51.277983 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14559c70-69c2-433c-a7e6-b0d5ec04fbbb None admin] REQUEST_METHOD: `GET` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:37:51.278267 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14559c70-69c2-433c-a7e6-b0d5ec04fbbb None admin] SCRIPT_NAME: `/identity` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:37:51.278563 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14559c70-69c2-433c-a7e6-b0d5ec04fbbb None admin] PATH_INFO: `/v3/services` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:37:51.279250 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14559c70-69c2-433c-a7e6-b0d5ec04fbbb None admin] RBAC: Adding query filter params (type=object-store) {{(pid=282898) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:37:51.279552 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14559c70-69c2-433c-a7e6-b0d5ec04fbbb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:37:51.280957 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14559c70-69c2-433c-a7e6-b0d5ec04fbbb None admin] RBAC: Authorization granted {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:37:51.286069 dv-cinder-851351-1-smb devstack@keystone.service[282898]: [pid: 282898|app: 0|req: 509/1012] 10.222.0.42 () {56 vars in 1122 bytes} [Thu Jul 28 08:37:51 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:37:51.291973 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29109839-3670-4d1a-bab4-f56f9430eb14 None admin] Authenticating user token {{(pid=282899) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:37:51.401122 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29109839-3670-4d1a-bab4-f56f9430eb14 None admin] Validating token access rules against request {{(pid=282899) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:37:51.417804 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG dbcounter [-] [282899] Writing DB stats keystone:SELECT=100 {{(pid=282899) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:37:51.437000 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71820fdc-f05f-493b-9b9c-dbe92325c3f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282899) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:37:51.437632 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71820fdc-f05f-493b-9b9c-dbe92325c3f3 None admin] REQUEST_METHOD: `POST` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:37:51.437911 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71820fdc-f05f-493b-9b9c-dbe92325c3f3 None admin] SCRIPT_NAME: `/identity` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:37:51.438187 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71820fdc-f05f-493b-9b9c-dbe92325c3f3 None admin] PATH_INFO: `/v3/endpoints` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:37:51.439113 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71820fdc-f05f-493b-9b9c-dbe92325c3f3 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:37:51.440498 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71820fdc-f05f-493b-9b9c-dbe92325c3f3 None admin] RBAC: Authorization granted {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:37:51.458939 dv-cinder-851351-1-smb devstack@keystone.service[282899]: [pid: 282899|app: 0|req: 504/1013] 10.222.0.42 () {60 vars in 1144 bytes} [Thu Jul 28 08:37:51 2022] POST /identity/v3/endpoints => generated 325 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 28 08:37:52.233403 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca5be0c-7fa9-49ee-8743-963d96a179d8 None None] REQUEST_METHOD: `GET` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:37:52.234009 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca5be0c-7fa9-49ee-8743-963d96a179d8 None None] SCRIPT_NAME: `/identity` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:37:52.234009 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca5be0c-7fa9-49ee-8743-963d96a179d8 None None] PATH_INFO: `/` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:37:52.235482 dv-cinder-851351-1-smb devstack@keystone.service[282898]: [pid: 282898|app: 0|req: 510/1014] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 08:37:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 08:37:52.240846 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b1ffdc-1a5d-40bd-ac2d-1801e85b37df None None] REQUEST_METHOD: `POST` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:37:52.241121 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b1ffdc-1a5d-40bd-ac2d-1801e85b37df None None] SCRIPT_NAME: `/identity` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:37:52.241419 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b1ffdc-1a5d-40bd-ac2d-1801e85b37df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:37:52.260164 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.auth.core [None req-c1b1ffdc-1a5d-40bd-ac2d-1801e85b37df None None] MFA Rules not processed for user `2be990a66857410a87ffa7609aec4f7b`. Rule list: `[]` (Enabled: `True`). {{(pid=282899) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 08:37:52.261396 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.fernet_utils [None req-c1b1ffdc-1a5d-40bd-ac2d-1801e85b37df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=282899) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:37:52.340034 dv-cinder-851351-1-smb devstack@keystone.service[282899]: [pid: 282899|app: 0|req: 505/1015] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 08:37:52 2022] POST /identity/v3/auth/tokens => generated 1863 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 08:37:52.363184 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca5be0c-7fa9-49ee-8743-963d96a179d8 None None] Authenticating user token {{(pid=282898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:37:52.373401 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG dbcounter [-] [282898] Writing DB stats keystone:SELECT=100 {{(pid=282898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:37:52.485135 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca5be0c-7fa9-49ee-8743-963d96a179d8 None None] Validating token access rules against request {{(pid=282898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:37:52.520329 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1f082f-ee62-407a-a497-c3ef94c18fa3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:37:52.521013 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1f082f-ee62-407a-a497-c3ef94c18fa3 None admin] REQUEST_METHOD: `GET` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:37:52.521289 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1f082f-ee62-407a-a497-c3ef94c18fa3 None admin] SCRIPT_NAME: `/identity` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:37:52.521559 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1f082f-ee62-407a-a497-c3ef94c18fa3 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:37:52.532949 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd1f082f-ee62-407a-a497-c3ef94c18fa3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 08:37:52.537831 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application [None req-bd1f082f-ee62-407a-a497-c3ef94c18fa3 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 28 08:37:52.537831 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:37:52.537831 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:37:52.537831 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:37:52.537831 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:37:52.537831 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:37:52.537831 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:37:52.537831 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:37:52.537831 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:37:52.537831 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:37:52.537831 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:37:52.537831 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:37:52.537831 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 08:37:52.537831 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 08:37:52.537831 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 08:37:52.537831 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 08:37:52.538974 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 08:37:52.538974 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 08:37:52.538974 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 08:37:52.538974 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 08:37:52.538974 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:37:52.538974 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:37:52.538974 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:37:52.538974 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:37:52.538974 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:37:52.538974 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:37:52.538974 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:37:52.538974 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application with Lock( Jul 28 08:37:52.538974 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:37:52.538974 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:37:52.538974 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:37:52.538974 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:37:52.540007 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:37:52.540007 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:37:52.540007 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:37:52.540007 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:37:52.540007 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 08:37:52.540007 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 08:37:52.540007 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 08:37:52.540007 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 08:37:52.540007 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 08:37:52.540007 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 08:37:52.540007 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 28 08:37:52.540007 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application Jul 28 08:37:52.540007 dv-cinder-851351-1-smb devstack@keystone.service[282898]: [pid: 282898|app: 0|req: 511/1016] 10.222.0.42 () {56 vars in 1120 bytes} [Thu Jul 28 08:37:52 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:37:52.545429 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b1ffdc-1a5d-40bd-ac2d-1801e85b37df None None] Authenticating user token {{(pid=282899) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:37:52.663723 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b1ffdc-1a5d-40bd-ac2d-1801e85b37df None None] Validating token access rules against request {{(pid=282899) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:37:52.665520 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG dbcounter [-] [282899] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=282899) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:37:52.707840 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1177d9-056a-4a57-9a05-d0962da12a6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282899) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:37:52.708484 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1177d9-056a-4a57-9a05-d0962da12a6b None admin] REQUEST_METHOD: `GET` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:37:52.708786 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1177d9-056a-4a57-9a05-d0962da12a6b None admin] SCRIPT_NAME: `/identity` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:37:52.709059 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1177d9-056a-4a57-9a05-d0962da12a6b None admin] PATH_INFO: `/v3/roles` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:37:52.709804 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f1177d9-056a-4a57-9a05-d0962da12a6b None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=282899) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:37:52.710108 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f1177d9-056a-4a57-9a05-d0962da12a6b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:37:52.711529 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f1177d9-056a-4a57-9a05-d0962da12a6b None admin] RBAC: Authorization granted {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:37:52.724866 dv-cinder-851351-1-smb devstack@keystone.service[282899]: [pid: 282899|app: 0|req: 506/1017] 10.222.0.42 () {56 vars in 1115 bytes} [Thu Jul 28 08:37:52 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:37:52.727250 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1f082f-ee62-407a-a497-c3ef94c18fa3 None admin] Authenticating user token {{(pid=282898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:37:52.808345 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG dbcounter [-] [282898] Writing DB stats keystone:SELECT=100 {{(pid=282898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:37:52.855877 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1f082f-ee62-407a-a497-c3ef94c18fa3 None admin] Validating token access rules against request {{(pid=282898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:37:52.894345 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74ec9b1-57ee-4341-b86f-a4f6145796dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:37:52.895047 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74ec9b1-57ee-4341-b86f-a4f6145796dc None admin] REQUEST_METHOD: `GET` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:37:52.895304 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74ec9b1-57ee-4341-b86f-a4f6145796dc None admin] SCRIPT_NAME: `/identity` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:37:52.895579 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74ec9b1-57ee-4341-b86f-a4f6145796dc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:37:52.908352 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e74ec9b1-57ee-4341-b86f-a4f6145796dc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:37:52.909931 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e74ec9b1-57ee-4341-b86f-a4f6145796dc None admin] RBAC: Authorization granted {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:37:52.913872 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407d1c99-aee3-42bc-ae9e-f6ba135c3c7c None None] REQUEST_METHOD: `GET` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:37:52.914638 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407d1c99-aee3-42bc-ae9e-f6ba135c3c7c None None] SCRIPT_NAME: `/identity` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:37:52.914928 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407d1c99-aee3-42bc-ae9e-f6ba135c3c7c None None] PATH_INFO: `/` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:37:52.916532 dv-cinder-851351-1-smb devstack@keystone.service[282899]: [pid: 282899|app: 0|req: 507/1018] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 08:37:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 08:37:52.925615 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f669fb66-7e2b-4ffe-ae4c-628f709bdb79 None None] REQUEST_METHOD: `POST` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:37:52.925927 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f669fb66-7e2b-4ffe-ae4c-628f709bdb79 None None] SCRIPT_NAME: `/identity` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:37:52.926185 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f669fb66-7e2b-4ffe-ae4c-628f709bdb79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:37:52.929730 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application [None req-e74ec9b1-57ee-4341-b86f-a4f6145796dc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 08:37:52.929730 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:37:52.929730 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:37:52.929730 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:37:52.929730 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:37:52.929730 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:37:52.929730 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:37:52.929730 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:37:52.929730 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:37:52.929730 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:37:52.929730 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:37:52.929730 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:37:52.929730 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 08:37:52.929730 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 08:37:52.929730 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 08:37:52.932113 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 08:37:52.932113 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:37:52.932113 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:37:52.932113 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:37:52.932113 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:37:52.932113 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:37:52.932113 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:37:52.932113 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:37:52.932113 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application with Lock( Jul 28 08:37:52.932113 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:37:52.932113 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:37:52.932113 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:37:52.932113 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:37:52.932113 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:37:52.932113 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:37:52.932113 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:37:52.932113 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:37:52.934489 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 08:37:52.934489 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 08:37:52.934489 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 08:37:52.934489 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application Jul 28 08:37:52.935187 dv-cinder-851351-1-smb devstack@keystone.service[282898]: [pid: 282898|app: 0|req: 512/1019] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 08:37:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:37:52.939181 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74ec9b1-57ee-4341-b86f-a4f6145796dc None admin] Authenticating user token {{(pid=282898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:37:52.946120 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.auth.core [None req-f669fb66-7e2b-4ffe-ae4c-628f709bdb79 None None] MFA Rules not processed for user `2be990a66857410a87ffa7609aec4f7b`. Rule list: `[]` (Enabled: `True`). {{(pid=282899) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 08:37:52.947350 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.fernet_utils [None req-f669fb66-7e2b-4ffe-ae4c-628f709bdb79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=282899) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:37:53.024730 dv-cinder-851351-1-smb devstack@keystone.service[282899]: [pid: 282899|app: 0|req: 508/1020] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 08:37:52 2022] POST /identity/v3/auth/tokens => generated 1863 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 08:37:53.046751 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f669fb66-7e2b-4ffe-ae4c-628f709bdb79 None None] Authenticating user token {{(pid=282899) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:37:53.057462 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74ec9b1-57ee-4341-b86f-a4f6145796dc None admin] Validating token access rules against request {{(pid=282898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:37:53.083126 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG dbcounter [-] [282898] Writing DB stats keystone:SELECT=100 {{(pid=282898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:37:53.112317 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52bdb937-d9ac-48d7-a939-ed66793946b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:37:53.113245 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52bdb937-d9ac-48d7-a939-ed66793946b1 None admin] REQUEST_METHOD: `GET` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:37:53.114443 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52bdb937-d9ac-48d7-a939-ed66793946b1 None admin] SCRIPT_NAME: `/identity` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:37:53.114443 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52bdb937-d9ac-48d7-a939-ed66793946b1 None admin] PATH_INFO: `/v3/domains` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:37:53.115264 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52bdb937-d9ac-48d7-a939-ed66793946b1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=282898) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:37:53.115575 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52bdb937-d9ac-48d7-a939-ed66793946b1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:37:53.117529 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52bdb937-d9ac-48d7-a939-ed66793946b1 None admin] RBAC: Authorization granted {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:37:53.135491 dv-cinder-851351-1-smb devstack@keystone.service[282898]: [pid: 282898|app: 0|req: 513/1021] 10.222.0.42 () {56 vars in 1109 bytes} [Thu Jul 28 08:37:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 08:37:53.136767 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52bdb937-d9ac-48d7-a939-ed66793946b1 None admin] Authenticating user token {{(pid=282898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:37:53.165587 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG dbcounter [-] [282899] Writing DB stats keystone:SELECT=100 {{(pid=282899) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:37:53.175714 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f669fb66-7e2b-4ffe-ae4c-628f709bdb79 None None] Validating token access rules against request {{(pid=282899) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:37:53.223001 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7fa3e7-2f18-4688-9024-00728980b0d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282899) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:37:53.223652 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7fa3e7-2f18-4688-9024-00728980b0d6 None admin] REQUEST_METHOD: `POST` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:37:53.223973 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7fa3e7-2f18-4688-9024-00728980b0d6 None admin] SCRIPT_NAME: `/identity` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:37:53.224219 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7fa3e7-2f18-4688-9024-00728980b0d6 None admin] PATH_INFO: `/v3/services` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:37:53.224981 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b7fa3e7-2f18-4688-9024-00728980b0d6 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:37:53.226394 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b7fa3e7-2f18-4688-9024-00728980b0d6 None admin] RBAC: Authorization granted {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:37:53.256706 dv-cinder-851351-1-smb devstack@keystone.service[282899]: [pid: 282899|app: 0|req: 509/1022] 10.222.0.42 () {60 vars in 1141 bytes} [Thu Jul 28 08:37:53 2022] POST /identity/v3/services => generated 242 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 28 08:37:53.261058 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52bdb937-d9ac-48d7-a939-ed66793946b1 None admin] Validating token access rules against request {{(pid=282898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:37:53.313176 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd76aa4-f1cc-44f7-b5b0-a28df90d2e13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:37:53.313888 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd76aa4-f1cc-44f7-b5b0-a28df90d2e13 None admin] REQUEST_METHOD: `GET` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:37:53.314174 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd76aa4-f1cc-44f7-b5b0-a28df90d2e13 None admin] SCRIPT_NAME: `/identity` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:37:53.314449 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd76aa4-f1cc-44f7-b5b0-a28df90d2e13 None admin] PATH_INFO: `/v3/users/nova` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:37:53.323994 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cd76aa4-f1cc-44f7-b5b0-a28df90d2e13 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:37:53.325540 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cd76aa4-f1cc-44f7-b5b0-a28df90d2e13 None admin] RBAC: Authorization granted {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:37:53.339946 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application [None req-3cd76aa4-f1cc-44f7-b5b0-a28df90d2e13 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 28 08:37:53.339946 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:37:53.339946 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:37:53.339946 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:37:53.339946 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:37:53.339946 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:37:53.339946 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:37:53.339946 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:37:53.339946 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:37:53.339946 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:37:53.339946 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:37:53.339946 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:37:53.339946 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 28 08:37:53.339946 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 28 08:37:53.339946 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 28 08:37:53.339946 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 28 08:37:53.341212 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:37:53.341212 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:37:53.341212 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 28 08:37:53.341212 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 08:37:53.341212 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 28 08:37:53.341212 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 08:37:53.341212 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:37:53.341212 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:37:53.341212 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:37:53.341212 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:37:53.341212 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:37:53.341212 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application with Lock( Jul 28 08:37:53.341212 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:37:53.341212 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:37:53.341212 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:37:53.341212 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:37:53.341212 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:37:53.341212 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:37:53.342453 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:37:53.342453 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:37:53.342453 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 28 08:37:53.342453 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 28 08:37:53.342453 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 28 08:37:53.342453 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 28 08:37:53.342453 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 28 08:37:53.342453 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 28 08:37:53.342453 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 28 08:37:53.342453 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application Jul 28 08:37:53.342453 dv-cinder-851351-1-smb devstack@keystone.service[282898]: [pid: 282898|app: 0|req: 514/1023] 10.222.0.42 () {56 vars in 1093 bytes} [Thu Jul 28 08:37:53 2022] GET /identity/v3/users/nova => generated 82 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:37:53.348043 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7fa3e7-2f18-4688-9024-00728980b0d6 None admin] Authenticating user token {{(pid=282899) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:37:53.479018 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7fa3e7-2f18-4688-9024-00728980b0d6 None admin] Validating token access rules against request {{(pid=282899) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:37:53.506059 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e5f5e1-073e-4a3a-926a-fb1bbad45644 None None] REQUEST_METHOD: `GET` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:37:53.506404 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e5f5e1-073e-4a3a-926a-fb1bbad45644 None None] SCRIPT_NAME: `/identity` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:37:53.506585 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e5f5e1-073e-4a3a-926a-fb1bbad45644 None None] PATH_INFO: `/` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:37:53.508263 dv-cinder-851351-1-smb devstack@keystone.service[282898]: [pid: 282898|app: 0|req: 515/1024] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 08:37:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 28 08:37:53.517663 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b840198-da62-46a7-b3bb-8d32ac5fd1f6 None None] REQUEST_METHOD: `POST` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:37:53.517950 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b840198-da62-46a7-b3bb-8d32ac5fd1f6 None None] SCRIPT_NAME: `/identity` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:37:53.518230 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b840198-da62-46a7-b3bb-8d32ac5fd1f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:37:53.525642 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c053b6a8-070a-4301-b877-0d4dc796b735 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282899) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:37:53.526294 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c053b6a8-070a-4301-b877-0d4dc796b735 None admin] REQUEST_METHOD: `GET` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:37:53.526574 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c053b6a8-070a-4301-b877-0d4dc796b735 None admin] SCRIPT_NAME: `/identity` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:37:53.526852 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c053b6a8-070a-4301-b877-0d4dc796b735 None admin] PATH_INFO: `/v3/users` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:37:53.527668 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c053b6a8-070a-4301-b877-0d4dc796b735 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=282899) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:37:53.527979 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c053b6a8-070a-4301-b877-0d4dc796b735 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:37:53.529471 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c053b6a8-070a-4301-b877-0d4dc796b735 None admin] RBAC: Authorization granted {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:37:53.538503 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.auth.core [None req-3b840198-da62-46a7-b3bb-8d32ac5fd1f6 None None] MFA Rules not processed for user `2be990a66857410a87ffa7609aec4f7b`. Rule list: `[]` (Enabled: `True`). {{(pid=282898) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 08:37:53.540646 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.fernet_utils [None req-3b840198-da62-46a7-b3bb-8d32ac5fd1f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=282898) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:37:53.549458 dv-cinder-851351-1-smb devstack@keystone.service[282899]: [pid: 282899|app: 0|req: 510/1025] 10.222.0.42 () {56 vars in 1133 bytes} [Thu Jul 28 08:37:53 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:37:53.555086 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c053b6a8-070a-4301-b877-0d4dc796b735 None admin] Authenticating user token {{(pid=282899) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:37:53.571464 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG dbcounter [-] [282898] Writing DB stats keystone:SELECT=100 {{(pid=282898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:37:53.572060 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG dbcounter [-] [282899] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=282899) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:37:53.624518 dv-cinder-851351-1-smb devstack@keystone.service[282898]: [pid: 282898|app: 0|req: 516/1026] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 08:37:53 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 28 08:37:53.647676 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b840198-da62-46a7-b3bb-8d32ac5fd1f6 None None] Authenticating user token {{(pid=282898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:37:53.698689 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c053b6a8-070a-4301-b877-0d4dc796b735 None admin] Validating token access rules against request {{(pid=282899) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:37:53.741343 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3519025e-8635-4cad-a76c-9f82b13033d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282899) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:37:53.741990 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3519025e-8635-4cad-a76c-9f82b13033d6 None admin] REQUEST_METHOD: `GET` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:37:53.742273 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3519025e-8635-4cad-a76c-9f82b13033d6 None admin] SCRIPT_NAME: `/identity` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:37:53.742545 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3519025e-8635-4cad-a76c-9f82b13033d6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:37:53.777026 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b840198-da62-46a7-b3bb-8d32ac5fd1f6 None None] Validating token access rules against request {{(pid=282898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:37:53.825331 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5bed11-c76a-482e-ad1c-a7d224f57f6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:37:53.826002 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5bed11-c76a-482e-ad1c-a7d224f57f6b None admin] REQUEST_METHOD: `GET` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:37:53.826289 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5bed11-c76a-482e-ad1c-a7d224f57f6b None admin] SCRIPT_NAME: `/identity` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:37:53.826564 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5bed11-c76a-482e-ad1c-a7d224f57f6b None admin] PATH_INFO: `/v3/domains/default` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:37:53.827827 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c5bed11-c76a-482e-ad1c-a7d224f57f6b None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:37:53.830504 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c5bed11-c76a-482e-ad1c-a7d224f57f6b None admin] RBAC: Authorization granted {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:37:53.832159 dv-cinder-851351-1-smb devstack@keystone.service[282898]: [pid: 282898|app: 0|req: 517/1027] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 08:37:53 2022] GET /identity/v3/domains/default => generated 199 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 08:37:53.833128 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3519025e-8635-4cad-a76c-9f82b13033d6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:37:53.835740 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3519025e-8635-4cad-a76c-9f82b13033d6 None admin] RBAC: Authorization granted {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:37:53.842986 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5bed11-c76a-482e-ad1c-a7d224f57f6b None admin] Authenticating user token {{(pid=282898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:37:53.859333 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG dbcounter [-] [282899] Writing DB stats keystone:SELECT=100 {{(pid=282899) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:37:53.898376 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG dbcounter [-] [282898] Writing DB stats keystone:SELECT=100 {{(pid=282898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:37:53.960756 dv-cinder-851351-1-smb devstack@keystone.service[282899]: [pid: 282899|app: 0|req: 511/1028] 10.222.0.42 () {58 vars in 1282 bytes} [Thu Jul 28 08:37:53 2022] GET /identity/v3/auth/tokens => generated 1959 bytes in 406 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jul 28 08:37:53.966738 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3519025e-8635-4cad-a76c-9f82b13033d6 None admin] Authenticating user token {{(pid=282899) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:37:53.987388 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5bed11-c76a-482e-ad1c-a7d224f57f6b None admin] Validating token access rules against request {{(pid=282898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:37:54.022130 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6aa24c4-1608-470a-ba60-d7a1da301998 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:37:54.022766 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6aa24c4-1608-470a-ba60-d7a1da301998 None admin] REQUEST_METHOD: `POST` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:37:54.023061 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6aa24c4-1608-470a-ba60-d7a1da301998 None admin] SCRIPT_NAME: `/identity` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:37:54.023326 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6aa24c4-1608-470a-ba60-d7a1da301998 None admin] PATH_INFO: `/v3/projects` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:37:54.024030 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6aa24c4-1608-470a-ba60-d7a1da301998 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:37:54.025512 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6aa24c4-1608-470a-ba60-d7a1da301998 None admin] RBAC: Authorization granted {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:37:54.056709 dv-cinder-851351-1-smb devstack@keystone.service[282898]: [pid: 282898|app: 0|req: 518/1029] 10.222.0.42 () {60 vars in 1141 bytes} [Thu Jul 28 08:37:53 2022] POST /identity/v3/projects => generated 311 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 08:37:54.084960 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3519025e-8635-4cad-a76c-9f82b13033d6 None admin] Validating token access rules against request {{(pid=282899) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:37:54.102750 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG dbcounter [-] [282899] Writing DB stats keystone:SELECT=100 {{(pid=282899) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:37:54.128943 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c5f371-86da-4027-85a8-1e0acad263af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282899) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:37:54.129603 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c5f371-86da-4027-85a8-1e0acad263af None admin] REQUEST_METHOD: `GET` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:37:54.129905 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c5f371-86da-4027-85a8-1e0acad263af None admin] SCRIPT_NAME: `/identity` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:37:54.130187 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c5f371-86da-4027-85a8-1e0acad263af None admin] PATH_INFO: `/v3/domains/Default` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:37:54.142788 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18c5f371-86da-4027-85a8-1e0acad263af None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:37:54.144417 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18c5f371-86da-4027-85a8-1e0acad263af None admin] RBAC: Authorization granted {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:37:54.161692 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application [None req-18c5f371-86da-4027-85a8-1e0acad263af None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 08:37:54.161692 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:37:54.161692 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:37:54.161692 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:37:54.161692 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:37:54.161692 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:37:54.161692 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:37:54.161692 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:37:54.161692 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:37:54.161692 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:37:54.161692 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:37:54.161692 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:37:54.161692 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 08:37:54.161692 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 08:37:54.161692 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 08:37:54.162850 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 08:37:54.162850 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:37:54.162850 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:37:54.162850 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:37:54.162850 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:37:54.162850 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:37:54.162850 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:37:54.162850 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:37:54.162850 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application with Lock( Jul 28 08:37:54.162850 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:37:54.162850 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:37:54.162850 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:37:54.162850 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:37:54.162850 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:37:54.162850 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:37:54.162850 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:37:54.162850 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:37:54.168976 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 08:37:54.168976 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 08:37:54.168976 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 08:37:54.168976 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application Jul 28 08:37:54.168976 dv-cinder-851351-1-smb devstack@keystone.service[282899]: [pid: 282899|app: 0|req: 512/1030] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 08:37:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 08:37:54.171375 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6aa24c4-1608-470a-ba60-d7a1da301998 None admin] Authenticating user token {{(pid=282898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:37:54.272003 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG dbcounter [-] [282898] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=282898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:37:54.289511 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6aa24c4-1608-470a-ba60-d7a1da301998 None admin] Validating token access rules against request {{(pid=282898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:37:54.327880 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eeae2f2-3440-4d65-8fa5-7d34c2a66a59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:37:54.328535 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eeae2f2-3440-4d65-8fa5-7d34c2a66a59 None admin] REQUEST_METHOD: `GET` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:37:54.328854 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eeae2f2-3440-4d65-8fa5-7d34c2a66a59 None admin] SCRIPT_NAME: `/identity` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:37:54.329533 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eeae2f2-3440-4d65-8fa5-7d34c2a66a59 None admin] PATH_INFO: `/v3/domains` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:37:54.330263 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eeae2f2-3440-4d65-8fa5-7d34c2a66a59 None admin] RBAC: Adding query filter params (name=Default) {{(pid=282898) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:37:54.330573 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eeae2f2-3440-4d65-8fa5-7d34c2a66a59 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:37:54.331985 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eeae2f2-3440-4d65-8fa5-7d34c2a66a59 None admin] RBAC: Authorization granted {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:37:54.345637 dv-cinder-851351-1-smb devstack@keystone.service[282898]: [pid: 282898|app: 0|req: 519/1031] 10.222.0.42 () {56 vars in 1109 bytes} [Thu Jul 28 08:37:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 08:37:54.351997 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c5f371-86da-4027-85a8-1e0acad263af None admin] Authenticating user token {{(pid=282899) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:37:54.470438 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c5f371-86da-4027-85a8-1e0acad263af None admin] Validating token access rules against request {{(pid=282899) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:37:54.506589 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580cdaca-0de3-4cc1-87f0-4935dfcac7b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282899) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:37:54.507246 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580cdaca-0de3-4cc1-87f0-4935dfcac7b4 None admin] REQUEST_METHOD: `GET` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:37:54.507528 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580cdaca-0de3-4cc1-87f0-4935dfcac7b4 None admin] SCRIPT_NAME: `/identity` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:37:54.507806 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580cdaca-0de3-4cc1-87f0-4935dfcac7b4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:37:54.514957 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-580cdaca-0de3-4cc1-87f0-4935dfcac7b4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:37:54.516425 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-580cdaca-0de3-4cc1-87f0-4935dfcac7b4 None admin] RBAC: Authorization granted {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:37:54.528179 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application [None req-580cdaca-0de3-4cc1-87f0-4935dfcac7b4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 08:37:54.528179 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:37:54.528179 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:37:54.528179 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:37:54.528179 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:37:54.528179 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:37:54.528179 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:37:54.528179 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:37:54.528179 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:37:54.528179 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:37:54.528179 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:37:54.528179 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:37:54.528179 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 28 08:37:54.528179 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 28 08:37:54.528179 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 28 08:37:54.529329 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 28 08:37:54.529329 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:37:54.529329 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:37:54.529329 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:37:54.529329 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:37:54.529329 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:37:54.529329 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:37:54.529329 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:37:54.529329 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application with Lock( Jul 28 08:37:54.529329 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:37:54.529329 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:37:54.529329 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:37:54.529329 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:37:54.529329 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:37:54.529329 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:37:54.529329 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:37:54.529329 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:37:54.530411 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 28 08:37:54.530411 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 28 08:37:54.530411 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 28 08:37:54.530411 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 28 08:37:54.530411 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 28 08:37:54.530411 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 28 08:37:54.530411 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 08:37:54.530411 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application Jul 28 08:37:54.532746 dv-cinder-851351-1-smb devstack@keystone.service[282899]: [pid: 282899|app: 0|req: 513/1032] 10.222.0.42 () {56 vars in 1111 bytes} [Thu Jul 28 08:37:54 2022] GET /identity/v3/projects/service => generated 88 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:37:54.535432 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eeae2f2-3440-4d65-8fa5-7d34c2a66a59 None admin] Authenticating user token {{(pid=282898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:37:54.649763 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eeae2f2-3440-4d65-8fa5-7d34c2a66a59 None admin] Validating token access rules against request {{(pid=282898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:37:54.697252 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c9a34b-1546-4a62-b71f-1090b58ec03b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:37:54.697905 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c9a34b-1546-4a62-b71f-1090b58ec03b None admin] REQUEST_METHOD: `GET` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:37:54.698180 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c9a34b-1546-4a62-b71f-1090b58ec03b None admin] SCRIPT_NAME: `/identity` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:37:54.698444 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c9a34b-1546-4a62-b71f-1090b58ec03b None admin] PATH_INFO: `/v3/projects` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:37:54.699249 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81c9a34b-1546-4a62-b71f-1090b58ec03b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=282898) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:37:54.699558 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81c9a34b-1546-4a62-b71f-1090b58ec03b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:37:54.701078 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81c9a34b-1546-4a62-b71f-1090b58ec03b None admin] RBAC: Authorization granted {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:37:54.714893 dv-cinder-851351-1-smb devstack@keystone.service[282898]: [pid: 282898|app: 0|req: 520/1033] 10.222.0.42 () {56 vars in 1148 bytes} [Thu Jul 28 08:37:54 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:37:54.721225 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580cdaca-0de3-4cc1-87f0-4935dfcac7b4 None admin] Authenticating user token {{(pid=282899) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:37:54.749356 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG dbcounter [-] [282899] Writing DB stats keystone:SELECT=100 {{(pid=282899) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:37:54.837377 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580cdaca-0de3-4cc1-87f0-4935dfcac7b4 None admin] Validating token access rules against request {{(pid=282899) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:37:54.875519 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4b7fba-91af-4b86-a47b-e2c6e84447c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282899) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:37:54.876159 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4b7fba-91af-4b86-a47b-e2c6e84447c8 None admin] REQUEST_METHOD: `GET` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:37:54.876629 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4b7fba-91af-4b86-a47b-e2c6e84447c8 None admin] SCRIPT_NAME: `/identity` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:37:54.876946 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4b7fba-91af-4b86-a47b-e2c6e84447c8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:37:54.877756 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc4b7fba-91af-4b86-a47b-e2c6e84447c8 None admin] RBAC: Adding query filter params (role.id=f33deecb73a247c0b6c50fe050d1ef3a, scope.project.id=5cde68cbfb9042dc9f36af3aacea2473, user.id=5e192fe026ef4f109b9a1099815c5926) {{(pid=282899) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:37:54.878069 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc4b7fba-91af-4b86-a47b-e2c6e84447c8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:37:54.879523 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc4b7fba-91af-4b86-a47b-e2c6e84447c8 None admin] RBAC: Authorization granted {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:37:54.886073 dv-cinder-851351-1-smb devstack@keystone.service[282899]: [pid: 282899|app: 0|req: 514/1034] 10.222.0.42 () {56 vars in 1374 bytes} [Thu Jul 28 08:37:54 2022] GET /identity/v3/role_assignments?user.id=5e192fe026ef4f109b9a1099815c5926&scope.project.id=5cde68cbfb9042dc9f36af3aacea2473&role.id=f33deecb73a247c0b6c50fe050d1ef3a => generated 259 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 08:37:55.354859 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147602be-266b-4d52-b08b-92db4616537b None None] REQUEST_METHOD: `GET` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:37:55.355434 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147602be-266b-4d52-b08b-92db4616537b None None] SCRIPT_NAME: `/identity` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:37:55.355434 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147602be-266b-4d52-b08b-92db4616537b None None] PATH_INFO: `/` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:37:55.356825 dv-cinder-851351-1-smb devstack@keystone.service[282898]: [pid: 282898|app: 0|req: 521/1035] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 08:37:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 08:37:55.362314 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0ec80b-310f-4d23-9a1a-c1db347c37fa None None] REQUEST_METHOD: `POST` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:37:55.362611 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0ec80b-310f-4d23-9a1a-c1db347c37fa None None] SCRIPT_NAME: `/identity` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:37:55.362883 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0ec80b-310f-4d23-9a1a-c1db347c37fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:37:55.383579 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.auth.core [None req-6f0ec80b-310f-4d23-9a1a-c1db347c37fa None None] MFA Rules not processed for user `2be990a66857410a87ffa7609aec4f7b`. Rule list: `[]` (Enabled: `True`). {{(pid=282899) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 08:37:55.385004 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.fernet_utils [None req-6f0ec80b-310f-4d23-9a1a-c1db347c37fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=282899) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:37:55.462721 dv-cinder-851351-1-smb devstack@keystone.service[282899]: [pid: 282899|app: 0|req: 515/1036] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 08:37:55 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 08:37:55.485475 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147602be-266b-4d52-b08b-92db4616537b None None] Authenticating user token {{(pid=282898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:37:55.489782 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG dbcounter [-] [282898] Writing DB stats keystone:SELECT=100 {{(pid=282898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:37:55.601608 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147602be-266b-4d52-b08b-92db4616537b None None] Validating token access rules against request {{(pid=282898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:37:55.637877 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c90a49a-2eb5-4a7f-8a92-f8cae0efe961 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:37:55.638450 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c90a49a-2eb5-4a7f-8a92-f8cae0efe961 None admin] REQUEST_METHOD: `GET` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:37:55.638733 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c90a49a-2eb5-4a7f-8a92-f8cae0efe961 None admin] SCRIPT_NAME: `/identity` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:37:55.639010 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c90a49a-2eb5-4a7f-8a92-f8cae0efe961 None admin] PATH_INFO: `/v3/services/image` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:37:55.639653 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c90a49a-2eb5-4a7f-8a92-f8cae0efe961 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:37:55.641068 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c90a49a-2eb5-4a7f-8a92-f8cae0efe961 None admin] RBAC: Authorization granted {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:37:55.650547 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application [None req-9c90a49a-2eb5-4a7f-8a92-f8cae0efe961 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jul 28 08:37:55.650547 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:37:55.650547 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 28 08:37:55.650547 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 28 08:37:55.650547 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 28 08:37:55.650547 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 28 08:37:55.650547 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 28 08:37:55.650547 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 08:37:55.650547 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 28 08:37:55.650547 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application Jul 28 08:37:55.650547 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 28 08:37:55.650547 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application Jul 28 08:37:55.650547 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:37:55.650547 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:37:55.650547 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:37:55.650547 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:37:55.650547 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:37:55.651828 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:37:55.651828 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:37:55.651828 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:37:55.651828 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:37:55.651828 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:37:55.651828 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:37:55.651828 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 28 08:37:55.651828 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 28 08:37:55.651828 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 28 08:37:55.651828 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 28 08:37:55.651828 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:37:55.651828 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:37:55.651828 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:37:55.651828 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:37:55.651828 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:37:55.651828 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:37:55.653336 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:37:55.653336 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application with Lock( Jul 28 08:37:55.653336 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:37:55.653336 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:37:55.653336 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:37:55.653336 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:37:55.653336 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:37:55.653336 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:37:55.653336 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:37:55.653336 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:37:55.653336 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 28 08:37:55.653336 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 08:37:55.653336 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 28 08:37:55.653336 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application Jul 28 08:37:55.660190 dv-cinder-851351-1-smb devstack@keystone.service[282898]: [pid: 282898|app: 0|req: 522/1037] 10.222.0.42 () {56 vars in 1105 bytes} [Thu Jul 28 08:37:55 2022] GET /identity/v3/services/image => generated 86 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:37:55.660424 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f0ec80b-310f-4d23-9a1a-c1db347c37fa None None] Authenticating user token {{(pid=282899) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:37:55.680250 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG dbcounter [-] [282899] Writing DB stats keystone:SELECT=100 {{(pid=282899) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:37:55.773177 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f0ec80b-310f-4d23-9a1a-c1db347c37fa None None] Validating token access rules against request {{(pid=282899) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:37:55.814517 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d705091d-9513-4d06-bb99-aa38855aa489 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282899) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:37:55.814517 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d705091d-9513-4d06-bb99-aa38855aa489 None admin] REQUEST_METHOD: `GET` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:37:55.814517 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d705091d-9513-4d06-bb99-aa38855aa489 None admin] SCRIPT_NAME: `/identity` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:37:55.814517 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d705091d-9513-4d06-bb99-aa38855aa489 None admin] PATH_INFO: `/v3/services` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:37:55.814987 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d705091d-9513-4d06-bb99-aa38855aa489 None admin] RBAC: Adding query filter params (name=image) {{(pid=282899) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:37:55.814987 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d705091d-9513-4d06-bb99-aa38855aa489 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:37:55.815410 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d705091d-9513-4d06-bb99-aa38855aa489 None admin] RBAC: Authorization granted {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:37:55.822449 dv-cinder-851351-1-smb devstack@keystone.service[282899]: [pid: 282899|app: 0|req: 516/1038] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 08:37:55 2022] GET /identity/v3/services?name=image => generated 122 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:37:55.827997 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c90a49a-2eb5-4a7f-8a92-f8cae0efe961 None admin] Authenticating user token {{(pid=282898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:37:55.902674 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG dbcounter [-] [282898] Writing DB stats keystone:SELECT=100 {{(pid=282898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:37:55.939633 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c90a49a-2eb5-4a7f-8a92-f8cae0efe961 None admin] Validating token access rules against request {{(pid=282898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:37:55.978649 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e3ea0c-f5f3-4123-a047-d240cfa162b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:37:55.979315 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e3ea0c-f5f3-4123-a047-d240cfa162b9 None admin] REQUEST_METHOD: `GET` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:37:55.979615 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e3ea0c-f5f3-4123-a047-d240cfa162b9 None admin] SCRIPT_NAME: `/identity` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:37:55.979864 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e3ea0c-f5f3-4123-a047-d240cfa162b9 None admin] PATH_INFO: `/v3/services` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:37:55.980548 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71e3ea0c-f5f3-4123-a047-d240cfa162b9 None admin] RBAC: Adding query filter params (type=image) {{(pid=282898) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:37:55.980878 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71e3ea0c-f5f3-4123-a047-d240cfa162b9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:37:55.982322 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71e3ea0c-f5f3-4123-a047-d240cfa162b9 None admin] RBAC: Authorization granted {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:37:55.987916 dv-cinder-851351-1-smb devstack@keystone.service[282898]: [pid: 282898|app: 0|req: 523/1039] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 08:37:55 2022] GET /identity/v3/services?type=image => generated 350 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:37:55.993835 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d705091d-9513-4d06-bb99-aa38855aa489 None admin] Authenticating user token {{(pid=282899) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:37:56.082984 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG dbcounter [-] [282899] Writing DB stats keystone:SELECT=100 {{(pid=282899) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:37:56.103929 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d705091d-9513-4d06-bb99-aa38855aa489 None admin] Validating token access rules against request {{(pid=282899) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:37:56.142174 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b81719-5364-4dcf-aa77-8334b4a6fec9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282899) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:37:56.142804 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b81719-5364-4dcf-aa77-8334b4a6fec9 None admin] REQUEST_METHOD: `GET` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:37:56.143084 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b81719-5364-4dcf-aa77-8334b4a6fec9 None admin] SCRIPT_NAME: `/identity` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:37:56.143357 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b81719-5364-4dcf-aa77-8334b4a6fec9 None admin] PATH_INFO: `/v3/endpoints` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:37:56.144126 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85b81719-5364-4dcf-aa77-8334b4a6fec9 None admin] RBAC: Adding query filter params (interface=public, service_id=587a63345e794f04912eaec7399aa24a, region_id=RegionOne) {{(pid=282899) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:37:56.144434 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85b81719-5364-4dcf-aa77-8334b4a6fec9 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:37:56.145842 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85b81719-5364-4dcf-aa77-8334b4a6fec9 None admin] RBAC: Authorization granted {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:37:56.151316 dv-cinder-851351-1-smb devstack@keystone.service[282899]: [pid: 282899|app: 0|req: 517/1040] 10.222.0.42 () {56 vars in 1251 bytes} [Thu Jul 28 08:37:55 2022] GET /identity/v3/endpoints?service_id=587a63345e794f04912eaec7399aa24a&interface=public®ion_id=RegionOne => generated 194 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:37:56.157000 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e3ea0c-f5f3-4123-a047-d240cfa162b9 None admin] Authenticating user token {{(pid=282898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:37:56.190008 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0d0dab-1779-4af6-9ac8-e1aa1ac8a940 None None] REQUEST_METHOD: `GET` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:37:56.190301 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0d0dab-1779-4af6-9ac8-e1aa1ac8a940 None None] SCRIPT_NAME: `/identity` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:37:56.190636 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0d0dab-1779-4af6-9ac8-e1aa1ac8a940 None None] PATH_INFO: `/` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:37:56.192033 dv-cinder-851351-1-smb devstack@keystone.service[282899]: [pid: 282899|app: 0|req: 518/1041] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 08:37:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 08:37:56.197064 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3262bc79-19e5-41cf-8989-f9d3a07e2b73 None None] REQUEST_METHOD: `POST` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:37:56.197357 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3262bc79-19e5-41cf-8989-f9d3a07e2b73 None None] SCRIPT_NAME: `/identity` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:37:56.197651 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3262bc79-19e5-41cf-8989-f9d3a07e2b73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:37:56.216469 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.auth.core [None req-3262bc79-19e5-41cf-8989-f9d3a07e2b73 None None] MFA Rules not processed for user `2be990a66857410a87ffa7609aec4f7b`. Rule list: `[]` (Enabled: `True`). {{(pid=282899) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 08:37:56.217694 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.fernet_utils [None req-3262bc79-19e5-41cf-8989-f9d3a07e2b73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=282899) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:37:56.263747 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e3ea0c-f5f3-4123-a047-d240cfa162b9 None admin] Validating token access rules against request {{(pid=282898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:37:56.286567 dv-cinder-851351-1-smb devstack@keystone.service[282899]: [pid: 282899|app: 0|req: 519/1042] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 08:37:56 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 28 08:37:56.295351 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG dbcounter [-] [282898] Writing DB stats keystone:SELECT=100 {{(pid=282898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:37:56.301571 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e16da8b-f6b6-4130-984c-efbee8acee1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:37:56.302205 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e16da8b-f6b6-4130-984c-efbee8acee1a None admin] REQUEST_METHOD: `GET` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:37:56.302492 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e16da8b-f6b6-4130-984c-efbee8acee1a None admin] SCRIPT_NAME: `/identity` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:37:56.302769 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e16da8b-f6b6-4130-984c-efbee8acee1a None admin] PATH_INFO: `/v3/services` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:37:56.303438 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e16da8b-f6b6-4130-984c-efbee8acee1a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:37:56.304853 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e16da8b-f6b6-4130-984c-efbee8acee1a None admin] RBAC: Authorization granted {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:37:56.311071 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3262bc79-19e5-41cf-8989-f9d3a07e2b73 None None] Authenticating user token {{(pid=282899) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:37:56.320967 dv-cinder-851351-1-smb devstack@keystone.service[282898]: [pid: 282898|app: 0|req: 524/1043] 10.222.0.42 () {56 vars in 1087 bytes} [Thu Jul 28 08:37:56 2022] GET /identity/v3/services => generated 1957 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 08:37:56.409629 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG dbcounter [-] [282899] Writing DB stats keystone:SELECT=100 {{(pid=282899) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:37:56.438278 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3262bc79-19e5-41cf-8989-f9d3a07e2b73 None None] Validating token access rules against request {{(pid=282899) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:37:56.479877 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50564c6-7dc7-43c7-8ac8-07f146c224da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282899) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:37:56.480574 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50564c6-7dc7-43c7-8ac8-07f146c224da None admin] REQUEST_METHOD: `GET` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:37:56.480871 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50564c6-7dc7-43c7-8ac8-07f146c224da None admin] SCRIPT_NAME: `/identity` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:37:56.481195 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50564c6-7dc7-43c7-8ac8-07f146c224da None admin] PATH_INFO: `/v3/domains/default` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:37:56.482466 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f50564c6-7dc7-43c7-8ac8-07f146c224da None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:37:56.483988 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f50564c6-7dc7-43c7-8ac8-07f146c224da None admin] RBAC: Authorization granted {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:37:56.486087 dv-cinder-851351-1-smb devstack@keystone.service[282899]: [pid: 282899|app: 0|req: 520/1044] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 08:37:56 2022] GET /identity/v3/domains/default => generated 199 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 08:37:56.494018 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e16da8b-f6b6-4130-984c-efbee8acee1a None admin] Authenticating user token {{(pid=282898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:37:56.616935 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e16da8b-f6b6-4130-984c-efbee8acee1a None admin] Validating token access rules against request {{(pid=282898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:37:56.652556 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad758378-e684-4dcb-aede-370354b381ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:37:56.653222 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad758378-e684-4dcb-aede-370354b381ba None admin] REQUEST_METHOD: `POST` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:37:56.653488 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad758378-e684-4dcb-aede-370354b381ba None admin] SCRIPT_NAME: `/identity` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:37:56.653770 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad758378-e684-4dcb-aede-370354b381ba None admin] PATH_INFO: `/v3/users` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:37:56.654468 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad758378-e684-4dcb-aede-370354b381ba None admin] RBAC: Authorizing `identity:create_user()` {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:37:56.655930 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad758378-e684-4dcb-aede-370354b381ba None admin] RBAC: Authorization granted {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:37:56.688883 dv-cinder-851351-1-smb devstack@keystone.service[282898]: [pid: 282898|app: 0|req: 525/1045] 10.222.0.42 () {60 vars in 1132 bytes} [Thu Jul 28 08:37:56 2022] POST /identity/v3/users => generated 285 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 08:37:56.914137 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692a5051-c2cd-4bc3-acab-3bf5347dc8fc None None] REQUEST_METHOD: `GET` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:37:56.914695 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692a5051-c2cd-4bc3-acab-3bf5347dc8fc None None] SCRIPT_NAME: `/identity` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:37:56.914695 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692a5051-c2cd-4bc3-acab-3bf5347dc8fc None None] PATH_INFO: `/` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:37:56.916081 dv-cinder-851351-1-smb devstack@keystone.service[282899]: [pid: 282899|app: 0|req: 521/1046] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 08:37:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 08:37:56.922024 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1d5af3-307e-4fd2-a56c-05f8ab859f6e None None] REQUEST_METHOD: `POST` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:37:56.922364 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1d5af3-307e-4fd2-a56c-05f8ab859f6e None None] SCRIPT_NAME: `/identity` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:37:56.922661 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1d5af3-307e-4fd2-a56c-05f8ab859f6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:37:56.942051 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.auth.core [None req-2c1d5af3-307e-4fd2-a56c-05f8ab859f6e None None] MFA Rules not processed for user `2be990a66857410a87ffa7609aec4f7b`. Rule list: `[]` (Enabled: `True`). {{(pid=282898) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 08:37:56.943189 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.fernet_utils [None req-2c1d5af3-307e-4fd2-a56c-05f8ab859f6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=282898) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:37:56.995965 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG dbcounter [-] [282898] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=282898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:37:57.020543 dv-cinder-851351-1-smb devstack@keystone.service[282898]: [pid: 282898|app: 0|req: 526/1047] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 08:37:56 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 08:37:57.042902 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692a5051-c2cd-4bc3-acab-3bf5347dc8fc None None] Authenticating user token {{(pid=282899) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:37:57.157133 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692a5051-c2cd-4bc3-acab-3bf5347dc8fc None None] Validating token access rules against request {{(pid=282899) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:37:57.192339 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678c4919-20d0-4e57-8c62-f7d06356aeb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282899) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:37:57.192940 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678c4919-20d0-4e57-8c62-f7d06356aeb0 None admin] REQUEST_METHOD: `GET` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:37:57.193235 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678c4919-20d0-4e57-8c62-f7d06356aeb0 None admin] SCRIPT_NAME: `/identity` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:37:57.193509 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678c4919-20d0-4e57-8c62-f7d06356aeb0 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:37:57.204643 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-678c4919-20d0-4e57-8c62-f7d06356aeb0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 08:37:57.209619 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application [None req-678c4919-20d0-4e57-8c62-f7d06356aeb0 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 28 08:37:57.209619 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:37:57.209619 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:37:57.209619 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:37:57.209619 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:37:57.209619 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:37:57.209619 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:37:57.209619 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:37:57.209619 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:37:57.209619 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:37:57.209619 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:37:57.209619 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:37:57.209619 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 08:37:57.209619 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 08:37:57.209619 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 08:37:57.209619 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 08:37:57.210710 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 08:37:57.210710 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 08:37:57.210710 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 08:37:57.210710 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 08:37:57.210710 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:37:57.210710 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:37:57.210710 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:37:57.210710 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:37:57.210710 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:37:57.210710 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:37:57.210710 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:37:57.210710 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application with Lock( Jul 28 08:37:57.210710 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:37:57.210710 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:37:57.210710 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:37:57.210710 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:37:57.211730 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:37:57.211730 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:37:57.211730 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:37:57.211730 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:37:57.211730 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 08:37:57.211730 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 08:37:57.211730 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 08:37:57.211730 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 08:37:57.211730 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 08:37:57.211730 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 08:37:57.211730 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 28 08:37:57.211730 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application Jul 28 08:37:57.211730 dv-cinder-851351-1-smb devstack@keystone.service[282899]: [pid: 282899|app: 0|req: 522/1048] 10.222.0.42 () {56 vars in 1120 bytes} [Thu Jul 28 08:37:57 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:37:57.218652 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c1d5af3-307e-4fd2-a56c-05f8ab859f6e None None] Authenticating user token {{(pid=282898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:37:57.318687 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c1d5af3-307e-4fd2-a56c-05f8ab859f6e None None] Validating token access rules against request {{(pid=282898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:37:57.354481 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db6e9e9-8a7a-4253-b304-50cba6c45344 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:37:57.355122 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db6e9e9-8a7a-4253-b304-50cba6c45344 None admin] REQUEST_METHOD: `GET` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:37:57.355379 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db6e9e9-8a7a-4253-b304-50cba6c45344 None admin] SCRIPT_NAME: `/identity` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:37:57.355683 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db6e9e9-8a7a-4253-b304-50cba6c45344 None admin] PATH_INFO: `/v3/roles` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:37:57.356429 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9db6e9e9-8a7a-4253-b304-50cba6c45344 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=282898) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:37:57.356762 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9db6e9e9-8a7a-4253-b304-50cba6c45344 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:37:57.358165 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9db6e9e9-8a7a-4253-b304-50cba6c45344 None admin] RBAC: Authorization granted {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:37:57.368710 dv-cinder-851351-1-smb devstack@keystone.service[282898]: [pid: 282898|app: 0|req: 527/1049] 10.222.0.42 () {56 vars in 1115 bytes} [Thu Jul 28 08:37:57 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:37:57.373149 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678c4919-20d0-4e57-8c62-f7d06356aeb0 None admin] Authenticating user token {{(pid=282899) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:37:57.378159 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG dbcounter [-] [282899] Writing DB stats keystone:SELECT=100 {{(pid=282899) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:37:57.483809 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678c4919-20d0-4e57-8c62-f7d06356aeb0 None admin] Validating token access rules against request {{(pid=282899) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:37:57.525355 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a0ac1e6-a738-4a20-8f6e-a7c8a0457df0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282899) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:37:57.526022 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0ac1e6-a738-4a20-8f6e-a7c8a0457df0 None admin] REQUEST_METHOD: `GET` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:37:57.526310 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0ac1e6-a738-4a20-8f6e-a7c8a0457df0 None admin] SCRIPT_NAME: `/identity` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:37:57.526590 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0ac1e6-a738-4a20-8f6e-a7c8a0457df0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:37:57.537786 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a0ac1e6-a738-4a20-8f6e-a7c8a0457df0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:37:57.539281 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a0ac1e6-a738-4a20-8f6e-a7c8a0457df0 None admin] RBAC: Authorization granted {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:37:57.555145 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application [None req-5a0ac1e6-a738-4a20-8f6e-a7c8a0457df0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 08:37:57.555145 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:37:57.555145 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:37:57.555145 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:37:57.555145 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:37:57.555145 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:37:57.555145 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:37:57.555145 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:37:57.555145 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:37:57.555145 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:37:57.555145 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:37:57.555145 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:37:57.555145 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 08:37:57.555145 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 08:37:57.555145 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 08:37:57.556350 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 08:37:57.556350 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:37:57.556350 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:37:57.556350 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:37:57.556350 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:37:57.556350 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:37:57.556350 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:37:57.556350 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:37:57.556350 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application with Lock( Jul 28 08:37:57.556350 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:37:57.556350 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:37:57.556350 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:37:57.556350 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:37:57.556350 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:37:57.556350 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:37:57.556350 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:37:57.556350 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:37:57.561956 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 08:37:57.561956 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 08:37:57.561956 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 08:37:57.561956 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application Jul 28 08:37:57.561956 dv-cinder-851351-1-smb devstack@keystone.service[282899]: [pid: 282899|app: 0|req: 523/1050] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 08:37:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:37:57.564812 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db6e9e9-8a7a-4253-b304-50cba6c45344 None admin] Authenticating user token {{(pid=282898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:37:57.620587 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG dbcounter [-] [282898] Writing DB stats keystone:SELECT=100 {{(pid=282898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:37:57.688083 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db6e9e9-8a7a-4253-b304-50cba6c45344 None admin] Validating token access rules against request {{(pid=282898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:37:57.730094 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ef0521-24aa-45ec-a0d6-d144e3341ff4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:37:57.730722 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ef0521-24aa-45ec-a0d6-d144e3341ff4 None admin] REQUEST_METHOD: `GET` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:37:57.731010 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ef0521-24aa-45ec-a0d6-d144e3341ff4 None admin] SCRIPT_NAME: `/identity` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:37:57.731288 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ef0521-24aa-45ec-a0d6-d144e3341ff4 None admin] PATH_INFO: `/v3/domains` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:37:57.732004 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77ef0521-24aa-45ec-a0d6-d144e3341ff4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=282898) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:37:57.732308 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77ef0521-24aa-45ec-a0d6-d144e3341ff4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:37:57.733735 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77ef0521-24aa-45ec-a0d6-d144e3341ff4 None admin] RBAC: Authorization granted {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:37:57.746615 dv-cinder-851351-1-smb devstack@keystone.service[282898]: [pid: 282898|app: 0|req: 528/1051] 10.222.0.42 () {56 vars in 1109 bytes} [Thu Jul 28 08:37:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:37:57.752226 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a0ac1e6-a738-4a20-8f6e-a7c8a0457df0 None admin] Authenticating user token {{(pid=282899) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:37:57.820587 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG dbcounter [-] [282899] Writing DB stats keystone:SELECT=100 {{(pid=282899) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:37:57.865705 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a0ac1e6-a738-4a20-8f6e-a7c8a0457df0 None admin] Validating token access rules against request {{(pid=282899) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:37:57.903508 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d8ac2a-337a-42df-b7c9-ed0da5909766 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282899) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:37:57.904247 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d8ac2a-337a-42df-b7c9-ed0da5909766 None admin] REQUEST_METHOD: `GET` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:37:57.904540 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d8ac2a-337a-42df-b7c9-ed0da5909766 None admin] SCRIPT_NAME: `/identity` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:37:57.904851 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d8ac2a-337a-42df-b7c9-ed0da5909766 None admin] PATH_INFO: `/v3/users/nova` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:37:57.914074 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d8ac2a-337a-42df-b7c9-ed0da5909766 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:37:57.915579 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d8ac2a-337a-42df-b7c9-ed0da5909766 None admin] RBAC: Authorization granted {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:37:57.928273 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application [None req-33d8ac2a-337a-42df-b7c9-ed0da5909766 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 28 08:37:57.928273 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:37:57.928273 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:37:57.928273 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:37:57.928273 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:37:57.928273 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:37:57.928273 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:37:57.928273 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:37:57.928273 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:37:57.928273 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:37:57.928273 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:37:57.928273 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:37:57.928273 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 28 08:37:57.928273 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 28 08:37:57.928273 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 28 08:37:57.928273 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 28 08:37:57.929480 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:37:57.929480 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:37:57.929480 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 28 08:37:57.929480 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 08:37:57.929480 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 28 08:37:57.929480 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 08:37:57.929480 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:37:57.929480 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:37:57.929480 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:37:57.929480 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:37:57.929480 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:37:57.929480 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application with Lock( Jul 28 08:37:57.929480 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:37:57.929480 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:37:57.929480 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:37:57.929480 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:37:57.929480 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:37:57.929480 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:37:57.935911 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:37:57.935911 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:37:57.935911 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 28 08:37:57.935911 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 28 08:37:57.935911 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 28 08:37:57.935911 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 28 08:37:57.935911 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 28 08:37:57.935911 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 28 08:37:57.935911 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 28 08:37:57.935911 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application Jul 28 08:37:57.935911 dv-cinder-851351-1-smb devstack@keystone.service[282899]: [pid: 282899|app: 0|req: 524/1052] 10.222.0.42 () {56 vars in 1093 bytes} [Thu Jul 28 08:37:57 2022] GET /identity/v3/users/nova => generated 82 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:37:57.938024 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ef0521-24aa-45ec-a0d6-d144e3341ff4 None admin] Authenticating user token {{(pid=282898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:37:58.051787 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ef0521-24aa-45ec-a0d6-d144e3341ff4 None admin] Validating token access rules against request {{(pid=282898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:37:58.054232 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG dbcounter [-] [282898] Writing DB stats keystone:SELECT=100 {{(pid=282898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:37:58.089659 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6b7131-7de9-4422-a0fb-a6d2d75f3490 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:37:58.090284 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6b7131-7de9-4422-a0fb-a6d2d75f3490 None admin] REQUEST_METHOD: `GET` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:37:58.090565 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6b7131-7de9-4422-a0fb-a6d2d75f3490 None admin] SCRIPT_NAME: `/identity` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:37:58.090838 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6b7131-7de9-4422-a0fb-a6d2d75f3490 None admin] PATH_INFO: `/v3/users` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:37:58.091652 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b6b7131-7de9-4422-a0fb-a6d2d75f3490 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=282898) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:37:58.091963 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b6b7131-7de9-4422-a0fb-a6d2d75f3490 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:37:58.093462 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b6b7131-7de9-4422-a0fb-a6d2d75f3490 None admin] RBAC: Authorization granted {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:37:58.111522 dv-cinder-851351-1-smb devstack@keystone.service[282898]: [pid: 282898|app: 0|req: 529/1053] 10.222.0.42 () {56 vars in 1133 bytes} [Thu Jul 28 08:37:57 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:37:58.117243 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d8ac2a-337a-42df-b7c9-ed0da5909766 None admin] Authenticating user token {{(pid=282899) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:37:58.221781 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d8ac2a-337a-42df-b7c9-ed0da5909766 None admin] Validating token access rules against request {{(pid=282899) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:37:58.239086 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG dbcounter [-] [282899] Writing DB stats keystone:SELECT=100 {{(pid=282899) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:37:58.258671 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b1dc91-23c8-475f-b6f4-61c9c1752274 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282899) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:37:58.259359 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b1dc91-23c8-475f-b6f4-61c9c1752274 None admin] REQUEST_METHOD: `GET` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:37:58.259644 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b1dc91-23c8-475f-b6f4-61c9c1752274 None admin] SCRIPT_NAME: `/identity` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:37:58.259925 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b1dc91-23c8-475f-b6f4-61c9c1752274 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:37:58.271604 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43b1dc91-23c8-475f-b6f4-61c9c1752274 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:37:58.273128 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43b1dc91-23c8-475f-b6f4-61c9c1752274 None admin] RBAC: Authorization granted {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:37:58.288719 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application [None req-43b1dc91-23c8-475f-b6f4-61c9c1752274 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 08:37:58.288719 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:37:58.288719 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:37:58.288719 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:37:58.288719 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:37:58.288719 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:37:58.288719 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:37:58.288719 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:37:58.288719 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:37:58.288719 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:37:58.288719 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:37:58.288719 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:37:58.288719 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 08:37:58.288719 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 08:37:58.288719 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 08:37:58.289970 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 08:37:58.289970 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:37:58.289970 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:37:58.289970 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:37:58.289970 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:37:58.289970 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:37:58.289970 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:37:58.289970 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:37:58.289970 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application with Lock( Jul 28 08:37:58.289970 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:37:58.289970 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:37:58.289970 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:37:58.289970 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:37:58.289970 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:37:58.289970 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:37:58.289970 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:37:58.289970 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:37:58.291084 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 08:37:58.291084 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 08:37:58.291084 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 08:37:58.291084 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application Jul 28 08:37:58.291084 dv-cinder-851351-1-smb devstack@keystone.service[282899]: [pid: 282899|app: 0|req: 525/1054] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 08:37:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:37:58.297589 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6b7131-7de9-4422-a0fb-a6d2d75f3490 None admin] Authenticating user token {{(pid=282898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:37:58.361634 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b34d458-3d0e-4c20-a47d-3eacf03c643c None None] REQUEST_METHOD: `GET` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:37:58.361881 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b34d458-3d0e-4c20-a47d-3eacf03c643c None None] SCRIPT_NAME: `/identity` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:37:58.362381 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b34d458-3d0e-4c20-a47d-3eacf03c643c None None] PATH_INFO: `/` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:37:58.364701 dv-cinder-851351-1-smb devstack@keystone.service[282899]: [pid: 282899|app: 0|req: 526/1055] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 08:37:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 08:37:58.369438 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6aafc51-d336-46ca-95c7-9ea672b5dcc4 None None] REQUEST_METHOD: `POST` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:37:58.369688 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6aafc51-d336-46ca-95c7-9ea672b5dcc4 None None] SCRIPT_NAME: `/identity` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:37:58.369962 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6aafc51-d336-46ca-95c7-9ea672b5dcc4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:37:58.390439 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.auth.core [None req-a6aafc51-d336-46ca-95c7-9ea672b5dcc4 None None] MFA Rules not processed for user `2be990a66857410a87ffa7609aec4f7b`. Rule list: `[]` (Enabled: `True`). {{(pid=282899) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 08:37:58.391821 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.fernet_utils [None req-a6aafc51-d336-46ca-95c7-9ea672b5dcc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=282899) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:37:58.414566 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6b7131-7de9-4422-a0fb-a6d2d75f3490 None admin] Validating token access rules against request {{(pid=282898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:37:58.452328 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b00d8ea-fc1d-44d8-8209-c7c64a2932c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:37:58.452991 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b00d8ea-fc1d-44d8-8209-c7c64a2932c3 None admin] REQUEST_METHOD: `GET` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:37:58.453282 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b00d8ea-fc1d-44d8-8209-c7c64a2932c3 None admin] SCRIPT_NAME: `/identity` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:37:58.453557 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b00d8ea-fc1d-44d8-8209-c7c64a2932c3 None admin] PATH_INFO: `/v3/domains` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:37:58.454710 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b00d8ea-fc1d-44d8-8209-c7c64a2932c3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=282898) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:37:58.455024 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b00d8ea-fc1d-44d8-8209-c7c64a2932c3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:37:58.456436 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b00d8ea-fc1d-44d8-8209-c7c64a2932c3 None admin] RBAC: Authorization granted {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:37:58.472710 dv-cinder-851351-1-smb devstack@keystone.service[282898]: [pid: 282898|app: 0|req: 530/1056] 10.222.0.42 () {56 vars in 1109 bytes} [Thu Jul 28 08:37:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:37:58.472918 dv-cinder-851351-1-smb devstack@keystone.service[282899]: [pid: 282899|app: 0|req: 527/1057] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 08:37:58 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 28 08:37:58.474425 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b00d8ea-fc1d-44d8-8209-c7c64a2932c3 None admin] Authenticating user token {{(pid=282898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:37:58.490731 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6aafc51-d336-46ca-95c7-9ea672b5dcc4 None None] Authenticating user token {{(pid=282899) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:37:58.503555 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG dbcounter [-] [282898] Writing DB stats keystone:SELECT=100 {{(pid=282898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:37:58.593491 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b00d8ea-fc1d-44d8-8209-c7c64a2932c3 None admin] Validating token access rules against request {{(pid=282898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:37:58.601125 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG dbcounter [-] [282899] Writing DB stats keystone:SELECT=100 {{(pid=282899) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:37:58.605303 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6aafc51-d336-46ca-95c7-9ea672b5dcc4 None None] Validating token access rules against request {{(pid=282899) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:37:58.634775 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3f8c5d-f1c6-45ed-b6a3-52dd0a685586 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:37:58.635619 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3f8c5d-f1c6-45ed-b6a3-52dd0a685586 None admin] REQUEST_METHOD: `GET` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:37:58.635910 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3f8c5d-f1c6-45ed-b6a3-52dd0a685586 None admin] SCRIPT_NAME: `/identity` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:37:58.636188 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3f8c5d-f1c6-45ed-b6a3-52dd0a685586 None admin] PATH_INFO: `/v3/projects/service` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:37:58.642675 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d39e6e-3b72-47b6-a0a2-e0980262fb46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282899) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:37:58.643345 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d39e6e-3b72-47b6-a0a2-e0980262fb46 None admin] REQUEST_METHOD: `GET` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:37:58.643641 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d39e6e-3b72-47b6-a0a2-e0980262fb46 None admin] SCRIPT_NAME: `/identity` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:37:58.643921 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d39e6e-3b72-47b6-a0a2-e0980262fb46 None admin] PATH_INFO: `/v3/services/image` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:37:58.644572 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80d39e6e-3b72-47b6-a0a2-e0980262fb46 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:37:58.645174 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e3f8c5d-f1c6-45ed-b6a3-52dd0a685586 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:37:58.645996 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80d39e6e-3b72-47b6-a0a2-e0980262fb46 None admin] RBAC: Authorization granted {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:37:58.647196 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e3f8c5d-f1c6-45ed-b6a3-52dd0a685586 None admin] RBAC: Authorization granted {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:37:58.655765 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application [None req-80d39e6e-3b72-47b6-a0a2-e0980262fb46 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jul 28 08:37:58.655765 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:37:58.655765 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 28 08:37:58.655765 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 28 08:37:58.655765 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 28 08:37:58.655765 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 28 08:37:58.655765 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 28 08:37:58.655765 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 08:37:58.655765 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 28 08:37:58.655765 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application Jul 28 08:37:58.655765 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 28 08:37:58.655765 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application Jul 28 08:37:58.655765 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:37:58.655765 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:37:58.655765 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:37:58.655765 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:37:58.655765 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:37:58.662341 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:37:58.662341 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:37:58.662341 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:37:58.662341 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:37:58.662341 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:37:58.662341 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:37:58.662341 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 28 08:37:58.662341 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 28 08:37:58.662341 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 28 08:37:58.662341 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 28 08:37:58.662341 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:37:58.662341 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:37:58.662341 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:37:58.662341 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:37:58.662341 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:37:58.662341 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:37:58.663512 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:37:58.663512 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application with Lock( Jul 28 08:37:58.663512 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:37:58.663512 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:37:58.663512 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:37:58.663512 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:37:58.663512 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:37:58.663512 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:37:58.663512 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:37:58.663512 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:37:58.663512 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 28 08:37:58.663512 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 08:37:58.663512 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 28 08:37:58.663512 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application Jul 28 08:37:58.663512 dv-cinder-851351-1-smb devstack@keystone.service[282899]: [pid: 282899|app: 0|req: 528/1058] 10.222.0.42 () {56 vars in 1105 bytes} [Thu Jul 28 08:37:58 2022] GET /identity/v3/services/image => generated 86 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:37:58.664512 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application [None req-6e3f8c5d-f1c6-45ed-b6a3-52dd0a685586 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 08:37:58.664512 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:37:58.664512 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:37:58.664512 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:37:58.664512 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:37:58.664512 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:37:58.664512 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:37:58.664512 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:37:58.664512 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:37:58.664512 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:37:58.664512 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:37:58.664512 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:37:58.664512 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 28 08:37:58.664512 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 28 08:37:58.664512 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 28 08:37:58.665537 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 28 08:37:58.665537 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:37:58.665537 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:37:58.665537 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:37:58.665537 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:37:58.665537 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:37:58.665537 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:37:58.665537 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:37:58.665537 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application with Lock( Jul 28 08:37:58.665537 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:37:58.665537 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:37:58.665537 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:37:58.665537 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:37:58.665537 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:37:58.665537 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:37:58.665537 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:37:58.665537 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:37:58.666618 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 28 08:37:58.666618 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 28 08:37:58.666618 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 28 08:37:58.666618 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 28 08:37:58.666618 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 28 08:37:58.666618 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 28 08:37:58.666618 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 08:37:58.666618 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application Jul 28 08:37:58.666618 dv-cinder-851351-1-smb devstack@keystone.service[282898]: [pid: 282898|app: 0|req: 531/1059] 10.222.0.42 () {56 vars in 1111 bytes} [Thu Jul 28 08:37:58 2022] GET /identity/v3/projects/service => generated 88 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:37:58.667240 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d39e6e-3b72-47b6-a0a2-e0980262fb46 None admin] Authenticating user token {{(pid=282899) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:37:58.668753 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3f8c5d-f1c6-45ed-b6a3-52dd0a685586 None admin] Authenticating user token {{(pid=282898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:37:58.763480 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG dbcounter [-] [282898] Writing DB stats keystone:SELECT=100 {{(pid=282898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:37:58.778723 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d39e6e-3b72-47b6-a0a2-e0980262fb46 None admin] Validating token access rules against request {{(pid=282899) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:37:58.790675 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3f8c5d-f1c6-45ed-b6a3-52dd0a685586 None admin] Validating token access rules against request {{(pid=282898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:37:58.816961 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be955a9d-524f-4ced-beb6-e68bd0279f26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282899) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:37:58.817101 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be955a9d-524f-4ced-beb6-e68bd0279f26 None admin] REQUEST_METHOD: `GET` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:37:58.817281 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be955a9d-524f-4ced-beb6-e68bd0279f26 None admin] SCRIPT_NAME: `/identity` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:37:58.817556 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be955a9d-524f-4ced-beb6-e68bd0279f26 None admin] PATH_INFO: `/v3/services` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:37:58.818283 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be955a9d-524f-4ced-beb6-e68bd0279f26 None admin] RBAC: Adding query filter params (name=image) {{(pid=282899) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:37:58.818587 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be955a9d-524f-4ced-beb6-e68bd0279f26 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:37:58.819990 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be955a9d-524f-4ced-beb6-e68bd0279f26 None admin] RBAC: Authorization granted {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:37:58.825060 dv-cinder-851351-1-smb devstack@keystone.service[282899]: [pid: 282899|app: 0|req: 529/1060] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 08:37:58 2022] GET /identity/v3/services?name=image => generated 122 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:37:58.826320 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9596dd-e288-48f4-aefd-420f0591a03f None None] REQUEST_METHOD: `GET` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:37:58.826625 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9596dd-e288-48f4-aefd-420f0591a03f None None] SCRIPT_NAME: `/identity` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:37:58.826884 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9596dd-e288-48f4-aefd-420f0591a03f None None] PATH_INFO: `/` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:37:58.828088 dv-cinder-851351-1-smb devstack@keystone.service[282899]: [pid: 282899|app: 0|req: 530/1061] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 08:37:58 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 08:37:58.831254 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9596dd-e288-48f4-aefd-420f0591a03f None None] Authenticating user token {{(pid=282899) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:37:58.834789 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e80a3f8-9b08-441b-b5a3-e46d9c9db3e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:37:58.835423 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e80a3f8-9b08-441b-b5a3-e46d9c9db3e7 None admin] REQUEST_METHOD: `GET` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:37:58.835707 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e80a3f8-9b08-441b-b5a3-e46d9c9db3e7 None admin] SCRIPT_NAME: `/identity` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:37:58.835981 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e80a3f8-9b08-441b-b5a3-e46d9c9db3e7 None admin] PATH_INFO: `/v3/projects` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:37:58.836779 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e80a3f8-9b08-441b-b5a3-e46d9c9db3e7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=282898) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:37:58.837091 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e80a3f8-9b08-441b-b5a3-e46d9c9db3e7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:37:58.838535 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e80a3f8-9b08-441b-b5a3-e46d9c9db3e7 None admin] RBAC: Authorization granted {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:37:58.851211 dv-cinder-851351-1-smb devstack@keystone.service[282898]: [pid: 282898|app: 0|req: 532/1062] 10.222.0.42 () {56 vars in 1148 bytes} [Thu Jul 28 08:37:58 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:37:58.852432 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815ff3fa-6ee6-427a-a599-ed13dcc930ee None None] REQUEST_METHOD: `POST` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:37:58.852746 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815ff3fa-6ee6-427a-a599-ed13dcc930ee None None] SCRIPT_NAME: `/identity` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:37:58.853026 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815ff3fa-6ee6-427a-a599-ed13dcc930ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:37:58.860824 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG dbcounter [-] [282899] Writing DB stats keystone:SELECT=100 {{(pid=282899) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:37:58.871721 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.auth.core [None req-815ff3fa-6ee6-427a-a599-ed13dcc930ee None None] MFA Rules not processed for user `2be990a66857410a87ffa7609aec4f7b`. Rule list: `[]` (Enabled: `True`). {{(pid=282898) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 08:37:58.872987 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.fernet_utils [None req-815ff3fa-6ee6-427a-a599-ed13dcc930ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=282898) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:37:58.938901 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9596dd-e288-48f4-aefd-420f0591a03f None None] Validating token access rules against request {{(pid=282899) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:37:58.939764 dv-cinder-851351-1-smb devstack@keystone.service[282898]: [pid: 282898|app: 0|req: 533/1063] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 08:37:58 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 08:37:58.940594 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815ff3fa-6ee6-427a-a599-ed13dcc930ee None None] Authenticating user token {{(pid=282898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:37:58.974838 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-409b031e-392b-4424-8c14-c87a23a5f961 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282899) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:37:58.975482 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409b031e-392b-4424-8c14-c87a23a5f961 None admin] REQUEST_METHOD: `GET` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:37:58.975767 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409b031e-392b-4424-8c14-c87a23a5f961 None admin] SCRIPT_NAME: `/identity` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:37:58.976046 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409b031e-392b-4424-8c14-c87a23a5f961 None admin] PATH_INFO: `/v3/services` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:37:58.976785 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-409b031e-392b-4424-8c14-c87a23a5f961 None admin] RBAC: Adding query filter params (type=image) {{(pid=282899) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:37:58.977103 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-409b031e-392b-4424-8c14-c87a23a5f961 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:37:58.978502 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-409b031e-392b-4424-8c14-c87a23a5f961 None admin] RBAC: Authorization granted {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:37:58.983538 dv-cinder-851351-1-smb devstack@keystone.service[282899]: [pid: 282899|app: 0|req: 531/1064] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 08:37:58 2022] GET /identity/v3/services?type=image => generated 350 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 08:37:58.985660 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-409b031e-392b-4424-8c14-c87a23a5f961 None admin] Authenticating user token {{(pid=282899) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:37:59.018009 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG dbcounter [-] [282898] Writing DB stats keystone:SELECT=100 {{(pid=282898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:37:59.047665 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815ff3fa-6ee6-427a-a599-ed13dcc930ee None None] Validating token access rules against request {{(pid=282898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:37:59.075025 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG dbcounter [-] [282899] Writing DB stats keystone:SELECT=100 {{(pid=282899) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:37:59.083120 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37dd84a3-8b48-41c0-9776-2099050f6ac3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:37:59.083791 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37dd84a3-8b48-41c0-9776-2099050f6ac3 None admin] REQUEST_METHOD: `PUT` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:37:59.084086 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37dd84a3-8b48-41c0-9776-2099050f6ac3 None admin] SCRIPT_NAME: `/identity` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:37:59.084381 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37dd84a3-8b48-41c0-9776-2099050f6ac3 None admin] PATH_INFO: `/v3/projects/5cde68cbfb9042dc9f36af3aacea2473/users/5e192fe026ef4f109b9a1099815c5926/roles/f33deecb73a247c0b6c50fe050d1ef3a` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:37:59.085911 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-409b031e-392b-4424-8c14-c87a23a5f961 None admin] Validating token access rules against request {{(pid=282899) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:37:59.086706 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37dd84a3-8b48-41c0-9776-2099050f6ac3 None admin] RBAC: Authorizing `identity:create_grant(project_id=5cde68cbfb9042dc9f36af3aacea2473, user_id=5e192fe026ef4f109b9a1099815c5926, role_id=f33deecb73a247c0b6c50fe050d1ef3a)` {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:37:59.088171 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37dd84a3-8b48-41c0-9776-2099050f6ac3 None admin] RBAC: Authorization granted {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:37:59.102362 dv-cinder-851351-1-smb devstack@keystone.service[282898]: [pid: 282898|app: 0|req: 534/1065] 10.222.0.42 () {58 vars in 1439 bytes} [Thu Jul 28 08:37:58 2022] PUT /identity/v3/projects/5cde68cbfb9042dc9f36af3aacea2473/users/5e192fe026ef4f109b9a1099815c5926/roles/f33deecb73a247c0b6c50fe050d1ef3a => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 08:37:59.103311 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37dd84a3-8b48-41c0-9776-2099050f6ac3 None admin] Authenticating user token {{(pid=282898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:37:59.134273 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b722b8-16ad-4e95-9a92-09b022e132c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282899) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:37:59.134958 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b722b8-16ad-4e95-9a92-09b022e132c6 None admin] REQUEST_METHOD: `GET` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:37:59.135241 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b722b8-16ad-4e95-9a92-09b022e132c6 None admin] SCRIPT_NAME: `/identity` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:37:59.135521 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b722b8-16ad-4e95-9a92-09b022e132c6 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:37:59.147961 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8b722b8-16ad-4e95-9a92-09b022e132c6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 08:37:59.153614 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application [None req-d8b722b8-16ad-4e95-9a92-09b022e132c6 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 08:37:59.153614 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:37:59.153614 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:37:59.153614 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:37:59.153614 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:37:59.153614 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:37:59.153614 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:37:59.153614 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:37:59.153614 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:37:59.153614 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:37:59.153614 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:37:59.153614 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:37:59.153614 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 08:37:59.153614 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 08:37:59.153614 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 08:37:59.153614 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 08:37:59.157028 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 08:37:59.157028 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 08:37:59.157028 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 08:37:59.157028 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 08:37:59.157028 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:37:59.157028 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:37:59.157028 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:37:59.157028 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:37:59.157028 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:37:59.157028 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:37:59.157028 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:37:59.157028 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application with Lock( Jul 28 08:37:59.157028 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:37:59.157028 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:37:59.157028 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:37:59.157028 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:37:59.158155 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:37:59.158155 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:37:59.158155 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:37:59.158155 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:37:59.158155 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 08:37:59.158155 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 08:37:59.158155 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 08:37:59.158155 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 08:37:59.158155 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 08:37:59.158155 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 08:37:59.158155 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 08:37:59.158155 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application Jul 28 08:37:59.158155 dv-cinder-851351-1-smb devstack@keystone.service[282899]: [pid: 282899|app: 0|req: 532/1066] 10.222.0.42 () {56 vars in 1096 bytes} [Thu Jul 28 08:37:58 2022] GET /identity/v3/roles/admin => generated 83 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:37:59.161627 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b722b8-16ad-4e95-9a92-09b022e132c6 None admin] Authenticating user token {{(pid=282899) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:37:59.227937 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37dd84a3-8b48-41c0-9776-2099050f6ac3 None admin] Validating token access rules against request {{(pid=282898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:37:59.265775 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG dbcounter [-] [282898] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=282898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:37:59.276557 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cde914c-2e24-4549-96d3-0d8267c31cd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:37:59.277929 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cde914c-2e24-4549-96d3-0d8267c31cd8 None admin] REQUEST_METHOD: `POST` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:37:59.278213 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cde914c-2e24-4549-96d3-0d8267c31cd8 None admin] SCRIPT_NAME: `/identity` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:37:59.278503 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cde914c-2e24-4549-96d3-0d8267c31cd8 None admin] PATH_INFO: `/v3/endpoints` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:37:59.280457 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cde914c-2e24-4549-96d3-0d8267c31cd8 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:37:59.281917 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cde914c-2e24-4549-96d3-0d8267c31cd8 None admin] RBAC: Authorization granted {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:37:59.283599 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b722b8-16ad-4e95-9a92-09b022e132c6 None admin] Validating token access rules against request {{(pid=282899) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:37:59.304967 dv-cinder-851351-1-smb devstack@keystone.service[282898]: [pid: 282898|app: 0|req: 535/1067] 10.222.0.42 () {60 vars in 1144 bytes} [Thu Jul 28 08:37:59 2022] POST /identity/v3/endpoints => generated 327 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 08:37:59.331931 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb1d27b5-6cb0-463f-8ce2-c79644498392 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282899) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:37:59.332609 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1d27b5-6cb0-463f-8ce2-c79644498392 None admin] REQUEST_METHOD: `GET` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:37:59.332939 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1d27b5-6cb0-463f-8ce2-c79644498392 None admin] SCRIPT_NAME: `/identity` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:37:59.333216 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1d27b5-6cb0-463f-8ce2-c79644498392 None admin] PATH_INFO: `/v3/roles` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:37:59.333999 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb1d27b5-6cb0-463f-8ce2-c79644498392 None admin] RBAC: Adding query filter params (name=admin) {{(pid=282899) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:37:59.334310 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb1d27b5-6cb0-463f-8ce2-c79644498392 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:37:59.335765 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb1d27b5-6cb0-463f-8ce2-c79644498392 None admin] RBAC: Authorization granted {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:37:59.346522 dv-cinder-851351-1-smb devstack@keystone.service[282899]: [pid: 282899|app: 0|req: 533/1068] 10.222.0.42 () {56 vars in 1099 bytes} [Thu Jul 28 08:37:59 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 08:37:59.352612 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cde914c-2e24-4549-96d3-0d8267c31cd8 None admin] Authenticating user token {{(pid=282898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:37:59.470619 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cde914c-2e24-4549-96d3-0d8267c31cd8 None admin] Validating token access rules against request {{(pid=282898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:37:59.509364 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f93e35f-da5e-40ad-b651-b74d46c2c0d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:37:59.509945 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f93e35f-da5e-40ad-b651-b74d46c2c0d4 None admin] REQUEST_METHOD: `GET` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:37:59.510230 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f93e35f-da5e-40ad-b651-b74d46c2c0d4 None admin] SCRIPT_NAME: `/identity` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:37:59.510505 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f93e35f-da5e-40ad-b651-b74d46c2c0d4 None admin] PATH_INFO: `/v3/users/8d7022dc9553422f95d85348b17ab680` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:37:59.526008 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f93e35f-da5e-40ad-b651-b74d46c2c0d4 None admin] RBAC: Authorizing `identity:get_user(user_id=8d7022dc9553422f95d85348b17ab680)` {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:37:59.527502 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f93e35f-da5e-40ad-b651-b74d46c2c0d4 None admin] RBAC: Authorization granted {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:37:59.529539 dv-cinder-851351-1-smb devstack@keystone.service[282898]: [pid: 282898|app: 0|req: 536/1069] 10.222.0.42 () {56 vars in 1177 bytes} [Thu Jul 28 08:37:59 2022] GET /identity/v3/users/8d7022dc9553422f95d85348b17ab680 => generated 285 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:37:59.535304 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb1d27b5-6cb0-463f-8ce2-c79644498392 None admin] Authenticating user token {{(pid=282899) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:37:59.547450 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG dbcounter [-] [282899] Writing DB stats keystone:SELECT=100 {{(pid=282899) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:37:59.644396 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb1d27b5-6cb0-463f-8ce2-c79644498392 None admin] Validating token access rules against request {{(pid=282899) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:37:59.682228 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51321342-f333-4dcf-9e56-b5fabe7fd934 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282899) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:37:59.682871 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51321342-f333-4dcf-9e56-b5fabe7fd934 None admin] REQUEST_METHOD: `GET` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:37:59.683213 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51321342-f333-4dcf-9e56-b5fabe7fd934 None admin] SCRIPT_NAME: `/identity` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:37:59.683417 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51321342-f333-4dcf-9e56-b5fabe7fd934 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:37:59.756960 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51321342-f333-4dcf-9e56-b5fabe7fd934 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:37:59.758430 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51321342-f333-4dcf-9e56-b5fabe7fd934 None admin] RBAC: Authorization granted {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:37:59.768945 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG dbcounter [-] [282899] Writing DB stats keystone:SELECT=100 {{(pid=282899) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:37:59.874984 dv-cinder-851351-1-smb devstack@keystone.service[282899]: [pid: 282899|app: 0|req: 534/1070] 10.222.0.42 () {58 vars in 1282 bytes} [Thu Jul 28 08:37:59 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 340 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 28 08:37:59.880979 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f93e35f-da5e-40ad-b651-b74d46c2c0d4 None admin] Authenticating user token {{(pid=282898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:37:59.931898 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG dbcounter [-] [282898] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=282898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:37:59.990895 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f93e35f-da5e-40ad-b651-b74d46c2c0d4 None admin] Validating token access rules against request {{(pid=282898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:38:00.028545 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6cddba-6a58-403d-a2a6-40f0398b7f44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:38:00.029332 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6cddba-6a58-403d-a2a6-40f0398b7f44 None admin] REQUEST_METHOD: `GET` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:38:00.029624 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6cddba-6a58-403d-a2a6-40f0398b7f44 None admin] SCRIPT_NAME: `/identity` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:38:00.029902 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6cddba-6a58-403d-a2a6-40f0398b7f44 None admin] PATH_INFO: `/v3/projects/6116135c46aa445298ea96f8874b0611` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:38:00.031214 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b6cddba-6a58-403d-a2a6-40f0398b7f44 None admin] RBAC: Authorizing `identity:get_project(project_id=6116135c46aa445298ea96f8874b0611)` {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:38:00.032775 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b6cddba-6a58-403d-a2a6-40f0398b7f44 None admin] RBAC: Authorization granted {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:38:00.034741 dv-cinder-851351-1-smb devstack@keystone.service[282898]: [pid: 282898|app: 0|req: 537/1071] 10.222.0.42 () {56 vars in 1186 bytes} [Thu Jul 28 08:37:59 2022] GET /identity/v3/projects/6116135c46aa445298ea96f8874b0611 => generated 311 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:38:00.041158 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51321342-f333-4dcf-9e56-b5fabe7fd934 None admin] Authenticating user token {{(pid=282899) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:38:00.152097 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51321342-f333-4dcf-9e56-b5fabe7fd934 None admin] Validating token access rules against request {{(pid=282899) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:38:00.164093 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG dbcounter [-] [282899] Writing DB stats keystone:SELECT=100 {{(pid=282899) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:38:00.198702 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a6de66-5a60-482c-a953-0a0819d78aa9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282899) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:38:00.199381 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a6de66-5a60-482c-a953-0a0819d78aa9 None admin] REQUEST_METHOD: `GET` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:38:00.199668 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a6de66-5a60-482c-a953-0a0819d78aa9 None admin] SCRIPT_NAME: `/identity` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:38:00.199954 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a6de66-5a60-482c-a953-0a0819d78aa9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:38:00.200867 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37a6de66-5a60-482c-a953-0a0819d78aa9 None admin] RBAC: Adding query filter params (role.id=a0e2a00bf94d40f38629d6b5293e3aee, scope.project.id=6116135c46aa445298ea96f8874b0611, user.id=8d7022dc9553422f95d85348b17ab680) {{(pid=282899) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:38:00.201193 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37a6de66-5a60-482c-a953-0a0819d78aa9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:38:00.202762 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37a6de66-5a60-482c-a953-0a0819d78aa9 None admin] RBAC: Authorization granted {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:38:00.210426 dv-cinder-851351-1-smb devstack@keystone.service[282899]: [pid: 282899|app: 0|req: 535/1072] 10.222.0.42 () {56 vars in 1374 bytes} [Thu Jul 28 08:38:00 2022] GET /identity/v3/role_assignments?user.id=8d7022dc9553422f95d85348b17ab680&scope.project.id=6116135c46aa445298ea96f8874b0611&role.id=a0e2a00bf94d40f38629d6b5293e3aee => generated 259 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 08:38:01.136389 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55283de9-8701-4f5f-98fc-96da2a8e85b7 None None] REQUEST_METHOD: `GET` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:38:01.137055 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55283de9-8701-4f5f-98fc-96da2a8e85b7 None None] SCRIPT_NAME: `/identity` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:38:01.137055 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55283de9-8701-4f5f-98fc-96da2a8e85b7 None None] PATH_INFO: `/` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:38:01.138467 dv-cinder-851351-1-smb devstack@keystone.service[282898]: [pid: 282898|app: 0|req: 538/1073] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 08:38:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 08:38:01.144016 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c52f15-ef95-4099-9da9-925960e4cb57 None None] REQUEST_METHOD: `POST` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:38:01.144949 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c52f15-ef95-4099-9da9-925960e4cb57 None None] SCRIPT_NAME: `/identity` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:38:01.144949 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c52f15-ef95-4099-9da9-925960e4cb57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:38:01.170217 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.auth.core [None req-12c52f15-ef95-4099-9da9-925960e4cb57 None None] MFA Rules not processed for user `2be990a66857410a87ffa7609aec4f7b`. Rule list: `[]` (Enabled: `True`). {{(pid=282899) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 08:38:01.172244 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.fernet_utils [None req-12c52f15-ef95-4099-9da9-925960e4cb57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=282899) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:38:01.259325 dv-cinder-851351-1-smb devstack@keystone.service[282899]: [pid: 282899|app: 0|req: 536/1074] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 08:38:01 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 08:38:01.282646 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55283de9-8701-4f5f-98fc-96da2a8e85b7 None None] Authenticating user token {{(pid=282898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:38:01.373476 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6aa94c2-0fb4-41bf-b7ce-fa4f78606189 None None] REQUEST_METHOD: `GET` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:38:01.374151 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6aa94c2-0fb4-41bf-b7ce-fa4f78606189 None None] SCRIPT_NAME: `/identity` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:38:01.374434 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6aa94c2-0fb4-41bf-b7ce-fa4f78606189 None None] PATH_INFO: `/` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:38:01.375838 dv-cinder-851351-1-smb devstack@keystone.service[282899]: [pid: 282899|app: 0|req: 537/1075] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 08:38:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 08:38:01.382198 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a130ac33-e304-4b35-9ab2-599b5a552068 None None] REQUEST_METHOD: `POST` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:38:01.382484 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a130ac33-e304-4b35-9ab2-599b5a552068 None None] SCRIPT_NAME: `/identity` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:38:01.382761 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a130ac33-e304-4b35-9ab2-599b5a552068 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:38:01.402044 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.auth.core [None req-a130ac33-e304-4b35-9ab2-599b5a552068 None None] MFA Rules not processed for user `2be990a66857410a87ffa7609aec4f7b`. Rule list: `[]` (Enabled: `True`). {{(pid=282899) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 08:38:01.403276 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.fernet_utils [None req-a130ac33-e304-4b35-9ab2-599b5a552068 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=282899) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:38:01.403557 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55283de9-8701-4f5f-98fc-96da2a8e85b7 None None] Validating token access rules against request {{(pid=282898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:38:01.420481 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG dbcounter [-] [282898] Writing DB stats keystone:SELECT=100 {{(pid=282898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:38:01.445338 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005c8a23-0e90-4ac1-b450-18b28c4ddbad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:38:01.446003 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005c8a23-0e90-4ac1-b450-18b28c4ddbad None admin] REQUEST_METHOD: `GET` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:38:01.446285 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005c8a23-0e90-4ac1-b450-18b28c4ddbad None admin] SCRIPT_NAME: `/identity` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:38:01.446564 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005c8a23-0e90-4ac1-b450-18b28c4ddbad None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:38:01.458804 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-005c8a23-0e90-4ac1-b450-18b28c4ddbad None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 08:38:01.463891 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application [None req-005c8a23-0e90-4ac1-b450-18b28c4ddbad None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 28 08:38:01.463891 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:38:01.463891 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:38:01.463891 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:38:01.463891 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:38:01.463891 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:38:01.463891 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:38:01.463891 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:38:01.463891 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:38:01.463891 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:38:01.463891 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:38:01.463891 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:38:01.463891 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 08:38:01.463891 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 08:38:01.463891 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 08:38:01.463891 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 08:38:01.465067 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 08:38:01.465067 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 08:38:01.465067 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 08:38:01.465067 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 08:38:01.465067 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:38:01.465067 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:38:01.465067 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:38:01.465067 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:38:01.465067 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:38:01.465067 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:38:01.465067 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:38:01.465067 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application with Lock( Jul 28 08:38:01.465067 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:38:01.465067 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:38:01.465067 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:38:01.465067 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:38:01.466104 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:38:01.466104 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:38:01.466104 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:38:01.466104 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:38:01.466104 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 08:38:01.466104 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 08:38:01.466104 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 08:38:01.466104 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 08:38:01.466104 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 08:38:01.466104 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 08:38:01.466104 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 28 08:38:01.466104 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application Jul 28 08:38:01.470601 dv-cinder-851351-1-smb devstack@keystone.service[282898]: [pid: 282898|app: 0|req: 539/1076] 10.222.0.42 () {56 vars in 1120 bytes} [Thu Jul 28 08:38:01 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:38:01.471391 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005c8a23-0e90-4ac1-b450-18b28c4ddbad None admin] Authenticating user token {{(pid=282898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:38:01.480830 dv-cinder-851351-1-smb devstack@keystone.service[282899]: [pid: 282899|app: 0|req: 538/1077] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 08:38:01 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 08:38:01.502827 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a130ac33-e304-4b35-9ab2-599b5a552068 None None] Authenticating user token {{(pid=282899) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:38:01.535801 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG dbcounter [-] [282899] Writing DB stats keystone:SELECT=100 {{(pid=282899) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:38:01.584926 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005c8a23-0e90-4ac1-b450-18b28c4ddbad None admin] Validating token access rules against request {{(pid=282898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:38:01.613429 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a130ac33-e304-4b35-9ab2-599b5a552068 None None] Validating token access rules against request {{(pid=282899) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:38:01.622351 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2781cd64-836a-43f0-9143-e9f3a52dff39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:38:01.622991 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2781cd64-836a-43f0-9143-e9f3a52dff39 None admin] REQUEST_METHOD: `GET` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:38:01.623275 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2781cd64-836a-43f0-9143-e9f3a52dff39 None admin] SCRIPT_NAME: `/identity` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:38:01.623561 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2781cd64-836a-43f0-9143-e9f3a52dff39 None admin] PATH_INFO: `/v3/roles` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:38:01.624304 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2781cd64-836a-43f0-9143-e9f3a52dff39 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=282898) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:38:01.624617 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2781cd64-836a-43f0-9143-e9f3a52dff39 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:38:01.626044 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2781cd64-836a-43f0-9143-e9f3a52dff39 None admin] RBAC: Authorization granted {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:38:01.635645 dv-cinder-851351-1-smb devstack@keystone.service[282898]: [pid: 282898|app: 0|req: 540/1078] 10.222.0.42 () {56 vars in 1115 bytes} [Thu Jul 28 08:38:01 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:38:01.641395 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2781cd64-836a-43f0-9143-e9f3a52dff39 None admin] Authenticating user token {{(pid=282898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:38:01.650554 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371842f3-4cb8-4b0c-9884-f11856c0d0ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282899) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:38:01.651202 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371842f3-4cb8-4b0c-9884-f11856c0d0ce None admin] REQUEST_METHOD: `GET` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:38:01.651493 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371842f3-4cb8-4b0c-9884-f11856c0d0ce None admin] SCRIPT_NAME: `/identity` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:38:01.651782 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371842f3-4cb8-4b0c-9884-f11856c0d0ce None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:38:01.679036 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG dbcounter [-] [282898] Writing DB stats keystone:SELECT=100 {{(pid=282898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:38:01.729025 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-371842f3-4cb8-4b0c-9884-f11856c0d0ce None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:38:01.730855 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-371842f3-4cb8-4b0c-9884-f11856c0d0ce None admin] RBAC: Authorization granted {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:38:01.754279 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2781cd64-836a-43f0-9143-e9f3a52dff39 None admin] Validating token access rules against request {{(pid=282898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:38:01.770553 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG dbcounter [-] [282899] Writing DB stats keystone:SELECT=100 {{(pid=282899) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:38:01.799878 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea5cd0b-04dc-4453-bb29-88ab2ef20f38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:38:01.800546 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea5cd0b-04dc-4453-bb29-88ab2ef20f38 None admin] REQUEST_METHOD: `GET` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:38:01.800890 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea5cd0b-04dc-4453-bb29-88ab2ef20f38 None admin] SCRIPT_NAME: `/identity` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:38:01.801159 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea5cd0b-04dc-4453-bb29-88ab2ef20f38 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:38:01.813065 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ea5cd0b-04dc-4453-bb29-88ab2ef20f38 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:38:01.814713 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ea5cd0b-04dc-4453-bb29-88ab2ef20f38 None admin] RBAC: Authorization granted {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:38:01.834097 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application [None req-2ea5cd0b-04dc-4453-bb29-88ab2ef20f38 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 08:38:01.834097 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:38:01.834097 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:38:01.834097 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:38:01.834097 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:38:01.834097 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:38:01.834097 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:38:01.834097 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:38:01.834097 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:38:01.834097 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:38:01.834097 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:38:01.834097 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:38:01.834097 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 08:38:01.834097 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 08:38:01.834097 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 08:38:01.835378 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 08:38:01.835378 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:38:01.835378 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:38:01.835378 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:38:01.835378 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:38:01.835378 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:38:01.835378 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:38:01.835378 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:38:01.835378 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application with Lock( Jul 28 08:38:01.835378 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:38:01.835378 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:38:01.835378 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:38:01.835378 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:38:01.835378 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:38:01.835378 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:38:01.835378 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:38:01.835378 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:38:01.837517 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 08:38:01.837517 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 08:38:01.837517 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 08:38:01.837517 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application Jul 28 08:38:01.837517 dv-cinder-851351-1-smb devstack@keystone.service[282898]: [pid: 282898|app: 0|req: 541/1079] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 08:38:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 08:38:01.841203 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea5cd0b-04dc-4453-bb29-88ab2ef20f38 None admin] Authenticating user token {{(pid=282898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:38:01.854651 dv-cinder-851351-1-smb devstack@keystone.service[282899]: [pid: 282899|app: 0|req: 539/1080] 10.222.0.42 () {58 vars in 1282 bytes} [Thu Jul 28 08:38:01 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 352 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jul 28 08:38:01.860272 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371842f3-4cb8-4b0c-9884-f11856c0d0ce None admin] Authenticating user token {{(pid=282899) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:38:01.937428 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG dbcounter [-] [282898] Writing DB stats keystone:SELECT=100 {{(pid=282898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:38:01.951035 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea5cd0b-04dc-4453-bb29-88ab2ef20f38 None admin] Validating token access rules against request {{(pid=282898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:38:01.973178 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371842f3-4cb8-4b0c-9884-f11856c0d0ce None admin] Validating token access rules against request {{(pid=282899) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:38:01.989276 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88bbabfc-390d-4dcf-870e-e0d875d72345 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:38:01.990279 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88bbabfc-390d-4dcf-870e-e0d875d72345 None admin] REQUEST_METHOD: `GET` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:38:01.990605 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88bbabfc-390d-4dcf-870e-e0d875d72345 None admin] SCRIPT_NAME: `/identity` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:38:01.990849 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88bbabfc-390d-4dcf-870e-e0d875d72345 None admin] PATH_INFO: `/v3/domains` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:38:01.991715 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88bbabfc-390d-4dcf-870e-e0d875d72345 None admin] RBAC: Adding query filter params (name=Default) {{(pid=282898) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:38:01.992034 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88bbabfc-390d-4dcf-870e-e0d875d72345 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:38:01.993443 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88bbabfc-390d-4dcf-870e-e0d875d72345 None admin] RBAC: Authorization granted {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:38:02.004021 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG dbcounter [-] [282899] Writing DB stats keystone:SELECT=100 {{(pid=282899) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:38:02.012707 dv-cinder-851351-1-smb devstack@keystone.service[282898]: [pid: 282898|app: 0|req: 542/1081] 10.222.0.42 () {56 vars in 1109 bytes} [Thu Jul 28 08:38:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 08:38:02.014261 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88bbabfc-390d-4dcf-870e-e0d875d72345 None admin] Authenticating user token {{(pid=282898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:38:02.014396 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651e9542-5b34-4577-a3a8-386ef847d32f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282899) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:38:02.015003 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651e9542-5b34-4577-a3a8-386ef847d32f None admin] REQUEST_METHOD: `GET` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:38:02.015286 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651e9542-5b34-4577-a3a8-386ef847d32f None admin] SCRIPT_NAME: `/identity` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:38:02.015565 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651e9542-5b34-4577-a3a8-386ef847d32f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:38:02.026439 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-651e9542-5b34-4577-a3a8-386ef847d32f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:38:02.027945 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-651e9542-5b34-4577-a3a8-386ef847d32f None admin] RBAC: Authorization granted {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:38:02.043224 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application [None req-651e9542-5b34-4577-a3a8-386ef847d32f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 08:38:02.043224 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:38:02.043224 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:38:02.043224 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:38:02.043224 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:38:02.043224 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:38:02.043224 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:38:02.043224 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:38:02.043224 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:38:02.043224 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:38:02.043224 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:38:02.043224 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:38:02.043224 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 08:38:02.043224 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 08:38:02.043224 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 08:38:02.044342 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 08:38:02.044342 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:38:02.044342 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:38:02.044342 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:38:02.044342 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:38:02.044342 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:38:02.044342 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:38:02.044342 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:38:02.044342 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application with Lock( Jul 28 08:38:02.044342 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:38:02.044342 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:38:02.044342 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:38:02.044342 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:38:02.044342 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:38:02.044342 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:38:02.044342 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:38:02.044342 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:38:02.045469 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 08:38:02.045469 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 08:38:02.045469 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 08:38:02.045469 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application Jul 28 08:38:02.045469 dv-cinder-851351-1-smb devstack@keystone.service[282899]: [pid: 282899|app: 0|req: 540/1082] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 08:38:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 08:38:02.050784 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651e9542-5b34-4577-a3a8-386ef847d32f None admin] Authenticating user token {{(pid=282899) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:38:02.124175 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88bbabfc-390d-4dcf-870e-e0d875d72345 None admin] Validating token access rules against request {{(pid=282898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:38:02.161681 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651e9542-5b34-4577-a3a8-386ef847d32f None admin] Validating token access rules against request {{(pid=282899) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:38:02.165100 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d5bc5c-27e7-4189-b4c2-acf47aba8cb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:38:02.165724 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d5bc5c-27e7-4189-b4c2-acf47aba8cb2 None admin] REQUEST_METHOD: `GET` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:38:02.166079 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d5bc5c-27e7-4189-b4c2-acf47aba8cb2 None admin] SCRIPT_NAME: `/identity` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:38:02.166563 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d5bc5c-27e7-4189-b4c2-acf47aba8cb2 None admin] PATH_INFO: `/v3/users/nova` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:38:02.175544 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15d5bc5c-27e7-4189-b4c2-acf47aba8cb2 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:38:02.177039 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15d5bc5c-27e7-4189-b4c2-acf47aba8cb2 None admin] RBAC: Authorization granted {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:38:02.189783 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application [None req-15d5bc5c-27e7-4189-b4c2-acf47aba8cb2 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 28 08:38:02.189783 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:38:02.189783 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:38:02.189783 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:38:02.189783 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:38:02.189783 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:38:02.189783 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:38:02.189783 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:38:02.189783 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:38:02.189783 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:38:02.189783 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:38:02.189783 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:38:02.189783 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 28 08:38:02.189783 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 28 08:38:02.189783 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 28 08:38:02.189783 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 28 08:38:02.191093 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:38:02.191093 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:38:02.191093 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 28 08:38:02.191093 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 08:38:02.191093 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 28 08:38:02.191093 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 08:38:02.191093 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:38:02.191093 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:38:02.191093 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:38:02.191093 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:38:02.191093 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:38:02.191093 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application with Lock( Jul 28 08:38:02.191093 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:38:02.191093 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:38:02.191093 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:38:02.191093 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:38:02.191093 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:38:02.191093 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:38:02.192221 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:38:02.192221 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:38:02.192221 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 28 08:38:02.192221 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 28 08:38:02.192221 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 28 08:38:02.192221 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 28 08:38:02.192221 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 28 08:38:02.192221 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 28 08:38:02.192221 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 28 08:38:02.192221 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application Jul 28 08:38:02.192221 dv-cinder-851351-1-smb devstack@keystone.service[282898]: [pid: 282898|app: 0|req: 543/1083] 10.222.0.42 () {56 vars in 1093 bytes} [Thu Jul 28 08:38:02 2022] GET /identity/v3/users/nova => generated 82 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 08:38:02.196824 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d5bc5c-27e7-4189-b4c2-acf47aba8cb2 None admin] Authenticating user token {{(pid=282898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:38:02.204583 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9edf330-3c98-4b8a-8d33-9d8aa0b7df20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282899) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:38:02.205311 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9edf330-3c98-4b8a-8d33-9d8aa0b7df20 None admin] REQUEST_METHOD: `GET` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:38:02.205594 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9edf330-3c98-4b8a-8d33-9d8aa0b7df20 None admin] SCRIPT_NAME: `/identity` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:38:02.205872 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9edf330-3c98-4b8a-8d33-9d8aa0b7df20 None admin] PATH_INFO: `/v3/domains` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:38:02.206592 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9edf330-3c98-4b8a-8d33-9d8aa0b7df20 None admin] RBAC: Adding query filter params (name=Default) {{(pid=282899) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:38:02.206898 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9edf330-3c98-4b8a-8d33-9d8aa0b7df20 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:38:02.208297 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9edf330-3c98-4b8a-8d33-9d8aa0b7df20 None admin] RBAC: Authorization granted {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:38:02.208984 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG dbcounter [-] [282898] Writing DB stats keystone:SELECT=100 {{(pid=282898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:38:02.221096 dv-cinder-851351-1-smb devstack@keystone.service[282899]: [pid: 282899|app: 0|req: 541/1084] 10.222.0.42 () {56 vars in 1109 bytes} [Thu Jul 28 08:38:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 08:38:02.222403 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c1e845-2351-48b2-8d3b-5708f606fcad None None] REQUEST_METHOD: `GET` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:38:02.222689 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c1e845-2351-48b2-8d3b-5708f606fcad None None] SCRIPT_NAME: `/identity` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:38:02.222965 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c1e845-2351-48b2-8d3b-5708f606fcad None None] PATH_INFO: `/` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:38:02.224238 dv-cinder-851351-1-smb devstack@keystone.service[282899]: [pid: 282899|app: 0|req: 542/1085] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 08:38:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 08:38:02.239262 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2302ae3-2e39-4a09-9759-ddaa9ae3da00 None None] REQUEST_METHOD: `POST` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:38:02.239651 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2302ae3-2e39-4a09-9759-ddaa9ae3da00 None None] SCRIPT_NAME: `/identity` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:38:02.239925 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2302ae3-2e39-4a09-9759-ddaa9ae3da00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:38:02.259905 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.auth.core [None req-c2302ae3-2e39-4a09-9759-ddaa9ae3da00 None None] MFA Rules not processed for user `2be990a66857410a87ffa7609aec4f7b`. Rule list: `[]` (Enabled: `True`). {{(pid=282899) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 08:38:02.261191 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.fernet_utils [None req-c2302ae3-2e39-4a09-9759-ddaa9ae3da00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=282899) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:38:02.308736 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG dbcounter [-] [282899] Writing DB stats keystone:SELECT=100 {{(pid=282899) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:38:02.318107 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d5bc5c-27e7-4189-b4c2-acf47aba8cb2 None admin] Validating token access rules against request {{(pid=282898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:38:02.338734 dv-cinder-851351-1-smb devstack@keystone.service[282899]: [pid: 282899|app: 0|req: 543/1086] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 08:38:02 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 28 08:38:02.360730 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a371cd-39fb-467f-8605-069f37f18947 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:38:02.361384 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a371cd-39fb-467f-8605-069f37f18947 None admin] REQUEST_METHOD: `GET` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:38:02.361639 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2302ae3-2e39-4a09-9759-ddaa9ae3da00 None None] Authenticating user token {{(pid=282899) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:38:02.361798 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a371cd-39fb-467f-8605-069f37f18947 None admin] SCRIPT_NAME: `/identity` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:38:02.361985 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a371cd-39fb-467f-8605-069f37f18947 None admin] PATH_INFO: `/v3/users` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:38:02.362964 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a371cd-39fb-467f-8605-069f37f18947 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=282898) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:38:02.363278 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a371cd-39fb-467f-8605-069f37f18947 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:38:02.364818 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a371cd-39fb-467f-8605-069f37f18947 None admin] RBAC: Authorization granted {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:38:02.393778 dv-cinder-851351-1-smb devstack@keystone.service[282898]: [pid: 282898|app: 0|req: 544/1087] 10.222.0.42 () {56 vars in 1133 bytes} [Thu Jul 28 08:38:02 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 08:38:02.395053 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a371cd-39fb-467f-8605-069f37f18947 None admin] Authenticating user token {{(pid=282898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:38:02.478607 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG dbcounter [-] [282898] Writing DB stats keystone:SELECT=100 {{(pid=282898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:38:02.501671 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2302ae3-2e39-4a09-9759-ddaa9ae3da00 None None] Validating token access rules against request {{(pid=282899) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:38:02.519818 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a371cd-39fb-467f-8605-069f37f18947 None admin] Validating token access rules against request {{(pid=282898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:38:02.544239 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73865455-fd81-481d-890c-fb102c67d993 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282899) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:38:02.544941 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73865455-fd81-481d-890c-fb102c67d993 None admin] REQUEST_METHOD: `GET` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:38:02.545224 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73865455-fd81-481d-890c-fb102c67d993 None admin] SCRIPT_NAME: `/identity` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:38:02.545499 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73865455-fd81-481d-890c-fb102c67d993 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:38:02.556063 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73865455-fd81-481d-890c-fb102c67d993 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 08:38:02.557154 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0cb9af2-3dec-4b96-bd34-c337387df5fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:38:02.557786 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0cb9af2-3dec-4b96-bd34-c337387df5fb None admin] REQUEST_METHOD: `GET` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:38:02.558068 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0cb9af2-3dec-4b96-bd34-c337387df5fb None admin] SCRIPT_NAME: `/identity` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:38:02.558341 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0cb9af2-3dec-4b96-bd34-c337387df5fb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:38:02.560975 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application [None req-73865455-fd81-481d-890c-fb102c67d993 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 08:38:02.560975 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:38:02.560975 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:38:02.560975 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:38:02.560975 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:38:02.560975 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:38:02.560975 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:38:02.560975 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:38:02.560975 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:38:02.560975 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:38:02.560975 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:38:02.560975 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:38:02.560975 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 08:38:02.560975 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 08:38:02.560975 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 08:38:02.560975 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 08:38:02.562274 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 08:38:02.562274 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 08:38:02.562274 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 08:38:02.562274 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 08:38:02.562274 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:38:02.562274 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:38:02.562274 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:38:02.562274 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:38:02.562274 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:38:02.562274 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:38:02.562274 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:38:02.562274 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application with Lock( Jul 28 08:38:02.562274 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:38:02.562274 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:38:02.562274 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:38:02.562274 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:38:02.563297 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:38:02.563297 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:38:02.563297 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:38:02.563297 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:38:02.563297 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 08:38:02.563297 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 08:38:02.563297 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 08:38:02.563297 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 08:38:02.563297 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 08:38:02.563297 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 08:38:02.563297 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 08:38:02.563297 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application Jul 28 08:38:02.567742 dv-cinder-851351-1-smb devstack@keystone.service[282899]: [pid: 282899|app: 0|req: 544/1088] 10.222.0.42 () {56 vars in 1096 bytes} [Thu Jul 28 08:38:02 2022] GET /identity/v3/roles/admin => generated 83 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 08:38:02.568459 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73865455-fd81-481d-890c-fb102c67d993 None admin] Authenticating user token {{(pid=282899) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:38:02.605248 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG dbcounter [-] [282899] Writing DB stats keystone:SELECT=100 {{(pid=282899) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:38:02.633896 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0cb9af2-3dec-4b96-bd34-c337387df5fb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:38:02.635397 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0cb9af2-3dec-4b96-bd34-c337387df5fb None admin] RBAC: Authorization granted {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:38:02.679019 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73865455-fd81-481d-890c-fb102c67d993 None admin] Validating token access rules against request {{(pid=282899) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:38:02.709337 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG dbcounter [-] [282898] Writing DB stats keystone:SELECT=100 {{(pid=282898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:38:02.717545 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-777a627c-62f8-456d-84cb-cc9a45fed3c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282899) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:38:02.718212 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777a627c-62f8-456d-84cb-cc9a45fed3c9 None admin] REQUEST_METHOD: `GET` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:38:02.718507 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777a627c-62f8-456d-84cb-cc9a45fed3c9 None admin] SCRIPT_NAME: `/identity` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:38:02.718793 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777a627c-62f8-456d-84cb-cc9a45fed3c9 None admin] PATH_INFO: `/v3/roles` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:38:02.719536 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-777a627c-62f8-456d-84cb-cc9a45fed3c9 None admin] RBAC: Adding query filter params (name=admin) {{(pid=282899) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:38:02.719851 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-777a627c-62f8-456d-84cb-cc9a45fed3c9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:38:02.721398 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-777a627c-62f8-456d-84cb-cc9a45fed3c9 None admin] RBAC: Authorization granted {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:38:02.730597 dv-cinder-851351-1-smb devstack@keystone.service[282899]: [pid: 282899|app: 0|req: 545/1089] 10.222.0.42 () {56 vars in 1099 bytes} [Thu Jul 28 08:38:02 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 08:38:02.736552 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-777a627c-62f8-456d-84cb-cc9a45fed3c9 None admin] Authenticating user token {{(pid=282899) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:38:02.753306 dv-cinder-851351-1-smb devstack@keystone.service[282898]: [pid: 282898|app: 0|req: 545/1090] 10.222.0.42 () {58 vars in 1282 bytes} [Thu Jul 28 08:38:02 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 354 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jul 28 08:38:02.754577 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0cb9af2-3dec-4b96-bd34-c337387df5fb None admin] Authenticating user token {{(pid=282898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:38:02.836993 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG dbcounter [-] [282899] Writing DB stats keystone:SELECT=100 {{(pid=282899) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:38:02.843667 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-777a627c-62f8-456d-84cb-cc9a45fed3c9 None admin] Validating token access rules against request {{(pid=282899) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:38:02.856855 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0cb9af2-3dec-4b96-bd34-c337387df5fb None admin] Validating token access rules against request {{(pid=282898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:38:02.877858 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c9dfef-91a3-4765-961d-862af2514071 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282899) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:38:02.878524 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c9dfef-91a3-4765-961d-862af2514071 None admin] REQUEST_METHOD: `GET` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:38:02.878806 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c9dfef-91a3-4765-961d-862af2514071 None admin] SCRIPT_NAME: `/identity` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:38:02.879083 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c9dfef-91a3-4765-961d-862af2514071 None admin] PATH_INFO: `/v3/users/8d7022dc9553422f95d85348b17ab680` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:38:02.880284 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c9dfef-91a3-4765-961d-862af2514071 None admin] RBAC: Authorizing `identity:get_user(user_id=8d7022dc9553422f95d85348b17ab680)` {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:38:02.881771 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c9dfef-91a3-4765-961d-862af2514071 None admin] RBAC: Authorization granted {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:38:02.883428 dv-cinder-851351-1-smb devstack@keystone.service[282899]: [pid: 282899|app: 0|req: 546/1091] 10.222.0.42 () {56 vars in 1177 bytes} [Thu Jul 28 08:38:02 2022] GET /identity/v3/users/8d7022dc9553422f95d85348b17ab680 => generated 285 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:38:02.889347 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c9dfef-91a3-4765-961d-862af2514071 None admin] Authenticating user token {{(pid=282899) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:38:02.891685 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cdef268-1acb-48f3-827c-7cbddff5baeb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:38:02.892431 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cdef268-1acb-48f3-827c-7cbddff5baeb None admin] REQUEST_METHOD: `GET` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:38:02.892780 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cdef268-1acb-48f3-827c-7cbddff5baeb None admin] SCRIPT_NAME: `/identity` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:38:02.893057 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cdef268-1acb-48f3-827c-7cbddff5baeb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:38:02.904554 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cdef268-1acb-48f3-827c-7cbddff5baeb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:38:02.906052 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cdef268-1acb-48f3-827c-7cbddff5baeb None admin] RBAC: Authorization granted {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:38:02.921597 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application [None req-8cdef268-1acb-48f3-827c-7cbddff5baeb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 08:38:02.921597 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:38:02.921597 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:38:02.921597 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:38:02.921597 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:38:02.921597 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:38:02.921597 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:38:02.921597 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:38:02.921597 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:38:02.921597 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:38:02.921597 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:38:02.921597 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:38:02.921597 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 08:38:02.921597 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 08:38:02.921597 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 08:38:02.922717 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 08:38:02.922717 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:38:02.922717 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:38:02.922717 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:38:02.922717 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:38:02.922717 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:38:02.922717 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:38:02.922717 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:38:02.922717 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application with Lock( Jul 28 08:38:02.922717 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:38:02.922717 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:38:02.922717 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:38:02.922717 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:38:02.922717 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:38:02.922717 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:38:02.922717 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:38:02.922717 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:38:02.924623 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 08:38:02.924623 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 08:38:02.924623 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 08:38:02.924623 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application Jul 28 08:38:02.924623 dv-cinder-851351-1-smb devstack@keystone.service[282898]: [pid: 282898|app: 0|req: 546/1092] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 08:38:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:38:02.928741 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cdef268-1acb-48f3-827c-7cbddff5baeb None admin] Authenticating user token {{(pid=282898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:38:02.948034 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG dbcounter [-] [282898] Writing DB stats keystone:SELECT=100 {{(pid=282898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:38:02.999184 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c9dfef-91a3-4765-961d-862af2514071 None admin] Validating token access rules against request {{(pid=282899) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:38:03.033140 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cdef268-1acb-48f3-827c-7cbddff5baeb None admin] Validating token access rules against request {{(pid=282898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:38:03.033818 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aafc75b0-0055-46b2-bdf4-2c32f632a2a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282899) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:38:03.034505 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aafc75b0-0055-46b2-bdf4-2c32f632a2a1 None admin] REQUEST_METHOD: `GET` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:38:03.034795 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aafc75b0-0055-46b2-bdf4-2c32f632a2a1 None admin] SCRIPT_NAME: `/identity` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:38:03.035070 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aafc75b0-0055-46b2-bdf4-2c32f632a2a1 None admin] PATH_INFO: `/v3/projects/6116135c46aa445298ea96f8874b0611` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:38:03.036272 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aafc75b0-0055-46b2-bdf4-2c32f632a2a1 None admin] RBAC: Authorizing `identity:get_project(project_id=6116135c46aa445298ea96f8874b0611)` {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:38:03.037782 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aafc75b0-0055-46b2-bdf4-2c32f632a2a1 None admin] RBAC: Authorization granted {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:38:03.039472 dv-cinder-851351-1-smb devstack@keystone.service[282899]: [pid: 282899|app: 0|req: 547/1093] 10.222.0.42 () {56 vars in 1186 bytes} [Thu Jul 28 08:38:02 2022] GET /identity/v3/projects/6116135c46aa445298ea96f8874b0611 => generated 311 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 08:38:03.045713 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aafc75b0-0055-46b2-bdf4-2c32f632a2a1 None admin] Authenticating user token {{(pid=282899) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:38:03.069109 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7fd568-c11a-41fe-b20f-d8c37c08a119 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:38:03.069739 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7fd568-c11a-41fe-b20f-d8c37c08a119 None admin] REQUEST_METHOD: `GET` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:38:03.070018 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7fd568-c11a-41fe-b20f-d8c37c08a119 None admin] SCRIPT_NAME: `/identity` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:38:03.070289 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7fd568-c11a-41fe-b20f-d8c37c08a119 None admin] PATH_INFO: `/v3/domains` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:38:03.070987 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d7fd568-c11a-41fe-b20f-d8c37c08a119 None admin] RBAC: Adding query filter params (name=Default) {{(pid=282898) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:38:03.071291 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d7fd568-c11a-41fe-b20f-d8c37c08a119 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:38:03.072687 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d7fd568-c11a-41fe-b20f-d8c37c08a119 None admin] RBAC: Authorization granted {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:38:03.077403 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG dbcounter [-] [282899] Writing DB stats keystone:SELECT=100 {{(pid=282899) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:38:03.086297 dv-cinder-851351-1-smb devstack@keystone.service[282898]: [pid: 282898|app: 0|req: 547/1094] 10.222.0.42 () {56 vars in 1109 bytes} [Thu Jul 28 08:38:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 08:38:03.092005 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7fd568-c11a-41fe-b20f-d8c37c08a119 None admin] Authenticating user token {{(pid=282898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:38:03.148772 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aafc75b0-0055-46b2-bdf4-2c32f632a2a1 None admin] Validating token access rules against request {{(pid=282899) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:38:03.169641 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG dbcounter [-] [282898] Writing DB stats keystone:SELECT=100 {{(pid=282898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:38:03.184128 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e1fbe0-a2bb-4cb7-9f40-30cb43e01adc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282899) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:38:03.184835 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e1fbe0-a2bb-4cb7-9f40-30cb43e01adc None admin] REQUEST_METHOD: `PUT` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:38:03.185124 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e1fbe0-a2bb-4cb7-9f40-30cb43e01adc None admin] SCRIPT_NAME: `/identity` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:38:03.185409 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e1fbe0-a2bb-4cb7-9f40-30cb43e01adc None admin] PATH_INFO: `/v3/projects/6116135c46aa445298ea96f8874b0611/users/8d7022dc9553422f95d85348b17ab680/roles/a0e2a00bf94d40f38629d6b5293e3aee` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:38:03.187520 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e1fbe0-a2bb-4cb7-9f40-30cb43e01adc None admin] RBAC: Authorizing `identity:create_grant(project_id=6116135c46aa445298ea96f8874b0611, user_id=8d7022dc9553422f95d85348b17ab680, role_id=a0e2a00bf94d40f38629d6b5293e3aee)` {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:38:03.189071 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e1fbe0-a2bb-4cb7-9f40-30cb43e01adc None admin] RBAC: Authorization granted {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:38:03.193435 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7fd568-c11a-41fe-b20f-d8c37c08a119 None admin] Validating token access rules against request {{(pid=282898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:38:03.204451 dv-cinder-851351-1-smb devstack@keystone.service[282899]: [pid: 282899|app: 0|req: 548/1095] 10.222.0.42 () {58 vars in 1439 bytes} [Thu Jul 28 08:38:03 2022] PUT /identity/v3/projects/6116135c46aa445298ea96f8874b0611/users/8d7022dc9553422f95d85348b17ab680/roles/a0e2a00bf94d40f38629d6b5293e3aee => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 28 08:38:03.232028 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-191e8253-376e-4818-955a-eb96d23e4ead None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:38:03.232752 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191e8253-376e-4818-955a-eb96d23e4ead None admin] REQUEST_METHOD: `GET` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:38:03.233041 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191e8253-376e-4818-955a-eb96d23e4ead None admin] SCRIPT_NAME: `/identity` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:38:03.233324 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191e8253-376e-4818-955a-eb96d23e4ead None admin] PATH_INFO: `/v3/projects/service` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:38:03.241486 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-191e8253-376e-4818-955a-eb96d23e4ead None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:38:03.242988 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-191e8253-376e-4818-955a-eb96d23e4ead None admin] RBAC: Authorization granted {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:38:03.255914 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application [None req-191e8253-376e-4818-955a-eb96d23e4ead None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 08:38:03.255914 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:38:03.255914 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:38:03.255914 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:38:03.255914 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:38:03.255914 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:38:03.255914 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:38:03.255914 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:38:03.255914 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:38:03.255914 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:38:03.255914 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:38:03.255914 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:38:03.255914 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 28 08:38:03.255914 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 28 08:38:03.255914 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 28 08:38:03.257210 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 28 08:38:03.257210 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:38:03.257210 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:38:03.257210 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:38:03.257210 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:38:03.257210 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:38:03.257210 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:38:03.257210 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:38:03.257210 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application with Lock( Jul 28 08:38:03.257210 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:38:03.257210 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:38:03.257210 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:38:03.257210 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:38:03.257210 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:38:03.257210 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:38:03.257210 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:38:03.257210 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:38:03.258308 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 28 08:38:03.258308 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 28 08:38:03.258308 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 28 08:38:03.258308 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 28 08:38:03.258308 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 28 08:38:03.258308 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 28 08:38:03.258308 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 08:38:03.258308 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application Jul 28 08:38:03.258308 dv-cinder-851351-1-smb devstack@keystone.service[282898]: [pid: 282898|app: 0|req: 548/1096] 10.222.0.42 () {56 vars in 1111 bytes} [Thu Jul 28 08:38:03 2022] GET /identity/v3/projects/service => generated 88 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 08:38:03.263446 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e1fbe0-a2bb-4cb7-9f40-30cb43e01adc None admin] Authenticating user token {{(pid=282899) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:38:03.364402 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG dbcounter [-] [282899] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=282899) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:38:03.376238 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e1fbe0-a2bb-4cb7-9f40-30cb43e01adc None admin] Validating token access rules against request {{(pid=282899) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:38:03.410552 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b409fe5-ff51-4ef3-b369-70ab2f7a6b7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282899) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:38:03.411202 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b409fe5-ff51-4ef3-b369-70ab2f7a6b7e None admin] REQUEST_METHOD: `GET` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:38:03.411490 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b409fe5-ff51-4ef3-b369-70ab2f7a6b7e None admin] SCRIPT_NAME: `/identity` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:38:03.411766 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b409fe5-ff51-4ef3-b369-70ab2f7a6b7e None admin] PATH_INFO: `/v3/projects` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:38:03.412546 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b409fe5-ff51-4ef3-b369-70ab2f7a6b7e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=282899) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:38:03.412890 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b409fe5-ff51-4ef3-b369-70ab2f7a6b7e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:38:03.414363 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b409fe5-ff51-4ef3-b369-70ab2f7a6b7e None admin] RBAC: Authorization granted {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:38:03.427802 dv-cinder-851351-1-smb devstack@keystone.service[282899]: [pid: 282899|app: 0|req: 549/1097] 10.222.0.42 () {56 vars in 1148 bytes} [Thu Jul 28 08:38:03 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:38:03.434371 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-191e8253-376e-4818-955a-eb96d23e4ead None admin] Authenticating user token {{(pid=282898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:38:03.541444 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-191e8253-376e-4818-955a-eb96d23e4ead None admin] Validating token access rules against request {{(pid=282898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:38:03.583097 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f8db8d-7700-4ea1-bd35-4b526c7f60ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:38:03.583756 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f8db8d-7700-4ea1-bd35-4b526c7f60ba None admin] REQUEST_METHOD: `GET` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:38:03.584041 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f8db8d-7700-4ea1-bd35-4b526c7f60ba None admin] SCRIPT_NAME: `/identity` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:38:03.584321 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f8db8d-7700-4ea1-bd35-4b526c7f60ba None admin] PATH_INFO: `/v3/role_assignments` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:38:03.585176 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9f8db8d-7700-4ea1-bd35-4b526c7f60ba None admin] RBAC: Adding query filter params (role.id=f33deecb73a247c0b6c50fe050d1ef3a, scope.project.id=5cde68cbfb9042dc9f36af3aacea2473, user.id=5e192fe026ef4f109b9a1099815c5926) {{(pid=282898) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:38:03.585495 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9f8db8d-7700-4ea1-bd35-4b526c7f60ba None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:38:03.586973 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9f8db8d-7700-4ea1-bd35-4b526c7f60ba None admin] RBAC: Authorization granted {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:38:03.594983 dv-cinder-851351-1-smb devstack@keystone.service[282898]: [pid: 282898|app: 0|req: 549/1098] 10.222.0.42 () {56 vars in 1374 bytes} [Thu Jul 28 08:38:03 2022] GET /identity/v3/role_assignments?user.id=5e192fe026ef4f109b9a1099815c5926&scope.project.id=5cde68cbfb9042dc9f36af3aacea2473&role.id=f33deecb73a247c0b6c50fe050d1ef3a => generated 608 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:38:05.186082 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9d3fe7-dd0b-4a7a-a600-03a6a7da46b0 None None] REQUEST_METHOD: `GET` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:38:05.186737 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9d3fe7-dd0b-4a7a-a600-03a6a7da46b0 None None] SCRIPT_NAME: `/identity` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:38:05.186737 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9d3fe7-dd0b-4a7a-a600-03a6a7da46b0 None None] PATH_INFO: `/` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:38:05.188020 dv-cinder-851351-1-smb devstack@keystone.service[282899]: [pid: 282899|app: 0|req: 550/1099] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 08:38:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 08:38:05.193346 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03994244-ce30-402d-9523-8e439b37c14b None None] REQUEST_METHOD: `POST` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:38:05.193813 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03994244-ce30-402d-9523-8e439b37c14b None None] SCRIPT_NAME: `/identity` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:38:05.193925 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03994244-ce30-402d-9523-8e439b37c14b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:38:05.201477 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG dbcounter [-] [282898] Writing DB stats keystone:SELECT=100 {{(pid=282898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:38:05.215377 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.auth.core [None req-03994244-ce30-402d-9523-8e439b37c14b None None] MFA Rules not processed for user `2be990a66857410a87ffa7609aec4f7b`. Rule list: `[]` (Enabled: `True`). {{(pid=282898) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 08:38:05.216596 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.fernet_utils [None req-03994244-ce30-402d-9523-8e439b37c14b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=282898) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:38:05.286793 dv-cinder-851351-1-smb devstack@keystone.service[282898]: [pid: 282898|app: 0|req: 550/1100] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 08:38:05 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 08:38:05.310030 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9d3fe7-dd0b-4a7a-a600-03a6a7da46b0 None None] Authenticating user token {{(pid=282899) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:38:05.418593 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9d3fe7-dd0b-4a7a-a600-03a6a7da46b0 None None] Validating token access rules against request {{(pid=282899) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:38:05.455215 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-013fb0b0-9348-47c3-bfd7-bad593500372 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282899) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:38:05.455790 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013fb0b0-9348-47c3-bfd7-bad593500372 None admin] REQUEST_METHOD: `GET` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:38:05.456081 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013fb0b0-9348-47c3-bfd7-bad593500372 None admin] SCRIPT_NAME: `/identity` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:38:05.456358 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013fb0b0-9348-47c3-bfd7-bad593500372 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:38:05.467051 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-013fb0b0-9348-47c3-bfd7-bad593500372 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 08:38:05.472112 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application [None req-013fb0b0-9348-47c3-bfd7-bad593500372 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 08:38:05.472112 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:38:05.472112 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:38:05.472112 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:38:05.472112 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:38:05.472112 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:38:05.472112 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:38:05.472112 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:38:05.472112 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:38:05.472112 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:38:05.472112 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:38:05.472112 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:38:05.472112 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 08:38:05.472112 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 08:38:05.472112 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 08:38:05.472112 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 08:38:05.473533 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 08:38:05.473533 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 08:38:05.473533 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 08:38:05.473533 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 08:38:05.473533 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:38:05.473533 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:38:05.473533 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:38:05.473533 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:38:05.473533 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:38:05.473533 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:38:05.473533 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:38:05.473533 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application with Lock( Jul 28 08:38:05.473533 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:38:05.473533 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:38:05.473533 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:38:05.473533 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:38:05.474914 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:38:05.474914 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:38:05.474914 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:38:05.474914 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:38:05.474914 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 08:38:05.474914 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 08:38:05.474914 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 08:38:05.474914 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 08:38:05.474914 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 08:38:05.474914 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 08:38:05.474914 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 08:38:05.474914 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application Jul 28 08:38:05.474914 dv-cinder-851351-1-smb devstack@keystone.service[282899]: [pid: 282899|app: 0|req: 551/1101] 10.222.0.42 () {56 vars in 1096 bytes} [Thu Jul 28 08:38:05 2022] GET /identity/v3/roles/admin => generated 83 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:38:05.479707 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03994244-ce30-402d-9523-8e439b37c14b None None] Authenticating user token {{(pid=282898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:38:05.582139 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03994244-ce30-402d-9523-8e439b37c14b None None] Validating token access rules against request {{(pid=282898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:38:05.613353 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG dbcounter [-] [282898] Writing DB stats keystone:SELECT=100 {{(pid=282898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:38:05.619492 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7032465e-416e-4279-ac9d-af03860f7b51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:38:05.620120 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7032465e-416e-4279-ac9d-af03860f7b51 None admin] REQUEST_METHOD: `GET` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:38:05.620397 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7032465e-416e-4279-ac9d-af03860f7b51 None admin] SCRIPT_NAME: `/identity` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:38:05.620654 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7032465e-416e-4279-ac9d-af03860f7b51 None admin] PATH_INFO: `/v3/roles` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:38:05.621411 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7032465e-416e-4279-ac9d-af03860f7b51 None admin] RBAC: Adding query filter params (name=admin) {{(pid=282898) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:38:05.621716 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7032465e-416e-4279-ac9d-af03860f7b51 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:38:05.623119 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7032465e-416e-4279-ac9d-af03860f7b51 None admin] RBAC: Authorization granted {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:38:05.632603 dv-cinder-851351-1-smb devstack@keystone.service[282898]: [pid: 282898|app: 0|req: 551/1102] 10.222.0.42 () {56 vars in 1099 bytes} [Thu Jul 28 08:38:05 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:38:05.638936 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-013fb0b0-9348-47c3-bfd7-bad593500372 None admin] Authenticating user token {{(pid=282899) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:38:05.656751 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG dbcounter [-] [282899] Writing DB stats keystone:SELECT=100 {{(pid=282899) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:38:05.765815 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-013fb0b0-9348-47c3-bfd7-bad593500372 None admin] Validating token access rules against request {{(pid=282899) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:38:05.803630 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2295dfa5-f23b-4ed6-95cd-eee7d909fb26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282899) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:38:05.804295 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2295dfa5-f23b-4ed6-95cd-eee7d909fb26 None admin] REQUEST_METHOD: `GET` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:38:05.804581 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2295dfa5-f23b-4ed6-95cd-eee7d909fb26 None admin] SCRIPT_NAME: `/identity` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:38:05.804920 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2295dfa5-f23b-4ed6-95cd-eee7d909fb26 None admin] PATH_INFO: `/v3/users/8d7022dc9553422f95d85348b17ab680` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:38:05.806228 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2295dfa5-f23b-4ed6-95cd-eee7d909fb26 None admin] RBAC: Authorizing `identity:get_user(user_id=8d7022dc9553422f95d85348b17ab680)` {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:38:05.807747 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2295dfa5-f23b-4ed6-95cd-eee7d909fb26 None admin] RBAC: Authorization granted {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:38:05.809448 dv-cinder-851351-1-smb devstack@keystone.service[282899]: [pid: 282899|app: 0|req: 552/1103] 10.222.0.42 () {56 vars in 1177 bytes} [Thu Jul 28 08:38:05 2022] GET /identity/v3/users/8d7022dc9553422f95d85348b17ab680 => generated 285 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:38:05.815871 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7032465e-416e-4279-ac9d-af03860f7b51 None admin] Authenticating user token {{(pid=282898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:38:05.922677 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7032465e-416e-4279-ac9d-af03860f7b51 None admin] Validating token access rules against request {{(pid=282898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:38:05.960119 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ba7c4f-0409-4eba-a0b5-54734f385dd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:38:05.960787 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ba7c4f-0409-4eba-a0b5-54734f385dd8 None admin] REQUEST_METHOD: `GET` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:38:05.961066 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ba7c4f-0409-4eba-a0b5-54734f385dd8 None admin] SCRIPT_NAME: `/identity` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:38:05.961349 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ba7c4f-0409-4eba-a0b5-54734f385dd8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:38:06.028570 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG dbcounter [-] [282898] Writing DB stats keystone:SELECT=100 {{(pid=282898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:38:06.036896 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18ba7c4f-0409-4eba-a0b5-54734f385dd8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:38:06.038377 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18ba7c4f-0409-4eba-a0b5-54734f385dd8 None admin] RBAC: Authorization granted {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:38:06.143379 dv-cinder-851351-1-smb devstack@keystone.service[282898]: [pid: 282898|app: 0|req: 552/1104] 10.222.0.42 () {58 vars in 1282 bytes} [Thu Jul 28 08:38:05 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 28 08:38:06.151000 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2295dfa5-f23b-4ed6-95cd-eee7d909fb26 None admin] Authenticating user token {{(pid=282899) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:38:06.246255 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG dbcounter [-] [282899] Writing DB stats keystone:SELECT=100 {{(pid=282899) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:38:06.266894 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2295dfa5-f23b-4ed6-95cd-eee7d909fb26 None admin] Validating token access rules against request {{(pid=282899) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:38:06.303581 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26aa888-b3ed-4bf7-8d66-566783fc7da9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282899) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:38:06.304191 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26aa888-b3ed-4bf7-8d66-566783fc7da9 None admin] REQUEST_METHOD: `GET` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:38:06.304541 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26aa888-b3ed-4bf7-8d66-566783fc7da9 None admin] SCRIPT_NAME: `/identity` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:38:06.304884 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26aa888-b3ed-4bf7-8d66-566783fc7da9 None admin] PATH_INFO: `/v3/projects/6116135c46aa445298ea96f8874b0611` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:38:06.306465 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f26aa888-b3ed-4bf7-8d66-566783fc7da9 None admin] RBAC: Authorizing `identity:get_project(project_id=6116135c46aa445298ea96f8874b0611)` {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:38:06.308020 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f26aa888-b3ed-4bf7-8d66-566783fc7da9 None admin] RBAC: Authorization granted {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:38:06.309919 dv-cinder-851351-1-smb devstack@keystone.service[282899]: [pid: 282899|app: 0|req: 553/1105] 10.222.0.42 () {56 vars in 1186 bytes} [Thu Jul 28 08:38:06 2022] GET /identity/v3/projects/6116135c46aa445298ea96f8874b0611 => generated 311 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:38:06.318060 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ba7c4f-0409-4eba-a0b5-54734f385dd8 None admin] Authenticating user token {{(pid=282898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:38:06.419631 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG dbcounter [-] [282898] Writing DB stats keystone:SELECT=100 {{(pid=282898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:38:06.426993 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ba7c4f-0409-4eba-a0b5-54734f385dd8 None admin] Validating token access rules against request {{(pid=282898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:38:06.462832 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e645dd-2e3a-49f8-8ea2-af7a9eb6d6c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:38:06.463466 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e645dd-2e3a-49f8-8ea2-af7a9eb6d6c6 None admin] REQUEST_METHOD: `GET` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:38:06.463744 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e645dd-2e3a-49f8-8ea2-af7a9eb6d6c6 None admin] SCRIPT_NAME: `/identity` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:38:06.464030 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e645dd-2e3a-49f8-8ea2-af7a9eb6d6c6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:38:06.464843 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e645dd-2e3a-49f8-8ea2-af7a9eb6d6c6 None admin] RBAC: Adding query filter params (role.id=a0e2a00bf94d40f38629d6b5293e3aee, scope.project.id=6116135c46aa445298ea96f8874b0611, user.id=8d7022dc9553422f95d85348b17ab680) {{(pid=282898) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:38:06.465218 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e645dd-2e3a-49f8-8ea2-af7a9eb6d6c6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:38:06.466643 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e645dd-2e3a-49f8-8ea2-af7a9eb6d6c6 None admin] RBAC: Authorization granted {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:38:06.473052 dv-cinder-851351-1-smb devstack@keystone.service[282898]: [pid: 282898|app: 0|req: 553/1106] 10.222.0.42 () {56 vars in 1374 bytes} [Thu Jul 28 08:38:06 2022] GET /identity/v3/role_assignments?user.id=8d7022dc9553422f95d85348b17ab680&scope.project.id=6116135c46aa445298ea96f8874b0611&role.id=a0e2a00bf94d40f38629d6b5293e3aee => generated 608 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:38:08.513677 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f807082-13c2-4245-8af1-f0223e3afe41 None None] REQUEST_METHOD: `GET` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:38:08.514298 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f807082-13c2-4245-8af1-f0223e3afe41 None None] SCRIPT_NAME: `/identity` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:38:08.514298 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f807082-13c2-4245-8af1-f0223e3afe41 None None] PATH_INFO: `/` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:38:08.515728 dv-cinder-851351-1-smb devstack@keystone.service[282899]: [pid: 282899|app: 0|req: 554/1107] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 08:38:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 08:38:08.521443 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd3ddd4-724b-4f20-b3bf-987ef43ee091 None None] REQUEST_METHOD: `POST` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:38:08.521923 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd3ddd4-724b-4f20-b3bf-987ef43ee091 None None] SCRIPT_NAME: `/identity` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:38:08.522032 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd3ddd4-724b-4f20-b3bf-987ef43ee091 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:38:08.541143 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.auth.core [None req-8cd3ddd4-724b-4f20-b3bf-987ef43ee091 None None] MFA Rules not processed for user `2be990a66857410a87ffa7609aec4f7b`. Rule list: `[]` (Enabled: `True`). {{(pid=282898) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 08:38:08.542360 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.fernet_utils [None req-8cd3ddd4-724b-4f20-b3bf-987ef43ee091 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=282898) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:38:08.613701 dv-cinder-851351-1-smb devstack@keystone.service[282898]: [pid: 282898|app: 0|req: 554/1108] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 08:38:08 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 08:38:08.638367 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f807082-13c2-4245-8af1-f0223e3afe41 None None] Authenticating user token {{(pid=282899) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:38:08.743558 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f807082-13c2-4245-8af1-f0223e3afe41 None None] Validating token access rules against request {{(pid=282899) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:38:08.779442 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb64879-e209-46d7-82c4-8ecf69b95a34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282899) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:38:08.780014 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb64879-e209-46d7-82c4-8ecf69b95a34 None admin] REQUEST_METHOD: `GET` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:38:08.780299 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb64879-e209-46d7-82c4-8ecf69b95a34 None admin] SCRIPT_NAME: `/identity` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:38:08.780579 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb64879-e209-46d7-82c4-8ecf69b95a34 None admin] PATH_INFO: `/v3/domains/default` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:38:08.781794 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eb64879-e209-46d7-82c4-8ecf69b95a34 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:38:08.783354 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eb64879-e209-46d7-82c4-8ecf69b95a34 None admin] RBAC: Authorization granted {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:38:08.785023 dv-cinder-851351-1-smb devstack@keystone.service[282899]: [pid: 282899|app: 0|req: 555/1109] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 08:38:08 2022] GET /identity/v3/domains/default => generated 199 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:38:08.791145 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd3ddd4-724b-4f20-b3bf-987ef43ee091 None None] Authenticating user token {{(pid=282898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:38:08.884476 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG dbcounter [-] [282898] Writing DB stats keystone:SELECT=100 {{(pid=282898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:38:08.897136 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd3ddd4-724b-4f20-b3bf-987ef43ee091 None None] Validating token access rules against request {{(pid=282898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:38:08.932976 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26229908-5306-4594-ab93-fdf4ba2bb513 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:38:08.933600 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26229908-5306-4594-ab93-fdf4ba2bb513 None admin] REQUEST_METHOD: `POST` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:38:08.933889 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26229908-5306-4594-ab93-fdf4ba2bb513 None admin] SCRIPT_NAME: `/identity` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:38:08.934157 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26229908-5306-4594-ab93-fdf4ba2bb513 None admin] PATH_INFO: `/v3/users` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:38:08.934857 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26229908-5306-4594-ab93-fdf4ba2bb513 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:38:08.936314 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26229908-5306-4594-ab93-fdf4ba2bb513 None admin] RBAC: Authorization granted {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:38:08.959288 dv-cinder-851351-1-smb devstack@keystone.service[282898]: [pid: 282898|app: 0|req: 555/1110] 10.222.0.42 () {60 vars in 1132 bytes} [Thu Jul 28 08:38:08 2022] POST /identity/v3/users => generated 286 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 08:38:10.994694 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578a5c4e-5160-4c36-b381-1c83adec2e83 None None] REQUEST_METHOD: `GET` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:38:10.995304 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578a5c4e-5160-4c36-b381-1c83adec2e83 None None] SCRIPT_NAME: `/identity` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:38:10.995304 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578a5c4e-5160-4c36-b381-1c83adec2e83 None None] PATH_INFO: `/` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:38:10.996639 dv-cinder-851351-1-smb devstack@keystone.service[282899]: [pid: 282899|app: 0|req: 556/1111] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 08:38:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 08:38:11.002285 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f7e511-5f96-444c-a390-e8c59654ba4e None None] REQUEST_METHOD: `POST` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:38:11.002737 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f7e511-5f96-444c-a390-e8c59654ba4e None None] SCRIPT_NAME: `/identity` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:38:11.002846 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f7e511-5f96-444c-a390-e8c59654ba4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:38:11.022468 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.auth.core [None req-28f7e511-5f96-444c-a390-e8c59654ba4e None None] MFA Rules not processed for user `2be990a66857410a87ffa7609aec4f7b`. Rule list: `[]` (Enabled: `True`). {{(pid=282898) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 08:38:11.023692 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.fernet_utils [None req-28f7e511-5f96-444c-a390-e8c59654ba4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=282898) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:38:11.096500 dv-cinder-851351-1-smb devstack@keystone.service[282898]: [pid: 282898|app: 0|req: 556/1112] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 08:38:11 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 08:38:11.119660 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578a5c4e-5160-4c36-b381-1c83adec2e83 None None] Authenticating user token {{(pid=282899) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:38:11.138842 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG dbcounter [-] [282899] Writing DB stats keystone:SELECT=100 {{(pid=282899) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:38:11.230049 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578a5c4e-5160-4c36-b381-1c83adec2e83 None None] Validating token access rules against request {{(pid=282899) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:38:11.266650 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dba1aea-1ef9-41c4-a07d-988ce05f8c6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282899) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:38:11.267310 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dba1aea-1ef9-41c4-a07d-988ce05f8c6c None admin] REQUEST_METHOD: `GET` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:38:11.267593 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dba1aea-1ef9-41c4-a07d-988ce05f8c6c None admin] SCRIPT_NAME: `/identity` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:38:11.267871 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dba1aea-1ef9-41c4-a07d-988ce05f8c6c None admin] PATH_INFO: `/v3/roles/d76677105be344cc83022cbde8a22d8d` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:38:11.269360 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dba1aea-1ef9-41c4-a07d-988ce05f8c6c None admin] RBAC: Authorizing `identity:get_role(role_id=d76677105be344cc83022cbde8a22d8d)` {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:38:11.270759 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dba1aea-1ef9-41c4-a07d-988ce05f8c6c None admin] RBAC: Authorization granted {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:38:11.272156 dv-cinder-851351-1-smb devstack@keystone.service[282899]: [pid: 282899|app: 0|req: 557/1113] 10.222.0.42 () {56 vars in 1177 bytes} [Thu Jul 28 08:38:11 2022] GET /identity/v3/roles/d76677105be344cc83022cbde8a22d8d => generated 223 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:38:11.278391 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f7e511-5f96-444c-a390-e8c59654ba4e None None] Authenticating user token {{(pid=282898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:38:11.357297 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG dbcounter [-] [282898] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=282898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:38:11.385312 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f7e511-5f96-444c-a390-e8c59654ba4e None None] Validating token access rules against request {{(pid=282898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:38:11.424602 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0bfbe20-a98e-4e35-9006-922f148c3e67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:38:11.425306 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0bfbe20-a98e-4e35-9006-922f148c3e67 None admin] REQUEST_METHOD: `GET` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:38:11.425584 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0bfbe20-a98e-4e35-9006-922f148c3e67 None admin] SCRIPT_NAME: `/identity` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:38:11.425860 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0bfbe20-a98e-4e35-9006-922f148c3e67 None admin] PATH_INFO: `/v3/users/7749ca51672f44c29e3f9a57e4534ae0` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:38:11.441014 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0bfbe20-a98e-4e35-9006-922f148c3e67 None admin] RBAC: Authorizing `identity:get_user(user_id=7749ca51672f44c29e3f9a57e4534ae0)` {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:38:11.442497 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0bfbe20-a98e-4e35-9006-922f148c3e67 None admin] RBAC: Authorization granted {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:38:11.444179 dv-cinder-851351-1-smb devstack@keystone.service[282898]: [pid: 282898|app: 0|req: 557/1114] 10.222.0.42 () {56 vars in 1177 bytes} [Thu Jul 28 08:38:11 2022] GET /identity/v3/users/7749ca51672f44c29e3f9a57e4534ae0 => generated 286 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 08:38:11.450482 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dba1aea-1ef9-41c4-a07d-988ce05f8c6c None admin] Authenticating user token {{(pid=282899) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:38:11.538560 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG dbcounter [-] [282899] Writing DB stats keystone:SELECT=100 {{(pid=282899) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:38:11.555898 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dba1aea-1ef9-41c4-a07d-988ce05f8c6c None admin] Validating token access rules against request {{(pid=282899) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:38:11.592460 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0826092-d28e-4661-aaa6-889e1e1865b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282899) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:38:11.593033 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0826092-d28e-4661-aaa6-889e1e1865b9 None admin] REQUEST_METHOD: `GET` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:38:11.593320 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0826092-d28e-4661-aaa6-889e1e1865b9 None admin] SCRIPT_NAME: `/identity` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:38:11.593601 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0826092-d28e-4661-aaa6-889e1e1865b9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:38:11.664545 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0826092-d28e-4661-aaa6-889e1e1865b9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:38:11.665970 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0826092-d28e-4661-aaa6-889e1e1865b9 None admin] RBAC: Authorization granted {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:38:11.753908 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG dbcounter [-] [282899] Writing DB stats keystone:SELECT=100 {{(pid=282899) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:38:11.779040 dv-cinder-851351-1-smb devstack@keystone.service[282899]: [pid: 282899|app: 0|req: 558/1115] 10.222.0.42 () {58 vars in 1282 bytes} [Thu Jul 28 08:38:11 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 28 08:38:11.785438 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0bfbe20-a98e-4e35-9006-922f148c3e67 None admin] Authenticating user token {{(pid=282898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:38:11.893270 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0bfbe20-a98e-4e35-9006-922f148c3e67 None admin] Validating token access rules against request {{(pid=282898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:38:11.927337 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG dbcounter [-] [282898] Writing DB stats keystone:SELECT=100 {{(pid=282898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:38:11.933404 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef14ac44-6284-45c1-a011-ad9d46431f83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:38:11.934062 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef14ac44-6284-45c1-a011-ad9d46431f83 None admin] REQUEST_METHOD: `GET` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:38:11.934343 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef14ac44-6284-45c1-a011-ad9d46431f83 None admin] SCRIPT_NAME: `/identity` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:38:11.934616 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef14ac44-6284-45c1-a011-ad9d46431f83 None admin] PATH_INFO: `/v3/projects/6116135c46aa445298ea96f8874b0611` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:38:11.935832 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef14ac44-6284-45c1-a011-ad9d46431f83 None admin] RBAC: Authorizing `identity:get_project(project_id=6116135c46aa445298ea96f8874b0611)` {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:38:11.937329 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef14ac44-6284-45c1-a011-ad9d46431f83 None admin] RBAC: Authorization granted {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:38:11.939148 dv-cinder-851351-1-smb devstack@keystone.service[282898]: [pid: 282898|app: 0|req: 558/1116] 10.222.0.42 () {56 vars in 1186 bytes} [Thu Jul 28 08:38:11 2022] GET /identity/v3/projects/6116135c46aa445298ea96f8874b0611 => generated 311 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:38:11.945888 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0826092-d28e-4661-aaa6-889e1e1865b9 None admin] Authenticating user token {{(pid=282899) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:38:12.059432 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0826092-d28e-4661-aaa6-889e1e1865b9 None admin] Validating token access rules against request {{(pid=282899) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:38:12.097674 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-970c7f93-83ca-4222-9cca-18f4fee8b868 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282899) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:38:12.098313 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970c7f93-83ca-4222-9cca-18f4fee8b868 None admin] REQUEST_METHOD: `GET` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:38:12.098600 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970c7f93-83ca-4222-9cca-18f4fee8b868 None admin] SCRIPT_NAME: `/identity` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:38:12.098882 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970c7f93-83ca-4222-9cca-18f4fee8b868 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:38:12.099700 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-970c7f93-83ca-4222-9cca-18f4fee8b868 None admin] RBAC: Adding query filter params (role.id=d76677105be344cc83022cbde8a22d8d, scope.project.id=6116135c46aa445298ea96f8874b0611, user.id=7749ca51672f44c29e3f9a57e4534ae0) {{(pid=282899) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:38:12.100018 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-970c7f93-83ca-4222-9cca-18f4fee8b868 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:38:12.101514 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-970c7f93-83ca-4222-9cca-18f4fee8b868 None admin] RBAC: Authorization granted {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:38:12.107734 dv-cinder-851351-1-smb devstack@keystone.service[282899]: [pid: 282899|app: 0|req: 559/1117] 10.222.0.42 () {56 vars in 1374 bytes} [Thu Jul 28 08:38:11 2022] GET /identity/v3/role_assignments?user.id=7749ca51672f44c29e3f9a57e4534ae0&scope.project.id=6116135c46aa445298ea96f8874b0611&role.id=d76677105be344cc83022cbde8a22d8d => generated 259 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:38:14.093862 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9778d98c-af17-47d6-9532-62be846aa054 None None] REQUEST_METHOD: `GET` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:38:14.094495 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9778d98c-af17-47d6-9532-62be846aa054 None None] SCRIPT_NAME: `/identity` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:38:14.094495 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9778d98c-af17-47d6-9532-62be846aa054 None None] PATH_INFO: `/` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:38:14.096130 dv-cinder-851351-1-smb devstack@keystone.service[282898]: [pid: 282898|app: 0|req: 559/1118] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 08:38:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 08:38:14.102505 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747faa5c-b05b-41dc-8005-b729766b3331 None None] REQUEST_METHOD: `POST` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:38:14.103043 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747faa5c-b05b-41dc-8005-b729766b3331 None None] SCRIPT_NAME: `/identity` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:38:14.103043 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747faa5c-b05b-41dc-8005-b729766b3331 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:38:14.122772 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.auth.core [None req-747faa5c-b05b-41dc-8005-b729766b3331 None None] MFA Rules not processed for user `2be990a66857410a87ffa7609aec4f7b`. Rule list: `[]` (Enabled: `True`). {{(pid=282899) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 08:38:14.124152 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.fernet_utils [None req-747faa5c-b05b-41dc-8005-b729766b3331 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=282899) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:38:14.172723 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG dbcounter [-] [282899] Writing DB stats keystone:SELECT=100 {{(pid=282899) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:38:14.198856 dv-cinder-851351-1-smb devstack@keystone.service[282899]: [pid: 282899|app: 0|req: 560/1119] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 08:38:14 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 08:38:14.222010 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9778d98c-af17-47d6-9532-62be846aa054 None None] Authenticating user token {{(pid=282898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:38:14.338011 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9778d98c-af17-47d6-9532-62be846aa054 None None] Validating token access rules against request {{(pid=282898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:38:14.376427 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff766cfa-706c-47ed-accb-48774050a612 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:38:14.377029 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff766cfa-706c-47ed-accb-48774050a612 None admin] REQUEST_METHOD: `GET` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:38:14.377317 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff766cfa-706c-47ed-accb-48774050a612 None admin] SCRIPT_NAME: `/identity` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:38:14.377596 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff766cfa-706c-47ed-accb-48774050a612 None admin] PATH_INFO: `/v3/roles/d76677105be344cc83022cbde8a22d8d` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:38:14.379156 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff766cfa-706c-47ed-accb-48774050a612 None admin] RBAC: Authorizing `identity:get_role(role_id=d76677105be344cc83022cbde8a22d8d)` {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:38:14.380573 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff766cfa-706c-47ed-accb-48774050a612 None admin] RBAC: Authorization granted {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:38:14.382002 dv-cinder-851351-1-smb devstack@keystone.service[282898]: [pid: 282898|app: 0|req: 560/1120] 10.222.0.42 () {56 vars in 1177 bytes} [Thu Jul 28 08:38:14 2022] GET /identity/v3/roles/d76677105be344cc83022cbde8a22d8d => generated 223 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:38:14.388316 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-747faa5c-b05b-41dc-8005-b729766b3331 None None] Authenticating user token {{(pid=282899) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:38:14.491847 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-747faa5c-b05b-41dc-8005-b729766b3331 None None] Validating token access rules against request {{(pid=282899) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:38:14.527014 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a8f8944-ef8e-40f4-a251-2f39a6d37a92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282899) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:38:14.527665 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8f8944-ef8e-40f4-a251-2f39a6d37a92 None admin] REQUEST_METHOD: `GET` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:38:14.527946 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8f8944-ef8e-40f4-a251-2f39a6d37a92 None admin] SCRIPT_NAME: `/identity` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:38:14.528206 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8f8944-ef8e-40f4-a251-2f39a6d37a92 None admin] PATH_INFO: `/v3/users/7749ca51672f44c29e3f9a57e4534ae0` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:38:14.529413 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a8f8944-ef8e-40f4-a251-2f39a6d37a92 None admin] RBAC: Authorizing `identity:get_user(user_id=7749ca51672f44c29e3f9a57e4534ae0)` {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:38:14.530866 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a8f8944-ef8e-40f4-a251-2f39a6d37a92 None admin] RBAC: Authorization granted {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:38:14.532551 dv-cinder-851351-1-smb devstack@keystone.service[282899]: [pid: 282899|app: 0|req: 561/1121] 10.222.0.42 () {56 vars in 1177 bytes} [Thu Jul 28 08:38:14 2022] GET /identity/v3/users/7749ca51672f44c29e3f9a57e4534ae0 => generated 286 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:38:14.539829 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff766cfa-706c-47ed-accb-48774050a612 None admin] Authenticating user token {{(pid=282898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:38:14.615485 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG dbcounter [-] [282898] Writing DB stats keystone:SELECT=100 {{(pid=282898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:38:14.655640 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff766cfa-706c-47ed-accb-48774050a612 None admin] Validating token access rules against request {{(pid=282898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:38:14.692682 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b91064-7931-4e8e-b0eb-d67ed8e7bf5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:38:14.693357 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b91064-7931-4e8e-b0eb-d67ed8e7bf5c None admin] REQUEST_METHOD: `GET` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:38:14.693636 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b91064-7931-4e8e-b0eb-d67ed8e7bf5c None admin] SCRIPT_NAME: `/identity` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:38:14.693909 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b91064-7931-4e8e-b0eb-d67ed8e7bf5c None admin] PATH_INFO: `/v3/projects/6116135c46aa445298ea96f8874b0611` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:38:14.695153 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41b91064-7931-4e8e-b0eb-d67ed8e7bf5c None admin] RBAC: Authorizing `identity:get_project(project_id=6116135c46aa445298ea96f8874b0611)` {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:38:14.696624 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41b91064-7931-4e8e-b0eb-d67ed8e7bf5c None admin] RBAC: Authorization granted {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:38:14.698374 dv-cinder-851351-1-smb devstack@keystone.service[282898]: [pid: 282898|app: 0|req: 561/1122] 10.222.0.42 () {56 vars in 1186 bytes} [Thu Jul 28 08:38:14 2022] GET /identity/v3/projects/6116135c46aa445298ea96f8874b0611 => generated 311 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:38:14.705068 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a8f8944-ef8e-40f4-a251-2f39a6d37a92 None admin] Authenticating user token {{(pid=282899) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:38:14.756833 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG dbcounter [-] [282899] Writing DB stats keystone:SELECT=100 {{(pid=282899) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:38:14.816209 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a8f8944-ef8e-40f4-a251-2f39a6d37a92 None admin] Validating token access rules against request {{(pid=282899) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:38:14.851878 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf5b8daa-fe68-418c-a99e-b6fbba9c4d27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282899) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:38:14.852568 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5b8daa-fe68-418c-a99e-b6fbba9c4d27 None admin] REQUEST_METHOD: `PUT` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:38:14.852890 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5b8daa-fe68-418c-a99e-b6fbba9c4d27 None admin] SCRIPT_NAME: `/identity` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:38:14.853174 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5b8daa-fe68-418c-a99e-b6fbba9c4d27 None admin] PATH_INFO: `/v3/projects/6116135c46aa445298ea96f8874b0611/users/7749ca51672f44c29e3f9a57e4534ae0/roles/d76677105be344cc83022cbde8a22d8d` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:38:14.855525 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf5b8daa-fe68-418c-a99e-b6fbba9c4d27 None admin] RBAC: Authorizing `identity:create_grant(project_id=6116135c46aa445298ea96f8874b0611, user_id=7749ca51672f44c29e3f9a57e4534ae0, role_id=d76677105be344cc83022cbde8a22d8d)` {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:38:14.857045 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf5b8daa-fe68-418c-a99e-b6fbba9c4d27 None admin] RBAC: Authorization granted {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:38:14.876406 dv-cinder-851351-1-smb devstack@keystone.service[282899]: [pid: 282899|app: 0|req: 562/1123] 10.222.0.42 () {58 vars in 1439 bytes} [Thu Jul 28 08:38:14 2022] PUT /identity/v3/projects/6116135c46aa445298ea96f8874b0611/users/7749ca51672f44c29e3f9a57e4534ae0/roles/d76677105be344cc83022cbde8a22d8d => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 08:38:16.927261 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991a4edd-fcca-4610-b335-66466c832d89 None None] REQUEST_METHOD: `GET` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:38:16.927876 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991a4edd-fcca-4610-b335-66466c832d89 None None] SCRIPT_NAME: `/identity` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:38:16.927876 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991a4edd-fcca-4610-b335-66466c832d89 None None] PATH_INFO: `/` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:38:16.929207 dv-cinder-851351-1-smb devstack@keystone.service[282898]: [pid: 282898|app: 0|req: 562/1124] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 08:38:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 08:38:16.935131 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ce03fb-1912-4924-b8c1-93a391d891b1 None None] REQUEST_METHOD: `POST` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:38:16.935691 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ce03fb-1912-4924-b8c1-93a391d891b1 None None] SCRIPT_NAME: `/identity` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:38:16.935691 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ce03fb-1912-4924-b8c1-93a391d891b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:38:16.955473 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.auth.core [None req-d8ce03fb-1912-4924-b8c1-93a391d891b1 None None] MFA Rules not processed for user `2be990a66857410a87ffa7609aec4f7b`. Rule list: `[]` (Enabled: `True`). {{(pid=282899) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 08:38:16.956821 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.fernet_utils [None req-d8ce03fb-1912-4924-b8c1-93a391d891b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=282899) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:38:17.029770 dv-cinder-851351-1-smb devstack@keystone.service[282899]: [pid: 282899|app: 0|req: 563/1125] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 08:38:16 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 08:38:17.053563 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991a4edd-fcca-4610-b335-66466c832d89 None None] Authenticating user token {{(pid=282898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:38:17.167368 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991a4edd-fcca-4610-b335-66466c832d89 None None] Validating token access rules against request {{(pid=282898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:38:17.204559 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a268c896-88c1-4b17-b5b4-0326606db37c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:38:17.205252 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a268c896-88c1-4b17-b5b4-0326606db37c None admin] REQUEST_METHOD: `GET` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:38:17.205531 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a268c896-88c1-4b17-b5b4-0326606db37c None admin] SCRIPT_NAME: `/identity` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:38:17.205810 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a268c896-88c1-4b17-b5b4-0326606db37c None admin] PATH_INFO: `/v3/roles/d76677105be344cc83022cbde8a22d8d` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:38:17.207308 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a268c896-88c1-4b17-b5b4-0326606db37c None admin] RBAC: Authorizing `identity:get_role(role_id=d76677105be344cc83022cbde8a22d8d)` {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:38:17.208744 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a268c896-88c1-4b17-b5b4-0326606db37c None admin] RBAC: Authorization granted {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:38:17.210156 dv-cinder-851351-1-smb devstack@keystone.service[282898]: [pid: 282898|app: 0|req: 563/1126] 10.222.0.42 () {56 vars in 1177 bytes} [Thu Jul 28 08:38:17 2022] GET /identity/v3/roles/d76677105be344cc83022cbde8a22d8d => generated 223 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:38:17.220013 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ce03fb-1912-4924-b8c1-93a391d891b1 None None] Authenticating user token {{(pid=282899) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:38:17.279368 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG dbcounter [-] [282899] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=282899) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:38:17.395896 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ce03fb-1912-4924-b8c1-93a391d891b1 None None] Validating token access rules against request {{(pid=282899) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:38:17.459074 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575db505-a55a-487b-a54f-76cc67d2321d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282899) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:38:17.460095 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575db505-a55a-487b-a54f-76cc67d2321d None admin] REQUEST_METHOD: `GET` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:38:17.460586 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575db505-a55a-487b-a54f-76cc67d2321d None admin] SCRIPT_NAME: `/identity` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:38:17.461118 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575db505-a55a-487b-a54f-76cc67d2321d None admin] PATH_INFO: `/v3/users/7749ca51672f44c29e3f9a57e4534ae0` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:38:17.463209 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-575db505-a55a-487b-a54f-76cc67d2321d None admin] RBAC: Authorizing `identity:get_user(user_id=7749ca51672f44c29e3f9a57e4534ae0)` {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:38:17.466010 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-575db505-a55a-487b-a54f-76cc67d2321d None admin] RBAC: Authorization granted {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:38:17.469103 dv-cinder-851351-1-smb devstack@keystone.service[282899]: [pid: 282899|app: 0|req: 564/1127] 10.222.0.42 () {56 vars in 1177 bytes} [Thu Jul 28 08:38:17 2022] GET /identity/v3/users/7749ca51672f44c29e3f9a57e4534ae0 => generated 286 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:38:17.475451 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a268c896-88c1-4b17-b5b4-0326606db37c None admin] Authenticating user token {{(pid=282898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:38:17.480062 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG dbcounter [-] [282898] Writing DB stats keystone:SELECT=100 {{(pid=282898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:38:17.588507 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a268c896-88c1-4b17-b5b4-0326606db37c None admin] Validating token access rules against request {{(pid=282898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:38:17.627100 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ab022e-2ccf-4618-a59d-dacde707f305 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:38:17.627726 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ab022e-2ccf-4618-a59d-dacde707f305 None admin] REQUEST_METHOD: `GET` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:38:17.628002 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ab022e-2ccf-4618-a59d-dacde707f305 None admin] SCRIPT_NAME: `/identity` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:38:17.628275 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ab022e-2ccf-4618-a59d-dacde707f305 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:38:17.702757 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ab022e-2ccf-4618-a59d-dacde707f305 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:38:17.704714 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ab022e-2ccf-4618-a59d-dacde707f305 None admin] RBAC: Authorization granted {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:38:17.707887 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG dbcounter [-] [282898] Writing DB stats keystone:SELECT=100 {{(pid=282898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:38:17.824379 dv-cinder-851351-1-smb devstack@keystone.service[282898]: [pid: 282898|app: 0|req: 564/1128] 10.222.0.42 () {58 vars in 1282 bytes} [Thu Jul 28 08:38:17 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 349 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 28 08:38:17.831192 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575db505-a55a-487b-a54f-76cc67d2321d None admin] Authenticating user token {{(pid=282899) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:38:17.950121 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575db505-a55a-487b-a54f-76cc67d2321d None admin] Validating token access rules against request {{(pid=282899) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:38:17.953369 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG dbcounter [-] [282899] Writing DB stats keystone:SELECT=100 {{(pid=282899) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:38:17.995048 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94144bbf-9c9b-4afd-9630-aef7ac4ebe53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282899) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:38:17.995738 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94144bbf-9c9b-4afd-9630-aef7ac4ebe53 None admin] REQUEST_METHOD: `GET` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:38:17.996023 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94144bbf-9c9b-4afd-9630-aef7ac4ebe53 None admin] SCRIPT_NAME: `/identity` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:38:17.996301 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94144bbf-9c9b-4afd-9630-aef7ac4ebe53 None admin] PATH_INFO: `/v3/projects/6116135c46aa445298ea96f8874b0611` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:38:17.997693 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94144bbf-9c9b-4afd-9630-aef7ac4ebe53 None admin] RBAC: Authorizing `identity:get_project(project_id=6116135c46aa445298ea96f8874b0611)` {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:38:17.999208 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94144bbf-9c9b-4afd-9630-aef7ac4ebe53 None admin] RBAC: Authorization granted {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:38:18.001180 dv-cinder-851351-1-smb devstack@keystone.service[282899]: [pid: 282899|app: 0|req: 565/1129] 10.222.0.42 () {56 vars in 1186 bytes} [Thu Jul 28 08:38:17 2022] GET /identity/v3/projects/6116135c46aa445298ea96f8874b0611 => generated 311 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:38:18.007998 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ab022e-2ccf-4618-a59d-dacde707f305 None admin] Authenticating user token {{(pid=282898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:38:18.118564 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ab022e-2ccf-4618-a59d-dacde707f305 None admin] Validating token access rules against request {{(pid=282898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:38:18.121347 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG dbcounter [-] [282898] Writing DB stats keystone:SELECT=100 {{(pid=282898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:38:18.159581 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ceb166-ed26-4467-bf90-12ca5f0de1b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:38:18.160220 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ceb166-ed26-4467-bf90-12ca5f0de1b0 None admin] REQUEST_METHOD: `GET` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:38:18.160504 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ceb166-ed26-4467-bf90-12ca5f0de1b0 None admin] SCRIPT_NAME: `/identity` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:38:18.160813 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ceb166-ed26-4467-bf90-12ca5f0de1b0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:38:18.161621 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0ceb166-ed26-4467-bf90-12ca5f0de1b0 None admin] RBAC: Adding query filter params (role.id=d76677105be344cc83022cbde8a22d8d, scope.project.id=6116135c46aa445298ea96f8874b0611, user.id=7749ca51672f44c29e3f9a57e4534ae0) {{(pid=282898) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:38:18.161937 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0ceb166-ed26-4467-bf90-12ca5f0de1b0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:38:18.163405 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0ceb166-ed26-4467-bf90-12ca5f0de1b0 None admin] RBAC: Authorization granted {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:38:18.170171 dv-cinder-851351-1-smb devstack@keystone.service[282898]: [pid: 282898|app: 0|req: 565/1130] 10.222.0.42 () {56 vars in 1374 bytes} [Thu Jul 28 08:38:18 2022] GET /identity/v3/role_assignments?user.id=7749ca51672f44c29e3f9a57e4534ae0&scope.project.id=6116135c46aa445298ea96f8874b0611&role.id=d76677105be344cc83022cbde8a22d8d => generated 608 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:38:20.277596 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af738fe7-1179-44af-b26a-9b5aa3230995 None None] REQUEST_METHOD: `GET` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:38:20.278187 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af738fe7-1179-44af-b26a-9b5aa3230995 None None] SCRIPT_NAME: `/identity` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:38:20.278187 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af738fe7-1179-44af-b26a-9b5aa3230995 None None] PATH_INFO: `/` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:38:20.279526 dv-cinder-851351-1-smb devstack@keystone.service[282899]: [pid: 282899|app: 0|req: 566/1131] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 08:38:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 08:38:20.285180 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c686426-f773-45e6-bad9-d4f858163c49 None None] REQUEST_METHOD: `POST` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:38:20.285616 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c686426-f773-45e6-bad9-d4f858163c49 None None] SCRIPT_NAME: `/identity` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:38:20.285732 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c686426-f773-45e6-bad9-d4f858163c49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:38:20.305267 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.auth.core [None req-2c686426-f773-45e6-bad9-d4f858163c49 None None] MFA Rules not processed for user `2be990a66857410a87ffa7609aec4f7b`. Rule list: `[]` (Enabled: `True`). {{(pid=282898) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 08:38:20.306513 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.fernet_utils [None req-2c686426-f773-45e6-bad9-d4f858163c49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=282898) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:38:20.380213 dv-cinder-851351-1-smb devstack@keystone.service[282898]: [pid: 282898|app: 0|req: 566/1132] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 08:38:20 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 08:38:20.403622 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af738fe7-1179-44af-b26a-9b5aa3230995 None None] Authenticating user token {{(pid=282899) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:38:20.521418 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af738fe7-1179-44af-b26a-9b5aa3230995 None None] Validating token access rules against request {{(pid=282899) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:38:20.556472 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c4a210-ef10-48b0-9241-b3fff4f1013d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282899) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:38:20.557075 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c4a210-ef10-48b0-9241-b3fff4f1013d None admin] REQUEST_METHOD: `GET` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:38:20.557358 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c4a210-ef10-48b0-9241-b3fff4f1013d None admin] SCRIPT_NAME: `/identity` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:38:20.557634 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c4a210-ef10-48b0-9241-b3fff4f1013d None admin] PATH_INFO: `/v3/domains/default` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:38:20.558817 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7c4a210-ef10-48b0-9241-b3fff4f1013d None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:38:20.560267 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7c4a210-ef10-48b0-9241-b3fff4f1013d None admin] RBAC: Authorization granted {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:38:20.561927 dv-cinder-851351-1-smb devstack@keystone.service[282899]: [pid: 282899|app: 0|req: 567/1133] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 08:38:20 2022] GET /identity/v3/domains/default => generated 199 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:38:20.568216 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c686426-f773-45e6-bad9-d4f858163c49 None None] Authenticating user token {{(pid=282898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:38:20.671414 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG dbcounter [-] [282898] Writing DB stats keystone:SELECT=100 {{(pid=282898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:38:20.675672 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c686426-f773-45e6-bad9-d4f858163c49 None None] Validating token access rules against request {{(pid=282898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:38:20.716281 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00ddb98-dac7-4b97-b5da-bb6ee5c0836e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:38:20.716943 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00ddb98-dac7-4b97-b5da-bb6ee5c0836e None admin] REQUEST_METHOD: `POST` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:38:20.717226 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00ddb98-dac7-4b97-b5da-bb6ee5c0836e None admin] SCRIPT_NAME: `/identity` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:38:20.717495 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00ddb98-dac7-4b97-b5da-bb6ee5c0836e None admin] PATH_INFO: `/v3/projects` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:38:20.718193 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f00ddb98-dac7-4b97-b5da-bb6ee5c0836e None admin] RBAC: Authorizing `identity:create_project()` {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:38:20.719747 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f00ddb98-dac7-4b97-b5da-bb6ee5c0836e None admin] RBAC: Authorization granted {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:38:20.748091 dv-cinder-851351-1-smb devstack@keystone.service[282898]: [pid: 282898|app: 0|req: 567/1134] 10.222.0.42 () {60 vars in 1141 bytes} [Thu Jul 28 08:38:20 2022] POST /identity/v3/projects => generated 311 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 08:38:22.812248 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6154b98c-5476-42e9-a298-eb4d0a28ff4b None None] REQUEST_METHOD: `GET` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:38:22.813044 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6154b98c-5476-42e9-a298-eb4d0a28ff4b None None] SCRIPT_NAME: `/identity` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:38:22.813044 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6154b98c-5476-42e9-a298-eb4d0a28ff4b None None] PATH_INFO: `/` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:38:22.814278 dv-cinder-851351-1-smb devstack@keystone.service[282899]: [pid: 282899|app: 0|req: 568/1135] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 08:38:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 08:38:22.819935 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e3629d-819e-4cca-b3e3-c6ff152e3389 None None] REQUEST_METHOD: `POST` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:38:22.820406 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e3629d-819e-4cca-b3e3-c6ff152e3389 None None] SCRIPT_NAME: `/identity` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:38:22.820518 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e3629d-819e-4cca-b3e3-c6ff152e3389 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:38:22.840440 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.auth.core [None req-94e3629d-819e-4cca-b3e3-c6ff152e3389 None None] MFA Rules not processed for user `2be990a66857410a87ffa7609aec4f7b`. Rule list: `[]` (Enabled: `True`). {{(pid=282898) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 08:38:22.841709 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.fernet_utils [None req-94e3629d-819e-4cca-b3e3-c6ff152e3389 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=282898) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:38:22.912713 dv-cinder-851351-1-smb devstack@keystone.service[282898]: [pid: 282898|app: 0|req: 568/1136] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 08:38:22 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 08:38:22.937092 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6154b98c-5476-42e9-a298-eb4d0a28ff4b None None] Authenticating user token {{(pid=282899) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:38:22.985015 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG dbcounter [-] [282899] Writing DB stats keystone:SELECT=100 {{(pid=282899) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:38:23.045184 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6154b98c-5476-42e9-a298-eb4d0a28ff4b None None] Validating token access rules against request {{(pid=282899) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:38:23.079615 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b3c428-c946-44fe-905f-4cd0a4d8d5a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282899) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:38:23.080263 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b3c428-c946-44fe-905f-4cd0a4d8d5a2 None admin] REQUEST_METHOD: `GET` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:38:23.080547 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b3c428-c946-44fe-905f-4cd0a4d8d5a2 None admin] SCRIPT_NAME: `/identity` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:38:23.080861 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b3c428-c946-44fe-905f-4cd0a4d8d5a2 None admin] PATH_INFO: `/v3/domains/default` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:38:23.082078 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65b3c428-c946-44fe-905f-4cd0a4d8d5a2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:38:23.083544 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65b3c428-c946-44fe-905f-4cd0a4d8d5a2 None admin] RBAC: Authorization granted {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:38:23.085199 dv-cinder-851351-1-smb devstack@keystone.service[282899]: [pid: 282899|app: 0|req: 569/1137] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 08:38:22 2022] GET /identity/v3/domains/default => generated 199 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:38:23.091465 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e3629d-819e-4cca-b3e3-c6ff152e3389 None None] Authenticating user token {{(pid=282898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:38:23.177331 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG dbcounter [-] [282898] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=282898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:38:23.198266 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e3629d-819e-4cca-b3e3-c6ff152e3389 None None] Validating token access rules against request {{(pid=282898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:38:23.235454 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23cf0c62-103c-4d3c-9cb2-b2dcab345f2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:38:23.236075 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23cf0c62-103c-4d3c-9cb2-b2dcab345f2b None admin] REQUEST_METHOD: `POST` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:38:23.236363 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23cf0c62-103c-4d3c-9cb2-b2dcab345f2b None admin] SCRIPT_NAME: `/identity` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:38:23.236638 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23cf0c62-103c-4d3c-9cb2-b2dcab345f2b None admin] PATH_INFO: `/v3/users` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:38:23.237365 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23cf0c62-103c-4d3c-9cb2-b2dcab345f2b None admin] RBAC: Authorizing `identity:create_user()` {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:38:23.238823 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23cf0c62-103c-4d3c-9cb2-b2dcab345f2b None admin] RBAC: Authorization granted {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:38:23.261662 dv-cinder-851351-1-smb devstack@keystone.service[282898]: [pid: 282898|app: 0|req: 569/1138] 10.222.0.42 () {60 vars in 1132 bytes} [Thu Jul 28 08:38:23 2022] POST /identity/v3/users => generated 286 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 08:38:25.399153 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d4abf8-b46f-45b5-9260-4f24e854c492 None None] REQUEST_METHOD: `GET` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:38:25.399744 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d4abf8-b46f-45b5-9260-4f24e854c492 None None] SCRIPT_NAME: `/identity` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:38:25.399744 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d4abf8-b46f-45b5-9260-4f24e854c492 None None] PATH_INFO: `/` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:38:25.401107 dv-cinder-851351-1-smb devstack@keystone.service[282899]: [pid: 282899|app: 0|req: 570/1139] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 08:38:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 08:38:25.409236 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d99279-fdfd-40f3-b160-e8eff6c1ae7b None None] REQUEST_METHOD: `POST` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:38:25.409792 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d99279-fdfd-40f3-b160-e8eff6c1ae7b None None] SCRIPT_NAME: `/identity` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:38:25.409792 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d99279-fdfd-40f3-b160-e8eff6c1ae7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:38:25.429823 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.auth.core [None req-27d99279-fdfd-40f3-b160-e8eff6c1ae7b None None] MFA Rules not processed for user `2be990a66857410a87ffa7609aec4f7b`. Rule list: `[]` (Enabled: `True`). {{(pid=282898) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 08:38:25.431027 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.fernet_utils [None req-27d99279-fdfd-40f3-b160-e8eff6c1ae7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=282898) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:38:25.508714 dv-cinder-851351-1-smb devstack@keystone.service[282898]: [pid: 282898|app: 0|req: 570/1140] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 08:38:25 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 28 08:38:25.532179 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d4abf8-b46f-45b5-9260-4f24e854c492 None None] Authenticating user token {{(pid=282899) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:38:25.646871 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d4abf8-b46f-45b5-9260-4f24e854c492 None None] Validating token access rules against request {{(pid=282899) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:38:25.656961 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG dbcounter [-] [282899] Writing DB stats keystone:SELECT=100 {{(pid=282899) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:38:25.684970 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a4aee7c-319b-4203-b028-b6fa73da272f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282899) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:38:25.685635 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4aee7c-319b-4203-b028-b6fa73da272f None admin] REQUEST_METHOD: `GET` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:38:25.685919 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4aee7c-319b-4203-b028-b6fa73da272f None admin] SCRIPT_NAME: `/identity` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:38:25.686197 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4aee7c-319b-4203-b028-b6fa73da272f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:38:25.697265 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a4aee7c-319b-4203-b028-b6fa73da272f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 08:38:25.702274 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application [None req-1a4aee7c-319b-4203-b028-b6fa73da272f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 08:38:25.702274 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:38:25.702274 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:38:25.702274 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:38:25.702274 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:38:25.702274 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:38:25.702274 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:38:25.702274 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:38:25.702274 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:38:25.702274 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:38:25.702274 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:38:25.702274 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:38:25.702274 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 08:38:25.702274 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 08:38:25.702274 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 08:38:25.702274 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 08:38:25.703555 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 08:38:25.703555 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 08:38:25.703555 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 08:38:25.703555 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 08:38:25.703555 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:38:25.703555 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:38:25.703555 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:38:25.703555 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:38:25.703555 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:38:25.703555 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:38:25.703555 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:38:25.703555 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application with Lock( Jul 28 08:38:25.703555 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:38:25.703555 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:38:25.703555 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:38:25.703555 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:38:25.705405 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:38:25.705405 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:38:25.705405 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:38:25.705405 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:38:25.705405 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 08:38:25.705405 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 08:38:25.705405 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 08:38:25.705405 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 08:38:25.705405 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 08:38:25.705405 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 08:38:25.705405 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 08:38:25.705405 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application Jul 28 08:38:25.705405 dv-cinder-851351-1-smb devstack@keystone.service[282899]: [pid: 282899|app: 0|req: 571/1141] 10.222.0.42 () {56 vars in 1096 bytes} [Thu Jul 28 08:38:25 2022] GET /identity/v3/roles/admin => generated 83 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:38:25.710638 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d99279-fdfd-40f3-b160-e8eff6c1ae7b None None] Authenticating user token {{(pid=282898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:38:25.788780 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG dbcounter [-] [282898] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=282898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:38:25.836131 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d99279-fdfd-40f3-b160-e8eff6c1ae7b None None] Validating token access rules against request {{(pid=282898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:38:25.885840 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d172c3c-732c-4c3f-a002-9a470a50f168 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:38:25.886491 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d172c3c-732c-4c3f-a002-9a470a50f168 None admin] REQUEST_METHOD: `GET` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:38:25.886777 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d172c3c-732c-4c3f-a002-9a470a50f168 None admin] SCRIPT_NAME: `/identity` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:38:25.887056 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d172c3c-732c-4c3f-a002-9a470a50f168 None admin] PATH_INFO: `/v3/roles` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:38:25.887807 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d172c3c-732c-4c3f-a002-9a470a50f168 None admin] RBAC: Adding query filter params (name=admin) {{(pid=282898) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:38:25.888119 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d172c3c-732c-4c3f-a002-9a470a50f168 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:38:25.889571 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d172c3c-732c-4c3f-a002-9a470a50f168 None admin] RBAC: Authorization granted {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:38:25.898937 dv-cinder-851351-1-smb devstack@keystone.service[282898]: [pid: 282898|app: 0|req: 571/1142] 10.222.0.42 () {56 vars in 1099 bytes} [Thu Jul 28 08:38:25 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:38:25.905338 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a4aee7c-319b-4203-b028-b6fa73da272f None admin] Authenticating user token {{(pid=282899) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:38:26.020001 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a4aee7c-319b-4203-b028-b6fa73da272f None admin] Validating token access rules against request {{(pid=282899) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:38:26.058550 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b487d7b-6911-423d-a264-965e92cc3783 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282899) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:38:26.059209 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b487d7b-6911-423d-a264-965e92cc3783 None admin] REQUEST_METHOD: `GET` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:38:26.059499 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b487d7b-6911-423d-a264-965e92cc3783 None admin] SCRIPT_NAME: `/identity` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:38:26.059767 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b487d7b-6911-423d-a264-965e92cc3783 None admin] PATH_INFO: `/v3/users/b26064d58646488281aa0932d86ddc1c` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:38:26.075419 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b487d7b-6911-423d-a264-965e92cc3783 None admin] RBAC: Authorizing `identity:get_user(user_id=b26064d58646488281aa0932d86ddc1c)` {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:38:26.076972 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b487d7b-6911-423d-a264-965e92cc3783 None admin] RBAC: Authorization granted {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:38:26.078765 dv-cinder-851351-1-smb devstack@keystone.service[282899]: [pid: 282899|app: 0|req: 572/1143] 10.222.0.42 () {56 vars in 1177 bytes} [Thu Jul 28 08:38:25 2022] GET /identity/v3/users/b26064d58646488281aa0932d86ddc1c => generated 286 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:38:26.085438 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d172c3c-732c-4c3f-a002-9a470a50f168 None admin] Authenticating user token {{(pid=282898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:38:26.195904 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d172c3c-732c-4c3f-a002-9a470a50f168 None admin] Validating token access rules against request {{(pid=282898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:38:26.225325 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG dbcounter [-] [282898] Writing DB stats keystone:SELECT=100 {{(pid=282898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:38:26.235779 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e140deb5-ba6e-4414-a219-d9d9a03ae5a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:38:26.236493 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e140deb5-ba6e-4414-a219-d9d9a03ae5a7 None admin] REQUEST_METHOD: `GET` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:38:26.236874 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e140deb5-ba6e-4414-a219-d9d9a03ae5a7 None admin] SCRIPT_NAME: `/identity` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:38:26.237205 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e140deb5-ba6e-4414-a219-d9d9a03ae5a7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:38:26.311194 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e140deb5-ba6e-4414-a219-d9d9a03ae5a7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:38:26.312590 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e140deb5-ba6e-4414-a219-d9d9a03ae5a7 None admin] RBAC: Authorization granted {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:38:26.421108 dv-cinder-851351-1-smb devstack@keystone.service[282898]: [pid: 282898|app: 0|req: 572/1144] 10.222.0.42 () {58 vars in 1282 bytes} [Thu Jul 28 08:38:26 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 336 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 28 08:38:26.427836 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b487d7b-6911-423d-a264-965e92cc3783 None admin] Authenticating user token {{(pid=282899) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:38:26.457914 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG dbcounter [-] [282899] Writing DB stats keystone:SELECT=100 {{(pid=282899) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:38:26.537728 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b487d7b-6911-423d-a264-965e92cc3783 None admin] Validating token access rules against request {{(pid=282899) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:38:26.575917 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e18c0c7-8604-43ef-897d-61bd3044d795 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282899) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:38:26.576727 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e18c0c7-8604-43ef-897d-61bd3044d795 None admin] REQUEST_METHOD: `GET` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:38:26.577119 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e18c0c7-8604-43ef-897d-61bd3044d795 None admin] SCRIPT_NAME: `/identity` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:38:26.577488 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e18c0c7-8604-43ef-897d-61bd3044d795 None admin] PATH_INFO: `/v3/projects/828d6561c00342f696a93967074c7246` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:38:26.579207 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e18c0c7-8604-43ef-897d-61bd3044d795 None admin] RBAC: Authorizing `identity:get_project(project_id=828d6561c00342f696a93967074c7246)` {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:38:26.580752 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e18c0c7-8604-43ef-897d-61bd3044d795 None admin] RBAC: Authorization granted {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:38:26.582538 dv-cinder-851351-1-smb devstack@keystone.service[282899]: [pid: 282899|app: 0|req: 573/1145] 10.222.0.42 () {56 vars in 1186 bytes} [Thu Jul 28 08:38:26 2022] GET /identity/v3/projects/828d6561c00342f696a93967074c7246 => generated 311 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:38:26.589346 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e140deb5-ba6e-4414-a219-d9d9a03ae5a7 None admin] Authenticating user token {{(pid=282898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:38:26.618830 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG dbcounter [-] [282898] Writing DB stats keystone:SELECT=100 {{(pid=282898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:38:26.695847 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e140deb5-ba6e-4414-a219-d9d9a03ae5a7 None admin] Validating token access rules against request {{(pid=282898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:38:26.738425 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e2b1ef-36fb-4ffa-aa46-2df588953a9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:38:26.739118 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e2b1ef-36fb-4ffa-aa46-2df588953a9d None admin] REQUEST_METHOD: `GET` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:38:26.739458 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e2b1ef-36fb-4ffa-aa46-2df588953a9d None admin] SCRIPT_NAME: `/identity` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:38:26.739851 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e2b1ef-36fb-4ffa-aa46-2df588953a9d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:38:26.740833 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1e2b1ef-36fb-4ffa-aa46-2df588953a9d None admin] RBAC: Adding query filter params (role.id=a0e2a00bf94d40f38629d6b5293e3aee, scope.project.id=828d6561c00342f696a93967074c7246, user.id=b26064d58646488281aa0932d86ddc1c) {{(pid=282898) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:38:26.741261 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1e2b1ef-36fb-4ffa-aa46-2df588953a9d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:38:26.742895 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1e2b1ef-36fb-4ffa-aa46-2df588953a9d None admin] RBAC: Authorization granted {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:38:26.749540 dv-cinder-851351-1-smb devstack@keystone.service[282898]: [pid: 282898|app: 0|req: 573/1146] 10.222.0.42 () {56 vars in 1374 bytes} [Thu Jul 28 08:38:26 2022] GET /identity/v3/role_assignments?user.id=b26064d58646488281aa0932d86ddc1c&scope.project.id=828d6561c00342f696a93967074c7246&role.id=a0e2a00bf94d40f38629d6b5293e3aee => generated 259 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:38:28.751445 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964f36b6-3f3d-4c83-b72b-24bff916ebbb None None] REQUEST_METHOD: `GET` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:38:28.752054 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964f36b6-3f3d-4c83-b72b-24bff916ebbb None None] SCRIPT_NAME: `/identity` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:38:28.752054 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964f36b6-3f3d-4c83-b72b-24bff916ebbb None None] PATH_INFO: `/` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:38:28.753432 dv-cinder-851351-1-smb devstack@keystone.service[282899]: [pid: 282899|app: 0|req: 574/1147] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 08:38:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 08:38:28.759049 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a729a1bb-73a8-4016-979a-e690e1492114 None None] REQUEST_METHOD: `POST` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:38:28.759594 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a729a1bb-73a8-4016-979a-e690e1492114 None None] SCRIPT_NAME: `/identity` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:38:28.759594 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a729a1bb-73a8-4016-979a-e690e1492114 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:38:28.780347 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.auth.core [None req-a729a1bb-73a8-4016-979a-e690e1492114 None None] MFA Rules not processed for user `2be990a66857410a87ffa7609aec4f7b`. Rule list: `[]` (Enabled: `True`). {{(pid=282898) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 08:38:28.781789 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.fernet_utils [None req-a729a1bb-73a8-4016-979a-e690e1492114 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=282898) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:38:28.858335 dv-cinder-851351-1-smb devstack@keystone.service[282898]: [pid: 282898|app: 0|req: 574/1148] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 08:38:28 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 08:38:28.880885 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-964f36b6-3f3d-4c83-b72b-24bff916ebbb None None] Authenticating user token {{(pid=282899) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:38:28.982041 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG dbcounter [-] [282899] Writing DB stats keystone:SELECT=100 {{(pid=282899) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:38:28.990775 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-964f36b6-3f3d-4c83-b72b-24bff916ebbb None None] Validating token access rules against request {{(pid=282899) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:38:29.028939 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d947c725-dcdb-4b2a-a69f-8cbab858ce26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282899) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:38:29.029515 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d947c725-dcdb-4b2a-a69f-8cbab858ce26 None admin] REQUEST_METHOD: `GET` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:38:29.029800 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d947c725-dcdb-4b2a-a69f-8cbab858ce26 None admin] SCRIPT_NAME: `/identity` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:38:29.030077 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d947c725-dcdb-4b2a-a69f-8cbab858ce26 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:38:29.040969 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d947c725-dcdb-4b2a-a69f-8cbab858ce26 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 08:38:29.045964 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application [None req-d947c725-dcdb-4b2a-a69f-8cbab858ce26 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 08:38:29.045964 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:38:29.045964 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:38:29.045964 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:38:29.045964 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:38:29.045964 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:38:29.045964 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:38:29.045964 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:38:29.045964 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:38:29.045964 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:38:29.045964 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:38:29.045964 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:38:29.045964 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 08:38:29.045964 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 08:38:29.045964 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 08:38:29.045964 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 08:38:29.047293 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 08:38:29.047293 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 08:38:29.047293 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 08:38:29.047293 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 08:38:29.047293 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:38:29.047293 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:38:29.047293 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:38:29.047293 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:38:29.047293 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:38:29.047293 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:38:29.047293 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:38:29.047293 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application with Lock( Jul 28 08:38:29.047293 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:38:29.047293 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:38:29.047293 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:38:29.047293 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:38:29.048584 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:38:29.048584 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:38:29.048584 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:38:29.048584 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:38:29.048584 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 08:38:29.048584 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 08:38:29.048584 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 08:38:29.048584 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 08:38:29.048584 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 08:38:29.048584 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 08:38:29.048584 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 08:38:29.048584 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application Jul 28 08:38:29.048584 dv-cinder-851351-1-smb devstack@keystone.service[282899]: [pid: 282899|app: 0|req: 575/1149] 10.222.0.42 () {56 vars in 1096 bytes} [Thu Jul 28 08:38:28 2022] GET /identity/v3/roles/admin => generated 83 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:38:29.053613 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a729a1bb-73a8-4016-979a-e690e1492114 None None] Authenticating user token {{(pid=282898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:38:29.086037 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG dbcounter [-] [282898] Writing DB stats keystone:SELECT=100 {{(pid=282898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:38:29.164322 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a729a1bb-73a8-4016-979a-e690e1492114 None None] Validating token access rules against request {{(pid=282898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:38:29.199583 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-174d02cd-be2e-46aa-b36a-e5c68509764d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:38:29.200208 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174d02cd-be2e-46aa-b36a-e5c68509764d None admin] REQUEST_METHOD: `GET` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:38:29.200491 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174d02cd-be2e-46aa-b36a-e5c68509764d None admin] SCRIPT_NAME: `/identity` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:38:29.200793 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174d02cd-be2e-46aa-b36a-e5c68509764d None admin] PATH_INFO: `/v3/roles` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:38:29.201530 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-174d02cd-be2e-46aa-b36a-e5c68509764d None admin] RBAC: Adding query filter params (name=admin) {{(pid=282898) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:38:29.201835 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-174d02cd-be2e-46aa-b36a-e5c68509764d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:38:29.203235 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-174d02cd-be2e-46aa-b36a-e5c68509764d None admin] RBAC: Authorization granted {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:38:29.212272 dv-cinder-851351-1-smb devstack@keystone.service[282898]: [pid: 282898|app: 0|req: 575/1150] 10.222.0.42 () {56 vars in 1099 bytes} [Thu Jul 28 08:38:29 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:38:29.218541 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d947c725-dcdb-4b2a-a69f-8cbab858ce26 None admin] Authenticating user token {{(pid=282899) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:38:29.326917 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d947c725-dcdb-4b2a-a69f-8cbab858ce26 None admin] Validating token access rules against request {{(pid=282899) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:38:29.363771 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e40cc8-cfb8-435c-bc77-ffe1c5112b6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282899) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:38:29.364443 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e40cc8-cfb8-435c-bc77-ffe1c5112b6f None admin] REQUEST_METHOD: `GET` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:38:29.364756 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e40cc8-cfb8-435c-bc77-ffe1c5112b6f None admin] SCRIPT_NAME: `/identity` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:38:29.365035 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e40cc8-cfb8-435c-bc77-ffe1c5112b6f None admin] PATH_INFO: `/v3/users/b26064d58646488281aa0932d86ddc1c` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:38:29.366234 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e40cc8-cfb8-435c-bc77-ffe1c5112b6f None admin] RBAC: Authorizing `identity:get_user(user_id=b26064d58646488281aa0932d86ddc1c)` {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:38:29.367693 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e40cc8-cfb8-435c-bc77-ffe1c5112b6f None admin] RBAC: Authorization granted {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:38:29.369348 dv-cinder-851351-1-smb devstack@keystone.service[282899]: [pid: 282899|app: 0|req: 576/1151] 10.222.0.42 () {56 vars in 1177 bytes} [Thu Jul 28 08:38:29 2022] GET /identity/v3/users/b26064d58646488281aa0932d86ddc1c => generated 286 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:38:29.375713 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-174d02cd-be2e-46aa-b36a-e5c68509764d None admin] Authenticating user token {{(pid=282898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:38:29.471971 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG dbcounter [-] [282898] Writing DB stats keystone:SELECT=100 {{(pid=282898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:38:29.488951 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-174d02cd-be2e-46aa-b36a-e5c68509764d None admin] Validating token access rules against request {{(pid=282898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:38:29.523391 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a50869-6b9e-4458-baef-3034c806e7ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:38:29.524043 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a50869-6b9e-4458-baef-3034c806e7ba None admin] REQUEST_METHOD: `GET` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:38:29.524327 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a50869-6b9e-4458-baef-3034c806e7ba None admin] SCRIPT_NAME: `/identity` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:38:29.524601 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a50869-6b9e-4458-baef-3034c806e7ba None admin] PATH_INFO: `/v3/projects/828d6561c00342f696a93967074c7246` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:38:29.525817 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25a50869-6b9e-4458-baef-3034c806e7ba None admin] RBAC: Authorizing `identity:get_project(project_id=828d6561c00342f696a93967074c7246)` {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:38:29.527269 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25a50869-6b9e-4458-baef-3034c806e7ba None admin] RBAC: Authorization granted {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:38:29.529020 dv-cinder-851351-1-smb devstack@keystone.service[282898]: [pid: 282898|app: 0|req: 576/1152] 10.222.0.42 () {56 vars in 1186 bytes} [Thu Jul 28 08:38:29 2022] GET /identity/v3/projects/828d6561c00342f696a93967074c7246 => generated 311 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:38:29.535331 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e40cc8-cfb8-435c-bc77-ffe1c5112b6f None admin] Authenticating user token {{(pid=282899) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:38:29.561545 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG dbcounter [-] [282899] Writing DB stats keystone:SELECT=100 {{(pid=282899) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:38:29.643653 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e40cc8-cfb8-435c-bc77-ffe1c5112b6f None admin] Validating token access rules against request {{(pid=282899) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:38:29.678355 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e704f6-4adf-42b0-934c-5e542a8edfb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282899) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:38:29.679046 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e704f6-4adf-42b0-934c-5e542a8edfb1 None admin] REQUEST_METHOD: `PUT` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:38:29.679327 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e704f6-4adf-42b0-934c-5e542a8edfb1 None admin] SCRIPT_NAME: `/identity` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:38:29.679610 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e704f6-4adf-42b0-934c-5e542a8edfb1 None admin] PATH_INFO: `/v3/projects/828d6561c00342f696a93967074c7246/users/b26064d58646488281aa0932d86ddc1c/roles/a0e2a00bf94d40f38629d6b5293e3aee` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:38:29.681673 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5e704f6-4adf-42b0-934c-5e542a8edfb1 None admin] RBAC: Authorizing `identity:create_grant(project_id=828d6561c00342f696a93967074c7246, user_id=b26064d58646488281aa0932d86ddc1c, role_id=a0e2a00bf94d40f38629d6b5293e3aee)` {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:38:29.683152 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5e704f6-4adf-42b0-934c-5e542a8edfb1 None admin] RBAC: Authorization granted {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:38:29.698688 dv-cinder-851351-1-smb devstack@keystone.service[282899]: [pid: 282899|app: 0|req: 577/1153] 10.222.0.42 () {58 vars in 1439 bytes} [Thu Jul 28 08:38:29 2022] PUT /identity/v3/projects/828d6561c00342f696a93967074c7246/users/b26064d58646488281aa0932d86ddc1c/roles/a0e2a00bf94d40f38629d6b5293e3aee => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 08:38:31.757067 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1018de-02ab-4e0b-b6cf-0077bb5a4a5d None None] REQUEST_METHOD: `GET` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:38:31.757894 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1018de-02ab-4e0b-b6cf-0077bb5a4a5d None None] SCRIPT_NAME: `/identity` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:38:31.757894 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1018de-02ab-4e0b-b6cf-0077bb5a4a5d None None] PATH_INFO: `/` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:38:31.758998 dv-cinder-851351-1-smb devstack@keystone.service[282898]: [pid: 282898|app: 0|req: 577/1154] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 08:38:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 08:38:31.764823 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cfec4be-8401-404e-9b9b-1bf1db66e2e9 None None] REQUEST_METHOD: `POST` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:38:31.765345 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cfec4be-8401-404e-9b9b-1bf1db66e2e9 None None] SCRIPT_NAME: `/identity` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:38:31.765496 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cfec4be-8401-404e-9b9b-1bf1db66e2e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:38:31.784443 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.auth.core [None req-2cfec4be-8401-404e-9b9b-1bf1db66e2e9 None None] MFA Rules not processed for user `2be990a66857410a87ffa7609aec4f7b`. Rule list: `[]` (Enabled: `True`). {{(pid=282899) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 08:38:31.785726 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.fernet_utils [None req-2cfec4be-8401-404e-9b9b-1bf1db66e2e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=282899) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:38:31.866954 dv-cinder-851351-1-smb devstack@keystone.service[282899]: [pid: 282899|app: 0|req: 578/1155] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 08:38:31 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 28 08:38:31.891327 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa1018de-02ab-4e0b-b6cf-0077bb5a4a5d None None] Authenticating user token {{(pid=282898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:38:32.008577 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa1018de-02ab-4e0b-b6cf-0077bb5a4a5d None None] Validating token access rules against request {{(pid=282898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:38:32.067048 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e20324e0-6416-488c-8269-c35548d0ddb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:38:32.068129 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20324e0-6416-488c-8269-c35548d0ddb9 None admin] REQUEST_METHOD: `GET` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:38:32.068633 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20324e0-6416-488c-8269-c35548d0ddb9 None admin] SCRIPT_NAME: `/identity` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:38:32.069176 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20324e0-6416-488c-8269-c35548d0ddb9 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:38:32.088655 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e20324e0-6416-488c-8269-c35548d0ddb9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 08:38:32.098924 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application [None req-e20324e0-6416-488c-8269-c35548d0ddb9 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 08:38:32.098924 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:38:32.098924 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:38:32.098924 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:38:32.098924 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:38:32.098924 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:38:32.098924 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:38:32.098924 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:38:32.098924 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:38:32.098924 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:38:32.098924 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:38:32.098924 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:38:32.098924 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 08:38:32.098924 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 08:38:32.098924 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 08:38:32.098924 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 08:38:32.100225 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 08:38:32.100225 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 08:38:32.100225 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 08:38:32.100225 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 08:38:32.100225 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:38:32.100225 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:38:32.100225 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:38:32.100225 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:38:32.100225 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:38:32.100225 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:38:32.100225 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:38:32.100225 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application with Lock( Jul 28 08:38:32.100225 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:38:32.100225 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:38:32.100225 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:38:32.100225 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:38:32.106768 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:38:32.106768 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:38:32.106768 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:38:32.106768 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:38:32.106768 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 08:38:32.106768 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 08:38:32.106768 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 08:38:32.106768 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 08:38:32.106768 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 08:38:32.106768 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 08:38:32.106768 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 08:38:32.106768 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application Jul 28 08:38:32.106768 dv-cinder-851351-1-smb devstack@keystone.service[282898]: [pid: 282898|app: 0|req: 578/1156] 10.222.0.42 () {56 vars in 1096 bytes} [Thu Jul 28 08:38:31 2022] GET /identity/v3/roles/admin => generated 83 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 08:38:32.108220 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cfec4be-8401-404e-9b9b-1bf1db66e2e9 None None] Authenticating user token {{(pid=282899) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:38:32.123768 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG dbcounter [-] [282899] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=282899) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:38:32.217774 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cfec4be-8401-404e-9b9b-1bf1db66e2e9 None None] Validating token access rules against request {{(pid=282899) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:38:32.253799 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6389bb50-ce82-4fd9-bedb-ded7a76d4ae7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282899) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:38:32.254436 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6389bb50-ce82-4fd9-bedb-ded7a76d4ae7 None admin] REQUEST_METHOD: `GET` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:38:32.254720 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6389bb50-ce82-4fd9-bedb-ded7a76d4ae7 None admin] SCRIPT_NAME: `/identity` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:38:32.254996 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6389bb50-ce82-4fd9-bedb-ded7a76d4ae7 None admin] PATH_INFO: `/v3/roles` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:38:32.255733 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6389bb50-ce82-4fd9-bedb-ded7a76d4ae7 None admin] RBAC: Adding query filter params (name=admin) {{(pid=282899) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:38:32.256006 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6389bb50-ce82-4fd9-bedb-ded7a76d4ae7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:38:32.257461 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6389bb50-ce82-4fd9-bedb-ded7a76d4ae7 None admin] RBAC: Authorization granted {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:38:32.266794 dv-cinder-851351-1-smb devstack@keystone.service[282899]: [pid: 282899|app: 0|req: 579/1157] 10.222.0.42 () {56 vars in 1099 bytes} [Thu Jul 28 08:38:32 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:38:32.275834 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e20324e0-6416-488c-8269-c35548d0ddb9 None admin] Authenticating user token {{(pid=282898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:38:32.292426 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG dbcounter [-] [282898] Writing DB stats keystone:SELECT=100 {{(pid=282898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:38:32.393594 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e20324e0-6416-488c-8269-c35548d0ddb9 None admin] Validating token access rules against request {{(pid=282898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:38:32.453132 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8df22f9-15bb-42e7-8d0e-5a44937bd448 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:38:32.454520 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8df22f9-15bb-42e7-8d0e-5a44937bd448 None admin] REQUEST_METHOD: `GET` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:38:32.454976 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8df22f9-15bb-42e7-8d0e-5a44937bd448 None admin] SCRIPT_NAME: `/identity` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:38:32.455404 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8df22f9-15bb-42e7-8d0e-5a44937bd448 None admin] PATH_INFO: `/v3/users/b26064d58646488281aa0932d86ddc1c` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:38:32.457363 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8df22f9-15bb-42e7-8d0e-5a44937bd448 None admin] RBAC: Authorizing `identity:get_user(user_id=b26064d58646488281aa0932d86ddc1c)` {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:38:32.459769 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8df22f9-15bb-42e7-8d0e-5a44937bd448 None admin] RBAC: Authorization granted {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:38:32.462786 dv-cinder-851351-1-smb devstack@keystone.service[282898]: [pid: 282898|app: 0|req: 579/1158] 10.222.0.42 () {56 vars in 1177 bytes} [Thu Jul 28 08:38:32 2022] GET /identity/v3/users/b26064d58646488281aa0932d86ddc1c => generated 286 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:38:32.469339 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6389bb50-ce82-4fd9-bedb-ded7a76d4ae7 None admin] Authenticating user token {{(pid=282899) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:38:32.558072 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG dbcounter [-] [282899] Writing DB stats keystone:SELECT=100 {{(pid=282899) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:38:32.592363 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6389bb50-ce82-4fd9-bedb-ded7a76d4ae7 None admin] Validating token access rules against request {{(pid=282899) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:38:32.641559 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa9631b-d823-4d84-9c73-9dd8fdc2c1d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282899) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:38:32.642654 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa9631b-d823-4d84-9c73-9dd8fdc2c1d4 None admin] REQUEST_METHOD: `GET` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:38:32.643152 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa9631b-d823-4d84-9c73-9dd8fdc2c1d4 None admin] SCRIPT_NAME: `/identity` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:38:32.643656 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa9631b-d823-4d84-9c73-9dd8fdc2c1d4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:38:32.769118 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa9631b-d823-4d84-9c73-9dd8fdc2c1d4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:38:32.771909 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa9631b-d823-4d84-9c73-9dd8fdc2c1d4 None admin] RBAC: Authorization granted {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:38:32.901474 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG dbcounter [-] [282899] Writing DB stats keystone:SELECT=100 {{(pid=282899) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:38:32.928974 dv-cinder-851351-1-smb devstack@keystone.service[282899]: [pid: 282899|app: 0|req: 580/1159] 10.222.0.42 () {58 vars in 1282 bytes} [Thu Jul 28 08:38:32 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 460 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 28 08:38:32.935372 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8df22f9-15bb-42e7-8d0e-5a44937bd448 None admin] Authenticating user token {{(pid=282898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:38:33.026312 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG dbcounter [-] [282898] Writing DB stats keystone:SELECT=100 {{(pid=282898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:38:33.049355 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8df22f9-15bb-42e7-8d0e-5a44937bd448 None admin] Validating token access rules against request {{(pid=282898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:38:33.087015 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05db699-4ac9-4f68-99ca-616c9659997d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:38:33.087713 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05db699-4ac9-4f68-99ca-616c9659997d None admin] REQUEST_METHOD: `GET` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:38:33.088039 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05db699-4ac9-4f68-99ca-616c9659997d None admin] SCRIPT_NAME: `/identity` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:38:33.088360 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05db699-4ac9-4f68-99ca-616c9659997d None admin] PATH_INFO: `/v3/projects/828d6561c00342f696a93967074c7246` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:38:33.089674 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e05db699-4ac9-4f68-99ca-616c9659997d None admin] RBAC: Authorizing `identity:get_project(project_id=828d6561c00342f696a93967074c7246)` {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:38:33.091180 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e05db699-4ac9-4f68-99ca-616c9659997d None admin] RBAC: Authorization granted {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:38:33.092964 dv-cinder-851351-1-smb devstack@keystone.service[282898]: [pid: 282898|app: 0|req: 580/1160] 10.222.0.42 () {56 vars in 1186 bytes} [Thu Jul 28 08:38:32 2022] GET /identity/v3/projects/828d6561c00342f696a93967074c7246 => generated 311 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:38:33.099772 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa9631b-d823-4d84-9c73-9dd8fdc2c1d4 None admin] Authenticating user token {{(pid=282899) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:38:33.212520 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa9631b-d823-4d84-9c73-9dd8fdc2c1d4 None admin] Validating token access rules against request {{(pid=282899) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:38:33.249104 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77abd24d-427b-4bb1-9c13-27b8e1a8c817 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282899) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:38:33.249736 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77abd24d-427b-4bb1-9c13-27b8e1a8c817 None admin] REQUEST_METHOD: `GET` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:38:33.250007 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77abd24d-427b-4bb1-9c13-27b8e1a8c817 None admin] SCRIPT_NAME: `/identity` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:38:33.250296 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77abd24d-427b-4bb1-9c13-27b8e1a8c817 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:38:33.251124 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77abd24d-427b-4bb1-9c13-27b8e1a8c817 None admin] RBAC: Adding query filter params (role.id=a0e2a00bf94d40f38629d6b5293e3aee, scope.project.id=828d6561c00342f696a93967074c7246, user.id=b26064d58646488281aa0932d86ddc1c) {{(pid=282899) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:38:33.251434 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77abd24d-427b-4bb1-9c13-27b8e1a8c817 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:38:33.252913 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77abd24d-427b-4bb1-9c13-27b8e1a8c817 None admin] RBAC: Authorization granted {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:38:33.259367 dv-cinder-851351-1-smb devstack@keystone.service[282899]: [pid: 282899|app: 0|req: 581/1161] 10.222.0.42 () {56 vars in 1374 bytes} [Thu Jul 28 08:38:33 2022] GET /identity/v3/role_assignments?user.id=b26064d58646488281aa0932d86ddc1c&scope.project.id=828d6561c00342f696a93967074c7246&role.id=a0e2a00bf94d40f38629d6b5293e3aee => generated 608 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:38:35.345729 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4cb714-2631-4dfb-8b68-a5d1efbd6926 None None] REQUEST_METHOD: `GET` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:38:35.346408 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4cb714-2631-4dfb-8b68-a5d1efbd6926 None None] SCRIPT_NAME: `/identity` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:38:35.346408 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4cb714-2631-4dfb-8b68-a5d1efbd6926 None None] PATH_INFO: `/` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:38:35.347785 dv-cinder-851351-1-smb devstack@keystone.service[282898]: [pid: 282898|app: 0|req: 581/1162] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 08:38:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 08:38:35.353804 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e94d355-e332-4b75-b12e-21a5ddde8cff None None] REQUEST_METHOD: `POST` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:38:35.354388 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e94d355-e332-4b75-b12e-21a5ddde8cff None None] SCRIPT_NAME: `/identity` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:38:35.354388 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e94d355-e332-4b75-b12e-21a5ddde8cff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:38:35.374357 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.auth.core [None req-9e94d355-e332-4b75-b12e-21a5ddde8cff None None] MFA Rules not processed for user `2be990a66857410a87ffa7609aec4f7b`. Rule list: `[]` (Enabled: `True`). {{(pid=282899) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 08:38:35.375606 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.fernet_utils [None req-9e94d355-e332-4b75-b12e-21a5ddde8cff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=282899) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:38:35.411302 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG dbcounter [-] [282899] Writing DB stats keystone:SELECT=100 {{(pid=282899) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:38:35.459041 dv-cinder-851351-1-smb devstack@keystone.service[282899]: [pid: 282899|app: 0|req: 582/1163] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 08:38:35 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 08:38:35.482200 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4cb714-2631-4dfb-8b68-a5d1efbd6926 None None] Authenticating user token {{(pid=282898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:38:35.605907 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4cb714-2631-4dfb-8b68-a5d1efbd6926 None None] Validating token access rules against request {{(pid=282898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:38:35.645479 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23526b92-d694-4445-8abe-eb7055e4cbc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:38:35.646179 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23526b92-d694-4445-8abe-eb7055e4cbc8 None admin] REQUEST_METHOD: `GET` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:38:35.646512 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23526b92-d694-4445-8abe-eb7055e4cbc8 None admin] SCRIPT_NAME: `/identity` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:38:35.646835 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23526b92-d694-4445-8abe-eb7055e4cbc8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:38:35.668695 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG dbcounter [-] [282898] Writing DB stats keystone:SELECT=100 {{(pid=282898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:38:35.728425 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23526b92-d694-4445-8abe-eb7055e4cbc8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:38:35.730207 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23526b92-d694-4445-8abe-eb7055e4cbc8 None admin] RBAC: Authorization granted {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:38:35.843724 dv-cinder-851351-1-smb devstack@keystone.service[282898]: [pid: 282898|app: 0|req: 582/1164] 10.222.0.42 () {58 vars in 1282 bytes} [Thu Jul 28 08:38:35 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 362 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jul 28 08:38:35.853300 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e94d355-e332-4b75-b12e-21a5ddde8cff None None] Authenticating user token {{(pid=282899) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:38:35.967613 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e94d355-e332-4b75-b12e-21a5ddde8cff None None] Validating token access rules against request {{(pid=282899) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:38:36.006030 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12cf5fcb-5fe0-40d3-a55f-32c3aea28b3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282899) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:38:36.006751 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12cf5fcb-5fe0-40d3-a55f-32c3aea28b3f None admin] REQUEST_METHOD: `GET` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:38:36.007080 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12cf5fcb-5fe0-40d3-a55f-32c3aea28b3f None admin] SCRIPT_NAME: `/identity` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:38:36.007400 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12cf5fcb-5fe0-40d3-a55f-32c3aea28b3f None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:38:36.015546 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12cf5fcb-5fe0-40d3-a55f-32c3aea28b3f None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:38:36.017290 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12cf5fcb-5fe0-40d3-a55f-32c3aea28b3f None admin] RBAC: Authorization granted {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:38:36.030121 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application [None req-12cf5fcb-5fe0-40d3-a55f-32c3aea28b3f None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Jul 28 08:38:36.030121 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:38:36.030121 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Jul 28 08:38:36.030121 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Jul 28 08:38:36.030121 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 28 08:38:36.030121 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 28 08:38:36.030121 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 28 08:38:36.030121 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 28 08:38:36.030121 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. Jul 28 08:38:36.030121 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application Jul 28 08:38:36.030121 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 28 08:38:36.030121 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application Jul 28 08:38:36.030121 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:38:36.030121 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:38:36.030121 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:38:36.030121 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:38:36.030121 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:38:36.032463 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:38:36.032463 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:38:36.032463 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:38:36.032463 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:38:36.032463 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:38:36.032463 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:38:36.032463 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 08:38:36.032463 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 08:38:36.032463 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 08:38:36.032463 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 08:38:36.032463 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:38:36.032463 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:38:36.032463 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:38:36.032463 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:38:36.032463 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:38:36.032463 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:38:36.034530 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:38:36.034530 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application with Lock( Jul 28 08:38:36.034530 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:38:36.034530 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:38:36.034530 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:38:36.034530 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:38:36.034530 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:38:36.034530 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:38:36.034530 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:38:36.034530 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:38:36.034530 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Jul 28 08:38:36.034530 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 08:38:36.034530 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. Jul 28 08:38:36.034530 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application Jul 28 08:38:36.034530 dv-cinder-851351-1-smb devstack@keystone.service[282899]: [pid: 282899|app: 0|req: 583/1165] 10.222.0.42 () {56 vars in 1117 bytes} [Thu Jul 28 08:38:35 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:38:36.039373 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23526b92-d694-4445-8abe-eb7055e4cbc8 None admin] Authenticating user token {{(pid=282898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:38:36.095299 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG dbcounter [-] [282898] Writing DB stats keystone:SELECT=100 {{(pid=282898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:38:36.157529 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23526b92-d694-4445-8abe-eb7055e4cbc8 None admin] Validating token access rules against request {{(pid=282898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:38:36.199115 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cba0006-8dab-4881-8767-f0278f8e84a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:38:36.199868 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cba0006-8dab-4881-8767-f0278f8e84a1 None admin] REQUEST_METHOD: `GET` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:38:36.200205 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cba0006-8dab-4881-8767-f0278f8e84a1 None admin] SCRIPT_NAME: `/identity` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:38:36.200527 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cba0006-8dab-4881-8767-f0278f8e84a1 None admin] PATH_INFO: `/v3/domains` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:38:36.201363 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cba0006-8dab-4881-8767-f0278f8e84a1 None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=282898) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:38:36.201722 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cba0006-8dab-4881-8767-f0278f8e84a1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:38:36.203241 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cba0006-8dab-4881-8767-f0278f8e84a1 None admin] RBAC: Authorization granted {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:38:36.212542 dv-cinder-851351-1-smb devstack@keystone.service[282898]: [pid: 282898|app: 0|req: 583/1166] 10.222.0.42 () {56 vars in 1115 bytes} [Thu Jul 28 08:38:36 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:38:38.301725 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9192ec8d-c765-456f-b82e-8878985847f4 None None] REQUEST_METHOD: `GET` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:38:38.302391 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9192ec8d-c765-456f-b82e-8878985847f4 None None] SCRIPT_NAME: `/identity` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:38:38.302391 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9192ec8d-c765-456f-b82e-8878985847f4 None None] PATH_INFO: `/` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:38:38.303941 dv-cinder-851351-1-smb devstack@keystone.service[282899]: [pid: 282899|app: 0|req: 584/1167] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 08:38:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 08:38:38.311714 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f165fd4e-1edd-4987-9553-aa9b426d4a08 None None] REQUEST_METHOD: `POST` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:38:38.312363 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f165fd4e-1edd-4987-9553-aa9b426d4a08 None None] SCRIPT_NAME: `/identity` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:38:38.312363 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f165fd4e-1edd-4987-9553-aa9b426d4a08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:38:38.334094 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.auth.core [None req-f165fd4e-1edd-4987-9553-aa9b426d4a08 None None] MFA Rules not processed for user `2be990a66857410a87ffa7609aec4f7b`. Rule list: `[]` (Enabled: `True`). {{(pid=282898) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 08:38:38.335369 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.fernet_utils [None req-f165fd4e-1edd-4987-9553-aa9b426d4a08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=282898) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:38:38.417850 dv-cinder-851351-1-smb devstack@keystone.service[282898]: [pid: 282898|app: 0|req: 584/1168] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 08:38:38 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 08:38:38.445541 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9192ec8d-c765-456f-b82e-8878985847f4 None None] Authenticating user token {{(pid=282899) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:38:38.482069 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG dbcounter [-] [282899] Writing DB stats keystone:SELECT=100 {{(pid=282899) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:38:38.573060 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9192ec8d-c765-456f-b82e-8878985847f4 None None] Validating token access rules against request {{(pid=282899) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:38:38.615339 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27cbd6a-5b10-44f9-90d2-08ad16764fb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282899) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:38:38.616025 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27cbd6a-5b10-44f9-90d2-08ad16764fb1 None admin] REQUEST_METHOD: `POST` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:38:38.616314 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27cbd6a-5b10-44f9-90d2-08ad16764fb1 None admin] SCRIPT_NAME: `/identity` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:38:38.616595 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27cbd6a-5b10-44f9-90d2-08ad16764fb1 None admin] PATH_INFO: `/v3/domains` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:38:38.617408 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b27cbd6a-5b10-44f9-90d2-08ad16764fb1 None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:38:38.618847 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b27cbd6a-5b10-44f9-90d2-08ad16764fb1 None admin] RBAC: Authorization granted {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:38:38.639040 dv-cinder-851351-1-smb devstack@keystone.service[282899]: [pid: 282899|app: 0|req: 585/1169] 10.222.0.42 () {60 vars in 1138 bytes} [Thu Jul 28 08:38:38 2022] POST /identity/v3/domains => generated 267 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 08:38:40.757315 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d5bfab-50f3-4674-8fe3-7f6057331963 None None] REQUEST_METHOD: `GET` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:38:40.757936 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d5bfab-50f3-4674-8fe3-7f6057331963 None None] SCRIPT_NAME: `/identity` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:38:40.757936 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d5bfab-50f3-4674-8fe3-7f6057331963 None None] PATH_INFO: `/` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:38:40.759386 dv-cinder-851351-1-smb devstack@keystone.service[282898]: [pid: 282898|app: 0|req: 585/1170] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 08:38:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 08:38:40.765780 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8658a457-7c92-45ac-97b2-27fde9c32703 None None] REQUEST_METHOD: `POST` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:38:40.766391 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8658a457-7c92-45ac-97b2-27fde9c32703 None None] SCRIPT_NAME: `/identity` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:38:40.766522 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8658a457-7c92-45ac-97b2-27fde9c32703 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:38:40.786295 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.auth.core [None req-8658a457-7c92-45ac-97b2-27fde9c32703 None None] MFA Rules not processed for user `2be990a66857410a87ffa7609aec4f7b`. Rule list: `[]` (Enabled: `True`). {{(pid=282899) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 08:38:40.787542 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.fernet_utils [None req-8658a457-7c92-45ac-97b2-27fde9c32703 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=282899) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:38:40.867258 dv-cinder-851351-1-smb devstack@keystone.service[282899]: [pid: 282899|app: 0|req: 586/1171] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 08:38:40 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 28 08:38:40.891936 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d5bfab-50f3-4674-8fe3-7f6057331963 None None] Authenticating user token {{(pid=282898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:38:40.942562 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG dbcounter [-] [282898] Writing DB stats keystone:SELECT=100 {{(pid=282898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:38:41.007466 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d5bfab-50f3-4674-8fe3-7f6057331963 None None] Validating token access rules against request {{(pid=282898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:38:41.044950 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c0e4f87-10ff-4415-965a-43c432ec85df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:38:41.045640 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0e4f87-10ff-4415-965a-43c432ec85df None admin] REQUEST_METHOD: `GET` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:38:41.045966 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0e4f87-10ff-4415-965a-43c432ec85df None admin] SCRIPT_NAME: `/identity` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:38:41.046279 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0e4f87-10ff-4415-965a-43c432ec85df None admin] PATH_INFO: `/v3/domains/5f1c048ad59742a88670a1fe4be18634` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:38:41.058058 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c0e4f87-10ff-4415-965a-43c432ec85df None admin] RBAC: Authorizing `identity:get_domain(domain_id=5f1c048ad59742a88670a1fe4be18634)` {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:38:41.059601 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c0e4f87-10ff-4415-965a-43c432ec85df None admin] RBAC: Authorization granted {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:38:41.061413 dv-cinder-851351-1-smb devstack@keystone.service[282898]: [pid: 282898|app: 0|req: 586/1172] 10.222.0.42 () {56 vars in 1183 bytes} [Thu Jul 28 08:38:40 2022] GET /identity/v3/domains/5f1c048ad59742a88670a1fe4be18634 => generated 267 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:38:41.068018 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8658a457-7c92-45ac-97b2-27fde9c32703 None None] Authenticating user token {{(pid=282899) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:38:41.088710 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG dbcounter [-] [282899] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=282899) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:38:41.179924 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8658a457-7c92-45ac-97b2-27fde9c32703 None None] Validating token access rules against request {{(pid=282899) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:38:41.218130 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783ee894-0e6a-443d-96f3-ddab8cdbbc4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282899) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:38:41.218784 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783ee894-0e6a-443d-96f3-ddab8cdbbc4a None admin] REQUEST_METHOD: `POST` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:38:41.219071 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783ee894-0e6a-443d-96f3-ddab8cdbbc4a None admin] SCRIPT_NAME: `/identity` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:38:41.219355 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783ee894-0e6a-443d-96f3-ddab8cdbbc4a None admin] PATH_INFO: `/v3/projects` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:38:41.220066 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-783ee894-0e6a-443d-96f3-ddab8cdbbc4a None admin] RBAC: Authorizing `identity:create_project()` {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:38:41.221585 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-783ee894-0e6a-443d-96f3-ddab8cdbbc4a None admin] RBAC: Authorization granted {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:38:41.252088 dv-cinder-851351-1-smb devstack@keystone.service[282899]: [pid: 282899|app: 0|req: 587/1173] 10.222.0.42 () {60 vars in 1141 bytes} [Thu Jul 28 08:38:41 2022] POST /identity/v3/projects => generated 361 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 08:38:43.360962 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e38fd80-a346-4684-a8de-91fdcdd2587b None None] REQUEST_METHOD: `GET` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:38:43.361600 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e38fd80-a346-4684-a8de-91fdcdd2587b None None] SCRIPT_NAME: `/identity` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:38:43.361925 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e38fd80-a346-4684-a8de-91fdcdd2587b None None] PATH_INFO: `/` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:38:43.363627 dv-cinder-851351-1-smb devstack@keystone.service[282898]: [pid: 282898|app: 0|req: 587/1174] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 08:38:43 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 08:38:43.369668 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2edade41-2a7f-4246-8cb9-651e3dbeb04d None None] REQUEST_METHOD: `POST` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:38:43.370204 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2edade41-2a7f-4246-8cb9-651e3dbeb04d None None] SCRIPT_NAME: `/identity` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:38:43.370204 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2edade41-2a7f-4246-8cb9-651e3dbeb04d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:38:43.389519 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.auth.core [None req-2edade41-2a7f-4246-8cb9-651e3dbeb04d None None] MFA Rules not processed for user `2be990a66857410a87ffa7609aec4f7b`. Rule list: `[]` (Enabled: `True`). {{(pid=282899) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 08:38:43.390803 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.fernet_utils [None req-2edade41-2a7f-4246-8cb9-651e3dbeb04d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=282899) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:38:43.457713 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG dbcounter [-] [282899] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=282899) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:38:43.464312 dv-cinder-851351-1-smb devstack@keystone.service[282899]: [pid: 282899|app: 0|req: 588/1175] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 08:38:43 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 08:38:43.488928 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e38fd80-a346-4684-a8de-91fdcdd2587b None None] Authenticating user token {{(pid=282898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:38:43.615245 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e38fd80-a346-4684-a8de-91fdcdd2587b None None] Validating token access rules against request {{(pid=282898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:38:43.617094 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG dbcounter [-] [282898] Writing DB stats keystone:SELECT=100 {{(pid=282898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:38:43.658593 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e00afb-0feb-4b8c-8502-63049e03616e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:38:43.659280 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e00afb-0feb-4b8c-8502-63049e03616e None admin] REQUEST_METHOD: `GET` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:38:43.659568 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e00afb-0feb-4b8c-8502-63049e03616e None admin] SCRIPT_NAME: `/identity` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:38:43.659844 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e00afb-0feb-4b8c-8502-63049e03616e None admin] PATH_INFO: `/v3/domains/5f1c048ad59742a88670a1fe4be18634` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:38:43.661191 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02e00afb-0feb-4b8c-8502-63049e03616e None admin] RBAC: Authorizing `identity:get_domain(domain_id=5f1c048ad59742a88670a1fe4be18634)` {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:38:43.662691 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02e00afb-0feb-4b8c-8502-63049e03616e None admin] RBAC: Authorization granted {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:38:43.664413 dv-cinder-851351-1-smb devstack@keystone.service[282898]: [pid: 282898|app: 0|req: 588/1176] 10.222.0.42 () {56 vars in 1183 bytes} [Thu Jul 28 08:38:43 2022] GET /identity/v3/domains/5f1c048ad59742a88670a1fe4be18634 => generated 267 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:38:43.671231 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2edade41-2a7f-4246-8cb9-651e3dbeb04d None None] Authenticating user token {{(pid=282899) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:38:43.788090 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2edade41-2a7f-4246-8cb9-651e3dbeb04d None None] Validating token access rules against request {{(pid=282899) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:38:43.827898 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a147133c-a665-415e-ba42-576bf29a1bce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282899) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:38:43.828587 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a147133c-a665-415e-ba42-576bf29a1bce None admin] REQUEST_METHOD: `POST` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:38:43.829248 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a147133c-a665-415e-ba42-576bf29a1bce None admin] SCRIPT_NAME: `/identity` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:38:43.829533 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a147133c-a665-415e-ba42-576bf29a1bce None admin] PATH_INFO: `/v3/users` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:38:43.830297 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a147133c-a665-415e-ba42-576bf29a1bce None admin] RBAC: Authorizing `identity:create_user()` {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:38:43.831765 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a147133c-a665-415e-ba42-576bf29a1bce None admin] RBAC: Authorization granted {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:38:43.854358 dv-cinder-851351-1-smb devstack@keystone.service[282899]: [pid: 282899|app: 0|req: 589/1177] 10.222.0.42 () {60 vars in 1132 bytes} [Thu Jul 28 08:38:43 2022] POST /identity/v3/users => generated 311 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 08:38:45.957648 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb90184d-bfd2-4b1f-a299-2000ed0845c6 None None] REQUEST_METHOD: `GET` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:38:45.958334 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb90184d-bfd2-4b1f-a299-2000ed0845c6 None None] SCRIPT_NAME: `/identity` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:38:45.958334 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb90184d-bfd2-4b1f-a299-2000ed0845c6 None None] PATH_INFO: `/` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:38:45.959590 dv-cinder-851351-1-smb devstack@keystone.service[282898]: [pid: 282898|app: 0|req: 589/1178] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 08:38:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 28 08:38:45.966149 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9293f3d0-7e2c-471a-b281-b9d2440f52b9 None None] REQUEST_METHOD: `POST` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:38:45.966821 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9293f3d0-7e2c-471a-b281-b9d2440f52b9 None None] SCRIPT_NAME: `/identity` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:38:45.966821 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9293f3d0-7e2c-471a-b281-b9d2440f52b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:38:45.986646 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.auth.core [None req-9293f3d0-7e2c-471a-b281-b9d2440f52b9 None None] MFA Rules not processed for user `2be990a66857410a87ffa7609aec4f7b`. Rule list: `[]` (Enabled: `True`). {{(pid=282899) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 08:38:45.987885 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.fernet_utils [None req-9293f3d0-7e2c-471a-b281-b9d2440f52b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=282899) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:38:46.043320 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG dbcounter [-] [282899] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=282899) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:38:46.062998 dv-cinder-851351-1-smb devstack@keystone.service[282899]: [pid: 282899|app: 0|req: 590/1179] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 08:38:45 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 08:38:46.100049 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb90184d-bfd2-4b1f-a299-2000ed0845c6 None None] Authenticating user token {{(pid=282898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:38:46.210257 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb90184d-bfd2-4b1f-a299-2000ed0845c6 None None] Validating token access rules against request {{(pid=282898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:38:46.247092 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3fe1a3-5b8a-4226-9bac-47ffffc7a15a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:38:46.247754 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3fe1a3-5b8a-4226-9bac-47ffffc7a15a None admin] REQUEST_METHOD: `GET` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:38:46.248044 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3fe1a3-5b8a-4226-9bac-47ffffc7a15a None admin] SCRIPT_NAME: `/identity` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:38:46.248320 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3fe1a3-5b8a-4226-9bac-47ffffc7a15a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:38:46.260194 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed3fe1a3-5b8a-4226-9bac-47ffffc7a15a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 08:38:46.265256 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application [None req-ed3fe1a3-5b8a-4226-9bac-47ffffc7a15a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 08:38:46.265256 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:38:46.265256 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:38:46.265256 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:38:46.265256 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:38:46.265256 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:38:46.265256 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:38:46.265256 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:38:46.265256 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:38:46.265256 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:38:46.265256 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:38:46.265256 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:38:46.265256 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 08:38:46.265256 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 08:38:46.265256 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 08:38:46.265256 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 08:38:46.267043 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 08:38:46.267043 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 08:38:46.267043 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 08:38:46.267043 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 08:38:46.267043 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:38:46.267043 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:38:46.267043 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:38:46.267043 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:38:46.267043 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:38:46.267043 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:38:46.267043 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:38:46.267043 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application with Lock( Jul 28 08:38:46.267043 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:38:46.267043 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:38:46.267043 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:38:46.267043 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:38:46.268059 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:38:46.268059 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:38:46.268059 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:38:46.268059 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:38:46.268059 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 08:38:46.268059 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 08:38:46.268059 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 08:38:46.268059 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 08:38:46.268059 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 08:38:46.268059 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 08:38:46.268059 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 08:38:46.268059 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application Jul 28 08:38:46.268059 dv-cinder-851351-1-smb devstack@keystone.service[282898]: [pid: 282898|app: 0|req: 590/1180] 10.222.0.42 () {56 vars in 1096 bytes} [Thu Jul 28 08:38:46 2022] GET /identity/v3/roles/admin => generated 83 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:38:46.276656 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9293f3d0-7e2c-471a-b281-b9d2440f52b9 None None] Authenticating user token {{(pid=282899) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:38:46.383666 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9293f3d0-7e2c-471a-b281-b9d2440f52b9 None None] Validating token access rules against request {{(pid=282899) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:38:46.420462 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42335e68-87a6-447a-b750-311156fb8d8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282899) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:38:46.421166 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42335e68-87a6-447a-b750-311156fb8d8c None admin] REQUEST_METHOD: `GET` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:38:46.421456 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42335e68-87a6-447a-b750-311156fb8d8c None admin] SCRIPT_NAME: `/identity` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:38:46.421704 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42335e68-87a6-447a-b750-311156fb8d8c None admin] PATH_INFO: `/v3/roles` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:38:46.422581 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42335e68-87a6-447a-b750-311156fb8d8c None admin] RBAC: Adding query filter params (name=admin) {{(pid=282899) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:38:46.422888 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42335e68-87a6-447a-b750-311156fb8d8c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:38:46.424303 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42335e68-87a6-447a-b750-311156fb8d8c None admin] RBAC: Authorization granted {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:38:46.433577 dv-cinder-851351-1-smb devstack@keystone.service[282899]: [pid: 282899|app: 0|req: 591/1181] 10.222.0.42 () {56 vars in 1099 bytes} [Thu Jul 28 08:38:46 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:38:46.439873 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3fe1a3-5b8a-4226-9bac-47ffffc7a15a None admin] Authenticating user token {{(pid=282898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:38:46.474645 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG dbcounter [-] [282898] Writing DB stats keystone:SELECT=100 {{(pid=282898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:38:46.550406 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3fe1a3-5b8a-4226-9bac-47ffffc7a15a None admin] Validating token access rules against request {{(pid=282898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:38:46.587177 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f076dd-8e48-4f62-b3a0-c487f956f7e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:38:46.587852 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f076dd-8e48-4f62-b3a0-c487f956f7e1 None admin] REQUEST_METHOD: `GET` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:38:46.588150 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f076dd-8e48-4f62-b3a0-c487f956f7e1 None admin] SCRIPT_NAME: `/identity` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:38:46.588431 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f076dd-8e48-4f62-b3a0-c487f956f7e1 None admin] PATH_INFO: `/v3/users/16192398cda4415eb615f62ae695899e` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:38:46.604149 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68f076dd-8e48-4f62-b3a0-c487f956f7e1 None admin] RBAC: Authorizing `identity:get_user(user_id=16192398cda4415eb615f62ae695899e)` {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:38:46.605688 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68f076dd-8e48-4f62-b3a0-c487f956f7e1 None admin] RBAC: Authorization granted {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:38:46.607472 dv-cinder-851351-1-smb devstack@keystone.service[282898]: [pid: 282898|app: 0|req: 591/1182] 10.222.0.42 () {56 vars in 1177 bytes} [Thu Jul 28 08:38:46 2022] GET /identity/v3/users/16192398cda4415eb615f62ae695899e => generated 311 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:38:46.617448 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42335e68-87a6-447a-b750-311156fb8d8c None admin] Authenticating user token {{(pid=282899) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:38:46.705192 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG dbcounter [-] [282899] Writing DB stats keystone:SELECT=100 {{(pid=282899) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:38:46.765194 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42335e68-87a6-447a-b750-311156fb8d8c None admin] Validating token access rules against request {{(pid=282899) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:38:46.813778 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e750dfbb-7f97-483d-80a2-b7bb64e32895 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282899) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:38:46.814421 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e750dfbb-7f97-483d-80a2-b7bb64e32895 None admin] REQUEST_METHOD: `GET` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:38:46.814702 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e750dfbb-7f97-483d-80a2-b7bb64e32895 None admin] SCRIPT_NAME: `/identity` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:38:46.814983 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e750dfbb-7f97-483d-80a2-b7bb64e32895 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:38:46.890675 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e750dfbb-7f97-483d-80a2-b7bb64e32895 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:38:46.892187 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e750dfbb-7f97-483d-80a2-b7bb64e32895 None admin] RBAC: Authorization granted {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:38:46.941253 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG dbcounter [-] [282899] Writing DB stats keystone:SELECT=100 {{(pid=282899) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:38:46.997952 dv-cinder-851351-1-smb devstack@keystone.service[282899]: [pid: 282899|app: 0|req: 592/1183] 10.222.0.42 () {58 vars in 1282 bytes} [Thu Jul 28 08:38:46 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 382 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 28 08:38:47.004780 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f076dd-8e48-4f62-b3a0-c487f956f7e1 None admin] Authenticating user token {{(pid=282898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:38:47.138564 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG dbcounter [-] [282898] Writing DB stats keystone:SELECT=100 {{(pid=282898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:38:47.154000 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f076dd-8e48-4f62-b3a0-c487f956f7e1 None admin] Validating token access rules against request {{(pid=282898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:38:47.190071 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3609f2-d552-4af4-8920-91bf431f508e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:38:47.190723 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3609f2-d552-4af4-8920-91bf431f508e None admin] REQUEST_METHOD: `GET` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:38:47.191005 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3609f2-d552-4af4-8920-91bf431f508e None admin] SCRIPT_NAME: `/identity` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:38:47.191281 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3609f2-d552-4af4-8920-91bf431f508e None admin] PATH_INFO: `/v3/projects/8a945a8540ab4d9fb8cabc030d0a5fc0` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:38:47.192532 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a3609f2-d552-4af4-8920-91bf431f508e None admin] RBAC: Authorizing `identity:get_project(project_id=8a945a8540ab4d9fb8cabc030d0a5fc0)` {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:38:47.194042 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a3609f2-d552-4af4-8920-91bf431f508e None admin] RBAC: Authorization granted {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:38:47.195780 dv-cinder-851351-1-smb devstack@keystone.service[282898]: [pid: 282898|app: 0|req: 592/1184] 10.222.0.42 () {56 vars in 1186 bytes} [Thu Jul 28 08:38:47 2022] GET /identity/v3/projects/8a945a8540ab4d9fb8cabc030d0a5fc0 => generated 361 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:38:47.202338 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e750dfbb-7f97-483d-80a2-b7bb64e32895 None admin] Authenticating user token {{(pid=282899) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:38:47.314231 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e750dfbb-7f97-483d-80a2-b7bb64e32895 None admin] Validating token access rules against request {{(pid=282899) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:38:47.351010 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9e5022-dcf6-4875-8b61-5303467c1313 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282899) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:38:47.351657 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9e5022-dcf6-4875-8b61-5303467c1313 None admin] REQUEST_METHOD: `GET` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:38:47.351941 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9e5022-dcf6-4875-8b61-5303467c1313 None admin] SCRIPT_NAME: `/identity` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:38:47.352214 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9e5022-dcf6-4875-8b61-5303467c1313 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:38:47.353050 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad9e5022-dcf6-4875-8b61-5303467c1313 None admin] RBAC: Adding query filter params (role.id=a0e2a00bf94d40f38629d6b5293e3aee, scope.project.id=8a945a8540ab4d9fb8cabc030d0a5fc0, user.id=16192398cda4415eb615f62ae695899e) {{(pid=282899) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:38:47.353364 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad9e5022-dcf6-4875-8b61-5303467c1313 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:38:47.354824 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad9e5022-dcf6-4875-8b61-5303467c1313 None admin] RBAC: Authorization granted {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:38:47.361120 dv-cinder-851351-1-smb devstack@keystone.service[282899]: [pid: 282899|app: 0|req: 593/1185] 10.222.0.42 () {56 vars in 1374 bytes} [Thu Jul 28 08:38:47 2022] GET /identity/v3/role_assignments?user.id=16192398cda4415eb615f62ae695899e&scope.project.id=8a945a8540ab4d9fb8cabc030d0a5fc0&role.id=a0e2a00bf94d40f38629d6b5293e3aee => generated 259 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:38:49.414984 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301ec287-9447-4adc-9d10-6499430b649b None None] REQUEST_METHOD: `GET` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:38:49.415629 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301ec287-9447-4adc-9d10-6499430b649b None None] SCRIPT_NAME: `/identity` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:38:49.415629 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301ec287-9447-4adc-9d10-6499430b649b None None] PATH_INFO: `/` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:38:49.416958 dv-cinder-851351-1-smb devstack@keystone.service[282898]: [pid: 282898|app: 0|req: 593/1186] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 08:38:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 08:38:49.425374 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e891c3b-a114-4186-9805-d615b6c92b4e None None] REQUEST_METHOD: `POST` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:38:49.426221 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e891c3b-a114-4186-9805-d615b6c92b4e None None] SCRIPT_NAME: `/identity` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:38:49.426221 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e891c3b-a114-4186-9805-d615b6c92b4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:38:49.446070 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.auth.core [None req-4e891c3b-a114-4186-9805-d615b6c92b4e None None] MFA Rules not processed for user `2be990a66857410a87ffa7609aec4f7b`. Rule list: `[]` (Enabled: `True`). {{(pid=282899) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 08:38:49.447346 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.fernet_utils [None req-4e891c3b-a114-4186-9805-d615b6c92b4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=282899) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:38:49.456851 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG dbcounter [-] [282899] Writing DB stats keystone:SELECT=100 {{(pid=282899) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:38:49.532098 dv-cinder-851351-1-smb devstack@keystone.service[282899]: [pid: 282899|app: 0|req: 594/1187] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 08:38:49 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 08:38:49.554829 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-301ec287-9447-4adc-9d10-6499430b649b None None] Authenticating user token {{(pid=282898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:38:49.666673 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-301ec287-9447-4adc-9d10-6499430b649b None None] Validating token access rules against request {{(pid=282898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:38:49.703472 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ae3639-0d51-4ce2-80bc-3eb7c25eccdc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:38:49.704471 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ae3639-0d51-4ce2-80bc-3eb7c25eccdc None admin] REQUEST_METHOD: `GET` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:38:49.704789 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ae3639-0d51-4ce2-80bc-3eb7c25eccdc None admin] SCRIPT_NAME: `/identity` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:38:49.705067 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ae3639-0d51-4ce2-80bc-3eb7c25eccdc None admin] PATH_INFO: `/v3/roles/admin` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:38:49.715962 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47ae3639-0d51-4ce2-80bc-3eb7c25eccdc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 08:38:49.721016 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application [None req-47ae3639-0d51-4ce2-80bc-3eb7c25eccdc None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 08:38:49.721016 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:38:49.721016 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:38:49.721016 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:38:49.721016 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:38:49.721016 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:38:49.721016 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:38:49.721016 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:38:49.721016 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:38:49.721016 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:38:49.721016 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:38:49.721016 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:38:49.721016 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 08:38:49.721016 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 08:38:49.721016 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 08:38:49.721016 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 08:38:49.723029 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 08:38:49.723029 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 08:38:49.723029 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 08:38:49.723029 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 08:38:49.723029 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:38:49.723029 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:38:49.723029 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:38:49.723029 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:38:49.723029 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:38:49.723029 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:38:49.723029 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:38:49.723029 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application with Lock( Jul 28 08:38:49.723029 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:38:49.723029 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:38:49.723029 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:38:49.723029 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:38:49.725441 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:38:49.725441 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:38:49.725441 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:38:49.725441 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:38:49.725441 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 08:38:49.725441 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 08:38:49.725441 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 08:38:49.725441 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 08:38:49.725441 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 08:38:49.725441 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 08:38:49.725441 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 08:38:49.725441 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application Jul 28 08:38:49.725441 dv-cinder-851351-1-smb devstack@keystone.service[282898]: [pid: 282898|app: 0|req: 594/1188] 10.222.0.42 () {56 vars in 1096 bytes} [Thu Jul 28 08:38:49 2022] GET /identity/v3/roles/admin => generated 83 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:38:49.730598 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e891c3b-a114-4186-9805-d615b6c92b4e None None] Authenticating user token {{(pid=282899) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:38:49.839884 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e891c3b-a114-4186-9805-d615b6c92b4e None None] Validating token access rules against request {{(pid=282899) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:38:49.876990 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee3b407c-9e56-4cd0-84b7-277882200993 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282899) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:38:49.877628 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3b407c-9e56-4cd0-84b7-277882200993 None admin] REQUEST_METHOD: `GET` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:38:49.877913 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3b407c-9e56-4cd0-84b7-277882200993 None admin] SCRIPT_NAME: `/identity` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:38:49.878197 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3b407c-9e56-4cd0-84b7-277882200993 None admin] PATH_INFO: `/v3/roles` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:38:49.878962 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee3b407c-9e56-4cd0-84b7-277882200993 None admin] RBAC: Adding query filter params (name=admin) {{(pid=282899) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:38:49.879277 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee3b407c-9e56-4cd0-84b7-277882200993 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:38:49.880704 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee3b407c-9e56-4cd0-84b7-277882200993 None admin] RBAC: Authorization granted {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:38:49.889984 dv-cinder-851351-1-smb devstack@keystone.service[282899]: [pid: 282899|app: 0|req: 595/1189] 10.222.0.42 () {56 vars in 1099 bytes} [Thu Jul 28 08:38:49 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 08:38:49.896285 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ae3639-0d51-4ce2-80bc-3eb7c25eccdc None admin] Authenticating user token {{(pid=282898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:38:49.917854 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG dbcounter [-] [282898] Writing DB stats keystone:SELECT=100 {{(pid=282898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:38:50.014678 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ae3639-0d51-4ce2-80bc-3eb7c25eccdc None admin] Validating token access rules against request {{(pid=282898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:38:50.057830 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175950e0-ad3f-4394-9426-258678c2d0b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:38:50.058477 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175950e0-ad3f-4394-9426-258678c2d0b0 None admin] REQUEST_METHOD: `GET` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:38:50.058758 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175950e0-ad3f-4394-9426-258678c2d0b0 None admin] SCRIPT_NAME: `/identity` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:38:50.059012 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175950e0-ad3f-4394-9426-258678c2d0b0 None admin] PATH_INFO: `/v3/users/16192398cda4415eb615f62ae695899e` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:38:50.060248 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-175950e0-ad3f-4394-9426-258678c2d0b0 None admin] RBAC: Authorizing `identity:get_user(user_id=16192398cda4415eb615f62ae695899e)` {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:38:50.061736 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-175950e0-ad3f-4394-9426-258678c2d0b0 None admin] RBAC: Authorization granted {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:38:50.063485 dv-cinder-851351-1-smb devstack@keystone.service[282898]: [pid: 282898|app: 0|req: 595/1190] 10.222.0.42 () {56 vars in 1177 bytes} [Thu Jul 28 08:38:49 2022] GET /identity/v3/users/16192398cda4415eb615f62ae695899e => generated 311 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:38:50.069847 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee3b407c-9e56-4cd0-84b7-277882200993 None admin] Authenticating user token {{(pid=282899) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:38:50.074229 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG dbcounter [-] [282899] Writing DB stats keystone:SELECT=100 {{(pid=282899) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:38:50.181015 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee3b407c-9e56-4cd0-84b7-277882200993 None admin] Validating token access rules against request {{(pid=282899) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:38:50.219604 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e7aef8-4274-43d1-b99e-8135285c2021 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282899) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:38:50.220309 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e7aef8-4274-43d1-b99e-8135285c2021 None admin] REQUEST_METHOD: `GET` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:38:50.220573 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e7aef8-4274-43d1-b99e-8135285c2021 None admin] SCRIPT_NAME: `/identity` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:38:50.220882 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e7aef8-4274-43d1-b99e-8135285c2021 None admin] PATH_INFO: `/v3/projects/8a945a8540ab4d9fb8cabc030d0a5fc0` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:38:50.222203 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e7aef8-4274-43d1-b99e-8135285c2021 None admin] RBAC: Authorizing `identity:get_project(project_id=8a945a8540ab4d9fb8cabc030d0a5fc0)` {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:38:50.223709 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e7aef8-4274-43d1-b99e-8135285c2021 None admin] RBAC: Authorization granted {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:38:50.225540 dv-cinder-851351-1-smb devstack@keystone.service[282899]: [pid: 282899|app: 0|req: 596/1191] 10.222.0.42 () {56 vars in 1186 bytes} [Thu Jul 28 08:38:50 2022] GET /identity/v3/projects/8a945a8540ab4d9fb8cabc030d0a5fc0 => generated 361 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:38:50.232146 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175950e0-ad3f-4394-9426-258678c2d0b0 None admin] Authenticating user token {{(pid=282898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:38:50.330289 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG dbcounter [-] [282898] Writing DB stats keystone:SELECT=100 {{(pid=282898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:38:50.349176 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175950e0-ad3f-4394-9426-258678c2d0b0 None admin] Validating token access rules against request {{(pid=282898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:38:50.402913 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d8e9c5-65cb-466a-b426-065dad3e561a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:38:50.404090 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d8e9c5-65cb-466a-b426-065dad3e561a None admin] REQUEST_METHOD: `PUT` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:38:50.404580 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d8e9c5-65cb-466a-b426-065dad3e561a None admin] SCRIPT_NAME: `/identity` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:38:50.405129 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d8e9c5-65cb-466a-b426-065dad3e561a None admin] PATH_INFO: `/v3/projects/8a945a8540ab4d9fb8cabc030d0a5fc0/users/16192398cda4415eb615f62ae695899e/roles/a0e2a00bf94d40f38629d6b5293e3aee` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:38:50.408785 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d8e9c5-65cb-466a-b426-065dad3e561a None admin] RBAC: Authorizing `identity:create_grant(project_id=8a945a8540ab4d9fb8cabc030d0a5fc0, user_id=16192398cda4415eb615f62ae695899e, role_id=a0e2a00bf94d40f38629d6b5293e3aee)` {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:38:50.411533 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d8e9c5-65cb-466a-b426-065dad3e561a None admin] RBAC: Authorization granted {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:38:50.435358 dv-cinder-851351-1-smb devstack@keystone.service[282898]: [pid: 282898|app: 0|req: 596/1192] 10.222.0.42 () {58 vars in 1439 bytes} [Thu Jul 28 08:38:50 2022] PUT /identity/v3/projects/8a945a8540ab4d9fb8cabc030d0a5fc0/users/16192398cda4415eb615f62ae695899e/roles/a0e2a00bf94d40f38629d6b5293e3aee => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 08:38:52.484742 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35695608-8879-4581-8f90-cc3865293538 None None] REQUEST_METHOD: `GET` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:38:52.485423 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35695608-8879-4581-8f90-cc3865293538 None None] SCRIPT_NAME: `/identity` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:38:52.485737 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35695608-8879-4581-8f90-cc3865293538 None None] PATH_INFO: `/` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:38:52.488193 dv-cinder-851351-1-smb devstack@keystone.service[282899]: [pid: 282899|app: 0|req: 597/1193] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 08:38:52 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 08:38:52.494325 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e13e68-85e7-45eb-bd15-bcf8bcc28aa0 None None] REQUEST_METHOD: `POST` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:38:52.494919 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e13e68-85e7-45eb-bd15-bcf8bcc28aa0 None None] SCRIPT_NAME: `/identity` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:38:52.494919 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e13e68-85e7-45eb-bd15-bcf8bcc28aa0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:38:52.514802 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.auth.core [None req-d9e13e68-85e7-45eb-bd15-bcf8bcc28aa0 None None] MFA Rules not processed for user `2be990a66857410a87ffa7609aec4f7b`. Rule list: `[]` (Enabled: `True`). {{(pid=282898) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 08:38:52.516146 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.fernet_utils [None req-d9e13e68-85e7-45eb-bd15-bcf8bcc28aa0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=282898) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:38:52.592162 dv-cinder-851351-1-smb devstack@keystone.service[282898]: [pid: 282898|app: 0|req: 597/1194] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 08:38:52 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 08:38:52.615719 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35695608-8879-4581-8f90-cc3865293538 None None] Authenticating user token {{(pid=282899) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:38:52.695280 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG dbcounter [-] [282899] Writing DB stats keystone:SELECT=100 {{(pid=282899) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:38:52.738033 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35695608-8879-4581-8f90-cc3865293538 None None] Validating token access rules against request {{(pid=282899) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:38:52.776323 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3afb2168-0d27-4db3-ab47-3932e803c550 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282899) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:38:52.777016 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afb2168-0d27-4db3-ab47-3932e803c550 None admin] REQUEST_METHOD: `GET` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:38:52.777307 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afb2168-0d27-4db3-ab47-3932e803c550 None admin] SCRIPT_NAME: `/identity` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:38:52.777524 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afb2168-0d27-4db3-ab47-3932e803c550 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:38:52.790738 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3afb2168-0d27-4db3-ab47-3932e803c550 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 08:38:52.795779 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application [None req-3afb2168-0d27-4db3-ab47-3932e803c550 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 08:38:52.795779 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:38:52.795779 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:38:52.795779 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:38:52.795779 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:38:52.795779 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:38:52.795779 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:38:52.795779 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:38:52.795779 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:38:52.795779 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:38:52.795779 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:38:52.795779 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:38:52.795779 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 08:38:52.795779 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 08:38:52.795779 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 08:38:52.795779 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 08:38:52.798059 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 08:38:52.798059 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 08:38:52.798059 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 08:38:52.798059 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 08:38:52.798059 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:38:52.798059 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:38:52.798059 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:38:52.798059 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:38:52.798059 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:38:52.798059 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:38:52.798059 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:38:52.798059 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application with Lock( Jul 28 08:38:52.798059 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:38:52.798059 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:38:52.798059 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:38:52.798059 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:38:52.800165 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:38:52.800165 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:38:52.800165 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:38:52.800165 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:38:52.800165 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 08:38:52.800165 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 08:38:52.800165 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 08:38:52.800165 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 08:38:52.800165 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 08:38:52.800165 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 08:38:52.800165 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 08:38:52.800165 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application Jul 28 08:38:52.800165 dv-cinder-851351-1-smb devstack@keystone.service[282899]: [pid: 282899|app: 0|req: 598/1195] 10.222.0.42 () {56 vars in 1096 bytes} [Thu Jul 28 08:38:52 2022] GET /identity/v3/roles/admin => generated 83 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:38:52.803968 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e13e68-85e7-45eb-bd15-bcf8bcc28aa0 None None] Authenticating user token {{(pid=282898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:38:52.891074 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG dbcounter [-] [282898] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=282898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:38:52.919648 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e13e68-85e7-45eb-bd15-bcf8bcc28aa0 None None] Validating token access rules against request {{(pid=282898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:38:52.965997 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fced7e1b-0a91-4f20-a649-34c89e18da7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:38:52.966691 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fced7e1b-0a91-4f20-a649-34c89e18da7d None admin] REQUEST_METHOD: `GET` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:38:52.967048 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fced7e1b-0a91-4f20-a649-34c89e18da7d None admin] SCRIPT_NAME: `/identity` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:38:52.967446 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fced7e1b-0a91-4f20-a649-34c89e18da7d None admin] PATH_INFO: `/v3/roles` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:38:52.968310 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fced7e1b-0a91-4f20-a649-34c89e18da7d None admin] RBAC: Adding query filter params (name=admin) {{(pid=282898) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:38:52.968755 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fced7e1b-0a91-4f20-a649-34c89e18da7d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:38:52.970212 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fced7e1b-0a91-4f20-a649-34c89e18da7d None admin] RBAC: Authorization granted {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:38:52.979514 dv-cinder-851351-1-smb devstack@keystone.service[282898]: [pid: 282898|app: 0|req: 598/1196] 10.222.0.42 () {56 vars in 1099 bytes} [Thu Jul 28 08:38:52 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 08:38:52.985741 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3afb2168-0d27-4db3-ab47-3932e803c550 None admin] Authenticating user token {{(pid=282899) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:38:53.098293 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3afb2168-0d27-4db3-ab47-3932e803c550 None admin] Validating token access rules against request {{(pid=282899) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:38:53.133363 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG dbcounter [-] [282899] Writing DB stats keystone:SELECT=100 {{(pid=282899) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:38:53.140231 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e5fb135-8ed1-4cc6-ba33-352d8fe1a873 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282899) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:38:53.140970 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5fb135-8ed1-4cc6-ba33-352d8fe1a873 None admin] REQUEST_METHOD: `GET` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:38:53.141254 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5fb135-8ed1-4cc6-ba33-352d8fe1a873 None admin] SCRIPT_NAME: `/identity` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:38:53.141534 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5fb135-8ed1-4cc6-ba33-352d8fe1a873 None admin] PATH_INFO: `/v3/users/16192398cda4415eb615f62ae695899e` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:38:53.142865 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e5fb135-8ed1-4cc6-ba33-352d8fe1a873 None admin] RBAC: Authorizing `identity:get_user(user_id=16192398cda4415eb615f62ae695899e)` {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:38:53.144420 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e5fb135-8ed1-4cc6-ba33-352d8fe1a873 None admin] RBAC: Authorization granted {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:38:53.146270 dv-cinder-851351-1-smb devstack@keystone.service[282899]: [pid: 282899|app: 0|req: 599/1197] 10.222.0.42 () {56 vars in 1177 bytes} [Thu Jul 28 08:38:52 2022] GET /identity/v3/users/16192398cda4415eb615f62ae695899e => generated 311 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:38:53.152468 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fced7e1b-0a91-4f20-a649-34c89e18da7d None admin] Authenticating user token {{(pid=282898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:38:53.328684 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fced7e1b-0a91-4f20-a649-34c89e18da7d None admin] Validating token access rules against request {{(pid=282898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:38:53.393816 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81281720-8152-428e-83a0-9658f62c5f5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:38:53.394762 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81281720-8152-428e-83a0-9658f62c5f5c None admin] REQUEST_METHOD: `GET` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:38:53.395239 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81281720-8152-428e-83a0-9658f62c5f5c None admin] SCRIPT_NAME: `/identity` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:38:53.395725 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81281720-8152-428e-83a0-9658f62c5f5c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:38:53.402578 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG dbcounter [-] [282898] Writing DB stats keystone:SELECT=100 {{(pid=282898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:38:53.479929 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81281720-8152-428e-83a0-9658f62c5f5c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:38:53.481446 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81281720-8152-428e-83a0-9658f62c5f5c None admin] RBAC: Authorization granted {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:38:53.592930 dv-cinder-851351-1-smb devstack@keystone.service[282898]: [pid: 282898|app: 0|req: 599/1198] 10.222.0.42 () {58 vars in 1282 bytes} [Thu Jul 28 08:38:53 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 441 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 28 08:38:53.602542 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e5fb135-8ed1-4cc6-ba33-352d8fe1a873 None admin] Authenticating user token {{(pid=282899) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:38:53.716466 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e5fb135-8ed1-4cc6-ba33-352d8fe1a873 None admin] Validating token access rules against request {{(pid=282899) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:38:53.765424 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e813fe93-a473-4a87-a1b2-464774c1d8dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282899) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:38:53.766114 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e813fe93-a473-4a87-a1b2-464774c1d8dc None admin] REQUEST_METHOD: `GET` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:38:53.766399 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e813fe93-a473-4a87-a1b2-464774c1d8dc None admin] SCRIPT_NAME: `/identity` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:38:53.766679 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e813fe93-a473-4a87-a1b2-464774c1d8dc None admin] PATH_INFO: `/v3/projects/8a945a8540ab4d9fb8cabc030d0a5fc0` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:38:53.767939 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e813fe93-a473-4a87-a1b2-464774c1d8dc None admin] RBAC: Authorizing `identity:get_project(project_id=8a945a8540ab4d9fb8cabc030d0a5fc0)` {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:38:53.769466 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e813fe93-a473-4a87-a1b2-464774c1d8dc None admin] RBAC: Authorization granted {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:38:53.771271 dv-cinder-851351-1-smb devstack@keystone.service[282899]: [pid: 282899|app: 0|req: 600/1199] 10.222.0.42 () {56 vars in 1186 bytes} [Thu Jul 28 08:38:53 2022] GET /identity/v3/projects/8a945a8540ab4d9fb8cabc030d0a5fc0 => generated 361 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:38:53.778130 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81281720-8152-428e-83a0-9658f62c5f5c None admin] Authenticating user token {{(pid=282898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:38:53.820993 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG dbcounter [-] [282898] Writing DB stats keystone:SELECT=100 {{(pid=282898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:38:53.925479 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81281720-8152-428e-83a0-9658f62c5f5c None admin] Validating token access rules against request {{(pid=282898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:38:53.964854 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3218c160-ec3a-4a58-b918-ada14f4a290b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:38:53.965566 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3218c160-ec3a-4a58-b918-ada14f4a290b None admin] REQUEST_METHOD: `GET` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:38:53.965900 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3218c160-ec3a-4a58-b918-ada14f4a290b None admin] SCRIPT_NAME: `/identity` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:38:53.966226 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3218c160-ec3a-4a58-b918-ada14f4a290b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:38:53.967132 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3218c160-ec3a-4a58-b918-ada14f4a290b None admin] RBAC: Adding query filter params (role.id=a0e2a00bf94d40f38629d6b5293e3aee, scope.project.id=8a945a8540ab4d9fb8cabc030d0a5fc0, user.id=16192398cda4415eb615f62ae695899e) {{(pid=282898) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:38:53.967459 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3218c160-ec3a-4a58-b918-ada14f4a290b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:38:53.969121 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3218c160-ec3a-4a58-b918-ada14f4a290b None admin] RBAC: Authorization granted {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:38:53.976212 dv-cinder-851351-1-smb devstack@keystone.service[282898]: [pid: 282898|app: 0|req: 600/1200] 10.222.0.42 () {56 vars in 1374 bytes} [Thu Jul 28 08:38:53 2022] GET /identity/v3/role_assignments?user.id=16192398cda4415eb615f62ae695899e&scope.project.id=8a945a8540ab4d9fb8cabc030d0a5fc0&role.id=a0e2a00bf94d40f38629d6b5293e3aee => generated 608 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 08:39:03.760312 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG dbcounter [-] [282899] Writing DB stats keystone:SELECT=66 {{(pid=282899) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:39:03.972923 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG dbcounter [-] [282898] Writing DB stats keystone:SELECT=50 {{(pid=282898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:39:52.131115 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5034641-7990-490b-b817-6059f8a1e50e None None] REQUEST_METHOD: `GET` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:39:52.132203 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5034641-7990-490b-b817-6059f8a1e50e None None] SCRIPT_NAME: `/identity` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:39:52.132203 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5034641-7990-490b-b817-6059f8a1e50e None None] PATH_INFO: `/` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:39:52.134494 dv-cinder-851351-1-smb devstack@keystone.service[282899]: [pid: 282899|app: 0|req: 601/1201] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 08:39:52 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 08:39:52.143587 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1b1476-bea3-4470-bdd6-11f17921ec22 None None] REQUEST_METHOD: `POST` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:39:52.144186 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1b1476-bea3-4470-bdd6-11f17921ec22 None None] SCRIPT_NAME: `/identity` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:39:52.144554 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1b1476-bea3-4470-bdd6-11f17921ec22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:39:52.168295 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.auth.core [None req-0d1b1476-bea3-4470-bdd6-11f17921ec22 None None] MFA Rules not processed for user `2be990a66857410a87ffa7609aec4f7b`. Rule list: `[]` (Enabled: `True`). {{(pid=282898) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 08:39:52.169815 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.fernet_utils [None req-0d1b1476-bea3-4470-bdd6-11f17921ec22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=282898) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:39:52.284698 dv-cinder-851351-1-smb devstack@keystone.service[282898]: [pid: 282898|app: 0|req: 601/1202] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 08:39:52 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 08:39:52.302037 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5034641-7990-490b-b817-6059f8a1e50e None None] Authenticating user token {{(pid=282899) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:39:52.505613 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5034641-7990-490b-b817-6059f8a1e50e None None] Validating token access rules against request {{(pid=282899) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:39:52.571783 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208fbd81-0133-4005-98a0-a808fa383c50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282899) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:39:52.573207 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208fbd81-0133-4005-98a0-a808fa383c50 None admin] REQUEST_METHOD: `GET` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:39:52.573728 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208fbd81-0133-4005-98a0-a808fa383c50 None admin] SCRIPT_NAME: `/identity` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:39:52.574205 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208fbd81-0133-4005-98a0-a808fa383c50 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:39:52.591617 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-208fbd81-0133-4005-98a0-a808fa383c50 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:39:52.594100 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-208fbd81-0133-4005-98a0-a808fa383c50 None admin] RBAC: Authorization granted {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:39:52.615664 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application [None req-208fbd81-0133-4005-98a0-a808fa383c50 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 08:39:52.615664 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:39:52.615664 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:39:52.615664 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:39:52.615664 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:39:52.615664 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:39:52.615664 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:39:52.615664 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:39:52.615664 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:39:52.615664 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:39:52.615664 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:39:52.615664 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:39:52.615664 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 08:39:52.615664 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 08:39:52.615664 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 08:39:52.617929 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 08:39:52.617929 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:39:52.617929 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:39:52.617929 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:39:52.617929 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:39:52.617929 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:39:52.617929 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:39:52.617929 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:39:52.617929 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application with Lock( Jul 28 08:39:52.617929 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:39:52.617929 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:39:52.617929 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:39:52.617929 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:39:52.617929 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:39:52.617929 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:39:52.617929 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:39:52.617929 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:39:52.620221 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 08:39:52.620221 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 08:39:52.620221 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 08:39:52.620221 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application Jul 28 08:39:52.620221 dv-cinder-851351-1-smb devstack@keystone.service[282899]: [pid: 282899|app: 0|req: 602/1203] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 08:39:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 316 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:39:52.626245 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1b1476-bea3-4470-bdd6-11f17921ec22 None None] Authenticating user token {{(pid=282898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:39:52.812699 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1b1476-bea3-4470-bdd6-11f17921ec22 None None] Validating token access rules against request {{(pid=282898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:39:52.867546 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG dbcounter [-] [282898] Writing DB stats keystone:SELECT=100 {{(pid=282898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:39:52.881250 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7f9437-3588-46c5-9ce3-3e6f75c52332 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:39:52.882513 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7f9437-3588-46c5-9ce3-3e6f75c52332 None admin] REQUEST_METHOD: `GET` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:39:52.883103 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7f9437-3588-46c5-9ce3-3e6f75c52332 None admin] SCRIPT_NAME: `/identity` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:39:52.883649 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7f9437-3588-46c5-9ce3-3e6f75c52332 None admin] PATH_INFO: `/v3/domains` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:39:52.885172 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c7f9437-3588-46c5-9ce3-3e6f75c52332 None admin] RBAC: Adding query filter params (name=Default) {{(pid=282898) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:39:52.885753 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c7f9437-3588-46c5-9ce3-3e6f75c52332 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:39:52.888964 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c7f9437-3588-46c5-9ce3-3e6f75c52332 None admin] RBAC: Authorization granted {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:39:52.919188 dv-cinder-851351-1-smb devstack@keystone.service[282898]: [pid: 282898|app: 0|req: 602/1204] 10.222.0.42 () {56 vars in 1109 bytes} [Thu Jul 28 08:39:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 289 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:39:52.920733 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208fbd81-0133-4005-98a0-a808fa383c50 None admin] Authenticating user token {{(pid=282899) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:39:53.026407 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG dbcounter [-] [282899] Writing DB stats keystone:SELECT=100 {{(pid=282899) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:39:53.112646 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208fbd81-0133-4005-98a0-a808fa383c50 None admin] Validating token access rules against request {{(pid=282899) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:39:53.165860 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9d9857-426a-4cd6-8cc1-8fc26f18f41b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282899) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:39:53.166976 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9d9857-426a-4cd6-8cc1-8fc26f18f41b None admin] REQUEST_METHOD: `POST` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:39:53.166976 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9d9857-426a-4cd6-8cc1-8fc26f18f41b None admin] SCRIPT_NAME: `/identity` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:39:53.167281 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9d9857-426a-4cd6-8cc1-8fc26f18f41b None admin] PATH_INFO: `/v3/users` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:39:53.167723 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa9d9857-426a-4cd6-8cc1-8fc26f18f41b None admin] RBAC: Authorizing `identity:create_user()` {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:39:53.169275 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa9d9857-426a-4cd6-8cc1-8fc26f18f41b None admin] RBAC: Authorization granted {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:39:53.204970 dv-cinder-851351-1-smb devstack@keystone.service[282899]: [pid: 282899|app: 0|req: 603/1205] 10.222.0.42 () {60 vars in 1132 bytes} [Thu Jul 28 08:39:52 2022] POST /identity/v3/users => generated 251 bytes in 285 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 08:39:55.952990 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff27086-a3da-4c29-9f96-1f3ff8f03e7d None None] REQUEST_METHOD: `GET` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:39:55.955019 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff27086-a3da-4c29-9f96-1f3ff8f03e7d None None] SCRIPT_NAME: `/identity` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:39:55.955724 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff27086-a3da-4c29-9f96-1f3ff8f03e7d None None] PATH_INFO: `/` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:39:55.958826 dv-cinder-851351-1-smb devstack@keystone.service[282898]: [pid: 282898|app: 0|req: 603/1206] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 08:39:55 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 08:39:55.967315 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8760d6bc-8af0-4ee0-9efe-e57581222080 None None] REQUEST_METHOD: `POST` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:39:55.968232 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8760d6bc-8af0-4ee0-9efe-e57581222080 None None] SCRIPT_NAME: `/identity` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:39:55.968232 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8760d6bc-8af0-4ee0-9efe-e57581222080 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:39:56.005311 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.auth.core [None req-8760d6bc-8af0-4ee0-9efe-e57581222080 None None] MFA Rules not processed for user `2be990a66857410a87ffa7609aec4f7b`. Rule list: `[]` (Enabled: `True`). {{(pid=282899) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 08:39:56.007997 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.fernet_utils [None req-8760d6bc-8af0-4ee0-9efe-e57581222080 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=282899) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:39:56.142989 dv-cinder-851351-1-smb devstack@keystone.service[282899]: [pid: 282899|app: 0|req: 604/1207] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 08:39:55 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 08:39:56.186352 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff27086-a3da-4c29-9f96-1f3ff8f03e7d None None] Authenticating user token {{(pid=282898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:39:56.350224 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff27086-a3da-4c29-9f96-1f3ff8f03e7d None None] Validating token access rules against request {{(pid=282898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:39:56.415600 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-710e6d50-7bb5-424a-ac73-da405e9a1291 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:39:56.416325 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710e6d50-7bb5-424a-ac73-da405e9a1291 None admin] REQUEST_METHOD: `GET` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:39:56.416601 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710e6d50-7bb5-424a-ac73-da405e9a1291 None admin] SCRIPT_NAME: `/identity` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:39:56.416985 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710e6d50-7bb5-424a-ac73-da405e9a1291 None admin] PATH_INFO: `/v3/roles/service` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:39:56.434168 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-710e6d50-7bb5-424a-ac73-da405e9a1291 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 08:39:56.439466 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application [None req-710e6d50-7bb5-424a-ac73-da405e9a1291 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 28 08:39:56.439466 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:39:56.439466 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:39:56.439466 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:39:56.439466 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:39:56.439466 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:39:56.439466 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:39:56.439466 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:39:56.439466 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:39:56.439466 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:39:56.439466 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:39:56.439466 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:39:56.439466 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 08:39:56.439466 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 08:39:56.439466 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 08:39:56.439466 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 08:39:56.442014 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 08:39:56.442014 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 08:39:56.442014 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 08:39:56.442014 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 08:39:56.442014 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:39:56.442014 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:39:56.442014 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:39:56.442014 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:39:56.442014 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:39:56.442014 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:39:56.442014 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:39:56.442014 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application with Lock( Jul 28 08:39:56.442014 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:39:56.442014 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:39:56.442014 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:39:56.442014 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:39:56.448537 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:39:56.448537 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:39:56.448537 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:39:56.448537 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:39:56.448537 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 08:39:56.448537 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 08:39:56.448537 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 08:39:56.448537 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 08:39:56.448537 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 08:39:56.448537 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 08:39:56.448537 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 28 08:39:56.448537 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application Jul 28 08:39:56.448537 dv-cinder-851351-1-smb devstack@keystone.service[282898]: [pid: 282898|app: 0|req: 604/1208] 10.222.0.42 () {56 vars in 1102 bytes} [Thu Jul 28 08:39:56 2022] GET /identity/v3/roles/service => generated 85 bytes in 261 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:39:56.451063 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8760d6bc-8af0-4ee0-9efe-e57581222080 None None] Authenticating user token {{(pid=282899) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:39:56.504749 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG dbcounter [-] [282899] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=282899) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:39:56.595029 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8760d6bc-8af0-4ee0-9efe-e57581222080 None None] Validating token access rules against request {{(pid=282899) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:39:56.645477 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2209d055-924c-4dfd-8783-3f84a9102ab4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282899) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:39:56.646256 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2209d055-924c-4dfd-8783-3f84a9102ab4 None admin] REQUEST_METHOD: `GET` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:39:56.646537 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2209d055-924c-4dfd-8783-3f84a9102ab4 None admin] SCRIPT_NAME: `/identity` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:39:56.646718 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2209d055-924c-4dfd-8783-3f84a9102ab4 None admin] PATH_INFO: `/v3/roles` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:39:56.647436 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2209d055-924c-4dfd-8783-3f84a9102ab4 None admin] RBAC: Adding query filter params (name=service) {{(pid=282899) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:39:56.647748 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2209d055-924c-4dfd-8783-3f84a9102ab4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:39:56.649502 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2209d055-924c-4dfd-8783-3f84a9102ab4 None admin] RBAC: Authorization granted {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:39:56.660706 dv-cinder-851351-1-smb devstack@keystone.service[282899]: [pid: 282899|app: 0|req: 605/1209] 10.222.0.42 () {56 vars in 1103 bytes} [Thu Jul 28 08:39:56 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 08:39:56.667624 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-710e6d50-7bb5-424a-ac73-da405e9a1291 None admin] Authenticating user token {{(pid=282898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:39:56.747881 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG dbcounter [-] [282898] Writing DB stats keystone:SELECT=100 {{(pid=282898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:39:56.837020 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-710e6d50-7bb5-424a-ac73-da405e9a1291 None admin] Validating token access rules against request {{(pid=282898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:39:56.892622 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c39e9c-2fd9-4315-8164-6791b424f64c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:39:56.893654 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c39e9c-2fd9-4315-8164-6791b424f64c None admin] REQUEST_METHOD: `GET` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:39:56.894146 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c39e9c-2fd9-4315-8164-6791b424f64c None admin] SCRIPT_NAME: `/identity` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:39:56.894641 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c39e9c-2fd9-4315-8164-6791b424f64c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:39:56.912864 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c39e9c-2fd9-4315-8164-6791b424f64c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:39:56.914899 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c39e9c-2fd9-4315-8164-6791b424f64c None admin] RBAC: Authorization granted {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:39:56.932799 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application [None req-44c39e9c-2fd9-4315-8164-6791b424f64c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 08:39:56.932799 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:39:56.932799 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:39:56.932799 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:39:56.932799 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:39:56.932799 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:39:56.932799 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:39:56.932799 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:39:56.932799 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:39:56.932799 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:39:56.932799 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:39:56.932799 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:39:56.932799 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 08:39:56.932799 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 08:39:56.932799 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 08:39:56.941215 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 08:39:56.941215 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:39:56.941215 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:39:56.941215 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:39:56.941215 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:39:56.941215 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:39:56.941215 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:39:56.941215 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:39:56.941215 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application with Lock( Jul 28 08:39:56.941215 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:39:56.941215 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:39:56.941215 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:39:56.941215 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:39:56.941215 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:39:56.941215 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:39:56.941215 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:39:56.941215 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:39:56.943529 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 08:39:56.943529 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 08:39:56.943529 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 08:39:56.943529 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application Jul 28 08:39:56.943529 dv-cinder-851351-1-smb devstack@keystone.service[282898]: [pid: 282898|app: 0|req: 605/1210] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 08:39:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 267 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:39:56.946089 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2209d055-924c-4dfd-8783-3f84a9102ab4 None admin] Authenticating user token {{(pid=282899) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:39:57.096713 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG dbcounter [-] [282899] Writing DB stats keystone:SELECT=100 {{(pid=282899) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:39:57.101068 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2209d055-924c-4dfd-8783-3f84a9102ab4 None admin] Validating token access rules against request {{(pid=282899) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:39:57.153298 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122c9feb-cc4a-4dc1-a4b4-cf6116aeda33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282899) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:39:57.154352 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122c9feb-cc4a-4dc1-a4b4-cf6116aeda33 None admin] REQUEST_METHOD: `GET` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:39:57.154740 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122c9feb-cc4a-4dc1-a4b4-cf6116aeda33 None admin] SCRIPT_NAME: `/identity` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:39:57.155198 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122c9feb-cc4a-4dc1-a4b4-cf6116aeda33 None admin] PATH_INFO: `/v3/domains` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:39:57.156166 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-122c9feb-cc4a-4dc1-a4b4-cf6116aeda33 None admin] RBAC: Adding query filter params (name=Default) {{(pid=282899) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:39:57.156685 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-122c9feb-cc4a-4dc1-a4b4-cf6116aeda33 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:39:57.158739 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-122c9feb-cc4a-4dc1-a4b4-cf6116aeda33 None admin] RBAC: Authorization granted {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:39:57.178350 dv-cinder-851351-1-smb devstack@keystone.service[282899]: [pid: 282899|app: 0|req: 606/1211] 10.222.0.42 () {56 vars in 1109 bytes} [Thu Jul 28 08:39:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:39:57.185356 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c39e9c-2fd9-4315-8164-6791b424f64c None admin] Authenticating user token {{(pid=282898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:39:57.335009 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c39e9c-2fd9-4315-8164-6791b424f64c None admin] Validating token access rules against request {{(pid=282898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:39:57.337528 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG dbcounter [-] [282898] Writing DB stats keystone:SELECT=100 {{(pid=282898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:39:57.393859 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f9bb27-21da-4da0-8121-0b3510e347d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:39:57.394892 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f9bb27-21da-4da0-8121-0b3510e347d4 None admin] REQUEST_METHOD: `GET` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:39:57.395414 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f9bb27-21da-4da0-8121-0b3510e347d4 None admin] SCRIPT_NAME: `/identity` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:39:57.395913 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f9bb27-21da-4da0-8121-0b3510e347d4 None admin] PATH_INFO: `/v3/users/placement` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:39:57.409647 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f9bb27-21da-4da0-8121-0b3510e347d4 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:39:57.411749 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f9bb27-21da-4da0-8121-0b3510e347d4 None admin] RBAC: Authorization granted {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:39:57.427225 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application [None req-94f9bb27-21da-4da0-8121-0b3510e347d4 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 28 08:39:57.427225 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:39:57.427225 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:39:57.427225 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:39:57.427225 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:39:57.427225 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:39:57.427225 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:39:57.427225 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:39:57.427225 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:39:57.427225 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:39:57.427225 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:39:57.427225 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:39:57.427225 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 28 08:39:57.427225 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 28 08:39:57.427225 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 28 08:39:57.427225 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 28 08:39:57.428721 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:39:57.428721 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:39:57.428721 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 28 08:39:57.428721 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 08:39:57.428721 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 28 08:39:57.428721 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 08:39:57.428721 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:39:57.428721 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:39:57.428721 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:39:57.428721 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:39:57.428721 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:39:57.428721 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application with Lock( Jul 28 08:39:57.428721 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:39:57.428721 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:39:57.428721 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:39:57.428721 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:39:57.428721 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:39:57.428721 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:39:57.430153 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:39:57.430153 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:39:57.430153 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 28 08:39:57.430153 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 28 08:39:57.430153 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 28 08:39:57.430153 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 28 08:39:57.430153 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 28 08:39:57.430153 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 28 08:39:57.430153 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 28 08:39:57.430153 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application Jul 28 08:39:57.430846 dv-cinder-851351-1-smb devstack@keystone.service[282898]: [pid: 282898|app: 0|req: 606/1212] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 08:39:57 2022] GET /identity/v3/users/placement => generated 87 bytes in 246 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:39:57.440141 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122c9feb-cc4a-4dc1-a4b4-cf6116aeda33 None admin] Authenticating user token {{(pid=282899) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:39:57.588025 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122c9feb-cc4a-4dc1-a4b4-cf6116aeda33 None admin] Validating token access rules against request {{(pid=282899) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:39:57.633451 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a5babc-9f5a-4d04-8a49-1794afdb1724 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282899) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:39:57.634241 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a5babc-9f5a-4d04-8a49-1794afdb1724 None admin] REQUEST_METHOD: `GET` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:39:57.634592 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a5babc-9f5a-4d04-8a49-1794afdb1724 None admin] SCRIPT_NAME: `/identity` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:39:57.634984 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a5babc-9f5a-4d04-8a49-1794afdb1724 None admin] PATH_INFO: `/v3/users` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:39:57.636000 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a5babc-9f5a-4d04-8a49-1794afdb1724 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=282899) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:39:57.636514 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a5babc-9f5a-4d04-8a49-1794afdb1724 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:39:57.638351 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a5babc-9f5a-4d04-8a49-1794afdb1724 None admin] RBAC: Authorization granted {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:39:57.662712 dv-cinder-851351-1-smb devstack@keystone.service[282899]: [pid: 282899|app: 0|req: 607/1213] 10.222.0.42 () {56 vars in 1143 bytes} [Thu Jul 28 08:39:57 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:39:57.672380 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f9bb27-21da-4da0-8121-0b3510e347d4 None admin] Authenticating user token {{(pid=282898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:39:57.848060 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f9bb27-21da-4da0-8121-0b3510e347d4 None admin] Validating token access rules against request {{(pid=282898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:39:57.921962 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce58717-8460-4012-b310-1122a6dc08ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:39:57.923117 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce58717-8460-4012-b310-1122a6dc08ae None admin] REQUEST_METHOD: `GET` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:39:57.923645 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce58717-8460-4012-b310-1122a6dc08ae None admin] SCRIPT_NAME: `/identity` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:39:57.924181 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce58717-8460-4012-b310-1122a6dc08ae None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:39:57.994178 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG dbcounter [-] [282898] Writing DB stats keystone:SELECT=100 {{(pid=282898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:39:58.070636 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce58717-8460-4012-b310-1122a6dc08ae None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:39:58.072828 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce58717-8460-4012-b310-1122a6dc08ae None admin] RBAC: Authorization granted {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:39:58.243634 dv-cinder-851351-1-smb devstack@keystone.service[282898]: [pid: 282898|app: 0|req: 607/1214] 10.222.0.42 () {58 vars in 1282 bytes} [Thu Jul 28 08:39:57 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 572 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jul 28 08:39:58.250704 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a5babc-9f5a-4d04-8a49-1794afdb1724 None admin] Authenticating user token {{(pid=282899) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:39:58.279209 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG dbcounter [-] [282899] Writing DB stats keystone:SELECT=100 {{(pid=282899) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:39:58.421145 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a5babc-9f5a-4d04-8a49-1794afdb1724 None admin] Validating token access rules against request {{(pid=282899) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:39:58.484913 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce9afdb-4e16-4bc8-ad53-a060aad4f6f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282899) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:39:58.485999 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce9afdb-4e16-4bc8-ad53-a060aad4f6f2 None admin] REQUEST_METHOD: `GET` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:39:58.486433 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce9afdb-4e16-4bc8-ad53-a060aad4f6f2 None admin] SCRIPT_NAME: `/identity` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:39:58.486863 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce9afdb-4e16-4bc8-ad53-a060aad4f6f2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:39:58.505132 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce9afdb-4e16-4bc8-ad53-a060aad4f6f2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:39:58.507044 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce9afdb-4e16-4bc8-ad53-a060aad4f6f2 None admin] RBAC: Authorization granted {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:39:58.532629 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application [None req-dce9afdb-4e16-4bc8-ad53-a060aad4f6f2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 08:39:58.532629 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:39:58.532629 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:39:58.532629 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:39:58.532629 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:39:58.532629 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:39:58.532629 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:39:58.532629 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:39:58.532629 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:39:58.532629 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:39:58.532629 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:39:58.532629 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:39:58.532629 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 08:39:58.532629 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 08:39:58.532629 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 08:39:58.535033 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 08:39:58.535033 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:39:58.535033 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:39:58.535033 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:39:58.535033 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:39:58.535033 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:39:58.535033 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:39:58.535033 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:39:58.535033 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application with Lock( Jul 28 08:39:58.535033 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:39:58.535033 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:39:58.535033 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:39:58.535033 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:39:58.535033 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:39:58.535033 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:39:58.535033 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:39:58.535033 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:39:58.536337 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 08:39:58.536337 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 08:39:58.536337 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 08:39:58.536337 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application Jul 28 08:39:58.536337 dv-cinder-851351-1-smb devstack@keystone.service[282899]: [pid: 282899|app: 0|req: 608/1215] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 08:39:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 285 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 08:39:58.545111 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce58717-8460-4012-b310-1122a6dc08ae None admin] Authenticating user token {{(pid=282898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:39:58.643333 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG dbcounter [-] [282898] Writing DB stats keystone:SELECT=100 {{(pid=282898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:39:58.698617 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce58717-8460-4012-b310-1122a6dc08ae None admin] Validating token access rules against request {{(pid=282898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:39:58.747802 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94afae5-bf49-4b0e-8ee9-375fa6002cd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:39:58.748968 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94afae5-bf49-4b0e-8ee9-375fa6002cd9 None admin] REQUEST_METHOD: `GET` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:39:58.749292 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94afae5-bf49-4b0e-8ee9-375fa6002cd9 None admin] SCRIPT_NAME: `/identity` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:39:58.749643 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94afae5-bf49-4b0e-8ee9-375fa6002cd9 None admin] PATH_INFO: `/v3/domains` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:39:58.750690 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d94afae5-bf49-4b0e-8ee9-375fa6002cd9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=282898) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:39:58.751126 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d94afae5-bf49-4b0e-8ee9-375fa6002cd9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:39:58.753299 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d94afae5-bf49-4b0e-8ee9-375fa6002cd9 None admin] RBAC: Authorization granted {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:39:58.770598 dv-cinder-851351-1-smb devstack@keystone.service[282898]: [pid: 282898|app: 0|req: 608/1216] 10.222.0.42 () {56 vars in 1109 bytes} [Thu Jul 28 08:39:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:39:58.777221 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce9afdb-4e16-4bc8-ad53-a060aad4f6f2 None admin] Authenticating user token {{(pid=282899) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:39:58.872075 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG dbcounter [-] [282899] Writing DB stats keystone:SELECT=100 {{(pid=282899) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:39:58.919748 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce9afdb-4e16-4bc8-ad53-a060aad4f6f2 None admin] Validating token access rules against request {{(pid=282899) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:39:58.973283 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d03d34-fc5b-4a42-bf60-bec9550df9da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282899) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:39:58.974268 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d03d34-fc5b-4a42-bf60-bec9550df9da None admin] REQUEST_METHOD: `GET` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:39:58.974749 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d03d34-fc5b-4a42-bf60-bec9550df9da None admin] SCRIPT_NAME: `/identity` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:39:58.975101 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d03d34-fc5b-4a42-bf60-bec9550df9da None admin] PATH_INFO: `/v3/projects/service` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:39:58.984846 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75d03d34-fc5b-4a42-bf60-bec9550df9da None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:39:58.986979 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75d03d34-fc5b-4a42-bf60-bec9550df9da None admin] RBAC: Authorization granted {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:39:59.005858 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application [None req-75d03d34-fc5b-4a42-bf60-bec9550df9da None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 08:39:59.005858 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:39:59.005858 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:39:59.005858 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:39:59.005858 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:39:59.005858 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:39:59.005858 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:39:59.005858 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:39:59.005858 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:39:59.005858 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:39:59.005858 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:39:59.005858 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:39:59.005858 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 28 08:39:59.005858 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 28 08:39:59.005858 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 28 08:39:59.008173 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 28 08:39:59.008173 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:39:59.008173 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:39:59.008173 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:39:59.008173 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:39:59.008173 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:39:59.008173 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:39:59.008173 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:39:59.008173 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application with Lock( Jul 28 08:39:59.008173 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:39:59.008173 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:39:59.008173 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:39:59.008173 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:39:59.008173 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:39:59.008173 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:39:59.008173 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:39:59.008173 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:39:59.010566 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 28 08:39:59.010566 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 28 08:39:59.010566 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 28 08:39:59.010566 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 28 08:39:59.010566 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 28 08:39:59.010566 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 28 08:39:59.010566 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 08:39:59.010566 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application Jul 28 08:39:59.014938 dv-cinder-851351-1-smb devstack@keystone.service[282899]: [pid: 282899|app: 0|req: 609/1217] 10.222.0.42 () {56 vars in 1111 bytes} [Thu Jul 28 08:39:58 2022] GET /identity/v3/projects/service => generated 88 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:39:59.016790 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94afae5-bf49-4b0e-8ee9-375fa6002cd9 None admin] Authenticating user token {{(pid=282898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:39:59.165000 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94afae5-bf49-4b0e-8ee9-375fa6002cd9 None admin] Validating token access rules against request {{(pid=282898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:39:59.200036 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG dbcounter [-] [282898] Writing DB stats keystone:SELECT=100 {{(pid=282898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:39:59.227653 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c85e5d5d-7648-4d97-94d1-a077ed63bfc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:39:59.228236 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85e5d5d-7648-4d97-94d1-a077ed63bfc5 None admin] REQUEST_METHOD: `GET` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:39:59.228474 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85e5d5d-7648-4d97-94d1-a077ed63bfc5 None admin] SCRIPT_NAME: `/identity` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:39:59.228766 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85e5d5d-7648-4d97-94d1-a077ed63bfc5 None admin] PATH_INFO: `/v3/projects` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:39:59.229672 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c85e5d5d-7648-4d97-94d1-a077ed63bfc5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=282898) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:39:59.229979 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c85e5d5d-7648-4d97-94d1-a077ed63bfc5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:39:59.231492 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c85e5d5d-7648-4d97-94d1-a077ed63bfc5 None admin] RBAC: Authorization granted {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:39:59.247324 dv-cinder-851351-1-smb devstack@keystone.service[282898]: [pid: 282898|app: 0|req: 609/1218] 10.222.0.42 () {56 vars in 1148 bytes} [Thu Jul 28 08:39:59 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:39:59.254472 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d03d34-fc5b-4a42-bf60-bec9550df9da None admin] Authenticating user token {{(pid=282899) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:39:59.407842 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d03d34-fc5b-4a42-bf60-bec9550df9da None admin] Validating token access rules against request {{(pid=282899) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:39:59.450501 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG dbcounter [-] [282899] Writing DB stats keystone:SELECT=100 {{(pid=282899) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:39:59.460893 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a5bed2-ba9b-4d55-9672-e267548b0e44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282899) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:39:59.461678 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a5bed2-ba9b-4d55-9672-e267548b0e44 None admin] REQUEST_METHOD: `GET` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:39:59.462056 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a5bed2-ba9b-4d55-9672-e267548b0e44 None admin] SCRIPT_NAME: `/identity` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:39:59.462443 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a5bed2-ba9b-4d55-9672-e267548b0e44 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:39:59.463391 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20a5bed2-ba9b-4d55-9672-e267548b0e44 None admin] RBAC: Adding query filter params (role.id=aa4daecf3ff74fa1b7d53041a4659723, scope.project.id=5cde68cbfb9042dc9f36af3aacea2473, user.id=bba431c3832c4dd5bcd296d3247840c0) {{(pid=282899) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:39:59.463902 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20a5bed2-ba9b-4d55-9672-e267548b0e44 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:39:59.466551 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20a5bed2-ba9b-4d55-9672-e267548b0e44 None admin] RBAC: Authorization granted {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:39:59.479469 dv-cinder-851351-1-smb devstack@keystone.service[282899]: [pid: 282899|app: 0|req: 610/1219] 10.222.0.42 () {56 vars in 1374 bytes} [Thu Jul 28 08:39:59 2022] GET /identity/v3/role_assignments?user.id=bba431c3832c4dd5bcd296d3247840c0&scope.project.id=5cde68cbfb9042dc9f36af3aacea2473&role.id=aa4daecf3ff74fa1b7d53041a4659723 => generated 259 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:40:01.873493 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887b5855-fa99-4d38-b806-08300915ff98 None None] REQUEST_METHOD: `GET` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:40:01.874091 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887b5855-fa99-4d38-b806-08300915ff98 None None] SCRIPT_NAME: `/identity` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:40:01.874091 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887b5855-fa99-4d38-b806-08300915ff98 None None] PATH_INFO: `/` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:40:01.875605 dv-cinder-851351-1-smb devstack@keystone.service[282898]: [pid: 282898|app: 0|req: 610/1220] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 08:40:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 08:40:01.882642 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d36dbe-b287-4098-ab06-7f17bc09fdfc None None] REQUEST_METHOD: `POST` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:40:01.883520 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d36dbe-b287-4098-ab06-7f17bc09fdfc None None] SCRIPT_NAME: `/identity` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:40:01.883520 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d36dbe-b287-4098-ab06-7f17bc09fdfc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:40:01.908242 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.auth.core [None req-a3d36dbe-b287-4098-ab06-7f17bc09fdfc None None] MFA Rules not processed for user `2be990a66857410a87ffa7609aec4f7b`. Rule list: `[]` (Enabled: `True`). {{(pid=282899) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 08:40:01.910589 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.fernet_utils [None req-a3d36dbe-b287-4098-ab06-7f17bc09fdfc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=282899) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:40:02.017413 dv-cinder-851351-1-smb devstack@keystone.service[282899]: [pid: 282899|app: 0|req: 611/1221] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 08:40:01 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 08:40:02.042897 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887b5855-fa99-4d38-b806-08300915ff98 None None] Authenticating user token {{(pid=282898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:40:02.227026 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887b5855-fa99-4d38-b806-08300915ff98 None None] Validating token access rules against request {{(pid=282898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:40:02.275962 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69fd53c0-e938-45c6-a06a-e41f5897c610 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:40:02.276850 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69fd53c0-e938-45c6-a06a-e41f5897c610 None admin] REQUEST_METHOD: `GET` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:40:02.277243 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69fd53c0-e938-45c6-a06a-e41f5897c610 None admin] SCRIPT_NAME: `/identity` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:40:02.277624 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69fd53c0-e938-45c6-a06a-e41f5897c610 None admin] PATH_INFO: `/v3/roles/service` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:40:02.294318 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69fd53c0-e938-45c6-a06a-e41f5897c610 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 08:40:02.301981 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application [None req-69fd53c0-e938-45c6-a06a-e41f5897c610 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 28 08:40:02.301981 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:40:02.301981 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:40:02.301981 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:40:02.301981 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:40:02.301981 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:40:02.301981 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:40:02.301981 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:40:02.301981 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:40:02.301981 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:40:02.301981 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:40:02.301981 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:40:02.301981 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 08:40:02.301981 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 08:40:02.301981 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 08:40:02.301981 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 08:40:02.314043 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 08:40:02.314043 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 08:40:02.314043 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 08:40:02.314043 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 08:40:02.314043 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:40:02.314043 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:40:02.314043 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:40:02.314043 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:40:02.314043 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:40:02.314043 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:40:02.314043 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:40:02.314043 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application with Lock( Jul 28 08:40:02.314043 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:40:02.314043 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:40:02.314043 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:40:02.314043 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:40:02.316473 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:40:02.316473 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:40:02.316473 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:40:02.316473 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:40:02.316473 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 08:40:02.316473 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 08:40:02.316473 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 08:40:02.316473 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 08:40:02.316473 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 08:40:02.316473 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 08:40:02.316473 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 28 08:40:02.316473 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application Jul 28 08:40:02.316473 dv-cinder-851351-1-smb devstack@keystone.service[282898]: [pid: 282898|app: 0|req: 611/1222] 10.222.0.42 () {56 vars in 1102 bytes} [Thu Jul 28 08:40:02 2022] GET /identity/v3/roles/service => generated 85 bytes in 262 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:40:02.318108 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d36dbe-b287-4098-ab06-7f17bc09fdfc None None] Authenticating user token {{(pid=282899) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:40:02.456307 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d36dbe-b287-4098-ab06-7f17bc09fdfc None None] Validating token access rules against request {{(pid=282899) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:40:02.486614 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG dbcounter [-] [282899] Writing DB stats keystone:SELECT=100 {{(pid=282899) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:40:02.501347 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1cb5b67-fbf0-4ba6-b293-e2d2cd307527 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282899) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:40:02.502017 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1cb5b67-fbf0-4ba6-b293-e2d2cd307527 None admin] REQUEST_METHOD: `GET` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:40:02.502304 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1cb5b67-fbf0-4ba6-b293-e2d2cd307527 None admin] SCRIPT_NAME: `/identity` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:40:02.502583 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1cb5b67-fbf0-4ba6-b293-e2d2cd307527 None admin] PATH_INFO: `/v3/roles` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:40:02.503528 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1cb5b67-fbf0-4ba6-b293-e2d2cd307527 None admin] RBAC: Adding query filter params (name=service) {{(pid=282899) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:40:02.503876 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1cb5b67-fbf0-4ba6-b293-e2d2cd307527 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:40:02.505491 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1cb5b67-fbf0-4ba6-b293-e2d2cd307527 None admin] RBAC: Authorization granted {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:40:02.517153 dv-cinder-851351-1-smb devstack@keystone.service[282899]: [pid: 282899|app: 0|req: 612/1223] 10.222.0.42 () {56 vars in 1103 bytes} [Thu Jul 28 08:40:02 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:40:02.527840 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69fd53c0-e938-45c6-a06a-e41f5897c610 None admin] Authenticating user token {{(pid=282898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:40:02.593131 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG dbcounter [-] [282898] Writing DB stats keystone:SELECT=100 {{(pid=282898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:40:02.692925 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69fd53c0-e938-45c6-a06a-e41f5897c610 None admin] Validating token access rules against request {{(pid=282898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:40:02.745890 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d064496-4a94-4442-b60c-d53c3e78ccee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:40:02.746525 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d064496-4a94-4442-b60c-d53c3e78ccee None admin] REQUEST_METHOD: `GET` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:40:02.746951 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d064496-4a94-4442-b60c-d53c3e78ccee None admin] SCRIPT_NAME: `/identity` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:40:02.747239 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d064496-4a94-4442-b60c-d53c3e78ccee None admin] PATH_INFO: `/v3/domains/Default` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:40:02.762147 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d064496-4a94-4442-b60c-d53c3e78ccee None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:40:02.763793 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d064496-4a94-4442-b60c-d53c3e78ccee None admin] RBAC: Authorization granted {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:40:02.782952 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application [None req-1d064496-4a94-4442-b60c-d53c3e78ccee None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 08:40:02.782952 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:40:02.782952 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:40:02.782952 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:40:02.782952 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:40:02.782952 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:40:02.782952 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:40:02.782952 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:40:02.782952 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:40:02.782952 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:40:02.782952 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:40:02.782952 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:40:02.782952 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 08:40:02.782952 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 08:40:02.782952 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 08:40:02.790848 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 08:40:02.790848 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:40:02.790848 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:40:02.790848 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:40:02.790848 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:40:02.790848 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:40:02.790848 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:40:02.790848 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:40:02.790848 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application with Lock( Jul 28 08:40:02.790848 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:40:02.790848 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:40:02.790848 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:40:02.790848 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:40:02.790848 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:40:02.790848 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:40:02.790848 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:40:02.790848 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:40:02.792239 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 08:40:02.792239 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 08:40:02.792239 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 08:40:02.792239 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application Jul 28 08:40:02.792239 dv-cinder-851351-1-smb devstack@keystone.service[282898]: [pid: 282898|app: 0|req: 612/1224] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 08:40:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 258 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:40:02.794204 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1cb5b67-fbf0-4ba6-b293-e2d2cd307527 None admin] Authenticating user token {{(pid=282899) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:40:02.932929 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1cb5b67-fbf0-4ba6-b293-e2d2cd307527 None admin] Validating token access rules against request {{(pid=282899) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:40:02.978581 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2878958c-fe09-4817-90c3-b7e5fa2b629e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282899) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:40:02.979245 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2878958c-fe09-4817-90c3-b7e5fa2b629e None admin] REQUEST_METHOD: `GET` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:40:02.979531 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2878958c-fe09-4817-90c3-b7e5fa2b629e None admin] SCRIPT_NAME: `/identity` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:40:02.979918 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2878958c-fe09-4817-90c3-b7e5fa2b629e None admin] PATH_INFO: `/v3/domains` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:40:02.980657 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2878958c-fe09-4817-90c3-b7e5fa2b629e None admin] RBAC: Adding query filter params (name=Default) {{(pid=282899) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:40:02.981095 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2878958c-fe09-4817-90c3-b7e5fa2b629e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:40:02.984140 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2878958c-fe09-4817-90c3-b7e5fa2b629e None admin] RBAC: Authorization granted {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:40:03.008832 dv-cinder-851351-1-smb devstack@keystone.service[282899]: [pid: 282899|app: 0|req: 613/1225] 10.222.0.42 () {56 vars in 1109 bytes} [Thu Jul 28 08:40:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:40:03.011866 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d064496-4a94-4442-b60c-d53c3e78ccee None admin] Authenticating user token {{(pid=282898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:40:03.128454 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG dbcounter [-] [282898] Writing DB stats keystone:SELECT=100 {{(pid=282898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:40:03.143687 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d064496-4a94-4442-b60c-d53c3e78ccee None admin] Validating token access rules against request {{(pid=282898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:40:03.194591 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88cea5c8-fe22-43ab-bd71-a94101ac3207 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:40:03.195675 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88cea5c8-fe22-43ab-bd71-a94101ac3207 None admin] REQUEST_METHOD: `GET` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:40:03.196169 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88cea5c8-fe22-43ab-bd71-a94101ac3207 None admin] SCRIPT_NAME: `/identity` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:40:03.196656 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88cea5c8-fe22-43ab-bd71-a94101ac3207 None admin] PATH_INFO: `/v3/users/placement` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:40:03.211292 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88cea5c8-fe22-43ab-bd71-a94101ac3207 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:40:03.213960 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88cea5c8-fe22-43ab-bd71-a94101ac3207 None admin] RBAC: Authorization granted {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:40:03.228260 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application [None req-88cea5c8-fe22-43ab-bd71-a94101ac3207 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 28 08:40:03.228260 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:40:03.228260 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:40:03.228260 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:40:03.228260 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:40:03.228260 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:40:03.228260 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:40:03.228260 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:40:03.228260 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:40:03.228260 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:40:03.228260 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:40:03.228260 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:40:03.228260 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 28 08:40:03.228260 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 28 08:40:03.228260 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 28 08:40:03.228260 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 28 08:40:03.234940 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:40:03.234940 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:40:03.234940 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 28 08:40:03.234940 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 08:40:03.234940 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 28 08:40:03.234940 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 08:40:03.234940 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:40:03.234940 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:40:03.234940 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:40:03.234940 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:40:03.234940 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:40:03.234940 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application with Lock( Jul 28 08:40:03.234940 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:40:03.234940 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:40:03.234940 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:40:03.234940 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:40:03.234940 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:40:03.234940 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:40:03.236136 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:40:03.236136 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:40:03.236136 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 28 08:40:03.236136 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 28 08:40:03.236136 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 28 08:40:03.236136 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 28 08:40:03.236136 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 28 08:40:03.236136 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 28 08:40:03.236136 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 28 08:40:03.236136 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application Jul 28 08:40:03.236136 dv-cinder-851351-1-smb devstack@keystone.service[282898]: [pid: 282898|app: 0|req: 613/1226] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 08:40:03 2022] GET /identity/v3/users/placement => generated 87 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:40:03.236906 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2878958c-fe09-4817-90c3-b7e5fa2b629e None admin] Authenticating user token {{(pid=282899) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:40:03.293916 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG dbcounter [-] [282899] Writing DB stats keystone:SELECT=100 {{(pid=282899) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:40:03.359451 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2878958c-fe09-4817-90c3-b7e5fa2b629e None admin] Validating token access rules against request {{(pid=282899) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:40:03.408475 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e963ddd-1f67-4161-9e9a-edeebae81b90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282899) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:40:03.409500 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e963ddd-1f67-4161-9e9a-edeebae81b90 None admin] REQUEST_METHOD: `GET` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:40:03.409999 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e963ddd-1f67-4161-9e9a-edeebae81b90 None admin] SCRIPT_NAME: `/identity` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:40:03.410502 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e963ddd-1f67-4161-9e9a-edeebae81b90 None admin] PATH_INFO: `/v3/users` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:40:03.412049 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e963ddd-1f67-4161-9e9a-edeebae81b90 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=282899) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:40:03.414033 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e963ddd-1f67-4161-9e9a-edeebae81b90 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:40:03.415628 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e963ddd-1f67-4161-9e9a-edeebae81b90 None admin] RBAC: Authorization granted {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:40:03.447313 dv-cinder-851351-1-smb devstack@keystone.service[282899]: [pid: 282899|app: 0|req: 614/1227] 10.222.0.42 () {56 vars in 1143 bytes} [Thu Jul 28 08:40:03 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:40:03.455761 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88cea5c8-fe22-43ab-bd71-a94101ac3207 None admin] Authenticating user token {{(pid=282898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:40:03.588891 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88cea5c8-fe22-43ab-bd71-a94101ac3207 None admin] Validating token access rules against request {{(pid=282898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:40:03.629364 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e7356ce-26a2-426a-90ff-31f7be31c223 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:40:03.630025 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7356ce-26a2-426a-90ff-31f7be31c223 None admin] REQUEST_METHOD: `GET` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:40:03.630321 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7356ce-26a2-426a-90ff-31f7be31c223 None admin] SCRIPT_NAME: `/identity` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:40:03.630596 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7356ce-26a2-426a-90ff-31f7be31c223 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:40:03.645781 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e7356ce-26a2-426a-90ff-31f7be31c223 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:40:03.647621 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e7356ce-26a2-426a-90ff-31f7be31c223 None admin] RBAC: Authorization granted {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:40:03.665863 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application [None req-5e7356ce-26a2-426a-90ff-31f7be31c223 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 08:40:03.665863 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:40:03.665863 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:40:03.665863 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:40:03.665863 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:40:03.665863 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:40:03.665863 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:40:03.665863 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:40:03.665863 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:40:03.665863 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:40:03.665863 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:40:03.665863 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:40:03.665863 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 08:40:03.665863 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 08:40:03.665863 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 08:40:03.668215 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 08:40:03.668215 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:40:03.668215 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:40:03.668215 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:40:03.668215 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:40:03.668215 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:40:03.668215 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:40:03.668215 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:40:03.668215 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application with Lock( Jul 28 08:40:03.668215 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:40:03.668215 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:40:03.668215 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:40:03.668215 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:40:03.668215 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:40:03.668215 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:40:03.668215 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:40:03.668215 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:40:03.670547 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 08:40:03.670547 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 08:40:03.670547 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 08:40:03.670547 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application Jul 28 08:40:03.670547 dv-cinder-851351-1-smb devstack@keystone.service[282898]: [pid: 282898|app: 0|req: 614/1228] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 08:40:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:40:03.675641 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e963ddd-1f67-4161-9e9a-edeebae81b90 None admin] Authenticating user token {{(pid=282899) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:40:03.835686 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e963ddd-1f67-4161-9e9a-edeebae81b90 None admin] Validating token access rules against request {{(pid=282899) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:40:03.840453 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG dbcounter [-] [282899] Writing DB stats keystone:SELECT=100 {{(pid=282899) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:40:03.896123 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d014b2-d22d-42bd-a14f-cb0b806ea4a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282899) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:40:03.896844 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d014b2-d22d-42bd-a14f-cb0b806ea4a2 None admin] REQUEST_METHOD: `GET` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:40:03.897124 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d014b2-d22d-42bd-a14f-cb0b806ea4a2 None admin] SCRIPT_NAME: `/identity` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:40:03.897399 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d014b2-d22d-42bd-a14f-cb0b806ea4a2 None admin] PATH_INFO: `/v3/domains` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:40:03.898122 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d014b2-d22d-42bd-a14f-cb0b806ea4a2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=282899) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:40:03.898454 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d014b2-d22d-42bd-a14f-cb0b806ea4a2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:40:03.899851 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d014b2-d22d-42bd-a14f-cb0b806ea4a2 None admin] RBAC: Authorization granted {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:40:03.915577 dv-cinder-851351-1-smb devstack@keystone.service[282899]: [pid: 282899|app: 0|req: 615/1229] 10.222.0.42 () {56 vars in 1109 bytes} [Thu Jul 28 08:40:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 08:40:03.925896 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e7356ce-26a2-426a-90ff-31f7be31c223 None admin] Authenticating user token {{(pid=282898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:40:03.943682 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG dbcounter [-] [282898] Writing DB stats keystone:SELECT=100 {{(pid=282898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:40:04.110534 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e7356ce-26a2-426a-90ff-31f7be31c223 None admin] Validating token access rules against request {{(pid=282898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:40:04.166850 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c5a0d8-ebd1-4da6-a2a5-8a6ea3191480 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:40:04.167643 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c5a0d8-ebd1-4da6-a2a5-8a6ea3191480 None admin] REQUEST_METHOD: `GET` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:40:04.168035 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c5a0d8-ebd1-4da6-a2a5-8a6ea3191480 None admin] SCRIPT_NAME: `/identity` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:40:04.168413 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c5a0d8-ebd1-4da6-a2a5-8a6ea3191480 None admin] PATH_INFO: `/v3/projects/service` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:40:04.177340 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61c5a0d8-ebd1-4da6-a2a5-8a6ea3191480 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:40:04.179227 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61c5a0d8-ebd1-4da6-a2a5-8a6ea3191480 None admin] RBAC: Authorization granted {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:40:04.195011 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application [None req-61c5a0d8-ebd1-4da6-a2a5-8a6ea3191480 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 08:40:04.195011 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:40:04.195011 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:40:04.195011 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:40:04.195011 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:40:04.195011 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:40:04.195011 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:40:04.195011 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:40:04.195011 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:40:04.195011 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:40:04.195011 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:40:04.195011 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:40:04.195011 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 28 08:40:04.195011 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 28 08:40:04.195011 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 28 08:40:04.197134 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 28 08:40:04.197134 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:40:04.197134 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:40:04.197134 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:40:04.197134 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:40:04.197134 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:40:04.197134 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:40:04.197134 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:40:04.197134 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application with Lock( Jul 28 08:40:04.197134 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:40:04.197134 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:40:04.197134 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:40:04.197134 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:40:04.197134 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:40:04.197134 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:40:04.197134 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:40:04.197134 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:40:04.199438 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 28 08:40:04.199438 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 28 08:40:04.199438 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 28 08:40:04.199438 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 28 08:40:04.199438 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 28 08:40:04.199438 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 28 08:40:04.199438 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 08:40:04.199438 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application Jul 28 08:40:04.199438 dv-cinder-851351-1-smb devstack@keystone.service[282898]: [pid: 282898|app: 0|req: 615/1230] 10.222.0.42 () {56 vars in 1111 bytes} [Thu Jul 28 08:40:03 2022] GET /identity/v3/projects/service => generated 88 bytes in 272 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:40:04.206067 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d014b2-d22d-42bd-a14f-cb0b806ea4a2 None admin] Authenticating user token {{(pid=282899) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:40:04.361384 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d014b2-d22d-42bd-a14f-cb0b806ea4a2 None admin] Validating token access rules against request {{(pid=282899) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:40:04.418157 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a14e11f-eba1-4a94-9df5-69c79e27c664 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282899) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:40:04.419163 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a14e11f-eba1-4a94-9df5-69c79e27c664 None admin] REQUEST_METHOD: `GET` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:40:04.419480 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a14e11f-eba1-4a94-9df5-69c79e27c664 None admin] SCRIPT_NAME: `/identity` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:40:04.420064 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a14e11f-eba1-4a94-9df5-69c79e27c664 None admin] PATH_INFO: `/v3/projects` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:40:04.421159 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a14e11f-eba1-4a94-9df5-69c79e27c664 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=282899) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:40:04.421640 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a14e11f-eba1-4a94-9df5-69c79e27c664 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:40:04.423587 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a14e11f-eba1-4a94-9df5-69c79e27c664 None admin] RBAC: Authorization granted {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:40:04.441758 dv-cinder-851351-1-smb devstack@keystone.service[282899]: [pid: 282899|app: 0|req: 616/1231] 10.222.0.42 () {56 vars in 1148 bytes} [Thu Jul 28 08:40:04 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 08:40:04.449870 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c5a0d8-ebd1-4da6-a2a5-8a6ea3191480 None admin] Authenticating user token {{(pid=282898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:40:04.534076 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG dbcounter [-] [282898] Writing DB stats keystone:SELECT=100 {{(pid=282898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:40:04.587986 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c5a0d8-ebd1-4da6-a2a5-8a6ea3191480 None admin] Validating token access rules against request {{(pid=282898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:40:04.637114 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afba9b78-4852-457b-96c0-e524c9301e10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:40:04.637876 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afba9b78-4852-457b-96c0-e524c9301e10 None admin] REQUEST_METHOD: `PUT` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:40:04.638306 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afba9b78-4852-457b-96c0-e524c9301e10 None admin] SCRIPT_NAME: `/identity` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:40:04.638727 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afba9b78-4852-457b-96c0-e524c9301e10 None admin] PATH_INFO: `/v3/projects/5cde68cbfb9042dc9f36af3aacea2473/users/bba431c3832c4dd5bcd296d3247840c0/roles/aa4daecf3ff74fa1b7d53041a4659723` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:40:04.659364 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afba9b78-4852-457b-96c0-e524c9301e10 None admin] RBAC: Authorizing `identity:create_grant(project_id=5cde68cbfb9042dc9f36af3aacea2473, user_id=bba431c3832c4dd5bcd296d3247840c0, role_id=aa4daecf3ff74fa1b7d53041a4659723)` {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:40:04.661308 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afba9b78-4852-457b-96c0-e524c9301e10 None admin] RBAC: Authorization granted {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:40:04.679120 dv-cinder-851351-1-smb devstack@keystone.service[282898]: [pid: 282898|app: 0|req: 616/1232] 10.222.0.42 () {58 vars in 1439 bytes} [Thu Jul 28 08:40:04 2022] PUT /identity/v3/projects/5cde68cbfb9042dc9f36af3aacea2473/users/bba431c3832c4dd5bcd296d3247840c0/roles/aa4daecf3ff74fa1b7d53041a4659723 => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 08:40:06.799379 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386238e4-a501-43b2-b7c3-f7c05c46ffb5 None None] REQUEST_METHOD: `GET` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:40:06.800096 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386238e4-a501-43b2-b7c3-f7c05c46ffb5 None None] SCRIPT_NAME: `/identity` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:40:06.800096 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386238e4-a501-43b2-b7c3-f7c05c46ffb5 None None] PATH_INFO: `/` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:40:06.802115 dv-cinder-851351-1-smb devstack@keystone.service[282899]: [pid: 282899|app: 0|req: 617/1233] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 08:40:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 08:40:06.809546 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec605d49-9fbb-4fb6-93d6-fc1425dff236 None None] REQUEST_METHOD: `POST` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:40:06.810296 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec605d49-9fbb-4fb6-93d6-fc1425dff236 None None] SCRIPT_NAME: `/identity` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:40:06.810594 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec605d49-9fbb-4fb6-93d6-fc1425dff236 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:40:06.842553 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.auth.core [None req-ec605d49-9fbb-4fb6-93d6-fc1425dff236 None None] MFA Rules not processed for user `2be990a66857410a87ffa7609aec4f7b`. Rule list: `[]` (Enabled: `True`). {{(pid=282898) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 08:40:06.844739 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.fernet_utils [None req-ec605d49-9fbb-4fb6-93d6-fc1425dff236 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=282898) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:40:06.940013 dv-cinder-851351-1-smb devstack@keystone.service[282898]: [pid: 282898|app: 0|req: 617/1234] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 08:40:06 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 08:40:06.974475 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-386238e4-a501-43b2-b7c3-f7c05c46ffb5 None None] Authenticating user token {{(pid=282899) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:40:07.012147 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG dbcounter [-] [282899] Writing DB stats keystone:SELECT=100 {{(pid=282899) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:40:07.134250 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-386238e4-a501-43b2-b7c3-f7c05c46ffb5 None None] Validating token access rules against request {{(pid=282899) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:40:07.189950 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ee239d-61cc-4cde-a991-7cc889012aed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282899) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:40:07.191056 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ee239d-61cc-4cde-a991-7cc889012aed None admin] REQUEST_METHOD: `GET` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:40:07.191555 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ee239d-61cc-4cde-a991-7cc889012aed None admin] SCRIPT_NAME: `/identity` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:40:07.192042 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ee239d-61cc-4cde-a991-7cc889012aed None admin] PATH_INFO: `/v3/roles/service` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:40:07.209582 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97ee239d-61cc-4cde-a991-7cc889012aed None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 08:40:07.214986 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application [None req-97ee239d-61cc-4cde-a991-7cc889012aed None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 28 08:40:07.214986 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:40:07.214986 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:40:07.214986 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:40:07.214986 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:40:07.214986 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:40:07.214986 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:40:07.214986 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:40:07.214986 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:40:07.214986 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:40:07.214986 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:40:07.214986 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:40:07.214986 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 08:40:07.214986 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 08:40:07.214986 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 08:40:07.214986 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 08:40:07.217702 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 08:40:07.217702 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 08:40:07.217702 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 08:40:07.217702 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 08:40:07.217702 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:40:07.217702 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:40:07.217702 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:40:07.217702 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:40:07.217702 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:40:07.217702 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:40:07.217702 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:40:07.217702 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application with Lock( Jul 28 08:40:07.217702 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:40:07.217702 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:40:07.217702 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:40:07.217702 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:40:07.219983 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:40:07.219983 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:40:07.219983 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:40:07.219983 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:40:07.219983 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 08:40:07.219983 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 08:40:07.219983 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 08:40:07.219983 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 08:40:07.219983 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 08:40:07.219983 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 08:40:07.219983 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 28 08:40:07.219983 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application Jul 28 08:40:07.219983 dv-cinder-851351-1-smb devstack@keystone.service[282899]: [pid: 282899|app: 0|req: 618/1235] 10.222.0.42 () {56 vars in 1102 bytes} [Thu Jul 28 08:40:06 2022] GET /identity/v3/roles/service => generated 85 bytes in 243 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 08:40:07.224214 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec605d49-9fbb-4fb6-93d6-fc1425dff236 None None] Authenticating user token {{(pid=282898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:40:07.293014 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG dbcounter [-] [282898] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=282898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:40:07.382268 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec605d49-9fbb-4fb6-93d6-fc1425dff236 None None] Validating token access rules against request {{(pid=282898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:40:07.448871 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-404b0858-b5d3-445e-adaf-c6cbb5488408 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:40:07.449828 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404b0858-b5d3-445e-adaf-c6cbb5488408 None admin] REQUEST_METHOD: `GET` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:40:07.450282 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404b0858-b5d3-445e-adaf-c6cbb5488408 None admin] SCRIPT_NAME: `/identity` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:40:07.450741 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404b0858-b5d3-445e-adaf-c6cbb5488408 None admin] PATH_INFO: `/v3/roles` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:40:07.452221 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-404b0858-b5d3-445e-adaf-c6cbb5488408 None admin] RBAC: Adding query filter params (name=service) {{(pid=282898) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:40:07.452759 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-404b0858-b5d3-445e-adaf-c6cbb5488408 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:40:07.455779 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-404b0858-b5d3-445e-adaf-c6cbb5488408 None admin] RBAC: Authorization granted {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:40:07.467387 dv-cinder-851351-1-smb devstack@keystone.service[282898]: [pid: 282898|app: 0|req: 618/1236] 10.222.0.42 () {56 vars in 1103 bytes} [Thu Jul 28 08:40:07 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 08:40:07.477820 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ee239d-61cc-4cde-a991-7cc889012aed None admin] Authenticating user token {{(pid=282899) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:40:07.604307 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG dbcounter [-] [282899] Writing DB stats keystone:SELECT=100 {{(pid=282899) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:40:07.644506 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ee239d-61cc-4cde-a991-7cc889012aed None admin] Validating token access rules against request {{(pid=282899) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:40:07.709921 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247dd96f-bf0f-4b51-ba90-697afee0a511 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282899) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:40:07.711048 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247dd96f-bf0f-4b51-ba90-697afee0a511 None admin] REQUEST_METHOD: `GET` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:40:07.711587 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247dd96f-bf0f-4b51-ba90-697afee0a511 None admin] SCRIPT_NAME: `/identity` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:40:07.712175 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247dd96f-bf0f-4b51-ba90-697afee0a511 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:40:07.727897 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-247dd96f-bf0f-4b51-ba90-697afee0a511 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:40:07.729477 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-247dd96f-bf0f-4b51-ba90-697afee0a511 None admin] RBAC: Authorization granted {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:40:07.747924 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application [None req-247dd96f-bf0f-4b51-ba90-697afee0a511 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 08:40:07.747924 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:40:07.747924 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:40:07.747924 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:40:07.747924 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:40:07.747924 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:40:07.747924 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:40:07.747924 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:40:07.747924 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:40:07.747924 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:40:07.747924 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:40:07.747924 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:40:07.747924 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 08:40:07.747924 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 08:40:07.747924 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 08:40:07.750242 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 08:40:07.750242 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:40:07.750242 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:40:07.750242 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:40:07.750242 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:40:07.750242 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:40:07.750242 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:40:07.750242 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:40:07.750242 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application with Lock( Jul 28 08:40:07.750242 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:40:07.750242 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:40:07.750242 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:40:07.750242 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:40:07.750242 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:40:07.750242 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:40:07.750242 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:40:07.750242 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:40:07.752010 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 08:40:07.752010 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 08:40:07.752010 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 08:40:07.752010 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application Jul 28 08:40:07.752010 dv-cinder-851351-1-smb devstack@keystone.service[282899]: [pid: 282899|app: 0|req: 619/1237] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 08:40:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 272 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:40:07.757111 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-404b0858-b5d3-445e-adaf-c6cbb5488408 None admin] Authenticating user token {{(pid=282898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:40:07.919010 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-404b0858-b5d3-445e-adaf-c6cbb5488408 None admin] Validating token access rules against request {{(pid=282898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:40:07.938239 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG dbcounter [-] [282898] Writing DB stats keystone:SELECT=100 {{(pid=282898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:40:07.991591 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f39da81a-7731-41a9-8cec-352751731b5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:40:07.992421 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39da81a-7731-41a9-8cec-352751731b5a None admin] REQUEST_METHOD: `GET` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:40:07.992913 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39da81a-7731-41a9-8cec-352751731b5a None admin] SCRIPT_NAME: `/identity` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:40:07.993451 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39da81a-7731-41a9-8cec-352751731b5a None admin] PATH_INFO: `/v3/domains` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:40:07.994613 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f39da81a-7731-41a9-8cec-352751731b5a None admin] RBAC: Adding query filter params (name=Default) {{(pid=282898) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:40:07.995073 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f39da81a-7731-41a9-8cec-352751731b5a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:40:07.997288 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f39da81a-7731-41a9-8cec-352751731b5a None admin] RBAC: Authorization granted {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:40:08.014605 dv-cinder-851351-1-smb devstack@keystone.service[282898]: [pid: 282898|app: 0|req: 619/1238] 10.222.0.42 () {56 vars in 1109 bytes} [Thu Jul 28 08:40:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:40:08.021079 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247dd96f-bf0f-4b51-ba90-697afee0a511 None admin] Authenticating user token {{(pid=282899) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:40:08.162192 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247dd96f-bf0f-4b51-ba90-697afee0a511 None admin] Validating token access rules against request {{(pid=282899) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:40:08.206279 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ceb98d-9913-49e3-ac47-57e081365150 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282899) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:40:08.206963 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ceb98d-9913-49e3-ac47-57e081365150 None admin] REQUEST_METHOD: `GET` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:40:08.207249 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ceb98d-9913-49e3-ac47-57e081365150 None admin] SCRIPT_NAME: `/identity` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:40:08.207528 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ceb98d-9913-49e3-ac47-57e081365150 None admin] PATH_INFO: `/v3/users/placement` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:40:08.211585 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG dbcounter [-] [282899] Writing DB stats keystone:SELECT=100 {{(pid=282899) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:40:08.220232 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65ceb98d-9913-49e3-ac47-57e081365150 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:40:08.221795 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65ceb98d-9913-49e3-ac47-57e081365150 None admin] RBAC: Authorization granted {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:40:08.238909 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application [None req-65ceb98d-9913-49e3-ac47-57e081365150 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 28 08:40:08.238909 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:40:08.238909 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:40:08.238909 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:40:08.238909 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:40:08.238909 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:40:08.238909 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:40:08.238909 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:40:08.238909 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:40:08.238909 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:40:08.238909 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:40:08.238909 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:40:08.238909 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 28 08:40:08.238909 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 28 08:40:08.238909 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 28 08:40:08.238909 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 28 08:40:08.241447 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:40:08.241447 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:40:08.241447 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 28 08:40:08.241447 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 08:40:08.241447 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 28 08:40:08.241447 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 08:40:08.241447 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:40:08.241447 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:40:08.241447 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:40:08.241447 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:40:08.241447 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:40:08.241447 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application with Lock( Jul 28 08:40:08.241447 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:40:08.241447 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:40:08.241447 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:40:08.241447 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:40:08.241447 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:40:08.241447 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:40:08.242993 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:40:08.242993 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:40:08.242993 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 28 08:40:08.242993 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 28 08:40:08.242993 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 28 08:40:08.242993 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 28 08:40:08.242993 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 28 08:40:08.242993 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 28 08:40:08.242993 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 28 08:40:08.242993 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application Jul 28 08:40:08.242993 dv-cinder-851351-1-smb devstack@keystone.service[282899]: [pid: 282899|app: 0|req: 620/1239] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 08:40:08 2022] GET /identity/v3/users/placement => generated 87 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:40:08.248982 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f39da81a-7731-41a9-8cec-352751731b5a None admin] Authenticating user token {{(pid=282898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:40:08.395896 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f39da81a-7731-41a9-8cec-352751731b5a None admin] Validating token access rules against request {{(pid=282898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:40:08.459007 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7dcdf27-3cf9-420f-a38b-c7f604ec025e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:40:08.459809 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7dcdf27-3cf9-420f-a38b-c7f604ec025e None admin] REQUEST_METHOD: `GET` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:40:08.460207 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7dcdf27-3cf9-420f-a38b-c7f604ec025e None admin] SCRIPT_NAME: `/identity` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:40:08.460587 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7dcdf27-3cf9-420f-a38b-c7f604ec025e None admin] PATH_INFO: `/v3/users` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:40:08.461610 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7dcdf27-3cf9-420f-a38b-c7f604ec025e None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=282898) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:40:08.462036 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7dcdf27-3cf9-420f-a38b-c7f604ec025e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:40:08.463705 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7dcdf27-3cf9-420f-a38b-c7f604ec025e None admin] RBAC: Authorization granted {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:40:08.486443 dv-cinder-851351-1-smb devstack@keystone.service[282898]: [pid: 282898|app: 0|req: 620/1240] 10.222.0.42 () {56 vars in 1143 bytes} [Thu Jul 28 08:40:08 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:40:08.493989 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ceb98d-9913-49e3-ac47-57e081365150 None admin] Authenticating user token {{(pid=282899) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:40:08.621141 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ceb98d-9913-49e3-ac47-57e081365150 None admin] Validating token access rules against request {{(pid=282899) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:40:08.674708 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e5a1e69-1907-4ca3-9873-4c77c2d7326c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282899) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:40:08.675801 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5a1e69-1907-4ca3-9873-4c77c2d7326c None admin] REQUEST_METHOD: `GET` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:40:08.676323 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5a1e69-1907-4ca3-9873-4c77c2d7326c None admin] SCRIPT_NAME: `/identity` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:40:08.676845 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5a1e69-1907-4ca3-9873-4c77c2d7326c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:40:08.805204 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG dbcounter [-] [282899] Writing DB stats keystone:SELECT=100 {{(pid=282899) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:40:08.813309 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e5a1e69-1907-4ca3-9873-4c77c2d7326c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:40:08.815224 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e5a1e69-1907-4ca3-9873-4c77c2d7326c None admin] RBAC: Authorization granted {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:40:08.994996 dv-cinder-851351-1-smb devstack@keystone.service[282899]: [pid: 282899|app: 0|req: 621/1241] 10.222.0.42 () {58 vars in 1282 bytes} [Thu Jul 28 08:40:08 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 502 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 28 08:40:09.002046 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7dcdf27-3cf9-420f-a38b-c7f604ec025e None admin] Authenticating user token {{(pid=282898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:40:09.037767 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG dbcounter [-] [282898] Writing DB stats keystone:SELECT=100 {{(pid=282898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:40:09.137147 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7dcdf27-3cf9-420f-a38b-c7f604ec025e None admin] Validating token access rules against request {{(pid=282898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:40:09.183686 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba591ada-d417-4a9b-a812-37cdbf7aa91f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:40:09.184374 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba591ada-d417-4a9b-a812-37cdbf7aa91f None admin] REQUEST_METHOD: `GET` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:40:09.184655 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba591ada-d417-4a9b-a812-37cdbf7aa91f None admin] SCRIPT_NAME: `/identity` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:40:09.184965 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba591ada-d417-4a9b-a812-37cdbf7aa91f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:40:09.197775 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba591ada-d417-4a9b-a812-37cdbf7aa91f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:40:09.199290 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba591ada-d417-4a9b-a812-37cdbf7aa91f None admin] RBAC: Authorization granted {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:40:09.218137 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application [None req-ba591ada-d417-4a9b-a812-37cdbf7aa91f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 08:40:09.218137 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:40:09.218137 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:40:09.218137 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:40:09.218137 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:40:09.218137 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:40:09.218137 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:40:09.218137 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:40:09.218137 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:40:09.218137 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:40:09.218137 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:40:09.218137 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:40:09.218137 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 08:40:09.218137 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 08:40:09.218137 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 08:40:09.220334 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 08:40:09.220334 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:40:09.220334 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:40:09.220334 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:40:09.220334 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:40:09.220334 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:40:09.220334 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:40:09.220334 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:40:09.220334 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application with Lock( Jul 28 08:40:09.220334 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:40:09.220334 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:40:09.220334 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:40:09.220334 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:40:09.220334 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:40:09.220334 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:40:09.220334 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:40:09.220334 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:40:09.222762 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 08:40:09.222762 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 08:40:09.222762 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 08:40:09.222762 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application Jul 28 08:40:09.222762 dv-cinder-851351-1-smb devstack@keystone.service[282898]: [pid: 282898|app: 0|req: 621/1242] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 08:40:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:40:09.226972 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e5a1e69-1907-4ca3-9873-4c77c2d7326c None admin] Authenticating user token {{(pid=282899) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:40:09.374065 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG dbcounter [-] [282899] Writing DB stats keystone:SELECT=100 {{(pid=282899) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:40:09.382524 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e5a1e69-1907-4ca3-9873-4c77c2d7326c None admin] Validating token access rules against request {{(pid=282899) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:40:09.439393 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23cb4b25-c532-42b1-88f2-ed6cc6a5bec4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282899) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:40:09.440208 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23cb4b25-c532-42b1-88f2-ed6cc6a5bec4 None admin] REQUEST_METHOD: `GET` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:40:09.440632 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23cb4b25-c532-42b1-88f2-ed6cc6a5bec4 None admin] SCRIPT_NAME: `/identity` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:40:09.441136 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23cb4b25-c532-42b1-88f2-ed6cc6a5bec4 None admin] PATH_INFO: `/v3/domains` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:40:09.442368 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23cb4b25-c532-42b1-88f2-ed6cc6a5bec4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=282899) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:40:09.442924 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23cb4b25-c532-42b1-88f2-ed6cc6a5bec4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:40:09.445080 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23cb4b25-c532-42b1-88f2-ed6cc6a5bec4 None admin] RBAC: Authorization granted {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:40:09.473401 dv-cinder-851351-1-smb devstack@keystone.service[282899]: [pid: 282899|app: 0|req: 622/1243] 10.222.0.42 () {56 vars in 1109 bytes} [Thu Jul 28 08:40:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:40:09.475417 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba591ada-d417-4a9b-a812-37cdbf7aa91f None admin] Authenticating user token {{(pid=282898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:40:09.601456 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG dbcounter [-] [282898] Writing DB stats keystone:SELECT=100 {{(pid=282898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:40:09.628802 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba591ada-d417-4a9b-a812-37cdbf7aa91f None admin] Validating token access rules against request {{(pid=282898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:40:09.667660 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0084c0a-08ad-4236-af9e-dad3f79ba39d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:40:09.668447 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0084c0a-08ad-4236-af9e-dad3f79ba39d None admin] REQUEST_METHOD: `GET` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:40:09.668842 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0084c0a-08ad-4236-af9e-dad3f79ba39d None admin] SCRIPT_NAME: `/identity` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:40:09.669125 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0084c0a-08ad-4236-af9e-dad3f79ba39d None admin] PATH_INFO: `/v3/projects/service` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:40:09.677987 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0084c0a-08ad-4236-af9e-dad3f79ba39d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:40:09.679520 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0084c0a-08ad-4236-af9e-dad3f79ba39d None admin] RBAC: Authorization granted {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:40:09.694056 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application [None req-d0084c0a-08ad-4236-af9e-dad3f79ba39d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 08:40:09.694056 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:40:09.694056 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:40:09.694056 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:40:09.694056 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:40:09.694056 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:40:09.694056 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:40:09.694056 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:40:09.694056 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:40:09.694056 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:40:09.694056 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:40:09.694056 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:40:09.694056 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 28 08:40:09.694056 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 28 08:40:09.694056 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 28 08:40:09.696159 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 28 08:40:09.696159 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:40:09.696159 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:40:09.696159 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:40:09.696159 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:40:09.696159 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:40:09.696159 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:40:09.696159 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:40:09.696159 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application with Lock( Jul 28 08:40:09.696159 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:40:09.696159 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:40:09.696159 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:40:09.696159 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:40:09.696159 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:40:09.696159 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:40:09.696159 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:40:09.696159 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:40:09.698220 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 28 08:40:09.698220 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 28 08:40:09.698220 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 28 08:40:09.698220 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 28 08:40:09.698220 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 28 08:40:09.698220 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 28 08:40:09.698220 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 08:40:09.698220 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application Jul 28 08:40:09.698220 dv-cinder-851351-1-smb devstack@keystone.service[282898]: [pid: 282898|app: 0|req: 622/1244] 10.222.0.42 () {56 vars in 1111 bytes} [Thu Jul 28 08:40:09 2022] GET /identity/v3/projects/service => generated 88 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:40:09.704487 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23cb4b25-c532-42b1-88f2-ed6cc6a5bec4 None admin] Authenticating user token {{(pid=282899) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:40:09.869375 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23cb4b25-c532-42b1-88f2-ed6cc6a5bec4 None admin] Validating token access rules against request {{(pid=282899) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:40:09.915404 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa72f43-e9e0-49a3-b097-4de74af10391 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282899) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:40:09.916373 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa72f43-e9e0-49a3-b097-4de74af10391 None admin] REQUEST_METHOD: `GET` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:40:09.916767 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa72f43-e9e0-49a3-b097-4de74af10391 None admin] SCRIPT_NAME: `/identity` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:40:09.917157 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa72f43-e9e0-49a3-b097-4de74af10391 None admin] PATH_INFO: `/v3/projects` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:40:09.918034 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa72f43-e9e0-49a3-b097-4de74af10391 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=282899) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:40:09.918504 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa72f43-e9e0-49a3-b097-4de74af10391 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:40:09.920305 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa72f43-e9e0-49a3-b097-4de74af10391 None admin] RBAC: Authorization granted {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:40:09.938604 dv-cinder-851351-1-smb devstack@keystone.service[282899]: [pid: 282899|app: 0|req: 623/1245] 10.222.0.42 () {56 vars in 1148 bytes} [Thu Jul 28 08:40:09 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:40:09.946021 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0084c0a-08ad-4236-af9e-dad3f79ba39d None admin] Authenticating user token {{(pid=282898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:40:10.126324 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0084c0a-08ad-4236-af9e-dad3f79ba39d None admin] Validating token access rules against request {{(pid=282898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:40:10.189610 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-516e1d9d-7dff-4d7f-9e3c-f6f785ab766b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:40:10.191072 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516e1d9d-7dff-4d7f-9e3c-f6f785ab766b None admin] REQUEST_METHOD: `GET` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:40:10.191559 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516e1d9d-7dff-4d7f-9e3c-f6f785ab766b None admin] SCRIPT_NAME: `/identity` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:40:10.192047 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516e1d9d-7dff-4d7f-9e3c-f6f785ab766b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:40:10.193683 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-516e1d9d-7dff-4d7f-9e3c-f6f785ab766b None admin] RBAC: Adding query filter params (role.id=aa4daecf3ff74fa1b7d53041a4659723, scope.project.id=5cde68cbfb9042dc9f36af3aacea2473, user.id=bba431c3832c4dd5bcd296d3247840c0) {{(pid=282898) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:40:10.194250 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-516e1d9d-7dff-4d7f-9e3c-f6f785ab766b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:40:10.197074 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-516e1d9d-7dff-4d7f-9e3c-f6f785ab766b None admin] RBAC: Authorization granted {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:40:10.211327 dv-cinder-851351-1-smb devstack@keystone.service[282898]: [pid: 282898|app: 0|req: 623/1246] 10.222.0.42 () {56 vars in 1374 bytes} [Thu Jul 28 08:40:09 2022] GET /identity/v3/role_assignments?user.id=bba431c3832c4dd5bcd296d3247840c0&scope.project.id=5cde68cbfb9042dc9f36af3aacea2473&role.id=aa4daecf3ff74fa1b7d53041a4659723 => generated 608 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:40:12.858301 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e64457-4788-4080-ae4e-aabbbd9e9b04 None None] REQUEST_METHOD: `GET` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:40:12.859223 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e64457-4788-4080-ae4e-aabbbd9e9b04 None None] SCRIPT_NAME: `/identity` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:40:12.859223 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e64457-4788-4080-ae4e-aabbbd9e9b04 None None] PATH_INFO: `/` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:40:12.861336 dv-cinder-851351-1-smb devstack@keystone.service[282899]: [pid: 282899|app: 0|req: 624/1247] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 08:40:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 08:40:12.869311 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ca523f-d671-46e2-b8b3-9ec07df3e1a9 None None] REQUEST_METHOD: `POST` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:40:12.869940 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ca523f-d671-46e2-b8b3-9ec07df3e1a9 None None] SCRIPT_NAME: `/identity` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:40:12.870177 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ca523f-d671-46e2-b8b3-9ec07df3e1a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:40:12.879988 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG dbcounter [-] [282898] Writing DB stats keystone:SELECT=100 {{(pid=282898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:40:12.896941 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.auth.core [None req-f7ca523f-d671-46e2-b8b3-9ec07df3e1a9 None None] MFA Rules not processed for user `2be990a66857410a87ffa7609aec4f7b`. Rule list: `[]` (Enabled: `True`). {{(pid=282898) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 08:40:12.898435 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.fernet_utils [None req-f7ca523f-d671-46e2-b8b3-9ec07df3e1a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=282898) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:40:12.999281 dv-cinder-851351-1-smb devstack@keystone.service[282898]: [pid: 282898|app: 0|req: 624/1248] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 08:40:12 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 08:40:13.027310 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e64457-4788-4080-ae4e-aabbbd9e9b04 None None] Authenticating user token {{(pid=282899) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:40:13.050484 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG dbcounter [-] [282899] Writing DB stats keystone:SELECT=100 {{(pid=282899) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:40:13.205020 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e64457-4788-4080-ae4e-aabbbd9e9b04 None None] Validating token access rules against request {{(pid=282899) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:40:13.254730 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b5c2d2-783b-4e88-9b54-c32a601a1723 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282899) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:40:13.255409 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b5c2d2-783b-4e88-9b54-c32a601a1723 None admin] REQUEST_METHOD: `GET` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:40:13.255688 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b5c2d2-783b-4e88-9b54-c32a601a1723 None admin] SCRIPT_NAME: `/identity` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:40:13.255969 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b5c2d2-783b-4e88-9b54-c32a601a1723 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:40:13.270079 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b5c2d2-783b-4e88-9b54-c32a601a1723 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 08:40:13.275803 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application [None req-e3b5c2d2-783b-4e88-9b54-c32a601a1723 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 08:40:13.275803 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:40:13.275803 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:40:13.275803 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:40:13.275803 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:40:13.275803 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:40:13.275803 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:40:13.275803 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:40:13.275803 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:40:13.275803 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:40:13.275803 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:40:13.275803 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:40:13.275803 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 08:40:13.275803 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 08:40:13.275803 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 08:40:13.275803 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 08:40:13.281591 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 08:40:13.281591 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 08:40:13.281591 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 08:40:13.281591 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 08:40:13.281591 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:40:13.281591 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:40:13.281591 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:40:13.281591 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:40:13.281591 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:40:13.281591 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:40:13.281591 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:40:13.281591 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application with Lock( Jul 28 08:40:13.281591 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:40:13.281591 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:40:13.281591 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:40:13.281591 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:40:13.283427 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:40:13.283427 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:40:13.283427 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:40:13.283427 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:40:13.283427 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 08:40:13.283427 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 08:40:13.283427 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 08:40:13.283427 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 08:40:13.283427 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 08:40:13.283427 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 08:40:13.283427 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 08:40:13.283427 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application Jul 28 08:40:13.283427 dv-cinder-851351-1-smb devstack@keystone.service[282899]: [pid: 282899|app: 0|req: 625/1249] 10.222.0.42 () {56 vars in 1096 bytes} [Thu Jul 28 08:40:13 2022] GET /identity/v3/roles/admin => generated 83 bytes in 250 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 08:40:13.286326 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ca523f-d671-46e2-b8b3-9ec07df3e1a9 None None] Authenticating user token {{(pid=282898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:40:13.470854 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ca523f-d671-46e2-b8b3-9ec07df3e1a9 None None] Validating token access rules against request {{(pid=282898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:40:13.520832 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG dbcounter [-] [282898] Writing DB stats keystone:SELECT=100 {{(pid=282898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:40:13.528009 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3959b5-d96c-4757-bfc9-24ba7ccc793b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:40:13.528736 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3959b5-d96c-4757-bfc9-24ba7ccc793b None admin] REQUEST_METHOD: `GET` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:40:13.529133 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3959b5-d96c-4757-bfc9-24ba7ccc793b None admin] SCRIPT_NAME: `/identity` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:40:13.529424 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3959b5-d96c-4757-bfc9-24ba7ccc793b None admin] PATH_INFO: `/v3/roles` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:40:13.530205 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b3959b5-d96c-4757-bfc9-24ba7ccc793b None admin] RBAC: Adding query filter params (name=admin) {{(pid=282898) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:40:13.530510 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b3959b5-d96c-4757-bfc9-24ba7ccc793b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:40:13.532308 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b3959b5-d96c-4757-bfc9-24ba7ccc793b None admin] RBAC: Authorization granted {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:40:13.545819 dv-cinder-851351-1-smb devstack@keystone.service[282898]: [pid: 282898|app: 0|req: 625/1250] 10.222.0.42 () {56 vars in 1099 bytes} [Thu Jul 28 08:40:13 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 08:40:13.554876 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b5c2d2-783b-4e88-9b54-c32a601a1723 None admin] Authenticating user token {{(pid=282899) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:40:13.685602 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG dbcounter [-] [282899] Writing DB stats keystone:SELECT=100 {{(pid=282899) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:40:13.723837 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b5c2d2-783b-4e88-9b54-c32a601a1723 None admin] Validating token access rules against request {{(pid=282899) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:40:13.772890 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b06c8e6b-c195-4f16-92a5-9a48f89aed16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282899) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:40:13.774030 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06c8e6b-c195-4f16-92a5-9a48f89aed16 None admin] REQUEST_METHOD: `GET` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:40:13.774484 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06c8e6b-c195-4f16-92a5-9a48f89aed16 None admin] SCRIPT_NAME: `/identity` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:40:13.774876 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06c8e6b-c195-4f16-92a5-9a48f89aed16 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:40:13.790820 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b06c8e6b-c195-4f16-92a5-9a48f89aed16 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:40:13.792998 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b06c8e6b-c195-4f16-92a5-9a48f89aed16 None admin] RBAC: Authorization granted {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:40:13.820298 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application [None req-b06c8e6b-c195-4f16-92a5-9a48f89aed16 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 08:40:13.820298 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:40:13.820298 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:40:13.820298 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:40:13.820298 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:40:13.820298 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:40:13.820298 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:40:13.820298 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:40:13.820298 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:40:13.820298 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:40:13.820298 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:40:13.820298 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:40:13.820298 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 08:40:13.820298 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 08:40:13.820298 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 08:40:13.821553 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 08:40:13.821553 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:40:13.821553 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:40:13.821553 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:40:13.821553 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:40:13.821553 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:40:13.821553 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:40:13.821553 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:40:13.821553 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application with Lock( Jul 28 08:40:13.821553 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:40:13.821553 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:40:13.821553 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:40:13.821553 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:40:13.821553 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:40:13.821553 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:40:13.821553 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:40:13.821553 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:40:13.822846 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 08:40:13.822846 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 08:40:13.822846 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 08:40:13.822846 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application Jul 28 08:40:13.822846 dv-cinder-851351-1-smb devstack@keystone.service[282899]: [pid: 282899|app: 0|req: 626/1251] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 08:40:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 269 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:40:13.831624 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3959b5-d96c-4757-bfc9-24ba7ccc793b None admin] Authenticating user token {{(pid=282898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:40:13.989245 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3959b5-d96c-4757-bfc9-24ba7ccc793b None admin] Validating token access rules against request {{(pid=282898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:40:14.047661 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b2a967-ef42-4a50-9e26-cab77e978dd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:40:14.049053 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b2a967-ef42-4a50-9e26-cab77e978dd3 None admin] REQUEST_METHOD: `GET` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:40:14.049741 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b2a967-ef42-4a50-9e26-cab77e978dd3 None admin] SCRIPT_NAME: `/identity` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:40:14.050295 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b2a967-ef42-4a50-9e26-cab77e978dd3 None admin] PATH_INFO: `/v3/domains` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:40:14.052183 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36b2a967-ef42-4a50-9e26-cab77e978dd3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=282898) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:40:14.052927 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36b2a967-ef42-4a50-9e26-cab77e978dd3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:40:14.055956 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36b2a967-ef42-4a50-9e26-cab77e978dd3 None admin] RBAC: Authorization granted {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:40:14.078294 dv-cinder-851351-1-smb devstack@keystone.service[282898]: [pid: 282898|app: 0|req: 626/1252] 10.222.0.42 () {56 vars in 1109 bytes} [Thu Jul 28 08:40:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:40:14.085576 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b06c8e6b-c195-4f16-92a5-9a48f89aed16 None admin] Authenticating user token {{(pid=282899) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:40:14.257000 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b06c8e6b-c195-4f16-92a5-9a48f89aed16 None admin] Validating token access rules against request {{(pid=282899) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:40:14.304456 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG dbcounter [-] [282899] Writing DB stats keystone:SELECT=100 {{(pid=282899) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:40:14.317319 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32ea2c9-8a18-436d-92f7-d5c47253cdaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282899) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:40:14.318523 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32ea2c9-8a18-436d-92f7-d5c47253cdaf None admin] REQUEST_METHOD: `GET` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:40:14.318995 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32ea2c9-8a18-436d-92f7-d5c47253cdaf None admin] SCRIPT_NAME: `/identity` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:40:14.319495 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32ea2c9-8a18-436d-92f7-d5c47253cdaf None admin] PATH_INFO: `/v3/users/placement` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:40:14.332381 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e32ea2c9-8a18-436d-92f7-d5c47253cdaf None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:40:14.334408 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e32ea2c9-8a18-436d-92f7-d5c47253cdaf None admin] RBAC: Authorization granted {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:40:14.351393 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application [None req-e32ea2c9-8a18-436d-92f7-d5c47253cdaf None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 28 08:40:14.351393 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:40:14.351393 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:40:14.351393 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:40:14.351393 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:40:14.351393 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:40:14.351393 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:40:14.351393 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:40:14.351393 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:40:14.351393 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:40:14.351393 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:40:14.351393 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:40:14.351393 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 28 08:40:14.351393 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 28 08:40:14.351393 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 28 08:40:14.351393 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 28 08:40:14.354061 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:40:14.354061 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:40:14.354061 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 28 08:40:14.354061 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 08:40:14.354061 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 28 08:40:14.354061 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 08:40:14.354061 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:40:14.354061 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:40:14.354061 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:40:14.354061 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:40:14.354061 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:40:14.354061 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application with Lock( Jul 28 08:40:14.354061 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:40:14.354061 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:40:14.354061 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:40:14.354061 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:40:14.354061 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:40:14.354061 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:40:14.356652 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:40:14.356652 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:40:14.356652 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 28 08:40:14.356652 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 28 08:40:14.356652 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 28 08:40:14.356652 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 28 08:40:14.356652 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 28 08:40:14.356652 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 28 08:40:14.356652 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 28 08:40:14.356652 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application Jul 28 08:40:14.356652 dv-cinder-851351-1-smb devstack@keystone.service[282899]: [pid: 282899|app: 0|req: 627/1253] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 08:40:14 2022] GET /identity/v3/users/placement => generated 87 bytes in 268 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:40:14.362445 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b2a967-ef42-4a50-9e26-cab77e978dd3 None admin] Authenticating user token {{(pid=282898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:40:14.461389 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG dbcounter [-] [282898] Writing DB stats keystone:SELECT=100 {{(pid=282898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:40:14.531429 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b2a967-ef42-4a50-9e26-cab77e978dd3 None admin] Validating token access rules against request {{(pid=282898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:40:14.587093 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a960d6a-02b3-4a80-987c-c241c49ae384 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:40:14.587799 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a960d6a-02b3-4a80-987c-c241c49ae384 None admin] REQUEST_METHOD: `GET` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:40:14.588258 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a960d6a-02b3-4a80-987c-c241c49ae384 None admin] SCRIPT_NAME: `/identity` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:40:14.588694 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a960d6a-02b3-4a80-987c-c241c49ae384 None admin] PATH_INFO: `/v3/users` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:40:14.589686 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a960d6a-02b3-4a80-987c-c241c49ae384 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=282898) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:40:14.590009 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a960d6a-02b3-4a80-987c-c241c49ae384 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:40:14.591648 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a960d6a-02b3-4a80-987c-c241c49ae384 None admin] RBAC: Authorization granted {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:40:14.620536 dv-cinder-851351-1-smb devstack@keystone.service[282898]: [pid: 282898|app: 0|req: 627/1254] 10.222.0.42 () {56 vars in 1143 bytes} [Thu Jul 28 08:40:14 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:40:14.627630 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32ea2c9-8a18-436d-92f7-d5c47253cdaf None admin] Authenticating user token {{(pid=282899) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:40:14.782200 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32ea2c9-8a18-436d-92f7-d5c47253cdaf None admin] Validating token access rules against request {{(pid=282899) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:40:14.826639 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e72e4a0-d872-4e57-bd58-0eb3f7bed056 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282899) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:40:14.827310 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e72e4a0-d872-4e57-bd58-0eb3f7bed056 None admin] REQUEST_METHOD: `GET` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:40:14.827592 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e72e4a0-d872-4e57-bd58-0eb3f7bed056 None admin] SCRIPT_NAME: `/identity` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:40:14.827920 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e72e4a0-d872-4e57-bd58-0eb3f7bed056 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:40:14.918100 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG dbcounter [-] [282899] Writing DB stats keystone:SELECT=100 {{(pid=282899) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:40:14.935341 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e72e4a0-d872-4e57-bd58-0eb3f7bed056 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:40:14.937649 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e72e4a0-d872-4e57-bd58-0eb3f7bed056 None admin] RBAC: Authorization granted {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:40:15.085247 dv-cinder-851351-1-smb devstack@keystone.service[282899]: [pid: 282899|app: 0|req: 628/1255] 10.222.0.42 () {58 vars in 1282 bytes} [Thu Jul 28 08:40:14 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 458 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 28 08:40:15.091207 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a960d6a-02b3-4a80-987c-c241c49ae384 None admin] Authenticating user token {{(pid=282898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:40:15.241920 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a960d6a-02b3-4a80-987c-c241c49ae384 None admin] Validating token access rules against request {{(pid=282898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:40:15.264585 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG dbcounter [-] [282898] Writing DB stats keystone:SELECT=100 {{(pid=282898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:40:15.299197 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ed3f7c-5f16-44ef-9e71-b2e7eb28ec52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:40:15.300564 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ed3f7c-5f16-44ef-9e71-b2e7eb28ec52 None admin] REQUEST_METHOD: `GET` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:40:15.301228 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ed3f7c-5f16-44ef-9e71-b2e7eb28ec52 None admin] SCRIPT_NAME: `/identity` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:40:15.301728 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ed3f7c-5f16-44ef-9e71-b2e7eb28ec52 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:40:15.322651 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77ed3f7c-5f16-44ef-9e71-b2e7eb28ec52 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:40:15.324228 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77ed3f7c-5f16-44ef-9e71-b2e7eb28ec52 None admin] RBAC: Authorization granted {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:40:15.343648 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application [None req-77ed3f7c-5f16-44ef-9e71-b2e7eb28ec52 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 08:40:15.343648 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:40:15.343648 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:40:15.343648 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:40:15.343648 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:40:15.343648 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:40:15.343648 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:40:15.343648 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:40:15.343648 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:40:15.343648 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:40:15.343648 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:40:15.343648 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:40:15.343648 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 08:40:15.343648 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 08:40:15.343648 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 08:40:15.345713 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 08:40:15.345713 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:40:15.345713 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:40:15.345713 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:40:15.345713 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:40:15.345713 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:40:15.345713 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:40:15.345713 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:40:15.345713 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application with Lock( Jul 28 08:40:15.345713 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:40:15.345713 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:40:15.345713 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:40:15.345713 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:40:15.345713 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:40:15.345713 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:40:15.345713 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:40:15.345713 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:40:15.347770 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 08:40:15.347770 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 08:40:15.347770 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 08:40:15.347770 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application Jul 28 08:40:15.347770 dv-cinder-851351-1-smb devstack@keystone.service[282898]: [pid: 282898|app: 0|req: 628/1256] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 08:40:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 255 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:40:15.354165 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e72e4a0-d872-4e57-bd58-0eb3f7bed056 None admin] Authenticating user token {{(pid=282899) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:40:15.508263 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG dbcounter [-] [282899] Writing DB stats keystone:SELECT=100 {{(pid=282899) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:40:15.530666 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e72e4a0-d872-4e57-bd58-0eb3f7bed056 None admin] Validating token access rules against request {{(pid=282899) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:40:15.573720 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf72d633-c81e-4cf8-aff8-af48347a7bcf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282899) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:40:15.574360 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf72d633-c81e-4cf8-aff8-af48347a7bcf None admin] REQUEST_METHOD: `GET` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:40:15.574642 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf72d633-c81e-4cf8-aff8-af48347a7bcf None admin] SCRIPT_NAME: `/identity` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:40:15.574919 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf72d633-c81e-4cf8-aff8-af48347a7bcf None admin] PATH_INFO: `/v3/domains` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:40:15.575643 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf72d633-c81e-4cf8-aff8-af48347a7bcf None admin] RBAC: Adding query filter params (name=Default) {{(pid=282899) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:40:15.576003 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf72d633-c81e-4cf8-aff8-af48347a7bcf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:40:15.577549 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf72d633-c81e-4cf8-aff8-af48347a7bcf None admin] RBAC: Authorization granted {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:40:15.591184 dv-cinder-851351-1-smb devstack@keystone.service[282899]: [pid: 282899|app: 0|req: 629/1257] 10.222.0.42 () {56 vars in 1109 bytes} [Thu Jul 28 08:40:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:40:15.598054 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ed3f7c-5f16-44ef-9e71-b2e7eb28ec52 None admin] Authenticating user token {{(pid=282898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:40:15.762277 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ed3f7c-5f16-44ef-9e71-b2e7eb28ec52 None admin] Validating token access rules against request {{(pid=282898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:40:15.810691 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fca3388-9823-4193-8248-4892a55a4087 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:40:15.812051 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fca3388-9823-4193-8248-4892a55a4087 None admin] REQUEST_METHOD: `GET` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:40:15.812345 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fca3388-9823-4193-8248-4892a55a4087 None admin] SCRIPT_NAME: `/identity` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:40:15.812748 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fca3388-9823-4193-8248-4892a55a4087 None admin] PATH_INFO: `/v3/projects/service` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:40:15.821121 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fca3388-9823-4193-8248-4892a55a4087 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:40:15.822622 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fca3388-9823-4193-8248-4892a55a4087 None admin] RBAC: Authorization granted {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:40:15.836876 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application [None req-9fca3388-9823-4193-8248-4892a55a4087 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 08:40:15.836876 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:40:15.836876 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:40:15.836876 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:40:15.836876 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:40:15.836876 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:40:15.836876 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:40:15.836876 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:40:15.836876 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:40:15.836876 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:40:15.836876 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:40:15.836876 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:40:15.836876 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 28 08:40:15.836876 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 28 08:40:15.836876 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 28 08:40:15.839341 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 28 08:40:15.839341 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:40:15.839341 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:40:15.839341 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:40:15.839341 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:40:15.839341 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:40:15.839341 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:40:15.839341 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:40:15.839341 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application with Lock( Jul 28 08:40:15.839341 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:40:15.839341 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:40:15.839341 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:40:15.839341 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:40:15.839341 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:40:15.839341 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:40:15.839341 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:40:15.839341 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:40:15.841792 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 28 08:40:15.841792 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 28 08:40:15.841792 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 28 08:40:15.841792 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 28 08:40:15.841792 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 28 08:40:15.841792 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 28 08:40:15.841792 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 08:40:15.841792 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application Jul 28 08:40:15.841792 dv-cinder-851351-1-smb devstack@keystone.service[282898]: [pid: 282898|app: 0|req: 629/1258] 10.222.0.42 () {56 vars in 1111 bytes} [Thu Jul 28 08:40:15 2022] GET /identity/v3/projects/service => generated 88 bytes in 242 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:40:15.846270 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf72d633-c81e-4cf8-aff8-af48347a7bcf None admin] Authenticating user token {{(pid=282899) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:40:16.002522 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf72d633-c81e-4cf8-aff8-af48347a7bcf None admin] Validating token access rules against request {{(pid=282899) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:40:16.053615 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4996229e-7f55-45d8-8e78-28395ba71f7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282899) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:40:16.054702 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4996229e-7f55-45d8-8e78-28395ba71f7f None admin] REQUEST_METHOD: `GET` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:40:16.055182 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4996229e-7f55-45d8-8e78-28395ba71f7f None admin] SCRIPT_NAME: `/identity` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:40:16.055712 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4996229e-7f55-45d8-8e78-28395ba71f7f None admin] PATH_INFO: `/v3/projects` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:40:16.057282 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4996229e-7f55-45d8-8e78-28395ba71f7f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=282899) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:40:16.057828 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4996229e-7f55-45d8-8e78-28395ba71f7f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:40:16.060238 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4996229e-7f55-45d8-8e78-28395ba71f7f None admin] RBAC: Authorization granted {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:40:16.079424 dv-cinder-851351-1-smb devstack@keystone.service[282899]: [pid: 282899|app: 0|req: 630/1259] 10.222.0.42 () {56 vars in 1148 bytes} [Thu Jul 28 08:40:15 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:40:16.086670 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fca3388-9823-4193-8248-4892a55a4087 None admin] Authenticating user token {{(pid=282898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:40:16.124527 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG dbcounter [-] [282898] Writing DB stats keystone:SELECT=100 {{(pid=282898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:40:16.250768 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fca3388-9823-4193-8248-4892a55a4087 None admin] Validating token access rules against request {{(pid=282898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:40:16.298339 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e18788b-26e0-4d79-9bb9-eaff1ffd1c4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:40:16.299235 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e18788b-26e0-4d79-9bb9-eaff1ffd1c4c None admin] REQUEST_METHOD: `GET` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:40:16.299717 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e18788b-26e0-4d79-9bb9-eaff1ffd1c4c None admin] SCRIPT_NAME: `/identity` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:40:16.300182 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e18788b-26e0-4d79-9bb9-eaff1ffd1c4c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:40:16.301706 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e18788b-26e0-4d79-9bb9-eaff1ffd1c4c None admin] RBAC: Adding query filter params (role.id=a0e2a00bf94d40f38629d6b5293e3aee, scope.project.id=5cde68cbfb9042dc9f36af3aacea2473, user.id=bba431c3832c4dd5bcd296d3247840c0) {{(pid=282898) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:40:16.302246 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e18788b-26e0-4d79-9bb9-eaff1ffd1c4c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:40:16.304579 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e18788b-26e0-4d79-9bb9-eaff1ffd1c4c None admin] RBAC: Authorization granted {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:40:16.312901 dv-cinder-851351-1-smb devstack@keystone.service[282898]: [pid: 282898|app: 0|req: 630/1260] 10.222.0.42 () {56 vars in 1374 bytes} [Thu Jul 28 08:40:16 2022] GET /identity/v3/role_assignments?user.id=bba431c3832c4dd5bcd296d3247840c0&scope.project.id=5cde68cbfb9042dc9f36af3aacea2473&role.id=a0e2a00bf94d40f38629d6b5293e3aee => generated 259 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:40:18.727609 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c142e745-68c6-4f38-99b2-a466e7e56dee None None] REQUEST_METHOD: `GET` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:40:18.728494 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c142e745-68c6-4f38-99b2-a466e7e56dee None None] SCRIPT_NAME: `/identity` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:40:18.728494 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c142e745-68c6-4f38-99b2-a466e7e56dee None None] PATH_INFO: `/` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:40:18.729972 dv-cinder-851351-1-smb devstack@keystone.service[282899]: [pid: 282899|app: 0|req: 631/1261] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 08:40:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 28 08:40:18.736780 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07bd4e3-d4d1-4a3a-beaf-28c92afb95c4 None None] REQUEST_METHOD: `POST` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:40:18.737681 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07bd4e3-d4d1-4a3a-beaf-28c92afb95c4 None None] SCRIPT_NAME: `/identity` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:40:18.737681 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07bd4e3-d4d1-4a3a-beaf-28c92afb95c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:40:18.767077 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.auth.core [None req-a07bd4e3-d4d1-4a3a-beaf-28c92afb95c4 None None] MFA Rules not processed for user `2be990a66857410a87ffa7609aec4f7b`. Rule list: `[]` (Enabled: `True`). {{(pid=282898) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 08:40:18.768442 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.fernet_utils [None req-a07bd4e3-d4d1-4a3a-beaf-28c92afb95c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=282898) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:40:18.868925 dv-cinder-851351-1-smb devstack@keystone.service[282898]: [pid: 282898|app: 0|req: 631/1262] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 08:40:18 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 08:40:18.891816 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c142e745-68c6-4f38-99b2-a466e7e56dee None None] Authenticating user token {{(pid=282899) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:40:18.903695 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG dbcounter [-] [282899] Writing DB stats keystone:SELECT=100 {{(pid=282899) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:40:19.035680 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c142e745-68c6-4f38-99b2-a466e7e56dee None None] Validating token access rules against request {{(pid=282899) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:40:19.073650 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ba0629-008f-42d4-aa52-3834fc6a96c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282899) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:40:19.074383 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ba0629-008f-42d4-aa52-3834fc6a96c0 None admin] REQUEST_METHOD: `GET` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:40:19.074707 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ba0629-008f-42d4-aa52-3834fc6a96c0 None admin] SCRIPT_NAME: `/identity` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:40:19.075031 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ba0629-008f-42d4-aa52-3834fc6a96c0 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:40:19.087419 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ba0629-008f-42d4-aa52-3834fc6a96c0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 08:40:19.092519 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application [None req-43ba0629-008f-42d4-aa52-3834fc6a96c0 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 08:40:19.092519 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:40:19.092519 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:40:19.092519 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:40:19.092519 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:40:19.092519 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:40:19.092519 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:40:19.092519 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:40:19.092519 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:40:19.092519 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:40:19.092519 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:40:19.092519 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:40:19.092519 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 08:40:19.092519 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 08:40:19.092519 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 08:40:19.092519 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 08:40:19.094463 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 08:40:19.094463 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 08:40:19.094463 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 08:40:19.094463 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 08:40:19.094463 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:40:19.094463 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:40:19.094463 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:40:19.094463 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:40:19.094463 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:40:19.094463 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:40:19.094463 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:40:19.094463 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application with Lock( Jul 28 08:40:19.094463 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:40:19.094463 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:40:19.094463 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:40:19.094463 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:40:19.095883 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:40:19.095883 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:40:19.095883 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:40:19.095883 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:40:19.095883 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 08:40:19.095883 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 08:40:19.095883 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 08:40:19.095883 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 08:40:19.095883 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 08:40:19.095883 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 08:40:19.095883 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 08:40:19.095883 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application Jul 28 08:40:19.095883 dv-cinder-851351-1-smb devstack@keystone.service[282899]: [pid: 282899|app: 0|req: 632/1263] 10.222.0.42 () {56 vars in 1096 bytes} [Thu Jul 28 08:40:18 2022] GET /identity/v3/roles/admin => generated 83 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:40:19.100328 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a07bd4e3-d4d1-4a3a-beaf-28c92afb95c4 None None] Authenticating user token {{(pid=282898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:40:19.120480 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG dbcounter [-] [282898] Writing DB stats keystone:SELECT=100 {{(pid=282898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:40:19.209317 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a07bd4e3-d4d1-4a3a-beaf-28c92afb95c4 None None] Validating token access rules against request {{(pid=282898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:40:19.247950 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4457c8f5-7f93-4902-8110-d38f18b0b275 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:40:19.250878 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4457c8f5-7f93-4902-8110-d38f18b0b275 None admin] REQUEST_METHOD: `GET` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:40:19.251167 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4457c8f5-7f93-4902-8110-d38f18b0b275 None admin] SCRIPT_NAME: `/identity` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:40:19.251444 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4457c8f5-7f93-4902-8110-d38f18b0b275 None admin] PATH_INFO: `/v3/roles` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:40:19.252714 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4457c8f5-7f93-4902-8110-d38f18b0b275 None admin] RBAC: Adding query filter params (name=admin) {{(pid=282898) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:40:19.253040 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4457c8f5-7f93-4902-8110-d38f18b0b275 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:40:19.254642 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4457c8f5-7f93-4902-8110-d38f18b0b275 None admin] RBAC: Authorization granted {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:40:19.265222 dv-cinder-851351-1-smb devstack@keystone.service[282898]: [pid: 282898|app: 0|req: 632/1264] 10.222.0.42 () {56 vars in 1099 bytes} [Thu Jul 28 08:40:19 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:40:19.271540 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ba0629-008f-42d4-aa52-3834fc6a96c0 None admin] Authenticating user token {{(pid=282899) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:40:19.345099 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG dbcounter [-] [282899] Writing DB stats keystone:SELECT=100 {{(pid=282899) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:40:19.382711 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ba0629-008f-42d4-aa52-3834fc6a96c0 None admin] Validating token access rules against request {{(pid=282899) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:40:19.433231 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351f269a-a67e-43e1-b998-ac71c108014a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282899) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:40:19.434001 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351f269a-a67e-43e1-b998-ac71c108014a None admin] REQUEST_METHOD: `GET` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:40:19.434310 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351f269a-a67e-43e1-b998-ac71c108014a None admin] SCRIPT_NAME: `/identity` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:40:19.434660 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351f269a-a67e-43e1-b998-ac71c108014a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:40:19.450442 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-351f269a-a67e-43e1-b998-ac71c108014a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:40:19.452298 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-351f269a-a67e-43e1-b998-ac71c108014a None admin] RBAC: Authorization granted {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:40:19.470205 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application [None req-351f269a-a67e-43e1-b998-ac71c108014a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 08:40:19.470205 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:40:19.470205 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:40:19.470205 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:40:19.470205 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:40:19.470205 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:40:19.470205 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:40:19.470205 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:40:19.470205 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:40:19.470205 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:40:19.470205 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:40:19.470205 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:40:19.470205 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 08:40:19.470205 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 08:40:19.470205 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 08:40:19.472024 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 08:40:19.472024 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:40:19.472024 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:40:19.472024 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:40:19.472024 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:40:19.472024 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:40:19.472024 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:40:19.472024 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:40:19.472024 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application with Lock( Jul 28 08:40:19.472024 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:40:19.472024 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:40:19.472024 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:40:19.472024 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:40:19.472024 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:40:19.472024 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:40:19.472024 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:40:19.472024 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:40:19.474546 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 08:40:19.474546 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 08:40:19.474546 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 08:40:19.474546 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application Jul 28 08:40:19.474546 dv-cinder-851351-1-smb devstack@keystone.service[282899]: [pid: 282899|app: 0|req: 633/1265] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 08:40:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:40:19.479571 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4457c8f5-7f93-4902-8110-d38f18b0b275 None admin] Authenticating user token {{(pid=282898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:40:19.581583 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG dbcounter [-] [282898] Writing DB stats keystone:SELECT=100 {{(pid=282898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:40:19.605578 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4457c8f5-7f93-4902-8110-d38f18b0b275 None admin] Validating token access rules against request {{(pid=282898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:40:19.644072 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb87aa4-f150-465e-9f5a-1da7db9a6d01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:40:19.644732 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb87aa4-f150-465e-9f5a-1da7db9a6d01 None admin] REQUEST_METHOD: `GET` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:40:19.645022 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb87aa4-f150-465e-9f5a-1da7db9a6d01 None admin] SCRIPT_NAME: `/identity` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:40:19.645294 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb87aa4-f150-465e-9f5a-1da7db9a6d01 None admin] PATH_INFO: `/v3/domains` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:40:19.646012 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb87aa4-f150-465e-9f5a-1da7db9a6d01 None admin] RBAC: Adding query filter params (name=Default) {{(pid=282898) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:40:19.646316 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb87aa4-f150-465e-9f5a-1da7db9a6d01 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:40:19.647739 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb87aa4-f150-465e-9f5a-1da7db9a6d01 None admin] RBAC: Authorization granted {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:40:19.665842 dv-cinder-851351-1-smb devstack@keystone.service[282898]: [pid: 282898|app: 0|req: 633/1266] 10.222.0.42 () {56 vars in 1109 bytes} [Thu Jul 28 08:40:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 08:40:19.672162 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351f269a-a67e-43e1-b998-ac71c108014a None admin] Authenticating user token {{(pid=282899) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:40:19.790759 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351f269a-a67e-43e1-b998-ac71c108014a None admin] Validating token access rules against request {{(pid=282899) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:40:19.815481 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG dbcounter [-] [282899] Writing DB stats keystone:SELECT=100 {{(pid=282899) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:40:19.833965 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b162ef-a39b-4070-8da2-9e810f03c143 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282899) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:40:19.834651 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b162ef-a39b-4070-8da2-9e810f03c143 None admin] REQUEST_METHOD: `GET` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:40:19.834937 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b162ef-a39b-4070-8da2-9e810f03c143 None admin] SCRIPT_NAME: `/identity` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:40:19.835215 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b162ef-a39b-4070-8da2-9e810f03c143 None admin] PATH_INFO: `/v3/users/placement` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:40:19.844616 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9b162ef-a39b-4070-8da2-9e810f03c143 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:40:19.846167 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9b162ef-a39b-4070-8da2-9e810f03c143 None admin] RBAC: Authorization granted {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:40:19.859151 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application [None req-e9b162ef-a39b-4070-8da2-9e810f03c143 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 28 08:40:19.859151 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:40:19.859151 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:40:19.859151 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:40:19.859151 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:40:19.859151 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:40:19.859151 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:40:19.859151 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:40:19.859151 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:40:19.859151 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:40:19.859151 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:40:19.859151 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:40:19.859151 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 28 08:40:19.859151 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 28 08:40:19.859151 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 28 08:40:19.859151 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 28 08:40:19.861052 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:40:19.861052 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:40:19.861052 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 28 08:40:19.861052 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 08:40:19.861052 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 28 08:40:19.861052 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 08:40:19.861052 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:40:19.861052 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:40:19.861052 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:40:19.861052 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:40:19.861052 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:40:19.861052 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application with Lock( Jul 28 08:40:19.861052 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:40:19.861052 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:40:19.861052 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:40:19.861052 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:40:19.861052 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:40:19.861052 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:40:19.863136 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:40:19.863136 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:40:19.863136 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 28 08:40:19.863136 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 28 08:40:19.863136 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 28 08:40:19.863136 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 28 08:40:19.863136 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 28 08:40:19.863136 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 28 08:40:19.863136 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 28 08:40:19.863136 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application Jul 28 08:40:19.863136 dv-cinder-851351-1-smb devstack@keystone.service[282899]: [pid: 282899|app: 0|req: 634/1267] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 08:40:19 2022] GET /identity/v3/users/placement => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:40:19.866671 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb87aa4-f150-465e-9f5a-1da7db9a6d01 None admin] Authenticating user token {{(pid=282898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:40:19.990555 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb87aa4-f150-465e-9f5a-1da7db9a6d01 None admin] Validating token access rules against request {{(pid=282898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:40:20.029091 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3422331-86e1-4f30-87d0-91cf097ae7d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:40:20.029727 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3422331-86e1-4f30-87d0-91cf097ae7d1 None admin] REQUEST_METHOD: `GET` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:40:20.030009 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3422331-86e1-4f30-87d0-91cf097ae7d1 None admin] SCRIPT_NAME: `/identity` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:40:20.030282 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3422331-86e1-4f30-87d0-91cf097ae7d1 None admin] PATH_INFO: `/v3/users` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:40:20.031108 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3422331-86e1-4f30-87d0-91cf097ae7d1 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=282898) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:40:20.031421 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3422331-86e1-4f30-87d0-91cf097ae7d1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:40:20.032913 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3422331-86e1-4f30-87d0-91cf097ae7d1 None admin] RBAC: Authorization granted {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:40:20.043668 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG dbcounter [-] [282898] Writing DB stats keystone:SELECT=100 {{(pid=282898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:40:20.053950 dv-cinder-851351-1-smb devstack@keystone.service[282898]: [pid: 282898|app: 0|req: 634/1268] 10.222.0.42 () {56 vars in 1143 bytes} [Thu Jul 28 08:40:19 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:40:20.063479 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b162ef-a39b-4070-8da2-9e810f03c143 None admin] Authenticating user token {{(pid=282899) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:40:20.177997 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b162ef-a39b-4070-8da2-9e810f03c143 None admin] Validating token access rules against request {{(pid=282899) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:40:20.214837 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad02811-0933-4ef1-b573-7d256d1ce6a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282899) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:40:20.215503 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad02811-0933-4ef1-b573-7d256d1ce6a5 None admin] REQUEST_METHOD: `GET` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:40:20.215790 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad02811-0933-4ef1-b573-7d256d1ce6a5 None admin] SCRIPT_NAME: `/identity` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:40:20.216062 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad02811-0933-4ef1-b573-7d256d1ce6a5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:40:20.228075 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ad02811-0933-4ef1-b573-7d256d1ce6a5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:40:20.229593 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ad02811-0933-4ef1-b573-7d256d1ce6a5 None admin] RBAC: Authorization granted {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:40:20.245219 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application [None req-2ad02811-0933-4ef1-b573-7d256d1ce6a5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 08:40:20.245219 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:40:20.245219 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:40:20.245219 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:40:20.245219 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:40:20.245219 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:40:20.245219 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:40:20.245219 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:40:20.245219 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:40:20.245219 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:40:20.245219 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:40:20.245219 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:40:20.245219 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 08:40:20.245219 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 08:40:20.245219 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 08:40:20.247226 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 08:40:20.247226 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:40:20.247226 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:40:20.247226 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:40:20.247226 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:40:20.247226 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:40:20.247226 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:40:20.247226 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:40:20.247226 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application with Lock( Jul 28 08:40:20.247226 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:40:20.247226 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:40:20.247226 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:40:20.247226 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:40:20.247226 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:40:20.247226 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:40:20.247226 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:40:20.247226 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:40:20.249555 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 08:40:20.249555 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 08:40:20.249555 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 08:40:20.249555 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application Jul 28 08:40:20.249555 dv-cinder-851351-1-smb devstack@keystone.service[282899]: [pid: 282899|app: 0|req: 635/1269] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 08:40:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:40:20.253972 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3422331-86e1-4f30-87d0-91cf097ae7d1 None admin] Authenticating user token {{(pid=282898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:40:20.361287 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3422331-86e1-4f30-87d0-91cf097ae7d1 None admin] Validating token access rules against request {{(pid=282898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:40:20.405188 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df2cf1dc-c2e1-484c-8506-95fba20c8b47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:40:20.405965 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2cf1dc-c2e1-484c-8506-95fba20c8b47 None admin] REQUEST_METHOD: `GET` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:40:20.406171 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2cf1dc-c2e1-484c-8506-95fba20c8b47 None admin] SCRIPT_NAME: `/identity` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:40:20.406455 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2cf1dc-c2e1-484c-8506-95fba20c8b47 None admin] PATH_INFO: `/v3/domains` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:40:20.407346 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df2cf1dc-c2e1-484c-8506-95fba20c8b47 None admin] RBAC: Adding query filter params (name=Default) {{(pid=282898) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:40:20.407659 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df2cf1dc-c2e1-484c-8506-95fba20c8b47 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:40:20.409433 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df2cf1dc-c2e1-484c-8506-95fba20c8b47 None admin] RBAC: Authorization granted {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:40:20.424655 dv-cinder-851351-1-smb devstack@keystone.service[282898]: [pid: 282898|app: 0|req: 635/1270] 10.222.0.42 () {56 vars in 1109 bytes} [Thu Jul 28 08:40:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:40:20.431935 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad02811-0933-4ef1-b573-7d256d1ce6a5 None admin] Authenticating user token {{(pid=282899) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:40:20.491455 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG dbcounter [-] [282899] Writing DB stats keystone:SELECT=100 {{(pid=282899) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:40:20.571984 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad02811-0933-4ef1-b573-7d256d1ce6a5 None admin] Validating token access rules against request {{(pid=282899) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:40:20.609345 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae2e33f-6a8c-4ce2-b4f7-fdf7d87c3292 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282899) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:40:20.610008 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae2e33f-6a8c-4ce2-b4f7-fdf7d87c3292 None admin] REQUEST_METHOD: `GET` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:40:20.610290 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae2e33f-6a8c-4ce2-b4f7-fdf7d87c3292 None admin] SCRIPT_NAME: `/identity` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:40:20.610565 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae2e33f-6a8c-4ce2-b4f7-fdf7d87c3292 None admin] PATH_INFO: `/v3/projects/service` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:40:20.618100 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae2e33f-6a8c-4ce2-b4f7-fdf7d87c3292 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:40:20.619572 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae2e33f-6a8c-4ce2-b4f7-fdf7d87c3292 None admin] RBAC: Authorization granted {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:40:20.631853 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application [None req-4ae2e33f-6a8c-4ce2-b4f7-fdf7d87c3292 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 08:40:20.631853 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:40:20.631853 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:40:20.631853 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:40:20.631853 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:40:20.631853 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:40:20.631853 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:40:20.631853 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:40:20.631853 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:40:20.631853 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:40:20.631853 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:40:20.631853 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:40:20.631853 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 28 08:40:20.631853 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 28 08:40:20.631853 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 28 08:40:20.633801 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 28 08:40:20.633801 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:40:20.633801 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:40:20.633801 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:40:20.633801 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:40:20.633801 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:40:20.633801 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:40:20.633801 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:40:20.633801 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application with Lock( Jul 28 08:40:20.633801 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:40:20.633801 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:40:20.633801 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:40:20.633801 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:40:20.633801 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:40:20.633801 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:40:20.633801 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:40:20.633801 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:40:20.635947 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 28 08:40:20.635947 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 28 08:40:20.635947 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 28 08:40:20.635947 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 28 08:40:20.635947 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 28 08:40:20.635947 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 28 08:40:20.635947 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 08:40:20.635947 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application Jul 28 08:40:20.635947 dv-cinder-851351-1-smb devstack@keystone.service[282899]: [pid: 282899|app: 0|req: 636/1271] 10.222.0.42 () {56 vars in 1111 bytes} [Thu Jul 28 08:40:20 2022] GET /identity/v3/projects/service => generated 88 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:40:20.641456 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df2cf1dc-c2e1-484c-8506-95fba20c8b47 None admin] Authenticating user token {{(pid=282898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:40:20.707255 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG dbcounter [-] [282898] Writing DB stats keystone:SELECT=100 {{(pid=282898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:40:20.752179 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df2cf1dc-c2e1-484c-8506-95fba20c8b47 None admin] Validating token access rules against request {{(pid=282898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:40:20.788229 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a078fa8d-0d27-44a4-aa57-b4b68b5721a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:40:20.788887 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a078fa8d-0d27-44a4-aa57-b4b68b5721a7 None admin] REQUEST_METHOD: `GET` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:40:20.789168 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a078fa8d-0d27-44a4-aa57-b4b68b5721a7 None admin] SCRIPT_NAME: `/identity` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:40:20.789439 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a078fa8d-0d27-44a4-aa57-b4b68b5721a7 None admin] PATH_INFO: `/v3/projects` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:40:20.790197 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a078fa8d-0d27-44a4-aa57-b4b68b5721a7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=282898) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:40:20.790501 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a078fa8d-0d27-44a4-aa57-b4b68b5721a7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:40:20.791936 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a078fa8d-0d27-44a4-aa57-b4b68b5721a7 None admin] RBAC: Authorization granted {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:40:20.804959 dv-cinder-851351-1-smb devstack@keystone.service[282898]: [pid: 282898|app: 0|req: 636/1272] 10.222.0.42 () {56 vars in 1148 bytes} [Thu Jul 28 08:40:20 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 08:40:20.815214 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae2e33f-6a8c-4ce2-b4f7-fdf7d87c3292 None admin] Authenticating user token {{(pid=282899) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:40:20.913237 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG dbcounter [-] [282899] Writing DB stats keystone:SELECT=100 {{(pid=282899) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:40:20.923135 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae2e33f-6a8c-4ce2-b4f7-fdf7d87c3292 None admin] Validating token access rules against request {{(pid=282899) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:40:20.967355 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b107291e-c0c5-4293-aacf-41ec2b4fa7f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282899) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:40:20.968415 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b107291e-c0c5-4293-aacf-41ec2b4fa7f0 None admin] REQUEST_METHOD: `PUT` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:40:20.968945 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b107291e-c0c5-4293-aacf-41ec2b4fa7f0 None admin] SCRIPT_NAME: `/identity` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:40:20.969428 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b107291e-c0c5-4293-aacf-41ec2b4fa7f0 None admin] PATH_INFO: `/v3/projects/5cde68cbfb9042dc9f36af3aacea2473/users/bba431c3832c4dd5bcd296d3247840c0/roles/a0e2a00bf94d40f38629d6b5293e3aee` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:40:20.972864 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b107291e-c0c5-4293-aacf-41ec2b4fa7f0 None admin] RBAC: Authorizing `identity:create_grant(project_id=5cde68cbfb9042dc9f36af3aacea2473, user_id=bba431c3832c4dd5bcd296d3247840c0, role_id=a0e2a00bf94d40f38629d6b5293e3aee)` {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:40:20.975546 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b107291e-c0c5-4293-aacf-41ec2b4fa7f0 None admin] RBAC: Authorization granted {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:40:20.993480 dv-cinder-851351-1-smb devstack@keystone.service[282899]: [pid: 282899|app: 0|req: 637/1273] 10.222.0.42 () {58 vars in 1439 bytes} [Thu Jul 28 08:40:20 2022] PUT /identity/v3/projects/5cde68cbfb9042dc9f36af3aacea2473/users/bba431c3832c4dd5bcd296d3247840c0/roles/a0e2a00bf94d40f38629d6b5293e3aee => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 08:40:23.063905 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746f3e44-b74f-437c-b6e6-83334672caa4 None None] REQUEST_METHOD: `GET` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:40:23.064837 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746f3e44-b74f-437c-b6e6-83334672caa4 None None] SCRIPT_NAME: `/identity` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:40:23.064837 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746f3e44-b74f-437c-b6e6-83334672caa4 None None] PATH_INFO: `/` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:40:23.065877 dv-cinder-851351-1-smb devstack@keystone.service[282898]: [pid: 282898|app: 0|req: 637/1274] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 08:40:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 08:40:23.071801 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7aeca3-dc4c-4b1c-8de1-dcb967b003eb None None] REQUEST_METHOD: `POST` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:40:23.072297 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7aeca3-dc4c-4b1c-8de1-dcb967b003eb None None] SCRIPT_NAME: `/identity` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:40:23.072297 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7aeca3-dc4c-4b1c-8de1-dcb967b003eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:40:23.092312 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.auth.core [None req-ad7aeca3-dc4c-4b1c-8de1-dcb967b003eb None None] MFA Rules not processed for user `2be990a66857410a87ffa7609aec4f7b`. Rule list: `[]` (Enabled: `True`). {{(pid=282899) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 08:40:23.093609 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.fernet_utils [None req-ad7aeca3-dc4c-4b1c-8de1-dcb967b003eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=282899) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:40:23.165639 dv-cinder-851351-1-smb devstack@keystone.service[282899]: [pid: 282899|app: 0|req: 638/1275] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 08:40:23 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 08:40:23.189521 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746f3e44-b74f-437c-b6e6-83334672caa4 None None] Authenticating user token {{(pid=282898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:40:23.305298 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746f3e44-b74f-437c-b6e6-83334672caa4 None None] Validating token access rules against request {{(pid=282898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:40:23.324378 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG dbcounter [-] [282898] Writing DB stats keystone:SELECT=100 {{(pid=282898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:40:23.344344 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aefb3c60-6793-4f1c-8eea-d402b35caeca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:40:23.345041 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aefb3c60-6793-4f1c-8eea-d402b35caeca None admin] REQUEST_METHOD: `GET` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:40:23.345325 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aefb3c60-6793-4f1c-8eea-d402b35caeca None admin] SCRIPT_NAME: `/identity` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:40:23.345603 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aefb3c60-6793-4f1c-8eea-d402b35caeca None admin] PATH_INFO: `/v3/roles/admin` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:40:23.357035 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aefb3c60-6793-4f1c-8eea-d402b35caeca None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 08:40:23.362069 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application [None req-aefb3c60-6793-4f1c-8eea-d402b35caeca None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 08:40:23.362069 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:40:23.362069 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:40:23.362069 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:40:23.362069 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:40:23.362069 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:40:23.362069 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:40:23.362069 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:40:23.362069 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:40:23.362069 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:40:23.362069 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:40:23.362069 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:40:23.362069 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 08:40:23.362069 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 08:40:23.362069 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 08:40:23.362069 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 08:40:23.363194 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 08:40:23.363194 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 08:40:23.363194 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 08:40:23.363194 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 08:40:23.363194 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:40:23.363194 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:40:23.363194 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:40:23.363194 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:40:23.363194 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:40:23.363194 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:40:23.363194 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:40:23.363194 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application with Lock( Jul 28 08:40:23.363194 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:40:23.363194 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:40:23.363194 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:40:23.363194 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:40:23.364273 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:40:23.364273 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:40:23.364273 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:40:23.364273 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:40:23.364273 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 08:40:23.364273 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 08:40:23.364273 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 08:40:23.364273 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 08:40:23.364273 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 08:40:23.364273 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 08:40:23.364273 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 08:40:23.364273 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application Jul 28 08:40:23.364273 dv-cinder-851351-1-smb devstack@keystone.service[282898]: [pid: 282898|app: 0|req: 638/1276] 10.222.0.42 () {56 vars in 1096 bytes} [Thu Jul 28 08:40:23 2022] GET /identity/v3/roles/admin => generated 83 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:40:23.370399 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad7aeca3-dc4c-4b1c-8de1-dcb967b003eb None None] Authenticating user token {{(pid=282899) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:40:23.489308 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG dbcounter [-] [282899] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=282899) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:40:23.511932 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad7aeca3-dc4c-4b1c-8de1-dcb967b003eb None None] Validating token access rules against request {{(pid=282899) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:40:23.547896 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d219a129-40ee-491e-843e-e001a088896e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282899) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:40:23.548525 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d219a129-40ee-491e-843e-e001a088896e None admin] REQUEST_METHOD: `GET` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:40:23.548840 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d219a129-40ee-491e-843e-e001a088896e None admin] SCRIPT_NAME: `/identity` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:40:23.549128 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d219a129-40ee-491e-843e-e001a088896e None admin] PATH_INFO: `/v3/roles` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:40:23.549874 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d219a129-40ee-491e-843e-e001a088896e None admin] RBAC: Adding query filter params (name=admin) {{(pid=282899) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:40:23.550179 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d219a129-40ee-491e-843e-e001a088896e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:40:23.551576 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d219a129-40ee-491e-843e-e001a088896e None admin] RBAC: Authorization granted {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:40:23.560546 dv-cinder-851351-1-smb devstack@keystone.service[282899]: [pid: 282899|app: 0|req: 639/1277] 10.222.0.42 () {56 vars in 1099 bytes} [Thu Jul 28 08:40:23 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:40:23.566779 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aefb3c60-6793-4f1c-8eea-d402b35caeca None admin] Authenticating user token {{(pid=282898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:40:23.677955 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aefb3c60-6793-4f1c-8eea-d402b35caeca None admin] Validating token access rules against request {{(pid=282898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:40:23.716161 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77752088-0473-40a6-b797-e83c5190ecc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:40:23.716959 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77752088-0473-40a6-b797-e83c5190ecc9 None admin] REQUEST_METHOD: `GET` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:40:23.717240 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77752088-0473-40a6-b797-e83c5190ecc9 None admin] SCRIPT_NAME: `/identity` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:40:23.717511 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77752088-0473-40a6-b797-e83c5190ecc9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:40:23.730345 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77752088-0473-40a6-b797-e83c5190ecc9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:40:23.732203 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77752088-0473-40a6-b797-e83c5190ecc9 None admin] RBAC: Authorization granted {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:40:23.747492 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application [None req-77752088-0473-40a6-b797-e83c5190ecc9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 08:40:23.747492 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:40:23.747492 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:40:23.747492 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:40:23.747492 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:40:23.747492 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:40:23.747492 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:40:23.747492 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:40:23.747492 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:40:23.747492 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:40:23.747492 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:40:23.747492 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:40:23.747492 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 08:40:23.747492 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 08:40:23.747492 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 08:40:23.748808 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 08:40:23.748808 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:40:23.748808 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:40:23.748808 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:40:23.748808 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:40:23.748808 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:40:23.748808 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:40:23.748808 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:40:23.748808 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application with Lock( Jul 28 08:40:23.748808 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:40:23.748808 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:40:23.748808 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:40:23.748808 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:40:23.748808 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:40:23.748808 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:40:23.748808 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:40:23.748808 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:40:23.750112 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 08:40:23.750112 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 08:40:23.750112 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 08:40:23.750112 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application Jul 28 08:40:23.750112 dv-cinder-851351-1-smb devstack@keystone.service[282898]: [pid: 282898|app: 0|req: 639/1278] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 08:40:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:40:23.754888 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d219a129-40ee-491e-843e-e001a088896e None admin] Authenticating user token {{(pid=282899) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:40:23.864691 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d219a129-40ee-491e-843e-e001a088896e None admin] Validating token access rules against request {{(pid=282899) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:40:23.899973 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f03f69e-c141-46d4-914a-1b3888c6ca7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282899) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:40:23.900609 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f03f69e-c141-46d4-914a-1b3888c6ca7b None admin] REQUEST_METHOD: `GET` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:40:23.900927 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f03f69e-c141-46d4-914a-1b3888c6ca7b None admin] SCRIPT_NAME: `/identity` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:40:23.901202 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f03f69e-c141-46d4-914a-1b3888c6ca7b None admin] PATH_INFO: `/v3/domains` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:40:23.901913 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f03f69e-c141-46d4-914a-1b3888c6ca7b None admin] RBAC: Adding query filter params (name=Default) {{(pid=282899) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:40:23.902222 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f03f69e-c141-46d4-914a-1b3888c6ca7b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:40:23.903638 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f03f69e-c141-46d4-914a-1b3888c6ca7b None admin] RBAC: Authorization granted {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:40:23.916238 dv-cinder-851351-1-smb devstack@keystone.service[282899]: [pid: 282899|app: 0|req: 640/1279] 10.222.0.42 () {56 vars in 1109 bytes} [Thu Jul 28 08:40:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:40:23.922421 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77752088-0473-40a6-b797-e83c5190ecc9 None admin] Authenticating user token {{(pid=282898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:40:23.955404 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG dbcounter [-] [282898] Writing DB stats keystone:SELECT=100 {{(pid=282898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:40:24.035250 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77752088-0473-40a6-b797-e83c5190ecc9 None admin] Validating token access rules against request {{(pid=282898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:40:24.095001 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa387c93-9211-49fa-8236-14cbc9e831fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:40:24.096096 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa387c93-9211-49fa-8236-14cbc9e831fa None admin] REQUEST_METHOD: `GET` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:40:24.096586 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa387c93-9211-49fa-8236-14cbc9e831fa None admin] SCRIPT_NAME: `/identity` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:40:24.097120 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa387c93-9211-49fa-8236-14cbc9e831fa None admin] PATH_INFO: `/v3/users/placement` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:40:24.111046 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa387c93-9211-49fa-8236-14cbc9e831fa None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:40:24.113614 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa387c93-9211-49fa-8236-14cbc9e831fa None admin] RBAC: Authorization granted {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:40:24.135061 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application [None req-fa387c93-9211-49fa-8236-14cbc9e831fa None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 28 08:40:24.135061 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:40:24.135061 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:40:24.135061 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:40:24.135061 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:40:24.135061 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:40:24.135061 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:40:24.135061 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:40:24.135061 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:40:24.135061 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:40:24.135061 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:40:24.135061 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:40:24.135061 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 28 08:40:24.135061 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 28 08:40:24.135061 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 28 08:40:24.135061 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 28 08:40:24.136461 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:40:24.136461 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:40:24.136461 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 28 08:40:24.136461 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 08:40:24.136461 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 28 08:40:24.136461 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 08:40:24.136461 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:40:24.136461 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:40:24.136461 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:40:24.136461 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:40:24.136461 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:40:24.136461 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application with Lock( Jul 28 08:40:24.136461 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:40:24.136461 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:40:24.136461 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:40:24.136461 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:40:24.136461 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:40:24.136461 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:40:24.137911 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:40:24.137911 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:40:24.137911 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 28 08:40:24.137911 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 28 08:40:24.137911 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 28 08:40:24.137911 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 28 08:40:24.137911 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 28 08:40:24.137911 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 28 08:40:24.137911 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 28 08:40:24.137911 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application Jul 28 08:40:24.137911 dv-cinder-851351-1-smb devstack@keystone.service[282898]: [pid: 282898|app: 0|req: 640/1280] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 08:40:23 2022] GET /identity/v3/users/placement => generated 87 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:40:24.143554 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f03f69e-c141-46d4-914a-1b3888c6ca7b None admin] Authenticating user token {{(pid=282899) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:40:24.147886 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG dbcounter [-] [282899] Writing DB stats keystone:SELECT=100 {{(pid=282899) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:40:24.252561 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f03f69e-c141-46d4-914a-1b3888c6ca7b None admin] Validating token access rules against request {{(pid=282899) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:40:24.289126 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1cc62db-4475-4f1d-bb14-c8507dfed0d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282899) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:40:24.289741 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1cc62db-4475-4f1d-bb14-c8507dfed0d1 None admin] REQUEST_METHOD: `GET` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:40:24.290025 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1cc62db-4475-4f1d-bb14-c8507dfed0d1 None admin] SCRIPT_NAME: `/identity` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:40:24.290304 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1cc62db-4475-4f1d-bb14-c8507dfed0d1 None admin] PATH_INFO: `/v3/users` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:40:24.291125 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1cc62db-4475-4f1d-bb14-c8507dfed0d1 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=282899) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:40:24.291404 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1cc62db-4475-4f1d-bb14-c8507dfed0d1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:40:24.292925 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1cc62db-4475-4f1d-bb14-c8507dfed0d1 None admin] RBAC: Authorization granted {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:40:24.312073 dv-cinder-851351-1-smb devstack@keystone.service[282899]: [pid: 282899|app: 0|req: 641/1281] 10.222.0.42 () {56 vars in 1143 bytes} [Thu Jul 28 08:40:24 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:40:24.318330 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa387c93-9211-49fa-8236-14cbc9e831fa None admin] Authenticating user token {{(pid=282898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:40:24.420912 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG dbcounter [-] [282898] Writing DB stats keystone:SELECT=100 {{(pid=282898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:40:24.430157 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa387c93-9211-49fa-8236-14cbc9e831fa None admin] Validating token access rules against request {{(pid=282898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:40:24.466221 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e37098-97af-463f-9c65-39788420afd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:40:24.466921 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e37098-97af-463f-9c65-39788420afd6 None admin] REQUEST_METHOD: `GET` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:40:24.467201 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e37098-97af-463f-9c65-39788420afd6 None admin] SCRIPT_NAME: `/identity` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:40:24.467472 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e37098-97af-463f-9c65-39788420afd6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:40:24.538457 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e37098-97af-463f-9c65-39788420afd6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:40:24.539845 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e37098-97af-463f-9c65-39788420afd6 None admin] RBAC: Authorization granted {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:40:24.641413 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG dbcounter [-] [282898] Writing DB stats keystone:SELECT=100 {{(pid=282898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:40:24.653107 dv-cinder-851351-1-smb devstack@keystone.service[282898]: [pid: 282898|app: 0|req: 641/1282] 10.222.0.42 () {58 vars in 1282 bytes} [Thu Jul 28 08:40:24 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 335 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 28 08:40:24.659552 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1cc62db-4475-4f1d-bb14-c8507dfed0d1 None admin] Authenticating user token {{(pid=282899) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:40:24.735317 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG dbcounter [-] [282899] Writing DB stats keystone:SELECT=100 {{(pid=282899) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:40:24.783332 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1cc62db-4475-4f1d-bb14-c8507dfed0d1 None admin] Validating token access rules against request {{(pid=282899) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:40:24.835575 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24a2e5f-337b-4b66-a483-ca4edfe82d1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282899) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:40:24.836262 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24a2e5f-337b-4b66-a483-ca4edfe82d1e None admin] REQUEST_METHOD: `GET` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:40:24.836544 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24a2e5f-337b-4b66-a483-ca4edfe82d1e None admin] SCRIPT_NAME: `/identity` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:40:24.837013 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24a2e5f-337b-4b66-a483-ca4edfe82d1e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:40:24.849736 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c24a2e5f-337b-4b66-a483-ca4edfe82d1e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:40:24.851240 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c24a2e5f-337b-4b66-a483-ca4edfe82d1e None admin] RBAC: Authorization granted {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:40:24.868147 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application [None req-c24a2e5f-337b-4b66-a483-ca4edfe82d1e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 08:40:24.868147 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:40:24.868147 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:40:24.868147 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:40:24.868147 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:40:24.868147 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:40:24.868147 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:40:24.868147 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:40:24.868147 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:40:24.868147 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:40:24.868147 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:40:24.868147 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:40:24.868147 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 08:40:24.868147 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 08:40:24.868147 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 08:40:24.870127 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 08:40:24.870127 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:40:24.870127 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:40:24.870127 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:40:24.870127 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:40:24.870127 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:40:24.870127 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:40:24.870127 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:40:24.870127 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application with Lock( Jul 28 08:40:24.870127 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:40:24.870127 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:40:24.870127 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:40:24.870127 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:40:24.870127 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:40:24.870127 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:40:24.870127 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:40:24.870127 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:40:24.871960 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 08:40:24.871960 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 08:40:24.871960 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 08:40:24.871960 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application Jul 28 08:40:24.871960 dv-cinder-851351-1-smb devstack@keystone.service[282899]: [pid: 282899|app: 0|req: 642/1283] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 08:40:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:40:24.875914 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e37098-97af-463f-9c65-39788420afd6 None admin] Authenticating user token {{(pid=282898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:40:24.986620 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e37098-97af-463f-9c65-39788420afd6 None admin] Validating token access rules against request {{(pid=282898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:40:25.043103 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7077f2d1-ef91-487e-ae29-860d8b9bf881 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:40:25.044164 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7077f2d1-ef91-487e-ae29-860d8b9bf881 None admin] REQUEST_METHOD: `GET` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:40:25.044765 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7077f2d1-ef91-487e-ae29-860d8b9bf881 None admin] SCRIPT_NAME: `/identity` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:40:25.045237 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7077f2d1-ef91-487e-ae29-860d8b9bf881 None admin] PATH_INFO: `/v3/domains` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:40:25.046471 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7077f2d1-ef91-487e-ae29-860d8b9bf881 None admin] RBAC: Adding query filter params (name=Default) {{(pid=282898) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:40:25.047018 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7077f2d1-ef91-487e-ae29-860d8b9bf881 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:40:25.049639 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7077f2d1-ef91-487e-ae29-860d8b9bf881 None admin] RBAC: Authorization granted {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:40:25.071495 dv-cinder-851351-1-smb devstack@keystone.service[282898]: [pid: 282898|app: 0|req: 642/1284] 10.222.0.42 () {56 vars in 1109 bytes} [Thu Jul 28 08:40:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:40:25.077491 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24a2e5f-337b-4b66-a483-ca4edfe82d1e None admin] Authenticating user token {{(pid=282899) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:40:25.193163 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24a2e5f-337b-4b66-a483-ca4edfe82d1e None admin] Validating token access rules against request {{(pid=282899) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:40:25.209632 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG dbcounter [-] [282899] Writing DB stats keystone:SELECT=100 {{(pid=282899) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:40:25.232005 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1986976-63dc-4932-84e7-f0391973030d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282899) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:40:25.232704 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1986976-63dc-4932-84e7-f0391973030d None admin] REQUEST_METHOD: `GET` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:40:25.232988 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1986976-63dc-4932-84e7-f0391973030d None admin] SCRIPT_NAME: `/identity` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:40:25.233267 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1986976-63dc-4932-84e7-f0391973030d None admin] PATH_INFO: `/v3/projects/service` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:40:25.240918 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1986976-63dc-4932-84e7-f0391973030d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:40:25.242455 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1986976-63dc-4932-84e7-f0391973030d None admin] RBAC: Authorization granted {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:40:25.254906 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application [None req-c1986976-63dc-4932-84e7-f0391973030d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 08:40:25.254906 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:40:25.254906 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:40:25.254906 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:40:25.254906 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:40:25.254906 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:40:25.254906 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:40:25.254906 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:40:25.254906 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:40:25.254906 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:40:25.254906 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:40:25.254906 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:40:25.254906 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 28 08:40:25.254906 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 28 08:40:25.254906 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 28 08:40:25.256260 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 28 08:40:25.256260 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:40:25.256260 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:40:25.256260 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:40:25.256260 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:40:25.256260 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:40:25.256260 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:40:25.256260 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:40:25.256260 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application with Lock( Jul 28 08:40:25.256260 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:40:25.256260 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:40:25.256260 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:40:25.256260 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:40:25.256260 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:40:25.256260 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:40:25.256260 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:40:25.256260 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:40:25.257627 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 28 08:40:25.257627 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 28 08:40:25.257627 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 28 08:40:25.257627 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 28 08:40:25.257627 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 28 08:40:25.257627 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 28 08:40:25.257627 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 08:40:25.257627 dv-cinder-851351-1-smb devstack@keystone.service[282899]: ERROR keystone.server.flask.application Jul 28 08:40:25.257627 dv-cinder-851351-1-smb devstack@keystone.service[282899]: [pid: 282899|app: 0|req: 643/1285] 10.222.0.42 () {56 vars in 1111 bytes} [Thu Jul 28 08:40:25 2022] GET /identity/v3/projects/service => generated 88 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:40:25.262414 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7077f2d1-ef91-487e-ae29-860d8b9bf881 None admin] Authenticating user token {{(pid=282898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:40:25.315411 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG dbcounter [-] [282898] Writing DB stats keystone:SELECT=100 {{(pid=282898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:40:25.369288 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7077f2d1-ef91-487e-ae29-860d8b9bf881 None admin] Validating token access rules against request {{(pid=282898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:40:25.409460 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de004ca-a554-475d-b485-faf9477815fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:40:25.410177 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de004ca-a554-475d-b485-faf9477815fc None admin] REQUEST_METHOD: `GET` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:40:25.410550 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de004ca-a554-475d-b485-faf9477815fc None admin] SCRIPT_NAME: `/identity` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:40:25.410781 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de004ca-a554-475d-b485-faf9477815fc None admin] PATH_INFO: `/v3/projects` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:40:25.411591 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de004ca-a554-475d-b485-faf9477815fc None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=282898) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:40:25.411891 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de004ca-a554-475d-b485-faf9477815fc None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:40:25.413587 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de004ca-a554-475d-b485-faf9477815fc None admin] RBAC: Authorization granted {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:40:25.427307 dv-cinder-851351-1-smb devstack@keystone.service[282898]: [pid: 282898|app: 0|req: 643/1286] 10.222.0.42 () {56 vars in 1148 bytes} [Thu Jul 28 08:40:25 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:40:25.434226 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1986976-63dc-4932-84e7-f0391973030d None admin] Authenticating user token {{(pid=282899) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:40:25.558655 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1986976-63dc-4932-84e7-f0391973030d None admin] Validating token access rules against request {{(pid=282899) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:40:25.598456 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81cfa0da-9934-4c38-8e3d-32f5ce977488 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282899) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:40:25.599094 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81cfa0da-9934-4c38-8e3d-32f5ce977488 None admin] REQUEST_METHOD: `GET` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:40:25.599376 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81cfa0da-9934-4c38-8e3d-32f5ce977488 None admin] SCRIPT_NAME: `/identity` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:40:25.599651 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81cfa0da-9934-4c38-8e3d-32f5ce977488 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:40:25.600457 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81cfa0da-9934-4c38-8e3d-32f5ce977488 None admin] RBAC: Adding query filter params (role.id=a0e2a00bf94d40f38629d6b5293e3aee, scope.project.id=5cde68cbfb9042dc9f36af3aacea2473, user.id=bba431c3832c4dd5bcd296d3247840c0) {{(pid=282899) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:40:25.600798 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81cfa0da-9934-4c38-8e3d-32f5ce977488 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:40:25.602312 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81cfa0da-9934-4c38-8e3d-32f5ce977488 None admin] RBAC: Authorization granted {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:40:25.609396 dv-cinder-851351-1-smb devstack@keystone.service[282899]: [pid: 282899|app: 0|req: 644/1287] 10.222.0.42 () {56 vars in 1374 bytes} [Thu Jul 28 08:40:25 2022] GET /identity/v3/role_assignments?user.id=bba431c3832c4dd5bcd296d3247840c0&scope.project.id=5cde68cbfb9042dc9f36af3aacea2473&role.id=a0e2a00bf94d40f38629d6b5293e3aee => generated 608 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:40:27.763274 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e2c9ff-9334-4d17-9e6e-1f2eff9138ae None None] REQUEST_METHOD: `GET` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:40:27.763997 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e2c9ff-9334-4d17-9e6e-1f2eff9138ae None None] SCRIPT_NAME: `/identity` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:40:27.763997 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e2c9ff-9334-4d17-9e6e-1f2eff9138ae None None] PATH_INFO: `/` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:40:27.765349 dv-cinder-851351-1-smb devstack@keystone.service[282898]: [pid: 282898|app: 0|req: 644/1288] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 08:40:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 08:40:27.771325 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7bc6922-4546-4030-9231-9597e1a40106 None None] REQUEST_METHOD: `POST` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:40:27.771946 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7bc6922-4546-4030-9231-9597e1a40106 None None] SCRIPT_NAME: `/identity` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:40:27.771946 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7bc6922-4546-4030-9231-9597e1a40106 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:40:27.791049 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.auth.core [None req-b7bc6922-4546-4030-9231-9597e1a40106 None None] MFA Rules not processed for user `2be990a66857410a87ffa7609aec4f7b`. Rule list: `[]` (Enabled: `True`). {{(pid=282899) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 08:40:27.792282 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.fernet_utils [None req-b7bc6922-4546-4030-9231-9597e1a40106 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=282899) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:40:27.826245 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG dbcounter [-] [282899] Writing DB stats keystone:SELECT=100 {{(pid=282899) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:40:27.870399 dv-cinder-851351-1-smb devstack@keystone.service[282899]: [pid: 282899|app: 0|req: 645/1289] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 08:40:27 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 08:40:27.892522 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e2c9ff-9334-4d17-9e6e-1f2eff9138ae None None] Authenticating user token {{(pid=282898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:40:28.025392 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e2c9ff-9334-4d17-9e6e-1f2eff9138ae None None] Validating token access rules against request {{(pid=282898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:40:28.037565 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG dbcounter [-] [282898] Writing DB stats keystone:SELECT=100 {{(pid=282898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:40:28.065099 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f33a77-63bc-43af-9e1f-925b401011a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:40:28.065761 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f33a77-63bc-43af-9e1f-925b401011a6 None admin] REQUEST_METHOD: `GET` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:40:28.066046 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f33a77-63bc-43af-9e1f-925b401011a6 None admin] SCRIPT_NAME: `/identity` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:40:28.066323 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f33a77-63bc-43af-9e1f-925b401011a6 None admin] PATH_INFO: `/v3/services/placement` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:40:28.066968 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25f33a77-63bc-43af-9e1f-925b401011a6 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:40:28.068365 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25f33a77-63bc-43af-9e1f-925b401011a6 None admin] RBAC: Authorization granted {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:40:28.077835 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application [None req-25f33a77-63bc-43af-9e1f-925b401011a6 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jul 28 08:40:28.077835 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:40:28.077835 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 28 08:40:28.077835 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 28 08:40:28.077835 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 28 08:40:28.077835 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 28 08:40:28.077835 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 28 08:40:28.077835 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 08:40:28.077835 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 28 08:40:28.077835 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application Jul 28 08:40:28.077835 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 28 08:40:28.077835 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application Jul 28 08:40:28.077835 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:40:28.077835 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:40:28.077835 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:40:28.077835 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:40:28.077835 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:40:28.079725 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:40:28.079725 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:40:28.079725 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:40:28.079725 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:40:28.079725 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:40:28.079725 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:40:28.079725 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 28 08:40:28.079725 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 28 08:40:28.079725 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 28 08:40:28.079725 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 28 08:40:28.079725 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:40:28.079725 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:40:28.079725 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:40:28.079725 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:40:28.079725 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:40:28.079725 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:40:28.080990 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:40:28.080990 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application with Lock( Jul 28 08:40:28.080990 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:40:28.080990 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:40:28.080990 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:40:28.080990 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:40:28.080990 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:40:28.080990 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:40:28.080990 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:40:28.080990 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:40:28.080990 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 28 08:40:28.080990 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 08:40:28.080990 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 28 08:40:28.080990 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application Jul 28 08:40:28.084702 dv-cinder-851351-1-smb devstack@keystone.service[282898]: [pid: 282898|app: 0|req: 645/1290] 10.222.0.42 () {56 vars in 1117 bytes} [Thu Jul 28 08:40:27 2022] GET /identity/v3/services/placement => generated 90 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:40:28.085900 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7bc6922-4546-4030-9231-9597e1a40106 None None] Authenticating user token {{(pid=282899) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:40:28.197573 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7bc6922-4546-4030-9231-9597e1a40106 None None] Validating token access rules against request {{(pid=282899) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:40:28.238704 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007baec0-82fe-44d0-b840-308a4a302b85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282899) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:40:28.239351 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007baec0-82fe-44d0-b840-308a4a302b85 None admin] REQUEST_METHOD: `GET` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:40:28.239637 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007baec0-82fe-44d0-b840-308a4a302b85 None admin] SCRIPT_NAME: `/identity` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:40:28.239914 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007baec0-82fe-44d0-b840-308a4a302b85 None admin] PATH_INFO: `/v3/services` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:40:28.240627 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-007baec0-82fe-44d0-b840-308a4a302b85 None admin] RBAC: Adding query filter params (name=placement) {{(pid=282899) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:40:28.240969 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-007baec0-82fe-44d0-b840-308a4a302b85 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:40:28.242389 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-007baec0-82fe-44d0-b840-308a4a302b85 None admin] RBAC: Authorization granted {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:40:28.248228 dv-cinder-851351-1-smb devstack@keystone.service[282899]: [pid: 282899|app: 0|req: 646/1291] 10.222.0.42 () {56 vars in 1116 bytes} [Thu Jul 28 08:40:28 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:40:28.254753 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f33a77-63bc-43af-9e1f-925b401011a6 None admin] Authenticating user token {{(pid=282898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:40:28.396904 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f33a77-63bc-43af-9e1f-925b401011a6 None admin] Validating token access rules against request {{(pid=282898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:40:28.451893 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be583690-173d-4b5a-995f-c521bde4ca57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:40:28.453079 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be583690-173d-4b5a-995f-c521bde4ca57 None admin] REQUEST_METHOD: `GET` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:40:28.453573 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be583690-173d-4b5a-995f-c521bde4ca57 None admin] SCRIPT_NAME: `/identity` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:40:28.454516 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be583690-173d-4b5a-995f-c521bde4ca57 None admin] PATH_INFO: `/v3/services` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:40:28.455952 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be583690-173d-4b5a-995f-c521bde4ca57 None admin] RBAC: Adding query filter params (type=placement) {{(pid=282898) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:40:28.456656 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be583690-173d-4b5a-995f-c521bde4ca57 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:40:28.459492 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be583690-173d-4b5a-995f-c521bde4ca57 None admin] RBAC: Authorization granted {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:40:28.469539 dv-cinder-851351-1-smb devstack@keystone.service[282898]: [pid: 282898|app: 0|req: 646/1292] 10.222.0.42 () {56 vars in 1116 bytes} [Thu Jul 28 08:40:28 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:40:30.476728 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6067cc5-de6a-4e14-9d5a-e150724e731c None None] REQUEST_METHOD: `GET` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:40:30.477601 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6067cc5-de6a-4e14-9d5a-e150724e731c None None] SCRIPT_NAME: `/identity` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:40:30.477807 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6067cc5-de6a-4e14-9d5a-e150724e731c None None] PATH_INFO: `/` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:40:30.479218 dv-cinder-851351-1-smb devstack@keystone.service[282899]: [pid: 282899|app: 0|req: 647/1293] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 08:40:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 08:40:30.485020 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11e44b0-969d-44fc-b77e-3e60b69329d2 None None] REQUEST_METHOD: `POST` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:40:30.485581 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11e44b0-969d-44fc-b77e-3e60b69329d2 None None] SCRIPT_NAME: `/identity` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:40:30.485581 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11e44b0-969d-44fc-b77e-3e60b69329d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:40:30.505410 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.auth.core [None req-c11e44b0-969d-44fc-b77e-3e60b69329d2 None None] MFA Rules not processed for user `2be990a66857410a87ffa7609aec4f7b`. Rule list: `[]` (Enabled: `True`). {{(pid=282898) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 08:40:30.506624 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.fernet_utils [None req-c11e44b0-969d-44fc-b77e-3e60b69329d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=282898) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:40:30.538846 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG dbcounter [-] [282898] Writing DB stats keystone:SELECT=100 {{(pid=282898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:40:30.581040 dv-cinder-851351-1-smb devstack@keystone.service[282898]: [pid: 282898|app: 0|req: 647/1294] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 08:40:30 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 08:40:30.603531 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6067cc5-de6a-4e14-9d5a-e150724e731c None None] Authenticating user token {{(pid=282899) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:40:30.635652 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG dbcounter [-] [282899] Writing DB stats keystone:SELECT=100 {{(pid=282899) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:40:30.722571 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6067cc5-de6a-4e14-9d5a-e150724e731c None None] Validating token access rules against request {{(pid=282899) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:40:30.769534 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1605fd5d-b2bd-4b33-a609-655f27f08798 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282899) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:40:30.770111 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1605fd5d-b2bd-4b33-a609-655f27f08798 None admin] REQUEST_METHOD: `POST` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:40:30.770399 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1605fd5d-b2bd-4b33-a609-655f27f08798 None admin] SCRIPT_NAME: `/identity` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:40:30.770674 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1605fd5d-b2bd-4b33-a609-655f27f08798 None admin] PATH_INFO: `/v3/services` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:40:30.771401 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1605fd5d-b2bd-4b33-a609-655f27f08798 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:40:30.772865 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1605fd5d-b2bd-4b33-a609-655f27f08798 None admin] RBAC: Authorization granted {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:40:30.790765 dv-cinder-851351-1-smb devstack@keystone.service[282899]: [pid: 282899|app: 0|req: 648/1295] 10.222.0.42 () {60 vars in 1141 bytes} [Thu Jul 28 08:40:30 2022] POST /identity/v3/services => generated 246 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 08:40:32.811747 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d35938c-c8ef-44f0-bac7-424d0431c894 None None] REQUEST_METHOD: `GET` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:40:32.812328 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d35938c-c8ef-44f0-bac7-424d0431c894 None None] SCRIPT_NAME: `/identity` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:40:32.812328 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d35938c-c8ef-44f0-bac7-424d0431c894 None None] PATH_INFO: `/` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:40:32.813734 dv-cinder-851351-1-smb devstack@keystone.service[282898]: [pid: 282898|app: 0|req: 648/1296] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 08:40:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 08:40:32.819385 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2d3365-def1-4729-a895-a6c96b6da24c None None] REQUEST_METHOD: `POST` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:40:32.819877 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2d3365-def1-4729-a895-a6c96b6da24c None None] SCRIPT_NAME: `/identity` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:40:32.819987 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2d3365-def1-4729-a895-a6c96b6da24c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:40:32.838756 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.auth.core [None req-ae2d3365-def1-4729-a895-a6c96b6da24c None None] MFA Rules not processed for user `2be990a66857410a87ffa7609aec4f7b`. Rule list: `[]` (Enabled: `True`). {{(pid=282899) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 08:40:32.840002 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.fernet_utils [None req-ae2d3365-def1-4729-a895-a6c96b6da24c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=282899) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:40:32.934414 dv-cinder-851351-1-smb devstack@keystone.service[282899]: [pid: 282899|app: 0|req: 649/1297] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 08:40:32 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 08:40:32.959482 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d35938c-c8ef-44f0-bac7-424d0431c894 None None] Authenticating user token {{(pid=282898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:40:33.094513 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d35938c-c8ef-44f0-bac7-424d0431c894 None None] Validating token access rules against request {{(pid=282898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:40:33.134437 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc1d7f0-3af5-4628-9773-0695162144a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:40:33.135104 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc1d7f0-3af5-4628-9773-0695162144a6 None admin] REQUEST_METHOD: `GET` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:40:33.135380 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc1d7f0-3af5-4628-9773-0695162144a6 None admin] SCRIPT_NAME: `/identity` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:40:33.135654 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc1d7f0-3af5-4628-9773-0695162144a6 None admin] PATH_INFO: `/v3/services/placement` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:40:33.136283 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc1d7f0-3af5-4628-9773-0695162144a6 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:40:33.137727 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc1d7f0-3af5-4628-9773-0695162144a6 None admin] RBAC: Authorization granted {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:40:33.147678 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application [None req-9bc1d7f0-3af5-4628-9773-0695162144a6 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jul 28 08:40:33.147678 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:40:33.147678 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 28 08:40:33.147678 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 28 08:40:33.147678 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 28 08:40:33.147678 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 28 08:40:33.147678 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 28 08:40:33.147678 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 08:40:33.147678 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 28 08:40:33.147678 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application Jul 28 08:40:33.147678 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 28 08:40:33.147678 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application Jul 28 08:40:33.147678 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:40:33.147678 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:40:33.147678 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:40:33.147678 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:40:33.147678 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:40:33.149228 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:40:33.149228 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:40:33.149228 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:40:33.149228 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:40:33.149228 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:40:33.149228 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:40:33.149228 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 28 08:40:33.149228 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 28 08:40:33.149228 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 28 08:40:33.149228 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 28 08:40:33.149228 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:40:33.149228 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:40:33.149228 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:40:33.149228 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:40:33.149228 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:40:33.149228 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:40:33.150557 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:40:33.150557 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application with Lock( Jul 28 08:40:33.150557 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:40:33.150557 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:40:33.150557 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:40:33.150557 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:40:33.150557 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:40:33.150557 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:40:33.150557 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:40:33.150557 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:40:33.150557 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 28 08:40:33.150557 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 08:40:33.150557 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 28 08:40:33.150557 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application Jul 28 08:40:33.150557 dv-cinder-851351-1-smb devstack@keystone.service[282898]: [pid: 282898|app: 0|req: 649/1298] 10.222.0.42 () {56 vars in 1117 bytes} [Thu Jul 28 08:40:32 2022] GET /identity/v3/services/placement => generated 90 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:40:33.155412 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2d3365-def1-4729-a895-a6c96b6da24c None None] Authenticating user token {{(pid=282899) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:40:33.175503 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG dbcounter [-] [282899] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=282899) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:40:33.261680 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2d3365-def1-4729-a895-a6c96b6da24c None None] Validating token access rules against request {{(pid=282899) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:40:33.297566 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461abb2d-74e0-4ab6-90cb-e8dc2420807d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282899) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:40:33.298209 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461abb2d-74e0-4ab6-90cb-e8dc2420807d None admin] REQUEST_METHOD: `GET` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:40:33.298490 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461abb2d-74e0-4ab6-90cb-e8dc2420807d None admin] SCRIPT_NAME: `/identity` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:40:33.298764 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461abb2d-74e0-4ab6-90cb-e8dc2420807d None admin] PATH_INFO: `/v3/services` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:40:33.299457 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-461abb2d-74e0-4ab6-90cb-e8dc2420807d None admin] RBAC: Adding query filter params (name=placement) {{(pid=282899) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:40:33.299764 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-461abb2d-74e0-4ab6-90cb-e8dc2420807d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:40:33.301192 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-461abb2d-74e0-4ab6-90cb-e8dc2420807d None admin] RBAC: Authorization granted {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:40:33.306673 dv-cinder-851351-1-smb devstack@keystone.service[282899]: [pid: 282899|app: 0|req: 650/1299] 10.222.0.42 () {56 vars in 1116 bytes} [Thu Jul 28 08:40:33 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:40:33.313114 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc1d7f0-3af5-4628-9773-0695162144a6 None admin] Authenticating user token {{(pid=282898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:40:33.349755 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG dbcounter [-] [282898] Writing DB stats keystone:SELECT=100 {{(pid=282898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:40:33.441334 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc1d7f0-3af5-4628-9773-0695162144a6 None admin] Validating token access rules against request {{(pid=282898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:40:33.482079 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49768b0-0e6b-4f6f-b224-c4b491bc818d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:40:33.482720 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49768b0-0e6b-4f6f-b224-c4b491bc818d None admin] REQUEST_METHOD: `GET` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:40:33.483006 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49768b0-0e6b-4f6f-b224-c4b491bc818d None admin] SCRIPT_NAME: `/identity` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:40:33.483283 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49768b0-0e6b-4f6f-b224-c4b491bc818d None admin] PATH_INFO: `/v3/endpoints` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:40:33.484075 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d49768b0-0e6b-4f6f-b224-c4b491bc818d None admin] RBAC: Adding query filter params (interface=public, service_id=385ca550c1d24c828b7ff757c8e3afba, region_id=RegionOne) {{(pid=282898) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:40:33.484387 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d49768b0-0e6b-4f6f-b224-c4b491bc818d None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:40:33.485822 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d49768b0-0e6b-4f6f-b224-c4b491bc818d None admin] RBAC: Authorization granted {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:40:33.491647 dv-cinder-851351-1-smb devstack@keystone.service[282898]: [pid: 282898|app: 0|req: 650/1300] 10.222.0.42 () {56 vars in 1251 bytes} [Thu Jul 28 08:40:33 2022] GET /identity/v3/endpoints?service_id=385ca550c1d24c828b7ff757c8e3afba&interface=public®ion_id=RegionOne => generated 194 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:40:33.497642 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461abb2d-74e0-4ab6-90cb-e8dc2420807d None admin] Authenticating user token {{(pid=282899) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:40:33.589713 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG dbcounter [-] [282899] Writing DB stats keystone:SELECT=100 {{(pid=282899) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:40:33.609910 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461abb2d-74e0-4ab6-90cb-e8dc2420807d None admin] Validating token access rules against request {{(pid=282899) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:40:33.647159 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad21693-dd65-4b60-ba6f-2b074b471d6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282899) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:40:33.647886 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad21693-dd65-4b60-ba6f-2b074b471d6c None admin] REQUEST_METHOD: `GET` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:40:33.648236 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad21693-dd65-4b60-ba6f-2b074b471d6c None admin] SCRIPT_NAME: `/identity` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:40:33.648522 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad21693-dd65-4b60-ba6f-2b074b471d6c None admin] PATH_INFO: `/v3/services` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:40:33.649414 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ad21693-dd65-4b60-ba6f-2b074b471d6c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:40:33.651459 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ad21693-dd65-4b60-ba6f-2b074b471d6c None admin] RBAC: Authorization granted {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:40:33.662030 dv-cinder-851351-1-smb devstack@keystone.service[282899]: [pid: 282899|app: 0|req: 651/1301] 10.222.0.42 () {56 vars in 1087 bytes} [Thu Jul 28 08:40:33 2022] GET /identity/v3/services => generated 2191 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 08:40:35.733572 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5118a87-a5b7-47e1-9a0f-37f10cdf9375 None None] REQUEST_METHOD: `GET` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:40:35.734177 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5118a87-a5b7-47e1-9a0f-37f10cdf9375 None None] SCRIPT_NAME: `/identity` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:40:35.734177 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5118a87-a5b7-47e1-9a0f-37f10cdf9375 None None] PATH_INFO: `/` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:40:35.735493 dv-cinder-851351-1-smb devstack@keystone.service[282898]: [pid: 282898|app: 0|req: 651/1302] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 08:40:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 08:40:35.741216 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788d47b7-366b-40db-9e1b-8df213b38581 None None] REQUEST_METHOD: `POST` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:40:35.741980 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788d47b7-366b-40db-9e1b-8df213b38581 None None] SCRIPT_NAME: `/identity` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:40:35.741980 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788d47b7-366b-40db-9e1b-8df213b38581 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:40:35.761445 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.auth.core [None req-788d47b7-366b-40db-9e1b-8df213b38581 None None] MFA Rules not processed for user `2be990a66857410a87ffa7609aec4f7b`. Rule list: `[]` (Enabled: `True`). {{(pid=282899) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 08:40:35.762719 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.fernet_utils [None req-788d47b7-366b-40db-9e1b-8df213b38581 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=282899) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:40:35.857378 dv-cinder-851351-1-smb devstack@keystone.service[282899]: [pid: 282899|app: 0|req: 652/1303] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 08:40:35 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 08:40:35.884276 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5118a87-a5b7-47e1-9a0f-37f10cdf9375 None None] Authenticating user token {{(pid=282898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:40:35.993335 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG dbcounter [-] [282898] Writing DB stats keystone:SELECT=100 {{(pid=282898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:40:36.001309 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5118a87-a5b7-47e1-9a0f-37f10cdf9375 None None] Validating token access rules against request {{(pid=282898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:40:36.039557 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f226dc-7c50-4fbe-a2f7-a8a441ccd400 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:40:36.040216 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f226dc-7c50-4fbe-a2f7-a8a441ccd400 None admin] REQUEST_METHOD: `GET` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:40:36.040497 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f226dc-7c50-4fbe-a2f7-a8a441ccd400 None admin] SCRIPT_NAME: `/identity` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:40:36.040805 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f226dc-7c50-4fbe-a2f7-a8a441ccd400 None admin] PATH_INFO: `/v3/services/placement` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:40:36.041453 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f226dc-7c50-4fbe-a2f7-a8a441ccd400 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:40:36.042845 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f226dc-7c50-4fbe-a2f7-a8a441ccd400 None admin] RBAC: Authorization granted {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:40:36.053021 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application [None req-07f226dc-7c50-4fbe-a2f7-a8a441ccd400 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jul 28 08:40:36.053021 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:40:36.053021 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 28 08:40:36.053021 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 28 08:40:36.053021 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 28 08:40:36.053021 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 28 08:40:36.053021 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 28 08:40:36.053021 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 08:40:36.053021 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 28 08:40:36.053021 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application Jul 28 08:40:36.053021 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 28 08:40:36.053021 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application Jul 28 08:40:36.053021 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:40:36.053021 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:40:36.053021 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:40:36.053021 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:40:36.053021 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:40:36.054330 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:40:36.054330 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:40:36.054330 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:40:36.054330 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:40:36.054330 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:40:36.054330 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:40:36.054330 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 28 08:40:36.054330 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 28 08:40:36.054330 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 28 08:40:36.054330 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 28 08:40:36.054330 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:40:36.054330 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:40:36.054330 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:40:36.054330 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:40:36.054330 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:40:36.054330 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:40:36.055682 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:40:36.055682 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application with Lock( Jul 28 08:40:36.055682 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:40:36.055682 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:40:36.055682 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:40:36.055682 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:40:36.055682 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:40:36.055682 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:40:36.055682 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:40:36.055682 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:40:36.055682 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 28 08:40:36.055682 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 08:40:36.055682 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 28 08:40:36.055682 dv-cinder-851351-1-smb devstack@keystone.service[282898]: ERROR keystone.server.flask.application Jul 28 08:40:36.055682 dv-cinder-851351-1-smb devstack@keystone.service[282898]: [pid: 282898|app: 0|req: 652/1304] 10.222.0.42 () {56 vars in 1117 bytes} [Thu Jul 28 08:40:35 2022] GET /identity/v3/services/placement => generated 90 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:40:36.060623 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788d47b7-366b-40db-9e1b-8df213b38581 None None] Authenticating user token {{(pid=282899) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:40:36.152894 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG dbcounter [-] [282899] Writing DB stats keystone:SELECT=100 {{(pid=282899) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:40:36.183046 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788d47b7-366b-40db-9e1b-8df213b38581 None None] Validating token access rules against request {{(pid=282899) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:40:36.220521 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c74cf2-ecfe-4b72-b3c4-38b8afec4e47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282899) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:40:36.221186 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c74cf2-ecfe-4b72-b3c4-38b8afec4e47 None admin] REQUEST_METHOD: `GET` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:40:36.221468 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c74cf2-ecfe-4b72-b3c4-38b8afec4e47 None admin] SCRIPT_NAME: `/identity` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:40:36.221749 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c74cf2-ecfe-4b72-b3c4-38b8afec4e47 None admin] PATH_INFO: `/v3/services` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:40:36.222448 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61c74cf2-ecfe-4b72-b3c4-38b8afec4e47 None admin] RBAC: Adding query filter params (name=placement) {{(pid=282899) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:40:36.222762 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61c74cf2-ecfe-4b72-b3c4-38b8afec4e47 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:40:36.224170 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61c74cf2-ecfe-4b72-b3c4-38b8afec4e47 None admin] RBAC: Authorization granted {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:40:36.232614 dv-cinder-851351-1-smb devstack@keystone.service[282899]: [pid: 282899|app: 0|req: 653/1305] 10.222.0.42 () {56 vars in 1116 bytes} [Thu Jul 28 08:40:36 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:40:36.238814 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f226dc-7c50-4fbe-a2f7-a8a441ccd400 None admin] Authenticating user token {{(pid=282898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:40:36.346387 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f226dc-7c50-4fbe-a2f7-a8a441ccd400 None admin] Validating token access rules against request {{(pid=282898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:40:36.383626 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe81cbe-9b7e-47b4-aca3-08ce754bd4a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2be990a66857410a87ffa7609aec4f7b', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:40:36.384264 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe81cbe-9b7e-47b4-aca3-08ce754bd4a0 None admin] REQUEST_METHOD: `POST` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:40:36.384547 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe81cbe-9b7e-47b4-aca3-08ce754bd4a0 None admin] SCRIPT_NAME: `/identity` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:40:36.384851 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe81cbe-9b7e-47b4-aca3-08ce754bd4a0 None admin] PATH_INFO: `/v3/endpoints` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:40:36.385582 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fe81cbe-9b7e-47b4-aca3-08ce754bd4a0 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:40:36.387032 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fe81cbe-9b7e-47b4-aca3-08ce754bd4a0 None admin] RBAC: Authorization granted {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:40:36.415245 dv-cinder-851351-1-smb devstack@keystone.service[282898]: [pid: 282898|app: 0|req: 653/1306] 10.222.0.42 () {60 vars in 1144 bytes} [Thu Jul 28 08:40:36 2022] POST /identity/v3/endpoints => generated 331 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 08:40:46.228180 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG dbcounter [-] [282899] Writing DB stats keystone:SELECT=30 {{(pid=282899) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:40:46.408396 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG dbcounter [-] [282898] Writing DB stats keystone:SELECT=91,keystone:INSERT=1 {{(pid=282898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:41:43.073352 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e100125-136f-45c6-8732-90e907facd30 None None] REQUEST_METHOD: `GET` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:41:43.074489 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e100125-136f-45c6-8732-90e907facd30 None None] SCRIPT_NAME: `/identity` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:41:43.075062 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e100125-136f-45c6-8732-90e907facd30 None None] PATH_INFO: `/` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:41:43.076848 dv-cinder-851351-1-smb devstack@keystone.service[282899]: [pid: 282899|app: 0|req: 654/1307] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 08:41:43 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 08:41:43.083258 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4cb558-a6cc-4ac4-9113-c609742f638e None None] REQUEST_METHOD: `POST` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:41:43.083856 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4cb558-a6cc-4ac4-9113-c609742f638e None None] SCRIPT_NAME: `/identity` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:41:43.084058 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4cb558-a6cc-4ac4-9113-c609742f638e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:41:43.262547 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.auth.core [None req-cf4cb558-a6cc-4ac4-9113-c609742f638e None None] MFA Rules not processed for user `2be990a66857410a87ffa7609aec4f7b`. Rule list: `[]` (Enabled: `True`). {{(pid=282898) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 08:41:43.264006 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.fernet_utils [None req-cf4cb558-a6cc-4ac4-9113-c609742f638e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=282898) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:41:43.498951 dv-cinder-851351-1-smb devstack@keystone.service[282898]: [pid: 282898|app: 0|req: 654/1308] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 08:41:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 417 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 08:41:43.563036 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8573b2-5892-4070-a512-bd9298d089dc None None] REQUEST_METHOD: `GET` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:41:43.563504 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8573b2-5892-4070-a512-bd9298d089dc None None] SCRIPT_NAME: `/identity` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:41:43.563851 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8573b2-5892-4070-a512-bd9298d089dc None None] PATH_INFO: `/` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:41:43.565333 dv-cinder-851351-1-smb devstack@keystone.service[282899]: [pid: 282899|app: 0|req: 655/1309] 10.222.0.42 () {54 vars in 965 bytes} [Thu Jul 28 08:41:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 08:41:43.580175 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ffde09-7da7-4d3c-bc95-25c4100645ee None None] REQUEST_METHOD: `POST` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:41:43.580499 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ffde09-7da7-4d3c-bc95-25c4100645ee None None] SCRIPT_NAME: `/identity` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:41:43.580755 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ffde09-7da7-4d3c-bc95-25c4100645ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:41:43.759103 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.auth.core [None req-a6ffde09-7da7-4d3c-bc95-25c4100645ee None None] MFA Rules not processed for user `7a2fa5c253dc4112bca7074204f01b0a`. Rule list: `[]` (Enabled: `True`). {{(pid=282898) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 08:41:43.760489 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.fernet_utils [None req-a6ffde09-7da7-4d3c-bc95-25c4100645ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=282898) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:41:43.784841 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG dbcounter [-] [282898] Writing DB stats keystone:SELECT=100 {{(pid=282898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:41:43.952598 dv-cinder-851351-1-smb devstack@keystone.service[282898]: [pid: 282898|app: 0|req: 655/1310] 10.222.0.42 () {58 vars in 1062 bytes} [Thu Jul 28 08:41:43 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 374 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 08:41:43.962671 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8573b2-5892-4070-a512-bd9298d089dc None None] Authenticating user token {{(pid=282899) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:41:43.964585 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.fernet_utils [None req-cc8573b2-5892-4070-a512-bd9298d089dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=282899) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:41:44.116779 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8573b2-5892-4070-a512-bd9298d089dc None None] Validating token access rules against request {{(pid=282899) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:41:44.199668 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52665a93-5f06-474c-a1d1-7ece600a62ec service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a2fa5c253dc4112bca7074204f01b0a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cde68cbfb9042dc9f36af3aacea2473', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282899) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:41:44.200310 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52665a93-5f06-474c-a1d1-7ece600a62ec service neutron] REQUEST_METHOD: `GET` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:41:44.200835 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52665a93-5f06-474c-a1d1-7ece600a62ec service neutron] SCRIPT_NAME: `/identity` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:41:44.201412 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52665a93-5f06-474c-a1d1-7ece600a62ec service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:41:44.203378 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.fernet_utils [None req-52665a93-5f06-474c-a1d1-7ece600a62ec service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=282899) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:41:44.273264 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG dbcounter [-] [282899] Writing DB stats keystone:SELECT=100 {{(pid=282899) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:41:44.336760 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52665a93-5f06-474c-a1d1-7ece600a62ec service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:41:44.338512 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52665a93-5f06-474c-a1d1-7ece600a62ec service neutron] RBAC: Authorization granted {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:41:44.359579 dv-cinder-851351-1-smb devstack@keystone.service[282899]: [pid: 282899|app: 0|req: 656/1311] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Jul 28 08:41:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 397 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 08:41:46.721077 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016ec721-ca25-49cd-9034-6034f332c2ac None None] REQUEST_METHOD: `GET` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:41:46.721664 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016ec721-ca25-49cd-9034-6034f332c2ac None None] SCRIPT_NAME: `/identity` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:41:46.721664 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016ec721-ca25-49cd-9034-6034f332c2ac None None] PATH_INFO: `/` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:41:46.725013 dv-cinder-851351-1-smb devstack@keystone.service[282898]: [pid: 282898|app: 0|req: 656/1312] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 08:41:46 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 08:41:46.729562 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09adbfd-6d6a-4ec4-a886-ac515e3b0e73 None None] REQUEST_METHOD: `POST` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:41:46.730159 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09adbfd-6d6a-4ec4-a886-ac515e3b0e73 None None] SCRIPT_NAME: `/identity` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:41:46.730159 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09adbfd-6d6a-4ec4-a886-ac515e3b0e73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:41:46.819019 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.auth.core [None req-d09adbfd-6d6a-4ec4-a886-ac515e3b0e73 None None] MFA Rules not processed for user `2be990a66857410a87ffa7609aec4f7b`. Rule list: `[]` (Enabled: `True`). {{(pid=282899) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 08:41:46.820378 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.fernet_utils [None req-d09adbfd-6d6a-4ec4-a886-ac515e3b0e73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=282899) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:41:46.945661 dv-cinder-851351-1-smb devstack@keystone.service[282899]: [pid: 282899|app: 0|req: 657/1313] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 08:41:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 08:41:46.985126 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-016ec721-ca25-49cd-9034-6034f332c2ac None None] Authenticating user token {{(pid=282898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:41:46.986872 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.fernet_utils [None req-016ec721-ca25-49cd-9034-6034f332c2ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=282898) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:41:47.107822 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-016ec721-ca25-49cd-9034-6034f332c2ac None None] Validating token access rules against request {{(pid=282898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:41:47.189593 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG dbcounter [-] [282898] Writing DB stats keystone:SELECT=100 {{(pid=282898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:41:47.192926 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6380f219-2436-4d41-814b-d7d0c8da8ab7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a2fa5c253dc4112bca7074204f01b0a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cde68cbfb9042dc9f36af3aacea2473', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:41:47.193619 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6380f219-2436-4d41-814b-d7d0c8da8ab7 service neutron] REQUEST_METHOD: `GET` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:41:47.193909 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6380f219-2436-4d41-814b-d7d0c8da8ab7 service neutron] SCRIPT_NAME: `/identity` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:41:47.194222 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6380f219-2436-4d41-814b-d7d0c8da8ab7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:41:47.196419 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.fernet_utils [None req-6380f219-2436-4d41-814b-d7d0c8da8ab7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=282898) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:41:47.318412 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6380f219-2436-4d41-814b-d7d0c8da8ab7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:41:47.319892 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6380f219-2436-4d41-814b-d7d0c8da8ab7 service neutron] RBAC: Authorization granted {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:41:47.340126 dv-cinder-851351-1-smb devstack@keystone.service[282898]: [pid: 282898|app: 0|req: 657/1314] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Jul 28 08:41:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 356 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 08:41:49.676929 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad53dc76-c0f2-433b-b8d4-d7b0c065f119 None None] REQUEST_METHOD: `GET` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:41:49.677566 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad53dc76-c0f2-433b-b8d4-d7b0c065f119 None None] SCRIPT_NAME: `/identity` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:41:49.677566 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad53dc76-c0f2-433b-b8d4-d7b0c065f119 None None] PATH_INFO: `/` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:41:49.679008 dv-cinder-851351-1-smb devstack@keystone.service[282899]: [pid: 282899|app: 0|req: 658/1315] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 08:41:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 08:41:49.684219 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c5222c-d8c0-4cee-813c-a227fee4f014 None None] REQUEST_METHOD: `POST` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:41:49.684712 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c5222c-d8c0-4cee-813c-a227fee4f014 None None] SCRIPT_NAME: `/identity` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:41:49.684828 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c5222c-d8c0-4cee-813c-a227fee4f014 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:41:49.752712 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.auth.core [None req-e5c5222c-d8c0-4cee-813c-a227fee4f014 None None] MFA Rules not processed for user `ff1f8d5551c44d2781c7ed09cd18be32`. Rule list: `[]` (Enabled: `True`). {{(pid=282898) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 08:41:49.753952 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.fernet_utils [None req-e5c5222c-d8c0-4cee-813c-a227fee4f014 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=282898) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:41:49.807024 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG dbcounter [-] [282898] Writing DB stats keystone:SELECT=100 {{(pid=282898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:41:49.856494 dv-cinder-851351-1-smb devstack@keystone.service[282898]: [pid: 282898|app: 0|req: 658/1316] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 08:41:49 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 08:41:49.897753 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad53dc76-c0f2-433b-b8d4-d7b0c065f119 None None] Authenticating user token {{(pid=282899) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:41:49.899365 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.fernet_utils [None req-ad53dc76-c0f2-433b-b8d4-d7b0c065f119 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=282899) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:41:49.910862 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG dbcounter [-] [282899] Writing DB stats keystone:SELECT=100 {{(pid=282899) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:41:50.012571 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad53dc76-c0f2-433b-b8d4-d7b0c065f119 None None] Validating token access rules against request {{(pid=282899) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:41:50.090225 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15cd6196-9255-4548-baad-bb0a5410e0c4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a2fa5c253dc4112bca7074204f01b0a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cde68cbfb9042dc9f36af3aacea2473', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282899) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:41:50.090862 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15cd6196-9255-4548-baad-bb0a5410e0c4 service neutron] REQUEST_METHOD: `GET` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:41:50.091148 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15cd6196-9255-4548-baad-bb0a5410e0c4 service neutron] SCRIPT_NAME: `/identity` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:41:50.091472 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15cd6196-9255-4548-baad-bb0a5410e0c4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:41:50.093209 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.fernet_utils [None req-15cd6196-9255-4548-baad-bb0a5410e0c4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=282899) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:41:50.158883 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG dbcounter [-] [282899] Writing DB stats keystone:SELECT=100 {{(pid=282899) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:41:50.210047 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15cd6196-9255-4548-baad-bb0a5410e0c4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:41:50.211529 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15cd6196-9255-4548-baad-bb0a5410e0c4 service neutron] RBAC: Authorization granted {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:41:50.232347 dv-cinder-851351-1-smb devstack@keystone.service[282899]: [pid: 282899|app: 0|req: 659/1317] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Jul 28 08:41:49 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 335 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 08:41:52.826029 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c41ab8-b78e-42f3-b12b-f87d4baee8db None None] REQUEST_METHOD: `GET` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:41:52.826513 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c41ab8-b78e-42f3-b12b-f87d4baee8db None None] SCRIPT_NAME: `/identity` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:41:52.826613 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c41ab8-b78e-42f3-b12b-f87d4baee8db None None] PATH_INFO: `/` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:41:52.827956 dv-cinder-851351-1-smb devstack@keystone.service[282898]: [pid: 282898|app: 0|req: 659/1318] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 08:41:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 08:41:52.833649 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662bc425-8578-4bd1-ba39-94233b6ab4da None None] REQUEST_METHOD: `POST` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:41:52.834126 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662bc425-8578-4bd1-ba39-94233b6ab4da None None] SCRIPT_NAME: `/identity` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:41:52.834230 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662bc425-8578-4bd1-ba39-94233b6ab4da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:41:52.903454 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.auth.core [None req-662bc425-8578-4bd1-ba39-94233b6ab4da None None] MFA Rules not processed for user `2be990a66857410a87ffa7609aec4f7b`. Rule list: `[]` (Enabled: `True`). {{(pid=282899) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 08:41:52.904810 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.fernet_utils [None req-662bc425-8578-4bd1-ba39-94233b6ab4da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=282899) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:41:53.003696 dv-cinder-851351-1-smb devstack@keystone.service[282899]: [pid: 282899|app: 0|req: 660/1319] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 08:41:52 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 08:41:53.043262 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c41ab8-b78e-42f3-b12b-f87d4baee8db None None] Authenticating user token {{(pid=282898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:41:53.044322 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.fernet_utils [None req-54c41ab8-b78e-42f3-b12b-f87d4baee8db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=282898) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:41:53.153098 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c41ab8-b78e-42f3-b12b-f87d4baee8db None None] Validating token access rules against request {{(pid=282898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:41:53.229333 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb321e2-4449-46fa-9673-d9289867fa03 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a2fa5c253dc4112bca7074204f01b0a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cde68cbfb9042dc9f36af3aacea2473', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:41:53.229955 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb321e2-4449-46fa-9673-d9289867fa03 service neutron] REQUEST_METHOD: `GET` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:41:53.230237 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb321e2-4449-46fa-9673-d9289867fa03 service neutron] SCRIPT_NAME: `/identity` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:41:53.230509 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb321e2-4449-46fa-9673-d9289867fa03 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:41:53.232284 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.fernet_utils [None req-4eb321e2-4449-46fa-9673-d9289867fa03 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=282898) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:41:53.240172 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG dbcounter [-] [282898] Writing DB stats keystone:SELECT=100 {{(pid=282898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:41:53.347590 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb321e2-4449-46fa-9673-d9289867fa03 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:41:53.349070 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb321e2-4449-46fa-9673-d9289867fa03 service neutron] RBAC: Authorization granted {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:41:53.369279 dv-cinder-851351-1-smb devstack@keystone.service[282898]: [pid: 282898|app: 0|req: 660/1320] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Jul 28 08:41:53 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 08:41:56.083205 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53fdd362-6573-4cf1-9ada-c512fe5ec521 None None] REQUEST_METHOD: `GET` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:41:56.083821 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53fdd362-6573-4cf1-9ada-c512fe5ec521 None None] SCRIPT_NAME: `/identity` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:41:56.083821 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53fdd362-6573-4cf1-9ada-c512fe5ec521 None None] PATH_INFO: `/` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:41:56.085199 dv-cinder-851351-1-smb devstack@keystone.service[282899]: [pid: 282899|app: 0|req: 661/1321] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 08:41:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 08:41:56.090972 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924bfef5-a8bb-4f0b-8dfe-261d5f3dd90a None None] REQUEST_METHOD: `POST` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:41:56.091605 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924bfef5-a8bb-4f0b-8dfe-261d5f3dd90a None None] SCRIPT_NAME: `/identity` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:41:56.091789 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924bfef5-a8bb-4f0b-8dfe-261d5f3dd90a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:41:56.165053 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.auth.core [None req-924bfef5-a8bb-4f0b-8dfe-261d5f3dd90a None None] MFA Rules not processed for user `2be990a66857410a87ffa7609aec4f7b`. Rule list: `[]` (Enabled: `True`). {{(pid=282898) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 08:41:56.166299 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.fernet_utils [None req-924bfef5-a8bb-4f0b-8dfe-261d5f3dd90a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=282898) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:41:56.228252 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG dbcounter [-] [282898] Writing DB stats keystone:SELECT=100 {{(pid=282898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:41:56.272879 dv-cinder-851351-1-smb devstack@keystone.service[282898]: [pid: 282898|app: 0|req: 661/1322] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 08:41:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 08:41:56.310668 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53fdd362-6573-4cf1-9ada-c512fe5ec521 None None] Authenticating user token {{(pid=282899) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:41:56.312364 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.fernet_utils [None req-53fdd362-6573-4cf1-9ada-c512fe5ec521 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=282899) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:41:56.335787 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG dbcounter [-] [282899] Writing DB stats keystone:SELECT=100 {{(pid=282899) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:41:56.434120 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53fdd362-6573-4cf1-9ada-c512fe5ec521 None None] Validating token access rules against request {{(pid=282899) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:41:56.514637 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76823d1c-e7b6-4f59-a1ae-7c3fae561f53 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a2fa5c253dc4112bca7074204f01b0a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cde68cbfb9042dc9f36af3aacea2473', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282899) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:41:56.515272 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76823d1c-e7b6-4f59-a1ae-7c3fae561f53 service neutron] REQUEST_METHOD: `GET` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:41:56.515564 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76823d1c-e7b6-4f59-a1ae-7c3fae561f53 service neutron] SCRIPT_NAME: `/identity` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:41:56.515836 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76823d1c-e7b6-4f59-a1ae-7c3fae561f53 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:41:56.517525 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.fernet_utils [None req-76823d1c-e7b6-4f59-a1ae-7c3fae561f53 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=282899) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:41:56.596863 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG dbcounter [-] [282899] Writing DB stats keystone:SELECT=100 {{(pid=282899) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:41:56.638294 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76823d1c-e7b6-4f59-a1ae-7c3fae561f53 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:41:56.639770 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76823d1c-e7b6-4f59-a1ae-7c3fae561f53 service neutron] RBAC: Authorization granted {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:41:56.660014 dv-cinder-851351-1-smb devstack@keystone.service[282899]: [pid: 282899|app: 0|req: 662/1323] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Jul 28 08:41:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 350 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 08:41:58.719863 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88d8d07-d404-4d1a-bac0-12168dd7596b None None] REQUEST_METHOD: `GET` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:41:58.720420 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88d8d07-d404-4d1a-bac0-12168dd7596b None None] SCRIPT_NAME: `/identity` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:41:58.720420 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88d8d07-d404-4d1a-bac0-12168dd7596b None None] PATH_INFO: `/` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:41:58.721749 dv-cinder-851351-1-smb devstack@keystone.service[282898]: [pid: 282898|app: 0|req: 662/1324] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 08:41:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 08:41:58.727605 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ef326d-d6a6-400e-8d4e-5a66cf19e259 None None] REQUEST_METHOD: `POST` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:41:58.728166 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ef326d-d6a6-400e-8d4e-5a66cf19e259 None None] SCRIPT_NAME: `/identity` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:41:58.728166 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ef326d-d6a6-400e-8d4e-5a66cf19e259 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:41:58.805553 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.auth.core [None req-89ef326d-d6a6-400e-8d4e-5a66cf19e259 None None] MFA Rules not processed for user `2be990a66857410a87ffa7609aec4f7b`. Rule list: `[]` (Enabled: `True`). {{(pid=282899) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 08:41:58.806828 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.fernet_utils [None req-89ef326d-d6a6-400e-8d4e-5a66cf19e259 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=282899) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:41:58.913789 dv-cinder-851351-1-smb devstack@keystone.service[282899]: [pid: 282899|app: 0|req: 663/1325] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 08:41:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 08:41:58.949862 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d88d8d07-d404-4d1a-bac0-12168dd7596b None None] Authenticating user token {{(pid=282898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:41:58.951568 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.fernet_utils [None req-d88d8d07-d404-4d1a-bac0-12168dd7596b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=282898) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:41:59.076689 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d88d8d07-d404-4d1a-bac0-12168dd7596b None None] Validating token access rules against request {{(pid=282898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:41:59.165672 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd1594d-3a88-4e1d-99cd-65ef6a5f0293 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a2fa5c253dc4112bca7074204f01b0a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cde68cbfb9042dc9f36af3aacea2473', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:41:59.166319 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd1594d-3a88-4e1d-99cd-65ef6a5f0293 service neutron] REQUEST_METHOD: `GET` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:41:59.166608 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd1594d-3a88-4e1d-99cd-65ef6a5f0293 service neutron] SCRIPT_NAME: `/identity` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:41:59.166883 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd1594d-3a88-4e1d-99cd-65ef6a5f0293 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:41:59.168611 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.fernet_utils [None req-6cd1594d-3a88-4e1d-99cd-65ef6a5f0293 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=282898) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:41:59.187317 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG dbcounter [-] [282898] Writing DB stats keystone:SELECT=100 {{(pid=282898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:41:59.292763 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd1594d-3a88-4e1d-99cd-65ef6a5f0293 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:41:59.294200 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd1594d-3a88-4e1d-99cd-65ef6a5f0293 service neutron] RBAC: Authorization granted {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:41:59.316856 dv-cinder-851351-1-smb devstack@keystone.service[282898]: [pid: 282898|app: 0|req: 663/1326] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Jul 28 08:41:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 368 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 28 08:42:01.363141 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50afd2b2-fdde-43f6-9105-3975f44307b8 None None] REQUEST_METHOD: `GET` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:42:01.363716 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50afd2b2-fdde-43f6-9105-3975f44307b8 None None] SCRIPT_NAME: `/identity` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:42:01.363716 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50afd2b2-fdde-43f6-9105-3975f44307b8 None None] PATH_INFO: `/` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:42:01.365129 dv-cinder-851351-1-smb devstack@keystone.service[282899]: [pid: 282899|app: 0|req: 664/1327] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 08:42:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 08:42:01.370639 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d560da6-0d81-4e6c-a16b-1daf7617dae8 None None] REQUEST_METHOD: `POST` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:42:01.371107 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d560da6-0d81-4e6c-a16b-1daf7617dae8 None None] SCRIPT_NAME: `/identity` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:42:01.371215 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d560da6-0d81-4e6c-a16b-1daf7617dae8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:42:01.444020 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.auth.core [None req-6d560da6-0d81-4e6c-a16b-1daf7617dae8 None None] MFA Rules not processed for user `ff1f8d5551c44d2781c7ed09cd18be32`. Rule list: `[]` (Enabled: `True`). {{(pid=282898) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 08:42:01.445335 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.fernet_utils [None req-6d560da6-0d81-4e6c-a16b-1daf7617dae8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=282898) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:42:01.513304 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG dbcounter [-] [282898] Writing DB stats keystone:SELECT=100 {{(pid=282898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:42:01.550511 dv-cinder-851351-1-smb devstack@keystone.service[282898]: [pid: 282898|app: 0|req: 664/1328] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 08:42:01 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 08:42:01.588450 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50afd2b2-fdde-43f6-9105-3975f44307b8 None None] Authenticating user token {{(pid=282899) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:42:01.590056 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.fernet_utils [None req-50afd2b2-fdde-43f6-9105-3975f44307b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=282899) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:42:01.623618 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG dbcounter [-] [282899] Writing DB stats keystone:SELECT=100 {{(pid=282899) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:42:01.705243 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50afd2b2-fdde-43f6-9105-3975f44307b8 None None] Validating token access rules against request {{(pid=282899) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:42:01.782756 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d52570b4-fcc5-4c95-8973-bdecb4dbbdd4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a2fa5c253dc4112bca7074204f01b0a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cde68cbfb9042dc9f36af3aacea2473', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282899) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:42:01.783390 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52570b4-fcc5-4c95-8973-bdecb4dbbdd4 service neutron] REQUEST_METHOD: `GET` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:42:01.783671 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52570b4-fcc5-4c95-8973-bdecb4dbbdd4 service neutron] SCRIPT_NAME: `/identity` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:42:01.783939 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52570b4-fcc5-4c95-8973-bdecb4dbbdd4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:42:01.785621 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.fernet_utils [None req-d52570b4-fcc5-4c95-8973-bdecb4dbbdd4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=282899) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:42:01.868605 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG dbcounter [-] [282899] Writing DB stats keystone:SELECT=100 {{(pid=282899) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:42:01.903983 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d52570b4-fcc5-4c95-8973-bdecb4dbbdd4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:42:01.905511 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d52570b4-fcc5-4c95-8973-bdecb4dbbdd4 service neutron] RBAC: Authorization granted {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:42:01.925796 dv-cinder-851351-1-smb devstack@keystone.service[282899]: [pid: 282899|app: 0|req: 665/1329] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Jul 28 08:42:01 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 338 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 08:42:04.154285 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6256d43b-31a7-4855-a5c5-c0f24a15b96a None None] REQUEST_METHOD: `GET` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:42:04.154946 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6256d43b-31a7-4855-a5c5-c0f24a15b96a None None] SCRIPT_NAME: `/identity` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:42:04.154946 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6256d43b-31a7-4855-a5c5-c0f24a15b96a None None] PATH_INFO: `/` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:42:04.156211 dv-cinder-851351-1-smb devstack@keystone.service[282898]: [pid: 282898|app: 0|req: 665/1330] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 08:42:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 08:42:04.162908 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d284a3e7-d0fe-4210-ace3-cf8d032b5889 None None] REQUEST_METHOD: `POST` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:42:04.163561 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d284a3e7-d0fe-4210-ace3-cf8d032b5889 None None] SCRIPT_NAME: `/identity` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:42:04.163561 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d284a3e7-d0fe-4210-ace3-cf8d032b5889 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:42:04.238130 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.auth.core [None req-d284a3e7-d0fe-4210-ace3-cf8d032b5889 None None] MFA Rules not processed for user `2be990a66857410a87ffa7609aec4f7b`. Rule list: `[]` (Enabled: `True`). {{(pid=282899) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 08:42:04.239363 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.fernet_utils [None req-d284a3e7-d0fe-4210-ace3-cf8d032b5889 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=282899) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:42:04.351303 dv-cinder-851351-1-smb devstack@keystone.service[282899]: [pid: 282899|app: 0|req: 666/1331] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 08:42:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 08:42:04.390794 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6256d43b-31a7-4855-a5c5-c0f24a15b96a None None] Authenticating user token {{(pid=282898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:42:04.392644 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.fernet_utils [None req-6256d43b-31a7-4855-a5c5-c0f24a15b96a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=282898) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:42:04.515276 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6256d43b-31a7-4855-a5c5-c0f24a15b96a None None] Validating token access rules against request {{(pid=282898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:42:04.597279 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-549713ab-780d-4ec3-929f-614deb9e7067 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a2fa5c253dc4112bca7074204f01b0a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cde68cbfb9042dc9f36af3aacea2473', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:42:04.597927 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549713ab-780d-4ec3-929f-614deb9e7067 service neutron] REQUEST_METHOD: `GET` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:42:04.598205 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549713ab-780d-4ec3-929f-614deb9e7067 service neutron] SCRIPT_NAME: `/identity` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:42:04.598472 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549713ab-780d-4ec3-929f-614deb9e7067 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:42:04.600117 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.fernet_utils [None req-549713ab-780d-4ec3-929f-614deb9e7067 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=282898) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:42:04.631811 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG dbcounter [-] [282898] Writing DB stats keystone:SELECT=100 {{(pid=282898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:42:04.741241 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-549713ab-780d-4ec3-929f-614deb9e7067 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:42:04.742728 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-549713ab-780d-4ec3-929f-614deb9e7067 service neutron] RBAC: Authorization granted {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:42:04.762681 dv-cinder-851351-1-smb devstack@keystone.service[282898]: [pid: 282898|app: 0|req: 666/1332] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Jul 28 08:42:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 372 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 08:42:06.818842 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce02bbdd-8bba-43f6-92ef-d3d918f9c4b7 None None] REQUEST_METHOD: `GET` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:42:06.819320 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce02bbdd-8bba-43f6-92ef-d3d918f9c4b7 None None] SCRIPT_NAME: `/identity` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:42:06.819432 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce02bbdd-8bba-43f6-92ef-d3d918f9c4b7 None None] PATH_INFO: `/` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:42:06.820843 dv-cinder-851351-1-smb devstack@keystone.service[282899]: [pid: 282899|app: 0|req: 667/1333] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 08:42:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 08:42:06.826335 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8556a23f-a871-4870-9ce3-29065059bd30 None None] REQUEST_METHOD: `POST` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:42:06.826835 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8556a23f-a871-4870-9ce3-29065059bd30 None None] SCRIPT_NAME: `/identity` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:42:06.826948 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8556a23f-a871-4870-9ce3-29065059bd30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:42:06.897437 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.auth.core [None req-8556a23f-a871-4870-9ce3-29065059bd30 None None] MFA Rules not processed for user `2be990a66857410a87ffa7609aec4f7b`. Rule list: `[]` (Enabled: `True`). {{(pid=282898) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 08:42:06.898685 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.fernet_utils [None req-8556a23f-a871-4870-9ce3-29065059bd30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=282898) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:42:06.978264 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG dbcounter [-] [282898] Writing DB stats keystone:SELECT=100 {{(pid=282898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:42:07.003670 dv-cinder-851351-1-smb devstack@keystone.service[282898]: [pid: 282898|app: 0|req: 667/1334] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 08:42:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 08:42:07.052326 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce02bbdd-8bba-43f6-92ef-d3d918f9c4b7 None None] Authenticating user token {{(pid=282899) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:42:07.053938 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.fernet_utils [None req-ce02bbdd-8bba-43f6-92ef-d3d918f9c4b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=282899) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:42:07.098499 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG dbcounter [-] [282899] Writing DB stats keystone:SELECT=100 {{(pid=282899) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:42:07.168701 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce02bbdd-8bba-43f6-92ef-d3d918f9c4b7 None None] Validating token access rules against request {{(pid=282899) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:42:07.246061 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6e8c95-bb90-452d-9349-550a7e9a9e64 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a2fa5c253dc4112bca7074204f01b0a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cde68cbfb9042dc9f36af3aacea2473', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282899) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:42:07.246698 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6e8c95-bb90-452d-9349-550a7e9a9e64 service neutron] REQUEST_METHOD: `GET` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:42:07.246982 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6e8c95-bb90-452d-9349-550a7e9a9e64 service neutron] SCRIPT_NAME: `/identity` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:42:07.247336 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6e8c95-bb90-452d-9349-550a7e9a9e64 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:42:07.249074 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.fernet_utils [None req-8c6e8c95-bb90-452d-9349-550a7e9a9e64 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=282899) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:42:07.338490 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG dbcounter [-] [282899] Writing DB stats keystone:SELECT=100 {{(pid=282899) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:42:07.366721 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c6e8c95-bb90-452d-9349-550a7e9a9e64 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:42:07.368109 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c6e8c95-bb90-452d-9349-550a7e9a9e64 service neutron] RBAC: Authorization granted {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:42:07.390517 dv-cinder-851351-1-smb devstack@keystone.service[282899]: [pid: 282899|app: 0|req: 668/1335] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Jul 28 08:42:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 08:42:09.786803 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d65d9b5-0522-4aa5-9e95-d5284564892a None None] REQUEST_METHOD: `GET` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:42:09.787425 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d65d9b5-0522-4aa5-9e95-d5284564892a None None] SCRIPT_NAME: `/identity` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:42:09.787425 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d65d9b5-0522-4aa5-9e95-d5284564892a None None] PATH_INFO: `/` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:42:09.788754 dv-cinder-851351-1-smb devstack@keystone.service[282898]: [pid: 282898|app: 0|req: 668/1336] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 08:42:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 08:42:09.794583 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8974a7-79a7-42a2-bbe4-b382a98ae380 None None] REQUEST_METHOD: `POST` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:42:09.795083 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8974a7-79a7-42a2-bbe4-b382a98ae380 None None] SCRIPT_NAME: `/identity` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:42:09.795204 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8974a7-79a7-42a2-bbe4-b382a98ae380 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:42:09.866250 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.auth.core [None req-5f8974a7-79a7-42a2-bbe4-b382a98ae380 None None] MFA Rules not processed for user `2be990a66857410a87ffa7609aec4f7b`. Rule list: `[]` (Enabled: `True`). {{(pid=282899) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 08:42:09.867500 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.fernet_utils [None req-5f8974a7-79a7-42a2-bbe4-b382a98ae380 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=282899) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:42:10.103876 dv-cinder-851351-1-smb devstack@keystone.service[282899]: [pid: 282899|app: 0|req: 669/1337] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 08:42:09 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 310 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 08:42:10.156086 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eed3322-e789-48e5-9dc0-e42cca3eb652 None None] REQUEST_METHOD: `GET` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:42:10.156338 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eed3322-e789-48e5-9dc0-e42cca3eb652 None None] SCRIPT_NAME: `/identity` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:42:10.156636 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eed3322-e789-48e5-9dc0-e42cca3eb652 None None] PATH_INFO: `/` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:42:10.158028 dv-cinder-851351-1-smb devstack@keystone.service[282898]: [pid: 282898|app: 0|req: 669/1338] 10.222.0.42 () {54 vars in 965 bytes} [Thu Jul 28 08:42:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 08:42:10.164748 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe06e26c-8793-4e06-81fa-dadc834fa62e None None] REQUEST_METHOD: `POST` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:42:10.165051 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe06e26c-8793-4e06-81fa-dadc834fa62e None None] SCRIPT_NAME: `/identity` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:42:10.165352 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe06e26c-8793-4e06-81fa-dadc834fa62e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:42:10.227312 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG dbcounter [-] [282899] Writing DB stats keystone:SELECT=100 {{(pid=282899) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:42:10.253900 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.auth.core [None req-fe06e26c-8793-4e06-81fa-dadc834fa62e None None] MFA Rules not processed for user `7a2fa5c253dc4112bca7074204f01b0a`. Rule list: `[]` (Enabled: `True`). {{(pid=282899) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 08:42:10.255169 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.fernet_utils [None req-fe06e26c-8793-4e06-81fa-dadc834fa62e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=282899) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:42:10.344378 dv-cinder-851351-1-smb devstack@keystone.service[282899]: [pid: 282899|app: 0|req: 670/1339] 10.222.0.42 () {58 vars in 1062 bytes} [Thu Jul 28 08:42:10 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 08:42:10.354201 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eed3322-e789-48e5-9dc0-e42cca3eb652 None None] Authenticating user token {{(pid=282898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:42:10.355668 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.fernet_utils [None req-6eed3322-e789-48e5-9dc0-e42cca3eb652 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=282898) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:42:10.477606 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eed3322-e789-48e5-9dc0-e42cca3eb652 None None] Validating token access rules against request {{(pid=282898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:42:10.560021 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8798067e-acd1-4cb4-b892-80f71f3adbe6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a2fa5c253dc4112bca7074204f01b0a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cde68cbfb9042dc9f36af3aacea2473', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:42:10.560706 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8798067e-acd1-4cb4-b892-80f71f3adbe6 service neutron] REQUEST_METHOD: `GET` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:42:10.560987 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8798067e-acd1-4cb4-b892-80f71f3adbe6 service neutron] SCRIPT_NAME: `/identity` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:42:10.561265 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8798067e-acd1-4cb4-b892-80f71f3adbe6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:42:10.563004 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.fernet_utils [None req-8798067e-acd1-4cb4-b892-80f71f3adbe6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=282898) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:42:10.604627 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG dbcounter [-] [282898] Writing DB stats keystone:SELECT=100 {{(pid=282898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:42:10.689452 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8798067e-acd1-4cb4-b892-80f71f3adbe6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:42:10.690963 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8798067e-acd1-4cb4-b892-80f71f3adbe6 service neutron] RBAC: Authorization granted {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:42:10.711743 dv-cinder-851351-1-smb devstack@keystone.service[282898]: [pid: 282898|app: 0|req: 670/1340] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Jul 28 08:42:10 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 358 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 08:42:15.313474 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94341f7f-bd1e-4928-9174-7202e7f89b8f None None] REQUEST_METHOD: `GET` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:42:15.313951 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94341f7f-bd1e-4928-9174-7202e7f89b8f None None] SCRIPT_NAME: `/identity` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:42:15.314040 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94341f7f-bd1e-4928-9174-7202e7f89b8f None None] PATH_INFO: `/` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:42:15.315714 dv-cinder-851351-1-smb devstack@keystone.service[282899]: [pid: 282899|app: 0|req: 671/1341] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 08:42:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 08:42:15.321142 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b625f84e-cb97-491e-b37a-d053a291d554 None None] REQUEST_METHOD: `POST` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:42:15.321664 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b625f84e-cb97-491e-b37a-d053a291d554 None None] SCRIPT_NAME: `/identity` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:42:15.321761 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b625f84e-cb97-491e-b37a-d053a291d554 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:42:15.394014 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.auth.core [None req-b625f84e-cb97-491e-b37a-d053a291d554 None None] MFA Rules not processed for user `2be990a66857410a87ffa7609aec4f7b`. Rule list: `[]` (Enabled: `True`). {{(pid=282898) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 08:42:15.395249 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.fernet_utils [None req-b625f84e-cb97-491e-b37a-d053a291d554 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=282898) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:42:15.486187 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG dbcounter [-] [282898] Writing DB stats keystone:SELECT=100 {{(pid=282898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:42:15.497992 dv-cinder-851351-1-smb devstack@keystone.service[282898]: [pid: 282898|app: 0|req: 671/1342] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 08:42:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 08:42:15.536299 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94341f7f-bd1e-4928-9174-7202e7f89b8f None None] Authenticating user token {{(pid=282899) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:42:15.538005 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.fernet_utils [None req-94341f7f-bd1e-4928-9174-7202e7f89b8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=282899) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:42:15.666383 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94341f7f-bd1e-4928-9174-7202e7f89b8f None None] Validating token access rules against request {{(pid=282899) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:42:15.705916 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG dbcounter [-] [282899] Writing DB stats keystone:SELECT=100 {{(pid=282899) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:42:15.743737 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a83b6cc-9df0-4dcf-be76-46aa5327a023 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a2fa5c253dc4112bca7074204f01b0a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cde68cbfb9042dc9f36af3aacea2473', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282899) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:42:15.744378 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a83b6cc-9df0-4dcf-be76-46aa5327a023 service neutron] REQUEST_METHOD: `GET` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:42:15.744651 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a83b6cc-9df0-4dcf-be76-46aa5327a023 service neutron] SCRIPT_NAME: `/identity` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:42:15.744952 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a83b6cc-9df0-4dcf-be76-46aa5327a023 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:42:15.746594 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.fernet_utils [None req-4a83b6cc-9df0-4dcf-be76-46aa5327a023 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=282899) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:42:15.860743 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a83b6cc-9df0-4dcf-be76-46aa5327a023 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:42:15.862278 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a83b6cc-9df0-4dcf-be76-46aa5327a023 service neutron] RBAC: Authorization granted {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:42:15.881941 dv-cinder-851351-1-smb devstack@keystone.service[282899]: [pid: 282899|app: 0|req: 672/1343] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Jul 28 08:42:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 346 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 08:42:18.602343 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87868668-fa96-45bc-acf7-2199e8b209fd None None] REQUEST_METHOD: `GET` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:42:18.603221 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87868668-fa96-45bc-acf7-2199e8b209fd None None] SCRIPT_NAME: `/identity` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:42:18.603221 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87868668-fa96-45bc-acf7-2199e8b209fd None None] PATH_INFO: `/` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:42:18.604280 dv-cinder-851351-1-smb devstack@keystone.service[282898]: [pid: 282898|app: 0|req: 672/1344] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 08:42:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 28 08:42:18.610876 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97d72dc-8ed2-40e2-8398-7713e37f18f8 None None] REQUEST_METHOD: `POST` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:42:18.611704 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97d72dc-8ed2-40e2-8398-7713e37f18f8 None None] SCRIPT_NAME: `/identity` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:42:18.611704 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97d72dc-8ed2-40e2-8398-7713e37f18f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:42:18.698834 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.auth.core [None req-b97d72dc-8ed2-40e2-8398-7713e37f18f8 None None] MFA Rules not processed for user `2be990a66857410a87ffa7609aec4f7b`. Rule list: `[]` (Enabled: `True`). {{(pid=282899) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 08:42:18.700317 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.fernet_utils [None req-b97d72dc-8ed2-40e2-8398-7713e37f18f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=282899) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:42:18.734070 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG dbcounter [-] [282899] Writing DB stats keystone:SELECT=100 {{(pid=282899) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:42:18.882327 dv-cinder-851351-1-smb devstack@keystone.service[282899]: [pid: 282899|app: 0|req: 673/1345] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 08:42:18 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 272 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 08:42:18.943274 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87868668-fa96-45bc-acf7-2199e8b209fd None None] Authenticating user token {{(pid=282898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:42:18.945021 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.fernet_utils [None req-87868668-fa96-45bc-acf7-2199e8b209fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=282898) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:42:19.071528 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87868668-fa96-45bc-acf7-2199e8b209fd None None] Validating token access rules against request {{(pid=282898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:42:19.165058 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d6e95e-67b6-44b5-bd1b-45ea967708e3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a2fa5c253dc4112bca7074204f01b0a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cde68cbfb9042dc9f36af3aacea2473', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:42:19.165563 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d6e95e-67b6-44b5-bd1b-45ea967708e3 service neutron] REQUEST_METHOD: `GET` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:42:19.165845 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d6e95e-67b6-44b5-bd1b-45ea967708e3 service neutron] SCRIPT_NAME: `/identity` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:42:19.166125 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d6e95e-67b6-44b5-bd1b-45ea967708e3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:42:19.167855 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.fernet_utils [None req-71d6e95e-67b6-44b5-bd1b-45ea967708e3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=282898) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:42:19.222913 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG dbcounter [-] [282898] Writing DB stats keystone:SELECT=100 {{(pid=282898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:42:19.309167 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71d6e95e-67b6-44b5-bd1b-45ea967708e3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:42:19.311146 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71d6e95e-67b6-44b5-bd1b-45ea967708e3 service neutron] RBAC: Authorization granted {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:42:19.345036 dv-cinder-851351-1-smb devstack@keystone.service[282898]: [pid: 282898|app: 0|req: 673/1346] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Jul 28 08:42:18 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 402 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 08:42:24.185930 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89dd1d16-7c13-4ed9-957d-66ef9586bee1 None None] REQUEST_METHOD: `GET` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:42:24.186648 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89dd1d16-7c13-4ed9-957d-66ef9586bee1 None None] SCRIPT_NAME: `/identity` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:42:24.186648 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89dd1d16-7c13-4ed9-957d-66ef9586bee1 None None] PATH_INFO: `/` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:42:24.188038 dv-cinder-851351-1-smb devstack@keystone.service[282899]: [pid: 282899|app: 0|req: 674/1347] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 08:42:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 08:42:24.196092 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbbfe045-3cab-4352-aa78-088833acc868 None None] REQUEST_METHOD: `POST` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:42:24.197135 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbbfe045-3cab-4352-aa78-088833acc868 None None] SCRIPT_NAME: `/identity` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:42:24.197135 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbbfe045-3cab-4352-aa78-088833acc868 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:42:24.298786 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.auth.core [None req-cbbfe045-3cab-4352-aa78-088833acc868 None None] MFA Rules not processed for user `2be990a66857410a87ffa7609aec4f7b`. Rule list: `[]` (Enabled: `True`). {{(pid=282898) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 08:42:24.300927 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.fernet_utils [None req-cbbfe045-3cab-4352-aa78-088833acc868 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=282898) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:42:24.466723 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG dbcounter [-] [282898] Writing DB stats keystone:SELECT=100 {{(pid=282898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:42:24.471422 dv-cinder-851351-1-smb devstack@keystone.service[282898]: [pid: 282898|app: 0|req: 674/1348] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 08:42:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 276 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 08:42:24.511316 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89dd1d16-7c13-4ed9-957d-66ef9586bee1 None None] Authenticating user token {{(pid=282899) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:42:24.514182 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.fernet_utils [None req-89dd1d16-7c13-4ed9-957d-66ef9586bee1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=282899) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:42:24.644455 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89dd1d16-7c13-4ed9-957d-66ef9586bee1 None None] Validating token access rules against request {{(pid=282899) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:42:24.715106 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG dbcounter [-] [282899] Writing DB stats keystone:SELECT=100 {{(pid=282899) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:42:24.755090 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46068b1a-20a2-48e0-8712-088b362e7636 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7a2fa5c253dc4112bca7074204f01b0a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cde68cbfb9042dc9f36af3aacea2473', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282899) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:42:24.755991 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46068b1a-20a2-48e0-8712-088b362e7636 service neutron] REQUEST_METHOD: `GET` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:42:24.756386 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46068b1a-20a2-48e0-8712-088b362e7636 service neutron] SCRIPT_NAME: `/identity` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:42:24.756776 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46068b1a-20a2-48e0-8712-088b362e7636 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:42:24.759953 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.fernet_utils [None req-46068b1a-20a2-48e0-8712-088b362e7636 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=282899) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:42:24.936788 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46068b1a-20a2-48e0-8712-088b362e7636 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:42:24.938754 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46068b1a-20a2-48e0-8712-088b362e7636 service neutron] RBAC: Authorization granted {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:42:24.965345 dv-cinder-851351-1-smb devstack@keystone.service[282899]: [pid: 282899|app: 0|req: 675/1349] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Jul 28 08:42:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 455 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 28 08:42:30.589854 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6845cedd-4f4b-42d1-9eb0-4913d9d68ada None None] REQUEST_METHOD: `GET` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:42:30.590610 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6845cedd-4f4b-42d1-9eb0-4913d9d68ada None None] SCRIPT_NAME: `/identity` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:42:30.590610 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6845cedd-4f4b-42d1-9eb0-4913d9d68ada None None] PATH_INFO: `/` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:42:30.593660 dv-cinder-851351-1-smb devstack@keystone.service[282898]: [pid: 282898|app: 0|req: 675/1350] 10.222.0.42 () {54 vars in 921 bytes} [Thu Jul 28 08:42:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 08:42:30.598660 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f625311d-ca8b-4016-803d-325624e1c033 None None] REQUEST_METHOD: `POST` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:42:30.599496 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f625311d-ca8b-4016-803d-325624e1c033 None None] SCRIPT_NAME: `/identity` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:42:30.599496 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f625311d-ca8b-4016-803d-325624e1c033 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:42:30.720857 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.auth.core [None req-f625311d-ca8b-4016-803d-325624e1c033 None None] MFA Rules not processed for user `bba431c3832c4dd5bcd296d3247840c0`. Rule list: `[]` (Enabled: `True`). {{(pid=282899) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 08:42:30.722504 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.fernet_utils [None req-f625311d-ca8b-4016-803d-325624e1c033 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=282899) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:42:30.761834 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG dbcounter [-] [282899] Writing DB stats keystone:SELECT=100 {{(pid=282899) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:42:30.939499 dv-cinder-851351-1-smb devstack@keystone.service[282899]: [pid: 282899|app: 0|req: 676/1351] 10.222.0.42 () {58 vars in 1018 bytes} [Thu Jul 28 08:42:30 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 342 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 08:42:36.172312 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2cc270d-d764-4d3f-9e67-e7a02eccd801 None None] REQUEST_METHOD: `GET` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:42:36.173090 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2cc270d-d764-4d3f-9e67-e7a02eccd801 None None] SCRIPT_NAME: `/identity` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:42:36.173090 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2cc270d-d764-4d3f-9e67-e7a02eccd801 None None] PATH_INFO: `/` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:42:36.174998 dv-cinder-851351-1-smb devstack@keystone.service[282898]: [pid: 282898|app: 0|req: 676/1352] 10.222.0.42 () {54 vars in 921 bytes} [Thu Jul 28 08:42:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 08:42:36.180551 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3d86cc-2473-4818-87f6-3f6414a8d966 None None] REQUEST_METHOD: `POST` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:42:36.181108 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3d86cc-2473-4818-87f6-3f6414a8d966 None None] SCRIPT_NAME: `/identity` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:42:36.181375 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3d86cc-2473-4818-87f6-3f6414a8d966 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:42:36.284386 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.auth.core [None req-6d3d86cc-2473-4818-87f6-3f6414a8d966 None None] MFA Rules not processed for user `bba431c3832c4dd5bcd296d3247840c0`. Rule list: `[]` (Enabled: `True`). {{(pid=282899) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 08:42:36.286092 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.fernet_utils [None req-6d3d86cc-2473-4818-87f6-3f6414a8d966 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=282899) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:42:36.380757 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG dbcounter [-] [282899] Writing DB stats keystone:SELECT=100 {{(pid=282899) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:42:36.429508 dv-cinder-851351-1-smb devstack@keystone.service[282899]: [pid: 282899|app: 0|req: 677/1353] 10.222.0.42 () {58 vars in 1018 bytes} [Thu Jul 28 08:42:36 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 250 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 08:42:37.881820 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c1690c-0e9b-4324-8d7b-09e87ec92d27 None None] REQUEST_METHOD: `GET` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:42:37.882687 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c1690c-0e9b-4324-8d7b-09e87ec92d27 None None] SCRIPT_NAME: `/identity` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:42:37.882687 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c1690c-0e9b-4324-8d7b-09e87ec92d27 None None] PATH_INFO: `/` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:42:37.884554 dv-cinder-851351-1-smb devstack@keystone.service[282898]: [pid: 282898|app: 0|req: 677/1354] 10.222.0.42 () {54 vars in 921 bytes} [Thu Jul 28 08:42:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 08:42:37.891269 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada53953-7dfa-4d31-8dff-ad8e97b76528 None None] REQUEST_METHOD: `POST` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:42:37.891804 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada53953-7dfa-4d31-8dff-ad8e97b76528 None None] SCRIPT_NAME: `/identity` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:42:37.892212 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada53953-7dfa-4d31-8dff-ad8e97b76528 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:42:37.987440 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.auth.core [None req-ada53953-7dfa-4d31-8dff-ad8e97b76528 None None] MFA Rules not processed for user `bba431c3832c4dd5bcd296d3247840c0`. Rule list: `[]` (Enabled: `True`). {{(pid=282899) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 08:42:37.988817 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.fernet_utils [None req-ada53953-7dfa-4d31-8dff-ad8e97b76528 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=282899) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:42:38.145238 dv-cinder-851351-1-smb devstack@keystone.service[282899]: [pid: 282899|app: 0|req: 678/1355] 10.222.0.42 () {58 vars in 1018 bytes} [Thu Jul 28 08:42:37 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 255 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 08:42:41.777322 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f5f250-790d-4744-9071-753fa1eabb90 None None] REQUEST_METHOD: `GET` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:42:41.778612 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f5f250-790d-4744-9071-753fa1eabb90 None None] SCRIPT_NAME: `/identity` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:42:41.779115 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f5f250-790d-4744-9071-753fa1eabb90 None None] PATH_INFO: `/` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:42:41.785689 dv-cinder-851351-1-smb devstack@keystone.service[282898]: [pid: 282898|app: 0|req: 678/1356] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 08:42:41 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 08:42:41.790373 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831cb5f1-4b0d-40a1-9def-ade8b8d97c03 None None] REQUEST_METHOD: `POST` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:42:41.790830 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831cb5f1-4b0d-40a1-9def-ade8b8d97c03 None None] SCRIPT_NAME: `/identity` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:42:41.793031 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831cb5f1-4b0d-40a1-9def-ade8b8d97c03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:42:41.839835 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG dbcounter [-] [282899] Writing DB stats keystone:SELECT=100 {{(pid=282899) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:42:41.884054 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.auth.core [None req-831cb5f1-4b0d-40a1-9def-ade8b8d97c03 None None] MFA Rules not processed for user `2be990a66857410a87ffa7609aec4f7b`. Rule list: `[]` (Enabled: `True`). {{(pid=282899) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 08:42:41.885487 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.fernet_utils [None req-831cb5f1-4b0d-40a1-9def-ade8b8d97c03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=282899) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:42:42.081051 dv-cinder-851351-1-smb devstack@keystone.service[282899]: [pid: 282899|app: 0|req: 679/1357] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 08:42:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 295 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 08:42:42.162436 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d2d1fc-ebc3-4246-a10a-6b1832b701bc None None] REQUEST_METHOD: `GET` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:42:42.162700 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d2d1fc-ebc3-4246-a10a-6b1832b701bc None None] SCRIPT_NAME: `/identity` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:42:42.163148 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d2d1fc-ebc3-4246-a10a-6b1832b701bc None None] PATH_INFO: `/` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:42:42.164416 dv-cinder-851351-1-smb devstack@keystone.service[282898]: [pid: 282898|app: 0|req: 679/1358] 10.222.0.42 () {54 vars in 962 bytes} [Thu Jul 28 08:42:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 08:42:42.173987 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02bb20f2-a268-4ea6-9924-d3de37dfd7f1 None None] REQUEST_METHOD: `POST` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:42:42.174368 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02bb20f2-a268-4ea6-9924-d3de37dfd7f1 None None] SCRIPT_NAME: `/identity` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:42:42.174610 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02bb20f2-a268-4ea6-9924-d3de37dfd7f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:42:42.280192 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.auth.core [None req-02bb20f2-a268-4ea6-9924-d3de37dfd7f1 None None] MFA Rules not processed for user `5e192fe026ef4f109b9a1099815c5926`. Rule list: `[]` (Enabled: `True`). {{(pid=282899) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 08:42:42.282048 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.fernet_utils [None req-02bb20f2-a268-4ea6-9924-d3de37dfd7f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=282899) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:42:42.357044 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG dbcounter [-] [282899] Writing DB stats keystone:SELECT=100 {{(pid=282899) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:42:42.488625 dv-cinder-851351-1-smb devstack@keystone.service[282899]: [pid: 282899|app: 0|req: 680/1359] 10.222.0.42 () {58 vars in 1059 bytes} [Thu Jul 28 08:42:42 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 316 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 08:42:42.497472 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d2d1fc-ebc3-4246-a10a-6b1832b701bc None None] Authenticating user token {{(pid=282898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:42:42.499127 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.fernet_utils [None req-70d2d1fc-ebc3-4246-a10a-6b1832b701bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=282898) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:42:42.678088 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d2d1fc-ebc3-4246-a10a-6b1832b701bc None None] Validating token access rules against request {{(pid=282898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:42:42.778571 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG dbcounter [-] [282898] Writing DB stats keystone:SELECT=100 {{(pid=282898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:42:42.826970 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8417afb9-455a-49e7-8b8d-ff446738b0c4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e192fe026ef4f109b9a1099815c5926', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cde68cbfb9042dc9f36af3aacea2473', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:42:42.827605 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8417afb9-455a-49e7-8b8d-ff446738b0c4 service nova] REQUEST_METHOD: `GET` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:42:42.827888 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8417afb9-455a-49e7-8b8d-ff446738b0c4 service nova] SCRIPT_NAME: `/identity` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:42:42.828161 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8417afb9-455a-49e7-8b8d-ff446738b0c4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:42:42.830625 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.fernet_utils [None req-8417afb9-455a-49e7-8b8d-ff446738b0c4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=282898) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:42:42.933549 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8417afb9-455a-49e7-8b8d-ff446738b0c4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:42:42.935243 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8417afb9-455a-49e7-8b8d-ff446738b0c4 service nova] RBAC: Authorization granted {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:42:42.957835 dv-cinder-851351-1-smb devstack@keystone.service[282898]: [pid: 282898|app: 0|req: 680/1360] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Jul 28 08:42:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 461 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 08:42:45.686778 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38514274-4234-413c-8ab6-123bc2e6ab44 None None] REQUEST_METHOD: `GET` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:42:45.687477 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38514274-4234-413c-8ab6-123bc2e6ab44 None None] SCRIPT_NAME: `/identity` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:42:45.687477 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38514274-4234-413c-8ab6-123bc2e6ab44 None None] PATH_INFO: `/` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:42:45.689176 dv-cinder-851351-1-smb devstack@keystone.service[282899]: [pid: 282899|app: 0|req: 681/1361] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 08:42:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 08:42:45.694884 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb647f40-2619-4ca2-8c28-b3b8f45cec32 None None] REQUEST_METHOD: `POST` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:42:45.695570 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb647f40-2619-4ca2-8c28-b3b8f45cec32 None None] SCRIPT_NAME: `/identity` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:42:45.695570 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb647f40-2619-4ca2-8c28-b3b8f45cec32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:42:45.785064 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.auth.core [None req-cb647f40-2619-4ca2-8c28-b3b8f45cec32 None None] MFA Rules not processed for user `2be990a66857410a87ffa7609aec4f7b`. Rule list: `[]` (Enabled: `True`). {{(pid=282898) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 08:42:45.786682 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.fernet_utils [None req-cb647f40-2619-4ca2-8c28-b3b8f45cec32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=282898) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:42:45.862748 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG dbcounter [-] [282898] Writing DB stats keystone:SELECT=100 {{(pid=282898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:42:45.977054 dv-cinder-851351-1-smb devstack@keystone.service[282898]: [pid: 282898|app: 0|req: 681/1362] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 08:42:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 283 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 08:42:46.050220 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38514274-4234-413c-8ab6-123bc2e6ab44 None None] Authenticating user token {{(pid=282899) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:42:46.052719 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.fernet_utils [None req-38514274-4234-413c-8ab6-123bc2e6ab44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=282899) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:42:46.288622 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38514274-4234-413c-8ab6-123bc2e6ab44 None None] Validating token access rules against request {{(pid=282899) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:42:46.303002 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG dbcounter [-] [282899] Writing DB stats keystone:SELECT=100 {{(pid=282899) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:42:46.483599 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b7dc73-f805-429b-aa71-60e013402005 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e192fe026ef4f109b9a1099815c5926', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cde68cbfb9042dc9f36af3aacea2473', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282899) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:42:46.484848 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b7dc73-f805-429b-aa71-60e013402005 service nova] REQUEST_METHOD: `GET` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:42:46.485367 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b7dc73-f805-429b-aa71-60e013402005 service nova] SCRIPT_NAME: `/identity` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:42:46.485776 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b7dc73-f805-429b-aa71-60e013402005 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:42:46.488434 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.fernet_utils [None req-b9b7dc73-f805-429b-aa71-60e013402005 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=282899) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:42:46.613105 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9b7dc73-f805-429b-aa71-60e013402005 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:42:46.615398 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9b7dc73-f805-429b-aa71-60e013402005 service nova] RBAC: Authorization granted {{(pid=282899) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:42:46.641770 dv-cinder-851351-1-smb devstack@keystone.service[282899]: [pid: 282899|app: 0|req: 682/1363] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Jul 28 08:42:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 593 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 08:42:49.178498 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc3e37a-e20d-4477-a45f-f2c4a4707aee None None] REQUEST_METHOD: `GET` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:42:49.179150 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc3e37a-e20d-4477-a45f-f2c4a4707aee None None] SCRIPT_NAME: `/identity` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:42:49.179150 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc3e37a-e20d-4477-a45f-f2c4a4707aee None None] PATH_INFO: `/` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:42:49.180525 dv-cinder-851351-1-smb devstack@keystone.service[282898]: [pid: 282898|app: 0|req: 682/1364] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 08:42:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 08:42:49.186964 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dacd2fa-63af-4148-8651-51a577489c39 None None] REQUEST_METHOD: `POST` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:42:49.187558 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dacd2fa-63af-4148-8651-51a577489c39 None None] SCRIPT_NAME: `/identity` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:42:49.187558 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dacd2fa-63af-4148-8651-51a577489c39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:42:49.208090 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG dbcounter [-] [282899] Writing DB stats keystone:SELECT=100 {{(pid=282899) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:42:49.284676 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.auth.core [None req-0dacd2fa-63af-4148-8651-51a577489c39 None None] MFA Rules not processed for user `2be990a66857410a87ffa7609aec4f7b`. Rule list: `[]` (Enabled: `True`). {{(pid=282899) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 08:42:49.286885 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.fernet_utils [None req-0dacd2fa-63af-4148-8651-51a577489c39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=282899) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:42:49.432822 dv-cinder-851351-1-smb devstack@keystone.service[282899]: [pid: 282899|app: 0|req: 683/1365] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 08:42:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 243 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 08:42:49.478605 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dacf6feb-4584-4cf3-8e43-d03a1973d1b1 None None] REQUEST_METHOD: `GET` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:42:49.479584 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dacf6feb-4584-4cf3-8e43-d03a1973d1b1 None None] SCRIPT_NAME: `/identity` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:42:49.481088 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dacf6feb-4584-4cf3-8e43-d03a1973d1b1 None None] PATH_INFO: `/` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:42:49.481969 dv-cinder-851351-1-smb devstack@keystone.service[282898]: [pid: 282898|app: 0|req: 683/1366] 10.222.0.42 () {54 vars in 962 bytes} [Thu Jul 28 08:42:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 08:42:49.490775 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddca1eb2-563f-4114-9681-5dced9bf0de8 None None] REQUEST_METHOD: `POST` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:42:49.492536 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddca1eb2-563f-4114-9681-5dced9bf0de8 None None] SCRIPT_NAME: `/identity` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:42:49.492536 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddca1eb2-563f-4114-9681-5dced9bf0de8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:42:49.608485 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.auth.core [None req-ddca1eb2-563f-4114-9681-5dced9bf0de8 None None] MFA Rules not processed for user `5e192fe026ef4f109b9a1099815c5926`. Rule list: `[]` (Enabled: `True`). {{(pid=282899) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 08:42:49.610419 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.common.fernet_utils [None req-ddca1eb2-563f-4114-9681-5dced9bf0de8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=282899) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:42:49.656808 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG dbcounter [-] [282899] Writing DB stats keystone:SELECT=100 {{(pid=282899) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:42:49.774304 dv-cinder-851351-1-smb devstack@keystone.service[282899]: [pid: 282899|app: 0|req: 684/1367] 10.222.0.42 () {58 vars in 1059 bytes} [Thu Jul 28 08:42:49 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 285 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 08:42:49.783583 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dacf6feb-4584-4cf3-8e43-d03a1973d1b1 None None] Authenticating user token {{(pid=282898) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:42:49.787438 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.fernet_utils [None req-dacf6feb-4584-4cf3-8e43-d03a1973d1b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=282898) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:42:50.056691 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dacf6feb-4584-4cf3-8e43-d03a1973d1b1 None None] Validating token access rules against request {{(pid=282898) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:42:50.082067 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG dbcounter [-] [282898] Writing DB stats keystone:SELECT=100 {{(pid=282898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:42:50.191329 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15634e11-101e-4928-b3d7-01e8c6ac927a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5e192fe026ef4f109b9a1099815c5926', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cde68cbfb9042dc9f36af3aacea2473', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=282898) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:42:50.192189 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15634e11-101e-4928-b3d7-01e8c6ac927a service nova] REQUEST_METHOD: `GET` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:42:50.192487 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15634e11-101e-4928-b3d7-01e8c6ac927a service nova] SCRIPT_NAME: `/identity` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:42:50.192891 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15634e11-101e-4928-b3d7-01e8c6ac927a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:42:50.194648 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.fernet_utils [None req-15634e11-101e-4928-b3d7-01e8c6ac927a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=282898) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:42:50.298942 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15634e11-101e-4928-b3d7-01e8c6ac927a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:42:50.300777 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15634e11-101e-4928-b3d7-01e8c6ac927a service nova] RBAC: Authorization granted {{(pid=282898) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:42:50.329563 dv-cinder-851351-1-smb devstack@keystone.service[282898]: [pid: 282898|app: 0|req: 684/1368] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Jul 28 08:42:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 547 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 08:42:50.572148 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e3c79a-02f2-428a-8292-051341a4a269 None None] REQUEST_METHOD: `GET` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:42:50.572932 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e3c79a-02f2-428a-8292-051341a4a269 None None] SCRIPT_NAME: `/identity` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:42:50.572932 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e3c79a-02f2-428a-8292-051341a4a269 None None] PATH_INFO: `/` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:42:50.574476 dv-cinder-851351-1-smb devstack@keystone.service[282899]: [pid: 282899|app: 0|req: 685/1369] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 08:42:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 08:42:50.580545 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab27c454-0c32-4d0c-a81c-19ede6b0ff3a None None] REQUEST_METHOD: `POST` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:42:50.580778 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab27c454-0c32-4d0c-a81c-19ede6b0ff3a None None] SCRIPT_NAME: `/identity` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:42:50.581048 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab27c454-0c32-4d0c-a81c-19ede6b0ff3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:42:50.625089 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG dbcounter [-] [282898] Writing DB stats keystone:SELECT=100 {{(pid=282898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:42:50.669856 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.auth.core [None req-ab27c454-0c32-4d0c-a81c-19ede6b0ff3a None None] MFA Rules not processed for user `2be990a66857410a87ffa7609aec4f7b`. Rule list: `[]` (Enabled: `True`). {{(pid=282898) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 08:42:50.671100 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.fernet_utils [None req-ab27c454-0c32-4d0c-a81c-19ede6b0ff3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=282898) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:42:50.788843 dv-cinder-851351-1-smb devstack@keystone.service[282898]: [pid: 282898|app: 0|req: 685/1370] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 08:42:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 08:42:52.476191 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9928cafa-ffdd-4a21-8505-3250768be8dd None None] REQUEST_METHOD: `GET` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:42:52.476804 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9928cafa-ffdd-4a21-8505-3250768be8dd None None] SCRIPT_NAME: `/identity` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:42:52.476804 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9928cafa-ffdd-4a21-8505-3250768be8dd None None] PATH_INFO: `/` {{(pid=282899) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:42:52.478441 dv-cinder-851351-1-smb devstack@keystone.service[282899]: [pid: 282899|app: 0|req: 686/1371] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 08:42:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 08:42:52.484451 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d76e55a-25a9-4a64-859f-829d9f93e2b3 None None] REQUEST_METHOD: `POST` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:42:52.485090 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d76e55a-25a9-4a64-859f-829d9f93e2b3 None None] SCRIPT_NAME: `/identity` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:42:52.485090 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d76e55a-25a9-4a64-859f-829d9f93e2b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=282898) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:42:52.617335 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.auth.core [None req-2d76e55a-25a9-4a64-859f-829d9f93e2b3 None None] MFA Rules not processed for user `2be990a66857410a87ffa7609aec4f7b`. Rule list: `[]` (Enabled: `True`). {{(pid=282898) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 08:42:52.625136 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG keystone.common.fernet_utils [None req-2d76e55a-25a9-4a64-859f-829d9f93e2b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=282898) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:42:52.702394 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG dbcounter [-] [282898] Writing DB stats keystone:SELECT=100 {{(pid=282898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:42:52.743089 dv-cinder-851351-1-smb devstack@keystone.service[282898]: [pid: 282898|app: 0|req: 686/1372] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 08:42:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 255 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 08:42:59.770924 dv-cinder-851351-1-smb devstack@keystone.service[282899]: DEBUG dbcounter [-] [282899] Writing DB stats keystone:SELECT=38 {{(pid=282899) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:43:02.735530 dv-cinder-851351-1-smb devstack@keystone.service[282898]: DEBUG dbcounter [-] [282898] Writing DB stats keystone:SELECT=19 {{(pid=282898) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:43:17.429799 dv-cinder-851351-1-smb systemd[1]: Stopping Devstack devstack@keystone.service... Jul 28 08:43:17.430151 dv-cinder-851351-1-smb devstack@keystone.service[282889]: Thu Jul 28 08:43:17 2022 - graceful shutdown triggered... Jul 28 08:43:17.430775 dv-cinder-851351-1-smb devstack@keystone.service[282899]: Gracefully killing worker 2 (pid: 282899)... Jul 28 08:43:17.431243 dv-cinder-851351-1-smb devstack@keystone.service[282898]: Gracefully killing worker 1 (pid: 282898)... Jul 28 08:43:18.431317 dv-cinder-851351-1-smb devstack@keystone.service[282889]: worker 1 buried after 1 seconds Jul 28 08:43:18.431317 dv-cinder-851351-1-smb devstack@keystone.service[282889]: worker 2 buried after 1 seconds Jul 28 08:43:18.431317 dv-cinder-851351-1-smb devstack@keystone.service[282889]: goodbye to uWSGI. Jul 28 08:43:18.433144 dv-cinder-851351-1-smb systemd[1]: devstack@keystone.service: Succeeded. Jul 28 08:43:18.434156 dv-cinder-851351-1-smb systemd[1]: Stopped Devstack devstack@keystone.service. Jul 28 08:52:16.207018 dv-cinder-851351-1-smb systemd[1]: Starting Devstack devstack@keystone.service... Jul 28 08:52:16.216551 dv-cinder-851351-1-smb devstack@keystone.service[352316]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Jul 28 08:52:16.219397 dv-cinder-851351-1-smb devstack@keystone.service[352316]: *** Starting uWSGI 2.0.18-debian (64bit) on [Thu Jul 28 08:52:16 2022] *** Jul 28 08:52:16.219596 dv-cinder-851351-1-smb devstack@keystone.service[352316]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jul 28 08:52:16.219775 dv-cinder-851351-1-smb devstack@keystone.service[352316]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jul 28 08:52:16.219914 dv-cinder-851351-1-smb devstack@keystone.service[352316]: nodename: dv-cinder-851351-1-smb Jul 28 08:52:16.220033 dv-cinder-851351-1-smb devstack@keystone.service[352316]: machine: x86_64 Jul 28 08:52:16.220150 dv-cinder-851351-1-smb devstack@keystone.service[352316]: clock source: unix Jul 28 08:52:16.220271 dv-cinder-851351-1-smb devstack@keystone.service[352316]: pcre jit disabled Jul 28 08:52:16.220441 dv-cinder-851351-1-smb devstack@keystone.service[352316]: detected number of CPU cores: 4 Jul 28 08:52:16.220441 dv-cinder-851351-1-smb devstack@keystone.service[352316]: current working directory: / Jul 28 08:52:16.220441 dv-cinder-851351-1-smb devstack@keystone.service[352316]: detected binary path: /usr/bin/uwsgi-core Jul 28 08:52:16.220441 dv-cinder-851351-1-smb devstack@keystone.service[352316]: your processes number limit is 47680 Jul 28 08:52:16.220441 dv-cinder-851351-1-smb devstack@keystone.service[352316]: your memory page size is 4096 bytes Jul 28 08:52:16.220441 dv-cinder-851351-1-smb devstack@keystone.service[352316]: detected max file descriptor number: 2048 Jul 28 08:52:16.220441 dv-cinder-851351-1-smb devstack@keystone.service[352316]: lock engine: pthread robust mutexes Jul 28 08:52:16.221140 dv-cinder-851351-1-smb devstack@keystone.service[352316]: thunder lock: enabled Jul 28 08:52:16.221140 dv-cinder-851351-1-smb devstack@keystone.service[352316]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Jul 28 08:52:16.221140 dv-cinder-851351-1-smb devstack@keystone.service[352316]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Jul 28 08:52:16.259714 dv-cinder-851351-1-smb devstack@keystone.service[352316]: Python main interpreter initialized at 0x55a008ed29c0 Jul 28 08:52:16.259714 dv-cinder-851351-1-smb devstack@keystone.service[352316]: python threads support enabled Jul 28 08:52:16.259714 dv-cinder-851351-1-smb devstack@keystone.service[352316]: your server socket listen backlog is limited to 100 connections Jul 28 08:52:16.259714 dv-cinder-851351-1-smb devstack@keystone.service[352316]: your mercy for graceful operations on workers is 90 seconds Jul 28 08:52:16.260204 dv-cinder-851351-1-smb devstack@keystone.service[352316]: mapped 403077 bytes (393 KB) for 2 cores Jul 28 08:52:16.260204 dv-cinder-851351-1-smb devstack@keystone.service[352316]: *** Operational MODE: preforking *** Jul 28 08:52:16.260397 dv-cinder-851351-1-smb devstack@keystone.service[352316]: *** uWSGI is running in multiple interpreter mode *** Jul 28 08:52:16.260397 dv-cinder-851351-1-smb devstack@keystone.service[352316]: spawned uWSGI master process (pid: 352316) Jul 28 08:52:16.260619 dv-cinder-851351-1-smb systemd[1]: Started Devstack devstack@keystone.service. Jul 28 08:52:16.263908 dv-cinder-851351-1-smb devstack@keystone.service[352316]: spawned uWSGI worker 1 (pid: 352328, cores: 1) Jul 28 08:52:16.263908 dv-cinder-851351-1-smb devstack@keystone.service[352316]: spawned uWSGI worker 2 (pid: 352329, cores: 1) Jul 28 08:52:16.263908 dv-cinder-851351-1-smb devstack@keystone.service[352316]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jul 28 08:52:21.746392 dv-cinder-851351-1-smb devstack@keystone.service[352329]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 28 08:52:21.746392 dv-cinder-851351-1-smb devstack@keystone.service[352329]: from cryptography.utils import int_from_bytes Jul 28 08:52:21.747388 dv-cinder-851351-1-smb devstack@keystone.service[352329]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 28 08:52:21.747388 dv-cinder-851351-1-smb devstack@keystone.service[352329]: from cryptography.utils import int_from_bytes Jul 28 08:52:21.751118 dv-cinder-851351-1-smb devstack@keystone.service[352328]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 28 08:52:21.751118 dv-cinder-851351-1-smb devstack@keystone.service[352328]: from cryptography.utils import int_from_bytes Jul 28 08:52:21.751724 dv-cinder-851351-1-smb devstack@keystone.service[352328]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 28 08:52:21.751724 dv-cinder-851351-1-smb devstack@keystone.service[352328]: from cryptography.utils import int_from_bytes Jul 28 08:52:21.796327 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=352329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 28 08:52:21.796594 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=352329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 28 08:52:21.796741 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG uwsgi [-] command line args: [] {{(pid=352329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 28 08:52:21.796986 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=352329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 28 08:52:21.797142 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG uwsgi [-] ================================================================================ {{(pid=352329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 28 08:52:21.797419 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG uwsgi [-] admin_token = **** {{(pid=352329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 08:52:21.797661 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG uwsgi [-] config_dir = [] {{(pid=352329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 08:52:21.797825 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=352329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 08:52:21.798019 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG uwsgi [-] config_source = [] {{(pid=352329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 08:52:21.798175 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG uwsgi [-] debug = True {{(pid=352329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 08:52:21.798383 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=352329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 08:52:21.798732 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=352328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 28 08:52:21.798891 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=352329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 08:52:21.799022 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=352328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 28 08:52:21.799162 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG uwsgi [-] insecure_debug = False {{(pid=352329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 08:52:21.799287 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG uwsgi [-] command line args: [] {{(pid=352328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 28 08:52:21.799413 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=352329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 08:52:21.799548 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=352328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 28 08:52:21.799680 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=352329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 08:52:21.799807 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG uwsgi [-] ================================================================================ {{(pid=352328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 28 08:52:21.799931 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG uwsgi [-] list_limit = None {{(pid=352329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 08:52:21.800049 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG uwsgi [-] admin_token = **** {{(pid=352328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 08:52:21.800197 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG uwsgi [-] log_config_append = None {{(pid=352329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 08:52:21.800197 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=352329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 08:52:21.800472 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG uwsgi [-] config_dir = [] {{(pid=352328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 08:52:21.800598 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG uwsgi [-] log_dir = None {{(pid=352329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 08:52:21.800756 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=352328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 08:52:21.800872 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG uwsgi [-] log_file = None {{(pid=352329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 08:52:21.801008 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG uwsgi [-] config_source = [] {{(pid=352328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 08:52:21.801122 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=352329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 08:52:21.801260 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG uwsgi [-] debug = True {{(pid=352328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 08:52:21.801260 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=352328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 08:52:21.801532 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=352329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 08:52:21.801652 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=352328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 08:52:21.801799 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=352329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 08:52:21.801907 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG uwsgi [-] insecure_debug = False {{(pid=352328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 08:52:21.802007 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=352329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 08:52:21.802108 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=352328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 08:52:21.802264 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=352329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 08:52:21.802264 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=352329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 08:52:21.802458 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=352328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 08:52:21.802552 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=352329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 08:52:21.802696 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG uwsgi [-] list_limit = None {{(pid=352328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 08:52:21.802696 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG uwsgi [-] log_config_append = None {{(pid=352328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 08:52:21.802942 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=352329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 08:52:21.803043 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=352328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 08:52:21.803147 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=352329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 08:52:21.803246 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG uwsgi [-] log_dir = None {{(pid=352328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 08:52:21.803344 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=352329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 08:52:21.803486 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG uwsgi [-] log_file = None {{(pid=352328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 08:52:21.803588 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=352329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 08:52:21.803687 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=352328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 08:52:21.803790 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=352329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 08:52:21.803936 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=352328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 08:52:21.804042 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=352329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 08:52:21.804143 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=352328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 08:52:21.804253 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG uwsgi [-] notification_format = cadf {{(pid=352329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 08:52:21.804352 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=352328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 08:52:21.804352 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=352328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 08:52:21.804591 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=352329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 08:52:21.804743 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=352328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 08:52:21.804743 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=352328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 08:52:21.804929 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.42/identity {{(pid=352329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 08:52:21.805045 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=352328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 08:52:21.805188 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG uwsgi [-] publish_errors = False {{(pid=352329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 08:52:21.805314 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=352328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 08:52:21.805474 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=352329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 08:52:21.805576 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=352328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 08:52:21.805688 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=352329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 08:52:21.805833 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=352328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 08:52:21.805929 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=352329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 08:52:21.806026 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=352328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 08:52:21.806123 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=352329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 08:52:21.806230 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=352328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 08:52:21.806346 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=352329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 08:52:21.806445 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG uwsgi [-] notification_format = cadf {{(pid=352328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 08:52:21.806544 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG uwsgi [-] standard_threads = False {{(pid=352329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 08:52:21.806544 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG uwsgi [-] strict_password_check = False {{(pid=352329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 08:52:21.806742 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=352328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 08:52:21.806841 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=352329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 08:52:21.806841 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG uwsgi [-] use_eventlog = False {{(pid=352329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 08:52:21.807042 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.42/identity {{(pid=352328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 08:52:21.807147 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG uwsgi [-] use_journal = False {{(pid=352329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 08:52:21.807241 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG uwsgi [-] publish_errors = False {{(pid=352328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 08:52:21.807347 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG uwsgi [-] use_json = False {{(pid=352329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 08:52:21.807347 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG uwsgi [-] use_stderr = False {{(pid=352329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 08:52:21.807549 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=352328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 08:52:21.807648 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG uwsgi [-] use_syslog = False {{(pid=352329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 08:52:21.807756 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=352328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 08:52:21.807850 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG uwsgi [-] watch_log_file = False {{(pid=352329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 08:52:21.807947 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=352328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 08:52:21.808052 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=352329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:52:21.808152 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=352328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 08:52:21.808253 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=352329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:52:21.808351 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=352328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 08:52:21.808449 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=352329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:52:21.808556 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG uwsgi [-] standard_threads = False {{(pid=352328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 08:52:21.808701 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=352329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:52:21.808817 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG uwsgi [-] strict_password_check = False {{(pid=352328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 08:52:21.808929 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=352329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:52:21.809034 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=352328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 08:52:21.809034 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG uwsgi [-] use_eventlog = False {{(pid=352328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 08:52:21.809231 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=352329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:52:21.809341 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG uwsgi [-] use_journal = False {{(pid=352328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 08:52:21.809458 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=352329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:52:21.809557 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG uwsgi [-] use_json = False {{(pid=352328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 08:52:21.809557 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG uwsgi [-] use_stderr = False {{(pid=352328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 08:52:21.809744 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=352329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:52:21.809844 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG uwsgi [-] use_syslog = False {{(pid=352328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 08:52:21.809950 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=352329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:52:21.810053 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG uwsgi [-] watch_log_file = False {{(pid=352328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 08:52:21.810152 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=352329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:52:21.810250 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=352328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:52:21.810347 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=352329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:52:21.810453 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=352328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:52:21.810558 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=352329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:52:21.810657 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=352328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:52:21.810756 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=352329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:52:21.810854 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=352328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:52:21.810954 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=352329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:52:21.811059 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=352328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:52:21.811160 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=352329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:52:21.811261 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=352328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:52:21.811418 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=352329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:52:21.811516 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=352328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:52:21.811614 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=352329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:52:21.811715 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=352328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:52:21.811828 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=352329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:52:21.811927 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=352328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:52:21.812032 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=352329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:52:21.812130 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=352328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:52:21.812228 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=352329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:52:21.812326 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=352328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:52:21.812440 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=352329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:52:21.812538 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=352328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:52:21.812677 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=352329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:52:21.812792 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=352328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:52:21.812887 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=352329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:52:21.812983 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=352328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:52:21.813087 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=352329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:52:21.813181 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=352328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:52:21.813278 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=352329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:52:21.813370 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=352328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:52:21.813461 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=352329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:52:21.813563 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=352328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:52:21.813658 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=352329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:52:21.813748 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=352328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:52:21.813860 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=352329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:52:21.813960 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=352328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:52:21.814064 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=352329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:52:21.814170 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=352328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:52:21.814270 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=352329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:52:21.814362 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=352328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:52:21.814468 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=352329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:52:21.814612 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=352328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:52:21.814744 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=352329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:52:21.814932 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=352329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:52:21.815032 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=352328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:52:21.815132 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=352329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:52:21.815230 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=352328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:52:21.815439 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=352329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:52:21.815542 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=352328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:52:21.815659 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=352329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:52:21.815759 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=352328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:52:21.815867 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=352329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:52:21.815966 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=352328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:52:21.816073 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=352329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:52:21.816172 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=352328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:52:21.816277 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=352329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:52:21.816384 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=352328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:52:21.816483 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=352329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:52:21.816581 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=352328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:52:21.816731 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=352329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:52:21.816840 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=352328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:52:21.816953 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=352329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:52:21.817052 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=352328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:52:21.817160 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=352329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:52:21.817268 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=352328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:52:21.817413 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=352329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:52:21.817529 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=352328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:52:21.817636 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=352329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:52:21.817730 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=352328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:52:21.817917 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=352329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:52:21.818083 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=352328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:52:21.818192 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=352329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:52:21.818297 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=352328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:52:21.818406 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=352329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:52:21.818521 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=352328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:52:21.818616 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=352329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:52:21.818720 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=352328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:52:21.818828 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=352329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:52:21.818943 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=352328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:52:21.819051 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=352329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:52:21.819161 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=352328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:52:21.819261 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=352329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:52:21.819359 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=352328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:52:21.819457 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=352329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:52:21.819555 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=352328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:52:21.819695 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=352329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:52:21.819827 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=352328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:52:21.819930 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=352329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:52:21.820029 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=352328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:52:21.820151 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=352329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:52:21.820273 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=352328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:52:21.820386 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=352329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:52:21.820485 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=352328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:52:21.820619 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=352329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:52:21.820791 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=352328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:52:21.820895 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=352329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:52:21.820998 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=352328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:52:21.821107 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=352329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:52:21.821206 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=352328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:52:21.821373 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=352329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:52:21.821541 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=352328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:52:21.821651 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=352329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:52:21.821776 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=352328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:52:21.821887 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=352329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:52:21.821980 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=352328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:52:21.822086 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=352329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:52:21.822195 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=352328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:52:21.822295 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=352329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:52:21.822394 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=352328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:52:21.822487 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=352329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:52:21.822584 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=352328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:52:21.822724 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=352329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:52:21.822842 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=352328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:52:21.822942 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=352328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:52:21.823039 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=352329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:52:21.823211 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=352328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:52:21.823384 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=352329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:52:21.823506 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=352328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:52:21.823609 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=352329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:52:21.823710 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=352328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:52:21.823810 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=352329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:52:21.823908 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=352328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:52:21.824017 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=352329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:52:21.824133 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=352328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:52:21.824244 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=352329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:52:21.824352 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=352328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:52:21.824457 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=352329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:52:21.824584 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=352329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:52:21.824748 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=352328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:52:21.824863 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=352328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:52:21.824955 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG uwsgi [-] cache.enabled = True {{(pid=352329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:52:21.825050 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=352328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:52:21.825157 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=352329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:52:21.825331 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=352328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:52:21.825498 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=352329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:52:21.825619 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=352329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:52:21.825721 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=352328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:52:21.825822 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=352329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:52:21.825928 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=352328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:52:21.826037 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=352329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:52:21.826137 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=352328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:52:21.826237 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=352329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:52:21.826335 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=352328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:52:21.826473 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=352329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:52:21.826598 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=352328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:52:21.826699 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=352329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:52:21.826797 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=352328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:52:21.826983 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=352329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:52:21.827131 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=352328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:52:21.827242 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=352329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:52:21.827353 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG uwsgi [-] cache.enabled = True {{(pid=352328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:52:21.827448 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=352329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:52:21.827552 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=352328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:52:21.827650 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=352329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:52:21.827742 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=352328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:52:21.827911 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=352329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:52:21.828084 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=352328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:52:21.828194 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=352329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:52:21.828288 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=352328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:52:21.828405 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=352329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:52:21.828498 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=352328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:52:21.828595 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=352329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:52:21.828785 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=352328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:52:21.828884 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=352329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:52:21.829353 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=352328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:52:21.829453 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=352329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:52:21.829558 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=352328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:52:21.829651 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=352329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:52:21.829752 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=352328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:52:21.829851 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=352329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:52:21.829949 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=352328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:52:21.830046 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=352329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:52:21.830141 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=352328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:52:21.830322 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=352329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:52:21.830494 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=352328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:52:21.830647 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=352329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:52:21.830791 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=352328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:52:21.830936 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=352329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:52:21.831081 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=352328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:52:21.831231 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=352329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:52:21.831420 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=352328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:52:21.831565 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=352329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:52:21.831725 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=352328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:52:21.831877 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=352329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:52:21.832034 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=352328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:52:21.832184 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=352329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:52:21.832341 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=352328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:52:21.832492 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG uwsgi [-] auth.external = None {{(pid=352329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:52:21.832635 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=352328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:52:21.832812 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG uwsgi [-] auth.mapped = None {{(pid=352329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:52:21.832970 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=352328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:52:21.832970 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=352328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:52:21.833263 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=352329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:52:21.833429 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=352328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:52:21.833604 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=352329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:52:21.833755 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=352328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:52:21.833914 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG uwsgi [-] auth.password = None {{(pid=352329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:52:21.834060 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=352328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:52:21.834218 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG uwsgi [-] auth.token = None {{(pid=352329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:52:21.834377 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=352328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:52:21.834528 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=352329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:52:21.834528 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG uwsgi [-] catalog.caching = True {{(pid=352329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:52:21.834812 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=352328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:52:21.834979 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=352329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:52:21.835131 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=352328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:52:21.835288 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=352329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:52:21.835440 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=352328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:52:21.835613 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=352329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:52:21.835774 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG uwsgi [-] auth.external = None {{(pid=352328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:52:21.835925 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=352329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:52:21.836079 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG uwsgi [-] auth.mapped = None {{(pid=352328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:52:21.836314 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=352329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:52:21.836473 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=352328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:52:21.836625 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG uwsgi [-] credential.caching = True {{(pid=352329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:52:21.836743 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=352328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:52:21.836954 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG uwsgi [-] credential.driver = sql {{(pid=352329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:52:21.837104 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG uwsgi [-] auth.password = None {{(pid=352328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:52:21.837266 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=352329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:52:21.837425 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG uwsgi [-] auth.token = None {{(pid=352328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:52:21.837575 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=352329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:52:21.837717 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=352328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:52:21.837882 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=352329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:52:21.838047 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG uwsgi [-] catalog.caching = True {{(pid=352328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:52:21.838200 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=352329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:52:21.838349 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=352328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:52:21.838498 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=352329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:52:21.838657 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=352328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:52:21.838657 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=352328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:52:21.838935 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=352329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:52:21.839099 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=352328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:52:21.839243 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=352329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:52:21.839395 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=352328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:52:21.839554 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=352329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:52:21.839703 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG uwsgi [-] credential.caching = True {{(pid=352328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:52:21.839869 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=352329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:52:21.840012 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG uwsgi [-] credential.driver = sql {{(pid=352328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:52:21.840160 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=352329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:52:21.840309 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=352328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:52:21.840454 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=352329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:52:21.840612 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=352328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:52:21.840812 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=352329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:52:21.840976 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=352328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:52:21.841130 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=352329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:52:21.841281 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=352328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:52:21.841435 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=352329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:52:21.841584 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=352328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:52:21.841739 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG uwsgi [-] federation.caching = True {{(pid=352329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:52:21.841893 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=352328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:52:21.842065 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=352329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:52:21.842210 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=352328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:52:21.842369 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG uwsgi [-] federation.driver = sql {{(pid=352329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:52:21.842513 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=352328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:52:21.842671 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=352329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:52:21.842816 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=352328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:52:21.842960 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=352329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:52:21.843123 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=352328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:52:21.843281 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=352329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:52:21.843434 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=352328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:52:21.843623 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=352329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:52:21.843623 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=352329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:52:21.843940 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=352328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:52:21.844096 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=352329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:52:21.844246 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=352328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:52:21.844395 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=352329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:52:21.844556 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=352328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:52:21.844726 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=352329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:52:21.844870 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG uwsgi [-] federation.caching = True {{(pid=352328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:52:21.845037 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=352329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:52:21.845183 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=352328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:52:21.845336 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG uwsgi [-] identity.caching = True {{(pid=352329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:52:21.845491 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG uwsgi [-] federation.driver = sql {{(pid=352328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:52:21.845649 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=352329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:52:21.845799 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=352328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:52:21.845951 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=352329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:52:21.846098 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=352328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:52:21.846253 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=352329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:52:21.846408 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=352328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:52:21.846634 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=352329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:52:21.846792 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=352328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:52:21.846948 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG uwsgi [-] identity.driver = sql {{(pid=352329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:52:21.847095 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=352328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:52:21.847255 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=352329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:52:21.847414 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=352328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:52:21.847570 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=352329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:52:21.847713 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=352328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:52:21.847857 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=352329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:52:21.848025 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=352328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:52:21.848177 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=352329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:52:21.848346 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=352328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:52:21.848497 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=352329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:52:21.848655 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG uwsgi [-] identity.caching = True {{(pid=352328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:52:21.848847 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=352329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:52:21.848994 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=352328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:52:21.849139 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=352329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:52:21.849295 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=352328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:52:21.849447 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=352329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:52:21.849597 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=352328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:52:21.849751 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=352329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:52:21.849895 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=352328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:52:21.850048 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=352329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:52:21.850204 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG uwsgi [-] identity.driver = sql {{(pid=352328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:52:21.850366 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=352329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:52:21.850517 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=352328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:52:21.850661 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=352329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:52:21.850817 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=352328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:52:21.850970 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=352329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:52:21.851123 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=352328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:52:21.851282 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=352329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:52:21.851447 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=352328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:52:21.851600 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=352329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:52:21.851750 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=352328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:52:21.851909 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=352329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:52:21.852062 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=352328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:52:21.852207 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=352329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:52:21.852362 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=352328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:52:21.852523 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=352329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:52:21.852683 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=352328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:52:21.852842 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=352329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:52:21.852991 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=352328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:52:21.853144 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=352329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:52:21.853298 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=352328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:52:21.853456 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=352329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:52:21.853602 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=352328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:52:21.853763 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=352329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:52:21.853924 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=352328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:52:21.854072 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=352329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:52:21.854234 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=352328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:52:21.854390 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=352329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:52:21.854555 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=352328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:52:21.854714 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=352329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:52:21.854878 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=352328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:52:21.855032 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=352329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:52:21.855196 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=352328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:52:21.855359 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=352329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:52:21.855515 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=352328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:52:21.855682 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=352329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:52:21.855834 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=352328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:52:21.855987 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=352329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:52:21.856132 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=352328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:52:21.856284 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=352329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:52:21.856451 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=352328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:52:21.856604 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG uwsgi [-] ldap.password = **** {{(pid=352329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:52:21.856806 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=352328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:52:21.856963 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=352329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:52:21.857117 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=352328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:52:21.857270 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=352329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:52:21.857421 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=352328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:52:21.857578 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=352329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:52:21.857733 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=352328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:52:21.857889 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=352329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:52:21.858039 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=352328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:52:21.858190 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=352329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:52:21.858340 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=352328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:52:21.858497 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=352329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:52:21.858663 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=352328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:52:21.858835 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=352329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:52:21.858987 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=352328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:52:21.859138 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=352329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:52:21.859283 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=352328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:52:21.859439 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=352329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:52:21.859584 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=352328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:52:21.859730 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=352329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:52:21.859884 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG uwsgi [-] ldap.password = **** {{(pid=352328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:52:21.860039 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=352329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:52:21.860201 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=352328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:52:21.860358 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=352329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:52:21.860512 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=352328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:52:21.860656 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=352329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:52:21.860825 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=352328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:52:21.860995 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=352329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:52:21.861146 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=352328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:52:21.861311 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG uwsgi [-] ldap.user = None {{(pid=352329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:52:21.861461 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=352328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:52:21.861611 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=352329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:52:21.861760 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=352328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:52:21.861908 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=352329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:52:21.862064 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=352328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:52:21.862280 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=352329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:52:21.862461 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=352328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:52:21.862617 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=352329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:52:21.862768 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=352328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:52:21.862912 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=352329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:52:21.863066 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=352328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:52:21.863222 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=352329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:52:21.863378 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=352328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:52:21.863529 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=352329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:52:21.863688 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=352328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:52:21.863847 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=352329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:52:21.863998 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=352328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:52:21.864152 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=352329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:52:21.864302 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=352328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:52:21.864447 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=352329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:52:21.864589 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG uwsgi [-] ldap.user = None {{(pid=352328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:52:21.864754 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=352329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:52:21.864909 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=352328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:52:21.865060 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=352329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:52:21.865220 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=352328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:52:21.865368 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=352329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:52:21.865511 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=352328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:52:21.865681 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=352329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:52:21.865904 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=352328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:52:21.866060 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=352329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:52:21.866222 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=352328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:52:21.866371 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=352329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:52:21.866522 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=352328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:52:21.866682 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=352329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:52:21.866850 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=352328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:52:21.867004 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=352329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:52:21.867145 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=352328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:52:21.867304 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=352329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:52:21.867455 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=352328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:52:21.867455 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=352328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:52:21.867750 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=352329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:52:21.867905 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=352328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:52:21.868052 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=352329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:52:21.868198 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=352328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:52:21.868352 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=352329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:52:21.868352 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=352329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:52:21.868641 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=352328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:52:21.868849 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=352329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:52:21.868996 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=352328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:52:21.869159 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=352329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:52:21.869310 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=352328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:52:21.869470 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=352329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:52:21.869577 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=352328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:52:21.869763 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG uwsgi [-] policy.driver = sql {{(pid=352329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:52:21.869919 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=352328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:52:21.870071 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=352329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:52:21.870215 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=352328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:52:21.870374 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=352329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:52:21.870530 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=352328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:52:21.870678 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=352329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:52:21.870833 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=352328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:52:21.870985 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG uwsgi [-] receipt.caching = True {{(pid=352329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:52:21.871146 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=352328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:52:21.871299 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=352329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:52:21.871466 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=352328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:52:21.871621 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=352329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:52:21.871777 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=352328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:52:21.871929 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=352329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:52:21.872073 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=352328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:52:21.872223 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=352329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:52:21.872380 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=352328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:52:21.872380 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=352328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:52:21.872692 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=352329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:52:21.872692 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG uwsgi [-] resource.caching = True {{(pid=352329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:52:21.872984 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG uwsgi [-] policy.driver = sql {{(pid=352328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:52:21.873128 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=352329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:52:21.873279 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=352328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:52:21.873429 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG uwsgi [-] resource.driver = sql {{(pid=352329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:52:21.873598 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=352328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:52:21.873758 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=352329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:52:21.873916 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=352328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:52:21.873916 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG uwsgi [-] receipt.caching = True {{(pid=352328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:52:21.874196 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=352329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:52:21.874345 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=352328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:52:21.874488 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=352329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:52:21.874488 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG uwsgi [-] revoke.caching = True {{(pid=352329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:52:21.874764 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=352328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:52:21.874909 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=352329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:52:21.875060 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=352328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:52:21.875203 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=352329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:52:21.875358 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=352328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:52:21.875500 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG uwsgi [-] role.cache_time = None {{(pid=352329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:52:21.875656 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=352328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:52:21.875815 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG uwsgi [-] role.caching = True {{(pid=352329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:52:21.875971 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG uwsgi [-] resource.caching = True {{(pid=352328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:52:21.876121 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG uwsgi [-] role.driver = sql {{(pid=352329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:52:21.876263 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=352328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:52:21.876406 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG uwsgi [-] role.list_limit = None {{(pid=352329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:52:21.876554 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG uwsgi [-] resource.driver = sql {{(pid=352328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:52:21.876715 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=352329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:52:21.876878 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=352328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:52:21.877030 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=352329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:52:21.877181 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=352328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:52:21.877336 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=352329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:52:21.877485 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=352328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:52:21.877631 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=352329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:52:21.877869 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG uwsgi [-] revoke.caching = True {{(pid=352328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:52:21.878024 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=352329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:52:21.878178 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=352328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:52:21.878326 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=352329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:52:21.878469 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=352328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:52:21.878611 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=352329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:52:21.878763 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG uwsgi [-] role.cache_time = None {{(pid=352328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:52:21.878917 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=352329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:52:21.879068 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG uwsgi [-] role.caching = True {{(pid=352328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:52:21.879222 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=352329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:52:21.879369 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG uwsgi [-] role.driver = sql {{(pid=352328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:52:21.879518 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=352329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:52:21.879677 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG uwsgi [-] role.list_limit = None {{(pid=352328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:52:21.879841 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=352329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:52:21.879999 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=352328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:52:21.880153 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=352329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:52:21.880306 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=352328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:52:21.880477 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=352329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:52:21.880637 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=352328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:52:21.880637 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=352328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:52:21.880954 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=352329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:52:21.880954 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=352329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:52:21.881246 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=352328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:52:21.881246 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=352328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:52:21.881544 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=352329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:52:21.881689 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=352328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:52:21.881858 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=352329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:52:21.881858 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=352329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:52:21.882135 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=352328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:52:21.882135 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=352328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:52:21.882446 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=352329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:52:21.882446 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=352329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:52:21.882733 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=352328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:52:21.882877 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=352329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:52:21.883020 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=352328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:52:21.883175 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=352329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:52:21.883328 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=352328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:52:21.883478 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=352329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:52:21.883621 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=352328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:52:21.883786 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=352329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:52:21.883939 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=352328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:52:21.884099 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=352329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:52:21.884250 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=352328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:52:21.884394 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=352329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:52:21.884549 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=352328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:52:21.884714 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=352329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:52:21.884871 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=352328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:52:21.885028 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=352329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:52:21.885174 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=352328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:52:21.885332 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=352329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:52:21.885332 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=352329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:52:21.885616 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=352328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:52:21.885778 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=352329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:52:21.885937 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=352328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:52:21.886098 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG uwsgi [-] token.cache_time = None {{(pid=352329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:52:21.886250 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=352328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:52:21.886418 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG uwsgi [-] token.caching = True {{(pid=352329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:52:21.886565 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=352328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:52:21.886721 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=352329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:52:21.886866 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=352328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:52:21.887020 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG uwsgi [-] token.provider = fernet {{(pid=352329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:52:21.887166 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=352328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:52:21.887312 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=352329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:52:21.887480 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=352328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:52:21.887634 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=352329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:52:21.887781 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=352328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:52:21.887938 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=352329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:52:21.888084 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=352328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:52:21.888242 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=352329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:52:21.888394 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=352328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:52:21.888551 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=352329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:52:21.888707 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=352328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:52:21.888861 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=352329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:52:21.889005 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=352328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:52:21.889149 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG uwsgi [-] trust.driver = sql {{(pid=352329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:52:21.889297 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=352328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:52:21.889449 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=352329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:52:21.889599 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG uwsgi [-] token.cache_time = None {{(pid=352328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:52:21.889756 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=352329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:52:21.889910 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG uwsgi [-] token.caching = True {{(pid=352328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:52:21.890053 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=352329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:52:21.890195 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=352328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:52:21.890347 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=352329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:52:21.890504 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG uwsgi [-] token.provider = fernet {{(pid=352328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:52:21.890655 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=352329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:52:21.890809 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=352328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:52:21.890962 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=352329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:52:21.891104 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=352328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:52:21.891271 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=352329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:52:21.891419 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=352328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:52:21.891579 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=352329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:52:21.891723 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=352328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:52:21.891723 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=352328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:52:21.892003 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG uwsgi [-] database.connection = **** {{(pid=352329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:52:21.892164 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=352328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:52:21.892322 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=352329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:52:21.892476 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG uwsgi [-] trust.driver = sql {{(pid=352328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:52:21.892635 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=352329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:52:21.892869 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=352328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:52:21.893022 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=352329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:52:21.893176 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=352328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:52:21.893346 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=352329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:52:21.893753 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=352328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:52:21.893911 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=352329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:52:21.893911 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=352329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:52:21.894293 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=352328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:52:21.894445 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=352329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:52:21.894602 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=352328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:52:21.894747 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=352329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:52:21.894848 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=352328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:52:21.894942 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=352329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:52:21.895182 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=352328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:52:21.895335 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=352329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:52:21.895489 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=352328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:52:21.895634 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=352329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:52:21.895778 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG uwsgi [-] database.connection = **** {{(pid=352328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:52:21.895940 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=352329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:52:21.896100 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=352328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:52:21.896252 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=352329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:52:21.896405 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=352328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:52:21.896565 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=352329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:52:21.896730 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=352328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:52:21.896886 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=352329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:52:21.897030 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=352328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:52:21.897180 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=352329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:52:21.897332 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=352328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:52:21.897491 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=352329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:52:21.897634 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=352328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:52:21.897784 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=352329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:52:21.897938 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=352328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:52:21.898097 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=352329) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 28 08:52:21.898259 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=352328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:52:21.898259 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=352328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:52:21.898259 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=352328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:52:21.898259 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=352328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:52:21.898259 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=352328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:52:21.898259 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=352328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:52:21.898259 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=352328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:52:21.898259 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=352328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:52:21.898259 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=352328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:52:21.899555 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=352328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:52:21.899555 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=352328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 08:52:21.899555 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=352328) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 28 08:52:21.911456 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=352329) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 08:52:21.911687 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=352329) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 08:52:21.911914 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=352329) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 08:52:21.913167 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=352328) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 08:52:21.913404 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=352328) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 08:52:21.913631 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=352328) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 08:52:21.920432 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=352329) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 08:52:21.922166 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=352328) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 08:52:21.950434 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=352329) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 08:52:21.950734 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=352329) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 08:52:21.952162 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=352328) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 08:52:21.952376 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=352328) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 08:52:22.003628 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=352329) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 08:52:22.004027 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=352328) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 08:52:22.055706 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=352329) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 08:52:22.056097 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=352329) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 08:52:22.056262 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=352328) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 08:52:22.056262 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=352328) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 08:52:22.122181 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=352329) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 08:52:22.122529 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=352328) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 08:52:22.122713 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=352329) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 08:52:22.122882 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=352328) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 08:52:22.122988 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=352329) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 08:52:22.123209 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=352328) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 08:52:22.123318 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=352329) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 08:52:22.123521 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=352328) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 08:52:22.123637 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=352329) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 08:52:22.123831 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=352328) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 08:52:22.123947 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=352329) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 08:52:22.124133 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=352328) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 08:52:22.146546 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=352329) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 08:52:22.146845 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=352329) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 08:52:22.146956 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=352328) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 08:52:22.147176 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=352329) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 08:52:22.147283 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=352328) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 08:52:22.147512 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=352329) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 08:52:22.147671 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=352328) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 08:52:22.147824 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=352329) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 08:52:22.147941 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=352328) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 08:52:22.148134 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=352329) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 08:52:22.148248 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=352328) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 08:52:22.148448 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=352329) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 08:52:22.148605 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=352328) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 08:52:22.148605 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=352328) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 08:52:22.159206 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=352329) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 08:52:22.159487 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=352328) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 08:52:22.172072 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=352329) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 08:52:22.172357 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=352329) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 08:52:22.172468 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=352329) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 08:52:22.172646 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=352328) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 08:52:22.172852 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=352329) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 08:52:22.172957 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=352328) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 08:52:22.173160 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=352329) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 08:52:22.173323 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=352328) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 08:52:22.173437 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=352329) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 08:52:22.173653 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=352328) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 08:52:22.173811 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=352329) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 08:52:22.173980 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=352328) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 08:52:22.173980 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=352328) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 08:52:22.173980 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=352328) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 08:52:22.190321 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=352329) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 08:52:22.190563 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=352329) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jul 28 08:52:22.190856 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=352329) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 08:52:22.191071 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=352328) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 08:52:22.191185 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=352329) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jul 28 08:52:22.191394 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=352328) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jul 28 08:52:22.191505 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=352329) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 08:52:22.191666 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=352328) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 08:52:22.191876 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=352329) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 08:52:22.192038 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=352328) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jul 28 08:52:22.192184 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=352329) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 08:52:22.192345 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=352328) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 08:52:22.192490 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=352329) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 08:52:22.192636 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=352328) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 08:52:22.192636 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=352328) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 08:52:22.192636 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=352328) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 08:52:22.201752 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=352329) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 08:52:22.202000 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=352329) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 08:52:22.202300 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=352329) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 08:52:22.202520 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=352328) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 08:52:22.202520 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=352328) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 08:52:22.202813 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=352329) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 08:52:22.202985 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=352328) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 08:52:22.203147 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=352328) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 08:52:22.209914 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=352329) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 28 08:52:22.210470 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=352328) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 28 08:52:22.214697 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=352329) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 28 08:52:22.214990 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=352329) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 08:52:22.215245 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=352329) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 08:52:22.215433 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=352328) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 28 08:52:22.215606 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=352329) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 08:52:22.215716 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=352328) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 08:52:22.215869 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=352329) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 08:52:22.216067 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=352328) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 08:52:22.216183 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=352329) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 08:52:22.216386 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=352328) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 08:52:22.216500 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=352329) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 08:52:22.216729 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=352328) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 08:52:22.216899 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=352329) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 08:52:22.217063 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=352328) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 08:52:22.217217 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=352329) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 08:52:22.217367 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=352328) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 08:52:22.217525 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=352329) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 08:52:22.217668 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=352328) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 08:52:22.217821 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=352329) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 08:52:22.217981 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=352328) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 08:52:22.217981 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=352328) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 08:52:22.217981 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=352328) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 08:52:22.240223 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=352329) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 08:52:22.240924 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=352328) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 08:52:22.241731 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=352329) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 28 08:52:22.241986 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=352329) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 08:52:22.242424 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=352328) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 28 08:52:22.242689 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=352328) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 08:52:22.246632 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=352329) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 28 08:52:22.246884 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=352329) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 08:52:22.247196 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=352329) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 08:52:22.247410 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=352328) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 28 08:52:22.247579 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=352328) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 08:52:22.247881 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=352328) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 08:52:22.254586 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=352329) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 28 08:52:22.254781 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=352328) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 28 08:52:22.254894 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=352328) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 08:52:22.254993 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=352329) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 08:52:22.259047 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=352328) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 28 08:52:22.259262 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=352329) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 28 08:52:22.259399 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=352328) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 08:52:22.259606 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=352329) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 08:52:22.259719 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=352328) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 08:52:22.259827 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=352329) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 08:52:22.259935 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=352328) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 08:52:22.260109 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=352329) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 08:52:22.260271 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=352328) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 08:52:22.260381 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=352329) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 08:52:22.260483 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=352328) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 08:52:22.260613 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=352329) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 08:52:22.260764 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=352328) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 08:52:22.260919 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=352329) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 08:52:22.261038 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=352328) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 08:52:22.261207 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=352329) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 08:52:22.276869 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=352329) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 08:52:22.277044 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=352328) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 08:52:22.277145 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=352329) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 08:52:22.277253 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=352328) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 08:52:22.280983 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=352329) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 28 08:52:22.281132 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=352328) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 28 08:52:22.284106 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=352329) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 08:52:22.284322 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=352328) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 08:52:22.284453 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=352329) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 08:52:22.284650 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=352328) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 08:52:22.288768 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=352329) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 28 08:52:22.289141 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=352328) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 28 08:52:22.291928 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=352329) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 28 08:52:22.292326 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=352328) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 28 08:52:22.295127 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=352329) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 08:52:22.295423 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=352329) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 08:52:22.295588 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=352328) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 08:52:22.295701 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=352329) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 08:52:22.295806 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=352328) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 08:52:22.295997 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=352329) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 08:52:22.296169 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=352328) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 08:52:22.296292 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=352329) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 08:52:22.296387 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=352328) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 08:52:22.296528 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=352329) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 08:52:22.296645 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=352328) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 08:52:22.296949 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=352328) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 08:52:22.312710 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=352329) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 28 08:52:22.312973 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=352329) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 08:52:22.313130 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=352328) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 28 08:52:22.313234 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=352329) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 08:52:22.313389 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=352328) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 08:52:22.313508 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=352329) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 08:52:22.313653 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=352328) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 08:52:22.313874 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=352328) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 08:52:22.320699 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=352329) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 08:52:22.320948 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=352328) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 08:52:22.322293 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=352329) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 08:52:22.322542 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=352328) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 08:52:22.322707 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=352329) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 08:52:22.322838 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=352328) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 08:52:22.325430 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=352329) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 28 08:52:22.325657 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=352328) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 28 08:52:22.325785 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=352329) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 08:52:22.325945 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=352328) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 08:52:22.326067 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=352329) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 08:52:22.326256 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=352328) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 08:52:22.326424 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=352329) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 08:52:22.326536 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=352328) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 08:52:22.326693 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=352329) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 08:52:22.326794 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=352328) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 08:52:22.338693 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=352329) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 28 08:52:22.338980 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=352328) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 28 08:52:22.339097 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=352329) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 08:52:22.339265 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=352328) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 08:52:22.339384 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=352329) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 08:52:22.339554 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=352328) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 08:52:22.339669 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=352329) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 08:52:22.339819 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=352328) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 08:52:22.339934 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=352329) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 08:52:22.340082 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=352328) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 08:52:22.340190 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=352329) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 08:52:22.340338 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=352328) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 08:52:22.340436 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=352329) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 08:52:22.340529 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=352328) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 08:52:22.355928 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=352329) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 28 08:52:22.356204 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=352328) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 28 08:52:22.358922 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=352329) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 28 08:52:22.359224 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=352328) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 28 08:52:22.361898 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=352329) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 08:52:22.362263 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=352328) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 08:52:22.364623 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=352329) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 08:52:22.365016 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=352328) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 08:52:22.366185 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=352329) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 28 08:52:22.366472 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=352329) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 08:52:22.366619 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=352328) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 28 08:52:22.366810 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=352329) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 08:52:22.366930 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=352328) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 08:52:22.367076 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=352328) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 08:52:22.373239 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=352329) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 08:52:22.373571 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=352328) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 08:52:22.374852 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=352329) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 28 08:52:22.375202 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=352328) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 28 08:52:22.377872 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=352329) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 08:52:22.378164 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=352329) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 08:52:22.378350 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=352328) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 08:52:22.378457 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=352329) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 08:52:22.378614 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=352328) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 08:52:22.378726 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=352329) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 08:52:22.378880 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=352328) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 08:52:22.378996 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=352328) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 08:52:22.386830 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=352329) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 28 08:52:22.387103 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=352329) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 08:52:22.387413 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=352329) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 08:52:22.388316 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=352328) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 28 08:52:22.388620 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=352328) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 08:52:22.388935 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=352328) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 08:52:22.394397 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=352329) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 28 08:52:22.394661 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=352329) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 08:52:22.394948 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=352329) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 08:52:22.395206 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=352329) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 08:52:22.395496 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=352329) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 08:52:22.395784 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=352329) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 08:52:22.395987 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=352328) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 28 08:52:22.396172 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=352329) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 08:52:22.396351 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=352328) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 08:52:22.396460 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=352329) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 08:52:22.396612 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=352328) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 08:52:22.396862 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=352329) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 08:52:22.397021 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=352328) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 08:52:22.397173 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=352329) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 08:52:22.397332 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=352328) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 08:52:22.397480 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=352329) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 08:52:22.397627 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=352328) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 08:52:22.397792 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=352329) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 08:52:22.397940 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=352328) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 08:52:22.398089 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=352329) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 08:52:22.398252 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=352328) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 08:52:22.398705 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=352329) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 08:52:22.398861 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=352328) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 08:52:22.398861 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=352328) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 08:52:22.398861 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=352328) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 08:52:22.399293 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=352328) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 08:52:22.399293 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=352328) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 08:52:22.399579 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=352328) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 08:52:22.431269 dv-cinder-851351-1-smb devstack@keystone.service[352329]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55a008ed29c0 pid: 352329 (default app) Jul 28 08:52:22.432854 dv-cinder-851351-1-smb devstack@keystone.service[352328]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55a008ed29c0 pid: 352328 (default app) Jul 28 08:52:22.434860 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4687bc6c-b636-419d-81d3-090bde827563 None None] REQUEST_METHOD: `GET` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:52:22.435153 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4687bc6c-b636-419d-81d3-090bde827563 None None] SCRIPT_NAME: `/identity` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:52:22.435427 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4687bc6c-b636-419d-81d3-090bde827563 None None] PATH_INFO: `/v3` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:52:22.439810 dv-cinder-851351-1-smb devstack@keystone.service[352329]: [pid: 352329|app: 0|req: 1/1] 10.222.0.42 () {50 vars in 791 bytes} [Thu Jul 28 08:52:22 2022] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:52:30.021912 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c830e22-8bca-4b01-bac6-60c0fe67ef03 None None] REQUEST_METHOD: `GET` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:52:30.021912 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c830e22-8bca-4b01-bac6-60c0fe67ef03 None None] SCRIPT_NAME: `/identity` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:52:30.022446 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c830e22-8bca-4b01-bac6-60c0fe67ef03 None None] PATH_INFO: `/` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:52:30.026810 dv-cinder-851351-1-smb devstack@keystone.service[352328]: [pid: 352328|app: 0|req: 1/2] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 08:52:30 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 08:52:30.032781 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8bd62b0-c417-4732-ad2f-fc7419d915c8 None None] REQUEST_METHOD: `POST` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:52:30.033192 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8bd62b0-c417-4732-ad2f-fc7419d915c8 None None] SCRIPT_NAME: `/identity` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:52:30.033346 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8bd62b0-c417-4732-ad2f-fc7419d915c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:52:30.105081 dv-cinder-851351-1-smb devstack@keystone.service[352329]: INFO dbcounter [None req-b8bd62b0-c417-4732-ad2f-fc7419d915c8 None None] Registered counter for database keystone Jul 28 08:52:30.127058 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG oslo_db.sqlalchemy.engines [None req-b8bd62b0-c417-4732-ad2f-fc7419d915c8 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=352329) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 28 08:52:30.134994 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG dbcounter [-] [352329] Writer thread running {{(pid=352329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 28 08:52:30.332930 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG passlib.handlers.bcrypt [None req-b8bd62b0-c417-4732-ad2f-fc7419d915c8 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=352329) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Jul 28 08:52:30.333366 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG passlib.handlers.bcrypt [None req-b8bd62b0-c417-4732-ad2f-fc7419d915c8 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=352329) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Jul 28 08:52:30.391644 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.auth.core [None req-b8bd62b0-c417-4732-ad2f-fc7419d915c8 None None] MFA Rules not processed for user `d18c063b2377412485965357671e5506`. Rule list: `[]` (Enabled: `True`). {{(pid=352329) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 08:52:30.393400 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.fernet_utils [None req-b8bd62b0-c417-4732-ad2f-fc7419d915c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=352329) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:52:30.526652 dv-cinder-851351-1-smb devstack@keystone.service[352329]: [pid: 352329|app: 0|req: 2/3] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 08:52:30 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 495 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jul 28 08:52:30.553402 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c830e22-8bca-4b01-bac6-60c0fe67ef03 None None] Authenticating user token {{(pid=352328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:52:30.625591 dv-cinder-851351-1-smb devstack@keystone.service[352328]: INFO dbcounter [None req-5c830e22-8bca-4b01-bac6-60c0fe67ef03 None None] Registered counter for database keystone Jul 28 08:52:30.645700 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG oslo_db.sqlalchemy.engines [None req-5c830e22-8bca-4b01-bac6-60c0fe67ef03 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=352328) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 28 08:52:30.652631 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG dbcounter [-] [352328] Writer thread running {{(pid=352328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 28 08:52:30.772327 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c830e22-8bca-4b01-bac6-60c0fe67ef03 None None] Validating token access rules against request {{(pid=352328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:52:30.777247 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b3b3d4-9188-4265-bfd0-49b2d907342f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c7af4b1c9fc4f35a95bbc0f95b044f2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:52:30.777902 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b3b3d4-9188-4265-bfd0-49b2d907342f admin admin] REQUEST_METHOD: `GET` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:52:30.778182 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b3b3d4-9188-4265-bfd0-49b2d907342f admin admin] SCRIPT_NAME: `/identity` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:52:30.778453 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b3b3d4-9188-4265-bfd0-49b2d907342f admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:52:30.787253 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49b3b3d4-9188-4265-bfd0-49b2d907342f admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:52:30.838815 dv-cinder-851351-1-smb devstack@keystone.service[352328]: WARNING keystone.common.rbac_enforcer.enforcer [None req-49b3b3d4-9188-4265-bfd0-49b2d907342f admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Jul 28 08:52:30.839105 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49b3b3d4-9188-4265-bfd0-49b2d907342f admin admin] RBAC: Authorization granted {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:52:30.849983 dv-cinder-851351-1-smb devstack@keystone.service[352328]: [pid: 352328|app: 0|req: 2/4] 10.222.0.42 () {58 vars in 1324 bytes} [Thu Jul 28 08:52:30 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 297 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 28 08:52:30.856275 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8bd62b0-c417-4732-ad2f-fc7419d915c8 None None] Authenticating user token {{(pid=352329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:52:30.871602 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8bd62b0-c417-4732-ad2f-fc7419d915c8 None None] Validating token access rules against request {{(pid=352329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:52:30.877722 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2deadfa7-2d0a-4153-bfb7-b97241b9cefc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c7af4b1c9fc4f35a95bbc0f95b044f2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:52:30.878805 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2deadfa7-2d0a-4153-bfb7-b97241b9cefc admin admin] REQUEST_METHOD: `GET` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:52:30.879097 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2deadfa7-2d0a-4153-bfb7-b97241b9cefc admin admin] SCRIPT_NAME: `/identity` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:52:30.879390 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2deadfa7-2d0a-4153-bfb7-b97241b9cefc admin admin] PATH_INFO: `/v3/projects/5c7af4b1c9fc4f35a95bbc0f95b044f2` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:52:30.881108 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2deadfa7-2d0a-4153-bfb7-b97241b9cefc admin admin] RBAC: Authorizing `identity:get_project(project_id=5c7af4b1c9fc4f35a95bbc0f95b044f2)` {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:52:30.931033 dv-cinder-851351-1-smb devstack@keystone.service[352329]: WARNING keystone.common.rbac_enforcer.enforcer [None req-2deadfa7-2d0a-4153-bfb7-b97241b9cefc admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Jul 28 08:52:30.931382 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2deadfa7-2d0a-4153-bfb7-b97241b9cefc admin admin] RBAC: Authorization granted {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:52:30.936144 dv-cinder-851351-1-smb devstack@keystone.service[352329]: [pid: 352329|app: 0|req: 3/5] 10.222.0.42 () {56 vars in 1207 bytes} [Thu Jul 28 08:52:30 2022] GET /identity/v3/projects/5c7af4b1c9fc4f35a95bbc0f95b044f2 => generated 344 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:52:32.930981 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba8ed02-1791-4466-98a2-f499567fb8a1 None None] REQUEST_METHOD: `GET` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:52:32.931613 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba8ed02-1791-4466-98a2-f499567fb8a1 None None] SCRIPT_NAME: `/identity` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:52:32.931613 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba8ed02-1791-4466-98a2-f499567fb8a1 None None] PATH_INFO: `/` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:52:32.935705 dv-cinder-851351-1-smb devstack@keystone.service[352328]: [pid: 352328|app: 0|req: 3/6] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 08:52:32 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 08:52:32.941747 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3dac37-2a16-499f-8b67-2a06af4ee469 None None] REQUEST_METHOD: `POST` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:52:32.942256 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3dac37-2a16-499f-8b67-2a06af4ee469 None None] SCRIPT_NAME: `/identity` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:52:32.942256 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3dac37-2a16-499f-8b67-2a06af4ee469 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:52:32.963781 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.auth.core [None req-7f3dac37-2a16-499f-8b67-2a06af4ee469 None None] MFA Rules not processed for user `d18c063b2377412485965357671e5506`. Rule list: `[]` (Enabled: `True`). {{(pid=352329) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 08:52:32.965360 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.fernet_utils [None req-7f3dac37-2a16-499f-8b67-2a06af4ee469 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=352329) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:52:32.975676 dv-cinder-851351-1-smb devstack@keystone.service[352329]: [pid: 352329|app: 0|req: 4/7] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 08:52:32 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Jul 28 08:52:32.997642 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba8ed02-1791-4466-98a2-f499567fb8a1 None None] Authenticating user token {{(pid=352328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:52:33.011886 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba8ed02-1791-4466-98a2-f499567fb8a1 None None] Validating token access rules against request {{(pid=352328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:52:33.016628 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee855bf0-874f-4c59-8400-884c3a20a37b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c7af4b1c9fc4f35a95bbc0f95b044f2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:52:33.017288 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee855bf0-874f-4c59-8400-884c3a20a37b admin admin] REQUEST_METHOD: `GET` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:52:33.017571 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee855bf0-874f-4c59-8400-884c3a20a37b admin admin] SCRIPT_NAME: `/identity` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:52:33.017869 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee855bf0-874f-4c59-8400-884c3a20a37b admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:52:33.027894 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee855bf0-874f-4c59-8400-884c3a20a37b admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:52:33.029747 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee855bf0-874f-4c59-8400-884c3a20a37b admin admin] RBAC: Authorization granted {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:52:33.039097 dv-cinder-851351-1-smb devstack@keystone.service[352328]: [pid: 352328|app: 0|req: 4/8] 10.222.0.42 () {58 vars in 1324 bytes} [Thu Jul 28 08:52:32 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 28 08:52:33.045267 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f3dac37-2a16-499f-8b67-2a06af4ee469 None None] Authenticating user token {{(pid=352329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:52:33.055069 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f3dac37-2a16-499f-8b67-2a06af4ee469 None None] Validating token access rules against request {{(pid=352329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:52:33.060934 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09afd437-9db6-4be2-a1ee-53dfb5756e81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5c7af4b1c9fc4f35a95bbc0f95b044f2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:52:33.061593 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09afd437-9db6-4be2-a1ee-53dfb5756e81 admin admin] REQUEST_METHOD: `GET` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:52:33.061878 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09afd437-9db6-4be2-a1ee-53dfb5756e81 admin admin] SCRIPT_NAME: `/identity` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:52:33.062152 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09afd437-9db6-4be2-a1ee-53dfb5756e81 admin admin] PATH_INFO: `/v3/users/d18c063b2377412485965357671e5506` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:52:33.063829 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09afd437-9db6-4be2-a1ee-53dfb5756e81 admin admin] RBAC: Authorizing `identity:get_user(user_id=d18c063b2377412485965357671e5506)` {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:52:33.065814 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09afd437-9db6-4be2-a1ee-53dfb5756e81 admin admin] RBAC: Authorization granted {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:52:33.067517 dv-cinder-851351-1-smb devstack@keystone.service[352329]: [pid: 352329|app: 0|req: 5/9] 10.222.0.42 () {56 vars in 1198 bytes} [Thu Jul 28 08:52:33 2022] GET /identity/v3/users/d18c063b2377412485965357671e5506 => generated 247 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:52:35.143422 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ab5152-6be0-4f0f-9a04-16e4be582e5f None None] REQUEST_METHOD: `GET` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:52:35.144032 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ab5152-6be0-4f0f-9a04-16e4be582e5f None None] SCRIPT_NAME: `/identity` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:52:35.144032 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ab5152-6be0-4f0f-9a04-16e4be582e5f None None] PATH_INFO: `/` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:52:35.145383 dv-cinder-851351-1-smb devstack@keystone.service[352328]: [pid: 352328|app: 0|req: 5/10] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 08:52:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 08:52:35.151060 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b6087c-4320-438b-aeb3-283b4d6f93a7 None None] REQUEST_METHOD: `POST` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:52:35.151509 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b6087c-4320-438b-aeb3-283b4d6f93a7 None None] SCRIPT_NAME: `/identity` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:52:35.151623 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b6087c-4320-438b-aeb3-283b4d6f93a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:52:35.174253 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.auth.core [None req-29b6087c-4320-438b-aeb3-283b4d6f93a7 None None] MFA Rules not processed for user `d18c063b2377412485965357671e5506`. Rule list: `[]` (Enabled: `True`). {{(pid=352329) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 08:52:35.175472 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.fernet_utils [None req-29b6087c-4320-438b-aeb3-283b4d6f93a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=352329) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:52:35.193252 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910710c7-8c34-4f6e-88c5-a78fa8fcadb0 None None] REQUEST_METHOD: `GET` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:52:35.193516 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910710c7-8c34-4f6e-88c5-a78fa8fcadb0 None None] SCRIPT_NAME: `/identity` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:52:35.193792 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910710c7-8c34-4f6e-88c5-a78fa8fcadb0 None None] PATH_INFO: `/` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:52:35.195207 dv-cinder-851351-1-smb devstack@keystone.service[352328]: [pid: 352328|app: 0|req: 6/11] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 08:52:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 28 08:52:35.200629 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538d08b0-923e-4b06-ab12-733585dab66e None None] REQUEST_METHOD: `POST` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:52:35.200949 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538d08b0-923e-4b06-ab12-733585dab66e None None] SCRIPT_NAME: `/identity` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:52:35.201231 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538d08b0-923e-4b06-ab12-733585dab66e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:52:35.245122 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG passlib.handlers.bcrypt [None req-538d08b0-923e-4b06-ab12-733585dab66e None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=352328) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Jul 28 08:52:35.245553 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG passlib.handlers.bcrypt [None req-538d08b0-923e-4b06-ab12-733585dab66e None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=352328) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Jul 28 08:52:35.276082 dv-cinder-851351-1-smb devstack@keystone.service[352329]: [pid: 352329|app: 0|req: 6/12] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 08:52:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 08:52:35.292535 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.auth.core [None req-538d08b0-923e-4b06-ab12-733585dab66e None None] MFA Rules not processed for user `d18c063b2377412485965357671e5506`. Rule list: `[]` (Enabled: `True`). {{(pid=352328) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 08:52:35.295186 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.fernet_utils [None req-538d08b0-923e-4b06-ab12-733585dab66e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=352328) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:52:35.298819 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b6087c-4320-438b-aeb3-283b4d6f93a7 None None] Authenticating user token {{(pid=352329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:52:35.323700 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG dbcounter [-] [352329] Writing DB stats keystone:SELECT=100 {{(pid=352329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:52:35.402577 dv-cinder-851351-1-smb devstack@keystone.service[352328]: [pid: 352328|app: 0|req: 7/13] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 08:52:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 28 08:52:35.411695 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b6087c-4320-438b-aeb3-283b4d6f93a7 None None] Validating token access rules against request {{(pid=352329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:52:35.424633 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538d08b0-923e-4b06-ab12-733585dab66e None None] Authenticating user token {{(pid=352328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:52:35.450647 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c37131c-679e-4ff4-bcec-0a119a1e17b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:52:35.451352 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c37131c-679e-4ff4-bcec-0a119a1e17b6 None admin] REQUEST_METHOD: `GET` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:52:35.451632 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c37131c-679e-4ff4-bcec-0a119a1e17b6 None admin] SCRIPT_NAME: `/identity` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:52:35.451905 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c37131c-679e-4ff4-bcec-0a119a1e17b6 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:52:35.465188 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c37131c-679e-4ff4-bcec-0a119a1e17b6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 08:52:35.474197 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application [None req-7c37131c-679e-4ff4-bcec-0a119a1e17b6 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 08:52:35.474197 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:52:35.474197 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:52:35.474197 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:52:35.474197 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:52:35.474197 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:52:35.474197 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:52:35.474197 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:52:35.474197 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:52:35.474197 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:52:35.474197 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:52:35.474197 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:52:35.474197 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 08:52:35.474197 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 08:52:35.474197 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 08:52:35.474197 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 08:52:35.475679 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 08:52:35.475679 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 08:52:35.475679 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 08:52:35.475679 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 08:52:35.475679 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:52:35.475679 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:52:35.475679 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:52:35.475679 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:52:35.475679 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:52:35.475679 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:52:35.475679 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:52:35.475679 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application with Lock( Jul 28 08:52:35.475679 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:52:35.475679 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:52:35.475679 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:52:35.475679 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:52:35.477203 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:52:35.477203 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:52:35.477203 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:52:35.477203 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:52:35.477203 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 08:52:35.477203 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 08:52:35.477203 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 08:52:35.477203 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 08:52:35.477203 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 08:52:35.477203 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 08:52:35.477203 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 08:52:35.477203 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application Jul 28 08:52:35.477203 dv-cinder-851351-1-smb devstack@keystone.service[352329]: [pid: 352329|app: 0|req: 7/14] 10.222.0.42 () {56 vars in 1096 bytes} [Thu Jul 28 08:52:35 2022] GET /identity/v3/roles/admin => generated 83 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:52:35.482229 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c37131c-679e-4ff4-bcec-0a119a1e17b6 None admin] Authenticating user token {{(pid=352329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:52:35.544210 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538d08b0-923e-4b06-ab12-733585dab66e None None] Validating token access rules against request {{(pid=352328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:52:35.546580 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG dbcounter [-] [352328] Writing DB stats keystone:SELECT=100 {{(pid=352328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:52:35.574852 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG dbcounter [-] [352329] Writing DB stats keystone:SELECT=100 {{(pid=352329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:52:35.586189 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a841f329-1a77-43f3-a63c-5808b5c2abab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:52:35.587116 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a841f329-1a77-43f3-a63c-5808b5c2abab None admin] REQUEST_METHOD: `GET` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:52:35.587388 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a841f329-1a77-43f3-a63c-5808b5c2abab None admin] SCRIPT_NAME: `/identity` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:52:35.587662 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a841f329-1a77-43f3-a63c-5808b5c2abab None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:52:35.596673 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c37131c-679e-4ff4-bcec-0a119a1e17b6 None admin] Validating token access rules against request {{(pid=352329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:52:35.632107 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294e6b1d-b994-4de6-9bf1-bdbd5d2cbc31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:52:35.632788 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294e6b1d-b994-4de6-9bf1-bdbd5d2cbc31 None admin] REQUEST_METHOD: `GET` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:52:35.633073 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294e6b1d-b994-4de6-9bf1-bdbd5d2cbc31 None admin] SCRIPT_NAME: `/identity` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:52:35.633360 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294e6b1d-b994-4de6-9bf1-bdbd5d2cbc31 None admin] PATH_INFO: `/v3/roles` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:52:35.634111 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-294e6b1d-b994-4de6-9bf1-bdbd5d2cbc31 None admin] RBAC: Adding query filter params (name=admin) {{(pid=352329) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:52:35.634422 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-294e6b1d-b994-4de6-9bf1-bdbd5d2cbc31 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:52:35.635867 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-294e6b1d-b994-4de6-9bf1-bdbd5d2cbc31 None admin] RBAC: Authorization granted {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:52:35.648419 dv-cinder-851351-1-smb devstack@keystone.service[352329]: [pid: 352329|app: 0|req: 8/15] 10.222.0.42 () {56 vars in 1099 bytes} [Thu Jul 28 08:52:35 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 08:52:35.654270 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294e6b1d-b994-4de6-9bf1-bdbd5d2cbc31 None admin] Authenticating user token {{(pid=352329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:52:35.659566 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a841f329-1a77-43f3-a63c-5808b5c2abab None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:52:35.661206 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a841f329-1a77-43f3-a63c-5808b5c2abab None admin] RBAC: Authorization granted {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:52:35.768343 dv-cinder-851351-1-smb devstack@keystone.service[352328]: [pid: 352328|app: 0|req: 8/16] 10.222.0.42 () {58 vars in 1282 bytes} [Thu Jul 28 08:52:35 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 344 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 28 08:52:35.771338 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294e6b1d-b994-4de6-9bf1-bdbd5d2cbc31 None admin] Validating token access rules against request {{(pid=352329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:52:35.774277 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a841f329-1a77-43f3-a63c-5808b5c2abab None admin] Authenticating user token {{(pid=352328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:52:35.777235 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG dbcounter [-] [352328] Writing DB stats keystone:SELECT=100 {{(pid=352328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:52:35.880193 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a841f329-1a77-43f3-a63c-5808b5c2abab None admin] Validating token access rules against request {{(pid=352328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:52:35.921631 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8405aff-952c-40ab-88e6-23e5ffa2d44c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:52:35.922530 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8405aff-952c-40ab-88e6-23e5ffa2d44c None admin] REQUEST_METHOD: `GET` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:52:35.922805 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8405aff-952c-40ab-88e6-23e5ffa2d44c None admin] SCRIPT_NAME: `/identity` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:52:35.923081 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8405aff-952c-40ab-88e6-23e5ffa2d44c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:52:35.924098 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf3aa6c-3925-4263-aa26-3d65fc90f853 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:52:35.924934 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf3aa6c-3925-4263-aa26-3d65fc90f853 None admin] REQUEST_METHOD: `GET` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:52:35.925214 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf3aa6c-3925-4263-aa26-3d65fc90f853 None admin] SCRIPT_NAME: `/identity` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:52:35.925496 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf3aa6c-3925-4263-aa26-3d65fc90f853 None admin] PATH_INFO: `/v3/users/d18c063b2377412485965357671e5506` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:52:35.926701 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bf3aa6c-3925-4263-aa26-3d65fc90f853 None admin] RBAC: Authorizing `identity:get_user(user_id=d18c063b2377412485965357671e5506)` {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:52:35.928193 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bf3aa6c-3925-4263-aa26-3d65fc90f853 None admin] RBAC: Authorization granted {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:52:35.930098 dv-cinder-851351-1-smb devstack@keystone.service[352329]: [pid: 352329|app: 0|req: 9/17] 10.222.0.42 () {56 vars in 1177 bytes} [Thu Jul 28 08:52:35 2022] GET /identity/v3/users/d18c063b2377412485965357671e5506 => generated 247 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 08:52:35.935514 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf3aa6c-3925-4263-aa26-3d65fc90f853 None admin] Authenticating user token {{(pid=352329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:52:35.942148 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8405aff-952c-40ab-88e6-23e5ffa2d44c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:52:35.943625 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8405aff-952c-40ab-88e6-23e5ffa2d44c None admin] RBAC: Authorization granted {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:52:35.952067 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG dbcounter [-] [352329] Writing DB stats keystone:SELECT=100 {{(pid=352329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:52:35.963403 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application [None req-e8405aff-952c-40ab-88e6-23e5ffa2d44c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 08:52:35.963403 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:52:35.963403 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:52:35.963403 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:52:35.963403 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:52:35.963403 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:52:35.963403 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:52:35.963403 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:52:35.963403 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:52:35.963403 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:52:35.963403 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:52:35.963403 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:52:35.963403 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 08:52:35.963403 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 08:52:35.963403 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 08:52:35.964591 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 08:52:35.964591 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:52:35.964591 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:52:35.964591 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:52:35.964591 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:52:35.964591 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:52:35.964591 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:52:35.964591 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:52:35.964591 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application with Lock( Jul 28 08:52:35.964591 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:52:35.964591 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:52:35.964591 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:52:35.964591 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:52:35.964591 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:52:35.964591 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:52:35.964591 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:52:35.964591 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:52:35.965811 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 08:52:35.965811 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 08:52:35.965811 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 08:52:35.965811 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application Jul 28 08:52:35.965811 dv-cinder-851351-1-smb devstack@keystone.service[352328]: [pid: 352328|app: 0|req: 9/18] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 08:52:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:52:35.970682 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8405aff-952c-40ab-88e6-23e5ffa2d44c None admin] Authenticating user token {{(pid=352328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:52:36.030158 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG dbcounter [-] [352328] Writing DB stats keystone:SELECT=100 {{(pid=352328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:52:36.041804 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf3aa6c-3925-4263-aa26-3d65fc90f853 None admin] Validating token access rules against request {{(pid=352329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:52:36.075561 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a09536d7-9991-49fd-9b68-e2df9a1aa4b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:52:36.076220 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09536d7-9991-49fd-9b68-e2df9a1aa4b3 None admin] REQUEST_METHOD: `GET` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:52:36.076509 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09536d7-9991-49fd-9b68-e2df9a1aa4b3 None admin] SCRIPT_NAME: `/identity` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:52:36.076897 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09536d7-9991-49fd-9b68-e2df9a1aa4b3 None admin] PATH_INFO: `/v3/domains/default` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:52:36.078052 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a09536d7-9991-49fd-9b68-e2df9a1aa4b3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:52:36.079878 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a09536d7-9991-49fd-9b68-e2df9a1aa4b3 None admin] RBAC: Authorization granted {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:52:36.080460 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8405aff-952c-40ab-88e6-23e5ffa2d44c None admin] Validating token access rules against request {{(pid=352328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:52:36.081892 dv-cinder-851351-1-smb devstack@keystone.service[352329]: [pid: 352329|app: 0|req: 10/19] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 08:52:35 2022] GET /identity/v3/domains/default => generated 199 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 08:52:36.089407 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a09536d7-9991-49fd-9b68-e2df9a1aa4b3 None admin] Authenticating user token {{(pid=352329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:52:36.127021 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8631da87-579a-44c6-98c0-072d095cca9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:52:36.127727 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8631da87-579a-44c6-98c0-072d095cca9b None admin] REQUEST_METHOD: `GET` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:52:36.128009 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8631da87-579a-44c6-98c0-072d095cca9b None admin] SCRIPT_NAME: `/identity` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:52:36.128293 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8631da87-579a-44c6-98c0-072d095cca9b None admin] PATH_INFO: `/v3/domains` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:52:36.129035 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8631da87-579a-44c6-98c0-072d095cca9b None admin] RBAC: Adding query filter params (name=Default) {{(pid=352328) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:52:36.129343 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8631da87-579a-44c6-98c0-072d095cca9b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:52:36.130828 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8631da87-579a-44c6-98c0-072d095cca9b None admin] RBAC: Authorization granted {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:52:36.148685 dv-cinder-851351-1-smb devstack@keystone.service[352328]: [pid: 352328|app: 0|req: 10/20] 10.222.0.42 () {56 vars in 1109 bytes} [Thu Jul 28 08:52:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 08:52:36.182887 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG dbcounter [-] [352329] Writing DB stats keystone:SELECT=100 {{(pid=352329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:52:36.206428 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a09536d7-9991-49fd-9b68-e2df9a1aa4b3 None admin] Validating token access rules against request {{(pid=352329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:52:36.248902 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9d9541-f081-44e5-bb35-76909274c629 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:52:36.249553 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9d9541-f081-44e5-bb35-76909274c629 None admin] REQUEST_METHOD: `GET` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:52:36.249838 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9d9541-f081-44e5-bb35-76909274c629 None admin] SCRIPT_NAME: `/identity` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:52:36.250110 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9d9541-f081-44e5-bb35-76909274c629 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:52:36.250936 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d9d9541-f081-44e5-bb35-76909274c629 None admin] RBAC: Adding query filter params (role.id=280023171b4a45efb67c036ff237bb3c, scope.domain.id=default, user.id=d18c063b2377412485965357671e5506) {{(pid=352329) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:52:36.251245 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d9d9541-f081-44e5-bb35-76909274c629 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:52:36.252845 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d9d9541-f081-44e5-bb35-76909274c629 None admin] RBAC: Authorization granted {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:52:36.260766 dv-cinder-851351-1-smb devstack@keystone.service[352329]: [pid: 352329|app: 0|req: 11/21] 10.222.0.42 () {56 vars in 1322 bytes} [Thu Jul 28 08:52:36 2022] GET /identity/v3/role_assignments?user.id=d18c063b2377412485965357671e5506&scope.domain.id=default&role.id=280023171b4a45efb67c036ff237bb3c => generated 233 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:52:38.441881 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc676d3-cc5f-4b22-a23a-5a4da5ba23a2 None None] REQUEST_METHOD: `GET` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:52:38.442472 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc676d3-cc5f-4b22-a23a-5a4da5ba23a2 None None] SCRIPT_NAME: `/identity` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:52:38.442472 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc676d3-cc5f-4b22-a23a-5a4da5ba23a2 None None] PATH_INFO: `/` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:52:38.444469 dv-cinder-851351-1-smb devstack@keystone.service[352328]: [pid: 352328|app: 0|req: 11/22] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 08:52:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 08:52:38.449884 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a619882-8839-4824-a000-07f4c7843865 None None] REQUEST_METHOD: `POST` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:52:38.450397 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a619882-8839-4824-a000-07f4c7843865 None None] SCRIPT_NAME: `/identity` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:52:38.450510 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a619882-8839-4824-a000-07f4c7843865 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:52:38.476277 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.auth.core [None req-1a619882-8839-4824-a000-07f4c7843865 None None] MFA Rules not processed for user `d18c063b2377412485965357671e5506`. Rule list: `[]` (Enabled: `True`). {{(pid=352329) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 08:52:38.477546 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.fernet_utils [None req-1a619882-8839-4824-a000-07f4c7843865 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=352329) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:52:38.576232 dv-cinder-851351-1-smb devstack@keystone.service[352329]: [pid: 352329|app: 0|req: 12/23] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 08:52:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 08:52:38.612061 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc676d3-cc5f-4b22-a23a-5a4da5ba23a2 None None] Authenticating user token {{(pid=352328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:52:38.754319 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc676d3-cc5f-4b22-a23a-5a4da5ba23a2 None None] Validating token access rules against request {{(pid=352328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:52:38.780233 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG dbcounter [-] [352328] Writing DB stats keystone:SELECT=100 {{(pid=352328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:52:38.800848 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d8c210-2a96-41de-8494-4e79201badfb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:52:38.801685 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d8c210-2a96-41de-8494-4e79201badfb None admin] REQUEST_METHOD: `GET` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:52:38.802232 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d8c210-2a96-41de-8494-4e79201badfb None admin] SCRIPT_NAME: `/identity` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:52:38.802514 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d8c210-2a96-41de-8494-4e79201badfb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:52:38.817968 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5d8c210-2a96-41de-8494-4e79201badfb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:52:38.819501 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5d8c210-2a96-41de-8494-4e79201badfb None admin] RBAC: Authorization granted {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:52:38.845001 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application [None req-c5d8c210-2a96-41de-8494-4e79201badfb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 08:52:38.845001 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:52:38.845001 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:52:38.845001 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:52:38.845001 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:52:38.845001 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:52:38.845001 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:52:38.845001 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:52:38.845001 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:52:38.845001 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:52:38.845001 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:52:38.845001 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:52:38.845001 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 08:52:38.845001 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 08:52:38.845001 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 08:52:38.846191 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 08:52:38.846191 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:52:38.846191 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:52:38.846191 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:52:38.846191 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:52:38.846191 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:52:38.846191 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:52:38.846191 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:52:38.846191 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application with Lock( Jul 28 08:52:38.846191 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:52:38.846191 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:52:38.846191 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:52:38.846191 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:52:38.846191 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:52:38.846191 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:52:38.846191 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:52:38.846191 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:52:38.847970 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 08:52:38.847970 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 08:52:38.847970 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 08:52:38.847970 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application Jul 28 08:52:38.847970 dv-cinder-851351-1-smb devstack@keystone.service[352328]: [pid: 352328|app: 0|req: 12/24] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 08:52:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:52:38.852200 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a619882-8839-4824-a000-07f4c7843865 None None] Authenticating user token {{(pid=352329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:52:38.855801 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d0a6aa-a80d-4a13-9dcb-65a4dad9bd63 None None] REQUEST_METHOD: `GET` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:52:38.856088 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d0a6aa-a80d-4a13-9dcb-65a4dad9bd63 None None] SCRIPT_NAME: `/identity` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:52:38.856350 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d0a6aa-a80d-4a13-9dcb-65a4dad9bd63 None None] PATH_INFO: `/` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:52:38.857755 dv-cinder-851351-1-smb devstack@keystone.service[352328]: [pid: 352328|app: 0|req: 13/25] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 08:52:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 08:52:38.867186 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75afdb2b-843c-4995-bbf2-01cb3668f8e1 None None] REQUEST_METHOD: `POST` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:52:38.867522 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75afdb2b-843c-4995-bbf2-01cb3668f8e1 None None] SCRIPT_NAME: `/identity` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:52:38.867708 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75afdb2b-843c-4995-bbf2-01cb3668f8e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:52:38.903887 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.auth.core [None req-75afdb2b-843c-4995-bbf2-01cb3668f8e1 None None] MFA Rules not processed for user `d18c063b2377412485965357671e5506`. Rule list: `[]` (Enabled: `True`). {{(pid=352328) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 08:52:38.907316 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.fernet_utils [None req-75afdb2b-843c-4995-bbf2-01cb3668f8e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=352328) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:52:38.996850 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG dbcounter [-] [352329] Writing DB stats keystone:SELECT=100 {{(pid=352329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:52:39.000187 dv-cinder-851351-1-smb devstack@keystone.service[352328]: [pid: 352328|app: 0|req: 14/26] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 08:52:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 28 08:52:39.001621 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ad3844-24aa-46d6-98a4-eb86c0f48e77 None None] REQUEST_METHOD: `GET` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:52:39.001944 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ad3844-24aa-46d6-98a4-eb86c0f48e77 None None] SCRIPT_NAME: `/identity` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:52:39.002224 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ad3844-24aa-46d6-98a4-eb86c0f48e77 None None] PATH_INFO: `/` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:52:39.004068 dv-cinder-851351-1-smb devstack@keystone.service[352328]: [pid: 352328|app: 0|req: 15/27] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 08:52:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 08:52:39.010231 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3b0365-678a-4ce3-b340-6e917f93e3ee None None] REQUEST_METHOD: `POST` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:52:39.010453 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3b0365-678a-4ce3-b340-6e917f93e3ee None None] SCRIPT_NAME: `/identity` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:52:39.010820 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3b0365-678a-4ce3-b340-6e917f93e3ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:52:39.055096 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a619882-8839-4824-a000-07f4c7843865 None None] Validating token access rules against request {{(pid=352329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:52:39.058659 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.auth.core [None req-5a3b0365-678a-4ce3-b340-6e917f93e3ee None None] MFA Rules not processed for user `d18c063b2377412485965357671e5506`. Rule list: `[]` (Enabled: `True`). {{(pid=352328) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 08:52:39.061465 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.fernet_utils [None req-5a3b0365-678a-4ce3-b340-6e917f93e3ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=352328) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:52:39.128500 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb0ef2d-4279-4cce-bb07-21b801409fe7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:52:39.129254 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb0ef2d-4279-4cce-bb07-21b801409fe7 None admin] REQUEST_METHOD: `GET` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:52:39.129545 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb0ef2d-4279-4cce-bb07-21b801409fe7 None admin] SCRIPT_NAME: `/identity` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:52:39.129828 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb0ef2d-4279-4cce-bb07-21b801409fe7 None admin] PATH_INFO: `/v3/domains` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:52:39.130659 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeb0ef2d-4279-4cce-bb07-21b801409fe7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=352329) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:52:39.130973 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeb0ef2d-4279-4cce-bb07-21b801409fe7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:52:39.132452 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeb0ef2d-4279-4cce-bb07-21b801409fe7 None admin] RBAC: Authorization granted {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:52:39.179747 dv-cinder-851351-1-smb devstack@keystone.service[352329]: [pid: 352329|app: 0|req: 13/28] 10.222.0.42 () {56 vars in 1109 bytes} [Thu Jul 28 08:52:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 327 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:52:39.180658 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb0ef2d-4279-4cce-bb07-21b801409fe7 None admin] Authenticating user token {{(pid=352329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:52:39.330673 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb0ef2d-4279-4cce-bb07-21b801409fe7 None admin] Validating token access rules against request {{(pid=352329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:52:39.341589 dv-cinder-851351-1-smb devstack@keystone.service[352328]: [pid: 352328|app: 0|req: 16/29] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 08:52:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 332 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 08:52:39.342780 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a3b0365-678a-4ce3-b340-6e917f93e3ee None None] Authenticating user token {{(pid=352328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:52:39.387871 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG dbcounter [-] [352328] Writing DB stats keystone:SELECT=100 {{(pid=352328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:52:39.389951 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2448db93-4157-446d-b6b2-f2847dd749c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:52:39.390613 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2448db93-4157-446d-b6b2-f2847dd749c4 None admin] REQUEST_METHOD: `POST` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:52:39.390878 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2448db93-4157-446d-b6b2-f2847dd749c4 None admin] SCRIPT_NAME: `/identity` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:52:39.391151 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2448db93-4157-446d-b6b2-f2847dd749c4 None admin] PATH_INFO: `/v3/roles` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:52:39.391908 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2448db93-4157-446d-b6b2-f2847dd749c4 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:52:39.393425 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2448db93-4157-446d-b6b2-f2847dd749c4 None admin] RBAC: Authorization granted {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:52:39.397393 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG dbcounter [-] [352329] Writing DB stats keystone:SELECT=100 {{(pid=352329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:52:39.490538 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a3b0365-678a-4ce3-b340-6e917f93e3ee None None] Validating token access rules against request {{(pid=352328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:52:39.532067 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259ce3d7-b863-4e2c-8024-92c865d53a6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:52:39.532807 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259ce3d7-b863-4e2c-8024-92c865d53a6f None admin] REQUEST_METHOD: `POST` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:52:39.533104 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259ce3d7-b863-4e2c-8024-92c865d53a6f None admin] SCRIPT_NAME: `/identity` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:52:39.533391 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259ce3d7-b863-4e2c-8024-92c865d53a6f None admin] PATH_INFO: `/v3/projects` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:52:39.534758 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-259ce3d7-b863-4e2c-8024-92c865d53a6f None admin] RBAC: Authorizing `identity:create_project()` {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:52:39.536268 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-259ce3d7-b863-4e2c-8024-92c865d53a6f None admin] RBAC: Authorization granted {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:52:39.566530 dv-cinder-851351-1-smb devstack@keystone.service[352329]: [pid: 352329|app: 0|req: 14/30] 10.222.0.42 () {60 vars in 1131 bytes} [Thu Jul 28 08:52:39 2022] POST /identity/v3/roles => generated 225 bytes in 386 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 08:52:39.569422 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea76a5db-7213-4ee6-8d70-f36573abc81d None None] REQUEST_METHOD: `GET` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:52:39.569994 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea76a5db-7213-4ee6-8d70-f36573abc81d None None] SCRIPT_NAME: `/identity` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:52:39.570525 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea76a5db-7213-4ee6-8d70-f36573abc81d None None] PATH_INFO: `/` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:52:39.572218 dv-cinder-851351-1-smb devstack@keystone.service[352329]: [pid: 352329|app: 0|req: 15/31] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 08:52:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 08:52:39.573400 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea76a5db-7213-4ee6-8d70-f36573abc81d None None] Authenticating user token {{(pid=352329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:52:39.734755 dv-cinder-851351-1-smb devstack@keystone.service[352328]: [pid: 352328|app: 0|req: 17/32] 10.222.0.42 () {60 vars in 1141 bytes} [Thu Jul 28 08:52:39 2022] POST /identity/v3/projects => generated 301 bytes in 392 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 08:52:39.740572 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6930dc7c-76bf-483c-9412-2046a23da8f5 None None] REQUEST_METHOD: `POST` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:52:39.740986 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6930dc7c-76bf-483c-9412-2046a23da8f5 None None] SCRIPT_NAME: `/identity` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:52:39.741242 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6930dc7c-76bf-483c-9412-2046a23da8f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:52:39.775463 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.auth.core [None req-6930dc7c-76bf-483c-9412-2046a23da8f5 None None] MFA Rules not processed for user `d18c063b2377412485965357671e5506`. Rule list: `[]` (Enabled: `True`). {{(pid=352328) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 08:52:39.777244 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.fernet_utils [None req-6930dc7c-76bf-483c-9412-2046a23da8f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=352328) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:52:39.789649 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea76a5db-7213-4ee6-8d70-f36573abc81d None None] Validating token access rules against request {{(pid=352329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:52:39.849157 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10268e4c-ed39-41c0-8f55-d6be8606565d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:52:39.851296 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10268e4c-ed39-41c0-8f55-d6be8606565d None admin] REQUEST_METHOD: `GET` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:52:39.852561 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10268e4c-ed39-41c0-8f55-d6be8606565d None admin] SCRIPT_NAME: `/identity` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:52:39.853330 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10268e4c-ed39-41c0-8f55-d6be8606565d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:52:39.880158 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10268e4c-ed39-41c0-8f55-d6be8606565d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 08:52:39.886223 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application [None req-10268e4c-ed39-41c0-8f55-d6be8606565d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 08:52:39.886223 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:52:39.886223 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:52:39.886223 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:52:39.886223 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:52:39.886223 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:52:39.886223 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:52:39.886223 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:52:39.886223 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:52:39.886223 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:52:39.886223 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:52:39.886223 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:52:39.886223 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 08:52:39.886223 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 08:52:39.886223 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 08:52:39.886223 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 08:52:39.887471 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 08:52:39.887471 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 08:52:39.887471 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 08:52:39.887471 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 08:52:39.887471 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:52:39.887471 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:52:39.887471 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:52:39.887471 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:52:39.887471 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:52:39.887471 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:52:39.887471 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:52:39.887471 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application with Lock( Jul 28 08:52:39.887471 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:52:39.887471 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:52:39.887471 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:52:39.887471 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:52:39.888544 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:52:39.888544 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:52:39.888544 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:52:39.888544 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:52:39.888544 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 08:52:39.888544 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 08:52:39.888544 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 08:52:39.888544 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 08:52:39.888544 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 08:52:39.888544 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 08:52:39.888544 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 08:52:39.888544 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application Jul 28 08:52:39.891521 dv-cinder-851351-1-smb devstack@keystone.service[352329]: [pid: 352329|app: 0|req: 16/33] 10.222.0.42 () {56 vars in 1096 bytes} [Thu Jul 28 08:52:39 2022] GET /identity/v3/roles/admin => generated 83 bytes in 319 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:52:39.900351 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10268e4c-ed39-41c0-8f55-d6be8606565d None admin] Authenticating user token {{(pid=352329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:52:39.959961 dv-cinder-851351-1-smb devstack@keystone.service[352328]: [pid: 352328|app: 0|req: 18/34] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 08:52:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 225 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 08:52:39.989153 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG dbcounter [-] [352329] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=352329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:52:39.992891 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c84e9b3-e6b8-41df-9faa-1901329344a2 None None] REQUEST_METHOD: `GET` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:52:39.993344 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c84e9b3-e6b8-41df-9faa-1901329344a2 None None] SCRIPT_NAME: `/identity` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:52:39.993897 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c84e9b3-e6b8-41df-9faa-1901329344a2 None None] PATH_INFO: `/` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:52:39.995695 dv-cinder-851351-1-smb devstack@keystone.service[352328]: [pid: 352328|app: 0|req: 19/35] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 08:52:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 28 08:52:39.998202 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c84e9b3-e6b8-41df-9faa-1901329344a2 None None] Authenticating user token {{(pid=352328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:52:40.023646 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG dbcounter [-] [352328] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=352328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:52:40.054391 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10268e4c-ed39-41c0-8f55-d6be8606565d None admin] Validating token access rules against request {{(pid=352329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:52:40.096686 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26b4d6c-898c-4928-bb06-d1fd316e9754 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:52:40.097455 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26b4d6c-898c-4928-bb06-d1fd316e9754 None admin] REQUEST_METHOD: `GET` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:52:40.097748 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26b4d6c-898c-4928-bb06-d1fd316e9754 None admin] SCRIPT_NAME: `/identity` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:52:40.098031 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26b4d6c-898c-4928-bb06-d1fd316e9754 None admin] PATH_INFO: `/v3/roles` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:52:40.098780 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d26b4d6c-898c-4928-bb06-d1fd316e9754 None admin] RBAC: Adding query filter params (name=admin) {{(pid=352329) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:52:40.099091 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d26b4d6c-898c-4928-bb06-d1fd316e9754 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:52:40.100656 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d26b4d6c-898c-4928-bb06-d1fd316e9754 None admin] RBAC: Authorization granted {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:52:40.109144 dv-cinder-851351-1-smb devstack@keystone.service[352329]: [pid: 352329|app: 0|req: 17/36] 10.222.0.42 () {56 vars in 1099 bytes} [Thu Jul 28 08:52:39 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 08:52:40.110505 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23a825e-d2b7-4dac-b724-d13716e1a15a None None] REQUEST_METHOD: `POST` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:52:40.110806 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23a825e-d2b7-4dac-b724-d13716e1a15a None None] SCRIPT_NAME: `/identity` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:52:40.111089 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23a825e-d2b7-4dac-b724-d13716e1a15a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:52:40.129996 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.auth.core [None req-a23a825e-d2b7-4dac-b724-d13716e1a15a None None] MFA Rules not processed for user `d18c063b2377412485965357671e5506`. Rule list: `[]` (Enabled: `True`). {{(pid=352329) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 08:52:40.131555 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.fernet_utils [None req-a23a825e-d2b7-4dac-b724-d13716e1a15a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=352329) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:52:40.135062 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c84e9b3-e6b8-41df-9faa-1901329344a2 None None] Validating token access rules against request {{(pid=352328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:52:40.171309 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d3ade8-01d3-45ce-b2cc-50c3229db998 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:52:40.171953 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d3ade8-01d3-45ce-b2cc-50c3229db998 None admin] REQUEST_METHOD: `POST` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:52:40.172239 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d3ade8-01d3-45ce-b2cc-50c3229db998 None admin] SCRIPT_NAME: `/identity` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:52:40.172522 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d3ade8-01d3-45ce-b2cc-50c3229db998 None admin] PATH_INFO: `/v3/roles` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:52:40.173299 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68d3ade8-01d3-45ce-b2cc-50c3229db998 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:52:40.175188 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68d3ade8-01d3-45ce-b2cc-50c3229db998 None admin] RBAC: Authorization granted {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:52:40.191937 dv-cinder-851351-1-smb devstack@keystone.service[352328]: [pid: 352328|app: 0|req: 20/37] 10.222.0.42 () {60 vars in 1131 bytes} [Thu Jul 28 08:52:39 2022] POST /identity/v3/roles => generated 219 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 08:52:40.193259 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9b3a34-0963-48c1-bae4-f77813923735 None None] REQUEST_METHOD: `GET` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:52:40.193554 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9b3a34-0963-48c1-bae4-f77813923735 None None] SCRIPT_NAME: `/identity` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:52:40.193838 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9b3a34-0963-48c1-bae4-f77813923735 None None] PATH_INFO: `/` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:52:40.195308 dv-cinder-851351-1-smb devstack@keystone.service[352328]: [pid: 352328|app: 0|req: 21/38] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 08:52:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 08:52:40.195832 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b9b3a34-0963-48c1-bae4-f77813923735 None None] Authenticating user token {{(pid=352328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:52:40.212583 dv-cinder-851351-1-smb devstack@keystone.service[352329]: [pid: 352329|app: 0|req: 18/39] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 08:52:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 08:52:40.215030 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b25f4d-f181-471b-96ef-616c0d8ca772 None None] REQUEST_METHOD: `POST` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:52:40.215539 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b25f4d-f181-471b-96ef-616c0d8ca772 None None] SCRIPT_NAME: `/identity` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:52:40.216247 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b25f4d-f181-471b-96ef-616c0d8ca772 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:52:40.249159 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.auth.core [None req-72b25f4d-f181-471b-96ef-616c0d8ca772 None None] MFA Rules not processed for user `d18c063b2377412485965357671e5506`. Rule list: `[]` (Enabled: `True`). {{(pid=352329) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 08:52:40.250723 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.fernet_utils [None req-72b25f4d-f181-471b-96ef-616c0d8ca772 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=352329) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:52:40.276827 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG dbcounter [-] [352328] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=352328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:52:40.306804 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG dbcounter [-] [352329] Writing DB stats keystone:SELECT=100 {{(pid=352329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:52:40.321719 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b9b3a34-0963-48c1-bae4-f77813923735 None None] Validating token access rules against request {{(pid=352328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:52:40.338126 dv-cinder-851351-1-smb devstack@keystone.service[352329]: [pid: 352329|app: 0|req: 19/40] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 08:52:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 08:52:40.339015 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b25f4d-f181-471b-96ef-616c0d8ca772 None None] Authenticating user token {{(pid=352329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:52:40.368884 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a182a5-8b4f-499f-806b-d547c073d950 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:52:40.369933 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a182a5-8b4f-499f-806b-d547c073d950 None admin] REQUEST_METHOD: `GET` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:52:40.369933 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a182a5-8b4f-499f-806b-d547c073d950 None admin] SCRIPT_NAME: `/identity` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:52:40.370157 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a182a5-8b4f-499f-806b-d547c073d950 None admin] PATH_INFO: `/v3/users/d18c063b2377412485965357671e5506` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:52:40.371667 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a182a5-8b4f-499f-806b-d547c073d950 None admin] RBAC: Authorizing `identity:get_user(user_id=d18c063b2377412485965357671e5506)` {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:52:40.373209 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a182a5-8b4f-499f-806b-d547c073d950 None admin] RBAC: Authorization granted {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:52:40.374928 dv-cinder-851351-1-smb devstack@keystone.service[352328]: [pid: 352328|app: 0|req: 22/41] 10.222.0.42 () {56 vars in 1177 bytes} [Thu Jul 28 08:52:40 2022] GET /identity/v3/users/d18c063b2377412485965357671e5506 => generated 247 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:52:40.375721 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a182a5-8b4f-499f-806b-d547c073d950 None admin] Authenticating user token {{(pid=352328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:52:40.453874 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b25f4d-f181-471b-96ef-616c0d8ca772 None None] Validating token access rules against request {{(pid=352329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:52:40.483063 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a182a5-8b4f-499f-806b-d547c073d950 None admin] Validating token access rules against request {{(pid=352328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:52:40.487921 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ae9d30-745b-498c-895a-ae758938ebf5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:52:40.488570 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ae9d30-745b-498c-895a-ae758938ebf5 None admin] REQUEST_METHOD: `POST` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:52:40.488891 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ae9d30-745b-498c-895a-ae758938ebf5 None admin] SCRIPT_NAME: `/identity` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:52:40.489174 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ae9d30-745b-498c-895a-ae758938ebf5 None admin] PATH_INFO: `/v3/roles` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:52:40.489906 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3ae9d30-745b-498c-895a-ae758938ebf5 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:52:40.491339 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3ae9d30-745b-498c-895a-ae758938ebf5 None admin] RBAC: Authorization granted {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:52:40.506121 dv-cinder-851351-1-smb devstack@keystone.service[352329]: [pid: 352329|app: 0|req: 20/42] 10.222.0.42 () {60 vars in 1131 bytes} [Thu Jul 28 08:52:40 2022] POST /identity/v3/roles => generated 223 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 08:52:40.507205 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ae9d30-745b-498c-895a-ae758938ebf5 None admin] Authenticating user token {{(pid=352329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:52:40.536332 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ddbc1fc-14fb-480f-ab7b-4645c768ac1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:52:40.538155 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ddbc1fc-14fb-480f-ab7b-4645c768ac1d None admin] REQUEST_METHOD: `GET` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:52:40.538502 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ddbc1fc-14fb-480f-ab7b-4645c768ac1d None admin] SCRIPT_NAME: `/identity` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:52:40.538845 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ddbc1fc-14fb-480f-ab7b-4645c768ac1d None admin] PATH_INFO: `/v3/domains/default` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:52:40.540776 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ddbc1fc-14fb-480f-ab7b-4645c768ac1d None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:52:40.542424 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ddbc1fc-14fb-480f-ab7b-4645c768ac1d None admin] RBAC: Authorization granted {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:52:40.544634 dv-cinder-851351-1-smb devstack@keystone.service[352328]: [pid: 352328|app: 0|req: 23/43] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 08:52:40 2022] GET /identity/v3/domains/default => generated 199 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:52:40.550415 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ddbc1fc-14fb-480f-ab7b-4645c768ac1d None admin] Authenticating user token {{(pid=352328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:52:40.552454 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG dbcounter [-] [352329] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=352329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:52:40.563141 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG dbcounter [-] [352328] Writing DB stats keystone:SELECT=100 {{(pid=352328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:52:40.631677 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ae9d30-745b-498c-895a-ae758938ebf5 None admin] Validating token access rules against request {{(pid=352329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:52:40.672715 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303ff5b3-e259-4f79-8e1d-29cfadca9196 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:52:40.673363 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ddbc1fc-14fb-480f-ab7b-4645c768ac1d None admin] Validating token access rules against request {{(pid=352328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:52:40.673551 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303ff5b3-e259-4f79-8e1d-29cfadca9196 None admin] REQUEST_METHOD: `GET` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:52:40.673737 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303ff5b3-e259-4f79-8e1d-29cfadca9196 None admin] SCRIPT_NAME: `/identity` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:52:40.673975 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303ff5b3-e259-4f79-8e1d-29cfadca9196 None admin] PATH_INFO: `/v3/domains/default` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:52:40.675241 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-303ff5b3-e259-4f79-8e1d-29cfadca9196 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:52:40.676780 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-303ff5b3-e259-4f79-8e1d-29cfadca9196 None admin] RBAC: Authorization granted {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:52:40.678608 dv-cinder-851351-1-smb devstack@keystone.service[352329]: [pid: 352329|app: 0|req: 21/44] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 08:52:40 2022] GET /identity/v3/domains/default => generated 199 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:52:40.684329 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303ff5b3-e259-4f79-8e1d-29cfadca9196 None admin] Authenticating user token {{(pid=352329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:52:40.717274 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef72c20-5954-4bd6-bdb2-657478e34655 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:52:40.717928 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef72c20-5954-4bd6-bdb2-657478e34655 None admin] REQUEST_METHOD: `POST` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:52:40.718223 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef72c20-5954-4bd6-bdb2-657478e34655 None admin] SCRIPT_NAME: `/identity` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:52:40.718582 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef72c20-5954-4bd6-bdb2-657478e34655 None admin] PATH_INFO: `/v3/projects` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:52:40.719338 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ef72c20-5954-4bd6-bdb2-657478e34655 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:52:40.720897 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ef72c20-5954-4bd6-bdb2-657478e34655 None admin] RBAC: Authorization granted {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:52:40.751107 dv-cinder-851351-1-smb devstack@keystone.service[352328]: [pid: 352328|app: 0|req: 24/45] 10.222.0.42 () {60 vars in 1141 bytes} [Thu Jul 28 08:52:40 2022] POST /identity/v3/projects => generated 312 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 28 08:52:40.799012 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303ff5b3-e259-4f79-8e1d-29cfadca9196 None admin] Validating token access rules against request {{(pid=352329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:52:40.802083 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG dbcounter [-] [352329] Writing DB stats keystone:SELECT=100 {{(pid=352329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:52:40.837904 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047c7611-8d33-45a9-b424-f8de81489697 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:52:40.838640 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047c7611-8d33-45a9-b424-f8de81489697 None admin] REQUEST_METHOD: `PUT` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:52:40.838931 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047c7611-8d33-45a9-b424-f8de81489697 None admin] SCRIPT_NAME: `/identity` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:52:40.839217 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047c7611-8d33-45a9-b424-f8de81489697 None admin] PATH_INFO: `/v3/domains/default/users/d18c063b2377412485965357671e5506/roles/280023171b4a45efb67c036ff237bb3c` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:52:40.841482 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-047c7611-8d33-45a9-b424-f8de81489697 None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=d18c063b2377412485965357671e5506, role_id=280023171b4a45efb67c036ff237bb3c)` {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:52:40.842998 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-047c7611-8d33-45a9-b424-f8de81489697 None admin] RBAC: Authorization granted {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:52:40.862120 dv-cinder-851351-1-smb devstack@keystone.service[352329]: [pid: 352329|app: 0|req: 22/46] 10.222.0.42 () {58 vars in 1361 bytes} [Thu Jul 28 08:52:40 2022] PUT /identity/v3/domains/default/users/d18c063b2377412485965357671e5506/roles/280023171b4a45efb67c036ff237bb3c => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 08:52:42.778772 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25fac15e-8e43-4198-bcbb-a5c01b15b84b None None] REQUEST_METHOD: `GET` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:52:42.779364 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25fac15e-8e43-4198-bcbb-a5c01b15b84b None None] SCRIPT_NAME: `/identity` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:52:42.779364 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25fac15e-8e43-4198-bcbb-a5c01b15b84b None None] PATH_INFO: `/` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:52:42.780927 dv-cinder-851351-1-smb devstack@keystone.service[352328]: [pid: 352328|app: 0|req: 25/47] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 08:52:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 08:52:42.786327 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2476b4-983f-4ef9-a765-56f0e5d8078b None None] REQUEST_METHOD: `POST` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:52:42.786798 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2476b4-983f-4ef9-a765-56f0e5d8078b None None] SCRIPT_NAME: `/identity` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:52:42.786931 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2476b4-983f-4ef9-a765-56f0e5d8078b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:52:42.806875 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.auth.core [None req-5e2476b4-983f-4ef9-a765-56f0e5d8078b None None] MFA Rules not processed for user `d18c063b2377412485965357671e5506`. Rule list: `[]` (Enabled: `True`). {{(pid=352329) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 08:52:42.808145 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.fernet_utils [None req-5e2476b4-983f-4ef9-a765-56f0e5d8078b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=352329) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:52:42.842967 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea54d969-2667-4ac3-b04c-acdb2a90bf8b None None] REQUEST_METHOD: `GET` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:52:42.843242 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea54d969-2667-4ac3-b04c-acdb2a90bf8b None None] SCRIPT_NAME: `/identity` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:52:42.843529 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea54d969-2667-4ac3-b04c-acdb2a90bf8b None None] PATH_INFO: `/` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:52:42.844993 dv-cinder-851351-1-smb devstack@keystone.service[352328]: [pid: 352328|app: 0|req: 26/48] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 08:52:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 08:52:42.850256 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9176521-5b54-4996-9980-a8a71854b761 None None] REQUEST_METHOD: `POST` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:52:42.850551 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9176521-5b54-4996-9980-a8a71854b761 None None] SCRIPT_NAME: `/identity` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:52:42.850835 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9176521-5b54-4996-9980-a8a71854b761 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:52:42.869317 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.auth.core [None req-d9176521-5b54-4996-9980-a8a71854b761 None None] MFA Rules not processed for user `d18c063b2377412485965357671e5506`. Rule list: `[]` (Enabled: `True`). {{(pid=352328) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 08:52:42.870609 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.fernet_utils [None req-d9176521-5b54-4996-9980-a8a71854b761 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=352328) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:52:42.881787 dv-cinder-851351-1-smb devstack@keystone.service[352329]: [pid: 352329|app: 0|req: 23/49] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 08:52:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 08:52:42.904774 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e2476b4-983f-4ef9-a765-56f0e5d8078b None None] Authenticating user token {{(pid=352329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:52:42.924381 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG dbcounter [-] [352328] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=352328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:52:42.941027 dv-cinder-851351-1-smb devstack@keystone.service[352328]: [pid: 352328|app: 0|req: 27/50] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 08:52:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 08:52:42.964995 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9176521-5b54-4996-9980-a8a71854b761 None None] Authenticating user token {{(pid=352328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:52:43.006426 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG dbcounter [-] [352329] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=352329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:52:43.015934 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e2476b4-983f-4ef9-a765-56f0e5d8078b None None] Validating token access rules against request {{(pid=352329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:52:43.052646 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f622b0-e596-4c37-a9a1-e6ef6602db9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:52:43.053258 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f622b0-e596-4c37-a9a1-e6ef6602db9b None admin] REQUEST_METHOD: `GET` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:52:43.053547 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f622b0-e596-4c37-a9a1-e6ef6602db9b None admin] SCRIPT_NAME: `/identity` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:52:43.053838 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f622b0-e596-4c37-a9a1-e6ef6602db9b None admin] PATH_INFO: `/v3/domains/default` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:52:43.055018 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77f622b0-e596-4c37-a9a1-e6ef6602db9b None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:52:43.056562 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77f622b0-e596-4c37-a9a1-e6ef6602db9b None admin] RBAC: Authorization granted {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:52:43.058253 dv-cinder-851351-1-smb devstack@keystone.service[352329]: [pid: 352329|app: 0|req: 24/51] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 08:52:42 2022] GET /identity/v3/domains/default => generated 199 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:52:43.063968 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f622b0-e596-4c37-a9a1-e6ef6602db9b None admin] Authenticating user token {{(pid=352329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:52:43.073539 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9176521-5b54-4996-9980-a8a71854b761 None None] Validating token access rules against request {{(pid=352328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:52:43.110315 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ebec4b4-f3e2-4020-915b-bda1af0ca0e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:52:43.110989 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ebec4b4-f3e2-4020-915b-bda1af0ca0e4 None admin] REQUEST_METHOD: `GET` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:52:43.111275 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ebec4b4-f3e2-4020-915b-bda1af0ca0e4 None admin] SCRIPT_NAME: `/identity` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:52:43.111555 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ebec4b4-f3e2-4020-915b-bda1af0ca0e4 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:52:43.124299 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ebec4b4-f3e2-4020-915b-bda1af0ca0e4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 08:52:43.131820 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application [None req-1ebec4b4-f3e2-4020-915b-bda1af0ca0e4 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 08:52:43.131820 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:52:43.131820 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:52:43.131820 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:52:43.131820 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:52:43.131820 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:52:43.131820 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:52:43.131820 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:52:43.131820 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:52:43.131820 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:52:43.131820 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:52:43.131820 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:52:43.131820 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 08:52:43.131820 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 08:52:43.131820 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 08:52:43.131820 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 08:52:43.133204 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 08:52:43.133204 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 08:52:43.133204 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 08:52:43.133204 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 08:52:43.133204 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:52:43.133204 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:52:43.133204 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:52:43.133204 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:52:43.133204 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:52:43.133204 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:52:43.133204 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:52:43.133204 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application with Lock( Jul 28 08:52:43.133204 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:52:43.133204 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:52:43.133204 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:52:43.133204 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:52:43.134235 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:52:43.134235 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:52:43.134235 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:52:43.134235 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:52:43.134235 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 08:52:43.134235 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 08:52:43.134235 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 08:52:43.134235 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 08:52:43.134235 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 08:52:43.134235 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 08:52:43.134235 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 08:52:43.134235 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application Jul 28 08:52:43.134235 dv-cinder-851351-1-smb devstack@keystone.service[352328]: [pid: 352328|app: 0|req: 28/52] 10.222.0.42 () {56 vars in 1096 bytes} [Thu Jul 28 08:52:42 2022] GET /identity/v3/roles/admin => generated 83 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:52:43.139189 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ebec4b4-f3e2-4020-915b-bda1af0ca0e4 None admin] Authenticating user token {{(pid=352328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:52:43.173191 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f622b0-e596-4c37-a9a1-e6ef6602db9b None admin] Validating token access rules against request {{(pid=352329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:52:43.188579 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG dbcounter [-] [352328] Writing DB stats keystone:SELECT=100 {{(pid=352328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:52:43.209596 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3077b03-0177-43cd-a905-1ba9d5f5bf7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:52:43.210647 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3077b03-0177-43cd-a905-1ba9d5f5bf7d None admin] REQUEST_METHOD: `POST` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:52:43.210942 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3077b03-0177-43cd-a905-1ba9d5f5bf7d None admin] SCRIPT_NAME: `/identity` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:52:43.211204 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3077b03-0177-43cd-a905-1ba9d5f5bf7d None admin] PATH_INFO: `/v3/projects` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:52:43.211930 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3077b03-0177-43cd-a905-1ba9d5f5bf7d None admin] RBAC: Authorizing `identity:create_project()` {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:52:43.213527 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3077b03-0177-43cd-a905-1ba9d5f5bf7d None admin] RBAC: Authorization granted {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:52:43.244567 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ebec4b4-f3e2-4020-915b-bda1af0ca0e4 None admin] Validating token access rules against request {{(pid=352328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:52:43.244912 dv-cinder-851351-1-smb devstack@keystone.service[352329]: [pid: 352329|app: 0|req: 25/53] 10.222.0.42 () {60 vars in 1140 bytes} [Thu Jul 28 08:52:43 2022] POST /identity/v3/projects => generated 298 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 28 08:52:43.287022 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9146106b-efce-4cb0-9ffb-86baf5e3b39a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:52:43.287708 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9146106b-efce-4cb0-9ffb-86baf5e3b39a None admin] REQUEST_METHOD: `GET` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:52:43.287978 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9146106b-efce-4cb0-9ffb-86baf5e3b39a None admin] SCRIPT_NAME: `/identity` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:52:43.288260 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9146106b-efce-4cb0-9ffb-86baf5e3b39a None admin] PATH_INFO: `/v3/roles` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:52:43.289046 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9146106b-efce-4cb0-9ffb-86baf5e3b39a None admin] RBAC: Adding query filter params (name=admin) {{(pid=352328) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:52:43.289357 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9146106b-efce-4cb0-9ffb-86baf5e3b39a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:52:43.290830 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9146106b-efce-4cb0-9ffb-86baf5e3b39a None admin] RBAC: Authorization granted {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:52:43.305500 dv-cinder-851351-1-smb devstack@keystone.service[352328]: [pid: 352328|app: 0|req: 29/54] 10.222.0.42 () {56 vars in 1099 bytes} [Thu Jul 28 08:52:43 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 08:52:43.312241 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3077b03-0177-43cd-a905-1ba9d5f5bf7d None admin] Authenticating user token {{(pid=352329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:52:43.332572 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG dbcounter [-] [352329] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=352329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:52:43.429227 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3077b03-0177-43cd-a905-1ba9d5f5bf7d None admin] Validating token access rules against request {{(pid=352329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:52:43.467853 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5da4d1-0ce7-4389-ad63-518c4a19e68c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:52:43.468539 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5da4d1-0ce7-4389-ad63-518c4a19e68c None admin] REQUEST_METHOD: `GET` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:52:43.468870 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5da4d1-0ce7-4389-ad63-518c4a19e68c None admin] SCRIPT_NAME: `/identity` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:52:43.469159 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5da4d1-0ce7-4389-ad63-518c4a19e68c None admin] PATH_INFO: `/v3/users/d18c063b2377412485965357671e5506` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:52:43.470875 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f5da4d1-0ce7-4389-ad63-518c4a19e68c None admin] RBAC: Authorizing `identity:get_user(user_id=d18c063b2377412485965357671e5506)` {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:52:43.473620 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f5da4d1-0ce7-4389-ad63-518c4a19e68c None admin] RBAC: Authorization granted {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:52:43.475329 dv-cinder-851351-1-smb devstack@keystone.service[352329]: [pid: 352329|app: 0|req: 26/55] 10.222.0.42 () {56 vars in 1177 bytes} [Thu Jul 28 08:52:43 2022] GET /identity/v3/users/d18c063b2377412485965357671e5506 => generated 247 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:52:43.481938 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9146106b-efce-4cb0-9ffb-86baf5e3b39a None admin] Authenticating user token {{(pid=352328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:52:43.597917 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9146106b-efce-4cb0-9ffb-86baf5e3b39a None admin] Validating token access rules against request {{(pid=352328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:52:43.610761 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG dbcounter [-] [352328] Writing DB stats keystone:SELECT=100 {{(pid=352328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:52:43.640796 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14407c3-468d-484e-8667-388a23ef5ae8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:52:43.641456 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14407c3-468d-484e-8667-388a23ef5ae8 None admin] REQUEST_METHOD: `GET` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:52:43.641754 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14407c3-468d-484e-8667-388a23ef5ae8 None admin] SCRIPT_NAME: `/identity` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:52:43.642053 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14407c3-468d-484e-8667-388a23ef5ae8 None admin] PATH_INFO: `/v3/domains/default` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:52:43.643337 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f14407c3-468d-484e-8667-388a23ef5ae8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:52:43.644870 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f14407c3-468d-484e-8667-388a23ef5ae8 None admin] RBAC: Authorization granted {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:52:43.646755 dv-cinder-851351-1-smb devstack@keystone.service[352328]: [pid: 352328|app: 0|req: 30/56] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 08:52:43 2022] GET /identity/v3/domains/default => generated 199 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:52:43.652467 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5da4d1-0ce7-4389-ad63-518c4a19e68c None admin] Authenticating user token {{(pid=352329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:52:43.754932 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG dbcounter [-] [352329] Writing DB stats keystone:SELECT=100 {{(pid=352329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:52:43.777800 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5da4d1-0ce7-4389-ad63-518c4a19e68c None admin] Validating token access rules against request {{(pid=352329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:52:43.815105 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4cb9de-fddc-4cd9-a3c2-bf10d1a07976 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:52:43.815853 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4cb9de-fddc-4cd9-a3c2-bf10d1a07976 None admin] REQUEST_METHOD: `GET` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:52:43.815996 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4cb9de-fddc-4cd9-a3c2-bf10d1a07976 None admin] SCRIPT_NAME: `/identity` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:52:43.816309 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4cb9de-fddc-4cd9-a3c2-bf10d1a07976 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:52:43.817166 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b4cb9de-fddc-4cd9-a3c2-bf10d1a07976 None admin] RBAC: Adding query filter params (role.id=280023171b4a45efb67c036ff237bb3c, scope.domain.id=default, user.id=d18c063b2377412485965357671e5506) {{(pid=352329) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:52:43.817485 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b4cb9de-fddc-4cd9-a3c2-bf10d1a07976 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:52:43.818987 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b4cb9de-fddc-4cd9-a3c2-bf10d1a07976 None admin] RBAC: Authorization granted {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:52:43.825788 dv-cinder-851351-1-smb devstack@keystone.service[352329]: [pid: 352329|app: 0|req: 27/57] 10.222.0.42 () {56 vars in 1322 bytes} [Thu Jul 28 08:52:43 2022] GET /identity/v3/role_assignments?user.id=d18c063b2377412485965357671e5506&scope.domain.id=default&role.id=280023171b4a45efb67c036ff237bb3c => generated 530 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:52:45.314315 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb44fdac-65e5-4c01-80f8-5f1e9413a7ab None None] REQUEST_METHOD: `GET` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:52:45.314892 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb44fdac-65e5-4c01-80f8-5f1e9413a7ab None None] SCRIPT_NAME: `/identity` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:52:45.314892 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb44fdac-65e5-4c01-80f8-5f1e9413a7ab None None] PATH_INFO: `/` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:52:45.316177 dv-cinder-851351-1-smb devstack@keystone.service[352328]: [pid: 352328|app: 0|req: 31/58] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 08:52:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 08:52:45.321505 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c875ec16-8127-41eb-9853-c38b2faed032 None None] REQUEST_METHOD: `POST` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:52:45.321962 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c875ec16-8127-41eb-9853-c38b2faed032 None None] SCRIPT_NAME: `/identity` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:52:45.322079 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c875ec16-8127-41eb-9853-c38b2faed032 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:52:45.341748 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.auth.core [None req-c875ec16-8127-41eb-9853-c38b2faed032 None None] MFA Rules not processed for user `d18c063b2377412485965357671e5506`. Rule list: `[]` (Enabled: `True`). {{(pid=352329) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 08:52:45.342981 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.fernet_utils [None req-c875ec16-8127-41eb-9853-c38b2faed032 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=352329) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:52:45.412030 dv-cinder-851351-1-smb devstack@keystone.service[352329]: [pid: 352329|app: 0|req: 28/59] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 08:52:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 08:52:45.436425 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb44fdac-65e5-4c01-80f8-5f1e9413a7ab None None] Authenticating user token {{(pid=352328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:52:45.545687 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb44fdac-65e5-4c01-80f8-5f1e9413a7ab None None] Validating token access rules against request {{(pid=352328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:52:45.581857 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1819388d-4567-4db5-a4a1-9e7c979c2ee3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:52:45.582508 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1819388d-4567-4db5-a4a1-9e7c979c2ee3 None admin] REQUEST_METHOD: `GET` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:52:45.582793 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1819388d-4567-4db5-a4a1-9e7c979c2ee3 None admin] SCRIPT_NAME: `/identity` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:52:45.583075 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1819388d-4567-4db5-a4a1-9e7c979c2ee3 None admin] PATH_INFO: `/v3/domains/default` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:52:45.584330 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1819388d-4567-4db5-a4a1-9e7c979c2ee3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:52:45.585846 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1819388d-4567-4db5-a4a1-9e7c979c2ee3 None admin] RBAC: Authorization granted {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:52:45.587474 dv-cinder-851351-1-smb devstack@keystone.service[352328]: [pid: 352328|app: 0|req: 32/60] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 08:52:45 2022] GET /identity/v3/domains/default => generated 199 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:52:45.593456 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c875ec16-8127-41eb-9853-c38b2faed032 None None] Authenticating user token {{(pid=352329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:52:45.678720 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG dbcounter [-] [352329] Writing DB stats keystone:SELECT=100 {{(pid=352329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:52:45.703027 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c875ec16-8127-41eb-9853-c38b2faed032 None None] Validating token access rules against request {{(pid=352329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:52:45.738709 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5967296-0e2b-457b-9b62-607e14b3afa5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:52:45.739343 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5967296-0e2b-457b-9b62-607e14b3afa5 None admin] REQUEST_METHOD: `POST` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:52:45.739628 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5967296-0e2b-457b-9b62-607e14b3afa5 None admin] SCRIPT_NAME: `/identity` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:52:45.739908 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5967296-0e2b-457b-9b62-607e14b3afa5 None admin] PATH_INFO: `/v3/users` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:52:45.740603 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5967296-0e2b-457b-9b62-607e14b3afa5 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:52:45.742120 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5967296-0e2b-457b-9b62-607e14b3afa5 None admin] RBAC: Authorization granted {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:52:45.770189 dv-cinder-851351-1-smb devstack@keystone.service[352329]: [pid: 352329|app: 0|req: 29/61] 10.222.0.42 () {60 vars in 1132 bytes} [Thu Jul 28 08:52:45 2022] POST /identity/v3/users => generated 275 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 08:52:48.793673 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e693ce-8e5e-458a-96b5-a0a2409c2d6e None None] REQUEST_METHOD: `GET` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:52:48.794790 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e693ce-8e5e-458a-96b5-a0a2409c2d6e None None] SCRIPT_NAME: `/identity` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:52:48.795297 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e693ce-8e5e-458a-96b5-a0a2409c2d6e None None] PATH_INFO: `/` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:52:48.796996 dv-cinder-851351-1-smb devstack@keystone.service[352328]: [pid: 352328|app: 0|req: 33/62] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 08:52:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 08:52:48.802732 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c49bffe-d886-4f8b-b070-2d56bb45f9ff None None] REQUEST_METHOD: `POST` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:52:48.803202 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c49bffe-d886-4f8b-b070-2d56bb45f9ff None None] SCRIPT_NAME: `/identity` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:52:48.803311 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c49bffe-d886-4f8b-b070-2d56bb45f9ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:52:48.830062 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.auth.core [None req-7c49bffe-d886-4f8b-b070-2d56bb45f9ff None None] MFA Rules not processed for user `d18c063b2377412485965357671e5506`. Rule list: `[]` (Enabled: `True`). {{(pid=352329) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 08:52:48.831303 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.fernet_utils [None req-7c49bffe-d886-4f8b-b070-2d56bb45f9ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=352329) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:52:48.907440 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175489b1-487b-44cf-878a-8b73649fb2e9 None None] REQUEST_METHOD: `GET` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:52:48.908136 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175489b1-487b-44cf-878a-8b73649fb2e9 None None] SCRIPT_NAME: `/identity` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:52:48.908759 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175489b1-487b-44cf-878a-8b73649fb2e9 None None] PATH_INFO: `/` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:52:48.910389 dv-cinder-851351-1-smb devstack@keystone.service[352328]: [pid: 352328|app: 0|req: 34/63] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 08:52:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 08:52:48.922089 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b0a70b-0011-48ac-a9ec-bb9c16415b96 None None] REQUEST_METHOD: `POST` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:52:48.922692 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b0a70b-0011-48ac-a9ec-bb9c16415b96 None None] SCRIPT_NAME: `/identity` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:52:48.923042 dv-cinder-851351-1-smb devstack@keystone.service[352329]: [pid: 352329|app: 0|req: 30/64] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 08:52:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 08:52:48.923448 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b0a70b-0011-48ac-a9ec-bb9c16415b96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:52:48.957774 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.auth.core [None req-07b0a70b-0011-48ac-a9ec-bb9c16415b96 None None] MFA Rules not processed for user `d18c063b2377412485965357671e5506`. Rule list: `[]` (Enabled: `True`). {{(pid=352328) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 08:52:48.959115 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.fernet_utils [None req-07b0a70b-0011-48ac-a9ec-bb9c16415b96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=352328) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:52:48.973711 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c49bffe-d886-4f8b-b070-2d56bb45f9ff None None] Authenticating user token {{(pid=352329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:52:49.031048 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG dbcounter [-] [352328] Writing DB stats keystone:SELECT=100 {{(pid=352328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:52:49.079304 dv-cinder-851351-1-smb devstack@keystone.service[352328]: [pid: 352328|app: 0|req: 35/65] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 08:52:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 08:52:49.087301 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG dbcounter [-] [352329] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=352329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:52:49.130127 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b0a70b-0011-48ac-a9ec-bb9c16415b96 None None] Authenticating user token {{(pid=352328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:52:49.163356 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c49bffe-d886-4f8b-b070-2d56bb45f9ff None None] Validating token access rules against request {{(pid=352329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:52:49.226568 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3dbe16b-41b7-431d-8d61-121226d8f8cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:52:49.227250 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3dbe16b-41b7-431d-8d61-121226d8f8cf None admin] REQUEST_METHOD: `GET` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:52:49.227532 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3dbe16b-41b7-431d-8d61-121226d8f8cf None admin] SCRIPT_NAME: `/identity` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:52:49.227810 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3dbe16b-41b7-431d-8d61-121226d8f8cf None admin] PATH_INFO: `/v3/roles/admin` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:52:49.241714 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3dbe16b-41b7-431d-8d61-121226d8f8cf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 08:52:49.246778 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application [None req-f3dbe16b-41b7-431d-8d61-121226d8f8cf None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 08:52:49.246778 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:52:49.246778 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:52:49.246778 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:52:49.246778 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:52:49.246778 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:52:49.246778 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:52:49.246778 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:52:49.246778 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:52:49.246778 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:52:49.246778 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:52:49.246778 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:52:49.246778 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 08:52:49.246778 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 08:52:49.246778 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 08:52:49.246778 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 08:52:49.247924 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 08:52:49.247924 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 08:52:49.247924 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 08:52:49.247924 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 08:52:49.247924 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:52:49.247924 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:52:49.247924 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:52:49.247924 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:52:49.247924 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:52:49.247924 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:52:49.247924 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:52:49.247924 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application with Lock( Jul 28 08:52:49.247924 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:52:49.247924 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:52:49.247924 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:52:49.247924 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:52:49.249068 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:52:49.249068 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:52:49.249068 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:52:49.249068 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:52:49.249068 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 08:52:49.249068 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 08:52:49.249068 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 08:52:49.249068 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 08:52:49.249068 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 08:52:49.249068 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 08:52:49.249068 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 08:52:49.249068 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application Jul 28 08:52:49.249068 dv-cinder-851351-1-smb devstack@keystone.service[352329]: [pid: 352329|app: 0|req: 31/66] 10.222.0.42 () {56 vars in 1096 bytes} [Thu Jul 28 08:52:48 2022] GET /identity/v3/roles/admin => generated 83 bytes in 275 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:52:49.258003 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3dbe16b-41b7-431d-8d61-121226d8f8cf None admin] Authenticating user token {{(pid=352329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:52:49.294687 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b0a70b-0011-48ac-a9ec-bb9c16415b96 None None] Validating token access rules against request {{(pid=352328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:52:49.345432 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b19985-96a5-4485-bf8f-f75bf2b8681a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:52:49.346112 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b19985-96a5-4485-bf8f-f75bf2b8681a None admin] REQUEST_METHOD: `GET` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:52:49.346428 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b19985-96a5-4485-bf8f-f75bf2b8681a None admin] SCRIPT_NAME: `/identity` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:52:49.347268 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b19985-96a5-4485-bf8f-f75bf2b8681a None admin] PATH_INFO: `/v3/roles/member` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:52:49.362011 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0b19985-96a5-4485-bf8f-f75bf2b8681a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 08:52:49.368588 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application [None req-f0b19985-96a5-4485-bf8f-f75bf2b8681a None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 28 08:52:49.368588 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:52:49.368588 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:52:49.368588 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:52:49.368588 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:52:49.368588 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:52:49.368588 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:52:49.368588 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:52:49.368588 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:52:49.368588 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:52:49.368588 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:52:49.368588 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:52:49.368588 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 08:52:49.368588 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 08:52:49.368588 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 08:52:49.368588 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 08:52:49.369802 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 08:52:49.369802 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 08:52:49.369802 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 08:52:49.369802 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 08:52:49.369802 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:52:49.369802 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:52:49.369802 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:52:49.369802 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:52:49.369802 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:52:49.369802 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:52:49.369802 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:52:49.369802 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application with Lock( Jul 28 08:52:49.369802 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:52:49.369802 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:52:49.369802 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:52:49.369802 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:52:49.370832 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:52:49.370832 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:52:49.370832 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:52:49.370832 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:52:49.370832 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 08:52:49.370832 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 08:52:49.370832 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 08:52:49.370832 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 08:52:49.370832 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 08:52:49.370832 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 08:52:49.370832 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 28 08:52:49.370832 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application Jul 28 08:52:49.370832 dv-cinder-851351-1-smb devstack@keystone.service[352328]: [pid: 352328|app: 0|req: 36/67] 10.222.0.42 () {56 vars in 1099 bytes} [Thu Jul 28 08:52:49 2022] GET /identity/v3/roles/member => generated 84 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 08:52:49.372596 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab1c54b-0cbe-4189-b5d7-2185902c852d None None] REQUEST_METHOD: `GET` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:52:49.372916 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab1c54b-0cbe-4189-b5d7-2185902c852d None None] SCRIPT_NAME: `/identity` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:52:49.373199 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab1c54b-0cbe-4189-b5d7-2185902c852d None None] PATH_INFO: `/` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:52:49.378841 dv-cinder-851351-1-smb devstack@keystone.service[352328]: [pid: 352328|app: 0|req: 37/68] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 08:52:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 08:52:49.378841 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab1c54b-0cbe-4189-b5d7-2185902c852d None None] Authenticating user token {{(pid=352328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:52:49.414244 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3dbe16b-41b7-431d-8d61-121226d8f8cf None admin] Validating token access rules against request {{(pid=352329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:52:49.420364 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG dbcounter [-] [352328] Writing DB stats keystone:SELECT=100 {{(pid=352328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:52:49.439052 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG dbcounter [-] [352329] Writing DB stats keystone:SELECT=100 {{(pid=352329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:52:49.452949 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3571d9a4-4a40-40a4-9ddf-0ae1f2e37b80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:52:49.453596 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3571d9a4-4a40-40a4-9ddf-0ae1f2e37b80 None admin] REQUEST_METHOD: `GET` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:52:49.453885 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3571d9a4-4a40-40a4-9ddf-0ae1f2e37b80 None admin] SCRIPT_NAME: `/identity` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:52:49.454539 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3571d9a4-4a40-40a4-9ddf-0ae1f2e37b80 None admin] PATH_INFO: `/v3/roles` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:52:49.455337 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3571d9a4-4a40-40a4-9ddf-0ae1f2e37b80 None admin] RBAC: Adding query filter params (name=admin) {{(pid=352329) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:52:49.455627 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3571d9a4-4a40-40a4-9ddf-0ae1f2e37b80 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:52:49.457087 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3571d9a4-4a40-40a4-9ddf-0ae1f2e37b80 None admin] RBAC: Authorization granted {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:52:49.466102 dv-cinder-851351-1-smb devstack@keystone.service[352329]: [pid: 352329|app: 0|req: 32/69] 10.222.0.42 () {56 vars in 1099 bytes} [Thu Jul 28 08:52:49 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 08:52:49.467323 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1115b9-ddbd-425d-bd8d-4513e8813513 None None] REQUEST_METHOD: `POST` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:52:49.467621 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1115b9-ddbd-425d-bd8d-4513e8813513 None None] SCRIPT_NAME: `/identity` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:52:49.467901 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1115b9-ddbd-425d-bd8d-4513e8813513 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:52:49.486187 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.auth.core [None req-bf1115b9-ddbd-425d-bd8d-4513e8813513 None None] MFA Rules not processed for user `d18c063b2377412485965357671e5506`. Rule list: `[]` (Enabled: `True`). {{(pid=352329) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 08:52:49.487796 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.fernet_utils [None req-bf1115b9-ddbd-425d-bd8d-4513e8813513 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=352329) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:52:49.497535 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab1c54b-0cbe-4189-b5d7-2185902c852d None None] Validating token access rules against request {{(pid=352328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:52:49.537094 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb36e81-dbbb-43b8-83b0-92016d1ca809 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:52:49.537751 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb36e81-dbbb-43b8-83b0-92016d1ca809 None admin] REQUEST_METHOD: `GET` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:52:49.538039 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb36e81-dbbb-43b8-83b0-92016d1ca809 None admin] SCRIPT_NAME: `/identity` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:52:49.538322 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb36e81-dbbb-43b8-83b0-92016d1ca809 None admin] PATH_INFO: `/v3/roles` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:52:49.539087 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eb36e81-dbbb-43b8-83b0-92016d1ca809 None admin] RBAC: Adding query filter params (name=member) {{(pid=352328) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:52:49.539685 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eb36e81-dbbb-43b8-83b0-92016d1ca809 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:52:49.541154 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eb36e81-dbbb-43b8-83b0-92016d1ca809 None admin] RBAC: Authorization granted {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:52:49.550014 dv-cinder-851351-1-smb devstack@keystone.service[352328]: [pid: 352328|app: 0|req: 38/70] 10.222.0.42 () {56 vars in 1101 bytes} [Thu Jul 28 08:52:49 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 08:52:49.551262 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99899642-298d-46c7-9851-cdb158ac2e75 None None] REQUEST_METHOD: `GET` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:52:49.551556 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99899642-298d-46c7-9851-cdb158ac2e75 None None] SCRIPT_NAME: `/identity` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:52:49.551851 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99899642-298d-46c7-9851-cdb158ac2e75 None None] PATH_INFO: `/` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:52:49.553264 dv-cinder-851351-1-smb devstack@keystone.service[352328]: [pid: 352328|app: 0|req: 39/71] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 08:52:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 08:52:49.555555 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99899642-298d-46c7-9851-cdb158ac2e75 None None] Authenticating user token {{(pid=352328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:52:49.567044 dv-cinder-851351-1-smb devstack@keystone.service[352329]: [pid: 352329|app: 0|req: 33/72] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 08:52:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 08:52:49.569755 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf1115b9-ddbd-425d-bd8d-4513e8813513 None None] Authenticating user token {{(pid=352329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:52:49.654537 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG dbcounter [-] [352328] Writing DB stats keystone:SELECT=100 {{(pid=352328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:52:49.659543 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99899642-298d-46c7-9851-cdb158ac2e75 None None] Validating token access rules against request {{(pid=352328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:52:49.671975 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf1115b9-ddbd-425d-bd8d-4513e8813513 None None] Validating token access rules against request {{(pid=352329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:52:49.686243 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG dbcounter [-] [352329] Writing DB stats keystone:SELECT=100 {{(pid=352329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:52:49.693598 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce7f50d-0971-4960-b51b-6d2990dcc0f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:52:49.694265 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce7f50d-0971-4960-b51b-6d2990dcc0f0 None admin] REQUEST_METHOD: `GET` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:52:49.694549 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce7f50d-0971-4960-b51b-6d2990dcc0f0 None admin] SCRIPT_NAME: `/identity` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:52:49.694823 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce7f50d-0971-4960-b51b-6d2990dcc0f0 None admin] PATH_INFO: `/v3/users/d18c063b2377412485965357671e5506` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:52:49.696109 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ce7f50d-0971-4960-b51b-6d2990dcc0f0 None admin] RBAC: Authorizing `identity:get_user(user_id=d18c063b2377412485965357671e5506)` {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:52:49.697623 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ce7f50d-0971-4960-b51b-6d2990dcc0f0 None admin] RBAC: Authorization granted {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:52:49.699272 dv-cinder-851351-1-smb devstack@keystone.service[352328]: [pid: 352328|app: 0|req: 40/73] 10.222.0.42 () {56 vars in 1177 bytes} [Thu Jul 28 08:52:49 2022] GET /identity/v3/users/d18c063b2377412485965357671e5506 => generated 247 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:52:49.700591 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d132f86-80a0-40b9-a61f-fcad40848957 None None] REQUEST_METHOD: `POST` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:52:49.700906 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d132f86-80a0-40b9-a61f-fcad40848957 None None] SCRIPT_NAME: `/identity` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:52:49.701189 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d132f86-80a0-40b9-a61f-fcad40848957 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:52:49.709965 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-367f942c-03e5-41e7-a5bb-0ad7cb13ee12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:52:49.710637 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367f942c-03e5-41e7-a5bb-0ad7cb13ee12 None admin] REQUEST_METHOD: `GET` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:52:49.710927 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367f942c-03e5-41e7-a5bb-0ad7cb13ee12 None admin] SCRIPT_NAME: `/identity` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:52:49.711211 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367f942c-03e5-41e7-a5bb-0ad7cb13ee12 None admin] PATH_INFO: `/v3/users/dee261de1c2f4d11bec14593404de7a4` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:52:49.719393 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.auth.core [None req-7d132f86-80a0-40b9-a61f-fcad40848957 None None] MFA Rules not processed for user `d18c063b2377412485965357671e5506`. Rule list: `[]` (Enabled: `True`). {{(pid=352328) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 08:52:49.720630 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.fernet_utils [None req-7d132f86-80a0-40b9-a61f-fcad40848957 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=352328) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:52:49.725599 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-367f942c-03e5-41e7-a5bb-0ad7cb13ee12 None admin] RBAC: Authorizing `identity:get_user(user_id=dee261de1c2f4d11bec14593404de7a4)` {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:52:49.727111 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-367f942c-03e5-41e7-a5bb-0ad7cb13ee12 None admin] RBAC: Authorization granted {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:52:49.728845 dv-cinder-851351-1-smb devstack@keystone.service[352329]: [pid: 352329|app: 0|req: 34/74] 10.222.0.42 () {56 vars in 1177 bytes} [Thu Jul 28 08:52:49 2022] GET /identity/v3/users/dee261de1c2f4d11bec14593404de7a4 => generated 275 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:52:49.733511 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2507fb-f9eb-4390-b8e8-8248bf65adff None None] REQUEST_METHOD: `GET` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:52:49.733511 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2507fb-f9eb-4390-b8e8-8248bf65adff None None] SCRIPT_NAME: `/identity` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:52:49.733511 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2507fb-f9eb-4390-b8e8-8248bf65adff None None] PATH_INFO: `/` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:52:49.733511 dv-cinder-851351-1-smb devstack@keystone.service[352329]: [pid: 352329|app: 0|req: 35/75] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 08:52:49 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 08:52:49.733511 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2507fb-f9eb-4390-b8e8-8248bf65adff None None] Authenticating user token {{(pid=352329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:52:49.792729 dv-cinder-851351-1-smb devstack@keystone.service[352328]: [pid: 352328|app: 0|req: 41/76] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 08:52:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 08:52:49.793917 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d132f86-80a0-40b9-a61f-fcad40848957 None None] Authenticating user token {{(pid=352328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:52:49.837785 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2507fb-f9eb-4390-b8e8-8248bf65adff None None] Validating token access rules against request {{(pid=352329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:52:49.871685 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b834d2-858e-4e87-bcd3-434947ace139 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:52:49.872345 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b834d2-858e-4e87-bcd3-434947ace139 None admin] REQUEST_METHOD: `GET` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:52:49.872633 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b834d2-858e-4e87-bcd3-434947ace139 None admin] SCRIPT_NAME: `/identity` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:52:49.872945 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b834d2-858e-4e87-bcd3-434947ace139 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:52:49.883250 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76b834d2-858e-4e87-bcd3-434947ace139 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 08:52:49.888218 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application [None req-76b834d2-858e-4e87-bcd3-434947ace139 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 28 08:52:49.888218 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:52:49.888218 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:52:49.888218 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:52:49.888218 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:52:49.888218 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:52:49.888218 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:52:49.888218 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:52:49.888218 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:52:49.888218 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:52:49.888218 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:52:49.888218 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:52:49.888218 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 08:52:49.888218 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 08:52:49.888218 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 08:52:49.888218 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 08:52:49.889414 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 08:52:49.889414 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 08:52:49.889414 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 08:52:49.889414 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 08:52:49.889414 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:52:49.889414 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:52:49.889414 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:52:49.889414 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:52:49.889414 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:52:49.889414 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:52:49.889414 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:52:49.889414 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application with Lock( Jul 28 08:52:49.889414 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:52:49.889414 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:52:49.889414 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:52:49.889414 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:52:49.895873 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:52:49.895873 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:52:49.895873 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:52:49.895873 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:52:49.895873 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 08:52:49.895873 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 08:52:49.895873 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 08:52:49.895873 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 08:52:49.895873 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 08:52:49.895873 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 08:52:49.895873 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 28 08:52:49.895873 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application Jul 28 08:52:49.895873 dv-cinder-851351-1-smb devstack@keystone.service[352329]: [pid: 352329|app: 0|req: 36/77] 10.222.0.42 () {56 vars in 1114 bytes} [Thu Jul 28 08:52:49 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:52:49.895873 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b834d2-858e-4e87-bcd3-434947ace139 None admin] Authenticating user token {{(pid=352329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:52:49.897574 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG dbcounter [-] [352328] Writing DB stats keystone:SELECT=100 {{(pid=352328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:52:49.902399 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d132f86-80a0-40b9-a61f-fcad40848957 None None] Validating token access rules against request {{(pid=352328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:52:49.925876 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG dbcounter [-] [352329] Writing DB stats keystone:SELECT=100 {{(pid=352329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:52:49.937240 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5dad9af-cdfb-48c7-97e6-2e57dc13ad68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:52:49.937891 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5dad9af-cdfb-48c7-97e6-2e57dc13ad68 None admin] REQUEST_METHOD: `GET` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:52:49.938179 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5dad9af-cdfb-48c7-97e6-2e57dc13ad68 None admin] SCRIPT_NAME: `/identity` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:52:49.938463 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5dad9af-cdfb-48c7-97e6-2e57dc13ad68 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:52:49.999410 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b834d2-858e-4e87-bcd3-434947ace139 None admin] Validating token access rules against request {{(pid=352329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:52:50.006326 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5dad9af-cdfb-48c7-97e6-2e57dc13ad68 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:52:50.007893 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5dad9af-cdfb-48c7-97e6-2e57dc13ad68 None admin] RBAC: Authorization granted {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:52:50.038197 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e14c566-e4c4-4503-b868-387f332e95f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:52:50.038972 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e14c566-e4c4-4503-b868-387f332e95f7 None admin] REQUEST_METHOD: `GET` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:52:50.039258 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e14c566-e4c4-4503-b868-387f332e95f7 None admin] SCRIPT_NAME: `/identity` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:52:50.039535 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e14c566-e4c4-4503-b868-387f332e95f7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:52:50.104625 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG dbcounter [-] [352328] Writing DB stats keystone:SELECT=100 {{(pid=352328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:52:50.109695 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e14c566-e4c4-4503-b868-387f332e95f7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:52:50.111230 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e14c566-e4c4-4503-b868-387f332e95f7 None admin] RBAC: Authorization granted {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:52:50.111445 dv-cinder-851351-1-smb devstack@keystone.service[352328]: [pid: 352328|app: 0|req: 42/78] 10.222.0.42 () {58 vars in 1282 bytes} [Thu Jul 28 08:52:49 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 28 08:52:50.112932 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce86a39f-ad73-4e32-b4e3-c8571cd3ae19 None None] REQUEST_METHOD: `POST` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:52:50.113072 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce86a39f-ad73-4e32-b4e3-c8571cd3ae19 None None] SCRIPT_NAME: `/identity` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:52:50.113370 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce86a39f-ad73-4e32-b4e3-c8571cd3ae19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:52:50.131440 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.auth.core [None req-ce86a39f-ad73-4e32-b4e3-c8571cd3ae19 None None] MFA Rules not processed for user `d18c063b2377412485965357671e5506`. Rule list: `[]` (Enabled: `True`). {{(pid=352328) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 08:52:50.132652 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.fernet_utils [None req-ce86a39f-ad73-4e32-b4e3-c8571cd3ae19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=352328) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:52:50.141661 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG dbcounter [-] [352329] Writing DB stats keystone:SELECT=100 {{(pid=352329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:52:50.200988 dv-cinder-851351-1-smb devstack@keystone.service[352328]: [pid: 352328|app: 0|req: 43/79] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 08:52:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 08:52:50.201929 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce86a39f-ad73-4e32-b4e3-c8571cd3ae19 None None] Authenticating user token {{(pid=352328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:52:50.211048 dv-cinder-851351-1-smb devstack@keystone.service[352329]: [pid: 352329|app: 0|req: 37/80] 10.222.0.42 () {58 vars in 1282 bytes} [Thu Jul 28 08:52:49 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 28 08:52:50.211896 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e14c566-e4c4-4503-b868-387f332e95f7 None admin] Authenticating user token {{(pid=352329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:52:50.306487 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce86a39f-ad73-4e32-b4e3-c8571cd3ae19 None None] Validating token access rules against request {{(pid=352328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:52:50.312765 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e14c566-e4c4-4503-b868-387f332e95f7 None admin] Validating token access rules against request {{(pid=352329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:52:50.333608 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG dbcounter [-] [352328] Writing DB stats keystone:SELECT=100 {{(pid=352328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:52:50.342312 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG dbcounter [-] [352329] Writing DB stats keystone:SELECT=100 {{(pid=352329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:52:50.342494 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb9c9ce-c2df-4e11-865f-93baaaf7451a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:52:50.343325 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb9c9ce-c2df-4e11-865f-93baaaf7451a None admin] REQUEST_METHOD: `GET` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:52:50.343621 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb9c9ce-c2df-4e11-865f-93baaaf7451a None admin] SCRIPT_NAME: `/identity` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:52:50.343925 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb9c9ce-c2df-4e11-865f-93baaaf7451a None admin] PATH_INFO: `/v3/roles/member` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:52:50.347846 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c173dd5a-bb0e-406d-ac95-552c0e8048bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:52:50.348488 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c173dd5a-bb0e-406d-ac95-552c0e8048bb None admin] REQUEST_METHOD: `GET` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:52:50.348816 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c173dd5a-bb0e-406d-ac95-552c0e8048bb None admin] SCRIPT_NAME: `/identity` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:52:50.349102 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c173dd5a-bb0e-406d-ac95-552c0e8048bb None admin] PATH_INFO: `/v3/roles` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:52:50.349843 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c173dd5a-bb0e-406d-ac95-552c0e8048bb None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=352329) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:52:50.350157 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c173dd5a-bb0e-406d-ac95-552c0e8048bb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:52:50.351586 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c173dd5a-bb0e-406d-ac95-552c0e8048bb None admin] RBAC: Authorization granted {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:52:50.354725 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efb9c9ce-c2df-4e11-865f-93baaaf7451a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 08:52:50.359665 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application [None req-efb9c9ce-c2df-4e11-865f-93baaaf7451a None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 28 08:52:50.359665 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:52:50.359665 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:52:50.359665 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:52:50.359665 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:52:50.359665 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:52:50.359665 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:52:50.359665 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:52:50.359665 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:52:50.359665 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:52:50.359665 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:52:50.359665 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:52:50.359665 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 08:52:50.359665 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 08:52:50.359665 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 08:52:50.359665 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 08:52:50.365667 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 08:52:50.365667 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 08:52:50.365667 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 08:52:50.365667 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 08:52:50.365667 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:52:50.365667 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:52:50.365667 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:52:50.365667 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:52:50.365667 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:52:50.365667 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:52:50.365667 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:52:50.365667 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application with Lock( Jul 28 08:52:50.365667 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:52:50.365667 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:52:50.365667 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:52:50.365667 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:52:50.366719 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:52:50.366719 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:52:50.366719 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:52:50.366719 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:52:50.366719 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 08:52:50.366719 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 08:52:50.366719 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 08:52:50.366719 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 08:52:50.366719 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 08:52:50.366719 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 08:52:50.366719 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 28 08:52:50.366719 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application Jul 28 08:52:50.367504 dv-cinder-851351-1-smb devstack@keystone.service[352329]: [pid: 352329|app: 0|req: 38/81] 10.222.0.42 () {56 vars in 1111 bytes} [Thu Jul 28 08:52:50 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:52:50.367600 dv-cinder-851351-1-smb devstack@keystone.service[352328]: [pid: 352328|app: 0|req: 44/82] 10.222.0.42 () {56 vars in 1099 bytes} [Thu Jul 28 08:52:50 2022] GET /identity/v3/roles/member => generated 84 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:52:50.367600 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb9c9ce-c2df-4e11-865f-93baaaf7451a None admin] Authenticating user token {{(pid=352328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:52:50.367758 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c173dd5a-bb0e-406d-ac95-552c0e8048bb None admin] Authenticating user token {{(pid=352329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:52:50.463078 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c173dd5a-bb0e-406d-ac95-552c0e8048bb None admin] Validating token access rules against request {{(pid=352329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:52:50.463900 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb9c9ce-c2df-4e11-865f-93baaaf7451a None admin] Validating token access rules against request {{(pid=352328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:52:50.497992 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a98cab-925f-4c62-8908-5f1312d84d86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:52:50.498661 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a98cab-925f-4c62-8908-5f1312d84d86 None admin] REQUEST_METHOD: `GET` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:52:50.498952 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a98cab-925f-4c62-8908-5f1312d84d86 None admin] SCRIPT_NAME: `/identity` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:52:50.499233 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a98cab-925f-4c62-8908-5f1312d84d86 None admin] PATH_INFO: `/v3/projects/9af593aec02c450aa4ce9c48ff4c6a1f` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:52:50.499471 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5037e76a-35e2-4c28-9d8d-b97842e49a69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:52:50.500132 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5037e76a-35e2-4c28-9d8d-b97842e49a69 None admin] REQUEST_METHOD: `GET` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:52:50.500414 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5037e76a-35e2-4c28-9d8d-b97842e49a69 None admin] SCRIPT_NAME: `/identity` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:52:50.500515 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28a98cab-925f-4c62-8908-5f1312d84d86 None admin] RBAC: Authorizing `identity:get_project(project_id=9af593aec02c450aa4ce9c48ff4c6a1f)` {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:52:50.500739 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5037e76a-35e2-4c28-9d8d-b97842e49a69 None admin] PATH_INFO: `/v3/projects/9af593aec02c450aa4ce9c48ff4c6a1f` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:52:50.501919 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5037e76a-35e2-4c28-9d8d-b97842e49a69 None admin] RBAC: Authorizing `identity:get_project(project_id=9af593aec02c450aa4ce9c48ff4c6a1f)` {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:52:50.502051 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28a98cab-925f-4c62-8908-5f1312d84d86 None admin] RBAC: Authorization granted {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:52:50.503428 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5037e76a-35e2-4c28-9d8d-b97842e49a69 None admin] RBAC: Authorization granted {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:52:50.503710 dv-cinder-851351-1-smb devstack@keystone.service[352329]: [pid: 352329|app: 0|req: 39/83] 10.222.0.42 () {56 vars in 1186 bytes} [Thu Jul 28 08:52:50 2022] GET /identity/v3/projects/9af593aec02c450aa4ce9c48ff4c6a1f => generated 298 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:52:50.504494 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a98cab-925f-4c62-8908-5f1312d84d86 None admin] Authenticating user token {{(pid=352329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:52:50.510086 dv-cinder-851351-1-smb devstack@keystone.service[352328]: [pid: 352328|app: 0|req: 45/84] 10.222.0.42 () {56 vars in 1186 bytes} [Thu Jul 28 08:52:50 2022] GET /identity/v3/projects/9af593aec02c450aa4ce9c48ff4c6a1f => generated 298 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:52:50.510886 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5037e76a-35e2-4c28-9d8d-b97842e49a69 None admin] Authenticating user token {{(pid=352328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:52:50.567784 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG dbcounter [-] [352329] Writing DB stats keystone:SELECT=100 {{(pid=352329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:52:50.569148 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG dbcounter [-] [352328] Writing DB stats keystone:SELECT=100 {{(pid=352328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:52:50.610674 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a98cab-925f-4c62-8908-5f1312d84d86 None admin] Validating token access rules against request {{(pid=352329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:52:50.615823 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5037e76a-35e2-4c28-9d8d-b97842e49a69 None admin] Validating token access rules against request {{(pid=352328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:52:50.644375 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b6406e-da0d-4a86-83e9-d18d1db94aa7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:52:50.645077 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b6406e-da0d-4a86-83e9-d18d1db94aa7 None admin] REQUEST_METHOD: `GET` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:52:50.645365 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b6406e-da0d-4a86-83e9-d18d1db94aa7 None admin] SCRIPT_NAME: `/identity` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:52:50.645649 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b6406e-da0d-4a86-83e9-d18d1db94aa7 None admin] PATH_INFO: `/v3/domains/default` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:52:50.646835 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54b6406e-da0d-4a86-83e9-d18d1db94aa7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:52:50.648311 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54b6406e-da0d-4a86-83e9-d18d1db94aa7 None admin] RBAC: Authorization granted {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:52:50.649996 dv-cinder-851351-1-smb devstack@keystone.service[352329]: [pid: 352329|app: 0|req: 40/85] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 08:52:50 2022] GET /identity/v3/domains/default => generated 199 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:52:50.650776 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b6406e-da0d-4a86-83e9-d18d1db94aa7 None admin] Authenticating user token {{(pid=352329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:52:50.660690 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6deb1809-0679-46e1-849f-ebcfba6ff4e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:52:50.661376 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6deb1809-0679-46e1-849f-ebcfba6ff4e8 None admin] REQUEST_METHOD: `GET` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:52:50.661665 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6deb1809-0679-46e1-849f-ebcfba6ff4e8 None admin] SCRIPT_NAME: `/identity` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:52:50.661946 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6deb1809-0679-46e1-849f-ebcfba6ff4e8 None admin] PATH_INFO: `/v3/users/dee261de1c2f4d11bec14593404de7a4` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:52:50.663163 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6deb1809-0679-46e1-849f-ebcfba6ff4e8 None admin] RBAC: Authorizing `identity:get_user(user_id=dee261de1c2f4d11bec14593404de7a4)` {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:52:50.664637 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6deb1809-0679-46e1-849f-ebcfba6ff4e8 None admin] RBAC: Authorization granted {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:52:50.666336 dv-cinder-851351-1-smb devstack@keystone.service[352328]: [pid: 352328|app: 0|req: 46/86] 10.222.0.42 () {56 vars in 1177 bytes} [Thu Jul 28 08:52:50 2022] GET /identity/v3/users/dee261de1c2f4d11bec14593404de7a4 => generated 275 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:52:50.668185 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6deb1809-0679-46e1-849f-ebcfba6ff4e8 None admin] Authenticating user token {{(pid=352328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:52:50.757799 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b6406e-da0d-4a86-83e9-d18d1db94aa7 None admin] Validating token access rules against request {{(pid=352329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:52:50.769027 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6deb1809-0679-46e1-849f-ebcfba6ff4e8 None admin] Validating token access rules against request {{(pid=352328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:52:50.791055 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG dbcounter [-] [352328] Writing DB stats keystone:SELECT=100 {{(pid=352328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:52:50.803388 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66b22a8-539a-4944-a8ea-9afadb70657d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:52:50.804437 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66b22a8-539a-4944-a8ea-9afadb70657d None admin] REQUEST_METHOD: `GET` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:52:50.804437 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66b22a8-539a-4944-a8ea-9afadb70657d None admin] SCRIPT_NAME: `/identity` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:52:50.804688 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66b22a8-539a-4944-a8ea-9afadb70657d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:52:50.805400 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f66b22a8-539a-4944-a8ea-9afadb70657d None admin] RBAC: Adding query filter params (role.id=280023171b4a45efb67c036ff237bb3c, scope.project.id=9af593aec02c450aa4ce9c48ff4c6a1f, user.id=d18c063b2377412485965357671e5506) {{(pid=352328) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:52:50.805716 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f66b22a8-539a-4944-a8ea-9afadb70657d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:52:50.805965 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG dbcounter [-] [352329] Writing DB stats keystone:SELECT=100 {{(pid=352329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:52:50.807613 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f66b22a8-539a-4944-a8ea-9afadb70657d None admin] RBAC: Authorization granted {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:52:50.812269 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1e0253-e3ad-4bbb-b710-e7b18ad37f78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:52:50.812939 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1e0253-e3ad-4bbb-b710-e7b18ad37f78 None admin] REQUEST_METHOD: `GET` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:52:50.813726 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1e0253-e3ad-4bbb-b710-e7b18ad37f78 None admin] SCRIPT_NAME: `/identity` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:52:50.813726 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1e0253-e3ad-4bbb-b710-e7b18ad37f78 None admin] PATH_INFO: `/v3/roles` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:52:50.814219 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af1e0253-e3ad-4bbb-b710-e7b18ad37f78 None admin] RBAC: Adding query filter params (name=member) {{(pid=352329) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:52:50.814539 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af1e0253-e3ad-4bbb-b710-e7b18ad37f78 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:52:50.816013 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af1e0253-e3ad-4bbb-b710-e7b18ad37f78 None admin] RBAC: Authorization granted {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:52:50.816609 dv-cinder-851351-1-smb devstack@keystone.service[352328]: [pid: 352328|app: 0|req: 47/87] 10.222.0.42 () {56 vars in 1374 bytes} [Thu Jul 28 08:52:50 2022] GET /identity/v3/role_assignments?user.id=d18c063b2377412485965357671e5506&scope.project.id=9af593aec02c450aa4ce9c48ff4c6a1f&role.id=280023171b4a45efb67c036ff237bb3c => generated 259 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:52:50.817445 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66b22a8-539a-4944-a8ea-9afadb70657d None admin] Authenticating user token {{(pid=352328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:52:50.825152 dv-cinder-851351-1-smb devstack@keystone.service[352329]: [pid: 352329|app: 0|req: 41/88] 10.222.0.42 () {56 vars in 1101 bytes} [Thu Jul 28 08:52:50 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:52:50.827437 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1e0253-e3ad-4bbb-b710-e7b18ad37f78 None admin] Authenticating user token {{(pid=352329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:52:50.950155 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1e0253-e3ad-4bbb-b710-e7b18ad37f78 None admin] Validating token access rules against request {{(pid=352329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:52:50.957056 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66b22a8-539a-4944-a8ea-9afadb70657d None admin] Validating token access rules against request {{(pid=352328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:52:50.991158 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d87deeef-7213-4d46-92e7-0f7e46aae2ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:52:50.991793 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87deeef-7213-4d46-92e7-0f7e46aae2ea None admin] REQUEST_METHOD: `POST` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:52:50.992085 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87deeef-7213-4d46-92e7-0f7e46aae2ea None admin] SCRIPT_NAME: `/identity` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:52:50.992368 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87deeef-7213-4d46-92e7-0f7e46aae2ea None admin] PATH_INFO: `/v3/users` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:52:50.993117 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d87deeef-7213-4d46-92e7-0f7e46aae2ea None admin] RBAC: Authorizing `identity:create_user()` {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:52:50.994606 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d87deeef-7213-4d46-92e7-0f7e46aae2ea None admin] RBAC: Authorization granted {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:52:51.000630 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e93f719-b9a8-4c4d-b3f8-baa67292de15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:52:51.001307 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e93f719-b9a8-4c4d-b3f8-baa67292de15 None admin] REQUEST_METHOD: `GET` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:52:51.001592 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e93f719-b9a8-4c4d-b3f8-baa67292de15 None admin] SCRIPT_NAME: `/identity` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:52:51.001868 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e93f719-b9a8-4c4d-b3f8-baa67292de15 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:52:51.002760 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e93f719-b9a8-4c4d-b3f8-baa67292de15 None admin] RBAC: Adding query filter params (role.id=16a3fc3aca974c47a329c2781b0be93a, scope.project.id=9af593aec02c450aa4ce9c48ff4c6a1f, user.id=dee261de1c2f4d11bec14593404de7a4) {{(pid=352328) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:52:51.003247 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e93f719-b9a8-4c4d-b3f8-baa67292de15 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:52:51.005611 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e93f719-b9a8-4c4d-b3f8-baa67292de15 None admin] RBAC: Authorization granted {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:52:51.020788 dv-cinder-851351-1-smb devstack@keystone.service[352328]: [pid: 352328|app: 0|req: 48/89] 10.222.0.42 () {56 vars in 1374 bytes} [Thu Jul 28 08:52:50 2022] GET /identity/v3/role_assignments?user.id=dee261de1c2f4d11bec14593404de7a4&scope.project.id=9af593aec02c450aa4ce9c48ff4c6a1f&role.id=16a3fc3aca974c47a329c2781b0be93a => generated 259 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:52:51.020788 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e93f719-b9a8-4c4d-b3f8-baa67292de15 None admin] Authenticating user token {{(pid=352328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:52:51.025135 dv-cinder-851351-1-smb devstack@keystone.service[352329]: [pid: 352329|app: 0|req: 42/90] 10.222.0.42 () {60 vars in 1132 bytes} [Thu Jul 28 08:52:50 2022] POST /identity/v3/users => generated 289 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 08:52:51.026204 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d87deeef-7213-4d46-92e7-0f7e46aae2ea None admin] Authenticating user token {{(pid=352329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:52:51.145169 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG dbcounter [-] [352329] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=352329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:52:51.159483 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG dbcounter [-] [352328] Writing DB stats keystone:SELECT=100 {{(pid=352328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:52:51.215040 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d87deeef-7213-4d46-92e7-0f7e46aae2ea None admin] Validating token access rules against request {{(pid=352329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:52:51.263505 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e148a709-5239-40df-8846-c08ea5012a55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:52:51.264633 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e148a709-5239-40df-8846-c08ea5012a55 None admin] REQUEST_METHOD: `GET` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:52:51.265200 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e148a709-5239-40df-8846-c08ea5012a55 None admin] SCRIPT_NAME: `/identity` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:52:51.265361 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e93f719-b9a8-4c4d-b3f8-baa67292de15 None admin] Validating token access rules against request {{(pid=352328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:52:51.265469 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e148a709-5239-40df-8846-c08ea5012a55 None admin] PATH_INFO: `/v3/users/dee261de1c2f4d11bec14593404de7a4` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:52:51.266788 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e148a709-5239-40df-8846-c08ea5012a55 None admin] RBAC: Authorizing `identity:get_user(user_id=dee261de1c2f4d11bec14593404de7a4)` {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:52:51.268616 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e148a709-5239-40df-8846-c08ea5012a55 None admin] RBAC: Authorization granted {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:52:51.270644 dv-cinder-851351-1-smb devstack@keystone.service[352329]: [pid: 352329|app: 0|req: 43/91] 10.222.0.42 () {56 vars in 1177 bytes} [Thu Jul 28 08:52:51 2022] GET /identity/v3/users/dee261de1c2f4d11bec14593404de7a4 => generated 275 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:52:51.276488 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e148a709-5239-40df-8846-c08ea5012a55 None admin] Authenticating user token {{(pid=352329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:52:51.314893 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8225ac76-aa83-4c75-bdfa-077b13630b10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:52:51.316202 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8225ac76-aa83-4c75-bdfa-077b13630b10 None admin] REQUEST_METHOD: `GET` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:52:51.316505 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8225ac76-aa83-4c75-bdfa-077b13630b10 None admin] SCRIPT_NAME: `/identity` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:52:51.316804 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8225ac76-aa83-4c75-bdfa-077b13630b10 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:52:51.401189 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8225ac76-aa83-4c75-bdfa-077b13630b10 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:52:51.403165 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8225ac76-aa83-4c75-bdfa-077b13630b10 None admin] RBAC: Authorization granted {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:52:51.403821 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e148a709-5239-40df-8846-c08ea5012a55 None admin] Validating token access rules against request {{(pid=352329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:52:51.425320 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG dbcounter [-] [352329] Writing DB stats keystone:SELECT=100 {{(pid=352329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:52:51.448449 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b80ed90-36c0-491c-baef-7000dcc4bc52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:52:51.449143 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b80ed90-36c0-491c-baef-7000dcc4bc52 None admin] REQUEST_METHOD: `GET` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:52:51.449603 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b80ed90-36c0-491c-baef-7000dcc4bc52 None admin] SCRIPT_NAME: `/identity` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:52:51.449884 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b80ed90-36c0-491c-baef-7000dcc4bc52 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:52:51.475738 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG dbcounter [-] [352328] Writing DB stats keystone:SELECT=100 {{(pid=352328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:52:51.543059 dv-cinder-851351-1-smb devstack@keystone.service[352328]: [pid: 352328|app: 0|req: 49/92] 10.222.0.42 () {58 vars in 1282 bytes} [Thu Jul 28 08:52:51 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 530 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 28 08:52:51.543398 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b80ed90-36c0-491c-baef-7000dcc4bc52 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:52:51.545019 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b80ed90-36c0-491c-baef-7000dcc4bc52 None admin] RBAC: Authorization granted {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:52:51.550004 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8225ac76-aa83-4c75-bdfa-077b13630b10 None admin] Authenticating user token {{(pid=352328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:52:51.691407 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8225ac76-aa83-4c75-bdfa-077b13630b10 None admin] Validating token access rules against request {{(pid=352328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:52:51.697629 dv-cinder-851351-1-smb devstack@keystone.service[352329]: [pid: 352329|app: 0|req: 44/93] 10.222.0.42 () {58 vars in 1282 bytes} [Thu Jul 28 08:52:51 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 422 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 28 08:52:51.707203 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b80ed90-36c0-491c-baef-7000dcc4bc52 None admin] Authenticating user token {{(pid=352329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:52:51.741121 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG dbcounter [-] [352329] Writing DB stats keystone:SELECT=100 {{(pid=352329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:52:51.750184 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db78c08-3261-4444-89f6-5a7660a57ec1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:52:51.750863 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db78c08-3261-4444-89f6-5a7660a57ec1 None admin] REQUEST_METHOD: `GET` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:52:51.751142 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db78c08-3261-4444-89f6-5a7660a57ec1 None admin] SCRIPT_NAME: `/identity` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:52:51.751414 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db78c08-3261-4444-89f6-5a7660a57ec1 None admin] PATH_INFO: `/v3/projects/9af593aec02c450aa4ce9c48ff4c6a1f` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:52:51.752874 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db78c08-3261-4444-89f6-5a7660a57ec1 None admin] RBAC: Authorizing `identity:get_project(project_id=9af593aec02c450aa4ce9c48ff4c6a1f)` {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:52:51.754356 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db78c08-3261-4444-89f6-5a7660a57ec1 None admin] RBAC: Authorization granted {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:52:51.756317 dv-cinder-851351-1-smb devstack@keystone.service[352328]: [pid: 352328|app: 0|req: 50/94] 10.222.0.42 () {56 vars in 1186 bytes} [Thu Jul 28 08:52:51 2022] GET /identity/v3/projects/9af593aec02c450aa4ce9c48ff4c6a1f => generated 298 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:52:51.762683 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db78c08-3261-4444-89f6-5a7660a57ec1 None admin] Authenticating user token {{(pid=352328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:52:51.786094 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG dbcounter [-] [352328] Writing DB stats keystone:SELECT=100 {{(pid=352328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:52:51.836298 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b80ed90-36c0-491c-baef-7000dcc4bc52 None admin] Validating token access rules against request {{(pid=352329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:52:51.872055 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db78c08-3261-4444-89f6-5a7660a57ec1 None admin] Validating token access rules against request {{(pid=352328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:52:51.876689 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f4cf89-3f72-4688-a551-f4f7283a2222 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:52:51.877787 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f4cf89-3f72-4688-a551-f4f7283a2222 None admin] REQUEST_METHOD: `GET` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:52:51.878287 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f4cf89-3f72-4688-a551-f4f7283a2222 None admin] SCRIPT_NAME: `/identity` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:52:51.878791 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f4cf89-3f72-4688-a551-f4f7283a2222 None admin] PATH_INFO: `/v3/projects/a177ed99903c46349a25c58aacd4f5b4` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:52:51.880231 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17f4cf89-3f72-4688-a551-f4f7283a2222 None admin] RBAC: Authorizing `identity:get_project(project_id=a177ed99903c46349a25c58aacd4f5b4)` {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:52:51.882112 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17f4cf89-3f72-4688-a551-f4f7283a2222 None admin] RBAC: Authorization granted {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:52:51.884362 dv-cinder-851351-1-smb devstack@keystone.service[352329]: [pid: 352329|app: 0|req: 45/95] 10.222.0.42 () {56 vars in 1186 bytes} [Thu Jul 28 08:52:51 2022] GET /identity/v3/projects/a177ed99903c46349a25c58aacd4f5b4 => generated 312 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:52:51.892973 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f4cf89-3f72-4688-a551-f4f7283a2222 None admin] Authenticating user token {{(pid=352329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:52:51.914320 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca4e74ac-2ba8-4cd0-855c-67d1c8604578 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:52:51.914973 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4e74ac-2ba8-4cd0-855c-67d1c8604578 None admin] REQUEST_METHOD: `GET` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:52:51.915255 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4e74ac-2ba8-4cd0-855c-67d1c8604578 None admin] SCRIPT_NAME: `/identity` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:52:51.915532 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4e74ac-2ba8-4cd0-855c-67d1c8604578 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:52:51.916346 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca4e74ac-2ba8-4cd0-855c-67d1c8604578 None admin] RBAC: Adding query filter params (role.id=a4fa43cd6d914398a0790a1516c83d08, scope.project.id=9af593aec02c450aa4ce9c48ff4c6a1f, user.id=dee261de1c2f4d11bec14593404de7a4) {{(pid=352328) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:52:51.916681 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca4e74ac-2ba8-4cd0-855c-67d1c8604578 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:52:51.918166 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca4e74ac-2ba8-4cd0-855c-67d1c8604578 None admin] RBAC: Authorization granted {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:52:51.938109 dv-cinder-851351-1-smb devstack@keystone.service[352328]: [pid: 352328|app: 0|req: 51/96] 10.222.0.42 () {56 vars in 1374 bytes} [Thu Jul 28 08:52:51 2022] GET /identity/v3/role_assignments?user.id=dee261de1c2f4d11bec14593404de7a4&scope.project.id=9af593aec02c450aa4ce9c48ff4c6a1f&role.id=a4fa43cd6d914398a0790a1516c83d08 => generated 259 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:52:52.027521 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG dbcounter [-] [352329] Writing DB stats keystone:SELECT=100 {{(pid=352329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:52:52.060142 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f4cf89-3f72-4688-a551-f4f7283a2222 None admin] Validating token access rules against request {{(pid=352329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:52:52.114418 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c08b3e-0525-4fed-94e3-b28bdefbf4e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:52:52.114988 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c08b3e-0525-4fed-94e3-b28bdefbf4e2 None admin] REQUEST_METHOD: `GET` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:52:52.115272 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c08b3e-0525-4fed-94e3-b28bdefbf4e2 None admin] SCRIPT_NAME: `/identity` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:52:52.115546 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c08b3e-0525-4fed-94e3-b28bdefbf4e2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:52:52.116367 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c08b3e-0525-4fed-94e3-b28bdefbf4e2 None admin] RBAC: Adding query filter params (role.id=16a3fc3aca974c47a329c2781b0be93a, scope.project.id=a177ed99903c46349a25c58aacd4f5b4, user.id=dee261de1c2f4d11bec14593404de7a4) {{(pid=352329) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:52:52.116690 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c08b3e-0525-4fed-94e3-b28bdefbf4e2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:52:52.118178 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c08b3e-0525-4fed-94e3-b28bdefbf4e2 None admin] RBAC: Authorization granted {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:52:52.129526 dv-cinder-851351-1-smb devstack@keystone.service[352329]: [pid: 352329|app: 0|req: 46/97] 10.222.0.42 () {56 vars in 1374 bytes} [Thu Jul 28 08:52:51 2022] GET /identity/v3/role_assignments?user.id=dee261de1c2f4d11bec14593404de7a4&scope.project.id=a177ed99903c46349a25c58aacd4f5b4&role.id=16a3fc3aca974c47a329c2781b0be93a => generated 259 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:52:53.558830 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257a632d-b810-4d14-baba-cbebb890de4d None None] REQUEST_METHOD: `GET` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:52:53.559394 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257a632d-b810-4d14-baba-cbebb890de4d None None] SCRIPT_NAME: `/identity` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:52:53.559394 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257a632d-b810-4d14-baba-cbebb890de4d None None] PATH_INFO: `/` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:52:53.560792 dv-cinder-851351-1-smb devstack@keystone.service[352328]: [pid: 352328|app: 0|req: 52/98] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 08:52:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 08:52:53.566940 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5530c35d-26eb-4090-81bd-25873874d859 None None] REQUEST_METHOD: `POST` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:52:53.567818 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5530c35d-26eb-4090-81bd-25873874d859 None None] SCRIPT_NAME: `/identity` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:52:53.568328 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5530c35d-26eb-4090-81bd-25873874d859 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:52:53.591855 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.auth.core [None req-5530c35d-26eb-4090-81bd-25873874d859 None None] MFA Rules not processed for user `d18c063b2377412485965357671e5506`. Rule list: `[]` (Enabled: `True`). {{(pid=352329) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 08:52:53.593462 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.fernet_utils [None req-5530c35d-26eb-4090-81bd-25873874d859 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=352329) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:52:53.677239 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c600f2-0b76-4fc8-aa89-82d0ad9f52ad None None] REQUEST_METHOD: `GET` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:52:53.677576 dv-cinder-851351-1-smb devstack@keystone.service[352329]: [pid: 352329|app: 0|req: 47/99] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 08:52:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 08:52:53.678068 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c600f2-0b76-4fc8-aa89-82d0ad9f52ad None None] SCRIPT_NAME: `/identity` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:52:53.678351 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c600f2-0b76-4fc8-aa89-82d0ad9f52ad None None] PATH_INFO: `/` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:52:53.679731 dv-cinder-851351-1-smb devstack@keystone.service[352328]: [pid: 352328|app: 0|req: 53/100] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 08:52:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 08:52:53.685011 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97fdbb7-4d41-471e-b9c6-3aebc121d2f0 None None] REQUEST_METHOD: `POST` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:52:53.685305 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97fdbb7-4d41-471e-b9c6-3aebc121d2f0 None None] SCRIPT_NAME: `/identity` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:52:53.685598 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97fdbb7-4d41-471e-b9c6-3aebc121d2f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:52:53.703669 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.auth.core [None req-b97fdbb7-4d41-471e-b9c6-3aebc121d2f0 None None] MFA Rules not processed for user `d18c063b2377412485965357671e5506`. Rule list: `[]` (Enabled: `True`). {{(pid=352329) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 08:52:53.705377 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.fernet_utils [None req-b97fdbb7-4d41-471e-b9c6-3aebc121d2f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=352329) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:52:53.718129 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c600f2-0b76-4fc8-aa89-82d0ad9f52ad None None] Authenticating user token {{(pid=352328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:52:53.775015 dv-cinder-851351-1-smb devstack@keystone.service[352329]: [pid: 352329|app: 0|req: 48/101] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 08:52:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 08:52:53.809366 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b97fdbb7-4d41-471e-b9c6-3aebc121d2f0 None None] Authenticating user token {{(pid=352329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:52:53.826318 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG dbcounter [-] [352329] Writing DB stats keystone:SELECT=100 {{(pid=352329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:52:53.893209 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG dbcounter [-] [352328] Writing DB stats keystone:SELECT=100 {{(pid=352328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:52:53.940403 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c600f2-0b76-4fc8-aa89-82d0ad9f52ad None None] Validating token access rules against request {{(pid=352328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:52:53.952153 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b97fdbb7-4d41-471e-b9c6-3aebc121d2f0 None None] Validating token access rules against request {{(pid=352329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:52:53.992093 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ed51b6-61b8-44c6-bd3e-f7860d9d761d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:52:53.993276 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ed51b6-61b8-44c6-bd3e-f7860d9d761d None admin] REQUEST_METHOD: `GET` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:52:53.994532 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ed51b6-61b8-44c6-bd3e-f7860d9d761d None admin] SCRIPT_NAME: `/identity` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:52:53.995585 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ed51b6-61b8-44c6-bd3e-f7860d9d761d None admin] PATH_INFO: `/v3/roles/member` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:52:54.009914 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076b274c-3e40-4e04-82b9-b1e015b319e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:52:54.010921 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076b274c-3e40-4e04-82b9-b1e015b319e7 None admin] REQUEST_METHOD: `GET` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:52:54.012306 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076b274c-3e40-4e04-82b9-b1e015b319e7 None admin] SCRIPT_NAME: `/identity` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:52:54.012818 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076b274c-3e40-4e04-82b9-b1e015b319e7 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:52:54.019341 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ed51b6-61b8-44c6-bd3e-f7860d9d761d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 08:52:54.027394 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application [None req-f9ed51b6-61b8-44c6-bd3e-f7860d9d761d None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 28 08:52:54.027394 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:52:54.027394 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:52:54.027394 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:52:54.027394 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:52:54.027394 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:52:54.027394 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:52:54.027394 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:52:54.027394 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:52:54.027394 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:52:54.027394 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:52:54.027394 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:52:54.027394 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 08:52:54.027394 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 08:52:54.027394 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 08:52:54.027394 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 08:52:54.028566 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 08:52:54.028566 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 08:52:54.028566 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 08:52:54.028566 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 08:52:54.028566 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:52:54.028566 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:52:54.028566 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:52:54.028566 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:52:54.028566 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:52:54.028566 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:52:54.028566 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:52:54.028566 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application with Lock( Jul 28 08:52:54.028566 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:52:54.028566 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:52:54.028566 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:52:54.028566 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:52:54.029648 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:52:54.029648 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:52:54.029648 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:52:54.029648 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:52:54.029648 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 08:52:54.029648 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 08:52:54.029648 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 08:52:54.029648 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 08:52:54.029648 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 08:52:54.029648 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 08:52:54.029648 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 28 08:52:54.029648 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application Jul 28 08:52:54.032313 dv-cinder-851351-1-smb devstack@keystone.service[352329]: [pid: 352329|app: 0|req: 49/102] 10.222.0.42 () {56 vars in 1099 bytes} [Thu Jul 28 08:52:53 2022] GET /identity/v3/roles/member => generated 84 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:52:54.042088 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ed51b6-61b8-44c6-bd3e-f7860d9d761d None admin] Authenticating user token {{(pid=352329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:52:54.044195 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-076b274c-3e40-4e04-82b9-b1e015b319e7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 08:52:54.056638 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application [None req-076b274c-3e40-4e04-82b9-b1e015b319e7 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 08:52:54.056638 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:52:54.056638 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:52:54.056638 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:52:54.056638 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:52:54.056638 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:52:54.056638 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:52:54.056638 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:52:54.056638 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:52:54.056638 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:52:54.056638 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:52:54.056638 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:52:54.056638 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 08:52:54.056638 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 08:52:54.056638 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 08:52:54.056638 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 08:52:54.059731 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 08:52:54.059731 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 08:52:54.059731 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 08:52:54.059731 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 08:52:54.059731 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:52:54.059731 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:52:54.059731 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:52:54.059731 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:52:54.059731 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:52:54.059731 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:52:54.059731 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:52:54.059731 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application with Lock( Jul 28 08:52:54.059731 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:52:54.059731 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:52:54.059731 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:52:54.059731 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:52:54.062025 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:52:54.062025 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:52:54.062025 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:52:54.062025 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:52:54.062025 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 08:52:54.062025 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 08:52:54.062025 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 08:52:54.062025 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 08:52:54.062025 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 08:52:54.062025 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 08:52:54.062025 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 08:52:54.062025 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application Jul 28 08:52:54.062025 dv-cinder-851351-1-smb devstack@keystone.service[352328]: [pid: 352328|app: 0|req: 54/103] 10.222.0.42 () {56 vars in 1096 bytes} [Thu Jul 28 08:52:53 2022] GET /identity/v3/roles/admin => generated 83 bytes in 341 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:52:54.066954 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076b274c-3e40-4e04-82b9-b1e015b319e7 None admin] Authenticating user token {{(pid=352328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:52:54.223124 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG dbcounter [-] [352329] Writing DB stats keystone:SELECT=100 {{(pid=352329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:52:54.278739 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076b274c-3e40-4e04-82b9-b1e015b319e7 None admin] Validating token access rules against request {{(pid=352328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:52:54.308740 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ed51b6-61b8-44c6-bd3e-f7860d9d761d None admin] Validating token access rules against request {{(pid=352329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:52:54.346647 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d571a0-1d9b-41de-80cc-cb1fa567016f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:52:54.347625 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d571a0-1d9b-41de-80cc-cb1fa567016f None admin] REQUEST_METHOD: `GET` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:52:54.348077 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d571a0-1d9b-41de-80cc-cb1fa567016f None admin] SCRIPT_NAME: `/identity` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:52:54.348510 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d571a0-1d9b-41de-80cc-cb1fa567016f None admin] PATH_INFO: `/v3/roles` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:52:54.349900 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83d571a0-1d9b-41de-80cc-cb1fa567016f None admin] RBAC: Adding query filter params (name=admin) {{(pid=352328) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:52:54.350405 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83d571a0-1d9b-41de-80cc-cb1fa567016f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:52:54.352152 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83d571a0-1d9b-41de-80cc-cb1fa567016f None admin] RBAC: Authorization granted {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:52:54.368863 dv-cinder-851351-1-smb devstack@keystone.service[352328]: [pid: 352328|app: 0|req: 55/104] 10.222.0.42 () {56 vars in 1099 bytes} [Thu Jul 28 08:52:54 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 303 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:52:54.374668 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d571a0-1d9b-41de-80cc-cb1fa567016f None admin] Authenticating user token {{(pid=352328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:52:54.380118 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG dbcounter [-] [352328] Writing DB stats keystone:SELECT=100 {{(pid=352328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:52:54.382511 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-973b0e8b-a8a4-46cc-b02e-831dac43a81f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:52:54.383317 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973b0e8b-a8a4-46cc-b02e-831dac43a81f None admin] REQUEST_METHOD: `GET` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:52:54.383709 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973b0e8b-a8a4-46cc-b02e-831dac43a81f None admin] SCRIPT_NAME: `/identity` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:52:54.384089 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973b0e8b-a8a4-46cc-b02e-831dac43a81f None admin] PATH_INFO: `/v3/roles` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:52:54.385013 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-973b0e8b-a8a4-46cc-b02e-831dac43a81f None admin] RBAC: Adding query filter params (name=member) {{(pid=352329) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:52:54.385430 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-973b0e8b-a8a4-46cc-b02e-831dac43a81f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:52:54.387007 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-973b0e8b-a8a4-46cc-b02e-831dac43a81f None admin] RBAC: Authorization granted {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:52:54.406933 dv-cinder-851351-1-smb devstack@keystone.service[352329]: [pid: 352329|app: 0|req: 50/105] 10.222.0.42 () {56 vars in 1101 bytes} [Thu Jul 28 08:52:54 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 366 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:52:54.412823 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-973b0e8b-a8a4-46cc-b02e-831dac43a81f None admin] Authenticating user token {{(pid=352329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:52:54.586734 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d571a0-1d9b-41de-80cc-cb1fa567016f None admin] Validating token access rules against request {{(pid=352328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:52:54.601704 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-973b0e8b-a8a4-46cc-b02e-831dac43a81f None admin] Validating token access rules against request {{(pid=352329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:52:54.634421 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG dbcounter [-] [352329] Writing DB stats keystone:SELECT=100 {{(pid=352329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:52:54.645104 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-865d378e-76ab-4054-a2d3-11d410fa7a40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:52:54.645787 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865d378e-76ab-4054-a2d3-11d410fa7a40 None admin] REQUEST_METHOD: `GET` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:52:54.646078 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865d378e-76ab-4054-a2d3-11d410fa7a40 None admin] SCRIPT_NAME: `/identity` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:52:54.646361 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865d378e-76ab-4054-a2d3-11d410fa7a40 None admin] PATH_INFO: `/v3/users/dee261de1c2f4d11bec14593404de7a4` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:52:54.648497 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-865d378e-76ab-4054-a2d3-11d410fa7a40 None admin] RBAC: Authorizing `identity:get_user(user_id=dee261de1c2f4d11bec14593404de7a4)` {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:52:54.650048 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-865d378e-76ab-4054-a2d3-11d410fa7a40 None admin] RBAC: Authorization granted {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:52:54.655042 dv-cinder-851351-1-smb devstack@keystone.service[352329]: [pid: 352329|app: 0|req: 51/106] 10.222.0.42 () {56 vars in 1177 bytes} [Thu Jul 28 08:52:54 2022] GET /identity/v3/users/dee261de1c2f4d11bec14593404de7a4 => generated 275 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:52:54.661029 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-865d378e-76ab-4054-a2d3-11d410fa7a40 None admin] Authenticating user token {{(pid=352329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:52:54.677152 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b5edae-7c1e-4076-86a5-e50ede3836ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:52:54.677832 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b5edae-7c1e-4076-86a5-e50ede3836ae None admin] REQUEST_METHOD: `GET` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:52:54.678116 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b5edae-7c1e-4076-86a5-e50ede3836ae None admin] SCRIPT_NAME: `/identity` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:52:54.678395 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b5edae-7c1e-4076-86a5-e50ede3836ae None admin] PATH_INFO: `/v3/users/d18c063b2377412485965357671e5506` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:52:54.679674 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60b5edae-7c1e-4076-86a5-e50ede3836ae None admin] RBAC: Authorizing `identity:get_user(user_id=d18c063b2377412485965357671e5506)` {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:52:54.681198 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60b5edae-7c1e-4076-86a5-e50ede3836ae None admin] RBAC: Authorization granted {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:52:54.690517 dv-cinder-851351-1-smb devstack@keystone.service[352328]: [pid: 352328|app: 0|req: 56/107] 10.222.0.42 () {56 vars in 1177 bytes} [Thu Jul 28 08:52:54 2022] GET /identity/v3/users/d18c063b2377412485965357671e5506 => generated 247 bytes in 316 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:52:54.691267 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b5edae-7c1e-4076-86a5-e50ede3836ae None admin] Authenticating user token {{(pid=352328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:52:54.842317 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG dbcounter [-] [352328] Writing DB stats keystone:SELECT=100 {{(pid=352328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:52:54.885981 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-865d378e-76ab-4054-a2d3-11d410fa7a40 None admin] Validating token access rules against request {{(pid=352329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:52:54.903984 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b5edae-7c1e-4076-86a5-e50ede3836ae None admin] Validating token access rules against request {{(pid=352328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:52:54.945615 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9111f975-661b-4454-a4ba-51cf59649a33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:52:54.946293 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9111f975-661b-4454-a4ba-51cf59649a33 None admin] REQUEST_METHOD: `GET` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:52:54.946588 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9111f975-661b-4454-a4ba-51cf59649a33 None admin] SCRIPT_NAME: `/identity` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:52:54.946872 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9111f975-661b-4454-a4ba-51cf59649a33 None admin] PATH_INFO: `/v3/projects/9af593aec02c450aa4ce9c48ff4c6a1f` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:52:54.948358 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9111f975-661b-4454-a4ba-51cf59649a33 None admin] RBAC: Authorizing `identity:get_project(project_id=9af593aec02c450aa4ce9c48ff4c6a1f)` {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:52:54.949891 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9111f975-661b-4454-a4ba-51cf59649a33 None admin] RBAC: Authorization granted {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:52:54.951888 dv-cinder-851351-1-smb devstack@keystone.service[352329]: [pid: 352329|app: 0|req: 52/108] 10.222.0.42 () {56 vars in 1186 bytes} [Thu Jul 28 08:52:54 2022] GET /identity/v3/projects/9af593aec02c450aa4ce9c48ff4c6a1f => generated 298 bytes in 291 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:52:54.952513 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78249835-6642-4555-955f-80683e05801c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:52:54.953210 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78249835-6642-4555-955f-80683e05801c None admin] REQUEST_METHOD: `GET` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:52:54.953494 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78249835-6642-4555-955f-80683e05801c None admin] SCRIPT_NAME: `/identity` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:52:54.953766 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78249835-6642-4555-955f-80683e05801c None admin] PATH_INFO: `/v3/projects/9af593aec02c450aa4ce9c48ff4c6a1f` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:52:54.955566 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78249835-6642-4555-955f-80683e05801c None admin] RBAC: Authorizing `identity:get_project(project_id=9af593aec02c450aa4ce9c48ff4c6a1f)` {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:52:54.957056 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78249835-6642-4555-955f-80683e05801c None admin] RBAC: Authorization granted {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:52:54.958063 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77bfb200-fa7f-45c0-a6e8-5602e84dc45d None None] REQUEST_METHOD: `GET` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:52:54.958359 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77bfb200-fa7f-45c0-a6e8-5602e84dc45d None None] SCRIPT_NAME: `/identity` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:52:54.960943 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77bfb200-fa7f-45c0-a6e8-5602e84dc45d None None] PATH_INFO: `/` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:52:54.961095 dv-cinder-851351-1-smb devstack@keystone.service[352328]: [pid: 352328|app: 0|req: 57/109] 10.222.0.42 () {56 vars in 1186 bytes} [Thu Jul 28 08:52:54 2022] GET /identity/v3/projects/9af593aec02c450aa4ce9c48ff4c6a1f => generated 298 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:52:54.961095 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac626121-cd9c-498e-b00d-989019db0281 None None] REQUEST_METHOD: `GET` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:52:54.961253 dv-cinder-851351-1-smb devstack@keystone.service[352329]: [pid: 352329|app: 0|req: 53/110] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 08:52:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 08:52:54.961340 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac626121-cd9c-498e-b00d-989019db0281 None None] SCRIPT_NAME: `/identity` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:52:54.961340 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac626121-cd9c-498e-b00d-989019db0281 None None] PATH_INFO: `/` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:52:54.961504 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32cf2f6-ea32-49aa-bd4e-e3573764d9c5 None None] REQUEST_METHOD: `GET` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:52:54.961504 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32cf2f6-ea32-49aa-bd4e-e3573764d9c5 None None] SCRIPT_NAME: `/identity` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:52:54.961658 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32cf2f6-ea32-49aa-bd4e-e3573764d9c5 None None] PATH_INFO: `/` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:52:54.961736 dv-cinder-851351-1-smb devstack@keystone.service[352328]: [pid: 352328|app: 0|req: 58/111] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 08:52:54 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 08:52:54.962399 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac626121-cd9c-498e-b00d-989019db0281 None None] Authenticating user token {{(pid=352328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:52:54.967155 dv-cinder-851351-1-smb devstack@keystone.service[352329]: [pid: 352329|app: 0|req: 54/112] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 08:52:54 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 08:52:54.968456 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f329dc7-a8a4-431f-965f-be84106c1ae2 None None] REQUEST_METHOD: `POST` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:52:54.968697 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f329dc7-a8a4-431f-965f-be84106c1ae2 None None] SCRIPT_NAME: `/identity` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:52:54.969130 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f329dc7-a8a4-431f-965f-be84106c1ae2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:52:54.987773 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.auth.core [None req-8f329dc7-a8a4-431f-965f-be84106c1ae2 None None] MFA Rules not processed for user `d18c063b2377412485965357671e5506`. Rule list: `[]` (Enabled: `True`). {{(pid=352329) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 08:52:54.989024 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.fernet_utils [None req-8f329dc7-a8a4-431f-965f-be84106c1ae2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=352329) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:52:55.060630 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG dbcounter [-] [352329] Writing DB stats keystone:SELECT=100 {{(pid=352329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:52:55.068234 dv-cinder-851351-1-smb devstack@keystone.service[352329]: [pid: 352329|app: 0|req: 55/113] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 08:52:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 08:52:55.069162 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f329dc7-a8a4-431f-965f-be84106c1ae2 None None] Authenticating user token {{(pid=352329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:52:55.085594 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac626121-cd9c-498e-b00d-989019db0281 None None] Validating token access rules against request {{(pid=352328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:52:55.120283 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99002b2-74f9-4316-8205-886c0badd4b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:52:55.121019 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99002b2-74f9-4316-8205-886c0badd4b2 None admin] REQUEST_METHOD: `PUT` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:52:55.121306 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99002b2-74f9-4316-8205-886c0badd4b2 None admin] SCRIPT_NAME: `/identity` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:52:55.121588 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99002b2-74f9-4316-8205-886c0badd4b2 None admin] PATH_INFO: `/v3/projects/9af593aec02c450aa4ce9c48ff4c6a1f/users/dee261de1c2f4d11bec14593404de7a4/roles/16a3fc3aca974c47a329c2781b0be93a` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:52:55.123605 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b99002b2-74f9-4316-8205-886c0badd4b2 None admin] RBAC: Authorizing `identity:create_grant(project_id=9af593aec02c450aa4ce9c48ff4c6a1f, user_id=dee261de1c2f4d11bec14593404de7a4, role_id=16a3fc3aca974c47a329c2781b0be93a)` {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:52:55.125131 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b99002b2-74f9-4316-8205-886c0badd4b2 None admin] RBAC: Authorization granted {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:52:55.137521 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG dbcounter [-] [352328] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=352328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:52:55.141772 dv-cinder-851351-1-smb devstack@keystone.service[352328]: [pid: 352328|app: 0|req: 59/114] 10.222.0.42 () {58 vars in 1439 bytes} [Thu Jul 28 08:52:54 2022] PUT /identity/v3/projects/9af593aec02c450aa4ce9c48ff4c6a1f/users/dee261de1c2f4d11bec14593404de7a4/roles/16a3fc3aca974c47a329c2781b0be93a => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 08:52:55.143623 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3f454b-e3db-46d5-9ab3-7a8dd99ac630 None None] REQUEST_METHOD: `POST` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:52:55.144174 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3f454b-e3db-46d5-9ab3-7a8dd99ac630 None None] SCRIPT_NAME: `/identity` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:52:55.144459 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3f454b-e3db-46d5-9ab3-7a8dd99ac630 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:52:55.165872 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.auth.core [None req-ee3f454b-e3db-46d5-9ab3-7a8dd99ac630 None None] MFA Rules not processed for user `d18c063b2377412485965357671e5506`. Rule list: `[]` (Enabled: `True`). {{(pid=352328) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 08:52:55.167144 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.fernet_utils [None req-ee3f454b-e3db-46d5-9ab3-7a8dd99ac630 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=352328) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:52:55.186168 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f329dc7-a8a4-431f-965f-be84106c1ae2 None None] Validating token access rules against request {{(pid=352329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:52:55.228143 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea6f875-69dd-4a98-ae18-92061ad62ead None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:52:55.228885 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea6f875-69dd-4a98-ae18-92061ad62ead None admin] REQUEST_METHOD: `PUT` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:52:55.229172 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea6f875-69dd-4a98-ae18-92061ad62ead None admin] SCRIPT_NAME: `/identity` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:52:55.229452 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea6f875-69dd-4a98-ae18-92061ad62ead None admin] PATH_INFO: `/v3/projects/9af593aec02c450aa4ce9c48ff4c6a1f/users/d18c063b2377412485965357671e5506/roles/280023171b4a45efb67c036ff237bb3c` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:52:55.232272 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ea6f875-69dd-4a98-ae18-92061ad62ead None admin] RBAC: Authorizing `identity:create_grant(project_id=9af593aec02c450aa4ce9c48ff4c6a1f, user_id=d18c063b2377412485965357671e5506, role_id=280023171b4a45efb67c036ff237bb3c)` {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:52:55.233869 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ea6f875-69dd-4a98-ae18-92061ad62ead None admin] RBAC: Authorization granted {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:52:55.260736 dv-cinder-851351-1-smb devstack@keystone.service[352329]: [pid: 352329|app: 0|req: 56/115] 10.222.0.42 () {58 vars in 1439 bytes} [Thu Jul 28 08:52:55 2022] PUT /identity/v3/projects/9af593aec02c450aa4ce9c48ff4c6a1f/users/d18c063b2377412485965357671e5506/roles/280023171b4a45efb67c036ff237bb3c => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 08:52:55.261027 dv-cinder-851351-1-smb devstack@keystone.service[352328]: [pid: 352328|app: 0|req: 60/116] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 08:52:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 08:52:55.261027 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766ff557-aa7f-4746-b9ba-b38f957f2685 None None] REQUEST_METHOD: `GET` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:52:55.261241 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5f2fb1-13d6-4aec-95e0-d0bff717f46c None None] REQUEST_METHOD: `POST` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:52:55.261340 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766ff557-aa7f-4746-b9ba-b38f957f2685 None None] SCRIPT_NAME: `/identity` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:52:55.261461 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5f2fb1-13d6-4aec-95e0-d0bff717f46c None None] SCRIPT_NAME: `/identity` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:52:55.261558 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766ff557-aa7f-4746-b9ba-b38f957f2685 None None] PATH_INFO: `/` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:52:55.261660 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5f2fb1-13d6-4aec-95e0-d0bff717f46c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:52:55.261755 dv-cinder-851351-1-smb devstack@keystone.service[352328]: [pid: 352328|app: 0|req: 61/117] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 08:52:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 08:52:55.261755 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766ff557-aa7f-4746-b9ba-b38f957f2685 None None] Authenticating user token {{(pid=352328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:52:55.282659 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.auth.core [None req-ff5f2fb1-13d6-4aec-95e0-d0bff717f46c None None] MFA Rules not processed for user `d18c063b2377412485965357671e5506`. Rule list: `[]` (Enabled: `True`). {{(pid=352329) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 08:52:55.284575 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.fernet_utils [None req-ff5f2fb1-13d6-4aec-95e0-d0bff717f46c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=352329) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:52:55.354450 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG dbcounter [-] [352329] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=352329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:52:55.377660 dv-cinder-851351-1-smb devstack@keystone.service[352329]: [pid: 352329|app: 0|req: 57/118] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 08:52:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 08:52:55.379426 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec27a75-e07f-420d-81e3-f1d00d8a7146 None None] REQUEST_METHOD: `POST` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:52:55.379725 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec27a75-e07f-420d-81e3-f1d00d8a7146 None None] SCRIPT_NAME: `/identity` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:52:55.380005 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec27a75-e07f-420d-81e3-f1d00d8a7146 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:52:55.408763 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.auth.core [None req-0ec27a75-e07f-420d-81e3-f1d00d8a7146 None None] MFA Rules not processed for user `d18c063b2377412485965357671e5506`. Rule list: `[]` (Enabled: `True`). {{(pid=352329) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 08:52:55.409974 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.fernet_utils [None req-0ec27a75-e07f-420d-81e3-f1d00d8a7146 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=352329) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:52:55.448167 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766ff557-aa7f-4746-b9ba-b38f957f2685 None None] Validating token access rules against request {{(pid=352328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:52:55.492541 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG dbcounter [-] [352328] Writing DB stats keystone:SELECT=100 {{(pid=352328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:52:55.506947 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389e0684-5c39-4463-9d34-e2611ac22e37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:52:55.507974 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389e0684-5c39-4463-9d34-e2611ac22e37 None admin] REQUEST_METHOD: `GET` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:52:55.508379 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389e0684-5c39-4463-9d34-e2611ac22e37 None admin] SCRIPT_NAME: `/identity` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:52:55.508685 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389e0684-5c39-4463-9d34-e2611ac22e37 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:52:55.515029 dv-cinder-851351-1-smb devstack@keystone.service[352329]: [pid: 352329|app: 0|req: 58/119] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 08:52:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 08:52:55.516241 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec27a75-e07f-420d-81e3-f1d00d8a7146 None None] Authenticating user token {{(pid=352329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:52:55.523321 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-389e0684-5c39-4463-9d34-e2611ac22e37 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 08:52:55.529154 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application [None req-389e0684-5c39-4463-9d34-e2611ac22e37 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 28 08:52:55.529154 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:52:55.529154 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:52:55.529154 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:52:55.529154 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:52:55.529154 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:52:55.529154 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:52:55.529154 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:52:55.529154 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:52:55.529154 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:52:55.529154 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:52:55.529154 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:52:55.529154 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 08:52:55.529154 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 08:52:55.529154 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 08:52:55.529154 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 08:52:55.530300 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 08:52:55.530300 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 08:52:55.530300 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 08:52:55.530300 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 08:52:55.530300 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:52:55.530300 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:52:55.530300 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:52:55.530300 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:52:55.530300 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:52:55.530300 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:52:55.530300 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:52:55.530300 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application with Lock( Jul 28 08:52:55.530300 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:52:55.530300 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:52:55.530300 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:52:55.530300 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:52:55.531358 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:52:55.531358 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:52:55.531358 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:52:55.531358 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:52:55.531358 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 08:52:55.531358 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 08:52:55.531358 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 08:52:55.531358 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 08:52:55.531358 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 08:52:55.531358 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 08:52:55.531358 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 28 08:52:55.531358 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application Jul 28 08:52:55.531358 dv-cinder-851351-1-smb devstack@keystone.service[352328]: [pid: 352328|app: 0|req: 62/120] 10.222.0.42 () {56 vars in 1099 bytes} [Thu Jul 28 08:52:55 2022] GET /identity/v3/roles/reader => generated 84 bytes in 277 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:52:55.531358 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389e0684-5c39-4463-9d34-e2611ac22e37 None admin] Authenticating user token {{(pid=352328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:52:55.639692 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec27a75-e07f-420d-81e3-f1d00d8a7146 None None] Validating token access rules against request {{(pid=352329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:52:55.658697 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG dbcounter [-] [352329] Writing DB stats keystone:SELECT=100 {{(pid=352329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:52:55.659287 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389e0684-5c39-4463-9d34-e2611ac22e37 None admin] Validating token access rules against request {{(pid=352328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:52:55.689951 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a39330-d298-42c4-8aad-0baabcb4bc80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:52:55.690665 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a39330-d298-42c4-8aad-0baabcb4bc80 None admin] REQUEST_METHOD: `GET` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:52:55.690956 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a39330-d298-42c4-8aad-0baabcb4bc80 None admin] SCRIPT_NAME: `/identity` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:52:55.691243 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a39330-d298-42c4-8aad-0baabcb4bc80 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:52:55.703167 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4a39330-d298-42c4-8aad-0baabcb4bc80 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 08:52:55.709508 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application [None req-c4a39330-d298-42c4-8aad-0baabcb4bc80 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 28 08:52:55.709508 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:52:55.709508 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:52:55.709508 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:52:55.709508 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:52:55.709508 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:52:55.709508 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:52:55.709508 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:52:55.709508 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:52:55.709508 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:52:55.709508 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:52:55.709508 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:52:55.709508 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 08:52:55.709508 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 08:52:55.709508 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 08:52:55.709508 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 08:52:55.711057 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 08:52:55.711057 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 08:52:55.711057 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 08:52:55.711057 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 08:52:55.711057 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:52:55.711057 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:52:55.711057 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:52:55.711057 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:52:55.711057 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:52:55.711057 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:52:55.711057 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:52:55.711057 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application with Lock( Jul 28 08:52:55.711057 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:52:55.711057 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:52:55.711057 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:52:55.711057 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:52:55.712553 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:52:55.712553 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:52:55.712553 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:52:55.712553 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:52:55.712553 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 08:52:55.712553 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 08:52:55.712553 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 08:52:55.712553 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 08:52:55.712553 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 08:52:55.712553 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 08:52:55.712553 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 28 08:52:55.712553 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application Jul 28 08:52:55.712553 dv-cinder-851351-1-smb devstack@keystone.service[352329]: [pid: 352329|app: 0|req: 59/121] 10.222.0.42 () {56 vars in 1114 bytes} [Thu Jul 28 08:52:55 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:52:55.712553 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a39330-d298-42c4-8aad-0baabcb4bc80 None admin] Authenticating user token {{(pid=352329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:52:55.716550 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cdf4436-8ac2-49fb-be5c-5fa455f29ae1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:52:55.717961 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cdf4436-8ac2-49fb-be5c-5fa455f29ae1 None admin] REQUEST_METHOD: `GET` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:52:55.719455 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cdf4436-8ac2-49fb-be5c-5fa455f29ae1 None admin] SCRIPT_NAME: `/identity` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:52:55.719953 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cdf4436-8ac2-49fb-be5c-5fa455f29ae1 None admin] PATH_INFO: `/v3/domains/default` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:52:55.721473 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cdf4436-8ac2-49fb-be5c-5fa455f29ae1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:52:55.723306 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cdf4436-8ac2-49fb-be5c-5fa455f29ae1 None admin] RBAC: Authorization granted {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:52:55.725965 dv-cinder-851351-1-smb devstack@keystone.service[352328]: [pid: 352328|app: 0|req: 63/122] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 08:52:55 2022] GET /identity/v3/domains/default => generated 199 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:52:55.726988 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cdf4436-8ac2-49fb-be5c-5fa455f29ae1 None admin] Authenticating user token {{(pid=352328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:52:55.793212 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG dbcounter [-] [352328] Writing DB stats keystone:SELECT=100 {{(pid=352328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:52:55.839766 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cdf4436-8ac2-49fb-be5c-5fa455f29ae1 None admin] Validating token access rules against request {{(pid=352328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:52:55.841499 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a39330-d298-42c4-8aad-0baabcb4bc80 None admin] Validating token access rules against request {{(pid=352329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:52:55.877182 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8f6f6e-a1ef-4567-a625-70a84784b6c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:52:55.877968 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8f6f6e-a1ef-4567-a625-70a84784b6c4 None admin] REQUEST_METHOD: `GET` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:52:55.878323 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8f6f6e-a1ef-4567-a625-70a84784b6c4 None admin] SCRIPT_NAME: `/identity` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:52:55.878673 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8f6f6e-a1ef-4567-a625-70a84784b6c4 None admin] PATH_INFO: `/v3/roles/member` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:52:55.879300 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f50fcd-b274-44f6-95fc-e432f5bba8e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:52:55.880207 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f50fcd-b274-44f6-95fc-e432f5bba8e2 None admin] REQUEST_METHOD: `GET` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:52:55.880724 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f50fcd-b274-44f6-95fc-e432f5bba8e2 None admin] SCRIPT_NAME: `/identity` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:52:55.881244 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f50fcd-b274-44f6-95fc-e432f5bba8e2 None admin] PATH_INFO: `/v3/roles` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:52:55.882199 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43f50fcd-b274-44f6-95fc-e432f5bba8e2 None admin] RBAC: Adding query filter params (name=reader) {{(pid=352329) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:52:55.882753 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43f50fcd-b274-44f6-95fc-e432f5bba8e2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:52:55.884407 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43f50fcd-b274-44f6-95fc-e432f5bba8e2 None admin] RBAC: Authorization granted {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:52:55.890792 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c8f6f6e-a1ef-4567-a625-70a84784b6c4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 08:52:55.894464 dv-cinder-851351-1-smb devstack@keystone.service[352329]: [pid: 352329|app: 0|req: 60/123] 10.222.0.42 () {56 vars in 1101 bytes} [Thu Jul 28 08:52:55 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:52:55.895578 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f50fcd-b274-44f6-95fc-e432f5bba8e2 None admin] Authenticating user token {{(pid=352329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:52:55.895896 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application [None req-7c8f6f6e-a1ef-4567-a625-70a84784b6c4 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 28 08:52:55.895896 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:52:55.895896 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:52:55.895896 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:52:55.895896 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:52:55.895896 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:52:55.895896 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:52:55.895896 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:52:55.895896 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:52:55.895896 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:52:55.895896 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:52:55.895896 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:52:55.895896 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 08:52:55.895896 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 08:52:55.895896 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 08:52:55.895896 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 08:52:55.897033 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 08:52:55.897033 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 08:52:55.897033 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 08:52:55.897033 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 08:52:55.897033 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:52:55.897033 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:52:55.897033 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:52:55.897033 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:52:55.897033 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:52:55.897033 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:52:55.897033 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:52:55.897033 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application with Lock( Jul 28 08:52:55.897033 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:52:55.897033 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:52:55.897033 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:52:55.897033 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:52:55.898049 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:52:55.898049 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:52:55.898049 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:52:55.898049 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:52:55.898049 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 08:52:55.898049 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 08:52:55.898049 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 08:52:55.898049 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 08:52:55.898049 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 08:52:55.898049 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 08:52:55.898049 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 28 08:52:55.898049 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application Jul 28 08:52:55.898049 dv-cinder-851351-1-smb devstack@keystone.service[352328]: [pid: 352328|app: 0|req: 64/124] 10.222.0.42 () {56 vars in 1099 bytes} [Thu Jul 28 08:52:55 2022] GET /identity/v3/roles/member => generated 84 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:52:55.898049 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8f6f6e-a1ef-4567-a625-70a84784b6c4 None admin] Authenticating user token {{(pid=352328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:52:55.946658 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG dbcounter [-] [352329] Writing DB stats keystone:SELECT=100 {{(pid=352329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:52:56.011128 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8f6f6e-a1ef-4567-a625-70a84784b6c4 None admin] Validating token access rules against request {{(pid=352328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:52:56.014347 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f50fcd-b274-44f6-95fc-e432f5bba8e2 None admin] Validating token access rules against request {{(pid=352329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:52:56.033764 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG dbcounter [-] [352328] Writing DB stats keystone:SELECT=100 {{(pid=352328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:52:56.053743 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7730f530-6f3e-4640-a64b-2f810d4ad3a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:52:56.054394 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7730f530-6f3e-4640-a64b-2f810d4ad3a2 None admin] REQUEST_METHOD: `POST` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:52:56.054682 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7730f530-6f3e-4640-a64b-2f810d4ad3a2 None admin] SCRIPT_NAME: `/identity` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:52:56.054963 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7730f530-6f3e-4640-a64b-2f810d4ad3a2 None admin] PATH_INFO: `/v3/projects` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:52:56.055592 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12bd4d68-f675-4285-bc7f-082760c40440 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:52:56.055803 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7730f530-6f3e-4640-a64b-2f810d4ad3a2 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:52:56.057199 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7730f530-6f3e-4640-a64b-2f810d4ad3a2 None admin] RBAC: Authorization granted {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:52:56.057494 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12bd4d68-f675-4285-bc7f-082760c40440 None admin] REQUEST_METHOD: `GET` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:52:56.057997 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12bd4d68-f675-4285-bc7f-082760c40440 None admin] SCRIPT_NAME: `/identity` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:52:56.058499 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12bd4d68-f675-4285-bc7f-082760c40440 None admin] PATH_INFO: `/v3/roles` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:52:56.060068 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12bd4d68-f675-4285-bc7f-082760c40440 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=352329) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:52:56.060904 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12bd4d68-f675-4285-bc7f-082760c40440 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:52:56.062534 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12bd4d68-f675-4285-bc7f-082760c40440 None admin] RBAC: Authorization granted {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:52:56.072424 dv-cinder-851351-1-smb devstack@keystone.service[352329]: [pid: 352329|app: 0|req: 61/125] 10.222.0.42 () {56 vars in 1111 bytes} [Thu Jul 28 08:52:55 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:52:56.073945 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12bd4d68-f675-4285-bc7f-082760c40440 None admin] Authenticating user token {{(pid=352329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:52:56.096906 dv-cinder-851351-1-smb devstack@keystone.service[352328]: [pid: 352328|app: 0|req: 65/126] 10.222.0.42 () {60 vars in 1141 bytes} [Thu Jul 28 08:52:55 2022] POST /identity/v3/projects => generated 302 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 08:52:56.098310 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7730f530-6f3e-4640-a64b-2f810d4ad3a2 None admin] Authenticating user token {{(pid=352328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:52:56.184142 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG dbcounter [-] [352329] Writing DB stats keystone:SELECT=100 {{(pid=352329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:52:56.198759 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12bd4d68-f675-4285-bc7f-082760c40440 None admin] Validating token access rules against request {{(pid=352329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:52:56.235609 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa29b423-c035-4d9a-b0da-fa7d93e85014 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:52:56.236772 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa29b423-c035-4d9a-b0da-fa7d93e85014 None admin] REQUEST_METHOD: `GET` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:52:56.237293 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa29b423-c035-4d9a-b0da-fa7d93e85014 None admin] SCRIPT_NAME: `/identity` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:52:56.237794 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa29b423-c035-4d9a-b0da-fa7d93e85014 None admin] PATH_INFO: `/v3/users/6ecabd483e0c4baa8a96cf6e2a2eb9e9` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:52:56.254472 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa29b423-c035-4d9a-b0da-fa7d93e85014 None admin] RBAC: Authorizing `identity:get_user(user_id=6ecabd483e0c4baa8a96cf6e2a2eb9e9)` {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:52:56.256445 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa29b423-c035-4d9a-b0da-fa7d93e85014 None admin] RBAC: Authorization granted {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:52:56.258634 dv-cinder-851351-1-smb devstack@keystone.service[352329]: [pid: 352329|app: 0|req: 62/127] 10.222.0.42 () {56 vars in 1177 bytes} [Thu Jul 28 08:52:56 2022] GET /identity/v3/users/6ecabd483e0c4baa8a96cf6e2a2eb9e9 => generated 289 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:52:56.259803 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa29b423-c035-4d9a-b0da-fa7d93e85014 None admin] Authenticating user token {{(pid=352329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:52:56.281781 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7730f530-6f3e-4640-a64b-2f810d4ad3a2 None admin] Validating token access rules against request {{(pid=352328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:52:56.361131 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c47e2c-ee58-4303-aa43-a0ad9f68c71c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:52:56.362300 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c47e2c-ee58-4303-aa43-a0ad9f68c71c None admin] REQUEST_METHOD: `GET` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:52:56.362814 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c47e2c-ee58-4303-aa43-a0ad9f68c71c None admin] SCRIPT_NAME: `/identity` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:52:56.363528 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c47e2c-ee58-4303-aa43-a0ad9f68c71c None admin] PATH_INFO: `/v3/roles` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:52:56.365547 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0c47e2c-ee58-4303-aa43-a0ad9f68c71c None admin] RBAC: Adding query filter params (name=member) {{(pid=352328) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:52:56.366163 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0c47e2c-ee58-4303-aa43-a0ad9f68c71c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:52:56.367865 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0c47e2c-ee58-4303-aa43-a0ad9f68c71c None admin] RBAC: Authorization granted {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:52:56.393432 dv-cinder-851351-1-smb devstack@keystone.service[352328]: [pid: 352328|app: 0|req: 66/128] 10.222.0.42 () {56 vars in 1101 bytes} [Thu Jul 28 08:52:56 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 296 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:52:56.394576 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c47e2c-ee58-4303-aa43-a0ad9f68c71c None admin] Authenticating user token {{(pid=352328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:52:56.428324 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa29b423-c035-4d9a-b0da-fa7d93e85014 None admin] Validating token access rules against request {{(pid=352329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:52:56.446019 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG dbcounter [-] [352328] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=352328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:52:56.479405 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd45c9c4-626a-44ca-9ab8-41e901996e22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:52:56.479999 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd45c9c4-626a-44ca-9ab8-41e901996e22 None admin] REQUEST_METHOD: `GET` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:52:56.480536 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd45c9c4-626a-44ca-9ab8-41e901996e22 None admin] SCRIPT_NAME: `/identity` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:52:56.480880 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd45c9c4-626a-44ca-9ab8-41e901996e22 None admin] PATH_INFO: `/v3/users/dee261de1c2f4d11bec14593404de7a4` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:52:56.482833 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd45c9c4-626a-44ca-9ab8-41e901996e22 None admin] RBAC: Authorizing `identity:get_user(user_id=dee261de1c2f4d11bec14593404de7a4)` {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:52:56.485090 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd45c9c4-626a-44ca-9ab8-41e901996e22 None admin] RBAC: Authorization granted {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:52:56.487500 dv-cinder-851351-1-smb devstack@keystone.service[352329]: [pid: 352329|app: 0|req: 63/129] 10.222.0.42 () {56 vars in 1177 bytes} [Thu Jul 28 08:52:56 2022] GET /identity/v3/users/dee261de1c2f4d11bec14593404de7a4 => generated 275 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:52:56.488579 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd45c9c4-626a-44ca-9ab8-41e901996e22 None admin] Authenticating user token {{(pid=352329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:52:56.525981 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG dbcounter [-] [352329] Writing DB stats keystone:SELECT=100 {{(pid=352329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:52:56.543636 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c47e2c-ee58-4303-aa43-a0ad9f68c71c None admin] Validating token access rules against request {{(pid=352328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:52:56.598343 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2733f033-f328-496d-9efd-7aab7f3e1606 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:52:56.599001 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2733f033-f328-496d-9efd-7aab7f3e1606 None admin] REQUEST_METHOD: `GET` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:52:56.599295 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2733f033-f328-496d-9efd-7aab7f3e1606 None admin] SCRIPT_NAME: `/identity` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:52:56.599578 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2733f033-f328-496d-9efd-7aab7f3e1606 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:52:56.621148 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd45c9c4-626a-44ca-9ab8-41e901996e22 None admin] Validating token access rules against request {{(pid=352329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:52:56.681779 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a625cbc8-a023-4c04-b1af-ad584c1cedf4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:52:56.682487 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a625cbc8-a023-4c04-b1af-ad584c1cedf4 None admin] REQUEST_METHOD: `GET` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:52:56.682725 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a625cbc8-a023-4c04-b1af-ad584c1cedf4 None admin] SCRIPT_NAME: `/identity` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:52:56.683014 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a625cbc8-a023-4c04-b1af-ad584c1cedf4 None admin] PATH_INFO: `/v3/users/dee261de1c2f4d11bec14593404de7a4` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:52:56.686105 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a625cbc8-a023-4c04-b1af-ad584c1cedf4 None admin] RBAC: Authorizing `identity:get_user(user_id=dee261de1c2f4d11bec14593404de7a4)` {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:52:56.687599 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a625cbc8-a023-4c04-b1af-ad584c1cedf4 None admin] RBAC: Authorization granted {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:52:56.691108 dv-cinder-851351-1-smb devstack@keystone.service[352329]: [pid: 352329|app: 0|req: 64/130] 10.222.0.42 () {56 vars in 1177 bytes} [Thu Jul 28 08:52:56 2022] GET /identity/v3/users/dee261de1c2f4d11bec14593404de7a4 => generated 275 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:52:56.692022 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a625cbc8-a023-4c04-b1af-ad584c1cedf4 None admin] Authenticating user token {{(pid=352329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:52:56.743998 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2733f033-f328-496d-9efd-7aab7f3e1606 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:52:56.745480 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2733f033-f328-496d-9efd-7aab7f3e1606 None admin] RBAC: Authorization granted {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:52:56.790320 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG dbcounter [-] [352328] Writing DB stats keystone:SELECT=100 {{(pid=352328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:52:56.873941 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG dbcounter [-] [352329] Writing DB stats keystone:SELECT=100 {{(pid=352329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:52:56.886005 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a625cbc8-a023-4c04-b1af-ad584c1cedf4 None admin] Validating token access rules against request {{(pid=352329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:52:56.911275 dv-cinder-851351-1-smb devstack@keystone.service[352328]: [pid: 352328|app: 0|req: 67/131] 10.222.0.42 () {58 vars in 1282 bytes} [Thu Jul 28 08:52:56 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 517 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 28 08:52:56.911998 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2733f033-f328-496d-9efd-7aab7f3e1606 None admin] Authenticating user token {{(pid=352328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:52:56.934276 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e654bc26-8dc9-416e-bf45-8f89db63cd46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:52:56.935270 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e654bc26-8dc9-416e-bf45-8f89db63cd46 None admin] REQUEST_METHOD: `GET` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:52:56.935741 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e654bc26-8dc9-416e-bf45-8f89db63cd46 None admin] SCRIPT_NAME: `/identity` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:52:56.936196 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e654bc26-8dc9-416e-bf45-8f89db63cd46 None admin] PATH_INFO: `/v3/projects/9af593aec02c450aa4ce9c48ff4c6a1f` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:52:56.938126 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e654bc26-8dc9-416e-bf45-8f89db63cd46 None admin] RBAC: Authorizing `identity:get_project(project_id=9af593aec02c450aa4ce9c48ff4c6a1f)` {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:52:56.939935 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e654bc26-8dc9-416e-bf45-8f89db63cd46 None admin] RBAC: Authorization granted {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:52:56.945406 dv-cinder-851351-1-smb devstack@keystone.service[352329]: [pid: 352329|app: 0|req: 65/132] 10.222.0.42 () {56 vars in 1186 bytes} [Thu Jul 28 08:52:56 2022] GET /identity/v3/projects/9af593aec02c450aa4ce9c48ff4c6a1f => generated 298 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:52:56.946463 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e654bc26-8dc9-416e-bf45-8f89db63cd46 None admin] Authenticating user token {{(pid=352329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:52:57.116217 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2733f033-f328-496d-9efd-7aab7f3e1606 None admin] Validating token access rules against request {{(pid=352328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:52:57.149240 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG dbcounter [-] [352328] Writing DB stats keystone:SELECT=100 {{(pid=352328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:52:57.164235 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36436d5c-ce0f-46e1-9b32-0d0aa4aadc33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:52:57.164939 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36436d5c-ce0f-46e1-9b32-0d0aa4aadc33 None admin] REQUEST_METHOD: `GET` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:52:57.165230 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36436d5c-ce0f-46e1-9b32-0d0aa4aadc33 None admin] SCRIPT_NAME: `/identity` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:52:57.165510 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36436d5c-ce0f-46e1-9b32-0d0aa4aadc33 None admin] PATH_INFO: `/v3/projects/a177ed99903c46349a25c58aacd4f5b4` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:52:57.167469 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36436d5c-ce0f-46e1-9b32-0d0aa4aadc33 None admin] RBAC: Authorizing `identity:get_project(project_id=a177ed99903c46349a25c58aacd4f5b4)` {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:52:57.168977 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36436d5c-ce0f-46e1-9b32-0d0aa4aadc33 None admin] RBAC: Authorization granted {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:52:57.170719 dv-cinder-851351-1-smb devstack@keystone.service[352328]: [pid: 352328|app: 0|req: 68/133] 10.222.0.42 () {56 vars in 1186 bytes} [Thu Jul 28 08:52:56 2022] GET /identity/v3/projects/a177ed99903c46349a25c58aacd4f5b4 => generated 312 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:52:57.171482 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36436d5c-ce0f-46e1-9b32-0d0aa4aadc33 None admin] Authenticating user token {{(pid=352328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:52:57.206340 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e654bc26-8dc9-416e-bf45-8f89db63cd46 None admin] Validating token access rules against request {{(pid=352329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:52:57.265995 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a82058-268d-4053-9f45-e99262018036 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:52:57.267178 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a82058-268d-4053-9f45-e99262018036 None admin] REQUEST_METHOD: `GET` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:52:57.267861 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a82058-268d-4053-9f45-e99262018036 None admin] SCRIPT_NAME: `/identity` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:52:57.268344 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a82058-268d-4053-9f45-e99262018036 None admin] PATH_INFO: `/v3/projects/9af593aec02c450aa4ce9c48ff4c6a1f` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:52:57.273688 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29a82058-268d-4053-9f45-e99262018036 None admin] RBAC: Authorizing `identity:get_project(project_id=9af593aec02c450aa4ce9c48ff4c6a1f)` {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:52:57.275188 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29a82058-268d-4053-9f45-e99262018036 None admin] RBAC: Authorization granted {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:52:57.280651 dv-cinder-851351-1-smb devstack@keystone.service[352329]: [pid: 352329|app: 0|req: 66/134] 10.222.0.42 () {56 vars in 1186 bytes} [Thu Jul 28 08:52:56 2022] GET /identity/v3/projects/9af593aec02c450aa4ce9c48ff4c6a1f => generated 298 bytes in 331 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:52:57.280651 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a82058-268d-4053-9f45-e99262018036 None admin] Authenticating user token {{(pid=352329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:52:57.337950 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG dbcounter [-] [352329] Writing DB stats keystone:SELECT=100 {{(pid=352329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:52:57.338526 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36436d5c-ce0f-46e1-9b32-0d0aa4aadc33 None admin] Validating token access rules against request {{(pid=352328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:52:57.386411 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b7cf29-413e-4f97-a20e-90a85b556058 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:52:57.387428 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b7cf29-413e-4f97-a20e-90a85b556058 None admin] REQUEST_METHOD: `PUT` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:52:57.387892 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b7cf29-413e-4f97-a20e-90a85b556058 None admin] SCRIPT_NAME: `/identity` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:52:57.388402 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b7cf29-413e-4f97-a20e-90a85b556058 None admin] PATH_INFO: `/v3/projects/9af593aec02c450aa4ce9c48ff4c6a1f/users/dee261de1c2f4d11bec14593404de7a4/roles/a4fa43cd6d914398a0790a1516c83d08` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:52:57.391917 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93b7cf29-413e-4f97-a20e-90a85b556058 None admin] RBAC: Authorizing `identity:create_grant(project_id=9af593aec02c450aa4ce9c48ff4c6a1f, user_id=dee261de1c2f4d11bec14593404de7a4, role_id=a4fa43cd6d914398a0790a1516c83d08)` {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:52:57.394416 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93b7cf29-413e-4f97-a20e-90a85b556058 None admin] RBAC: Authorization granted {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:52:57.415483 dv-cinder-851351-1-smb devstack@keystone.service[352328]: [pid: 352328|app: 0|req: 69/135] 10.222.0.42 () {58 vars in 1439 bytes} [Thu Jul 28 08:52:57 2022] PUT /identity/v3/projects/9af593aec02c450aa4ce9c48ff4c6a1f/users/dee261de1c2f4d11bec14593404de7a4/roles/a4fa43cd6d914398a0790a1516c83d08 => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 08:52:57.416994 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b7cf29-413e-4f97-a20e-90a85b556058 None admin] Authenticating user token {{(pid=352328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:52:57.418980 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a82058-268d-4053-9f45-e99262018036 None admin] Validating token access rules against request {{(pid=352329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:52:57.471796 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30bcc26f-ef52-47c5-8b47-81ed91bc65d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:52:57.472531 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30bcc26f-ef52-47c5-8b47-81ed91bc65d8 None admin] REQUEST_METHOD: `PUT` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:52:57.472957 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30bcc26f-ef52-47c5-8b47-81ed91bc65d8 None admin] SCRIPT_NAME: `/identity` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:52:57.473248 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30bcc26f-ef52-47c5-8b47-81ed91bc65d8 None admin] PATH_INFO: `/v3/projects/a177ed99903c46349a25c58aacd4f5b4/users/dee261de1c2f4d11bec14593404de7a4/roles/16a3fc3aca974c47a329c2781b0be93a` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:52:57.476347 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30bcc26f-ef52-47c5-8b47-81ed91bc65d8 None admin] RBAC: Authorizing `identity:create_grant(project_id=a177ed99903c46349a25c58aacd4f5b4, user_id=dee261de1c2f4d11bec14593404de7a4, role_id=16a3fc3aca974c47a329c2781b0be93a)` {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:52:57.478100 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30bcc26f-ef52-47c5-8b47-81ed91bc65d8 None admin] RBAC: Authorization granted {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:52:57.496159 dv-cinder-851351-1-smb devstack@keystone.service[352329]: [pid: 352329|app: 0|req: 67/136] 10.222.0.42 () {58 vars in 1439 bytes} [Thu Jul 28 08:52:57 2022] PUT /identity/v3/projects/a177ed99903c46349a25c58aacd4f5b4/users/dee261de1c2f4d11bec14593404de7a4/roles/16a3fc3aca974c47a329c2781b0be93a => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 08:52:57.498018 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84692049-d80a-4c89-9f7d-1c7a6e8bfd0f None None] REQUEST_METHOD: `GET` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:52:57.498719 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84692049-d80a-4c89-9f7d-1c7a6e8bfd0f None None] SCRIPT_NAME: `/identity` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:52:57.499112 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84692049-d80a-4c89-9f7d-1c7a6e8bfd0f None None] PATH_INFO: `/` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:52:57.500783 dv-cinder-851351-1-smb devstack@keystone.service[352329]: [pid: 352329|app: 0|req: 68/137] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 08:52:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 08:52:57.507841 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75e79c4-2973-4ee8-8370-94b6851399d6 None None] REQUEST_METHOD: `POST` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:52:57.508109 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75e79c4-2973-4ee8-8370-94b6851399d6 None None] SCRIPT_NAME: `/identity` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:52:57.508392 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75e79c4-2973-4ee8-8370-94b6851399d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:52:57.531000 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.auth.core [None req-f75e79c4-2973-4ee8-8370-94b6851399d6 None None] MFA Rules not processed for user `d18c063b2377412485965357671e5506`. Rule list: `[]` (Enabled: `True`). {{(pid=352329) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 08:52:57.534014 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.fernet_utils [None req-f75e79c4-2973-4ee8-8370-94b6851399d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=352329) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:52:57.612567 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG dbcounter [-] [352328] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=352328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:52:57.672295 dv-cinder-851351-1-smb devstack@keystone.service[352329]: [pid: 352329|app: 0|req: 69/138] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 08:52:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 28 08:52:57.673996 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c805c02-8ad3-4e92-9f6c-c4f377de944e None None] REQUEST_METHOD: `GET` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:52:57.674345 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c805c02-8ad3-4e92-9f6c-c4f377de944e None None] SCRIPT_NAME: `/identity` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:52:57.674630 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c805c02-8ad3-4e92-9f6c-c4f377de944e None None] PATH_INFO: `/` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:52:57.678018 dv-cinder-851351-1-smb devstack@keystone.service[352329]: [pid: 352329|app: 0|req: 70/139] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 08:52:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 08:52:57.687487 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b7cf29-413e-4f97-a20e-90a85b556058 None admin] Validating token access rules against request {{(pid=352328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:52:57.697520 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7922c3-7eb8-403b-9c79-516cde9ac852 None None] REQUEST_METHOD: `POST` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:52:57.698112 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7922c3-7eb8-403b-9c79-516cde9ac852 None None] SCRIPT_NAME: `/identity` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:52:57.698112 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7922c3-7eb8-403b-9c79-516cde9ac852 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:52:57.725285 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.auth.core [None req-bd7922c3-7eb8-403b-9c79-516cde9ac852 None None] MFA Rules not processed for user `d18c063b2377412485965357671e5506`. Rule list: `[]` (Enabled: `True`). {{(pid=352329) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 08:52:57.726645 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.fernet_utils [None req-bd7922c3-7eb8-403b-9c79-516cde9ac852 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=352329) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:52:57.737108 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32681db-2394-45e0-91a0-73f6422bbdd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:52:57.737774 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32681db-2394-45e0-91a0-73f6422bbdd5 None admin] REQUEST_METHOD: `GET` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:52:57.738055 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32681db-2394-45e0-91a0-73f6422bbdd5 None admin] SCRIPT_NAME: `/identity` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:52:57.738330 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32681db-2394-45e0-91a0-73f6422bbdd5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:52:57.739149 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d32681db-2394-45e0-91a0-73f6422bbdd5 None admin] RBAC: Adding query filter params (role.id=3abd212955234654b7d9a8d7df33e380, scope.project.id=9af593aec02c450aa4ce9c48ff4c6a1f, user.id=6ecabd483e0c4baa8a96cf6e2a2eb9e9) {{(pid=352328) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:52:57.739461 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d32681db-2394-45e0-91a0-73f6422bbdd5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:52:57.740962 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d32681db-2394-45e0-91a0-73f6422bbdd5 None admin] RBAC: Authorization granted {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:52:57.749121 dv-cinder-851351-1-smb devstack@keystone.service[352328]: [pid: 352328|app: 0|req: 70/140] 10.222.0.42 () {56 vars in 1374 bytes} [Thu Jul 28 08:52:57 2022] GET /identity/v3/role_assignments?user.id=6ecabd483e0c4baa8a96cf6e2a2eb9e9&scope.project.id=9af593aec02c450aa4ce9c48ff4c6a1f&role.id=3abd212955234654b7d9a8d7df33e380 => generated 259 bytes in 333 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:52:57.751084 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32681db-2394-45e0-91a0-73f6422bbdd5 None admin] Authenticating user token {{(pid=352328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:52:57.752216 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG dbcounter [-] [352329] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=352329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:52:57.934090 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32681db-2394-45e0-91a0-73f6422bbdd5 None admin] Validating token access rules against request {{(pid=352328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:52:57.942902 dv-cinder-851351-1-smb devstack@keystone.service[352329]: [pid: 352329|app: 0|req: 71/141] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 08:52:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 247 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 08:52:57.983330 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG dbcounter [-] [352328] Writing DB stats keystone:SELECT=100 {{(pid=352328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:52:57.996183 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff51b88-02eb-4337-aab6-446a341d3103 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:52:57.997063 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff51b88-02eb-4337-aab6-446a341d3103 None admin] REQUEST_METHOD: `GET` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:52:57.997347 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff51b88-02eb-4337-aab6-446a341d3103 None admin] SCRIPT_NAME: `/identity` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:52:57.997625 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff51b88-02eb-4337-aab6-446a341d3103 None admin] PATH_INFO: `/v3/roles/member` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:52:58.015597 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff51b88-02eb-4337-aab6-446a341d3103 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 08:52:58.024010 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd7922c3-7eb8-403b-9c79-516cde9ac852 None None] Authenticating user token {{(pid=352329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:52:58.024174 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application [None req-3ff51b88-02eb-4337-aab6-446a341d3103 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 28 08:52:58.024174 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:52:58.024174 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:52:58.024174 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:52:58.024174 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:52:58.024174 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:52:58.024174 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:52:58.024174 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:52:58.024174 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:52:58.024174 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:52:58.024174 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:52:58.024174 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:52:58.024174 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 08:52:58.024174 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 08:52:58.024174 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 08:52:58.024174 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 08:52:58.025701 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 08:52:58.025701 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 08:52:58.025701 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 08:52:58.025701 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 08:52:58.025701 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:52:58.025701 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:52:58.025701 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:52:58.025701 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:52:58.025701 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:52:58.025701 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:52:58.025701 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:52:58.025701 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application with Lock( Jul 28 08:52:58.025701 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:52:58.025701 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:52:58.025701 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:52:58.025701 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:52:58.026857 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:52:58.026857 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:52:58.026857 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:52:58.026857 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:52:58.026857 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 08:52:58.026857 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 08:52:58.026857 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 08:52:58.026857 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 08:52:58.026857 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 08:52:58.026857 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 08:52:58.026857 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 28 08:52:58.026857 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application Jul 28 08:52:58.026857 dv-cinder-851351-1-smb devstack@keystone.service[352328]: [pid: 352328|app: 0|req: 71/142] 10.222.0.42 () {56 vars in 1099 bytes} [Thu Jul 28 08:52:57 2022] GET /identity/v3/roles/member => generated 84 bytes in 273 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:52:58.033838 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff51b88-02eb-4337-aab6-446a341d3103 None admin] Authenticating user token {{(pid=352328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:52:58.197365 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff51b88-02eb-4337-aab6-446a341d3103 None admin] Validating token access rules against request {{(pid=352328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:52:58.266422 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6bc6ca-999d-4482-a6b8-2a210f66ad51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:52:58.267532 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6bc6ca-999d-4482-a6b8-2a210f66ad51 None admin] REQUEST_METHOD: `GET` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:52:58.268049 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6bc6ca-999d-4482-a6b8-2a210f66ad51 None admin] SCRIPT_NAME: `/identity` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:52:58.268720 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6bc6ca-999d-4482-a6b8-2a210f66ad51 None admin] PATH_INFO: `/v3/roles` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:52:58.270101 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db6bc6ca-999d-4482-a6b8-2a210f66ad51 None admin] RBAC: Adding query filter params (name=member) {{(pid=352328) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:52:58.270602 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db6bc6ca-999d-4482-a6b8-2a210f66ad51 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:52:58.272392 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db6bc6ca-999d-4482-a6b8-2a210f66ad51 None admin] RBAC: Authorization granted {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:52:58.282627 dv-cinder-851351-1-smb devstack@keystone.service[352328]: [pid: 352328|app: 0|req: 72/143] 10.222.0.42 () {56 vars in 1101 bytes} [Thu Jul 28 08:52:58 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 08:52:58.287367 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd7922c3-7eb8-403b-9c79-516cde9ac852 None None] Validating token access rules against request {{(pid=352329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:52:58.290211 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6bc6ca-999d-4482-a6b8-2a210f66ad51 None admin] Authenticating user token {{(pid=352328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:52:58.364261 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4a0ffa-047a-4fcd-bc16-756bb3453470 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:52:58.365134 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4a0ffa-047a-4fcd-bc16-756bb3453470 None admin] REQUEST_METHOD: `GET` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:52:58.365526 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4a0ffa-047a-4fcd-bc16-756bb3453470 None admin] SCRIPT_NAME: `/identity` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:52:58.365907 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4a0ffa-047a-4fcd-bc16-756bb3453470 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:52:58.381101 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG dbcounter [-] [352328] Writing DB stats keystone:SELECT=100 {{(pid=352328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:52:58.383907 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb4a0ffa-047a-4fcd-bc16-756bb3453470 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 08:52:58.397310 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application [None req-fb4a0ffa-047a-4fcd-bc16-756bb3453470 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 08:52:58.397310 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:52:58.397310 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:52:58.397310 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:52:58.397310 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:52:58.397310 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:52:58.397310 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:52:58.397310 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:52:58.397310 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:52:58.397310 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:52:58.397310 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:52:58.397310 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:52:58.397310 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 08:52:58.397310 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 08:52:58.397310 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 08:52:58.397310 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 08:52:58.398624 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 08:52:58.398624 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 08:52:58.398624 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 08:52:58.398624 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 08:52:58.398624 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:52:58.398624 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:52:58.398624 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:52:58.398624 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:52:58.398624 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:52:58.398624 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:52:58.398624 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:52:58.398624 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application with Lock( Jul 28 08:52:58.398624 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:52:58.398624 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:52:58.398624 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:52:58.398624 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:52:58.400092 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:52:58.400092 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:52:58.400092 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:52:58.400092 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:52:58.400092 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 08:52:58.400092 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 08:52:58.400092 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 08:52:58.400092 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 08:52:58.400092 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 08:52:58.400092 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 08:52:58.400092 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 08:52:58.400092 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application Jul 28 08:52:58.400092 dv-cinder-851351-1-smb devstack@keystone.service[352329]: [pid: 352329|app: 0|req: 72/144] 10.222.0.42 () {56 vars in 1096 bytes} [Thu Jul 28 08:52:58 2022] GET /identity/v3/roles/admin => generated 83 bytes in 378 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:52:58.405583 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4a0ffa-047a-4fcd-bc16-756bb3453470 None admin] Authenticating user token {{(pid=352329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:52:58.437678 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG dbcounter [-] [352329] Writing DB stats keystone:SELECT=100 {{(pid=352329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:52:58.494098 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6bc6ca-999d-4482-a6b8-2a210f66ad51 None admin] Validating token access rules against request {{(pid=352328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:52:58.554845 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d760fa-4363-4b77-9ada-4fc1946e08b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:52:58.556123 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d760fa-4363-4b77-9ada-4fc1946e08b8 None admin] REQUEST_METHOD: `GET` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:52:58.557991 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d760fa-4363-4b77-9ada-4fc1946e08b8 None admin] SCRIPT_NAME: `/identity` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:52:58.558510 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d760fa-4363-4b77-9ada-4fc1946e08b8 None admin] PATH_INFO: `/v3/users/dee261de1c2f4d11bec14593404de7a4` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:52:58.561135 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d760fa-4363-4b77-9ada-4fc1946e08b8 None admin] RBAC: Authorizing `identity:get_user(user_id=dee261de1c2f4d11bec14593404de7a4)` {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:52:58.563684 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d760fa-4363-4b77-9ada-4fc1946e08b8 None admin] RBAC: Authorization granted {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:52:58.567328 dv-cinder-851351-1-smb devstack@keystone.service[352328]: [pid: 352328|app: 0|req: 73/145] 10.222.0.42 () {56 vars in 1177 bytes} [Thu Jul 28 08:52:58 2022] GET /identity/v3/users/dee261de1c2f4d11bec14593404de7a4 => generated 275 bytes in 279 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 08:52:58.576332 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d760fa-4363-4b77-9ada-4fc1946e08b8 None admin] Authenticating user token {{(pid=352328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:52:58.607676 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4a0ffa-047a-4fcd-bc16-756bb3453470 None admin] Validating token access rules against request {{(pid=352329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:52:58.675726 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57982062-b94d-417a-aabf-5113889a3c03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:52:58.676821 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57982062-b94d-417a-aabf-5113889a3c03 None admin] REQUEST_METHOD: `GET` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:52:58.677117 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57982062-b94d-417a-aabf-5113889a3c03 None admin] SCRIPT_NAME: `/identity` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:52:58.677395 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57982062-b94d-417a-aabf-5113889a3c03 None admin] PATH_INFO: `/v3/roles` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:52:58.678423 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57982062-b94d-417a-aabf-5113889a3c03 None admin] RBAC: Adding query filter params (name=admin) {{(pid=352329) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:52:58.678739 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57982062-b94d-417a-aabf-5113889a3c03 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:52:58.680428 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57982062-b94d-417a-aabf-5113889a3c03 None admin] RBAC: Authorization granted {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:52:58.698372 dv-cinder-851351-1-smb devstack@keystone.service[352329]: [pid: 352329|app: 0|req: 73/146] 10.222.0.42 () {56 vars in 1099 bytes} [Thu Jul 28 08:52:58 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 293 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 08:52:58.705975 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57982062-b94d-417a-aabf-5113889a3c03 None admin] Authenticating user token {{(pid=352329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:52:58.743762 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d760fa-4363-4b77-9ada-4fc1946e08b8 None admin] Validating token access rules against request {{(pid=352328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:52:58.774190 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG dbcounter [-] [352328] Writing DB stats keystone:SELECT=100 {{(pid=352328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:52:58.814668 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG dbcounter [-] [352329] Writing DB stats keystone:SELECT=100 {{(pid=352329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:52:58.829748 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4c9abf-ef4e-42c3-8ee4-0b4b631cc03f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:52:58.830481 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4c9abf-ef4e-42c3-8ee4-0b4b631cc03f None admin] REQUEST_METHOD: `GET` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:52:58.830775 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4c9abf-ef4e-42c3-8ee4-0b4b631cc03f None admin] SCRIPT_NAME: `/identity` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:52:58.831060 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4c9abf-ef4e-42c3-8ee4-0b4b631cc03f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:52:58.850980 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57982062-b94d-417a-aabf-5113889a3c03 None admin] Validating token access rules against request {{(pid=352329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:52:58.887790 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc53e2e-41c1-44a4-af70-9dc4ac48fea7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:52:58.888946 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc53e2e-41c1-44a4-af70-9dc4ac48fea7 None admin] REQUEST_METHOD: `GET` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:52:58.889460 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc53e2e-41c1-44a4-af70-9dc4ac48fea7 None admin] SCRIPT_NAME: `/identity` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:52:58.889957 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc53e2e-41c1-44a4-af70-9dc4ac48fea7 None admin] PATH_INFO: `/v3/users/d18c063b2377412485965357671e5506` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:52:58.891396 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bc53e2e-41c1-44a4-af70-9dc4ac48fea7 None admin] RBAC: Authorizing `identity:get_user(user_id=d18c063b2377412485965357671e5506)` {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:52:58.893340 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bc53e2e-41c1-44a4-af70-9dc4ac48fea7 None admin] RBAC: Authorization granted {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:52:58.895659 dv-cinder-851351-1-smb devstack@keystone.service[352329]: [pid: 352329|app: 0|req: 74/147] 10.222.0.42 () {56 vars in 1177 bytes} [Thu Jul 28 08:52:58 2022] GET /identity/v3/users/d18c063b2377412485965357671e5506 => generated 247 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 08:52:58.902211 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc53e2e-41c1-44a4-af70-9dc4ac48fea7 None admin] Authenticating user token {{(pid=352329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:52:58.910815 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de4c9abf-ef4e-42c3-8ee4-0b4b631cc03f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:52:58.912316 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de4c9abf-ef4e-42c3-8ee4-0b4b631cc03f None admin] RBAC: Authorization granted {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:52:59.022267 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc53e2e-41c1-44a4-af70-9dc4ac48fea7 None admin] Validating token access rules against request {{(pid=352329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:52:59.060839 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd17822-09f3-4a46-a45d-8c689cc3f8b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:52:59.061859 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd17822-09f3-4a46-a45d-8c689cc3f8b8 None admin] REQUEST_METHOD: `GET` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:52:59.062392 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd17822-09f3-4a46-a45d-8c689cc3f8b8 None admin] SCRIPT_NAME: `/identity` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:52:59.062902 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd17822-09f3-4a46-a45d-8c689cc3f8b8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:52:59.079986 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG dbcounter [-] [352329] Writing DB stats keystone:SELECT=100 {{(pid=352329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:52:59.123717 dv-cinder-851351-1-smb devstack@keystone.service[352328]: [pid: 352328|app: 0|req: 74/148] 10.222.0.42 () {58 vars in 1282 bytes} [Thu Jul 28 08:52:58 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 544 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 28 08:52:59.123717 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39910114-8ac5-4a13-a467-c1fda4f31950 None None] REQUEST_METHOD: `GET` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:52:59.123717 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39910114-8ac5-4a13-a467-c1fda4f31950 None None] SCRIPT_NAME: `/identity` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:52:59.123717 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39910114-8ac5-4a13-a467-c1fda4f31950 None None] PATH_INFO: `/` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:52:59.123717 dv-cinder-851351-1-smb devstack@keystone.service[352328]: [pid: 352328|app: 0|req: 75/149] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 08:52:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 08:52:59.129188 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b72c90a-e64a-4902-beff-5802f98bd3e2 None None] REQUEST_METHOD: `POST` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:52:59.129481 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b72c90a-e64a-4902-beff-5802f98bd3e2 None None] SCRIPT_NAME: `/identity` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:52:59.129769 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b72c90a-e64a-4902-beff-5802f98bd3e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:52:59.150339 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.auth.core [None req-0b72c90a-e64a-4902-beff-5802f98bd3e2 None None] MFA Rules not processed for user `d18c063b2377412485965357671e5506`. Rule list: `[]` (Enabled: `True`). {{(pid=352328) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 08:52:59.151595 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.fernet_utils [None req-0b72c90a-e64a-4902-beff-5802f98bd3e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=352328) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:52:59.162468 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG dbcounter [-] [352328] Writing DB stats keystone:SELECT=100 {{(pid=352328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:52:59.169045 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bd17822-09f3-4a46-a45d-8c689cc3f8b8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:52:59.171262 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bd17822-09f3-4a46-a45d-8c689cc3f8b8 None admin] RBAC: Authorization granted {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:52:59.223081 dv-cinder-851351-1-smb devstack@keystone.service[352328]: [pid: 352328|app: 0|req: 76/150] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 08:52:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 28 08:52:59.224002 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b72c90a-e64a-4902-beff-5802f98bd3e2 None None] Authenticating user token {{(pid=352328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:52:59.298655 dv-cinder-851351-1-smb devstack@keystone.service[352329]: [pid: 352329|app: 0|req: 75/151] 10.222.0.42 () {58 vars in 1282 bytes} [Thu Jul 28 08:52:58 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 397 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 28 08:52:59.300059 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd17822-09f3-4a46-a45d-8c689cc3f8b8 None admin] Authenticating user token {{(pid=352329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:52:59.353132 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b72c90a-e64a-4902-beff-5802f98bd3e2 None None] Validating token access rules against request {{(pid=352328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:52:59.361969 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG dbcounter [-] [352329] Writing DB stats keystone:SELECT=100 {{(pid=352329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:52:59.415209 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8dd44dc-93e8-45f1-a425-4d0b3b0a40ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:52:59.415883 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8dd44dc-93e8-45f1-a425-4d0b3b0a40ed None admin] REQUEST_METHOD: `GET` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:52:59.416167 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8dd44dc-93e8-45f1-a425-4d0b3b0a40ed None admin] SCRIPT_NAME: `/identity` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:52:59.416445 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8dd44dc-93e8-45f1-a425-4d0b3b0a40ed None admin] PATH_INFO: `/v3/projects/9af593aec02c450aa4ce9c48ff4c6a1f` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:52:59.420770 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8dd44dc-93e8-45f1-a425-4d0b3b0a40ed None admin] RBAC: Authorizing `identity:get_project(project_id=9af593aec02c450aa4ce9c48ff4c6a1f)` {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:52:59.422269 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8dd44dc-93e8-45f1-a425-4d0b3b0a40ed None admin] RBAC: Authorization granted {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:52:59.424034 dv-cinder-851351-1-smb devstack@keystone.service[352328]: [pid: 352328|app: 0|req: 77/152] 10.222.0.42 () {56 vars in 1186 bytes} [Thu Jul 28 08:52:59 2022] GET /identity/v3/projects/9af593aec02c450aa4ce9c48ff4c6a1f => generated 298 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:52:59.424841 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8dd44dc-93e8-45f1-a425-4d0b3b0a40ed None admin] Authenticating user token {{(pid=352328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:52:59.457428 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG dbcounter [-] [352328] Writing DB stats keystone:SELECT=100 {{(pid=352328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:52:59.472224 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd17822-09f3-4a46-a45d-8c689cc3f8b8 None admin] Validating token access rules against request {{(pid=352329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:52:59.520937 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4276b8-7ba5-4ced-86a2-3418532c8af9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:52:59.521968 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4276b8-7ba5-4ced-86a2-3418532c8af9 None admin] REQUEST_METHOD: `GET` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:52:59.522510 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4276b8-7ba5-4ced-86a2-3418532c8af9 None admin] SCRIPT_NAME: `/identity` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:52:59.522959 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4276b8-7ba5-4ced-86a2-3418532c8af9 None admin] PATH_INFO: `/v3/domains/default` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:52:59.525694 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e4276b8-7ba5-4ced-86a2-3418532c8af9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:52:59.527403 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e4276b8-7ba5-4ced-86a2-3418532c8af9 None admin] RBAC: Authorization granted {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:52:59.530935 dv-cinder-851351-1-smb devstack@keystone.service[352329]: [pid: 352329|app: 0|req: 76/153] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 08:52:59 2022] GET /identity/v3/domains/default => generated 199 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:52:59.537634 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4276b8-7ba5-4ced-86a2-3418532c8af9 None admin] Authenticating user token {{(pid=352329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:52:59.670617 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4276b8-7ba5-4ced-86a2-3418532c8af9 None admin] Validating token access rules against request {{(pid=352329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:52:59.670924 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8dd44dc-93e8-45f1-a425-4d0b3b0a40ed None admin] Validating token access rules against request {{(pid=352328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:52:59.684119 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG dbcounter [-] [352329] Writing DB stats keystone:SELECT=100 {{(pid=352329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:52:59.712878 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df8a2b8-0158-4213-877b-49c1b7661876 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:52:59.714288 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df8a2b8-0158-4213-877b-49c1b7661876 None admin] REQUEST_METHOD: `GET` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:52:59.714747 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df8a2b8-0158-4213-877b-49c1b7661876 None admin] SCRIPT_NAME: `/identity` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:52:59.715196 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df8a2b8-0158-4213-877b-49c1b7661876 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:52:59.716176 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4df8a2b8-0158-4213-877b-49c1b7661876 None admin] RBAC: Adding query filter params (role.id=16a3fc3aca974c47a329c2781b0be93a, scope.project.id=9af593aec02c450aa4ce9c48ff4c6a1f, user.id=dee261de1c2f4d11bec14593404de7a4) {{(pid=352329) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:52:59.716764 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4df8a2b8-0158-4213-877b-49c1b7661876 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:52:59.718478 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4df8a2b8-0158-4213-877b-49c1b7661876 None admin] RBAC: Authorization granted {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:52:59.725205 dv-cinder-851351-1-smb devstack@keystone.service[352329]: [pid: 352329|app: 0|req: 77/154] 10.222.0.42 () {56 vars in 1374 bytes} [Thu Jul 28 08:52:59 2022] GET /identity/v3/role_assignments?user.id=dee261de1c2f4d11bec14593404de7a4&scope.project.id=9af593aec02c450aa4ce9c48ff4c6a1f&role.id=16a3fc3aca974c47a329c2781b0be93a => generated 608 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:52:59.726274 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df8a2b8-0158-4213-877b-49c1b7661876 None admin] Authenticating user token {{(pid=352329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:52:59.770867 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b26b813-b90d-4195-8e8c-67d4b9903729 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:52:59.771557 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b26b813-b90d-4195-8e8c-67d4b9903729 None admin] REQUEST_METHOD: `GET` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:52:59.771841 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b26b813-b90d-4195-8e8c-67d4b9903729 None admin] SCRIPT_NAME: `/identity` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:52:59.772117 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b26b813-b90d-4195-8e8c-67d4b9903729 None admin] PATH_INFO: `/v3/projects/9af593aec02c450aa4ce9c48ff4c6a1f` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:52:59.777882 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b26b813-b90d-4195-8e8c-67d4b9903729 None admin] RBAC: Authorizing `identity:get_project(project_id=9af593aec02c450aa4ce9c48ff4c6a1f)` {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:52:59.779158 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b26b813-b90d-4195-8e8c-67d4b9903729 None admin] RBAC: Authorization granted {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:52:59.781198 dv-cinder-851351-1-smb devstack@keystone.service[352328]: [pid: 352328|app: 0|req: 78/155] 10.222.0.42 () {56 vars in 1186 bytes} [Thu Jul 28 08:52:59 2022] GET /identity/v3/projects/9af593aec02c450aa4ce9c48ff4c6a1f => generated 298 bytes in 356 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:52:59.787398 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b26b813-b90d-4195-8e8c-67d4b9903729 None admin] Authenticating user token {{(pid=352328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:52:59.844118 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df8a2b8-0158-4213-877b-49c1b7661876 None admin] Validating token access rules against request {{(pid=352329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:52:59.885030 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bceae9b-597e-4a9d-9155-8bd199fa8ae0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:52:59.886045 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bceae9b-597e-4a9d-9155-8bd199fa8ae0 None admin] REQUEST_METHOD: `POST` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:52:59.886602 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bceae9b-597e-4a9d-9155-8bd199fa8ae0 None admin] SCRIPT_NAME: `/identity` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:52:59.887058 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bceae9b-597e-4a9d-9155-8bd199fa8ae0 None admin] PATH_INFO: `/v3/users` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:52:59.887949 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bceae9b-597e-4a9d-9155-8bd199fa8ae0 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:52:59.889678 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bceae9b-597e-4a9d-9155-8bd199fa8ae0 None admin] RBAC: Authorization granted {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:52:59.924400 dv-cinder-851351-1-smb devstack@keystone.service[352329]: [pid: 352329|app: 0|req: 78/156] 10.222.0.42 () {60 vars in 1132 bytes} [Thu Jul 28 08:52:59 2022] POST /identity/v3/users => generated 283 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 08:52:59.989093 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG dbcounter [-] [352328] Writing DB stats keystone:SELECT=100 {{(pid=352328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:53:00.012544 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b26b813-b90d-4195-8e8c-67d4b9903729 None admin] Validating token access rules against request {{(pid=352328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:53:00.064965 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9682b215-04fd-48e9-91a9-10daee2a28e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:53:00.065984 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9682b215-04fd-48e9-91a9-10daee2a28e4 None admin] REQUEST_METHOD: `GET` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:53:00.066559 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9682b215-04fd-48e9-91a9-10daee2a28e4 None admin] SCRIPT_NAME: `/identity` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:53:00.067275 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9682b215-04fd-48e9-91a9-10daee2a28e4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:53:00.068618 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9682b215-04fd-48e9-91a9-10daee2a28e4 None admin] RBAC: Adding query filter params (role.id=280023171b4a45efb67c036ff237bb3c, scope.project.id=9af593aec02c450aa4ce9c48ff4c6a1f, user.id=d18c063b2377412485965357671e5506) {{(pid=352328) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:53:00.069542 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9682b215-04fd-48e9-91a9-10daee2a28e4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:53:00.074041 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9682b215-04fd-48e9-91a9-10daee2a28e4 None admin] RBAC: Authorization granted {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:53:00.090521 dv-cinder-851351-1-smb devstack@keystone.service[352328]: [pid: 352328|app: 0|req: 79/157] 10.222.0.42 () {56 vars in 1374 bytes} [Thu Jul 28 08:52:59 2022] GET /identity/v3/role_assignments?user.id=d18c063b2377412485965357671e5506&scope.project.id=9af593aec02c450aa4ce9c48ff4c6a1f&role.id=280023171b4a45efb67c036ff237bb3c => generated 608 bytes in 304 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 08:53:00.287932 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1626022f-2748-465a-a849-7cc7872dc7a4 None None] REQUEST_METHOD: `GET` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:53:00.288154 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1626022f-2748-465a-a849-7cc7872dc7a4 None None] SCRIPT_NAME: `/identity` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:53:00.288405 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1626022f-2748-465a-a849-7cc7872dc7a4 None None] PATH_INFO: `/` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:53:00.289879 dv-cinder-851351-1-smb devstack@keystone.service[352329]: [pid: 352329|app: 0|req: 79/158] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 08:53:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 08:53:00.296021 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f23e12-e150-4ce3-9130-850c30505551 None None] REQUEST_METHOD: `POST` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:53:00.296625 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f23e12-e150-4ce3-9130-850c30505551 None None] SCRIPT_NAME: `/identity` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:53:00.297116 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f23e12-e150-4ce3-9130-850c30505551 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:53:00.318425 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.auth.core [None req-94f23e12-e150-4ce3-9130-850c30505551 None None] MFA Rules not processed for user `d18c063b2377412485965357671e5506`. Rule list: `[]` (Enabled: `True`). {{(pid=352328) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 08:53:00.319925 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.fernet_utils [None req-94f23e12-e150-4ce3-9130-850c30505551 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=352328) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:53:00.407089 dv-cinder-851351-1-smb devstack@keystone.service[352328]: [pid: 352328|app: 0|req: 80/159] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 08:53:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 08:53:00.423524 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2a48f4-3d5e-4d27-bc63-1f08f163580b None None] REQUEST_METHOD: `GET` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:53:00.424280 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2a48f4-3d5e-4d27-bc63-1f08f163580b None None] SCRIPT_NAME: `/identity` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:53:00.424556 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2a48f4-3d5e-4d27-bc63-1f08f163580b None None] PATH_INFO: `/` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:53:00.426029 dv-cinder-851351-1-smb devstack@keystone.service[352329]: [pid: 352329|app: 0|req: 80/160] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 08:53:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 08:53:00.432842 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f395b4-7c66-45ee-a588-0e8fea6aea76 None None] REQUEST_METHOD: `POST` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:53:00.433398 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f395b4-7c66-45ee-a588-0e8fea6aea76 None None] SCRIPT_NAME: `/identity` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:53:00.433861 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f395b4-7c66-45ee-a588-0e8fea6aea76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:53:00.435784 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2a48f4-3d5e-4d27-bc63-1f08f163580b None None] Authenticating user token {{(pid=352329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:53:00.455950 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.auth.core [None req-93f395b4-7c66-45ee-a588-0e8fea6aea76 None None] MFA Rules not processed for user `d18c063b2377412485965357671e5506`. Rule list: `[]` (Enabled: `True`). {{(pid=352328) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 08:53:00.457337 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.fernet_utils [None req-93f395b4-7c66-45ee-a588-0e8fea6aea76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=352328) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:53:00.483070 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG dbcounter [-] [352329] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=352329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:53:00.549631 dv-cinder-851351-1-smb devstack@keystone.service[352328]: [pid: 352328|app: 0|req: 81/161] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 08:53:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 08:53:00.572728 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f395b4-7c66-45ee-a588-0e8fea6aea76 None None] Authenticating user token {{(pid=352328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:53:00.576818 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG dbcounter [-] [352328] Writing DB stats keystone:SELECT=100 {{(pid=352328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:53:00.586449 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2a48f4-3d5e-4d27-bc63-1f08f163580b None None] Validating token access rules against request {{(pid=352329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:53:00.622614 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21db881-7790-4ade-93b3-d4e94077f5a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:53:00.623308 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21db881-7790-4ade-93b3-d4e94077f5a9 None admin] REQUEST_METHOD: `GET` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:53:00.623591 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21db881-7790-4ade-93b3-d4e94077f5a9 None admin] SCRIPT_NAME: `/identity` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:53:00.623866 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21db881-7790-4ade-93b3-d4e94077f5a9 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:53:00.636317 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e21db881-7790-4ade-93b3-d4e94077f5a9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 08:53:00.642179 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application [None req-e21db881-7790-4ade-93b3-d4e94077f5a9 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 28 08:53:00.642179 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:53:00.642179 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:53:00.642179 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:53:00.642179 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:53:00.642179 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:53:00.642179 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:53:00.642179 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:53:00.642179 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:53:00.642179 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:53:00.642179 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:53:00.642179 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:53:00.642179 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 08:53:00.642179 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 08:53:00.642179 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 08:53:00.642179 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 08:53:00.643562 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 08:53:00.643562 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 08:53:00.643562 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 08:53:00.643562 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 08:53:00.643562 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:53:00.643562 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:53:00.643562 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:53:00.643562 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:53:00.643562 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:53:00.643562 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:53:00.643562 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:53:00.643562 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application with Lock( Jul 28 08:53:00.643562 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:53:00.643562 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:53:00.643562 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:53:00.643562 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:53:00.644820 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:53:00.644820 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:53:00.644820 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:53:00.644820 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:53:00.644820 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 08:53:00.644820 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 08:53:00.644820 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 08:53:00.644820 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 08:53:00.644820 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 08:53:00.644820 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 08:53:00.644820 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 28 08:53:00.644820 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application Jul 28 08:53:00.650663 dv-cinder-851351-1-smb devstack@keystone.service[352329]: [pid: 352329|app: 0|req: 81/162] 10.222.0.42 () {56 vars in 1114 bytes} [Thu Jul 28 08:53:00 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:53:00.650663 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21db881-7790-4ade-93b3-d4e94077f5a9 None admin] Authenticating user token {{(pid=352329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:53:00.698978 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f395b4-7c66-45ee-a588-0e8fea6aea76 None None] Validating token access rules against request {{(pid=352328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:53:00.739133 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b98c296-d7a4-4702-bba2-66d63b79c916 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:53:00.739971 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b98c296-d7a4-4702-bba2-66d63b79c916 None admin] REQUEST_METHOD: `GET` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:53:00.740366 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b98c296-d7a4-4702-bba2-66d63b79c916 None admin] SCRIPT_NAME: `/identity` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:53:00.740782 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b98c296-d7a4-4702-bba2-66d63b79c916 None admin] PATH_INFO: `/v3/roles/member` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:53:00.753206 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b98c296-d7a4-4702-bba2-66d63b79c916 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 08:53:00.753851 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG dbcounter [-] [352329] Writing DB stats keystone:SELECT=100 {{(pid=352329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:53:00.758731 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application [None req-8b98c296-d7a4-4702-bba2-66d63b79c916 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 28 08:53:00.758731 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:53:00.758731 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:53:00.758731 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:53:00.758731 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:53:00.758731 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:53:00.758731 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:53:00.758731 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:53:00.758731 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:53:00.758731 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:53:00.758731 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:53:00.758731 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:53:00.758731 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 08:53:00.758731 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 08:53:00.758731 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 08:53:00.758731 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 08:53:00.759885 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 08:53:00.759885 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 08:53:00.759885 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 08:53:00.759885 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 08:53:00.759885 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:53:00.759885 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:53:00.759885 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:53:00.759885 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:53:00.759885 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:53:00.759885 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:53:00.759885 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:53:00.759885 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application with Lock( Jul 28 08:53:00.759885 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:53:00.759885 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:53:00.759885 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:53:00.759885 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:53:00.760953 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:53:00.760953 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:53:00.760953 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:53:00.760953 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:53:00.760953 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 08:53:00.760953 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 08:53:00.760953 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 08:53:00.760953 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 08:53:00.760953 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 08:53:00.760953 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 08:53:00.760953 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 28 08:53:00.760953 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application Jul 28 08:53:00.760953 dv-cinder-851351-1-smb devstack@keystone.service[352328]: [pid: 352328|app: 0|req: 82/163] 10.222.0.42 () {56 vars in 1099 bytes} [Thu Jul 28 08:53:00 2022] GET /identity/v3/roles/member => generated 84 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 08:53:00.770758 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21db881-7790-4ade-93b3-d4e94077f5a9 None admin] Validating token access rules against request {{(pid=352329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:53:00.775306 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b98c296-d7a4-4702-bba2-66d63b79c916 None admin] Authenticating user token {{(pid=352328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:53:00.809273 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-030c3112-394d-47ff-8eb7-a8f91705d452 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:53:00.809786 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030c3112-394d-47ff-8eb7-a8f91705d452 None admin] REQUEST_METHOD: `GET` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:53:00.810069 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030c3112-394d-47ff-8eb7-a8f91705d452 None admin] SCRIPT_NAME: `/identity` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:53:00.810357 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030c3112-394d-47ff-8eb7-a8f91705d452 None admin] PATH_INFO: `/v3/roles` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:53:00.811082 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-030c3112-394d-47ff-8eb7-a8f91705d452 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=352329) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:53:00.811392 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-030c3112-394d-47ff-8eb7-a8f91705d452 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:53:00.813714 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-030c3112-394d-47ff-8eb7-a8f91705d452 None admin] RBAC: Authorization granted {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:53:00.824770 dv-cinder-851351-1-smb devstack@keystone.service[352329]: [pid: 352329|app: 0|req: 82/164] 10.222.0.42 () {56 vars in 1111 bytes} [Thu Jul 28 08:53:00 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 08:53:00.826508 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e833809f-e0b8-4a43-b71a-40b15b4562b2 None None] REQUEST_METHOD: `GET` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:53:00.826801 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e833809f-e0b8-4a43-b71a-40b15b4562b2 None None] SCRIPT_NAME: `/identity` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:53:00.827082 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e833809f-e0b8-4a43-b71a-40b15b4562b2 None None] PATH_INFO: `/` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:53:00.828603 dv-cinder-851351-1-smb devstack@keystone.service[352329]: [pid: 352329|app: 0|req: 83/165] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 08:53:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 08:53:00.829772 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e833809f-e0b8-4a43-b71a-40b15b4562b2 None None] Authenticating user token {{(pid=352329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:53:00.875719 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG dbcounter [-] [352328] Writing DB stats keystone:SELECT=100 {{(pid=352328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:53:00.925763 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b98c296-d7a4-4702-bba2-66d63b79c916 None admin] Validating token access rules against request {{(pid=352328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:53:00.963940 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e833809f-e0b8-4a43-b71a-40b15b4562b2 None None] Validating token access rules against request {{(pid=352329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:53:00.972966 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6fa9f33-affd-4980-a409-9e3d66ff3b64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:53:00.973616 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6fa9f33-affd-4980-a409-9e3d66ff3b64 None admin] REQUEST_METHOD: `GET` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:53:00.973902 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6fa9f33-affd-4980-a409-9e3d66ff3b64 None admin] SCRIPT_NAME: `/identity` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:53:00.974179 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6fa9f33-affd-4980-a409-9e3d66ff3b64 None admin] PATH_INFO: `/v3/roles` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:53:00.975405 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6fa9f33-affd-4980-a409-9e3d66ff3b64 None admin] RBAC: Adding query filter params (name=member) {{(pid=352328) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:53:00.975719 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6fa9f33-affd-4980-a409-9e3d66ff3b64 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:53:00.977914 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6fa9f33-affd-4980-a409-9e3d66ff3b64 None admin] RBAC: Authorization granted {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:53:00.990413 dv-cinder-851351-1-smb devstack@keystone.service[352328]: [pid: 352328|app: 0|req: 83/166] 10.222.0.42 () {56 vars in 1101 bytes} [Thu Jul 28 08:53:00 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:53:00.991849 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def4c621-52ba-46e9-85ab-32e5b1e09e85 None None] REQUEST_METHOD: `POST` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:53:00.992363 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def4c621-52ba-46e9-85ab-32e5b1e09e85 None None] SCRIPT_NAME: `/identity` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:53:00.992641 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def4c621-52ba-46e9-85ab-32e5b1e09e85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:53:01.001837 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5afa6e37-ebda-456d-b92b-46c086696d69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:53:01.002640 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5afa6e37-ebda-456d-b92b-46c086696d69 None admin] REQUEST_METHOD: `GET` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:53:01.002982 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5afa6e37-ebda-456d-b92b-46c086696d69 None admin] SCRIPT_NAME: `/identity` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:53:01.003327 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5afa6e37-ebda-456d-b92b-46c086696d69 None admin] PATH_INFO: `/v3/users/dee261de1c2f4d11bec14593404de7a4` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:53:01.004697 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5afa6e37-ebda-456d-b92b-46c086696d69 None admin] RBAC: Authorizing `identity:get_user(user_id=dee261de1c2f4d11bec14593404de7a4)` {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:53:01.011383 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5afa6e37-ebda-456d-b92b-46c086696d69 None admin] RBAC: Authorization granted {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:53:01.014318 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.auth.core [None req-def4c621-52ba-46e9-85ab-32e5b1e09e85 None None] MFA Rules not processed for user `d18c063b2377412485965357671e5506`. Rule list: `[]` (Enabled: `True`). {{(pid=352328) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 08:53:01.015542 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.fernet_utils [None req-def4c621-52ba-46e9-85ab-32e5b1e09e85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=352328) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:53:01.022171 dv-cinder-851351-1-smb devstack@keystone.service[352329]: [pid: 352329|app: 0|req: 84/167] 10.222.0.42 () {56 vars in 1177 bytes} [Thu Jul 28 08:53:00 2022] GET /identity/v3/users/dee261de1c2f4d11bec14593404de7a4 => generated 275 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:53:01.022498 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5afa6e37-ebda-456d-b92b-46c086696d69 None admin] Authenticating user token {{(pid=352329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:53:01.047450 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG dbcounter [-] [352329] Writing DB stats keystone:SELECT=100 {{(pid=352329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:53:01.107298 dv-cinder-851351-1-smb devstack@keystone.service[352328]: [pid: 352328|app: 0|req: 84/168] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 08:53:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 08:53:01.108937 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def4c621-52ba-46e9-85ab-32e5b1e09e85 None None] Authenticating user token {{(pid=352328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:53:01.150903 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5afa6e37-ebda-456d-b92b-46c086696d69 None admin] Validating token access rules against request {{(pid=352329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:53:01.197828 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b8b80f-bb0d-448f-a7e0-2b31cebf6215 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:53:01.198513 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b8b80f-bb0d-448f-a7e0-2b31cebf6215 None admin] REQUEST_METHOD: `GET` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:53:01.198796 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b8b80f-bb0d-448f-a7e0-2b31cebf6215 None admin] SCRIPT_NAME: `/identity` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:53:01.199069 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b8b80f-bb0d-448f-a7e0-2b31cebf6215 None admin] PATH_INFO: `/v3/users/dee261de1c2f4d11bec14593404de7a4` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:53:01.202417 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b8b80f-bb0d-448f-a7e0-2b31cebf6215 None admin] RBAC: Authorizing `identity:get_user(user_id=dee261de1c2f4d11bec14593404de7a4)` {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:53:01.203912 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b8b80f-bb0d-448f-a7e0-2b31cebf6215 None admin] RBAC: Authorization granted {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:53:01.206090 dv-cinder-851351-1-smb devstack@keystone.service[352329]: [pid: 352329|app: 0|req: 85/169] 10.222.0.42 () {56 vars in 1177 bytes} [Thu Jul 28 08:53:01 2022] GET /identity/v3/users/dee261de1c2f4d11bec14593404de7a4 => generated 275 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:53:01.206879 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b8b80f-bb0d-448f-a7e0-2b31cebf6215 None admin] Authenticating user token {{(pid=352329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:53:01.241759 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG dbcounter [-] [352328] Writing DB stats keystone:SELECT=100 {{(pid=352328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:53:01.318960 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG dbcounter [-] [352329] Writing DB stats keystone:SELECT=100 {{(pid=352329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:53:01.337997 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b8b80f-bb0d-448f-a7e0-2b31cebf6215 None admin] Validating token access rules against request {{(pid=352329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:53:01.342816 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def4c621-52ba-46e9-85ab-32e5b1e09e85 None None] Validating token access rules against request {{(pid=352328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:53:01.384921 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3ae902-e264-4fca-ab8e-88a81c7f2c99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:53:01.385935 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3ae902-e264-4fca-ab8e-88a81c7f2c99 None admin] REQUEST_METHOD: `GET` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:53:01.386373 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3ae902-e264-4fca-ab8e-88a81c7f2c99 None admin] SCRIPT_NAME: `/identity` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:53:01.386814 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3ae902-e264-4fca-ab8e-88a81c7f2c99 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:53:01.400233 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731bd0f9-6b81-495b-a739-787b619b6b8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:53:01.401389 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731bd0f9-6b81-495b-a739-787b619b6b8f None admin] REQUEST_METHOD: `GET` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:53:01.401790 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731bd0f9-6b81-495b-a739-787b619b6b8f None admin] SCRIPT_NAME: `/identity` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:53:01.402171 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731bd0f9-6b81-495b-a739-787b619b6b8f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:53:01.410715 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c3ae902-e264-4fca-ab8e-88a81c7f2c99 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 08:53:01.416637 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application [None req-7c3ae902-e264-4fca-ab8e-88a81c7f2c99 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 28 08:53:01.416637 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:53:01.416637 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:53:01.416637 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:53:01.416637 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:53:01.416637 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:53:01.416637 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:53:01.416637 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:53:01.416637 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:53:01.416637 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:53:01.416637 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:53:01.416637 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:53:01.416637 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 08:53:01.416637 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 08:53:01.416637 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 08:53:01.416637 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 08:53:01.417965 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 08:53:01.417965 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 08:53:01.417965 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 08:53:01.417965 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 08:53:01.417965 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:53:01.417965 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:53:01.417965 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:53:01.417965 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:53:01.417965 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:53:01.417965 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:53:01.417965 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:53:01.417965 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application with Lock( Jul 28 08:53:01.417965 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:53:01.417965 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:53:01.417965 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:53:01.417965 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:53:01.419151 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:53:01.419151 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:53:01.419151 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:53:01.419151 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:53:01.419151 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 08:53:01.419151 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 08:53:01.419151 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 08:53:01.419151 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 08:53:01.419151 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 08:53:01.419151 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 08:53:01.419151 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 28 08:53:01.419151 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application Jul 28 08:53:01.421389 dv-cinder-851351-1-smb devstack@keystone.service[352329]: [pid: 352329|app: 0|req: 86/170] 10.222.0.42 () {56 vars in 1099 bytes} [Thu Jul 28 08:53:01 2022] GET /identity/v3/roles/reader => generated 84 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:53:01.422405 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3ae902-e264-4fca-ab8e-88a81c7f2c99 None admin] Authenticating user token {{(pid=352329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:53:01.547536 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-731bd0f9-6b81-495b-a739-787b619b6b8f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:53:01.549387 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-731bd0f9-6b81-495b-a739-787b619b6b8f None admin] RBAC: Authorization granted {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:53:01.564709 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3ae902-e264-4fca-ab8e-88a81c7f2c99 None admin] Validating token access rules against request {{(pid=352329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:53:01.597079 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a662a299-2b30-4df7-a1d8-a784123552cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:53:01.597724 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a662a299-2b30-4df7-a1d8-a784123552cb None admin] REQUEST_METHOD: `GET` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:53:01.598008 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a662a299-2b30-4df7-a1d8-a784123552cb None admin] SCRIPT_NAME: `/identity` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:53:01.598285 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a662a299-2b30-4df7-a1d8-a784123552cb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:53:01.626250 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG dbcounter [-] [352329] Writing DB stats keystone:SELECT=100 {{(pid=352329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:53:01.657135 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG dbcounter [-] [352328] Writing DB stats keystone:SELECT=100 {{(pid=352328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:53:01.688691 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a662a299-2b30-4df7-a1d8-a784123552cb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:53:01.690545 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a662a299-2b30-4df7-a1d8-a784123552cb None admin] RBAC: Authorization granted {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:53:01.765714 dv-cinder-851351-1-smb devstack@keystone.service[352328]: [pid: 352328|app: 0|req: 85/171] 10.222.0.42 () {58 vars in 1282 bytes} [Thu Jul 28 08:53:01 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 658 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 28 08:53:01.771311 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731bd0f9-6b81-495b-a739-787b619b6b8f None admin] Authenticating user token {{(pid=352328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:53:01.807965 dv-cinder-851351-1-smb devstack@keystone.service[352329]: [pid: 352329|app: 0|req: 87/172] 10.222.0.42 () {58 vars in 1282 bytes} [Thu Jul 28 08:53:01 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 386 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 28 08:53:01.809982 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a662a299-2b30-4df7-a1d8-a784123552cb None admin] Authenticating user token {{(pid=352329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:53:01.865442 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG dbcounter [-] [352329] Writing DB stats keystone:SELECT=100 {{(pid=352329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:53:01.925974 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a662a299-2b30-4df7-a1d8-a784123552cb None admin] Validating token access rules against request {{(pid=352329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:53:01.968401 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ecb689-3c02-4fcd-8291-94571fad53b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:53:01.971725 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ecb689-3c02-4fcd-8291-94571fad53b2 None admin] REQUEST_METHOD: `GET` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:53:01.972006 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ecb689-3c02-4fcd-8291-94571fad53b2 None admin] SCRIPT_NAME: `/identity` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:53:01.972279 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ecb689-3c02-4fcd-8291-94571fad53b2 None admin] PATH_INFO: `/v3/projects/9af593aec02c450aa4ce9c48ff4c6a1f` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:53:01.973578 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9ecb689-3c02-4fcd-8291-94571fad53b2 None admin] RBAC: Authorizing `identity:get_project(project_id=9af593aec02c450aa4ce9c48ff4c6a1f)` {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:53:01.975052 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9ecb689-3c02-4fcd-8291-94571fad53b2 None admin] RBAC: Authorization granted {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:53:01.976948 dv-cinder-851351-1-smb devstack@keystone.service[352329]: [pid: 352329|app: 0|req: 88/173] 10.222.0.42 () {56 vars in 1186 bytes} [Thu Jul 28 08:53:01 2022] GET /identity/v3/projects/9af593aec02c450aa4ce9c48ff4c6a1f => generated 298 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:53:01.982612 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ecb689-3c02-4fcd-8291-94571fad53b2 None admin] Authenticating user token {{(pid=352329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:53:02.073216 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731bd0f9-6b81-495b-a739-787b619b6b8f None admin] Validating token access rules against request {{(pid=352328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:53:02.144751 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eefa672-f6b2-40a0-8524-294b4cad4b24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:53:02.145386 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eefa672-f6b2-40a0-8524-294b4cad4b24 None admin] REQUEST_METHOD: `GET` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:53:02.145665 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eefa672-f6b2-40a0-8524-294b4cad4b24 None admin] SCRIPT_NAME: `/identity` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:53:02.145936 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eefa672-f6b2-40a0-8524-294b4cad4b24 None admin] PATH_INFO: `/v3/roles` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:53:02.146668 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eefa672-f6b2-40a0-8524-294b4cad4b24 None admin] RBAC: Adding query filter params (name=reader) {{(pid=352328) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:53:02.146979 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eefa672-f6b2-40a0-8524-294b4cad4b24 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:53:02.148372 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eefa672-f6b2-40a0-8524-294b4cad4b24 None admin] RBAC: Authorization granted {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:53:02.156759 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ecb689-3c02-4fcd-8291-94571fad53b2 None admin] Validating token access rules against request {{(pid=352329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:53:02.170639 dv-cinder-851351-1-smb devstack@keystone.service[352328]: [pid: 352328|app: 0|req: 86/174] 10.222.0.42 () {56 vars in 1101 bytes} [Thu Jul 28 08:53:01 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 404 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:53:02.173887 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eefa672-f6b2-40a0-8524-294b4cad4b24 None admin] Authenticating user token {{(pid=352328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:53:02.191689 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG dbcounter [-] [352329] Writing DB stats keystone:SELECT=100 {{(pid=352329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:53:02.217701 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG dbcounter [-] [352328] Writing DB stats keystone:SELECT=100 {{(pid=352328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:53:02.235300 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4bafff1-33f5-4edd-84f2-13a3d982ad7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:53:02.235970 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4bafff1-33f5-4edd-84f2-13a3d982ad7f None admin] REQUEST_METHOD: `GET` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:53:02.236285 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4bafff1-33f5-4edd-84f2-13a3d982ad7f None admin] SCRIPT_NAME: `/identity` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:53:02.236562 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4bafff1-33f5-4edd-84f2-13a3d982ad7f None admin] PATH_INFO: `/v3/projects/a177ed99903c46349a25c58aacd4f5b4` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:53:02.238941 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4bafff1-33f5-4edd-84f2-13a3d982ad7f None admin] RBAC: Authorizing `identity:get_project(project_id=a177ed99903c46349a25c58aacd4f5b4)` {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:53:02.240435 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4bafff1-33f5-4edd-84f2-13a3d982ad7f None admin] RBAC: Authorization granted {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:53:02.242185 dv-cinder-851351-1-smb devstack@keystone.service[352329]: [pid: 352329|app: 0|req: 89/175] 10.222.0.42 () {56 vars in 1186 bytes} [Thu Jul 28 08:53:01 2022] GET /identity/v3/projects/a177ed99903c46349a25c58aacd4f5b4 => generated 312 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:53:02.247399 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4bafff1-33f5-4edd-84f2-13a3d982ad7f None admin] Authenticating user token {{(pid=352329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:53:02.329647 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eefa672-f6b2-40a0-8524-294b4cad4b24 None admin] Validating token access rules against request {{(pid=352328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:53:02.365807 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-237ff645-f8a0-4e52-a2d3-1069aabaa845 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:53:02.366445 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237ff645-f8a0-4e52-a2d3-1069aabaa845 None admin] REQUEST_METHOD: `GET` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:53:02.367126 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237ff645-f8a0-4e52-a2d3-1069aabaa845 None admin] SCRIPT_NAME: `/identity` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:53:02.367409 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237ff645-f8a0-4e52-a2d3-1069aabaa845 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:53:02.368528 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-237ff645-f8a0-4e52-a2d3-1069aabaa845 None admin] RBAC: Adding query filter params (role.id=a4fa43cd6d914398a0790a1516c83d08, scope.project.id=9af593aec02c450aa4ce9c48ff4c6a1f, user.id=dee261de1c2f4d11bec14593404de7a4) {{(pid=352328) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:53:02.368873 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-237ff645-f8a0-4e52-a2d3-1069aabaa845 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:53:02.370348 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-237ff645-f8a0-4e52-a2d3-1069aabaa845 None admin] RBAC: Authorization granted {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:53:02.377160 dv-cinder-851351-1-smb devstack@keystone.service[352328]: [pid: 352328|app: 0|req: 87/176] 10.222.0.42 () {56 vars in 1374 bytes} [Thu Jul 28 08:53:02 2022] GET /identity/v3/role_assignments?user.id=dee261de1c2f4d11bec14593404de7a4&scope.project.id=9af593aec02c450aa4ce9c48ff4c6a1f&role.id=a4fa43cd6d914398a0790a1516c83d08 => generated 608 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:53:02.378073 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-237ff645-f8a0-4e52-a2d3-1069aabaa845 None admin] Authenticating user token {{(pid=352328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:53:02.488810 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG dbcounter [-] [352328] Writing DB stats keystone:SELECT=100 {{(pid=352328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:53:02.517256 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4bafff1-33f5-4edd-84f2-13a3d982ad7f None admin] Validating token access rules against request {{(pid=352329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:53:02.522645 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-237ff645-f8a0-4e52-a2d3-1069aabaa845 None admin] Validating token access rules against request {{(pid=352328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:53:02.571688 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5002c60c-ad5c-4de4-b47e-bb22076e57f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:53:02.572882 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5002c60c-ad5c-4de4-b47e-bb22076e57f9 None admin] REQUEST_METHOD: `GET` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:53:02.574110 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5002c60c-ad5c-4de4-b47e-bb22076e57f9 None admin] SCRIPT_NAME: `/identity` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:53:02.574397 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5002c60c-ad5c-4de4-b47e-bb22076e57f9 None admin] PATH_INFO: `/v3/users/6ecabd483e0c4baa8a96cf6e2a2eb9e9` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:53:02.576813 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5002c60c-ad5c-4de4-b47e-bb22076e57f9 None admin] RBAC: Authorizing `identity:get_user(user_id=6ecabd483e0c4baa8a96cf6e2a2eb9e9)` {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:53:02.578306 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5002c60c-ad5c-4de4-b47e-bb22076e57f9 None admin] RBAC: Authorization granted {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:53:02.580464 dv-cinder-851351-1-smb devstack@keystone.service[352329]: [pid: 352329|app: 0|req: 90/177] 10.222.0.42 () {56 vars in 1177 bytes} [Thu Jul 28 08:53:02 2022] GET /identity/v3/users/6ecabd483e0c4baa8a96cf6e2a2eb9e9 => generated 289 bytes in 338 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:53:02.587596 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5002c60c-ad5c-4de4-b47e-bb22076e57f9 None admin] Authenticating user token {{(pid=352329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:53:02.598331 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f1596c-3446-498c-9235-d2e1d6c200ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:53:02.598992 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f1596c-3446-498c-9235-d2e1d6c200ee None admin] REQUEST_METHOD: `GET` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:53:02.599313 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f1596c-3446-498c-9235-d2e1d6c200ee None admin] SCRIPT_NAME: `/identity` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:53:02.599595 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f1596c-3446-498c-9235-d2e1d6c200ee None admin] PATH_INFO: `/v3/role_assignments` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:53:02.600411 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f1596c-3446-498c-9235-d2e1d6c200ee None admin] RBAC: Adding query filter params (role.id=16a3fc3aca974c47a329c2781b0be93a, scope.project.id=a177ed99903c46349a25c58aacd4f5b4, user.id=dee261de1c2f4d11bec14593404de7a4) {{(pid=352328) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:53:02.600747 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f1596c-3446-498c-9235-d2e1d6c200ee None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:53:02.602219 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f1596c-3446-498c-9235-d2e1d6c200ee None admin] RBAC: Authorization granted {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:53:02.614858 dv-cinder-851351-1-smb devstack@keystone.service[352328]: [pid: 352328|app: 0|req: 88/178] 10.222.0.42 () {56 vars in 1374 bytes} [Thu Jul 28 08:53:02 2022] GET /identity/v3/role_assignments?user.id=dee261de1c2f4d11bec14593404de7a4&scope.project.id=a177ed99903c46349a25c58aacd4f5b4&role.id=16a3fc3aca974c47a329c2781b0be93a => generated 608 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:53:02.657611 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG dbcounter [-] [352329] Writing DB stats keystone:SELECT=100 {{(pid=352329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:53:02.734953 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5002c60c-ad5c-4de4-b47e-bb22076e57f9 None admin] Validating token access rules against request {{(pid=352329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:53:02.787194 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed20363-ca4a-481a-9e59-bd6cf649ad09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:53:02.787883 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed20363-ca4a-481a-9e59-bd6cf649ad09 None admin] REQUEST_METHOD: `GET` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:53:02.788172 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed20363-ca4a-481a-9e59-bd6cf649ad09 None admin] SCRIPT_NAME: `/identity` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:53:02.788451 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed20363-ca4a-481a-9e59-bd6cf649ad09 None admin] PATH_INFO: `/v3/projects/9af593aec02c450aa4ce9c48ff4c6a1f` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:53:02.793663 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ed20363-ca4a-481a-9e59-bd6cf649ad09 None admin] RBAC: Authorizing `identity:get_project(project_id=9af593aec02c450aa4ce9c48ff4c6a1f)` {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:53:02.795189 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ed20363-ca4a-481a-9e59-bd6cf649ad09 None admin] RBAC: Authorization granted {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:53:02.797089 dv-cinder-851351-1-smb devstack@keystone.service[352329]: [pid: 352329|app: 0|req: 91/179] 10.222.0.42 () {56 vars in 1186 bytes} [Thu Jul 28 08:53:02 2022] GET /identity/v3/projects/9af593aec02c450aa4ce9c48ff4c6a1f => generated 298 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:53:02.803396 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f1596c-3446-498c-9235-d2e1d6c200ee None admin] Authenticating user token {{(pid=352328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:53:02.926429 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f1596c-3446-498c-9235-d2e1d6c200ee None admin] Validating token access rules against request {{(pid=352328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:53:02.963164 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e8ba2f-66e5-4403-bc11-b100665a98d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:53:02.963868 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e8ba2f-66e5-4403-bc11-b100665a98d0 None admin] REQUEST_METHOD: `PUT` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:53:02.964140 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e8ba2f-66e5-4403-bc11-b100665a98d0 None admin] SCRIPT_NAME: `/identity` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:53:02.964464 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e8ba2f-66e5-4403-bc11-b100665a98d0 None admin] PATH_INFO: `/v3/projects/9af593aec02c450aa4ce9c48ff4c6a1f/users/6ecabd483e0c4baa8a96cf6e2a2eb9e9/roles/3abd212955234654b7d9a8d7df33e380` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:53:02.966601 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e8ba2f-66e5-4403-bc11-b100665a98d0 None admin] RBAC: Authorizing `identity:create_grant(project_id=9af593aec02c450aa4ce9c48ff4c6a1f, user_id=6ecabd483e0c4baa8a96cf6e2a2eb9e9, role_id=3abd212955234654b7d9a8d7df33e380)` {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:53:02.968059 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e8ba2f-66e5-4403-bc11-b100665a98d0 None admin] RBAC: Authorization granted {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:53:02.986279 dv-cinder-851351-1-smb devstack@keystone.service[352328]: [pid: 352328|app: 0|req: 89/180] 10.222.0.42 () {58 vars in 1439 bytes} [Thu Jul 28 08:53:02 2022] PUT /identity/v3/projects/9af593aec02c450aa4ce9c48ff4c6a1f/users/6ecabd483e0c4baa8a96cf6e2a2eb9e9/roles/3abd212955234654b7d9a8d7df33e380 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 08:53:03.054008 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad24092b-871a-4f03-980c-c417562e89dd None None] REQUEST_METHOD: `GET` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:53:03.054587 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad24092b-871a-4f03-980c-c417562e89dd None None] SCRIPT_NAME: `/identity` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:53:03.054587 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad24092b-871a-4f03-980c-c417562e89dd None None] PATH_INFO: `/` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:53:03.056158 dv-cinder-851351-1-smb devstack@keystone.service[352329]: [pid: 352329|app: 0|req: 92/181] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 08:53:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 08:53:03.062385 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7667afc-1f87-42fc-a124-5435f4bdddba None None] REQUEST_METHOD: `POST` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:53:03.062758 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7667afc-1f87-42fc-a124-5435f4bdddba None None] SCRIPT_NAME: `/identity` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:53:03.062943 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7667afc-1f87-42fc-a124-5435f4bdddba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:53:03.077658 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG dbcounter [-] [352328] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=352328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:53:03.085737 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.auth.core [None req-d7667afc-1f87-42fc-a124-5435f4bdddba None None] MFA Rules not processed for user `d18c063b2377412485965357671e5506`. Rule list: `[]` (Enabled: `True`). {{(pid=352328) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 08:53:03.087092 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.fernet_utils [None req-d7667afc-1f87-42fc-a124-5435f4bdddba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=352328) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:53:03.088021 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a74b521-6149-4a91-a638-72bd2557189e None None] REQUEST_METHOD: `GET` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:53:03.088564 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a74b521-6149-4a91-a638-72bd2557189e None None] SCRIPT_NAME: `/identity` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:53:03.089132 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a74b521-6149-4a91-a638-72bd2557189e None None] PATH_INFO: `/` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:53:03.091841 dv-cinder-851351-1-smb devstack@keystone.service[352329]: [pid: 352329|app: 0|req: 93/182] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 08:53:03 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 08:53:03.099352 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407ef480-7668-4c50-83d5-ae967ee92aa3 None None] REQUEST_METHOD: `POST` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:53:03.099718 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407ef480-7668-4c50-83d5-ae967ee92aa3 None None] SCRIPT_NAME: `/identity` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:53:03.099923 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407ef480-7668-4c50-83d5-ae967ee92aa3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:53:03.131751 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.auth.core [None req-407ef480-7668-4c50-83d5-ae967ee92aa3 None None] MFA Rules not processed for user `d18c063b2377412485965357671e5506`. Rule list: `[]` (Enabled: `True`). {{(pid=352329) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 08:53:03.133068 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.fernet_utils [None req-407ef480-7668-4c50-83d5-ae967ee92aa3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=352329) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:53:03.164857 dv-cinder-851351-1-smb devstack@keystone.service[352328]: [pid: 352328|app: 0|req: 90/183] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 08:53:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 08:53:03.190299 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7667afc-1f87-42fc-a124-5435f4bdddba None None] Authenticating user token {{(pid=352328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:53:03.215205 dv-cinder-851351-1-smb devstack@keystone.service[352329]: [pid: 352329|app: 0|req: 94/184] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 08:53:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 08:53:03.245472 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-407ef480-7668-4c50-83d5-ae967ee92aa3 None None] Authenticating user token {{(pid=352329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:53:03.297340 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7667afc-1f87-42fc-a124-5435f4bdddba None None] Validating token access rules against request {{(pid=352328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:53:03.305469 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG dbcounter [-] [352329] Writing DB stats keystone:SELECT=100 {{(pid=352329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:53:03.334187 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc58cf56-60dc-487d-83a1-3b099bb6e6c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:53:03.335146 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc58cf56-60dc-487d-83a1-3b099bb6e6c8 None admin] REQUEST_METHOD: `GET` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:53:03.335485 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc58cf56-60dc-487d-83a1-3b099bb6e6c8 None admin] SCRIPT_NAME: `/identity` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:53:03.335763 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc58cf56-60dc-487d-83a1-3b099bb6e6c8 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:53:03.342618 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG dbcounter [-] [352328] Writing DB stats keystone:SELECT=100 {{(pid=352328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:53:03.350603 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-407ef480-7668-4c50-83d5-ae967ee92aa3 None None] Validating token access rules against request {{(pid=352329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:53:03.350865 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc58cf56-60dc-487d-83a1-3b099bb6e6c8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 08:53:03.356985 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application [None req-bc58cf56-60dc-487d-83a1-3b099bb6e6c8 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 28 08:53:03.356985 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:53:03.356985 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:53:03.356985 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:53:03.356985 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:53:03.356985 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:53:03.356985 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:53:03.356985 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:53:03.356985 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:53:03.356985 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:53:03.356985 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:53:03.356985 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:53:03.356985 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 08:53:03.356985 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 08:53:03.356985 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 08:53:03.356985 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 08:53:03.358370 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 08:53:03.358370 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 08:53:03.358370 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 08:53:03.358370 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 08:53:03.358370 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:53:03.358370 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:53:03.358370 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:53:03.358370 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:53:03.358370 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:53:03.358370 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:53:03.358370 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:53:03.358370 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application with Lock( Jul 28 08:53:03.358370 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:53:03.358370 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:53:03.358370 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:53:03.358370 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:53:03.359607 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:53:03.359607 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:53:03.359607 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:53:03.359607 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:53:03.359607 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 08:53:03.359607 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 08:53:03.359607 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 08:53:03.359607 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 08:53:03.359607 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 08:53:03.359607 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 08:53:03.359607 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 28 08:53:03.359607 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application Jul 28 08:53:03.360760 dv-cinder-851351-1-smb devstack@keystone.service[352328]: [pid: 352328|app: 0|req: 91/185] 10.222.0.42 () {56 vars in 1114 bytes} [Thu Jul 28 08:53:03 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:53:03.366615 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc58cf56-60dc-487d-83a1-3b099bb6e6c8 None admin] Authenticating user token {{(pid=352328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:53:03.393458 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5b9333-8a95-4dee-8075-3570a29502b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:53:03.394127 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5b9333-8a95-4dee-8075-3570a29502b8 None admin] REQUEST_METHOD: `GET` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:53:03.394413 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5b9333-8a95-4dee-8075-3570a29502b8 None admin] SCRIPT_NAME: `/identity` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:53:03.394691 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5b9333-8a95-4dee-8075-3570a29502b8 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:53:03.405821 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa5b9333-8a95-4dee-8075-3570a29502b8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 08:53:03.410954 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application [None req-fa5b9333-8a95-4dee-8075-3570a29502b8 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 08:53:03.410954 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:53:03.410954 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:53:03.410954 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:53:03.410954 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:53:03.410954 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:53:03.410954 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:53:03.410954 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:53:03.410954 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:53:03.410954 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:53:03.410954 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:53:03.410954 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:53:03.410954 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 08:53:03.410954 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 08:53:03.410954 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 08:53:03.410954 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 08:53:03.412120 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 08:53:03.412120 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 08:53:03.412120 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 08:53:03.412120 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 08:53:03.412120 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:53:03.412120 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:53:03.412120 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:53:03.412120 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:53:03.412120 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:53:03.412120 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:53:03.412120 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:53:03.412120 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application with Lock( Jul 28 08:53:03.412120 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:53:03.412120 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:53:03.412120 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:53:03.412120 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:53:03.413183 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:53:03.413183 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:53:03.413183 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:53:03.413183 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:53:03.413183 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 08:53:03.413183 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 08:53:03.413183 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 08:53:03.413183 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 08:53:03.413183 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 08:53:03.413183 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 08:53:03.413183 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 08:53:03.413183 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application Jul 28 08:53:03.413183 dv-cinder-851351-1-smb devstack@keystone.service[352329]: [pid: 352329|app: 0|req: 95/186] 10.222.0.42 () {56 vars in 1096 bytes} [Thu Jul 28 08:53:03 2022] GET /identity/v3/roles/admin => generated 83 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 08:53:03.414027 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e523c97-eb89-4811-b4ed-0542bd6e45b8 None None] REQUEST_METHOD: `GET` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:53:03.414027 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e523c97-eb89-4811-b4ed-0542bd6e45b8 None None] SCRIPT_NAME: `/identity` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:53:03.414027 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e523c97-eb89-4811-b4ed-0542bd6e45b8 None None] PATH_INFO: `/` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:53:03.415440 dv-cinder-851351-1-smb devstack@keystone.service[352329]: [pid: 352329|app: 0|req: 96/187] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 08:53:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 08:53:03.421593 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e523c97-eb89-4811-b4ed-0542bd6e45b8 None None] Authenticating user token {{(pid=352329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:53:03.482270 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc58cf56-60dc-487d-83a1-3b099bb6e6c8 None admin] Validating token access rules against request {{(pid=352328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:53:03.517235 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b83713ee-7968-430c-9a67-d759ade2fdd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:53:03.517954 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83713ee-7968-430c-9a67-d759ade2fdd2 None admin] REQUEST_METHOD: `GET` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:53:03.518210 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83713ee-7968-430c-9a67-d759ade2fdd2 None admin] SCRIPT_NAME: `/identity` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:53:03.518537 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83713ee-7968-430c-9a67-d759ade2fdd2 None admin] PATH_INFO: `/v3/roles` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:53:03.519261 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b83713ee-7968-430c-9a67-d759ade2fdd2 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=352328) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:53:03.519539 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b83713ee-7968-430c-9a67-d759ade2fdd2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:53:03.520965 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b83713ee-7968-430c-9a67-d759ade2fdd2 None admin] RBAC: Authorization granted {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:53:03.530507 dv-cinder-851351-1-smb devstack@keystone.service[352328]: [pid: 352328|app: 0|req: 92/188] 10.222.0.42 () {56 vars in 1111 bytes} [Thu Jul 28 08:53:03 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:53:03.536389 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1d1f06-647e-4700-ae49-2b85979ba3c1 None None] REQUEST_METHOD: `POST` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:53:03.536711 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1d1f06-647e-4700-ae49-2b85979ba3c1 None None] SCRIPT_NAME: `/identity` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:53:03.537215 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1d1f06-647e-4700-ae49-2b85979ba3c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:53:03.543888 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e523c97-eb89-4811-b4ed-0542bd6e45b8 None None] Validating token access rules against request {{(pid=352329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:53:03.554410 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG dbcounter [-] [352329] Writing DB stats keystone:SELECT=100 {{(pid=352329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:53:03.558604 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.auth.core [None req-0b1d1f06-647e-4700-ae49-2b85979ba3c1 None None] MFA Rules not processed for user `d18c063b2377412485965357671e5506`. Rule list: `[]` (Enabled: `True`). {{(pid=352328) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 08:53:03.559934 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.fernet_utils [None req-0b1d1f06-647e-4700-ae49-2b85979ba3c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=352328) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:53:03.582698 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e45676f-94fe-4284-8b1b-5d3520feb50d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:53:03.583360 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e45676f-94fe-4284-8b1b-5d3520feb50d None admin] REQUEST_METHOD: `GET` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:53:03.583641 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e45676f-94fe-4284-8b1b-5d3520feb50d None admin] SCRIPT_NAME: `/identity` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:53:03.584041 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e45676f-94fe-4284-8b1b-5d3520feb50d None admin] PATH_INFO: `/v3/roles` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:53:03.584902 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e45676f-94fe-4284-8b1b-5d3520feb50d None admin] RBAC: Adding query filter params (name=admin) {{(pid=352329) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:53:03.585212 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e45676f-94fe-4284-8b1b-5d3520feb50d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:53:03.586748 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e45676f-94fe-4284-8b1b-5d3520feb50d None admin] RBAC: Authorization granted {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:53:03.601759 dv-cinder-851351-1-smb devstack@keystone.service[352329]: [pid: 352329|app: 0|req: 97/189] 10.222.0.42 () {56 vars in 1099 bytes} [Thu Jul 28 08:53:03 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:53:03.601759 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e45676f-94fe-4284-8b1b-5d3520feb50d None admin] Authenticating user token {{(pid=352329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:53:03.624111 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG dbcounter [-] [352328] Writing DB stats keystone:SELECT=100 {{(pid=352328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:53:03.639558 dv-cinder-851351-1-smb devstack@keystone.service[352328]: [pid: 352328|app: 0|req: 93/190] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 08:53:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 08:53:03.640551 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b1d1f06-647e-4700-ae49-2b85979ba3c1 None None] Authenticating user token {{(pid=352328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:53:03.727592 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e45676f-94fe-4284-8b1b-5d3520feb50d None admin] Validating token access rules against request {{(pid=352329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:53:03.750245 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b1d1f06-647e-4700-ae49-2b85979ba3c1 None None] Validating token access rules against request {{(pid=352328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:53:03.762322 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec56241-329c-487f-bb5c-6f4bbee5408d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:53:03.762977 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec56241-329c-487f-bb5c-6f4bbee5408d None admin] REQUEST_METHOD: `GET` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:53:03.763258 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec56241-329c-487f-bb5c-6f4bbee5408d None admin] SCRIPT_NAME: `/identity` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:53:03.763528 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec56241-329c-487f-bb5c-6f4bbee5408d None admin] PATH_INFO: `/v3/users/393f088d556d4599ba13edfd35b7951a` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:53:03.777340 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fec56241-329c-487f-bb5c-6f4bbee5408d None admin] RBAC: Authorizing `identity:get_user(user_id=393f088d556d4599ba13edfd35b7951a)` {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:53:03.778957 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fec56241-329c-487f-bb5c-6f4bbee5408d None admin] RBAC: Authorization granted {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:53:03.781058 dv-cinder-851351-1-smb devstack@keystone.service[352329]: [pid: 352329|app: 0|req: 98/191] 10.222.0.42 () {56 vars in 1177 bytes} [Thu Jul 28 08:53:03 2022] GET /identity/v3/users/393f088d556d4599ba13edfd35b7951a => generated 283 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:53:03.781672 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec56241-329c-487f-bb5c-6f4bbee5408d None admin] Authenticating user token {{(pid=352329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:53:03.795355 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a6d5bd-1fa0-4e25-8a03-c9f326363eb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:53:03.796075 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a6d5bd-1fa0-4e25-8a03-c9f326363eb8 None admin] REQUEST_METHOD: `GET` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:53:03.796369 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a6d5bd-1fa0-4e25-8a03-c9f326363eb8 None admin] SCRIPT_NAME: `/identity` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:53:03.796697 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a6d5bd-1fa0-4e25-8a03-c9f326363eb8 None admin] PATH_INFO: `/v3/users/393f088d556d4599ba13edfd35b7951a` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:53:03.797935 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a6d5bd-1fa0-4e25-8a03-c9f326363eb8 None admin] RBAC: Authorizing `identity:get_user(user_id=393f088d556d4599ba13edfd35b7951a)` {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:53:03.799474 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a6d5bd-1fa0-4e25-8a03-c9f326363eb8 None admin] RBAC: Authorization granted {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:53:03.805648 dv-cinder-851351-1-smb devstack@keystone.service[352328]: [pid: 352328|app: 0|req: 94/192] 10.222.0.42 () {56 vars in 1177 bytes} [Thu Jul 28 08:53:03 2022] GET /identity/v3/users/393f088d556d4599ba13edfd35b7951a => generated 283 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:53:03.805648 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a6d5bd-1fa0-4e25-8a03-c9f326363eb8 None admin] Authenticating user token {{(pid=352328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:53:03.818595 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG dbcounter [-] [352329] Writing DB stats keystone:SELECT=100 {{(pid=352329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:53:03.868809 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG dbcounter [-] [352328] Writing DB stats keystone:SELECT=100 {{(pid=352328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:53:03.895364 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec56241-329c-487f-bb5c-6f4bbee5408d None admin] Validating token access rules against request {{(pid=352329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:53:03.915751 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a6d5bd-1fa0-4e25-8a03-c9f326363eb8 None admin] Validating token access rules against request {{(pid=352328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:53:03.931781 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1dac07-6692-4d44-ac83-ecd9ebc19b37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:53:03.932445 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1dac07-6692-4d44-ac83-ecd9ebc19b37 None admin] REQUEST_METHOD: `GET` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:53:03.932757 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1dac07-6692-4d44-ac83-ecd9ebc19b37 None admin] SCRIPT_NAME: `/identity` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:53:03.933036 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1dac07-6692-4d44-ac83-ecd9ebc19b37 None admin] PATH_INFO: `/v3/domains/default` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:53:03.934219 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c1dac07-6692-4d44-ac83-ecd9ebc19b37 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:53:03.935705 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c1dac07-6692-4d44-ac83-ecd9ebc19b37 None admin] RBAC: Authorization granted {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:53:03.942198 dv-cinder-851351-1-smb devstack@keystone.service[352329]: [pid: 352329|app: 0|req: 99/193] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 08:53:03 2022] GET /identity/v3/domains/default => generated 199 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:53:03.942198 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1dac07-6692-4d44-ac83-ecd9ebc19b37 None admin] Authenticating user token {{(pid=352329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:53:03.956284 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a22dfc69-8370-491f-8637-ce17ff725a84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:53:03.957010 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22dfc69-8370-491f-8637-ce17ff725a84 None admin] REQUEST_METHOD: `GET` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:53:03.957316 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22dfc69-8370-491f-8637-ce17ff725a84 None admin] SCRIPT_NAME: `/identity` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:53:03.957606 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22dfc69-8370-491f-8637-ce17ff725a84 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:53:04.040495 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a22dfc69-8370-491f-8637-ce17ff725a84 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:53:04.043254 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a22dfc69-8370-491f-8637-ce17ff725a84 None admin] RBAC: Authorization granted {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:53:04.053390 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG dbcounter [-] [352329] Writing DB stats keystone:SELECT=100 {{(pid=352329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:53:04.060377 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1dac07-6692-4d44-ac83-ecd9ebc19b37 None admin] Validating token access rules against request {{(pid=352329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:53:04.098883 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a370c61-63f5-4c5b-b604-0fa6a13d81ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:53:04.099633 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a370c61-63f5-4c5b-b604-0fa6a13d81ec None admin] REQUEST_METHOD: `GET` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:53:04.099918 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a370c61-63f5-4c5b-b604-0fa6a13d81ec None admin] SCRIPT_NAME: `/identity` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:53:04.100195 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a370c61-63f5-4c5b-b604-0fa6a13d81ec None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:53:04.134406 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG dbcounter [-] [352328] Writing DB stats keystone:SELECT=100 {{(pid=352328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:53:04.177692 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a370c61-63f5-4c5b-b604-0fa6a13d81ec None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:53:04.179213 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a370c61-63f5-4c5b-b604-0fa6a13d81ec None admin] RBAC: Authorization granted {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:53:04.188957 dv-cinder-851351-1-smb devstack@keystone.service[352328]: [pid: 352328|app: 0|req: 95/194] 10.222.0.42 () {58 vars in 1282 bytes} [Thu Jul 28 08:53:03 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 387 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 28 08:53:04.190572 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a22dfc69-8370-491f-8637-ce17ff725a84 None admin] Authenticating user token {{(pid=352328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:53:04.280347 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG dbcounter [-] [352329] Writing DB stats keystone:SELECT=100 {{(pid=352329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:53:04.293330 dv-cinder-851351-1-smb devstack@keystone.service[352329]: [pid: 352329|app: 0|req: 100/195] 10.222.0.42 () {58 vars in 1282 bytes} [Thu Jul 28 08:53:03 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 351 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 28 08:53:04.293330 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a370c61-63f5-4c5b-b604-0fa6a13d81ec None admin] Authenticating user token {{(pid=352329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:53:04.301432 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a22dfc69-8370-491f-8637-ce17ff725a84 None admin] Validating token access rules against request {{(pid=352328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:53:04.335817 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98b50a8-1e40-4ca4-a5f1-55968343f8c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:53:04.336451 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98b50a8-1e40-4ca4-a5f1-55968343f8c4 None admin] REQUEST_METHOD: `POST` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:53:04.336772 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98b50a8-1e40-4ca4-a5f1-55968343f8c4 None admin] SCRIPT_NAME: `/identity` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:53:04.337056 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98b50a8-1e40-4ca4-a5f1-55968343f8c4 None admin] PATH_INFO: `/v3/users` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:53:04.337755 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e98b50a8-1e40-4ca4-a5f1-55968343f8c4 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:53:04.339295 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e98b50a8-1e40-4ca4-a5f1-55968343f8c4 None admin] RBAC: Authorization granted {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:53:04.370012 dv-cinder-851351-1-smb devstack@keystone.service[352328]: [pid: 352328|app: 0|req: 96/196] 10.222.0.42 () {60 vars in 1132 bytes} [Thu Jul 28 08:53:04 2022] POST /identity/v3/users => generated 297 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 08:53:04.370976 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98b50a8-1e40-4ca4-a5f1-55968343f8c4 None admin] Authenticating user token {{(pid=352328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:53:04.405597 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG dbcounter [-] [352328] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=352328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:53:04.406921 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a370c61-63f5-4c5b-b604-0fa6a13d81ec None admin] Validating token access rules against request {{(pid=352329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:53:04.448558 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb9489a2-1b4a-430c-9286-b96ac24c3e4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:53:04.449428 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9489a2-1b4a-430c-9286-b96ac24c3e4d None admin] REQUEST_METHOD: `GET` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:53:04.449788 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9489a2-1b4a-430c-9286-b96ac24c3e4d None admin] SCRIPT_NAME: `/identity` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:53:04.450137 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9489a2-1b4a-430c-9286-b96ac24c3e4d None admin] PATH_INFO: `/v3/projects/be5ef7d0266e453784a39d297f9b131d` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:53:04.451531 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb9489a2-1b4a-430c-9286-b96ac24c3e4d None admin] RBAC: Authorizing `identity:get_project(project_id=be5ef7d0266e453784a39d297f9b131d)` {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:53:04.453914 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb9489a2-1b4a-430c-9286-b96ac24c3e4d None admin] RBAC: Authorization granted {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:53:04.461562 dv-cinder-851351-1-smb devstack@keystone.service[352329]: [pid: 352329|app: 0|req: 101/197] 10.222.0.42 () {56 vars in 1186 bytes} [Thu Jul 28 08:53:04 2022] GET /identity/v3/projects/be5ef7d0266e453784a39d297f9b131d => generated 302 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:53:04.463916 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb9489a2-1b4a-430c-9286-b96ac24c3e4d None admin] Authenticating user token {{(pid=352329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:53:04.525631 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98b50a8-1e40-4ca4-a5f1-55968343f8c4 None admin] Validating token access rules against request {{(pid=352328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:53:04.541008 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG dbcounter [-] [352329] Writing DB stats keystone:SELECT=100 {{(pid=352329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:53:04.567982 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9e7abe-2a6f-4d78-911e-113cdea08748 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:53:04.569218 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9e7abe-2a6f-4d78-911e-113cdea08748 None admin] REQUEST_METHOD: `GET` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:53:04.569498 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9e7abe-2a6f-4d78-911e-113cdea08748 None admin] SCRIPT_NAME: `/identity` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:53:04.569817 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9e7abe-2a6f-4d78-911e-113cdea08748 None admin] PATH_INFO: `/v3/projects/be5ef7d0266e453784a39d297f9b131d` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:53:04.571127 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f9e7abe-2a6f-4d78-911e-113cdea08748 None admin] RBAC: Authorizing `identity:get_project(project_id=be5ef7d0266e453784a39d297f9b131d)` {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:53:04.572616 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f9e7abe-2a6f-4d78-911e-113cdea08748 None admin] RBAC: Authorization granted {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:53:04.574546 dv-cinder-851351-1-smb devstack@keystone.service[352328]: [pid: 352328|app: 0|req: 97/198] 10.222.0.42 () {56 vars in 1186 bytes} [Thu Jul 28 08:53:04 2022] GET /identity/v3/projects/be5ef7d0266e453784a39d297f9b131d => generated 302 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:53:04.581388 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9e7abe-2a6f-4d78-911e-113cdea08748 None admin] Authenticating user token {{(pid=352328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:53:04.596506 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb9489a2-1b4a-430c-9286-b96ac24c3e4d None admin] Validating token access rules against request {{(pid=352329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:53:04.643380 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc13709e-fbcb-4771-8e9f-4557ebea89ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:53:04.643380 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc13709e-fbcb-4771-8e9f-4557ebea89ff None admin] REQUEST_METHOD: `GET` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:53:04.643380 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc13709e-fbcb-4771-8e9f-4557ebea89ff None admin] SCRIPT_NAME: `/identity` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:53:04.643380 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc13709e-fbcb-4771-8e9f-4557ebea89ff None admin] PATH_INFO: `/v3/role_assignments` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:53:04.644047 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc13709e-fbcb-4771-8e9f-4557ebea89ff None admin] RBAC: Adding query filter params (role.id=a4fa43cd6d914398a0790a1516c83d08, scope.project.id=be5ef7d0266e453784a39d297f9b131d, user.id=393f088d556d4599ba13edfd35b7951a) {{(pid=352329) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:53:04.644315 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc13709e-fbcb-4771-8e9f-4557ebea89ff None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:53:04.648849 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc13709e-fbcb-4771-8e9f-4557ebea89ff None admin] RBAC: Authorization granted {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:53:04.654759 dv-cinder-851351-1-smb devstack@keystone.service[352329]: [pid: 352329|app: 0|req: 102/199] 10.222.0.42 () {56 vars in 1374 bytes} [Thu Jul 28 08:53:04 2022] GET /identity/v3/role_assignments?user.id=393f088d556d4599ba13edfd35b7951a&scope.project.id=be5ef7d0266e453784a39d297f9b131d&role.id=a4fa43cd6d914398a0790a1516c83d08 => generated 259 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 08:53:04.689684 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG dbcounter [-] [352328] Writing DB stats keystone:SELECT=100 {{(pid=352328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:53:04.715586 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9e7abe-2a6f-4d78-911e-113cdea08748 None admin] Validating token access rules against request {{(pid=352328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:53:04.757738 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41434f9a-bd67-44f6-8533-65f3f1e85d62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:53:04.758844 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41434f9a-bd67-44f6-8533-65f3f1e85d62 None admin] REQUEST_METHOD: `GET` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:53:04.759375 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41434f9a-bd67-44f6-8533-65f3f1e85d62 None admin] SCRIPT_NAME: `/identity` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:53:04.759879 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41434f9a-bd67-44f6-8533-65f3f1e85d62 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:53:04.761033 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41434f9a-bd67-44f6-8533-65f3f1e85d62 None admin] RBAC: Adding query filter params (role.id=280023171b4a45efb67c036ff237bb3c, scope.project.id=be5ef7d0266e453784a39d297f9b131d, user.id=393f088d556d4599ba13edfd35b7951a) {{(pid=352328) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:53:04.761625 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41434f9a-bd67-44f6-8533-65f3f1e85d62 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:53:04.763508 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41434f9a-bd67-44f6-8533-65f3f1e85d62 None admin] RBAC: Authorization granted {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:53:04.771883 dv-cinder-851351-1-smb devstack@keystone.service[352328]: [pid: 352328|app: 0|req: 98/200] 10.222.0.42 () {56 vars in 1374 bytes} [Thu Jul 28 08:53:04 2022] GET /identity/v3/role_assignments?user.id=393f088d556d4599ba13edfd35b7951a&scope.project.id=be5ef7d0266e453784a39d297f9b131d&role.id=280023171b4a45efb67c036ff237bb3c => generated 259 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:53:05.153014 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f499d948-2170-4555-a8d9-08281f5809a5 None None] REQUEST_METHOD: `GET` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:53:05.153607 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f499d948-2170-4555-a8d9-08281f5809a5 None None] SCRIPT_NAME: `/identity` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:53:05.154020 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f499d948-2170-4555-a8d9-08281f5809a5 None None] PATH_INFO: `/` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:53:05.156606 dv-cinder-851351-1-smb devstack@keystone.service[352329]: [pid: 352329|app: 0|req: 103/201] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 08:53:05 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 08:53:05.162399 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502fa2cd-cf41-4d91-a4ea-6e6ebe200307 None None] REQUEST_METHOD: `POST` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:53:05.163347 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502fa2cd-cf41-4d91-a4ea-6e6ebe200307 None None] SCRIPT_NAME: `/identity` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:53:05.163873 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502fa2cd-cf41-4d91-a4ea-6e6ebe200307 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:53:05.189807 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.auth.core [None req-502fa2cd-cf41-4d91-a4ea-6e6ebe200307 None None] MFA Rules not processed for user `d18c063b2377412485965357671e5506`. Rule list: `[]` (Enabled: `True`). {{(pid=352328) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 08:53:05.191506 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.fernet_utils [None req-502fa2cd-cf41-4d91-a4ea-6e6ebe200307 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=352328) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:53:05.268322 dv-cinder-851351-1-smb devstack@keystone.service[352328]: [pid: 352328|app: 0|req: 99/202] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 08:53:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 28 08:53:05.303520 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f499d948-2170-4555-a8d9-08281f5809a5 None None] Authenticating user token {{(pid=352329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:53:05.438841 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f499d948-2170-4555-a8d9-08281f5809a5 None None] Validating token access rules against request {{(pid=352329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:53:05.477865 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG dbcounter [-] [352329] Writing DB stats keystone:SELECT=100 {{(pid=352329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:53:05.487453 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7870deb1-6f7f-4a51-945f-045974be851e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:53:05.488122 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7870deb1-6f7f-4a51-945f-045974be851e None admin] REQUEST_METHOD: `GET` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:53:05.488405 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7870deb1-6f7f-4a51-945f-045974be851e None admin] SCRIPT_NAME: `/identity` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:53:05.488702 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7870deb1-6f7f-4a51-945f-045974be851e None admin] PATH_INFO: `/v3/roles/reader` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:53:05.505035 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7870deb1-6f7f-4a51-945f-045974be851e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 08:53:05.510689 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application [None req-7870deb1-6f7f-4a51-945f-045974be851e None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 28 08:53:05.510689 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:53:05.510689 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:53:05.510689 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:53:05.510689 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:53:05.510689 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:53:05.510689 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:53:05.510689 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:53:05.510689 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:53:05.510689 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:53:05.510689 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:53:05.510689 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:53:05.510689 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 08:53:05.510689 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 08:53:05.510689 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 08:53:05.510689 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 08:53:05.511828 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 08:53:05.511828 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 08:53:05.511828 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 08:53:05.511828 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 08:53:05.511828 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:53:05.511828 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:53:05.511828 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:53:05.511828 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:53:05.511828 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:53:05.511828 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:53:05.511828 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:53:05.511828 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application with Lock( Jul 28 08:53:05.511828 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:53:05.511828 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:53:05.511828 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:53:05.511828 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:53:05.512902 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:53:05.512902 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:53:05.512902 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:53:05.512902 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:53:05.512902 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 08:53:05.512902 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 08:53:05.512902 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 08:53:05.512902 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 08:53:05.512902 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 08:53:05.512902 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 08:53:05.512902 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 28 08:53:05.512902 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application Jul 28 08:53:05.512902 dv-cinder-851351-1-smb devstack@keystone.service[352329]: [pid: 352329|app: 0|req: 104/203] 10.222.0.42 () {56 vars in 1099 bytes} [Thu Jul 28 08:53:05 2022] GET /identity/v3/roles/reader => generated 84 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:53:05.519562 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502fa2cd-cf41-4d91-a4ea-6e6ebe200307 None None] Authenticating user token {{(pid=352328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:53:05.607943 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG dbcounter [-] [352328] Writing DB stats keystone:SELECT=100 {{(pid=352328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:53:05.638698 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502fa2cd-cf41-4d91-a4ea-6e6ebe200307 None None] Validating token access rules against request {{(pid=352328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:53:05.683929 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd77c435-ca9a-45e4-8b6b-613861bb35e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:53:05.685021 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd77c435-ca9a-45e4-8b6b-613861bb35e2 None admin] REQUEST_METHOD: `GET` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:53:05.685549 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd77c435-ca9a-45e4-8b6b-613861bb35e2 None admin] SCRIPT_NAME: `/identity` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:53:05.686048 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd77c435-ca9a-45e4-8b6b-613861bb35e2 None admin] PATH_INFO: `/v3/roles` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:53:05.687015 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd77c435-ca9a-45e4-8b6b-613861bb35e2 None admin] RBAC: Adding query filter params (name=reader) {{(pid=352328) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:53:05.687541 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd77c435-ca9a-45e4-8b6b-613861bb35e2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:53:05.689204 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd77c435-ca9a-45e4-8b6b-613861bb35e2 None admin] RBAC: Authorization granted {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:53:05.698575 dv-cinder-851351-1-smb devstack@keystone.service[352328]: [pid: 352328|app: 0|req: 100/204] 10.222.0.42 () {56 vars in 1101 bytes} [Thu Jul 28 08:53:05 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:53:05.707103 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7870deb1-6f7f-4a51-945f-045974be851e None admin] Authenticating user token {{(pid=352329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:53:05.860565 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7870deb1-6f7f-4a51-945f-045974be851e None admin] Validating token access rules against request {{(pid=352329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:53:05.908405 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8910147b-b784-4542-b027-7b2c8b2b6087 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:53:05.909141 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8910147b-b784-4542-b027-7b2c8b2b6087 None admin] REQUEST_METHOD: `GET` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:53:05.909421 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8910147b-b784-4542-b027-7b2c8b2b6087 None admin] SCRIPT_NAME: `/identity` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:53:05.909697 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8910147b-b784-4542-b027-7b2c8b2b6087 None admin] PATH_INFO: `/v3/users/6ecabd483e0c4baa8a96cf6e2a2eb9e9` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:53:05.911083 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8910147b-b784-4542-b027-7b2c8b2b6087 None admin] RBAC: Authorizing `identity:get_user(user_id=6ecabd483e0c4baa8a96cf6e2a2eb9e9)` {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:53:05.912577 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8910147b-b784-4542-b027-7b2c8b2b6087 None admin] RBAC: Authorization granted {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:53:05.915391 dv-cinder-851351-1-smb devstack@keystone.service[352329]: [pid: 352329|app: 0|req: 105/205] 10.222.0.42 () {56 vars in 1177 bytes} [Thu Jul 28 08:53:05 2022] GET /identity/v3/users/6ecabd483e0c4baa8a96cf6e2a2eb9e9 => generated 289 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:53:05.920035 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd77c435-ca9a-45e4-8b6b-613861bb35e2 None admin] Authenticating user token {{(pid=352328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:53:06.087130 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd77c435-ca9a-45e4-8b6b-613861bb35e2 None admin] Validating token access rules against request {{(pid=352328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:53:06.140238 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d756b5e-6168-41c0-a003-484a5324a262 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:53:06.140839 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d756b5e-6168-41c0-a003-484a5324a262 None admin] REQUEST_METHOD: `GET` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:53:06.141128 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d756b5e-6168-41c0-a003-484a5324a262 None admin] SCRIPT_NAME: `/identity` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:53:06.141408 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d756b5e-6168-41c0-a003-484a5324a262 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:53:06.149609 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG dbcounter [-] [352328] Writing DB stats keystone:SELECT=100 {{(pid=352328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:53:06.233745 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d756b5e-6168-41c0-a003-484a5324a262 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:53:06.236086 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d756b5e-6168-41c0-a003-484a5324a262 None admin] RBAC: Authorization granted {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:53:06.369571 dv-cinder-851351-1-smb devstack@keystone.service[352328]: [pid: 352328|app: 0|req: 101/206] 10.222.0.42 () {58 vars in 1282 bytes} [Thu Jul 28 08:53:05 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 450 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 28 08:53:06.377833 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8910147b-b784-4542-b027-7b2c8b2b6087 None admin] Authenticating user token {{(pid=352329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:53:06.448307 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG dbcounter [-] [352329] Writing DB stats keystone:SELECT=100 {{(pid=352329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:53:06.495153 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8910147b-b784-4542-b027-7b2c8b2b6087 None admin] Validating token access rules against request {{(pid=352329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:53:06.534178 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18465741-3795-4ef3-90fb-600e8e916972 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:53:06.534845 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18465741-3795-4ef3-90fb-600e8e916972 None admin] REQUEST_METHOD: `GET` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:53:06.535130 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18465741-3795-4ef3-90fb-600e8e916972 None admin] SCRIPT_NAME: `/identity` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:53:06.535598 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18465741-3795-4ef3-90fb-600e8e916972 None admin] PATH_INFO: `/v3/projects/9af593aec02c450aa4ce9c48ff4c6a1f` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:53:06.541372 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18465741-3795-4ef3-90fb-600e8e916972 None admin] RBAC: Authorizing `identity:get_project(project_id=9af593aec02c450aa4ce9c48ff4c6a1f)` {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:53:06.542909 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18465741-3795-4ef3-90fb-600e8e916972 None admin] RBAC: Authorization granted {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:53:06.544625 dv-cinder-851351-1-smb devstack@keystone.service[352329]: [pid: 352329|app: 0|req: 106/207] 10.222.0.42 () {56 vars in 1186 bytes} [Thu Jul 28 08:53:06 2022] GET /identity/v3/projects/9af593aec02c450aa4ce9c48ff4c6a1f => generated 298 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:53:06.551048 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d756b5e-6168-41c0-a003-484a5324a262 None admin] Authenticating user token {{(pid=352328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:53:06.605593 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG dbcounter [-] [352328] Writing DB stats keystone:SELECT=100 {{(pid=352328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:53:06.686533 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d756b5e-6168-41c0-a003-484a5324a262 None admin] Validating token access rules against request {{(pid=352328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:53:06.722428 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1728e9ff-a4e5-4cc0-bc68-4ae7b02140ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:53:06.722985 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1728e9ff-a4e5-4cc0-bc68-4ae7b02140ed None admin] REQUEST_METHOD: `GET` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:53:06.723269 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1728e9ff-a4e5-4cc0-bc68-4ae7b02140ed None admin] SCRIPT_NAME: `/identity` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:53:06.723545 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1728e9ff-a4e5-4cc0-bc68-4ae7b02140ed None admin] PATH_INFO: `/v3/role_assignments` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:53:06.724355 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1728e9ff-a4e5-4cc0-bc68-4ae7b02140ed None admin] RBAC: Adding query filter params (role.id=3abd212955234654b7d9a8d7df33e380, scope.project.id=9af593aec02c450aa4ce9c48ff4c6a1f, user.id=6ecabd483e0c4baa8a96cf6e2a2eb9e9) {{(pid=352328) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:53:06.724691 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1728e9ff-a4e5-4cc0-bc68-4ae7b02140ed None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:53:06.726144 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1728e9ff-a4e5-4cc0-bc68-4ae7b02140ed None admin] RBAC: Authorization granted {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:53:06.732853 dv-cinder-851351-1-smb devstack@keystone.service[352328]: [pid: 352328|app: 0|req: 102/208] 10.222.0.42 () {56 vars in 1374 bytes} [Thu Jul 28 08:53:06 2022] GET /identity/v3/role_assignments?user.id=6ecabd483e0c4baa8a96cf6e2a2eb9e9&scope.project.id=9af593aec02c450aa4ce9c48ff4c6a1f&role.id=3abd212955234654b7d9a8d7df33e380 => generated 608 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:53:07.106711 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e23418e-a28b-4b87-a796-5bc1fd88474b None None] REQUEST_METHOD: `GET` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:53:07.106711 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e23418e-a28b-4b87-a796-5bc1fd88474b None None] SCRIPT_NAME: `/identity` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:53:07.106711 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e23418e-a28b-4b87-a796-5bc1fd88474b None None] PATH_INFO: `/` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:53:07.107512 dv-cinder-851351-1-smb devstack@keystone.service[352329]: [pid: 352329|app: 0|req: 107/209] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 08:53:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 08:53:07.112126 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26902bf3-1646-499b-b913-e80908673aeb None None] REQUEST_METHOD: `POST` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:53:07.112421 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26902bf3-1646-499b-b913-e80908673aeb None None] SCRIPT_NAME: `/identity` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:53:07.112723 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26902bf3-1646-499b-b913-e80908673aeb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:53:07.133773 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.auth.core [None req-26902bf3-1646-499b-b913-e80908673aeb None None] MFA Rules not processed for user `d18c063b2377412485965357671e5506`. Rule list: `[]` (Enabled: `True`). {{(pid=352328) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 08:53:07.135384 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.fernet_utils [None req-26902bf3-1646-499b-b913-e80908673aeb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=352328) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:53:07.219472 dv-cinder-851351-1-smb devstack@keystone.service[352328]: [pid: 352328|app: 0|req: 103/210] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 08:53:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 08:53:07.249141 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf954de4-13f3-4146-8d2a-113581264283 None None] REQUEST_METHOD: `GET` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:53:07.249894 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf954de4-13f3-4146-8d2a-113581264283 None None] SCRIPT_NAME: `/identity` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:53:07.250388 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf954de4-13f3-4146-8d2a-113581264283 None None] PATH_INFO: `/` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:53:07.250944 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26902bf3-1646-499b-b913-e80908673aeb None None] Authenticating user token {{(pid=352328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:53:07.252818 dv-cinder-851351-1-smb devstack@keystone.service[352329]: [pid: 352329|app: 0|req: 108/211] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 08:53:07 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 08:53:07.258608 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbe31b5-1d47-44e6-bd27-86056df90ec2 None None] REQUEST_METHOD: `POST` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:53:07.258904 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbe31b5-1d47-44e6-bd27-86056df90ec2 None None] SCRIPT_NAME: `/identity` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:53:07.259185 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbe31b5-1d47-44e6-bd27-86056df90ec2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:53:07.278130 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.auth.core [None req-1fbe31b5-1d47-44e6-bd27-86056df90ec2 None None] MFA Rules not processed for user `d18c063b2377412485965357671e5506`. Rule list: `[]` (Enabled: `True`). {{(pid=352329) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 08:53:07.279313 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.fernet_utils [None req-1fbe31b5-1d47-44e6-bd27-86056df90ec2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=352329) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:53:07.287455 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG dbcounter [-] [352328] Writing DB stats keystone:SELECT=100 {{(pid=352328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:53:07.354837 dv-cinder-851351-1-smb devstack@keystone.service[352329]: [pid: 352329|app: 0|req: 109/212] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 08:53:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 08:53:07.356209 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1269f926-5d21-4ff0-9bd5-9d807bb84810 None None] REQUEST_METHOD: `GET` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:53:07.356507 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1269f926-5d21-4ff0-9bd5-9d807bb84810 None None] SCRIPT_NAME: `/identity` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:53:07.356814 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1269f926-5d21-4ff0-9bd5-9d807bb84810 None None] PATH_INFO: `/` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:53:07.358268 dv-cinder-851351-1-smb devstack@keystone.service[352329]: [pid: 352329|app: 0|req: 110/213] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 08:53:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 08:53:07.363184 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0dbd2d0-6522-4089-b15b-f2aca527ba4a None None] REQUEST_METHOD: `GET` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:53:07.363481 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0dbd2d0-6522-4089-b15b-f2aca527ba4a None None] SCRIPT_NAME: `/identity` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:53:07.363765 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0dbd2d0-6522-4089-b15b-f2aca527ba4a None None] PATH_INFO: `/` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:53:07.365211 dv-cinder-851351-1-smb devstack@keystone.service[352329]: [pid: 352329|app: 0|req: 111/214] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 08:53:07 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 08:53:07.366093 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee45315-24e4-4659-b71e-c91c8d51dd51 None None] REQUEST_METHOD: `POST` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:53:07.366381 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee45315-24e4-4659-b71e-c91c8d51dd51 None None] SCRIPT_NAME: `/identity` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:53:07.366660 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee45315-24e4-4659-b71e-c91c8d51dd51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:53:07.380246 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26902bf3-1646-499b-b913-e80908673aeb None None] Validating token access rules against request {{(pid=352328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:53:07.385298 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.auth.core [None req-1ee45315-24e4-4659-b71e-c91c8d51dd51 None None] MFA Rules not processed for user `d18c063b2377412485965357671e5506`. Rule list: `[]` (Enabled: `True`). {{(pid=352329) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 08:53:07.386514 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.fernet_utils [None req-1ee45315-24e4-4659-b71e-c91c8d51dd51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=352329) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:53:07.414115 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce67cf4b-84d5-4f98-bb8e-bdb3c3678561 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:53:07.414774 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce67cf4b-84d5-4f98-bb8e-bdb3c3678561 None admin] REQUEST_METHOD: `GET` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:53:07.415054 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce67cf4b-84d5-4f98-bb8e-bdb3c3678561 None admin] SCRIPT_NAME: `/identity` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:53:07.415329 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce67cf4b-84d5-4f98-bb8e-bdb3c3678561 None admin] PATH_INFO: `/v3/domains/default` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:53:07.416476 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce67cf4b-84d5-4f98-bb8e-bdb3c3678561 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:53:07.417975 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce67cf4b-84d5-4f98-bb8e-bdb3c3678561 None admin] RBAC: Authorization granted {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:53:07.419597 dv-cinder-851351-1-smb devstack@keystone.service[352328]: [pid: 352328|app: 0|req: 104/215] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 08:53:07 2022] GET /identity/v3/domains/default => generated 199 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 08:53:07.420756 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea28944-b6af-426d-84e7-d1990b2622f8 None None] REQUEST_METHOD: `POST` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:53:07.421036 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea28944-b6af-426d-84e7-d1990b2622f8 None None] SCRIPT_NAME: `/identity` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:53:07.421309 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea28944-b6af-426d-84e7-d1990b2622f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:53:07.438467 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.auth.core [None req-0ea28944-b6af-426d-84e7-d1990b2622f8 None None] MFA Rules not processed for user `d18c063b2377412485965357671e5506`. Rule list: `[]` (Enabled: `True`). {{(pid=352328) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 08:53:07.439732 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.fernet_utils [None req-0ea28944-b6af-426d-84e7-d1990b2622f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=352328) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:53:07.440191 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG dbcounter [-] [352329] Writing DB stats keystone:SELECT=100 {{(pid=352329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:53:07.458978 dv-cinder-851351-1-smb devstack@keystone.service[352329]: [pid: 352329|app: 0|req: 112/216] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 08:53:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 08:53:07.459823 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee45315-24e4-4659-b71e-c91c8d51dd51 None None] Authenticating user token {{(pid=352329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:53:07.506581 dv-cinder-851351-1-smb devstack@keystone.service[352328]: [pid: 352328|app: 0|req: 105/217] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 08:53:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 08:53:07.507506 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea28944-b6af-426d-84e7-d1990b2622f8 None None] Authenticating user token {{(pid=352328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:53:07.535842 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG dbcounter [-] [352328] Writing DB stats keystone:SELECT=100 {{(pid=352328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:53:07.560569 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee45315-24e4-4659-b71e-c91c8d51dd51 None None] Validating token access rules against request {{(pid=352329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:53:07.596654 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce1198c-7974-4e88-8fa2-c3d5a4d4fdce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:53:07.597395 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce1198c-7974-4e88-8fa2-c3d5a4d4fdce None admin] REQUEST_METHOD: `GET` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:53:07.597681 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce1198c-7974-4e88-8fa2-c3d5a4d4fdce None admin] SCRIPT_NAME: `/identity` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:53:07.597959 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce1198c-7974-4e88-8fa2-c3d5a4d4fdce None admin] PATH_INFO: `/v3/roles/member` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:53:07.609201 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea28944-b6af-426d-84e7-d1990b2622f8 None None] Validating token access rules against request {{(pid=352328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:53:07.612182 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ce1198c-7974-4e88-8fa2-c3d5a4d4fdce None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 08:53:07.619821 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application [None req-9ce1198c-7974-4e88-8fa2-c3d5a4d4fdce None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 28 08:53:07.619821 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:53:07.619821 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:53:07.619821 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:53:07.619821 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:53:07.619821 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:53:07.619821 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:53:07.619821 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:53:07.619821 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:53:07.619821 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:53:07.619821 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:53:07.619821 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:53:07.619821 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 08:53:07.619821 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 08:53:07.619821 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 08:53:07.619821 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 08:53:07.621110 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 08:53:07.621110 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 08:53:07.621110 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 08:53:07.621110 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 08:53:07.621110 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:53:07.621110 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:53:07.621110 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:53:07.621110 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:53:07.621110 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:53:07.621110 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:53:07.621110 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:53:07.621110 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application with Lock( Jul 28 08:53:07.621110 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:53:07.621110 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:53:07.621110 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:53:07.621110 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:53:07.622199 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:53:07.622199 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:53:07.622199 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:53:07.622199 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:53:07.622199 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 08:53:07.622199 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 08:53:07.622199 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 08:53:07.622199 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 08:53:07.622199 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 08:53:07.622199 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 08:53:07.622199 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 28 08:53:07.622199 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application Jul 28 08:53:07.622199 dv-cinder-851351-1-smb devstack@keystone.service[352329]: [pid: 352329|app: 0|req: 113/218] 10.222.0.42 () {56 vars in 1099 bytes} [Thu Jul 28 08:53:07 2022] GET /identity/v3/roles/member => generated 84 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:53:07.623619 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce1198c-7974-4e88-8fa2-c3d5a4d4fdce None admin] Authenticating user token {{(pid=352329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:53:07.652499 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c66d2e-6f86-4edd-aece-563dbbd11ef6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:53:07.654219 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c66d2e-6f86-4edd-aece-563dbbd11ef6 None admin] REQUEST_METHOD: `POST` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:53:07.654920 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c66d2e-6f86-4edd-aece-563dbbd11ef6 None admin] SCRIPT_NAME: `/identity` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:53:07.655640 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c66d2e-6f86-4edd-aece-563dbbd11ef6 None admin] PATH_INFO: `/v3/users` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:53:07.656837 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74c66d2e-6f86-4edd-aece-563dbbd11ef6 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:53:07.659126 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74c66d2e-6f86-4edd-aece-563dbbd11ef6 None admin] RBAC: Authorization granted {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:53:07.682064 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG dbcounter [-] [352329] Writing DB stats keystone:SELECT=100 {{(pid=352329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:53:07.695052 dv-cinder-851351-1-smb devstack@keystone.service[352328]: [pid: 352328|app: 0|req: 106/219] 10.222.0.42 () {60 vars in 1132 bytes} [Thu Jul 28 08:53:07 2022] POST /identity/v3/users => generated 297 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 08:53:07.695052 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c66d2e-6f86-4edd-aece-563dbbd11ef6 None admin] Authenticating user token {{(pid=352328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:53:07.764482 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce1198c-7974-4e88-8fa2-c3d5a4d4fdce None admin] Validating token access rules against request {{(pid=352329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:53:07.791065 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG dbcounter [-] [352328] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=352328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:53:07.809426 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6abcb582-f735-4632-9d0a-2e61fbf88daa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:53:07.810252 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abcb582-f735-4632-9d0a-2e61fbf88daa None admin] REQUEST_METHOD: `GET` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:53:07.810650 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abcb582-f735-4632-9d0a-2e61fbf88daa None admin] SCRIPT_NAME: `/identity` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:53:07.810858 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abcb582-f735-4632-9d0a-2e61fbf88daa None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:53:07.812995 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c66d2e-6f86-4edd-aece-563dbbd11ef6 None admin] Validating token access rules against request {{(pid=352328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:53:07.823965 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6abcb582-f735-4632-9d0a-2e61fbf88daa None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 08:53:07.829676 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application [None req-6abcb582-f735-4632-9d0a-2e61fbf88daa None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 28 08:53:07.829676 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:53:07.829676 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:53:07.829676 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:53:07.829676 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:53:07.829676 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:53:07.829676 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:53:07.829676 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:53:07.829676 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:53:07.829676 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:53:07.829676 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:53:07.829676 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:53:07.829676 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 08:53:07.829676 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 08:53:07.829676 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 08:53:07.829676 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 08:53:07.830974 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 08:53:07.830974 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 08:53:07.830974 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 08:53:07.830974 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 08:53:07.830974 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:53:07.830974 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:53:07.830974 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:53:07.830974 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:53:07.830974 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:53:07.830974 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:53:07.830974 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:53:07.830974 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application with Lock( Jul 28 08:53:07.830974 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:53:07.830974 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:53:07.830974 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:53:07.830974 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:53:07.833234 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:53:07.833234 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:53:07.833234 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:53:07.833234 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:53:07.833234 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 08:53:07.833234 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 08:53:07.833234 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 08:53:07.833234 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 08:53:07.833234 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 08:53:07.833234 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 08:53:07.833234 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 28 08:53:07.833234 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application Jul 28 08:53:07.833234 dv-cinder-851351-1-smb devstack@keystone.service[352329]: [pid: 352329|app: 0|req: 114/220] 10.222.0.42 () {56 vars in 1114 bytes} [Thu Jul 28 08:53:07 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:53:07.834442 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6abcb582-f735-4632-9d0a-2e61fbf88daa None admin] Authenticating user token {{(pid=352329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:53:07.856773 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e36f2b-a4be-4e26-bf4c-3a91f031a2d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:53:07.857651 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e36f2b-a4be-4e26-bf4c-3a91f031a2d3 None admin] REQUEST_METHOD: `GET` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:53:07.858676 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e36f2b-a4be-4e26-bf4c-3a91f031a2d3 None admin] SCRIPT_NAME: `/identity` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:53:07.858676 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e36f2b-a4be-4e26-bf4c-3a91f031a2d3 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:53:07.871122 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87e36f2b-a4be-4e26-bf4c-3a91f031a2d3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 08:53:07.877208 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application [None req-87e36f2b-a4be-4e26-bf4c-3a91f031a2d3 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 08:53:07.877208 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:53:07.877208 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:53:07.877208 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:53:07.877208 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:53:07.877208 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:53:07.877208 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:53:07.877208 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:53:07.877208 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:53:07.877208 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:53:07.877208 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:53:07.877208 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:53:07.877208 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 08:53:07.877208 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 08:53:07.877208 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 08:53:07.877208 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 08:53:07.878631 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 08:53:07.878631 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 08:53:07.878631 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 08:53:07.878631 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 08:53:07.878631 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:53:07.878631 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:53:07.878631 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:53:07.878631 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:53:07.878631 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:53:07.878631 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:53:07.878631 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:53:07.878631 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application with Lock( Jul 28 08:53:07.878631 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:53:07.878631 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:53:07.878631 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:53:07.878631 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:53:07.879875 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:53:07.879875 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:53:07.879875 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:53:07.879875 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:53:07.879875 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 08:53:07.879875 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 08:53:07.879875 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 08:53:07.879875 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 08:53:07.879875 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 08:53:07.879875 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 08:53:07.879875 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 08:53:07.879875 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application Jul 28 08:53:07.879875 dv-cinder-851351-1-smb devstack@keystone.service[352328]: [pid: 352328|app: 0|req: 107/221] 10.222.0.42 () {56 vars in 1096 bytes} [Thu Jul 28 08:53:07 2022] GET /identity/v3/roles/admin => generated 83 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:53:07.879875 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e36f2b-a4be-4e26-bf4c-3a91f031a2d3 None admin] Authenticating user token {{(pid=352328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:53:07.991905 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6abcb582-f735-4632-9d0a-2e61fbf88daa None admin] Validating token access rules against request {{(pid=352329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:53:07.996877 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG dbcounter [-] [352329] Writing DB stats keystone:SELECT=100 {{(pid=352329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:53:08.012084 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e36f2b-a4be-4e26-bf4c-3a91f031a2d3 None admin] Validating token access rules against request {{(pid=352328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:53:08.046407 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a7e42c-469b-4fe7-bf64-5987f3d5a5dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:53:08.047249 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a7e42c-469b-4fe7-bf64-5987f3d5a5dd None admin] REQUEST_METHOD: `GET` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:53:08.047535 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a7e42c-469b-4fe7-bf64-5987f3d5a5dd None admin] SCRIPT_NAME: `/identity` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:53:08.048453 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a7e42c-469b-4fe7-bf64-5987f3d5a5dd None admin] PATH_INFO: `/v3/roles` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:53:08.049690 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4a7e42c-469b-4fe7-bf64-5987f3d5a5dd None admin] RBAC: Adding query filter params (name=member) {{(pid=352329) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:53:08.049892 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4a7e42c-469b-4fe7-bf64-5987f3d5a5dd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:53:08.051843 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4a7e42c-469b-4fe7-bf64-5987f3d5a5dd None admin] RBAC: Authorization granted {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:53:08.057582 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f31247d1-2444-4da1-93e5-7575e6b13755 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:53:08.058417 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31247d1-2444-4da1-93e5-7575e6b13755 None admin] REQUEST_METHOD: `GET` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:53:08.059784 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31247d1-2444-4da1-93e5-7575e6b13755 None admin] SCRIPT_NAME: `/identity` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:53:08.059784 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31247d1-2444-4da1-93e5-7575e6b13755 None admin] PATH_INFO: `/v3/roles` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:53:08.059784 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f31247d1-2444-4da1-93e5-7575e6b13755 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=352328) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:53:08.060242 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f31247d1-2444-4da1-93e5-7575e6b13755 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:53:08.062445 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f31247d1-2444-4da1-93e5-7575e6b13755 None admin] RBAC: Authorization granted {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:53:08.062628 dv-cinder-851351-1-smb devstack@keystone.service[352329]: [pid: 352329|app: 0|req: 115/222] 10.222.0.42 () {56 vars in 1101 bytes} [Thu Jul 28 08:53:07 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:53:08.063219 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a7e42c-469b-4fe7-bf64-5987f3d5a5dd None admin] Authenticating user token {{(pid=352329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:53:08.073017 dv-cinder-851351-1-smb devstack@keystone.service[352328]: [pid: 352328|app: 0|req: 108/223] 10.222.0.42 () {56 vars in 1111 bytes} [Thu Jul 28 08:53:07 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:53:08.073717 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f31247d1-2444-4da1-93e5-7575e6b13755 None admin] Authenticating user token {{(pid=352328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:53:08.090666 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG dbcounter [-] [352328] Writing DB stats keystone:SELECT=100 {{(pid=352328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:53:08.185247 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a7e42c-469b-4fe7-bf64-5987f3d5a5dd None admin] Validating token access rules against request {{(pid=352329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:53:08.220774 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f31247d1-2444-4da1-93e5-7575e6b13755 None admin] Validating token access rules against request {{(pid=352328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:53:08.236527 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68f77b1-c7b9-4a1e-ad77-cf06a340553e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:53:08.237874 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68f77b1-c7b9-4a1e-ad77-cf06a340553e None admin] REQUEST_METHOD: `GET` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:53:08.238815 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68f77b1-c7b9-4a1e-ad77-cf06a340553e None admin] SCRIPT_NAME: `/identity` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:53:08.239763 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68f77b1-c7b9-4a1e-ad77-cf06a340553e None admin] PATH_INFO: `/v3/roles` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:53:08.241090 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c68f77b1-c7b9-4a1e-ad77-cf06a340553e None admin] RBAC: Adding query filter params (name=admin) {{(pid=352329) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:53:08.241986 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c68f77b1-c7b9-4a1e-ad77-cf06a340553e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:53:08.243682 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c68f77b1-c7b9-4a1e-ad77-cf06a340553e None admin] RBAC: Authorization granted {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:53:08.256436 dv-cinder-851351-1-smb devstack@keystone.service[352329]: [pid: 352329|app: 0|req: 116/224] 10.222.0.42 () {56 vars in 1099 bytes} [Thu Jul 28 08:53:08 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:53:08.257645 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68f77b1-c7b9-4a1e-ad77-cf06a340553e None admin] Authenticating user token {{(pid=352329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:53:08.262345 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e01446f-d17e-43cc-a952-74064ed96c11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:53:08.263045 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e01446f-d17e-43cc-a952-74064ed96c11 None admin] REQUEST_METHOD: `GET` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:53:08.263298 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e01446f-d17e-43cc-a952-74064ed96c11 None admin] SCRIPT_NAME: `/identity` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:53:08.263574 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e01446f-d17e-43cc-a952-74064ed96c11 None admin] PATH_INFO: `/v3/users/747d1edf4168468ca4d6cbe7589cc7dd` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:53:08.283896 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e01446f-d17e-43cc-a952-74064ed96c11 None admin] RBAC: Authorizing `identity:get_user(user_id=747d1edf4168468ca4d6cbe7589cc7dd)` {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:53:08.285444 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e01446f-d17e-43cc-a952-74064ed96c11 None admin] RBAC: Authorization granted {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:53:08.288742 dv-cinder-851351-1-smb devstack@keystone.service[352328]: [pid: 352328|app: 0|req: 109/225] 10.222.0.42 () {56 vars in 1177 bytes} [Thu Jul 28 08:53:08 2022] GET /identity/v3/users/747d1edf4168468ca4d6cbe7589cc7dd => generated 297 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:53:08.289955 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e01446f-d17e-43cc-a952-74064ed96c11 None admin] Authenticating user token {{(pid=352328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:53:08.304469 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG dbcounter [-] [352329] Writing DB stats keystone:SELECT=100 {{(pid=352329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:53:08.361066 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG dbcounter [-] [352328] Writing DB stats keystone:SELECT=100 {{(pid=352328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:53:08.397119 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68f77b1-c7b9-4a1e-ad77-cf06a340553e None admin] Validating token access rules against request {{(pid=352329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:53:08.412233 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e01446f-d17e-43cc-a952-74064ed96c11 None admin] Validating token access rules against request {{(pid=352328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:53:08.440276 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbce71df-0b1b-4cec-9658-0fb127939554 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:53:08.441899 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbce71df-0b1b-4cec-9658-0fb127939554 None admin] REQUEST_METHOD: `GET` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:53:08.442469 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbce71df-0b1b-4cec-9658-0fb127939554 None admin] SCRIPT_NAME: `/identity` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:53:08.442996 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbce71df-0b1b-4cec-9658-0fb127939554 None admin] PATH_INFO: `/v3/users/393f088d556d4599ba13edfd35b7951a` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:53:08.444903 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbce71df-0b1b-4cec-9658-0fb127939554 None admin] RBAC: Authorizing `identity:get_user(user_id=393f088d556d4599ba13edfd35b7951a)` {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:53:08.446649 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbce71df-0b1b-4cec-9658-0fb127939554 None admin] RBAC: Authorization granted {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:53:08.448597 dv-cinder-851351-1-smb devstack@keystone.service[352329]: [pid: 352329|app: 0|req: 117/226] 10.222.0.42 () {56 vars in 1177 bytes} [Thu Jul 28 08:53:08 2022] GET /identity/v3/users/393f088d556d4599ba13edfd35b7951a => generated 283 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:53:08.449983 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbce71df-0b1b-4cec-9658-0fb127939554 None admin] Authenticating user token {{(pid=352329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:53:08.453766 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556af37f-3f8a-4199-8d0a-a93425fb92b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:53:08.454964 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556af37f-3f8a-4199-8d0a-a93425fb92b9 None admin] REQUEST_METHOD: `GET` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:53:08.455331 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556af37f-3f8a-4199-8d0a-a93425fb92b9 None admin] SCRIPT_NAME: `/identity` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:53:08.455684 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556af37f-3f8a-4199-8d0a-a93425fb92b9 None admin] PATH_INFO: `/v3/users/393f088d556d4599ba13edfd35b7951a` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:53:08.461941 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-556af37f-3f8a-4199-8d0a-a93425fb92b9 None admin] RBAC: Authorizing `identity:get_user(user_id=393f088d556d4599ba13edfd35b7951a)` {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:53:08.464174 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-556af37f-3f8a-4199-8d0a-a93425fb92b9 None admin] RBAC: Authorization granted {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:53:08.466550 dv-cinder-851351-1-smb devstack@keystone.service[352328]: [pid: 352328|app: 0|req: 110/227] 10.222.0.42 () {56 vars in 1177 bytes} [Thu Jul 28 08:53:08 2022] GET /identity/v3/users/393f088d556d4599ba13edfd35b7951a => generated 283 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:53:08.467420 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556af37f-3f8a-4199-8d0a-a93425fb92b9 None admin] Authenticating user token {{(pid=352328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:53:08.588073 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556af37f-3f8a-4199-8d0a-a93425fb92b9 None admin] Validating token access rules against request {{(pid=352328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:53:08.593943 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG dbcounter [-] [352329] Writing DB stats keystone:SELECT=100 {{(pid=352329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:53:08.603078 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbce71df-0b1b-4cec-9658-0fb127939554 None admin] Validating token access rules against request {{(pid=352329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:53:08.635301 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG dbcounter [-] [352328] Writing DB stats keystone:SELECT=100 {{(pid=352328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:53:08.642650 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-684cc456-f5ff-44b2-a59d-e69f735e0288 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:53:08.643330 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684cc456-f5ff-44b2-a59d-e69f735e0288 None admin] REQUEST_METHOD: `GET` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:53:08.643612 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684cc456-f5ff-44b2-a59d-e69f735e0288 None admin] SCRIPT_NAME: `/identity` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:53:08.643889 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684cc456-f5ff-44b2-a59d-e69f735e0288 None admin] PATH_INFO: `/v3/projects/be5ef7d0266e453784a39d297f9b131d` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:53:08.644217 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc527b2-7535-4fdb-a6f8-54fe95306fa2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:53:08.645108 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc527b2-7535-4fdb-a6f8-54fe95306fa2 None admin] REQUEST_METHOD: `GET` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:53:08.645242 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-684cc456-f5ff-44b2-a59d-e69f735e0288 None admin] RBAC: Authorizing `identity:get_project(project_id=be5ef7d0266e453784a39d297f9b131d)` {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:53:08.645729 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc527b2-7535-4fdb-a6f8-54fe95306fa2 None admin] SCRIPT_NAME: `/identity` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:53:08.646210 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc527b2-7535-4fdb-a6f8-54fe95306fa2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:53:08.646635 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-684cc456-f5ff-44b2-a59d-e69f735e0288 None admin] RBAC: Authorization granted {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:53:08.648382 dv-cinder-851351-1-smb devstack@keystone.service[352328]: [pid: 352328|app: 0|req: 111/228] 10.222.0.42 () {56 vars in 1186 bytes} [Thu Jul 28 08:53:08 2022] GET /identity/v3/projects/be5ef7d0266e453784a39d297f9b131d => generated 302 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:53:08.653770 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-684cc456-f5ff-44b2-a59d-e69f735e0288 None admin] Authenticating user token {{(pid=352328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:53:08.739764 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc527b2-7535-4fdb-a6f8-54fe95306fa2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:53:08.742162 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc527b2-7535-4fdb-a6f8-54fe95306fa2 None admin] RBAC: Authorization granted {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:53:08.773037 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-684cc456-f5ff-44b2-a59d-e69f735e0288 None admin] Validating token access rules against request {{(pid=352328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:53:08.815283 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ec875d-32d2-4985-b436-9969d03b3a91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:53:08.816042 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ec875d-32d2-4985-b436-9969d03b3a91 None admin] REQUEST_METHOD: `GET` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:53:08.816482 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ec875d-32d2-4985-b436-9969d03b3a91 None admin] SCRIPT_NAME: `/identity` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:53:08.816779 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ec875d-32d2-4985-b436-9969d03b3a91 None admin] PATH_INFO: `/v3/projects/be5ef7d0266e453784a39d297f9b131d` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:53:08.818092 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17ec875d-32d2-4985-b436-9969d03b3a91 None admin] RBAC: Authorizing `identity:get_project(project_id=be5ef7d0266e453784a39d297f9b131d)` {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:53:08.819636 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17ec875d-32d2-4985-b436-9969d03b3a91 None admin] RBAC: Authorization granted {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:53:08.826232 dv-cinder-851351-1-smb devstack@keystone.service[352328]: [pid: 352328|app: 0|req: 112/229] 10.222.0.42 () {56 vars in 1186 bytes} [Thu Jul 28 08:53:08 2022] GET /identity/v3/projects/be5ef7d0266e453784a39d297f9b131d => generated 302 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:53:08.826232 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ec875d-32d2-4985-b436-9969d03b3a91 None admin] Authenticating user token {{(pid=352328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:53:08.867002 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG dbcounter [-] [352329] Writing DB stats keystone:SELECT=100 {{(pid=352329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:53:08.875907 dv-cinder-851351-1-smb devstack@keystone.service[352329]: [pid: 352329|app: 0|req: 118/230] 10.222.0.42 () {58 vars in 1282 bytes} [Thu Jul 28 08:53:08 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 426 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 28 08:53:08.876972 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc527b2-7535-4fdb-a6f8-54fe95306fa2 None admin] Authenticating user token {{(pid=352329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:53:08.912552 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG dbcounter [-] [352328] Writing DB stats keystone:SELECT=100 {{(pid=352328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:53:08.961274 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ec875d-32d2-4985-b436-9969d03b3a91 None admin] Validating token access rules against request {{(pid=352328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:53:09.004948 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc527b2-7535-4fdb-a6f8-54fe95306fa2 None admin] Validating token access rules against request {{(pid=352329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:53:09.024613 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-978a8132-6a6d-4b73-84d0-2f93c8ab1321 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:53:09.024613 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978a8132-6a6d-4b73-84d0-2f93c8ab1321 None admin] REQUEST_METHOD: `PUT` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:53:09.024613 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978a8132-6a6d-4b73-84d0-2f93c8ab1321 None admin] SCRIPT_NAME: `/identity` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:53:09.024613 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978a8132-6a6d-4b73-84d0-2f93c8ab1321 None admin] PATH_INFO: `/v3/projects/be5ef7d0266e453784a39d297f9b131d/users/393f088d556d4599ba13edfd35b7951a/roles/a4fa43cd6d914398a0790a1516c83d08` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:53:09.025122 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-978a8132-6a6d-4b73-84d0-2f93c8ab1321 None admin] RBAC: Authorizing `identity:create_grant(project_id=be5ef7d0266e453784a39d297f9b131d, user_id=393f088d556d4599ba13edfd35b7951a, role_id=a4fa43cd6d914398a0790a1516c83d08)` {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:53:09.025122 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-978a8132-6a6d-4b73-84d0-2f93c8ab1321 None admin] RBAC: Authorization granted {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:53:09.042386 dv-cinder-851351-1-smb devstack@keystone.service[352328]: [pid: 352328|app: 0|req: 113/231] 10.222.0.42 () {58 vars in 1439 bytes} [Thu Jul 28 08:53:08 2022] PUT /identity/v3/projects/be5ef7d0266e453784a39d297f9b131d/users/393f088d556d4599ba13edfd35b7951a/roles/a4fa43cd6d914398a0790a1516c83d08 => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 08:53:09.043542 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-978a8132-6a6d-4b73-84d0-2f93c8ab1321 None admin] Authenticating user token {{(pid=352328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:53:09.072938 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-097e0c20-d4e6-4e1b-8552-1e77572aa17f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:53:09.073668 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097e0c20-d4e6-4e1b-8552-1e77572aa17f None admin] REQUEST_METHOD: `PUT` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:53:09.073948 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097e0c20-d4e6-4e1b-8552-1e77572aa17f None admin] SCRIPT_NAME: `/identity` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:53:09.074228 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097e0c20-d4e6-4e1b-8552-1e77572aa17f None admin] PATH_INFO: `/v3/projects/be5ef7d0266e453784a39d297f9b131d/users/393f088d556d4599ba13edfd35b7951a/roles/280023171b4a45efb67c036ff237bb3c` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:53:09.076815 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-097e0c20-d4e6-4e1b-8552-1e77572aa17f None admin] RBAC: Authorizing `identity:create_grant(project_id=be5ef7d0266e453784a39d297f9b131d, user_id=393f088d556d4599ba13edfd35b7951a, role_id=280023171b4a45efb67c036ff237bb3c)` {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:53:09.078888 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-097e0c20-d4e6-4e1b-8552-1e77572aa17f None admin] RBAC: Authorization granted {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:53:09.111345 dv-cinder-851351-1-smb devstack@keystone.service[352329]: [pid: 352329|app: 0|req: 119/232] 10.222.0.42 () {58 vars in 1439 bytes} [Thu Jul 28 08:53:08 2022] PUT /identity/v3/projects/be5ef7d0266e453784a39d297f9b131d/users/393f088d556d4599ba13edfd35b7951a/roles/280023171b4a45efb67c036ff237bb3c => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 08:53:09.170305 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-978a8132-6a6d-4b73-84d0-2f93c8ab1321 None admin] Validating token access rules against request {{(pid=352328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:53:09.203306 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG dbcounter [-] [352328] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=352328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:53:09.213317 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d347c3-dcc8-49f5-9a29-d68ada102df0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:53:09.214115 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d347c3-dcc8-49f5-9a29-d68ada102df0 None admin] REQUEST_METHOD: `GET` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:53:09.214410 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d347c3-dcc8-49f5-9a29-d68ada102df0 None admin] SCRIPT_NAME: `/identity` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:53:09.214691 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d347c3-dcc8-49f5-9a29-d68ada102df0 None admin] PATH_INFO: `/v3/projects/be5ef7d0266e453784a39d297f9b131d` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:53:09.216018 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d347c3-dcc8-49f5-9a29-d68ada102df0 None admin] RBAC: Authorizing `identity:get_project(project_id=be5ef7d0266e453784a39d297f9b131d)` {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:53:09.217681 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d347c3-dcc8-49f5-9a29-d68ada102df0 None admin] RBAC: Authorization granted {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:53:09.223094 dv-cinder-851351-1-smb devstack@keystone.service[352328]: [pid: 352328|app: 0|req: 114/233] 10.222.0.42 () {56 vars in 1186 bytes} [Thu Jul 28 08:53:09 2022] GET /identity/v3/projects/be5ef7d0266e453784a39d297f9b131d => generated 302 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:53:09.227483 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-097e0c20-d4e6-4e1b-8552-1e77572aa17f None admin] Authenticating user token {{(pid=352329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:53:09.309234 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG dbcounter [-] [352329] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=352329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:53:09.382541 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-097e0c20-d4e6-4e1b-8552-1e77572aa17f None admin] Validating token access rules against request {{(pid=352329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:53:09.436470 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3fa7fc0-0ef7-4c93-9cca-c3155e3bd865 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:53:09.437314 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3fa7fc0-0ef7-4c93-9cca-c3155e3bd865 None admin] REQUEST_METHOD: `GET` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:53:09.439047 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3fa7fc0-0ef7-4c93-9cca-c3155e3bd865 None admin] SCRIPT_NAME: `/identity` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:53:09.439047 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3fa7fc0-0ef7-4c93-9cca-c3155e3bd865 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:53:09.439047 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3fa7fc0-0ef7-4c93-9cca-c3155e3bd865 None admin] RBAC: Adding query filter params (role.id=16a3fc3aca974c47a329c2781b0be93a, scope.project.id=be5ef7d0266e453784a39d297f9b131d, user.id=747d1edf4168468ca4d6cbe7589cc7dd) {{(pid=352329) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:53:09.439462 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3fa7fc0-0ef7-4c93-9cca-c3155e3bd865 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:53:09.442669 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3fa7fc0-0ef7-4c93-9cca-c3155e3bd865 None admin] RBAC: Authorization granted {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:53:09.452720 dv-cinder-851351-1-smb devstack@keystone.service[352329]: [pid: 352329|app: 0|req: 120/234] 10.222.0.42 () {56 vars in 1374 bytes} [Thu Jul 28 08:53:09 2022] GET /identity/v3/role_assignments?user.id=747d1edf4168468ca4d6cbe7589cc7dd&scope.project.id=be5ef7d0266e453784a39d297f9b131d&role.id=16a3fc3aca974c47a329c2781b0be93a => generated 259 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:53:10.047600 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fefc9e0f-eec0-4922-b4f0-1096662048de None None] REQUEST_METHOD: `GET` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:53:10.048301 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fefc9e0f-eec0-4922-b4f0-1096662048de None None] SCRIPT_NAME: `/identity` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:53:10.048301 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fefc9e0f-eec0-4922-b4f0-1096662048de None None] PATH_INFO: `/` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:53:10.050064 dv-cinder-851351-1-smb devstack@keystone.service[352328]: [pid: 352328|app: 0|req: 115/235] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 08:53:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 08:53:10.055526 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70ef3b1-31a6-4c51-85a6-4f76d3e4f36d None None] REQUEST_METHOD: `POST` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:53:10.055818 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70ef3b1-31a6-4c51-85a6-4f76d3e4f36d None None] SCRIPT_NAME: `/identity` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:53:10.056092 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70ef3b1-31a6-4c51-85a6-4f76d3e4f36d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:53:10.072909 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f6050f-818f-4f90-a484-5aa625a1eef4 None None] REQUEST_METHOD: `GET` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:53:10.073281 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f6050f-818f-4f90-a484-5aa625a1eef4 None None] SCRIPT_NAME: `/identity` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:53:10.073478 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f6050f-818f-4f90-a484-5aa625a1eef4 None None] PATH_INFO: `/` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:53:10.075046 dv-cinder-851351-1-smb devstack@keystone.service[352328]: [pid: 352328|app: 0|req: 116/236] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 08:53:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 08:53:10.080835 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce479c0-c7a5-405d-9fea-7d2b9ec11bce None None] REQUEST_METHOD: `POST` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:53:10.081153 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce479c0-c7a5-405d-9fea-7d2b9ec11bce None None] SCRIPT_NAME: `/identity` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:53:10.081378 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce479c0-c7a5-405d-9fea-7d2b9ec11bce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:53:10.082098 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.auth.core [None req-c70ef3b1-31a6-4c51-85a6-4f76d3e4f36d None None] MFA Rules not processed for user `d18c063b2377412485965357671e5506`. Rule list: `[]` (Enabled: `True`). {{(pid=352329) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 08:53:10.083344 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.fernet_utils [None req-c70ef3b1-31a6-4c51-85a6-4f76d3e4f36d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=352329) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:53:10.110081 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.auth.core [None req-2ce479c0-c7a5-405d-9fea-7d2b9ec11bce None None] MFA Rules not processed for user `d18c063b2377412485965357671e5506`. Rule list: `[]` (Enabled: `True`). {{(pid=352328) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 08:53:10.112124 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.fernet_utils [None req-2ce479c0-c7a5-405d-9fea-7d2b9ec11bce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=352328) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:53:10.187950 dv-cinder-851351-1-smb devstack@keystone.service[352329]: [pid: 352329|app: 0|req: 121/237] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 08:53:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 08:53:10.218758 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70ef3b1-31a6-4c51-85a6-4f76d3e4f36d None None] Authenticating user token {{(pid=352329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:53:10.252180 dv-cinder-851351-1-smb devstack@keystone.service[352328]: [pid: 352328|app: 0|req: 117/238] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 08:53:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 28 08:53:10.275151 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG dbcounter [-] [352329] Writing DB stats keystone:SELECT=100 {{(pid=352329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:53:10.292562 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce479c0-c7a5-405d-9fea-7d2b9ec11bce None None] Authenticating user token {{(pid=352328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:53:10.371581 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70ef3b1-31a6-4c51-85a6-4f76d3e4f36d None None] Validating token access rules against request {{(pid=352329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:53:10.435962 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81223017-a12c-4610-aea1-f908a0aa654d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:53:10.436644 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81223017-a12c-4610-aea1-f908a0aa654d None admin] REQUEST_METHOD: `GET` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:53:10.437564 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81223017-a12c-4610-aea1-f908a0aa654d None admin] SCRIPT_NAME: `/identity` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:53:10.437564 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81223017-a12c-4610-aea1-f908a0aa654d None admin] PATH_INFO: `/v3/roles/reader` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:53:10.460588 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81223017-a12c-4610-aea1-f908a0aa654d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 08:53:10.465704 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application [None req-81223017-a12c-4610-aea1-f908a0aa654d None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 28 08:53:10.465704 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:53:10.465704 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:53:10.465704 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:53:10.465704 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:53:10.465704 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:53:10.465704 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:53:10.465704 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:53:10.465704 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:53:10.465704 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:53:10.465704 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:53:10.465704 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:53:10.465704 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 08:53:10.465704 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 08:53:10.465704 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 08:53:10.465704 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 08:53:10.466826 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 08:53:10.466826 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 08:53:10.466826 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 08:53:10.466826 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 08:53:10.466826 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:53:10.466826 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:53:10.466826 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:53:10.466826 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:53:10.466826 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:53:10.466826 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:53:10.466826 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:53:10.466826 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application with Lock( Jul 28 08:53:10.466826 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:53:10.466826 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:53:10.466826 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:53:10.466826 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:53:10.467863 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:53:10.467863 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:53:10.467863 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:53:10.467863 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:53:10.467863 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 08:53:10.467863 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 08:53:10.467863 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 08:53:10.467863 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 08:53:10.467863 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 08:53:10.467863 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 08:53:10.467863 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 28 08:53:10.467863 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application Jul 28 08:53:10.467863 dv-cinder-851351-1-smb devstack@keystone.service[352329]: [pid: 352329|app: 0|req: 122/239] 10.222.0.42 () {56 vars in 1099 bytes} [Thu Jul 28 08:53:10 2022] GET /identity/v3/roles/reader => generated 84 bytes in 249 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 08:53:10.475155 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81223017-a12c-4610-aea1-f908a0aa654d None admin] Authenticating user token {{(pid=352329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:53:10.488697 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce479c0-c7a5-405d-9fea-7d2b9ec11bce None None] Validating token access rules against request {{(pid=352328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:53:10.538252 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG dbcounter [-] [352328] Writing DB stats keystone:SELECT=100 {{(pid=352328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:53:10.554958 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03de39e6-cb19-4907-a749-f464e1ed6f10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:53:10.555642 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03de39e6-cb19-4907-a749-f464e1ed6f10 None admin] REQUEST_METHOD: `GET` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:53:10.555927 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03de39e6-cb19-4907-a749-f464e1ed6f10 None admin] SCRIPT_NAME: `/identity` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:53:10.556205 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03de39e6-cb19-4907-a749-f464e1ed6f10 None admin] PATH_INFO: `/v3/domains/default` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:53:10.557634 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03de39e6-cb19-4907-a749-f464e1ed6f10 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:53:10.563531 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03de39e6-cb19-4907-a749-f464e1ed6f10 None admin] RBAC: Authorization granted {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:53:10.565561 dv-cinder-851351-1-smb devstack@keystone.service[352328]: [pid: 352328|app: 0|req: 118/240] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 08:53:10 2022] GET /identity/v3/domains/default => generated 199 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 08:53:10.571624 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03de39e6-cb19-4907-a749-f464e1ed6f10 None admin] Authenticating user token {{(pid=352328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:53:10.691378 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81223017-a12c-4610-aea1-f908a0aa654d None admin] Validating token access rules against request {{(pid=352329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:53:10.715887 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG dbcounter [-] [352329] Writing DB stats keystone:SELECT=100 {{(pid=352329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:53:10.745837 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b5baaa-9dff-470b-8c9b-2f7dc85982a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:53:10.746506 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b5baaa-9dff-470b-8c9b-2f7dc85982a4 None admin] REQUEST_METHOD: `GET` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:53:10.746795 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b5baaa-9dff-470b-8c9b-2f7dc85982a4 None admin] SCRIPT_NAME: `/identity` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:53:10.747080 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b5baaa-9dff-470b-8c9b-2f7dc85982a4 None admin] PATH_INFO: `/v3/roles` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:53:10.747882 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24b5baaa-9dff-470b-8c9b-2f7dc85982a4 None admin] RBAC: Adding query filter params (name=reader) {{(pid=352329) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:53:10.748205 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24b5baaa-9dff-470b-8c9b-2f7dc85982a4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:53:10.749743 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24b5baaa-9dff-470b-8c9b-2f7dc85982a4 None admin] RBAC: Authorization granted {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:53:10.759464 dv-cinder-851351-1-smb devstack@keystone.service[352329]: [pid: 352329|app: 0|req: 123/241] 10.222.0.42 () {56 vars in 1101 bytes} [Thu Jul 28 08:53:10 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 285 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:53:10.772499 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03de39e6-cb19-4907-a749-f464e1ed6f10 None admin] Validating token access rules against request {{(pid=352328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:53:10.773950 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b5baaa-9dff-470b-8c9b-2f7dc85982a4 None admin] Authenticating user token {{(pid=352329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:53:10.818713 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3e4e35-4a63-4b13-850a-51a610c72638 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:53:10.819384 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3e4e35-4a63-4b13-850a-51a610c72638 None admin] REQUEST_METHOD: `POST` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:53:10.819671 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3e4e35-4a63-4b13-850a-51a610c72638 None admin] SCRIPT_NAME: `/identity` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:53:10.819940 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3e4e35-4a63-4b13-850a-51a610c72638 None admin] PATH_INFO: `/v3/users` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:53:10.820882 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca3e4e35-4a63-4b13-850a-51a610c72638 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:53:10.822501 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca3e4e35-4a63-4b13-850a-51a610c72638 None admin] RBAC: Authorization granted {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:53:10.864579 dv-cinder-851351-1-smb devstack@keystone.service[352328]: [pid: 352328|app: 0|req: 119/242] 10.222.0.42 () {60 vars in 1132 bytes} [Thu Jul 28 08:53:10 2022] POST /identity/v3/users => generated 293 bytes in 293 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 08:53:10.896417 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b5baaa-9dff-470b-8c9b-2f7dc85982a4 None admin] Validating token access rules against request {{(pid=352329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:53:10.935622 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff68107-5eb9-4acc-81f7-15e73ccedb8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:53:10.936312 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff68107-5eb9-4acc-81f7-15e73ccedb8b None admin] REQUEST_METHOD: `GET` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:53:10.936654 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff68107-5eb9-4acc-81f7-15e73ccedb8b None admin] SCRIPT_NAME: `/identity` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:53:10.936968 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff68107-5eb9-4acc-81f7-15e73ccedb8b None admin] PATH_INFO: `/v3/users/b7cd5d64f7a6486aa3ca34ab7044ab52` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:53:10.954595 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff68107-5eb9-4acc-81f7-15e73ccedb8b None admin] RBAC: Authorizing `identity:get_user(user_id=b7cd5d64f7a6486aa3ca34ab7044ab52)` {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:53:10.956299 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff68107-5eb9-4acc-81f7-15e73ccedb8b None admin] RBAC: Authorization granted {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:53:10.958632 dv-cinder-851351-1-smb devstack@keystone.service[352329]: [pid: 352329|app: 0|req: 124/243] 10.222.0.42 () {56 vars in 1177 bytes} [Thu Jul 28 08:53:10 2022] GET /identity/v3/users/b7cd5d64f7a6486aa3ca34ab7044ab52 => generated 297 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 08:53:10.964230 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3e4e35-4a63-4b13-850a-51a610c72638 None admin] Authenticating user token {{(pid=352328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:53:11.063211 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG dbcounter [-] [352328] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=352328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:53:11.121980 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3e4e35-4a63-4b13-850a-51a610c72638 None admin] Validating token access rules against request {{(pid=352328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:53:11.170583 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002b87e4-aa4a-4b30-8a65-ce3b48fe990a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:53:11.171326 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002b87e4-aa4a-4b30-8a65-ce3b48fe990a None admin] REQUEST_METHOD: `GET` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:53:11.171614 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002b87e4-aa4a-4b30-8a65-ce3b48fe990a None admin] SCRIPT_NAME: `/identity` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:53:11.171895 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002b87e4-aa4a-4b30-8a65-ce3b48fe990a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:53:11.267462 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-002b87e4-aa4a-4b30-8a65-ce3b48fe990a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:53:11.269540 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-002b87e4-aa4a-4b30-8a65-ce3b48fe990a None admin] RBAC: Authorization granted {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:53:11.344189 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG dbcounter [-] [352328] Writing DB stats keystone:SELECT=100 {{(pid=352328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:53:11.411387 dv-cinder-851351-1-smb devstack@keystone.service[352328]: [pid: 352328|app: 0|req: 120/244] 10.222.0.42 () {58 vars in 1282 bytes} [Thu Jul 28 08:53:10 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 447 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 28 08:53:11.417156 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff68107-5eb9-4acc-81f7-15e73ccedb8b None admin] Authenticating user token {{(pid=352329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:53:11.475490 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG dbcounter [-] [352329] Writing DB stats keystone:SELECT=100 {{(pid=352329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:53:11.568788 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff68107-5eb9-4acc-81f7-15e73ccedb8b None admin] Validating token access rules against request {{(pid=352329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:53:11.615182 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf07cdf-22ed-428b-bf73-49693c6a1c2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:53:11.615867 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf07cdf-22ed-428b-bf73-49693c6a1c2e None admin] REQUEST_METHOD: `GET` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:53:11.616154 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf07cdf-22ed-428b-bf73-49693c6a1c2e None admin] SCRIPT_NAME: `/identity` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:53:11.616431 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf07cdf-22ed-428b-bf73-49693c6a1c2e None admin] PATH_INFO: `/v3/projects/be5ef7d0266e453784a39d297f9b131d` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:53:11.617708 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaf07cdf-22ed-428b-bf73-49693c6a1c2e None admin] RBAC: Authorizing `identity:get_project(project_id=be5ef7d0266e453784a39d297f9b131d)` {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:53:11.619286 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaf07cdf-22ed-428b-bf73-49693c6a1c2e None admin] RBAC: Authorization granted {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:53:11.621063 dv-cinder-851351-1-smb devstack@keystone.service[352329]: [pid: 352329|app: 0|req: 125/245] 10.222.0.42 () {56 vars in 1186 bytes} [Thu Jul 28 08:53:11 2022] GET /identity/v3/projects/be5ef7d0266e453784a39d297f9b131d => generated 302 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:53:11.627443 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002b87e4-aa4a-4b30-8a65-ce3b48fe990a None admin] Authenticating user token {{(pid=352328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:53:11.717992 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d092a8-5a5f-4373-92ce-7049c23b6fb7 None None] REQUEST_METHOD: `GET` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:53:11.718322 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d092a8-5a5f-4373-92ce-7049c23b6fb7 None None] SCRIPT_NAME: `/identity` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:53:11.718549 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d092a8-5a5f-4373-92ce-7049c23b6fb7 None None] PATH_INFO: `/` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:53:11.722011 dv-cinder-851351-1-smb devstack@keystone.service[352329]: [pid: 352329|app: 0|req: 126/246] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 08:53:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 08:53:11.727173 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d035bd37-7b15-42bb-a51f-497205949763 None None] REQUEST_METHOD: `POST` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:53:11.727557 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d035bd37-7b15-42bb-a51f-497205949763 None None] SCRIPT_NAME: `/identity` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:53:11.727769 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d035bd37-7b15-42bb-a51f-497205949763 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:53:11.757564 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002b87e4-aa4a-4b30-8a65-ce3b48fe990a None admin] Validating token access rules against request {{(pid=352328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:53:11.760384 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.auth.core [None req-d035bd37-7b15-42bb-a51f-497205949763 None None] MFA Rules not processed for user `d18c063b2377412485965357671e5506`. Rule list: `[]` (Enabled: `True`). {{(pid=352329) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 08:53:11.761758 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.fernet_utils [None req-d035bd37-7b15-42bb-a51f-497205949763 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=352329) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:53:11.800777 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c73cfa-fb3a-4267-b0ee-0e8e286dc814 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:53:11.802116 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c73cfa-fb3a-4267-b0ee-0e8e286dc814 None admin] REQUEST_METHOD: `GET` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:53:11.802626 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c73cfa-fb3a-4267-b0ee-0e8e286dc814 None admin] SCRIPT_NAME: `/identity` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:53:11.803378 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c73cfa-fb3a-4267-b0ee-0e8e286dc814 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:53:11.804845 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0c73cfa-fb3a-4267-b0ee-0e8e286dc814 None admin] RBAC: Adding query filter params (role.id=3abd212955234654b7d9a8d7df33e380, scope.project.id=be5ef7d0266e453784a39d297f9b131d, user.id=b7cd5d64f7a6486aa3ca34ab7044ab52) {{(pid=352328) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:53:11.805686 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0c73cfa-fb3a-4267-b0ee-0e8e286dc814 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:53:11.808318 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0c73cfa-fb3a-4267-b0ee-0e8e286dc814 None admin] RBAC: Authorization granted {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:53:11.820146 dv-cinder-851351-1-smb devstack@keystone.service[352328]: [pid: 352328|app: 0|req: 121/247] 10.222.0.42 () {56 vars in 1374 bytes} [Thu Jul 28 08:53:11 2022] GET /identity/v3/role_assignments?user.id=b7cd5d64f7a6486aa3ca34ab7044ab52&scope.project.id=be5ef7d0266e453784a39d297f9b131d&role.id=3abd212955234654b7d9a8d7df33e380 => generated 259 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:53:11.823888 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d85d90a-d3f7-4f2c-ab8a-0f7ba3b7e7b5 None None] REQUEST_METHOD: `GET` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:53:11.823888 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d85d90a-d3f7-4f2c-ab8a-0f7ba3b7e7b5 None None] SCRIPT_NAME: `/identity` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:53:11.823888 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d85d90a-d3f7-4f2c-ab8a-0f7ba3b7e7b5 None None] PATH_INFO: `/` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:53:11.823888 dv-cinder-851351-1-smb devstack@keystone.service[352328]: [pid: 352328|app: 0|req: 122/248] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 08:53:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 08:53:11.831698 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51cfbf1d-fa54-455c-813d-d07768eb3aea None None] REQUEST_METHOD: `POST` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:53:11.832770 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51cfbf1d-fa54-455c-813d-d07768eb3aea None None] SCRIPT_NAME: `/identity` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:53:11.833852 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51cfbf1d-fa54-455c-813d-d07768eb3aea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:53:11.857127 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.auth.core [None req-51cfbf1d-fa54-455c-813d-d07768eb3aea None None] MFA Rules not processed for user `d18c063b2377412485965357671e5506`. Rule list: `[]` (Enabled: `True`). {{(pid=352328) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 08:53:11.858378 dv-cinder-851351-1-smb devstack@keystone.service[352329]: [pid: 352329|app: 0|req: 127/249] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 08:53:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 08:53:11.859290 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.fernet_utils [None req-51cfbf1d-fa54-455c-813d-d07768eb3aea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=352328) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:53:11.873038 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG dbcounter [-] [352328] Writing DB stats keystone:SELECT=100 {{(pid=352328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:53:11.887141 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d035bd37-7b15-42bb-a51f-497205949763 None None] Authenticating user token {{(pid=352329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:53:11.950642 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG dbcounter [-] [352329] Writing DB stats keystone:SELECT=100 {{(pid=352329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:53:11.950937 dv-cinder-851351-1-smb devstack@keystone.service[352328]: [pid: 352328|app: 0|req: 123/250] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 08:53:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 08:53:11.981619 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51cfbf1d-fa54-455c-813d-d07768eb3aea None None] Authenticating user token {{(pid=352328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:53:12.127195 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d035bd37-7b15-42bb-a51f-497205949763 None None] Validating token access rules against request {{(pid=352329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:53:12.134424 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51cfbf1d-fa54-455c-813d-d07768eb3aea None None] Validating token access rules against request {{(pid=352328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:53:12.174801 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db551875-b41c-4078-b3e6-46a6de3e8360 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:53:12.175495 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db551875-b41c-4078-b3e6-46a6de3e8360 None admin] REQUEST_METHOD: `GET` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:53:12.175784 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db551875-b41c-4078-b3e6-46a6de3e8360 None admin] SCRIPT_NAME: `/identity` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:53:12.176064 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db551875-b41c-4078-b3e6-46a6de3e8360 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:53:12.179758 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1605c440-6b41-46eb-bd3b-e8eaf789fb65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:53:12.180453 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1605c440-6b41-46eb-bd3b-e8eaf789fb65 None admin] REQUEST_METHOD: `GET` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:53:12.180762 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1605c440-6b41-46eb-bd3b-e8eaf789fb65 None admin] SCRIPT_NAME: `/identity` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:53:12.181223 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1605c440-6b41-46eb-bd3b-e8eaf789fb65 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:53:12.189409 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db551875-b41c-4078-b3e6-46a6de3e8360 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 08:53:12.194266 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1605c440-6b41-46eb-bd3b-e8eaf789fb65 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 08:53:12.194942 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application [None req-db551875-b41c-4078-b3e6-46a6de3e8360 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 08:53:12.194942 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:53:12.194942 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:53:12.194942 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:53:12.194942 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:53:12.194942 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:53:12.194942 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:53:12.194942 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:53:12.194942 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:53:12.194942 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:53:12.194942 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:53:12.194942 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:53:12.194942 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 08:53:12.194942 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 08:53:12.194942 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 08:53:12.194942 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 08:53:12.196031 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 08:53:12.196031 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 08:53:12.196031 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 08:53:12.196031 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 08:53:12.196031 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:53:12.196031 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:53:12.196031 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:53:12.196031 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:53:12.196031 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:53:12.196031 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:53:12.196031 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:53:12.196031 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application with Lock( Jul 28 08:53:12.196031 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:53:12.196031 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:53:12.196031 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:53:12.196031 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:53:12.197072 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:53:12.197072 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:53:12.197072 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:53:12.197072 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:53:12.197072 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 08:53:12.197072 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 08:53:12.197072 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 08:53:12.197072 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 08:53:12.197072 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 08:53:12.197072 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 08:53:12.197072 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 08:53:12.197072 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application Jul 28 08:53:12.197072 dv-cinder-851351-1-smb devstack@keystone.service[352329]: [pid: 352329|app: 0|req: 128/251] 10.222.0.42 () {56 vars in 1096 bytes} [Thu Jul 28 08:53:11 2022] GET /identity/v3/roles/admin => generated 83 bytes in 310 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 08:53:12.197929 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8160ac-5f89-4bb7-b79e-6981b559b621 None None] REQUEST_METHOD: `GET` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:53:12.198519 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8160ac-5f89-4bb7-b79e-6981b559b621 None None] SCRIPT_NAME: `/identity` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:53:12.198519 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8160ac-5f89-4bb7-b79e-6981b559b621 None None] PATH_INFO: `/` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:53:12.203572 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application [None req-1605c440-6b41-46eb-bd3b-e8eaf789fb65 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 28 08:53:12.203572 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:53:12.203572 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:53:12.203572 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:53:12.203572 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:53:12.203572 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:53:12.203572 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:53:12.203572 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:53:12.203572 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:53:12.203572 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:53:12.203572 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:53:12.203572 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:53:12.203572 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 08:53:12.203572 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 08:53:12.203572 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 08:53:12.203572 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 08:53:12.206259 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 08:53:12.206259 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 08:53:12.206259 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 08:53:12.206259 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 08:53:12.206259 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:53:12.206259 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:53:12.206259 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:53:12.206259 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:53:12.206259 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:53:12.206259 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:53:12.206259 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:53:12.206259 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application with Lock( Jul 28 08:53:12.206259 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:53:12.206259 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:53:12.206259 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:53:12.206259 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:53:12.207459 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:53:12.207459 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:53:12.207459 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:53:12.207459 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:53:12.207459 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 08:53:12.207459 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 08:53:12.207459 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 08:53:12.207459 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 08:53:12.207459 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 08:53:12.207459 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 08:53:12.207459 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 28 08:53:12.207459 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application Jul 28 08:53:12.208395 dv-cinder-851351-1-smb devstack@keystone.service[352329]: [pid: 352329|app: 0|req: 129/252] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 08:53:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 08:53:12.208504 dv-cinder-851351-1-smb devstack@keystone.service[352328]: [pid: 352328|app: 0|req: 124/253] 10.222.0.42 () {56 vars in 1114 bytes} [Thu Jul 28 08:53:11 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:53:12.208598 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8160ac-5f89-4bb7-b79e-6981b559b621 None None] Authenticating user token {{(pid=352329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:53:12.210483 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1685e2-4727-47d1-ba68-7756fc407d85 None None] REQUEST_METHOD: `POST` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:53:12.210771 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1685e2-4727-47d1-ba68-7756fc407d85 None None] SCRIPT_NAME: `/identity` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:53:12.211047 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1685e2-4727-47d1-ba68-7756fc407d85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:53:12.219437 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG dbcounter [-] [352328] Writing DB stats keystone:SELECT=100 {{(pid=352328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:53:12.232194 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.auth.core [None req-3e1685e2-4727-47d1-ba68-7756fc407d85 None None] MFA Rules not processed for user `d18c063b2377412485965357671e5506`. Rule list: `[]` (Enabled: `True`). {{(pid=352328) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 08:53:12.233356 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.fernet_utils [None req-3e1685e2-4727-47d1-ba68-7756fc407d85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=352328) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:53:12.317624 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG dbcounter [-] [352329] Writing DB stats keystone:SELECT=100 {{(pid=352329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:53:12.331972 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8160ac-5f89-4bb7-b79e-6981b559b621 None None] Validating token access rules against request {{(pid=352329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:53:12.334410 dv-cinder-851351-1-smb devstack@keystone.service[352328]: [pid: 352328|app: 0|req: 125/254] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 08:53:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 08:53:12.335649 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e1685e2-4727-47d1-ba68-7756fc407d85 None None] Authenticating user token {{(pid=352328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:53:12.373856 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d45a0456-09d1-4ccf-9110-29ec65cb70b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:53:12.374568 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45a0456-09d1-4ccf-9110-29ec65cb70b4 None admin] REQUEST_METHOD: `GET` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:53:12.374859 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45a0456-09d1-4ccf-9110-29ec65cb70b4 None admin] SCRIPT_NAME: `/identity` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:53:12.375139 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45a0456-09d1-4ccf-9110-29ec65cb70b4 None admin] PATH_INFO: `/v3/roles` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:53:12.375892 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d45a0456-09d1-4ccf-9110-29ec65cb70b4 None admin] RBAC: Adding query filter params (name=admin) {{(pid=352329) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:53:12.376204 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d45a0456-09d1-4ccf-9110-29ec65cb70b4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:53:12.384693 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d45a0456-09d1-4ccf-9110-29ec65cb70b4 None admin] RBAC: Authorization granted {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:53:12.389036 dv-cinder-851351-1-smb devstack@keystone.service[352329]: [pid: 352329|app: 0|req: 130/255] 10.222.0.42 () {56 vars in 1099 bytes} [Thu Jul 28 08:53:12 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:53:12.390606 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d45a0456-09d1-4ccf-9110-29ec65cb70b4 None admin] Authenticating user token {{(pid=352329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:53:12.509061 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d45a0456-09d1-4ccf-9110-29ec65cb70b4 None admin] Validating token access rules against request {{(pid=352329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:53:12.534183 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e1685e2-4727-47d1-ba68-7756fc407d85 None None] Validating token access rules against request {{(pid=352328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:53:12.540431 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eea4ee1-49ac-4490-971f-942457f8b14b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:53:12.548706 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eea4ee1-49ac-4490-971f-942457f8b14b None admin] REQUEST_METHOD: `GET` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:53:12.548706 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eea4ee1-49ac-4490-971f-942457f8b14b None admin] SCRIPT_NAME: `/identity` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:53:12.548706 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eea4ee1-49ac-4490-971f-942457f8b14b None admin] PATH_INFO: `/v3/roles/member` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:53:12.554923 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eea4ee1-49ac-4490-971f-942457f8b14b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 08:53:12.567929 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application [None req-9eea4ee1-49ac-4490-971f-942457f8b14b None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 28 08:53:12.567929 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:53:12.567929 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:53:12.567929 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:53:12.567929 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:53:12.567929 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:53:12.567929 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:53:12.567929 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:53:12.567929 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:53:12.567929 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:53:12.567929 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:53:12.567929 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:53:12.567929 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 08:53:12.567929 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 08:53:12.567929 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 08:53:12.567929 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 08:53:12.569225 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 08:53:12.569225 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 08:53:12.569225 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 08:53:12.569225 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 08:53:12.569225 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:53:12.569225 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:53:12.569225 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:53:12.569225 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:53:12.569225 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:53:12.569225 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:53:12.569225 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:53:12.569225 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application with Lock( Jul 28 08:53:12.569225 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:53:12.569225 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:53:12.569225 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:53:12.569225 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:53:12.570233 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:53:12.570233 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:53:12.570233 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:53:12.570233 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:53:12.570233 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 08:53:12.570233 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 08:53:12.570233 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 08:53:12.570233 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 08:53:12.570233 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 08:53:12.570233 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 08:53:12.570233 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 28 08:53:12.570233 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application Jul 28 08:53:12.570233 dv-cinder-851351-1-smb devstack@keystone.service[352329]: [pid: 352329|app: 0|req: 131/256] 10.222.0.42 () {56 vars in 1099 bytes} [Thu Jul 28 08:53:12 2022] GET /identity/v3/roles/member => generated 84 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:53:12.570233 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eea4ee1-49ac-4490-971f-942457f8b14b None admin] Authenticating user token {{(pid=352329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:53:12.601564 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG dbcounter [-] [352329] Writing DB stats keystone:SELECT=100 {{(pid=352329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:53:12.610131 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a619dbd9-8d53-4f88-8fd3-536533c96efe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:53:12.611189 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a619dbd9-8d53-4f88-8fd3-536533c96efe None admin] REQUEST_METHOD: `GET` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:53:12.611691 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a619dbd9-8d53-4f88-8fd3-536533c96efe None admin] SCRIPT_NAME: `/identity` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:53:12.611967 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a619dbd9-8d53-4f88-8fd3-536533c96efe None admin] PATH_INFO: `/v3/roles` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:53:12.612743 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a619dbd9-8d53-4f88-8fd3-536533c96efe None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=352328) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:53:12.613053 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a619dbd9-8d53-4f88-8fd3-536533c96efe None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:53:12.614463 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a619dbd9-8d53-4f88-8fd3-536533c96efe None admin] RBAC: Authorization granted {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:53:12.616110 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG dbcounter [-] [352328] Writing DB stats keystone:SELECT=100 {{(pid=352328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:53:12.632648 dv-cinder-851351-1-smb devstack@keystone.service[352328]: [pid: 352328|app: 0|req: 126/257] 10.222.0.42 () {56 vars in 1111 bytes} [Thu Jul 28 08:53:12 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 297 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:53:12.637478 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a619dbd9-8d53-4f88-8fd3-536533c96efe None admin] Authenticating user token {{(pid=352328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:53:12.685976 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eea4ee1-49ac-4490-971f-942457f8b14b None admin] Validating token access rules against request {{(pid=352329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:53:12.726585 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba0e633-5223-4456-abf7-195b72e16b52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:53:12.727696 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba0e633-5223-4456-abf7-195b72e16b52 None admin] REQUEST_METHOD: `GET` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:53:12.728257 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba0e633-5223-4456-abf7-195b72e16b52 None admin] SCRIPT_NAME: `/identity` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:53:12.728870 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba0e633-5223-4456-abf7-195b72e16b52 None admin] PATH_INFO: `/v3/users/393f088d556d4599ba13edfd35b7951a` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:53:12.730559 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba0e633-5223-4456-abf7-195b72e16b52 None admin] RBAC: Authorizing `identity:get_user(user_id=393f088d556d4599ba13edfd35b7951a)` {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:53:12.732301 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba0e633-5223-4456-abf7-195b72e16b52 None admin] RBAC: Authorization granted {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:53:12.734450 dv-cinder-851351-1-smb devstack@keystone.service[352329]: [pid: 352329|app: 0|req: 132/258] 10.222.0.42 () {56 vars in 1177 bytes} [Thu Jul 28 08:53:12 2022] GET /identity/v3/users/393f088d556d4599ba13edfd35b7951a => generated 283 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:53:12.735648 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba0e633-5223-4456-abf7-195b72e16b52 None admin] Authenticating user token {{(pid=352329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:53:12.743907 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a619dbd9-8d53-4f88-8fd3-536533c96efe None admin] Validating token access rules against request {{(pid=352328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:53:12.779753 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f62c008-e417-4fa9-82cd-eb3eec08c030 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:53:12.780268 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f62c008-e417-4fa9-82cd-eb3eec08c030 None admin] REQUEST_METHOD: `GET` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:53:12.780540 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f62c008-e417-4fa9-82cd-eb3eec08c030 None admin] SCRIPT_NAME: `/identity` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:53:12.784394 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f62c008-e417-4fa9-82cd-eb3eec08c030 None admin] PATH_INFO: `/v3/roles` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:53:12.785583 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f62c008-e417-4fa9-82cd-eb3eec08c030 None admin] RBAC: Adding query filter params (name=member) {{(pid=352328) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:53:12.786077 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f62c008-e417-4fa9-82cd-eb3eec08c030 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:53:12.787802 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f62c008-e417-4fa9-82cd-eb3eec08c030 None admin] RBAC: Authorization granted {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:53:12.799715 dv-cinder-851351-1-smb devstack@keystone.service[352328]: [pid: 352328|app: 0|req: 127/259] 10.222.0.42 () {56 vars in 1101 bytes} [Thu Jul 28 08:53:12 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:53:12.806745 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f62c008-e417-4fa9-82cd-eb3eec08c030 None admin] Authenticating user token {{(pid=352328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:53:12.825941 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG dbcounter [-] [352329] Writing DB stats keystone:SELECT=100 {{(pid=352329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:53:12.849066 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba0e633-5223-4456-abf7-195b72e16b52 None admin] Validating token access rules against request {{(pid=352329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:53:12.868503 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG dbcounter [-] [352328] Writing DB stats keystone:SELECT=100 {{(pid=352328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:53:12.887927 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82bb2cf1-9c9b-41eb-8de0-13ab2d786268 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:53:12.889040 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82bb2cf1-9c9b-41eb-8de0-13ab2d786268 None admin] REQUEST_METHOD: `GET` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:53:12.889583 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82bb2cf1-9c9b-41eb-8de0-13ab2d786268 None admin] SCRIPT_NAME: `/identity` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:53:12.890090 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82bb2cf1-9c9b-41eb-8de0-13ab2d786268 None admin] PATH_INFO: `/v3/users/393f088d556d4599ba13edfd35b7951a` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:53:12.891593 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82bb2cf1-9c9b-41eb-8de0-13ab2d786268 None admin] RBAC: Authorizing `identity:get_user(user_id=393f088d556d4599ba13edfd35b7951a)` {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:53:12.893466 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82bb2cf1-9c9b-41eb-8de0-13ab2d786268 None admin] RBAC: Authorization granted {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:53:12.895579 dv-cinder-851351-1-smb devstack@keystone.service[352329]: [pid: 352329|app: 0|req: 133/260] 10.222.0.42 () {56 vars in 1177 bytes} [Thu Jul 28 08:53:12 2022] GET /identity/v3/users/393f088d556d4599ba13edfd35b7951a => generated 283 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:53:12.896640 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82bb2cf1-9c9b-41eb-8de0-13ab2d786268 None admin] Authenticating user token {{(pid=352329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:53:12.912003 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f62c008-e417-4fa9-82cd-eb3eec08c030 None admin] Validating token access rules against request {{(pid=352328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:53:12.947880 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03082e77-230f-4067-9c76-88b883a2b981 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:53:12.948521 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03082e77-230f-4067-9c76-88b883a2b981 None admin] REQUEST_METHOD: `GET` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:53:12.948894 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03082e77-230f-4067-9c76-88b883a2b981 None admin] SCRIPT_NAME: `/identity` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:53:12.949107 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03082e77-230f-4067-9c76-88b883a2b981 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:53:13.028331 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03082e77-230f-4067-9c76-88b883a2b981 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:53:13.030315 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03082e77-230f-4067-9c76-88b883a2b981 None admin] RBAC: Authorization granted {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:53:13.042761 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82bb2cf1-9c9b-41eb-8de0-13ab2d786268 None admin] Validating token access rules against request {{(pid=352329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:53:13.079370 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c6151b-5c01-4085-a628-6df5da429592 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:53:13.080142 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c6151b-5c01-4085-a628-6df5da429592 None admin] REQUEST_METHOD: `GET` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:53:13.080459 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c6151b-5c01-4085-a628-6df5da429592 None admin] SCRIPT_NAME: `/identity` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:53:13.080781 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c6151b-5c01-4085-a628-6df5da429592 None admin] PATH_INFO: `/v3/users/747d1edf4168468ca4d6cbe7589cc7dd` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:53:13.082118 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69c6151b-5c01-4085-a628-6df5da429592 None admin] RBAC: Authorizing `identity:get_user(user_id=747d1edf4168468ca4d6cbe7589cc7dd)` {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:53:13.083632 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69c6151b-5c01-4085-a628-6df5da429592 None admin] RBAC: Authorization granted {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:53:13.085722 dv-cinder-851351-1-smb devstack@keystone.service[352329]: [pid: 352329|app: 0|req: 134/261] 10.222.0.42 () {56 vars in 1177 bytes} [Thu Jul 28 08:53:12 2022] GET /identity/v3/users/747d1edf4168468ca4d6cbe7589cc7dd => generated 297 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:53:13.086565 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c6151b-5c01-4085-a628-6df5da429592 None admin] Authenticating user token {{(pid=352329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:53:13.099322 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG dbcounter [-] [352328] Writing DB stats keystone:SELECT=100 {{(pid=352328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:53:13.120284 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG dbcounter [-] [352329] Writing DB stats keystone:SELECT=100 {{(pid=352329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:53:13.151050 dv-cinder-851351-1-smb devstack@keystone.service[352328]: [pid: 352328|app: 0|req: 128/262] 10.222.0.42 () {58 vars in 1282 bytes} [Thu Jul 28 08:53:12 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 351 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 28 08:53:13.151933 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03082e77-230f-4067-9c76-88b883a2b981 None admin] Authenticating user token {{(pid=352328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:53:13.194749 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c6151b-5c01-4085-a628-6df5da429592 None admin] Validating token access rules against request {{(pid=352329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:53:13.234667 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c9ef8e-2bb8-4345-8d9a-bf48605f6121 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:53:13.235429 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c9ef8e-2bb8-4345-8d9a-bf48605f6121 None admin] REQUEST_METHOD: `GET` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:53:13.235720 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c9ef8e-2bb8-4345-8d9a-bf48605f6121 None admin] SCRIPT_NAME: `/identity` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:53:13.236031 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c9ef8e-2bb8-4345-8d9a-bf48605f6121 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:53:13.309416 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19c9ef8e-2bb8-4345-8d9a-bf48605f6121 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:53:13.310866 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19c9ef8e-2bb8-4345-8d9a-bf48605f6121 None admin] RBAC: Authorization granted {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:53:13.335346 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03082e77-230f-4067-9c76-88b883a2b981 None admin] Validating token access rules against request {{(pid=352328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:53:13.377334 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG dbcounter [-] [352329] Writing DB stats keystone:SELECT=100 {{(pid=352329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:53:13.410274 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20562454-0064-46af-85a2-e5c2663c02c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:53:13.410980 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20562454-0064-46af-85a2-e5c2663c02c4 None admin] REQUEST_METHOD: `GET` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:53:13.411263 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20562454-0064-46af-85a2-e5c2663c02c4 None admin] SCRIPT_NAME: `/identity` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:53:13.411707 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20562454-0064-46af-85a2-e5c2663c02c4 None admin] PATH_INFO: `/v3/projects/be5ef7d0266e453784a39d297f9b131d` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:53:13.414144 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20562454-0064-46af-85a2-e5c2663c02c4 None admin] RBAC: Authorizing `identity:get_project(project_id=be5ef7d0266e453784a39d297f9b131d)` {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:53:13.418224 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20562454-0064-46af-85a2-e5c2663c02c4 None admin] RBAC: Authorization granted {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:53:13.418224 dv-cinder-851351-1-smb devstack@keystone.service[352328]: [pid: 352328|app: 0|req: 129/263] 10.222.0.42 () {56 vars in 1186 bytes} [Thu Jul 28 08:53:13 2022] GET /identity/v3/projects/be5ef7d0266e453784a39d297f9b131d => generated 302 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:53:13.418824 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20562454-0064-46af-85a2-e5c2663c02c4 None admin] Authenticating user token {{(pid=352328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:53:13.452031 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG dbcounter [-] [352328] Writing DB stats keystone:SELECT=100 {{(pid=352328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:53:13.482030 dv-cinder-851351-1-smb devstack@keystone.service[352329]: [pid: 352329|app: 0|req: 135/264] 10.222.0.42 () {58 vars in 1282 bytes} [Thu Jul 28 08:53:13 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 396 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 28 08:53:13.485070 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c9ef8e-2bb8-4345-8d9a-bf48605f6121 None admin] Authenticating user token {{(pid=352329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:53:13.602945 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20562454-0064-46af-85a2-e5c2663c02c4 None admin] Validating token access rules against request {{(pid=352328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:53:13.620747 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c9ef8e-2bb8-4345-8d9a-bf48605f6121 None admin] Validating token access rules against request {{(pid=352329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:53:13.633467 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG dbcounter [-] [352329] Writing DB stats keystone:SELECT=100 {{(pid=352329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:53:13.660701 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5953a498-7d46-4b49-bf0f-32f48002ec57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:53:13.660977 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5953a498-7d46-4b49-bf0f-32f48002ec57 None admin] REQUEST_METHOD: `PUT` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:53:13.661253 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5953a498-7d46-4b49-bf0f-32f48002ec57 None admin] SCRIPT_NAME: `/identity` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:53:13.661489 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5953a498-7d46-4b49-bf0f-32f48002ec57 None admin] PATH_INFO: `/v3/projects/be5ef7d0266e453784a39d297f9b131d/users/747d1edf4168468ca4d6cbe7589cc7dd/roles/16a3fc3aca974c47a329c2781b0be93a` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:53:13.666442 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5953a498-7d46-4b49-bf0f-32f48002ec57 None admin] RBAC: Authorizing `identity:create_grant(project_id=be5ef7d0266e453784a39d297f9b131d, user_id=747d1edf4168468ca4d6cbe7589cc7dd, role_id=16a3fc3aca974c47a329c2781b0be93a)` {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:53:13.667982 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5953a498-7d46-4b49-bf0f-32f48002ec57 None admin] RBAC: Authorization granted {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:53:13.680753 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc921cc-5f82-4b43-8f6d-368a5ae80053 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:53:13.681480 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc921cc-5f82-4b43-8f6d-368a5ae80053 None admin] REQUEST_METHOD: `GET` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:53:13.681768 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc921cc-5f82-4b43-8f6d-368a5ae80053 None admin] SCRIPT_NAME: `/identity` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:53:13.682048 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc921cc-5f82-4b43-8f6d-368a5ae80053 None admin] PATH_INFO: `/v3/projects/be5ef7d0266e453784a39d297f9b131d` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:53:13.686438 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebc921cc-5f82-4b43-8f6d-368a5ae80053 None admin] RBAC: Authorizing `identity:get_project(project_id=be5ef7d0266e453784a39d297f9b131d)` {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:53:13.688546 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebc921cc-5f82-4b43-8f6d-368a5ae80053 None admin] RBAC: Authorization granted {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:53:13.690853 dv-cinder-851351-1-smb devstack@keystone.service[352328]: [pid: 352328|app: 0|req: 130/265] 10.222.0.42 () {56 vars in 1186 bytes} [Thu Jul 28 08:53:13 2022] GET /identity/v3/projects/be5ef7d0266e453784a39d297f9b131d => generated 302 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:53:13.691882 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc921cc-5f82-4b43-8f6d-368a5ae80053 None admin] Authenticating user token {{(pid=352328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:53:13.699191 dv-cinder-851351-1-smb devstack@keystone.service[352329]: [pid: 352329|app: 0|req: 136/266] 10.222.0.42 () {58 vars in 1439 bytes} [Thu Jul 28 08:53:13 2022] PUT /identity/v3/projects/be5ef7d0266e453784a39d297f9b131d/users/747d1edf4168468ca4d6cbe7589cc7dd/roles/16a3fc3aca974c47a329c2781b0be93a => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 08:53:13.700690 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5953a498-7d46-4b49-bf0f-32f48002ec57 None admin] Authenticating user token {{(pid=352329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:53:13.857225 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5953a498-7d46-4b49-bf0f-32f48002ec57 None admin] Validating token access rules against request {{(pid=352329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:53:13.865070 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG dbcounter [-] [352328] Writing DB stats keystone:SELECT=100 {{(pid=352328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:53:13.882847 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc921cc-5f82-4b43-8f6d-368a5ae80053 None admin] Validating token access rules against request {{(pid=352328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:53:13.905469 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21f2489-1adb-42b8-9736-804fe4adfc1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:53:13.906561 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21f2489-1adb-42b8-9736-804fe4adfc1e None admin] REQUEST_METHOD: `GET` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:53:13.907064 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21f2489-1adb-42b8-9736-804fe4adfc1e None admin] SCRIPT_NAME: `/identity` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:53:13.907591 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21f2489-1adb-42b8-9736-804fe4adfc1e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:53:13.908625 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d21f2489-1adb-42b8-9736-804fe4adfc1e None admin] RBAC: Adding query filter params (role.id=280023171b4a45efb67c036ff237bb3c, scope.project.id=be5ef7d0266e453784a39d297f9b131d, user.id=393f088d556d4599ba13edfd35b7951a) {{(pid=352329) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:53:13.909389 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d21f2489-1adb-42b8-9736-804fe4adfc1e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:53:13.913033 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d21f2489-1adb-42b8-9736-804fe4adfc1e None admin] RBAC: Authorization granted {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:53:13.928276 dv-cinder-851351-1-smb devstack@keystone.service[352329]: [pid: 352329|app: 0|req: 137/267] 10.222.0.42 () {56 vars in 1374 bytes} [Thu Jul 28 08:53:13 2022] GET /identity/v3/role_assignments?user.id=393f088d556d4599ba13edfd35b7951a&scope.project.id=be5ef7d0266e453784a39d297f9b131d&role.id=280023171b4a45efb67c036ff237bb3c => generated 608 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:53:13.952144 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6bb211d-9eec-4688-b9cb-32a801c14bed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:53:13.953426 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6bb211d-9eec-4688-b9cb-32a801c14bed None admin] REQUEST_METHOD: `GET` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:53:13.953941 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6bb211d-9eec-4688-b9cb-32a801c14bed None admin] SCRIPT_NAME: `/identity` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:53:13.954912 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6bb211d-9eec-4688-b9cb-32a801c14bed None admin] PATH_INFO: `/v3/projects/be5ef7d0266e453784a39d297f9b131d` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:53:13.956747 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6bb211d-9eec-4688-b9cb-32a801c14bed None admin] RBAC: Authorizing `identity:get_project(project_id=be5ef7d0266e453784a39d297f9b131d)` {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:53:13.958720 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6bb211d-9eec-4688-b9cb-32a801c14bed None admin] RBAC: Authorization granted {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:53:13.961227 dv-cinder-851351-1-smb devstack@keystone.service[352328]: [pid: 352328|app: 0|req: 131/268] 10.222.0.42 () {56 vars in 1186 bytes} [Thu Jul 28 08:53:13 2022] GET /identity/v3/projects/be5ef7d0266e453784a39d297f9b131d => generated 302 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:53:13.967182 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21f2489-1adb-42b8-9736-804fe4adfc1e None admin] Authenticating user token {{(pid=352329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:53:14.060854 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG dbcounter [-] [352329] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=352329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:53:14.135766 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21f2489-1adb-42b8-9736-804fe4adfc1e None admin] Validating token access rules against request {{(pid=352329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:53:14.173217 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580b0a7e-4e14-450c-ad88-e5743a31a7e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:53:14.174304 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580b0a7e-4e14-450c-ad88-e5743a31a7e9 None admin] REQUEST_METHOD: `GET` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:53:14.174803 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580b0a7e-4e14-450c-ad88-e5743a31a7e9 None admin] SCRIPT_NAME: `/identity` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:53:14.175296 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580b0a7e-4e14-450c-ad88-e5743a31a7e9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:53:14.176368 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-580b0a7e-4e14-450c-ad88-e5743a31a7e9 None admin] RBAC: Adding query filter params (role.id=a4fa43cd6d914398a0790a1516c83d08, scope.project.id=be5ef7d0266e453784a39d297f9b131d, user.id=393f088d556d4599ba13edfd35b7951a) {{(pid=352329) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:53:14.176934 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-580b0a7e-4e14-450c-ad88-e5743a31a7e9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:53:14.178651 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-580b0a7e-4e14-450c-ad88-e5743a31a7e9 None admin] RBAC: Authorization granted {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:53:14.186181 dv-cinder-851351-1-smb devstack@keystone.service[352329]: [pid: 352329|app: 0|req: 138/269] 10.222.0.42 () {56 vars in 1374 bytes} [Thu Jul 28 08:53:13 2022] GET /identity/v3/role_assignments?user.id=393f088d556d4599ba13edfd35b7951a&scope.project.id=be5ef7d0266e453784a39d297f9b131d&role.id=a4fa43cd6d914398a0790a1516c83d08 => generated 608 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:53:14.232102 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62bdb2f-d847-4f8e-9bb5-6aa713627596 None None] REQUEST_METHOD: `GET` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:53:14.233190 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62bdb2f-d847-4f8e-9bb5-6aa713627596 None None] SCRIPT_NAME: `/identity` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:53:14.233706 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62bdb2f-d847-4f8e-9bb5-6aa713627596 None None] PATH_INFO: `/` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:53:14.235442 dv-cinder-851351-1-smb devstack@keystone.service[352328]: [pid: 352328|app: 0|req: 132/270] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 08:53:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 08:53:14.241394 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d20589-f8a7-4d4a-a812-1a196ef2e15e None None] REQUEST_METHOD: `POST` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:53:14.242041 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d20589-f8a7-4d4a-a812-1a196ef2e15e None None] SCRIPT_NAME: `/identity` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:53:14.242574 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d20589-f8a7-4d4a-a812-1a196ef2e15e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:53:14.277684 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.auth.core [None req-46d20589-f8a7-4d4a-a812-1a196ef2e15e None None] MFA Rules not processed for user `d18c063b2377412485965357671e5506`. Rule list: `[]` (Enabled: `True`). {{(pid=352329) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 08:53:14.280012 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.fernet_utils [None req-46d20589-f8a7-4d4a-a812-1a196ef2e15e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=352329) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:53:14.381321 dv-cinder-851351-1-smb devstack@keystone.service[352329]: [pid: 352329|app: 0|req: 139/271] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 08:53:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 08:53:14.412159 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62bdb2f-d847-4f8e-9bb5-6aa713627596 None None] Authenticating user token {{(pid=352328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:53:14.546430 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62bdb2f-d847-4f8e-9bb5-6aa713627596 None None] Validating token access rules against request {{(pid=352328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:53:14.585779 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e74de0c-19b7-4ff9-b00b-4170aa6fcdb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:53:14.586441 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e74de0c-19b7-4ff9-b00b-4170aa6fcdb0 None admin] REQUEST_METHOD: `GET` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:53:14.586719 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e74de0c-19b7-4ff9-b00b-4170aa6fcdb0 None admin] SCRIPT_NAME: `/identity` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:53:14.586987 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e74de0c-19b7-4ff9-b00b-4170aa6fcdb0 None admin] PATH_INFO: `/v3/domains/default` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:53:14.588213 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e74de0c-19b7-4ff9-b00b-4170aa6fcdb0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:53:14.589812 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e74de0c-19b7-4ff9-b00b-4170aa6fcdb0 None admin] RBAC: Authorization granted {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:53:14.591676 dv-cinder-851351-1-smb devstack@keystone.service[352328]: [pid: 352328|app: 0|req: 133/272] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 08:53:14 2022] GET /identity/v3/domains/default => generated 199 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:53:14.597316 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d20589-f8a7-4d4a-a812-1a196ef2e15e None None] Authenticating user token {{(pid=352329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:53:14.646731 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG dbcounter [-] [352329] Writing DB stats keystone:SELECT=100 {{(pid=352329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:53:14.729970 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5ece5a-0a22-4abd-880e-fb73aad587fb None None] REQUEST_METHOD: `GET` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:53:14.730589 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5ece5a-0a22-4abd-880e-fb73aad587fb None None] SCRIPT_NAME: `/identity` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:53:14.730925 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5ece5a-0a22-4abd-880e-fb73aad587fb None None] PATH_INFO: `/` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:53:14.732586 dv-cinder-851351-1-smb devstack@keystone.service[352328]: [pid: 352328|app: 0|req: 134/273] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 08:53:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 28 08:53:14.740322 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90578c9d-ec7e-4b6c-9a08-fb33fe91a692 None None] REQUEST_METHOD: `POST` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:53:14.740657 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90578c9d-ec7e-4b6c-9a08-fb33fe91a692 None None] SCRIPT_NAME: `/identity` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:53:14.741087 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90578c9d-ec7e-4b6c-9a08-fb33fe91a692 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:53:14.743454 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d20589-f8a7-4d4a-a812-1a196ef2e15e None None] Validating token access rules against request {{(pid=352329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:53:14.772977 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.auth.core [None req-90578c9d-ec7e-4b6c-9a08-fb33fe91a692 None None] MFA Rules not processed for user `d18c063b2377412485965357671e5506`. Rule list: `[]` (Enabled: `True`). {{(pid=352328) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 08:53:14.774274 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.fernet_utils [None req-90578c9d-ec7e-4b6c-9a08-fb33fe91a692 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=352328) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:53:14.784688 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae693dc-e70c-4689-b5be-fbdb3030eda5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:53:14.785718 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae693dc-e70c-4689-b5be-fbdb3030eda5 None admin] REQUEST_METHOD: `POST` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:53:14.786202 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae693dc-e70c-4689-b5be-fbdb3030eda5 None admin] SCRIPT_NAME: `/identity` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:53:14.786670 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae693dc-e70c-4689-b5be-fbdb3030eda5 None admin] PATH_INFO: `/v3/users` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:53:14.787585 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae693dc-e70c-4689-b5be-fbdb3030eda5 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:53:14.789324 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae693dc-e70c-4689-b5be-fbdb3030eda5 None admin] RBAC: Authorization granted {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:53:14.812813 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG dbcounter [-] [352328] Writing DB stats keystone:SELECT=100 {{(pid=352328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:53:14.816288 dv-cinder-851351-1-smb devstack@keystone.service[352329]: [pid: 352329|app: 0|req: 140/274] 10.222.0.42 () {60 vars in 1132 bytes} [Thu Jul 28 08:53:14 2022] POST /identity/v3/users => generated 293 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 08:53:14.828348 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af182f51-f79e-4189-bb23-60b4cb9192d9 None None] REQUEST_METHOD: `GET` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:53:14.828683 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af182f51-f79e-4189-bb23-60b4cb9192d9 None None] SCRIPT_NAME: `/identity` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:53:14.828944 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af182f51-f79e-4189-bb23-60b4cb9192d9 None None] PATH_INFO: `/` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:53:14.836026 dv-cinder-851351-1-smb devstack@keystone.service[352329]: [pid: 352329|app: 0|req: 141/275] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 08:53:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 28 08:53:14.836877 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09316f5b-2183-42e9-8d33-add0d98da82a None None] REQUEST_METHOD: `POST` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:53:14.837168 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09316f5b-2183-42e9-8d33-add0d98da82a None None] SCRIPT_NAME: `/identity` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:53:14.837446 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09316f5b-2183-42e9-8d33-add0d98da82a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:53:14.857433 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.auth.core [None req-09316f5b-2183-42e9-8d33-add0d98da82a None None] MFA Rules not processed for user `d18c063b2377412485965357671e5506`. Rule list: `[]` (Enabled: `True`). {{(pid=352329) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 08:53:14.858693 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.fernet_utils [None req-09316f5b-2183-42e9-8d33-add0d98da82a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=352329) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:53:14.889410 dv-cinder-851351-1-smb devstack@keystone.service[352328]: [pid: 352328|app: 0|req: 135/276] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 08:53:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 08:53:14.912978 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90578c9d-ec7e-4b6c-9a08-fb33fe91a692 None None] Authenticating user token {{(pid=352328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:53:14.951085 dv-cinder-851351-1-smb devstack@keystone.service[352329]: [pid: 352329|app: 0|req: 142/277] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 08:53:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 08:53:14.979483 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09316f5b-2183-42e9-8d33-add0d98da82a None None] Authenticating user token {{(pid=352329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:53:15.011278 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG dbcounter [-] [352329] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=352329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:53:15.063891 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90578c9d-ec7e-4b6c-9a08-fb33fe91a692 None None] Validating token access rules against request {{(pid=352328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:53:15.113708 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e066dc-c958-431c-8629-cb72b91b4414 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:53:15.114912 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e066dc-c958-431c-8629-cb72b91b4414 None admin] REQUEST_METHOD: `GET` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:53:15.115036 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e066dc-c958-431c-8629-cb72b91b4414 None admin] SCRIPT_NAME: `/identity` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:53:15.115266 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e066dc-c958-431c-8629-cb72b91b4414 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:53:15.124621 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09316f5b-2183-42e9-8d33-add0d98da82a None None] Validating token access rules against request {{(pid=352329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:53:15.131133 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54e066dc-c958-431c-8629-cb72b91b4414 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 08:53:15.136605 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application [None req-54e066dc-c958-431c-8629-cb72b91b4414 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 28 08:53:15.136605 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:53:15.136605 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:53:15.136605 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:53:15.136605 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:53:15.136605 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:53:15.136605 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:53:15.136605 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:53:15.136605 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:53:15.136605 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:53:15.136605 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:53:15.136605 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:53:15.136605 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 08:53:15.136605 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 08:53:15.136605 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 08:53:15.136605 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 08:53:15.137859 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 08:53:15.137859 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 08:53:15.137859 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 08:53:15.137859 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 08:53:15.137859 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:53:15.137859 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:53:15.137859 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:53:15.137859 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:53:15.137859 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:53:15.137859 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:53:15.137859 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:53:15.137859 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application with Lock( Jul 28 08:53:15.137859 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:53:15.137859 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:53:15.137859 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:53:15.137859 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:53:15.138870 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:53:15.138870 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:53:15.138870 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:53:15.138870 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:53:15.138870 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 08:53:15.138870 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 08:53:15.138870 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 08:53:15.138870 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 08:53:15.138870 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 08:53:15.138870 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 08:53:15.138870 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 28 08:53:15.138870 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application Jul 28 08:53:15.138870 dv-cinder-851351-1-smb devstack@keystone.service[352328]: [pid: 352328|app: 0|req: 136/278] 10.222.0.42 () {56 vars in 1099 bytes} [Thu Jul 28 08:53:14 2022] GET /identity/v3/roles/reader => generated 84 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 08:53:15.144029 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e066dc-c958-431c-8629-cb72b91b4414 None admin] Authenticating user token {{(pid=352328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:53:15.168550 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG dbcounter [-] [352328] Writing DB stats keystone:SELECT=100 {{(pid=352328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:53:15.173835 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b1fcee-8396-48d0-b002-8fc994d8865e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:53:15.174796 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b1fcee-8396-48d0-b002-8fc994d8865e None admin] REQUEST_METHOD: `GET` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:53:15.175074 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b1fcee-8396-48d0-b002-8fc994d8865e None admin] SCRIPT_NAME: `/identity` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:53:15.175349 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b1fcee-8396-48d0-b002-8fc994d8865e None admin] PATH_INFO: `/v3/roles/member` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:53:15.191302 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25b1fcee-8396-48d0-b002-8fc994d8865e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 08:53:15.197217 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application [None req-25b1fcee-8396-48d0-b002-8fc994d8865e None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 28 08:53:15.197217 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:53:15.197217 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:53:15.197217 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:53:15.197217 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:53:15.197217 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:53:15.197217 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:53:15.197217 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:53:15.197217 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:53:15.197217 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:53:15.197217 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:53:15.197217 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:53:15.197217 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 08:53:15.197217 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 08:53:15.197217 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 08:53:15.197217 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 08:53:15.198501 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 08:53:15.198501 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 08:53:15.198501 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 08:53:15.198501 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 08:53:15.198501 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:53:15.198501 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:53:15.198501 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:53:15.198501 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:53:15.198501 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:53:15.198501 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:53:15.198501 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:53:15.198501 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application with Lock( Jul 28 08:53:15.198501 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:53:15.198501 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:53:15.198501 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:53:15.198501 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:53:15.199508 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:53:15.199508 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:53:15.199508 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:53:15.199508 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:53:15.199508 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 08:53:15.199508 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 08:53:15.199508 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 08:53:15.199508 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 08:53:15.199508 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 08:53:15.199508 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 08:53:15.199508 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 28 08:53:15.199508 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application Jul 28 08:53:15.200273 dv-cinder-851351-1-smb devstack@keystone.service[352329]: [pid: 352329|app: 0|req: 143/279] 10.222.0.42 () {56 vars in 1099 bytes} [Thu Jul 28 08:53:14 2022] GET /identity/v3/roles/member => generated 84 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 08:53:15.206882 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b1fcee-8396-48d0-b002-8fc994d8865e None admin] Authenticating user token {{(pid=352329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:53:15.280506 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e066dc-c958-431c-8629-cb72b91b4414 None admin] Validating token access rules against request {{(pid=352328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:53:15.300861 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG dbcounter [-] [352329] Writing DB stats keystone:SELECT=100 {{(pid=352329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:53:15.320723 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd922a9-7a73-4139-bc14-75eda4265e86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:53:15.321416 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd922a9-7a73-4139-bc14-75eda4265e86 None admin] REQUEST_METHOD: `GET` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:53:15.321697 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd922a9-7a73-4139-bc14-75eda4265e86 None admin] SCRIPT_NAME: `/identity` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:53:15.321972 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd922a9-7a73-4139-bc14-75eda4265e86 None admin] PATH_INFO: `/v3/roles` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:53:15.322864 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd922a9-7a73-4139-bc14-75eda4265e86 None admin] RBAC: Adding query filter params (name=reader) {{(pid=352328) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:53:15.323222 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd922a9-7a73-4139-bc14-75eda4265e86 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:53:15.324815 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd922a9-7a73-4139-bc14-75eda4265e86 None admin] RBAC: Authorization granted {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:53:15.327415 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b1fcee-8396-48d0-b002-8fc994d8865e None admin] Validating token access rules against request {{(pid=352329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:53:15.334957 dv-cinder-851351-1-smb devstack@keystone.service[352328]: [pid: 352328|app: 0|req: 137/280] 10.222.0.42 () {56 vars in 1101 bytes} [Thu Jul 28 08:53:15 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 08:53:15.340407 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd922a9-7a73-4139-bc14-75eda4265e86 None admin] Authenticating user token {{(pid=352328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:53:15.365591 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6139131-7432-4899-8c06-75923c346137 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:53:15.366237 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6139131-7432-4899-8c06-75923c346137 None admin] REQUEST_METHOD: `GET` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:53:15.366519 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6139131-7432-4899-8c06-75923c346137 None admin] SCRIPT_NAME: `/identity` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:53:15.366791 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6139131-7432-4899-8c06-75923c346137 None admin] PATH_INFO: `/v3/roles` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:53:15.367522 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6139131-7432-4899-8c06-75923c346137 None admin] RBAC: Adding query filter params (name=member) {{(pid=352329) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:53:15.367828 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6139131-7432-4899-8c06-75923c346137 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:53:15.369280 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6139131-7432-4899-8c06-75923c346137 None admin] RBAC: Authorization granted {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:53:15.378858 dv-cinder-851351-1-smb devstack@keystone.service[352329]: [pid: 352329|app: 0|req: 144/281] 10.222.0.42 () {56 vars in 1101 bytes} [Thu Jul 28 08:53:15 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 08:53:15.384752 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6139131-7432-4899-8c06-75923c346137 None admin] Authenticating user token {{(pid=352329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:53:15.442514 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG dbcounter [-] [352328] Writing DB stats keystone:SELECT=100 {{(pid=352328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:53:15.463530 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd922a9-7a73-4139-bc14-75eda4265e86 None admin] Validating token access rules against request {{(pid=352328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:53:15.496195 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6139131-7432-4899-8c06-75923c346137 None admin] Validating token access rules against request {{(pid=352329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:53:15.500265 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf5ff49b-87a2-4915-ad96-0c24a7a6e825 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:53:15.500959 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5ff49b-87a2-4915-ad96-0c24a7a6e825 None admin] REQUEST_METHOD: `GET` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:53:15.501250 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5ff49b-87a2-4915-ad96-0c24a7a6e825 None admin] SCRIPT_NAME: `/identity` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:53:15.501528 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5ff49b-87a2-4915-ad96-0c24a7a6e825 None admin] PATH_INFO: `/v3/users/b7cd5d64f7a6486aa3ca34ab7044ab52` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:53:15.502801 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf5ff49b-87a2-4915-ad96-0c24a7a6e825 None admin] RBAC: Authorizing `identity:get_user(user_id=b7cd5d64f7a6486aa3ca34ab7044ab52)` {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:53:15.504390 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf5ff49b-87a2-4915-ad96-0c24a7a6e825 None admin] RBAC: Authorization granted {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:53:15.506575 dv-cinder-851351-1-smb devstack@keystone.service[352328]: [pid: 352328|app: 0|req: 138/282] 10.222.0.42 () {56 vars in 1177 bytes} [Thu Jul 28 08:53:15 2022] GET /identity/v3/users/b7cd5d64f7a6486aa3ca34ab7044ab52 => generated 297 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 08:53:15.511827 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf5ff49b-87a2-4915-ad96-0c24a7a6e825 None admin] Authenticating user token {{(pid=352328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:53:15.557602 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37cb160e-ef71-4030-a6d5-2e36469fdfe9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:53:15.558242 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37cb160e-ef71-4030-a6d5-2e36469fdfe9 None admin] REQUEST_METHOD: `GET` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:53:15.559340 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37cb160e-ef71-4030-a6d5-2e36469fdfe9 None admin] SCRIPT_NAME: `/identity` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:53:15.559340 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37cb160e-ef71-4030-a6d5-2e36469fdfe9 None admin] PATH_INFO: `/v3/users/4be5a5e817b04cf996b1f068d558f7d7` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:53:15.579383 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG dbcounter [-] [352329] Writing DB stats keystone:SELECT=100 {{(pid=352329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:53:15.583994 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37cb160e-ef71-4030-a6d5-2e36469fdfe9 None admin] RBAC: Authorizing `identity:get_user(user_id=4be5a5e817b04cf996b1f068d558f7d7)` {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:53:15.585552 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37cb160e-ef71-4030-a6d5-2e36469fdfe9 None admin] RBAC: Authorization granted {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:53:15.587324 dv-cinder-851351-1-smb devstack@keystone.service[352329]: [pid: 352329|app: 0|req: 145/283] 10.222.0.42 () {56 vars in 1177 bytes} [Thu Jul 28 08:53:15 2022] GET /identity/v3/users/4be5a5e817b04cf996b1f068d558f7d7 => generated 293 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 08:53:15.594573 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37cb160e-ef71-4030-a6d5-2e36469fdfe9 None admin] Authenticating user token {{(pid=352329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:53:15.733181 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37cb160e-ef71-4030-a6d5-2e36469fdfe9 None admin] Validating token access rules against request {{(pid=352329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:53:15.753147 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf5ff49b-87a2-4915-ad96-0c24a7a6e825 None admin] Validating token access rules against request {{(pid=352328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:53:15.775821 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2efca5-3e46-4496-a40c-8ff0ecb2ec41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:53:15.776640 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2efca5-3e46-4496-a40c-8ff0ecb2ec41 None admin] REQUEST_METHOD: `GET` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:53:15.780693 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2efca5-3e46-4496-a40c-8ff0ecb2ec41 None admin] SCRIPT_NAME: `/identity` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:53:15.780693 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2efca5-3e46-4496-a40c-8ff0ecb2ec41 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:53:15.780693 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f2efca5-3e46-4496-a40c-8ff0ecb2ec41 None admin] RBAC: Adding query filter params (role.id=16a3fc3aca974c47a329c2781b0be93a, user.id=4be5a5e817b04cf996b1f068d558f7d7, scope.system=all) {{(pid=352329) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:53:15.780693 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f2efca5-3e46-4496-a40c-8ff0ecb2ec41 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:53:15.780693 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f2efca5-3e46-4496-a40c-8ff0ecb2ec41 None admin] RBAC: Authorization granted {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:53:15.787808 dv-cinder-851351-1-smb devstack@keystone.service[352329]: [pid: 352329|app: 0|req: 146/284] 10.222.0.42 () {56 vars in 1308 bytes} [Thu Jul 28 08:53:15 2022] GET /identity/v3/role_assignments?user.id=4be5a5e817b04cf996b1f068d558f7d7&scope.system=all&role.id=16a3fc3aca974c47a329c2781b0be93a => generated 226 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:53:15.818211 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf11ef9-ec60-4a5b-94a9-5ed3fd469577 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:53:15.818803 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf11ef9-ec60-4a5b-94a9-5ed3fd469577 None admin] REQUEST_METHOD: `GET` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:53:15.819114 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf11ef9-ec60-4a5b-94a9-5ed3fd469577 None admin] SCRIPT_NAME: `/identity` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:53:15.819447 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf11ef9-ec60-4a5b-94a9-5ed3fd469577 None admin] PATH_INFO: `/v3/projects/be5ef7d0266e453784a39d297f9b131d` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:53:15.820770 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cf11ef9-ec60-4a5b-94a9-5ed3fd469577 None admin] RBAC: Authorizing `identity:get_project(project_id=be5ef7d0266e453784a39d297f9b131d)` {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:53:15.822339 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cf11ef9-ec60-4a5b-94a9-5ed3fd469577 None admin] RBAC: Authorization granted {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:53:15.824696 dv-cinder-851351-1-smb devstack@keystone.service[352328]: [pid: 352328|app: 0|req: 139/285] 10.222.0.42 () {56 vars in 1186 bytes} [Thu Jul 28 08:53:15 2022] GET /identity/v3/projects/be5ef7d0266e453784a39d297f9b131d => generated 302 bytes in 313 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 08:53:15.833952 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2efca5-3e46-4496-a40c-8ff0ecb2ec41 None admin] Authenticating user token {{(pid=352329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:53:15.969101 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG dbcounter [-] [352329] Writing DB stats keystone:SELECT=100 {{(pid=352329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:53:16.021833 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2efca5-3e46-4496-a40c-8ff0ecb2ec41 None admin] Validating token access rules against request {{(pid=352329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:53:16.078265 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949e792e-81d2-42ce-acd1-3724c2b6f858 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:53:16.078986 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949e792e-81d2-42ce-acd1-3724c2b6f858 None admin] REQUEST_METHOD: `PUT` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:53:16.079640 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949e792e-81d2-42ce-acd1-3724c2b6f858 None admin] SCRIPT_NAME: `/identity` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:53:16.079988 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949e792e-81d2-42ce-acd1-3724c2b6f858 None admin] PATH_INFO: `/v3/projects/be5ef7d0266e453784a39d297f9b131d/users/b7cd5d64f7a6486aa3ca34ab7044ab52/roles/3abd212955234654b7d9a8d7df33e380` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:53:16.083738 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-949e792e-81d2-42ce-acd1-3724c2b6f858 None admin] RBAC: Authorizing `identity:create_grant(project_id=be5ef7d0266e453784a39d297f9b131d, user_id=b7cd5d64f7a6486aa3ca34ab7044ab52, role_id=3abd212955234654b7d9a8d7df33e380)` {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:53:16.085343 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-949e792e-81d2-42ce-acd1-3724c2b6f858 None admin] RBAC: Authorization granted {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:53:16.110048 dv-cinder-851351-1-smb devstack@keystone.service[352329]: [pid: 352329|app: 0|req: 147/286] 10.222.0.42 () {58 vars in 1439 bytes} [Thu Jul 28 08:53:15 2022] PUT /identity/v3/projects/be5ef7d0266e453784a39d297f9b131d/users/b7cd5d64f7a6486aa3ca34ab7044ab52/roles/3abd212955234654b7d9a8d7df33e380 => generated 0 bytes in 276 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 08:53:16.627468 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b718b7f-89e2-4905-aac0-eb79477479c4 None None] REQUEST_METHOD: `GET` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:53:16.628072 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b718b7f-89e2-4905-aac0-eb79477479c4 None None] SCRIPT_NAME: `/identity` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:53:16.628072 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b718b7f-89e2-4905-aac0-eb79477479c4 None None] PATH_INFO: `/` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:53:16.629740 dv-cinder-851351-1-smb devstack@keystone.service[352328]: [pid: 352328|app: 0|req: 140/287] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 08:53:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 08:53:16.634984 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f607e2b1-2f70-4ef6-aa03-4a1248f22d69 None None] REQUEST_METHOD: `POST` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:53:16.635273 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f607e2b1-2f70-4ef6-aa03-4a1248f22d69 None None] SCRIPT_NAME: `/identity` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:53:16.635552 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f607e2b1-2f70-4ef6-aa03-4a1248f22d69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:53:16.661755 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.auth.core [None req-f607e2b1-2f70-4ef6-aa03-4a1248f22d69 None None] MFA Rules not processed for user `d18c063b2377412485965357671e5506`. Rule list: `[]` (Enabled: `True`). {{(pid=352329) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 08:53:16.662998 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.fernet_utils [None req-f607e2b1-2f70-4ef6-aa03-4a1248f22d69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=352329) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:53:16.750564 dv-cinder-851351-1-smb devstack@keystone.service[352329]: [pid: 352329|app: 0|req: 148/288] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 08:53:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 08:53:16.773806 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b718b7f-89e2-4905-aac0-eb79477479c4 None None] Authenticating user token {{(pid=352328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:53:16.795225 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG dbcounter [-] [352328] Writing DB stats keystone:SELECT=100 {{(pid=352328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:53:16.886101 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b718b7f-89e2-4905-aac0-eb79477479c4 None None] Validating token access rules against request {{(pid=352328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:53:16.922307 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001d7be2-2003-4c53-addb-defc4bea5dfe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:53:16.922978 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001d7be2-2003-4c53-addb-defc4bea5dfe None admin] REQUEST_METHOD: `GET` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:53:16.923261 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001d7be2-2003-4c53-addb-defc4bea5dfe None admin] SCRIPT_NAME: `/identity` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:53:16.923611 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001d7be2-2003-4c53-addb-defc4bea5dfe None admin] PATH_INFO: `/v3/roles/member` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:53:16.935318 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-001d7be2-2003-4c53-addb-defc4bea5dfe None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 08:53:16.941027 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application [None req-001d7be2-2003-4c53-addb-defc4bea5dfe None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 28 08:53:16.941027 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:53:16.941027 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:53:16.941027 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:53:16.941027 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:53:16.941027 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:53:16.941027 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:53:16.941027 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:53:16.941027 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:53:16.941027 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:53:16.941027 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:53:16.941027 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:53:16.941027 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 08:53:16.941027 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 08:53:16.941027 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 08:53:16.941027 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 08:53:16.943447 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 08:53:16.943447 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 08:53:16.943447 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 08:53:16.943447 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 08:53:16.943447 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:53:16.943447 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:53:16.943447 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:53:16.943447 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:53:16.943447 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:53:16.943447 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:53:16.943447 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:53:16.943447 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application with Lock( Jul 28 08:53:16.943447 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:53:16.943447 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:53:16.943447 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:53:16.943447 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:53:16.945741 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:53:16.945741 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:53:16.945741 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:53:16.945741 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:53:16.945741 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 08:53:16.945741 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 08:53:16.945741 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 08:53:16.945741 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 08:53:16.945741 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 08:53:16.945741 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 08:53:16.945741 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 28 08:53:16.945741 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application Jul 28 08:53:16.945741 dv-cinder-851351-1-smb devstack@keystone.service[352328]: [pid: 352328|app: 0|req: 141/289] 10.222.0.42 () {56 vars in 1099 bytes} [Thu Jul 28 08:53:16 2022] GET /identity/v3/roles/member => generated 84 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:53:16.953463 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f607e2b1-2f70-4ef6-aa03-4a1248f22d69 None None] Authenticating user token {{(pid=352329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:53:17.045081 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG dbcounter [-] [352329] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=352329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:53:17.093647 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f607e2b1-2f70-4ef6-aa03-4a1248f22d69 None None] Validating token access rules against request {{(pid=352329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:53:17.137532 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607bec84-1acd-4509-9c44-6bbd0339ad48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:53:17.138105 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607bec84-1acd-4509-9c44-6bbd0339ad48 None admin] REQUEST_METHOD: `GET` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:53:17.138392 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607bec84-1acd-4509-9c44-6bbd0339ad48 None admin] SCRIPT_NAME: `/identity` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:53:17.138672 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607bec84-1acd-4509-9c44-6bbd0339ad48 None admin] PATH_INFO: `/v3/roles` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:53:17.139420 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-607bec84-1acd-4509-9c44-6bbd0339ad48 None admin] RBAC: Adding query filter params (name=member) {{(pid=352329) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:53:17.139727 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-607bec84-1acd-4509-9c44-6bbd0339ad48 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:53:17.141189 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-607bec84-1acd-4509-9c44-6bbd0339ad48 None admin] RBAC: Authorization granted {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:53:17.150605 dv-cinder-851351-1-smb devstack@keystone.service[352329]: [pid: 352329|app: 0|req: 149/290] 10.222.0.42 () {56 vars in 1101 bytes} [Thu Jul 28 08:53:16 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:53:17.161863 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001d7be2-2003-4c53-addb-defc4bea5dfe None admin] Authenticating user token {{(pid=352328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:53:17.263162 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG dbcounter [-] [352328] Writing DB stats keystone:SELECT=100 {{(pid=352328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:53:17.286052 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001d7be2-2003-4c53-addb-defc4bea5dfe None admin] Validating token access rules against request {{(pid=352328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:53:17.322143 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba5a91a-3332-4029-b6fe-6666821485ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:53:17.322825 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba5a91a-3332-4029-b6fe-6666821485ef None admin] REQUEST_METHOD: `GET` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:53:17.323109 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba5a91a-3332-4029-b6fe-6666821485ef None admin] SCRIPT_NAME: `/identity` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:53:17.323388 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba5a91a-3332-4029-b6fe-6666821485ef None admin] PATH_INFO: `/v3/users/747d1edf4168468ca4d6cbe7589cc7dd` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:53:17.324807 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba5a91a-3332-4029-b6fe-6666821485ef None admin] RBAC: Authorizing `identity:get_user(user_id=747d1edf4168468ca4d6cbe7589cc7dd)` {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:53:17.326342 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba5a91a-3332-4029-b6fe-6666821485ef None admin] RBAC: Authorization granted {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:53:17.328500 dv-cinder-851351-1-smb devstack@keystone.service[352328]: [pid: 352328|app: 0|req: 142/291] 10.222.0.42 () {56 vars in 1177 bytes} [Thu Jul 28 08:53:17 2022] GET /identity/v3/users/747d1edf4168468ca4d6cbe7589cc7dd => generated 297 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:53:17.334965 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607bec84-1acd-4509-9c44-6bbd0339ad48 None admin] Authenticating user token {{(pid=352329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:53:17.470925 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607bec84-1acd-4509-9c44-6bbd0339ad48 None admin] Validating token access rules against request {{(pid=352329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:53:17.478466 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c2c03e-d633-43de-a3d2-ceba58b2e008 None None] REQUEST_METHOD: `GET` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:53:17.478748 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c2c03e-d633-43de-a3d2-ceba58b2e008 None None] SCRIPT_NAME: `/identity` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:53:17.479012 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c2c03e-d633-43de-a3d2-ceba58b2e008 None None] PATH_INFO: `/` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:53:17.480567 dv-cinder-851351-1-smb devstack@keystone.service[352328]: [pid: 352328|app: 0|req: 143/292] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 08:53:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 28 08:53:17.486194 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be07f0e-b449-48f0-a6c9-7e447f88f7e4 None None] REQUEST_METHOD: `POST` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:53:17.486940 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be07f0e-b449-48f0-a6c9-7e447f88f7e4 None None] SCRIPT_NAME: `/identity` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:53:17.487286 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be07f0e-b449-48f0-a6c9-7e447f88f7e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:53:17.495524 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG dbcounter [-] [352329] Writing DB stats keystone:SELECT=100 {{(pid=352329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:53:17.519562 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.auth.core [None req-7be07f0e-b449-48f0-a6c9-7e447f88f7e4 None None] MFA Rules not processed for user `d18c063b2377412485965357671e5506`. Rule list: `[]` (Enabled: `True`). {{(pid=352328) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 08:53:17.520795 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.fernet_utils [None req-7be07f0e-b449-48f0-a6c9-7e447f88f7e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=352328) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:53:17.538936 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c723f918-26fa-45ef-b46b-0c533ddcc467 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:53:17.539628 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c723f918-26fa-45ef-b46b-0c533ddcc467 None admin] REQUEST_METHOD: `GET` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:53:17.539910 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c723f918-26fa-45ef-b46b-0c533ddcc467 None admin] SCRIPT_NAME: `/identity` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:53:17.540183 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c723f918-26fa-45ef-b46b-0c533ddcc467 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:53:17.652914 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c723f918-26fa-45ef-b46b-0c533ddcc467 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:53:17.653321 dv-cinder-851351-1-smb devstack@keystone.service[352328]: [pid: 352328|app: 0|req: 144/293] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 08:53:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 08:53:17.654253 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c723f918-26fa-45ef-b46b-0c533ddcc467 None admin] RBAC: Authorization granted {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:53:17.693620 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be07f0e-b449-48f0-a6c9-7e447f88f7e4 None None] Authenticating user token {{(pid=352328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:53:17.814351 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG dbcounter [-] [352328] Writing DB stats keystone:SELECT=100 {{(pid=352328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:53:17.824151 dv-cinder-851351-1-smb devstack@keystone.service[352329]: [pid: 352329|app: 0|req: 150/294] 10.222.0.42 () {58 vars in 1282 bytes} [Thu Jul 28 08:53:17 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 490 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 28 08:53:17.830865 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9738e491-deb7-4c59-a299-8a5199171fa6 None None] REQUEST_METHOD: `GET` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:53:17.831440 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9738e491-deb7-4c59-a299-8a5199171fa6 None None] SCRIPT_NAME: `/identity` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:53:17.831936 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9738e491-deb7-4c59-a299-8a5199171fa6 None None] PATH_INFO: `/` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:53:17.834252 dv-cinder-851351-1-smb devstack@keystone.service[352329]: [pid: 352329|app: 0|req: 151/295] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 08:53:17 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 08:53:17.834598 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be07f0e-b449-48f0-a6c9-7e447f88f7e4 None None] Validating token access rules against request {{(pid=352328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:53:17.835476 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9738e491-deb7-4c59-a299-8a5199171fa6 None None] Authenticating user token {{(pid=352329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:53:17.861717 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG dbcounter [-] [352329] Writing DB stats keystone:SELECT=100 {{(pid=352329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:53:17.874335 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bfd865e-e56e-4ebd-8c4b-8a1c84000261 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:53:17.875359 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfd865e-e56e-4ebd-8c4b-8a1c84000261 None admin] REQUEST_METHOD: `GET` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:53:17.875738 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfd865e-e56e-4ebd-8c4b-8a1c84000261 None admin] SCRIPT_NAME: `/identity` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:53:17.876114 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfd865e-e56e-4ebd-8c4b-8a1c84000261 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:53:17.887229 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bfd865e-e56e-4ebd-8c4b-8a1c84000261 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 08:53:17.892409 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application [None req-8bfd865e-e56e-4ebd-8c4b-8a1c84000261 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 28 08:53:17.892409 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:53:17.892409 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:53:17.892409 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:53:17.892409 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:53:17.892409 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:53:17.892409 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:53:17.892409 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:53:17.892409 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:53:17.892409 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:53:17.892409 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:53:17.892409 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:53:17.892409 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 08:53:17.892409 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 08:53:17.892409 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 08:53:17.892409 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 08:53:17.893765 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 08:53:17.893765 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 08:53:17.893765 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 08:53:17.893765 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 08:53:17.893765 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:53:17.893765 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:53:17.893765 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:53:17.893765 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:53:17.893765 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:53:17.893765 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:53:17.893765 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:53:17.893765 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application with Lock( Jul 28 08:53:17.893765 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:53:17.893765 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:53:17.893765 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:53:17.893765 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:53:17.895005 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:53:17.895005 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:53:17.895005 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:53:17.895005 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:53:17.895005 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 08:53:17.895005 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 08:53:17.895005 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 08:53:17.895005 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 08:53:17.895005 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 08:53:17.895005 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 08:53:17.895005 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 28 08:53:17.895005 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application Jul 28 08:53:17.896483 dv-cinder-851351-1-smb devstack@keystone.service[352328]: [pid: 352328|app: 0|req: 145/296] 10.222.0.42 () {56 vars in 1099 bytes} [Thu Jul 28 08:53:17 2022] GET /identity/v3/roles/reader => generated 84 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 08:53:17.897855 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06937af8-9831-4330-bca0-ec61f1ad998f None None] REQUEST_METHOD: `POST` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:53:17.898235 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06937af8-9831-4330-bca0-ec61f1ad998f None None] SCRIPT_NAME: `/identity` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:53:17.898618 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06937af8-9831-4330-bca0-ec61f1ad998f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:53:17.918339 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.auth.core [None req-06937af8-9831-4330-bca0-ec61f1ad998f None None] MFA Rules not processed for user `d18c063b2377412485965357671e5506`. Rule list: `[]` (Enabled: `True`). {{(pid=352328) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 08:53:17.919582 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.fernet_utils [None req-06937af8-9831-4330-bca0-ec61f1ad998f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=352328) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:53:17.953822 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9738e491-deb7-4c59-a299-8a5199171fa6 None None] Validating token access rules against request {{(pid=352329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:53:17.990759 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328c0c27-de7d-43f3-8d7a-22fc682dbd78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:53:17.991846 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328c0c27-de7d-43f3-8d7a-22fc682dbd78 None admin] REQUEST_METHOD: `GET` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:53:17.992347 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328c0c27-de7d-43f3-8d7a-22fc682dbd78 None admin] SCRIPT_NAME: `/identity` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:53:17.992902 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328c0c27-de7d-43f3-8d7a-22fc682dbd78 None admin] PATH_INFO: `/v3/projects/be5ef7d0266e453784a39d297f9b131d` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:53:17.994372 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-328c0c27-de7d-43f3-8d7a-22fc682dbd78 None admin] RBAC: Authorizing `identity:get_project(project_id=be5ef7d0266e453784a39d297f9b131d)` {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:53:17.996077 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-328c0c27-de7d-43f3-8d7a-22fc682dbd78 None admin] RBAC: Authorization granted {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:53:17.996987 dv-cinder-851351-1-smb devstack@keystone.service[352328]: [pid: 352328|app: 0|req: 146/297] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 08:53:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 08:53:17.997977 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06937af8-9831-4330-bca0-ec61f1ad998f None None] Authenticating user token {{(pid=352328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:53:17.998656 dv-cinder-851351-1-smb devstack@keystone.service[352329]: [pid: 352329|app: 0|req: 152/298] 10.222.0.42 () {56 vars in 1186 bytes} [Thu Jul 28 08:53:17 2022] GET /identity/v3/projects/be5ef7d0266e453784a39d297f9b131d => generated 302 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:53:18.015488 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328c0c27-de7d-43f3-8d7a-22fc682dbd78 None admin] Authenticating user token {{(pid=352329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:53:18.076607 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG dbcounter [-] [352328] Writing DB stats keystone:SELECT=100 {{(pid=352328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:53:18.114799 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06937af8-9831-4330-bca0-ec61f1ad998f None None] Validating token access rules against request {{(pid=352328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:53:18.117103 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG dbcounter [-] [352329] Writing DB stats keystone:SELECT=100 {{(pid=352329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:53:18.130769 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328c0c27-de7d-43f3-8d7a-22fc682dbd78 None admin] Validating token access rules against request {{(pid=352329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:53:18.150055 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada91cba-958d-4f03-82e8-37faae543086 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:53:18.150727 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada91cba-958d-4f03-82e8-37faae543086 None admin] REQUEST_METHOD: `GET` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:53:18.151013 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada91cba-958d-4f03-82e8-37faae543086 None admin] SCRIPT_NAME: `/identity` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:53:18.151291 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada91cba-958d-4f03-82e8-37faae543086 None admin] PATH_INFO: `/v3/roles` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:53:18.152024 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada91cba-958d-4f03-82e8-37faae543086 None admin] RBAC: Adding query filter params (name=reader) {{(pid=352328) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:53:18.152325 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada91cba-958d-4f03-82e8-37faae543086 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:53:18.153768 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada91cba-958d-4f03-82e8-37faae543086 None admin] RBAC: Authorization granted {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:53:18.163612 dv-cinder-851351-1-smb devstack@keystone.service[352328]: [pid: 352328|app: 0|req: 147/299] 10.222.0.42 () {56 vars in 1101 bytes} [Thu Jul 28 08:53:17 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:53:18.164700 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada91cba-958d-4f03-82e8-37faae543086 None admin] Authenticating user token {{(pid=352328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:53:18.173544 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96db097d-9649-4c3e-b9a0-87473cb9a624 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:53:18.174575 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96db097d-9649-4c3e-b9a0-87473cb9a624 None admin] REQUEST_METHOD: `GET` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:53:18.175053 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96db097d-9649-4c3e-b9a0-87473cb9a624 None admin] SCRIPT_NAME: `/identity` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:53:18.175632 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96db097d-9649-4c3e-b9a0-87473cb9a624 None admin] PATH_INFO: `/v3/domains/default` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:53:18.177245 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96db097d-9649-4c3e-b9a0-87473cb9a624 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:53:18.179075 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96db097d-9649-4c3e-b9a0-87473cb9a624 None admin] RBAC: Authorization granted {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:53:18.181679 dv-cinder-851351-1-smb devstack@keystone.service[352329]: [pid: 352329|app: 0|req: 153/300] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 08:53:18 2022] GET /identity/v3/domains/default => generated 199 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 08:53:18.182741 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96db097d-9649-4c3e-b9a0-87473cb9a624 None admin] Authenticating user token {{(pid=352329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:53:18.274463 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada91cba-958d-4f03-82e8-37faae543086 None admin] Validating token access rules against request {{(pid=352328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:53:18.301569 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG dbcounter [-] [352328] Writing DB stats keystone:SELECT=100 {{(pid=352328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:53:18.304656 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96db097d-9649-4c3e-b9a0-87473cb9a624 None admin] Validating token access rules against request {{(pid=352329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:53:18.311176 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee05d38-4fc1-45a4-8d36-3978b2aba989 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:53:18.311899 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee05d38-4fc1-45a4-8d36-3978b2aba989 None admin] REQUEST_METHOD: `GET` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:53:18.312242 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee05d38-4fc1-45a4-8d36-3978b2aba989 None admin] SCRIPT_NAME: `/identity` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:53:18.312584 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee05d38-4fc1-45a4-8d36-3978b2aba989 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:53:18.313483 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ee05d38-4fc1-45a4-8d36-3978b2aba989 None admin] RBAC: Adding query filter params (role.id=16a3fc3aca974c47a329c2781b0be93a, scope.project.id=be5ef7d0266e453784a39d297f9b131d, user.id=747d1edf4168468ca4d6cbe7589cc7dd) {{(pid=352328) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:53:18.313879 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ee05d38-4fc1-45a4-8d36-3978b2aba989 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:53:18.315430 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ee05d38-4fc1-45a4-8d36-3978b2aba989 None admin] RBAC: Authorization granted {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:53:18.322029 dv-cinder-851351-1-smb devstack@keystone.service[352328]: [pid: 352328|app: 0|req: 148/301] 10.222.0.42 () {56 vars in 1374 bytes} [Thu Jul 28 08:53:18 2022] GET /identity/v3/role_assignments?user.id=747d1edf4168468ca4d6cbe7589cc7dd&scope.project.id=be5ef7d0266e453784a39d297f9b131d&role.id=16a3fc3aca974c47a329c2781b0be93a => generated 608 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:53:18.322814 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee05d38-4fc1-45a4-8d36-3978b2aba989 None admin] Authenticating user token {{(pid=352328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:53:18.349809 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fce9bce-25ab-4238-a916-1e2bd0aceff3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:53:18.351015 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fce9bce-25ab-4238-a916-1e2bd0aceff3 None admin] REQUEST_METHOD: `GET` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:53:18.351604 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fce9bce-25ab-4238-a916-1e2bd0aceff3 None admin] SCRIPT_NAME: `/identity` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:53:18.352087 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fce9bce-25ab-4238-a916-1e2bd0aceff3 None admin] PATH_INFO: `/v3/users/694481f660d64b0b8e0b04dc860e3b88` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:53:18.369464 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fce9bce-25ab-4238-a916-1e2bd0aceff3 None admin] RBAC: Authorizing `identity:get_user(user_id=694481f660d64b0b8e0b04dc860e3b88)` {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:53:18.371713 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fce9bce-25ab-4238-a916-1e2bd0aceff3 None admin] RBAC: Authorization granted {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:53:18.374343 dv-cinder-851351-1-smb devstack@keystone.service[352329]: [pid: 352329|app: 0|req: 154/302] 10.222.0.42 () {56 vars in 1177 bytes} [Thu Jul 28 08:53:18 2022] GET /identity/v3/users/694481f660d64b0b8e0b04dc860e3b88 => generated 293 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:53:18.381824 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fce9bce-25ab-4238-a916-1e2bd0aceff3 None admin] Authenticating user token {{(pid=352329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:53:18.403420 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG dbcounter [-] [352329] Writing DB stats keystone:SELECT=100 {{(pid=352329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:53:18.475484 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee05d38-4fc1-45a4-8d36-3978b2aba989 None admin] Validating token access rules against request {{(pid=352328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:53:18.514397 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b82599b-2fd5-4781-9689-ae339deafc49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:53:18.515069 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b82599b-2fd5-4781-9689-ae339deafc49 None admin] REQUEST_METHOD: `POST` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:53:18.515352 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b82599b-2fd5-4781-9689-ae339deafc49 None admin] SCRIPT_NAME: `/identity` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:53:18.515632 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b82599b-2fd5-4781-9689-ae339deafc49 None admin] PATH_INFO: `/v3/groups` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:53:18.516353 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b82599b-2fd5-4781-9689-ae339deafc49 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:53:18.519730 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b82599b-2fd5-4781-9689-ae339deafc49 None admin] RBAC: Authorization granted {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:53:18.545749 dv-cinder-851351-1-smb devstack@keystone.service[352328]: [pid: 352328|app: 0|req: 149/303] 10.222.0.42 () {60 vars in 1134 bytes} [Thu Jul 28 08:53:18 2022] POST /identity/v3/groups => generated 229 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 08:53:18.547706 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85ea204-518e-4586-a592-0c3d5f6fcb81 None None] REQUEST_METHOD: `GET` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:53:18.548413 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85ea204-518e-4586-a592-0c3d5f6fcb81 None None] SCRIPT_NAME: `/identity` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:53:18.548766 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85ea204-518e-4586-a592-0c3d5f6fcb81 None None] PATH_INFO: `/` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:53:18.555541 dv-cinder-851351-1-smb devstack@keystone.service[352328]: [pid: 352328|app: 0|req: 150/304] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 08:53:18 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 08:53:18.557425 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1240451a-7560-48fb-bc44-e46721e40963 None None] REQUEST_METHOD: `POST` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:53:18.557721 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1240451a-7560-48fb-bc44-e46721e40963 None None] SCRIPT_NAME: `/identity` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:53:18.557998 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1240451a-7560-48fb-bc44-e46721e40963 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:53:18.558240 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fce9bce-25ab-4238-a916-1e2bd0aceff3 None admin] Validating token access rules against request {{(pid=352329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:53:18.588042 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.auth.core [None req-1240451a-7560-48fb-bc44-e46721e40963 None None] MFA Rules not processed for user `d18c063b2377412485965357671e5506`. Rule list: `[]` (Enabled: `True`). {{(pid=352328) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 08:53:18.588820 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.fernet_utils [None req-1240451a-7560-48fb-bc44-e46721e40963 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=352328) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:53:18.608856 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b8d3b1f-4518-424c-8a30-07fb4ab198cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:53:18.609957 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8d3b1f-4518-424c-8a30-07fb4ab198cd None admin] REQUEST_METHOD: `GET` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:53:18.610338 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8d3b1f-4518-424c-8a30-07fb4ab198cd None admin] SCRIPT_NAME: `/identity` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:53:18.610623 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8d3b1f-4518-424c-8a30-07fb4ab198cd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:53:18.611516 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b8d3b1f-4518-424c-8a30-07fb4ab198cd None admin] RBAC: Adding query filter params (role.id=3abd212955234654b7d9a8d7df33e380, user.id=694481f660d64b0b8e0b04dc860e3b88, scope.system=all) {{(pid=352329) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:53:18.611836 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b8d3b1f-4518-424c-8a30-07fb4ab198cd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:53:18.613401 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b8d3b1f-4518-424c-8a30-07fb4ab198cd None admin] RBAC: Authorization granted {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:53:18.624712 dv-cinder-851351-1-smb devstack@keystone.service[352329]: [pid: 352329|app: 0|req: 155/305] 10.222.0.42 () {56 vars in 1308 bytes} [Thu Jul 28 08:53:18 2022] GET /identity/v3/role_assignments?user.id=694481f660d64b0b8e0b04dc860e3b88&scope.system=all&role.id=3abd212955234654b7d9a8d7df33e380 => generated 226 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:53:18.624712 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4a72f2-31c8-49c8-88da-771b064dfdbb None None] REQUEST_METHOD: `GET` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:53:18.624712 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4a72f2-31c8-49c8-88da-771b064dfdbb None None] SCRIPT_NAME: `/identity` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:53:18.624712 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4a72f2-31c8-49c8-88da-771b064dfdbb None None] PATH_INFO: `/` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:53:18.624712 dv-cinder-851351-1-smb devstack@keystone.service[352329]: [pid: 352329|app: 0|req: 156/306] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 08:53:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 08:53:18.630927 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9912dfbe-3b5c-465a-8151-762c34c53264 None None] REQUEST_METHOD: `POST` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:53:18.631246 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9912dfbe-3b5c-465a-8151-762c34c53264 None None] SCRIPT_NAME: `/identity` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:53:18.631485 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9912dfbe-3b5c-465a-8151-762c34c53264 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:53:18.651650 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.auth.core [None req-9912dfbe-3b5c-465a-8151-762c34c53264 None None] MFA Rules not processed for user `d18c063b2377412485965357671e5506`. Rule list: `[]` (Enabled: `True`). {{(pid=352329) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 08:53:18.653035 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.fernet_utils [None req-9912dfbe-3b5c-465a-8151-762c34c53264 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=352329) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:53:18.663177 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG dbcounter [-] [352328] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=352328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:53:18.695625 dv-cinder-851351-1-smb devstack@keystone.service[352328]: [pid: 352328|app: 0|req: 151/307] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 08:53:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 28 08:53:18.718237 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1240451a-7560-48fb-bc44-e46721e40963 None None] Authenticating user token {{(pid=352328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:53:18.740116 dv-cinder-851351-1-smb devstack@keystone.service[352329]: [pid: 352329|app: 0|req: 157/308] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 08:53:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 28 08:53:18.763450 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9912dfbe-3b5c-465a-8151-762c34c53264 None None] Authenticating user token {{(pid=352329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:53:18.765774 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG dbcounter [-] [352329] Writing DB stats keystone:SELECT=100 {{(pid=352329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:53:18.860612 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1240451a-7560-48fb-bc44-e46721e40963 None None] Validating token access rules against request {{(pid=352328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:53:18.896233 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9912dfbe-3b5c-465a-8151-762c34c53264 None None] Validating token access rules against request {{(pid=352329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:53:18.900318 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca665deb-8152-455b-88df-e7fad9f62dd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:53:18.901015 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca665deb-8152-455b-88df-e7fad9f62dd1 None admin] REQUEST_METHOD: `GET` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:53:18.901297 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca665deb-8152-455b-88df-e7fad9f62dd1 None admin] SCRIPT_NAME: `/identity` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:53:18.901572 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca665deb-8152-455b-88df-e7fad9f62dd1 None admin] PATH_INFO: `/v3/roles/member` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:53:18.913852 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca665deb-8152-455b-88df-e7fad9f62dd1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 08:53:18.919240 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application [None req-ca665deb-8152-455b-88df-e7fad9f62dd1 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 28 08:53:18.919240 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:53:18.919240 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:53:18.919240 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:53:18.919240 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:53:18.919240 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:53:18.919240 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:53:18.919240 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:53:18.919240 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:53:18.919240 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:53:18.919240 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:53:18.919240 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:53:18.919240 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 08:53:18.919240 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 08:53:18.919240 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 08:53:18.919240 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 08:53:18.920364 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 08:53:18.920364 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 08:53:18.920364 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 08:53:18.920364 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 08:53:18.920364 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:53:18.920364 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:53:18.920364 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:53:18.920364 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:53:18.920364 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:53:18.920364 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:53:18.920364 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:53:18.920364 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application with Lock( Jul 28 08:53:18.920364 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:53:18.920364 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:53:18.920364 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:53:18.920364 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:53:18.921432 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:53:18.921432 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:53:18.921432 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:53:18.921432 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:53:18.921432 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 08:53:18.921432 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 08:53:18.921432 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 08:53:18.921432 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 08:53:18.921432 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 08:53:18.921432 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 08:53:18.921432 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 28 08:53:18.921432 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application Jul 28 08:53:18.921432 dv-cinder-851351-1-smb devstack@keystone.service[352328]: [pid: 352328|app: 0|req: 152/309] 10.222.0.42 () {56 vars in 1099 bytes} [Thu Jul 28 08:53:18 2022] GET /identity/v3/roles/member => generated 84 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 08:53:18.926410 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca665deb-8152-455b-88df-e7fad9f62dd1 None admin] Authenticating user token {{(pid=352328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:53:18.932654 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d778ed8-15ff-4661-abba-0b482bd67d1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:53:18.933381 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d778ed8-15ff-4661-abba-0b482bd67d1f None admin] REQUEST_METHOD: `GET` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:53:18.933635 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d778ed8-15ff-4661-abba-0b482bd67d1f None admin] SCRIPT_NAME: `/identity` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:53:18.933918 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d778ed8-15ff-4661-abba-0b482bd67d1f None admin] PATH_INFO: `/v3/roles/reader` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:53:18.945410 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d778ed8-15ff-4661-abba-0b482bd67d1f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 08:53:18.950441 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application [None req-3d778ed8-15ff-4661-abba-0b482bd67d1f None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 28 08:53:18.950441 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:53:18.950441 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:53:18.950441 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:53:18.950441 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:53:18.950441 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:53:18.950441 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:53:18.950441 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:53:18.950441 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:53:18.950441 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:53:18.950441 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:53:18.950441 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:53:18.950441 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 08:53:18.950441 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 08:53:18.950441 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 08:53:18.950441 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 08:53:18.952751 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 08:53:18.952751 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 08:53:18.952751 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 08:53:18.952751 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 08:53:18.952751 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:53:18.952751 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:53:18.952751 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:53:18.952751 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:53:18.952751 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:53:18.952751 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:53:18.952751 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:53:18.952751 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application with Lock( Jul 28 08:53:18.952751 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:53:18.952751 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:53:18.952751 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:53:18.952751 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:53:18.955392 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:53:18.955392 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:53:18.955392 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:53:18.955392 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:53:18.955392 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 08:53:18.955392 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 08:53:18.955392 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 08:53:18.955392 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 08:53:18.955392 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 08:53:18.955392 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 08:53:18.955392 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 28 08:53:18.955392 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application Jul 28 08:53:18.955392 dv-cinder-851351-1-smb devstack@keystone.service[352329]: [pid: 352329|app: 0|req: 158/310] 10.222.0.42 () {56 vars in 1099 bytes} [Thu Jul 28 08:53:18 2022] GET /identity/v3/roles/reader => generated 84 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 08:53:18.962729 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d778ed8-15ff-4661-abba-0b482bd67d1f None admin] Authenticating user token {{(pid=352329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:53:18.975556 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG dbcounter [-] [352328] Writing DB stats keystone:SELECT=100 {{(pid=352328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:53:19.045920 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca665deb-8152-455b-88df-e7fad9f62dd1 None admin] Validating token access rules against request {{(pid=352328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:53:19.055461 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG dbcounter [-] [352329] Writing DB stats keystone:SELECT=100 {{(pid=352329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:53:19.084873 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d732e13d-c1d1-4cb3-9ff3-33c314b3e522 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:53:19.085582 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d732e13d-c1d1-4cb3-9ff3-33c314b3e522 None admin] REQUEST_METHOD: `GET` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:53:19.085870 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d732e13d-c1d1-4cb3-9ff3-33c314b3e522 None admin] SCRIPT_NAME: `/identity` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:53:19.086143 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d732e13d-c1d1-4cb3-9ff3-33c314b3e522 None admin] PATH_INFO: `/v3/roles` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:53:19.086893 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d732e13d-c1d1-4cb3-9ff3-33c314b3e522 None admin] RBAC: Adding query filter params (name=member) {{(pid=352328) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:53:19.087180 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d732e13d-c1d1-4cb3-9ff3-33c314b3e522 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:53:19.088696 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d732e13d-c1d1-4cb3-9ff3-33c314b3e522 None admin] RBAC: Authorization granted {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:53:19.098537 dv-cinder-851351-1-smb devstack@keystone.service[352328]: [pid: 352328|app: 0|req: 153/311] 10.222.0.42 () {56 vars in 1101 bytes} [Thu Jul 28 08:53:18 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:53:19.104037 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d732e13d-c1d1-4cb3-9ff3-33c314b3e522 None admin] Authenticating user token {{(pid=352328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:53:19.110734 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d778ed8-15ff-4661-abba-0b482bd67d1f None admin] Validating token access rules against request {{(pid=352329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:53:19.160264 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d47080-2f5d-48a3-bcd9-b2a55cc9f820 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:53:19.161624 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d47080-2f5d-48a3-bcd9-b2a55cc9f820 None admin] REQUEST_METHOD: `GET` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:53:19.162377 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d47080-2f5d-48a3-bcd9-b2a55cc9f820 None admin] SCRIPT_NAME: `/identity` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:53:19.162918 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d47080-2f5d-48a3-bcd9-b2a55cc9f820 None admin] PATH_INFO: `/v3/roles` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:53:19.164357 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9d47080-2f5d-48a3-bcd9-b2a55cc9f820 None admin] RBAC: Adding query filter params (name=reader) {{(pid=352329) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:53:19.164914 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9d47080-2f5d-48a3-bcd9-b2a55cc9f820 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:53:19.167100 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9d47080-2f5d-48a3-bcd9-b2a55cc9f820 None admin] RBAC: Authorization granted {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:53:19.184073 dv-cinder-851351-1-smb devstack@keystone.service[352329]: [pid: 352329|app: 0|req: 159/312] 10.222.0.42 () {56 vars in 1101 bytes} [Thu Jul 28 08:53:18 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:53:19.184958 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d47080-2f5d-48a3-bcd9-b2a55cc9f820 None admin] Authenticating user token {{(pid=352329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:53:19.223585 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d732e13d-c1d1-4cb3-9ff3-33c314b3e522 None admin] Validating token access rules against request {{(pid=352328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:53:19.226635 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG dbcounter [-] [352328] Writing DB stats keystone:SELECT=100 {{(pid=352328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:53:19.262874 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fbaa954-4775-4d3d-a393-791a8cefbab6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:53:19.264070 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fbaa954-4775-4d3d-a393-791a8cefbab6 None admin] REQUEST_METHOD: `GET` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:53:19.264614 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fbaa954-4775-4d3d-a393-791a8cefbab6 None admin] SCRIPT_NAME: `/identity` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:53:19.265157 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fbaa954-4775-4d3d-a393-791a8cefbab6 None admin] PATH_INFO: `/v3/users/4be5a5e817b04cf996b1f068d558f7d7` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:53:19.266563 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fbaa954-4775-4d3d-a393-791a8cefbab6 None admin] RBAC: Authorizing `identity:get_user(user_id=4be5a5e817b04cf996b1f068d558f7d7)` {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:53:19.268547 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fbaa954-4775-4d3d-a393-791a8cefbab6 None admin] RBAC: Authorization granted {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:53:19.270836 dv-cinder-851351-1-smb devstack@keystone.service[352328]: [pid: 352328|app: 0|req: 154/313] 10.222.0.42 () {56 vars in 1177 bytes} [Thu Jul 28 08:53:19 2022] GET /identity/v3/users/4be5a5e817b04cf996b1f068d558f7d7 => generated 293 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:53:19.276936 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fbaa954-4775-4d3d-a393-791a8cefbab6 None admin] Authenticating user token {{(pid=352328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:53:19.309564 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d47080-2f5d-48a3-bcd9-b2a55cc9f820 None admin] Validating token access rules against request {{(pid=352329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:53:19.339122 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG dbcounter [-] [352329] Writing DB stats keystone:SELECT=100 {{(pid=352329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:53:19.354647 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62270bfb-a85e-4ccf-9894-2f2580fbcaa5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:53:19.355708 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62270bfb-a85e-4ccf-9894-2f2580fbcaa5 None admin] REQUEST_METHOD: `GET` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:53:19.356097 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62270bfb-a85e-4ccf-9894-2f2580fbcaa5 None admin] SCRIPT_NAME: `/identity` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:53:19.356483 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62270bfb-a85e-4ccf-9894-2f2580fbcaa5 None admin] PATH_INFO: `/v3/users/b7cd5d64f7a6486aa3ca34ab7044ab52` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:53:19.358524 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62270bfb-a85e-4ccf-9894-2f2580fbcaa5 None admin] RBAC: Authorizing `identity:get_user(user_id=b7cd5d64f7a6486aa3ca34ab7044ab52)` {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:53:19.360894 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62270bfb-a85e-4ccf-9894-2f2580fbcaa5 None admin] RBAC: Authorization granted {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:53:19.363276 dv-cinder-851351-1-smb devstack@keystone.service[352329]: [pid: 352329|app: 0|req: 160/314] 10.222.0.42 () {56 vars in 1177 bytes} [Thu Jul 28 08:53:19 2022] GET /identity/v3/users/b7cd5d64f7a6486aa3ca34ab7044ab52 => generated 297 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:53:19.368804 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62270bfb-a85e-4ccf-9894-2f2580fbcaa5 None admin] Authenticating user token {{(pid=352329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:53:19.413931 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fbaa954-4775-4d3d-a393-791a8cefbab6 None admin] Validating token access rules against request {{(pid=352328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:53:19.460377 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e83f06-ecfb-4e9e-a737-e3f95254e61b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:53:19.461777 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e83f06-ecfb-4e9e-a737-e3f95254e61b None admin] REQUEST_METHOD: `PUT` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:53:19.462296 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e83f06-ecfb-4e9e-a737-e3f95254e61b None admin] SCRIPT_NAME: `/identity` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:53:19.462819 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e83f06-ecfb-4e9e-a737-e3f95254e61b None admin] PATH_INFO: `/v3/system/users/4be5a5e817b04cf996b1f068d558f7d7/roles/16a3fc3aca974c47a329c2781b0be93a` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:53:19.465008 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9e83f06-ecfb-4e9e-a737-e3f95254e61b None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=4be5a5e817b04cf996b1f068d558f7d7, role_id=16a3fc3aca974c47a329c2781b0be93a)` {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:53:19.467030 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9e83f06-ecfb-4e9e-a737-e3f95254e61b None admin] RBAC: Authorization granted {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:53:19.477840 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62270bfb-a85e-4ccf-9894-2f2580fbcaa5 None admin] Validating token access rules against request {{(pid=352329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:53:19.487000 dv-cinder-851351-1-smb devstack@keystone.service[352328]: [pid: 352328|app: 0|req: 155/315] 10.222.0.42 () {58 vars in 1334 bytes} [Thu Jul 28 08:53:19 2022] PUT /identity/v3/system/users/4be5a5e817b04cf996b1f068d558f7d7/roles/16a3fc3aca974c47a329c2781b0be93a => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 08:53:19.520623 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269d9f9c-5b5c-4d1b-841f-0d95d26a980b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:53:19.521308 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269d9f9c-5b5c-4d1b-841f-0d95d26a980b None admin] REQUEST_METHOD: `GET` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:53:19.521595 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269d9f9c-5b5c-4d1b-841f-0d95d26a980b None admin] SCRIPT_NAME: `/identity` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:53:19.521872 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269d9f9c-5b5c-4d1b-841f-0d95d26a980b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:53:19.593099 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG dbcounter [-] [352329] Writing DB stats keystone:SELECT=100 {{(pid=352329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:53:19.604441 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-269d9f9c-5b5c-4d1b-841f-0d95d26a980b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:53:19.606875 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-269d9f9c-5b5c-4d1b-841f-0d95d26a980b None admin] RBAC: Authorization granted {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:53:19.717012 dv-cinder-851351-1-smb devstack@keystone.service[352329]: [pid: 352329|app: 0|req: 161/316] 10.222.0.42 () {58 vars in 1282 bytes} [Thu Jul 28 08:53:19 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 348 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 28 08:53:19.726148 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e83f06-ecfb-4e9e-a737-e3f95254e61b None admin] Authenticating user token {{(pid=352328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:53:19.766307 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG dbcounter [-] [352328] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=352328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:53:19.839066 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e83f06-ecfb-4e9e-a737-e3f95254e61b None admin] Validating token access rules against request {{(pid=352328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:53:19.874013 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e41c395-4688-4f44-bdc1-0c3c4c56fe6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:53:19.874680 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e41c395-4688-4f44-bdc1-0c3c4c56fe6d None admin] REQUEST_METHOD: `GET` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:53:19.874960 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e41c395-4688-4f44-bdc1-0c3c4c56fe6d None admin] SCRIPT_NAME: `/identity` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:53:19.875232 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e41c395-4688-4f44-bdc1-0c3c4c56fe6d None admin] PATH_INFO: `/v3/projects/be5ef7d0266e453784a39d297f9b131d` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:53:19.876425 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e41c395-4688-4f44-bdc1-0c3c4c56fe6d None admin] RBAC: Authorizing `identity:get_project(project_id=be5ef7d0266e453784a39d297f9b131d)` {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:53:19.877963 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e41c395-4688-4f44-bdc1-0c3c4c56fe6d None admin] RBAC: Authorization granted {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:53:19.879987 dv-cinder-851351-1-smb devstack@keystone.service[352328]: [pid: 352328|app: 0|req: 156/317] 10.222.0.42 () {56 vars in 1186 bytes} [Thu Jul 28 08:53:19 2022] GET /identity/v3/projects/be5ef7d0266e453784a39d297f9b131d => generated 302 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:53:19.885702 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269d9f9c-5b5c-4d1b-841f-0d95d26a980b None admin] Authenticating user token {{(pid=352329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:53:19.979419 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG dbcounter [-] [352329] Writing DB stats keystone:SELECT=100 {{(pid=352329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:53:19.992019 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269d9f9c-5b5c-4d1b-841f-0d95d26a980b None admin] Validating token access rules against request {{(pid=352329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:53:20.029178 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c08ca75-ff5c-4df8-a863-1eb53ff316c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:53:20.029836 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c08ca75-ff5c-4df8-a863-1eb53ff316c7 None admin] REQUEST_METHOD: `GET` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:53:20.030121 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c08ca75-ff5c-4df8-a863-1eb53ff316c7 None admin] SCRIPT_NAME: `/identity` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:53:20.030402 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c08ca75-ff5c-4df8-a863-1eb53ff316c7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:53:20.031223 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c08ca75-ff5c-4df8-a863-1eb53ff316c7 None admin] RBAC: Adding query filter params (role.id=3abd212955234654b7d9a8d7df33e380, scope.project.id=be5ef7d0266e453784a39d297f9b131d, user.id=b7cd5d64f7a6486aa3ca34ab7044ab52) {{(pid=352329) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:53:20.031578 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c08ca75-ff5c-4df8-a863-1eb53ff316c7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:53:20.033232 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c08ca75-ff5c-4df8-a863-1eb53ff316c7 None admin] RBAC: Authorization granted {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:53:20.040206 dv-cinder-851351-1-smb devstack@keystone.service[352329]: [pid: 352329|app: 0|req: 162/318] 10.222.0.42 () {56 vars in 1374 bytes} [Thu Jul 28 08:53:19 2022] GET /identity/v3/role_assignments?user.id=b7cd5d64f7a6486aa3ca34ab7044ab52&scope.project.id=be5ef7d0266e453784a39d297f9b131d&role.id=3abd212955234654b7d9a8d7df33e380 => generated 608 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:53:20.697377 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5281f62-d362-4b51-9bad-ba60d46a97fd None None] REQUEST_METHOD: `GET` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:53:20.697664 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5281f62-d362-4b51-9bad-ba60d46a97fd None None] SCRIPT_NAME: `/identity` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:53:20.697998 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5281f62-d362-4b51-9bad-ba60d46a97fd None None] PATH_INFO: `/` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:53:20.699266 dv-cinder-851351-1-smb devstack@keystone.service[352328]: [pid: 352328|app: 0|req: 157/319] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 08:53:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 08:53:20.705309 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20d0447-2db2-45e4-bb3a-be704ad13fd1 None None] REQUEST_METHOD: `POST` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:53:20.705583 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20d0447-2db2-45e4-bb3a-be704ad13fd1 None None] SCRIPT_NAME: `/identity` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:53:20.705865 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20d0447-2db2-45e4-bb3a-be704ad13fd1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:53:20.724714 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.auth.core [None req-f20d0447-2db2-45e4-bb3a-be704ad13fd1 None None] MFA Rules not processed for user `d18c063b2377412485965357671e5506`. Rule list: `[]` (Enabled: `True`). {{(pid=352329) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 08:53:20.725940 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.fernet_utils [None req-f20d0447-2db2-45e4-bb3a-be704ad13fd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=352329) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:53:20.727063 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6053c4-6346-4529-a859-14b376f94b8b None None] REQUEST_METHOD: `GET` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:53:20.727575 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6053c4-6346-4529-a859-14b376f94b8b None None] SCRIPT_NAME: `/identity` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:53:20.727575 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6053c4-6346-4529-a859-14b376f94b8b None None] PATH_INFO: `/` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:53:20.729298 dv-cinder-851351-1-smb devstack@keystone.service[352328]: [pid: 352328|app: 0|req: 158/320] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 08:53:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 28 08:53:20.734383 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2127940e-5cef-4390-aa45-5242b0726c91 None None] REQUEST_METHOD: `POST` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:53:20.734673 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2127940e-5cef-4390-aa45-5242b0726c91 None None] SCRIPT_NAME: `/identity` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:53:20.734944 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2127940e-5cef-4390-aa45-5242b0726c91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:53:20.754585 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.auth.core [None req-2127940e-5cef-4390-aa45-5242b0726c91 None None] MFA Rules not processed for user `d18c063b2377412485965357671e5506`. Rule list: `[]` (Enabled: `True`). {{(pid=352328) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 08:53:20.755813 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.fernet_utils [None req-2127940e-5cef-4390-aa45-5242b0726c91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=352328) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:53:20.800186 dv-cinder-851351-1-smb devstack@keystone.service[352329]: [pid: 352329|app: 0|req: 163/321] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 08:53:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 08:53:20.822012 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f20d0447-2db2-45e4-bb3a-be704ad13fd1 None None] Authenticating user token {{(pid=352329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:53:20.829579 dv-cinder-851351-1-smb devstack@keystone.service[352328]: [pid: 352328|app: 0|req: 159/322] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 08:53:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 28 08:53:20.853141 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2127940e-5cef-4390-aa45-5242b0726c91 None None] Authenticating user token {{(pid=352328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:53:20.886251 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG dbcounter [-] [352328] Writing DB stats keystone:SELECT=100 {{(pid=352328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:53:20.914735 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG dbcounter [-] [352329] Writing DB stats keystone:SELECT=100 {{(pid=352329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:53:20.932113 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f20d0447-2db2-45e4-bb3a-be704ad13fd1 None None] Validating token access rules against request {{(pid=352329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:53:20.958821 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2127940e-5cef-4390-aa45-5242b0726c91 None None] Validating token access rules against request {{(pid=352328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:53:20.970768 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcbdfb08-ae47-401b-8cd1-a8ed86a5f298 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:53:20.971427 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcbdfb08-ae47-401b-8cd1-a8ed86a5f298 None admin] REQUEST_METHOD: `GET` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:53:20.971708 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcbdfb08-ae47-401b-8cd1-a8ed86a5f298 None admin] SCRIPT_NAME: `/identity` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:53:20.971982 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcbdfb08-ae47-401b-8cd1-a8ed86a5f298 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:53:20.984340 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcbdfb08-ae47-401b-8cd1-a8ed86a5f298 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 08:53:20.990615 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application [None req-fcbdfb08-ae47-401b-8cd1-a8ed86a5f298 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 28 08:53:20.990615 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:53:20.990615 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:53:20.990615 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:53:20.990615 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:53:20.990615 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:53:20.990615 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:53:20.990615 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:53:20.990615 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:53:20.990615 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:53:20.990615 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:53:20.990615 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:53:20.990615 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 08:53:20.990615 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 08:53:20.990615 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 08:53:20.990615 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 08:53:20.991924 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 08:53:20.991924 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 08:53:20.991924 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 08:53:20.991924 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 08:53:20.991924 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:53:20.991924 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:53:20.991924 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:53:20.991924 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:53:20.991924 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:53:20.991924 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:53:20.991924 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:53:20.991924 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application with Lock( Jul 28 08:53:20.991924 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:53:20.991924 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:53:20.991924 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:53:20.991924 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:53:20.992985 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:53:20.992985 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:53:20.992985 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:53:20.992985 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:53:20.992985 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 08:53:20.992985 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 08:53:20.992985 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 08:53:20.992985 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 08:53:20.992985 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 08:53:20.992985 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 08:53:20.992985 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 28 08:53:20.992985 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application Jul 28 08:53:20.992985 dv-cinder-851351-1-smb devstack@keystone.service[352329]: [pid: 352329|app: 0|req: 164/323] 10.222.0.42 () {56 vars in 1099 bytes} [Thu Jul 28 08:53:20 2022] GET /identity/v3/roles/reader => generated 84 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 08:53:20.997639 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcbdfb08-ae47-401b-8cd1-a8ed86a5f298 None admin] Authenticating user token {{(pid=352329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:53:21.002545 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bba7491-a9b1-4be9-9c1f-ac45abc92a59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:53:21.003656 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bba7491-a9b1-4be9-9c1f-ac45abc92a59 None admin] REQUEST_METHOD: `GET` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:53:21.004139 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bba7491-a9b1-4be9-9c1f-ac45abc92a59 None admin] SCRIPT_NAME: `/identity` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:53:21.004625 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bba7491-a9b1-4be9-9c1f-ac45abc92a59 None admin] PATH_INFO: `/v3/domains/default` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:53:21.008516 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bba7491-a9b1-4be9-9c1f-ac45abc92a59 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:53:21.010408 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bba7491-a9b1-4be9-9c1f-ac45abc92a59 None admin] RBAC: Authorization granted {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:53:21.015991 dv-cinder-851351-1-smb devstack@keystone.service[352328]: [pid: 352328|app: 0|req: 160/324] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 08:53:20 2022] GET /identity/v3/domains/default => generated 199 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 08:53:21.017939 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bba7491-a9b1-4be9-9c1f-ac45abc92a59 None admin] Authenticating user token {{(pid=352328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:53:21.105551 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcbdfb08-ae47-401b-8cd1-a8ed86a5f298 None admin] Validating token access rules against request {{(pid=352329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:53:21.130220 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bba7491-a9b1-4be9-9c1f-ac45abc92a59 None admin] Validating token access rules against request {{(pid=352328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:53:21.131920 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG dbcounter [-] [352328] Writing DB stats keystone:SELECT=100 {{(pid=352328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:53:21.143093 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b64f5e-1308-43f4-b539-06287303466c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:53:21.143730 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b64f5e-1308-43f4-b539-06287303466c None admin] REQUEST_METHOD: `GET` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:53:21.144011 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b64f5e-1308-43f4-b539-06287303466c None admin] SCRIPT_NAME: `/identity` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:53:21.144284 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b64f5e-1308-43f4-b539-06287303466c None admin] PATH_INFO: `/v3/roles` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:53:21.145049 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23b64f5e-1308-43f4-b539-06287303466c None admin] RBAC: Adding query filter params (name=reader) {{(pid=352329) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:53:21.145358 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23b64f5e-1308-43f4-b539-06287303466c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:53:21.146886 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23b64f5e-1308-43f4-b539-06287303466c None admin] RBAC: Authorization granted {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:53:21.155890 dv-cinder-851351-1-smb devstack@keystone.service[352329]: [pid: 352329|app: 0|req: 165/325] 10.222.0.42 () {56 vars in 1101 bytes} [Thu Jul 28 08:53:20 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 08:53:21.162710 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b64f5e-1308-43f4-b539-06287303466c None admin] Authenticating user token {{(pid=352329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:53:21.167769 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3511e6f-cffc-45bb-b53a-ea4a69131c80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:53:21.168423 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3511e6f-cffc-45bb-b53a-ea4a69131c80 None admin] REQUEST_METHOD: `POST` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:53:21.168733 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3511e6f-cffc-45bb-b53a-ea4a69131c80 None admin] SCRIPT_NAME: `/identity` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:53:21.169011 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3511e6f-cffc-45bb-b53a-ea4a69131c80 None admin] PATH_INFO: `/v3/groups` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:53:21.169690 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3511e6f-cffc-45bb-b53a-ea4a69131c80 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:53:21.171145 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3511e6f-cffc-45bb-b53a-ea4a69131c80 None admin] RBAC: Authorization granted {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:53:21.174524 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG dbcounter [-] [352329] Writing DB stats keystone:SELECT=100 {{(pid=352329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:53:21.188927 dv-cinder-851351-1-smb devstack@keystone.service[352328]: [pid: 352328|app: 0|req: 161/326] 10.222.0.42 () {60 vars in 1134 bytes} [Thu Jul 28 08:53:21 2022] POST /identity/v3/groups => generated 226 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 08:53:21.277581 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b64f5e-1308-43f4-b539-06287303466c None admin] Validating token access rules against request {{(pid=352329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:53:21.315677 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e02aa6e5-7b81-44e3-8b06-dc051b7d6047 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:53:21.316357 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02aa6e5-7b81-44e3-8b06-dc051b7d6047 None admin] REQUEST_METHOD: `GET` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:53:21.316629 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02aa6e5-7b81-44e3-8b06-dc051b7d6047 None admin] SCRIPT_NAME: `/identity` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:53:21.316948 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02aa6e5-7b81-44e3-8b06-dc051b7d6047 None admin] PATH_INFO: `/v3/users/694481f660d64b0b8e0b04dc860e3b88` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:53:21.318222 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e02aa6e5-7b81-44e3-8b06-dc051b7d6047 None admin] RBAC: Authorizing `identity:get_user(user_id=694481f660d64b0b8e0b04dc860e3b88)` {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:53:21.319722 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e02aa6e5-7b81-44e3-8b06-dc051b7d6047 None admin] RBAC: Authorization granted {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:53:21.321671 dv-cinder-851351-1-smb devstack@keystone.service[352329]: [pid: 352329|app: 0|req: 166/327] 10.222.0.42 () {56 vars in 1177 bytes} [Thu Jul 28 08:53:21 2022] GET /identity/v3/users/694481f660d64b0b8e0b04dc860e3b88 => generated 293 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 08:53:21.327457 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3511e6f-cffc-45bb-b53a-ea4a69131c80 None admin] Authenticating user token {{(pid=352328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:53:21.429886 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3511e6f-cffc-45bb-b53a-ea4a69131c80 None admin] Validating token access rules against request {{(pid=352328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:53:21.467601 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a03fd5b0-5de0-4b90-b6d8-32d5ef4195c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:53:21.468350 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03fd5b0-5de0-4b90-b6d8-32d5ef4195c4 None admin] REQUEST_METHOD: `PUT` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:53:21.468563 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03fd5b0-5de0-4b90-b6d8-32d5ef4195c4 None admin] SCRIPT_NAME: `/identity` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:53:21.468861 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03fd5b0-5de0-4b90-b6d8-32d5ef4195c4 None admin] PATH_INFO: `/v3/system/users/694481f660d64b0b8e0b04dc860e3b88/roles/3abd212955234654b7d9a8d7df33e380` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:53:21.470404 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a03fd5b0-5de0-4b90-b6d8-32d5ef4195c4 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=694481f660d64b0b8e0b04dc860e3b88, role_id=3abd212955234654b7d9a8d7df33e380)` {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:53:21.471856 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a03fd5b0-5de0-4b90-b6d8-32d5ef4195c4 None admin] RBAC: Authorization granted {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:53:21.484297 dv-cinder-851351-1-smb devstack@keystone.service[352328]: [pid: 352328|app: 0|req: 162/328] 10.222.0.42 () {58 vars in 1334 bytes} [Thu Jul 28 08:53:21 2022] PUT /identity/v3/system/users/694481f660d64b0b8e0b04dc860e3b88/roles/3abd212955234654b7d9a8d7df33e380 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 28 08:53:21.600800 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbca4c02-9c32-472d-bb35-9fa0ded193e5 None None] REQUEST_METHOD: `GET` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:53:21.601199 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbca4c02-9c32-472d-bb35-9fa0ded193e5 None None] SCRIPT_NAME: `/identity` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:53:21.601341 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbca4c02-9c32-472d-bb35-9fa0ded193e5 None None] PATH_INFO: `/` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:53:21.603075 dv-cinder-851351-1-smb devstack@keystone.service[352329]: [pid: 352329|app: 0|req: 167/329] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 08:53:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 08:53:21.608643 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9527e424-50f1-4761-bf1a-482a5a201360 None None] REQUEST_METHOD: `POST` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:53:21.608967 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9527e424-50f1-4761-bf1a-482a5a201360 None None] SCRIPT_NAME: `/identity` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:53:21.609252 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9527e424-50f1-4761-bf1a-482a5a201360 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:53:21.630700 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.auth.core [None req-9527e424-50f1-4761-bf1a-482a5a201360 None None] MFA Rules not processed for user `d18c063b2377412485965357671e5506`. Rule list: `[]` (Enabled: `True`). {{(pid=352328) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 08:53:21.631964 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.fernet_utils [None req-9527e424-50f1-4761-bf1a-482a5a201360 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=352328) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:53:21.655733 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG dbcounter [-] [352328] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=352328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:53:21.715161 dv-cinder-851351-1-smb devstack@keystone.service[352328]: [pid: 352328|app: 0|req: 163/330] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 08:53:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 08:53:21.741957 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbca4c02-9c32-472d-bb35-9fa0ded193e5 None None] Authenticating user token {{(pid=352329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:53:21.833870 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG dbcounter [-] [352329] Writing DB stats keystone:SELECT=100 {{(pid=352329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:53:21.858810 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbca4c02-9c32-472d-bb35-9fa0ded193e5 None None] Validating token access rules against request {{(pid=352329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:53:21.894133 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be14d96-88e0-4f02-8d1d-c7cbe92a5b0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:53:21.894798 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be14d96-88e0-4f02-8d1d-c7cbe92a5b0b None admin] REQUEST_METHOD: `GET` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:53:21.895080 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be14d96-88e0-4f02-8d1d-c7cbe92a5b0b None admin] SCRIPT_NAME: `/identity` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:53:21.895354 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be14d96-88e0-4f02-8d1d-c7cbe92a5b0b None admin] PATH_INFO: `/v3/roles/member` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:53:21.906847 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3be14d96-88e0-4f02-8d1d-c7cbe92a5b0b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 08:53:21.912632 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application [None req-3be14d96-88e0-4f02-8d1d-c7cbe92a5b0b None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 28 08:53:21.912632 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:53:21.912632 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:53:21.912632 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:53:21.912632 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:53:21.912632 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:53:21.912632 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:53:21.912632 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:53:21.912632 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:53:21.912632 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:53:21.912632 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:53:21.912632 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:53:21.912632 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 08:53:21.912632 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 08:53:21.912632 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 08:53:21.912632 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 08:53:21.913775 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 08:53:21.913775 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 08:53:21.913775 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 08:53:21.913775 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 08:53:21.913775 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:53:21.913775 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:53:21.913775 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:53:21.913775 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:53:21.913775 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:53:21.913775 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:53:21.913775 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:53:21.913775 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application with Lock( Jul 28 08:53:21.913775 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:53:21.913775 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:53:21.913775 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:53:21.913775 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:53:21.914811 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:53:21.914811 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:53:21.914811 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:53:21.914811 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:53:21.914811 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 08:53:21.914811 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 08:53:21.914811 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 08:53:21.914811 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 08:53:21.914811 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 08:53:21.914811 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 08:53:21.914811 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 28 08:53:21.914811 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application Jul 28 08:53:21.914811 dv-cinder-851351-1-smb devstack@keystone.service[352329]: [pid: 352329|app: 0|req: 168/331] 10.222.0.42 () {56 vars in 1099 bytes} [Thu Jul 28 08:53:21 2022] GET /identity/v3/roles/member => generated 84 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:53:21.920760 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9527e424-50f1-4761-bf1a-482a5a201360 None None] Authenticating user token {{(pid=352328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:53:22.075915 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9527e424-50f1-4761-bf1a-482a5a201360 None None] Validating token access rules against request {{(pid=352328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:53:22.123364 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7770508f-dc7e-49aa-947e-630b9a38af10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:53:22.123929 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7770508f-dc7e-49aa-947e-630b9a38af10 None admin] REQUEST_METHOD: `GET` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:53:22.124207 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7770508f-dc7e-49aa-947e-630b9a38af10 None admin] SCRIPT_NAME: `/identity` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:53:22.124479 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7770508f-dc7e-49aa-947e-630b9a38af10 None admin] PATH_INFO: `/v3/roles` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:53:22.125362 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7770508f-dc7e-49aa-947e-630b9a38af10 None admin] RBAC: Adding query filter params (name=member) {{(pid=352328) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:53:22.125668 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7770508f-dc7e-49aa-947e-630b9a38af10 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:53:22.127162 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7770508f-dc7e-49aa-947e-630b9a38af10 None admin] RBAC: Authorization granted {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:53:22.139837 dv-cinder-851351-1-smb devstack@keystone.service[352328]: [pid: 352328|app: 0|req: 164/332] 10.222.0.42 () {56 vars in 1101 bytes} [Thu Jul 28 08:53:21 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:53:22.145623 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be14d96-88e0-4f02-8d1d-c7cbe92a5b0b None admin] Authenticating user token {{(pid=352329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:53:22.324983 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be14d96-88e0-4f02-8d1d-c7cbe92a5b0b None admin] Validating token access rules against request {{(pid=352329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:53:22.377571 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8894aa33-5466-4b9f-b5c7-31508cec8e0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:53:22.378184 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8894aa33-5466-4b9f-b5c7-31508cec8e0d None admin] REQUEST_METHOD: `GET` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:53:22.378478 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8894aa33-5466-4b9f-b5c7-31508cec8e0d None admin] SCRIPT_NAME: `/identity` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:53:22.378768 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8894aa33-5466-4b9f-b5c7-31508cec8e0d None admin] PATH_INFO: `/v3/users/4be5a5e817b04cf996b1f068d558f7d7` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:53:22.380109 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8894aa33-5466-4b9f-b5c7-31508cec8e0d None admin] RBAC: Authorizing `identity:get_user(user_id=4be5a5e817b04cf996b1f068d558f7d7)` {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:53:22.381656 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8894aa33-5466-4b9f-b5c7-31508cec8e0d None admin] RBAC: Authorization granted {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:53:22.383706 dv-cinder-851351-1-smb devstack@keystone.service[352329]: [pid: 352329|app: 0|req: 169/333] 10.222.0.42 () {56 vars in 1177 bytes} [Thu Jul 28 08:53:22 2022] GET /identity/v3/users/4be5a5e817b04cf996b1f068d558f7d7 => generated 293 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:53:22.389826 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7770508f-dc7e-49aa-947e-630b9a38af10 None admin] Authenticating user token {{(pid=352328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:53:22.438250 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG dbcounter [-] [352328] Writing DB stats keystone:SELECT=100 {{(pid=352328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:53:22.547143 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7770508f-dc7e-49aa-947e-630b9a38af10 None admin] Validating token access rules against request {{(pid=352328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:53:22.595870 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a42eb1d9-21c2-4244-94cc-fe5f6067e1a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:53:22.596518 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42eb1d9-21c2-4244-94cc-fe5f6067e1a0 None admin] REQUEST_METHOD: `GET` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:53:22.596831 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42eb1d9-21c2-4244-94cc-fe5f6067e1a0 None admin] SCRIPT_NAME: `/identity` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:53:22.597116 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42eb1d9-21c2-4244-94cc-fe5f6067e1a0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:53:22.597925 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a42eb1d9-21c2-4244-94cc-fe5f6067e1a0 None admin] RBAC: Adding query filter params (role.id=16a3fc3aca974c47a329c2781b0be93a, user.id=4be5a5e817b04cf996b1f068d558f7d7, scope.system=all) {{(pid=352328) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:53:22.598231 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a42eb1d9-21c2-4244-94cc-fe5f6067e1a0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:53:22.599712 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a42eb1d9-21c2-4244-94cc-fe5f6067e1a0 None admin] RBAC: Authorization granted {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:53:22.618046 dv-cinder-851351-1-smb devstack@keystone.service[352328]: [pid: 352328|app: 0|req: 165/334] 10.222.0.42 () {56 vars in 1308 bytes} [Thu Jul 28 08:53:22 2022] GET /identity/v3/role_assignments?user.id=4be5a5e817b04cf996b1f068d558f7d7&scope.system=all&role.id=16a3fc3aca974c47a329c2781b0be93a => generated 510 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:53:23.726631 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409c3e77-8593-4fcc-90b5-94e2717d8084 None None] REQUEST_METHOD: `GET` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:53:23.727197 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409c3e77-8593-4fcc-90b5-94e2717d8084 None None] SCRIPT_NAME: `/identity` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:53:23.727197 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409c3e77-8593-4fcc-90b5-94e2717d8084 None None] PATH_INFO: `/` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:53:23.728626 dv-cinder-851351-1-smb devstack@keystone.service[352329]: [pid: 352329|app: 0|req: 170/335] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 08:53:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 08:53:23.734542 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45766710-c37e-46dd-bf04-b9cb639ac1d2 None None] REQUEST_METHOD: `POST` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:53:23.735076 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45766710-c37e-46dd-bf04-b9cb639ac1d2 None None] SCRIPT_NAME: `/identity` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:53:23.735076 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45766710-c37e-46dd-bf04-b9cb639ac1d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:53:23.755840 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.auth.core [None req-45766710-c37e-46dd-bf04-b9cb639ac1d2 None None] MFA Rules not processed for user `d18c063b2377412485965357671e5506`. Rule list: `[]` (Enabled: `True`). {{(pid=352328) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 08:53:23.757112 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.fernet_utils [None req-45766710-c37e-46dd-bf04-b9cb639ac1d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=352328) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:53:23.767623 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9af533b-5217-4894-90a6-8f77a2f42d25 None None] REQUEST_METHOD: `GET` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:53:23.767952 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9af533b-5217-4894-90a6-8f77a2f42d25 None None] SCRIPT_NAME: `/identity` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:53:23.768244 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9af533b-5217-4894-90a6-8f77a2f42d25 None None] PATH_INFO: `/` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:53:23.770259 dv-cinder-851351-1-smb devstack@keystone.service[352329]: [pid: 352329|app: 0|req: 171/336] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 08:53:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 08:53:23.782566 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7610f4-fb9e-44bb-887d-5f11e690c150 None None] REQUEST_METHOD: `POST` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:53:23.783278 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7610f4-fb9e-44bb-887d-5f11e690c150 None None] SCRIPT_NAME: `/identity` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:53:23.783933 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7610f4-fb9e-44bb-887d-5f11e690c150 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:53:23.796830 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG dbcounter [-] [352329] Writing DB stats keystone:SELECT=100 {{(pid=352329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:53:23.820250 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.auth.core [None req-2e7610f4-fb9e-44bb-887d-5f11e690c150 None None] MFA Rules not processed for user `d18c063b2377412485965357671e5506`. Rule list: `[]` (Enabled: `True`). {{(pid=352329) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 08:53:23.821505 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.fernet_utils [None req-2e7610f4-fb9e-44bb-887d-5f11e690c150 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=352329) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:53:23.890411 dv-cinder-851351-1-smb devstack@keystone.service[352328]: [pid: 352328|app: 0|req: 166/337] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 08:53:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 28 08:53:23.931367 dv-cinder-851351-1-smb devstack@keystone.service[352329]: [pid: 352329|app: 0|req: 172/338] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 08:53:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 08:53:23.961300 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45766710-c37e-46dd-bf04-b9cb639ac1d2 None None] Authenticating user token {{(pid=352328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:53:23.964086 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e7610f4-fb9e-44bb-887d-5f11e690c150 None None] Authenticating user token {{(pid=352329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:53:23.975061 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG dbcounter [-] [352328] Writing DB stats keystone:SELECT=100 {{(pid=352328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:53:24.074128 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e7610f4-fb9e-44bb-887d-5f11e690c150 None None] Validating token access rules against request {{(pid=352329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:53:24.110446 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844dda90-448c-4029-8fd7-cc849d4427c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:53:24.111156 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844dda90-448c-4029-8fd7-cc849d4427c5 None admin] REQUEST_METHOD: `GET` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:53:24.111433 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844dda90-448c-4029-8fd7-cc849d4427c5 None admin] SCRIPT_NAME: `/identity` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:53:24.111706 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844dda90-448c-4029-8fd7-cc849d4427c5 None admin] PATH_INFO: `/v3/roles/member` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:53:24.113743 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG dbcounter [-] [352329] Writing DB stats keystone:SELECT=100 {{(pid=352329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:53:24.123604 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-844dda90-448c-4029-8fd7-cc849d4427c5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 08:53:24.129936 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application [None req-844dda90-448c-4029-8fd7-cc849d4427c5 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 28 08:53:24.129936 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:53:24.129936 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:53:24.129936 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:53:24.129936 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:53:24.129936 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:53:24.129936 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:53:24.129936 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:53:24.129936 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:53:24.129936 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:53:24.129936 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:53:24.129936 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:53:24.129936 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 08:53:24.129936 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 08:53:24.129936 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 08:53:24.129936 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 08:53:24.131124 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 08:53:24.131124 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 08:53:24.131124 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 08:53:24.131124 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 08:53:24.131124 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:53:24.131124 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:53:24.131124 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:53:24.131124 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:53:24.131124 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:53:24.131124 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:53:24.131124 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:53:24.131124 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application with Lock( Jul 28 08:53:24.131124 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:53:24.131124 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:53:24.131124 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:53:24.131124 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:53:24.132172 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:53:24.132172 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:53:24.132172 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:53:24.132172 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:53:24.132172 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 08:53:24.132172 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 08:53:24.132172 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 08:53:24.132172 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 08:53:24.132172 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 08:53:24.132172 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 08:53:24.132172 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 28 08:53:24.132172 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application Jul 28 08:53:24.132172 dv-cinder-851351-1-smb devstack@keystone.service[352329]: [pid: 352329|app: 0|req: 173/339] 10.222.0.42 () {56 vars in 1099 bytes} [Thu Jul 28 08:53:23 2022] GET /identity/v3/roles/member => generated 84 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 08:53:24.137492 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844dda90-448c-4029-8fd7-cc849d4427c5 None admin] Authenticating user token {{(pid=352329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:53:24.167846 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45766710-c37e-46dd-bf04-b9cb639ac1d2 None None] Validating token access rules against request {{(pid=352328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:53:24.238149 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7db5ef8-d6ec-416f-a4d2-6d2a0e4c1636 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:53:24.238850 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7db5ef8-d6ec-416f-a4d2-6d2a0e4c1636 None admin] REQUEST_METHOD: `GET` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:53:24.239137 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7db5ef8-d6ec-416f-a4d2-6d2a0e4c1636 None admin] SCRIPT_NAME: `/identity` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:53:24.239471 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7db5ef8-d6ec-416f-a4d2-6d2a0e4c1636 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:53:24.259543 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7db5ef8-d6ec-416f-a4d2-6d2a0e4c1636 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 08:53:24.273038 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application [None req-c7db5ef8-d6ec-416f-a4d2-6d2a0e4c1636 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 28 08:53:24.273038 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:53:24.273038 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:53:24.273038 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:53:24.273038 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:53:24.273038 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:53:24.273038 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:53:24.273038 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:53:24.273038 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:53:24.273038 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:53:24.273038 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:53:24.273038 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:53:24.273038 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 08:53:24.273038 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 08:53:24.273038 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 08:53:24.273038 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 08:53:24.274224 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 08:53:24.274224 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 08:53:24.274224 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 08:53:24.274224 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 08:53:24.274224 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:53:24.274224 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:53:24.274224 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:53:24.274224 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:53:24.274224 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:53:24.274224 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:53:24.274224 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:53:24.274224 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application with Lock( Jul 28 08:53:24.274224 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:53:24.274224 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:53:24.274224 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:53:24.274224 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:53:24.275287 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:53:24.275287 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:53:24.275287 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:53:24.275287 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:53:24.275287 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 08:53:24.275287 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 08:53:24.275287 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 08:53:24.275287 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 08:53:24.275287 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 08:53:24.275287 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 08:53:24.275287 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 28 08:53:24.275287 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application Jul 28 08:53:24.276085 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844dda90-448c-4029-8fd7-cc849d4427c5 None admin] Validating token access rules against request {{(pid=352329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:53:24.276185 dv-cinder-851351-1-smb devstack@keystone.service[352328]: [pid: 352328|app: 0|req: 167/340] 10.222.0.42 () {56 vars in 1114 bytes} [Thu Jul 28 08:53:23 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 314 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:53:24.285779 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7db5ef8-d6ec-416f-a4d2-6d2a0e4c1636 None admin] Authenticating user token {{(pid=352328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:53:24.346341 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24121ef9-e33a-4227-8937-863ef6f931fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:53:24.347528 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24121ef9-e33a-4227-8937-863ef6f931fa None admin] REQUEST_METHOD: `GET` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:53:24.348046 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24121ef9-e33a-4227-8937-863ef6f931fa None admin] SCRIPT_NAME: `/identity` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:53:24.348534 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24121ef9-e33a-4227-8937-863ef6f931fa None admin] PATH_INFO: `/v3/roles` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:53:24.349527 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24121ef9-e33a-4227-8937-863ef6f931fa None admin] RBAC: Adding query filter params (name=member) {{(pid=352329) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:53:24.350049 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24121ef9-e33a-4227-8937-863ef6f931fa None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:53:24.351694 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24121ef9-e33a-4227-8937-863ef6f931fa None admin] RBAC: Authorization granted {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:53:24.377089 dv-cinder-851351-1-smb devstack@keystone.service[352329]: [pid: 352329|app: 0|req: 174/341] 10.222.0.42 () {56 vars in 1101 bytes} [Thu Jul 28 08:53:24 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:53:24.383005 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24121ef9-e33a-4227-8937-863ef6f931fa None admin] Authenticating user token {{(pid=352329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:53:24.429347 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG dbcounter [-] [352328] Writing DB stats keystone:SELECT=100 {{(pid=352328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:53:24.478833 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG dbcounter [-] [352329] Writing DB stats keystone:SELECT=100 {{(pid=352329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:53:24.514870 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7db5ef8-d6ec-416f-a4d2-6d2a0e4c1636 None admin] Validating token access rules against request {{(pid=352328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:53:24.560886 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24121ef9-e33a-4227-8937-863ef6f931fa None admin] Validating token access rules against request {{(pid=352329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:53:24.601965 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db77b13-c89b-42d8-889b-9cc0a54974bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:53:24.603181 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db77b13-c89b-42d8-889b-9cc0a54974bc None admin] REQUEST_METHOD: `GET` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:53:24.603681 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db77b13-c89b-42d8-889b-9cc0a54974bc None admin] SCRIPT_NAME: `/identity` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:53:24.604189 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db77b13-c89b-42d8-889b-9cc0a54974bc None admin] PATH_INFO: `/v3/roles` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:53:24.605202 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1db77b13-c89b-42d8-889b-9cc0a54974bc None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=352328) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:53:24.605736 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1db77b13-c89b-42d8-889b-9cc0a54974bc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:53:24.607385 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1db77b13-c89b-42d8-889b-9cc0a54974bc None admin] RBAC: Authorization granted {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:53:24.612504 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40171882-c4c9-4f85-b10c-3e86f4dd3553 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:53:24.613232 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40171882-c4c9-4f85-b10c-3e86f4dd3553 None admin] REQUEST_METHOD: `GET` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:53:24.613520 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40171882-c4c9-4f85-b10c-3e86f4dd3553 None admin] SCRIPT_NAME: `/identity` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:53:24.613794 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40171882-c4c9-4f85-b10c-3e86f4dd3553 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:53:24.627570 dv-cinder-851351-1-smb devstack@keystone.service[352328]: [pid: 352328|app: 0|req: 168/342] 10.222.0.42 () {56 vars in 1111 bytes} [Thu Jul 28 08:53:24 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 342 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:53:24.633528 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db77b13-c89b-42d8-889b-9cc0a54974bc None admin] Authenticating user token {{(pid=352328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:53:24.697230 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40171882-c4c9-4f85-b10c-3e86f4dd3553 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:53:24.698727 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40171882-c4c9-4f85-b10c-3e86f4dd3553 None admin] RBAC: Authorization granted {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:53:24.756370 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG dbcounter [-] [352329] Writing DB stats keystone:SELECT=100 {{(pid=352329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:53:24.809025 dv-cinder-851351-1-smb devstack@keystone.service[352329]: [pid: 352329|app: 0|req: 175/343] 10.222.0.42 () {58 vars in 1282 bytes} [Thu Jul 28 08:53:24 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 426 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 28 08:53:24.818141 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40171882-c4c9-4f85-b10c-3e86f4dd3553 None admin] Authenticating user token {{(pid=352329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:53:24.832316 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db77b13-c89b-42d8-889b-9cc0a54974bc None admin] Validating token access rules against request {{(pid=352328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:53:24.901136 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG dbcounter [-] [352328] Writing DB stats keystone:SELECT=100 {{(pid=352328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:53:24.911469 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07913c6a-e29f-466e-803c-a75e04ae3d32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:53:24.912119 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07913c6a-e29f-466e-803c-a75e04ae3d32 None admin] REQUEST_METHOD: `GET` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:53:24.912404 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07913c6a-e29f-466e-803c-a75e04ae3d32 None admin] SCRIPT_NAME: `/identity` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:53:24.912710 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07913c6a-e29f-466e-803c-a75e04ae3d32 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:53:25.030744 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40171882-c4c9-4f85-b10c-3e86f4dd3553 None admin] Validating token access rules against request {{(pid=352329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:53:25.040548 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07913c6a-e29f-466e-803c-a75e04ae3d32 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:53:25.042141 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07913c6a-e29f-466e-803c-a75e04ae3d32 None admin] RBAC: Authorization granted {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:53:25.104227 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04370716-465f-416f-8025-9d94a01ea0aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:53:25.104917 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04370716-465f-416f-8025-9d94a01ea0aa None admin] REQUEST_METHOD: `GET` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:53:25.105381 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04370716-465f-416f-8025-9d94a01ea0aa None admin] SCRIPT_NAME: `/identity` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:53:25.105936 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04370716-465f-416f-8025-9d94a01ea0aa None admin] PATH_INFO: `/v3/projects/9af593aec02c450aa4ce9c48ff4c6a1f` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:53:25.107820 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04370716-465f-416f-8025-9d94a01ea0aa None admin] RBAC: Authorizing `identity:get_project(project_id=9af593aec02c450aa4ce9c48ff4c6a1f)` {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:53:25.109643 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04370716-465f-416f-8025-9d94a01ea0aa None admin] RBAC: Authorization granted {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:53:25.116391 dv-cinder-851351-1-smb devstack@keystone.service[352329]: [pid: 352329|app: 0|req: 176/344] 10.222.0.42 () {56 vars in 1186 bytes} [Thu Jul 28 08:53:24 2022] GET /identity/v3/projects/9af593aec02c450aa4ce9c48ff4c6a1f => generated 298 bytes in 294 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 08:53:25.118381 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368de223-de46-4ee3-9c41-c847884f4948 None None] REQUEST_METHOD: `GET` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:53:25.118851 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368de223-de46-4ee3-9c41-c847884f4948 None None] SCRIPT_NAME: `/identity` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:53:25.119362 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368de223-de46-4ee3-9c41-c847884f4948 None None] PATH_INFO: `/` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:53:25.120931 dv-cinder-851351-1-smb devstack@keystone.service[352329]: [pid: 352329|app: 0|req: 177/345] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 08:53:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 08:53:25.121815 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-368de223-de46-4ee3-9c41-c847884f4948 None None] Authenticating user token {{(pid=352329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:53:25.154876 dv-cinder-851351-1-smb devstack@keystone.service[352328]: [pid: 352328|app: 0|req: 169/346] 10.222.0.42 () {58 vars in 1282 bytes} [Thu Jul 28 08:53:24 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 522 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 28 08:53:25.156302 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa29f68-7b0a-4785-8841-b020d1d59899 None None] REQUEST_METHOD: `POST` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:53:25.156597 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa29f68-7b0a-4785-8841-b020d1d59899 None None] SCRIPT_NAME: `/identity` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:53:25.156904 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa29f68-7b0a-4785-8841-b020d1d59899 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:53:25.168212 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG dbcounter [-] [352329] Writing DB stats keystone:SELECT=100 {{(pid=352329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:53:25.180715 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.auth.core [None req-9aa29f68-7b0a-4785-8841-b020d1d59899 None None] MFA Rules not processed for user `d18c063b2377412485965357671e5506`. Rule list: `[]` (Enabled: `True`). {{(pid=352328) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 08:53:25.182005 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.fernet_utils [None req-9aa29f68-7b0a-4785-8841-b020d1d59899 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=352328) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:53:25.212042 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG dbcounter [-] [352328] Writing DB stats keystone:SELECT=100 {{(pid=352328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:53:25.267578 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-368de223-de46-4ee3-9c41-c847884f4948 None None] Validating token access rules against request {{(pid=352329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:53:25.287903 dv-cinder-851351-1-smb devstack@keystone.service[352328]: [pid: 352328|app: 0|req: 170/347] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 08:53:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 08:53:25.288929 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa29f68-7b0a-4785-8841-b020d1d59899 None None] Authenticating user token {{(pid=352328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:53:25.307687 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a12c232-1dcf-4a5a-8d59-4f7f6dcb805c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:53:25.308784 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a12c232-1dcf-4a5a-8d59-4f7f6dcb805c None admin] REQUEST_METHOD: `GET` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:53:25.309272 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a12c232-1dcf-4a5a-8d59-4f7f6dcb805c None admin] SCRIPT_NAME: `/identity` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:53:25.309777 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a12c232-1dcf-4a5a-8d59-4f7f6dcb805c None admin] PATH_INFO: `/v3/groups/313e220fa1e24b3c975e71a69928a850` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:53:25.317130 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a12c232-1dcf-4a5a-8d59-4f7f6dcb805c None admin] RBAC: Authorizing `identity:get_group(group_id=313e220fa1e24b3c975e71a69928a850)` {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:53:25.319035 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a12c232-1dcf-4a5a-8d59-4f7f6dcb805c None admin] RBAC: Authorization granted {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:53:25.321036 dv-cinder-851351-1-smb devstack@keystone.service[352329]: [pid: 352329|app: 0|req: 178/348] 10.222.0.42 () {56 vars in 1180 bytes} [Thu Jul 28 08:53:25 2022] GET /identity/v3/groups/313e220fa1e24b3c975e71a69928a850 => generated 226 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:53:25.328833 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a12c232-1dcf-4a5a-8d59-4f7f6dcb805c None admin] Authenticating user token {{(pid=352329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:53:25.434086 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG dbcounter [-] [352329] Writing DB stats keystone:SELECT=100 {{(pid=352329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:53:25.440943 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa29f68-7b0a-4785-8841-b020d1d59899 None None] Validating token access rules against request {{(pid=352328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:53:25.449246 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a12c232-1dcf-4a5a-8d59-4f7f6dcb805c None admin] Validating token access rules against request {{(pid=352329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:53:25.488866 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16b7a82-66bd-4229-bb63-e774fac612e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:53:25.489629 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16b7a82-66bd-4229-bb63-e774fac612e6 None admin] REQUEST_METHOD: `GET` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:53:25.489979 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16b7a82-66bd-4229-bb63-e774fac612e6 None admin] SCRIPT_NAME: `/identity` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:53:25.490316 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16b7a82-66bd-4229-bb63-e774fac612e6 None admin] PATH_INFO: `/v3/projects/9af593aec02c450aa4ce9c48ff4c6a1f` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:53:25.491555 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671d82e5-3039-4dec-8173-ff53026af6d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:53:25.491698 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e16b7a82-66bd-4229-bb63-e774fac612e6 None admin] RBAC: Authorizing `identity:get_project(project_id=9af593aec02c450aa4ce9c48ff4c6a1f)` {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:53:25.492480 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671d82e5-3039-4dec-8173-ff53026af6d2 None admin] REQUEST_METHOD: `GET` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:53:25.492946 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671d82e5-3039-4dec-8173-ff53026af6d2 None admin] SCRIPT_NAME: `/identity` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:53:25.493325 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e16b7a82-66bd-4229-bb63-e774fac612e6 None admin] RBAC: Authorization granted {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:53:25.493568 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671d82e5-3039-4dec-8173-ff53026af6d2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:53:25.494521 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-671d82e5-3039-4dec-8173-ff53026af6d2 None admin] RBAC: Adding query filter params (group.id=313e220fa1e24b3c975e71a69928a850, role.id=16a3fc3aca974c47a329c2781b0be93a, scope.project.id=9af593aec02c450aa4ce9c48ff4c6a1f) {{(pid=352329) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:53:25.494985 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-671d82e5-3039-4dec-8173-ff53026af6d2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:53:25.495603 dv-cinder-851351-1-smb devstack@keystone.service[352328]: [pid: 352328|app: 0|req: 171/349] 10.222.0.42 () {56 vars in 1186 bytes} [Thu Jul 28 08:53:25 2022] GET /identity/v3/projects/9af593aec02c450aa4ce9c48ff4c6a1f => generated 298 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:53:25.496637 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16b7a82-66bd-4229-bb63-e774fac612e6 None admin] Authenticating user token {{(pid=352328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:53:25.497011 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-671d82e5-3039-4dec-8173-ff53026af6d2 None admin] RBAC: Authorization granted {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:53:25.511090 dv-cinder-851351-1-smb devstack@keystone.service[352329]: [pid: 352329|app: 0|req: 179/350] 10.222.0.42 () {56 vars in 1376 bytes} [Thu Jul 28 08:53:25 2022] GET /identity/v3/role_assignments?group.id=313e220fa1e24b3c975e71a69928a850&scope.project.id=9af593aec02c450aa4ce9c48ff4c6a1f&role.id=16a3fc3aca974c47a329c2781b0be93a => generated 260 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:53:25.512795 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c1f055-0dd9-42a9-bbca-e5fe34063ff9 None None] REQUEST_METHOD: `GET` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:53:25.513303 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c1f055-0dd9-42a9-bbca-e5fe34063ff9 None None] SCRIPT_NAME: `/identity` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:53:25.513765 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c1f055-0dd9-42a9-bbca-e5fe34063ff9 None None] PATH_INFO: `/` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:53:25.515268 dv-cinder-851351-1-smb devstack@keystone.service[352329]: [pid: 352329|app: 0|req: 180/351] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 08:53:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 08:53:25.516170 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c1f055-0dd9-42a9-bbca-e5fe34063ff9 None None] Authenticating user token {{(pid=352329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:53:25.561863 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG dbcounter [-] [352328] Writing DB stats keystone:SELECT=100 {{(pid=352328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:53:25.658453 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16b7a82-66bd-4229-bb63-e774fac612e6 None admin] Validating token access rules against request {{(pid=352328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:53:25.682446 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c1f055-0dd9-42a9-bbca-e5fe34063ff9 None None] Validating token access rules against request {{(pid=352329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:53:25.703579 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18391885-bb30-4478-b4d5-8739fea7b30f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:53:25.705082 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18391885-bb30-4478-b4d5-8739fea7b30f None admin] REQUEST_METHOD: `GET` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:53:25.705544 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18391885-bb30-4478-b4d5-8739fea7b30f None admin] SCRIPT_NAME: `/identity` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:53:25.705983 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18391885-bb30-4478-b4d5-8739fea7b30f None admin] PATH_INFO: `/v3/roles/reader` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:53:25.720388 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18391885-bb30-4478-b4d5-8739fea7b30f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 08:53:25.725545 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application [None req-18391885-bb30-4478-b4d5-8739fea7b30f None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 28 08:53:25.725545 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:53:25.725545 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:53:25.725545 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:53:25.725545 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:53:25.725545 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:53:25.725545 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:53:25.725545 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:53:25.725545 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:53:25.725545 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:53:25.725545 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:53:25.725545 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:53:25.725545 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 08:53:25.725545 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 08:53:25.725545 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 08:53:25.725545 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 08:53:25.726661 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 08:53:25.726661 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 08:53:25.726661 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 08:53:25.726661 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 08:53:25.726661 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:53:25.726661 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:53:25.726661 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:53:25.726661 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:53:25.726661 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:53:25.726661 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:53:25.726661 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:53:25.726661 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application with Lock( Jul 28 08:53:25.726661 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:53:25.726661 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:53:25.726661 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:53:25.726661 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:53:25.727691 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:53:25.727691 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:53:25.727691 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:53:25.727691 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:53:25.727691 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 08:53:25.727691 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 08:53:25.727691 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 08:53:25.727691 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 08:53:25.727691 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 08:53:25.727691 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 08:53:25.727691 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 28 08:53:25.727691 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application Jul 28 08:53:25.728451 dv-cinder-851351-1-smb devstack@keystone.service[352328]: [pid: 352328|app: 0|req: 172/352] 10.222.0.42 () {56 vars in 1099 bytes} [Thu Jul 28 08:53:25 2022] GET /identity/v3/roles/reader => generated 84 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:53:25.732719 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9cd5dd-3648-4d51-868e-84e8dc7a3ded None None] REQUEST_METHOD: `POST` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:53:25.732719 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9cd5dd-3648-4d51-868e-84e8dc7a3ded None None] SCRIPT_NAME: `/identity` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:53:25.732719 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9cd5dd-3648-4d51-868e-84e8dc7a3ded None None] PATH_INFO: `/v3/auth/tokens` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:53:25.733339 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b82f50-13a3-404b-81ba-aa7c9f05d122 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:53:25.734067 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b82f50-13a3-404b-81ba-aa7c9f05d122 None admin] REQUEST_METHOD: `GET` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:53:25.734346 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b82f50-13a3-404b-81ba-aa7c9f05d122 None admin] SCRIPT_NAME: `/identity` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:53:25.734619 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b82f50-13a3-404b-81ba-aa7c9f05d122 None admin] PATH_INFO: `/v3/groups/313e220fa1e24b3c975e71a69928a850` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:53:25.735893 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22b82f50-13a3-404b-81ba-aa7c9f05d122 None admin] RBAC: Authorizing `identity:get_group(group_id=313e220fa1e24b3c975e71a69928a850)` {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:53:25.739840 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22b82f50-13a3-404b-81ba-aa7c9f05d122 None admin] RBAC: Authorization granted {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:53:25.742755 dv-cinder-851351-1-smb devstack@keystone.service[352329]: [pid: 352329|app: 0|req: 181/353] 10.222.0.42 () {56 vars in 1180 bytes} [Thu Jul 28 08:53:25 2022] GET /identity/v3/groups/313e220fa1e24b3c975e71a69928a850 => generated 226 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:53:25.745646 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89743995-d014-4070-ad29-7796958874b9 None None] REQUEST_METHOD: `GET` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:53:25.745968 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89743995-d014-4070-ad29-7796958874b9 None None] SCRIPT_NAME: `/identity` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:53:25.746245 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89743995-d014-4070-ad29-7796958874b9 None None] PATH_INFO: `/` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:53:25.749286 dv-cinder-851351-1-smb devstack@keystone.service[352329]: [pid: 352329|app: 0|req: 182/354] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 08:53:25 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 08:53:25.750520 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89743995-d014-4070-ad29-7796958874b9 None None] Authenticating user token {{(pid=352329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:53:25.761134 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.auth.core [None req-2c9cd5dd-3648-4d51-868e-84e8dc7a3ded None None] MFA Rules not processed for user `d18c063b2377412485965357671e5506`. Rule list: `[]` (Enabled: `True`). {{(pid=352328) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 08:53:25.762693 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.fernet_utils [None req-2c9cd5dd-3648-4d51-868e-84e8dc7a3ded None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=352328) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:53:25.801056 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG dbcounter [-] [352329] Writing DB stats keystone:SELECT=100 {{(pid=352329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:53:25.855469 dv-cinder-851351-1-smb devstack@keystone.service[352328]: [pid: 352328|app: 0|req: 173/355] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 08:53:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 08:53:25.857041 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c9cd5dd-3648-4d51-868e-84e8dc7a3ded None None] Authenticating user token {{(pid=352328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:53:25.880581 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG dbcounter [-] [352328] Writing DB stats keystone:SELECT=100 {{(pid=352328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:53:25.888418 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89743995-d014-4070-ad29-7796958874b9 None None] Validating token access rules against request {{(pid=352329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:53:25.940365 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a4c394-9630-4301-8114-182ef37e3aa3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:53:25.941362 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a4c394-9630-4301-8114-182ef37e3aa3 None admin] REQUEST_METHOD: `GET` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:53:25.941802 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a4c394-9630-4301-8114-182ef37e3aa3 None admin] SCRIPT_NAME: `/identity` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:53:25.942594 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a4c394-9630-4301-8114-182ef37e3aa3 None admin] PATH_INFO: `/v3/roles` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:53:25.943866 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82a4c394-9630-4301-8114-182ef37e3aa3 None admin] RBAC: Adding query filter params (name=reader) {{(pid=352329) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:53:25.944334 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82a4c394-9630-4301-8114-182ef37e3aa3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:53:25.946725 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82a4c394-9630-4301-8114-182ef37e3aa3 None admin] RBAC: Authorization granted {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:53:25.964603 dv-cinder-851351-1-smb devstack@keystone.service[352329]: [pid: 352329|app: 0|req: 183/356] 10.222.0.42 () {56 vars in 1101 bytes} [Thu Jul 28 08:53:25 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:53:25.966670 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f39c54-7864-49d1-bf6e-064d2a39822b None None] REQUEST_METHOD: `POST` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:53:25.967387 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f39c54-7864-49d1-bf6e-064d2a39822b None None] SCRIPT_NAME: `/identity` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:53:25.968097 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f39c54-7864-49d1-bf6e-064d2a39822b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:53:25.988025 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.auth.core [None req-63f39c54-7864-49d1-bf6e-064d2a39822b None None] MFA Rules not processed for user `d18c063b2377412485965357671e5506`. Rule list: `[]` (Enabled: `True`). {{(pid=352329) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 08:53:25.989643 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.fernet_utils [None req-63f39c54-7864-49d1-bf6e-064d2a39822b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=352329) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:53:26.010006 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c9cd5dd-3648-4d51-868e-84e8dc7a3ded None None] Validating token access rules against request {{(pid=352328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:53:26.056864 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809c8cc5-b16a-4fc8-bd0e-66e38c271527 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:53:26.057543 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809c8cc5-b16a-4fc8-bd0e-66e38c271527 None admin] REQUEST_METHOD: `GET` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:53:26.057857 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809c8cc5-b16a-4fc8-bd0e-66e38c271527 None admin] SCRIPT_NAME: `/identity` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:53:26.058394 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809c8cc5-b16a-4fc8-bd0e-66e38c271527 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:53:26.059670 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-809c8cc5-b16a-4fc8-bd0e-66e38c271527 None admin] RBAC: Adding query filter params (group.id=313e220fa1e24b3c975e71a69928a850, role.id=a4fa43cd6d914398a0790a1516c83d08, scope.project.id=9af593aec02c450aa4ce9c48ff4c6a1f) {{(pid=352328) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:53:26.060010 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-809c8cc5-b16a-4fc8-bd0e-66e38c271527 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:53:26.061828 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-809c8cc5-b16a-4fc8-bd0e-66e38c271527 None admin] RBAC: Authorization granted {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:53:26.072733 dv-cinder-851351-1-smb devstack@keystone.service[352328]: [pid: 352328|app: 0|req: 174/357] 10.222.0.42 () {56 vars in 1376 bytes} [Thu Jul 28 08:53:25 2022] GET /identity/v3/role_assignments?group.id=313e220fa1e24b3c975e71a69928a850&scope.project.id=9af593aec02c450aa4ce9c48ff4c6a1f&role.id=a4fa43cd6d914398a0790a1516c83d08 => generated 260 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:53:26.072733 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809c8cc5-b16a-4fc8-bd0e-66e38c271527 None admin] Authenticating user token {{(pid=352328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:53:26.082075 dv-cinder-851351-1-smb devstack@keystone.service[352329]: [pid: 352329|app: 0|req: 184/358] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 08:53:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 08:53:26.082075 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f39c54-7864-49d1-bf6e-064d2a39822b None None] Authenticating user token {{(pid=352329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:53:26.134864 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG dbcounter [-] [352329] Writing DB stats keystone:SELECT=100 {{(pid=352329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:53:26.206381 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG dbcounter [-] [352328] Writing DB stats keystone:SELECT=100 {{(pid=352328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:53:26.232305 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809c8cc5-b16a-4fc8-bd0e-66e38c271527 None admin] Validating token access rules against request {{(pid=352328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:53:26.279509 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc1d4cc-c267-46b6-96df-21cbd50a6d0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:53:26.280535 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc1d4cc-c267-46b6-96df-21cbd50a6d0d None admin] REQUEST_METHOD: `GET` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:53:26.281034 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc1d4cc-c267-46b6-96df-21cbd50a6d0d None admin] SCRIPT_NAME: `/identity` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:53:26.281506 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc1d4cc-c267-46b6-96df-21cbd50a6d0d None admin] PATH_INFO: `/v3/roles/member` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:53:26.300844 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bc1d4cc-c267-46b6-96df-21cbd50a6d0d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 08:53:26.308556 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application [None req-1bc1d4cc-c267-46b6-96df-21cbd50a6d0d None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 28 08:53:26.308556 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:53:26.308556 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:53:26.308556 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:53:26.308556 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:53:26.308556 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:53:26.308556 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:53:26.308556 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:53:26.308556 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:53:26.308556 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:53:26.308556 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:53:26.308556 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:53:26.308556 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 08:53:26.308556 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 08:53:26.308556 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 08:53:26.308556 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 08:53:26.309822 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 08:53:26.309822 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 08:53:26.309822 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 08:53:26.309822 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 08:53:26.309822 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:53:26.309822 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:53:26.309822 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:53:26.309822 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:53:26.309822 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:53:26.309822 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:53:26.309822 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:53:26.309822 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application with Lock( Jul 28 08:53:26.309822 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:53:26.309822 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:53:26.309822 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:53:26.309822 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:53:26.310831 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:53:26.310831 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:53:26.310831 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:53:26.310831 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:53:26.310831 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 08:53:26.310831 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 08:53:26.310831 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 08:53:26.310831 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 08:53:26.310831 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 08:53:26.310831 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 08:53:26.310831 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 28 08:53:26.310831 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application Jul 28 08:53:26.312382 dv-cinder-851351-1-smb devstack@keystone.service[352328]: [pid: 352328|app: 0|req: 175/359] 10.222.0.42 () {56 vars in 1099 bytes} [Thu Jul 28 08:53:26 2022] GET /identity/v3/roles/member => generated 84 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:53:26.316218 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc1d4cc-c267-46b6-96df-21cbd50a6d0d None admin] Authenticating user token {{(pid=352328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:53:26.345681 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f39c54-7864-49d1-bf6e-064d2a39822b None None] Validating token access rules against request {{(pid=352329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:53:26.398971 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb51f49-c174-4547-9c27-7eba91a50d43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:53:26.400269 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb51f49-c174-4547-9c27-7eba91a50d43 None admin] REQUEST_METHOD: `GET` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:53:26.400556 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb51f49-c174-4547-9c27-7eba91a50d43 None admin] SCRIPT_NAME: `/identity` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:53:26.400889 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb51f49-c174-4547-9c27-7eba91a50d43 None admin] PATH_INFO: `/v3/users/694481f660d64b0b8e0b04dc860e3b88` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:53:26.403678 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb51f49-c174-4547-9c27-7eba91a50d43 None admin] RBAC: Authorizing `identity:get_user(user_id=694481f660d64b0b8e0b04dc860e3b88)` {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:53:26.405665 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb51f49-c174-4547-9c27-7eba91a50d43 None admin] RBAC: Authorization granted {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:53:26.408387 dv-cinder-851351-1-smb devstack@keystone.service[352329]: [pid: 352329|app: 0|req: 185/360] 10.222.0.42 () {56 vars in 1177 bytes} [Thu Jul 28 08:53:26 2022] GET /identity/v3/users/694481f660d64b0b8e0b04dc860e3b88 => generated 293 bytes in 329 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:53:26.409728 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4409546d-f45d-48f2-b08d-07023d06b126 None None] REQUEST_METHOD: `GET` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:53:26.410017 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4409546d-f45d-48f2-b08d-07023d06b126 None None] SCRIPT_NAME: `/identity` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:53:26.410291 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4409546d-f45d-48f2-b08d-07023d06b126 None None] PATH_INFO: `/` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:53:26.414456 dv-cinder-851351-1-smb devstack@keystone.service[352329]: [pid: 352329|app: 0|req: 186/361] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 08:53:26 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 08:53:26.415246 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4409546d-f45d-48f2-b08d-07023d06b126 None None] Authenticating user token {{(pid=352329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:53:26.474255 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc1d4cc-c267-46b6-96df-21cbd50a6d0d None admin] Validating token access rules against request {{(pid=352328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:53:26.521039 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06abd69-4a91-473a-8fe6-cd835ee57512 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:53:26.521681 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06abd69-4a91-473a-8fe6-cd835ee57512 None admin] REQUEST_METHOD: `GET` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:53:26.521971 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06abd69-4a91-473a-8fe6-cd835ee57512 None admin] SCRIPT_NAME: `/identity` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:53:26.522339 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06abd69-4a91-473a-8fe6-cd835ee57512 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:53:26.537035 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG dbcounter [-] [352328] Writing DB stats keystone:SELECT=100 {{(pid=352328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:53:26.541531 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c06abd69-4a91-473a-8fe6-cd835ee57512 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 08:53:26.547898 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application [None req-c06abd69-4a91-473a-8fe6-cd835ee57512 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 28 08:53:26.547898 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:53:26.547898 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:53:26.547898 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:53:26.547898 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:53:26.547898 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:53:26.547898 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:53:26.547898 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:53:26.547898 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:53:26.547898 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:53:26.547898 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:53:26.547898 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:53:26.547898 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 08:53:26.547898 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 08:53:26.547898 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 08:53:26.547898 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 08:53:26.549284 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 08:53:26.549284 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 08:53:26.549284 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 08:53:26.549284 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 08:53:26.549284 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:53:26.549284 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:53:26.549284 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:53:26.549284 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:53:26.549284 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:53:26.549284 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:53:26.549284 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:53:26.549284 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application with Lock( Jul 28 08:53:26.549284 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:53:26.549284 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:53:26.549284 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:53:26.549284 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:53:26.550561 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:53:26.550561 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:53:26.550561 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:53:26.550561 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:53:26.550561 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 08:53:26.550561 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 08:53:26.550561 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 08:53:26.550561 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 08:53:26.550561 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 08:53:26.550561 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 08:53:26.550561 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 28 08:53:26.550561 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application Jul 28 08:53:26.550561 dv-cinder-851351-1-smb devstack@keystone.service[352328]: [pid: 352328|app: 0|req: 176/362] 10.222.0.42 () {56 vars in 1114 bytes} [Thu Jul 28 08:53:26 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:53:26.550561 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06abd69-4a91-473a-8fe6-cd835ee57512 None admin] Authenticating user token {{(pid=352328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:53:26.582749 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG dbcounter [-] [352329] Writing DB stats keystone:SELECT=100 {{(pid=352329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:53:26.622656 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4409546d-f45d-48f2-b08d-07023d06b126 None None] Validating token access rules against request {{(pid=352329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:53:26.662944 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351dae73-5fe3-4628-ae76-82838076dfed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:53:26.663586 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351dae73-5fe3-4628-ae76-82838076dfed None admin] REQUEST_METHOD: `GET` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:53:26.663863 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351dae73-5fe3-4628-ae76-82838076dfed None admin] SCRIPT_NAME: `/identity` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:53:26.664134 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351dae73-5fe3-4628-ae76-82838076dfed None admin] PATH_INFO: `/v3/roles` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:53:26.664906 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-351dae73-5fe3-4628-ae76-82838076dfed None admin] RBAC: Adding query filter params (name=member) {{(pid=352329) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:53:26.665215 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-351dae73-5fe3-4628-ae76-82838076dfed None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:53:26.666717 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-351dae73-5fe3-4628-ae76-82838076dfed None admin] RBAC: Authorization granted {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:53:26.676400 dv-cinder-851351-1-smb devstack@keystone.service[352329]: [pid: 352329|app: 0|req: 187/363] 10.222.0.42 () {56 vars in 1101 bytes} [Thu Jul 28 08:53:26 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:53:26.682061 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68468457-f0de-4d4e-bd13-b730840da4f3 None None] REQUEST_METHOD: `POST` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:53:26.682373 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68468457-f0de-4d4e-bd13-b730840da4f3 None None] SCRIPT_NAME: `/identity` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:53:26.682623 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68468457-f0de-4d4e-bd13-b730840da4f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:53:26.693372 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06abd69-4a91-473a-8fe6-cd835ee57512 None admin] Validating token access rules against request {{(pid=352328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:53:26.701989 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.auth.core [None req-68468457-f0de-4d4e-bd13-b730840da4f3 None None] MFA Rules not processed for user `d18c063b2377412485965357671e5506`. Rule list: `[]` (Enabled: `True`). {{(pid=352329) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 08:53:26.703259 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.fernet_utils [None req-68468457-f0de-4d4e-bd13-b730840da4f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=352329) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:53:26.729936 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0edbe5d-4749-4d35-aa70-adcc500179ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:53:26.730581 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0edbe5d-4749-4d35-aa70-adcc500179ad None admin] REQUEST_METHOD: `GET` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:53:26.730868 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0edbe5d-4749-4d35-aa70-adcc500179ad None admin] SCRIPT_NAME: `/identity` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:53:26.731146 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0edbe5d-4749-4d35-aa70-adcc500179ad None admin] PATH_INFO: `/v3/role_assignments` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:53:26.731951 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0edbe5d-4749-4d35-aa70-adcc500179ad None admin] RBAC: Adding query filter params (role.id=3abd212955234654b7d9a8d7df33e380, user.id=694481f660d64b0b8e0b04dc860e3b88, scope.system=all) {{(pid=352328) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:53:26.732262 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0edbe5d-4749-4d35-aa70-adcc500179ad None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:53:26.733831 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0edbe5d-4749-4d35-aa70-adcc500179ad None admin] RBAC: Authorization granted {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:53:26.746974 dv-cinder-851351-1-smb devstack@keystone.service[352328]: [pid: 352328|app: 0|req: 177/364] 10.222.0.42 () {56 vars in 1308 bytes} [Thu Jul 28 08:53:26 2022] GET /identity/v3/role_assignments?user.id=694481f660d64b0b8e0b04dc860e3b88&scope.system=all&role.id=3abd212955234654b7d9a8d7df33e380 => generated 510 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:53:26.747844 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0edbe5d-4749-4d35-aa70-adcc500179ad None admin] Authenticating user token {{(pid=352328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:53:26.783795 dv-cinder-851351-1-smb devstack@keystone.service[352329]: [pid: 352329|app: 0|req: 188/365] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 08:53:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 08:53:26.784699 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68468457-f0de-4d4e-bd13-b730840da4f3 None None] Authenticating user token {{(pid=352329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:53:26.830462 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG dbcounter [-] [352328] Writing DB stats keystone:SELECT=100 {{(pid=352328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:53:26.878731 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0edbe5d-4749-4d35-aa70-adcc500179ad None admin] Validating token access rules against request {{(pid=352328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:53:26.894451 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG dbcounter [-] [352329] Writing DB stats keystone:SELECT=100 {{(pid=352329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:53:26.920037 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8080723c-2a70-4c33-86b9-7537c7994854 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:53:26.921189 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8080723c-2a70-4c33-86b9-7537c7994854 None admin] REQUEST_METHOD: `GET` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:53:26.921675 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8080723c-2a70-4c33-86b9-7537c7994854 None admin] SCRIPT_NAME: `/identity` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:53:26.922120 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8080723c-2a70-4c33-86b9-7537c7994854 None admin] PATH_INFO: `/v3/roles` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:53:26.923082 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8080723c-2a70-4c33-86b9-7537c7994854 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=352328) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:53:26.923628 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8080723c-2a70-4c33-86b9-7537c7994854 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:53:26.925295 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8080723c-2a70-4c33-86b9-7537c7994854 None admin] RBAC: Authorization granted {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:53:26.936084 dv-cinder-851351-1-smb devstack@keystone.service[352328]: [pid: 352328|app: 0|req: 178/366] 10.222.0.42 () {56 vars in 1111 bytes} [Thu Jul 28 08:53:26 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:53:26.937345 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8080723c-2a70-4c33-86b9-7537c7994854 None admin] Authenticating user token {{(pid=352328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:53:26.958468 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68468457-f0de-4d4e-bd13-b730840da4f3 None None] Validating token access rules against request {{(pid=352329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:53:27.040562 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a52f3cad-7904-45bf-8e6b-cde1f6542135 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:53:27.041229 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52f3cad-7904-45bf-8e6b-cde1f6542135 None admin] REQUEST_METHOD: `GET` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:53:27.041521 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52f3cad-7904-45bf-8e6b-cde1f6542135 None admin] SCRIPT_NAME: `/identity` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:53:27.041799 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52f3cad-7904-45bf-8e6b-cde1f6542135 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:53:27.055297 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8080723c-2a70-4c33-86b9-7537c7994854 None admin] Validating token access rules against request {{(pid=352328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:53:27.078039 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG dbcounter [-] [352328] Writing DB stats keystone:SELECT=100 {{(pid=352328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:53:27.103024 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c529f71f-3fee-4956-bca3-95da246a94f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:53:27.103705 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c529f71f-3fee-4956-bca3-95da246a94f1 None admin] REQUEST_METHOD: `GET` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:53:27.103989 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c529f71f-3fee-4956-bca3-95da246a94f1 None admin] SCRIPT_NAME: `/identity` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:53:27.104263 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c529f71f-3fee-4956-bca3-95da246a94f1 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:53:27.135857 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c529f71f-3fee-4956-bca3-95da246a94f1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 08:53:27.143612 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application [None req-c529f71f-3fee-4956-bca3-95da246a94f1 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 08:53:27.143612 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:53:27.143612 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:53:27.143612 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:53:27.143612 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:53:27.143612 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:53:27.143612 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:53:27.143612 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:53:27.143612 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:53:27.143612 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:53:27.143612 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:53:27.143612 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:53:27.143612 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 08:53:27.143612 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 08:53:27.143612 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 08:53:27.143612 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 08:53:27.145094 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 08:53:27.145094 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 08:53:27.145094 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 08:53:27.145094 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 08:53:27.145094 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:53:27.145094 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:53:27.145094 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:53:27.145094 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:53:27.145094 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:53:27.145094 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:53:27.145094 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:53:27.145094 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application with Lock( Jul 28 08:53:27.145094 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:53:27.145094 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:53:27.145094 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:53:27.145094 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:53:27.146129 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:53:27.146129 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:53:27.146129 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:53:27.146129 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:53:27.146129 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 08:53:27.146129 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 08:53:27.146129 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 08:53:27.146129 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 08:53:27.146129 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 08:53:27.146129 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 08:53:27.146129 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 08:53:27.146129 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application Jul 28 08:53:27.146129 dv-cinder-851351-1-smb devstack@keystone.service[352328]: [pid: 352328|app: 0|req: 179/367] 10.222.0.42 () {56 vars in 1096 bytes} [Thu Jul 28 08:53:26 2022] GET /identity/v3/roles/admin => generated 83 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:53:27.146129 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c529f71f-3fee-4956-bca3-95da246a94f1 None admin] Authenticating user token {{(pid=352328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:53:27.156707 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a52f3cad-7904-45bf-8e6b-cde1f6542135 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:53:27.158723 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a52f3cad-7904-45bf-8e6b-cde1f6542135 None admin] RBAC: Authorization granted {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:53:27.255025 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG dbcounter [-] [352329] Writing DB stats keystone:SELECT=100 {{(pid=352329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:53:27.277023 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c529f71f-3fee-4956-bca3-95da246a94f1 None admin] Validating token access rules against request {{(pid=352328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:53:27.300766 dv-cinder-851351-1-smb devstack@keystone.service[352329]: [pid: 352329|app: 0|req: 189/368] 10.222.0.42 () {58 vars in 1282 bytes} [Thu Jul 28 08:53:26 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 516 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 28 08:53:27.305238 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a52f3cad-7904-45bf-8e6b-cde1f6542135 None admin] Authenticating user token {{(pid=352329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:53:27.331235 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a675d77-dfd8-44d4-b3f1-6db86397b38a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:53:27.331888 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a675d77-dfd8-44d4-b3f1-6db86397b38a None admin] REQUEST_METHOD: `GET` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:53:27.332172 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a675d77-dfd8-44d4-b3f1-6db86397b38a None admin] SCRIPT_NAME: `/identity` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:53:27.332450 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a675d77-dfd8-44d4-b3f1-6db86397b38a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:53:27.409465 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG dbcounter [-] [352328] Writing DB stats keystone:SELECT=100 {{(pid=352328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:53:27.443837 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a675d77-dfd8-44d4-b3f1-6db86397b38a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:53:27.447065 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a52f3cad-7904-45bf-8e6b-cde1f6542135 None admin] Validating token access rules against request {{(pid=352329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:53:27.447222 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a675d77-dfd8-44d4-b3f1-6db86397b38a None admin] RBAC: Authorization granted {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:53:27.508756 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ef5b92-750a-414a-b197-8aa9f1e8ef1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:53:27.509440 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ef5b92-750a-414a-b197-8aa9f1e8ef1b None admin] REQUEST_METHOD: `GET` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:53:27.509717 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ef5b92-750a-414a-b197-8aa9f1e8ef1b None admin] SCRIPT_NAME: `/identity` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:53:27.509994 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ef5b92-750a-414a-b197-8aa9f1e8ef1b None admin] PATH_INFO: `/v3/roles` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:53:27.510693 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6ef5b92-750a-414a-b197-8aa9f1e8ef1b None admin] RBAC: Adding query filter params (name=admin) {{(pid=352329) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:53:27.511056 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6ef5b92-750a-414a-b197-8aa9f1e8ef1b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:53:27.512424 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6ef5b92-750a-414a-b197-8aa9f1e8ef1b None admin] RBAC: Authorization granted {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:53:27.528963 dv-cinder-851351-1-smb devstack@keystone.service[352329]: [pid: 352329|app: 0|req: 190/369] 10.222.0.42 () {56 vars in 1099 bytes} [Thu Jul 28 08:53:27 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:53:27.530077 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ef5b92-750a-414a-b197-8aa9f1e8ef1b None admin] Authenticating user token {{(pid=352329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:53:27.572086 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG dbcounter [-] [352329] Writing DB stats keystone:SELECT=100 {{(pid=352329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:53:27.583838 dv-cinder-851351-1-smb devstack@keystone.service[352328]: [pid: 352328|app: 0|req: 180/370] 10.222.0.42 () {58 vars in 1282 bytes} [Thu Jul 28 08:53:27 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 438 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 28 08:53:27.585464 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a675d77-dfd8-44d4-b3f1-6db86397b38a None admin] Authenticating user token {{(pid=352328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:53:27.661695 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ef5b92-750a-414a-b197-8aa9f1e8ef1b None admin] Validating token access rules against request {{(pid=352329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:53:27.696775 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG dbcounter [-] [352328] Writing DB stats keystone:SELECT=100 {{(pid=352328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:53:27.712686 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf52d6c-e522-46f4-b731-67daa9daafab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:53:27.713389 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf52d6c-e522-46f4-b731-67daa9daafab None admin] REQUEST_METHOD: `GET` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:53:27.713697 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf52d6c-e522-46f4-b731-67daa9daafab None admin] SCRIPT_NAME: `/identity` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:53:27.713992 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf52d6c-e522-46f4-b731-67daa9daafab None admin] PATH_INFO: `/v3/projects/be5ef7d0266e453784a39d297f9b131d` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:53:27.715169 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaf52d6c-e522-46f4-b731-67daa9daafab None admin] RBAC: Authorizing `identity:get_project(project_id=be5ef7d0266e453784a39d297f9b131d)` {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:53:27.716934 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaf52d6c-e522-46f4-b731-67daa9daafab None admin] RBAC: Authorization granted {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:53:27.718707 dv-cinder-851351-1-smb devstack@keystone.service[352329]: [pid: 352329|app: 0|req: 191/371] 10.222.0.42 () {56 vars in 1186 bytes} [Thu Jul 28 08:53:27 2022] GET /identity/v3/projects/be5ef7d0266e453784a39d297f9b131d => generated 302 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:53:27.719562 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf52d6c-e522-46f4-b731-67daa9daafab None admin] Authenticating user token {{(pid=352329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:53:27.724910 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a675d77-dfd8-44d4-b3f1-6db86397b38a None admin] Validating token access rules against request {{(pid=352328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:53:27.768498 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e590943a-5e00-4f67-b6b0-2ee63d32af49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:53:27.769904 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e590943a-5e00-4f67-b6b0-2ee63d32af49 None admin] REQUEST_METHOD: `GET` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:53:27.770681 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e590943a-5e00-4f67-b6b0-2ee63d32af49 None admin] SCRIPT_NAME: `/identity` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:53:27.771187 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e590943a-5e00-4f67-b6b0-2ee63d32af49 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:53:27.836072 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf52d6c-e522-46f4-b731-67daa9daafab None admin] Validating token access rules against request {{(pid=352329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:53:27.837700 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG dbcounter [-] [352329] Writing DB stats keystone:SELECT=100 {{(pid=352329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:53:27.859671 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e590943a-5e00-4f67-b6b0-2ee63d32af49 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:53:27.862084 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e590943a-5e00-4f67-b6b0-2ee63d32af49 None admin] RBAC: Authorization granted {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:53:27.879493 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37db825a-fa02-489b-82cc-c8132b181dfa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:53:27.880803 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37db825a-fa02-489b-82cc-c8132b181dfa None admin] REQUEST_METHOD: `GET` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:53:27.881772 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37db825a-fa02-489b-82cc-c8132b181dfa None admin] SCRIPT_NAME: `/identity` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:53:27.882534 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37db825a-fa02-489b-82cc-c8132b181dfa None admin] PATH_INFO: `/v3/projects/be5ef7d0266e453784a39d297f9b131d` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:53:27.884210 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37db825a-fa02-489b-82cc-c8132b181dfa None admin] RBAC: Authorizing `identity:get_project(project_id=be5ef7d0266e453784a39d297f9b131d)` {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:53:27.886358 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37db825a-fa02-489b-82cc-c8132b181dfa None admin] RBAC: Authorization granted {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:53:27.888697 dv-cinder-851351-1-smb devstack@keystone.service[352329]: [pid: 352329|app: 0|req: 192/372] 10.222.0.42 () {56 vars in 1186 bytes} [Thu Jul 28 08:53:27 2022] GET /identity/v3/projects/be5ef7d0266e453784a39d297f9b131d => generated 302 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:53:27.890319 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37db825a-fa02-489b-82cc-c8132b181dfa None admin] Authenticating user token {{(pid=352329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:53:27.967521 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG dbcounter [-] [352328] Writing DB stats keystone:SELECT=100 {{(pid=352328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:53:27.993585 dv-cinder-851351-1-smb devstack@keystone.service[352328]: [pid: 352328|app: 0|req: 181/373] 10.222.0.42 () {58 vars in 1282 bytes} [Thu Jul 28 08:53:27 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 409 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 28 08:53:27.995248 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e590943a-5e00-4f67-b6b0-2ee63d32af49 None admin] Authenticating user token {{(pid=352328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:53:28.037045 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37db825a-fa02-489b-82cc-c8132b181dfa None admin] Validating token access rules against request {{(pid=352329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:53:28.090579 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4f0439-f759-4b5c-bc0f-f0b534c40603 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:53:28.091068 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4f0439-f759-4b5c-bc0f-f0b534c40603 None admin] REQUEST_METHOD: `GET` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:53:28.091385 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4f0439-f759-4b5c-bc0f-f0b534c40603 None admin] SCRIPT_NAME: `/identity` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:53:28.091663 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4f0439-f759-4b5c-bc0f-f0b534c40603 None admin] PATH_INFO: `/v3/groups/313e220fa1e24b3c975e71a69928a850` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:53:28.093736 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c4f0439-f759-4b5c-bc0f-f0b534c40603 None admin] RBAC: Authorizing `identity:get_group(group_id=313e220fa1e24b3c975e71a69928a850)` {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:53:28.094376 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c4f0439-f759-4b5c-bc0f-f0b534c40603 None admin] RBAC: Authorization granted {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:53:28.096092 dv-cinder-851351-1-smb devstack@keystone.service[352329]: [pid: 352329|app: 0|req: 193/374] 10.222.0.42 () {56 vars in 1180 bytes} [Thu Jul 28 08:53:27 2022] GET /identity/v3/groups/313e220fa1e24b3c975e71a69928a850 => generated 226 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:53:28.099523 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4f0439-f759-4b5c-bc0f-f0b534c40603 None admin] Authenticating user token {{(pid=352329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:53:28.128541 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e590943a-5e00-4f67-b6b0-2ee63d32af49 None admin] Validating token access rules against request {{(pid=352328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:53:28.152608 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG dbcounter [-] [352329] Writing DB stats keystone:SELECT=100 {{(pid=352329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:53:28.171734 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de16d27-aa2a-4a3f-b067-4152858b1983 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:53:28.171734 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de16d27-aa2a-4a3f-b067-4152858b1983 None admin] REQUEST_METHOD: `GET` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:53:28.172131 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de16d27-aa2a-4a3f-b067-4152858b1983 None admin] SCRIPT_NAME: `/identity` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:53:28.172302 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de16d27-aa2a-4a3f-b067-4152858b1983 None admin] PATH_INFO: `/v3/groups/313e220fa1e24b3c975e71a69928a850` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:53:28.174703 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de16d27-aa2a-4a3f-b067-4152858b1983 None admin] RBAC: Authorizing `identity:get_group(group_id=313e220fa1e24b3c975e71a69928a850)` {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:53:28.176189 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de16d27-aa2a-4a3f-b067-4152858b1983 None admin] RBAC: Authorization granted {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:53:28.178116 dv-cinder-851351-1-smb devstack@keystone.service[352328]: [pid: 352328|app: 0|req: 182/375] 10.222.0.42 () {56 vars in 1180 bytes} [Thu Jul 28 08:53:27 2022] GET /identity/v3/groups/313e220fa1e24b3c975e71a69928a850 => generated 226 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:53:28.183521 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84de7ad-0e2f-4131-bcac-ab34386f1a05 None None] REQUEST_METHOD: `GET` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:53:28.183521 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84de7ad-0e2f-4131-bcac-ab34386f1a05 None None] SCRIPT_NAME: `/identity` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:53:28.183521 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84de7ad-0e2f-4131-bcac-ab34386f1a05 None None] PATH_INFO: `/` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:53:28.183521 dv-cinder-851351-1-smb devstack@keystone.service[352328]: [pid: 352328|app: 0|req: 183/376] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 08:53:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 08:53:28.183521 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a84de7ad-0e2f-4131-bcac-ab34386f1a05 None None] Authenticating user token {{(pid=352328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:53:28.240720 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4f0439-f759-4b5c-bc0f-f0b534c40603 None admin] Validating token access rules against request {{(pid=352329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:53:28.251731 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG dbcounter [-] [352328] Writing DB stats keystone:SELECT=100 {{(pid=352328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:53:28.294194 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18954f2e-2e77-4244-8505-960d273aa68b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:53:28.294194 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18954f2e-2e77-4244-8505-960d273aa68b None admin] REQUEST_METHOD: `GET` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:53:28.294194 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18954f2e-2e77-4244-8505-960d273aa68b None admin] SCRIPT_NAME: `/identity` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:53:28.294828 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18954f2e-2e77-4244-8505-960d273aa68b None admin] PATH_INFO: `/v3/projects/5c7af4b1c9fc4f35a95bbc0f95b044f2` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:53:28.296180 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18954f2e-2e77-4244-8505-960d273aa68b None admin] RBAC: Authorizing `identity:get_project(project_id=5c7af4b1c9fc4f35a95bbc0f95b044f2)` {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:53:28.298565 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18954f2e-2e77-4244-8505-960d273aa68b None admin] RBAC: Authorization granted {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:53:28.304909 dv-cinder-851351-1-smb devstack@keystone.service[352329]: [pid: 352329|app: 0|req: 194/377] 10.222.0.42 () {56 vars in 1186 bytes} [Thu Jul 28 08:53:28 2022] GET /identity/v3/projects/5c7af4b1c9fc4f35a95bbc0f95b044f2 => generated 344 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:53:28.304909 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18954f2e-2e77-4244-8505-960d273aa68b None admin] Authenticating user token {{(pid=352329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:53:28.332125 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a84de7ad-0e2f-4131-bcac-ab34386f1a05 None None] Validating token access rules against request {{(pid=352328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:53:28.378325 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca72c321-5b81-4272-b958-2e5e2cb61123 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:53:28.378933 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca72c321-5b81-4272-b958-2e5e2cb61123 None admin] REQUEST_METHOD: `GET` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:53:28.379144 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca72c321-5b81-4272-b958-2e5e2cb61123 None admin] SCRIPT_NAME: `/identity` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:53:28.379420 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca72c321-5b81-4272-b958-2e5e2cb61123 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:53:28.380266 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca72c321-5b81-4272-b958-2e5e2cb61123 None admin] RBAC: Adding query filter params (group.id=313e220fa1e24b3c975e71a69928a850, role.id=16a3fc3aca974c47a329c2781b0be93a, scope.project.id=be5ef7d0266e453784a39d297f9b131d) {{(pid=352328) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:53:28.380582 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca72c321-5b81-4272-b958-2e5e2cb61123 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:53:28.384739 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca72c321-5b81-4272-b958-2e5e2cb61123 None admin] RBAC: Authorization granted {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:53:28.392730 dv-cinder-851351-1-smb devstack@keystone.service[352328]: [pid: 352328|app: 0|req: 184/378] 10.222.0.42 () {56 vars in 1376 bytes} [Thu Jul 28 08:53:28 2022] GET /identity/v3/role_assignments?group.id=313e220fa1e24b3c975e71a69928a850&scope.project.id=be5ef7d0266e453784a39d297f9b131d&role.id=16a3fc3aca974c47a329c2781b0be93a => generated 260 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:53:28.392730 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6fe5d4-c338-495c-8bd2-34993e2109ad None None] REQUEST_METHOD: `POST` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:53:28.392730 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6fe5d4-c338-495c-8bd2-34993e2109ad None None] SCRIPT_NAME: `/identity` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:53:28.392730 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6fe5d4-c338-495c-8bd2-34993e2109ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:53:28.411781 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.auth.core [None req-6e6fe5d4-c338-495c-8bd2-34993e2109ad None None] MFA Rules not processed for user `d18c063b2377412485965357671e5506`. Rule list: `[]` (Enabled: `True`). {{(pid=352328) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 08:53:28.413305 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.fernet_utils [None req-6e6fe5d4-c338-495c-8bd2-34993e2109ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=352328) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:53:28.445615 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18954f2e-2e77-4244-8505-960d273aa68b None admin] Validating token access rules against request {{(pid=352329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:53:28.455178 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG dbcounter [-] [352329] Writing DB stats keystone:SELECT=100 {{(pid=352329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:53:28.498502 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b37f783-47ef-402f-b99e-8d0be72d23cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:53:28.499136 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b37f783-47ef-402f-b99e-8d0be72d23cc None admin] REQUEST_METHOD: `GET` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:53:28.499452 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b37f783-47ef-402f-b99e-8d0be72d23cc None admin] SCRIPT_NAME: `/identity` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:53:28.499709 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b37f783-47ef-402f-b99e-8d0be72d23cc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:53:28.500532 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b37f783-47ef-402f-b99e-8d0be72d23cc None admin] RBAC: Adding query filter params (group.id=313e220fa1e24b3c975e71a69928a850, role.id=a4fa43cd6d914398a0790a1516c83d08, scope.project.id=be5ef7d0266e453784a39d297f9b131d) {{(pid=352329) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:53:28.501918 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b37f783-47ef-402f-b99e-8d0be72d23cc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:53:28.503777 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b37f783-47ef-402f-b99e-8d0be72d23cc None admin] RBAC: Authorization granted {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:53:28.512200 dv-cinder-851351-1-smb devstack@keystone.service[352329]: [pid: 352329|app: 0|req: 195/379] 10.222.0.42 () {56 vars in 1376 bytes} [Thu Jul 28 08:53:28 2022] GET /identity/v3/role_assignments?group.id=313e220fa1e24b3c975e71a69928a850&scope.project.id=be5ef7d0266e453784a39d297f9b131d&role.id=a4fa43cd6d914398a0790a1516c83d08 => generated 260 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:53:28.513263 dv-cinder-851351-1-smb devstack@keystone.service[352328]: [pid: 352328|app: 0|req: 185/380] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 08:53:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 08:53:28.514073 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b37f783-47ef-402f-b99e-8d0be72d23cc None admin] Authenticating user token {{(pid=352329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:53:28.515238 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d292f3-ab7c-4bb1-ae83-119ffcba9f3d None None] REQUEST_METHOD: `GET` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:53:28.515738 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d292f3-ab7c-4bb1-ae83-119ffcba9f3d None None] SCRIPT_NAME: `/identity` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:53:28.516238 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d292f3-ab7c-4bb1-ae83-119ffcba9f3d None None] PATH_INFO: `/` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:53:28.518307 dv-cinder-851351-1-smb devstack@keystone.service[352328]: [pid: 352328|app: 0|req: 186/381] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 08:53:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 08:53:28.524328 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a29d16-cd9e-4d29-8c13-75d6d06ba209 None None] REQUEST_METHOD: `POST` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:53:28.524625 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a29d16-cd9e-4d29-8c13-75d6d06ba209 None None] SCRIPT_NAME: `/identity` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:53:28.524942 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a29d16-cd9e-4d29-8c13-75d6d06ba209 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:53:28.551765 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.auth.core [None req-88a29d16-cd9e-4d29-8c13-75d6d06ba209 None None] MFA Rules not processed for user `d18c063b2377412485965357671e5506`. Rule list: `[]` (Enabled: `True`). {{(pid=352328) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 08:53:28.553046 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.fernet_utils [None req-88a29d16-cd9e-4d29-8c13-75d6d06ba209 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=352328) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:53:28.607233 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG dbcounter [-] [352328] Writing DB stats keystone:SELECT=100 {{(pid=352328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:53:28.651799 dv-cinder-851351-1-smb devstack@keystone.service[352328]: [pid: 352328|app: 0|req: 187/382] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 08:53:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 28 08:53:28.652620 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a29d16-cd9e-4d29-8c13-75d6d06ba209 None None] Authenticating user token {{(pid=352328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:53:28.671573 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b37f783-47ef-402f-b99e-8d0be72d23cc None admin] Validating token access rules against request {{(pid=352329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:53:28.711152 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e473f91-666b-4486-9acf-1c65564b9cab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:53:28.711882 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e473f91-666b-4486-9acf-1c65564b9cab None admin] REQUEST_METHOD: `GET` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:53:28.712173 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e473f91-666b-4486-9acf-1c65564b9cab None admin] SCRIPT_NAME: `/identity` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:53:28.712453 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e473f91-666b-4486-9acf-1c65564b9cab None admin] PATH_INFO: `/v3/groups/1bda7933e7cd46bb88eaf0bc55ad78c4` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:53:28.719908 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e473f91-666b-4486-9acf-1c65564b9cab None admin] RBAC: Authorizing `identity:get_group(group_id=1bda7933e7cd46bb88eaf0bc55ad78c4)` {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:53:28.721722 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e473f91-666b-4486-9acf-1c65564b9cab None admin] RBAC: Authorization granted {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:53:28.728539 dv-cinder-851351-1-smb devstack@keystone.service[352329]: [pid: 352329|app: 0|req: 196/383] 10.222.0.42 () {56 vars in 1180 bytes} [Thu Jul 28 08:53:28 2022] GET /identity/v3/groups/1bda7933e7cd46bb88eaf0bc55ad78c4 => generated 229 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:53:28.730062 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e473f91-666b-4486-9acf-1c65564b9cab None admin] Authenticating user token {{(pid=352329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:53:28.773083 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG dbcounter [-] [352329] Writing DB stats keystone:SELECT=100 {{(pid=352329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:53:28.801629 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a29d16-cd9e-4d29-8c13-75d6d06ba209 None None] Validating token access rules against request {{(pid=352328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:53:28.849234 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d538af26-f03a-48ed-b661-bd30cefe781d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:53:28.849916 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d538af26-f03a-48ed-b661-bd30cefe781d None admin] REQUEST_METHOD: `GET` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:53:28.850195 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d538af26-f03a-48ed-b661-bd30cefe781d None admin] SCRIPT_NAME: `/identity` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:53:28.850470 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d538af26-f03a-48ed-b661-bd30cefe781d None admin] PATH_INFO: `/v3/roles/member` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:53:28.869772 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d538af26-f03a-48ed-b661-bd30cefe781d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 08:53:28.870232 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e473f91-666b-4486-9acf-1c65564b9cab None admin] Validating token access rules against request {{(pid=352329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:53:28.876272 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application [None req-d538af26-f03a-48ed-b661-bd30cefe781d None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 28 08:53:28.876272 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:53:28.876272 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:53:28.876272 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:53:28.876272 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:53:28.876272 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:53:28.876272 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:53:28.876272 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:53:28.876272 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:53:28.876272 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:53:28.876272 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:53:28.876272 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:53:28.876272 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 08:53:28.876272 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 08:53:28.876272 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 08:53:28.876272 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 08:53:28.877531 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 08:53:28.877531 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 08:53:28.877531 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 08:53:28.877531 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 08:53:28.877531 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:53:28.877531 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:53:28.877531 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:53:28.877531 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:53:28.877531 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:53:28.877531 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:53:28.877531 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:53:28.877531 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application with Lock( Jul 28 08:53:28.877531 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:53:28.877531 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:53:28.877531 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:53:28.877531 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:53:28.879009 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:53:28.879009 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:53:28.879009 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:53:28.879009 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:53:28.879009 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 08:53:28.879009 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 08:53:28.879009 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 08:53:28.879009 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 08:53:28.879009 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 08:53:28.879009 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 08:53:28.879009 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 28 08:53:28.879009 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application Jul 28 08:53:28.879009 dv-cinder-851351-1-smb devstack@keystone.service[352328]: [pid: 352328|app: 0|req: 188/384] 10.222.0.42 () {56 vars in 1099 bytes} [Thu Jul 28 08:53:28 2022] GET /identity/v3/roles/member => generated 84 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:53:28.880030 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d538af26-f03a-48ed-b661-bd30cefe781d None admin] Authenticating user token {{(pid=352328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:53:28.913726 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aade153-71da-4475-afec-789a01943f5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:53:28.914396 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aade153-71da-4475-afec-789a01943f5e None admin] REQUEST_METHOD: `GET` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:53:28.914738 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aade153-71da-4475-afec-789a01943f5e None admin] SCRIPT_NAME: `/identity` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:53:28.915034 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aade153-71da-4475-afec-789a01943f5e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:53:28.915860 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aade153-71da-4475-afec-789a01943f5e None admin] RBAC: Adding query filter params (group.id=1bda7933e7cd46bb88eaf0bc55ad78c4, role.id=280023171b4a45efb67c036ff237bb3c, scope.project.id=5c7af4b1c9fc4f35a95bbc0f95b044f2) {{(pid=352329) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:53:28.916181 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aade153-71da-4475-afec-789a01943f5e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:53:28.919699 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aade153-71da-4475-afec-789a01943f5e None admin] RBAC: Authorization granted {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:53:28.925082 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG dbcounter [-] [352328] Writing DB stats keystone:SELECT=100 {{(pid=352328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:53:28.927000 dv-cinder-851351-1-smb devstack@keystone.service[352329]: [pid: 352329|app: 0|req: 197/385] 10.222.0.42 () {56 vars in 1376 bytes} [Thu Jul 28 08:53:28 2022] GET /identity/v3/role_assignments?group.id=1bda7933e7cd46bb88eaf0bc55ad78c4&scope.project.id=5c7af4b1c9fc4f35a95bbc0f95b044f2&role.id=280023171b4a45efb67c036ff237bb3c => generated 260 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 08:53:28.928285 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aade153-71da-4475-afec-789a01943f5e None admin] Authenticating user token {{(pid=352329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:53:29.009970 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d538af26-f03a-48ed-b661-bd30cefe781d None admin] Validating token access rules against request {{(pid=352328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:53:29.067877 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d734ed7-cdb6-476c-8b8c-d7d6023f68dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:53:29.068567 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d734ed7-cdb6-476c-8b8c-d7d6023f68dd None admin] REQUEST_METHOD: `GET` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:53:29.068876 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d734ed7-cdb6-476c-8b8c-d7d6023f68dd None admin] SCRIPT_NAME: `/identity` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:53:29.069148 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d734ed7-cdb6-476c-8b8c-d7d6023f68dd None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:53:29.075127 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG dbcounter [-] [352329] Writing DB stats keystone:SELECT=100 {{(pid=352329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:53:29.082576 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aade153-71da-4475-afec-789a01943f5e None admin] Validating token access rules against request {{(pid=352329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:53:29.098678 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d734ed7-cdb6-476c-8b8c-d7d6023f68dd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 08:53:29.103895 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application [None req-9d734ed7-cdb6-476c-8b8c-d7d6023f68dd None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 28 08:53:29.103895 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:53:29.103895 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:53:29.103895 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:53:29.103895 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:53:29.103895 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:53:29.103895 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:53:29.103895 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:53:29.103895 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:53:29.103895 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:53:29.103895 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:53:29.103895 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:53:29.103895 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 08:53:29.103895 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 08:53:29.103895 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 08:53:29.103895 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 08:53:29.105139 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 08:53:29.105139 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 08:53:29.105139 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 08:53:29.105139 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 08:53:29.105139 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:53:29.105139 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:53:29.105139 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:53:29.105139 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:53:29.105139 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:53:29.105139 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:53:29.105139 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:53:29.105139 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application with Lock( Jul 28 08:53:29.105139 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:53:29.105139 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:53:29.105139 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:53:29.105139 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:53:29.106181 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:53:29.106181 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:53:29.106181 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:53:29.106181 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:53:29.106181 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 08:53:29.106181 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 08:53:29.106181 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 08:53:29.106181 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 08:53:29.106181 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 08:53:29.106181 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 08:53:29.106181 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 28 08:53:29.106181 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application Jul 28 08:53:29.107470 dv-cinder-851351-1-smb devstack@keystone.service[352328]: [pid: 352328|app: 0|req: 189/386] 10.222.0.42 () {56 vars in 1114 bytes} [Thu Jul 28 08:53:28 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:53:29.111903 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d734ed7-cdb6-476c-8b8c-d7d6023f68dd None admin] Authenticating user token {{(pid=352328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:53:29.156115 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a018eab-b6cf-48c3-b038-247e28ae5c7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:53:29.156820 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a018eab-b6cf-48c3-b038-247e28ae5c7a None admin] REQUEST_METHOD: `GET` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:53:29.157111 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a018eab-b6cf-48c3-b038-247e28ae5c7a None admin] SCRIPT_NAME: `/identity` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:53:29.157397 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a018eab-b6cf-48c3-b038-247e28ae5c7a None admin] PATH_INFO: `/v3/roles` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:53:29.158226 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a018eab-b6cf-48c3-b038-247e28ae5c7a None admin] RBAC: Adding query filter params (name=member) {{(pid=352329) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:53:29.158536 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a018eab-b6cf-48c3-b038-247e28ae5c7a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:53:29.160182 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a018eab-b6cf-48c3-b038-247e28ae5c7a None admin] RBAC: Authorization granted {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:53:29.175922 dv-cinder-851351-1-smb devstack@keystone.service[352329]: [pid: 352329|app: 0|req: 198/387] 10.222.0.42 () {56 vars in 1101 bytes} [Thu Jul 28 08:53:28 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:53:29.181663 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a018eab-b6cf-48c3-b038-247e28ae5c7a None admin] Authenticating user token {{(pid=352329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:53:29.231945 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG dbcounter [-] [352328] Writing DB stats keystone:SELECT=100 {{(pid=352328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:53:29.241827 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d734ed7-cdb6-476c-8b8c-d7d6023f68dd None admin] Validating token access rules against request {{(pid=352328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:53:29.280691 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8dbcc11-fbc4-4677-8d06-7a6869c1b0fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:53:29.280691 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8dbcc11-fbc4-4677-8d06-7a6869c1b0fb None admin] REQUEST_METHOD: `GET` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:53:29.280691 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8dbcc11-fbc4-4677-8d06-7a6869c1b0fb None admin] SCRIPT_NAME: `/identity` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:53:29.280691 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8dbcc11-fbc4-4677-8d06-7a6869c1b0fb None admin] PATH_INFO: `/v3/roles` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:53:29.281265 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8dbcc11-fbc4-4677-8d06-7a6869c1b0fb None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=352328) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:53:29.281265 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8dbcc11-fbc4-4677-8d06-7a6869c1b0fb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:53:29.281896 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8dbcc11-fbc4-4677-8d06-7a6869c1b0fb None admin] RBAC: Authorization granted {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:53:29.292342 dv-cinder-851351-1-smb devstack@keystone.service[352328]: [pid: 352328|app: 0|req: 190/388] 10.222.0.42 () {56 vars in 1111 bytes} [Thu Jul 28 08:53:29 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:53:29.301796 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8dbcc11-fbc4-4677-8d06-7a6869c1b0fb None admin] Authenticating user token {{(pid=352328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:53:29.360942 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a018eab-b6cf-48c3-b038-247e28ae5c7a None admin] Validating token access rules against request {{(pid=352329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:53:29.407293 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8dbcc11-fbc4-4677-8d06-7a6869c1b0fb None admin] Validating token access rules against request {{(pid=352328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:53:29.424334 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb25f37-4954-4d60-94ef-6ca1ec8e599e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:53:29.425329 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb25f37-4954-4d60-94ef-6ca1ec8e599e None admin] REQUEST_METHOD: `GET` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:53:29.425797 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb25f37-4954-4d60-94ef-6ca1ec8e599e None admin] SCRIPT_NAME: `/identity` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:53:29.426305 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb25f37-4954-4d60-94ef-6ca1ec8e599e None admin] PATH_INFO: `/v3/groups/313e220fa1e24b3c975e71a69928a850` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:53:29.427665 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb25f37-4954-4d60-94ef-6ca1ec8e599e None admin] RBAC: Authorizing `identity:get_group(group_id=313e220fa1e24b3c975e71a69928a850)` {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:53:29.429353 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb25f37-4954-4d60-94ef-6ca1ec8e599e None admin] RBAC: Authorization granted {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:53:29.437084 dv-cinder-851351-1-smb devstack@keystone.service[352329]: [pid: 352329|app: 0|req: 199/389] 10.222.0.42 () {56 vars in 1180 bytes} [Thu Jul 28 08:53:29 2022] GET /identity/v3/groups/313e220fa1e24b3c975e71a69928a850 => generated 226 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 08:53:29.438205 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb25f37-4954-4d60-94ef-6ca1ec8e599e None admin] Authenticating user token {{(pid=352329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:53:29.448026 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81eb42fa-51a6-4db0-bbd6-8dbee2cf6553 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:53:29.449006 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81eb42fa-51a6-4db0-bbd6-8dbee2cf6553 None admin] REQUEST_METHOD: `GET` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:53:29.450505 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81eb42fa-51a6-4db0-bbd6-8dbee2cf6553 None admin] SCRIPT_NAME: `/identity` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:53:29.450786 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81eb42fa-51a6-4db0-bbd6-8dbee2cf6553 None admin] PATH_INFO: `/v3/groups/313e220fa1e24b3c975e71a69928a850` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:53:29.452413 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81eb42fa-51a6-4db0-bbd6-8dbee2cf6553 None admin] RBAC: Authorizing `identity:get_group(group_id=313e220fa1e24b3c975e71a69928a850)` {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:53:29.456036 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81eb42fa-51a6-4db0-bbd6-8dbee2cf6553 None admin] RBAC: Authorization granted {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:53:29.457757 dv-cinder-851351-1-smb devstack@keystone.service[352328]: [pid: 352328|app: 0|req: 191/390] 10.222.0.42 () {56 vars in 1180 bytes} [Thu Jul 28 08:53:29 2022] GET /identity/v3/groups/313e220fa1e24b3c975e71a69928a850 => generated 226 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 08:53:29.463528 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81eb42fa-51a6-4db0-bbd6-8dbee2cf6553 None admin] Authenticating user token {{(pid=352328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:53:29.501091 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG dbcounter [-] [352329] Writing DB stats keystone:SELECT=100 {{(pid=352329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:53:29.521034 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG dbcounter [-] [352328] Writing DB stats keystone:SELECT=100 {{(pid=352328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:53:29.601987 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb25f37-4954-4d60-94ef-6ca1ec8e599e None admin] Validating token access rules against request {{(pid=352329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:53:29.642083 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8882e59-fd0f-40a9-8cdf-8ec4cf498420 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:53:29.642752 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8882e59-fd0f-40a9-8cdf-8ec4cf498420 None admin] REQUEST_METHOD: `GET` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:53:29.643034 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8882e59-fd0f-40a9-8cdf-8ec4cf498420 None admin] SCRIPT_NAME: `/identity` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:53:29.643309 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8882e59-fd0f-40a9-8cdf-8ec4cf498420 None admin] PATH_INFO: `/v3/projects/9af593aec02c450aa4ce9c48ff4c6a1f` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:53:29.644515 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8882e59-fd0f-40a9-8cdf-8ec4cf498420 None admin] RBAC: Authorizing `identity:get_project(project_id=9af593aec02c450aa4ce9c48ff4c6a1f)` {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:53:29.646474 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8882e59-fd0f-40a9-8cdf-8ec4cf498420 None admin] RBAC: Authorization granted {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:53:29.649780 dv-cinder-851351-1-smb devstack@keystone.service[352329]: [pid: 352329|app: 0|req: 200/391] 10.222.0.42 () {56 vars in 1186 bytes} [Thu Jul 28 08:53:29 2022] GET /identity/v3/projects/9af593aec02c450aa4ce9c48ff4c6a1f => generated 298 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:53:29.656508 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8882e59-fd0f-40a9-8cdf-8ec4cf498420 None admin] Authenticating user token {{(pid=352329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:53:29.691097 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81eb42fa-51a6-4db0-bbd6-8dbee2cf6553 None admin] Validating token access rules against request {{(pid=352328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:53:29.758481 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d99e11-83af-4d1d-90a0-9b1e25e823ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:53:29.759149 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d99e11-83af-4d1d-90a0-9b1e25e823ea None admin] REQUEST_METHOD: `GET` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:53:29.759429 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d99e11-83af-4d1d-90a0-9b1e25e823ea None admin] SCRIPT_NAME: `/identity` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:53:29.759699 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d99e11-83af-4d1d-90a0-9b1e25e823ea None admin] PATH_INFO: `/v3/projects/9af593aec02c450aa4ce9c48ff4c6a1f` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:53:29.760943 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d99e11-83af-4d1d-90a0-9b1e25e823ea None admin] RBAC: Authorizing `identity:get_project(project_id=9af593aec02c450aa4ce9c48ff4c6a1f)` {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:53:29.762405 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d99e11-83af-4d1d-90a0-9b1e25e823ea None admin] RBAC: Authorization granted {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:53:29.764310 dv-cinder-851351-1-smb devstack@keystone.service[352328]: [pid: 352328|app: 0|req: 192/392] 10.222.0.42 () {56 vars in 1186 bytes} [Thu Jul 28 08:53:29 2022] GET /identity/v3/projects/9af593aec02c450aa4ce9c48ff4c6a1f => generated 298 bytes in 301 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 08:53:29.771323 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d99e11-83af-4d1d-90a0-9b1e25e823ea None admin] Authenticating user token {{(pid=352328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:53:29.858394 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG dbcounter [-] [352329] Writing DB stats keystone:SELECT=100 {{(pid=352329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:53:29.868018 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8882e59-fd0f-40a9-8cdf-8ec4cf498420 None admin] Validating token access rules against request {{(pid=352329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:53:29.952685 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee566d18-4393-4ba9-bc8e-b787d2064eac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:53:29.953320 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee566d18-4393-4ba9-bc8e-b787d2064eac None admin] REQUEST_METHOD: `PUT` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:53:29.953598 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee566d18-4393-4ba9-bc8e-b787d2064eac None admin] SCRIPT_NAME: `/identity` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:53:29.953874 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee566d18-4393-4ba9-bc8e-b787d2064eac None admin] PATH_INFO: `/v3/projects/9af593aec02c450aa4ce9c48ff4c6a1f/groups/313e220fa1e24b3c975e71a69928a850/roles/16a3fc3aca974c47a329c2781b0be93a` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:53:29.957695 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee566d18-4393-4ba9-bc8e-b787d2064eac None admin] RBAC: Authorizing `identity:create_grant(project_id=9af593aec02c450aa4ce9c48ff4c6a1f, group_id=313e220fa1e24b3c975e71a69928a850, role_id=16a3fc3aca974c47a329c2781b0be93a)` {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:53:29.959297 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee566d18-4393-4ba9-bc8e-b787d2064eac None admin] RBAC: Authorization granted {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:53:29.977025 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG dbcounter [-] [352328] Writing DB stats keystone:SELECT=100 {{(pid=352328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:53:29.983540 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d99e11-83af-4d1d-90a0-9b1e25e823ea None admin] Validating token access rules against request {{(pid=352328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:53:29.994237 dv-cinder-851351-1-smb devstack@keystone.service[352329]: [pid: 352329|app: 0|req: 201/393] 10.222.0.42 () {58 vars in 1442 bytes} [Thu Jul 28 08:53:29 2022] PUT /identity/v3/projects/9af593aec02c450aa4ce9c48ff4c6a1f/groups/313e220fa1e24b3c975e71a69928a850/roles/16a3fc3aca974c47a329c2781b0be93a => generated 0 bytes in 339 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 28 08:53:30.039855 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753f25f8-40ba-4fb9-9348-ebb7e0edff78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:53:30.040568 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753f25f8-40ba-4fb9-9348-ebb7e0edff78 None admin] REQUEST_METHOD: `PUT` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:53:30.040883 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753f25f8-40ba-4fb9-9348-ebb7e0edff78 None admin] SCRIPT_NAME: `/identity` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:53:30.041158 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753f25f8-40ba-4fb9-9348-ebb7e0edff78 None admin] PATH_INFO: `/v3/projects/9af593aec02c450aa4ce9c48ff4c6a1f/groups/313e220fa1e24b3c975e71a69928a850/roles/a4fa43cd6d914398a0790a1516c83d08` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:53:30.046679 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-753f25f8-40ba-4fb9-9348-ebb7e0edff78 None admin] RBAC: Authorizing `identity:create_grant(project_id=9af593aec02c450aa4ce9c48ff4c6a1f, group_id=313e220fa1e24b3c975e71a69928a850, role_id=a4fa43cd6d914398a0790a1516c83d08)` {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:53:30.048233 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-753f25f8-40ba-4fb9-9348-ebb7e0edff78 None admin] RBAC: Authorization granted {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:53:30.076814 dv-cinder-851351-1-smb devstack@keystone.service[352328]: [pid: 352328|app: 0|req: 193/394] 10.222.0.42 () {58 vars in 1442 bytes} [Thu Jul 28 08:53:29 2022] PUT /identity/v3/projects/9af593aec02c450aa4ce9c48ff4c6a1f/groups/313e220fa1e24b3c975e71a69928a850/roles/a4fa43cd6d914398a0790a1516c83d08 => generated 0 bytes in 306 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 08:53:30.865853 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd3ef62-c272-43d3-a52a-1b73f6cfd3fb None None] REQUEST_METHOD: `GET` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:53:30.866448 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd3ef62-c272-43d3-a52a-1b73f6cfd3fb None None] SCRIPT_NAME: `/identity` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:53:30.866448 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd3ef62-c272-43d3-a52a-1b73f6cfd3fb None None] PATH_INFO: `/` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:53:30.868046 dv-cinder-851351-1-smb devstack@keystone.service[352329]: [pid: 352329|app: 0|req: 202/395] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 08:53:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 08:53:30.873599 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57dcbf2-1f8a-4737-b0c6-d4b710fde8d1 None None] REQUEST_METHOD: `POST` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:53:30.873906 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57dcbf2-1f8a-4737-b0c6-d4b710fde8d1 None None] SCRIPT_NAME: `/identity` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:53:30.874166 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57dcbf2-1f8a-4737-b0c6-d4b710fde8d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:53:30.901714 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.auth.core [None req-d57dcbf2-1f8a-4737-b0c6-d4b710fde8d1 None None] MFA Rules not processed for user `d18c063b2377412485965357671e5506`. Rule list: `[]` (Enabled: `True`). {{(pid=352328) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 08:53:30.902953 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.fernet_utils [None req-d57dcbf2-1f8a-4737-b0c6-d4b710fde8d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=352328) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:53:30.980205 dv-cinder-851351-1-smb devstack@keystone.service[352328]: [pid: 352328|app: 0|req: 194/396] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 08:53:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 28 08:53:31.002832 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc25afc-4c1d-4ab8-b7b5-cd07bfef764f None None] REQUEST_METHOD: `GET` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:53:31.003185 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc25afc-4c1d-4ab8-b7b5-cd07bfef764f None None] SCRIPT_NAME: `/identity` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:53:31.003404 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc25afc-4c1d-4ab8-b7b5-cd07bfef764f None None] PATH_INFO: `/` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:53:31.004825 dv-cinder-851351-1-smb devstack@keystone.service[352329]: [pid: 352329|app: 0|req: 203/397] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 08:53:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 08:53:31.014047 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25efb2fe-5829-42b8-ada1-4e2ae2dcea93 None None] REQUEST_METHOD: `POST` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:53:31.014404 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25efb2fe-5829-42b8-ada1-4e2ae2dcea93 None None] SCRIPT_NAME: `/identity` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:53:31.014632 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25efb2fe-5829-42b8-ada1-4e2ae2dcea93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:53:31.027815 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc25afc-4c1d-4ab8-b7b5-cd07bfef764f None None] Authenticating user token {{(pid=352329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:53:31.064701 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.auth.core [None req-25efb2fe-5829-42b8-ada1-4e2ae2dcea93 None None] MFA Rules not processed for user `d18c063b2377412485965357671e5506`. Rule list: `[]` (Enabled: `True`). {{(pid=352328) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 08:53:31.065933 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.fernet_utils [None req-25efb2fe-5829-42b8-ada1-4e2ae2dcea93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=352328) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:53:31.192601 dv-cinder-851351-1-smb devstack@keystone.service[352328]: [pid: 352328|app: 0|req: 195/398] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 08:53:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 28 08:53:31.198793 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc25afc-4c1d-4ab8-b7b5-cd07bfef764f None None] Validating token access rules against request {{(pid=352329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:53:31.224699 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25efb2fe-5829-42b8-ada1-4e2ae2dcea93 None None] Authenticating user token {{(pid=352328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:53:31.247178 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7503577a-97d7-41cf-8131-126da60e23f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:53:31.247178 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7503577a-97d7-41cf-8131-126da60e23f3 None admin] REQUEST_METHOD: `GET` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:53:31.247178 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7503577a-97d7-41cf-8131-126da60e23f3 None admin] SCRIPT_NAME: `/identity` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:53:31.247178 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7503577a-97d7-41cf-8131-126da60e23f3 None admin] PATH_INFO: `/v3/roles/member` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:53:31.249774 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG dbcounter [-] [352328] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=352328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:53:31.259662 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7503577a-97d7-41cf-8131-126da60e23f3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 08:53:31.265469 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application [None req-7503577a-97d7-41cf-8131-126da60e23f3 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 28 08:53:31.265469 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:53:31.265469 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:53:31.265469 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:53:31.265469 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:53:31.265469 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:53:31.265469 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:53:31.265469 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:53:31.265469 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:53:31.265469 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:53:31.265469 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:53:31.265469 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:53:31.265469 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 08:53:31.265469 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 08:53:31.265469 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 08:53:31.265469 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 08:53:31.266626 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 08:53:31.266626 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 08:53:31.266626 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 08:53:31.266626 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 08:53:31.266626 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:53:31.266626 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:53:31.266626 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:53:31.266626 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:53:31.266626 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:53:31.266626 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:53:31.266626 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:53:31.266626 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application with Lock( Jul 28 08:53:31.266626 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:53:31.266626 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:53:31.266626 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:53:31.266626 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:53:31.267890 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:53:31.267890 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:53:31.267890 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:53:31.267890 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:53:31.267890 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 08:53:31.267890 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 08:53:31.267890 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 08:53:31.267890 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 08:53:31.267890 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 08:53:31.267890 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 08:53:31.267890 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 28 08:53:31.267890 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application Jul 28 08:53:31.267890 dv-cinder-851351-1-smb devstack@keystone.service[352329]: [pid: 352329|app: 0|req: 204/399] 10.222.0.42 () {56 vars in 1099 bytes} [Thu Jul 28 08:53:31 2022] GET /identity/v3/roles/member => generated 84 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:53:31.273669 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7503577a-97d7-41cf-8131-126da60e23f3 None admin] Authenticating user token {{(pid=352329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:53:31.304384 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG dbcounter [-] [352329] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=352329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:53:31.402489 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25efb2fe-5829-42b8-ada1-4e2ae2dcea93 None None] Validating token access rules against request {{(pid=352328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:53:31.440695 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29be09f-93b4-4dc7-94e9-6a48de3a0ffe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:53:31.441372 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29be09f-93b4-4dc7-94e9-6a48de3a0ffe None admin] REQUEST_METHOD: `GET` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:53:31.441652 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29be09f-93b4-4dc7-94e9-6a48de3a0ffe None admin] SCRIPT_NAME: `/identity` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:53:31.442210 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29be09f-93b4-4dc7-94e9-6a48de3a0ffe None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:53:31.454868 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e29be09f-93b4-4dc7-94e9-6a48de3a0ffe None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 08:53:31.459853 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application [None req-e29be09f-93b4-4dc7-94e9-6a48de3a0ffe None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 28 08:53:31.459853 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:53:31.459853 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:53:31.459853 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:53:31.459853 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:53:31.459853 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:53:31.459853 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:53:31.459853 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:53:31.459853 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:53:31.459853 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:53:31.459853 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:53:31.459853 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:53:31.459853 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 08:53:31.459853 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 08:53:31.459853 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 08:53:31.459853 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 08:53:31.460992 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 08:53:31.460992 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 08:53:31.460992 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 08:53:31.460992 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 08:53:31.460992 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:53:31.460992 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:53:31.460992 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:53:31.460992 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:53:31.460992 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:53:31.460992 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:53:31.460992 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:53:31.460992 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application with Lock( Jul 28 08:53:31.460992 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:53:31.460992 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:53:31.460992 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:53:31.460992 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:53:31.462758 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:53:31.462758 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:53:31.462758 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:53:31.462758 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:53:31.462758 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 08:53:31.462758 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 08:53:31.462758 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 08:53:31.462758 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 08:53:31.462758 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 08:53:31.462758 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 08:53:31.462758 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 28 08:53:31.462758 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application Jul 28 08:53:31.462758 dv-cinder-851351-1-smb devstack@keystone.service[352328]: [pid: 352328|app: 0|req: 196/400] 10.222.0.42 () {56 vars in 1114 bytes} [Thu Jul 28 08:53:31 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 08:53:31.466844 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29be09f-93b4-4dc7-94e9-6a48de3a0ffe None admin] Authenticating user token {{(pid=352328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:53:31.478870 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7503577a-97d7-41cf-8131-126da60e23f3 None admin] Validating token access rules against request {{(pid=352329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:53:31.547633 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG dbcounter [-] [352328] Writing DB stats keystone:SELECT=100 {{(pid=352328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:53:31.568143 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731ca4c1-eccf-42fa-a117-92e81a5cf1e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:53:31.569538 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731ca4c1-eccf-42fa-a117-92e81a5cf1e3 None admin] REQUEST_METHOD: `GET` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:53:31.570284 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731ca4c1-eccf-42fa-a117-92e81a5cf1e3 None admin] SCRIPT_NAME: `/identity` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:53:31.570744 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731ca4c1-eccf-42fa-a117-92e81a5cf1e3 None admin] PATH_INFO: `/v3/roles` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:53:31.571826 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-731ca4c1-eccf-42fa-a117-92e81a5cf1e3 None admin] RBAC: Adding query filter params (name=member) {{(pid=352329) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:53:31.572335 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-731ca4c1-eccf-42fa-a117-92e81a5cf1e3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:53:31.574384 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-731ca4c1-eccf-42fa-a117-92e81a5cf1e3 None admin] RBAC: Authorization granted {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:53:31.583131 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29be09f-93b4-4dc7-94e9-6a48de3a0ffe None admin] Validating token access rules against request {{(pid=352328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:53:31.584403 dv-cinder-851351-1-smb devstack@keystone.service[352329]: [pid: 352329|app: 0|req: 205/401] 10.222.0.42 () {56 vars in 1101 bytes} [Thu Jul 28 08:53:31 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 311 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:53:31.585981 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c230e8ca-ccfa-4403-830e-bbb3254b31bb None None] REQUEST_METHOD: `GET` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:53:31.586271 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c230e8ca-ccfa-4403-830e-bbb3254b31bb None None] SCRIPT_NAME: `/identity` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:53:31.586556 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c230e8ca-ccfa-4403-830e-bbb3254b31bb None None] PATH_INFO: `/` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:53:31.588103 dv-cinder-851351-1-smb devstack@keystone.service[352329]: [pid: 352329|app: 0|req: 206/402] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 08:53:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 08:53:31.594535 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c230e8ca-ccfa-4403-830e-bbb3254b31bb None None] Authenticating user token {{(pid=352329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:53:31.627268 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f06c242b-3afa-4215-826e-03450c9a5e80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:53:31.628438 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06c242b-3afa-4215-826e-03450c9a5e80 None admin] REQUEST_METHOD: `GET` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:53:31.628973 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06c242b-3afa-4215-826e-03450c9a5e80 None admin] SCRIPT_NAME: `/identity` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:53:31.629490 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06c242b-3afa-4215-826e-03450c9a5e80 None admin] PATH_INFO: `/v3/roles` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:53:31.631261 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f06c242b-3afa-4215-826e-03450c9a5e80 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=352328) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:53:31.632139 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f06c242b-3afa-4215-826e-03450c9a5e80 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:53:31.634244 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f06c242b-3afa-4215-826e-03450c9a5e80 None admin] RBAC: Authorization granted {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:53:31.646448 dv-cinder-851351-1-smb devstack@keystone.service[352328]: [pid: 352328|app: 0|req: 197/403] 10.222.0.42 () {56 vars in 1111 bytes} [Thu Jul 28 08:53:31 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:53:31.648255 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a497c3-a4ed-4676-8f8c-38c307c21837 None None] REQUEST_METHOD: `POST` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:53:31.648789 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a497c3-a4ed-4676-8f8c-38c307c21837 None None] SCRIPT_NAME: `/identity` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:53:31.649306 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a497c3-a4ed-4676-8f8c-38c307c21837 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:53:31.676962 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.auth.core [None req-90a497c3-a4ed-4676-8f8c-38c307c21837 None None] MFA Rules not processed for user `d18c063b2377412485965357671e5506`. Rule list: `[]` (Enabled: `True`). {{(pid=352328) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 08:53:31.679158 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.fernet_utils [None req-90a497c3-a4ed-4676-8f8c-38c307c21837 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=352328) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:53:31.706656 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG dbcounter [-] [352329] Writing DB stats keystone:SELECT=100 {{(pid=352329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:53:31.736334 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c230e8ca-ccfa-4403-830e-bbb3254b31bb None None] Validating token access rules against request {{(pid=352329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:53:31.775149 dv-cinder-851351-1-smb devstack@keystone.service[352328]: [pid: 352328|app: 0|req: 198/404] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 08:53:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 08:53:31.776493 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a497c3-a4ed-4676-8f8c-38c307c21837 None None] Authenticating user token {{(pid=352328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:53:31.791122 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e72762d-452b-4d33-8bc8-7d75164291a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:53:31.792148 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e72762d-452b-4d33-8bc8-7d75164291a7 None admin] REQUEST_METHOD: `GET` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:53:31.792963 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e72762d-452b-4d33-8bc8-7d75164291a7 None admin] SCRIPT_NAME: `/identity` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:53:31.794420 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e72762d-452b-4d33-8bc8-7d75164291a7 None admin] PATH_INFO: `/v3/groups/313e220fa1e24b3c975e71a69928a850` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:53:31.796031 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e72762d-452b-4d33-8bc8-7d75164291a7 None admin] RBAC: Authorizing `identity:get_group(group_id=313e220fa1e24b3c975e71a69928a850)` {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:53:31.798389 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e72762d-452b-4d33-8bc8-7d75164291a7 None admin] RBAC: Authorization granted {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:53:31.801965 dv-cinder-851351-1-smb devstack@keystone.service[352329]: [pid: 352329|app: 0|req: 207/405] 10.222.0.42 () {56 vars in 1180 bytes} [Thu Jul 28 08:53:31 2022] GET /identity/v3/groups/313e220fa1e24b3c975e71a69928a850 => generated 226 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:53:31.803033 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e72762d-452b-4d33-8bc8-7d75164291a7 None admin] Authenticating user token {{(pid=352329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:53:31.859294 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG dbcounter [-] [352328] Writing DB stats keystone:SELECT=100 {{(pid=352328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:53:31.900916 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a497c3-a4ed-4676-8f8c-38c307c21837 None None] Validating token access rules against request {{(pid=352328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:53:31.905506 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e72762d-452b-4d33-8bc8-7d75164291a7 None admin] Validating token access rules against request {{(pid=352329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:53:31.940903 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-908314a8-1304-418e-8c15-40f19ec22bf8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:53:31.941976 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908314a8-1304-418e-8c15-40f19ec22bf8 None admin] REQUEST_METHOD: `GET` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:53:31.942470 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908314a8-1304-418e-8c15-40f19ec22bf8 None admin] SCRIPT_NAME: `/identity` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:53:31.942954 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908314a8-1304-418e-8c15-40f19ec22bf8 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:53:31.943256 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a12cc9-fdcd-4b71-a135-c8d3decb7953 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:53:31.944228 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a12cc9-fdcd-4b71-a135-c8d3decb7953 None admin] REQUEST_METHOD: `GET` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:53:31.944520 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a12cc9-fdcd-4b71-a135-c8d3decb7953 None admin] SCRIPT_NAME: `/identity` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:53:31.944866 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a12cc9-fdcd-4b71-a135-c8d3decb7953 None admin] PATH_INFO: `/v3/groups/313e220fa1e24b3c975e71a69928a850` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:53:31.946184 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07a12cc9-fdcd-4b71-a135-c8d3decb7953 None admin] RBAC: Authorizing `identity:get_group(group_id=313e220fa1e24b3c975e71a69928a850)` {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:53:31.947784 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07a12cc9-fdcd-4b71-a135-c8d3decb7953 None admin] RBAC: Authorization granted {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:53:31.954981 dv-cinder-851351-1-smb devstack@keystone.service[352328]: [pid: 352328|app: 0|req: 199/406] 10.222.0.42 () {56 vars in 1180 bytes} [Thu Jul 28 08:53:31 2022] GET /identity/v3/groups/313e220fa1e24b3c975e71a69928a850 => generated 226 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:53:31.955934 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a12cc9-fdcd-4b71-a135-c8d3decb7953 None admin] Authenticating user token {{(pid=352328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:53:31.961048 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-908314a8-1304-418e-8c15-40f19ec22bf8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 08:53:31.967155 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application [None req-908314a8-1304-418e-8c15-40f19ec22bf8 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 08:53:31.967155 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:53:31.967155 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:53:31.967155 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:53:31.967155 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:53:31.967155 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:53:31.967155 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:53:31.967155 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:53:31.967155 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:53:31.967155 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:53:31.967155 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:53:31.967155 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:53:31.967155 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 08:53:31.967155 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 08:53:31.967155 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 08:53:31.967155 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 08:53:31.968296 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 08:53:31.968296 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 08:53:31.968296 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 08:53:31.968296 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 08:53:31.968296 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:53:31.968296 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:53:31.968296 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:53:31.968296 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:53:31.968296 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:53:31.968296 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:53:31.968296 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:53:31.968296 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application with Lock( Jul 28 08:53:31.968296 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:53:31.968296 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:53:31.968296 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:53:31.968296 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:53:31.969434 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:53:31.969434 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:53:31.969434 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:53:31.969434 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:53:31.969434 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 08:53:31.969434 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 08:53:31.969434 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 08:53:31.969434 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 08:53:31.969434 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 08:53:31.969434 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 08:53:31.969434 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 08:53:31.969434 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application Jul 28 08:53:31.972315 dv-cinder-851351-1-smb devstack@keystone.service[352329]: [pid: 352329|app: 0|req: 208/407] 10.222.0.42 () {56 vars in 1096 bytes} [Thu Jul 28 08:53:31 2022] GET /identity/v3/roles/admin => generated 83 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:53:31.973401 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-908314a8-1304-418e-8c15-40f19ec22bf8 None admin] Authenticating user token {{(pid=352329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:53:31.988021 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG dbcounter [-] [352329] Writing DB stats keystone:SELECT=100 {{(pid=352329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:53:32.094155 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a12cc9-fdcd-4b71-a135-c8d3decb7953 None admin] Validating token access rules against request {{(pid=352328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:53:32.114912 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-908314a8-1304-418e-8c15-40f19ec22bf8 None admin] Validating token access rules against request {{(pid=352329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:53:32.127711 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG dbcounter [-] [352328] Writing DB stats keystone:SELECT=100 {{(pid=352328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:53:32.136457 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6f1bc7-26cd-44b7-90af-6d2c4ac41fe1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:53:32.137527 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6f1bc7-26cd-44b7-90af-6d2c4ac41fe1 None admin] REQUEST_METHOD: `GET` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:53:32.137815 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6f1bc7-26cd-44b7-90af-6d2c4ac41fe1 None admin] SCRIPT_NAME: `/identity` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:53:32.138091 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6f1bc7-26cd-44b7-90af-6d2c4ac41fe1 None admin] PATH_INFO: `/v3/projects/be5ef7d0266e453784a39d297f9b131d` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:53:32.139276 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d6f1bc7-26cd-44b7-90af-6d2c4ac41fe1 None admin] RBAC: Authorizing `identity:get_project(project_id=be5ef7d0266e453784a39d297f9b131d)` {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:53:32.140760 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d6f1bc7-26cd-44b7-90af-6d2c4ac41fe1 None admin] RBAC: Authorization granted {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:53:32.144822 dv-cinder-851351-1-smb devstack@keystone.service[352328]: [pid: 352328|app: 0|req: 200/408] 10.222.0.42 () {56 vars in 1186 bytes} [Thu Jul 28 08:53:31 2022] GET /identity/v3/projects/be5ef7d0266e453784a39d297f9b131d => generated 302 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:53:32.145877 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6f1bc7-26cd-44b7-90af-6d2c4ac41fe1 None admin] Authenticating user token {{(pid=352328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:53:32.161796 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b005a7-8e1b-44af-82a1-1441cb380252 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:53:32.163020 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b005a7-8e1b-44af-82a1-1441cb380252 None admin] REQUEST_METHOD: `GET` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:53:32.163523 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b005a7-8e1b-44af-82a1-1441cb380252 None admin] SCRIPT_NAME: `/identity` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:53:32.164072 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b005a7-8e1b-44af-82a1-1441cb380252 None admin] PATH_INFO: `/v3/projects/be5ef7d0266e453784a39d297f9b131d` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:53:32.165593 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3b005a7-8e1b-44af-82a1-1441cb380252 None admin] RBAC: Authorizing `identity:get_project(project_id=be5ef7d0266e453784a39d297f9b131d)` {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:53:32.167579 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3b005a7-8e1b-44af-82a1-1441cb380252 None admin] RBAC: Authorization granted {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:53:32.170052 dv-cinder-851351-1-smb devstack@keystone.service[352329]: [pid: 352329|app: 0|req: 209/409] 10.222.0.42 () {56 vars in 1186 bytes} [Thu Jul 28 08:53:31 2022] GET /identity/v3/projects/be5ef7d0266e453784a39d297f9b131d => generated 302 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:53:32.171358 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b005a7-8e1b-44af-82a1-1441cb380252 None admin] Authenticating user token {{(pid=352329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:53:32.283454 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG dbcounter [-] [352329] Writing DB stats keystone:SELECT=100 {{(pid=352329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:53:32.290340 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6f1bc7-26cd-44b7-90af-6d2c4ac41fe1 None admin] Validating token access rules against request {{(pid=352328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:53:32.319079 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b005a7-8e1b-44af-82a1-1441cb380252 None admin] Validating token access rules against request {{(pid=352329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:53:32.341874 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d9a7073-6e69-457e-8f12-9b2f91d09da6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:53:32.342930 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9a7073-6e69-457e-8f12-9b2f91d09da6 None admin] REQUEST_METHOD: `GET` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:53:32.343431 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9a7073-6e69-457e-8f12-9b2f91d09da6 None admin] SCRIPT_NAME: `/identity` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:53:32.343928 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9a7073-6e69-457e-8f12-9b2f91d09da6 None admin] PATH_INFO: `/v3/roles` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:53:32.345137 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d9a7073-6e69-457e-8f12-9b2f91d09da6 None admin] RBAC: Adding query filter params (name=admin) {{(pid=352328) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:53:32.345686 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d9a7073-6e69-457e-8f12-9b2f91d09da6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:53:32.347379 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d9a7073-6e69-457e-8f12-9b2f91d09da6 None admin] RBAC: Authorization granted {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:53:32.357633 dv-cinder-851351-1-smb devstack@keystone.service[352328]: [pid: 352328|app: 0|req: 201/410] 10.222.0.42 () {56 vars in 1099 bytes} [Thu Jul 28 08:53:32 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:53:32.358875 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d9a7073-6e69-457e-8f12-9b2f91d09da6 None admin] Authenticating user token {{(pid=352328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:53:32.370110 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157f461f-aa26-4fac-ac9a-5629ddb23f42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:53:32.370876 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157f461f-aa26-4fac-ac9a-5629ddb23f42 None admin] REQUEST_METHOD: `PUT` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:53:32.371163 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157f461f-aa26-4fac-ac9a-5629ddb23f42 None admin] SCRIPT_NAME: `/identity` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:53:32.371443 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157f461f-aa26-4fac-ac9a-5629ddb23f42 None admin] PATH_INFO: `/v3/projects/be5ef7d0266e453784a39d297f9b131d/groups/313e220fa1e24b3c975e71a69928a850/roles/16a3fc3aca974c47a329c2781b0be93a` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:53:32.374337 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-157f461f-aa26-4fac-ac9a-5629ddb23f42 None admin] RBAC: Authorizing `identity:create_grant(project_id=be5ef7d0266e453784a39d297f9b131d, group_id=313e220fa1e24b3c975e71a69928a850, role_id=16a3fc3aca974c47a329c2781b0be93a)` {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:53:32.375895 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-157f461f-aa26-4fac-ac9a-5629ddb23f42 None admin] RBAC: Authorization granted {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:53:32.396752 dv-cinder-851351-1-smb devstack@keystone.service[352329]: [pid: 352329|app: 0|req: 210/411] 10.222.0.42 () {58 vars in 1442 bytes} [Thu Jul 28 08:53:32 2022] PUT /identity/v3/projects/be5ef7d0266e453784a39d297f9b131d/groups/313e220fa1e24b3c975e71a69928a850/roles/16a3fc3aca974c47a329c2781b0be93a => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 08:53:32.398163 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157f461f-aa26-4fac-ac9a-5629ddb23f42 None admin] Authenticating user token {{(pid=352329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:53:32.482638 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG dbcounter [-] [352328] Writing DB stats keystone:SELECT=100 {{(pid=352328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:53:32.539482 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d9a7073-6e69-457e-8f12-9b2f91d09da6 None admin] Validating token access rules against request {{(pid=352328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:53:32.585207 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da8fea1-f1cb-4b51-a3bd-e7fe78807951 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:53:32.585914 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da8fea1-f1cb-4b51-a3bd-e7fe78807951 None admin] REQUEST_METHOD: `PUT` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:53:32.586194 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da8fea1-f1cb-4b51-a3bd-e7fe78807951 None admin] SCRIPT_NAME: `/identity` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:53:32.586468 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da8fea1-f1cb-4b51-a3bd-e7fe78807951 None admin] PATH_INFO: `/v3/projects/be5ef7d0266e453784a39d297f9b131d/groups/313e220fa1e24b3c975e71a69928a850/roles/a4fa43cd6d914398a0790a1516c83d08` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:53:32.589599 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6da8fea1-f1cb-4b51-a3bd-e7fe78807951 None admin] RBAC: Authorizing `identity:create_grant(project_id=be5ef7d0266e453784a39d297f9b131d, group_id=313e220fa1e24b3c975e71a69928a850, role_id=a4fa43cd6d914398a0790a1516c83d08)` {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:53:32.591347 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6da8fea1-f1cb-4b51-a3bd-e7fe78807951 None admin] RBAC: Authorization granted {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:53:32.610312 dv-cinder-851351-1-smb devstack@keystone.service[352328]: [pid: 352328|app: 0|req: 202/412] 10.222.0.42 () {58 vars in 1442 bytes} [Thu Jul 28 08:53:32 2022] PUT /identity/v3/projects/be5ef7d0266e453784a39d297f9b131d/groups/313e220fa1e24b3c975e71a69928a850/roles/a4fa43cd6d914398a0790a1516c83d08 => generated 0 bytes in 251 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 08:53:32.613603 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81c0092-1e84-45e1-ba88-939eb70fd747 None None] REQUEST_METHOD: `GET` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:53:32.613935 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81c0092-1e84-45e1-ba88-939eb70fd747 None None] SCRIPT_NAME: `/identity` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:53:32.614220 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81c0092-1e84-45e1-ba88-939eb70fd747 None None] PATH_INFO: `/` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:53:32.621687 dv-cinder-851351-1-smb devstack@keystone.service[352328]: [pid: 352328|app: 0|req: 203/413] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 08:53:32 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 08:53:32.623792 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f275b58c-9041-4eef-9f0c-26b196ed1001 None None] REQUEST_METHOD: `POST` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:53:32.624100 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f275b58c-9041-4eef-9f0c-26b196ed1001 None None] SCRIPT_NAME: `/identity` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:53:32.624355 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f275b58c-9041-4eef-9f0c-26b196ed1001 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:53:32.632806 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157f461f-aa26-4fac-ac9a-5629ddb23f42 None admin] Validating token access rules against request {{(pid=352329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:53:32.659623 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.auth.core [None req-f275b58c-9041-4eef-9f0c-26b196ed1001 None None] MFA Rules not processed for user `d18c063b2377412485965357671e5506`. Rule list: `[]` (Enabled: `True`). {{(pid=352328) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 08:53:32.661450 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.fernet_utils [None req-f275b58c-9041-4eef-9f0c-26b196ed1001 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=352328) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:53:32.680182 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82936ce4-684a-44c0-b05b-cbf7ca66c327 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:53:32.680916 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82936ce4-684a-44c0-b05b-cbf7ca66c327 None admin] REQUEST_METHOD: `GET` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:53:32.681250 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82936ce4-684a-44c0-b05b-cbf7ca66c327 None admin] SCRIPT_NAME: `/identity` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:53:32.681567 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82936ce4-684a-44c0-b05b-cbf7ca66c327 None admin] PATH_INFO: `/v3/groups/1bda7933e7cd46bb88eaf0bc55ad78c4` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:53:32.682810 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82936ce4-684a-44c0-b05b-cbf7ca66c327 None admin] RBAC: Authorizing `identity:get_group(group_id=1bda7933e7cd46bb88eaf0bc55ad78c4)` {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:53:32.684323 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82936ce4-684a-44c0-b05b-cbf7ca66c327 None admin] RBAC: Authorization granted {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:53:32.687319 dv-cinder-851351-1-smb devstack@keystone.service[352329]: [pid: 352329|app: 0|req: 211/414] 10.222.0.42 () {56 vars in 1180 bytes} [Thu Jul 28 08:53:32 2022] GET /identity/v3/groups/1bda7933e7cd46bb88eaf0bc55ad78c4 => generated 229 bytes in 289 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:53:32.700390 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82936ce4-684a-44c0-b05b-cbf7ca66c327 None admin] Authenticating user token {{(pid=352329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:53:32.700954 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG dbcounter [-] [352329] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=352329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:53:32.763684 dv-cinder-851351-1-smb devstack@keystone.service[352328]: [pid: 352328|app: 0|req: 204/415] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 08:53:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 28 08:53:32.765884 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad7a0f1-0144-47d2-b768-292c3edc683a None None] REQUEST_METHOD: `GET` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:53:32.766321 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad7a0f1-0144-47d2-b768-292c3edc683a None None] SCRIPT_NAME: `/identity` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:53:32.766721 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad7a0f1-0144-47d2-b768-292c3edc683a None None] PATH_INFO: `/` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:53:32.768733 dv-cinder-851351-1-smb devstack@keystone.service[352328]: [pid: 352328|app: 0|req: 205/416] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 08:53:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 08:53:32.774510 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d063b8-9e8f-427a-94a5-a7e7a455094c None None] REQUEST_METHOD: `POST` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:53:32.774836 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d063b8-9e8f-427a-94a5-a7e7a455094c None None] SCRIPT_NAME: `/identity` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:53:32.780712 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d063b8-9e8f-427a-94a5-a7e7a455094c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:53:32.794538 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.auth.core [None req-d0d063b8-9e8f-427a-94a5-a7e7a455094c None None] MFA Rules not processed for user `d18c063b2377412485965357671e5506`. Rule list: `[]` (Enabled: `True`). {{(pid=352328) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 08:53:32.795704 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.fernet_utils [None req-d0d063b8-9e8f-427a-94a5-a7e7a455094c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=352328) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:53:32.848913 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82936ce4-684a-44c0-b05b-cbf7ca66c327 None admin] Validating token access rules against request {{(pid=352329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:53:32.857061 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG dbcounter [-] [352328] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=352328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:53:32.879722 dv-cinder-851351-1-smb devstack@keystone.service[352328]: [pid: 352328|app: 0|req: 206/417] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 08:53:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 28 08:53:32.880867 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d063b8-9e8f-427a-94a5-a7e7a455094c None None] Authenticating user token {{(pid=352328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:53:32.898305 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1c2987-a3bf-4ae3-bbe6-b79b6be4c740 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:53:32.899049 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1c2987-a3bf-4ae3-bbe6-b79b6be4c740 None admin] REQUEST_METHOD: `GET` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:53:32.899383 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1c2987-a3bf-4ae3-bbe6-b79b6be4c740 None admin] SCRIPT_NAME: `/identity` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:53:32.899659 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1c2987-a3bf-4ae3-bbe6-b79b6be4c740 None admin] PATH_INFO: `/v3/projects/5c7af4b1c9fc4f35a95bbc0f95b044f2` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:53:32.901018 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec1c2987-a3bf-4ae3-bbe6-b79b6be4c740 None admin] RBAC: Authorizing `identity:get_project(project_id=5c7af4b1c9fc4f35a95bbc0f95b044f2)` {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:53:32.903313 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec1c2987-a3bf-4ae3-bbe6-b79b6be4c740 None admin] RBAC: Authorization granted {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:53:32.906045 dv-cinder-851351-1-smb devstack@keystone.service[352329]: [pid: 352329|app: 0|req: 212/418] 10.222.0.42 () {56 vars in 1186 bytes} [Thu Jul 28 08:53:32 2022] GET /identity/v3/projects/5c7af4b1c9fc4f35a95bbc0f95b044f2 => generated 344 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:53:32.907253 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1c2987-a3bf-4ae3-bbe6-b79b6be4c740 None admin] Authenticating user token {{(pid=352329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:53:32.995079 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG dbcounter [-] [352329] Writing DB stats keystone:SELECT=100 {{(pid=352329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:53:33.023941 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d063b8-9e8f-427a-94a5-a7e7a455094c None None] Validating token access rules against request {{(pid=352328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:53:33.037861 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1c2987-a3bf-4ae3-bbe6-b79b6be4c740 None admin] Validating token access rules against request {{(pid=352329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:53:33.074037 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a58c72a-3abf-45c3-9b3d-a939cdebaf4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:53:33.074723 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a58c72a-3abf-45c3-9b3d-a939cdebaf4d None admin] REQUEST_METHOD: `GET` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:53:33.075008 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a58c72a-3abf-45c3-9b3d-a939cdebaf4d None admin] SCRIPT_NAME: `/identity` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:53:33.075286 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a58c72a-3abf-45c3-9b3d-a939cdebaf4d None admin] PATH_INFO: `/v3/roles/member` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:53:33.087809 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a58c72a-3abf-45c3-9b3d-a939cdebaf4d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 08:53:33.090842 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88883735-3841-4da8-b4fd-f3949f9a2943 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:53:33.091623 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88883735-3841-4da8-b4fd-f3949f9a2943 None admin] REQUEST_METHOD: `GET` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:53:33.091975 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88883735-3841-4da8-b4fd-f3949f9a2943 None admin] SCRIPT_NAME: `/identity` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:53:33.092319 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88883735-3841-4da8-b4fd-f3949f9a2943 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:53:33.093121 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application [None req-0a58c72a-3abf-45c3-9b3d-a939cdebaf4d None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 28 08:53:33.093121 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:53:33.093121 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:53:33.093121 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:53:33.093121 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:53:33.093121 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:53:33.093121 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:53:33.093121 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:53:33.093121 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:53:33.093121 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:53:33.093121 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:53:33.093121 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:53:33.093121 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 08:53:33.093121 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 08:53:33.093121 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 08:53:33.093121 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 08:53:33.094245 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 08:53:33.094245 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 08:53:33.094245 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 08:53:33.094245 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 08:53:33.094245 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:53:33.094245 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:53:33.094245 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:53:33.094245 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:53:33.094245 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:53:33.094245 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:53:33.094245 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:53:33.094245 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application with Lock( Jul 28 08:53:33.094245 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:53:33.094245 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:53:33.094245 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:53:33.094245 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:53:33.095808 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:53:33.095808 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:53:33.095808 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:53:33.095808 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:53:33.095808 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 08:53:33.095808 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 08:53:33.095808 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 08:53:33.095808 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 08:53:33.095808 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 08:53:33.095808 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 08:53:33.095808 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 28 08:53:33.095808 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application Jul 28 08:53:33.095808 dv-cinder-851351-1-smb devstack@keystone.service[352328]: [pid: 352328|app: 0|req: 207/419] 10.222.0.42 () {56 vars in 1099 bytes} [Thu Jul 28 08:53:32 2022] GET /identity/v3/roles/member => generated 84 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:53:33.095808 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a58c72a-3abf-45c3-9b3d-a939cdebaf4d None admin] Authenticating user token {{(pid=352328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:53:33.113737 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88883735-3841-4da8-b4fd-f3949f9a2943 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 08:53:33.121793 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application [None req-88883735-3841-4da8-b4fd-f3949f9a2943 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 28 08:53:33.121793 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:53:33.121793 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:53:33.121793 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:53:33.121793 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:53:33.121793 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:53:33.121793 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:53:33.121793 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:53:33.121793 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:53:33.121793 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:53:33.121793 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:53:33.121793 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:53:33.121793 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 08:53:33.121793 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 08:53:33.121793 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 08:53:33.121793 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 08:53:33.123457 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 08:53:33.123457 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 08:53:33.123457 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 08:53:33.123457 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 08:53:33.123457 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:53:33.123457 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:53:33.123457 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:53:33.123457 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:53:33.123457 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:53:33.123457 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:53:33.123457 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:53:33.123457 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application with Lock( Jul 28 08:53:33.123457 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:53:33.123457 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:53:33.123457 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:53:33.123457 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:53:33.124760 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:53:33.124760 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:53:33.124760 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:53:33.124760 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:53:33.124760 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 08:53:33.124760 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 08:53:33.124760 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 08:53:33.124760 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 08:53:33.124760 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 08:53:33.124760 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 08:53:33.124760 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 28 08:53:33.124760 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application Jul 28 08:53:33.124760 dv-cinder-851351-1-smb devstack@keystone.service[352329]: [pid: 352329|app: 0|req: 213/420] 10.222.0.42 () {56 vars in 1114 bytes} [Thu Jul 28 08:53:32 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:53:33.125795 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88883735-3841-4da8-b4fd-f3949f9a2943 None admin] Authenticating user token {{(pid=352329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:53:33.155475 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG dbcounter [-] [352328] Writing DB stats keystone:SELECT=100 {{(pid=352328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:53:33.235837 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a58c72a-3abf-45c3-9b3d-a939cdebaf4d None admin] Validating token access rules against request {{(pid=352328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:53:33.265789 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88883735-3841-4da8-b4fd-f3949f9a2943 None admin] Validating token access rules against request {{(pid=352329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:53:33.278156 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce8c72b-08f1-415d-bb14-00b758a0204d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:53:33.278860 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce8c72b-08f1-415d-bb14-00b758a0204d None admin] REQUEST_METHOD: `PUT` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:53:33.279145 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce8c72b-08f1-415d-bb14-00b758a0204d None admin] SCRIPT_NAME: `/identity` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:53:33.279424 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce8c72b-08f1-415d-bb14-00b758a0204d None admin] PATH_INFO: `/v3/projects/5c7af4b1c9fc4f35a95bbc0f95b044f2/groups/1bda7933e7cd46bb88eaf0bc55ad78c4/roles/280023171b4a45efb67c036ff237bb3c` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:53:33.281579 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ce8c72b-08f1-415d-bb14-00b758a0204d None admin] RBAC: Authorizing `identity:create_grant(project_id=5c7af4b1c9fc4f35a95bbc0f95b044f2, group_id=1bda7933e7cd46bb88eaf0bc55ad78c4, role_id=280023171b4a45efb67c036ff237bb3c)` {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:53:33.283159 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ce8c72b-08f1-415d-bb14-00b758a0204d None admin] RBAC: Authorization granted {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:53:33.300141 dv-cinder-851351-1-smb devstack@keystone.service[352328]: [pid: 352328|app: 0|req: 208/421] 10.222.0.42 () {58 vars in 1442 bytes} [Thu Jul 28 08:53:33 2022] PUT /identity/v3/projects/5c7af4b1c9fc4f35a95bbc0f95b044f2/groups/1bda7933e7cd46bb88eaf0bc55ad78c4/roles/280023171b4a45efb67c036ff237bb3c => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 08:53:33.301327 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce8c72b-08f1-415d-bb14-00b758a0204d None admin] Authenticating user token {{(pid=352328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:53:33.312707 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG dbcounter [-] [352329] Writing DB stats keystone:SELECT=100 {{(pid=352329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:53:33.324397 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf02a55-9ba6-4a70-b402-28c32df790b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:53:33.325482 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf02a55-9ba6-4a70-b402-28c32df790b5 None admin] REQUEST_METHOD: `GET` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:53:33.326020 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf02a55-9ba6-4a70-b402-28c32df790b5 None admin] SCRIPT_NAME: `/identity` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:53:33.326535 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf02a55-9ba6-4a70-b402-28c32df790b5 None admin] PATH_INFO: `/v3/roles` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:53:33.327641 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edf02a55-9ba6-4a70-b402-28c32df790b5 None admin] RBAC: Adding query filter params (name=member) {{(pid=352329) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:53:33.328302 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edf02a55-9ba6-4a70-b402-28c32df790b5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:53:33.330518 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edf02a55-9ba6-4a70-b402-28c32df790b5 None admin] RBAC: Authorization granted {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:53:33.355198 dv-cinder-851351-1-smb devstack@keystone.service[352329]: [pid: 352329|app: 0|req: 214/422] 10.222.0.42 () {56 vars in 1101 bytes} [Thu Jul 28 08:53:33 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:53:33.357196 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf02a55-9ba6-4a70-b402-28c32df790b5 None admin] Authenticating user token {{(pid=352329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:53:33.432069 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce8c72b-08f1-415d-bb14-00b758a0204d None admin] Validating token access rules against request {{(pid=352328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:53:33.434034 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG dbcounter [-] [352328] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=352328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:53:33.481633 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef16b0a-08a6-459a-be58-99379f4f810f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:53:33.483246 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef16b0a-08a6-459a-be58-99379f4f810f None admin] REQUEST_METHOD: `GET` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:53:33.483530 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef16b0a-08a6-459a-be58-99379f4f810f None admin] SCRIPT_NAME: `/identity` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:53:33.483803 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef16b0a-08a6-459a-be58-99379f4f810f None admin] PATH_INFO: `/v3/roles` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:53:33.484562 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ef16b0a-08a6-459a-be58-99379f4f810f None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=352328) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:53:33.484898 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ef16b0a-08a6-459a-be58-99379f4f810f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:53:33.486442 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ef16b0a-08a6-459a-be58-99379f4f810f None admin] RBAC: Authorization granted {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:53:33.501296 dv-cinder-851351-1-smb devstack@keystone.service[352328]: [pid: 352328|app: 0|req: 209/423] 10.222.0.42 () {56 vars in 1111 bytes} [Thu Jul 28 08:53:33 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:53:33.508988 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef16b0a-08a6-459a-be58-99379f4f810f None admin] Authenticating user token {{(pid=352328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:53:33.551686 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf02a55-9ba6-4a70-b402-28c32df790b5 None admin] Validating token access rules against request {{(pid=352329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:53:33.589464 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c00801-79fc-4144-95d6-0357ccf1a4cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:53:33.590557 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c00801-79fc-4144-95d6-0357ccf1a4cb None admin] REQUEST_METHOD: `GET` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:53:33.591105 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c00801-79fc-4144-95d6-0357ccf1a4cb None admin] SCRIPT_NAME: `/identity` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:53:33.591594 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c00801-79fc-4144-95d6-0357ccf1a4cb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:53:33.632733 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef16b0a-08a6-459a-be58-99379f4f810f None admin] Validating token access rules against request {{(pid=352328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:53:33.676987 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2136bb42-db4e-486e-a2a7-cd6b4c60e491 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:53:33.677637 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2136bb42-db4e-486e-a2a7-cd6b4c60e491 None admin] REQUEST_METHOD: `GET` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:53:33.677919 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2136bb42-db4e-486e-a2a7-cd6b4c60e491 None admin] SCRIPT_NAME: `/identity` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:53:33.678204 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2136bb42-db4e-486e-a2a7-cd6b4c60e491 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:53:33.698941 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG dbcounter [-] [352329] Writing DB stats keystone:SELECT=100 {{(pid=352329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:53:33.718046 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG dbcounter [-] [352328] Writing DB stats keystone:SELECT=100 {{(pid=352328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:53:33.724547 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77c00801-79fc-4144-95d6-0357ccf1a4cb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:53:33.726747 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77c00801-79fc-4144-95d6-0357ccf1a4cb None admin] RBAC: Authorization granted {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:53:33.764707 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2136bb42-db4e-486e-a2a7-cd6b4c60e491 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:53:33.764965 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2136bb42-db4e-486e-a2a7-cd6b4c60e491 None admin] RBAC: Authorization granted {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:53:33.877057 dv-cinder-851351-1-smb devstack@keystone.service[352328]: [pid: 352328|app: 0|req: 210/424] 10.222.0.42 () {58 vars in 1282 bytes} [Thu Jul 28 08:53:33 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 371 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 28 08:53:33.886652 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2136bb42-db4e-486e-a2a7-cd6b4c60e491 None admin] Authenticating user token {{(pid=352328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:53:33.939089 dv-cinder-851351-1-smb devstack@keystone.service[352329]: [pid: 352329|app: 0|req: 215/425] 10.222.0.42 () {58 vars in 1282 bytes} [Thu Jul 28 08:53:33 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 582 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 28 08:53:33.945688 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c00801-79fc-4144-95d6-0357ccf1a4cb None admin] Authenticating user token {{(pid=352329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:53:33.979366 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG dbcounter [-] [352328] Writing DB stats keystone:SELECT=100 {{(pid=352328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:53:34.052021 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2136bb42-db4e-486e-a2a7-cd6b4c60e491 None admin] Validating token access rules against request {{(pid=352328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:53:34.151544 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a3c08fd-50a3-4405-8b01-e792ef1eef8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:53:34.153080 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3c08fd-50a3-4405-8b01-e792ef1eef8a None admin] REQUEST_METHOD: `GET` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:53:34.153362 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3c08fd-50a3-4405-8b01-e792ef1eef8a None admin] SCRIPT_NAME: `/identity` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:53:34.153633 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3c08fd-50a3-4405-8b01-e792ef1eef8a None admin] PATH_INFO: `/v3/projects/9af593aec02c450aa4ce9c48ff4c6a1f` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:53:34.157615 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a3c08fd-50a3-4405-8b01-e792ef1eef8a None admin] RBAC: Authorizing `identity:get_project(project_id=9af593aec02c450aa4ce9c48ff4c6a1f)` {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:53:34.159095 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a3c08fd-50a3-4405-8b01-e792ef1eef8a None admin] RBAC: Authorization granted {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:53:34.161481 dv-cinder-851351-1-smb devstack@keystone.service[352328]: [pid: 352328|app: 0|req: 211/426] 10.222.0.42 () {56 vars in 1186 bytes} [Thu Jul 28 08:53:33 2022] GET /identity/v3/projects/9af593aec02c450aa4ce9c48ff4c6a1f => generated 298 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:53:34.166462 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a3c08fd-50a3-4405-8b01-e792ef1eef8a None admin] Authenticating user token {{(pid=352328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:53:34.168755 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG dbcounter [-] [352329] Writing DB stats keystone:SELECT=100 {{(pid=352329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:53:34.191872 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c00801-79fc-4144-95d6-0357ccf1a4cb None admin] Validating token access rules against request {{(pid=352329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:53:34.257488 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35527dd0-2e1c-4d0f-8be8-f4df11d1c5f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:53:34.258175 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35527dd0-2e1c-4d0f-8be8-f4df11d1c5f0 None admin] REQUEST_METHOD: `GET` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:53:34.258463 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35527dd0-2e1c-4d0f-8be8-f4df11d1c5f0 None admin] SCRIPT_NAME: `/identity` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:53:34.258743 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35527dd0-2e1c-4d0f-8be8-f4df11d1c5f0 None admin] PATH_INFO: `/v3/projects/9af593aec02c450aa4ce9c48ff4c6a1f` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:53:34.265509 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35527dd0-2e1c-4d0f-8be8-f4df11d1c5f0 None admin] RBAC: Authorizing `identity:get_project(project_id=9af593aec02c450aa4ce9c48ff4c6a1f)` {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:53:34.267091 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35527dd0-2e1c-4d0f-8be8-f4df11d1c5f0 None admin] RBAC: Authorization granted {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:53:34.269306 dv-cinder-851351-1-smb devstack@keystone.service[352329]: [pid: 352329|app: 0|req: 216/427] 10.222.0.42 () {56 vars in 1186 bytes} [Thu Jul 28 08:53:33 2022] GET /identity/v3/projects/9af593aec02c450aa4ce9c48ff4c6a1f => generated 298 bytes in 324 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:53:34.274943 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35527dd0-2e1c-4d0f-8be8-f4df11d1c5f0 None admin] Authenticating user token {{(pid=352329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:53:34.319362 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a3c08fd-50a3-4405-8b01-e792ef1eef8a None admin] Validating token access rules against request {{(pid=352328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:53:34.354906 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG dbcounter [-] [352328] Writing DB stats keystone:SELECT=100 {{(pid=352328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:53:34.369049 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7febf2d0-8f43-4dd7-8436-e709ed7783a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:53:34.369824 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7febf2d0-8f43-4dd7-8436-e709ed7783a1 None admin] REQUEST_METHOD: `GET` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:53:34.371486 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7febf2d0-8f43-4dd7-8436-e709ed7783a1 None admin] SCRIPT_NAME: `/identity` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:53:34.371486 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7febf2d0-8f43-4dd7-8436-e709ed7783a1 None admin] PATH_INFO: `/v3/groups/313e220fa1e24b3c975e71a69928a850` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:53:34.378046 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7febf2d0-8f43-4dd7-8436-e709ed7783a1 None admin] RBAC: Authorizing `identity:get_group(group_id=313e220fa1e24b3c975e71a69928a850)` {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:53:34.379581 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7febf2d0-8f43-4dd7-8436-e709ed7783a1 None admin] RBAC: Authorization granted {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:53:34.381402 dv-cinder-851351-1-smb devstack@keystone.service[352328]: [pid: 352328|app: 0|req: 212/428] 10.222.0.42 () {56 vars in 1180 bytes} [Thu Jul 28 08:53:34 2022] GET /identity/v3/groups/313e220fa1e24b3c975e71a69928a850 => generated 226 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:53:34.390931 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7febf2d0-8f43-4dd7-8436-e709ed7783a1 None admin] Authenticating user token {{(pid=352328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:53:34.519390 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35527dd0-2e1c-4d0f-8be8-f4df11d1c5f0 None admin] Validating token access rules against request {{(pid=352329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:53:34.582510 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7febf2d0-8f43-4dd7-8436-e709ed7783a1 None admin] Validating token access rules against request {{(pid=352328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:53:34.601463 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07fb957f-6fe0-4285-8789-410970f4561f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:53:34.602547 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07fb957f-6fe0-4285-8789-410970f4561f None admin] REQUEST_METHOD: `GET` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:53:34.603069 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07fb957f-6fe0-4285-8789-410970f4561f None admin] SCRIPT_NAME: `/identity` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:53:34.603608 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07fb957f-6fe0-4285-8789-410970f4561f None admin] PATH_INFO: `/v3/groups/313e220fa1e24b3c975e71a69928a850` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:53:34.605329 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07fb957f-6fe0-4285-8789-410970f4561f None admin] RBAC: Authorizing `identity:get_group(group_id=313e220fa1e24b3c975e71a69928a850)` {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:53:34.607044 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07fb957f-6fe0-4285-8789-410970f4561f None admin] RBAC: Authorization granted {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:53:34.609418 dv-cinder-851351-1-smb devstack@keystone.service[352329]: [pid: 352329|app: 0|req: 217/429] 10.222.0.42 () {56 vars in 1180 bytes} [Thu Jul 28 08:53:34 2022] GET /identity/v3/groups/313e220fa1e24b3c975e71a69928a850 => generated 226 bytes in 335 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 08:53:34.615188 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07fb957f-6fe0-4285-8789-410970f4561f None admin] Authenticating user token {{(pid=352329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:53:34.631760 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-359028b9-9658-483a-adf5-179d8949b4bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:53:34.632331 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359028b9-9658-483a-adf5-179d8949b4bc None admin] REQUEST_METHOD: `GET` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:53:34.632615 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359028b9-9658-483a-adf5-179d8949b4bc None admin] SCRIPT_NAME: `/identity` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:53:34.632910 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359028b9-9658-483a-adf5-179d8949b4bc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:53:34.633728 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-359028b9-9658-483a-adf5-179d8949b4bc None admin] RBAC: Adding query filter params (group.id=313e220fa1e24b3c975e71a69928a850, role.id=a4fa43cd6d914398a0790a1516c83d08, scope.project.id=9af593aec02c450aa4ce9c48ff4c6a1f) {{(pid=352328) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:53:34.634027 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-359028b9-9658-483a-adf5-179d8949b4bc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:53:34.635480 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-359028b9-9658-483a-adf5-179d8949b4bc None admin] RBAC: Authorization granted {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:53:34.642923 dv-cinder-851351-1-smb devstack@keystone.service[352328]: [pid: 352328|app: 0|req: 213/430] 10.222.0.42 () {56 vars in 1376 bytes} [Thu Jul 28 08:53:34 2022] GET /identity/v3/role_assignments?group.id=313e220fa1e24b3c975e71a69928a850&scope.project.id=9af593aec02c450aa4ce9c48ff4c6a1f&role.id=a4fa43cd6d914398a0790a1516c83d08 => generated 611 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:53:34.649140 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG dbcounter [-] [352329] Writing DB stats keystone:SELECT=100 {{(pid=352329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:53:34.737898 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07fb957f-6fe0-4285-8789-410970f4561f None admin] Validating token access rules against request {{(pid=352329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:53:34.779247 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ddb2d8b-47be-4f03-b4c2-7f0ba3aa6e22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:53:34.780310 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ddb2d8b-47be-4f03-b4c2-7f0ba3aa6e22 None admin] REQUEST_METHOD: `GET` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:53:34.780885 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ddb2d8b-47be-4f03-b4c2-7f0ba3aa6e22 None admin] SCRIPT_NAME: `/identity` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:53:34.781391 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ddb2d8b-47be-4f03-b4c2-7f0ba3aa6e22 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:53:34.782519 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ddb2d8b-47be-4f03-b4c2-7f0ba3aa6e22 None admin] RBAC: Adding query filter params (group.id=313e220fa1e24b3c975e71a69928a850, role.id=16a3fc3aca974c47a329c2781b0be93a, scope.project.id=9af593aec02c450aa4ce9c48ff4c6a1f) {{(pid=352329) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:53:34.783080 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ddb2d8b-47be-4f03-b4c2-7f0ba3aa6e22 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:53:34.784923 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ddb2d8b-47be-4f03-b4c2-7f0ba3aa6e22 None admin] RBAC: Authorization granted {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:53:34.792735 dv-cinder-851351-1-smb devstack@keystone.service[352329]: [pid: 352329|app: 0|req: 218/431] 10.222.0.42 () {56 vars in 1376 bytes} [Thu Jul 28 08:53:34 2022] GET /identity/v3/role_assignments?group.id=313e220fa1e24b3c975e71a69928a850&scope.project.id=9af593aec02c450aa4ce9c48ff4c6a1f&role.id=16a3fc3aca974c47a329c2781b0be93a => generated 611 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:53:34.818408 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cabb7cb7-9005-4c88-a381-4d63bfaa49eb None None] REQUEST_METHOD: `GET` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:53:34.818741 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cabb7cb7-9005-4c88-a381-4d63bfaa49eb None None] SCRIPT_NAME: `/identity` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:53:34.819078 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cabb7cb7-9005-4c88-a381-4d63bfaa49eb None None] PATH_INFO: `/` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:53:34.820882 dv-cinder-851351-1-smb devstack@keystone.service[352328]: [pid: 352328|app: 0|req: 214/432] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 08:53:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 08:53:34.827121 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c3af52-aaed-4f9d-b0d1-7ee507ff801d None None] REQUEST_METHOD: `POST` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:53:34.827422 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c3af52-aaed-4f9d-b0d1-7ee507ff801d None None] SCRIPT_NAME: `/identity` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:53:34.827746 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c3af52-aaed-4f9d-b0d1-7ee507ff801d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:53:34.849938 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.auth.core [None req-32c3af52-aaed-4f9d-b0d1-7ee507ff801d None None] MFA Rules not processed for user `d18c063b2377412485965357671e5506`. Rule list: `[]` (Enabled: `True`). {{(pid=352329) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 08:53:34.851213 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.fernet_utils [None req-32c3af52-aaed-4f9d-b0d1-7ee507ff801d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=352329) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:53:34.937976 dv-cinder-851351-1-smb devstack@keystone.service[352329]: [pid: 352329|app: 0|req: 219/433] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 08:53:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 08:53:34.967400 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cabb7cb7-9005-4c88-a381-4d63bfaa49eb None None] Authenticating user token {{(pid=352328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:53:35.037672 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0dff968-8b57-4779-9264-59e99763ac5b None None] REQUEST_METHOD: `GET` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:53:35.038789 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0dff968-8b57-4779-9264-59e99763ac5b None None] SCRIPT_NAME: `/identity` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:53:35.039374 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0dff968-8b57-4779-9264-59e99763ac5b None None] PATH_INFO: `/` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:53:35.041095 dv-cinder-851351-1-smb devstack@keystone.service[352329]: [pid: 352329|app: 0|req: 220/434] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 08:53:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 28 08:53:35.047103 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c593f9-f0a1-451c-8bf4-f0bfe876dc91 None None] REQUEST_METHOD: `POST` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:53:35.047441 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c593f9-f0a1-451c-8bf4-f0bfe876dc91 None None] SCRIPT_NAME: `/identity` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:53:35.047685 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c593f9-f0a1-451c-8bf4-f0bfe876dc91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:53:35.059960 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG dbcounter [-] [352328] Writing DB stats keystone:SELECT=100 {{(pid=352328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:53:35.067894 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.auth.core [None req-b0c593f9-f0a1-451c-8bf4-f0bfe876dc91 None None] MFA Rules not processed for user `d18c063b2377412485965357671e5506`. Rule list: `[]` (Enabled: `True`). {{(pid=352329) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 08:53:35.069414 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.fernet_utils [None req-b0c593f9-f0a1-451c-8bf4-f0bfe876dc91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=352329) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:53:35.098476 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG dbcounter [-] [352329] Writing DB stats keystone:SELECT=100 {{(pid=352329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:53:35.117582 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cabb7cb7-9005-4c88-a381-4d63bfaa49eb None None] Validating token access rules against request {{(pid=352328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:53:35.167739 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a18a8f-50fe-40e4-8878-e3cd64f3bb91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:53:35.168477 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a18a8f-50fe-40e4-8878-e3cd64f3bb91 None admin] REQUEST_METHOD: `GET` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:53:35.168817 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a18a8f-50fe-40e4-8878-e3cd64f3bb91 None admin] SCRIPT_NAME: `/identity` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:53:35.169136 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a18a8f-50fe-40e4-8878-e3cd64f3bb91 None admin] PATH_INFO: `/v3/roles/member` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:53:35.182122 dv-cinder-851351-1-smb devstack@keystone.service[352329]: [pid: 352329|app: 0|req: 221/435] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 08:53:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 08:53:35.184386 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85a18a8f-50fe-40e4-8878-e3cd64f3bb91 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 08:53:35.190493 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application [None req-85a18a8f-50fe-40e4-8878-e3cd64f3bb91 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 28 08:53:35.190493 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:53:35.190493 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:53:35.190493 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:53:35.190493 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:53:35.190493 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:53:35.190493 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:53:35.190493 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:53:35.190493 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:53:35.190493 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:53:35.190493 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:53:35.190493 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:53:35.190493 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 08:53:35.190493 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 08:53:35.190493 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 08:53:35.190493 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 08:53:35.191714 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 08:53:35.191714 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 08:53:35.191714 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 08:53:35.191714 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 08:53:35.191714 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:53:35.191714 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:53:35.191714 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:53:35.191714 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:53:35.191714 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:53:35.191714 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:53:35.191714 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:53:35.191714 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application with Lock( Jul 28 08:53:35.191714 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:53:35.191714 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:53:35.191714 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:53:35.191714 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:53:35.192830 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:53:35.192830 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:53:35.192830 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:53:35.192830 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:53:35.192830 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 08:53:35.192830 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 08:53:35.192830 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 08:53:35.192830 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 08:53:35.192830 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 08:53:35.192830 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 08:53:35.192830 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 28 08:53:35.192830 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application Jul 28 08:53:35.192830 dv-cinder-851351-1-smb devstack@keystone.service[352328]: [pid: 352328|app: 0|req: 215/436] 10.222.0.42 () {56 vars in 1099 bytes} [Thu Jul 28 08:53:34 2022] GET /identity/v3/roles/member => generated 84 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:53:35.198805 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c593f9-f0a1-451c-8bf4-f0bfe876dc91 None None] Authenticating user token {{(pid=352329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:53:35.206866 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a18a8f-50fe-40e4-8878-e3cd64f3bb91 None admin] Authenticating user token {{(pid=352328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:53:35.357861 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a18a8f-50fe-40e4-8878-e3cd64f3bb91 None admin] Validating token access rules against request {{(pid=352328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:53:35.362377 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c593f9-f0a1-451c-8bf4-f0bfe876dc91 None None] Validating token access rules against request {{(pid=352329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:53:35.399572 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG dbcounter [-] [352328] Writing DB stats keystone:SELECT=100 {{(pid=352328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:53:35.409721 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f606852c-b40e-48d9-bef6-43119670be87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:53:35.410386 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f606852c-b40e-48d9-bef6-43119670be87 None admin] REQUEST_METHOD: `GET` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:53:35.410671 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f606852c-b40e-48d9-bef6-43119670be87 None admin] SCRIPT_NAME: `/identity` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:53:35.410946 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f606852c-b40e-48d9-bef6-43119670be87 None admin] PATH_INFO: `/v3/roles` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:53:35.411700 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f606852c-b40e-48d9-bef6-43119670be87 None admin] RBAC: Adding query filter params (name=member) {{(pid=352329) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:53:35.412007 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f606852c-b40e-48d9-bef6-43119670be87 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:53:35.413488 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f606852c-b40e-48d9-bef6-43119670be87 None admin] RBAC: Authorization granted {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:53:35.423364 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cae6baa-c040-4dc3-9cec-d7219dd05751 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:53:35.424512 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cae6baa-c040-4dc3-9cec-d7219dd05751 None admin] REQUEST_METHOD: `GET` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:53:35.424512 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cae6baa-c040-4dc3-9cec-d7219dd05751 None admin] SCRIPT_NAME: `/identity` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:53:35.424766 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cae6baa-c040-4dc3-9cec-d7219dd05751 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:53:35.427300 dv-cinder-851351-1-smb devstack@keystone.service[352329]: [pid: 352329|app: 0|req: 222/437] 10.222.0.42 () {56 vars in 1101 bytes} [Thu Jul 28 08:53:35 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:53:35.434081 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f606852c-b40e-48d9-bef6-43119670be87 None admin] Authenticating user token {{(pid=352329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:53:35.439608 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cae6baa-c040-4dc3-9cec-d7219dd05751 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 08:53:35.444756 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application [None req-6cae6baa-c040-4dc3-9cec-d7219dd05751 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 28 08:53:35.444756 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:53:35.444756 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:53:35.444756 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:53:35.444756 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:53:35.444756 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:53:35.444756 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:53:35.444756 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:53:35.444756 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:53:35.444756 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:53:35.444756 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:53:35.444756 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:53:35.444756 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 08:53:35.444756 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 08:53:35.444756 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 08:53:35.444756 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 08:53:35.445958 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 08:53:35.445958 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 08:53:35.445958 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 08:53:35.445958 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 08:53:35.445958 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:53:35.445958 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:53:35.445958 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:53:35.445958 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:53:35.445958 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:53:35.445958 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:53:35.445958 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:53:35.445958 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application with Lock( Jul 28 08:53:35.445958 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:53:35.445958 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:53:35.445958 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:53:35.445958 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:53:35.447643 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:53:35.447643 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:53:35.447643 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:53:35.447643 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:53:35.447643 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 08:53:35.447643 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 08:53:35.447643 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 08:53:35.447643 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 08:53:35.447643 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 08:53:35.447643 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 08:53:35.447643 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 28 08:53:35.447643 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application Jul 28 08:53:35.447643 dv-cinder-851351-1-smb devstack@keystone.service[352328]: [pid: 352328|app: 0|req: 216/438] 10.222.0.42 () {56 vars in 1114 bytes} [Thu Jul 28 08:53:35 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:53:35.452366 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cae6baa-c040-4dc3-9cec-d7219dd05751 None admin] Authenticating user token {{(pid=352328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:53:35.457961 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG dbcounter [-] [352329] Writing DB stats keystone:SELECT=100 {{(pid=352329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:53:35.580704 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f606852c-b40e-48d9-bef6-43119670be87 None admin] Validating token access rules against request {{(pid=352329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:53:35.615641 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cae6baa-c040-4dc3-9cec-d7219dd05751 None admin] Validating token access rules against request {{(pid=352328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:53:35.620830 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ffce69-bed5-421a-9c98-f77998754f9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:53:35.621479 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ffce69-bed5-421a-9c98-f77998754f9b None admin] REQUEST_METHOD: `GET` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:53:35.621766 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ffce69-bed5-421a-9c98-f77998754f9b None admin] SCRIPT_NAME: `/identity` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:53:35.622043 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ffce69-bed5-421a-9c98-f77998754f9b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:53:35.655858 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d841185-daa5-414e-87b6-6d694dd22eaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:53:35.656513 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d841185-daa5-414e-87b6-6d694dd22eaa None admin] REQUEST_METHOD: `GET` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:53:35.656829 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d841185-daa5-414e-87b6-6d694dd22eaa None admin] SCRIPT_NAME: `/identity` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:53:35.657130 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d841185-daa5-414e-87b6-6d694dd22eaa None admin] PATH_INFO: `/v3/roles` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:53:35.657895 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d841185-daa5-414e-87b6-6d694dd22eaa None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=352328) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:53:35.658206 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d841185-daa5-414e-87b6-6d694dd22eaa None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:53:35.659695 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d841185-daa5-414e-87b6-6d694dd22eaa None admin] RBAC: Authorization granted {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:53:35.669446 dv-cinder-851351-1-smb devstack@keystone.service[352328]: [pid: 352328|app: 0|req: 217/439] 10.222.0.42 () {56 vars in 1111 bytes} [Thu Jul 28 08:53:35 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 08:53:35.675159 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d841185-daa5-414e-87b6-6d694dd22eaa None admin] Authenticating user token {{(pid=352328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:53:35.697111 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99ffce69-bed5-421a-9c98-f77998754f9b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:53:35.699119 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99ffce69-bed5-421a-9c98-f77998754f9b None admin] RBAC: Authorization granted {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:53:35.717712 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG dbcounter [-] [352329] Writing DB stats keystone:SELECT=100 {{(pid=352329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:53:35.731386 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG dbcounter [-] [352328] Writing DB stats keystone:SELECT=100 {{(pid=352328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:53:35.800641 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d841185-daa5-414e-87b6-6d694dd22eaa None admin] Validating token access rules against request {{(pid=352328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:53:35.825724 dv-cinder-851351-1-smb devstack@keystone.service[352329]: [pid: 352329|app: 0|req: 223/440] 10.222.0.42 () {58 vars in 1282 bytes} [Thu Jul 28 08:53:35 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 392 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 28 08:53:35.832185 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ffce69-bed5-421a-9c98-f77998754f9b None admin] Authenticating user token {{(pid=352329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:53:35.843869 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-987e70ff-041b-4732-b5f6-b1785ddaf97d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:53:35.844513 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987e70ff-041b-4732-b5f6-b1785ddaf97d None admin] REQUEST_METHOD: `GET` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:53:35.844841 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987e70ff-041b-4732-b5f6-b1785ddaf97d None admin] SCRIPT_NAME: `/identity` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:53:35.845219 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987e70ff-041b-4732-b5f6-b1785ddaf97d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:53:35.922325 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-987e70ff-041b-4732-b5f6-b1785ddaf97d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:53:35.923772 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-987e70ff-041b-4732-b5f6-b1785ddaf97d None admin] RBAC: Authorization granted {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:53:35.952787 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ffce69-bed5-421a-9c98-f77998754f9b None admin] Validating token access rules against request {{(pid=352329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:53:35.969266 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG dbcounter [-] [352329] Writing DB stats keystone:SELECT=100 {{(pid=352329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:53:35.976475 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG dbcounter [-] [352328] Writing DB stats keystone:SELECT=100 {{(pid=352328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:53:35.991449 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f042a008-ee38-4a95-bbef-aba040f11bfa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:53:35.992119 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f042a008-ee38-4a95-bbef-aba040f11bfa None admin] REQUEST_METHOD: `GET` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:53:35.992396 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f042a008-ee38-4a95-bbef-aba040f11bfa None admin] SCRIPT_NAME: `/identity` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:53:35.992657 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f042a008-ee38-4a95-bbef-aba040f11bfa None admin] PATH_INFO: `/v3/projects/be5ef7d0266e453784a39d297f9b131d` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:53:35.993899 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f042a008-ee38-4a95-bbef-aba040f11bfa None admin] RBAC: Authorizing `identity:get_project(project_id=be5ef7d0266e453784a39d297f9b131d)` {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:53:35.995381 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f042a008-ee38-4a95-bbef-aba040f11bfa None admin] RBAC: Authorization granted {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:53:35.997103 dv-cinder-851351-1-smb devstack@keystone.service[352329]: [pid: 352329|app: 0|req: 224/441] 10.222.0.42 () {56 vars in 1186 bytes} [Thu Jul 28 08:53:35 2022] GET /identity/v3/projects/be5ef7d0266e453784a39d297f9b131d => generated 302 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:53:35.998275 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab26fd83-8712-45cc-9cf6-bbacc552e327 None None] REQUEST_METHOD: `GET` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:53:35.998553 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab26fd83-8712-45cc-9cf6-bbacc552e327 None None] SCRIPT_NAME: `/identity` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:53:35.998826 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab26fd83-8712-45cc-9cf6-bbacc552e327 None None] PATH_INFO: `/` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:53:36.000345 dv-cinder-851351-1-smb devstack@keystone.service[352329]: [pid: 352329|app: 0|req: 225/442] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 08:53:35 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 08:53:36.005330 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab26fd83-8712-45cc-9cf6-bbacc552e327 None None] Authenticating user token {{(pid=352329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:53:36.036562 dv-cinder-851351-1-smb devstack@keystone.service[352328]: [pid: 352328|app: 0|req: 218/443] 10.222.0.42 () {58 vars in 1282 bytes} [Thu Jul 28 08:53:35 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 362 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 28 08:53:36.038053 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ce5aa2-51e5-4fa5-97d9-3a400cd4c0c6 None None] REQUEST_METHOD: `POST` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:53:36.038241 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ce5aa2-51e5-4fa5-97d9-3a400cd4c0c6 None None] SCRIPT_NAME: `/identity` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:53:36.038510 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ce5aa2-51e5-4fa5-97d9-3a400cd4c0c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:53:36.057325 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.auth.core [None req-a8ce5aa2-51e5-4fa5-97d9-3a400cd4c0c6 None None] MFA Rules not processed for user `d18c063b2377412485965357671e5506`. Rule list: `[]` (Enabled: `True`). {{(pid=352328) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 08:53:36.058584 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.fernet_utils [None req-a8ce5aa2-51e5-4fa5-97d9-3a400cd4c0c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=352328) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:53:36.116073 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab26fd83-8712-45cc-9cf6-bbacc552e327 None None] Validating token access rules against request {{(pid=352329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:53:36.129785 dv-cinder-851351-1-smb devstack@keystone.service[352328]: [pid: 352328|app: 0|req: 219/444] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 08:53:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 08:53:36.130454 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ce5aa2-51e5-4fa5-97d9-3a400cd4c0c6 None None] Authenticating user token {{(pid=352328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:53:36.155877 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33aa7bd0-1dad-4b7d-94b6-03fd57745549 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:53:36.156575 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33aa7bd0-1dad-4b7d-94b6-03fd57745549 None admin] REQUEST_METHOD: `GET` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:53:36.156881 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33aa7bd0-1dad-4b7d-94b6-03fd57745549 None admin] SCRIPT_NAME: `/identity` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:53:36.157191 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33aa7bd0-1dad-4b7d-94b6-03fd57745549 None admin] PATH_INFO: `/v3/groups/313e220fa1e24b3c975e71a69928a850` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:53:36.158470 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33aa7bd0-1dad-4b7d-94b6-03fd57745549 None admin] RBAC: Authorizing `identity:get_group(group_id=313e220fa1e24b3c975e71a69928a850)` {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:53:36.159923 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33aa7bd0-1dad-4b7d-94b6-03fd57745549 None admin] RBAC: Authorization granted {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:53:36.161609 dv-cinder-851351-1-smb devstack@keystone.service[352329]: [pid: 352329|app: 0|req: 226/445] 10.222.0.42 () {56 vars in 1180 bytes} [Thu Jul 28 08:53:36 2022] GET /identity/v3/groups/313e220fa1e24b3c975e71a69928a850 => generated 226 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:53:36.162374 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33aa7bd0-1dad-4b7d-94b6-03fd57745549 None admin] Authenticating user token {{(pid=352329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:53:36.211896 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG dbcounter [-] [352329] Writing DB stats keystone:SELECT=100 {{(pid=352329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:53:36.223655 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG dbcounter [-] [352328] Writing DB stats keystone:SELECT=100 {{(pid=352328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:53:36.250811 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ce5aa2-51e5-4fa5-97d9-3a400cd4c0c6 None None] Validating token access rules against request {{(pid=352328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:53:36.261438 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33aa7bd0-1dad-4b7d-94b6-03fd57745549 None admin] Validating token access rules against request {{(pid=352329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:53:36.284623 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ce8b1f-5d02-4dc4-ad58-02a944018d9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:53:36.285305 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ce8b1f-5d02-4dc4-ad58-02a944018d9d None admin] REQUEST_METHOD: `GET` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:53:36.285583 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ce8b1f-5d02-4dc4-ad58-02a944018d9d None admin] SCRIPT_NAME: `/identity` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:53:36.285861 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ce8b1f-5d02-4dc4-ad58-02a944018d9d None admin] PATH_INFO: `/v3/projects/be5ef7d0266e453784a39d297f9b131d` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:53:36.287013 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ce8b1f-5d02-4dc4-ad58-02a944018d9d None admin] RBAC: Authorizing `identity:get_project(project_id=be5ef7d0266e453784a39d297f9b131d)` {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:53:36.288473 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ce8b1f-5d02-4dc4-ad58-02a944018d9d None admin] RBAC: Authorization granted {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:53:36.294684 dv-cinder-851351-1-smb devstack@keystone.service[352328]: [pid: 352328|app: 0|req: 220/446] 10.222.0.42 () {56 vars in 1186 bytes} [Thu Jul 28 08:53:36 2022] GET /identity/v3/projects/be5ef7d0266e453784a39d297f9b131d => generated 302 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:53:36.294684 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ce8b1f-5d02-4dc4-ad58-02a944018d9d None admin] Authenticating user token {{(pid=352328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:53:36.294940 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a14f8d7-320f-40b9-ad45-b528b62e81e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:53:36.295502 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a14f8d7-320f-40b9-ad45-b528b62e81e4 None admin] REQUEST_METHOD: `GET` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:53:36.295790 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a14f8d7-320f-40b9-ad45-b528b62e81e4 None admin] SCRIPT_NAME: `/identity` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:53:36.296065 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a14f8d7-320f-40b9-ad45-b528b62e81e4 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:53:36.306834 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a14f8d7-320f-40b9-ad45-b528b62e81e4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 08:53:36.311854 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application [None req-0a14f8d7-320f-40b9-ad45-b528b62e81e4 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 08:53:36.311854 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:53:36.311854 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:53:36.311854 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:53:36.311854 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:53:36.311854 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:53:36.311854 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:53:36.311854 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:53:36.311854 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:53:36.311854 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:53:36.311854 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:53:36.311854 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:53:36.311854 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 08:53:36.311854 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 08:53:36.311854 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 08:53:36.311854 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 08:53:36.313079 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 08:53:36.313079 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 08:53:36.313079 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 08:53:36.313079 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 08:53:36.313079 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:53:36.313079 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:53:36.313079 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:53:36.313079 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:53:36.313079 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:53:36.313079 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:53:36.313079 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:53:36.313079 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application with Lock( Jul 28 08:53:36.313079 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:53:36.313079 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:53:36.313079 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:53:36.313079 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:53:36.314152 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:53:36.314152 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:53:36.314152 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:53:36.314152 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:53:36.314152 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 08:53:36.314152 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 08:53:36.314152 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 08:53:36.314152 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 08:53:36.314152 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 08:53:36.314152 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 08:53:36.314152 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 08:53:36.314152 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application Jul 28 08:53:36.314152 dv-cinder-851351-1-smb devstack@keystone.service[352329]: [pid: 352329|app: 0|req: 227/447] 10.222.0.42 () {56 vars in 1096 bytes} [Thu Jul 28 08:53:36 2022] GET /identity/v3/roles/admin => generated 83 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:53:36.314152 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a14f8d7-320f-40b9-ad45-b528b62e81e4 None admin] Authenticating user token {{(pid=352329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:53:36.396677 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ce8b1f-5d02-4dc4-ad58-02a944018d9d None admin] Validating token access rules against request {{(pid=352328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:53:36.413175 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a14f8d7-320f-40b9-ad45-b528b62e81e4 None admin] Validating token access rules against request {{(pid=352329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:53:36.424631 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG dbcounter [-] [352329] Writing DB stats keystone:SELECT=100 {{(pid=352329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:53:36.433022 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a32e344-72f5-4cfa-8ed7-c204c7f3ada1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:53:36.433661 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a32e344-72f5-4cfa-8ed7-c204c7f3ada1 None admin] REQUEST_METHOD: `GET` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:53:36.433944 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a32e344-72f5-4cfa-8ed7-c204c7f3ada1 None admin] SCRIPT_NAME: `/identity` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:53:36.434220 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a32e344-72f5-4cfa-8ed7-c204c7f3ada1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:53:36.435021 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a32e344-72f5-4cfa-8ed7-c204c7f3ada1 None admin] RBAC: Adding query filter params (group.id=313e220fa1e24b3c975e71a69928a850, role.id=16a3fc3aca974c47a329c2781b0be93a, scope.project.id=be5ef7d0266e453784a39d297f9b131d) {{(pid=352328) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:53:36.435333 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a32e344-72f5-4cfa-8ed7-c204c7f3ada1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:53:36.436812 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a32e344-72f5-4cfa-8ed7-c204c7f3ada1 None admin] RBAC: Authorization granted {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:53:36.442997 dv-cinder-851351-1-smb devstack@keystone.service[352328]: [pid: 352328|app: 0|req: 221/448] 10.222.0.42 () {56 vars in 1376 bytes} [Thu Jul 28 08:53:36 2022] GET /identity/v3/role_assignments?group.id=313e220fa1e24b3c975e71a69928a850&scope.project.id=be5ef7d0266e453784a39d297f9b131d&role.id=16a3fc3aca974c47a329c2781b0be93a => generated 611 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:53:36.443846 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a32e344-72f5-4cfa-8ed7-c204c7f3ada1 None admin] Authenticating user token {{(pid=352328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:53:36.449654 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4020d9ff-9516-4dae-990b-12bfa6509189 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:53:36.450345 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4020d9ff-9516-4dae-990b-12bfa6509189 None admin] REQUEST_METHOD: `GET` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:53:36.450626 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4020d9ff-9516-4dae-990b-12bfa6509189 None admin] SCRIPT_NAME: `/identity` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:53:36.450897 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4020d9ff-9516-4dae-990b-12bfa6509189 None admin] PATH_INFO: `/v3/groups/313e220fa1e24b3c975e71a69928a850` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:53:36.452268 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4020d9ff-9516-4dae-990b-12bfa6509189 None admin] RBAC: Authorizing `identity:get_group(group_id=313e220fa1e24b3c975e71a69928a850)` {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:53:36.453863 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4020d9ff-9516-4dae-990b-12bfa6509189 None admin] RBAC: Authorization granted {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:53:36.456139 dv-cinder-851351-1-smb devstack@keystone.service[352329]: [pid: 352329|app: 0|req: 228/449] 10.222.0.42 () {56 vars in 1180 bytes} [Thu Jul 28 08:53:36 2022] GET /identity/v3/groups/313e220fa1e24b3c975e71a69928a850 => generated 226 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:53:36.462626 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4020d9ff-9516-4dae-990b-12bfa6509189 None admin] Authenticating user token {{(pid=352329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:53:36.471377 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG dbcounter [-] [352328] Writing DB stats keystone:SELECT=100 {{(pid=352328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:53:36.575274 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4020d9ff-9516-4dae-990b-12bfa6509189 None admin] Validating token access rules against request {{(pid=352329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:53:36.586026 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a32e344-72f5-4cfa-8ed7-c204c7f3ada1 None admin] Validating token access rules against request {{(pid=352328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:53:36.613276 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da2962d-de6d-4a5f-abcf-6f213123eff9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:53:36.613930 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da2962d-de6d-4a5f-abcf-6f213123eff9 None admin] REQUEST_METHOD: `GET` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:53:36.614215 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da2962d-de6d-4a5f-abcf-6f213123eff9 None admin] SCRIPT_NAME: `/identity` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:53:36.614494 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da2962d-de6d-4a5f-abcf-6f213123eff9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:53:36.615325 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da2962d-de6d-4a5f-abcf-6f213123eff9 None admin] RBAC: Adding query filter params (group.id=313e220fa1e24b3c975e71a69928a850, role.id=a4fa43cd6d914398a0790a1516c83d08, scope.project.id=be5ef7d0266e453784a39d297f9b131d) {{(pid=352329) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:53:36.615643 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da2962d-de6d-4a5f-abcf-6f213123eff9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:53:36.617971 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da2962d-de6d-4a5f-abcf-6f213123eff9 None admin] RBAC: Authorization granted {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:53:36.624896 dv-cinder-851351-1-smb devstack@keystone.service[352329]: [pid: 352329|app: 0|req: 229/450] 10.222.0.42 () {56 vars in 1376 bytes} [Thu Jul 28 08:53:36 2022] GET /identity/v3/role_assignments?group.id=313e220fa1e24b3c975e71a69928a850&scope.project.id=be5ef7d0266e453784a39d297f9b131d&role.id=a4fa43cd6d914398a0790a1516c83d08 => generated 611 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:53:36.634098 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79977478-fa87-4476-865a-a529986f7bee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:53:36.634783 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79977478-fa87-4476-865a-a529986f7bee None admin] REQUEST_METHOD: `GET` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:53:36.635075 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79977478-fa87-4476-865a-a529986f7bee None admin] SCRIPT_NAME: `/identity` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:53:36.635349 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79977478-fa87-4476-865a-a529986f7bee None admin] PATH_INFO: `/v3/roles` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:53:36.636129 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79977478-fa87-4476-865a-a529986f7bee None admin] RBAC: Adding query filter params (name=admin) {{(pid=352328) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:53:36.636444 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79977478-fa87-4476-865a-a529986f7bee None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:53:36.638004 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79977478-fa87-4476-865a-a529986f7bee None admin] RBAC: Authorization granted {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:53:36.648023 dv-cinder-851351-1-smb devstack@keystone.service[352328]: [pid: 352328|app: 0|req: 222/451] 10.222.0.42 () {56 vars in 1099 bytes} [Thu Jul 28 08:53:36 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:53:36.654438 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da2962d-de6d-4a5f-abcf-6f213123eff9 None admin] Authenticating user token {{(pid=352329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:53:36.706493 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG dbcounter [-] [352329] Writing DB stats keystone:SELECT=100 {{(pid=352329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:53:36.777588 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da2962d-de6d-4a5f-abcf-6f213123eff9 None admin] Validating token access rules against request {{(pid=352329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:53:36.822933 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-747a9d3f-59ac-4c97-8101-b7e651d1899b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:53:36.823650 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747a9d3f-59ac-4c97-8101-b7e651d1899b None admin] REQUEST_METHOD: `GET` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:53:36.823939 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747a9d3f-59ac-4c97-8101-b7e651d1899b None admin] SCRIPT_NAME: `/identity` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:53:36.824219 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747a9d3f-59ac-4c97-8101-b7e651d1899b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:53:36.904616 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-747a9d3f-59ac-4c97-8101-b7e651d1899b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:53:36.906164 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-747a9d3f-59ac-4c97-8101-b7e651d1899b None admin] RBAC: Authorization granted {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:53:36.951427 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG dbcounter [-] [352329] Writing DB stats keystone:SELECT=100 {{(pid=352329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:53:37.016111 dv-cinder-851351-1-smb devstack@keystone.service[352329]: [pid: 352329|app: 0|req: 230/452] 10.222.0.42 () {58 vars in 1282 bytes} [Thu Jul 28 08:53:36 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 362 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 28 08:53:37.022644 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79977478-fa87-4476-865a-a529986f7bee None admin] Authenticating user token {{(pid=352328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:53:37.096737 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG dbcounter [-] [352328] Writing DB stats keystone:SELECT=100 {{(pid=352328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:53:37.135003 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79977478-fa87-4476-865a-a529986f7bee None admin] Validating token access rules against request {{(pid=352328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:53:37.170329 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c589bf-7cce-4cce-bcfd-73b77e79f89b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:53:37.171017 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c589bf-7cce-4cce-bcfd-73b77e79f89b None admin] REQUEST_METHOD: `GET` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:53:37.171313 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c589bf-7cce-4cce-bcfd-73b77e79f89b None admin] SCRIPT_NAME: `/identity` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:53:37.171579 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c589bf-7cce-4cce-bcfd-73b77e79f89b None admin] PATH_INFO: `/v3/projects/5c7af4b1c9fc4f35a95bbc0f95b044f2` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:53:37.172858 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8c589bf-7cce-4cce-bcfd-73b77e79f89b None admin] RBAC: Authorizing `identity:get_project(project_id=5c7af4b1c9fc4f35a95bbc0f95b044f2)` {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:53:37.174414 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8c589bf-7cce-4cce-bcfd-73b77e79f89b None admin] RBAC: Authorization granted {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:53:37.176112 dv-cinder-851351-1-smb devstack@keystone.service[352328]: [pid: 352328|app: 0|req: 223/453] 10.222.0.42 () {56 vars in 1186 bytes} [Thu Jul 28 08:53:37 2022] GET /identity/v3/projects/5c7af4b1c9fc4f35a95bbc0f95b044f2 => generated 344 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:53:37.182135 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-747a9d3f-59ac-4c97-8101-b7e651d1899b None admin] Authenticating user token {{(pid=352329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:53:37.284917 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-747a9d3f-59ac-4c97-8101-b7e651d1899b None admin] Validating token access rules against request {{(pid=352329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:53:37.319965 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb5e993-adf3-44db-926a-42ffc5408bfe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:53:37.320615 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb5e993-adf3-44db-926a-42ffc5408bfe None admin] REQUEST_METHOD: `GET` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:53:37.320933 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb5e993-adf3-44db-926a-42ffc5408bfe None admin] SCRIPT_NAME: `/identity` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:53:37.321210 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb5e993-adf3-44db-926a-42ffc5408bfe None admin] PATH_INFO: `/v3/groups/1bda7933e7cd46bb88eaf0bc55ad78c4` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:53:37.322413 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeb5e993-adf3-44db-926a-42ffc5408bfe None admin] RBAC: Authorizing `identity:get_group(group_id=1bda7933e7cd46bb88eaf0bc55ad78c4)` {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:53:37.323895 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeb5e993-adf3-44db-926a-42ffc5408bfe None admin] RBAC: Authorization granted {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:53:37.325574 dv-cinder-851351-1-smb devstack@keystone.service[352329]: [pid: 352329|app: 0|req: 231/454] 10.222.0.42 () {56 vars in 1180 bytes} [Thu Jul 28 08:53:37 2022] GET /identity/v3/groups/1bda7933e7cd46bb88eaf0bc55ad78c4 => generated 229 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:53:37.332340 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c589bf-7cce-4cce-bcfd-73b77e79f89b None admin] Authenticating user token {{(pid=352328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:53:37.435867 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c589bf-7cce-4cce-bcfd-73b77e79f89b None admin] Validating token access rules against request {{(pid=352328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:53:37.470810 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e2327b-1016-4025-a143-15d0867b999e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:53:37.471389 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e2327b-1016-4025-a143-15d0867b999e None admin] REQUEST_METHOD: `GET` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:53:37.471670 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e2327b-1016-4025-a143-15d0867b999e None admin] SCRIPT_NAME: `/identity` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:53:37.471953 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e2327b-1016-4025-a143-15d0867b999e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:53:37.472769 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e2327b-1016-4025-a143-15d0867b999e None admin] RBAC: Adding query filter params (group.id=1bda7933e7cd46bb88eaf0bc55ad78c4, role.id=280023171b4a45efb67c036ff237bb3c, scope.project.id=5c7af4b1c9fc4f35a95bbc0f95b044f2) {{(pid=352328) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:53:37.473077 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e2327b-1016-4025-a143-15d0867b999e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:53:37.474526 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e2327b-1016-4025-a143-15d0867b999e None admin] RBAC: Authorization granted {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:53:37.477451 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG dbcounter [-] [352328] Writing DB stats keystone:SELECT=100 {{(pid=352328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:53:37.481283 dv-cinder-851351-1-smb devstack@keystone.service[352328]: [pid: 352328|app: 0|req: 224/455] 10.222.0.42 () {56 vars in 1376 bytes} [Thu Jul 28 08:53:37 2022] GET /identity/v3/role_assignments?group.id=1bda7933e7cd46bb88eaf0bc55ad78c4&scope.project.id=5c7af4b1c9fc4f35a95bbc0f95b044f2&role.id=280023171b4a45efb67c036ff237bb3c => generated 611 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:53:40.143725 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd758b66-b528-4a86-a164-3dcff2e975a3 None None] REQUEST_METHOD: `GET` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:53:40.144872 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd758b66-b528-4a86-a164-3dcff2e975a3 None None] SCRIPT_NAME: `/identity` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:53:40.145407 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd758b66-b528-4a86-a164-3dcff2e975a3 None None] PATH_INFO: `/` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:53:40.147058 dv-cinder-851351-1-smb devstack@keystone.service[352329]: [pid: 352329|app: 0|req: 232/456] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 08:53:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 08:53:40.162812 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e6b922-48a9-4fec-9474-7cdb72b7d2de None None] REQUEST_METHOD: `POST` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:53:40.163783 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e6b922-48a9-4fec-9474-7cdb72b7d2de None None] SCRIPT_NAME: `/identity` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:53:40.164268 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e6b922-48a9-4fec-9474-7cdb72b7d2de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:53:40.193741 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.auth.core [None req-61e6b922-48a9-4fec-9474-7cdb72b7d2de None None] MFA Rules not processed for user `d18c063b2377412485965357671e5506`. Rule list: `[]` (Enabled: `True`). {{(pid=352328) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 08:53:40.195288 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.fernet_utils [None req-61e6b922-48a9-4fec-9474-7cdb72b7d2de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=352328) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:53:40.207972 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6784901d-8c1d-4196-927d-6277f7d35f6a None None] REQUEST_METHOD: `GET` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:53:40.208251 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6784901d-8c1d-4196-927d-6277f7d35f6a None None] SCRIPT_NAME: `/identity` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:53:40.208777 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6784901d-8c1d-4196-927d-6277f7d35f6a None None] PATH_INFO: `/` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:53:40.210595 dv-cinder-851351-1-smb devstack@keystone.service[352329]: [pid: 352329|app: 0|req: 233/457] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 08:53:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 08:53:40.216121 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a575bc31-f4fb-40dd-a4cd-c39f1753ec66 None None] REQUEST_METHOD: `POST` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:53:40.216755 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a575bc31-f4fb-40dd-a4cd-c39f1753ec66 None None] SCRIPT_NAME: `/identity` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:53:40.217292 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a575bc31-f4fb-40dd-a4cd-c39f1753ec66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:53:40.236506 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.auth.core [None req-a575bc31-f4fb-40dd-a4cd-c39f1753ec66 None None] MFA Rules not processed for user `d18c063b2377412485965357671e5506`. Rule list: `[]` (Enabled: `True`). {{(pid=352329) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 08:53:40.238117 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.fernet_utils [None req-a575bc31-f4fb-40dd-a4cd-c39f1753ec66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=352329) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:53:40.241895 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG dbcounter [-] [352329] Writing DB stats keystone:SELECT=100 {{(pid=352329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:53:40.285356 dv-cinder-851351-1-smb devstack@keystone.service[352328]: [pid: 352328|app: 0|req: 225/458] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 08:53:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 08:53:40.287130 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df2fd7a-a86d-42f0-a520-13a5ef12913a None None] REQUEST_METHOD: `GET` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:53:40.287661 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df2fd7a-a86d-42f0-a520-13a5ef12913a None None] SCRIPT_NAME: `/identity` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:53:40.288150 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df2fd7a-a86d-42f0-a520-13a5ef12913a None None] PATH_INFO: `/` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:53:40.290103 dv-cinder-851351-1-smb devstack@keystone.service[352328]: [pid: 352328|app: 0|req: 226/459] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 08:53:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 08:53:40.296230 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec8d7b7-8fdf-4334-b259-12b891ffb135 None None] REQUEST_METHOD: `POST` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:53:40.296894 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec8d7b7-8fdf-4334-b259-12b891ffb135 None None] SCRIPT_NAME: `/identity` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:53:40.297411 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec8d7b7-8fdf-4334-b259-12b891ffb135 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:53:40.325789 dv-cinder-851351-1-smb devstack@keystone.service[352329]: [pid: 352329|app: 0|req: 234/460] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 08:53:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 28 08:53:40.326672 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a575bc31-f4fb-40dd-a4cd-c39f1753ec66 None None] Authenticating user token {{(pid=352329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:53:40.329735 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.auth.core [None req-0ec8d7b7-8fdf-4334-b259-12b891ffb135 None None] MFA Rules not processed for user `d18c063b2377412485965357671e5506`. Rule list: `[]` (Enabled: `True`). {{(pid=352328) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 08:53:40.331263 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.fernet_utils [None req-0ec8d7b7-8fdf-4334-b259-12b891ffb135 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=352328) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:53:40.429741 dv-cinder-851351-1-smb devstack@keystone.service[352328]: [pid: 352328|app: 0|req: 227/461] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 08:53:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 08:53:40.430681 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec8d7b7-8fdf-4334-b259-12b891ffb135 None None] Authenticating user token {{(pid=352328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:53:40.480775 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a575bc31-f4fb-40dd-a4cd-c39f1753ec66 None None] Validating token access rules against request {{(pid=352329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:53:40.523543 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba3c417-6f95-4a09-b0f8-800116160a34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:53:40.524244 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba3c417-6f95-4a09-b0f8-800116160a34 None admin] REQUEST_METHOD: `GET` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:53:40.524528 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba3c417-6f95-4a09-b0f8-800116160a34 None admin] SCRIPT_NAME: `/identity` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:53:40.524842 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba3c417-6f95-4a09-b0f8-800116160a34 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:53:40.528753 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG dbcounter [-] [352328] Writing DB stats keystone:SELECT=100 {{(pid=352328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:53:40.535189 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG dbcounter [-] [352329] Writing DB stats keystone:SELECT=100 {{(pid=352329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:53:40.538010 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ba3c417-6f95-4a09-b0f8-800116160a34 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:53:40.539425 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ba3c417-6f95-4a09-b0f8-800116160a34 None admin] RBAC: Authorization granted {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:53:40.562666 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application [None req-2ba3c417-6f95-4a09-b0f8-800116160a34 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 08:53:40.562666 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:53:40.562666 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:53:40.562666 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:53:40.562666 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:53:40.562666 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:53:40.562666 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:53:40.562666 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:53:40.562666 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:53:40.562666 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:53:40.562666 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:53:40.562666 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:53:40.562666 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 08:53:40.562666 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 08:53:40.562666 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 08:53:40.564416 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 08:53:40.564416 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:53:40.564416 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:53:40.564416 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:53:40.564416 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:53:40.564416 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:53:40.564416 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:53:40.564416 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:53:40.564416 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application with Lock( Jul 28 08:53:40.564416 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:53:40.564416 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:53:40.564416 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:53:40.564416 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:53:40.564416 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:53:40.564416 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:53:40.564416 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:53:40.564416 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:53:40.565588 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 08:53:40.565588 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 08:53:40.565588 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 08:53:40.565588 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application Jul 28 08:53:40.565588 dv-cinder-851351-1-smb devstack@keystone.service[352329]: [pid: 352329|app: 0|req: 235/462] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 08:53:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:53:40.565588 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba3c417-6f95-4a09-b0f8-800116160a34 None admin] Authenticating user token {{(pid=352329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:53:40.598505 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec8d7b7-8fdf-4334-b259-12b891ffb135 None None] Validating token access rules against request {{(pid=352328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:53:40.644095 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05bc0719-8003-4d26-a799-2f483d2d0fe8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:53:40.645200 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05bc0719-8003-4d26-a799-2f483d2d0fe8 None admin] REQUEST_METHOD: `GET` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:53:40.645677 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05bc0719-8003-4d26-a799-2f483d2d0fe8 None admin] SCRIPT_NAME: `/identity` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:53:40.646106 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05bc0719-8003-4d26-a799-2f483d2d0fe8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:53:40.662687 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05bc0719-8003-4d26-a799-2f483d2d0fe8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:53:40.664777 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05bc0719-8003-4d26-a799-2f483d2d0fe8 None admin] RBAC: Authorization granted {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:53:40.689049 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application [None req-05bc0719-8003-4d26-a799-2f483d2d0fe8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 08:53:40.689049 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:53:40.689049 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:53:40.689049 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:53:40.689049 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:53:40.689049 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:53:40.689049 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:53:40.689049 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:53:40.689049 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:53:40.689049 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:53:40.689049 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:53:40.689049 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:53:40.689049 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 08:53:40.689049 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 08:53:40.689049 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 08:53:40.690409 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 08:53:40.690409 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:53:40.690409 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:53:40.690409 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:53:40.690409 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:53:40.690409 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:53:40.690409 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:53:40.690409 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:53:40.690409 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application with Lock( Jul 28 08:53:40.690409 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:53:40.690409 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:53:40.690409 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:53:40.690409 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:53:40.690409 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:53:40.690409 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:53:40.690409 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:53:40.690409 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:53:40.691693 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 08:53:40.691693 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 08:53:40.691693 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 08:53:40.691693 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application Jul 28 08:53:40.699241 dv-cinder-851351-1-smb devstack@keystone.service[352328]: [pid: 352328|app: 0|req: 228/463] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 08:53:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 269 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:53:40.702228 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b83266c-8eab-4e92-be7e-c60c6fbec9a2 None None] REQUEST_METHOD: `GET` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:53:40.702228 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b83266c-8eab-4e92-be7e-c60c6fbec9a2 None None] SCRIPT_NAME: `/identity` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:53:40.702562 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b83266c-8eab-4e92-be7e-c60c6fbec9a2 None None] PATH_INFO: `/` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:53:40.703349 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba3c417-6f95-4a09-b0f8-800116160a34 None admin] Validating token access rules against request {{(pid=352329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:53:40.708717 dv-cinder-851351-1-smb devstack@keystone.service[352328]: [pid: 352328|app: 0|req: 229/464] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 08:53:40 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 08:53:40.708717 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b83266c-8eab-4e92-be7e-c60c6fbec9a2 None None] Authenticating user token {{(pid=352328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:53:40.763140 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647db398-a53c-477f-9f0a-5e015b663082 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:53:40.764792 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647db398-a53c-477f-9f0a-5e015b663082 None admin] REQUEST_METHOD: `GET` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:53:40.764792 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647db398-a53c-477f-9f0a-5e015b663082 None admin] SCRIPT_NAME: `/identity` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:53:40.765305 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647db398-a53c-477f-9f0a-5e015b663082 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:53:40.784938 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-647db398-a53c-477f-9f0a-5e015b663082 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:53:40.786502 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-647db398-a53c-477f-9f0a-5e015b663082 None admin] RBAC: Authorization granted {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:53:40.803867 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application [None req-647db398-a53c-477f-9f0a-5e015b663082 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 08:53:40.803867 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:53:40.803867 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:53:40.803867 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:53:40.803867 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:53:40.803867 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:53:40.803867 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:53:40.803867 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:53:40.803867 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:53:40.803867 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:53:40.803867 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:53:40.803867 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:53:40.803867 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 08:53:40.803867 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 08:53:40.803867 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 08:53:40.805203 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 08:53:40.805203 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:53:40.805203 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:53:40.805203 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:53:40.805203 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:53:40.805203 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:53:40.805203 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:53:40.805203 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:53:40.805203 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application with Lock( Jul 28 08:53:40.805203 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:53:40.805203 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:53:40.805203 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:53:40.805203 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:53:40.805203 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:53:40.805203 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:53:40.805203 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:53:40.805203 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:53:40.806402 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 08:53:40.806402 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 08:53:40.806402 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 08:53:40.806402 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application Jul 28 08:53:40.807998 dv-cinder-851351-1-smb devstack@keystone.service[352329]: [pid: 352329|app: 0|req: 236/465] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 08:53:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 243 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:53:40.808994 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647db398-a53c-477f-9f0a-5e015b663082 None admin] Authenticating user token {{(pid=352329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:53:40.854604 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b83266c-8eab-4e92-be7e-c60c6fbec9a2 None None] Validating token access rules against request {{(pid=352328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:53:40.869122 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG dbcounter [-] [352329] Writing DB stats keystone:SELECT=100 {{(pid=352329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:53:40.874258 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG dbcounter [-] [352328] Writing DB stats keystone:SELECT=100 {{(pid=352328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:53:40.899361 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a52d711-f015-4eee-9098-e3312da17900 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:53:40.900635 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a52d711-f015-4eee-9098-e3312da17900 None admin] REQUEST_METHOD: `GET` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:53:40.900944 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a52d711-f015-4eee-9098-e3312da17900 None admin] SCRIPT_NAME: `/identity` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:53:40.901229 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a52d711-f015-4eee-9098-e3312da17900 None admin] PATH_INFO: `/v3/domains` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:53:40.901950 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a52d711-f015-4eee-9098-e3312da17900 None admin] RBAC: Adding query filter params (name=Default) {{(pid=352328) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:53:40.902257 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a52d711-f015-4eee-9098-e3312da17900 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:53:40.903844 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a52d711-f015-4eee-9098-e3312da17900 None admin] RBAC: Authorization granted {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:53:40.926031 dv-cinder-851351-1-smb devstack@keystone.service[352328]: [pid: 352328|app: 0|req: 230/466] 10.222.0.42 () {56 vars in 1109 bytes} [Thu Jul 28 08:53:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:53:40.926031 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b41c43-255a-4d66-97fa-25f5aee4d161 None None] REQUEST_METHOD: `POST` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:53:40.926031 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b41c43-255a-4d66-97fa-25f5aee4d161 None None] SCRIPT_NAME: `/identity` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:53:40.926031 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b41c43-255a-4d66-97fa-25f5aee4d161 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:53:40.946224 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.auth.core [None req-d8b41c43-255a-4d66-97fa-25f5aee4d161 None None] MFA Rules not processed for user `d18c063b2377412485965357671e5506`. Rule list: `[]` (Enabled: `True`). {{(pid=352328) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 08:53:40.947455 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.fernet_utils [None req-d8b41c43-255a-4d66-97fa-25f5aee4d161 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=352328) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:53:40.955302 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647db398-a53c-477f-9f0a-5e015b663082 None admin] Validating token access rules against request {{(pid=352329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:53:40.993307 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f65bd5-da7b-4998-91bc-f436ea11eeed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:53:40.993952 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f65bd5-da7b-4998-91bc-f436ea11eeed None admin] REQUEST_METHOD: `GET` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:53:40.994242 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f65bd5-da7b-4998-91bc-f436ea11eeed None admin] SCRIPT_NAME: `/identity` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:53:40.994518 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f65bd5-da7b-4998-91bc-f436ea11eeed None admin] PATH_INFO: `/v3/domains` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:53:40.995236 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11f65bd5-da7b-4998-91bc-f436ea11eeed None admin] RBAC: Adding query filter params (name=Default) {{(pid=352329) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:53:40.995541 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11f65bd5-da7b-4998-91bc-f436ea11eeed None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:53:40.996985 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11f65bd5-da7b-4998-91bc-f436ea11eeed None admin] RBAC: Authorization granted {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:53:41.017166 dv-cinder-851351-1-smb devstack@keystone.service[352329]: [pid: 352329|app: 0|req: 237/467] 10.222.0.42 () {56 vars in 1109 bytes} [Thu Jul 28 08:53:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:53:41.017166 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f65bd5-da7b-4998-91bc-f436ea11eeed None admin] Authenticating user token {{(pid=352329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:53:41.040752 dv-cinder-851351-1-smb devstack@keystone.service[352328]: [pid: 352328|app: 0|req: 231/468] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 08:53:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 08:53:41.040752 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b41c43-255a-4d66-97fa-25f5aee4d161 None None] Authenticating user token {{(pid=352328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:53:41.130646 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f65bd5-da7b-4998-91bc-f436ea11eeed None admin] Validating token access rules against request {{(pid=352329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:53:41.134025 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG dbcounter [-] [352329] Writing DB stats keystone:SELECT=100 {{(pid=352329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:53:41.153856 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b41c43-255a-4d66-97fa-25f5aee4d161 None None] Validating token access rules against request {{(pid=352328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:53:41.155934 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG dbcounter [-] [352328] Writing DB stats keystone:SELECT=100 {{(pid=352328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:53:41.175848 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5152342a-ca4a-40ce-8048-e9cf79b6d83f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:53:41.176572 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5152342a-ca4a-40ce-8048-e9cf79b6d83f None admin] REQUEST_METHOD: `GET` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:53:41.176809 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5152342a-ca4a-40ce-8048-e9cf79b6d83f None admin] SCRIPT_NAME: `/identity` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:53:41.177083 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5152342a-ca4a-40ce-8048-e9cf79b6d83f None admin] PATH_INFO: `/v3/domains` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:53:41.177797 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5152342a-ca4a-40ce-8048-e9cf79b6d83f None admin] RBAC: Adding query filter params (name=Default) {{(pid=352329) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:53:41.178103 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5152342a-ca4a-40ce-8048-e9cf79b6d83f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:53:41.179643 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5152342a-ca4a-40ce-8048-e9cf79b6d83f None admin] RBAC: Authorization granted {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:53:41.199231 dv-cinder-851351-1-smb devstack@keystone.service[352329]: [pid: 352329|app: 0|req: 238/469] 10.222.0.42 () {56 vars in 1109 bytes} [Thu Jul 28 08:53:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:53:41.199231 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5152342a-ca4a-40ce-8048-e9cf79b6d83f None admin] Authenticating user token {{(pid=352329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:53:41.201935 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89765ae2-52b3-486c-b237-41562e9c0974 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:53:41.202595 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89765ae2-52b3-486c-b237-41562e9c0974 None admin] REQUEST_METHOD: `POST` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:53:41.202857 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89765ae2-52b3-486c-b237-41562e9c0974 None admin] SCRIPT_NAME: `/identity` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:53:41.203148 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89765ae2-52b3-486c-b237-41562e9c0974 None admin] PATH_INFO: `/v3/users` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:53:41.203826 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89765ae2-52b3-486c-b237-41562e9c0974 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:53:41.205742 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89765ae2-52b3-486c-b237-41562e9c0974 None admin] RBAC: Authorization granted {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:53:41.229184 dv-cinder-851351-1-smb devstack@keystone.service[352328]: [pid: 352328|app: 0|req: 232/470] 10.222.0.42 () {60 vars in 1132 bytes} [Thu Jul 28 08:53:41 2022] POST /identity/v3/users => generated 246 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 08:53:41.230048 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89765ae2-52b3-486c-b237-41562e9c0974 None admin] Authenticating user token {{(pid=352328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:53:41.341573 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5152342a-ca4a-40ce-8048-e9cf79b6d83f None admin] Validating token access rules against request {{(pid=352329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:53:41.365397 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89765ae2-52b3-486c-b237-41562e9c0974 None admin] Validating token access rules against request {{(pid=352328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:53:41.389759 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1785b784-06b9-44a5-9dab-480d8cf12c91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:53:41.390899 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1785b784-06b9-44a5-9dab-480d8cf12c91 None admin] REQUEST_METHOD: `POST` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:53:41.391513 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1785b784-06b9-44a5-9dab-480d8cf12c91 None admin] SCRIPT_NAME: `/identity` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:53:41.392053 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1785b784-06b9-44a5-9dab-480d8cf12c91 None admin] PATH_INFO: `/v3/users` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:53:41.393078 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1785b784-06b9-44a5-9dab-480d8cf12c91 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:53:41.395001 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1785b784-06b9-44a5-9dab-480d8cf12c91 None admin] RBAC: Authorization granted {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:53:41.412380 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b929df-6bba-4c59-9ed6-1d56aa91e2f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:53:41.413032 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b929df-6bba-4c59-9ed6-1d56aa91e2f1 None admin] REQUEST_METHOD: `GET` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:53:41.413317 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b929df-6bba-4c59-9ed6-1d56aa91e2f1 None admin] SCRIPT_NAME: `/identity` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:53:41.413591 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b929df-6bba-4c59-9ed6-1d56aa91e2f1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:53:41.428290 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28b929df-6bba-4c59-9ed6-1d56aa91e2f1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:53:41.428290 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28b929df-6bba-4c59-9ed6-1d56aa91e2f1 None admin] RBAC: Authorization granted {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:53:41.429080 dv-cinder-851351-1-smb devstack@keystone.service[352329]: [pid: 352329|app: 0|req: 239/471] 10.222.0.42 () {60 vars in 1132 bytes} [Thu Jul 28 08:53:41 2022] POST /identity/v3/users => generated 248 bytes in 233 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 08:53:41.430135 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1785b784-06b9-44a5-9dab-480d8cf12c91 None admin] Authenticating user token {{(pid=352329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:53:41.446829 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application [None req-28b929df-6bba-4c59-9ed6-1d56aa91e2f1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 08:53:41.446829 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:53:41.446829 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:53:41.446829 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:53:41.446829 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:53:41.446829 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:53:41.446829 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:53:41.446829 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:53:41.446829 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:53:41.446829 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:53:41.446829 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:53:41.446829 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:53:41.446829 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 08:53:41.446829 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 08:53:41.446829 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 08:53:41.448061 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 08:53:41.448061 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:53:41.448061 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:53:41.448061 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:53:41.448061 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:53:41.448061 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:53:41.448061 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:53:41.448061 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:53:41.448061 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application with Lock( Jul 28 08:53:41.448061 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:53:41.448061 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:53:41.448061 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:53:41.448061 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:53:41.448061 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:53:41.448061 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:53:41.448061 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:53:41.448061 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:53:41.449360 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 08:53:41.449360 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 08:53:41.449360 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 08:53:41.449360 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application Jul 28 08:53:41.453384 dv-cinder-851351-1-smb devstack@keystone.service[352328]: [pid: 352328|app: 0|req: 233/472] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 08:53:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:53:41.455253 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b929df-6bba-4c59-9ed6-1d56aa91e2f1 None admin] Authenticating user token {{(pid=352328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:53:41.469363 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG dbcounter [-] [352329] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=352329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:53:41.471603 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG dbcounter [-] [352328] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=352328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:53:41.587633 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1785b784-06b9-44a5-9dab-480d8cf12c91 None admin] Validating token access rules against request {{(pid=352329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:53:41.596957 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b929df-6bba-4c59-9ed6-1d56aa91e2f1 None admin] Validating token access rules against request {{(pid=352328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:53:41.626543 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-407fa014-5dcd-4830-83ac-3ba0800dcf04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:53:41.627198 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407fa014-5dcd-4830-83ac-3ba0800dcf04 None admin] REQUEST_METHOD: `POST` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:53:41.627484 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407fa014-5dcd-4830-83ac-3ba0800dcf04 None admin] SCRIPT_NAME: `/identity` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:53:41.627768 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407fa014-5dcd-4830-83ac-3ba0800dcf04 None admin] PATH_INFO: `/v3/users` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:53:41.628465 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-407fa014-5dcd-4830-83ac-3ba0800dcf04 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:53:41.629999 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-407fa014-5dcd-4830-83ac-3ba0800dcf04 None admin] RBAC: Authorization granted {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:53:41.638853 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-891e60e6-b52e-418c-8463-a8c864f84b48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:53:41.640006 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891e60e6-b52e-418c-8463-a8c864f84b48 None admin] REQUEST_METHOD: `GET` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:53:41.640635 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891e60e6-b52e-418c-8463-a8c864f84b48 None admin] SCRIPT_NAME: `/identity` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:53:41.641154 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891e60e6-b52e-418c-8463-a8c864f84b48 None admin] PATH_INFO: `/v3/domains` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:53:41.642178 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-891e60e6-b52e-418c-8463-a8c864f84b48 None admin] RBAC: Adding query filter params (name=Default) {{(pid=352328) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:53:41.642558 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-891e60e6-b52e-418c-8463-a8c864f84b48 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:53:41.644264 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-891e60e6-b52e-418c-8463-a8c864f84b48 None admin] RBAC: Authorization granted {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:53:41.655088 dv-cinder-851351-1-smb devstack@keystone.service[352329]: [pid: 352329|app: 0|req: 240/473] 10.222.0.42 () {60 vars in 1132 bytes} [Thu Jul 28 08:53:41 2022] POST /identity/v3/users => generated 248 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 08:53:41.659646 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229aa84d-f968-48a2-9d01-70f821626714 None None] REQUEST_METHOD: `GET` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:53:41.659646 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229aa84d-f968-48a2-9d01-70f821626714 None None] SCRIPT_NAME: `/identity` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:53:41.659646 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229aa84d-f968-48a2-9d01-70f821626714 None None] PATH_INFO: `/` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:53:41.660061 dv-cinder-851351-1-smb devstack@keystone.service[352329]: [pid: 352329|app: 0|req: 241/474] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 08:53:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 08:53:41.660353 dv-cinder-851351-1-smb devstack@keystone.service[352328]: [pid: 352328|app: 0|req: 234/475] 10.222.0.42 () {56 vars in 1109 bytes} [Thu Jul 28 08:53:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 08:53:41.666261 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-229aa84d-f968-48a2-9d01-70f821626714 None None] Authenticating user token {{(pid=352329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:53:41.668335 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b620f3-08d2-4a87-8d92-451a1f7f41f4 None None] REQUEST_METHOD: `POST` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:53:41.668641 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b620f3-08d2-4a87-8d92-451a1f7f41f4 None None] SCRIPT_NAME: `/identity` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:53:41.669033 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b620f3-08d2-4a87-8d92-451a1f7f41f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:53:41.703546 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.auth.core [None req-93b620f3-08d2-4a87-8d92-451a1f7f41f4 None None] MFA Rules not processed for user `d18c063b2377412485965357671e5506`. Rule list: `[]` (Enabled: `True`). {{(pid=352328) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 08:53:41.705334 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.fernet_utils [None req-93b620f3-08d2-4a87-8d92-451a1f7f41f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=352328) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:53:41.793225 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG dbcounter [-] [352329] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=352329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:53:41.796478 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG dbcounter [-] [352328] Writing DB stats keystone:SELECT=100 {{(pid=352328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:53:41.803881 dv-cinder-851351-1-smb devstack@keystone.service[352328]: [pid: 352328|app: 0|req: 235/476] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 08:53:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 08:53:41.828269 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-229aa84d-f968-48a2-9d01-70f821626714 None None] Validating token access rules against request {{(pid=352329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:53:41.838944 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b620f3-08d2-4a87-8d92-451a1f7f41f4 None None] Authenticating user token {{(pid=352328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:53:41.872215 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3feed0-3d68-4264-a09d-c833513bfdda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:53:41.873419 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3feed0-3d68-4264-a09d-c833513bfdda None admin] REQUEST_METHOD: `POST` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:53:41.873934 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3feed0-3d68-4264-a09d-c833513bfdda None admin] SCRIPT_NAME: `/identity` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:53:41.874530 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3feed0-3d68-4264-a09d-c833513bfdda None admin] PATH_INFO: `/v3/users` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:53:41.875630 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d3feed0-3d68-4264-a09d-c833513bfdda None admin] RBAC: Authorizing `identity:create_user()` {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:53:41.877664 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d3feed0-3d68-4264-a09d-c833513bfdda None admin] RBAC: Authorization granted {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:53:41.902149 dv-cinder-851351-1-smb devstack@keystone.service[352329]: [pid: 352329|app: 0|req: 242/477] 10.222.0.42 () {60 vars in 1132 bytes} [Thu Jul 28 08:53:41 2022] POST /identity/v3/users => generated 249 bytes in 236 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 08:53:41.977124 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b620f3-08d2-4a87-8d92-451a1f7f41f4 None None] Validating token access rules against request {{(pid=352328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:53:42.036511 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb9a876-4e64-435f-a280-8b5abb67553a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:53:42.037210 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb9a876-4e64-435f-a280-8b5abb67553a None admin] REQUEST_METHOD: `POST` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:53:42.037494 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb9a876-4e64-435f-a280-8b5abb67553a None admin] SCRIPT_NAME: `/identity` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:53:42.037767 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb9a876-4e64-435f-a280-8b5abb67553a None admin] PATH_INFO: `/v3/roles` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:53:42.038519 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb9a876-4e64-435f-a280-8b5abb67553a None admin] RBAC: Authorizing `identity:create_role()` {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:53:42.039966 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb9a876-4e64-435f-a280-8b5abb67553a None admin] RBAC: Authorization granted {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:53:42.052220 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.sql.core [None req-4eb9a876-4e64-435f-a280-8b5abb67553a None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jul 28 08:53:42.052220 dv-cinder-851351-1-smb devstack@keystone.service[352328]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Jul 28 08:53:42.052220 dv-cinder-851351-1-smb devstack@keystone.service[352328]: [parameters: {'id': '6fdee2bf5afc4dceaff2ce2ae701c7ab', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Jul 28 08:53:42.052220 dv-cinder-851351-1-smb devstack@keystone.service[352328]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=352328) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jul 28 08:53:42.069927 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application [None req-4eb9a876-4e64-435f-a280-8b5abb67553a None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Jul 28 08:53:42.069927 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:53:42.069927 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 28 08:53:42.069927 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 28 08:53:42.069927 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 28 08:53:42.069927 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 28 08:53:42.069927 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 28 08:53:42.069927 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application result = self._query(query) Jul 28 08:53:42.069927 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 28 08:53:42.069927 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application conn.query(q) Jul 28 08:53:42.069927 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 28 08:53:42.069927 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 28 08:53:42.069927 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 28 08:53:42.069927 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application result.read() Jul 28 08:53:42.069927 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 28 08:53:42.071272 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 28 08:53:42.071272 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 28 08:53:42.071272 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 28 08:53:42.071272 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 28 08:53:42.071272 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 28 08:53:42.071272 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 28 08:53:42.071272 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 28 08:53:42.071272 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jul 28 08:53:42.071272 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application Jul 28 08:53:42.071272 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jul 28 08:53:42.071272 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application Jul 28 08:53:42.071272 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:53:42.071272 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jul 28 08:53:42.071272 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jul 28 08:53:42.071272 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role Jul 28 08:53:42.071272 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return ref.to_dict() Jul 28 08:53:42.071272 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 28 08:53:42.071272 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application next(self.gen) Jul 28 08:53:42.072484 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jul 28 08:53:42.072484 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application yield resource Jul 28 08:53:42.072484 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 28 08:53:42.072484 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application next(self.gen) Jul 28 08:53:42.072484 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jul 28 08:53:42.072484 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application self.session.rollback() Jul 28 08:53:42.072484 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 28 08:53:42.072484 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application self.force_reraise() Jul 28 08:53:42.072484 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 28 08:53:42.072484 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application raise self.value Jul 28 08:53:42.072484 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jul 28 08:53:42.072484 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jul 28 08:53:42.072484 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jul 28 08:53:42.072484 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application session.commit() Jul 28 08:53:42.072484 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jul 28 08:53:42.072484 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jul 28 08:53:42.072484 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jul 28 08:53:42.075359 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application self._prepare_impl() Jul 28 08:53:42.075359 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jul 28 08:53:42.075359 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application self.session.flush() Jul 28 08:53:42.075359 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jul 28 08:53:42.075359 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application self._flush(objects) Jul 28 08:53:42.075359 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jul 28 08:53:42.075359 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jul 28 08:53:42.075359 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jul 28 08:53:42.075359 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application compat.raise_( Jul 28 08:53:42.075359 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 28 08:53:42.075359 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application raise exception Jul 28 08:53:42.075359 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jul 28 08:53:42.075359 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application flush_context.execute() Jul 28 08:53:42.075359 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jul 28 08:53:42.075359 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application rec.execute(self) Jul 28 08:53:42.075359 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jul 28 08:53:42.075359 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jul 28 08:53:42.077852 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jul 28 08:53:42.077852 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application _emit_insert_statements( Jul 28 08:53:42.077852 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Jul 28 08:53:42.077852 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application c = connection._execute_20( Jul 28 08:53:42.077852 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jul 28 08:53:42.077852 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jul 28 08:53:42.077852 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Jul 28 08:53:42.077852 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jul 28 08:53:42.077852 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jul 28 08:53:42.077852 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application ret = self._execute_context( Jul 28 08:53:42.077852 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jul 28 08:53:42.077852 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jul 28 08:53:42.077852 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jul 28 08:53:42.077852 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jul 28 08:53:42.077852 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 28 08:53:42.077852 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application raise exception Jul 28 08:53:42.080525 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 28 08:53:42.080525 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 28 08:53:42.080525 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 28 08:53:42.080525 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 28 08:53:42.080525 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 28 08:53:42.080525 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application result = self._query(query) Jul 28 08:53:42.080525 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 28 08:53:42.080525 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application conn.query(q) Jul 28 08:53:42.080525 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 28 08:53:42.080525 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 28 08:53:42.080525 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 28 08:53:42.080525 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application result.read() Jul 28 08:53:42.080525 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 28 08:53:42.080525 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 28 08:53:42.080525 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 28 08:53:42.080525 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 28 08:53:42.082185 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 28 08:53:42.082185 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 28 08:53:42.082185 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 28 08:53:42.082185 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 28 08:53:42.082185 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jul 28 08:53:42.082185 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Jul 28 08:53:42.082185 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application [parameters: {'id': '6fdee2bf5afc4dceaff2ce2ae701c7ab', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Jul 28 08:53:42.082185 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jul 28 08:53:42.082185 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application Jul 28 08:53:42.082185 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 28 08:53:42.082185 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application Jul 28 08:53:42.082185 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:53:42.082185 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:53:42.082185 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:53:42.082185 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:53:42.082185 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:53:42.083455 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:53:42.083455 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:53:42.083455 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:53:42.083455 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:53:42.083455 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:53:42.083455 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:53:42.083455 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post Jul 28 08:53:42.083455 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( Jul 28 08:53:42.083455 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:53:42.083455 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:53:42.083455 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role Jul 28 08:53:42.083455 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) Jul 28 08:53:42.083455 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jul 28 08:53:42.083455 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jul 28 08:53:42.083455 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Jul 28 08:53:42.083455 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application Jul 28 08:53:42.089999 dv-cinder-851351-1-smb devstack@keystone.service[352328]: [pid: 352328|app: 0|req: 236/478] 10.222.0.42 () {60 vars in 1131 bytes} [Thu Jul 28 08:53:41 2022] POST /identity/v3/roles => generated 144 bytes in 233 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:53:42.090126 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3feed0-3d68-4264-a09d-c833513bfdda None admin] Authenticating user token {{(pid=352329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:53:42.216586 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3feed0-3d68-4264-a09d-c833513bfdda None admin] Validating token access rules against request {{(pid=352329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:53:42.251533 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG dbcounter [-] [352329] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=352329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:53:42.258912 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e530d70a-6e6b-4ed0-bf33-a0e7cf8cf430 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:53:42.260049 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e530d70a-6e6b-4ed0-bf33-a0e7cf8cf430 None admin] REQUEST_METHOD: `GET` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:53:42.260562 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e530d70a-6e6b-4ed0-bf33-a0e7cf8cf430 None admin] SCRIPT_NAME: `/identity` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:53:42.261118 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e530d70a-6e6b-4ed0-bf33-a0e7cf8cf430 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:53:42.273875 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e530d70a-6e6b-4ed0-bf33-a0e7cf8cf430 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 08:53:42.280222 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application [None req-e530d70a-6e6b-4ed0-bf33-a0e7cf8cf430 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 28 08:53:42.280222 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:53:42.280222 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:53:42.280222 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:53:42.280222 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:53:42.280222 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:53:42.280222 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:53:42.280222 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:53:42.280222 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:53:42.280222 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:53:42.280222 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:53:42.280222 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:53:42.280222 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 08:53:42.280222 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 08:53:42.280222 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 08:53:42.280222 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 08:53:42.281523 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 08:53:42.281523 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 08:53:42.281523 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 08:53:42.281523 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 08:53:42.281523 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:53:42.281523 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:53:42.281523 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:53:42.281523 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:53:42.281523 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:53:42.281523 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:53:42.281523 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:53:42.281523 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application with Lock( Jul 28 08:53:42.281523 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:53:42.281523 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:53:42.281523 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:53:42.281523 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:53:42.282615 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:53:42.282615 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:53:42.282615 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:53:42.282615 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:53:42.282615 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 08:53:42.282615 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 08:53:42.282615 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 08:53:42.282615 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 08:53:42.282615 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 08:53:42.282615 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 08:53:42.282615 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 28 08:53:42.282615 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application Jul 28 08:53:42.290093 dv-cinder-851351-1-smb devstack@keystone.service[352329]: [pid: 352329|app: 0|req: 243/479] 10.222.0.42 () {56 vars in 1114 bytes} [Thu Jul 28 08:53:42 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:53:42.293795 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb9a876-4e64-435f-a280-8b5abb67553a None admin] Authenticating user token {{(pid=352328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:53:42.370485 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG dbcounter [-] [352328] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=352328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:53:42.428139 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb9a876-4e64-435f-a280-8b5abb67553a None admin] Validating token access rules against request {{(pid=352328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:53:42.475397 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0977fe6c-4365-4509-9130-a4c17fa9b439 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:53:42.475971 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0977fe6c-4365-4509-9130-a4c17fa9b439 None admin] REQUEST_METHOD: `GET` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:53:42.476248 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0977fe6c-4365-4509-9130-a4c17fa9b439 None admin] SCRIPT_NAME: `/identity` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:53:42.476518 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0977fe6c-4365-4509-9130-a4c17fa9b439 None admin] PATH_INFO: `/v3/roles` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:53:42.477321 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0977fe6c-4365-4509-9130-a4c17fa9b439 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=352328) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:53:42.477626 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0977fe6c-4365-4509-9130-a4c17fa9b439 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:53:42.479112 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0977fe6c-4365-4509-9130-a4c17fa9b439 None admin] RBAC: Authorization granted {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:53:42.490099 dv-cinder-851351-1-smb devstack@keystone.service[352328]: [pid: 352328|app: 0|req: 237/480] 10.222.0.42 () {56 vars in 1111 bytes} [Thu Jul 28 08:53:42 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:53:43.921594 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84de1e0e-ebbf-46db-be8e-7c91ea6c8eac None None] REQUEST_METHOD: `GET` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:53:43.922704 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84de1e0e-ebbf-46db-be8e-7c91ea6c8eac None None] SCRIPT_NAME: `/identity` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:53:43.923294 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84de1e0e-ebbf-46db-be8e-7c91ea6c8eac None None] PATH_INFO: `/` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:53:43.925293 dv-cinder-851351-1-smb devstack@keystone.service[352329]: [pid: 352329|app: 0|req: 244/481] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 08:53:43 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 08:53:43.932071 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab02850c-44a3-462d-8e27-a6866924f6d7 None None] REQUEST_METHOD: `POST` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:53:43.932644 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab02850c-44a3-462d-8e27-a6866924f6d7 None None] SCRIPT_NAME: `/identity` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:53:43.932644 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab02850c-44a3-462d-8e27-a6866924f6d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:53:43.961858 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.auth.core [None req-ab02850c-44a3-462d-8e27-a6866924f6d7 None None] MFA Rules not processed for user `d18c063b2377412485965357671e5506`. Rule list: `[]` (Enabled: `True`). {{(pid=352328) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 08:53:43.963087 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.fernet_utils [None req-ab02850c-44a3-462d-8e27-a6866924f6d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=352328) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:53:44.043507 dv-cinder-851351-1-smb devstack@keystone.service[352328]: [pid: 352328|app: 0|req: 238/482] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 08:53:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 28 08:53:44.083820 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84de1e0e-ebbf-46db-be8e-7c91ea6c8eac None None] Authenticating user token {{(pid=352329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:53:44.176736 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7d58fc-3525-4e23-90f1-57127ee86f17 None None] REQUEST_METHOD: `GET` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:53:44.177185 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7d58fc-3525-4e23-90f1-57127ee86f17 None None] SCRIPT_NAME: `/identity` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:53:44.177550 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7d58fc-3525-4e23-90f1-57127ee86f17 None None] PATH_INFO: `/` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:53:44.179286 dv-cinder-851351-1-smb devstack@keystone.service[352328]: [pid: 352328|app: 0|req: 239/483] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 08:53:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 08:53:44.185306 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9dbea9-7f92-49c9-b622-186c7a229921 None None] REQUEST_METHOD: `POST` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:53:44.185688 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9dbea9-7f92-49c9-b622-186c7a229921 None None] SCRIPT_NAME: `/identity` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:53:44.186183 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9dbea9-7f92-49c9-b622-186c7a229921 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:53:44.209655 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.auth.core [None req-2d9dbea9-7f92-49c9-b622-186c7a229921 None None] MFA Rules not processed for user `d18c063b2377412485965357671e5506`. Rule list: `[]` (Enabled: `True`). {{(pid=352328) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 08:53:44.211154 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.fernet_utils [None req-2d9dbea9-7f92-49c9-b622-186c7a229921 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=352328) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:53:44.238398 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84de1e0e-ebbf-46db-be8e-7c91ea6c8eac None None] Validating token access rules against request {{(pid=352329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:53:44.275366 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG dbcounter [-] [352328] Writing DB stats keystone:SELECT=100 {{(pid=352328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:53:44.297867 dv-cinder-851351-1-smb devstack@keystone.service[352328]: [pid: 352328|app: 0|req: 240/484] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 08:53:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 28 08:53:44.304767 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a29682-0015-4585-8ac9-51075e1e8132 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:53:44.304767 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a29682-0015-4585-8ac9-51075e1e8132 None admin] REQUEST_METHOD: `GET` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:53:44.304767 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a29682-0015-4585-8ac9-51075e1e8132 None admin] SCRIPT_NAME: `/identity` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:53:44.304767 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a29682-0015-4585-8ac9-51075e1e8132 None admin] PATH_INFO: `/v3/roles/service` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:53:44.324146 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9dbea9-7f92-49c9-b622-186c7a229921 None None] Authenticating user token {{(pid=352328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:53:44.329786 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37a29682-0015-4585-8ac9-51075e1e8132 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 08:53:44.335052 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application [None req-37a29682-0015-4585-8ac9-51075e1e8132 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 28 08:53:44.335052 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:53:44.335052 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:53:44.335052 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:53:44.335052 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:53:44.335052 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:53:44.335052 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:53:44.335052 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:53:44.335052 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:53:44.335052 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:53:44.335052 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:53:44.335052 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:53:44.335052 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 08:53:44.335052 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 08:53:44.335052 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 08:53:44.335052 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 08:53:44.336357 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 08:53:44.336357 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 08:53:44.336357 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 08:53:44.336357 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 08:53:44.336357 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:53:44.336357 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:53:44.336357 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:53:44.336357 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:53:44.336357 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:53:44.336357 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:53:44.336357 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:53:44.336357 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application with Lock( Jul 28 08:53:44.336357 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:53:44.336357 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:53:44.336357 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:53:44.336357 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:53:44.337421 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:53:44.337421 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:53:44.337421 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:53:44.337421 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:53:44.337421 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 08:53:44.337421 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 08:53:44.337421 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 08:53:44.337421 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 08:53:44.337421 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 08:53:44.337421 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 08:53:44.337421 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 28 08:53:44.337421 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application Jul 28 08:53:44.337421 dv-cinder-851351-1-smb devstack@keystone.service[352329]: [pid: 352329|app: 0|req: 245/485] 10.222.0.42 () {56 vars in 1102 bytes} [Thu Jul 28 08:53:44 2022] GET /identity/v3/roles/service => generated 85 bytes in 253 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:53:44.342520 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a29682-0015-4585-8ac9-51075e1e8132 None admin] Authenticating user token {{(pid=352329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:53:44.429215 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG dbcounter [-] [352329] Writing DB stats keystone:SELECT=100 {{(pid=352329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:53:44.460974 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9dbea9-7f92-49c9-b622-186c7a229921 None None] Validating token access rules against request {{(pid=352328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:53:44.511240 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f8a2551-e3f0-48f5-9f63-aa5323dce4f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:53:44.513313 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8a2551-e3f0-48f5-9f63-aa5323dce4f3 None admin] REQUEST_METHOD: `GET` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:53:44.513904 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8a2551-e3f0-48f5-9f63-aa5323dce4f3 None admin] SCRIPT_NAME: `/identity` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:53:44.514651 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8a2551-e3f0-48f5-9f63-aa5323dce4f3 None admin] PATH_INFO: `/v3/roles/service` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:53:44.521568 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a29682-0015-4585-8ac9-51075e1e8132 None admin] Validating token access rules against request {{(pid=352329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:53:44.535203 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f8a2551-e3f0-48f5-9f63-aa5323dce4f3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 08:53:44.545531 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application [None req-8f8a2551-e3f0-48f5-9f63-aa5323dce4f3 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 28 08:53:44.545531 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:53:44.545531 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:53:44.545531 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:53:44.545531 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:53:44.545531 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:53:44.545531 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:53:44.545531 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:53:44.545531 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:53:44.545531 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:53:44.545531 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:53:44.545531 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:53:44.545531 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 08:53:44.545531 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 08:53:44.545531 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 08:53:44.545531 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 08:53:44.546780 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 08:53:44.546780 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 08:53:44.546780 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 08:53:44.546780 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 08:53:44.546780 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:53:44.546780 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:53:44.546780 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:53:44.546780 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:53:44.546780 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:53:44.546780 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:53:44.546780 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:53:44.546780 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application with Lock( Jul 28 08:53:44.546780 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:53:44.546780 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:53:44.546780 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:53:44.546780 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:53:44.547829 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:53:44.547829 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:53:44.547829 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:53:44.547829 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:53:44.547829 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 08:53:44.547829 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 08:53:44.547829 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 08:53:44.547829 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 08:53:44.547829 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 08:53:44.547829 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 08:53:44.547829 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 28 08:53:44.547829 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application Jul 28 08:53:44.552657 dv-cinder-851351-1-smb devstack@keystone.service[352328]: [pid: 352328|app: 0|req: 241/486] 10.222.0.42 () {56 vars in 1102 bytes} [Thu Jul 28 08:53:44 2022] GET /identity/v3/roles/service => generated 85 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 08:53:44.559995 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23167096-5dcc-4d44-b446-4233e36aa176 None None] REQUEST_METHOD: `GET` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:53:44.560331 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23167096-5dcc-4d44-b446-4233e36aa176 None None] SCRIPT_NAME: `/identity` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:53:44.560538 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23167096-5dcc-4d44-b446-4233e36aa176 None None] PATH_INFO: `/` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:53:44.563849 dv-cinder-851351-1-smb devstack@keystone.service[352328]: [pid: 352328|app: 0|req: 242/487] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 08:53:44 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 08:53:44.564933 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23167096-5dcc-4d44-b446-4233e36aa176 None None] Authenticating user token {{(pid=352328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:53:44.583403 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93becf6-9d64-4c2e-ba51-45bb33b3984d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:53:44.584476 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93becf6-9d64-4c2e-ba51-45bb33b3984d None admin] REQUEST_METHOD: `GET` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:53:44.584796 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93becf6-9d64-4c2e-ba51-45bb33b3984d None admin] SCRIPT_NAME: `/identity` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:53:44.585074 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93becf6-9d64-4c2e-ba51-45bb33b3984d None admin] PATH_INFO: `/v3/roles` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:53:44.586308 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f93becf6-9d64-4c2e-ba51-45bb33b3984d None admin] RBAC: Adding query filter params (name=service) {{(pid=352329) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:53:44.586870 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f93becf6-9d64-4c2e-ba51-45bb33b3984d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:53:44.590183 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f93becf6-9d64-4c2e-ba51-45bb33b3984d None admin] RBAC: Authorization granted {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:53:44.602346 dv-cinder-851351-1-smb devstack@keystone.service[352329]: [pid: 352329|app: 0|req: 246/488] 10.222.0.42 () {56 vars in 1103 bytes} [Thu Jul 28 08:53:44 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 08:53:44.608565 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebfec89-350a-4c9a-b9b2-6290e1f6547d None None] REQUEST_METHOD: `POST` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:53:44.608886 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebfec89-350a-4c9a-b9b2-6290e1f6547d None None] SCRIPT_NAME: `/identity` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:53:44.609158 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebfec89-350a-4c9a-b9b2-6290e1f6547d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:53:44.634624 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.auth.core [None req-6ebfec89-350a-4c9a-b9b2-6290e1f6547d None None] MFA Rules not processed for user `d18c063b2377412485965357671e5506`. Rule list: `[]` (Enabled: `True`). {{(pid=352329) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 08:53:44.636014 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.fernet_utils [None req-6ebfec89-350a-4c9a-b9b2-6290e1f6547d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=352329) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:53:44.646501 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG dbcounter [-] [352328] Writing DB stats keystone:SELECT=100 {{(pid=352328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:53:44.753693 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23167096-5dcc-4d44-b446-4233e36aa176 None None] Validating token access rules against request {{(pid=352328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:53:44.786889 dv-cinder-851351-1-smb devstack@keystone.service[352329]: [pid: 352329|app: 0|req: 247/489] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 08:53:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 08:53:44.788333 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ebfec89-350a-4c9a-b9b2-6290e1f6547d None None] Authenticating user token {{(pid=352329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:53:44.845676 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a8c385-ca52-4572-a6bd-da3bde6ec232 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:53:44.846288 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a8c385-ca52-4572-a6bd-da3bde6ec232 None admin] REQUEST_METHOD: `GET` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:53:44.846578 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a8c385-ca52-4572-a6bd-da3bde6ec232 None admin] SCRIPT_NAME: `/identity` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:53:44.846854 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a8c385-ca52-4572-a6bd-da3bde6ec232 None admin] PATH_INFO: `/v3/roles` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:53:44.847639 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36a8c385-ca52-4572-a6bd-da3bde6ec232 None admin] RBAC: Adding query filter params (name=service) {{(pid=352328) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:53:44.847940 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36a8c385-ca52-4572-a6bd-da3bde6ec232 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:53:44.849407 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36a8c385-ca52-4572-a6bd-da3bde6ec232 None admin] RBAC: Authorization granted {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:53:44.853017 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG dbcounter [-] [352329] Writing DB stats keystone:SELECT=100 {{(pid=352329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:53:44.869355 dv-cinder-851351-1-smb devstack@keystone.service[352328]: [pid: 352328|app: 0|req: 243/490] 10.222.0.42 () {56 vars in 1103 bytes} [Thu Jul 28 08:53:44 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 301 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:53:44.869355 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978d28c1-44c5-44d6-a243-8f41255dcda3 None None] REQUEST_METHOD: `GET` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:53:44.869355 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978d28c1-44c5-44d6-a243-8f41255dcda3 None None] SCRIPT_NAME: `/identity` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:53:44.869355 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978d28c1-44c5-44d6-a243-8f41255dcda3 None None] PATH_INFO: `/` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:53:44.869355 dv-cinder-851351-1-smb devstack@keystone.service[352328]: [pid: 352328|app: 0|req: 244/491] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 08:53:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 08:53:44.869355 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-978d28c1-44c5-44d6-a243-8f41255dcda3 None None] Authenticating user token {{(pid=352328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:53:44.929459 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ebfec89-350a-4c9a-b9b2-6290e1f6547d None None] Validating token access rules against request {{(pid=352329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:53:44.975355 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-779b91e1-9e11-4d97-8b69-a094dea47a30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:53:44.977523 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779b91e1-9e11-4d97-8b69-a094dea47a30 None admin] REQUEST_METHOD: `GET` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:53:44.978143 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779b91e1-9e11-4d97-8b69-a094dea47a30 None admin] SCRIPT_NAME: `/identity` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:53:44.978695 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779b91e1-9e11-4d97-8b69-a094dea47a30 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:53:44.981258 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-978d28c1-44c5-44d6-a243-8f41255dcda3 None None] Validating token access rules against request {{(pid=352328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:53:44.995329 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG dbcounter [-] [352328] Writing DB stats keystone:SELECT=100 {{(pid=352328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:53:44.998543 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-779b91e1-9e11-4d97-8b69-a094dea47a30 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:53:45.000552 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-779b91e1-9e11-4d97-8b69-a094dea47a30 None admin] RBAC: Authorization granted {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:53:45.031383 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application [None req-779b91e1-9e11-4d97-8b69-a094dea47a30 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 08:53:45.031383 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:53:45.031383 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:53:45.031383 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:53:45.031383 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:53:45.031383 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:53:45.031383 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:53:45.031383 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:53:45.031383 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:53:45.031383 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:53:45.031383 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:53:45.031383 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:53:45.031383 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 08:53:45.031383 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 08:53:45.031383 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 08:53:45.032921 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 08:53:45.032921 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:53:45.032921 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:53:45.032921 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:53:45.032921 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:53:45.032921 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:53:45.032921 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:53:45.032921 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:53:45.032921 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application with Lock( Jul 28 08:53:45.032921 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:53:45.032921 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:53:45.032921 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:53:45.032921 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:53:45.032921 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:53:45.032921 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:53:45.032921 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:53:45.032921 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:53:45.034187 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 08:53:45.034187 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 08:53:45.034187 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 08:53:45.034187 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application Jul 28 08:53:45.034187 dv-cinder-851351-1-smb devstack@keystone.service[352329]: [pid: 352329|app: 0|req: 248/492] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 08:53:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 245 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:53:45.034187 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-779b91e1-9e11-4d97-8b69-a094dea47a30 None admin] Authenticating user token {{(pid=352329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:53:45.054739 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a1114ae-f8a8-423e-ae27-97c9e48f686b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:53:45.055405 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1114ae-f8a8-423e-ae27-97c9e48f686b None admin] REQUEST_METHOD: `GET` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:53:45.055687 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1114ae-f8a8-423e-ae27-97c9e48f686b None admin] SCRIPT_NAME: `/identity` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:53:45.055977 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1114ae-f8a8-423e-ae27-97c9e48f686b None admin] PATH_INFO: `/v3/roles/service` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:53:45.071794 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a1114ae-f8a8-423e-ae27-97c9e48f686b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 08:53:45.080697 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application [None req-6a1114ae-f8a8-423e-ae27-97c9e48f686b None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 28 08:53:45.080697 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:53:45.080697 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:53:45.080697 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:53:45.080697 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:53:45.080697 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:53:45.080697 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:53:45.080697 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:53:45.080697 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:53:45.080697 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:53:45.080697 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:53:45.080697 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:53:45.080697 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 08:53:45.080697 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 08:53:45.080697 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 08:53:45.080697 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 08:53:45.082043 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 08:53:45.082043 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 08:53:45.082043 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 08:53:45.082043 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 08:53:45.082043 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:53:45.082043 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:53:45.082043 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:53:45.082043 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:53:45.082043 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:53:45.082043 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:53:45.082043 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:53:45.082043 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application with Lock( Jul 28 08:53:45.082043 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:53:45.082043 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:53:45.082043 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:53:45.082043 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:53:45.083061 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:53:45.083061 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:53:45.083061 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:53:45.083061 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:53:45.083061 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 08:53:45.083061 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 08:53:45.083061 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 08:53:45.083061 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 08:53:45.083061 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 08:53:45.083061 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 08:53:45.083061 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 28 08:53:45.083061 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application Jul 28 08:53:45.083061 dv-cinder-851351-1-smb devstack@keystone.service[352328]: [pid: 352328|app: 0|req: 245/493] 10.222.0.42 () {56 vars in 1102 bytes} [Thu Jul 28 08:53:44 2022] GET /identity/v3/roles/service => generated 85 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:53:45.085193 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055b20a5-1cc7-4347-ad60-01f5be3d1c6b None None] REQUEST_METHOD: `POST` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:53:45.085193 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055b20a5-1cc7-4347-ad60-01f5be3d1c6b None None] SCRIPT_NAME: `/identity` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:53:45.085193 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055b20a5-1cc7-4347-ad60-01f5be3d1c6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:53:45.113153 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.auth.core [None req-055b20a5-1cc7-4347-ad60-01f5be3d1c6b None None] MFA Rules not processed for user `d18c063b2377412485965357671e5506`. Rule list: `[]` (Enabled: `True`). {{(pid=352328) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 08:53:45.115909 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.fernet_utils [None req-055b20a5-1cc7-4347-ad60-01f5be3d1c6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=352328) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:53:45.162617 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG dbcounter [-] [352329] Writing DB stats keystone:SELECT=100 {{(pid=352329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:53:45.171065 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-779b91e1-9e11-4d97-8b69-a094dea47a30 None admin] Validating token access rules against request {{(pid=352329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:53:45.200720 dv-cinder-851351-1-smb devstack@keystone.service[352328]: [pid: 352328|app: 0|req: 246/494] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 08:53:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 08:53:45.200720 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-055b20a5-1cc7-4347-ad60-01f5be3d1c6b None None] Authenticating user token {{(pid=352328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:53:45.222697 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e9c171-8528-46da-a070-3f47bacf0b8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:53:45.223902 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e9c171-8528-46da-a070-3f47bacf0b8d None admin] REQUEST_METHOD: `GET` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:53:45.224192 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e9c171-8528-46da-a070-3f47bacf0b8d None admin] SCRIPT_NAME: `/identity` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:53:45.224615 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e9c171-8528-46da-a070-3f47bacf0b8d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:53:45.238904 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83e9c171-8528-46da-a070-3f47bacf0b8d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:53:45.240500 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83e9c171-8528-46da-a070-3f47bacf0b8d None admin] RBAC: Authorization granted {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:53:45.255700 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application [None req-83e9c171-8528-46da-a070-3f47bacf0b8d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 08:53:45.255700 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:53:45.255700 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:53:45.255700 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:53:45.255700 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:53:45.255700 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:53:45.255700 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:53:45.255700 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:53:45.255700 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:53:45.255700 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:53:45.255700 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:53:45.255700 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:53:45.255700 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 08:53:45.255700 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 08:53:45.255700 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 08:53:45.256992 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 08:53:45.256992 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:53:45.256992 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:53:45.256992 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:53:45.256992 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:53:45.256992 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:53:45.256992 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:53:45.256992 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:53:45.256992 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application with Lock( Jul 28 08:53:45.256992 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:53:45.256992 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:53:45.256992 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:53:45.256992 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:53:45.256992 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:53:45.256992 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:53:45.256992 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:53:45.256992 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:53:45.258083 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 08:53:45.258083 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 08:53:45.258083 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 08:53:45.258083 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application Jul 28 08:53:45.258083 dv-cinder-851351-1-smb devstack@keystone.service[352329]: [pid: 352329|app: 0|req: 249/495] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 08:53:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:53:45.258083 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e9c171-8528-46da-a070-3f47bacf0b8d None admin] Authenticating user token {{(pid=352329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:53:45.306628 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG dbcounter [-] [352328] Writing DB stats keystone:SELECT=100 {{(pid=352328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:53:45.310668 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-055b20a5-1cc7-4347-ad60-01f5be3d1c6b None None] Validating token access rules against request {{(pid=352328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:53:45.347742 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41537e4f-fb45-4e86-b684-a37a19a9227c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:53:45.348480 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41537e4f-fb45-4e86-b684-a37a19a9227c None admin] REQUEST_METHOD: `GET` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:53:45.348792 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41537e4f-fb45-4e86-b684-a37a19a9227c None admin] SCRIPT_NAME: `/identity` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:53:45.349069 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41537e4f-fb45-4e86-b684-a37a19a9227c None admin] PATH_INFO: `/v3/domains` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:53:45.349896 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41537e4f-fb45-4e86-b684-a37a19a9227c None admin] RBAC: Adding query filter params (name=Default) {{(pid=352328) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:53:45.350198 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41537e4f-fb45-4e86-b684-a37a19a9227c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:53:45.351595 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41537e4f-fb45-4e86-b684-a37a19a9227c None admin] RBAC: Authorization granted {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:53:45.363586 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e9c171-8528-46da-a070-3f47bacf0b8d None admin] Validating token access rules against request {{(pid=352329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:53:45.368911 dv-cinder-851351-1-smb devstack@keystone.service[352328]: [pid: 352328|app: 0|req: 247/496] 10.222.0.42 () {56 vars in 1109 bytes} [Thu Jul 28 08:53:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:53:45.370078 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41537e4f-fb45-4e86-b684-a37a19a9227c None admin] Authenticating user token {{(pid=352328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:53:45.400191 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a1c010-4b4c-4e38-9175-b2b1a3fc108f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:53:45.400872 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a1c010-4b4c-4e38-9175-b2b1a3fc108f None admin] REQUEST_METHOD: `GET` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:53:45.401152 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a1c010-4b4c-4e38-9175-b2b1a3fc108f None admin] SCRIPT_NAME: `/identity` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:53:45.401425 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a1c010-4b4c-4e38-9175-b2b1a3fc108f None admin] PATH_INFO: `/v3/roles` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:53:45.402154 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74a1c010-4b4c-4e38-9175-b2b1a3fc108f None admin] RBAC: Adding query filter params (name=service) {{(pid=352329) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:53:45.402457 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74a1c010-4b4c-4e38-9175-b2b1a3fc108f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:53:45.403885 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74a1c010-4b4c-4e38-9175-b2b1a3fc108f None admin] RBAC: Authorization granted {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:53:45.412180 dv-cinder-851351-1-smb devstack@keystone.service[352329]: [pid: 352329|app: 0|req: 250/497] 10.222.0.42 () {56 vars in 1103 bytes} [Thu Jul 28 08:53:45 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:53:45.413023 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a1c010-4b4c-4e38-9175-b2b1a3fc108f None admin] Authenticating user token {{(pid=352329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:53:45.426982 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG dbcounter [-] [352329] Writing DB stats keystone:SELECT=100 {{(pid=352329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:53:45.485699 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41537e4f-fb45-4e86-b684-a37a19a9227c None admin] Validating token access rules against request {{(pid=352328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:53:45.516321 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a1c010-4b4c-4e38-9175-b2b1a3fc108f None admin] Validating token access rules against request {{(pid=352329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:53:45.524527 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11bf9e2f-39bd-401b-a5e9-be405b0d730a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:53:45.525453 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11bf9e2f-39bd-401b-a5e9-be405b0d730a None admin] REQUEST_METHOD: `GET` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:53:45.525808 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11bf9e2f-39bd-401b-a5e9-be405b0d730a None admin] SCRIPT_NAME: `/identity` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:53:45.526154 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11bf9e2f-39bd-401b-a5e9-be405b0d730a None admin] PATH_INFO: `/v3/roles/service` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:53:45.537463 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11bf9e2f-39bd-401b-a5e9-be405b0d730a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 08:53:45.543017 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application [None req-11bf9e2f-39bd-401b-a5e9-be405b0d730a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 28 08:53:45.543017 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:53:45.543017 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:53:45.543017 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:53:45.543017 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:53:45.543017 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:53:45.543017 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:53:45.543017 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:53:45.543017 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:53:45.543017 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:53:45.543017 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:53:45.543017 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:53:45.543017 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 08:53:45.543017 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 08:53:45.543017 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 08:53:45.543017 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 08:53:45.544310 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 08:53:45.544310 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 08:53:45.544310 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 08:53:45.544310 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 08:53:45.544310 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:53:45.544310 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:53:45.544310 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:53:45.544310 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:53:45.544310 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:53:45.544310 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:53:45.544310 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:53:45.544310 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application with Lock( Jul 28 08:53:45.544310 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:53:45.544310 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:53:45.544310 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:53:45.544310 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:53:45.545599 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:53:45.545599 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:53:45.545599 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:53:45.545599 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:53:45.545599 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 08:53:45.545599 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 08:53:45.545599 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 08:53:45.545599 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 08:53:45.545599 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 08:53:45.545599 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 08:53:45.545599 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 28 08:53:45.545599 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application Jul 28 08:53:45.545599 dv-cinder-851351-1-smb devstack@keystone.service[352328]: [pid: 352328|app: 0|req: 248/498] 10.222.0.42 () {56 vars in 1102 bytes} [Thu Jul 28 08:53:45 2022] GET /identity/v3/roles/service => generated 85 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:53:45.545599 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11bf9e2f-39bd-401b-a5e9-be405b0d730a None admin] Authenticating user token {{(pid=352328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:53:45.556079 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e56dbe-f458-4f82-9b61-987bb0994221 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:53:45.556877 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e56dbe-f458-4f82-9b61-987bb0994221 None admin] REQUEST_METHOD: `GET` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:53:45.557102 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e56dbe-f458-4f82-9b61-987bb0994221 None admin] SCRIPT_NAME: `/identity` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:53:45.557406 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e56dbe-f458-4f82-9b61-987bb0994221 None admin] PATH_INFO: `/v3/domains` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:53:45.558214 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95e56dbe-f458-4f82-9b61-987bb0994221 None admin] RBAC: Adding query filter params (name=Default) {{(pid=352329) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:53:45.558530 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95e56dbe-f458-4f82-9b61-987bb0994221 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:53:45.561312 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95e56dbe-f458-4f82-9b61-987bb0994221 None admin] RBAC: Authorization granted {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:53:45.568311 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG dbcounter [-] [352328] Writing DB stats keystone:SELECT=100 {{(pid=352328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:53:45.576489 dv-cinder-851351-1-smb devstack@keystone.service[352329]: [pid: 352329|app: 0|req: 251/499] 10.222.0.42 () {56 vars in 1109 bytes} [Thu Jul 28 08:53:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:53:45.577668 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e56dbe-f458-4f82-9b61-987bb0994221 None admin] Authenticating user token {{(pid=352329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:53:45.651518 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG dbcounter [-] [352329] Writing DB stats keystone:SELECT=100 {{(pid=352329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:53:45.657372 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11bf9e2f-39bd-401b-a5e9-be405b0d730a None admin] Validating token access rules against request {{(pid=352328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:53:45.684143 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e56dbe-f458-4f82-9b61-987bb0994221 None admin] Validating token access rules against request {{(pid=352329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:53:45.692865 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c93f8257-d53c-4afb-b358-f7769fe67397 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:53:45.693521 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93f8257-d53c-4afb-b358-f7769fe67397 None admin] REQUEST_METHOD: `GET` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:53:45.693802 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93f8257-d53c-4afb-b358-f7769fe67397 None admin] SCRIPT_NAME: `/identity` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:53:45.694074 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93f8257-d53c-4afb-b358-f7769fe67397 None admin] PATH_INFO: `/v3/users/nova` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:53:45.701884 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c93f8257-d53c-4afb-b358-f7769fe67397 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:53:45.703372 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c93f8257-d53c-4afb-b358-f7769fe67397 None admin] RBAC: Authorization granted {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:53:45.716532 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application [None req-c93f8257-d53c-4afb-b358-f7769fe67397 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 28 08:53:45.716532 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:53:45.716532 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:53:45.716532 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:53:45.716532 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:53:45.716532 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:53:45.716532 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:53:45.716532 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:53:45.716532 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:53:45.716532 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:53:45.716532 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:53:45.716532 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:53:45.716532 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 28 08:53:45.716532 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 28 08:53:45.716532 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 28 08:53:45.716532 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 28 08:53:45.717998 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:53:45.717998 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:53:45.717998 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 28 08:53:45.717998 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 08:53:45.717998 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 28 08:53:45.717998 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 08:53:45.717998 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:53:45.717998 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:53:45.717998 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:53:45.717998 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:53:45.717998 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:53:45.717998 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application with Lock( Jul 28 08:53:45.717998 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:53:45.717998 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:53:45.717998 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:53:45.717998 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:53:45.717998 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:53:45.717998 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:53:45.719207 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:53:45.719207 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:53:45.719207 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 28 08:53:45.719207 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 28 08:53:45.719207 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 28 08:53:45.719207 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 28 08:53:45.719207 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 28 08:53:45.719207 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 28 08:53:45.719207 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 28 08:53:45.719207 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application Jul 28 08:53:45.719207 dv-cinder-851351-1-smb devstack@keystone.service[352328]: [pid: 352328|app: 0|req: 249/500] 10.222.0.42 () {56 vars in 1093 bytes} [Thu Jul 28 08:53:45 2022] GET /identity/v3/users/nova => generated 82 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:53:45.719207 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1e4e19-7b1b-4bdb-80c9-c09fb6dd82e9 None None] REQUEST_METHOD: `GET` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:53:45.719207 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1e4e19-7b1b-4bdb-80c9-c09fb6dd82e9 None None] SCRIPT_NAME: `/identity` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:53:45.720191 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1e4e19-7b1b-4bdb-80c9-c09fb6dd82e9 None None] PATH_INFO: `/` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:53:45.725182 dv-cinder-851351-1-smb devstack@keystone.service[352328]: [pid: 352328|app: 0|req: 250/501] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 08:53:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 08:53:45.725182 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1e4e19-7b1b-4bdb-80c9-c09fb6dd82e9 None None] Authenticating user token {{(pid=352328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:53:45.725470 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c74e1539-9061-4071-97a5-9835004ad4e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:53:45.725470 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74e1539-9061-4071-97a5-9835004ad4e9 None admin] REQUEST_METHOD: `GET` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:53:45.725470 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74e1539-9061-4071-97a5-9835004ad4e9 None admin] SCRIPT_NAME: `/identity` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:53:45.725772 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74e1539-9061-4071-97a5-9835004ad4e9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:53:45.736905 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c74e1539-9061-4071-97a5-9835004ad4e9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:53:45.738397 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c74e1539-9061-4071-97a5-9835004ad4e9 None admin] RBAC: Authorization granted {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:53:45.754616 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application [None req-c74e1539-9061-4071-97a5-9835004ad4e9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 08:53:45.754616 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:53:45.754616 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:53:45.754616 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:53:45.754616 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:53:45.754616 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:53:45.754616 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:53:45.754616 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:53:45.754616 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:53:45.754616 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:53:45.754616 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:53:45.754616 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:53:45.754616 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 08:53:45.754616 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 08:53:45.754616 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 08:53:45.755866 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 08:53:45.755866 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:53:45.755866 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:53:45.755866 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:53:45.755866 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:53:45.755866 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:53:45.755866 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:53:45.755866 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:53:45.755866 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application with Lock( Jul 28 08:53:45.755866 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:53:45.755866 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:53:45.755866 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:53:45.755866 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:53:45.755866 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:53:45.755866 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:53:45.755866 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:53:45.755866 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:53:45.757225 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 08:53:45.757225 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 08:53:45.757225 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 08:53:45.757225 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application Jul 28 08:53:45.757225 dv-cinder-851351-1-smb devstack@keystone.service[352329]: [pid: 352329|app: 0|req: 252/502] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 08:53:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:53:45.757225 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c74e1539-9061-4071-97a5-9835004ad4e9 None admin] Authenticating user token {{(pid=352329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:53:45.815790 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG dbcounter [-] [352328] Writing DB stats keystone:SELECT=100 {{(pid=352328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:53:45.840306 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1e4e19-7b1b-4bdb-80c9-c09fb6dd82e9 None None] Validating token access rules against request {{(pid=352328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:53:45.860999 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c74e1539-9061-4071-97a5-9835004ad4e9 None admin] Validating token access rules against request {{(pid=352329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:53:45.877827 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db793f03-ff27-443c-a294-400f652aed48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:53:45.878469 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db793f03-ff27-443c-a294-400f652aed48 None admin] REQUEST_METHOD: `GET` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:53:45.878759 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db793f03-ff27-443c-a294-400f652aed48 None admin] SCRIPT_NAME: `/identity` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:53:45.879047 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db793f03-ff27-443c-a294-400f652aed48 None admin] PATH_INFO: `/v3/roles` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:53:45.879774 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db793f03-ff27-443c-a294-400f652aed48 None admin] RBAC: Adding query filter params (name=service) {{(pid=352328) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:53:45.880092 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db793f03-ff27-443c-a294-400f652aed48 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:53:45.881534 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db793f03-ff27-443c-a294-400f652aed48 None admin] RBAC: Authorization granted {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:53:45.886593 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG dbcounter [-] [352329] Writing DB stats keystone:SELECT=100 {{(pid=352329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:53:45.890591 dv-cinder-851351-1-smb devstack@keystone.service[352328]: [pid: 352328|app: 0|req: 251/503] 10.222.0.42 () {56 vars in 1103 bytes} [Thu Jul 28 08:53:45 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:53:45.891427 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db793f03-ff27-443c-a294-400f652aed48 None admin] Authenticating user token {{(pid=352328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:53:45.903979 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04788636-2e8e-4371-a620-3ff983bdc330 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:53:45.904648 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04788636-2e8e-4371-a620-3ff983bdc330 None admin] REQUEST_METHOD: `GET` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:53:45.904966 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04788636-2e8e-4371-a620-3ff983bdc330 None admin] SCRIPT_NAME: `/identity` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:53:45.905244 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04788636-2e8e-4371-a620-3ff983bdc330 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:53:45.913230 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04788636-2e8e-4371-a620-3ff983bdc330 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:53:45.914738 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04788636-2e8e-4371-a620-3ff983bdc330 None admin] RBAC: Authorization granted {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:53:45.932337 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application [None req-04788636-2e8e-4371-a620-3ff983bdc330 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jul 28 08:53:45.932337 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:53:45.932337 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:53:45.932337 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:53:45.932337 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:53:45.932337 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:53:45.932337 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:53:45.932337 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:53:45.932337 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:53:45.932337 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:53:45.932337 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:53:45.932337 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:53:45.932337 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 28 08:53:45.932337 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 28 08:53:45.932337 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 28 08:53:45.932337 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 28 08:53:45.934029 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:53:45.934029 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:53:45.934029 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 28 08:53:45.934029 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 08:53:45.934029 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 28 08:53:45.934029 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 08:53:45.934029 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:53:45.934029 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:53:45.934029 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:53:45.934029 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:53:45.934029 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:53:45.934029 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application with Lock( Jul 28 08:53:45.934029 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:53:45.934029 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:53:45.934029 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:53:45.934029 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:53:45.934029 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:53:45.934029 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:53:45.935211 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:53:45.935211 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:53:45.935211 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 28 08:53:45.935211 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 28 08:53:45.935211 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 28 08:53:45.935211 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 28 08:53:45.935211 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 28 08:53:45.935211 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 28 08:53:45.935211 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jul 28 08:53:45.935211 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application Jul 28 08:53:45.935211 dv-cinder-851351-1-smb devstack@keystone.service[352329]: [pid: 352329|app: 0|req: 253/504] 10.222.0.42 () {56 vars in 1099 bytes} [Thu Jul 28 08:53:45 2022] GET /identity/v3/users/cinder => generated 84 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:53:45.935211 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8d9305-682f-43f5-ba6f-ca6de123dc41 None None] REQUEST_METHOD: `POST` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:53:45.935211 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8d9305-682f-43f5-ba6f-ca6de123dc41 None None] SCRIPT_NAME: `/identity` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:53:45.936174 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8d9305-682f-43f5-ba6f-ca6de123dc41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:53:45.953801 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.auth.core [None req-7b8d9305-682f-43f5-ba6f-ca6de123dc41 None None] MFA Rules not processed for user `d18c063b2377412485965357671e5506`. Rule list: `[]` (Enabled: `True`). {{(pid=352329) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 08:53:45.955478 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.fernet_utils [None req-7b8d9305-682f-43f5-ba6f-ca6de123dc41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=352329) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:53:46.004225 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db793f03-ff27-443c-a294-400f652aed48 None admin] Validating token access rules against request {{(pid=352328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:53:46.040488 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2759490-0599-47a4-a83b-a1c31a4fc3ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:53:46.041268 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2759490-0599-47a4-a83b-a1c31a4fc3ea None admin] REQUEST_METHOD: `GET` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:53:46.041636 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2759490-0599-47a4-a83b-a1c31a4fc3ea None admin] SCRIPT_NAME: `/identity` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:53:46.042038 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2759490-0599-47a4-a83b-a1c31a4fc3ea None admin] PATH_INFO: `/v3/users` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:53:46.042896 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2759490-0599-47a4-a83b-a1c31a4fc3ea None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=352328) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:53:46.043281 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2759490-0599-47a4-a83b-a1c31a4fc3ea None admin] RBAC: Authorizing `identity:list_users()` {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:53:46.043402 dv-cinder-851351-1-smb devstack@keystone.service[352329]: [pid: 352329|app: 0|req: 254/505] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 08:53:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 08:53:46.044357 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8d9305-682f-43f5-ba6f-ca6de123dc41 None None] Authenticating user token {{(pid=352329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:53:46.050229 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2759490-0599-47a4-a83b-a1c31a4fc3ea None admin] RBAC: Authorization granted {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:53:46.077820 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG dbcounter [-] [352328] Writing DB stats keystone:SELECT=100 {{(pid=352328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:53:46.090631 dv-cinder-851351-1-smb devstack@keystone.service[352328]: [pid: 352328|app: 0|req: 252/506] 10.222.0.42 () {56 vars in 1133 bytes} [Thu Jul 28 08:53:45 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:53:46.091634 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2759490-0599-47a4-a83b-a1c31a4fc3ea None admin] Authenticating user token {{(pid=352328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:53:46.152053 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8d9305-682f-43f5-ba6f-ca6de123dc41 None None] Validating token access rules against request {{(pid=352329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:53:46.166243 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG dbcounter [-] [352329] Writing DB stats keystone:SELECT=100 {{(pid=352329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:53:46.189000 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9cfba30-9f4b-499a-b52e-2fbd66dd7feb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:53:46.189646 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9cfba30-9f4b-499a-b52e-2fbd66dd7feb None admin] REQUEST_METHOD: `GET` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:53:46.189932 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9cfba30-9f4b-499a-b52e-2fbd66dd7feb None admin] SCRIPT_NAME: `/identity` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:53:46.190197 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9cfba30-9f4b-499a-b52e-2fbd66dd7feb None admin] PATH_INFO: `/v3/domains` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:53:46.190914 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9cfba30-9f4b-499a-b52e-2fbd66dd7feb None admin] RBAC: Adding query filter params (name=Default) {{(pid=352329) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:53:46.191223 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9cfba30-9f4b-499a-b52e-2fbd66dd7feb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:53:46.192642 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9cfba30-9f4b-499a-b52e-2fbd66dd7feb None admin] RBAC: Authorization granted {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:53:46.193191 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2759490-0599-47a4-a83b-a1c31a4fc3ea None admin] Validating token access rules against request {{(pid=352328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:53:46.204478 dv-cinder-851351-1-smb devstack@keystone.service[352329]: [pid: 352329|app: 0|req: 255/507] 10.222.0.42 () {56 vars in 1109 bytes} [Thu Jul 28 08:53:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:53:46.205380 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9cfba30-9f4b-499a-b52e-2fbd66dd7feb None admin] Authenticating user token {{(pid=352329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:53:46.233640 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32564d8-df68-4265-b802-841a28cf043e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:53:46.234308 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32564d8-df68-4265-b802-841a28cf043e None admin] REQUEST_METHOD: `GET` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:53:46.234593 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32564d8-df68-4265-b802-841a28cf043e None admin] SCRIPT_NAME: `/identity` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:53:46.234867 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32564d8-df68-4265-b802-841a28cf043e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:53:46.245685 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c32564d8-df68-4265-b802-841a28cf043e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:53:46.247175 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c32564d8-df68-4265-b802-841a28cf043e None admin] RBAC: Authorization granted {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:53:46.262263 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application [None req-c32564d8-df68-4265-b802-841a28cf043e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 08:53:46.262263 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:53:46.262263 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:53:46.262263 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:53:46.262263 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:53:46.262263 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:53:46.262263 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:53:46.262263 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:53:46.262263 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:53:46.262263 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:53:46.262263 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:53:46.262263 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:53:46.262263 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 08:53:46.262263 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 08:53:46.262263 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 08:53:46.263596 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 08:53:46.263596 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:53:46.263596 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:53:46.263596 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:53:46.263596 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:53:46.263596 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:53:46.263596 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:53:46.263596 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:53:46.263596 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application with Lock( Jul 28 08:53:46.263596 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:53:46.263596 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:53:46.263596 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:53:46.263596 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:53:46.263596 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:53:46.263596 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:53:46.263596 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:53:46.263596 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:53:46.264696 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 08:53:46.264696 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 08:53:46.264696 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 08:53:46.264696 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application Jul 28 08:53:46.264696 dv-cinder-851351-1-smb devstack@keystone.service[352328]: [pid: 352328|app: 0|req: 253/508] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 08:53:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:53:46.264696 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32564d8-df68-4265-b802-841a28cf043e None admin] Authenticating user token {{(pid=352328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:53:46.314197 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9cfba30-9f4b-499a-b52e-2fbd66dd7feb None admin] Validating token access rules against request {{(pid=352329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:53:46.316587 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG dbcounter [-] [352328] Writing DB stats keystone:SELECT=100 {{(pid=352328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:53:46.350571 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a58e04-5c54-480a-b04c-9aab498a4329 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:53:46.351132 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a58e04-5c54-480a-b04c-9aab498a4329 None admin] REQUEST_METHOD: `GET` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:53:46.351415 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a58e04-5c54-480a-b04c-9aab498a4329 None admin] SCRIPT_NAME: `/identity` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:53:46.351681 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a58e04-5c54-480a-b04c-9aab498a4329 None admin] PATH_INFO: `/v3/users` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:53:46.352507 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46a58e04-5c54-480a-b04c-9aab498a4329 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=352329) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:53:46.352846 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46a58e04-5c54-480a-b04c-9aab498a4329 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:53:46.354727 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46a58e04-5c54-480a-b04c-9aab498a4329 None admin] RBAC: Authorization granted {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:53:46.366169 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32564d8-df68-4265-b802-841a28cf043e None admin] Validating token access rules against request {{(pid=352328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:53:46.392549 dv-cinder-851351-1-smb devstack@keystone.service[352329]: [pid: 352329|app: 0|req: 256/509] 10.222.0.42 () {56 vars in 1137 bytes} [Thu Jul 28 08:53:46 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:53:46.393541 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a58e04-5c54-480a-b04c-9aab498a4329 None admin] Authenticating user token {{(pid=352329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:53:46.410054 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b2d4a2-3dac-4ccf-b332-db407ba4c4c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:53:46.410721 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b2d4a2-3dac-4ccf-b332-db407ba4c4c7 None admin] REQUEST_METHOD: `GET` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:53:46.411004 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b2d4a2-3dac-4ccf-b332-db407ba4c4c7 None admin] SCRIPT_NAME: `/identity` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:53:46.411281 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b2d4a2-3dac-4ccf-b332-db407ba4c4c7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:53:46.422547 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62b2d4a2-3dac-4ccf-b332-db407ba4c4c7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:53:46.424032 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62b2d4a2-3dac-4ccf-b332-db407ba4c4c7 None admin] RBAC: Authorization granted {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:53:46.424650 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG dbcounter [-] [352329] Writing DB stats keystone:SELECT=100 {{(pid=352329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:53:46.439616 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application [None req-62b2d4a2-3dac-4ccf-b332-db407ba4c4c7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 08:53:46.439616 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:53:46.439616 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:53:46.439616 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:53:46.439616 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:53:46.439616 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:53:46.439616 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:53:46.439616 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:53:46.439616 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:53:46.439616 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:53:46.439616 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:53:46.439616 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:53:46.439616 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 08:53:46.439616 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 08:53:46.439616 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 08:53:46.440958 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 08:53:46.440958 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:53:46.440958 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:53:46.440958 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:53:46.440958 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:53:46.440958 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:53:46.440958 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:53:46.440958 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:53:46.440958 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application with Lock( Jul 28 08:53:46.440958 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:53:46.440958 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:53:46.440958 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:53:46.440958 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:53:46.440958 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:53:46.440958 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:53:46.440958 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:53:46.440958 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:53:46.442230 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 08:53:46.442230 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 08:53:46.442230 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 08:53:46.442230 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application Jul 28 08:53:46.442230 dv-cinder-851351-1-smb devstack@keystone.service[352328]: [pid: 352328|app: 0|req: 254/510] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 08:53:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:53:46.442858 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b2d4a2-3dac-4ccf-b332-db407ba4c4c7 None admin] Authenticating user token {{(pid=352328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:53:46.498670 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a58e04-5c54-480a-b04c-9aab498a4329 None admin] Validating token access rules against request {{(pid=352329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:53:46.533315 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab6cc54-99df-4b1e-b80f-ee183e527306 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:53:46.533982 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab6cc54-99df-4b1e-b80f-ee183e527306 None admin] REQUEST_METHOD: `GET` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:53:46.534259 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab6cc54-99df-4b1e-b80f-ee183e527306 None admin] SCRIPT_NAME: `/identity` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:53:46.534540 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab6cc54-99df-4b1e-b80f-ee183e527306 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:53:46.543306 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b2d4a2-3dac-4ccf-b332-db407ba4c4c7 None admin] Validating token access rules against request {{(pid=352328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:53:46.544931 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG dbcounter [-] [352328] Writing DB stats keystone:SELECT=100 {{(pid=352328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:53:46.580689 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb402e3-21fb-4a56-bb80-340abcbf173e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:53:46.581360 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb402e3-21fb-4a56-bb80-340abcbf173e None admin] REQUEST_METHOD: `GET` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:53:46.581640 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb402e3-21fb-4a56-bb80-340abcbf173e None admin] SCRIPT_NAME: `/identity` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:53:46.581912 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb402e3-21fb-4a56-bb80-340abcbf173e None admin] PATH_INFO: `/v3/users/glance` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:53:46.589865 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcb402e3-21fb-4a56-bb80-340abcbf173e None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:53:46.591338 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcb402e3-21fb-4a56-bb80-340abcbf173e None admin] RBAC: Authorization granted {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:53:46.602798 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application [None req-bcb402e3-21fb-4a56-bb80-340abcbf173e None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jul 28 08:53:46.602798 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:53:46.602798 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:53:46.602798 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:53:46.602798 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:53:46.602798 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:53:46.602798 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:53:46.602798 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:53:46.602798 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:53:46.602798 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:53:46.602798 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:53:46.602798 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:53:46.602798 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 28 08:53:46.602798 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 28 08:53:46.602798 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 28 08:53:46.602798 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 28 08:53:46.604095 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:53:46.604095 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:53:46.604095 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 28 08:53:46.604095 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 08:53:46.604095 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 28 08:53:46.604095 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 08:53:46.604095 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:53:46.604095 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:53:46.604095 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:53:46.604095 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:53:46.604095 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:53:46.604095 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application with Lock( Jul 28 08:53:46.604095 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:53:46.604095 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:53:46.604095 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:53:46.604095 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:53:46.604095 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:53:46.604095 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:53:46.605477 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:53:46.605477 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:53:46.605477 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 28 08:53:46.605477 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 28 08:53:46.605477 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 28 08:53:46.605477 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 28 08:53:46.605477 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 28 08:53:46.605477 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 28 08:53:46.605477 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jul 28 08:53:46.605477 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application Jul 28 08:53:46.605477 dv-cinder-851351-1-smb devstack@keystone.service[352328]: [pid: 352328|app: 0|req: 255/511] 10.222.0.42 () {56 vars in 1099 bytes} [Thu Jul 28 08:53:46 2022] GET /identity/v3/users/glance => generated 84 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:53:46.605477 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb402e3-21fb-4a56-bb80-340abcbf173e None admin] Authenticating user token {{(pid=352328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:53:46.609243 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ab6cc54-99df-4b1e-b80f-ee183e527306 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:53:46.610752 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ab6cc54-99df-4b1e-b80f-ee183e527306 None admin] RBAC: Authorization granted {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:53:46.645838 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG dbcounter [-] [352329] Writing DB stats keystone:SELECT=100 {{(pid=352329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:53:46.715526 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb402e3-21fb-4a56-bb80-340abcbf173e None admin] Validating token access rules against request {{(pid=352328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:53:46.720864 dv-cinder-851351-1-smb devstack@keystone.service[352329]: [pid: 352329|app: 0|req: 257/512] 10.222.0.42 () {58 vars in 1282 bytes} [Thu Jul 28 08:53:46 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 28 08:53:46.721727 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab6cc54-99df-4b1e-b80f-ee183e527306 None admin] Authenticating user token {{(pid=352329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:53:46.752875 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0378eb-04a7-4183-9bbc-e13131459f7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:53:46.753508 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0378eb-04a7-4183-9bbc-e13131459f7f None admin] REQUEST_METHOD: `GET` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:53:46.753786 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0378eb-04a7-4183-9bbc-e13131459f7f None admin] SCRIPT_NAME: `/identity` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:53:46.754065 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0378eb-04a7-4183-9bbc-e13131459f7f None admin] PATH_INFO: `/v3/domains` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:53:46.754771 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a0378eb-04a7-4183-9bbc-e13131459f7f None admin] RBAC: Adding query filter params (name=Default) {{(pid=352328) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:53:46.755086 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a0378eb-04a7-4183-9bbc-e13131459f7f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:53:46.756476 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a0378eb-04a7-4183-9bbc-e13131459f7f None admin] RBAC: Authorization granted {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:53:46.768711 dv-cinder-851351-1-smb devstack@keystone.service[352328]: [pid: 352328|app: 0|req: 256/513] 10.222.0.42 () {56 vars in 1109 bytes} [Thu Jul 28 08:53:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:53:46.769341 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0378eb-04a7-4183-9bbc-e13131459f7f None admin] Authenticating user token {{(pid=352328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:53:46.793538 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG dbcounter [-] [352328] Writing DB stats keystone:SELECT=100 {{(pid=352328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:53:46.828691 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab6cc54-99df-4b1e-b80f-ee183e527306 None admin] Validating token access rules against request {{(pid=352329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:53:46.858101 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG dbcounter [-] [352329] Writing DB stats keystone:SELECT=100 {{(pid=352329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:53:46.864454 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81e2c0c-fe88-4251-a27e-b807c32b2b41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:53:46.865119 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81e2c0c-fe88-4251-a27e-b807c32b2b41 None admin] REQUEST_METHOD: `GET` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:53:46.865404 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81e2c0c-fe88-4251-a27e-b807c32b2b41 None admin] SCRIPT_NAME: `/identity` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:53:46.865679 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81e2c0c-fe88-4251-a27e-b807c32b2b41 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:53:46.878129 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0378eb-04a7-4183-9bbc-e13131459f7f None admin] Validating token access rules against request {{(pid=352328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:53:46.911696 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59950e8a-dec5-49bc-8517-1aeed30e24d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:53:46.912408 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59950e8a-dec5-49bc-8517-1aeed30e24d0 None admin] REQUEST_METHOD: `GET` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:53:46.912728 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59950e8a-dec5-49bc-8517-1aeed30e24d0 None admin] SCRIPT_NAME: `/identity` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:53:46.913008 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59950e8a-dec5-49bc-8517-1aeed30e24d0 None admin] PATH_INFO: `/v3/domains` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:53:46.913707 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59950e8a-dec5-49bc-8517-1aeed30e24d0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=352328) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:53:46.914020 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59950e8a-dec5-49bc-8517-1aeed30e24d0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:53:46.915403 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59950e8a-dec5-49bc-8517-1aeed30e24d0 None admin] RBAC: Authorization granted {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:53:46.931594 dv-cinder-851351-1-smb devstack@keystone.service[352328]: [pid: 352328|app: 0|req: 257/514] 10.222.0.42 () {56 vars in 1109 bytes} [Thu Jul 28 08:53:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:53:46.931594 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59950e8a-dec5-49bc-8517-1aeed30e24d0 None admin] Authenticating user token {{(pid=352328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:53:46.937383 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e81e2c0c-fe88-4251-a27e-b807c32b2b41 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:53:46.938870 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e81e2c0c-fe88-4251-a27e-b807c32b2b41 None admin] RBAC: Authorization granted {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:53:47.016920 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG dbcounter [-] [352328] Writing DB stats keystone:SELECT=100 {{(pid=352328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:53:47.037660 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59950e8a-dec5-49bc-8517-1aeed30e24d0 None admin] Validating token access rules against request {{(pid=352328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:53:47.045335 dv-cinder-851351-1-smb devstack@keystone.service[352329]: [pid: 352329|app: 0|req: 258/515] 10.222.0.42 () {58 vars in 1282 bytes} [Thu Jul 28 08:53:46 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 28 08:53:47.046202 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81e2c0c-fe88-4251-a27e-b807c32b2b41 None admin] Authenticating user token {{(pid=352329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:53:47.076466 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70cf9c1f-d7cd-44d0-a7e5-dd3aff2f0537 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:53:47.077139 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70cf9c1f-d7cd-44d0-a7e5-dd3aff2f0537 None admin] REQUEST_METHOD: `GET` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:53:47.077286 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG dbcounter [-] [352329] Writing DB stats keystone:SELECT=100 {{(pid=352329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:53:47.077495 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70cf9c1f-d7cd-44d0-a7e5-dd3aff2f0537 None admin] SCRIPT_NAME: `/identity` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:53:47.077698 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70cf9c1f-d7cd-44d0-a7e5-dd3aff2f0537 None admin] PATH_INFO: `/v3/users` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:53:47.078495 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70cf9c1f-d7cd-44d0-a7e5-dd3aff2f0537 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=352328) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:53:47.078859 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70cf9c1f-d7cd-44d0-a7e5-dd3aff2f0537 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:53:47.080627 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70cf9c1f-d7cd-44d0-a7e5-dd3aff2f0537 None admin] RBAC: Authorization granted {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:53:47.097912 dv-cinder-851351-1-smb devstack@keystone.service[352328]: [pid: 352328|app: 0|req: 258/516] 10.222.0.42 () {56 vars in 1137 bytes} [Thu Jul 28 08:53:46 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:53:47.098748 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70cf9c1f-d7cd-44d0-a7e5-dd3aff2f0537 None admin] Authenticating user token {{(pid=352328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:53:47.150987 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81e2c0c-fe88-4251-a27e-b807c32b2b41 None admin] Validating token access rules against request {{(pid=352329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:53:47.187035 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6792f177-fd17-4000-8d7d-b95d017c30b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:53:47.187689 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6792f177-fd17-4000-8d7d-b95d017c30b0 None admin] REQUEST_METHOD: `GET` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:53:47.187981 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6792f177-fd17-4000-8d7d-b95d017c30b0 None admin] SCRIPT_NAME: `/identity` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:53:47.188249 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6792f177-fd17-4000-8d7d-b95d017c30b0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:53:47.197070 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70cf9c1f-d7cd-44d0-a7e5-dd3aff2f0537 None admin] Validating token access rules against request {{(pid=352328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:53:47.198647 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6792f177-fd17-4000-8d7d-b95d017c30b0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:53:47.200145 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6792f177-fd17-4000-8d7d-b95d017c30b0 None admin] RBAC: Authorization granted {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:53:47.215705 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application [None req-6792f177-fd17-4000-8d7d-b95d017c30b0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 08:53:47.215705 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:53:47.215705 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:53:47.215705 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:53:47.215705 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:53:47.215705 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:53:47.215705 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:53:47.215705 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:53:47.215705 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:53:47.215705 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:53:47.215705 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:53:47.215705 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:53:47.215705 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 08:53:47.215705 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 08:53:47.215705 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 08:53:47.216917 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 08:53:47.216917 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:53:47.216917 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:53:47.216917 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:53:47.216917 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:53:47.216917 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:53:47.216917 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:53:47.216917 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:53:47.216917 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application with Lock( Jul 28 08:53:47.216917 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:53:47.216917 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:53:47.216917 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:53:47.216917 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:53:47.216917 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:53:47.216917 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:53:47.216917 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:53:47.216917 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:53:47.218000 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 08:53:47.218000 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 08:53:47.218000 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 08:53:47.218000 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application Jul 28 08:53:47.218000 dv-cinder-851351-1-smb devstack@keystone.service[352329]: [pid: 352329|app: 0|req: 259/517] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 08:53:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:53:47.218000 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6792f177-fd17-4000-8d7d-b95d017c30b0 None admin] Authenticating user token {{(pid=352329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:53:47.232862 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5e0fd8-42d1-47e6-88a9-fdaf3fc553d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:53:47.233514 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5e0fd8-42d1-47e6-88a9-fdaf3fc553d4 None admin] REQUEST_METHOD: `GET` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:53:47.233790 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5e0fd8-42d1-47e6-88a9-fdaf3fc553d4 None admin] SCRIPT_NAME: `/identity` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:53:47.234048 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5e0fd8-42d1-47e6-88a9-fdaf3fc553d4 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:53:47.241526 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac5e0fd8-42d1-47e6-88a9-fdaf3fc553d4 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:53:47.242975 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac5e0fd8-42d1-47e6-88a9-fdaf3fc553d4 None admin] RBAC: Authorization granted {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:53:47.245612 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG dbcounter [-] [352328] Writing DB stats keystone:SELECT=100 {{(pid=352328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:53:47.255792 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application [None req-ac5e0fd8-42d1-47e6-88a9-fdaf3fc553d4 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jul 28 08:53:47.255792 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:53:47.255792 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:53:47.255792 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:53:47.255792 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:53:47.255792 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:53:47.255792 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:53:47.255792 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:53:47.255792 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:53:47.255792 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:53:47.255792 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:53:47.255792 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:53:47.255792 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 28 08:53:47.255792 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 28 08:53:47.255792 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 28 08:53:47.255792 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 28 08:53:47.256982 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:53:47.256982 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:53:47.256982 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 28 08:53:47.256982 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 08:53:47.256982 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 28 08:53:47.256982 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 08:53:47.256982 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:53:47.256982 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:53:47.256982 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:53:47.256982 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:53:47.256982 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:53:47.256982 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application with Lock( Jul 28 08:53:47.256982 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:53:47.256982 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:53:47.256982 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:53:47.256982 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:53:47.256982 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:53:47.256982 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:53:47.258145 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:53:47.258145 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:53:47.258145 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 28 08:53:47.258145 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 28 08:53:47.258145 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 28 08:53:47.258145 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 28 08:53:47.258145 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 28 08:53:47.258145 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 28 08:53:47.258145 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jul 28 08:53:47.258145 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application Jul 28 08:53:47.258145 dv-cinder-851351-1-smb devstack@keystone.service[352328]: [pid: 352328|app: 0|req: 259/518] 10.222.0.42 () {56 vars in 1102 bytes} [Thu Jul 28 08:53:47 2022] GET /identity/v3/users/neutron => generated 85 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:53:47.258145 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5e0fd8-42d1-47e6-88a9-fdaf3fc553d4 None admin] Authenticating user token {{(pid=352328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:53:47.303800 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG dbcounter [-] [352329] Writing DB stats keystone:SELECT=100 {{(pid=352329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:53:47.322947 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6792f177-fd17-4000-8d7d-b95d017c30b0 None admin] Validating token access rules against request {{(pid=352329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:53:47.356457 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e14331e6-361a-4953-b2db-097846961ec6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:53:47.357160 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14331e6-361a-4953-b2db-097846961ec6 None admin] REQUEST_METHOD: `POST` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:53:47.357441 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14331e6-361a-4953-b2db-097846961ec6 None admin] SCRIPT_NAME: `/identity` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:53:47.357687 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14331e6-361a-4953-b2db-097846961ec6 None admin] PATH_INFO: `/v3/users` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:53:47.358397 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e14331e6-361a-4953-b2db-097846961ec6 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:53:47.359874 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e14331e6-361a-4953-b2db-097846961ec6 None admin] RBAC: Authorization granted {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:53:47.363877 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5e0fd8-42d1-47e6-88a9-fdaf3fc553d4 None admin] Validating token access rules against request {{(pid=352328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:53:47.381251 dv-cinder-851351-1-smb devstack@keystone.service[352329]: [pid: 352329|app: 0|req: 260/519] 10.222.0.42 () {60 vars in 1132 bytes} [Thu Jul 28 08:53:47 2022] POST /identity/v3/users => generated 247 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 08:53:47.382105 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e14331e6-361a-4953-b2db-097846961ec6 None admin] Authenticating user token {{(pid=352329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:53:47.406036 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8fd375-3d89-4191-8e14-594f8a8f1cef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:53:47.406635 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8fd375-3d89-4191-8e14-594f8a8f1cef None admin] REQUEST_METHOD: `GET` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:53:47.406919 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8fd375-3d89-4191-8e14-594f8a8f1cef None admin] SCRIPT_NAME: `/identity` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:53:47.407207 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8fd375-3d89-4191-8e14-594f8a8f1cef None admin] PATH_INFO: `/v3/domains/Default` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:53:47.420136 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed8fd375-3d89-4191-8e14-594f8a8f1cef None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:53:47.421719 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed8fd375-3d89-4191-8e14-594f8a8f1cef None admin] RBAC: Authorization granted {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:53:47.439193 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application [None req-ed8fd375-3d89-4191-8e14-594f8a8f1cef None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 08:53:47.439193 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:53:47.439193 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:53:47.439193 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:53:47.439193 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:53:47.439193 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:53:47.439193 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:53:47.439193 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:53:47.439193 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:53:47.439193 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:53:47.439193 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:53:47.439193 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:53:47.439193 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 08:53:47.439193 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 08:53:47.439193 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 08:53:47.440392 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 08:53:47.440392 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:53:47.440392 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:53:47.440392 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:53:47.440392 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:53:47.440392 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:53:47.440392 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:53:47.440392 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:53:47.440392 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application with Lock( Jul 28 08:53:47.440392 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:53:47.440392 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:53:47.440392 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:53:47.440392 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:53:47.440392 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:53:47.440392 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:53:47.440392 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:53:47.440392 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:53:47.441562 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 08:53:47.441562 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 08:53:47.441562 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 08:53:47.441562 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application Jul 28 08:53:47.441562 dv-cinder-851351-1-smb devstack@keystone.service[352328]: [pid: 352328|app: 0|req: 260/520] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 08:53:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:53:47.441562 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8fd375-3d89-4191-8e14-594f8a8f1cef None admin] Authenticating user token {{(pid=352328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:53:47.514707 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG dbcounter [-] [352328] Writing DB stats keystone:SELECT=100 {{(pid=352328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:53:47.515448 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e14331e6-361a-4953-b2db-097846961ec6 None admin] Validating token access rules against request {{(pid=352329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:53:47.553790 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-550ed67f-3f9c-4097-a68d-2e85d1798097 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:53:47.554448 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550ed67f-3f9c-4097-a68d-2e85d1798097 None admin] REQUEST_METHOD: `GET` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:53:47.554739 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550ed67f-3f9c-4097-a68d-2e85d1798097 None admin] SCRIPT_NAME: `/identity` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:53:47.555017 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550ed67f-3f9c-4097-a68d-2e85d1798097 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:53:47.566079 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG dbcounter [-] [352329] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=352329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:53:47.578379 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8fd375-3d89-4191-8e14-594f8a8f1cef None admin] Validating token access rules against request {{(pid=352328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:53:47.621343 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072ee9ba-8bdf-4ad1-b23a-c874126ebdb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:53:47.621992 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072ee9ba-8bdf-4ad1-b23a-c874126ebdb9 None admin] REQUEST_METHOD: `GET` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:53:47.622275 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072ee9ba-8bdf-4ad1-b23a-c874126ebdb9 None admin] SCRIPT_NAME: `/identity` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:53:47.622552 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072ee9ba-8bdf-4ad1-b23a-c874126ebdb9 None admin] PATH_INFO: `/v3/domains` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:53:47.623268 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-072ee9ba-8bdf-4ad1-b23a-c874126ebdb9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=352328) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:53:47.623579 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-072ee9ba-8bdf-4ad1-b23a-c874126ebdb9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:53:47.625064 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-072ee9ba-8bdf-4ad1-b23a-c874126ebdb9 None admin] RBAC: Authorization granted {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:53:47.638354 dv-cinder-851351-1-smb devstack@keystone.service[352328]: [pid: 352328|app: 0|req: 261/521] 10.222.0.42 () {56 vars in 1109 bytes} [Thu Jul 28 08:53:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:53:47.643790 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072ee9ba-8bdf-4ad1-b23a-c874126ebdb9 None admin] Authenticating user token {{(pid=352328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:53:47.644404 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-550ed67f-3f9c-4097-a68d-2e85d1798097 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:53:47.645954 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-550ed67f-3f9c-4097-a68d-2e85d1798097 None admin] RBAC: Authorization granted {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:53:47.750624 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072ee9ba-8bdf-4ad1-b23a-c874126ebdb9 None admin] Validating token access rules against request {{(pid=352328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:53:47.754820 dv-cinder-851351-1-smb devstack@keystone.service[352329]: [pid: 352329|app: 0|req: 261/522] 10.222.0.42 () {58 vars in 1282 bytes} [Thu Jul 28 08:53:47 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 373 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 28 08:53:47.755512 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-550ed67f-3f9c-4097-a68d-2e85d1798097 None admin] Authenticating user token {{(pid=352329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:53:47.770735 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG dbcounter [-] [352328] Writing DB stats keystone:SELECT=100 {{(pid=352328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:53:47.794948 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6191b15a-dcb5-45a9-86fc-279c7a65782e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:53:47.795720 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6191b15a-dcb5-45a9-86fc-279c7a65782e None admin] REQUEST_METHOD: `GET` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:53:47.796006 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6191b15a-dcb5-45a9-86fc-279c7a65782e None admin] SCRIPT_NAME: `/identity` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:53:47.796281 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6191b15a-dcb5-45a9-86fc-279c7a65782e None admin] PATH_INFO: `/v3/users` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:53:47.797132 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6191b15a-dcb5-45a9-86fc-279c7a65782e None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=352328) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:53:47.797444 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6191b15a-dcb5-45a9-86fc-279c7a65782e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:53:47.799002 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6191b15a-dcb5-45a9-86fc-279c7a65782e None admin] RBAC: Authorization granted {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:53:47.799373 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG dbcounter [-] [352329] Writing DB stats keystone:SELECT=100 {{(pid=352329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:53:47.818512 dv-cinder-851351-1-smb devstack@keystone.service[352328]: [pid: 352328|app: 0|req: 262/523] 10.222.0.42 () {56 vars in 1139 bytes} [Thu Jul 28 08:53:47 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:53:47.819376 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6191b15a-dcb5-45a9-86fc-279c7a65782e None admin] Authenticating user token {{(pid=352328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:53:47.869115 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-550ed67f-3f9c-4097-a68d-2e85d1798097 None admin] Validating token access rules against request {{(pid=352329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:53:47.908304 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dca6bb6-9df4-4ec8-9f08-6e19aa17e51b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:53:47.908990 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dca6bb6-9df4-4ec8-9f08-6e19aa17e51b None admin] REQUEST_METHOD: `GET` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:53:47.909286 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dca6bb6-9df4-4ec8-9f08-6e19aa17e51b None admin] SCRIPT_NAME: `/identity` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:53:47.909566 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dca6bb6-9df4-4ec8-9f08-6e19aa17e51b None admin] PATH_INFO: `/v3/domains` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:53:47.910295 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dca6bb6-9df4-4ec8-9f08-6e19aa17e51b None admin] RBAC: Adding query filter params (name=Default) {{(pid=352329) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:53:47.910615 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dca6bb6-9df4-4ec8-9f08-6e19aa17e51b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:53:47.912053 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dca6bb6-9df4-4ec8-9f08-6e19aa17e51b None admin] RBAC: Authorization granted {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:53:47.923790 dv-cinder-851351-1-smb devstack@keystone.service[352329]: [pid: 352329|app: 0|req: 262/524] 10.222.0.42 () {56 vars in 1109 bytes} [Thu Jul 28 08:53:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:53:47.924639 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dca6bb6-9df4-4ec8-9f08-6e19aa17e51b None admin] Authenticating user token {{(pid=352329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:53:47.938884 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6191b15a-dcb5-45a9-86fc-279c7a65782e None admin] Validating token access rules against request {{(pid=352328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:53:47.979205 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122818e1-d9dc-4b1f-8953-0b9fa23084b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:53:47.979976 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122818e1-d9dc-4b1f-8953-0b9fa23084b2 None admin] REQUEST_METHOD: `GET` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:53:47.980265 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122818e1-d9dc-4b1f-8953-0b9fa23084b2 None admin] SCRIPT_NAME: `/identity` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:53:47.980547 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122818e1-d9dc-4b1f-8953-0b9fa23084b2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:53:47.992281 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-122818e1-d9dc-4b1f-8953-0b9fa23084b2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:53:47.993814 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-122818e1-d9dc-4b1f-8953-0b9fa23084b2 None admin] RBAC: Authorization granted {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:53:48.006741 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application [None req-122818e1-d9dc-4b1f-8953-0b9fa23084b2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 08:53:48.006741 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:53:48.006741 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:53:48.006741 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:53:48.006741 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:53:48.006741 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:53:48.006741 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:53:48.006741 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:53:48.006741 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:53:48.006741 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:53:48.006741 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:53:48.006741 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:53:48.006741 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 28 08:53:48.006741 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 28 08:53:48.006741 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 28 08:53:48.007900 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 28 08:53:48.007900 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:53:48.007900 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:53:48.007900 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:53:48.007900 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:53:48.007900 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:53:48.007900 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:53:48.007900 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:53:48.007900 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application with Lock( Jul 28 08:53:48.007900 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:53:48.007900 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:53:48.007900 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:53:48.007900 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:53:48.007900 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:53:48.007900 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:53:48.007900 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:53:48.007900 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:53:48.009068 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 28 08:53:48.009068 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 28 08:53:48.009068 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 28 08:53:48.009068 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 28 08:53:48.009068 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 28 08:53:48.009068 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 28 08:53:48.009068 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 08:53:48.009068 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application Jul 28 08:53:48.009068 dv-cinder-851351-1-smb devstack@keystone.service[352328]: [pid: 352328|app: 0|req: 263/525] 10.222.0.42 () {56 vars in 1111 bytes} [Thu Jul 28 08:53:47 2022] GET /identity/v3/projects/service => generated 88 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:53:48.009068 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122818e1-d9dc-4b1f-8953-0b9fa23084b2 None admin] Authenticating user token {{(pid=352328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:53:48.044721 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG dbcounter [-] [352328] Writing DB stats keystone:SELECT=100 {{(pid=352328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:53:48.046091 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG dbcounter [-] [352329] Writing DB stats keystone:SELECT=100 {{(pid=352329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:53:48.050582 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dca6bb6-9df4-4ec8-9f08-6e19aa17e51b None admin] Validating token access rules against request {{(pid=352329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:53:48.089249 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13359374-d923-45b8-992e-c27ae34ab833 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:53:48.089932 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13359374-d923-45b8-992e-c27ae34ab833 None admin] REQUEST_METHOD: `GET` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:53:48.090215 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13359374-d923-45b8-992e-c27ae34ab833 None admin] SCRIPT_NAME: `/identity` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:53:48.090497 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13359374-d923-45b8-992e-c27ae34ab833 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:53:48.102153 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13359374-d923-45b8-992e-c27ae34ab833 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:53:48.103657 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13359374-d923-45b8-992e-c27ae34ab833 None admin] RBAC: Authorization granted {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:53:48.118944 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application [None req-13359374-d923-45b8-992e-c27ae34ab833 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 08:53:48.118944 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:53:48.118944 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:53:48.118944 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:53:48.118944 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:53:48.118944 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:53:48.118944 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:53:48.118944 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:53:48.118944 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:53:48.118944 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:53:48.118944 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:53:48.118944 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:53:48.118944 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 08:53:48.118944 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 08:53:48.118944 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 08:53:48.120107 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 08:53:48.120107 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:53:48.120107 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:53:48.120107 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:53:48.120107 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:53:48.120107 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:53:48.120107 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:53:48.120107 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:53:48.120107 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application with Lock( Jul 28 08:53:48.120107 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:53:48.120107 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:53:48.120107 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:53:48.120107 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:53:48.120107 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:53:48.120107 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:53:48.120107 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:53:48.120107 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:53:48.121255 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 08:53:48.121255 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 08:53:48.121255 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 08:53:48.121255 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application Jul 28 08:53:48.121255 dv-cinder-851351-1-smb devstack@keystone.service[352329]: [pid: 352329|app: 0|req: 263/526] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 08:53:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:53:48.121255 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13359374-d923-45b8-992e-c27ae34ab833 None admin] Authenticating user token {{(pid=352329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:53:48.129113 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122818e1-d9dc-4b1f-8953-0b9fa23084b2 None admin] Validating token access rules against request {{(pid=352328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:53:48.166282 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1de464-b974-46fc-b3bb-d0f239a51961 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:53:48.167353 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1de464-b974-46fc-b3bb-d0f239a51961 None admin] REQUEST_METHOD: `GET` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:53:48.167842 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1de464-b974-46fc-b3bb-d0f239a51961 None admin] SCRIPT_NAME: `/identity` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:53:48.168331 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1de464-b974-46fc-b3bb-d0f239a51961 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:53:48.233839 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13359374-d923-45b8-992e-c27ae34ab833 None admin] Validating token access rules against request {{(pid=352329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:53:48.241427 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae1de464-b974-46fc-b3bb-d0f239a51961 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:53:48.242925 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae1de464-b974-46fc-b3bb-d0f239a51961 None admin] RBAC: Authorization granted {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:53:48.270294 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84894779-fcd4-4543-8f02-4ff5a892fbf5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:53:48.271333 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84894779-fcd4-4543-8f02-4ff5a892fbf5 None admin] REQUEST_METHOD: `GET` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:53:48.271820 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84894779-fcd4-4543-8f02-4ff5a892fbf5 None admin] SCRIPT_NAME: `/identity` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:53:48.272313 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84894779-fcd4-4543-8f02-4ff5a892fbf5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:53:48.273420 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG dbcounter [-] [352328] Writing DB stats keystone:SELECT=100 {{(pid=352328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:53:48.280305 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84894779-fcd4-4543-8f02-4ff5a892fbf5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:53:48.281833 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84894779-fcd4-4543-8f02-4ff5a892fbf5 None admin] RBAC: Authorization granted {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:53:48.294351 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application [None req-84894779-fcd4-4543-8f02-4ff5a892fbf5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 08:53:48.294351 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:53:48.294351 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:53:48.294351 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:53:48.294351 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:53:48.294351 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:53:48.294351 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:53:48.294351 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:53:48.294351 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:53:48.294351 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:53:48.294351 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:53:48.294351 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:53:48.294351 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 28 08:53:48.294351 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 28 08:53:48.294351 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 28 08:53:48.295638 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 28 08:53:48.295638 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:53:48.295638 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:53:48.295638 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:53:48.295638 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:53:48.295638 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:53:48.295638 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:53:48.295638 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:53:48.295638 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application with Lock( Jul 28 08:53:48.295638 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:53:48.295638 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:53:48.295638 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:53:48.295638 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:53:48.295638 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:53:48.295638 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:53:48.295638 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:53:48.295638 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:53:48.297125 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 28 08:53:48.297125 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 28 08:53:48.297125 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 28 08:53:48.297125 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 28 08:53:48.297125 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 28 08:53:48.297125 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 28 08:53:48.297125 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 08:53:48.297125 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application Jul 28 08:53:48.297125 dv-cinder-851351-1-smb devstack@keystone.service[352329]: [pid: 352329|app: 0|req: 264/527] 10.222.0.42 () {56 vars in 1111 bytes} [Thu Jul 28 08:53:48 2022] GET /identity/v3/projects/service => generated 88 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:53:48.297125 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84894779-fcd4-4543-8f02-4ff5a892fbf5 None admin] Authenticating user token {{(pid=352329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:53:48.313994 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG dbcounter [-] [352329] Writing DB stats keystone:SELECT=100 {{(pid=352329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:53:48.363074 dv-cinder-851351-1-smb devstack@keystone.service[352328]: [pid: 352328|app: 0|req: 264/528] 10.222.0.42 () {58 vars in 1282 bytes} [Thu Jul 28 08:53:48 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 350 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 28 08:53:48.363074 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1de464-b974-46fc-b3bb-d0f239a51961 None admin] Authenticating user token {{(pid=352328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:53:48.420454 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84894779-fcd4-4543-8f02-4ff5a892fbf5 None admin] Validating token access rules against request {{(pid=352329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:53:48.460702 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c772095c-14b6-4574-9dab-8e8fcec211af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:53:48.461639 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c772095c-14b6-4574-9dab-8e8fcec211af None admin] REQUEST_METHOD: `GET` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:53:48.461935 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c772095c-14b6-4574-9dab-8e8fcec211af None admin] SCRIPT_NAME: `/identity` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:53:48.462199 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c772095c-14b6-4574-9dab-8e8fcec211af None admin] PATH_INFO: `/v3/projects` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:53:48.463041 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c772095c-14b6-4574-9dab-8e8fcec211af None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=352329) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:53:48.463349 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c772095c-14b6-4574-9dab-8e8fcec211af None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:53:48.464867 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c772095c-14b6-4574-9dab-8e8fcec211af None admin] RBAC: Authorization granted {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:53:48.467491 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1de464-b974-46fc-b3bb-d0f239a51961 None admin] Validating token access rules against request {{(pid=352328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:53:48.483558 dv-cinder-851351-1-smb devstack@keystone.service[352329]: [pid: 352329|app: 0|req: 265/529] 10.222.0.42 () {56 vars in 1148 bytes} [Thu Jul 28 08:53:48 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:53:48.484425 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c772095c-14b6-4574-9dab-8e8fcec211af None admin] Authenticating user token {{(pid=352329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:53:48.506031 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG dbcounter [-] [352328] Writing DB stats keystone:SELECT=100 {{(pid=352328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:53:48.512330 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-534395ac-829f-48d9-b31c-899be36285a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:53:48.512998 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534395ac-829f-48d9-b31c-899be36285a8 None admin] REQUEST_METHOD: `GET` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:53:48.513282 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534395ac-829f-48d9-b31c-899be36285a8 None admin] SCRIPT_NAME: `/identity` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:53:48.513557 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534395ac-829f-48d9-b31c-899be36285a8 None admin] PATH_INFO: `/v3/domains` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:53:48.514265 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-534395ac-829f-48d9-b31c-899be36285a8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=352328) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:53:48.514573 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-534395ac-829f-48d9-b31c-899be36285a8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:53:48.515996 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-534395ac-829f-48d9-b31c-899be36285a8 None admin] RBAC: Authorization granted {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:53:48.528066 dv-cinder-851351-1-smb devstack@keystone.service[352328]: [pid: 352328|app: 0|req: 265/530] 10.222.0.42 () {56 vars in 1109 bytes} [Thu Jul 28 08:53:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:53:48.528926 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-534395ac-829f-48d9-b31c-899be36285a8 None admin] Authenticating user token {{(pid=352328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:53:48.573800 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG dbcounter [-] [352329] Writing DB stats keystone:SELECT=100 {{(pid=352329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:53:48.620068 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c772095c-14b6-4574-9dab-8e8fcec211af None admin] Validating token access rules against request {{(pid=352329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:53:48.661943 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1166ddd8-822b-4962-9d39-953d09e8e1ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:53:48.662581 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1166ddd8-822b-4962-9d39-953d09e8e1ff None admin] REQUEST_METHOD: `GET` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:53:48.662880 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1166ddd8-822b-4962-9d39-953d09e8e1ff None admin] SCRIPT_NAME: `/identity` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:53:48.663128 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1166ddd8-822b-4962-9d39-953d09e8e1ff None admin] PATH_INFO: `/v3/projects` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:53:48.663890 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1166ddd8-822b-4962-9d39-953d09e8e1ff None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=352329) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:53:48.664198 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1166ddd8-822b-4962-9d39-953d09e8e1ff None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:53:48.664727 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-534395ac-829f-48d9-b31c-899be36285a8 None admin] Validating token access rules against request {{(pid=352328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:53:48.665750 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1166ddd8-822b-4962-9d39-953d09e8e1ff None admin] RBAC: Authorization granted {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:53:48.682967 dv-cinder-851351-1-smb devstack@keystone.service[352329]: [pid: 352329|app: 0|req: 266/531] 10.222.0.42 () {56 vars in 1148 bytes} [Thu Jul 28 08:53:48 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:53:48.682967 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1166ddd8-822b-4962-9d39-953d09e8e1ff None admin] Authenticating user token {{(pid=352329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:53:48.707696 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3164c42-b1fe-4364-9150-f22641cf151b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:53:48.708405 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3164c42-b1fe-4364-9150-f22641cf151b None admin] REQUEST_METHOD: `GET` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:53:48.708649 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3164c42-b1fe-4364-9150-f22641cf151b None admin] SCRIPT_NAME: `/identity` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:53:48.708945 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3164c42-b1fe-4364-9150-f22641cf151b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:53:48.720908 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3164c42-b1fe-4364-9150-f22641cf151b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:53:48.722365 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3164c42-b1fe-4364-9150-f22641cf151b None admin] RBAC: Authorization granted {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:53:48.738447 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application [None req-b3164c42-b1fe-4364-9150-f22641cf151b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 08:53:48.738447 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:53:48.738447 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:53:48.738447 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:53:48.738447 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:53:48.738447 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:53:48.738447 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:53:48.738447 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:53:48.738447 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:53:48.738447 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:53:48.738447 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:53:48.738447 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:53:48.738447 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 08:53:48.738447 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 08:53:48.738447 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 08:53:48.739614 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 08:53:48.739614 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:53:48.739614 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:53:48.739614 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:53:48.739614 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:53:48.739614 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:53:48.739614 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:53:48.739614 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:53:48.739614 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application with Lock( Jul 28 08:53:48.739614 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:53:48.739614 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:53:48.739614 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:53:48.739614 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:53:48.739614 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:53:48.739614 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:53:48.739614 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:53:48.739614 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:53:48.741430 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 08:53:48.741430 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 08:53:48.741430 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 08:53:48.741430 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application Jul 28 08:53:48.741430 dv-cinder-851351-1-smb devstack@keystone.service[352328]: [pid: 352328|app: 0|req: 266/532] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 08:53:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:53:48.741430 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3164c42-b1fe-4364-9150-f22641cf151b None admin] Authenticating user token {{(pid=352328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:53:48.789206 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG dbcounter [-] [352328] Writing DB stats keystone:SELECT=100 {{(pid=352328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:53:48.798261 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1166ddd8-822b-4962-9d39-953d09e8e1ff None admin] Validating token access rules against request {{(pid=352329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:53:48.830886 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG dbcounter [-] [352329] Writing DB stats keystone:SELECT=100 {{(pid=352329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:53:48.837941 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a68fac-f1d3-403d-ab26-5635f95cee25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:53:48.838745 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a68fac-f1d3-403d-ab26-5635f95cee25 None admin] REQUEST_METHOD: `GET` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:53:48.839029 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a68fac-f1d3-403d-ab26-5635f95cee25 None admin] SCRIPT_NAME: `/identity` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:53:48.839306 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a68fac-f1d3-403d-ab26-5635f95cee25 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:53:48.840118 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4a68fac-f1d3-403d-ab26-5635f95cee25 None admin] RBAC: Adding query filter params (role.id=32da6d9f8d8f48e285530909f7633410, scope.project.id=9cfa053c839a4fedacde7163d907e2a4, user.id=e3ba63c3fc36470fbbe8312b51a13f13) {{(pid=352329) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:53:48.840434 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4a68fac-f1d3-403d-ab26-5635f95cee25 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:53:48.841945 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4a68fac-f1d3-403d-ab26-5635f95cee25 None admin] RBAC: Authorization granted {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:53:48.848891 dv-cinder-851351-1-smb devstack@keystone.service[352329]: [pid: 352329|app: 0|req: 267/533] 10.222.0.42 () {56 vars in 1374 bytes} [Thu Jul 28 08:53:48 2022] GET /identity/v3/role_assignments?user.id=e3ba63c3fc36470fbbe8312b51a13f13&scope.project.id=9cfa053c839a4fedacde7163d907e2a4&role.id=32da6d9f8d8f48e285530909f7633410 => generated 259 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:53:48.849570 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3164c42-b1fe-4364-9150-f22641cf151b None admin] Validating token access rules against request {{(pid=352328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:53:48.850456 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a68fac-f1d3-403d-ab26-5635f95cee25 None admin] Authenticating user token {{(pid=352329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:53:48.907023 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7837d53-24e8-4abf-9f69-3ec8948714d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:53:48.907831 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7837d53-24e8-4abf-9f69-3ec8948714d1 None admin] REQUEST_METHOD: `GET` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:53:48.908128 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7837d53-24e8-4abf-9f69-3ec8948714d1 None admin] SCRIPT_NAME: `/identity` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:53:48.908412 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7837d53-24e8-4abf-9f69-3ec8948714d1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:53:48.920538 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7837d53-24e8-4abf-9f69-3ec8948714d1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:53:48.922850 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7837d53-24e8-4abf-9f69-3ec8948714d1 None admin] RBAC: Authorization granted {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:53:48.943868 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application [None req-c7837d53-24e8-4abf-9f69-3ec8948714d1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 08:53:48.943868 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:53:48.943868 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:53:48.943868 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:53:48.943868 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:53:48.943868 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:53:48.943868 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:53:48.943868 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:53:48.943868 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:53:48.943868 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:53:48.943868 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:53:48.943868 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:53:48.943868 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 28 08:53:48.943868 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 28 08:53:48.943868 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 28 08:53:48.945099 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 28 08:53:48.945099 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:53:48.945099 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:53:48.945099 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:53:48.945099 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:53:48.945099 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:53:48.945099 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:53:48.945099 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:53:48.945099 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application with Lock( Jul 28 08:53:48.945099 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:53:48.945099 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:53:48.945099 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:53:48.945099 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:53:48.945099 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:53:48.945099 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:53:48.945099 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:53:48.945099 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:53:48.946912 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 28 08:53:48.946912 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 28 08:53:48.946912 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 28 08:53:48.946912 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 28 08:53:48.946912 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 28 08:53:48.946912 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 28 08:53:48.946912 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 08:53:48.946912 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application Jul 28 08:53:48.946912 dv-cinder-851351-1-smb devstack@keystone.service[352328]: [pid: 352328|app: 0|req: 267/534] 10.222.0.42 () {56 vars in 1111 bytes} [Thu Jul 28 08:53:48 2022] GET /identity/v3/projects/service => generated 88 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:53:48.946912 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7837d53-24e8-4abf-9f69-3ec8948714d1 None admin] Authenticating user token {{(pid=352328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:53:49.002176 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a68fac-f1d3-403d-ab26-5635f95cee25 None admin] Validating token access rules against request {{(pid=352329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:53:49.054198 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c397b7d-56d3-4301-90d5-815bb5228e37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:53:49.055669 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c397b7d-56d3-4301-90d5-815bb5228e37 None admin] REQUEST_METHOD: `GET` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:53:49.056184 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c397b7d-56d3-4301-90d5-815bb5228e37 None admin] SCRIPT_NAME: `/identity` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:53:49.056693 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c397b7d-56d3-4301-90d5-815bb5228e37 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:53:49.058756 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c397b7d-56d3-4301-90d5-815bb5228e37 None admin] RBAC: Adding query filter params (role.id=32da6d9f8d8f48e285530909f7633410, scope.project.id=9cfa053c839a4fedacde7163d907e2a4, user.id=b2c09dcfea224aeb8e846eb810e0e489) {{(pid=352329) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:53:49.059085 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c397b7d-56d3-4301-90d5-815bb5228e37 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:53:49.060629 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c397b7d-56d3-4301-90d5-815bb5228e37 None admin] RBAC: Authorization granted {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:53:49.072774 dv-cinder-851351-1-smb devstack@keystone.service[352329]: [pid: 352329|app: 0|req: 268/535] 10.222.0.42 () {56 vars in 1374 bytes} [Thu Jul 28 08:53:48 2022] GET /identity/v3/role_assignments?user.id=b2c09dcfea224aeb8e846eb810e0e489&scope.project.id=9cfa053c839a4fedacde7163d907e2a4&role.id=32da6d9f8d8f48e285530909f7633410 => generated 259 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:53:49.074920 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c397b7d-56d3-4301-90d5-815bb5228e37 None admin] Authenticating user token {{(pid=352329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:53:49.085765 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7837d53-24e8-4abf-9f69-3ec8948714d1 None admin] Validating token access rules against request {{(pid=352328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:53:49.095361 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG dbcounter [-] [352328] Writing DB stats keystone:SELECT=100 {{(pid=352328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:53:49.173993 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa8313c7-2b8d-409d-bb72-8b2000f6428d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:53:49.174697 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8313c7-2b8d-409d-bb72-8b2000f6428d None admin] REQUEST_METHOD: `GET` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:53:49.174981 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8313c7-2b8d-409d-bb72-8b2000f6428d None admin] SCRIPT_NAME: `/identity` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:53:49.175254 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8313c7-2b8d-409d-bb72-8b2000f6428d None admin] PATH_INFO: `/v3/domains` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:53:49.176015 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa8313c7-2b8d-409d-bb72-8b2000f6428d None admin] RBAC: Adding query filter params (name=Default) {{(pid=352328) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:53:49.176323 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa8313c7-2b8d-409d-bb72-8b2000f6428d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:53:49.177781 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa8313c7-2b8d-409d-bb72-8b2000f6428d None admin] RBAC: Authorization granted {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:53:49.201802 dv-cinder-851351-1-smb devstack@keystone.service[352328]: [pid: 352328|app: 0|req: 268/536] 10.222.0.42 () {56 vars in 1109 bytes} [Thu Jul 28 08:53:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:53:49.207674 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG dbcounter [-] [352329] Writing DB stats keystone:SELECT=100 {{(pid=352329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:53:49.208365 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa8313c7-2b8d-409d-bb72-8b2000f6428d None admin] Authenticating user token {{(pid=352328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:53:49.331304 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c397b7d-56d3-4301-90d5-815bb5228e37 None admin] Validating token access rules against request {{(pid=352329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:53:49.335569 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa8313c7-2b8d-409d-bb72-8b2000f6428d None admin] Validating token access rules against request {{(pid=352328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:53:49.371563 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2097f72-f6ac-46ff-a50b-a9dbab1d5997 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:53:49.372279 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2097f72-f6ac-46ff-a50b-a9dbab1d5997 None admin] REQUEST_METHOD: `GET` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:53:49.372554 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2097f72-f6ac-46ff-a50b-a9dbab1d5997 None admin] SCRIPT_NAME: `/identity` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:53:49.372862 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2097f72-f6ac-46ff-a50b-a9dbab1d5997 None admin] PATH_INFO: `/v3/projects/service` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:53:49.380605 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2097f72-f6ac-46ff-a50b-a9dbab1d5997 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:53:49.382137 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2097f72-f6ac-46ff-a50b-a9dbab1d5997 None admin] RBAC: Authorization granted {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:53:49.397359 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application [None req-a2097f72-f6ac-46ff-a50b-a9dbab1d5997 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 08:53:49.397359 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:53:49.397359 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:53:49.397359 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:53:49.397359 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:53:49.397359 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:53:49.397359 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:53:49.397359 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:53:49.397359 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:53:49.397359 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:53:49.397359 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:53:49.397359 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:53:49.397359 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 28 08:53:49.397359 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 28 08:53:49.397359 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 28 08:53:49.398530 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 28 08:53:49.398530 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:53:49.398530 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:53:49.398530 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:53:49.398530 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:53:49.398530 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:53:49.398530 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:53:49.398530 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:53:49.398530 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application with Lock( Jul 28 08:53:49.398530 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:53:49.398530 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:53:49.398530 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:53:49.398530 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:53:49.398530 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:53:49.398530 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:53:49.398530 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:53:49.398530 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:53:49.399865 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 28 08:53:49.399865 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 28 08:53:49.399865 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 28 08:53:49.399865 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 28 08:53:49.399865 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 28 08:53:49.399865 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 28 08:53:49.399865 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 08:53:49.399865 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application Jul 28 08:53:49.399865 dv-cinder-851351-1-smb devstack@keystone.service[352328]: [pid: 352328|app: 0|req: 269/537] 10.222.0.42 () {56 vars in 1111 bytes} [Thu Jul 28 08:53:49 2022] GET /identity/v3/projects/service => generated 88 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 08:53:49.409773 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2097f72-f6ac-46ff-a50b-a9dbab1d5997 None admin] Authenticating user token {{(pid=352328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:53:49.414669 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6cea0b5-c421-4f59-b59b-18a1841b9d15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:53:49.415338 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6cea0b5-c421-4f59-b59b-18a1841b9d15 None admin] REQUEST_METHOD: `GET` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:53:49.415622 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6cea0b5-c421-4f59-b59b-18a1841b9d15 None admin] SCRIPT_NAME: `/identity` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:53:49.415898 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6cea0b5-c421-4f59-b59b-18a1841b9d15 None admin] PATH_INFO: `/v3/projects` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:53:49.416697 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6cea0b5-c421-4f59-b59b-18a1841b9d15 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=352329) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:53:49.417018 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6cea0b5-c421-4f59-b59b-18a1841b9d15 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:53:49.418504 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6cea0b5-c421-4f59-b59b-18a1841b9d15 None admin] RBAC: Authorization granted {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:53:49.445701 dv-cinder-851351-1-smb devstack@keystone.service[352329]: [pid: 352329|app: 0|req: 269/538] 10.222.0.42 () {56 vars in 1148 bytes} [Thu Jul 28 08:53:49 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 371 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:53:49.454784 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6cea0b5-c421-4f59-b59b-18a1841b9d15 None admin] Authenticating user token {{(pid=352329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:53:49.468784 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG dbcounter [-] [352328] Writing DB stats keystone:SELECT=100 {{(pid=352328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:53:49.578776 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2097f72-f6ac-46ff-a50b-a9dbab1d5997 None admin] Validating token access rules against request {{(pid=352328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:53:49.610315 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6cea0b5-c421-4f59-b59b-18a1841b9d15 None admin] Validating token access rules against request {{(pid=352329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:53:49.620893 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63bf8304-ee20-4c61-b515-c237b834bede None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:53:49.621549 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63bf8304-ee20-4c61-b515-c237b834bede None admin] REQUEST_METHOD: `GET` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:53:49.621835 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63bf8304-ee20-4c61-b515-c237b834bede None admin] SCRIPT_NAME: `/identity` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:53:49.622108 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63bf8304-ee20-4c61-b515-c237b834bede None admin] PATH_INFO: `/v3/projects` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:53:49.623260 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63bf8304-ee20-4c61-b515-c237b834bede None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=352328) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:53:49.623574 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63bf8304-ee20-4c61-b515-c237b834bede None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:53:49.625709 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63bf8304-ee20-4c61-b515-c237b834bede None admin] RBAC: Authorization granted {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:53:49.649072 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG dbcounter [-] [352329] Writing DB stats keystone:SELECT=100 {{(pid=352329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:53:49.650704 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e72b75-6694-44b0-9f75-07048217f7db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:53:49.651281 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e72b75-6694-44b0-9f75-07048217f7db None admin] REQUEST_METHOD: `GET` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:53:49.651575 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e72b75-6694-44b0-9f75-07048217f7db None admin] SCRIPT_NAME: `/identity` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:53:49.651854 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e72b75-6694-44b0-9f75-07048217f7db None admin] PATH_INFO: `/v3/role_assignments` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:53:49.652693 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85e72b75-6694-44b0-9f75-07048217f7db None admin] RBAC: Adding query filter params (role.id=32da6d9f8d8f48e285530909f7633410, scope.project.id=9cfa053c839a4fedacde7163d907e2a4, user.id=5ec07578e79545168574fc04cba0a319) {{(pid=352329) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:53:49.653083 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85e72b75-6694-44b0-9f75-07048217f7db None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:53:49.654591 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85e72b75-6694-44b0-9f75-07048217f7db None admin] RBAC: Authorization granted {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:53:49.655285 dv-cinder-851351-1-smb devstack@keystone.service[352328]: [pid: 352328|app: 0|req: 270/539] 10.222.0.42 () {56 vars in 1148 bytes} [Thu Jul 28 08:53:49 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:53:49.656849 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62617a5-8705-4f11-aa2c-97f0a496f3a6 None None] REQUEST_METHOD: `GET` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:53:49.657540 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62617a5-8705-4f11-aa2c-97f0a496f3a6 None None] SCRIPT_NAME: `/identity` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:53:49.657757 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62617a5-8705-4f11-aa2c-97f0a496f3a6 None None] PATH_INFO: `/` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:53:49.660381 dv-cinder-851351-1-smb devstack@keystone.service[352328]: [pid: 352328|app: 0|req: 271/540] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 08:53:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 08:53:49.661227 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62617a5-8705-4f11-aa2c-97f0a496f3a6 None None] Authenticating user token {{(pid=352328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:53:49.669419 dv-cinder-851351-1-smb devstack@keystone.service[352329]: [pid: 352329|app: 0|req: 270/541] 10.222.0.42 () {56 vars in 1374 bytes} [Thu Jul 28 08:53:49 2022] GET /identity/v3/role_assignments?user.id=5ec07578e79545168574fc04cba0a319&scope.project.id=9cfa053c839a4fedacde7163d907e2a4&role.id=32da6d9f8d8f48e285530909f7633410 => generated 259 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:53:49.672612 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47155e0d-252e-4f55-aa2c-b03eb20e813a None None] REQUEST_METHOD: `POST` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:53:49.672992 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47155e0d-252e-4f55-aa2c-b03eb20e813a None None] SCRIPT_NAME: `/identity` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:53:49.673270 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47155e0d-252e-4f55-aa2c-b03eb20e813a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:53:49.699963 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.auth.core [None req-47155e0d-252e-4f55-aa2c-b03eb20e813a None None] MFA Rules not processed for user `d18c063b2377412485965357671e5506`. Rule list: `[]` (Enabled: `True`). {{(pid=352329) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 08:53:49.701280 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.fernet_utils [None req-47155e0d-252e-4f55-aa2c-b03eb20e813a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=352329) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:53:49.837173 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG dbcounter [-] [352328] Writing DB stats keystone:SELECT=100 {{(pid=352328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:53:49.847562 dv-cinder-851351-1-smb devstack@keystone.service[352329]: [pid: 352329|app: 0|req: 271/542] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 08:53:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 28 08:53:49.858985 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62617a5-8705-4f11-aa2c-97f0a496f3a6 None None] Validating token access rules against request {{(pid=352328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:53:49.883204 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47155e0d-252e-4f55-aa2c-b03eb20e813a None None] Authenticating user token {{(pid=352329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:53:49.895648 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5519755-01a3-4a4a-b392-0d1ab6567197 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:53:49.896285 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5519755-01a3-4a4a-b392-0d1ab6567197 None admin] REQUEST_METHOD: `GET` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:53:49.896657 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5519755-01a3-4a4a-b392-0d1ab6567197 None admin] SCRIPT_NAME: `/identity` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:53:49.898723 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5519755-01a3-4a4a-b392-0d1ab6567197 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:53:49.898723 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5519755-01a3-4a4a-b392-0d1ab6567197 None admin] RBAC: Adding query filter params (role.id=32da6d9f8d8f48e285530909f7633410, scope.project.id=9cfa053c839a4fedacde7163d907e2a4, user.id=129f505b6d004c8a949020bd2113e32d) {{(pid=352328) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:53:49.898723 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5519755-01a3-4a4a-b392-0d1ab6567197 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:53:49.899550 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5519755-01a3-4a4a-b392-0d1ab6567197 None admin] RBAC: Authorization granted {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:53:49.906032 dv-cinder-851351-1-smb devstack@keystone.service[352328]: [pid: 352328|app: 0|req: 272/543] 10.222.0.42 () {56 vars in 1374 bytes} [Thu Jul 28 08:53:49 2022] GET /identity/v3/role_assignments?user.id=129f505b6d004c8a949020bd2113e32d&scope.project.id=9cfa053c839a4fedacde7163d907e2a4&role.id=32da6d9f8d8f48e285530909f7633410 => generated 259 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:53:50.008176 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47155e0d-252e-4f55-aa2c-b03eb20e813a None None] Validating token access rules against request {{(pid=352329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:53:50.024692 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG dbcounter [-] [352329] Writing DB stats keystone:SELECT=100 {{(pid=352329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:53:50.051956 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59523794-0813-485e-9327-5eb419cf2662 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:53:50.052630 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59523794-0813-485e-9327-5eb419cf2662 None admin] REQUEST_METHOD: `GET` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:53:50.052940 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59523794-0813-485e-9327-5eb419cf2662 None admin] SCRIPT_NAME: `/identity` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:53:50.053225 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59523794-0813-485e-9327-5eb419cf2662 None admin] PATH_INFO: `/v3/roles/service` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:53:50.069555 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59523794-0813-485e-9327-5eb419cf2662 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 08:53:50.074674 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application [None req-59523794-0813-485e-9327-5eb419cf2662 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 28 08:53:50.074674 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:53:50.074674 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:53:50.074674 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:53:50.074674 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:53:50.074674 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:53:50.074674 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:53:50.074674 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:53:50.074674 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:53:50.074674 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:53:50.074674 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:53:50.074674 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:53:50.074674 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 08:53:50.074674 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 08:53:50.074674 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 08:53:50.074674 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 08:53:50.075818 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 08:53:50.075818 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 08:53:50.075818 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 08:53:50.075818 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 08:53:50.075818 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:53:50.075818 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:53:50.075818 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:53:50.075818 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:53:50.075818 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:53:50.075818 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:53:50.075818 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:53:50.075818 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application with Lock( Jul 28 08:53:50.075818 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:53:50.075818 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:53:50.075818 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:53:50.075818 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:53:50.076997 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:53:50.076997 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:53:50.076997 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:53:50.076997 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:53:50.076997 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 08:53:50.076997 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 08:53:50.076997 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 08:53:50.076997 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 08:53:50.076997 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 08:53:50.076997 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 08:53:50.076997 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 28 08:53:50.076997 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application Jul 28 08:53:50.076997 dv-cinder-851351-1-smb devstack@keystone.service[352329]: [pid: 352329|app: 0|req: 272/544] 10.222.0.42 () {56 vars in 1102 bytes} [Thu Jul 28 08:53:49 2022] GET /identity/v3/roles/service => generated 85 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:53:50.085003 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5519755-01a3-4a4a-b392-0d1ab6567197 None admin] Authenticating user token {{(pid=352328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:53:50.217338 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5519755-01a3-4a4a-b392-0d1ab6567197 None admin] Validating token access rules against request {{(pid=352328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:53:50.253178 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054b00a4-e11b-4476-9235-48deab84d7cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:53:50.253813 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054b00a4-e11b-4476-9235-48deab84d7cb None admin] REQUEST_METHOD: `GET` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:53:50.254092 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054b00a4-e11b-4476-9235-48deab84d7cb None admin] SCRIPT_NAME: `/identity` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:53:50.254371 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054b00a4-e11b-4476-9235-48deab84d7cb None admin] PATH_INFO: `/v3/roles` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:53:50.255082 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-054b00a4-e11b-4476-9235-48deab84d7cb None admin] RBAC: Adding query filter params (name=service) {{(pid=352328) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:53:50.255383 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-054b00a4-e11b-4476-9235-48deab84d7cb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:53:50.256788 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-054b00a4-e11b-4476-9235-48deab84d7cb None admin] RBAC: Authorization granted {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:53:50.265896 dv-cinder-851351-1-smb devstack@keystone.service[352328]: [pid: 352328|app: 0|req: 273/545] 10.222.0.42 () {56 vars in 1103 bytes} [Thu Jul 28 08:53:50 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:53:50.271531 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59523794-0813-485e-9327-5eb419cf2662 None admin] Authenticating user token {{(pid=352329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:53:50.446713 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59523794-0813-485e-9327-5eb419cf2662 None admin] Validating token access rules against request {{(pid=352329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:53:50.482133 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e4be0a-11b8-4dc4-9781-f0fd6f1869a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:53:50.482718 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e4be0a-11b8-4dc4-9781-f0fd6f1869a1 None admin] REQUEST_METHOD: `GET` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:53:50.483005 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e4be0a-11b8-4dc4-9781-f0fd6f1869a1 None admin] SCRIPT_NAME: `/identity` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:53:50.483285 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e4be0a-11b8-4dc4-9781-f0fd6f1869a1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:53:50.494046 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22e4be0a-11b8-4dc4-9781-f0fd6f1869a1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:53:50.495535 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22e4be0a-11b8-4dc4-9781-f0fd6f1869a1 None admin] RBAC: Authorization granted {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:53:50.510789 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application [None req-22e4be0a-11b8-4dc4-9781-f0fd6f1869a1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 08:53:50.510789 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:53:50.510789 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:53:50.510789 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:53:50.510789 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:53:50.510789 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:53:50.510789 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:53:50.510789 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:53:50.510789 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:53:50.510789 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:53:50.510789 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:53:50.510789 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:53:50.510789 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 08:53:50.510789 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 08:53:50.510789 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 08:53:50.511897 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 08:53:50.511897 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:53:50.511897 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:53:50.511897 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:53:50.511897 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:53:50.511897 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:53:50.511897 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:53:50.511897 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:53:50.511897 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application with Lock( Jul 28 08:53:50.511897 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:53:50.511897 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:53:50.511897 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:53:50.511897 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:53:50.511897 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:53:50.511897 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:53:50.511897 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:53:50.511897 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:53:50.513074 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 08:53:50.513074 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 08:53:50.513074 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 08:53:50.513074 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application Jul 28 08:53:50.513074 dv-cinder-851351-1-smb devstack@keystone.service[352329]: [pid: 352329|app: 0|req: 273/546] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 08:53:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:53:50.519658 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054b00a4-e11b-4476-9235-48deab84d7cb None admin] Authenticating user token {{(pid=352328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:53:50.539821 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG dbcounter [-] [352328] Writing DB stats keystone:SELECT=100 {{(pid=352328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:53:50.653648 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054b00a4-e11b-4476-9235-48deab84d7cb None admin] Validating token access rules against request {{(pid=352328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:53:50.701419 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14908dcc-6329-41a6-9ecc-2e1849a372d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:53:50.702080 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14908dcc-6329-41a6-9ecc-2e1849a372d8 None admin] REQUEST_METHOD: `GET` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:53:50.702361 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14908dcc-6329-41a6-9ecc-2e1849a372d8 None admin] SCRIPT_NAME: `/identity` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:53:50.702640 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14908dcc-6329-41a6-9ecc-2e1849a372d8 None admin] PATH_INFO: `/v3/domains` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:53:50.703361 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14908dcc-6329-41a6-9ecc-2e1849a372d8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=352328) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:53:50.703671 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14908dcc-6329-41a6-9ecc-2e1849a372d8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:53:50.705541 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14908dcc-6329-41a6-9ecc-2e1849a372d8 None admin] RBAC: Authorization granted {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:53:50.718640 dv-cinder-851351-1-smb devstack@keystone.service[352328]: [pid: 352328|app: 0|req: 274/547] 10.222.0.42 () {56 vars in 1109 bytes} [Thu Jul 28 08:53:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:53:50.724289 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e4be0a-11b8-4dc4-9781-f0fd6f1869a1 None admin] Authenticating user token {{(pid=352329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:53:50.781882 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG dbcounter [-] [352329] Writing DB stats keystone:SELECT=100 {{(pid=352329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:53:50.872429 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e4be0a-11b8-4dc4-9781-f0fd6f1869a1 None admin] Validating token access rules against request {{(pid=352329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:53:50.919276 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf071819-3b84-49a9-8f32-47c983dc8058 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:53:50.919936 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf071819-3b84-49a9-8f32-47c983dc8058 None admin] REQUEST_METHOD: `GET` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:53:50.920225 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf071819-3b84-49a9-8f32-47c983dc8058 None admin] SCRIPT_NAME: `/identity` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:53:50.920493 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf071819-3b84-49a9-8f32-47c983dc8058 None admin] PATH_INFO: `/v3/users/swift` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:53:50.933804 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf071819-3b84-49a9-8f32-47c983dc8058 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:53:50.935298 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf071819-3b84-49a9-8f32-47c983dc8058 None admin] RBAC: Authorization granted {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:53:50.950241 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application [None req-bf071819-3b84-49a9-8f32-47c983dc8058 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 28 08:53:50.950241 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:53:50.950241 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:53:50.950241 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:53:50.950241 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:53:50.950241 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:53:50.950241 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:53:50.950241 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:53:50.950241 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:53:50.950241 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:53:50.950241 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:53:50.950241 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:53:50.950241 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 28 08:53:50.950241 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 28 08:53:50.950241 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 28 08:53:50.950241 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 28 08:53:50.951410 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:53:50.951410 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:53:50.951410 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 28 08:53:50.951410 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 08:53:50.951410 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 28 08:53:50.951410 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 08:53:50.951410 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:53:50.951410 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:53:50.951410 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:53:50.951410 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:53:50.951410 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:53:50.951410 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application with Lock( Jul 28 08:53:50.951410 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:53:50.951410 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:53:50.951410 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:53:50.951410 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:53:50.951410 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:53:50.951410 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:53:50.952604 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:53:50.952604 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:53:50.952604 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 28 08:53:50.952604 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 28 08:53:50.952604 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 28 08:53:50.952604 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 28 08:53:50.952604 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 28 08:53:50.952604 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 28 08:53:50.952604 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 28 08:53:50.952604 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application Jul 28 08:53:50.952604 dv-cinder-851351-1-smb devstack@keystone.service[352329]: [pid: 352329|app: 0|req: 274/548] 10.222.0.42 () {56 vars in 1096 bytes} [Thu Jul 28 08:53:50 2022] GET /identity/v3/users/swift => generated 83 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:53:50.960084 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14908dcc-6329-41a6-9ecc-2e1849a372d8 None admin] Authenticating user token {{(pid=352328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:53:51.058825 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG dbcounter [-] [352328] Writing DB stats keystone:SELECT=100 {{(pid=352328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:53:51.108432 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14908dcc-6329-41a6-9ecc-2e1849a372d8 None admin] Validating token access rules against request {{(pid=352328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:53:51.162129 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c082153b-fa8b-4e37-b1db-8470a0d90ef9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:53:51.162805 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c082153b-fa8b-4e37-b1db-8470a0d90ef9 None admin] REQUEST_METHOD: `GET` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:53:51.163084 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c082153b-fa8b-4e37-b1db-8470a0d90ef9 None admin] SCRIPT_NAME: `/identity` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:53:51.163357 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c082153b-fa8b-4e37-b1db-8470a0d90ef9 None admin] PATH_INFO: `/v3/users` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:53:51.164188 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c082153b-fa8b-4e37-b1db-8470a0d90ef9 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=352328) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:53:51.164499 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c082153b-fa8b-4e37-b1db-8470a0d90ef9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:53:51.166009 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c082153b-fa8b-4e37-b1db-8470a0d90ef9 None admin] RBAC: Authorization granted {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:53:51.193624 dv-cinder-851351-1-smb devstack@keystone.service[352328]: [pid: 352328|app: 0|req: 275/549] 10.222.0.42 () {56 vars in 1135 bytes} [Thu Jul 28 08:53:50 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:53:51.199410 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf071819-3b84-49a9-8f32-47c983dc8058 None admin] Authenticating user token {{(pid=352329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:53:51.234034 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68436d6b-3b79-49e7-b90e-1e10af3e65bb None None] REQUEST_METHOD: `GET` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:53:51.234579 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68436d6b-3b79-49e7-b90e-1e10af3e65bb None None] SCRIPT_NAME: `/identity` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:53:51.234705 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68436d6b-3b79-49e7-b90e-1e10af3e65bb None None] PATH_INFO: `/` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:53:51.236457 dv-cinder-851351-1-smb devstack@keystone.service[352328]: [pid: 352328|app: 0|req: 276/550] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 08:53:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 28 08:53:51.241413 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896690f7-022c-454b-b016-a47ba1cadba8 None None] REQUEST_METHOD: `POST` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:53:51.241698 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896690f7-022c-454b-b016-a47ba1cadba8 None None] SCRIPT_NAME: `/identity` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:53:51.241977 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896690f7-022c-454b-b016-a47ba1cadba8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:53:51.267888 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.auth.core [None req-896690f7-022c-454b-b016-a47ba1cadba8 None None] MFA Rules not processed for user `d18c063b2377412485965357671e5506`. Rule list: `[]` (Enabled: `True`). {{(pid=352328) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 08:53:51.269272 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.fernet_utils [None req-896690f7-022c-454b-b016-a47ba1cadba8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=352328) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:53:51.289438 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG dbcounter [-] [352329] Writing DB stats keystone:SELECT=100 {{(pid=352329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:53:51.305494 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf071819-3b84-49a9-8f32-47c983dc8058 None admin] Validating token access rules against request {{(pid=352329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:53:51.340473 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff1497f8-0f6a-438c-9aa9-c6ab3b7661e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:53:51.341153 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1497f8-0f6a-438c-9aa9-c6ab3b7661e7 None admin] REQUEST_METHOD: `GET` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:53:51.341438 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1497f8-0f6a-438c-9aa9-c6ab3b7661e7 None admin] SCRIPT_NAME: `/identity` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:53:51.341718 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1497f8-0f6a-438c-9aa9-c6ab3b7661e7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:53:51.407382 dv-cinder-851351-1-smb devstack@keystone.service[352328]: [pid: 352328|app: 0|req: 277/551] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 08:53:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 08:53:51.411131 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff1497f8-0f6a-438c-9aa9-c6ab3b7661e7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:53:51.412626 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff1497f8-0f6a-438c-9aa9-c6ab3b7661e7 None admin] RBAC: Authorization granted {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:53:51.450220 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-896690f7-022c-454b-b016-a47ba1cadba8 None None] Authenticating user token {{(pid=352328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:53:51.497385 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG dbcounter [-] [352329] Writing DB stats keystone:SELECT=100 {{(pid=352329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:53:51.521989 dv-cinder-851351-1-smb devstack@keystone.service[352329]: [pid: 352329|app: 0|req: 275/552] 10.222.0.42 () {58 vars in 1282 bytes} [Thu Jul 28 08:53:51 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 28 08:53:51.528139 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff1497f8-0f6a-438c-9aa9-c6ab3b7661e7 None admin] Authenticating user token {{(pid=352329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:53:51.557064 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG dbcounter [-] [352328] Writing DB stats keystone:SELECT=100 {{(pid=352328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:53:51.611227 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-896690f7-022c-454b-b016-a47ba1cadba8 None None] Validating token access rules against request {{(pid=352328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:53:51.647051 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b6872a-82c1-4b29-8834-c5ede2aa32b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:53:51.647828 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b6872a-82c1-4b29-8834-c5ede2aa32b0 None admin] REQUEST_METHOD: `GET` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:53:51.648745 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b6872a-82c1-4b29-8834-c5ede2aa32b0 None admin] SCRIPT_NAME: `/identity` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:53:51.648745 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b6872a-82c1-4b29-8834-c5ede2aa32b0 None admin] PATH_INFO: `/v3/roles/service` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:53:51.650899 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff1497f8-0f6a-438c-9aa9-c6ab3b7661e7 None admin] Validating token access rules against request {{(pid=352329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:53:51.660408 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b6872a-82c1-4b29-8834-c5ede2aa32b0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 08:53:51.665951 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application [None req-86b6872a-82c1-4b29-8834-c5ede2aa32b0 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 28 08:53:51.665951 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:53:51.665951 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:53:51.665951 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:53:51.665951 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:53:51.665951 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:53:51.665951 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:53:51.665951 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:53:51.665951 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:53:51.665951 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:53:51.665951 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:53:51.665951 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:53:51.665951 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 08:53:51.665951 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 08:53:51.665951 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 08:53:51.665951 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 08:53:51.667104 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 08:53:51.667104 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 08:53:51.667104 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 08:53:51.667104 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 08:53:51.667104 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:53:51.667104 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:53:51.667104 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:53:51.667104 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:53:51.667104 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:53:51.667104 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:53:51.667104 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:53:51.667104 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application with Lock( Jul 28 08:53:51.667104 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:53:51.667104 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:53:51.667104 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:53:51.667104 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:53:51.668162 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:53:51.668162 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:53:51.668162 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:53:51.668162 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:53:51.668162 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 08:53:51.668162 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 08:53:51.668162 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 08:53:51.668162 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 08:53:51.668162 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 08:53:51.668162 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 08:53:51.668162 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 28 08:53:51.668162 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application Jul 28 08:53:51.668162 dv-cinder-851351-1-smb devstack@keystone.service[352328]: [pid: 352328|app: 0|req: 278/553] 10.222.0.42 () {56 vars in 1102 bytes} [Thu Jul 28 08:53:51 2022] GET /identity/v3/roles/service => generated 85 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:53:51.669050 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c496e6-0bf7-48bc-b4cd-38a74cb05f07 None None] REQUEST_METHOD: `GET` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:53:51.669164 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c496e6-0bf7-48bc-b4cd-38a74cb05f07 None None] SCRIPT_NAME: `/identity` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:53:51.670719 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c496e6-0bf7-48bc-b4cd-38a74cb05f07 None None] PATH_INFO: `/` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:53:51.671687 dv-cinder-851351-1-smb devstack@keystone.service[352328]: [pid: 352328|app: 0|req: 279/554] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 08:53:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 08:53:51.675873 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c496e6-0bf7-48bc-b4cd-38a74cb05f07 None None] Authenticating user token {{(pid=352328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:53:51.693419 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca9a48f-8af6-4bc8-8418-a979629e334d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:53:51.694190 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca9a48f-8af6-4bc8-8418-a979629e334d None admin] REQUEST_METHOD: `GET` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:53:51.694472 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca9a48f-8af6-4bc8-8418-a979629e334d None admin] SCRIPT_NAME: `/identity` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:53:51.694743 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca9a48f-8af6-4bc8-8418-a979629e334d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:53:51.706478 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fca9a48f-8af6-4bc8-8418-a979629e334d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:53:51.708285 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fca9a48f-8af6-4bc8-8418-a979629e334d None admin] RBAC: Authorization granted {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:53:51.724308 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application [None req-fca9a48f-8af6-4bc8-8418-a979629e334d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 08:53:51.724308 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:53:51.724308 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:53:51.724308 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:53:51.724308 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:53:51.724308 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:53:51.724308 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:53:51.724308 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:53:51.724308 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:53:51.724308 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:53:51.724308 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:53:51.724308 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:53:51.724308 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 08:53:51.724308 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 08:53:51.724308 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 08:53:51.725634 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 08:53:51.725634 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:53:51.725634 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:53:51.725634 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:53:51.725634 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:53:51.725634 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:53:51.725634 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:53:51.725634 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:53:51.725634 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application with Lock( Jul 28 08:53:51.725634 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:53:51.725634 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:53:51.725634 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:53:51.725634 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:53:51.725634 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:53:51.725634 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:53:51.725634 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:53:51.725634 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:53:51.726986 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 08:53:51.726986 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 08:53:51.726986 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 08:53:51.726986 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application Jul 28 08:53:51.734757 dv-cinder-851351-1-smb devstack@keystone.service[352329]: [pid: 352329|app: 0|req: 276/555] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 08:53:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:53:51.734757 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd436545-1d9b-4c5b-af60-a65d72ee97ed None None] REQUEST_METHOD: `POST` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:53:51.734757 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd436545-1d9b-4c5b-af60-a65d72ee97ed None None] SCRIPT_NAME: `/identity` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:53:51.734757 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd436545-1d9b-4c5b-af60-a65d72ee97ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:53:51.753438 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.auth.core [None req-dd436545-1d9b-4c5b-af60-a65d72ee97ed None None] MFA Rules not processed for user `d18c063b2377412485965357671e5506`. Rule list: `[]` (Enabled: `True`). {{(pid=352329) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 08:53:51.754712 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.fernet_utils [None req-dd436545-1d9b-4c5b-af60-a65d72ee97ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=352329) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:53:51.789403 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG dbcounter [-] [352329] Writing DB stats keystone:SELECT=100 {{(pid=352329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:53:51.790842 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c496e6-0bf7-48bc-b4cd-38a74cb05f07 None None] Validating token access rules against request {{(pid=352328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:53:51.810604 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG dbcounter [-] [352328] Writing DB stats keystone:SELECT=100 {{(pid=352328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:53:51.831403 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9307e466-9652-4ea4-96de-24e57c51a8db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:53:51.831766 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9307e466-9652-4ea4-96de-24e57c51a8db None admin] REQUEST_METHOD: `GET` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:53:51.831982 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9307e466-9652-4ea4-96de-24e57c51a8db None admin] SCRIPT_NAME: `/identity` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:53:51.836745 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9307e466-9652-4ea4-96de-24e57c51a8db None admin] PATH_INFO: `/v3/roles` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:53:51.836745 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9307e466-9652-4ea4-96de-24e57c51a8db None admin] RBAC: Adding query filter params (name=service) {{(pid=352328) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:53:51.836745 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9307e466-9652-4ea4-96de-24e57c51a8db None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:53:51.836745 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9307e466-9652-4ea4-96de-24e57c51a8db None admin] RBAC: Authorization granted {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:53:51.837376 dv-cinder-851351-1-smb devstack@keystone.service[352329]: [pid: 352329|app: 0|req: 277/556] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 08:53:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 08:53:51.838562 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd436545-1d9b-4c5b-af60-a65d72ee97ed None None] Authenticating user token {{(pid=352329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:53:51.844702 dv-cinder-851351-1-smb devstack@keystone.service[352328]: [pid: 352328|app: 0|req: 280/557] 10.222.0.42 () {56 vars in 1103 bytes} [Thu Jul 28 08:53:51 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 08:53:51.849796 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9307e466-9652-4ea4-96de-24e57c51a8db None admin] Authenticating user token {{(pid=352328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:53:51.958869 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9307e466-9652-4ea4-96de-24e57c51a8db None admin] Validating token access rules against request {{(pid=352328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:53:51.961296 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd436545-1d9b-4c5b-af60-a65d72ee97ed None None] Validating token access rules against request {{(pid=352329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:53:51.996645 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc7b604-38bb-4845-bcee-8a45346b20c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:53:51.997776 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc7b604-38bb-4845-bcee-8a45346b20c2 None admin] REQUEST_METHOD: `GET` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:53:51.998122 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffdf1145-bf51-4b52-9e83-55f402953ad9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:53:51.998534 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc7b604-38bb-4845-bcee-8a45346b20c2 None admin] SCRIPT_NAME: `/identity` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:53:51.998754 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffdf1145-bf51-4b52-9e83-55f402953ad9 None admin] REQUEST_METHOD: `GET` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:53:51.999041 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffdf1145-bf51-4b52-9e83-55f402953ad9 None admin] SCRIPT_NAME: `/identity` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:53:51.999313 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffdf1145-bf51-4b52-9e83-55f402953ad9 None admin] PATH_INFO: `/v3/domains` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:53:51.999670 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc7b604-38bb-4845-bcee-8a45346b20c2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:53:52.000021 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffdf1145-bf51-4b52-9e83-55f402953ad9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=352329) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:53:52.000326 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffdf1145-bf51-4b52-9e83-55f402953ad9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:53:52.001816 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffdf1145-bf51-4b52-9e83-55f402953ad9 None admin] RBAC: Authorization granted {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:53:52.013054 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc7b604-38bb-4845-bcee-8a45346b20c2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:53:52.014976 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc7b604-38bb-4845-bcee-8a45346b20c2 None admin] RBAC: Authorization granted {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:53:52.019072 dv-cinder-851351-1-smb devstack@keystone.service[352329]: [pid: 352329|app: 0|req: 278/558] 10.222.0.42 () {56 vars in 1109 bytes} [Thu Jul 28 08:53:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:53:52.020027 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffdf1145-bf51-4b52-9e83-55f402953ad9 None admin] Authenticating user token {{(pid=352329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:53:52.033020 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application [None req-bcc7b604-38bb-4845-bcee-8a45346b20c2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 08:53:52.033020 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:53:52.033020 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:53:52.033020 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:53:52.033020 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:53:52.033020 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:53:52.033020 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:53:52.033020 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:53:52.033020 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:53:52.033020 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:53:52.033020 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:53:52.033020 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:53:52.033020 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 08:53:52.033020 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 08:53:52.033020 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 08:53:52.034265 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 08:53:52.034265 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:53:52.034265 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:53:52.034265 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:53:52.034265 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:53:52.034265 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:53:52.034265 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:53:52.034265 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:53:52.034265 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application with Lock( Jul 28 08:53:52.034265 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:53:52.034265 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:53:52.034265 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:53:52.034265 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:53:52.034265 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:53:52.034265 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:53:52.034265 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:53:52.034265 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:53:52.035379 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 08:53:52.035379 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 08:53:52.035379 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 08:53:52.035379 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application Jul 28 08:53:52.037897 dv-cinder-851351-1-smb devstack@keystone.service[352328]: [pid: 352328|app: 0|req: 281/559] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 08:53:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 08:53:52.039023 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc7b604-38bb-4845-bcee-8a45346b20c2 None admin] Authenticating user token {{(pid=352328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:53:52.049489 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG dbcounter [-] [352329] Writing DB stats keystone:SELECT=100 {{(pid=352329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:53:52.075604 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG dbcounter [-] [352328] Writing DB stats keystone:SELECT=100 {{(pid=352328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:53:52.129544 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffdf1145-bf51-4b52-9e83-55f402953ad9 None admin] Validating token access rules against request {{(pid=352329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:53:52.154490 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc7b604-38bb-4845-bcee-8a45346b20c2 None admin] Validating token access rules against request {{(pid=352328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:53:52.165625 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4103cb22-e036-4c7b-923f-049a3ebc8881 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:53:52.166327 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4103cb22-e036-4c7b-923f-049a3ebc8881 None admin] REQUEST_METHOD: `GET` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:53:52.166614 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4103cb22-e036-4c7b-923f-049a3ebc8881 None admin] SCRIPT_NAME: `/identity` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:53:52.166911 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4103cb22-e036-4c7b-923f-049a3ebc8881 None admin] PATH_INFO: `/v3/roles/service` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:53:52.178460 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4103cb22-e036-4c7b-923f-049a3ebc8881 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 08:53:52.184380 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application [None req-4103cb22-e036-4c7b-923f-049a3ebc8881 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 28 08:53:52.184380 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:53:52.184380 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:53:52.184380 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:53:52.184380 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:53:52.184380 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:53:52.184380 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:53:52.184380 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:53:52.184380 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:53:52.184380 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:53:52.184380 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:53:52.184380 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:53:52.184380 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 08:53:52.184380 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 08:53:52.184380 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 08:53:52.184380 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 08:53:52.185598 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 08:53:52.185598 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 08:53:52.185598 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 08:53:52.185598 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 08:53:52.185598 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:53:52.185598 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:53:52.185598 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:53:52.185598 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:53:52.185598 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:53:52.185598 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:53:52.185598 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:53:52.185598 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application with Lock( Jul 28 08:53:52.185598 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:53:52.185598 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:53:52.185598 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:53:52.185598 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:53:52.186728 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:53:52.186728 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:53:52.186728 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:53:52.186728 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:53:52.186728 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 08:53:52.186728 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 08:53:52.186728 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 08:53:52.186728 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 08:53:52.186728 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 08:53:52.186728 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 08:53:52.186728 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 28 08:53:52.186728 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application Jul 28 08:53:52.188842 dv-cinder-851351-1-smb devstack@keystone.service[352329]: [pid: 352329|app: 0|req: 279/560] 10.222.0.42 () {56 vars in 1102 bytes} [Thu Jul 28 08:53:52 2022] GET /identity/v3/roles/service => generated 85 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:53:52.190079 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4103cb22-e036-4c7b-923f-049a3ebc8881 None admin] Authenticating user token {{(pid=352329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:53:52.192824 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2351af7-6227-4505-b573-eebd96d7128a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:53:52.193486 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2351af7-6227-4505-b573-eebd96d7128a None admin] REQUEST_METHOD: `GET` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:53:52.193771 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2351af7-6227-4505-b573-eebd96d7128a None admin] SCRIPT_NAME: `/identity` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:53:52.194045 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2351af7-6227-4505-b573-eebd96d7128a None admin] PATH_INFO: `/v3/projects/service` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:53:52.201025 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2351af7-6227-4505-b573-eebd96d7128a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:53:52.202499 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2351af7-6227-4505-b573-eebd96d7128a None admin] RBAC: Authorization granted {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:53:52.214545 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application [None req-a2351af7-6227-4505-b573-eebd96d7128a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 08:53:52.214545 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:53:52.214545 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:53:52.214545 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:53:52.214545 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:53:52.214545 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:53:52.214545 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:53:52.214545 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:53:52.214545 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:53:52.214545 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:53:52.214545 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:53:52.214545 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:53:52.214545 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 28 08:53:52.214545 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 28 08:53:52.214545 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 28 08:53:52.215777 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 28 08:53:52.215777 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:53:52.215777 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:53:52.215777 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:53:52.215777 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:53:52.215777 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:53:52.215777 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:53:52.215777 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:53:52.215777 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application with Lock( Jul 28 08:53:52.215777 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:53:52.215777 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:53:52.215777 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:53:52.215777 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:53:52.215777 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:53:52.215777 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:53:52.215777 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:53:52.215777 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:53:52.216939 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 28 08:53:52.216939 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 28 08:53:52.216939 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 28 08:53:52.216939 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 28 08:53:52.216939 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 28 08:53:52.216939 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 28 08:53:52.216939 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 08:53:52.216939 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application Jul 28 08:53:52.216939 dv-cinder-851351-1-smb devstack@keystone.service[352328]: [pid: 352328|app: 0|req: 282/561] 10.222.0.42 () {56 vars in 1111 bytes} [Thu Jul 28 08:53:52 2022] GET /identity/v3/projects/service => generated 88 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:53:52.216939 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f87a99d-82e4-4506-94b5-d0ce5188e91b None None] REQUEST_METHOD: `GET` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:53:52.217710 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f87a99d-82e4-4506-94b5-d0ce5188e91b None None] SCRIPT_NAME: `/identity` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:53:52.217710 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f87a99d-82e4-4506-94b5-d0ce5188e91b None None] PATH_INFO: `/` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:53:52.222691 dv-cinder-851351-1-smb devstack@keystone.service[352328]: [pid: 352328|app: 0|req: 283/562] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 08:53:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 08:53:52.222691 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f87a99d-82e4-4506-94b5-d0ce5188e91b None None] Authenticating user token {{(pid=352328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:53:52.289986 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG dbcounter [-] [352329] Writing DB stats keystone:SELECT=100 {{(pid=352329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:53:52.306374 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4103cb22-e036-4c7b-923f-049a3ebc8881 None admin] Validating token access rules against request {{(pid=352329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:53:52.322444 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG dbcounter [-] [352328] Writing DB stats keystone:SELECT=100 {{(pid=352328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:53:52.334525 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f87a99d-82e4-4506-94b5-d0ce5188e91b None None] Validating token access rules against request {{(pid=352328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:53:52.343368 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed77334-baef-44e1-9aff-304b61fe4bf3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:53:52.344020 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed77334-baef-44e1-9aff-304b61fe4bf3 None admin] REQUEST_METHOD: `GET` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:53:52.344307 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed77334-baef-44e1-9aff-304b61fe4bf3 None admin] SCRIPT_NAME: `/identity` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:53:52.344643 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed77334-baef-44e1-9aff-304b61fe4bf3 None admin] PATH_INFO: `/v3/domains` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:53:52.345403 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fed77334-baef-44e1-9aff-304b61fe4bf3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=352329) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:53:52.345715 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fed77334-baef-44e1-9aff-304b61fe4bf3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:53:52.347122 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fed77334-baef-44e1-9aff-304b61fe4bf3 None admin] RBAC: Authorization granted {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:53:52.361078 dv-cinder-851351-1-smb devstack@keystone.service[352329]: [pid: 352329|app: 0|req: 280/563] 10.222.0.42 () {56 vars in 1109 bytes} [Thu Jul 28 08:53:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:53:52.362664 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed77334-baef-44e1-9aff-304b61fe4bf3 None admin] Authenticating user token {{(pid=352329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:53:52.374080 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6b3e81-45d4-4198-9f1a-9c48b6d6111a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:53:52.374784 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6b3e81-45d4-4198-9f1a-9c48b6d6111a None admin] REQUEST_METHOD: `GET` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:53:52.375079 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6b3e81-45d4-4198-9f1a-9c48b6d6111a None admin] SCRIPT_NAME: `/identity` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:53:52.375360 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6b3e81-45d4-4198-9f1a-9c48b6d6111a None admin] PATH_INFO: `/v3/roles` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:53:52.376565 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb6b3e81-45d4-4198-9f1a-9c48b6d6111a None admin] RBAC: Adding query filter params (name=service) {{(pid=352328) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:53:52.376911 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb6b3e81-45d4-4198-9f1a-9c48b6d6111a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:53:52.378702 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb6b3e81-45d4-4198-9f1a-9c48b6d6111a None admin] RBAC: Authorization granted {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:53:52.388710 dv-cinder-851351-1-smb devstack@keystone.service[352328]: [pid: 352328|app: 0|req: 284/564] 10.222.0.42 () {56 vars in 1103 bytes} [Thu Jul 28 08:53:52 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:53:52.389482 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b5d10b-56f6-4cf2-9b51-f62dd6d995b1 None None] REQUEST_METHOD: `POST` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:53:52.389776 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b5d10b-56f6-4cf2-9b51-f62dd6d995b1 None None] SCRIPT_NAME: `/identity` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:53:52.390059 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b5d10b-56f6-4cf2-9b51-f62dd6d995b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:53:52.409110 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.auth.core [None req-29b5d10b-56f6-4cf2-9b51-f62dd6d995b1 None None] MFA Rules not processed for user `d18c063b2377412485965357671e5506`. Rule list: `[]` (Enabled: `True`). {{(pid=352328) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 08:53:52.410338 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.fernet_utils [None req-29b5d10b-56f6-4cf2-9b51-f62dd6d995b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=352328) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:53:52.482331 dv-cinder-851351-1-smb devstack@keystone.service[352328]: [pid: 352328|app: 0|req: 285/565] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 08:53:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 08:53:52.483152 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b5d10b-56f6-4cf2-9b51-f62dd6d995b1 None None] Authenticating user token {{(pid=352328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:53:52.489814 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed77334-baef-44e1-9aff-304b61fe4bf3 None admin] Validating token access rules against request {{(pid=352329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:53:52.525632 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19ac641-f483-432c-a559-516650271a51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:53:52.526271 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19ac641-f483-432c-a559-516650271a51 None admin] REQUEST_METHOD: `GET` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:53:52.526557 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19ac641-f483-432c-a559-516650271a51 None admin] SCRIPT_NAME: `/identity` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:53:52.526832 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19ac641-f483-432c-a559-516650271a51 None admin] PATH_INFO: `/v3/projects` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:53:52.527595 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c19ac641-f483-432c-a559-516650271a51 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=352329) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:53:52.527906 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c19ac641-f483-432c-a559-516650271a51 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:53:52.529396 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c19ac641-f483-432c-a559-516650271a51 None admin] RBAC: Authorization granted {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:53:52.541948 dv-cinder-851351-1-smb devstack@keystone.service[352329]: [pid: 352329|app: 0|req: 281/566] 10.222.0.42 () {56 vars in 1148 bytes} [Thu Jul 28 08:53:52 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:53:52.543011 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19ac641-f483-432c-a559-516650271a51 None admin] Authenticating user token {{(pid=352329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:53:52.552378 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG dbcounter [-] [352329] Writing DB stats keystone:SELECT=100 {{(pid=352329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:53:52.572383 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG dbcounter [-] [352328] Writing DB stats keystone:SELECT=100 {{(pid=352328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:53:52.591176 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b5d10b-56f6-4cf2-9b51-f62dd6d995b1 None None] Validating token access rules against request {{(pid=352328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:53:52.626423 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e008d44f-1086-48b8-acdd-7f57ce9f47af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:53:52.627130 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e008d44f-1086-48b8-acdd-7f57ce9f47af None admin] REQUEST_METHOD: `GET` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:53:52.627413 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e008d44f-1086-48b8-acdd-7f57ce9f47af None admin] SCRIPT_NAME: `/identity` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:53:52.627676 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e008d44f-1086-48b8-acdd-7f57ce9f47af None admin] PATH_INFO: `/v3/users/nova` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:53:52.634877 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e008d44f-1086-48b8-acdd-7f57ce9f47af None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:53:52.636343 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e008d44f-1086-48b8-acdd-7f57ce9f47af None admin] RBAC: Authorization granted {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:53:52.646095 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19ac641-f483-432c-a559-516650271a51 None admin] Validating token access rules against request {{(pid=352329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:53:52.648138 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application [None req-e008d44f-1086-48b8-acdd-7f57ce9f47af None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 28 08:53:52.648138 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:53:52.648138 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:53:52.648138 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:53:52.648138 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:53:52.648138 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:53:52.648138 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:53:52.648138 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:53:52.648138 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:53:52.648138 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:53:52.648138 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:53:52.648138 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:53:52.648138 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 28 08:53:52.648138 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 28 08:53:52.648138 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 28 08:53:52.648138 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 28 08:53:52.649461 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:53:52.649461 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:53:52.649461 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 28 08:53:52.649461 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 08:53:52.649461 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 28 08:53:52.649461 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 08:53:52.649461 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:53:52.649461 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:53:52.649461 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:53:52.649461 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:53:52.649461 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:53:52.649461 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application with Lock( Jul 28 08:53:52.649461 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:53:52.649461 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:53:52.649461 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:53:52.649461 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:53:52.649461 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:53:52.649461 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:53:52.650868 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:53:52.650868 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:53:52.650868 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 28 08:53:52.650868 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 28 08:53:52.650868 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 28 08:53:52.650868 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 28 08:53:52.650868 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 28 08:53:52.650868 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 28 08:53:52.650868 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 28 08:53:52.650868 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application Jul 28 08:53:52.652999 dv-cinder-851351-1-smb devstack@keystone.service[352328]: [pid: 352328|app: 0|req: 286/567] 10.222.0.42 () {56 vars in 1093 bytes} [Thu Jul 28 08:53:52 2022] GET /identity/v3/users/nova => generated 82 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:53:52.654121 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bdea178-7886-4e21-9c5b-4b5e000957a9 None None] REQUEST_METHOD: `GET` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:53:52.654412 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bdea178-7886-4e21-9c5b-4b5e000957a9 None None] SCRIPT_NAME: `/identity` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:53:52.654694 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bdea178-7886-4e21-9c5b-4b5e000957a9 None None] PATH_INFO: `/` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:53:52.655984 dv-cinder-851351-1-smb devstack@keystone.service[352328]: [pid: 352328|app: 0|req: 287/568] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 08:53:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 08:53:52.656814 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bdea178-7886-4e21-9c5b-4b5e000957a9 None None] Authenticating user token {{(pid=352328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:53:52.685232 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2faaa607-72cc-4bbf-98e1-cd369e514d3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:53:52.685886 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2faaa607-72cc-4bbf-98e1-cd369e514d3e None admin] REQUEST_METHOD: `GET` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:53:52.686189 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2faaa607-72cc-4bbf-98e1-cd369e514d3e None admin] SCRIPT_NAME: `/identity` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:53:52.686469 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2faaa607-72cc-4bbf-98e1-cd369e514d3e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:53:52.697262 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2faaa607-72cc-4bbf-98e1-cd369e514d3e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:53:52.698738 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2faaa607-72cc-4bbf-98e1-cd369e514d3e None admin] RBAC: Authorization granted {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:53:52.713458 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application [None req-2faaa607-72cc-4bbf-98e1-cd369e514d3e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 08:53:52.713458 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:53:52.713458 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:53:52.713458 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:53:52.713458 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:53:52.713458 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:53:52.713458 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:53:52.713458 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:53:52.713458 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:53:52.713458 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:53:52.713458 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:53:52.713458 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:53:52.713458 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 08:53:52.713458 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 08:53:52.713458 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 08:53:52.714786 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 08:53:52.714786 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:53:52.714786 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:53:52.714786 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:53:52.714786 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:53:52.714786 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:53:52.714786 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:53:52.714786 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:53:52.714786 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application with Lock( Jul 28 08:53:52.714786 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:53:52.714786 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:53:52.714786 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:53:52.714786 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:53:52.714786 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:53:52.714786 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:53:52.714786 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:53:52.714786 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:53:52.715917 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 08:53:52.715917 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 08:53:52.715917 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 08:53:52.715917 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application Jul 28 08:53:52.715917 dv-cinder-851351-1-smb devstack@keystone.service[352329]: [pid: 352329|app: 0|req: 282/569] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 08:53:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:53:52.715917 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2faaa607-72cc-4bbf-98e1-cd369e514d3e None admin] Authenticating user token {{(pid=352329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:53:52.765653 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bdea178-7886-4e21-9c5b-4b5e000957a9 None None] Validating token access rules against request {{(pid=352328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:53:52.776782 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG dbcounter [-] [352329] Writing DB stats keystone:SELECT=100 {{(pid=352329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:53:52.799537 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa0af3a4-b8ab-4594-aa1e-3ceaa74df19c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:53:52.800197 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0af3a4-b8ab-4594-aa1e-3ceaa74df19c None admin] REQUEST_METHOD: `GET` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:53:52.800481 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0af3a4-b8ab-4594-aa1e-3ceaa74df19c None admin] SCRIPT_NAME: `/identity` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:53:52.800794 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0af3a4-b8ab-4594-aa1e-3ceaa74df19c None admin] PATH_INFO: `/v3/roles/service` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:53:52.811099 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa0af3a4-b8ab-4594-aa1e-3ceaa74df19c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 08:53:52.816552 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application [None req-aa0af3a4-b8ab-4594-aa1e-3ceaa74df19c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 28 08:53:52.816552 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:53:52.816552 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:53:52.816552 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:53:52.816552 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:53:52.816552 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:53:52.816552 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:53:52.816552 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:53:52.816552 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:53:52.816552 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:53:52.816552 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:53:52.816552 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:53:52.816552 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 08:53:52.816552 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 08:53:52.816552 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 08:53:52.816552 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 08:53:52.817719 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 08:53:52.817719 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 08:53:52.817719 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 08:53:52.817719 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 08:53:52.817719 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:53:52.817719 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:53:52.817719 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:53:52.817719 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:53:52.817719 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:53:52.817719 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:53:52.817719 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:53:52.817719 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application with Lock( Jul 28 08:53:52.817719 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:53:52.817719 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:53:52.817719 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:53:52.817719 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:53:52.818819 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:53:52.818819 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:53:52.818819 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:53:52.818819 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:53:52.818819 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 08:53:52.818819 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 08:53:52.818819 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 08:53:52.818819 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 08:53:52.818819 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 08:53:52.818819 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 08:53:52.818819 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 28 08:53:52.818819 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application Jul 28 08:53:52.818819 dv-cinder-851351-1-smb devstack@keystone.service[352328]: [pid: 352328|app: 0|req: 288/570] 10.222.0.42 () {56 vars in 1102 bytes} [Thu Jul 28 08:53:52 2022] GET /identity/v3/roles/service => generated 85 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:53:52.819693 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2faaa607-72cc-4bbf-98e1-cd369e514d3e None admin] Validating token access rules against request {{(pid=352329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:53:52.819798 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa0af3a4-b8ab-4594-aa1e-3ceaa74df19c None admin] Authenticating user token {{(pid=352328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:53:52.821401 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG dbcounter [-] [352328] Writing DB stats keystone:SELECT=100 {{(pid=352328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:53:52.855510 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-646780a9-26a2-47c3-b15c-8b813fdcb8ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:53:52.856150 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646780a9-26a2-47c3-b15c-8b813fdcb8ea None admin] REQUEST_METHOD: `GET` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:53:52.856435 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646780a9-26a2-47c3-b15c-8b813fdcb8ea None admin] SCRIPT_NAME: `/identity` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:53:52.856765 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646780a9-26a2-47c3-b15c-8b813fdcb8ea None admin] PATH_INFO: `/v3/role_assignments` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:53:52.857561 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-646780a9-26a2-47c3-b15c-8b813fdcb8ea None admin] RBAC: Adding query filter params (role.id=32da6d9f8d8f48e285530909f7633410, scope.project.id=9cfa053c839a4fedacde7163d907e2a4, user.id=456c30f8918e4aef8a8e2d65f1f0faf7) {{(pid=352329) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:53:52.857872 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-646780a9-26a2-47c3-b15c-8b813fdcb8ea None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:53:52.859320 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-646780a9-26a2-47c3-b15c-8b813fdcb8ea None admin] RBAC: Authorization granted {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:53:52.864797 dv-cinder-851351-1-smb devstack@keystone.service[352329]: [pid: 352329|app: 0|req: 283/571] 10.222.0.42 () {56 vars in 1374 bytes} [Thu Jul 28 08:53:52 2022] GET /identity/v3/role_assignments?user.id=456c30f8918e4aef8a8e2d65f1f0faf7&scope.project.id=9cfa053c839a4fedacde7163d907e2a4&role.id=32da6d9f8d8f48e285530909f7633410 => generated 259 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:53:52.865955 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504d7509-2052-433d-9dac-759d3feaabc3 None None] REQUEST_METHOD: `POST` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:53:52.866238 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504d7509-2052-433d-9dac-759d3feaabc3 None None] SCRIPT_NAME: `/identity` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:53:52.866512 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504d7509-2052-433d-9dac-759d3feaabc3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:53:52.892873 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.auth.core [None req-504d7509-2052-433d-9dac-759d3feaabc3 None None] MFA Rules not processed for user `d18c063b2377412485965357671e5506`. Rule list: `[]` (Enabled: `True`). {{(pid=352329) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 08:53:52.894133 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.fernet_utils [None req-504d7509-2052-433d-9dac-759d3feaabc3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=352329) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:53:52.932882 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa0af3a4-b8ab-4594-aa1e-3ceaa74df19c None admin] Validating token access rules against request {{(pid=352328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:53:52.972484 dv-cinder-851351-1-smb devstack@keystone.service[352329]: [pid: 352329|app: 0|req: 284/572] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 08:53:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 08:53:52.973404 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504d7509-2052-433d-9dac-759d3feaabc3 None None] Authenticating user token {{(pid=352329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:53:52.987118 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf07215-aa1a-4d1a-ae43-03f5849492e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:53:52.988218 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf07215-aa1a-4d1a-ae43-03f5849492e7 None admin] REQUEST_METHOD: `GET` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:53:52.988731 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf07215-aa1a-4d1a-ae43-03f5849492e7 None admin] SCRIPT_NAME: `/identity` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:53:52.989478 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf07215-aa1a-4d1a-ae43-03f5849492e7 None admin] PATH_INFO: `/v3/users` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:53:52.991119 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf07215-aa1a-4d1a-ae43-03f5849492e7 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=352328) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:53:52.991638 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf07215-aa1a-4d1a-ae43-03f5849492e7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:53:52.993944 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf07215-aa1a-4d1a-ae43-03f5849492e7 None admin] RBAC: Authorization granted {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:53:53.020635 dv-cinder-851351-1-smb devstack@keystone.service[352328]: [pid: 352328|app: 0|req: 289/573] 10.222.0.42 () {56 vars in 1133 bytes} [Thu Jul 28 08:53:52 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:53:53.021964 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf07215-aa1a-4d1a-ae43-03f5849492e7 None admin] Authenticating user token {{(pid=352328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:53:53.038937 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG dbcounter [-] [352329] Writing DB stats keystone:SELECT=100 {{(pid=352329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:53:53.087636 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG dbcounter [-] [352328] Writing DB stats keystone:SELECT=100 {{(pid=352328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:53:53.094150 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504d7509-2052-433d-9dac-759d3feaabc3 None None] Validating token access rules against request {{(pid=352329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:53:53.130043 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34abaefa-b7a2-404b-9295-d404949ad096 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:53:53.131000 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34abaefa-b7a2-404b-9295-d404949ad096 None admin] REQUEST_METHOD: `GET` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:53:53.131460 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34abaefa-b7a2-404b-9295-d404949ad096 None admin] SCRIPT_NAME: `/identity` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:53:53.131906 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34abaefa-b7a2-404b-9295-d404949ad096 None admin] PATH_INFO: `/v3/domains` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:53:53.132615 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34abaefa-b7a2-404b-9295-d404949ad096 None admin] RBAC: Adding query filter params (name=Default) {{(pid=352329) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:53:53.132956 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34abaefa-b7a2-404b-9295-d404949ad096 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:53:53.134350 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34abaefa-b7a2-404b-9295-d404949ad096 None admin] RBAC: Authorization granted {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:53:53.135761 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf07215-aa1a-4d1a-ae43-03f5849492e7 None admin] Validating token access rules against request {{(pid=352328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:53:53.150734 dv-cinder-851351-1-smb devstack@keystone.service[352329]: [pid: 352329|app: 0|req: 285/574] 10.222.0.42 () {56 vars in 1109 bytes} [Thu Jul 28 08:53:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:53:53.151654 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34abaefa-b7a2-404b-9295-d404949ad096 None admin] Authenticating user token {{(pid=352329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:53:53.171243 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9efdc9-3832-4134-9e55-1804c4dfd141 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:53:53.171881 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9efdc9-3832-4134-9e55-1804c4dfd141 None admin] REQUEST_METHOD: `GET` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:53:53.172166 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9efdc9-3832-4134-9e55-1804c4dfd141 None admin] SCRIPT_NAME: `/identity` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:53:53.172442 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9efdc9-3832-4134-9e55-1804c4dfd141 None admin] PATH_INFO: `/v3/roles` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:53:53.173248 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb9efdc9-3832-4134-9e55-1804c4dfd141 None admin] RBAC: Adding query filter params (name=service) {{(pid=352328) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:53:53.173554 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb9efdc9-3832-4134-9e55-1804c4dfd141 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:53:53.174955 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb9efdc9-3832-4134-9e55-1804c4dfd141 None admin] RBAC: Authorization granted {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:53:53.183254 dv-cinder-851351-1-smb devstack@keystone.service[352328]: [pid: 352328|app: 0|req: 290/575] 10.222.0.42 () {56 vars in 1103 bytes} [Thu Jul 28 08:53:53 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:53:53.184071 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9efdc9-3832-4134-9e55-1804c4dfd141 None admin] Authenticating user token {{(pid=352328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:53:53.262016 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34abaefa-b7a2-404b-9295-d404949ad096 None admin] Validating token access rules against request {{(pid=352329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:53:53.275822 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG dbcounter [-] [352329] Writing DB stats keystone:SELECT=100 {{(pid=352329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:53:53.297481 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9efdc9-3832-4134-9e55-1804c4dfd141 None admin] Validating token access rules against request {{(pid=352328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:53:53.299066 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c26e16-0641-427c-9900-230f5a4b8c20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:53:53.300483 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c26e16-0641-427c-9900-230f5a4b8c20 None admin] REQUEST_METHOD: `GET` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:53:53.300483 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c26e16-0641-427c-9900-230f5a4b8c20 None admin] SCRIPT_NAME: `/identity` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:53:53.300483 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c26e16-0641-427c-9900-230f5a4b8c20 None admin] PATH_INFO: `/v3/roles/service` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:53:53.312651 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76c26e16-0641-427c-9900-230f5a4b8c20 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 08:53:53.318244 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application [None req-76c26e16-0641-427c-9900-230f5a4b8c20 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 28 08:53:53.318244 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:53:53.318244 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:53:53.318244 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:53:53.318244 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:53:53.318244 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:53:53.318244 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:53:53.318244 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:53:53.318244 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:53:53.318244 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:53:53.318244 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:53:53.318244 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:53:53.318244 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 08:53:53.318244 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 08:53:53.318244 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 08:53:53.318244 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 08:53:53.319400 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 08:53:53.319400 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 08:53:53.319400 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 08:53:53.319400 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 08:53:53.319400 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:53:53.319400 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:53:53.319400 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:53:53.319400 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:53:53.319400 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:53:53.319400 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:53:53.319400 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:53:53.319400 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application with Lock( Jul 28 08:53:53.319400 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:53:53.319400 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:53:53.319400 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:53:53.319400 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:53:53.320441 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:53:53.320441 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:53:53.320441 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:53:53.320441 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:53:53.320441 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 08:53:53.320441 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 08:53:53.320441 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 08:53:53.320441 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 08:53:53.320441 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 08:53:53.320441 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 08:53:53.320441 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 28 08:53:53.320441 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application Jul 28 08:53:53.320441 dv-cinder-851351-1-smb devstack@keystone.service[352329]: [pid: 352329|app: 0|req: 286/576] 10.222.0.42 () {56 vars in 1102 bytes} [Thu Jul 28 08:53:53 2022] GET /identity/v3/roles/service => generated 85 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:53:53.321800 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c26e16-0641-427c-9900-230f5a4b8c20 None admin] Authenticating user token {{(pid=352329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:53:53.327261 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG dbcounter [-] [352328] Writing DB stats keystone:SELECT=100 {{(pid=352328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:53:53.342199 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b625721-43f3-4ca7-965c-84e4ba5fc9e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:53:53.342866 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b625721-43f3-4ca7-965c-84e4ba5fc9e9 None admin] REQUEST_METHOD: `GET` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:53:53.343146 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b625721-43f3-4ca7-965c-84e4ba5fc9e9 None admin] SCRIPT_NAME: `/identity` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:53:53.343425 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b625721-43f3-4ca7-965c-84e4ba5fc9e9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:53:53.354553 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b625721-43f3-4ca7-965c-84e4ba5fc9e9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:53:53.356016 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b625721-43f3-4ca7-965c-84e4ba5fc9e9 None admin] RBAC: Authorization granted {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:53:53.374865 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application [None req-2b625721-43f3-4ca7-965c-84e4ba5fc9e9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 08:53:53.374865 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:53:53.374865 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:53:53.374865 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:53:53.374865 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:53:53.374865 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:53:53.374865 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:53:53.374865 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:53:53.374865 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:53:53.374865 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:53:53.374865 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:53:53.374865 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:53:53.374865 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 08:53:53.374865 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 08:53:53.374865 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 08:53:53.376200 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 08:53:53.376200 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:53:53.376200 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:53:53.376200 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:53:53.376200 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:53:53.376200 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:53:53.376200 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:53:53.376200 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:53:53.376200 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application with Lock( Jul 28 08:53:53.376200 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:53:53.376200 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:53:53.376200 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:53:53.376200 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:53:53.376200 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:53:53.376200 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:53:53.376200 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:53:53.376200 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:53:53.377777 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 08:53:53.377777 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 08:53:53.377777 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 08:53:53.377777 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application Jul 28 08:53:53.378408 dv-cinder-851351-1-smb devstack@keystone.service[352328]: [pid: 352328|app: 0|req: 291/577] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 08:53:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:53:53.379332 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b625721-43f3-4ca7-965c-84e4ba5fc9e9 None admin] Authenticating user token {{(pid=352328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:53:53.432483 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c26e16-0641-427c-9900-230f5a4b8c20 None admin] Validating token access rules against request {{(pid=352329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:53:53.469284 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74e2cc1-8e0e-4965-ab24-e1243a57eeba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:53:53.469980 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74e2cc1-8e0e-4965-ab24-e1243a57eeba None admin] REQUEST_METHOD: `GET` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:53:53.470271 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74e2cc1-8e0e-4965-ab24-e1243a57eeba None admin] SCRIPT_NAME: `/identity` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:53:53.470692 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74e2cc1-8e0e-4965-ab24-e1243a57eeba None admin] PATH_INFO: `/v3/users/cinder` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:53:53.479319 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a74e2cc1-8e0e-4965-ab24-e1243a57eeba None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:53:53.481504 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a74e2cc1-8e0e-4965-ab24-e1243a57eeba None admin] RBAC: Authorization granted {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:53:53.482945 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b625721-43f3-4ca7-965c-84e4ba5fc9e9 None admin] Validating token access rules against request {{(pid=352328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:53:53.495958 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application [None req-a74e2cc1-8e0e-4965-ab24-e1243a57eeba None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jul 28 08:53:53.495958 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:53:53.495958 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:53:53.495958 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:53:53.495958 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:53:53.495958 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:53:53.495958 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:53:53.495958 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:53:53.495958 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:53:53.495958 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:53:53.495958 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:53:53.495958 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:53:53.495958 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 28 08:53:53.495958 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 28 08:53:53.495958 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 28 08:53:53.495958 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 28 08:53:53.497379 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:53:53.497379 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:53:53.497379 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 28 08:53:53.497379 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 08:53:53.497379 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 28 08:53:53.497379 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 08:53:53.497379 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:53:53.497379 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:53:53.497379 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:53:53.497379 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:53:53.497379 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:53:53.497379 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application with Lock( Jul 28 08:53:53.497379 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:53:53.497379 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:53:53.497379 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:53:53.497379 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:53:53.497379 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:53:53.497379 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:53:53.499261 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:53:53.499261 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:53:53.499261 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 28 08:53:53.499261 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 28 08:53:53.499261 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 28 08:53:53.499261 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 28 08:53:53.499261 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 28 08:53:53.499261 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 28 08:53:53.499261 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jul 28 08:53:53.499261 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application Jul 28 08:53:53.499261 dv-cinder-851351-1-smb devstack@keystone.service[352329]: [pid: 352329|app: 0|req: 287/578] 10.222.0.42 () {56 vars in 1099 bytes} [Thu Jul 28 08:53:53 2022] GET /identity/v3/users/cinder => generated 84 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:53:53.499261 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74e2cc1-8e0e-4965-ab24-e1243a57eeba None admin] Authenticating user token {{(pid=352329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:53:53.530045 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6166a6-0db2-4489-8af9-f671dd6f1a55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:53:53.530625 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6166a6-0db2-4489-8af9-f671dd6f1a55 None admin] REQUEST_METHOD: `GET` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:53:53.530897 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6166a6-0db2-4489-8af9-f671dd6f1a55 None admin] SCRIPT_NAME: `/identity` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:53:53.531166 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6166a6-0db2-4489-8af9-f671dd6f1a55 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:53:53.538878 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG dbcounter [-] [352329] Writing DB stats keystone:SELECT=100 {{(pid=352329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:53:53.543742 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f6166a6-0db2-4489-8af9-f671dd6f1a55 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:53:53.545271 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f6166a6-0db2-4489-8af9-f671dd6f1a55 None admin] RBAC: Authorization granted {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:53:53.560948 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application [None req-2f6166a6-0db2-4489-8af9-f671dd6f1a55 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 08:53:53.560948 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:53:53.560948 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:53:53.560948 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:53:53.560948 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:53:53.560948 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:53:53.560948 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:53:53.560948 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:53:53.560948 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:53:53.560948 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:53:53.560948 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:53:53.560948 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:53:53.560948 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 08:53:53.560948 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 08:53:53.560948 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 08:53:53.562124 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 08:53:53.562124 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:53:53.562124 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:53:53.562124 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:53:53.562124 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:53:53.562124 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:53:53.562124 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:53:53.562124 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:53:53.562124 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application with Lock( Jul 28 08:53:53.562124 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:53:53.562124 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:53:53.562124 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:53:53.562124 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:53:53.562124 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:53:53.562124 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:53:53.562124 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:53:53.562124 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:53:53.563280 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 08:53:53.563280 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 08:53:53.563280 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 08:53:53.563280 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application Jul 28 08:53:53.563280 dv-cinder-851351-1-smb devstack@keystone.service[352328]: [pid: 352328|app: 0|req: 292/579] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 08:53:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:53:53.563280 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6166a6-0db2-4489-8af9-f671dd6f1a55 None admin] Authenticating user token {{(pid=352328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:53:53.595117 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG dbcounter [-] [352328] Writing DB stats keystone:SELECT=100 {{(pid=352328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:53:53.625754 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74e2cc1-8e0e-4965-ab24-e1243a57eeba None admin] Validating token access rules against request {{(pid=352329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:53:53.659915 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d38b4615-ad71-44c5-8f4b-1f87f8c70763 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:53:53.660552 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38b4615-ad71-44c5-8f4b-1f87f8c70763 None admin] REQUEST_METHOD: `GET` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:53:53.660875 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38b4615-ad71-44c5-8f4b-1f87f8c70763 None admin] SCRIPT_NAME: `/identity` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:53:53.661152 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38b4615-ad71-44c5-8f4b-1f87f8c70763 None admin] PATH_INFO: `/v3/roles` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:53:53.661886 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d38b4615-ad71-44c5-8f4b-1f87f8c70763 None admin] RBAC: Adding query filter params (name=service) {{(pid=352329) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:53:53.662200 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d38b4615-ad71-44c5-8f4b-1f87f8c70763 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:53:53.663599 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d38b4615-ad71-44c5-8f4b-1f87f8c70763 None admin] RBAC: Authorization granted {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:53:53.672725 dv-cinder-851351-1-smb devstack@keystone.service[352329]: [pid: 352329|app: 0|req: 288/580] 10.222.0.42 () {56 vars in 1103 bytes} [Thu Jul 28 08:53:53 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:53:53.673538 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d38b4615-ad71-44c5-8f4b-1f87f8c70763 None admin] Authenticating user token {{(pid=352329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:53:53.674303 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6166a6-0db2-4489-8af9-f671dd6f1a55 None admin] Validating token access rules against request {{(pid=352328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:53:53.714806 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ae8add-0324-4dca-897a-2e8193fbb8f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:53:53.715440 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ae8add-0324-4dca-897a-2e8193fbb8f4 None admin] REQUEST_METHOD: `GET` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:53:53.715720 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ae8add-0324-4dca-897a-2e8193fbb8f4 None admin] SCRIPT_NAME: `/identity` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:53:53.715988 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ae8add-0324-4dca-897a-2e8193fbb8f4 None admin] PATH_INFO: `/v3/domains` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:53:53.716700 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3ae8add-0324-4dca-897a-2e8193fbb8f4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=352328) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:53:53.717410 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3ae8add-0324-4dca-897a-2e8193fbb8f4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:53:53.719142 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3ae8add-0324-4dca-897a-2e8193fbb8f4 None admin] RBAC: Authorization granted {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:53:53.736436 dv-cinder-851351-1-smb devstack@keystone.service[352328]: [pid: 352328|app: 0|req: 293/581] 10.222.0.42 () {56 vars in 1109 bytes} [Thu Jul 28 08:53:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:53:53.736436 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ae8add-0324-4dca-897a-2e8193fbb8f4 None admin] Authenticating user token {{(pid=352328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:53:53.776656 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG dbcounter [-] [352329] Writing DB stats keystone:SELECT=100 {{(pid=352329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:53:53.784012 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d38b4615-ad71-44c5-8f4b-1f87f8c70763 None admin] Validating token access rules against request {{(pid=352329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:53:53.828491 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f59a13-6bdf-4f16-be9b-d31d3ac2fd64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:53:53.829500 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG dbcounter [-] [352328] Writing DB stats keystone:SELECT=100 {{(pid=352328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:53:53.830251 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f59a13-6bdf-4f16-be9b-d31d3ac2fd64 None admin] REQUEST_METHOD: `GET` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:53:53.830579 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f59a13-6bdf-4f16-be9b-d31d3ac2fd64 None admin] SCRIPT_NAME: `/identity` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:53:53.830861 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f59a13-6bdf-4f16-be9b-d31d3ac2fd64 None admin] PATH_INFO: `/v3/users` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:53:53.831668 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87f59a13-6bdf-4f16-be9b-d31d3ac2fd64 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=352329) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:53:53.831974 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87f59a13-6bdf-4f16-be9b-d31d3ac2fd64 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:53:53.833832 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87f59a13-6bdf-4f16-be9b-d31d3ac2fd64 None admin] RBAC: Authorization granted {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:53:53.846286 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ae8add-0324-4dca-897a-2e8193fbb8f4 None admin] Validating token access rules against request {{(pid=352328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:53:53.857235 dv-cinder-851351-1-smb devstack@keystone.service[352329]: [pid: 352329|app: 0|req: 289/582] 10.222.0.42 () {56 vars in 1137 bytes} [Thu Jul 28 08:53:53 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:53:53.857235 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f59a13-6bdf-4f16-be9b-d31d3ac2fd64 None admin] Authenticating user token {{(pid=352329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:53:53.885212 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a041da-d65f-4f86-97b4-8d29deb0daa8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:53:53.885907 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a041da-d65f-4f86-97b4-8d29deb0daa8 None admin] REQUEST_METHOD: `GET` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:53:53.886193 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a041da-d65f-4f86-97b4-8d29deb0daa8 None admin] SCRIPT_NAME: `/identity` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:53:53.886474 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a041da-d65f-4f86-97b4-8d29deb0daa8 None admin] PATH_INFO: `/v3/domains` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:53:53.887218 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a041da-d65f-4f86-97b4-8d29deb0daa8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=352328) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:53:53.887506 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a041da-d65f-4f86-97b4-8d29deb0daa8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:53:53.888911 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a041da-d65f-4f86-97b4-8d29deb0daa8 None admin] RBAC: Authorization granted {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:53:53.907550 dv-cinder-851351-1-smb devstack@keystone.service[352328]: [pid: 352328|app: 0|req: 294/583] 10.222.0.42 () {56 vars in 1109 bytes} [Thu Jul 28 08:53:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:53:53.907550 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a041da-d65f-4f86-97b4-8d29deb0daa8 None admin] Authenticating user token {{(pid=352328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:53:53.983752 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f59a13-6bdf-4f16-be9b-d31d3ac2fd64 None admin] Validating token access rules against request {{(pid=352329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:53:54.022437 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a041da-d65f-4f86-97b4-8d29deb0daa8 None admin] Validating token access rules against request {{(pid=352328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:53:54.031166 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0546f076-1f07-4f47-8e95-2bcdf99bcdab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:53:54.032116 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0546f076-1f07-4f47-8e95-2bcdf99bcdab None admin] REQUEST_METHOD: `GET` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:53:54.032564 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0546f076-1f07-4f47-8e95-2bcdf99bcdab None admin] SCRIPT_NAME: `/identity` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:53:54.033055 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0546f076-1f07-4f47-8e95-2bcdf99bcdab None admin] PATH_INFO: `/v3/domains/Default` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:53:54.044977 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0546f076-1f07-4f47-8e95-2bcdf99bcdab None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:53:54.046762 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0546f076-1f07-4f47-8e95-2bcdf99bcdab None admin] RBAC: Authorization granted {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:53:54.060831 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d884a60b-9470-442d-8945-37b8fe18b832 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:53:54.061487 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d884a60b-9470-442d-8945-37b8fe18b832 None admin] REQUEST_METHOD: `GET` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:53:54.061766 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d884a60b-9470-442d-8945-37b8fe18b832 None admin] SCRIPT_NAME: `/identity` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:53:54.062038 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d884a60b-9470-442d-8945-37b8fe18b832 None admin] PATH_INFO: `/v3/projects/service` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:53:54.064152 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application [None req-0546f076-1f07-4f47-8e95-2bcdf99bcdab None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 08:53:54.064152 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:53:54.064152 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:53:54.064152 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:53:54.064152 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:53:54.064152 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:53:54.064152 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:53:54.064152 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:53:54.064152 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:53:54.064152 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:53:54.064152 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:53:54.064152 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:53:54.064152 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 08:53:54.064152 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 08:53:54.064152 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 08:53:54.065453 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 08:53:54.065453 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:53:54.065453 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:53:54.065453 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:53:54.065453 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:53:54.065453 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:53:54.065453 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:53:54.065453 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:53:54.065453 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application with Lock( Jul 28 08:53:54.065453 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:53:54.065453 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:53:54.065453 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:53:54.065453 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:53:54.065453 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:53:54.065453 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:53:54.065453 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:53:54.065453 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:53:54.066789 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 08:53:54.066789 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 08:53:54.066789 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 08:53:54.066789 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application Jul 28 08:53:54.068495 dv-cinder-851351-1-smb devstack@keystone.service[352329]: [pid: 352329|app: 0|req: 290/584] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 08:53:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:53:54.069571 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0546f076-1f07-4f47-8e95-2bcdf99bcdab None admin] Authenticating user token {{(pid=352329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:53:54.074227 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d884a60b-9470-442d-8945-37b8fe18b832 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:53:54.075272 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG dbcounter [-] [352329] Writing DB stats keystone:SELECT=100 {{(pid=352329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:53:54.075753 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d884a60b-9470-442d-8945-37b8fe18b832 None admin] RBAC: Authorization granted {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:53:54.088806 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application [None req-d884a60b-9470-442d-8945-37b8fe18b832 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 08:53:54.088806 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:53:54.088806 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:53:54.088806 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:53:54.088806 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:53:54.088806 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:53:54.088806 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:53:54.088806 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:53:54.088806 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:53:54.088806 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:53:54.088806 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:53:54.088806 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:53:54.088806 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 28 08:53:54.088806 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 28 08:53:54.088806 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 28 08:53:54.089968 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 28 08:53:54.089968 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:53:54.089968 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:53:54.089968 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:53:54.089968 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:53:54.089968 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:53:54.089968 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:53:54.089968 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:53:54.089968 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application with Lock( Jul 28 08:53:54.089968 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:53:54.089968 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:53:54.089968 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:53:54.089968 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:53:54.089968 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:53:54.089968 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:53:54.089968 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:53:54.089968 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:53:54.091081 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 28 08:53:54.091081 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 28 08:53:54.091081 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 28 08:53:54.091081 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 28 08:53:54.091081 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 28 08:53:54.091081 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 28 08:53:54.091081 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 08:53:54.091081 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application Jul 28 08:53:54.091081 dv-cinder-851351-1-smb devstack@keystone.service[352328]: [pid: 352328|app: 0|req: 295/585] 10.222.0.42 () {56 vars in 1111 bytes} [Thu Jul 28 08:53:53 2022] GET /identity/v3/projects/service => generated 88 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:53:54.091081 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d884a60b-9470-442d-8945-37b8fe18b832 None admin] Authenticating user token {{(pid=352328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:53:54.105123 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG dbcounter [-] [352328] Writing DB stats keystone:SELECT=100 {{(pid=352328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:53:54.190923 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0546f076-1f07-4f47-8e95-2bcdf99bcdab None admin] Validating token access rules against request {{(pid=352329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:53:54.201527 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d884a60b-9470-442d-8945-37b8fe18b832 None admin] Validating token access rules against request {{(pid=352328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:53:54.242108 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1d46a0-9ef2-4dea-a145-1aaa9300f267 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:53:54.243109 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1d46a0-9ef2-4dea-a145-1aaa9300f267 None admin] REQUEST_METHOD: `GET` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:53:54.243328 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1d46a0-9ef2-4dea-a145-1aaa9300f267 None admin] SCRIPT_NAME: `/identity` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:53:54.243582 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1d46a0-9ef2-4dea-a145-1aaa9300f267 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:53:54.247007 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c01d8d-4dcb-4cb5-b58b-b2dfc6595b87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:53:54.247670 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c01d8d-4dcb-4cb5-b58b-b2dfc6595b87 None admin] REQUEST_METHOD: `GET` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:53:54.247951 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c01d8d-4dcb-4cb5-b58b-b2dfc6595b87 None admin] SCRIPT_NAME: `/identity` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:53:54.248227 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c01d8d-4dcb-4cb5-b58b-b2dfc6595b87 None admin] PATH_INFO: `/v3/users/glance` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:53:54.256148 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c1d46a0-9ef2-4dea-a145-1aaa9300f267 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:53:54.257158 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c01d8d-4dcb-4cb5-b58b-b2dfc6595b87 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:53:54.257668 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c1d46a0-9ef2-4dea-a145-1aaa9300f267 None admin] RBAC: Authorization granted {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:53:54.258682 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c01d8d-4dcb-4cb5-b58b-b2dfc6595b87 None admin] RBAC: Authorization granted {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:53:54.270528 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application [None req-33c01d8d-4dcb-4cb5-b58b-b2dfc6595b87 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jul 28 08:53:54.270528 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:53:54.270528 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:53:54.270528 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:53:54.270528 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:53:54.270528 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:53:54.270528 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:53:54.270528 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:53:54.270528 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:53:54.270528 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:53:54.270528 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:53:54.270528 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:53:54.270528 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 28 08:53:54.270528 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 28 08:53:54.270528 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 28 08:53:54.270528 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 28 08:53:54.271707 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:53:54.271707 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:53:54.271707 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 28 08:53:54.271707 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 08:53:54.271707 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 28 08:53:54.271707 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 08:53:54.271707 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:53:54.271707 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:53:54.271707 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:53:54.271707 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:53:54.271707 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:53:54.271707 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application with Lock( Jul 28 08:53:54.271707 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:53:54.271707 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:53:54.271707 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:53:54.271707 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:53:54.271707 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:53:54.271707 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:53:54.273438 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:53:54.273438 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:53:54.273438 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 28 08:53:54.273438 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 28 08:53:54.273438 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 28 08:53:54.273438 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 28 08:53:54.273438 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 28 08:53:54.273438 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 28 08:53:54.273438 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jul 28 08:53:54.273438 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application Jul 28 08:53:54.279208 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application [None req-7c1d46a0-9ef2-4dea-a145-1aaa9300f267 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 08:53:54.279208 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:53:54.279208 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:53:54.279208 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:53:54.279208 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:53:54.279208 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:53:54.279208 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:53:54.279208 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:53:54.279208 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:53:54.279208 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:53:54.279208 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:53:54.279208 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:53:54.279208 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 08:53:54.279208 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 08:53:54.279208 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 08:53:54.280536 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 08:53:54.280536 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:53:54.280536 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:53:54.280536 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:53:54.280536 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:53:54.280536 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:53:54.280536 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:53:54.280536 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:53:54.280536 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application with Lock( Jul 28 08:53:54.280536 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:53:54.280536 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:53:54.280536 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:53:54.280536 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:53:54.280536 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:53:54.280536 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:53:54.280536 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:53:54.280536 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:53:54.283201 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 08:53:54.283201 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 08:53:54.283201 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 08:53:54.283201 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application Jul 28 08:53:54.283201 dv-cinder-851351-1-smb devstack@keystone.service[352329]: [pid: 352329|app: 0|req: 291/586] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 08:53:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:53:54.283201 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1d46a0-9ef2-4dea-a145-1aaa9300f267 None admin] Authenticating user token {{(pid=352329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:53:54.283884 dv-cinder-851351-1-smb devstack@keystone.service[352328]: [pid: 352328|app: 0|req: 296/587] 10.222.0.42 () {56 vars in 1099 bytes} [Thu Jul 28 08:53:54 2022] GET /identity/v3/users/glance => generated 84 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:53:54.283884 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c01d8d-4dcb-4cb5-b58b-b2dfc6595b87 None admin] Authenticating user token {{(pid=352328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:53:54.340173 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG dbcounter [-] [352329] Writing DB stats keystone:SELECT=100 {{(pid=352329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:53:54.352439 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG dbcounter [-] [352328] Writing DB stats keystone:SELECT=100 {{(pid=352328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:53:54.388743 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1d46a0-9ef2-4dea-a145-1aaa9300f267 None admin] Validating token access rules against request {{(pid=352329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:53:54.398758 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c01d8d-4dcb-4cb5-b58b-b2dfc6595b87 None admin] Validating token access rules against request {{(pid=352328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:53:54.423742 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21dbd6d0-2770-4a7a-9ca2-50fc84d6d7a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:53:54.424702 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21dbd6d0-2770-4a7a-9ca2-50fc84d6d7a3 None admin] REQUEST_METHOD: `GET` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:53:54.425175 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21dbd6d0-2770-4a7a-9ca2-50fc84d6d7a3 None admin] SCRIPT_NAME: `/identity` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:53:54.425448 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21dbd6d0-2770-4a7a-9ca2-50fc84d6d7a3 None admin] PATH_INFO: `/v3/domains` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:53:54.426148 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21dbd6d0-2770-4a7a-9ca2-50fc84d6d7a3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=352329) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:53:54.426450 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21dbd6d0-2770-4a7a-9ca2-50fc84d6d7a3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:53:54.427851 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21dbd6d0-2770-4a7a-9ca2-50fc84d6d7a3 None admin] RBAC: Authorization granted {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:53:54.436070 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a20b58-461f-427d-8595-f94209bdb578 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:53:54.436928 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a20b58-461f-427d-8595-f94209bdb578 None admin] REQUEST_METHOD: `GET` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:53:54.437273 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a20b58-461f-427d-8595-f94209bdb578 None admin] SCRIPT_NAME: `/identity` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:53:54.437613 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a20b58-461f-427d-8595-f94209bdb578 None admin] PATH_INFO: `/v3/projects` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:53:54.438501 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34a20b58-461f-427d-8595-f94209bdb578 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=352328) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:53:54.438934 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34a20b58-461f-427d-8595-f94209bdb578 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:53:54.444923 dv-cinder-851351-1-smb devstack@keystone.service[352329]: [pid: 352329|app: 0|req: 292/588] 10.222.0.42 () {56 vars in 1109 bytes} [Thu Jul 28 08:53:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:53:54.445083 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34a20b58-461f-427d-8595-f94209bdb578 None admin] RBAC: Authorization granted {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:53:54.445216 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21dbd6d0-2770-4a7a-9ca2-50fc84d6d7a3 None admin] Authenticating user token {{(pid=352329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:53:54.457983 dv-cinder-851351-1-smb devstack@keystone.service[352328]: [pid: 352328|app: 0|req: 297/589] 10.222.0.42 () {56 vars in 1148 bytes} [Thu Jul 28 08:53:54 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:53:54.458851 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a20b58-461f-427d-8595-f94209bdb578 None admin] Authenticating user token {{(pid=352328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:53:54.553462 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21dbd6d0-2770-4a7a-9ca2-50fc84d6d7a3 None admin] Validating token access rules against request {{(pid=352329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:53:54.569920 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a20b58-461f-427d-8595-f94209bdb578 None admin] Validating token access rules against request {{(pid=352328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:53:54.571091 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG dbcounter [-] [352329] Writing DB stats keystone:SELECT=100 {{(pid=352329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:53:54.590679 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867c1257-3e02-4d5b-9c61-e5eddfbe9cf0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:53:54.591235 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867c1257-3e02-4d5b-9c61-e5eddfbe9cf0 None admin] REQUEST_METHOD: `GET` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:53:54.591517 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867c1257-3e02-4d5b-9c61-e5eddfbe9cf0 None admin] SCRIPT_NAME: `/identity` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:53:54.591789 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867c1257-3e02-4d5b-9c61-e5eddfbe9cf0 None admin] PATH_INFO: `/v3/users` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:53:54.592597 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-867c1257-3e02-4d5b-9c61-e5eddfbe9cf0 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=352329) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:53:54.592933 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-867c1257-3e02-4d5b-9c61-e5eddfbe9cf0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:53:54.594392 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-867c1257-3e02-4d5b-9c61-e5eddfbe9cf0 None admin] RBAC: Authorization granted {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:53:54.598240 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG dbcounter [-] [352328] Writing DB stats keystone:SELECT=100 {{(pid=352328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:53:54.608580 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be53e056-a5b9-4e15-8d85-5eb49808bd7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:53:54.609234 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be53e056-a5b9-4e15-8d85-5eb49808bd7d None admin] REQUEST_METHOD: `GET` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:53:54.610033 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be53e056-a5b9-4e15-8d85-5eb49808bd7d None admin] SCRIPT_NAME: `/identity` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:53:54.610345 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be53e056-a5b9-4e15-8d85-5eb49808bd7d None admin] PATH_INFO: `/v3/domains` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:53:54.611050 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be53e056-a5b9-4e15-8d85-5eb49808bd7d None admin] RBAC: Adding query filter params (name=Default) {{(pid=352328) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:53:54.611350 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be53e056-a5b9-4e15-8d85-5eb49808bd7d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:53:54.612746 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be53e056-a5b9-4e15-8d85-5eb49808bd7d None admin] RBAC: Authorization granted {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:53:54.617616 dv-cinder-851351-1-smb devstack@keystone.service[352329]: [pid: 352329|app: 0|req: 293/590] 10.222.0.42 () {56 vars in 1137 bytes} [Thu Jul 28 08:53:54 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:53:54.617616 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867c1257-3e02-4d5b-9c61-e5eddfbe9cf0 None admin] Authenticating user token {{(pid=352329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:53:54.633940 dv-cinder-851351-1-smb devstack@keystone.service[352328]: [pid: 352328|app: 0|req: 298/591] 10.222.0.42 () {56 vars in 1109 bytes} [Thu Jul 28 08:53:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:53:54.633940 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be53e056-a5b9-4e15-8d85-5eb49808bd7d None admin] Authenticating user token {{(pid=352328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:53:54.726752 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867c1257-3e02-4d5b-9c61-e5eddfbe9cf0 None admin] Validating token access rules against request {{(pid=352329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:53:54.735594 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be53e056-a5b9-4e15-8d85-5eb49808bd7d None admin] Validating token access rules against request {{(pid=352328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:53:54.761522 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15bb0ef-1f04-45ee-8aab-2948542def40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:53:54.762187 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15bb0ef-1f04-45ee-8aab-2948542def40 None admin] REQUEST_METHOD: `GET` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:53:54.762475 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15bb0ef-1f04-45ee-8aab-2948542def40 None admin] SCRIPT_NAME: `/identity` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:53:54.762751 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15bb0ef-1f04-45ee-8aab-2948542def40 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:53:54.770665 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b15bb0ef-1f04-45ee-8aab-2948542def40 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:53:54.772181 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b15bb0ef-1f04-45ee-8aab-2948542def40 None admin] RBAC: Authorization granted {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:53:54.777029 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b703f821-cd3c-436c-ae7a-a08154afb293 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:53:54.777713 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b703f821-cd3c-436c-ae7a-a08154afb293 None admin] REQUEST_METHOD: `PUT` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:53:54.777991 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b703f821-cd3c-436c-ae7a-a08154afb293 None admin] SCRIPT_NAME: `/identity` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:53:54.778263 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b703f821-cd3c-436c-ae7a-a08154afb293 None admin] PATH_INFO: `/v3/projects/9cfa053c839a4fedacde7163d907e2a4/users/e3ba63c3fc36470fbbe8312b51a13f13/roles/32da6d9f8d8f48e285530909f7633410` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:53:54.784899 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application [None req-b15bb0ef-1f04-45ee-8aab-2948542def40 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jul 28 08:53:54.784899 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:53:54.784899 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:53:54.784899 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:53:54.784899 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:53:54.784899 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:53:54.784899 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:53:54.784899 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:53:54.784899 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:53:54.784899 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:53:54.784899 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:53:54.784899 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:53:54.784899 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 28 08:53:54.784899 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 28 08:53:54.784899 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 28 08:53:54.784899 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 28 08:53:54.786063 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:53:54.786063 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:53:54.786063 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 28 08:53:54.786063 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 08:53:54.786063 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 28 08:53:54.786063 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 08:53:54.786063 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:53:54.786063 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:53:54.786063 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:53:54.786063 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:53:54.786063 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:53:54.786063 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application with Lock( Jul 28 08:53:54.786063 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:53:54.786063 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:53:54.786063 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:53:54.786063 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:53:54.786063 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:53:54.786063 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:53:54.787261 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:53:54.787261 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:53:54.787261 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 28 08:53:54.787261 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 28 08:53:54.787261 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 28 08:53:54.787261 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 28 08:53:54.787261 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 28 08:53:54.787261 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 28 08:53:54.787261 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jul 28 08:53:54.787261 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application Jul 28 08:53:54.790879 dv-cinder-851351-1-smb devstack@keystone.service[352329]: [pid: 352329|app: 0|req: 294/592] 10.222.0.42 () {56 vars in 1102 bytes} [Thu Jul 28 08:53:54 2022] GET /identity/v3/users/neutron => generated 85 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:53:54.791596 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15bb0ef-1f04-45ee-8aab-2948542def40 None admin] Authenticating user token {{(pid=352329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:53:54.796728 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b703f821-cd3c-436c-ae7a-a08154afb293 None admin] RBAC: Authorizing `identity:create_grant(project_id=9cfa053c839a4fedacde7163d907e2a4, user_id=e3ba63c3fc36470fbbe8312b51a13f13, role_id=32da6d9f8d8f48e285530909f7633410)` {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:53:54.798332 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b703f821-cd3c-436c-ae7a-a08154afb293 None admin] RBAC: Authorization granted {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:53:54.813148 dv-cinder-851351-1-smb devstack@keystone.service[352328]: [pid: 352328|app: 0|req: 299/593] 10.222.0.42 () {58 vars in 1439 bytes} [Thu Jul 28 08:53:54 2022] PUT /identity/v3/projects/9cfa053c839a4fedacde7163d907e2a4/users/e3ba63c3fc36470fbbe8312b51a13f13/roles/32da6d9f8d8f48e285530909f7633410 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 08:53:54.825730 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b703f821-cd3c-436c-ae7a-a08154afb293 None admin] Authenticating user token {{(pid=352328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:53:54.832410 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG dbcounter [-] [352329] Writing DB stats keystone:SELECT=100 {{(pid=352329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:53:54.876515 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG dbcounter [-] [352328] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=352328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:53:54.913028 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15bb0ef-1f04-45ee-8aab-2948542def40 None admin] Validating token access rules against request {{(pid=352329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:53:54.951686 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb0c22c-a411-44b2-96e8-ac19fe9dba50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:53:54.952363 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb0c22c-a411-44b2-96e8-ac19fe9dba50 None admin] REQUEST_METHOD: `GET` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:53:54.952651 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb0c22c-a411-44b2-96e8-ac19fe9dba50 None admin] SCRIPT_NAME: `/identity` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:53:54.952789 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b703f821-cd3c-436c-ae7a-a08154afb293 None admin] Validating token access rules against request {{(pid=352328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:53:54.952960 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb0c22c-a411-44b2-96e8-ac19fe9dba50 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:53:54.966081 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cb0c22c-a411-44b2-96e8-ac19fe9dba50 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:53:54.967667 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cb0c22c-a411-44b2-96e8-ac19fe9dba50 None admin] RBAC: Authorization granted {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:53:54.988485 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application [None req-7cb0c22c-a411-44b2-96e8-ac19fe9dba50 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 08:53:54.988485 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:53:54.988485 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:53:54.988485 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:53:54.988485 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:53:54.988485 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:53:54.988485 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:53:54.988485 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:53:54.988485 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:53:54.988485 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:53:54.988485 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:53:54.988485 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:53:54.988485 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 08:53:54.988485 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 08:53:54.988485 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 08:53:54.989862 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 08:53:54.989862 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:53:54.989862 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:53:54.989862 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:53:54.989862 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:53:54.989862 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:53:54.989862 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:53:54.989862 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:53:54.989862 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application with Lock( Jul 28 08:53:54.989862 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:53:54.989862 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:53:54.989862 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:53:54.989862 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:53:54.989862 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:53:54.989862 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:53:54.989862 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:53:54.989862 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:53:54.991128 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 08:53:54.991128 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 08:53:54.991128 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 08:53:54.991128 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application Jul 28 08:53:54.991128 dv-cinder-851351-1-smb devstack@keystone.service[352329]: [pid: 352329|app: 0|req: 295/594] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 08:53:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:53:54.991128 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb0c22c-a411-44b2-96e8-ac19fe9dba50 None admin] Authenticating user token {{(pid=352329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:53:54.996065 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0effbbe0-3ab6-4703-ba06-44ac8d9dd3eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:53:54.996772 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0effbbe0-3ab6-4703-ba06-44ac8d9dd3eb None admin] REQUEST_METHOD: `GET` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:53:54.997058 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0effbbe0-3ab6-4703-ba06-44ac8d9dd3eb None admin] SCRIPT_NAME: `/identity` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:53:54.997335 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0effbbe0-3ab6-4703-ba06-44ac8d9dd3eb None admin] PATH_INFO: `/v3/projects/service` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:53:55.004852 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0effbbe0-3ab6-4703-ba06-44ac8d9dd3eb None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:53:55.006322 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0effbbe0-3ab6-4703-ba06-44ac8d9dd3eb None admin] RBAC: Authorization granted {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:53:55.019874 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application [None req-0effbbe0-3ab6-4703-ba06-44ac8d9dd3eb None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 08:53:55.019874 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:53:55.019874 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:53:55.019874 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:53:55.019874 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:53:55.019874 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:53:55.019874 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:53:55.019874 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:53:55.019874 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:53:55.019874 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:53:55.019874 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:53:55.019874 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:53:55.019874 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 28 08:53:55.019874 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 28 08:53:55.019874 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 28 08:53:55.021437 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 28 08:53:55.021437 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:53:55.021437 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:53:55.021437 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:53:55.021437 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:53:55.021437 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:53:55.021437 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:53:55.021437 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:53:55.021437 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application with Lock( Jul 28 08:53:55.021437 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:53:55.021437 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:53:55.021437 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:53:55.021437 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:53:55.021437 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:53:55.021437 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:53:55.021437 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:53:55.021437 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:53:55.022543 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 28 08:53:55.022543 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 28 08:53:55.022543 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 28 08:53:55.022543 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 28 08:53:55.022543 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 28 08:53:55.022543 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 28 08:53:55.022543 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 08:53:55.022543 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application Jul 28 08:53:55.022543 dv-cinder-851351-1-smb devstack@keystone.service[352328]: [pid: 352328|app: 0|req: 300/595] 10.222.0.42 () {56 vars in 1111 bytes} [Thu Jul 28 08:53:54 2022] GET /identity/v3/projects/service => generated 88 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:53:55.022543 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0380f357-6de9-43b2-b2ab-2ef8154f0f52 None None] REQUEST_METHOD: `GET` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:53:55.022543 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0380f357-6de9-43b2-b2ab-2ef8154f0f52 None None] SCRIPT_NAME: `/identity` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:53:55.023298 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0380f357-6de9-43b2-b2ab-2ef8154f0f52 None None] PATH_INFO: `/` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:53:55.023825 dv-cinder-851351-1-smb devstack@keystone.service[352328]: [pid: 352328|app: 0|req: 301/596] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 08:53:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 08:53:55.024098 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0380f357-6de9-43b2-b2ab-2ef8154f0f52 None None] Authenticating user token {{(pid=352328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:53:55.088322 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG dbcounter [-] [352329] Writing DB stats keystone:SELECT=100 {{(pid=352329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:53:55.104313 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb0c22c-a411-44b2-96e8-ac19fe9dba50 None admin] Validating token access rules against request {{(pid=352329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:53:55.125446 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG dbcounter [-] [352328] Writing DB stats keystone:SELECT=100 {{(pid=352328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:53:55.133246 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0380f357-6de9-43b2-b2ab-2ef8154f0f52 None None] Validating token access rules against request {{(pid=352328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:53:55.139920 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc22b29-8578-4daa-a60d-d38601b14ba7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:53:55.140561 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc22b29-8578-4daa-a60d-d38601b14ba7 None admin] REQUEST_METHOD: `GET` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:53:55.140879 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc22b29-8578-4daa-a60d-d38601b14ba7 None admin] SCRIPT_NAME: `/identity` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:53:55.141151 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc22b29-8578-4daa-a60d-d38601b14ba7 None admin] PATH_INFO: `/v3/users` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:53:55.142076 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dc22b29-8578-4daa-a60d-d38601b14ba7 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=352329) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:53:55.142379 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dc22b29-8578-4daa-a60d-d38601b14ba7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:53:55.143840 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dc22b29-8578-4daa-a60d-d38601b14ba7 None admin] RBAC: Authorization granted {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:53:55.161040 dv-cinder-851351-1-smb devstack@keystone.service[352329]: [pid: 352329|app: 0|req: 296/597] 10.222.0.42 () {56 vars in 1139 bytes} [Thu Jul 28 08:53:54 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:53:55.161877 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc22b29-8578-4daa-a60d-d38601b14ba7 None admin] Authenticating user token {{(pid=352329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:53:55.176894 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd7e65f3-7d09-4cd5-81b7-a89dca7bead1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:53:55.177915 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7e65f3-7d09-4cd5-81b7-a89dca7bead1 None admin] REQUEST_METHOD: `GET` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:53:55.178209 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7e65f3-7d09-4cd5-81b7-a89dca7bead1 None admin] SCRIPT_NAME: `/identity` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:53:55.178332 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7e65f3-7d09-4cd5-81b7-a89dca7bead1 None admin] PATH_INFO: `/v3/domains` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:53:55.179188 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd7e65f3-7d09-4cd5-81b7-a89dca7bead1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=352328) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:53:55.179505 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd7e65f3-7d09-4cd5-81b7-a89dca7bead1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:53:55.180882 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd7e65f3-7d09-4cd5-81b7-a89dca7bead1 None admin] RBAC: Authorization granted {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:53:55.197268 dv-cinder-851351-1-smb devstack@keystone.service[352328]: [pid: 352328|app: 0|req: 302/598] 10.222.0.42 () {56 vars in 1109 bytes} [Thu Jul 28 08:53:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:53:55.197268 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e1c2b9-c021-4100-a367-e69d5b003a1b None None] REQUEST_METHOD: `POST` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:53:55.197268 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e1c2b9-c021-4100-a367-e69d5b003a1b None None] SCRIPT_NAME: `/identity` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:53:55.197268 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e1c2b9-c021-4100-a367-e69d5b003a1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:53:55.213559 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.auth.core [None req-a6e1c2b9-c021-4100-a367-e69d5b003a1b None None] MFA Rules not processed for user `d18c063b2377412485965357671e5506`. Rule list: `[]` (Enabled: `True`). {{(pid=352328) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 08:53:55.214756 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.fernet_utils [None req-a6e1c2b9-c021-4100-a367-e69d5b003a1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=352328) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:53:55.289218 dv-cinder-851351-1-smb devstack@keystone.service[352328]: [pid: 352328|app: 0|req: 303/599] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 08:53:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 08:53:55.290537 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e1c2b9-c021-4100-a367-e69d5b003a1b None None] Authenticating user token {{(pid=352328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:53:55.296841 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc22b29-8578-4daa-a60d-d38601b14ba7 None admin] Validating token access rules against request {{(pid=352329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:53:55.334909 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c9af15-6f93-409e-adfc-875d0d20443c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:53:55.335549 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c9af15-6f93-409e-adfc-875d0d20443c None admin] REQUEST_METHOD: `GET` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:53:55.335829 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c9af15-6f93-409e-adfc-875d0d20443c None admin] SCRIPT_NAME: `/identity` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:53:55.336101 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c9af15-6f93-409e-adfc-875d0d20443c None admin] PATH_INFO: `/v3/projects` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:53:55.336892 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07c9af15-6f93-409e-adfc-875d0d20443c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=352329) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:53:55.337201 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07c9af15-6f93-409e-adfc-875d0d20443c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:53:55.338648 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07c9af15-6f93-409e-adfc-875d0d20443c None admin] RBAC: Authorization granted {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:53:55.355884 dv-cinder-851351-1-smb devstack@keystone.service[352329]: [pid: 352329|app: 0|req: 297/600] 10.222.0.42 () {56 vars in 1148 bytes} [Thu Jul 28 08:53:55 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:53:55.355884 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c9af15-6f93-409e-adfc-875d0d20443c None admin] Authenticating user token {{(pid=352329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:53:55.359203 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG dbcounter [-] [352329] Writing DB stats keystone:SELECT=100 {{(pid=352329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:53:55.393495 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG dbcounter [-] [352328] Writing DB stats keystone:SELECT=100 {{(pid=352328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:53:55.411580 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e1c2b9-c021-4100-a367-e69d5b003a1b None None] Validating token access rules against request {{(pid=352328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:53:55.459174 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc83dcd-03ca-41fa-b9a8-5013ee2e8bbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:53:55.459921 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc83dcd-03ca-41fa-b9a8-5013ee2e8bbd None admin] REQUEST_METHOD: `GET` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:53:55.460264 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc83dcd-03ca-41fa-b9a8-5013ee2e8bbd None admin] SCRIPT_NAME: `/identity` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:53:55.460623 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc83dcd-03ca-41fa-b9a8-5013ee2e8bbd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:53:55.461127 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c9af15-6f93-409e-adfc-875d0d20443c None admin] Validating token access rules against request {{(pid=352329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:53:55.473358 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fc83dcd-03ca-41fa-b9a8-5013ee2e8bbd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:53:55.474917 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fc83dcd-03ca-41fa-b9a8-5013ee2e8bbd None admin] RBAC: Authorization granted {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:53:55.490471 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application [None req-2fc83dcd-03ca-41fa-b9a8-5013ee2e8bbd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 08:53:55.490471 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:53:55.490471 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:53:55.490471 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:53:55.490471 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:53:55.490471 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:53:55.490471 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:53:55.490471 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:53:55.490471 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:53:55.490471 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:53:55.490471 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:53:55.490471 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:53:55.490471 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 08:53:55.490471 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 08:53:55.490471 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 08:53:55.491844 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 08:53:55.491844 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:53:55.491844 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:53:55.491844 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:53:55.491844 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:53:55.491844 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:53:55.491844 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:53:55.491844 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:53:55.491844 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application with Lock( Jul 28 08:53:55.491844 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:53:55.491844 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:53:55.491844 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:53:55.491844 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:53:55.491844 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:53:55.491844 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:53:55.491844 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:53:55.491844 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:53:55.493397 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 08:53:55.493397 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 08:53:55.493397 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 08:53:55.493397 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application Jul 28 08:53:55.493397 dv-cinder-851351-1-smb devstack@keystone.service[352328]: [pid: 352328|app: 0|req: 304/601] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 08:53:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:53:55.494088 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc83dcd-03ca-41fa-b9a8-5013ee2e8bbd None admin] Authenticating user token {{(pid=352328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:53:55.504618 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd83c5f-7ae5-4c9f-9239-f0a50c4d6c78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:53:55.505351 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd83c5f-7ae5-4c9f-9239-f0a50c4d6c78 None admin] REQUEST_METHOD: `GET` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:53:55.505614 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd83c5f-7ae5-4c9f-9239-f0a50c4d6c78 None admin] SCRIPT_NAME: `/identity` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:53:55.505897 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd83c5f-7ae5-4c9f-9239-f0a50c4d6c78 None admin] PATH_INFO: `/v3/projects/service` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:53:55.513185 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bd83c5f-7ae5-4c9f-9239-f0a50c4d6c78 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:53:55.514652 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bd83c5f-7ae5-4c9f-9239-f0a50c4d6c78 None admin] RBAC: Authorization granted {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:53:55.526500 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application [None req-4bd83c5f-7ae5-4c9f-9239-f0a50c4d6c78 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 08:53:55.526500 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:53:55.526500 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:53:55.526500 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:53:55.526500 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:53:55.526500 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:53:55.526500 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:53:55.526500 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:53:55.526500 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:53:55.526500 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:53:55.526500 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:53:55.526500 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:53:55.526500 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 28 08:53:55.526500 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 28 08:53:55.526500 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 28 08:53:55.527795 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 28 08:53:55.527795 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:53:55.527795 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:53:55.527795 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:53:55.527795 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:53:55.527795 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:53:55.527795 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:53:55.527795 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:53:55.527795 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application with Lock( Jul 28 08:53:55.527795 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:53:55.527795 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:53:55.527795 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:53:55.527795 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:53:55.527795 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:53:55.527795 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:53:55.527795 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:53:55.527795 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:53:55.528963 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 28 08:53:55.528963 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 28 08:53:55.528963 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 28 08:53:55.528963 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 28 08:53:55.528963 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 28 08:53:55.528963 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 28 08:53:55.528963 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 08:53:55.528963 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application Jul 28 08:53:55.528963 dv-cinder-851351-1-smb devstack@keystone.service[352329]: [pid: 352329|app: 0|req: 298/602] 10.222.0.42 () {56 vars in 1111 bytes} [Thu Jul 28 08:53:55 2022] GET /identity/v3/projects/service => generated 88 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:53:55.528963 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd83c5f-7ae5-4c9f-9239-f0a50c4d6c78 None admin] Authenticating user token {{(pid=352329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:53:55.599674 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG dbcounter [-] [352329] Writing DB stats keystone:SELECT=100 {{(pid=352329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:53:55.613675 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc83dcd-03ca-41fa-b9a8-5013ee2e8bbd None admin] Validating token access rules against request {{(pid=352328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:53:55.642628 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd83c5f-7ae5-4c9f-9239-f0a50c4d6c78 None admin] Validating token access rules against request {{(pid=352329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:53:55.649393 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b334095-ccfc-40af-87e1-502aebc22c93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:53:55.650451 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b334095-ccfc-40af-87e1-502aebc22c93 None admin] REQUEST_METHOD: `GET` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:53:55.650801 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b334095-ccfc-40af-87e1-502aebc22c93 None admin] SCRIPT_NAME: `/identity` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:53:55.651138 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b334095-ccfc-40af-87e1-502aebc22c93 None admin] PATH_INFO: `/v3/roles/service` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:53:55.659660 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG dbcounter [-] [352328] Writing DB stats keystone:SELECT=100 {{(pid=352328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:53:55.664361 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b334095-ccfc-40af-87e1-502aebc22c93 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 08:53:55.669631 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application [None req-3b334095-ccfc-40af-87e1-502aebc22c93 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 28 08:53:55.669631 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:53:55.669631 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:53:55.669631 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:53:55.669631 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:53:55.669631 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:53:55.669631 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:53:55.669631 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:53:55.669631 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:53:55.669631 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:53:55.669631 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:53:55.669631 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:53:55.669631 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 08:53:55.669631 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 08:53:55.669631 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 08:53:55.669631 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 08:53:55.670960 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 08:53:55.670960 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 08:53:55.670960 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 08:53:55.670960 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 08:53:55.670960 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:53:55.670960 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:53:55.670960 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:53:55.670960 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:53:55.670960 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:53:55.670960 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:53:55.670960 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:53:55.670960 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application with Lock( Jul 28 08:53:55.670960 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:53:55.670960 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:53:55.670960 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:53:55.670960 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:53:55.676756 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:53:55.676756 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:53:55.676756 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:53:55.676756 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:53:55.676756 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 08:53:55.676756 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 08:53:55.676756 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 08:53:55.676756 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 08:53:55.676756 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 08:53:55.676756 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 08:53:55.676756 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 28 08:53:55.676756 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application Jul 28 08:53:55.676756 dv-cinder-851351-1-smb devstack@keystone.service[352328]: [pid: 352328|app: 0|req: 305/603] 10.222.0.42 () {56 vars in 1102 bytes} [Thu Jul 28 08:53:55 2022] GET /identity/v3/roles/service => generated 85 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:53:55.676756 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b334095-ccfc-40af-87e1-502aebc22c93 None admin] Authenticating user token {{(pid=352328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:53:55.685630 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b5d9e9-11d9-4ff3-83e8-772f418181d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:53:55.686323 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b5d9e9-11d9-4ff3-83e8-772f418181d5 None admin] REQUEST_METHOD: `PUT` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:53:55.686607 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b5d9e9-11d9-4ff3-83e8-772f418181d5 None admin] SCRIPT_NAME: `/identity` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:53:55.686885 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b5d9e9-11d9-4ff3-83e8-772f418181d5 None admin] PATH_INFO: `/v3/projects/9cfa053c839a4fedacde7163d907e2a4/users/b2c09dcfea224aeb8e846eb810e0e489/roles/32da6d9f8d8f48e285530909f7633410` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:53:55.702586 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7b5d9e9-11d9-4ff3-83e8-772f418181d5 None admin] RBAC: Authorizing `identity:create_grant(project_id=9cfa053c839a4fedacde7163d907e2a4, user_id=b2c09dcfea224aeb8e846eb810e0e489, role_id=32da6d9f8d8f48e285530909f7633410)` {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:53:55.704782 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7b5d9e9-11d9-4ff3-83e8-772f418181d5 None admin] RBAC: Authorization granted {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:53:55.718364 dv-cinder-851351-1-smb devstack@keystone.service[352329]: [pid: 352329|app: 0|req: 299/604] 10.222.0.42 () {58 vars in 1439 bytes} [Thu Jul 28 08:53:55 2022] PUT /identity/v3/projects/9cfa053c839a4fedacde7163d907e2a4/users/b2c09dcfea224aeb8e846eb810e0e489/roles/32da6d9f8d8f48e285530909f7633410 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 08:53:55.729722 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b5d9e9-11d9-4ff3-83e8-772f418181d5 None admin] Authenticating user token {{(pid=352329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:53:55.786605 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b334095-ccfc-40af-87e1-502aebc22c93 None admin] Validating token access rules against request {{(pid=352328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:53:55.826981 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf14a07-562c-4817-9828-7aed5efc4b4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:53:55.827684 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf14a07-562c-4817-9828-7aed5efc4b4f None admin] REQUEST_METHOD: `GET` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:53:55.827963 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf14a07-562c-4817-9828-7aed5efc4b4f None admin] SCRIPT_NAME: `/identity` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:53:55.828279 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf14a07-562c-4817-9828-7aed5efc4b4f None admin] PATH_INFO: `/v3/domains` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:53:55.829571 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcf14a07-562c-4817-9828-7aed5efc4b4f None admin] RBAC: Adding query filter params (name=Default) {{(pid=352328) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:53:55.829880 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcf14a07-562c-4817-9828-7aed5efc4b4f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:53:55.831340 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcf14a07-562c-4817-9828-7aed5efc4b4f None admin] RBAC: Authorization granted {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:53:55.849826 dv-cinder-851351-1-smb devstack@keystone.service[352328]: [pid: 352328|app: 0|req: 306/605] 10.222.0.42 () {56 vars in 1109 bytes} [Thu Jul 28 08:53:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:53:55.850868 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf14a07-562c-4817-9828-7aed5efc4b4f None admin] Authenticating user token {{(pid=352328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:53:55.881216 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b5d9e9-11d9-4ff3-83e8-772f418181d5 None admin] Validating token access rules against request {{(pid=352329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:53:55.907204 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG dbcounter [-] [352329] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=352329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:53:55.934077 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG dbcounter [-] [352328] Writing DB stats keystone:SELECT=100 {{(pid=352328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:53:55.936030 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f7e3197-12c6-4618-8b9c-4deb21baed4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:53:55.939201 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7e3197-12c6-4618-8b9c-4deb21baed4e None admin] REQUEST_METHOD: `GET` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:53:55.939201 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7e3197-12c6-4618-8b9c-4deb21baed4e None admin] SCRIPT_NAME: `/identity` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:53:55.939201 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7e3197-12c6-4618-8b9c-4deb21baed4e None admin] PATH_INFO: `/v3/projects` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:53:55.939201 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f7e3197-12c6-4618-8b9c-4deb21baed4e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=352329) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:53:55.939201 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f7e3197-12c6-4618-8b9c-4deb21baed4e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:53:55.944714 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f7e3197-12c6-4618-8b9c-4deb21baed4e None admin] RBAC: Authorization granted {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:53:55.959885 dv-cinder-851351-1-smb devstack@keystone.service[352329]: [pid: 352329|app: 0|req: 300/606] 10.222.0.42 () {56 vars in 1148 bytes} [Thu Jul 28 08:53:55 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:53:55.960986 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f7e3197-12c6-4618-8b9c-4deb21baed4e None admin] Authenticating user token {{(pid=352329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:53:55.992850 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf14a07-562c-4817-9828-7aed5efc4b4f None admin] Validating token access rules against request {{(pid=352328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:53:56.055765 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce730a0-386b-4ce3-8727-629da0e15561 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:53:56.056914 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce730a0-386b-4ce3-8727-629da0e15561 None admin] REQUEST_METHOD: `GET` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:53:56.057301 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce730a0-386b-4ce3-8727-629da0e15561 None admin] SCRIPT_NAME: `/identity` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:53:56.057676 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce730a0-386b-4ce3-8727-629da0e15561 None admin] PATH_INFO: `/v3/roles` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:53:56.058520 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ce730a0-386b-4ce3-8727-629da0e15561 None admin] RBAC: Adding query filter params (name=service) {{(pid=352328) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:53:56.059172 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ce730a0-386b-4ce3-8727-629da0e15561 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:53:56.061580 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ce730a0-386b-4ce3-8727-629da0e15561 None admin] RBAC: Authorization granted {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:53:56.073108 dv-cinder-851351-1-smb devstack@keystone.service[352328]: [pid: 352328|app: 0|req: 307/607] 10.222.0.42 () {56 vars in 1103 bytes} [Thu Jul 28 08:53:55 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:53:56.078328 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce730a0-386b-4ce3-8727-629da0e15561 None admin] Authenticating user token {{(pid=352328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:53:56.100963 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f7e3197-12c6-4618-8b9c-4deb21baed4e None admin] Validating token access rules against request {{(pid=352329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:53:56.147334 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37fe9474-907f-4931-9fca-da61a45a7279 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:53:56.148388 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37fe9474-907f-4931-9fca-da61a45a7279 None admin] REQUEST_METHOD: `GET` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:53:56.148823 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37fe9474-907f-4931-9fca-da61a45a7279 None admin] SCRIPT_NAME: `/identity` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:53:56.149569 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37fe9474-907f-4931-9fca-da61a45a7279 None admin] PATH_INFO: `/v3/projects/service` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:53:56.159323 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37fe9474-907f-4931-9fca-da61a45a7279 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:53:56.160887 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37fe9474-907f-4931-9fca-da61a45a7279 None admin] RBAC: Authorization granted {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:53:56.176304 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application [None req-37fe9474-907f-4931-9fca-da61a45a7279 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 08:53:56.176304 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:53:56.176304 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:53:56.176304 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:53:56.176304 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:53:56.176304 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:53:56.176304 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:53:56.176304 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:53:56.176304 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:53:56.176304 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:53:56.176304 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:53:56.176304 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:53:56.176304 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 28 08:53:56.176304 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 28 08:53:56.176304 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 28 08:53:56.177550 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 28 08:53:56.177550 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:53:56.177550 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:53:56.177550 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:53:56.177550 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:53:56.177550 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:53:56.177550 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:53:56.177550 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:53:56.177550 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application with Lock( Jul 28 08:53:56.177550 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:53:56.177550 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:53:56.177550 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:53:56.177550 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:53:56.177550 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:53:56.177550 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:53:56.177550 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:53:56.177550 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:53:56.178666 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 28 08:53:56.178666 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 28 08:53:56.178666 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 28 08:53:56.178666 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 28 08:53:56.178666 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 28 08:53:56.178666 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 28 08:53:56.178666 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 08:53:56.178666 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application Jul 28 08:53:56.178666 dv-cinder-851351-1-smb devstack@keystone.service[352329]: [pid: 352329|app: 0|req: 301/608] 10.222.0.42 () {56 vars in 1111 bytes} [Thu Jul 28 08:53:55 2022] GET /identity/v3/projects/service => generated 88 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:53:56.179296 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37fe9474-907f-4931-9fca-da61a45a7279 None admin] Authenticating user token {{(pid=352329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:53:56.195456 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce730a0-386b-4ce3-8727-629da0e15561 None admin] Validating token access rules against request {{(pid=352328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:53:56.219340 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG dbcounter [-] [352328] Writing DB stats keystone:SELECT=100 {{(pid=352328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:53:56.225999 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG dbcounter [-] [352329] Writing DB stats keystone:SELECT=100 {{(pid=352329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:53:56.238686 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4323946-77f9-4cdb-bded-8e80605fe76d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:53:56.239694 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4323946-77f9-4cdb-bded-8e80605fe76d None admin] REQUEST_METHOD: `PUT` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:53:56.240215 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4323946-77f9-4cdb-bded-8e80605fe76d None admin] SCRIPT_NAME: `/identity` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:53:56.240757 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4323946-77f9-4cdb-bded-8e80605fe76d None admin] PATH_INFO: `/v3/projects/9cfa053c839a4fedacde7163d907e2a4/users/5ec07578e79545168574fc04cba0a319/roles/32da6d9f8d8f48e285530909f7633410` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:53:56.257289 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4323946-77f9-4cdb-bded-8e80605fe76d None admin] RBAC: Authorizing `identity:create_grant(project_id=9cfa053c839a4fedacde7163d907e2a4, user_id=5ec07578e79545168574fc04cba0a319, role_id=32da6d9f8d8f48e285530909f7633410)` {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:53:56.259085 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4323946-77f9-4cdb-bded-8e80605fe76d None admin] RBAC: Authorization granted {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:53:56.277145 dv-cinder-851351-1-smb devstack@keystone.service[352328]: [pid: 352328|app: 0|req: 308/609] 10.222.0.42 () {58 vars in 1439 bytes} [Thu Jul 28 08:53:56 2022] PUT /identity/v3/projects/9cfa053c839a4fedacde7163d907e2a4/users/5ec07578e79545168574fc04cba0a319/roles/32da6d9f8d8f48e285530909f7633410 => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 08:53:56.279302 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4323946-77f9-4cdb-bded-8e80605fe76d None admin] Authenticating user token {{(pid=352328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:53:56.339241 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37fe9474-907f-4931-9fca-da61a45a7279 None admin] Validating token access rules against request {{(pid=352329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:53:56.409579 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4323946-77f9-4cdb-bded-8e80605fe76d None admin] Validating token access rules against request {{(pid=352328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:53:56.422385 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4e1e8c-003a-43a7-ae7e-cf488d688ff0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:53:56.423138 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4e1e8c-003a-43a7-ae7e-cf488d688ff0 None admin] REQUEST_METHOD: `GET` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:53:56.423395 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4e1e8c-003a-43a7-ae7e-cf488d688ff0 None admin] SCRIPT_NAME: `/identity` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:53:56.423675 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4e1e8c-003a-43a7-ae7e-cf488d688ff0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:53:56.448374 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f4e1e8c-003a-43a7-ae7e-cf488d688ff0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:53:56.449897 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f4e1e8c-003a-43a7-ae7e-cf488d688ff0 None admin] RBAC: Authorization granted {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:53:56.453113 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881a413c-548e-4bf9-8ced-01b34eada308 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:53:56.454586 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881a413c-548e-4bf9-8ced-01b34eada308 None admin] REQUEST_METHOD: `GET` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:53:56.455095 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881a413c-548e-4bf9-8ced-01b34eada308 None admin] SCRIPT_NAME: `/identity` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:53:56.455625 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881a413c-548e-4bf9-8ced-01b34eada308 None admin] PATH_INFO: `/v3/projects` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:53:56.456709 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-881a413c-548e-4bf9-8ced-01b34eada308 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=352328) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:53:56.457283 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-881a413c-548e-4bf9-8ced-01b34eada308 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:53:56.459924 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-881a413c-548e-4bf9-8ced-01b34eada308 None admin] RBAC: Authorization granted {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:53:56.475806 dv-cinder-851351-1-smb devstack@keystone.service[352328]: [pid: 352328|app: 0|req: 309/610] 10.222.0.42 () {56 vars in 1148 bytes} [Thu Jul 28 08:53:56 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:53:56.481332 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application [None req-2f4e1e8c-003a-43a7-ae7e-cf488d688ff0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 08:53:56.481332 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:53:56.481332 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:53:56.481332 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:53:56.481332 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:53:56.481332 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:53:56.481332 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:53:56.481332 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:53:56.481332 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:53:56.481332 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:53:56.481332 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:53:56.481332 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:53:56.481332 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 08:53:56.481332 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 08:53:56.481332 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 08:53:56.482527 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 08:53:56.482527 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:53:56.482527 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:53:56.482527 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:53:56.482527 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:53:56.482527 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:53:56.482527 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:53:56.482527 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:53:56.482527 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application with Lock( Jul 28 08:53:56.482527 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:53:56.482527 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:53:56.482527 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:53:56.482527 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:53:56.482527 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:53:56.482527 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:53:56.482527 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:53:56.482527 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:53:56.483635 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 08:53:56.483635 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 08:53:56.483635 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 08:53:56.483635 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application Jul 28 08:53:56.484345 dv-cinder-851351-1-smb devstack@keystone.service[352329]: [pid: 352329|app: 0|req: 302/611] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 08:53:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 304 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:53:56.485742 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881a413c-548e-4bf9-8ced-01b34eada308 None admin] Authenticating user token {{(pid=352328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:53:56.488797 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4e1e8c-003a-43a7-ae7e-cf488d688ff0 None admin] Authenticating user token {{(pid=352329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:53:56.537182 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG dbcounter [-] [352328] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=352328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:53:56.625973 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881a413c-548e-4bf9-8ced-01b34eada308 None admin] Validating token access rules against request {{(pid=352328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:53:56.635517 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG dbcounter [-] [352329] Writing DB stats keystone:SELECT=100 {{(pid=352329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:53:56.658965 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4e1e8c-003a-43a7-ae7e-cf488d688ff0 None admin] Validating token access rules against request {{(pid=352329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:53:56.679071 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c4b276-3903-4a98-8699-3fdc30bc5b11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:53:56.680322 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c4b276-3903-4a98-8699-3fdc30bc5b11 None admin] REQUEST_METHOD: `PUT` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:53:56.680863 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c4b276-3903-4a98-8699-3fdc30bc5b11 None admin] SCRIPT_NAME: `/identity` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:53:56.681463 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c4b276-3903-4a98-8699-3fdc30bc5b11 None admin] PATH_INFO: `/v3/projects/9cfa053c839a4fedacde7163d907e2a4/users/129f505b6d004c8a949020bd2113e32d/roles/32da6d9f8d8f48e285530909f7633410` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:53:56.702011 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c4b276-3903-4a98-8699-3fdc30bc5b11 None admin] RBAC: Authorizing `identity:create_grant(project_id=9cfa053c839a4fedacde7163d907e2a4, user_id=129f505b6d004c8a949020bd2113e32d, role_id=32da6d9f8d8f48e285530909f7633410)` {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:53:56.704648 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394620f2-c9f7-46d4-a292-1312cb37a3ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:53:56.705266 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c4b276-3903-4a98-8699-3fdc30bc5b11 None admin] RBAC: Authorization granted {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:53:56.705419 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394620f2-c9f7-46d4-a292-1312cb37a3ff None admin] REQUEST_METHOD: `GET` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:53:56.705786 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394620f2-c9f7-46d4-a292-1312cb37a3ff None admin] SCRIPT_NAME: `/identity` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:53:56.706142 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394620f2-c9f7-46d4-a292-1312cb37a3ff None admin] PATH_INFO: `/v3/domains` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:53:56.706945 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-394620f2-c9f7-46d4-a292-1312cb37a3ff None admin] RBAC: Adding query filter params (name=Default) {{(pid=352329) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:53:56.707325 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-394620f2-c9f7-46d4-a292-1312cb37a3ff None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:53:56.709047 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-394620f2-c9f7-46d4-a292-1312cb37a3ff None admin] RBAC: Authorization granted {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:53:56.723576 dv-cinder-851351-1-smb devstack@keystone.service[352329]: [pid: 352329|app: 0|req: 303/612] 10.222.0.42 () {56 vars in 1109 bytes} [Thu Jul 28 08:53:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 08:53:56.724770 dv-cinder-851351-1-smb devstack@keystone.service[352328]: [pid: 352328|app: 0|req: 310/613] 10.222.0.42 () {58 vars in 1439 bytes} [Thu Jul 28 08:53:56 2022] PUT /identity/v3/projects/9cfa053c839a4fedacde7163d907e2a4/users/129f505b6d004c8a949020bd2113e32d/roles/32da6d9f8d8f48e285530909f7633410 => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 08:53:56.732426 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394620f2-c9f7-46d4-a292-1312cb37a3ff None admin] Authenticating user token {{(pid=352329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:53:56.860425 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394620f2-c9f7-46d4-a292-1312cb37a3ff None admin] Validating token access rules against request {{(pid=352329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:53:56.898492 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf2ecc25-8b55-41fb-aa30-a6c284358896 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:53:56.899178 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2ecc25-8b55-41fb-aa30-a6c284358896 None admin] REQUEST_METHOD: `GET` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:53:56.899462 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2ecc25-8b55-41fb-aa30-a6c284358896 None admin] SCRIPT_NAME: `/identity` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:53:56.899740 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2ecc25-8b55-41fb-aa30-a6c284358896 None admin] PATH_INFO: `/v3/users/swift` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:53:56.908732 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf2ecc25-8b55-41fb-aa30-a6c284358896 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:53:56.910263 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf2ecc25-8b55-41fb-aa30-a6c284358896 None admin] RBAC: Authorization granted {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:53:56.923320 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application [None req-bf2ecc25-8b55-41fb-aa30-a6c284358896 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 28 08:53:56.923320 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:53:56.923320 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:53:56.923320 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:53:56.923320 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:53:56.923320 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:53:56.923320 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:53:56.923320 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:53:56.923320 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:53:56.923320 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:53:56.923320 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:53:56.923320 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:53:56.923320 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 28 08:53:56.923320 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 28 08:53:56.923320 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 28 08:53:56.923320 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 28 08:53:56.924591 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:53:56.924591 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:53:56.924591 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 28 08:53:56.924591 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 08:53:56.924591 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 28 08:53:56.924591 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 08:53:56.924591 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:53:56.924591 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:53:56.924591 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:53:56.924591 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:53:56.924591 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:53:56.924591 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application with Lock( Jul 28 08:53:56.924591 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:53:56.924591 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:53:56.924591 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:53:56.924591 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:53:56.924591 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:53:56.924591 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:53:56.925823 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:53:56.925823 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:53:56.925823 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 28 08:53:56.925823 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 28 08:53:56.925823 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 28 08:53:56.925823 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 28 08:53:56.925823 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 28 08:53:56.925823 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 28 08:53:56.925823 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 28 08:53:56.925823 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application Jul 28 08:53:56.925823 dv-cinder-851351-1-smb devstack@keystone.service[352329]: [pid: 352329|app: 0|req: 304/614] 10.222.0.42 () {56 vars in 1096 bytes} [Thu Jul 28 08:53:56 2022] GET /identity/v3/users/swift => generated 83 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:53:56.930837 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c4b276-3903-4a98-8699-3fdc30bc5b11 None admin] Authenticating user token {{(pid=352328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:53:56.965171 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ef46b1-fb22-42c3-bce1-0cb51ba5fc26 None None] REQUEST_METHOD: `GET` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:53:56.965930 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ef46b1-fb22-42c3-bce1-0cb51ba5fc26 None None] SCRIPT_NAME: `/identity` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:53:56.966434 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ef46b1-fb22-42c3-bce1-0cb51ba5fc26 None None] PATH_INFO: `/` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:53:56.968565 dv-cinder-851351-1-smb devstack@keystone.service[352329]: [pid: 352329|app: 0|req: 305/615] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 08:53:56 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 08:53:56.975677 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74bfa11-8f68-4903-b084-3d2730e80693 None None] REQUEST_METHOD: `POST` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:53:56.976390 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74bfa11-8f68-4903-b084-3d2730e80693 None None] SCRIPT_NAME: `/identity` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:53:56.976970 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74bfa11-8f68-4903-b084-3d2730e80693 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:53:56.997114 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG dbcounter [-] [352329] Writing DB stats keystone:SELECT=100 {{(pid=352329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:53:57.012530 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.auth.core [None req-b74bfa11-8f68-4903-b084-3d2730e80693 None None] MFA Rules not processed for user `d18c063b2377412485965357671e5506`. Rule list: `[]` (Enabled: `True`). {{(pid=352329) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 08:53:57.013801 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.fernet_utils [None req-b74bfa11-8f68-4903-b084-3d2730e80693 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=352329) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:53:57.098398 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG dbcounter [-] [352328] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=352328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:53:57.129660 dv-cinder-851351-1-smb devstack@keystone.service[352329]: [pid: 352329|app: 0|req: 306/616] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 08:53:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 28 08:53:57.133241 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c4b276-3903-4a98-8699-3fdc30bc5b11 None admin] Validating token access rules against request {{(pid=352328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:53:57.163064 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74bfa11-8f68-4903-b084-3d2730e80693 None None] Authenticating user token {{(pid=352329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:53:57.179038 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c862a8-44f6-4c4d-b260-811b0d83130f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:53:57.179707 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c862a8-44f6-4c4d-b260-811b0d83130f None admin] REQUEST_METHOD: `GET` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:53:57.179999 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c862a8-44f6-4c4d-b260-811b0d83130f None admin] SCRIPT_NAME: `/identity` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:53:57.180359 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c862a8-44f6-4c4d-b260-811b0d83130f None admin] PATH_INFO: `/v3/users` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:53:57.181306 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9c862a8-44f6-4c4d-b260-811b0d83130f None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=352328) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:53:57.181559 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9c862a8-44f6-4c4d-b260-811b0d83130f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:53:57.183886 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9c862a8-44f6-4c4d-b260-811b0d83130f None admin] RBAC: Authorization granted {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:53:57.208715 dv-cinder-851351-1-smb devstack@keystone.service[352328]: [pid: 352328|app: 0|req: 311/617] 10.222.0.42 () {56 vars in 1135 bytes} [Thu Jul 28 08:53:56 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:53:57.214368 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c862a8-44f6-4c4d-b260-811b0d83130f None admin] Authenticating user token {{(pid=352328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:53:57.334936 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74bfa11-8f68-4903-b084-3d2730e80693 None None] Validating token access rules against request {{(pid=352329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:53:57.358461 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c862a8-44f6-4c4d-b260-811b0d83130f None admin] Validating token access rules against request {{(pid=352328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:53:57.394286 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e107efb8-7f92-4856-a793-6cc4877539f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:53:57.394957 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e107efb8-7f92-4856-a793-6cc4877539f1 None admin] REQUEST_METHOD: `GET` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:53:57.395221 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e107efb8-7f92-4856-a793-6cc4877539f1 None admin] SCRIPT_NAME: `/identity` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:53:57.395497 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e107efb8-7f92-4856-a793-6cc4877539f1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:53:57.404528 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33fe94c-f2d9-41fd-b891-61c67061304e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:53:57.405228 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33fe94c-f2d9-41fd-b891-61c67061304e None admin] REQUEST_METHOD: `GET` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:53:57.405514 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33fe94c-f2d9-41fd-b891-61c67061304e None admin] SCRIPT_NAME: `/identity` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:53:57.405792 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33fe94c-f2d9-41fd-b891-61c67061304e None admin] PATH_INFO: `/v3/roles/service` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:53:57.406315 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e107efb8-7f92-4856-a793-6cc4877539f1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:53:57.407965 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e107efb8-7f92-4856-a793-6cc4877539f1 None admin] RBAC: Authorization granted {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:53:57.408884 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG dbcounter [-] [352329] Writing DB stats keystone:SELECT=100 {{(pid=352329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:53:57.427242 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application [None req-e107efb8-7f92-4856-a793-6cc4877539f1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 08:53:57.427242 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:53:57.427242 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:53:57.427242 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:53:57.427242 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:53:57.427242 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:53:57.427242 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:53:57.427242 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:53:57.427242 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:53:57.427242 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:53:57.427242 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:53:57.427242 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:53:57.427242 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 08:53:57.427242 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 08:53:57.427242 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 08:53:57.428911 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 08:53:57.428911 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:53:57.428911 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:53:57.428911 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:53:57.428911 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:53:57.428911 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:53:57.428911 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:53:57.428911 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:53:57.428911 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application with Lock( Jul 28 08:53:57.428911 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:53:57.428911 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:53:57.428911 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:53:57.428911 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:53:57.428911 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:53:57.428911 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:53:57.428911 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:53:57.428911 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:53:57.430144 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 08:53:57.430144 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 08:53:57.430144 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 08:53:57.430144 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application Jul 28 08:53:57.430144 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG dbcounter [-] [352328] Writing DB stats keystone:SELECT=100 {{(pid=352328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:53:57.430526 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f33fe94c-f2d9-41fd-b891-61c67061304e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 08:53:57.434014 dv-cinder-851351-1-smb devstack@keystone.service[352328]: [pid: 352328|app: 0|req: 312/618] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 08:53:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:53:57.434820 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e107efb8-7f92-4856-a793-6cc4877539f1 None admin] Authenticating user token {{(pid=352328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:53:57.436226 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application [None req-f33fe94c-f2d9-41fd-b891-61c67061304e None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 28 08:53:57.436226 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:53:57.436226 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:53:57.436226 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:53:57.436226 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:53:57.436226 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:53:57.436226 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:53:57.436226 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:53:57.436226 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:53:57.436226 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:53:57.436226 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:53:57.436226 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:53:57.436226 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 08:53:57.436226 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 08:53:57.436226 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 08:53:57.436226 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 08:53:57.439051 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 08:53:57.439051 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 08:53:57.439051 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 08:53:57.439051 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 08:53:57.439051 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:53:57.439051 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:53:57.439051 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:53:57.439051 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:53:57.439051 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:53:57.439051 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:53:57.439051 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:53:57.439051 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application with Lock( Jul 28 08:53:57.439051 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:53:57.439051 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:53:57.439051 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:53:57.439051 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:53:57.441387 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:53:57.441387 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:53:57.441387 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:53:57.441387 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:53:57.441387 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 08:53:57.441387 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 08:53:57.441387 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 08:53:57.441387 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 08:53:57.441387 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 08:53:57.441387 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 08:53:57.441387 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 28 08:53:57.441387 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application Jul 28 08:53:57.443236 dv-cinder-851351-1-smb devstack@keystone.service[352329]: [pid: 352329|app: 0|req: 307/619] 10.222.0.42 () {56 vars in 1102 bytes} [Thu Jul 28 08:53:57 2022] GET /identity/v3/roles/service => generated 85 bytes in 276 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 08:53:57.449270 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33fe94c-f2d9-41fd-b891-61c67061304e None admin] Authenticating user token {{(pid=352329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:53:57.568524 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e107efb8-7f92-4856-a793-6cc4877539f1 None admin] Validating token access rules against request {{(pid=352328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:53:57.591557 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33fe94c-f2d9-41fd-b891-61c67061304e None admin] Validating token access rules against request {{(pid=352329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:53:57.629275 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb025c4-58a0-45e3-840c-acad26cb4cac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:53:57.629954 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb025c4-58a0-45e3-840c-acad26cb4cac None admin] REQUEST_METHOD: `GET` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:53:57.630238 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb025c4-58a0-45e3-840c-acad26cb4cac None admin] SCRIPT_NAME: `/identity` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:53:57.630516 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb025c4-58a0-45e3-840c-acad26cb4cac None admin] PATH_INFO: `/v3/roles` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:53:57.631255 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cb025c4-58a0-45e3-840c-acad26cb4cac None admin] RBAC: Adding query filter params (name=service) {{(pid=352329) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:53:57.631565 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cb025c4-58a0-45e3-840c-acad26cb4cac None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:53:57.633047 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cb025c4-58a0-45e3-840c-acad26cb4cac None admin] RBAC: Authorization granted {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:53:57.642551 dv-cinder-851351-1-smb devstack@keystone.service[352329]: [pid: 352329|app: 0|req: 308/620] 10.222.0.42 () {56 vars in 1103 bytes} [Thu Jul 28 08:53:57 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 08:53:57.648453 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb025c4-58a0-45e3-840c-acad26cb4cac None admin] Authenticating user token {{(pid=352329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:53:57.663379 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd57441-dbee-4c5e-8f93-dd6c255be964 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:53:57.664030 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd57441-dbee-4c5e-8f93-dd6c255be964 None admin] REQUEST_METHOD: `GET` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:53:57.664313 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd57441-dbee-4c5e-8f93-dd6c255be964 None admin] SCRIPT_NAME: `/identity` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:53:57.664589 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd57441-dbee-4c5e-8f93-dd6c255be964 None admin] PATH_INFO: `/v3/domains` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:53:57.665335 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fd57441-dbee-4c5e-8f93-dd6c255be964 None admin] RBAC: Adding query filter params (name=Default) {{(pid=352328) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:53:57.665645 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fd57441-dbee-4c5e-8f93-dd6c255be964 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:53:57.667041 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fd57441-dbee-4c5e-8f93-dd6c255be964 None admin] RBAC: Authorization granted {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:53:57.685725 dv-cinder-851351-1-smb devstack@keystone.service[352328]: [pid: 352328|app: 0|req: 313/621] 10.222.0.42 () {56 vars in 1109 bytes} [Thu Jul 28 08:53:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:53:57.691027 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd57441-dbee-4c5e-8f93-dd6c255be964 None admin] Authenticating user token {{(pid=352328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:53:57.757089 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG dbcounter [-] [352328] Writing DB stats keystone:SELECT=100 {{(pid=352328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:53:57.774322 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG dbcounter [-] [352329] Writing DB stats keystone:SELECT=100 {{(pid=352329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:53:57.798769 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd57441-dbee-4c5e-8f93-dd6c255be964 None admin] Validating token access rules against request {{(pid=352328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:53:57.837596 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4ec5a9-881a-4aeb-83cc-c0e878382e97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:53:57.838259 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4ec5a9-881a-4aeb-83cc-c0e878382e97 None admin] REQUEST_METHOD: `GET` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:53:57.838542 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4ec5a9-881a-4aeb-83cc-c0e878382e97 None admin] SCRIPT_NAME: `/identity` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:53:57.838749 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb025c4-58a0-45e3-840c-acad26cb4cac None admin] Validating token access rules against request {{(pid=352329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:53:57.838931 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4ec5a9-881a-4aeb-83cc-c0e878382e97 None admin] PATH_INFO: `/v3/projects/service` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:53:57.846410 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f4ec5a9-881a-4aeb-83cc-c0e878382e97 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:53:57.847892 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f4ec5a9-881a-4aeb-83cc-c0e878382e97 None admin] RBAC: Authorization granted {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:53:57.860760 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application [None req-6f4ec5a9-881a-4aeb-83cc-c0e878382e97 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 08:53:57.860760 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:53:57.860760 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:53:57.860760 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:53:57.860760 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:53:57.860760 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:53:57.860760 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:53:57.860760 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:53:57.860760 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:53:57.860760 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:53:57.860760 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:53:57.860760 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:53:57.860760 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 28 08:53:57.860760 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 28 08:53:57.860760 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 28 08:53:57.863117 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 28 08:53:57.863117 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:53:57.863117 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:53:57.863117 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:53:57.863117 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:53:57.863117 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:53:57.863117 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:53:57.863117 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:53:57.863117 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application with Lock( Jul 28 08:53:57.863117 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:53:57.863117 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:53:57.863117 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:53:57.863117 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:53:57.863117 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:53:57.863117 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:53:57.863117 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:53:57.863117 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:53:57.865347 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 28 08:53:57.865347 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 28 08:53:57.865347 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 28 08:53:57.865347 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 28 08:53:57.865347 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 28 08:53:57.865347 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 28 08:53:57.865347 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 08:53:57.865347 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application Jul 28 08:53:57.865347 dv-cinder-851351-1-smb devstack@keystone.service[352328]: [pid: 352328|app: 0|req: 314/622] 10.222.0.42 () {56 vars in 1111 bytes} [Thu Jul 28 08:53:57 2022] GET /identity/v3/projects/service => generated 88 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 08:53:57.870970 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4ec5a9-881a-4aeb-83cc-c0e878382e97 None admin] Authenticating user token {{(pid=352328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:53:57.874430 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f15e58-9b3f-45d3-97ac-9663c284e855 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:53:57.875123 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f15e58-9b3f-45d3-97ac-9663c284e855 None admin] REQUEST_METHOD: `GET` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:53:57.875406 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f15e58-9b3f-45d3-97ac-9663c284e855 None admin] SCRIPT_NAME: `/identity` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:53:57.875706 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f15e58-9b3f-45d3-97ac-9663c284e855 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:53:57.887635 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f15e58-9b3f-45d3-97ac-9663c284e855 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:53:57.889182 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f15e58-9b3f-45d3-97ac-9663c284e855 None admin] RBAC: Authorization granted {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:53:57.904811 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application [None req-94f15e58-9b3f-45d3-97ac-9663c284e855 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 08:53:57.904811 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:53:57.904811 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:53:57.904811 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:53:57.904811 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:53:57.904811 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:53:57.904811 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:53:57.904811 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:53:57.904811 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:53:57.904811 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:53:57.904811 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:53:57.904811 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:53:57.904811 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 08:53:57.904811 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 08:53:57.904811 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 08:53:57.907047 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 08:53:57.907047 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:53:57.907047 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:53:57.907047 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:53:57.907047 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:53:57.907047 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:53:57.907047 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:53:57.907047 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:53:57.907047 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application with Lock( Jul 28 08:53:57.907047 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:53:57.907047 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:53:57.907047 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:53:57.907047 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:53:57.907047 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:53:57.907047 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:53:57.907047 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:53:57.907047 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:53:57.909160 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 08:53:57.909160 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 08:53:57.909160 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 08:53:57.909160 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application Jul 28 08:53:57.916697 dv-cinder-851351-1-smb devstack@keystone.service[352329]: [pid: 352329|app: 0|req: 309/623] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 08:53:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 258 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:53:57.916697 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f15e58-9b3f-45d3-97ac-9663c284e855 None admin] Authenticating user token {{(pid=352329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:53:57.989787 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4ec5a9-881a-4aeb-83cc-c0e878382e97 None admin] Validating token access rules against request {{(pid=352328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:53:58.003709 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG dbcounter [-] [352328] Writing DB stats keystone:SELECT=100 {{(pid=352328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:53:58.039081 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e654a59-d7d0-4c67-8ddd-c8af8f03b506 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:53:58.040252 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e654a59-d7d0-4c67-8ddd-c8af8f03b506 None admin] REQUEST_METHOD: `GET` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:53:58.040890 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e654a59-d7d0-4c67-8ddd-c8af8f03b506 None admin] SCRIPT_NAME: `/identity` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:53:58.041240 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e654a59-d7d0-4c67-8ddd-c8af8f03b506 None admin] PATH_INFO: `/v3/projects` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:53:58.042381 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e654a59-d7d0-4c67-8ddd-c8af8f03b506 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=352328) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:53:58.043224 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e654a59-d7d0-4c67-8ddd-c8af8f03b506 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:53:58.045112 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e654a59-d7d0-4c67-8ddd-c8af8f03b506 None admin] RBAC: Authorization granted {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:53:58.062592 dv-cinder-851351-1-smb devstack@keystone.service[352328]: [pid: 352328|app: 0|req: 315/624] 10.222.0.42 () {56 vars in 1148 bytes} [Thu Jul 28 08:53:57 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:53:58.064069 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a990128f-2c80-4f26-a25a-ba4902565065 None None] REQUEST_METHOD: `GET` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:53:58.064487 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a990128f-2c80-4f26-a25a-ba4902565065 None None] SCRIPT_NAME: `/identity` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:53:58.064871 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a990128f-2c80-4f26-a25a-ba4902565065 None None] PATH_INFO: `/` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:53:58.066592 dv-cinder-851351-1-smb devstack@keystone.service[352328]: [pid: 352328|app: 0|req: 316/625] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 08:53:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 08:53:58.073904 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a990128f-2c80-4f26-a25a-ba4902565065 None None] Authenticating user token {{(pid=352328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:53:58.108333 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f15e58-9b3f-45d3-97ac-9663c284e855 None admin] Validating token access rules against request {{(pid=352329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:53:58.120768 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG dbcounter [-] [352329] Writing DB stats keystone:SELECT=100 {{(pid=352329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:53:58.148167 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b3c95a9-3ff6-4c4c-917a-2805acf66e6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:53:58.149370 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3c95a9-3ff6-4c4c-917a-2805acf66e6c None admin] REQUEST_METHOD: `GET` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:53:58.149900 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3c95a9-3ff6-4c4c-917a-2805acf66e6c None admin] SCRIPT_NAME: `/identity` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:53:58.150445 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3c95a9-3ff6-4c4c-917a-2805acf66e6c None admin] PATH_INFO: `/v3/domains` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:53:58.151523 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b3c95a9-3ff6-4c4c-917a-2805acf66e6c None admin] RBAC: Adding query filter params (name=Default) {{(pid=352329) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:53:58.152104 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b3c95a9-3ff6-4c4c-917a-2805acf66e6c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:53:58.153865 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b3c95a9-3ff6-4c4c-917a-2805acf66e6c None admin] RBAC: Authorization granted {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:53:58.167996 dv-cinder-851351-1-smb devstack@keystone.service[352329]: [pid: 352329|app: 0|req: 310/626] 10.222.0.42 () {56 vars in 1109 bytes} [Thu Jul 28 08:53:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 08:53:58.169728 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f8ee78-aa17-4e76-9136-3e7b004242fd None None] REQUEST_METHOD: `POST` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:53:58.170253 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f8ee78-aa17-4e76-9136-3e7b004242fd None None] SCRIPT_NAME: `/identity` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:53:58.170802 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f8ee78-aa17-4e76-9136-3e7b004242fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:53:58.183896 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a990128f-2c80-4f26-a25a-ba4902565065 None None] Validating token access rules against request {{(pid=352328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:53:58.191258 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.auth.core [None req-22f8ee78-aa17-4e76-9136-3e7b004242fd None None] MFA Rules not processed for user `d18c063b2377412485965357671e5506`. Rule list: `[]` (Enabled: `True`). {{(pid=352329) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 08:53:58.192928 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.fernet_utils [None req-22f8ee78-aa17-4e76-9136-3e7b004242fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=352329) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:53:58.219480 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8a419a-a776-449a-875a-bdf9298ff2f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:53:58.220486 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8a419a-a776-449a-875a-bdf9298ff2f0 None admin] REQUEST_METHOD: `PUT` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:53:58.220876 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8a419a-a776-449a-875a-bdf9298ff2f0 None admin] SCRIPT_NAME: `/identity` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:53:58.221156 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8a419a-a776-449a-875a-bdf9298ff2f0 None admin] PATH_INFO: `/v3/projects/9cfa053c839a4fedacde7163d907e2a4/users/456c30f8918e4aef8a8e2d65f1f0faf7/roles/32da6d9f8d8f48e285530909f7633410` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:53:58.242397 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba8a419a-a776-449a-875a-bdf9298ff2f0 None admin] RBAC: Authorizing `identity:create_grant(project_id=9cfa053c839a4fedacde7163d907e2a4, user_id=456c30f8918e4aef8a8e2d65f1f0faf7, role_id=32da6d9f8d8f48e285530909f7633410)` {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:53:58.244304 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba8a419a-a776-449a-875a-bdf9298ff2f0 None admin] RBAC: Authorization granted {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:53:58.268772 dv-cinder-851351-1-smb devstack@keystone.service[352328]: [pid: 352328|app: 0|req: 317/627] 10.222.0.42 () {58 vars in 1439 bytes} [Thu Jul 28 08:53:58 2022] PUT /identity/v3/projects/9cfa053c839a4fedacde7163d907e2a4/users/456c30f8918e4aef8a8e2d65f1f0faf7/roles/32da6d9f8d8f48e285530909f7633410 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 08:53:58.270512 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8a419a-a776-449a-875a-bdf9298ff2f0 None admin] Authenticating user token {{(pid=352328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:53:58.285480 dv-cinder-851351-1-smb devstack@keystone.service[352329]: [pid: 352329|app: 0|req: 311/628] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 08:53:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 08:53:58.304603 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG dbcounter [-] [352328] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=352328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:53:58.343412 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f8ee78-aa17-4e76-9136-3e7b004242fd None None] Authenticating user token {{(pid=352329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:53:58.444731 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8a419a-a776-449a-875a-bdf9298ff2f0 None admin] Validating token access rules against request {{(pid=352328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:53:58.522954 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1753de45-5b27-4237-a5b2-633bcfc20ae6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:53:58.524054 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1753de45-5b27-4237-a5b2-633bcfc20ae6 None admin] REQUEST_METHOD: `GET` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:53:58.524555 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1753de45-5b27-4237-a5b2-633bcfc20ae6 None admin] SCRIPT_NAME: `/identity` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:53:58.525102 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1753de45-5b27-4237-a5b2-633bcfc20ae6 None admin] PATH_INFO: `/v3/users/nova` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:53:58.538178 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1753de45-5b27-4237-a5b2-633bcfc20ae6 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:53:58.539276 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1753de45-5b27-4237-a5b2-633bcfc20ae6 None admin] RBAC: Authorization granted {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:53:58.547355 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG dbcounter [-] [352329] Writing DB stats keystone:SELECT=100 {{(pid=352329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:53:58.551839 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f8ee78-aa17-4e76-9136-3e7b004242fd None None] Validating token access rules against request {{(pid=352329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:53:58.553741 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application [None req-1753de45-5b27-4237-a5b2-633bcfc20ae6 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 28 08:53:58.553741 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:53:58.553741 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:53:58.553741 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:53:58.553741 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:53:58.553741 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:53:58.553741 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:53:58.553741 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:53:58.553741 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:53:58.553741 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:53:58.553741 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:53:58.553741 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:53:58.553741 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 28 08:53:58.553741 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 28 08:53:58.553741 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 28 08:53:58.553741 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 28 08:53:58.556424 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:53:58.556424 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:53:58.556424 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 28 08:53:58.556424 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 08:53:58.556424 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 28 08:53:58.556424 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 08:53:58.556424 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:53:58.556424 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:53:58.556424 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:53:58.556424 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:53:58.556424 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:53:58.556424 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application with Lock( Jul 28 08:53:58.556424 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:53:58.556424 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:53:58.556424 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:53:58.556424 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:53:58.556424 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:53:58.556424 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:53:58.558702 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:53:58.558702 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:53:58.558702 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 28 08:53:58.558702 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 28 08:53:58.558702 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 28 08:53:58.558702 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 28 08:53:58.558702 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 28 08:53:58.558702 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 28 08:53:58.558702 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 28 08:53:58.558702 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application Jul 28 08:53:58.558702 dv-cinder-851351-1-smb devstack@keystone.service[352328]: [pid: 352328|app: 0|req: 318/629] 10.222.0.42 () {56 vars in 1093 bytes} [Thu Jul 28 08:53:58 2022] GET /identity/v3/users/nova => generated 82 bytes in 285 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:53:58.564703 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1753de45-5b27-4237-a5b2-633bcfc20ae6 None admin] Authenticating user token {{(pid=352328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:53:58.595010 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a961f76-53c1-498a-86af-5ce662684e23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:53:58.595684 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a961f76-53c1-498a-86af-5ce662684e23 None admin] REQUEST_METHOD: `GET` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:53:58.595994 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a961f76-53c1-498a-86af-5ce662684e23 None admin] SCRIPT_NAME: `/identity` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:53:58.596264 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a961f76-53c1-498a-86af-5ce662684e23 None admin] PATH_INFO: `/v3/roles/service` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:53:58.608400 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a961f76-53c1-498a-86af-5ce662684e23 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 08:53:58.613723 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application [None req-4a961f76-53c1-498a-86af-5ce662684e23 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 28 08:53:58.613723 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:53:58.613723 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:53:58.613723 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:53:58.613723 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:53:58.613723 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:53:58.613723 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:53:58.613723 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:53:58.613723 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:53:58.613723 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:53:58.613723 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:53:58.613723 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:53:58.613723 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 08:53:58.613723 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 08:53:58.613723 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 08:53:58.613723 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 08:53:58.614969 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 08:53:58.614969 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 08:53:58.614969 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 08:53:58.614969 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 08:53:58.614969 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:53:58.614969 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:53:58.614969 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:53:58.614969 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:53:58.614969 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:53:58.614969 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:53:58.614969 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:53:58.614969 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application with Lock( Jul 28 08:53:58.614969 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:53:58.614969 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:53:58.614969 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:53:58.614969 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:53:58.616057 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:53:58.616057 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:53:58.616057 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:53:58.616057 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:53:58.616057 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 08:53:58.616057 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 08:53:58.616057 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 08:53:58.616057 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 08:53:58.616057 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 08:53:58.616057 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 08:53:58.616057 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 28 08:53:58.616057 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application Jul 28 08:53:58.616908 dv-cinder-851351-1-smb devstack@keystone.service[352329]: [pid: 352329|app: 0|req: 312/630] 10.222.0.42 () {56 vars in 1102 bytes} [Thu Jul 28 08:53:58 2022] GET /identity/v3/roles/service => generated 85 bytes in 273 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:53:58.623443 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a961f76-53c1-498a-86af-5ce662684e23 None admin] Authenticating user token {{(pid=352329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:53:58.681320 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG dbcounter [-] [352328] Writing DB stats keystone:SELECT=100 {{(pid=352328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:53:58.724258 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1753de45-5b27-4237-a5b2-633bcfc20ae6 None admin] Validating token access rules against request {{(pid=352328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:53:58.740704 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a961f76-53c1-498a-86af-5ce662684e23 None admin] Validating token access rules against request {{(pid=352329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:53:58.780812 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1553600-e4a5-44a6-8cc9-0ca9141a50cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:53:58.781367 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1553600-e4a5-44a6-8cc9-0ca9141a50cb None admin] REQUEST_METHOD: `GET` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:53:58.781655 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1553600-e4a5-44a6-8cc9-0ca9141a50cb None admin] SCRIPT_NAME: `/identity` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:53:58.781969 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1553600-e4a5-44a6-8cc9-0ca9141a50cb None admin] PATH_INFO: `/v3/roles` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:53:58.782803 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1553600-e4a5-44a6-8cc9-0ca9141a50cb None admin] RBAC: Adding query filter params (name=service) {{(pid=352329) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:53:58.783641 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1553600-e4a5-44a6-8cc9-0ca9141a50cb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:53:58.785386 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1553600-e4a5-44a6-8cc9-0ca9141a50cb None admin] RBAC: Authorization granted {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:53:58.795758 dv-cinder-851351-1-smb devstack@keystone.service[352329]: [pid: 352329|app: 0|req: 313/631] 10.222.0.42 () {56 vars in 1103 bytes} [Thu Jul 28 08:53:58 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:53:58.798357 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc84ebf5-8c9f-4bad-aba0-2b3e146127f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:53:58.799286 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc84ebf5-8c9f-4bad-aba0-2b3e146127f2 None admin] REQUEST_METHOD: `GET` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:53:58.799807 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc84ebf5-8c9f-4bad-aba0-2b3e146127f2 None admin] SCRIPT_NAME: `/identity` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:53:58.800302 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc84ebf5-8c9f-4bad-aba0-2b3e146127f2 None admin] PATH_INFO: `/v3/users` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:53:58.801429 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc84ebf5-8c9f-4bad-aba0-2b3e146127f2 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=352328) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:53:58.801585 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1553600-e4a5-44a6-8cc9-0ca9141a50cb None admin] Authenticating user token {{(pid=352329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:53:58.802116 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc84ebf5-8c9f-4bad-aba0-2b3e146127f2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:53:58.803913 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc84ebf5-8c9f-4bad-aba0-2b3e146127f2 None admin] RBAC: Authorization granted {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:53:58.830021 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG dbcounter [-] [352329] Writing DB stats keystone:SELECT=100 {{(pid=352329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:53:58.847385 dv-cinder-851351-1-smb devstack@keystone.service[352328]: [pid: 352328|app: 0|req: 319/632] 10.222.0.42 () {56 vars in 1133 bytes} [Thu Jul 28 08:53:58 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 287 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:53:58.852985 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc84ebf5-8c9f-4bad-aba0-2b3e146127f2 None admin] Authenticating user token {{(pid=352328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:53:58.930224 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1553600-e4a5-44a6-8cc9-0ca9141a50cb None admin] Validating token access rules against request {{(pid=352329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:53:58.987892 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f96f771-50c7-4c84-bc13-ecabfc31f5d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:53:58.988643 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f96f771-50c7-4c84-bc13-ecabfc31f5d8 None admin] REQUEST_METHOD: `GET` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:53:58.988912 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f96f771-50c7-4c84-bc13-ecabfc31f5d8 None admin] SCRIPT_NAME: `/identity` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:53:58.989193 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f96f771-50c7-4c84-bc13-ecabfc31f5d8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:53:59.001995 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f96f771-50c7-4c84-bc13-ecabfc31f5d8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:53:59.003500 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f96f771-50c7-4c84-bc13-ecabfc31f5d8 None admin] RBAC: Authorization granted {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:53:59.025042 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application [None req-5f96f771-50c7-4c84-bc13-ecabfc31f5d8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 08:53:59.025042 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:53:59.025042 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:53:59.025042 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:53:59.025042 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:53:59.025042 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:53:59.025042 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:53:59.025042 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:53:59.025042 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:53:59.025042 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:53:59.025042 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:53:59.025042 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:53:59.025042 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 08:53:59.025042 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 08:53:59.025042 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 08:53:59.026161 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 08:53:59.026161 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:53:59.026161 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:53:59.026161 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:53:59.026161 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:53:59.026161 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:53:59.026161 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:53:59.026161 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:53:59.026161 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application with Lock( Jul 28 08:53:59.026161 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:53:59.026161 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:53:59.026161 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:53:59.026161 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:53:59.026161 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:53:59.026161 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:53:59.026161 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:53:59.026161 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:53:59.027288 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 08:53:59.027288 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 08:53:59.027288 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 08:53:59.027288 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application Jul 28 08:53:59.027288 dv-cinder-851351-1-smb devstack@keystone.service[352329]: [pid: 352329|app: 0|req: 314/633] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 08:53:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 08:53:59.028075 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df46b27-fcbd-47d4-994c-8c960d3202ba None None] REQUEST_METHOD: `GET` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:53:59.028194 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df46b27-fcbd-47d4-994c-8c960d3202ba None None] SCRIPT_NAME: `/identity` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:53:59.028476 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df46b27-fcbd-47d4-994c-8c960d3202ba None None] PATH_INFO: `/` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:53:59.032822 dv-cinder-851351-1-smb devstack@keystone.service[352329]: [pid: 352329|app: 0|req: 315/634] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 08:53:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 08:53:59.034047 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df46b27-fcbd-47d4-994c-8c960d3202ba None None] Authenticating user token {{(pid=352329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:53:59.053872 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc84ebf5-8c9f-4bad-aba0-2b3e146127f2 None admin] Validating token access rules against request {{(pid=352328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:53:59.102436 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d3c10b-e8a4-443a-aa32-de4d30921dde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:53:59.103107 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d3c10b-e8a4-443a-aa32-de4d30921dde None admin] REQUEST_METHOD: `GET` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:53:59.103391 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d3c10b-e8a4-443a-aa32-de4d30921dde None admin] SCRIPT_NAME: `/identity` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:53:59.103664 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d3c10b-e8a4-443a-aa32-de4d30921dde None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:53:59.113164 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG dbcounter [-] [352328] Writing DB stats keystone:SELECT=100 {{(pid=352328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:53:59.148293 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG dbcounter [-] [352329] Writing DB stats keystone:SELECT=100 {{(pid=352329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:53:59.182818 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df46b27-fcbd-47d4-994c-8c960d3202ba None None] Validating token access rules against request {{(pid=352329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:53:59.189175 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92d3c10b-e8a4-443a-aa32-de4d30921dde None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:53:59.190781 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92d3c10b-e8a4-443a-aa32-de4d30921dde None admin] RBAC: Authorization granted {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:53:59.221248 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2858a522-ebbb-4a83-b07a-b0df84598f68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:53:59.222259 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2858a522-ebbb-4a83-b07a-b0df84598f68 None admin] REQUEST_METHOD: `GET` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:53:59.222755 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2858a522-ebbb-4a83-b07a-b0df84598f68 None admin] SCRIPT_NAME: `/identity` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:53:59.223206 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2858a522-ebbb-4a83-b07a-b0df84598f68 None admin] PATH_INFO: `/v3/domains` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:53:59.224138 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2858a522-ebbb-4a83-b07a-b0df84598f68 None admin] RBAC: Adding query filter params (name=Default) {{(pid=352329) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:53:59.224653 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2858a522-ebbb-4a83-b07a-b0df84598f68 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:53:59.226444 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2858a522-ebbb-4a83-b07a-b0df84598f68 None admin] RBAC: Authorization granted {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:53:59.244598 dv-cinder-851351-1-smb devstack@keystone.service[352329]: [pid: 352329|app: 0|req: 316/635] 10.222.0.42 () {56 vars in 1109 bytes} [Thu Jul 28 08:53:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:53:59.246443 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854488c7-6d26-468d-ae72-e6a5e4ecf808 None None] REQUEST_METHOD: `POST` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:53:59.246937 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854488c7-6d26-468d-ae72-e6a5e4ecf808 None None] SCRIPT_NAME: `/identity` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:53:59.247488 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854488c7-6d26-468d-ae72-e6a5e4ecf808 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:53:59.267424 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.auth.core [None req-854488c7-6d26-468d-ae72-e6a5e4ecf808 None None] MFA Rules not processed for user `d18c063b2377412485965357671e5506`. Rule list: `[]` (Enabled: `True`). {{(pid=352329) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 08:53:59.269093 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.fernet_utils [None req-854488c7-6d26-468d-ae72-e6a5e4ecf808 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=352329) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:53:59.316135 dv-cinder-851351-1-smb devstack@keystone.service[352328]: [pid: 352328|app: 0|req: 320/636] 10.222.0.42 () {58 vars in 1282 bytes} [Thu Jul 28 08:53:58 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 463 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 28 08:53:59.316987 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d3c10b-e8a4-443a-aa32-de4d30921dde None admin] Authenticating user token {{(pid=352328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:53:59.349832 dv-cinder-851351-1-smb devstack@keystone.service[352329]: [pid: 352329|app: 0|req: 317/637] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 08:53:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 08:53:59.350708 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854488c7-6d26-468d-ae72-e6a5e4ecf808 None None] Authenticating user token {{(pid=352329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:53:59.363156 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG dbcounter [-] [352328] Writing DB stats keystone:SELECT=100 {{(pid=352328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:53:59.419568 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG dbcounter [-] [352329] Writing DB stats keystone:SELECT=100 {{(pid=352329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:53:59.427953 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d3c10b-e8a4-443a-aa32-de4d30921dde None admin] Validating token access rules against request {{(pid=352328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:53:59.460987 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854488c7-6d26-468d-ae72-e6a5e4ecf808 None None] Validating token access rules against request {{(pid=352329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:53:59.466870 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e71b7f-edda-4258-877f-ab1e1db04ca9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:53:59.467536 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e71b7f-edda-4258-877f-ab1e1db04ca9 None admin] REQUEST_METHOD: `GET` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:53:59.467822 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e71b7f-edda-4258-877f-ab1e1db04ca9 None admin] SCRIPT_NAME: `/identity` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:53:59.468100 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e71b7f-edda-4258-877f-ab1e1db04ca9 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:53:59.476577 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33e71b7f-edda-4258-877f-ab1e1db04ca9 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:53:59.478155 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33e71b7f-edda-4258-877f-ab1e1db04ca9 None admin] RBAC: Authorization granted {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:53:59.490131 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application [None req-33e71b7f-edda-4258-877f-ab1e1db04ca9 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jul 28 08:53:59.490131 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:53:59.490131 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:53:59.490131 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:53:59.490131 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:53:59.490131 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:53:59.490131 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:53:59.490131 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:53:59.490131 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:53:59.490131 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:53:59.490131 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:53:59.490131 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:53:59.490131 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 28 08:53:59.490131 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 28 08:53:59.490131 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 28 08:53:59.490131 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 28 08:53:59.491426 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:53:59.491426 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:53:59.491426 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 28 08:53:59.491426 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 08:53:59.491426 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 28 08:53:59.491426 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 08:53:59.491426 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:53:59.491426 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:53:59.491426 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:53:59.491426 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:53:59.491426 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:53:59.491426 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application with Lock( Jul 28 08:53:59.491426 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:53:59.491426 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:53:59.491426 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:53:59.491426 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:53:59.491426 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:53:59.491426 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:53:59.493474 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:53:59.493474 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:53:59.493474 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 28 08:53:59.493474 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 28 08:53:59.493474 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 28 08:53:59.493474 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 28 08:53:59.493474 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 28 08:53:59.493474 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 28 08:53:59.493474 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jul 28 08:53:59.493474 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application Jul 28 08:53:59.493474 dv-cinder-851351-1-smb devstack@keystone.service[352328]: [pid: 352328|app: 0|req: 321/638] 10.222.0.42 () {56 vars in 1099 bytes} [Thu Jul 28 08:53:59 2022] GET /identity/v3/users/cinder => generated 84 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:53:59.493474 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48400d97-ac06-48e5-be76-fdd9277cea1c None None] REQUEST_METHOD: `GET` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:53:59.493474 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48400d97-ac06-48e5-be76-fdd9277cea1c None None] SCRIPT_NAME: `/identity` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:53:59.494420 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48400d97-ac06-48e5-be76-fdd9277cea1c None None] PATH_INFO: `/` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:53:59.499637 dv-cinder-851351-1-smb devstack@keystone.service[352328]: [pid: 352328|app: 0|req: 322/639] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 08:53:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 08:53:59.499637 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48400d97-ac06-48e5-be76-fdd9277cea1c None None] Authenticating user token {{(pid=352328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:53:59.504642 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16ae34e-5b2a-4615-852a-05a590521b34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:53:59.505330 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16ae34e-5b2a-4615-852a-05a590521b34 None admin] REQUEST_METHOD: `GET` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:53:59.506121 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16ae34e-5b2a-4615-852a-05a590521b34 None admin] SCRIPT_NAME: `/identity` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:53:59.506121 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16ae34e-5b2a-4615-852a-05a590521b34 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:53:59.517217 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c16ae34e-5b2a-4615-852a-05a590521b34 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:53:59.518697 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c16ae34e-5b2a-4615-852a-05a590521b34 None admin] RBAC: Authorization granted {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:53:59.534553 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application [None req-c16ae34e-5b2a-4615-852a-05a590521b34 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 08:53:59.534553 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:53:59.534553 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:53:59.534553 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:53:59.534553 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:53:59.534553 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:53:59.534553 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:53:59.534553 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:53:59.534553 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:53:59.534553 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:53:59.534553 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:53:59.534553 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:53:59.534553 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 08:53:59.534553 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 08:53:59.534553 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 08:53:59.535747 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 08:53:59.535747 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:53:59.535747 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:53:59.535747 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:53:59.535747 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:53:59.535747 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:53:59.535747 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:53:59.535747 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:53:59.535747 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application with Lock( Jul 28 08:53:59.535747 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:53:59.535747 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:53:59.535747 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:53:59.535747 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:53:59.535747 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:53:59.535747 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:53:59.535747 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:53:59.535747 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:53:59.537231 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 08:53:59.537231 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 08:53:59.537231 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 08:53:59.537231 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application Jul 28 08:53:59.540511 dv-cinder-851351-1-smb devstack@keystone.service[352329]: [pid: 352329|app: 0|req: 318/640] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 08:53:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:53:59.541480 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16ae34e-5b2a-4615-852a-05a590521b34 None admin] Authenticating user token {{(pid=352329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:53:59.610978 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG dbcounter [-] [352328] Writing DB stats keystone:SELECT=100 {{(pid=352328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:53:59.617192 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48400d97-ac06-48e5-be76-fdd9277cea1c None None] Validating token access rules against request {{(pid=352328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:53:59.649137 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16ae34e-5b2a-4615-852a-05a590521b34 None admin] Validating token access rules against request {{(pid=352329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:53:59.652977 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7bbb4a-9009-469f-bb0c-b440957ae466 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:53:59.653655 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7bbb4a-9009-469f-bb0c-b440957ae466 None admin] REQUEST_METHOD: `GET` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:53:59.653935 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7bbb4a-9009-469f-bb0c-b440957ae466 None admin] SCRIPT_NAME: `/identity` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:53:59.654213 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7bbb4a-9009-469f-bb0c-b440957ae466 None admin] PATH_INFO: `/v3/roles/service` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:53:59.665443 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de7bbb4a-9009-469f-bb0c-b440957ae466 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 08:53:59.666300 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG dbcounter [-] [352329] Writing DB stats keystone:SELECT=100 {{(pid=352329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:53:59.671600 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application [None req-de7bbb4a-9009-469f-bb0c-b440957ae466 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 28 08:53:59.671600 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:53:59.671600 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:53:59.671600 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:53:59.671600 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:53:59.671600 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:53:59.671600 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:53:59.671600 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:53:59.671600 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:53:59.671600 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:53:59.671600 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:53:59.671600 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:53:59.671600 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 08:53:59.671600 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 08:53:59.671600 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 08:53:59.671600 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 08:53:59.672924 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 08:53:59.672924 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 08:53:59.672924 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 08:53:59.672924 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 08:53:59.672924 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:53:59.672924 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:53:59.672924 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:53:59.672924 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:53:59.672924 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:53:59.672924 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:53:59.672924 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:53:59.672924 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application with Lock( Jul 28 08:53:59.672924 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:53:59.672924 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:53:59.672924 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:53:59.672924 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:53:59.674633 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:53:59.674633 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:53:59.674633 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:53:59.674633 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:53:59.674633 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 08:53:59.674633 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 08:53:59.674633 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 08:53:59.674633 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 08:53:59.674633 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 08:53:59.674633 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 08:53:59.674633 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 28 08:53:59.674633 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application Jul 28 08:53:59.674633 dv-cinder-851351-1-smb devstack@keystone.service[352328]: [pid: 352328|app: 0|req: 323/641] 10.222.0.42 () {56 vars in 1102 bytes} [Thu Jul 28 08:53:59 2022] GET /identity/v3/roles/service => generated 85 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:53:59.674633 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11fc82da-5215-4359-83f3-40f924ab514d None None] REQUEST_METHOD: `POST` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:53:59.675587 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11fc82da-5215-4359-83f3-40f924ab514d None None] SCRIPT_NAME: `/identity` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:53:59.675587 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11fc82da-5215-4359-83f3-40f924ab514d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:53:59.691791 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e26b6e-fde2-465c-972e-096cb8cb0dde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:53:59.692430 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e26b6e-fde2-465c-972e-096cb8cb0dde None admin] REQUEST_METHOD: `GET` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:53:59.692736 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e26b6e-fde2-465c-972e-096cb8cb0dde None admin] SCRIPT_NAME: `/identity` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:53:59.693012 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e26b6e-fde2-465c-972e-096cb8cb0dde None admin] PATH_INFO: `/v3/users` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:53:59.693315 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.auth.core [None req-11fc82da-5215-4359-83f3-40f924ab514d None None] MFA Rules not processed for user `d18c063b2377412485965357671e5506`. Rule list: `[]` (Enabled: `True`). {{(pid=352328) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 08:53:59.693818 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9e26b6e-fde2-465c-972e-096cb8cb0dde None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=352329) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:53:59.694123 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9e26b6e-fde2-465c-972e-096cb8cb0dde None admin] RBAC: Authorizing `identity:list_users()` {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:53:59.694529 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.fernet_utils [None req-11fc82da-5215-4359-83f3-40f924ab514d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=352328) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:53:59.695654 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9e26b6e-fde2-465c-972e-096cb8cb0dde None admin] RBAC: Authorization granted {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:53:59.714665 dv-cinder-851351-1-smb devstack@keystone.service[352329]: [pid: 352329|app: 0|req: 319/642] 10.222.0.42 () {56 vars in 1137 bytes} [Thu Jul 28 08:53:59 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:53:59.717667 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e26b6e-fde2-465c-972e-096cb8cb0dde None admin] Authenticating user token {{(pid=352329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:53:59.780686 dv-cinder-851351-1-smb devstack@keystone.service[352328]: [pid: 352328|app: 0|req: 324/643] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 08:53:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 08:53:59.780686 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11fc82da-5215-4359-83f3-40f924ab514d None None] Authenticating user token {{(pid=352328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:53:59.839598 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e26b6e-fde2-465c-972e-096cb8cb0dde None admin] Validating token access rules against request {{(pid=352329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:53:59.873956 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG dbcounter [-] [352328] Writing DB stats keystone:SELECT=100 {{(pid=352328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:53:59.874187 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83c3896-734b-4a11-af0d-0291cda3bbdb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:53:59.874701 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83c3896-734b-4a11-af0d-0291cda3bbdb None admin] REQUEST_METHOD: `GET` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:53:59.874987 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83c3896-734b-4a11-af0d-0291cda3bbdb None admin] SCRIPT_NAME: `/identity` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:53:59.875319 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83c3896-734b-4a11-af0d-0291cda3bbdb None admin] PATH_INFO: `/v3/domains` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:53:59.876198 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a83c3896-734b-4a11-af0d-0291cda3bbdb None admin] RBAC: Adding query filter params (name=Default) {{(pid=352329) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:53:59.876564 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a83c3896-734b-4a11-af0d-0291cda3bbdb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:53:59.878052 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a83c3896-734b-4a11-af0d-0291cda3bbdb None admin] RBAC: Authorization granted {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:53:59.889392 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11fc82da-5215-4359-83f3-40f924ab514d None None] Validating token access rules against request {{(pid=352328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:53:59.890514 dv-cinder-851351-1-smb devstack@keystone.service[352329]: [pid: 352329|app: 0|req: 320/644] 10.222.0.42 () {56 vars in 1109 bytes} [Thu Jul 28 08:53:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:53:59.891320 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83c3896-734b-4a11-af0d-0291cda3bbdb None admin] Authenticating user token {{(pid=352329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:53:59.927111 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG dbcounter [-] [352329] Writing DB stats keystone:SELECT=100 {{(pid=352329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:53:59.933153 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-049e31c4-04f8-402d-be02-921629e89106 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:53:59.933790 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049e31c4-04f8-402d-be02-921629e89106 None admin] REQUEST_METHOD: `GET` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:53:59.934071 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049e31c4-04f8-402d-be02-921629e89106 None admin] SCRIPT_NAME: `/identity` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:53:59.934323 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049e31c4-04f8-402d-be02-921629e89106 None admin] PATH_INFO: `/v3/roles` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:53:59.935156 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-049e31c4-04f8-402d-be02-921629e89106 None admin] RBAC: Adding query filter params (name=service) {{(pid=352328) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:53:59.935491 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-049e31c4-04f8-402d-be02-921629e89106 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:53:59.936950 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-049e31c4-04f8-402d-be02-921629e89106 None admin] RBAC: Authorization granted {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:53:59.950787 dv-cinder-851351-1-smb devstack@keystone.service[352328]: [pid: 352328|app: 0|req: 325/645] 10.222.0.42 () {56 vars in 1103 bytes} [Thu Jul 28 08:53:59 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:53:59.951832 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-049e31c4-04f8-402d-be02-921629e89106 None admin] Authenticating user token {{(pid=352328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:54:00.000093 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83c3896-734b-4a11-af0d-0291cda3bbdb None admin] Validating token access rules against request {{(pid=352329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:54:00.041712 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33281b68-376c-41fc-9e34-0a01fa851415 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:54:00.042353 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33281b68-376c-41fc-9e34-0a01fa851415 None admin] REQUEST_METHOD: `GET` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:54:00.042681 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33281b68-376c-41fc-9e34-0a01fa851415 None admin] SCRIPT_NAME: `/identity` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:54:00.042985 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33281b68-376c-41fc-9e34-0a01fa851415 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:54:00.072655 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-049e31c4-04f8-402d-be02-921629e89106 None admin] Validating token access rules against request {{(pid=352328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:54:00.108581 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4ab495-f8ec-4ce9-a217-778de6db3b10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:54:00.109423 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4ab495-f8ec-4ce9-a217-778de6db3b10 None admin] REQUEST_METHOD: `GET` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:54:00.109864 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4ab495-f8ec-4ce9-a217-778de6db3b10 None admin] SCRIPT_NAME: `/identity` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:54:00.110402 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4ab495-f8ec-4ce9-a217-778de6db3b10 None admin] PATH_INFO: `/v3/roles/service` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:54:00.123086 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33281b68-376c-41fc-9e34-0a01fa851415 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:54:00.124759 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33281b68-376c-41fc-9e34-0a01fa851415 None admin] RBAC: Authorization granted {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:54:00.124906 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e4ab495-f8ec-4ce9-a217-778de6db3b10 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 08:54:00.131439 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application [None req-0e4ab495-f8ec-4ce9-a217-778de6db3b10 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 28 08:54:00.131439 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:54:00.131439 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:54:00.131439 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:54:00.131439 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:54:00.131439 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:54:00.131439 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:54:00.131439 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:54:00.131439 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:54:00.131439 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:54:00.131439 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:54:00.131439 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:54:00.131439 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 08:54:00.131439 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 08:54:00.131439 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 08:54:00.131439 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 08:54:00.137894 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 08:54:00.137894 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 08:54:00.137894 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 08:54:00.137894 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 08:54:00.137894 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:54:00.137894 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:54:00.137894 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:54:00.137894 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:54:00.137894 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:54:00.137894 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:54:00.137894 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:54:00.137894 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application with Lock( Jul 28 08:54:00.137894 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:54:00.137894 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:54:00.137894 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:54:00.137894 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:54:00.139205 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:54:00.139205 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:54:00.139205 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:54:00.139205 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:54:00.139205 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 08:54:00.139205 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 08:54:00.139205 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 08:54:00.139205 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 08:54:00.139205 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 08:54:00.139205 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 08:54:00.139205 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 28 08:54:00.139205 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application Jul 28 08:54:00.139205 dv-cinder-851351-1-smb devstack@keystone.service[352328]: [pid: 352328|app: 0|req: 326/646] 10.222.0.42 () {56 vars in 1102 bytes} [Thu Jul 28 08:53:59 2022] GET /identity/v3/roles/service => generated 85 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:54:00.139205 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4ab495-f8ec-4ce9-a217-778de6db3b10 None admin] Authenticating user token {{(pid=352328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:54:00.150603 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG dbcounter [-] [352328] Writing DB stats keystone:SELECT=100 {{(pid=352328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:54:00.168757 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG dbcounter [-] [352329] Writing DB stats keystone:SELECT=100 {{(pid=352329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:54:00.240838 dv-cinder-851351-1-smb devstack@keystone.service[352329]: [pid: 352329|app: 0|req: 321/647] 10.222.0.42 () {58 vars in 1282 bytes} [Thu Jul 28 08:53:59 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 350 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 28 08:54:00.242019 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33281b68-376c-41fc-9e34-0a01fa851415 None admin] Authenticating user token {{(pid=352329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:54:00.253587 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4ab495-f8ec-4ce9-a217-778de6db3b10 None admin] Validating token access rules against request {{(pid=352328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:54:00.294074 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fbec8e0-63e7-442d-a740-7a7eeea98e2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:54:00.295147 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbec8e0-63e7-442d-a740-7a7eeea98e2c None admin] REQUEST_METHOD: `GET` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:54:00.295672 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbec8e0-63e7-442d-a740-7a7eeea98e2c None admin] SCRIPT_NAME: `/identity` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:54:00.296179 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbec8e0-63e7-442d-a740-7a7eeea98e2c None admin] PATH_INFO: `/v3/projects/service` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:54:00.305112 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fbec8e0-63e7-442d-a740-7a7eeea98e2c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:54:00.306641 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fbec8e0-63e7-442d-a740-7a7eeea98e2c None admin] RBAC: Authorization granted {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:54:00.319433 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application [None req-7fbec8e0-63e7-442d-a740-7a7eeea98e2c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 08:54:00.319433 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:54:00.319433 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:54:00.319433 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:54:00.319433 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:54:00.319433 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:54:00.319433 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:54:00.319433 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:54:00.319433 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:54:00.319433 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:54:00.319433 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:54:00.319433 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:54:00.319433 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 28 08:54:00.319433 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 28 08:54:00.319433 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 28 08:54:00.320639 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 28 08:54:00.320639 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:54:00.320639 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:54:00.320639 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:54:00.320639 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:54:00.320639 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:54:00.320639 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:54:00.320639 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:54:00.320639 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application with Lock( Jul 28 08:54:00.320639 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:54:00.320639 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:54:00.320639 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:54:00.320639 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:54:00.320639 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:54:00.320639 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:54:00.320639 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:54:00.320639 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:54:00.326961 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 28 08:54:00.326961 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 28 08:54:00.326961 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 28 08:54:00.326961 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 28 08:54:00.326961 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 28 08:54:00.326961 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 28 08:54:00.326961 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 08:54:00.326961 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application Jul 28 08:54:00.326961 dv-cinder-851351-1-smb devstack@keystone.service[352328]: [pid: 352328|app: 0|req: 327/648] 10.222.0.42 () {56 vars in 1111 bytes} [Thu Jul 28 08:54:00 2022] GET /identity/v3/projects/service => generated 88 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:54:00.326961 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fbec8e0-63e7-442d-a740-7a7eeea98e2c None admin] Authenticating user token {{(pid=352328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:54:00.372900 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33281b68-376c-41fc-9e34-0a01fa851415 None admin] Validating token access rules against request {{(pid=352329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:54:00.419232 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96da0f2e-8ff6-4c0b-a0e5-633303b7ceba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:54:00.419785 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96da0f2e-8ff6-4c0b-a0e5-633303b7ceba None admin] REQUEST_METHOD: `GET` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:54:00.420071 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96da0f2e-8ff6-4c0b-a0e5-633303b7ceba None admin] SCRIPT_NAME: `/identity` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:54:00.420349 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96da0f2e-8ff6-4c0b-a0e5-633303b7ceba None admin] PATH_INFO: `/v3/domains/Default` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:54:00.422459 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG dbcounter [-] [352329] Writing DB stats keystone:SELECT=100 {{(pid=352329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:54:00.424487 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG dbcounter [-] [352328] Writing DB stats keystone:SELECT=100 {{(pid=352328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:54:00.433900 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96da0f2e-8ff6-4c0b-a0e5-633303b7ceba None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:54:00.435401 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96da0f2e-8ff6-4c0b-a0e5-633303b7ceba None admin] RBAC: Authorization granted {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:54:00.451367 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application [None req-96da0f2e-8ff6-4c0b-a0e5-633303b7ceba None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 08:54:00.451367 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:54:00.451367 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:54:00.451367 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:54:00.451367 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:54:00.451367 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:54:00.451367 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:54:00.451367 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:54:00.451367 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:54:00.451367 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:54:00.451367 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:54:00.451367 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:54:00.451367 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 08:54:00.451367 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 08:54:00.451367 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 08:54:00.452554 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 08:54:00.452554 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:54:00.452554 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:54:00.452554 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:54:00.452554 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:54:00.452554 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:54:00.452554 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:54:00.452554 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:54:00.452554 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application with Lock( Jul 28 08:54:00.452554 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:54:00.452554 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:54:00.452554 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:54:00.452554 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:54:00.452554 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:54:00.452554 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:54:00.452554 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:54:00.452554 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:54:00.454777 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 08:54:00.454777 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 08:54:00.454777 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 08:54:00.454777 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application Jul 28 08:54:00.454777 dv-cinder-851351-1-smb devstack@keystone.service[352329]: [pid: 352329|app: 0|req: 322/649] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 08:54:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:54:00.454777 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96da0f2e-8ff6-4c0b-a0e5-633303b7ceba None admin] Authenticating user token {{(pid=352329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:54:00.489908 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fbec8e0-63e7-442d-a740-7a7eeea98e2c None admin] Validating token access rules against request {{(pid=352328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:54:00.534626 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3130d268-527a-4181-be8d-6d4a7c4886a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:54:00.535265 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3130d268-527a-4181-be8d-6d4a7c4886a6 None admin] REQUEST_METHOD: `GET` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:54:00.535547 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3130d268-527a-4181-be8d-6d4a7c4886a6 None admin] SCRIPT_NAME: `/identity` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:54:00.535823 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3130d268-527a-4181-be8d-6d4a7c4886a6 None admin] PATH_INFO: `/v3/roles` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:54:00.536554 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3130d268-527a-4181-be8d-6d4a7c4886a6 None admin] RBAC: Adding query filter params (name=service) {{(pid=352328) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:54:00.536889 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3130d268-527a-4181-be8d-6d4a7c4886a6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:54:00.538283 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3130d268-527a-4181-be8d-6d4a7c4886a6 None admin] RBAC: Authorization granted {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:54:00.551451 dv-cinder-851351-1-smb devstack@keystone.service[352328]: [pid: 352328|app: 0|req: 328/650] 10.222.0.42 () {56 vars in 1103 bytes} [Thu Jul 28 08:54:00 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:54:00.551451 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3130d268-527a-4181-be8d-6d4a7c4886a6 None admin] Authenticating user token {{(pid=352328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:54:00.571675 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96da0f2e-8ff6-4c0b-a0e5-633303b7ceba None admin] Validating token access rules against request {{(pid=352329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:54:00.611290 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d13053-de51-4453-b1ab-bf24422148a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:54:00.611994 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d13053-de51-4453-b1ab-bf24422148a7 None admin] REQUEST_METHOD: `GET` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:54:00.612246 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d13053-de51-4453-b1ab-bf24422148a7 None admin] SCRIPT_NAME: `/identity` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:54:00.612519 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d13053-de51-4453-b1ab-bf24422148a7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:54:00.626428 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d13053-de51-4453-b1ab-bf24422148a7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:54:00.628446 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d13053-de51-4453-b1ab-bf24422148a7 None admin] RBAC: Authorization granted {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:54:00.647683 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application [None req-13d13053-de51-4453-b1ab-bf24422148a7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 08:54:00.647683 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:54:00.647683 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:54:00.647683 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:54:00.647683 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:54:00.647683 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:54:00.647683 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:54:00.647683 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:54:00.647683 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:54:00.647683 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:54:00.647683 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:54:00.647683 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:54:00.647683 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 08:54:00.647683 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 08:54:00.647683 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 08:54:00.649052 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 08:54:00.649052 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:54:00.649052 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:54:00.649052 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:54:00.649052 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:54:00.649052 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:54:00.649052 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:54:00.649052 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:54:00.649052 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application with Lock( Jul 28 08:54:00.649052 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:54:00.649052 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:54:00.649052 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:54:00.649052 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:54:00.649052 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:54:00.649052 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:54:00.649052 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:54:00.649052 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:54:00.650818 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 08:54:00.650818 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 08:54:00.650818 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 08:54:00.650818 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application Jul 28 08:54:00.650818 dv-cinder-851351-1-smb devstack@keystone.service[352329]: [pid: 352329|app: 0|req: 323/651] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 08:54:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:54:00.650818 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d13053-de51-4453-b1ab-bf24422148a7 None admin] Authenticating user token {{(pid=352329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:54:00.662686 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3130d268-527a-4181-be8d-6d4a7c4886a6 None admin] Validating token access rules against request {{(pid=352328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:54:00.690575 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG dbcounter [-] [352329] Writing DB stats keystone:SELECT=100 {{(pid=352329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:54:00.692294 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG dbcounter [-] [352328] Writing DB stats keystone:SELECT=100 {{(pid=352328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:54:00.697673 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2077676b-8f1d-4c79-bd51-e87ede7d1885 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:54:00.698302 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2077676b-8f1d-4c79-bd51-e87ede7d1885 None admin] REQUEST_METHOD: `GET` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:54:00.698588 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2077676b-8f1d-4c79-bd51-e87ede7d1885 None admin] SCRIPT_NAME: `/identity` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:54:00.698867 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2077676b-8f1d-4c79-bd51-e87ede7d1885 None admin] PATH_INFO: `/v3/projects` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:54:00.699633 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2077676b-8f1d-4c79-bd51-e87ede7d1885 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=352328) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:54:00.700000 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2077676b-8f1d-4c79-bd51-e87ede7d1885 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:54:00.701491 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2077676b-8f1d-4c79-bd51-e87ede7d1885 None admin] RBAC: Authorization granted {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:54:00.713903 dv-cinder-851351-1-smb devstack@keystone.service[352328]: [pid: 352328|app: 0|req: 329/652] 10.222.0.42 () {56 vars in 1148 bytes} [Thu Jul 28 08:54:00 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:54:00.714713 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2077676b-8f1d-4c79-bd51-e87ede7d1885 None admin] Authenticating user token {{(pid=352328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:54:00.751325 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d13053-de51-4453-b1ab-bf24422148a7 None admin] Validating token access rules against request {{(pid=352329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:54:00.784841 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9dba57f-29e4-459a-a4f4-d97630a5fa0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:54:00.785473 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9dba57f-29e4-459a-a4f4-d97630a5fa0d None admin] REQUEST_METHOD: `GET` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:54:00.785761 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9dba57f-29e4-459a-a4f4-d97630a5fa0d None admin] SCRIPT_NAME: `/identity` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:54:00.786039 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9dba57f-29e4-459a-a4f4-d97630a5fa0d None admin] PATH_INFO: `/v3/domains` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:54:00.786738 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9dba57f-29e4-459a-a4f4-d97630a5fa0d None admin] RBAC: Adding query filter params (name=Default) {{(pid=352329) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:54:00.787061 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9dba57f-29e4-459a-a4f4-d97630a5fa0d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:54:00.788455 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9dba57f-29e4-459a-a4f4-d97630a5fa0d None admin] RBAC: Authorization granted {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:54:00.800240 dv-cinder-851351-1-smb devstack@keystone.service[352329]: [pid: 352329|app: 0|req: 324/653] 10.222.0.42 () {56 vars in 1109 bytes} [Thu Jul 28 08:54:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:54:00.801574 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e774f825-971c-4948-94e2-b7bc144c9129 None None] REQUEST_METHOD: `GET` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:54:00.801862 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e774f825-971c-4948-94e2-b7bc144c9129 None None] SCRIPT_NAME: `/identity` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:54:00.802138 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e774f825-971c-4948-94e2-b7bc144c9129 None None] PATH_INFO: `/` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:54:00.803384 dv-cinder-851351-1-smb devstack@keystone.service[352329]: [pid: 352329|app: 0|req: 325/654] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 08:54:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 08:54:00.804079 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e774f825-971c-4948-94e2-b7bc144c9129 None None] Authenticating user token {{(pid=352329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:54:00.822993 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2077676b-8f1d-4c79-bd51-e87ede7d1885 None admin] Validating token access rules against request {{(pid=352328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:54:00.857747 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f78509-8383-4dd0-9732-6fd4a6104043 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:54:00.858823 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f78509-8383-4dd0-9732-6fd4a6104043 None admin] REQUEST_METHOD: `GET` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:54:00.859096 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f78509-8383-4dd0-9732-6fd4a6104043 None admin] SCRIPT_NAME: `/identity` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:54:00.859366 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f78509-8383-4dd0-9732-6fd4a6104043 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:54:00.869819 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2f78509-8383-4dd0-9732-6fd4a6104043 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:54:00.871313 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2f78509-8383-4dd0-9732-6fd4a6104043 None admin] RBAC: Authorization granted {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:54:00.886262 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application [None req-d2f78509-8383-4dd0-9732-6fd4a6104043 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 08:54:00.886262 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:54:00.886262 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:54:00.886262 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:54:00.886262 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:54:00.886262 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:54:00.886262 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:54:00.886262 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:54:00.886262 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:54:00.886262 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:54:00.886262 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:54:00.886262 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:54:00.886262 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 08:54:00.886262 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 08:54:00.886262 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 08:54:00.887553 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 08:54:00.887553 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:54:00.887553 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:54:00.887553 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:54:00.887553 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:54:00.887553 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:54:00.887553 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:54:00.887553 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:54:00.887553 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application with Lock( Jul 28 08:54:00.887553 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:54:00.887553 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:54:00.887553 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:54:00.887553 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:54:00.887553 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:54:00.887553 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:54:00.887553 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:54:00.887553 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:54:00.888650 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 08:54:00.888650 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 08:54:00.888650 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 08:54:00.888650 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application Jul 28 08:54:00.888650 dv-cinder-851351-1-smb devstack@keystone.service[352328]: [pid: 352328|app: 0|req: 330/655] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 08:54:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:54:00.889048 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f78509-8383-4dd0-9732-6fd4a6104043 None admin] Authenticating user token {{(pid=352328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:54:00.906935 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG dbcounter [-] [352329] Writing DB stats keystone:SELECT=100 {{(pid=352329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:54:00.912331 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e774f825-971c-4948-94e2-b7bc144c9129 None None] Validating token access rules against request {{(pid=352329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:54:00.938239 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG dbcounter [-] [352328] Writing DB stats keystone:SELECT=100 {{(pid=352328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:54:00.948065 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89436d8c-640e-47c0-a3c9-fdd66c9afdcd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:54:00.948631 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89436d8c-640e-47c0-a3c9-fdd66c9afdcd None admin] REQUEST_METHOD: `GET` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:54:00.948941 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89436d8c-640e-47c0-a3c9-fdd66c9afdcd None admin] SCRIPT_NAME: `/identity` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:54:00.949215 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89436d8c-640e-47c0-a3c9-fdd66c9afdcd None admin] PATH_INFO: `/v3/domains` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:54:00.950112 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89436d8c-640e-47c0-a3c9-fdd66c9afdcd None admin] RBAC: Adding query filter params (name=Default) {{(pid=352329) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:54:00.950342 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89436d8c-640e-47c0-a3c9-fdd66c9afdcd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:54:00.951639 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89436d8c-640e-47c0-a3c9-fdd66c9afdcd None admin] RBAC: Authorization granted {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:54:00.963627 dv-cinder-851351-1-smb devstack@keystone.service[352329]: [pid: 352329|app: 0|req: 326/656] 10.222.0.42 () {56 vars in 1109 bytes} [Thu Jul 28 08:54:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:54:00.964457 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89436d8c-640e-47c0-a3c9-fdd66c9afdcd None admin] Authenticating user token {{(pid=352329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:54:00.994546 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f78509-8383-4dd0-9732-6fd4a6104043 None admin] Validating token access rules against request {{(pid=352328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:54:01.031209 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca1c47d-e9a1-44a9-88fe-9b6e7a06b4f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:54:01.031972 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca1c47d-e9a1-44a9-88fe-9b6e7a06b4f1 None admin] REQUEST_METHOD: `GET` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:54:01.032248 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca1c47d-e9a1-44a9-88fe-9b6e7a06b4f1 None admin] SCRIPT_NAME: `/identity` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:54:01.032636 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca1c47d-e9a1-44a9-88fe-9b6e7a06b4f1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:54:01.033464 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eca1c47d-e9a1-44a9-88fe-9b6e7a06b4f1 None admin] RBAC: Adding query filter params (role.id=32da6d9f8d8f48e285530909f7633410, scope.project.id=9cfa053c839a4fedacde7163d907e2a4, user.id=e3ba63c3fc36470fbbe8312b51a13f13) {{(pid=352328) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:54:01.033796 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eca1c47d-e9a1-44a9-88fe-9b6e7a06b4f1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:54:01.035241 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eca1c47d-e9a1-44a9-88fe-9b6e7a06b4f1 None admin] RBAC: Authorization granted {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:54:01.041425 dv-cinder-851351-1-smb devstack@keystone.service[352328]: [pid: 352328|app: 0|req: 331/657] 10.222.0.42 () {56 vars in 1374 bytes} [Thu Jul 28 08:54:00 2022] GET /identity/v3/role_assignments?user.id=e3ba63c3fc36470fbbe8312b51a13f13&scope.project.id=9cfa053c839a4fedacde7163d907e2a4&role.id=32da6d9f8d8f48e285530909f7633410 => generated 608 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:54:01.042636 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73b9984-7a09-425b-9b9d-2cdf860747a4 None None] REQUEST_METHOD: `POST` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:54:01.042920 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73b9984-7a09-425b-9b9d-2cdf860747a4 None None] SCRIPT_NAME: `/identity` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:54:01.043197 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73b9984-7a09-425b-9b9d-2cdf860747a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:54:01.062881 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.auth.core [None req-e73b9984-7a09-425b-9b9d-2cdf860747a4 None None] MFA Rules not processed for user `d18c063b2377412485965357671e5506`. Rule list: `[]` (Enabled: `True`). {{(pid=352328) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 08:54:01.064155 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.fernet_utils [None req-e73b9984-7a09-425b-9b9d-2cdf860747a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=352328) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:54:01.074163 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89436d8c-640e-47c0-a3c9-fdd66c9afdcd None admin] Validating token access rules against request {{(pid=352329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:54:01.117007 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-411ed37e-2185-4cc9-af08-7d8e9a445816 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:54:01.118007 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411ed37e-2185-4cc9-af08-7d8e9a445816 None admin] REQUEST_METHOD: `GET` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:54:01.118301 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411ed37e-2185-4cc9-af08-7d8e9a445816 None admin] SCRIPT_NAME: `/identity` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:54:01.118585 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411ed37e-2185-4cc9-af08-7d8e9a445816 None admin] PATH_INFO: `/v3/users/glance` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:54:01.127393 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-411ed37e-2185-4cc9-af08-7d8e9a445816 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:54:01.128951 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-411ed37e-2185-4cc9-af08-7d8e9a445816 None admin] RBAC: Authorization granted {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:54:01.143602 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application [None req-411ed37e-2185-4cc9-af08-7d8e9a445816 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jul 28 08:54:01.143602 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:54:01.143602 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:54:01.143602 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:54:01.143602 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:54:01.143602 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:54:01.143602 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:54:01.143602 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:54:01.143602 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:54:01.143602 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:54:01.143602 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:54:01.143602 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:54:01.143602 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 28 08:54:01.143602 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 28 08:54:01.143602 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 28 08:54:01.143602 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 28 08:54:01.145473 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:54:01.145473 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:54:01.145473 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 28 08:54:01.145473 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 08:54:01.145473 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 28 08:54:01.145473 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 08:54:01.145473 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:54:01.145473 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:54:01.145473 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:54:01.145473 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:54:01.145473 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:54:01.145473 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application with Lock( Jul 28 08:54:01.145473 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:54:01.145473 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:54:01.145473 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:54:01.145473 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:54:01.145473 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:54:01.145473 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:54:01.152168 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:54:01.152168 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:54:01.152168 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 28 08:54:01.152168 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 28 08:54:01.152168 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 28 08:54:01.152168 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 28 08:54:01.152168 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 28 08:54:01.152168 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 28 08:54:01.152168 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jul 28 08:54:01.152168 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application Jul 28 08:54:01.152168 dv-cinder-851351-1-smb devstack@keystone.service[352329]: [pid: 352329|app: 0|req: 327/658] 10.222.0.42 () {56 vars in 1099 bytes} [Thu Jul 28 08:54:00 2022] GET /identity/v3/users/glance => generated 84 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:54:01.152168 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-411ed37e-2185-4cc9-af08-7d8e9a445816 None admin] Authenticating user token {{(pid=352329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:54:01.158101 dv-cinder-851351-1-smb devstack@keystone.service[352328]: [pid: 352328|app: 0|req: 332/659] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 08:54:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 08:54:01.170031 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73b9984-7a09-425b-9b9d-2cdf860747a4 None None] Authenticating user token {{(pid=352328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:54:01.171976 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG dbcounter [-] [352329] Writing DB stats keystone:SELECT=100 {{(pid=352329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:54:01.217734 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG dbcounter [-] [352328] Writing DB stats keystone:SELECT=100 {{(pid=352328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:54:01.278287 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-411ed37e-2185-4cc9-af08-7d8e9a445816 None admin] Validating token access rules against request {{(pid=352329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:54:01.287175 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73b9984-7a09-425b-9b9d-2cdf860747a4 None None] Validating token access rules against request {{(pid=352328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:54:01.317540 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e406951-316a-4bdb-8083-4a0130a72f75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:54:01.318201 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e406951-316a-4bdb-8083-4a0130a72f75 None admin] REQUEST_METHOD: `GET` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:54:01.318490 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e406951-316a-4bdb-8083-4a0130a72f75 None admin] SCRIPT_NAME: `/identity` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:54:01.318769 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e406951-316a-4bdb-8083-4a0130a72f75 None admin] PATH_INFO: `/v3/domains` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:54:01.319482 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e406951-316a-4bdb-8083-4a0130a72f75 None admin] RBAC: Adding query filter params (name=Default) {{(pid=352329) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:54:01.319801 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e406951-316a-4bdb-8083-4a0130a72f75 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:54:01.321242 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e406951-316a-4bdb-8083-4a0130a72f75 None admin] RBAC: Authorization granted {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:54:01.325925 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e5b5f44-64cf-43e2-b053-4f9defba3e31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:54:01.326781 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5b5f44-64cf-43e2-b053-4f9defba3e31 None admin] REQUEST_METHOD: `GET` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:54:01.327229 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5b5f44-64cf-43e2-b053-4f9defba3e31 None admin] SCRIPT_NAME: `/identity` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:54:01.327672 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5b5f44-64cf-43e2-b053-4f9defba3e31 None admin] PATH_INFO: `/v3/projects/service` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:54:01.334188 dv-cinder-851351-1-smb devstack@keystone.service[352329]: [pid: 352329|app: 0|req: 328/660] 10.222.0.42 () {56 vars in 1109 bytes} [Thu Jul 28 08:54:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:54:01.335036 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e406951-316a-4bdb-8083-4a0130a72f75 None admin] Authenticating user token {{(pid=352329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:54:01.340216 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e5b5f44-64cf-43e2-b053-4f9defba3e31 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:54:01.341727 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e5b5f44-64cf-43e2-b053-4f9defba3e31 None admin] RBAC: Authorization granted {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:54:01.355270 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application [None req-4e5b5f44-64cf-43e2-b053-4f9defba3e31 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 08:54:01.355270 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:54:01.355270 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:54:01.355270 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:54:01.355270 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:54:01.355270 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:54:01.355270 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:54:01.355270 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:54:01.355270 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:54:01.355270 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:54:01.355270 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:54:01.355270 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:54:01.355270 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 28 08:54:01.355270 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 28 08:54:01.355270 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 28 08:54:01.356449 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 28 08:54:01.356449 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:54:01.356449 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:54:01.356449 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:54:01.356449 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:54:01.356449 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:54:01.356449 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:54:01.356449 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:54:01.356449 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application with Lock( Jul 28 08:54:01.356449 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:54:01.356449 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:54:01.356449 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:54:01.356449 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:54:01.356449 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:54:01.356449 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:54:01.356449 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:54:01.356449 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:54:01.357614 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 28 08:54:01.357614 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 28 08:54:01.357614 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 28 08:54:01.357614 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 28 08:54:01.357614 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 28 08:54:01.357614 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 28 08:54:01.357614 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 08:54:01.357614 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application Jul 28 08:54:01.357614 dv-cinder-851351-1-smb devstack@keystone.service[352328]: [pid: 352328|app: 0|req: 333/661] 10.222.0.42 () {56 vars in 1111 bytes} [Thu Jul 28 08:54:01 2022] GET /identity/v3/projects/service => generated 88 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:54:01.358236 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e5b5f44-64cf-43e2-b053-4f9defba3e31 None admin] Authenticating user token {{(pid=352328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:54:01.427891 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG dbcounter [-] [352329] Writing DB stats keystone:SELECT=100 {{(pid=352329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:54:01.451863 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e406951-316a-4bdb-8083-4a0130a72f75 None admin] Validating token access rules against request {{(pid=352329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:54:01.469602 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG dbcounter [-] [352328] Writing DB stats keystone:SELECT=100 {{(pid=352328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:54:01.473485 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e5b5f44-64cf-43e2-b053-4f9defba3e31 None admin] Validating token access rules against request {{(pid=352328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:54:01.490275 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-063fffb2-1fb5-4e57-bcca-ed36a7abf2d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:54:01.490918 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063fffb2-1fb5-4e57-bcca-ed36a7abf2d7 None admin] REQUEST_METHOD: `GET` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:54:01.491201 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063fffb2-1fb5-4e57-bcca-ed36a7abf2d7 None admin] SCRIPT_NAME: `/identity` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:54:01.491482 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063fffb2-1fb5-4e57-bcca-ed36a7abf2d7 None admin] PATH_INFO: `/v3/users` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:54:01.492290 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-063fffb2-1fb5-4e57-bcca-ed36a7abf2d7 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=352329) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:54:01.492603 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-063fffb2-1fb5-4e57-bcca-ed36a7abf2d7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:54:01.494153 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-063fffb2-1fb5-4e57-bcca-ed36a7abf2d7 None admin] RBAC: Authorization granted {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:54:01.511786 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050c1d77-c766-423f-87ea-e0c68b676ba2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:54:01.512517 dv-cinder-851351-1-smb devstack@keystone.service[352329]: [pid: 352329|app: 0|req: 329/662] 10.222.0.42 () {56 vars in 1137 bytes} [Thu Jul 28 08:54:01 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:54:01.512654 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050c1d77-c766-423f-87ea-e0c68b676ba2 None admin] REQUEST_METHOD: `GET` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:54:01.513094 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050c1d77-c766-423f-87ea-e0c68b676ba2 None admin] SCRIPT_NAME: `/identity` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:54:01.513443 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050c1d77-c766-423f-87ea-e0c68b676ba2 None admin] PATH_INFO: `/v3/roles/service` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:54:01.514325 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-063fffb2-1fb5-4e57-bcca-ed36a7abf2d7 None admin] Authenticating user token {{(pid=352329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:54:01.529567 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-050c1d77-c766-423f-87ea-e0c68b676ba2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 08:54:01.535279 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application [None req-050c1d77-c766-423f-87ea-e0c68b676ba2 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 28 08:54:01.535279 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:54:01.535279 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:54:01.535279 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:54:01.535279 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:54:01.535279 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:54:01.535279 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:54:01.535279 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:54:01.535279 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:54:01.535279 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:54:01.535279 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:54:01.535279 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:54:01.535279 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 08:54:01.535279 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 08:54:01.535279 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 08:54:01.535279 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 08:54:01.536488 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 08:54:01.536488 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 08:54:01.536488 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 08:54:01.536488 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 08:54:01.536488 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:54:01.536488 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:54:01.536488 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:54:01.536488 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:54:01.536488 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:54:01.536488 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:54:01.536488 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:54:01.536488 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application with Lock( Jul 28 08:54:01.536488 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:54:01.536488 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:54:01.536488 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:54:01.536488 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:54:01.538104 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:54:01.538104 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:54:01.538104 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:54:01.538104 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:54:01.538104 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 08:54:01.538104 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 08:54:01.538104 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 08:54:01.538104 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 08:54:01.538104 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 08:54:01.538104 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 08:54:01.538104 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 28 08:54:01.538104 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application Jul 28 08:54:01.538104 dv-cinder-851351-1-smb devstack@keystone.service[352328]: [pid: 352328|app: 0|req: 334/663] 10.222.0.42 () {56 vars in 1102 bytes} [Thu Jul 28 08:54:01 2022] GET /identity/v3/roles/service => generated 85 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:54:01.538104 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050c1d77-c766-423f-87ea-e0c68b676ba2 None admin] Authenticating user token {{(pid=352328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:54:01.628035 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-063fffb2-1fb5-4e57-bcca-ed36a7abf2d7 None admin] Validating token access rules against request {{(pid=352329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:54:01.650568 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050c1d77-c766-423f-87ea-e0c68b676ba2 None admin] Validating token access rules against request {{(pid=352328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:54:01.666192 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5b4eef-645f-4fed-8a75-4b3db1d0e26b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:54:01.666900 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5b4eef-645f-4fed-8a75-4b3db1d0e26b None admin] REQUEST_METHOD: `GET` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:54:01.667180 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5b4eef-645f-4fed-8a75-4b3db1d0e26b None admin] SCRIPT_NAME: `/identity` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:54:01.667461 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5b4eef-645f-4fed-8a75-4b3db1d0e26b None admin] PATH_INFO: `/v3/users/neutron` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:54:01.670478 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG dbcounter [-] [352329] Writing DB stats keystone:SELECT=100 {{(pid=352329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:54:01.677099 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c5b4eef-645f-4fed-8a75-4b3db1d0e26b None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:54:01.678845 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c5b4eef-645f-4fed-8a75-4b3db1d0e26b None admin] RBAC: Authorization granted {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:54:01.686446 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a5360c8-5b81-44b3-b7ad-2ca3d9621e5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:54:01.687090 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5360c8-5b81-44b3-b7ad-2ca3d9621e5a None admin] REQUEST_METHOD: `GET` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:54:01.687376 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5360c8-5b81-44b3-b7ad-2ca3d9621e5a None admin] SCRIPT_NAME: `/identity` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:54:01.687653 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5360c8-5b81-44b3-b7ad-2ca3d9621e5a None admin] PATH_INFO: `/v3/projects` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:54:01.688495 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a5360c8-5b81-44b3-b7ad-2ca3d9621e5a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=352328) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:54:01.688851 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a5360c8-5b81-44b3-b7ad-2ca3d9621e5a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:54:01.690302 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a5360c8-5b81-44b3-b7ad-2ca3d9621e5a None admin] RBAC: Authorization granted {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:54:01.691147 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application [None req-5c5b4eef-645f-4fed-8a75-4b3db1d0e26b None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jul 28 08:54:01.691147 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:54:01.691147 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:54:01.691147 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:54:01.691147 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:54:01.691147 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:54:01.691147 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:54:01.691147 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:54:01.691147 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:54:01.691147 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:54:01.691147 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:54:01.691147 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:54:01.691147 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 28 08:54:01.691147 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 28 08:54:01.691147 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 28 08:54:01.691147 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 28 08:54:01.692263 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:54:01.692263 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:54:01.692263 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 28 08:54:01.692263 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 08:54:01.692263 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 28 08:54:01.692263 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 08:54:01.692263 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:54:01.692263 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:54:01.692263 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:54:01.692263 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:54:01.692263 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:54:01.692263 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application with Lock( Jul 28 08:54:01.692263 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:54:01.692263 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:54:01.692263 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:54:01.692263 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:54:01.692263 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:54:01.692263 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:54:01.693526 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:54:01.693526 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:54:01.693526 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 28 08:54:01.693526 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 28 08:54:01.693526 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 28 08:54:01.693526 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 28 08:54:01.693526 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 28 08:54:01.693526 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 28 08:54:01.693526 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jul 28 08:54:01.693526 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application Jul 28 08:54:01.693526 dv-cinder-851351-1-smb devstack@keystone.service[352329]: [pid: 352329|app: 0|req: 330/664] 10.222.0.42 () {56 vars in 1102 bytes} [Thu Jul 28 08:54:01 2022] GET /identity/v3/users/neutron => generated 85 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:54:01.693526 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5b4eef-645f-4fed-8a75-4b3db1d0e26b None admin] Authenticating user token {{(pid=352329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:54:01.711128 dv-cinder-851351-1-smb devstack@keystone.service[352328]: [pid: 352328|app: 0|req: 335/665] 10.222.0.42 () {56 vars in 1148 bytes} [Thu Jul 28 08:54:01 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:54:01.713126 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a5360c8-5b81-44b3-b7ad-2ca3d9621e5a None admin] Authenticating user token {{(pid=352328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:54:01.739664 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG dbcounter [-] [352328] Writing DB stats keystone:SELECT=100 {{(pid=352328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:54:01.817692 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5b4eef-645f-4fed-8a75-4b3db1d0e26b None admin] Validating token access rules against request {{(pid=352329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:54:01.845426 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a5360c8-5b81-44b3-b7ad-2ca3d9621e5a None admin] Validating token access rules against request {{(pid=352328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:54:01.855822 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11145598-c7c0-446e-bdf1-1893549ae20f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:54:01.856471 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11145598-c7c0-446e-bdf1-1893549ae20f None admin] REQUEST_METHOD: `GET` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:54:01.856789 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11145598-c7c0-446e-bdf1-1893549ae20f None admin] SCRIPT_NAME: `/identity` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:54:01.857073 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11145598-c7c0-446e-bdf1-1893549ae20f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:54:01.889949 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e6a852-716e-4dd5-ac55-3cb6e43814c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:54:01.890592 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e6a852-716e-4dd5-ac55-3cb6e43814c9 None admin] REQUEST_METHOD: `GET` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:54:01.890937 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e6a852-716e-4dd5-ac55-3cb6e43814c9 None admin] SCRIPT_NAME: `/identity` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:54:01.891253 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e6a852-716e-4dd5-ac55-3cb6e43814c9 None admin] PATH_INFO: `/v3/roles` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:54:01.892026 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47e6a852-716e-4dd5-ac55-3cb6e43814c9 None admin] RBAC: Adding query filter params (name=service) {{(pid=352328) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:54:01.892332 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47e6a852-716e-4dd5-ac55-3cb6e43814c9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:54:01.893765 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47e6a852-716e-4dd5-ac55-3cb6e43814c9 None admin] RBAC: Authorization granted {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:54:01.902583 dv-cinder-851351-1-smb devstack@keystone.service[352328]: [pid: 352328|app: 0|req: 336/666] 10.222.0.42 () {56 vars in 1103 bytes} [Thu Jul 28 08:54:01 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:54:01.903634 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e6a852-716e-4dd5-ac55-3cb6e43814c9 None admin] Authenticating user token {{(pid=352328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:54:01.931749 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG dbcounter [-] [352329] Writing DB stats keystone:SELECT=100 {{(pid=352329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:54:01.940146 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11145598-c7c0-446e-bdf1-1893549ae20f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:54:01.941690 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11145598-c7c0-446e-bdf1-1893549ae20f None admin] RBAC: Authorization granted {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:54:01.998184 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG dbcounter [-] [352328] Writing DB stats keystone:SELECT=100 {{(pid=352328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:54:02.022190 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e6a852-716e-4dd5-ac55-3cb6e43814c9 None admin] Validating token access rules against request {{(pid=352328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:54:02.060427 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8bc42a3-5ce5-4485-b510-5bc2a1313b93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:54:02.061190 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8bc42a3-5ce5-4485-b510-5bc2a1313b93 None admin] REQUEST_METHOD: `GET` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:54:02.061540 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8bc42a3-5ce5-4485-b510-5bc2a1313b93 None admin] SCRIPT_NAME: `/identity` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:54:02.061881 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8bc42a3-5ce5-4485-b510-5bc2a1313b93 None admin] PATH_INFO: `/v3/users` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:54:02.067241 dv-cinder-851351-1-smb devstack@keystone.service[352329]: [pid: 352329|app: 0|req: 331/667] 10.222.0.42 () {58 vars in 1282 bytes} [Thu Jul 28 08:54:01 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 369 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 28 08:54:02.067449 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8bc42a3-5ce5-4485-b510-5bc2a1313b93 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=352328) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:54:02.067449 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8bc42a3-5ce5-4485-b510-5bc2a1313b93 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:54:02.067667 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11145598-c7c0-446e-bdf1-1893549ae20f None admin] Authenticating user token {{(pid=352329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:54:02.067766 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8bc42a3-5ce5-4485-b510-5bc2a1313b93 None admin] RBAC: Authorization granted {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:54:02.090545 dv-cinder-851351-1-smb devstack@keystone.service[352328]: [pid: 352328|app: 0|req: 337/668] 10.222.0.42 () {56 vars in 1139 bytes} [Thu Jul 28 08:54:01 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:54:02.091662 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8bc42a3-5ce5-4485-b510-5bc2a1313b93 None admin] Authenticating user token {{(pid=352328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:54:02.177835 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG dbcounter [-] [352329] Writing DB stats keystone:SELECT=100 {{(pid=352329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:54:02.184211 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11145598-c7c0-446e-bdf1-1893549ae20f None admin] Validating token access rules against request {{(pid=352329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:54:02.211868 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8bc42a3-5ce5-4485-b510-5bc2a1313b93 None admin] Validating token access rules against request {{(pid=352328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:54:02.226737 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82ab231-d169-4770-94da-a9a9d6125534 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:54:02.227653 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82ab231-d169-4770-94da-a9a9d6125534 None admin] REQUEST_METHOD: `GET` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:54:02.228049 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82ab231-d169-4770-94da-a9a9d6125534 None admin] SCRIPT_NAME: `/identity` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:54:02.228421 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82ab231-d169-4770-94da-a9a9d6125534 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:54:02.229436 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f82ab231-d169-4770-94da-a9a9d6125534 None admin] RBAC: Adding query filter params (role.id=32da6d9f8d8f48e285530909f7633410, scope.project.id=9cfa053c839a4fedacde7163d907e2a4, user.id=b2c09dcfea224aeb8e846eb810e0e489) {{(pid=352329) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:54:02.229816 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f82ab231-d169-4770-94da-a9a9d6125534 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:54:02.231679 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f82ab231-d169-4770-94da-a9a9d6125534 None admin] RBAC: Authorization granted {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:54:02.238808 dv-cinder-851351-1-smb devstack@keystone.service[352329]: [pid: 352329|app: 0|req: 332/669] 10.222.0.42 () {56 vars in 1374 bytes} [Thu Jul 28 08:54:02 2022] GET /identity/v3/role_assignments?user.id=b2c09dcfea224aeb8e846eb810e0e489&scope.project.id=9cfa053c839a4fedacde7163d907e2a4&role.id=32da6d9f8d8f48e285530909f7633410 => generated 608 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:54:02.239807 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82ab231-d169-4770-94da-a9a9d6125534 None admin] Authenticating user token {{(pid=352329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:54:02.266727 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc75397c-45d1-4506-a890-f4f2141a260e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:54:02.267740 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc75397c-45d1-4506-a890-f4f2141a260e None admin] REQUEST_METHOD: `GET` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:54:02.268225 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc75397c-45d1-4506-a890-f4f2141a260e None admin] SCRIPT_NAME: `/identity` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:54:02.268706 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc75397c-45d1-4506-a890-f4f2141a260e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:54:02.277026 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG dbcounter [-] [352328] Writing DB stats keystone:SELECT=100 {{(pid=352328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:54:02.283737 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc75397c-45d1-4506-a890-f4f2141a260e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:54:02.285736 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc75397c-45d1-4506-a890-f4f2141a260e None admin] RBAC: Authorization granted {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:54:02.303679 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application [None req-dc75397c-45d1-4506-a890-f4f2141a260e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 08:54:02.303679 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:54:02.303679 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:54:02.303679 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:54:02.303679 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:54:02.303679 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:54:02.303679 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:54:02.303679 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:54:02.303679 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:54:02.303679 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:54:02.303679 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:54:02.303679 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:54:02.303679 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 08:54:02.303679 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 08:54:02.303679 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 08:54:02.305122 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 08:54:02.305122 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:54:02.305122 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:54:02.305122 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:54:02.305122 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:54:02.305122 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:54:02.305122 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:54:02.305122 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:54:02.305122 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application with Lock( Jul 28 08:54:02.305122 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:54:02.305122 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:54:02.305122 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:54:02.305122 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:54:02.305122 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:54:02.305122 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:54:02.305122 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:54:02.305122 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:54:02.306447 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 08:54:02.306447 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 08:54:02.306447 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 08:54:02.306447 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application Jul 28 08:54:02.308488 dv-cinder-851351-1-smb devstack@keystone.service[352328]: [pid: 352328|app: 0|req: 338/670] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 08:54:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:54:02.309629 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc75397c-45d1-4506-a890-f4f2141a260e None admin] Authenticating user token {{(pid=352328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:54:02.374484 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82ab231-d169-4770-94da-a9a9d6125534 None admin] Validating token access rules against request {{(pid=352329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:54:02.425012 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc75397c-45d1-4506-a890-f4f2141a260e None admin] Validating token access rules against request {{(pid=352328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:54:02.425540 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499262db-61cb-4295-8ded-a43e3ceefbe4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:54:02.426428 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499262db-61cb-4295-8ded-a43e3ceefbe4 None admin] REQUEST_METHOD: `GET` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:54:02.427215 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499262db-61cb-4295-8ded-a43e3ceefbe4 None admin] SCRIPT_NAME: `/identity` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:54:02.427663 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499262db-61cb-4295-8ded-a43e3ceefbe4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:54:02.443867 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-499262db-61cb-4295-8ded-a43e3ceefbe4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:54:02.446287 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-499262db-61cb-4295-8ded-a43e3ceefbe4 None admin] RBAC: Authorization granted {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:54:02.466633 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application [None req-499262db-61cb-4295-8ded-a43e3ceefbe4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 08:54:02.466633 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:54:02.466633 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:54:02.466633 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:54:02.466633 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:54:02.466633 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:54:02.466633 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:54:02.466633 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:54:02.466633 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:54:02.466633 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:54:02.466633 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:54:02.466633 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:54:02.466633 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 08:54:02.466633 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 08:54:02.466633 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 08:54:02.467999 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 08:54:02.467999 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:54:02.467999 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:54:02.467999 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:54:02.467999 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:54:02.467999 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:54:02.467999 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:54:02.467999 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:54:02.467999 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application with Lock( Jul 28 08:54:02.467999 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:54:02.467999 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:54:02.467999 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:54:02.467999 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:54:02.467999 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:54:02.467999 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:54:02.467999 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:54:02.467999 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:54:02.469337 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 08:54:02.469337 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 08:54:02.469337 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 08:54:02.469337 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application Jul 28 08:54:02.469337 dv-cinder-851351-1-smb devstack@keystone.service[352329]: [pid: 352329|app: 0|req: 333/671] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 08:54:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:54:02.469337 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499262db-61cb-4295-8ded-a43e3ceefbe4 None admin] Authenticating user token {{(pid=352329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:54:02.486336 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a860e9-5143-4baa-a8df-256a7c7a8517 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:54:02.486983 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a860e9-5143-4baa-a8df-256a7c7a8517 None admin] REQUEST_METHOD: `GET` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:54:02.487267 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a860e9-5143-4baa-a8df-256a7c7a8517 None admin] SCRIPT_NAME: `/identity` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:54:02.487541 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a860e9-5143-4baa-a8df-256a7c7a8517 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:54:02.490251 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG dbcounter [-] [352329] Writing DB stats keystone:SELECT=100 {{(pid=352329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:54:02.557685 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG dbcounter [-] [352328] Writing DB stats keystone:SELECT=100 {{(pid=352328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:54:02.570502 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85a860e9-5143-4baa-a8df-256a7c7a8517 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:54:02.572589 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85a860e9-5143-4baa-a8df-256a7c7a8517 None admin] RBAC: Authorization granted {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:54:02.592294 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499262db-61cb-4295-8ded-a43e3ceefbe4 None admin] Validating token access rules against request {{(pid=352329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:54:02.628624 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4114f439-1752-47cb-8a64-d329f9e45ac4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:54:02.629304 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4114f439-1752-47cb-8a64-d329f9e45ac4 None admin] REQUEST_METHOD: `GET` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:54:02.629586 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4114f439-1752-47cb-8a64-d329f9e45ac4 None admin] SCRIPT_NAME: `/identity` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:54:02.629861 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4114f439-1752-47cb-8a64-d329f9e45ac4 None admin] PATH_INFO: `/v3/domains` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:54:02.630568 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4114f439-1752-47cb-8a64-d329f9e45ac4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=352329) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:54:02.630883 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4114f439-1752-47cb-8a64-d329f9e45ac4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:54:02.632279 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4114f439-1752-47cb-8a64-d329f9e45ac4 None admin] RBAC: Authorization granted {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:54:02.645422 dv-cinder-851351-1-smb devstack@keystone.service[352329]: [pid: 352329|app: 0|req: 334/672] 10.222.0.42 () {56 vars in 1109 bytes} [Thu Jul 28 08:54:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:54:02.646357 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4114f439-1752-47cb-8a64-d329f9e45ac4 None admin] Authenticating user token {{(pid=352329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:54:02.686357 dv-cinder-851351-1-smb devstack@keystone.service[352328]: [pid: 352328|app: 0|req: 339/673] 10.222.0.42 () {58 vars in 1282 bytes} [Thu Jul 28 08:54:02 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 377 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 28 08:54:02.687760 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a860e9-5143-4baa-a8df-256a7c7a8517 None admin] Authenticating user token {{(pid=352328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:54:02.722074 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG dbcounter [-] [352329] Writing DB stats keystone:SELECT=100 {{(pid=352329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:54:02.755423 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4114f439-1752-47cb-8a64-d329f9e45ac4 None admin] Validating token access rules against request {{(pid=352329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:54:02.788713 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG dbcounter [-] [352328] Writing DB stats keystone:SELECT=100 {{(pid=352328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:54:02.798876 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac5b46d-ea8f-479c-89c3-b2daba3f75aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:54:02.800023 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a860e9-5143-4baa-a8df-256a7c7a8517 None admin] Validating token access rules against request {{(pid=352328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:54:02.800542 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac5b46d-ea8f-479c-89c3-b2daba3f75aa None admin] REQUEST_METHOD: `GET` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:54:02.801062 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac5b46d-ea8f-479c-89c3-b2daba3f75aa None admin] SCRIPT_NAME: `/identity` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:54:02.801892 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac5b46d-ea8f-479c-89c3-b2daba3f75aa None admin] PATH_INFO: `/v3/domains` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:54:02.803811 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ac5b46d-ea8f-479c-89c3-b2daba3f75aa None admin] RBAC: Adding query filter params (name=Default) {{(pid=352329) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:54:02.804356 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ac5b46d-ea8f-479c-89c3-b2daba3f75aa None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:54:02.806014 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ac5b46d-ea8f-479c-89c3-b2daba3f75aa None admin] RBAC: Authorization granted {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:54:02.822857 dv-cinder-851351-1-smb devstack@keystone.service[352329]: [pid: 352329|app: 0|req: 335/674] 10.222.0.42 () {56 vars in 1109 bytes} [Thu Jul 28 08:54:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:54:02.824508 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac5b46d-ea8f-479c-89c3-b2daba3f75aa None admin] Authenticating user token {{(pid=352329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:54:02.838390 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9108291-44a5-4287-b60b-73998a453160 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:54:02.839053 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9108291-44a5-4287-b60b-73998a453160 None admin] REQUEST_METHOD: `GET` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:54:02.839331 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9108291-44a5-4287-b60b-73998a453160 None admin] SCRIPT_NAME: `/identity` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:54:02.839603 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9108291-44a5-4287-b60b-73998a453160 None admin] PATH_INFO: `/v3/users/swift` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:54:02.848240 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9108291-44a5-4287-b60b-73998a453160 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:54:02.849744 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9108291-44a5-4287-b60b-73998a453160 None admin] RBAC: Authorization granted {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:54:02.864230 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application [None req-c9108291-44a5-4287-b60b-73998a453160 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 28 08:54:02.864230 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:54:02.864230 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:54:02.864230 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:54:02.864230 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:54:02.864230 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:54:02.864230 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:54:02.864230 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:54:02.864230 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:54:02.864230 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:54:02.864230 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:54:02.864230 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:54:02.864230 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 28 08:54:02.864230 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 28 08:54:02.864230 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 28 08:54:02.864230 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 28 08:54:02.865654 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:54:02.865654 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:54:02.865654 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 28 08:54:02.865654 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 08:54:02.865654 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 28 08:54:02.865654 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 08:54:02.865654 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:54:02.865654 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:54:02.865654 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:54:02.865654 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:54:02.865654 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:54:02.865654 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application with Lock( Jul 28 08:54:02.865654 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:54:02.865654 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:54:02.865654 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:54:02.865654 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:54:02.865654 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:54:02.865654 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:54:02.867318 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:54:02.867318 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:54:02.867318 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 28 08:54:02.867318 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 28 08:54:02.867318 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 28 08:54:02.867318 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 28 08:54:02.867318 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 28 08:54:02.867318 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 28 08:54:02.867318 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 28 08:54:02.867318 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application Jul 28 08:54:02.867318 dv-cinder-851351-1-smb devstack@keystone.service[352328]: [pid: 352328|app: 0|req: 340/675] 10.222.0.42 () {56 vars in 1096 bytes} [Thu Jul 28 08:54:02 2022] GET /identity/v3/users/swift => generated 83 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:54:02.867318 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9108291-44a5-4287-b60b-73998a453160 None admin] Authenticating user token {{(pid=352328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:54:02.958290 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac5b46d-ea8f-479c-89c3-b2daba3f75aa None admin] Validating token access rules against request {{(pid=352329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:54:02.974720 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9108291-44a5-4287-b60b-73998a453160 None admin] Validating token access rules against request {{(pid=352328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:54:02.991146 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG dbcounter [-] [352329] Writing DB stats keystone:SELECT=100 {{(pid=352329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:54:02.996987 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1957f9c0-3b02-4c0b-9e27-79fb066dc468 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:54:02.997664 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1957f9c0-3b02-4c0b-9e27-79fb066dc468 None admin] REQUEST_METHOD: `GET` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:54:02.997949 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1957f9c0-3b02-4c0b-9e27-79fb066dc468 None admin] SCRIPT_NAME: `/identity` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:54:02.998244 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1957f9c0-3b02-4c0b-9e27-79fb066dc468 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:54:03.011573 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e85da72c-8168-46b3-9304-8d917991de5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:54:03.012609 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85da72c-8168-46b3-9304-8d917991de5b None admin] REQUEST_METHOD: `GET` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:54:03.013155 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85da72c-8168-46b3-9304-8d917991de5b None admin] SCRIPT_NAME: `/identity` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:54:03.013647 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85da72c-8168-46b3-9304-8d917991de5b None admin] PATH_INFO: `/v3/projects/service` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:54:03.021476 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e85da72c-8168-46b3-9304-8d917991de5b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:54:03.023545 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e85da72c-8168-46b3-9304-8d917991de5b None admin] RBAC: Authorization granted {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:54:03.023680 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1957f9c0-3b02-4c0b-9e27-79fb066dc468 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:54:03.025353 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1957f9c0-3b02-4c0b-9e27-79fb066dc468 None admin] RBAC: Authorization granted {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:54:03.036969 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application [None req-e85da72c-8168-46b3-9304-8d917991de5b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 08:54:03.036969 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:54:03.036969 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:54:03.036969 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:54:03.036969 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:54:03.036969 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:54:03.036969 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:54:03.036969 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:54:03.036969 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:54:03.036969 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:54:03.036969 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:54:03.036969 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:54:03.036969 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 28 08:54:03.036969 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 28 08:54:03.036969 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 28 08:54:03.038233 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 28 08:54:03.038233 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:54:03.038233 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:54:03.038233 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:54:03.038233 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:54:03.038233 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:54:03.038233 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:54:03.038233 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:54:03.038233 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application with Lock( Jul 28 08:54:03.038233 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:54:03.038233 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:54:03.038233 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:54:03.038233 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:54:03.038233 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:54:03.038233 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:54:03.038233 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:54:03.038233 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:54:03.039351 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 28 08:54:03.039351 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 28 08:54:03.039351 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 28 08:54:03.039351 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 28 08:54:03.039351 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 28 08:54:03.039351 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 28 08:54:03.039351 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 08:54:03.039351 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application Jul 28 08:54:03.041723 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application [None req-1957f9c0-3b02-4c0b-9e27-79fb066dc468 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 08:54:03.041723 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:54:03.041723 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:54:03.041723 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:54:03.041723 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:54:03.041723 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:54:03.041723 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:54:03.041723 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:54:03.041723 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:54:03.041723 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:54:03.041723 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:54:03.041723 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:54:03.041723 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 08:54:03.041723 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 08:54:03.041723 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 08:54:03.042782 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 08:54:03.042782 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:54:03.042782 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:54:03.042782 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:54:03.042782 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:54:03.042782 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:54:03.042782 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:54:03.042782 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:54:03.042782 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application with Lock( Jul 28 08:54:03.042782 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:54:03.042782 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:54:03.042782 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:54:03.042782 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:54:03.042782 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:54:03.042782 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:54:03.042782 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:54:03.042782 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:54:03.044317 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 08:54:03.044317 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 08:54:03.044317 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 08:54:03.044317 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application Jul 28 08:54:03.045076 dv-cinder-851351-1-smb devstack@keystone.service[352328]: [pid: 352328|app: 0|req: 341/676] 10.222.0.42 () {56 vars in 1111 bytes} [Thu Jul 28 08:54:02 2022] GET /identity/v3/projects/service => generated 88 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:54:03.046158 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e85da72c-8168-46b3-9304-8d917991de5b None admin] Authenticating user token {{(pid=352328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:54:03.051781 dv-cinder-851351-1-smb devstack@keystone.service[352329]: [pid: 352329|app: 0|req: 336/677] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 08:54:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:54:03.051781 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1957f9c0-3b02-4c0b-9e27-79fb066dc468 None admin] Authenticating user token {{(pid=352329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:54:03.065874 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG dbcounter [-] [352328] Writing DB stats keystone:SELECT=100 {{(pid=352328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:54:03.159293 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e85da72c-8168-46b3-9304-8d917991de5b None admin] Validating token access rules against request {{(pid=352328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:54:03.164447 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1957f9c0-3b02-4c0b-9e27-79fb066dc468 None admin] Validating token access rules against request {{(pid=352329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:54:03.196684 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f59dfb85-bebf-4905-9302-b64e546e88bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:54:03.197348 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59dfb85-bebf-4905-9302-b64e546e88bf None admin] REQUEST_METHOD: `GET` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:54:03.197634 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59dfb85-bebf-4905-9302-b64e546e88bf None admin] SCRIPT_NAME: `/identity` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:54:03.197908 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59dfb85-bebf-4905-9302-b64e546e88bf None admin] PATH_INFO: `/v3/users` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:54:03.198731 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f59dfb85-bebf-4905-9302-b64e546e88bf None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=352328) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:54:03.199029 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f59dfb85-bebf-4905-9302-b64e546e88bf None admin] RBAC: Authorizing `identity:list_users()` {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:54:03.200475 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f59dfb85-bebf-4905-9302-b64e546e88bf None admin] RBAC: Authorization granted {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:54:03.203296 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18040b35-262d-4d99-a8e5-8ef7367978a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:54:03.204004 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18040b35-262d-4d99-a8e5-8ef7367978a6 None admin] REQUEST_METHOD: `GET` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:54:03.204635 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18040b35-262d-4d99-a8e5-8ef7367978a6 None admin] SCRIPT_NAME: `/identity` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:54:03.204941 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18040b35-262d-4d99-a8e5-8ef7367978a6 None admin] PATH_INFO: `/v3/projects` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:54:03.205706 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18040b35-262d-4d99-a8e5-8ef7367978a6 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=352329) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:54:03.206014 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18040b35-262d-4d99-a8e5-8ef7367978a6 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:54:03.207451 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18040b35-262d-4d99-a8e5-8ef7367978a6 None admin] RBAC: Authorization granted {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:54:03.219431 dv-cinder-851351-1-smb devstack@keystone.service[352328]: [pid: 352328|app: 0|req: 342/678] 10.222.0.42 () {56 vars in 1135 bytes} [Thu Jul 28 08:54:03 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:54:03.220358 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f59dfb85-bebf-4905-9302-b64e546e88bf None admin] Authenticating user token {{(pid=352328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:54:03.230703 dv-cinder-851351-1-smb devstack@keystone.service[352329]: [pid: 352329|app: 0|req: 337/679] 10.222.0.42 () {56 vars in 1148 bytes} [Thu Jul 28 08:54:03 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:54:03.230703 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4aa993f-983c-4bff-86d7-b23c552b266a None None] REQUEST_METHOD: `GET` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:54:03.230703 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4aa993f-983c-4bff-86d7-b23c552b266a None None] SCRIPT_NAME: `/identity` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:54:03.230703 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4aa993f-983c-4bff-86d7-b23c552b266a None None] PATH_INFO: `/` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:54:03.232805 dv-cinder-851351-1-smb devstack@keystone.service[352329]: [pid: 352329|app: 0|req: 338/680] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 08:54:03 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 08:54:03.234027 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4aa993f-983c-4bff-86d7-b23c552b266a None None] Authenticating user token {{(pid=352329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:54:03.281715 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG dbcounter [-] [352329] Writing DB stats keystone:SELECT=100 {{(pid=352329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:54:03.294444 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG dbcounter [-] [352328] Writing DB stats keystone:SELECT=100 {{(pid=352328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:54:03.331064 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f59dfb85-bebf-4905-9302-b64e546e88bf None admin] Validating token access rules against request {{(pid=352328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:54:03.342663 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4aa993f-983c-4bff-86d7-b23c552b266a None None] Validating token access rules against request {{(pid=352329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:54:03.373808 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2d3600-74c4-43f9-8538-26a017a6d72b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:54:03.374439 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2d3600-74c4-43f9-8538-26a017a6d72b None admin] REQUEST_METHOD: `GET` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:54:03.374748 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2d3600-74c4-43f9-8538-26a017a6d72b None admin] SCRIPT_NAME: `/identity` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:54:03.374978 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2d3600-74c4-43f9-8538-26a017a6d72b None admin] PATH_INFO: `/v3/domains` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:54:03.375820 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f2d3600-74c4-43f9-8538-26a017a6d72b None admin] RBAC: Adding query filter params (name=Default) {{(pid=352328) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:54:03.376069 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f2d3600-74c4-43f9-8538-26a017a6d72b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:54:03.377575 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f2d3600-74c4-43f9-8538-26a017a6d72b None admin] RBAC: Authorization granted {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:54:03.377907 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3878541f-d00a-4698-90c1-3e297b4f7879 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:54:03.378536 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3878541f-d00a-4698-90c1-3e297b4f7879 None admin] REQUEST_METHOD: `GET` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:54:03.378920 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3878541f-d00a-4698-90c1-3e297b4f7879 None admin] SCRIPT_NAME: `/identity` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:54:03.379042 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3878541f-d00a-4698-90c1-3e297b4f7879 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:54:03.395766 dv-cinder-851351-1-smb devstack@keystone.service[352328]: [pid: 352328|app: 0|req: 343/681] 10.222.0.42 () {56 vars in 1109 bytes} [Thu Jul 28 08:54:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:54:03.395766 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2d3600-74c4-43f9-8538-26a017a6d72b None admin] Authenticating user token {{(pid=352328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:54:03.463615 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3878541f-d00a-4698-90c1-3e297b4f7879 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:54:03.465067 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3878541f-d00a-4698-90c1-3e297b4f7879 None admin] RBAC: Authorization granted {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:54:03.517928 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG dbcounter [-] [352329] Writing DB stats keystone:SELECT=100 {{(pid=352329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:54:03.525869 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2d3600-74c4-43f9-8538-26a017a6d72b None admin] Validating token access rules against request {{(pid=352328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:54:03.556062 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG dbcounter [-] [352328] Writing DB stats keystone:SELECT=100 {{(pid=352328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:54:03.566782 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d66ee7c-2b79-48b6-a7f2-7f54caabbb9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:54:03.567479 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d66ee7c-2b79-48b6-a7f2-7f54caabbb9a None admin] REQUEST_METHOD: `GET` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:54:03.567724 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d66ee7c-2b79-48b6-a7f2-7f54caabbb9a None admin] SCRIPT_NAME: `/identity` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:54:03.567954 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d66ee7c-2b79-48b6-a7f2-7f54caabbb9a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:54:03.568878 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d66ee7c-2b79-48b6-a7f2-7f54caabbb9a None admin] RBAC: Adding query filter params (role.id=32da6d9f8d8f48e285530909f7633410, scope.project.id=9cfa053c839a4fedacde7163d907e2a4, user.id=5ec07578e79545168574fc04cba0a319) {{(pid=352328) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:54:03.569191 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d66ee7c-2b79-48b6-a7f2-7f54caabbb9a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:54:03.570654 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d66ee7c-2b79-48b6-a7f2-7f54caabbb9a None admin] RBAC: Authorization granted {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:54:03.585828 dv-cinder-851351-1-smb devstack@keystone.service[352328]: [pid: 352328|app: 0|req: 344/682] 10.222.0.42 () {56 vars in 1374 bytes} [Thu Jul 28 08:54:03 2022] GET /identity/v3/role_assignments?user.id=5ec07578e79545168574fc04cba0a319&scope.project.id=9cfa053c839a4fedacde7163d907e2a4&role.id=32da6d9f8d8f48e285530909f7633410 => generated 608 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:54:03.585828 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ced074-81fd-40a2-97aa-bb00bd4bbd5e None None] REQUEST_METHOD: `POST` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:54:03.585828 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ced074-81fd-40a2-97aa-bb00bd4bbd5e None None] SCRIPT_NAME: `/identity` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:54:03.585828 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ced074-81fd-40a2-97aa-bb00bd4bbd5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:54:03.599619 dv-cinder-851351-1-smb devstack@keystone.service[352329]: [pid: 352329|app: 0|req: 339/683] 10.222.0.42 () {58 vars in 1282 bytes} [Thu Jul 28 08:54:03 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 366 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 28 08:54:03.600373 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.auth.core [None req-55ced074-81fd-40a2-97aa-bb00bd4bbd5e None None] MFA Rules not processed for user `d18c063b2377412485965357671e5506`. Rule list: `[]` (Enabled: `True`). {{(pid=352328) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 08:54:03.600868 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3878541f-d00a-4698-90c1-3e297b4f7879 None admin] Authenticating user token {{(pid=352329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:54:03.601922 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.fernet_utils [None req-55ced074-81fd-40a2-97aa-bb00bd4bbd5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=352328) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:54:03.693868 dv-cinder-851351-1-smb devstack@keystone.service[352328]: [pid: 352328|app: 0|req: 345/684] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 08:54:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 08:54:03.694791 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ced074-81fd-40a2-97aa-bb00bd4bbd5e None None] Authenticating user token {{(pid=352328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:54:03.738552 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3878541f-d00a-4698-90c1-3e297b4f7879 None admin] Validating token access rules against request {{(pid=352329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:54:03.788746 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb183071-12ff-4051-bffd-8c7f83902f58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:54:03.789424 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb183071-12ff-4051-bffd-8c7f83902f58 None admin] REQUEST_METHOD: `GET` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:54:03.789706 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb183071-12ff-4051-bffd-8c7f83902f58 None admin] SCRIPT_NAME: `/identity` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:54:03.791316 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb183071-12ff-4051-bffd-8c7f83902f58 None admin] PATH_INFO: `/v3/projects/service` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:54:03.802296 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb183071-12ff-4051-bffd-8c7f83902f58 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:54:03.804177 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb183071-12ff-4051-bffd-8c7f83902f58 None admin] RBAC: Authorization granted {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:54:03.822252 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application [None req-cb183071-12ff-4051-bffd-8c7f83902f58 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 08:54:03.822252 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:54:03.822252 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:54:03.822252 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:54:03.822252 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:54:03.822252 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:54:03.822252 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:54:03.822252 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:54:03.822252 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:54:03.822252 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:54:03.822252 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:54:03.822252 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:54:03.822252 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 28 08:54:03.822252 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 28 08:54:03.822252 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 28 08:54:03.823452 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 28 08:54:03.823452 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:54:03.823452 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:54:03.823452 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:54:03.823452 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:54:03.823452 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:54:03.823452 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:54:03.823452 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:54:03.823452 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application with Lock( Jul 28 08:54:03.823452 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:54:03.823452 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:54:03.823452 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:54:03.823452 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:54:03.823452 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:54:03.823452 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:54:03.823452 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:54:03.823452 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:54:03.824564 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 28 08:54:03.824564 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 28 08:54:03.824564 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 28 08:54:03.824564 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 28 08:54:03.824564 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 28 08:54:03.824564 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 28 08:54:03.824564 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 08:54:03.824564 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application Jul 28 08:54:03.824564 dv-cinder-851351-1-smb devstack@keystone.service[352329]: [pid: 352329|app: 0|req: 340/685] 10.222.0.42 () {56 vars in 1111 bytes} [Thu Jul 28 08:54:03 2022] GET /identity/v3/projects/service => generated 88 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:54:03.829763 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb183071-12ff-4051-bffd-8c7f83902f58 None admin] Authenticating user token {{(pid=352329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:54:03.830630 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG dbcounter [-] [352329] Writing DB stats keystone:SELECT=100 {{(pid=352329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:54:03.863780 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ced074-81fd-40a2-97aa-bb00bd4bbd5e None None] Validating token access rules against request {{(pid=352328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:54:03.902423 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG dbcounter [-] [352328] Writing DB stats keystone:SELECT=100 {{(pid=352328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:54:03.918041 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1119b318-17be-4b51-8b29-21eaba9c884c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:54:03.918866 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1119b318-17be-4b51-8b29-21eaba9c884c None admin] REQUEST_METHOD: `GET` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:54:03.919147 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1119b318-17be-4b51-8b29-21eaba9c884c None admin] SCRIPT_NAME: `/identity` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:54:03.919421 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1119b318-17be-4b51-8b29-21eaba9c884c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:54:03.931859 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1119b318-17be-4b51-8b29-21eaba9c884c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:54:03.933519 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1119b318-17be-4b51-8b29-21eaba9c884c None admin] RBAC: Authorization granted {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:54:03.950465 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application [None req-1119b318-17be-4b51-8b29-21eaba9c884c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 08:54:03.950465 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:54:03.950465 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:54:03.950465 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:54:03.950465 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:54:03.950465 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:54:03.950465 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:54:03.950465 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:54:03.950465 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:54:03.950465 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:54:03.950465 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:54:03.950465 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:54:03.950465 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 08:54:03.950465 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 08:54:03.950465 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 08:54:03.951662 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 08:54:03.951662 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:54:03.951662 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:54:03.951662 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:54:03.951662 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:54:03.951662 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:54:03.951662 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:54:03.951662 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:54:03.951662 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application with Lock( Jul 28 08:54:03.951662 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:54:03.951662 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:54:03.951662 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:54:03.951662 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:54:03.951662 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:54:03.951662 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:54:03.951662 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:54:03.951662 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:54:03.952869 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 08:54:03.952869 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 08:54:03.952869 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 08:54:03.952869 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application Jul 28 08:54:03.952869 dv-cinder-851351-1-smb devstack@keystone.service[352328]: [pid: 352328|app: 0|req: 346/686] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 08:54:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 257 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:54:03.953225 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1119b318-17be-4b51-8b29-21eaba9c884c None admin] Authenticating user token {{(pid=352328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:54:03.963869 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb183071-12ff-4051-bffd-8c7f83902f58 None admin] Validating token access rules against request {{(pid=352329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:54:04.023390 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02cfc472-156d-4345-8377-d315e10a4be9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:54:04.024572 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02cfc472-156d-4345-8377-d315e10a4be9 None admin] REQUEST_METHOD: `GET` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:54:04.025116 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02cfc472-156d-4345-8377-d315e10a4be9 None admin] SCRIPT_NAME: `/identity` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:54:04.025933 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02cfc472-156d-4345-8377-d315e10a4be9 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:54:04.041563 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02cfc472-156d-4345-8377-d315e10a4be9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 08:54:04.048458 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application [None req-02cfc472-156d-4345-8377-d315e10a4be9 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 08:54:04.048458 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:54:04.048458 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:54:04.048458 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:54:04.048458 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:54:04.048458 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:54:04.048458 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:54:04.048458 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:54:04.048458 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:54:04.048458 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:54:04.048458 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:54:04.048458 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:54:04.048458 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 08:54:04.048458 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 08:54:04.048458 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 08:54:04.048458 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 08:54:04.049726 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 08:54:04.049726 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 08:54:04.049726 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 08:54:04.049726 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 08:54:04.049726 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:54:04.049726 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:54:04.049726 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:54:04.049726 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:54:04.049726 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:54:04.049726 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:54:04.049726 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:54:04.049726 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application with Lock( Jul 28 08:54:04.049726 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:54:04.049726 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:54:04.049726 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:54:04.049726 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:54:04.050797 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:54:04.050797 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:54:04.050797 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:54:04.050797 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:54:04.050797 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 08:54:04.050797 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 08:54:04.050797 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 08:54:04.050797 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 08:54:04.050797 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 08:54:04.050797 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 08:54:04.050797 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 08:54:04.050797 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application Jul 28 08:54:04.059167 dv-cinder-851351-1-smb devstack@keystone.service[352329]: [pid: 352329|app: 0|req: 341/687] 10.222.0.42 () {56 vars in 1096 bytes} [Thu Jul 28 08:54:03 2022] GET /identity/v3/roles/admin => generated 83 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:54:04.059167 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02cfc472-156d-4345-8377-d315e10a4be9 None admin] Authenticating user token {{(pid=352329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:54:04.089473 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1119b318-17be-4b51-8b29-21eaba9c884c None admin] Validating token access rules against request {{(pid=352328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:54:04.123407 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG dbcounter [-] [352329] Writing DB stats keystone:SELECT=100 {{(pid=352329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:54:04.137950 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e44f4d14-465e-469e-9002-df68e8bd644a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:54:04.138729 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44f4d14-465e-469e-9002-df68e8bd644a None admin] REQUEST_METHOD: `GET` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:54:04.139116 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44f4d14-465e-469e-9002-df68e8bd644a None admin] SCRIPT_NAME: `/identity` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:54:04.139494 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44f4d14-465e-469e-9002-df68e8bd644a None admin] PATH_INFO: `/v3/projects` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:54:04.140370 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e44f4d14-465e-469e-9002-df68e8bd644a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=352328) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:54:04.141319 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e44f4d14-465e-469e-9002-df68e8bd644a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:54:04.142908 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e44f4d14-465e-469e-9002-df68e8bd644a None admin] RBAC: Authorization granted {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:54:04.160765 dv-cinder-851351-1-smb devstack@keystone.service[352328]: [pid: 352328|app: 0|req: 347/688] 10.222.0.42 () {56 vars in 1148 bytes} [Thu Jul 28 08:54:03 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:54:04.161951 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e44f4d14-465e-469e-9002-df68e8bd644a None admin] Authenticating user token {{(pid=352328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:54:04.173405 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02cfc472-156d-4345-8377-d315e10a4be9 None admin] Validating token access rules against request {{(pid=352329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:54:04.210799 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b12eaf-7cfb-41ed-97b0-11e7c9291467 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:54:04.211756 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b12eaf-7cfb-41ed-97b0-11e7c9291467 None admin] REQUEST_METHOD: `GET` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:54:04.212201 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b12eaf-7cfb-41ed-97b0-11e7c9291467 None admin] SCRIPT_NAME: `/identity` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:54:04.212653 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b12eaf-7cfb-41ed-97b0-11e7c9291467 None admin] PATH_INFO: `/v3/domains` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:54:04.213516 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG dbcounter [-] [352328] Writing DB stats keystone:SELECT=100 {{(pid=352328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:54:04.213736 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77b12eaf-7cfb-41ed-97b0-11e7c9291467 None admin] RBAC: Adding query filter params (name=Default) {{(pid=352329) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:54:04.214862 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77b12eaf-7cfb-41ed-97b0-11e7c9291467 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:54:04.216702 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77b12eaf-7cfb-41ed-97b0-11e7c9291467 None admin] RBAC: Authorization granted {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:54:04.230341 dv-cinder-851351-1-smb devstack@keystone.service[352329]: [pid: 352329|app: 0|req: 342/689] 10.222.0.42 () {56 vars in 1109 bytes} [Thu Jul 28 08:54:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:54:04.231655 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b12eaf-7cfb-41ed-97b0-11e7c9291467 None admin] Authenticating user token {{(pid=352329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:54:04.306804 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e44f4d14-465e-469e-9002-df68e8bd644a None admin] Validating token access rules against request {{(pid=352328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:54:04.345045 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b12eaf-7cfb-41ed-97b0-11e7c9291467 None admin] Validating token access rules against request {{(pid=352329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:54:04.354351 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a3b004-4197-467a-9966-2806575386f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:54:04.355000 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a3b004-4197-467a-9966-2806575386f4 None admin] REQUEST_METHOD: `GET` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:54:04.355283 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a3b004-4197-467a-9966-2806575386f4 None admin] SCRIPT_NAME: `/identity` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:54:04.355557 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a3b004-4197-467a-9966-2806575386f4 None admin] PATH_INFO: `/v3/roles` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:54:04.356300 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00a3b004-4197-467a-9966-2806575386f4 None admin] RBAC: Adding query filter params (name=admin) {{(pid=352328) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:54:04.356610 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00a3b004-4197-467a-9966-2806575386f4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:54:04.358519 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00a3b004-4197-467a-9966-2806575386f4 None admin] RBAC: Authorization granted {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:54:04.372845 dv-cinder-851351-1-smb devstack@keystone.service[352328]: [pid: 352328|app: 0|req: 348/690] 10.222.0.42 () {56 vars in 1099 bytes} [Thu Jul 28 08:54:04 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:54:04.374211 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a3b004-4197-467a-9966-2806575386f4 None admin] Authenticating user token {{(pid=352328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:54:04.380972 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG dbcounter [-] [352329] Writing DB stats keystone:SELECT=100 {{(pid=352329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:54:04.396080 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a372c91f-9ba7-473b-ae9d-44330deb8f13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:54:04.396889 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a372c91f-9ba7-473b-ae9d-44330deb8f13 None admin] REQUEST_METHOD: `GET` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:54:04.397179 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a372c91f-9ba7-473b-ae9d-44330deb8f13 None admin] SCRIPT_NAME: `/identity` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:54:04.397466 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a372c91f-9ba7-473b-ae9d-44330deb8f13 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:54:04.398558 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a372c91f-9ba7-473b-ae9d-44330deb8f13 None admin] RBAC: Adding query filter params (role.id=32da6d9f8d8f48e285530909f7633410, scope.project.id=9cfa053c839a4fedacde7163d907e2a4, user.id=129f505b6d004c8a949020bd2113e32d) {{(pid=352329) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:54:04.398876 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a372c91f-9ba7-473b-ae9d-44330deb8f13 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:54:04.400808 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a372c91f-9ba7-473b-ae9d-44330deb8f13 None admin] RBAC: Authorization granted {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:54:04.412835 dv-cinder-851351-1-smb devstack@keystone.service[352329]: [pid: 352329|app: 0|req: 343/691] 10.222.0.42 () {56 vars in 1374 bytes} [Thu Jul 28 08:54:04 2022] GET /identity/v3/role_assignments?user.id=129f505b6d004c8a949020bd2113e32d&scope.project.id=9cfa053c839a4fedacde7163d907e2a4&role.id=32da6d9f8d8f48e285530909f7633410 => generated 608 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:54:04.414185 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a372c91f-9ba7-473b-ae9d-44330deb8f13 None admin] Authenticating user token {{(pid=352329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:54:04.504919 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG dbcounter [-] [352328] Writing DB stats keystone:SELECT=100 {{(pid=352328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:54:04.513980 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a3b004-4197-467a-9966-2806575386f4 None admin] Validating token access rules against request {{(pid=352328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:54:04.553320 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675a5ce3-5485-429b-a053-7178f11bc22b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:54:04.554443 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675a5ce3-5485-429b-a053-7178f11bc22b None admin] REQUEST_METHOD: `GET` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:54:04.555003 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675a5ce3-5485-429b-a053-7178f11bc22b None admin] SCRIPT_NAME: `/identity` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:54:04.555507 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675a5ce3-5485-429b-a053-7178f11bc22b None admin] PATH_INFO: `/v3/projects/service` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:54:04.562083 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a372c91f-9ba7-473b-ae9d-44330deb8f13 None admin] Validating token access rules against request {{(pid=352329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:54:04.564313 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-675a5ce3-5485-429b-a053-7178f11bc22b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:54:04.566242 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-675a5ce3-5485-429b-a053-7178f11bc22b None admin] RBAC: Authorization granted {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:54:04.580447 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application [None req-675a5ce3-5485-429b-a053-7178f11bc22b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 08:54:04.580447 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:54:04.580447 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:54:04.580447 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:54:04.580447 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:54:04.580447 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:54:04.580447 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:54:04.580447 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:54:04.580447 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:54:04.580447 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:54:04.580447 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:54:04.580447 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:54:04.580447 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 28 08:54:04.580447 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 28 08:54:04.580447 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 28 08:54:04.582199 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 28 08:54:04.582199 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:54:04.582199 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:54:04.582199 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:54:04.582199 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:54:04.582199 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:54:04.582199 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:54:04.582199 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:54:04.582199 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application with Lock( Jul 28 08:54:04.582199 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:54:04.582199 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:54:04.582199 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:54:04.582199 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:54:04.582199 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:54:04.582199 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:54:04.582199 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:54:04.582199 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:54:04.592442 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 28 08:54:04.592442 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 28 08:54:04.592442 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 28 08:54:04.592442 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 28 08:54:04.592442 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 28 08:54:04.592442 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 28 08:54:04.592442 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 08:54:04.592442 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application Jul 28 08:54:04.592442 dv-cinder-851351-1-smb devstack@keystone.service[352328]: [pid: 352328|app: 0|req: 349/692] 10.222.0.42 () {56 vars in 1111 bytes} [Thu Jul 28 08:54:04 2022] GET /identity/v3/projects/service => generated 88 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:54:04.592442 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e5774f-66f8-4ef0-b4bb-881672bf1dc1 None None] REQUEST_METHOD: `GET` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:54:04.592442 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e5774f-66f8-4ef0-b4bb-881672bf1dc1 None None] SCRIPT_NAME: `/identity` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:54:04.593327 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e5774f-66f8-4ef0-b4bb-881672bf1dc1 None None] PATH_INFO: `/` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:54:04.593327 dv-cinder-851351-1-smb devstack@keystone.service[352328]: [pid: 352328|app: 0|req: 350/693] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 08:54:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 08:54:04.593327 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e5774f-66f8-4ef0-b4bb-881672bf1dc1 None None] Authenticating user token {{(pid=352328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:54:04.619968 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87724c06-7101-4e2e-a8a2-474807861f89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:54:04.621154 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87724c06-7101-4e2e-a8a2-474807861f89 None admin] REQUEST_METHOD: `GET` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:54:04.621446 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87724c06-7101-4e2e-a8a2-474807861f89 None admin] SCRIPT_NAME: `/identity` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:54:04.621729 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87724c06-7101-4e2e-a8a2-474807861f89 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:54:04.635608 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87724c06-7101-4e2e-a8a2-474807861f89 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:54:04.637396 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87724c06-7101-4e2e-a8a2-474807861f89 None admin] RBAC: Authorization granted {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:54:04.655286 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application [None req-87724c06-7101-4e2e-a8a2-474807861f89 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 08:54:04.655286 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:54:04.655286 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:54:04.655286 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:54:04.655286 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:54:04.655286 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:54:04.655286 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:54:04.655286 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:54:04.655286 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:54:04.655286 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:54:04.655286 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:54:04.655286 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:54:04.655286 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 08:54:04.655286 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 08:54:04.655286 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 08:54:04.656460 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 08:54:04.656460 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:54:04.656460 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:54:04.656460 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:54:04.656460 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:54:04.656460 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:54:04.656460 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:54:04.656460 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:54:04.656460 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application with Lock( Jul 28 08:54:04.656460 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:54:04.656460 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:54:04.656460 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:54:04.656460 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:54:04.656460 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:54:04.656460 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:54:04.656460 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:54:04.656460 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:54:04.659367 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 08:54:04.659367 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 08:54:04.659367 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 08:54:04.659367 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application Jul 28 08:54:04.659367 dv-cinder-851351-1-smb devstack@keystone.service[352329]: [pid: 352329|app: 0|req: 344/694] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 08:54:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 245 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:54:04.664800 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8413f83-17b0-4820-bea3-49055e8cf802 None None] REQUEST_METHOD: `POST` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:54:04.664800 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8413f83-17b0-4820-bea3-49055e8cf802 None None] SCRIPT_NAME: `/identity` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:54:04.664800 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8413f83-17b0-4820-bea3-49055e8cf802 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:54:04.683560 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.auth.core [None req-a8413f83-17b0-4820-bea3-49055e8cf802 None None] MFA Rules not processed for user `d18c063b2377412485965357671e5506`. Rule list: `[]` (Enabled: `True`). {{(pid=352329) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 08:54:04.684809 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.fernet_utils [None req-a8413f83-17b0-4820-bea3-49055e8cf802 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=352329) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:54:04.722487 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG dbcounter [-] [352329] Writing DB stats keystone:SELECT=100 {{(pid=352329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:54:04.741796 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e5774f-66f8-4ef0-b4bb-881672bf1dc1 None None] Validating token access rules against request {{(pid=352328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:54:04.761243 dv-cinder-851351-1-smb devstack@keystone.service[352329]: [pid: 352329|app: 0|req: 345/695] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 08:54:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 08:54:04.762189 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8413f83-17b0-4820-bea3-49055e8cf802 None None] Authenticating user token {{(pid=352329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:54:04.791414 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c223e0-0d5e-4f73-89a1-57f95ccd03f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:54:04.793001 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c223e0-0d5e-4f73-89a1-57f95ccd03f0 None admin] REQUEST_METHOD: `GET` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:54:04.793481 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c223e0-0d5e-4f73-89a1-57f95ccd03f0 None admin] SCRIPT_NAME: `/identity` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:54:04.793937 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c223e0-0d5e-4f73-89a1-57f95ccd03f0 None admin] PATH_INFO: `/v3/projects` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:54:04.795559 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84c223e0-0d5e-4f73-89a1-57f95ccd03f0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=352328) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:54:04.796190 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84c223e0-0d5e-4f73-89a1-57f95ccd03f0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:54:04.798131 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84c223e0-0d5e-4f73-89a1-57f95ccd03f0 None admin] RBAC: Authorization granted {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:54:04.816110 dv-cinder-851351-1-smb devstack@keystone.service[352328]: [pid: 352328|app: 0|req: 351/696] 10.222.0.42 () {56 vars in 1148 bytes} [Thu Jul 28 08:54:04 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:54:04.817309 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c223e0-0d5e-4f73-89a1-57f95ccd03f0 None admin] Authenticating user token {{(pid=352328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:54:04.842296 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG dbcounter [-] [352328] Writing DB stats keystone:SELECT=100 {{(pid=352328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:54:04.891374 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8413f83-17b0-4820-bea3-49055e8cf802 None None] Validating token access rules against request {{(pid=352329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:54:04.936854 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c223e0-0d5e-4f73-89a1-57f95ccd03f0 None admin] Validating token access rules against request {{(pid=352328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:54:04.942282 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c39f87-d154-41c2-88e6-2080f86ba33f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:54:04.943193 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c39f87-d154-41c2-88e6-2080f86ba33f None admin] REQUEST_METHOD: `GET` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:54:04.943666 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c39f87-d154-41c2-88e6-2080f86ba33f None admin] SCRIPT_NAME: `/identity` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:54:04.944119 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c39f87-d154-41c2-88e6-2080f86ba33f None admin] PATH_INFO: `/v3/domains` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:54:04.945607 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7c39f87-d154-41c2-88e6-2080f86ba33f None admin] RBAC: Adding query filter params (name=Default) {{(pid=352329) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:54:04.946117 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7c39f87-d154-41c2-88e6-2080f86ba33f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:54:04.948207 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7c39f87-d154-41c2-88e6-2080f86ba33f None admin] RBAC: Authorization granted {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:54:04.965952 dv-cinder-851351-1-smb devstack@keystone.service[352329]: [pid: 352329|app: 0|req: 346/697] 10.222.0.42 () {56 vars in 1109 bytes} [Thu Jul 28 08:54:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:54:04.967854 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c39f87-d154-41c2-88e6-2080f86ba33f None admin] Authenticating user token {{(pid=352329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:54:04.975548 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4436ed85-6b67-4978-a162-2b0ce3865cbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:54:04.976221 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4436ed85-6b67-4978-a162-2b0ce3865cbc None admin] REQUEST_METHOD: `GET` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:54:04.976508 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4436ed85-6b67-4978-a162-2b0ce3865cbc None admin] SCRIPT_NAME: `/identity` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:54:04.976854 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4436ed85-6b67-4978-a162-2b0ce3865cbc None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:54:04.977506 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4436ed85-6b67-4978-a162-2b0ce3865cbc None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:54:04.978952 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4436ed85-6b67-4978-a162-2b0ce3865cbc None admin] RBAC: Authorization granted {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:54:04.990856 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application [None req-4436ed85-6b67-4978-a162-2b0ce3865cbc None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 28 08:54:04.990856 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:54:04.990856 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 28 08:54:04.990856 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 28 08:54:04.990856 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 28 08:54:04.990856 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 28 08:54:04.990856 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 28 08:54:04.990856 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 08:54:04.990856 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 28 08:54:04.990856 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application Jul 28 08:54:04.990856 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 28 08:54:04.990856 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application Jul 28 08:54:04.990856 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:54:04.990856 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:54:04.990856 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:54:04.990856 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:54:04.992357 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:54:04.992357 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:54:04.992357 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:54:04.992357 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:54:04.992357 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:54:04.992357 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:54:04.992357 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:54:04.992357 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 28 08:54:04.992357 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 28 08:54:04.992357 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 28 08:54:04.992357 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 28 08:54:04.992357 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:54:04.992357 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:54:04.992357 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:54:04.992357 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:54:04.992357 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:54:04.993656 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:54:04.993656 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:54:04.993656 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application with Lock( Jul 28 08:54:04.993656 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:54:04.993656 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:54:04.993656 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:54:04.993656 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:54:04.993656 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:54:04.993656 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:54:04.993656 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:54:04.993656 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:54:04.993656 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 28 08:54:04.993656 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 08:54:04.993656 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 28 08:54:04.993656 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application Jul 28 08:54:04.993656 dv-cinder-851351-1-smb devstack@keystone.service[352328]: [pid: 352328|app: 0|req: 352/698] 10.222.0.42 () {56 vars in 1129 bytes} [Thu Jul 28 08:54:04 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:54:04.994753 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4436ed85-6b67-4978-a162-2b0ce3865cbc None admin] Authenticating user token {{(pid=352328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:54:05.019087 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG dbcounter [-] [352329] Writing DB stats keystone:SELECT=100 {{(pid=352329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:54:05.098840 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG dbcounter [-] [352328] Writing DB stats keystone:SELECT=100 {{(pid=352328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:54:05.109144 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c39f87-d154-41c2-88e6-2080f86ba33f None admin] Validating token access rules against request {{(pid=352329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:54:05.126118 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4436ed85-6b67-4978-a162-2b0ce3865cbc None admin] Validating token access rules against request {{(pid=352328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:54:05.151154 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f7d1d5-239c-44ee-b2b0-95455b214bf2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:54:05.152058 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f7d1d5-239c-44ee-b2b0-95455b214bf2 None admin] REQUEST_METHOD: `GET` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:54:05.152527 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f7d1d5-239c-44ee-b2b0-95455b214bf2 None admin] SCRIPT_NAME: `/identity` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:54:05.153047 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f7d1d5-239c-44ee-b2b0-95455b214bf2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:54:05.154016 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6f7d1d5-239c-44ee-b2b0-95455b214bf2 None admin] RBAC: Adding query filter params (role.id=32da6d9f8d8f48e285530909f7633410, scope.project.id=9cfa053c839a4fedacde7163d907e2a4, user.id=456c30f8918e4aef8a8e2d65f1f0faf7) {{(pid=352329) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:54:05.154581 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6f7d1d5-239c-44ee-b2b0-95455b214bf2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:54:05.156260 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6f7d1d5-239c-44ee-b2b0-95455b214bf2 None admin] RBAC: Authorization granted {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:54:05.163325 dv-cinder-851351-1-smb devstack@keystone.service[352329]: [pid: 352329|app: 0|req: 347/699] 10.222.0.42 () {56 vars in 1374 bytes} [Thu Jul 28 08:54:04 2022] GET /identity/v3/role_assignments?user.id=456c30f8918e4aef8a8e2d65f1f0faf7&scope.project.id=9cfa053c839a4fedacde7163d907e2a4&role.id=32da6d9f8d8f48e285530909f7633410 => generated 608 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:54:05.164544 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f7d1d5-239c-44ee-b2b0-95455b214bf2 None admin] Authenticating user token {{(pid=352329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:54:05.171063 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f19c0900-4a47-48e3-ac1d-ca0f4754ec09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:54:05.171756 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19c0900-4a47-48e3-ac1d-ca0f4754ec09 None admin] REQUEST_METHOD: `GET` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:54:05.172046 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19c0900-4a47-48e3-ac1d-ca0f4754ec09 None admin] SCRIPT_NAME: `/identity` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:54:05.172325 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19c0900-4a47-48e3-ac1d-ca0f4754ec09 None admin] PATH_INFO: `/v3/users/nova` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:54:05.183805 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f19c0900-4a47-48e3-ac1d-ca0f4754ec09 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:54:05.185436 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f19c0900-4a47-48e3-ac1d-ca0f4754ec09 None admin] RBAC: Authorization granted {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:54:05.205309 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application [None req-f19c0900-4a47-48e3-ac1d-ca0f4754ec09 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 28 08:54:05.205309 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:54:05.205309 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:54:05.205309 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:54:05.205309 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:54:05.205309 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:54:05.205309 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:54:05.205309 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:54:05.205309 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:54:05.205309 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:54:05.205309 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:54:05.205309 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:54:05.205309 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 28 08:54:05.205309 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 28 08:54:05.205309 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 28 08:54:05.205309 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 28 08:54:05.206605 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:54:05.206605 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:54:05.206605 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 28 08:54:05.206605 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 08:54:05.206605 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 28 08:54:05.206605 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 08:54:05.206605 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:54:05.206605 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:54:05.206605 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:54:05.206605 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:54:05.206605 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:54:05.206605 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application with Lock( Jul 28 08:54:05.206605 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:54:05.206605 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:54:05.206605 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:54:05.206605 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:54:05.206605 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:54:05.206605 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:54:05.207789 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:54:05.207789 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:54:05.207789 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 28 08:54:05.207789 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 28 08:54:05.207789 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 28 08:54:05.207789 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 28 08:54:05.207789 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 28 08:54:05.207789 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 28 08:54:05.207789 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 28 08:54:05.207789 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application Jul 28 08:54:05.210656 dv-cinder-851351-1-smb devstack@keystone.service[352328]: [pid: 352328|app: 0|req: 353/700] 10.222.0.42 () {56 vars in 1093 bytes} [Thu Jul 28 08:54:04 2022] GET /identity/v3/users/nova => generated 82 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:54:05.218091 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f19c0900-4a47-48e3-ac1d-ca0f4754ec09 None admin] Authenticating user token {{(pid=352328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:54:05.290467 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG dbcounter [-] [352329] Writing DB stats keystone:SELECT=100 {{(pid=352329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:54:05.299615 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f7d1d5-239c-44ee-b2b0-95455b214bf2 None admin] Validating token access rules against request {{(pid=352329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:54:05.339531 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c4942ed-40e9-4f1e-a716-9dd495cebc92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:54:05.340617 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4942ed-40e9-4f1e-a716-9dd495cebc92 None admin] REQUEST_METHOD: `GET` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:54:05.341173 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4942ed-40e9-4f1e-a716-9dd495cebc92 None admin] SCRIPT_NAME: `/identity` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:54:05.341746 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4942ed-40e9-4f1e-a716-9dd495cebc92 None admin] PATH_INFO: `/v3/services` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:54:05.342717 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c4942ed-40e9-4f1e-a716-9dd495cebc92 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=352329) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:54:05.343245 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c4942ed-40e9-4f1e-a716-9dd495cebc92 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:54:05.344982 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c4942ed-40e9-4f1e-a716-9dd495cebc92 None admin] RBAC: Authorization granted {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:54:05.350943 dv-cinder-851351-1-smb devstack@keystone.service[352329]: [pid: 352329|app: 0|req: 348/701] 10.222.0.42 () {56 vars in 1124 bytes} [Thu Jul 28 08:54:05 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:54:05.356172 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c4942ed-40e9-4f1e-a716-9dd495cebc92 None admin] Authenticating user token {{(pid=352329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:54:05.431083 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f19c0900-4a47-48e3-ac1d-ca0f4754ec09 None admin] Validating token access rules against request {{(pid=352328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:54:05.471080 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e56b799d-444f-4f8d-8761-614e343e1756 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:54:05.471735 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56b799d-444f-4f8d-8761-614e343e1756 None admin] REQUEST_METHOD: `GET` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:54:05.472008 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56b799d-444f-4f8d-8761-614e343e1756 None admin] SCRIPT_NAME: `/identity` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:54:05.472283 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56b799d-444f-4f8d-8761-614e343e1756 None admin] PATH_INFO: `/v3/users` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:54:05.473584 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e56b799d-444f-4f8d-8761-614e343e1756 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=352328) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:54:05.473892 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e56b799d-444f-4f8d-8761-614e343e1756 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:54:05.475656 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e56b799d-444f-4f8d-8761-614e343e1756 None admin] RBAC: Authorization granted {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:54:05.476742 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c4942ed-40e9-4f1e-a716-9dd495cebc92 None admin] Validating token access rules against request {{(pid=352329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:54:05.489136 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG dbcounter [-] [352328] Writing DB stats keystone:SELECT=100 {{(pid=352328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:54:05.500472 dv-cinder-851351-1-smb devstack@keystone.service[352328]: [pid: 352328|app: 0|req: 354/702] 10.222.0.42 () {56 vars in 1133 bytes} [Thu Jul 28 08:54:05 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 283 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:54:05.506102 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e56b799d-444f-4f8d-8761-614e343e1756 None admin] Authenticating user token {{(pid=352328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:54:05.529742 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50350631-8c96-4287-9fc5-6f8f588e6c5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:54:05.531184 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50350631-8c96-4287-9fc5-6f8f588e6c5e None admin] REQUEST_METHOD: `GET` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:54:05.531707 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50350631-8c96-4287-9fc5-6f8f588e6c5e None admin] SCRIPT_NAME: `/identity` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:54:05.532284 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50350631-8c96-4287-9fc5-6f8f588e6c5e None admin] PATH_INFO: `/v3/services` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:54:05.533232 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50350631-8c96-4287-9fc5-6f8f588e6c5e None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=352329) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:54:05.533760 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50350631-8c96-4287-9fc5-6f8f588e6c5e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:54:05.536282 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50350631-8c96-4287-9fc5-6f8f588e6c5e None admin] RBAC: Authorization granted {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:54:05.546617 dv-cinder-851351-1-smb devstack@keystone.service[352329]: [pid: 352329|app: 0|req: 349/703] 10.222.0.42 () {56 vars in 1124 bytes} [Thu Jul 28 08:54:05 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:54:05.643824 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e56b799d-444f-4f8d-8761-614e343e1756 None admin] Validating token access rules against request {{(pid=352328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:54:05.684276 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d966a0-f279-4aca-a3db-2e0cc17c6824 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:54:05.685377 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d966a0-f279-4aca-a3db-2e0cc17c6824 None admin] REQUEST_METHOD: `GET` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:54:05.685883 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d966a0-f279-4aca-a3db-2e0cc17c6824 None admin] SCRIPT_NAME: `/identity` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:54:05.686481 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d966a0-f279-4aca-a3db-2e0cc17c6824 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:54:05.767158 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG dbcounter [-] [352328] Writing DB stats keystone:SELECT=100 {{(pid=352328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:54:05.772120 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97d966a0-f279-4aca-a3db-2e0cc17c6824 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:54:05.773841 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97d966a0-f279-4aca-a3db-2e0cc17c6824 None admin] RBAC: Authorization granted {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:54:05.898537 dv-cinder-851351-1-smb devstack@keystone.service[352328]: [pid: 352328|app: 0|req: 355/704] 10.222.0.42 () {58 vars in 1282 bytes} [Thu Jul 28 08:54:05 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 393 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 28 08:54:05.905151 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50350631-8c96-4287-9fc5-6f8f588e6c5e None admin] Authenticating user token {{(pid=352329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:54:05.911749 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d938c8e7-3f6d-4a87-994d-15b13aef364c None None] REQUEST_METHOD: `GET` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:54:05.912392 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d938c8e7-3f6d-4a87-994d-15b13aef364c None None] SCRIPT_NAME: `/identity` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:54:05.912771 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d938c8e7-3f6d-4a87-994d-15b13aef364c None None] PATH_INFO: `/` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:54:05.914607 dv-cinder-851351-1-smb devstack@keystone.service[352328]: [pid: 352328|app: 0|req: 356/705] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 08:54:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 08:54:05.924937 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ede0a3-fc82-463e-9c60-127cf64cf493 None None] REQUEST_METHOD: `POST` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:54:05.925296 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ede0a3-fc82-463e-9c60-127cf64cf493 None None] SCRIPT_NAME: `/identity` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:54:05.925556 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ede0a3-fc82-463e-9c60-127cf64cf493 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:54:05.944273 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG dbcounter [-] [352329] Writing DB stats keystone:SELECT=100 {{(pid=352329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:54:05.957735 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.auth.core [None req-82ede0a3-fc82-463e-9c60-127cf64cf493 None None] MFA Rules not processed for user `d18c063b2377412485965357671e5506`. Rule list: `[]` (Enabled: `True`). {{(pid=352328) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 08:54:05.958983 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.fernet_utils [None req-82ede0a3-fc82-463e-9c60-127cf64cf493 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=352328) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:54:06.051661 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50350631-8c96-4287-9fc5-6f8f588e6c5e None admin] Validating token access rules against request {{(pid=352329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:54:06.097153 dv-cinder-851351-1-smb devstack@keystone.service[352328]: [pid: 352328|app: 0|req: 357/706] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 08:54:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 28 08:54:06.097876 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e537852c-c01c-4ebe-b20a-e11f2418056c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:54:06.098552 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e537852c-c01c-4ebe-b20a-e11f2418056c None admin] REQUEST_METHOD: `GET` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:54:06.098838 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e537852c-c01c-4ebe-b20a-e11f2418056c None admin] SCRIPT_NAME: `/identity` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:54:06.099118 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e537852c-c01c-4ebe-b20a-e11f2418056c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:54:06.122643 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ede0a3-fc82-463e-9c60-127cf64cf493 None None] Authenticating user token {{(pid=352328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:54:06.139465 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e537852c-c01c-4ebe-b20a-e11f2418056c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:54:06.141025 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e537852c-c01c-4ebe-b20a-e11f2418056c None admin] RBAC: Authorization granted {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:54:06.169477 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application [None req-e537852c-c01c-4ebe-b20a-e11f2418056c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 08:54:06.169477 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:54:06.169477 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:54:06.169477 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:54:06.169477 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:54:06.169477 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:54:06.169477 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:54:06.169477 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:54:06.169477 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:54:06.169477 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:54:06.169477 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:54:06.169477 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:54:06.169477 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 08:54:06.169477 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 08:54:06.169477 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 08:54:06.170627 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 08:54:06.170627 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:54:06.170627 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:54:06.170627 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:54:06.170627 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:54:06.170627 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:54:06.170627 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:54:06.170627 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:54:06.170627 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application with Lock( Jul 28 08:54:06.170627 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:54:06.170627 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:54:06.170627 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:54:06.170627 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:54:06.170627 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:54:06.170627 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:54:06.170627 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:54:06.170627 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:54:06.171765 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 08:54:06.171765 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 08:54:06.171765 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 08:54:06.171765 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application Jul 28 08:54:06.171765 dv-cinder-851351-1-smb devstack@keystone.service[352329]: [pid: 352329|app: 0|req: 350/707] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 08:54:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 266 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:54:06.175615 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG dbcounter [-] [352328] Writing DB stats keystone:SELECT=100 {{(pid=352328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:54:06.176461 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e537852c-c01c-4ebe-b20a-e11f2418056c None admin] Authenticating user token {{(pid=352329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:54:06.313471 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ede0a3-fc82-463e-9c60-127cf64cf493 None None] Validating token access rules against request {{(pid=352328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:54:06.323595 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG dbcounter [-] [352329] Writing DB stats keystone:SELECT=100 {{(pid=352329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:54:06.367153 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e537852c-c01c-4ebe-b20a-e11f2418056c None admin] Validating token access rules against request {{(pid=352329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:54:06.385289 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ba9c87-2af7-429e-8ef4-892673d5a318 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:54:06.386344 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ba9c87-2af7-429e-8ef4-892673d5a318 None admin] REQUEST_METHOD: `GET` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:54:06.386865 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ba9c87-2af7-429e-8ef4-892673d5a318 None admin] SCRIPT_NAME: `/identity` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:54:06.387392 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ba9c87-2af7-429e-8ef4-892673d5a318 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:54:06.401770 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ba9c87-2af7-429e-8ef4-892673d5a318 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:54:06.404028 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ba9c87-2af7-429e-8ef4-892673d5a318 None admin] RBAC: Authorization granted {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:54:06.421717 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application [None req-79ba9c87-2af7-429e-8ef4-892673d5a318 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 08:54:06.421717 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:54:06.421717 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:54:06.421717 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:54:06.421717 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:54:06.421717 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:54:06.421717 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:54:06.421717 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:54:06.421717 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:54:06.421717 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:54:06.421717 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:54:06.421717 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:54:06.421717 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 08:54:06.421717 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 08:54:06.421717 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 08:54:06.423258 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 08:54:06.423258 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:54:06.423258 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:54:06.423258 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:54:06.423258 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:54:06.423258 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:54:06.423258 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:54:06.423258 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:54:06.423258 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application with Lock( Jul 28 08:54:06.423258 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:54:06.423258 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:54:06.423258 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:54:06.423258 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:54:06.423258 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:54:06.423258 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:54:06.423258 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:54:06.423258 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:54:06.424357 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 08:54:06.424357 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 08:54:06.424357 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 08:54:06.424357 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application Jul 28 08:54:06.426886 dv-cinder-851351-1-smb devstack@keystone.service[352328]: [pid: 352328|app: 0|req: 358/708] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 08:54:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 305 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:54:06.432968 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ba9c87-2af7-429e-8ef4-892673d5a318 None admin] Authenticating user token {{(pid=352328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:54:06.464952 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46dd08ea-6ea0-43f7-ae37-de1812ed4992 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:54:06.465614 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46dd08ea-6ea0-43f7-ae37-de1812ed4992 None admin] REQUEST_METHOD: `GET` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:54:06.465914 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46dd08ea-6ea0-43f7-ae37-de1812ed4992 None admin] SCRIPT_NAME: `/identity` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:54:06.466259 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46dd08ea-6ea0-43f7-ae37-de1812ed4992 None admin] PATH_INFO: `/v3/domains` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:54:06.466926 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46dd08ea-6ea0-43f7-ae37-de1812ed4992 None admin] RBAC: Adding query filter params (name=Default) {{(pid=352329) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:54:06.467243 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46dd08ea-6ea0-43f7-ae37-de1812ed4992 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:54:06.468755 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46dd08ea-6ea0-43f7-ae37-de1812ed4992 None admin] RBAC: Authorization granted {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:54:06.500300 dv-cinder-851351-1-smb devstack@keystone.service[352329]: [pid: 352329|app: 0|req: 351/709] 10.222.0.42 () {56 vars in 1109 bytes} [Thu Jul 28 08:54:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 324 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:54:06.505691 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46dd08ea-6ea0-43f7-ae37-de1812ed4992 None admin] Authenticating user token {{(pid=352329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:54:06.531438 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG dbcounter [-] [352328] Writing DB stats keystone:SELECT=100 {{(pid=352328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:54:06.554666 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ba9c87-2af7-429e-8ef4-892673d5a318 None admin] Validating token access rules against request {{(pid=352328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:54:06.605942 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22271e63-a7c0-4bff-9f96-ac64112fd552 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:54:06.607032 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22271e63-a7c0-4bff-9f96-ac64112fd552 None admin] REQUEST_METHOD: `GET` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:54:06.607534 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22271e63-a7c0-4bff-9f96-ac64112fd552 None admin] SCRIPT_NAME: `/identity` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:54:06.608018 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22271e63-a7c0-4bff-9f96-ac64112fd552 None admin] PATH_INFO: `/v3/domains` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:54:06.608976 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22271e63-a7c0-4bff-9f96-ac64112fd552 None admin] RBAC: Adding query filter params (name=Default) {{(pid=352328) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:54:06.609675 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22271e63-a7c0-4bff-9f96-ac64112fd552 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:54:06.611334 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22271e63-a7c0-4bff-9f96-ac64112fd552 None admin] RBAC: Authorization granted {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:54:06.635524 dv-cinder-851351-1-smb devstack@keystone.service[352328]: [pid: 352328|app: 0|req: 359/710] 10.222.0.42 () {56 vars in 1109 bytes} [Thu Jul 28 08:54:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 08:54:06.641723 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22271e63-a7c0-4bff-9f96-ac64112fd552 None admin] Authenticating user token {{(pid=352328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:54:06.797850 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22271e63-a7c0-4bff-9f96-ac64112fd552 None admin] Validating token access rules against request {{(pid=352328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:54:06.836271 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe9af74-d4ea-4780-b72c-fd08dc1ec6c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:54:06.837448 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe9af74-d4ea-4780-b72c-fd08dc1ec6c0 None admin] REQUEST_METHOD: `POST` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:54:06.838017 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe9af74-d4ea-4780-b72c-fd08dc1ec6c0 None admin] SCRIPT_NAME: `/identity` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:54:06.838747 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe9af74-d4ea-4780-b72c-fd08dc1ec6c0 None admin] PATH_INFO: `/v3/users` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:54:06.839772 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fe9af74-d4ea-4780-b72c-fd08dc1ec6c0 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:54:06.841578 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fe9af74-d4ea-4780-b72c-fd08dc1ec6c0 None admin] RBAC: Authorization granted {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:54:06.849467 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46dd08ea-6ea0-43f7-ae37-de1812ed4992 None admin] Validating token access rules against request {{(pid=352329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:54:06.853911 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG dbcounter [-] [352328] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=352328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:54:06.870782 dv-cinder-851351-1-smb devstack@keystone.service[352328]: [pid: 352328|app: 0|req: 360/711] 10.222.0.42 () {60 vars in 1132 bytes} [Thu Jul 28 08:54:06 2022] POST /identity/v3/users => generated 254 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 28 08:54:06.870782 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c63be41-d26f-4416-8c21-56e54d34a368 None None] REQUEST_METHOD: `GET` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:54:06.870782 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c63be41-d26f-4416-8c21-56e54d34a368 None None] SCRIPT_NAME: `/identity` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:54:06.870782 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c63be41-d26f-4416-8c21-56e54d34a368 None None] PATH_INFO: `/` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:54:06.870782 dv-cinder-851351-1-smb devstack@keystone.service[352328]: [pid: 352328|app: 0|req: 361/712] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 08:54:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 08:54:06.876990 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20a9694-803b-4715-854a-0577a5d2604e None None] REQUEST_METHOD: `POST` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:54:06.877537 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20a9694-803b-4715-854a-0577a5d2604e None None] SCRIPT_NAME: `/identity` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:54:06.878076 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20a9694-803b-4715-854a-0577a5d2604e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:54:06.902153 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.auth.core [None req-b20a9694-803b-4715-854a-0577a5d2604e None None] MFA Rules not processed for user `d18c063b2377412485965357671e5506`. Rule list: `[]` (Enabled: `True`). {{(pid=352328) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 08:54:06.903605 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.fernet_utils [None req-b20a9694-803b-4715-854a-0577a5d2604e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=352328) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:54:06.942426 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a0b6a9-1f36-487f-a3f7-81ffc4881a87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:54:06.943191 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a0b6a9-1f36-487f-a3f7-81ffc4881a87 None admin] REQUEST_METHOD: `GET` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:54:06.943396 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a0b6a9-1f36-487f-a3f7-81ffc4881a87 None admin] SCRIPT_NAME: `/identity` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:54:06.943682 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a0b6a9-1f36-487f-a3f7-81ffc4881a87 None admin] PATH_INFO: `/v3/projects/service` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:54:06.950610 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG dbcounter [-] [352329] Writing DB stats keystone:SELECT=100 {{(pid=352329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:54:06.965722 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05a0b6a9-1f36-487f-a3f7-81ffc4881a87 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:54:06.967232 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05a0b6a9-1f36-487f-a3f7-81ffc4881a87 None admin] RBAC: Authorization granted {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:54:06.991145 dv-cinder-851351-1-smb devstack@keystone.service[352328]: [pid: 352328|app: 0|req: 362/713] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 08:54:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 08:54:06.998616 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application [None req-05a0b6a9-1f36-487f-a3f7-81ffc4881a87 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 08:54:06.998616 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:54:06.998616 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:54:06.998616 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:54:06.998616 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:54:06.998616 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:54:06.998616 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:54:06.998616 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:54:06.998616 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:54:06.998616 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:54:06.998616 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:54:06.998616 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:54:06.998616 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 28 08:54:06.998616 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 28 08:54:06.998616 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 28 08:54:06.999818 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 28 08:54:06.999818 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:54:06.999818 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:54:06.999818 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:54:06.999818 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:54:06.999818 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:54:06.999818 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:54:06.999818 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:54:06.999818 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application with Lock( Jul 28 08:54:06.999818 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:54:06.999818 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:54:06.999818 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:54:06.999818 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:54:06.999818 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:54:06.999818 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:54:06.999818 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:54:06.999818 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:54:07.001684 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 28 08:54:07.001684 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 28 08:54:07.001684 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 28 08:54:07.001684 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 28 08:54:07.001684 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 28 08:54:07.001684 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 28 08:54:07.001684 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 08:54:07.001684 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application Jul 28 08:54:07.001684 dv-cinder-851351-1-smb devstack@keystone.service[352329]: [pid: 352329|app: 0|req: 352/714] 10.222.0.42 () {56 vars in 1111 bytes} [Thu Jul 28 08:54:06 2022] GET /identity/v3/projects/service => generated 88 bytes in 495 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:54:07.006328 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20a9694-803b-4715-854a-0577a5d2604e None None] Authenticating user token {{(pid=352328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:54:07.033492 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a0b6a9-1f36-487f-a3f7-81ffc4881a87 None admin] Authenticating user token {{(pid=352329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:54:07.150247 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20a9694-803b-4715-854a-0577a5d2604e None None] Validating token access rules against request {{(pid=352328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:54:07.161695 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a0b6a9-1f36-487f-a3f7-81ffc4881a87 None admin] Validating token access rules against request {{(pid=352329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:54:07.179908 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG dbcounter [-] [352328] Writing DB stats keystone:SELECT=100 {{(pid=352328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:54:07.190810 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92782e5a-6c13-4c29-8458-5a2dedb5c2d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:54:07.191564 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92782e5a-6c13-4c29-8458-5a2dedb5c2d6 None admin] REQUEST_METHOD: `GET` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:54:07.191971 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92782e5a-6c13-4c29-8458-5a2dedb5c2d6 None admin] SCRIPT_NAME: `/identity` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:54:07.192322 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92782e5a-6c13-4c29-8458-5a2dedb5c2d6 None admin] PATH_INFO: `/v3/projects` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:54:07.193250 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92782e5a-6c13-4c29-8458-5a2dedb5c2d6 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=352328) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:54:07.193640 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92782e5a-6c13-4c29-8458-5a2dedb5c2d6 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:54:07.195148 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92782e5a-6c13-4c29-8458-5a2dedb5c2d6 None admin] RBAC: Authorization granted {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:54:07.208174 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-417b3252-b244-43d3-992f-8ef42f49e4a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:54:07.209181 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417b3252-b244-43d3-992f-8ef42f49e4a2 None admin] REQUEST_METHOD: `GET` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:54:07.209336 dv-cinder-851351-1-smb devstack@keystone.service[352328]: [pid: 352328|app: 0|req: 363/715] 10.222.0.42 () {56 vars in 1148 bytes} [Thu Jul 28 08:54:07 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:54:07.209810 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417b3252-b244-43d3-992f-8ef42f49e4a2 None admin] SCRIPT_NAME: `/identity` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:54:07.210281 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417b3252-b244-43d3-992f-8ef42f49e4a2 None admin] PATH_INFO: `/v3/services/network` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:54:07.211130 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-417b3252-b244-43d3-992f-8ef42f49e4a2 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:54:07.212516 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-417b3252-b244-43d3-992f-8ef42f49e4a2 None admin] RBAC: Authorization granted {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:54:07.220168 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92782e5a-6c13-4c29-8458-5a2dedb5c2d6 None admin] Authenticating user token {{(pid=352328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:54:07.231454 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application [None req-417b3252-b244-43d3-992f-8ef42f49e4a2 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jul 28 08:54:07.231454 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:54:07.231454 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 28 08:54:07.231454 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 28 08:54:07.231454 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 28 08:54:07.231454 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 28 08:54:07.231454 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 28 08:54:07.231454 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 08:54:07.231454 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 28 08:54:07.231454 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application Jul 28 08:54:07.231454 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 28 08:54:07.231454 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application Jul 28 08:54:07.231454 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:54:07.231454 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:54:07.231454 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:54:07.231454 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:54:07.231454 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:54:07.233027 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:54:07.233027 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:54:07.233027 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:54:07.233027 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:54:07.233027 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:54:07.233027 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:54:07.233027 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 28 08:54:07.233027 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 28 08:54:07.233027 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 28 08:54:07.233027 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 28 08:54:07.233027 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:54:07.233027 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:54:07.233027 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:54:07.233027 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:54:07.233027 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:54:07.233027 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:54:07.234100 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:54:07.234100 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application with Lock( Jul 28 08:54:07.234100 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:54:07.234100 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:54:07.234100 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:54:07.234100 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:54:07.234100 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:54:07.234100 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:54:07.234100 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:54:07.234100 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:54:07.234100 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 28 08:54:07.234100 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 08:54:07.234100 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 28 08:54:07.234100 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application Jul 28 08:54:07.234100 dv-cinder-851351-1-smb devstack@keystone.service[352329]: [pid: 352329|app: 0|req: 353/716] 10.222.0.42 () {56 vars in 1111 bytes} [Thu Jul 28 08:54:07 2022] GET /identity/v3/services/network => generated 88 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 08:54:07.239356 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-417b3252-b244-43d3-992f-8ef42f49e4a2 None admin] Authenticating user token {{(pid=352329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:54:07.310038 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG dbcounter [-] [352329] Writing DB stats keystone:SELECT=100 {{(pid=352329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:54:07.340366 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92782e5a-6c13-4c29-8458-5a2dedb5c2d6 None admin] Validating token access rules against request {{(pid=352328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:54:07.357773 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-417b3252-b244-43d3-992f-8ef42f49e4a2 None admin] Validating token access rules against request {{(pid=352329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:54:07.377638 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d250db3-c46d-45a2-ac3f-5c32a1567281 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:54:07.378283 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d250db3-c46d-45a2-ac3f-5c32a1567281 None admin] REQUEST_METHOD: `GET` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:54:07.378567 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d250db3-c46d-45a2-ac3f-5c32a1567281 None admin] SCRIPT_NAME: `/identity` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:54:07.378844 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d250db3-c46d-45a2-ac3f-5c32a1567281 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:54:07.379822 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d250db3-c46d-45a2-ac3f-5c32a1567281 None admin] RBAC: Adding query filter params (role.id=280023171b4a45efb67c036ff237bb3c, scope.project.id=9cfa053c839a4fedacde7163d907e2a4, user.id=e3ba63c3fc36470fbbe8312b51a13f13) {{(pid=352328) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:54:07.380298 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d250db3-c46d-45a2-ac3f-5c32a1567281 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:54:07.382819 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d250db3-c46d-45a2-ac3f-5c32a1567281 None admin] RBAC: Authorization granted {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:54:07.395360 dv-cinder-851351-1-smb devstack@keystone.service[352328]: [pid: 352328|app: 0|req: 364/717] 10.222.0.42 () {56 vars in 1374 bytes} [Thu Jul 28 08:54:07 2022] GET /identity/v3/role_assignments?user.id=e3ba63c3fc36470fbbe8312b51a13f13&scope.project.id=9cfa053c839a4fedacde7163d907e2a4&role.id=280023171b4a45efb67c036ff237bb3c => generated 259 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 08:54:07.398558 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d5e2d4-5163-487c-8c2d-286ed0837f45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:54:07.399561 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d5e2d4-5163-487c-8c2d-286ed0837f45 None admin] REQUEST_METHOD: `GET` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:54:07.400123 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d5e2d4-5163-487c-8c2d-286ed0837f45 None admin] SCRIPT_NAME: `/identity` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:54:07.400739 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d5e2d4-5163-487c-8c2d-286ed0837f45 None admin] PATH_INFO: `/v3/services` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:54:07.401759 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90d5e2d4-5163-487c-8c2d-286ed0837f45 None admin] RBAC: Adding query filter params (name=network) {{(pid=352329) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:54:07.402362 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90d5e2d4-5163-487c-8c2d-286ed0837f45 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:54:07.404120 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90d5e2d4-5163-487c-8c2d-286ed0837f45 None admin] RBAC: Authorization granted {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:54:07.410563 dv-cinder-851351-1-smb devstack@keystone.service[352329]: [pid: 352329|app: 0|req: 354/718] 10.222.0.42 () {56 vars in 1112 bytes} [Thu Jul 28 08:54:07 2022] GET /identity/v3/services?name=network => generated 124 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 08:54:07.416324 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d250db3-c46d-45a2-ac3f-5c32a1567281 None admin] Authenticating user token {{(pid=352328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:54:07.479110 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG dbcounter [-] [352328] Writing DB stats keystone:SELECT=100 {{(pid=352328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:54:07.558414 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d250db3-c46d-45a2-ac3f-5c32a1567281 None admin] Validating token access rules against request {{(pid=352328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:54:07.609359 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1605c03a-aef3-40ae-b5c5-6c8492da13b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:54:07.610053 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1605c03a-aef3-40ae-b5c5-6c8492da13b9 None admin] REQUEST_METHOD: `GET` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:54:07.610332 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1605c03a-aef3-40ae-b5c5-6c8492da13b9 None admin] SCRIPT_NAME: `/identity` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:54:07.610607 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1605c03a-aef3-40ae-b5c5-6c8492da13b9 None admin] PATH_INFO: `/v3/services` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:54:07.611309 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1605c03a-aef3-40ae-b5c5-6c8492da13b9 None admin] RBAC: Adding query filter params (type=network) {{(pid=352328) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:54:07.611596 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1605c03a-aef3-40ae-b5c5-6c8492da13b9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:54:07.613029 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1605c03a-aef3-40ae-b5c5-6c8492da13b9 None admin] RBAC: Authorization granted {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:54:07.620536 dv-cinder-851351-1-smb devstack@keystone.service[352328]: [pid: 352328|app: 0|req: 365/719] 10.222.0.42 () {56 vars in 1112 bytes} [Thu Jul 28 08:54:07 2022] GET /identity/v3/services?type=network => generated 124 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 08:54:07.938640 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f643546-75f1-477f-ab61-73160d882914 None None] REQUEST_METHOD: `GET` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:54:07.939278 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f643546-75f1-477f-ab61-73160d882914 None None] SCRIPT_NAME: `/identity` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:54:07.939814 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f643546-75f1-477f-ab61-73160d882914 None None] PATH_INFO: `/` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:54:07.941915 dv-cinder-851351-1-smb devstack@keystone.service[352329]: [pid: 352329|app: 0|req: 355/720] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 08:54:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 08:54:07.947170 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0137602-01c2-406c-b085-28182225443b None None] REQUEST_METHOD: `POST` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:54:07.947723 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0137602-01c2-406c-b085-28182225443b None None] SCRIPT_NAME: `/identity` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:54:07.947723 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0137602-01c2-406c-b085-28182225443b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:54:07.976129 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.auth.core [None req-a0137602-01c2-406c-b085-28182225443b None None] MFA Rules not processed for user `d18c063b2377412485965357671e5506`. Rule list: `[]` (Enabled: `True`). {{(pid=352328) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 08:54:07.977779 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.fernet_utils [None req-a0137602-01c2-406c-b085-28182225443b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=352328) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:54:07.994625 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65acb7fb-0ed9-4dfa-b553-9250aad4b425 None None] REQUEST_METHOD: `GET` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:54:07.995680 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65acb7fb-0ed9-4dfa-b553-9250aad4b425 None None] SCRIPT_NAME: `/identity` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:54:07.996221 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65acb7fb-0ed9-4dfa-b553-9250aad4b425 None None] PATH_INFO: `/` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:54:07.998254 dv-cinder-851351-1-smb devstack@keystone.service[352329]: [pid: 352329|app: 0|req: 356/721] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 08:54:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 08:54:08.004141 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6459435-acf5-4185-b44a-ed9c464d7f14 None None] REQUEST_METHOD: `POST` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:54:08.004462 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6459435-acf5-4185-b44a-ed9c464d7f14 None None] SCRIPT_NAME: `/identity` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:54:08.004791 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6459435-acf5-4185-b44a-ed9c464d7f14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:54:08.049819 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.auth.core [None req-b6459435-acf5-4185-b44a-ed9c464d7f14 None None] MFA Rules not processed for user `d18c063b2377412485965357671e5506`. Rule list: `[]` (Enabled: `True`). {{(pid=352329) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 08:54:08.051043 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.fernet_utils [None req-b6459435-acf5-4185-b44a-ed9c464d7f14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=352329) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:54:08.097836 dv-cinder-851351-1-smb devstack@keystone.service[352328]: [pid: 352328|app: 0|req: 366/722] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 08:54:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 08:54:08.120225 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0137602-01c2-406c-b085-28182225443b None None] Authenticating user token {{(pid=352328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:54:08.166224 dv-cinder-851351-1-smb devstack@keystone.service[352329]: [pid: 352329|app: 0|req: 357/723] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 08:54:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 08:54:08.194800 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG dbcounter [-] [352328] Writing DB stats keystone:SELECT=100 {{(pid=352328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:54:08.235272 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6459435-acf5-4185-b44a-ed9c464d7f14 None None] Authenticating user token {{(pid=352329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:54:08.289285 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG dbcounter [-] [352329] Writing DB stats keystone:SELECT=100 {{(pid=352329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:54:08.291859 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0137602-01c2-406c-b085-28182225443b None None] Validating token access rules against request {{(pid=352328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:54:08.343649 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6459435-acf5-4185-b44a-ed9c464d7f14 None None] Validating token access rules against request {{(pid=352329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:54:08.369088 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9459a518-1488-4bf4-a17f-ae7c21a4a9bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:54:08.370160 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9459a518-1488-4bf4-a17f-ae7c21a4a9bf None admin] REQUEST_METHOD: `POST` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:54:08.370679 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9459a518-1488-4bf4-a17f-ae7c21a4a9bf None admin] SCRIPT_NAME: `/identity` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:54:08.371239 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9459a518-1488-4bf4-a17f-ae7c21a4a9bf None admin] PATH_INFO: `/v3/services` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:54:08.372294 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9459a518-1488-4bf4-a17f-ae7c21a4a9bf None admin] RBAC: Authorizing `identity:create_service()` {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:54:08.373951 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9459a518-1488-4bf4-a17f-ae7c21a4a9bf None admin] RBAC: Authorization granted {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:54:08.392793 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d31177-b3ad-450d-8075-5c72f10d3176 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:54:08.393513 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d31177-b3ad-450d-8075-5c72f10d3176 None admin] REQUEST_METHOD: `GET` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:54:08.393800 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d31177-b3ad-450d-8075-5c72f10d3176 None admin] SCRIPT_NAME: `/identity` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:54:08.394253 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d31177-b3ad-450d-8075-5c72f10d3176 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:54:08.412691 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d31177-b3ad-450d-8075-5c72f10d3176 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 08:54:08.414188 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application [None req-63d31177-b3ad-450d-8075-5c72f10d3176 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 08:54:08.414188 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:54:08.414188 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:54:08.414188 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:54:08.414188 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:54:08.414188 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:54:08.414188 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:54:08.414188 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:54:08.414188 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:54:08.414188 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:54:08.414188 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:54:08.414188 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:54:08.414188 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 08:54:08.414188 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 08:54:08.414188 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 08:54:08.414188 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 08:54:08.415388 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 08:54:08.415388 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 08:54:08.415388 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 08:54:08.415388 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 08:54:08.415388 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:54:08.415388 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:54:08.415388 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:54:08.415388 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:54:08.415388 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:54:08.415388 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:54:08.415388 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:54:08.415388 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application with Lock( Jul 28 08:54:08.415388 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:54:08.415388 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:54:08.415388 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:54:08.415388 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:54:08.416443 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:54:08.416443 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:54:08.416443 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:54:08.416443 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:54:08.416443 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 08:54:08.416443 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 08:54:08.416443 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 08:54:08.416443 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 08:54:08.416443 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 08:54:08.416443 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 08:54:08.416443 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 08:54:08.416443 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application Jul 28 08:54:08.416443 dv-cinder-851351-1-smb devstack@keystone.service[352329]: [pid: 352329|app: 0|req: 358/724] 10.222.0.42 () {56 vars in 1096 bytes} [Thu Jul 28 08:54:08 2022] GET /identity/v3/roles/admin => generated 83 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 08:54:08.418149 dv-cinder-851351-1-smb devstack@keystone.service[352328]: [pid: 352328|app: 0|req: 367/725] 10.222.0.42 () {60 vars in 1141 bytes} [Thu Jul 28 08:54:08 2022] POST /identity/v3/services => generated 251 bytes in 298 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 28 08:54:08.421314 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d31177-b3ad-450d-8075-5c72f10d3176 None admin] Authenticating user token {{(pid=352329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:54:08.580986 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d31177-b3ad-450d-8075-5c72f10d3176 None admin] Validating token access rules against request {{(pid=352329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:54:08.602904 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG dbcounter [-] [352329] Writing DB stats keystone:SELECT=100 {{(pid=352329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:54:08.637495 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ddaea3-55ec-460e-b673-ea229f4c1237 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:54:08.638141 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ddaea3-55ec-460e-b673-ea229f4c1237 None admin] REQUEST_METHOD: `GET` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:54:08.638420 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ddaea3-55ec-460e-b673-ea229f4c1237 None admin] SCRIPT_NAME: `/identity` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:54:08.638688 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ddaea3-55ec-460e-b673-ea229f4c1237 None admin] PATH_INFO: `/v3/roles` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:54:08.639417 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1ddaea3-55ec-460e-b673-ea229f4c1237 None admin] RBAC: Adding query filter params (name=admin) {{(pid=352329) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:54:08.639718 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1ddaea3-55ec-460e-b673-ea229f4c1237 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:54:08.641242 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1ddaea3-55ec-460e-b673-ea229f4c1237 None admin] RBAC: Authorization granted {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:54:08.650584 dv-cinder-851351-1-smb devstack@keystone.service[352329]: [pid: 352329|app: 0|req: 359/726] 10.222.0.42 () {56 vars in 1099 bytes} [Thu Jul 28 08:54:08 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 08:54:08.656243 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9459a518-1488-4bf4-a17f-ae7c21a4a9bf None admin] Authenticating user token {{(pid=352328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:54:08.759448 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9459a518-1488-4bf4-a17f-ae7c21a4a9bf None admin] Validating token access rules against request {{(pid=352328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:54:08.761985 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG dbcounter [-] [352328] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=352328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:54:08.797773 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-092ed9d1-a253-4be7-b1f8-ce291d873dcf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:54:08.798471 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092ed9d1-a253-4be7-b1f8-ce291d873dcf None admin] REQUEST_METHOD: `GET` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:54:08.798755 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092ed9d1-a253-4be7-b1f8-ce291d873dcf None admin] SCRIPT_NAME: `/identity` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:54:08.799045 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092ed9d1-a253-4be7-b1f8-ce291d873dcf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:54:08.810344 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-092ed9d1-a253-4be7-b1f8-ce291d873dcf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:54:08.811832 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-092ed9d1-a253-4be7-b1f8-ce291d873dcf None admin] RBAC: Authorization granted {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:54:08.827428 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application [None req-092ed9d1-a253-4be7-b1f8-ce291d873dcf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 08:54:08.827428 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:54:08.827428 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:54:08.827428 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:54:08.827428 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:54:08.827428 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:54:08.827428 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:54:08.827428 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:54:08.827428 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:54:08.827428 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:54:08.827428 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:54:08.827428 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:54:08.827428 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 08:54:08.827428 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 08:54:08.827428 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 08:54:08.828639 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 08:54:08.828639 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:54:08.828639 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:54:08.828639 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:54:08.828639 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:54:08.828639 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:54:08.828639 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:54:08.828639 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:54:08.828639 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application with Lock( Jul 28 08:54:08.828639 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:54:08.828639 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:54:08.828639 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:54:08.828639 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:54:08.828639 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:54:08.828639 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:54:08.828639 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:54:08.828639 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:54:08.830182 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 08:54:08.830182 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 08:54:08.830182 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 08:54:08.830182 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application Jul 28 08:54:08.830182 dv-cinder-851351-1-smb devstack@keystone.service[352328]: [pid: 352328|app: 0|req: 368/727] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 08:54:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:54:08.835196 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ddaea3-55ec-460e-b673-ea229f4c1237 None admin] Authenticating user token {{(pid=352329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:54:08.966215 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ddaea3-55ec-460e-b673-ea229f4c1237 None admin] Validating token access rules against request {{(pid=352329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:54:09.032859 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ffd565-721f-4a3a-9d2f-cc3bebc24578 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:54:09.033588 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ffd565-721f-4a3a-9d2f-cc3bebc24578 None admin] REQUEST_METHOD: `GET` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:54:09.033763 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ffd565-721f-4a3a-9d2f-cc3bebc24578 None admin] SCRIPT_NAME: `/identity` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:54:09.034043 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ffd565-721f-4a3a-9d2f-cc3bebc24578 None admin] PATH_INFO: `/v3/domains` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:54:09.034757 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3ffd565-721f-4a3a-9d2f-cc3bebc24578 None admin] RBAC: Adding query filter params (name=Default) {{(pid=352329) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:54:09.035060 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3ffd565-721f-4a3a-9d2f-cc3bebc24578 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:54:09.036517 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3ffd565-721f-4a3a-9d2f-cc3bebc24578 None admin] RBAC: Authorization granted {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:54:09.049452 dv-cinder-851351-1-smb devstack@keystone.service[352329]: [pid: 352329|app: 0|req: 360/728] 10.222.0.42 () {56 vars in 1109 bytes} [Thu Jul 28 08:54:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:54:09.055094 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-092ed9d1-a253-4be7-b1f8-ce291d873dcf None admin] Authenticating user token {{(pid=352328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:54:09.185157 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-092ed9d1-a253-4be7-b1f8-ce291d873dcf None admin] Validating token access rules against request {{(pid=352328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:54:09.227633 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b30cbeb-d0fd-4f7f-a366-822e6e1d0ef5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:54:09.228296 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b30cbeb-d0fd-4f7f-a366-822e6e1d0ef5 None admin] REQUEST_METHOD: `GET` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:54:09.228577 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b30cbeb-d0fd-4f7f-a366-822e6e1d0ef5 None admin] SCRIPT_NAME: `/identity` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:54:09.228885 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b30cbeb-d0fd-4f7f-a366-822e6e1d0ef5 None admin] PATH_INFO: `/v3/users/swift` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:54:09.239281 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b30cbeb-d0fd-4f7f-a366-822e6e1d0ef5 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:54:09.240877 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b30cbeb-d0fd-4f7f-a366-822e6e1d0ef5 None admin] RBAC: Authorization granted {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:54:09.253702 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application [None req-6b30cbeb-d0fd-4f7f-a366-822e6e1d0ef5 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 28 08:54:09.253702 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:54:09.253702 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:54:09.253702 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:54:09.253702 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:54:09.253702 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:54:09.253702 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:54:09.253702 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:54:09.253702 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:54:09.253702 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:54:09.253702 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:54:09.253702 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:54:09.253702 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 28 08:54:09.253702 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 28 08:54:09.253702 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 28 08:54:09.253702 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 28 08:54:09.256265 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:54:09.256265 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:54:09.256265 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 28 08:54:09.256265 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 08:54:09.256265 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 28 08:54:09.256265 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 08:54:09.256265 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:54:09.256265 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:54:09.256265 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:54:09.256265 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:54:09.256265 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:54:09.256265 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application with Lock( Jul 28 08:54:09.256265 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:54:09.256265 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:54:09.256265 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:54:09.256265 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:54:09.256265 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:54:09.256265 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:54:09.258836 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:54:09.258836 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:54:09.258836 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 28 08:54:09.258836 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 28 08:54:09.258836 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 28 08:54:09.258836 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 28 08:54:09.258836 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 28 08:54:09.258836 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 28 08:54:09.258836 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 28 08:54:09.258836 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application Jul 28 08:54:09.258836 dv-cinder-851351-1-smb devstack@keystone.service[352328]: [pid: 352328|app: 0|req: 369/729] 10.222.0.42 () {56 vars in 1096 bytes} [Thu Jul 28 08:54:09 2022] GET /identity/v3/users/swift => generated 83 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:54:09.264823 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ffd565-721f-4a3a-9d2f-cc3bebc24578 None admin] Authenticating user token {{(pid=352329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:54:09.313080 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG dbcounter [-] [352329] Writing DB stats keystone:SELECT=100 {{(pid=352329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:54:09.389069 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ffd565-721f-4a3a-9d2f-cc3bebc24578 None admin] Validating token access rules against request {{(pid=352329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:54:09.424020 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99244ef6-cba8-4d68-b0af-f6b42909a6a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:54:09.424679 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99244ef6-cba8-4d68-b0af-f6b42909a6a8 None admin] REQUEST_METHOD: `GET` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:54:09.424973 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99244ef6-cba8-4d68-b0af-f6b42909a6a8 None admin] SCRIPT_NAME: `/identity` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:54:09.425243 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99244ef6-cba8-4d68-b0af-f6b42909a6a8 None admin] PATH_INFO: `/v3/users` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:54:09.426045 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99244ef6-cba8-4d68-b0af-f6b42909a6a8 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=352329) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:54:09.426348 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99244ef6-cba8-4d68-b0af-f6b42909a6a8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:54:09.427805 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99244ef6-cba8-4d68-b0af-f6b42909a6a8 None admin] RBAC: Authorization granted {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:54:09.446135 dv-cinder-851351-1-smb devstack@keystone.service[352329]: [pid: 352329|app: 0|req: 361/730] 10.222.0.42 () {56 vars in 1135 bytes} [Thu Jul 28 08:54:09 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:54:09.451878 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b30cbeb-d0fd-4f7f-a366-822e6e1d0ef5 None admin] Authenticating user token {{(pid=352328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:54:09.482523 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG dbcounter [-] [352328] Writing DB stats keystone:SELECT=100 {{(pid=352328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:54:09.584929 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b30cbeb-d0fd-4f7f-a366-822e6e1d0ef5 None admin] Validating token access rules against request {{(pid=352328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:54:09.618920 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7ef33a-3102-4c78-a73f-4da8b464e66d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:54:09.619552 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7ef33a-3102-4c78-a73f-4da8b464e66d None admin] REQUEST_METHOD: `GET` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:54:09.619830 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7ef33a-3102-4c78-a73f-4da8b464e66d None admin] SCRIPT_NAME: `/identity` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:54:09.620099 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7ef33a-3102-4c78-a73f-4da8b464e66d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:54:09.700476 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c7ef33a-3102-4c78-a73f-4da8b464e66d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:54:09.701887 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c7ef33a-3102-4c78-a73f-4da8b464e66d None admin] RBAC: Authorization granted {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:54:09.708726 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f67f209-96b0-479c-8d30-a0a2e1b2a4ff None None] REQUEST_METHOD: `GET` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:54:09.708726 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f67f209-96b0-479c-8d30-a0a2e1b2a4ff None None] SCRIPT_NAME: `/identity` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:54:09.708726 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f67f209-96b0-479c-8d30-a0a2e1b2a4ff None None] PATH_INFO: `/` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:54:09.709853 dv-cinder-851351-1-smb devstack@keystone.service[352329]: [pid: 352329|app: 0|req: 362/731] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 08:54:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 28 08:54:09.716055 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15f28c0-54e5-4591-b548-162ddc76a80f None None] REQUEST_METHOD: `POST` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:54:09.716279 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15f28c0-54e5-4591-b548-162ddc76a80f None None] SCRIPT_NAME: `/identity` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:54:09.716789 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15f28c0-54e5-4591-b548-162ddc76a80f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:54:09.731256 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG dbcounter [-] [352328] Writing DB stats keystone:SELECT=100 {{(pid=352328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:54:09.737999 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.auth.core [None req-a15f28c0-54e5-4591-b548-162ddc76a80f None None] MFA Rules not processed for user `d18c063b2377412485965357671e5506`. Rule list: `[]` (Enabled: `True`). {{(pid=352329) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 08:54:09.740115 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.fernet_utils [None req-a15f28c0-54e5-4591-b548-162ddc76a80f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=352329) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:54:09.836100 dv-cinder-851351-1-smb devstack@keystone.service[352328]: [pid: 352328|app: 0|req: 370/732] 10.222.0.42 () {58 vars in 1282 bytes} [Thu Jul 28 08:54:09 2022] GET /identity/v3/auth/tokens => generated 903 bytes in 385 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 28 08:54:09.841801 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7ef33a-3102-4c78-a73f-4da8b464e66d None admin] Authenticating user token {{(pid=352328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:54:09.881339 dv-cinder-851351-1-smb devstack@keystone.service[352329]: [pid: 352329|app: 0|req: 363/733] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 08:54:09 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 28 08:54:09.960142 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15f28c0-54e5-4591-b548-162ddc76a80f None None] Authenticating user token {{(pid=352329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:54:09.972440 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7ef33a-3102-4c78-a73f-4da8b464e66d None admin] Validating token access rules against request {{(pid=352328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:54:09.991699 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG dbcounter [-] [352328] Writing DB stats keystone:SELECT=100 {{(pid=352328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:54:09.992456 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG dbcounter [-] [352329] Writing DB stats keystone:SELECT=100 {{(pid=352329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:54:10.041934 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c964dd-2156-422b-b2d4-3d19110e9964 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:54:10.042615 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c964dd-2156-422b-b2d4-3d19110e9964 None admin] REQUEST_METHOD: `GET` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:54:10.042893 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c964dd-2156-422b-b2d4-3d19110e9964 None admin] SCRIPT_NAME: `/identity` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:54:10.043167 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c964dd-2156-422b-b2d4-3d19110e9964 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:54:10.068784 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76c964dd-2156-422b-b2d4-3d19110e9964 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:54:10.070317 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76c964dd-2156-422b-b2d4-3d19110e9964 None admin] RBAC: Authorization granted {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:54:10.092925 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application [None req-76c964dd-2156-422b-b2d4-3d19110e9964 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 08:54:10.092925 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:54:10.092925 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:54:10.092925 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:54:10.092925 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:54:10.092925 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:54:10.092925 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:54:10.092925 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:54:10.092925 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:54:10.092925 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:54:10.092925 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:54:10.092925 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:54:10.092925 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 08:54:10.092925 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 08:54:10.092925 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 08:54:10.094113 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 08:54:10.094113 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:54:10.094113 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:54:10.094113 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:54:10.094113 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:54:10.094113 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:54:10.094113 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:54:10.094113 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:54:10.094113 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application with Lock( Jul 28 08:54:10.094113 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:54:10.094113 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:54:10.094113 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:54:10.094113 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:54:10.094113 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:54:10.094113 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:54:10.094113 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:54:10.094113 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:54:10.095385 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 08:54:10.095385 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 08:54:10.095385 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 08:54:10.095385 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application Jul 28 08:54:10.095385 dv-cinder-851351-1-smb devstack@keystone.service[352328]: [pid: 352328|app: 0|req: 371/734] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 08:54:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 254 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:54:10.099048 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65876b5-61fb-4be5-8cb0-9dbd71e68b6a None None] REQUEST_METHOD: `GET` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:54:10.099048 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65876b5-61fb-4be5-8cb0-9dbd71e68b6a None None] SCRIPT_NAME: `/identity` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:54:10.099048 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65876b5-61fb-4be5-8cb0-9dbd71e68b6a None None] PATH_INFO: `/` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:54:10.102319 dv-cinder-851351-1-smb devstack@keystone.service[352328]: [pid: 352328|app: 0|req: 372/735] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 08:54:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 08:54:10.103143 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d65876b5-61fb-4be5-8cb0-9dbd71e68b6a None None] Authenticating user token {{(pid=352328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:54:10.129921 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15f28c0-54e5-4591-b548-162ddc76a80f None None] Validating token access rules against request {{(pid=352329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:54:10.169362 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b34feb-d198-45df-abf5-9d3d2b591618 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:54:10.170024 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b34feb-d198-45df-abf5-9d3d2b591618 None admin] REQUEST_METHOD: `GET` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:54:10.170301 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b34feb-d198-45df-abf5-9d3d2b591618 None admin] SCRIPT_NAME: `/identity` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:54:10.170576 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b34feb-d198-45df-abf5-9d3d2b591618 None admin] PATH_INFO: `/v3/roles/service` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:54:10.182800 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b34feb-d198-45df-abf5-9d3d2b591618 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 08:54:10.188077 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application [None req-04b34feb-d198-45df-abf5-9d3d2b591618 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 28 08:54:10.188077 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:54:10.188077 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:54:10.188077 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:54:10.188077 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:54:10.188077 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:54:10.188077 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:54:10.188077 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:54:10.188077 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:54:10.188077 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:54:10.188077 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:54:10.188077 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:54:10.188077 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 08:54:10.188077 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 08:54:10.188077 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 08:54:10.188077 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 08:54:10.190661 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 08:54:10.190661 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 08:54:10.190661 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 08:54:10.190661 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 08:54:10.190661 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:54:10.190661 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:54:10.190661 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:54:10.190661 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:54:10.190661 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:54:10.190661 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:54:10.190661 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:54:10.190661 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application with Lock( Jul 28 08:54:10.190661 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:54:10.190661 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:54:10.190661 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:54:10.190661 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:54:10.192899 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:54:10.192899 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:54:10.192899 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:54:10.192899 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:54:10.192899 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 08:54:10.192899 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 08:54:10.192899 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 08:54:10.192899 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 08:54:10.192899 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 08:54:10.192899 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 08:54:10.192899 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 28 08:54:10.192899 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application Jul 28 08:54:10.199949 dv-cinder-851351-1-smb devstack@keystone.service[352329]: [pid: 352329|app: 0|req: 364/736] 10.222.0.42 () {56 vars in 1102 bytes} [Thu Jul 28 08:54:09 2022] GET /identity/v3/roles/service => generated 85 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 08:54:10.199949 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3bc8df-dfb5-49cb-b825-7863b74c48b1 None None] REQUEST_METHOD: `POST` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:54:10.199949 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3bc8df-dfb5-49cb-b825-7863b74c48b1 None None] SCRIPT_NAME: `/identity` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:54:10.199949 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3bc8df-dfb5-49cb-b825-7863b74c48b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:54:10.216410 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.auth.core [None req-9b3bc8df-dfb5-49cb-b825-7863b74c48b1 None None] MFA Rules not processed for user `d18c063b2377412485965357671e5506`. Rule list: `[]` (Enabled: `True`). {{(pid=352329) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 08:54:10.217560 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.fernet_utils [None req-9b3bc8df-dfb5-49cb-b825-7863b74c48b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=352329) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:54:10.233599 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d65876b5-61fb-4be5-8cb0-9dbd71e68b6a None None] Validating token access rules against request {{(pid=352328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:54:10.284888 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26804e92-ed0a-44bd-98f1-3a5db644c733 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:54:10.285623 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26804e92-ed0a-44bd-98f1-3a5db644c733 None admin] REQUEST_METHOD: `GET` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:54:10.285905 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26804e92-ed0a-44bd-98f1-3a5db644c733 None admin] SCRIPT_NAME: `/identity` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:54:10.286177 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26804e92-ed0a-44bd-98f1-3a5db644c733 None admin] PATH_INFO: `/v3/domains` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:54:10.286903 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26804e92-ed0a-44bd-98f1-3a5db644c733 None admin] RBAC: Adding query filter params (name=Default) {{(pid=352328) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:54:10.287207 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26804e92-ed0a-44bd-98f1-3a5db644c733 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:54:10.288630 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26804e92-ed0a-44bd-98f1-3a5db644c733 None admin] RBAC: Authorization granted {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:54:10.304689 dv-cinder-851351-1-smb devstack@keystone.service[352329]: [pid: 352329|app: 0|req: 365/737] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 08:54:10 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 08:54:10.306245 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b3bc8df-dfb5-49cb-b825-7863b74c48b1 None None] Authenticating user token {{(pid=352329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:54:10.312027 dv-cinder-851351-1-smb devstack@keystone.service[352328]: [pid: 352328|app: 0|req: 373/738] 10.222.0.42 () {56 vars in 1109 bytes} [Thu Jul 28 08:54:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:54:10.314411 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26804e92-ed0a-44bd-98f1-3a5db644c733 None admin] Authenticating user token {{(pid=352328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:54:10.322415 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG dbcounter [-] [352329] Writing DB stats keystone:SELECT=100 {{(pid=352329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:54:10.357181 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG dbcounter [-] [352328] Writing DB stats keystone:SELECT=100 {{(pid=352328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:54:10.431484 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b3bc8df-dfb5-49cb-b825-7863b74c48b1 None None] Validating token access rules against request {{(pid=352329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:54:10.445837 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26804e92-ed0a-44bd-98f1-3a5db644c733 None admin] Validating token access rules against request {{(pid=352328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:54:10.466831 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-593302ad-b276-4ef5-b565-50b5ddb8b6a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:54:10.467382 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593302ad-b276-4ef5-b565-50b5ddb8b6a6 None admin] REQUEST_METHOD: `GET` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:54:10.467663 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593302ad-b276-4ef5-b565-50b5ddb8b6a6 None admin] SCRIPT_NAME: `/identity` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:54:10.467944 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593302ad-b276-4ef5-b565-50b5ddb8b6a6 None admin] PATH_INFO: `/v3/roles` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:54:10.468691 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-593302ad-b276-4ef5-b565-50b5ddb8b6a6 None admin] RBAC: Adding query filter params (name=service) {{(pid=352329) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:54:10.469005 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-593302ad-b276-4ef5-b565-50b5ddb8b6a6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:54:10.470450 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-593302ad-b276-4ef5-b565-50b5ddb8b6a6 None admin] RBAC: Authorization granted {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:54:10.479604 dv-cinder-851351-1-smb devstack@keystone.service[352329]: [pid: 352329|app: 0|req: 366/739] 10.222.0.42 () {56 vars in 1103 bytes} [Thu Jul 28 08:54:10 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:54:10.481594 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-593302ad-b276-4ef5-b565-50b5ddb8b6a6 None admin] Authenticating user token {{(pid=352329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:54:10.482652 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d312cd2-7003-4053-b91a-4fdd85da5d14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:54:10.483290 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d312cd2-7003-4053-b91a-4fdd85da5d14 None admin] REQUEST_METHOD: `GET` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:54:10.483576 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d312cd2-7003-4053-b91a-4fdd85da5d14 None admin] SCRIPT_NAME: `/identity` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:54:10.484191 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d312cd2-7003-4053-b91a-4fdd85da5d14 None admin] PATH_INFO: `/v3/projects/service` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:54:10.491997 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d312cd2-7003-4053-b91a-4fdd85da5d14 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:54:10.493531 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d312cd2-7003-4053-b91a-4fdd85da5d14 None admin] RBAC: Authorization granted {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:54:10.566976 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG dbcounter [-] [352329] Writing DB stats keystone:SELECT=100 {{(pid=352329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:54:10.602966 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-593302ad-b276-4ef5-b565-50b5ddb8b6a6 None admin] Validating token access rules against request {{(pid=352329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:54:10.631160 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application [None req-8d312cd2-7003-4053-b91a-4fdd85da5d14 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 08:54:10.631160 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:54:10.631160 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:54:10.631160 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:54:10.631160 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:54:10.631160 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:54:10.631160 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:54:10.631160 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:54:10.631160 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:54:10.631160 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:54:10.631160 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:54:10.631160 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:54:10.631160 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 28 08:54:10.631160 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 28 08:54:10.631160 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 28 08:54:10.632362 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 28 08:54:10.632362 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:54:10.632362 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:54:10.632362 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:54:10.632362 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:54:10.632362 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:54:10.632362 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:54:10.632362 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:54:10.632362 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application with Lock( Jul 28 08:54:10.632362 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:54:10.632362 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:54:10.632362 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:54:10.632362 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:54:10.632362 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:54:10.632362 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:54:10.632362 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:54:10.632362 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:54:10.633533 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 28 08:54:10.633533 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 28 08:54:10.633533 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 28 08:54:10.633533 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 28 08:54:10.633533 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 28 08:54:10.633533 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 28 08:54:10.633533 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 08:54:10.633533 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application Jul 28 08:54:10.633533 dv-cinder-851351-1-smb devstack@keystone.service[352328]: [pid: 352328|app: 0|req: 374/740] 10.222.0.42 () {56 vars in 1111 bytes} [Thu Jul 28 08:54:10 2022] GET /identity/v3/projects/service => generated 88 bytes in 318 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:54:10.634150 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67abf68-e72f-4b95-8bf8-139e9c0f4530 None None] REQUEST_METHOD: `GET` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:54:10.634150 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67abf68-e72f-4b95-8bf8-139e9c0f4530 None None] SCRIPT_NAME: `/identity` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:54:10.634843 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67abf68-e72f-4b95-8bf8-139e9c0f4530 None None] PATH_INFO: `/` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:54:10.639851 dv-cinder-851351-1-smb devstack@keystone.service[352328]: [pid: 352328|app: 0|req: 375/741] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 08:54:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 08:54:10.639851 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67abf68-e72f-4b95-8bf8-139e9c0f4530 None None] Authenticating user token {{(pid=352328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:54:10.650165 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a6f423-81de-47de-9b60-056fc3cf3ed2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:54:10.650840 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a6f423-81de-47de-9b60-056fc3cf3ed2 None admin] REQUEST_METHOD: `GET` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:54:10.651130 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a6f423-81de-47de-9b60-056fc3cf3ed2 None admin] SCRIPT_NAME: `/identity` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:54:10.651405 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a6f423-81de-47de-9b60-056fc3cf3ed2 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:54:10.663389 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a6f423-81de-47de-9b60-056fc3cf3ed2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 08:54:10.668895 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application [None req-43a6f423-81de-47de-9b60-056fc3cf3ed2 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 08:54:10.668895 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:54:10.668895 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:54:10.668895 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:54:10.668895 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:54:10.668895 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:54:10.668895 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:54:10.668895 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:54:10.668895 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:54:10.668895 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:54:10.668895 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:54:10.668895 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:54:10.668895 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 08:54:10.668895 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 08:54:10.668895 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 08:54:10.668895 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 08:54:10.670215 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 08:54:10.670215 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 08:54:10.670215 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 08:54:10.670215 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 08:54:10.670215 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:54:10.670215 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:54:10.670215 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:54:10.670215 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:54:10.670215 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:54:10.670215 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:54:10.670215 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:54:10.670215 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application with Lock( Jul 28 08:54:10.670215 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:54:10.670215 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:54:10.670215 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:54:10.670215 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:54:10.671529 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:54:10.671529 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:54:10.671529 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:54:10.671529 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:54:10.671529 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 08:54:10.671529 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 08:54:10.671529 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 08:54:10.671529 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 08:54:10.671529 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 08:54:10.671529 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 08:54:10.671529 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 08:54:10.671529 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application Jul 28 08:54:10.675112 dv-cinder-851351-1-smb devstack@keystone.service[352329]: [pid: 352329|app: 0|req: 367/742] 10.222.0.42 () {56 vars in 1096 bytes} [Thu Jul 28 08:54:10 2022] GET /identity/v3/roles/admin => generated 83 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:54:10.675994 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a6f423-81de-47de-9b60-056fc3cf3ed2 None admin] Authenticating user token {{(pid=352329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:54:10.736091 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG dbcounter [-] [352328] Writing DB stats keystone:SELECT=100 {{(pid=352328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:54:10.751633 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67abf68-e72f-4b95-8bf8-139e9c0f4530 None None] Validating token access rules against request {{(pid=352328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:54:10.784890 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a6f423-81de-47de-9b60-056fc3cf3ed2 None admin] Validating token access rules against request {{(pid=352329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:54:10.789002 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e036b40c-974e-4a46-b748-683bf02b82aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:54:10.789678 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e036b40c-974e-4a46-b748-683bf02b82aa None admin] REQUEST_METHOD: `GET` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:54:10.789964 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e036b40c-974e-4a46-b748-683bf02b82aa None admin] SCRIPT_NAME: `/identity` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:54:10.790243 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e036b40c-974e-4a46-b748-683bf02b82aa None admin] PATH_INFO: `/v3/domains/Default` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:54:10.801407 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e036b40c-974e-4a46-b748-683bf02b82aa None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:54:10.803382 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e036b40c-974e-4a46-b748-683bf02b82aa None admin] RBAC: Authorization granted {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:54:10.814610 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG dbcounter [-] [352329] Writing DB stats keystone:SELECT=100 {{(pid=352329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:54:10.820321 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application [None req-e036b40c-974e-4a46-b748-683bf02b82aa None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 08:54:10.820321 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:54:10.820321 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:54:10.820321 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:54:10.820321 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:54:10.820321 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:54:10.820321 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:54:10.820321 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:54:10.820321 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:54:10.820321 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:54:10.820321 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:54:10.820321 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:54:10.820321 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 08:54:10.820321 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 08:54:10.820321 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 08:54:10.821476 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 08:54:10.821476 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:54:10.821476 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:54:10.821476 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:54:10.821476 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:54:10.821476 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:54:10.821476 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:54:10.821476 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:54:10.821476 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application with Lock( Jul 28 08:54:10.821476 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:54:10.821476 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:54:10.821476 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:54:10.821476 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:54:10.821476 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:54:10.821476 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:54:10.821476 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:54:10.821476 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:54:10.822975 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 08:54:10.822975 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 08:54:10.822975 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 08:54:10.822975 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application Jul 28 08:54:10.822975 dv-cinder-851351-1-smb devstack@keystone.service[352328]: [pid: 352328|app: 0|req: 376/743] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 08:54:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:54:10.822975 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99c87ff-7f00-4a0a-bdd6-47c907455f4b None None] REQUEST_METHOD: `POST` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:54:10.823442 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99c87ff-7f00-4a0a-bdd6-47c907455f4b None None] SCRIPT_NAME: `/identity` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:54:10.823442 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99c87ff-7f00-4a0a-bdd6-47c907455f4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:54:10.827057 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b31b30af-68fd-4011-863f-820bbc238720 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:54:10.827716 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31b30af-68fd-4011-863f-820bbc238720 None admin] REQUEST_METHOD: `GET` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:54:10.827969 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31b30af-68fd-4011-863f-820bbc238720 None admin] SCRIPT_NAME: `/identity` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:54:10.828282 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31b30af-68fd-4011-863f-820bbc238720 None admin] PATH_INFO: `/v3/projects` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:54:10.829556 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b31b30af-68fd-4011-863f-820bbc238720 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=352329) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:54:10.829840 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b31b30af-68fd-4011-863f-820bbc238720 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:54:10.831314 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b31b30af-68fd-4011-863f-820bbc238720 None admin] RBAC: Authorization granted {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:54:10.843406 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.auth.core [None req-c99c87ff-7f00-4a0a-bdd6-47c907455f4b None None] MFA Rules not processed for user `d18c063b2377412485965357671e5506`. Rule list: `[]` (Enabled: `True`). {{(pid=352328) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 08:54:10.844287 dv-cinder-851351-1-smb devstack@keystone.service[352329]: [pid: 352329|app: 0|req: 368/744] 10.222.0.42 () {56 vars in 1148 bytes} [Thu Jul 28 08:54:10 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:54:10.847465 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b31b30af-68fd-4011-863f-820bbc238720 None admin] Authenticating user token {{(pid=352329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:54:10.847628 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.fernet_utils [None req-c99c87ff-7f00-4a0a-bdd6-47c907455f4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=352328) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:54:10.914860 dv-cinder-851351-1-smb devstack@keystone.service[352328]: [pid: 352328|app: 0|req: 377/745] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 08:54:10 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 08:54:10.916153 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99c87ff-7f00-4a0a-bdd6-47c907455f4b None None] Authenticating user token {{(pid=352328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:54:10.960871 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b31b30af-68fd-4011-863f-820bbc238720 None admin] Validating token access rules against request {{(pid=352329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:54:10.997597 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5254129d-4b39-41d5-9486-48d0f185d033 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:54:10.998148 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5254129d-4b39-41d5-9486-48d0f185d033 None admin] REQUEST_METHOD: `GET` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:54:10.998437 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5254129d-4b39-41d5-9486-48d0f185d033 None admin] SCRIPT_NAME: `/identity` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:54:10.998713 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5254129d-4b39-41d5-9486-48d0f185d033 None admin] PATH_INFO: `/v3/roles` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:54:10.999449 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5254129d-4b39-41d5-9486-48d0f185d033 None admin] RBAC: Adding query filter params (name=admin) {{(pid=352329) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:54:10.999759 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5254129d-4b39-41d5-9486-48d0f185d033 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:54:11.000360 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG dbcounter [-] [352328] Writing DB stats keystone:SELECT=100 {{(pid=352328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:54:11.001269 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5254129d-4b39-41d5-9486-48d0f185d033 None admin] RBAC: Authorization granted {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:54:11.010760 dv-cinder-851351-1-smb devstack@keystone.service[352329]: [pid: 352329|app: 0|req: 369/746] 10.222.0.42 () {56 vars in 1099 bytes} [Thu Jul 28 08:54:10 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:54:11.016251 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5254129d-4b39-41d5-9486-48d0f185d033 None admin] Authenticating user token {{(pid=352329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:54:11.043265 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99c87ff-7f00-4a0a-bdd6-47c907455f4b None None] Validating token access rules against request {{(pid=352328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:54:11.072706 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG dbcounter [-] [352329] Writing DB stats keystone:SELECT=100 {{(pid=352329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:54:11.080645 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df580073-4bf5-4019-bc3b-3a909871de40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:54:11.081324 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df580073-4bf5-4019-bc3b-3a909871de40 None admin] REQUEST_METHOD: `GET` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:54:11.081611 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df580073-4bf5-4019-bc3b-3a909871de40 None admin] SCRIPT_NAME: `/identity` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:54:11.081953 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df580073-4bf5-4019-bc3b-3a909871de40 None admin] PATH_INFO: `/v3/domains` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:54:11.082665 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df580073-4bf5-4019-bc3b-3a909871de40 None admin] RBAC: Adding query filter params (name=Default) {{(pid=352328) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:54:11.082984 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df580073-4bf5-4019-bc3b-3a909871de40 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:54:11.084369 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df580073-4bf5-4019-bc3b-3a909871de40 None admin] RBAC: Authorization granted {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:54:11.096536 dv-cinder-851351-1-smb devstack@keystone.service[352328]: [pid: 352328|app: 0|req: 378/747] 10.222.0.42 () {56 vars in 1109 bytes} [Thu Jul 28 08:54:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:54:11.097396 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df580073-4bf5-4019-bc3b-3a909871de40 None admin] Authenticating user token {{(pid=352328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:54:11.126958 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5254129d-4b39-41d5-9486-48d0f185d033 None admin] Validating token access rules against request {{(pid=352329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:54:11.171919 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73dcb2ba-5270-49e3-9122-6503c5d3a3dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:54:11.173107 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73dcb2ba-5270-49e3-9122-6503c5d3a3dc None admin] REQUEST_METHOD: `GET` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:54:11.173107 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73dcb2ba-5270-49e3-9122-6503c5d3a3dc None admin] SCRIPT_NAME: `/identity` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:54:11.173516 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73dcb2ba-5270-49e3-9122-6503c5d3a3dc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:54:11.173951 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73dcb2ba-5270-49e3-9122-6503c5d3a3dc None admin] RBAC: Adding query filter params (role.id=280023171b4a45efb67c036ff237bb3c, scope.project.id=9cfa053c839a4fedacde7163d907e2a4, user.id=456c30f8918e4aef8a8e2d65f1f0faf7) {{(pid=352329) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:54:11.174264 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73dcb2ba-5270-49e3-9122-6503c5d3a3dc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:54:11.175738 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73dcb2ba-5270-49e3-9122-6503c5d3a3dc None admin] RBAC: Authorization granted {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:54:11.184640 dv-cinder-851351-1-smb devstack@keystone.service[352329]: [pid: 352329|app: 0|req: 370/748] 10.222.0.42 () {56 vars in 1374 bytes} [Thu Jul 28 08:54:11 2022] GET /identity/v3/role_assignments?user.id=456c30f8918e4aef8a8e2d65f1f0faf7&scope.project.id=9cfa053c839a4fedacde7163d907e2a4&role.id=280023171b4a45efb67c036ff237bb3c => generated 259 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:54:11.184640 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73dcb2ba-5270-49e3-9122-6503c5d3a3dc None admin] Authenticating user token {{(pid=352329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:54:11.227883 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df580073-4bf5-4019-bc3b-3a909871de40 None admin] Validating token access rules against request {{(pid=352328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:54:11.264140 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG dbcounter [-] [352328] Writing DB stats keystone:SELECT=100 {{(pid=352328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:54:11.271526 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0b25e0-dad3-4505-abed-57b72e628982 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:54:11.272196 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0b25e0-dad3-4505-abed-57b72e628982 None admin] REQUEST_METHOD: `POST` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:54:11.272478 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0b25e0-dad3-4505-abed-57b72e628982 None admin] SCRIPT_NAME: `/identity` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:54:11.272829 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0b25e0-dad3-4505-abed-57b72e628982 None admin] PATH_INFO: `/v3/services` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:54:11.273569 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b0b25e0-dad3-4505-abed-57b72e628982 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:54:11.275006 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b0b25e0-dad3-4505-abed-57b72e628982 None admin] RBAC: Authorization granted {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:54:11.296709 dv-cinder-851351-1-smb devstack@keystone.service[352328]: [pid: 352328|app: 0|req: 379/749] 10.222.0.42 () {60 vars in 1141 bytes} [Thu Jul 28 08:54:11 2022] POST /identity/v3/services => generated 240 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 08:54:11.296709 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0b25e0-dad3-4505-abed-57b72e628982 None admin] Authenticating user token {{(pid=352328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:54:11.319207 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73dcb2ba-5270-49e3-9122-6503c5d3a3dc None admin] Validating token access rules against request {{(pid=352329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:54:11.341175 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG dbcounter [-] [352329] Writing DB stats keystone:SELECT=100 {{(pid=352329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:54:11.379964 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269a5b28-220a-408e-88b1-e78ccda6706a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:54:11.380655 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269a5b28-220a-408e-88b1-e78ccda6706a None admin] REQUEST_METHOD: `GET` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:54:11.380988 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269a5b28-220a-408e-88b1-e78ccda6706a None admin] SCRIPT_NAME: `/identity` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:54:11.381262 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269a5b28-220a-408e-88b1-e78ccda6706a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:54:11.394363 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-269a5b28-220a-408e-88b1-e78ccda6706a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:54:11.395957 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-269a5b28-220a-408e-88b1-e78ccda6706a None admin] RBAC: Authorization granted {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:54:11.415373 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application [None req-269a5b28-220a-408e-88b1-e78ccda6706a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 08:54:11.415373 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:54:11.415373 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:54:11.415373 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:54:11.415373 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:54:11.415373 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:54:11.415373 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:54:11.415373 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:54:11.415373 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:54:11.415373 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:54:11.415373 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:54:11.415373 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:54:11.415373 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 08:54:11.415373 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 08:54:11.415373 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 08:54:11.416566 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 08:54:11.416566 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:54:11.416566 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:54:11.416566 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:54:11.416566 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:54:11.416566 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:54:11.416566 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:54:11.416566 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:54:11.416566 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application with Lock( Jul 28 08:54:11.416566 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:54:11.416566 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:54:11.416566 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:54:11.416566 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:54:11.416566 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:54:11.416566 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:54:11.416566 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:54:11.416566 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:54:11.418371 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 08:54:11.418371 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 08:54:11.418371 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 08:54:11.418371 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application Jul 28 08:54:11.418371 dv-cinder-851351-1-smb devstack@keystone.service[352329]: [pid: 352329|app: 0|req: 371/750] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 08:54:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:54:11.419179 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4d3bef-1cbe-47d2-853b-124fbf9c84b4 None None] REQUEST_METHOD: `GET` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:54:11.419481 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4d3bef-1cbe-47d2-853b-124fbf9c84b4 None None] SCRIPT_NAME: `/identity` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:54:11.419767 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4d3bef-1cbe-47d2-853b-124fbf9c84b4 None None] PATH_INFO: `/` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:54:11.421922 dv-cinder-851351-1-smb devstack@keystone.service[352329]: [pid: 352329|app: 0|req: 372/751] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 08:54:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 08:54:11.423035 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4d3bef-1cbe-47d2-853b-124fbf9c84b4 None None] Authenticating user token {{(pid=352329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:54:11.455057 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0b25e0-dad3-4505-abed-57b72e628982 None admin] Validating token access rules against request {{(pid=352328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:54:11.510558 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d61bc0e-8392-49bf-913d-461e813174cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:54:11.511235 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d61bc0e-8392-49bf-913d-461e813174cc None admin] REQUEST_METHOD: `GET` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:54:11.511518 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d61bc0e-8392-49bf-913d-461e813174cc None admin] SCRIPT_NAME: `/identity` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:54:11.511787 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d61bc0e-8392-49bf-913d-461e813174cc None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:54:11.522476 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d61bc0e-8392-49bf-913d-461e813174cc None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:54:11.523876 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d61bc0e-8392-49bf-913d-461e813174cc None admin] RBAC: Authorization granted {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:54:11.541430 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application [None req-3d61bc0e-8392-49bf-913d-461e813174cc None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 28 08:54:11.541430 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:54:11.541430 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:54:11.541430 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:54:11.541430 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:54:11.541430 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:54:11.541430 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:54:11.541430 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:54:11.541430 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:54:11.541430 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:54:11.541430 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:54:11.541430 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:54:11.541430 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 28 08:54:11.541430 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 28 08:54:11.541430 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 28 08:54:11.541430 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 28 08:54:11.543558 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:54:11.543558 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:54:11.543558 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 28 08:54:11.543558 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 08:54:11.543558 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 28 08:54:11.543558 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 08:54:11.543558 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:54:11.543558 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:54:11.543558 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:54:11.543558 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:54:11.543558 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:54:11.543558 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application with Lock( Jul 28 08:54:11.543558 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:54:11.543558 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:54:11.543558 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:54:11.543558 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:54:11.543558 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:54:11.543558 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:54:11.545710 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:54:11.545710 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:54:11.545710 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 28 08:54:11.545710 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 28 08:54:11.545710 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 28 08:54:11.545710 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 28 08:54:11.545710 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 28 08:54:11.545710 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 28 08:54:11.545710 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 28 08:54:11.545710 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application Jul 28 08:54:11.545710 dv-cinder-851351-1-smb devstack@keystone.service[352328]: [pid: 352328|app: 0|req: 380/752] 10.222.0.42 () {56 vars in 1117 bytes} [Thu Jul 28 08:54:11 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 252 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:54:11.547072 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85434a37-b455-485b-a1a0-ad192a379938 None None] REQUEST_METHOD: `POST` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:54:11.547072 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85434a37-b455-485b-a1a0-ad192a379938 None None] SCRIPT_NAME: `/identity` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:54:11.547072 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85434a37-b455-485b-a1a0-ad192a379938 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:54:11.569400 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.auth.core [None req-85434a37-b455-485b-a1a0-ad192a379938 None None] MFA Rules not processed for user `d18c063b2377412485965357671e5506`. Rule list: `[]` (Enabled: `True`). {{(pid=352328) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 08:54:11.570617 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.fernet_utils [None req-85434a37-b455-485b-a1a0-ad192a379938 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=352328) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:54:11.590485 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4d3bef-1cbe-47d2-853b-124fbf9c84b4 None None] Validating token access rules against request {{(pid=352329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:54:11.626637 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG dbcounter [-] [352328] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=352328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:54:11.662945 dv-cinder-851351-1-smb devstack@keystone.service[352328]: [pid: 352328|app: 0|req: 381/753] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 08:54:11 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 08:54:11.668702 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85434a37-b455-485b-a1a0-ad192a379938 None None] Authenticating user token {{(pid=352328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:54:11.678936 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb50907f-c65c-462c-9ae7-49f269415615 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:54:11.680081 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb50907f-c65c-462c-9ae7-49f269415615 None admin] REQUEST_METHOD: `GET` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:54:11.680535 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb50907f-c65c-462c-9ae7-49f269415615 None admin] SCRIPT_NAME: `/identity` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:54:11.681022 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb50907f-c65c-462c-9ae7-49f269415615 None admin] PATH_INFO: `/v3/domains` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:54:11.681961 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb50907f-c65c-462c-9ae7-49f269415615 None admin] RBAC: Adding query filter params (name=Default) {{(pid=352329) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:54:11.682535 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb50907f-c65c-462c-9ae7-49f269415615 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:54:11.684180 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb50907f-c65c-462c-9ae7-49f269415615 None admin] RBAC: Authorization granted {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:54:11.703029 dv-cinder-851351-1-smb devstack@keystone.service[352329]: [pid: 352329|app: 0|req: 373/754] 10.222.0.42 () {56 vars in 1109 bytes} [Thu Jul 28 08:54:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 280 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:54:11.704813 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb50907f-c65c-462c-9ae7-49f269415615 None admin] Authenticating user token {{(pid=352329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:54:11.733651 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG dbcounter [-] [352329] Writing DB stats keystone:SELECT=100 {{(pid=352329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:54:11.800434 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85434a37-b455-485b-a1a0-ad192a379938 None None] Validating token access rules against request {{(pid=352328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:54:11.831801 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb50907f-c65c-462c-9ae7-49f269415615 None admin] Validating token access rules against request {{(pid=352329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:54:11.846327 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac9634f-9a9d-46c2-9564-6da8b85124bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:54:11.846991 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac9634f-9a9d-46c2-9564-6da8b85124bd None admin] REQUEST_METHOD: `GET` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:54:11.847283 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac9634f-9a9d-46c2-9564-6da8b85124bd None admin] SCRIPT_NAME: `/identity` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:54:11.847857 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac9634f-9a9d-46c2-9564-6da8b85124bd None admin] PATH_INFO: `/v3/users` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:54:11.848743 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ac9634f-9a9d-46c2-9564-6da8b85124bd None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=352328) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:54:11.849063 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ac9634f-9a9d-46c2-9564-6da8b85124bd None admin] RBAC: Authorizing `identity:list_users()` {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:54:11.850920 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ac9634f-9a9d-46c2-9564-6da8b85124bd None admin] RBAC: Authorization granted {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:54:11.876166 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4394f8f0-6ee2-48f3-a230-20750b1625ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:54:11.877327 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4394f8f0-6ee2-48f3-a230-20750b1625ba None admin] REQUEST_METHOD: `GET` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:54:11.877924 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4394f8f0-6ee2-48f3-a230-20750b1625ba None admin] SCRIPT_NAME: `/identity` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:54:11.878357 dv-cinder-851351-1-smb devstack@keystone.service[352328]: [pid: 352328|app: 0|req: 382/755] 10.222.0.42 () {56 vars in 1149 bytes} [Thu Jul 28 08:54:11 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:54:11.878710 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4394f8f0-6ee2-48f3-a230-20750b1625ba None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:54:11.879315 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac9634f-9a9d-46c2-9564-6da8b85124bd None admin] Authenticating user token {{(pid=352328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:54:11.879855 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4394f8f0-6ee2-48f3-a230-20750b1625ba None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:54:11.881662 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4394f8f0-6ee2-48f3-a230-20750b1625ba None admin] RBAC: Authorization granted {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:54:11.899000 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application [None req-4394f8f0-6ee2-48f3-a230-20750b1625ba None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 28 08:54:11.899000 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:54:11.899000 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 28 08:54:11.899000 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 28 08:54:11.899000 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 28 08:54:11.899000 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 28 08:54:11.899000 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 28 08:54:11.899000 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 08:54:11.899000 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 28 08:54:11.899000 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application Jul 28 08:54:11.899000 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 28 08:54:11.899000 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application Jul 28 08:54:11.899000 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:54:11.899000 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:54:11.899000 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:54:11.899000 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:54:11.900248 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:54:11.900248 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:54:11.900248 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:54:11.900248 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:54:11.900248 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:54:11.900248 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:54:11.900248 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:54:11.900248 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 28 08:54:11.900248 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 28 08:54:11.900248 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 28 08:54:11.900248 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 28 08:54:11.900248 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:54:11.900248 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:54:11.900248 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:54:11.900248 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:54:11.900248 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:54:11.901408 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:54:11.901408 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:54:11.901408 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application with Lock( Jul 28 08:54:11.901408 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:54:11.901408 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:54:11.901408 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:54:11.901408 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:54:11.901408 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:54:11.901408 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:54:11.901408 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:54:11.901408 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:54:11.901408 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 28 08:54:11.901408 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 08:54:11.901408 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 28 08:54:11.901408 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application Jul 28 08:54:11.905571 dv-cinder-851351-1-smb devstack@keystone.service[352329]: [pid: 352329|app: 0|req: 374/756] 10.222.0.42 () {56 vars in 1129 bytes} [Thu Jul 28 08:54:11 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:54:11.907298 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4394f8f0-6ee2-48f3-a230-20750b1625ba None admin] Authenticating user token {{(pid=352329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:54:11.940843 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG dbcounter [-] [352328] Writing DB stats keystone:SELECT=100 {{(pid=352328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:54:12.023803 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG dbcounter [-] [352329] Writing DB stats keystone:SELECT=100 {{(pid=352329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:54:12.039712 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4394f8f0-6ee2-48f3-a230-20750b1625ba None admin] Validating token access rules against request {{(pid=352329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:54:12.048872 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac9634f-9a9d-46c2-9564-6da8b85124bd None admin] Validating token access rules against request {{(pid=352328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:54:12.077910 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54323597-4b8f-483c-8363-61910f213e1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:54:12.078906 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54323597-4b8f-483c-8363-61910f213e1c None admin] REQUEST_METHOD: `GET` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:54:12.079719 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54323597-4b8f-483c-8363-61910f213e1c None admin] SCRIPT_NAME: `/identity` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:54:12.080158 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54323597-4b8f-483c-8363-61910f213e1c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:54:12.092614 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c018b2bd-47ae-4db6-afca-86cf9da4c65e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:54:12.093518 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c018b2bd-47ae-4db6-afca-86cf9da4c65e None admin] REQUEST_METHOD: `GET` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:54:12.094052 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c018b2bd-47ae-4db6-afca-86cf9da4c65e None admin] SCRIPT_NAME: `/identity` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:54:12.094617 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c018b2bd-47ae-4db6-afca-86cf9da4c65e None admin] PATH_INFO: `/v3/users/nova` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:54:12.105667 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c018b2bd-47ae-4db6-afca-86cf9da4c65e None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:54:12.107837 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c018b2bd-47ae-4db6-afca-86cf9da4c65e None admin] RBAC: Authorization granted {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:54:12.126400 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application [None req-c018b2bd-47ae-4db6-afca-86cf9da4c65e None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 28 08:54:12.126400 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:54:12.126400 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:54:12.126400 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:54:12.126400 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:54:12.126400 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:54:12.126400 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:54:12.126400 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:54:12.126400 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:54:12.126400 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:54:12.126400 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:54:12.126400 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:54:12.126400 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 28 08:54:12.126400 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 28 08:54:12.126400 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 28 08:54:12.126400 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 28 08:54:12.127867 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:54:12.127867 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:54:12.127867 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 28 08:54:12.127867 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 08:54:12.127867 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 28 08:54:12.127867 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 08:54:12.127867 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:54:12.127867 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:54:12.127867 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:54:12.127867 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:54:12.127867 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:54:12.127867 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application with Lock( Jul 28 08:54:12.127867 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:54:12.127867 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:54:12.127867 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:54:12.127867 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:54:12.127867 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:54:12.127867 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:54:12.129317 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:54:12.129317 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:54:12.129317 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 28 08:54:12.129317 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 28 08:54:12.129317 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 28 08:54:12.129317 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 28 08:54:12.129317 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 28 08:54:12.129317 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 28 08:54:12.129317 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 28 08:54:12.129317 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application Jul 28 08:54:12.131117 dv-cinder-851351-1-smb devstack@keystone.service[352328]: [pid: 352328|app: 0|req: 383/757] 10.222.0.42 () {56 vars in 1093 bytes} [Thu Jul 28 08:54:11 2022] GET /identity/v3/users/nova => generated 82 bytes in 252 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:54:12.132157 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c018b2bd-47ae-4db6-afca-86cf9da4c65e None admin] Authenticating user token {{(pid=352328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:54:12.161416 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54323597-4b8f-483c-8363-61910f213e1c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:54:12.163190 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54323597-4b8f-483c-8363-61910f213e1c None admin] RBAC: Authorization granted {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:54:12.238967 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG dbcounter [-] [352328] Writing DB stats keystone:SELECT=100 {{(pid=352328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:54:12.244808 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c018b2bd-47ae-4db6-afca-86cf9da4c65e None admin] Validating token access rules against request {{(pid=352328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:54:12.254281 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG dbcounter [-] [352329] Writing DB stats keystone:SELECT=100 {{(pid=352329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:54:12.269282 dv-cinder-851351-1-smb devstack@keystone.service[352329]: [pid: 352329|app: 0|req: 375/758] 10.222.0.42 () {58 vars in 1282 bytes} [Thu Jul 28 08:54:11 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 363 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 28 08:54:12.270519 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54323597-4b8f-483c-8363-61910f213e1c None admin] Authenticating user token {{(pid=352329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:54:12.282534 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dca4e97-0ade-4a5e-bc2e-bf53192ee2a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:54:12.283315 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dca4e97-0ade-4a5e-bc2e-bf53192ee2a7 None admin] REQUEST_METHOD: `GET` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:54:12.283754 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dca4e97-0ade-4a5e-bc2e-bf53192ee2a7 None admin] SCRIPT_NAME: `/identity` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:54:12.284034 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dca4e97-0ade-4a5e-bc2e-bf53192ee2a7 None admin] PATH_INFO: `/v3/services` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:54:12.284896 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dca4e97-0ade-4a5e-bc2e-bf53192ee2a7 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=352328) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:54:12.285276 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dca4e97-0ade-4a5e-bc2e-bf53192ee2a7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:54:12.286905 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dca4e97-0ade-4a5e-bc2e-bf53192ee2a7 None admin] RBAC: Authorization granted {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:54:12.296817 dv-cinder-851351-1-smb devstack@keystone.service[352328]: [pid: 352328|app: 0|req: 384/759] 10.222.0.42 () {56 vars in 1124 bytes} [Thu Jul 28 08:54:12 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:54:12.296817 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dca4e97-0ade-4a5e-bc2e-bf53192ee2a7 None admin] Authenticating user token {{(pid=352328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:54:12.389988 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54323597-4b8f-483c-8363-61910f213e1c None admin] Validating token access rules against request {{(pid=352329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:54:12.425153 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dca4e97-0ade-4a5e-bc2e-bf53192ee2a7 None admin] Validating token access rules against request {{(pid=352328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:54:12.426629 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb46f10e-aa1a-4cc0-bfc7-b5a3a992d188 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:54:12.427478 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb46f10e-aa1a-4cc0-bfc7-b5a3a992d188 None admin] REQUEST_METHOD: `GET` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:54:12.427924 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb46f10e-aa1a-4cc0-bfc7-b5a3a992d188 None admin] SCRIPT_NAME: `/identity` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:54:12.428352 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb46f10e-aa1a-4cc0-bfc7-b5a3a992d188 None admin] PATH_INFO: `/v3/users` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:54:12.429342 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb46f10e-aa1a-4cc0-bfc7-b5a3a992d188 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=352329) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:54:12.429815 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb46f10e-aa1a-4cc0-bfc7-b5a3a992d188 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:54:12.431453 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb46f10e-aa1a-4cc0-bfc7-b5a3a992d188 None admin] RBAC: Authorization granted {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:54:12.450285 dv-cinder-851351-1-smb devstack@keystone.service[352329]: [pid: 352329|app: 0|req: 376/760] 10.222.0.42 () {56 vars in 1133 bytes} [Thu Jul 28 08:54:12 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:54:12.451378 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb46f10e-aa1a-4cc0-bfc7-b5a3a992d188 None admin] Authenticating user token {{(pid=352329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:54:12.466221 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64cd95ea-cdb8-40f3-983d-0b7c61d79164 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:54:12.466221 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64cd95ea-cdb8-40f3-983d-0b7c61d79164 None admin] REQUEST_METHOD: `GET` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:54:12.466221 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64cd95ea-cdb8-40f3-983d-0b7c61d79164 None admin] SCRIPT_NAME: `/identity` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:54:12.466221 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64cd95ea-cdb8-40f3-983d-0b7c61d79164 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:54:12.479413 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64cd95ea-cdb8-40f3-983d-0b7c61d79164 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:54:12.481025 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64cd95ea-cdb8-40f3-983d-0b7c61d79164 None admin] RBAC: Authorization granted {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:54:12.500537 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application [None req-64cd95ea-cdb8-40f3-983d-0b7c61d79164 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 08:54:12.500537 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:54:12.500537 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:54:12.500537 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:54:12.500537 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:54:12.500537 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:54:12.500537 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:54:12.500537 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:54:12.500537 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:54:12.500537 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:54:12.500537 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:54:12.500537 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:54:12.500537 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 08:54:12.500537 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 08:54:12.500537 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 08:54:12.501936 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 08:54:12.501936 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:54:12.501936 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:54:12.501936 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:54:12.501936 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:54:12.501936 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:54:12.501936 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:54:12.501936 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:54:12.501936 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application with Lock( Jul 28 08:54:12.501936 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:54:12.501936 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:54:12.501936 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:54:12.501936 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:54:12.501936 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:54:12.501936 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:54:12.501936 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:54:12.501936 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:54:12.503255 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 08:54:12.503255 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 08:54:12.503255 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 08:54:12.503255 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application Jul 28 08:54:12.503255 dv-cinder-851351-1-smb devstack@keystone.service[352328]: [pid: 352328|app: 0|req: 385/761] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 08:54:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:54:12.503255 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64cd95ea-cdb8-40f3-983d-0b7c61d79164 None admin] Authenticating user token {{(pid=352328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:54:12.517990 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG dbcounter [-] [352329] Writing DB stats keystone:SELECT=100 {{(pid=352329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:54:12.526419 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG dbcounter [-] [352328] Writing DB stats keystone:SELECT=100 {{(pid=352328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:54:12.583473 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb46f10e-aa1a-4cc0-bfc7-b5a3a992d188 None admin] Validating token access rules against request {{(pid=352329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:54:12.622406 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e918f4-db9a-458e-883b-57acd34886ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:54:12.623065 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e918f4-db9a-458e-883b-57acd34886ef None admin] REQUEST_METHOD: `GET` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:54:12.623336 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e918f4-db9a-458e-883b-57acd34886ef None admin] SCRIPT_NAME: `/identity` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:54:12.623619 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e918f4-db9a-458e-883b-57acd34886ef None admin] PATH_INFO: `/v3/services` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:54:12.624716 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65e918f4-db9a-458e-883b-57acd34886ef None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=352329) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:54:12.625039 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65e918f4-db9a-458e-883b-57acd34886ef None admin] RBAC: Authorizing `identity:list_services()` {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:54:12.626782 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65e918f4-db9a-458e-883b-57acd34886ef None admin] RBAC: Authorization granted {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:54:12.637809 dv-cinder-851351-1-smb devstack@keystone.service[352329]: [pid: 352329|app: 0|req: 377/762] 10.222.0.42 () {56 vars in 1124 bytes} [Thu Jul 28 08:54:12 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:54:12.637809 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e918f4-db9a-458e-883b-57acd34886ef None admin] Authenticating user token {{(pid=352329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:54:12.655191 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64cd95ea-cdb8-40f3-983d-0b7c61d79164 None admin] Validating token access rules against request {{(pid=352328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:54:12.690005 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f7d06d-298f-4105-8737-18628984e690 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:54:12.690630 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f7d06d-298f-4105-8737-18628984e690 None admin] REQUEST_METHOD: `GET` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:54:12.690958 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f7d06d-298f-4105-8737-18628984e690 None admin] SCRIPT_NAME: `/identity` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:54:12.691281 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f7d06d-298f-4105-8737-18628984e690 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:54:12.702385 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48f7d06d-298f-4105-8737-18628984e690 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:54:12.704816 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48f7d06d-298f-4105-8737-18628984e690 None admin] RBAC: Authorization granted {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:54:12.719837 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application [None req-48f7d06d-298f-4105-8737-18628984e690 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 08:54:12.719837 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:54:12.719837 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:54:12.719837 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:54:12.719837 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:54:12.719837 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:54:12.719837 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:54:12.719837 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:54:12.719837 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:54:12.719837 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:54:12.719837 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:54:12.719837 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:54:12.719837 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 08:54:12.719837 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 08:54:12.719837 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 08:54:12.721960 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 08:54:12.721960 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:54:12.721960 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:54:12.721960 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:54:12.721960 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:54:12.721960 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:54:12.721960 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:54:12.721960 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:54:12.721960 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application with Lock( Jul 28 08:54:12.721960 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:54:12.721960 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:54:12.721960 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:54:12.721960 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:54:12.721960 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:54:12.721960 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:54:12.721960 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:54:12.721960 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:54:12.724159 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 08:54:12.724159 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 08:54:12.724159 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 08:54:12.724159 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application Jul 28 08:54:12.726215 dv-cinder-851351-1-smb devstack@keystone.service[352328]: [pid: 352328|app: 0|req: 386/763] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 08:54:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:54:12.727045 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f7d06d-298f-4105-8737-18628984e690 None admin] Authenticating user token {{(pid=352328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:54:12.790108 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e918f4-db9a-458e-883b-57acd34886ef None admin] Validating token access rules against request {{(pid=352329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:54:12.794986 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG dbcounter [-] [352328] Writing DB stats keystone:SELECT=100 {{(pid=352328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:54:12.804503 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG dbcounter [-] [352329] Writing DB stats keystone:SELECT=100 {{(pid=352329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:54:12.832378 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a689e7e2-ec76-4c2b-99d9-c48c85aa73ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:54:12.833517 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a689e7e2-ec76-4c2b-99d9-c48c85aa73ff None admin] REQUEST_METHOD: `GET` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:54:12.834039 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a689e7e2-ec76-4c2b-99d9-c48c85aa73ff None admin] SCRIPT_NAME: `/identity` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:54:12.834588 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a689e7e2-ec76-4c2b-99d9-c48c85aa73ff None admin] PATH_INFO: `/v3/domains` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:54:12.834837 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f7d06d-298f-4105-8737-18628984e690 None admin] Validating token access rules against request {{(pid=352328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:54:12.835793 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a689e7e2-ec76-4c2b-99d9-c48c85aa73ff None admin] RBAC: Adding query filter params (name=Default) {{(pid=352329) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:54:12.836416 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a689e7e2-ec76-4c2b-99d9-c48c85aa73ff None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:54:12.838178 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a689e7e2-ec76-4c2b-99d9-c48c85aa73ff None admin] RBAC: Authorization granted {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:54:12.852348 dv-cinder-851351-1-smb devstack@keystone.service[352329]: [pid: 352329|app: 0|req: 378/764] 10.222.0.42 () {56 vars in 1109 bytes} [Thu Jul 28 08:54:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:54:12.853645 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a689e7e2-ec76-4c2b-99d9-c48c85aa73ff None admin] Authenticating user token {{(pid=352329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:54:12.877170 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eabaa355-ffe8-467f-9a0e-91c094c8df95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:54:12.877834 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabaa355-ffe8-467f-9a0e-91c094c8df95 None admin] REQUEST_METHOD: `GET` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:54:12.878122 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabaa355-ffe8-467f-9a0e-91c094c8df95 None admin] SCRIPT_NAME: `/identity` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:54:12.878402 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabaa355-ffe8-467f-9a0e-91c094c8df95 None admin] PATH_INFO: `/v3/endpoints` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:54:12.879188 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eabaa355-ffe8-467f-9a0e-91c094c8df95 None admin] RBAC: Adding query filter params (interface=public, service_id=3c8c743d37e742d1994d4059a06fceb3, region_id=RegionOne) {{(pid=352328) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:54:12.879503 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eabaa355-ffe8-467f-9a0e-91c094c8df95 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:54:12.880935 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eabaa355-ffe8-467f-9a0e-91c094c8df95 None admin] RBAC: Authorization granted {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:54:12.895421 dv-cinder-851351-1-smb devstack@keystone.service[352328]: [pid: 352328|app: 0|req: 387/765] 10.222.0.42 () {56 vars in 1251 bytes} [Thu Jul 28 08:54:12 2022] GET /identity/v3/endpoints?service_id=3c8c743d37e742d1994d4059a06fceb3&interface=public®ion_id=RegionOne => generated 194 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:54:12.895421 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eabaa355-ffe8-467f-9a0e-91c094c8df95 None admin] Authenticating user token {{(pid=352328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:54:13.000018 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eabaa355-ffe8-467f-9a0e-91c094c8df95 None admin] Validating token access rules against request {{(pid=352328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:54:13.004491 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a689e7e2-ec76-4c2b-99d9-c48c85aa73ff None admin] Validating token access rules against request {{(pid=352329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:54:13.032865 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG dbcounter [-] [352328] Writing DB stats keystone:SELECT=100 {{(pid=352328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:54:13.039944 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a1a6b07-02a0-407b-bd79-5261cfe9a801 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:54:13.040618 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1a6b07-02a0-407b-bd79-5261cfe9a801 None admin] REQUEST_METHOD: `GET` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:54:13.040948 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1a6b07-02a0-407b-bd79-5261cfe9a801 None admin] SCRIPT_NAME: `/identity` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:54:13.041225 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1a6b07-02a0-407b-bd79-5261cfe9a801 None admin] PATH_INFO: `/v3/projects/service` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:54:13.048236 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538770ff-25dc-4a95-a2b4-0612d6167dea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:54:13.048838 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a1a6b07-02a0-407b-bd79-5261cfe9a801 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:54:13.049456 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538770ff-25dc-4a95-a2b4-0612d6167dea None admin] REQUEST_METHOD: `GET` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:54:13.050011 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538770ff-25dc-4a95-a2b4-0612d6167dea None admin] SCRIPT_NAME: `/identity` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:54:13.050309 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a1a6b07-02a0-407b-bd79-5261cfe9a801 None admin] RBAC: Authorization granted {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:54:13.050750 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538770ff-25dc-4a95-a2b4-0612d6167dea None admin] PATH_INFO: `/v3/domains` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:54:13.051679 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-538770ff-25dc-4a95-a2b4-0612d6167dea None admin] RBAC: Adding query filter params (name=Default) {{(pid=352329) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:54:13.052300 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-538770ff-25dc-4a95-a2b4-0612d6167dea None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:54:13.054073 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-538770ff-25dc-4a95-a2b4-0612d6167dea None admin] RBAC: Authorization granted {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:54:13.063150 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application [None req-7a1a6b07-02a0-407b-bd79-5261cfe9a801 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 08:54:13.063150 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:54:13.063150 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:54:13.063150 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:54:13.063150 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:54:13.063150 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:54:13.063150 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:54:13.063150 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:54:13.063150 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:54:13.063150 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:54:13.063150 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:54:13.063150 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:54:13.063150 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 28 08:54:13.063150 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 28 08:54:13.063150 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 28 08:54:13.064348 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 28 08:54:13.064348 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:54:13.064348 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:54:13.064348 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:54:13.064348 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:54:13.064348 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:54:13.064348 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:54:13.064348 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:54:13.064348 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application with Lock( Jul 28 08:54:13.064348 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:54:13.064348 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:54:13.064348 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:54:13.064348 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:54:13.064348 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:54:13.064348 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:54:13.064348 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:54:13.064348 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:54:13.065506 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 28 08:54:13.065506 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 28 08:54:13.065506 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 28 08:54:13.065506 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 28 08:54:13.065506 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 28 08:54:13.065506 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 28 08:54:13.065506 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 08:54:13.065506 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application Jul 28 08:54:13.069287 dv-cinder-851351-1-smb devstack@keystone.service[352328]: [pid: 352328|app: 0|req: 388/766] 10.222.0.42 () {56 vars in 1111 bytes} [Thu Jul 28 08:54:12 2022] GET /identity/v3/projects/service => generated 88 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:54:13.070279 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a1a6b07-02a0-407b-bd79-5261cfe9a801 None admin] Authenticating user token {{(pid=352328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:54:13.071733 dv-cinder-851351-1-smb devstack@keystone.service[352329]: [pid: 352329|app: 0|req: 379/767] 10.222.0.42 () {56 vars in 1109 bytes} [Thu Jul 28 08:54:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:54:13.072849 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538770ff-25dc-4a95-a2b4-0612d6167dea None admin] Authenticating user token {{(pid=352329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:54:13.106896 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG dbcounter [-] [352329] Writing DB stats keystone:SELECT=100 {{(pid=352329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:54:13.187296 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538770ff-25dc-4a95-a2b4-0612d6167dea None admin] Validating token access rules against request {{(pid=352329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:54:13.191873 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a1a6b07-02a0-407b-bd79-5261cfe9a801 None admin] Validating token access rules against request {{(pid=352328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:54:13.229422 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2bfdfb5-d750-44f0-b6fb-5dce3317f214 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:54:13.230076 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2bfdfb5-d750-44f0-b6fb-5dce3317f214 None admin] REQUEST_METHOD: `GET` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:54:13.230365 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2bfdfb5-d750-44f0-b6fb-5dce3317f214 None admin] SCRIPT_NAME: `/identity` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:54:13.230647 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2bfdfb5-d750-44f0-b6fb-5dce3317f214 None admin] PATH_INFO: `/v3/projects` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:54:13.231518 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2bfdfb5-d750-44f0-b6fb-5dce3317f214 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=352329) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:54:13.231825 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2bfdfb5-d750-44f0-b6fb-5dce3317f214 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:54:13.233370 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2bfdfb5-d750-44f0-b6fb-5dce3317f214 None admin] RBAC: Authorization granted {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:54:13.236920 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-423e33c4-3b10-4997-9111-6cd23e15ec8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:54:13.237955 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423e33c4-3b10-4997-9111-6cd23e15ec8e None admin] REQUEST_METHOD: `GET` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:54:13.238469 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423e33c4-3b10-4997-9111-6cd23e15ec8e None admin] SCRIPT_NAME: `/identity` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:54:13.238971 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423e33c4-3b10-4997-9111-6cd23e15ec8e None admin] PATH_INFO: `/v3/services` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:54:13.239884 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-423e33c4-3b10-4997-9111-6cd23e15ec8e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:54:13.241587 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-423e33c4-3b10-4997-9111-6cd23e15ec8e None admin] RBAC: Authorization granted {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:54:13.253076 dv-cinder-851351-1-smb devstack@keystone.service[352329]: [pid: 352329|app: 0|req: 380/768] 10.222.0.42 () {56 vars in 1148 bytes} [Thu Jul 28 08:54:13 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:54:13.253806 dv-cinder-851351-1-smb devstack@keystone.service[352328]: [pid: 352328|app: 0|req: 389/769] 10.222.0.42 () {56 vars in 1087 bytes} [Thu Jul 28 08:54:13 2022] GET /identity/v3/services => generated 772 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:54:13.254088 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2bfdfb5-d750-44f0-b6fb-5dce3317f214 None admin] Authenticating user token {{(pid=352329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:54:13.254991 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-423e33c4-3b10-4997-9111-6cd23e15ec8e None admin] Authenticating user token {{(pid=352328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:54:13.345228 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG dbcounter [-] [352328] Writing DB stats keystone:SELECT=100 {{(pid=352328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:54:13.394290 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG dbcounter [-] [352329] Writing DB stats keystone:SELECT=100 {{(pid=352329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:54:13.411456 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2bfdfb5-d750-44f0-b6fb-5dce3317f214 None admin] Validating token access rules against request {{(pid=352329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:54:13.412094 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-423e33c4-3b10-4997-9111-6cd23e15ec8e None admin] Validating token access rules against request {{(pid=352328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:54:13.457122 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e62ea1-cb5a-4eba-8f15-a88eda42b01d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:54:13.458237 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e62ea1-cb5a-4eba-8f15-a88eda42b01d None admin] REQUEST_METHOD: `GET` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:54:13.458507 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e62ea1-cb5a-4eba-8f15-a88eda42b01d None admin] SCRIPT_NAME: `/identity` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:54:13.458812 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e62ea1-cb5a-4eba-8f15-a88eda42b01d None admin] PATH_INFO: `/v3/projects/service` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:54:13.458987 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2632bf2-1937-49e0-aa22-ef1bcc3a0c42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:54:13.459587 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2632bf2-1937-49e0-aa22-ef1bcc3a0c42 None admin] REQUEST_METHOD: `GET` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:54:13.459846 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2632bf2-1937-49e0-aa22-ef1bcc3a0c42 None admin] SCRIPT_NAME: `/identity` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:54:13.460117 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2632bf2-1937-49e0-aa22-ef1bcc3a0c42 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:54:13.461003 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2632bf2-1937-49e0-aa22-ef1bcc3a0c42 None admin] RBAC: Adding query filter params (role.id=32da6d9f8d8f48e285530909f7633410, scope.project.id=9cfa053c839a4fedacde7163d907e2a4, user.id=02fa8a25f4a844faac620f7db414011a) {{(pid=352328) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:54:13.461294 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2632bf2-1937-49e0-aa22-ef1bcc3a0c42 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:54:13.463512 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2632bf2-1937-49e0-aa22-ef1bcc3a0c42 None admin] RBAC: Authorization granted {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:54:13.467986 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e62ea1-cb5a-4eba-8f15-a88eda42b01d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:54:13.470477 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e62ea1-cb5a-4eba-8f15-a88eda42b01d None admin] RBAC: Authorization granted {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:54:13.473371 dv-cinder-851351-1-smb devstack@keystone.service[352328]: [pid: 352328|app: 0|req: 390/770] 10.222.0.42 () {56 vars in 1374 bytes} [Thu Jul 28 08:54:13 2022] GET /identity/v3/role_assignments?user.id=02fa8a25f4a844faac620f7db414011a&scope.project.id=9cfa053c839a4fedacde7163d907e2a4&role.id=32da6d9f8d8f48e285530909f7633410 => generated 259 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:54:13.474488 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf1f202-1334-47f3-8ccb-6cb666d8b113 None None] REQUEST_METHOD: `GET` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:54:13.474752 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf1f202-1334-47f3-8ccb-6cb666d8b113 None None] SCRIPT_NAME: `/identity` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:54:13.475029 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf1f202-1334-47f3-8ccb-6cb666d8b113 None None] PATH_INFO: `/` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:54:13.481167 dv-cinder-851351-1-smb devstack@keystone.service[352328]: [pid: 352328|app: 0|req: 391/771] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 08:54:13 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 08:54:13.484801 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application [None req-51e62ea1-cb5a-4eba-8f15-a88eda42b01d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 08:54:13.484801 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:54:13.484801 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:54:13.484801 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:54:13.484801 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:54:13.484801 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:54:13.484801 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:54:13.484801 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:54:13.484801 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:54:13.484801 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:54:13.484801 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:54:13.484801 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:54:13.484801 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 28 08:54:13.484801 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 28 08:54:13.484801 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 28 08:54:13.486032 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 28 08:54:13.486032 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:54:13.486032 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:54:13.486032 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:54:13.486032 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:54:13.486032 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:54:13.486032 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:54:13.486032 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:54:13.486032 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application with Lock( Jul 28 08:54:13.486032 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:54:13.486032 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:54:13.486032 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:54:13.486032 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:54:13.486032 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:54:13.486032 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:54:13.486032 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:54:13.486032 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:54:13.487522 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 28 08:54:13.487522 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 28 08:54:13.487522 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 28 08:54:13.487522 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 28 08:54:13.487522 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 28 08:54:13.487522 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 28 08:54:13.487522 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 08:54:13.487522 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application Jul 28 08:54:13.487522 dv-cinder-851351-1-smb devstack@keystone.service[352329]: [pid: 352329|app: 0|req: 381/772] 10.222.0.42 () {56 vars in 1111 bytes} [Thu Jul 28 08:54:13 2022] GET /identity/v3/projects/service => generated 88 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:54:13.489850 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775fea10-aee7-4341-b745-608b5e29b4a5 None None] REQUEST_METHOD: `GET` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:54:13.490019 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede50c51-8fec-457c-b364-ae2577579cad None None] REQUEST_METHOD: `POST` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:54:13.490346 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede50c51-8fec-457c-b364-ae2577579cad None None] SCRIPT_NAME: `/identity` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:54:13.490634 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775fea10-aee7-4341-b745-608b5e29b4a5 None None] SCRIPT_NAME: `/identity` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:54:13.490771 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede50c51-8fec-457c-b364-ae2577579cad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:54:13.491301 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775fea10-aee7-4341-b745-608b5e29b4a5 None None] PATH_INFO: `/` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:54:13.492998 dv-cinder-851351-1-smb devstack@keystone.service[352328]: [pid: 352328|app: 0|req: 392/773] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 08:54:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 08:54:13.500701 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-775fea10-aee7-4341-b745-608b5e29b4a5 None None] Authenticating user token {{(pid=352328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:54:13.512794 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.auth.core [None req-ede50c51-8fec-457c-b364-ae2577579cad None None] MFA Rules not processed for user `d18c063b2377412485965357671e5506`. Rule list: `[]` (Enabled: `True`). {{(pid=352329) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 08:54:13.513920 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.fernet_utils [None req-ede50c51-8fec-457c-b364-ae2577579cad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=352329) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:54:13.599476 dv-cinder-851351-1-smb devstack@keystone.service[352329]: [pid: 352329|app: 0|req: 382/774] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 08:54:13 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 08:54:13.606160 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bddb0fa7-6183-41d9-96c1-6e479ff863e3 None None] REQUEST_METHOD: `POST` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:54:13.606522 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bddb0fa7-6183-41d9-96c1-6e479ff863e3 None None] SCRIPT_NAME: `/identity` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:54:13.606721 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bddb0fa7-6183-41d9-96c1-6e479ff863e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:54:13.616122 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-775fea10-aee7-4341-b745-608b5e29b4a5 None None] Validating token access rules against request {{(pid=352328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:54:13.637093 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG dbcounter [-] [352328] Writing DB stats keystone:SELECT=100 {{(pid=352328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:54:13.642944 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.auth.core [None req-bddb0fa7-6183-41d9-96c1-6e479ff863e3 None None] MFA Rules not processed for user `d18c063b2377412485965357671e5506`. Rule list: `[]` (Enabled: `True`). {{(pid=352329) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 08:54:13.644339 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.fernet_utils [None req-bddb0fa7-6183-41d9-96c1-6e479ff863e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=352329) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:54:13.663420 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21957ad-4ae6-4922-a92f-7ed1b2121c69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:54:13.664170 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21957ad-4ae6-4922-a92f-7ed1b2121c69 None admin] REQUEST_METHOD: `GET` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:54:13.664457 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21957ad-4ae6-4922-a92f-7ed1b2121c69 None admin] SCRIPT_NAME: `/identity` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:54:13.664766 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21957ad-4ae6-4922-a92f-7ed1b2121c69 None admin] PATH_INFO: `/v3/projects` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:54:13.665548 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b21957ad-4ae6-4922-a92f-7ed1b2121c69 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=352328) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:54:13.665856 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b21957ad-4ae6-4922-a92f-7ed1b2121c69 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:54:13.667323 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b21957ad-4ae6-4922-a92f-7ed1b2121c69 None admin] RBAC: Authorization granted {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:54:13.682647 dv-cinder-851351-1-smb devstack@keystone.service[352328]: [pid: 352328|app: 0|req: 393/775] 10.222.0.42 () {56 vars in 1148 bytes} [Thu Jul 28 08:54:13 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:54:13.688964 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21957ad-4ae6-4922-a92f-7ed1b2121c69 None admin] Authenticating user token {{(pid=352328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:54:13.719366 dv-cinder-851351-1-smb devstack@keystone.service[352329]: [pid: 352329|app: 0|req: 383/776] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 08:54:13 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 08:54:13.720293 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bddb0fa7-6183-41d9-96c1-6e479ff863e3 None None] Authenticating user token {{(pid=352329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:54:13.732995 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG dbcounter [-] [352329] Writing DB stats keystone:SELECT=100 {{(pid=352329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:54:13.819329 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21957ad-4ae6-4922-a92f-7ed1b2121c69 None admin] Validating token access rules against request {{(pid=352328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:54:13.847254 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bddb0fa7-6183-41d9-96c1-6e479ff863e3 None None] Validating token access rules against request {{(pid=352329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:54:13.859353 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a78f16f4-26a8-4040-a00e-bc3c50a98bac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:54:13.860558 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78f16f4-26a8-4040-a00e-bc3c50a98bac None admin] REQUEST_METHOD: `GET` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:54:13.861197 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78f16f4-26a8-4040-a00e-bc3c50a98bac None admin] SCRIPT_NAME: `/identity` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:54:13.861718 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78f16f4-26a8-4040-a00e-bc3c50a98bac None admin] PATH_INFO: `/v3/roles/admin` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:54:13.873931 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a78f16f4-26a8-4040-a00e-bc3c50a98bac None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 08:54:13.880083 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application [None req-a78f16f4-26a8-4040-a00e-bc3c50a98bac None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 08:54:13.880083 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:54:13.880083 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:54:13.880083 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:54:13.880083 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:54:13.880083 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:54:13.880083 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:54:13.880083 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:54:13.880083 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:54:13.880083 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:54:13.880083 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:54:13.880083 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:54:13.880083 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 08:54:13.880083 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 08:54:13.880083 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 08:54:13.880083 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 08:54:13.881283 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 08:54:13.881283 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 08:54:13.881283 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 08:54:13.881283 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 08:54:13.881283 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:54:13.881283 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:54:13.881283 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:54:13.881283 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:54:13.881283 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:54:13.881283 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:54:13.881283 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:54:13.881283 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application with Lock( Jul 28 08:54:13.881283 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:54:13.881283 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:54:13.881283 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:54:13.881283 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:54:13.882346 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:54:13.882346 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:54:13.882346 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:54:13.882346 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:54:13.882346 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 08:54:13.882346 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 08:54:13.882346 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 08:54:13.882346 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 08:54:13.882346 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 08:54:13.882346 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 08:54:13.882346 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 08:54:13.882346 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application Jul 28 08:54:13.888707 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b609c689-226a-41f3-9f17-f0e62b924bf2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:54:13.888954 dv-cinder-851351-1-smb devstack@keystone.service[352328]: [pid: 352328|app: 0|req: 394/777] 10.222.0.42 () {56 vars in 1096 bytes} [Thu Jul 28 08:54:13 2022] GET /identity/v3/roles/admin => generated 83 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:54:13.889314 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b609c689-226a-41f3-9f17-f0e62b924bf2 None admin] REQUEST_METHOD: `PUT` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:54:13.889605 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b609c689-226a-41f3-9f17-f0e62b924bf2 None admin] SCRIPT_NAME: `/identity` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:54:13.889879 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b609c689-226a-41f3-9f17-f0e62b924bf2 None admin] PATH_INFO: `/v3/projects/9cfa053c839a4fedacde7163d907e2a4/users/e3ba63c3fc36470fbbe8312b51a13f13/roles/280023171b4a45efb67c036ff237bb3c` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:54:13.890131 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a78f16f4-26a8-4040-a00e-bc3c50a98bac None admin] Authenticating user token {{(pid=352328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:54:13.892039 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b609c689-226a-41f3-9f17-f0e62b924bf2 None admin] RBAC: Authorizing `identity:create_grant(project_id=9cfa053c839a4fedacde7163d907e2a4, user_id=e3ba63c3fc36470fbbe8312b51a13f13, role_id=280023171b4a45efb67c036ff237bb3c)` {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:54:13.893635 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b609c689-226a-41f3-9f17-f0e62b924bf2 None admin] RBAC: Authorization granted {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:54:13.916799 dv-cinder-851351-1-smb devstack@keystone.service[352329]: [pid: 352329|app: 0|req: 384/778] 10.222.0.42 () {58 vars in 1439 bytes} [Thu Jul 28 08:54:13 2022] PUT /identity/v3/projects/9cfa053c839a4fedacde7163d907e2a4/users/e3ba63c3fc36470fbbe8312b51a13f13/roles/280023171b4a45efb67c036ff237bb3c => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 08:54:13.918268 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b609c689-226a-41f3-9f17-f0e62b924bf2 None admin] Authenticating user token {{(pid=352329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:54:13.981383 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG dbcounter [-] [352328] Writing DB stats keystone:SELECT=100 {{(pid=352328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:54:14.052410 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG dbcounter [-] [352329] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=352329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:54:14.118215 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b609c689-226a-41f3-9f17-f0e62b924bf2 None admin] Validating token access rules against request {{(pid=352329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:54:14.135081 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a78f16f4-26a8-4040-a00e-bc3c50a98bac None admin] Validating token access rules against request {{(pid=352328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:54:14.157474 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63953aaf-d11f-45b8-8cbb-74db44aa38a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:54:14.158141 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63953aaf-d11f-45b8-8cbb-74db44aa38a3 None admin] REQUEST_METHOD: `GET` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:54:14.158521 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63953aaf-d11f-45b8-8cbb-74db44aa38a3 None admin] SCRIPT_NAME: `/identity` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:54:14.158946 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63953aaf-d11f-45b8-8cbb-74db44aa38a3 None admin] PATH_INFO: `/v3/roles` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:54:14.159785 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63953aaf-d11f-45b8-8cbb-74db44aa38a3 None admin] RBAC: Adding query filter params (name=admin) {{(pid=352329) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:54:14.160196 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63953aaf-d11f-45b8-8cbb-74db44aa38a3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:54:14.162051 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63953aaf-d11f-45b8-8cbb-74db44aa38a3 None admin] RBAC: Authorization granted {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:54:14.173829 dv-cinder-851351-1-smb devstack@keystone.service[352329]: [pid: 352329|app: 0|req: 385/779] 10.222.0.42 () {56 vars in 1099 bytes} [Thu Jul 28 08:54:13 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:54:14.178818 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b249e0-ef9d-4a2a-97a8-b08ad9bbec0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:54:14.179832 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b249e0-ef9d-4a2a-97a8-b08ad9bbec0a None admin] REQUEST_METHOD: `GET` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:54:14.180279 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b249e0-ef9d-4a2a-97a8-b08ad9bbec0a None admin] SCRIPT_NAME: `/identity` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:54:14.180764 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b249e0-ef9d-4a2a-97a8-b08ad9bbec0a None admin] PATH_INFO: `/v3/services/network` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:54:14.181643 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3b249e0-ef9d-4a2a-97a8-b08ad9bbec0a None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:54:14.182904 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63953aaf-d11f-45b8-8cbb-74db44aa38a3 None admin] Authenticating user token {{(pid=352329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:54:14.183535 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3b249e0-ef9d-4a2a-97a8-b08ad9bbec0a None admin] RBAC: Authorization granted {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:54:14.193957 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application [None req-f3b249e0-ef9d-4a2a-97a8-b08ad9bbec0a None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jul 28 08:54:14.193957 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:54:14.193957 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 28 08:54:14.193957 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 28 08:54:14.193957 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 28 08:54:14.193957 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 28 08:54:14.193957 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 28 08:54:14.193957 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 08:54:14.193957 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 28 08:54:14.193957 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application Jul 28 08:54:14.193957 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 28 08:54:14.193957 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application Jul 28 08:54:14.193957 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:54:14.193957 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:54:14.193957 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:54:14.193957 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:54:14.193957 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:54:14.195858 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:54:14.195858 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:54:14.195858 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:54:14.195858 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:54:14.195858 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:54:14.195858 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:54:14.195858 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 28 08:54:14.195858 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 28 08:54:14.195858 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 28 08:54:14.195858 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 28 08:54:14.195858 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:54:14.195858 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:54:14.195858 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:54:14.195858 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:54:14.195858 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:54:14.195858 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:54:14.197070 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:54:14.197070 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application with Lock( Jul 28 08:54:14.197070 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:54:14.197070 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:54:14.197070 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:54:14.197070 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:54:14.197070 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:54:14.197070 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:54:14.197070 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:54:14.197070 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:54:14.197070 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 28 08:54:14.197070 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 08:54:14.197070 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 28 08:54:14.197070 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application Jul 28 08:54:14.199953 dv-cinder-851351-1-smb devstack@keystone.service[352328]: [pid: 352328|app: 0|req: 395/780] 10.222.0.42 () {56 vars in 1111 bytes} [Thu Jul 28 08:54:13 2022] GET /identity/v3/services/network => generated 88 bytes in 310 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:54:14.206828 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b249e0-ef9d-4a2a-97a8-b08ad9bbec0a None admin] Authenticating user token {{(pid=352328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:54:14.318692 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63953aaf-d11f-45b8-8cbb-74db44aa38a3 None admin] Validating token access rules against request {{(pid=352329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:54:14.345918 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b249e0-ef9d-4a2a-97a8-b08ad9bbec0a None admin] Validating token access rules against request {{(pid=352328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:54:14.348535 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG dbcounter [-] [352328] Writing DB stats keystone:SELECT=100 {{(pid=352328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:54:14.380018 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG dbcounter [-] [352329] Writing DB stats keystone:SELECT=100 {{(pid=352329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:54:14.390452 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f35deb52-9cd7-4256-82e1-56c2a9f1263f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:54:14.391571 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35deb52-9cd7-4256-82e1-56c2a9f1263f None admin] REQUEST_METHOD: `GET` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:54:14.391858 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35deb52-9cd7-4256-82e1-56c2a9f1263f None admin] SCRIPT_NAME: `/identity` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:54:14.392132 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35deb52-9cd7-4256-82e1-56c2a9f1263f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:54:14.408981 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f35deb52-9cd7-4256-82e1-56c2a9f1263f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:54:14.410684 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f35deb52-9cd7-4256-82e1-56c2a9f1263f None admin] RBAC: Authorization granted {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:54:14.426941 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application [None req-f35deb52-9cd7-4256-82e1-56c2a9f1263f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 08:54:14.426941 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:54:14.426941 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:54:14.426941 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:54:14.426941 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:54:14.426941 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:54:14.426941 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:54:14.426941 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:54:14.426941 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:54:14.426941 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:54:14.426941 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:54:14.426941 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:54:14.426941 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 08:54:14.426941 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 08:54:14.426941 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 08:54:14.428110 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 08:54:14.428110 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:54:14.428110 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:54:14.428110 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:54:14.428110 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:54:14.428110 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:54:14.428110 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:54:14.428110 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:54:14.428110 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application with Lock( Jul 28 08:54:14.428110 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:54:14.428110 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:54:14.428110 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:54:14.428110 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:54:14.428110 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:54:14.428110 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:54:14.428110 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:54:14.428110 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:54:14.429281 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 08:54:14.429281 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 08:54:14.429281 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 08:54:14.429281 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application Jul 28 08:54:14.429281 dv-cinder-851351-1-smb devstack@keystone.service[352329]: [pid: 352329|app: 0|req: 386/781] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 08:54:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 246 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:54:14.434146 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb51d0a-44c8-4b83-a79c-e556897c53f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:54:14.434808 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb51d0a-44c8-4b83-a79c-e556897c53f3 None admin] REQUEST_METHOD: `GET` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:54:14.435093 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb51d0a-44c8-4b83-a79c-e556897c53f3 None admin] SCRIPT_NAME: `/identity` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:54:14.435368 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb51d0a-44c8-4b83-a79c-e556897c53f3 None admin] PATH_INFO: `/v3/services` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:54:14.436078 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecb51d0a-44c8-4b83-a79c-e556897c53f3 None admin] RBAC: Adding query filter params (name=network) {{(pid=352328) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:54:14.437332 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f35deb52-9cd7-4256-82e1-56c2a9f1263f None admin] Authenticating user token {{(pid=352329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:54:14.438039 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecb51d0a-44c8-4b83-a79c-e556897c53f3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:54:14.439505 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecb51d0a-44c8-4b83-a79c-e556897c53f3 None admin] RBAC: Authorization granted {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:54:14.455199 dv-cinder-851351-1-smb devstack@keystone.service[352328]: [pid: 352328|app: 0|req: 396/782] 10.222.0.42 () {56 vars in 1112 bytes} [Thu Jul 28 08:54:14 2022] GET /identity/v3/services?name=network => generated 124 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:54:14.461058 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb51d0a-44c8-4b83-a79c-e556897c53f3 None admin] Authenticating user token {{(pid=352328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:54:14.642399 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f35deb52-9cd7-4256-82e1-56c2a9f1263f None admin] Validating token access rules against request {{(pid=352329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:54:14.649058 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb51d0a-44c8-4b83-a79c-e556897c53f3 None admin] Validating token access rules against request {{(pid=352328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:54:14.691805 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c4c91c5-ba5c-4798-a3c4-cd063c640d18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:54:14.692444 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4c91c5-ba5c-4798-a3c4-cd063c640d18 None admin] REQUEST_METHOD: `GET` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:54:14.692752 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4c91c5-ba5c-4798-a3c4-cd063c640d18 None admin] SCRIPT_NAME: `/identity` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:54:14.693025 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4c91c5-ba5c-4798-a3c4-cd063c640d18 None admin] PATH_INFO: `/v3/services` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:54:14.693698 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4cbcb6c-b52e-46db-a678-b2312b5ee8d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:54:14.693847 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c4c91c5-ba5c-4798-a3c4-cd063c640d18 None admin] RBAC: Adding query filter params (type=network) {{(pid=352328) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:54:14.694052 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c4c91c5-ba5c-4798-a3c4-cd063c640d18 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:54:14.694902 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4cbcb6c-b52e-46db-a678-b2312b5ee8d8 None admin] REQUEST_METHOD: `GET` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:54:14.695391 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c4c91c5-ba5c-4798-a3c4-cd063c640d18 None admin] RBAC: Authorization granted {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:54:14.695617 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4cbcb6c-b52e-46db-a678-b2312b5ee8d8 None admin] SCRIPT_NAME: `/identity` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:54:14.696094 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4cbcb6c-b52e-46db-a678-b2312b5ee8d8 None admin] PATH_INFO: `/v3/domains` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:54:14.697197 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4cbcb6c-b52e-46db-a678-b2312b5ee8d8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=352329) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:54:14.697840 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4cbcb6c-b52e-46db-a678-b2312b5ee8d8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:54:14.699493 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4cbcb6c-b52e-46db-a678-b2312b5ee8d8 None admin] RBAC: Authorization granted {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:54:14.701354 dv-cinder-851351-1-smb devstack@keystone.service[352328]: [pid: 352328|app: 0|req: 397/783] 10.222.0.42 () {56 vars in 1112 bytes} [Thu Jul 28 08:54:14 2022] GET /identity/v3/services?type=network => generated 350 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:54:14.707777 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c4c91c5-ba5c-4798-a3c4-cd063c640d18 None admin] Authenticating user token {{(pid=352328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:54:14.723091 dv-cinder-851351-1-smb devstack@keystone.service[352329]: [pid: 352329|app: 0|req: 387/784] 10.222.0.42 () {56 vars in 1109 bytes} [Thu Jul 28 08:54:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 286 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:54:14.738189 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4cbcb6c-b52e-46db-a678-b2312b5ee8d8 None admin] Authenticating user token {{(pid=352329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:54:14.771064 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG dbcounter [-] [352328] Writing DB stats keystone:SELECT=100 {{(pid=352328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:54:14.839646 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG dbcounter [-] [352329] Writing DB stats keystone:SELECT=100 {{(pid=352329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:54:14.855407 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c4c91c5-ba5c-4798-a3c4-cd063c640d18 None admin] Validating token access rules against request {{(pid=352328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:54:14.891480 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4111e717-be29-4dc6-ba44-64cd482aaae2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:54:14.892123 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4111e717-be29-4dc6-ba44-64cd482aaae2 None admin] REQUEST_METHOD: `GET` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:54:14.892516 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4111e717-be29-4dc6-ba44-64cd482aaae2 None admin] SCRIPT_NAME: `/identity` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:54:14.892761 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4111e717-be29-4dc6-ba44-64cd482aaae2 None admin] PATH_INFO: `/v3/endpoints` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:54:14.893546 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4111e717-be29-4dc6-ba44-64cd482aaae2 None admin] RBAC: Adding query filter params (interface=public, service_id=2a56853905c444bfa4639d494ebf8ba9, region_id=RegionOne) {{(pid=352328) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:54:14.893856 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4111e717-be29-4dc6-ba44-64cd482aaae2 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:54:14.895266 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4111e717-be29-4dc6-ba44-64cd482aaae2 None admin] RBAC: Authorization granted {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:54:14.901369 dv-cinder-851351-1-smb devstack@keystone.service[352328]: [pid: 352328|app: 0|req: 398/785] 10.222.0.42 () {56 vars in 1251 bytes} [Thu Jul 28 08:54:14 2022] GET /identity/v3/endpoints?service_id=2a56853905c444bfa4639d494ebf8ba9&interface=public®ion_id=RegionOne => generated 194 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:54:14.907086 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4111e717-be29-4dc6-ba44-64cd482aaae2 None admin] Authenticating user token {{(pid=352328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:54:15.000984 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4cbcb6c-b52e-46db-a678-b2312b5ee8d8 None admin] Validating token access rules against request {{(pid=352329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:54:15.043880 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG dbcounter [-] [352328] Writing DB stats keystone:SELECT=100 {{(pid=352328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:54:15.056500 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4111e717-be29-4dc6-ba44-64cd482aaae2 None admin] Validating token access rules against request {{(pid=352328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:54:15.074324 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd544c1-371e-4ceb-86ea-0fd17df5c740 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:54:15.075004 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd544c1-371e-4ceb-86ea-0fd17df5c740 None admin] REQUEST_METHOD: `GET` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:54:15.075287 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd544c1-371e-4ceb-86ea-0fd17df5c740 None admin] SCRIPT_NAME: `/identity` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:54:15.075564 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd544c1-371e-4ceb-86ea-0fd17df5c740 None admin] PATH_INFO: `/v3/users/swift` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:54:15.090672 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bd544c1-371e-4ceb-86ea-0fd17df5c740 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:54:15.092171 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bd544c1-371e-4ceb-86ea-0fd17df5c740 None admin] RBAC: Authorization granted {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:54:15.130937 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application [None req-2bd544c1-371e-4ceb-86ea-0fd17df5c740 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 28 08:54:15.130937 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:54:15.130937 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:54:15.130937 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:54:15.130937 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:54:15.130937 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:54:15.130937 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:54:15.130937 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:54:15.130937 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:54:15.130937 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:54:15.130937 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:54:15.130937 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:54:15.130937 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 28 08:54:15.130937 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 28 08:54:15.130937 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 28 08:54:15.130937 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 28 08:54:15.132396 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:54:15.132396 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:54:15.132396 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 28 08:54:15.132396 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 08:54:15.132396 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 28 08:54:15.132396 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 08:54:15.132396 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:54:15.132396 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:54:15.132396 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:54:15.132396 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:54:15.132396 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:54:15.132396 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application with Lock( Jul 28 08:54:15.132396 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:54:15.132396 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:54:15.132396 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:54:15.132396 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:54:15.132396 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:54:15.132396 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:54:15.133890 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:54:15.133890 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:54:15.133890 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 28 08:54:15.133890 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 28 08:54:15.133890 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 28 08:54:15.133890 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 28 08:54:15.133890 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 28 08:54:15.133890 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 28 08:54:15.133890 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 28 08:54:15.133890 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application Jul 28 08:54:15.133890 dv-cinder-851351-1-smb devstack@keystone.service[352329]: [pid: 352329|app: 0|req: 388/786] 10.222.0.42 () {56 vars in 1096 bytes} [Thu Jul 28 08:54:14 2022] GET /identity/v3/users/swift => generated 83 bytes in 395 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 08:54:15.137733 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f93127f-e7d1-4624-b00f-9cd4c5d6d3ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:54:15.138472 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f93127f-e7d1-4624-b00f-9cd4c5d6d3ec None admin] REQUEST_METHOD: `GET` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:54:15.138849 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f93127f-e7d1-4624-b00f-9cd4c5d6d3ec None admin] SCRIPT_NAME: `/identity` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:54:15.139195 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f93127f-e7d1-4624-b00f-9cd4c5d6d3ec None admin] PATH_INFO: `/v3/services` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:54:15.140065 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f93127f-e7d1-4624-b00f-9cd4c5d6d3ec None admin] RBAC: Authorizing `identity:list_services()` {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:54:15.141626 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd544c1-371e-4ceb-86ea-0fd17df5c740 None admin] Authenticating user token {{(pid=352329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:54:15.143306 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f93127f-e7d1-4624-b00f-9cd4c5d6d3ec None admin] RBAC: Authorization granted {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:54:15.161131 dv-cinder-851351-1-smb devstack@keystone.service[352328]: [pid: 352328|app: 0|req: 399/787] 10.222.0.42 () {56 vars in 1087 bytes} [Thu Jul 28 08:54:14 2022] GET /identity/v3/services => generated 772 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:54:15.323759 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd544c1-371e-4ceb-86ea-0fd17df5c740 None admin] Validating token access rules against request {{(pid=352329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:54:15.331047 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG dbcounter [-] [352329] Writing DB stats keystone:SELECT=100 {{(pid=352329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:54:15.387365 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260a8782-40b8-4ced-9ea1-4431f22646f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:54:15.388055 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260a8782-40b8-4ced-9ea1-4431f22646f7 None admin] REQUEST_METHOD: `GET` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:54:15.388341 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260a8782-40b8-4ced-9ea1-4431f22646f7 None admin] SCRIPT_NAME: `/identity` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:54:15.388624 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260a8782-40b8-4ced-9ea1-4431f22646f7 None admin] PATH_INFO: `/v3/users` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:54:15.389575 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-260a8782-40b8-4ced-9ea1-4431f22646f7 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=352329) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:54:15.389887 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-260a8782-40b8-4ced-9ea1-4431f22646f7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:54:15.391789 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-260a8782-40b8-4ced-9ea1-4431f22646f7 None admin] RBAC: Authorization granted {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:54:15.431651 dv-cinder-851351-1-smb devstack@keystone.service[352329]: [pid: 352329|app: 0|req: 389/788] 10.222.0.42 () {56 vars in 1135 bytes} [Thu Jul 28 08:54:15 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 290 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:54:15.438162 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f93127f-e7d1-4624-b00f-9cd4c5d6d3ec None admin] Authenticating user token {{(pid=352328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:54:15.601394 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f93127f-e7d1-4624-b00f-9cd4c5d6d3ec None admin] Validating token access rules against request {{(pid=352328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:54:15.648044 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77068c2e-1e0b-458e-8bd3-e7ac8020a0e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:54:15.648752 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77068c2e-1e0b-458e-8bd3-e7ac8020a0e8 None admin] REQUEST_METHOD: `GET` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:54:15.649040 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77068c2e-1e0b-458e-8bd3-e7ac8020a0e8 None admin] SCRIPT_NAME: `/identity` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:54:15.649317 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77068c2e-1e0b-458e-8bd3-e7ac8020a0e8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:54:15.668933 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77068c2e-1e0b-458e-8bd3-e7ac8020a0e8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:54:15.671401 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77068c2e-1e0b-458e-8bd3-e7ac8020a0e8 None admin] RBAC: Authorization granted {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:54:15.701748 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application [None req-77068c2e-1e0b-458e-8bd3-e7ac8020a0e8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 08:54:15.701748 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:54:15.701748 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:54:15.701748 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:54:15.701748 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:54:15.701748 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:54:15.701748 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:54:15.701748 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:54:15.701748 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:54:15.701748 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:54:15.701748 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:54:15.701748 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:54:15.701748 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 08:54:15.701748 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 08:54:15.701748 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 08:54:15.702932 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 08:54:15.702932 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:54:15.702932 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:54:15.702932 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:54:15.702932 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:54:15.702932 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:54:15.702932 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:54:15.702932 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:54:15.702932 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application with Lock( Jul 28 08:54:15.702932 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:54:15.702932 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:54:15.702932 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:54:15.702932 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:54:15.702932 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:54:15.702932 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:54:15.702932 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:54:15.702932 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:54:15.704091 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 08:54:15.704091 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 08:54:15.704091 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 08:54:15.704091 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application Jul 28 08:54:15.704740 dv-cinder-851351-1-smb devstack@keystone.service[352328]: [pid: 352328|app: 0|req: 400/789] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 08:54:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 267 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:54:15.713864 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260a8782-40b8-4ced-9ea1-4431f22646f7 None admin] Authenticating user token {{(pid=352329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:54:15.814777 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50eb2174-a853-4c33-b890-9fd306986df8 None None] REQUEST_METHOD: `GET` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:54:15.815046 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50eb2174-a853-4c33-b890-9fd306986df8 None None] SCRIPT_NAME: `/identity` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:54:15.815329 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50eb2174-a853-4c33-b890-9fd306986df8 None None] PATH_INFO: `/` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:54:15.817020 dv-cinder-851351-1-smb devstack@keystone.service[352328]: [pid: 352328|app: 0|req: 401/790] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 08:54:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 28 08:54:15.817915 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aff3eee-a742-49b4-b662-39d63509dfd4 None None] REQUEST_METHOD: `GET` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:54:15.818187 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aff3eee-a742-49b4-b662-39d63509dfd4 None None] SCRIPT_NAME: `/identity` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:54:15.818464 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aff3eee-a742-49b4-b662-39d63509dfd4 None None] PATH_INFO: `/` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:54:15.819714 dv-cinder-851351-1-smb devstack@keystone.service[352328]: [pid: 352328|app: 0|req: 402/791] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 08:54:15 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 08:54:15.823858 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ecd93d8-131a-4aa1-b841-5df6675d8aea None None] REQUEST_METHOD: `POST` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:54:15.824099 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ecd93d8-131a-4aa1-b841-5df6675d8aea None None] SCRIPT_NAME: `/identity` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:54:15.824378 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ecd93d8-131a-4aa1-b841-5df6675d8aea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:54:15.855488 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.auth.core [None req-0ecd93d8-131a-4aa1-b841-5df6675d8aea None None] MFA Rules not processed for user `d18c063b2377412485965357671e5506`. Rule list: `[]` (Enabled: `True`). {{(pid=352328) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 08:54:15.858097 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.fernet_utils [None req-0ecd93d8-131a-4aa1-b841-5df6675d8aea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=352328) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:54:15.859615 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260a8782-40b8-4ced-9ea1-4431f22646f7 None admin] Validating token access rules against request {{(pid=352329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:54:15.864859 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG dbcounter [-] [352328] Writing DB stats keystone:SELECT=100 {{(pid=352328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:54:15.906013 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb749c7d-16c5-427f-beb5-8c465ce76457 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:54:15.907071 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb749c7d-16c5-427f-beb5-8c465ce76457 None admin] REQUEST_METHOD: `GET` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:54:15.907365 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb749c7d-16c5-427f-beb5-8c465ce76457 None admin] SCRIPT_NAME: `/identity` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:54:15.907651 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb749c7d-16c5-427f-beb5-8c465ce76457 None admin] PATH_INFO: `/v3/domains` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:54:15.908864 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb749c7d-16c5-427f-beb5-8c465ce76457 None admin] RBAC: Adding query filter params (name=Default) {{(pid=352329) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:54:15.909238 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb749c7d-16c5-427f-beb5-8c465ce76457 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:54:15.910960 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb749c7d-16c5-427f-beb5-8c465ce76457 None admin] RBAC: Authorization granted {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:54:15.927195 dv-cinder-851351-1-smb devstack@keystone.service[352329]: [pid: 352329|app: 0|req: 390/792] 10.222.0.42 () {56 vars in 1109 bytes} [Thu Jul 28 08:54:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:54:15.929245 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d08838-0d44-42a4-9852-8495f87cd282 None None] REQUEST_METHOD: `POST` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:54:15.929558 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d08838-0d44-42a4-9852-8495f87cd282 None None] SCRIPT_NAME: `/identity` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:54:15.929842 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d08838-0d44-42a4-9852-8495f87cd282 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:54:15.953123 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.auth.core [None req-40d08838-0d44-42a4-9852-8495f87cd282 None None] MFA Rules not processed for user `d18c063b2377412485965357671e5506`. Rule list: `[]` (Enabled: `True`). {{(pid=352329) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 08:54:15.954937 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.fernet_utils [None req-40d08838-0d44-42a4-9852-8495f87cd282 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=352329) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:54:15.964511 dv-cinder-851351-1-smb devstack@keystone.service[352328]: [pid: 352328|app: 0|req: 403/793] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 08:54:15 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 08:54:15.970580 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ecd93d8-131a-4aa1-b841-5df6675d8aea None None] Authenticating user token {{(pid=352328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:54:15.978711 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG dbcounter [-] [352329] Writing DB stats keystone:SELECT=100 {{(pid=352329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:54:16.052332 dv-cinder-851351-1-smb devstack@keystone.service[352329]: [pid: 352329|app: 0|req: 391/794] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 08:54:15 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 08:54:16.053560 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d08838-0d44-42a4-9852-8495f87cd282 None None] Authenticating user token {{(pid=352329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:54:16.116701 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ecd93d8-131a-4aa1-b841-5df6675d8aea None None] Validating token access rules against request {{(pid=352328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:54:16.160345 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-009bcbeb-cd71-49c2-9250-3ef9fa7799c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:54:16.161388 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009bcbeb-cd71-49c2-9250-3ef9fa7799c0 None admin] REQUEST_METHOD: `GET` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:54:16.161999 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009bcbeb-cd71-49c2-9250-3ef9fa7799c0 None admin] SCRIPT_NAME: `/identity` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:54:16.162439 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009bcbeb-cd71-49c2-9250-3ef9fa7799c0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:54:16.172461 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-009bcbeb-cd71-49c2-9250-3ef9fa7799c0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:54:16.175578 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-009bcbeb-cd71-49c2-9250-3ef9fa7799c0 None admin] RBAC: Authorization granted {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:54:16.180789 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG dbcounter [-] [352328] Writing DB stats keystone:SELECT=100 {{(pid=352328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:54:16.208824 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application [None req-009bcbeb-cd71-49c2-9250-3ef9fa7799c0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 08:54:16.208824 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:54:16.208824 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:54:16.208824 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:54:16.208824 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:54:16.208824 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:54:16.208824 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:54:16.208824 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:54:16.208824 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:54:16.208824 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:54:16.208824 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:54:16.208824 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:54:16.208824 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 28 08:54:16.208824 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 28 08:54:16.208824 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 28 08:54:16.211020 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 28 08:54:16.211020 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:54:16.211020 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:54:16.211020 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:54:16.211020 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:54:16.211020 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:54:16.211020 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:54:16.211020 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:54:16.211020 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application with Lock( Jul 28 08:54:16.211020 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:54:16.211020 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:54:16.211020 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:54:16.211020 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:54:16.211020 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:54:16.211020 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:54:16.211020 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:54:16.211020 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:54:16.221996 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 28 08:54:16.221996 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 28 08:54:16.221996 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 28 08:54:16.221996 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 28 08:54:16.221996 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 28 08:54:16.221996 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 28 08:54:16.221996 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 08:54:16.221996 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application Jul 28 08:54:16.221996 dv-cinder-851351-1-smb devstack@keystone.service[352328]: [pid: 352328|app: 0|req: 404/795] 10.222.0.42 () {56 vars in 1111 bytes} [Thu Jul 28 08:54:15 2022] GET /identity/v3/projects/service => generated 88 bytes in 245 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:54:16.221996 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-009bcbeb-cd71-49c2-9250-3ef9fa7799c0 None admin] Authenticating user token {{(pid=352328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:54:16.261735 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d08838-0d44-42a4-9852-8495f87cd282 None None] Validating token access rules against request {{(pid=352329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:54:16.327933 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a1ba36-c1e4-4d7f-97ba-f3c7d6072faf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:54:16.329557 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a1ba36-c1e4-4d7f-97ba-f3c7d6072faf None admin] REQUEST_METHOD: `GET` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:54:16.330073 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a1ba36-c1e4-4d7f-97ba-f3c7d6072faf None admin] SCRIPT_NAME: `/identity` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:54:16.330567 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a1ba36-c1e4-4d7f-97ba-f3c7d6072faf None admin] PATH_INFO: `/v3/roles/service` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:54:16.343578 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63a1ba36-c1e4-4d7f-97ba-f3c7d6072faf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 08:54:16.349543 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application [None req-63a1ba36-c1e4-4d7f-97ba-f3c7d6072faf None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 28 08:54:16.349543 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:54:16.349543 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:54:16.349543 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:54:16.349543 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:54:16.349543 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:54:16.349543 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:54:16.349543 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:54:16.349543 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:54:16.349543 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:54:16.349543 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:54:16.349543 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:54:16.349543 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 08:54:16.349543 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 08:54:16.349543 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 08:54:16.349543 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 08:54:16.350854 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 08:54:16.350854 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 08:54:16.350854 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 08:54:16.350854 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 08:54:16.350854 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:54:16.350854 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:54:16.350854 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:54:16.350854 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:54:16.350854 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:54:16.350854 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:54:16.350854 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:54:16.350854 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application with Lock( Jul 28 08:54:16.350854 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:54:16.350854 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:54:16.350854 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:54:16.350854 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:54:16.351899 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:54:16.351899 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:54:16.351899 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:54:16.351899 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:54:16.351899 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 08:54:16.351899 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 08:54:16.351899 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 08:54:16.351899 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 08:54:16.351899 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 08:54:16.351899 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 08:54:16.351899 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 28 08:54:16.351899 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application Jul 28 08:54:16.354725 dv-cinder-851351-1-smb devstack@keystone.service[352329]: [pid: 352329|app: 0|req: 392/796] 10.222.0.42 () {56 vars in 1102 bytes} [Thu Jul 28 08:54:16 2022] GET /identity/v3/roles/service => generated 85 bytes in 302 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:54:16.355841 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a1ba36-c1e4-4d7f-97ba-f3c7d6072faf None admin] Authenticating user token {{(pid=352329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:54:16.370499 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-009bcbeb-cd71-49c2-9250-3ef9fa7799c0 None admin] Validating token access rules against request {{(pid=352328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:54:16.373671 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG dbcounter [-] [352329] Writing DB stats keystone:SELECT=100 {{(pid=352329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:54:16.409006 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449bfd2a-f715-4eb3-99ca-9f9f61d298e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:54:16.409701 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449bfd2a-f715-4eb3-99ca-9f9f61d298e2 None admin] REQUEST_METHOD: `GET` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:54:16.409965 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449bfd2a-f715-4eb3-99ca-9f9f61d298e2 None admin] SCRIPT_NAME: `/identity` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:54:16.410244 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449bfd2a-f715-4eb3-99ca-9f9f61d298e2 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:54:16.410896 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-449bfd2a-f715-4eb3-99ca-9f9f61d298e2 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:54:16.412363 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-449bfd2a-f715-4eb3-99ca-9f9f61d298e2 None admin] RBAC: Authorization granted {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:54:16.422687 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application [None req-449bfd2a-f715-4eb3-99ca-9f9f61d298e2 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 28 08:54:16.422687 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:54:16.422687 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 28 08:54:16.422687 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 28 08:54:16.422687 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 28 08:54:16.422687 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 28 08:54:16.422687 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 28 08:54:16.422687 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 08:54:16.422687 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 28 08:54:16.422687 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application Jul 28 08:54:16.422687 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 28 08:54:16.422687 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application Jul 28 08:54:16.422687 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:54:16.422687 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:54:16.422687 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:54:16.422687 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:54:16.423901 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:54:16.423901 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:54:16.423901 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:54:16.423901 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:54:16.423901 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:54:16.423901 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:54:16.423901 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:54:16.423901 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 28 08:54:16.423901 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 28 08:54:16.423901 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 28 08:54:16.423901 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 28 08:54:16.423901 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:54:16.423901 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:54:16.423901 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:54:16.423901 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:54:16.423901 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:54:16.424977 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:54:16.424977 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:54:16.424977 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application with Lock( Jul 28 08:54:16.424977 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:54:16.424977 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:54:16.424977 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:54:16.424977 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:54:16.424977 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:54:16.424977 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:54:16.424977 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:54:16.424977 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:54:16.424977 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 28 08:54:16.424977 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 08:54:16.424977 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 28 08:54:16.424977 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application Jul 28 08:54:16.429026 dv-cinder-851351-1-smb devstack@keystone.service[352328]: [pid: 352328|app: 0|req: 405/797] 10.222.0.42 () {56 vars in 1129 bytes} [Thu Jul 28 08:54:16 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:54:16.429944 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449bfd2a-f715-4eb3-99ca-9f9f61d298e2 None admin] Authenticating user token {{(pid=352328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:54:16.479422 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a1ba36-c1e4-4d7f-97ba-f3c7d6072faf None admin] Validating token access rules against request {{(pid=352329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:54:16.497633 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG dbcounter [-] [352328] Writing DB stats keystone:SELECT=100 {{(pid=352328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:54:16.520038 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328874ca-1118-419d-87f2-9c4e81390527 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:54:16.520689 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328874ca-1118-419d-87f2-9c4e81390527 None admin] REQUEST_METHOD: `GET` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:54:16.520998 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328874ca-1118-419d-87f2-9c4e81390527 None admin] SCRIPT_NAME: `/identity` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:54:16.521249 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328874ca-1118-419d-87f2-9c4e81390527 None admin] PATH_INFO: `/v3/projects` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:54:16.522014 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-328874ca-1118-419d-87f2-9c4e81390527 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=352329) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:54:16.522319 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-328874ca-1118-419d-87f2-9c4e81390527 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:54:16.523780 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-328874ca-1118-419d-87f2-9c4e81390527 None admin] RBAC: Authorization granted {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:54:16.540885 dv-cinder-851351-1-smb devstack@keystone.service[352329]: [pid: 352329|app: 0|req: 393/798] 10.222.0.42 () {56 vars in 1148 bytes} [Thu Jul 28 08:54:16 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:54:16.540885 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328874ca-1118-419d-87f2-9c4e81390527 None admin] Authenticating user token {{(pid=352329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:54:16.542815 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449bfd2a-f715-4eb3-99ca-9f9f61d298e2 None admin] Validating token access rules against request {{(pid=352328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:54:16.583106 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce7318e-27c8-4f36-aeaf-8dbe37f681dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:54:16.584119 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce7318e-27c8-4f36-aeaf-8dbe37f681dc None admin] REQUEST_METHOD: `GET` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:54:16.584617 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce7318e-27c8-4f36-aeaf-8dbe37f681dc None admin] SCRIPT_NAME: `/identity` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:54:16.585133 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce7318e-27c8-4f36-aeaf-8dbe37f681dc None admin] PATH_INFO: `/v3/roles` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:54:16.586416 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce7318e-27c8-4f36-aeaf-8dbe37f681dc None admin] RBAC: Adding query filter params (name=service) {{(pid=352328) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:54:16.586904 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce7318e-27c8-4f36-aeaf-8dbe37f681dc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:54:16.589372 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce7318e-27c8-4f36-aeaf-8dbe37f681dc None admin] RBAC: Authorization granted {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:54:16.601791 dv-cinder-851351-1-smb devstack@keystone.service[352328]: [pid: 352328|app: 0|req: 406/799] 10.222.0.42 () {56 vars in 1103 bytes} [Thu Jul 28 08:54:16 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:54:16.603268 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e614c5c-b553-44a7-abfc-a4cb14d8baac None None] REQUEST_METHOD: `GET` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:54:16.603670 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e614c5c-b553-44a7-abfc-a4cb14d8baac None None] SCRIPT_NAME: `/identity` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:54:16.603946 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e614c5c-b553-44a7-abfc-a4cb14d8baac None None] PATH_INFO: `/` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:54:16.605517 dv-cinder-851351-1-smb devstack@keystone.service[352328]: [pid: 352328|app: 0|req: 407/800] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 08:54:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 08:54:16.606037 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e614c5c-b553-44a7-abfc-a4cb14d8baac None None] Authenticating user token {{(pid=352328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:54:16.648183 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG dbcounter [-] [352329] Writing DB stats keystone:SELECT=100 {{(pid=352329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:54:16.698051 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328874ca-1118-419d-87f2-9c4e81390527 None admin] Validating token access rules against request {{(pid=352329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:54:16.738581 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e614c5c-b553-44a7-abfc-a4cb14d8baac None None] Validating token access rules against request {{(pid=352328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:54:16.750179 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2100ebf6-ab12-4bf8-aa1d-f2bd1afdef37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:54:16.750995 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2100ebf6-ab12-4bf8-aa1d-f2bd1afdef37 None admin] REQUEST_METHOD: `GET` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:54:16.751282 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2100ebf6-ab12-4bf8-aa1d-f2bd1afdef37 None admin] SCRIPT_NAME: `/identity` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:54:16.751560 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2100ebf6-ab12-4bf8-aa1d-f2bd1afdef37 None admin] PATH_INFO: `/v3/services` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:54:16.752270 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2100ebf6-ab12-4bf8-aa1d-f2bd1afdef37 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=352329) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:54:16.752579 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2100ebf6-ab12-4bf8-aa1d-f2bd1afdef37 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:54:16.754030 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2100ebf6-ab12-4bf8-aa1d-f2bd1afdef37 None admin] RBAC: Authorization granted {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:54:16.760180 dv-cinder-851351-1-smb devstack@keystone.service[352329]: [pid: 352329|app: 0|req: 394/801] 10.222.0.42 () {56 vars in 1124 bytes} [Thu Jul 28 08:54:16 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:54:16.762174 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2100ebf6-ab12-4bf8-aa1d-f2bd1afdef37 None admin] Authenticating user token {{(pid=352329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:54:16.788650 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG dbcounter [-] [352328] Writing DB stats keystone:SELECT=100 {{(pid=352328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:54:16.803003 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acdde381-ca89-4bb8-ab39-7f94838bb63c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:54:16.803913 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acdde381-ca89-4bb8-ab39-7f94838bb63c None admin] REQUEST_METHOD: `PUT` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:54:16.804193 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acdde381-ca89-4bb8-ab39-7f94838bb63c None admin] SCRIPT_NAME: `/identity` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:54:16.804467 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acdde381-ca89-4bb8-ab39-7f94838bb63c None admin] PATH_INFO: `/v3/projects/9cfa053c839a4fedacde7163d907e2a4/users/456c30f8918e4aef8a8e2d65f1f0faf7/roles/280023171b4a45efb67c036ff237bb3c` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:54:16.806645 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acdde381-ca89-4bb8-ab39-7f94838bb63c None admin] RBAC: Authorizing `identity:create_grant(project_id=9cfa053c839a4fedacde7163d907e2a4, user_id=456c30f8918e4aef8a8e2d65f1f0faf7, role_id=280023171b4a45efb67c036ff237bb3c)` {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:54:16.809098 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acdde381-ca89-4bb8-ab39-7f94838bb63c None admin] RBAC: Authorization granted {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:54:16.827860 dv-cinder-851351-1-smb devstack@keystone.service[352328]: [pid: 352328|app: 0|req: 408/802] 10.222.0.42 () {58 vars in 1439 bytes} [Thu Jul 28 08:54:16 2022] PUT /identity/v3/projects/9cfa053c839a4fedacde7163d907e2a4/users/456c30f8918e4aef8a8e2d65f1f0faf7/roles/280023171b4a45efb67c036ff237bb3c => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 08:54:16.839258 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c9eec2-0620-40ef-be8d-7f6718a15300 None None] REQUEST_METHOD: `POST` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:54:16.840179 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c9eec2-0620-40ef-be8d-7f6718a15300 None None] SCRIPT_NAME: `/identity` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:54:16.840998 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c9eec2-0620-40ef-be8d-7f6718a15300 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:54:16.887999 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.auth.core [None req-61c9eec2-0620-40ef-be8d-7f6718a15300 None None] MFA Rules not processed for user `d18c063b2377412485965357671e5506`. Rule list: `[]` (Enabled: `True`). {{(pid=352328) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 08:54:16.890772 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.fernet_utils [None req-61c9eec2-0620-40ef-be8d-7f6718a15300 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=352328) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:54:16.949697 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2100ebf6-ab12-4bf8-aa1d-f2bd1afdef37 None admin] Validating token access rules against request {{(pid=352329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:54:17.027787 dv-cinder-851351-1-smb devstack@keystone.service[352328]: [pid: 352328|app: 0|req: 409/803] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 08:54:16 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 08:54:17.029013 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c9eec2-0620-40ef-be8d-7f6718a15300 None None] Authenticating user token {{(pid=352328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:54:17.037438 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788bf3d0-c500-4405-bf9d-452fce7239f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:54:17.038533 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788bf3d0-c500-4405-bf9d-452fce7239f1 None admin] REQUEST_METHOD: `GET` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:54:17.039035 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788bf3d0-c500-4405-bf9d-452fce7239f1 None admin] SCRIPT_NAME: `/identity` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:54:17.039521 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788bf3d0-c500-4405-bf9d-452fce7239f1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:54:17.043092 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG dbcounter [-] [352329] Writing DB stats keystone:SELECT=100 {{(pid=352329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:54:17.056103 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-788bf3d0-c500-4405-bf9d-452fce7239f1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:54:17.058013 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-788bf3d0-c500-4405-bf9d-452fce7239f1 None admin] RBAC: Authorization granted {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:54:17.073969 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application [None req-788bf3d0-c500-4405-bf9d-452fce7239f1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 08:54:17.073969 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:54:17.073969 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:54:17.073969 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:54:17.073969 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:54:17.073969 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:54:17.073969 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:54:17.073969 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:54:17.073969 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:54:17.073969 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:54:17.073969 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:54:17.073969 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:54:17.073969 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 08:54:17.073969 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 08:54:17.073969 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 08:54:17.075141 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 08:54:17.075141 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:54:17.075141 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:54:17.075141 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:54:17.075141 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:54:17.075141 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:54:17.075141 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:54:17.075141 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:54:17.075141 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application with Lock( Jul 28 08:54:17.075141 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:54:17.075141 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:54:17.075141 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:54:17.075141 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:54:17.075141 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:54:17.075141 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:54:17.075141 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:54:17.075141 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:54:17.076637 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 08:54:17.076637 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 08:54:17.076637 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 08:54:17.076637 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application Jul 28 08:54:17.076637 dv-cinder-851351-1-smb devstack@keystone.service[352329]: [pid: 352329|app: 0|req: 395/804] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 08:54:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 315 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:54:17.076637 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788bf3d0-c500-4405-bf9d-452fce7239f1 None admin] Authenticating user token {{(pid=352329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:54:17.149926 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c9eec2-0620-40ef-be8d-7f6718a15300 None None] Validating token access rules against request {{(pid=352328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:54:17.168837 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG dbcounter [-] [352328] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=352328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:54:17.191476 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6df8fc-aead-4162-ae0f-ad09a204de9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:54:17.192576 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6df8fc-aead-4162-ae0f-ad09a204de9b None admin] REQUEST_METHOD: `GET` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:54:17.193135 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6df8fc-aead-4162-ae0f-ad09a204de9b None admin] SCRIPT_NAME: `/identity` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:54:17.193659 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6df8fc-aead-4162-ae0f-ad09a204de9b None admin] PATH_INFO: `/v3/services` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:54:17.194574 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f6df8fc-aead-4162-ae0f-ad09a204de9b None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=352328) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:54:17.195116 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f6df8fc-aead-4162-ae0f-ad09a204de9b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:54:17.196856 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f6df8fc-aead-4162-ae0f-ad09a204de9b None admin] RBAC: Authorization granted {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:54:17.203209 dv-cinder-851351-1-smb devstack@keystone.service[352328]: [pid: 352328|app: 0|req: 410/805] 10.222.0.42 () {56 vars in 1124 bytes} [Thu Jul 28 08:54:17 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:54:17.204922 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6df8fc-aead-4162-ae0f-ad09a204de9b None admin] Authenticating user token {{(pid=352328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:54:17.229027 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788bf3d0-c500-4405-bf9d-452fce7239f1 None admin] Validating token access rules against request {{(pid=352329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:54:17.281851 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89316b3f-0971-4887-b57f-6f00170cc925 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:54:17.282517 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89316b3f-0971-4887-b57f-6f00170cc925 None admin] REQUEST_METHOD: `GET` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:54:17.282974 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89316b3f-0971-4887-b57f-6f00170cc925 None admin] SCRIPT_NAME: `/identity` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:54:17.283412 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89316b3f-0971-4887-b57f-6f00170cc925 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:54:17.301219 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89316b3f-0971-4887-b57f-6f00170cc925 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 08:54:17.309146 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application [None req-89316b3f-0971-4887-b57f-6f00170cc925 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 08:54:17.309146 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:54:17.309146 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:54:17.309146 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:54:17.309146 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:54:17.309146 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:54:17.309146 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:54:17.309146 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:54:17.309146 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:54:17.309146 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:54:17.309146 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:54:17.309146 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:54:17.309146 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 08:54:17.309146 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 08:54:17.309146 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 08:54:17.309146 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 08:54:17.310423 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 08:54:17.310423 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 08:54:17.310423 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 08:54:17.310423 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 08:54:17.310423 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:54:17.310423 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:54:17.310423 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:54:17.310423 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:54:17.310423 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:54:17.310423 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:54:17.310423 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:54:17.310423 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application with Lock( Jul 28 08:54:17.310423 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:54:17.310423 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:54:17.310423 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:54:17.310423 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:54:17.311565 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:54:17.311565 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:54:17.311565 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:54:17.311565 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:54:17.311565 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 08:54:17.311565 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 08:54:17.311565 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 08:54:17.311565 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 08:54:17.311565 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 08:54:17.311565 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 08:54:17.311565 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 08:54:17.311565 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application Jul 28 08:54:17.316266 dv-cinder-851351-1-smb devstack@keystone.service[352329]: [pid: 352329|app: 0|req: 396/806] 10.222.0.42 () {56 vars in 1096 bytes} [Thu Jul 28 08:54:17 2022] GET /identity/v3/roles/admin => generated 83 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:54:17.318114 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89316b3f-0971-4887-b57f-6f00170cc925 None admin] Authenticating user token {{(pid=352329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:54:17.325412 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6df8fc-aead-4162-ae0f-ad09a204de9b None admin] Validating token access rules against request {{(pid=352328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:54:17.362762 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dccdcf9-c4e2-4b91-a4d8-3e41d1c1f822 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:54:17.363827 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dccdcf9-c4e2-4b91-a4d8-3e41d1c1f822 None admin] REQUEST_METHOD: `GET` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:54:17.364342 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dccdcf9-c4e2-4b91-a4d8-3e41d1c1f822 None admin] SCRIPT_NAME: `/identity` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:54:17.364980 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dccdcf9-c4e2-4b91-a4d8-3e41d1c1f822 None admin] PATH_INFO: `/v3/domains` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:54:17.365922 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dccdcf9-c4e2-4b91-a4d8-3e41d1c1f822 None admin] RBAC: Adding query filter params (name=Default) {{(pid=352328) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:54:17.366454 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dccdcf9-c4e2-4b91-a4d8-3e41d1c1f822 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:54:17.368229 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dccdcf9-c4e2-4b91-a4d8-3e41d1c1f822 None admin] RBAC: Authorization granted {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:54:17.382175 dv-cinder-851351-1-smb devstack@keystone.service[352328]: [pid: 352328|app: 0|req: 411/807] 10.222.0.42 () {56 vars in 1109 bytes} [Thu Jul 28 08:54:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:54:17.383520 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG dbcounter [-] [352329] Writing DB stats keystone:SELECT=100 {{(pid=352329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:54:17.383768 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dccdcf9-c4e2-4b91-a4d8-3e41d1c1f822 None admin] Authenticating user token {{(pid=352328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:54:17.433946 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG dbcounter [-] [352328] Writing DB stats keystone:SELECT=100 {{(pid=352328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:54:17.439967 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89316b3f-0971-4887-b57f-6f00170cc925 None admin] Validating token access rules against request {{(pid=352329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:54:17.478560 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f61728-c0e0-4a1c-84a4-b25d1855613e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:54:17.479211 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f61728-c0e0-4a1c-84a4-b25d1855613e None admin] REQUEST_METHOD: `POST` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:54:17.479495 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f61728-c0e0-4a1c-84a4-b25d1855613e None admin] SCRIPT_NAME: `/identity` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:54:17.480056 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f61728-c0e0-4a1c-84a4-b25d1855613e None admin] PATH_INFO: `/v3/endpoints` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:54:17.480587 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f61728-c0e0-4a1c-84a4-b25d1855613e None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:54:17.482148 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f61728-c0e0-4a1c-84a4-b25d1855613e None admin] RBAC: Authorization granted {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:54:17.505227 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dccdcf9-c4e2-4b91-a4d8-3e41d1c1f822 None admin] Validating token access rules against request {{(pid=352328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:54:17.510077 dv-cinder-851351-1-smb devstack@keystone.service[352329]: [pid: 352329|app: 0|req: 397/808] 10.222.0.42 () {60 vars in 1144 bytes} [Thu Jul 28 08:54:17 2022] POST /identity/v3/endpoints => generated 346 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 08:54:17.511058 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f61728-c0e0-4a1c-84a4-b25d1855613e None admin] Authenticating user token {{(pid=352329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:54:17.593674 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d849c6-d8f9-4024-9c0a-655ec259dc0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:54:17.595636 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d849c6-d8f9-4024-9c0a-655ec259dc0c None admin] REQUEST_METHOD: `GET` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:54:17.596151 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d849c6-d8f9-4024-9c0a-655ec259dc0c None admin] SCRIPT_NAME: `/identity` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:54:17.596724 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d849c6-d8f9-4024-9c0a-655ec259dc0c None admin] PATH_INFO: `/v3/roles` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:54:17.598186 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0d849c6-d8f9-4024-9c0a-655ec259dc0c None admin] RBAC: Adding query filter params (name=admin) {{(pid=352328) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:54:17.598762 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0d849c6-d8f9-4024-9c0a-655ec259dc0c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:54:17.600580 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0d849c6-d8f9-4024-9c0a-655ec259dc0c None admin] RBAC: Authorization granted {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:54:17.612731 dv-cinder-851351-1-smb devstack@keystone.service[352328]: [pid: 352328|app: 0|req: 412/809] 10.222.0.42 () {56 vars in 1099 bytes} [Thu Jul 28 08:54:17 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:54:17.629538 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d849c6-d8f9-4024-9c0a-655ec259dc0c None admin] Authenticating user token {{(pid=352328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:54:17.733394 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f61728-c0e0-4a1c-84a4-b25d1855613e None admin] Validating token access rules against request {{(pid=352329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:54:17.738628 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG dbcounter [-] [352329] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=352329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:54:17.786360 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG dbcounter [-] [352328] Writing DB stats keystone:SELECT=100 {{(pid=352328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:54:17.791291 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d849c6-d8f9-4024-9c0a-655ec259dc0c None admin] Validating token access rules against request {{(pid=352328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:54:17.818807 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1de951-3524-4905-abc8-7effc669a37d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:54:17.819814 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1de951-3524-4905-abc8-7effc669a37d None admin] REQUEST_METHOD: `GET` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:54:17.820260 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1de951-3524-4905-abc8-7effc669a37d None admin] SCRIPT_NAME: `/identity` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:54:17.820738 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1de951-3524-4905-abc8-7effc669a37d None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:54:17.829458 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b1de951-3524-4905-abc8-7effc669a37d None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:54:17.831228 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b1de951-3524-4905-abc8-7effc669a37d None admin] RBAC: Authorization granted {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:54:17.836269 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e29b488-13e2-40d4-9bc4-8140db95188e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:54:17.836979 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e29b488-13e2-40d4-9bc4-8140db95188e None admin] REQUEST_METHOD: `GET` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:54:17.837288 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e29b488-13e2-40d4-9bc4-8140db95188e None admin] SCRIPT_NAME: `/identity` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:54:17.837563 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e29b488-13e2-40d4-9bc4-8140db95188e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:54:17.849370 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e29b488-13e2-40d4-9bc4-8140db95188e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:54:17.850760 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e29b488-13e2-40d4-9bc4-8140db95188e None admin] RBAC: Authorization granted {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:54:17.856781 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application [None req-7b1de951-3524-4905-abc8-7effc669a37d None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 28 08:54:17.856781 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:54:17.856781 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:54:17.856781 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:54:17.856781 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:54:17.856781 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:54:17.856781 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:54:17.856781 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:54:17.856781 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:54:17.856781 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:54:17.856781 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:54:17.856781 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:54:17.856781 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 28 08:54:17.856781 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 28 08:54:17.856781 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 28 08:54:17.856781 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 28 08:54:17.857977 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:54:17.857977 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:54:17.857977 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 28 08:54:17.857977 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 08:54:17.857977 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 28 08:54:17.857977 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 08:54:17.857977 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:54:17.857977 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:54:17.857977 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:54:17.857977 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:54:17.857977 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:54:17.857977 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application with Lock( Jul 28 08:54:17.857977 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:54:17.857977 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:54:17.857977 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:54:17.857977 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:54:17.857977 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:54:17.857977 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:54:17.859202 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:54:17.859202 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:54:17.859202 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 28 08:54:17.859202 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 28 08:54:17.859202 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 28 08:54:17.859202 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 28 08:54:17.859202 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 28 08:54:17.859202 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 28 08:54:17.859202 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 28 08:54:17.859202 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application Jul 28 08:54:17.862296 dv-cinder-851351-1-smb devstack@keystone.service[352329]: [pid: 352329|app: 0|req: 398/810] 10.222.0.42 () {56 vars in 1117 bytes} [Thu Jul 28 08:54:17 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 351 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:54:17.863320 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d364c8-07f3-4d6d-af22-27c8955274ea None None] REQUEST_METHOD: `GET` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:54:17.863570 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d364c8-07f3-4d6d-af22-27c8955274ea None None] SCRIPT_NAME: `/identity` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:54:17.863869 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d364c8-07f3-4d6d-af22-27c8955274ea None None] PATH_INFO: `/` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:54:17.865407 dv-cinder-851351-1-smb devstack@keystone.service[352329]: [pid: 352329|app: 0|req: 399/811] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 08:54:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 08:54:17.873640 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d364c8-07f3-4d6d-af22-27c8955274ea None None] Authenticating user token {{(pid=352329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:54:17.874866 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application [None req-5e29b488-13e2-40d4-9bc4-8140db95188e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 08:54:17.874866 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:54:17.874866 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:54:17.874866 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:54:17.874866 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:54:17.874866 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:54:17.874866 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:54:17.874866 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:54:17.874866 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:54:17.874866 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:54:17.874866 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:54:17.874866 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:54:17.874866 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 08:54:17.874866 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 08:54:17.874866 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 08:54:17.876081 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 08:54:17.876081 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:54:17.876081 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:54:17.876081 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:54:17.876081 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:54:17.876081 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:54:17.876081 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:54:17.876081 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:54:17.876081 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application with Lock( Jul 28 08:54:17.876081 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:54:17.876081 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:54:17.876081 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:54:17.876081 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:54:17.876081 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:54:17.876081 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:54:17.876081 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:54:17.876081 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:54:17.877267 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 08:54:17.877267 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 08:54:17.877267 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 08:54:17.877267 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application Jul 28 08:54:17.879692 dv-cinder-851351-1-smb devstack@keystone.service[352328]: [pid: 352328|app: 0|req: 413/812] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 08:54:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 252 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 08:54:17.881331 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e7188e-cae3-415e-8493-f6732f77929f None None] REQUEST_METHOD: `POST` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:54:17.881846 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e7188e-cae3-415e-8493-f6732f77929f None None] SCRIPT_NAME: `/identity` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:54:17.882369 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e7188e-cae3-415e-8493-f6732f77929f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:54:17.903975 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.auth.core [None req-31e7188e-cae3-415e-8493-f6732f77929f None None] MFA Rules not processed for user `d18c063b2377412485965357671e5506`. Rule list: `[]` (Enabled: `True`). {{(pid=352328) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 08:54:17.905820 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.fernet_utils [None req-31e7188e-cae3-415e-8493-f6732f77929f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=352328) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:54:17.983382 dv-cinder-851351-1-smb devstack@keystone.service[352328]: [pid: 352328|app: 0|req: 414/813] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 08:54:17 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 08:54:17.984949 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e7188e-cae3-415e-8493-f6732f77929f None None] Authenticating user token {{(pid=352328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:54:18.001609 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d364c8-07f3-4d6d-af22-27c8955274ea None None] Validating token access rules against request {{(pid=352329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:54:18.048683 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9dccbe-557e-4d74-be1e-d29e9534b1f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:54:18.049739 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9dccbe-557e-4d74-be1e-d29e9534b1f3 None admin] REQUEST_METHOD: `GET` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:54:18.050269 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9dccbe-557e-4d74-be1e-d29e9534b1f3 None admin] SCRIPT_NAME: `/identity` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:54:18.050801 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9dccbe-557e-4d74-be1e-d29e9534b1f3 None admin] PATH_INFO: `/v3/users` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:54:18.052125 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe9dccbe-557e-4d74-be1e-d29e9534b1f3 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=352329) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:54:18.052696 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe9dccbe-557e-4d74-be1e-d29e9534b1f3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:54:18.054423 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe9dccbe-557e-4d74-be1e-d29e9534b1f3 None admin] RBAC: Authorization granted {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:54:18.074790 dv-cinder-851351-1-smb devstack@keystone.service[352329]: [pid: 352329|app: 0|req: 400/814] 10.222.0.42 () {56 vars in 1149 bytes} [Thu Jul 28 08:54:17 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:54:18.076181 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9dccbe-557e-4d74-be1e-d29e9534b1f3 None admin] Authenticating user token {{(pid=352329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:54:18.091172 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG dbcounter [-] [352328] Writing DB stats keystone:SELECT=100 {{(pid=352328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:54:18.113800 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG dbcounter [-] [352329] Writing DB stats keystone:SELECT=100 {{(pid=352329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:54:18.116851 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e7188e-cae3-415e-8493-f6732f77929f None None] Validating token access rules against request {{(pid=352328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:54:18.156594 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e46f2b-2e60-459c-9e86-6f6bd9a31236 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:54:18.157104 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e46f2b-2e60-459c-9e86-6f6bd9a31236 None admin] REQUEST_METHOD: `GET` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:54:18.157360 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e46f2b-2e60-459c-9e86-6f6bd9a31236 None admin] SCRIPT_NAME: `/identity` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:54:18.157684 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e46f2b-2e60-459c-9e86-6f6bd9a31236 None admin] PATH_INFO: `/v3/domains` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:54:18.158423 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4e46f2b-2e60-459c-9e86-6f6bd9a31236 None admin] RBAC: Adding query filter params (name=Default) {{(pid=352328) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:54:18.158747 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4e46f2b-2e60-459c-9e86-6f6bd9a31236 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:54:18.160164 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4e46f2b-2e60-459c-9e86-6f6bd9a31236 None admin] RBAC: Authorization granted {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:54:18.173868 dv-cinder-851351-1-smb devstack@keystone.service[352328]: [pid: 352328|app: 0|req: 415/815] 10.222.0.42 () {56 vars in 1109 bytes} [Thu Jul 28 08:54:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:54:18.174858 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e46f2b-2e60-459c-9e86-6f6bd9a31236 None admin] Authenticating user token {{(pid=352328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:54:18.233102 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9dccbe-557e-4d74-be1e-d29e9534b1f3 None admin] Validating token access rules against request {{(pid=352329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:54:18.271519 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f9afa9-fb05-4fd7-b899-bfff767c1456 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:54:18.272620 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f9afa9-fb05-4fd7-b899-bfff767c1456 None admin] REQUEST_METHOD: `GET` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:54:18.273206 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f9afa9-fb05-4fd7-b899-bfff767c1456 None admin] SCRIPT_NAME: `/identity` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:54:18.273722 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f9afa9-fb05-4fd7-b899-bfff767c1456 None admin] PATH_INFO: `/v3/services/network` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:54:18.274606 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f9afa9-fb05-4fd7-b899-bfff767c1456 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:54:18.276271 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f9afa9-fb05-4fd7-b899-bfff767c1456 None admin] RBAC: Authorization granted {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:54:18.289204 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application [None req-71f9afa9-fb05-4fd7-b899-bfff767c1456 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jul 28 08:54:18.289204 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:54:18.289204 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 28 08:54:18.289204 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 28 08:54:18.289204 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 28 08:54:18.289204 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 28 08:54:18.289204 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 28 08:54:18.289204 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 08:54:18.289204 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 28 08:54:18.289204 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application Jul 28 08:54:18.289204 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 28 08:54:18.289204 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application Jul 28 08:54:18.289204 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:54:18.289204 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:54:18.289204 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:54:18.289204 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:54:18.289204 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:54:18.290517 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:54:18.290517 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:54:18.290517 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:54:18.290517 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:54:18.290517 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:54:18.290517 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:54:18.290517 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 28 08:54:18.290517 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 28 08:54:18.290517 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 28 08:54:18.290517 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 28 08:54:18.290517 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:54:18.290517 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:54:18.290517 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:54:18.290517 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:54:18.290517 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:54:18.290517 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:54:18.291665 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:54:18.291665 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application with Lock( Jul 28 08:54:18.291665 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:54:18.291665 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:54:18.291665 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:54:18.291665 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:54:18.291665 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:54:18.291665 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:54:18.291665 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:54:18.291665 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:54:18.291665 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 28 08:54:18.291665 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 08:54:18.291665 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 28 08:54:18.291665 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application Jul 28 08:54:18.292787 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e46f2b-2e60-459c-9e86-6f6bd9a31236 None admin] Validating token access rules against request {{(pid=352328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:54:18.294800 dv-cinder-851351-1-smb devstack@keystone.service[352329]: [pid: 352329|app: 0|req: 401/816] 10.222.0.42 () {56 vars in 1111 bytes} [Thu Jul 28 08:54:18 2022] GET /identity/v3/services/network => generated 88 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:54:18.295914 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f9afa9-fb05-4fd7-b899-bfff767c1456 None admin] Authenticating user token {{(pid=352329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:54:18.335448 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ccacda-ee59-4846-8b20-08e0de178814 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:54:18.336154 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ccacda-ee59-4846-8b20-08e0de178814 None admin] REQUEST_METHOD: `GET` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:54:18.336439 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ccacda-ee59-4846-8b20-08e0de178814 None admin] SCRIPT_NAME: `/identity` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:54:18.336743 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ccacda-ee59-4846-8b20-08e0de178814 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:54:18.346914 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG dbcounter [-] [352328] Writing DB stats keystone:SELECT=100 {{(pid=352328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:54:18.350452 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18ccacda-ee59-4846-8b20-08e0de178814 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:54:18.352939 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18ccacda-ee59-4846-8b20-08e0de178814 None admin] RBAC: Authorization granted {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:54:18.369404 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application [None req-18ccacda-ee59-4846-8b20-08e0de178814 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 08:54:18.369404 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:54:18.369404 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:54:18.369404 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:54:18.369404 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:54:18.369404 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:54:18.369404 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:54:18.369404 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:54:18.369404 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:54:18.369404 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:54:18.369404 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:54:18.369404 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:54:18.369404 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 08:54:18.369404 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 08:54:18.369404 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 08:54:18.370752 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 08:54:18.370752 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:54:18.370752 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:54:18.370752 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:54:18.370752 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:54:18.370752 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:54:18.370752 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:54:18.370752 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:54:18.370752 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application with Lock( Jul 28 08:54:18.370752 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:54:18.370752 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:54:18.370752 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:54:18.370752 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:54:18.370752 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:54:18.370752 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:54:18.370752 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:54:18.370752 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:54:18.372218 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 08:54:18.372218 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 08:54:18.372218 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 08:54:18.372218 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application Jul 28 08:54:18.372218 dv-cinder-851351-1-smb devstack@keystone.service[352328]: [pid: 352328|app: 0|req: 416/817] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 08:54:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:54:18.372218 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ccacda-ee59-4846-8b20-08e0de178814 None admin] Authenticating user token {{(pid=352328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:54:18.426691 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG dbcounter [-] [352329] Writing DB stats keystone:SELECT=100 {{(pid=352329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:54:18.457096 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f9afa9-fb05-4fd7-b899-bfff767c1456 None admin] Validating token access rules against request {{(pid=352329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:54:18.498748 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e155247-23c1-43e3-bdfd-354674d182b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:54:18.499836 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e155247-23c1-43e3-bdfd-354674d182b4 None admin] REQUEST_METHOD: `GET` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:54:18.499836 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e155247-23c1-43e3-bdfd-354674d182b4 None admin] SCRIPT_NAME: `/identity` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:54:18.500116 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e155247-23c1-43e3-bdfd-354674d182b4 None admin] PATH_INFO: `/v3/users/nova` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:54:18.513392 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e155247-23c1-43e3-bdfd-354674d182b4 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:54:18.514913 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e155247-23c1-43e3-bdfd-354674d182b4 None admin] RBAC: Authorization granted {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:54:18.527805 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application [None req-9e155247-23c1-43e3-bdfd-354674d182b4 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 28 08:54:18.527805 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:54:18.527805 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:54:18.527805 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:54:18.527805 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:54:18.527805 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:54:18.527805 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:54:18.527805 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:54:18.527805 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:54:18.527805 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:54:18.527805 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:54:18.527805 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:54:18.527805 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 28 08:54:18.527805 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 28 08:54:18.527805 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 28 08:54:18.527805 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 28 08:54:18.529125 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:54:18.529125 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:54:18.529125 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 28 08:54:18.529125 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 08:54:18.529125 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 28 08:54:18.529125 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 08:54:18.529125 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:54:18.529125 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:54:18.529125 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:54:18.529125 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:54:18.529125 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:54:18.529125 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application with Lock( Jul 28 08:54:18.529125 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:54:18.529125 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:54:18.529125 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:54:18.529125 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:54:18.529125 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:54:18.529125 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:54:18.530735 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:54:18.530735 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:54:18.530735 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 28 08:54:18.530735 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 28 08:54:18.530735 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 28 08:54:18.530735 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 28 08:54:18.530735 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 28 08:54:18.530735 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 28 08:54:18.530735 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 28 08:54:18.530735 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application Jul 28 08:54:18.530735 dv-cinder-851351-1-smb devstack@keystone.service[352329]: [pid: 352329|app: 0|req: 402/818] 10.222.0.42 () {56 vars in 1093 bytes} [Thu Jul 28 08:54:18 2022] GET /identity/v3/users/nova => generated 82 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:54:18.532145 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e155247-23c1-43e3-bdfd-354674d182b4 None admin] Authenticating user token {{(pid=352329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:54:18.532763 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ccacda-ee59-4846-8b20-08e0de178814 None admin] Validating token access rules against request {{(pid=352328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:54:18.577526 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded5d9a5-e327-43f1-98cc-f279db722fd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:54:18.578849 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded5d9a5-e327-43f1-98cc-f279db722fd2 None admin] REQUEST_METHOD: `GET` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:54:18.579816 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded5d9a5-e327-43f1-98cc-f279db722fd2 None admin] SCRIPT_NAME: `/identity` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:54:18.580426 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded5d9a5-e327-43f1-98cc-f279db722fd2 None admin] PATH_INFO: `/v3/services` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:54:18.581966 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded5d9a5-e327-43f1-98cc-f279db722fd2 None admin] RBAC: Adding query filter params (name=network) {{(pid=352328) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:54:18.582645 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded5d9a5-e327-43f1-98cc-f279db722fd2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:54:18.585444 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded5d9a5-e327-43f1-98cc-f279db722fd2 None admin] RBAC: Authorization granted {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:54:18.601058 dv-cinder-851351-1-smb devstack@keystone.service[352328]: [pid: 352328|app: 0|req: 417/819] 10.222.0.42 () {56 vars in 1112 bytes} [Thu Jul 28 08:54:18 2022] GET /identity/v3/services?name=network => generated 124 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:54:18.602901 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded5d9a5-e327-43f1-98cc-f279db722fd2 None admin] Authenticating user token {{(pid=352328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:54:18.681031 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e155247-23c1-43e3-bdfd-354674d182b4 None admin] Validating token access rules against request {{(pid=352329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:54:18.685924 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG dbcounter [-] [352328] Writing DB stats keystone:SELECT=100 {{(pid=352328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:54:18.720644 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f72dd58-5bb1-40a2-bd7a-af6c02e6515a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:54:18.721858 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f72dd58-5bb1-40a2-bd7a-af6c02e6515a None admin] REQUEST_METHOD: `GET` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:54:18.722323 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f72dd58-5bb1-40a2-bd7a-af6c02e6515a None admin] SCRIPT_NAME: `/identity` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:54:18.722777 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f72dd58-5bb1-40a2-bd7a-af6c02e6515a None admin] PATH_INFO: `/v3/domains` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:54:18.723668 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f72dd58-5bb1-40a2-bd7a-af6c02e6515a None admin] RBAC: Adding query filter params (name=Default) {{(pid=352329) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:54:18.724163 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f72dd58-5bb1-40a2-bd7a-af6c02e6515a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:54:18.725774 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f72dd58-5bb1-40a2-bd7a-af6c02e6515a None admin] RBAC: Authorization granted {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:54:18.740069 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded5d9a5-e327-43f1-98cc-f279db722fd2 None admin] Validating token access rules against request {{(pid=352328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:54:18.740378 dv-cinder-851351-1-smb devstack@keystone.service[352329]: [pid: 352329|app: 0|req: 403/820] 10.222.0.42 () {56 vars in 1109 bytes} [Thu Jul 28 08:54:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:54:18.741532 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f72dd58-5bb1-40a2-bd7a-af6c02e6515a None admin] Authenticating user token {{(pid=352329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:54:18.750788 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG dbcounter [-] [352329] Writing DB stats keystone:SELECT=100 {{(pid=352329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:54:18.780852 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c053268d-c363-4177-b615-51d3ad0ebde5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:54:18.782020 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c053268d-c363-4177-b615-51d3ad0ebde5 None admin] REQUEST_METHOD: `GET` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:54:18.782523 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c053268d-c363-4177-b615-51d3ad0ebde5 None admin] SCRIPT_NAME: `/identity` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:54:18.783071 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c053268d-c363-4177-b615-51d3ad0ebde5 None admin] PATH_INFO: `/v3/users` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:54:18.784128 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c053268d-c363-4177-b615-51d3ad0ebde5 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=352328) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:54:18.784702 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c053268d-c363-4177-b615-51d3ad0ebde5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:54:18.786516 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c053268d-c363-4177-b615-51d3ad0ebde5 None admin] RBAC: Authorization granted {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:54:18.807309 dv-cinder-851351-1-smb devstack@keystone.service[352328]: [pid: 352328|app: 0|req: 418/821] 10.222.0.42 () {56 vars in 1133 bytes} [Thu Jul 28 08:54:18 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:54:18.808693 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c053268d-c363-4177-b615-51d3ad0ebde5 None admin] Authenticating user token {{(pid=352328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:54:18.851528 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f72dd58-5bb1-40a2-bd7a-af6c02e6515a None admin] Validating token access rules against request {{(pid=352329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:54:18.891054 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248548c8-6a24-4020-941a-86155d470e4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:54:18.891708 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248548c8-6a24-4020-941a-86155d470e4a None admin] REQUEST_METHOD: `GET` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:54:18.891998 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248548c8-6a24-4020-941a-86155d470e4a None admin] SCRIPT_NAME: `/identity` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:54:18.892283 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248548c8-6a24-4020-941a-86155d470e4a None admin] PATH_INFO: `/v3/services` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:54:18.893021 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-248548c8-6a24-4020-941a-86155d470e4a None admin] RBAC: Adding query filter params (type=network) {{(pid=352329) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:54:18.893334 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-248548c8-6a24-4020-941a-86155d470e4a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:54:18.894768 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-248548c8-6a24-4020-941a-86155d470e4a None admin] RBAC: Authorization granted {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:54:18.905111 dv-cinder-851351-1-smb devstack@keystone.service[352329]: [pid: 352329|app: 0|req: 404/822] 10.222.0.42 () {56 vars in 1112 bytes} [Thu Jul 28 08:54:18 2022] GET /identity/v3/services?type=network => generated 350 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:54:18.905111 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248548c8-6a24-4020-941a-86155d470e4a None admin] Authenticating user token {{(pid=352329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:54:18.939575 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c053268d-c363-4177-b615-51d3ad0ebde5 None admin] Validating token access rules against request {{(pid=352328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:54:18.955904 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG dbcounter [-] [352328] Writing DB stats keystone:SELECT=100 {{(pid=352328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:54:18.978884 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG dbcounter [-] [352329] Writing DB stats keystone:SELECT=100 {{(pid=352329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:54:18.979771 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9f95f3-c2da-440a-9014-f1115baacbf1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:54:18.980795 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9f95f3-c2da-440a-9014-f1115baacbf1 None admin] REQUEST_METHOD: `GET` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:54:18.981312 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9f95f3-c2da-440a-9014-f1115baacbf1 None admin] SCRIPT_NAME: `/identity` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:54:18.981865 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9f95f3-c2da-440a-9014-f1115baacbf1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:54:18.990402 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd9f95f3-c2da-440a-9014-f1115baacbf1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:54:18.992302 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd9f95f3-c2da-440a-9014-f1115baacbf1 None admin] RBAC: Authorization granted {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:54:19.005407 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application [None req-bd9f95f3-c2da-440a-9014-f1115baacbf1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 08:54:19.005407 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:54:19.005407 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:54:19.005407 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:54:19.005407 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:54:19.005407 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:54:19.005407 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:54:19.005407 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:54:19.005407 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:54:19.005407 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:54:19.005407 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:54:19.005407 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:54:19.005407 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 28 08:54:19.005407 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 28 08:54:19.005407 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 28 08:54:19.006588 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 28 08:54:19.006588 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:54:19.006588 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:54:19.006588 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:54:19.006588 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:54:19.006588 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:54:19.006588 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:54:19.006588 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:54:19.006588 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application with Lock( Jul 28 08:54:19.006588 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:54:19.006588 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:54:19.006588 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:54:19.006588 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:54:19.006588 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:54:19.006588 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:54:19.006588 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:54:19.006588 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:54:19.007704 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 28 08:54:19.007704 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 28 08:54:19.007704 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 28 08:54:19.007704 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 28 08:54:19.007704 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 28 08:54:19.007704 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 28 08:54:19.007704 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 08:54:19.007704 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application Jul 28 08:54:19.010489 dv-cinder-851351-1-smb devstack@keystone.service[352328]: [pid: 352328|app: 0|req: 419/823] 10.222.0.42 () {56 vars in 1111 bytes} [Thu Jul 28 08:54:18 2022] GET /identity/v3/projects/service => generated 88 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:54:19.011653 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9f95f3-c2da-440a-9014-f1115baacbf1 None admin] Authenticating user token {{(pid=352328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:54:19.016734 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248548c8-6a24-4020-941a-86155d470e4a None admin] Validating token access rules against request {{(pid=352329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:54:19.054269 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae61ceb8-45a7-4a0b-b3f7-bcb636ef56c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:54:19.054925 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae61ceb8-45a7-4a0b-b3f7-bcb636ef56c0 None admin] REQUEST_METHOD: `GET` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:54:19.055213 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae61ceb8-45a7-4a0b-b3f7-bcb636ef56c0 None admin] SCRIPT_NAME: `/identity` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:54:19.055493 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae61ceb8-45a7-4a0b-b3f7-bcb636ef56c0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:54:19.126250 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9f95f3-c2da-440a-9014-f1115baacbf1 None admin] Validating token access rules against request {{(pid=352328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:54:19.132078 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae61ceb8-45a7-4a0b-b3f7-bcb636ef56c0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:54:19.133658 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae61ceb8-45a7-4a0b-b3f7-bcb636ef56c0 None admin] RBAC: Authorization granted {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:54:19.164912 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1809a02c-8ff1-45c3-a6ba-5d638cecb508 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:54:19.165725 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1809a02c-8ff1-45c3-a6ba-5d638cecb508 None admin] REQUEST_METHOD: `POST` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:54:19.166102 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1809a02c-8ff1-45c3-a6ba-5d638cecb508 None admin] SCRIPT_NAME: `/identity` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:54:19.166476 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1809a02c-8ff1-45c3-a6ba-5d638cecb508 None admin] PATH_INFO: `/v3/endpoints` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:54:19.167332 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1809a02c-8ff1-45c3-a6ba-5d638cecb508 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:54:19.168841 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1809a02c-8ff1-45c3-a6ba-5d638cecb508 None admin] RBAC: Authorization granted {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:54:19.196945 dv-cinder-851351-1-smb devstack@keystone.service[352328]: [pid: 352328|app: 0|req: 420/824] 10.222.0.42 () {60 vars in 1144 bytes} [Thu Jul 28 08:54:19 2022] POST /identity/v3/endpoints => generated 327 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 08:54:19.198277 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1809a02c-8ff1-45c3-a6ba-5d638cecb508 None admin] Authenticating user token {{(pid=352328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:54:19.234562 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG dbcounter [-] [352329] Writing DB stats keystone:SELECT=100 {{(pid=352329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:54:19.238927 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG dbcounter [-] [352328] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=352328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:54:19.287819 dv-cinder-851351-1-smb devstack@keystone.service[352329]: [pid: 352329|app: 0|req: 405/825] 10.222.0.42 () {58 vars in 1282 bytes} [Thu Jul 28 08:54:18 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 386 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 28 08:54:19.290636 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75111609-6038-4376-bfbc-fb4adcf3be63 None None] REQUEST_METHOD: `GET` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:54:19.291145 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75111609-6038-4376-bfbc-fb4adcf3be63 None None] SCRIPT_NAME: `/identity` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:54:19.291888 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75111609-6038-4376-bfbc-fb4adcf3be63 None None] PATH_INFO: `/` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:54:19.299253 dv-cinder-851351-1-smb devstack@keystone.service[352329]: [pid: 352329|app: 0|req: 406/826] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 08:54:19 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 08:54:19.301116 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75111609-6038-4376-bfbc-fb4adcf3be63 None None] Authenticating user token {{(pid=352329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:54:19.340471 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1809a02c-8ff1-45c3-a6ba-5d638cecb508 None admin] Validating token access rules against request {{(pid=352328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:54:19.381518 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7c472e-62d8-4b25-8c9a-683ee5a4a79f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:54:19.382239 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7c472e-62d8-4b25-8c9a-683ee5a4a79f None admin] REQUEST_METHOD: `GET` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:54:19.382532 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7c472e-62d8-4b25-8c9a-683ee5a4a79f None admin] SCRIPT_NAME: `/identity` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:54:19.382811 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7c472e-62d8-4b25-8c9a-683ee5a4a79f None admin] PATH_INFO: `/v3/projects` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:54:19.383594 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b7c472e-62d8-4b25-8c9a-683ee5a4a79f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=352328) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:54:19.383908 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b7c472e-62d8-4b25-8c9a-683ee5a4a79f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:54:19.385413 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b7c472e-62d8-4b25-8c9a-683ee5a4a79f None admin] RBAC: Authorization granted {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:54:19.404689 dv-cinder-851351-1-smb devstack@keystone.service[352328]: [pid: 352328|app: 0|req: 421/827] 10.222.0.42 () {56 vars in 1148 bytes} [Thu Jul 28 08:54:19 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:54:19.404689 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ac3dbc-4add-4027-8c60-4d577c3122d8 None None] REQUEST_METHOD: `POST` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:54:19.404689 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ac3dbc-4add-4027-8c60-4d577c3122d8 None None] SCRIPT_NAME: `/identity` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:54:19.404689 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ac3dbc-4add-4027-8c60-4d577c3122d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:54:19.423008 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.auth.core [None req-b5ac3dbc-4add-4027-8c60-4d577c3122d8 None None] MFA Rules not processed for user `d18c063b2377412485965357671e5506`. Rule list: `[]` (Enabled: `True`). {{(pid=352328) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 08:54:19.424243 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.fernet_utils [None req-b5ac3dbc-4add-4027-8c60-4d577c3122d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=352328) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:54:19.449864 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75111609-6038-4376-bfbc-fb4adcf3be63 None None] Validating token access rules against request {{(pid=352329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:54:19.492794 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f3976d-36aa-402d-b24a-de187e792cc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:54:19.493817 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f3976d-36aa-402d-b24a-de187e792cc0 None admin] REQUEST_METHOD: `GET` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:54:19.494504 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f3976d-36aa-402d-b24a-de187e792cc0 None admin] SCRIPT_NAME: `/identity` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:54:19.495968 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f3976d-36aa-402d-b24a-de187e792cc0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:54:19.507290 dv-cinder-851351-1-smb devstack@keystone.service[352328]: [pid: 352328|app: 0|req: 422/828] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 08:54:19 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 08:54:19.508229 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ac3dbc-4add-4027-8c60-4d577c3122d8 None None] Authenticating user token {{(pid=352328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:54:19.513269 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9f3976d-36aa-402d-b24a-de187e792cc0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:54:19.515404 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9f3976d-36aa-402d-b24a-de187e792cc0 None admin] RBAC: Authorization granted {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:54:19.527820 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG dbcounter [-] [352328] Writing DB stats keystone:SELECT=100 {{(pid=352328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:54:19.544207 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application [None req-f9f3976d-36aa-402d-b24a-de187e792cc0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 08:54:19.544207 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:54:19.544207 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:54:19.544207 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:54:19.544207 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:54:19.544207 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:54:19.544207 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:54:19.544207 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:54:19.544207 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:54:19.544207 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:54:19.544207 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:54:19.544207 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:54:19.544207 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 08:54:19.544207 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 08:54:19.544207 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 08:54:19.545627 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 08:54:19.545627 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:54:19.545627 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:54:19.545627 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:54:19.545627 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:54:19.545627 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:54:19.545627 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:54:19.545627 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:54:19.545627 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application with Lock( Jul 28 08:54:19.545627 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:54:19.545627 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:54:19.545627 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:54:19.545627 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:54:19.545627 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:54:19.545627 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:54:19.545627 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:54:19.545627 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:54:19.546979 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 08:54:19.546979 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 08:54:19.546979 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 08:54:19.546979 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application Jul 28 08:54:19.547644 dv-cinder-851351-1-smb devstack@keystone.service[352329]: [pid: 352329|app: 0|req: 407/829] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 08:54:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 248 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:54:19.548532 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f3976d-36aa-402d-b24a-de187e792cc0 None admin] Authenticating user token {{(pid=352329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:54:19.578740 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG dbcounter [-] [352329] Writing DB stats keystone:SELECT=100 {{(pid=352329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:54:19.648902 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ac3dbc-4add-4027-8c60-4d577c3122d8 None None] Validating token access rules against request {{(pid=352328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:54:19.673085 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f3976d-36aa-402d-b24a-de187e792cc0 None admin] Validating token access rules against request {{(pid=352329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:54:19.685329 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0444b8-2a81-45e1-ba93-488f052dc1d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:54:19.686023 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0444b8-2a81-45e1-ba93-488f052dc1d2 None admin] REQUEST_METHOD: `PUT` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:54:19.686304 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0444b8-2a81-45e1-ba93-488f052dc1d2 None admin] SCRIPT_NAME: `/identity` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:54:19.686585 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0444b8-2a81-45e1-ba93-488f052dc1d2 None admin] PATH_INFO: `/v3/projects/9cfa053c839a4fedacde7163d907e2a4/users/02fa8a25f4a844faac620f7db414011a/roles/32da6d9f8d8f48e285530909f7633410` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:54:19.703235 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b0444b8-2a81-45e1-ba93-488f052dc1d2 None admin] RBAC: Authorizing `identity:create_grant(project_id=9cfa053c839a4fedacde7163d907e2a4, user_id=02fa8a25f4a844faac620f7db414011a, role_id=32da6d9f8d8f48e285530909f7633410)` {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:54:19.705078 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b0444b8-2a81-45e1-ba93-488f052dc1d2 None admin] RBAC: Authorization granted {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:54:19.709066 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1752f209-9c5a-494c-b907-a6288114c105 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:54:19.709698 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1752f209-9c5a-494c-b907-a6288114c105 None admin] REQUEST_METHOD: `GET` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:54:19.710017 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1752f209-9c5a-494c-b907-a6288114c105 None admin] SCRIPT_NAME: `/identity` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:54:19.710328 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1752f209-9c5a-494c-b907-a6288114c105 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:54:19.728701 dv-cinder-851351-1-smb devstack@keystone.service[352328]: [pid: 352328|app: 0|req: 423/830] 10.222.0.42 () {58 vars in 1439 bytes} [Thu Jul 28 08:54:19 2022] PUT /identity/v3/projects/9cfa053c839a4fedacde7163d907e2a4/users/02fa8a25f4a844faac620f7db414011a/roles/32da6d9f8d8f48e285530909f7633410 => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 08:54:19.728701 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0444b8-2a81-45e1-ba93-488f052dc1d2 None admin] Authenticating user token {{(pid=352328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:54:19.731134 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1752f209-9c5a-494c-b907-a6288114c105 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 08:54:19.737390 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application [None req-1752f209-9c5a-494c-b907-a6288114c105 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 08:54:19.737390 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:54:19.737390 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:54:19.737390 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:54:19.737390 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:54:19.737390 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:54:19.737390 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:54:19.737390 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:54:19.737390 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:54:19.737390 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:54:19.737390 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:54:19.737390 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:54:19.737390 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 08:54:19.737390 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 08:54:19.737390 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 08:54:19.737390 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 08:54:19.738689 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 08:54:19.738689 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 08:54:19.738689 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 08:54:19.738689 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 08:54:19.738689 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:54:19.738689 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:54:19.738689 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:54:19.738689 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:54:19.738689 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:54:19.738689 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:54:19.738689 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:54:19.738689 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application with Lock( Jul 28 08:54:19.738689 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:54:19.738689 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:54:19.738689 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:54:19.738689 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:54:19.740326 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:54:19.740326 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:54:19.740326 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:54:19.740326 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:54:19.740326 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 08:54:19.740326 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 08:54:19.740326 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 08:54:19.740326 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 08:54:19.740326 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 08:54:19.740326 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 08:54:19.740326 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 08:54:19.740326 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application Jul 28 08:54:19.744313 dv-cinder-851351-1-smb devstack@keystone.service[352329]: [pid: 352329|app: 0|req: 408/831] 10.222.0.42 () {56 vars in 1096 bytes} [Thu Jul 28 08:54:19 2022] GET /identity/v3/roles/admin => generated 83 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:54:19.745503 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1752f209-9c5a-494c-b907-a6288114c105 None admin] Authenticating user token {{(pid=352329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:54:19.827613 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG dbcounter [-] [352328] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=352328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:54:19.869607 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1752f209-9c5a-494c-b907-a6288114c105 None admin] Validating token access rules against request {{(pid=352329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:54:19.881229 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0444b8-2a81-45e1-ba93-488f052dc1d2 None admin] Validating token access rules against request {{(pid=352328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:54:19.885094 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG dbcounter [-] [352329] Writing DB stats keystone:SELECT=100 {{(pid=352329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:54:19.921547 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-478c2384-b344-4820-b5c9-cd68b01ce616 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:54:19.922289 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478c2384-b344-4820-b5c9-cd68b01ce616 None admin] REQUEST_METHOD: `GET` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:54:19.922590 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478c2384-b344-4820-b5c9-cd68b01ce616 None admin] SCRIPT_NAME: `/identity` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:54:19.922851 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478c2384-b344-4820-b5c9-cd68b01ce616 None admin] PATH_INFO: `/v3/roles` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:54:19.923605 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-478c2384-b344-4820-b5c9-cd68b01ce616 None admin] RBAC: Adding query filter params (name=admin) {{(pid=352329) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:54:19.923912 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-478c2384-b344-4820-b5c9-cd68b01ce616 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:54:19.925396 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-478c2384-b344-4820-b5c9-cd68b01ce616 None admin] RBAC: Authorization granted {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:54:19.932428 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c310d57c-9cef-4ade-8e9e-1c488b21d402 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:54:19.933112 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c310d57c-9cef-4ade-8e9e-1c488b21d402 None admin] REQUEST_METHOD: `GET` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:54:19.933390 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c310d57c-9cef-4ade-8e9e-1c488b21d402 None admin] SCRIPT_NAME: `/identity` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:54:19.933661 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c310d57c-9cef-4ade-8e9e-1c488b21d402 None admin] PATH_INFO: `/v3/domains` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:54:19.934386 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c310d57c-9cef-4ade-8e9e-1c488b21d402 None admin] RBAC: Adding query filter params (name=Default) {{(pid=352328) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:54:19.934688 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c310d57c-9cef-4ade-8e9e-1c488b21d402 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:54:19.935307 dv-cinder-851351-1-smb devstack@keystone.service[352329]: [pid: 352329|app: 0|req: 409/832] 10.222.0.42 () {56 vars in 1099 bytes} [Thu Jul 28 08:54:19 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:54:19.936099 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c310d57c-9cef-4ade-8e9e-1c488b21d402 None admin] RBAC: Authorization granted {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:54:19.936493 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2933250e-5e51-4d8f-a2da-5b15b5625b74 None None] REQUEST_METHOD: `GET` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:54:19.936823 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2933250e-5e51-4d8f-a2da-5b15b5625b74 None None] SCRIPT_NAME: `/identity` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:54:19.937100 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2933250e-5e51-4d8f-a2da-5b15b5625b74 None None] PATH_INFO: `/` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:54:19.938839 dv-cinder-851351-1-smb devstack@keystone.service[352329]: [pid: 352329|app: 0|req: 410/833] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 08:54:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 08:54:19.943746 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2933250e-5e51-4d8f-a2da-5b15b5625b74 None None] Authenticating user token {{(pid=352329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:54:19.949617 dv-cinder-851351-1-smb devstack@keystone.service[352328]: [pid: 352328|app: 0|req: 424/834] 10.222.0.42 () {56 vars in 1109 bytes} [Thu Jul 28 08:54:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:54:19.951029 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e64682-f7e7-4327-878c-64b82199109c None None] REQUEST_METHOD: `POST` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:54:19.951322 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e64682-f7e7-4327-878c-64b82199109c None None] SCRIPT_NAME: `/identity` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:54:19.951600 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e64682-f7e7-4327-878c-64b82199109c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:54:19.971785 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.auth.core [None req-16e64682-f7e7-4327-878c-64b82199109c None None] MFA Rules not processed for user `d18c063b2377412485965357671e5506`. Rule list: `[]` (Enabled: `True`). {{(pid=352328) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 08:54:19.972972 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.fernet_utils [None req-16e64682-f7e7-4327-878c-64b82199109c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=352328) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:54:20.050999 dv-cinder-851351-1-smb devstack@keystone.service[352328]: [pid: 352328|app: 0|req: 425/835] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 08:54:19 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 08:54:20.052388 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e64682-f7e7-4327-878c-64b82199109c None None] Authenticating user token {{(pid=352328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:54:20.086233 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2933250e-5e51-4d8f-a2da-5b15b5625b74 None None] Validating token access rules against request {{(pid=352329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:54:20.116896 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG dbcounter [-] [352328] Writing DB stats keystone:SELECT=100 {{(pid=352328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:54:20.125912 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1432a675-d462-4be6-8d48-ead961cca904 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:54:20.126576 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1432a675-d462-4be6-8d48-ead961cca904 None admin] REQUEST_METHOD: `GET` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:54:20.126954 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1432a675-d462-4be6-8d48-ead961cca904 None admin] SCRIPT_NAME: `/identity` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:54:20.127236 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1432a675-d462-4be6-8d48-ead961cca904 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:54:20.139822 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1432a675-d462-4be6-8d48-ead961cca904 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:54:20.141445 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1432a675-d462-4be6-8d48-ead961cca904 None admin] RBAC: Authorization granted {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:54:20.144625 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG dbcounter [-] [352329] Writing DB stats keystone:SELECT=100 {{(pid=352329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:54:20.158811 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application [None req-1432a675-d462-4be6-8d48-ead961cca904 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 08:54:20.158811 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:54:20.158811 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:54:20.158811 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:54:20.158811 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:54:20.158811 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:54:20.158811 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:54:20.158811 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:54:20.158811 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:54:20.158811 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:54:20.158811 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:54:20.158811 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:54:20.158811 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 08:54:20.158811 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 08:54:20.158811 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 08:54:20.160169 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 08:54:20.160169 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:54:20.160169 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:54:20.160169 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:54:20.160169 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:54:20.160169 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:54:20.160169 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:54:20.160169 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:54:20.160169 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application with Lock( Jul 28 08:54:20.160169 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:54:20.160169 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:54:20.160169 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:54:20.160169 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:54:20.160169 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:54:20.160169 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:54:20.160169 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:54:20.160169 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:54:20.161541 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 08:54:20.161541 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 08:54:20.161541 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 08:54:20.161541 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application Jul 28 08:54:20.168904 dv-cinder-851351-1-smb devstack@keystone.service[352329]: [pid: 352329|app: 0|req: 411/836] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 08:54:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:54:20.168904 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1432a675-d462-4be6-8d48-ead961cca904 None admin] Authenticating user token {{(pid=352329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:54:20.169196 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e64682-f7e7-4327-878c-64b82199109c None None] Validating token access rules against request {{(pid=352328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:54:20.205224 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a237953d-02d5-467c-9b8e-60f36b9db43a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:54:20.206164 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a237953d-02d5-467c-9b8e-60f36b9db43a None admin] REQUEST_METHOD: `GET` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:54:20.206642 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a237953d-02d5-467c-9b8e-60f36b9db43a None admin] SCRIPT_NAME: `/identity` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:54:20.207095 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a237953d-02d5-467c-9b8e-60f36b9db43a None admin] PATH_INFO: `/v3/projects/service` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:54:20.214508 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a237953d-02d5-467c-9b8e-60f36b9db43a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:54:20.216078 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a237953d-02d5-467c-9b8e-60f36b9db43a None admin] RBAC: Authorization granted {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:54:20.228347 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application [None req-a237953d-02d5-467c-9b8e-60f36b9db43a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 08:54:20.228347 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:54:20.228347 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:54:20.228347 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:54:20.228347 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:54:20.228347 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:54:20.228347 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:54:20.228347 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:54:20.228347 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:54:20.228347 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:54:20.228347 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:54:20.228347 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:54:20.228347 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 28 08:54:20.228347 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 28 08:54:20.228347 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 28 08:54:20.231299 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 28 08:54:20.231299 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:54:20.231299 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:54:20.231299 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:54:20.231299 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:54:20.231299 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:54:20.231299 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:54:20.231299 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:54:20.231299 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application with Lock( Jul 28 08:54:20.231299 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:54:20.231299 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:54:20.231299 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:54:20.231299 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:54:20.231299 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:54:20.231299 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:54:20.231299 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:54:20.231299 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:54:20.232723 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 28 08:54:20.232723 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 28 08:54:20.232723 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 28 08:54:20.232723 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 28 08:54:20.232723 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 28 08:54:20.232723 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 28 08:54:20.232723 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 08:54:20.232723 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application Jul 28 08:54:20.232723 dv-cinder-851351-1-smb devstack@keystone.service[352328]: [pid: 352328|app: 0|req: 426/837] 10.222.0.42 () {56 vars in 1111 bytes} [Thu Jul 28 08:54:20 2022] GET /identity/v3/projects/service => generated 88 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:54:20.232723 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a237953d-02d5-467c-9b8e-60f36b9db43a None admin] Authenticating user token {{(pid=352328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:54:20.282138 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1432a675-d462-4be6-8d48-ead961cca904 None admin] Validating token access rules against request {{(pid=352329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:54:20.323722 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a574c23-2d2a-4177-aa17-282cfb55d920 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:54:20.324399 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a574c23-2d2a-4177-aa17-282cfb55d920 None admin] REQUEST_METHOD: `GET` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:54:20.324721 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a574c23-2d2a-4177-aa17-282cfb55d920 None admin] SCRIPT_NAME: `/identity` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:54:20.324999 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a574c23-2d2a-4177-aa17-282cfb55d920 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:54:20.325688 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a574c23-2d2a-4177-aa17-282cfb55d920 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:54:20.327141 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a574c23-2d2a-4177-aa17-282cfb55d920 None admin] RBAC: Authorization granted {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:54:20.339172 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application [None req-4a574c23-2d2a-4177-aa17-282cfb55d920 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 28 08:54:20.339172 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:54:20.339172 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 28 08:54:20.339172 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 28 08:54:20.339172 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 28 08:54:20.339172 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 28 08:54:20.339172 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 28 08:54:20.339172 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 08:54:20.339172 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 28 08:54:20.339172 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application Jul 28 08:54:20.339172 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 28 08:54:20.339172 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application Jul 28 08:54:20.339172 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:54:20.339172 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:54:20.339172 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:54:20.339172 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:54:20.339172 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:54:20.340835 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:54:20.340835 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:54:20.340835 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:54:20.340835 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:54:20.340835 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:54:20.340835 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:54:20.340835 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 28 08:54:20.340835 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 28 08:54:20.340835 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 28 08:54:20.340835 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 28 08:54:20.340835 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:54:20.340835 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:54:20.340835 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:54:20.340835 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:54:20.340835 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:54:20.340835 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:54:20.342073 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:54:20.342073 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application with Lock( Jul 28 08:54:20.342073 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:54:20.342073 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:54:20.342073 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:54:20.342073 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:54:20.342073 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:54:20.342073 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:54:20.342073 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:54:20.342073 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:54:20.342073 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 28 08:54:20.342073 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 08:54:20.342073 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 28 08:54:20.342073 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application Jul 28 08:54:20.346265 dv-cinder-851351-1-smb devstack@keystone.service[352329]: [pid: 352329|app: 0|req: 412/838] 10.222.0.42 () {56 vars in 1114 bytes} [Thu Jul 28 08:54:20 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:54:20.346265 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a574c23-2d2a-4177-aa17-282cfb55d920 None admin] Authenticating user token {{(pid=352329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:54:20.370937 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a237953d-02d5-467c-9b8e-60f36b9db43a None admin] Validating token access rules against request {{(pid=352328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:54:20.390006 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG dbcounter [-] [352328] Writing DB stats keystone:SELECT=100 {{(pid=352328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:54:20.411256 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e63549-3296-445f-93e2-70d588826920 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:54:20.412211 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e63549-3296-445f-93e2-70d588826920 None admin] REQUEST_METHOD: `GET` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:54:20.412803 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e63549-3296-445f-93e2-70d588826920 None admin] SCRIPT_NAME: `/identity` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:54:20.413282 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e63549-3296-445f-93e2-70d588826920 None admin] PATH_INFO: `/v3/domains` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:54:20.414161 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e63549-3296-445f-93e2-70d588826920 None admin] RBAC: Adding query filter params (name=Default) {{(pid=352328) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:54:20.414575 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e63549-3296-445f-93e2-70d588826920 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:54:20.416498 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e63549-3296-445f-93e2-70d588826920 None admin] RBAC: Authorization granted {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:54:20.425876 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG dbcounter [-] [352329] Writing DB stats keystone:SELECT=100 {{(pid=352329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:54:20.436042 dv-cinder-851351-1-smb devstack@keystone.service[352328]: [pid: 352328|app: 0|req: 427/839] 10.222.0.42 () {56 vars in 1109 bytes} [Thu Jul 28 08:54:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:54:20.436042 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e63549-3296-445f-93e2-70d588826920 None admin] Authenticating user token {{(pid=352328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:54:20.477565 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a574c23-2d2a-4177-aa17-282cfb55d920 None admin] Validating token access rules against request {{(pid=352329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:54:20.516069 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ce64a0-9e46-40be-80cd-f9853eb2ba92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:54:20.516811 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ce64a0-9e46-40be-80cd-f9853eb2ba92 None admin] REQUEST_METHOD: `GET` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:54:20.516941 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ce64a0-9e46-40be-80cd-f9853eb2ba92 None admin] SCRIPT_NAME: `/identity` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:54:20.517159 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ce64a0-9e46-40be-80cd-f9853eb2ba92 None admin] PATH_INFO: `/v3/projects` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:54:20.517938 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4ce64a0-9e46-40be-80cd-f9853eb2ba92 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=352329) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:54:20.518257 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4ce64a0-9e46-40be-80cd-f9853eb2ba92 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:54:20.519731 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4ce64a0-9e46-40be-80cd-f9853eb2ba92 None admin] RBAC: Authorization granted {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:54:20.533651 dv-cinder-851351-1-smb devstack@keystone.service[352329]: [pid: 352329|app: 0|req: 413/840] 10.222.0.42 () {56 vars in 1148 bytes} [Thu Jul 28 08:54:20 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:54:20.539327 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ce64a0-9e46-40be-80cd-f9853eb2ba92 None admin] Authenticating user token {{(pid=352329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:54:20.548069 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e63549-3296-445f-93e2-70d588826920 None admin] Validating token access rules against request {{(pid=352328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:54:20.589175 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c18c0ad4-2275-47ed-b560-a44f53e111e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:54:20.590143 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18c0ad4-2275-47ed-b560-a44f53e111e6 None admin] REQUEST_METHOD: `GET` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:54:20.590593 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18c0ad4-2275-47ed-b560-a44f53e111e6 None admin] SCRIPT_NAME: `/identity` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:54:20.591053 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18c0ad4-2275-47ed-b560-a44f53e111e6 None admin] PATH_INFO: `/v3/services` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:54:20.591757 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c18c0ad4-2275-47ed-b560-a44f53e111e6 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=352328) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:54:20.592125 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c18c0ad4-2275-47ed-b560-a44f53e111e6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:54:20.593619 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c18c0ad4-2275-47ed-b560-a44f53e111e6 None admin] RBAC: Authorization granted {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:54:20.599125 dv-cinder-851351-1-smb devstack@keystone.service[352328]: [pid: 352328|app: 0|req: 428/841] 10.222.0.42 () {56 vars in 1114 bytes} [Thu Jul 28 08:54:20 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:54:20.600373 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c18c0ad4-2275-47ed-b560-a44f53e111e6 None admin] Authenticating user token {{(pid=352328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:54:20.656751 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ce64a0-9e46-40be-80cd-f9853eb2ba92 None admin] Validating token access rules against request {{(pid=352329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:54:20.658790 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG dbcounter [-] [352328] Writing DB stats keystone:SELECT=100 {{(pid=352328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:54:20.681757 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG dbcounter [-] [352329] Writing DB stats keystone:SELECT=100 {{(pid=352329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:54:20.700193 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618e7040-0548-41d8-84f1-f059c33f132f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:54:20.701717 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618e7040-0548-41d8-84f1-f059c33f132f None admin] REQUEST_METHOD: `GET` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:54:20.702235 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618e7040-0548-41d8-84f1-f059c33f132f None admin] SCRIPT_NAME: `/identity` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:54:20.702610 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618e7040-0548-41d8-84f1-f059c33f132f None admin] PATH_INFO: `/v3/users/swift` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:54:20.713437 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-618e7040-0548-41d8-84f1-f059c33f132f None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:54:20.715079 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-618e7040-0548-41d8-84f1-f059c33f132f None admin] RBAC: Authorization granted {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:54:20.733818 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application [None req-618e7040-0548-41d8-84f1-f059c33f132f None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 28 08:54:20.733818 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:54:20.733818 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:54:20.733818 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:54:20.733818 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:54:20.733818 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:54:20.733818 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:54:20.733818 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:54:20.733818 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:54:20.733818 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:54:20.733818 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:54:20.733818 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:54:20.733818 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 28 08:54:20.733818 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 28 08:54:20.733818 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 28 08:54:20.733818 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 28 08:54:20.735412 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:54:20.735412 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:54:20.735412 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 28 08:54:20.735412 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 08:54:20.735412 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 28 08:54:20.735412 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 08:54:20.735412 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:54:20.735412 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:54:20.735412 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:54:20.735412 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:54:20.735412 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:54:20.735412 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application with Lock( Jul 28 08:54:20.735412 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:54:20.735412 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:54:20.735412 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:54:20.735412 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:54:20.735412 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:54:20.735412 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:54:20.736855 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:54:20.736855 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:54:20.736855 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 28 08:54:20.736855 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 28 08:54:20.736855 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 28 08:54:20.736855 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 28 08:54:20.736855 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 28 08:54:20.736855 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 28 08:54:20.736855 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 28 08:54:20.736855 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application Jul 28 08:54:20.738498 dv-cinder-851351-1-smb devstack@keystone.service[352329]: [pid: 352329|app: 0|req: 414/842] 10.222.0.42 () {56 vars in 1096 bytes} [Thu Jul 28 08:54:20 2022] GET /identity/v3/users/swift => generated 83 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:54:20.739593 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618e7040-0548-41d8-84f1-f059c33f132f None admin] Authenticating user token {{(pid=352329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:54:20.758198 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c18c0ad4-2275-47ed-b560-a44f53e111e6 None admin] Validating token access rules against request {{(pid=352328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:54:20.797535 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df48a55-632b-4ae0-9793-a194eb7b630f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:54:20.798090 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df48a55-632b-4ae0-9793-a194eb7b630f None admin] REQUEST_METHOD: `GET` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:54:20.798374 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df48a55-632b-4ae0-9793-a194eb7b630f None admin] SCRIPT_NAME: `/identity` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:54:20.798652 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df48a55-632b-4ae0-9793-a194eb7b630f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:54:20.799562 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3df48a55-632b-4ae0-9793-a194eb7b630f None admin] RBAC: Adding query filter params (role.id=280023171b4a45efb67c036ff237bb3c, scope.project.id=9cfa053c839a4fedacde7163d907e2a4, user.id=e3ba63c3fc36470fbbe8312b51a13f13) {{(pid=352328) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:54:20.799799 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3df48a55-632b-4ae0-9793-a194eb7b630f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:54:20.801291 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3df48a55-632b-4ae0-9793-a194eb7b630f None admin] RBAC: Authorization granted {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:54:20.808191 dv-cinder-851351-1-smb devstack@keystone.service[352328]: [pid: 352328|app: 0|req: 429/843] 10.222.0.42 () {56 vars in 1374 bytes} [Thu Jul 28 08:54:20 2022] GET /identity/v3/role_assignments?user.id=e3ba63c3fc36470fbbe8312b51a13f13&scope.project.id=9cfa053c839a4fedacde7163d907e2a4&role.id=280023171b4a45efb67c036ff237bb3c => generated 608 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:54:20.810242 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df48a55-632b-4ae0-9793-a194eb7b630f None admin] Authenticating user token {{(pid=352328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:54:20.867018 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618e7040-0548-41d8-84f1-f059c33f132f None admin] Validating token access rules against request {{(pid=352329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:54:20.935741 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7dda99-1b16-4db5-be0f-71206d821deb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:54:20.936904 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7dda99-1b16-4db5-be0f-71206d821deb None admin] REQUEST_METHOD: `GET` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:54:20.937396 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7dda99-1b16-4db5-be0f-71206d821deb None admin] SCRIPT_NAME: `/identity` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:54:20.938010 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7dda99-1b16-4db5-be0f-71206d821deb None admin] PATH_INFO: `/v3/services` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:54:20.939430 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa7dda99-1b16-4db5-be0f-71206d821deb None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=352329) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:54:20.940503 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa7dda99-1b16-4db5-be0f-71206d821deb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:54:20.942746 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa7dda99-1b16-4db5-be0f-71206d821deb None admin] RBAC: Authorization granted {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:54:20.960725 dv-cinder-851351-1-smb devstack@keystone.service[352329]: [pid: 352329|app: 0|req: 415/844] 10.222.0.42 () {56 vars in 1114 bytes} [Thu Jul 28 08:54:20 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:54:20.978104 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df48a55-632b-4ae0-9793-a194eb7b630f None admin] Validating token access rules against request {{(pid=352328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:54:20.981186 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG dbcounter [-] [352328] Writing DB stats keystone:SELECT=100 {{(pid=352328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:54:21.026071 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eab0f91-810c-4d8b-8d97-853e35599519 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:54:21.026741 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eab0f91-810c-4d8b-8d97-853e35599519 None admin] REQUEST_METHOD: `GET` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:54:21.027037 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eab0f91-810c-4d8b-8d97-853e35599519 None admin] SCRIPT_NAME: `/identity` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:54:21.027312 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eab0f91-810c-4d8b-8d97-853e35599519 None admin] PATH_INFO: `/v3/users` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:54:21.028154 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eab0f91-810c-4d8b-8d97-853e35599519 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=352328) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:54:21.028463 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eab0f91-810c-4d8b-8d97-853e35599519 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:54:21.030767 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eab0f91-810c-4d8b-8d97-853e35599519 None admin] RBAC: Authorization granted {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:54:21.053185 dv-cinder-851351-1-smb devstack@keystone.service[352328]: [pid: 352328|app: 0|req: 430/845] 10.222.0.42 () {56 vars in 1135 bytes} [Thu Jul 28 08:54:20 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:54:21.059283 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7dda99-1b16-4db5-be0f-71206d821deb None admin] Authenticating user token {{(pid=352329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:54:21.117798 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG dbcounter [-] [352329] Writing DB stats keystone:SELECT=100 {{(pid=352329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:54:21.180014 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7dda99-1b16-4db5-be0f-71206d821deb None admin] Validating token access rules against request {{(pid=352329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:54:21.217564 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0aef7d6-214a-44c9-a403-f33ba5970eb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:54:21.218650 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0aef7d6-214a-44c9-a403-f33ba5970eb5 None admin] REQUEST_METHOD: `GET` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:54:21.219210 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0aef7d6-214a-44c9-a403-f33ba5970eb5 None admin] SCRIPT_NAME: `/identity` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:54:21.219702 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0aef7d6-214a-44c9-a403-f33ba5970eb5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:54:21.292485 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0aef7d6-214a-44c9-a403-f33ba5970eb5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:54:21.294013 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0aef7d6-214a-44c9-a403-f33ba5970eb5 None admin] RBAC: Authorization granted {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:54:21.343776 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG dbcounter [-] [352329] Writing DB stats keystone:SELECT=100 {{(pid=352329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:54:21.401962 dv-cinder-851351-1-smb devstack@keystone.service[352329]: [pid: 352329|app: 0|req: 416/846] 10.222.0.42 () {58 vars in 1282 bytes} [Thu Jul 28 08:54:21 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 343 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jul 28 08:54:21.408039 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eab0f91-810c-4d8b-8d97-853e35599519 None admin] Authenticating user token {{(pid=352328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:54:21.521979 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eab0f91-810c-4d8b-8d97-853e35599519 None admin] Validating token access rules against request {{(pid=352328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:54:21.561828 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143d7d11-fdf1-4a61-8229-dcf7876be83d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:54:21.562908 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143d7d11-fdf1-4a61-8229-dcf7876be83d None admin] REQUEST_METHOD: `GET` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:54:21.563356 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143d7d11-fdf1-4a61-8229-dcf7876be83d None admin] SCRIPT_NAME: `/identity` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:54:21.563809 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143d7d11-fdf1-4a61-8229-dcf7876be83d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:54:21.575593 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-143d7d11-fdf1-4a61-8229-dcf7876be83d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:54:21.577388 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-143d7d11-fdf1-4a61-8229-dcf7876be83d None admin] RBAC: Authorization granted {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:54:21.593874 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application [None req-143d7d11-fdf1-4a61-8229-dcf7876be83d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 08:54:21.593874 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:54:21.593874 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:54:21.593874 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:54:21.593874 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:54:21.593874 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:54:21.593874 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:54:21.593874 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:54:21.593874 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:54:21.593874 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:54:21.593874 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:54:21.593874 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:54:21.593874 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 08:54:21.593874 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 08:54:21.593874 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 08:54:21.595360 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 08:54:21.595360 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:54:21.595360 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:54:21.595360 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:54:21.595360 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:54:21.595360 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:54:21.595360 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:54:21.595360 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:54:21.595360 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application with Lock( Jul 28 08:54:21.595360 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:54:21.595360 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:54:21.595360 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:54:21.595360 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:54:21.595360 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:54:21.595360 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:54:21.595360 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:54:21.595360 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:54:21.596723 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 08:54:21.596723 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 08:54:21.596723 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 08:54:21.596723 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application Jul 28 08:54:21.598638 dv-cinder-851351-1-smb devstack@keystone.service[352328]: [pid: 352328|app: 0|req: 431/847] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 08:54:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:54:21.604854 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0aef7d6-214a-44c9-a403-f33ba5970eb5 None admin] Authenticating user token {{(pid=352329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:54:21.713893 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0aef7d6-214a-44c9-a403-f33ba5970eb5 None admin] Validating token access rules against request {{(pid=352329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:54:21.750908 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc499fb4-f30e-40ba-aed1-6e55d81817c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:54:21.751559 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc499fb4-f30e-40ba-aed1-6e55d81817c8 None admin] REQUEST_METHOD: `GET` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:54:21.751840 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc499fb4-f30e-40ba-aed1-6e55d81817c8 None admin] SCRIPT_NAME: `/identity` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:54:21.752116 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc499fb4-f30e-40ba-aed1-6e55d81817c8 None admin] PATH_INFO: `/v3/domains` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:54:21.752863 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc499fb4-f30e-40ba-aed1-6e55d81817c8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=352329) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:54:21.753171 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc499fb4-f30e-40ba-aed1-6e55d81817c8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:54:21.754601 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc499fb4-f30e-40ba-aed1-6e55d81817c8 None admin] RBAC: Authorization granted {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:54:21.767947 dv-cinder-851351-1-smb devstack@keystone.service[352329]: [pid: 352329|app: 0|req: 417/848] 10.222.0.42 () {56 vars in 1109 bytes} [Thu Jul 28 08:54:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:54:21.773805 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143d7d11-fdf1-4a61-8229-dcf7876be83d None admin] Authenticating user token {{(pid=352328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:54:21.792869 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG dbcounter [-] [352328] Writing DB stats keystone:SELECT=100 {{(pid=352328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:54:21.890283 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143d7d11-fdf1-4a61-8229-dcf7876be83d None admin] Validating token access rules against request {{(pid=352328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:54:21.928401 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692bb566-eb3d-4d40-aa6e-a01b3688945e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:54:21.929584 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692bb566-eb3d-4d40-aa6e-a01b3688945e None admin] REQUEST_METHOD: `GET` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:54:21.930104 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692bb566-eb3d-4d40-aa6e-a01b3688945e None admin] SCRIPT_NAME: `/identity` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:54:21.930661 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692bb566-eb3d-4d40-aa6e-a01b3688945e None admin] PATH_INFO: `/v3/projects/service` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:54:21.939564 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-692bb566-eb3d-4d40-aa6e-a01b3688945e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:54:21.941875 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-692bb566-eb3d-4d40-aa6e-a01b3688945e None admin] RBAC: Authorization granted {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:54:21.956114 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application [None req-692bb566-eb3d-4d40-aa6e-a01b3688945e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 08:54:21.956114 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:54:21.956114 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:54:21.956114 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:54:21.956114 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:54:21.956114 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:54:21.956114 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:54:21.956114 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:54:21.956114 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:54:21.956114 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:54:21.956114 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:54:21.956114 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:54:21.956114 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 28 08:54:21.956114 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 28 08:54:21.956114 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 28 08:54:21.957563 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 28 08:54:21.957563 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:54:21.957563 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:54:21.957563 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:54:21.957563 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:54:21.957563 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:54:21.957563 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:54:21.957563 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:54:21.957563 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application with Lock( Jul 28 08:54:21.957563 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:54:21.957563 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:54:21.957563 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:54:21.957563 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:54:21.957563 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:54:21.957563 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:54:21.957563 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:54:21.957563 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:54:21.958831 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 28 08:54:21.958831 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 28 08:54:21.958831 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 28 08:54:21.958831 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 28 08:54:21.958831 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 28 08:54:21.958831 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 28 08:54:21.958831 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 08:54:21.958831 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application Jul 28 08:54:21.961941 dv-cinder-851351-1-smb devstack@keystone.service[352328]: [pid: 352328|app: 0|req: 432/849] 10.222.0.42 () {56 vars in 1111 bytes} [Thu Jul 28 08:54:21 2022] GET /identity/v3/projects/service => generated 88 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:54:21.968896 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc499fb4-f30e-40ba-aed1-6e55d81817c8 None admin] Authenticating user token {{(pid=352329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:54:21.973694 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG dbcounter [-] [352329] Writing DB stats keystone:SELECT=100 {{(pid=352329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:54:22.097943 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc499fb4-f30e-40ba-aed1-6e55d81817c8 None admin] Validating token access rules against request {{(pid=352329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:54:22.136027 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7109b23a-9b60-4a4c-8481-7a03b57d33c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:54:22.136692 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7109b23a-9b60-4a4c-8481-7a03b57d33c9 None admin] REQUEST_METHOD: `GET` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:54:22.136979 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7109b23a-9b60-4a4c-8481-7a03b57d33c9 None admin] SCRIPT_NAME: `/identity` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:54:22.137255 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7109b23a-9b60-4a4c-8481-7a03b57d33c9 None admin] PATH_INFO: `/v3/projects` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:54:22.138037 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7109b23a-9b60-4a4c-8481-7a03b57d33c9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=352329) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:54:22.138338 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7109b23a-9b60-4a4c-8481-7a03b57d33c9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:54:22.139823 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7109b23a-9b60-4a4c-8481-7a03b57d33c9 None admin] RBAC: Authorization granted {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:54:22.154269 dv-cinder-851351-1-smb devstack@keystone.service[352329]: [pid: 352329|app: 0|req: 418/850] 10.222.0.42 () {56 vars in 1148 bytes} [Thu Jul 28 08:54:21 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:54:22.161949 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692bb566-eb3d-4d40-aa6e-a01b3688945e None admin] Authenticating user token {{(pid=352328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:54:22.257573 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG dbcounter [-] [352328] Writing DB stats keystone:SELECT=100 {{(pid=352328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:54:22.289747 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692bb566-eb3d-4d40-aa6e-a01b3688945e None admin] Validating token access rules against request {{(pid=352328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:54:22.329007 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2081931-dc42-43f8-b471-9df6277a10d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:54:22.330523 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2081931-dc42-43f8-b471-9df6277a10d9 None admin] REQUEST_METHOD: `GET` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:54:22.331045 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2081931-dc42-43f8-b471-9df6277a10d9 None admin] SCRIPT_NAME: `/identity` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:54:22.331596 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2081931-dc42-43f8-b471-9df6277a10d9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:54:22.332733 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2081931-dc42-43f8-b471-9df6277a10d9 None admin] RBAC: Adding query filter params (role.id=280023171b4a45efb67c036ff237bb3c, scope.project.id=9cfa053c839a4fedacde7163d907e2a4, user.id=456c30f8918e4aef8a8e2d65f1f0faf7) {{(pid=352328) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:54:22.333379 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2081931-dc42-43f8-b471-9df6277a10d9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:54:22.335157 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2081931-dc42-43f8-b471-9df6277a10d9 None admin] RBAC: Authorization granted {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:54:22.343274 dv-cinder-851351-1-smb devstack@keystone.service[352328]: [pid: 352328|app: 0|req: 433/851] 10.222.0.42 () {56 vars in 1374 bytes} [Thu Jul 28 08:54:22 2022] GET /identity/v3/role_assignments?user.id=456c30f8918e4aef8a8e2d65f1f0faf7&scope.project.id=9cfa053c839a4fedacde7163d907e2a4&role.id=280023171b4a45efb67c036ff237bb3c => generated 608 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:54:22.407862 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26929c4-be63-4c73-9424-299f8c87d247 None None] REQUEST_METHOD: `GET` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:54:22.408118 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26929c4-be63-4c73-9424-299f8c87d247 None None] SCRIPT_NAME: `/identity` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:54:22.408398 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26929c4-be63-4c73-9424-299f8c87d247 None None] PATH_INFO: `/` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:54:22.410432 dv-cinder-851351-1-smb devstack@keystone.service[352329]: [pid: 352329|app: 0|req: 419/852] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 08:54:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 08:54:22.416943 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1451b6cd-10e0-4368-a00d-5324265b71a3 None None] REQUEST_METHOD: `POST` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:54:22.417329 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1451b6cd-10e0-4368-a00d-5324265b71a3 None None] SCRIPT_NAME: `/identity` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:54:22.417570 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1451b6cd-10e0-4368-a00d-5324265b71a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:54:22.439565 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.auth.core [None req-1451b6cd-10e0-4368-a00d-5324265b71a3 None None] MFA Rules not processed for user `d18c063b2377412485965357671e5506`. Rule list: `[]` (Enabled: `True`). {{(pid=352328) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 08:54:22.441019 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.fernet_utils [None req-1451b6cd-10e0-4368-a00d-5324265b71a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=352328) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:54:22.529246 dv-cinder-851351-1-smb devstack@keystone.service[352328]: [pid: 352328|app: 0|req: 434/853] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 08:54:22 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 08:54:22.554366 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26929c4-be63-4c73-9424-299f8c87d247 None None] Authenticating user token {{(pid=352329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:54:22.628904 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG dbcounter [-] [352329] Writing DB stats keystone:SELECT=100 {{(pid=352329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:54:22.679127 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26929c4-be63-4c73-9424-299f8c87d247 None None] Validating token access rules against request {{(pid=352329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:54:22.718620 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a0947a5-3f89-46a5-ad0d-ed32840942d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:54:22.719748 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0947a5-3f89-46a5-ad0d-ed32840942d6 None admin] REQUEST_METHOD: `GET` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:54:22.720251 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0947a5-3f89-46a5-ad0d-ed32840942d6 None admin] SCRIPT_NAME: `/identity` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:54:22.720818 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0947a5-3f89-46a5-ad0d-ed32840942d6 None admin] PATH_INFO: `/v3/roles/service` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:54:22.732475 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a0947a5-3f89-46a5-ad0d-ed32840942d6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 08:54:22.737956 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application [None req-0a0947a5-3f89-46a5-ad0d-ed32840942d6 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 28 08:54:22.737956 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:54:22.737956 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:54:22.737956 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:54:22.737956 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:54:22.737956 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:54:22.737956 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:54:22.737956 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:54:22.737956 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:54:22.737956 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:54:22.737956 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:54:22.737956 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:54:22.737956 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 08:54:22.737956 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 08:54:22.737956 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 08:54:22.737956 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 08:54:22.739105 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 08:54:22.739105 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 08:54:22.739105 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 08:54:22.739105 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 08:54:22.739105 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:54:22.739105 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:54:22.739105 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:54:22.739105 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:54:22.739105 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:54:22.739105 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:54:22.739105 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:54:22.739105 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application with Lock( Jul 28 08:54:22.739105 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:54:22.739105 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:54:22.739105 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:54:22.739105 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:54:22.740160 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:54:22.740160 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:54:22.740160 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:54:22.740160 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:54:22.740160 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 08:54:22.740160 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 08:54:22.740160 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 08:54:22.740160 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 08:54:22.740160 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 08:54:22.740160 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 08:54:22.740160 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 28 08:54:22.740160 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application Jul 28 08:54:22.743301 dv-cinder-851351-1-smb devstack@keystone.service[352329]: [pid: 352329|app: 0|req: 420/854] 10.222.0.42 () {56 vars in 1102 bytes} [Thu Jul 28 08:54:22 2022] GET /identity/v3/roles/service => generated 85 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:54:22.753892 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1451b6cd-10e0-4368-a00d-5324265b71a3 None None] Authenticating user token {{(pid=352328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:54:22.851083 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG dbcounter [-] [352328] Writing DB stats keystone:SELECT=100 {{(pid=352328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:54:22.890959 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1451b6cd-10e0-4368-a00d-5324265b71a3 None None] Validating token access rules against request {{(pid=352328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:54:22.928569 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db203cb-72a0-4df6-972c-08cacdae0248 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:54:22.929712 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db203cb-72a0-4df6-972c-08cacdae0248 None admin] REQUEST_METHOD: `GET` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:54:22.930243 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db203cb-72a0-4df6-972c-08cacdae0248 None admin] SCRIPT_NAME: `/identity` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:54:22.930751 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db203cb-72a0-4df6-972c-08cacdae0248 None admin] PATH_INFO: `/v3/roles` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:54:22.931702 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db203cb-72a0-4df6-972c-08cacdae0248 None admin] RBAC: Adding query filter params (name=service) {{(pid=352328) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:54:22.932225 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db203cb-72a0-4df6-972c-08cacdae0248 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:54:22.933872 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db203cb-72a0-4df6-972c-08cacdae0248 None admin] RBAC: Authorization granted {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:54:22.944022 dv-cinder-851351-1-smb devstack@keystone.service[352328]: [pid: 352328|app: 0|req: 435/855] 10.222.0.42 () {56 vars in 1103 bytes} [Thu Jul 28 08:54:22 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:54:22.952697 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a0947a5-3f89-46a5-ad0d-ed32840942d6 None admin] Authenticating user token {{(pid=352329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:54:23.029407 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9306d509-a86e-490d-9d0f-70fbd8a6d696 None None] REQUEST_METHOD: `GET` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:54:23.029687 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9306d509-a86e-490d-9d0f-70fbd8a6d696 None None] SCRIPT_NAME: `/identity` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:54:23.030086 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9306d509-a86e-490d-9d0f-70fbd8a6d696 None None] PATH_INFO: `/` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:54:23.031881 dv-cinder-851351-1-smb devstack@keystone.service[352328]: [pid: 352328|app: 0|req: 436/856] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 08:54:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 28 08:54:23.038336 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c9ae9e-8486-48df-9971-36b04aec7ada None None] REQUEST_METHOD: `POST` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:54:23.038759 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c9ae9e-8486-48df-9971-36b04aec7ada None None] SCRIPT_NAME: `/identity` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:54:23.039188 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c9ae9e-8486-48df-9971-36b04aec7ada None None] PATH_INFO: `/v3/auth/tokens` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:54:23.059367 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.auth.core [None req-54c9ae9e-8486-48df-9971-36b04aec7ada None None] MFA Rules not processed for user `d18c063b2377412485965357671e5506`. Rule list: `[]` (Enabled: `True`). {{(pid=352328) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 08:54:23.060994 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.fernet_utils [None req-54c9ae9e-8486-48df-9971-36b04aec7ada None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=352328) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:54:23.064100 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a0947a5-3f89-46a5-ad0d-ed32840942d6 None admin] Validating token access rules against request {{(pid=352329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:54:23.093311 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG dbcounter [-] [352329] Writing DB stats keystone:SELECT=100 {{(pid=352329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:54:23.104900 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d4ea19d-eca3-477b-81b0-7ff110a22af1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:54:23.105569 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4ea19d-eca3-477b-81b0-7ff110a22af1 None admin] REQUEST_METHOD: `GET` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:54:23.105849 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4ea19d-eca3-477b-81b0-7ff110a22af1 None admin] SCRIPT_NAME: `/identity` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:54:23.106116 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4ea19d-eca3-477b-81b0-7ff110a22af1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:54:23.118510 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d4ea19d-eca3-477b-81b0-7ff110a22af1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:54:23.120004 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d4ea19d-eca3-477b-81b0-7ff110a22af1 None admin] RBAC: Authorization granted {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:54:23.136098 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application [None req-7d4ea19d-eca3-477b-81b0-7ff110a22af1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 08:54:23.136098 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:54:23.136098 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:54:23.136098 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:54:23.136098 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:54:23.136098 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:54:23.136098 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:54:23.136098 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:54:23.136098 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:54:23.136098 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:54:23.136098 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:54:23.136098 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:54:23.136098 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 08:54:23.136098 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 08:54:23.136098 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 08:54:23.137432 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 08:54:23.137432 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:54:23.137432 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:54:23.137432 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:54:23.137432 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:54:23.137432 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:54:23.137432 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:54:23.137432 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:54:23.137432 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application with Lock( Jul 28 08:54:23.137432 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:54:23.137432 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:54:23.137432 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:54:23.137432 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:54:23.137432 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:54:23.137432 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:54:23.137432 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:54:23.137432 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:54:23.139373 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 08:54:23.139373 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 08:54:23.139373 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 08:54:23.139373 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application Jul 28 08:54:23.139373 dv-cinder-851351-1-smb devstack@keystone.service[352329]: [pid: 352329|app: 0|req: 421/857] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 08:54:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:54:23.139373 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c9409d-deaa-45c1-8c21-f2853a04a588 None None] REQUEST_METHOD: `GET` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:54:23.139373 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c9409d-deaa-45c1-8c21-f2853a04a588 None None] SCRIPT_NAME: `/identity` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:54:23.139373 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c9409d-deaa-45c1-8c21-f2853a04a588 None None] PATH_INFO: `/` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:54:23.144753 dv-cinder-851351-1-smb devstack@keystone.service[352329]: [pid: 352329|app: 0|req: 422/858] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 08:54:23 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 08:54:23.145711 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c9409d-deaa-45c1-8c21-f2853a04a588 None None] Authenticating user token {{(pid=352329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:54:23.158793 dv-cinder-851351-1-smb devstack@keystone.service[352328]: [pid: 352328|app: 0|req: 437/859] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 08:54:23 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 08:54:23.160558 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdcf517d-1af1-426a-aae3-9b8275a030d6 None None] REQUEST_METHOD: `POST` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:54:23.160881 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdcf517d-1af1-426a-aae3-9b8275a030d6 None None] SCRIPT_NAME: `/identity` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:54:23.161167 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdcf517d-1af1-426a-aae3-9b8275a030d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:54:23.183341 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.auth.core [None req-bdcf517d-1af1-426a-aae3-9b8275a030d6 None None] MFA Rules not processed for user `d18c063b2377412485965357671e5506`. Rule list: `[]` (Enabled: `True`). {{(pid=352328) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 08:54:23.184702 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.fernet_utils [None req-bdcf517d-1af1-426a-aae3-9b8275a030d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=352328) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:54:23.255732 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG dbcounter [-] [352328] Writing DB stats keystone:SELECT=100 {{(pid=352328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:54:23.268583 dv-cinder-851351-1-smb devstack@keystone.service[352328]: [pid: 352328|app: 0|req: 438/860] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 08:54:23 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 08:54:23.273614 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdcf517d-1af1-426a-aae3-9b8275a030d6 None None] Authenticating user token {{(pid=352328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:54:23.274248 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c9409d-deaa-45c1-8c21-f2853a04a588 None None] Validating token access rules against request {{(pid=352329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:54:23.313333 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed14a909-f92e-44f2-8311-a99ca17f492e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:54:23.313956 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed14a909-f92e-44f2-8311-a99ca17f492e None admin] REQUEST_METHOD: `GET` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:54:23.314235 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed14a909-f92e-44f2-8311-a99ca17f492e None admin] SCRIPT_NAME: `/identity` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:54:23.314510 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed14a909-f92e-44f2-8311-a99ca17f492e None admin] PATH_INFO: `/v3/domains` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:54:23.315212 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed14a909-f92e-44f2-8311-a99ca17f492e None admin] RBAC: Adding query filter params (name=Default) {{(pid=352329) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:54:23.315519 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed14a909-f92e-44f2-8311-a99ca17f492e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:54:23.316933 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed14a909-f92e-44f2-8311-a99ca17f492e None admin] RBAC: Authorization granted {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:54:23.330915 dv-cinder-851351-1-smb devstack@keystone.service[352329]: [pid: 352329|app: 0|req: 423/861] 10.222.0.42 () {56 vars in 1109 bytes} [Thu Jul 28 08:54:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:54:23.331756 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed14a909-f92e-44f2-8311-a99ca17f492e None admin] Authenticating user token {{(pid=352329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:54:23.372018 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG dbcounter [-] [352329] Writing DB stats keystone:SELECT=100 {{(pid=352329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:54:23.396303 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdcf517d-1af1-426a-aae3-9b8275a030d6 None None] Validating token access rules against request {{(pid=352328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:54:23.433183 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fee3e6b-f909-4b51-9311-a2938fe7887b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:54:23.433938 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fee3e6b-f909-4b51-9311-a2938fe7887b None admin] REQUEST_METHOD: `GET` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:54:23.434159 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fee3e6b-f909-4b51-9311-a2938fe7887b None admin] SCRIPT_NAME: `/identity` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:54:23.434438 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fee3e6b-f909-4b51-9311-a2938fe7887b None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:54:23.435108 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fee3e6b-f909-4b51-9311-a2938fe7887b None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:54:23.436567 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fee3e6b-f909-4b51-9311-a2938fe7887b None admin] RBAC: Authorization granted {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:54:23.446127 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed14a909-f92e-44f2-8311-a99ca17f492e None admin] Validating token access rules against request {{(pid=352329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:54:23.447088 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application [None req-4fee3e6b-f909-4b51-9311-a2938fe7887b None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 28 08:54:23.447088 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:54:23.447088 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 28 08:54:23.447088 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 28 08:54:23.447088 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 28 08:54:23.447088 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 28 08:54:23.447088 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 28 08:54:23.447088 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 08:54:23.447088 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 28 08:54:23.447088 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application Jul 28 08:54:23.447088 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 28 08:54:23.447088 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application Jul 28 08:54:23.447088 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:54:23.447088 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:54:23.447088 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:54:23.447088 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:54:23.448260 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:54:23.448260 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:54:23.448260 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:54:23.448260 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:54:23.448260 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:54:23.448260 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:54:23.448260 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:54:23.448260 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 28 08:54:23.448260 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 28 08:54:23.448260 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 28 08:54:23.448260 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 28 08:54:23.448260 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:54:23.448260 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:54:23.448260 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:54:23.448260 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:54:23.448260 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:54:23.449381 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:54:23.449381 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:54:23.449381 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application with Lock( Jul 28 08:54:23.449381 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:54:23.449381 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:54:23.449381 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:54:23.449381 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:54:23.449381 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:54:23.449381 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:54:23.449381 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:54:23.449381 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:54:23.449381 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 28 08:54:23.449381 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 08:54:23.449381 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 28 08:54:23.449381 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application Jul 28 08:54:23.449381 dv-cinder-851351-1-smb devstack@keystone.service[352328]: [pid: 352328|app: 0|req: 439/862] 10.222.0.42 () {56 vars in 1132 bytes} [Thu Jul 28 08:54:23 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:54:23.450431 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fee3e6b-f909-4b51-9311-a2938fe7887b None admin] Authenticating user token {{(pid=352328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:54:23.489162 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c804bf23-6c3e-4b94-8692-fa4293b5d6ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:54:23.489801 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c804bf23-6c3e-4b94-8692-fa4293b5d6ef None admin] REQUEST_METHOD: `POST` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:54:23.490087 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c804bf23-6c3e-4b94-8692-fa4293b5d6ef None admin] SCRIPT_NAME: `/identity` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:54:23.490364 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c804bf23-6c3e-4b94-8692-fa4293b5d6ef None admin] PATH_INFO: `/v3/services` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:54:23.491080 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c804bf23-6c3e-4b94-8692-fa4293b5d6ef None admin] RBAC: Authorizing `identity:create_service()` {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:54:23.492494 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c804bf23-6c3e-4b94-8692-fa4293b5d6ef None admin] RBAC: Authorization granted {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:54:23.509758 dv-cinder-851351-1-smb devstack@keystone.service[352329]: [pid: 352329|app: 0|req: 424/863] 10.222.0.42 () {60 vars in 1141 bytes} [Thu Jul 28 08:54:23 2022] POST /identity/v3/services => generated 251 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 08:54:23.510694 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c804bf23-6c3e-4b94-8692-fa4293b5d6ef None admin] Authenticating user token {{(pid=352329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:54:23.522161 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG dbcounter [-] [352328] Writing DB stats keystone:SELECT=100 {{(pid=352328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:54:23.608973 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fee3e6b-f909-4b51-9311-a2938fe7887b None admin] Validating token access rules against request {{(pid=352328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:54:23.641170 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG dbcounter [-] [352329] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=352329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:54:23.662087 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c804bf23-6c3e-4b94-8692-fa4293b5d6ef None admin] Validating token access rules against request {{(pid=352329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:54:23.669471 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc40a9a-1566-4966-8f0a-bb1261570d79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:54:23.670608 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc40a9a-1566-4966-8f0a-bb1261570d79 None admin] REQUEST_METHOD: `GET` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:54:23.671201 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc40a9a-1566-4966-8f0a-bb1261570d79 None admin] SCRIPT_NAME: `/identity` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:54:23.671785 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc40a9a-1566-4966-8f0a-bb1261570d79 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:54:23.682060 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fc40a9a-1566-4966-8f0a-bb1261570d79 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:54:23.684185 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fc40a9a-1566-4966-8f0a-bb1261570d79 None admin] RBAC: Authorization granted {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:54:23.698408 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application [None req-1fc40a9a-1566-4966-8f0a-bb1261570d79 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 28 08:54:23.698408 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:54:23.698408 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:54:23.698408 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:54:23.698408 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:54:23.698408 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:54:23.698408 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:54:23.698408 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:54:23.698408 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:54:23.698408 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:54:23.698408 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:54:23.698408 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:54:23.698408 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 28 08:54:23.698408 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 28 08:54:23.698408 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 28 08:54:23.698408 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 28 08:54:23.699686 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:54:23.699686 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:54:23.699686 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 28 08:54:23.699686 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 08:54:23.699686 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 28 08:54:23.699686 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 08:54:23.699686 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:54:23.699686 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:54:23.699686 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:54:23.699686 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:54:23.699686 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:54:23.699686 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application with Lock( Jul 28 08:54:23.699686 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:54:23.699686 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:54:23.699686 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:54:23.699686 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:54:23.699686 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:54:23.699686 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:54:23.700910 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:54:23.700910 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:54:23.700910 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 28 08:54:23.700910 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 28 08:54:23.700910 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 28 08:54:23.700910 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 28 08:54:23.700910 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 28 08:54:23.700910 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 28 08:54:23.700910 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 28 08:54:23.700910 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application Jul 28 08:54:23.700910 dv-cinder-851351-1-smb devstack@keystone.service[352328]: [pid: 352328|app: 0|req: 440/864] 10.222.0.42 () {56 vars in 1117 bytes} [Thu Jul 28 08:54:23 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 251 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:54:23.706118 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc40a9a-1566-4966-8f0a-bb1261570d79 None admin] Authenticating user token {{(pid=352328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:54:23.708841 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6f78ac-912b-42df-b6f7-c668804a7c0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:54:23.709713 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6f78ac-912b-42df-b6f7-c668804a7c0c None admin] REQUEST_METHOD: `GET` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:54:23.710163 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6f78ac-912b-42df-b6f7-c668804a7c0c None admin] SCRIPT_NAME: `/identity` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:54:23.710618 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6f78ac-912b-42df-b6f7-c668804a7c0c None admin] PATH_INFO: `/v3/services` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:54:23.711582 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e6f78ac-912b-42df-b6f7-c668804a7c0c None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=352329) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:54:23.712059 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e6f78ac-912b-42df-b6f7-c668804a7c0c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:54:23.713710 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e6f78ac-912b-42df-b6f7-c668804a7c0c None admin] RBAC: Authorization granted {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:54:23.719277 dv-cinder-851351-1-smb devstack@keystone.service[352329]: [pid: 352329|app: 0|req: 425/865] 10.222.0.42 () {56 vars in 1126 bytes} [Thu Jul 28 08:54:23 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:54:23.725458 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6f78ac-912b-42df-b6f7-c668804a7c0c None admin] Authenticating user token {{(pid=352329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:54:23.837183 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc40a9a-1566-4966-8f0a-bb1261570d79 None admin] Validating token access rules against request {{(pid=352328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:54:23.851955 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6f78ac-912b-42df-b6f7-c668804a7c0c None admin] Validating token access rules against request {{(pid=352329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:54:23.857525 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG dbcounter [-] [352328] Writing DB stats keystone:SELECT=100 {{(pid=352328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:54:23.885606 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcef1c90-20d9-46d4-95f8-39d05c2dfa17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:54:23.886251 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcef1c90-20d9-46d4-95f8-39d05c2dfa17 None admin] REQUEST_METHOD: `GET` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:54:23.886535 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcef1c90-20d9-46d4-95f8-39d05c2dfa17 None admin] SCRIPT_NAME: `/identity` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:54:23.886812 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcef1c90-20d9-46d4-95f8-39d05c2dfa17 None admin] PATH_INFO: `/v3/users` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:54:23.887932 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcef1c90-20d9-46d4-95f8-39d05c2dfa17 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=352328) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:54:23.888693 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcef1c90-20d9-46d4-95f8-39d05c2dfa17 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:54:23.890431 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcef1c90-20d9-46d4-95f8-39d05c2dfa17 None admin] RBAC: Authorization granted {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:54:23.898034 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbab94bd-2dcf-4407-b419-473790548a80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:54:23.898976 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbab94bd-2dcf-4407-b419-473790548a80 None admin] REQUEST_METHOD: `GET` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:54:23.899698 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbab94bd-2dcf-4407-b419-473790548a80 None admin] SCRIPT_NAME: `/identity` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:54:23.900145 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbab94bd-2dcf-4407-b419-473790548a80 None admin] PATH_INFO: `/v3/services` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:54:23.901272 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbab94bd-2dcf-4407-b419-473790548a80 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=352329) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:54:23.901816 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbab94bd-2dcf-4407-b419-473790548a80 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:54:23.904313 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbab94bd-2dcf-4407-b419-473790548a80 None admin] RBAC: Authorization granted {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:54:23.910334 dv-cinder-851351-1-smb devstack@keystone.service[352329]: [pid: 352329|app: 0|req: 426/866] 10.222.0.42 () {56 vars in 1126 bytes} [Thu Jul 28 08:54:23 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:54:23.919906 dv-cinder-851351-1-smb devstack@keystone.service[352328]: [pid: 352328|app: 0|req: 441/867] 10.222.0.42 () {56 vars in 1149 bytes} [Thu Jul 28 08:54:23 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 08:54:23.921224 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbab94bd-2dcf-4407-b419-473790548a80 None admin] Authenticating user token {{(pid=352329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:54:23.951267 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG dbcounter [-] [352329] Writing DB stats keystone:SELECT=100 {{(pid=352329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:54:24.053929 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbab94bd-2dcf-4407-b419-473790548a80 None admin] Validating token access rules against request {{(pid=352329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:54:24.098743 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-193f5ada-d17a-4e29-8be0-fb1bb9b191e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:54:24.099423 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193f5ada-d17a-4e29-8be0-fb1bb9b191e6 None admin] REQUEST_METHOD: `GET` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:54:24.099709 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193f5ada-d17a-4e29-8be0-fb1bb9b191e6 None admin] SCRIPT_NAME: `/identity` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:54:24.099989 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193f5ada-d17a-4e29-8be0-fb1bb9b191e6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:54:24.180694 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-193f5ada-d17a-4e29-8be0-fb1bb9b191e6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:54:24.182597 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-193f5ada-d17a-4e29-8be0-fb1bb9b191e6 None admin] RBAC: Authorization granted {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:54:24.209246 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG dbcounter [-] [352329] Writing DB stats keystone:SELECT=100 {{(pid=352329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:54:24.290158 dv-cinder-851351-1-smb devstack@keystone.service[352329]: [pid: 352329|app: 0|req: 427/868] 10.222.0.42 () {58 vars in 1282 bytes} [Thu Jul 28 08:54:23 2022] GET /identity/v3/auth/tokens => generated 1252 bytes in 369 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 28 08:54:24.296146 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcef1c90-20d9-46d4-95f8-39d05c2dfa17 None admin] Authenticating user token {{(pid=352328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:54:24.412088 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcef1c90-20d9-46d4-95f8-39d05c2dfa17 None admin] Validating token access rules against request {{(pid=352328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:54:24.450440 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0affd848-8af7-4a19-b550-3e319c007c9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:54:24.451146 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0affd848-8af7-4a19-b550-3e319c007c9b None admin] REQUEST_METHOD: `GET` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:54:24.451433 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0affd848-8af7-4a19-b550-3e319c007c9b None admin] SCRIPT_NAME: `/identity` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:54:24.451722 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0affd848-8af7-4a19-b550-3e319c007c9b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:54:24.463493 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0affd848-8af7-4a19-b550-3e319c007c9b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:54:24.465022 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0affd848-8af7-4a19-b550-3e319c007c9b None admin] RBAC: Authorization granted {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:54:24.481022 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application [None req-0affd848-8af7-4a19-b550-3e319c007c9b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 08:54:24.481022 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:54:24.481022 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:54:24.481022 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:54:24.481022 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:54:24.481022 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:54:24.481022 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:54:24.481022 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:54:24.481022 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:54:24.481022 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:54:24.481022 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:54:24.481022 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:54:24.481022 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 08:54:24.481022 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 08:54:24.481022 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 08:54:24.482185 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 08:54:24.482185 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:54:24.482185 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:54:24.482185 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:54:24.482185 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:54:24.482185 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:54:24.482185 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:54:24.482185 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:54:24.482185 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application with Lock( Jul 28 08:54:24.482185 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:54:24.482185 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:54:24.482185 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:54:24.482185 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:54:24.482185 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:54:24.482185 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:54:24.482185 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:54:24.482185 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:54:24.483307 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 08:54:24.483307 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 08:54:24.483307 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 08:54:24.483307 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application Jul 28 08:54:24.483307 dv-cinder-851351-1-smb devstack@keystone.service[352328]: [pid: 352328|app: 0|req: 442/869] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 08:54:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:54:24.489852 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-193f5ada-d17a-4e29-8be0-fb1bb9b191e6 None admin] Authenticating user token {{(pid=352329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:54:24.536692 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b419ee-f53f-4c80-b53e-86b400252993 None None] REQUEST_METHOD: `GET` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:54:24.537062 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b419ee-f53f-4c80-b53e-86b400252993 None None] SCRIPT_NAME: `/identity` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:54:24.537269 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b419ee-f53f-4c80-b53e-86b400252993 None None] PATH_INFO: `/` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:54:24.538941 dv-cinder-851351-1-smb devstack@keystone.service[352328]: [pid: 352328|app: 0|req: 443/870] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 08:54:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 08:54:24.544703 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897ab103-6e82-4e55-97ca-6e33c9966ff3 None None] REQUEST_METHOD: `POST` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:54:24.545009 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897ab103-6e82-4e55-97ca-6e33c9966ff3 None None] SCRIPT_NAME: `/identity` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:54:24.545278 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897ab103-6e82-4e55-97ca-6e33c9966ff3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:54:24.570597 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.auth.core [None req-897ab103-6e82-4e55-97ca-6e33c9966ff3 None None] MFA Rules not processed for user `d18c063b2377412485965357671e5506`. Rule list: `[]` (Enabled: `True`). {{(pid=352328) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 08:54:24.571929 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.fernet_utils [None req-897ab103-6e82-4e55-97ca-6e33c9966ff3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=352328) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:54:24.594926 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG dbcounter [-] [352328] Writing DB stats keystone:SELECT=100 {{(pid=352328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:54:24.612881 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-193f5ada-d17a-4e29-8be0-fb1bb9b191e6 None admin] Validating token access rules against request {{(pid=352329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:54:24.641913 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG dbcounter [-] [352329] Writing DB stats keystone:SELECT=100 {{(pid=352329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:54:24.656035 dv-cinder-851351-1-smb devstack@keystone.service[352328]: [pid: 352328|app: 0|req: 444/871] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 08:54:24 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 08:54:24.671938 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed567d6e-a603-4764-b2d4-ea6e331234e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:54:24.672745 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed567d6e-a603-4764-b2d4-ea6e331234e6 None admin] REQUEST_METHOD: `GET` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:54:24.673035 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed567d6e-a603-4764-b2d4-ea6e331234e6 None admin] SCRIPT_NAME: `/identity` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:54:24.673361 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed567d6e-a603-4764-b2d4-ea6e331234e6 None admin] PATH_INFO: `/v3/domains` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:54:24.674090 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed567d6e-a603-4764-b2d4-ea6e331234e6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=352329) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:54:24.674433 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed567d6e-a603-4764-b2d4-ea6e331234e6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:54:24.675918 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed567d6e-a603-4764-b2d4-ea6e331234e6 None admin] RBAC: Authorization granted {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:54:24.680186 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-897ab103-6e82-4e55-97ca-6e33c9966ff3 None None] Authenticating user token {{(pid=352328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:54:24.695330 dv-cinder-851351-1-smb devstack@keystone.service[352329]: [pid: 352329|app: 0|req: 428/872] 10.222.0.42 () {56 vars in 1109 bytes} [Thu Jul 28 08:54:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:54:24.697062 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed567d6e-a603-4764-b2d4-ea6e331234e6 None admin] Authenticating user token {{(pid=352329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:54:24.805833 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed567d6e-a603-4764-b2d4-ea6e331234e6 None admin] Validating token access rules against request {{(pid=352329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:54:24.817165 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-897ab103-6e82-4e55-97ca-6e33c9966ff3 None None] Validating token access rules against request {{(pid=352328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:54:24.851079 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba58681b-e17a-4d43-b36a-4c239decc6ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:54:24.851755 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba58681b-e17a-4d43-b36a-4c239decc6ee None admin] REQUEST_METHOD: `GET` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:54:24.852047 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba58681b-e17a-4d43-b36a-4c239decc6ee None admin] SCRIPT_NAME: `/identity` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:54:24.852341 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba58681b-e17a-4d43-b36a-4c239decc6ee None admin] PATH_INFO: `/v3/projects/service` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:54:24.854199 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e8eace8-1f35-4695-9fdc-ff6124ce7ab0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:54:24.854866 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8eace8-1f35-4695-9fdc-ff6124ce7ab0 None admin] REQUEST_METHOD: `GET` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:54:24.855152 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8eace8-1f35-4695-9fdc-ff6124ce7ab0 None admin] SCRIPT_NAME: `/identity` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:54:24.855427 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8eace8-1f35-4695-9fdc-ff6124ce7ab0 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:54:24.856076 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e8eace8-1f35-4695-9fdc-ff6124ce7ab0 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:54:24.857519 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e8eace8-1f35-4695-9fdc-ff6124ce7ab0 None admin] RBAC: Authorization granted {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:54:24.860066 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba58681b-e17a-4d43-b36a-4c239decc6ee None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:54:24.862233 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba58681b-e17a-4d43-b36a-4c239decc6ee None admin] RBAC: Authorization granted {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:54:24.867197 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application [None req-2e8eace8-1f35-4695-9fdc-ff6124ce7ab0 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 28 08:54:24.867197 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:54:24.867197 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 28 08:54:24.867197 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 28 08:54:24.867197 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 28 08:54:24.867197 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 28 08:54:24.867197 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 28 08:54:24.867197 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 08:54:24.867197 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 28 08:54:24.867197 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application Jul 28 08:54:24.867197 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 28 08:54:24.867197 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application Jul 28 08:54:24.867197 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:54:24.867197 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:54:24.867197 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:54:24.867197 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:54:24.867197 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:54:24.868783 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:54:24.868783 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:54:24.868783 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:54:24.868783 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:54:24.868783 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:54:24.868783 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:54:24.868783 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 28 08:54:24.868783 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 28 08:54:24.868783 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 28 08:54:24.868783 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 28 08:54:24.868783 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:54:24.868783 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:54:24.868783 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:54:24.868783 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:54:24.868783 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:54:24.868783 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:54:24.869854 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:54:24.869854 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application with Lock( Jul 28 08:54:24.869854 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:54:24.869854 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:54:24.869854 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:54:24.869854 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:54:24.869854 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:54:24.869854 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:54:24.869854 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:54:24.869854 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:54:24.869854 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 28 08:54:24.869854 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 08:54:24.869854 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 28 08:54:24.869854 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application Jul 28 08:54:24.873715 dv-cinder-851351-1-smb devstack@keystone.service[352328]: [pid: 352328|app: 0|req: 445/873] 10.222.0.42 () {56 vars in 1126 bytes} [Thu Jul 28 08:54:24 2022] GET /identity/v3/services/object-store => generated 93 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 08:54:24.874384 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application [None req-ba58681b-e17a-4d43-b36a-4c239decc6ee None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 08:54:24.874384 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:54:24.874384 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:54:24.874384 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:54:24.874384 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:54:24.874384 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:54:24.874384 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:54:24.874384 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:54:24.874384 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:54:24.874384 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:54:24.874384 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:54:24.874384 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:54:24.874384 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 28 08:54:24.874384 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 28 08:54:24.874384 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 28 08:54:24.876393 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 28 08:54:24.876393 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:54:24.876393 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:54:24.876393 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:54:24.876393 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:54:24.876393 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:54:24.876393 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:54:24.876393 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:54:24.876393 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application with Lock( Jul 28 08:54:24.876393 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:54:24.876393 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:54:24.876393 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:54:24.876393 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:54:24.876393 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:54:24.876393 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:54:24.876393 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:54:24.876393 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:54:24.878470 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 28 08:54:24.878470 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 28 08:54:24.878470 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 28 08:54:24.878470 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 28 08:54:24.878470 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 28 08:54:24.878470 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 28 08:54:24.878470 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 08:54:24.878470 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application Jul 28 08:54:24.879393 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e8eace8-1f35-4695-9fdc-ff6124ce7ab0 None admin] Authenticating user token {{(pid=352328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:54:24.884735 dv-cinder-851351-1-smb devstack@keystone.service[352329]: [pid: 352329|app: 0|req: 429/874] 10.222.0.42 () {56 vars in 1111 bytes} [Thu Jul 28 08:54:24 2022] GET /identity/v3/projects/service => generated 88 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:54:24.884735 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba58681b-e17a-4d43-b36a-4c239decc6ee None admin] Authenticating user token {{(pid=352329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:54:24.898945 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG dbcounter [-] [352328] Writing DB stats keystone:SELECT=100 {{(pid=352328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:54:24.945773 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG dbcounter [-] [352329] Writing DB stats keystone:SELECT=100 {{(pid=352329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:54:25.008105 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e8eace8-1f35-4695-9fdc-ff6124ce7ab0 None admin] Validating token access rules against request {{(pid=352328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:54:25.010621 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba58681b-e17a-4d43-b36a-4c239decc6ee None admin] Validating token access rules against request {{(pid=352329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:54:25.050613 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8190dcf-2b36-4c4f-9e69-003e2243c2e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:54:25.051454 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8190dcf-2b36-4c4f-9e69-003e2243c2e6 None admin] REQUEST_METHOD: `GET` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:54:25.051809 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8190dcf-2b36-4c4f-9e69-003e2243c2e6 None admin] SCRIPT_NAME: `/identity` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:54:25.052182 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8190dcf-2b36-4c4f-9e69-003e2243c2e6 None admin] PATH_INFO: `/v3/services` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:54:25.053106 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8190dcf-2b36-4c4f-9e69-003e2243c2e6 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=352328) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:54:25.053564 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8190dcf-2b36-4c4f-9e69-003e2243c2e6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:54:25.054043 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71719bf3-e121-41d9-88a0-6edd369e081a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:54:25.054761 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71719bf3-e121-41d9-88a0-6edd369e081a None admin] REQUEST_METHOD: `GET` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:54:25.055081 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71719bf3-e121-41d9-88a0-6edd369e081a None admin] SCRIPT_NAME: `/identity` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:54:25.055201 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8190dcf-2b36-4c4f-9e69-003e2243c2e6 None admin] RBAC: Authorization granted {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:54:25.055377 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71719bf3-e121-41d9-88a0-6edd369e081a None admin] PATH_INFO: `/v3/projects` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:54:25.056189 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71719bf3-e121-41d9-88a0-6edd369e081a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=352329) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:54:25.056802 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71719bf3-e121-41d9-88a0-6edd369e081a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:54:25.058862 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71719bf3-e121-41d9-88a0-6edd369e081a None admin] RBAC: Authorization granted {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:54:25.065907 dv-cinder-851351-1-smb devstack@keystone.service[352328]: [pid: 352328|app: 0|req: 446/875] 10.222.0.42 () {56 vars in 1122 bytes} [Thu Jul 28 08:54:24 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:54:25.067045 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8190dcf-2b36-4c4f-9e69-003e2243c2e6 None admin] Authenticating user token {{(pid=352328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:54:25.080570 dv-cinder-851351-1-smb devstack@keystone.service[352329]: [pid: 352329|app: 0|req: 430/876] 10.222.0.42 () {56 vars in 1148 bytes} [Thu Jul 28 08:54:24 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:54:25.081801 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71719bf3-e121-41d9-88a0-6edd369e081a None admin] Authenticating user token {{(pid=352329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:54:25.198229 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG dbcounter [-] [352328] Writing DB stats keystone:SELECT=100 {{(pid=352328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:54:25.226551 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8190dcf-2b36-4c4f-9e69-003e2243c2e6 None admin] Validating token access rules against request {{(pid=352328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:54:25.228285 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG dbcounter [-] [352329] Writing DB stats keystone:SELECT=100 {{(pid=352329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:54:25.236183 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71719bf3-e121-41d9-88a0-6edd369e081a None admin] Validating token access rules against request {{(pid=352329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:54:25.283617 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba233b8-3cde-431a-96ec-6558624e9041 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:54:25.284821 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba233b8-3cde-431a-96ec-6558624e9041 None admin] REQUEST_METHOD: `GET` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:54:25.285344 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba233b8-3cde-431a-96ec-6558624e9041 None admin] SCRIPT_NAME: `/identity` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:54:25.285841 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba233b8-3cde-431a-96ec-6558624e9041 None admin] PATH_INFO: `/v3/services` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:54:25.287143 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ba233b8-3cde-431a-96ec-6558624e9041 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=352328) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:54:25.287721 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ba233b8-3cde-431a-96ec-6558624e9041 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:54:25.288484 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401b94fc-097e-4055-880c-7ec840b6c9f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:54:25.289384 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401b94fc-097e-4055-880c-7ec840b6c9f8 None admin] REQUEST_METHOD: `GET` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:54:25.289894 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401b94fc-097e-4055-880c-7ec840b6c9f8 None admin] SCRIPT_NAME: `/identity` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:54:25.290371 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ba233b8-3cde-431a-96ec-6558624e9041 None admin] RBAC: Authorization granted {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:54:25.290628 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401b94fc-097e-4055-880c-7ec840b6c9f8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:54:25.291663 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-401b94fc-097e-4055-880c-7ec840b6c9f8 None admin] RBAC: Adding query filter params (role.id=32da6d9f8d8f48e285530909f7633410, scope.project.id=9cfa053c839a4fedacde7163d907e2a4, user.id=02fa8a25f4a844faac620f7db414011a) {{(pid=352329) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:54:25.292206 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-401b94fc-097e-4055-880c-7ec840b6c9f8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:54:25.294617 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-401b94fc-097e-4055-880c-7ec840b6c9f8 None admin] RBAC: Authorization granted {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:54:25.302116 dv-cinder-851351-1-smb devstack@keystone.service[352329]: [pid: 352329|app: 0|req: 431/877] 10.222.0.42 () {56 vars in 1374 bytes} [Thu Jul 28 08:54:25 2022] GET /identity/v3/role_assignments?user.id=02fa8a25f4a844faac620f7db414011a&scope.project.id=9cfa053c839a4fedacde7163d907e2a4&role.id=32da6d9f8d8f48e285530909f7633410 => generated 608 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:54:25.305189 dv-cinder-851351-1-smb devstack@keystone.service[352328]: [pid: 352328|app: 0|req: 447/878] 10.222.0.42 () {56 vars in 1122 bytes} [Thu Jul 28 08:54:25 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:54:25.692744 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40cd9921-fc00-43aa-91f0-91ad5cc973d6 None None] REQUEST_METHOD: `GET` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:54:25.693307 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40cd9921-fc00-43aa-91f0-91ad5cc973d6 None None] SCRIPT_NAME: `/identity` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:54:25.693307 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40cd9921-fc00-43aa-91f0-91ad5cc973d6 None None] PATH_INFO: `/` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:54:25.694950 dv-cinder-851351-1-smb devstack@keystone.service[352329]: [pid: 352329|app: 0|req: 432/879] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 08:54:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 08:54:25.700363 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee15d4a-ac69-4ca0-946d-ca4dede95250 None None] REQUEST_METHOD: `POST` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:54:25.700653 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee15d4a-ac69-4ca0-946d-ca4dede95250 None None] SCRIPT_NAME: `/identity` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:54:25.700985 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee15d4a-ac69-4ca0-946d-ca4dede95250 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:54:25.720514 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.auth.core [None req-5ee15d4a-ac69-4ca0-946d-ca4dede95250 None None] MFA Rules not processed for user `d18c063b2377412485965357671e5506`. Rule list: `[]` (Enabled: `True`). {{(pid=352328) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 08:54:25.721782 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.fernet_utils [None req-5ee15d4a-ac69-4ca0-946d-ca4dede95250 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=352328) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:54:25.795709 dv-cinder-851351-1-smb devstack@keystone.service[352328]: [pid: 352328|app: 0|req: 448/880] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 08:54:25 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 08:54:25.818523 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40cd9921-fc00-43aa-91f0-91ad5cc973d6 None None] Authenticating user token {{(pid=352329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:54:25.937487 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40cd9921-fc00-43aa-91f0-91ad5cc973d6 None None] Validating token access rules against request {{(pid=352329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:54:25.975151 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee6e624a-c596-41b0-8485-0e629ff0fa8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:54:25.975716 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6e624a-c596-41b0-8485-0e629ff0fa8e None admin] REQUEST_METHOD: `GET` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:54:25.976002 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6e624a-c596-41b0-8485-0e629ff0fa8e None admin] SCRIPT_NAME: `/identity` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:54:25.976277 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6e624a-c596-41b0-8485-0e629ff0fa8e None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:54:25.976951 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee6e624a-c596-41b0-8485-0e629ff0fa8e None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:54:25.978363 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee6e624a-c596-41b0-8485-0e629ff0fa8e None admin] RBAC: Authorization granted {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:54:25.987990 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application [None req-ee6e624a-c596-41b0-8485-0e629ff0fa8e None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 28 08:54:25.987990 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:54:25.987990 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 28 08:54:25.987990 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 28 08:54:25.987990 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 28 08:54:25.987990 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 28 08:54:25.987990 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 28 08:54:25.987990 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 08:54:25.987990 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 28 08:54:25.987990 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application Jul 28 08:54:25.987990 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 28 08:54:25.987990 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application Jul 28 08:54:25.987990 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:54:25.987990 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:54:25.987990 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:54:25.987990 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:54:25.987990 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:54:25.989271 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:54:25.989271 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:54:25.989271 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:54:25.989271 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:54:25.989271 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:54:25.989271 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:54:25.989271 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 28 08:54:25.989271 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 28 08:54:25.989271 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 28 08:54:25.989271 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 28 08:54:25.989271 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:54:25.989271 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:54:25.989271 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:54:25.989271 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:54:25.989271 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:54:25.989271 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:54:25.990835 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:54:25.990835 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application with Lock( Jul 28 08:54:25.990835 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:54:25.990835 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:54:25.990835 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:54:25.990835 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:54:25.990835 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:54:25.990835 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:54:25.990835 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:54:25.990835 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:54:25.990835 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 28 08:54:25.990835 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 08:54:25.990835 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 28 08:54:25.990835 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application Jul 28 08:54:25.990835 dv-cinder-851351-1-smb devstack@keystone.service[352329]: [pid: 352329|app: 0|req: 433/881] 10.222.0.42 () {56 vars in 1114 bytes} [Thu Jul 28 08:54:25 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:54:25.995343 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee15d4a-ac69-4ca0-946d-ca4dede95250 None None] Authenticating user token {{(pid=352328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:54:26.094695 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG dbcounter [-] [352328] Writing DB stats keystone:SELECT=100 {{(pid=352328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:54:26.126911 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee15d4a-ac69-4ca0-946d-ca4dede95250 None None] Validating token access rules against request {{(pid=352328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:54:26.163504 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821a125b-ea4b-4483-8d67-8211a18c444e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:54:26.164160 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821a125b-ea4b-4483-8d67-8211a18c444e None admin] REQUEST_METHOD: `GET` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:54:26.164445 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821a125b-ea4b-4483-8d67-8211a18c444e None admin] SCRIPT_NAME: `/identity` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:54:26.164752 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821a125b-ea4b-4483-8d67-8211a18c444e None admin] PATH_INFO: `/v3/services` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:54:26.165458 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-821a125b-ea4b-4483-8d67-8211a18c444e None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=352328) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:54:26.165766 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-821a125b-ea4b-4483-8d67-8211a18c444e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:54:26.167160 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-821a125b-ea4b-4483-8d67-8211a18c444e None admin] RBAC: Authorization granted {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:54:26.173382 dv-cinder-851351-1-smb devstack@keystone.service[352328]: [pid: 352328|app: 0|req: 449/882] 10.222.0.42 () {56 vars in 1114 bytes} [Thu Jul 28 08:54:25 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:54:26.180377 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee6e624a-c596-41b0-8485-0e629ff0fa8e None admin] Authenticating user token {{(pid=352329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:54:26.211445 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e3c218-85ee-4a60-a8e6-1a2741da04a5 None None] REQUEST_METHOD: `GET` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:54:26.211805 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e3c218-85ee-4a60-a8e6-1a2741da04a5 None None] SCRIPT_NAME: `/identity` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:54:26.211930 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG dbcounter [-] [352329] Writing DB stats keystone:SELECT=100 {{(pid=352329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:54:26.212041 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e3c218-85ee-4a60-a8e6-1a2741da04a5 None None] PATH_INFO: `/` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:54:26.213723 dv-cinder-851351-1-smb devstack@keystone.service[352328]: [pid: 352328|app: 0|req: 450/883] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 08:54:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 08:54:26.219387 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8aa7c0-758e-4b8d-ae64-017cb51e75dc None None] REQUEST_METHOD: `POST` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:54:26.219677 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8aa7c0-758e-4b8d-ae64-017cb51e75dc None None] SCRIPT_NAME: `/identity` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:54:26.219960 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8aa7c0-758e-4b8d-ae64-017cb51e75dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:54:26.239991 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.auth.core [None req-6a8aa7c0-758e-4b8d-ae64-017cb51e75dc None None] MFA Rules not processed for user `d18c063b2377412485965357671e5506`. Rule list: `[]` (Enabled: `True`). {{(pid=352328) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 08:54:26.241187 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.fernet_utils [None req-6a8aa7c0-758e-4b8d-ae64-017cb51e75dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=352328) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:54:26.289238 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee6e624a-c596-41b0-8485-0e629ff0fa8e None admin] Validating token access rules against request {{(pid=352329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:54:26.320754 dv-cinder-851351-1-smb devstack@keystone.service[352328]: [pid: 352328|app: 0|req: 451/884] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 08:54:26 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 28 08:54:26.325126 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee1eef9-c410-44a1-adf7-c5570a3fb47d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:54:26.325770 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee1eef9-c410-44a1-adf7-c5570a3fb47d None admin] REQUEST_METHOD: `GET` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:54:26.326057 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee1eef9-c410-44a1-adf7-c5570a3fb47d None admin] SCRIPT_NAME: `/identity` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:54:26.326334 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee1eef9-c410-44a1-adf7-c5570a3fb47d None admin] PATH_INFO: `/v3/services` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:54:26.327028 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ee1eef9-c410-44a1-adf7-c5570a3fb47d None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=352329) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:54:26.327335 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ee1eef9-c410-44a1-adf7-c5570a3fb47d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:54:26.328791 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ee1eef9-c410-44a1-adf7-c5570a3fb47d None admin] RBAC: Authorization granted {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:54:26.334458 dv-cinder-851351-1-smb devstack@keystone.service[352329]: [pid: 352329|app: 0|req: 434/885] 10.222.0.42 () {56 vars in 1114 bytes} [Thu Jul 28 08:54:26 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:54:26.338025 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8aa7c0-758e-4b8d-ae64-017cb51e75dc None None] Authenticating user token {{(pid=352328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:54:26.340063 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee1eef9-c410-44a1-adf7-c5570a3fb47d None admin] Authenticating user token {{(pid=352329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:54:26.417086 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG dbcounter [-] [352328] Writing DB stats keystone:SELECT=100 {{(pid=352328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:54:26.437860 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG dbcounter [-] [352329] Writing DB stats keystone:SELECT=100 {{(pid=352329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:54:26.447576 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee1eef9-c410-44a1-adf7-c5570a3fb47d None admin] Validating token access rules against request {{(pid=352329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:54:26.450977 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8aa7c0-758e-4b8d-ae64-017cb51e75dc None None] Validating token access rules against request {{(pid=352328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:54:26.485465 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e99b67-c498-4e5a-86b7-ba9e1cb9e6ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:54:26.486561 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e99b67-c498-4e5a-86b7-ba9e1cb9e6ae None admin] REQUEST_METHOD: `GET` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:54:26.487076 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e99b67-c498-4e5a-86b7-ba9e1cb9e6ae None admin] SCRIPT_NAME: `/identity` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:54:26.487567 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e99b67-c498-4e5a-86b7-ba9e1cb9e6ae None admin] PATH_INFO: `/v3/endpoints` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:54:26.488642 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20e99b67-c498-4e5a-86b7-ba9e1cb9e6ae None admin] RBAC: Adding query filter params (interface=public, service_id=cec47d632a42485c938764d3bfdb2de3, region_id=RegionOne) {{(pid=352329) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:54:26.489190 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20e99b67-c498-4e5a-86b7-ba9e1cb9e6ae None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:54:26.491139 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20e99b67-c498-4e5a-86b7-ba9e1cb9e6ae None admin] RBAC: Authorization granted {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:54:26.491442 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d68ffb-7bd9-44c8-a93d-026f863cfc97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:54:26.492212 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d68ffb-7bd9-44c8-a93d-026f863cfc97 None admin] REQUEST_METHOD: `POST` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:54:26.492562 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d68ffb-7bd9-44c8-a93d-026f863cfc97 None admin] SCRIPT_NAME: `/identity` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:54:26.492960 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d68ffb-7bd9-44c8-a93d-026f863cfc97 None admin] PATH_INFO: `/v3/services` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:54:26.493745 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1d68ffb-7bd9-44c8-a93d-026f863cfc97 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:54:26.495312 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1d68ffb-7bd9-44c8-a93d-026f863cfc97 None admin] RBAC: Authorization granted {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:54:26.501954 dv-cinder-851351-1-smb devstack@keystone.service[352329]: [pid: 352329|app: 0|req: 435/886] 10.222.0.42 () {56 vars in 1251 bytes} [Thu Jul 28 08:54:26 2022] GET /identity/v3/endpoints?service_id=cec47d632a42485c938764d3bfdb2de3&interface=public®ion_id=RegionOne => generated 194 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 08:54:26.508550 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e99b67-c498-4e5a-86b7-ba9e1cb9e6ae None admin] Authenticating user token {{(pid=352329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:54:26.528519 dv-cinder-851351-1-smb devstack@keystone.service[352328]: [pid: 352328|app: 0|req: 452/887] 10.222.0.42 () {60 vars in 1141 bytes} [Thu Jul 28 08:54:26 2022] POST /identity/v3/services => generated 269 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 08:54:26.634840 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e99b67-c498-4e5a-86b7-ba9e1cb9e6ae None admin] Validating token access rules against request {{(pid=352329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:54:26.678987 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f3123d-1f70-45ef-8c8b-03383507da78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:54:26.679704 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f3123d-1f70-45ef-8c8b-03383507da78 None admin] REQUEST_METHOD: `GET` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:54:26.679993 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f3123d-1f70-45ef-8c8b-03383507da78 None admin] SCRIPT_NAME: `/identity` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:54:26.680267 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f3123d-1f70-45ef-8c8b-03383507da78 None admin] PATH_INFO: `/v3/services` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:54:26.680981 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43f3123d-1f70-45ef-8c8b-03383507da78 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:54:26.682497 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43f3123d-1f70-45ef-8c8b-03383507da78 None admin] RBAC: Authorization granted {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:54:26.689729 dv-cinder-851351-1-smb devstack@keystone.service[352329]: [pid: 352329|app: 0|req: 436/888] 10.222.0.42 () {56 vars in 1087 bytes} [Thu Jul 28 08:54:26 2022] GET /identity/v3/services => generated 1268 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 08:54:27.449512 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92d7e05-ee9f-48ad-a9b5-e69ca2b5fba7 None None] REQUEST_METHOD: `GET` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:54:27.450095 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92d7e05-ee9f-48ad-a9b5-e69ca2b5fba7 None None] SCRIPT_NAME: `/identity` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:54:27.450095 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92d7e05-ee9f-48ad-a9b5-e69ca2b5fba7 None None] PATH_INFO: `/` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:54:27.451807 dv-cinder-851351-1-smb devstack@keystone.service[352328]: [pid: 352328|app: 0|req: 453/889] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 08:54:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 08:54:27.458268 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddba78a4-86cb-40be-88dc-e6ee279bb017 None None] REQUEST_METHOD: `POST` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:54:27.458952 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddba78a4-86cb-40be-88dc-e6ee279bb017 None None] SCRIPT_NAME: `/identity` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:54:27.458952 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddba78a4-86cb-40be-88dc-e6ee279bb017 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:54:27.474460 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6912705f-316d-43d0-9745-1fee6f46747e None None] REQUEST_METHOD: `GET` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:54:27.474724 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6912705f-316d-43d0-9745-1fee6f46747e None None] SCRIPT_NAME: `/identity` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:54:27.474990 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6912705f-316d-43d0-9745-1fee6f46747e None None] PATH_INFO: `/` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:54:27.476365 dv-cinder-851351-1-smb devstack@keystone.service[352328]: [pid: 352328|app: 0|req: 454/890] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 08:54:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 28 08:54:27.481674 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.auth.core [None req-ddba78a4-86cb-40be-88dc-e6ee279bb017 None None] MFA Rules not processed for user `d18c063b2377412485965357671e5506`. Rule list: `[]` (Enabled: `True`). {{(pid=352329) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 08:54:27.482001 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0a1935-546b-49b9-862a-217e59eef9bd None None] REQUEST_METHOD: `POST` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:54:27.482386 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0a1935-546b-49b9-862a-217e59eef9bd None None] SCRIPT_NAME: `/identity` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:54:27.482764 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0a1935-546b-49b9-862a-217e59eef9bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:54:27.482916 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.fernet_utils [None req-ddba78a4-86cb-40be-88dc-e6ee279bb017 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=352329) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:54:27.495563 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG dbcounter [-] [352329] Writing DB stats keystone:SELECT=100 {{(pid=352329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:54:27.503656 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.auth.core [None req-ab0a1935-546b-49b9-862a-217e59eef9bd None None] MFA Rules not processed for user `d18c063b2377412485965357671e5506`. Rule list: `[]` (Enabled: `True`). {{(pid=352328) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 08:54:27.505252 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.fernet_utils [None req-ab0a1935-546b-49b9-862a-217e59eef9bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=352328) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:54:27.566860 dv-cinder-851351-1-smb devstack@keystone.service[352329]: [pid: 352329|app: 0|req: 437/891] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 08:54:27 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 08:54:27.590223 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddba78a4-86cb-40be-88dc-e6ee279bb017 None None] Authenticating user token {{(pid=352329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:54:27.596558 dv-cinder-851351-1-smb devstack@keystone.service[352328]: [pid: 352328|app: 0|req: 455/892] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 08:54:27 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 28 08:54:27.627386 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0a1935-546b-49b9-862a-217e59eef9bd None None] Authenticating user token {{(pid=352328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:54:27.711196 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG dbcounter [-] [352328] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=352328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:54:27.754447 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddba78a4-86cb-40be-88dc-e6ee279bb017 None None] Validating token access rules against request {{(pid=352329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:54:27.775635 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0a1935-546b-49b9-862a-217e59eef9bd None None] Validating token access rules against request {{(pid=352328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:54:27.803803 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241681e4-046e-4d52-80a3-d9d808db4ab4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:54:27.804843 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241681e4-046e-4d52-80a3-d9d808db4ab4 None admin] REQUEST_METHOD: `POST` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:54:27.805311 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241681e4-046e-4d52-80a3-d9d808db4ab4 None admin] SCRIPT_NAME: `/identity` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:54:27.805689 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241681e4-046e-4d52-80a3-d9d808db4ab4 None admin] PATH_INFO: `/v3/services` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:54:27.806546 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-241681e4-046e-4d52-80a3-d9d808db4ab4 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:54:27.808070 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-241681e4-046e-4d52-80a3-d9d808db4ab4 None admin] RBAC: Authorization granted {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:54:27.830363 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a5ef85-ca38-4996-a36f-f24d38e8562a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:54:27.832377 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a5ef85-ca38-4996-a36f-f24d38e8562a None admin] REQUEST_METHOD: `GET` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:54:27.840694 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a5ef85-ca38-4996-a36f-f24d38e8562a None admin] SCRIPT_NAME: `/identity` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:54:27.840984 dv-cinder-851351-1-smb devstack@keystone.service[352329]: [pid: 352329|app: 0|req: 438/893] 10.222.0.42 () {60 vars in 1141 bytes} [Thu Jul 28 08:54:27 2022] POST /identity/v3/services => generated 241 bytes in 244 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 28 08:54:27.841104 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a5ef85-ca38-4996-a36f-f24d38e8562a None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:54:27.859204 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95a5ef85-ca38-4996-a36f-f24d38e8562a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 08:54:27.867281 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application [None req-95a5ef85-ca38-4996-a36f-f24d38e8562a None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 28 08:54:27.867281 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:54:27.867281 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:54:27.867281 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:54:27.867281 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:54:27.867281 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:54:27.867281 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:54:27.867281 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:54:27.867281 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:54:27.867281 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:54:27.867281 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:54:27.867281 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:54:27.867281 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 08:54:27.867281 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 08:54:27.867281 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 08:54:27.867281 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 08:54:27.868630 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 08:54:27.868630 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 08:54:27.868630 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 08:54:27.868630 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 08:54:27.868630 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:54:27.868630 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:54:27.868630 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:54:27.868630 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:54:27.868630 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:54:27.868630 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:54:27.868630 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:54:27.868630 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application with Lock( Jul 28 08:54:27.868630 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:54:27.868630 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:54:27.868630 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:54:27.868630 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:54:27.869815 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:54:27.869815 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:54:27.869815 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:54:27.869815 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:54:27.869815 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 08:54:27.869815 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 08:54:27.869815 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 08:54:27.869815 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 08:54:27.869815 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 08:54:27.869815 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 08:54:27.869815 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 28 08:54:27.869815 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application Jul 28 08:54:27.870698 dv-cinder-851351-1-smb devstack@keystone.service[352328]: [pid: 352328|app: 0|req: 456/894] 10.222.0.42 () {56 vars in 1120 bytes} [Thu Jul 28 08:54:27 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 243 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 08:54:27.876453 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241681e4-046e-4d52-80a3-d9d808db4ab4 None admin] Authenticating user token {{(pid=352329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:54:27.897845 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG dbcounter [-] [352329] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=352329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:54:28.039435 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241681e4-046e-4d52-80a3-d9d808db4ab4 None admin] Validating token access rules against request {{(pid=352329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:54:28.081132 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d753f841-1093-409c-9831-e12a11c7a82f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:54:28.081798 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d753f841-1093-409c-9831-e12a11c7a82f None admin] REQUEST_METHOD: `GET` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:54:28.082083 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d753f841-1093-409c-9831-e12a11c7a82f None admin] SCRIPT_NAME: `/identity` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:54:28.082361 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d753f841-1093-409c-9831-e12a11c7a82f None admin] PATH_INFO: `/v3/roles` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:54:28.083116 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d753f841-1093-409c-9831-e12a11c7a82f None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=352329) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:54:28.083422 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d753f841-1093-409c-9831-e12a11c7a82f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:54:28.084926 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d753f841-1093-409c-9831-e12a11c7a82f None admin] RBAC: Authorization granted {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:54:28.096957 dv-cinder-851351-1-smb devstack@keystone.service[352329]: [pid: 352329|app: 0|req: 439/895] 10.222.0.42 () {56 vars in 1115 bytes} [Thu Jul 28 08:54:27 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:54:28.102862 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a5ef85-ca38-4996-a36f-f24d38e8562a None admin] Authenticating user token {{(pid=352328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:54:28.240579 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a5ef85-ca38-4996-a36f-f24d38e8562a None admin] Validating token access rules against request {{(pid=352328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:54:28.262897 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG dbcounter [-] [352328] Writing DB stats keystone:SELECT=100 {{(pid=352328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:54:28.279710 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24bc2f77-3449-4c67-b52e-a6e482f5ff5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:54:28.280278 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24bc2f77-3449-4c67-b52e-a6e482f5ff5a None admin] REQUEST_METHOD: `GET` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:54:28.280561 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24bc2f77-3449-4c67-b52e-a6e482f5ff5a None admin] SCRIPT_NAME: `/identity` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:54:28.280863 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24bc2f77-3449-4c67-b52e-a6e482f5ff5a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:54:28.292476 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24bc2f77-3449-4c67-b52e-a6e482f5ff5a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:54:28.294005 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24bc2f77-3449-4c67-b52e-a6e482f5ff5a None admin] RBAC: Authorization granted {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:54:28.311644 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application [None req-24bc2f77-3449-4c67-b52e-a6e482f5ff5a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 08:54:28.311644 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:54:28.311644 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:54:28.311644 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:54:28.311644 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:54:28.311644 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:54:28.311644 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:54:28.311644 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:54:28.311644 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:54:28.311644 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:54:28.311644 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:54:28.311644 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:54:28.311644 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 08:54:28.311644 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 08:54:28.311644 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 08:54:28.314172 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 08:54:28.314172 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:54:28.314172 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:54:28.314172 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:54:28.314172 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:54:28.314172 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:54:28.314172 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:54:28.314172 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:54:28.314172 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application with Lock( Jul 28 08:54:28.314172 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:54:28.314172 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:54:28.314172 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:54:28.314172 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:54:28.314172 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:54:28.314172 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:54:28.314172 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:54:28.314172 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:54:28.316629 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 08:54:28.316629 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 08:54:28.316629 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 08:54:28.316629 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application Jul 28 08:54:28.316629 dv-cinder-851351-1-smb devstack@keystone.service[352328]: [pid: 352328|app: 0|req: 457/896] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 08:54:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:54:28.319941 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d753f841-1093-409c-9831-e12a11c7a82f None admin] Authenticating user token {{(pid=352329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:54:28.398932 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG dbcounter [-] [352329] Writing DB stats keystone:SELECT=100 {{(pid=352329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:54:28.442572 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d753f841-1093-409c-9831-e12a11c7a82f None admin] Validating token access rules against request {{(pid=352329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:54:28.488773 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23b9caa-069a-4ddb-bb46-61b33eb7a01b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:54:28.489623 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23b9caa-069a-4ddb-bb46-61b33eb7a01b None admin] REQUEST_METHOD: `GET` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:54:28.489815 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23b9caa-069a-4ddb-bb46-61b33eb7a01b None admin] SCRIPT_NAME: `/identity` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:54:28.490082 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23b9caa-069a-4ddb-bb46-61b33eb7a01b None admin] PATH_INFO: `/v3/domains` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:54:28.490862 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a23b9caa-069a-4ddb-bb46-61b33eb7a01b None admin] RBAC: Adding query filter params (name=Default) {{(pid=352329) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:54:28.491202 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a23b9caa-069a-4ddb-bb46-61b33eb7a01b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:54:28.492732 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a23b9caa-069a-4ddb-bb46-61b33eb7a01b None admin] RBAC: Authorization granted {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:54:28.508987 dv-cinder-851351-1-smb devstack@keystone.service[352329]: [pid: 352329|app: 0|req: 440/897] 10.222.0.42 () {56 vars in 1109 bytes} [Thu Jul 28 08:54:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:54:28.514779 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24bc2f77-3449-4c67-b52e-a6e482f5ff5a None admin] Authenticating user token {{(pid=352328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:54:28.643498 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24bc2f77-3449-4c67-b52e-a6e482f5ff5a None admin] Validating token access rules against request {{(pid=352328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:54:28.695420 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8289307-620a-48f6-a2ef-5ef9d0cb8ef7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:54:28.696419 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8289307-620a-48f6-a2ef-5ef9d0cb8ef7 None admin] REQUEST_METHOD: `GET` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:54:28.696874 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8289307-620a-48f6-a2ef-5ef9d0cb8ef7 None admin] SCRIPT_NAME: `/identity` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:54:28.697283 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8289307-620a-48f6-a2ef-5ef9d0cb8ef7 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:54:28.710164 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8289307-620a-48f6-a2ef-5ef9d0cb8ef7 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:54:28.711729 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8289307-620a-48f6-a2ef-5ef9d0cb8ef7 None admin] RBAC: Authorization granted {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:54:28.731030 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application [None req-d8289307-620a-48f6-a2ef-5ef9d0cb8ef7 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 28 08:54:28.731030 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:54:28.731030 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:54:28.731030 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:54:28.731030 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:54:28.731030 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:54:28.731030 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:54:28.731030 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:54:28.731030 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:54:28.731030 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:54:28.731030 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:54:28.731030 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:54:28.731030 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 28 08:54:28.731030 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 28 08:54:28.731030 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 28 08:54:28.731030 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 28 08:54:28.732332 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:54:28.732332 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:54:28.732332 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 28 08:54:28.732332 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 08:54:28.732332 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 28 08:54:28.732332 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 08:54:28.732332 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:54:28.732332 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:54:28.732332 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:54:28.732332 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:54:28.732332 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:54:28.732332 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application with Lock( Jul 28 08:54:28.732332 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:54:28.732332 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:54:28.732332 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:54:28.732332 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:54:28.732332 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:54:28.732332 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:54:28.733620 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:54:28.733620 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:54:28.733620 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 28 08:54:28.733620 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 28 08:54:28.733620 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 28 08:54:28.733620 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 28 08:54:28.733620 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 28 08:54:28.733620 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 28 08:54:28.733620 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 28 08:54:28.733620 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application Jul 28 08:54:28.733620 dv-cinder-851351-1-smb devstack@keystone.service[352328]: [pid: 352328|app: 0|req: 458/898] 10.222.0.42 () {56 vars in 1117 bytes} [Thu Jul 28 08:54:28 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:54:28.740930 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23b9caa-069a-4ddb-bb46-61b33eb7a01b None admin] Authenticating user token {{(pid=352329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:54:28.801728 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154f38ef-d6c6-467c-9276-1a1d99a15ec4 None None] REQUEST_METHOD: `GET` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:54:28.802436 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154f38ef-d6c6-467c-9276-1a1d99a15ec4 None None] SCRIPT_NAME: `/identity` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:54:28.802943 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154f38ef-d6c6-467c-9276-1a1d99a15ec4 None None] PATH_INFO: `/` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:54:28.805004 dv-cinder-851351-1-smb devstack@keystone.service[352328]: [pid: 352328|app: 0|req: 459/899] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 08:54:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 28 08:54:28.815866 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3e8502-6ae5-4607-8267-90a76a27b071 None None] REQUEST_METHOD: `POST` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:54:28.816533 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3e8502-6ae5-4607-8267-90a76a27b071 None None] SCRIPT_NAME: `/identity` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:54:28.817112 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3e8502-6ae5-4607-8267-90a76a27b071 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:54:28.839438 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.auth.core [None req-7d3e8502-6ae5-4607-8267-90a76a27b071 None None] MFA Rules not processed for user `d18c063b2377412485965357671e5506`. Rule list: `[]` (Enabled: `True`). {{(pid=352328) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 08:54:28.841158 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.fernet_utils [None req-7d3e8502-6ae5-4607-8267-90a76a27b071 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=352328) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:54:28.879145 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG dbcounter [-] [352328] Writing DB stats keystone:SELECT=100 {{(pid=352328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:54:28.885014 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23b9caa-069a-4ddb-bb46-61b33eb7a01b None admin] Validating token access rules against request {{(pid=352329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:54:28.917631 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG dbcounter [-] [352329] Writing DB stats keystone:SELECT=100 {{(pid=352329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:54:28.931056 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed1f371-8eb6-46e8-b078-44078a30e701 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:54:28.931696 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed1f371-8eb6-46e8-b078-44078a30e701 None admin] REQUEST_METHOD: `GET` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:54:28.932339 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed1f371-8eb6-46e8-b078-44078a30e701 None admin] SCRIPT_NAME: `/identity` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:54:28.932339 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed1f371-8eb6-46e8-b078-44078a30e701 None admin] PATH_INFO: `/v3/users` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:54:28.938149 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aed1f371-8eb6-46e8-b078-44078a30e701 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=352329) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:54:28.938149 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aed1f371-8eb6-46e8-b078-44078a30e701 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:54:28.938149 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aed1f371-8eb6-46e8-b078-44078a30e701 None admin] RBAC: Authorization granted {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:54:28.949284 dv-cinder-851351-1-smb devstack@keystone.service[352328]: [pid: 352328|app: 0|req: 460/900] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 08:54:28 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 28 08:54:28.954791 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317ec0d8-47ab-4e60-bdd7-c7399f026d46 None None] REQUEST_METHOD: `GET` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:54:28.955204 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317ec0d8-47ab-4e60-bdd7-c7399f026d46 None None] SCRIPT_NAME: `/identity` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:54:28.955542 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317ec0d8-47ab-4e60-bdd7-c7399f026d46 None None] PATH_INFO: `/` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:54:28.962263 dv-cinder-851351-1-smb devstack@keystone.service[352328]: [pid: 352328|app: 0|req: 461/901] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 08:54:28 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 08:54:28.964387 dv-cinder-851351-1-smb devstack@keystone.service[352329]: [pid: 352329|app: 0|req: 441/902] 10.222.0.42 () {56 vars in 1149 bytes} [Thu Jul 28 08:54:28 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:54:28.966946 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d11c0f8-b224-4a40-8643-5c414d55cf12 None None] REQUEST_METHOD: `POST` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:54:28.967547 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d11c0f8-b224-4a40-8643-5c414d55cf12 None None] SCRIPT_NAME: `/identity` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:54:28.968048 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d11c0f8-b224-4a40-8643-5c414d55cf12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:54:28.970218 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed1f371-8eb6-46e8-b078-44078a30e701 None admin] Authenticating user token {{(pid=352329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:54:28.991104 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.auth.core [None req-1d11c0f8-b224-4a40-8643-5c414d55cf12 None None] MFA Rules not processed for user `d18c063b2377412485965357671e5506`. Rule list: `[]` (Enabled: `True`). {{(pid=352328) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 08:54:28.991104 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.fernet_utils [None req-1d11c0f8-b224-4a40-8643-5c414d55cf12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=352328) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:54:29.096707 dv-cinder-851351-1-smb devstack@keystone.service[352328]: [pid: 352328|app: 0|req: 462/903] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 08:54:28 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 08:54:29.096962 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d11c0f8-b224-4a40-8643-5c414d55cf12 None None] Authenticating user token {{(pid=352328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:54:29.114423 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed1f371-8eb6-46e8-b078-44078a30e701 None admin] Validating token access rules against request {{(pid=352329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:54:29.163427 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3da0c2f-a8b7-491c-9c00-498c68759404 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:54:29.164135 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3da0c2f-a8b7-491c-9c00-498c68759404 None admin] REQUEST_METHOD: `GET` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:54:29.164405 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3da0c2f-a8b7-491c-9c00-498c68759404 None admin] SCRIPT_NAME: `/identity` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:54:29.164737 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3da0c2f-a8b7-491c-9c00-498c68759404 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:54:29.226072 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG dbcounter [-] [352329] Writing DB stats keystone:SELECT=100 {{(pid=352329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:54:29.229003 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG dbcounter [-] [352328] Writing DB stats keystone:SELECT=100 {{(pid=352328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:54:29.242779 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d11c0f8-b224-4a40-8643-5c414d55cf12 None None] Validating token access rules against request {{(pid=352328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:54:29.252012 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3da0c2f-a8b7-491c-9c00-498c68759404 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:54:29.253886 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3da0c2f-a8b7-491c-9c00-498c68759404 None admin] RBAC: Authorization granted {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:54:29.286157 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72fc8052-c553-4e9f-abca-4a6dcd0d8401 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:54:29.287118 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fc8052-c553-4e9f-abca-4a6dcd0d8401 None admin] REQUEST_METHOD: `GET` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:54:29.287461 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fc8052-c553-4e9f-abca-4a6dcd0d8401 None admin] SCRIPT_NAME: `/identity` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:54:29.287873 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fc8052-c553-4e9f-abca-4a6dcd0d8401 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:54:29.288890 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72fc8052-c553-4e9f-abca-4a6dcd0d8401 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:54:29.291065 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72fc8052-c553-4e9f-abca-4a6dcd0d8401 None admin] RBAC: Authorization granted {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:54:29.306293 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application [None req-72fc8052-c553-4e9f-abca-4a6dcd0d8401 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 28 08:54:29.306293 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:54:29.306293 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 28 08:54:29.306293 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 28 08:54:29.306293 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 28 08:54:29.306293 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 28 08:54:29.306293 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 28 08:54:29.306293 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 08:54:29.306293 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 28 08:54:29.306293 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application Jul 28 08:54:29.306293 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 28 08:54:29.306293 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application Jul 28 08:54:29.306293 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:54:29.306293 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:54:29.306293 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:54:29.306293 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:54:29.307682 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:54:29.307682 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:54:29.307682 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:54:29.307682 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:54:29.307682 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:54:29.307682 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:54:29.307682 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:54:29.307682 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 28 08:54:29.307682 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 28 08:54:29.307682 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 28 08:54:29.307682 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 28 08:54:29.307682 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:54:29.307682 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:54:29.307682 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:54:29.307682 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:54:29.307682 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:54:29.314288 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:54:29.314288 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:54:29.314288 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application with Lock( Jul 28 08:54:29.314288 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:54:29.314288 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:54:29.314288 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:54:29.314288 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:54:29.314288 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:54:29.314288 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:54:29.314288 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:54:29.314288 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:54:29.314288 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 28 08:54:29.314288 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 08:54:29.314288 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 28 08:54:29.314288 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application Jul 28 08:54:29.314288 dv-cinder-851351-1-smb devstack@keystone.service[352328]: [pid: 352328|app: 0|req: 463/904] 10.222.0.42 () {56 vars in 1132 bytes} [Thu Jul 28 08:54:29 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:54:29.315376 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72fc8052-c553-4e9f-abca-4a6dcd0d8401 None admin] Authenticating user token {{(pid=352328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:54:29.386878 dv-cinder-851351-1-smb devstack@keystone.service[352329]: [pid: 352329|app: 0|req: 442/905] 10.222.0.42 () {58 vars in 1282 bytes} [Thu Jul 28 08:54:28 2022] GET /identity/v3/auth/tokens => generated 1464 bytes in 412 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jul 28 08:54:29.386878 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3da0c2f-a8b7-491c-9c00-498c68759404 None admin] Authenticating user token {{(pid=352329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:54:29.475995 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72fc8052-c553-4e9f-abca-4a6dcd0d8401 None admin] Validating token access rules against request {{(pid=352328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:54:29.509852 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG dbcounter [-] [352329] Writing DB stats keystone:SELECT=100 {{(pid=352329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:54:29.521812 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f8876f2-9139-437f-8b9f-b61a08272c3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:54:29.522615 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8876f2-9139-437f-8b9f-b61a08272c3b None admin] REQUEST_METHOD: `GET` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:54:29.522904 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8876f2-9139-437f-8b9f-b61a08272c3b None admin] SCRIPT_NAME: `/identity` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:54:29.523173 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8876f2-9139-437f-8b9f-b61a08272c3b None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:54:29.523801 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f8876f2-9139-437f-8b9f-b61a08272c3b None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:54:29.525290 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f8876f2-9139-437f-8b9f-b61a08272c3b None admin] RBAC: Authorization granted {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:54:29.535811 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application [None req-5f8876f2-9139-437f-8b9f-b61a08272c3b None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 28 08:54:29.535811 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:54:29.535811 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 28 08:54:29.535811 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 28 08:54:29.535811 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 28 08:54:29.535811 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 28 08:54:29.535811 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 28 08:54:29.535811 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 08:54:29.535811 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 28 08:54:29.535811 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application Jul 28 08:54:29.535811 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 28 08:54:29.535811 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application Jul 28 08:54:29.535811 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:54:29.535811 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:54:29.535811 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:54:29.535811 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:54:29.535811 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:54:29.537427 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:54:29.537427 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:54:29.537427 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:54:29.537427 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:54:29.537427 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:54:29.537427 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:54:29.537427 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 28 08:54:29.537427 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 28 08:54:29.537427 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 28 08:54:29.537427 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 28 08:54:29.537427 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:54:29.537427 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:54:29.537427 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:54:29.537427 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:54:29.537427 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:54:29.537427 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:54:29.538665 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:54:29.538665 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application with Lock( Jul 28 08:54:29.538665 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:54:29.538665 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:54:29.538665 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:54:29.538665 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:54:29.538665 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:54:29.538665 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:54:29.538665 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:54:29.538665 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:54:29.538665 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 28 08:54:29.538665 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 08:54:29.538665 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 28 08:54:29.538665 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application Jul 28 08:54:29.542366 dv-cinder-851351-1-smb devstack@keystone.service[352328]: [pid: 352328|app: 0|req: 464/906] 10.222.0.42 () {56 vars in 1114 bytes} [Thu Jul 28 08:54:29 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:54:29.543491 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f8876f2-9139-437f-8b9f-b61a08272c3b None admin] Authenticating user token {{(pid=352328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:54:29.547339 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3da0c2f-a8b7-491c-9c00-498c68759404 None admin] Validating token access rules against request {{(pid=352329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:54:29.577368 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG dbcounter [-] [352328] Writing DB stats keystone:SELECT=100 {{(pid=352328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:54:29.589905 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79241ebb-e95b-4d58-95d2-9bf8f9620943 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:54:29.590547 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79241ebb-e95b-4d58-95d2-9bf8f9620943 None admin] REQUEST_METHOD: `GET` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:54:29.590825 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79241ebb-e95b-4d58-95d2-9bf8f9620943 None admin] SCRIPT_NAME: `/identity` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:54:29.591097 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79241ebb-e95b-4d58-95d2-9bf8f9620943 None admin] PATH_INFO: `/v3/services` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:54:29.592168 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79241ebb-e95b-4d58-95d2-9bf8f9620943 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=352329) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:54:29.592168 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79241ebb-e95b-4d58-95d2-9bf8f9620943 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:54:29.593526 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79241ebb-e95b-4d58-95d2-9bf8f9620943 None admin] RBAC: Authorization granted {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:54:29.598955 dv-cinder-851351-1-smb devstack@keystone.service[352329]: [pid: 352329|app: 0|req: 443/907] 10.222.0.42 () {56 vars in 1126 bytes} [Thu Jul 28 08:54:29 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:54:29.599720 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79241ebb-e95b-4d58-95d2-9bf8f9620943 None admin] Authenticating user token {{(pid=352329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:54:29.689897 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f8876f2-9139-437f-8b9f-b61a08272c3b None admin] Validating token access rules against request {{(pid=352328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:54:29.722136 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79241ebb-e95b-4d58-95d2-9bf8f9620943 None admin] Validating token access rules against request {{(pid=352329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:54:29.737180 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b78b3eba-8533-4ed0-965a-fc6355331cfa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:54:29.738019 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78b3eba-8533-4ed0-965a-fc6355331cfa None admin] REQUEST_METHOD: `GET` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:54:29.738503 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78b3eba-8533-4ed0-965a-fc6355331cfa None admin] SCRIPT_NAME: `/identity` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:54:29.738774 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78b3eba-8533-4ed0-965a-fc6355331cfa None admin] PATH_INFO: `/v3/domains/Default` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:54:29.755534 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b78b3eba-8533-4ed0-965a-fc6355331cfa None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:54:29.757063 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b78b3eba-8533-4ed0-965a-fc6355331cfa None admin] RBAC: Authorization granted {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:54:29.764235 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b2bb9b6-78ad-47c2-892c-7812a2405e41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:54:29.765092 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2bb9b6-78ad-47c2-892c-7812a2405e41 None admin] REQUEST_METHOD: `GET` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:54:29.765538 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2bb9b6-78ad-47c2-892c-7812a2405e41 None admin] SCRIPT_NAME: `/identity` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:54:29.766376 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2bb9b6-78ad-47c2-892c-7812a2405e41 None admin] PATH_INFO: `/v3/services` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:54:29.767198 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b2bb9b6-78ad-47c2-892c-7812a2405e41 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=352329) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:54:29.767834 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b2bb9b6-78ad-47c2-892c-7812a2405e41 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:54:29.769710 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b2bb9b6-78ad-47c2-892c-7812a2405e41 None admin] RBAC: Authorization granted {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:54:29.774045 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application [None req-b78b3eba-8533-4ed0-965a-fc6355331cfa None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 08:54:29.774045 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:54:29.774045 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:54:29.774045 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:54:29.774045 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:54:29.774045 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:54:29.774045 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:54:29.774045 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:54:29.774045 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:54:29.774045 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:54:29.774045 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:54:29.774045 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:54:29.774045 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 08:54:29.774045 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 08:54:29.774045 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 08:54:29.775396 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 08:54:29.775396 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:54:29.775396 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:54:29.775396 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:54:29.775396 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:54:29.775396 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:54:29.775396 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:54:29.775396 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:54:29.775396 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application with Lock( Jul 28 08:54:29.775396 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:54:29.775396 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:54:29.775396 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:54:29.775396 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:54:29.775396 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:54:29.775396 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:54:29.775396 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:54:29.775396 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:54:29.777304 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 08:54:29.777304 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 08:54:29.777304 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 08:54:29.777304 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application Jul 28 08:54:29.777304 dv-cinder-851351-1-smb devstack@keystone.service[352328]: [pid: 352328|app: 0|req: 465/908] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 08:54:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:54:29.777304 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b78b3eba-8533-4ed0-965a-fc6355331cfa None admin] Authenticating user token {{(pid=352328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:54:29.785579 dv-cinder-851351-1-smb devstack@keystone.service[352329]: [pid: 352329|app: 0|req: 444/909] 10.222.0.42 () {56 vars in 1114 bytes} [Thu Jul 28 08:54:29 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:54:29.785579 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b2bb9b6-78ad-47c2-892c-7812a2405e41 None admin] Authenticating user token {{(pid=352329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:54:29.797854 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG dbcounter [-] [352329] Writing DB stats keystone:SELECT=100 {{(pid=352329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:54:29.874868 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG dbcounter [-] [352328] Writing DB stats keystone:SELECT=100 {{(pid=352328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:54:29.916500 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b2bb9b6-78ad-47c2-892c-7812a2405e41 None admin] Validating token access rules against request {{(pid=352329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:54:29.924756 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b78b3eba-8533-4ed0-965a-fc6355331cfa None admin] Validating token access rules against request {{(pid=352328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:54:29.961686 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db860ea3-cee7-4990-9d26-54a607ca5d13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:54:29.962559 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db860ea3-cee7-4990-9d26-54a607ca5d13 None admin] REQUEST_METHOD: `GET` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:54:29.963019 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db860ea3-cee7-4990-9d26-54a607ca5d13 None admin] SCRIPT_NAME: `/identity` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:54:29.963390 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db860ea3-cee7-4990-9d26-54a607ca5d13 None admin] PATH_INFO: `/v3/services` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:54:29.964182 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db860ea3-cee7-4990-9d26-54a607ca5d13 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=352329) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:54:29.964652 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db860ea3-cee7-4990-9d26-54a607ca5d13 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:54:29.965537 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2278f250-9afb-42d7-8907-fed6788c8def None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:54:29.966198 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2278f250-9afb-42d7-8907-fed6788c8def None admin] REQUEST_METHOD: `GET` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:54:29.966563 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2278f250-9afb-42d7-8907-fed6788c8def None admin] SCRIPT_NAME: `/identity` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:54:29.966702 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db860ea3-cee7-4990-9d26-54a607ca5d13 None admin] RBAC: Authorization granted {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:54:29.966840 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2278f250-9afb-42d7-8907-fed6788c8def None admin] PATH_INFO: `/v3/services` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:54:29.967553 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2278f250-9afb-42d7-8907-fed6788c8def None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=352328) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:54:29.967862 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2278f250-9afb-42d7-8907-fed6788c8def None admin] RBAC: Authorizing `identity:list_services()` {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:54:29.969976 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2278f250-9afb-42d7-8907-fed6788c8def None admin] RBAC: Authorization granted {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:54:29.973195 dv-cinder-851351-1-smb devstack@keystone.service[352329]: [pid: 352329|app: 0|req: 445/910] 10.222.0.42 () {56 vars in 1114 bytes} [Thu Jul 28 08:54:29 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:54:29.976105 dv-cinder-851351-1-smb devstack@keystone.service[352328]: [pid: 352328|app: 0|req: 466/911] 10.222.0.42 () {56 vars in 1126 bytes} [Thu Jul 28 08:54:29 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:54:29.979153 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db860ea3-cee7-4990-9d26-54a607ca5d13 None admin] Authenticating user token {{(pid=352329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:54:29.981900 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2278f250-9afb-42d7-8907-fed6788c8def None admin] Authenticating user token {{(pid=352328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:54:30.082900 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG dbcounter [-] [352329] Writing DB stats keystone:SELECT=100 {{(pid=352329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:54:30.112995 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db860ea3-cee7-4990-9d26-54a607ca5d13 None admin] Validating token access rules against request {{(pid=352329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:54:30.127014 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2278f250-9afb-42d7-8907-fed6788c8def None admin] Validating token access rules against request {{(pid=352328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:54:30.147925 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f3a72fd-623b-4c6a-8fc4-e63f645c6246 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:54:30.148561 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3a72fd-623b-4c6a-8fc4-e63f645c6246 None admin] REQUEST_METHOD: `GET` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:54:30.148875 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3a72fd-623b-4c6a-8fc4-e63f645c6246 None admin] SCRIPT_NAME: `/identity` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:54:30.149149 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3a72fd-623b-4c6a-8fc4-e63f645c6246 None admin] PATH_INFO: `/v3/domains` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:54:30.149851 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f3a72fd-623b-4c6a-8fc4-e63f645c6246 None admin] RBAC: Adding query filter params (name=Default) {{(pid=352329) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:54:30.150153 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f3a72fd-623b-4c6a-8fc4-e63f645c6246 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:54:30.151663 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f3a72fd-623b-4c6a-8fc4-e63f645c6246 None admin] RBAC: Authorization granted {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:54:30.161046 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fcea44a-8d12-43fc-981b-ba0069b7568f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:54:30.161686 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fcea44a-8d12-43fc-981b-ba0069b7568f None admin] REQUEST_METHOD: `POST` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:54:30.161965 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fcea44a-8d12-43fc-981b-ba0069b7568f None admin] SCRIPT_NAME: `/identity` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:54:30.162263 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fcea44a-8d12-43fc-981b-ba0069b7568f None admin] PATH_INFO: `/v3/endpoints` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:54:30.162970 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fcea44a-8d12-43fc-981b-ba0069b7568f None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:54:30.164353 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fcea44a-8d12-43fc-981b-ba0069b7568f None admin] RBAC: Authorization granted {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:54:30.164533 dv-cinder-851351-1-smb devstack@keystone.service[352329]: [pid: 352329|app: 0|req: 446/912] 10.222.0.42 () {56 vars in 1109 bytes} [Thu Jul 28 08:54:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:54:30.165388 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f3a72fd-623b-4c6a-8fc4-e63f645c6246 None admin] Authenticating user token {{(pid=352329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:54:30.171077 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG dbcounter [-] [352328] Writing DB stats keystone:SELECT=100 {{(pid=352328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:54:30.187159 dv-cinder-851351-1-smb devstack@keystone.service[352328]: [pid: 352328|app: 0|req: 467/913] 10.222.0.42 () {60 vars in 1144 bytes} [Thu Jul 28 08:54:29 2022] POST /identity/v3/endpoints => generated 346 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 08:54:30.188543 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80d8028-84bb-4080-a9a8-b4b5b1aea76b None None] REQUEST_METHOD: `GET` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:54:30.188993 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80d8028-84bb-4080-a9a8-b4b5b1aea76b None None] SCRIPT_NAME: `/identity` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:54:30.189271 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80d8028-84bb-4080-a9a8-b4b5b1aea76b None None] PATH_INFO: `/` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:54:30.190717 dv-cinder-851351-1-smb devstack@keystone.service[352328]: [pid: 352328|app: 0|req: 468/914] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 08:54:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 08:54:30.191275 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b80d8028-84bb-4080-a9a8-b4b5b1aea76b None None] Authenticating user token {{(pid=352328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:54:30.326751 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b80d8028-84bb-4080-a9a8-b4b5b1aea76b None None] Validating token access rules against request {{(pid=352328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:54:30.341093 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f3a72fd-623b-4c6a-8fc4-e63f645c6246 None admin] Validating token access rules against request {{(pid=352329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:54:30.379948 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02fdfd3-cb59-47cb-b31b-85421d68aac8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:54:30.380630 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e5a084-ccd0-4f31-966e-3291ff1af8ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:54:30.381320 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e5a084-ccd0-4f31-966e-3291ff1af8ba None admin] REQUEST_METHOD: `GET` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:54:30.381669 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e5a084-ccd0-4f31-966e-3291ff1af8ba None admin] SCRIPT_NAME: `/identity` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:54:30.381887 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02fdfd3-cb59-47cb-b31b-85421d68aac8 None admin] REQUEST_METHOD: `GET` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:54:30.382115 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e5a084-ccd0-4f31-966e-3291ff1af8ba None admin] PATH_INFO: `/v3/endpoints` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:54:30.382280 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02fdfd3-cb59-47cb-b31b-85421d68aac8 None admin] SCRIPT_NAME: `/identity` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:54:30.382385 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02fdfd3-cb59-47cb-b31b-85421d68aac8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:54:30.382634 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89e5a084-ccd0-4f31-966e-3291ff1af8ba None admin] RBAC: Adding query filter params (interface=public, service_id=a5418f5b5ebe442f9f1747675c16adbc, region_id=RegionOne) {{(pid=352329) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:54:30.382939 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89e5a084-ccd0-4f31-966e-3291ff1af8ba None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:54:30.384345 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89e5a084-ccd0-4f31-966e-3291ff1af8ba None admin] RBAC: Authorization granted {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:54:30.386127 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG dbcounter [-] [352329] Writing DB stats keystone:SELECT=100 {{(pid=352329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:54:30.391369 dv-cinder-851351-1-smb devstack@keystone.service[352329]: [pid: 352329|app: 0|req: 447/915] 10.222.0.42 () {56 vars in 1251 bytes} [Thu Jul 28 08:54:30 2022] GET /identity/v3/endpoints?service_id=a5418f5b5ebe442f9f1747675c16adbc&interface=public®ion_id=RegionOne => generated 194 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:54:30.391591 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d02fdfd3-cb59-47cb-b31b-85421d68aac8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:54:30.392784 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19956560-98ce-4320-bff8-2701ae977343 None None] REQUEST_METHOD: `POST` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:54:30.393011 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19956560-98ce-4320-bff8-2701ae977343 None None] SCRIPT_NAME: `/identity` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:54:30.393136 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d02fdfd3-cb59-47cb-b31b-85421d68aac8 None admin] RBAC: Authorization granted {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:54:30.393307 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19956560-98ce-4320-bff8-2701ae977343 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:54:30.413529 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application [None req-d02fdfd3-cb59-47cb-b31b-85421d68aac8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 08:54:30.413529 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:54:30.413529 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:54:30.413529 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:54:30.413529 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:54:30.413529 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:54:30.413529 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:54:30.413529 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:54:30.413529 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:54:30.413529 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:54:30.413529 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:54:30.413529 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:54:30.413529 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 28 08:54:30.413529 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 28 08:54:30.413529 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 28 08:54:30.415476 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 28 08:54:30.415476 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:54:30.415476 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:54:30.415476 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:54:30.415476 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:54:30.415476 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:54:30.415476 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:54:30.415476 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:54:30.415476 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application with Lock( Jul 28 08:54:30.415476 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:54:30.415476 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:54:30.415476 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:54:30.415476 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:54:30.415476 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:54:30.415476 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:54:30.415476 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:54:30.415476 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:54:30.417704 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 28 08:54:30.417704 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 28 08:54:30.417704 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 28 08:54:30.417704 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 28 08:54:30.417704 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 28 08:54:30.417704 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 28 08:54:30.417704 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 08:54:30.417704 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application Jul 28 08:54:30.417704 dv-cinder-851351-1-smb devstack@keystone.service[352328]: [pid: 352328|app: 0|req: 469/916] 10.222.0.42 () {56 vars in 1111 bytes} [Thu Jul 28 08:54:30 2022] GET /identity/v3/projects/service => generated 88 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:54:30.417704 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02fdfd3-cb59-47cb-b31b-85421d68aac8 None admin] Authenticating user token {{(pid=352328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:54:30.419987 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.auth.core [None req-19956560-98ce-4320-bff8-2701ae977343 None None] MFA Rules not processed for user `d18c063b2377412485965357671e5506`. Rule list: `[]` (Enabled: `True`). {{(pid=352329) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 08:54:30.419987 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.fernet_utils [None req-19956560-98ce-4320-bff8-2701ae977343 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=352329) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:54:30.475790 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG dbcounter [-] [352328] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=352328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:54:30.505957 dv-cinder-851351-1-smb devstack@keystone.service[352329]: [pid: 352329|app: 0|req: 448/917] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 08:54:30 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 08:54:30.507301 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19956560-98ce-4320-bff8-2701ae977343 None None] Authenticating user token {{(pid=352329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:54:30.565645 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02fdfd3-cb59-47cb-b31b-85421d68aac8 None admin] Validating token access rules against request {{(pid=352328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:54:30.607013 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae73d0e-f884-4853-ad72-0a8955295b91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:54:30.607563 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae73d0e-f884-4853-ad72-0a8955295b91 None admin] REQUEST_METHOD: `GET` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:54:30.607846 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae73d0e-f884-4853-ad72-0a8955295b91 None admin] SCRIPT_NAME: `/identity` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:54:30.608117 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae73d0e-f884-4853-ad72-0a8955295b91 None admin] PATH_INFO: `/v3/services` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:54:30.608820 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bae73d0e-f884-4853-ad72-0a8955295b91 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:54:30.610212 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bae73d0e-f884-4853-ad72-0a8955295b91 None admin] RBAC: Authorization granted {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:54:30.624829 dv-cinder-851351-1-smb devstack@keystone.service[352328]: [pid: 352328|app: 0|req: 470/918] 10.222.0.42 () {56 vars in 1087 bytes} [Thu Jul 28 08:54:30 2022] GET /identity/v3/services => generated 1497 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 08:54:30.624829 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae73d0e-f884-4853-ad72-0a8955295b91 None admin] Authenticating user token {{(pid=352328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:54:30.666298 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19956560-98ce-4320-bff8-2701ae977343 None None] Validating token access rules against request {{(pid=352329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:54:30.712339 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG dbcounter [-] [352329] Writing DB stats keystone:SELECT=100 {{(pid=352329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:54:30.717438 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff4b9f7-009c-4b08-b492-4cc5b4294dbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:54:30.718362 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff4b9f7-009c-4b08-b492-4cc5b4294dbc None admin] REQUEST_METHOD: `GET` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:54:30.718919 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff4b9f7-009c-4b08-b492-4cc5b4294dbc None admin] SCRIPT_NAME: `/identity` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:54:30.719464 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff4b9f7-009c-4b08-b492-4cc5b4294dbc None admin] PATH_INFO: `/v3/projects` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:54:30.720531 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff4b9f7-009c-4b08-b492-4cc5b4294dbc None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=352329) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:54:30.721170 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff4b9f7-009c-4b08-b492-4cc5b4294dbc None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:54:30.723276 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff4b9f7-009c-4b08-b492-4cc5b4294dbc None admin] RBAC: Authorization granted {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:54:30.737578 dv-cinder-851351-1-smb devstack@keystone.service[352329]: [pid: 352329|app: 0|req: 449/919] 10.222.0.42 () {56 vars in 1148 bytes} [Thu Jul 28 08:54:30 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:54:30.744711 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff4b9f7-009c-4b08-b492-4cc5b4294dbc None admin] Authenticating user token {{(pid=352329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:54:30.786189 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae73d0e-f884-4853-ad72-0a8955295b91 None admin] Validating token access rules against request {{(pid=352328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:54:30.812526 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG dbcounter [-] [352328] Writing DB stats keystone:SELECT=100 {{(pid=352328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:54:30.855275 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f8089e-7be0-4d69-b81a-2923b602959e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:54:30.856378 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f8089e-7be0-4d69-b81a-2923b602959e None admin] REQUEST_METHOD: `GET` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:54:30.857515 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f8089e-7be0-4d69-b81a-2923b602959e None admin] SCRIPT_NAME: `/identity` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:54:30.858046 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f8089e-7be0-4d69-b81a-2923b602959e None admin] PATH_INFO: `/v3/services/object-store` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:54:30.859268 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f8089e-7be0-4d69-b81a-2923b602959e None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:54:30.861379 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f8089e-7be0-4d69-b81a-2923b602959e None admin] RBAC: Authorization granted {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:54:30.873505 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application [None req-66f8089e-7be0-4d69-b81a-2923b602959e None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 28 08:54:30.873505 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:54:30.873505 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 28 08:54:30.873505 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 28 08:54:30.873505 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 28 08:54:30.873505 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 28 08:54:30.873505 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 28 08:54:30.873505 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 08:54:30.873505 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 28 08:54:30.873505 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application Jul 28 08:54:30.873505 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 28 08:54:30.873505 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application Jul 28 08:54:30.873505 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:54:30.873505 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:54:30.873505 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:54:30.873505 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:54:30.873505 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:54:30.874851 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:54:30.874851 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:54:30.874851 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:54:30.874851 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:54:30.874851 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:54:30.874851 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:54:30.874851 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 28 08:54:30.874851 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 28 08:54:30.874851 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 28 08:54:30.874851 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 28 08:54:30.874851 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:54:30.874851 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:54:30.874851 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:54:30.874851 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:54:30.874851 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:54:30.874851 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:54:30.876001 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:54:30.876001 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application with Lock( Jul 28 08:54:30.876001 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:54:30.876001 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:54:30.876001 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:54:30.876001 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:54:30.876001 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:54:30.876001 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:54:30.876001 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:54:30.876001 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:54:30.876001 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 28 08:54:30.876001 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 08:54:30.876001 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 28 08:54:30.876001 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application Jul 28 08:54:30.884365 dv-cinder-851351-1-smb devstack@keystone.service[352328]: [pid: 352328|app: 0|req: 471/920] 10.222.0.42 () {56 vars in 1126 bytes} [Thu Jul 28 08:54:30 2022] GET /identity/v3/services/object-store => generated 93 bytes in 262 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:54:30.886086 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f8089e-7be0-4d69-b81a-2923b602959e None admin] Authenticating user token {{(pid=352328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:54:30.902532 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff4b9f7-009c-4b08-b492-4cc5b4294dbc None admin] Validating token access rules against request {{(pid=352329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:54:30.970046 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f754a1-a785-4a36-ac30-1032f3c6b3b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:54:30.971164 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f754a1-a785-4a36-ac30-1032f3c6b3b1 None admin] REQUEST_METHOD: `GET` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:54:30.971896 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f754a1-a785-4a36-ac30-1032f3c6b3b1 None admin] SCRIPT_NAME: `/identity` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:54:30.972410 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f754a1-a785-4a36-ac30-1032f3c6b3b1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:54:30.974110 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8f754a1-a785-4a36-ac30-1032f3c6b3b1 None admin] RBAC: Adding query filter params (role.id=15fc2297dd8749eab8d518cabaaf36f4, scope.project.id=9cfa053c839a4fedacde7163d907e2a4, user.id=02fa8a25f4a844faac620f7db414011a) {{(pid=352329) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:54:30.974975 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8f754a1-a785-4a36-ac30-1032f3c6b3b1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:54:30.976912 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8f754a1-a785-4a36-ac30-1032f3c6b3b1 None admin] RBAC: Authorization granted {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:54:30.993392 dv-cinder-851351-1-smb devstack@keystone.service[352329]: [pid: 352329|app: 0|req: 450/921] 10.222.0.42 () {56 vars in 1374 bytes} [Thu Jul 28 08:54:30 2022] GET /identity/v3/role_assignments?user.id=02fa8a25f4a844faac620f7db414011a&scope.project.id=9cfa053c839a4fedacde7163d907e2a4&role.id=15fc2297dd8749eab8d518cabaaf36f4 => generated 259 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 08:54:31.041746 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f8089e-7be0-4d69-b81a-2923b602959e None admin] Validating token access rules against request {{(pid=352328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:54:31.097669 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21487c2-ccd4-4afb-8390-ca92bdc8fff7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:54:31.098792 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21487c2-ccd4-4afb-8390-ca92bdc8fff7 None admin] REQUEST_METHOD: `GET` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:54:31.099316 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21487c2-ccd4-4afb-8390-ca92bdc8fff7 None admin] SCRIPT_NAME: `/identity` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:54:31.099840 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21487c2-ccd4-4afb-8390-ca92bdc8fff7 None admin] PATH_INFO: `/v3/services` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:54:31.100854 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b21487c2-ccd4-4afb-8390-ca92bdc8fff7 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=352328) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:54:31.101450 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b21487c2-ccd4-4afb-8390-ca92bdc8fff7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:54:31.103130 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b21487c2-ccd4-4afb-8390-ca92bdc8fff7 None admin] RBAC: Authorization granted {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:54:31.114351 dv-cinder-851351-1-smb devstack@keystone.service[352328]: [pid: 352328|app: 0|req: 472/922] 10.222.0.42 () {56 vars in 1122 bytes} [Thu Jul 28 08:54:30 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:54:31.116176 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f754a1-a785-4a36-ac30-1032f3c6b3b1 None admin] Authenticating user token {{(pid=352329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:54:31.185689 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG dbcounter [-] [352329] Writing DB stats keystone:SELECT=100 {{(pid=352329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:54:31.233193 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f754a1-a785-4a36-ac30-1032f3c6b3b1 None admin] Validating token access rules against request {{(pid=352329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:54:31.278409 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d2d0da-d897-4cdf-80b0-e9918c2a2b53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:54:31.279053 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d2d0da-d897-4cdf-80b0-e9918c2a2b53 None admin] REQUEST_METHOD: `GET` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:54:31.279337 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d2d0da-d897-4cdf-80b0-e9918c2a2b53 None admin] SCRIPT_NAME: `/identity` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:54:31.279621 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d2d0da-d897-4cdf-80b0-e9918c2a2b53 None admin] PATH_INFO: `/v3/services` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:54:31.280311 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d2d0da-d897-4cdf-80b0-e9918c2a2b53 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=352329) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:54:31.280619 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d2d0da-d897-4cdf-80b0-e9918c2a2b53 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:54:31.282191 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d2d0da-d897-4cdf-80b0-e9918c2a2b53 None admin] RBAC: Authorization granted {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:54:31.288087 dv-cinder-851351-1-smb devstack@keystone.service[352329]: [pid: 352329|app: 0|req: 451/923] 10.222.0.42 () {56 vars in 1122 bytes} [Thu Jul 28 08:54:31 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:54:31.294247 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21487c2-ccd4-4afb-8390-ca92bdc8fff7 None admin] Authenticating user token {{(pid=352328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:54:31.341098 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG dbcounter [-] [352328] Writing DB stats keystone:SELECT=100 {{(pid=352328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:54:31.404186 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21487c2-ccd4-4afb-8390-ca92bdc8fff7 None admin] Validating token access rules against request {{(pid=352328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:54:31.443612 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f180454-9dc4-4dc0-8d35-f8e37817e019 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:54:31.444707 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f180454-9dc4-4dc0-8d35-f8e37817e019 None admin] REQUEST_METHOD: `GET` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:54:31.445223 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f180454-9dc4-4dc0-8d35-f8e37817e019 None admin] SCRIPT_NAME: `/identity` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:54:31.445721 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f180454-9dc4-4dc0-8d35-f8e37817e019 None admin] PATH_INFO: `/v3/endpoints` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:54:31.446718 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f180454-9dc4-4dc0-8d35-f8e37817e019 None admin] RBAC: Adding query filter params (interface=public, service_id=d02c0ca34b72450ebd2ab27f29aa059d, region_id=RegionOne) {{(pid=352328) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:54:31.447269 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f180454-9dc4-4dc0-8d35-f8e37817e019 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:54:31.448916 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f180454-9dc4-4dc0-8d35-f8e37817e019 None admin] RBAC: Authorization granted {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:54:31.459917 dv-cinder-851351-1-smb devstack@keystone.service[352328]: [pid: 352328|app: 0|req: 473/924] 10.222.0.42 () {56 vars in 1251 bytes} [Thu Jul 28 08:54:31 2022] GET /identity/v3/endpoints?service_id=d02c0ca34b72450ebd2ab27f29aa059d&interface=public®ion_id=RegionOne => generated 194 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:54:31.461859 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d2d0da-d897-4cdf-80b0-e9918c2a2b53 None admin] Authenticating user token {{(pid=352329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:54:31.577159 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d2d0da-d897-4cdf-80b0-e9918c2a2b53 None admin] Validating token access rules against request {{(pid=352329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:54:31.595327 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG dbcounter [-] [352329] Writing DB stats keystone:SELECT=100 {{(pid=352329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:54:31.614505 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a75eab3b-7123-4a54-9d28-24f465a5858a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:54:31.615149 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75eab3b-7123-4a54-9d28-24f465a5858a None admin] REQUEST_METHOD: `GET` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:54:31.615456 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75eab3b-7123-4a54-9d28-24f465a5858a None admin] SCRIPT_NAME: `/identity` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:54:31.615731 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75eab3b-7123-4a54-9d28-24f465a5858a None admin] PATH_INFO: `/v3/services` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:54:31.616439 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a75eab3b-7123-4a54-9d28-24f465a5858a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:54:31.617886 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a75eab3b-7123-4a54-9d28-24f465a5858a None admin] RBAC: Authorization granted {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:54:31.624722 dv-cinder-851351-1-smb devstack@keystone.service[352329]: [pid: 352329|app: 0|req: 452/925] 10.222.0.42 () {56 vars in 1087 bytes} [Thu Jul 28 08:54:31 2022] GET /identity/v3/services => generated 1497 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 08:54:32.338170 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66fec9e-3145-497a-af9e-88a8cc54fb1c None None] REQUEST_METHOD: `GET` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:54:32.338849 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66fec9e-3145-497a-af9e-88a8cc54fb1c None None] SCRIPT_NAME: `/identity` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:54:32.338849 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66fec9e-3145-497a-af9e-88a8cc54fb1c None None] PATH_INFO: `/` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:54:32.340463 dv-cinder-851351-1-smb devstack@keystone.service[352328]: [pid: 352328|app: 0|req: 474/926] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 08:54:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 28 08:54:32.346134 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aae225a-8fe8-4491-b6b3-d73f207dd97c None None] REQUEST_METHOD: `POST` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:54:32.346710 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aae225a-8fe8-4491-b6b3-d73f207dd97c None None] SCRIPT_NAME: `/identity` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:54:32.346710 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aae225a-8fe8-4491-b6b3-d73f207dd97c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:54:32.367094 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.auth.core [None req-1aae225a-8fe8-4491-b6b3-d73f207dd97c None None] MFA Rules not processed for user `d18c063b2377412485965357671e5506`. Rule list: `[]` (Enabled: `True`). {{(pid=352329) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 08:54:32.368306 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.fernet_utils [None req-1aae225a-8fe8-4491-b6b3-d73f207dd97c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=352329) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:54:32.448613 dv-cinder-851351-1-smb devstack@keystone.service[352329]: [pid: 352329|app: 0|req: 453/927] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 08:54:32 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 08:54:32.472325 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e66fec9e-3145-497a-af9e-88a8cc54fb1c None None] Authenticating user token {{(pid=352328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:54:32.582397 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e66fec9e-3145-497a-af9e-88a8cc54fb1c None None] Validating token access rules against request {{(pid=352328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:54:32.585003 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG dbcounter [-] [352328] Writing DB stats keystone:SELECT=100 {{(pid=352328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:54:32.619629 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7713f3ed-6159-44db-9221-509b443e7cb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:54:32.620175 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7713f3ed-6159-44db-9221-509b443e7cb6 None admin] REQUEST_METHOD: `POST` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:54:32.620455 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7713f3ed-6159-44db-9221-509b443e7cb6 None admin] SCRIPT_NAME: `/identity` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:54:32.620766 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7713f3ed-6159-44db-9221-509b443e7cb6 None admin] PATH_INFO: `/v3/projects` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:54:32.621462 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7713f3ed-6159-44db-9221-509b443e7cb6 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:54:32.622910 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7713f3ed-6159-44db-9221-509b443e7cb6 None admin] RBAC: Authorization granted {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:54:32.625749 dv-cinder-851351-1-smb devstack@keystone.service[352328]: WARNING keystone.server.flask.common [None req-7713f3ed-6159-44db-9221-509b443e7cb6 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Jul 28 08:54:32.644315 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.sql.core [None req-7713f3ed-6159-44db-9221-509b443e7cb6 None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jul 28 08:54:32.644315 dv-cinder-851351-1-smb devstack@keystone.service[352328]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Jul 28 08:54:32.644315 dv-cinder-851351-1-smb devstack@keystone.service[352328]: [parameters: {'id': '8213db3eefb24fc2b31c06a9ac8b8c3d', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Jul 28 08:54:32.644315 dv-cinder-851351-1-smb devstack@keystone.service[352328]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=352328) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jul 28 08:54:32.652482 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application [None req-7713f3ed-6159-44db-9221-509b443e7cb6 None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 8213db3eefb24fc2b31c06a9ac8b8c3d.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 8213db3eefb24fc2b31c06a9ac8b8c3d. Jul 28 08:54:32.652482 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:54:32.652482 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 28 08:54:32.652482 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 28 08:54:32.652482 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 28 08:54:32.652482 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 28 08:54:32.652482 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 28 08:54:32.652482 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application result = self._query(query) Jul 28 08:54:32.652482 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 28 08:54:32.652482 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application conn.query(q) Jul 28 08:54:32.652482 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 28 08:54:32.652482 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 28 08:54:32.652482 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 28 08:54:32.653524 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application result.read() Jul 28 08:54:32.653524 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 28 08:54:32.653524 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 28 08:54:32.653524 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 28 08:54:32.653524 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 28 08:54:32.653524 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 28 08:54:32.653524 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 28 08:54:32.653524 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 28 08:54:32.653524 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 28 08:54:32.653524 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jul 28 08:54:32.653524 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application Jul 28 08:54:32.653524 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jul 28 08:54:32.653524 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application Jul 28 08:54:32.653524 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:54:32.653524 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jul 28 08:54:32.653524 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jul 28 08:54:32.653524 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Jul 28 08:54:32.653524 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return project_ref.to_dict() Jul 28 08:54:32.655155 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 28 08:54:32.655155 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application next(self.gen) Jul 28 08:54:32.655155 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jul 28 08:54:32.655155 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application yield resource Jul 28 08:54:32.655155 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 28 08:54:32.655155 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application next(self.gen) Jul 28 08:54:32.655155 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jul 28 08:54:32.655155 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application self.session.rollback() Jul 28 08:54:32.655155 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 28 08:54:32.655155 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application self.force_reraise() Jul 28 08:54:32.655155 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 28 08:54:32.655155 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application raise self.value Jul 28 08:54:32.655155 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jul 28 08:54:32.655155 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jul 28 08:54:32.655155 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jul 28 08:54:32.655155 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application session.commit() Jul 28 08:54:32.655155 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jul 28 08:54:32.656581 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jul 28 08:54:32.656581 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jul 28 08:54:32.656581 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application self._prepare_impl() Jul 28 08:54:32.656581 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jul 28 08:54:32.656581 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application self.session.flush() Jul 28 08:54:32.656581 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jul 28 08:54:32.656581 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application self._flush(objects) Jul 28 08:54:32.656581 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jul 28 08:54:32.656581 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jul 28 08:54:32.656581 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jul 28 08:54:32.656581 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application compat.raise_( Jul 28 08:54:32.656581 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 28 08:54:32.656581 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application raise exception Jul 28 08:54:32.656581 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jul 28 08:54:32.656581 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application flush_context.execute() Jul 28 08:54:32.656581 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jul 28 08:54:32.656581 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application rec.execute(self) Jul 28 08:54:32.657752 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jul 28 08:54:32.657752 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jul 28 08:54:32.657752 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jul 28 08:54:32.657752 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application _emit_insert_statements( Jul 28 08:54:32.657752 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Jul 28 08:54:32.657752 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application c = connection._execute_20( Jul 28 08:54:32.657752 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jul 28 08:54:32.657752 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jul 28 08:54:32.657752 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Jul 28 08:54:32.657752 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jul 28 08:54:32.657752 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jul 28 08:54:32.657752 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application ret = self._execute_context( Jul 28 08:54:32.657752 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jul 28 08:54:32.657752 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jul 28 08:54:32.657752 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jul 28 08:54:32.658846 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jul 28 08:54:32.658846 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 28 08:54:32.658846 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application raise exception Jul 28 08:54:32.658846 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 28 08:54:32.658846 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 28 08:54:32.658846 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 28 08:54:32.658846 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 28 08:54:32.658846 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 28 08:54:32.658846 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application result = self._query(query) Jul 28 08:54:32.658846 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 28 08:54:32.658846 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application conn.query(q) Jul 28 08:54:32.658846 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 28 08:54:32.658846 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 28 08:54:32.658846 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 28 08:54:32.658846 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application result.read() Jul 28 08:54:32.658846 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 28 08:54:32.658846 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 28 08:54:32.667333 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 28 08:54:32.667333 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 28 08:54:32.667333 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 28 08:54:32.667333 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 28 08:54:32.667333 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 28 08:54:32.667333 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 28 08:54:32.667333 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jul 28 08:54:32.667333 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Jul 28 08:54:32.667333 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application [parameters: {'id': '8213db3eefb24fc2b31c06a9ac8b8c3d', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Jul 28 08:54:32.667333 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jul 28 08:54:32.667333 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application Jul 28 08:54:32.667333 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 28 08:54:32.667333 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application Jul 28 08:54:32.667333 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:54:32.667333 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Jul 28 08:54:32.669473 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Jul 28 08:54:32.669473 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jul 28 08:54:32.669473 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jul 28 08:54:32.669473 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Jul 28 08:54:32.669473 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application Jul 28 08:54:32.669473 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 28 08:54:32.669473 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application Jul 28 08:54:32.669473 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:54:32.669473 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:54:32.669473 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:54:32.669473 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:54:32.669473 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:54:32.669473 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:54:32.669473 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:54:32.669473 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:54:32.669473 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:54:32.669473 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:54:32.671796 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:54:32.671796 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Jul 28 08:54:32.671796 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Jul 28 08:54:32.671796 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:54:32.671796 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:54:32.671796 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Jul 28 08:54:32.671796 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application raise exception.Conflict( Jul 28 08:54:32.671796 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 8213db3eefb24fc2b31c06a9ac8b8c3d. Jul 28 08:54:32.671796 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application Jul 28 08:54:32.671796 dv-cinder-851351-1-smb devstack@keystone.service[352328]: [pid: 352328|app: 0|req: 475/928] 10.222.0.42 () {60 vars in 1140 bytes} [Thu Jul 28 08:54:32 2022] POST /identity/v3/projects => generated 262 bytes in 182 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:54:32.673338 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aae225a-8fe8-4491-b6b3-d73f207dd97c None None] Authenticating user token {{(pid=352329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:54:32.749581 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6497f6a1-70ad-4fdd-a415-5e61ff7ea8f0 None None] REQUEST_METHOD: `GET` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:54:32.749581 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6497f6a1-70ad-4fdd-a415-5e61ff7ea8f0 None None] SCRIPT_NAME: `/identity` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:54:32.751278 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6497f6a1-70ad-4fdd-a415-5e61ff7ea8f0 None None] PATH_INFO: `/` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:54:32.757511 dv-cinder-851351-1-smb devstack@keystone.service[352328]: [pid: 352328|app: 0|req: 476/929] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 08:54:32 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 28 08:54:32.762247 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e86493-8b53-4de8-8b74-19a58f78e769 None None] REQUEST_METHOD: `POST` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:54:32.762549 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e86493-8b53-4de8-8b74-19a58f78e769 None None] SCRIPT_NAME: `/identity` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:54:32.762810 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e86493-8b53-4de8-8b74-19a58f78e769 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:54:32.779123 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aae225a-8fe8-4491-b6b3-d73f207dd97c None None] Validating token access rules against request {{(pid=352329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:54:32.782822 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.auth.core [None req-f4e86493-8b53-4de8-8b74-19a58f78e769 None None] MFA Rules not processed for user `d18c063b2377412485965357671e5506`. Rule list: `[]` (Enabled: `True`). {{(pid=352328) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 08:54:32.783911 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.fernet_utils [None req-f4e86493-8b53-4de8-8b74-19a58f78e769 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=352328) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:54:32.793712 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG dbcounter [-] [352329] Writing DB stats keystone:SELECT=100 {{(pid=352329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:54:32.827243 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d78b7b0b-dfbc-4b0e-81b4-05f110bf61a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:54:32.828121 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78b7b0b-dfbc-4b0e-81b4-05f110bf61a3 None admin] REQUEST_METHOD: `GET` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:54:32.828509 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78b7b0b-dfbc-4b0e-81b4-05f110bf61a3 None admin] SCRIPT_NAME: `/identity` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:54:32.828921 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78b7b0b-dfbc-4b0e-81b4-05f110bf61a3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:54:32.837706 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d78b7b0b-dfbc-4b0e-81b4-05f110bf61a3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:54:32.840008 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d78b7b0b-dfbc-4b0e-81b4-05f110bf61a3 None admin] RBAC: Authorization granted {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:54:32.856144 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application [None req-d78b7b0b-dfbc-4b0e-81b4-05f110bf61a3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 08:54:32.856144 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:54:32.856144 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:54:32.856144 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:54:32.856144 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:54:32.856144 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:54:32.856144 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:54:32.856144 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:54:32.856144 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:54:32.856144 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:54:32.856144 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:54:32.856144 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:54:32.856144 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 28 08:54:32.856144 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 28 08:54:32.856144 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 28 08:54:32.857626 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 28 08:54:32.857626 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:54:32.857626 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:54:32.857626 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:54:32.857626 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:54:32.857626 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:54:32.857626 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:54:32.857626 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:54:32.857626 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application with Lock( Jul 28 08:54:32.857626 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:54:32.857626 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:54:32.857626 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:54:32.857626 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:54:32.857626 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:54:32.857626 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:54:32.857626 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:54:32.857626 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:54:32.859085 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 28 08:54:32.859085 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 28 08:54:32.859085 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 28 08:54:32.859085 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 28 08:54:32.859085 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 28 08:54:32.859085 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 28 08:54:32.859085 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 08:54:32.859085 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application Jul 28 08:54:32.860624 dv-cinder-851351-1-smb devstack@keystone.service[352329]: [pid: 352329|app: 0|req: 454/930] 10.222.0.42 () {56 vars in 1111 bytes} [Thu Jul 28 08:54:32 2022] GET /identity/v3/projects/service => generated 88 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 08:54:32.867023 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d78b7b0b-dfbc-4b0e-81b4-05f110bf61a3 None admin] Authenticating user token {{(pid=352329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:54:32.882260 dv-cinder-851351-1-smb devstack@keystone.service[352328]: [pid: 352328|app: 0|req: 477/931] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 08:54:32 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 28 08:54:32.899820 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e86493-8b53-4de8-8b74-19a58f78e769 None None] Authenticating user token {{(pid=352328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:54:32.999479 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d78b7b0b-dfbc-4b0e-81b4-05f110bf61a3 None admin] Validating token access rules against request {{(pid=352329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:54:33.013636 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG dbcounter [-] [352328] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=352328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:54:33.028215 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e86493-8b53-4de8-8b74-19a58f78e769 None None] Validating token access rules against request {{(pid=352328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:54:33.048987 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b9a9b0d-ac72-469a-93a6-d36f54b14372 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:54:33.049923 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9a9b0d-ac72-469a-93a6-d36f54b14372 None admin] REQUEST_METHOD: `GET` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:54:33.050375 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9a9b0d-ac72-469a-93a6-d36f54b14372 None admin] SCRIPT_NAME: `/identity` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:54:33.050806 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9a9b0d-ac72-469a-93a6-d36f54b14372 None admin] PATH_INFO: `/v3/projects` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:54:33.052281 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b9a9b0d-ac72-469a-93a6-d36f54b14372 None admin] RBAC: Adding query filter params (name=service) {{(pid=352329) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:54:33.052784 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b9a9b0d-ac72-469a-93a6-d36f54b14372 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:54:33.054946 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b9a9b0d-ac72-469a-93a6-d36f54b14372 None admin] RBAC: Authorization granted {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:54:33.066761 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b4eed9-18ac-4662-8e26-c61faaf0e64a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:54:33.067505 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b4eed9-18ac-4662-8e26-c61faaf0e64a None admin] REQUEST_METHOD: `GET` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:54:33.067854 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b4eed9-18ac-4662-8e26-c61faaf0e64a None admin] SCRIPT_NAME: `/identity` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:54:33.068536 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b4eed9-18ac-4662-8e26-c61faaf0e64a None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:54:33.068976 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92b4eed9-18ac-4662-8e26-c61faaf0e64a None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:54:33.070550 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92b4eed9-18ac-4662-8e26-c61faaf0e64a None admin] RBAC: Authorization granted {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:54:33.076314 dv-cinder-851351-1-smb devstack@keystone.service[352329]: [pid: 352329|app: 0|req: 455/932] 10.222.0.42 () {56 vars in 1112 bytes} [Thu Jul 28 08:54:32 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 08:54:33.086747 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application [None req-92b4eed9-18ac-4662-8e26-c61faaf0e64a None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 28 08:54:33.086747 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:54:33.086747 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 28 08:54:33.086747 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 28 08:54:33.086747 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 28 08:54:33.086747 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 28 08:54:33.086747 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 28 08:54:33.086747 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 08:54:33.086747 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 28 08:54:33.086747 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application Jul 28 08:54:33.086747 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 28 08:54:33.086747 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application Jul 28 08:54:33.086747 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:54:33.086747 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:54:33.086747 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:54:33.086747 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:54:33.088280 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:54:33.088280 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:54:33.088280 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:54:33.088280 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:54:33.088280 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:54:33.088280 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:54:33.088280 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:54:33.088280 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 28 08:54:33.088280 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 28 08:54:33.088280 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 28 08:54:33.088280 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 28 08:54:33.088280 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:54:33.088280 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:54:33.088280 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:54:33.088280 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:54:33.088280 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:54:33.089956 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:54:33.089956 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:54:33.089956 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application with Lock( Jul 28 08:54:33.089956 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:54:33.089956 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:54:33.089956 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:54:33.089956 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:54:33.089956 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:54:33.089956 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:54:33.089956 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:54:33.089956 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:54:33.089956 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 28 08:54:33.089956 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 08:54:33.089956 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 28 08:54:33.089956 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application Jul 28 08:54:33.094544 dv-cinder-851351-1-smb devstack@keystone.service[352328]: [pid: 352328|app: 0|req: 478/933] 10.222.0.42 () {56 vars in 1132 bytes} [Thu Jul 28 08:54:32 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 08:54:33.101931 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b9a9b0d-ac72-469a-93a6-d36f54b14372 None admin] Authenticating user token {{(pid=352329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:54:33.142516 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG dbcounter [-] [352329] Writing DB stats keystone:SELECT=100 {{(pid=352329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:54:33.226648 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b9a9b0d-ac72-469a-93a6-d36f54b14372 None admin] Validating token access rules against request {{(pid=352329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:54:33.264991 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d78a737-ad78-4e11-8887-dc18e82195e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:54:33.266086 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d78a737-ad78-4e11-8887-dc18e82195e8 None admin] REQUEST_METHOD: `GET` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:54:33.266379 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d78a737-ad78-4e11-8887-dc18e82195e8 None admin] SCRIPT_NAME: `/identity` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:54:33.266700 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d78a737-ad78-4e11-8887-dc18e82195e8 None admin] PATH_INFO: `/v3/services` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:54:33.267597 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d78a737-ad78-4e11-8887-dc18e82195e8 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=352329) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:54:33.267918 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d78a737-ad78-4e11-8887-dc18e82195e8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:54:33.269618 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d78a737-ad78-4e11-8887-dc18e82195e8 None admin] RBAC: Authorization granted {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:54:33.275618 dv-cinder-851351-1-smb devstack@keystone.service[352329]: [pid: 352329|app: 0|req: 456/934] 10.222.0.42 () {56 vars in 1126 bytes} [Thu Jul 28 08:54:33 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:54:33.281213 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b4eed9-18ac-4662-8e26-c61faaf0e64a None admin] Authenticating user token {{(pid=352328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:54:33.392788 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b4eed9-18ac-4662-8e26-c61faaf0e64a None admin] Validating token access rules against request {{(pid=352328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:54:33.430610 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fadd4eea-238f-422c-8744-190812dec94f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:54:33.431655 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fadd4eea-238f-422c-8744-190812dec94f None admin] REQUEST_METHOD: `GET` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:54:33.432150 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fadd4eea-238f-422c-8744-190812dec94f None admin] SCRIPT_NAME: `/identity` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:54:33.432650 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fadd4eea-238f-422c-8744-190812dec94f None admin] PATH_INFO: `/v3/services` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:54:33.433588 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fadd4eea-238f-422c-8744-190812dec94f None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=352328) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:54:33.434122 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fadd4eea-238f-422c-8744-190812dec94f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:54:33.435733 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fadd4eea-238f-422c-8744-190812dec94f None admin] RBAC: Authorization granted {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:54:33.442273 dv-cinder-851351-1-smb devstack@keystone.service[352328]: [pid: 352328|app: 0|req: 479/935] 10.222.0.42 () {56 vars in 1126 bytes} [Thu Jul 28 08:54:33 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:54:33.451055 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d78a737-ad78-4e11-8887-dc18e82195e8 None admin] Authenticating user token {{(pid=352329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:54:33.551301 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG dbcounter [-] [352329] Writing DB stats keystone:SELECT=100 {{(pid=352329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:54:33.558459 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d78a737-ad78-4e11-8887-dc18e82195e8 None admin] Validating token access rules against request {{(pid=352329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:54:33.595158 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d3bfed-8717-4e84-8b1e-bb290e2870fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:54:33.595812 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d3bfed-8717-4e84-8b1e-bb290e2870fe None admin] REQUEST_METHOD: `POST` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:54:33.596109 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d3bfed-8717-4e84-8b1e-bb290e2870fe None admin] SCRIPT_NAME: `/identity` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:54:33.596376 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d3bfed-8717-4e84-8b1e-bb290e2870fe None admin] PATH_INFO: `/v3/endpoints` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:54:33.597152 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d3bfed-8717-4e84-8b1e-bb290e2870fe None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:54:33.598568 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d3bfed-8717-4e84-8b1e-bb290e2870fe None admin] RBAC: Authorization granted {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:54:33.627098 dv-cinder-851351-1-smb devstack@keystone.service[352329]: [pid: 352329|app: 0|req: 457/936] 10.222.0.42 () {60 vars in 1144 bytes} [Thu Jul 28 08:54:33 2022] POST /identity/v3/endpoints => generated 347 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 08:54:33.853938 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3297e8-0e96-4c68-b682-af5f50c7911c None None] REQUEST_METHOD: `GET` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:54:33.854396 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3297e8-0e96-4c68-b682-af5f50c7911c None None] SCRIPT_NAME: `/identity` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:54:33.854754 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3297e8-0e96-4c68-b682-af5f50c7911c None None] PATH_INFO: `/` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:54:33.856524 dv-cinder-851351-1-smb devstack@keystone.service[352328]: [pid: 352328|app: 0|req: 480/937] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 08:54:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 08:54:33.862113 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb3a682-af24-4fd3-b78e-89e0a9cb16f9 None None] REQUEST_METHOD: `POST` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:54:33.862479 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb3a682-af24-4fd3-b78e-89e0a9cb16f9 None None] SCRIPT_NAME: `/identity` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:54:33.862831 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb3a682-af24-4fd3-b78e-89e0a9cb16f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:54:33.882007 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.auth.core [None req-bcb3a682-af24-4fd3-b78e-89e0a9cb16f9 None None] MFA Rules not processed for user `d18c063b2377412485965357671e5506`. Rule list: `[]` (Enabled: `True`). {{(pid=352329) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 08:54:33.883235 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.fernet_utils [None req-bcb3a682-af24-4fd3-b78e-89e0a9cb16f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=352329) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:54:33.963623 dv-cinder-851351-1-smb devstack@keystone.service[352329]: [pid: 352329|app: 0|req: 458/938] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 08:54:33 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 08:54:33.986608 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b3297e8-0e96-4c68-b682-af5f50c7911c None None] Authenticating user token {{(pid=352328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:54:34.011396 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG dbcounter [-] [352328] Writing DB stats keystone:SELECT=100 {{(pid=352328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:54:34.054071 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f1d039-0b9f-4ce6-95f1-500b2b4c92b2 None None] REQUEST_METHOD: `GET` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:54:34.054447 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f1d039-0b9f-4ce6-95f1-500b2b4c92b2 None None] SCRIPT_NAME: `/identity` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:54:34.054657 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f1d039-0b9f-4ce6-95f1-500b2b4c92b2 None None] PATH_INFO: `/` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:54:34.056512 dv-cinder-851351-1-smb devstack@keystone.service[352329]: [pid: 352329|app: 0|req: 459/939] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 08:54:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 08:54:34.061441 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d17e25-2c29-4af6-9f86-640c00ab3723 None None] REQUEST_METHOD: `POST` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:54:34.061725 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d17e25-2c29-4af6-9f86-640c00ab3723 None None] SCRIPT_NAME: `/identity` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:54:34.062074 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d17e25-2c29-4af6-9f86-640c00ab3723 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:54:34.082187 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.auth.core [None req-17d17e25-2c29-4af6-9f86-640c00ab3723 None None] MFA Rules not processed for user `d18c063b2377412485965357671e5506`. Rule list: `[]` (Enabled: `True`). {{(pid=352329) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 08:54:34.083597 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.fernet_utils [None req-17d17e25-2c29-4af6-9f86-640c00ab3723 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=352329) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:54:34.115342 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b3297e8-0e96-4c68-b682-af5f50c7911c None None] Validating token access rules against request {{(pid=352328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:54:34.176034 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf8da75-46e8-4117-aa92-02b5da228580 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:54:34.177848 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf8da75-46e8-4117-aa92-02b5da228580 None admin] REQUEST_METHOD: `GET` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:54:34.178490 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf8da75-46e8-4117-aa92-02b5da228580 None admin] SCRIPT_NAME: `/identity` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:54:34.179150 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf8da75-46e8-4117-aa92-02b5da228580 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:54:34.180169 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf8da75-46e8-4117-aa92-02b5da228580 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:54:34.182842 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf8da75-46e8-4117-aa92-02b5da228580 None admin] RBAC: Authorization granted {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:54:34.189221 dv-cinder-851351-1-smb devstack@keystone.service[352329]: [pid: 352329|app: 0|req: 460/940] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 08:54:34 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 08:54:34.198878 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application [None req-3bf8da75-46e8-4117-aa92-02b5da228580 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 28 08:54:34.198878 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:54:34.198878 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 28 08:54:34.198878 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 28 08:54:34.198878 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 28 08:54:34.198878 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 28 08:54:34.198878 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 28 08:54:34.198878 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 08:54:34.198878 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 28 08:54:34.198878 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application Jul 28 08:54:34.198878 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 28 08:54:34.198878 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application Jul 28 08:54:34.198878 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:54:34.198878 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:54:34.198878 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:54:34.198878 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:54:34.198878 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:54:34.200884 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:54:34.200884 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:54:34.200884 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:54:34.200884 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:54:34.200884 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:54:34.200884 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:54:34.200884 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 28 08:54:34.200884 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 28 08:54:34.200884 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 28 08:54:34.200884 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 28 08:54:34.200884 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:54:34.200884 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:54:34.200884 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:54:34.200884 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:54:34.200884 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:54:34.200884 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:54:34.202892 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:54:34.202892 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application with Lock( Jul 28 08:54:34.202892 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:54:34.202892 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:54:34.202892 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:54:34.202892 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:54:34.202892 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:54:34.202892 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:54:34.202892 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:54:34.202892 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:54:34.202892 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 28 08:54:34.202892 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 08:54:34.202892 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 28 08:54:34.202892 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application Jul 28 08:54:34.207588 dv-cinder-851351-1-smb devstack@keystone.service[352328]: [pid: 352328|app: 0|req: 481/941] 10.222.0.42 () {56 vars in 1126 bytes} [Thu Jul 28 08:54:33 2022] GET /identity/v3/services/object-store => generated 93 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:54:34.213388 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d17e25-2c29-4af6-9f86-640c00ab3723 None None] Authenticating user token {{(pid=352329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:54:34.218124 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf8da75-46e8-4117-aa92-02b5da228580 None admin] Authenticating user token {{(pid=352328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:54:34.224769 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG dbcounter [-] [352329] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=352329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:54:34.325447 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG dbcounter [-] [352328] Writing DB stats keystone:SELECT=100 {{(pid=352328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:54:34.328682 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d17e25-2c29-4af6-9f86-640c00ab3723 None None] Validating token access rules against request {{(pid=352329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:54:34.355156 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf8da75-46e8-4117-aa92-02b5da228580 None admin] Validating token access rules against request {{(pid=352328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:54:34.370538 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-571ecc90-c2cd-4939-b5ac-6e238b0d01ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:54:34.371550 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571ecc90-c2cd-4939-b5ac-6e238b0d01ce None admin] REQUEST_METHOD: `GET` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:54:34.372089 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571ecc90-c2cd-4939-b5ac-6e238b0d01ce None admin] SCRIPT_NAME: `/identity` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:54:34.372563 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571ecc90-c2cd-4939-b5ac-6e238b0d01ce None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:54:34.385401 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-571ecc90-c2cd-4939-b5ac-6e238b0d01ce None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 08:54:34.391299 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application [None req-571ecc90-c2cd-4939-b5ac-6e238b0d01ce None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 28 08:54:34.391299 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:54:34.391299 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:54:34.391299 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:54:34.391299 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:54:34.391299 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:54:34.391299 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:54:34.391299 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:54:34.391299 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:54:34.391299 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:54:34.391299 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:54:34.391299 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:54:34.391299 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 08:54:34.391299 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 08:54:34.391299 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 08:54:34.391299 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 08:54:34.392477 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 08:54:34.392477 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 08:54:34.392477 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 08:54:34.392477 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 08:54:34.392477 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:54:34.392477 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:54:34.392477 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:54:34.392477 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:54:34.392477 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:54:34.392477 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:54:34.392477 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:54:34.392477 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application with Lock( Jul 28 08:54:34.392477 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:54:34.392477 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:54:34.392477 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:54:34.392477 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:54:34.393541 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:54:34.393541 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:54:34.393541 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:54:34.393541 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:54:34.393541 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 08:54:34.393541 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 08:54:34.393541 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 08:54:34.393541 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 08:54:34.393541 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 08:54:34.393541 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 08:54:34.393541 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 28 08:54:34.393541 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application Jul 28 08:54:34.400937 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ab6032-e390-4062-8ce4-8259abb19e89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:54:34.400937 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ab6032-e390-4062-8ce4-8259abb19e89 None admin] REQUEST_METHOD: `GET` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:54:34.400937 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ab6032-e390-4062-8ce4-8259abb19e89 None admin] SCRIPT_NAME: `/identity` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:54:34.400937 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ab6032-e390-4062-8ce4-8259abb19e89 None admin] PATH_INFO: `/v3/services` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:54:34.401724 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66ab6032-e390-4062-8ce4-8259abb19e89 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=352328) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:54:34.401827 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66ab6032-e390-4062-8ce4-8259abb19e89 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:54:34.402351 dv-cinder-851351-1-smb devstack@keystone.service[352329]: [pid: 352329|app: 0|req: 461/942] 10.222.0.42 () {56 vars in 1120 bytes} [Thu Jul 28 08:54:34 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 08:54:34.403345 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66ab6032-e390-4062-8ce4-8259abb19e89 None admin] RBAC: Authorization granted {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:54:34.403682 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-571ecc90-c2cd-4939-b5ac-6e238b0d01ce None admin] Authenticating user token {{(pid=352329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:54:34.415418 dv-cinder-851351-1-smb devstack@keystone.service[352328]: [pid: 352328|app: 0|req: 482/943] 10.222.0.42 () {56 vars in 1122 bytes} [Thu Jul 28 08:54:34 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 08:54:34.416636 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ab6032-e390-4062-8ce4-8259abb19e89 None admin] Authenticating user token {{(pid=352328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:54:34.493219 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG dbcounter [-] [352329] Writing DB stats keystone:SELECT=100 {{(pid=352329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:54:34.533096 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-571ecc90-c2cd-4939-b5ac-6e238b0d01ce None admin] Validating token access rules against request {{(pid=352329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:54:34.562259 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ab6032-e390-4062-8ce4-8259abb19e89 None admin] Validating token access rules against request {{(pid=352328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:54:34.572019 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7f2040-25a6-48db-b189-016d4d38e874 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:54:34.573407 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7f2040-25a6-48db-b189-016d4d38e874 None admin] REQUEST_METHOD: `GET` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:54:34.573950 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7f2040-25a6-48db-b189-016d4d38e874 None admin] SCRIPT_NAME: `/identity` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:54:34.574480 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7f2040-25a6-48db-b189-016d4d38e874 None admin] PATH_INFO: `/v3/roles` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:54:34.575566 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc7f2040-25a6-48db-b189-016d4d38e874 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=352329) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:54:34.576145 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc7f2040-25a6-48db-b189-016d4d38e874 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:54:34.578131 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc7f2040-25a6-48db-b189-016d4d38e874 None admin] RBAC: Authorization granted {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:54:34.594424 dv-cinder-851351-1-smb devstack@keystone.service[352329]: [pid: 352329|app: 0|req: 462/944] 10.222.0.42 () {56 vars in 1115 bytes} [Thu Jul 28 08:54:34 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:54:34.595850 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7f2040-25a6-48db-b189-016d4d38e874 None admin] Authenticating user token {{(pid=352329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:54:34.608008 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c89c0e5-d721-4e25-9e70-ea9aee498932 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:54:34.609189 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c89c0e5-d721-4e25-9e70-ea9aee498932 None admin] REQUEST_METHOD: `GET` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:54:34.609813 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c89c0e5-d721-4e25-9e70-ea9aee498932 None admin] SCRIPT_NAME: `/identity` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:54:34.610309 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c89c0e5-d721-4e25-9e70-ea9aee498932 None admin] PATH_INFO: `/v3/services` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:54:34.611270 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c89c0e5-d721-4e25-9e70-ea9aee498932 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=352328) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:54:34.611811 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c89c0e5-d721-4e25-9e70-ea9aee498932 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:54:34.613749 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c89c0e5-d721-4e25-9e70-ea9aee498932 None admin] RBAC: Authorization granted {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:54:34.620408 dv-cinder-851351-1-smb devstack@keystone.service[352328]: [pid: 352328|app: 0|req: 483/945] 10.222.0.42 () {56 vars in 1122 bytes} [Thu Jul 28 08:54:34 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:54:34.626935 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c89c0e5-d721-4e25-9e70-ea9aee498932 None admin] Authenticating user token {{(pid=352328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:54:34.643891 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG dbcounter [-] [352328] Writing DB stats keystone:SELECT=100 {{(pid=352328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:54:34.723237 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7f2040-25a6-48db-b189-016d4d38e874 None admin] Validating token access rules against request {{(pid=352329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:54:34.745908 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c89c0e5-d721-4e25-9e70-ea9aee498932 None admin] Validating token access rules against request {{(pid=352328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:54:34.760338 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG dbcounter [-] [352329] Writing DB stats keystone:SELECT=100 {{(pid=352329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:54:34.768283 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed2ead6-8b60-4e6e-a111-501e940f9706 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:54:34.769002 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed2ead6-8b60-4e6e-a111-501e940f9706 None admin] REQUEST_METHOD: `GET` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:54:34.769289 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed2ead6-8b60-4e6e-a111-501e940f9706 None admin] SCRIPT_NAME: `/identity` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:54:34.769569 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed2ead6-8b60-4e6e-a111-501e940f9706 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:54:34.784340 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed2ead6-8b60-4e6e-a111-501e940f9706 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:54:34.786161 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed2ead6-8b60-4e6e-a111-501e940f9706 None admin] RBAC: Authorization granted {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:54:34.786620 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f420be2-1306-422f-9a08-448c7913db33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:54:34.787450 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f420be2-1306-422f-9a08-448c7913db33 None admin] REQUEST_METHOD: `POST` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:54:34.788002 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f420be2-1306-422f-9a08-448c7913db33 None admin] SCRIPT_NAME: `/identity` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:54:34.788449 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f420be2-1306-422f-9a08-448c7913db33 None admin] PATH_INFO: `/v3/endpoints` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:54:34.789434 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f420be2-1306-422f-9a08-448c7913db33 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:54:34.791178 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f420be2-1306-422f-9a08-448c7913db33 None admin] RBAC: Authorization granted {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:54:34.803743 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application [None req-5ed2ead6-8b60-4e6e-a111-501e940f9706 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 08:54:34.803743 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:54:34.803743 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:54:34.803743 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:54:34.803743 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:54:34.803743 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:54:34.803743 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:54:34.803743 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:54:34.803743 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:54:34.803743 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:54:34.803743 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:54:34.803743 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:54:34.803743 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 08:54:34.803743 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 08:54:34.803743 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 08:54:34.805236 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 08:54:34.805236 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:54:34.805236 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:54:34.805236 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:54:34.805236 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:54:34.805236 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:54:34.805236 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:54:34.805236 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:54:34.805236 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application with Lock( Jul 28 08:54:34.805236 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:54:34.805236 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:54:34.805236 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:54:34.805236 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:54:34.805236 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:54:34.805236 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:54:34.805236 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:54:34.805236 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:54:34.806379 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 08:54:34.806379 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 08:54:34.806379 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 08:54:34.806379 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application Jul 28 08:54:34.806379 dv-cinder-851351-1-smb devstack@keystone.service[352329]: [pid: 352329|app: 0|req: 463/946] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 08:54:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:54:34.811133 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed2ead6-8b60-4e6e-a111-501e940f9706 None admin] Authenticating user token {{(pid=352329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:54:34.820600 dv-cinder-851351-1-smb devstack@keystone.service[352328]: [pid: 352328|app: 0|req: 484/947] 10.222.0.42 () {60 vars in 1144 bytes} [Thu Jul 28 08:54:34 2022] POST /identity/v3/endpoints => generated 349 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 28 08:54:34.941518 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed2ead6-8b60-4e6e-a111-501e940f9706 None admin] Validating token access rules against request {{(pid=352329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:54:34.987812 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e2b9f2-1507-4961-935a-4c7271a66290 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:54:34.988467 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e2b9f2-1507-4961-935a-4c7271a66290 None admin] REQUEST_METHOD: `GET` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:54:34.988781 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e2b9f2-1507-4961-935a-4c7271a66290 None admin] SCRIPT_NAME: `/identity` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:54:34.989058 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e2b9f2-1507-4961-935a-4c7271a66290 None admin] PATH_INFO: `/v3/domains` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:54:34.989849 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2e2b9f2-1507-4961-935a-4c7271a66290 None admin] RBAC: Adding query filter params (name=Default) {{(pid=352329) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:54:34.990157 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2e2b9f2-1507-4961-935a-4c7271a66290 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:54:34.991741 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2e2b9f2-1507-4961-935a-4c7271a66290 None admin] RBAC: Authorization granted {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:54:35.006186 dv-cinder-851351-1-smb devstack@keystone.service[352329]: [pid: 352329|app: 0|req: 464/948] 10.222.0.42 () {56 vars in 1109 bytes} [Thu Jul 28 08:54:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 08:54:35.014018 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f420be2-1306-422f-9a08-448c7913db33 None admin] Authenticating user token {{(pid=352328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:54:35.105900 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG dbcounter [-] [352328] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=352328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:54:35.164876 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f420be2-1306-422f-9a08-448c7913db33 None admin] Validating token access rules against request {{(pid=352328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:54:35.217332 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c03f40c-be31-49f4-887a-d4bba73fd3e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:54:35.217933 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c03f40c-be31-49f4-887a-d4bba73fd3e6 None admin] REQUEST_METHOD: `GET` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:54:35.218221 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c03f40c-be31-49f4-887a-d4bba73fd3e6 None admin] SCRIPT_NAME: `/identity` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:54:35.218511 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c03f40c-be31-49f4-887a-d4bba73fd3e6 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:54:35.228202 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c03f40c-be31-49f4-887a-d4bba73fd3e6 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:54:35.229792 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c03f40c-be31-49f4-887a-d4bba73fd3e6 None admin] RBAC: Authorization granted {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:54:35.243547 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application [None req-5c03f40c-be31-49f4-887a-d4bba73fd3e6 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 28 08:54:35.243547 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:54:35.243547 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:54:35.243547 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:54:35.243547 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:54:35.243547 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:54:35.243547 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:54:35.243547 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:54:35.243547 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:54:35.243547 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:54:35.243547 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:54:35.243547 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:54:35.243547 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 28 08:54:35.243547 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 28 08:54:35.243547 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 28 08:54:35.243547 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 28 08:54:35.244856 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:54:35.244856 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:54:35.244856 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 28 08:54:35.244856 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 08:54:35.244856 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 28 08:54:35.244856 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 08:54:35.244856 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:54:35.244856 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:54:35.244856 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:54:35.244856 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:54:35.244856 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:54:35.244856 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application with Lock( Jul 28 08:54:35.244856 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:54:35.244856 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:54:35.244856 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:54:35.244856 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:54:35.244856 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:54:35.244856 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:54:35.246110 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:54:35.246110 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:54:35.246110 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 28 08:54:35.246110 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 28 08:54:35.246110 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 28 08:54:35.246110 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 28 08:54:35.246110 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 28 08:54:35.246110 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 28 08:54:35.246110 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 28 08:54:35.246110 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application Jul 28 08:54:35.246110 dv-cinder-851351-1-smb devstack@keystone.service[352328]: [pid: 352328|app: 0|req: 485/949] 10.222.0.42 () {56 vars in 1117 bytes} [Thu Jul 28 08:54:35 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:54:35.253891 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e2b9f2-1507-4961-935a-4c7271a66290 None admin] Authenticating user token {{(pid=352329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:54:35.303633 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG dbcounter [-] [352329] Writing DB stats keystone:SELECT=100 {{(pid=352329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:54:35.372036 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e2b9f2-1507-4961-935a-4c7271a66290 None admin] Validating token access rules against request {{(pid=352329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:54:35.407905 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb8cc75-344d-4fdf-ac80-be7303b363d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:54:35.408555 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb8cc75-344d-4fdf-ac80-be7303b363d7 None admin] REQUEST_METHOD: `GET` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:54:35.408879 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb8cc75-344d-4fdf-ac80-be7303b363d7 None admin] SCRIPT_NAME: `/identity` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:54:35.409169 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb8cc75-344d-4fdf-ac80-be7303b363d7 None admin] PATH_INFO: `/v3/users` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:54:35.409966 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfb8cc75-344d-4fdf-ac80-be7303b363d7 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=352329) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:54:35.410282 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfb8cc75-344d-4fdf-ac80-be7303b363d7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:54:35.411751 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfb8cc75-344d-4fdf-ac80-be7303b363d7 None admin] RBAC: Authorization granted {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:54:35.431365 dv-cinder-851351-1-smb devstack@keystone.service[352329]: [pid: 352329|app: 0|req: 465/950] 10.222.0.42 () {56 vars in 1149 bytes} [Thu Jul 28 08:54:35 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:54:35.444883 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c03f40c-be31-49f4-887a-d4bba73fd3e6 None admin] Authenticating user token {{(pid=352328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:54:35.526475 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a09c04-41e6-48db-9c83-f10a79371699 None None] REQUEST_METHOD: `GET` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:54:35.527347 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a09c04-41e6-48db-9c83-f10a79371699 None None] SCRIPT_NAME: `/identity` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:54:35.527347 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a09c04-41e6-48db-9c83-f10a79371699 None None] PATH_INFO: `/` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:54:35.528578 dv-cinder-851351-1-smb devstack@keystone.service[352329]: [pid: 352329|app: 0|req: 466/951] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 08:54:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 28 08:54:35.533671 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0ce29b-1f29-4ed1-aa13-0c59c99429ec None None] REQUEST_METHOD: `POST` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:54:35.534000 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0ce29b-1f29-4ed1-aa13-0c59c99429ec None None] SCRIPT_NAME: `/identity` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:54:35.534267 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0ce29b-1f29-4ed1-aa13-0c59c99429ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:54:35.553984 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.auth.core [None req-2d0ce29b-1f29-4ed1-aa13-0c59c99429ec None None] MFA Rules not processed for user `d18c063b2377412485965357671e5506`. Rule list: `[]` (Enabled: `True`). {{(pid=352329) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 08:54:35.555207 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.fernet_utils [None req-2d0ce29b-1f29-4ed1-aa13-0c59c99429ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=352329) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:54:35.637017 dv-cinder-851351-1-smb devstack@keystone.service[352329]: [pid: 352329|app: 0|req: 467/952] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 08:54:35 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 28 08:54:35.645611 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c03f40c-be31-49f4-887a-d4bba73fd3e6 None admin] Validating token access rules against request {{(pid=352328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:54:35.652575 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0ce29b-1f29-4ed1-aa13-0c59c99429ec None None] Authenticating user token {{(pid=352329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:54:35.678790 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG dbcounter [-] [352329] Writing DB stats keystone:SELECT=100 {{(pid=352329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:54:35.698034 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG dbcounter [-] [352328] Writing DB stats keystone:SELECT=100 {{(pid=352328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:54:35.714603 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e9d07f-d691-40ea-861b-8258a0b65174 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:54:35.716311 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e9d07f-d691-40ea-861b-8258a0b65174 None admin] REQUEST_METHOD: `GET` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:54:35.717172 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e9d07f-d691-40ea-861b-8258a0b65174 None admin] SCRIPT_NAME: `/identity` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:54:35.717931 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e9d07f-d691-40ea-861b-8258a0b65174 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:54:35.738577 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22e9d07f-d691-40ea-861b-8258a0b65174 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:54:35.741912 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22e9d07f-d691-40ea-861b-8258a0b65174 None admin] RBAC: Authorization granted {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:54:35.759240 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0ce29b-1f29-4ed1-aa13-0c59c99429ec None None] Validating token access rules against request {{(pid=352329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:54:35.765464 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application [None req-22e9d07f-d691-40ea-861b-8258a0b65174 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 08:54:35.765464 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:54:35.765464 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:54:35.765464 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:54:35.765464 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:54:35.765464 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:54:35.765464 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:54:35.765464 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:54:35.765464 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:54:35.765464 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:54:35.765464 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:54:35.765464 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:54:35.765464 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 08:54:35.765464 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 08:54:35.765464 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 08:54:35.766772 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 08:54:35.766772 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:54:35.766772 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:54:35.766772 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:54:35.766772 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:54:35.766772 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:54:35.766772 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:54:35.766772 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:54:35.766772 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application with Lock( Jul 28 08:54:35.766772 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:54:35.766772 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:54:35.766772 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:54:35.766772 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:54:35.766772 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:54:35.766772 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:54:35.766772 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:54:35.766772 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:54:35.767952 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 08:54:35.767952 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 08:54:35.767952 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 08:54:35.767952 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application Jul 28 08:54:35.767952 dv-cinder-851351-1-smb devstack@keystone.service[352328]: [pid: 352328|app: 0|req: 486/953] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 08:54:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 324 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:54:35.768848 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90012f4f-12cc-483a-98f0-6faf1e2049f6 None None] REQUEST_METHOD: `GET` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:54:35.768985 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90012f4f-12cc-483a-98f0-6faf1e2049f6 None None] SCRIPT_NAME: `/identity` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:54:35.769261 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90012f4f-12cc-483a-98f0-6faf1e2049f6 None None] PATH_INFO: `/` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:54:35.770750 dv-cinder-851351-1-smb devstack@keystone.service[352328]: [pid: 352328|app: 0|req: 487/954] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 08:54:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 08:54:35.772470 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90012f4f-12cc-483a-98f0-6faf1e2049f6 None None] Authenticating user token {{(pid=352328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:54:35.805295 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0f1ff0-4eb7-449c-9170-d0bc65d72f12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:54:35.805840 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0f1ff0-4eb7-449c-9170-d0bc65d72f12 None admin] REQUEST_METHOD: `POST` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:54:35.806122 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0f1ff0-4eb7-449c-9170-d0bc65d72f12 None admin] SCRIPT_NAME: `/identity` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:54:35.806398 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0f1ff0-4eb7-449c-9170-d0bc65d72f12 None admin] PATH_INFO: `/v3/users` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:54:35.807084 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e0f1ff0-4eb7-449c-9170-d0bc65d72f12 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:54:35.808553 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e0f1ff0-4eb7-449c-9170-d0bc65d72f12 None admin] RBAC: Authorization granted {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:54:35.811157 dv-cinder-851351-1-smb devstack@keystone.service[352329]: WARNING keystone.server.flask.common [None req-6e0f1ff0-4eb7-449c-9170-d0bc65d72f12 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Jul 28 08:54:35.824515 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.sql.core [None req-6e0f1ff0-4eb7-449c-9170-d0bc65d72f12 None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jul 28 08:54:35.824515 dv-cinder-851351-1-smb devstack@keystone.service[352329]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Jul 28 08:54:35.824515 dv-cinder-851351-1-smb devstack@keystone.service[352329]: [parameters: {'user_id': '2f81976230c84b9a86d8b7bfadcbdd9c', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Jul 28 08:54:35.824515 dv-cinder-851351-1-smb devstack@keystone.service[352329]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=352329) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jul 28 08:54:35.841645 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application [None req-6e0f1ff0-4eb7-449c-9170-d0bc65d72f12 None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Jul 28 08:54:35.841645 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:54:35.841645 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 28 08:54:35.841645 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 28 08:54:35.841645 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 28 08:54:35.841645 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 28 08:54:35.841645 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 28 08:54:35.841645 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application result = self._query(query) Jul 28 08:54:35.841645 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 28 08:54:35.841645 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application conn.query(q) Jul 28 08:54:35.841645 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 28 08:54:35.841645 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 28 08:54:35.841645 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 28 08:54:35.841645 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application result.read() Jul 28 08:54:35.841645 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 28 08:54:35.842946 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 28 08:54:35.842946 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 28 08:54:35.842946 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 28 08:54:35.842946 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 28 08:54:35.842946 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 28 08:54:35.842946 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 28 08:54:35.842946 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 28 08:54:35.842946 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jul 28 08:54:35.842946 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application Jul 28 08:54:35.842946 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jul 28 08:54:35.842946 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application Jul 28 08:54:35.842946 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:54:35.842946 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jul 28 08:54:35.842946 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jul 28 08:54:35.842946 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Jul 28 08:54:35.842946 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Jul 28 08:54:35.842946 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 28 08:54:35.842946 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application next(self.gen) Jul 28 08:54:35.844233 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jul 28 08:54:35.844233 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application yield resource Jul 28 08:54:35.844233 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 28 08:54:35.844233 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application next(self.gen) Jul 28 08:54:35.844233 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jul 28 08:54:35.844233 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application self.session.rollback() Jul 28 08:54:35.844233 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 28 08:54:35.844233 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application self.force_reraise() Jul 28 08:54:35.844233 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 28 08:54:35.844233 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application raise self.value Jul 28 08:54:35.844233 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jul 28 08:54:35.844233 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jul 28 08:54:35.844233 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jul 28 08:54:35.844233 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application session.commit() Jul 28 08:54:35.844233 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jul 28 08:54:35.844233 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jul 28 08:54:35.844233 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jul 28 08:54:35.845401 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application self._prepare_impl() Jul 28 08:54:35.845401 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jul 28 08:54:35.845401 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application self.session.flush() Jul 28 08:54:35.845401 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jul 28 08:54:35.845401 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application self._flush(objects) Jul 28 08:54:35.845401 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jul 28 08:54:35.845401 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jul 28 08:54:35.845401 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jul 28 08:54:35.845401 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application compat.raise_( Jul 28 08:54:35.845401 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 28 08:54:35.845401 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application raise exception Jul 28 08:54:35.845401 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jul 28 08:54:35.845401 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application flush_context.execute() Jul 28 08:54:35.845401 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jul 28 08:54:35.845401 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application rec.execute(self) Jul 28 08:54:35.845401 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jul 28 08:54:35.845401 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jul 28 08:54:35.846578 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jul 28 08:54:35.846578 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application _emit_insert_statements( Jul 28 08:54:35.846578 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Jul 28 08:54:35.846578 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application result = connection._execute_20( Jul 28 08:54:35.846578 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jul 28 08:54:35.846578 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jul 28 08:54:35.846578 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Jul 28 08:54:35.846578 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jul 28 08:54:35.846578 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jul 28 08:54:35.846578 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application ret = self._execute_context( Jul 28 08:54:35.846578 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jul 28 08:54:35.846578 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jul 28 08:54:35.846578 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jul 28 08:54:35.846578 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jul 28 08:54:35.846578 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 28 08:54:35.846578 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application raise exception Jul 28 08:54:35.847700 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 28 08:54:35.847700 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 28 08:54:35.847700 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 28 08:54:35.847700 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 28 08:54:35.847700 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 28 08:54:35.847700 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application result = self._query(query) Jul 28 08:54:35.847700 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 28 08:54:35.847700 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application conn.query(q) Jul 28 08:54:35.847700 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 28 08:54:35.847700 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 28 08:54:35.847700 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 28 08:54:35.847700 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application result.read() Jul 28 08:54:35.847700 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 28 08:54:35.847700 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 28 08:54:35.847700 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 28 08:54:35.847700 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 28 08:54:35.849810 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 28 08:54:35.849810 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 28 08:54:35.849810 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 28 08:54:35.849810 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 28 08:54:35.849810 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jul 28 08:54:35.849810 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Jul 28 08:54:35.849810 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application [parameters: {'user_id': '2f81976230c84b9a86d8b7bfadcbdd9c', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Jul 28 08:54:35.849810 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jul 28 08:54:35.849810 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application Jul 28 08:54:35.849810 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 28 08:54:35.849810 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application Jul 28 08:54:35.849810 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:54:35.849810 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:54:35.849810 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:54:35.849810 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:54:35.851906 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:54:35.851906 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:54:35.851906 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:54:35.851906 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:54:35.851906 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:54:35.851906 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:54:35.851906 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:54:35.851906 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Jul 28 08:54:35.851906 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Jul 28 08:54:35.851906 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:54:35.851906 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:54:35.851906 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 28 08:54:35.851906 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 08:54:35.851906 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 28 08:54:35.851906 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 08:54:35.851906 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Jul 28 08:54:35.851906 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Jul 28 08:54:35.854951 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Jul 28 08:54:35.854951 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Jul 28 08:54:35.854951 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jul 28 08:54:35.854951 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jul 28 08:54:35.854951 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Jul 28 08:54:35.854951 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application Jul 28 08:54:35.854951 dv-cinder-851351-1-smb devstack@keystone.service[352329]: [pid: 352329|app: 0|req: 468/955] 10.222.0.42 () {60 vars in 1131 bytes} [Thu Jul 28 08:54:35 2022] POST /identity/v3/users => generated 160 bytes in 196 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Jul 28 08:54:35.854951 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5fe6538-091b-4d15-9431-099ed5e99b54 None None] REQUEST_METHOD: `POST` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:54:35.854951 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5fe6538-091b-4d15-9431-099ed5e99b54 None None] SCRIPT_NAME: `/identity` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:54:35.854951 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5fe6538-091b-4d15-9431-099ed5e99b54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:54:35.872540 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.auth.core [None req-e5fe6538-091b-4d15-9431-099ed5e99b54 None None] MFA Rules not processed for user `d18c063b2377412485965357671e5506`. Rule list: `[]` (Enabled: `True`). {{(pid=352329) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 08:54:35.874365 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.fernet_utils [None req-e5fe6538-091b-4d15-9431-099ed5e99b54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=352329) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:54:35.900100 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90012f4f-12cc-483a-98f0-6faf1e2049f6 None None] Validating token access rules against request {{(pid=352328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:54:35.936394 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-452fb2e6-4c58-4ef9-aff3-bca14a610902 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:54:35.937060 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452fb2e6-4c58-4ef9-aff3-bca14a610902 None admin] REQUEST_METHOD: `GET` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:54:35.937348 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452fb2e6-4c58-4ef9-aff3-bca14a610902 None admin] SCRIPT_NAME: `/identity` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:54:35.937693 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452fb2e6-4c58-4ef9-aff3-bca14a610902 None admin] PATH_INFO: `/v3/domains` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:54:35.938400 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-452fb2e6-4c58-4ef9-aff3-bca14a610902 None admin] RBAC: Adding query filter params (name=Default) {{(pid=352328) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:54:35.938708 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-452fb2e6-4c58-4ef9-aff3-bca14a610902 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:54:35.940102 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-452fb2e6-4c58-4ef9-aff3-bca14a610902 None admin] RBAC: Authorization granted {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:54:35.948739 dv-cinder-851351-1-smb devstack@keystone.service[352329]: [pid: 352329|app: 0|req: 469/956] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 08:54:35 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 08:54:35.948739 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5fe6538-091b-4d15-9431-099ed5e99b54 None None] Authenticating user token {{(pid=352329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:54:35.958997 dv-cinder-851351-1-smb devstack@keystone.service[352328]: [pid: 352328|app: 0|req: 488/957] 10.222.0.42 () {56 vars in 1109 bytes} [Thu Jul 28 08:54:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:54:35.964651 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-452fb2e6-4c58-4ef9-aff3-bca14a610902 None admin] Authenticating user token {{(pid=352328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:54:35.976399 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG dbcounter [-] [352329] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=352329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:54:36.007086 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG dbcounter [-] [352328] Writing DB stats keystone:SELECT=100 {{(pid=352328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:54:36.075862 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5fe6538-091b-4d15-9431-099ed5e99b54 None None] Validating token access rules against request {{(pid=352329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:54:36.077482 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-452fb2e6-4c58-4ef9-aff3-bca14a610902 None admin] Validating token access rules against request {{(pid=352328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:54:36.127784 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3fa6e90-5f94-4820-a68b-02785c8f1c1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:54:36.128706 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3fa6e90-5f94-4820-a68b-02785c8f1c1c None admin] REQUEST_METHOD: `GET` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:54:36.129100 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3fa6e90-5f94-4820-a68b-02785c8f1c1c None admin] SCRIPT_NAME: `/identity` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:54:36.129603 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3fa6e90-5f94-4820-a68b-02785c8f1c1c None admin] PATH_INFO: `/v3/projects/service` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:54:36.131450 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41165278-d0aa-4df1-8b62-472de863a4b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:54:36.132570 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41165278-d0aa-4df1-8b62-472de863a4b0 None admin] REQUEST_METHOD: `GET` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:54:36.133129 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41165278-d0aa-4df1-8b62-472de863a4b0 None admin] SCRIPT_NAME: `/identity` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:54:36.134022 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41165278-d0aa-4df1-8b62-472de863a4b0 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:54:36.139745 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3fa6e90-5f94-4820-a68b-02785c8f1c1c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:54:36.141518 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3fa6e90-5f94-4820-a68b-02785c8f1c1c None admin] RBAC: Authorization granted {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:54:36.146660 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41165278-d0aa-4df1-8b62-472de863a4b0 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:54:36.148435 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41165278-d0aa-4df1-8b62-472de863a4b0 None admin] RBAC: Authorization granted {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:54:36.159604 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application [None req-d3fa6e90-5f94-4820-a68b-02785c8f1c1c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 08:54:36.159604 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:54:36.159604 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:54:36.159604 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:54:36.159604 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:54:36.159604 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:54:36.159604 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:54:36.159604 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:54:36.159604 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:54:36.159604 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:54:36.159604 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:54:36.159604 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:54:36.159604 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 28 08:54:36.159604 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 28 08:54:36.159604 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 28 08:54:36.161173 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 28 08:54:36.161173 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:54:36.161173 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:54:36.161173 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:54:36.161173 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:54:36.161173 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:54:36.161173 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:54:36.161173 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:54:36.161173 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application with Lock( Jul 28 08:54:36.161173 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:54:36.161173 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:54:36.161173 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:54:36.161173 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:54:36.161173 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:54:36.161173 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:54:36.161173 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:54:36.161173 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:54:36.162792 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 28 08:54:36.162792 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 28 08:54:36.162792 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 28 08:54:36.162792 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 28 08:54:36.162792 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 28 08:54:36.162792 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 28 08:54:36.162792 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 08:54:36.162792 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application Jul 28 08:54:36.165234 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application [None req-41165278-d0aa-4df1-8b62-472de863a4b0 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jul 28 08:54:36.165234 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:54:36.165234 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:54:36.165234 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:54:36.165234 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:54:36.165234 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:54:36.165234 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:54:36.165234 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:54:36.165234 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:54:36.165234 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:54:36.165234 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:54:36.165234 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:54:36.165234 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 28 08:54:36.165234 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 28 08:54:36.165234 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 28 08:54:36.165234 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 28 08:54:36.166659 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:54:36.166659 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:54:36.166659 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 28 08:54:36.166659 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 08:54:36.166659 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 28 08:54:36.166659 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 08:54:36.166659 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:54:36.166659 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:54:36.166659 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:54:36.166659 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:54:36.166659 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:54:36.166659 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application with Lock( Jul 28 08:54:36.166659 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:54:36.166659 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:54:36.166659 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:54:36.166659 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:54:36.166659 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:54:36.166659 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:54:36.168130 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:54:36.168130 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:54:36.168130 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 28 08:54:36.168130 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 28 08:54:36.168130 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 28 08:54:36.168130 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 28 08:54:36.168130 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 28 08:54:36.168130 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 28 08:54:36.168130 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jul 28 08:54:36.168130 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application Jul 28 08:54:36.168130 dv-cinder-851351-1-smb devstack@keystone.service[352329]: [pid: 352329|app: 0|req: 470/959] 10.222.0.42 () {56 vars in 1099 bytes} [Thu Jul 28 08:54:35 2022] GET /identity/v3/users/cinder => generated 84 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:54:36.169105 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41165278-d0aa-4df1-8b62-472de863a4b0 None admin] Authenticating user token {{(pid=352329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:54:36.169264 dv-cinder-851351-1-smb devstack@keystone.service[352328]: [pid: 352328|app: 0|req: 489/959] 10.222.0.42 () {56 vars in 1111 bytes} [Thu Jul 28 08:54:35 2022] GET /identity/v3/projects/service => generated 88 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 08:54:36.170288 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3fa6e90-5f94-4820-a68b-02785c8f1c1c None admin] Authenticating user token {{(pid=352328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:54:36.267862 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG dbcounter [-] [352329] Writing DB stats keystone:SELECT=100 {{(pid=352329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:54:36.282698 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG dbcounter [-] [352328] Writing DB stats keystone:SELECT=100 {{(pid=352328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:54:36.287416 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3fa6e90-5f94-4820-a68b-02785c8f1c1c None admin] Validating token access rules against request {{(pid=352328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:54:36.296603 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41165278-d0aa-4df1-8b62-472de863a4b0 None admin] Validating token access rules against request {{(pid=352329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:54:36.323256 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4be8937-ae90-48ae-b934-27bfa6425765 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:54:36.324046 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4be8937-ae90-48ae-b934-27bfa6425765 None admin] REQUEST_METHOD: `GET` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:54:36.324426 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4be8937-ae90-48ae-b934-27bfa6425765 None admin] SCRIPT_NAME: `/identity` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:54:36.324855 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4be8937-ae90-48ae-b934-27bfa6425765 None admin] PATH_INFO: `/v3/projects` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:54:36.325727 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4be8937-ae90-48ae-b934-27bfa6425765 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=352328) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:54:36.326168 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4be8937-ae90-48ae-b934-27bfa6425765 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:54:36.327602 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4be8937-ae90-48ae-b934-27bfa6425765 None admin] RBAC: Authorization granted {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:54:36.339769 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af7b4901-d9cd-4920-9d3d-77b00db96167 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:54:36.340434 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7b4901-d9cd-4920-9d3d-77b00db96167 None admin] REQUEST_METHOD: `GET` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:54:36.340748 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7b4901-d9cd-4920-9d3d-77b00db96167 None admin] SCRIPT_NAME: `/identity` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:54:36.341032 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7b4901-d9cd-4920-9d3d-77b00db96167 None admin] PATH_INFO: `/v3/services/compute` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:54:36.341806 dv-cinder-851351-1-smb devstack@keystone.service[352328]: [pid: 352328|app: 0|req: 490/960] 10.222.0.42 () {56 vars in 1148 bytes} [Thu Jul 28 08:54:36 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:54:36.342450 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4be8937-ae90-48ae-b934-27bfa6425765 None admin] Authenticating user token {{(pid=352328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:54:36.347182 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af7b4901-d9cd-4920-9d3d-77b00db96167 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:54:36.348121 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af7b4901-d9cd-4920-9d3d-77b00db96167 None admin] RBAC: Authorization granted {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:54:36.358299 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application [None req-af7b4901-d9cd-4920-9d3d-77b00db96167 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jul 28 08:54:36.358299 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:54:36.358299 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 28 08:54:36.358299 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 28 08:54:36.358299 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 28 08:54:36.358299 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 28 08:54:36.358299 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 28 08:54:36.358299 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 08:54:36.358299 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 28 08:54:36.358299 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application Jul 28 08:54:36.358299 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 28 08:54:36.358299 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application Jul 28 08:54:36.358299 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:54:36.358299 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:54:36.358299 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:54:36.358299 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:54:36.358299 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:54:36.359861 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:54:36.359861 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:54:36.359861 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:54:36.359861 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:54:36.359861 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:54:36.359861 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:54:36.359861 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 28 08:54:36.359861 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 28 08:54:36.359861 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 28 08:54:36.359861 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 28 08:54:36.359861 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:54:36.359861 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:54:36.359861 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:54:36.359861 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:54:36.359861 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:54:36.359861 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:54:36.360990 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:54:36.360990 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application with Lock( Jul 28 08:54:36.360990 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:54:36.360990 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:54:36.360990 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:54:36.360990 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:54:36.360990 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:54:36.360990 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:54:36.360990 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:54:36.360990 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:54:36.360990 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 28 08:54:36.360990 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 08:54:36.360990 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 28 08:54:36.360990 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application Jul 28 08:54:36.360990 dv-cinder-851351-1-smb devstack@keystone.service[352329]: [pid: 352329|app: 0|req: 471/961] 10.222.0.42 () {56 vars in 1111 bytes} [Thu Jul 28 08:54:36 2022] GET /identity/v3/services/compute => generated 88 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:54:36.361997 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af7b4901-d9cd-4920-9d3d-77b00db96167 None admin] Authenticating user token {{(pid=352329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:54:36.459246 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4be8937-ae90-48ae-b934-27bfa6425765 None admin] Validating token access rules against request {{(pid=352328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:54:36.475861 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af7b4901-d9cd-4920-9d3d-77b00db96167 None admin] Validating token access rules against request {{(pid=352329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:54:36.498836 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ac2d75-ab4a-403b-ada3-e6d9759e1811 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:54:36.499509 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ac2d75-ab4a-403b-ada3-e6d9759e1811 None admin] REQUEST_METHOD: `GET` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:54:36.499791 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ac2d75-ab4a-403b-ada3-e6d9759e1811 None admin] SCRIPT_NAME: `/identity` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:54:36.500097 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ac2d75-ab4a-403b-ada3-e6d9759e1811 None admin] PATH_INFO: `/v3/users` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:54:36.501670 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50ac2d75-ab4a-403b-ada3-e6d9759e1811 None admin] RBAC: Adding query filter params (name=cinder) {{(pid=352328) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:54:36.501992 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50ac2d75-ab4a-403b-ada3-e6d9759e1811 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:54:36.503955 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50ac2d75-ab4a-403b-ada3-e6d9759e1811 None admin] RBAC: Authorization granted {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:54:36.517781 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9510c03a-5e4d-4d19-a4d8-b9527e4065cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:54:36.518508 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9510c03a-5e4d-4d19-a4d8-b9527e4065cf None admin] REQUEST_METHOD: `PUT` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:54:36.518797 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9510c03a-5e4d-4d19-a4d8-b9527e4065cf None admin] SCRIPT_NAME: `/identity` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:54:36.519100 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9510c03a-5e4d-4d19-a4d8-b9527e4065cf None admin] PATH_INFO: `/v3/projects/9cfa053c839a4fedacde7163d907e2a4/users/02fa8a25f4a844faac620f7db414011a/roles/15fc2297dd8749eab8d518cabaaf36f4` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:54:36.521699 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9510c03a-5e4d-4d19-a4d8-b9527e4065cf None admin] RBAC: Authorizing `identity:create_grant(project_id=9cfa053c839a4fedacde7163d907e2a4, user_id=02fa8a25f4a844faac620f7db414011a, role_id=15fc2297dd8749eab8d518cabaaf36f4)` {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:54:36.523244 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9510c03a-5e4d-4d19-a4d8-b9527e4065cf None admin] RBAC: Authorization granted {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:54:36.535399 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG dbcounter [-] [352329] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=352329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:54:36.541003 dv-cinder-851351-1-smb devstack@keystone.service[352329]: [pid: 352329|app: 0|req: 472/962] 10.222.0.42 () {58 vars in 1439 bytes} [Thu Jul 28 08:54:36 2022] PUT /identity/v3/projects/9cfa053c839a4fedacde7163d907e2a4/users/02fa8a25f4a844faac620f7db414011a/roles/15fc2297dd8749eab8d518cabaaf36f4 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 08:54:36.541936 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9510c03a-5e4d-4d19-a4d8-b9527e4065cf None admin] Authenticating user token {{(pid=352329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:54:36.558199 dv-cinder-851351-1-smb devstack@keystone.service[352328]: [pid: 352328|app: 0|req: 491/963] 10.222.0.42 () {56 vars in 1101 bytes} [Thu Jul 28 08:54:36 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:54:36.684985 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9510c03a-5e4d-4d19-a4d8-b9527e4065cf None admin] Validating token access rules against request {{(pid=352329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:54:36.731762 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065c9f03-d507-44c7-9c44-ac7666208cea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:54:36.732492 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065c9f03-d507-44c7-9c44-ac7666208cea None admin] REQUEST_METHOD: `GET` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:54:36.732825 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065c9f03-d507-44c7-9c44-ac7666208cea None admin] SCRIPT_NAME: `/identity` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:54:36.733112 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065c9f03-d507-44c7-9c44-ac7666208cea None admin] PATH_INFO: `/v3/services` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:54:36.733895 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-065c9f03-d507-44c7-9c44-ac7666208cea None admin] RBAC: Adding query filter params (name=compute) {{(pid=352329) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:54:36.734212 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-065c9f03-d507-44c7-9c44-ac7666208cea None admin] RBAC: Authorizing `identity:list_services()` {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:54:36.735824 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-065c9f03-d507-44c7-9c44-ac7666208cea None admin] RBAC: Authorization granted {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:54:36.745974 dv-cinder-851351-1-smb devstack@keystone.service[352329]: [pid: 352329|app: 0|req: 473/964] 10.222.0.42 () {56 vars in 1112 bytes} [Thu Jul 28 08:54:36 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:54:36.752617 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ac2d75-ab4a-403b-ada3-e6d9759e1811 None admin] Authenticating user token {{(pid=352328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:54:36.781623 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG dbcounter [-] [352328] Writing DB stats keystone:SELECT=100 {{(pid=352328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:54:36.884632 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ac2d75-ab4a-403b-ada3-e6d9759e1811 None admin] Validating token access rules against request {{(pid=352328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:54:36.923496 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611530ce-1533-489c-99a6-c50cc929f181 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:54:36.924424 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611530ce-1533-489c-99a6-c50cc929f181 None admin] REQUEST_METHOD: `GET` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:54:36.924946 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611530ce-1533-489c-99a6-c50cc929f181 None admin] SCRIPT_NAME: `/identity` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:54:36.925389 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611530ce-1533-489c-99a6-c50cc929f181 None admin] PATH_INFO: `/v3/services` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:54:36.926260 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-611530ce-1533-489c-99a6-c50cc929f181 None admin] RBAC: Adding query filter params (type=compute) {{(pid=352328) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:54:36.926760 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-611530ce-1533-489c-99a6-c50cc929f181 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:54:36.928454 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-611530ce-1533-489c-99a6-c50cc929f181 None admin] RBAC: Authorization granted {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:54:36.940871 dv-cinder-851351-1-smb devstack@keystone.service[352328]: [pid: 352328|app: 0|req: 492/965] 10.222.0.42 () {56 vars in 1112 bytes} [Thu Jul 28 08:54:36 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:54:37.066682 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a652c7f-c741-4cbf-8b05-a8c3e6f13407 None None] REQUEST_METHOD: `GET` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:54:37.067023 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a652c7f-c741-4cbf-8b05-a8c3e6f13407 None None] SCRIPT_NAME: `/identity` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:54:37.067284 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a652c7f-c741-4cbf-8b05-a8c3e6f13407 None None] PATH_INFO: `/` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:54:37.069080 dv-cinder-851351-1-smb devstack@keystone.service[352329]: [pid: 352329|app: 0|req: 474/966] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 08:54:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 08:54:37.075159 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701a7106-2c2e-42cd-9c57-a187dd4da60d None None] REQUEST_METHOD: `POST` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:54:37.075529 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701a7106-2c2e-42cd-9c57-a187dd4da60d None None] SCRIPT_NAME: `/identity` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:54:37.075733 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701a7106-2c2e-42cd-9c57-a187dd4da60d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:54:37.105273 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.auth.core [None req-701a7106-2c2e-42cd-9c57-a187dd4da60d None None] MFA Rules not processed for user `d18c063b2377412485965357671e5506`. Rule list: `[]` (Enabled: `True`). {{(pid=352328) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 08:54:37.106819 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.fernet_utils [None req-701a7106-2c2e-42cd-9c57-a187dd4da60d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=352328) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:54:37.202262 dv-cinder-851351-1-smb devstack@keystone.service[352328]: [pid: 352328|app: 0|req: 493/967] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 08:54:37 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 08:54:37.225999 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a652c7f-c741-4cbf-8b05-a8c3e6f13407 None None] Authenticating user token {{(pid=352329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:54:37.295316 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG dbcounter [-] [352329] Writing DB stats keystone:SELECT=100 {{(pid=352329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:54:37.338963 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a652c7f-c741-4cbf-8b05-a8c3e6f13407 None None] Validating token access rules against request {{(pid=352329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:54:37.374638 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cadfe3d8-e851-4fa6-8a38-d4324e4c820b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:54:37.375382 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cadfe3d8-e851-4fa6-8a38-d4324e4c820b None admin] REQUEST_METHOD: `GET` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:54:37.375663 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cadfe3d8-e851-4fa6-8a38-d4324e4c820b None admin] SCRIPT_NAME: `/identity` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:54:37.375940 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cadfe3d8-e851-4fa6-8a38-d4324e4c820b None admin] PATH_INFO: `/v3/services/object-store` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:54:37.376582 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cadfe3d8-e851-4fa6-8a38-d4324e4c820b None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:54:37.378005 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cadfe3d8-e851-4fa6-8a38-d4324e4c820b None admin] RBAC: Authorization granted {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:54:37.387724 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application [None req-cadfe3d8-e851-4fa6-8a38-d4324e4c820b None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 28 08:54:37.387724 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:54:37.387724 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 28 08:54:37.387724 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 28 08:54:37.387724 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 28 08:54:37.387724 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 28 08:54:37.387724 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 28 08:54:37.387724 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 08:54:37.387724 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 28 08:54:37.387724 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application Jul 28 08:54:37.387724 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 28 08:54:37.387724 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application Jul 28 08:54:37.387724 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:54:37.387724 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:54:37.387724 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:54:37.387724 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:54:37.387724 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:54:37.389062 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:54:37.389062 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:54:37.389062 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:54:37.389062 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:54:37.389062 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:54:37.389062 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:54:37.389062 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 28 08:54:37.389062 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 28 08:54:37.389062 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 28 08:54:37.389062 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 28 08:54:37.389062 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:54:37.389062 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:54:37.389062 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:54:37.389062 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:54:37.389062 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:54:37.389062 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:54:37.390142 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:54:37.390142 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application with Lock( Jul 28 08:54:37.390142 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:54:37.390142 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:54:37.390142 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:54:37.390142 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:54:37.390142 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:54:37.390142 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:54:37.390142 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:54:37.390142 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:54:37.390142 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 28 08:54:37.390142 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 08:54:37.390142 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 28 08:54:37.390142 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application Jul 28 08:54:37.391845 dv-cinder-851351-1-smb devstack@keystone.service[352329]: [pid: 352329|app: 0|req: 475/968] 10.222.0.42 () {56 vars in 1126 bytes} [Thu Jul 28 08:54:37 2022] GET /identity/v3/services/object-store => generated 93 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:54:37.395267 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701a7106-2c2e-42cd-9c57-a187dd4da60d None None] Authenticating user token {{(pid=352328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:54:37.408033 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG dbcounter [-] [352328] Writing DB stats keystone:SELECT=100 {{(pid=352328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:54:37.507574 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701a7106-2c2e-42cd-9c57-a187dd4da60d None None] Validating token access rules against request {{(pid=352328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:54:37.543213 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55f66fc-7b3f-4409-aef6-c491b1a0067a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:54:37.543843 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55f66fc-7b3f-4409-aef6-c491b1a0067a None admin] REQUEST_METHOD: `GET` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:54:37.544163 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55f66fc-7b3f-4409-aef6-c491b1a0067a None admin] SCRIPT_NAME: `/identity` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:54:37.544447 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55f66fc-7b3f-4409-aef6-c491b1a0067a None admin] PATH_INFO: `/v3/services` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:54:37.545615 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d55f66fc-7b3f-4409-aef6-c491b1a0067a None admin] RBAC: Adding query filter params (name=object-store) {{(pid=352328) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:54:37.545987 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d55f66fc-7b3f-4409-aef6-c491b1a0067a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:54:37.547862 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d55f66fc-7b3f-4409-aef6-c491b1a0067a None admin] RBAC: Authorization granted {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:54:37.558072 dv-cinder-851351-1-smb devstack@keystone.service[352328]: [pid: 352328|app: 0|req: 494/969] 10.222.0.42 () {56 vars in 1122 bytes} [Thu Jul 28 08:54:37 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:54:37.559957 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cadfe3d8-e851-4fa6-8a38-d4324e4c820b None admin] Authenticating user token {{(pid=352329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:54:37.678680 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cadfe3d8-e851-4fa6-8a38-d4324e4c820b None admin] Validating token access rules against request {{(pid=352329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:54:37.706898 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG dbcounter [-] [352329] Writing DB stats keystone:SELECT=100 {{(pid=352329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:54:37.716242 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100a6445-f511-46cb-8e12-98271560d752 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:54:37.717225 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100a6445-f511-46cb-8e12-98271560d752 None admin] REQUEST_METHOD: `GET` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:54:37.717704 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100a6445-f511-46cb-8e12-98271560d752 None admin] SCRIPT_NAME: `/identity` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:54:37.718169 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100a6445-f511-46cb-8e12-98271560d752 None admin] PATH_INFO: `/v3/services` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:54:37.719110 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-100a6445-f511-46cb-8e12-98271560d752 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=352329) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:54:37.719625 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-100a6445-f511-46cb-8e12-98271560d752 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:54:37.721265 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-100a6445-f511-46cb-8e12-98271560d752 None admin] RBAC: Authorization granted {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:54:37.727037 dv-cinder-851351-1-smb devstack@keystone.service[352329]: [pid: 352329|app: 0|req: 476/970] 10.222.0.42 () {56 vars in 1122 bytes} [Thu Jul 28 08:54:37 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:54:37.733390 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55f66fc-7b3f-4409-aef6-c491b1a0067a None admin] Authenticating user token {{(pid=352328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:54:37.813557 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG dbcounter [-] [352328] Writing DB stats keystone:SELECT=100 {{(pid=352328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:54:37.841250 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55f66fc-7b3f-4409-aef6-c491b1a0067a None admin] Validating token access rules against request {{(pid=352328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:54:37.881460 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-213e06a0-de42-4db0-9f26-31462ee53660 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:54:37.882509 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213e06a0-de42-4db0-9f26-31462ee53660 None admin] REQUEST_METHOD: `GET` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:54:37.883012 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213e06a0-de42-4db0-9f26-31462ee53660 None admin] SCRIPT_NAME: `/identity` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:54:37.883484 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213e06a0-de42-4db0-9f26-31462ee53660 None admin] PATH_INFO: `/v3/endpoints` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:54:37.884927 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-213e06a0-de42-4db0-9f26-31462ee53660 None admin] RBAC: Adding query filter params (interface=admin, service_id=d02c0ca34b72450ebd2ab27f29aa059d, region_id=RegionOne) {{(pid=352328) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:54:37.885474 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-213e06a0-de42-4db0-9f26-31462ee53660 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:54:37.888191 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-213e06a0-de42-4db0-9f26-31462ee53660 None admin] RBAC: Authorization granted {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:54:37.902251 dv-cinder-851351-1-smb devstack@keystone.service[352328]: [pid: 352328|app: 0|req: 495/971] 10.222.0.42 () {56 vars in 1249 bytes} [Thu Jul 28 08:54:37 2022] GET /identity/v3/endpoints?service_id=d02c0ca34b72450ebd2ab27f29aa059d&interface=admin®ion_id=RegionOne => generated 193 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 08:54:37.903378 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100a6445-f511-46cb-8e12-98271560d752 None admin] Authenticating user token {{(pid=352329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:54:38.028318 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100a6445-f511-46cb-8e12-98271560d752 None admin] Validating token access rules against request {{(pid=352329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:54:38.066022 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3660917f-5efa-4872-b182-add5ae9b660a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:54:38.066581 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3660917f-5efa-4872-b182-add5ae9b660a None admin] REQUEST_METHOD: `GET` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:54:38.066867 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3660917f-5efa-4872-b182-add5ae9b660a None admin] SCRIPT_NAME: `/identity` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:54:38.067184 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3660917f-5efa-4872-b182-add5ae9b660a None admin] PATH_INFO: `/v3/services` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:54:38.067863 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3660917f-5efa-4872-b182-add5ae9b660a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:54:38.069350 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3660917f-5efa-4872-b182-add5ae9b660a None admin] RBAC: Authorization granted {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:54:38.075679 dv-cinder-851351-1-smb devstack@keystone.service[352329]: [pid: 352329|app: 0|req: 477/972] 10.222.0.42 () {56 vars in 1087 bytes} [Thu Jul 28 08:54:37 2022] GET /identity/v3/services => generated 1497 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 28 08:54:38.677086 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09162124-04d1-4db8-951b-af07b2e61fdb None None] REQUEST_METHOD: `GET` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:54:38.677649 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09162124-04d1-4db8-951b-af07b2e61fdb None None] SCRIPT_NAME: `/identity` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:54:38.677649 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09162124-04d1-4db8-951b-af07b2e61fdb None None] PATH_INFO: `/` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:54:38.679123 dv-cinder-851351-1-smb devstack@keystone.service[352328]: [pid: 352328|app: 0|req: 496/973] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 08:54:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 08:54:38.684594 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468c5fd3-fa5f-4983-b63a-299c9de78a3c None None] REQUEST_METHOD: `POST` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:54:38.685089 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468c5fd3-fa5f-4983-b63a-299c9de78a3c None None] SCRIPT_NAME: `/identity` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:54:38.685204 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468c5fd3-fa5f-4983-b63a-299c9de78a3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:54:38.704882 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.auth.core [None req-468c5fd3-fa5f-4983-b63a-299c9de78a3c None None] MFA Rules not processed for user `d18c063b2377412485965357671e5506`. Rule list: `[]` (Enabled: `True`). {{(pid=352329) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 08:54:38.706104 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.fernet_utils [None req-468c5fd3-fa5f-4983-b63a-299c9de78a3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=352329) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:54:38.761482 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG dbcounter [-] [352329] Writing DB stats keystone:SELECT=100 {{(pid=352329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:54:38.779523 dv-cinder-851351-1-smb devstack@keystone.service[352329]: [pid: 352329|app: 0|req: 478/974] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 08:54:38 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 08:54:38.802900 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09162124-04d1-4db8-951b-af07b2e61fdb None None] Authenticating user token {{(pid=352328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:54:38.915328 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09162124-04d1-4db8-951b-af07b2e61fdb None None] Validating token access rules against request {{(pid=352328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:54:38.954771 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1167872-fe00-46ec-b93f-b5df899b9394 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:54:38.955821 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1167872-fe00-46ec-b93f-b5df899b9394 None admin] REQUEST_METHOD: `GET` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:54:38.956326 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1167872-fe00-46ec-b93f-b5df899b9394 None admin] SCRIPT_NAME: `/identity` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:54:38.956885 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1167872-fe00-46ec-b93f-b5df899b9394 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:54:38.967799 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG dbcounter [-] [352328] Writing DB stats keystone:SELECT=100 {{(pid=352328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:54:38.972332 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1167872-fe00-46ec-b93f-b5df899b9394 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 08:54:38.977674 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application [None req-c1167872-fe00-46ec-b93f-b5df899b9394 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 28 08:54:38.977674 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:54:38.977674 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:54:38.977674 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:54:38.977674 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:54:38.977674 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:54:38.977674 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:54:38.977674 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:54:38.977674 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:54:38.977674 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:54:38.977674 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:54:38.977674 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:54:38.977674 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 08:54:38.977674 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 08:54:38.977674 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 08:54:38.977674 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 08:54:38.978933 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 08:54:38.978933 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 08:54:38.978933 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 08:54:38.978933 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 08:54:38.978933 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:54:38.978933 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:54:38.978933 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:54:38.978933 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:54:38.978933 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:54:38.978933 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:54:38.978933 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:54:38.978933 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application with Lock( Jul 28 08:54:38.978933 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:54:38.978933 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:54:38.978933 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:54:38.978933 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:54:38.980074 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:54:38.980074 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:54:38.980074 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:54:38.980074 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:54:38.980074 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 08:54:38.980074 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 08:54:38.980074 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 08:54:38.980074 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 08:54:38.980074 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 08:54:38.980074 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 08:54:38.980074 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 28 08:54:38.980074 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application Jul 28 08:54:38.980074 dv-cinder-851351-1-smb devstack@keystone.service[352328]: [pid: 352328|app: 0|req: 497/975] 10.222.0.42 () {56 vars in 1120 bytes} [Thu Jul 28 08:54:38 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:54:38.987714 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468c5fd3-fa5f-4983-b63a-299c9de78a3c None None] Authenticating user token {{(pid=352329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:54:39.019174 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16038f31-243a-407b-b147-39a0f9d96754 None None] REQUEST_METHOD: `GET` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:54:39.019489 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16038f31-243a-407b-b147-39a0f9d96754 None None] SCRIPT_NAME: `/identity` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:54:39.019735 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16038f31-243a-407b-b147-39a0f9d96754 None None] PATH_INFO: `/` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:54:39.021263 dv-cinder-851351-1-smb devstack@keystone.service[352328]: [pid: 352328|app: 0|req: 498/976] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 08:54:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 08:54:39.027233 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e53a63-7ab2-483c-bf03-326621a2e5ed None None] REQUEST_METHOD: `POST` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:54:39.027517 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e53a63-7ab2-483c-bf03-326621a2e5ed None None] SCRIPT_NAME: `/identity` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:54:39.027866 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e53a63-7ab2-483c-bf03-326621a2e5ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:54:39.052637 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.auth.core [None req-93e53a63-7ab2-483c-bf03-326621a2e5ed None None] MFA Rules not processed for user `d18c063b2377412485965357671e5506`. Rule list: `[]` (Enabled: `True`). {{(pid=352328) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 08:54:39.054050 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.fernet_utils [None req-93e53a63-7ab2-483c-bf03-326621a2e5ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=352328) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:54:39.113803 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468c5fd3-fa5f-4983-b63a-299c9de78a3c None None] Validating token access rules against request {{(pid=352329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:54:39.130420 dv-cinder-851351-1-smb devstack@keystone.service[352328]: [pid: 352328|app: 0|req: 499/977] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 08:54:39 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 08:54:39.151106 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba5597cb-6b7d-4ab8-acb5-36d97ed529ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:54:39.151756 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5597cb-6b7d-4ab8-acb5-36d97ed529ec None admin] REQUEST_METHOD: `GET` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:54:39.152043 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5597cb-6b7d-4ab8-acb5-36d97ed529ec None admin] SCRIPT_NAME: `/identity` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:54:39.152322 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5597cb-6b7d-4ab8-acb5-36d97ed529ec None admin] PATH_INFO: `/v3/roles` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:54:39.153203 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba5597cb-6b7d-4ab8-acb5-36d97ed529ec None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=352329) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:54:39.153514 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba5597cb-6b7d-4ab8-acb5-36d97ed529ec None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:54:39.153917 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e53a63-7ab2-483c-bf03-326621a2e5ed None None] Authenticating user token {{(pid=352328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:54:39.154930 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba5597cb-6b7d-4ab8-acb5-36d97ed529ec None admin] RBAC: Authorization granted {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:54:39.165203 dv-cinder-851351-1-smb devstack@keystone.service[352329]: [pid: 352329|app: 0|req: 479/978] 10.222.0.42 () {56 vars in 1115 bytes} [Thu Jul 28 08:54:38 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:54:39.170910 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba5597cb-6b7d-4ab8-acb5-36d97ed529ec None admin] Authenticating user token {{(pid=352329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:54:39.229102 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG dbcounter [-] [352329] Writing DB stats keystone:SELECT=100 {{(pid=352329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:54:39.275646 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e53a63-7ab2-483c-bf03-326621a2e5ed None None] Validating token access rules against request {{(pid=352328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:54:39.286787 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba5597cb-6b7d-4ab8-acb5-36d97ed529ec None admin] Validating token access rules against request {{(pid=352329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:54:39.307026 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG dbcounter [-] [352328] Writing DB stats keystone:SELECT=100 {{(pid=352328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:54:39.318115 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21502ff0-2c01-474b-921f-d7f1b68281a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:54:39.318890 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21502ff0-2c01-474b-921f-d7f1b68281a7 None admin] REQUEST_METHOD: `POST` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:54:39.319171 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21502ff0-2c01-474b-921f-d7f1b68281a7 None admin] SCRIPT_NAME: `/identity` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:54:39.319556 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21502ff0-2c01-474b-921f-d7f1b68281a7 None admin] PATH_INFO: `/v3/services` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:54:39.320291 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21502ff0-2c01-474b-921f-d7f1b68281a7 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:54:39.321728 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21502ff0-2c01-474b-921f-d7f1b68281a7 None admin] RBAC: Authorization granted {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:54:39.334578 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc93510-f8a8-4472-a0a4-54a6750470c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:54:39.335249 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc93510-f8a8-4472-a0a4-54a6750470c9 None admin] REQUEST_METHOD: `GET` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:54:39.335530 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc93510-f8a8-4472-a0a4-54a6750470c9 None admin] SCRIPT_NAME: `/identity` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:54:39.335803 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc93510-f8a8-4472-a0a4-54a6750470c9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:54:39.342071 dv-cinder-851351-1-smb devstack@keystone.service[352328]: [pid: 352328|app: 0|req: 500/979] 10.222.0.42 () {60 vars in 1141 bytes} [Thu Jul 28 08:54:39 2022] POST /identity/v3/services => generated 242 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 28 08:54:39.354153 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc93510-f8a8-4472-a0a4-54a6750470c9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:54:39.355701 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc93510-f8a8-4472-a0a4-54a6750470c9 None admin] RBAC: Authorization granted {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:54:39.374436 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application [None req-9fc93510-f8a8-4472-a0a4-54a6750470c9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 08:54:39.374436 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:54:39.374436 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:54:39.374436 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:54:39.374436 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:54:39.374436 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:54:39.374436 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:54:39.374436 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:54:39.374436 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:54:39.374436 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:54:39.374436 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:54:39.374436 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:54:39.374436 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 08:54:39.374436 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 08:54:39.374436 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 08:54:39.375752 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 08:54:39.375752 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:54:39.375752 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:54:39.375752 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:54:39.375752 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:54:39.375752 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:54:39.375752 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:54:39.375752 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:54:39.375752 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application with Lock( Jul 28 08:54:39.375752 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:54:39.375752 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:54:39.375752 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:54:39.375752 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:54:39.375752 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:54:39.375752 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:54:39.375752 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:54:39.375752 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:54:39.382457 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 08:54:39.382457 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 08:54:39.382457 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 08:54:39.382457 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application Jul 28 08:54:39.382457 dv-cinder-851351-1-smb devstack@keystone.service[352329]: [pid: 352329|app: 0|req: 480/980] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 08:54:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 08:54:39.384215 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21502ff0-2c01-474b-921f-d7f1b68281a7 None admin] Authenticating user token {{(pid=352328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:54:39.506012 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21502ff0-2c01-474b-921f-d7f1b68281a7 None admin] Validating token access rules against request {{(pid=352328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:54:39.541985 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1442e9-be80-482b-81e5-51d96b2f98a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:54:39.542681 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1442e9-be80-482b-81e5-51d96b2f98a9 None admin] REQUEST_METHOD: `GET` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:54:39.542969 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1442e9-be80-482b-81e5-51d96b2f98a9 None admin] SCRIPT_NAME: `/identity` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:54:39.543344 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1442e9-be80-482b-81e5-51d96b2f98a9 None admin] PATH_INFO: `/v3/domains` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:54:39.543967 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e1442e9-be80-482b-81e5-51d96b2f98a9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=352328) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:54:39.544712 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e1442e9-be80-482b-81e5-51d96b2f98a9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:54:39.545794 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e1442e9-be80-482b-81e5-51d96b2f98a9 None admin] RBAC: Authorization granted {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:54:39.559358 dv-cinder-851351-1-smb devstack@keystone.service[352328]: [pid: 352328|app: 0|req: 501/981] 10.222.0.42 () {56 vars in 1109 bytes} [Thu Jul 28 08:54:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:54:39.565184 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc93510-f8a8-4472-a0a4-54a6750470c9 None admin] Authenticating user token {{(pid=352329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:54:39.670671 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG dbcounter [-] [352329] Writing DB stats keystone:SELECT=100 {{(pid=352329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:54:39.674496 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc93510-f8a8-4472-a0a4-54a6750470c9 None admin] Validating token access rules against request {{(pid=352329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:54:39.710788 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b89a73-0433-4b2c-8103-204958bb47c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:54:39.711578 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b89a73-0433-4b2c-8103-204958bb47c0 None admin] REQUEST_METHOD: `GET` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:54:39.711869 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b89a73-0433-4b2c-8103-204958bb47c0 None admin] SCRIPT_NAME: `/identity` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:54:39.712067 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b89a73-0433-4b2c-8103-204958bb47c0 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:54:39.720690 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2b89a73-0433-4b2c-8103-204958bb47c0 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:54:39.722182 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2b89a73-0433-4b2c-8103-204958bb47c0 None admin] RBAC: Authorization granted {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:54:39.734563 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application [None req-f2b89a73-0433-4b2c-8103-204958bb47c0 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 28 08:54:39.734563 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:54:39.734563 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:54:39.734563 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:54:39.734563 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:54:39.734563 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:54:39.734563 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:54:39.734563 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:54:39.734563 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:54:39.734563 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:54:39.734563 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:54:39.734563 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:54:39.734563 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 28 08:54:39.734563 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 28 08:54:39.734563 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 28 08:54:39.734563 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 28 08:54:39.735928 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:54:39.735928 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:54:39.735928 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 28 08:54:39.735928 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 08:54:39.735928 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 28 08:54:39.735928 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 08:54:39.735928 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:54:39.735928 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:54:39.735928 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:54:39.735928 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:54:39.735928 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:54:39.735928 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application with Lock( Jul 28 08:54:39.735928 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:54:39.735928 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:54:39.735928 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:54:39.735928 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:54:39.735928 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:54:39.735928 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:54:39.741955 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:54:39.741955 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:54:39.741955 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 28 08:54:39.741955 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 28 08:54:39.741955 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 28 08:54:39.741955 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 28 08:54:39.741955 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 28 08:54:39.741955 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 28 08:54:39.741955 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 28 08:54:39.741955 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application Jul 28 08:54:39.741955 dv-cinder-851351-1-smb devstack@keystone.service[352329]: [pid: 352329|app: 0|req: 481/982] 10.222.0.42 () {56 vars in 1117 bytes} [Thu Jul 28 08:54:39 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:54:39.744726 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1442e9-be80-482b-81e5-51d96b2f98a9 None admin] Authenticating user token {{(pid=352328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:54:39.791722 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG dbcounter [-] [352328] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=352328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:54:39.851022 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1442e9-be80-482b-81e5-51d96b2f98a9 None admin] Validating token access rules against request {{(pid=352328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:54:39.887574 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32112e71-779a-4f53-852e-a48113678d24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:54:39.888218 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32112e71-779a-4f53-852e-a48113678d24 None admin] REQUEST_METHOD: `GET` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:54:39.888504 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32112e71-779a-4f53-852e-a48113678d24 None admin] SCRIPT_NAME: `/identity` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:54:39.888825 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32112e71-779a-4f53-852e-a48113678d24 None admin] PATH_INFO: `/v3/users` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:54:39.889644 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32112e71-779a-4f53-852e-a48113678d24 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=352328) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:54:39.889958 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32112e71-779a-4f53-852e-a48113678d24 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:54:39.891475 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32112e71-779a-4f53-852e-a48113678d24 None admin] RBAC: Authorization granted {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:54:39.910539 dv-cinder-851351-1-smb devstack@keystone.service[352328]: [pid: 352328|app: 0|req: 502/983] 10.222.0.42 () {56 vars in 1149 bytes} [Thu Jul 28 08:54:39 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:54:39.916210 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b89a73-0433-4b2c-8103-204958bb47c0 None admin] Authenticating user token {{(pid=352329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:54:40.027073 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b89a73-0433-4b2c-8103-204958bb47c0 None admin] Validating token access rules against request {{(pid=352329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:54:40.064373 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0979904f-29ab-41bf-bb2b-8d3edac2744f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:54:40.064950 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0979904f-29ab-41bf-bb2b-8d3edac2744f None admin] REQUEST_METHOD: `GET` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:54:40.065194 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0979904f-29ab-41bf-bb2b-8d3edac2744f None admin] SCRIPT_NAME: `/identity` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:54:40.065510 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0979904f-29ab-41bf-bb2b-8d3edac2744f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:54:40.099583 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG dbcounter [-] [352329] Writing DB stats keystone:SELECT=100 {{(pid=352329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:54:40.124374 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a33503b-334b-47fb-8830-be2042549c77 None None] REQUEST_METHOD: `GET` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:54:40.124698 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a33503b-334b-47fb-8830-be2042549c77 None None] SCRIPT_NAME: `/identity` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:54:40.125042 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a33503b-334b-47fb-8830-be2042549c77 None None] PATH_INFO: `/` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:54:40.126588 dv-cinder-851351-1-smb devstack@keystone.service[352328]: [pid: 352328|app: 0|req: 503/984] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 08:54:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 28 08:54:40.131582 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656dc4d7-13f6-4561-a457-16921953ffe9 None None] REQUEST_METHOD: `POST` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:54:40.131882 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656dc4d7-13f6-4561-a457-16921953ffe9 None None] SCRIPT_NAME: `/identity` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:54:40.132134 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656dc4d7-13f6-4561-a457-16921953ffe9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:54:40.146119 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0979904f-29ab-41bf-bb2b-8d3edac2744f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:54:40.147785 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0979904f-29ab-41bf-bb2b-8d3edac2744f None admin] RBAC: Authorization granted {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:54:40.150562 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.auth.core [None req-656dc4d7-13f6-4561-a457-16921953ffe9 None None] MFA Rules not processed for user `d18c063b2377412485965357671e5506`. Rule list: `[]` (Enabled: `True`). {{(pid=352328) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 08:54:40.151868 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.fernet_utils [None req-656dc4d7-13f6-4561-a457-16921953ffe9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=352328) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:54:40.225364 dv-cinder-851351-1-smb devstack@keystone.service[352328]: [pid: 352328|app: 0|req: 504/985] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 08:54:40 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 28 08:54:40.248314 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656dc4d7-13f6-4561-a457-16921953ffe9 None None] Authenticating user token {{(pid=352328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:54:40.261988 dv-cinder-851351-1-smb devstack@keystone.service[352329]: [pid: 352329|app: 0|req: 482/986] 10.222.0.42 () {58 vars in 1282 bytes} [Thu Jul 28 08:54:39 2022] GET /identity/v3/auth/tokens => generated 1560 bytes in 346 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 28 08:54:40.268005 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0979904f-29ab-41bf-bb2b-8d3edac2744f None admin] Authenticating user token {{(pid=352329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:54:40.282172 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG dbcounter [-] [352328] Writing DB stats keystone:SELECT=100 {{(pid=352328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:54:40.339523 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG dbcounter [-] [352329] Writing DB stats keystone:SELECT=100 {{(pid=352329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:54:40.370229 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656dc4d7-13f6-4561-a457-16921953ffe9 None None] Validating token access rules against request {{(pid=352328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:54:40.393204 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0979904f-29ab-41bf-bb2b-8d3edac2744f None admin] Validating token access rules against request {{(pid=352329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:54:40.417568 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bbf8017-3853-4cfa-904b-93c3c99ab8e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:54:40.418234 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbf8017-3853-4cfa-904b-93c3c99ab8e6 None admin] REQUEST_METHOD: `GET` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:54:40.418517 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbf8017-3853-4cfa-904b-93c3c99ab8e6 None admin] SCRIPT_NAME: `/identity` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:54:40.418790 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbf8017-3853-4cfa-904b-93c3c99ab8e6 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:54:40.419429 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bbf8017-3853-4cfa-904b-93c3c99ab8e6 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:54:40.421006 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bbf8017-3853-4cfa-904b-93c3c99ab8e6 None admin] RBAC: Authorization granted {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:54:40.429693 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12fc1661-5b4b-4a13-8f48-f22c9c974245 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:54:40.430019 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application [None req-2bbf8017-3853-4cfa-904b-93c3c99ab8e6 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 28 08:54:40.430019 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:54:40.430019 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 28 08:54:40.430019 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 28 08:54:40.430019 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 28 08:54:40.430019 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 28 08:54:40.430019 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 28 08:54:40.430019 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 08:54:40.430019 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 28 08:54:40.430019 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application Jul 28 08:54:40.430019 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 28 08:54:40.430019 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application Jul 28 08:54:40.430019 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:54:40.430019 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:54:40.430019 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:54:40.430019 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:54:40.430019 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:54:40.431281 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:54:40.431281 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:54:40.431281 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:54:40.431281 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:54:40.431281 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:54:40.431281 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:54:40.431281 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 28 08:54:40.431281 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 28 08:54:40.431281 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 28 08:54:40.431281 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 28 08:54:40.431281 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:54:40.431281 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:54:40.431281 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:54:40.431281 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:54:40.431281 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:54:40.431281 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:54:40.432361 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:54:40.432361 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application with Lock( Jul 28 08:54:40.432361 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:54:40.432361 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:54:40.432361 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:54:40.432361 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:54:40.432361 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:54:40.432361 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:54:40.432361 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:54:40.432361 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:54:40.432361 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 28 08:54:40.432361 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 08:54:40.432361 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 28 08:54:40.432361 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application Jul 28 08:54:40.433661 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12fc1661-5b4b-4a13-8f48-f22c9c974245 None admin] REQUEST_METHOD: `GET` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:54:40.433661 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12fc1661-5b4b-4a13-8f48-f22c9c974245 None admin] SCRIPT_NAME: `/identity` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:54:40.433661 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12fc1661-5b4b-4a13-8f48-f22c9c974245 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:54:40.433916 dv-cinder-851351-1-smb devstack@keystone.service[352328]: [pid: 352328|app: 0|req: 505/987] 10.222.0.42 () {56 vars in 1126 bytes} [Thu Jul 28 08:54:40 2022] GET /identity/v3/services/object-store => generated 93 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 08:54:40.437354 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bbf8017-3853-4cfa-904b-93c3c99ab8e6 None admin] Authenticating user token {{(pid=352328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:54:40.447398 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12fc1661-5b4b-4a13-8f48-f22c9c974245 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:54:40.448920 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12fc1661-5b4b-4a13-8f48-f22c9c974245 None admin] RBAC: Authorization granted {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:54:40.465182 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application [None req-12fc1661-5b4b-4a13-8f48-f22c9c974245 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 08:54:40.465182 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:54:40.465182 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:54:40.465182 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:54:40.465182 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:54:40.465182 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:54:40.465182 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:54:40.465182 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:54:40.465182 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:54:40.465182 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:54:40.465182 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:54:40.465182 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:54:40.465182 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 08:54:40.465182 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 08:54:40.465182 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 08:54:40.466469 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 08:54:40.466469 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:54:40.466469 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:54:40.466469 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:54:40.466469 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:54:40.466469 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:54:40.466469 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:54:40.466469 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:54:40.466469 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application with Lock( Jul 28 08:54:40.466469 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:54:40.466469 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:54:40.466469 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:54:40.466469 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:54:40.466469 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:54:40.466469 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:54:40.466469 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:54:40.466469 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:54:40.467834 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 08:54:40.467834 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 08:54:40.467834 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 08:54:40.467834 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application Jul 28 08:54:40.467834 dv-cinder-851351-1-smb devstack@keystone.service[352329]: [pid: 352329|app: 0|req: 483/988] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 08:54:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:54:40.471772 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12fc1661-5b4b-4a13-8f48-f22c9c974245 None admin] Authenticating user token {{(pid=352329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:54:40.546142 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG dbcounter [-] [352328] Writing DB stats keystone:SELECT=100 {{(pid=352328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:54:40.554317 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bbf8017-3853-4cfa-904b-93c3c99ab8e6 None admin] Validating token access rules against request {{(pid=352328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:54:40.582583 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12fc1661-5b4b-4a13-8f48-f22c9c974245 None admin] Validating token access rules against request {{(pid=352329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:54:40.591294 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc032a09-4bf4-4e50-8370-d74d6de2e473 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:54:40.591897 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc032a09-4bf4-4e50-8370-d74d6de2e473 None admin] REQUEST_METHOD: `GET` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:54:40.592187 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc032a09-4bf4-4e50-8370-d74d6de2e473 None admin] SCRIPT_NAME: `/identity` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:54:40.592464 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc032a09-4bf4-4e50-8370-d74d6de2e473 None admin] PATH_INFO: `/v3/services` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:54:40.593193 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc032a09-4bf4-4e50-8370-d74d6de2e473 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=352328) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:54:40.593509 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc032a09-4bf4-4e50-8370-d74d6de2e473 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:54:40.594971 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc032a09-4bf4-4e50-8370-d74d6de2e473 None admin] RBAC: Authorization granted {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:54:40.596564 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG dbcounter [-] [352329] Writing DB stats keystone:SELECT=100 {{(pid=352329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:54:40.605567 dv-cinder-851351-1-smb devstack@keystone.service[352328]: [pid: 352328|app: 0|req: 506/989] 10.222.0.42 () {56 vars in 1122 bytes} [Thu Jul 28 08:54:40 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 08:54:40.606753 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc032a09-4bf4-4e50-8370-d74d6de2e473 None admin] Authenticating user token {{(pid=352328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:54:40.625610 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99260fb7-81d8-47b2-84a3-f0cd6dced7a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:54:40.626248 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99260fb7-81d8-47b2-84a3-f0cd6dced7a6 None admin] REQUEST_METHOD: `GET` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:54:40.626541 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99260fb7-81d8-47b2-84a3-f0cd6dced7a6 None admin] SCRIPT_NAME: `/identity` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:54:40.626813 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99260fb7-81d8-47b2-84a3-f0cd6dced7a6 None admin] PATH_INFO: `/v3/domains` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:54:40.627521 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99260fb7-81d8-47b2-84a3-f0cd6dced7a6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=352329) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:54:40.627831 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99260fb7-81d8-47b2-84a3-f0cd6dced7a6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:54:40.629276 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99260fb7-81d8-47b2-84a3-f0cd6dced7a6 None admin] RBAC: Authorization granted {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:54:40.646423 dv-cinder-851351-1-smb devstack@keystone.service[352329]: [pid: 352329|app: 0|req: 484/990] 10.222.0.42 () {56 vars in 1109 bytes} [Thu Jul 28 08:54:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 08:54:40.647323 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99260fb7-81d8-47b2-84a3-f0cd6dced7a6 None admin] Authenticating user token {{(pid=352329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:54:40.721558 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc032a09-4bf4-4e50-8370-d74d6de2e473 None admin] Validating token access rules against request {{(pid=352328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:54:40.757656 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99260fb7-81d8-47b2-84a3-f0cd6dced7a6 None admin] Validating token access rules against request {{(pid=352329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:54:40.762088 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b05832-c9be-41ed-9fe2-8d9efad79834 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:54:40.762729 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b05832-c9be-41ed-9fe2-8d9efad79834 None admin] REQUEST_METHOD: `GET` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:54:40.763017 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b05832-c9be-41ed-9fe2-8d9efad79834 None admin] SCRIPT_NAME: `/identity` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:54:40.763296 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b05832-c9be-41ed-9fe2-8d9efad79834 None admin] PATH_INFO: `/v3/services` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:54:40.763988 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b05832-c9be-41ed-9fe2-8d9efad79834 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=352328) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:54:40.764301 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b05832-c9be-41ed-9fe2-8d9efad79834 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:54:40.765914 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b05832-c9be-41ed-9fe2-8d9efad79834 None admin] RBAC: Authorization granted {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:54:40.776044 dv-cinder-851351-1-smb devstack@keystone.service[352328]: [pid: 352328|app: 0|req: 507/991] 10.222.0.42 () {56 vars in 1122 bytes} [Thu Jul 28 08:54:40 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:54:40.777045 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b05832-c9be-41ed-9fe2-8d9efad79834 None admin] Authenticating user token {{(pid=352328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:54:40.798678 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4deebfd7-6548-4dc9-85ff-be1e26b21475 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:54:40.799342 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4deebfd7-6548-4dc9-85ff-be1e26b21475 None admin] REQUEST_METHOD: `GET` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:54:40.799626 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4deebfd7-6548-4dc9-85ff-be1e26b21475 None admin] SCRIPT_NAME: `/identity` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:54:40.799905 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4deebfd7-6548-4dc9-85ff-be1e26b21475 None admin] PATH_INFO: `/v3/projects/service` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:54:40.804135 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG dbcounter [-] [352328] Writing DB stats keystone:SELECT=100 {{(pid=352328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:54:40.807647 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4deebfd7-6548-4dc9-85ff-be1e26b21475 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:54:40.809306 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4deebfd7-6548-4dc9-85ff-be1e26b21475 None admin] RBAC: Authorization granted {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:54:40.821480 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application [None req-4deebfd7-6548-4dc9-85ff-be1e26b21475 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 08:54:40.821480 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:54:40.821480 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:54:40.821480 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:54:40.821480 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:54:40.821480 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:54:40.821480 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:54:40.821480 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:54:40.821480 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:54:40.821480 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:54:40.821480 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:54:40.821480 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:54:40.821480 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 28 08:54:40.821480 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 28 08:54:40.821480 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 28 08:54:40.822634 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 28 08:54:40.822634 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:54:40.822634 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:54:40.822634 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:54:40.822634 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:54:40.822634 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:54:40.822634 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:54:40.822634 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:54:40.822634 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application with Lock( Jul 28 08:54:40.822634 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:54:40.822634 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:54:40.822634 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:54:40.822634 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:54:40.822634 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:54:40.822634 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:54:40.822634 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:54:40.822634 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:54:40.823756 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 28 08:54:40.823756 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 28 08:54:40.823756 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 28 08:54:40.823756 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 28 08:54:40.823756 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 28 08:54:40.823756 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 28 08:54:40.823756 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 08:54:40.823756 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application Jul 28 08:54:40.823756 dv-cinder-851351-1-smb devstack@keystone.service[352329]: [pid: 352329|app: 0|req: 485/992] 10.222.0.42 () {56 vars in 1111 bytes} [Thu Jul 28 08:54:40 2022] GET /identity/v3/projects/service => generated 88 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:54:40.828641 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4deebfd7-6548-4dc9-85ff-be1e26b21475 None admin] Authenticating user token {{(pid=352329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:54:40.861396 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG dbcounter [-] [352329] Writing DB stats keystone:SELECT=100 {{(pid=352329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:54:40.893307 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b05832-c9be-41ed-9fe2-8d9efad79834 None admin] Validating token access rules against request {{(pid=352328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:54:40.929540 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300478c4-2ef0-4103-b3cd-6a8438f98b02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:54:40.930186 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300478c4-2ef0-4103-b3cd-6a8438f98b02 None admin] REQUEST_METHOD: `POST` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:54:40.930472 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300478c4-2ef0-4103-b3cd-6a8438f98b02 None admin] SCRIPT_NAME: `/identity` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:54:40.930751 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300478c4-2ef0-4103-b3cd-6a8438f98b02 None admin] PATH_INFO: `/v3/endpoints` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:54:40.931480 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-300478c4-2ef0-4103-b3cd-6a8438f98b02 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:54:40.932900 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-300478c4-2ef0-4103-b3cd-6a8438f98b02 None admin] RBAC: Authorization granted {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:54:40.934910 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4deebfd7-6548-4dc9-85ff-be1e26b21475 None admin] Validating token access rules against request {{(pid=352329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:54:40.954718 dv-cinder-851351-1-smb devstack@keystone.service[352328]: [pid: 352328|app: 0|req: 508/993] 10.222.0.42 () {60 vars in 1144 bytes} [Thu Jul 28 08:54:40 2022] POST /identity/v3/endpoints => generated 325 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 28 08:54:40.982501 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-545a1987-c668-4f8e-bdb7-de38296843ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:54:40.983284 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545a1987-c668-4f8e-bdb7-de38296843ce None admin] REQUEST_METHOD: `GET` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:54:40.983633 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545a1987-c668-4f8e-bdb7-de38296843ce None admin] SCRIPT_NAME: `/identity` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:54:40.983981 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545a1987-c668-4f8e-bdb7-de38296843ce None admin] PATH_INFO: `/v3/projects` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:54:40.984959 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-545a1987-c668-4f8e-bdb7-de38296843ce None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=352329) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:54:40.985327 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-545a1987-c668-4f8e-bdb7-de38296843ce None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:54:40.986920 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-545a1987-c668-4f8e-bdb7-de38296843ce None admin] RBAC: Authorization granted {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:54:41.002754 dv-cinder-851351-1-smb devstack@keystone.service[352329]: [pid: 352329|app: 0|req: 486/994] 10.222.0.42 () {56 vars in 1148 bytes} [Thu Jul 28 08:54:40 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 08:54:41.012141 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300478c4-2ef0-4103-b3cd-6a8438f98b02 None admin] Authenticating user token {{(pid=352328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:54:41.120707 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG dbcounter [-] [352328] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=352328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:54:41.139836 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300478c4-2ef0-4103-b3cd-6a8438f98b02 None admin] Validating token access rules against request {{(pid=352328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:54:41.179607 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d550c76e-249a-41ef-9363-9ec425ba62fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:54:41.180251 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d550c76e-249a-41ef-9363-9ec425ba62fb None admin] REQUEST_METHOD: `GET` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:54:41.180535 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d550c76e-249a-41ef-9363-9ec425ba62fb None admin] SCRIPT_NAME: `/identity` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:54:41.180846 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d550c76e-249a-41ef-9363-9ec425ba62fb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:54:41.181671 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d550c76e-249a-41ef-9363-9ec425ba62fb None admin] RBAC: Adding query filter params (role.id=15fc2297dd8749eab8d518cabaaf36f4, scope.project.id=9cfa053c839a4fedacde7163d907e2a4, user.id=02fa8a25f4a844faac620f7db414011a) {{(pid=352328) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:54:41.181982 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d550c76e-249a-41ef-9363-9ec425ba62fb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:54:41.183482 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d550c76e-249a-41ef-9363-9ec425ba62fb None admin] RBAC: Authorization granted {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:54:41.193902 dv-cinder-851351-1-smb devstack@keystone.service[352328]: [pid: 352328|app: 0|req: 509/995] 10.222.0.42 () {56 vars in 1374 bytes} [Thu Jul 28 08:54:41 2022] GET /identity/v3/role_assignments?user.id=02fa8a25f4a844faac620f7db414011a&scope.project.id=9cfa053c839a4fedacde7163d907e2a4&role.id=15fc2297dd8749eab8d518cabaaf36f4 => generated 608 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:54:41.412147 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0627251d-2fbd-4c37-a678-088f66864548 None None] REQUEST_METHOD: `GET` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:54:41.412368 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0627251d-2fbd-4c37-a678-088f66864548 None None] SCRIPT_NAME: `/identity` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:54:41.412610 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0627251d-2fbd-4c37-a678-088f66864548 None None] PATH_INFO: `/` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:54:41.414087 dv-cinder-851351-1-smb devstack@keystone.service[352329]: [pid: 352329|app: 0|req: 487/996] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 08:54:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 08:54:41.420096 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4cc22e-b90a-4a1c-80d9-eae1b0bda99f None None] REQUEST_METHOD: `POST` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:54:41.420381 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4cc22e-b90a-4a1c-80d9-eae1b0bda99f None None] SCRIPT_NAME: `/identity` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:54:41.420680 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4cc22e-b90a-4a1c-80d9-eae1b0bda99f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:54:41.441284 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.auth.core [None req-ee4cc22e-b90a-4a1c-80d9-eae1b0bda99f None None] MFA Rules not processed for user `d18c063b2377412485965357671e5506`. Rule list: `[]` (Enabled: `True`). {{(pid=352328) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 08:54:41.442519 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.fernet_utils [None req-ee4cc22e-b90a-4a1c-80d9-eae1b0bda99f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=352328) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:54:41.521067 dv-cinder-851351-1-smb devstack@keystone.service[352328]: [pid: 352328|app: 0|req: 510/997] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 08:54:41 2022] POST /identity/v3/auth/tokens => generated 1707 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 08:54:41.543649 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0627251d-2fbd-4c37-a678-088f66864548 None None] Authenticating user token {{(pid=352329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:54:41.653410 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG dbcounter [-] [352329] Writing DB stats keystone:SELECT=100 {{(pid=352329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:54:41.670018 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0627251d-2fbd-4c37-a678-088f66864548 None None] Validating token access rules against request {{(pid=352329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:54:41.708950 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909188a9-1941-442d-bf78-338d65ead0fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:54:41.708950 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909188a9-1941-442d-bf78-338d65ead0fe None admin] REQUEST_METHOD: `GET` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:54:41.708950 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909188a9-1941-442d-bf78-338d65ead0fe None admin] SCRIPT_NAME: `/identity` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:54:41.709404 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909188a9-1941-442d-bf78-338d65ead0fe None admin] PATH_INFO: `/v3/services/compute` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:54:41.710073 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-909188a9-1941-442d-bf78-338d65ead0fe None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:54:41.711692 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-909188a9-1941-442d-bf78-338d65ead0fe None admin] RBAC: Authorization granted {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:54:41.723879 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application [None req-909188a9-1941-442d-bf78-338d65ead0fe None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jul 28 08:54:41.723879 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:54:41.723879 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 28 08:54:41.723879 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 28 08:54:41.723879 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 28 08:54:41.723879 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 28 08:54:41.723879 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 28 08:54:41.723879 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 08:54:41.723879 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 28 08:54:41.723879 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application Jul 28 08:54:41.723879 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 28 08:54:41.723879 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application Jul 28 08:54:41.723879 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:54:41.723879 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:54:41.723879 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:54:41.723879 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:54:41.723879 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:54:41.725376 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:54:41.725376 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:54:41.725376 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:54:41.725376 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:54:41.725376 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:54:41.725376 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:54:41.725376 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 28 08:54:41.725376 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 28 08:54:41.725376 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 28 08:54:41.725376 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 28 08:54:41.725376 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:54:41.725376 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:54:41.725376 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:54:41.725376 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:54:41.725376 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:54:41.725376 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:54:41.726459 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:54:41.726459 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application with Lock( Jul 28 08:54:41.726459 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:54:41.726459 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:54:41.726459 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:54:41.726459 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:54:41.726459 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:54:41.726459 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:54:41.726459 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:54:41.726459 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:54:41.726459 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 28 08:54:41.726459 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 08:54:41.726459 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 28 08:54:41.726459 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application Jul 28 08:54:41.727400 dv-cinder-851351-1-smb devstack@keystone.service[352329]: [pid: 352329|app: 0|req: 488/998] 10.222.0.42 () {56 vars in 1111 bytes} [Thu Jul 28 08:54:41 2022] GET /identity/v3/services/compute => generated 88 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:54:41.734228 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee4cc22e-b90a-4a1c-80d9-eae1b0bda99f None None] Authenticating user token {{(pid=352328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:54:41.827532 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG dbcounter [-] [352328] Writing DB stats keystone:SELECT=100 {{(pid=352328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:54:41.851458 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee4cc22e-b90a-4a1c-80d9-eae1b0bda99f None None] Validating token access rules against request {{(pid=352328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:54:41.891012 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3806f51c-7f4e-475b-91e7-963cfb91a253 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:54:41.891633 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3806f51c-7f4e-475b-91e7-963cfb91a253 None admin] REQUEST_METHOD: `GET` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:54:41.892212 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3806f51c-7f4e-475b-91e7-963cfb91a253 None admin] SCRIPT_NAME: `/identity` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:54:41.892212 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3806f51c-7f4e-475b-91e7-963cfb91a253 None admin] PATH_INFO: `/v3/services` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:54:41.892852 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3806f51c-7f4e-475b-91e7-963cfb91a253 None admin] RBAC: Adding query filter params (name=compute) {{(pid=352328) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:54:41.893150 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3806f51c-7f4e-475b-91e7-963cfb91a253 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:54:41.894546 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3806f51c-7f4e-475b-91e7-963cfb91a253 None admin] RBAC: Authorization granted {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:54:41.904006 dv-cinder-851351-1-smb devstack@keystone.service[352328]: [pid: 352328|app: 0|req: 511/999] 10.222.0.42 () {56 vars in 1112 bytes} [Thu Jul 28 08:54:41 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 08:54:41.909458 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909188a9-1941-442d-bf78-338d65ead0fe None admin] Authenticating user token {{(pid=352329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:54:42.037514 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909188a9-1941-442d-bf78-338d65ead0fe None admin] Validating token access rules against request {{(pid=352329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:54:42.077496 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91354e85-5662-400e-aecd-c09a40eb3ee9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:54:42.078211 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91354e85-5662-400e-aecd-c09a40eb3ee9 None admin] REQUEST_METHOD: `GET` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:54:42.078500 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91354e85-5662-400e-aecd-c09a40eb3ee9 None admin] SCRIPT_NAME: `/identity` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:54:42.078774 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91354e85-5662-400e-aecd-c09a40eb3ee9 None admin] PATH_INFO: `/v3/services` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:54:42.079941 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91354e85-5662-400e-aecd-c09a40eb3ee9 None admin] RBAC: Adding query filter params (type=compute) {{(pid=352329) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:54:42.080256 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91354e85-5662-400e-aecd-c09a40eb3ee9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:54:42.081729 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91354e85-5662-400e-aecd-c09a40eb3ee9 None admin] RBAC: Authorization granted {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:54:42.092050 dv-cinder-851351-1-smb devstack@keystone.service[352329]: [pid: 352329|app: 0|req: 489/1000] 10.222.0.42 () {56 vars in 1112 bytes} [Thu Jul 28 08:54:41 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:54:42.100701 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3806f51c-7f4e-475b-91e7-963cfb91a253 None admin] Authenticating user token {{(pid=352328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:54:42.215456 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3806f51c-7f4e-475b-91e7-963cfb91a253 None admin] Validating token access rules against request {{(pid=352328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:54:42.252248 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2bf165-846d-4859-a81f-2ebbf5acbca2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:54:42.252920 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2bf165-846d-4859-a81f-2ebbf5acbca2 None admin] REQUEST_METHOD: `GET` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:54:42.253203 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2bf165-846d-4859-a81f-2ebbf5acbca2 None admin] SCRIPT_NAME: `/identity` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:54:42.253476 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2bf165-846d-4859-a81f-2ebbf5acbca2 None admin] PATH_INFO: `/v3/endpoints` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:54:42.254251 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac2bf165-846d-4859-a81f-2ebbf5acbca2 None admin] RBAC: Adding query filter params (interface=public, service_id=6bfd19a32ae8414f9cdbeb07de94f5f6, region_id=RegionOne) {{(pid=352328) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:54:42.254560 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac2bf165-846d-4859-a81f-2ebbf5acbca2 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:54:42.255947 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac2bf165-846d-4859-a81f-2ebbf5acbca2 None admin] RBAC: Authorization granted {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:54:42.263217 dv-cinder-851351-1-smb devstack@keystone.service[352328]: [pid: 352328|app: 0|req: 512/1001] 10.222.0.42 () {56 vars in 1251 bytes} [Thu Jul 28 08:54:42 2022] GET /identity/v3/endpoints?service_id=6bfd19a32ae8414f9cdbeb07de94f5f6&interface=public®ion_id=RegionOne => generated 194 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:54:42.269031 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91354e85-5662-400e-aecd-c09a40eb3ee9 None admin] Authenticating user token {{(pid=352329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:54:42.289105 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG dbcounter [-] [352329] Writing DB stats keystone:SELECT=100 {{(pid=352329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:54:42.381843 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91354e85-5662-400e-aecd-c09a40eb3ee9 None admin] Validating token access rules against request {{(pid=352329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:54:42.420714 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f415dc84-05af-4516-a0ba-cea41b286156 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:54:42.421375 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f415dc84-05af-4516-a0ba-cea41b286156 None admin] REQUEST_METHOD: `GET` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:54:42.421684 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f415dc84-05af-4516-a0ba-cea41b286156 None admin] SCRIPT_NAME: `/identity` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:54:42.422001 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f415dc84-05af-4516-a0ba-cea41b286156 None admin] PATH_INFO: `/v3/services` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:54:42.422684 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f415dc84-05af-4516-a0ba-cea41b286156 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:54:42.424143 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f415dc84-05af-4516-a0ba-cea41b286156 None admin] RBAC: Authorization granted {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:54:42.440712 dv-cinder-851351-1-smb devstack@keystone.service[352329]: [pid: 352329|app: 0|req: 490/1002] 10.222.0.42 () {56 vars in 1087 bytes} [Thu Jul 28 08:54:42 2022] GET /identity/v3/services => generated 1727 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 08:54:43.037120 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb61043-3e7a-47f5-972c-231717d6266d None None] REQUEST_METHOD: `GET` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:54:43.037668 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb61043-3e7a-47f5-972c-231717d6266d None None] SCRIPT_NAME: `/identity` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:54:43.037668 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb61043-3e7a-47f5-972c-231717d6266d None None] PATH_INFO: `/` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:54:43.039188 dv-cinder-851351-1-smb devstack@keystone.service[352328]: [pid: 352328|app: 0|req: 513/1003] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 08:54:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 08:54:43.046381 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4bb331-8876-484c-b813-d7458de5136e None None] REQUEST_METHOD: `POST` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:54:43.046991 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4bb331-8876-484c-b813-d7458de5136e None None] SCRIPT_NAME: `/identity` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:54:43.046991 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4bb331-8876-484c-b813-d7458de5136e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:54:43.065887 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.auth.core [None req-8e4bb331-8876-484c-b813-d7458de5136e None None] MFA Rules not processed for user `d18c063b2377412485965357671e5506`. Rule list: `[]` (Enabled: `True`). {{(pid=352329) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 08:54:43.067079 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.fernet_utils [None req-8e4bb331-8876-484c-b813-d7458de5136e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=352329) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:54:43.136733 dv-cinder-851351-1-smb devstack@keystone.service[352329]: [pid: 352329|app: 0|req: 491/1004] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 08:54:43 2022] POST /identity/v3/auth/tokens => generated 1707 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 08:54:43.159346 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb61043-3e7a-47f5-972c-231717d6266d None None] Authenticating user token {{(pid=352328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:54:43.168696 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG dbcounter [-] [352328] Writing DB stats keystone:SELECT=100 {{(pid=352328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:54:43.262489 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a29a81-5970-46e1-bf55-ae1a5a995a38 None None] REQUEST_METHOD: `GET` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:54:43.263078 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a29a81-5970-46e1-bf55-ae1a5a995a38 None None] SCRIPT_NAME: `/identity` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:54:43.263545 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a29a81-5970-46e1-bf55-ae1a5a995a38 None None] PATH_INFO: `/` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:54:43.265464 dv-cinder-851351-1-smb devstack@keystone.service[352329]: [pid: 352329|app: 0|req: 492/1005] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 08:54:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 28 08:54:43.270272 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1484f3-81b1-428b-a380-bfb27a382a27 None None] REQUEST_METHOD: `POST` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:54:43.270561 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1484f3-81b1-428b-a380-bfb27a382a27 None None] SCRIPT_NAME: `/identity` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:54:43.270835 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1484f3-81b1-428b-a380-bfb27a382a27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:54:43.277429 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb61043-3e7a-47f5-972c-231717d6266d None None] Validating token access rules against request {{(pid=352328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:54:43.289389 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.auth.core [None req-6c1484f3-81b1-428b-a380-bfb27a382a27 None None] MFA Rules not processed for user `d18c063b2377412485965357671e5506`. Rule list: `[]` (Enabled: `True`). {{(pid=352329) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 08:54:43.290619 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.fernet_utils [None req-6c1484f3-81b1-428b-a380-bfb27a382a27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=352329) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:54:43.298521 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG dbcounter [-] [352329] Writing DB stats keystone:SELECT=100 {{(pid=352329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:54:43.331066 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d55d994-8be7-4e07-9134-8a59890975d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:54:43.332055 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d55d994-8be7-4e07-9134-8a59890975d7 None admin] REQUEST_METHOD: `GET` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:54:43.332339 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d55d994-8be7-4e07-9134-8a59890975d7 None admin] SCRIPT_NAME: `/identity` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:54:43.332741 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d55d994-8be7-4e07-9134-8a59890975d7 None admin] PATH_INFO: `/v3/domains/default` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:54:43.333950 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d55d994-8be7-4e07-9134-8a59890975d7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:54:43.335405 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d55d994-8be7-4e07-9134-8a59890975d7 None admin] RBAC: Authorization granted {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:54:43.342740 dv-cinder-851351-1-smb devstack@keystone.service[352328]: [pid: 352328|app: 0|req: 514/1006] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 08:54:43 2022] GET /identity/v3/domains/default => generated 199 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:54:43.343797 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d55d994-8be7-4e07-9134-8a59890975d7 None admin] Authenticating user token {{(pid=352328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:54:43.384412 dv-cinder-851351-1-smb devstack@keystone.service[352329]: [pid: 352329|app: 0|req: 493/1007] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 08:54:43 2022] POST /identity/v3/auth/tokens => generated 1707 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 28 08:54:43.416853 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c1484f3-81b1-428b-a380-bfb27a382a27 None None] Authenticating user token {{(pid=352329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:54:43.466614 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG dbcounter [-] [352328] Writing DB stats keystone:SELECT=100 {{(pid=352328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:54:43.505031 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d55d994-8be7-4e07-9134-8a59890975d7 None admin] Validating token access rules against request {{(pid=352328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:54:43.544397 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce4fe74-0de8-4fe1-acf4-a75fd00dc76b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:54:43.544992 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce4fe74-0de8-4fe1-acf4-a75fd00dc76b None admin] REQUEST_METHOD: `POST` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:54:43.545216 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c1484f3-81b1-428b-a380-bfb27a382a27 None None] Validating token access rules against request {{(pid=352329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:54:43.545346 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce4fe74-0de8-4fe1-acf4-a75fd00dc76b None admin] SCRIPT_NAME: `/identity` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:54:43.545611 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce4fe74-0de8-4fe1-acf4-a75fd00dc76b None admin] PATH_INFO: `/v3/projects` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:54:43.546367 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ce4fe74-0de8-4fe1-acf4-a75fd00dc76b None admin] RBAC: Authorizing `identity:create_project()` {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:54:43.547841 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ce4fe74-0de8-4fe1-acf4-a75fd00dc76b None admin] RBAC: Authorization granted {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:54:43.580542 dv-cinder-851351-1-smb devstack@keystone.service[352328]: [pid: 352328|app: 0|req: 515/1008] 10.222.0.42 () {60 vars in 1141 bytes} [Thu Jul 28 08:54:43 2022] POST /identity/v3/projects => generated 311 bytes in 237 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 08:54:43.595049 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b55f6728-fefa-44fa-afb1-9123626e798b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:54:43.595749 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55f6728-fefa-44fa-afb1-9123626e798b None admin] REQUEST_METHOD: `GET` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:54:43.596090 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55f6728-fefa-44fa-afb1-9123626e798b None admin] SCRIPT_NAME: `/identity` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:54:43.596373 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55f6728-fefa-44fa-afb1-9123626e798b None admin] PATH_INFO: `/v3/services/image` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:54:43.597076 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b55f6728-fefa-44fa-afb1-9123626e798b None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:54:43.598577 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b55f6728-fefa-44fa-afb1-9123626e798b None admin] RBAC: Authorization granted {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:54:43.610888 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application [None req-b55f6728-fefa-44fa-afb1-9123626e798b None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jul 28 08:54:43.610888 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:54:43.610888 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 28 08:54:43.610888 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 28 08:54:43.610888 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 28 08:54:43.610888 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 28 08:54:43.610888 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 28 08:54:43.610888 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 08:54:43.610888 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 28 08:54:43.610888 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application Jul 28 08:54:43.610888 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 28 08:54:43.610888 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application Jul 28 08:54:43.610888 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:54:43.610888 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:54:43.610888 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:54:43.610888 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:54:43.610888 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:54:43.617862 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:54:43.617862 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:54:43.617862 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:54:43.617862 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:54:43.617862 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:54:43.617862 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:54:43.617862 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 28 08:54:43.617862 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 28 08:54:43.617862 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 28 08:54:43.617862 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 28 08:54:43.617862 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:54:43.617862 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:54:43.617862 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:54:43.617862 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:54:43.617862 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:54:43.617862 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:54:43.619200 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:54:43.619200 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application with Lock( Jul 28 08:54:43.619200 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:54:43.619200 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:54:43.619200 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:54:43.619200 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:54:43.619200 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:54:43.619200 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:54:43.619200 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:54:43.619200 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:54:43.619200 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 28 08:54:43.619200 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 08:54:43.619200 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 28 08:54:43.619200 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application Jul 28 08:54:43.619200 dv-cinder-851351-1-smb devstack@keystone.service[352329]: [pid: 352329|app: 0|req: 494/1009] 10.222.0.42 () {56 vars in 1105 bytes} [Thu Jul 28 08:54:43 2022] GET /identity/v3/services/image => generated 86 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 08:54:43.621746 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce4fe74-0de8-4fe1-acf4-a75fd00dc76b None admin] Authenticating user token {{(pid=352328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:54:43.742872 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce4fe74-0de8-4fe1-acf4-a75fd00dc76b None admin] Validating token access rules against request {{(pid=352328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:54:43.771049 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG dbcounter [-] [352328] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=352328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:54:43.782253 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2808d1b-73ab-46ef-b02f-1c79e17f4cb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:54:43.783236 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2808d1b-73ab-46ef-b02f-1c79e17f4cb8 None admin] REQUEST_METHOD: `GET` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:54:43.783518 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2808d1b-73ab-46ef-b02f-1c79e17f4cb8 None admin] SCRIPT_NAME: `/identity` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:54:43.783797 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2808d1b-73ab-46ef-b02f-1c79e17f4cb8 None admin] PATH_INFO: `/v3/services` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:54:43.784503 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2808d1b-73ab-46ef-b02f-1c79e17f4cb8 None admin] RBAC: Adding query filter params (name=image) {{(pid=352328) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:54:43.784856 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2808d1b-73ab-46ef-b02f-1c79e17f4cb8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:54:43.786259 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2808d1b-73ab-46ef-b02f-1c79e17f4cb8 None admin] RBAC: Authorization granted {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:54:43.791724 dv-cinder-851351-1-smb devstack@keystone.service[352328]: [pid: 352328|app: 0|req: 516/1010] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 08:54:43 2022] GET /identity/v3/services?name=image => generated 122 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:54:43.798127 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b55f6728-fefa-44fa-afb1-9123626e798b None admin] Authenticating user token {{(pid=352329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:54:43.802861 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG dbcounter [-] [352329] Writing DB stats keystone:SELECT=100 {{(pid=352329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:54:43.914217 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b55f6728-fefa-44fa-afb1-9123626e798b None admin] Validating token access rules against request {{(pid=352329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:54:43.950030 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c86a60c1-76e0-4129-93b0-5cef400b146e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:54:43.950678 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86a60c1-76e0-4129-93b0-5cef400b146e None admin] REQUEST_METHOD: `GET` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:54:43.950967 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86a60c1-76e0-4129-93b0-5cef400b146e None admin] SCRIPT_NAME: `/identity` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:54:43.951248 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86a60c1-76e0-4129-93b0-5cef400b146e None admin] PATH_INFO: `/v3/services` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:54:43.951943 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c86a60c1-76e0-4129-93b0-5cef400b146e None admin] RBAC: Adding query filter params (type=image) {{(pid=352329) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:54:43.952274 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c86a60c1-76e0-4129-93b0-5cef400b146e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:54:43.953822 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c86a60c1-76e0-4129-93b0-5cef400b146e None admin] RBAC: Authorization granted {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:54:43.959568 dv-cinder-851351-1-smb devstack@keystone.service[352329]: [pid: 352329|app: 0|req: 495/1011] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 08:54:43 2022] GET /identity/v3/services?type=image => generated 122 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:54:44.523905 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38dff601-82b7-460c-8514-b9751007958c None None] REQUEST_METHOD: `GET` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:54:44.524487 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38dff601-82b7-460c-8514-b9751007958c None None] SCRIPT_NAME: `/identity` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:54:44.524487 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38dff601-82b7-460c-8514-b9751007958c None None] PATH_INFO: `/` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:54:44.526138 dv-cinder-851351-1-smb devstack@keystone.service[352328]: [pid: 352328|app: 0|req: 517/1012] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 08:54:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 08:54:44.531589 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed46d14-9b79-47e9-be47-7f9f49f8803a None None] REQUEST_METHOD: `POST` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:54:44.532079 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed46d14-9b79-47e9-be47-7f9f49f8803a None None] SCRIPT_NAME: `/identity` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:54:44.532182 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed46d14-9b79-47e9-be47-7f9f49f8803a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:54:44.551351 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.auth.core [None req-4ed46d14-9b79-47e9-be47-7f9f49f8803a None None] MFA Rules not processed for user `d18c063b2377412485965357671e5506`. Rule list: `[]` (Enabled: `True`). {{(pid=352329) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 08:54:44.552561 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.fernet_utils [None req-4ed46d14-9b79-47e9-be47-7f9f49f8803a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=352329) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:54:44.620398 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG dbcounter [-] [352329] Writing DB stats keystone:SELECT=100 {{(pid=352329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:54:44.632970 dv-cinder-851351-1-smb devstack@keystone.service[352329]: [pid: 352329|app: 0|req: 496/1013] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 08:54:44 2022] POST /identity/v3/auth/tokens => generated 1707 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 08:54:44.650541 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38dff601-82b7-460c-8514-b9751007958c None None] Authenticating user token {{(pid=352328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:54:44.765585 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38dff601-82b7-460c-8514-b9751007958c None None] Validating token access rules against request {{(pid=352328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:54:44.800350 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58164ec2-ad8b-476d-ab91-98968a86202a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:54:44.800950 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58164ec2-ad8b-476d-ab91-98968a86202a None admin] REQUEST_METHOD: `GET` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:54:44.801233 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58164ec2-ad8b-476d-ab91-98968a86202a None admin] SCRIPT_NAME: `/identity` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:54:44.801513 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58164ec2-ad8b-476d-ab91-98968a86202a None admin] PATH_INFO: `/v3/services/compute` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:54:44.802154 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58164ec2-ad8b-476d-ab91-98968a86202a None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:54:44.803632 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58164ec2-ad8b-476d-ab91-98968a86202a None admin] RBAC: Authorization granted {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:54:44.812996 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application [None req-58164ec2-ad8b-476d-ab91-98968a86202a None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jul 28 08:54:44.812996 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:54:44.812996 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 28 08:54:44.812996 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 28 08:54:44.812996 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 28 08:54:44.812996 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 28 08:54:44.812996 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 28 08:54:44.812996 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 08:54:44.812996 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 28 08:54:44.812996 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application Jul 28 08:54:44.812996 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 28 08:54:44.812996 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application Jul 28 08:54:44.812996 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:54:44.812996 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:54:44.812996 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:54:44.812996 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:54:44.812996 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:54:44.819346 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:54:44.819346 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:54:44.819346 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:54:44.819346 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:54:44.819346 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:54:44.819346 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:54:44.819346 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 28 08:54:44.819346 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 28 08:54:44.819346 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 28 08:54:44.819346 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 28 08:54:44.819346 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:54:44.819346 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:54:44.819346 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:54:44.819346 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:54:44.819346 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:54:44.819346 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:54:44.820449 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:54:44.820449 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application with Lock( Jul 28 08:54:44.820449 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:54:44.820449 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:54:44.820449 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:54:44.820449 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:54:44.820449 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:54:44.820449 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:54:44.820449 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:54:44.820449 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:54:44.820449 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 28 08:54:44.820449 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 08:54:44.820449 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 28 08:54:44.820449 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application Jul 28 08:54:44.820449 dv-cinder-851351-1-smb devstack@keystone.service[352328]: [pid: 352328|app: 0|req: 518/1014] 10.222.0.42 () {56 vars in 1111 bytes} [Thu Jul 28 08:54:44 2022] GET /identity/v3/services/compute => generated 88 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:54:44.821485 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed46d14-9b79-47e9-be47-7f9f49f8803a None None] Authenticating user token {{(pid=352329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:54:44.928424 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed46d14-9b79-47e9-be47-7f9f49f8803a None None] Validating token access rules against request {{(pid=352329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:54:44.964587 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f62d824-6db9-41b6-815d-60a7e7633415 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:54:44.965261 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f62d824-6db9-41b6-815d-60a7e7633415 None admin] REQUEST_METHOD: `GET` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:54:44.965545 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f62d824-6db9-41b6-815d-60a7e7633415 None admin] SCRIPT_NAME: `/identity` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:54:44.965825 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f62d824-6db9-41b6-815d-60a7e7633415 None admin] PATH_INFO: `/v3/services` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:54:44.966522 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f62d824-6db9-41b6-815d-60a7e7633415 None admin] RBAC: Adding query filter params (name=compute) {{(pid=352329) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:54:44.966833 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f62d824-6db9-41b6-815d-60a7e7633415 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:54:44.968235 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f62d824-6db9-41b6-815d-60a7e7633415 None admin] RBAC: Authorization granted {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:54:44.973510 dv-cinder-851351-1-smb devstack@keystone.service[352329]: [pid: 352329|app: 0|req: 497/1015] 10.222.0.42 () {56 vars in 1112 bytes} [Thu Jul 28 08:54:44 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 08:54:44.979279 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58164ec2-ad8b-476d-ab91-98968a86202a None admin] Authenticating user token {{(pid=352328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:54:45.056081 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG dbcounter [-] [352328] Writing DB stats keystone:SELECT=100 {{(pid=352328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:54:45.112295 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58164ec2-ad8b-476d-ab91-98968a86202a None admin] Validating token access rules against request {{(pid=352328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:54:45.162441 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574345a6-c5cf-4682-9794-8afd43d57de3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:54:45.168690 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574345a6-c5cf-4682-9794-8afd43d57de3 None admin] REQUEST_METHOD: `GET` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:54:45.168690 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574345a6-c5cf-4682-9794-8afd43d57de3 None admin] SCRIPT_NAME: `/identity` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:54:45.168690 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574345a6-c5cf-4682-9794-8afd43d57de3 None admin] PATH_INFO: `/v3/services` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:54:45.168690 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-574345a6-c5cf-4682-9794-8afd43d57de3 None admin] RBAC: Adding query filter params (type=compute) {{(pid=352328) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:54:45.168690 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-574345a6-c5cf-4682-9794-8afd43d57de3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:54:45.168690 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-574345a6-c5cf-4682-9794-8afd43d57de3 None admin] RBAC: Authorization granted {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:54:45.175811 dv-cinder-851351-1-smb devstack@keystone.service[352328]: [pid: 352328|app: 0|req: 519/1016] 10.222.0.42 () {56 vars in 1112 bytes} [Thu Jul 28 08:54:44 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:54:45.184699 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f62d824-6db9-41b6-815d-60a7e7633415 None admin] Authenticating user token {{(pid=352329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:54:45.268704 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG dbcounter [-] [352329] Writing DB stats keystone:SELECT=100 {{(pid=352329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:54:45.320824 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f62d824-6db9-41b6-815d-60a7e7633415 None admin] Validating token access rules against request {{(pid=352329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:54:45.363331 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58db88a1-4ea5-43bb-81fc-1eb0db4bce06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:54:45.364013 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58db88a1-4ea5-43bb-81fc-1eb0db4bce06 None admin] REQUEST_METHOD: `POST` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:54:45.364299 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58db88a1-4ea5-43bb-81fc-1eb0db4bce06 None admin] SCRIPT_NAME: `/identity` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:54:45.368683 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58db88a1-4ea5-43bb-81fc-1eb0db4bce06 None admin] PATH_INFO: `/v3/endpoints` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:54:45.368683 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58db88a1-4ea5-43bb-81fc-1eb0db4bce06 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:54:45.368683 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58db88a1-4ea5-43bb-81fc-1eb0db4bce06 None admin] RBAC: Authorization granted {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:54:45.395091 dv-cinder-851351-1-smb devstack@keystone.service[352329]: [pid: 352329|app: 0|req: 498/1017] 10.222.0.42 () {60 vars in 1144 bytes} [Thu Jul 28 08:54:45 2022] POST /identity/v3/endpoints => generated 334 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 08:54:45.667855 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8944055b-f0e2-4ca5-b413-8ae171280558 None None] REQUEST_METHOD: `GET` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:54:45.668486 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8944055b-f0e2-4ca5-b413-8ae171280558 None None] SCRIPT_NAME: `/identity` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:54:45.668486 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8944055b-f0e2-4ca5-b413-8ae171280558 None None] PATH_INFO: `/` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:54:45.669823 dv-cinder-851351-1-smb devstack@keystone.service[352328]: [pid: 352328|app: 0|req: 520/1018] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 08:54:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 08:54:45.675892 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580bec72-6f48-440f-8dbe-68b540950e70 None None] REQUEST_METHOD: `POST` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:54:45.676420 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580bec72-6f48-440f-8dbe-68b540950e70 None None] SCRIPT_NAME: `/identity` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:54:45.676420 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580bec72-6f48-440f-8dbe-68b540950e70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:54:45.697300 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.auth.core [None req-580bec72-6f48-440f-8dbe-68b540950e70 None None] MFA Rules not processed for user `d18c063b2377412485965357671e5506`. Rule list: `[]` (Enabled: `True`). {{(pid=352329) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 08:54:45.698549 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.fernet_utils [None req-580bec72-6f48-440f-8dbe-68b540950e70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=352329) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:54:45.784779 dv-cinder-851351-1-smb devstack@keystone.service[352329]: [pid: 352329|app: 0|req: 499/1019] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 08:54:45 2022] POST /identity/v3/auth/tokens => generated 1863 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 08:54:45.804397 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8944055b-f0e2-4ca5-b413-8ae171280558 None None] Authenticating user token {{(pid=352328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:54:45.912828 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8944055b-f0e2-4ca5-b413-8ae171280558 None None] Validating token access rules against request {{(pid=352328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:54:45.931651 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG dbcounter [-] [352328] Writing DB stats keystone:SELECT=100 {{(pid=352328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:54:45.956221 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1906ff6b-b30c-41c3-b577-dc7a5c03ab59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:54:45.956930 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1906ff6b-b30c-41c3-b577-dc7a5c03ab59 None admin] REQUEST_METHOD: `GET` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:54:45.957212 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1906ff6b-b30c-41c3-b577-dc7a5c03ab59 None admin] SCRIPT_NAME: `/identity` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:54:45.957487 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1906ff6b-b30c-41c3-b577-dc7a5c03ab59 None admin] PATH_INFO: `/v3/domains/default` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:54:45.958800 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1906ff6b-b30c-41c3-b577-dc7a5c03ab59 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:54:45.960257 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1906ff6b-b30c-41c3-b577-dc7a5c03ab59 None admin] RBAC: Authorization granted {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:54:45.964739 dv-cinder-851351-1-smb devstack@keystone.service[352328]: [pid: 352328|app: 0|req: 521/1020] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 08:54:45 2022] GET /identity/v3/domains/default => generated 199 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:54:45.968519 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580bec72-6f48-440f-8dbe-68b540950e70 None None] Authenticating user token {{(pid=352329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:54:46.024213 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG dbcounter [-] [352329] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=352329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:54:46.063087 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9eb520a-6fd3-4fcb-9d86-2199058d3728 None None] REQUEST_METHOD: `GET` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:54:46.063368 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9eb520a-6fd3-4fcb-9d86-2199058d3728 None None] SCRIPT_NAME: `/identity` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:54:46.063651 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9eb520a-6fd3-4fcb-9d86-2199058d3728 None None] PATH_INFO: `/` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:54:46.065320 dv-cinder-851351-1-smb devstack@keystone.service[352328]: [pid: 352328|app: 0|req: 522/1021] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 08:54:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 28 08:54:46.070653 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb040eb8-cdc7-4f2e-80c8-2987f90d6050 None None] REQUEST_METHOD: `POST` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:54:46.070949 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb040eb8-cdc7-4f2e-80c8-2987f90d6050 None None] SCRIPT_NAME: `/identity` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:54:46.071221 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb040eb8-cdc7-4f2e-80c8-2987f90d6050 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:54:46.090661 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.auth.core [None req-bb040eb8-cdc7-4f2e-80c8-2987f90d6050 None None] MFA Rules not processed for user `d18c063b2377412485965357671e5506`. Rule list: `[]` (Enabled: `True`). {{(pid=352328) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 08:54:46.091898 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.fernet_utils [None req-bb040eb8-cdc7-4f2e-80c8-2987f90d6050 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=352328) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:54:46.094810 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580bec72-6f48-440f-8dbe-68b540950e70 None None] Validating token access rules against request {{(pid=352329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:54:46.131119 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b40ec1f4-6831-4928-a1b9-ae6078623f29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:54:46.131764 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40ec1f4-6831-4928-a1b9-ae6078623f29 None admin] REQUEST_METHOD: `POST` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:54:46.132045 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40ec1f4-6831-4928-a1b9-ae6078623f29 None admin] SCRIPT_NAME: `/identity` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:54:46.132320 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40ec1f4-6831-4928-a1b9-ae6078623f29 None admin] PATH_INFO: `/v3/users` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:54:46.133064 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b40ec1f4-6831-4928-a1b9-ae6078623f29 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:54:46.134529 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b40ec1f4-6831-4928-a1b9-ae6078623f29 None admin] RBAC: Authorization granted {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:54:46.163870 dv-cinder-851351-1-smb devstack@keystone.service[352329]: [pid: 352329|app: 0|req: 500/1022] 10.222.0.42 () {60 vars in 1132 bytes} [Thu Jul 28 08:54:45 2022] POST /identity/v3/users => generated 285 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 28 08:54:46.189443 dv-cinder-851351-1-smb devstack@keystone.service[352328]: [pid: 352328|app: 0|req: 523/1023] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 08:54:46 2022] POST /identity/v3/auth/tokens => generated 1863 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 28 08:54:46.213677 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b40ec1f4-6831-4928-a1b9-ae6078623f29 None admin] Authenticating user token {{(pid=352329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:54:46.335333 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG dbcounter [-] [352329] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=352329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:54:46.339077 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b40ec1f4-6831-4928-a1b9-ae6078623f29 None admin] Validating token access rules against request {{(pid=352329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:54:46.378451 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de05812-5d81-4b2b-8bd8-7c74786cbe85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:54:46.379099 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de05812-5d81-4b2b-8bd8-7c74786cbe85 None admin] REQUEST_METHOD: `POST` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:54:46.379385 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de05812-5d81-4b2b-8bd8-7c74786cbe85 None admin] SCRIPT_NAME: `/identity` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:54:46.379665 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de05812-5d81-4b2b-8bd8-7c74786cbe85 None admin] PATH_INFO: `/v3/services` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:54:46.380404 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de05812-5d81-4b2b-8bd8-7c74786cbe85 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:54:46.381901 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de05812-5d81-4b2b-8bd8-7c74786cbe85 None admin] RBAC: Authorization granted {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:54:46.398725 dv-cinder-851351-1-smb devstack@keystone.service[352329]: [pid: 352329|app: 0|req: 501/1024] 10.222.0.42 () {60 vars in 1141 bytes} [Thu Jul 28 08:54:46 2022] POST /identity/v3/services => generated 242 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 08:54:47.663378 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d164875e-69e9-494a-87a5-d6e9fd81755a None None] REQUEST_METHOD: `GET` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:54:47.664000 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d164875e-69e9-494a-87a5-d6e9fd81755a None None] SCRIPT_NAME: `/identity` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:54:47.664000 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d164875e-69e9-494a-87a5-d6e9fd81755a None None] PATH_INFO: `/` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:54:47.665332 dv-cinder-851351-1-smb devstack@keystone.service[352328]: [pid: 352328|app: 0|req: 524/1025] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 08:54:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 08:54:47.670888 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141abc5f-250d-45b3-8029-e628e74eefc0 None None] REQUEST_METHOD: `POST` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:54:47.671448 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141abc5f-250d-45b3-8029-e628e74eefc0 None None] SCRIPT_NAME: `/identity` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:54:47.671448 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141abc5f-250d-45b3-8029-e628e74eefc0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:54:47.690676 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.auth.core [None req-141abc5f-250d-45b3-8029-e628e74eefc0 None None] MFA Rules not processed for user `d18c063b2377412485965357671e5506`. Rule list: `[]` (Enabled: `True`). {{(pid=352329) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 08:54:47.691888 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.fernet_utils [None req-141abc5f-250d-45b3-8029-e628e74eefc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=352329) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:54:47.767314 dv-cinder-851351-1-smb devstack@keystone.service[352329]: [pid: 352329|app: 0|req: 502/1026] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 08:54:47 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 08:54:47.790451 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d164875e-69e9-494a-87a5-d6e9fd81755a None None] Authenticating user token {{(pid=352328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:54:47.901051 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d164875e-69e9-494a-87a5-d6e9fd81755a None None] Validating token access rules against request {{(pid=352328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:54:47.918686 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG dbcounter [-] [352328] Writing DB stats keystone:SELECT=100 {{(pid=352328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:54:47.939465 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-893f4104-7d4a-4a0d-ac16-c9279129a1b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:54:47.940122 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893f4104-7d4a-4a0d-ac16-c9279129a1b0 None admin] REQUEST_METHOD: `GET` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:54:47.940402 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893f4104-7d4a-4a0d-ac16-c9279129a1b0 None admin] SCRIPT_NAME: `/identity` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:54:47.940698 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893f4104-7d4a-4a0d-ac16-c9279129a1b0 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:54:47.951615 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-893f4104-7d4a-4a0d-ac16-c9279129a1b0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 08:54:47.956999 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application [None req-893f4104-7d4a-4a0d-ac16-c9279129a1b0 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 28 08:54:47.956999 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:54:47.956999 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:54:47.956999 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:54:47.956999 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:54:47.956999 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:54:47.956999 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:54:47.956999 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:54:47.956999 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:54:47.956999 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:54:47.956999 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:54:47.956999 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:54:47.956999 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 08:54:47.956999 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 08:54:47.956999 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 08:54:47.956999 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 08:54:47.962998 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 08:54:47.962998 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 08:54:47.962998 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 08:54:47.962998 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 08:54:47.962998 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:54:47.962998 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:54:47.962998 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:54:47.962998 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:54:47.962998 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:54:47.962998 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:54:47.962998 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:54:47.962998 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application with Lock( Jul 28 08:54:47.962998 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:54:47.962998 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:54:47.962998 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:54:47.962998 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:54:47.964181 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:54:47.964181 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:54:47.964181 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:54:47.964181 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:54:47.964181 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 08:54:47.964181 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 08:54:47.964181 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 08:54:47.964181 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 08:54:47.964181 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 08:54:47.964181 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 08:54:47.964181 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 28 08:54:47.964181 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application Jul 28 08:54:47.964181 dv-cinder-851351-1-smb devstack@keystone.service[352328]: [pid: 352328|app: 0|req: 525/1027] 10.222.0.42 () {56 vars in 1120 bytes} [Thu Jul 28 08:54:47 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:54:47.967379 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-141abc5f-250d-45b3-8029-e628e74eefc0 None None] Authenticating user token {{(pid=352329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:54:48.066160 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG dbcounter [-] [352329] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=352329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:54:48.084148 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-141abc5f-250d-45b3-8029-e628e74eefc0 None None] Validating token access rules against request {{(pid=352329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:54:48.121054 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-222b2a22-1be6-4b6c-b1b7-f340d8abd281 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:54:48.121700 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222b2a22-1be6-4b6c-b1b7-f340d8abd281 None admin] REQUEST_METHOD: `GET` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:54:48.121979 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222b2a22-1be6-4b6c-b1b7-f340d8abd281 None admin] SCRIPT_NAME: `/identity` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:54:48.122262 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222b2a22-1be6-4b6c-b1b7-f340d8abd281 None admin] PATH_INFO: `/v3/roles` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:54:48.122997 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-222b2a22-1be6-4b6c-b1b7-f340d8abd281 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=352329) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:54:48.123316 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-222b2a22-1be6-4b6c-b1b7-f340d8abd281 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:54:48.124818 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-222b2a22-1be6-4b6c-b1b7-f340d8abd281 None admin] RBAC: Authorization granted {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:54:48.133886 dv-cinder-851351-1-smb devstack@keystone.service[352329]: [pid: 352329|app: 0|req: 503/1028] 10.222.0.42 () {56 vars in 1115 bytes} [Thu Jul 28 08:54:47 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:54:48.139594 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-893f4104-7d4a-4a0d-ac16-c9279129a1b0 None admin] Authenticating user token {{(pid=352328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:54:48.244101 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-893f4104-7d4a-4a0d-ac16-c9279129a1b0 None admin] Validating token access rules against request {{(pid=352328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:54:48.277341 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aeb7b96-e12e-46fc-be40-efc83c358b98 None None] REQUEST_METHOD: `GET` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:54:48.277600 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aeb7b96-e12e-46fc-be40-efc83c358b98 None None] SCRIPT_NAME: `/identity` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:54:48.277877 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aeb7b96-e12e-46fc-be40-efc83c358b98 None None] PATH_INFO: `/` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:54:48.279518 dv-cinder-851351-1-smb devstack@keystone.service[352329]: [pid: 352329|app: 0|req: 504/1029] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 08:54:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 08:54:48.280458 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044de1fe-fe52-4353-9416-72e8dc936840 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:54:48.281208 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044de1fe-fe52-4353-9416-72e8dc936840 None admin] REQUEST_METHOD: `GET` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:54:48.281492 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044de1fe-fe52-4353-9416-72e8dc936840 None admin] SCRIPT_NAME: `/identity` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:54:48.281835 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044de1fe-fe52-4353-9416-72e8dc936840 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:54:48.285175 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45d50b2-e00d-4823-9878-3b14ae2e2091 None None] REQUEST_METHOD: `POST` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:54:48.285466 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45d50b2-e00d-4823-9878-3b14ae2e2091 None None] SCRIPT_NAME: `/identity` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:54:48.285768 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45d50b2-e00d-4823-9878-3b14ae2e2091 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:54:48.293175 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-044de1fe-fe52-4353-9416-72e8dc936840 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:54:48.294659 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-044de1fe-fe52-4353-9416-72e8dc936840 None admin] RBAC: Authorization granted {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:54:48.304596 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.auth.core [None req-f45d50b2-e00d-4823-9878-3b14ae2e2091 None None] MFA Rules not processed for user `d18c063b2377412485965357671e5506`. Rule list: `[]` (Enabled: `True`). {{(pid=352329) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 08:54:48.305900 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.fernet_utils [None req-f45d50b2-e00d-4823-9878-3b14ae2e2091 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=352329) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:54:48.310640 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application [None req-044de1fe-fe52-4353-9416-72e8dc936840 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 08:54:48.310640 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:54:48.310640 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:54:48.310640 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:54:48.310640 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:54:48.310640 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:54:48.310640 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:54:48.310640 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:54:48.310640 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:54:48.310640 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:54:48.310640 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:54:48.310640 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:54:48.310640 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 08:54:48.310640 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 08:54:48.310640 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 08:54:48.311753 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 08:54:48.311753 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:54:48.311753 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:54:48.311753 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:54:48.311753 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:54:48.311753 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:54:48.311753 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:54:48.311753 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:54:48.311753 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application with Lock( Jul 28 08:54:48.311753 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:54:48.311753 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:54:48.311753 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:54:48.311753 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:54:48.311753 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:54:48.311753 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:54:48.311753 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:54:48.311753 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:54:48.313342 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 08:54:48.313342 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 08:54:48.313342 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 08:54:48.313342 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application Jul 28 08:54:48.316820 dv-cinder-851351-1-smb devstack@keystone.service[352328]: [pid: 352328|app: 0|req: 526/1030] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 08:54:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:54:48.317602 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044de1fe-fe52-4353-9416-72e8dc936840 None admin] Authenticating user token {{(pid=352328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:54:48.349668 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG dbcounter [-] [352328] Writing DB stats keystone:SELECT=100 {{(pid=352328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:54:48.382920 dv-cinder-851351-1-smb devstack@keystone.service[352329]: [pid: 352329|app: 0|req: 505/1031] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 08:54:48 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 08:54:48.406440 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f45d50b2-e00d-4823-9878-3b14ae2e2091 None None] Authenticating user token {{(pid=352329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:54:48.430144 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044de1fe-fe52-4353-9416-72e8dc936840 None admin] Validating token access rules against request {{(pid=352328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:54:48.465682 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1cd82c-ca0d-4150-b171-6c5467b59542 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:54:48.466313 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1cd82c-ca0d-4150-b171-6c5467b59542 None admin] REQUEST_METHOD: `GET` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:54:48.466596 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1cd82c-ca0d-4150-b171-6c5467b59542 None admin] SCRIPT_NAME: `/identity` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:54:48.466864 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1cd82c-ca0d-4150-b171-6c5467b59542 None admin] PATH_INFO: `/v3/domains` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:54:48.467576 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd1cd82c-ca0d-4150-b171-6c5467b59542 None admin] RBAC: Adding query filter params (name=Default) {{(pid=352328) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:54:48.467887 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd1cd82c-ca0d-4150-b171-6c5467b59542 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:54:48.469342 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd1cd82c-ca0d-4150-b171-6c5467b59542 None admin] RBAC: Authorization granted {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:54:48.481222 dv-cinder-851351-1-smb devstack@keystone.service[352328]: [pid: 352328|app: 0|req: 527/1032] 10.222.0.42 () {56 vars in 1109 bytes} [Thu Jul 28 08:54:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 08:54:48.482541 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f7e9a1-f380-4afd-8496-3ccf62c94f7a None None] REQUEST_METHOD: `GET` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:54:48.482832 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f7e9a1-f380-4afd-8496-3ccf62c94f7a None None] SCRIPT_NAME: `/identity` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:54:48.483104 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f7e9a1-f380-4afd-8496-3ccf62c94f7a None None] PATH_INFO: `/` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:54:48.484436 dv-cinder-851351-1-smb devstack@keystone.service[352328]: [pid: 352328|app: 0|req: 528/1033] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 08:54:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 08:54:48.488692 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f7e9a1-f380-4afd-8496-3ccf62c94f7a None None] Authenticating user token {{(pid=352328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:54:48.493215 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG dbcounter [-] [352329] Writing DB stats keystone:SELECT=100 {{(pid=352329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:54:48.515825 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f45d50b2-e00d-4823-9878-3b14ae2e2091 None None] Validating token access rules against request {{(pid=352329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:54:48.552238 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-003d865c-fd5d-4af9-a4ec-7920ff16e2b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:54:48.553202 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003d865c-fd5d-4af9-a4ec-7920ff16e2b6 None admin] REQUEST_METHOD: `GET` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:54:48.553662 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003d865c-fd5d-4af9-a4ec-7920ff16e2b6 None admin] SCRIPT_NAME: `/identity` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:54:48.554126 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003d865c-fd5d-4af9-a4ec-7920ff16e2b6 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:54:48.569221 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-003d865c-fd5d-4af9-a4ec-7920ff16e2b6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 08:54:48.574325 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application [None req-003d865c-fd5d-4af9-a4ec-7920ff16e2b6 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 08:54:48.574325 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:54:48.574325 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:54:48.574325 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:54:48.574325 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:54:48.574325 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:54:48.574325 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:54:48.574325 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:54:48.574325 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:54:48.574325 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:54:48.574325 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:54:48.574325 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:54:48.574325 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 08:54:48.574325 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 08:54:48.574325 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 08:54:48.574325 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 08:54:48.576918 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 08:54:48.576918 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 08:54:48.576918 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 08:54:48.576918 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 08:54:48.576918 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:54:48.576918 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:54:48.576918 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:54:48.576918 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:54:48.576918 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:54:48.576918 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:54:48.576918 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:54:48.576918 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application with Lock( Jul 28 08:54:48.576918 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:54:48.576918 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:54:48.576918 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:54:48.576918 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:54:48.578301 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:54:48.578301 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:54:48.578301 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:54:48.578301 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:54:48.578301 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 08:54:48.578301 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 08:54:48.578301 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 08:54:48.578301 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 08:54:48.578301 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 08:54:48.578301 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 08:54:48.578301 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 08:54:48.578301 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application Jul 28 08:54:48.578301 dv-cinder-851351-1-smb devstack@keystone.service[352329]: [pid: 352329|app: 0|req: 506/1034] 10.222.0.42 () {56 vars in 1096 bytes} [Thu Jul 28 08:54:48 2022] GET /identity/v3/roles/admin => generated 83 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 08:54:48.578301 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09fb0e46-34ba-4eea-823c-66c71169b12d None None] REQUEST_METHOD: `POST` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:54:48.579846 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09fb0e46-34ba-4eea-823c-66c71169b12d None None] SCRIPT_NAME: `/identity` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:54:48.579846 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09fb0e46-34ba-4eea-823c-66c71169b12d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:54:48.588051 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG dbcounter [-] [352328] Writing DB stats keystone:SELECT=100 {{(pid=352328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:54:48.597186 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.auth.core [None req-09fb0e46-34ba-4eea-823c-66c71169b12d None None] MFA Rules not processed for user `d18c063b2377412485965357671e5506`. Rule list: `[]` (Enabled: `True`). {{(pid=352329) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 08:54:48.598434 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.fernet_utils [None req-09fb0e46-34ba-4eea-823c-66c71169b12d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=352329) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:54:48.602513 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f7e9a1-f380-4afd-8496-3ccf62c94f7a None None] Validating token access rules against request {{(pid=352328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:54:48.637122 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81da606e-5a80-47df-904e-a62346b3b10d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:54:48.637806 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81da606e-5a80-47df-904e-a62346b3b10d None admin] REQUEST_METHOD: `GET` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:54:48.638089 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81da606e-5a80-47df-904e-a62346b3b10d None admin] SCRIPT_NAME: `/identity` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:54:48.638365 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81da606e-5a80-47df-904e-a62346b3b10d None admin] PATH_INFO: `/v3/users/nova` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:54:48.647369 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81da606e-5a80-47df-904e-a62346b3b10d None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:54:48.648878 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81da606e-5a80-47df-904e-a62346b3b10d None admin] RBAC: Authorization granted {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:54:48.661941 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application [None req-81da606e-5a80-47df-904e-a62346b3b10d None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 28 08:54:48.661941 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:54:48.661941 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:54:48.661941 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:54:48.661941 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:54:48.661941 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:54:48.661941 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:54:48.661941 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:54:48.661941 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:54:48.661941 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:54:48.661941 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:54:48.661941 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:54:48.661941 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 28 08:54:48.661941 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 28 08:54:48.661941 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 28 08:54:48.661941 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 28 08:54:48.663246 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:54:48.663246 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:54:48.663246 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 28 08:54:48.663246 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 08:54:48.663246 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 28 08:54:48.663246 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 08:54:48.663246 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:54:48.663246 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:54:48.663246 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:54:48.663246 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:54:48.663246 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:54:48.663246 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application with Lock( Jul 28 08:54:48.663246 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:54:48.663246 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:54:48.663246 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:54:48.663246 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:54:48.663246 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:54:48.663246 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:54:48.665343 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:54:48.665343 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:54:48.665343 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 28 08:54:48.665343 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 28 08:54:48.665343 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 28 08:54:48.665343 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 28 08:54:48.665343 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 28 08:54:48.665343 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 28 08:54:48.665343 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 28 08:54:48.665343 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application Jul 28 08:54:48.665343 dv-cinder-851351-1-smb devstack@keystone.service[352328]: [pid: 352328|app: 0|req: 529/1035] 10.222.0.42 () {56 vars in 1093 bytes} [Thu Jul 28 08:54:48 2022] GET /identity/v3/users/nova => generated 82 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:54:48.665343 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81da606e-5a80-47df-904e-a62346b3b10d None admin] Authenticating user token {{(pid=352328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:54:48.675830 dv-cinder-851351-1-smb devstack@keystone.service[352329]: [pid: 352329|app: 0|req: 507/1036] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 08:54:48 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 08:54:48.676741 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09fb0e46-34ba-4eea-823c-66c71169b12d None None] Authenticating user token {{(pid=352329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:54:48.747974 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG dbcounter [-] [352329] Writing DB stats keystone:SELECT=100 {{(pid=352329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:54:48.780223 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81da606e-5a80-47df-904e-a62346b3b10d None admin] Validating token access rules against request {{(pid=352328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:54:48.787494 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09fb0e46-34ba-4eea-823c-66c71169b12d None None] Validating token access rules against request {{(pid=352329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:54:48.820693 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e605f986-db5a-4b7e-a1ae-27665f1db63d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:54:48.821399 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e605f986-db5a-4b7e-a1ae-27665f1db63d None admin] REQUEST_METHOD: `GET` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:54:48.821659 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e605f986-db5a-4b7e-a1ae-27665f1db63d None admin] SCRIPT_NAME: `/identity` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:54:48.821938 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e605f986-db5a-4b7e-a1ae-27665f1db63d None admin] PATH_INFO: `/v3/roles` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:54:48.822691 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e605f986-db5a-4b7e-a1ae-27665f1db63d None admin] RBAC: Adding query filter params (name=admin) {{(pid=352328) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:54:48.823014 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e605f986-db5a-4b7e-a1ae-27665f1db63d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:54:48.824478 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e605f986-db5a-4b7e-a1ae-27665f1db63d None admin] RBAC: Authorization granted {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:54:48.825191 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df04d642-77ed-4dd8-b438-2d5463890752 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:54:48.825867 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df04d642-77ed-4dd8-b438-2d5463890752 None admin] REQUEST_METHOD: `GET` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:54:48.826137 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df04d642-77ed-4dd8-b438-2d5463890752 None admin] SCRIPT_NAME: `/identity` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:54:48.826413 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df04d642-77ed-4dd8-b438-2d5463890752 None admin] PATH_INFO: `/v3/users` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:54:48.827238 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df04d642-77ed-4dd8-b438-2d5463890752 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=352329) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:54:48.827554 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df04d642-77ed-4dd8-b438-2d5463890752 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:54:48.829152 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df04d642-77ed-4dd8-b438-2d5463890752 None admin] RBAC: Authorization granted {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:54:48.835378 dv-cinder-851351-1-smb devstack@keystone.service[352328]: [pid: 352328|app: 0|req: 530/1037] 10.222.0.42 () {56 vars in 1099 bytes} [Thu Jul 28 08:54:48 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:54:48.836262 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e605f986-db5a-4b7e-a1ae-27665f1db63d None admin] Authenticating user token {{(pid=352328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:54:48.849933 dv-cinder-851351-1-smb devstack@keystone.service[352329]: [pid: 352329|app: 0|req: 508/1038] 10.222.0.42 () {56 vars in 1133 bytes} [Thu Jul 28 08:54:48 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:54:48.850807 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df04d642-77ed-4dd8-b438-2d5463890752 None admin] Authenticating user token {{(pid=352329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:54:48.855366 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG dbcounter [-] [352328] Writing DB stats keystone:SELECT=100 {{(pid=352328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:54:48.950758 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e605f986-db5a-4b7e-a1ae-27665f1db63d None admin] Validating token access rules against request {{(pid=352328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:54:48.960789 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df04d642-77ed-4dd8-b438-2d5463890752 None admin] Validating token access rules against request {{(pid=352329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:54:48.990678 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG dbcounter [-] [352329] Writing DB stats keystone:SELECT=100 {{(pid=352329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:54:48.992783 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3cea599-bb6b-4d49-b49e-774482718862 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:54:48.993456 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3cea599-bb6b-4d49-b49e-774482718862 None admin] REQUEST_METHOD: `GET` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:54:48.993882 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3cea599-bb6b-4d49-b49e-774482718862 None admin] SCRIPT_NAME: `/identity` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:54:48.994157 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3cea599-bb6b-4d49-b49e-774482718862 None admin] PATH_INFO: `/v3/services/image` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:54:48.994785 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3cea599-bb6b-4d49-b49e-774482718862 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:54:48.996201 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3cea599-bb6b-4d49-b49e-774482718862 None admin] RBAC: Authorization granted {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:54:49.005567 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application [None req-f3cea599-bb6b-4d49-b49e-774482718862 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jul 28 08:54:49.005567 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:54:49.005567 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 28 08:54:49.005567 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 28 08:54:49.005567 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 28 08:54:49.005567 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 28 08:54:49.005567 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 28 08:54:49.005567 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 08:54:49.005567 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 28 08:54:49.005567 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application Jul 28 08:54:49.005567 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 28 08:54:49.005567 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application Jul 28 08:54:49.005567 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:54:49.005567 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:54:49.005567 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:54:49.005567 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:54:49.005567 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:54:49.007533 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:54:49.007533 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:54:49.007533 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:54:49.007533 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:54:49.007533 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:54:49.007533 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:54:49.007533 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 28 08:54:49.007533 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 28 08:54:49.007533 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 28 08:54:49.007533 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 28 08:54:49.007533 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:54:49.007533 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:54:49.007533 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:54:49.007533 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:54:49.007533 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:54:49.007533 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:54:49.009308 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:54:49.009308 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application with Lock( Jul 28 08:54:49.009308 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:54:49.009308 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:54:49.009308 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:54:49.009308 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:54:49.009308 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:54:49.009308 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:54:49.009308 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:54:49.009308 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:54:49.009308 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 28 08:54:49.009308 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 08:54:49.009308 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 28 08:54:49.009308 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application Jul 28 08:54:49.011021 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6395ec-c4e9-4e16-9b74-3f687574ad1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:54:49.011202 dv-cinder-851351-1-smb devstack@keystone.service[352328]: [pid: 352328|app: 0|req: 531/1039] 10.222.0.42 () {56 vars in 1105 bytes} [Thu Jul 28 08:54:48 2022] GET /identity/v3/services/image => generated 86 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:54:49.011367 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6395ec-c4e9-4e16-9b74-3f687574ad1e None admin] REQUEST_METHOD: `GET` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:54:49.011367 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6395ec-c4e9-4e16-9b74-3f687574ad1e None admin] SCRIPT_NAME: `/identity` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:54:49.011653 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3cea599-bb6b-4d49-b49e-774482718862 None admin] Authenticating user token {{(pid=352328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:54:49.011820 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6395ec-c4e9-4e16-9b74-3f687574ad1e None admin] PATH_INFO: `/v3/users/0c1ec7598e194e5c8438d3878efb38c7` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:54:49.031133 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea6395ec-c4e9-4e16-9b74-3f687574ad1e None admin] RBAC: Authorizing `identity:get_user(user_id=0c1ec7598e194e5c8438d3878efb38c7)` {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:54:49.032560 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea6395ec-c4e9-4e16-9b74-3f687574ad1e None admin] RBAC: Authorization granted {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:54:49.034608 dv-cinder-851351-1-smb devstack@keystone.service[352329]: [pid: 352329|app: 0|req: 509/1040] 10.222.0.42 () {56 vars in 1177 bytes} [Thu Jul 28 08:54:48 2022] GET /identity/v3/users/0c1ec7598e194e5c8438d3878efb38c7 => generated 285 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:54:49.035299 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6395ec-c4e9-4e16-9b74-3f687574ad1e None admin] Authenticating user token {{(pid=352329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:54:49.128145 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG dbcounter [-] [352328] Writing DB stats keystone:SELECT=100 {{(pid=352328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:54:49.162633 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6395ec-c4e9-4e16-9b74-3f687574ad1e None admin] Validating token access rules against request {{(pid=352329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:54:49.163008 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3cea599-bb6b-4d49-b49e-774482718862 None admin] Validating token access rules against request {{(pid=352328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:54:49.199593 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08bef721-5c57-4404-9a74-8b0f62021f4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:54:49.200140 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b25b8f94-e13f-4b74-9d42-aa8211ae661a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:54:49.200382 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08bef721-5c57-4404-9a74-8b0f62021f4d None admin] REQUEST_METHOD: `GET` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:54:49.200541 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08bef721-5c57-4404-9a74-8b0f62021f4d None admin] SCRIPT_NAME: `/identity` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:54:49.200790 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08bef721-5c57-4404-9a74-8b0f62021f4d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:54:49.200945 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25b8f94-e13f-4b74-9d42-aa8211ae661a None admin] REQUEST_METHOD: `GET` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:54:49.201114 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25b8f94-e13f-4b74-9d42-aa8211ae661a None admin] SCRIPT_NAME: `/identity` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:54:49.201367 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25b8f94-e13f-4b74-9d42-aa8211ae661a None admin] PATH_INFO: `/v3/services` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:54:49.202063 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b25b8f94-e13f-4b74-9d42-aa8211ae661a None admin] RBAC: Adding query filter params (name=image) {{(pid=352329) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:54:49.202376 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b25b8f94-e13f-4b74-9d42-aa8211ae661a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:54:49.203870 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b25b8f94-e13f-4b74-9d42-aa8211ae661a None admin] RBAC: Authorization granted {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:54:49.209716 dv-cinder-851351-1-smb devstack@keystone.service[352329]: [pid: 352329|app: 0|req: 510/1041] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 08:54:49 2022] GET /identity/v3/services?name=image => generated 122 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:54:49.210560 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b25b8f94-e13f-4b74-9d42-aa8211ae661a None admin] Authenticating user token {{(pid=352329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:54:49.260911 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG dbcounter [-] [352329] Writing DB stats keystone:SELECT=100 {{(pid=352329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:54:49.278585 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08bef721-5c57-4404-9a74-8b0f62021f4d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:54:49.280082 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08bef721-5c57-4404-9a74-8b0f62021f4d None admin] RBAC: Authorization granted {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:54:49.315638 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b25b8f94-e13f-4b74-9d42-aa8211ae661a None admin] Validating token access rules against request {{(pid=352329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:54:49.351781 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ce392b-0226-42ca-afcf-c1d139dfe901 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:54:49.352429 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ce392b-0226-42ca-afcf-c1d139dfe901 None admin] REQUEST_METHOD: `GET` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:54:49.353482 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ce392b-0226-42ca-afcf-c1d139dfe901 None admin] SCRIPT_NAME: `/identity` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:54:49.353482 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ce392b-0226-42ca-afcf-c1d139dfe901 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:54:49.358385 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG dbcounter [-] [352328] Writing DB stats keystone:SELECT=100 {{(pid=352328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:54:49.388712 dv-cinder-851351-1-smb devstack@keystone.service[352328]: [pid: 352328|app: 0|req: 532/1042] 10.222.0.42 () {58 vars in 1282 bytes} [Thu Jul 28 08:54:49 2022] GET /identity/v3/auth/tokens => generated 1959 bytes in 381 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 28 08:54:49.389600 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08bef721-5c57-4404-9a74-8b0f62021f4d None admin] Authenticating user token {{(pid=352328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:54:49.426231 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ce392b-0226-42ca-afcf-c1d139dfe901 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:54:49.427736 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ce392b-0226-42ca-afcf-c1d139dfe901 None admin] RBAC: Authorization granted {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:54:49.479669 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG dbcounter [-] [352329] Writing DB stats keystone:SELECT=100 {{(pid=352329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:54:49.496626 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08bef721-5c57-4404-9a74-8b0f62021f4d None admin] Validating token access rules against request {{(pid=352328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:54:49.532808 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e603f66-e703-4167-855b-fe2857020adb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:54:49.533446 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e603f66-e703-4167-855b-fe2857020adb None admin] REQUEST_METHOD: `GET` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:54:49.533729 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e603f66-e703-4167-855b-fe2857020adb None admin] SCRIPT_NAME: `/identity` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:54:49.534001 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e603f66-e703-4167-855b-fe2857020adb None admin] PATH_INFO: `/v3/services` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:54:49.534699 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e603f66-e703-4167-855b-fe2857020adb None admin] RBAC: Adding query filter params (type=image) {{(pid=352328) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:54:49.534878 dv-cinder-851351-1-smb devstack@keystone.service[352329]: [pid: 352329|app: 0|req: 511/1043] 10.222.0.42 () {58 vars in 1282 bytes} [Thu Jul 28 08:54:49 2022] GET /identity/v3/auth/tokens => generated 1959 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 28 08:54:49.535016 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e603f66-e703-4167-855b-fe2857020adb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:54:49.535563 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ce392b-0226-42ca-afcf-c1d139dfe901 None admin] Authenticating user token {{(pid=352329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:54:49.536383 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e603f66-e703-4167-855b-fe2857020adb None admin] RBAC: Authorization granted {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:54:49.544597 dv-cinder-851351-1-smb devstack@keystone.service[352328]: [pid: 352328|app: 0|req: 533/1044] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 08:54:49 2022] GET /identity/v3/services?type=image => generated 350 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:54:49.545457 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e603f66-e703-4167-855b-fe2857020adb None admin] Authenticating user token {{(pid=352328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:54:49.589464 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG dbcounter [-] [352328] Writing DB stats keystone:SELECT=100 {{(pid=352328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:54:49.651785 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ce392b-0226-42ca-afcf-c1d139dfe901 None admin] Validating token access rules against request {{(pid=352329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:54:49.653671 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e603f66-e703-4167-855b-fe2857020adb None admin] Validating token access rules against request {{(pid=352328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:54:49.690017 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c6ba9a-b98c-41a1-aa54-262ba852f1a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:54:49.690882 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c6ba9a-b98c-41a1-aa54-262ba852f1a4 None admin] REQUEST_METHOD: `GET` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:54:49.690882 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c6ba9a-b98c-41a1-aa54-262ba852f1a4 None admin] SCRIPT_NAME: `/identity` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:54:49.691169 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c6ba9a-b98c-41a1-aa54-262ba852f1a4 None admin] PATH_INFO: `/v3/projects/bfcd60e891d347e9b21fff5dd9459e3b` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:54:49.692390 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2c6ba9a-b98c-41a1-aa54-262ba852f1a4 None admin] RBAC: Authorizing `identity:get_project(project_id=bfcd60e891d347e9b21fff5dd9459e3b)` {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:54:49.693925 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2c6ba9a-b98c-41a1-aa54-262ba852f1a4 None admin] RBAC: Authorization granted {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:54:49.695808 dv-cinder-851351-1-smb devstack@keystone.service[352328]: [pid: 352328|app: 0|req: 534/1045] 10.222.0.42 () {56 vars in 1186 bytes} [Thu Jul 28 08:54:49 2022] GET /identity/v3/projects/bfcd60e891d347e9b21fff5dd9459e3b => generated 311 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:54:49.696397 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c6ba9a-b98c-41a1-aa54-262ba852f1a4 None admin] Authenticating user token {{(pid=352328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:54:49.703582 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb43a98b-6a81-4e7b-8d4c-81ee7505945a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:54:49.704635 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb43a98b-6a81-4e7b-8d4c-81ee7505945a None admin] REQUEST_METHOD: `GET` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:54:49.704954 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb43a98b-6a81-4e7b-8d4c-81ee7505945a None admin] SCRIPT_NAME: `/identity` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:54:49.705211 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb43a98b-6a81-4e7b-8d4c-81ee7505945a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:54:49.716378 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb43a98b-6a81-4e7b-8d4c-81ee7505945a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:54:49.717900 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb43a98b-6a81-4e7b-8d4c-81ee7505945a None admin] RBAC: Authorization granted {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:54:49.727458 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG dbcounter [-] [352329] Writing DB stats keystone:SELECT=100 {{(pid=352329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:54:49.734819 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application [None req-cb43a98b-6a81-4e7b-8d4c-81ee7505945a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 08:54:49.734819 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:54:49.734819 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:54:49.734819 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:54:49.734819 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:54:49.734819 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:54:49.734819 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:54:49.734819 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:54:49.734819 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:54:49.734819 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:54:49.734819 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:54:49.734819 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:54:49.734819 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 08:54:49.734819 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 08:54:49.734819 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 08:54:49.736043 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 08:54:49.736043 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:54:49.736043 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:54:49.736043 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:54:49.736043 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:54:49.736043 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:54:49.736043 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:54:49.736043 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:54:49.736043 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application with Lock( Jul 28 08:54:49.736043 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:54:49.736043 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:54:49.736043 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:54:49.736043 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:54:49.736043 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:54:49.736043 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:54:49.736043 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:54:49.736043 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:54:49.737189 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 08:54:49.737189 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 08:54:49.737189 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 08:54:49.737189 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application Jul 28 08:54:49.738311 dv-cinder-851351-1-smb devstack@keystone.service[352329]: [pid: 352329|app: 0|req: 512/1046] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 08:54:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:54:49.739780 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb43a98b-6a81-4e7b-8d4c-81ee7505945a None admin] Authenticating user token {{(pid=352329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:54:49.835806 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c6ba9a-b98c-41a1-aa54-262ba852f1a4 None admin] Validating token access rules against request {{(pid=352328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:54:49.845057 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb43a98b-6a81-4e7b-8d4c-81ee7505945a None admin] Validating token access rules against request {{(pid=352329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:54:49.848992 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG dbcounter [-] [352328] Writing DB stats keystone:SELECT=100 {{(pid=352328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:54:49.880305 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6947f5e-5dd6-4fa2-a446-6848475b59ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:54:49.880963 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6947f5e-5dd6-4fa2-a446-6848475b59ec None admin] REQUEST_METHOD: `GET` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:54:49.881241 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6947f5e-5dd6-4fa2-a446-6848475b59ec None admin] SCRIPT_NAME: `/identity` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:54:49.881513 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6947f5e-5dd6-4fa2-a446-6848475b59ec None admin] PATH_INFO: `/v3/role_assignments` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:54:49.882302 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6947f5e-5dd6-4fa2-a446-6848475b59ec None admin] RBAC: Adding query filter params (role.id=280023171b4a45efb67c036ff237bb3c, scope.project.id=bfcd60e891d347e9b21fff5dd9459e3b, user.id=0c1ec7598e194e5c8438d3878efb38c7) {{(pid=352329) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:54:49.882609 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6947f5e-5dd6-4fa2-a446-6848475b59ec None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:54:49.884059 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6947f5e-5dd6-4fa2-a446-6848475b59ec None admin] RBAC: Authorization granted {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:54:49.889711 dv-cinder-851351-1-smb devstack@keystone.service[352329]: [pid: 352329|app: 0|req: 513/1047] 10.222.0.42 () {56 vars in 1374 bytes} [Thu Jul 28 08:54:49 2022] GET /identity/v3/role_assignments?user.id=0c1ec7598e194e5c8438d3878efb38c7&scope.project.id=bfcd60e891d347e9b21fff5dd9459e3b&role.id=280023171b4a45efb67c036ff237bb3c => generated 259 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:54:49.890632 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6947f5e-5dd6-4fa2-a446-6848475b59ec None admin] Authenticating user token {{(pid=352329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:54:49.893479 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff719a9-88ed-4df1-9666-96f842d5866d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:54:49.894581 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff719a9-88ed-4df1-9666-96f842d5866d None admin] REQUEST_METHOD: `GET` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:54:49.895054 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff719a9-88ed-4df1-9666-96f842d5866d None admin] SCRIPT_NAME: `/identity` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:54:49.895488 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff719a9-88ed-4df1-9666-96f842d5866d None admin] PATH_INFO: `/v3/endpoints` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:54:49.896957 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff719a9-88ed-4df1-9666-96f842d5866d None admin] RBAC: Adding query filter params (interface=public, service_id=f91425951cc140ea899e42ea59dfbee0, region_id=RegionOne) {{(pid=352328) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:54:49.897499 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff719a9-88ed-4df1-9666-96f842d5866d None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:54:49.900087 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff719a9-88ed-4df1-9666-96f842d5866d None admin] RBAC: Authorization granted {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:54:49.912791 dv-cinder-851351-1-smb devstack@keystone.service[352328]: [pid: 352328|app: 0|req: 535/1048] 10.222.0.42 () {56 vars in 1251 bytes} [Thu Jul 28 08:54:49 2022] GET /identity/v3/endpoints?service_id=f91425951cc140ea899e42ea59dfbee0&interface=public®ion_id=RegionOne => generated 194 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:54:49.916515 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff719a9-88ed-4df1-9666-96f842d5866d None admin] Authenticating user token {{(pid=352328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:54:49.978049 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG dbcounter [-] [352329] Writing DB stats keystone:SELECT=100 {{(pid=352329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:54:50.028771 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6947f5e-5dd6-4fa2-a446-6848475b59ec None admin] Validating token access rules against request {{(pid=352329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:54:50.053345 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff719a9-88ed-4df1-9666-96f842d5866d None admin] Validating token access rules against request {{(pid=352328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:54:50.069037 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd41b3a-a854-48e9-bda4-e7b14c1d222d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:54:50.070511 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd41b3a-a854-48e9-bda4-e7b14c1d222d None admin] REQUEST_METHOD: `GET` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:54:50.070511 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd41b3a-a854-48e9-bda4-e7b14c1d222d None admin] SCRIPT_NAME: `/identity` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:54:50.070511 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd41b3a-a854-48e9-bda4-e7b14c1d222d None admin] PATH_INFO: `/v3/domains` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:54:50.070940 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebd41b3a-a854-48e9-bda4-e7b14c1d222d None admin] RBAC: Adding query filter params (name=Default) {{(pid=352329) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:54:50.071252 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebd41b3a-a854-48e9-bda4-e7b14c1d222d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:54:50.072678 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebd41b3a-a854-48e9-bda4-e7b14c1d222d None admin] RBAC: Authorization granted {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:54:50.088617 dv-cinder-851351-1-smb devstack@keystone.service[352329]: [pid: 352329|app: 0|req: 514/1049] 10.222.0.42 () {56 vars in 1109 bytes} [Thu Jul 28 08:54:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:54:50.093733 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c4f6bb-62ac-4d37-9789-b46ce3dd831b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:54:50.094352 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd41b3a-a854-48e9-bda4-e7b14c1d222d None admin] Authenticating user token {{(pid=352329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:54:50.094542 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c4f6bb-62ac-4d37-9789-b46ce3dd831b None admin] REQUEST_METHOD: `GET` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:54:50.094896 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c4f6bb-62ac-4d37-9789-b46ce3dd831b None admin] SCRIPT_NAME: `/identity` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:54:50.095339 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c4f6bb-62ac-4d37-9789-b46ce3dd831b None admin] PATH_INFO: `/v3/services` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:54:50.095997 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c4f6bb-62ac-4d37-9789-b46ce3dd831b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:54:50.097547 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c4f6bb-62ac-4d37-9789-b46ce3dd831b None admin] RBAC: Authorization granted {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:54:50.104964 dv-cinder-851351-1-smb devstack@keystone.service[352328]: [pid: 352328|app: 0|req: 536/1050] 10.222.0.42 () {56 vars in 1087 bytes} [Thu Jul 28 08:54:49 2022] GET /identity/v3/services => generated 1957 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 08:54:50.221934 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd41b3a-a854-48e9-bda4-e7b14c1d222d None admin] Validating token access rules against request {{(pid=352329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:54:50.249377 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG dbcounter [-] [352329] Writing DB stats keystone:SELECT=100 {{(pid=352329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:54:50.263122 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79bd0b3-7abe-4d3e-b0ca-7a2dc5f9df18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:54:50.264119 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79bd0b3-7abe-4d3e-b0ca-7a2dc5f9df18 None admin] REQUEST_METHOD: `GET` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:54:50.264568 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79bd0b3-7abe-4d3e-b0ca-7a2dc5f9df18 None admin] SCRIPT_NAME: `/identity` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:54:50.265022 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79bd0b3-7abe-4d3e-b0ca-7a2dc5f9df18 None admin] PATH_INFO: `/v3/projects/service` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:54:50.275198 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f79bd0b3-7abe-4d3e-b0ca-7a2dc5f9df18 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:54:50.276722 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f79bd0b3-7abe-4d3e-b0ca-7a2dc5f9df18 None admin] RBAC: Authorization granted {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:54:50.290844 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application [None req-f79bd0b3-7abe-4d3e-b0ca-7a2dc5f9df18 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 08:54:50.290844 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:54:50.290844 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:54:50.290844 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:54:50.290844 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:54:50.290844 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:54:50.290844 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:54:50.290844 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:54:50.290844 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:54:50.290844 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:54:50.290844 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:54:50.290844 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:54:50.290844 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 28 08:54:50.290844 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 28 08:54:50.290844 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 28 08:54:50.292034 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 28 08:54:50.292034 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:54:50.292034 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:54:50.292034 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:54:50.292034 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:54:50.292034 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:54:50.292034 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:54:50.292034 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:54:50.292034 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application with Lock( Jul 28 08:54:50.292034 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:54:50.292034 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:54:50.292034 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:54:50.292034 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:54:50.292034 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:54:50.292034 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:54:50.292034 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:54:50.292034 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:54:50.293239 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 28 08:54:50.293239 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 28 08:54:50.293239 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 28 08:54:50.293239 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 28 08:54:50.293239 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 28 08:54:50.293239 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 28 08:54:50.293239 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 08:54:50.293239 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application Jul 28 08:54:50.293239 dv-cinder-851351-1-smb devstack@keystone.service[352329]: [pid: 352329|app: 0|req: 515/1051] 10.222.0.42 () {56 vars in 1111 bytes} [Thu Jul 28 08:54:50 2022] GET /identity/v3/projects/service => generated 88 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:54:50.298565 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c4f6bb-62ac-4d37-9789-b46ce3dd831b None admin] Authenticating user token {{(pid=352328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:54:50.337661 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG dbcounter [-] [352328] Writing DB stats keystone:SELECT=100 {{(pid=352328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:54:50.412026 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c4f6bb-62ac-4d37-9789-b46ce3dd831b None admin] Validating token access rules against request {{(pid=352328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:54:50.449074 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e72de4a-a6d7-48c7-86ff-cefc37ec9151 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:54:50.449716 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e72de4a-a6d7-48c7-86ff-cefc37ec9151 None admin] REQUEST_METHOD: `GET` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:54:50.450001 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e72de4a-a6d7-48c7-86ff-cefc37ec9151 None admin] SCRIPT_NAME: `/identity` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:54:50.450276 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e72de4a-a6d7-48c7-86ff-cefc37ec9151 None admin] PATH_INFO: `/v3/projects` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:54:50.451050 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e72de4a-a6d7-48c7-86ff-cefc37ec9151 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=352328) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:54:50.451361 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e72de4a-a6d7-48c7-86ff-cefc37ec9151 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:54:50.452898 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e72de4a-a6d7-48c7-86ff-cefc37ec9151 None admin] RBAC: Authorization granted {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:54:50.470556 dv-cinder-851351-1-smb devstack@keystone.service[352328]: [pid: 352328|app: 0|req: 537/1052] 10.222.0.42 () {56 vars in 1148 bytes} [Thu Jul 28 08:54:50 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 08:54:50.472590 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79bd0b3-7abe-4d3e-b0ca-7a2dc5f9df18 None admin] Authenticating user token {{(pid=352329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:54:50.577826 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79bd0b3-7abe-4d3e-b0ca-7a2dc5f9df18 None admin] Validating token access rules against request {{(pid=352329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:54:50.613598 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f0af0d-3d48-48a3-a08a-4f16cb4a21aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:54:50.614238 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f0af0d-3d48-48a3-a08a-4f16cb4a21aa None admin] REQUEST_METHOD: `GET` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:54:50.614526 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f0af0d-3d48-48a3-a08a-4f16cb4a21aa None admin] SCRIPT_NAME: `/identity` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:54:50.614807 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f0af0d-3d48-48a3-a08a-4f16cb4a21aa None admin] PATH_INFO: `/v3/role_assignments` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:54:50.615745 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4f0af0d-3d48-48a3-a08a-4f16cb4a21aa None admin] RBAC: Adding query filter params (role.id=15fc2297dd8749eab8d518cabaaf36f4, scope.project.id=9cfa053c839a4fedacde7163d907e2a4, user.id=e3ba63c3fc36470fbbe8312b51a13f13) {{(pid=352329) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:54:50.615928 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4f0af0d-3d48-48a3-a08a-4f16cb4a21aa None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:54:50.617458 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4f0af0d-3d48-48a3-a08a-4f16cb4a21aa None admin] RBAC: Authorization granted {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:54:50.625498 dv-cinder-851351-1-smb devstack@keystone.service[352329]: [pid: 352329|app: 0|req: 516/1053] 10.222.0.42 () {56 vars in 1374 bytes} [Thu Jul 28 08:54:50 2022] GET /identity/v3/role_assignments?user.id=e3ba63c3fc36470fbbe8312b51a13f13&scope.project.id=9cfa053c839a4fedacde7163d907e2a4&role.id=15fc2297dd8749eab8d518cabaaf36f4 => generated 259 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:54:51.910233 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0c344d-9d4d-4e12-b5d9-af38baf700a0 None None] REQUEST_METHOD: `GET` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:54:51.910931 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0c344d-9d4d-4e12-b5d9-af38baf700a0 None None] SCRIPT_NAME: `/identity` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:54:51.910931 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0c344d-9d4d-4e12-b5d9-af38baf700a0 None None] PATH_INFO: `/` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:54:51.912437 dv-cinder-851351-1-smb devstack@keystone.service[352328]: [pid: 352328|app: 0|req: 538/1054] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 08:54:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 08:54:51.917736 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b52421-dd6d-4dd3-b8b8-9749750b2d3a None None] REQUEST_METHOD: `POST` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:54:51.918184 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b52421-dd6d-4dd3-b8b8-9749750b2d3a None None] SCRIPT_NAME: `/identity` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:54:51.918298 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b52421-dd6d-4dd3-b8b8-9749750b2d3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:54:51.936909 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.auth.core [None req-34b52421-dd6d-4dd3-b8b8-9749750b2d3a None None] MFA Rules not processed for user `d18c063b2377412485965357671e5506`. Rule list: `[]` (Enabled: `True`). {{(pid=352329) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 08:54:51.938184 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.fernet_utils [None req-34b52421-dd6d-4dd3-b8b8-9749750b2d3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=352329) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:54:51.985642 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG dbcounter [-] [352329] Writing DB stats keystone:SELECT=100 {{(pid=352329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:54:52.016706 dv-cinder-851351-1-smb devstack@keystone.service[352329]: [pid: 352329|app: 0|req: 517/1055] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 08:54:51 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 08:54:52.039315 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0c344d-9d4d-4e12-b5d9-af38baf700a0 None None] Authenticating user token {{(pid=352328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:54:52.147378 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG dbcounter [-] [352328] Writing DB stats keystone:SELECT=100 {{(pid=352328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:54:52.156750 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0c344d-9d4d-4e12-b5d9-af38baf700a0 None None] Validating token access rules against request {{(pid=352328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:54:52.177655 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a63de34-b985-4317-bf23-e3f76606d001 None None] REQUEST_METHOD: `GET` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:54:52.178306 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a63de34-b985-4317-bf23-e3f76606d001 None None] SCRIPT_NAME: `/identity` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:54:52.179476 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a63de34-b985-4317-bf23-e3f76606d001 None None] PATH_INFO: `/` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:54:52.182238 dv-cinder-851351-1-smb devstack@keystone.service[352329]: [pid: 352329|app: 0|req: 518/1056] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 08:54:52 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 08:54:52.188606 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a77e5b-837f-451d-a2f5-fb7dcd80be86 None None] REQUEST_METHOD: `POST` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:54:52.189625 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a77e5b-837f-451d-a2f5-fb7dcd80be86 None None] SCRIPT_NAME: `/identity` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:54:52.190157 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a77e5b-837f-451d-a2f5-fb7dcd80be86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:54:52.195621 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac3f522-4201-4255-9b05-e234c4e6d550 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:54:52.196304 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac3f522-4201-4255-9b05-e234c4e6d550 None admin] REQUEST_METHOD: `GET` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:54:52.196580 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac3f522-4201-4255-9b05-e234c4e6d550 None admin] SCRIPT_NAME: `/identity` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:54:52.196887 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac3f522-4201-4255-9b05-e234c4e6d550 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:54:52.212843 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ac3f522-4201-4255-9b05-e234c4e6d550 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 08:54:52.216099 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.auth.core [None req-a9a77e5b-837f-451d-a2f5-fb7dcd80be86 None None] MFA Rules not processed for user `d18c063b2377412485965357671e5506`. Rule list: `[]` (Enabled: `True`). {{(pid=352329) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 08:54:52.217711 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.fernet_utils [None req-a9a77e5b-837f-451d-a2f5-fb7dcd80be86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=352329) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:54:52.217873 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application [None req-7ac3f522-4201-4255-9b05-e234c4e6d550 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 08:54:52.217873 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:54:52.217873 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:54:52.217873 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:54:52.217873 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:54:52.217873 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:54:52.217873 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:54:52.217873 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:54:52.217873 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:54:52.217873 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:54:52.217873 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:54:52.217873 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:54:52.217873 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 08:54:52.217873 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 08:54:52.217873 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 08:54:52.217873 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 08:54:52.218973 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 08:54:52.218973 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 08:54:52.218973 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 08:54:52.218973 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 08:54:52.218973 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:54:52.218973 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:54:52.218973 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:54:52.218973 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:54:52.218973 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:54:52.218973 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:54:52.218973 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:54:52.218973 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application with Lock( Jul 28 08:54:52.218973 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:54:52.218973 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:54:52.218973 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:54:52.218973 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:54:52.220057 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:54:52.220057 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:54:52.220057 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:54:52.220057 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:54:52.220057 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 08:54:52.220057 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 08:54:52.220057 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 08:54:52.220057 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 08:54:52.220057 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 08:54:52.220057 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 08:54:52.220057 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 08:54:52.220057 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application Jul 28 08:54:52.220057 dv-cinder-851351-1-smb devstack@keystone.service[352328]: [pid: 352328|app: 0|req: 539/1057] 10.222.0.42 () {56 vars in 1096 bytes} [Thu Jul 28 08:54:52 2022] GET /identity/v3/roles/admin => generated 83 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:54:52.226653 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac3f522-4201-4255-9b05-e234c4e6d550 None admin] Authenticating user token {{(pid=352328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:54:52.298615 dv-cinder-851351-1-smb devstack@keystone.service[352329]: [pid: 352329|app: 0|req: 519/1058] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 08:54:52 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 08:54:52.322307 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a77e5b-837f-451d-a2f5-fb7dcd80be86 None None] Authenticating user token {{(pid=352329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:54:52.338389 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac3f522-4201-4255-9b05-e234c4e6d550 None admin] Validating token access rules against request {{(pid=352328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:54:52.374183 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f009c118-fe6b-404d-8859-a6ee1fa1ad64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:54:52.374931 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f009c118-fe6b-404d-8859-a6ee1fa1ad64 None admin] REQUEST_METHOD: `GET` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:54:52.375260 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f009c118-fe6b-404d-8859-a6ee1fa1ad64 None admin] SCRIPT_NAME: `/identity` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:54:52.375478 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f009c118-fe6b-404d-8859-a6ee1fa1ad64 None admin] PATH_INFO: `/v3/roles` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:54:52.376195 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f009c118-fe6b-404d-8859-a6ee1fa1ad64 None admin] RBAC: Adding query filter params (name=admin) {{(pid=352328) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:54:52.376500 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f009c118-fe6b-404d-8859-a6ee1fa1ad64 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:54:52.377972 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f009c118-fe6b-404d-8859-a6ee1fa1ad64 None admin] RBAC: Authorization granted {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:54:52.393106 dv-cinder-851351-1-smb devstack@keystone.service[352328]: [pid: 352328|app: 0|req: 540/1059] 10.222.0.42 () {56 vars in 1099 bytes} [Thu Jul 28 08:54:52 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 08:54:52.395928 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f009c118-fe6b-404d-8859-a6ee1fa1ad64 None admin] Authenticating user token {{(pid=352328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:54:52.420638 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG dbcounter [-] [352328] Writing DB stats keystone:SELECT=100 {{(pid=352328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:54:52.437002 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a77e5b-837f-451d-a2f5-fb7dcd80be86 None None] Validating token access rules against request {{(pid=352329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:54:52.449513 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG dbcounter [-] [352329] Writing DB stats keystone:SELECT=100 {{(pid=352329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:54:52.478003 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e7449d-fc5b-4233-97ab-f03133b8ab1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:54:52.478733 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e7449d-fc5b-4233-97ab-f03133b8ab1b None admin] REQUEST_METHOD: `GET` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:54:52.479018 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e7449d-fc5b-4233-97ab-f03133b8ab1b None admin] SCRIPT_NAME: `/identity` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:54:52.479350 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e7449d-fc5b-4233-97ab-f03133b8ab1b None admin] PATH_INFO: `/v3/services/image` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:54:52.480030 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9e7449d-fc5b-4233-97ab-f03133b8ab1b None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:54:52.481465 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9e7449d-fc5b-4233-97ab-f03133b8ab1b None admin] RBAC: Authorization granted {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:54:52.494252 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application [None req-d9e7449d-fc5b-4233-97ab-f03133b8ab1b None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jul 28 08:54:52.494252 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:54:52.494252 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 28 08:54:52.494252 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 28 08:54:52.494252 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 28 08:54:52.494252 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 28 08:54:52.494252 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 28 08:54:52.494252 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 08:54:52.494252 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 28 08:54:52.494252 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application Jul 28 08:54:52.494252 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 28 08:54:52.494252 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application Jul 28 08:54:52.494252 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:54:52.494252 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:54:52.494252 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:54:52.494252 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:54:52.494252 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:54:52.495738 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:54:52.495738 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:54:52.495738 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:54:52.495738 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:54:52.495738 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:54:52.495738 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:54:52.495738 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 28 08:54:52.495738 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 28 08:54:52.495738 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 28 08:54:52.495738 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 28 08:54:52.495738 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:54:52.495738 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:54:52.495738 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:54:52.495738 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:54:52.495738 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:54:52.495738 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:54:52.496834 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:54:52.496834 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application with Lock( Jul 28 08:54:52.496834 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:54:52.496834 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:54:52.496834 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:54:52.496834 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:54:52.496834 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:54:52.496834 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:54:52.496834 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:54:52.496834 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:54:52.496834 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 28 08:54:52.496834 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 08:54:52.496834 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 28 08:54:52.496834 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application Jul 28 08:54:52.496834 dv-cinder-851351-1-smb devstack@keystone.service[352329]: [pid: 352329|app: 0|req: 520/1060] 10.222.0.42 () {56 vars in 1105 bytes} [Thu Jul 28 08:54:52 2022] GET /identity/v3/services/image => generated 86 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 08:54:52.501626 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e7449d-fc5b-4233-97ab-f03133b8ab1b None admin] Authenticating user token {{(pid=352329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:54:52.514805 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f009c118-fe6b-404d-8859-a6ee1fa1ad64 None admin] Validating token access rules against request {{(pid=352328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:54:52.556435 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f32afef-6298-4865-8a1c-b2ab1456651f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:54:52.557116 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f32afef-6298-4865-8a1c-b2ab1456651f None admin] REQUEST_METHOD: `GET` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:54:52.557400 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f32afef-6298-4865-8a1c-b2ab1456651f None admin] SCRIPT_NAME: `/identity` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:54:52.557684 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f32afef-6298-4865-8a1c-b2ab1456651f None admin] PATH_INFO: `/v3/users/0c1ec7598e194e5c8438d3878efb38c7` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:54:52.558899 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f32afef-6298-4865-8a1c-b2ab1456651f None admin] RBAC: Authorizing `identity:get_user(user_id=0c1ec7598e194e5c8438d3878efb38c7)` {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:54:52.560334 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f32afef-6298-4865-8a1c-b2ab1456651f None admin] RBAC: Authorization granted {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:54:52.562009 dv-cinder-851351-1-smb devstack@keystone.service[352328]: [pid: 352328|app: 0|req: 541/1061] 10.222.0.42 () {56 vars in 1177 bytes} [Thu Jul 28 08:54:52 2022] GET /identity/v3/users/0c1ec7598e194e5c8438d3878efb38c7 => generated 285 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:54:52.567940 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f32afef-6298-4865-8a1c-b2ab1456651f None admin] Authenticating user token {{(pid=352328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:54:52.612273 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e7449d-fc5b-4233-97ab-f03133b8ab1b None admin] Validating token access rules against request {{(pid=352329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:54:52.647173 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f5ba14-cf3c-4aae-b088-1f1a085d133a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:54:52.647801 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f5ba14-cf3c-4aae-b088-1f1a085d133a None admin] REQUEST_METHOD: `GET` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:54:52.648082 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f5ba14-cf3c-4aae-b088-1f1a085d133a None admin] SCRIPT_NAME: `/identity` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:54:52.648354 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f5ba14-cf3c-4aae-b088-1f1a085d133a None admin] PATH_INFO: `/v3/services` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:54:52.649075 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f5ba14-cf3c-4aae-b088-1f1a085d133a None admin] RBAC: Adding query filter params (name=image) {{(pid=352329) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:54:52.649385 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f5ba14-cf3c-4aae-b088-1f1a085d133a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:54:52.650789 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f5ba14-cf3c-4aae-b088-1f1a085d133a None admin] RBAC: Authorization granted {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:54:52.655587 dv-cinder-851351-1-smb devstack@keystone.service[352329]: [pid: 352329|app: 0|req: 521/1062] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 08:54:52 2022] GET /identity/v3/services?name=image => generated 122 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 08:54:52.656944 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9e37c6-3653-4a08-8fb2-062b55b61a66 None None] REQUEST_METHOD: `GET` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:54:52.657235 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9e37c6-3653-4a08-8fb2-062b55b61a66 None None] SCRIPT_NAME: `/identity` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:54:52.657511 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9e37c6-3653-4a08-8fb2-062b55b61a66 None None] PATH_INFO: `/` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:54:52.658889 dv-cinder-851351-1-smb devstack@keystone.service[352329]: [pid: 352329|app: 0|req: 522/1063] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 08:54:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 08:54:52.663155 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG dbcounter [-] [352328] Writing DB stats keystone:SELECT=100 {{(pid=352328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:54:52.663329 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f9e37c6-3653-4a08-8fb2-062b55b61a66 None None] Authenticating user token {{(pid=352329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:54:52.678384 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f32afef-6298-4865-8a1c-b2ab1456651f None admin] Validating token access rules against request {{(pid=352328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:54:52.697288 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG dbcounter [-] [352329] Writing DB stats keystone:SELECT=100 {{(pid=352329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:54:52.713903 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276af80d-f029-42e5-ba08-ed198a7b035c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:54:52.714560 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276af80d-f029-42e5-ba08-ed198a7b035c None admin] REQUEST_METHOD: `GET` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:54:52.714842 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276af80d-f029-42e5-ba08-ed198a7b035c None admin] SCRIPT_NAME: `/identity` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:54:52.715119 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276af80d-f029-42e5-ba08-ed198a7b035c None admin] PATH_INFO: `/v3/projects/bfcd60e891d347e9b21fff5dd9459e3b` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:54:52.716325 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-276af80d-f029-42e5-ba08-ed198a7b035c None admin] RBAC: Authorizing `identity:get_project(project_id=bfcd60e891d347e9b21fff5dd9459e3b)` {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:54:52.717791 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-276af80d-f029-42e5-ba08-ed198a7b035c None admin] RBAC: Authorization granted {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:54:52.719527 dv-cinder-851351-1-smb devstack@keystone.service[352328]: [pid: 352328|app: 0|req: 542/1064] 10.222.0.42 () {56 vars in 1186 bytes} [Thu Jul 28 08:54:52 2022] GET /identity/v3/projects/bfcd60e891d347e9b21fff5dd9459e3b => generated 311 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:54:52.720771 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edee6db8-175f-4169-b63e-2cbe3858c055 None None] REQUEST_METHOD: `POST` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:54:52.721053 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edee6db8-175f-4169-b63e-2cbe3858c055 None None] SCRIPT_NAME: `/identity` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:54:52.721323 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edee6db8-175f-4169-b63e-2cbe3858c055 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:54:52.739014 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.auth.core [None req-edee6db8-175f-4169-b63e-2cbe3858c055 None None] MFA Rules not processed for user `d18c063b2377412485965357671e5506`. Rule list: `[]` (Enabled: `True`). {{(pid=352328) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 08:54:52.740212 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.fernet_utils [None req-edee6db8-175f-4169-b63e-2cbe3858c055 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=352328) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:54:52.772232 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f9e37c6-3653-4a08-8fb2-062b55b61a66 None None] Validating token access rules against request {{(pid=352329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:54:52.806394 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b3971b6-988a-434b-b90d-c8e971e30dff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:54:52.807028 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3971b6-988a-434b-b90d-c8e971e30dff None admin] REQUEST_METHOD: `GET` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:54:52.807306 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3971b6-988a-434b-b90d-c8e971e30dff None admin] SCRIPT_NAME: `/identity` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:54:52.807577 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3971b6-988a-434b-b90d-c8e971e30dff None admin] PATH_INFO: `/v3/services` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:54:52.808030 dv-cinder-851351-1-smb devstack@keystone.service[352328]: [pid: 352328|app: 0|req: 543/1065] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 08:54:52 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 08:54:52.808264 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b3971b6-988a-434b-b90d-c8e971e30dff None admin] RBAC: Adding query filter params (type=image) {{(pid=352329) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:54:52.808564 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b3971b6-988a-434b-b90d-c8e971e30dff None admin] RBAC: Authorizing `identity:list_services()` {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:54:52.808885 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edee6db8-175f-4169-b63e-2cbe3858c055 None None] Authenticating user token {{(pid=352328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:54:52.810059 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b3971b6-988a-434b-b90d-c8e971e30dff None admin] RBAC: Authorization granted {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:54:52.822082 dv-cinder-851351-1-smb devstack@keystone.service[352329]: [pid: 352329|app: 0|req: 523/1066] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 08:54:52 2022] GET /identity/v3/services?type=image => generated 350 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 08:54:52.823311 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b3971b6-988a-434b-b90d-c8e971e30dff None admin] Authenticating user token {{(pid=352329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:54:52.888408 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG dbcounter [-] [352328] Writing DB stats keystone:SELECT=100 {{(pid=352328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:54:52.908058 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edee6db8-175f-4169-b63e-2cbe3858c055 None None] Validating token access rules against request {{(pid=352328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:54:52.921643 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG dbcounter [-] [352329] Writing DB stats keystone:SELECT=100 {{(pid=352329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:54:52.924568 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b3971b6-988a-434b-b90d-c8e971e30dff None admin] Validating token access rules against request {{(pid=352329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:54:52.945365 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9000c22-9fa6-4b01-af98-876d4d7b3504 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:54:52.946055 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9000c22-9fa6-4b01-af98-876d4d7b3504 None admin] REQUEST_METHOD: `PUT` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:54:52.946332 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9000c22-9fa6-4b01-af98-876d4d7b3504 None admin] SCRIPT_NAME: `/identity` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:54:52.946606 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9000c22-9fa6-4b01-af98-876d4d7b3504 None admin] PATH_INFO: `/v3/projects/bfcd60e891d347e9b21fff5dd9459e3b/users/0c1ec7598e194e5c8438d3878efb38c7/roles/280023171b4a45efb67c036ff237bb3c` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:54:52.948681 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9000c22-9fa6-4b01-af98-876d4d7b3504 None admin] RBAC: Authorizing `identity:create_grant(project_id=bfcd60e891d347e9b21fff5dd9459e3b, user_id=0c1ec7598e194e5c8438d3878efb38c7, role_id=280023171b4a45efb67c036ff237bb3c)` {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:54:52.950075 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9000c22-9fa6-4b01-af98-876d4d7b3504 None admin] RBAC: Authorization granted {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:54:52.958852 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26afdf38-192a-4ff6-8fb1-f332308795d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:54:52.959493 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26afdf38-192a-4ff6-8fb1-f332308795d4 None admin] REQUEST_METHOD: `POST` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:54:52.959801 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26afdf38-192a-4ff6-8fb1-f332308795d4 None admin] SCRIPT_NAME: `/identity` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:54:52.960107 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26afdf38-192a-4ff6-8fb1-f332308795d4 None admin] PATH_INFO: `/v3/endpoints` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:54:52.961003 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26afdf38-192a-4ff6-8fb1-f332308795d4 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:54:52.962374 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26afdf38-192a-4ff6-8fb1-f332308795d4 None admin] RBAC: Authorization granted {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:54:52.975696 dv-cinder-851351-1-smb devstack@keystone.service[352328]: [pid: 352328|app: 0|req: 544/1067] 10.222.0.42 () {58 vars in 1439 bytes} [Thu Jul 28 08:54:52 2022] PUT /identity/v3/projects/bfcd60e891d347e9b21fff5dd9459e3b/users/0c1ec7598e194e5c8438d3878efb38c7/roles/280023171b4a45efb67c036ff237bb3c => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 08:54:52.975696 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9000c22-9fa6-4b01-af98-876d4d7b3504 None admin] Authenticating user token {{(pid=352328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:54:52.990687 dv-cinder-851351-1-smb devstack@keystone.service[352329]: [pid: 352329|app: 0|req: 524/1068] 10.222.0.42 () {60 vars in 1144 bytes} [Thu Jul 28 08:54:52 2022] POST /identity/v3/endpoints => generated 327 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 08:54:53.108302 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9000c22-9fa6-4b01-af98-876d4d7b3504 None admin] Validating token access rules against request {{(pid=352328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:54:53.160496 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d62a6d38-0d69-419b-a935-781ffe09c613 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:54:53.161188 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62a6d38-0d69-419b-a935-781ffe09c613 None admin] REQUEST_METHOD: `GET` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:54:53.161465 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62a6d38-0d69-419b-a935-781ffe09c613 None admin] SCRIPT_NAME: `/identity` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:54:53.161734 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62a6d38-0d69-419b-a935-781ffe09c613 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:54:53.170176 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG dbcounter [-] [352328] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=352328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:54:53.173338 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d62a6d38-0d69-419b-a935-781ffe09c613 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 08:54:53.178897 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application [None req-d62a6d38-0d69-419b-a935-781ffe09c613 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 28 08:54:53.178897 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:54:53.178897 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:54:53.178897 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:54:53.178897 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:54:53.178897 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:54:53.178897 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:54:53.178897 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:54:53.178897 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:54:53.178897 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:54:53.178897 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:54:53.178897 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:54:53.178897 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 08:54:53.178897 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 08:54:53.178897 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 08:54:53.178897 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 08:54:53.180083 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 08:54:53.180083 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 08:54:53.180083 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 08:54:53.180083 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 08:54:53.180083 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:54:53.180083 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:54:53.180083 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:54:53.180083 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:54:53.180083 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:54:53.180083 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:54:53.180083 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:54:53.180083 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application with Lock( Jul 28 08:54:53.180083 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:54:53.180083 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:54:53.180083 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:54:53.180083 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:54:53.181198 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:54:53.181198 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:54:53.181198 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:54:53.181198 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:54:53.181198 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 08:54:53.181198 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 08:54:53.181198 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 08:54:53.181198 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 08:54:53.181198 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 08:54:53.181198 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 08:54:53.181198 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 28 08:54:53.181198 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application Jul 28 08:54:53.181198 dv-cinder-851351-1-smb devstack@keystone.service[352328]: [pid: 352328|app: 0|req: 545/1069] 10.222.0.42 () {56 vars in 1120 bytes} [Thu Jul 28 08:54:52 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:54:53.186830 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26afdf38-192a-4ff6-8fb1-f332308795d4 None admin] Authenticating user token {{(pid=352329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:54:53.294182 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26afdf38-192a-4ff6-8fb1-f332308795d4 None admin] Validating token access rules against request {{(pid=352329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:54:53.329561 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c162f4d6-3485-4c8c-9a38-9eeae5334ed9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:54:53.330211 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c162f4d6-3485-4c8c-9a38-9eeae5334ed9 None admin] REQUEST_METHOD: `GET` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:54:53.330495 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c162f4d6-3485-4c8c-9a38-9eeae5334ed9 None admin] SCRIPT_NAME: `/identity` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:54:53.330771 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c162f4d6-3485-4c8c-9a38-9eeae5334ed9 None admin] PATH_INFO: `/v3/roles` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:54:53.331505 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c162f4d6-3485-4c8c-9a38-9eeae5334ed9 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=352329) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:54:53.331815 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c162f4d6-3485-4c8c-9a38-9eeae5334ed9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:54:53.333259 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c162f4d6-3485-4c8c-9a38-9eeae5334ed9 None admin] RBAC: Authorization granted {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:54:53.341866 dv-cinder-851351-1-smb devstack@keystone.service[352329]: [pid: 352329|app: 0|req: 525/1070] 10.222.0.42 () {56 vars in 1115 bytes} [Thu Jul 28 08:54:53 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:54:53.347924 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d62a6d38-0d69-419b-a935-781ffe09c613 None admin] Authenticating user token {{(pid=352328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:54:53.451744 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d62a6d38-0d69-419b-a935-781ffe09c613 None admin] Validating token access rules against request {{(pid=352328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:54:53.488540 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89880b0d-5aad-48e9-a395-201c2c10ca8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:54:53.489233 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89880b0d-5aad-48e9-a395-201c2c10ca8c None admin] REQUEST_METHOD: `GET` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:54:53.489519 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89880b0d-5aad-48e9-a395-201c2c10ca8c None admin] SCRIPT_NAME: `/identity` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:54:53.489796 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89880b0d-5aad-48e9-a395-201c2c10ca8c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:54:53.500852 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89880b0d-5aad-48e9-a395-201c2c10ca8c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:54:53.502337 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89880b0d-5aad-48e9-a395-201c2c10ca8c None admin] RBAC: Authorization granted {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:54:53.517987 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application [None req-89880b0d-5aad-48e9-a395-201c2c10ca8c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 08:54:53.517987 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:54:53.517987 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:54:53.517987 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:54:53.517987 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:54:53.517987 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:54:53.517987 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:54:53.517987 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:54:53.517987 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:54:53.517987 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:54:53.517987 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:54:53.517987 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:54:53.517987 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 08:54:53.517987 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 08:54:53.517987 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 08:54:53.519959 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 08:54:53.519959 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:54:53.519959 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:54:53.519959 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:54:53.519959 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:54:53.519959 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:54:53.519959 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:54:53.519959 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:54:53.519959 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application with Lock( Jul 28 08:54:53.519959 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:54:53.519959 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:54:53.519959 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:54:53.519959 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:54:53.519959 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:54:53.519959 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:54:53.519959 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:54:53.519959 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:54:53.522395 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 08:54:53.522395 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 08:54:53.522395 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 08:54:53.522395 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application Jul 28 08:54:53.524699 dv-cinder-851351-1-smb devstack@keystone.service[352328]: [pid: 352328|app: 0|req: 546/1071] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 08:54:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:54:53.525182 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c162f4d6-3485-4c8c-9a38-9eeae5334ed9 None admin] Authenticating user token {{(pid=352329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:54:53.545566 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG dbcounter [-] [352329] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=352329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:54:53.629238 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c162f4d6-3485-4c8c-9a38-9eeae5334ed9 None admin] Validating token access rules against request {{(pid=352329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:54:53.664831 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfbf7d34-3ad7-4c37-8ea3-315ac57d1250 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:54:53.665468 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbf7d34-3ad7-4c37-8ea3-315ac57d1250 None admin] REQUEST_METHOD: `GET` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:54:53.665757 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbf7d34-3ad7-4c37-8ea3-315ac57d1250 None admin] SCRIPT_NAME: `/identity` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:54:53.666006 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbf7d34-3ad7-4c37-8ea3-315ac57d1250 None admin] PATH_INFO: `/v3/domains` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:54:53.666741 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfbf7d34-3ad7-4c37-8ea3-315ac57d1250 None admin] RBAC: Adding query filter params (name=Default) {{(pid=352329) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:54:53.667067 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfbf7d34-3ad7-4c37-8ea3-315ac57d1250 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:54:53.668433 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfbf7d34-3ad7-4c37-8ea3-315ac57d1250 None admin] RBAC: Authorization granted {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:54:53.686221 dv-cinder-851351-1-smb devstack@keystone.service[352329]: [pid: 352329|app: 0|req: 526/1072] 10.222.0.42 () {56 vars in 1109 bytes} [Thu Jul 28 08:54:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:54:53.687510 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89880b0d-5aad-48e9-a395-201c2c10ca8c None admin] Authenticating user token {{(pid=352328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:54:53.742349 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG dbcounter [-] [352328] Writing DB stats keystone:SELECT=100 {{(pid=352328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:54:53.796157 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89880b0d-5aad-48e9-a395-201c2c10ca8c None admin] Validating token access rules against request {{(pid=352328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:54:53.830671 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b1bc21-b2ab-44c6-9ba7-94441e996520 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:54:53.831333 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b1bc21-b2ab-44c6-9ba7-94441e996520 None admin] REQUEST_METHOD: `GET` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:54:53.831617 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b1bc21-b2ab-44c6-9ba7-94441e996520 None admin] SCRIPT_NAME: `/identity` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:54:53.831893 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b1bc21-b2ab-44c6-9ba7-94441e996520 None admin] PATH_INFO: `/v3/users/nova` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:54:53.839736 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b1bc21-b2ab-44c6-9ba7-94441e996520 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:54:53.841266 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b1bc21-b2ab-44c6-9ba7-94441e996520 None admin] RBAC: Authorization granted {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:54:53.852941 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application [None req-c0b1bc21-b2ab-44c6-9ba7-94441e996520 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 28 08:54:53.852941 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:54:53.852941 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:54:53.852941 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:54:53.852941 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:54:53.852941 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:54:53.852941 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:54:53.852941 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:54:53.852941 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:54:53.852941 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:54:53.852941 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:54:53.852941 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:54:53.852941 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 28 08:54:53.852941 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 28 08:54:53.852941 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 28 08:54:53.852941 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 28 08:54:53.854104 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:54:53.854104 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:54:53.854104 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 28 08:54:53.854104 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 08:54:53.854104 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 28 08:54:53.854104 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 08:54:53.854104 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:54:53.854104 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:54:53.854104 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:54:53.854104 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:54:53.854104 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:54:53.854104 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application with Lock( Jul 28 08:54:53.854104 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:54:53.854104 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:54:53.854104 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:54:53.854104 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:54:53.854104 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:54:53.854104 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:54:53.855310 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:54:53.855310 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:54:53.855310 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 28 08:54:53.855310 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 28 08:54:53.855310 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 28 08:54:53.855310 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 28 08:54:53.855310 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 28 08:54:53.855310 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 28 08:54:53.855310 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 28 08:54:53.855310 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application Jul 28 08:54:53.855310 dv-cinder-851351-1-smb devstack@keystone.service[352328]: [pid: 352328|app: 0|req: 547/1073] 10.222.0.42 () {56 vars in 1093 bytes} [Thu Jul 28 08:54:53 2022] GET /identity/v3/users/nova => generated 82 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:54:53.860236 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfbf7d34-3ad7-4c37-8ea3-315ac57d1250 None admin] Authenticating user token {{(pid=352329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:54:53.940036 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG dbcounter [-] [352329] Writing DB stats keystone:SELECT=100 {{(pid=352329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:54:53.964127 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfbf7d34-3ad7-4c37-8ea3-315ac57d1250 None admin] Validating token access rules against request {{(pid=352329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:54:53.999592 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d59acb1-0332-4141-bbf6-5a26d4cd8107 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:54:54.000245 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d59acb1-0332-4141-bbf6-5a26d4cd8107 None admin] REQUEST_METHOD: `GET` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:54:54.000523 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d59acb1-0332-4141-bbf6-5a26d4cd8107 None admin] SCRIPT_NAME: `/identity` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:54:54.000837 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d59acb1-0332-4141-bbf6-5a26d4cd8107 None admin] PATH_INFO: `/v3/users` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:54:54.001640 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d59acb1-0332-4141-bbf6-5a26d4cd8107 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=352329) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:54:54.001940 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d59acb1-0332-4141-bbf6-5a26d4cd8107 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:54:54.003441 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d59acb1-0332-4141-bbf6-5a26d4cd8107 None admin] RBAC: Authorization granted {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:54:54.030010 dv-cinder-851351-1-smb devstack@keystone.service[352329]: [pid: 352329|app: 0|req: 527/1074] 10.222.0.42 () {56 vars in 1133 bytes} [Thu Jul 28 08:54:53 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:54:54.031443 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b1bc21-b2ab-44c6-9ba7-94441e996520 None admin] Authenticating user token {{(pid=352328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:54:54.137021 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b1bc21-b2ab-44c6-9ba7-94441e996520 None admin] Validating token access rules against request {{(pid=352328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:54:54.152688 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG dbcounter [-] [352328] Writing DB stats keystone:SELECT=100 {{(pid=352328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:54:54.173182 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f4c250-ef6f-4d07-a56d-a53f4063184b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:54:54.173837 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f4c250-ef6f-4d07-a56d-a53f4063184b None admin] REQUEST_METHOD: `GET` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:54:54.174116 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f4c250-ef6f-4d07-a56d-a53f4063184b None admin] SCRIPT_NAME: `/identity` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:54:54.174391 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f4c250-ef6f-4d07-a56d-a53f4063184b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:54:54.186400 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f4c250-ef6f-4d07-a56d-a53f4063184b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:54:54.188053 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f4c250-ef6f-4d07-a56d-a53f4063184b None admin] RBAC: Authorization granted {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:54:54.205555 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application [None req-b4f4c250-ef6f-4d07-a56d-a53f4063184b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 08:54:54.205555 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:54:54.205555 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:54:54.205555 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:54:54.205555 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:54:54.205555 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:54:54.205555 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:54:54.205555 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:54:54.205555 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:54:54.205555 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:54:54.205555 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:54:54.205555 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:54:54.205555 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 08:54:54.205555 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 08:54:54.205555 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 08:54:54.206780 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 08:54:54.206780 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:54:54.206780 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:54:54.206780 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:54:54.206780 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:54:54.206780 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:54:54.206780 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:54:54.206780 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:54:54.206780 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application with Lock( Jul 28 08:54:54.206780 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:54:54.206780 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:54:54.206780 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:54:54.206780 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:54:54.206780 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:54:54.206780 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:54:54.206780 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:54:54.206780 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:54:54.208380 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 08:54:54.208380 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 08:54:54.208380 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 08:54:54.208380 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application Jul 28 08:54:54.208971 dv-cinder-851351-1-smb devstack@keystone.service[352328]: [pid: 352328|app: 0|req: 548/1075] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 08:54:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:54:54.212597 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d59acb1-0332-4141-bbf6-5a26d4cd8107 None admin] Authenticating user token {{(pid=352329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:54:54.330647 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d59acb1-0332-4141-bbf6-5a26d4cd8107 None admin] Validating token access rules against request {{(pid=352329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:54:54.369972 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faac5222-5157-48c1-bafe-5546b78b36fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:54:54.370610 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faac5222-5157-48c1-bafe-5546b78b36fc None admin] REQUEST_METHOD: `GET` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:54:54.370895 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faac5222-5157-48c1-bafe-5546b78b36fc None admin] SCRIPT_NAME: `/identity` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:54:54.371181 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faac5222-5157-48c1-bafe-5546b78b36fc None admin] PATH_INFO: `/v3/domains` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:54:54.371883 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faac5222-5157-48c1-bafe-5546b78b36fc None admin] RBAC: Adding query filter params (name=Default) {{(pid=352329) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:54:54.372258 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faac5222-5157-48c1-bafe-5546b78b36fc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:54:54.373715 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faac5222-5157-48c1-bafe-5546b78b36fc None admin] RBAC: Authorization granted {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:54:54.376345 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG dbcounter [-] [352329] Writing DB stats keystone:SELECT=100 {{(pid=352329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:54:54.391992 dv-cinder-851351-1-smb devstack@keystone.service[352329]: [pid: 352329|app: 0|req: 528/1076] 10.222.0.42 () {56 vars in 1109 bytes} [Thu Jul 28 08:54:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:54:54.393759 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f4c250-ef6f-4d07-a56d-a53f4063184b None admin] Authenticating user token {{(pid=352328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:54:54.500413 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f4c250-ef6f-4d07-a56d-a53f4063184b None admin] Validating token access rules against request {{(pid=352328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:54:54.538050 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86adf885-86b9-478a-8177-9f9389d52d2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:54:54.538706 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86adf885-86b9-478a-8177-9f9389d52d2b None admin] REQUEST_METHOD: `GET` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:54:54.538992 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86adf885-86b9-478a-8177-9f9389d52d2b None admin] SCRIPT_NAME: `/identity` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:54:54.539269 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86adf885-86b9-478a-8177-9f9389d52d2b None admin] PATH_INFO: `/v3/projects/service` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:54:54.546634 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86adf885-86b9-478a-8177-9f9389d52d2b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:54:54.548214 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86adf885-86b9-478a-8177-9f9389d52d2b None admin] RBAC: Authorization granted {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:54:54.560041 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application [None req-86adf885-86b9-478a-8177-9f9389d52d2b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 08:54:54.560041 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:54:54.560041 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:54:54.560041 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:54:54.560041 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:54:54.560041 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:54:54.560041 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:54:54.560041 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:54:54.560041 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:54:54.560041 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:54:54.560041 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:54:54.560041 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:54:54.560041 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 28 08:54:54.560041 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 28 08:54:54.560041 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 28 08:54:54.561289 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 28 08:54:54.561289 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:54:54.561289 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:54:54.561289 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:54:54.561289 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:54:54.561289 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:54:54.561289 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:54:54.561289 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:54:54.561289 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application with Lock( Jul 28 08:54:54.561289 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:54:54.561289 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:54:54.561289 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:54:54.561289 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:54:54.561289 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:54:54.561289 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:54:54.561289 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:54:54.561289 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:54:54.562475 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 28 08:54:54.562475 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 28 08:54:54.562475 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 28 08:54:54.562475 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 28 08:54:54.562475 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 28 08:54:54.562475 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 28 08:54:54.562475 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 08:54:54.562475 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application Jul 28 08:54:54.562475 dv-cinder-851351-1-smb devstack@keystone.service[352328]: [pid: 352328|app: 0|req: 549/1077] 10.222.0.42 () {56 vars in 1111 bytes} [Thu Jul 28 08:54:54 2022] GET /identity/v3/projects/service => generated 88 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 08:54:54.569382 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faac5222-5157-48c1-bafe-5546b78b36fc None admin] Authenticating user token {{(pid=352329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:54:54.679301 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faac5222-5157-48c1-bafe-5546b78b36fc None admin] Validating token access rules against request {{(pid=352329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:54:54.717265 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018425cd-74ef-49a9-bb3e-4090f14a7723 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:54:54.717903 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018425cd-74ef-49a9-bb3e-4090f14a7723 None admin] REQUEST_METHOD: `GET` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:54:54.718188 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018425cd-74ef-49a9-bb3e-4090f14a7723 None admin] SCRIPT_NAME: `/identity` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:54:54.718531 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018425cd-74ef-49a9-bb3e-4090f14a7723 None admin] PATH_INFO: `/v3/projects` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:54:54.719300 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-018425cd-74ef-49a9-bb3e-4090f14a7723 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=352329) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:54:54.719612 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-018425cd-74ef-49a9-bb3e-4090f14a7723 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:54:54.721103 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-018425cd-74ef-49a9-bb3e-4090f14a7723 None admin] RBAC: Authorization granted {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:54:54.734055 dv-cinder-851351-1-smb devstack@keystone.service[352329]: [pid: 352329|app: 0|req: 529/1078] 10.222.0.42 () {56 vars in 1148 bytes} [Thu Jul 28 08:54:54 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:54:54.740070 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86adf885-86b9-478a-8177-9f9389d52d2b None admin] Authenticating user token {{(pid=352328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:54:54.767479 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG dbcounter [-] [352328] Writing DB stats keystone:SELECT=100 {{(pid=352328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:54:54.867299 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86adf885-86b9-478a-8177-9f9389d52d2b None admin] Validating token access rules against request {{(pid=352328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:54:54.905066 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c4d3fd0-33b4-470d-a80c-0ccf7b53183f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:54:54.906321 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4d3fd0-33b4-470d-a80c-0ccf7b53183f None admin] REQUEST_METHOD: `PUT` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:54:54.906838 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4d3fd0-33b4-470d-a80c-0ccf7b53183f None admin] SCRIPT_NAME: `/identity` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:54:54.907346 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4d3fd0-33b4-470d-a80c-0ccf7b53183f None admin] PATH_INFO: `/v3/projects/9cfa053c839a4fedacde7163d907e2a4/users/e3ba63c3fc36470fbbe8312b51a13f13/roles/15fc2297dd8749eab8d518cabaaf36f4` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:54:54.909854 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c4d3fd0-33b4-470d-a80c-0ccf7b53183f None admin] RBAC: Authorizing `identity:create_grant(project_id=9cfa053c839a4fedacde7163d907e2a4, user_id=e3ba63c3fc36470fbbe8312b51a13f13, role_id=15fc2297dd8749eab8d518cabaaf36f4)` {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:54:54.911558 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c4d3fd0-33b4-470d-a80c-0ccf7b53183f None admin] RBAC: Authorization granted {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:54:54.926139 dv-cinder-851351-1-smb devstack@keystone.service[352328]: [pid: 352328|app: 0|req: 550/1079] 10.222.0.42 () {58 vars in 1439 bytes} [Thu Jul 28 08:54:54 2022] PUT /identity/v3/projects/9cfa053c839a4fedacde7163d907e2a4/users/e3ba63c3fc36470fbbe8312b51a13f13/roles/15fc2297dd8749eab8d518cabaaf36f4 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 08:54:55.001705 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c8f15f-c532-4581-8115-2c643f06f74c None None] REQUEST_METHOD: `GET` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:54:55.002273 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c8f15f-c532-4581-8115-2c643f06f74c None None] SCRIPT_NAME: `/identity` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:54:55.002368 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c8f15f-c532-4581-8115-2c643f06f74c None None] PATH_INFO: `/` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:54:55.004640 dv-cinder-851351-1-smb devstack@keystone.service[352329]: [pid: 352329|app: 0|req: 530/1080] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 08:54:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 08:54:55.011224 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483b7620-4126-4e26-92c7-dd43d1d61dcf None None] REQUEST_METHOD: `POST` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:54:55.011498 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483b7620-4126-4e26-92c7-dd43d1d61dcf None None] SCRIPT_NAME: `/identity` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:54:55.011740 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483b7620-4126-4e26-92c7-dd43d1d61dcf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:54:55.037482 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.auth.core [None req-483b7620-4126-4e26-92c7-dd43d1d61dcf None None] MFA Rules not processed for user `d18c063b2377412485965357671e5506`. Rule list: `[]` (Enabled: `True`). {{(pid=352328) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 08:54:55.038775 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.fernet_utils [None req-483b7620-4126-4e26-92c7-dd43d1d61dcf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=352328) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:54:55.134713 dv-cinder-851351-1-smb devstack@keystone.service[352328]: [pid: 352328|app: 0|req: 551/1081] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 08:54:55 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 08:54:55.158404 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5443ef57-ba0c-4f28-b81e-6b951039e198 None None] REQUEST_METHOD: `GET` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:54:55.158686 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5443ef57-ba0c-4f28-b81e-6b951039e198 None None] SCRIPT_NAME: `/identity` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:54:55.158988 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5443ef57-ba0c-4f28-b81e-6b951039e198 None None] PATH_INFO: `/` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:54:55.160616 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483b7620-4126-4e26-92c7-dd43d1d61dcf None None] Authenticating user token {{(pid=352328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:54:55.160805 dv-cinder-851351-1-smb devstack@keystone.service[352329]: [pid: 352329|app: 0|req: 531/1082] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 08:54:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 08:54:55.166531 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802a5ce0-f78b-41a8-9c84-131ec7a4d053 None None] REQUEST_METHOD: `POST` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:54:55.166834 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802a5ce0-f78b-41a8-9c84-131ec7a4d053 None None] SCRIPT_NAME: `/identity` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:54:55.167290 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802a5ce0-f78b-41a8-9c84-131ec7a4d053 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:54:55.178439 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG dbcounter [-] [352328] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=352328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:54:55.187253 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.auth.core [None req-802a5ce0-f78b-41a8-9c84-131ec7a4d053 None None] MFA Rules not processed for user `d18c063b2377412485965357671e5506`. Rule list: `[]` (Enabled: `True`). {{(pid=352329) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 08:54:55.188615 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.fernet_utils [None req-802a5ce0-f78b-41a8-9c84-131ec7a4d053 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=352329) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:54:55.252609 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG dbcounter [-] [352329] Writing DB stats keystone:SELECT=100 {{(pid=352329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:54:55.273332 dv-cinder-851351-1-smb devstack@keystone.service[352329]: [pid: 352329|app: 0|req: 532/1083] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 08:54:55 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 28 08:54:55.291661 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483b7620-4126-4e26-92c7-dd43d1d61dcf None None] Validating token access rules against request {{(pid=352328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:54:55.295421 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802a5ce0-f78b-41a8-9c84-131ec7a4d053 None None] Authenticating user token {{(pid=352329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:54:55.334944 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5666ea18-330e-4141-b672-e1971eb413ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:54:55.335623 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5666ea18-330e-4141-b672-e1971eb413ad None admin] REQUEST_METHOD: `GET` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:54:55.335905 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5666ea18-330e-4141-b672-e1971eb413ad None admin] SCRIPT_NAME: `/identity` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:54:55.336179 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5666ea18-330e-4141-b672-e1971eb413ad None admin] PATH_INFO: `/v3/roles/admin` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:54:55.349221 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5666ea18-330e-4141-b672-e1971eb413ad None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 08:54:55.354215 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application [None req-5666ea18-330e-4141-b672-e1971eb413ad None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 08:54:55.354215 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:54:55.354215 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:54:55.354215 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:54:55.354215 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:54:55.354215 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:54:55.354215 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:54:55.354215 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:54:55.354215 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:54:55.354215 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:54:55.354215 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:54:55.354215 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:54:55.354215 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 08:54:55.354215 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 08:54:55.354215 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 08:54:55.354215 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 08:54:55.355447 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 08:54:55.355447 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 08:54:55.355447 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 08:54:55.355447 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 08:54:55.355447 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:54:55.355447 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:54:55.355447 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:54:55.355447 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:54:55.355447 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:54:55.355447 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:54:55.355447 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:54:55.355447 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application with Lock( Jul 28 08:54:55.355447 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:54:55.355447 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:54:55.355447 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:54:55.355447 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:54:55.356528 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:54:55.356528 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:54:55.356528 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:54:55.356528 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:54:55.356528 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 08:54:55.356528 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 08:54:55.356528 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 08:54:55.356528 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 08:54:55.356528 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 08:54:55.356528 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 08:54:55.356528 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 08:54:55.356528 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application Jul 28 08:54:55.356528 dv-cinder-851351-1-smb devstack@keystone.service[352328]: [pid: 352328|app: 0|req: 552/1084] 10.222.0.42 () {56 vars in 1096 bytes} [Thu Jul 28 08:54:55 2022] GET /identity/v3/roles/admin => generated 83 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 08:54:55.362223 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5666ea18-330e-4141-b672-e1971eb413ad None admin] Authenticating user token {{(pid=352328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:54:55.410633 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802a5ce0-f78b-41a8-9c84-131ec7a4d053 None None] Validating token access rules against request {{(pid=352329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:54:55.446215 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG dbcounter [-] [352328] Writing DB stats keystone:SELECT=100 {{(pid=352328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:54:55.452892 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88329992-fa81-4ecd-abbe-9cf08c3ebf46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:54:55.453557 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88329992-fa81-4ecd-abbe-9cf08c3ebf46 None admin] REQUEST_METHOD: `GET` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:54:55.454056 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88329992-fa81-4ecd-abbe-9cf08c3ebf46 None admin] SCRIPT_NAME: `/identity` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:54:55.454561 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88329992-fa81-4ecd-abbe-9cf08c3ebf46 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:54:55.479841 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5666ea18-330e-4141-b672-e1971eb413ad None admin] Validating token access rules against request {{(pid=352328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:54:55.526480 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG dbcounter [-] [352329] Writing DB stats keystone:SELECT=100 {{(pid=352329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:54:55.526976 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4cb17a-7602-4e43-9692-4a41ee94a021 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:54:55.527943 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4cb17a-7602-4e43-9692-4a41ee94a021 None admin] REQUEST_METHOD: `GET` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:54:55.528266 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4cb17a-7602-4e43-9692-4a41ee94a021 None admin] SCRIPT_NAME: `/identity` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:54:55.528711 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4cb17a-7602-4e43-9692-4a41ee94a021 None admin] PATH_INFO: `/v3/roles` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:54:55.529667 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b4cb17a-7602-4e43-9692-4a41ee94a021 None admin] RBAC: Adding query filter params (name=admin) {{(pid=352328) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:54:55.530067 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b4cb17a-7602-4e43-9692-4a41ee94a021 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:54:55.532556 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b4cb17a-7602-4e43-9692-4a41ee94a021 None admin] RBAC: Authorization granted {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:54:55.552517 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88329992-fa81-4ecd-abbe-9cf08c3ebf46 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:54:55.554374 dv-cinder-851351-1-smb devstack@keystone.service[352328]: [pid: 352328|app: 0|req: 553/1085] 10.222.0.42 () {56 vars in 1099 bytes} [Thu Jul 28 08:54:55 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 08:54:55.555615 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88329992-fa81-4ecd-abbe-9cf08c3ebf46 None admin] RBAC: Authorization granted {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:54:55.556157 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4cb17a-7602-4e43-9692-4a41ee94a021 None admin] Authenticating user token {{(pid=352328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:54:55.691240 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4cb17a-7602-4e43-9692-4a41ee94a021 None admin] Validating token access rules against request {{(pid=352328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:54:55.692949 dv-cinder-851351-1-smb devstack@keystone.service[352329]: [pid: 352329|app: 0|req: 533/1086] 10.222.0.42 () {58 vars in 1282 bytes} [Thu Jul 28 08:54:55 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 398 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jul 28 08:54:55.699057 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88329992-fa81-4ecd-abbe-9cf08c3ebf46 None admin] Authenticating user token {{(pid=352329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:54:55.732299 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b52fe6-a8aa-4142-acf1-508a5d9e19a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:54:55.732988 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b52fe6-a8aa-4142-acf1-508a5d9e19a6 None admin] REQUEST_METHOD: `GET` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:54:55.733266 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b52fe6-a8aa-4142-acf1-508a5d9e19a6 None admin] SCRIPT_NAME: `/identity` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:54:55.733537 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b52fe6-a8aa-4142-acf1-508a5d9e19a6 None admin] PATH_INFO: `/v3/users/0c1ec7598e194e5c8438d3878efb38c7` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:54:55.734831 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10b52fe6-a8aa-4142-acf1-508a5d9e19a6 None admin] RBAC: Authorizing `identity:get_user(user_id=0c1ec7598e194e5c8438d3878efb38c7)` {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:54:55.736291 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10b52fe6-a8aa-4142-acf1-508a5d9e19a6 None admin] RBAC: Authorization granted {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:54:55.738168 dv-cinder-851351-1-smb devstack@keystone.service[352328]: [pid: 352328|app: 0|req: 554/1087] 10.222.0.42 () {56 vars in 1177 bytes} [Thu Jul 28 08:54:55 2022] GET /identity/v3/users/0c1ec7598e194e5c8438d3878efb38c7 => generated 285 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 08:54:55.743825 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b52fe6-a8aa-4142-acf1-508a5d9e19a6 None admin] Authenticating user token {{(pid=352328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:54:55.746835 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG dbcounter [-] [352328] Writing DB stats keystone:SELECT=100 {{(pid=352328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:54:55.788743 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG dbcounter [-] [352329] Writing DB stats keystone:SELECT=100 {{(pid=352329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:54:55.804698 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88329992-fa81-4ecd-abbe-9cf08c3ebf46 None admin] Validating token access rules against request {{(pid=352329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:54:55.848002 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce62828-d60f-44b8-a31d-bead44ed51a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:54:55.849072 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce62828-d60f-44b8-a31d-bead44ed51a4 None admin] REQUEST_METHOD: `GET` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:54:55.849359 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce62828-d60f-44b8-a31d-bead44ed51a4 None admin] SCRIPT_NAME: `/identity` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:54:55.849783 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce62828-d60f-44b8-a31d-bead44ed51a4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:54:55.855043 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b52fe6-a8aa-4142-acf1-508a5d9e19a6 None admin] Validating token access rules against request {{(pid=352328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:54:55.860770 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ce62828-d60f-44b8-a31d-bead44ed51a4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:54:55.862225 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ce62828-d60f-44b8-a31d-bead44ed51a4 None admin] RBAC: Authorization granted {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:54:55.878233 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application [None req-6ce62828-d60f-44b8-a31d-bead44ed51a4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 08:54:55.878233 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:54:55.878233 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:54:55.878233 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:54:55.878233 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:54:55.878233 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:54:55.878233 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:54:55.878233 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:54:55.878233 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:54:55.878233 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:54:55.878233 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:54:55.878233 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:54:55.878233 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 08:54:55.878233 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 08:54:55.878233 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 08:54:55.879410 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 08:54:55.879410 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:54:55.879410 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:54:55.879410 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:54:55.879410 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:54:55.879410 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:54:55.879410 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:54:55.879410 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:54:55.879410 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application with Lock( Jul 28 08:54:55.879410 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:54:55.879410 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:54:55.879410 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:54:55.879410 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:54:55.879410 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:54:55.879410 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:54:55.879410 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:54:55.879410 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:54:55.880933 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 08:54:55.880933 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 08:54:55.880933 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 08:54:55.880933 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application Jul 28 08:54:55.880933 dv-cinder-851351-1-smb devstack@keystone.service[352329]: [pid: 352329|app: 0|req: 534/1088] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 08:54:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:54:55.885585 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce62828-d60f-44b8-a31d-bead44ed51a4 None admin] Authenticating user token {{(pid=352329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:54:55.893194 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83aab40e-f221-41e3-a8a4-93602105543e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:54:55.893833 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83aab40e-f221-41e3-a8a4-93602105543e None admin] REQUEST_METHOD: `GET` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:54:55.894116 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83aab40e-f221-41e3-a8a4-93602105543e None admin] SCRIPT_NAME: `/identity` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:54:55.894394 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83aab40e-f221-41e3-a8a4-93602105543e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:54:55.968232 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83aab40e-f221-41e3-a8a4-93602105543e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:54:55.969706 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83aab40e-f221-41e3-a8a4-93602105543e None admin] RBAC: Authorization granted {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:54:55.971625 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG dbcounter [-] [352328] Writing DB stats keystone:SELECT=100 {{(pid=352328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:54:55.995145 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce62828-d60f-44b8-a31d-bead44ed51a4 None admin] Validating token access rules against request {{(pid=352329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:54:56.029282 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c69af8-6913-4b26-bb04-49a306e28836 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:54:56.029962 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c69af8-6913-4b26-bb04-49a306e28836 None admin] REQUEST_METHOD: `GET` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:54:56.030440 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c69af8-6913-4b26-bb04-49a306e28836 None admin] SCRIPT_NAME: `/identity` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:54:56.030745 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c69af8-6913-4b26-bb04-49a306e28836 None admin] PATH_INFO: `/v3/domains` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:54:56.031431 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07c69af8-6913-4b26-bb04-49a306e28836 None admin] RBAC: Adding query filter params (name=Default) {{(pid=352329) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:54:56.032013 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07c69af8-6913-4b26-bb04-49a306e28836 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:54:56.033154 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07c69af8-6913-4b26-bb04-49a306e28836 None admin] RBAC: Authorization granted {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:54:56.040557 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG dbcounter [-] [352329] Writing DB stats keystone:SELECT=100 {{(pid=352329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:54:56.057421 dv-cinder-851351-1-smb devstack@keystone.service[352329]: [pid: 352329|app: 0|req: 535/1089] 10.222.0.42 () {56 vars in 1109 bytes} [Thu Jul 28 08:54:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 08:54:56.101941 dv-cinder-851351-1-smb devstack@keystone.service[352328]: [pid: 352328|app: 0|req: 555/1090] 10.222.0.42 () {58 vars in 1282 bytes} [Thu Jul 28 08:54:55 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 358 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jul 28 08:54:56.108508 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c69af8-6913-4b26-bb04-49a306e28836 None admin] Authenticating user token {{(pid=352329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:54:56.225435 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c69af8-6913-4b26-bb04-49a306e28836 None admin] Validating token access rules against request {{(pid=352329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:54:56.261243 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b48a104-cf1a-4f7d-bbb1-50eb773245b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:54:56.261915 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b48a104-cf1a-4f7d-bbb1-50eb773245b4 None admin] REQUEST_METHOD: `GET` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:54:56.262190 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b48a104-cf1a-4f7d-bbb1-50eb773245b4 None admin] SCRIPT_NAME: `/identity` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:54:56.262469 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b48a104-cf1a-4f7d-bbb1-50eb773245b4 None admin] PATH_INFO: `/v3/projects/bfcd60e891d347e9b21fff5dd9459e3b` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:54:56.263653 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b48a104-cf1a-4f7d-bbb1-50eb773245b4 None admin] RBAC: Authorizing `identity:get_project(project_id=bfcd60e891d347e9b21fff5dd9459e3b)` {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:54:56.265174 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b48a104-cf1a-4f7d-bbb1-50eb773245b4 None admin] RBAC: Authorization granted {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:54:56.266884 dv-cinder-851351-1-smb devstack@keystone.service[352329]: [pid: 352329|app: 0|req: 536/1091] 10.222.0.42 () {56 vars in 1186 bytes} [Thu Jul 28 08:54:56 2022] GET /identity/v3/projects/bfcd60e891d347e9b21fff5dd9459e3b => generated 311 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:54:56.273381 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83aab40e-f221-41e3-a8a4-93602105543e None admin] Authenticating user token {{(pid=352328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:54:56.379260 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83aab40e-f221-41e3-a8a4-93602105543e None admin] Validating token access rules against request {{(pid=352328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:54:56.380862 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG dbcounter [-] [352328] Writing DB stats keystone:SELECT=100 {{(pid=352328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:54:56.418597 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e0b642-b5ad-4e67-bb8c-3c225322bba9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:54:56.419241 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e0b642-b5ad-4e67-bb8c-3c225322bba9 None admin] REQUEST_METHOD: `GET` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:54:56.419525 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e0b642-b5ad-4e67-bb8c-3c225322bba9 None admin] SCRIPT_NAME: `/identity` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:54:56.419798 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e0b642-b5ad-4e67-bb8c-3c225322bba9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:54:56.420600 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70e0b642-b5ad-4e67-bb8c-3c225322bba9 None admin] RBAC: Adding query filter params (role.id=280023171b4a45efb67c036ff237bb3c, scope.project.id=bfcd60e891d347e9b21fff5dd9459e3b, user.id=0c1ec7598e194e5c8438d3878efb38c7) {{(pid=352328) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:54:56.420947 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70e0b642-b5ad-4e67-bb8c-3c225322bba9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:54:56.422446 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70e0b642-b5ad-4e67-bb8c-3c225322bba9 None admin] RBAC: Authorization granted {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:54:56.428527 dv-cinder-851351-1-smb devstack@keystone.service[352328]: [pid: 352328|app: 0|req: 556/1092] 10.222.0.42 () {56 vars in 1374 bytes} [Thu Jul 28 08:54:56 2022] GET /identity/v3/role_assignments?user.id=0c1ec7598e194e5c8438d3878efb38c7&scope.project.id=bfcd60e891d347e9b21fff5dd9459e3b&role.id=280023171b4a45efb67c036ff237bb3c => generated 608 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 08:54:57.001958 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac933dd6-ac1e-43b6-a8bf-0ced65eb1de8 None None] REQUEST_METHOD: `GET` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:54:57.002344 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac933dd6-ac1e-43b6-a8bf-0ced65eb1de8 None None] SCRIPT_NAME: `/identity` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:54:57.002618 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac933dd6-ac1e-43b6-a8bf-0ced65eb1de8 None None] PATH_INFO: `/` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:54:57.004636 dv-cinder-851351-1-smb devstack@keystone.service[352329]: [pid: 352329|app: 0|req: 537/1093] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 08:54:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 08:54:57.010446 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9db379e-2fb0-4020-82a1-22171118355d None None] REQUEST_METHOD: `POST` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:54:57.010769 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9db379e-2fb0-4020-82a1-22171118355d None None] SCRIPT_NAME: `/identity` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:54:57.010971 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9db379e-2fb0-4020-82a1-22171118355d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:54:57.032711 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.auth.core [None req-e9db379e-2fb0-4020-82a1-22171118355d None None] MFA Rules not processed for user `d18c063b2377412485965357671e5506`. Rule list: `[]` (Enabled: `True`). {{(pid=352328) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 08:54:57.033915 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.fernet_utils [None req-e9db379e-2fb0-4020-82a1-22171118355d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=352328) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:54:57.103864 dv-cinder-851351-1-smb devstack@keystone.service[352328]: [pid: 352328|app: 0|req: 557/1094] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 08:54:57 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 08:54:57.127528 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac933dd6-ac1e-43b6-a8bf-0ced65eb1de8 None None] Authenticating user token {{(pid=352329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:54:57.199121 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG dbcounter [-] [352329] Writing DB stats keystone:SELECT=100 {{(pid=352329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:54:57.240530 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac933dd6-ac1e-43b6-a8bf-0ced65eb1de8 None None] Validating token access rules against request {{(pid=352329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:54:57.276479 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67fc0388-d882-4f3b-afdf-5aa3b6d2fef0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:54:57.277074 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67fc0388-d882-4f3b-afdf-5aa3b6d2fef0 None admin] REQUEST_METHOD: `GET` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:54:57.277358 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67fc0388-d882-4f3b-afdf-5aa3b6d2fef0 None admin] SCRIPT_NAME: `/identity` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:54:57.277634 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67fc0388-d882-4f3b-afdf-5aa3b6d2fef0 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:54:57.288434 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67fc0388-d882-4f3b-afdf-5aa3b6d2fef0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 08:54:57.293386 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application [None req-67fc0388-d882-4f3b-afdf-5aa3b6d2fef0 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 28 08:54:57.293386 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:54:57.293386 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:54:57.293386 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:54:57.293386 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:54:57.293386 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:54:57.293386 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:54:57.293386 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:54:57.293386 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:54:57.293386 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:54:57.293386 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:54:57.293386 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:54:57.293386 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 08:54:57.293386 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 08:54:57.293386 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 08:54:57.293386 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 08:54:57.294607 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 08:54:57.294607 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 08:54:57.294607 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 08:54:57.294607 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 08:54:57.294607 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:54:57.294607 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:54:57.294607 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:54:57.294607 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:54:57.294607 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:54:57.294607 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:54:57.294607 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:54:57.294607 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application with Lock( Jul 28 08:54:57.294607 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:54:57.294607 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:54:57.294607 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:54:57.294607 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:54:57.295740 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:54:57.295740 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:54:57.295740 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:54:57.295740 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:54:57.295740 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 08:54:57.295740 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 08:54:57.295740 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 08:54:57.295740 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 08:54:57.295740 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 08:54:57.295740 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 08:54:57.295740 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 28 08:54:57.295740 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application Jul 28 08:54:57.295740 dv-cinder-851351-1-smb devstack@keystone.service[352329]: [pid: 352329|app: 0|req: 538/1095] 10.222.0.42 () {56 vars in 1120 bytes} [Thu Jul 28 08:54:57 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:54:57.301047 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9db379e-2fb0-4020-82a1-22171118355d None None] Authenticating user token {{(pid=352328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:54:57.396594 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG dbcounter [-] [352328] Writing DB stats keystone:SELECT=100 {{(pid=352328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:54:57.403632 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9db379e-2fb0-4020-82a1-22171118355d None None] Validating token access rules against request {{(pid=352328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:54:57.439022 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-662b7d90-3614-4fc6-85ed-d7d03f0291c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:54:57.439655 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662b7d90-3614-4fc6-85ed-d7d03f0291c3 None admin] REQUEST_METHOD: `GET` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:54:57.439938 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662b7d90-3614-4fc6-85ed-d7d03f0291c3 None admin] SCRIPT_NAME: `/identity` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:54:57.440213 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662b7d90-3614-4fc6-85ed-d7d03f0291c3 None admin] PATH_INFO: `/v3/roles` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:54:57.440981 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-662b7d90-3614-4fc6-85ed-d7d03f0291c3 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=352328) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:54:57.441285 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-662b7d90-3614-4fc6-85ed-d7d03f0291c3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:54:57.442677 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-662b7d90-3614-4fc6-85ed-d7d03f0291c3 None admin] RBAC: Authorization granted {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:54:57.451018 dv-cinder-851351-1-smb devstack@keystone.service[352328]: [pid: 352328|app: 0|req: 558/1096] 10.222.0.42 () {56 vars in 1115 bytes} [Thu Jul 28 08:54:57 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:54:57.457195 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67fc0388-d882-4f3b-afdf-5aa3b6d2fef0 None admin] Authenticating user token {{(pid=352329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:54:57.577473 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67fc0388-d882-4f3b-afdf-5aa3b6d2fef0 None admin] Validating token access rules against request {{(pid=352329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:54:57.605680 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG dbcounter [-] [352329] Writing DB stats keystone:SELECT=100 {{(pid=352329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:54:57.615707 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccebf62e-049c-43d9-801d-5c6477a02774 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:54:57.616367 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccebf62e-049c-43d9-801d-5c6477a02774 None admin] REQUEST_METHOD: `GET` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:54:57.616652 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccebf62e-049c-43d9-801d-5c6477a02774 None admin] SCRIPT_NAME: `/identity` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:54:57.616952 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccebf62e-049c-43d9-801d-5c6477a02774 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:54:57.627452 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccebf62e-049c-43d9-801d-5c6477a02774 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:54:57.628959 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccebf62e-049c-43d9-801d-5c6477a02774 None admin] RBAC: Authorization granted {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:54:57.645392 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application [None req-ccebf62e-049c-43d9-801d-5c6477a02774 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 08:54:57.645392 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:54:57.645392 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:54:57.645392 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:54:57.645392 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:54:57.645392 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:54:57.645392 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:54:57.645392 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:54:57.645392 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:54:57.645392 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:54:57.645392 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:54:57.645392 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:54:57.645392 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 08:54:57.645392 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 08:54:57.645392 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 08:54:57.646586 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 08:54:57.646586 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:54:57.646586 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:54:57.646586 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:54:57.646586 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:54:57.646586 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:54:57.646586 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:54:57.646586 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:54:57.646586 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application with Lock( Jul 28 08:54:57.646586 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:54:57.646586 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:54:57.646586 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:54:57.646586 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:54:57.646586 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:54:57.646586 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:54:57.646586 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:54:57.646586 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:54:57.647703 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 08:54:57.647703 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 08:54:57.647703 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 08:54:57.647703 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application Jul 28 08:54:57.647703 dv-cinder-851351-1-smb devstack@keystone.service[352329]: [pid: 352329|app: 0|req: 539/1097] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 08:54:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:54:57.652631 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-662b7d90-3614-4fc6-85ed-d7d03f0291c3 None admin] Authenticating user token {{(pid=352328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:54:57.762651 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-662b7d90-3614-4fc6-85ed-d7d03f0291c3 None admin] Validating token access rules against request {{(pid=352328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:54:57.797340 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e71760b-9142-453f-bc07-45dee13454cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:54:57.797966 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e71760b-9142-453f-bc07-45dee13454cd None admin] REQUEST_METHOD: `GET` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:54:57.798245 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e71760b-9142-453f-bc07-45dee13454cd None admin] SCRIPT_NAME: `/identity` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:54:57.798515 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e71760b-9142-453f-bc07-45dee13454cd None admin] PATH_INFO: `/v3/domains` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:54:57.799196 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e71760b-9142-453f-bc07-45dee13454cd None admin] RBAC: Adding query filter params (name=Default) {{(pid=352328) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:54:57.799499 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e71760b-9142-453f-bc07-45dee13454cd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:54:57.800908 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e71760b-9142-453f-bc07-45dee13454cd None admin] RBAC: Authorization granted {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:54:57.813291 dv-cinder-851351-1-smb devstack@keystone.service[352328]: [pid: 352328|app: 0|req: 559/1098] 10.222.0.42 () {56 vars in 1109 bytes} [Thu Jul 28 08:54:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:54:57.819246 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccebf62e-049c-43d9-801d-5c6477a02774 None admin] Authenticating user token {{(pid=352329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:54:57.933539 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccebf62e-049c-43d9-801d-5c6477a02774 None admin] Validating token access rules against request {{(pid=352329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:54:57.971284 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae45255-07ac-4f4f-97ae-c5ed787bacb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:54:57.971943 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae45255-07ac-4f4f-97ae-c5ed787bacb6 None admin] REQUEST_METHOD: `GET` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:54:57.972210 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae45255-07ac-4f4f-97ae-c5ed787bacb6 None admin] SCRIPT_NAME: `/identity` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:54:57.972478 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae45255-07ac-4f4f-97ae-c5ed787bacb6 None admin] PATH_INFO: `/v3/users/nova` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:54:57.981490 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae45255-07ac-4f4f-97ae-c5ed787bacb6 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:54:57.982976 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae45255-07ac-4f4f-97ae-c5ed787bacb6 None admin] RBAC: Authorization granted {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:54:58.000463 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application [None req-4ae45255-07ac-4f4f-97ae-c5ed787bacb6 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 28 08:54:58.000463 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:54:58.000463 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:54:58.000463 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:54:58.000463 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:54:58.000463 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:54:58.000463 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:54:58.000463 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:54:58.000463 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:54:58.000463 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:54:58.000463 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:54:58.000463 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:54:58.000463 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 28 08:54:58.000463 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 28 08:54:58.000463 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 28 08:54:58.000463 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 28 08:54:58.001780 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:54:58.001780 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:54:58.001780 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 28 08:54:58.001780 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 08:54:58.001780 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 28 08:54:58.001780 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 08:54:58.001780 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:54:58.001780 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:54:58.001780 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:54:58.001780 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:54:58.001780 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:54:58.001780 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application with Lock( Jul 28 08:54:58.001780 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:54:58.001780 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:54:58.001780 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:54:58.001780 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:54:58.001780 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:54:58.001780 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:54:58.002971 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:54:58.002971 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:54:58.002971 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 28 08:54:58.002971 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 28 08:54:58.002971 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 28 08:54:58.002971 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 28 08:54:58.002971 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 28 08:54:58.002971 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 28 08:54:58.002971 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 28 08:54:58.002971 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application Jul 28 08:54:58.002971 dv-cinder-851351-1-smb devstack@keystone.service[352329]: [pid: 352329|app: 0|req: 540/1099] 10.222.0.42 () {56 vars in 1093 bytes} [Thu Jul 28 08:54:57 2022] GET /identity/v3/users/nova => generated 82 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:54:58.008968 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e71760b-9142-453f-bc07-45dee13454cd None admin] Authenticating user token {{(pid=352328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:54:58.029612 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG dbcounter [-] [352328] Writing DB stats keystone:SELECT=100 {{(pid=352328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:54:58.126639 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e71760b-9142-453f-bc07-45dee13454cd None admin] Validating token access rules against request {{(pid=352328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:54:58.162353 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91283138-f06a-4ea8-8eea-8bd85f88a473 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:54:58.162982 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91283138-f06a-4ea8-8eea-8bd85f88a473 None admin] REQUEST_METHOD: `GET` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:54:58.163264 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91283138-f06a-4ea8-8eea-8bd85f88a473 None admin] SCRIPT_NAME: `/identity` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:54:58.163534 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91283138-f06a-4ea8-8eea-8bd85f88a473 None admin] PATH_INFO: `/v3/users` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:54:58.164335 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91283138-f06a-4ea8-8eea-8bd85f88a473 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=352328) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:54:58.164645 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91283138-f06a-4ea8-8eea-8bd85f88a473 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:54:58.166130 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91283138-f06a-4ea8-8eea-8bd85f88a473 None admin] RBAC: Authorization granted {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:54:58.186020 dv-cinder-851351-1-smb devstack@keystone.service[352328]: [pid: 352328|app: 0|req: 560/1100] 10.222.0.42 () {56 vars in 1133 bytes} [Thu Jul 28 08:54:58 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 08:54:58.191912 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae45255-07ac-4f4f-97ae-c5ed787bacb6 None admin] Authenticating user token {{(pid=352329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:54:58.234807 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG dbcounter [-] [352329] Writing DB stats keystone:SELECT=100 {{(pid=352329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:54:58.297071 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae45255-07ac-4f4f-97ae-c5ed787bacb6 None admin] Validating token access rules against request {{(pid=352329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:54:58.331385 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1927b98-1742-4651-9f52-4902597ed968 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:54:58.332017 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1927b98-1742-4651-9f52-4902597ed968 None admin] REQUEST_METHOD: `GET` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:54:58.332301 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1927b98-1742-4651-9f52-4902597ed968 None admin] SCRIPT_NAME: `/identity` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:54:58.332583 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1927b98-1742-4651-9f52-4902597ed968 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:54:58.402871 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1927b98-1742-4651-9f52-4902597ed968 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:54:58.404365 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1927b98-1742-4651-9f52-4902597ed968 None admin] RBAC: Authorization granted {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:54:58.445777 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG dbcounter [-] [352329] Writing DB stats keystone:SELECT=100 {{(pid=352329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:54:58.488421 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fcf78c3-2de5-440e-ab8c-a948c637a36d None None] REQUEST_METHOD: `GET` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:54:58.488832 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fcf78c3-2de5-440e-ab8c-a948c637a36d None None] SCRIPT_NAME: `/identity` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:54:58.489120 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fcf78c3-2de5-440e-ab8c-a948c637a36d None None] PATH_INFO: `/` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:54:58.490602 dv-cinder-851351-1-smb devstack@keystone.service[352328]: [pid: 352328|app: 0|req: 561/1101] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 08:54:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 08:54:58.496736 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15227a6-767a-4c58-891e-587e4c436896 None None] REQUEST_METHOD: `POST` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:54:58.497121 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15227a6-767a-4c58-891e-587e4c436896 None None] SCRIPT_NAME: `/identity` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:54:58.497461 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15227a6-767a-4c58-891e-587e4c436896 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:54:58.515555 dv-cinder-851351-1-smb devstack@keystone.service[352329]: [pid: 352329|app: 0|req: 541/1102] 10.222.0.42 () {58 vars in 1282 bytes} [Thu Jul 28 08:54:58 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 28 08:54:58.516952 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.auth.core [None req-e15227a6-767a-4c58-891e-587e4c436896 None None] MFA Rules not processed for user `d18c063b2377412485965357671e5506`. Rule list: `[]` (Enabled: `True`). {{(pid=352328) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 08:54:58.518189 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.fernet_utils [None req-e15227a6-767a-4c58-891e-587e4c436896 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=352328) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:54:58.521779 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1927b98-1742-4651-9f52-4902597ed968 None admin] Authenticating user token {{(pid=352329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:54:58.600988 dv-cinder-851351-1-smb devstack@keystone.service[352328]: [pid: 352328|app: 0|req: 562/1103] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 08:54:58 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 08:54:58.626245 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e15227a6-767a-4c58-891e-587e4c436896 None None] Authenticating user token {{(pid=352328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:54:58.635883 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1927b98-1742-4651-9f52-4902597ed968 None admin] Validating token access rules against request {{(pid=352329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:54:58.637725 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG dbcounter [-] [352328] Writing DB stats keystone:SELECT=100 {{(pid=352328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:54:58.672605 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f382ad6-d460-4a24-a616-f5e83fa127a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:54:58.673310 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f382ad6-d460-4a24-a616-f5e83fa127a7 None admin] REQUEST_METHOD: `GET` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:54:58.673580 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f382ad6-d460-4a24-a616-f5e83fa127a7 None admin] SCRIPT_NAME: `/identity` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:54:58.673875 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f382ad6-d460-4a24-a616-f5e83fa127a7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:54:58.680988 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG dbcounter [-] [352329] Writing DB stats keystone:SELECT=100 {{(pid=352329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:54:58.684635 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f382ad6-d460-4a24-a616-f5e83fa127a7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:54:58.686780 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f382ad6-d460-4a24-a616-f5e83fa127a7 None admin] RBAC: Authorization granted {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:54:58.702793 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application [None req-7f382ad6-d460-4a24-a616-f5e83fa127a7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 08:54:58.702793 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:54:58.702793 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:54:58.702793 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:54:58.702793 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:54:58.702793 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:54:58.702793 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:54:58.702793 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:54:58.702793 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:54:58.702793 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:54:58.702793 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:54:58.702793 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:54:58.702793 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 08:54:58.702793 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 08:54:58.702793 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 08:54:58.704044 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 08:54:58.704044 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:54:58.704044 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:54:58.704044 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:54:58.704044 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:54:58.704044 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:54:58.704044 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:54:58.704044 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:54:58.704044 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application with Lock( Jul 28 08:54:58.704044 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:54:58.704044 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:54:58.704044 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:54:58.704044 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:54:58.704044 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:54:58.704044 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:54:58.704044 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:54:58.704044 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:54:58.705735 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 08:54:58.705735 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 08:54:58.705735 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 08:54:58.705735 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application Jul 28 08:54:58.705735 dv-cinder-851351-1-smb devstack@keystone.service[352329]: [pid: 352329|app: 0|req: 542/1104] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 08:54:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 08:54:58.710208 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f382ad6-d460-4a24-a616-f5e83fa127a7 None admin] Authenticating user token {{(pid=352329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:54:58.735909 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e15227a6-767a-4c58-891e-587e4c436896 None None] Validating token access rules against request {{(pid=352328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:54:58.773209 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c045a1ad-4b4b-4c07-b90c-e39641dea585 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:54:58.773871 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c045a1ad-4b4b-4c07-b90c-e39641dea585 None admin] REQUEST_METHOD: `GET` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:54:58.774152 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c045a1ad-4b4b-4c07-b90c-e39641dea585 None admin] SCRIPT_NAME: `/identity` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:54:58.774426 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c045a1ad-4b4b-4c07-b90c-e39641dea585 None admin] PATH_INFO: `/v3/domains/default` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:54:58.775639 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c045a1ad-4b4b-4c07-b90c-e39641dea585 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:54:58.777133 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c045a1ad-4b4b-4c07-b90c-e39641dea585 None admin] RBAC: Authorization granted {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:54:58.778816 dv-cinder-851351-1-smb devstack@keystone.service[352328]: [pid: 352328|app: 0|req: 563/1105] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 08:54:58 2022] GET /identity/v3/domains/default => generated 199 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 08:54:58.784707 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c045a1ad-4b4b-4c07-b90c-e39641dea585 None admin] Authenticating user token {{(pid=352328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:54:58.812444 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f382ad6-d460-4a24-a616-f5e83fa127a7 None admin] Validating token access rules against request {{(pid=352329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:54:58.847419 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0179ff54-d132-4b55-bdb4-bf547542af4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:54:58.848056 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0179ff54-d132-4b55-bdb4-bf547542af4b None admin] REQUEST_METHOD: `GET` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:54:58.848364 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0179ff54-d132-4b55-bdb4-bf547542af4b None admin] SCRIPT_NAME: `/identity` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:54:58.848612 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0179ff54-d132-4b55-bdb4-bf547542af4b None admin] PATH_INFO: `/v3/domains` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:54:58.849357 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0179ff54-d132-4b55-bdb4-bf547542af4b None admin] RBAC: Adding query filter params (name=Default) {{(pid=352329) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:54:58.849662 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0179ff54-d132-4b55-bdb4-bf547542af4b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:54:58.851068 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0179ff54-d132-4b55-bdb4-bf547542af4b None admin] RBAC: Authorization granted {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:54:58.858852 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG dbcounter [-] [352328] Writing DB stats keystone:SELECT=100 {{(pid=352328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:54:58.864492 dv-cinder-851351-1-smb devstack@keystone.service[352329]: [pid: 352329|app: 0|req: 543/1106] 10.222.0.42 () {56 vars in 1109 bytes} [Thu Jul 28 08:54:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:54:58.870341 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0179ff54-d132-4b55-bdb4-bf547542af4b None admin] Authenticating user token {{(pid=352329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:54:58.885389 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c045a1ad-4b4b-4c07-b90c-e39641dea585 None admin] Validating token access rules against request {{(pid=352328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:54:58.919675 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG dbcounter [-] [352329] Writing DB stats keystone:SELECT=100 {{(pid=352329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:54:58.919948 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02a4707-3c13-4ffc-b356-922c9a147e76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:54:58.920585 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02a4707-3c13-4ffc-b356-922c9a147e76 None admin] REQUEST_METHOD: `POST` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:54:58.920908 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02a4707-3c13-4ffc-b356-922c9a147e76 None admin] SCRIPT_NAME: `/identity` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:54:58.921180 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02a4707-3c13-4ffc-b356-922c9a147e76 None admin] PATH_INFO: `/v3/users` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:54:58.921951 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f02a4707-3c13-4ffc-b356-922c9a147e76 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:54:58.923397 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f02a4707-3c13-4ffc-b356-922c9a147e76 None admin] RBAC: Authorization granted {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:54:58.956841 dv-cinder-851351-1-smb devstack@keystone.service[352328]: [pid: 352328|app: 0|req: 564/1107] 10.222.0.42 () {60 vars in 1132 bytes} [Thu Jul 28 08:54:58 2022] POST /identity/v3/users => generated 286 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 28 08:54:58.973743 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0179ff54-d132-4b55-bdb4-bf547542af4b None admin] Validating token access rules against request {{(pid=352329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:54:59.018141 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0cc4c5-0593-49e3-980c-236e376140e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:54:59.018832 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0cc4c5-0593-49e3-980c-236e376140e8 None admin] REQUEST_METHOD: `GET` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:54:59.019097 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0cc4c5-0593-49e3-980c-236e376140e8 None admin] SCRIPT_NAME: `/identity` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:54:59.019371 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0cc4c5-0593-49e3-980c-236e376140e8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:54:59.029870 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da0cc4c5-0593-49e3-980c-236e376140e8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:54:59.031363 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da0cc4c5-0593-49e3-980c-236e376140e8 None admin] RBAC: Authorization granted {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:54:59.044335 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application [None req-da0cc4c5-0593-49e3-980c-236e376140e8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 08:54:59.044335 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:54:59.044335 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:54:59.044335 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:54:59.044335 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:54:59.044335 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:54:59.044335 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:54:59.044335 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:54:59.044335 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:54:59.044335 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:54:59.044335 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:54:59.044335 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:54:59.044335 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 28 08:54:59.044335 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 28 08:54:59.044335 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 28 08:54:59.051206 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 28 08:54:59.051206 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:54:59.051206 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:54:59.051206 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:54:59.051206 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:54:59.051206 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:54:59.051206 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:54:59.051206 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:54:59.051206 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application with Lock( Jul 28 08:54:59.051206 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:54:59.051206 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:54:59.051206 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:54:59.051206 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:54:59.051206 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:54:59.051206 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:54:59.051206 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:54:59.051206 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:54:59.052657 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 28 08:54:59.052657 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 28 08:54:59.052657 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 28 08:54:59.052657 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 28 08:54:59.052657 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 28 08:54:59.052657 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 28 08:54:59.052657 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 08:54:59.052657 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application Jul 28 08:54:59.052657 dv-cinder-851351-1-smb devstack@keystone.service[352329]: [pid: 352329|app: 0|req: 544/1108] 10.222.0.42 () {56 vars in 1111 bytes} [Thu Jul 28 08:54:58 2022] GET /identity/v3/projects/service => generated 88 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 08:54:59.055249 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02a4707-3c13-4ffc-b356-922c9a147e76 None admin] Authenticating user token {{(pid=352328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:54:59.162720 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02a4707-3c13-4ffc-b356-922c9a147e76 None admin] Validating token access rules against request {{(pid=352328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:54:59.192573 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG dbcounter [-] [352328] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=352328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:54:59.199164 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffef2525-80de-4961-bcd0-da15f7c585a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:54:59.199966 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffef2525-80de-4961-bcd0-da15f7c585a5 None admin] REQUEST_METHOD: `GET` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:54:59.200408 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffef2525-80de-4961-bcd0-da15f7c585a5 None admin] SCRIPT_NAME: `/identity` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:54:59.200903 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffef2525-80de-4961-bcd0-da15f7c585a5 None admin] PATH_INFO: `/v3/projects` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:54:59.201675 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffef2525-80de-4961-bcd0-da15f7c585a5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=352328) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:54:59.201984 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffef2525-80de-4961-bcd0-da15f7c585a5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:54:59.203460 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffef2525-80de-4961-bcd0-da15f7c585a5 None admin] RBAC: Authorization granted {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:54:59.216213 dv-cinder-851351-1-smb devstack@keystone.service[352328]: [pid: 352328|app: 0|req: 565/1109] 10.222.0.42 () {56 vars in 1148 bytes} [Thu Jul 28 08:54:59 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:54:59.222507 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0cc4c5-0593-49e3-980c-236e376140e8 None admin] Authenticating user token {{(pid=352329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:54:59.323331 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0cc4c5-0593-49e3-980c-236e376140e8 None admin] Validating token access rules against request {{(pid=352329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:54:59.334284 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG dbcounter [-] [352329] Writing DB stats keystone:SELECT=100 {{(pid=352329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:54:59.360717 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3823d52-dacb-43af-9881-d325d140a452 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:54:59.361367 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3823d52-dacb-43af-9881-d325d140a452 None admin] REQUEST_METHOD: `GET` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:54:59.361648 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3823d52-dacb-43af-9881-d325d140a452 None admin] SCRIPT_NAME: `/identity` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:54:59.361922 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3823d52-dacb-43af-9881-d325d140a452 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:54:59.362729 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3823d52-dacb-43af-9881-d325d140a452 None admin] RBAC: Adding query filter params (role.id=15fc2297dd8749eab8d518cabaaf36f4, scope.project.id=9cfa053c839a4fedacde7163d907e2a4, user.id=e3ba63c3fc36470fbbe8312b51a13f13) {{(pid=352329) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:54:59.363041 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3823d52-dacb-43af-9881-d325d140a452 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:54:59.364478 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3823d52-dacb-43af-9881-d325d140a452 None admin] RBAC: Authorization granted {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:54:59.370624 dv-cinder-851351-1-smb devstack@keystone.service[352329]: [pid: 352329|app: 0|req: 545/1110] 10.222.0.42 () {56 vars in 1374 bytes} [Thu Jul 28 08:54:59 2022] GET /identity/v3/role_assignments?user.id=e3ba63c3fc36470fbbe8312b51a13f13&scope.project.id=9cfa053c839a4fedacde7163d907e2a4&role.id=15fc2297dd8749eab8d518cabaaf36f4 => generated 608 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:55:01.030837 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664f71c7-4494-481a-bfef-354b6b0293fe None None] REQUEST_METHOD: `GET` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:55:01.033361 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664f71c7-4494-481a-bfef-354b6b0293fe None None] SCRIPT_NAME: `/identity` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:55:01.033672 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664f71c7-4494-481a-bfef-354b6b0293fe None None] PATH_INFO: `/` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:55:01.035592 dv-cinder-851351-1-smb devstack@keystone.service[352328]: [pid: 352328|app: 0|req: 566/1111] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 08:55:01 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 08:55:01.042388 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8b2926-4e81-4a98-a902-29a843690ffc None None] REQUEST_METHOD: `POST` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:55:01.042967 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8b2926-4e81-4a98-a902-29a843690ffc None None] SCRIPT_NAME: `/identity` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:55:01.043326 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8b2926-4e81-4a98-a902-29a843690ffc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:55:01.063895 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.auth.core [None req-0f8b2926-4e81-4a98-a902-29a843690ffc None None] MFA Rules not processed for user `d18c063b2377412485965357671e5506`. Rule list: `[]` (Enabled: `True`). {{(pid=352329) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 08:55:01.065166 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.fernet_utils [None req-0f8b2926-4e81-4a98-a902-29a843690ffc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=352329) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:55:01.143053 dv-cinder-851351-1-smb devstack@keystone.service[352329]: [pid: 352329|app: 0|req: 546/1112] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 08:55:01 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 08:55:01.166725 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664f71c7-4494-481a-bfef-354b6b0293fe None None] Authenticating user token {{(pid=352328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:55:01.278625 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664f71c7-4494-481a-bfef-354b6b0293fe None None] Validating token access rules against request {{(pid=352328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:55:01.314822 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a18a93-2882-405a-852e-5750426f03d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:55:01.315472 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a18a93-2882-405a-852e-5750426f03d7 None admin] REQUEST_METHOD: `GET` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:55:01.315760 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a18a93-2882-405a-852e-5750426f03d7 None admin] SCRIPT_NAME: `/identity` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:55:01.316041 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a18a93-2882-405a-852e-5750426f03d7 None admin] PATH_INFO: `/v3/roles/a4fa43cd6d914398a0790a1516c83d08` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:55:01.317592 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60a18a93-2882-405a-852e-5750426f03d7 None admin] RBAC: Authorizing `identity:get_role(role_id=a4fa43cd6d914398a0790a1516c83d08)` {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:55:01.318978 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60a18a93-2882-405a-852e-5750426f03d7 None admin] RBAC: Authorization granted {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:55:01.320369 dv-cinder-851351-1-smb devstack@keystone.service[352328]: [pid: 352328|app: 0|req: 567/1113] 10.222.0.42 () {56 vars in 1177 bytes} [Thu Jul 28 08:55:01 2022] GET /identity/v3/roles/a4fa43cd6d914398a0790a1516c83d08 => generated 223 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:55:01.326712 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f8b2926-4e81-4a98-a902-29a843690ffc None None] Authenticating user token {{(pid=352329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:55:01.433844 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f8b2926-4e81-4a98-a902-29a843690ffc None None] Validating token access rules against request {{(pid=352329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:55:01.436286 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG dbcounter [-] [352329] Writing DB stats keystone:SELECT=100 {{(pid=352329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:55:01.471654 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88969db-8fc5-454b-8a22-3f311bdc2dda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:55:01.472311 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88969db-8fc5-454b-8a22-3f311bdc2dda None admin] REQUEST_METHOD: `GET` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:55:01.472590 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88969db-8fc5-454b-8a22-3f311bdc2dda None admin] SCRIPT_NAME: `/identity` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:55:01.472904 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88969db-8fc5-454b-8a22-3f311bdc2dda None admin] PATH_INFO: `/v3/users/24cc0f803d084abb99f8fe91ced21ef3` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:55:01.488077 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a88969db-8fc5-454b-8a22-3f311bdc2dda None admin] RBAC: Authorizing `identity:get_user(user_id=24cc0f803d084abb99f8fe91ced21ef3)` {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:55:01.489602 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a88969db-8fc5-454b-8a22-3f311bdc2dda None admin] RBAC: Authorization granted {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:55:01.491293 dv-cinder-851351-1-smb devstack@keystone.service[352329]: [pid: 352329|app: 0|req: 547/1114] 10.222.0.42 () {56 vars in 1177 bytes} [Thu Jul 28 08:55:01 2022] GET /identity/v3/users/24cc0f803d084abb99f8fe91ced21ef3 => generated 286 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:55:01.497629 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a18a93-2882-405a-852e-5750426f03d7 None admin] Authenticating user token {{(pid=352328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:55:01.562937 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG dbcounter [-] [352328] Writing DB stats keystone:SELECT=100 {{(pid=352328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:55:01.613617 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a18a93-2882-405a-852e-5750426f03d7 None admin] Validating token access rules against request {{(pid=352328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:55:01.649719 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e72d62-9671-4a5d-9939-f267dfedcc4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:55:01.650341 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e72d62-9671-4a5d-9939-f267dfedcc4e None admin] REQUEST_METHOD: `GET` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:55:01.650620 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e72d62-9671-4a5d-9939-f267dfedcc4e None admin] SCRIPT_NAME: `/identity` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:55:01.650892 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e72d62-9671-4a5d-9939-f267dfedcc4e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:55:01.721219 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e72d62-9671-4a5d-9939-f267dfedcc4e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:55:01.722682 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e72d62-9671-4a5d-9939-f267dfedcc4e None admin] RBAC: Authorization granted {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:55:01.783047 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG dbcounter [-] [352328] Writing DB stats keystone:SELECT=100 {{(pid=352328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:55:01.829833 dv-cinder-851351-1-smb devstack@keystone.service[352328]: [pid: 352328|app: 0|req: 568/1115] 10.222.0.42 () {58 vars in 1282 bytes} [Thu Jul 28 08:55:01 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 28 08:55:01.836125 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88969db-8fc5-454b-8a22-3f311bdc2dda None admin] Authenticating user token {{(pid=352329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:55:01.943324 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88969db-8fc5-454b-8a22-3f311bdc2dda None admin] Validating token access rules against request {{(pid=352329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:55:01.979527 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f8100ae-b58a-41a1-a5f8-776b07756e63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:55:01.980178 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8100ae-b58a-41a1-a5f8-776b07756e63 None admin] REQUEST_METHOD: `GET` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:55:01.980462 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8100ae-b58a-41a1-a5f8-776b07756e63 None admin] SCRIPT_NAME: `/identity` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:55:01.980770 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8100ae-b58a-41a1-a5f8-776b07756e63 None admin] PATH_INFO: `/v3/projects/bfcd60e891d347e9b21fff5dd9459e3b` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:55:01.981998 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f8100ae-b58a-41a1-a5f8-776b07756e63 None admin] RBAC: Authorizing `identity:get_project(project_id=bfcd60e891d347e9b21fff5dd9459e3b)` {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:55:01.983461 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f8100ae-b58a-41a1-a5f8-776b07756e63 None admin] RBAC: Authorization granted {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:55:01.985254 dv-cinder-851351-1-smb devstack@keystone.service[352329]: [pid: 352329|app: 0|req: 548/1116] 10.222.0.42 () {56 vars in 1186 bytes} [Thu Jul 28 08:55:01 2022] GET /identity/v3/projects/bfcd60e891d347e9b21fff5dd9459e3b => generated 311 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:55:01.991797 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e72d62-9671-4a5d-9939-f267dfedcc4e None admin] Authenticating user token {{(pid=352328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:55:02.102265 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e72d62-9671-4a5d-9939-f267dfedcc4e None admin] Validating token access rules against request {{(pid=352328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:55:02.138051 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642c25fc-60db-4c1a-9c26-59edf3cca67e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:55:02.138685 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642c25fc-60db-4c1a-9c26-59edf3cca67e None admin] REQUEST_METHOD: `GET` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:55:02.138974 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642c25fc-60db-4c1a-9c26-59edf3cca67e None admin] SCRIPT_NAME: `/identity` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:55:02.139252 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642c25fc-60db-4c1a-9c26-59edf3cca67e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:55:02.140070 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-642c25fc-60db-4c1a-9c26-59edf3cca67e None admin] RBAC: Adding query filter params (role.id=a4fa43cd6d914398a0790a1516c83d08, scope.project.id=bfcd60e891d347e9b21fff5dd9459e3b, user.id=24cc0f803d084abb99f8fe91ced21ef3) {{(pid=352328) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:55:02.140385 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-642c25fc-60db-4c1a-9c26-59edf3cca67e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:55:02.141867 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-642c25fc-60db-4c1a-9c26-59edf3cca67e None admin] RBAC: Authorization granted {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:55:02.147663 dv-cinder-851351-1-smb devstack@keystone.service[352328]: [pid: 352328|app: 0|req: 569/1117] 10.222.0.42 () {56 vars in 1374 bytes} [Thu Jul 28 08:55:01 2022] GET /identity/v3/role_assignments?user.id=24cc0f803d084abb99f8fe91ced21ef3&scope.project.id=bfcd60e891d347e9b21fff5dd9459e3b&role.id=a4fa43cd6d914398a0790a1516c83d08 => generated 259 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:55:04.155436 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9035482-fc1b-4b65-bb23-6b8a82d4f160 None None] REQUEST_METHOD: `GET` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:55:04.156124 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9035482-fc1b-4b65-bb23-6b8a82d4f160 None None] SCRIPT_NAME: `/identity` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:55:04.156124 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9035482-fc1b-4b65-bb23-6b8a82d4f160 None None] PATH_INFO: `/` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:55:04.157470 dv-cinder-851351-1-smb devstack@keystone.service[352329]: [pid: 352329|app: 0|req: 549/1118] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 08:55:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 08:55:04.163477 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003ccd2c-030d-4d39-b9ba-41221e604cc0 None None] REQUEST_METHOD: `POST` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:55:04.164072 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003ccd2c-030d-4d39-b9ba-41221e604cc0 None None] SCRIPT_NAME: `/identity` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:55:04.164072 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003ccd2c-030d-4d39-b9ba-41221e604cc0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:55:04.183751 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.auth.core [None req-003ccd2c-030d-4d39-b9ba-41221e604cc0 None None] MFA Rules not processed for user `d18c063b2377412485965357671e5506`. Rule list: `[]` (Enabled: `True`). {{(pid=352328) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 08:55:04.185034 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.fernet_utils [None req-003ccd2c-030d-4d39-b9ba-41221e604cc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=352328) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:55:04.205157 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG dbcounter [-] [352328] Writing DB stats keystone:SELECT=100 {{(pid=352328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:55:04.262669 dv-cinder-851351-1-smb devstack@keystone.service[352328]: [pid: 352328|app: 0|req: 570/1119] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 08:55:04 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 28 08:55:04.286131 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9035482-fc1b-4b65-bb23-6b8a82d4f160 None None] Authenticating user token {{(pid=352329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:55:04.320638 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG dbcounter [-] [352329] Writing DB stats keystone:SELECT=100 {{(pid=352329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:55:04.403334 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9035482-fc1b-4b65-bb23-6b8a82d4f160 None None] Validating token access rules against request {{(pid=352329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:55:04.442080 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c041bd-c843-4a9e-abfc-46b6312762ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:55:04.442751 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c041bd-c843-4a9e-abfc-46b6312762ca None admin] REQUEST_METHOD: `GET` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:55:04.443039 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c041bd-c843-4a9e-abfc-46b6312762ca None admin] SCRIPT_NAME: `/identity` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:55:04.443302 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c041bd-c843-4a9e-abfc-46b6312762ca None admin] PATH_INFO: `/v3/roles/a4fa43cd6d914398a0790a1516c83d08` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:55:04.444875 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c041bd-c843-4a9e-abfc-46b6312762ca None admin] RBAC: Authorizing `identity:get_role(role_id=a4fa43cd6d914398a0790a1516c83d08)` {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:55:04.446284 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c041bd-c843-4a9e-abfc-46b6312762ca None admin] RBAC: Authorization granted {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:55:04.447694 dv-cinder-851351-1-smb devstack@keystone.service[352329]: [pid: 352329|app: 0|req: 550/1120] 10.222.0.42 () {56 vars in 1177 bytes} [Thu Jul 28 08:55:04 2022] GET /identity/v3/roles/a4fa43cd6d914398a0790a1516c83d08 => generated 223 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 08:55:04.454558 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-003ccd2c-030d-4d39-b9ba-41221e604cc0 None None] Authenticating user token {{(pid=352328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:55:04.562850 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-003ccd2c-030d-4d39-b9ba-41221e604cc0 None None] Validating token access rules against request {{(pid=352328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:55:04.603604 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4890972-f203-4486-882f-5fd238bd7da7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:55:04.604281 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4890972-f203-4486-882f-5fd238bd7da7 None admin] REQUEST_METHOD: `GET` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:55:04.604566 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4890972-f203-4486-882f-5fd238bd7da7 None admin] SCRIPT_NAME: `/identity` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:55:04.604880 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4890972-f203-4486-882f-5fd238bd7da7 None admin] PATH_INFO: `/v3/users/24cc0f803d084abb99f8fe91ced21ef3` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:55:04.606146 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4890972-f203-4486-882f-5fd238bd7da7 None admin] RBAC: Authorizing `identity:get_user(user_id=24cc0f803d084abb99f8fe91ced21ef3)` {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:55:04.607618 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4890972-f203-4486-882f-5fd238bd7da7 None admin] RBAC: Authorization granted {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:55:04.609447 dv-cinder-851351-1-smb devstack@keystone.service[352328]: [pid: 352328|app: 0|req: 571/1121] 10.222.0.42 () {56 vars in 1177 bytes} [Thu Jul 28 08:55:04 2022] GET /identity/v3/users/24cc0f803d084abb99f8fe91ced21ef3 => generated 286 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:55:04.619002 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c041bd-c843-4a9e-abfc-46b6312762ca None admin] Authenticating user token {{(pid=352329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:55:04.786649 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG dbcounter [-] [352329] Writing DB stats keystone:SELECT=100 {{(pid=352329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:55:04.792981 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c041bd-c843-4a9e-abfc-46b6312762ca None admin] Validating token access rules against request {{(pid=352329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:55:04.855259 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663df901-a43f-4c7d-aa4b-afbf3e57c937 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:55:04.856321 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663df901-a43f-4c7d-aa4b-afbf3e57c937 None admin] REQUEST_METHOD: `GET` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:55:04.856849 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663df901-a43f-4c7d-aa4b-afbf3e57c937 None admin] SCRIPT_NAME: `/identity` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:55:04.857331 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663df901-a43f-4c7d-aa4b-afbf3e57c937 None admin] PATH_INFO: `/v3/projects/bfcd60e891d347e9b21fff5dd9459e3b` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:55:04.859434 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-663df901-a43f-4c7d-aa4b-afbf3e57c937 None admin] RBAC: Authorizing `identity:get_project(project_id=bfcd60e891d347e9b21fff5dd9459e3b)` {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:55:04.862095 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-663df901-a43f-4c7d-aa4b-afbf3e57c937 None admin] RBAC: Authorization granted {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:55:04.865215 dv-cinder-851351-1-smb devstack@keystone.service[352329]: [pid: 352329|app: 0|req: 551/1122] 10.222.0.42 () {56 vars in 1186 bytes} [Thu Jul 28 08:55:04 2022] GET /identity/v3/projects/bfcd60e891d347e9b21fff5dd9459e3b => generated 311 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:55:04.874748 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4890972-f203-4486-882f-5fd238bd7da7 None admin] Authenticating user token {{(pid=352328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:55:04.900652 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG dbcounter [-] [352328] Writing DB stats keystone:SELECT=100 {{(pid=352328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:55:05.000367 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4890972-f203-4486-882f-5fd238bd7da7 None admin] Validating token access rules against request {{(pid=352328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:55:05.062704 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0bcc413-8abc-4e7e-b519-cf89f23470dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:55:05.063847 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0bcc413-8abc-4e7e-b519-cf89f23470dd None admin] REQUEST_METHOD: `PUT` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:55:05.064308 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0bcc413-8abc-4e7e-b519-cf89f23470dd None admin] SCRIPT_NAME: `/identity` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:55:05.064999 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0bcc413-8abc-4e7e-b519-cf89f23470dd None admin] PATH_INFO: `/v3/projects/bfcd60e891d347e9b21fff5dd9459e3b/users/24cc0f803d084abb99f8fe91ced21ef3/roles/a4fa43cd6d914398a0790a1516c83d08` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:55:05.068874 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0bcc413-8abc-4e7e-b519-cf89f23470dd None admin] RBAC: Authorizing `identity:create_grant(project_id=bfcd60e891d347e9b21fff5dd9459e3b, user_id=24cc0f803d084abb99f8fe91ced21ef3, role_id=a4fa43cd6d914398a0790a1516c83d08)` {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:55:05.071646 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0bcc413-8abc-4e7e-b519-cf89f23470dd None admin] RBAC: Authorization granted {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:55:05.092390 dv-cinder-851351-1-smb devstack@keystone.service[352328]: [pid: 352328|app: 0|req: 572/1123] 10.222.0.42 () {58 vars in 1439 bytes} [Thu Jul 28 08:55:04 2022] PUT /identity/v3/projects/bfcd60e891d347e9b21fff5dd9459e3b/users/24cc0f803d084abb99f8fe91ced21ef3/roles/a4fa43cd6d914398a0790a1516c83d08 => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 08:55:07.121649 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33464498-b0ec-4555-af7c-1a59f1ebe2da None None] REQUEST_METHOD: `GET` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:55:07.122538 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33464498-b0ec-4555-af7c-1a59f1ebe2da None None] SCRIPT_NAME: `/identity` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:55:07.122538 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33464498-b0ec-4555-af7c-1a59f1ebe2da None None] PATH_INFO: `/` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:55:07.124137 dv-cinder-851351-1-smb devstack@keystone.service[352329]: [pid: 352329|app: 0|req: 552/1124] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 08:55:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 08:55:07.130444 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7eef27-3af8-4b60-85bc-65aa5149f0df None None] REQUEST_METHOD: `POST` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:55:07.131059 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7eef27-3af8-4b60-85bc-65aa5149f0df None None] SCRIPT_NAME: `/identity` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:55:07.131059 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7eef27-3af8-4b60-85bc-65aa5149f0df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:55:07.151158 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.auth.core [None req-8c7eef27-3af8-4b60-85bc-65aa5149f0df None None] MFA Rules not processed for user `d18c063b2377412485965357671e5506`. Rule list: `[]` (Enabled: `True`). {{(pid=352328) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 08:55:07.152449 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.fernet_utils [None req-8c7eef27-3af8-4b60-85bc-65aa5149f0df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=352328) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:55:07.238374 dv-cinder-851351-1-smb devstack@keystone.service[352328]: [pid: 352328|app: 0|req: 573/1125] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 08:55:07 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 08:55:07.262537 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33464498-b0ec-4555-af7c-1a59f1ebe2da None None] Authenticating user token {{(pid=352329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:55:07.400180 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33464498-b0ec-4555-af7c-1a59f1ebe2da None None] Validating token access rules against request {{(pid=352329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:55:07.447724 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d53f8f-c4b9-46c7-a235-c15f39ffc63e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:55:07.448402 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d53f8f-c4b9-46c7-a235-c15f39ffc63e None admin] REQUEST_METHOD: `GET` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:55:07.448703 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d53f8f-c4b9-46c7-a235-c15f39ffc63e None admin] SCRIPT_NAME: `/identity` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:55:07.449001 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d53f8f-c4b9-46c7-a235-c15f39ffc63e None admin] PATH_INFO: `/v3/roles/a4fa43cd6d914398a0790a1516c83d08` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:55:07.450641 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53d53f8f-c4b9-46c7-a235-c15f39ffc63e None admin] RBAC: Authorizing `identity:get_role(role_id=a4fa43cd6d914398a0790a1516c83d08)` {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:55:07.452069 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53d53f8f-c4b9-46c7-a235-c15f39ffc63e None admin] RBAC: Authorization granted {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:55:07.453534 dv-cinder-851351-1-smb devstack@keystone.service[352329]: [pid: 352329|app: 0|req: 553/1126] 10.222.0.42 () {56 vars in 1177 bytes} [Thu Jul 28 08:55:07 2022] GET /identity/v3/roles/a4fa43cd6d914398a0790a1516c83d08 => generated 223 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:55:07.460295 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7eef27-3af8-4b60-85bc-65aa5149f0df None None] Authenticating user token {{(pid=352328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:55:07.474748 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG dbcounter [-] [352328] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=352328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:55:07.581663 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7eef27-3af8-4b60-85bc-65aa5149f0df None None] Validating token access rules against request {{(pid=352328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:55:07.626139 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4335ef5a-61d1-4d9b-a977-eb44cbb2c764 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:55:07.626843 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4335ef5a-61d1-4d9b-a977-eb44cbb2c764 None admin] REQUEST_METHOD: `GET` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:55:07.627132 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4335ef5a-61d1-4d9b-a977-eb44cbb2c764 None admin] SCRIPT_NAME: `/identity` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:55:07.627412 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4335ef5a-61d1-4d9b-a977-eb44cbb2c764 None admin] PATH_INFO: `/v3/users/24cc0f803d084abb99f8fe91ced21ef3` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:55:07.629068 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4335ef5a-61d1-4d9b-a977-eb44cbb2c764 None admin] RBAC: Authorizing `identity:get_user(user_id=24cc0f803d084abb99f8fe91ced21ef3)` {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:55:07.630620 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4335ef5a-61d1-4d9b-a977-eb44cbb2c764 None admin] RBAC: Authorization granted {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:55:07.632466 dv-cinder-851351-1-smb devstack@keystone.service[352328]: [pid: 352328|app: 0|req: 574/1127] 10.222.0.42 () {56 vars in 1177 bytes} [Thu Jul 28 08:55:07 2022] GET /identity/v3/users/24cc0f803d084abb99f8fe91ced21ef3 => generated 286 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:55:07.639355 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d53f8f-c4b9-46c7-a235-c15f39ffc63e None admin] Authenticating user token {{(pid=352329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:55:07.683071 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG dbcounter [-] [352329] Writing DB stats keystone:SELECT=100 {{(pid=352329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:55:07.778130 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d53f8f-c4b9-46c7-a235-c15f39ffc63e None admin] Validating token access rules against request {{(pid=352329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:55:07.831939 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b96e35-03a1-40fb-8681-22b0e79e9e90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:55:07.832912 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b96e35-03a1-40fb-8681-22b0e79e9e90 None admin] REQUEST_METHOD: `GET` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:55:07.833059 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b96e35-03a1-40fb-8681-22b0e79e9e90 None admin] SCRIPT_NAME: `/identity` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:55:07.833231 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b96e35-03a1-40fb-8681-22b0e79e9e90 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:55:07.923127 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6b96e35-03a1-40fb-8681-22b0e79e9e90 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:55:07.924715 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6b96e35-03a1-40fb-8681-22b0e79e9e90 None admin] RBAC: Authorization granted {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:55:07.966813 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG dbcounter [-] [352329] Writing DB stats keystone:SELECT=100 {{(pid=352329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:55:08.083325 dv-cinder-851351-1-smb devstack@keystone.service[352329]: [pid: 352329|app: 0|req: 554/1128] 10.222.0.42 () {58 vars in 1282 bytes} [Thu Jul 28 08:55:07 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 445 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jul 28 08:55:08.089805 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4335ef5a-61d1-4d9b-a977-eb44cbb2c764 None admin] Authenticating user token {{(pid=352328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:55:08.192190 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG dbcounter [-] [352328] Writing DB stats keystone:SELECT=100 {{(pid=352328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:55:08.216537 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4335ef5a-61d1-4d9b-a977-eb44cbb2c764 None admin] Validating token access rules against request {{(pid=352328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:55:08.260028 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f8fa7a-c4f9-4942-8053-e1f7c4b75b94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:55:08.260737 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f8fa7a-c4f9-4942-8053-e1f7c4b75b94 None admin] REQUEST_METHOD: `GET` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:55:08.261195 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f8fa7a-c4f9-4942-8053-e1f7c4b75b94 None admin] SCRIPT_NAME: `/identity` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:55:08.261639 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f8fa7a-c4f9-4942-8053-e1f7c4b75b94 None admin] PATH_INFO: `/v3/projects/bfcd60e891d347e9b21fff5dd9459e3b` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:55:08.263153 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f8fa7a-c4f9-4942-8053-e1f7c4b75b94 None admin] RBAC: Authorizing `identity:get_project(project_id=bfcd60e891d347e9b21fff5dd9459e3b)` {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:55:08.265053 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f8fa7a-c4f9-4942-8053-e1f7c4b75b94 None admin] RBAC: Authorization granted {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:55:08.267343 dv-cinder-851351-1-smb devstack@keystone.service[352328]: [pid: 352328|app: 0|req: 575/1129] 10.222.0.42 () {56 vars in 1186 bytes} [Thu Jul 28 08:55:08 2022] GET /identity/v3/projects/bfcd60e891d347e9b21fff5dd9459e3b => generated 311 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:55:08.274994 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b96e35-03a1-40fb-8681-22b0e79e9e90 None admin] Authenticating user token {{(pid=352329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:55:08.395081 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b96e35-03a1-40fb-8681-22b0e79e9e90 None admin] Validating token access rules against request {{(pid=352329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:55:08.435837 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629e138e-49db-4fc3-b9be-1d3aae507a93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:55:08.436472 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629e138e-49db-4fc3-b9be-1d3aae507a93 None admin] REQUEST_METHOD: `GET` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:55:08.436844 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629e138e-49db-4fc3-b9be-1d3aae507a93 None admin] SCRIPT_NAME: `/identity` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:55:08.437161 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629e138e-49db-4fc3-b9be-1d3aae507a93 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:55:08.437973 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-629e138e-49db-4fc3-b9be-1d3aae507a93 None admin] RBAC: Adding query filter params (role.id=a4fa43cd6d914398a0790a1516c83d08, scope.project.id=bfcd60e891d347e9b21fff5dd9459e3b, user.id=24cc0f803d084abb99f8fe91ced21ef3) {{(pid=352329) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:55:08.438286 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-629e138e-49db-4fc3-b9be-1d3aae507a93 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:55:08.439739 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-629e138e-49db-4fc3-b9be-1d3aae507a93 None admin] RBAC: Authorization granted {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:55:08.441849 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG dbcounter [-] [352329] Writing DB stats keystone:SELECT=100 {{(pid=352329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:55:08.447434 dv-cinder-851351-1-smb devstack@keystone.service[352329]: [pid: 352329|app: 0|req: 555/1130] 10.222.0.42 () {56 vars in 1374 bytes} [Thu Jul 28 08:55:08 2022] GET /identity/v3/role_assignments?user.id=24cc0f803d084abb99f8fe91ced21ef3&scope.project.id=bfcd60e891d347e9b21fff5dd9459e3b&role.id=a4fa43cd6d914398a0790a1516c83d08 => generated 608 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:55:10.503432 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a691c18-36ba-46ec-b570-4d79eede26a8 None None] REQUEST_METHOD: `GET` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:55:10.504047 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a691c18-36ba-46ec-b570-4d79eede26a8 None None] SCRIPT_NAME: `/identity` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:55:10.504047 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a691c18-36ba-46ec-b570-4d79eede26a8 None None] PATH_INFO: `/` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:55:10.505405 dv-cinder-851351-1-smb devstack@keystone.service[352328]: [pid: 352328|app: 0|req: 576/1131] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 08:55:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 08:55:10.512192 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd298663-b8bd-4d0f-b299-bbea733272a0 None None] REQUEST_METHOD: `POST` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:55:10.512750 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd298663-b8bd-4d0f-b299-bbea733272a0 None None] SCRIPT_NAME: `/identity` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:55:10.512750 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd298663-b8bd-4d0f-b299-bbea733272a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:55:10.532207 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.auth.core [None req-fd298663-b8bd-4d0f-b299-bbea733272a0 None None] MFA Rules not processed for user `d18c063b2377412485965357671e5506`. Rule list: `[]` (Enabled: `True`). {{(pid=352329) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 08:55:10.534250 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.fernet_utils [None req-fd298663-b8bd-4d0f-b299-bbea733272a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=352329) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:55:10.609077 dv-cinder-851351-1-smb devstack@keystone.service[352329]: [pid: 352329|app: 0|req: 556/1132] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 08:55:10 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 08:55:10.634160 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a691c18-36ba-46ec-b570-4d79eede26a8 None None] Authenticating user token {{(pid=352328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:55:10.747818 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a691c18-36ba-46ec-b570-4d79eede26a8 None None] Validating token access rules against request {{(pid=352328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:55:10.783728 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961f930f-2b6c-4968-bd4e-39b86d676d66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:55:10.784290 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961f930f-2b6c-4968-bd4e-39b86d676d66 None admin] REQUEST_METHOD: `GET` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:55:10.784567 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961f930f-2b6c-4968-bd4e-39b86d676d66 None admin] SCRIPT_NAME: `/identity` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:55:10.784869 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961f930f-2b6c-4968-bd4e-39b86d676d66 None admin] PATH_INFO: `/v3/domains/default` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:55:10.786080 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-961f930f-2b6c-4968-bd4e-39b86d676d66 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:55:10.787521 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-961f930f-2b6c-4968-bd4e-39b86d676d66 None admin] RBAC: Authorization granted {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:55:10.789175 dv-cinder-851351-1-smb devstack@keystone.service[352328]: [pid: 352328|app: 0|req: 577/1133] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 08:55:10 2022] GET /identity/v3/domains/default => generated 199 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:55:10.795458 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd298663-b8bd-4d0f-b299-bbea733272a0 None None] Authenticating user token {{(pid=352329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:55:10.919692 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd298663-b8bd-4d0f-b299-bbea733272a0 None None] Validating token access rules against request {{(pid=352329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:55:10.968787 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG dbcounter [-] [352329] Writing DB stats keystone:SELECT=100 {{(pid=352329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:55:10.979310 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c9fa86-8146-4c9a-b926-713afef6077b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:55:10.979983 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c9fa86-8146-4c9a-b926-713afef6077b None admin] REQUEST_METHOD: `POST` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:55:10.980273 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c9fa86-8146-4c9a-b926-713afef6077b None admin] SCRIPT_NAME: `/identity` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:55:10.980552 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c9fa86-8146-4c9a-b926-713afef6077b None admin] PATH_INFO: `/v3/projects` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:55:10.981335 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0c9fa86-8146-4c9a-b926-713afef6077b None admin] RBAC: Authorizing `identity:create_project()` {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:55:10.982957 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0c9fa86-8146-4c9a-b926-713afef6077b None admin] RBAC: Authorization granted {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:55:11.018614 dv-cinder-851351-1-smb devstack@keystone.service[352329]: [pid: 352329|app: 0|req: 557/1134] 10.222.0.42 () {60 vars in 1141 bytes} [Thu Jul 28 08:55:10 2022] POST /identity/v3/projects => generated 311 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 08:55:13.071846 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e7f807-20b3-406d-a49c-38fed3e112c6 None None] REQUEST_METHOD: `GET` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:55:13.072830 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e7f807-20b3-406d-a49c-38fed3e112c6 None None] SCRIPT_NAME: `/identity` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:55:13.072830 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e7f807-20b3-406d-a49c-38fed3e112c6 None None] PATH_INFO: `/` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:55:13.074250 dv-cinder-851351-1-smb devstack@keystone.service[352328]: [pid: 352328|app: 0|req: 578/1135] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 08:55:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 08:55:13.080518 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b71e90-3d92-4e34-aa55-3939265f8944 None None] REQUEST_METHOD: `POST` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:55:13.081006 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b71e90-3d92-4e34-aa55-3939265f8944 None None] SCRIPT_NAME: `/identity` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:55:13.081107 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b71e90-3d92-4e34-aa55-3939265f8944 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:55:13.101265 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.auth.core [None req-74b71e90-3d92-4e34-aa55-3939265f8944 None None] MFA Rules not processed for user `d18c063b2377412485965357671e5506`. Rule list: `[]` (Enabled: `True`). {{(pid=352329) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 08:55:13.102763 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.fernet_utils [None req-74b71e90-3d92-4e34-aa55-3939265f8944 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=352329) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:55:13.181526 dv-cinder-851351-1-smb devstack@keystone.service[352329]: [pid: 352329|app: 0|req: 558/1136] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 08:55:13 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 08:55:13.208393 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e7f807-20b3-406d-a49c-38fed3e112c6 None None] Authenticating user token {{(pid=352328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:55:13.225137 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG dbcounter [-] [352328] Writing DB stats keystone:SELECT=100 {{(pid=352328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:55:13.316280 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e7f807-20b3-406d-a49c-38fed3e112c6 None None] Validating token access rules against request {{(pid=352328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:55:13.352174 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721d946b-c92e-4574-a6d0-85229470937e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:55:13.352852 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721d946b-c92e-4574-a6d0-85229470937e None admin] REQUEST_METHOD: `GET` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:55:13.353130 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721d946b-c92e-4574-a6d0-85229470937e None admin] SCRIPT_NAME: `/identity` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:55:13.353400 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721d946b-c92e-4574-a6d0-85229470937e None admin] PATH_INFO: `/v3/domains/default` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:55:13.354567 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-721d946b-c92e-4574-a6d0-85229470937e None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:55:13.356035 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-721d946b-c92e-4574-a6d0-85229470937e None admin] RBAC: Authorization granted {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:55:13.357675 dv-cinder-851351-1-smb devstack@keystone.service[352328]: [pid: 352328|app: 0|req: 579/1137] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 08:55:13 2022] GET /identity/v3/domains/default => generated 199 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:55:13.364238 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b71e90-3d92-4e34-aa55-3939265f8944 None None] Authenticating user token {{(pid=352329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:55:13.471833 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b71e90-3d92-4e34-aa55-3939265f8944 None None] Validating token access rules against request {{(pid=352329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:55:13.483720 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG dbcounter [-] [352329] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=352329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:55:13.512404 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e9ac124-b747-448a-a11f-a672929817a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:55:13.513080 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9ac124-b747-448a-a11f-a672929817a6 None admin] REQUEST_METHOD: `POST` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:55:13.513359 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9ac124-b747-448a-a11f-a672929817a6 None admin] SCRIPT_NAME: `/identity` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:55:13.513670 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9ac124-b747-448a-a11f-a672929817a6 None admin] PATH_INFO: `/v3/users` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:55:13.514384 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e9ac124-b747-448a-a11f-a672929817a6 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:55:13.515877 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e9ac124-b747-448a-a11f-a672929817a6 None admin] RBAC: Authorization granted {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:55:13.540273 dv-cinder-851351-1-smb devstack@keystone.service[352329]: [pid: 352329|app: 0|req: 559/1138] 10.222.0.42 () {60 vars in 1132 bytes} [Thu Jul 28 08:55:13 2022] POST /identity/v3/users => generated 286 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 08:55:15.622007 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06faee21-4cb2-4f37-857f-0b8d2b211d5d None None] REQUEST_METHOD: `GET` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:55:15.622657 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06faee21-4cb2-4f37-857f-0b8d2b211d5d None None] SCRIPT_NAME: `/identity` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:55:15.622657 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06faee21-4cb2-4f37-857f-0b8d2b211d5d None None] PATH_INFO: `/` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:55:15.624107 dv-cinder-851351-1-smb devstack@keystone.service[352328]: [pid: 352328|app: 0|req: 580/1139] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 08:55:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 08:55:15.630555 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbda524-5967-4cd5-8c3a-256c29ef2eb0 None None] REQUEST_METHOD: `POST` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:55:15.631115 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbda524-5967-4cd5-8c3a-256c29ef2eb0 None None] SCRIPT_NAME: `/identity` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:55:15.631268 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbda524-5967-4cd5-8c3a-256c29ef2eb0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:55:15.651595 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.auth.core [None req-bbbda524-5967-4cd5-8c3a-256c29ef2eb0 None None] MFA Rules not processed for user `d18c063b2377412485965357671e5506`. Rule list: `[]` (Enabled: `True`). {{(pid=352329) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 08:55:15.652916 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.fernet_utils [None req-bbbda524-5967-4cd5-8c3a-256c29ef2eb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=352329) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:55:15.724644 dv-cinder-851351-1-smb devstack@keystone.service[352329]: [pid: 352329|app: 0|req: 560/1140] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 08:55:15 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 08:55:15.766393 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06faee21-4cb2-4f37-857f-0b8d2b211d5d None None] Authenticating user token {{(pid=352328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:55:15.914233 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG dbcounter [-] [352328] Writing DB stats keystone:SELECT=100 {{(pid=352328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:55:15.948245 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06faee21-4cb2-4f37-857f-0b8d2b211d5d None None] Validating token access rules against request {{(pid=352328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:55:16.018776 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d23a2b-0ffa-4de5-8558-53215b796288 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:55:16.019879 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d23a2b-0ffa-4de5-8558-53215b796288 None admin] REQUEST_METHOD: `GET` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:55:16.020380 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d23a2b-0ffa-4de5-8558-53215b796288 None admin] SCRIPT_NAME: `/identity` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:55:16.020908 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d23a2b-0ffa-4de5-8558-53215b796288 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:55:16.039821 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2d23a2b-0ffa-4de5-8558-53215b796288 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 08:55:16.048892 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application [None req-c2d23a2b-0ffa-4de5-8558-53215b796288 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 08:55:16.048892 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:55:16.048892 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:55:16.048892 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:55:16.048892 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:55:16.048892 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:55:16.048892 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:55:16.048892 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:55:16.048892 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:55:16.048892 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:55:16.048892 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:55:16.048892 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:55:16.048892 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 08:55:16.048892 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 08:55:16.048892 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 08:55:16.048892 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 08:55:16.050323 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 08:55:16.050323 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 08:55:16.050323 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 08:55:16.050323 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 08:55:16.050323 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:55:16.050323 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:55:16.050323 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:55:16.050323 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:55:16.050323 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:55:16.050323 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:55:16.050323 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:55:16.050323 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application with Lock( Jul 28 08:55:16.050323 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:55:16.050323 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:55:16.050323 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:55:16.050323 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:55:16.051638 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:55:16.051638 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:55:16.051638 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:55:16.051638 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:55:16.051638 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 08:55:16.051638 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 08:55:16.051638 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 08:55:16.051638 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 08:55:16.051638 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 08:55:16.051638 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 08:55:16.051638 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 08:55:16.051638 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application Jul 28 08:55:16.051638 dv-cinder-851351-1-smb devstack@keystone.service[352328]: [pid: 352328|app: 0|req: 581/1141] 10.222.0.42 () {56 vars in 1096 bytes} [Thu Jul 28 08:55:15 2022] GET /identity/v3/roles/admin => generated 83 bytes in 286 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:55:16.057857 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbbda524-5967-4cd5-8c3a-256c29ef2eb0 None None] Authenticating user token {{(pid=352329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:55:16.165665 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG dbcounter [-] [352329] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=352329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:55:16.173104 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbbda524-5967-4cd5-8c3a-256c29ef2eb0 None None] Validating token access rules against request {{(pid=352329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:55:16.234580 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade3bffe-1135-4080-a75f-24995f6a46ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:55:16.235652 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade3bffe-1135-4080-a75f-24995f6a46ab None admin] REQUEST_METHOD: `GET` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:55:16.236168 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade3bffe-1135-4080-a75f-24995f6a46ab None admin] SCRIPT_NAME: `/identity` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:55:16.236766 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade3bffe-1135-4080-a75f-24995f6a46ab None admin] PATH_INFO: `/v3/roles` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:55:16.238046 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ade3bffe-1135-4080-a75f-24995f6a46ab None admin] RBAC: Adding query filter params (name=admin) {{(pid=352329) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:55:16.238603 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ade3bffe-1135-4080-a75f-24995f6a46ab None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:55:16.241257 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ade3bffe-1135-4080-a75f-24995f6a46ab None admin] RBAC: Authorization granted {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:55:16.256521 dv-cinder-851351-1-smb devstack@keystone.service[352329]: [pid: 352329|app: 0|req: 561/1142] 10.222.0.42 () {56 vars in 1099 bytes} [Thu Jul 28 08:55:16 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:55:16.262946 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d23a2b-0ffa-4de5-8558-53215b796288 None admin] Authenticating user token {{(pid=352328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:55:16.431834 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d23a2b-0ffa-4de5-8558-53215b796288 None admin] Validating token access rules against request {{(pid=352328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:55:16.487581 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17d488e-57ac-4da3-9f09-b306efd29ff3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:55:16.488243 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17d488e-57ac-4da3-9f09-b306efd29ff3 None admin] REQUEST_METHOD: `GET` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:55:16.488522 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17d488e-57ac-4da3-9f09-b306efd29ff3 None admin] SCRIPT_NAME: `/identity` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:55:16.488787 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17d488e-57ac-4da3-9f09-b306efd29ff3 None admin] PATH_INFO: `/v3/users/83c29eb8de1e47a69dfb88e4df8481d6` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:55:16.501673 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG dbcounter [-] [352328] Writing DB stats keystone:SELECT=100 {{(pid=352328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:55:16.505258 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b17d488e-57ac-4da3-9f09-b306efd29ff3 None admin] RBAC: Authorizing `identity:get_user(user_id=83c29eb8de1e47a69dfb88e4df8481d6)` {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:55:16.507326 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b17d488e-57ac-4da3-9f09-b306efd29ff3 None admin] RBAC: Authorization granted {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:55:16.509191 dv-cinder-851351-1-smb devstack@keystone.service[352328]: [pid: 352328|app: 0|req: 582/1143] 10.222.0.42 () {56 vars in 1177 bytes} [Thu Jul 28 08:55:16 2022] GET /identity/v3/users/83c29eb8de1e47a69dfb88e4df8481d6 => generated 286 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:55:16.515387 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade3bffe-1135-4080-a75f-24995f6a46ab None admin] Authenticating user token {{(pid=352329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:55:16.626330 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade3bffe-1135-4080-a75f-24995f6a46ab None admin] Validating token access rules against request {{(pid=352329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:55:16.662946 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64ade10-d201-4aea-8b1c-7a5dff29fc12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:55:16.663721 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64ade10-d201-4aea-8b1c-7a5dff29fc12 None admin] REQUEST_METHOD: `GET` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:55:16.663965 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64ade10-d201-4aea-8b1c-7a5dff29fc12 None admin] SCRIPT_NAME: `/identity` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:55:16.664287 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64ade10-d201-4aea-8b1c-7a5dff29fc12 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:55:16.695469 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG dbcounter [-] [352329] Writing DB stats keystone:SELECT=100 {{(pid=352329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:55:16.741531 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d64ade10-d201-4aea-8b1c-7a5dff29fc12 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:55:16.743035 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d64ade10-d201-4aea-8b1c-7a5dff29fc12 None admin] RBAC: Authorization granted {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:55:16.852080 dv-cinder-851351-1-smb devstack@keystone.service[352329]: [pid: 352329|app: 0|req: 562/1144] 10.222.0.42 () {58 vars in 1282 bytes} [Thu Jul 28 08:55:16 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 28 08:55:16.858431 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17d488e-57ac-4da3-9f09-b306efd29ff3 None admin] Authenticating user token {{(pid=352328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:55:16.974317 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17d488e-57ac-4da3-9f09-b306efd29ff3 None admin] Validating token access rules against request {{(pid=352328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:55:17.013058 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00887cb-b0a2-4836-b87e-790dc45e5a1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:55:17.013813 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00887cb-b0a2-4836-b87e-790dc45e5a1e None admin] REQUEST_METHOD: `GET` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:55:17.014141 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00887cb-b0a2-4836-b87e-790dc45e5a1e None admin] SCRIPT_NAME: `/identity` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:55:17.014463 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00887cb-b0a2-4836-b87e-790dc45e5a1e None admin] PATH_INFO: `/v3/projects/5d786687177b43f1a77b0111e41c578a` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:55:17.015894 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b00887cb-b0a2-4836-b87e-790dc45e5a1e None admin] RBAC: Authorizing `identity:get_project(project_id=5d786687177b43f1a77b0111e41c578a)` {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:55:17.017501 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b00887cb-b0a2-4836-b87e-790dc45e5a1e None admin] RBAC: Authorization granted {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:55:17.019372 dv-cinder-851351-1-smb devstack@keystone.service[352328]: [pid: 352328|app: 0|req: 583/1145] 10.222.0.42 () {56 vars in 1186 bytes} [Thu Jul 28 08:55:16 2022] GET /identity/v3/projects/5d786687177b43f1a77b0111e41c578a => generated 311 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:55:17.026817 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64ade10-d201-4aea-8b1c-7a5dff29fc12 None admin] Authenticating user token {{(pid=352329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:55:17.091785 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG dbcounter [-] [352329] Writing DB stats keystone:SELECT=100 {{(pid=352329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:55:17.138492 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64ade10-d201-4aea-8b1c-7a5dff29fc12 None admin] Validating token access rules against request {{(pid=352329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:55:17.176655 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5dc91e8-338e-41c0-a7fd-f670f738f224 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:55:17.177305 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5dc91e8-338e-41c0-a7fd-f670f738f224 None admin] REQUEST_METHOD: `GET` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:55:17.177579 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5dc91e8-338e-41c0-a7fd-f670f738f224 None admin] SCRIPT_NAME: `/identity` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:55:17.177852 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5dc91e8-338e-41c0-a7fd-f670f738f224 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:55:17.178668 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5dc91e8-338e-41c0-a7fd-f670f738f224 None admin] RBAC: Adding query filter params (role.id=280023171b4a45efb67c036ff237bb3c, scope.project.id=5d786687177b43f1a77b0111e41c578a, user.id=83c29eb8de1e47a69dfb88e4df8481d6) {{(pid=352329) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:55:17.178981 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5dc91e8-338e-41c0-a7fd-f670f738f224 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:55:17.180982 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5dc91e8-338e-41c0-a7fd-f670f738f224 None admin] RBAC: Authorization granted {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:55:17.187568 dv-cinder-851351-1-smb devstack@keystone.service[352329]: [pid: 352329|app: 0|req: 563/1146] 10.222.0.42 () {56 vars in 1374 bytes} [Thu Jul 28 08:55:17 2022] GET /identity/v3/role_assignments?user.id=83c29eb8de1e47a69dfb88e4df8481d6&scope.project.id=5d786687177b43f1a77b0111e41c578a&role.id=280023171b4a45efb67c036ff237bb3c => generated 259 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:55:19.228370 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77cf93b-6ffa-4177-8384-6116fc7106de None None] REQUEST_METHOD: `GET` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:55:19.229053 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77cf93b-6ffa-4177-8384-6116fc7106de None None] SCRIPT_NAME: `/identity` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:55:19.229053 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77cf93b-6ffa-4177-8384-6116fc7106de None None] PATH_INFO: `/` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:55:19.230533 dv-cinder-851351-1-smb devstack@keystone.service[352328]: [pid: 352328|app: 0|req: 584/1147] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 08:55:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 08:55:19.236705 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca25e9d-4b91-42c1-89f9-344d39bf2985 None None] REQUEST_METHOD: `POST` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:55:19.237327 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca25e9d-4b91-42c1-89f9-344d39bf2985 None None] SCRIPT_NAME: `/identity` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:55:19.237327 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca25e9d-4b91-42c1-89f9-344d39bf2985 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:55:19.257330 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.auth.core [None req-3ca25e9d-4b91-42c1-89f9-344d39bf2985 None None] MFA Rules not processed for user `d18c063b2377412485965357671e5506`. Rule list: `[]` (Enabled: `True`). {{(pid=352329) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 08:55:19.258578 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.fernet_utils [None req-3ca25e9d-4b91-42c1-89f9-344d39bf2985 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=352329) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:55:19.339214 dv-cinder-851351-1-smb devstack@keystone.service[352329]: [pid: 352329|app: 0|req: 564/1148] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 08:55:19 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 08:55:19.363158 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77cf93b-6ffa-4177-8384-6116fc7106de None None] Authenticating user token {{(pid=352328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:55:19.489790 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG dbcounter [-] [352328] Writing DB stats keystone:SELECT=100 {{(pid=352328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:55:19.555740 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77cf93b-6ffa-4177-8384-6116fc7106de None None] Validating token access rules against request {{(pid=352328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:55:19.620520 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1933d4a-085f-4a13-8586-c12421f90635 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:55:19.621558 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1933d4a-085f-4a13-8586-c12421f90635 None admin] REQUEST_METHOD: `GET` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:55:19.622032 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1933d4a-085f-4a13-8586-c12421f90635 None admin] SCRIPT_NAME: `/identity` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:55:19.622520 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1933d4a-085f-4a13-8586-c12421f90635 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:55:19.642527 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1933d4a-085f-4a13-8586-c12421f90635 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 08:55:19.652426 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application [None req-f1933d4a-085f-4a13-8586-c12421f90635 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 08:55:19.652426 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:55:19.652426 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:55:19.652426 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:55:19.652426 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:55:19.652426 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:55:19.652426 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:55:19.652426 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:55:19.652426 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:55:19.652426 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:55:19.652426 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:55:19.652426 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:55:19.652426 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 08:55:19.652426 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 08:55:19.652426 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 08:55:19.652426 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 08:55:19.653872 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 08:55:19.653872 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 08:55:19.653872 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 08:55:19.653872 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 08:55:19.653872 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:55:19.653872 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:55:19.653872 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:55:19.653872 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:55:19.653872 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:55:19.653872 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:55:19.653872 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:55:19.653872 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application with Lock( Jul 28 08:55:19.653872 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:55:19.653872 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:55:19.653872 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:55:19.653872 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:55:19.660615 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:55:19.660615 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:55:19.660615 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:55:19.660615 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:55:19.660615 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 08:55:19.660615 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 08:55:19.660615 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 08:55:19.660615 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 08:55:19.660615 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 08:55:19.660615 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 08:55:19.660615 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 08:55:19.660615 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application Jul 28 08:55:19.660615 dv-cinder-851351-1-smb devstack@keystone.service[352328]: [pid: 352328|app: 0|req: 585/1149] 10.222.0.42 () {56 vars in 1096 bytes} [Thu Jul 28 08:55:19 2022] GET /identity/v3/roles/admin => generated 83 bytes in 293 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:55:19.662161 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca25e9d-4b91-42c1-89f9-344d39bf2985 None None] Authenticating user token {{(pid=352329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:55:19.751016 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG dbcounter [-] [352329] Writing DB stats keystone:SELECT=100 {{(pid=352329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:55:19.806892 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca25e9d-4b91-42c1-89f9-344d39bf2985 None None] Validating token access rules against request {{(pid=352329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:55:19.845970 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d374bfc-3521-4d16-a5fa-387f40eda8dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:55:19.846620 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d374bfc-3521-4d16-a5fa-387f40eda8dc None admin] REQUEST_METHOD: `GET` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:55:19.846912 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d374bfc-3521-4d16-a5fa-387f40eda8dc None admin] SCRIPT_NAME: `/identity` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:55:19.847182 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d374bfc-3521-4d16-a5fa-387f40eda8dc None admin] PATH_INFO: `/v3/roles` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:55:19.847925 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d374bfc-3521-4d16-a5fa-387f40eda8dc None admin] RBAC: Adding query filter params (name=admin) {{(pid=352329) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:55:19.848228 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d374bfc-3521-4d16-a5fa-387f40eda8dc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:55:19.849667 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d374bfc-3521-4d16-a5fa-387f40eda8dc None admin] RBAC: Authorization granted {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:55:19.859770 dv-cinder-851351-1-smb devstack@keystone.service[352329]: [pid: 352329|app: 0|req: 565/1150] 10.222.0.42 () {56 vars in 1099 bytes} [Thu Jul 28 08:55:19 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 08:55:19.866111 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1933d4a-085f-4a13-8586-c12421f90635 None admin] Authenticating user token {{(pid=352328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:55:19.976915 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1933d4a-085f-4a13-8586-c12421f90635 None admin] Validating token access rules against request {{(pid=352328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:55:20.009421 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG dbcounter [-] [352328] Writing DB stats keystone:SELECT=100 {{(pid=352328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:55:20.020130 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af174f5-4ce8-42c1-bf0f-a85b02520403 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:55:20.021195 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af174f5-4ce8-42c1-bf0f-a85b02520403 None admin] REQUEST_METHOD: `GET` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:55:20.021474 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af174f5-4ce8-42c1-bf0f-a85b02520403 None admin] SCRIPT_NAME: `/identity` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:55:20.021754 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af174f5-4ce8-42c1-bf0f-a85b02520403 None admin] PATH_INFO: `/v3/users/83c29eb8de1e47a69dfb88e4df8481d6` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:55:20.023081 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9af174f5-4ce8-42c1-bf0f-a85b02520403 None admin] RBAC: Authorizing `identity:get_user(user_id=83c29eb8de1e47a69dfb88e4df8481d6)` {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:55:20.024554 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9af174f5-4ce8-42c1-bf0f-a85b02520403 None admin] RBAC: Authorization granted {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:55:20.026360 dv-cinder-851351-1-smb devstack@keystone.service[352328]: [pid: 352328|app: 0|req: 586/1151] 10.222.0.42 () {56 vars in 1177 bytes} [Thu Jul 28 08:55:19 2022] GET /identity/v3/users/83c29eb8de1e47a69dfb88e4df8481d6 => generated 286 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 08:55:20.032816 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d374bfc-3521-4d16-a5fa-387f40eda8dc None admin] Authenticating user token {{(pid=352329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:55:20.143897 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d374bfc-3521-4d16-a5fa-387f40eda8dc None admin] Validating token access rules against request {{(pid=352329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:55:20.160111 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG dbcounter [-] [352329] Writing DB stats keystone:SELECT=100 {{(pid=352329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:55:20.194218 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f3cb7e8-0b04-4bbb-aace-e5a69835b632 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:55:20.195318 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3cb7e8-0b04-4bbb-aace-e5a69835b632 None admin] REQUEST_METHOD: `GET` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:55:20.195813 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3cb7e8-0b04-4bbb-aace-e5a69835b632 None admin] SCRIPT_NAME: `/identity` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:55:20.196311 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3cb7e8-0b04-4bbb-aace-e5a69835b632 None admin] PATH_INFO: `/v3/projects/5d786687177b43f1a77b0111e41c578a` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:55:20.198533 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f3cb7e8-0b04-4bbb-aace-e5a69835b632 None admin] RBAC: Authorizing `identity:get_project(project_id=5d786687177b43f1a77b0111e41c578a)` {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:55:20.201396 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f3cb7e8-0b04-4bbb-aace-e5a69835b632 None admin] RBAC: Authorization granted {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:55:20.205411 dv-cinder-851351-1-smb devstack@keystone.service[352329]: [pid: 352329|app: 0|req: 566/1152] 10.222.0.42 () {56 vars in 1186 bytes} [Thu Jul 28 08:55:20 2022] GET /identity/v3/projects/5d786687177b43f1a77b0111e41c578a => generated 311 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:55:20.212496 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af174f5-4ce8-42c1-bf0f-a85b02520403 None admin] Authenticating user token {{(pid=352328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:55:20.379824 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af174f5-4ce8-42c1-bf0f-a85b02520403 None admin] Validating token access rules against request {{(pid=352328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:55:20.421442 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dca3c36-1d49-4eb6-b40f-7bc261dc796a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:55:20.422371 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dca3c36-1d49-4eb6-b40f-7bc261dc796a None admin] REQUEST_METHOD: `PUT` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:55:20.422915 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dca3c36-1d49-4eb6-b40f-7bc261dc796a None admin] SCRIPT_NAME: `/identity` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:55:20.425962 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dca3c36-1d49-4eb6-b40f-7bc261dc796a None admin] PATH_INFO: `/v3/projects/5d786687177b43f1a77b0111e41c578a/users/83c29eb8de1e47a69dfb88e4df8481d6/roles/280023171b4a45efb67c036ff237bb3c` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:55:20.428392 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dca3c36-1d49-4eb6-b40f-7bc261dc796a None admin] RBAC: Authorizing `identity:create_grant(project_id=5d786687177b43f1a77b0111e41c578a, user_id=83c29eb8de1e47a69dfb88e4df8481d6, role_id=280023171b4a45efb67c036ff237bb3c)` {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:55:20.429944 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dca3c36-1d49-4eb6-b40f-7bc261dc796a None admin] RBAC: Authorization granted {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:55:20.446584 dv-cinder-851351-1-smb devstack@keystone.service[352328]: [pid: 352328|app: 0|req: 587/1153] 10.222.0.42 () {58 vars in 1439 bytes} [Thu Jul 28 08:55:20 2022] PUT /identity/v3/projects/5d786687177b43f1a77b0111e41c578a/users/83c29eb8de1e47a69dfb88e4df8481d6/roles/280023171b4a45efb67c036ff237bb3c => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 08:55:22.521266 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674585ef-b3f5-463c-93a4-31652e4359ae None None] REQUEST_METHOD: `GET` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:55:22.521907 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674585ef-b3f5-463c-93a4-31652e4359ae None None] SCRIPT_NAME: `/identity` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:55:22.521907 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674585ef-b3f5-463c-93a4-31652e4359ae None None] PATH_INFO: `/` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:55:22.523213 dv-cinder-851351-1-smb devstack@keystone.service[352329]: [pid: 352329|app: 0|req: 567/1154] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 08:55:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 08:55:22.529168 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326df76f-4412-44b2-83ea-bac81ec168e7 None None] REQUEST_METHOD: `POST` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:55:22.529975 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326df76f-4412-44b2-83ea-bac81ec168e7 None None] SCRIPT_NAME: `/identity` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:55:22.529975 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326df76f-4412-44b2-83ea-bac81ec168e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:55:22.549425 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.auth.core [None req-326df76f-4412-44b2-83ea-bac81ec168e7 None None] MFA Rules not processed for user `d18c063b2377412485965357671e5506`. Rule list: `[]` (Enabled: `True`). {{(pid=352328) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 08:55:22.550671 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.fernet_utils [None req-326df76f-4412-44b2-83ea-bac81ec168e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=352328) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:55:22.608615 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG dbcounter [-] [352328] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=352328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:55:22.627731 dv-cinder-851351-1-smb devstack@keystone.service[352328]: [pid: 352328|app: 0|req: 588/1155] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 08:55:22 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 28 08:55:22.651601 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-674585ef-b3f5-463c-93a4-31652e4359ae None None] Authenticating user token {{(pid=352329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:55:22.773146 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-674585ef-b3f5-463c-93a4-31652e4359ae None None] Validating token access rules against request {{(pid=352329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:55:22.813208 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10da6fb0-032a-415e-a220-8435a89124f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:55:22.813879 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10da6fb0-032a-415e-a220-8435a89124f0 None admin] REQUEST_METHOD: `GET` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:55:22.814160 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10da6fb0-032a-415e-a220-8435a89124f0 None admin] SCRIPT_NAME: `/identity` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:55:22.814438 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10da6fb0-032a-415e-a220-8435a89124f0 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:55:22.828109 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10da6fb0-032a-415e-a220-8435a89124f0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 08:55:22.833734 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application [None req-10da6fb0-032a-415e-a220-8435a89124f0 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 08:55:22.833734 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:55:22.833734 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:55:22.833734 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:55:22.833734 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:55:22.833734 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:55:22.833734 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:55:22.833734 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:55:22.833734 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:55:22.833734 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:55:22.833734 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:55:22.833734 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:55:22.833734 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 08:55:22.833734 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 08:55:22.833734 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 08:55:22.833734 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 08:55:22.835643 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 08:55:22.835643 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 08:55:22.835643 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 08:55:22.835643 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 08:55:22.835643 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:55:22.835643 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:55:22.835643 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:55:22.835643 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:55:22.835643 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:55:22.835643 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:55:22.835643 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:55:22.835643 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application with Lock( Jul 28 08:55:22.835643 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:55:22.835643 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:55:22.835643 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:55:22.835643 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:55:22.837541 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:55:22.837541 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:55:22.837541 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:55:22.837541 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:55:22.837541 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 08:55:22.837541 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 08:55:22.837541 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 08:55:22.837541 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 08:55:22.837541 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 08:55:22.837541 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 08:55:22.837541 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 08:55:22.837541 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application Jul 28 08:55:22.837541 dv-cinder-851351-1-smb devstack@keystone.service[352329]: [pid: 352329|app: 0|req: 568/1156] 10.222.0.42 () {56 vars in 1096 bytes} [Thu Jul 28 08:55:22 2022] GET /identity/v3/roles/admin => generated 83 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:55:22.841766 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-326df76f-4412-44b2-83ea-bac81ec168e7 None None] Authenticating user token {{(pid=352328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:55:22.953783 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-326df76f-4412-44b2-83ea-bac81ec168e7 None None] Validating token access rules against request {{(pid=352328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:55:22.993130 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e517ff-bc7b-4b1d-9523-0108d3c0bd08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:55:22.993784 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e517ff-bc7b-4b1d-9523-0108d3c0bd08 None admin] REQUEST_METHOD: `GET` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:55:22.994065 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e517ff-bc7b-4b1d-9523-0108d3c0bd08 None admin] SCRIPT_NAME: `/identity` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:55:22.994334 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e517ff-bc7b-4b1d-9523-0108d3c0bd08 None admin] PATH_INFO: `/v3/roles` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:55:22.995087 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e517ff-bc7b-4b1d-9523-0108d3c0bd08 None admin] RBAC: Adding query filter params (name=admin) {{(pid=352328) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:55:22.995383 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e517ff-bc7b-4b1d-9523-0108d3c0bd08 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:55:22.996826 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e517ff-bc7b-4b1d-9523-0108d3c0bd08 None admin] RBAC: Authorization granted {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:55:23.007108 dv-cinder-851351-1-smb devstack@keystone.service[352328]: [pid: 352328|app: 0|req: 589/1157] 10.222.0.42 () {56 vars in 1099 bytes} [Thu Jul 28 08:55:22 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:55:23.013464 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10da6fb0-032a-415e-a220-8435a89124f0 None admin] Authenticating user token {{(pid=352329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:55:23.066081 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG dbcounter [-] [352329] Writing DB stats keystone:SELECT=100 {{(pid=352329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:55:23.130863 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10da6fb0-032a-415e-a220-8435a89124f0 None admin] Validating token access rules against request {{(pid=352329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:55:23.168529 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b31ccd-aee7-4c08-a2bc-0075f3b4fd0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:55:23.169309 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b31ccd-aee7-4c08-a2bc-0075f3b4fd0e None admin] REQUEST_METHOD: `GET` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:55:23.169640 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b31ccd-aee7-4c08-a2bc-0075f3b4fd0e None admin] SCRIPT_NAME: `/identity` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:55:23.169967 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b31ccd-aee7-4c08-a2bc-0075f3b4fd0e None admin] PATH_INFO: `/v3/users/83c29eb8de1e47a69dfb88e4df8481d6` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:55:23.171321 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b31ccd-aee7-4c08-a2bc-0075f3b4fd0e None admin] RBAC: Authorizing `identity:get_user(user_id=83c29eb8de1e47a69dfb88e4df8481d6)` {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:55:23.172905 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b31ccd-aee7-4c08-a2bc-0075f3b4fd0e None admin] RBAC: Authorization granted {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:55:23.174640 dv-cinder-851351-1-smb devstack@keystone.service[352329]: [pid: 352329|app: 0|req: 569/1158] 10.222.0.42 () {56 vars in 1177 bytes} [Thu Jul 28 08:55:23 2022] GET /identity/v3/users/83c29eb8de1e47a69dfb88e4df8481d6 => generated 286 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:55:23.180983 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e517ff-bc7b-4b1d-9523-0108d3c0bd08 None admin] Authenticating user token {{(pid=352328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:55:23.242397 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG dbcounter [-] [352328] Writing DB stats keystone:SELECT=100 {{(pid=352328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:55:23.302794 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e517ff-bc7b-4b1d-9523-0108d3c0bd08 None admin] Validating token access rules against request {{(pid=352328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:55:23.347059 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2717d1b9-9836-4d71-8c4f-85c9fb327841 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:55:23.347722 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2717d1b9-9836-4d71-8c4f-85c9fb327841 None admin] REQUEST_METHOD: `GET` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:55:23.348006 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2717d1b9-9836-4d71-8c4f-85c9fb327841 None admin] SCRIPT_NAME: `/identity` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:55:23.348284 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2717d1b9-9836-4d71-8c4f-85c9fb327841 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:55:23.429375 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2717d1b9-9836-4d71-8c4f-85c9fb327841 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:55:23.430902 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2717d1b9-9836-4d71-8c4f-85c9fb327841 None admin] RBAC: Authorization granted {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:55:23.487821 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG dbcounter [-] [352328] Writing DB stats keystone:SELECT=100 {{(pid=352328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:55:23.551453 dv-cinder-851351-1-smb devstack@keystone.service[352328]: [pid: 352328|app: 0|req: 590/1159] 10.222.0.42 () {58 vars in 1282 bytes} [Thu Jul 28 08:55:23 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 371 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 28 08:55:23.557985 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b31ccd-aee7-4c08-a2bc-0075f3b4fd0e None admin] Authenticating user token {{(pid=352329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:55:23.674069 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b31ccd-aee7-4c08-a2bc-0075f3b4fd0e None admin] Validating token access rules against request {{(pid=352329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:55:23.685622 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG dbcounter [-] [352329] Writing DB stats keystone:SELECT=100 {{(pid=352329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:55:23.713147 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4e1405-5e78-420a-8d0d-575b193c5a35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:55:23.713814 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4e1405-5e78-420a-8d0d-575b193c5a35 None admin] REQUEST_METHOD: `GET` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:55:23.714099 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4e1405-5e78-420a-8d0d-575b193c5a35 None admin] SCRIPT_NAME: `/identity` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:55:23.714379 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4e1405-5e78-420a-8d0d-575b193c5a35 None admin] PATH_INFO: `/v3/projects/5d786687177b43f1a77b0111e41c578a` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:55:23.715636 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce4e1405-5e78-420a-8d0d-575b193c5a35 None admin] RBAC: Authorizing `identity:get_project(project_id=5d786687177b43f1a77b0111e41c578a)` {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:55:23.717152 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce4e1405-5e78-420a-8d0d-575b193c5a35 None admin] RBAC: Authorization granted {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:55:23.719651 dv-cinder-851351-1-smb devstack@keystone.service[352329]: [pid: 352329|app: 0|req: 570/1160] 10.222.0.42 () {56 vars in 1186 bytes} [Thu Jul 28 08:55:23 2022] GET /identity/v3/projects/5d786687177b43f1a77b0111e41c578a => generated 311 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:55:23.726257 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2717d1b9-9836-4d71-8c4f-85c9fb327841 None admin] Authenticating user token {{(pid=352328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:55:23.842913 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2717d1b9-9836-4d71-8c4f-85c9fb327841 None admin] Validating token access rules against request {{(pid=352328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:55:23.882309 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6956d1a5-5441-4415-96cd-7101cc32189f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:55:23.882949 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6956d1a5-5441-4415-96cd-7101cc32189f None admin] REQUEST_METHOD: `GET` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:55:23.883235 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6956d1a5-5441-4415-96cd-7101cc32189f None admin] SCRIPT_NAME: `/identity` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:55:23.883515 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6956d1a5-5441-4415-96cd-7101cc32189f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:55:23.884329 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6956d1a5-5441-4415-96cd-7101cc32189f None admin] RBAC: Adding query filter params (role.id=280023171b4a45efb67c036ff237bb3c, scope.project.id=5d786687177b43f1a77b0111e41c578a, user.id=83c29eb8de1e47a69dfb88e4df8481d6) {{(pid=352328) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:55:23.884645 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6956d1a5-5441-4415-96cd-7101cc32189f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:55:23.886146 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6956d1a5-5441-4415-96cd-7101cc32189f None admin] RBAC: Authorization granted {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:55:23.892971 dv-cinder-851351-1-smb devstack@keystone.service[352328]: [pid: 352328|app: 0|req: 591/1161] 10.222.0.42 () {56 vars in 1374 bytes} [Thu Jul 28 08:55:23 2022] GET /identity/v3/role_assignments?user.id=83c29eb8de1e47a69dfb88e4df8481d6&scope.project.id=5d786687177b43f1a77b0111e41c578a&role.id=280023171b4a45efb67c036ff237bb3c => generated 608 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:55:26.030124 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa92e711-4182-4082-aee7-7e1b6dcad315 None None] REQUEST_METHOD: `GET` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:55:26.030754 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa92e711-4182-4082-aee7-7e1b6dcad315 None None] SCRIPT_NAME: `/identity` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:55:26.030754 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa92e711-4182-4082-aee7-7e1b6dcad315 None None] PATH_INFO: `/` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:55:26.032111 dv-cinder-851351-1-smb devstack@keystone.service[352329]: [pid: 352329|app: 0|req: 571/1162] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 08:55:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 08:55:26.038302 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c4837c-3d23-4c07-aa3c-4c14eb91891f None None] REQUEST_METHOD: `POST` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:55:26.039135 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c4837c-3d23-4c07-aa3c-4c14eb91891f None None] SCRIPT_NAME: `/identity` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:55:26.039135 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c4837c-3d23-4c07-aa3c-4c14eb91891f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:55:26.059790 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.auth.core [None req-11c4837c-3d23-4c07-aa3c-4c14eb91891f None None] MFA Rules not processed for user `d18c063b2377412485965357671e5506`. Rule list: `[]` (Enabled: `True`). {{(pid=352328) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 08:55:26.061097 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.fernet_utils [None req-11c4837c-3d23-4c07-aa3c-4c14eb91891f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=352328) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:55:26.070396 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG dbcounter [-] [352328] Writing DB stats keystone:SELECT=100 {{(pid=352328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:55:26.141763 dv-cinder-851351-1-smb devstack@keystone.service[352328]: [pid: 352328|app: 0|req: 592/1163] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 08:55:26 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 08:55:26.164856 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa92e711-4182-4082-aee7-7e1b6dcad315 None None] Authenticating user token {{(pid=352329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:55:26.307625 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa92e711-4182-4082-aee7-7e1b6dcad315 None None] Validating token access rules against request {{(pid=352329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:55:26.358224 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f7e56a5-9473-48ea-b9cd-9f49d481bf0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:55:26.358890 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7e56a5-9473-48ea-b9cd-9f49d481bf0c None admin] REQUEST_METHOD: `GET` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:55:26.359176 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7e56a5-9473-48ea-b9cd-9f49d481bf0c None admin] SCRIPT_NAME: `/identity` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:55:26.359452 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7e56a5-9473-48ea-b9cd-9f49d481bf0c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:55:26.412317 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG dbcounter [-] [352329] Writing DB stats keystone:SELECT=100 {{(pid=352329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:55:26.437141 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f7e56a5-9473-48ea-b9cd-9f49d481bf0c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:55:26.438650 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f7e56a5-9473-48ea-b9cd-9f49d481bf0c None admin] RBAC: Authorization granted {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:55:26.548325 dv-cinder-851351-1-smb devstack@keystone.service[352329]: [pid: 352329|app: 0|req: 572/1164] 10.222.0.42 () {58 vars in 1282 bytes} [Thu Jul 28 08:55:26 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 384 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 28 08:55:26.554761 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c4837c-3d23-4c07-aa3c-4c14eb91891f None None] Authenticating user token {{(pid=352328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:55:26.665720 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c4837c-3d23-4c07-aa3c-4c14eb91891f None None] Validating token access rules against request {{(pid=352328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:55:26.705091 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7213ebcf-e5bb-4d0e-9685-cc8796bbce37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:55:26.705829 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7213ebcf-e5bb-4d0e-9685-cc8796bbce37 None admin] REQUEST_METHOD: `GET` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:55:26.706164 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7213ebcf-e5bb-4d0e-9685-cc8796bbce37 None admin] SCRIPT_NAME: `/identity` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:55:26.706522 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7213ebcf-e5bb-4d0e-9685-cc8796bbce37 None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:55:26.714528 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7213ebcf-e5bb-4d0e-9685-cc8796bbce37 None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:55:26.716101 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7213ebcf-e5bb-4d0e-9685-cc8796bbce37 None admin] RBAC: Authorization granted {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:55:26.733305 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application [None req-7213ebcf-e5bb-4d0e-9685-cc8796bbce37 None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Jul 28 08:55:26.733305 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:55:26.733305 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Jul 28 08:55:26.733305 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Jul 28 08:55:26.733305 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 28 08:55:26.733305 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 28 08:55:26.733305 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 28 08:55:26.733305 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 28 08:55:26.733305 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. Jul 28 08:55:26.733305 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application Jul 28 08:55:26.733305 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 28 08:55:26.733305 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application Jul 28 08:55:26.733305 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:55:26.733305 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:55:26.733305 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:55:26.733305 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:55:26.733305 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:55:26.735583 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:55:26.735583 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:55:26.735583 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:55:26.735583 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:55:26.735583 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:55:26.735583 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:55:26.735583 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 08:55:26.735583 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 08:55:26.735583 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 08:55:26.735583 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 08:55:26.735583 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:55:26.735583 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:55:26.735583 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:55:26.735583 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:55:26.735583 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:55:26.735583 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:55:26.737479 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:55:26.737479 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application with Lock( Jul 28 08:55:26.737479 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:55:26.737479 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:55:26.737479 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:55:26.737479 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:55:26.737479 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:55:26.737479 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:55:26.737479 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:55:26.737479 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:55:26.737479 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Jul 28 08:55:26.737479 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 08:55:26.737479 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. Jul 28 08:55:26.737479 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application Jul 28 08:55:26.739088 dv-cinder-851351-1-smb devstack@keystone.service[352328]: [pid: 352328|app: 0|req: 593/1165] 10.222.0.42 () {56 vars in 1117 bytes} [Thu Jul 28 08:55:26 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:55:26.747035 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f7e56a5-9473-48ea-b9cd-9f49d481bf0c None admin] Authenticating user token {{(pid=352329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:55:26.837118 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG dbcounter [-] [352329] Writing DB stats keystone:SELECT=100 {{(pid=352329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:55:26.864985 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f7e56a5-9473-48ea-b9cd-9f49d481bf0c None admin] Validating token access rules against request {{(pid=352329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:55:26.903894 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a93bc9-669a-45e0-8a57-01549edb11ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:55:26.904596 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a93bc9-669a-45e0-8a57-01549edb11ae None admin] REQUEST_METHOD: `GET` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:55:26.904954 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a93bc9-669a-45e0-8a57-01549edb11ae None admin] SCRIPT_NAME: `/identity` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:55:26.905403 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a93bc9-669a-45e0-8a57-01549edb11ae None admin] PATH_INFO: `/v3/domains` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:55:26.906174 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a93bc9-669a-45e0-8a57-01549edb11ae None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=352329) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:55:26.906529 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a93bc9-669a-45e0-8a57-01549edb11ae None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:55:26.908008 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a93bc9-669a-45e0-8a57-01549edb11ae None admin] RBAC: Authorization granted {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:55:26.916522 dv-cinder-851351-1-smb devstack@keystone.service[352329]: [pid: 352329|app: 0|req: 573/1166] 10.222.0.42 () {56 vars in 1115 bytes} [Thu Jul 28 08:55:26 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:55:28.997099 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3a519d-b580-4d0f-8fd8-10e00379f4c4 None None] REQUEST_METHOD: `GET` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:55:28.997977 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3a519d-b580-4d0f-8fd8-10e00379f4c4 None None] SCRIPT_NAME: `/identity` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:55:28.997977 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3a519d-b580-4d0f-8fd8-10e00379f4c4 None None] PATH_INFO: `/` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:55:28.999038 dv-cinder-851351-1-smb devstack@keystone.service[352328]: [pid: 352328|app: 0|req: 594/1167] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 08:55:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 08:55:29.005264 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096196a7-fe4c-4bf8-8395-f14bacb71028 None None] REQUEST_METHOD: `POST` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:55:29.005922 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096196a7-fe4c-4bf8-8395-f14bacb71028 None None] SCRIPT_NAME: `/identity` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:55:29.005922 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096196a7-fe4c-4bf8-8395-f14bacb71028 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:55:29.026451 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.auth.core [None req-096196a7-fe4c-4bf8-8395-f14bacb71028 None None] MFA Rules not processed for user `d18c063b2377412485965357671e5506`. Rule list: `[]` (Enabled: `True`). {{(pid=352329) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 08:55:29.027695 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.fernet_utils [None req-096196a7-fe4c-4bf8-8395-f14bacb71028 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=352329) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:55:29.105692 dv-cinder-851351-1-smb devstack@keystone.service[352329]: [pid: 352329|app: 0|req: 574/1168] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 08:55:29 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 08:55:29.129355 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3a519d-b580-4d0f-8fd8-10e00379f4c4 None None] Authenticating user token {{(pid=352328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:55:29.132739 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG dbcounter [-] [352328] Writing DB stats keystone:SELECT=100 {{(pid=352328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:55:29.250594 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3a519d-b580-4d0f-8fd8-10e00379f4c4 None None] Validating token access rules against request {{(pid=352328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:55:29.297805 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb6990a3-9c6a-4da8-aa25-2aee149d635e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:55:29.298472 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6990a3-9c6a-4da8-aa25-2aee149d635e None admin] REQUEST_METHOD: `POST` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:55:29.298765 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6990a3-9c6a-4da8-aa25-2aee149d635e None admin] SCRIPT_NAME: `/identity` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:55:29.299039 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6990a3-9c6a-4da8-aa25-2aee149d635e None admin] PATH_INFO: `/v3/domains` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:55:29.299796 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb6990a3-9c6a-4da8-aa25-2aee149d635e None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:55:29.301263 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb6990a3-9c6a-4da8-aa25-2aee149d635e None admin] RBAC: Authorization granted {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:55:29.320431 dv-cinder-851351-1-smb devstack@keystone.service[352328]: [pid: 352328|app: 0|req: 595/1169] 10.222.0.42 () {60 vars in 1138 bytes} [Thu Jul 28 08:55:29 2022] POST /identity/v3/domains => generated 267 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 08:55:31.426510 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc8a51c-5fc4-4bb2-8a41-5cf081f52b7e None None] REQUEST_METHOD: `GET` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:55:31.427162 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc8a51c-5fc4-4bb2-8a41-5cf081f52b7e None None] SCRIPT_NAME: `/identity` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:55:31.427162 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc8a51c-5fc4-4bb2-8a41-5cf081f52b7e None None] PATH_INFO: `/` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:55:31.428449 dv-cinder-851351-1-smb devstack@keystone.service[352329]: [pid: 352329|app: 0|req: 575/1170] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 08:55:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 08:55:31.434360 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23126d10-ec18-4eeb-b1fe-c2388ca96706 None None] REQUEST_METHOD: `POST` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:55:31.434907 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23126d10-ec18-4eeb-b1fe-c2388ca96706 None None] SCRIPT_NAME: `/identity` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:55:31.434907 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23126d10-ec18-4eeb-b1fe-c2388ca96706 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:55:31.456448 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.auth.core [None req-23126d10-ec18-4eeb-b1fe-c2388ca96706 None None] MFA Rules not processed for user `d18c063b2377412485965357671e5506`. Rule list: `[]` (Enabled: `True`). {{(pid=352328) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 08:55:31.457725 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.fernet_utils [None req-23126d10-ec18-4eeb-b1fe-c2388ca96706 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=352328) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:55:31.517588 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG dbcounter [-] [352328] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=352328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:55:31.530246 dv-cinder-851351-1-smb devstack@keystone.service[352328]: [pid: 352328|app: 0|req: 596/1171] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 08:55:31 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 08:55:31.554051 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc8a51c-5fc4-4bb2-8a41-5cf081f52b7e None None] Authenticating user token {{(pid=352329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:55:31.646624 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG dbcounter [-] [352329] Writing DB stats keystone:SELECT=100 {{(pid=352329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:55:31.683633 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc8a51c-5fc4-4bb2-8a41-5cf081f52b7e None None] Validating token access rules against request {{(pid=352329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:55:31.728853 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa65fddf-c9de-4c22-bcbb-f902bb29346d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:55:31.730024 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa65fddf-c9de-4c22-bcbb-f902bb29346d None admin] REQUEST_METHOD: `GET` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:55:31.730431 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa65fddf-c9de-4c22-bcbb-f902bb29346d None admin] SCRIPT_NAME: `/identity` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:55:31.730947 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa65fddf-c9de-4c22-bcbb-f902bb29346d None admin] PATH_INFO: `/v3/domains/e46e78b7793d493eb272ea88297c06d2` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:55:31.751922 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa65fddf-c9de-4c22-bcbb-f902bb29346d None admin] RBAC: Authorizing `identity:get_domain(domain_id=e46e78b7793d493eb272ea88297c06d2)` {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:55:31.754195 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa65fddf-c9de-4c22-bcbb-f902bb29346d None admin] RBAC: Authorization granted {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:55:31.757389 dv-cinder-851351-1-smb devstack@keystone.service[352329]: [pid: 352329|app: 0|req: 576/1172] 10.222.0.42 () {56 vars in 1183 bytes} [Thu Jul 28 08:55:31 2022] GET /identity/v3/domains/e46e78b7793d493eb272ea88297c06d2 => generated 267 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:55:31.766923 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23126d10-ec18-4eeb-b1fe-c2388ca96706 None None] Authenticating user token {{(pid=352328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:55:31.877293 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23126d10-ec18-4eeb-b1fe-c2388ca96706 None None] Validating token access rules against request {{(pid=352328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:55:31.914410 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e043ce2-0dad-4009-983b-6944a2833d67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:55:31.915057 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e043ce2-0dad-4009-983b-6944a2833d67 None admin] REQUEST_METHOD: `POST` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:55:31.915341 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e043ce2-0dad-4009-983b-6944a2833d67 None admin] SCRIPT_NAME: `/identity` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:55:31.915619 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e043ce2-0dad-4009-983b-6944a2833d67 None admin] PATH_INFO: `/v3/projects` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:55:31.916336 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e043ce2-0dad-4009-983b-6944a2833d67 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:55:31.917840 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e043ce2-0dad-4009-983b-6944a2833d67 None admin] RBAC: Authorization granted {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:55:31.947977 dv-cinder-851351-1-smb devstack@keystone.service[352328]: [pid: 352328|app: 0|req: 597/1173] 10.222.0.42 () {60 vars in 1141 bytes} [Thu Jul 28 08:55:31 2022] POST /identity/v3/projects => generated 361 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 08:55:34.052520 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b96e3d-65e2-4f01-bf20-c087c00633e9 None None] REQUEST_METHOD: `GET` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:55:34.053269 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b96e3d-65e2-4f01-bf20-c087c00633e9 None None] SCRIPT_NAME: `/identity` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:55:34.053269 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b96e3d-65e2-4f01-bf20-c087c00633e9 None None] PATH_INFO: `/` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:55:34.054554 dv-cinder-851351-1-smb devstack@keystone.service[352329]: [pid: 352329|app: 0|req: 577/1174] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 08:55:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 08:55:34.061208 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feba1c03-5e6c-4b37-922c-45195dfbaf60 None None] REQUEST_METHOD: `POST` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:55:34.061865 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feba1c03-5e6c-4b37-922c-45195dfbaf60 None None] SCRIPT_NAME: `/identity` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:55:34.061865 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feba1c03-5e6c-4b37-922c-45195dfbaf60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:55:34.084082 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.auth.core [None req-feba1c03-5e6c-4b37-922c-45195dfbaf60 None None] MFA Rules not processed for user `d18c063b2377412485965357671e5506`. Rule list: `[]` (Enabled: `True`). {{(pid=352328) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 08:55:34.085387 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.fernet_utils [None req-feba1c03-5e6c-4b37-922c-45195dfbaf60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=352328) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:55:34.135374 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG dbcounter [-] [352328] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=352328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:55:34.171357 dv-cinder-851351-1-smb devstack@keystone.service[352328]: [pid: 352328|app: 0|req: 598/1175] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 08:55:34 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 08:55:34.197491 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b96e3d-65e2-4f01-bf20-c087c00633e9 None None] Authenticating user token {{(pid=352329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:55:34.324171 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b96e3d-65e2-4f01-bf20-c087c00633e9 None None] Validating token access rules against request {{(pid=352329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:55:34.359375 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG dbcounter [-] [352329] Writing DB stats keystone:SELECT=100 {{(pid=352329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:55:34.366349 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6cdde9-5396-42e7-aba6-bc19d312c7d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:55:34.367032 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6cdde9-5396-42e7-aba6-bc19d312c7d7 None admin] REQUEST_METHOD: `GET` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:55:34.367316 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6cdde9-5396-42e7-aba6-bc19d312c7d7 None admin] SCRIPT_NAME: `/identity` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:55:34.367594 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6cdde9-5396-42e7-aba6-bc19d312c7d7 None admin] PATH_INFO: `/v3/domains/e46e78b7793d493eb272ea88297c06d2` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:55:34.368924 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f6cdde9-5396-42e7-aba6-bc19d312c7d7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=e46e78b7793d493eb272ea88297c06d2)` {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:55:34.370438 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f6cdde9-5396-42e7-aba6-bc19d312c7d7 None admin] RBAC: Authorization granted {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:55:34.372177 dv-cinder-851351-1-smb devstack@keystone.service[352329]: [pid: 352329|app: 0|req: 578/1176] 10.222.0.42 () {56 vars in 1183 bytes} [Thu Jul 28 08:55:34 2022] GET /identity/v3/domains/e46e78b7793d493eb272ea88297c06d2 => generated 267 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:55:34.378722 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feba1c03-5e6c-4b37-922c-45195dfbaf60 None None] Authenticating user token {{(pid=352328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:55:34.526836 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feba1c03-5e6c-4b37-922c-45195dfbaf60 None None] Validating token access rules against request {{(pid=352328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:55:34.582819 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8b19f4-d5fb-4753-a70b-3cb0d90bcf42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:55:34.583389 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8b19f4-d5fb-4753-a70b-3cb0d90bcf42 None admin] REQUEST_METHOD: `POST` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:55:34.583678 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8b19f4-d5fb-4753-a70b-3cb0d90bcf42 None admin] SCRIPT_NAME: `/identity` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:55:34.583957 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8b19f4-d5fb-4753-a70b-3cb0d90bcf42 None admin] PATH_INFO: `/v3/users` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:55:34.584709 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec8b19f4-d5fb-4753-a70b-3cb0d90bcf42 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:55:34.586194 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec8b19f4-d5fb-4753-a70b-3cb0d90bcf42 None admin] RBAC: Authorization granted {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:55:34.610718 dv-cinder-851351-1-smb devstack@keystone.service[352328]: [pid: 352328|app: 0|req: 599/1177] 10.222.0.42 () {60 vars in 1132 bytes} [Thu Jul 28 08:55:34 2022] POST /identity/v3/users => generated 311 bytes in 233 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 08:55:36.808439 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d891a4c6-c3b2-4d9c-9b6a-3846368a092f None None] REQUEST_METHOD: `GET` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:55:36.809346 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d891a4c6-c3b2-4d9c-9b6a-3846368a092f None None] SCRIPT_NAME: `/identity` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:55:36.809346 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d891a4c6-c3b2-4d9c-9b6a-3846368a092f None None] PATH_INFO: `/` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:55:36.810461 dv-cinder-851351-1-smb devstack@keystone.service[352329]: [pid: 352329|app: 0|req: 579/1178] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 08:55:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 08:55:36.816535 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2de748-fad6-4555-a97a-55d893c7171a None None] REQUEST_METHOD: `POST` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:55:36.817456 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2de748-fad6-4555-a97a-55d893c7171a None None] SCRIPT_NAME: `/identity` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:55:36.817456 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2de748-fad6-4555-a97a-55d893c7171a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:55:36.837647 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.auth.core [None req-3b2de748-fad6-4555-a97a-55d893c7171a None None] MFA Rules not processed for user `d18c063b2377412485965357671e5506`. Rule list: `[]` (Enabled: `True`). {{(pid=352328) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 08:55:36.838907 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.fernet_utils [None req-3b2de748-fad6-4555-a97a-55d893c7171a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=352328) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:55:36.866606 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG dbcounter [-] [352328] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=352328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:55:36.916112 dv-cinder-851351-1-smb devstack@keystone.service[352328]: [pid: 352328|app: 0|req: 600/1179] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 08:55:36 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 28 08:55:36.940103 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d891a4c6-c3b2-4d9c-9b6a-3846368a092f None None] Authenticating user token {{(pid=352329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:55:37.053833 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d891a4c6-c3b2-4d9c-9b6a-3846368a092f None None] Validating token access rules against request {{(pid=352329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:55:37.091521 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f574ea-7fbb-432f-9abe-4f03004d2de7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:55:37.092182 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f574ea-7fbb-432f-9abe-4f03004d2de7 None admin] REQUEST_METHOD: `GET` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:55:37.092497 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f574ea-7fbb-432f-9abe-4f03004d2de7 None admin] SCRIPT_NAME: `/identity` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:55:37.092800 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f574ea-7fbb-432f-9abe-4f03004d2de7 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:55:37.105067 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f574ea-7fbb-432f-9abe-4f03004d2de7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 08:55:37.110495 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application [None req-98f574ea-7fbb-432f-9abe-4f03004d2de7 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 08:55:37.110495 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:55:37.110495 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:55:37.110495 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:55:37.110495 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:55:37.110495 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:55:37.110495 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:55:37.110495 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:55:37.110495 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:55:37.110495 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:55:37.110495 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:55:37.110495 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:55:37.110495 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 08:55:37.110495 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 08:55:37.110495 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 08:55:37.110495 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 08:55:37.112757 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 08:55:37.112757 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 08:55:37.112757 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 08:55:37.112757 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 08:55:37.112757 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:55:37.112757 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:55:37.112757 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:55:37.112757 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:55:37.112757 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:55:37.112757 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:55:37.112757 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:55:37.112757 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application with Lock( Jul 28 08:55:37.112757 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:55:37.112757 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:55:37.112757 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:55:37.112757 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:55:37.114733 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:55:37.114733 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:55:37.114733 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:55:37.114733 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:55:37.114733 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 08:55:37.114733 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 08:55:37.114733 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 08:55:37.114733 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 08:55:37.114733 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 08:55:37.114733 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 08:55:37.114733 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 08:55:37.114733 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application Jul 28 08:55:37.114733 dv-cinder-851351-1-smb devstack@keystone.service[352329]: [pid: 352329|app: 0|req: 580/1180] 10.222.0.42 () {56 vars in 1096 bytes} [Thu Jul 28 08:55:36 2022] GET /identity/v3/roles/admin => generated 83 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:55:37.118291 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2de748-fad6-4555-a97a-55d893c7171a None None] Authenticating user token {{(pid=352328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:55:37.232603 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2de748-fad6-4555-a97a-55d893c7171a None None] Validating token access rules against request {{(pid=352328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:55:37.271941 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0028f082-04ba-49d5-b0ce-c7ffc090a2ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:55:37.272582 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0028f082-04ba-49d5-b0ce-c7ffc090a2ef None admin] REQUEST_METHOD: `GET` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:55:37.272872 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0028f082-04ba-49d5-b0ce-c7ffc090a2ef None admin] SCRIPT_NAME: `/identity` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:55:37.273177 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0028f082-04ba-49d5-b0ce-c7ffc090a2ef None admin] PATH_INFO: `/v3/roles` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:55:37.273910 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0028f082-04ba-49d5-b0ce-c7ffc090a2ef None admin] RBAC: Adding query filter params (name=admin) {{(pid=352328) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:55:37.274218 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0028f082-04ba-49d5-b0ce-c7ffc090a2ef None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:55:37.275631 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0028f082-04ba-49d5-b0ce-c7ffc090a2ef None admin] RBAC: Authorization granted {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:55:37.285148 dv-cinder-851351-1-smb devstack@keystone.service[352328]: [pid: 352328|app: 0|req: 601/1181] 10.222.0.42 () {56 vars in 1099 bytes} [Thu Jul 28 08:55:37 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:55:37.295356 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f574ea-7fbb-432f-9abe-4f03004d2de7 None admin] Authenticating user token {{(pid=352329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:55:37.363391 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG dbcounter [-] [352329] Writing DB stats keystone:SELECT=100 {{(pid=352329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:55:37.408461 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f574ea-7fbb-432f-9abe-4f03004d2de7 None admin] Validating token access rules against request {{(pid=352329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:55:37.445296 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2f87c2-afe7-416f-884c-55eae64faa2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:55:37.445965 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2f87c2-afe7-416f-884c-55eae64faa2c None admin] REQUEST_METHOD: `GET` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:55:37.446252 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2f87c2-afe7-416f-884c-55eae64faa2c None admin] SCRIPT_NAME: `/identity` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:55:37.446519 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2f87c2-afe7-416f-884c-55eae64faa2c None admin] PATH_INFO: `/v3/users/ad153fd8edb44d7c99b289be36ff0a21` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:55:37.462119 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c2f87c2-afe7-416f-884c-55eae64faa2c None admin] RBAC: Authorizing `identity:get_user(user_id=ad153fd8edb44d7c99b289be36ff0a21)` {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:55:37.463613 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c2f87c2-afe7-416f-884c-55eae64faa2c None admin] RBAC: Authorization granted {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:55:37.465439 dv-cinder-851351-1-smb devstack@keystone.service[352329]: [pid: 352329|app: 0|req: 581/1182] 10.222.0.42 () {56 vars in 1177 bytes} [Thu Jul 28 08:55:37 2022] GET /identity/v3/users/ad153fd8edb44d7c99b289be36ff0a21 => generated 311 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:55:37.471754 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0028f082-04ba-49d5-b0ce-c7ffc090a2ef None admin] Authenticating user token {{(pid=352328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:55:37.502144 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG dbcounter [-] [352328] Writing DB stats keystone:SELECT=100 {{(pid=352328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:55:37.638379 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0028f082-04ba-49d5-b0ce-c7ffc090a2ef None admin] Validating token access rules against request {{(pid=352328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:55:37.706184 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e5a07f-84de-4094-8fd9-a8123f3db243 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:55:37.707256 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e5a07f-84de-4094-8fd9-a8123f3db243 None admin] REQUEST_METHOD: `GET` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:55:37.707749 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e5a07f-84de-4094-8fd9-a8123f3db243 None admin] SCRIPT_NAME: `/identity` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:55:37.708244 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e5a07f-84de-4094-8fd9-a8123f3db243 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:55:37.814509 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31e5a07f-84de-4094-8fd9-a8123f3db243 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:55:37.816008 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31e5a07f-84de-4094-8fd9-a8123f3db243 None admin] RBAC: Authorization granted {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:55:37.844074 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG dbcounter [-] [352328] Writing DB stats keystone:SELECT=100 {{(pid=352328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:55:37.943635 dv-cinder-851351-1-smb devstack@keystone.service[352328]: [pid: 352328|app: 0|req: 602/1183] 10.222.0.42 () {58 vars in 1282 bytes} [Thu Jul 28 08:55:37 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 472 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jul 28 08:55:37.950022 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2f87c2-afe7-416f-884c-55eae64faa2c None admin] Authenticating user token {{(pid=352329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:55:38.071513 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2f87c2-afe7-416f-884c-55eae64faa2c None admin] Validating token access rules against request {{(pid=352329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:55:38.093108 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG dbcounter [-] [352329] Writing DB stats keystone:SELECT=100 {{(pid=352329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:55:38.114958 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e58fa9c-5f5d-428e-86ff-948544105e36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:55:38.115641 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e58fa9c-5f5d-428e-86ff-948544105e36 None admin] REQUEST_METHOD: `GET` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:55:38.115928 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e58fa9c-5f5d-428e-86ff-948544105e36 None admin] SCRIPT_NAME: `/identity` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:55:38.116208 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e58fa9c-5f5d-428e-86ff-948544105e36 None admin] PATH_INFO: `/v3/projects/dc71fcccde9e445db2c312b2481c8ac2` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:55:38.117500 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e58fa9c-5f5d-428e-86ff-948544105e36 None admin] RBAC: Authorizing `identity:get_project(project_id=dc71fcccde9e445db2c312b2481c8ac2)` {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:55:38.119002 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e58fa9c-5f5d-428e-86ff-948544105e36 None admin] RBAC: Authorization granted {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:55:38.120784 dv-cinder-851351-1-smb devstack@keystone.service[352329]: [pid: 352329|app: 0|req: 582/1184] 10.222.0.42 () {56 vars in 1186 bytes} [Thu Jul 28 08:55:37 2022] GET /identity/v3/projects/dc71fcccde9e445db2c312b2481c8ac2 => generated 361 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 08:55:38.127402 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e5a07f-84de-4094-8fd9-a8123f3db243 None admin] Authenticating user token {{(pid=352328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:55:38.240926 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e5a07f-84de-4094-8fd9-a8123f3db243 None admin] Validating token access rules against request {{(pid=352328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:55:38.276047 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG dbcounter [-] [352328] Writing DB stats keystone:SELECT=100 {{(pid=352328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:55:38.291282 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b19e5f-76ab-4584-9efd-d6d1ccf63e11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:55:38.292344 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b19e5f-76ab-4584-9efd-d6d1ccf63e11 None admin] REQUEST_METHOD: `GET` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:55:38.293116 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b19e5f-76ab-4584-9efd-d6d1ccf63e11 None admin] SCRIPT_NAME: `/identity` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:55:38.293394 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b19e5f-76ab-4584-9efd-d6d1ccf63e11 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:55:38.294207 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75b19e5f-76ab-4584-9efd-d6d1ccf63e11 None admin] RBAC: Adding query filter params (role.id=280023171b4a45efb67c036ff237bb3c, scope.project.id=dc71fcccde9e445db2c312b2481c8ac2, user.id=ad153fd8edb44d7c99b289be36ff0a21) {{(pid=352328) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:55:38.294519 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75b19e5f-76ab-4584-9efd-d6d1ccf63e11 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:55:38.296051 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75b19e5f-76ab-4584-9efd-d6d1ccf63e11 None admin] RBAC: Authorization granted {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:55:38.304437 dv-cinder-851351-1-smb devstack@keystone.service[352328]: [pid: 352328|app: 0|req: 603/1185] 10.222.0.42 () {56 vars in 1374 bytes} [Thu Jul 28 08:55:38 2022] GET /identity/v3/role_assignments?user.id=ad153fd8edb44d7c99b289be36ff0a21&scope.project.id=dc71fcccde9e445db2c312b2481c8ac2&role.id=280023171b4a45efb67c036ff237bb3c => generated 259 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:55:40.368607 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9adf099d-f986-4e7e-984b-06cf21803b25 None None] REQUEST_METHOD: `GET` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:55:40.369297 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9adf099d-f986-4e7e-984b-06cf21803b25 None None] SCRIPT_NAME: `/identity` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:55:40.369596 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9adf099d-f986-4e7e-984b-06cf21803b25 None None] PATH_INFO: `/` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:55:40.372165 dv-cinder-851351-1-smb devstack@keystone.service[352329]: [pid: 352329|app: 0|req: 583/1186] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 08:55:40 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 08:55:40.381131 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de92e972-cfa6-4bec-a3a9-3fe9c39f5183 None None] REQUEST_METHOD: `POST` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:55:40.381734 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de92e972-cfa6-4bec-a3a9-3fe9c39f5183 None None] SCRIPT_NAME: `/identity` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:55:40.381734 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de92e972-cfa6-4bec-a3a9-3fe9c39f5183 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:55:40.408754 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.auth.core [None req-de92e972-cfa6-4bec-a3a9-3fe9c39f5183 None None] MFA Rules not processed for user `d18c063b2377412485965357671e5506`. Rule list: `[]` (Enabled: `True`). {{(pid=352328) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 08:55:40.410926 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.fernet_utils [None req-de92e972-cfa6-4bec-a3a9-3fe9c39f5183 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=352328) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:55:40.536431 dv-cinder-851351-1-smb devstack@keystone.service[352328]: [pid: 352328|app: 0|req: 604/1187] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 08:55:40 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 08:55:40.559963 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9adf099d-f986-4e7e-984b-06cf21803b25 None None] Authenticating user token {{(pid=352329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:55:40.684921 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9adf099d-f986-4e7e-984b-06cf21803b25 None None] Validating token access rules against request {{(pid=352329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:55:40.747223 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7abcc487-f61c-4bb9-aa14-063529514552 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:55:40.748365 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abcc487-f61c-4bb9-aa14-063529514552 None admin] REQUEST_METHOD: `GET` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:55:40.748909 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abcc487-f61c-4bb9-aa14-063529514552 None admin] SCRIPT_NAME: `/identity` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:55:40.749379 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abcc487-f61c-4bb9-aa14-063529514552 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:55:40.769568 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7abcc487-f61c-4bb9-aa14-063529514552 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 08:55:40.780191 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application [None req-7abcc487-f61c-4bb9-aa14-063529514552 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 08:55:40.780191 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:55:40.780191 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:55:40.780191 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:55:40.780191 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:55:40.780191 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:55:40.780191 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:55:40.780191 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:55:40.780191 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:55:40.780191 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:55:40.780191 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:55:40.780191 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:55:40.780191 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 08:55:40.780191 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 08:55:40.780191 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 08:55:40.780191 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 08:55:40.781669 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 08:55:40.781669 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 08:55:40.781669 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 08:55:40.781669 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 08:55:40.781669 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:55:40.781669 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:55:40.781669 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:55:40.781669 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:55:40.781669 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:55:40.781669 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:55:40.781669 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:55:40.781669 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application with Lock( Jul 28 08:55:40.781669 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:55:40.781669 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:55:40.781669 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:55:40.781669 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:55:40.782863 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:55:40.782863 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:55:40.782863 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:55:40.782863 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:55:40.782863 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 08:55:40.782863 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 08:55:40.782863 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 08:55:40.782863 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 08:55:40.782863 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 08:55:40.782863 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 08:55:40.782863 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 08:55:40.782863 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application Jul 28 08:55:40.782863 dv-cinder-851351-1-smb devstack@keystone.service[352329]: [pid: 352329|app: 0|req: 584/1188] 10.222.0.42 () {56 vars in 1096 bytes} [Thu Jul 28 08:55:40 2022] GET /identity/v3/roles/admin => generated 83 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:55:40.789933 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de92e972-cfa6-4bec-a3a9-3fe9c39f5183 None None] Authenticating user token {{(pid=352328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:55:40.903605 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de92e972-cfa6-4bec-a3a9-3fe9c39f5183 None None] Validating token access rules against request {{(pid=352328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:55:40.922186 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG dbcounter [-] [352328] Writing DB stats keystone:SELECT=100 {{(pid=352328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:55:40.943514 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77498d1b-4be1-4059-8b14-e6a3540cffca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:55:40.944036 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77498d1b-4be1-4059-8b14-e6a3540cffca None admin] REQUEST_METHOD: `GET` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:55:40.944321 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77498d1b-4be1-4059-8b14-e6a3540cffca None admin] SCRIPT_NAME: `/identity` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:55:40.944595 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77498d1b-4be1-4059-8b14-e6a3540cffca None admin] PATH_INFO: `/v3/roles` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:55:40.945380 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77498d1b-4be1-4059-8b14-e6a3540cffca None admin] RBAC: Adding query filter params (name=admin) {{(pid=352328) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:55:40.945686 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77498d1b-4be1-4059-8b14-e6a3540cffca None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:55:40.947079 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77498d1b-4be1-4059-8b14-e6a3540cffca None admin] RBAC: Authorization granted {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:55:40.957063 dv-cinder-851351-1-smb devstack@keystone.service[352328]: [pid: 352328|app: 0|req: 605/1189] 10.222.0.42 () {56 vars in 1099 bytes} [Thu Jul 28 08:55:40 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:55:40.963447 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7abcc487-f61c-4bb9-aa14-063529514552 None admin] Authenticating user token {{(pid=352329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:55:41.027929 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG dbcounter [-] [352329] Writing DB stats keystone:SELECT=100 {{(pid=352329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:55:41.094522 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7abcc487-f61c-4bb9-aa14-063529514552 None admin] Validating token access rules against request {{(pid=352329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:55:41.133700 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae178110-3b1b-46c4-8f61-0544c279dc7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:55:41.134365 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae178110-3b1b-46c4-8f61-0544c279dc7e None admin] REQUEST_METHOD: `GET` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:55:41.134650 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae178110-3b1b-46c4-8f61-0544c279dc7e None admin] SCRIPT_NAME: `/identity` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:55:41.134923 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae178110-3b1b-46c4-8f61-0544c279dc7e None admin] PATH_INFO: `/v3/users/ad153fd8edb44d7c99b289be36ff0a21` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:55:41.136183 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae178110-3b1b-46c4-8f61-0544c279dc7e None admin] RBAC: Authorizing `identity:get_user(user_id=ad153fd8edb44d7c99b289be36ff0a21)` {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:55:41.137841 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae178110-3b1b-46c4-8f61-0544c279dc7e None admin] RBAC: Authorization granted {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:55:41.139564 dv-cinder-851351-1-smb devstack@keystone.service[352329]: [pid: 352329|app: 0|req: 585/1190] 10.222.0.42 () {56 vars in 1177 bytes} [Thu Jul 28 08:55:40 2022] GET /identity/v3/users/ad153fd8edb44d7c99b289be36ff0a21 => generated 311 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:55:41.146084 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77498d1b-4be1-4059-8b14-e6a3540cffca None admin] Authenticating user token {{(pid=352328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:55:41.262645 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77498d1b-4be1-4059-8b14-e6a3540cffca None admin] Validating token access rules against request {{(pid=352328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:55:41.300985 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada00062-3937-4ab3-9908-1e12310631a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:55:41.301720 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada00062-3937-4ab3-9908-1e12310631a4 None admin] REQUEST_METHOD: `GET` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:55:41.302048 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada00062-3937-4ab3-9908-1e12310631a4 None admin] SCRIPT_NAME: `/identity` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:55:41.302357 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada00062-3937-4ab3-9908-1e12310631a4 None admin] PATH_INFO: `/v3/projects/dc71fcccde9e445db2c312b2481c8ac2` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:55:41.303729 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada00062-3937-4ab3-9908-1e12310631a4 None admin] RBAC: Authorizing `identity:get_project(project_id=dc71fcccde9e445db2c312b2481c8ac2)` {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:55:41.305287 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada00062-3937-4ab3-9908-1e12310631a4 None admin] RBAC: Authorization granted {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:55:41.307075 dv-cinder-851351-1-smb devstack@keystone.service[352328]: [pid: 352328|app: 0|req: 606/1191] 10.222.0.42 () {56 vars in 1186 bytes} [Thu Jul 28 08:55:41 2022] GET /identity/v3/projects/dc71fcccde9e445db2c312b2481c8ac2 => generated 361 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:55:41.313884 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae178110-3b1b-46c4-8f61-0544c279dc7e None admin] Authenticating user token {{(pid=352329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:55:41.436276 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae178110-3b1b-46c4-8f61-0544c279dc7e None admin] Validating token access rules against request {{(pid=352329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:55:41.452534 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG dbcounter [-] [352329] Writing DB stats keystone:SELECT=100 {{(pid=352329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:55:41.475656 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd8b093-413b-4b91-aeb2-14036b75c5a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:55:41.476416 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd8b093-413b-4b91-aeb2-14036b75c5a5 None admin] REQUEST_METHOD: `PUT` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:55:41.476785 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd8b093-413b-4b91-aeb2-14036b75c5a5 None admin] SCRIPT_NAME: `/identity` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:55:41.477130 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd8b093-413b-4b91-aeb2-14036b75c5a5 None admin] PATH_INFO: `/v3/projects/dc71fcccde9e445db2c312b2481c8ac2/users/ad153fd8edb44d7c99b289be36ff0a21/roles/280023171b4a45efb67c036ff237bb3c` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:55:41.479305 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bd8b093-413b-4b91-aeb2-14036b75c5a5 None admin] RBAC: Authorizing `identity:create_grant(project_id=dc71fcccde9e445db2c312b2481c8ac2, user_id=ad153fd8edb44d7c99b289be36ff0a21, role_id=280023171b4a45efb67c036ff237bb3c)` {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:55:41.480837 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bd8b093-413b-4b91-aeb2-14036b75c5a5 None admin] RBAC: Authorization granted {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:55:41.496728 dv-cinder-851351-1-smb devstack@keystone.service[352329]: [pid: 352329|app: 0|req: 586/1192] 10.222.0.42 () {58 vars in 1439 bytes} [Thu Jul 28 08:55:41 2022] PUT /identity/v3/projects/dc71fcccde9e445db2c312b2481c8ac2/users/ad153fd8edb44d7c99b289be36ff0a21/roles/280023171b4a45efb67c036ff237bb3c => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 08:55:43.659825 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59cf988-34ca-4a9d-9e9a-a4279fe4f9e8 None None] REQUEST_METHOD: `GET` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:55:43.660438 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59cf988-34ca-4a9d-9e9a-a4279fe4f9e8 None None] SCRIPT_NAME: `/identity` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:55:43.660438 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59cf988-34ca-4a9d-9e9a-a4279fe4f9e8 None None] PATH_INFO: `/` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:55:43.661807 dv-cinder-851351-1-smb devstack@keystone.service[352328]: [pid: 352328|app: 0|req: 607/1193] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 08:55:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 08:55:43.668024 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b5b1a9-78eb-40f1-b0f2-5cf0d32bdf43 None None] REQUEST_METHOD: `POST` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:55:43.668629 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b5b1a9-78eb-40f1-b0f2-5cf0d32bdf43 None None] SCRIPT_NAME: `/identity` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:55:43.668629 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b5b1a9-78eb-40f1-b0f2-5cf0d32bdf43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:55:43.689467 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.auth.core [None req-e3b5b1a9-78eb-40f1-b0f2-5cf0d32bdf43 None None] MFA Rules not processed for user `d18c063b2377412485965357671e5506`. Rule list: `[]` (Enabled: `True`). {{(pid=352329) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 08:55:43.690754 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.fernet_utils [None req-e3b5b1a9-78eb-40f1-b0f2-5cf0d32bdf43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=352329) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:55:43.775337 dv-cinder-851351-1-smb devstack@keystone.service[352329]: [pid: 352329|app: 0|req: 587/1194] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 08:55:43 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 08:55:43.800372 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a59cf988-34ca-4a9d-9e9a-a4279fe4f9e8 None None] Authenticating user token {{(pid=352328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:55:43.863816 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG dbcounter [-] [352328] Writing DB stats keystone:SELECT=100 {{(pid=352328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:55:43.930285 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a59cf988-34ca-4a9d-9e9a-a4279fe4f9e8 None None] Validating token access rules against request {{(pid=352328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:55:43.969370 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fefe003b-c943-4bf7-be65-364667e8e4ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:55:43.970111 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fefe003b-c943-4bf7-be65-364667e8e4ac None admin] REQUEST_METHOD: `GET` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:55:43.970436 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fefe003b-c943-4bf7-be65-364667e8e4ac None admin] SCRIPT_NAME: `/identity` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:55:43.970752 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fefe003b-c943-4bf7-be65-364667e8e4ac None admin] PATH_INFO: `/v3/roles/admin` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:55:43.984221 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fefe003b-c943-4bf7-be65-364667e8e4ac None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 08:55:43.989291 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application [None req-fefe003b-c943-4bf7-be65-364667e8e4ac None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 08:55:43.989291 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:55:43.989291 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:55:43.989291 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:55:43.989291 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:55:43.989291 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:55:43.989291 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:55:43.989291 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:55:43.989291 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:55:43.989291 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:55:43.989291 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:55:43.989291 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:55:43.989291 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 08:55:43.989291 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 08:55:43.989291 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 08:55:43.989291 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 08:55:43.991349 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 08:55:43.991349 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 08:55:43.991349 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 08:55:43.991349 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 08:55:43.991349 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:55:43.991349 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:55:43.991349 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:55:43.991349 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:55:43.991349 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:55:43.991349 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:55:43.991349 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:55:43.991349 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application with Lock( Jul 28 08:55:43.991349 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:55:43.991349 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:55:43.991349 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:55:43.991349 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:55:43.993317 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:55:43.993317 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:55:43.993317 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:55:43.993317 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:55:43.993317 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 08:55:43.993317 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 08:55:43.993317 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 08:55:43.993317 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 08:55:43.993317 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 08:55:43.993317 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 08:55:43.993317 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 08:55:43.993317 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application Jul 28 08:55:43.993317 dv-cinder-851351-1-smb devstack@keystone.service[352328]: [pid: 352328|app: 0|req: 608/1195] 10.222.0.42 () {56 vars in 1096 bytes} [Thu Jul 28 08:55:43 2022] GET /identity/v3/roles/admin => generated 83 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:55:43.997216 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b5b1a9-78eb-40f1-b0f2-5cf0d32bdf43 None None] Authenticating user token {{(pid=352329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:55:44.113066 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b5b1a9-78eb-40f1-b0f2-5cf0d32bdf43 None None] Validating token access rules against request {{(pid=352329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:55:44.116010 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG dbcounter [-] [352329] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=352329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:55:44.154253 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e871859-b1c0-45e1-8bc8-6ed6fec4f0e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:55:44.154976 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e871859-b1c0-45e1-8bc8-6ed6fec4f0e9 None admin] REQUEST_METHOD: `GET` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:55:44.155264 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e871859-b1c0-45e1-8bc8-6ed6fec4f0e9 None admin] SCRIPT_NAME: `/identity` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:55:44.155523 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e871859-b1c0-45e1-8bc8-6ed6fec4f0e9 None admin] PATH_INFO: `/v3/roles` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:55:44.156275 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e871859-b1c0-45e1-8bc8-6ed6fec4f0e9 None admin] RBAC: Adding query filter params (name=admin) {{(pid=352329) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:55:44.156583 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e871859-b1c0-45e1-8bc8-6ed6fec4f0e9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:55:44.158052 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e871859-b1c0-45e1-8bc8-6ed6fec4f0e9 None admin] RBAC: Authorization granted {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:55:44.167710 dv-cinder-851351-1-smb devstack@keystone.service[352329]: [pid: 352329|app: 0|req: 588/1196] 10.222.0.42 () {56 vars in 1099 bytes} [Thu Jul 28 08:55:43 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:55:44.174334 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fefe003b-c943-4bf7-be65-364667e8e4ac None admin] Authenticating user token {{(pid=352328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:55:44.290251 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fefe003b-c943-4bf7-be65-364667e8e4ac None admin] Validating token access rules against request {{(pid=352328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:55:44.298395 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG dbcounter [-] [352328] Writing DB stats keystone:SELECT=100 {{(pid=352328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:55:44.335355 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e90129-1fdf-4046-9e50-c7eb6f9e2cd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:55:44.336035 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e90129-1fdf-4046-9e50-c7eb6f9e2cd1 None admin] REQUEST_METHOD: `GET` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:55:44.336320 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e90129-1fdf-4046-9e50-c7eb6f9e2cd1 None admin] SCRIPT_NAME: `/identity` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:55:44.336598 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e90129-1fdf-4046-9e50-c7eb6f9e2cd1 None admin] PATH_INFO: `/v3/users/ad153fd8edb44d7c99b289be36ff0a21` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:55:44.337990 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1e90129-1fdf-4046-9e50-c7eb6f9e2cd1 None admin] RBAC: Authorizing `identity:get_user(user_id=ad153fd8edb44d7c99b289be36ff0a21)` {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:55:44.339473 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1e90129-1fdf-4046-9e50-c7eb6f9e2cd1 None admin] RBAC: Authorization granted {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:55:44.341278 dv-cinder-851351-1-smb devstack@keystone.service[352328]: [pid: 352328|app: 0|req: 609/1197] 10.222.0.42 () {56 vars in 1177 bytes} [Thu Jul 28 08:55:44 2022] GET /identity/v3/users/ad153fd8edb44d7c99b289be36ff0a21 => generated 311 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:55:44.350704 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e871859-b1c0-45e1-8bc8-6ed6fec4f0e9 None admin] Authenticating user token {{(pid=352329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:55:44.468805 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e871859-b1c0-45e1-8bc8-6ed6fec4f0e9 None admin] Validating token access rules against request {{(pid=352329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:55:44.514385 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13244f6d-06d4-4c5b-b6b1-bd8e61e906c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:55:44.515471 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13244f6d-06d4-4c5b-b6b1-bd8e61e906c4 None admin] REQUEST_METHOD: `GET` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:55:44.515950 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13244f6d-06d4-4c5b-b6b1-bd8e61e906c4 None admin] SCRIPT_NAME: `/identity` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:55:44.516419 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13244f6d-06d4-4c5b-b6b1-bd8e61e906c4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:55:44.580041 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG dbcounter [-] [352329] Writing DB stats keystone:SELECT=100 {{(pid=352329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:55:44.621875 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13244f6d-06d4-4c5b-b6b1-bd8e61e906c4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:55:44.623646 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13244f6d-06d4-4c5b-b6b1-bd8e61e906c4 None admin] RBAC: Authorization granted {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:55:44.732737 dv-cinder-851351-1-smb devstack@keystone.service[352329]: [pid: 352329|app: 0|req: 589/1198] 10.222.0.42 () {58 vars in 1282 bytes} [Thu Jul 28 08:55:44 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 383 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 28 08:55:44.739617 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e90129-1fdf-4046-9e50-c7eb6f9e2cd1 None admin] Authenticating user token {{(pid=352328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:55:44.852642 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e90129-1fdf-4046-9e50-c7eb6f9e2cd1 None admin] Validating token access rules against request {{(pid=352328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:55:44.892486 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a908bd5e-9c09-42a8-8d09-1732ea0de0a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:55:44.893240 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a908bd5e-9c09-42a8-8d09-1732ea0de0a1 None admin] REQUEST_METHOD: `GET` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:55:44.893564 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a908bd5e-9c09-42a8-8d09-1732ea0de0a1 None admin] SCRIPT_NAME: `/identity` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:55:44.893878 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a908bd5e-9c09-42a8-8d09-1732ea0de0a1 None admin] PATH_INFO: `/v3/projects/dc71fcccde9e445db2c312b2481c8ac2` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:55:44.895134 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a908bd5e-9c09-42a8-8d09-1732ea0de0a1 None admin] RBAC: Authorizing `identity:get_project(project_id=dc71fcccde9e445db2c312b2481c8ac2)` {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:55:44.896637 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a908bd5e-9c09-42a8-8d09-1732ea0de0a1 None admin] RBAC: Authorization granted {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:55:44.898442 dv-cinder-851351-1-smb devstack@keystone.service[352328]: [pid: 352328|app: 0|req: 610/1199] 10.222.0.42 () {56 vars in 1186 bytes} [Thu Jul 28 08:55:44 2022] GET /identity/v3/projects/dc71fcccde9e445db2c312b2481c8ac2 => generated 361 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:55:44.905168 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13244f6d-06d4-4c5b-b6b1-bd8e61e906c4 None admin] Authenticating user token {{(pid=352329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:55:44.980223 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG dbcounter [-] [352329] Writing DB stats keystone:SELECT=100 {{(pid=352329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:55:45.018893 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13244f6d-06d4-4c5b-b6b1-bd8e61e906c4 None admin] Validating token access rules against request {{(pid=352329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:55:45.055940 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a76146-0a5a-4d1a-815b-9106014b1962 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:55:45.056636 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a76146-0a5a-4d1a-815b-9106014b1962 None admin] REQUEST_METHOD: `GET` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:55:45.057008 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a76146-0a5a-4d1a-815b-9106014b1962 None admin] SCRIPT_NAME: `/identity` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:55:45.057333 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a76146-0a5a-4d1a-815b-9106014b1962 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:55:45.058209 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8a76146-0a5a-4d1a-815b-9106014b1962 None admin] RBAC: Adding query filter params (role.id=280023171b4a45efb67c036ff237bb3c, scope.project.id=dc71fcccde9e445db2c312b2481c8ac2, user.id=ad153fd8edb44d7c99b289be36ff0a21) {{(pid=352329) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:55:45.058563 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8a76146-0a5a-4d1a-815b-9106014b1962 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:55:45.060080 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8a76146-0a5a-4d1a-815b-9106014b1962 None admin] RBAC: Authorization granted {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:55:45.066644 dv-cinder-851351-1-smb devstack@keystone.service[352329]: [pid: 352329|app: 0|req: 590/1200] 10.222.0.42 () {56 vars in 1374 bytes} [Thu Jul 28 08:55:44 2022] GET /identity/v3/role_assignments?user.id=ad153fd8edb44d7c99b289be36ff0a21&scope.project.id=dc71fcccde9e445db2c312b2481c8ac2&role.id=280023171b4a45efb67c036ff237bb3c => generated 608 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:55:54.887586 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG dbcounter [-] [352328] Writing DB stats keystone:SELECT=79 {{(pid=352328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:55:55.063793 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG dbcounter [-] [352329] Writing DB stats keystone:SELECT=35 {{(pid=352329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:56:43.352002 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f676c2-7566-449b-b67a-5d95da593290 None None] REQUEST_METHOD: `GET` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:56:43.352705 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f676c2-7566-449b-b67a-5d95da593290 None None] SCRIPT_NAME: `/identity` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:56:43.353017 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f676c2-7566-449b-b67a-5d95da593290 None None] PATH_INFO: `/` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:56:43.356028 dv-cinder-851351-1-smb devstack@keystone.service[352328]: [pid: 352328|app: 0|req: 611/1201] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 08:56:43 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 08:56:43.362410 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d77d7f3-51ea-4b6b-af1d-c033cc4846db None None] REQUEST_METHOD: `POST` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:56:43.363335 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d77d7f3-51ea-4b6b-af1d-c033cc4846db None None] SCRIPT_NAME: `/identity` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:56:43.363335 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d77d7f3-51ea-4b6b-af1d-c033cc4846db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:56:43.384205 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.auth.core [None req-0d77d7f3-51ea-4b6b-af1d-c033cc4846db None None] MFA Rules not processed for user `d18c063b2377412485965357671e5506`. Rule list: `[]` (Enabled: `True`). {{(pid=352329) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 08:56:43.385519 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.fernet_utils [None req-0d77d7f3-51ea-4b6b-af1d-c033cc4846db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=352329) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:56:43.473682 dv-cinder-851351-1-smb devstack@keystone.service[352329]: [pid: 352329|app: 0|req: 591/1202] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 08:56:43 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 28 08:56:43.498102 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f676c2-7566-449b-b67a-5d95da593290 None None] Authenticating user token {{(pid=352328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:56:43.668173 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f676c2-7566-449b-b67a-5d95da593290 None None] Validating token access rules against request {{(pid=352328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:56:43.743338 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef9923d-15bb-4454-9d34-9f59e07b9ba0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:56:43.744266 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef9923d-15bb-4454-9d34-9f59e07b9ba0 None admin] REQUEST_METHOD: `GET` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:56:43.744677 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef9923d-15bb-4454-9d34-9f59e07b9ba0 None admin] SCRIPT_NAME: `/identity` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:56:43.745094 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef9923d-15bb-4454-9d34-9f59e07b9ba0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:56:43.764033 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bef9923d-15bb-4454-9d34-9f59e07b9ba0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:56:43.766778 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bef9923d-15bb-4454-9d34-9f59e07b9ba0 None admin] RBAC: Authorization granted {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:56:43.794749 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application [None req-bef9923d-15bb-4454-9d34-9f59e07b9ba0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 08:56:43.794749 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:56:43.794749 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:56:43.794749 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:56:43.794749 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:56:43.794749 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:56:43.794749 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:56:43.794749 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:56:43.794749 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:56:43.794749 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:56:43.794749 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:56:43.794749 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:56:43.794749 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 08:56:43.794749 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 08:56:43.794749 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 08:56:43.796064 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 08:56:43.796064 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:56:43.796064 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:56:43.796064 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:56:43.796064 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:56:43.796064 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:56:43.796064 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:56:43.796064 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:56:43.796064 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application with Lock( Jul 28 08:56:43.796064 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:56:43.796064 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:56:43.796064 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:56:43.796064 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:56:43.796064 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:56:43.796064 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:56:43.796064 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:56:43.796064 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:56:43.797349 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 08:56:43.797349 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 08:56:43.797349 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 08:56:43.797349 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application Jul 28 08:56:43.797349 dv-cinder-851351-1-smb devstack@keystone.service[352328]: [pid: 352328|app: 0|req: 612/1203] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 08:56:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 300 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 08:56:43.803383 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d77d7f3-51ea-4b6b-af1d-c033cc4846db None None] Authenticating user token {{(pid=352329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:56:43.920607 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d77d7f3-51ea-4b6b-af1d-c033cc4846db None None] Validating token access rules against request {{(pid=352329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:56:43.958497 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG dbcounter [-] [352329] Writing DB stats keystone:SELECT=100 {{(pid=352329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:56:43.967514 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da3413f0-6161-47b8-a867-1ca164c806f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:56:43.968181 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3413f0-6161-47b8-a867-1ca164c806f1 None admin] REQUEST_METHOD: `GET` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:56:43.968467 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3413f0-6161-47b8-a867-1ca164c806f1 None admin] SCRIPT_NAME: `/identity` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:56:43.968803 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3413f0-6161-47b8-a867-1ca164c806f1 None admin] PATH_INFO: `/v3/domains` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:56:43.969527 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da3413f0-6161-47b8-a867-1ca164c806f1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=352329) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:56:43.969834 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da3413f0-6161-47b8-a867-1ca164c806f1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:56:43.971329 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da3413f0-6161-47b8-a867-1ca164c806f1 None admin] RBAC: Authorization granted {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:56:43.986427 dv-cinder-851351-1-smb devstack@keystone.service[352329]: [pid: 352329|app: 0|req: 592/1204] 10.222.0.42 () {56 vars in 1109 bytes} [Thu Jul 28 08:56:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 08:56:43.992711 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef9923d-15bb-4454-9d34-9f59e07b9ba0 None admin] Authenticating user token {{(pid=352328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:56:44.086189 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG dbcounter [-] [352328] Writing DB stats keystone:SELECT=100 {{(pid=352328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:56:44.175443 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef9923d-15bb-4454-9d34-9f59e07b9ba0 None admin] Validating token access rules against request {{(pid=352328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:56:44.226167 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c912c9b-a3de-4e10-87ba-a9f8204d00d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:56:44.226806 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c912c9b-a3de-4e10-87ba-a9f8204d00d9 None admin] REQUEST_METHOD: `POST` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:56:44.227100 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c912c9b-a3de-4e10-87ba-a9f8204d00d9 None admin] SCRIPT_NAME: `/identity` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:56:44.227360 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c912c9b-a3de-4e10-87ba-a9f8204d00d9 None admin] PATH_INFO: `/v3/users` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:56:44.228059 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c912c9b-a3de-4e10-87ba-a9f8204d00d9 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:56:44.229555 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c912c9b-a3de-4e10-87ba-a9f8204d00d9 None admin] RBAC: Authorization granted {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:56:44.254907 dv-cinder-851351-1-smb devstack@keystone.service[352328]: [pid: 352328|app: 0|req: 613/1205] 10.222.0.42 () {60 vars in 1132 bytes} [Thu Jul 28 08:56:43 2022] POST /identity/v3/users => generated 251 bytes in 263 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 08:56:46.696713 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4740ec-a910-4de9-9f65-718a99a9ce73 None None] REQUEST_METHOD: `GET` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:56:46.700285 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4740ec-a910-4de9-9f65-718a99a9ce73 None None] SCRIPT_NAME: `/identity` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:56:46.700285 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4740ec-a910-4de9-9f65-718a99a9ce73 None None] PATH_INFO: `/` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:56:46.700285 dv-cinder-851351-1-smb devstack@keystone.service[352329]: [pid: 352329|app: 0|req: 593/1206] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 08:56:46 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 08:56:46.710232 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad222fe-71fe-4076-98f7-44bcfa342d32 None None] REQUEST_METHOD: `POST` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:56:46.711605 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad222fe-71fe-4076-98f7-44bcfa342d32 None None] SCRIPT_NAME: `/identity` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:56:46.712305 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad222fe-71fe-4076-98f7-44bcfa342d32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:56:46.740764 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.auth.core [None req-7ad222fe-71fe-4076-98f7-44bcfa342d32 None None] MFA Rules not processed for user `d18c063b2377412485965357671e5506`. Rule list: `[]` (Enabled: `True`). {{(pid=352328) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 08:56:46.742635 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.fernet_utils [None req-7ad222fe-71fe-4076-98f7-44bcfa342d32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=352328) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:56:46.863251 dv-cinder-851351-1-smb devstack@keystone.service[352328]: [pid: 352328|app: 0|req: 614/1207] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 08:56:46 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 08:56:46.891296 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4740ec-a910-4de9-9f65-718a99a9ce73 None None] Authenticating user token {{(pid=352329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:56:47.052435 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4740ec-a910-4de9-9f65-718a99a9ce73 None None] Validating token access rules against request {{(pid=352329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:56:47.113552 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b240762a-1347-4f00-bb77-78b22d6ce660 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:56:47.114626 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b240762a-1347-4f00-bb77-78b22d6ce660 None admin] REQUEST_METHOD: `GET` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:56:47.115092 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b240762a-1347-4f00-bb77-78b22d6ce660 None admin] SCRIPT_NAME: `/identity` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:56:47.115585 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b240762a-1347-4f00-bb77-78b22d6ce660 None admin] PATH_INFO: `/v3/roles/service` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:56:47.136648 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b240762a-1347-4f00-bb77-78b22d6ce660 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 08:56:47.144620 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application [None req-b240762a-1347-4f00-bb77-78b22d6ce660 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 28 08:56:47.144620 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:56:47.144620 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:56:47.144620 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:56:47.144620 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:56:47.144620 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:56:47.144620 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:56:47.144620 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:56:47.144620 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:56:47.144620 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:56:47.144620 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:56:47.144620 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:56:47.144620 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 08:56:47.144620 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 08:56:47.144620 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 08:56:47.144620 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 08:56:47.147239 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 08:56:47.147239 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 08:56:47.147239 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 08:56:47.147239 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 08:56:47.147239 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:56:47.147239 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:56:47.147239 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:56:47.147239 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:56:47.147239 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:56:47.147239 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:56:47.147239 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:56:47.147239 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application with Lock( Jul 28 08:56:47.147239 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:56:47.147239 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:56:47.147239 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:56:47.147239 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:56:47.149371 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:56:47.149371 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:56:47.149371 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:56:47.149371 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:56:47.149371 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 08:56:47.149371 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 08:56:47.149371 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 08:56:47.149371 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 08:56:47.149371 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 08:56:47.149371 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 08:56:47.149371 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 28 08:56:47.149371 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application Jul 28 08:56:47.149371 dv-cinder-851351-1-smb devstack@keystone.service[352329]: [pid: 352329|app: 0|req: 594/1208] 10.222.0.42 () {56 vars in 1102 bytes} [Thu Jul 28 08:56:46 2022] GET /identity/v3/roles/service => generated 85 bytes in 256 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:56:47.155738 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad222fe-71fe-4076-98f7-44bcfa342d32 None None] Authenticating user token {{(pid=352328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:56:47.238351 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG dbcounter [-] [352328] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=352328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:56:47.335851 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad222fe-71fe-4076-98f7-44bcfa342d32 None None] Validating token access rules against request {{(pid=352328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:56:47.380543 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b467bf-bb9c-473b-b911-92d35e4b7591 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:56:47.381253 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b467bf-bb9c-473b-b911-92d35e4b7591 None admin] REQUEST_METHOD: `GET` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:56:47.381616 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b467bf-bb9c-473b-b911-92d35e4b7591 None admin] SCRIPT_NAME: `/identity` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:56:47.381821 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b467bf-bb9c-473b-b911-92d35e4b7591 None admin] PATH_INFO: `/v3/roles` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:56:47.382601 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8b467bf-bb9c-473b-b911-92d35e4b7591 None admin] RBAC: Adding query filter params (name=service) {{(pid=352328) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:56:47.382922 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8b467bf-bb9c-473b-b911-92d35e4b7591 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:56:47.384370 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8b467bf-bb9c-473b-b911-92d35e4b7591 None admin] RBAC: Authorization granted {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:56:47.400758 dv-cinder-851351-1-smb devstack@keystone.service[352328]: [pid: 352328|app: 0|req: 615/1209] 10.222.0.42 () {56 vars in 1103 bytes} [Thu Jul 28 08:56:47 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:56:47.407931 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b240762a-1347-4f00-bb77-78b22d6ce660 None admin] Authenticating user token {{(pid=352329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:56:47.490703 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG dbcounter [-] [352329] Writing DB stats keystone:SELECT=100 {{(pid=352329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:56:47.575490 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b240762a-1347-4f00-bb77-78b22d6ce660 None admin] Validating token access rules against request {{(pid=352329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:56:47.644164 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14364ce5-1264-423a-b197-e616a7029e1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:56:47.645324 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14364ce5-1264-423a-b197-e616a7029e1a None admin] REQUEST_METHOD: `GET` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:56:47.648773 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14364ce5-1264-423a-b197-e616a7029e1a None admin] SCRIPT_NAME: `/identity` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:56:47.649271 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14364ce5-1264-423a-b197-e616a7029e1a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:56:47.674908 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14364ce5-1264-423a-b197-e616a7029e1a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:56:47.677851 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14364ce5-1264-423a-b197-e616a7029e1a None admin] RBAC: Authorization granted {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:56:47.708270 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application [None req-14364ce5-1264-423a-b197-e616a7029e1a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 08:56:47.708270 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:56:47.708270 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:56:47.708270 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:56:47.708270 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:56:47.708270 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:56:47.708270 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:56:47.708270 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:56:47.708270 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:56:47.708270 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:56:47.708270 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:56:47.708270 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:56:47.708270 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 08:56:47.708270 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 08:56:47.708270 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 08:56:47.711606 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 08:56:47.711606 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:56:47.711606 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:56:47.711606 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:56:47.711606 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:56:47.711606 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:56:47.711606 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:56:47.711606 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:56:47.711606 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application with Lock( Jul 28 08:56:47.711606 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:56:47.711606 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:56:47.711606 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:56:47.711606 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:56:47.711606 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:56:47.711606 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:56:47.711606 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:56:47.711606 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:56:47.714054 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 08:56:47.714054 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 08:56:47.714054 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 08:56:47.714054 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application Jul 28 08:56:47.720641 dv-cinder-851351-1-smb devstack@keystone.service[352329]: [pid: 352329|app: 0|req: 595/1210] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 08:56:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 308 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:56:47.723182 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b467bf-bb9c-473b-b911-92d35e4b7591 None admin] Authenticating user token {{(pid=352328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:56:47.897056 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG dbcounter [-] [352328] Writing DB stats keystone:SELECT=100 {{(pid=352328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:56:47.901168 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b467bf-bb9c-473b-b911-92d35e4b7591 None admin] Validating token access rules against request {{(pid=352328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:56:47.961984 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-859ce9fc-5ace-47ad-b527-1eb44fb64b8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:56:47.963411 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859ce9fc-5ace-47ad-b527-1eb44fb64b8c None admin] REQUEST_METHOD: `GET` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:56:47.963857 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859ce9fc-5ace-47ad-b527-1eb44fb64b8c None admin] SCRIPT_NAME: `/identity` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:56:47.964302 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859ce9fc-5ace-47ad-b527-1eb44fb64b8c None admin] PATH_INFO: `/v3/domains` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:56:47.965537 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-859ce9fc-5ace-47ad-b527-1eb44fb64b8c None admin] RBAC: Adding query filter params (name=Default) {{(pid=352328) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:56:47.966153 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-859ce9fc-5ace-47ad-b527-1eb44fb64b8c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:56:47.968289 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-859ce9fc-5ace-47ad-b527-1eb44fb64b8c None admin] RBAC: Authorization granted {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:56:47.990850 dv-cinder-851351-1-smb devstack@keystone.service[352328]: [pid: 352328|app: 0|req: 616/1211] 10.222.0.42 () {56 vars in 1109 bytes} [Thu Jul 28 08:56:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 08:56:47.997897 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14364ce5-1264-423a-b197-e616a7029e1a None admin] Authenticating user token {{(pid=352329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:56:48.161794 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14364ce5-1264-423a-b197-e616a7029e1a None admin] Validating token access rules against request {{(pid=352329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:56:48.164869 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG dbcounter [-] [352329] Writing DB stats keystone:SELECT=100 {{(pid=352329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:56:48.220889 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ddaafa-4688-4ff0-a226-c40d74ca8e2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:56:48.222009 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ddaafa-4688-4ff0-a226-c40d74ca8e2e None admin] REQUEST_METHOD: `GET` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:56:48.222496 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ddaafa-4688-4ff0-a226-c40d74ca8e2e None admin] SCRIPT_NAME: `/identity` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:56:48.222929 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ddaafa-4688-4ff0-a226-c40d74ca8e2e None admin] PATH_INFO: `/v3/users/placement` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:56:48.239167 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2ddaafa-4688-4ff0-a226-c40d74ca8e2e None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:56:48.241643 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2ddaafa-4688-4ff0-a226-c40d74ca8e2e None admin] RBAC: Authorization granted {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:56:48.261196 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application [None req-e2ddaafa-4688-4ff0-a226-c40d74ca8e2e None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 28 08:56:48.261196 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:56:48.261196 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:56:48.261196 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:56:48.261196 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:56:48.261196 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:56:48.261196 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:56:48.261196 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:56:48.261196 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:56:48.261196 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:56:48.261196 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:56:48.261196 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:56:48.261196 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 28 08:56:48.261196 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 28 08:56:48.261196 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 28 08:56:48.261196 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 28 08:56:48.262782 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:56:48.262782 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:56:48.262782 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 28 08:56:48.262782 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 08:56:48.262782 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 28 08:56:48.262782 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 08:56:48.262782 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:56:48.262782 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:56:48.262782 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:56:48.262782 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:56:48.262782 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:56:48.262782 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application with Lock( Jul 28 08:56:48.262782 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:56:48.262782 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:56:48.262782 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:56:48.262782 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:56:48.262782 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:56:48.262782 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:56:48.263991 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:56:48.263991 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:56:48.263991 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 28 08:56:48.263991 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 28 08:56:48.263991 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 28 08:56:48.263991 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 28 08:56:48.263991 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 28 08:56:48.263991 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 28 08:56:48.263991 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 28 08:56:48.263991 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application Jul 28 08:56:48.263991 dv-cinder-851351-1-smb devstack@keystone.service[352329]: [pid: 352329|app: 0|req: 596/1212] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 08:56:47 2022] GET /identity/v3/users/placement => generated 87 bytes in 266 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:56:48.270294 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-859ce9fc-5ace-47ad-b527-1eb44fb64b8c None admin] Authenticating user token {{(pid=352328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:56:48.425776 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-859ce9fc-5ace-47ad-b527-1eb44fb64b8c None admin] Validating token access rules against request {{(pid=352328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:56:48.477249 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9881ffc4-4cd3-4ffa-8aaa-c86d7e9a3c69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:56:48.478113 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9881ffc4-4cd3-4ffa-8aaa-c86d7e9a3c69 None admin] REQUEST_METHOD: `GET` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:56:48.478491 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9881ffc4-4cd3-4ffa-8aaa-c86d7e9a3c69 None admin] SCRIPT_NAME: `/identity` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:56:48.478862 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9881ffc4-4cd3-4ffa-8aaa-c86d7e9a3c69 None admin] PATH_INFO: `/v3/users` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:56:48.479895 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9881ffc4-4cd3-4ffa-8aaa-c86d7e9a3c69 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=352328) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:56:48.480326 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9881ffc4-4cd3-4ffa-8aaa-c86d7e9a3c69 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:56:48.482091 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9881ffc4-4cd3-4ffa-8aaa-c86d7e9a3c69 None admin] RBAC: Authorization granted {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:56:48.508243 dv-cinder-851351-1-smb devstack@keystone.service[352328]: [pid: 352328|app: 0|req: 617/1213] 10.222.0.42 () {56 vars in 1143 bytes} [Thu Jul 28 08:56:48 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:56:48.517019 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ddaafa-4688-4ff0-a226-c40d74ca8e2e None admin] Authenticating user token {{(pid=352329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:56:48.659483 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ddaafa-4688-4ff0-a226-c40d74ca8e2e None admin] Validating token access rules against request {{(pid=352329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:56:48.729715 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d30caed2-4d8e-4846-994d-f9b56daf15c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:56:48.730397 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30caed2-4d8e-4846-994d-f9b56daf15c8 None admin] REQUEST_METHOD: `GET` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:56:48.730541 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30caed2-4d8e-4846-994d-f9b56daf15c8 None admin] SCRIPT_NAME: `/identity` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:56:48.730812 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30caed2-4d8e-4846-994d-f9b56daf15c8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:56:48.768934 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG dbcounter [-] [352329] Writing DB stats keystone:SELECT=100 {{(pid=352329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:56:48.820344 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d30caed2-4d8e-4846-994d-f9b56daf15c8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:56:48.823363 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d30caed2-4d8e-4846-994d-f9b56daf15c8 None admin] RBAC: Authorization granted {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:56:49.021030 dv-cinder-851351-1-smb devstack@keystone.service[352329]: [pid: 352329|app: 0|req: 597/1214] 10.222.0.42 () {58 vars in 1282 bytes} [Thu Jul 28 08:56:48 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 505 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 28 08:56:49.028626 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9881ffc4-4cd3-4ffa-8aaa-c86d7e9a3c69 None admin] Authenticating user token {{(pid=352328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:56:49.064561 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG dbcounter [-] [352328] Writing DB stats keystone:SELECT=100 {{(pid=352328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:56:49.208749 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9881ffc4-4cd3-4ffa-8aaa-c86d7e9a3c69 None admin] Validating token access rules against request {{(pid=352328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:56:49.263738 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250c58b8-2c06-4b66-a160-7fe678534bf8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:56:49.264829 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250c58b8-2c06-4b66-a160-7fe678534bf8 None admin] REQUEST_METHOD: `GET` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:56:49.265226 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250c58b8-2c06-4b66-a160-7fe678534bf8 None admin] SCRIPT_NAME: `/identity` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:56:49.265513 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250c58b8-2c06-4b66-a160-7fe678534bf8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:56:49.284270 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-250c58b8-2c06-4b66-a160-7fe678534bf8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:56:49.286144 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-250c58b8-2c06-4b66-a160-7fe678534bf8 None admin] RBAC: Authorization granted {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:56:49.314653 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application [None req-250c58b8-2c06-4b66-a160-7fe678534bf8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 08:56:49.314653 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:56:49.314653 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:56:49.314653 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:56:49.314653 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:56:49.314653 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:56:49.314653 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:56:49.314653 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:56:49.314653 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:56:49.314653 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:56:49.314653 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:56:49.314653 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:56:49.314653 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 08:56:49.314653 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 08:56:49.314653 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 08:56:49.316036 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 08:56:49.316036 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:56:49.316036 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:56:49.316036 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:56:49.316036 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:56:49.316036 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:56:49.316036 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:56:49.316036 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:56:49.316036 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application with Lock( Jul 28 08:56:49.316036 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:56:49.316036 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:56:49.316036 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:56:49.316036 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:56:49.316036 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:56:49.316036 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:56:49.316036 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:56:49.316036 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:56:49.317784 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 08:56:49.317784 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 08:56:49.317784 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 08:56:49.317784 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application Jul 28 08:56:49.317784 dv-cinder-851351-1-smb devstack@keystone.service[352328]: [pid: 352328|app: 0|req: 618/1215] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 08:56:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 290 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:56:49.326634 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d30caed2-4d8e-4846-994d-f9b56daf15c8 None admin] Authenticating user token {{(pid=352329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:56:49.453436 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG dbcounter [-] [352329] Writing DB stats keystone:SELECT=100 {{(pid=352329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:56:49.536723 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d30caed2-4d8e-4846-994d-f9b56daf15c8 None admin] Validating token access rules against request {{(pid=352329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:56:49.602565 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55cf4852-9168-400d-a7dd-f8cf60f988da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:56:49.603288 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55cf4852-9168-400d-a7dd-f8cf60f988da None admin] REQUEST_METHOD: `GET` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:56:49.603533 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55cf4852-9168-400d-a7dd-f8cf60f988da None admin] SCRIPT_NAME: `/identity` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:56:49.603837 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55cf4852-9168-400d-a7dd-f8cf60f988da None admin] PATH_INFO: `/v3/domains` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:56:49.604506 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55cf4852-9168-400d-a7dd-f8cf60f988da None admin] RBAC: Adding query filter params (name=Default) {{(pid=352329) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:56:49.604860 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55cf4852-9168-400d-a7dd-f8cf60f988da None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:56:49.611844 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55cf4852-9168-400d-a7dd-f8cf60f988da None admin] RBAC: Authorization granted {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:56:49.620393 dv-cinder-851351-1-smb devstack@keystone.service[352329]: [pid: 352329|app: 0|req: 598/1216] 10.222.0.42 () {56 vars in 1109 bytes} [Thu Jul 28 08:56:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 295 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:56:49.627660 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250c58b8-2c06-4b66-a160-7fe678534bf8 None admin] Authenticating user token {{(pid=352328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:56:49.730539 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG dbcounter [-] [352328] Writing DB stats keystone:SELECT=100 {{(pid=352328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:56:49.775889 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250c58b8-2c06-4b66-a160-7fe678534bf8 None admin] Validating token access rules against request {{(pid=352328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:56:49.824246 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a5584a-ea76-451e-ba03-74b4ca31fd16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:56:49.825017 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a5584a-ea76-451e-ba03-74b4ca31fd16 None admin] REQUEST_METHOD: `GET` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:56:49.825379 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a5584a-ea76-451e-ba03-74b4ca31fd16 None admin] SCRIPT_NAME: `/identity` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:56:49.825663 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a5584a-ea76-451e-ba03-74b4ca31fd16 None admin] PATH_INFO: `/v3/projects/service` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:56:49.837016 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09a5584a-ea76-451e-ba03-74b4ca31fd16 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:56:49.839006 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09a5584a-ea76-451e-ba03-74b4ca31fd16 None admin] RBAC: Authorization granted {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:56:49.855171 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application [None req-09a5584a-ea76-451e-ba03-74b4ca31fd16 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 08:56:49.855171 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:56:49.855171 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:56:49.855171 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:56:49.855171 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:56:49.855171 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:56:49.855171 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:56:49.855171 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:56:49.855171 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:56:49.855171 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:56:49.855171 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:56:49.855171 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:56:49.855171 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 28 08:56:49.855171 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 28 08:56:49.855171 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 28 08:56:49.857058 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 28 08:56:49.857058 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:56:49.857058 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:56:49.857058 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:56:49.857058 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:56:49.857058 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:56:49.857058 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:56:49.857058 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:56:49.857058 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application with Lock( Jul 28 08:56:49.857058 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:56:49.857058 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:56:49.857058 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:56:49.857058 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:56:49.857058 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:56:49.857058 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:56:49.857058 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:56:49.857058 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:56:49.859871 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 28 08:56:49.859871 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 28 08:56:49.859871 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 28 08:56:49.859871 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 28 08:56:49.859871 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 28 08:56:49.859871 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 28 08:56:49.859871 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 08:56:49.859871 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application Jul 28 08:56:49.859871 dv-cinder-851351-1-smb devstack@keystone.service[352328]: [pid: 352328|app: 0|req: 619/1217] 10.222.0.42 () {56 vars in 1111 bytes} [Thu Jul 28 08:56:49 2022] GET /identity/v3/projects/service => generated 88 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 08:56:49.865315 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55cf4852-9168-400d-a7dd-f8cf60f988da None admin] Authenticating user token {{(pid=352329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:56:50.019153 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55cf4852-9168-400d-a7dd-f8cf60f988da None admin] Validating token access rules against request {{(pid=352329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:56:50.056935 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG dbcounter [-] [352329] Writing DB stats keystone:SELECT=100 {{(pid=352329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:56:50.072213 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949c6e86-1c6e-42cc-8a4f-9ee9641c87c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:56:50.072998 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949c6e86-1c6e-42cc-8a4f-9ee9641c87c5 None admin] REQUEST_METHOD: `GET` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:56:50.073376 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949c6e86-1c6e-42cc-8a4f-9ee9641c87c5 None admin] SCRIPT_NAME: `/identity` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:56:50.073726 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949c6e86-1c6e-42cc-8a4f-9ee9641c87c5 None admin] PATH_INFO: `/v3/projects` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:56:50.074675 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-949c6e86-1c6e-42cc-8a4f-9ee9641c87c5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=352329) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:56:50.075102 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-949c6e86-1c6e-42cc-8a4f-9ee9641c87c5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:56:50.077816 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-949c6e86-1c6e-42cc-8a4f-9ee9641c87c5 None admin] RBAC: Authorization granted {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:56:50.096424 dv-cinder-851351-1-smb devstack@keystone.service[352329]: [pid: 352329|app: 0|req: 599/1218] 10.222.0.42 () {56 vars in 1148 bytes} [Thu Jul 28 08:56:49 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 08:56:50.104369 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a5584a-ea76-451e-ba03-74b4ca31fd16 None admin] Authenticating user token {{(pid=352328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:56:50.265135 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a5584a-ea76-451e-ba03-74b4ca31fd16 None admin] Validating token access rules against request {{(pid=352328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:56:50.305141 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG dbcounter [-] [352328] Writing DB stats keystone:SELECT=100 {{(pid=352328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:56:50.313269 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f45698f-2b84-4c98-9648-21d27479af24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:56:50.314124 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f45698f-2b84-4c98-9648-21d27479af24 None admin] REQUEST_METHOD: `GET` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:56:50.314534 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f45698f-2b84-4c98-9648-21d27479af24 None admin] SCRIPT_NAME: `/identity` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:56:50.314913 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f45698f-2b84-4c98-9648-21d27479af24 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:56:50.316094 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f45698f-2b84-4c98-9648-21d27479af24 None admin] RBAC: Adding query filter params (role.id=32da6d9f8d8f48e285530909f7633410, scope.project.id=9cfa053c839a4fedacde7163d907e2a4, user.id=9b6ed94c1df745c3bc7adf2769fc5119) {{(pid=352328) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:56:50.316531 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f45698f-2b84-4c98-9648-21d27479af24 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:56:50.318522 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f45698f-2b84-4c98-9648-21d27479af24 None admin] RBAC: Authorization granted {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:56:50.327325 dv-cinder-851351-1-smb devstack@keystone.service[352328]: [pid: 352328|app: 0|req: 620/1219] 10.222.0.42 () {56 vars in 1374 bytes} [Thu Jul 28 08:56:50 2022] GET /identity/v3/role_assignments?user.id=9b6ed94c1df745c3bc7adf2769fc5119&scope.project.id=9cfa053c839a4fedacde7163d907e2a4&role.id=32da6d9f8d8f48e285530909f7633410 => generated 259 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:56:52.726336 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e73565-7f63-4181-b313-a442f6f09cc9 None None] REQUEST_METHOD: `GET` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:56:52.727077 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e73565-7f63-4181-b313-a442f6f09cc9 None None] SCRIPT_NAME: `/identity` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:56:52.727077 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e73565-7f63-4181-b313-a442f6f09cc9 None None] PATH_INFO: `/` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:56:52.728545 dv-cinder-851351-1-smb devstack@keystone.service[352329]: [pid: 352329|app: 0|req: 600/1220] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 08:56:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 08:56:52.734534 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f2f682-62c7-4757-b2e9-1acc62783140 None None] REQUEST_METHOD: `POST` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:56:52.735143 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f2f682-62c7-4757-b2e9-1acc62783140 None None] SCRIPT_NAME: `/identity` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:56:52.735143 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f2f682-62c7-4757-b2e9-1acc62783140 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:56:52.754497 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.auth.core [None req-75f2f682-62c7-4757-b2e9-1acc62783140 None None] MFA Rules not processed for user `d18c063b2377412485965357671e5506`. Rule list: `[]` (Enabled: `True`). {{(pid=352328) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 08:56:52.755764 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.fernet_utils [None req-75f2f682-62c7-4757-b2e9-1acc62783140 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=352328) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:56:52.863796 dv-cinder-851351-1-smb devstack@keystone.service[352328]: [pid: 352328|app: 0|req: 621/1221] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 08:56:52 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 08:56:52.885820 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e73565-7f63-4181-b313-a442f6f09cc9 None None] Authenticating user token {{(pid=352329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:56:53.046362 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e73565-7f63-4181-b313-a442f6f09cc9 None None] Validating token access rules against request {{(pid=352329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:56:53.100723 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f80ef516-ae6f-4c16-90e2-e080f099f61c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:56:53.101646 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80ef516-ae6f-4c16-90e2-e080f099f61c None admin] REQUEST_METHOD: `GET` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:56:53.102099 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80ef516-ae6f-4c16-90e2-e080f099f61c None admin] SCRIPT_NAME: `/identity` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:56:53.102475 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80ef516-ae6f-4c16-90e2-e080f099f61c None admin] PATH_INFO: `/v3/roles/service` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:56:53.115630 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f80ef516-ae6f-4c16-90e2-e080f099f61c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 08:56:53.120624 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application [None req-f80ef516-ae6f-4c16-90e2-e080f099f61c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 28 08:56:53.120624 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:56:53.120624 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:56:53.120624 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:56:53.120624 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:56:53.120624 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:56:53.120624 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:56:53.120624 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:56:53.120624 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:56:53.120624 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:56:53.120624 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:56:53.120624 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:56:53.120624 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 08:56:53.120624 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 08:56:53.120624 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 08:56:53.120624 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 08:56:53.122760 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 08:56:53.122760 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 08:56:53.122760 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 08:56:53.122760 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 08:56:53.122760 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:56:53.122760 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:56:53.122760 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:56:53.122760 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:56:53.122760 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:56:53.122760 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:56:53.122760 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:56:53.122760 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application with Lock( Jul 28 08:56:53.122760 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:56:53.122760 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:56:53.122760 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:56:53.122760 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:56:53.123943 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:56:53.123943 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:56:53.123943 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:56:53.123943 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:56:53.123943 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 08:56:53.123943 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 08:56:53.123943 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 08:56:53.123943 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 08:56:53.123943 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 08:56:53.123943 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 08:56:53.123943 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 28 08:56:53.123943 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application Jul 28 08:56:53.123943 dv-cinder-851351-1-smb devstack@keystone.service[352329]: [pid: 352329|app: 0|req: 601/1222] 10.222.0.42 () {56 vars in 1102 bytes} [Thu Jul 28 08:56:52 2022] GET /identity/v3/roles/service => generated 85 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:56:53.128745 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f2f682-62c7-4757-b2e9-1acc62783140 None None] Authenticating user token {{(pid=352328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:56:53.277305 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f2f682-62c7-4757-b2e9-1acc62783140 None None] Validating token access rules against request {{(pid=352328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:56:53.315967 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG dbcounter [-] [352328] Writing DB stats keystone:SELECT=100 {{(pid=352328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:56:53.334089 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ba49c6-4ff5-4760-88e4-aa23bfd983ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:56:53.335283 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ba49c6-4ff5-4760-88e4-aa23bfd983ad None admin] REQUEST_METHOD: `GET` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:56:53.335649 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ba49c6-4ff5-4760-88e4-aa23bfd983ad None admin] SCRIPT_NAME: `/identity` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:56:53.336139 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ba49c6-4ff5-4760-88e4-aa23bfd983ad None admin] PATH_INFO: `/v3/roles` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:56:53.337113 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22ba49c6-4ff5-4760-88e4-aa23bfd983ad None admin] RBAC: Adding query filter params (name=service) {{(pid=352328) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:56:53.337724 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22ba49c6-4ff5-4760-88e4-aa23bfd983ad None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:56:53.339647 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22ba49c6-4ff5-4760-88e4-aa23bfd983ad None admin] RBAC: Authorization granted {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:56:53.360236 dv-cinder-851351-1-smb devstack@keystone.service[352328]: [pid: 352328|app: 0|req: 622/1223] 10.222.0.42 () {56 vars in 1103 bytes} [Thu Jul 28 08:56:53 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:56:53.361602 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f80ef516-ae6f-4c16-90e2-e080f099f61c None admin] Authenticating user token {{(pid=352329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:56:53.414430 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG dbcounter [-] [352329] Writing DB stats keystone:SELECT=100 {{(pid=352329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:56:53.484328 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f80ef516-ae6f-4c16-90e2-e080f099f61c None admin] Validating token access rules against request {{(pid=352329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:56:53.528384 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351063cd-6848-4481-be73-61fbde75d13d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:56:53.529321 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351063cd-6848-4481-be73-61fbde75d13d None admin] REQUEST_METHOD: `GET` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:56:53.529738 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351063cd-6848-4481-be73-61fbde75d13d None admin] SCRIPT_NAME: `/identity` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:56:53.530162 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351063cd-6848-4481-be73-61fbde75d13d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:56:53.543769 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-351063cd-6848-4481-be73-61fbde75d13d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:56:53.545519 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-351063cd-6848-4481-be73-61fbde75d13d None admin] RBAC: Authorization granted {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:56:53.565399 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application [None req-351063cd-6848-4481-be73-61fbde75d13d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 08:56:53.565399 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:56:53.565399 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:56:53.565399 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:56:53.565399 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:56:53.565399 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:56:53.565399 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:56:53.565399 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:56:53.565399 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:56:53.565399 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:56:53.565399 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:56:53.565399 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:56:53.565399 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 08:56:53.565399 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 08:56:53.565399 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 08:56:53.566736 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 08:56:53.566736 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:56:53.566736 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:56:53.566736 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:56:53.566736 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:56:53.566736 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:56:53.566736 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:56:53.566736 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:56:53.566736 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application with Lock( Jul 28 08:56:53.566736 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:56:53.566736 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:56:53.566736 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:56:53.566736 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:56:53.566736 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:56:53.566736 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:56:53.566736 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:56:53.566736 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:56:53.568019 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 08:56:53.568019 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 08:56:53.568019 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 08:56:53.568019 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application Jul 28 08:56:53.568019 dv-cinder-851351-1-smb devstack@keystone.service[352329]: [pid: 352329|app: 0|req: 602/1224] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 08:56:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:56:53.576751 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ba49c6-4ff5-4760-88e4-aa23bfd983ad None admin] Authenticating user token {{(pid=352328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:56:53.727087 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ba49c6-4ff5-4760-88e4-aa23bfd983ad None admin] Validating token access rules against request {{(pid=352328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:56:53.773315 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c1dfc9f-ebe2-47bf-a505-ed8114f53862 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:56:53.774508 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1dfc9f-ebe2-47bf-a505-ed8114f53862 None admin] REQUEST_METHOD: `GET` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:56:53.774770 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1dfc9f-ebe2-47bf-a505-ed8114f53862 None admin] SCRIPT_NAME: `/identity` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:56:53.775210 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1dfc9f-ebe2-47bf-a505-ed8114f53862 None admin] PATH_INFO: `/v3/domains` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:56:53.776290 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c1dfc9f-ebe2-47bf-a505-ed8114f53862 None admin] RBAC: Adding query filter params (name=Default) {{(pid=352328) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:56:53.776714 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c1dfc9f-ebe2-47bf-a505-ed8114f53862 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:56:53.778825 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c1dfc9f-ebe2-47bf-a505-ed8114f53862 None admin] RBAC: Authorization granted {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:56:53.796083 dv-cinder-851351-1-smb devstack@keystone.service[352328]: [pid: 352328|app: 0|req: 623/1225] 10.222.0.42 () {56 vars in 1109 bytes} [Thu Jul 28 08:56:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:56:53.804068 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351063cd-6848-4481-be73-61fbde75d13d None admin] Authenticating user token {{(pid=352329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:56:53.942486 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG dbcounter [-] [352329] Writing DB stats keystone:SELECT=100 {{(pid=352329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:56:53.955533 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351063cd-6848-4481-be73-61fbde75d13d None admin] Validating token access rules against request {{(pid=352329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:56:54.015002 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff24fe0-eb45-49fe-8696-1a6d2efbe8a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:56:54.015875 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff24fe0-eb45-49fe-8696-1a6d2efbe8a0 None admin] REQUEST_METHOD: `GET` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:56:54.016163 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff24fe0-eb45-49fe-8696-1a6d2efbe8a0 None admin] SCRIPT_NAME: `/identity` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:56:54.016449 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff24fe0-eb45-49fe-8696-1a6d2efbe8a0 None admin] PATH_INFO: `/v3/users/placement` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:56:54.031535 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff24fe0-eb45-49fe-8696-1a6d2efbe8a0 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:56:54.033989 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff24fe0-eb45-49fe-8696-1a6d2efbe8a0 None admin] RBAC: Authorization granted {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:56:54.056885 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application [None req-9ff24fe0-eb45-49fe-8696-1a6d2efbe8a0 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 28 08:56:54.056885 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:56:54.056885 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:56:54.056885 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:56:54.056885 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:56:54.056885 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:56:54.056885 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:56:54.056885 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:56:54.056885 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:56:54.056885 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:56:54.056885 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:56:54.056885 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:56:54.056885 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 28 08:56:54.056885 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 28 08:56:54.056885 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 28 08:56:54.056885 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 28 08:56:54.063978 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:56:54.063978 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:56:54.063978 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 28 08:56:54.063978 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 08:56:54.063978 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 28 08:56:54.063978 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 08:56:54.063978 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:56:54.063978 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:56:54.063978 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:56:54.063978 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:56:54.063978 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:56:54.063978 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application with Lock( Jul 28 08:56:54.063978 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:56:54.063978 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:56:54.063978 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:56:54.063978 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:56:54.063978 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:56:54.063978 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:56:54.066755 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:56:54.066755 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:56:54.066755 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 28 08:56:54.066755 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 28 08:56:54.066755 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 28 08:56:54.066755 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 28 08:56:54.066755 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 28 08:56:54.066755 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 28 08:56:54.066755 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 28 08:56:54.066755 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application Jul 28 08:56:54.066755 dv-cinder-851351-1-smb devstack@keystone.service[352329]: [pid: 352329|app: 0|req: 603/1226] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 08:56:53 2022] GET /identity/v3/users/placement => generated 87 bytes in 256 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:56:54.068136 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c1dfc9f-ebe2-47bf-a505-ed8114f53862 None admin] Authenticating user token {{(pid=352328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:56:54.149845 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG dbcounter [-] [352328] Writing DB stats keystone:SELECT=100 {{(pid=352328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:56:54.231929 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c1dfc9f-ebe2-47bf-a505-ed8114f53862 None admin] Validating token access rules against request {{(pid=352328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:56:54.275076 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae5093d-8d40-4eea-8c2d-a8c74cfec53a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:56:54.276075 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae5093d-8d40-4eea-8c2d-a8c74cfec53a None admin] REQUEST_METHOD: `GET` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:56:54.276342 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae5093d-8d40-4eea-8c2d-a8c74cfec53a None admin] SCRIPT_NAME: `/identity` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:56:54.276633 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae5093d-8d40-4eea-8c2d-a8c74cfec53a None admin] PATH_INFO: `/v3/users` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:56:54.277548 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae5093d-8d40-4eea-8c2d-a8c74cfec53a None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=352328) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:56:54.277945 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae5093d-8d40-4eea-8c2d-a8c74cfec53a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:56:54.279491 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae5093d-8d40-4eea-8c2d-a8c74cfec53a None admin] RBAC: Authorization granted {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:56:54.303354 dv-cinder-851351-1-smb devstack@keystone.service[352328]: [pid: 352328|app: 0|req: 624/1227] 10.222.0.42 () {56 vars in 1143 bytes} [Thu Jul 28 08:56:54 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 08:56:54.312704 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff24fe0-eb45-49fe-8696-1a6d2efbe8a0 None admin] Authenticating user token {{(pid=352329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:56:54.480848 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff24fe0-eb45-49fe-8696-1a6d2efbe8a0 None admin] Validating token access rules against request {{(pid=352329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:56:54.538406 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb9c7648-d921-4b9c-95ac-3e908177f516 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:56:54.539376 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9c7648-d921-4b9c-95ac-3e908177f516 None admin] REQUEST_METHOD: `GET` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:56:54.539829 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9c7648-d921-4b9c-95ac-3e908177f516 None admin] SCRIPT_NAME: `/identity` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:56:54.540184 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9c7648-d921-4b9c-95ac-3e908177f516 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:56:54.556953 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb9c7648-d921-4b9c-95ac-3e908177f516 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:56:54.559253 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb9c7648-d921-4b9c-95ac-3e908177f516 None admin] RBAC: Authorization granted {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:56:54.587284 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application [None req-eb9c7648-d921-4b9c-95ac-3e908177f516 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 08:56:54.587284 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:56:54.587284 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:56:54.587284 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:56:54.587284 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:56:54.587284 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:56:54.587284 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:56:54.587284 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:56:54.587284 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:56:54.587284 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:56:54.587284 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:56:54.587284 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:56:54.587284 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 08:56:54.587284 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 08:56:54.587284 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 08:56:54.590255 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 08:56:54.590255 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:56:54.590255 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:56:54.590255 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:56:54.590255 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:56:54.590255 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:56:54.590255 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:56:54.590255 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:56:54.590255 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application with Lock( Jul 28 08:56:54.590255 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:56:54.590255 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:56:54.590255 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:56:54.590255 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:56:54.590255 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:56:54.590255 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:56:54.590255 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:56:54.590255 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:56:54.592311 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 08:56:54.592311 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 08:56:54.592311 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 08:56:54.592311 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application Jul 28 08:56:54.592311 dv-cinder-851351-1-smb devstack@keystone.service[352329]: [pid: 352329|app: 0|req: 604/1228] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 08:56:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 277 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 08:56:54.598772 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae5093d-8d40-4eea-8c2d-a8c74cfec53a None admin] Authenticating user token {{(pid=352328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:56:54.765677 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae5093d-8d40-4eea-8c2d-a8c74cfec53a None admin] Validating token access rules against request {{(pid=352328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:56:54.769383 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG dbcounter [-] [352328] Writing DB stats keystone:SELECT=100 {{(pid=352328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:56:54.818252 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e435057-67b9-44e8-8e8f-ab29207d957e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:56:54.819144 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e435057-67b9-44e8-8e8f-ab29207d957e None admin] REQUEST_METHOD: `GET` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:56:54.819144 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e435057-67b9-44e8-8e8f-ab29207d957e None admin] SCRIPT_NAME: `/identity` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:56:54.819557 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e435057-67b9-44e8-8e8f-ab29207d957e None admin] PATH_INFO: `/v3/domains` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:56:54.820461 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e435057-67b9-44e8-8e8f-ab29207d957e None admin] RBAC: Adding query filter params (name=Default) {{(pid=352328) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:56:54.820884 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e435057-67b9-44e8-8e8f-ab29207d957e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:56:54.822974 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e435057-67b9-44e8-8e8f-ab29207d957e None admin] RBAC: Authorization granted {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:56:54.850215 dv-cinder-851351-1-smb devstack@keystone.service[352328]: [pid: 352328|app: 0|req: 625/1229] 10.222.0.42 () {56 vars in 1109 bytes} [Thu Jul 28 08:56:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 08:56:54.851623 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb9c7648-d921-4b9c-95ac-3e908177f516 None admin] Authenticating user token {{(pid=352329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:56:54.863902 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG dbcounter [-] [352329] Writing DB stats keystone:SELECT=100 {{(pid=352329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:56:55.002771 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb9c7648-d921-4b9c-95ac-3e908177f516 None admin] Validating token access rules against request {{(pid=352329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:56:55.057741 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f61e9b8a-4737-45c7-a307-6ea658d4b843 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:56:55.058555 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61e9b8a-4737-45c7-a307-6ea658d4b843 None admin] REQUEST_METHOD: `GET` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:56:55.058894 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61e9b8a-4737-45c7-a307-6ea658d4b843 None admin] SCRIPT_NAME: `/identity` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:56:55.059267 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61e9b8a-4737-45c7-a307-6ea658d4b843 None admin] PATH_INFO: `/v3/projects/service` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:56:55.068427 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f61e9b8a-4737-45c7-a307-6ea658d4b843 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:56:55.070061 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f61e9b8a-4737-45c7-a307-6ea658d4b843 None admin] RBAC: Authorization granted {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:56:55.086902 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application [None req-f61e9b8a-4737-45c7-a307-6ea658d4b843 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 08:56:55.086902 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:56:55.086902 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:56:55.086902 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:56:55.086902 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:56:55.086902 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:56:55.086902 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:56:55.086902 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:56:55.086902 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:56:55.086902 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:56:55.086902 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:56:55.086902 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:56:55.086902 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 28 08:56:55.086902 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 28 08:56:55.086902 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 28 08:56:55.089283 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 28 08:56:55.089283 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:56:55.089283 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:56:55.089283 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:56:55.089283 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:56:55.089283 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:56:55.089283 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:56:55.089283 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:56:55.089283 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application with Lock( Jul 28 08:56:55.089283 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:56:55.089283 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:56:55.089283 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:56:55.089283 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:56:55.089283 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:56:55.089283 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:56:55.089283 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:56:55.089283 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:56:55.091389 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 28 08:56:55.091389 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 28 08:56:55.091389 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 28 08:56:55.091389 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 28 08:56:55.091389 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 28 08:56:55.091389 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 28 08:56:55.091389 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 08:56:55.091389 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application Jul 28 08:56:55.091389 dv-cinder-851351-1-smb devstack@keystone.service[352329]: [pid: 352329|app: 0|req: 605/1230] 10.222.0.42 () {56 vars in 1111 bytes} [Thu Jul 28 08:56:54 2022] GET /identity/v3/projects/service => generated 88 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 08:56:55.101278 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e435057-67b9-44e8-8e8f-ab29207d957e None admin] Authenticating user token {{(pid=352328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:56:55.251845 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e435057-67b9-44e8-8e8f-ab29207d957e None admin] Validating token access rules against request {{(pid=352328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:56:55.327747 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ab7d59-69f4-4deb-b2ec-2f8ce1d420cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:56:55.329019 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ab7d59-69f4-4deb-b2ec-2f8ce1d420cb None admin] REQUEST_METHOD: `GET` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:56:55.329891 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ab7d59-69f4-4deb-b2ec-2f8ce1d420cb None admin] SCRIPT_NAME: `/identity` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:56:55.330389 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ab7d59-69f4-4deb-b2ec-2f8ce1d420cb None admin] PATH_INFO: `/v3/projects` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:56:55.331556 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3ab7d59-69f4-4deb-b2ec-2f8ce1d420cb None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=352328) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:56:55.332109 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3ab7d59-69f4-4deb-b2ec-2f8ce1d420cb None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:56:55.335648 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3ab7d59-69f4-4deb-b2ec-2f8ce1d420cb None admin] RBAC: Authorization granted {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:56:55.364413 dv-cinder-851351-1-smb devstack@keystone.service[352328]: [pid: 352328|app: 0|req: 626/1231] 10.222.0.42 () {56 vars in 1148 bytes} [Thu Jul 28 08:56:55 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:56:55.370917 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f61e9b8a-4737-45c7-a307-6ea658d4b843 None admin] Authenticating user token {{(pid=352329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:56:55.470151 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG dbcounter [-] [352329] Writing DB stats keystone:SELECT=100 {{(pid=352329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:56:55.521018 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f61e9b8a-4737-45c7-a307-6ea658d4b843 None admin] Validating token access rules against request {{(pid=352329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:56:55.575145 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6647390f-0947-4225-888a-1ca5a2431fc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:56:55.575946 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6647390f-0947-4225-888a-1ca5a2431fc6 None admin] REQUEST_METHOD: `PUT` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:56:55.576382 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6647390f-0947-4225-888a-1ca5a2431fc6 None admin] SCRIPT_NAME: `/identity` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:56:55.576594 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6647390f-0947-4225-888a-1ca5a2431fc6 None admin] PATH_INFO: `/v3/projects/9cfa053c839a4fedacde7163d907e2a4/users/9b6ed94c1df745c3bc7adf2769fc5119/roles/32da6d9f8d8f48e285530909f7633410` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:56:55.608591 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6647390f-0947-4225-888a-1ca5a2431fc6 None admin] RBAC: Authorizing `identity:create_grant(project_id=9cfa053c839a4fedacde7163d907e2a4, user_id=9b6ed94c1df745c3bc7adf2769fc5119, role_id=32da6d9f8d8f48e285530909f7633410)` {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:56:55.610378 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6647390f-0947-4225-888a-1ca5a2431fc6 None admin] RBAC: Authorization granted {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:56:55.632387 dv-cinder-851351-1-smb devstack@keystone.service[352329]: [pid: 352329|app: 0|req: 606/1232] 10.222.0.42 () {58 vars in 1439 bytes} [Thu Jul 28 08:56:55 2022] PUT /identity/v3/projects/9cfa053c839a4fedacde7163d907e2a4/users/9b6ed94c1df745c3bc7adf2769fc5119/roles/32da6d9f8d8f48e285530909f7633410 => generated 0 bytes in 262 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 08:56:57.794820 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3569c282-6dac-4540-8da3-c6432c25b5e4 None None] REQUEST_METHOD: `GET` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:56:57.795484 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3569c282-6dac-4540-8da3-c6432c25b5e4 None None] SCRIPT_NAME: `/identity` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:56:57.795613 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3569c282-6dac-4540-8da3-c6432c25b5e4 None None] PATH_INFO: `/` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:56:57.797078 dv-cinder-851351-1-smb devstack@keystone.service[352328]: [pid: 352328|app: 0|req: 627/1233] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 08:56:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 08:56:57.804051 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bae2d62-67df-417e-a3f4-0cce0df88e6a None None] REQUEST_METHOD: `POST` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:56:57.804616 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bae2d62-67df-417e-a3f4-0cce0df88e6a None None] SCRIPT_NAME: `/identity` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:56:57.804616 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bae2d62-67df-417e-a3f4-0cce0df88e6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:56:57.824344 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.auth.core [None req-1bae2d62-67df-417e-a3f4-0cce0df88e6a None None] MFA Rules not processed for user `d18c063b2377412485965357671e5506`. Rule list: `[]` (Enabled: `True`). {{(pid=352329) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 08:56:57.825637 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.fernet_utils [None req-1bae2d62-67df-417e-a3f4-0cce0df88e6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=352329) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:56:57.909565 dv-cinder-851351-1-smb devstack@keystone.service[352329]: [pid: 352329|app: 0|req: 607/1234] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 08:56:57 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 08:56:57.935280 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3569c282-6dac-4540-8da3-c6432c25b5e4 None None] Authenticating user token {{(pid=352328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:56:57.969869 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG dbcounter [-] [352328] Writing DB stats keystone:SELECT=100 {{(pid=352328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:56:58.083087 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3569c282-6dac-4540-8da3-c6432c25b5e4 None None] Validating token access rules against request {{(pid=352328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:56:58.130324 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-517b005c-edd2-4e7c-aebc-eafd75c48521 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:56:58.131118 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517b005c-edd2-4e7c-aebc-eafd75c48521 None admin] REQUEST_METHOD: `GET` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:56:58.131450 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517b005c-edd2-4e7c-aebc-eafd75c48521 None admin] SCRIPT_NAME: `/identity` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:56:58.131737 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517b005c-edd2-4e7c-aebc-eafd75c48521 None admin] PATH_INFO: `/v3/roles/service` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:56:58.147340 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-517b005c-edd2-4e7c-aebc-eafd75c48521 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 08:56:58.152653 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application [None req-517b005c-edd2-4e7c-aebc-eafd75c48521 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 28 08:56:58.152653 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:56:58.152653 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:56:58.152653 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:56:58.152653 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:56:58.152653 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:56:58.152653 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:56:58.152653 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:56:58.152653 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:56:58.152653 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:56:58.152653 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:56:58.152653 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:56:58.152653 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 08:56:58.152653 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 08:56:58.152653 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 08:56:58.152653 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 08:56:58.155113 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 08:56:58.155113 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 08:56:58.155113 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 08:56:58.155113 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 08:56:58.155113 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:56:58.155113 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:56:58.155113 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:56:58.155113 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:56:58.155113 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:56:58.155113 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:56:58.155113 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:56:58.155113 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application with Lock( Jul 28 08:56:58.155113 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:56:58.155113 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:56:58.155113 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:56:58.155113 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:56:58.157963 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:56:58.157963 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:56:58.157963 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:56:58.157963 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:56:58.157963 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 08:56:58.157963 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 08:56:58.157963 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 08:56:58.157963 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 08:56:58.157963 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 08:56:58.157963 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 08:56:58.157963 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 28 08:56:58.157963 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application Jul 28 08:56:58.157963 dv-cinder-851351-1-smb devstack@keystone.service[352328]: [pid: 352328|app: 0|req: 628/1235] 10.222.0.42 () {56 vars in 1102 bytes} [Thu Jul 28 08:56:57 2022] GET /identity/v3/roles/service => generated 85 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:56:58.161751 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bae2d62-67df-417e-a3f4-0cce0df88e6a None None] Authenticating user token {{(pid=352329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:56:58.225295 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG dbcounter [-] [352329] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=352329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:56:58.293446 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bae2d62-67df-417e-a3f4-0cce0df88e6a None None] Validating token access rules against request {{(pid=352329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:56:58.353714 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-973ebfdf-c141-4a80-9290-b04db7d473c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:56:58.354586 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973ebfdf-c141-4a80-9290-b04db7d473c1 None admin] REQUEST_METHOD: `GET` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:56:58.354848 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973ebfdf-c141-4a80-9290-b04db7d473c1 None admin] SCRIPT_NAME: `/identity` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:56:58.355133 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973ebfdf-c141-4a80-9290-b04db7d473c1 None admin] PATH_INFO: `/v3/roles` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:56:58.356114 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-973ebfdf-c141-4a80-9290-b04db7d473c1 None admin] RBAC: Adding query filter params (name=service) {{(pid=352329) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:56:58.356422 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-973ebfdf-c141-4a80-9290-b04db7d473c1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:56:58.358127 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-973ebfdf-c141-4a80-9290-b04db7d473c1 None admin] RBAC: Authorization granted {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:56:58.368936 dv-cinder-851351-1-smb devstack@keystone.service[352329]: [pid: 352329|app: 0|req: 608/1236] 10.222.0.42 () {56 vars in 1103 bytes} [Thu Jul 28 08:56:58 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 08:56:58.380603 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-517b005c-edd2-4e7c-aebc-eafd75c48521 None admin] Authenticating user token {{(pid=352328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:56:58.525307 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG dbcounter [-] [352328] Writing DB stats keystone:SELECT=100 {{(pid=352328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:56:58.552231 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-517b005c-edd2-4e7c-aebc-eafd75c48521 None admin] Validating token access rules against request {{(pid=352328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:56:58.612633 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ea9c00-be20-40be-be6b-083796857667 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:56:58.613742 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ea9c00-be20-40be-be6b-083796857667 None admin] REQUEST_METHOD: `GET` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:56:58.614232 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ea9c00-be20-40be-be6b-083796857667 None admin] SCRIPT_NAME: `/identity` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:56:58.614698 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ea9c00-be20-40be-be6b-083796857667 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:56:58.632837 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ea9c00-be20-40be-be6b-083796857667 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:56:58.635564 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ea9c00-be20-40be-be6b-083796857667 None admin] RBAC: Authorization granted {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:56:58.666136 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application [None req-36ea9c00-be20-40be-be6b-083796857667 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 08:56:58.666136 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:56:58.666136 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:56:58.666136 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:56:58.666136 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:56:58.666136 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:56:58.666136 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:56:58.666136 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:56:58.666136 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:56:58.666136 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:56:58.666136 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:56:58.666136 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:56:58.666136 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 08:56:58.666136 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 08:56:58.666136 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 08:56:58.668215 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 08:56:58.668215 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:56:58.668215 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:56:58.668215 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:56:58.668215 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:56:58.668215 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:56:58.668215 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:56:58.668215 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:56:58.668215 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application with Lock( Jul 28 08:56:58.668215 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:56:58.668215 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:56:58.668215 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:56:58.668215 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:56:58.668215 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:56:58.668215 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:56:58.668215 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:56:58.668215 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:56:58.670212 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 08:56:58.670212 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 08:56:58.670212 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 08:56:58.670212 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application Jul 28 08:56:58.670212 dv-cinder-851351-1-smb devstack@keystone.service[352328]: [pid: 352328|app: 0|req: 629/1237] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 08:56:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 288 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:56:58.678418 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-973ebfdf-c141-4a80-9290-b04db7d473c1 None admin] Authenticating user token {{(pid=352329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:56:58.833224 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-973ebfdf-c141-4a80-9290-b04db7d473c1 None admin] Validating token access rules against request {{(pid=352329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:56:58.849326 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG dbcounter [-] [352329] Writing DB stats keystone:SELECT=100 {{(pid=352329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:56:58.885115 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-648c9822-d022-4440-8e5c-250cce83d3df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:56:58.886087 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648c9822-d022-4440-8e5c-250cce83d3df None admin] REQUEST_METHOD: `GET` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:56:58.886567 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648c9822-d022-4440-8e5c-250cce83d3df None admin] SCRIPT_NAME: `/identity` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:56:58.887045 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648c9822-d022-4440-8e5c-250cce83d3df None admin] PATH_INFO: `/v3/domains` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:56:58.888391 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-648c9822-d022-4440-8e5c-250cce83d3df None admin] RBAC: Adding query filter params (name=Default) {{(pid=352329) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:56:58.888967 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-648c9822-d022-4440-8e5c-250cce83d3df None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:56:58.891515 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-648c9822-d022-4440-8e5c-250cce83d3df None admin] RBAC: Authorization granted {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:56:58.916425 dv-cinder-851351-1-smb devstack@keystone.service[352329]: [pid: 352329|app: 0|req: 609/1238] 10.222.0.42 () {56 vars in 1109 bytes} [Thu Jul 28 08:56:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:56:58.918262 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ea9c00-be20-40be-be6b-083796857667 None admin] Authenticating user token {{(pid=352328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:56:59.074910 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ea9c00-be20-40be-be6b-083796857667 None admin] Validating token access rules against request {{(pid=352328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:56:59.127033 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e9b4dd-bbd9-4f43-8bad-d359e9c0225c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:56:59.127958 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e9b4dd-bbd9-4f43-8bad-d359e9c0225c None admin] REQUEST_METHOD: `GET` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:56:59.128368 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e9b4dd-bbd9-4f43-8bad-d359e9c0225c None admin] SCRIPT_NAME: `/identity` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:56:59.128877 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e9b4dd-bbd9-4f43-8bad-d359e9c0225c None admin] PATH_INFO: `/v3/users/placement` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:56:59.133836 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG dbcounter [-] [352328] Writing DB stats keystone:SELECT=100 {{(pid=352328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:56:59.144872 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e9b4dd-bbd9-4f43-8bad-d359e9c0225c None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:56:59.146953 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e9b4dd-bbd9-4f43-8bad-d359e9c0225c None admin] RBAC: Authorization granted {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:56:59.172614 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application [None req-25e9b4dd-bbd9-4f43-8bad-d359e9c0225c None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 28 08:56:59.172614 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:56:59.172614 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:56:59.172614 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:56:59.172614 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:56:59.172614 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:56:59.172614 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:56:59.172614 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:56:59.172614 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:56:59.172614 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:56:59.172614 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:56:59.172614 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:56:59.172614 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 28 08:56:59.172614 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 28 08:56:59.172614 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 28 08:56:59.172614 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 28 08:56:59.174996 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:56:59.174996 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:56:59.174996 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 28 08:56:59.174996 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 08:56:59.174996 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 28 08:56:59.174996 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 08:56:59.174996 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:56:59.174996 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:56:59.174996 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:56:59.174996 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:56:59.174996 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:56:59.174996 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application with Lock( Jul 28 08:56:59.174996 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:56:59.174996 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:56:59.174996 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:56:59.174996 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:56:59.174996 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:56:59.174996 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:56:59.177375 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:56:59.177375 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:56:59.177375 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 28 08:56:59.177375 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 28 08:56:59.177375 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 28 08:56:59.177375 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 28 08:56:59.177375 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 28 08:56:59.177375 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 28 08:56:59.177375 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 28 08:56:59.177375 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application Jul 28 08:56:59.177375 dv-cinder-851351-1-smb devstack@keystone.service[352328]: [pid: 352328|app: 0|req: 630/1239] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 08:56:58 2022] GET /identity/v3/users/placement => generated 87 bytes in 257 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:56:59.183500 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-648c9822-d022-4440-8e5c-250cce83d3df None admin] Authenticating user token {{(pid=352329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:56:59.327322 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-648c9822-d022-4440-8e5c-250cce83d3df None admin] Validating token access rules against request {{(pid=352329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:56:59.382153 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8de29e5-56d9-428d-b2fe-57101b32f061 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:56:59.383061 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8de29e5-56d9-428d-b2fe-57101b32f061 None admin] REQUEST_METHOD: `GET` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:56:59.383513 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8de29e5-56d9-428d-b2fe-57101b32f061 None admin] SCRIPT_NAME: `/identity` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:56:59.383917 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8de29e5-56d9-428d-b2fe-57101b32f061 None admin] PATH_INFO: `/v3/users` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:56:59.385027 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8de29e5-56d9-428d-b2fe-57101b32f061 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=352329) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:56:59.385442 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8de29e5-56d9-428d-b2fe-57101b32f061 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:56:59.387115 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8de29e5-56d9-428d-b2fe-57101b32f061 None admin] RBAC: Authorization granted {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:56:59.417137 dv-cinder-851351-1-smb devstack@keystone.service[352329]: [pid: 352329|app: 0|req: 610/1240] 10.222.0.42 () {56 vars in 1143 bytes} [Thu Jul 28 08:56:59 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:56:59.426245 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e9b4dd-bbd9-4f43-8bad-d359e9c0225c None admin] Authenticating user token {{(pid=352328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:56:59.572347 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e9b4dd-bbd9-4f43-8bad-d359e9c0225c None admin] Validating token access rules against request {{(pid=352328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:56:59.614358 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20508041-43e5-4c71-bf4c-e4d5232297ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:56:59.615061 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20508041-43e5-4c71-bf4c-e4d5232297ed None admin] REQUEST_METHOD: `GET` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:56:59.615341 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20508041-43e5-4c71-bf4c-e4d5232297ed None admin] SCRIPT_NAME: `/identity` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:56:59.615611 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20508041-43e5-4c71-bf4c-e4d5232297ed None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:56:59.722490 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG dbcounter [-] [352328] Writing DB stats keystone:SELECT=100 {{(pid=352328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:56:59.735791 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20508041-43e5-4c71-bf4c-e4d5232297ed None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:56:59.738721 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20508041-43e5-4c71-bf4c-e4d5232297ed None admin] RBAC: Authorization granted {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:56:59.903339 dv-cinder-851351-1-smb devstack@keystone.service[352328]: [pid: 352328|app: 0|req: 631/1241] 10.222.0.42 () {58 vars in 1282 bytes} [Thu Jul 28 08:56:59 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 478 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jul 28 08:56:59.911713 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8de29e5-56d9-428d-b2fe-57101b32f061 None admin] Authenticating user token {{(pid=352329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:56:59.952246 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG dbcounter [-] [352329] Writing DB stats keystone:SELECT=100 {{(pid=352329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:57:00.070876 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8de29e5-56d9-428d-b2fe-57101b32f061 None admin] Validating token access rules against request {{(pid=352329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:57:00.120750 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc9caba0-2afe-4193-89de-76a8b2ead022 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:57:00.121795 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9caba0-2afe-4193-89de-76a8b2ead022 None admin] REQUEST_METHOD: `GET` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:57:00.122256 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9caba0-2afe-4193-89de-76a8b2ead022 None admin] SCRIPT_NAME: `/identity` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:57:00.122615 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9caba0-2afe-4193-89de-76a8b2ead022 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:57:00.139971 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc9caba0-2afe-4193-89de-76a8b2ead022 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:57:00.143005 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc9caba0-2afe-4193-89de-76a8b2ead022 None admin] RBAC: Authorization granted {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:57:00.168754 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application [None req-cc9caba0-2afe-4193-89de-76a8b2ead022 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 08:57:00.168754 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:57:00.168754 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:57:00.168754 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:57:00.168754 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:57:00.168754 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:57:00.168754 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:57:00.168754 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:57:00.168754 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:57:00.168754 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:57:00.168754 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:57:00.168754 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:57:00.168754 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 08:57:00.168754 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 08:57:00.168754 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 08:57:00.171212 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 08:57:00.171212 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:57:00.171212 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:57:00.171212 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:57:00.171212 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:57:00.171212 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:57:00.171212 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:57:00.171212 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:57:00.171212 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application with Lock( Jul 28 08:57:00.171212 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:57:00.171212 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:57:00.171212 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:57:00.171212 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:57:00.171212 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:57:00.171212 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:57:00.171212 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:57:00.171212 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:57:00.173682 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 08:57:00.173682 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 08:57:00.173682 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 08:57:00.173682 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application Jul 28 08:57:00.173682 dv-cinder-851351-1-smb devstack@keystone.service[352329]: [pid: 352329|app: 0|req: 611/1242] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 08:56:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 260 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:57:00.179275 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20508041-43e5-4c71-bf4c-e4d5232297ed None admin] Authenticating user token {{(pid=352328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:57:00.317791 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG dbcounter [-] [352328] Writing DB stats keystone:SELECT=100 {{(pid=352328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:57:00.326812 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20508041-43e5-4c71-bf4c-e4d5232297ed None admin] Validating token access rules against request {{(pid=352328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:57:00.374416 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da13205-afdc-482f-ae87-c65181d83748 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:57:00.375315 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da13205-afdc-482f-ae87-c65181d83748 None admin] REQUEST_METHOD: `GET` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:57:00.375771 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da13205-afdc-482f-ae87-c65181d83748 None admin] SCRIPT_NAME: `/identity` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:57:00.376198 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da13205-afdc-482f-ae87-c65181d83748 None admin] PATH_INFO: `/v3/domains` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:57:00.377106 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1da13205-afdc-482f-ae87-c65181d83748 None admin] RBAC: Adding query filter params (name=Default) {{(pid=352328) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:57:00.377554 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1da13205-afdc-482f-ae87-c65181d83748 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:57:00.379409 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1da13205-afdc-482f-ae87-c65181d83748 None admin] RBAC: Authorization granted {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:57:00.393459 dv-cinder-851351-1-smb devstack@keystone.service[352328]: [pid: 352328|app: 0|req: 632/1243] 10.222.0.42 () {56 vars in 1109 bytes} [Thu Jul 28 08:57:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:57:00.401365 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc9caba0-2afe-4193-89de-76a8b2ead022 None admin] Authenticating user token {{(pid=352329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:57:00.524091 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG dbcounter [-] [352329] Writing DB stats keystone:SELECT=100 {{(pid=352329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:57:00.568119 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc9caba0-2afe-4193-89de-76a8b2ead022 None admin] Validating token access rules against request {{(pid=352329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:57:00.631854 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2bd9fba-6526-4455-8b5d-4144c770b686 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:57:00.632765 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2bd9fba-6526-4455-8b5d-4144c770b686 None admin] REQUEST_METHOD: `GET` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:57:00.633230 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2bd9fba-6526-4455-8b5d-4144c770b686 None admin] SCRIPT_NAME: `/identity` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:57:00.633755 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2bd9fba-6526-4455-8b5d-4144c770b686 None admin] PATH_INFO: `/v3/projects/service` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:57:00.646901 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2bd9fba-6526-4455-8b5d-4144c770b686 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:57:00.649823 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2bd9fba-6526-4455-8b5d-4144c770b686 None admin] RBAC: Authorization granted {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:57:00.673699 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application [None req-e2bd9fba-6526-4455-8b5d-4144c770b686 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 08:57:00.673699 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:57:00.673699 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:57:00.673699 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:57:00.673699 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:57:00.673699 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:57:00.673699 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:57:00.673699 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:57:00.673699 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:57:00.673699 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:57:00.673699 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:57:00.673699 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:57:00.673699 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 28 08:57:00.673699 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 28 08:57:00.673699 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 28 08:57:00.675053 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 28 08:57:00.675053 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:57:00.675053 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:57:00.675053 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:57:00.675053 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:57:00.675053 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:57:00.675053 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:57:00.675053 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:57:00.675053 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application with Lock( Jul 28 08:57:00.675053 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:57:00.675053 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:57:00.675053 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:57:00.675053 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:57:00.675053 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:57:00.675053 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:57:00.675053 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:57:00.675053 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:57:00.676176 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 28 08:57:00.676176 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 28 08:57:00.676176 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 28 08:57:00.676176 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 28 08:57:00.676176 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 28 08:57:00.676176 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 28 08:57:00.676176 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 08:57:00.676176 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application Jul 28 08:57:00.676917 dv-cinder-851351-1-smb devstack@keystone.service[352329]: [pid: 352329|app: 0|req: 612/1244] 10.222.0.42 () {56 vars in 1111 bytes} [Thu Jul 28 08:57:00 2022] GET /identity/v3/projects/service => generated 88 bytes in 276 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:57:00.685568 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da13205-afdc-482f-ae87-c65181d83748 None admin] Authenticating user token {{(pid=352328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:57:00.868962 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da13205-afdc-482f-ae87-c65181d83748 None admin] Validating token access rules against request {{(pid=352328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:57:00.916335 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b496d169-3f33-4468-b68d-b2b2a149ad1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:57:00.917157 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b496d169-3f33-4468-b68d-b2b2a149ad1c None admin] REQUEST_METHOD: `GET` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:57:00.917493 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b496d169-3f33-4468-b68d-b2b2a149ad1c None admin] SCRIPT_NAME: `/identity` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:57:00.917799 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b496d169-3f33-4468-b68d-b2b2a149ad1c None admin] PATH_INFO: `/v3/projects` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:57:00.918710 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b496d169-3f33-4468-b68d-b2b2a149ad1c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=352328) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:57:00.919030 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b496d169-3f33-4468-b68d-b2b2a149ad1c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:57:00.920973 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b496d169-3f33-4468-b68d-b2b2a149ad1c None admin] RBAC: Authorization granted {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:57:00.941698 dv-cinder-851351-1-smb devstack@keystone.service[352328]: [pid: 352328|app: 0|req: 633/1245] 10.222.0.42 () {56 vars in 1148 bytes} [Thu Jul 28 08:57:00 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:57:00.950929 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2bd9fba-6526-4455-8b5d-4144c770b686 None admin] Authenticating user token {{(pid=352329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:57:01.123713 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2bd9fba-6526-4455-8b5d-4144c770b686 None admin] Validating token access rules against request {{(pid=352329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:57:01.173181 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43727a13-f48a-48c8-8b18-ab54ffb76bd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:57:01.174171 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43727a13-f48a-48c8-8b18-ab54ffb76bd4 None admin] REQUEST_METHOD: `GET` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:57:01.174694 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43727a13-f48a-48c8-8b18-ab54ffb76bd4 None admin] SCRIPT_NAME: `/identity` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:57:01.175210 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43727a13-f48a-48c8-8b18-ab54ffb76bd4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:57:01.178163 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43727a13-f48a-48c8-8b18-ab54ffb76bd4 None admin] RBAC: Adding query filter params (role.id=32da6d9f8d8f48e285530909f7633410, scope.project.id=9cfa053c839a4fedacde7163d907e2a4, user.id=9b6ed94c1df745c3bc7adf2769fc5119) {{(pid=352329) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:57:01.178704 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43727a13-f48a-48c8-8b18-ab54ffb76bd4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:57:01.181470 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43727a13-f48a-48c8-8b18-ab54ffb76bd4 None admin] RBAC: Authorization granted {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:57:01.190026 dv-cinder-851351-1-smb devstack@keystone.service[352329]: [pid: 352329|app: 0|req: 613/1246] 10.222.0.42 () {56 vars in 1374 bytes} [Thu Jul 28 08:57:00 2022] GET /identity/v3/role_assignments?user.id=9b6ed94c1df745c3bc7adf2769fc5119&scope.project.id=9cfa053c839a4fedacde7163d907e2a4&role.id=32da6d9f8d8f48e285530909f7633410 => generated 608 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:57:03.716896 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f109921b-8458-4bac-9e66-1f7a72028999 None None] REQUEST_METHOD: `GET` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:57:03.717872 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f109921b-8458-4bac-9e66-1f7a72028999 None None] SCRIPT_NAME: `/identity` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:57:03.717872 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f109921b-8458-4bac-9e66-1f7a72028999 None None] PATH_INFO: `/` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:57:03.719156 dv-cinder-851351-1-smb devstack@keystone.service[352328]: [pid: 352328|app: 0|req: 634/1247] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 08:57:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 08:57:03.726323 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409a7b3d-4f55-4148-ad36-7e01ad164782 None None] REQUEST_METHOD: `POST` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:57:03.726982 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409a7b3d-4f55-4148-ad36-7e01ad164782 None None] SCRIPT_NAME: `/identity` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:57:03.727289 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409a7b3d-4f55-4148-ad36-7e01ad164782 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:57:03.737892 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG dbcounter [-] [352329] Writing DB stats keystone:SELECT=100 {{(pid=352329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:57:03.753302 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.auth.core [None req-409a7b3d-4f55-4148-ad36-7e01ad164782 None None] MFA Rules not processed for user `d18c063b2377412485965357671e5506`. Rule list: `[]` (Enabled: `True`). {{(pid=352329) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 08:57:03.754548 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.fernet_utils [None req-409a7b3d-4f55-4148-ad36-7e01ad164782 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=352329) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:57:03.852629 dv-cinder-851351-1-smb devstack@keystone.service[352329]: [pid: 352329|app: 0|req: 614/1248] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 08:57:03 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 08:57:03.898249 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f109921b-8458-4bac-9e66-1f7a72028999 None None] Authenticating user token {{(pid=352328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:57:03.922674 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG dbcounter [-] [352328] Writing DB stats keystone:SELECT=100 {{(pid=352328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:57:04.068229 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f109921b-8458-4bac-9e66-1f7a72028999 None None] Validating token access rules against request {{(pid=352328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:57:04.122624 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10584cd8-ea47-4be8-8352-6f1cb3954d33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:57:04.123720 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10584cd8-ea47-4be8-8352-6f1cb3954d33 None admin] REQUEST_METHOD: `GET` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:57:04.124135 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10584cd8-ea47-4be8-8352-6f1cb3954d33 None admin] SCRIPT_NAME: `/identity` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:57:04.124620 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10584cd8-ea47-4be8-8352-6f1cb3954d33 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:57:04.142401 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10584cd8-ea47-4be8-8352-6f1cb3954d33 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 08:57:04.147656 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application [None req-10584cd8-ea47-4be8-8352-6f1cb3954d33 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 08:57:04.147656 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:57:04.147656 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:57:04.147656 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:57:04.147656 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:57:04.147656 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:57:04.147656 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:57:04.147656 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:57:04.147656 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:57:04.147656 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:57:04.147656 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:57:04.147656 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:57:04.147656 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 08:57:04.147656 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 08:57:04.147656 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 08:57:04.147656 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 08:57:04.150661 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 08:57:04.150661 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 08:57:04.150661 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 08:57:04.150661 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 08:57:04.150661 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:57:04.150661 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:57:04.150661 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:57:04.150661 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:57:04.150661 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:57:04.150661 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:57:04.150661 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:57:04.150661 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application with Lock( Jul 28 08:57:04.150661 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:57:04.150661 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:57:04.150661 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:57:04.150661 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:57:04.153408 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:57:04.153408 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:57:04.153408 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:57:04.153408 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:57:04.153408 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 08:57:04.153408 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 08:57:04.153408 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 08:57:04.153408 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 08:57:04.153408 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 08:57:04.153408 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 08:57:04.153408 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 08:57:04.153408 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application Jul 28 08:57:04.153408 dv-cinder-851351-1-smb devstack@keystone.service[352328]: [pid: 352328|app: 0|req: 635/1249] 10.222.0.42 () {56 vars in 1096 bytes} [Thu Jul 28 08:57:03 2022] GET /identity/v3/roles/admin => generated 83 bytes in 252 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:57:04.156066 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-409a7b3d-4f55-4148-ad36-7e01ad164782 None None] Authenticating user token {{(pid=352329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:57:04.301485 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-409a7b3d-4f55-4148-ad36-7e01ad164782 None None] Validating token access rules against request {{(pid=352329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:57:04.337123 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG dbcounter [-] [352329] Writing DB stats keystone:SELECT=100 {{(pid=352329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:57:04.344345 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c80691a-eb5f-4f78-8ea3-8506b538c6f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:57:04.345558 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c80691a-eb5f-4f78-8ea3-8506b538c6f1 None admin] REQUEST_METHOD: `GET` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:57:04.346144 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c80691a-eb5f-4f78-8ea3-8506b538c6f1 None admin] SCRIPT_NAME: `/identity` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:57:04.346689 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c80691a-eb5f-4f78-8ea3-8506b538c6f1 None admin] PATH_INFO: `/v3/roles` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:57:04.348095 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c80691a-eb5f-4f78-8ea3-8506b538c6f1 None admin] RBAC: Adding query filter params (name=admin) {{(pid=352329) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:57:04.348629 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c80691a-eb5f-4f78-8ea3-8506b538c6f1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:57:04.351348 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c80691a-eb5f-4f78-8ea3-8506b538c6f1 None admin] RBAC: Authorization granted {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:57:04.368136 dv-cinder-851351-1-smb devstack@keystone.service[352329]: [pid: 352329|app: 0|req: 615/1250] 10.222.0.42 () {56 vars in 1099 bytes} [Thu Jul 28 08:57:04 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 08:57:04.374325 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10584cd8-ea47-4be8-8352-6f1cb3954d33 None admin] Authenticating user token {{(pid=352328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:57:04.482348 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG dbcounter [-] [352328] Writing DB stats keystone:SELECT=100 {{(pid=352328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:57:04.519994 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10584cd8-ea47-4be8-8352-6f1cb3954d33 None admin] Validating token access rules against request {{(pid=352328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:57:04.568486 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac27588-8a55-4ea4-b31f-46e112ae0e4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:57:04.569468 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac27588-8a55-4ea4-b31f-46e112ae0e4a None admin] REQUEST_METHOD: `GET` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:57:04.570157 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac27588-8a55-4ea4-b31f-46e112ae0e4a None admin] SCRIPT_NAME: `/identity` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:57:04.570672 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac27588-8a55-4ea4-b31f-46e112ae0e4a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:57:04.590800 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fac27588-8a55-4ea4-b31f-46e112ae0e4a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:57:04.592760 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fac27588-8a55-4ea4-b31f-46e112ae0e4a None admin] RBAC: Authorization granted {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:57:04.624159 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application [None req-fac27588-8a55-4ea4-b31f-46e112ae0e4a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 08:57:04.624159 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:57:04.624159 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:57:04.624159 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:57:04.624159 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:57:04.624159 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:57:04.624159 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:57:04.624159 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:57:04.624159 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:57:04.624159 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:57:04.624159 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:57:04.624159 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:57:04.624159 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 08:57:04.624159 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 08:57:04.624159 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 08:57:04.626605 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 08:57:04.626605 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:57:04.626605 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:57:04.626605 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:57:04.626605 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:57:04.626605 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:57:04.626605 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:57:04.626605 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:57:04.626605 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application with Lock( Jul 28 08:57:04.626605 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:57:04.626605 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:57:04.626605 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:57:04.626605 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:57:04.626605 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:57:04.626605 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:57:04.626605 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:57:04.626605 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:57:04.629013 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 08:57:04.629013 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 08:57:04.629013 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 08:57:04.629013 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application Jul 28 08:57:04.629013 dv-cinder-851351-1-smb devstack@keystone.service[352328]: [pid: 352328|app: 0|req: 636/1251] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 08:57:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 253 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:57:04.633516 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c80691a-eb5f-4f78-8ea3-8506b538c6f1 None admin] Authenticating user token {{(pid=352329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:57:04.795417 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c80691a-eb5f-4f78-8ea3-8506b538c6f1 None admin] Validating token access rules against request {{(pid=352329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:57:04.852866 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e7f499-45d4-428f-b94b-ded6eb201a4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:57:04.853532 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e7f499-45d4-428f-b94b-ded6eb201a4a None admin] REQUEST_METHOD: `GET` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:57:04.853816 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e7f499-45d4-428f-b94b-ded6eb201a4a None admin] SCRIPT_NAME: `/identity` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:57:04.854102 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e7f499-45d4-428f-b94b-ded6eb201a4a None admin] PATH_INFO: `/v3/domains` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:57:04.854851 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e7f499-45d4-428f-b94b-ded6eb201a4a None admin] RBAC: Adding query filter params (name=Default) {{(pid=352329) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:57:04.855171 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e7f499-45d4-428f-b94b-ded6eb201a4a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:57:04.856913 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e7f499-45d4-428f-b94b-ded6eb201a4a None admin] RBAC: Authorization granted {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:57:04.872608 dv-cinder-851351-1-smb devstack@keystone.service[352329]: [pid: 352329|app: 0|req: 616/1252] 10.222.0.42 () {56 vars in 1109 bytes} [Thu Jul 28 08:57:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:57:04.882102 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac27588-8a55-4ea4-b31f-46e112ae0e4a None admin] Authenticating user token {{(pid=352328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:57:05.015255 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac27588-8a55-4ea4-b31f-46e112ae0e4a None admin] Validating token access rules against request {{(pid=352328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:57:05.048091 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG dbcounter [-] [352328] Writing DB stats keystone:SELECT=100 {{(pid=352328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:57:05.058523 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30878f73-94d8-47d2-acf7-b3ae73c07571 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:57:05.059349 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30878f73-94d8-47d2-acf7-b3ae73c07571 None admin] REQUEST_METHOD: `GET` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:57:05.059685 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30878f73-94d8-47d2-acf7-b3ae73c07571 None admin] SCRIPT_NAME: `/identity` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:57:05.060017 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30878f73-94d8-47d2-acf7-b3ae73c07571 None admin] PATH_INFO: `/v3/users/placement` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:57:05.070362 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30878f73-94d8-47d2-acf7-b3ae73c07571 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:57:05.072265 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30878f73-94d8-47d2-acf7-b3ae73c07571 None admin] RBAC: Authorization granted {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:57:05.087264 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application [None req-30878f73-94d8-47d2-acf7-b3ae73c07571 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 28 08:57:05.087264 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:57:05.087264 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:57:05.087264 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:57:05.087264 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:57:05.087264 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:57:05.087264 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:57:05.087264 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:57:05.087264 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:57:05.087264 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:57:05.087264 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:57:05.087264 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:57:05.087264 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 28 08:57:05.087264 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 28 08:57:05.087264 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 28 08:57:05.087264 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 28 08:57:05.089843 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:57:05.089843 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:57:05.089843 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 28 08:57:05.089843 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 08:57:05.089843 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 28 08:57:05.089843 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 08:57:05.089843 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:57:05.089843 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:57:05.089843 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:57:05.089843 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:57:05.089843 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:57:05.089843 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application with Lock( Jul 28 08:57:05.089843 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:57:05.089843 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:57:05.089843 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:57:05.089843 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:57:05.089843 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:57:05.089843 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:57:05.092438 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:57:05.092438 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:57:05.092438 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 28 08:57:05.092438 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 28 08:57:05.092438 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 28 08:57:05.092438 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 28 08:57:05.092438 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 28 08:57:05.092438 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 28 08:57:05.092438 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 28 08:57:05.092438 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application Jul 28 08:57:05.092438 dv-cinder-851351-1-smb devstack@keystone.service[352328]: [pid: 352328|app: 0|req: 637/1253] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 08:57:04 2022] GET /identity/v3/users/placement => generated 87 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:57:05.097764 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e7f499-45d4-428f-b94b-ded6eb201a4a None admin] Authenticating user token {{(pid=352329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:57:05.183431 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG dbcounter [-] [352329] Writing DB stats keystone:SELECT=100 {{(pid=352329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:57:05.252755 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e7f499-45d4-428f-b94b-ded6eb201a4a None admin] Validating token access rules against request {{(pid=352329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:57:05.306868 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31761d5c-79cf-47f3-b64f-0475e21a733b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:57:05.308173 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31761d5c-79cf-47f3-b64f-0475e21a733b None admin] REQUEST_METHOD: `GET` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:57:05.308850 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31761d5c-79cf-47f3-b64f-0475e21a733b None admin] SCRIPT_NAME: `/identity` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:57:05.309423 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31761d5c-79cf-47f3-b64f-0475e21a733b None admin] PATH_INFO: `/v3/users` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:57:05.311431 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31761d5c-79cf-47f3-b64f-0475e21a733b None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=352329) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:57:05.311974 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31761d5c-79cf-47f3-b64f-0475e21a733b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:57:05.314834 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31761d5c-79cf-47f3-b64f-0475e21a733b None admin] RBAC: Authorization granted {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:57:05.355420 dv-cinder-851351-1-smb devstack@keystone.service[352329]: [pid: 352329|app: 0|req: 617/1254] 10.222.0.42 () {56 vars in 1143 bytes} [Thu Jul 28 08:57:05 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:57:05.363971 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30878f73-94d8-47d2-acf7-b3ae73c07571 None admin] Authenticating user token {{(pid=352328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:57:05.513171 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30878f73-94d8-47d2-acf7-b3ae73c07571 None admin] Validating token access rules against request {{(pid=352328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:57:05.556545 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee156bd4-1b40-4d23-8160-93d6609b17dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:57:05.557699 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee156bd4-1b40-4d23-8160-93d6609b17dd None admin] REQUEST_METHOD: `GET` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:57:05.558172 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee156bd4-1b40-4d23-8160-93d6609b17dd None admin] SCRIPT_NAME: `/identity` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:57:05.558638 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee156bd4-1b40-4d23-8160-93d6609b17dd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:57:05.655361 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG dbcounter [-] [352328] Writing DB stats keystone:SELECT=100 {{(pid=352328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:57:05.677297 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee156bd4-1b40-4d23-8160-93d6609b17dd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:57:05.680118 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee156bd4-1b40-4d23-8160-93d6609b17dd None admin] RBAC: Authorization granted {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:57:05.826673 dv-cinder-851351-1-smb devstack@keystone.service[352328]: [pid: 352328|app: 0|req: 638/1255] 10.222.0.42 () {58 vars in 1282 bytes} [Thu Jul 28 08:57:05 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 463 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 28 08:57:05.833416 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31761d5c-79cf-47f3-b64f-0475e21a733b None admin] Authenticating user token {{(pid=352329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:57:05.973564 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31761d5c-79cf-47f3-b64f-0475e21a733b None admin] Validating token access rules against request {{(pid=352329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:57:05.988656 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG dbcounter [-] [352329] Writing DB stats keystone:SELECT=100 {{(pid=352329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:57:06.017271 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d06501-cd3b-43aa-af37-2ba9f53b1445 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:57:06.018208 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d06501-cd3b-43aa-af37-2ba9f53b1445 None admin] REQUEST_METHOD: `GET` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:57:06.018685 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d06501-cd3b-43aa-af37-2ba9f53b1445 None admin] SCRIPT_NAME: `/identity` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:57:06.019148 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d06501-cd3b-43aa-af37-2ba9f53b1445 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:57:06.035245 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30d06501-cd3b-43aa-af37-2ba9f53b1445 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:57:06.037536 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30d06501-cd3b-43aa-af37-2ba9f53b1445 None admin] RBAC: Authorization granted {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:57:06.057968 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application [None req-30d06501-cd3b-43aa-af37-2ba9f53b1445 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 08:57:06.057968 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:57:06.057968 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:57:06.057968 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:57:06.057968 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:57:06.057968 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:57:06.057968 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:57:06.057968 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:57:06.057968 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:57:06.057968 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:57:06.057968 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:57:06.057968 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:57:06.057968 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 08:57:06.057968 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 08:57:06.057968 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 08:57:06.060834 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 08:57:06.060834 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:57:06.060834 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:57:06.060834 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:57:06.060834 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:57:06.060834 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:57:06.060834 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:57:06.060834 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:57:06.060834 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application with Lock( Jul 28 08:57:06.060834 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:57:06.060834 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:57:06.060834 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:57:06.060834 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:57:06.060834 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:57:06.060834 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:57:06.060834 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:57:06.060834 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:57:06.063370 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 08:57:06.063370 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 08:57:06.063370 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 08:57:06.063370 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application Jul 28 08:57:06.063370 dv-cinder-851351-1-smb devstack@keystone.service[352329]: [pid: 352329|app: 0|req: 618/1256] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 08:57:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 08:57:06.067909 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee156bd4-1b40-4d23-8160-93d6609b17dd None admin] Authenticating user token {{(pid=352328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:57:06.196910 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG dbcounter [-] [352328] Writing DB stats keystone:SELECT=100 {{(pid=352328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:57:06.214502 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee156bd4-1b40-4d23-8160-93d6609b17dd None admin] Validating token access rules against request {{(pid=352328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:57:06.275234 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a762cbba-a5e2-4757-b736-61743358f07c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:57:06.275925 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a762cbba-a5e2-4757-b736-61743358f07c None admin] REQUEST_METHOD: `GET` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:57:06.276187 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a762cbba-a5e2-4757-b736-61743358f07c None admin] SCRIPT_NAME: `/identity` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:57:06.276532 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a762cbba-a5e2-4757-b736-61743358f07c None admin] PATH_INFO: `/v3/domains` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:57:06.277331 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a762cbba-a5e2-4757-b736-61743358f07c None admin] RBAC: Adding query filter params (name=Default) {{(pid=352328) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:57:06.277657 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a762cbba-a5e2-4757-b736-61743358f07c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:57:06.279202 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a762cbba-a5e2-4757-b736-61743358f07c None admin] RBAC: Authorization granted {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:57:06.298586 dv-cinder-851351-1-smb devstack@keystone.service[352328]: [pid: 352328|app: 0|req: 639/1257] 10.222.0.42 () {56 vars in 1109 bytes} [Thu Jul 28 08:57:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:57:06.304111 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d06501-cd3b-43aa-af37-2ba9f53b1445 None admin] Authenticating user token {{(pid=352329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:57:06.435268 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d06501-cd3b-43aa-af37-2ba9f53b1445 None admin] Validating token access rules against request {{(pid=352329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:57:06.492484 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e20ec6-4b18-4588-8192-c49e24524479 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:57:06.493273 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e20ec6-4b18-4588-8192-c49e24524479 None admin] REQUEST_METHOD: `GET` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:57:06.493659 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e20ec6-4b18-4588-8192-c49e24524479 None admin] SCRIPT_NAME: `/identity` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:57:06.494028 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e20ec6-4b18-4588-8192-c49e24524479 None admin] PATH_INFO: `/v3/projects/service` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:57:06.503590 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2e20ec6-4b18-4588-8192-c49e24524479 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:57:06.505491 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2e20ec6-4b18-4588-8192-c49e24524479 None admin] RBAC: Authorization granted {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:57:06.520397 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application [None req-b2e20ec6-4b18-4588-8192-c49e24524479 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 08:57:06.520397 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:57:06.520397 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:57:06.520397 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:57:06.520397 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:57:06.520397 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:57:06.520397 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:57:06.520397 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:57:06.520397 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:57:06.520397 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:57:06.520397 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:57:06.520397 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:57:06.520397 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 28 08:57:06.520397 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 28 08:57:06.520397 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 28 08:57:06.523177 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 28 08:57:06.523177 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:57:06.523177 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:57:06.523177 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:57:06.523177 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:57:06.523177 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:57:06.523177 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:57:06.523177 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:57:06.523177 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application with Lock( Jul 28 08:57:06.523177 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:57:06.523177 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:57:06.523177 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:57:06.523177 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:57:06.523177 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:57:06.523177 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:57:06.523177 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:57:06.523177 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:57:06.525969 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 28 08:57:06.525969 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 28 08:57:06.525969 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 28 08:57:06.525969 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 28 08:57:06.525969 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 28 08:57:06.525969 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 28 08:57:06.525969 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 08:57:06.525969 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application Jul 28 08:57:06.525969 dv-cinder-851351-1-smb devstack@keystone.service[352329]: [pid: 352329|app: 0|req: 619/1258] 10.222.0.42 () {56 vars in 1111 bytes} [Thu Jul 28 08:57:06 2022] GET /identity/v3/projects/service => generated 88 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:57:06.529347 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a762cbba-a5e2-4757-b736-61743358f07c None admin] Authenticating user token {{(pid=352328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:57:06.705421 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a762cbba-a5e2-4757-b736-61743358f07c None admin] Validating token access rules against request {{(pid=352328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:57:06.757946 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dbab7f4-36b7-4a3b-a732-eccae9980961 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:57:06.758995 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbab7f4-36b7-4a3b-a732-eccae9980961 None admin] REQUEST_METHOD: `GET` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:57:06.759414 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbab7f4-36b7-4a3b-a732-eccae9980961 None admin] SCRIPT_NAME: `/identity` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:57:06.759781 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbab7f4-36b7-4a3b-a732-eccae9980961 None admin] PATH_INFO: `/v3/projects` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:57:06.760766 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dbab7f4-36b7-4a3b-a732-eccae9980961 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=352328) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:57:06.761198 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dbab7f4-36b7-4a3b-a732-eccae9980961 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:57:06.762975 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dbab7f4-36b7-4a3b-a732-eccae9980961 None admin] RBAC: Authorization granted {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:57:06.781480 dv-cinder-851351-1-smb devstack@keystone.service[352328]: [pid: 352328|app: 0|req: 640/1259] 10.222.0.42 () {56 vars in 1148 bytes} [Thu Jul 28 08:57:06 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:57:06.790787 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e20ec6-4b18-4588-8192-c49e24524479 None admin] Authenticating user token {{(pid=352329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:57:06.828009 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG dbcounter [-] [352329] Writing DB stats keystone:SELECT=100 {{(pid=352329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:57:06.932245 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e20ec6-4b18-4588-8192-c49e24524479 None admin] Validating token access rules against request {{(pid=352329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:57:06.987957 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3200cd6-a5c6-490a-b12a-a8575847a349 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:57:06.988841 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3200cd6-a5c6-490a-b12a-a8575847a349 None admin] REQUEST_METHOD: `GET` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:57:06.989172 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3200cd6-a5c6-490a-b12a-a8575847a349 None admin] SCRIPT_NAME: `/identity` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:57:06.989532 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3200cd6-a5c6-490a-b12a-a8575847a349 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:57:06.990501 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3200cd6-a5c6-490a-b12a-a8575847a349 None admin] RBAC: Adding query filter params (role.id=280023171b4a45efb67c036ff237bb3c, scope.project.id=9cfa053c839a4fedacde7163d907e2a4, user.id=9b6ed94c1df745c3bc7adf2769fc5119) {{(pid=352329) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:57:06.990980 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3200cd6-a5c6-490a-b12a-a8575847a349 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:57:06.992699 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3200cd6-a5c6-490a-b12a-a8575847a349 None admin] RBAC: Authorization granted {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:57:07.002155 dv-cinder-851351-1-smb devstack@keystone.service[352329]: [pid: 352329|app: 0|req: 620/1260] 10.222.0.42 () {56 vars in 1374 bytes} [Thu Jul 28 08:57:06 2022] GET /identity/v3/role_assignments?user.id=9b6ed94c1df745c3bc7adf2769fc5119&scope.project.id=9cfa053c839a4fedacde7163d907e2a4&role.id=280023171b4a45efb67c036ff237bb3c => generated 259 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:57:09.253938 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0490094-3abd-4a6e-b41a-81d0737ea8b0 None None] REQUEST_METHOD: `GET` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:57:09.254563 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0490094-3abd-4a6e-b41a-81d0737ea8b0 None None] SCRIPT_NAME: `/identity` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:57:09.255091 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0490094-3abd-4a6e-b41a-81d0737ea8b0 None None] PATH_INFO: `/` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:57:09.257589 dv-cinder-851351-1-smb devstack@keystone.service[352328]: [pid: 352328|app: 0|req: 641/1261] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 08:57:09 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 08:57:09.282223 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6048a6b6-2e90-4282-ad95-27cf0ccc57a6 None None] REQUEST_METHOD: `POST` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:57:09.283042 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6048a6b6-2e90-4282-ad95-27cf0ccc57a6 None None] SCRIPT_NAME: `/identity` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:57:09.283193 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6048a6b6-2e90-4282-ad95-27cf0ccc57a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:57:09.310667 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.auth.core [None req-6048a6b6-2e90-4282-ad95-27cf0ccc57a6 None None] MFA Rules not processed for user `d18c063b2377412485965357671e5506`. Rule list: `[]` (Enabled: `True`). {{(pid=352329) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 08:57:09.311960 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.fernet_utils [None req-6048a6b6-2e90-4282-ad95-27cf0ccc57a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=352329) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:57:09.417321 dv-cinder-851351-1-smb devstack@keystone.service[352329]: [pid: 352329|app: 0|req: 621/1262] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 08:57:09 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 08:57:09.457138 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0490094-3abd-4a6e-b41a-81d0737ea8b0 None None] Authenticating user token {{(pid=352328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:57:09.470676 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG dbcounter [-] [352328] Writing DB stats keystone:SELECT=100 {{(pid=352328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:57:09.625210 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0490094-3abd-4a6e-b41a-81d0737ea8b0 None None] Validating token access rules against request {{(pid=352328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:57:09.673101 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b8ae5f2-04f7-4fbe-abb0-1098c2a933f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:57:09.673869 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8ae5f2-04f7-4fbe-abb0-1098c2a933f9 None admin] REQUEST_METHOD: `GET` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:57:09.674158 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8ae5f2-04f7-4fbe-abb0-1098c2a933f9 None admin] SCRIPT_NAME: `/identity` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:57:09.674437 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8ae5f2-04f7-4fbe-abb0-1098c2a933f9 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:57:09.690644 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b8ae5f2-04f7-4fbe-abb0-1098c2a933f9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 08:57:09.698496 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application [None req-8b8ae5f2-04f7-4fbe-abb0-1098c2a933f9 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 08:57:09.698496 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:57:09.698496 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:57:09.698496 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:57:09.698496 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:57:09.698496 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:57:09.698496 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:57:09.698496 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:57:09.698496 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:57:09.698496 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:57:09.698496 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:57:09.698496 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:57:09.698496 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 08:57:09.698496 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 08:57:09.698496 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 08:57:09.698496 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 08:57:09.699966 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 08:57:09.699966 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 08:57:09.699966 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 08:57:09.699966 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 08:57:09.699966 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:57:09.699966 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:57:09.699966 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:57:09.699966 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:57:09.699966 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:57:09.699966 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:57:09.699966 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:57:09.699966 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application with Lock( Jul 28 08:57:09.699966 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:57:09.699966 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:57:09.699966 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:57:09.699966 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:57:09.701096 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:57:09.701096 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:57:09.701096 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:57:09.701096 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:57:09.701096 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 08:57:09.701096 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 08:57:09.701096 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 08:57:09.701096 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 08:57:09.701096 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 08:57:09.701096 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 08:57:09.701096 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 08:57:09.701096 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application Jul 28 08:57:09.701096 dv-cinder-851351-1-smb devstack@keystone.service[352328]: [pid: 352328|app: 0|req: 642/1263] 10.222.0.42 () {56 vars in 1096 bytes} [Thu Jul 28 08:57:09 2022] GET /identity/v3/roles/admin => generated 83 bytes in 244 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:57:09.708152 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6048a6b6-2e90-4282-ad95-27cf0ccc57a6 None None] Authenticating user token {{(pid=352329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:57:09.737100 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG dbcounter [-] [352329] Writing DB stats keystone:SELECT=100 {{(pid=352329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:57:09.859605 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6048a6b6-2e90-4282-ad95-27cf0ccc57a6 None None] Validating token access rules against request {{(pid=352329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:57:09.903973 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da94bd18-43e0-4186-81f7-f9ed7f61170d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:57:09.904540 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da94bd18-43e0-4186-81f7-f9ed7f61170d None admin] REQUEST_METHOD: `GET` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:57:09.904860 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da94bd18-43e0-4186-81f7-f9ed7f61170d None admin] SCRIPT_NAME: `/identity` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:57:09.905143 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da94bd18-43e0-4186-81f7-f9ed7f61170d None admin] PATH_INFO: `/v3/roles` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:57:09.905879 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da94bd18-43e0-4186-81f7-f9ed7f61170d None admin] RBAC: Adding query filter params (name=admin) {{(pid=352329) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:57:09.906185 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da94bd18-43e0-4186-81f7-f9ed7f61170d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:57:09.907607 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da94bd18-43e0-4186-81f7-f9ed7f61170d None admin] RBAC: Authorization granted {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:57:09.917368 dv-cinder-851351-1-smb devstack@keystone.service[352329]: [pid: 352329|app: 0|req: 622/1264] 10.222.0.42 () {56 vars in 1099 bytes} [Thu Jul 28 08:57:09 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:57:09.923406 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b8ae5f2-04f7-4fbe-abb0-1098c2a933f9 None admin] Authenticating user token {{(pid=352328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:57:10.013736 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG dbcounter [-] [352328] Writing DB stats keystone:SELECT=100 {{(pid=352328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:57:10.051281 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b8ae5f2-04f7-4fbe-abb0-1098c2a933f9 None admin] Validating token access rules against request {{(pid=352328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:57:10.093129 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7e2f8c-6881-461a-81d1-c297a409e060 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:57:10.094082 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7e2f8c-6881-461a-81d1-c297a409e060 None admin] REQUEST_METHOD: `GET` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:57:10.094557 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7e2f8c-6881-461a-81d1-c297a409e060 None admin] SCRIPT_NAME: `/identity` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:57:10.095037 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7e2f8c-6881-461a-81d1-c297a409e060 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:57:10.110051 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d7e2f8c-6881-461a-81d1-c297a409e060 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:57:10.112479 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d7e2f8c-6881-461a-81d1-c297a409e060 None admin] RBAC: Authorization granted {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:57:10.134158 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application [None req-1d7e2f8c-6881-461a-81d1-c297a409e060 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 08:57:10.134158 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:57:10.134158 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:57:10.134158 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:57:10.134158 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:57:10.134158 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:57:10.134158 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:57:10.134158 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:57:10.134158 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:57:10.134158 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:57:10.134158 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:57:10.134158 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:57:10.134158 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 08:57:10.134158 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 08:57:10.134158 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 08:57:10.136599 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 08:57:10.136599 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:57:10.136599 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:57:10.136599 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:57:10.136599 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:57:10.136599 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:57:10.136599 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:57:10.136599 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:57:10.136599 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application with Lock( Jul 28 08:57:10.136599 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:57:10.136599 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:57:10.136599 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:57:10.136599 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:57:10.136599 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:57:10.136599 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:57:10.136599 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:57:10.136599 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:57:10.139110 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 08:57:10.139110 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 08:57:10.139110 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 08:57:10.139110 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application Jul 28 08:57:10.139110 dv-cinder-851351-1-smb devstack@keystone.service[352328]: [pid: 352328|app: 0|req: 643/1265] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 08:57:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:57:10.144929 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da94bd18-43e0-4186-81f7-f9ed7f61170d None admin] Authenticating user token {{(pid=352329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:57:10.249513 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG dbcounter [-] [352329] Writing DB stats keystone:SELECT=100 {{(pid=352329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:57:10.270963 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da94bd18-43e0-4186-81f7-f9ed7f61170d None admin] Validating token access rules against request {{(pid=352329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:57:10.312404 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d5217d2-ab7d-4030-8f88-8677f6d287f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:57:10.313593 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5217d2-ab7d-4030-8f88-8677f6d287f4 None admin] REQUEST_METHOD: `GET` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:57:10.313593 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5217d2-ab7d-4030-8f88-8677f6d287f4 None admin] SCRIPT_NAME: `/identity` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:57:10.313593 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5217d2-ab7d-4030-8f88-8677f6d287f4 None admin] PATH_INFO: `/v3/domains` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:57:10.314320 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d5217d2-ab7d-4030-8f88-8677f6d287f4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=352329) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:57:10.314623 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d5217d2-ab7d-4030-8f88-8677f6d287f4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:57:10.316037 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d5217d2-ab7d-4030-8f88-8677f6d287f4 None admin] RBAC: Authorization granted {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:57:10.331793 dv-cinder-851351-1-smb devstack@keystone.service[352329]: [pid: 352329|app: 0|req: 623/1266] 10.222.0.42 () {56 vars in 1109 bytes} [Thu Jul 28 08:57:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:57:10.338536 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7e2f8c-6881-461a-81d1-c297a409e060 None admin] Authenticating user token {{(pid=352328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:57:10.467930 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7e2f8c-6881-461a-81d1-c297a409e060 None admin] Validating token access rules against request {{(pid=352328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:57:10.490887 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG dbcounter [-] [352328] Writing DB stats keystone:SELECT=100 {{(pid=352328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:57:10.510747 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56717e30-7bb2-40d6-939e-0338427e5ac7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:57:10.511377 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56717e30-7bb2-40d6-939e-0338427e5ac7 None admin] REQUEST_METHOD: `GET` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:57:10.511855 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56717e30-7bb2-40d6-939e-0338427e5ac7 None admin] SCRIPT_NAME: `/identity` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:57:10.512145 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56717e30-7bb2-40d6-939e-0338427e5ac7 None admin] PATH_INFO: `/v3/users/placement` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:57:10.521194 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56717e30-7bb2-40d6-939e-0338427e5ac7 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:57:10.522941 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56717e30-7bb2-40d6-939e-0338427e5ac7 None admin] RBAC: Authorization granted {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:57:10.538600 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application [None req-56717e30-7bb2-40d6-939e-0338427e5ac7 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 28 08:57:10.538600 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:57:10.538600 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:57:10.538600 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:57:10.538600 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:57:10.538600 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:57:10.538600 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:57:10.538600 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:57:10.538600 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:57:10.538600 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:57:10.538600 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:57:10.538600 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:57:10.538600 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 28 08:57:10.538600 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 28 08:57:10.538600 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 28 08:57:10.538600 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 28 08:57:10.539990 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:57:10.539990 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:57:10.539990 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 28 08:57:10.539990 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 08:57:10.539990 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 28 08:57:10.539990 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 08:57:10.539990 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:57:10.539990 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:57:10.539990 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:57:10.539990 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:57:10.539990 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:57:10.539990 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application with Lock( Jul 28 08:57:10.539990 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:57:10.539990 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:57:10.539990 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:57:10.539990 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:57:10.539990 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:57:10.539990 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:57:10.541588 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:57:10.541588 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:57:10.541588 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 28 08:57:10.541588 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 28 08:57:10.541588 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 28 08:57:10.541588 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 28 08:57:10.541588 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 28 08:57:10.541588 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 28 08:57:10.541588 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 28 08:57:10.541588 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application Jul 28 08:57:10.541588 dv-cinder-851351-1-smb devstack@keystone.service[352328]: [pid: 352328|app: 0|req: 644/1267] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 08:57:10 2022] GET /identity/v3/users/placement => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 08:57:10.546416 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d5217d2-ab7d-4030-8f88-8677f6d287f4 None admin] Authenticating user token {{(pid=352329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:57:10.691179 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d5217d2-ab7d-4030-8f88-8677f6d287f4 None admin] Validating token access rules against request {{(pid=352329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:57:10.732516 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f012016b-34ca-4c15-87d0-cfe217f18c9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:57:10.733251 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f012016b-34ca-4c15-87d0-cfe217f18c9d None admin] REQUEST_METHOD: `GET` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:57:10.733579 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f012016b-34ca-4c15-87d0-cfe217f18c9d None admin] SCRIPT_NAME: `/identity` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:57:10.733898 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f012016b-34ca-4c15-87d0-cfe217f18c9d None admin] PATH_INFO: `/v3/users` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:57:10.734969 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f012016b-34ca-4c15-87d0-cfe217f18c9d None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=352329) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:57:10.735279 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f012016b-34ca-4c15-87d0-cfe217f18c9d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:57:10.736805 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f012016b-34ca-4c15-87d0-cfe217f18c9d None admin] RBAC: Authorization granted {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:57:10.749366 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG dbcounter [-] [352329] Writing DB stats keystone:SELECT=100 {{(pid=352329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:57:10.760917 dv-cinder-851351-1-smb devstack@keystone.service[352329]: [pid: 352329|app: 0|req: 624/1268] 10.222.0.42 () {56 vars in 1143 bytes} [Thu Jul 28 08:57:10 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:57:10.767369 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56717e30-7bb2-40d6-939e-0338427e5ac7 None admin] Authenticating user token {{(pid=352328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:57:10.912291 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56717e30-7bb2-40d6-939e-0338427e5ac7 None admin] Validating token access rules against request {{(pid=352328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:57:10.965763 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f205c33a-8c53-4dcb-a82a-2efe995b2d03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:57:10.966737 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f205c33a-8c53-4dcb-a82a-2efe995b2d03 None admin] REQUEST_METHOD: `GET` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:57:10.967157 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f205c33a-8c53-4dcb-a82a-2efe995b2d03 None admin] SCRIPT_NAME: `/identity` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:57:10.967541 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f205c33a-8c53-4dcb-a82a-2efe995b2d03 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:57:10.984534 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f205c33a-8c53-4dcb-a82a-2efe995b2d03 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:57:10.986859 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f205c33a-8c53-4dcb-a82a-2efe995b2d03 None admin] RBAC: Authorization granted {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:57:11.006438 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application [None req-f205c33a-8c53-4dcb-a82a-2efe995b2d03 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 08:57:11.006438 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:57:11.006438 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:57:11.006438 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:57:11.006438 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:57:11.006438 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:57:11.006438 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:57:11.006438 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:57:11.006438 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:57:11.006438 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:57:11.006438 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:57:11.006438 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:57:11.006438 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 08:57:11.006438 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 08:57:11.006438 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 08:57:11.012746 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 08:57:11.012746 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:57:11.012746 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:57:11.012746 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:57:11.012746 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:57:11.012746 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:57:11.012746 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:57:11.012746 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:57:11.012746 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application with Lock( Jul 28 08:57:11.012746 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:57:11.012746 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:57:11.012746 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:57:11.012746 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:57:11.012746 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:57:11.012746 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:57:11.012746 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:57:11.012746 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:57:11.013878 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 08:57:11.013878 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 08:57:11.013878 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 08:57:11.013878 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application Jul 28 08:57:11.013878 dv-cinder-851351-1-smb devstack@keystone.service[352328]: [pid: 352328|app: 0|req: 645/1269] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 08:57:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:57:11.014236 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f012016b-34ca-4c15-87d0-cfe217f18c9d None admin] Authenticating user token {{(pid=352329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:57:11.131723 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f012016b-34ca-4c15-87d0-cfe217f18c9d None admin] Validating token access rules against request {{(pid=352329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:57:11.173091 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f222d0b0-a84e-4102-9762-73a7083d0fcc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:57:11.173756 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f222d0b0-a84e-4102-9762-73a7083d0fcc None admin] REQUEST_METHOD: `GET` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:57:11.174039 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f222d0b0-a84e-4102-9762-73a7083d0fcc None admin] SCRIPT_NAME: `/identity` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:57:11.174319 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f222d0b0-a84e-4102-9762-73a7083d0fcc None admin] PATH_INFO: `/v3/domains` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:57:11.175047 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f222d0b0-a84e-4102-9762-73a7083d0fcc None admin] RBAC: Adding query filter params (name=Default) {{(pid=352329) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:57:11.175354 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f222d0b0-a84e-4102-9762-73a7083d0fcc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:57:11.176812 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f222d0b0-a84e-4102-9762-73a7083d0fcc None admin] RBAC: Authorization granted {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:57:11.190048 dv-cinder-851351-1-smb devstack@keystone.service[352329]: [pid: 352329|app: 0|req: 625/1270] 10.222.0.42 () {56 vars in 1109 bytes} [Thu Jul 28 08:57:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:57:11.196343 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f205c33a-8c53-4dcb-a82a-2efe995b2d03 None admin] Authenticating user token {{(pid=352328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:57:11.234124 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG dbcounter [-] [352328] Writing DB stats keystone:SELECT=100 {{(pid=352328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:57:11.314357 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f205c33a-8c53-4dcb-a82a-2efe995b2d03 None admin] Validating token access rules against request {{(pid=352328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:57:11.353673 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f62bc8-8c80-49a2-a6d6-a0195f22ad72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:57:11.354505 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f62bc8-8c80-49a2-a6d6-a0195f22ad72 None admin] REQUEST_METHOD: `GET` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:57:11.354675 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f62bc8-8c80-49a2-a6d6-a0195f22ad72 None admin] SCRIPT_NAME: `/identity` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:57:11.354874 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f62bc8-8c80-49a2-a6d6-a0195f22ad72 None admin] PATH_INFO: `/v3/projects/service` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:57:11.363071 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f62bc8-8c80-49a2-a6d6-a0195f22ad72 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:57:11.364783 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f62bc8-8c80-49a2-a6d6-a0195f22ad72 None admin] RBAC: Authorization granted {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:57:11.377799 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application [None req-b4f62bc8-8c80-49a2-a6d6-a0195f22ad72 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 08:57:11.377799 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:57:11.377799 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:57:11.377799 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:57:11.377799 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:57:11.377799 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:57:11.377799 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:57:11.377799 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:57:11.377799 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:57:11.377799 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:57:11.377799 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:57:11.377799 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:57:11.377799 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 28 08:57:11.377799 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 28 08:57:11.377799 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 28 08:57:11.385465 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 28 08:57:11.385465 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:57:11.385465 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:57:11.385465 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:57:11.385465 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:57:11.385465 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:57:11.385465 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:57:11.385465 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:57:11.385465 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application with Lock( Jul 28 08:57:11.385465 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:57:11.385465 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:57:11.385465 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:57:11.385465 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:57:11.385465 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:57:11.385465 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:57:11.385465 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:57:11.385465 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:57:11.387925 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 28 08:57:11.387925 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 28 08:57:11.387925 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 28 08:57:11.387925 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 28 08:57:11.387925 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 28 08:57:11.387925 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 28 08:57:11.387925 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 08:57:11.387925 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application Jul 28 08:57:11.387925 dv-cinder-851351-1-smb devstack@keystone.service[352328]: [pid: 352328|app: 0|req: 646/1271] 10.222.0.42 () {56 vars in 1111 bytes} [Thu Jul 28 08:57:11 2022] GET /identity/v3/projects/service => generated 88 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:57:11.389112 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f222d0b0-a84e-4102-9762-73a7083d0fcc None admin] Authenticating user token {{(pid=352329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:57:11.459647 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG dbcounter [-] [352329] Writing DB stats keystone:SELECT=100 {{(pid=352329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:57:11.510628 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f222d0b0-a84e-4102-9762-73a7083d0fcc None admin] Validating token access rules against request {{(pid=352329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:57:11.549121 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4d4b94-a2f0-43e4-956c-ccb7922ea21c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:57:11.550215 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4d4b94-a2f0-43e4-956c-ccb7922ea21c None admin] REQUEST_METHOD: `GET` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:57:11.550713 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4d4b94-a2f0-43e4-956c-ccb7922ea21c None admin] SCRIPT_NAME: `/identity` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:57:11.551206 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4d4b94-a2f0-43e4-956c-ccb7922ea21c None admin] PATH_INFO: `/v3/projects` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:57:11.552460 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a4d4b94-a2f0-43e4-956c-ccb7922ea21c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=352329) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:57:11.553089 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a4d4b94-a2f0-43e4-956c-ccb7922ea21c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:57:11.555122 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a4d4b94-a2f0-43e4-956c-ccb7922ea21c None admin] RBAC: Authorization granted {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:57:11.572321 dv-cinder-851351-1-smb devstack@keystone.service[352329]: [pid: 352329|app: 0|req: 626/1272] 10.222.0.42 () {56 vars in 1148 bytes} [Thu Jul 28 08:57:11 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 08:57:11.581006 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f62bc8-8c80-49a2-a6d6-a0195f22ad72 None admin] Authenticating user token {{(pid=352328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:57:11.746559 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG dbcounter [-] [352328] Writing DB stats keystone:SELECT=100 {{(pid=352328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:57:11.759724 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f62bc8-8c80-49a2-a6d6-a0195f22ad72 None admin] Validating token access rules against request {{(pid=352328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:57:11.800572 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f80e7b28-8b0f-4370-8011-aa4dc97455a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:57:11.801313 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80e7b28-8b0f-4370-8011-aa4dc97455a7 None admin] REQUEST_METHOD: `PUT` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:57:11.801610 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80e7b28-8b0f-4370-8011-aa4dc97455a7 None admin] SCRIPT_NAME: `/identity` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:57:11.801894 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80e7b28-8b0f-4370-8011-aa4dc97455a7 None admin] PATH_INFO: `/v3/projects/9cfa053c839a4fedacde7163d907e2a4/users/9b6ed94c1df745c3bc7adf2769fc5119/roles/280023171b4a45efb67c036ff237bb3c` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:57:11.804162 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f80e7b28-8b0f-4370-8011-aa4dc97455a7 None admin] RBAC: Authorizing `identity:create_grant(project_id=9cfa053c839a4fedacde7163d907e2a4, user_id=9b6ed94c1df745c3bc7adf2769fc5119, role_id=280023171b4a45efb67c036ff237bb3c)` {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:57:11.805684 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f80e7b28-8b0f-4370-8011-aa4dc97455a7 None admin] RBAC: Authorization granted {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:57:11.822169 dv-cinder-851351-1-smb devstack@keystone.service[352328]: [pid: 352328|app: 0|req: 647/1273] 10.222.0.42 () {58 vars in 1439 bytes} [Thu Jul 28 08:57:11 2022] PUT /identity/v3/projects/9cfa053c839a4fedacde7163d907e2a4/users/9b6ed94c1df745c3bc7adf2769fc5119/roles/280023171b4a45efb67c036ff237bb3c => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 08:57:13.860017 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6204711e-f7a0-497e-9c9c-ea3b292d7ca3 None None] REQUEST_METHOD: `GET` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:57:13.860730 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6204711e-f7a0-497e-9c9c-ea3b292d7ca3 None None] SCRIPT_NAME: `/identity` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:57:13.860730 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6204711e-f7a0-497e-9c9c-ea3b292d7ca3 None None] PATH_INFO: `/` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:57:13.861992 dv-cinder-851351-1-smb devstack@keystone.service[352329]: [pid: 352329|app: 0|req: 627/1274] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 08:57:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 28 08:57:13.867955 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700234a7-a12a-413e-8e23-5f6826f2693f None None] REQUEST_METHOD: `POST` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:57:13.868521 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700234a7-a12a-413e-8e23-5f6826f2693f None None] SCRIPT_NAME: `/identity` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:57:13.868521 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700234a7-a12a-413e-8e23-5f6826f2693f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:57:13.890551 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.auth.core [None req-700234a7-a12a-413e-8e23-5f6826f2693f None None] MFA Rules not processed for user `d18c063b2377412485965357671e5506`. Rule list: `[]` (Enabled: `True`). {{(pid=352328) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 08:57:13.891816 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.fernet_utils [None req-700234a7-a12a-413e-8e23-5f6826f2693f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=352328) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:57:13.975155 dv-cinder-851351-1-smb devstack@keystone.service[352328]: [pid: 352328|app: 0|req: 648/1275] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 08:57:13 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 08:57:13.999268 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6204711e-f7a0-497e-9c9c-ea3b292d7ca3 None None] Authenticating user token {{(pid=352329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:57:14.114686 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6204711e-f7a0-497e-9c9c-ea3b292d7ca3 None None] Validating token access rules against request {{(pid=352329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:57:14.136211 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG dbcounter [-] [352329] Writing DB stats keystone:SELECT=100 {{(pid=352329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:57:14.154851 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dbe0967-5b05-4b23-8125-ad5606016525 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:57:14.155508 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dbe0967-5b05-4b23-8125-ad5606016525 None admin] REQUEST_METHOD: `GET` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:57:14.155789 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dbe0967-5b05-4b23-8125-ad5606016525 None admin] SCRIPT_NAME: `/identity` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:57:14.156063 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dbe0967-5b05-4b23-8125-ad5606016525 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:57:14.167214 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dbe0967-5b05-4b23-8125-ad5606016525 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 08:57:14.173194 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application [None req-3dbe0967-5b05-4b23-8125-ad5606016525 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 08:57:14.173194 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:57:14.173194 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:57:14.173194 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:57:14.173194 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:57:14.173194 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:57:14.173194 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:57:14.173194 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:57:14.173194 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:57:14.173194 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:57:14.173194 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:57:14.173194 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:57:14.173194 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 08:57:14.173194 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 08:57:14.173194 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 08:57:14.173194 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 08:57:14.175260 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 08:57:14.175260 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 08:57:14.175260 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 08:57:14.175260 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 08:57:14.175260 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:57:14.175260 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:57:14.175260 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:57:14.175260 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:57:14.175260 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:57:14.175260 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:57:14.175260 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:57:14.175260 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application with Lock( Jul 28 08:57:14.175260 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:57:14.175260 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:57:14.175260 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:57:14.175260 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:57:14.177621 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:57:14.177621 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:57:14.177621 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:57:14.177621 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:57:14.177621 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 08:57:14.177621 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 08:57:14.177621 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 08:57:14.177621 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 08:57:14.177621 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 08:57:14.177621 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 08:57:14.177621 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 08:57:14.177621 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application Jul 28 08:57:14.177621 dv-cinder-851351-1-smb devstack@keystone.service[352329]: [pid: 352329|app: 0|req: 628/1276] 10.222.0.42 () {56 vars in 1096 bytes} [Thu Jul 28 08:57:13 2022] GET /identity/v3/roles/admin => generated 83 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:57:14.183873 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700234a7-a12a-413e-8e23-5f6826f2693f None None] Authenticating user token {{(pid=352328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:57:14.276501 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG dbcounter [-] [352328] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=352328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:57:14.297282 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700234a7-a12a-413e-8e23-5f6826f2693f None None] Validating token access rules against request {{(pid=352328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:57:14.333087 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3915c651-58e4-4385-926f-2ac0be1deade None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:57:14.333726 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3915c651-58e4-4385-926f-2ac0be1deade None admin] REQUEST_METHOD: `GET` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:57:14.334010 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3915c651-58e4-4385-926f-2ac0be1deade None admin] SCRIPT_NAME: `/identity` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:57:14.334290 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3915c651-58e4-4385-926f-2ac0be1deade None admin] PATH_INFO: `/v3/roles` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:57:14.335041 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3915c651-58e4-4385-926f-2ac0be1deade None admin] RBAC: Adding query filter params (name=admin) {{(pid=352328) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:57:14.335349 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3915c651-58e4-4385-926f-2ac0be1deade None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:57:14.336794 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3915c651-58e4-4385-926f-2ac0be1deade None admin] RBAC: Authorization granted {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:57:14.345770 dv-cinder-851351-1-smb devstack@keystone.service[352328]: [pid: 352328|app: 0|req: 649/1277] 10.222.0.42 () {56 vars in 1099 bytes} [Thu Jul 28 08:57:14 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:57:14.351833 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dbe0967-5b05-4b23-8125-ad5606016525 None admin] Authenticating user token {{(pid=352329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:57:14.462832 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dbe0967-5b05-4b23-8125-ad5606016525 None admin] Validating token access rules against request {{(pid=352329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:57:14.497730 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d526d3cf-7cf4-4386-a3c6-e8f9135a8ac1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:57:14.498386 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d526d3cf-7cf4-4386-a3c6-e8f9135a8ac1 None admin] REQUEST_METHOD: `GET` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:57:14.498665 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d526d3cf-7cf4-4386-a3c6-e8f9135a8ac1 None admin] SCRIPT_NAME: `/identity` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:57:14.498937 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d526d3cf-7cf4-4386-a3c6-e8f9135a8ac1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:57:14.510198 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d526d3cf-7cf4-4386-a3c6-e8f9135a8ac1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:57:14.511735 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d526d3cf-7cf4-4386-a3c6-e8f9135a8ac1 None admin] RBAC: Authorization granted {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:57:14.526689 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application [None req-d526d3cf-7cf4-4386-a3c6-e8f9135a8ac1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 08:57:14.526689 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:57:14.526689 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:57:14.526689 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:57:14.526689 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:57:14.526689 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:57:14.526689 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:57:14.526689 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:57:14.526689 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:57:14.526689 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:57:14.526689 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:57:14.526689 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:57:14.526689 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 08:57:14.526689 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 08:57:14.526689 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 08:57:14.528729 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 08:57:14.528729 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:57:14.528729 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:57:14.528729 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:57:14.528729 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:57:14.528729 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:57:14.528729 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:57:14.528729 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:57:14.528729 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application with Lock( Jul 28 08:57:14.528729 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:57:14.528729 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:57:14.528729 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:57:14.528729 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:57:14.528729 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:57:14.528729 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:57:14.528729 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:57:14.528729 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:57:14.530717 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 08:57:14.530717 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 08:57:14.530717 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 08:57:14.530717 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application Jul 28 08:57:14.530717 dv-cinder-851351-1-smb devstack@keystone.service[352329]: [pid: 352329|app: 0|req: 629/1278] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 08:57:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:57:14.534003 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3915c651-58e4-4385-926f-2ac0be1deade None admin] Authenticating user token {{(pid=352328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:57:14.663528 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3915c651-58e4-4385-926f-2ac0be1deade None admin] Validating token access rules against request {{(pid=352328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:57:14.705161 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe8ba8da-8267-495f-aa9c-3915a0a62392 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:57:14.705822 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8ba8da-8267-495f-aa9c-3915a0a62392 None admin] REQUEST_METHOD: `GET` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:57:14.706112 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8ba8da-8267-495f-aa9c-3915a0a62392 None admin] SCRIPT_NAME: `/identity` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:57:14.706389 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8ba8da-8267-495f-aa9c-3915a0a62392 None admin] PATH_INFO: `/v3/domains` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:57:14.707124 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe8ba8da-8267-495f-aa9c-3915a0a62392 None admin] RBAC: Adding query filter params (name=Default) {{(pid=352328) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:57:14.707436 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe8ba8da-8267-495f-aa9c-3915a0a62392 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:57:14.708900 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe8ba8da-8267-495f-aa9c-3915a0a62392 None admin] RBAC: Authorization granted {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:57:14.723164 dv-cinder-851351-1-smb devstack@keystone.service[352328]: [pid: 352328|app: 0|req: 650/1279] 10.222.0.42 () {56 vars in 1109 bytes} [Thu Jul 28 08:57:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:57:14.729728 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d526d3cf-7cf4-4386-a3c6-e8f9135a8ac1 None admin] Authenticating user token {{(pid=352329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:57:14.768859 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG dbcounter [-] [352329] Writing DB stats keystone:SELECT=100 {{(pid=352329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:57:14.852412 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d526d3cf-7cf4-4386-a3c6-e8f9135a8ac1 None admin] Validating token access rules against request {{(pid=352329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:57:14.889369 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e09cef95-1395-44a4-a027-f5b0a93b9e9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:57:14.890134 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09cef95-1395-44a4-a027-f5b0a93b9e9a None admin] REQUEST_METHOD: `GET` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:57:14.890293 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09cef95-1395-44a4-a027-f5b0a93b9e9a None admin] SCRIPT_NAME: `/identity` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:57:14.890573 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09cef95-1395-44a4-a027-f5b0a93b9e9a None admin] PATH_INFO: `/v3/users/placement` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:57:14.899431 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e09cef95-1395-44a4-a027-f5b0a93b9e9a None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:57:14.901241 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e09cef95-1395-44a4-a027-f5b0a93b9e9a None admin] RBAC: Authorization granted {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:57:14.915209 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application [None req-e09cef95-1395-44a4-a027-f5b0a93b9e9a None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 28 08:57:14.915209 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:57:14.915209 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:57:14.915209 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:57:14.915209 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:57:14.915209 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:57:14.915209 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:57:14.915209 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:57:14.915209 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:57:14.915209 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:57:14.915209 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:57:14.915209 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:57:14.915209 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 28 08:57:14.915209 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 28 08:57:14.915209 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 28 08:57:14.915209 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 28 08:57:14.916880 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:57:14.916880 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:57:14.916880 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 28 08:57:14.916880 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 08:57:14.916880 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 28 08:57:14.916880 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 08:57:14.916880 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:57:14.916880 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:57:14.916880 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:57:14.916880 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:57:14.916880 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:57:14.916880 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application with Lock( Jul 28 08:57:14.916880 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:57:14.916880 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:57:14.916880 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:57:14.916880 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:57:14.916880 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:57:14.916880 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:57:14.918404 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:57:14.918404 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:57:14.918404 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 28 08:57:14.918404 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 28 08:57:14.918404 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 28 08:57:14.918404 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 28 08:57:14.918404 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 28 08:57:14.918404 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 28 08:57:14.918404 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 28 08:57:14.918404 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application Jul 28 08:57:14.918404 dv-cinder-851351-1-smb devstack@keystone.service[352329]: [pid: 352329|app: 0|req: 630/1280] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 08:57:14 2022] GET /identity/v3/users/placement => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:57:14.922661 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe8ba8da-8267-495f-aa9c-3915a0a62392 None admin] Authenticating user token {{(pid=352328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:57:14.926757 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG dbcounter [-] [352328] Writing DB stats keystone:SELECT=100 {{(pid=352328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:57:15.034014 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe8ba8da-8267-495f-aa9c-3915a0a62392 None admin] Validating token access rules against request {{(pid=352328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:57:15.073147 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e9bfa2-6b06-4904-a1ae-f2e1e3cbf3c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:57:15.073790 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e9bfa2-6b06-4904-a1ae-f2e1e3cbf3c1 None admin] REQUEST_METHOD: `GET` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:57:15.074071 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e9bfa2-6b06-4904-a1ae-f2e1e3cbf3c1 None admin] SCRIPT_NAME: `/identity` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:57:15.074348 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e9bfa2-6b06-4904-a1ae-f2e1e3cbf3c1 None admin] PATH_INFO: `/v3/users` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:57:15.075170 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01e9bfa2-6b06-4904-a1ae-f2e1e3cbf3c1 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=352328) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:57:15.075484 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01e9bfa2-6b06-4904-a1ae-f2e1e3cbf3c1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:57:15.076984 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01e9bfa2-6b06-4904-a1ae-f2e1e3cbf3c1 None admin] RBAC: Authorization granted {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:57:15.098082 dv-cinder-851351-1-smb devstack@keystone.service[352328]: [pid: 352328|app: 0|req: 651/1281] 10.222.0.42 () {56 vars in 1143 bytes} [Thu Jul 28 08:57:14 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:57:15.104416 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e09cef95-1395-44a4-a027-f5b0a93b9e9a None admin] Authenticating user token {{(pid=352329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:57:15.201076 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG dbcounter [-] [352329] Writing DB stats keystone:SELECT=100 {{(pid=352329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:57:15.212783 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e09cef95-1395-44a4-a027-f5b0a93b9e9a None admin] Validating token access rules against request {{(pid=352329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:57:15.248036 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-365e0616-2977-4df7-8c6f-2c7ff4dc0ea5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:57:15.248703 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365e0616-2977-4df7-8c6f-2c7ff4dc0ea5 None admin] REQUEST_METHOD: `GET` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:57:15.248995 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365e0616-2977-4df7-8c6f-2c7ff4dc0ea5 None admin] SCRIPT_NAME: `/identity` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:57:15.249274 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365e0616-2977-4df7-8c6f-2c7ff4dc0ea5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:57:15.323753 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-365e0616-2977-4df7-8c6f-2c7ff4dc0ea5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:57:15.325329 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-365e0616-2977-4df7-8c6f-2c7ff4dc0ea5 None admin] RBAC: Authorization granted {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:57:15.426096 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG dbcounter [-] [352329] Writing DB stats keystone:SELECT=100 {{(pid=352329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:57:15.437220 dv-cinder-851351-1-smb devstack@keystone.service[352329]: [pid: 352329|app: 0|req: 631/1282] 10.222.0.42 () {58 vars in 1282 bytes} [Thu Jul 28 08:57:15 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 28 08:57:15.443240 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e9bfa2-6b06-4904-a1ae-f2e1e3cbf3c1 None admin] Authenticating user token {{(pid=352328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:57:15.515987 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG dbcounter [-] [352328] Writing DB stats keystone:SELECT=100 {{(pid=352328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:57:15.557207 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e9bfa2-6b06-4904-a1ae-f2e1e3cbf3c1 None admin] Validating token access rules against request {{(pid=352328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:57:15.599309 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc5df55-cf0f-4ce0-a277-bfb44109f5e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:57:15.599988 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc5df55-cf0f-4ce0-a277-bfb44109f5e9 None admin] REQUEST_METHOD: `GET` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:57:15.600264 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc5df55-cf0f-4ce0-a277-bfb44109f5e9 None admin] SCRIPT_NAME: `/identity` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:57:15.600541 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc5df55-cf0f-4ce0-a277-bfb44109f5e9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:57:15.612202 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dc5df55-cf0f-4ce0-a277-bfb44109f5e9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:57:15.613740 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dc5df55-cf0f-4ce0-a277-bfb44109f5e9 None admin] RBAC: Authorization granted {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:57:15.629917 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application [None req-6dc5df55-cf0f-4ce0-a277-bfb44109f5e9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 08:57:15.629917 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:57:15.629917 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:57:15.629917 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:57:15.629917 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:57:15.629917 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:57:15.629917 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:57:15.629917 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:57:15.629917 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:57:15.629917 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:57:15.629917 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:57:15.629917 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:57:15.629917 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 08:57:15.629917 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 08:57:15.629917 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 08:57:15.631133 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 08:57:15.631133 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:57:15.631133 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:57:15.631133 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:57:15.631133 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:57:15.631133 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:57:15.631133 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:57:15.631133 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:57:15.631133 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application with Lock( Jul 28 08:57:15.631133 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:57:15.631133 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:57:15.631133 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:57:15.631133 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:57:15.631133 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:57:15.631133 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:57:15.631133 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:57:15.631133 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:57:15.632497 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 08:57:15.632497 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 08:57:15.632497 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 08:57:15.632497 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application Jul 28 08:57:15.632497 dv-cinder-851351-1-smb devstack@keystone.service[352328]: [pid: 352328|app: 0|req: 652/1283] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 08:57:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:57:15.637930 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-365e0616-2977-4df7-8c6f-2c7ff4dc0ea5 None admin] Authenticating user token {{(pid=352329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:57:15.774638 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-365e0616-2977-4df7-8c6f-2c7ff4dc0ea5 None admin] Validating token access rules against request {{(pid=352329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:57:15.814427 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd4613a4-7072-4d85-9013-89ba964a5f12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:57:15.815125 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4613a4-7072-4d85-9013-89ba964a5f12 None admin] REQUEST_METHOD: `GET` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:57:15.815413 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4613a4-7072-4d85-9013-89ba964a5f12 None admin] SCRIPT_NAME: `/identity` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:57:15.815670 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4613a4-7072-4d85-9013-89ba964a5f12 None admin] PATH_INFO: `/v3/domains` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:57:15.816395 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd4613a4-7072-4d85-9013-89ba964a5f12 None admin] RBAC: Adding query filter params (name=Default) {{(pid=352329) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:57:15.816771 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd4613a4-7072-4d85-9013-89ba964a5f12 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:57:15.818170 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd4613a4-7072-4d85-9013-89ba964a5f12 None admin] RBAC: Authorization granted {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:57:15.831891 dv-cinder-851351-1-smb devstack@keystone.service[352329]: [pid: 352329|app: 0|req: 632/1284] 10.222.0.42 () {56 vars in 1109 bytes} [Thu Jul 28 08:57:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 08:57:15.838459 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc5df55-cf0f-4ce0-a277-bfb44109f5e9 None admin] Authenticating user token {{(pid=352328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:57:15.954372 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc5df55-cf0f-4ce0-a277-bfb44109f5e9 None admin] Validating token access rules against request {{(pid=352328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:57:15.969205 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG dbcounter [-] [352328] Writing DB stats keystone:SELECT=100 {{(pid=352328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:57:15.993904 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc3fd61-a864-4ea3-bb43-f1231f41d7f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:57:15.994574 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc3fd61-a864-4ea3-bb43-f1231f41d7f0 None admin] REQUEST_METHOD: `GET` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:57:15.994857 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc3fd61-a864-4ea3-bb43-f1231f41d7f0 None admin] SCRIPT_NAME: `/identity` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:57:15.995106 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc3fd61-a864-4ea3-bb43-f1231f41d7f0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:57:16.002494 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dc3fd61-a864-4ea3-bb43-f1231f41d7f0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:57:16.003966 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dc3fd61-a864-4ea3-bb43-f1231f41d7f0 None admin] RBAC: Authorization granted {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:57:16.017350 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application [None req-7dc3fd61-a864-4ea3-bb43-f1231f41d7f0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 08:57:16.017350 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:57:16.017350 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:57:16.017350 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:57:16.017350 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:57:16.017350 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:57:16.017350 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:57:16.017350 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:57:16.017350 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:57:16.017350 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:57:16.017350 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:57:16.017350 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:57:16.017350 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 28 08:57:16.017350 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 28 08:57:16.017350 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 28 08:57:16.019222 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 28 08:57:16.019222 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:57:16.019222 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:57:16.019222 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:57:16.019222 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:57:16.019222 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:57:16.019222 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:57:16.019222 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:57:16.019222 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application with Lock( Jul 28 08:57:16.019222 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:57:16.019222 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:57:16.019222 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:57:16.019222 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:57:16.019222 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:57:16.019222 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:57:16.019222 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:57:16.019222 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:57:16.021258 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 28 08:57:16.021258 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 28 08:57:16.021258 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 28 08:57:16.021258 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 28 08:57:16.021258 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 28 08:57:16.021258 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 28 08:57:16.021258 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 08:57:16.021258 dv-cinder-851351-1-smb devstack@keystone.service[352328]: ERROR keystone.server.flask.application Jul 28 08:57:16.021258 dv-cinder-851351-1-smb devstack@keystone.service[352328]: [pid: 352328|app: 0|req: 653/1285] 10.222.0.42 () {56 vars in 1111 bytes} [Thu Jul 28 08:57:15 2022] GET /identity/v3/projects/service => generated 88 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:57:16.025285 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd4613a4-7072-4d85-9013-89ba964a5f12 None admin] Authenticating user token {{(pid=352329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:57:16.083388 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG dbcounter [-] [352329] Writing DB stats keystone:SELECT=100 {{(pid=352329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:57:16.140599 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd4613a4-7072-4d85-9013-89ba964a5f12 None admin] Validating token access rules against request {{(pid=352329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:57:16.196653 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf93a4e-8027-4ac7-b9c4-d4a289b1ef4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:57:16.197346 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf93a4e-8027-4ac7-b9c4-d4a289b1ef4c None admin] REQUEST_METHOD: `GET` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:57:16.197628 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf93a4e-8027-4ac7-b9c4-d4a289b1ef4c None admin] SCRIPT_NAME: `/identity` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:57:16.197896 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf93a4e-8027-4ac7-b9c4-d4a289b1ef4c None admin] PATH_INFO: `/v3/projects` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:57:16.198666 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf93a4e-8027-4ac7-b9c4-d4a289b1ef4c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=352329) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:57:16.198955 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf93a4e-8027-4ac7-b9c4-d4a289b1ef4c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:57:16.200476 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf93a4e-8027-4ac7-b9c4-d4a289b1ef4c None admin] RBAC: Authorization granted {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:57:16.214730 dv-cinder-851351-1-smb devstack@keystone.service[352329]: [pid: 352329|app: 0|req: 633/1286] 10.222.0.42 () {56 vars in 1148 bytes} [Thu Jul 28 08:57:16 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:57:16.221210 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc3fd61-a864-4ea3-bb43-f1231f41d7f0 None admin] Authenticating user token {{(pid=352328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:57:16.333674 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc3fd61-a864-4ea3-bb43-f1231f41d7f0 None admin] Validating token access rules against request {{(pid=352328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:57:16.369152 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf49d617-508a-49fd-8788-15bd30583120 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:57:16.369780 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf49d617-508a-49fd-8788-15bd30583120 None admin] REQUEST_METHOD: `GET` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:57:16.370057 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf49d617-508a-49fd-8788-15bd30583120 None admin] SCRIPT_NAME: `/identity` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:57:16.370326 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf49d617-508a-49fd-8788-15bd30583120 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:57:16.371274 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf49d617-508a-49fd-8788-15bd30583120 None admin] RBAC: Adding query filter params (role.id=280023171b4a45efb67c036ff237bb3c, scope.project.id=9cfa053c839a4fedacde7163d907e2a4, user.id=9b6ed94c1df745c3bc7adf2769fc5119) {{(pid=352328) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:57:16.371579 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf49d617-508a-49fd-8788-15bd30583120 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:57:16.373053 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf49d617-508a-49fd-8788-15bd30583120 None admin] RBAC: Authorization granted {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:57:16.379519 dv-cinder-851351-1-smb devstack@keystone.service[352328]: [pid: 352328|app: 0|req: 654/1287] 10.222.0.42 () {56 vars in 1374 bytes} [Thu Jul 28 08:57:16 2022] GET /identity/v3/role_assignments?user.id=9b6ed94c1df745c3bc7adf2769fc5119&scope.project.id=9cfa053c839a4fedacde7163d907e2a4&role.id=280023171b4a45efb67c036ff237bb3c => generated 608 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:57:18.418787 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ed418d-fe6b-4ca6-860d-06beecd9fcc3 None None] REQUEST_METHOD: `GET` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:57:18.419761 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ed418d-fe6b-4ca6-860d-06beecd9fcc3 None None] SCRIPT_NAME: `/identity` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:57:18.419761 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ed418d-fe6b-4ca6-860d-06beecd9fcc3 None None] PATH_INFO: `/` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:57:18.420886 dv-cinder-851351-1-smb devstack@keystone.service[352329]: [pid: 352329|app: 0|req: 634/1288] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 08:57:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 08:57:18.427246 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c91e76-675f-4f02-aab6-541905acd611 None None] REQUEST_METHOD: `POST` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:57:18.427848 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c91e76-675f-4f02-aab6-541905acd611 None None] SCRIPT_NAME: `/identity` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:57:18.427848 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c91e76-675f-4f02-aab6-541905acd611 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:57:18.447686 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.auth.core [None req-73c91e76-675f-4f02-aab6-541905acd611 None None] MFA Rules not processed for user `d18c063b2377412485965357671e5506`. Rule list: `[]` (Enabled: `True`). {{(pid=352328) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 08:57:18.449049 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.fernet_utils [None req-73c91e76-675f-4f02-aab6-541905acd611 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=352328) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:57:18.487056 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG dbcounter [-] [352328] Writing DB stats keystone:SELECT=100 {{(pid=352328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:57:18.529050 dv-cinder-851351-1-smb devstack@keystone.service[352328]: [pid: 352328|app: 0|req: 655/1289] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 08:57:18 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 28 08:57:18.551885 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ed418d-fe6b-4ca6-860d-06beecd9fcc3 None None] Authenticating user token {{(pid=352329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:57:18.682687 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ed418d-fe6b-4ca6-860d-06beecd9fcc3 None None] Validating token access rules against request {{(pid=352329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:57:18.694488 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG dbcounter [-] [352329] Writing DB stats keystone:SELECT=100 {{(pid=352329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:57:18.719839 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d09407-0550-44ab-9953-50759a65432d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:57:18.720530 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d09407-0550-44ab-9953-50759a65432d None admin] REQUEST_METHOD: `GET` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:57:18.720847 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d09407-0550-44ab-9953-50759a65432d None admin] SCRIPT_NAME: `/identity` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:57:18.721123 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d09407-0550-44ab-9953-50759a65432d None admin] PATH_INFO: `/v3/services/placement` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:57:18.721763 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72d09407-0550-44ab-9953-50759a65432d None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:57:18.723167 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72d09407-0550-44ab-9953-50759a65432d None admin] RBAC: Authorization granted {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:57:18.732477 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application [None req-72d09407-0550-44ab-9953-50759a65432d None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jul 28 08:57:18.732477 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:57:18.732477 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 28 08:57:18.732477 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 28 08:57:18.732477 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 28 08:57:18.732477 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 28 08:57:18.732477 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 28 08:57:18.732477 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 08:57:18.732477 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 28 08:57:18.732477 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application Jul 28 08:57:18.732477 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 28 08:57:18.732477 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application Jul 28 08:57:18.732477 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:57:18.732477 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:57:18.732477 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:57:18.732477 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:57:18.732477 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:57:18.733892 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:57:18.733892 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:57:18.733892 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:57:18.733892 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:57:18.733892 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:57:18.733892 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:57:18.733892 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 28 08:57:18.733892 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 28 08:57:18.733892 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 28 08:57:18.733892 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 28 08:57:18.733892 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:57:18.733892 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:57:18.733892 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:57:18.733892 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:57:18.733892 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:57:18.733892 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:57:18.735091 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:57:18.735091 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application with Lock( Jul 28 08:57:18.735091 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:57:18.735091 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:57:18.735091 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:57:18.735091 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:57:18.735091 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:57:18.735091 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:57:18.735091 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:57:18.735091 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:57:18.735091 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 28 08:57:18.735091 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 08:57:18.735091 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 28 08:57:18.735091 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application Jul 28 08:57:18.735091 dv-cinder-851351-1-smb devstack@keystone.service[352329]: [pid: 352329|app: 0|req: 635/1290] 10.222.0.42 () {56 vars in 1117 bytes} [Thu Jul 28 08:57:18 2022] GET /identity/v3/services/placement => generated 90 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 08:57:18.742637 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c91e76-675f-4f02-aab6-541905acd611 None None] Authenticating user token {{(pid=352328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:57:18.847731 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c91e76-675f-4f02-aab6-541905acd611 None None] Validating token access rules against request {{(pid=352328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:57:18.890266 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e354131-83c8-45d5-aa28-d76ff9f3dd48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:57:18.891339 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e354131-83c8-45d5-aa28-d76ff9f3dd48 None admin] REQUEST_METHOD: `GET` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:57:18.891823 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e354131-83c8-45d5-aa28-d76ff9f3dd48 None admin] SCRIPT_NAME: `/identity` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:57:18.892303 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e354131-83c8-45d5-aa28-d76ff9f3dd48 None admin] PATH_INFO: `/v3/services` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:57:18.893672 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e354131-83c8-45d5-aa28-d76ff9f3dd48 None admin] RBAC: Adding query filter params (name=placement) {{(pid=352328) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:57:18.894229 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e354131-83c8-45d5-aa28-d76ff9f3dd48 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:57:18.896822 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e354131-83c8-45d5-aa28-d76ff9f3dd48 None admin] RBAC: Authorization granted {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:57:18.906615 dv-cinder-851351-1-smb devstack@keystone.service[352328]: [pid: 352328|app: 0|req: 656/1291] 10.222.0.42 () {56 vars in 1116 bytes} [Thu Jul 28 08:57:18 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:57:18.912786 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d09407-0550-44ab-9953-50759a65432d None admin] Authenticating user token {{(pid=352329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:57:19.030475 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d09407-0550-44ab-9953-50759a65432d None admin] Validating token access rules against request {{(pid=352329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:57:19.076058 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7332ef18-4bb5-4e4f-9b10-b8fa27cd95a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:57:19.076705 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7332ef18-4bb5-4e4f-9b10-b8fa27cd95a5 None admin] REQUEST_METHOD: `GET` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:57:19.077018 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7332ef18-4bb5-4e4f-9b10-b8fa27cd95a5 None admin] SCRIPT_NAME: `/identity` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:57:19.077303 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7332ef18-4bb5-4e4f-9b10-b8fa27cd95a5 None admin] PATH_INFO: `/v3/services` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:57:19.077982 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7332ef18-4bb5-4e4f-9b10-b8fa27cd95a5 None admin] RBAC: Adding query filter params (type=placement) {{(pid=352329) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:57:19.078287 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7332ef18-4bb5-4e4f-9b10-b8fa27cd95a5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:57:19.080091 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7332ef18-4bb5-4e4f-9b10-b8fa27cd95a5 None admin] RBAC: Authorization granted {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:57:19.085594 dv-cinder-851351-1-smb devstack@keystone.service[352329]: [pid: 352329|app: 0|req: 636/1292] 10.222.0.42 () {56 vars in 1116 bytes} [Thu Jul 28 08:57:18 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:57:21.176443 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777ee9b0-c732-4168-a129-ed1fad2f954d None None] REQUEST_METHOD: `GET` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:57:21.177092 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777ee9b0-c732-4168-a129-ed1fad2f954d None None] SCRIPT_NAME: `/identity` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:57:21.177092 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777ee9b0-c732-4168-a129-ed1fad2f954d None None] PATH_INFO: `/` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:57:21.178445 dv-cinder-851351-1-smb devstack@keystone.service[352328]: [pid: 352328|app: 0|req: 657/1293] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 08:57:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 08:57:21.184272 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05fd5ca6-7372-441d-8657-cf550e66be77 None None] REQUEST_METHOD: `POST` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:57:21.184807 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05fd5ca6-7372-441d-8657-cf550e66be77 None None] SCRIPT_NAME: `/identity` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:57:21.184913 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05fd5ca6-7372-441d-8657-cf550e66be77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:57:21.203515 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.auth.core [None req-05fd5ca6-7372-441d-8657-cf550e66be77 None None] MFA Rules not processed for user `d18c063b2377412485965357671e5506`. Rule list: `[]` (Enabled: `True`). {{(pid=352329) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 08:57:21.205154 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.fernet_utils [None req-05fd5ca6-7372-441d-8657-cf550e66be77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=352329) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:57:21.238349 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG dbcounter [-] [352329] Writing DB stats keystone:SELECT=100 {{(pid=352329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:57:21.304150 dv-cinder-851351-1-smb devstack@keystone.service[352329]: [pid: 352329|app: 0|req: 637/1294] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 08:57:21 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 08:57:21.327150 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-777ee9b0-c732-4168-a129-ed1fad2f954d None None] Authenticating user token {{(pid=352328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:57:21.362552 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG dbcounter [-] [352328] Writing DB stats keystone:SELECT=100 {{(pid=352328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:57:21.441639 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-777ee9b0-c732-4168-a129-ed1fad2f954d None None] Validating token access rules against request {{(pid=352328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:57:21.480910 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a249af-ef5a-4300-85ec-ac31c272f893 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:57:21.481553 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a249af-ef5a-4300-85ec-ac31c272f893 None admin] REQUEST_METHOD: `POST` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:57:21.481832 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a249af-ef5a-4300-85ec-ac31c272f893 None admin] SCRIPT_NAME: `/identity` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:57:21.482111 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a249af-ef5a-4300-85ec-ac31c272f893 None admin] PATH_INFO: `/v3/services` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:57:21.482829 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a249af-ef5a-4300-85ec-ac31c272f893 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:57:21.484234 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a249af-ef5a-4300-85ec-ac31c272f893 None admin] RBAC: Authorization granted {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:57:21.501059 dv-cinder-851351-1-smb devstack@keystone.service[352328]: [pid: 352328|app: 0|req: 658/1295] 10.222.0.42 () {60 vars in 1141 bytes} [Thu Jul 28 08:57:21 2022] POST /identity/v3/services => generated 246 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 08:57:23.583581 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1793ec00-e809-495e-827f-99b25fbe1707 None None] REQUEST_METHOD: `GET` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:57:23.584239 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1793ec00-e809-495e-827f-99b25fbe1707 None None] SCRIPT_NAME: `/identity` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:57:23.584239 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1793ec00-e809-495e-827f-99b25fbe1707 None None] PATH_INFO: `/` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:57:23.586479 dv-cinder-851351-1-smb devstack@keystone.service[352329]: [pid: 352329|app: 0|req: 638/1296] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 08:57:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 08:57:23.593999 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23cb6f2a-1298-4fe6-8f4f-13fdcbc3367a None None] REQUEST_METHOD: `POST` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:57:23.594652 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23cb6f2a-1298-4fe6-8f4f-13fdcbc3367a None None] SCRIPT_NAME: `/identity` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:57:23.594883 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23cb6f2a-1298-4fe6-8f4f-13fdcbc3367a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:57:23.628237 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.auth.core [None req-23cb6f2a-1298-4fe6-8f4f-13fdcbc3367a None None] MFA Rules not processed for user `d18c063b2377412485965357671e5506`. Rule list: `[]` (Enabled: `True`). {{(pid=352328) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 08:57:23.629773 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.fernet_utils [None req-23cb6f2a-1298-4fe6-8f4f-13fdcbc3367a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=352328) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:57:23.738007 dv-cinder-851351-1-smb devstack@keystone.service[352328]: [pid: 352328|app: 0|req: 659/1297] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 08:57:23 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 08:57:23.760993 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1793ec00-e809-495e-827f-99b25fbe1707 None None] Authenticating user token {{(pid=352329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:57:23.868059 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1793ec00-e809-495e-827f-99b25fbe1707 None None] Validating token access rules against request {{(pid=352329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:57:23.907289 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-545d7ee4-9309-47b8-b736-7d9e003c07dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:57:23.907945 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545d7ee4-9309-47b8-b736-7d9e003c07dd None admin] REQUEST_METHOD: `GET` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:57:23.908223 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545d7ee4-9309-47b8-b736-7d9e003c07dd None admin] SCRIPT_NAME: `/identity` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:57:23.908496 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545d7ee4-9309-47b8-b736-7d9e003c07dd None admin] PATH_INFO: `/v3/services/placement` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:57:23.909175 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-545d7ee4-9309-47b8-b736-7d9e003c07dd None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:57:23.910568 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-545d7ee4-9309-47b8-b736-7d9e003c07dd None admin] RBAC: Authorization granted {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:57:23.920528 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application [None req-545d7ee4-9309-47b8-b736-7d9e003c07dd None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jul 28 08:57:23.920528 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:57:23.920528 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 28 08:57:23.920528 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 28 08:57:23.920528 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 28 08:57:23.920528 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 28 08:57:23.920528 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 28 08:57:23.920528 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 08:57:23.920528 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 28 08:57:23.920528 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application Jul 28 08:57:23.920528 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 28 08:57:23.920528 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application Jul 28 08:57:23.920528 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:57:23.920528 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:57:23.920528 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:57:23.920528 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:57:23.920528 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:57:23.922139 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:57:23.922139 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:57:23.922139 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:57:23.922139 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:57:23.922139 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:57:23.922139 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:57:23.922139 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 28 08:57:23.922139 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 28 08:57:23.922139 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 28 08:57:23.922139 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 28 08:57:23.922139 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:57:23.922139 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:57:23.922139 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:57:23.922139 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:57:23.922139 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:57:23.922139 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:57:23.923474 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:57:23.923474 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application with Lock( Jul 28 08:57:23.923474 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:57:23.923474 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:57:23.923474 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:57:23.923474 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:57:23.923474 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:57:23.923474 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:57:23.923474 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:57:23.923474 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:57:23.923474 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 28 08:57:23.923474 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 08:57:23.923474 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 28 08:57:23.923474 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application Jul 28 08:57:23.923474 dv-cinder-851351-1-smb devstack@keystone.service[352329]: [pid: 352329|app: 0|req: 639/1298] 10.222.0.42 () {56 vars in 1117 bytes} [Thu Jul 28 08:57:23 2022] GET /identity/v3/services/placement => generated 90 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:57:23.928374 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23cb6f2a-1298-4fe6-8f4f-13fdcbc3367a None None] Authenticating user token {{(pid=352328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:57:23.952253 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG dbcounter [-] [352328] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=352328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:57:24.045520 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23cb6f2a-1298-4fe6-8f4f-13fdcbc3367a None None] Validating token access rules against request {{(pid=352328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:57:24.082655 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a99dab28-78a9-4a68-8dd8-08d23771f7fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:57:24.083288 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99dab28-78a9-4a68-8dd8-08d23771f7fe None admin] REQUEST_METHOD: `GET` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:57:24.083567 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99dab28-78a9-4a68-8dd8-08d23771f7fe None admin] SCRIPT_NAME: `/identity` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:57:24.083838 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99dab28-78a9-4a68-8dd8-08d23771f7fe None admin] PATH_INFO: `/v3/services` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:57:24.084534 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a99dab28-78a9-4a68-8dd8-08d23771f7fe None admin] RBAC: Adding query filter params (name=placement) {{(pid=352328) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:57:24.084872 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a99dab28-78a9-4a68-8dd8-08d23771f7fe None admin] RBAC: Authorizing `identity:list_services()` {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:57:24.086277 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a99dab28-78a9-4a68-8dd8-08d23771f7fe None admin] RBAC: Authorization granted {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:57:24.092164 dv-cinder-851351-1-smb devstack@keystone.service[352328]: [pid: 352328|app: 0|req: 660/1299] 10.222.0.42 () {56 vars in 1116 bytes} [Thu Jul 28 08:57:23 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:57:24.098609 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-545d7ee4-9309-47b8-b736-7d9e003c07dd None admin] Authenticating user token {{(pid=352329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:57:24.133044 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG dbcounter [-] [352329] Writing DB stats keystone:SELECT=100 {{(pid=352329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:57:24.205424 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-545d7ee4-9309-47b8-b736-7d9e003c07dd None admin] Validating token access rules against request {{(pid=352329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:57:24.240758 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b32b9cf-9ed6-490d-80fe-a5b0ae985c38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:57:24.241390 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b32b9cf-9ed6-490d-80fe-a5b0ae985c38 None admin] REQUEST_METHOD: `GET` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:57:24.241670 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b32b9cf-9ed6-490d-80fe-a5b0ae985c38 None admin] SCRIPT_NAME: `/identity` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:57:24.241948 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b32b9cf-9ed6-490d-80fe-a5b0ae985c38 None admin] PATH_INFO: `/v3/endpoints` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:57:24.242714 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b32b9cf-9ed6-490d-80fe-a5b0ae985c38 None admin] RBAC: Adding query filter params (interface=public, service_id=cbc6441b5c814d86a4fe389c134b4f60, region_id=RegionOne) {{(pid=352329) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:57:24.243020 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b32b9cf-9ed6-490d-80fe-a5b0ae985c38 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:57:24.244426 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b32b9cf-9ed6-490d-80fe-a5b0ae985c38 None admin] RBAC: Authorization granted {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:57:24.250248 dv-cinder-851351-1-smb devstack@keystone.service[352329]: [pid: 352329|app: 0|req: 640/1300] 10.222.0.42 () {56 vars in 1251 bytes} [Thu Jul 28 08:57:24 2022] GET /identity/v3/endpoints?service_id=cbc6441b5c814d86a4fe389c134b4f60&interface=public®ion_id=RegionOne => generated 194 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 08:57:24.256383 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a99dab28-78a9-4a68-8dd8-08d23771f7fe None admin] Authenticating user token {{(pid=352328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:57:24.344603 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG dbcounter [-] [352328] Writing DB stats keystone:SELECT=100 {{(pid=352328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:57:24.364920 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a99dab28-78a9-4a68-8dd8-08d23771f7fe None admin] Validating token access rules against request {{(pid=352328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:57:24.401529 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5fbd537-7a4a-484c-a2c7-54a8364e1486 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:57:24.402093 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5fbd537-7a4a-484c-a2c7-54a8364e1486 None admin] REQUEST_METHOD: `GET` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:57:24.402365 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5fbd537-7a4a-484c-a2c7-54a8364e1486 None admin] SCRIPT_NAME: `/identity` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:57:24.402638 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5fbd537-7a4a-484c-a2c7-54a8364e1486 None admin] PATH_INFO: `/v3/services` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:57:24.403307 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5fbd537-7a4a-484c-a2c7-54a8364e1486 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:57:24.404704 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5fbd537-7a4a-484c-a2c7-54a8364e1486 None admin] RBAC: Authorization granted {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:57:24.412106 dv-cinder-851351-1-smb devstack@keystone.service[352328]: [pid: 352328|app: 0|req: 661/1301] 10.222.0.42 () {56 vars in 1087 bytes} [Thu Jul 28 08:57:24 2022] GET /identity/v3/services => generated 2191 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 08:57:26.478733 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adff4541-ba39-4d8b-b0f1-68869eae903b None None] REQUEST_METHOD: `GET` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:57:26.479328 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adff4541-ba39-4d8b-b0f1-68869eae903b None None] SCRIPT_NAME: `/identity` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:57:26.479328 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adff4541-ba39-4d8b-b0f1-68869eae903b None None] PATH_INFO: `/` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:57:26.480805 dv-cinder-851351-1-smb devstack@keystone.service[352329]: [pid: 352329|app: 0|req: 641/1302] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 08:57:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 08:57:26.486272 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc92f643-4df7-4fb0-9fa0-98383fcbf43a None None] REQUEST_METHOD: `POST` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:57:26.486763 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc92f643-4df7-4fb0-9fa0-98383fcbf43a None None] SCRIPT_NAME: `/identity` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:57:26.486763 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc92f643-4df7-4fb0-9fa0-98383fcbf43a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:57:26.505546 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.auth.core [None req-bc92f643-4df7-4fb0-9fa0-98383fcbf43a None None] MFA Rules not processed for user `d18c063b2377412485965357671e5506`. Rule list: `[]` (Enabled: `True`). {{(pid=352328) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 08:57:26.506759 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.fernet_utils [None req-bc92f643-4df7-4fb0-9fa0-98383fcbf43a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=352328) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:57:26.582601 dv-cinder-851351-1-smb devstack@keystone.service[352328]: [pid: 352328|app: 0|req: 662/1303] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 08:57:26 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 08:57:26.605402 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adff4541-ba39-4d8b-b0f1-68869eae903b None None] Authenticating user token {{(pid=352329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:57:26.709691 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG dbcounter [-] [352329] Writing DB stats keystone:SELECT=100 {{(pid=352329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:57:26.718099 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adff4541-ba39-4d8b-b0f1-68869eae903b None None] Validating token access rules against request {{(pid=352329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:57:26.754521 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7695227a-3c72-48d1-a2da-b73330b87a81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:57:26.755082 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7695227a-3c72-48d1-a2da-b73330b87a81 None admin] REQUEST_METHOD: `GET` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:57:26.755365 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7695227a-3c72-48d1-a2da-b73330b87a81 None admin] SCRIPT_NAME: `/identity` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:57:26.755637 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7695227a-3c72-48d1-a2da-b73330b87a81 None admin] PATH_INFO: `/v3/services/placement` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:57:26.756271 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7695227a-3c72-48d1-a2da-b73330b87a81 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:57:26.757703 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7695227a-3c72-48d1-a2da-b73330b87a81 None admin] RBAC: Authorization granted {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:57:26.767384 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application [None req-7695227a-3c72-48d1-a2da-b73330b87a81 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jul 28 08:57:26.767384 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:57:26.767384 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 28 08:57:26.767384 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 28 08:57:26.767384 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 28 08:57:26.767384 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 28 08:57:26.767384 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 28 08:57:26.767384 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 08:57:26.767384 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 28 08:57:26.767384 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application Jul 28 08:57:26.767384 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 28 08:57:26.767384 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application Jul 28 08:57:26.767384 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 08:57:26.767384 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 08:57:26.767384 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 08:57:26.767384 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 08:57:26.767384 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 08:57:26.770073 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 08:57:26.770073 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 08:57:26.770073 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 08:57:26.770073 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 08:57:26.770073 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 08:57:26.770073 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 08:57:26.770073 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 28 08:57:26.770073 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 28 08:57:26.770073 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 28 08:57:26.770073 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 28 08:57:26.770073 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 08:57:26.770073 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 08:57:26.770073 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 08:57:26.770073 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 08:57:26.770073 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 08:57:26.770073 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 08:57:26.772367 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 08:57:26.772367 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application with Lock( Jul 28 08:57:26.772367 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 08:57:26.772367 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return self._enter() Jul 28 08:57:26.772367 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 08:57:26.772367 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 08:57:26.772367 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 08:57:26.772367 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application return self.creator() Jul 28 08:57:26.772367 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 08:57:26.772367 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application created_value = creator( Jul 28 08:57:26.772367 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 28 08:57:26.772367 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 08:57:26.772367 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 28 08:57:26.772367 dv-cinder-851351-1-smb devstack@keystone.service[352329]: ERROR keystone.server.flask.application Jul 28 08:57:26.772367 dv-cinder-851351-1-smb devstack@keystone.service[352329]: [pid: 352329|app: 0|req: 642/1304] 10.222.0.42 () {56 vars in 1117 bytes} [Thu Jul 28 08:57:26 2022] GET /identity/v3/services/placement => generated 90 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 08:57:26.775208 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc92f643-4df7-4fb0-9fa0-98383fcbf43a None None] Authenticating user token {{(pid=352328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:57:26.861356 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG dbcounter [-] [352328] Writing DB stats keystone:SELECT=100 {{(pid=352328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:57:26.886716 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc92f643-4df7-4fb0-9fa0-98383fcbf43a None None] Validating token access rules against request {{(pid=352328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:57:26.924512 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b53b6b-ffff-4d6e-a9f1-3e3a89aff411 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:57:26.925235 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b53b6b-ffff-4d6e-a9f1-3e3a89aff411 None admin] REQUEST_METHOD: `GET` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:57:26.925520 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b53b6b-ffff-4d6e-a9f1-3e3a89aff411 None admin] SCRIPT_NAME: `/identity` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:57:26.925800 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b53b6b-ffff-4d6e-a9f1-3e3a89aff411 None admin] PATH_INFO: `/v3/services` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:57:26.926519 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b53b6b-ffff-4d6e-a9f1-3e3a89aff411 None admin] RBAC: Adding query filter params (name=placement) {{(pid=352328) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 08:57:26.926834 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b53b6b-ffff-4d6e-a9f1-3e3a89aff411 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:57:26.928285 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b53b6b-ffff-4d6e-a9f1-3e3a89aff411 None admin] RBAC: Authorization granted {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:57:26.934725 dv-cinder-851351-1-smb devstack@keystone.service[352328]: [pid: 352328|app: 0|req: 663/1305] 10.222.0.42 () {56 vars in 1116 bytes} [Thu Jul 28 08:57:26 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 08:57:26.941048 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7695227a-3c72-48d1-a2da-b73330b87a81 None admin] Authenticating user token {{(pid=352329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:57:27.051782 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7695227a-3c72-48d1-a2da-b73330b87a81 None admin] Validating token access rules against request {{(pid=352329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:57:27.092266 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde6e2ed-7e05-4546-823e-80b13cc95855 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd18c063b2377412485965357671e5506', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:57:27.092950 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde6e2ed-7e05-4546-823e-80b13cc95855 None admin] REQUEST_METHOD: `POST` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:57:27.093224 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde6e2ed-7e05-4546-823e-80b13cc95855 None admin] SCRIPT_NAME: `/identity` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:57:27.093506 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde6e2ed-7e05-4546-823e-80b13cc95855 None admin] PATH_INFO: `/v3/endpoints` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:57:27.094233 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cde6e2ed-7e05-4546-823e-80b13cc95855 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:57:27.095639 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cde6e2ed-7e05-4546-823e-80b13cc95855 None admin] RBAC: Authorization granted {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:57:27.118157 dv-cinder-851351-1-smb devstack@keystone.service[352329]: [pid: 352329|app: 0|req: 643/1306] 10.222.0.42 () {60 vars in 1144 bytes} [Thu Jul 28 08:57:26 2022] POST /identity/v3/endpoints => generated 331 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 08:57:36.931125 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG dbcounter [-] [352328] Writing DB stats keystone:SELECT=30 {{(pid=352328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:57:37.113667 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG dbcounter [-] [352329] Writing DB stats keystone:SELECT=91,keystone:INSERT=1 {{(pid=352329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:58:34.221032 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10046210-9a84-4dba-b101-99e9ff8fa244 None None] REQUEST_METHOD: `GET` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:58:34.221670 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10046210-9a84-4dba-b101-99e9ff8fa244 None None] SCRIPT_NAME: `/identity` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:58:34.221670 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10046210-9a84-4dba-b101-99e9ff8fa244 None None] PATH_INFO: `/` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:58:34.223065 dv-cinder-851351-1-smb devstack@keystone.service[352328]: [pid: 352328|app: 0|req: 664/1307] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 08:58:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 08:58:34.229188 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8357f3-e5e1-47a6-850b-a2b2475a0011 None None] REQUEST_METHOD: `POST` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:58:34.230044 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8357f3-e5e1-47a6-850b-a2b2475a0011 None None] SCRIPT_NAME: `/identity` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:58:34.230475 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8357f3-e5e1-47a6-850b-a2b2475a0011 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:58:34.391858 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.auth.core [None req-ac8357f3-e5e1-47a6-850b-a2b2475a0011 None None] MFA Rules not processed for user `d18c063b2377412485965357671e5506`. Rule list: `[]` (Enabled: `True`). {{(pid=352329) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 08:58:34.393141 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.fernet_utils [None req-ac8357f3-e5e1-47a6-850b-a2b2475a0011 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=352329) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:58:34.628155 dv-cinder-851351-1-smb devstack@keystone.service[352329]: [pid: 352329|app: 0|req: 644/1308] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 08:58:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 400 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 08:58:34.695236 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b95c46d-8348-4671-86c4-7ce5927b8124 None None] REQUEST_METHOD: `GET` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:58:34.695527 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b95c46d-8348-4671-86c4-7ce5927b8124 None None] SCRIPT_NAME: `/identity` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:58:34.695805 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b95c46d-8348-4671-86c4-7ce5927b8124 None None] PATH_INFO: `/` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:58:34.697309 dv-cinder-851351-1-smb devstack@keystone.service[352328]: [pid: 352328|app: 0|req: 665/1309] 10.222.0.42 () {54 vars in 965 bytes} [Thu Jul 28 08:58:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 08:58:34.707042 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56cd126-a3f8-4a28-bc91-c7edcf562061 None None] REQUEST_METHOD: `POST` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:58:34.707526 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56cd126-a3f8-4a28-bc91-c7edcf562061 None None] SCRIPT_NAME: `/identity` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:58:34.708003 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56cd126-a3f8-4a28-bc91-c7edcf562061 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:58:34.834655 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.auth.core [None req-b56cd126-a3f8-4a28-bc91-c7edcf562061 None None] MFA Rules not processed for user `129f505b6d004c8a949020bd2113e32d`. Rule list: `[]` (Enabled: `True`). {{(pid=352329) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 08:58:34.836301 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.fernet_utils [None req-b56cd126-a3f8-4a28-bc91-c7edcf562061 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=352329) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:58:34.865251 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG dbcounter [-] [352329] Writing DB stats keystone:SELECT=100 {{(pid=352329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:58:34.949768 dv-cinder-851351-1-smb devstack@keystone.service[352329]: [pid: 352329|app: 0|req: 645/1310] 10.222.0.42 () {58 vars in 1062 bytes} [Thu Jul 28 08:58:34 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 244 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 08:58:34.959902 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b95c46d-8348-4671-86c4-7ce5927b8124 None None] Authenticating user token {{(pid=352328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:58:34.962692 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.fernet_utils [None req-1b95c46d-8348-4671-86c4-7ce5927b8124 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=352328) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:58:35.140957 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b95c46d-8348-4671-86c4-7ce5927b8124 None None] Validating token access rules against request {{(pid=352328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:58:35.227278 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-217ad122-23a0-48ff-b498-d804fb514781 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '129f505b6d004c8a949020bd2113e32d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9cfa053c839a4fedacde7163d907e2a4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:58:35.228992 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217ad122-23a0-48ff-b498-d804fb514781 service neutron] REQUEST_METHOD: `GET` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:58:35.229548 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217ad122-23a0-48ff-b498-d804fb514781 service neutron] SCRIPT_NAME: `/identity` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:58:35.230042 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217ad122-23a0-48ff-b498-d804fb514781 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:58:35.231999 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.fernet_utils [None req-217ad122-23a0-48ff-b498-d804fb514781 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=352328) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:58:35.304006 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG dbcounter [-] [352328] Writing DB stats keystone:SELECT=100 {{(pid=352328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:58:35.363334 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-217ad122-23a0-48ff-b498-d804fb514781 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:58:35.364849 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-217ad122-23a0-48ff-b498-d804fb514781 service neutron] RBAC: Authorization granted {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:58:35.397112 dv-cinder-851351-1-smb devstack@keystone.service[352328]: [pid: 352328|app: 0|req: 666/1311] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Jul 28 08:58:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 438 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 08:58:37.724040 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58243085-fd0a-473e-b12a-68a2dfe1c376 None None] REQUEST_METHOD: `GET` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:58:37.724643 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58243085-fd0a-473e-b12a-68a2dfe1c376 None None] SCRIPT_NAME: `/identity` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:58:37.724643 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58243085-fd0a-473e-b12a-68a2dfe1c376 None None] PATH_INFO: `/` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:58:37.727039 dv-cinder-851351-1-smb devstack@keystone.service[352329]: [pid: 352329|app: 0|req: 646/1312] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 08:58:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 08:58:37.732087 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879650da-6e90-47c5-a87d-16b7de7cf0e9 None None] REQUEST_METHOD: `POST` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:58:37.732643 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879650da-6e90-47c5-a87d-16b7de7cf0e9 None None] SCRIPT_NAME: `/identity` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:58:37.732643 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879650da-6e90-47c5-a87d-16b7de7cf0e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:58:37.827406 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.auth.core [None req-879650da-6e90-47c5-a87d-16b7de7cf0e9 None None] MFA Rules not processed for user `d18c063b2377412485965357671e5506`. Rule list: `[]` (Enabled: `True`). {{(pid=352328) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 08:58:37.829087 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.fernet_utils [None req-879650da-6e90-47c5-a87d-16b7de7cf0e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=352328) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:58:37.935912 dv-cinder-851351-1-smb devstack@keystone.service[352328]: [pid: 352328|app: 0|req: 667/1313] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 08:58:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 08:58:37.974876 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58243085-fd0a-473e-b12a-68a2dfe1c376 None None] Authenticating user token {{(pid=352329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:58:37.976407 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.fernet_utils [None req-58243085-fd0a-473e-b12a-68a2dfe1c376 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=352329) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:58:38.103194 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58243085-fd0a-473e-b12a-68a2dfe1c376 None None] Validating token access rules against request {{(pid=352329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:58:38.180825 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG dbcounter [-] [352329] Writing DB stats keystone:SELECT=100 {{(pid=352329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:58:38.183606 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466a2063-a03e-4e78-84ec-a5bcd7cbdfae service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '129f505b6d004c8a949020bd2113e32d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9cfa053c839a4fedacde7163d907e2a4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:58:38.184340 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466a2063-a03e-4e78-84ec-a5bcd7cbdfae service neutron] REQUEST_METHOD: `GET` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:58:38.184906 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466a2063-a03e-4e78-84ec-a5bcd7cbdfae service neutron] SCRIPT_NAME: `/identity` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:58:38.185408 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466a2063-a03e-4e78-84ec-a5bcd7cbdfae service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:58:38.187360 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.fernet_utils [None req-466a2063-a03e-4e78-84ec-a5bcd7cbdfae service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=352329) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:58:38.303328 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-466a2063-a03e-4e78-84ec-a5bcd7cbdfae service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:58:38.304711 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-466a2063-a03e-4e78-84ec-a5bcd7cbdfae service neutron] RBAC: Authorization granted {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:58:38.328537 dv-cinder-851351-1-smb devstack@keystone.service[352329]: [pid: 352329|app: 0|req: 647/1314] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Jul 28 08:58:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 354 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 08:58:40.686876 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a117d60c-1f43-4119-97e2-ebba2176b78b None None] REQUEST_METHOD: `GET` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:58:40.687461 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a117d60c-1f43-4119-97e2-ebba2176b78b None None] SCRIPT_NAME: `/identity` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:58:40.687461 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a117d60c-1f43-4119-97e2-ebba2176b78b None None] PATH_INFO: `/` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:58:40.688939 dv-cinder-851351-1-smb devstack@keystone.service[352328]: [pid: 352328|app: 0|req: 668/1315] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 08:58:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 08:58:40.694246 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a5792b-46b2-4921-8d29-c7ed92010ff4 None None] REQUEST_METHOD: `POST` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:58:40.694673 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a5792b-46b2-4921-8d29-c7ed92010ff4 None None] SCRIPT_NAME: `/identity` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:58:40.694756 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a5792b-46b2-4921-8d29-c7ed92010ff4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:58:40.766242 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.auth.core [None req-b1a5792b-46b2-4921-8d29-c7ed92010ff4 None None] MFA Rules not processed for user `dee261de1c2f4d11bec14593404de7a4`. Rule list: `[]` (Enabled: `True`). {{(pid=352329) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 08:58:40.767460 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.fernet_utils [None req-b1a5792b-46b2-4921-8d29-c7ed92010ff4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=352329) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:58:40.822196 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG dbcounter [-] [352329] Writing DB stats keystone:SELECT=100 {{(pid=352329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:58:40.873215 dv-cinder-851351-1-smb devstack@keystone.service[352329]: [pid: 352329|app: 0|req: 648/1316] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 08:58:40 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 08:58:40.915850 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a117d60c-1f43-4119-97e2-ebba2176b78b None None] Authenticating user token {{(pid=352328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:58:40.917464 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.fernet_utils [None req-a117d60c-1f43-4119-97e2-ebba2176b78b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=352328) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:58:40.927711 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG dbcounter [-] [352328] Writing DB stats keystone:SELECT=100 {{(pid=352328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:58:41.030013 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a117d60c-1f43-4119-97e2-ebba2176b78b None None] Validating token access rules against request {{(pid=352328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:58:41.113309 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426171b6-9b01-431c-86b8-f30fde725bf6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '129f505b6d004c8a949020bd2113e32d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9cfa053c839a4fedacde7163d907e2a4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:58:41.113951 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426171b6-9b01-431c-86b8-f30fde725bf6 service neutron] REQUEST_METHOD: `GET` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:58:41.114254 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426171b6-9b01-431c-86b8-f30fde725bf6 service neutron] SCRIPT_NAME: `/identity` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:58:41.114522 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426171b6-9b01-431c-86b8-f30fde725bf6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:58:41.116201 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.fernet_utils [None req-426171b6-9b01-431c-86b8-f30fde725bf6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=352328) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:58:41.185337 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG dbcounter [-] [352328] Writing DB stats keystone:SELECT=100 {{(pid=352328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:58:41.235511 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-426171b6-9b01-431c-86b8-f30fde725bf6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:58:41.237020 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-426171b6-9b01-431c-86b8-f30fde725bf6 service neutron] RBAC: Authorization granted {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:58:41.255986 dv-cinder-851351-1-smb devstack@keystone.service[352328]: [pid: 352328|app: 0|req: 669/1317] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Jul 28 08:58:40 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 28 08:58:43.824993 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd73ef3b-9b5e-4eaf-b37f-5037bb916c13 None None] REQUEST_METHOD: `GET` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:58:43.825575 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd73ef3b-9b5e-4eaf-b37f-5037bb916c13 None None] SCRIPT_NAME: `/identity` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:58:43.825575 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd73ef3b-9b5e-4eaf-b37f-5037bb916c13 None None] PATH_INFO: `/` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:58:43.827282 dv-cinder-851351-1-smb devstack@keystone.service[352329]: [pid: 352329|app: 0|req: 649/1318] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 08:58:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 08:58:43.833121 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de367f6-90b2-4f0a-b541-3b523d010203 None None] REQUEST_METHOD: `POST` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:58:43.833554 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de367f6-90b2-4f0a-b541-3b523d010203 None None] SCRIPT_NAME: `/identity` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:58:43.833659 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de367f6-90b2-4f0a-b541-3b523d010203 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:58:43.901500 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.auth.core [None req-1de367f6-90b2-4f0a-b541-3b523d010203 None None] MFA Rules not processed for user `d18c063b2377412485965357671e5506`. Rule list: `[]` (Enabled: `True`). {{(pid=352328) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 08:58:43.902753 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.fernet_utils [None req-1de367f6-90b2-4f0a-b541-3b523d010203 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=352328) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:58:44.006777 dv-cinder-851351-1-smb devstack@keystone.service[352328]: [pid: 352328|app: 0|req: 670/1319] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 08:58:43 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 08:58:44.045338 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd73ef3b-9b5e-4eaf-b37f-5037bb916c13 None None] Authenticating user token {{(pid=352329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:58:44.047023 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.fernet_utils [None req-bd73ef3b-9b5e-4eaf-b37f-5037bb916c13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=352329) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:58:44.157015 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd73ef3b-9b5e-4eaf-b37f-5037bb916c13 None None] Validating token access rules against request {{(pid=352329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:58:44.235798 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0bb3a5-8a70-412a-9604-a098d965b12c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '129f505b6d004c8a949020bd2113e32d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9cfa053c839a4fedacde7163d907e2a4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:58:44.236418 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0bb3a5-8a70-412a-9604-a098d965b12c service neutron] REQUEST_METHOD: `GET` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:58:44.236709 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0bb3a5-8a70-412a-9604-a098d965b12c service neutron] SCRIPT_NAME: `/identity` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:58:44.236993 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0bb3a5-8a70-412a-9604-a098d965b12c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:58:44.238620 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.fernet_utils [None req-ee0bb3a5-8a70-412a-9604-a098d965b12c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=352329) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:58:44.246386 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG dbcounter [-] [352329] Writing DB stats keystone:SELECT=100 {{(pid=352329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:58:44.353369 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee0bb3a5-8a70-412a-9604-a098d965b12c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:58:44.355261 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee0bb3a5-8a70-412a-9604-a098d965b12c service neutron] RBAC: Authorization granted {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:58:44.376236 dv-cinder-851351-1-smb devstack@keystone.service[352329]: [pid: 352329|app: 0|req: 650/1320] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Jul 28 08:58:44 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 08:58:47.087833 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216de705-712a-4fa7-b07a-0ff3c8210745 None None] REQUEST_METHOD: `GET` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:58:47.088414 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216de705-712a-4fa7-b07a-0ff3c8210745 None None] SCRIPT_NAME: `/identity` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:58:47.088414 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216de705-712a-4fa7-b07a-0ff3c8210745 None None] PATH_INFO: `/` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:58:47.091614 dv-cinder-851351-1-smb devstack@keystone.service[352328]: [pid: 352328|app: 0|req: 671/1321] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 08:58:47 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 08:58:47.095330 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07726a6-a95f-452a-9cf3-9505e8ef4f90 None None] REQUEST_METHOD: `POST` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:58:47.095781 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07726a6-a95f-452a-9cf3-9505e8ef4f90 None None] SCRIPT_NAME: `/identity` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:58:47.095896 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07726a6-a95f-452a-9cf3-9505e8ef4f90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:58:47.166617 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.auth.core [None req-f07726a6-a95f-452a-9cf3-9505e8ef4f90 None None] MFA Rules not processed for user `d18c063b2377412485965357671e5506`. Rule list: `[]` (Enabled: `True`). {{(pid=352329) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 08:58:47.168212 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.fernet_utils [None req-f07726a6-a95f-452a-9cf3-9505e8ef4f90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=352329) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:58:47.234745 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG dbcounter [-] [352329] Writing DB stats keystone:SELECT=100 {{(pid=352329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:58:47.283177 dv-cinder-851351-1-smb devstack@keystone.service[352329]: [pid: 352329|app: 0|req: 651/1322] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 08:58:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 08:58:47.337767 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3edde6-10b2-4e55-9dc4-b6058a220beb None None] REQUEST_METHOD: `GET` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:58:47.338028 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3edde6-10b2-4e55-9dc4-b6058a220beb None None] SCRIPT_NAME: `/identity` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:58:47.338326 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3edde6-10b2-4e55-9dc4-b6058a220beb None None] PATH_INFO: `/` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:58:47.339771 dv-cinder-851351-1-smb devstack@keystone.service[352328]: [pid: 352328|app: 0|req: 672/1323] 10.222.0.42 () {54 vars in 965 bytes} [Thu Jul 28 08:58:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 08:58:47.346612 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43def6d5-5bc4-49b0-83e7-faa73d80407e None None] REQUEST_METHOD: `POST` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:58:47.346903 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43def6d5-5bc4-49b0-83e7-faa73d80407e None None] SCRIPT_NAME: `/identity` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:58:47.347175 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43def6d5-5bc4-49b0-83e7-faa73d80407e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:58:47.433093 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.auth.core [None req-43def6d5-5bc4-49b0-83e7-faa73d80407e None None] MFA Rules not processed for user `129f505b6d004c8a949020bd2113e32d`. Rule list: `[]` (Enabled: `True`). {{(pid=352329) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 08:58:47.434344 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.fernet_utils [None req-43def6d5-5bc4-49b0-83e7-faa73d80407e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=352329) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:58:47.519828 dv-cinder-851351-1-smb devstack@keystone.service[352329]: [pid: 352329|app: 0|req: 652/1324] 10.222.0.42 () {58 vars in 1062 bytes} [Thu Jul 28 08:58:47 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 08:58:47.529377 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce3edde6-10b2-4e55-9dc4-b6058a220beb None None] Authenticating user token {{(pid=352328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:58:47.530951 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.fernet_utils [None req-ce3edde6-10b2-4e55-9dc4-b6058a220beb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=352328) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:58:47.551552 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG dbcounter [-] [352328] Writing DB stats keystone:SELECT=100 {{(pid=352328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:58:47.651387 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce3edde6-10b2-4e55-9dc4-b6058a220beb None None] Validating token access rules against request {{(pid=352328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:58:47.729762 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b92d5b-691f-40a4-869e-567b819ab275 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '129f505b6d004c8a949020bd2113e32d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9cfa053c839a4fedacde7163d907e2a4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:58:47.730339 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b92d5b-691f-40a4-869e-567b819ab275 service neutron] REQUEST_METHOD: `GET` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:58:47.730620 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b92d5b-691f-40a4-869e-567b819ab275 service neutron] SCRIPT_NAME: `/identity` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:58:47.730894 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b92d5b-691f-40a4-869e-567b819ab275 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:58:47.732625 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.fernet_utils [None req-53b92d5b-691f-40a4-869e-567b819ab275 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=352328) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:58:47.807837 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG dbcounter [-] [352328] Writing DB stats keystone:SELECT=100 {{(pid=352328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:58:47.847883 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53b92d5b-691f-40a4-869e-567b819ab275 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:58:47.849385 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53b92d5b-691f-40a4-869e-567b819ab275 service neutron] RBAC: Authorization granted {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:58:47.869020 dv-cinder-851351-1-smb devstack@keystone.service[352328]: [pid: 352328|app: 0|req: 673/1325] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Jul 28 08:58:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 340 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 08:58:50.147296 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0bd8bee-0d19-4eb3-94bb-bbab77822af9 None None] REQUEST_METHOD: `GET` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:58:50.147774 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0bd8bee-0d19-4eb3-94bb-bbab77822af9 None None] SCRIPT_NAME: `/identity` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:58:50.147850 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0bd8bee-0d19-4eb3-94bb-bbab77822af9 None None] PATH_INFO: `/` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:58:50.149474 dv-cinder-851351-1-smb devstack@keystone.service[352329]: [pid: 352329|app: 0|req: 653/1326] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 08:58:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 08:58:50.155596 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8ebdf1-d010-4f69-ad24-1c670e788227 None None] REQUEST_METHOD: `POST` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:58:50.155596 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8ebdf1-d010-4f69-ad24-1c670e788227 None None] SCRIPT_NAME: `/identity` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:58:50.156123 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8ebdf1-d010-4f69-ad24-1c670e788227 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:58:50.228410 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.auth.core [None req-eb8ebdf1-d010-4f69-ad24-1c670e788227 None None] MFA Rules not processed for user `d18c063b2377412485965357671e5506`. Rule list: `[]` (Enabled: `True`). {{(pid=352328) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 08:58:50.229760 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.fernet_utils [None req-eb8ebdf1-d010-4f69-ad24-1c670e788227 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=352328) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:58:50.336793 dv-cinder-851351-1-smb devstack@keystone.service[352328]: [pid: 352328|app: 0|req: 674/1327] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 08:58:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 08:58:50.373184 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0bd8bee-0d19-4eb3-94bb-bbab77822af9 None None] Authenticating user token {{(pid=352329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:58:50.374783 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.fernet_utils [None req-c0bd8bee-0d19-4eb3-94bb-bbab77822af9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=352329) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:58:50.444947 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG dbcounter [-] [352329] Writing DB stats keystone:SELECT=100 {{(pid=352329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:58:50.495498 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0bd8bee-0d19-4eb3-94bb-bbab77822af9 None None] Validating token access rules against request {{(pid=352329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:58:50.576456 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05486395-6730-48bf-8bda-0c378a8d6714 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '129f505b6d004c8a949020bd2113e32d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9cfa053c839a4fedacde7163d907e2a4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:58:50.577300 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05486395-6730-48bf-8bda-0c378a8d6714 service neutron] REQUEST_METHOD: `GET` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:58:50.577940 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05486395-6730-48bf-8bda-0c378a8d6714 service neutron] SCRIPT_NAME: `/identity` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:58:50.578239 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05486395-6730-48bf-8bda-0c378a8d6714 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:58:50.580260 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.fernet_utils [None req-05486395-6730-48bf-8bda-0c378a8d6714 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=352329) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:58:50.694744 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG dbcounter [-] [352329] Writing DB stats keystone:SELECT=100 {{(pid=352329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:58:50.697191 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05486395-6730-48bf-8bda-0c378a8d6714 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:58:50.698724 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05486395-6730-48bf-8bda-0c378a8d6714 service neutron] RBAC: Authorization granted {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:58:50.718121 dv-cinder-851351-1-smb devstack@keystone.service[352329]: [pid: 352329|app: 0|req: 654/1328] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Jul 28 08:58:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 345 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 08:58:52.791070 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30166948-a7ca-4775-8669-60576bf1ccf0 None None] REQUEST_METHOD: `GET` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:58:52.791624 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30166948-a7ca-4775-8669-60576bf1ccf0 None None] SCRIPT_NAME: `/identity` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:58:52.791624 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30166948-a7ca-4775-8669-60576bf1ccf0 None None] PATH_INFO: `/` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:58:52.793089 dv-cinder-851351-1-smb devstack@keystone.service[352328]: [pid: 352328|app: 0|req: 675/1329] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 08:58:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 28 08:58:52.798342 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034bb11f-9118-4e80-bd9b-0a72edc322d8 None None] REQUEST_METHOD: `POST` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:58:52.798767 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034bb11f-9118-4e80-bd9b-0a72edc322d8 None None] SCRIPT_NAME: `/identity` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:58:52.798900 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034bb11f-9118-4e80-bd9b-0a72edc322d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:58:52.870015 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.auth.core [None req-034bb11f-9118-4e80-bd9b-0a72edc322d8 None None] MFA Rules not processed for user `dee261de1c2f4d11bec14593404de7a4`. Rule list: `[]` (Enabled: `True`). {{(pid=352329) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 08:58:52.871257 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.fernet_utils [None req-034bb11f-9118-4e80-bd9b-0a72edc322d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=352329) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:58:52.972493 dv-cinder-851351-1-smb devstack@keystone.service[352329]: [pid: 352329|app: 0|req: 655/1330] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 08:58:52 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 08:58:53.014230 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30166948-a7ca-4775-8669-60576bf1ccf0 None None] Authenticating user token {{(pid=352328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:58:53.015804 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.fernet_utils [None req-30166948-a7ca-4775-8669-60576bf1ccf0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=352328) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:58:53.048089 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG dbcounter [-] [352328] Writing DB stats keystone:SELECT=100 {{(pid=352328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:58:53.129793 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30166948-a7ca-4775-8669-60576bf1ccf0 None None] Validating token access rules against request {{(pid=352328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:58:53.209080 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147140a0-ef56-407a-abfd-a37ae341105b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '129f505b6d004c8a949020bd2113e32d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9cfa053c839a4fedacde7163d907e2a4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:58:53.209731 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147140a0-ef56-407a-abfd-a37ae341105b service neutron] REQUEST_METHOD: `GET` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:58:53.209990 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147140a0-ef56-407a-abfd-a37ae341105b service neutron] SCRIPT_NAME: `/identity` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:58:53.210283 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147140a0-ef56-407a-abfd-a37ae341105b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:58:53.212057 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.fernet_utils [None req-147140a0-ef56-407a-abfd-a37ae341105b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=352328) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:58:53.294236 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG dbcounter [-] [352328] Writing DB stats keystone:SELECT=100 {{(pid=352328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:58:53.328892 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-147140a0-ef56-407a-abfd-a37ae341105b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:58:53.330358 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-147140a0-ef56-407a-abfd-a37ae341105b service neutron] RBAC: Authorization granted {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:58:53.348987 dv-cinder-851351-1-smb devstack@keystone.service[352328]: [pid: 352328|app: 0|req: 676/1331] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Jul 28 08:58:53 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 335 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 08:58:55.748491 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a81ca5-c0a1-493a-96e9-ab9e78759a1f None None] REQUEST_METHOD: `GET` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:58:55.749104 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a81ca5-c0a1-493a-96e9-ab9e78759a1f None None] SCRIPT_NAME: `/identity` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:58:55.749104 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a81ca5-c0a1-493a-96e9-ab9e78759a1f None None] PATH_INFO: `/` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:58:55.750469 dv-cinder-851351-1-smb devstack@keystone.service[352329]: [pid: 352329|app: 0|req: 656/1332] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 08:58:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 08:58:55.756079 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2344e986-ba6a-4964-b403-073dd45c7751 None None] REQUEST_METHOD: `POST` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:58:55.756565 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2344e986-ba6a-4964-b403-073dd45c7751 None None] SCRIPT_NAME: `/identity` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:58:55.756649 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2344e986-ba6a-4964-b403-073dd45c7751 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:58:55.842453 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.auth.core [None req-2344e986-ba6a-4964-b403-073dd45c7751 None None] MFA Rules not processed for user `d18c063b2377412485965357671e5506`. Rule list: `[]` (Enabled: `True`). {{(pid=352328) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 08:58:55.843697 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.fernet_utils [None req-2344e986-ba6a-4964-b403-073dd45c7751 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=352328) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:58:55.947527 dv-cinder-851351-1-smb devstack@keystone.service[352328]: [pid: 352328|app: 0|req: 677/1333] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 08:58:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 08:58:55.985327 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a81ca5-c0a1-493a-96e9-ab9e78759a1f None None] Authenticating user token {{(pid=352329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:58:55.986905 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.fernet_utils [None req-46a81ca5-c0a1-493a-96e9-ab9e78759a1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=352329) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:58:56.065421 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG dbcounter [-] [352329] Writing DB stats keystone:SELECT=100 {{(pid=352329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:58:56.106264 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a81ca5-c0a1-493a-96e9-ab9e78759a1f None None] Validating token access rules against request {{(pid=352329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:58:56.185629 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c28d3f7-8f66-4f3b-873d-6d99278ab203 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '129f505b6d004c8a949020bd2113e32d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9cfa053c839a4fedacde7163d907e2a4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:58:56.186391 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c28d3f7-8f66-4f3b-873d-6d99278ab203 service neutron] REQUEST_METHOD: `GET` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:58:56.186731 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c28d3f7-8f66-4f3b-873d-6d99278ab203 service neutron] SCRIPT_NAME: `/identity` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:58:56.187093 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c28d3f7-8f66-4f3b-873d-6d99278ab203 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:58:56.189275 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.fernet_utils [None req-8c28d3f7-8f66-4f3b-873d-6d99278ab203 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=352329) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:58:56.315221 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c28d3f7-8f66-4f3b-873d-6d99278ab203 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:58:56.316594 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c28d3f7-8f66-4f3b-873d-6d99278ab203 service neutron] RBAC: Authorization granted {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:58:56.328443 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG dbcounter [-] [352329] Writing DB stats keystone:SELECT=100 {{(pid=352329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:58:56.337970 dv-cinder-851351-1-smb devstack@keystone.service[352329]: [pid: 352329|app: 0|req: 657/1334] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Jul 28 08:58:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 353 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 08:58:58.399444 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa156286-125e-497d-851f-dfb7c2f402e4 None None] REQUEST_METHOD: `GET` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:58:58.400026 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa156286-125e-497d-851f-dfb7c2f402e4 None None] SCRIPT_NAME: `/identity` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:58:58.400026 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa156286-125e-497d-851f-dfb7c2f402e4 None None] PATH_INFO: `/` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:58:58.401420 dv-cinder-851351-1-smb devstack@keystone.service[352328]: [pid: 352328|app: 0|req: 678/1335] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 08:58:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 08:58:58.407028 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66f74d6-ced8-4624-8088-a302939f51b7 None None] REQUEST_METHOD: `POST` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:58:58.407473 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66f74d6-ced8-4624-8088-a302939f51b7 None None] SCRIPT_NAME: `/identity` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:58:58.407579 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66f74d6-ced8-4624-8088-a302939f51b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:58:58.478646 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.auth.core [None req-e66f74d6-ced8-4624-8088-a302939f51b7 None None] MFA Rules not processed for user `d18c063b2377412485965357671e5506`. Rule list: `[]` (Enabled: `True`). {{(pid=352329) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 08:58:58.479909 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.fernet_utils [None req-e66f74d6-ced8-4624-8088-a302939f51b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=352329) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:58:58.581269 dv-cinder-851351-1-smb devstack@keystone.service[352329]: [pid: 352329|app: 0|req: 658/1336] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 08:58:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 08:58:58.621709 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa156286-125e-497d-851f-dfb7c2f402e4 None None] Authenticating user token {{(pid=352328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:58:58.623297 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.fernet_utils [None req-fa156286-125e-497d-851f-dfb7c2f402e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=352328) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:58:58.665053 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG dbcounter [-] [352328] Writing DB stats keystone:SELECT=100 {{(pid=352328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:58:58.731771 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa156286-125e-497d-851f-dfb7c2f402e4 None None] Validating token access rules against request {{(pid=352328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:58:58.809336 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5693edc-e0a9-4e08-ad2d-edd1fa28eedd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '129f505b6d004c8a949020bd2113e32d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9cfa053c839a4fedacde7163d907e2a4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:58:58.809980 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5693edc-e0a9-4e08-ad2d-edd1fa28eedd service neutron] REQUEST_METHOD: `GET` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:58:58.810261 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5693edc-e0a9-4e08-ad2d-edd1fa28eedd service neutron] SCRIPT_NAME: `/identity` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:58:58.810529 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5693edc-e0a9-4e08-ad2d-edd1fa28eedd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:58:58.812189 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.fernet_utils [None req-d5693edc-e0a9-4e08-ad2d-edd1fa28eedd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=352328) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:58:58.900205 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG dbcounter [-] [352328] Writing DB stats keystone:SELECT=100 {{(pid=352328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:58:58.929901 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5693edc-e0a9-4e08-ad2d-edd1fa28eedd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:58:58.931308 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5693edc-e0a9-4e08-ad2d-edd1fa28eedd service neutron] RBAC: Authorization granted {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:58:58.952236 dv-cinder-851351-1-smb devstack@keystone.service[352328]: [pid: 352328|app: 0|req: 679/1337] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Jul 28 08:58:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 08:59:01.297875 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0499726-33a4-4b53-95c1-94bf9bc4563a None None] REQUEST_METHOD: `GET` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:59:01.298415 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0499726-33a4-4b53-95c1-94bf9bc4563a None None] SCRIPT_NAME: `/identity` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:59:01.298415 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0499726-33a4-4b53-95c1-94bf9bc4563a None None] PATH_INFO: `/` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:59:01.299813 dv-cinder-851351-1-smb devstack@keystone.service[352329]: [pid: 352329|app: 0|req: 659/1338] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 08:59:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 08:59:01.306045 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166ddc65-f618-48e2-81bf-bcd9389a55cb None None] REQUEST_METHOD: `POST` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:59:01.306586 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166ddc65-f618-48e2-81bf-bcd9389a55cb None None] SCRIPT_NAME: `/identity` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:59:01.306586 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166ddc65-f618-48e2-81bf-bcd9389a55cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:59:01.381687 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.auth.core [None req-166ddc65-f618-48e2-81bf-bcd9389a55cb None None] MFA Rules not processed for user `d18c063b2377412485965357671e5506`. Rule list: `[]` (Enabled: `True`). {{(pid=352328) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 08:59:01.385295 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.fernet_utils [None req-166ddc65-f618-48e2-81bf-bcd9389a55cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=352328) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:59:01.497043 dv-cinder-851351-1-smb devstack@keystone.service[352328]: [pid: 352328|app: 0|req: 680/1339] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 08:59:01 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 08:59:01.533777 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0499726-33a4-4b53-95c1-94bf9bc4563a None None] Authenticating user token {{(pid=352329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:59:01.535339 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.fernet_utils [None req-e0499726-33a4-4b53-95c1-94bf9bc4563a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=352329) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:59:01.650275 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG dbcounter [-] [352329] Writing DB stats keystone:SELECT=100 {{(pid=352329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:59:01.680293 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0499726-33a4-4b53-95c1-94bf9bc4563a None None] Validating token access rules against request {{(pid=352329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:59:01.760425 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1cf1d2-d7e6-4519-ad78-54e89691ad17 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '129f505b6d004c8a949020bd2113e32d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9cfa053c839a4fedacde7163d907e2a4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:59:01.761295 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1cf1d2-d7e6-4519-ad78-54e89691ad17 service neutron] REQUEST_METHOD: `GET` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:59:01.761551 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1cf1d2-d7e6-4519-ad78-54e89691ad17 service neutron] SCRIPT_NAME: `/identity` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:59:01.761850 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1cf1d2-d7e6-4519-ad78-54e89691ad17 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:59:01.763854 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.fernet_utils [None req-ed1cf1d2-d7e6-4519-ad78-54e89691ad17 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=352329) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:59:01.887399 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed1cf1d2-d7e6-4519-ad78-54e89691ad17 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:59:01.889319 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed1cf1d2-d7e6-4519-ad78-54e89691ad17 service neutron] RBAC: Authorization granted {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:59:01.908506 dv-cinder-851351-1-smb devstack@keystone.service[352329]: [pid: 352329|app: 0|req: 660/1340] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Jul 28 08:59:01 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 375 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 08:59:05.991843 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29082d60-a990-4f4d-ae9e-cbc4a4b26de6 None None] REQUEST_METHOD: `GET` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:59:05.992326 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29082d60-a990-4f4d-ae9e-cbc4a4b26de6 None None] SCRIPT_NAME: `/identity` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:59:05.992585 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29082d60-a990-4f4d-ae9e-cbc4a4b26de6 None None] PATH_INFO: `/` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:59:05.994055 dv-cinder-851351-1-smb devstack@keystone.service[352328]: [pid: 352328|app: 0|req: 681/1341] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 08:59:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 08:59:05.999684 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23d5382-ef27-4b13-af60-e8129892cc9a None None] REQUEST_METHOD: `POST` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:59:06.000175 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23d5382-ef27-4b13-af60-e8129892cc9a None None] SCRIPT_NAME: `/identity` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:59:06.000263 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23d5382-ef27-4b13-af60-e8129892cc9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:59:06.006577 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG dbcounter [-] [352329] Writing DB stats keystone:SELECT=100 {{(pid=352329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:59:06.078731 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.auth.core [None req-d23d5382-ef27-4b13-af60-e8129892cc9a None None] MFA Rules not processed for user `d18c063b2377412485965357671e5506`. Rule list: `[]` (Enabled: `True`). {{(pid=352329) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 08:59:06.079961 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.fernet_utils [None req-d23d5382-ef27-4b13-af60-e8129892cc9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=352329) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:59:06.185549 dv-cinder-851351-1-smb devstack@keystone.service[352329]: [pid: 352329|app: 0|req: 661/1342] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 08:59:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 08:59:06.225372 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29082d60-a990-4f4d-ae9e-cbc4a4b26de6 None None] Authenticating user token {{(pid=352328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:59:06.227068 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.fernet_utils [None req-29082d60-a990-4f4d-ae9e-cbc4a4b26de6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=352328) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:59:06.277311 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG dbcounter [-] [352328] Writing DB stats keystone:SELECT=100 {{(pid=352328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:59:06.336085 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29082d60-a990-4f4d-ae9e-cbc4a4b26de6 None None] Validating token access rules against request {{(pid=352328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:59:06.410104 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ec18d9-fe53-4bf2-b68e-91854bf3c8ce service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '129f505b6d004c8a949020bd2113e32d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9cfa053c839a4fedacde7163d907e2a4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:59:06.410656 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ec18d9-fe53-4bf2-b68e-91854bf3c8ce service neutron] REQUEST_METHOD: `GET` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:59:06.410926 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ec18d9-fe53-4bf2-b68e-91854bf3c8ce service neutron] SCRIPT_NAME: `/identity` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:59:06.411192 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ec18d9-fe53-4bf2-b68e-91854bf3c8ce service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:59:06.412854 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.fernet_utils [None req-23ec18d9-fe53-4bf2-b68e-91854bf3c8ce service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=352328) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:59:06.511345 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG dbcounter [-] [352328] Writing DB stats keystone:SELECT=100 {{(pid=352328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:59:06.531355 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23ec18d9-fe53-4bf2-b68e-91854bf3c8ce service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:59:06.533577 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23ec18d9-fe53-4bf2-b68e-91854bf3c8ce service neutron] RBAC: Authorization granted {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:59:06.552375 dv-cinder-851351-1-smb devstack@keystone.service[352328]: [pid: 352328|app: 0|req: 682/1343] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Jul 28 08:59:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 08:59:09.376438 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6ffb3b-1a16-45b7-bdac-f3bdb9c2d6de None None] REQUEST_METHOD: `GET` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:59:09.377116 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6ffb3b-1a16-45b7-bdac-f3bdb9c2d6de None None] SCRIPT_NAME: `/identity` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:59:09.377116 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6ffb3b-1a16-45b7-bdac-f3bdb9c2d6de None None] PATH_INFO: `/` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:59:09.378442 dv-cinder-851351-1-smb devstack@keystone.service[352329]: [pid: 352329|app: 0|req: 662/1344] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 08:59:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 08:59:09.385455 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed256272-889b-40cc-9624-86cf8f11285c None None] REQUEST_METHOD: `POST` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:59:09.386010 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed256272-889b-40cc-9624-86cf8f11285c None None] SCRIPT_NAME: `/identity` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:59:09.386319 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed256272-889b-40cc-9624-86cf8f11285c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:59:09.496935 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.auth.core [None req-ed256272-889b-40cc-9624-86cf8f11285c None None] MFA Rules not processed for user `d18c063b2377412485965357671e5506`. Rule list: `[]` (Enabled: `True`). {{(pid=352328) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 08:59:09.498201 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.fernet_utils [None req-ed256272-889b-40cc-9624-86cf8f11285c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=352328) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:59:09.688270 dv-cinder-851351-1-smb devstack@keystone.service[352328]: [pid: 352328|app: 0|req: 683/1345] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 08:59:09 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 305 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 08:59:09.746915 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6ffb3b-1a16-45b7-bdac-f3bdb9c2d6de None None] Authenticating user token {{(pid=352329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:59:09.748635 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.fernet_utils [None req-9f6ffb3b-1a16-45b7-bdac-f3bdb9c2d6de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=352329) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:59:09.881759 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG dbcounter [-] [352329] Writing DB stats keystone:SELECT=100 {{(pid=352329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:59:09.904490 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6ffb3b-1a16-45b7-bdac-f3bdb9c2d6de None None] Validating token access rules against request {{(pid=352329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:59:10.013412 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c4f05a-3da6-4814-856c-3a18d9d44a09 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '129f505b6d004c8a949020bd2113e32d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9cfa053c839a4fedacde7163d907e2a4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:59:10.014566 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c4f05a-3da6-4814-856c-3a18d9d44a09 service neutron] REQUEST_METHOD: `GET` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:59:10.015064 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c4f05a-3da6-4814-856c-3a18d9d44a09 service neutron] SCRIPT_NAME: `/identity` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:59:10.015542 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c4f05a-3da6-4814-856c-3a18d9d44a09 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:59:10.018852 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.fernet_utils [None req-59c4f05a-3da6-4814-856c-3a18d9d44a09 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=352329) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:59:10.210660 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59c4f05a-3da6-4814-856c-3a18d9d44a09 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:59:10.212165 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59c4f05a-3da6-4814-856c-3a18d9d44a09 service neutron] RBAC: Authorization granted {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:59:10.243940 dv-cinder-851351-1-smb devstack@keystone.service[352329]: [pid: 352329|app: 0|req: 663/1346] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Jul 28 08:59:09 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 498 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 08:59:14.974330 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c70aa7c-46a4-4695-b9b6-d5a7dbbfe444 None None] REQUEST_METHOD: `GET` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:59:14.974878 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c70aa7c-46a4-4695-b9b6-d5a7dbbfe444 None None] SCRIPT_NAME: `/identity` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:59:14.974878 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c70aa7c-46a4-4695-b9b6-d5a7dbbfe444 None None] PATH_INFO: `/` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:59:14.976378 dv-cinder-851351-1-smb devstack@keystone.service[352328]: [pid: 352328|app: 0|req: 684/1347] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 08:59:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 08:59:14.982630 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276a7f8a-2154-4557-b077-9f4ca3de8f04 None None] REQUEST_METHOD: `POST` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:59:14.983187 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276a7f8a-2154-4557-b077-9f4ca3de8f04 None None] SCRIPT_NAME: `/identity` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:59:14.983187 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276a7f8a-2154-4557-b077-9f4ca3de8f04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:59:15.001297 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG dbcounter [-] [352329] Writing DB stats keystone:SELECT=100 {{(pid=352329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:59:15.071455 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.auth.core [None req-276a7f8a-2154-4557-b077-9f4ca3de8f04 None None] MFA Rules not processed for user `d18c063b2377412485965357671e5506`. Rule list: `[]` (Enabled: `True`). {{(pid=352329) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 08:59:15.072905 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.fernet_utils [None req-276a7f8a-2154-4557-b077-9f4ca3de8f04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=352329) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:59:15.202729 dv-cinder-851351-1-smb devstack@keystone.service[352329]: [pid: 352329|app: 0|req: 664/1348] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 08:59:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 08:59:15.248102 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c70aa7c-46a4-4695-b9b6-d5a7dbbfe444 None None] Authenticating user token {{(pid=352328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:59:15.250221 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.fernet_utils [None req-4c70aa7c-46a4-4695-b9b6-d5a7dbbfe444 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=352328) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:59:15.346544 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG dbcounter [-] [352328] Writing DB stats keystone:SELECT=100 {{(pid=352328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:59:15.403623 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c70aa7c-46a4-4695-b9b6-d5a7dbbfe444 None None] Validating token access rules against request {{(pid=352328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:59:15.516780 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f1000ff-5a47-465e-8f33-6c1471d58316 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '129f505b6d004c8a949020bd2113e32d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9cfa053c839a4fedacde7163d907e2a4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:59:15.517924 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1000ff-5a47-465e-8f33-6c1471d58316 service neutron] REQUEST_METHOD: `GET` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:59:15.518462 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1000ff-5a47-465e-8f33-6c1471d58316 service neutron] SCRIPT_NAME: `/identity` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:59:15.518907 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1000ff-5a47-465e-8f33-6c1471d58316 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:59:15.522164 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.fernet_utils [None req-3f1000ff-5a47-465e-8f33-6c1471d58316 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=352328) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:59:15.664441 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG dbcounter [-] [352328] Writing DB stats keystone:SELECT=100 {{(pid=352328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:59:15.668828 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f1000ff-5a47-465e-8f33-6c1471d58316 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:59:15.671018 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f1000ff-5a47-465e-8f33-6c1471d58316 service neutron] RBAC: Authorization granted {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:59:15.693730 dv-cinder-851351-1-smb devstack@keystone.service[352328]: [pid: 352328|app: 0|req: 685/1349] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Jul 28 08:59:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 447 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 08:59:21.328300 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e44c7c-23a5-4790-be81-8c3417ee721f None None] REQUEST_METHOD: `GET` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:59:21.328300 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e44c7c-23a5-4790-be81-8c3417ee721f None None] SCRIPT_NAME: `/identity` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:59:21.328300 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e44c7c-23a5-4790-be81-8c3417ee721f None None] PATH_INFO: `/` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:59:21.333440 dv-cinder-851351-1-smb devstack@keystone.service[352329]: [pid: 352329|app: 0|req: 665/1350] 10.222.0.42 () {54 vars in 921 bytes} [Thu Jul 28 08:59:21 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 08:59:21.342503 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dfc8687-6fd1-4ae1-b5bb-8b96bf7bd01f None None] REQUEST_METHOD: `POST` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:59:21.345371 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dfc8687-6fd1-4ae1-b5bb-8b96bf7bd01f None None] SCRIPT_NAME: `/identity` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:59:21.345371 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dfc8687-6fd1-4ae1-b5bb-8b96bf7bd01f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:59:21.454328 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.auth.core [None req-4dfc8687-6fd1-4ae1-b5bb-8b96bf7bd01f None None] MFA Rules not processed for user `9b6ed94c1df745c3bc7adf2769fc5119`. Rule list: `[]` (Enabled: `True`). {{(pid=352328) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 08:59:21.456068 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.fernet_utils [None req-4dfc8687-6fd1-4ae1-b5bb-8b96bf7bd01f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=352328) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:59:21.594614 dv-cinder-851351-1-smb devstack@keystone.service[352328]: [pid: 352328|app: 0|req: 686/1351] 10.222.0.42 () {58 vars in 1018 bytes} [Thu Jul 28 08:59:21 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 254 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 08:59:25.201751 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG dbcounter [-] [352329] Writing DB stats keystone:SELECT=59 {{(pid=352329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:59:26.726435 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6b1a54-d6e5-4a15-97f3-7c11ae4d3eac None None] REQUEST_METHOD: `GET` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:59:26.727257 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6b1a54-d6e5-4a15-97f3-7c11ae4d3eac None None] SCRIPT_NAME: `/identity` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:59:26.727257 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6b1a54-d6e5-4a15-97f3-7c11ae4d3eac None None] PATH_INFO: `/` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:59:26.728988 dv-cinder-851351-1-smb devstack@keystone.service[352329]: [pid: 352329|app: 0|req: 666/1352] 10.222.0.42 () {54 vars in 921 bytes} [Thu Jul 28 08:59:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 28 08:59:26.735409 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3aa351-35f5-4d26-a354-f664c46afa31 None None] REQUEST_METHOD: `POST` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:59:26.735996 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3aa351-35f5-4d26-a354-f664c46afa31 None None] SCRIPT_NAME: `/identity` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:59:26.736162 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3aa351-35f5-4d26-a354-f664c46afa31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:59:26.811324 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG dbcounter [-] [352328] Writing DB stats keystone:SELECT=100 {{(pid=352328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:59:26.851550 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.auth.core [None req-1f3aa351-35f5-4d26-a354-f664c46afa31 None None] MFA Rules not processed for user `9b6ed94c1df745c3bc7adf2769fc5119`. Rule list: `[]` (Enabled: `True`). {{(pid=352328) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 08:59:26.852859 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.fernet_utils [None req-1f3aa351-35f5-4d26-a354-f664c46afa31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=352328) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:59:26.981261 dv-cinder-851351-1-smb devstack@keystone.service[352328]: [pid: 352328|app: 0|req: 687/1353] 10.222.0.42 () {58 vars in 1018 bytes} [Thu Jul 28 08:59:26 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 247 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 08:59:28.657786 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95eee1df-5f98-461e-a9fa-972847c92a2d None None] REQUEST_METHOD: `GET` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:59:28.658407 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95eee1df-5f98-461e-a9fa-972847c92a2d None None] SCRIPT_NAME: `/identity` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:59:28.658407 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95eee1df-5f98-461e-a9fa-972847c92a2d None None] PATH_INFO: `/` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:59:28.659869 dv-cinder-851351-1-smb devstack@keystone.service[352329]: [pid: 352329|app: 0|req: 667/1354] 10.222.0.42 () {54 vars in 921 bytes} [Thu Jul 28 08:59:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 08:59:28.665833 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60efc6e4-a231-4c41-8886-6fede60f930b None None] REQUEST_METHOD: `POST` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:59:28.666396 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60efc6e4-a231-4c41-8886-6fede60f930b None None] SCRIPT_NAME: `/identity` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:59:28.666829 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60efc6e4-a231-4c41-8886-6fede60f930b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:59:28.776045 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.auth.core [None req-60efc6e4-a231-4c41-8886-6fede60f930b None None] MFA Rules not processed for user `9b6ed94c1df745c3bc7adf2769fc5119`. Rule list: `[]` (Enabled: `True`). {{(pid=352328) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 08:59:28.777393 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.fernet_utils [None req-60efc6e4-a231-4c41-8886-6fede60f930b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=352328) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:59:28.834144 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG dbcounter [-] [352328] Writing DB stats keystone:SELECT=100 {{(pid=352328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:59:28.922887 dv-cinder-851351-1-smb devstack@keystone.service[352328]: [pid: 352328|app: 0|req: 688/1355] 10.222.0.42 () {58 vars in 1018 bytes} [Thu Jul 28 08:59:28 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 258 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 08:59:32.325705 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9768f8-fbc1-4b1b-b7f4-3007a0f3c6b5 None None] REQUEST_METHOD: `GET` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:59:32.326390 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9768f8-fbc1-4b1b-b7f4-3007a0f3c6b5 None None] SCRIPT_NAME: `/identity` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:59:32.326390 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9768f8-fbc1-4b1b-b7f4-3007a0f3c6b5 None None] PATH_INFO: `/` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:59:32.328047 dv-cinder-851351-1-smb devstack@keystone.service[352329]: [pid: 352329|app: 0|req: 668/1356] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 08:59:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 08:59:32.334321 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f0e426-90de-4108-af67-d0665d8bd7c4 None None] REQUEST_METHOD: `POST` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:59:32.334927 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f0e426-90de-4108-af67-d0665d8bd7c4 None None] SCRIPT_NAME: `/identity` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:59:32.335024 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f0e426-90de-4108-af67-d0665d8bd7c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:59:32.411524 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.auth.core [None req-b7f0e426-90de-4108-af67-d0665d8bd7c4 None None] MFA Rules not processed for user `d18c063b2377412485965357671e5506`. Rule list: `[]` (Enabled: `True`). {{(pid=352328) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 08:59:32.412835 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.fernet_utils [None req-b7f0e426-90de-4108-af67-d0665d8bd7c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=352328) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:59:32.550735 dv-cinder-851351-1-smb devstack@keystone.service[352328]: [pid: 352328|app: 0|req: 689/1357] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 08:59:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 08:59:32.616990 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a247ed2f-9761-4143-9898-a53a74a9afee None None] REQUEST_METHOD: `GET` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:59:32.617770 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a247ed2f-9761-4143-9898-a53a74a9afee None None] SCRIPT_NAME: `/identity` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:59:32.621513 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a247ed2f-9761-4143-9898-a53a74a9afee None None] PATH_INFO: `/` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:59:32.624630 dv-cinder-851351-1-smb devstack@keystone.service[352329]: [pid: 352329|app: 0|req: 669/1358] 10.222.0.42 () {54 vars in 962 bytes} [Thu Jul 28 08:59:32 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 08:59:32.634441 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269d2864-7450-4dfb-b894-109b36ac00ec None None] REQUEST_METHOD: `POST` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:59:32.634768 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269d2864-7450-4dfb-b894-109b36ac00ec None None] SCRIPT_NAME: `/identity` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:59:32.636178 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269d2864-7450-4dfb-b894-109b36ac00ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:59:32.665559 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG dbcounter [-] [352328] Writing DB stats keystone:SELECT=100 {{(pid=352328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:59:32.816194 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.auth.core [None req-269d2864-7450-4dfb-b894-109b36ac00ec None None] MFA Rules not processed for user `e3ba63c3fc36470fbbe8312b51a13f13`. Rule list: `[]` (Enabled: `True`). {{(pid=352328) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 08:59:32.816880 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.fernet_utils [None req-269d2864-7450-4dfb-b894-109b36ac00ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=352328) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:59:32.995274 dv-cinder-851351-1-smb devstack@keystone.service[352328]: [pid: 352328|app: 0|req: 690/1359] 10.222.0.42 () {58 vars in 1059 bytes} [Thu Jul 28 08:59:32 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 362 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 08:59:33.003986 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a247ed2f-9761-4143-9898-a53a74a9afee None None] Authenticating user token {{(pid=352329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:59:33.012168 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.fernet_utils [None req-a247ed2f-9761-4143-9898-a53a74a9afee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=352329) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:59:33.226367 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a247ed2f-9761-4143-9898-a53a74a9afee None None] Validating token access rules against request {{(pid=352329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:59:33.324470 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG dbcounter [-] [352329] Writing DB stats keystone:SELECT=100 {{(pid=352329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:59:33.378734 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7fa1497-ab23-4626-bc10-5fe44d2cd52a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3ba63c3fc36470fbbe8312b51a13f13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9cfa053c839a4fedacde7163d907e2a4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:59:33.379959 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7fa1497-ab23-4626-bc10-5fe44d2cd52a service nova] REQUEST_METHOD: `GET` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:59:33.379959 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7fa1497-ab23-4626-bc10-5fe44d2cd52a service nova] SCRIPT_NAME: `/identity` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:59:33.379959 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7fa1497-ab23-4626-bc10-5fe44d2cd52a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:59:33.381806 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.fernet_utils [None req-d7fa1497-ab23-4626-bc10-5fe44d2cd52a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=352329) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:59:33.479692 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7fa1497-ab23-4626-bc10-5fe44d2cd52a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:59:33.481654 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7fa1497-ab23-4626-bc10-5fe44d2cd52a service nova] RBAC: Authorization granted {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:59:33.502307 dv-cinder-851351-1-smb devstack@keystone.service[352329]: [pid: 352329|app: 0|req: 670/1360] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Jul 28 08:59:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 499 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 28 08:59:35.983954 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0dab55-5569-4115-8eef-7c04535fd673 None None] REQUEST_METHOD: `GET` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:59:35.984832 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0dab55-5569-4115-8eef-7c04535fd673 None None] SCRIPT_NAME: `/identity` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:59:35.984832 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0dab55-5569-4115-8eef-7c04535fd673 None None] PATH_INFO: `/` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:59:35.986656 dv-cinder-851351-1-smb devstack@keystone.service[352328]: [pid: 352328|app: 0|req: 691/1361] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 08:59:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 08:59:35.994875 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc68b298-932f-45fe-b6cb-7f0c377eeb06 None None] REQUEST_METHOD: `POST` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:59:35.996635 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc68b298-932f-45fe-b6cb-7f0c377eeb06 None None] SCRIPT_NAME: `/identity` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:59:35.996907 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc68b298-932f-45fe-b6cb-7f0c377eeb06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:59:36.136118 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.auth.core [None req-dc68b298-932f-45fe-b6cb-7f0c377eeb06 None None] MFA Rules not processed for user `d18c063b2377412485965357671e5506`. Rule list: `[]` (Enabled: `True`). {{(pid=352329) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 08:59:36.138012 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.fernet_utils [None req-dc68b298-932f-45fe-b6cb-7f0c377eeb06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=352329) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:59:36.213024 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG dbcounter [-] [352329] Writing DB stats keystone:SELECT=100 {{(pid=352329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:59:36.300861 dv-cinder-851351-1-smb devstack@keystone.service[352329]: [pid: 352329|app: 0|req: 671/1362] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 08:59:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 304 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 08:59:36.364330 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0dab55-5569-4115-8eef-7c04535fd673 None None] Authenticating user token {{(pid=352328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:59:36.371556 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.fernet_utils [None req-1d0dab55-5569-4115-8eef-7c04535fd673 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=352328) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:59:36.486411 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG dbcounter [-] [352328] Writing DB stats keystone:SELECT=100 {{(pid=352328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:59:36.612541 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0dab55-5569-4115-8eef-7c04535fd673 None None] Validating token access rules against request {{(pid=352328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:59:36.834769 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26b222f-6785-433c-aaf1-36da4c9d1401 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3ba63c3fc36470fbbe8312b51a13f13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9cfa053c839a4fedacde7163d907e2a4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:59:36.836250 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26b222f-6785-433c-aaf1-36da4c9d1401 service nova] REQUEST_METHOD: `GET` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:59:36.840937 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26b222f-6785-433c-aaf1-36da4c9d1401 service nova] SCRIPT_NAME: `/identity` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:59:36.841338 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26b222f-6785-433c-aaf1-36da4c9d1401 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:59:36.843138 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.fernet_utils [None req-d26b222f-6785-433c-aaf1-36da4c9d1401 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=352328) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:59:36.870459 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG dbcounter [-] [352328] Writing DB stats keystone:SELECT=100 {{(pid=352328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:59:36.967130 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d26b222f-6785-433c-aaf1-36da4c9d1401 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:59:36.968919 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d26b222f-6785-433c-aaf1-36da4c9d1401 service nova] RBAC: Authorization granted {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:59:36.989761 dv-cinder-851351-1-smb devstack@keystone.service[352328]: [pid: 352328|app: 0|req: 692/1363] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Jul 28 08:59:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 627 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 28 08:59:39.550608 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4beabbf9-14bf-4712-98ab-b9a477e06839 None None] REQUEST_METHOD: `GET` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:59:39.551144 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4beabbf9-14bf-4712-98ab-b9a477e06839 None None] SCRIPT_NAME: `/identity` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:59:39.551144 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4beabbf9-14bf-4712-98ab-b9a477e06839 None None] PATH_INFO: `/` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:59:39.552907 dv-cinder-851351-1-smb devstack@keystone.service[352329]: [pid: 352329|app: 0|req: 672/1364] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 08:59:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 08:59:39.562889 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b1a5a3-877e-4979-aa14-5688fd24a5b1 None None] REQUEST_METHOD: `POST` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:59:39.562889 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b1a5a3-877e-4979-aa14-5688fd24a5b1 None None] SCRIPT_NAME: `/identity` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:59:39.562889 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b1a5a3-877e-4979-aa14-5688fd24a5b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:59:39.646854 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.auth.core [None req-01b1a5a3-877e-4979-aa14-5688fd24a5b1 None None] MFA Rules not processed for user `d18c063b2377412485965357671e5506`. Rule list: `[]` (Enabled: `True`). {{(pid=352328) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 08:59:39.648775 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.fernet_utils [None req-01b1a5a3-877e-4979-aa14-5688fd24a5b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=352328) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:59:39.758214 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG dbcounter [-] [352328] Writing DB stats keystone:SELECT=100 {{(pid=352328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:59:39.766033 dv-cinder-851351-1-smb devstack@keystone.service[352328]: [pid: 352328|app: 0|req: 693/1365] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 08:59:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 08:59:39.812019 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ba7367-7eb2-4182-a670-d8f5270532dc None None] REQUEST_METHOD: `GET` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:59:39.812468 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ba7367-7eb2-4182-a670-d8f5270532dc None None] SCRIPT_NAME: `/identity` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:59:39.812805 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ba7367-7eb2-4182-a670-d8f5270532dc None None] PATH_INFO: `/` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:59:39.814868 dv-cinder-851351-1-smb devstack@keystone.service[352329]: [pid: 352329|app: 0|req: 673/1366] 10.222.0.42 () {54 vars in 962 bytes} [Thu Jul 28 08:59:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 08:59:39.822018 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb237dcd-8621-4b3b-892c-956d76fd0dd1 None None] REQUEST_METHOD: `POST` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:59:39.822355 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb237dcd-8621-4b3b-892c-956d76fd0dd1 None None] SCRIPT_NAME: `/identity` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:59:39.822611 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb237dcd-8621-4b3b-892c-956d76fd0dd1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:59:39.924804 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.auth.core [None req-eb237dcd-8621-4b3b-892c-956d76fd0dd1 None None] MFA Rules not processed for user `e3ba63c3fc36470fbbe8312b51a13f13`. Rule list: `[]` (Enabled: `True`). {{(pid=352328) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 08:59:39.926590 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.fernet_utils [None req-eb237dcd-8621-4b3b-892c-956d76fd0dd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=352328) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:59:40.100611 dv-cinder-851351-1-smb devstack@keystone.service[352328]: [pid: 352328|app: 0|req: 694/1367] 10.222.0.42 () {58 vars in 1059 bytes} [Thu Jul 28 08:59:39 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 280 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 08:59:40.109917 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ba7367-7eb2-4182-a670-d8f5270532dc None None] Authenticating user token {{(pid=352329) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:59:40.112456 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.fernet_utils [None req-72ba7367-7eb2-4182-a670-d8f5270532dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=352329) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:59:40.329384 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ba7367-7eb2-4182-a670-d8f5270532dc None None] Validating token access rules against request {{(pid=352329) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:59:40.353140 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG dbcounter [-] [352329] Writing DB stats keystone:SELECT=100 {{(pid=352329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:59:40.475832 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14fc9a76-2c3d-4a0a-8321-03ad12133937 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3ba63c3fc36470fbbe8312b51a13f13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9cfa053c839a4fedacde7163d907e2a4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352329) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:59:40.476683 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14fc9a76-2c3d-4a0a-8321-03ad12133937 service nova] REQUEST_METHOD: `GET` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:59:40.477065 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14fc9a76-2c3d-4a0a-8321-03ad12133937 service nova] SCRIPT_NAME: `/identity` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:59:40.477422 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14fc9a76-2c3d-4a0a-8321-03ad12133937 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:59:40.479209 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.fernet_utils [None req-14fc9a76-2c3d-4a0a-8321-03ad12133937 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=352329) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:59:40.592829 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14fc9a76-2c3d-4a0a-8321-03ad12133937 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:59:40.595269 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14fc9a76-2c3d-4a0a-8321-03ad12133937 service nova] RBAC: Authorization granted {{(pid=352329) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:59:40.617873 dv-cinder-851351-1-smb devstack@keystone.service[352329]: [pid: 352329|app: 0|req: 674/1368] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Jul 28 08:59:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 509 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 08:59:41.518078 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a85c99-0cd6-49eb-9235-babd875d99c5 None None] REQUEST_METHOD: `GET` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:59:41.518667 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a85c99-0cd6-49eb-9235-babd875d99c5 None None] SCRIPT_NAME: `/identity` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:59:41.518667 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a85c99-0cd6-49eb-9235-babd875d99c5 None None] PATH_INFO: `/` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:59:41.520253 dv-cinder-851351-1-smb devstack@keystone.service[352328]: [pid: 352328|app: 0|req: 695/1369] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 08:59:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 08:59:41.525649 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4caf4e-85a9-4b57-87b4-8ba22cec50c1 None None] REQUEST_METHOD: `POST` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:59:41.525993 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4caf4e-85a9-4b57-87b4-8ba22cec50c1 None None] SCRIPT_NAME: `/identity` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:59:41.526210 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4caf4e-85a9-4b57-87b4-8ba22cec50c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:59:41.562102 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG dbcounter [-] [352329] Writing DB stats keystone:SELECT=100 {{(pid=352329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:59:41.602305 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.auth.core [None req-df4caf4e-85a9-4b57-87b4-8ba22cec50c1 None None] MFA Rules not processed for user `d18c063b2377412485965357671e5506`. Rule list: `[]` (Enabled: `True`). {{(pid=352329) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 08:59:41.603700 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.fernet_utils [None req-df4caf4e-85a9-4b57-87b4-8ba22cec50c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=352329) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:59:41.710509 dv-cinder-851351-1-smb devstack@keystone.service[352329]: [pid: 352329|app: 0|req: 675/1370] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 08:59:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 08:59:42.769072 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f8ccf6-3f3d-4ed6-9e03-2feae3cbfd2d None None] REQUEST_METHOD: `GET` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:59:42.770093 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f8ccf6-3f3d-4ed6-9e03-2feae3cbfd2d None None] SCRIPT_NAME: `/identity` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:59:42.770418 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f8ccf6-3f3d-4ed6-9e03-2feae3cbfd2d None None] PATH_INFO: `/` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:59:42.772110 dv-cinder-851351-1-smb devstack@keystone.service[352328]: [pid: 352328|app: 0|req: 696/1371] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 08:59:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 08:59:42.778729 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1518871c-710b-4c1d-aa98-63d6121186df None None] REQUEST_METHOD: `POST` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:59:42.779165 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1518871c-710b-4c1d-aa98-63d6121186df None None] SCRIPT_NAME: `/identity` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:59:42.779165 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1518871c-710b-4c1d-aa98-63d6121186df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=352329) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:59:42.866064 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.auth.core [None req-1518871c-710b-4c1d-aa98-63d6121186df None None] MFA Rules not processed for user `d18c063b2377412485965357671e5506`. Rule list: `[]` (Enabled: `True`). {{(pid=352329) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 08:59:42.867326 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG keystone.common.fernet_utils [None req-1518871c-710b-4c1d-aa98-63d6121186df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=352329) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:59:42.948649 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG dbcounter [-] [352329] Writing DB stats keystone:SELECT=100 {{(pid=352329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:59:43.013871 dv-cinder-851351-1-smb devstack@keystone.service[352329]: [pid: 352329|app: 0|req: 676/1372] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 08:59:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 236 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 08:59:43.061053 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f8ccf6-3f3d-4ed6-9e03-2feae3cbfd2d None None] Authenticating user token {{(pid=352328) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 08:59:43.062696 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.fernet_utils [None req-18f8ccf6-3f3d-4ed6-9e03-2feae3cbfd2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=352328) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:59:43.119606 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG dbcounter [-] [352328] Writing DB stats keystone:SELECT=100 {{(pid=352328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:59:43.218573 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f8ccf6-3f3d-4ed6-9e03-2feae3cbfd2d None None] Validating token access rules against request {{(pid=352328) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 08:59:43.333282 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3497cea-4ffa-4892-bec5-d0064db0f07d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e3ba63c3fc36470fbbe8312b51a13f13', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9cfa053c839a4fedacde7163d907e2a4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=352328) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 08:59:43.333919 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3497cea-4ffa-4892-bec5-d0064db0f07d service nova] REQUEST_METHOD: `GET` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 08:59:43.334200 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3497cea-4ffa-4892-bec5-d0064db0f07d service nova] SCRIPT_NAME: `/identity` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 08:59:43.334543 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3497cea-4ffa-4892-bec5-d0064db0f07d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=352328) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 08:59:43.336211 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.fernet_utils [None req-c3497cea-4ffa-4892-bec5-d0064db0f07d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=352328) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 08:59:43.346233 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG dbcounter [-] [352328] Writing DB stats keystone:SELECT=100 {{(pid=352328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:59:43.454854 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3497cea-4ffa-4892-bec5-d0064db0f07d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 08:59:43.456640 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3497cea-4ffa-4892-bec5-d0064db0f07d service nova] RBAC: Authorization granted {{(pid=352328) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 08:59:43.478522 dv-cinder-851351-1-smb devstack@keystone.service[352328]: [pid: 352328|app: 0|req: 697/1373] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Jul 28 08:59:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 418 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 08:59:53.010100 dv-cinder-851351-1-smb devstack@keystone.service[352329]: DEBUG dbcounter [-] [352329] Writing DB stats keystone:SELECT=19 {{(pid=352329) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 08:59:53.475389 dv-cinder-851351-1-smb devstack@keystone.service[352328]: DEBUG dbcounter [-] [352328] Writing DB stats keystone:SELECT=41 {{(pid=352328) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:00:03.391413 dv-cinder-851351-1-smb systemd[1]: Stopping Devstack devstack@keystone.service... Jul 28 09:00:03.392314 dv-cinder-851351-1-smb devstack@keystone.service[352316]: Thu Jul 28 09:00:03 2022 - graceful shutdown triggered... Jul 28 09:00:03.392855 dv-cinder-851351-1-smb devstack@keystone.service[352329]: Gracefully killing worker 2 (pid: 352329)... Jul 28 09:00:03.393471 dv-cinder-851351-1-smb devstack@keystone.service[352328]: Gracefully killing worker 1 (pid: 352328)... Jul 28 09:00:04.393492 dv-cinder-851351-1-smb devstack@keystone.service[352316]: worker 1 buried after 1 seconds Jul 28 09:00:04.393492 dv-cinder-851351-1-smb devstack@keystone.service[352316]: worker 2 buried after 1 seconds Jul 28 09:00:04.393492 dv-cinder-851351-1-smb devstack@keystone.service[352316]: goodbye to uWSGI. Jul 28 09:00:04.395287 dv-cinder-851351-1-smb systemd[1]: devstack@keystone.service: Succeeded. Jul 28 09:00:04.396002 dv-cinder-851351-1-smb systemd[1]: Stopped Devstack devstack@keystone.service. Jul 28 09:04:49.858860 dv-cinder-851351-1-smb systemd[1]: Starting Devstack devstack@keystone.service... Jul 28 09:04:49.871438 dv-cinder-851351-1-smb devstack@keystone.service[416282]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Jul 28 09:04:49.876543 dv-cinder-851351-1-smb devstack@keystone.service[416282]: *** Starting uWSGI 2.0.18-debian (64bit) on [Thu Jul 28 09:04:49 2022] *** Jul 28 09:04:49.876543 dv-cinder-851351-1-smb devstack@keystone.service[416282]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jul 28 09:04:49.876543 dv-cinder-851351-1-smb devstack@keystone.service[416282]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jul 28 09:04:49.876543 dv-cinder-851351-1-smb devstack@keystone.service[416282]: nodename: dv-cinder-851351-1-smb Jul 28 09:04:49.876543 dv-cinder-851351-1-smb devstack@keystone.service[416282]: machine: x86_64 Jul 28 09:04:49.876543 dv-cinder-851351-1-smb devstack@keystone.service[416282]: clock source: unix Jul 28 09:04:49.876543 dv-cinder-851351-1-smb devstack@keystone.service[416282]: pcre jit disabled Jul 28 09:04:49.876543 dv-cinder-851351-1-smb devstack@keystone.service[416282]: detected number of CPU cores: 4 Jul 28 09:04:49.876543 dv-cinder-851351-1-smb devstack@keystone.service[416282]: current working directory: / Jul 28 09:04:49.876543 dv-cinder-851351-1-smb devstack@keystone.service[416282]: detected binary path: /usr/bin/uwsgi-core Jul 28 09:04:49.876543 dv-cinder-851351-1-smb devstack@keystone.service[416282]: your processes number limit is 47680 Jul 28 09:04:49.876543 dv-cinder-851351-1-smb devstack@keystone.service[416282]: your memory page size is 4096 bytes Jul 28 09:04:49.876543 dv-cinder-851351-1-smb devstack@keystone.service[416282]: detected max file descriptor number: 2048 Jul 28 09:04:49.876543 dv-cinder-851351-1-smb devstack@keystone.service[416282]: lock engine: pthread robust mutexes Jul 28 09:04:49.876543 dv-cinder-851351-1-smb devstack@keystone.service[416282]: thunder lock: enabled Jul 28 09:04:49.876543 dv-cinder-851351-1-smb devstack@keystone.service[416282]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Jul 28 09:04:49.876543 dv-cinder-851351-1-smb devstack@keystone.service[416282]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Jul 28 09:04:49.914440 dv-cinder-851351-1-smb devstack@keystone.service[416282]: Python main interpreter initialized at 0x55a65e7049c0 Jul 28 09:04:49.914440 dv-cinder-851351-1-smb devstack@keystone.service[416282]: python threads support enabled Jul 28 09:04:49.914440 dv-cinder-851351-1-smb devstack@keystone.service[416282]: your server socket listen backlog is limited to 100 connections Jul 28 09:04:49.914440 dv-cinder-851351-1-smb devstack@keystone.service[416282]: your mercy for graceful operations on workers is 90 seconds Jul 28 09:04:49.914878 dv-cinder-851351-1-smb devstack@keystone.service[416282]: mapped 403077 bytes (393 KB) for 2 cores Jul 28 09:04:49.914878 dv-cinder-851351-1-smb devstack@keystone.service[416282]: *** Operational MODE: preforking *** Jul 28 09:04:49.915168 dv-cinder-851351-1-smb devstack@keystone.service[416282]: *** uWSGI is running in multiple interpreter mode *** Jul 28 09:04:49.915168 dv-cinder-851351-1-smb devstack@keystone.service[416282]: spawned uWSGI master process (pid: 416282) Jul 28 09:04:49.915387 dv-cinder-851351-1-smb systemd[1]: Started Devstack devstack@keystone.service. Jul 28 09:04:49.915998 dv-cinder-851351-1-smb devstack@keystone.service[416282]: spawned uWSGI worker 1 (pid: 416293, cores: 1) Jul 28 09:04:49.916375 dv-cinder-851351-1-smb devstack@keystone.service[416282]: spawned uWSGI worker 2 (pid: 416294, cores: 1) Jul 28 09:04:49.916542 dv-cinder-851351-1-smb devstack@keystone.service[416282]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jul 28 09:04:55.423007 dv-cinder-851351-1-smb devstack@keystone.service[416294]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 28 09:04:55.423007 dv-cinder-851351-1-smb devstack@keystone.service[416294]: from cryptography.utils import int_from_bytes Jul 28 09:04:55.423932 dv-cinder-851351-1-smb devstack@keystone.service[416294]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 28 09:04:55.423932 dv-cinder-851351-1-smb devstack@keystone.service[416294]: from cryptography.utils import int_from_bytes Jul 28 09:04:55.424530 dv-cinder-851351-1-smb devstack@keystone.service[416293]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 28 09:04:55.424530 dv-cinder-851351-1-smb devstack@keystone.service[416293]: from cryptography.utils import int_from_bytes Jul 28 09:04:55.425109 dv-cinder-851351-1-smb devstack@keystone.service[416293]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 28 09:04:55.425109 dv-cinder-851351-1-smb devstack@keystone.service[416293]: from cryptography.utils import int_from_bytes Jul 28 09:04:55.474862 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=416293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 28 09:04:55.475106 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=416293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 28 09:04:55.475203 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG uwsgi [-] command line args: [] {{(pid=416293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 28 09:04:55.475519 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=416293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 28 09:04:55.475676 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG uwsgi [-] ================================================================================ {{(pid=416293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 28 09:04:55.475958 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG uwsgi [-] admin_token = **** {{(pid=416293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:04:55.476214 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG uwsgi [-] config_dir = [] {{(pid=416293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:04:55.476357 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=416293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:04:55.476446 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=416294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 28 09:04:55.476533 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG uwsgi [-] config_source = [] {{(pid=416293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:04:55.476615 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=416294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 28 09:04:55.476791 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG uwsgi [-] debug = True {{(pid=416293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:04:55.476895 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG uwsgi [-] command line args: [] {{(pid=416294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 28 09:04:55.476971 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=416293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:04:55.477312 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=416294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 28 09:04:55.477312 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG uwsgi [-] ================================================================================ {{(pid=416294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 28 09:04:55.477575 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=416293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:04:55.477713 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG uwsgi [-] admin_token = **** {{(pid=416294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:04:55.477842 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG uwsgi [-] insecure_debug = False {{(pid=416293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:04:55.477975 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG uwsgi [-] config_dir = [] {{(pid=416294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:04:55.478105 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=416293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:04:55.478239 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=416294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:04:55.478368 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=416293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:04:55.478492 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG uwsgi [-] config_source = [] {{(pid=416294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:04:55.478619 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG uwsgi [-] list_limit = None {{(pid=416293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:04:55.478748 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG uwsgi [-] debug = True {{(pid=416294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:04:55.478876 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG uwsgi [-] log_config_append = None {{(pid=416293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:04:55.479007 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=416294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:04:55.479163 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=416293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:04:55.479293 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=416294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:04:55.479420 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG uwsgi [-] log_dir = None {{(pid=416293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:04:55.479549 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG uwsgi [-] insecure_debug = False {{(pid=416294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:04:55.479687 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG uwsgi [-] log_file = None {{(pid=416293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:04:55.479817 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=416294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:04:55.479931 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=416293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:04:55.480040 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=416294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:04:55.480168 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=416293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:04:55.480291 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG uwsgi [-] list_limit = None {{(pid=416294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:04:55.480428 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=416293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:04:55.480571 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG uwsgi [-] log_config_append = None {{(pid=416294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:04:55.480571 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=416294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:04:55.480794 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=416293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:04:55.480794 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=416293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:04:55.480986 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG uwsgi [-] log_dir = None {{(pid=416294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:04:55.481094 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=416293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:04:55.481186 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG uwsgi [-] log_file = None {{(pid=416294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:04:55.481253 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=416293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:04:55.481384 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=416294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:04:55.481522 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=416293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:04:55.481618 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=416294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:04:55.481692 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=416293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:04:55.481822 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=416294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:04:55.481910 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=416293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:04:55.481983 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=416294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:04:55.482118 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=416293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:04:55.482212 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=416294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:04:55.482342 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=416293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:04:55.482430 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=416294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:04:55.482559 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=416293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:04:55.482651 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=416294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:04:55.482781 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG uwsgi [-] notification_format = cadf {{(pid=416293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:04:55.482873 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=416294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:04:55.482873 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=416294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:04:55.483081 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=416293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:04:55.483167 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=416294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:04:55.483167 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=416294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:04:55.483348 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.42/identity {{(pid=416293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:04:55.483433 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=416294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:04:55.483517 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG uwsgi [-] publish_errors = False {{(pid=416293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:04:55.483595 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=416294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:04:55.483718 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=416293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:04:55.483812 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG uwsgi [-] notification_format = cadf {{(pid=416294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:04:55.483898 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=416293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:04:55.483898 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=416293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:04:55.484098 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=416294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:04:55.484187 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=416293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:04:55.484187 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=416293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:04:55.484387 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.42/identity {{(pid=416294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:04:55.484510 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG uwsgi [-] standard_threads = False {{(pid=416293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:04:55.484599 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG uwsgi [-] publish_errors = False {{(pid=416294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:04:55.484701 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG uwsgi [-] strict_password_check = False {{(pid=416293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:04:55.484799 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=416294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:04:55.484894 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=416293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:04:55.485082 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=416294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:04:55.485170 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG uwsgi [-] use_eventlog = False {{(pid=416293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:04:55.485255 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=416294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:04:55.485338 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG uwsgi [-] use_journal = False {{(pid=416293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:04:55.485422 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=416294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:04:55.485506 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG uwsgi [-] use_json = False {{(pid=416293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:04:55.485597 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=416294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:04:55.485676 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG uwsgi [-] use_stderr = False {{(pid=416293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:04:55.485676 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG uwsgi [-] use_syslog = False {{(pid=416293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:04:55.485829 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG uwsgi [-] standard_threads = False {{(pid=416294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:04:55.485917 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG uwsgi [-] watch_log_file = False {{(pid=416293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:04:55.486001 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG uwsgi [-] strict_password_check = False {{(pid=416294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:04:55.486138 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=416294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:04:55.486242 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=416293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:04:55.486329 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG uwsgi [-] use_eventlog = False {{(pid=416294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:04:55.486408 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=416293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:04:55.486491 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG uwsgi [-] use_journal = False {{(pid=416294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:04:55.486662 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=416293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:04:55.486807 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG uwsgi [-] use_json = False {{(pid=416294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:04:55.486807 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG uwsgi [-] use_stderr = False {{(pid=416294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:04:55.486974 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=416293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:04:55.487060 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG uwsgi [-] use_syslog = False {{(pid=416294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:04:55.487165 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=416293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:04:55.487257 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG uwsgi [-] watch_log_file = False {{(pid=416294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:04:55.487351 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=416293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:04:55.487444 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=416294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:04:55.487635 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=416293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:04:55.487732 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=416294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:04:55.487821 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=416293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:04:55.487912 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=416294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:04:55.488098 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=416293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:04:55.488245 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=416294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:04:55.488339 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=416293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:04:55.488425 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=416294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:04:55.488638 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=416293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:04:55.488858 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=416294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:04:55.488960 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=416294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:04:55.489049 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=416293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:04:55.489207 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=416294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:04:55.489360 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=416293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:04:55.489454 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=416294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:04:55.489549 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=416293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:04:55.489641 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=416294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:04:55.489734 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=416293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:04:55.489923 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=416294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:04:55.490059 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=416293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:04:55.490159 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=416294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:04:55.490258 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=416293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:04:55.490347 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=416294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:04:55.490426 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=416293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:04:55.490614 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=416294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:04:55.490760 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=416293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:04:55.490855 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=416294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:04:55.490951 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=416293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:04:55.491075 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=416294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:04:55.491185 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=416293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:04:55.491307 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=416294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:04:55.491418 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=416293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:04:55.491587 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=416294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:04:55.491742 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=416293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:04:55.491838 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=416294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:04:55.491920 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=416293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:04:55.492057 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=416294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:04:55.492156 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=416293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:04:55.492317 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=416294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:04:55.492480 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=416293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:04:55.492583 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=416294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:04:55.492706 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=416293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:04:55.492803 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=416293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:04:55.492890 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=416294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:04:55.493059 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=416293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:04:55.493212 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=416294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:04:55.493311 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=416294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:04:55.493399 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=416293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:04:55.493483 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=416294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:04:55.493572 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=416293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:04:55.493744 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=416294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:04:55.493890 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=416293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:04:55.493985 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=416294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:04:55.494065 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=416293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:04:55.494181 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=416294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:04:55.494301 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=416293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:04:55.494422 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=416294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:04:55.494523 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=416293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:04:55.494700 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=416294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:04:55.494845 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=416293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:04:55.494950 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=416294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:04:55.495032 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=416293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:04:55.495125 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=416294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:04:55.495205 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=416293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:04:55.495385 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=416294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:04:55.495531 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=416293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:04:55.495632 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=416294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:04:55.495714 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=416293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:04:55.495807 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=416294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:04:55.495887 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=416293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:04:55.496088 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=416293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:04:55.496230 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=416294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:04:55.496327 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=416294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:04:55.496408 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=416293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:04:55.496501 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=416294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:04:55.496587 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=416293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:04:55.496784 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=416294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:04:55.496937 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=416293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:04:55.497033 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=416294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:04:55.497115 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=416293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:04:55.497207 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=416294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:04:55.497300 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=416293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:04:55.497445 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=416294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:04:55.497544 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=416293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:04:55.497641 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=416294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:04:55.497727 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=416293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:04:55.497895 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=416294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:04:55.498000 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=416293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:04:55.498150 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=416294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:04:55.498242 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=416293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:04:55.498385 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=416294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:04:55.498476 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=416293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:04:55.498623 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=416294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:04:55.498720 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=416293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:04:55.498859 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=416294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:04:55.498955 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=416293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:04:55.499098 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=416294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:04:55.499195 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=416293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:04:55.499334 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=416294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:04:55.499432 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=416293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:04:55.499573 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=416293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:04:55.499662 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=416294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:04:55.499802 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=416294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:04:55.499897 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=416293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:04:55.500048 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=416294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:04:55.500140 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=416293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:04:55.500268 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=416294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:04:55.500374 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=416293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:04:55.500517 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=416294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:04:55.500607 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=416293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:04:55.500822 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=416294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:04:55.500906 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=416293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:04:55.500990 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=416294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:04:55.501081 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=416293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:04:55.501225 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=416294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:04:55.501323 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=416293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:04:55.501475 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=416294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:04:55.501573 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=416293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:04:55.501712 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=416294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:04:55.501810 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=416293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:04:55.501953 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=416294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:04:55.502050 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=416293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:04:55.502174 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=416294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:04:55.502273 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=416293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:04:55.502445 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=416294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:04:55.502553 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=416293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:04:55.502689 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=416294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:04:55.502786 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=416293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:04:55.502919 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=416294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:04:55.503021 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=416293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:04:55.503156 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=416294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:04:55.503247 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=416293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:04:55.503377 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=416294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:04:55.503463 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=416293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:04:55.503621 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=416293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:04:55.503718 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=416294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:04:55.503865 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=416293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:04:55.503958 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=416294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:04:55.504113 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=416294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:04:55.504204 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG uwsgi [-] cache.enabled = True {{(pid=416293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:04:55.504419 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=416294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:04:55.504604 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=416293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:04:55.504731 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=416294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:04:55.504818 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=416293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:04:55.504905 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=416294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:04:55.504989 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=416293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:04:55.505140 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=416294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:04:55.505240 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=416293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:04:55.505392 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG uwsgi [-] cache.enabled = True {{(pid=416294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:04:55.505486 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=416293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:04:55.505633 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=416294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:04:55.505719 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=416293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:04:55.505872 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=416294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:04:55.505971 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=416293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:04:55.506116 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=416293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:04:55.506207 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=416294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:04:55.506353 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=416294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:04:55.506444 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=416293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:04:55.506593 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=416294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:04:55.506691 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=416293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:04:55.506831 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=416294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:04:55.506923 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=416293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:04:55.507068 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=416294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:04:55.507163 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=416293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:04:55.507304 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=416294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:04:55.507403 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=416293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:04:55.507549 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=416293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:04:55.507641 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=416294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:04:55.507794 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=416293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:04:55.507888 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=416294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:04:55.508038 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=416293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:04:55.508136 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=416294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:04:55.508276 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=416294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:04:55.508361 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=416293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:04:55.508513 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=416293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:04:55.508598 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=416294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:04:55.508771 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=416294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:04:55.508877 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=416293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:04:55.509010 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=416294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:04:55.509098 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=416293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:04:55.509246 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=416293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:04:55.509338 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=416294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:04:55.509477 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=416294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:04:55.509572 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=416293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:04:55.509711 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=416294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:04:55.509803 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=416293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:04:55.509948 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=416294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:04:55.510052 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=416293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:04:55.510185 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=416294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:04:55.510289 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=416293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:04:55.510414 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=416294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:04:55.510508 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=416293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:04:55.510658 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=416294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:04:55.510750 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=416293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:04:55.510895 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=416294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:04:55.510992 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=416293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:04:55.511144 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=416294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:04:55.511237 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG uwsgi [-] auth.external = None {{(pid=416293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:04:55.511382 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG uwsgi [-] auth.mapped = None {{(pid=416293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:04:55.511473 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=416294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:04:55.511634 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=416294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:04:55.511732 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=416293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:04:55.511893 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=416294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:04:55.511986 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=416293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:04:55.512136 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=416294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:04:55.512228 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG uwsgi [-] auth.password = None {{(pid=416293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:04:55.512372 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG uwsgi [-] auth.token = None {{(pid=416293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:04:55.512470 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG uwsgi [-] auth.external = None {{(pid=416294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:04:55.512604 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG uwsgi [-] auth.mapped = None {{(pid=416294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:04:55.512708 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=416293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:04:55.512881 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG uwsgi [-] catalog.caching = True {{(pid=416293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:04:55.512976 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=416294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:04:55.513136 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=416293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:04:55.513229 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=416294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:04:55.513366 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG uwsgi [-] auth.password = None {{(pid=416294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:04:55.513458 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=416293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:04:55.513597 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG uwsgi [-] auth.token = None {{(pid=416294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:04:55.513683 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=416293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:04:55.513836 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=416294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:04:55.513929 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=416293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:04:55.514071 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG uwsgi [-] catalog.caching = True {{(pid=416294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:04:55.514165 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=416293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:04:55.514313 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG uwsgi [-] credential.caching = True {{(pid=416293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:04:55.514398 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=416294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:04:55.514543 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=416294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:04:55.514626 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG uwsgi [-] credential.driver = sql {{(pid=416293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:04:55.514789 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=416294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:04:55.514886 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=416293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:04:55.515035 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=416294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:04:55.515127 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=416293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:04:55.515266 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=416294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:04:55.515361 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=416293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:04:55.515501 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG uwsgi [-] credential.caching = True {{(pid=416294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:04:55.515587 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=416293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:04:55.515746 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG uwsgi [-] credential.driver = sql {{(pid=416294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:04:55.515838 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=416293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:04:55.515993 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=416294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:04:55.516100 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=416293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:04:55.516241 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=416294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:04:55.516326 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=416293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:04:55.516478 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=416294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:04:55.516571 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=416293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:04:55.516750 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=416294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:04:55.516867 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=416293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:04:55.516988 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=416294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:04:55.517086 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=416293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:04:55.517252 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=416294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:04:55.517339 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=416293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:04:55.517508 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=416294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:04:55.517606 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=416293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:04:55.517746 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=416294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:04:55.517839 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=416293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:04:55.518010 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=416294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:04:55.518103 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=416293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:04:55.518281 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG uwsgi [-] federation.caching = True {{(pid=416293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:04:55.518375 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=416294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:04:55.518528 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=416293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:04:55.518621 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=416294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:04:55.518782 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG uwsgi [-] federation.driver = sql {{(pid=416293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:04:55.518876 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=416294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:04:55.519024 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=416294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:04:55.519123 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=416293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:04:55.519263 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=416293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:04:55.519354 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=416294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:04:55.519504 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG uwsgi [-] federation.caching = True {{(pid=416294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:04:55.519596 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=416293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:04:55.519742 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=416294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:04:55.519841 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=416293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:04:55.520016 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG uwsgi [-] federation.driver = sql {{(pid=416294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:04:55.520117 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=416293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:04:55.520259 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=416293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:04:55.520363 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=416294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:04:55.520488 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=416294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:04:55.520586 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=416293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:04:55.520758 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=416294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:04:55.520847 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=416293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:04:55.521000 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=416294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:04:55.521103 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=416293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:04:55.521270 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG uwsgi [-] identity.caching = True {{(pid=416293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:04:55.521372 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=416294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:04:55.521509 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=416294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:04:55.521594 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=416293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:04:55.521764 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=416294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:04:55.521851 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=416293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:04:55.522002 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=416294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:04:55.522096 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=416293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:04:55.522245 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=416293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:04:55.522330 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=416294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:04:55.522487 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG uwsgi [-] identity.caching = True {{(pid=416294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:04:55.522571 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG uwsgi [-] identity.driver = sql {{(pid=416293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:04:55.522728 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=416293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:04:55.522825 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=416294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:04:55.522974 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=416294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:04:55.523060 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=416293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:04:55.523212 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=416294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:04:55.523305 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=416293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:04:55.523450 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=416294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:04:55.523545 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=416293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:04:55.523697 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=416293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:04:55.523783 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG uwsgi [-] identity.driver = sql {{(pid=416294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:04:55.523927 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=416294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:04:55.524102 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=416293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:04:55.524202 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=416293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:04:55.524288 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=416294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:04:55.524405 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=416294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:04:55.524500 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=416293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:04:55.524656 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=416294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:04:55.524808 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=416293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:04:55.524900 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=416294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:04:55.524980 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=416293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:04:55.525129 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=416294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:04:55.525215 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=416293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:04:55.525363 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=416294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:04:55.525454 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=416293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:04:55.525619 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=416294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:04:55.525707 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=416293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:04:55.525846 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=416294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:04:55.525932 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=416293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:04:55.526095 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=416294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:04:55.526180 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=416293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:04:55.526351 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=416294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:04:55.526445 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=416293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:04:55.526597 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=416294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:04:55.526689 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=416293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:04:55.526835 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=416293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:04:55.526926 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=416294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:04:55.527081 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=416293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:04:55.527175 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=416294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:04:55.527317 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=416294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:04:55.527409 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=416293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:04:55.527552 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=416294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:04:55.527645 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=416293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:04:55.527791 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=416294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:04:55.527883 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=416293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:04:55.528031 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=416293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:04:55.528122 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=416294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:04:55.528288 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=416294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:04:55.528388 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=416293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:04:55.528505 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=416294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:04:55.528599 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=416293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:04:55.528770 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=416294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:04:55.528869 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=416293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:04:55.529022 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=416294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:04:55.529115 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=416293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:04:55.529257 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=416294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:04:55.529351 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=416293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:04:55.529505 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=416293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:04:55.529598 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=416294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:04:55.529751 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=416294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:04:55.529835 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=416293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:04:55.529988 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG uwsgi [-] ldap.password = **** {{(pid=416293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:04:55.530081 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=416294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:04:55.530233 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=416293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:04:55.530320 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=416294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:04:55.530480 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=416293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:04:55.530567 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=416294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:04:55.530710 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=416294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:04:55.530803 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=416293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:04:55.530948 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=416294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:04:55.531040 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=416293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:04:55.531181 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG uwsgi [-] ldap.password = **** {{(pid=416294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:04:55.531277 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=416293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:04:55.531418 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=416294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:04:55.531511 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=416293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:04:55.531655 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=416294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:04:55.531741 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=416293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:04:55.531898 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=416294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:04:55.531982 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=416293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:04:55.532135 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=416293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:04:55.532221 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=416294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:04:55.532369 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=416294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:04:55.532455 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=416293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:04:55.532620 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=416294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:04:55.532771 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=416293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:04:55.532890 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=416293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:04:55.532982 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=416294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:04:55.533134 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=416293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:04:55.533233 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=416294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:04:55.533378 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=416293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:04:55.533471 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=416294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:04:55.533618 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG uwsgi [-] ldap.user = None {{(pid=416293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:04:55.533705 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=416294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:04:55.533867 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=416293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:04:55.533959 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=416294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:04:55.534108 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=416294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:04:55.534194 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=416293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:04:55.534349 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=416294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:04:55.534442 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=416293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:04:55.534586 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=416294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:04:55.534671 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=416293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:04:55.534820 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG uwsgi [-] ldap.user = None {{(pid=416294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:04:55.534920 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=416293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:04:55.535061 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=416294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:04:55.535146 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=416293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:04:55.535313 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=416293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:04:55.535397 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=416294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:04:55.535600 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=416293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:04:55.535699 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=416294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:04:55.535846 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=416293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:04:55.535938 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=416294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:04:55.536090 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=416293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:04:55.536181 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=416294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:04:55.536333 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=416293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:04:55.536431 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=416294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:04:55.536567 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=416294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:04:55.536658 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=416293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:04:55.536822 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=416294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:04:55.536916 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=416293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:04:55.537061 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=416294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:04:55.537167 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=416293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:04:55.537299 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=416294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:04:55.537385 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=416293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:04:55.537535 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=416294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:04:55.537626 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=416293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:04:55.537768 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=416294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:04:55.537867 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=416293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:04:55.538020 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=416294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:04:55.538112 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=416293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:04:55.538267 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=416294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:04:55.538352 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=416293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:04:55.538513 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=416293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:04:55.538611 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=416294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:04:55.538757 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=416293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:04:55.538877 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=416294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:04:55.539000 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=416293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:04:55.539100 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=416294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:04:55.539337 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=416294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:04:55.539422 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=416293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:04:55.539589 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=416294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:04:55.539681 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=416293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:04:55.539830 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=416294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:04:55.540002 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=416293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:04:55.540084 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=416294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:04:55.540162 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=416293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:04:55.540297 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=416294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:04:55.540399 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG uwsgi [-] policy.driver = sql {{(pid=416293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:04:55.540535 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=416294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:04:55.540634 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=416293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:04:55.540810 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=416294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:04:55.540908 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=416293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:04:55.541062 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=416293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:04:55.541154 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=416294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:04:55.541291 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=416294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:04:55.541385 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG uwsgi [-] receipt.caching = True {{(pid=416293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:04:55.541533 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=416293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:04:55.541617 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG uwsgi [-] policy.driver = sql {{(pid=416294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:04:55.541771 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=416294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:04:55.541857 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=416293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:04:55.542020 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=416294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:04:55.542123 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=416293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:04:55.542257 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=416293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:04:55.542342 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=416294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:04:55.542749 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG uwsgi [-] receipt.caching = True {{(pid=416294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:04:55.542852 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=416293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:04:55.542933 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=416294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:04:55.543024 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG uwsgi [-] resource.caching = True {{(pid=416293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:04:55.543109 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=416294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:04:55.543194 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=416293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:04:55.543272 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=416294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:04:55.543355 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG uwsgi [-] resource.driver = sql {{(pid=416293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:04:55.543433 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=416294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:04:55.543521 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=416293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:04:55.543635 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=416294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:04:55.543723 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=416293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:04:55.543876 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG uwsgi [-] resource.caching = True {{(pid=416294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:04:55.543961 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=416293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:04:55.544128 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=416294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:04:55.544224 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG uwsgi [-] revoke.caching = True {{(pid=416293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:04:55.544375 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG uwsgi [-] resource.driver = sql {{(pid=416294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:04:55.544468 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=416293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:04:55.544614 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=416294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:04:55.544731 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=416293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:04:55.544888 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=416294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:04:55.544984 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG uwsgi [-] role.cache_time = None {{(pid=416293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:04:55.545133 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG uwsgi [-] role.caching = True {{(pid=416293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:04:55.545219 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=416294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:04:55.545372 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG uwsgi [-] revoke.caching = True {{(pid=416294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:04:55.545457 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG uwsgi [-] role.driver = sql {{(pid=416293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:04:55.545614 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG uwsgi [-] role.list_limit = None {{(pid=416293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:04:55.545709 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=416294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:04:55.545852 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=416294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:04:55.545944 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=416293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:04:55.546092 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG uwsgi [-] role.cache_time = None {{(pid=416294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:04:55.546186 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=416293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:04:55.546328 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG uwsgi [-] role.caching = True {{(pid=416294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:04:55.546423 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=416293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:04:55.546574 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG uwsgi [-] role.driver = sql {{(pid=416294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:04:55.546666 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=416293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:04:55.546805 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG uwsgi [-] role.list_limit = None {{(pid=416294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:04:55.546890 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=416293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:04:55.547055 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=416294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:04:55.547142 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=416293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:04:55.547302 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=416294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:04:55.547396 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=416293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:04:55.547551 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=416294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:04:55.547638 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=416293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:04:55.547788 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=416293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:04:55.547874 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=416294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:04:55.548036 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=416294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:04:55.548129 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=416293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:04:55.548282 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=416294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:04:55.548376 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=416293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:04:55.548528 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=416294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:04:55.548623 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=416293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:04:55.548798 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=416294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:04:55.548886 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=416293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:04:55.549031 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=416294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:04:55.549219 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=416293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:04:55.549313 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=416294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:04:55.549471 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=416293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:04:55.549557 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=416294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:04:55.549734 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=416293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:04:55.549821 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=416294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:04:55.549982 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=416294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:04:55.550076 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=416293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:04:55.550236 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=416293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:04:55.550393 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=416294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:04:55.550480 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=416293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:04:55.550631 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=416294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:04:55.550717 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=416293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:04:55.550883 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=416294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:04:55.550970 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=416293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:04:55.551168 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=416294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:04:55.551263 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=416293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:04:55.551421 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=416294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:04:55.551521 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=416293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:04:55.551672 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=416294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:04:55.551765 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=416293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:04:55.551910 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=416294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:04:55.552004 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=416293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:04:55.552166 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=416294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:04:55.552306 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=416293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:04:55.552419 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=416294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:04:55.552520 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=416293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:04:55.552702 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=416294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:04:55.552792 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=416293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:04:55.552913 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=416294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:04:55.553011 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=416293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:04:55.553147 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=416294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:04:55.553240 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=416293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:04:55.553380 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=416294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:04:55.553473 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=416293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:04:55.553631 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG uwsgi [-] token.cache_time = None {{(pid=416293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:04:55.553728 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=416294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:04:55.553875 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG uwsgi [-] token.caching = True {{(pid=416293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:04:55.553968 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=416294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:04:55.554120 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=416293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:04:55.554207 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=416294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:04:55.554358 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=416294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:04:55.554457 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG uwsgi [-] token.provider = fernet {{(pid=416293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:04:55.554596 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=416294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:04:55.554681 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=416293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:04:55.554829 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG uwsgi [-] token.cache_time = None {{(pid=416294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:04:55.554915 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=416293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:04:55.555067 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG uwsgi [-] token.caching = True {{(pid=416294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:04:55.555162 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=416293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:04:55.555305 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=416294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:04:55.555398 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=416293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:04:55.555559 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=416293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:04:55.555644 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG uwsgi [-] token.provider = fernet {{(pid=416294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:04:55.555811 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=416293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:04:55.555906 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=416294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:04:55.556065 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=416294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:04:55.556157 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG uwsgi [-] trust.driver = sql {{(pid=416293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:04:55.556308 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=416293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:04:55.556393 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=416294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:04:55.556543 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=416294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:04:55.556647 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=416293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:04:55.556821 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=416294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:04:55.556949 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=416293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:04:55.557080 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=416294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:04:55.557210 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=416293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:04:55.557332 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG uwsgi [-] trust.driver = sql {{(pid=416294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:04:55.557465 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=416293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:04:55.557596 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=416294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:04:55.557726 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=416293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:04:55.557856 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=416294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:04:55.557986 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=416293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:04:55.558109 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=416294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:04:55.558239 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=416293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:04:55.558363 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=416294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:04:55.558485 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG uwsgi [-] database.connection = **** {{(pid=416293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:04:55.558607 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=416294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:04:55.558744 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=416293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:04:55.558869 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=416294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:04:55.558990 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=416293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:04:55.559112 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=416294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:04:55.559233 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=416293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:04:55.559354 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=416294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:04:55.559485 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=416293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:04:55.559615 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG uwsgi [-] database.connection = **** {{(pid=416294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:04:55.559737 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=416293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:04:55.559877 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=416294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:04:55.560014 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=416293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:04:55.560145 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=416294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:04:55.560274 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=416293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:04:55.560403 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=416294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:04:55.560533 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=416293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:04:55.560719 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=416294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:04:55.560857 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=416293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:04:55.560990 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=416294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:04:55.561113 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=416293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:04:55.561243 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=416294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:04:55.561385 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=416293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:04:55.561591 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=416294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:04:55.561737 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=416293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:04:55.561868 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=416294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:04:55.561999 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=416293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:04:55.562122 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=416294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:04:55.562251 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=416293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:04:55.562392 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=416294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:04:55.562516 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=416293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:04:55.562644 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=416294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:04:55.562768 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=416293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:04:55.562896 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=416294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:04:55.563019 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=416293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:04:55.563150 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=416294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:04:55.563280 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=416293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:04:55.563402 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=416294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:04:55.563524 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=416293) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 28 09:04:55.563645 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=416294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:04:55.563645 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=416294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:04:55.563645 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=416294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:04:55.563645 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=416294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:04:55.564110 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=416294) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 28 09:04:55.592486 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=416293) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 09:04:55.592751 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=416293) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 09:04:55.592988 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=416293) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 09:04:55.593101 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=416294) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 09:04:55.593254 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=416294) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 09:04:55.593483 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=416294) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 09:04:55.601785 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=416293) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 09:04:55.604317 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=416294) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 09:04:55.632303 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=416293) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 09:04:55.632534 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=416293) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 09:04:55.639060 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=416294) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 09:04:55.639478 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=416294) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 09:04:55.684618 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=416294) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 09:04:55.684922 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=416293) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 09:04:55.736980 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=416294) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 09:04:55.737348 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=416294) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 09:04:55.737706 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=416293) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 09:04:55.737925 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=416293) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 09:04:55.801359 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=416294) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 09:04:55.801656 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=416294) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 09:04:55.801756 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=416293) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 09:04:55.801948 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=416294) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 09:04:55.802045 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=416293) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 09:04:55.802235 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=416294) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 09:04:55.802365 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=416293) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 09:04:55.802505 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=416294) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 09:04:55.802599 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=416293) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 09:04:55.802729 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=416294) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 09:04:55.802814 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=416293) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 09:04:55.802814 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=416293) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 09:04:55.825524 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=416294) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 09:04:55.825817 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=416294) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 09:04:55.825961 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=416294) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 09:04:55.826051 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=416293) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 09:04:55.826145 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=416294) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 09:04:55.826226 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=416293) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 09:04:55.826378 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=416294) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 09:04:55.826477 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=416293) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 09:04:55.826614 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=416294) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 09:04:55.826716 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=416293) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 09:04:55.826845 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=416294) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 09:04:55.826972 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=416293) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 09:04:55.827116 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=416293) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 09:04:55.827252 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=416293) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 09:04:55.837815 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=416294) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 09:04:55.838390 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=416293) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 09:04:55.850496 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=416294) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 09:04:55.850716 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=416294) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 09:04:55.850818 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=416293) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 09:04:55.851007 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=416294) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 09:04:55.851110 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=416293) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 09:04:55.851309 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=416294) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 09:04:55.851415 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=416293) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 09:04:55.851550 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=416294) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 09:04:55.851679 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=416293) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 09:04:55.851819 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=416294) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 09:04:55.851955 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=416293) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 09:04:55.852083 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=416294) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 09:04:55.852214 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=416293) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 09:04:55.852214 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=416293) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 09:04:55.868712 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=416294) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 09:04:55.868932 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=416294) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jul 28 09:04:55.869263 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=416294) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 09:04:55.869459 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=416294) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jul 28 09:04:55.869725 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=416294) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 09:04:55.869956 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=416294) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 09:04:55.870243 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=416294) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 09:04:55.870477 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=416294) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 09:04:55.873309 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=416293) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 09:04:55.873516 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=416293) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jul 28 09:04:55.873865 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=416293) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 09:04:55.874064 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=416293) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jul 28 09:04:55.874306 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=416293) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 09:04:55.874596 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=416293) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 09:04:55.874859 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=416293) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 09:04:55.875096 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=416293) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 09:04:55.880132 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=416294) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 09:04:55.880389 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=416294) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 09:04:55.880701 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=416294) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 09:04:55.880982 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=416294) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 09:04:55.885097 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=416293) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 09:04:55.885383 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=416293) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 09:04:55.885674 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=416293) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 09:04:55.885951 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=416293) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 09:04:55.888041 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=416294) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 28 09:04:55.892885 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=416294) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 28 09:04:55.893146 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=416293) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 28 09:04:55.893308 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=416294) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 09:04:55.893415 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=416294) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 09:04:55.893703 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=416294) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 09:04:55.893981 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=416294) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 09:04:55.894220 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=416294) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 09:04:55.894511 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=416294) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 09:04:55.894758 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=416294) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 09:04:55.895129 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=416294) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 09:04:55.895407 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=416294) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 09:04:55.895674 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=416294) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 09:04:55.898061 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=416293) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 28 09:04:55.898341 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=416293) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 09:04:55.898666 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=416293) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 09:04:55.898953 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=416293) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 09:04:55.899241 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=416293) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 09:04:55.899505 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=416293) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 09:04:55.899753 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=416293) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 09:04:55.900057 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=416293) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 09:04:55.900317 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=416293) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 09:04:55.900599 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=416293) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 09:04:55.900898 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=416293) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 09:04:55.918738 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=416294) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 09:04:55.920274 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=416294) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 28 09:04:55.920525 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=416294) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 09:04:55.924131 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=416293) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 09:04:55.925188 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=416294) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 28 09:04:55.925468 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=416294) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 09:04:55.925690 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=416293) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 28 09:04:55.925791 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=416294) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 09:04:55.926014 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=416293) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 09:04:55.930892 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=416293) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 28 09:04:55.931210 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=416293) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 09:04:55.931475 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=416293) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 09:04:55.932549 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=416294) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 28 09:04:55.932882 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=416294) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 09:04:55.937135 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=416294) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 28 09:04:55.937365 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=416294) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 09:04:55.937631 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=416294) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 09:04:55.937919 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=416294) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 09:04:55.938190 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=416294) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 09:04:55.938437 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=416293) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 28 09:04:55.938539 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=416294) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 09:04:55.938673 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=416293) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 09:04:55.938819 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=416294) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 09:04:55.939124 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=416294) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 09:04:55.943107 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=416293) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 28 09:04:55.943376 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=416293) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 09:04:55.943707 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=416293) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 09:04:55.943994 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=416293) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 09:04:55.944276 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=416293) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 09:04:55.944576 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=416293) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 09:04:55.944880 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=416293) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 09:04:55.945160 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=416293) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 09:04:55.955350 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=416294) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 09:04:55.955635 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=416294) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 09:04:55.959737 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=416294) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 28 09:04:55.961682 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=416293) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 09:04:55.961991 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=416293) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 09:04:55.964617 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=416294) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 09:04:55.964617 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=416294) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 09:04:55.966069 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=416293) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 28 09:04:55.967840 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=416294) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 28 09:04:55.969304 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=416293) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 09:04:55.969595 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=416293) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 09:04:55.971071 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=416294) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 28 09:04:55.974120 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=416293) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 28 09:04:55.974694 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=416294) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 09:04:55.975000 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=416294) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 09:04:55.975289 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=416294) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 09:04:55.975585 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=416294) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 09:04:55.975866 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=416294) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 09:04:55.976156 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=416294) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 09:04:55.977428 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=416293) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 28 09:04:55.980608 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=416293) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 09:04:55.980947 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=416293) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 09:04:55.981240 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=416293) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 09:04:55.981535 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=416293) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 09:04:55.981841 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=416293) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 09:04:55.982137 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=416293) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 09:04:55.992301 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=416294) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 28 09:04:55.992605 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=416294) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 09:04:55.992902 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=416294) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 09:04:55.993167 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=416294) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 09:04:55.998303 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=416293) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 28 09:04:55.998611 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=416293) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 09:04:55.998885 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=416293) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 09:04:55.999152 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=416293) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 09:04:55.999979 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=416294) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 09:04:56.001599 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=416294) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 09:04:56.001975 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=416294) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 09:04:56.004695 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=416294) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 28 09:04:56.004997 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=416294) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 09:04:56.005264 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=416294) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 09:04:56.005568 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=416294) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 09:04:56.005858 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=416294) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 09:04:56.006124 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=416293) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 09:04:56.007721 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=416293) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 09:04:56.007989 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=416293) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 09:04:56.010908 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=416293) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 28 09:04:56.011523 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=416293) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 09:04:56.011523 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=416293) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 09:04:56.011784 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=416293) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 09:04:56.012022 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=416293) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 09:04:56.017231 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=416294) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 28 09:04:56.017512 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=416294) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 09:04:56.017794 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=416294) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 09:04:56.018077 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=416294) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 09:04:56.018360 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=416294) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 09:04:56.018638 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=416294) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 09:04:56.018913 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=416294) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 09:04:56.023514 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=416293) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 28 09:04:56.023803 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=416293) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 09:04:56.024088 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=416293) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 09:04:56.024371 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=416293) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 09:04:56.024656 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=416293) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 09:04:56.024962 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=416293) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 09:04:56.025249 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=416293) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 09:04:56.036955 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=416294) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 28 09:04:56.040571 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=416294) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 28 09:04:56.041269 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=416293) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 28 09:04:56.044281 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=416293) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 28 09:04:56.046072 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=416294) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 09:04:56.047265 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=416293) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 09:04:56.047589 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=416294) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 09:04:56.049134 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=416294) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 28 09:04:56.049439 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=416294) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 09:04:56.049758 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=416294) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 09:04:56.050020 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=416293) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 09:04:56.051701 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=416293) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 28 09:04:56.054969 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=416293) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 09:04:56.054969 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=416293) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 09:04:56.056546 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=416294) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 09:04:56.058050 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=416294) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 28 09:04:56.058776 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=416293) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 09:04:56.060403 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=416293) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 28 09:04:56.061026 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=416294) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 09:04:56.061326 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=416294) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 09:04:56.061610 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=416294) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 09:04:56.061889 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=416294) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 09:04:56.063343 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=416293) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 09:04:56.063645 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=416293) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 09:04:56.063940 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=416293) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 09:04:56.064224 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=416293) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 09:04:56.069891 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=416294) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 28 09:04:56.070183 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=416294) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 09:04:56.070468 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=416294) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 09:04:56.072359 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=416293) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 28 09:04:56.072658 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=416293) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 09:04:56.072958 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=416293) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 09:04:56.078043 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=416294) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 28 09:04:56.078903 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=416294) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 09:04:56.078903 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=416294) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 09:04:56.079086 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=416294) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 09:04:56.079264 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=416294) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 09:04:56.079550 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=416294) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 09:04:56.079841 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=416294) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 09:04:56.080706 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=416294) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 09:04:56.080795 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=416293) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 28 09:04:56.080886 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=416294) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 09:04:56.081036 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=416293) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 09:04:56.081175 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=416294) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 09:04:56.081899 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=416293) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 09:04:56.082119 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=416294) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 09:04:56.082211 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=416293) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 09:04:56.082338 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=416294) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 09:04:56.082454 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=416293) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 09:04:56.082534 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=416294) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 09:04:56.082612 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=416293) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 09:04:56.082690 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=416294) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 09:04:56.082782 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=416293) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 09:04:56.082782 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=416293) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 09:04:56.082782 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=416293) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 09:04:56.082992 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=416293) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 09:04:56.083213 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=416293) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 09:04:56.083493 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=416293) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 09:04:56.083765 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=416293) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 09:04:56.084654 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=416293) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 09:04:56.115166 dv-cinder-851351-1-smb devstack@keystone.service[416294]: WSGI app 0 (mountpoint='') ready in 7 seconds on interpreter 0x55a65e7049c0 pid: 416294 (default app) Jul 28 09:04:56.117415 dv-cinder-851351-1-smb devstack@keystone.service[416293]: WSGI app 0 (mountpoint='') ready in 7 seconds on interpreter 0x55a65e7049c0 pid: 416293 (default app) Jul 28 09:04:56.118925 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589e74d7-9866-462d-bdbf-d04dc4afb5f1 None None] REQUEST_METHOD: `GET` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:04:56.119217 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589e74d7-9866-462d-bdbf-d04dc4afb5f1 None None] SCRIPT_NAME: `/identity` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:04:56.119501 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589e74d7-9866-462d-bdbf-d04dc4afb5f1 None None] PATH_INFO: `/v3` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:04:56.123781 dv-cinder-851351-1-smb devstack@keystone.service[416294]: [pid: 416294|app: 0|req: 1/1] 10.222.0.42 () {50 vars in 791 bytes} [Thu Jul 28 09:04:56 2022] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:05:03.774058 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094eed7a-a871-4b4d-a9bc-55888c297077 None None] REQUEST_METHOD: `GET` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:05:03.774684 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094eed7a-a871-4b4d-a9bc-55888c297077 None None] SCRIPT_NAME: `/identity` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:05:03.774684 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094eed7a-a871-4b4d-a9bc-55888c297077 None None] PATH_INFO: `/` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:05:03.779129 dv-cinder-851351-1-smb devstack@keystone.service[416293]: [pid: 416293|app: 0|req: 1/2] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 09:05:03 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 09:05:03.784618 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239a83f6-eee7-43bd-ae05-c4e6f678b700 None None] REQUEST_METHOD: `POST` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:05:03.785110 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239a83f6-eee7-43bd-ae05-c4e6f678b700 None None] SCRIPT_NAME: `/identity` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:05:03.785207 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239a83f6-eee7-43bd-ae05-c4e6f678b700 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:05:03.855432 dv-cinder-851351-1-smb devstack@keystone.service[416294]: INFO dbcounter [None req-239a83f6-eee7-43bd-ae05-c4e6f678b700 None None] Registered counter for database keystone Jul 28 09:05:03.877019 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG oslo_db.sqlalchemy.engines [None req-239a83f6-eee7-43bd-ae05-c4e6f678b700 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=416294) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 28 09:05:03.884576 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG dbcounter [-] [416294] Writer thread running {{(pid=416294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 28 09:05:04.074380 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG passlib.handlers.bcrypt [None req-239a83f6-eee7-43bd-ae05-c4e6f678b700 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=416294) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Jul 28 09:05:04.074787 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG passlib.handlers.bcrypt [None req-239a83f6-eee7-43bd-ae05-c4e6f678b700 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=416294) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Jul 28 09:05:04.130304 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.auth.core [None req-239a83f6-eee7-43bd-ae05-c4e6f678b700 None None] MFA Rules not processed for user `dbf87abab90e4fdf9e75408f4199918e`. Rule list: `[]` (Enabled: `True`). {{(pid=416294) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 09:05:04.131961 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.fernet_utils [None req-239a83f6-eee7-43bd-ae05-c4e6f678b700 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=416294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 09:05:04.264748 dv-cinder-851351-1-smb devstack@keystone.service[416294]: [pid: 416294|app: 0|req: 2/3] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 09:05:03 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 481 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jul 28 09:05:04.288525 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094eed7a-a871-4b4d-a9bc-55888c297077 None None] Authenticating user token {{(pid=416293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:05:04.357479 dv-cinder-851351-1-smb devstack@keystone.service[416293]: INFO dbcounter [None req-094eed7a-a871-4b4d-a9bc-55888c297077 None None] Registered counter for database keystone Jul 28 09:05:04.377883 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG oslo_db.sqlalchemy.engines [None req-094eed7a-a871-4b4d-a9bc-55888c297077 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=416293) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 28 09:05:04.385065 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG dbcounter [-] [416293] Writer thread running {{(pid=416293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 28 09:05:04.504683 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094eed7a-a871-4b4d-a9bc-55888c297077 None None] Validating token access rules against request {{(pid=416293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:05:04.509668 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8215c0-e40f-45e2-8cf3-f4f93bae17c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b5d78d12a0c4dfdbf387a60d6572e81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:05:04.510345 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8215c0-e40f-45e2-8cf3-f4f93bae17c9 admin admin] REQUEST_METHOD: `GET` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:05:04.510629 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8215c0-e40f-45e2-8cf3-f4f93bae17c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:05:04.510915 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8215c0-e40f-45e2-8cf3-f4f93bae17c9 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:05:04.519917 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea8215c0-e40f-45e2-8cf3-f4f93bae17c9 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:05:04.572632 dv-cinder-851351-1-smb devstack@keystone.service[416293]: WARNING keystone.common.rbac_enforcer.enforcer [None req-ea8215c0-e40f-45e2-8cf3-f4f93bae17c9 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Jul 28 09:05:04.572997 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea8215c0-e40f-45e2-8cf3-f4f93bae17c9 admin admin] RBAC: Authorization granted {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:05:04.584697 dv-cinder-851351-1-smb devstack@keystone.service[416293]: [pid: 416293|app: 0|req: 2/4] 10.222.0.42 () {58 vars in 1324 bytes} [Thu Jul 28 09:05:04 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 297 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 28 09:05:04.591006 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-239a83f6-eee7-43bd-ae05-c4e6f678b700 None None] Authenticating user token {{(pid=416294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:05:04.606116 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-239a83f6-eee7-43bd-ae05-c4e6f678b700 None None] Validating token access rules against request {{(pid=416294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:05:04.612065 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a7ce587-39b1-42f7-81cc-4ad27e1d2ed1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b5d78d12a0c4dfdbf387a60d6572e81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:05:04.613196 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7ce587-39b1-42f7-81cc-4ad27e1d2ed1 admin admin] REQUEST_METHOD: `GET` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:05:04.613483 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7ce587-39b1-42f7-81cc-4ad27e1d2ed1 admin admin] SCRIPT_NAME: `/identity` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:05:04.613760 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7ce587-39b1-42f7-81cc-4ad27e1d2ed1 admin admin] PATH_INFO: `/v3/projects/0b5d78d12a0c4dfdbf387a60d6572e81` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:05:04.615430 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a7ce587-39b1-42f7-81cc-4ad27e1d2ed1 admin admin] RBAC: Authorizing `identity:get_project(project_id=0b5d78d12a0c4dfdbf387a60d6572e81)` {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:05:04.665356 dv-cinder-851351-1-smb devstack@keystone.service[416294]: WARNING keystone.common.rbac_enforcer.enforcer [None req-2a7ce587-39b1-42f7-81cc-4ad27e1d2ed1 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Jul 28 09:05:04.665693 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a7ce587-39b1-42f7-81cc-4ad27e1d2ed1 admin admin] RBAC: Authorization granted {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:05:04.670559 dv-cinder-851351-1-smb devstack@keystone.service[416294]: [pid: 416294|app: 0|req: 3/5] 10.222.0.42 () {56 vars in 1207 bytes} [Thu Jul 28 09:05:04 2022] GET /identity/v3/projects/0b5d78d12a0c4dfdbf387a60d6572e81 => generated 344 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:05:06.660531 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd00371d-20cb-499e-a4f0-64cabcf7b184 None None] REQUEST_METHOD: `GET` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:05:06.661139 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd00371d-20cb-499e-a4f0-64cabcf7b184 None None] SCRIPT_NAME: `/identity` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:05:06.661139 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd00371d-20cb-499e-a4f0-64cabcf7b184 None None] PATH_INFO: `/` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:05:06.665300 dv-cinder-851351-1-smb devstack@keystone.service[416293]: [pid: 416293|app: 0|req: 3/6] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 09:05:06 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 28 09:05:06.671068 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33bd39e2-f329-4ee7-8990-a41b6aa4586d None None] REQUEST_METHOD: `POST` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:05:06.671551 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33bd39e2-f329-4ee7-8990-a41b6aa4586d None None] SCRIPT_NAME: `/identity` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:05:06.671649 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33bd39e2-f329-4ee7-8990-a41b6aa4586d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:05:06.693797 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.auth.core [None req-33bd39e2-f329-4ee7-8990-a41b6aa4586d None None] MFA Rules not processed for user `dbf87abab90e4fdf9e75408f4199918e`. Rule list: `[]` (Enabled: `True`). {{(pid=416294) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 09:05:06.695358 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.fernet_utils [None req-33bd39e2-f329-4ee7-8990-a41b6aa4586d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=416294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 09:05:06.704739 dv-cinder-851351-1-smb devstack@keystone.service[416294]: [pid: 416294|app: 0|req: 4/7] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 09:05:06 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jul 28 09:05:06.727147 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd00371d-20cb-499e-a4f0-64cabcf7b184 None None] Authenticating user token {{(pid=416293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:05:06.740935 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd00371d-20cb-499e-a4f0-64cabcf7b184 None None] Validating token access rules against request {{(pid=416293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:05:06.745814 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-814bbff3-d821-476b-a84a-695a36f915cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b5d78d12a0c4dfdbf387a60d6572e81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:05:06.746461 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814bbff3-d821-476b-a84a-695a36f915cb admin admin] REQUEST_METHOD: `GET` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:05:06.746750 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814bbff3-d821-476b-a84a-695a36f915cb admin admin] SCRIPT_NAME: `/identity` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:05:06.747044 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814bbff3-d821-476b-a84a-695a36f915cb admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:05:06.755662 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-814bbff3-d821-476b-a84a-695a36f915cb admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:05:06.757544 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-814bbff3-d821-476b-a84a-695a36f915cb admin admin] RBAC: Authorization granted {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:05:06.767069 dv-cinder-851351-1-smb devstack@keystone.service[416293]: [pid: 416293|app: 0|req: 4/8] 10.222.0.42 () {58 vars in 1324 bytes} [Thu Jul 28 09:05:06 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 28 09:05:06.773167 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33bd39e2-f329-4ee7-8990-a41b6aa4586d None None] Authenticating user token {{(pid=416294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:05:06.783831 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33bd39e2-f329-4ee7-8990-a41b6aa4586d None None] Validating token access rules against request {{(pid=416294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:05:06.789817 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-395faf39-ca01-40fc-940c-00ff5ad53fb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0b5d78d12a0c4dfdbf387a60d6572e81', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:05:06.790480 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395faf39-ca01-40fc-940c-00ff5ad53fb2 admin admin] REQUEST_METHOD: `GET` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:05:06.790770 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395faf39-ca01-40fc-940c-00ff5ad53fb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:05:06.791040 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395faf39-ca01-40fc-940c-00ff5ad53fb2 admin admin] PATH_INFO: `/v3/users/dbf87abab90e4fdf9e75408f4199918e` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:05:06.792616 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-395faf39-ca01-40fc-940c-00ff5ad53fb2 admin admin] RBAC: Authorizing `identity:get_user(user_id=dbf87abab90e4fdf9e75408f4199918e)` {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:05:06.794526 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-395faf39-ca01-40fc-940c-00ff5ad53fb2 admin admin] RBAC: Authorization granted {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:05:06.796166 dv-cinder-851351-1-smb devstack@keystone.service[416294]: [pid: 416294|app: 0|req: 5/9] 10.222.0.42 () {56 vars in 1198 bytes} [Thu Jul 28 09:05:06 2022] GET /identity/v3/users/dbf87abab90e4fdf9e75408f4199918e => generated 247 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:05:08.862936 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456e21cb-576d-432d-9a7d-503b5350549c None None] REQUEST_METHOD: `GET` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:05:08.863543 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456e21cb-576d-432d-9a7d-503b5350549c None None] SCRIPT_NAME: `/identity` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:05:08.863543 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456e21cb-576d-432d-9a7d-503b5350549c None None] PATH_INFO: `/` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:05:08.864957 dv-cinder-851351-1-smb devstack@keystone.service[416293]: [pid: 416293|app: 0|req: 5/10] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 09:05:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 28 09:05:08.870484 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb04805-df8e-41e7-ab9b-31d487c95c2a None None] REQUEST_METHOD: `POST` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:05:08.870937 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb04805-df8e-41e7-ab9b-31d487c95c2a None None] SCRIPT_NAME: `/identity` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:05:08.871039 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb04805-df8e-41e7-ab9b-31d487c95c2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:05:08.891787 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.auth.core [None req-aeb04805-df8e-41e7-ab9b-31d487c95c2a None None] MFA Rules not processed for user `dbf87abab90e4fdf9e75408f4199918e`. Rule list: `[]` (Enabled: `True`). {{(pid=416294) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 09:05:08.893041 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.fernet_utils [None req-aeb04805-df8e-41e7-ab9b-31d487c95c2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=416294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 09:05:08.914804 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f370bec-3092-4c17-a19f-f558aec427a1 None None] REQUEST_METHOD: `GET` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:05:08.915057 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f370bec-3092-4c17-a19f-f558aec427a1 None None] SCRIPT_NAME: `/identity` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:05:08.915364 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f370bec-3092-4c17-a19f-f558aec427a1 None None] PATH_INFO: `/` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:05:08.916943 dv-cinder-851351-1-smb devstack@keystone.service[416293]: [pid: 416293|app: 0|req: 6/11] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 09:05:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 28 09:05:08.921721 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3358936e-2e60-44e9-83c6-db18a44f9138 None None] REQUEST_METHOD: `POST` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:05:08.921984 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3358936e-2e60-44e9-83c6-db18a44f9138 None None] SCRIPT_NAME: `/identity` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:05:08.922279 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3358936e-2e60-44e9-83c6-db18a44f9138 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:05:08.965605 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG passlib.handlers.bcrypt [None req-3358936e-2e60-44e9-83c6-db18a44f9138 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=416293) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Jul 28 09:05:08.966352 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG passlib.handlers.bcrypt [None req-3358936e-2e60-44e9-83c6-db18a44f9138 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=416293) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Jul 28 09:05:08.999373 dv-cinder-851351-1-smb devstack@keystone.service[416294]: [pid: 416294|app: 0|req: 6/12] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 09:05:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 09:05:09.011652 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.auth.core [None req-3358936e-2e60-44e9-83c6-db18a44f9138 None None] MFA Rules not processed for user `dbf87abab90e4fdf9e75408f4199918e`. Rule list: `[]` (Enabled: `True`). {{(pid=416293) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 09:05:09.013285 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.fernet_utils [None req-3358936e-2e60-44e9-83c6-db18a44f9138 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=416293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 09:05:09.022873 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb04805-df8e-41e7-ab9b-31d487c95c2a None None] Authenticating user token {{(pid=416294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:05:09.050427 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG dbcounter [-] [416294] Writing DB stats keystone:SELECT=100 {{(pid=416294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:05:09.132412 dv-cinder-851351-1-smb devstack@keystone.service[416293]: [pid: 416293|app: 0|req: 7/13] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 09:05:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 28 09:05:09.141731 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb04805-df8e-41e7-ab9b-31d487c95c2a None None] Validating token access rules against request {{(pid=416294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:05:09.154676 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3358936e-2e60-44e9-83c6-db18a44f9138 None None] Authenticating user token {{(pid=416293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:05:09.179097 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa8332d-2751-485b-97b9-af0000b00ded None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:05:09.179774 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa8332d-2751-485b-97b9-af0000b00ded None admin] REQUEST_METHOD: `GET` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:05:09.180066 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa8332d-2751-485b-97b9-af0000b00ded None admin] SCRIPT_NAME: `/identity` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:05:09.180351 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa8332d-2751-485b-97b9-af0000b00ded None admin] PATH_INFO: `/v3/roles/admin` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:05:09.192492 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aa8332d-2751-485b-97b9-af0000b00ded None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 09:05:09.201876 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application [None req-8aa8332d-2751-485b-97b9-af0000b00ded None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 09:05:09.201876 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 09:05:09.201876 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 09:05:09.201876 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 09:05:09.201876 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 09:05:09.201876 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 09:05:09.201876 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 09:05:09.201876 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 09:05:09.201876 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 09:05:09.201876 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 09:05:09.201876 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 09:05:09.201876 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 09:05:09.201876 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 09:05:09.201876 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 09:05:09.201876 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 09:05:09.201876 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 09:05:09.202994 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 09:05:09.202994 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 09:05:09.202994 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 09:05:09.202994 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 09:05:09.202994 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 09:05:09.202994 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 09:05:09.202994 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 09:05:09.202994 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 09:05:09.202994 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 09:05:09.202994 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 09:05:09.202994 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 09:05:09.202994 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application with Lock( Jul 28 09:05:09.202994 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 09:05:09.202994 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return self._enter() Jul 28 09:05:09.202994 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 09:05:09.202994 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 09:05:09.203935 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 09:05:09.203935 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return self.creator() Jul 28 09:05:09.203935 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 09:05:09.203935 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application created_value = creator( Jul 28 09:05:09.203935 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 09:05:09.203935 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 09:05:09.203935 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 09:05:09.203935 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 09:05:09.203935 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 09:05:09.203935 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 09:05:09.203935 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 09:05:09.203935 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application Jul 28 09:05:09.203935 dv-cinder-851351-1-smb devstack@keystone.service[416294]: [pid: 416294|app: 0|req: 7/14] 10.222.0.42 () {56 vars in 1096 bytes} [Thu Jul 28 09:05:09 2022] GET /identity/v3/roles/admin => generated 83 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 09:05:09.209496 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa8332d-2751-485b-97b9-af0000b00ded None admin] Authenticating user token {{(pid=416294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:05:09.274379 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3358936e-2e60-44e9-83c6-db18a44f9138 None None] Validating token access rules against request {{(pid=416293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:05:09.276834 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG dbcounter [-] [416293] Writing DB stats keystone:SELECT=100 {{(pid=416293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:05:09.299612 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG dbcounter [-] [416294] Writing DB stats keystone:SELECT=100 {{(pid=416294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:05:09.314943 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925218eb-9c07-4487-800b-7b7bf7053689 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:05:09.315877 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925218eb-9c07-4487-800b-7b7bf7053689 None admin] REQUEST_METHOD: `GET` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:05:09.316168 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925218eb-9c07-4487-800b-7b7bf7053689 None admin] SCRIPT_NAME: `/identity` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:05:09.316578 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925218eb-9c07-4487-800b-7b7bf7053689 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:05:09.319979 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa8332d-2751-485b-97b9-af0000b00ded None admin] Validating token access rules against request {{(pid=416294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:05:09.356491 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-798dd59d-af00-42a7-8309-bee0dbb023a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:05:09.357144 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798dd59d-af00-42a7-8309-bee0dbb023a0 None admin] REQUEST_METHOD: `GET` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:05:09.357426 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798dd59d-af00-42a7-8309-bee0dbb023a0 None admin] SCRIPT_NAME: `/identity` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:05:09.357699 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798dd59d-af00-42a7-8309-bee0dbb023a0 None admin] PATH_INFO: `/v3/roles` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:05:09.358435 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-798dd59d-af00-42a7-8309-bee0dbb023a0 None admin] RBAC: Adding query filter params (name=admin) {{(pid=416294) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 09:05:09.358740 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-798dd59d-af00-42a7-8309-bee0dbb023a0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:05:09.360151 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-798dd59d-af00-42a7-8309-bee0dbb023a0 None admin] RBAC: Authorization granted {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:05:09.373970 dv-cinder-851351-1-smb devstack@keystone.service[416294]: [pid: 416294|app: 0|req: 8/15] 10.222.0.42 () {56 vars in 1099 bytes} [Thu Jul 28 09:05:09 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:05:09.379842 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-798dd59d-af00-42a7-8309-bee0dbb023a0 None admin] Authenticating user token {{(pid=416294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:05:09.386532 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-925218eb-9c07-4487-800b-7b7bf7053689 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:05:09.388041 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-925218eb-9c07-4487-800b-7b7bf7053689 None admin] RBAC: Authorization granted {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:05:09.495166 dv-cinder-851351-1-smb devstack@keystone.service[416293]: [pid: 416293|app: 0|req: 8/16] 10.222.0.42 () {58 vars in 1282 bytes} [Thu Jul 28 09:05:09 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 28 09:05:09.501609 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925218eb-9c07-4487-800b-7b7bf7053689 None admin] Authenticating user token {{(pid=416293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:05:09.505003 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG dbcounter [-] [416293] Writing DB stats keystone:SELECT=100 {{(pid=416293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:05:09.594269 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-798dd59d-af00-42a7-8309-bee0dbb023a0 None admin] Validating token access rules against request {{(pid=416294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:05:09.607720 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925218eb-9c07-4487-800b-7b7bf7053689 None admin] Validating token access rules against request {{(pid=416293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:05:09.629445 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d0f3b2-257d-417b-95bb-8096002ef711 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:05:09.630112 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d0f3b2-257d-417b-95bb-8096002ef711 None admin] REQUEST_METHOD: `GET` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:05:09.630444 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d0f3b2-257d-417b-95bb-8096002ef711 None admin] SCRIPT_NAME: `/identity` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:05:09.630722 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d0f3b2-257d-417b-95bb-8096002ef711 None admin] PATH_INFO: `/v3/users/dbf87abab90e4fdf9e75408f4199918e` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:05:09.631970 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60d0f3b2-257d-417b-95bb-8096002ef711 None admin] RBAC: Authorizing `identity:get_user(user_id=dbf87abab90e4fdf9e75408f4199918e)` {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:05:09.633483 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60d0f3b2-257d-417b-95bb-8096002ef711 None admin] RBAC: Authorization granted {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:05:09.635189 dv-cinder-851351-1-smb devstack@keystone.service[416294]: [pid: 416294|app: 0|req: 9/17] 10.222.0.42 () {56 vars in 1177 bytes} [Thu Jul 28 09:05:09 2022] GET /identity/v3/users/dbf87abab90e4fdf9e75408f4199918e => generated 247 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 09:05:09.640973 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d0f3b2-257d-417b-95bb-8096002ef711 None admin] Authenticating user token {{(pid=416294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:05:09.650266 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916a83fa-b7d9-4dca-aba7-785992fa9ba3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:05:09.651159 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916a83fa-b7d9-4dca-aba7-785992fa9ba3 None admin] REQUEST_METHOD: `GET` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:05:09.651449 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916a83fa-b7d9-4dca-aba7-785992fa9ba3 None admin] SCRIPT_NAME: `/identity` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:05:09.651728 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916a83fa-b7d9-4dca-aba7-785992fa9ba3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:05:09.660850 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG dbcounter [-] [416294] Writing DB stats keystone:SELECT=100 {{(pid=416294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:05:09.678685 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-916a83fa-b7d9-4dca-aba7-785992fa9ba3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:05:09.680208 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-916a83fa-b7d9-4dca-aba7-785992fa9ba3 None admin] RBAC: Authorization granted {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:05:09.698494 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application [None req-916a83fa-b7d9-4dca-aba7-785992fa9ba3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 09:05:09.698494 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 09:05:09.698494 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 09:05:09.698494 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 09:05:09.698494 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 09:05:09.698494 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 09:05:09.698494 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 09:05:09.698494 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 09:05:09.698494 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 09:05:09.698494 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 09:05:09.698494 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 09:05:09.698494 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 09:05:09.698494 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 09:05:09.698494 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 09:05:09.698494 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 09:05:09.699927 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 09:05:09.699927 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 09:05:09.699927 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 09:05:09.699927 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 09:05:09.699927 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 09:05:09.699927 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 09:05:09.699927 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 09:05:09.699927 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 09:05:09.699927 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application with Lock( Jul 28 09:05:09.699927 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 09:05:09.699927 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self._enter() Jul 28 09:05:09.699927 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 09:05:09.699927 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 09:05:09.699927 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 09:05:09.699927 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self.creator() Jul 28 09:05:09.699927 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 09:05:09.699927 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application created_value = creator( Jul 28 09:05:09.700864 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 09:05:09.700864 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 09:05:09.700864 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 09:05:09.700864 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application Jul 28 09:05:09.700864 dv-cinder-851351-1-smb devstack@keystone.service[416293]: [pid: 416293|app: 0|req: 9/18] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 09:05:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 09:05:09.706215 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916a83fa-b7d9-4dca-aba7-785992fa9ba3 None admin] Authenticating user token {{(pid=416293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:05:09.759332 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d0f3b2-257d-417b-95bb-8096002ef711 None admin] Validating token access rules against request {{(pid=416294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:05:09.764680 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG dbcounter [-] [416293] Writing DB stats keystone:SELECT=100 {{(pid=416293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:05:09.796558 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea11de8-a517-487c-8dc7-c10782284d98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:05:09.797253 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea11de8-a517-487c-8dc7-c10782284d98 None admin] REQUEST_METHOD: `GET` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:05:09.797543 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea11de8-a517-487c-8dc7-c10782284d98 None admin] SCRIPT_NAME: `/identity` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:05:09.797818 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea11de8-a517-487c-8dc7-c10782284d98 None admin] PATH_INFO: `/v3/domains/default` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:05:09.799056 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eea11de8-a517-487c-8dc7-c10782284d98 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:05:09.800541 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eea11de8-a517-487c-8dc7-c10782284d98 None admin] RBAC: Authorization granted {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:05:09.802238 dv-cinder-851351-1-smb devstack@keystone.service[416294]: [pid: 416294|app: 0|req: 10/19] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 09:05:09 2022] GET /identity/v3/domains/default => generated 199 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 09:05:09.808407 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea11de8-a517-487c-8dc7-c10782284d98 None admin] Authenticating user token {{(pid=416294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:05:09.810705 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916a83fa-b7d9-4dca-aba7-785992fa9ba3 None admin] Validating token access rules against request {{(pid=416293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:05:09.846124 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d69a6eb3-afbc-4632-b0b8-e978e19c7644 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:05:09.846765 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69a6eb3-afbc-4632-b0b8-e978e19c7644 None admin] REQUEST_METHOD: `GET` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:05:09.847051 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69a6eb3-afbc-4632-b0b8-e978e19c7644 None admin] SCRIPT_NAME: `/identity` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:05:09.847328 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69a6eb3-afbc-4632-b0b8-e978e19c7644 None admin] PATH_INFO: `/v3/domains` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:05:09.848096 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d69a6eb3-afbc-4632-b0b8-e978e19c7644 None admin] RBAC: Adding query filter params (name=Default) {{(pid=416293) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 09:05:09.848402 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d69a6eb3-afbc-4632-b0b8-e978e19c7644 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:05:09.849905 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d69a6eb3-afbc-4632-b0b8-e978e19c7644 None admin] RBAC: Authorization granted {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:05:09.867276 dv-cinder-851351-1-smb devstack@keystone.service[416293]: [pid: 416293|app: 0|req: 10/20] 10.222.0.42 () {56 vars in 1109 bytes} [Thu Jul 28 09:05:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 09:05:09.897530 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG dbcounter [-] [416294] Writing DB stats keystone:SELECT=100 {{(pid=416294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:05:09.919861 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea11de8-a517-487c-8dc7-c10782284d98 None admin] Validating token access rules against request {{(pid=416294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:05:09.961577 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4efb368-90d5-42e8-8588-24c2afba59d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:05:09.962293 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4efb368-90d5-42e8-8588-24c2afba59d1 None admin] REQUEST_METHOD: `GET` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:05:09.962814 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4efb368-90d5-42e8-8588-24c2afba59d1 None admin] SCRIPT_NAME: `/identity` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:05:09.963319 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4efb368-90d5-42e8-8588-24c2afba59d1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:05:09.964699 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4efb368-90d5-42e8-8588-24c2afba59d1 None admin] RBAC: Adding query filter params (role.id=c67085ec338243df8f9b7d6459036e23, scope.domain.id=default, user.id=dbf87abab90e4fdf9e75408f4199918e) {{(pid=416294) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 09:05:09.965250 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4efb368-90d5-42e8-8588-24c2afba59d1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:05:09.968050 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4efb368-90d5-42e8-8588-24c2afba59d1 None admin] RBAC: Authorization granted {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:05:09.978169 dv-cinder-851351-1-smb devstack@keystone.service[416294]: [pid: 416294|app: 0|req: 11/21] 10.222.0.42 () {56 vars in 1322 bytes} [Thu Jul 28 09:05:09 2022] GET /identity/v3/role_assignments?user.id=dbf87abab90e4fdf9e75408f4199918e&scope.domain.id=default&role.id=c67085ec338243df8f9b7d6459036e23 => generated 233 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 09:05:12.330317 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9023443-2ae3-477c-8297-23996250906a None None] REQUEST_METHOD: `GET` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:05:12.330869 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9023443-2ae3-477c-8297-23996250906a None None] SCRIPT_NAME: `/identity` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:05:12.330869 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9023443-2ae3-477c-8297-23996250906a None None] PATH_INFO: `/` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:05:12.332291 dv-cinder-851351-1-smb devstack@keystone.service[416293]: [pid: 416293|app: 0|req: 11/22] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 09:05:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 09:05:12.337824 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321c182d-83a0-4c1a-bdb9-95783053e33f None None] REQUEST_METHOD: `POST` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:05:12.338243 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321c182d-83a0-4c1a-bdb9-95783053e33f None None] SCRIPT_NAME: `/identity` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:05:12.338433 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321c182d-83a0-4c1a-bdb9-95783053e33f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:05:12.362699 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.auth.core [None req-321c182d-83a0-4c1a-bdb9-95783053e33f None None] MFA Rules not processed for user `dbf87abab90e4fdf9e75408f4199918e`. Rule list: `[]` (Enabled: `True`). {{(pid=416294) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 09:05:12.363991 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.fernet_utils [None req-321c182d-83a0-4c1a-bdb9-95783053e33f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=416294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 09:05:12.461865 dv-cinder-851351-1-smb devstack@keystone.service[416294]: [pid: 416294|app: 0|req: 12/23] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 09:05:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 28 09:05:12.495650 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9023443-2ae3-477c-8297-23996250906a None None] Authenticating user token {{(pid=416293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:05:12.551236 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f109a267-a4bf-4e12-b6db-e3f42939f9be None None] REQUEST_METHOD: `GET` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:05:12.552006 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f109a267-a4bf-4e12-b6db-e3f42939f9be None None] SCRIPT_NAME: `/identity` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:05:12.552491 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f109a267-a4bf-4e12-b6db-e3f42939f9be None None] PATH_INFO: `/` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:05:12.554434 dv-cinder-851351-1-smb devstack@keystone.service[416294]: [pid: 416294|app: 0|req: 13/24] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 09:05:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 09:05:12.565087 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001160be-baa0-405e-9a6a-0227ca7a9a55 None None] REQUEST_METHOD: `POST` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:05:12.565690 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001160be-baa0-405e-9a6a-0227ca7a9a55 None None] SCRIPT_NAME: `/identity` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:05:12.566201 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001160be-baa0-405e-9a6a-0227ca7a9a55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:05:12.598342 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.auth.core [None req-001160be-baa0-405e-9a6a-0227ca7a9a55 None None] MFA Rules not processed for user `dbf87abab90e4fdf9e75408f4199918e`. Rule list: `[]` (Enabled: `True`). {{(pid=416294) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 09:05:12.599977 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.fernet_utils [None req-001160be-baa0-405e-9a6a-0227ca7a9a55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=416294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 09:05:12.633973 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9023443-2ae3-477c-8297-23996250906a None None] Validating token access rules against request {{(pid=416293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:05:12.664230 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG dbcounter [-] [416293] Writing DB stats keystone:SELECT=100 {{(pid=416293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:05:12.692199 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48ca8ea-9f50-4457-864d-6ff503fff185 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:05:12.692916 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48ca8ea-9f50-4457-864d-6ff503fff185 None admin] REQUEST_METHOD: `GET` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:05:12.693205 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48ca8ea-9f50-4457-864d-6ff503fff185 None admin] SCRIPT_NAME: `/identity` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:05:12.693485 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48ca8ea-9f50-4457-864d-6ff503fff185 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:05:12.715081 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b48ca8ea-9f50-4457-864d-6ff503fff185 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 09:05:12.721930 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application [None req-b48ca8ea-9f50-4457-864d-6ff503fff185 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 09:05:12.721930 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 09:05:12.721930 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 09:05:12.721930 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 09:05:12.721930 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 09:05:12.721930 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 09:05:12.721930 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 09:05:12.721930 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 09:05:12.721930 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 09:05:12.721930 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 09:05:12.721930 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 09:05:12.721930 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 09:05:12.721930 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 09:05:12.721930 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 09:05:12.721930 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 09:05:12.721930 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 09:05:12.722975 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 09:05:12.722975 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 09:05:12.722975 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 09:05:12.722975 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 09:05:12.722975 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 09:05:12.722975 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 09:05:12.722975 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 09:05:12.722975 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 09:05:12.722975 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 09:05:12.722975 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 09:05:12.722975 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 09:05:12.722975 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application with Lock( Jul 28 09:05:12.722975 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 09:05:12.722975 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self._enter() Jul 28 09:05:12.722975 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 09:05:12.722975 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 09:05:12.723813 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 09:05:12.723813 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self.creator() Jul 28 09:05:12.723813 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 09:05:12.723813 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application created_value = creator( Jul 28 09:05:12.723813 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 09:05:12.723813 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 09:05:12.723813 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 09:05:12.723813 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 09:05:12.723813 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 09:05:12.723813 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 09:05:12.723813 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 09:05:12.723813 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application Jul 28 09:05:12.723813 dv-cinder-851351-1-smb devstack@keystone.service[416293]: [pid: 416293|app: 0|req: 12/25] 10.222.0.42 () {56 vars in 1096 bytes} [Thu Jul 28 09:05:12 2022] GET /identity/v3/roles/admin => generated 83 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 09:05:12.725030 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c178b7-03c9-46cc-82d8-f3c3f065b93e None None] REQUEST_METHOD: `GET` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:05:12.725030 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c178b7-03c9-46cc-82d8-f3c3f065b93e None None] SCRIPT_NAME: `/identity` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:05:12.725207 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c178b7-03c9-46cc-82d8-f3c3f065b93e None None] PATH_INFO: `/` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:05:12.726636 dv-cinder-851351-1-smb devstack@keystone.service[416293]: [pid: 416293|app: 0|req: 13/26] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 09:05:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 09:05:12.731380 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c178b7-03c9-46cc-82d8-f3c3f065b93e None None] Authenticating user token {{(pid=416293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:05:12.747484 dv-cinder-851351-1-smb devstack@keystone.service[416294]: [pid: 416294|app: 0|req: 14/27] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 09:05:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 28 09:05:12.748986 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670720c2-46d7-4628-a5ad-856dd6385ab0 None None] REQUEST_METHOD: `POST` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:05:12.749287 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670720c2-46d7-4628-a5ad-856dd6385ab0 None None] SCRIPT_NAME: `/identity` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:05:12.749568 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670720c2-46d7-4628-a5ad-856dd6385ab0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:05:12.765380 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG dbcounter [-] [416294] Writing DB stats keystone:SELECT=100 {{(pid=416294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:05:12.783753 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.auth.core [None req-670720c2-46d7-4628-a5ad-856dd6385ab0 None None] MFA Rules not processed for user `dbf87abab90e4fdf9e75408f4199918e`. Rule list: `[]` (Enabled: `True`). {{(pid=416294) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 09:05:12.785108 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.fernet_utils [None req-670720c2-46d7-4628-a5ad-856dd6385ab0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=416294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 09:05:12.865251 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c178b7-03c9-46cc-82d8-f3c3f065b93e None None] Validating token access rules against request {{(pid=416293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:05:12.929230 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ad631a-657c-479f-9d24-bce4abc3e730 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:05:12.930101 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ad631a-657c-479f-9d24-bce4abc3e730 None admin] REQUEST_METHOD: `GET` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:05:12.930388 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ad631a-657c-479f-9d24-bce4abc3e730 None admin] SCRIPT_NAME: `/identity` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:05:12.932958 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ad631a-657c-479f-9d24-bce4abc3e730 None admin] PATH_INFO: `/v3/roles` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:05:12.933722 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69ad631a-657c-479f-9d24-bce4abc3e730 None admin] RBAC: Adding query filter params (name=admin) {{(pid=416293) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 09:05:12.934040 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69ad631a-657c-479f-9d24-bce4abc3e730 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:05:12.937081 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69ad631a-657c-479f-9d24-bce4abc3e730 None admin] RBAC: Authorization granted {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:05:12.937419 dv-cinder-851351-1-smb devstack@keystone.service[416294]: [pid: 416294|app: 0|req: 15/28] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 09:05:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 09:05:12.938389 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670720c2-46d7-4628-a5ad-856dd6385ab0 None None] Authenticating user token {{(pid=416294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:05:12.959282 dv-cinder-851351-1-smb devstack@keystone.service[416293]: [pid: 416293|app: 0|req: 14/29] 10.222.0.42 () {56 vars in 1099 bytes} [Thu Jul 28 09:05:12 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:05:12.960591 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e9f266-3fbf-4bc2-ae17-278ae53557ee None None] REQUEST_METHOD: `GET` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:05:12.960905 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e9f266-3fbf-4bc2-ae17-278ae53557ee None None] SCRIPT_NAME: `/identity` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:05:12.961186 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e9f266-3fbf-4bc2-ae17-278ae53557ee None None] PATH_INFO: `/` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:05:12.962662 dv-cinder-851351-1-smb devstack@keystone.service[416293]: [pid: 416293|app: 0|req: 15/30] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 09:05:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 09:05:12.970126 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12e500b-85dc-4dfd-bd1b-3c4618e98b07 None None] REQUEST_METHOD: `POST` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:05:12.970327 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12e500b-85dc-4dfd-bd1b-3c4618e98b07 None None] SCRIPT_NAME: `/identity` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:05:12.976232 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12e500b-85dc-4dfd-bd1b-3c4618e98b07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:05:13.072004 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670720c2-46d7-4628-a5ad-856dd6385ab0 None None] Validating token access rules against request {{(pid=416294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:05:13.111287 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.auth.core [None req-d12e500b-85dc-4dfd-bd1b-3c4618e98b07 None None] MFA Rules not processed for user `dbf87abab90e4fdf9e75408f4199918e`. Rule list: `[]` (Enabled: `True`). {{(pid=416293) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 09:05:13.112511 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.fernet_utils [None req-d12e500b-85dc-4dfd-bd1b-3c4618e98b07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=416293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 09:05:13.120481 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a853f22-2a28-4b41-8daf-678999c0ee6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:05:13.121469 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a853f22-2a28-4b41-8daf-678999c0ee6a None admin] REQUEST_METHOD: `GET` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:05:13.122057 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a853f22-2a28-4b41-8daf-678999c0ee6a None admin] SCRIPT_NAME: `/identity` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:05:13.122848 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a853f22-2a28-4b41-8daf-678999c0ee6a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:05:13.125429 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG dbcounter [-] [416294] Writing DB stats keystone:SELECT=100 {{(pid=416294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:05:13.137992 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a853f22-2a28-4b41-8daf-678999c0ee6a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:05:13.139602 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a853f22-2a28-4b41-8daf-678999c0ee6a None admin] RBAC: Authorization granted {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:05:13.153505 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG dbcounter [-] [416293] Writing DB stats keystone:SELECT=100 {{(pid=416293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:05:13.171423 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application [None req-4a853f22-2a28-4b41-8daf-678999c0ee6a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 09:05:13.171423 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 09:05:13.171423 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 09:05:13.171423 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 09:05:13.171423 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 09:05:13.171423 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 09:05:13.171423 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 09:05:13.171423 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 09:05:13.171423 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 09:05:13.171423 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 09:05:13.171423 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 09:05:13.171423 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 09:05:13.171423 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 09:05:13.171423 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 09:05:13.171423 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 09:05:13.172400 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 09:05:13.172400 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 09:05:13.172400 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 09:05:13.172400 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 09:05:13.172400 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 09:05:13.172400 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 09:05:13.172400 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 09:05:13.172400 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 09:05:13.172400 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application with Lock( Jul 28 09:05:13.172400 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 09:05:13.172400 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return self._enter() Jul 28 09:05:13.172400 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 09:05:13.172400 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 09:05:13.172400 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 09:05:13.172400 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return self.creator() Jul 28 09:05:13.172400 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 09:05:13.172400 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application created_value = creator( Jul 28 09:05:13.173705 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 09:05:13.173705 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 09:05:13.173705 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 09:05:13.173705 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application Jul 28 09:05:13.173705 dv-cinder-851351-1-smb devstack@keystone.service[416294]: [pid: 416294|app: 0|req: 16/31] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 09:05:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 09:05:13.173705 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a853f22-2a28-4b41-8daf-678999c0ee6a None admin] Authenticating user token {{(pid=416294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:05:13.220695 dv-cinder-851351-1-smb devstack@keystone.service[416293]: [pid: 416293|app: 0|req: 16/32] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 09:05:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 245 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 09:05:13.220695 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12e500b-85dc-4dfd-bd1b-3c4618e98b07 None None] Authenticating user token {{(pid=416293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:05:13.306298 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a853f22-2a28-4b41-8daf-678999c0ee6a None admin] Validating token access rules against request {{(pid=416294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:05:13.326504 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12e500b-85dc-4dfd-bd1b-3c4618e98b07 None None] Validating token access rules against request {{(pid=416293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:05:13.344356 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b00f48-449e-4298-a612-d737b0d8d301 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:05:13.345783 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b00f48-449e-4298-a612-d737b0d8d301 None admin] REQUEST_METHOD: `GET` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:05:13.346290 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b00f48-449e-4298-a612-d737b0d8d301 None admin] SCRIPT_NAME: `/identity` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:05:13.346777 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b00f48-449e-4298-a612-d737b0d8d301 None admin] PATH_INFO: `/v3/users/dbf87abab90e4fdf9e75408f4199918e` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:05:13.348242 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b00f48-449e-4298-a612-d737b0d8d301 None admin] RBAC: Authorizing `identity:get_user(user_id=dbf87abab90e4fdf9e75408f4199918e)` {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:05:13.350206 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b00f48-449e-4298-a612-d737b0d8d301 None admin] RBAC: Authorization granted {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:05:13.352093 dv-cinder-851351-1-smb devstack@keystone.service[416294]: [pid: 416294|app: 0|req: 17/33] 10.222.0.42 () {56 vars in 1177 bytes} [Thu Jul 28 09:05:13 2022] GET /identity/v3/users/dbf87abab90e4fdf9e75408f4199918e => generated 247 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:05:13.353183 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b00f48-449e-4298-a612-d737b0d8d301 None admin] Authenticating user token {{(pid=416294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:05:13.365432 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7d2d8b-5f53-4989-bf2d-04d12bb78464 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:05:13.366762 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7d2d8b-5f53-4989-bf2d-04d12bb78464 None admin] REQUEST_METHOD: `POST` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:05:13.367247 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7d2d8b-5f53-4989-bf2d-04d12bb78464 None admin] SCRIPT_NAME: `/identity` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:05:13.367714 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7d2d8b-5f53-4989-bf2d-04d12bb78464 None admin] PATH_INFO: `/v3/roles` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:05:13.368787 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba7d2d8b-5f53-4989-bf2d-04d12bb78464 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:05:13.370456 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba7d2d8b-5f53-4989-bf2d-04d12bb78464 None admin] RBAC: Authorization granted {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:05:13.418326 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG dbcounter [-] [416294] Writing DB stats keystone:SELECT=100 {{(pid=416294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:05:13.468946 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b00f48-449e-4298-a612-d737b0d8d301 None admin] Validating token access rules against request {{(pid=416294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:05:13.508836 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69624e1e-4917-4afd-9e14-2446a534ceaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:05:13.509828 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69624e1e-4917-4afd-9e14-2446a534ceaf None admin] REQUEST_METHOD: `GET` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:05:13.510309 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69624e1e-4917-4afd-9e14-2446a534ceaf None admin] SCRIPT_NAME: `/identity` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:05:13.510781 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69624e1e-4917-4afd-9e14-2446a534ceaf None admin] PATH_INFO: `/v3/domains` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:05:13.511700 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69624e1e-4917-4afd-9e14-2446a534ceaf None admin] RBAC: Adding query filter params (name=Default) {{(pid=416294) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 09:05:13.512198 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69624e1e-4917-4afd-9e14-2446a534ceaf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:05:13.513874 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69624e1e-4917-4afd-9e14-2446a534ceaf None admin] RBAC: Authorization granted {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:05:13.527468 dv-cinder-851351-1-smb devstack@keystone.service[416293]: [pid: 416293|app: 0|req: 17/34] 10.222.0.42 () {60 vars in 1131 bytes} [Thu Jul 28 09:05:13 2022] POST /identity/v3/roles => generated 225 bytes in 312 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 09:05:13.533569 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7d2d8b-5f53-4989-bf2d-04d12bb78464 None admin] Authenticating user token {{(pid=416293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:05:13.535297 dv-cinder-851351-1-smb devstack@keystone.service[416294]: [pid: 416294|app: 0|req: 18/35] 10.222.0.42 () {56 vars in 1109 bytes} [Thu Jul 28 09:05:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:05:13.536373 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69624e1e-4917-4afd-9e14-2446a534ceaf None admin] Authenticating user token {{(pid=416294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:05:13.590412 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG dbcounter [-] [416293] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=416293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:05:13.673624 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69624e1e-4917-4afd-9e14-2446a534ceaf None admin] Validating token access rules against request {{(pid=416294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:05:13.691285 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG dbcounter [-] [416294] Writing DB stats keystone:SELECT=100 {{(pid=416294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:05:13.714765 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7d2d8b-5f53-4989-bf2d-04d12bb78464 None admin] Validating token access rules against request {{(pid=416293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:05:13.717022 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1daadf4-b537-4ed2-a515-e8592557947c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:05:13.718064 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1daadf4-b537-4ed2-a515-e8592557947c None admin] REQUEST_METHOD: `GET` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:05:13.718576 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1daadf4-b537-4ed2-a515-e8592557947c None admin] SCRIPT_NAME: `/identity` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:05:13.719079 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1daadf4-b537-4ed2-a515-e8592557947c None admin] PATH_INFO: `/v3/domains/default` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:05:13.720616 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1daadf4-b537-4ed2-a515-e8592557947c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:05:13.722513 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1daadf4-b537-4ed2-a515-e8592557947c None admin] RBAC: Authorization granted {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:05:13.724680 dv-cinder-851351-1-smb devstack@keystone.service[416294]: [pid: 416294|app: 0|req: 19/36] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 09:05:13 2022] GET /identity/v3/domains/default => generated 199 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:05:13.725767 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1daadf4-b537-4ed2-a515-e8592557947c None admin] Authenticating user token {{(pid=416294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:05:13.759823 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-726d773b-1bc2-4248-8619-bbd955f310de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:05:13.760562 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726d773b-1bc2-4248-8619-bbd955f310de None admin] REQUEST_METHOD: `POST` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:05:13.760848 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726d773b-1bc2-4248-8619-bbd955f310de None admin] SCRIPT_NAME: `/identity` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:05:13.761131 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726d773b-1bc2-4248-8619-bbd955f310de None admin] PATH_INFO: `/v3/roles` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:05:13.761888 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-726d773b-1bc2-4248-8619-bbd955f310de None admin] RBAC: Authorizing `identity:create_role()` {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:05:13.763470 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-726d773b-1bc2-4248-8619-bbd955f310de None admin] RBAC: Authorization granted {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:05:13.781799 dv-cinder-851351-1-smb devstack@keystone.service[416293]: [pid: 416293|app: 0|req: 18/37] 10.222.0.42 () {60 vars in 1131 bytes} [Thu Jul 28 09:05:13 2022] POST /identity/v3/roles => generated 219 bytes in 254 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 09:05:13.783455 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad96253-5e27-4437-813d-40e6ff6646ca None None] REQUEST_METHOD: `GET` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:05:13.783753 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad96253-5e27-4437-813d-40e6ff6646ca None None] SCRIPT_NAME: `/identity` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:05:13.784049 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad96253-5e27-4437-813d-40e6ff6646ca None None] PATH_INFO: `/` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:05:13.786333 dv-cinder-851351-1-smb devstack@keystone.service[416293]: [pid: 416293|app: 0|req: 19/38] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 09:05:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 09:05:13.786547 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92bb2830-aa9e-41f8-9e36-2a0415a83cd5 None None] REQUEST_METHOD: `GET` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:05:13.787229 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92bb2830-aa9e-41f8-9e36-2a0415a83cd5 None None] SCRIPT_NAME: `/identity` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:05:13.787229 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92bb2830-aa9e-41f8-9e36-2a0415a83cd5 None None] PATH_INFO: `/` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:05:13.790221 dv-cinder-851351-1-smb devstack@keystone.service[416293]: [pid: 416293|app: 0|req: 20/39] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 09:05:13 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 09:05:13.790221 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92bb2830-aa9e-41f8-9e36-2a0415a83cd5 None None] Authenticating user token {{(pid=416293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:05:13.895364 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1daadf4-b537-4ed2-a515-e8592557947c None admin] Validating token access rules against request {{(pid=416294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:05:13.938930 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab029431-fa45-4c66-b18f-4c3fbb88591e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:05:13.939498 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab029431-fa45-4c66-b18f-4c3fbb88591e None admin] REQUEST_METHOD: `POST` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:05:13.939812 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab029431-fa45-4c66-b18f-4c3fbb88591e None admin] SCRIPT_NAME: `/identity` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:05:13.940087 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab029431-fa45-4c66-b18f-4c3fbb88591e None admin] PATH_INFO: `/v3/projects` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:05:13.940841 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab029431-fa45-4c66-b18f-4c3fbb88591e None admin] RBAC: Authorizing `identity:create_project()` {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:05:13.942364 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab029431-fa45-4c66-b18f-4c3fbb88591e None admin] RBAC: Authorization granted {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:05:13.954722 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG dbcounter [-] [416293] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=416293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:05:13.981501 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92bb2830-aa9e-41f8-9e36-2a0415a83cd5 None None] Validating token access rules against request {{(pid=416293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:05:14.027834 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2385686-1597-4e43-bd82-f5d605c374ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:05:14.028569 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2385686-1597-4e43-bd82-f5d605c374ba None admin] REQUEST_METHOD: `PUT` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:05:14.028885 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2385686-1597-4e43-bd82-f5d605c374ba None admin] SCRIPT_NAME: `/identity` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:05:14.029175 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2385686-1597-4e43-bd82-f5d605c374ba None admin] PATH_INFO: `/v3/domains/default/users/dbf87abab90e4fdf9e75408f4199918e/roles/c67085ec338243df8f9b7d6459036e23` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:05:14.031770 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2385686-1597-4e43-bd82-f5d605c374ba None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=dbf87abab90e4fdf9e75408f4199918e, role_id=c67085ec338243df8f9b7d6459036e23)` {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:05:14.033302 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2385686-1597-4e43-bd82-f5d605c374ba None admin] RBAC: Authorization granted {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:05:14.052483 dv-cinder-851351-1-smb devstack@keystone.service[416293]: [pid: 416293|app: 0|req: 21/40] 10.222.0.42 () {58 vars in 1361 bytes} [Thu Jul 28 09:05:13 2022] PUT /identity/v3/domains/default/users/dbf87abab90e4fdf9e75408f4199918e/roles/c67085ec338243df8f9b7d6459036e23 => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 09:05:14.054028 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac185996-eaa8-4333-b556-9c75cc5952e6 None None] REQUEST_METHOD: `POST` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:05:14.054323 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac185996-eaa8-4333-b556-9c75cc5952e6 None None] SCRIPT_NAME: `/identity` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:05:14.054606 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac185996-eaa8-4333-b556-9c75cc5952e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:05:14.075932 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.auth.core [None req-ac185996-eaa8-4333-b556-9c75cc5952e6 None None] MFA Rules not processed for user `dbf87abab90e4fdf9e75408f4199918e`. Rule list: `[]` (Enabled: `True`). {{(pid=416293) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 09:05:14.077577 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.fernet_utils [None req-ac185996-eaa8-4333-b556-9c75cc5952e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=416293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 09:05:14.093645 dv-cinder-851351-1-smb devstack@keystone.service[416294]: [pid: 416294|app: 0|req: 20/41] 10.222.0.42 () {60 vars in 1141 bytes} [Thu Jul 28 09:05:13 2022] POST /identity/v3/projects => generated 301 bytes in 368 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 09:05:14.095015 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbf834c-1f65-4cdd-8451-0629b363fc4b None None] REQUEST_METHOD: `POST` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:05:14.095316 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbf834c-1f65-4cdd-8451-0629b363fc4b None None] SCRIPT_NAME: `/identity` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:05:14.095602 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbf834c-1f65-4cdd-8451-0629b363fc4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:05:14.120516 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.auth.core [None req-6fbf834c-1f65-4cdd-8451-0629b363fc4b None None] MFA Rules not processed for user `dbf87abab90e4fdf9e75408f4199918e`. Rule list: `[]` (Enabled: `True`). {{(pid=416294) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 09:05:14.122976 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.fernet_utils [None req-6fbf834c-1f65-4cdd-8451-0629b363fc4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=416294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 09:05:14.159277 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG dbcounter [-] [416294] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=416294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:05:14.177489 dv-cinder-851351-1-smb devstack@keystone.service[416293]: [pid: 416293|app: 0|req: 22/42] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 09:05:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 09:05:14.202760 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac185996-eaa8-4333-b556-9c75cc5952e6 None None] Authenticating user token {{(pid=416293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:05:14.217037 dv-cinder-851351-1-smb devstack@keystone.service[416294]: [pid: 416294|app: 0|req: 21/43] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 09:05:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 09:05:14.241282 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fbf834c-1f65-4cdd-8451-0629b363fc4b None None] Authenticating user token {{(pid=416294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:05:14.311471 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG dbcounter [-] [416293] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=416293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:05:14.339685 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac185996-eaa8-4333-b556-9c75cc5952e6 None None] Validating token access rules against request {{(pid=416293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:05:14.370859 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fbf834c-1f65-4cdd-8451-0629b363fc4b None None] Validating token access rules against request {{(pid=416294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:05:14.390790 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9058119-48e8-4dd5-ae84-61c1f2160f2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:05:14.390790 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9058119-48e8-4dd5-ae84-61c1f2160f2e None admin] REQUEST_METHOD: `GET` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:05:14.390790 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9058119-48e8-4dd5-ae84-61c1f2160f2e None admin] SCRIPT_NAME: `/identity` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:05:14.390790 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9058119-48e8-4dd5-ae84-61c1f2160f2e None admin] PATH_INFO: `/v3/domains/default` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:05:14.392160 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9058119-48e8-4dd5-ae84-61c1f2160f2e None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:05:14.393732 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9058119-48e8-4dd5-ae84-61c1f2160f2e None admin] RBAC: Authorization granted {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:05:14.396133 dv-cinder-851351-1-smb devstack@keystone.service[416293]: [pid: 416293|app: 0|req: 23/44] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 09:05:14 2022] GET /identity/v3/domains/default => generated 199 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 09:05:14.401611 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9058119-48e8-4dd5-ae84-61c1f2160f2e None admin] Authenticating user token {{(pid=416293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:05:14.409156 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a0d576-103a-4c6a-9656-e5d0b7de253c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:05:14.409821 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a0d576-103a-4c6a-9656-e5d0b7de253c None admin] REQUEST_METHOD: `POST` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:05:14.410299 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a0d576-103a-4c6a-9656-e5d0b7de253c None admin] SCRIPT_NAME: `/identity` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:05:14.410697 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a0d576-103a-4c6a-9656-e5d0b7de253c None admin] PATH_INFO: `/v3/roles` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:05:14.411444 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5a0d576-103a-4c6a-9656-e5d0b7de253c None admin] RBAC: Authorizing `identity:create_role()` {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:05:14.413128 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5a0d576-103a-4c6a-9656-e5d0b7de253c None admin] RBAC: Authorization granted {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:05:14.431181 dv-cinder-851351-1-smb devstack@keystone.service[416294]: [pid: 416294|app: 0|req: 22/45] 10.222.0.42 () {60 vars in 1131 bytes} [Thu Jul 28 09:05:14 2022] POST /identity/v3/roles => generated 223 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 09:05:14.576544 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9058119-48e8-4dd5-ae84-61c1f2160f2e None admin] Validating token access rules against request {{(pid=416293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:05:14.619026 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61889562-013b-4637-b661-d335a33301b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:05:14.619691 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61889562-013b-4637-b661-d335a33301b0 None admin] REQUEST_METHOD: `POST` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:05:14.619980 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61889562-013b-4637-b661-d335a33301b0 None admin] SCRIPT_NAME: `/identity` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:05:14.620262 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61889562-013b-4637-b661-d335a33301b0 None admin] PATH_INFO: `/v3/projects` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:05:14.621021 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61889562-013b-4637-b661-d335a33301b0 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:05:14.622544 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61889562-013b-4637-b661-d335a33301b0 None admin] RBAC: Authorization granted {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:05:14.651177 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG dbcounter [-] [416293] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=416293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:05:14.664834 dv-cinder-851351-1-smb devstack@keystone.service[416293]: [pid: 416293|app: 0|req: 24/46] 10.222.0.42 () {60 vars in 1141 bytes} [Thu Jul 28 09:05:14 2022] POST /identity/v3/projects => generated 312 bytes in 264 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 28 09:05:16.090474 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79932095-776c-410c-8087-50d5b10b7eef None None] REQUEST_METHOD: `GET` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:05:16.091024 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79932095-776c-410c-8087-50d5b10b7eef None None] SCRIPT_NAME: `/identity` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:05:16.091024 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79932095-776c-410c-8087-50d5b10b7eef None None] PATH_INFO: `/` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:05:16.092420 dv-cinder-851351-1-smb devstack@keystone.service[416294]: [pid: 416294|app: 0|req: 23/47] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 09:05:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 09:05:16.097902 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aee9fcb-0daa-4efb-b02a-2a3a4a1df1bd None None] REQUEST_METHOD: `POST` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:05:16.098350 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aee9fcb-0daa-4efb-b02a-2a3a4a1df1bd None None] SCRIPT_NAME: `/identity` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:05:16.098460 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aee9fcb-0daa-4efb-b02a-2a3a4a1df1bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:05:16.118484 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.auth.core [None req-1aee9fcb-0daa-4efb-b02a-2a3a4a1df1bd None None] MFA Rules not processed for user `dbf87abab90e4fdf9e75408f4199918e`. Rule list: `[]` (Enabled: `True`). {{(pid=416293) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 09:05:16.119698 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.fernet_utils [None req-1aee9fcb-0daa-4efb-b02a-2a3a4a1df1bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=416293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 09:05:16.200703 dv-cinder-851351-1-smb devstack@keystone.service[416293]: [pid: 416293|app: 0|req: 25/48] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 09:05:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 09:05:16.223716 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79932095-776c-410c-8087-50d5b10b7eef None None] Authenticating user token {{(pid=416294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:05:16.252478 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG dbcounter [-] [416294] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=416294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:05:16.338541 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79932095-776c-410c-8087-50d5b10b7eef None None] Validating token access rules against request {{(pid=416294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:05:16.375281 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a91a91b-58f9-40e2-b516-d1baaa0dcd0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:05:16.375950 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a91a91b-58f9-40e2-b516-d1baaa0dcd0d None admin] REQUEST_METHOD: `GET` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:05:16.376236 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a91a91b-58f9-40e2-b516-d1baaa0dcd0d None admin] SCRIPT_NAME: `/identity` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:05:16.376517 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a91a91b-58f9-40e2-b516-d1baaa0dcd0d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:05:16.387298 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a91a91b-58f9-40e2-b516-d1baaa0dcd0d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 09:05:16.392321 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application [None req-3a91a91b-58f9-40e2-b516-d1baaa0dcd0d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 09:05:16.392321 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 09:05:16.392321 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 09:05:16.392321 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 09:05:16.392321 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 09:05:16.392321 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 09:05:16.392321 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 09:05:16.392321 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 09:05:16.392321 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 09:05:16.392321 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 09:05:16.392321 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 09:05:16.392321 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 09:05:16.392321 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 09:05:16.392321 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 09:05:16.392321 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 09:05:16.392321 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 09:05:16.393296 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 09:05:16.393296 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 09:05:16.393296 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 09:05:16.393296 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 09:05:16.393296 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 09:05:16.393296 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 09:05:16.393296 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 09:05:16.393296 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 09:05:16.393296 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 09:05:16.393296 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 09:05:16.393296 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 09:05:16.393296 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application with Lock( Jul 28 09:05:16.393296 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 09:05:16.393296 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return self._enter() Jul 28 09:05:16.393296 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 09:05:16.393296 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 09:05:16.394468 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 09:05:16.394468 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return self.creator() Jul 28 09:05:16.394468 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 09:05:16.394468 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application created_value = creator( Jul 28 09:05:16.394468 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 09:05:16.394468 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 09:05:16.394468 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 09:05:16.394468 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 09:05:16.394468 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 09:05:16.394468 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 09:05:16.394468 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 09:05:16.394468 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application Jul 28 09:05:16.394468 dv-cinder-851351-1-smb devstack@keystone.service[416294]: [pid: 416294|app: 0|req: 24/49] 10.222.0.42 () {56 vars in 1096 bytes} [Thu Jul 28 09:05:16 2022] GET /identity/v3/roles/admin => generated 83 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 09:05:16.399832 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aee9fcb-0daa-4efb-b02a-2a3a4a1df1bd None None] Authenticating user token {{(pid=416293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:05:16.506652 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aee9fcb-0daa-4efb-b02a-2a3a4a1df1bd None None] Validating token access rules against request {{(pid=416293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:05:16.534357 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG dbcounter [-] [416293] Writing DB stats keystone:SELECT=100 {{(pid=416293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:05:16.544747 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4aabba-849c-4db8-bca9-2a1883183960 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:05:16.545399 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4aabba-849c-4db8-bca9-2a1883183960 None admin] REQUEST_METHOD: `GET` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:05:16.545686 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4aabba-849c-4db8-bca9-2a1883183960 None admin] SCRIPT_NAME: `/identity` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:05:16.545969 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4aabba-849c-4db8-bca9-2a1883183960 None admin] PATH_INFO: `/v3/roles` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:05:16.546714 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d4aabba-849c-4db8-bca9-2a1883183960 None admin] RBAC: Adding query filter params (name=admin) {{(pid=416293) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 09:05:16.547023 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d4aabba-849c-4db8-bca9-2a1883183960 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:05:16.548456 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d4aabba-849c-4db8-bca9-2a1883183960 None admin] RBAC: Authorization granted {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:05:16.557873 dv-cinder-851351-1-smb devstack@keystone.service[416293]: [pid: 416293|app: 0|req: 26/50] 10.222.0.42 () {56 vars in 1099 bytes} [Thu Jul 28 09:05:16 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:05:16.564313 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a91a91b-58f9-40e2-b516-d1baaa0dcd0d None admin] Authenticating user token {{(pid=416294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:05:16.655820 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG dbcounter [-] [416294] Writing DB stats keystone:SELECT=100 {{(pid=416294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:05:16.673385 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a91a91b-58f9-40e2-b516-d1baaa0dcd0d None admin] Validating token access rules against request {{(pid=416294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:05:16.704630 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a71b4a1-27f5-4c97-b271-ad9d68f1c344 None None] REQUEST_METHOD: `GET` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:05:16.705001 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a71b4a1-27f5-4c97-b271-ad9d68f1c344 None None] SCRIPT_NAME: `/identity` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:05:16.705285 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a71b4a1-27f5-4c97-b271-ad9d68f1c344 None None] PATH_INFO: `/` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:05:16.706658 dv-cinder-851351-1-smb devstack@keystone.service[416293]: [pid: 416293|app: 0|req: 27/51] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 09:05:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 09:05:16.709343 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c18ed66-e76d-4ca8-ab48-235b85ff2da2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:05:16.710001 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c18ed66-e76d-4ca8-ab48-235b85ff2da2 None admin] REQUEST_METHOD: `GET` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:05:16.710288 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c18ed66-e76d-4ca8-ab48-235b85ff2da2 None admin] SCRIPT_NAME: `/identity` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:05:16.710609 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c18ed66-e76d-4ca8-ab48-235b85ff2da2 None admin] PATH_INFO: `/v3/users/dbf87abab90e4fdf9e75408f4199918e` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:05:16.711763 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c18ed66-e76d-4ca8-ab48-235b85ff2da2 None admin] RBAC: Authorizing `identity:get_user(user_id=dbf87abab90e4fdf9e75408f4199918e)` {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:05:16.711938 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8398be3a-cb28-4fa9-9872-8754b12672dd None None] REQUEST_METHOD: `POST` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:05:16.712237 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8398be3a-cb28-4fa9-9872-8754b12672dd None None] SCRIPT_NAME: `/identity` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:05:16.712523 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8398be3a-cb28-4fa9-9872-8754b12672dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:05:16.713277 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c18ed66-e76d-4ca8-ab48-235b85ff2da2 None admin] RBAC: Authorization granted {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:05:16.714918 dv-cinder-851351-1-smb devstack@keystone.service[416294]: [pid: 416294|app: 0|req: 25/52] 10.222.0.42 () {56 vars in 1177 bytes} [Thu Jul 28 09:05:16 2022] GET /identity/v3/users/dbf87abab90e4fdf9e75408f4199918e => generated 247 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:05:16.720397 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c18ed66-e76d-4ca8-ab48-235b85ff2da2 None admin] Authenticating user token {{(pid=416294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:05:16.731841 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.auth.core [None req-8398be3a-cb28-4fa9-9872-8754b12672dd None None] MFA Rules not processed for user `dbf87abab90e4fdf9e75408f4199918e`. Rule list: `[]` (Enabled: `True`). {{(pid=416293) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 09:05:16.733092 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.fernet_utils [None req-8398be3a-cb28-4fa9-9872-8754b12672dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=416293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 09:05:16.803371 dv-cinder-851351-1-smb devstack@keystone.service[416293]: [pid: 416293|app: 0|req: 28/53] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 09:05:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 09:05:16.821543 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c18ed66-e76d-4ca8-ab48-235b85ff2da2 None admin] Validating token access rules against request {{(pid=416294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:05:16.826774 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8398be3a-cb28-4fa9-9872-8754b12672dd None None] Authenticating user token {{(pid=416293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:05:16.856475 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-325dc12d-59ec-4388-8e6f-c50e47258e58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:05:16.857169 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325dc12d-59ec-4388-8e6f-c50e47258e58 None admin] REQUEST_METHOD: `GET` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:05:16.857450 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325dc12d-59ec-4388-8e6f-c50e47258e58 None admin] SCRIPT_NAME: `/identity` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:05:16.857764 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325dc12d-59ec-4388-8e6f-c50e47258e58 None admin] PATH_INFO: `/v3/domains/default` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:05:16.858937 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-325dc12d-59ec-4388-8e6f-c50e47258e58 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:05:16.860407 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-325dc12d-59ec-4388-8e6f-c50e47258e58 None admin] RBAC: Authorization granted {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:05:16.862243 dv-cinder-851351-1-smb devstack@keystone.service[416294]: [pid: 416294|app: 0|req: 26/54] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 09:05:16 2022] GET /identity/v3/domains/default => generated 199 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 09:05:16.868115 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-325dc12d-59ec-4388-8e6f-c50e47258e58 None admin] Authenticating user token {{(pid=416294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:05:16.890295 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG dbcounter [-] [416294] Writing DB stats keystone:SELECT=100 {{(pid=416294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:05:16.928649 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8398be3a-cb28-4fa9-9872-8754b12672dd None None] Validating token access rules against request {{(pid=416293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:05:16.951221 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG dbcounter [-] [416293] Writing DB stats keystone:SELECT=100 {{(pid=416293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:05:16.966698 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a268fbf-e72c-4201-8ed2-14006445e7b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:05:16.966858 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a268fbf-e72c-4201-8ed2-14006445e7b0 None admin] REQUEST_METHOD: `GET` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:05:16.967090 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a268fbf-e72c-4201-8ed2-14006445e7b0 None admin] SCRIPT_NAME: `/identity` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:05:16.967375 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a268fbf-e72c-4201-8ed2-14006445e7b0 None admin] PATH_INFO: `/v3/domains/default` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:05:16.968580 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a268fbf-e72c-4201-8ed2-14006445e7b0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:05:16.970192 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a268fbf-e72c-4201-8ed2-14006445e7b0 None admin] RBAC: Authorization granted {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:05:16.971756 dv-cinder-851351-1-smb devstack@keystone.service[416293]: [pid: 416293|app: 0|req: 29/55] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 09:05:16 2022] GET /identity/v3/domains/default => generated 199 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 09:05:16.973929 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-325dc12d-59ec-4388-8e6f-c50e47258e58 None admin] Validating token access rules against request {{(pid=416294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:05:16.977591 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a268fbf-e72c-4201-8ed2-14006445e7b0 None admin] Authenticating user token {{(pid=416293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:05:17.009004 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2baa2ef6-b05e-48a4-90ce-3093104c8dd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:05:17.009653 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2baa2ef6-b05e-48a4-90ce-3093104c8dd5 None admin] REQUEST_METHOD: `GET` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:05:17.009945 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2baa2ef6-b05e-48a4-90ce-3093104c8dd5 None admin] SCRIPT_NAME: `/identity` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:05:17.010224 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2baa2ef6-b05e-48a4-90ce-3093104c8dd5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:05:17.011021 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2baa2ef6-b05e-48a4-90ce-3093104c8dd5 None admin] RBAC: Adding query filter params (role.id=c67085ec338243df8f9b7d6459036e23, scope.domain.id=default, user.id=dbf87abab90e4fdf9e75408f4199918e) {{(pid=416294) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 09:05:17.011336 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2baa2ef6-b05e-48a4-90ce-3093104c8dd5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:05:17.012816 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2baa2ef6-b05e-48a4-90ce-3093104c8dd5 None admin] RBAC: Authorization granted {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:05:17.018797 dv-cinder-851351-1-smb devstack@keystone.service[416294]: [pid: 416294|app: 0|req: 27/56] 10.222.0.42 () {56 vars in 1322 bytes} [Thu Jul 28 09:05:16 2022] GET /identity/v3/role_assignments?user.id=dbf87abab90e4fdf9e75408f4199918e&scope.domain.id=default&role.id=c67085ec338243df8f9b7d6459036e23 => generated 530 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 09:05:17.087823 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a268fbf-e72c-4201-8ed2-14006445e7b0 None admin] Validating token access rules against request {{(pid=416293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:05:17.127655 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162ca5fb-bcff-46ba-ab45-636e35a828ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:05:17.128388 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162ca5fb-bcff-46ba-ab45-636e35a828ee None admin] REQUEST_METHOD: `POST` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:05:17.128575 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162ca5fb-bcff-46ba-ab45-636e35a828ee None admin] SCRIPT_NAME: `/identity` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:05:17.128928 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162ca5fb-bcff-46ba-ab45-636e35a828ee None admin] PATH_INFO: `/v3/projects` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:05:17.129644 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-162ca5fb-bcff-46ba-ab45-636e35a828ee None admin] RBAC: Authorizing `identity:create_project()` {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:05:17.131156 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-162ca5fb-bcff-46ba-ab45-636e35a828ee None admin] RBAC: Authorization granted {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:05:17.164482 dv-cinder-851351-1-smb devstack@keystone.service[416293]: [pid: 416293|app: 0|req: 30/57] 10.222.0.42 () {60 vars in 1140 bytes} [Thu Jul 28 09:05:16 2022] POST /identity/v3/projects => generated 298 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 09:05:19.190034 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43bb45e1-a735-4295-a4eb-349d870ed44b None None] REQUEST_METHOD: `GET` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:05:19.190591 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43bb45e1-a735-4295-a4eb-349d870ed44b None None] SCRIPT_NAME: `/identity` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:05:19.190591 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43bb45e1-a735-4295-a4eb-349d870ed44b None None] PATH_INFO: `/` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:05:19.192012 dv-cinder-851351-1-smb devstack@keystone.service[416294]: [pid: 416294|app: 0|req: 28/58] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 09:05:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 09:05:19.197450 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc32180-6e72-4c90-bbfb-0f911755eb4b None None] REQUEST_METHOD: `POST` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:05:19.197885 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc32180-6e72-4c90-bbfb-0f911755eb4b None None] SCRIPT_NAME: `/identity` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:05:19.197997 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc32180-6e72-4c90-bbfb-0f911755eb4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:05:19.217822 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.auth.core [None req-0bc32180-6e72-4c90-bbfb-0f911755eb4b None None] MFA Rules not processed for user `dbf87abab90e4fdf9e75408f4199918e`. Rule list: `[]` (Enabled: `True`). {{(pid=416293) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 09:05:19.218984 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.fernet_utils [None req-0bc32180-6e72-4c90-bbfb-0f911755eb4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=416293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 09:05:19.254681 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG dbcounter [-] [416293] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=416293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:05:19.291550 dv-cinder-851351-1-smb devstack@keystone.service[416293]: [pid: 416293|app: 0|req: 31/59] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 09:05:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 09:05:19.316051 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43bb45e1-a735-4295-a4eb-349d870ed44b None None] Authenticating user token {{(pid=416294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:05:19.409936 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG dbcounter [-] [416294] Writing DB stats keystone:SELECT=100 {{(pid=416294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:05:19.428854 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43bb45e1-a735-4295-a4eb-349d870ed44b None None] Validating token access rules against request {{(pid=416294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:05:19.464702 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f861d5-c66b-455b-9733-c7c420bd96de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:05:19.465387 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f861d5-c66b-455b-9733-c7c420bd96de None admin] REQUEST_METHOD: `GET` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:05:19.465675 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f861d5-c66b-455b-9733-c7c420bd96de None admin] SCRIPT_NAME: `/identity` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:05:19.465953 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f861d5-c66b-455b-9733-c7c420bd96de None admin] PATH_INFO: `/v3/domains/default` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:05:19.467183 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42f861d5-c66b-455b-9733-c7c420bd96de None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:05:19.468864 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42f861d5-c66b-455b-9733-c7c420bd96de None admin] RBAC: Authorization granted {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:05:19.470303 dv-cinder-851351-1-smb devstack@keystone.service[416294]: [pid: 416294|app: 0|req: 29/60] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 09:05:19 2022] GET /identity/v3/domains/default => generated 199 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:05:19.476443 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc32180-6e72-4c90-bbfb-0f911755eb4b None None] Authenticating user token {{(pid=416293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:05:19.580509 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc32180-6e72-4c90-bbfb-0f911755eb4b None None] Validating token access rules against request {{(pid=416293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:05:19.618371 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-817d246a-da6e-480e-a1e2-48f0ee6d5f36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:05:19.619017 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817d246a-da6e-480e-a1e2-48f0ee6d5f36 None admin] REQUEST_METHOD: `POST` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:05:19.619308 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817d246a-da6e-480e-a1e2-48f0ee6d5f36 None admin] SCRIPT_NAME: `/identity` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:05:19.619591 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817d246a-da6e-480e-a1e2-48f0ee6d5f36 None admin] PATH_INFO: `/v3/users` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:05:19.620298 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-817d246a-da6e-480e-a1e2-48f0ee6d5f36 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:05:19.621831 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-817d246a-da6e-480e-a1e2-48f0ee6d5f36 None admin] RBAC: Authorization granted {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:05:19.649280 dv-cinder-851351-1-smb devstack@keystone.service[416293]: [pid: 416293|app: 0|req: 32/61] 10.222.0.42 () {60 vars in 1132 bytes} [Thu Jul 28 09:05:19 2022] POST /identity/v3/users => generated 275 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 09:05:22.818770 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5be7b0-dd5d-440b-b738-6e9aae5f9869 None None] REQUEST_METHOD: `GET` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:05:22.819370 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5be7b0-dd5d-440b-b738-6e9aae5f9869 None None] SCRIPT_NAME: `/identity` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:05:22.819370 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5be7b0-dd5d-440b-b738-6e9aae5f9869 None None] PATH_INFO: `/` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:05:22.820749 dv-cinder-851351-1-smb devstack@keystone.service[416294]: [pid: 416294|app: 0|req: 30/62] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 09:05:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 09:05:22.827053 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bad54a5-1356-48ea-ad06-17917645631a None None] REQUEST_METHOD: `POST` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:05:22.827955 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bad54a5-1356-48ea-ad06-17917645631a None None] SCRIPT_NAME: `/identity` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:05:22.828435 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bad54a5-1356-48ea-ad06-17917645631a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:05:22.853823 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.auth.core [None req-4bad54a5-1356-48ea-ad06-17917645631a None None] MFA Rules not processed for user `dbf87abab90e4fdf9e75408f4199918e`. Rule list: `[]` (Enabled: `True`). {{(pid=416293) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 09:05:22.855062 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.fernet_utils [None req-4bad54a5-1356-48ea-ad06-17917645631a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=416293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 09:05:22.883287 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG dbcounter [-] [416293] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=416293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:05:22.952217 dv-cinder-851351-1-smb devstack@keystone.service[416293]: [pid: 416293|app: 0|req: 33/63] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 09:05:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 28 09:05:22.979679 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f68ad6-9f07-41ba-8fb8-763066069fc7 None None] REQUEST_METHOD: `GET` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:05:22.980318 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f68ad6-9f07-41ba-8fb8-763066069fc7 None None] SCRIPT_NAME: `/identity` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:05:22.980871 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f68ad6-9f07-41ba-8fb8-763066069fc7 None None] PATH_INFO: `/` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:05:22.982492 dv-cinder-851351-1-smb devstack@keystone.service[416294]: [pid: 416294|app: 0|req: 31/64] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 09:05:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 09:05:22.986283 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bad54a5-1356-48ea-ad06-17917645631a None None] Authenticating user token {{(pid=416293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:05:22.988402 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e2c212-3f2b-489c-866a-a70691691e1c None None] REQUEST_METHOD: `POST` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:05:22.988983 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e2c212-3f2b-489c-866a-a70691691e1c None None] SCRIPT_NAME: `/identity` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:05:22.989473 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e2c212-3f2b-489c-866a-a70691691e1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:05:23.024555 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.auth.core [None req-c3e2c212-3f2b-489c-866a-a70691691e1c None None] MFA Rules not processed for user `dbf87abab90e4fdf9e75408f4199918e`. Rule list: `[]` (Enabled: `True`). {{(pid=416294) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 09:05:23.025835 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.fernet_utils [None req-c3e2c212-3f2b-489c-866a-a70691691e1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=416294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 09:05:23.146178 dv-cinder-851351-1-smb devstack@keystone.service[416294]: [pid: 416294|app: 0|req: 32/65] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 09:05:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 28 09:05:23.147888 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cedcb0c-a14f-4947-b780-d1c3d9bce0c1 None None] REQUEST_METHOD: `GET` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:05:23.148407 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cedcb0c-a14f-4947-b780-d1c3d9bce0c1 None None] SCRIPT_NAME: `/identity` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:05:23.148823 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cedcb0c-a14f-4947-b780-d1c3d9bce0c1 None None] PATH_INFO: `/` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:05:23.150238 dv-cinder-851351-1-smb devstack@keystone.service[416294]: [pid: 416294|app: 0|req: 33/66] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 09:05:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 09:05:23.156408 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f54a46-f224-4902-a7a3-99cec9d456c9 None None] REQUEST_METHOD: `POST` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:05:23.157018 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f54a46-f224-4902-a7a3-99cec9d456c9 None None] SCRIPT_NAME: `/identity` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:05:23.157542 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f54a46-f224-4902-a7a3-99cec9d456c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:05:23.158417 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bad54a5-1356-48ea-ad06-17917645631a None None] Validating token access rules against request {{(pid=416293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:05:23.178306 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.auth.core [None req-b0f54a46-f224-4902-a7a3-99cec9d456c9 None None] MFA Rules not processed for user `dbf87abab90e4fdf9e75408f4199918e`. Rule list: `[]` (Enabled: `True`). {{(pid=416294) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 09:05:23.179804 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.fernet_utils [None req-b0f54a46-f224-4902-a7a3-99cec9d456c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=416294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 09:05:23.205818 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393623a1-76c8-4ec1-a1c1-477d7550b351 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:05:23.206864 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393623a1-76c8-4ec1-a1c1-477d7550b351 None admin] REQUEST_METHOD: `GET` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:05:23.207331 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393623a1-76c8-4ec1-a1c1-477d7550b351 None admin] SCRIPT_NAME: `/identity` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:05:23.207769 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393623a1-76c8-4ec1-a1c1-477d7550b351 None admin] PATH_INFO: `/v3/roles/member` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:05:23.224633 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-393623a1-76c8-4ec1-a1c1-477d7550b351 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 09:05:23.230872 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application [None req-393623a1-76c8-4ec1-a1c1-477d7550b351 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 28 09:05:23.230872 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 09:05:23.230872 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 09:05:23.230872 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 09:05:23.230872 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 09:05:23.230872 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 09:05:23.230872 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 09:05:23.230872 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 09:05:23.230872 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 09:05:23.230872 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 09:05:23.230872 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 09:05:23.230872 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 09:05:23.230872 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 09:05:23.230872 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 09:05:23.230872 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 09:05:23.230872 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 09:05:23.232093 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 09:05:23.232093 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 09:05:23.232093 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 09:05:23.232093 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 09:05:23.232093 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 09:05:23.232093 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 09:05:23.232093 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 09:05:23.232093 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 09:05:23.232093 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 09:05:23.232093 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 09:05:23.232093 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 09:05:23.232093 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application with Lock( Jul 28 09:05:23.232093 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 09:05:23.232093 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self._enter() Jul 28 09:05:23.232093 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 09:05:23.232093 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 09:05:23.233168 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 09:05:23.233168 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self.creator() Jul 28 09:05:23.233168 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 09:05:23.233168 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application created_value = creator( Jul 28 09:05:23.233168 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 09:05:23.233168 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 09:05:23.233168 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 09:05:23.233168 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 09:05:23.233168 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 09:05:23.233168 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 09:05:23.233168 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 28 09:05:23.233168 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application Jul 28 09:05:23.236139 dv-cinder-851351-1-smb devstack@keystone.service[416293]: [pid: 416293|app: 0|req: 34/67] 10.222.0.42 () {56 vars in 1099 bytes} [Thu Jul 28 09:05:22 2022] GET /identity/v3/roles/member => generated 84 bytes in 251 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 09:05:23.237180 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393623a1-76c8-4ec1-a1c1-477d7550b351 None admin] Authenticating user token {{(pid=416293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:05:23.263871 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG dbcounter [-] [416293] Writing DB stats keystone:SELECT=100 {{(pid=416293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:05:23.270688 dv-cinder-851351-1-smb devstack@keystone.service[416294]: [pid: 416294|app: 0|req: 34/68] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 09:05:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 09:05:23.271904 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f54a46-f224-4902-a7a3-99cec9d456c9 None None] Authenticating user token {{(pid=416294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:05:23.296363 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG dbcounter [-] [416294] Writing DB stats keystone:SELECT=100 {{(pid=416294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:05:23.388309 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393623a1-76c8-4ec1-a1c1-477d7550b351 None admin] Validating token access rules against request {{(pid=416293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:05:23.410918 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f54a46-f224-4902-a7a3-99cec9d456c9 None None] Validating token access rules against request {{(pid=416294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:05:23.425349 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23be5b3b-46a4-47af-a4fe-c7f7ec6a853a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:05:23.426025 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23be5b3b-46a4-47af-a4fe-c7f7ec6a853a None admin] REQUEST_METHOD: `GET` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:05:23.426316 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23be5b3b-46a4-47af-a4fe-c7f7ec6a853a None admin] SCRIPT_NAME: `/identity` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:05:23.426583 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23be5b3b-46a4-47af-a4fe-c7f7ec6a853a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:05:23.441211 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23be5b3b-46a4-47af-a4fe-c7f7ec6a853a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 09:05:23.446283 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application [None req-23be5b3b-46a4-47af-a4fe-c7f7ec6a853a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 09:05:23.446283 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 09:05:23.446283 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 09:05:23.446283 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 09:05:23.446283 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 09:05:23.446283 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 09:05:23.446283 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 09:05:23.446283 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 09:05:23.446283 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 09:05:23.446283 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 09:05:23.446283 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 09:05:23.446283 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 09:05:23.446283 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 09:05:23.446283 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 09:05:23.446283 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 09:05:23.446283 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 09:05:23.447323 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 09:05:23.447323 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 09:05:23.447323 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 09:05:23.447323 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 09:05:23.447323 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 09:05:23.447323 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 09:05:23.447323 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 09:05:23.447323 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 09:05:23.447323 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 09:05:23.447323 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 09:05:23.447323 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 09:05:23.447323 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application with Lock( Jul 28 09:05:23.447323 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 09:05:23.447323 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self._enter() Jul 28 09:05:23.447323 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 09:05:23.447323 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 09:05:23.448445 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 09:05:23.448445 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self.creator() Jul 28 09:05:23.448445 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 09:05:23.448445 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application created_value = creator( Jul 28 09:05:23.448445 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 09:05:23.448445 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 09:05:23.448445 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 09:05:23.448445 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 09:05:23.448445 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 09:05:23.448445 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 09:05:23.448445 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 09:05:23.448445 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application Jul 28 09:05:23.449716 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d85bc99d-a4d4-4175-8eec-b178679347c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:05:23.449819 dv-cinder-851351-1-smb devstack@keystone.service[416293]: [pid: 416293|app: 0|req: 35/69] 10.222.0.42 () {56 vars in 1096 bytes} [Thu Jul 28 09:05:23 2022] GET /identity/v3/roles/admin => generated 83 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 09:05:23.449912 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85bc99d-a4d4-4175-8eec-b178679347c7 None admin] REQUEST_METHOD: `GET` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:05:23.450008 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23be5b3b-46a4-47af-a4fe-c7f7ec6a853a None admin] Authenticating user token {{(pid=416293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:05:23.450096 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85bc99d-a4d4-4175-8eec-b178679347c7 None admin] SCRIPT_NAME: `/identity` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:05:23.450096 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85bc99d-a4d4-4175-8eec-b178679347c7 None admin] PATH_INFO: `/v3/roles` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:05:23.450096 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d85bc99d-a4d4-4175-8eec-b178679347c7 None admin] RBAC: Adding query filter params (name=member) {{(pid=416294) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 09:05:23.450303 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d85bc99d-a4d4-4175-8eec-b178679347c7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:05:23.451553 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d85bc99d-a4d4-4175-8eec-b178679347c7 None admin] RBAC: Authorization granted {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:05:23.460761 dv-cinder-851351-1-smb devstack@keystone.service[416294]: [pid: 416294|app: 0|req: 35/70] 10.222.0.42 () {56 vars in 1101 bytes} [Thu Jul 28 09:05:23 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:05:23.462036 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69eead3b-d723-4f8d-8a97-4dd5202aa2cf None None] REQUEST_METHOD: `GET` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:05:23.462327 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69eead3b-d723-4f8d-8a97-4dd5202aa2cf None None] SCRIPT_NAME: `/identity` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:05:23.462605 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69eead3b-d723-4f8d-8a97-4dd5202aa2cf None None] PATH_INFO: `/` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:05:23.463886 dv-cinder-851351-1-smb devstack@keystone.service[416294]: [pid: 416294|app: 0|req: 36/71] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 09:05:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 09:05:23.466762 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef243af-f3c4-42d6-86ee-4cc4fbc9d655 None None] REQUEST_METHOD: `GET` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:05:23.467263 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef243af-f3c4-42d6-86ee-4cc4fbc9d655 None None] SCRIPT_NAME: `/identity` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:05:23.467621 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef243af-f3c4-42d6-86ee-4cc4fbc9d655 None None] PATH_INFO: `/` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:05:23.470340 dv-cinder-851351-1-smb devstack@keystone.service[416294]: [pid: 416294|app: 0|req: 37/72] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 09:05:23 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 09:05:23.470340 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef243af-f3c4-42d6-86ee-4cc4fbc9d655 None None] Authenticating user token {{(pid=416294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:05:23.545100 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG dbcounter [-] [416293] Writing DB stats keystone:SELECT=100 {{(pid=416293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:05:23.550131 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG dbcounter [-] [416294] Writing DB stats keystone:SELECT=100 {{(pid=416294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:05:23.577448 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23be5b3b-46a4-47af-a4fe-c7f7ec6a853a None admin] Validating token access rules against request {{(pid=416293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:05:23.587093 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef243af-f3c4-42d6-86ee-4cc4fbc9d655 None None] Validating token access rules against request {{(pid=416294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:05:23.621158 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-236d20de-ea9c-4ee9-86de-aa003ee25778 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:05:23.621849 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236d20de-ea9c-4ee9-86de-aa003ee25778 None admin] REQUEST_METHOD: `GET` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:05:23.622143 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236d20de-ea9c-4ee9-86de-aa003ee25778 None admin] SCRIPT_NAME: `/identity` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:05:23.622423 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236d20de-ea9c-4ee9-86de-aa003ee25778 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:05:23.630512 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49eb7929-0565-4cc5-a207-e78d5548fba7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:05:23.631115 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49eb7929-0565-4cc5-a207-e78d5548fba7 None admin] REQUEST_METHOD: `GET` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:05:23.632024 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49eb7929-0565-4cc5-a207-e78d5548fba7 None admin] SCRIPT_NAME: `/identity` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:05:23.632024 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49eb7929-0565-4cc5-a207-e78d5548fba7 None admin] PATH_INFO: `/v3/roles` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:05:23.632411 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49eb7929-0565-4cc5-a207-e78d5548fba7 None admin] RBAC: Adding query filter params (name=admin) {{(pid=416294) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 09:05:23.633068 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49eb7929-0565-4cc5-a207-e78d5548fba7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:05:23.633689 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-236d20de-ea9c-4ee9-86de-aa003ee25778 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 09:05:23.634185 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49eb7929-0565-4cc5-a207-e78d5548fba7 None admin] RBAC: Authorization granted {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:05:23.639874 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application [None req-236d20de-ea9c-4ee9-86de-aa003ee25778 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 28 09:05:23.639874 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 09:05:23.639874 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 09:05:23.639874 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 09:05:23.639874 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 09:05:23.639874 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 09:05:23.639874 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 09:05:23.639874 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 09:05:23.639874 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 09:05:23.639874 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 09:05:23.639874 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 09:05:23.639874 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 09:05:23.639874 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 09:05:23.639874 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 09:05:23.639874 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 09:05:23.639874 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 09:05:23.640983 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 09:05:23.640983 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 09:05:23.640983 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 09:05:23.640983 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 09:05:23.640983 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 09:05:23.640983 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 09:05:23.640983 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 09:05:23.640983 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 09:05:23.640983 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 09:05:23.640983 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 09:05:23.640983 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 09:05:23.640983 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application with Lock( Jul 28 09:05:23.640983 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 09:05:23.640983 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self._enter() Jul 28 09:05:23.640983 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 09:05:23.640983 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 09:05:23.641865 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 09:05:23.641865 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self.creator() Jul 28 09:05:23.641865 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 09:05:23.641865 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application created_value = creator( Jul 28 09:05:23.641865 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 09:05:23.641865 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 09:05:23.641865 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 09:05:23.641865 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 09:05:23.641865 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 09:05:23.641865 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 09:05:23.641865 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 28 09:05:23.641865 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application Jul 28 09:05:23.641865 dv-cinder-851351-1-smb devstack@keystone.service[416293]: [pid: 416293|app: 0|req: 36/73] 10.222.0.42 () {56 vars in 1114 bytes} [Thu Jul 28 09:05:23 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 09:05:23.641865 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-236d20de-ea9c-4ee9-86de-aa003ee25778 None admin] Authenticating user token {{(pid=416293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:05:23.650026 dv-cinder-851351-1-smb devstack@keystone.service[416294]: [pid: 416294|app: 0|req: 38/74] 10.222.0.42 () {56 vars in 1099 bytes} [Thu Jul 28 09:05:23 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:05:23.650026 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9893d9-fec2-46d9-8621-db14723a2a36 None None] REQUEST_METHOD: `POST` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:05:23.650026 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9893d9-fec2-46d9-8621-db14723a2a36 None None] SCRIPT_NAME: `/identity` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:05:23.650026 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9893d9-fec2-46d9-8621-db14723a2a36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:05:23.666033 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.auth.core [None req-5d9893d9-fec2-46d9-8621-db14723a2a36 None None] MFA Rules not processed for user `dbf87abab90e4fdf9e75408f4199918e`. Rule list: `[]` (Enabled: `True`). {{(pid=416294) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 09:05:23.667166 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.fernet_utils [None req-5d9893d9-fec2-46d9-8621-db14723a2a36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=416294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 09:05:23.747339 dv-cinder-851351-1-smb devstack@keystone.service[416294]: [pid: 416294|app: 0|req: 39/75] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 09:05:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 09:05:23.748810 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc8904e-a471-4ad8-86aa-d7d2bf578639 None None] REQUEST_METHOD: `POST` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:05:23.749106 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc8904e-a471-4ad8-86aa-d7d2bf578639 None None] SCRIPT_NAME: `/identity` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:05:23.749417 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc8904e-a471-4ad8-86aa-d7d2bf578639 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:05:23.773277 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-236d20de-ea9c-4ee9-86de-aa003ee25778 None admin] Validating token access rules against request {{(pid=416293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:05:23.778403 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.auth.core [None req-ffc8904e-a471-4ad8-86aa-d7d2bf578639 None None] MFA Rules not processed for user `dbf87abab90e4fdf9e75408f4199918e`. Rule list: `[]` (Enabled: `True`). {{(pid=416294) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 09:05:23.778692 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.fernet_utils [None req-ffc8904e-a471-4ad8-86aa-d7d2bf578639 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=416294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 09:05:23.815330 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed8ead7-f0c0-4574-8f0c-0384a911adec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:05:23.816133 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed8ead7-f0c0-4574-8f0c-0384a911adec None admin] REQUEST_METHOD: `GET` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:05:23.816426 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed8ead7-f0c0-4574-8f0c-0384a911adec None admin] SCRIPT_NAME: `/identity` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:05:23.816732 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed8ead7-f0c0-4574-8f0c-0384a911adec None admin] PATH_INFO: `/v3/users/d8807d513cea475c9faa3106083edd8a` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:05:23.820651 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG dbcounter [-] [416293] Writing DB stats keystone:SELECT=100 {{(pid=416293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:05:23.838072 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed8ead7-f0c0-4574-8f0c-0384a911adec None admin] RBAC: Authorizing `identity:get_user(user_id=d8807d513cea475c9faa3106083edd8a)` {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:05:23.839593 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed8ead7-f0c0-4574-8f0c-0384a911adec None admin] RBAC: Authorization granted {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:05:23.841452 dv-cinder-851351-1-smb devstack@keystone.service[416293]: [pid: 416293|app: 0|req: 37/76] 10.222.0.42 () {56 vars in 1177 bytes} [Thu Jul 28 09:05:23 2022] GET /identity/v3/users/d8807d513cea475c9faa3106083edd8a => generated 275 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:05:23.844952 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG dbcounter [-] [416294] Writing DB stats keystone:SELECT=100 {{(pid=416294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:05:23.845591 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed8ead7-f0c0-4574-8f0c-0384a911adec None admin] Authenticating user token {{(pid=416293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:05:23.854158 dv-cinder-851351-1-smb devstack@keystone.service[416294]: [pid: 416294|app: 0|req: 40/77] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 09:05:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 09:05:23.866450 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc8904e-a471-4ad8-86aa-d7d2bf578639 None None] Authenticating user token {{(pid=416294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:05:23.962579 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed8ead7-f0c0-4574-8f0c-0384a911adec None admin] Validating token access rules against request {{(pid=416293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:05:23.968445 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc8904e-a471-4ad8-86aa-d7d2bf578639 None None] Validating token access rules against request {{(pid=416294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:05:24.003136 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e6378b4-d7cd-4e13-919d-0a04b65ec485 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:05:24.003810 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6378b4-d7cd-4e13-919d-0a04b65ec485 None admin] REQUEST_METHOD: `GET` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:05:24.004098 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6378b4-d7cd-4e13-919d-0a04b65ec485 None admin] SCRIPT_NAME: `/identity` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:05:24.004377 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6378b4-d7cd-4e13-919d-0a04b65ec485 None admin] PATH_INFO: `/v3/roles` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:05:24.005162 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e6378b4-d7cd-4e13-919d-0a04b65ec485 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=416293) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 09:05:24.005325 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff82438-59cb-4f78-aa61-6f5e39fe0329 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:05:24.005482 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e6378b4-d7cd-4e13-919d-0a04b65ec485 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:05:24.005986 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff82438-59cb-4f78-aa61-6f5e39fe0329 None admin] REQUEST_METHOD: `GET` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:05:24.006291 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff82438-59cb-4f78-aa61-6f5e39fe0329 None admin] SCRIPT_NAME: `/identity` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:05:24.006561 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff82438-59cb-4f78-aa61-6f5e39fe0329 None admin] PATH_INFO: `/v3/users/dbf87abab90e4fdf9e75408f4199918e` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:05:24.006866 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e6378b4-d7cd-4e13-919d-0a04b65ec485 None admin] RBAC: Authorization granted {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:05:24.007792 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cff82438-59cb-4f78-aa61-6f5e39fe0329 None admin] RBAC: Authorizing `identity:get_user(user_id=dbf87abab90e4fdf9e75408f4199918e)` {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:05:24.009303 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cff82438-59cb-4f78-aa61-6f5e39fe0329 None admin] RBAC: Authorization granted {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:05:24.010975 dv-cinder-851351-1-smb devstack@keystone.service[416294]: [pid: 416294|app: 0|req: 41/78] 10.222.0.42 () {56 vars in 1177 bytes} [Thu Jul 28 09:05:23 2022] GET /identity/v3/users/dbf87abab90e4fdf9e75408f4199918e => generated 247 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:05:24.011763 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff82438-59cb-4f78-aa61-6f5e39fe0329 None admin] Authenticating user token {{(pid=416294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:05:24.020744 dv-cinder-851351-1-smb devstack@keystone.service[416293]: [pid: 416293|app: 0|req: 38/79] 10.222.0.42 () {56 vars in 1111 bytes} [Thu Jul 28 09:05:23 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:05:24.021449 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e6378b4-d7cd-4e13-919d-0a04b65ec485 None admin] Authenticating user token {{(pid=416293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:05:24.083950 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG dbcounter [-] [416294] Writing DB stats keystone:SELECT=100 {{(pid=416294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:05:24.090761 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG dbcounter [-] [416293] Writing DB stats keystone:SELECT=100 {{(pid=416293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:05:24.129096 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff82438-59cb-4f78-aa61-6f5e39fe0329 None admin] Validating token access rules against request {{(pid=416294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:05:24.140118 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e6378b4-d7cd-4e13-919d-0a04b65ec485 None admin] Validating token access rules against request {{(pid=416293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:05:24.164071 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2273a822-8bdd-4a95-9a8a-8a3c1fbc0369 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:05:24.164654 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2273a822-8bdd-4a95-9a8a-8a3c1fbc0369 None admin] REQUEST_METHOD: `GET` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:05:24.164975 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2273a822-8bdd-4a95-9a8a-8a3c1fbc0369 None admin] SCRIPT_NAME: `/identity` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:05:24.165244 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2273a822-8bdd-4a95-9a8a-8a3c1fbc0369 None admin] PATH_INFO: `/v3/roles/member` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:05:24.175936 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80094344-2d8a-48f0-9713-38cb1d65faca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:05:24.176291 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2273a822-8bdd-4a95-9a8a-8a3c1fbc0369 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 09:05:24.176582 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80094344-2d8a-48f0-9713-38cb1d65faca None admin] REQUEST_METHOD: `GET` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:05:24.176903 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80094344-2d8a-48f0-9713-38cb1d65faca None admin] SCRIPT_NAME: `/identity` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:05:24.177196 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80094344-2d8a-48f0-9713-38cb1d65faca None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:05:24.181797 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application [None req-2273a822-8bdd-4a95-9a8a-8a3c1fbc0369 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 28 09:05:24.181797 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 09:05:24.181797 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 09:05:24.181797 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 09:05:24.181797 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 09:05:24.181797 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 09:05:24.181797 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 09:05:24.181797 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 09:05:24.181797 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 09:05:24.181797 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 09:05:24.181797 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 09:05:24.181797 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 09:05:24.181797 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 09:05:24.181797 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 09:05:24.181797 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 09:05:24.181797 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 09:05:24.182771 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 09:05:24.182771 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 09:05:24.182771 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 09:05:24.182771 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 09:05:24.182771 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 09:05:24.182771 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 09:05:24.182771 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 09:05:24.182771 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 09:05:24.182771 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 09:05:24.182771 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 09:05:24.182771 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 09:05:24.182771 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application with Lock( Jul 28 09:05:24.182771 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 09:05:24.182771 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return self._enter() Jul 28 09:05:24.182771 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 09:05:24.182771 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 09:05:24.183604 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 09:05:24.183604 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return self.creator() Jul 28 09:05:24.183604 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 09:05:24.183604 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application created_value = creator( Jul 28 09:05:24.183604 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 09:05:24.183604 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 09:05:24.183604 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 09:05:24.183604 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 09:05:24.183604 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 09:05:24.183604 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 09:05:24.183604 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 28 09:05:24.183604 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application Jul 28 09:05:24.183604 dv-cinder-851351-1-smb devstack@keystone.service[416294]: [pid: 416294|app: 0|req: 42/80] 10.222.0.42 () {56 vars in 1099 bytes} [Thu Jul 28 09:05:24 2022] GET /identity/v3/roles/member => generated 84 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 09:05:24.184325 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2273a822-8bdd-4a95-9a8a-8a3c1fbc0369 None admin] Authenticating user token {{(pid=416294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:05:24.256519 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80094344-2d8a-48f0-9713-38cb1d65faca None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:05:24.257999 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80094344-2d8a-48f0-9713-38cb1d65faca None admin] RBAC: Authorization granted {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:05:24.295584 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2273a822-8bdd-4a95-9a8a-8a3c1fbc0369 None admin] Validating token access rules against request {{(pid=416294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:05:24.320748 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG dbcounter [-] [416294] Writing DB stats keystone:SELECT=100 {{(pid=416294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:05:24.323784 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG dbcounter [-] [416293] Writing DB stats keystone:SELECT=100 {{(pid=416293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:05:24.334558 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df8c9f42-e93c-4510-a810-adf3d6c606ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:05:24.334558 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8c9f42-e93c-4510-a810-adf3d6c606ff None admin] REQUEST_METHOD: `GET` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:05:24.334558 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8c9f42-e93c-4510-a810-adf3d6c606ff None admin] SCRIPT_NAME: `/identity` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:05:24.334910 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8c9f42-e93c-4510-a810-adf3d6c606ff None admin] PATH_INFO: `/v3/domains/default` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:05:24.335819 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df8c9f42-e93c-4510-a810-adf3d6c606ff None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:05:24.337359 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df8c9f42-e93c-4510-a810-adf3d6c606ff None admin] RBAC: Authorization granted {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:05:24.339002 dv-cinder-851351-1-smb devstack@keystone.service[416294]: [pid: 416294|app: 0|req: 43/81] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 09:05:24 2022] GET /identity/v3/domains/default => generated 199 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:05:24.339781 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df8c9f42-e93c-4510-a810-adf3d6c606ff None admin] Authenticating user token {{(pid=416294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:05:24.374923 dv-cinder-851351-1-smb devstack@keystone.service[416293]: [pid: 416293|app: 0|req: 39/82] 10.222.0.42 () {58 vars in 1282 bytes} [Thu Jul 28 09:05:24 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 354 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 28 09:05:24.375907 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80094344-2d8a-48f0-9713-38cb1d65faca None admin] Authenticating user token {{(pid=416293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:05:24.454357 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df8c9f42-e93c-4510-a810-adf3d6c606ff None admin] Validating token access rules against request {{(pid=416294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:05:24.489013 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6298551-e4d1-4e9a-8ada-22038055d353 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:05:24.489658 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6298551-e4d1-4e9a-8ada-22038055d353 None admin] REQUEST_METHOD: `GET` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:05:24.489944 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6298551-e4d1-4e9a-8ada-22038055d353 None admin] SCRIPT_NAME: `/identity` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:05:24.490225 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6298551-e4d1-4e9a-8ada-22038055d353 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:05:24.490372 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80094344-2d8a-48f0-9713-38cb1d65faca None admin] Validating token access rules against request {{(pid=416293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:05:24.527717 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20920f81-0a37-4dbc-b82a-3007d6030c0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:05:24.528286 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20920f81-0a37-4dbc-b82a-3007d6030c0c None admin] REQUEST_METHOD: `GET` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:05:24.528581 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20920f81-0a37-4dbc-b82a-3007d6030c0c None admin] SCRIPT_NAME: `/identity` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:05:24.528912 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20920f81-0a37-4dbc-b82a-3007d6030c0c None admin] PATH_INFO: `/v3/users/d8807d513cea475c9faa3106083edd8a` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:05:24.530215 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20920f81-0a37-4dbc-b82a-3007d6030c0c None admin] RBAC: Authorizing `identity:get_user(user_id=d8807d513cea475c9faa3106083edd8a)` {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:05:24.532504 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20920f81-0a37-4dbc-b82a-3007d6030c0c None admin] RBAC: Authorization granted {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:05:24.534808 dv-cinder-851351-1-smb devstack@keystone.service[416293]: [pid: 416293|app: 0|req: 40/83] 10.222.0.42 () {56 vars in 1177 bytes} [Thu Jul 28 09:05:24 2022] GET /identity/v3/users/d8807d513cea475c9faa3106083edd8a => generated 275 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:05:24.535333 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20920f81-0a37-4dbc-b82a-3007d6030c0c None admin] Authenticating user token {{(pid=416293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:05:24.558663 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG dbcounter [-] [416294] Writing DB stats keystone:SELECT=100 {{(pid=416294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:05:24.564690 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG dbcounter [-] [416293] Writing DB stats keystone:SELECT=100 {{(pid=416293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:05:24.574996 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6298551-e4d1-4e9a-8ada-22038055d353 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:05:24.578273 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6298551-e4d1-4e9a-8ada-22038055d353 None admin] RBAC: Authorization granted {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:05:24.650058 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20920f81-0a37-4dbc-b82a-3007d6030c0c None admin] Validating token access rules against request {{(pid=416293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:05:24.694177 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9171e0-2f90-4e79-a4c4-d06eed314a7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:05:24.694718 dv-cinder-851351-1-smb devstack@keystone.service[416294]: [pid: 416294|app: 0|req: 44/84] 10.222.0.42 () {58 vars in 1282 bytes} [Thu Jul 28 09:05:24 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 355 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 28 09:05:24.694931 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9171e0-2f90-4e79-a4c4-d06eed314a7b None admin] REQUEST_METHOD: `GET` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:05:24.695107 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9171e0-2f90-4e79-a4c4-d06eed314a7b None admin] SCRIPT_NAME: `/identity` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:05:24.695376 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9171e0-2f90-4e79-a4c4-d06eed314a7b None admin] PATH_INFO: `/v3/roles` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:05:24.695537 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6298551-e4d1-4e9a-8ada-22038055d353 None admin] Authenticating user token {{(pid=416294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:05:24.696136 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba9171e0-2f90-4e79-a4c4-d06eed314a7b None admin] RBAC: Adding query filter params (name=member) {{(pid=416293) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 09:05:24.696511 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba9171e0-2f90-4e79-a4c4-d06eed314a7b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:05:24.697929 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba9171e0-2f90-4e79-a4c4-d06eed314a7b None admin] RBAC: Authorization granted {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:05:24.711263 dv-cinder-851351-1-smb devstack@keystone.service[416293]: [pid: 416293|app: 0|req: 41/85] 10.222.0.42 () {56 vars in 1101 bytes} [Thu Jul 28 09:05:24 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:05:24.713530 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9171e0-2f90-4e79-a4c4-d06eed314a7b None admin] Authenticating user token {{(pid=416293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:05:24.803372 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG dbcounter [-] [416294] Writing DB stats keystone:SELECT=100 {{(pid=416294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:05:24.810756 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG dbcounter [-] [416293] Writing DB stats keystone:SELECT=100 {{(pid=416293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:05:24.812384 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6298551-e4d1-4e9a-8ada-22038055d353 None admin] Validating token access rules against request {{(pid=416294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:05:24.828570 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9171e0-2f90-4e79-a4c4-d06eed314a7b None admin] Validating token access rules against request {{(pid=416293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:05:24.849493 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a841a616-c21f-4d61-8ff7-b7a848bb1579 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:05:24.850136 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a841a616-c21f-4d61-8ff7-b7a848bb1579 None admin] REQUEST_METHOD: `POST` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:05:24.850432 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a841a616-c21f-4d61-8ff7-b7a848bb1579 None admin] SCRIPT_NAME: `/identity` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:05:24.850701 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a841a616-c21f-4d61-8ff7-b7a848bb1579 None admin] PATH_INFO: `/v3/users` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:05:24.851691 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a841a616-c21f-4d61-8ff7-b7a848bb1579 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:05:24.852957 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a841a616-c21f-4d61-8ff7-b7a848bb1579 None admin] RBAC: Authorization granted {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:05:24.864546 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90be562d-d21b-422e-8946-778ff5721022 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:05:24.865397 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90be562d-d21b-422e-8946-778ff5721022 None admin] REQUEST_METHOD: `GET` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:05:24.865562 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90be562d-d21b-422e-8946-778ff5721022 None admin] SCRIPT_NAME: `/identity` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:05:24.865800 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90be562d-d21b-422e-8946-778ff5721022 None admin] PATH_INFO: `/v3/projects/c515ec4395fe420e9ab0ba34fb1ada8f` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:05:24.867048 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90be562d-d21b-422e-8946-778ff5721022 None admin] RBAC: Authorizing `identity:get_project(project_id=c515ec4395fe420e9ab0ba34fb1ada8f)` {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:05:24.868531 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90be562d-d21b-422e-8946-778ff5721022 None admin] RBAC: Authorization granted {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:05:24.870324 dv-cinder-851351-1-smb devstack@keystone.service[416293]: [pid: 416293|app: 0|req: 42/86] 10.222.0.42 () {56 vars in 1186 bytes} [Thu Jul 28 09:05:24 2022] GET /identity/v3/projects/c515ec4395fe420e9ab0ba34fb1ada8f => generated 298 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:05:24.871107 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90be562d-d21b-422e-8946-778ff5721022 None admin] Authenticating user token {{(pid=416293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:05:24.884991 dv-cinder-851351-1-smb devstack@keystone.service[416294]: [pid: 416294|app: 0|req: 45/87] 10.222.0.42 () {60 vars in 1132 bytes} [Thu Jul 28 09:05:24 2022] POST /identity/v3/users => generated 289 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 09:05:24.885879 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a841a616-c21f-4d61-8ff7-b7a848bb1579 None admin] Authenticating user token {{(pid=416294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:05:25.015021 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90be562d-d21b-422e-8946-778ff5721022 None admin] Validating token access rules against request {{(pid=416293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:05:25.033207 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a841a616-c21f-4d61-8ff7-b7a848bb1579 None admin] Validating token access rules against request {{(pid=416294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:05:25.055559 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef5ab41-2df1-4824-8dad-d8469628fbef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:05:25.056291 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef5ab41-2df1-4824-8dad-d8469628fbef None admin] REQUEST_METHOD: `GET` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:05:25.057530 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef5ab41-2df1-4824-8dad-d8469628fbef None admin] SCRIPT_NAME: `/identity` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:05:25.057530 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef5ab41-2df1-4824-8dad-d8469628fbef None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:05:25.079431 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d967c2cc-9a0f-4d1a-bc91-a5bad46d6cb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:05:25.080868 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d967c2cc-9a0f-4d1a-bc91-a5bad46d6cb5 None admin] REQUEST_METHOD: `GET` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:05:25.081353 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d967c2cc-9a0f-4d1a-bc91-a5bad46d6cb5 None admin] SCRIPT_NAME: `/identity` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:05:25.081689 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d967c2cc-9a0f-4d1a-bc91-a5bad46d6cb5 None admin] PATH_INFO: `/v3/projects/c515ec4395fe420e9ab0ba34fb1ada8f` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:05:25.082989 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d967c2cc-9a0f-4d1a-bc91-a5bad46d6cb5 None admin] RBAC: Authorizing `identity:get_project(project_id=c515ec4395fe420e9ab0ba34fb1ada8f)` {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:05:25.085117 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d967c2cc-9a0f-4d1a-bc91-a5bad46d6cb5 None admin] RBAC: Authorization granted {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:05:25.086913 dv-cinder-851351-1-smb devstack@keystone.service[416294]: [pid: 416294|app: 0|req: 46/88] 10.222.0.42 () {56 vars in 1186 bytes} [Thu Jul 28 09:05:24 2022] GET /identity/v3/projects/c515ec4395fe420e9ab0ba34fb1ada8f => generated 298 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:05:25.087707 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d967c2cc-9a0f-4d1a-bc91-a5bad46d6cb5 None admin] Authenticating user token {{(pid=416294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:05:25.088553 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG dbcounter [-] [416293] Writing DB stats keystone:SELECT=100 {{(pid=416293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:05:25.124602 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG dbcounter [-] [416294] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=416294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:05:25.159749 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ef5ab41-2df1-4824-8dad-d8469628fbef None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:05:25.161354 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ef5ab41-2df1-4824-8dad-d8469628fbef None admin] RBAC: Authorization granted {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:05:25.238829 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d967c2cc-9a0f-4d1a-bc91-a5bad46d6cb5 None admin] Validating token access rules against request {{(pid=416294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:05:25.290829 dv-cinder-851351-1-smb devstack@keystone.service[416293]: [pid: 416293|app: 0|req: 43/89] 10.222.0.42 () {58 vars in 1282 bytes} [Thu Jul 28 09:05:24 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 420 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 28 09:05:25.293306 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef5ab41-2df1-4824-8dad-d8469628fbef None admin] Authenticating user token {{(pid=416293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:05:25.296783 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137009d3-e73c-414d-a2da-bfe7bb8963c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:05:25.297476 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137009d3-e73c-414d-a2da-bfe7bb8963c2 None admin] REQUEST_METHOD: `GET` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:05:25.297765 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137009d3-e73c-414d-a2da-bfe7bb8963c2 None admin] SCRIPT_NAME: `/identity` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:05:25.298045 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137009d3-e73c-414d-a2da-bfe7bb8963c2 None admin] PATH_INFO: `/v3/users/d8807d513cea475c9faa3106083edd8a` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:05:25.299684 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-137009d3-e73c-414d-a2da-bfe7bb8963c2 None admin] RBAC: Authorizing `identity:get_user(user_id=d8807d513cea475c9faa3106083edd8a)` {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:05:25.301371 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-137009d3-e73c-414d-a2da-bfe7bb8963c2 None admin] RBAC: Authorization granted {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:05:25.303479 dv-cinder-851351-1-smb devstack@keystone.service[416294]: [pid: 416294|app: 0|req: 47/90] 10.222.0.42 () {56 vars in 1177 bytes} [Thu Jul 28 09:05:25 2022] GET /identity/v3/users/d8807d513cea475c9faa3106083edd8a => generated 275 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:05:25.304361 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137009d3-e73c-414d-a2da-bfe7bb8963c2 None admin] Authenticating user token {{(pid=416294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:05:25.371140 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG dbcounter [-] [416293] Writing DB stats keystone:SELECT=100 {{(pid=416293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:05:25.418687 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG dbcounter [-] [416294] Writing DB stats keystone:SELECT=100 {{(pid=416294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:05:25.439735 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137009d3-e73c-414d-a2da-bfe7bb8963c2 None admin] Validating token access rules against request {{(pid=416294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:05:25.449744 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef5ab41-2df1-4824-8dad-d8469628fbef None admin] Validating token access rules against request {{(pid=416293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:05:25.480776 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e77922d4-1120-41e7-a258-2147d0e6b5da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:05:25.481446 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77922d4-1120-41e7-a258-2147d0e6b5da None admin] REQUEST_METHOD: `GET` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:05:25.481717 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77922d4-1120-41e7-a258-2147d0e6b5da None admin] SCRIPT_NAME: `/identity` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:05:25.481999 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77922d4-1120-41e7-a258-2147d0e6b5da None admin] PATH_INFO: `/v3/role_assignments` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:05:25.482814 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e77922d4-1120-41e7-a258-2147d0e6b5da None admin] RBAC: Adding query filter params (role.id=c67085ec338243df8f9b7d6459036e23, scope.project.id=c515ec4395fe420e9ab0ba34fb1ada8f, user.id=dbf87abab90e4fdf9e75408f4199918e) {{(pid=416294) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 09:05:25.483124 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e77922d4-1120-41e7-a258-2147d0e6b5da None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:05:25.484601 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e77922d4-1120-41e7-a258-2147d0e6b5da None admin] RBAC: Authorization granted {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:05:25.491757 dv-cinder-851351-1-smb devstack@keystone.service[416294]: [pid: 416294|app: 0|req: 48/91] 10.222.0.42 () {56 vars in 1374 bytes} [Thu Jul 28 09:05:25 2022] GET /identity/v3/role_assignments?user.id=dbf87abab90e4fdf9e75408f4199918e&scope.project.id=c515ec4395fe420e9ab0ba34fb1ada8f&role.id=c67085ec338243df8f9b7d6459036e23 => generated 259 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:05:25.492641 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e77922d4-1120-41e7-a258-2147d0e6b5da None admin] Authenticating user token {{(pid=416294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:05:25.508494 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78731614-db62-4ffc-b2a4-8b42d92ef67b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:05:25.509446 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78731614-db62-4ffc-b2a4-8b42d92ef67b None admin] REQUEST_METHOD: `GET` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:05:25.509841 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78731614-db62-4ffc-b2a4-8b42d92ef67b None admin] SCRIPT_NAME: `/identity` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:05:25.510269 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78731614-db62-4ffc-b2a4-8b42d92ef67b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:05:25.511288 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78731614-db62-4ffc-b2a4-8b42d92ef67b None admin] RBAC: Adding query filter params (role.id=ba1a79dc27074d5a94dce2d994019d37, scope.project.id=c515ec4395fe420e9ab0ba34fb1ada8f, user.id=d8807d513cea475c9faa3106083edd8a) {{(pid=416293) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 09:05:25.511742 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78731614-db62-4ffc-b2a4-8b42d92ef67b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:05:25.513472 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78731614-db62-4ffc-b2a4-8b42d92ef67b None admin] RBAC: Authorization granted {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:05:25.523065 dv-cinder-851351-1-smb devstack@keystone.service[416293]: [pid: 416293|app: 0|req: 44/92] 10.222.0.42 () {56 vars in 1374 bytes} [Thu Jul 28 09:05:25 2022] GET /identity/v3/role_assignments?user.id=d8807d513cea475c9faa3106083edd8a&scope.project.id=c515ec4395fe420e9ab0ba34fb1ada8f&role.id=ba1a79dc27074d5a94dce2d994019d37 => generated 259 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:05:25.524343 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78731614-db62-4ffc-b2a4-8b42d92ef67b None admin] Authenticating user token {{(pid=416293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:05:25.697119 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e77922d4-1120-41e7-a258-2147d0e6b5da None admin] Validating token access rules against request {{(pid=416294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:05:25.744442 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed22363-e0ed-4897-88d2-70811818ee29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:05:25.745574 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed22363-e0ed-4897-88d2-70811818ee29 None admin] REQUEST_METHOD: `GET` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:05:25.746297 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed22363-e0ed-4897-88d2-70811818ee29 None admin] SCRIPT_NAME: `/identity` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:05:25.746805 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed22363-e0ed-4897-88d2-70811818ee29 None admin] PATH_INFO: `/v3/projects/c515ec4395fe420e9ab0ba34fb1ada8f` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:05:25.748969 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed22363-e0ed-4897-88d2-70811818ee29 None admin] RBAC: Authorizing `identity:get_project(project_id=c515ec4395fe420e9ab0ba34fb1ada8f)` {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:05:25.751316 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed22363-e0ed-4897-88d2-70811818ee29 None admin] RBAC: Authorization granted {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:05:25.755384 dv-cinder-851351-1-smb devstack@keystone.service[416294]: [pid: 416294|app: 0|req: 49/93] 10.222.0.42 () {56 vars in 1186 bytes} [Thu Jul 28 09:05:25 2022] GET /identity/v3/projects/c515ec4395fe420e9ab0ba34fb1ada8f => generated 298 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:05:25.765911 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed22363-e0ed-4897-88d2-70811818ee29 None admin] Authenticating user token {{(pid=416294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:05:25.787084 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78731614-db62-4ffc-b2a4-8b42d92ef67b None admin] Validating token access rules against request {{(pid=416293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:05:25.803185 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG dbcounter [-] [416294] Writing DB stats keystone:SELECT=100 {{(pid=416294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:05:25.828280 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG dbcounter [-] [416293] Writing DB stats keystone:SELECT=100 {{(pid=416293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:05:25.849522 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a20e55e-1736-4ce5-b50a-bd1ecb8a4ebb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:05:25.850173 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a20e55e-1736-4ce5-b50a-bd1ecb8a4ebb None admin] REQUEST_METHOD: `GET` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:05:25.850462 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a20e55e-1736-4ce5-b50a-bd1ecb8a4ebb None admin] SCRIPT_NAME: `/identity` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:05:25.850740 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a20e55e-1736-4ce5-b50a-bd1ecb8a4ebb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:05:25.956043 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed22363-e0ed-4897-88d2-70811818ee29 None admin] Validating token access rules against request {{(pid=416294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:05:25.987364 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a20e55e-1736-4ce5-b50a-bd1ecb8a4ebb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:05:25.989205 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a20e55e-1736-4ce5-b50a-bd1ecb8a4ebb None admin] RBAC: Authorization granted {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:05:26.030206 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab5496a-72fa-4484-b5b4-281d36dc625f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:05:26.030855 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab5496a-72fa-4484-b5b4-281d36dc625f None admin] REQUEST_METHOD: `GET` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:05:26.031139 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab5496a-72fa-4484-b5b4-281d36dc625f None admin] SCRIPT_NAME: `/identity` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:05:26.031415 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab5496a-72fa-4484-b5b4-281d36dc625f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:05:26.032225 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ab5496a-72fa-4484-b5b4-281d36dc625f None admin] RBAC: Adding query filter params (role.id=6194848862704a289bbaa3fda43a9050, scope.project.id=c515ec4395fe420e9ab0ba34fb1ada8f, user.id=d8807d513cea475c9faa3106083edd8a) {{(pid=416294) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 09:05:26.032539 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ab5496a-72fa-4484-b5b4-281d36dc625f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:05:26.034082 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ab5496a-72fa-4484-b5b4-281d36dc625f None admin] RBAC: Authorization granted {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:05:26.046863 dv-cinder-851351-1-smb devstack@keystone.service[416294]: [pid: 416294|app: 0|req: 50/94] 10.222.0.42 () {56 vars in 1374 bytes} [Thu Jul 28 09:05:25 2022] GET /identity/v3/role_assignments?user.id=d8807d513cea475c9faa3106083edd8a&scope.project.id=c515ec4395fe420e9ab0ba34fb1ada8f&role.id=6194848862704a289bbaa3fda43a9050 => generated 259 bytes in 282 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:05:26.204743 dv-cinder-851351-1-smb devstack@keystone.service[416293]: [pid: 416293|app: 0|req: 45/95] 10.222.0.42 () {58 vars in 1282 bytes} [Thu Jul 28 09:05:25 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 681 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 28 09:05:26.213920 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab5496a-72fa-4484-b5b4-281d36dc625f None admin] Authenticating user token {{(pid=416294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:05:26.369601 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG dbcounter [-] [416294] Writing DB stats keystone:SELECT=100 {{(pid=416294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:05:26.398699 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab5496a-72fa-4484-b5b4-281d36dc625f None admin] Validating token access rules against request {{(pid=416294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:05:26.457255 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f261e59f-4e54-4de1-a31e-9f68b8568d39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:05:26.458266 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f261e59f-4e54-4de1-a31e-9f68b8568d39 None admin] REQUEST_METHOD: `GET` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:05:26.458721 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f261e59f-4e54-4de1-a31e-9f68b8568d39 None admin] SCRIPT_NAME: `/identity` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:05:26.459203 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f261e59f-4e54-4de1-a31e-9f68b8568d39 None admin] PATH_INFO: `/v3/projects/090ea9d868594067b3092600971fc7a7` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:05:26.461185 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f261e59f-4e54-4de1-a31e-9f68b8568d39 None admin] RBAC: Authorizing `identity:get_project(project_id=090ea9d868594067b3092600971fc7a7)` {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:05:26.464623 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f261e59f-4e54-4de1-a31e-9f68b8568d39 None admin] RBAC: Authorization granted {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:05:26.467884 dv-cinder-851351-1-smb devstack@keystone.service[416294]: [pid: 416294|app: 0|req: 51/96] 10.222.0.42 () {56 vars in 1186 bytes} [Thu Jul 28 09:05:26 2022] GET /identity/v3/projects/090ea9d868594067b3092600971fc7a7 => generated 312 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:05:26.474848 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a20e55e-1736-4ce5-b50a-bd1ecb8a4ebb None admin] Authenticating user token {{(pid=416293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:05:26.516256 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG dbcounter [-] [416293] Writing DB stats keystone:SELECT=100 {{(pid=416293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:05:26.625762 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a20e55e-1736-4ce5-b50a-bd1ecb8a4ebb None admin] Validating token access rules against request {{(pid=416293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:05:26.680394 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e4a06b-704b-448d-bb17-1d72a8de7d20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:05:26.681083 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e4a06b-704b-448d-bb17-1d72a8de7d20 None admin] REQUEST_METHOD: `GET` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:05:26.681519 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e4a06b-704b-448d-bb17-1d72a8de7d20 None admin] SCRIPT_NAME: `/identity` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:05:26.681858 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e4a06b-704b-448d-bb17-1d72a8de7d20 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:05:26.682747 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e4a06b-704b-448d-bb17-1d72a8de7d20 None admin] RBAC: Adding query filter params (role.id=ba1a79dc27074d5a94dce2d994019d37, scope.project.id=090ea9d868594067b3092600971fc7a7, user.id=d8807d513cea475c9faa3106083edd8a) {{(pid=416293) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 09:05:26.683067 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e4a06b-704b-448d-bb17-1d72a8de7d20 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:05:26.689183 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e4a06b-704b-448d-bb17-1d72a8de7d20 None admin] RBAC: Authorization granted {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:05:26.696122 dv-cinder-851351-1-smb devstack@keystone.service[416293]: [pid: 416293|app: 0|req: 46/97] 10.222.0.42 () {56 vars in 1374 bytes} [Thu Jul 28 09:05:26 2022] GET /identity/v3/role_assignments?user.id=d8807d513cea475c9faa3106083edd8a&scope.project.id=090ea9d868594067b3092600971fc7a7&role.id=ba1a79dc27074d5a94dce2d994019d37 => generated 259 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:05:27.896589 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14698ff4-c547-4c6d-9f01-5287e7aa521e None None] REQUEST_METHOD: `GET` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:05:27.897188 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14698ff4-c547-4c6d-9f01-5287e7aa521e None None] SCRIPT_NAME: `/identity` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:05:27.897188 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14698ff4-c547-4c6d-9f01-5287e7aa521e None None] PATH_INFO: `/` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:05:27.898569 dv-cinder-851351-1-smb devstack@keystone.service[416294]: [pid: 416294|app: 0|req: 52/98] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 09:05:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 09:05:27.904076 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f609ec6-6317-4316-a860-5153a69c89bf None None] REQUEST_METHOD: `POST` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:05:27.904966 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f609ec6-6317-4316-a860-5153a69c89bf None None] SCRIPT_NAME: `/identity` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:05:27.905476 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f609ec6-6317-4316-a860-5153a69c89bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:05:27.924721 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.auth.core [None req-7f609ec6-6317-4316-a860-5153a69c89bf None None] MFA Rules not processed for user `dbf87abab90e4fdf9e75408f4199918e`. Rule list: `[]` (Enabled: `True`). {{(pid=416293) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 09:05:27.926391 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.fernet_utils [None req-7f609ec6-6317-4316-a860-5153a69c89bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=416293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 09:05:28.011005 dv-cinder-851351-1-smb devstack@keystone.service[416293]: [pid: 416293|app: 0|req: 47/99] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 09:05:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 09:05:28.033735 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14698ff4-c547-4c6d-9f01-5287e7aa521e None None] Authenticating user token {{(pid=416294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:05:28.155100 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14698ff4-c547-4c6d-9f01-5287e7aa521e None None] Validating token access rules against request {{(pid=416294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:05:28.202338 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8be14a2-ed8a-43c6-915e-455612d8bdf5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:05:28.203021 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8be14a2-ed8a-43c6-915e-455612d8bdf5 None admin] REQUEST_METHOD: `GET` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:05:28.203321 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8be14a2-ed8a-43c6-915e-455612d8bdf5 None admin] SCRIPT_NAME: `/identity` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:05:28.203607 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8be14a2-ed8a-43c6-915e-455612d8bdf5 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:05:28.219168 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8be14a2-ed8a-43c6-915e-455612d8bdf5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 09:05:28.224860 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application [None req-a8be14a2-ed8a-43c6-915e-455612d8bdf5 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 28 09:05:28.224860 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 09:05:28.224860 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 09:05:28.224860 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 09:05:28.224860 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 09:05:28.224860 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 09:05:28.224860 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 09:05:28.224860 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 09:05:28.224860 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 09:05:28.224860 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 09:05:28.224860 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 09:05:28.224860 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 09:05:28.224860 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 09:05:28.224860 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 09:05:28.224860 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 09:05:28.224860 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 09:05:28.225837 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 09:05:28.225837 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 09:05:28.225837 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 09:05:28.225837 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 09:05:28.225837 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 09:05:28.225837 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 09:05:28.225837 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 09:05:28.225837 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 09:05:28.225837 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 09:05:28.225837 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 09:05:28.225837 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 09:05:28.225837 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application with Lock( Jul 28 09:05:28.225837 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 09:05:28.225837 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return self._enter() Jul 28 09:05:28.225837 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 09:05:28.225837 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 09:05:28.226681 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 09:05:28.226681 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return self.creator() Jul 28 09:05:28.226681 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 09:05:28.226681 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application created_value = creator( Jul 28 09:05:28.226681 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 09:05:28.226681 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 09:05:28.226681 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 09:05:28.226681 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 09:05:28.226681 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 09:05:28.226681 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 09:05:28.226681 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 28 09:05:28.226681 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application Jul 28 09:05:28.226681 dv-cinder-851351-1-smb devstack@keystone.service[416294]: [pid: 416294|app: 0|req: 53/100] 10.222.0.42 () {56 vars in 1099 bytes} [Thu Jul 28 09:05:28 2022] GET /identity/v3/roles/reader => generated 84 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 09:05:28.232382 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f609ec6-6317-4316-a860-5153a69c89bf None None] Authenticating user token {{(pid=416293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:05:28.253029 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG dbcounter [-] [416293] Writing DB stats keystone:SELECT=100 {{(pid=416293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:05:28.264387 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ace6d74-5019-4f16-838c-a7f76d4dd459 None None] REQUEST_METHOD: `GET` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:05:28.265089 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ace6d74-5019-4f16-838c-a7f76d4dd459 None None] SCRIPT_NAME: `/identity` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:05:28.265591 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ace6d74-5019-4f16-838c-a7f76d4dd459 None None] PATH_INFO: `/` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:05:28.267212 dv-cinder-851351-1-smb devstack@keystone.service[416294]: [pid: 416294|app: 0|req: 54/101] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 09:05:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 28 09:05:28.268485 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61afea2b-764d-493c-afbb-cb7bedede8f8 None None] REQUEST_METHOD: `GET` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:05:28.273073 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61afea2b-764d-493c-afbb-cb7bedede8f8 None None] SCRIPT_NAME: `/identity` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:05:28.273683 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61afea2b-764d-493c-afbb-cb7bedede8f8 None None] PATH_INFO: `/` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:05:28.275396 dv-cinder-851351-1-smb devstack@keystone.service[416294]: [pid: 416294|app: 0|req: 55/102] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 09:05:28 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 09:05:28.276880 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2edd0bc2-ec2d-4f6c-992f-f00f0f0580b5 None None] REQUEST_METHOD: `POST` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:05:28.277413 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2edd0bc2-ec2d-4f6c-992f-f00f0f0580b5 None None] SCRIPT_NAME: `/identity` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:05:28.277899 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2edd0bc2-ec2d-4f6c-992f-f00f0f0580b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:05:28.298780 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.auth.core [None req-2edd0bc2-ec2d-4f6c-992f-f00f0f0580b5 None None] MFA Rules not processed for user `dbf87abab90e4fdf9e75408f4199918e`. Rule list: `[]` (Enabled: `True`). {{(pid=416294) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 09:05:28.300511 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.fernet_utils [None req-2edd0bc2-ec2d-4f6c-992f-f00f0f0580b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=416294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 09:05:28.303185 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG dbcounter [-] [416294] Writing DB stats keystone:SELECT=100 {{(pid=416294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:05:28.356927 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f609ec6-6317-4316-a860-5153a69c89bf None None] Validating token access rules against request {{(pid=416293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:05:28.395059 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f2f909-73cc-42dd-9d6e-ab39a5564797 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:05:28.396024 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f2f909-73cc-42dd-9d6e-ab39a5564797 None admin] REQUEST_METHOD: `GET` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:05:28.396474 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f2f909-73cc-42dd-9d6e-ab39a5564797 None admin] SCRIPT_NAME: `/identity` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:05:28.396932 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f2f909-73cc-42dd-9d6e-ab39a5564797 None admin] PATH_INFO: `/v3/roles` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:05:28.397851 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4f2f909-73cc-42dd-9d6e-ab39a5564797 None admin] RBAC: Adding query filter params (name=reader) {{(pid=416293) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 09:05:28.398315 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4f2f909-73cc-42dd-9d6e-ab39a5564797 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:05:28.399917 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4f2f909-73cc-42dd-9d6e-ab39a5564797 None admin] RBAC: Authorization granted {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:05:28.409749 dv-cinder-851351-1-smb devstack@keystone.service[416293]: [pid: 416293|app: 0|req: 48/103] 10.222.0.42 () {56 vars in 1101 bytes} [Thu Jul 28 09:05:28 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:05:28.411319 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c418faf2-f851-4d36-b2e6-fcf515423257 None None] REQUEST_METHOD: `POST` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:05:28.411804 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c418faf2-f851-4d36-b2e6-fcf515423257 None None] SCRIPT_NAME: `/identity` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:05:28.412280 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c418faf2-f851-4d36-b2e6-fcf515423257 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:05:28.431422 dv-cinder-851351-1-smb devstack@keystone.service[416294]: [pid: 416294|app: 0|req: 56/104] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 09:05:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 28 09:05:28.432899 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2edd0bc2-ec2d-4f6c-992f-f00f0f0580b5 None None] Authenticating user token {{(pid=416294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:05:28.445803 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.auth.core [None req-c418faf2-f851-4d36-b2e6-fcf515423257 None None] MFA Rules not processed for user `dbf87abab90e4fdf9e75408f4199918e`. Rule list: `[]` (Enabled: `True`). {{(pid=416293) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 09:05:28.447066 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.fernet_utils [None req-c418faf2-f851-4d36-b2e6-fcf515423257 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=416293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 09:05:28.524935 dv-cinder-851351-1-smb devstack@keystone.service[416293]: [pid: 416293|app: 0|req: 49/105] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 09:05:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 09:05:28.526124 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c418faf2-f851-4d36-b2e6-fcf515423257 None None] Authenticating user token {{(pid=416293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:05:28.545214 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG dbcounter [-] [416293] Writing DB stats keystone:SELECT=100 {{(pid=416293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:05:28.666480 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c418faf2-f851-4d36-b2e6-fcf515423257 None None] Validating token access rules against request {{(pid=416293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:05:28.666899 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2edd0bc2-ec2d-4f6c-992f-f00f0f0580b5 None None] Validating token access rules against request {{(pid=416294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:05:28.709392 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85dc2305-7ac3-435d-bcb3-1314ac9316e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:05:28.710722 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85dc2305-7ac3-435d-bcb3-1314ac9316e1 None admin] REQUEST_METHOD: `GET` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:05:28.711224 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85dc2305-7ac3-435d-bcb3-1314ac9316e1 None admin] SCRIPT_NAME: `/identity` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:05:28.711700 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85dc2305-7ac3-435d-bcb3-1314ac9316e1 None admin] PATH_INFO: `/v3/domains/default` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:05:28.713166 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85dc2305-7ac3-435d-bcb3-1314ac9316e1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:05:28.714869 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85dc2305-7ac3-435d-bcb3-1314ac9316e1 None admin] RBAC: Authorization granted {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:05:28.717313 dv-cinder-851351-1-smb devstack@keystone.service[416293]: [pid: 416293|app: 0|req: 50/106] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 09:05:28 2022] GET /identity/v3/domains/default => generated 199 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:05:28.718347 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85dc2305-7ac3-435d-bcb3-1314ac9316e1 None admin] Authenticating user token {{(pid=416293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:05:28.780743 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab2fef9-f203-476f-914f-69808354984a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:05:28.785458 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab2fef9-f203-476f-914f-69808354984a None admin] REQUEST_METHOD: `GET` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:05:28.785754 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab2fef9-f203-476f-914f-69808354984a None admin] SCRIPT_NAME: `/identity` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:05:28.786045 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab2fef9-f203-476f-914f-69808354984a None admin] PATH_INFO: `/v3/users/7ebed970bd644c1aa9e856d13f0bfa52` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:05:28.801088 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG dbcounter [-] [416293] Writing DB stats keystone:SELECT=100 {{(pid=416293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:05:28.801798 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG dbcounter [-] [416294] Writing DB stats keystone:SELECT=100 {{(pid=416294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:05:28.833432 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dab2fef9-f203-476f-914f-69808354984a None admin] RBAC: Authorizing `identity:get_user(user_id=7ebed970bd644c1aa9e856d13f0bfa52)` {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:05:28.834943 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dab2fef9-f203-476f-914f-69808354984a None admin] RBAC: Authorization granted {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:05:28.836750 dv-cinder-851351-1-smb devstack@keystone.service[416294]: [pid: 416294|app: 0|req: 57/107] 10.222.0.42 () {56 vars in 1177 bytes} [Thu Jul 28 09:05:28 2022] GET /identity/v3/users/7ebed970bd644c1aa9e856d13f0bfa52 => generated 289 bytes in 404 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:05:28.837528 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab2fef9-f203-476f-914f-69808354984a None admin] Authenticating user token {{(pid=416294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:05:28.839334 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85dc2305-7ac3-435d-bcb3-1314ac9316e1 None admin] Validating token access rules against request {{(pid=416293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:05:28.888197 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed21df3-c5e7-4ef5-8826-8c4002d8952e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:05:28.889273 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed21df3-c5e7-4ef5-8826-8c4002d8952e None admin] REQUEST_METHOD: `GET` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:05:28.889567 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed21df3-c5e7-4ef5-8826-8c4002d8952e None admin] SCRIPT_NAME: `/identity` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:05:28.889851 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed21df3-c5e7-4ef5-8826-8c4002d8952e None admin] PATH_INFO: `/v3/roles/member` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:05:28.900607 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed21df3-c5e7-4ef5-8826-8c4002d8952e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 09:05:28.905618 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application [None req-5ed21df3-c5e7-4ef5-8826-8c4002d8952e None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 28 09:05:28.905618 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 09:05:28.905618 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 09:05:28.905618 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 09:05:28.905618 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 09:05:28.905618 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 09:05:28.905618 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 09:05:28.905618 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 09:05:28.905618 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 09:05:28.905618 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 09:05:28.905618 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 09:05:28.905618 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 09:05:28.905618 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 09:05:28.905618 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 09:05:28.905618 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 09:05:28.905618 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 09:05:28.907196 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 09:05:28.907196 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 09:05:28.907196 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 09:05:28.907196 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 09:05:28.907196 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 09:05:28.907196 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 09:05:28.907196 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 09:05:28.907196 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 09:05:28.907196 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 09:05:28.907196 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 09:05:28.907196 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 09:05:28.907196 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application with Lock( Jul 28 09:05:28.907196 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 09:05:28.907196 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self._enter() Jul 28 09:05:28.907196 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 09:05:28.907196 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 09:05:28.908071 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 09:05:28.908071 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self.creator() Jul 28 09:05:28.908071 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 09:05:28.908071 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application created_value = creator( Jul 28 09:05:28.908071 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 09:05:28.908071 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 09:05:28.908071 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 09:05:28.908071 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 09:05:28.908071 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 09:05:28.908071 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 09:05:28.908071 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 28 09:05:28.908071 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application Jul 28 09:05:28.908071 dv-cinder-851351-1-smb devstack@keystone.service[416293]: [pid: 416293|app: 0|req: 51/108] 10.222.0.42 () {56 vars in 1099 bytes} [Thu Jul 28 09:05:28 2022] GET /identity/v3/roles/member => generated 84 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 09:05:28.908914 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2264ae0-d208-4e2e-baf1-eb9d3d722efe None None] REQUEST_METHOD: `GET` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:05:28.908997 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2264ae0-d208-4e2e-baf1-eb9d3d722efe None None] SCRIPT_NAME: `/identity` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:05:28.909934 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2264ae0-d208-4e2e-baf1-eb9d3d722efe None None] PATH_INFO: `/` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:05:28.910541 dv-cinder-851351-1-smb devstack@keystone.service[416293]: [pid: 416293|app: 0|req: 52/109] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 09:05:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 09:05:28.911258 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2264ae0-d208-4e2e-baf1-eb9d3d722efe None None] Authenticating user token {{(pid=416293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:05:28.964790 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab2fef9-f203-476f-914f-69808354984a None admin] Validating token access rules against request {{(pid=416294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:05:29.007695 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007c92ba-a43e-4f18-9094-c21e5ea96436 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:05:29.008336 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007c92ba-a43e-4f18-9094-c21e5ea96436 None admin] REQUEST_METHOD: `POST` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:05:29.008638 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007c92ba-a43e-4f18-9094-c21e5ea96436 None admin] SCRIPT_NAME: `/identity` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:05:29.008948 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007c92ba-a43e-4f18-9094-c21e5ea96436 None admin] PATH_INFO: `/v3/projects` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:05:29.009851 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-007c92ba-a43e-4f18-9094-c21e5ea96436 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:05:29.011638 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-007c92ba-a43e-4f18-9094-c21e5ea96436 None admin] RBAC: Authorization granted {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:05:29.022169 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2264ae0-d208-4e2e-baf1-eb9d3d722efe None None] Validating token access rules against request {{(pid=416293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:05:29.045542 dv-cinder-851351-1-smb devstack@keystone.service[416294]: [pid: 416294|app: 0|req: 58/110] 10.222.0.42 () {60 vars in 1141 bytes} [Thu Jul 28 09:05:28 2022] POST /identity/v3/projects => generated 302 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 09:05:29.047195 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4cc4ce-5704-48ce-bae9-a61a9f2828c2 None None] REQUEST_METHOD: `GET` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:05:29.047500 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4cc4ce-5704-48ce-bae9-a61a9f2828c2 None None] SCRIPT_NAME: `/identity` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:05:29.047789 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4cc4ce-5704-48ce-bae9-a61a9f2828c2 None None] PATH_INFO: `/` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:05:29.049082 dv-cinder-851351-1-smb devstack@keystone.service[416294]: [pid: 416294|app: 0|req: 59/111] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 09:05:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 09:05:29.049817 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf4cc4ce-5704-48ce-bae9-a61a9f2828c2 None None] Authenticating user token {{(pid=416294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:05:29.083565 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG dbcounter [-] [416293] Writing DB stats keystone:SELECT=100 {{(pid=416293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:05:29.091957 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbdf8665-83f0-4d8d-8ff1-0b6f6bd21176 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:05:29.093232 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbdf8665-83f0-4d8d-8ff1-0b6f6bd21176 None admin] REQUEST_METHOD: `GET` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:05:29.093813 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbdf8665-83f0-4d8d-8ff1-0b6f6bd21176 None admin] SCRIPT_NAME: `/identity` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:05:29.094348 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbdf8665-83f0-4d8d-8ff1-0b6f6bd21176 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:05:29.117127 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG dbcounter [-] [416294] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=416294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:05:29.188382 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf4cc4ce-5704-48ce-bae9-a61a9f2828c2 None None] Validating token access rules against request {{(pid=416294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:05:29.198060 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbdf8665-83f0-4d8d-8ff1-0b6f6bd21176 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:05:29.200251 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbdf8665-83f0-4d8d-8ff1-0b6f6bd21176 None admin] RBAC: Authorization granted {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:05:29.231536 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67566d47-c81e-4d5b-b4a0-0a214c089a59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:05:29.232616 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67566d47-c81e-4d5b-b4a0-0a214c089a59 None admin] REQUEST_METHOD: `GET` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:05:29.233122 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67566d47-c81e-4d5b-b4a0-0a214c089a59 None admin] SCRIPT_NAME: `/identity` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:05:29.233631 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67566d47-c81e-4d5b-b4a0-0a214c089a59 None admin] PATH_INFO: `/v3/roles` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:05:29.234571 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67566d47-c81e-4d5b-b4a0-0a214c089a59 None admin] RBAC: Adding query filter params (name=member) {{(pid=416294) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 09:05:29.235057 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67566d47-c81e-4d5b-b4a0-0a214c089a59 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:05:29.237063 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67566d47-c81e-4d5b-b4a0-0a214c089a59 None admin] RBAC: Authorization granted {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:05:29.248008 dv-cinder-851351-1-smb devstack@keystone.service[416294]: [pid: 416294|app: 0|req: 60/112] 10.222.0.42 () {56 vars in 1101 bytes} [Thu Jul 28 09:05:29 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:05:29.254597 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3400248-20d8-4da6-9355-eedf47d04e3e None None] REQUEST_METHOD: `POST` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:05:29.254902 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3400248-20d8-4da6-9355-eedf47d04e3e None None] SCRIPT_NAME: `/identity` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:05:29.255175 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3400248-20d8-4da6-9355-eedf47d04e3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:05:29.276318 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.auth.core [None req-f3400248-20d8-4da6-9355-eedf47d04e3e None None] MFA Rules not processed for user `dbf87abab90e4fdf9e75408f4199918e`. Rule list: `[]` (Enabled: `True`). {{(pid=416294) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 09:05:29.277951 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.fernet_utils [None req-f3400248-20d8-4da6-9355-eedf47d04e3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=416294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 09:05:29.342434 dv-cinder-851351-1-smb devstack@keystone.service[416293]: [pid: 416293|app: 0|req: 53/113] 10.222.0.42 () {58 vars in 1282 bytes} [Thu Jul 28 09:05:28 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 431 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 28 09:05:29.344132 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f7d026-1426-4040-8748-6301076abddf None None] REQUEST_METHOD: `POST` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:05:29.344649 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f7d026-1426-4040-8748-6301076abddf None None] SCRIPT_NAME: `/identity` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:05:29.345178 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f7d026-1426-4040-8748-6301076abddf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:05:29.364487 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.auth.core [None req-30f7d026-1426-4040-8748-6301076abddf None None] MFA Rules not processed for user `dbf87abab90e4fdf9e75408f4199918e`. Rule list: `[]` (Enabled: `True`). {{(pid=416293) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 09:05:29.366139 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.fernet_utils [None req-30f7d026-1426-4040-8748-6301076abddf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=416293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 09:05:29.381839 dv-cinder-851351-1-smb devstack@keystone.service[416294]: [pid: 416294|app: 0|req: 61/114] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 09:05:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 09:05:29.382873 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3400248-20d8-4da6-9355-eedf47d04e3e None None] Authenticating user token {{(pid=416294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:05:29.398875 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG dbcounter [-] [416293] Writing DB stats keystone:SELECT=100 {{(pid=416293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:05:29.435288 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG dbcounter [-] [416294] Writing DB stats keystone:SELECT=100 {{(pid=416294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:05:29.465996 dv-cinder-851351-1-smb devstack@keystone.service[416293]: [pid: 416293|app: 0|req: 54/115] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 09:05:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 09:05:29.466978 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f7d026-1426-4040-8748-6301076abddf None None] Authenticating user token {{(pid=416293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:05:29.505507 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3400248-20d8-4da6-9355-eedf47d04e3e None None] Validating token access rules against request {{(pid=416294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:05:29.543174 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01466931-d04f-4caa-bc0b-745a2e3bb6d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:05:29.544253 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01466931-d04f-4caa-bc0b-745a2e3bb6d5 None admin] REQUEST_METHOD: `GET` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:05:29.544809 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01466931-d04f-4caa-bc0b-745a2e3bb6d5 None admin] SCRIPT_NAME: `/identity` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:05:29.545566 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01466931-d04f-4caa-bc0b-745a2e3bb6d5 None admin] PATH_INFO: `/v3/users/d8807d513cea475c9faa3106083edd8a` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:05:29.547492 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01466931-d04f-4caa-bc0b-745a2e3bb6d5 None admin] RBAC: Authorizing `identity:get_user(user_id=d8807d513cea475c9faa3106083edd8a)` {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:05:29.549632 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01466931-d04f-4caa-bc0b-745a2e3bb6d5 None admin] RBAC: Authorization granted {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:05:29.557428 dv-cinder-851351-1-smb devstack@keystone.service[416294]: [pid: 416294|app: 0|req: 62/116] 10.222.0.42 () {56 vars in 1177 bytes} [Thu Jul 28 09:05:29 2022] GET /identity/v3/users/d8807d513cea475c9faa3106083edd8a => generated 275 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:05:29.558783 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01466931-d04f-4caa-bc0b-745a2e3bb6d5 None admin] Authenticating user token {{(pid=416294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:05:29.600719 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f7d026-1426-4040-8748-6301076abddf None None] Validating token access rules against request {{(pid=416293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:05:29.648342 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f541fa45-7aa5-4173-b6e7-dc0c19b32c72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:05:29.648889 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f541fa45-7aa5-4173-b6e7-dc0c19b32c72 None admin] REQUEST_METHOD: `GET` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:05:29.649183 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f541fa45-7aa5-4173-b6e7-dc0c19b32c72 None admin] SCRIPT_NAME: `/identity` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:05:29.649511 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f541fa45-7aa5-4173-b6e7-dc0c19b32c72 None admin] PATH_INFO: `/v3/projects/c515ec4395fe420e9ab0ba34fb1ada8f` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:05:29.650711 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f541fa45-7aa5-4173-b6e7-dc0c19b32c72 None admin] RBAC: Authorizing `identity:get_project(project_id=c515ec4395fe420e9ab0ba34fb1ada8f)` {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:05:29.653067 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f541fa45-7aa5-4173-b6e7-dc0c19b32c72 None admin] RBAC: Authorization granted {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:05:29.655700 dv-cinder-851351-1-smb devstack@keystone.service[416293]: [pid: 416293|app: 0|req: 55/117] 10.222.0.42 () {56 vars in 1186 bytes} [Thu Jul 28 09:05:29 2022] GET /identity/v3/projects/c515ec4395fe420e9ab0ba34fb1ada8f => generated 298 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:05:29.656045 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f541fa45-7aa5-4173-b6e7-dc0c19b32c72 None admin] Authenticating user token {{(pid=416293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:05:29.690402 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01466931-d04f-4caa-bc0b-745a2e3bb6d5 None admin] Validating token access rules against request {{(pid=416294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:05:29.697373 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG dbcounter [-] [416293] Writing DB stats keystone:SELECT=100 {{(pid=416293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:05:29.704293 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG dbcounter [-] [416294] Writing DB stats keystone:SELECT=100 {{(pid=416294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:05:29.733283 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a73552a-4098-458a-9a8a-9ff6f8d0c0fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:05:29.733957 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a73552a-4098-458a-9a8a-9ff6f8d0c0fb None admin] REQUEST_METHOD: `GET` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:05:29.734249 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a73552a-4098-458a-9a8a-9ff6f8d0c0fb None admin] SCRIPT_NAME: `/identity` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:05:29.734541 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a73552a-4098-458a-9a8a-9ff6f8d0c0fb None admin] PATH_INFO: `/v3/roles/admin` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:05:29.745710 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a73552a-4098-458a-9a8a-9ff6f8d0c0fb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 09:05:29.751301 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application [None req-6a73552a-4098-458a-9a8a-9ff6f8d0c0fb None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 09:05:29.751301 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 09:05:29.751301 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 09:05:29.751301 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 09:05:29.751301 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 09:05:29.751301 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 09:05:29.751301 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 09:05:29.751301 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 09:05:29.751301 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 09:05:29.751301 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 09:05:29.751301 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 09:05:29.751301 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 09:05:29.751301 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 09:05:29.751301 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 09:05:29.751301 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 09:05:29.751301 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 09:05:29.752256 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 09:05:29.752256 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 09:05:29.752256 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 09:05:29.752256 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 09:05:29.752256 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 09:05:29.752256 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 09:05:29.752256 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 09:05:29.752256 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 09:05:29.752256 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 09:05:29.752256 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 09:05:29.752256 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 09:05:29.752256 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application with Lock( Jul 28 09:05:29.752256 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 09:05:29.752256 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return self._enter() Jul 28 09:05:29.752256 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 09:05:29.752256 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 09:05:29.753170 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 09:05:29.753170 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return self.creator() Jul 28 09:05:29.753170 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 09:05:29.753170 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application created_value = creator( Jul 28 09:05:29.753170 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 09:05:29.753170 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 09:05:29.753170 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 09:05:29.753170 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 09:05:29.753170 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 09:05:29.753170 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 09:05:29.753170 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 09:05:29.753170 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application Jul 28 09:05:29.753170 dv-cinder-851351-1-smb devstack@keystone.service[416294]: [pid: 416294|app: 0|req: 63/118] 10.222.0.42 () {56 vars in 1096 bytes} [Thu Jul 28 09:05:29 2022] GET /identity/v3/roles/admin => generated 83 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 09:05:29.753945 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a73552a-4098-458a-9a8a-9ff6f8d0c0fb None admin] Authenticating user token {{(pid=416294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:05:29.784606 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f541fa45-7aa5-4173-b6e7-dc0c19b32c72 None admin] Validating token access rules against request {{(pid=416293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:05:29.820324 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd4d8996-a5d3-4cf7-8982-8cc0c4c6930a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:05:29.821180 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4d8996-a5d3-4cf7-8982-8cc0c4c6930a None admin] REQUEST_METHOD: `GET` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:05:29.821471 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4d8996-a5d3-4cf7-8982-8cc0c4c6930a None admin] SCRIPT_NAME: `/identity` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:05:29.821756 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4d8996-a5d3-4cf7-8982-8cc0c4c6930a None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:05:29.833099 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd4d8996-a5d3-4cf7-8982-8cc0c4c6930a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 09:05:29.838248 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application [None req-cd4d8996-a5d3-4cf7-8982-8cc0c4c6930a None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 28 09:05:29.838248 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 09:05:29.838248 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 09:05:29.838248 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 09:05:29.838248 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 09:05:29.838248 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 09:05:29.838248 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 09:05:29.838248 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 09:05:29.838248 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 09:05:29.838248 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 09:05:29.838248 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 09:05:29.838248 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 09:05:29.838248 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 09:05:29.838248 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 09:05:29.838248 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 09:05:29.838248 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 09:05:29.839226 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 09:05:29.839226 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 09:05:29.839226 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 09:05:29.839226 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 09:05:29.839226 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 09:05:29.839226 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 09:05:29.839226 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 09:05:29.839226 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 09:05:29.839226 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 09:05:29.839226 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 09:05:29.839226 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 09:05:29.839226 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application with Lock( Jul 28 09:05:29.839226 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 09:05:29.839226 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self._enter() Jul 28 09:05:29.839226 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 09:05:29.839226 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 09:05:29.840067 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 09:05:29.840067 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self.creator() Jul 28 09:05:29.840067 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 09:05:29.840067 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application created_value = creator( Jul 28 09:05:29.840067 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 09:05:29.840067 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 09:05:29.840067 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 09:05:29.840067 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 09:05:29.840067 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 09:05:29.840067 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 09:05:29.840067 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 28 09:05:29.840067 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application Jul 28 09:05:29.840067 dv-cinder-851351-1-smb devstack@keystone.service[416293]: [pid: 416293|app: 0|req: 56/119] 10.222.0.42 () {56 vars in 1114 bytes} [Thu Jul 28 09:05:29 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 09:05:29.841200 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd4d8996-a5d3-4cf7-8982-8cc0c4c6930a None admin] Authenticating user token {{(pid=416293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:05:29.873590 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a73552a-4098-458a-9a8a-9ff6f8d0c0fb None admin] Validating token access rules against request {{(pid=416294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:05:29.908930 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70f1e34-b098-4e75-ba3f-9aadf326aed1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:05:29.910087 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70f1e34-b098-4e75-ba3f-9aadf326aed1 None admin] REQUEST_METHOD: `GET` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:05:29.910635 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70f1e34-b098-4e75-ba3f-9aadf326aed1 None admin] SCRIPT_NAME: `/identity` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:05:29.911076 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70f1e34-b098-4e75-ba3f-9aadf326aed1 None admin] PATH_INFO: `/v3/projects/c515ec4395fe420e9ab0ba34fb1ada8f` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:05:29.912445 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c70f1e34-b098-4e75-ba3f-9aadf326aed1 None admin] RBAC: Authorizing `identity:get_project(project_id=c515ec4395fe420e9ab0ba34fb1ada8f)` {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:05:29.914143 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c70f1e34-b098-4e75-ba3f-9aadf326aed1 None admin] RBAC: Authorization granted {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:05:29.915916 dv-cinder-851351-1-smb devstack@keystone.service[416294]: [pid: 416294|app: 0|req: 64/120] 10.222.0.42 () {56 vars in 1186 bytes} [Thu Jul 28 09:05:29 2022] GET /identity/v3/projects/c515ec4395fe420e9ab0ba34fb1ada8f => generated 298 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:05:29.917168 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3871ffc5-2b14-4a36-8a33-8f2b08d7af74 None None] REQUEST_METHOD: `GET` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:05:29.917465 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3871ffc5-2b14-4a36-8a33-8f2b08d7af74 None None] SCRIPT_NAME: `/identity` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:05:29.917802 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3871ffc5-2b14-4a36-8a33-8f2b08d7af74 None None] PATH_INFO: `/` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:05:29.923046 dv-cinder-851351-1-smb devstack@keystone.service[416294]: [pid: 416294|app: 0|req: 65/121] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 09:05:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 09:05:29.923046 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3871ffc5-2b14-4a36-8a33-8f2b08d7af74 None None] Authenticating user token {{(pid=416294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:05:29.947441 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG dbcounter [-] [416293] Writing DB stats keystone:SELECT=100 {{(pid=416293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:05:29.959319 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd4d8996-a5d3-4cf7-8982-8cc0c4c6930a None admin] Validating token access rules against request {{(pid=416293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:05:29.965084 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG dbcounter [-] [416294] Writing DB stats keystone:SELECT=100 {{(pid=416294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:05:30.001051 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c887b2-4492-468b-87b7-709d3586b853 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:05:30.001702 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c887b2-4492-468b-87b7-709d3586b853 None admin] REQUEST_METHOD: `GET` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:05:30.001991 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c887b2-4492-468b-87b7-709d3586b853 None admin] SCRIPT_NAME: `/identity` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:05:30.002272 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c887b2-4492-468b-87b7-709d3586b853 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:05:30.003198 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c887b2-4492-468b-87b7-709d3586b853 None admin] RBAC: Adding query filter params (role.id=071325426dc84e2cb2689d138bc2b032, scope.project.id=c515ec4395fe420e9ab0ba34fb1ada8f, user.id=7ebed970bd644c1aa9e856d13f0bfa52) {{(pid=416293) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 09:05:30.003587 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c887b2-4492-468b-87b7-709d3586b853 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:05:30.005225 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c887b2-4492-468b-87b7-709d3586b853 None admin] RBAC: Authorization granted {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:05:30.020901 dv-cinder-851351-1-smb devstack@keystone.service[416293]: [pid: 416293|app: 0|req: 57/122] 10.222.0.42 () {56 vars in 1374 bytes} [Thu Jul 28 09:05:29 2022] GET /identity/v3/role_assignments?user.id=7ebed970bd644c1aa9e856d13f0bfa52&scope.project.id=c515ec4395fe420e9ab0ba34fb1ada8f&role.id=071325426dc84e2cb2689d138bc2b032 => generated 259 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:05:30.023280 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c887b2-4492-468b-87b7-709d3586b853 None admin] Authenticating user token {{(pid=416293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:05:30.037816 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3871ffc5-2b14-4a36-8a33-8f2b08d7af74 None None] Validating token access rules against request {{(pid=416294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:05:30.078977 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6862288f-8dd1-4bc7-b5e3-2e11ac2ce86b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:05:30.079241 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6862288f-8dd1-4bc7-b5e3-2e11ac2ce86b None admin] REQUEST_METHOD: `GET` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:05:30.079325 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6862288f-8dd1-4bc7-b5e3-2e11ac2ce86b None admin] SCRIPT_NAME: `/identity` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:05:30.079630 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6862288f-8dd1-4bc7-b5e3-2e11ac2ce86b None admin] PATH_INFO: `/v3/roles` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:05:30.080391 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6862288f-8dd1-4bc7-b5e3-2e11ac2ce86b None admin] RBAC: Adding query filter params (name=admin) {{(pid=416294) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 09:05:30.080812 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6862288f-8dd1-4bc7-b5e3-2e11ac2ce86b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:05:30.082328 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6862288f-8dd1-4bc7-b5e3-2e11ac2ce86b None admin] RBAC: Authorization granted {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:05:30.092755 dv-cinder-851351-1-smb devstack@keystone.service[416294]: [pid: 416294|app: 0|req: 66/123] 10.222.0.42 () {56 vars in 1099 bytes} [Thu Jul 28 09:05:29 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:05:30.098606 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6862288f-8dd1-4bc7-b5e3-2e11ac2ce86b None admin] Authenticating user token {{(pid=416294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:05:30.159265 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c887b2-4492-468b-87b7-709d3586b853 None admin] Validating token access rules against request {{(pid=416293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:05:30.209097 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee22a7b5-295b-40a9-9253-ee90aad52523 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:05:30.210289 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee22a7b5-295b-40a9-9253-ee90aad52523 None admin] REQUEST_METHOD: `GET` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:05:30.210581 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee22a7b5-295b-40a9-9253-ee90aad52523 None admin] SCRIPT_NAME: `/identity` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:05:30.211010 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee22a7b5-295b-40a9-9253-ee90aad52523 None admin] PATH_INFO: `/v3/roles` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:05:30.211899 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee22a7b5-295b-40a9-9253-ee90aad52523 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=416293) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 09:05:30.212215 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee22a7b5-295b-40a9-9253-ee90aad52523 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:05:30.214694 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee22a7b5-295b-40a9-9253-ee90aad52523 None admin] RBAC: Authorization granted {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:05:30.219251 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG dbcounter [-] [416294] Writing DB stats keystone:SELECT=100 {{(pid=416294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:05:30.224813 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6862288f-8dd1-4bc7-b5e3-2e11ac2ce86b None admin] Validating token access rules against request {{(pid=416294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:05:30.228769 dv-cinder-851351-1-smb devstack@keystone.service[416293]: [pid: 416293|app: 0|req: 58/124] 10.222.0.42 () {56 vars in 1111 bytes} [Thu Jul 28 09:05:30 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:05:30.231333 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969cc2c7-2086-4717-ab1b-8250a7ebf389 None None] REQUEST_METHOD: `POST` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:05:30.235183 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969cc2c7-2086-4717-ab1b-8250a7ebf389 None None] SCRIPT_NAME: `/identity` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:05:30.235684 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969cc2c7-2086-4717-ab1b-8250a7ebf389 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:05:30.258877 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.auth.core [None req-969cc2c7-2086-4717-ab1b-8250a7ebf389 None None] MFA Rules not processed for user `dbf87abab90e4fdf9e75408f4199918e`. Rule list: `[]` (Enabled: `True`). {{(pid=416293) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 09:05:30.260677 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.fernet_utils [None req-969cc2c7-2086-4717-ab1b-8250a7ebf389 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=416293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 09:05:30.274245 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-745e1572-9fa5-4f53-aad1-12291eb339b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:05:30.275225 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745e1572-9fa5-4f53-aad1-12291eb339b7 None admin] REQUEST_METHOD: `PUT` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:05:30.275649 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745e1572-9fa5-4f53-aad1-12291eb339b7 None admin] SCRIPT_NAME: `/identity` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:05:30.276032 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745e1572-9fa5-4f53-aad1-12291eb339b7 None admin] PATH_INFO: `/v3/projects/c515ec4395fe420e9ab0ba34fb1ada8f/users/d8807d513cea475c9faa3106083edd8a/roles/ba1a79dc27074d5a94dce2d994019d37` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:05:30.277082 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG dbcounter [-] [416293] Writing DB stats keystone:SELECT=100 {{(pid=416293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:05:30.279651 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-745e1572-9fa5-4f53-aad1-12291eb339b7 None admin] RBAC: Authorizing `identity:create_grant(project_id=c515ec4395fe420e9ab0ba34fb1ada8f, user_id=d8807d513cea475c9faa3106083edd8a, role_id=ba1a79dc27074d5a94dce2d994019d37)` {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:05:30.282185 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-745e1572-9fa5-4f53-aad1-12291eb339b7 None admin] RBAC: Authorization granted {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:05:30.299583 dv-cinder-851351-1-smb devstack@keystone.service[416294]: [pid: 416294|app: 0|req: 67/125] 10.222.0.42 () {58 vars in 1439 bytes} [Thu Jul 28 09:05:30 2022] PUT /identity/v3/projects/c515ec4395fe420e9ab0ba34fb1ada8f/users/d8807d513cea475c9faa3106083edd8a/roles/ba1a79dc27074d5a94dce2d994019d37 => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 09:05:30.300984 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-745e1572-9fa5-4f53-aad1-12291eb339b7 None admin] Authenticating user token {{(pid=416294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:05:30.346183 dv-cinder-851351-1-smb devstack@keystone.service[416293]: [pid: 416293|app: 0|req: 59/126] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 09:05:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 09:05:30.351906 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969cc2c7-2086-4717-ab1b-8250a7ebf389 None None] Authenticating user token {{(pid=416293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:05:30.449600 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-745e1572-9fa5-4f53-aad1-12291eb339b7 None admin] Validating token access rules against request {{(pid=416294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:05:30.475475 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969cc2c7-2086-4717-ab1b-8250a7ebf389 None None] Validating token access rules against request {{(pid=416293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:05:30.498847 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5844a4-7369-4967-a776-d885b72e5c44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:05:30.501472 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5844a4-7369-4967-a776-d885b72e5c44 None admin] REQUEST_METHOD: `GET` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:05:30.502356 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5844a4-7369-4967-a776-d885b72e5c44 None admin] SCRIPT_NAME: `/identity` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:05:30.503696 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5844a4-7369-4967-a776-d885b72e5c44 None admin] PATH_INFO: `/v3/users/dbf87abab90e4fdf9e75408f4199918e` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:05:30.507131 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd5844a4-7369-4967-a776-d885b72e5c44 None admin] RBAC: Authorizing `identity:get_user(user_id=dbf87abab90e4fdf9e75408f4199918e)` {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:05:30.509478 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd5844a4-7369-4967-a776-d885b72e5c44 None admin] RBAC: Authorization granted {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:05:30.512628 dv-cinder-851351-1-smb devstack@keystone.service[416294]: [pid: 416294|app: 0|req: 68/127] 10.222.0.42 () {56 vars in 1177 bytes} [Thu Jul 28 09:05:30 2022] GET /identity/v3/users/dbf87abab90e4fdf9e75408f4199918e => generated 247 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:05:30.514750 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5844a4-7369-4967-a776-d885b72e5c44 None admin] Authenticating user token {{(pid=416294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:05:30.568508 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96544f29-a9d6-4ce8-83d9-25a3fdf811da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:05:30.569151 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96544f29-a9d6-4ce8-83d9-25a3fdf811da None admin] REQUEST_METHOD: `GET` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:05:30.569450 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96544f29-a9d6-4ce8-83d9-25a3fdf811da None admin] SCRIPT_NAME: `/identity` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:05:30.569736 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96544f29-a9d6-4ce8-83d9-25a3fdf811da None admin] PATH_INFO: `/v3/users/d8807d513cea475c9faa3106083edd8a` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:05:30.572256 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96544f29-a9d6-4ce8-83d9-25a3fdf811da None admin] RBAC: Authorizing `identity:get_user(user_id=d8807d513cea475c9faa3106083edd8a)` {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:05:30.574160 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96544f29-a9d6-4ce8-83d9-25a3fdf811da None admin] RBAC: Authorization granted {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:05:30.574321 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG dbcounter [-] [416294] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=416294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:05:30.576202 dv-cinder-851351-1-smb devstack@keystone.service[416293]: [pid: 416293|app: 0|req: 60/128] 10.222.0.42 () {56 vars in 1177 bytes} [Thu Jul 28 09:05:30 2022] GET /identity/v3/users/d8807d513cea475c9faa3106083edd8a => generated 275 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:05:30.577822 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96544f29-a9d6-4ce8-83d9-25a3fdf811da None admin] Authenticating user token {{(pid=416293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:05:30.623979 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG dbcounter [-] [416293] Writing DB stats keystone:SELECT=100 {{(pid=416293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:05:30.649072 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5844a4-7369-4967-a776-d885b72e5c44 None admin] Validating token access rules against request {{(pid=416294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:05:30.716609 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a6ddba-1409-47ff-b42e-dbcfa45517cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:05:30.717637 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a6ddba-1409-47ff-b42e-dbcfa45517cc None admin] REQUEST_METHOD: `GET` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:05:30.718257 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a6ddba-1409-47ff-b42e-dbcfa45517cc None admin] SCRIPT_NAME: `/identity` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:05:30.719553 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a6ddba-1409-47ff-b42e-dbcfa45517cc None admin] PATH_INFO: `/v3/roles/member` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:05:30.749725 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64a6ddba-1409-47ff-b42e-dbcfa45517cc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 09:05:30.755717 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application [None req-64a6ddba-1409-47ff-b42e-dbcfa45517cc None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 28 09:05:30.755717 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 09:05:30.755717 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 09:05:30.755717 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 09:05:30.755717 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 09:05:30.755717 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 09:05:30.755717 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 09:05:30.755717 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 09:05:30.755717 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 09:05:30.755717 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 09:05:30.755717 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 09:05:30.755717 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 09:05:30.755717 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 09:05:30.755717 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 09:05:30.755717 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 09:05:30.755717 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 09:05:30.756900 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 09:05:30.756900 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 09:05:30.756900 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 09:05:30.756900 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 09:05:30.756900 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 09:05:30.756900 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 09:05:30.756900 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 09:05:30.756900 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 09:05:30.756900 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 09:05:30.756900 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 09:05:30.756900 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 09:05:30.756900 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application with Lock( Jul 28 09:05:30.756900 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 09:05:30.756900 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return self._enter() Jul 28 09:05:30.756900 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 09:05:30.756900 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 09:05:30.757864 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 09:05:30.757864 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return self.creator() Jul 28 09:05:30.757864 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 09:05:30.757864 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application created_value = creator( Jul 28 09:05:30.757864 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 09:05:30.757864 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 09:05:30.757864 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 09:05:30.757864 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 09:05:30.757864 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 09:05:30.757864 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 09:05:30.757864 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 28 09:05:30.757864 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application Jul 28 09:05:30.757864 dv-cinder-851351-1-smb devstack@keystone.service[416294]: [pid: 416294|app: 0|req: 69/129] 10.222.0.42 () {56 vars in 1099 bytes} [Thu Jul 28 09:05:30 2022] GET /identity/v3/roles/member => generated 84 bytes in 242 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 09:05:30.757864 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a6ddba-1409-47ff-b42e-dbcfa45517cc None admin] Authenticating user token {{(pid=416294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:05:30.784110 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96544f29-a9d6-4ce8-83d9-25a3fdf811da None admin] Validating token access rules against request {{(pid=416293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:05:30.823241 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476461b9-ab83-47e9-9467-a133c1388ce7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:05:30.824642 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476461b9-ab83-47e9-9467-a133c1388ce7 None admin] REQUEST_METHOD: `GET` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:05:30.825106 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476461b9-ab83-47e9-9467-a133c1388ce7 None admin] SCRIPT_NAME: `/identity` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:05:30.825533 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476461b9-ab83-47e9-9467-a133c1388ce7 None admin] PATH_INFO: `/v3/projects/c515ec4395fe420e9ab0ba34fb1ada8f` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:05:30.826969 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-476461b9-ab83-47e9-9467-a133c1388ce7 None admin] RBAC: Authorizing `identity:get_project(project_id=c515ec4395fe420e9ab0ba34fb1ada8f)` {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:05:30.828637 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-476461b9-ab83-47e9-9467-a133c1388ce7 None admin] RBAC: Authorization granted {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:05:30.830711 dv-cinder-851351-1-smb devstack@keystone.service[416293]: [pid: 416293|app: 0|req: 61/130] 10.222.0.42 () {56 vars in 1186 bytes} [Thu Jul 28 09:05:30 2022] GET /identity/v3/projects/c515ec4395fe420e9ab0ba34fb1ada8f => generated 298 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:05:30.836468 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476461b9-ab83-47e9-9467-a133c1388ce7 None admin] Authenticating user token {{(pid=416293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:05:30.927854 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG dbcounter [-] [416293] Writing DB stats keystone:SELECT=100 {{(pid=416293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:05:30.951274 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476461b9-ab83-47e9-9467-a133c1388ce7 None admin] Validating token access rules against request {{(pid=416293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:05:30.987770 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG dbcounter [-] [416294] Writing DB stats keystone:SELECT=100 {{(pid=416294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:05:30.991075 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d7466d-b33e-4b01-9371-deab9c1f300d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:05:30.991919 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d7466d-b33e-4b01-9371-deab9c1f300d None admin] REQUEST_METHOD: `GET` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:05:30.992354 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d7466d-b33e-4b01-9371-deab9c1f300d None admin] SCRIPT_NAME: `/identity` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:05:30.992852 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d7466d-b33e-4b01-9371-deab9c1f300d None admin] PATH_INFO: `/v3/roles` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:05:30.994343 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45d7466d-b33e-4b01-9371-deab9c1f300d None admin] RBAC: Adding query filter params (name=member) {{(pid=416293) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 09:05:30.995020 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45d7466d-b33e-4b01-9371-deab9c1f300d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:05:30.996571 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45d7466d-b33e-4b01-9371-deab9c1f300d None admin] RBAC: Authorization granted {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:05:31.006500 dv-cinder-851351-1-smb devstack@keystone.service[416293]: [pid: 416293|app: 0|req: 62/131] 10.222.0.42 () {56 vars in 1101 bytes} [Thu Jul 28 09:05:30 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:05:31.007778 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d7466d-b33e-4b01-9371-deab9c1f300d None admin] Authenticating user token {{(pid=416293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:05:31.038683 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a6ddba-1409-47ff-b42e-dbcfa45517cc None admin] Validating token access rules against request {{(pid=416294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:05:31.115729 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d7466d-b33e-4b01-9371-deab9c1f300d None admin] Validating token access rules against request {{(pid=416293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:05:31.152924 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8652437-1717-4de3-b56d-1c435ae40170 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:05:31.154844 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8652437-1717-4de3-b56d-1c435ae40170 None admin] REQUEST_METHOD: `GET` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:05:31.155848 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8652437-1717-4de3-b56d-1c435ae40170 None admin] SCRIPT_NAME: `/identity` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:05:31.156717 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3156cbe-c702-402c-850d-54be326194b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:05:31.157639 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3156cbe-c702-402c-850d-54be326194b5 None admin] REQUEST_METHOD: `PUT` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:05:31.158132 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8652437-1717-4de3-b56d-1c435ae40170 None admin] PATH_INFO: `/v3/projects/c515ec4395fe420e9ab0ba34fb1ada8f` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:05:31.159183 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3156cbe-c702-402c-850d-54be326194b5 None admin] SCRIPT_NAME: `/identity` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:05:31.159741 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3156cbe-c702-402c-850d-54be326194b5 None admin] PATH_INFO: `/v3/projects/c515ec4395fe420e9ab0ba34fb1ada8f/users/dbf87abab90e4fdf9e75408f4199918e/roles/c67085ec338243df8f9b7d6459036e23` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:05:31.160600 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8652437-1717-4de3-b56d-1c435ae40170 None admin] RBAC: Authorizing `identity:get_project(project_id=c515ec4395fe420e9ab0ba34fb1ada8f)` {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:05:31.163148 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8652437-1717-4de3-b56d-1c435ae40170 None admin] RBAC: Authorization granted {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:05:31.165124 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3156cbe-c702-402c-850d-54be326194b5 None admin] RBAC: Authorizing `identity:create_grant(project_id=c515ec4395fe420e9ab0ba34fb1ada8f, user_id=dbf87abab90e4fdf9e75408f4199918e, role_id=c67085ec338243df8f9b7d6459036e23)` {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:05:31.166793 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3156cbe-c702-402c-850d-54be326194b5 None admin] RBAC: Authorization granted {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:05:31.172992 dv-cinder-851351-1-smb devstack@keystone.service[416294]: [pid: 416294|app: 0|req: 70/132] 10.222.0.42 () {56 vars in 1186 bytes} [Thu Jul 28 09:05:30 2022] GET /identity/v3/projects/c515ec4395fe420e9ab0ba34fb1ada8f => generated 298 bytes in 415 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:05:31.173720 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8652437-1717-4de3-b56d-1c435ae40170 None admin] Authenticating user token {{(pid=416294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:05:31.196257 dv-cinder-851351-1-smb devstack@keystone.service[416293]: [pid: 416293|app: 0|req: 63/133] 10.222.0.42 () {58 vars in 1439 bytes} [Thu Jul 28 09:05:31 2022] PUT /identity/v3/projects/c515ec4395fe420e9ab0ba34fb1ada8f/users/dbf87abab90e4fdf9e75408f4199918e/roles/c67085ec338243df8f9b7d6459036e23 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 09:05:31.202023 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3156cbe-c702-402c-850d-54be326194b5 None admin] Authenticating user token {{(pid=416293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:05:31.210840 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG dbcounter [-] [416293] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=416293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:05:31.391170 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3156cbe-c702-402c-850d-54be326194b5 None admin] Validating token access rules against request {{(pid=416293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:05:31.409246 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8652437-1717-4de3-b56d-1c435ae40170 None admin] Validating token access rules against request {{(pid=416294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:05:31.429674 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54e0a51-82bd-4cd5-9415-f1b685da9c7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:05:31.430648 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54e0a51-82bd-4cd5-9415-f1b685da9c7b None admin] REQUEST_METHOD: `PUT` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:05:31.431036 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54e0a51-82bd-4cd5-9415-f1b685da9c7b None admin] SCRIPT_NAME: `/identity` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:05:31.431417 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54e0a51-82bd-4cd5-9415-f1b685da9c7b None admin] PATH_INFO: `/v3/projects/c515ec4395fe420e9ab0ba34fb1ada8f/users/d8807d513cea475c9faa3106083edd8a/roles/6194848862704a289bbaa3fda43a9050` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:05:31.434080 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f54e0a51-82bd-4cd5-9415-f1b685da9c7b None admin] RBAC: Authorizing `identity:create_grant(project_id=c515ec4395fe420e9ab0ba34fb1ada8f, user_id=d8807d513cea475c9faa3106083edd8a, role_id=6194848862704a289bbaa3fda43a9050)` {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:05:31.435701 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f54e0a51-82bd-4cd5-9415-f1b685da9c7b None admin] RBAC: Authorization granted {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:05:31.457372 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf3a03b-3c77-410d-9ea2-9d6cffc31038 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:05:31.458121 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf3a03b-3c77-410d-9ea2-9d6cffc31038 None admin] REQUEST_METHOD: `GET` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:05:31.458418 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf3a03b-3c77-410d-9ea2-9d6cffc31038 None admin] SCRIPT_NAME: `/identity` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:05:31.458697 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf3a03b-3c77-410d-9ea2-9d6cffc31038 None admin] PATH_INFO: `/v3/users/d8807d513cea475c9faa3106083edd8a` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:05:31.460042 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaf3a03b-3c77-410d-9ea2-9d6cffc31038 None admin] RBAC: Authorizing `identity:get_user(user_id=d8807d513cea475c9faa3106083edd8a)` {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:05:31.461614 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaf3a03b-3c77-410d-9ea2-9d6cffc31038 None admin] RBAC: Authorization granted {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:05:31.463082 dv-cinder-851351-1-smb devstack@keystone.service[416293]: [pid: 416293|app: 0|req: 64/134] 10.222.0.42 () {58 vars in 1439 bytes} [Thu Jul 28 09:05:31 2022] PUT /identity/v3/projects/c515ec4395fe420e9ab0ba34fb1ada8f/users/d8807d513cea475c9faa3106083edd8a/roles/6194848862704a289bbaa3fda43a9050 => generated 0 bytes in 262 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 09:05:31.463314 dv-cinder-851351-1-smb devstack@keystone.service[416294]: [pid: 416294|app: 0|req: 71/135] 10.222.0.42 () {56 vars in 1177 bytes} [Thu Jul 28 09:05:31 2022] GET /identity/v3/users/d8807d513cea475c9faa3106083edd8a => generated 275 bytes in 290 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:05:31.469478 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54e0a51-82bd-4cd5-9415-f1b685da9c7b None admin] Authenticating user token {{(pid=416293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:05:31.536412 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68ff0b7-e1d7-44e1-883b-721bd458aad0 None None] REQUEST_METHOD: `GET` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:05:31.536867 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68ff0b7-e1d7-44e1-883b-721bd458aad0 None None] SCRIPT_NAME: `/identity` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:05:31.537046 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68ff0b7-e1d7-44e1-883b-721bd458aad0 None None] PATH_INFO: `/` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:05:31.538854 dv-cinder-851351-1-smb devstack@keystone.service[416294]: [pid: 416294|app: 0|req: 72/136] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 09:05:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 09:05:31.546351 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e44157-c10c-4062-97ab-aaaadc2199d7 None None] REQUEST_METHOD: `POST` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:05:31.546692 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e44157-c10c-4062-97ab-aaaadc2199d7 None None] SCRIPT_NAME: `/identity` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:05:31.546930 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e44157-c10c-4062-97ab-aaaadc2199d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:05:31.572109 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.auth.core [None req-73e44157-c10c-4062-97ab-aaaadc2199d7 None None] MFA Rules not processed for user `dbf87abab90e4fdf9e75408f4199918e`. Rule list: `[]` (Enabled: `True`). {{(pid=416294) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 09:05:31.573389 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.fernet_utils [None req-73e44157-c10c-4062-97ab-aaaadc2199d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=416294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 09:05:31.574504 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG dbcounter [-] [416293] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=416293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:05:31.616442 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54e0a51-82bd-4cd5-9415-f1b685da9c7b None admin] Validating token access rules against request {{(pid=416293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:05:31.632243 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG dbcounter [-] [416294] Writing DB stats keystone:SELECT=100 {{(pid=416294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:05:31.674822 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611ad3ba-1687-48d7-9946-c3ec61ca1039 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:05:31.675468 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611ad3ba-1687-48d7-9946-c3ec61ca1039 None admin] REQUEST_METHOD: `GET` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:05:31.675761 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611ad3ba-1687-48d7-9946-c3ec61ca1039 None admin] SCRIPT_NAME: `/identity` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:05:31.676047 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611ad3ba-1687-48d7-9946-c3ec61ca1039 None admin] PATH_INFO: `/v3/projects/090ea9d868594067b3092600971fc7a7` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:05:31.677555 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-611ad3ba-1687-48d7-9946-c3ec61ca1039 None admin] RBAC: Authorizing `identity:get_project(project_id=090ea9d868594067b3092600971fc7a7)` {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:05:31.679077 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-611ad3ba-1687-48d7-9946-c3ec61ca1039 None admin] RBAC: Authorization granted {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:05:31.685199 dv-cinder-851351-1-smb devstack@keystone.service[416293]: [pid: 416293|app: 0|req: 65/137] 10.222.0.42 () {56 vars in 1186 bytes} [Thu Jul 28 09:05:31 2022] GET /identity/v3/projects/090ea9d868594067b3092600971fc7a7 => generated 312 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:05:31.692268 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611ad3ba-1687-48d7-9946-c3ec61ca1039 None admin] Authenticating user token {{(pid=416293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:05:31.794052 dv-cinder-851351-1-smb devstack@keystone.service[416294]: [pid: 416294|app: 0|req: 73/138] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 09:05:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 249 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 09:05:31.833630 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e44157-c10c-4062-97ab-aaaadc2199d7 None None] Authenticating user token {{(pid=416294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:05:31.927245 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611ad3ba-1687-48d7-9946-c3ec61ca1039 None admin] Validating token access rules against request {{(pid=416293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:05:31.961829 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e44157-c10c-4062-97ab-aaaadc2199d7 None None] Validating token access rules against request {{(pid=416294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:05:31.997711 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG dbcounter [-] [416293] Writing DB stats keystone:SELECT=100 {{(pid=416293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:05:31.998246 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45cd7abd-2c77-4afd-a728-83ebefdc6b03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:05:31.998708 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45cd7abd-2c77-4afd-a728-83ebefdc6b03 None admin] REQUEST_METHOD: `GET` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:05:31.998998 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45cd7abd-2c77-4afd-a728-83ebefdc6b03 None admin] SCRIPT_NAME: `/identity` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:05:31.999591 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45cd7abd-2c77-4afd-a728-83ebefdc6b03 None admin] PATH_INFO: `/v3/domains/default` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:05:32.001329 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45cd7abd-2c77-4afd-a728-83ebefdc6b03 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:05:32.002949 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45cd7abd-2c77-4afd-a728-83ebefdc6b03 None admin] RBAC: Authorization granted {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:05:32.005350 dv-cinder-851351-1-smb devstack@keystone.service[416294]: [pid: 416294|app: 0|req: 74/139] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 09:05:31 2022] GET /identity/v3/domains/default => generated 199 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 09:05:32.010309 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4faf1674-fa72-4326-a8b8-028babbf8797 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:05:32.011307 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4faf1674-fa72-4326-a8b8-028babbf8797 None admin] REQUEST_METHOD: `PUT` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:05:32.011807 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4faf1674-fa72-4326-a8b8-028babbf8797 None admin] SCRIPT_NAME: `/identity` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:05:32.012311 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4faf1674-fa72-4326-a8b8-028babbf8797 None admin] PATH_INFO: `/v3/projects/090ea9d868594067b3092600971fc7a7/users/d8807d513cea475c9faa3106083edd8a/roles/ba1a79dc27074d5a94dce2d994019d37` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:05:32.013680 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45cd7abd-2c77-4afd-a728-83ebefdc6b03 None admin] Authenticating user token {{(pid=416294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:05:32.017483 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4faf1674-fa72-4326-a8b8-028babbf8797 None admin] RBAC: Authorizing `identity:create_grant(project_id=090ea9d868594067b3092600971fc7a7, user_id=d8807d513cea475c9faa3106083edd8a, role_id=ba1a79dc27074d5a94dce2d994019d37)` {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:05:32.019443 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4faf1674-fa72-4326-a8b8-028babbf8797 None admin] RBAC: Authorization granted {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:05:32.060294 dv-cinder-851351-1-smb devstack@keystone.service[416293]: [pid: 416293|app: 0|req: 66/140] 10.222.0.42 () {58 vars in 1439 bytes} [Thu Jul 28 09:05:31 2022] PUT /identity/v3/projects/090ea9d868594067b3092600971fc7a7/users/d8807d513cea475c9faa3106083edd8a/roles/ba1a79dc27074d5a94dce2d994019d37 => generated 0 bytes in 369 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 28 09:05:32.068231 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG dbcounter [-] [416294] Writing DB stats keystone:SELECT=100 {{(pid=416294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:05:32.173482 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45cd7abd-2c77-4afd-a728-83ebefdc6b03 None admin] Validating token access rules against request {{(pid=416294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:05:32.219535 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-951dc740-5350-480e-a12c-5b499cbee89e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:05:32.220113 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951dc740-5350-480e-a12c-5b499cbee89e None admin] REQUEST_METHOD: `POST` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:05:32.220401 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951dc740-5350-480e-a12c-5b499cbee89e None admin] SCRIPT_NAME: `/identity` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:05:32.220694 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951dc740-5350-480e-a12c-5b499cbee89e None admin] PATH_INFO: `/v3/users` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:05:32.221486 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-951dc740-5350-480e-a12c-5b499cbee89e None admin] RBAC: Authorizing `identity:create_user()` {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:05:32.223056 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-951dc740-5350-480e-a12c-5b499cbee89e None admin] RBAC: Authorization granted {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:05:32.258308 dv-cinder-851351-1-smb devstack@keystone.service[416294]: [pid: 416294|app: 0|req: 75/141] 10.222.0.42 () {60 vars in 1132 bytes} [Thu Jul 28 09:05:32 2022] POST /identity/v3/users => generated 283 bytes in 245 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 09:05:32.633790 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fecea22e-4efb-4f5d-80c0-a7d423e82ae4 None None] REQUEST_METHOD: `GET` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:05:32.634136 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fecea22e-4efb-4f5d-80c0-a7d423e82ae4 None None] SCRIPT_NAME: `/identity` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:05:32.634374 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fecea22e-4efb-4f5d-80c0-a7d423e82ae4 None None] PATH_INFO: `/` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:05:32.635847 dv-cinder-851351-1-smb devstack@keystone.service[416293]: [pid: 416293|app: 0|req: 67/142] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 09:05:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 09:05:32.641434 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6a8ebb-f53b-412d-bb86-a0f0b5fe2b86 None None] REQUEST_METHOD: `POST` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:05:32.641734 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6a8ebb-f53b-412d-bb86-a0f0b5fe2b86 None None] SCRIPT_NAME: `/identity` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:05:32.642021 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6a8ebb-f53b-412d-bb86-a0f0b5fe2b86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:05:32.665889 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.auth.core [None req-4b6a8ebb-f53b-412d-bb86-a0f0b5fe2b86 None None] MFA Rules not processed for user `dbf87abab90e4fdf9e75408f4199918e`. Rule list: `[]` (Enabled: `True`). {{(pid=416294) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 09:05:32.667203 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.fernet_utils [None req-4b6a8ebb-f53b-412d-bb86-a0f0b5fe2b86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=416294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 09:05:32.750734 dv-cinder-851351-1-smb devstack@keystone.service[416294]: [pid: 416294|app: 0|req: 76/143] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 09:05:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 09:05:32.785519 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fecea22e-4efb-4f5d-80c0-a7d423e82ae4 None None] Authenticating user token {{(pid=416293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:05:32.938593 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fecea22e-4efb-4f5d-80c0-a7d423e82ae4 None None] Validating token access rules against request {{(pid=416293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:05:33.001571 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d3d1c7-9dbe-4850-8f8f-07f27189b30f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:05:33.002344 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d3d1c7-9dbe-4850-8f8f-07f27189b30f None admin] REQUEST_METHOD: `GET` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:05:33.002542 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d3d1c7-9dbe-4850-8f8f-07f27189b30f None admin] SCRIPT_NAME: `/identity` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:05:33.002834 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d3d1c7-9dbe-4850-8f8f-07f27189b30f None admin] PATH_INFO: `/v3/roles/reader` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:05:33.023851 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86d3d1c7-9dbe-4850-8f8f-07f27189b30f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 09:05:33.029577 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application [None req-86d3d1c7-9dbe-4850-8f8f-07f27189b30f None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 28 09:05:33.029577 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 09:05:33.029577 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 09:05:33.029577 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 09:05:33.029577 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 09:05:33.029577 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 09:05:33.029577 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 09:05:33.029577 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 09:05:33.029577 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 09:05:33.029577 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 09:05:33.029577 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 09:05:33.029577 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 09:05:33.029577 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 09:05:33.029577 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 09:05:33.029577 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 09:05:33.029577 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 09:05:33.030531 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 09:05:33.030531 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 09:05:33.030531 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 09:05:33.030531 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 09:05:33.030531 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 09:05:33.030531 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 09:05:33.030531 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 09:05:33.030531 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 09:05:33.030531 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 09:05:33.030531 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 09:05:33.030531 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 09:05:33.030531 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application with Lock( Jul 28 09:05:33.030531 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 09:05:33.030531 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self._enter() Jul 28 09:05:33.030531 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 09:05:33.030531 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 09:05:33.031785 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 09:05:33.031785 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self.creator() Jul 28 09:05:33.031785 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 09:05:33.031785 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application created_value = creator( Jul 28 09:05:33.031785 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 09:05:33.031785 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 09:05:33.031785 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 09:05:33.031785 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 09:05:33.031785 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 09:05:33.031785 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 09:05:33.031785 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 28 09:05:33.031785 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application Jul 28 09:05:33.031785 dv-cinder-851351-1-smb devstack@keystone.service[416293]: [pid: 416293|app: 0|req: 68/144] 10.222.0.42 () {56 vars in 1099 bytes} [Thu Jul 28 09:05:32 2022] GET /identity/v3/roles/reader => generated 84 bytes in 246 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 09:05:33.037018 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6a8ebb-f53b-412d-bb86-a0f0b5fe2b86 None None] Authenticating user token {{(pid=416294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:05:33.046613 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG dbcounter [-] [416294] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=416294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:05:33.106942 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488393ee-0346-4506-801e-34883f6a3360 None None] REQUEST_METHOD: `GET` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:05:33.107281 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488393ee-0346-4506-801e-34883f6a3360 None None] SCRIPT_NAME: `/identity` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:05:33.107514 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488393ee-0346-4506-801e-34883f6a3360 None None] PATH_INFO: `/` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:05:33.109133 dv-cinder-851351-1-smb devstack@keystone.service[416293]: [pid: 416293|app: 0|req: 69/145] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 09:05:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 28 09:05:33.115920 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f0d3ad-0a81-4fd8-841f-a1260550bcf9 None None] REQUEST_METHOD: `POST` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:05:33.116545 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f0d3ad-0a81-4fd8-841f-a1260550bcf9 None None] SCRIPT_NAME: `/identity` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:05:33.117081 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f0d3ad-0a81-4fd8-841f-a1260550bcf9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:05:33.148869 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.auth.core [None req-01f0d3ad-0a81-4fd8-841f-a1260550bcf9 None None] MFA Rules not processed for user `dbf87abab90e4fdf9e75408f4199918e`. Rule list: `[]` (Enabled: `True`). {{(pid=416293) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 09:05:33.150512 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.fernet_utils [None req-01f0d3ad-0a81-4fd8-841f-a1260550bcf9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=416293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 09:05:33.163054 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6a8ebb-f53b-412d-bb86-a0f0b5fe2b86 None None] Validating token access rules against request {{(pid=416294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:05:33.213685 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb3b39b-3253-4ff2-af1e-8b3102e7ea73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:05:33.214258 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb3b39b-3253-4ff2-af1e-8b3102e7ea73 None admin] REQUEST_METHOD: `GET` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:05:33.214541 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb3b39b-3253-4ff2-af1e-8b3102e7ea73 None admin] SCRIPT_NAME: `/identity` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:05:33.214827 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb3b39b-3253-4ff2-af1e-8b3102e7ea73 None admin] PATH_INFO: `/v3/roles` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:05:33.215595 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb3b39b-3253-4ff2-af1e-8b3102e7ea73 None admin] RBAC: Adding query filter params (name=reader) {{(pid=416294) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 09:05:33.215908 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb3b39b-3253-4ff2-af1e-8b3102e7ea73 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:05:33.217366 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb3b39b-3253-4ff2-af1e-8b3102e7ea73 None admin] RBAC: Authorization granted {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:05:33.226787 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG dbcounter [-] [416293] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=416293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:05:33.230790 dv-cinder-851351-1-smb devstack@keystone.service[416294]: [pid: 416294|app: 0|req: 77/146] 10.222.0.42 () {56 vars in 1101 bytes} [Thu Jul 28 09:05:33 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:05:33.238636 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb3b39b-3253-4ff2-af1e-8b3102e7ea73 None admin] Authenticating user token {{(pid=416294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:05:33.259612 dv-cinder-851351-1-smb devstack@keystone.service[416293]: [pid: 416293|app: 0|req: 70/147] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 09:05:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 09:05:33.284705 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f0d3ad-0a81-4fd8-841f-a1260550bcf9 None None] Authenticating user token {{(pid=416293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:05:33.331299 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG dbcounter [-] [416294] Writing DB stats keystone:SELECT=100 {{(pid=416294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:05:33.382055 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb3b39b-3253-4ff2-af1e-8b3102e7ea73 None admin] Validating token access rules against request {{(pid=416294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:05:33.401774 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f0d3ad-0a81-4fd8-841f-a1260550bcf9 None None] Validating token access rules against request {{(pid=416293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:05:33.440042 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-325dfdaa-7c87-4e68-9abb-c11418a8099c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:05:33.441074 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325dfdaa-7c87-4e68-9abb-c11418a8099c None admin] REQUEST_METHOD: `GET` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:05:33.441514 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325dfdaa-7c87-4e68-9abb-c11418a8099c None admin] SCRIPT_NAME: `/identity` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:05:33.442080 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325dfdaa-7c87-4e68-9abb-c11418a8099c None admin] PATH_INFO: `/v3/roles/member` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:05:33.450908 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ca2643-b6a7-49f8-ac9d-6c93b3c50056 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:05:33.451912 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ca2643-b6a7-49f8-ac9d-6c93b3c50056 None admin] REQUEST_METHOD: `GET` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:05:33.452292 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ca2643-b6a7-49f8-ac9d-6c93b3c50056 None admin] SCRIPT_NAME: `/identity` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:05:33.452700 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ca2643-b6a7-49f8-ac9d-6c93b3c50056 None admin] PATH_INFO: `/v3/users/7ebed970bd644c1aa9e856d13f0bfa52` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:05:33.454077 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19ca2643-b6a7-49f8-ac9d-6c93b3c50056 None admin] RBAC: Authorizing `identity:get_user(user_id=7ebed970bd644c1aa9e856d13f0bfa52)` {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:05:33.455401 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-325dfdaa-7c87-4e68-9abb-c11418a8099c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 09:05:33.455725 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19ca2643-b6a7-49f8-ac9d-6c93b3c50056 None admin] RBAC: Authorization granted {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:05:33.464773 dv-cinder-851351-1-smb devstack@keystone.service[416294]: [pid: 416294|app: 0|req: 78/148] 10.222.0.42 () {56 vars in 1177 bytes} [Thu Jul 28 09:05:33 2022] GET /identity/v3/users/7ebed970bd644c1aa9e856d13f0bfa52 => generated 289 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:05:33.465535 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application [None req-325dfdaa-7c87-4e68-9abb-c11418a8099c None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 28 09:05:33.465535 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 09:05:33.465535 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 09:05:33.465535 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 09:05:33.465535 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 09:05:33.465535 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 09:05:33.465535 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 09:05:33.465535 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 09:05:33.465535 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 09:05:33.465535 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 09:05:33.465535 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 09:05:33.465535 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 09:05:33.465535 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 09:05:33.465535 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 09:05:33.465535 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 09:05:33.465535 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 09:05:33.466606 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 09:05:33.466606 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 09:05:33.466606 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 09:05:33.466606 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 09:05:33.466606 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 09:05:33.466606 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 09:05:33.466606 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 09:05:33.466606 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 09:05:33.466606 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 09:05:33.466606 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 09:05:33.466606 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 09:05:33.466606 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application with Lock( Jul 28 09:05:33.466606 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 09:05:33.466606 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self._enter() Jul 28 09:05:33.466606 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 09:05:33.466606 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 09:05:33.467547 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 09:05:33.467547 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self.creator() Jul 28 09:05:33.467547 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 09:05:33.467547 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application created_value = creator( Jul 28 09:05:33.467547 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 09:05:33.467547 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 09:05:33.467547 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 09:05:33.467547 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 09:05:33.467547 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 09:05:33.467547 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 09:05:33.467547 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 28 09:05:33.467547 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application Jul 28 09:05:33.470409 dv-cinder-851351-1-smb devstack@keystone.service[416293]: [pid: 416293|app: 0|req: 71/149] 10.222.0.42 () {56 vars in 1099 bytes} [Thu Jul 28 09:05:33 2022] GET /identity/v3/roles/member => generated 84 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 09:05:33.472449 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ca2643-b6a7-49f8-ac9d-6c93b3c50056 None admin] Authenticating user token {{(pid=416294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:05:33.477293 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-325dfdaa-7c87-4e68-9abb-c11418a8099c None admin] Authenticating user token {{(pid=416293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:05:33.526340 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG dbcounter [-] [416293] Writing DB stats keystone:SELECT=100 {{(pid=416293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:05:33.590754 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-325dfdaa-7c87-4e68-9abb-c11418a8099c None admin] Validating token access rules against request {{(pid=416293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:05:33.631239 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec0069e-0c3b-4c27-880c-6df193c26f6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:05:33.632252 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec0069e-0c3b-4c27-880c-6df193c26f6e None admin] REQUEST_METHOD: `GET` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:05:33.633067 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec0069e-0c3b-4c27-880c-6df193c26f6e None admin] SCRIPT_NAME: `/identity` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:05:33.633585 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec0069e-0c3b-4c27-880c-6df193c26f6e None admin] PATH_INFO: `/v3/roles` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:05:33.634521 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ec0069e-0c3b-4c27-880c-6df193c26f6e None admin] RBAC: Adding query filter params (name=member) {{(pid=416293) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 09:05:33.635027 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ec0069e-0c3b-4c27-880c-6df193c26f6e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:05:33.636901 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ec0069e-0c3b-4c27-880c-6df193c26f6e None admin] RBAC: Authorization granted {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:05:33.648374 dv-cinder-851351-1-smb devstack@keystone.service[416293]: [pid: 416293|app: 0|req: 72/150] 10.222.0.42 () {56 vars in 1101 bytes} [Thu Jul 28 09:05:33 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 09:05:33.655696 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ca2643-b6a7-49f8-ac9d-6c93b3c50056 None admin] Validating token access rules against request {{(pid=416294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:05:33.656952 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec0069e-0c3b-4c27-880c-6df193c26f6e None admin] Authenticating user token {{(pid=416293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:05:33.744297 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ba38fe-4039-458e-9380-7d207f77a5a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:05:33.744919 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ba38fe-4039-458e-9380-7d207f77a5a5 None admin] REQUEST_METHOD: `GET` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:05:33.745206 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ba38fe-4039-458e-9380-7d207f77a5a5 None admin] SCRIPT_NAME: `/identity` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:05:33.745487 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ba38fe-4039-458e-9380-7d207f77a5a5 None admin] PATH_INFO: `/v3/projects/c515ec4395fe420e9ab0ba34fb1ada8f` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:05:33.749940 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4ba38fe-4039-458e-9380-7d207f77a5a5 None admin] RBAC: Authorizing `identity:get_project(project_id=c515ec4395fe420e9ab0ba34fb1ada8f)` {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:05:33.749940 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4ba38fe-4039-458e-9380-7d207f77a5a5 None admin] RBAC: Authorization granted {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:05:33.750237 dv-cinder-851351-1-smb devstack@keystone.service[416294]: [pid: 416294|app: 0|req: 79/151] 10.222.0.42 () {56 vars in 1186 bytes} [Thu Jul 28 09:05:33 2022] GET /identity/v3/projects/c515ec4395fe420e9ab0ba34fb1ada8f => generated 298 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:05:33.761066 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ba38fe-4039-458e-9380-7d207f77a5a5 None admin] Authenticating user token {{(pid=416294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:05:33.774171 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG dbcounter [-] [416294] Writing DB stats keystone:SELECT=100 {{(pid=416294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:05:33.830754 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec0069e-0c3b-4c27-880c-6df193c26f6e None admin] Validating token access rules against request {{(pid=416293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:05:33.834088 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG dbcounter [-] [416293] Writing DB stats keystone:SELECT=100 {{(pid=416293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:05:33.956398 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ba38fe-4039-458e-9380-7d207f77a5a5 None admin] Validating token access rules against request {{(pid=416294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:05:33.966446 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e093bb7-37cf-4682-a892-f78719b04b53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:05:33.967472 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e093bb7-37cf-4682-a892-f78719b04b53 None admin] REQUEST_METHOD: `GET` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:05:33.967954 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e093bb7-37cf-4682-a892-f78719b04b53 None admin] SCRIPT_NAME: `/identity` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:05:33.968426 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e093bb7-37cf-4682-a892-f78719b04b53 None admin] PATH_INFO: `/v3/users/d8807d513cea475c9faa3106083edd8a` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:05:33.969908 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e093bb7-37cf-4682-a892-f78719b04b53 None admin] RBAC: Authorizing `identity:get_user(user_id=d8807d513cea475c9faa3106083edd8a)` {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:05:33.971644 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e093bb7-37cf-4682-a892-f78719b04b53 None admin] RBAC: Authorization granted {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:05:33.973648 dv-cinder-851351-1-smb devstack@keystone.service[416293]: [pid: 416293|app: 0|req: 73/152] 10.222.0.42 () {56 vars in 1177 bytes} [Thu Jul 28 09:05:33 2022] GET /identity/v3/users/d8807d513cea475c9faa3106083edd8a => generated 275 bytes in 317 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:05:33.985193 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e093bb7-37cf-4682-a892-f78719b04b53 None admin] Authenticating user token {{(pid=416293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:05:34.028175 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160de327-01af-43c5-8b67-ea0137571784 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:05:34.028944 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160de327-01af-43c5-8b67-ea0137571784 None admin] REQUEST_METHOD: `PUT` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:05:34.029235 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160de327-01af-43c5-8b67-ea0137571784 None admin] SCRIPT_NAME: `/identity` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:05:34.029522 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160de327-01af-43c5-8b67-ea0137571784 None admin] PATH_INFO: `/v3/projects/c515ec4395fe420e9ab0ba34fb1ada8f/users/7ebed970bd644c1aa9e856d13f0bfa52/roles/071325426dc84e2cb2689d138bc2b032` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:05:34.034718 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-160de327-01af-43c5-8b67-ea0137571784 None admin] RBAC: Authorizing `identity:create_grant(project_id=c515ec4395fe420e9ab0ba34fb1ada8f, user_id=7ebed970bd644c1aa9e856d13f0bfa52, role_id=071325426dc84e2cb2689d138bc2b032)` {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:05:34.036214 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-160de327-01af-43c5-8b67-ea0137571784 None admin] RBAC: Authorization granted {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:05:34.067043 dv-cinder-851351-1-smb devstack@keystone.service[416294]: [pid: 416294|app: 0|req: 80/153] 10.222.0.42 () {58 vars in 1439 bytes} [Thu Jul 28 09:05:33 2022] PUT /identity/v3/projects/c515ec4395fe420e9ab0ba34fb1ada8f/users/7ebed970bd644c1aa9e856d13f0bfa52/roles/071325426dc84e2cb2689d138bc2b032 => generated 0 bytes in 306 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 09:05:34.152047 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e093bb7-37cf-4682-a892-f78719b04b53 None admin] Validating token access rules against request {{(pid=416293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:05:34.190047 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7e9ad8-8699-4e36-9cdb-716a5f458912 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:05:34.190741 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7e9ad8-8699-4e36-9cdb-716a5f458912 None admin] REQUEST_METHOD: `GET` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:05:34.191028 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7e9ad8-8699-4e36-9cdb-716a5f458912 None admin] SCRIPT_NAME: `/identity` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:05:34.191303 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7e9ad8-8699-4e36-9cdb-716a5f458912 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:05:34.247565 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG dbcounter [-] [416293] Writing DB stats keystone:SELECT=100 {{(pid=416293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:05:34.283639 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de7e9ad8-8699-4e36-9cdb-716a5f458912 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:05:34.285123 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de7e9ad8-8699-4e36-9cdb-716a5f458912 None admin] RBAC: Authorization granted {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:05:34.415771 dv-cinder-851351-1-smb devstack@keystone.service[416293]: [pid: 416293|app: 0|req: 74/154] 10.222.0.42 () {58 vars in 1282 bytes} [Thu Jul 28 09:05:33 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 431 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 28 09:05:34.422009 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160de327-01af-43c5-8b67-ea0137571784 None admin] Authenticating user token {{(pid=416294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:05:34.519034 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG dbcounter [-] [416294] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=416294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:05:34.569050 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160de327-01af-43c5-8b67-ea0137571784 None admin] Validating token access rules against request {{(pid=416294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:05:34.605683 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-956f1693-b66b-47b9-8298-45339b238e08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:05:34.606359 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956f1693-b66b-47b9-8298-45339b238e08 None admin] REQUEST_METHOD: `GET` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:05:34.606646 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956f1693-b66b-47b9-8298-45339b238e08 None admin] SCRIPT_NAME: `/identity` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:05:34.606926 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956f1693-b66b-47b9-8298-45339b238e08 None admin] PATH_INFO: `/v3/projects/c515ec4395fe420e9ab0ba34fb1ada8f` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:05:34.609392 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-956f1693-b66b-47b9-8298-45339b238e08 None admin] RBAC: Authorizing `identity:get_project(project_id=c515ec4395fe420e9ab0ba34fb1ada8f)` {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:05:34.610877 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-956f1693-b66b-47b9-8298-45339b238e08 None admin] RBAC: Authorization granted {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:05:34.612637 dv-cinder-851351-1-smb devstack@keystone.service[416294]: [pid: 416294|app: 0|req: 81/155] 10.222.0.42 () {56 vars in 1186 bytes} [Thu Jul 28 09:05:34 2022] GET /identity/v3/projects/c515ec4395fe420e9ab0ba34fb1ada8f => generated 298 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:05:34.618844 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7e9ad8-8699-4e36-9cdb-716a5f458912 None admin] Authenticating user token {{(pid=416293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:05:34.723333 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG dbcounter [-] [416293] Writing DB stats keystone:SELECT=100 {{(pid=416293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:05:34.762490 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7e9ad8-8699-4e36-9cdb-716a5f458912 None admin] Validating token access rules against request {{(pid=416293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:05:34.811927 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce71469c-5312-4967-9fe0-51b0fe80f82a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:05:34.812583 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce71469c-5312-4967-9fe0-51b0fe80f82a None admin] REQUEST_METHOD: `GET` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:05:34.812911 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce71469c-5312-4967-9fe0-51b0fe80f82a None admin] SCRIPT_NAME: `/identity` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:05:34.813190 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce71469c-5312-4967-9fe0-51b0fe80f82a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:05:34.814003 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce71469c-5312-4967-9fe0-51b0fe80f82a None admin] RBAC: Adding query filter params (role.id=ba1a79dc27074d5a94dce2d994019d37, scope.project.id=c515ec4395fe420e9ab0ba34fb1ada8f, user.id=d8807d513cea475c9faa3106083edd8a) {{(pid=416293) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 09:05:34.814318 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce71469c-5312-4967-9fe0-51b0fe80f82a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:05:34.815864 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce71469c-5312-4967-9fe0-51b0fe80f82a None admin] RBAC: Authorization granted {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:05:34.827006 dv-cinder-851351-1-smb devstack@keystone.service[416293]: [pid: 416293|app: 0|req: 75/156] 10.222.0.42 () {56 vars in 1374 bytes} [Thu Jul 28 09:05:34 2022] GET /identity/v3/role_assignments?user.id=d8807d513cea475c9faa3106083edd8a&scope.project.id=c515ec4395fe420e9ab0ba34fb1ada8f&role.id=ba1a79dc27074d5a94dce2d994019d37 => generated 608 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:05:34.855878 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ab91f9-b4b3-436c-9723-1644fb974cbf None None] REQUEST_METHOD: `GET` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:05:34.856220 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ab91f9-b4b3-436c-9723-1644fb974cbf None None] SCRIPT_NAME: `/identity` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:05:34.856447 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ab91f9-b4b3-436c-9723-1644fb974cbf None None] PATH_INFO: `/` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:05:34.858041 dv-cinder-851351-1-smb devstack@keystone.service[416294]: [pid: 416294|app: 0|req: 82/157] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 09:05:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 09:05:34.863547 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a95b4f6-3ba9-4145-878a-36299659a484 None None] REQUEST_METHOD: `POST` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:05:34.863845 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a95b4f6-3ba9-4145-878a-36299659a484 None None] SCRIPT_NAME: `/identity` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:05:34.864132 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a95b4f6-3ba9-4145-878a-36299659a484 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:05:34.894103 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.auth.core [None req-4a95b4f6-3ba9-4145-878a-36299659a484 None None] MFA Rules not processed for user `dbf87abab90e4fdf9e75408f4199918e`. Rule list: `[]` (Enabled: `True`). {{(pid=416293) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 09:05:34.895389 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.fernet_utils [None req-4a95b4f6-3ba9-4145-878a-36299659a484 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=416293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 09:05:34.988179 dv-cinder-851351-1-smb devstack@keystone.service[416293]: [pid: 416293|app: 0|req: 76/158] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 09:05:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 28 09:05:35.023355 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ab91f9-b4b3-436c-9723-1644fb974cbf None None] Authenticating user token {{(pid=416294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:05:35.102010 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f060a901-5f21-409f-a5c3-f9774c0927ab None None] REQUEST_METHOD: `GET` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:05:35.102211 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f060a901-5f21-409f-a5c3-f9774c0927ab None None] SCRIPT_NAME: `/identity` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:05:35.102476 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f060a901-5f21-409f-a5c3-f9774c0927ab None None] PATH_INFO: `/` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:05:35.103899 dv-cinder-851351-1-smb devstack@keystone.service[416293]: [pid: 416293|app: 0|req: 77/159] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 09:05:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 09:05:35.110006 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3924b17-bb39-47d6-9d5e-928ad4b8bee3 None None] REQUEST_METHOD: `POST` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:05:35.110310 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3924b17-bb39-47d6-9d5e-928ad4b8bee3 None None] SCRIPT_NAME: `/identity` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:05:35.110587 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3924b17-bb39-47d6-9d5e-928ad4b8bee3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:05:35.140235 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.auth.core [None req-f3924b17-bb39-47d6-9d5e-928ad4b8bee3 None None] MFA Rules not processed for user `dbf87abab90e4fdf9e75408f4199918e`. Rule list: `[]` (Enabled: `True`). {{(pid=416293) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 09:05:35.141533 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.fernet_utils [None req-f3924b17-bb39-47d6-9d5e-928ad4b8bee3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=416293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 09:05:35.183884 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ab91f9-b4b3-436c-9723-1644fb974cbf None None] Validating token access rules against request {{(pid=416294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:05:35.232946 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG dbcounter [-] [416294] Writing DB stats keystone:SELECT=100 {{(pid=416294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:05:35.245073 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aab2625-e432-457a-9304-dcdc4f4bb761 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:05:35.245760 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aab2625-e432-457a-9304-dcdc4f4bb761 None admin] REQUEST_METHOD: `GET` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:05:35.246046 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aab2625-e432-457a-9304-dcdc4f4bb761 None admin] SCRIPT_NAME: `/identity` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:05:35.246326 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aab2625-e432-457a-9304-dcdc4f4bb761 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:05:35.270928 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aab2625-e432-457a-9304-dcdc4f4bb761 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 09:05:35.277763 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG dbcounter [-] [416293] Writing DB stats keystone:SELECT=100 {{(pid=416293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:05:35.280211 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application [None req-9aab2625-e432-457a-9304-dcdc4f4bb761 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 09:05:35.280211 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 09:05:35.280211 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 09:05:35.280211 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 09:05:35.280211 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 09:05:35.280211 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 09:05:35.280211 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 09:05:35.280211 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 09:05:35.280211 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 09:05:35.280211 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 09:05:35.280211 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 09:05:35.280211 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 09:05:35.280211 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 09:05:35.280211 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 09:05:35.280211 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 09:05:35.280211 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 09:05:35.281490 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 09:05:35.281490 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 09:05:35.281490 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 09:05:35.281490 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 09:05:35.281490 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 09:05:35.281490 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 09:05:35.281490 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 09:05:35.281490 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 09:05:35.281490 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 09:05:35.281490 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 09:05:35.281490 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 09:05:35.281490 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application with Lock( Jul 28 09:05:35.281490 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 09:05:35.281490 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return self._enter() Jul 28 09:05:35.281490 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 09:05:35.281490 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 09:05:35.282516 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 09:05:35.282516 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return self.creator() Jul 28 09:05:35.282516 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 09:05:35.282516 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application created_value = creator( Jul 28 09:05:35.282516 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 09:05:35.282516 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 09:05:35.282516 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 09:05:35.282516 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 09:05:35.282516 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 09:05:35.282516 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 09:05:35.282516 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 09:05:35.282516 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application Jul 28 09:05:35.284929 dv-cinder-851351-1-smb devstack@keystone.service[416294]: [pid: 416294|app: 0|req: 83/160] 10.222.0.42 () {56 vars in 1096 bytes} [Thu Jul 28 09:05:35 2022] GET /identity/v3/roles/admin => generated 83 bytes in 262 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 09:05:35.291778 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aab2625-e432-457a-9304-dcdc4f4bb761 None admin] Authenticating user token {{(pid=416294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:05:35.292687 dv-cinder-851351-1-smb devstack@keystone.service[416293]: [pid: 416293|app: 0|req: 78/161] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 09:05:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 09:05:35.330226 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3924b17-bb39-47d6-9d5e-928ad4b8bee3 None None] Authenticating user token {{(pid=416293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:05:35.414979 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aab2625-e432-457a-9304-dcdc4f4bb761 None admin] Validating token access rules against request {{(pid=416294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:05:35.454924 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0218bf5-f2a2-4db5-9ea5-ab20b3a1ec95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:05:35.455859 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0218bf5-f2a2-4db5-9ea5-ab20b3a1ec95 None admin] REQUEST_METHOD: `GET` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:05:35.456348 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0218bf5-f2a2-4db5-9ea5-ab20b3a1ec95 None admin] SCRIPT_NAME: `/identity` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:05:35.456823 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0218bf5-f2a2-4db5-9ea5-ab20b3a1ec95 None admin] PATH_INFO: `/v3/roles` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:05:35.457746 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0218bf5-f2a2-4db5-9ea5-ab20b3a1ec95 None admin] RBAC: Adding query filter params (name=admin) {{(pid=416294) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 09:05:35.458221 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0218bf5-f2a2-4db5-9ea5-ab20b3a1ec95 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:05:35.459813 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0218bf5-f2a2-4db5-9ea5-ab20b3a1ec95 None admin] RBAC: Authorization granted {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:05:35.469332 dv-cinder-851351-1-smb devstack@keystone.service[416294]: [pid: 416294|app: 0|req: 84/162] 10.222.0.42 () {56 vars in 1099 bytes} [Thu Jul 28 09:05:35 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 09:05:35.476600 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0218bf5-f2a2-4db5-9ea5-ab20b3a1ec95 None admin] Authenticating user token {{(pid=416294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:05:35.550694 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3924b17-bb39-47d6-9d5e-928ad4b8bee3 None None] Validating token access rules against request {{(pid=416293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:05:35.586299 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG dbcounter [-] [416294] Writing DB stats keystone:SELECT=100 {{(pid=416294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:05:35.626117 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12138637-dd8e-4f6b-99a5-470a80e73ce9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:05:35.627123 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12138637-dd8e-4f6b-99a5-470a80e73ce9 None admin] REQUEST_METHOD: `GET` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:05:35.627608 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12138637-dd8e-4f6b-99a5-470a80e73ce9 None admin] SCRIPT_NAME: `/identity` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:05:35.628070 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12138637-dd8e-4f6b-99a5-470a80e73ce9 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:05:35.654226 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12138637-dd8e-4f6b-99a5-470a80e73ce9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 09:05:35.658716 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application [None req-12138637-dd8e-4f6b-99a5-470a80e73ce9 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 28 09:05:35.658716 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 09:05:35.658716 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 09:05:35.658716 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 09:05:35.658716 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 09:05:35.658716 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 09:05:35.658716 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 09:05:35.658716 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 09:05:35.658716 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 09:05:35.658716 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 09:05:35.658716 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 09:05:35.658716 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 09:05:35.658716 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 09:05:35.658716 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 09:05:35.658716 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 09:05:35.658716 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 09:05:35.659747 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 09:05:35.659747 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 09:05:35.659747 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 09:05:35.659747 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 09:05:35.659747 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 09:05:35.659747 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 09:05:35.659747 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 09:05:35.659747 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 09:05:35.659747 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 09:05:35.659747 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 09:05:35.659747 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 09:05:35.659747 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application with Lock( Jul 28 09:05:35.659747 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 09:05:35.659747 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self._enter() Jul 28 09:05:35.659747 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 09:05:35.659747 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 09:05:35.660601 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 09:05:35.660601 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self.creator() Jul 28 09:05:35.660601 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 09:05:35.660601 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application created_value = creator( Jul 28 09:05:35.660601 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 09:05:35.660601 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 09:05:35.660601 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 09:05:35.660601 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 09:05:35.660601 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 09:05:35.660601 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 09:05:35.660601 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 28 09:05:35.660601 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application Jul 28 09:05:35.660601 dv-cinder-851351-1-smb devstack@keystone.service[416293]: [pid: 416293|app: 0|req: 79/163] 10.222.0.42 () {56 vars in 1114 bytes} [Thu Jul 28 09:05:35 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 331 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 09:05:35.662811 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0218bf5-f2a2-4db5-9ea5-ab20b3a1ec95 None admin] Validating token access rules against request {{(pid=416294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:05:35.666510 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12138637-dd8e-4f6b-99a5-470a80e73ce9 None admin] Authenticating user token {{(pid=416293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:05:35.705006 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae39d4b4-b72c-4ec8-85d7-4046464c861e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:05:35.706050 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae39d4b4-b72c-4ec8-85d7-4046464c861e None admin] REQUEST_METHOD: `GET` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:05:35.706612 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae39d4b4-b72c-4ec8-85d7-4046464c861e None admin] SCRIPT_NAME: `/identity` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:05:35.707119 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae39d4b4-b72c-4ec8-85d7-4046464c861e None admin] PATH_INFO: `/v3/users/dbf87abab90e4fdf9e75408f4199918e` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:05:35.708587 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae39d4b4-b72c-4ec8-85d7-4046464c861e None admin] RBAC: Authorizing `identity:get_user(user_id=dbf87abab90e4fdf9e75408f4199918e)` {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:05:35.710316 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae39d4b4-b72c-4ec8-85d7-4046464c861e None admin] RBAC: Authorization granted {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:05:35.712203 dv-cinder-851351-1-smb devstack@keystone.service[416294]: [pid: 416294|app: 0|req: 85/164] 10.222.0.42 () {56 vars in 1177 bytes} [Thu Jul 28 09:05:35 2022] GET /identity/v3/users/dbf87abab90e4fdf9e75408f4199918e => generated 247 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 09:05:35.718459 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae39d4b4-b72c-4ec8-85d7-4046464c861e None admin] Authenticating user token {{(pid=416294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:05:35.829031 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG dbcounter [-] [416293] Writing DB stats keystone:SELECT=100 {{(pid=416293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:05:35.864355 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae39d4b4-b72c-4ec8-85d7-4046464c861e None admin] Validating token access rules against request {{(pid=416294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:05:35.889868 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG dbcounter [-] [416294] Writing DB stats keystone:SELECT=100 {{(pid=416294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:05:35.904542 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28f6bbc-51d5-4d79-afd8-8f5fca810e40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:05:35.905640 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28f6bbc-51d5-4d79-afd8-8f5fca810e40 None admin] REQUEST_METHOD: `GET` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:05:35.906168 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28f6bbc-51d5-4d79-afd8-8f5fca810e40 None admin] SCRIPT_NAME: `/identity` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:05:35.906666 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28f6bbc-51d5-4d79-afd8-8f5fca810e40 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:05:35.958847 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12138637-dd8e-4f6b-99a5-470a80e73ce9 None admin] Validating token access rules against request {{(pid=416293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:05:36.020370 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d28f6bbc-51d5-4d79-afd8-8f5fca810e40 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:05:36.022503 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d28f6bbc-51d5-4d79-afd8-8f5fca810e40 None admin] RBAC: Authorization granted {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:05:36.037438 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09edaeb8-2d9e-4088-adf2-69fa90429cd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:05:36.038098 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09edaeb8-2d9e-4088-adf2-69fa90429cd0 None admin] REQUEST_METHOD: `GET` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:05:36.038382 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09edaeb8-2d9e-4088-adf2-69fa90429cd0 None admin] SCRIPT_NAME: `/identity` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:05:36.038658 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09edaeb8-2d9e-4088-adf2-69fa90429cd0 None admin] PATH_INFO: `/v3/roles` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:05:36.039412 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09edaeb8-2d9e-4088-adf2-69fa90429cd0 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=416293) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 09:05:36.039720 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09edaeb8-2d9e-4088-adf2-69fa90429cd0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:05:36.041212 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09edaeb8-2d9e-4088-adf2-69fa90429cd0 None admin] RBAC: Authorization granted {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:05:36.055810 dv-cinder-851351-1-smb devstack@keystone.service[416293]: [pid: 416293|app: 0|req: 80/165] 10.222.0.42 () {56 vars in 1111 bytes} [Thu Jul 28 09:05:35 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 390 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 09:05:36.063086 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09edaeb8-2d9e-4088-adf2-69fa90429cd0 None admin] Authenticating user token {{(pid=416293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:05:36.243080 dv-cinder-851351-1-smb devstack@keystone.service[416294]: [pid: 416294|app: 0|req: 86/166] 10.222.0.42 () {58 vars in 1282 bytes} [Thu Jul 28 09:05:35 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 525 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 28 09:05:36.248629 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28f6bbc-51d5-4d79-afd8-8f5fca810e40 None admin] Authenticating user token {{(pid=416294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:05:36.255569 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09edaeb8-2d9e-4088-adf2-69fa90429cd0 None admin] Validating token access rules against request {{(pid=416293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:05:36.297360 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG dbcounter [-] [416293] Writing DB stats keystone:SELECT=100 {{(pid=416293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:05:36.298477 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG dbcounter [-] [416294] Writing DB stats keystone:SELECT=100 {{(pid=416294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:05:36.366154 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97befe73-b3ec-447c-930c-29ebd93aedee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:05:36.367106 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97befe73-b3ec-447c-930c-29ebd93aedee None admin] REQUEST_METHOD: `GET` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:05:36.367564 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97befe73-b3ec-447c-930c-29ebd93aedee None admin] SCRIPT_NAME: `/identity` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:05:36.368001 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97befe73-b3ec-447c-930c-29ebd93aedee None admin] PATH_INFO: `/v3/users/d8807d513cea475c9faa3106083edd8a` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:05:36.369408 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97befe73-b3ec-447c-930c-29ebd93aedee None admin] RBAC: Authorizing `identity:get_user(user_id=d8807d513cea475c9faa3106083edd8a)` {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:05:36.371055 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97befe73-b3ec-447c-930c-29ebd93aedee None admin] RBAC: Authorization granted {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:05:36.373318 dv-cinder-851351-1-smb devstack@keystone.service[416293]: [pid: 416293|app: 0|req: 81/167] 10.222.0.42 () {56 vars in 1177 bytes} [Thu Jul 28 09:05:36 2022] GET /identity/v3/users/d8807d513cea475c9faa3106083edd8a => generated 275 bytes in 311 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 09:05:36.379997 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97befe73-b3ec-447c-930c-29ebd93aedee None admin] Authenticating user token {{(pid=416293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:05:36.482976 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28f6bbc-51d5-4d79-afd8-8f5fca810e40 None admin] Validating token access rules against request {{(pid=416294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:05:36.548423 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97befe73-b3ec-447c-930c-29ebd93aedee None admin] Validating token access rules against request {{(pid=416293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:05:36.568517 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc02de8-e11d-40fd-af00-a04e858e4eff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:05:36.569449 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc02de8-e11d-40fd-af00-a04e858e4eff None admin] REQUEST_METHOD: `GET` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:05:36.569904 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc02de8-e11d-40fd-af00-a04e858e4eff None admin] SCRIPT_NAME: `/identity` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:05:36.571080 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc02de8-e11d-40fd-af00-a04e858e4eff None admin] PATH_INFO: `/v3/projects/c515ec4395fe420e9ab0ba34fb1ada8f` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:05:36.574173 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccc02de8-e11d-40fd-af00-a04e858e4eff None admin] RBAC: Authorizing `identity:get_project(project_id=c515ec4395fe420e9ab0ba34fb1ada8f)` {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:05:36.576251 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccc02de8-e11d-40fd-af00-a04e858e4eff None admin] RBAC: Authorization granted {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:05:36.580218 dv-cinder-851351-1-smb devstack@keystone.service[416294]: [pid: 416294|app: 0|req: 87/168] 10.222.0.42 () {56 vars in 1186 bytes} [Thu Jul 28 09:05:36 2022] GET /identity/v3/projects/c515ec4395fe420e9ab0ba34fb1ada8f => generated 298 bytes in 332 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 09:05:36.587205 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e7447f-ae4d-40ca-8142-2d648c4d2b30 None None] REQUEST_METHOD: `GET` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:05:36.588529 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e7447f-ae4d-40ca-8142-2d648c4d2b30 None None] SCRIPT_NAME: `/identity` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:05:36.591861 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e7447f-ae4d-40ca-8142-2d648c4d2b30 None None] PATH_INFO: `/` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:05:36.593573 dv-cinder-851351-1-smb devstack@keystone.service[416294]: [pid: 416294|app: 0|req: 88/169] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 09:05:36 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 09:05:36.600575 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e7447f-ae4d-40ca-8142-2d648c4d2b30 None None] Authenticating user token {{(pid=416294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:05:36.630717 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34405cb8-7636-445c-97a3-5fd4bc549174 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:05:36.631664 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34405cb8-7636-445c-97a3-5fd4bc549174 None admin] REQUEST_METHOD: `GET` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:05:36.632152 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34405cb8-7636-445c-97a3-5fd4bc549174 None admin] SCRIPT_NAME: `/identity` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:05:36.632588 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34405cb8-7636-445c-97a3-5fd4bc549174 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:05:36.745360 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG dbcounter [-] [416293] Writing DB stats keystone:SELECT=100 {{(pid=416293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:05:36.773470 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34405cb8-7636-445c-97a3-5fd4bc549174 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:05:36.775351 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34405cb8-7636-445c-97a3-5fd4bc549174 None admin] RBAC: Authorization granted {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:05:36.785016 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG dbcounter [-] [416294] Writing DB stats keystone:SELECT=100 {{(pid=416294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:05:36.806247 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e7447f-ae4d-40ca-8142-2d648c4d2b30 None None] Validating token access rules against request {{(pid=416294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:05:36.876398 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558da71e-3e15-4eec-b194-5d0a8b2d6f01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:05:36.877081 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558da71e-3e15-4eec-b194-5d0a8b2d6f01 None admin] REQUEST_METHOD: `GET` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:05:36.877362 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558da71e-3e15-4eec-b194-5d0a8b2d6f01 None admin] SCRIPT_NAME: `/identity` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:05:36.877637 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558da71e-3e15-4eec-b194-5d0a8b2d6f01 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:05:36.878533 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-558da71e-3e15-4eec-b194-5d0a8b2d6f01 None admin] RBAC: Adding query filter params (role.id=c67085ec338243df8f9b7d6459036e23, scope.project.id=c515ec4395fe420e9ab0ba34fb1ada8f, user.id=dbf87abab90e4fdf9e75408f4199918e) {{(pid=416294) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 09:05:36.878842 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-558da71e-3e15-4eec-b194-5d0a8b2d6f01 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:05:36.881247 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-558da71e-3e15-4eec-b194-5d0a8b2d6f01 None admin] RBAC: Authorization granted {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:05:36.894792 dv-cinder-851351-1-smb devstack@keystone.service[416294]: [pid: 416294|app: 0|req: 89/170] 10.222.0.42 () {56 vars in 1374 bytes} [Thu Jul 28 09:05:36 2022] GET /identity/v3/role_assignments?user.id=dbf87abab90e4fdf9e75408f4199918e&scope.project.id=c515ec4395fe420e9ab0ba34fb1ada8f&role.id=c67085ec338243df8f9b7d6459036e23 => generated 608 bytes in 294 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:05:36.896140 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a2d48a-049a-46dc-81a7-db6d37dbcbb8 None None] REQUEST_METHOD: `POST` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:05:36.896433 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a2d48a-049a-46dc-81a7-db6d37dbcbb8 None None] SCRIPT_NAME: `/identity` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:05:36.896728 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a2d48a-049a-46dc-81a7-db6d37dbcbb8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:05:36.939216 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.auth.core [None req-56a2d48a-049a-46dc-81a7-db6d37dbcbb8 None None] MFA Rules not processed for user `dbf87abab90e4fdf9e75408f4199918e`. Rule list: `[]` (Enabled: `True`). {{(pid=416294) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 09:05:36.940435 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.fernet_utils [None req-56a2d48a-049a-46dc-81a7-db6d37dbcbb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=416294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 09:05:36.983742 dv-cinder-851351-1-smb devstack@keystone.service[416293]: [pid: 416293|app: 0|req: 82/171] 10.222.0.42 () {58 vars in 1282 bytes} [Thu Jul 28 09:05:36 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 604 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 28 09:05:36.993009 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34405cb8-7636-445c-97a3-5fd4bc549174 None admin] Authenticating user token {{(pid=416293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:05:37.103934 dv-cinder-851351-1-smb devstack@keystone.service[416294]: [pid: 416294|app: 0|req: 90/172] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 09:05:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 09:05:37.137120 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG dbcounter [-] [416293] Writing DB stats keystone:SELECT=100 {{(pid=416293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:05:37.144192 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34405cb8-7636-445c-97a3-5fd4bc549174 None admin] Validating token access rules against request {{(pid=416293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:05:37.149481 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a2d48a-049a-46dc-81a7-db6d37dbcbb8 None None] Authenticating user token {{(pid=416294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:05:37.246462 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e69b5d6-c6e0-47fe-9452-3d857336731c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:05:37.247171 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e69b5d6-c6e0-47fe-9452-3d857336731c None admin] REQUEST_METHOD: `GET` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:05:37.247538 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e69b5d6-c6e0-47fe-9452-3d857336731c None admin] SCRIPT_NAME: `/identity` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:05:37.247839 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e69b5d6-c6e0-47fe-9452-3d857336731c None admin] PATH_INFO: `/v3/projects/c515ec4395fe420e9ab0ba34fb1ada8f` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:05:37.249082 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e69b5d6-c6e0-47fe-9452-3d857336731c None admin] RBAC: Authorizing `identity:get_project(project_id=c515ec4395fe420e9ab0ba34fb1ada8f)` {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:05:37.250715 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e69b5d6-c6e0-47fe-9452-3d857336731c None admin] RBAC: Authorization granted {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:05:37.252889 dv-cinder-851351-1-smb devstack@keystone.service[416293]: [pid: 416293|app: 0|req: 83/173] 10.222.0.42 () {56 vars in 1186 bytes} [Thu Jul 28 09:05:36 2022] GET /identity/v3/projects/c515ec4395fe420e9ab0ba34fb1ada8f => generated 298 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 09:05:37.271326 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e69b5d6-c6e0-47fe-9452-3d857336731c None admin] Authenticating user token {{(pid=416293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:05:37.306930 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG dbcounter [-] [416294] Writing DB stats keystone:SELECT=100 {{(pid=416294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:05:37.325826 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a2d48a-049a-46dc-81a7-db6d37dbcbb8 None None] Validating token access rules against request {{(pid=416294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:05:37.366228 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c9fc99-cce8-4acb-8ffe-0b4e501a4e24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:05:37.366819 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c9fc99-cce8-4acb-8ffe-0b4e501a4e24 None admin] REQUEST_METHOD: `GET` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:05:37.367100 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c9fc99-cce8-4acb-8ffe-0b4e501a4e24 None admin] SCRIPT_NAME: `/identity` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:05:37.367375 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c9fc99-cce8-4acb-8ffe-0b4e501a4e24 None admin] PATH_INFO: `/v3/roles/member` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:05:37.380881 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77c9fc99-cce8-4acb-8ffe-0b4e501a4e24 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 09:05:37.389605 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application [None req-77c9fc99-cce8-4acb-8ffe-0b4e501a4e24 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 28 09:05:37.389605 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 09:05:37.389605 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 09:05:37.389605 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 09:05:37.389605 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 09:05:37.389605 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 09:05:37.389605 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 09:05:37.389605 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 09:05:37.389605 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 09:05:37.389605 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 09:05:37.389605 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 09:05:37.389605 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 09:05:37.389605 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 09:05:37.389605 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 09:05:37.389605 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 09:05:37.389605 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 09:05:37.390838 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 09:05:37.390838 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 09:05:37.390838 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 09:05:37.390838 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 09:05:37.390838 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 09:05:37.390838 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 09:05:37.390838 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 09:05:37.390838 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 09:05:37.390838 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 09:05:37.390838 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 09:05:37.390838 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 09:05:37.390838 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application with Lock( Jul 28 09:05:37.390838 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 09:05:37.390838 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return self._enter() Jul 28 09:05:37.390838 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 09:05:37.390838 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 09:05:37.391850 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 09:05:37.391850 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return self.creator() Jul 28 09:05:37.391850 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 09:05:37.391850 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application created_value = creator( Jul 28 09:05:37.391850 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 09:05:37.391850 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 09:05:37.391850 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 09:05:37.391850 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 09:05:37.391850 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 09:05:37.391850 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 09:05:37.391850 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 28 09:05:37.391850 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application Jul 28 09:05:37.391850 dv-cinder-851351-1-smb devstack@keystone.service[416294]: [pid: 416294|app: 0|req: 91/174] 10.222.0.42 () {56 vars in 1099 bytes} [Thu Jul 28 09:05:37 2022] GET /identity/v3/roles/member => generated 84 bytes in 242 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 09:05:37.392745 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c611305c-778a-4d38-82de-d1ac6ddc3532 None None] REQUEST_METHOD: `GET` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:05:37.392745 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c611305c-778a-4d38-82de-d1ac6ddc3532 None None] SCRIPT_NAME: `/identity` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:05:37.392745 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c611305c-778a-4d38-82de-d1ac6ddc3532 None None] PATH_INFO: `/` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:05:37.398555 dv-cinder-851351-1-smb devstack@keystone.service[416294]: [pid: 416294|app: 0|req: 92/175] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 09:05:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 09:05:37.398555 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a286b021-28a0-4819-a559-ae04c279f331 None None] REQUEST_METHOD: `GET` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:05:37.398555 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a286b021-28a0-4819-a559-ae04c279f331 None None] SCRIPT_NAME: `/identity` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:05:37.398555 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a286b021-28a0-4819-a559-ae04c279f331 None None] PATH_INFO: `/` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:05:37.398555 dv-cinder-851351-1-smb devstack@keystone.service[416294]: [pid: 416294|app: 0|req: 93/176] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 09:05:37 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 09:05:37.402238 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a286b021-28a0-4819-a559-ae04c279f331 None None] Authenticating user token {{(pid=416294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:05:37.458199 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e69b5d6-c6e0-47fe-9452-3d857336731c None admin] Validating token access rules against request {{(pid=416293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:05:37.501507 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f00213f-3bf9-4967-95dc-9a901508ee29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:05:37.502254 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f00213f-3bf9-4967-95dc-9a901508ee29 None admin] REQUEST_METHOD: `GET` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:05:37.502604 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f00213f-3bf9-4967-95dc-9a901508ee29 None admin] SCRIPT_NAME: `/identity` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:05:37.503361 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f00213f-3bf9-4967-95dc-9a901508ee29 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:05:37.503861 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f00213f-3bf9-4967-95dc-9a901508ee29 None admin] RBAC: Adding query filter params (role.id=6194848862704a289bbaa3fda43a9050, scope.project.id=c515ec4395fe420e9ab0ba34fb1ada8f, user.id=d8807d513cea475c9faa3106083edd8a) {{(pid=416293) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 09:05:37.504176 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f00213f-3bf9-4967-95dc-9a901508ee29 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:05:37.505681 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f00213f-3bf9-4967-95dc-9a901508ee29 None admin] RBAC: Authorization granted {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:05:37.511990 dv-cinder-851351-1-smb devstack@keystone.service[416293]: [pid: 416293|app: 0|req: 84/177] 10.222.0.42 () {56 vars in 1374 bytes} [Thu Jul 28 09:05:37 2022] GET /identity/v3/role_assignments?user.id=d8807d513cea475c9faa3106083edd8a&scope.project.id=c515ec4395fe420e9ab0ba34fb1ada8f&role.id=6194848862704a289bbaa3fda43a9050 => generated 608 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 09:05:37.522167 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b6d477-0712-4687-ab7c-84c019cc1cdd None None] REQUEST_METHOD: `POST` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:05:37.522495 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b6d477-0712-4687-ab7c-84c019cc1cdd None None] SCRIPT_NAME: `/identity` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:05:37.522728 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b6d477-0712-4687-ab7c-84c019cc1cdd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:05:37.539739 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a286b021-28a0-4819-a559-ae04c279f331 None None] Validating token access rules against request {{(pid=416294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:05:37.542933 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.auth.core [None req-25b6d477-0712-4687-ab7c-84c019cc1cdd None None] MFA Rules not processed for user `dbf87abab90e4fdf9e75408f4199918e`. Rule list: `[]` (Enabled: `True`). {{(pid=416293) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 09:05:37.544547 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.fernet_utils [None req-25b6d477-0712-4687-ab7c-84c019cc1cdd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=416293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 09:05:37.560452 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG dbcounter [-] [416293] Writing DB stats keystone:SELECT=100 {{(pid=416293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:05:37.596879 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39c3c89-54ed-48e8-87cf-eee97403b4a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:05:37.598064 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39c3c89-54ed-48e8-87cf-eee97403b4a0 None admin] REQUEST_METHOD: `GET` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:05:37.599588 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39c3c89-54ed-48e8-87cf-eee97403b4a0 None admin] SCRIPT_NAME: `/identity` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:05:37.600169 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39c3c89-54ed-48e8-87cf-eee97403b4a0 None admin] PATH_INFO: `/v3/roles` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:05:37.601912 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c39c3c89-54ed-48e8-87cf-eee97403b4a0 None admin] RBAC: Adding query filter params (name=member) {{(pid=416294) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 09:05:37.602776 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c39c3c89-54ed-48e8-87cf-eee97403b4a0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:05:37.604874 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c39c3c89-54ed-48e8-87cf-eee97403b4a0 None admin] RBAC: Authorization granted {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:05:37.624456 dv-cinder-851351-1-smb devstack@keystone.service[416294]: [pid: 416294|app: 0|req: 94/178] 10.222.0.42 () {56 vars in 1101 bytes} [Thu Jul 28 09:05:37 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:05:37.624456 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5b794a-d191-4c8e-b4e1-32e5915d4755 None None] REQUEST_METHOD: `POST` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:05:37.624456 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5b794a-d191-4c8e-b4e1-32e5915d4755 None None] SCRIPT_NAME: `/identity` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:05:37.624456 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5b794a-d191-4c8e-b4e1-32e5915d4755 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:05:37.636774 dv-cinder-851351-1-smb devstack@keystone.service[416293]: [pid: 416293|app: 0|req: 85/179] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 09:05:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 09:05:37.638943 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG dbcounter [-] [416294] Writing DB stats keystone:SELECT=100 {{(pid=416294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:05:37.641068 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52b45e4-bdf1-4e41-9baf-70ef178b9d9d None None] REQUEST_METHOD: `GET` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:05:37.643579 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52b45e4-bdf1-4e41-9baf-70ef178b9d9d None None] SCRIPT_NAME: `/identity` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:05:37.643579 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52b45e4-bdf1-4e41-9baf-70ef178b9d9d None None] PATH_INFO: `/` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:05:37.644077 dv-cinder-851351-1-smb devstack@keystone.service[416293]: [pid: 416293|app: 0|req: 86/180] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 09:05:37 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 09:05:37.645458 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f52b45e4-bdf1-4e41-9baf-70ef178b9d9d None None] Authenticating user token {{(pid=416293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:05:37.653692 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.auth.core [None req-1b5b794a-d191-4c8e-b4e1-32e5915d4755 None None] MFA Rules not processed for user `dbf87abab90e4fdf9e75408f4199918e`. Rule list: `[]` (Enabled: `True`). {{(pid=416294) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 09:05:37.656702 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.fernet_utils [None req-1b5b794a-d191-4c8e-b4e1-32e5915d4755 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=416294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 09:05:37.750665 dv-cinder-851351-1-smb devstack@keystone.service[416294]: [pid: 416294|app: 0|req: 95/181] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 09:05:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 09:05:37.751744 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eff3e9c-f23e-4053-ad32-471514cb1910 None None] REQUEST_METHOD: `POST` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:05:37.752095 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eff3e9c-f23e-4053-ad32-471514cb1910 None None] SCRIPT_NAME: `/identity` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:05:37.752374 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eff3e9c-f23e-4053-ad32-471514cb1910 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:05:37.772693 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.auth.core [None req-0eff3e9c-f23e-4053-ad32-471514cb1910 None None] MFA Rules not processed for user `dbf87abab90e4fdf9e75408f4199918e`. Rule list: `[]` (Enabled: `True`). {{(pid=416294) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 09:05:37.774740 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.fernet_utils [None req-0eff3e9c-f23e-4053-ad32-471514cb1910 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=416294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 09:05:37.796613 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f52b45e4-bdf1-4e41-9baf-70ef178b9d9d None None] Validating token access rules against request {{(pid=416293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:05:37.838135 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a94337d-0937-456f-b766-168694f60479 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:05:37.838805 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a94337d-0937-456f-b766-168694f60479 None admin] REQUEST_METHOD: `GET` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:05:37.839091 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a94337d-0937-456f-b766-168694f60479 None admin] SCRIPT_NAME: `/identity` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:05:37.839377 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a94337d-0937-456f-b766-168694f60479 None admin] PATH_INFO: `/v3/users/d8807d513cea475c9faa3106083edd8a` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:05:37.840575 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a94337d-0937-456f-b766-168694f60479 None admin] RBAC: Authorizing `identity:get_user(user_id=d8807d513cea475c9faa3106083edd8a)` {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:05:37.842809 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a94337d-0937-456f-b766-168694f60479 None admin] RBAC: Authorization granted {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:05:37.844468 dv-cinder-851351-1-smb devstack@keystone.service[416293]: [pid: 416293|app: 0|req: 87/182] 10.222.0.42 () {56 vars in 1177 bytes} [Thu Jul 28 09:05:37 2022] GET /identity/v3/users/d8807d513cea475c9faa3106083edd8a => generated 275 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:05:37.844578 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a94337d-0937-456f-b766-168694f60479 None admin] Authenticating user token {{(pid=416293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:05:37.858366 dv-cinder-851351-1-smb devstack@keystone.service[416294]: [pid: 416294|app: 0|req: 96/183] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 09:05:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 09:05:37.860080 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c8e042-8ff8-4c0b-bcd5-e41e37a6c6d6 None None] REQUEST_METHOD: `GET` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:05:37.860383 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c8e042-8ff8-4c0b-bcd5-e41e37a6c6d6 None None] SCRIPT_NAME: `/identity` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:05:37.860686 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c8e042-8ff8-4c0b-bcd5-e41e37a6c6d6 None None] PATH_INFO: `/` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:05:37.862233 dv-cinder-851351-1-smb devstack@keystone.service[416294]: [pid: 416294|app: 0|req: 97/184] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 09:05:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 09:05:37.862841 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c8e042-8ff8-4c0b-bcd5-e41e37a6c6d6 None None] Authenticating user token {{(pid=416294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:05:37.877881 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG dbcounter [-] [416293] Writing DB stats keystone:SELECT=100 {{(pid=416293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:05:37.945571 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG dbcounter [-] [416294] Writing DB stats keystone:SELECT=100 {{(pid=416294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:05:37.973816 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a94337d-0937-456f-b766-168694f60479 None admin] Validating token access rules against request {{(pid=416293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:05:37.986119 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c8e042-8ff8-4c0b-bcd5-e41e37a6c6d6 None None] Validating token access rules against request {{(pid=416294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:05:38.012252 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4999d18-67cc-4b54-a223-42cfb96100df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:05:38.012958 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4999d18-67cc-4b54-a223-42cfb96100df None admin] REQUEST_METHOD: `GET` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:05:38.013279 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4999d18-67cc-4b54-a223-42cfb96100df None admin] SCRIPT_NAME: `/identity` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:05:38.013559 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4999d18-67cc-4b54-a223-42cfb96100df None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:05:38.023419 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2dfaf0a-5d69-4f72-870e-f2f4e6cf5e73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:05:38.024088 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2dfaf0a-5d69-4f72-870e-f2f4e6cf5e73 None admin] REQUEST_METHOD: `GET` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:05:38.024375 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2dfaf0a-5d69-4f72-870e-f2f4e6cf5e73 None admin] SCRIPT_NAME: `/identity` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:05:38.024610 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4999d18-67cc-4b54-a223-42cfb96100df None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 09:05:38.024745 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2dfaf0a-5d69-4f72-870e-f2f4e6cf5e73 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:05:38.029704 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application [None req-d4999d18-67cc-4b54-a223-42cfb96100df None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 28 09:05:38.029704 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 09:05:38.029704 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 09:05:38.029704 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 09:05:38.029704 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 09:05:38.029704 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 09:05:38.029704 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 09:05:38.029704 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 09:05:38.029704 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 09:05:38.029704 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 09:05:38.029704 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 09:05:38.029704 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 09:05:38.029704 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 09:05:38.029704 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 09:05:38.029704 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 09:05:38.029704 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 09:05:38.030775 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 09:05:38.030775 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 09:05:38.030775 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 09:05:38.030775 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 09:05:38.030775 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 09:05:38.030775 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 09:05:38.030775 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 09:05:38.030775 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 09:05:38.030775 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 09:05:38.030775 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 09:05:38.030775 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 09:05:38.030775 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application with Lock( Jul 28 09:05:38.030775 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 09:05:38.030775 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self._enter() Jul 28 09:05:38.030775 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 09:05:38.030775 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 09:05:38.031654 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 09:05:38.031654 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self.creator() Jul 28 09:05:38.031654 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 09:05:38.031654 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application created_value = creator( Jul 28 09:05:38.031654 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 09:05:38.031654 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 09:05:38.031654 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 09:05:38.031654 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 09:05:38.031654 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 09:05:38.031654 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 09:05:38.031654 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 28 09:05:38.031654 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application Jul 28 09:05:38.031654 dv-cinder-851351-1-smb devstack@keystone.service[416293]: [pid: 416293|app: 0|req: 88/185] 10.222.0.42 () {56 vars in 1114 bytes} [Thu Jul 28 09:05:37 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 09:05:38.032375 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4999d18-67cc-4b54-a223-42cfb96100df None admin] Authenticating user token {{(pid=416293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:05:38.037870 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2dfaf0a-5d69-4f72-870e-f2f4e6cf5e73 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 09:05:38.042407 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application [None req-c2dfaf0a-5d69-4f72-870e-f2f4e6cf5e73 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 09:05:38.042407 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 09:05:38.042407 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 09:05:38.042407 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 09:05:38.042407 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 09:05:38.042407 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 09:05:38.042407 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 09:05:38.042407 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 09:05:38.042407 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 09:05:38.042407 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 09:05:38.042407 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 09:05:38.042407 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 09:05:38.042407 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 09:05:38.042407 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 09:05:38.042407 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 09:05:38.042407 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 09:05:38.043395 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 09:05:38.043395 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 09:05:38.043395 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 09:05:38.043395 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 09:05:38.043395 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 09:05:38.043395 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 09:05:38.043395 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 09:05:38.043395 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 09:05:38.043395 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 09:05:38.043395 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 09:05:38.043395 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 09:05:38.043395 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application with Lock( Jul 28 09:05:38.043395 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 09:05:38.043395 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return self._enter() Jul 28 09:05:38.043395 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 09:05:38.043395 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 09:05:38.044252 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 09:05:38.044252 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return self.creator() Jul 28 09:05:38.044252 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 09:05:38.044252 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application created_value = creator( Jul 28 09:05:38.044252 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 09:05:38.044252 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 09:05:38.044252 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 09:05:38.044252 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 09:05:38.044252 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 09:05:38.044252 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 09:05:38.044252 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 09:05:38.044252 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application Jul 28 09:05:38.044252 dv-cinder-851351-1-smb devstack@keystone.service[416294]: [pid: 416294|app: 0|req: 98/186] 10.222.0.42 () {56 vars in 1096 bytes} [Thu Jul 28 09:05:37 2022] GET /identity/v3/roles/admin => generated 83 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 09:05:38.045680 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a7ef69-296b-4f0e-a219-617697382add None None] REQUEST_METHOD: `POST` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:05:38.045826 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a7ef69-296b-4f0e-a219-617697382add None None] SCRIPT_NAME: `/identity` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:05:38.045985 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a7ef69-296b-4f0e-a219-617697382add None None] PATH_INFO: `/v3/auth/tokens` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:05:38.065273 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.auth.core [None req-f5a7ef69-296b-4f0e-a219-617697382add None None] MFA Rules not processed for user `dbf87abab90e4fdf9e75408f4199918e`. Rule list: `[]` (Enabled: `True`). {{(pid=416294) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 09:05:38.066608 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.fernet_utils [None req-f5a7ef69-296b-4f0e-a219-617697382add None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=416294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 09:05:38.117242 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG dbcounter [-] [416293] Writing DB stats keystone:SELECT=100 {{(pid=416293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:05:38.140014 dv-cinder-851351-1-smb devstack@keystone.service[416294]: [pid: 416294|app: 0|req: 99/187] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 09:05:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 09:05:38.140535 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4999d18-67cc-4b54-a223-42cfb96100df None admin] Validating token access rules against request {{(pid=416293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:05:38.145631 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a7ef69-296b-4f0e-a219-617697382add None None] Authenticating user token {{(pid=416294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:05:38.177363 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91be3a26-ac9d-4177-b0e5-47b4f400bead None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:05:38.178000 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91be3a26-ac9d-4177-b0e5-47b4f400bead None admin] REQUEST_METHOD: `GET` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:05:38.178285 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91be3a26-ac9d-4177-b0e5-47b4f400bead None admin] SCRIPT_NAME: `/identity` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:05:38.178559 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91be3a26-ac9d-4177-b0e5-47b4f400bead None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:05:38.203349 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG dbcounter [-] [416294] Writing DB stats keystone:SELECT=100 {{(pid=416294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:05:38.248052 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a7ef69-296b-4f0e-a219-617697382add None None] Validating token access rules against request {{(pid=416294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:05:38.249217 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91be3a26-ac9d-4177-b0e5-47b4f400bead None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:05:38.250738 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91be3a26-ac9d-4177-b0e5-47b4f400bead None admin] RBAC: Authorization granted {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:05:38.282253 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac09d55-0dbb-4eaf-8b66-ba2c5730f784 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:05:38.282906 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac09d55-0dbb-4eaf-8b66-ba2c5730f784 None admin] REQUEST_METHOD: `GET` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:05:38.283187 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac09d55-0dbb-4eaf-8b66-ba2c5730f784 None admin] SCRIPT_NAME: `/identity` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:05:38.283440 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac09d55-0dbb-4eaf-8b66-ba2c5730f784 None admin] PATH_INFO: `/v3/domains/default` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:05:38.284679 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ac09d55-0dbb-4eaf-8b66-ba2c5730f784 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:05:38.286141 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ac09d55-0dbb-4eaf-8b66-ba2c5730f784 None admin] RBAC: Authorization granted {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:05:38.287810 dv-cinder-851351-1-smb devstack@keystone.service[416294]: [pid: 416294|app: 0|req: 100/188] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 09:05:38 2022] GET /identity/v3/domains/default => generated 199 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:05:38.292718 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac09d55-0dbb-4eaf-8b66-ba2c5730f784 None admin] Authenticating user token {{(pid=416294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:05:38.328690 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG dbcounter [-] [416293] Writing DB stats keystone:SELECT=100 {{(pid=416293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:05:38.352070 dv-cinder-851351-1-smb devstack@keystone.service[416293]: [pid: 416293|app: 0|req: 89/189] 10.222.0.42 () {58 vars in 1282 bytes} [Thu Jul 28 09:05:38 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 28 09:05:38.352933 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91be3a26-ac9d-4177-b0e5-47b4f400bead None admin] Authenticating user token {{(pid=416293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:05:38.398565 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac09d55-0dbb-4eaf-8b66-ba2c5730f784 None admin] Validating token access rules against request {{(pid=416294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:05:38.422066 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG dbcounter [-] [416294] Writing DB stats keystone:SELECT=100 {{(pid=416294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:05:38.433479 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6cd2059-8e64-45fb-8a41-901a7d4c9360 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:05:38.434113 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6cd2059-8e64-45fb-8a41-901a7d4c9360 None admin] REQUEST_METHOD: `GET` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:05:38.434398 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6cd2059-8e64-45fb-8a41-901a7d4c9360 None admin] SCRIPT_NAME: `/identity` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:05:38.434674 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6cd2059-8e64-45fb-8a41-901a7d4c9360 None admin] PATH_INFO: `/v3/roles` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:05:38.435406 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6cd2059-8e64-45fb-8a41-901a7d4c9360 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=416294) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 09:05:38.435714 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6cd2059-8e64-45fb-8a41-901a7d4c9360 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:05:38.437145 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6cd2059-8e64-45fb-8a41-901a7d4c9360 None admin] RBAC: Authorization granted {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:05:38.445655 dv-cinder-851351-1-smb devstack@keystone.service[416294]: [pid: 416294|app: 0|req: 101/190] 10.222.0.42 () {56 vars in 1111 bytes} [Thu Jul 28 09:05:38 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:05:38.446437 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6cd2059-8e64-45fb-8a41-901a7d4c9360 None admin] Authenticating user token {{(pid=416294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:05:38.451676 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91be3a26-ac9d-4177-b0e5-47b4f400bead None admin] Validating token access rules against request {{(pid=416293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:05:38.486977 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0894814e-8068-4646-8fd9-2df1e063a997 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:05:38.487686 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0894814e-8068-4646-8fd9-2df1e063a997 None admin] REQUEST_METHOD: `GET` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:05:38.487916 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0894814e-8068-4646-8fd9-2df1e063a997 None admin] SCRIPT_NAME: `/identity` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:05:38.488179 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0894814e-8068-4646-8fd9-2df1e063a997 None admin] PATH_INFO: `/v3/roles` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:05:38.488935 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0894814e-8068-4646-8fd9-2df1e063a997 None admin] RBAC: Adding query filter params (name=admin) {{(pid=416293) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 09:05:38.489238 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0894814e-8068-4646-8fd9-2df1e063a997 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:05:38.490633 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0894814e-8068-4646-8fd9-2df1e063a997 None admin] RBAC: Authorization granted {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:05:38.498849 dv-cinder-851351-1-smb devstack@keystone.service[416293]: [pid: 416293|app: 0|req: 90/191] 10.222.0.42 () {56 vars in 1099 bytes} [Thu Jul 28 09:05:38 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:05:38.499611 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0894814e-8068-4646-8fd9-2df1e063a997 None admin] Authenticating user token {{(pid=416293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:05:38.539897 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG dbcounter [-] [416293] Writing DB stats keystone:SELECT=100 {{(pid=416293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:05:38.553583 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6cd2059-8e64-45fb-8a41-901a7d4c9360 None admin] Validating token access rules against request {{(pid=416294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:05:38.586781 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3ff363-e2a6-4f3e-ac04-87967c5a5649 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:05:38.587434 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3ff363-e2a6-4f3e-ac04-87967c5a5649 None admin] REQUEST_METHOD: `GET` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:05:38.587716 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3ff363-e2a6-4f3e-ac04-87967c5a5649 None admin] SCRIPT_NAME: `/identity` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:05:38.587987 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3ff363-e2a6-4f3e-ac04-87967c5a5649 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:05:38.597999 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df3ff363-e2a6-4f3e-ac04-87967c5a5649 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 09:05:38.600348 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0894814e-8068-4646-8fd9-2df1e063a997 None admin] Validating token access rules against request {{(pid=416293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:05:38.603409 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application [None req-df3ff363-e2a6-4f3e-ac04-87967c5a5649 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 28 09:05:38.603409 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 09:05:38.603409 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 09:05:38.603409 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 09:05:38.603409 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 09:05:38.603409 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 09:05:38.603409 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 09:05:38.603409 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 09:05:38.603409 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 09:05:38.603409 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 09:05:38.603409 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 09:05:38.603409 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 09:05:38.603409 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 09:05:38.603409 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 09:05:38.603409 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 09:05:38.603409 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 09:05:38.604365 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 09:05:38.604365 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 09:05:38.604365 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 09:05:38.604365 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 09:05:38.604365 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 09:05:38.604365 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 09:05:38.604365 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 09:05:38.604365 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 09:05:38.604365 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 09:05:38.604365 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 09:05:38.604365 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 09:05:38.604365 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application with Lock( Jul 28 09:05:38.604365 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 09:05:38.604365 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return self._enter() Jul 28 09:05:38.604365 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 09:05:38.604365 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 09:05:38.605745 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 09:05:38.605745 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return self.creator() Jul 28 09:05:38.605745 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 09:05:38.605745 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application created_value = creator( Jul 28 09:05:38.605745 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 09:05:38.605745 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 09:05:38.605745 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 09:05:38.605745 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 09:05:38.605745 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 09:05:38.605745 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 09:05:38.605745 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 28 09:05:38.605745 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application Jul 28 09:05:38.605745 dv-cinder-851351-1-smb devstack@keystone.service[416294]: [pid: 416294|app: 0|req: 102/192] 10.222.0.42 () {56 vars in 1099 bytes} [Thu Jul 28 09:05:38 2022] GET /identity/v3/roles/reader => generated 84 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 09:05:38.605745 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3ff363-e2a6-4f3e-ac04-87967c5a5649 None admin] Authenticating user token {{(pid=416294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:05:38.640908 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8463fbc-e072-4cc2-bfe5-4a66b6c9cea1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:05:38.641581 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8463fbc-e072-4cc2-bfe5-4a66b6c9cea1 None admin] REQUEST_METHOD: `POST` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:05:38.641872 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8463fbc-e072-4cc2-bfe5-4a66b6c9cea1 None admin] SCRIPT_NAME: `/identity` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:05:38.642179 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8463fbc-e072-4cc2-bfe5-4a66b6c9cea1 None admin] PATH_INFO: `/v3/users` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:05:38.642876 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8463fbc-e072-4cc2-bfe5-4a66b6c9cea1 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:05:38.644399 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8463fbc-e072-4cc2-bfe5-4a66b6c9cea1 None admin] RBAC: Authorization granted {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:05:38.653783 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG dbcounter [-] [416294] Writing DB stats keystone:SELECT=100 {{(pid=416294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:05:38.666307 dv-cinder-851351-1-smb devstack@keystone.service[416293]: [pid: 416293|app: 0|req: 91/193] 10.222.0.42 () {60 vars in 1132 bytes} [Thu Jul 28 09:05:38 2022] POST /identity/v3/users => generated 297 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 09:05:38.667141 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8463fbc-e072-4cc2-bfe5-4a66b6c9cea1 None admin] Authenticating user token {{(pid=416293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:05:38.718743 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3ff363-e2a6-4f3e-ac04-87967c5a5649 None admin] Validating token access rules against request {{(pid=416294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:05:38.768910 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dccc5bc6-5e76-49fd-908b-5853a00284f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:05:38.769725 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dccc5bc6-5e76-49fd-908b-5853a00284f1 None admin] REQUEST_METHOD: `GET` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:05:38.770014 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dccc5bc6-5e76-49fd-908b-5853a00284f1 None admin] SCRIPT_NAME: `/identity` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:05:38.770980 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dccc5bc6-5e76-49fd-908b-5853a00284f1 None admin] PATH_INFO: `/v3/projects/090ea9d868594067b3092600971fc7a7` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:05:38.771658 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dccc5bc6-5e76-49fd-908b-5853a00284f1 None admin] RBAC: Authorizing `identity:get_project(project_id=090ea9d868594067b3092600971fc7a7)` {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:05:38.773218 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dccc5bc6-5e76-49fd-908b-5853a00284f1 None admin] RBAC: Authorization granted {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:05:38.775016 dv-cinder-851351-1-smb devstack@keystone.service[416294]: [pid: 416294|app: 0|req: 103/194] 10.222.0.42 () {56 vars in 1186 bytes} [Thu Jul 28 09:05:38 2022] GET /identity/v3/projects/090ea9d868594067b3092600971fc7a7 => generated 312 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:05:38.776371 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dccc5bc6-5e76-49fd-908b-5853a00284f1 None admin] Authenticating user token {{(pid=416294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:05:38.788579 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG dbcounter [-] [416293] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=416293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:05:38.797836 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8463fbc-e072-4cc2-bfe5-4a66b6c9cea1 None admin] Validating token access rules against request {{(pid=416293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:05:38.839565 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02bac337-79fe-4afb-a196-369301f42d2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:05:38.840249 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02bac337-79fe-4afb-a196-369301f42d2d None admin] REQUEST_METHOD: `GET` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:05:38.840541 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02bac337-79fe-4afb-a196-369301f42d2d None admin] SCRIPT_NAME: `/identity` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:05:38.840856 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02bac337-79fe-4afb-a196-369301f42d2d None admin] PATH_INFO: `/v3/users/738beb0bf3334354a3d964d6fadda0d8` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:05:38.857122 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02bac337-79fe-4afb-a196-369301f42d2d None admin] RBAC: Authorizing `identity:get_user(user_id=738beb0bf3334354a3d964d6fadda0d8)` {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:05:38.859377 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02bac337-79fe-4afb-a196-369301f42d2d None admin] RBAC: Authorization granted {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:05:38.860630 dv-cinder-851351-1-smb devstack@keystone.service[416293]: [pid: 416293|app: 0|req: 92/195] 10.222.0.42 () {56 vars in 1177 bytes} [Thu Jul 28 09:05:38 2022] GET /identity/v3/users/738beb0bf3334354a3d964d6fadda0d8 => generated 283 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:05:38.862141 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02bac337-79fe-4afb-a196-369301f42d2d None admin] Authenticating user token {{(pid=416293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:05:38.899745 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dccc5bc6-5e76-49fd-908b-5853a00284f1 None admin] Validating token access rules against request {{(pid=416294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:05:38.919888 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG dbcounter [-] [416294] Writing DB stats keystone:SELECT=100 {{(pid=416294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:05:38.947711 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83df5818-4afa-4bae-a018-ac5986f0531b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:05:38.948389 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83df5818-4afa-4bae-a018-ac5986f0531b None admin] REQUEST_METHOD: `GET` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:05:38.949100 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83df5818-4afa-4bae-a018-ac5986f0531b None admin] SCRIPT_NAME: `/identity` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:05:38.949485 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83df5818-4afa-4bae-a018-ac5986f0531b None admin] PATH_INFO: `/v3/users/738beb0bf3334354a3d964d6fadda0d8` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:05:38.950894 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83df5818-4afa-4bae-a018-ac5986f0531b None admin] RBAC: Authorizing `identity:get_user(user_id=738beb0bf3334354a3d964d6fadda0d8)` {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:05:38.952380 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83df5818-4afa-4bae-a018-ac5986f0531b None admin] RBAC: Authorization granted {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:05:38.955077 dv-cinder-851351-1-smb devstack@keystone.service[416294]: [pid: 416294|app: 0|req: 104/196] 10.222.0.42 () {56 vars in 1177 bytes} [Thu Jul 28 09:05:38 2022] GET /identity/v3/users/738beb0bf3334354a3d964d6fadda0d8 => generated 283 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:05:38.956037 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83df5818-4afa-4bae-a018-ac5986f0531b None admin] Authenticating user token {{(pid=416294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:05:39.009696 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02bac337-79fe-4afb-a196-369301f42d2d None admin] Validating token access rules against request {{(pid=416293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:05:39.051863 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3109af-74e7-47c8-bd9b-0f1e864f9eff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:05:39.052966 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3109af-74e7-47c8-bd9b-0f1e864f9eff None admin] REQUEST_METHOD: `GET` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:05:39.053509 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3109af-74e7-47c8-bd9b-0f1e864f9eff None admin] SCRIPT_NAME: `/identity` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:05:39.053986 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3109af-74e7-47c8-bd9b-0f1e864f9eff None admin] PATH_INFO: `/v3/roles` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:05:39.054925 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f3109af-74e7-47c8-bd9b-0f1e864f9eff None admin] RBAC: Adding query filter params (name=reader) {{(pid=416293) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 09:05:39.055432 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f3109af-74e7-47c8-bd9b-0f1e864f9eff None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:05:39.057105 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f3109af-74e7-47c8-bd9b-0f1e864f9eff None admin] RBAC: Authorization granted {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:05:39.067096 dv-cinder-851351-1-smb devstack@keystone.service[416293]: [pid: 416293|app: 0|req: 93/197] 10.222.0.42 () {56 vars in 1101 bytes} [Thu Jul 28 09:05:38 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:05:39.072017 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3109af-74e7-47c8-bd9b-0f1e864f9eff None admin] Authenticating user token {{(pid=416293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:05:39.091741 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83df5818-4afa-4bae-a018-ac5986f0531b None admin] Validating token access rules against request {{(pid=416294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:05:39.096212 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG dbcounter [-] [416293] Writing DB stats keystone:SELECT=100 {{(pid=416293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:05:39.157477 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a98af8-d64f-4d8c-a2b3-5bad5d421794 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:05:39.159357 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a98af8-d64f-4d8c-a2b3-5bad5d421794 None admin] REQUEST_METHOD: `GET` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:05:39.160121 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a98af8-d64f-4d8c-a2b3-5bad5d421794 None admin] SCRIPT_NAME: `/identity` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:05:39.160608 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a98af8-d64f-4d8c-a2b3-5bad5d421794 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:05:39.162353 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5a98af8-d64f-4d8c-a2b3-5bad5d421794 None admin] RBAC: Adding query filter params (role.id=ba1a79dc27074d5a94dce2d994019d37, scope.project.id=090ea9d868594067b3092600971fc7a7, user.id=d8807d513cea475c9faa3106083edd8a) {{(pid=416294) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 09:05:39.163039 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5a98af8-d64f-4d8c-a2b3-5bad5d421794 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:05:39.164856 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5a98af8-d64f-4d8c-a2b3-5bad5d421794 None admin] RBAC: Authorization granted {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:05:39.174653 dv-cinder-851351-1-smb devstack@keystone.service[416294]: [pid: 416294|app: 0|req: 105/198] 10.222.0.42 () {56 vars in 1374 bytes} [Thu Jul 28 09:05:38 2022] GET /identity/v3/role_assignments?user.id=d8807d513cea475c9faa3106083edd8a&scope.project.id=090ea9d868594067b3092600971fc7a7&role.id=ba1a79dc27074d5a94dce2d994019d37 => generated 608 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:05:39.175887 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a98af8-d64f-4d8c-a2b3-5bad5d421794 None admin] Authenticating user token {{(pid=416294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:05:39.208742 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3109af-74e7-47c8-bd9b-0f1e864f9eff None admin] Validating token access rules against request {{(pid=416293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:05:39.244762 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG dbcounter [-] [416294] Writing DB stats keystone:SELECT=100 {{(pid=416294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:05:39.260531 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-841a024c-1745-4cb0-99c9-d30a9ffa6312 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:05:39.264146 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841a024c-1745-4cb0-99c9-d30a9ffa6312 None admin] REQUEST_METHOD: `GET` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:05:39.264146 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841a024c-1745-4cb0-99c9-d30a9ffa6312 None admin] SCRIPT_NAME: `/identity` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:05:39.264146 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841a024c-1745-4cb0-99c9-d30a9ffa6312 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:05:39.362216 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a98af8-d64f-4d8c-a2b3-5bad5d421794 None admin] Validating token access rules against request {{(pid=416294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:05:39.395469 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-841a024c-1745-4cb0-99c9-d30a9ffa6312 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:05:39.397411 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-841a024c-1745-4cb0-99c9-d30a9ffa6312 None admin] RBAC: Authorization granted {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:05:39.415651 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG dbcounter [-] [416293] Writing DB stats keystone:SELECT=100 {{(pid=416293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:05:39.418578 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288022db-33ec-4add-8120-abcd979a6dfa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:05:39.420260 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288022db-33ec-4add-8120-abcd979a6dfa None admin] REQUEST_METHOD: `GET` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:05:39.421838 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288022db-33ec-4add-8120-abcd979a6dfa None admin] SCRIPT_NAME: `/identity` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:05:39.422370 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288022db-33ec-4add-8120-abcd979a6dfa None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:05:39.520933 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-288022db-33ec-4add-8120-abcd979a6dfa None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:05:39.523690 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-288022db-33ec-4add-8120-abcd979a6dfa None admin] RBAC: Authorization granted {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:05:39.530393 dv-cinder-851351-1-smb devstack@keystone.service[416293]: [pid: 416293|app: 0|req: 94/199] 10.222.0.42 () {58 vars in 1282 bytes} [Thu Jul 28 09:05:39 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 463 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 28 09:05:39.531362 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-841a024c-1745-4cb0-99c9-d30a9ffa6312 None admin] Authenticating user token {{(pid=416293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:05:39.587705 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG dbcounter [-] [416294] Writing DB stats keystone:SELECT=100 {{(pid=416294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:05:39.660696 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-841a024c-1745-4cb0-99c9-d30a9ffa6312 None admin] Validating token access rules against request {{(pid=416293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:05:39.663172 dv-cinder-851351-1-smb devstack@keystone.service[416294]: [pid: 416294|app: 0|req: 106/200] 10.222.0.42 () {58 vars in 1282 bytes} [Thu Jul 28 09:05:39 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 487 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 28 09:05:39.664520 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288022db-33ec-4add-8120-abcd979a6dfa None admin] Authenticating user token {{(pid=416294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:05:39.686538 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG dbcounter [-] [416293] Writing DB stats keystone:SELECT=100 {{(pid=416293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:05:39.717278 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a0c774-f391-40a5-af43-7db5e0c994d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:05:39.718049 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a0c774-f391-40a5-af43-7db5e0c994d1 None admin] REQUEST_METHOD: `GET` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:05:39.718348 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a0c774-f391-40a5-af43-7db5e0c994d1 None admin] SCRIPT_NAME: `/identity` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:05:39.718712 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a0c774-f391-40a5-af43-7db5e0c994d1 None admin] PATH_INFO: `/v3/users/7ebed970bd644c1aa9e856d13f0bfa52` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:05:39.720309 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9a0c774-f391-40a5-af43-7db5e0c994d1 None admin] RBAC: Authorizing `identity:get_user(user_id=7ebed970bd644c1aa9e856d13f0bfa52)` {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:05:39.721609 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9a0c774-f391-40a5-af43-7db5e0c994d1 None admin] RBAC: Authorization granted {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:05:39.723428 dv-cinder-851351-1-smb devstack@keystone.service[416293]: [pid: 416293|app: 0|req: 95/201] 10.222.0.42 () {56 vars in 1177 bytes} [Thu Jul 28 09:05:39 2022] GET /identity/v3/users/7ebed970bd644c1aa9e856d13f0bfa52 => generated 289 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:05:39.728976 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a0c774-f391-40a5-af43-7db5e0c994d1 None admin] Authenticating user token {{(pid=416293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:05:39.811599 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288022db-33ec-4add-8120-abcd979a6dfa None admin] Validating token access rules against request {{(pid=416294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:05:39.841802 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a0c774-f391-40a5-af43-7db5e0c994d1 None admin] Validating token access rules against request {{(pid=416293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:05:39.863902 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf96f37-50ce-4440-82c9-fa6d3fa87ead None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:05:39.865214 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf96f37-50ce-4440-82c9-fa6d3fa87ead None admin] REQUEST_METHOD: `GET` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:05:39.865500 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf96f37-50ce-4440-82c9-fa6d3fa87ead None admin] SCRIPT_NAME: `/identity` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:05:39.865773 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf96f37-50ce-4440-82c9-fa6d3fa87ead None admin] PATH_INFO: `/v3/projects/5c46e2ed162f45cabaf6f30752f915a4` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:05:39.868064 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cf96f37-50ce-4440-82c9-fa6d3fa87ead None admin] RBAC: Authorizing `identity:get_project(project_id=5c46e2ed162f45cabaf6f30752f915a4)` {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:05:39.869800 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cf96f37-50ce-4440-82c9-fa6d3fa87ead None admin] RBAC: Authorization granted {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:05:39.871275 dv-cinder-851351-1-smb devstack@keystone.service[416294]: [pid: 416294|app: 0|req: 107/202] 10.222.0.42 () {56 vars in 1186 bytes} [Thu Jul 28 09:05:39 2022] GET /identity/v3/projects/5c46e2ed162f45cabaf6f30752f915a4 => generated 302 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:05:39.872049 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf96f37-50ce-4440-82c9-fa6d3fa87ead None admin] Authenticating user token {{(pid=416294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:05:39.883979 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65ab315-4d4b-44be-99a2-c138b0522a95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:05:39.886044 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65ab315-4d4b-44be-99a2-c138b0522a95 None admin] REQUEST_METHOD: `GET` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:05:39.886557 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65ab315-4d4b-44be-99a2-c138b0522a95 None admin] SCRIPT_NAME: `/identity` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:05:39.887073 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65ab315-4d4b-44be-99a2-c138b0522a95 None admin] PATH_INFO: `/v3/projects/5c46e2ed162f45cabaf6f30752f915a4` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:05:39.888549 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f65ab315-4d4b-44be-99a2-c138b0522a95 None admin] RBAC: Authorizing `identity:get_project(project_id=5c46e2ed162f45cabaf6f30752f915a4)` {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:05:39.890881 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f65ab315-4d4b-44be-99a2-c138b0522a95 None admin] RBAC: Authorization granted {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:05:39.893408 dv-cinder-851351-1-smb devstack@keystone.service[416293]: [pid: 416293|app: 0|req: 96/203] 10.222.0.42 () {56 vars in 1186 bytes} [Thu Jul 28 09:05:39 2022] GET /identity/v3/projects/5c46e2ed162f45cabaf6f30752f915a4 => generated 302 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:05:39.895031 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65ab315-4d4b-44be-99a2-c138b0522a95 None admin] Authenticating user token {{(pid=416293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:05:39.901171 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG dbcounter [-] [416294] Writing DB stats keystone:SELECT=100 {{(pid=416294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:05:39.953599 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG dbcounter [-] [416293] Writing DB stats keystone:SELECT=100 {{(pid=416293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:05:39.999123 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf96f37-50ce-4440-82c9-fa6d3fa87ead None admin] Validating token access rules against request {{(pid=416294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:05:40.016203 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65ab315-4d4b-44be-99a2-c138b0522a95 None admin] Validating token access rules against request {{(pid=416293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:05:40.038658 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88bec185-fa50-4e3a-84b8-f944944ee914 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:05:40.039431 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88bec185-fa50-4e3a-84b8-f944944ee914 None admin] REQUEST_METHOD: `GET` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:05:40.039871 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88bec185-fa50-4e3a-84b8-f944944ee914 None admin] SCRIPT_NAME: `/identity` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:05:40.040219 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88bec185-fa50-4e3a-84b8-f944944ee914 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:05:40.058669 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e207aca5-04a1-4c9f-a6e8-f8beb4e21861 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:05:40.059670 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e207aca5-04a1-4c9f-a6e8-f8beb4e21861 None admin] REQUEST_METHOD: `GET` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:05:40.060177 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e207aca5-04a1-4c9f-a6e8-f8beb4e21861 None admin] SCRIPT_NAME: `/identity` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:05:40.060644 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e207aca5-04a1-4c9f-a6e8-f8beb4e21861 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:05:40.061737 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e207aca5-04a1-4c9f-a6e8-f8beb4e21861 None admin] RBAC: Adding query filter params (role.id=6194848862704a289bbaa3fda43a9050, scope.project.id=5c46e2ed162f45cabaf6f30752f915a4, user.id=738beb0bf3334354a3d964d6fadda0d8) {{(pid=416293) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 09:05:40.062238 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e207aca5-04a1-4c9f-a6e8-f8beb4e21861 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:05:40.063915 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e207aca5-04a1-4c9f-a6e8-f8beb4e21861 None admin] RBAC: Authorization granted {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:05:40.077119 dv-cinder-851351-1-smb devstack@keystone.service[416293]: [pid: 416293|app: 0|req: 97/204] 10.222.0.42 () {56 vars in 1374 bytes} [Thu Jul 28 09:05:39 2022] GET /identity/v3/role_assignments?user.id=738beb0bf3334354a3d964d6fadda0d8&scope.project.id=5c46e2ed162f45cabaf6f30752f915a4&role.id=6194848862704a289bbaa3fda43a9050 => generated 259 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:05:40.078563 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e207aca5-04a1-4c9f-a6e8-f8beb4e21861 None admin] Authenticating user token {{(pid=416293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:05:40.128855 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88bec185-fa50-4e3a-84b8-f944944ee914 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:05:40.128855 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88bec185-fa50-4e3a-84b8-f944944ee914 None admin] RBAC: Authorization granted {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:05:40.144144 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG dbcounter [-] [416294] Writing DB stats keystone:SELECT=100 {{(pid=416294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:05:40.246726 dv-cinder-851351-1-smb devstack@keystone.service[416294]: [pid: 416294|app: 0|req: 108/205] 10.222.0.42 () {58 vars in 1282 bytes} [Thu Jul 28 09:05:39 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 375 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 28 09:05:40.252599 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88bec185-fa50-4e3a-84b8-f944944ee914 None admin] Authenticating user token {{(pid=416294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:05:40.272677 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e207aca5-04a1-4c9f-a6e8-f8beb4e21861 None admin] Validating token access rules against request {{(pid=416293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:05:40.289280 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG dbcounter [-] [416293] Writing DB stats keystone:SELECT=100 {{(pid=416293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:05:40.325423 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3bda948-7b4c-475c-8765-bd965920bde7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:05:40.326081 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3bda948-7b4c-475c-8765-bd965920bde7 None admin] REQUEST_METHOD: `GET` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:05:40.326365 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3bda948-7b4c-475c-8765-bd965920bde7 None admin] SCRIPT_NAME: `/identity` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:05:40.326631 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3bda948-7b4c-475c-8765-bd965920bde7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:05:40.327451 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3bda948-7b4c-475c-8765-bd965920bde7 None admin] RBAC: Adding query filter params (role.id=c67085ec338243df8f9b7d6459036e23, scope.project.id=5c46e2ed162f45cabaf6f30752f915a4, user.id=738beb0bf3334354a3d964d6fadda0d8) {{(pid=416293) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 09:05:40.327764 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3bda948-7b4c-475c-8765-bd965920bde7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:05:40.329280 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3bda948-7b4c-475c-8765-bd965920bde7 None admin] RBAC: Authorization granted {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:05:40.335728 dv-cinder-851351-1-smb devstack@keystone.service[416293]: [pid: 416293|app: 0|req: 98/206] 10.222.0.42 () {56 vars in 1374 bytes} [Thu Jul 28 09:05:40 2022] GET /identity/v3/role_assignments?user.id=738beb0bf3334354a3d964d6fadda0d8&scope.project.id=5c46e2ed162f45cabaf6f30752f915a4&role.id=c67085ec338243df8f9b7d6459036e23 => generated 259 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:05:40.369763 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88bec185-fa50-4e3a-84b8-f944944ee914 None admin] Validating token access rules against request {{(pid=416294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:05:40.387557 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG dbcounter [-] [416294] Writing DB stats keystone:SELECT=100 {{(pid=416294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:05:40.417382 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab6054d0-cc0f-43aa-9750-f6d81c0458bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:05:40.418389 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6054d0-cc0f-43aa-9750-f6d81c0458bd None admin] REQUEST_METHOD: `GET` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:05:40.418675 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6054d0-cc0f-43aa-9750-f6d81c0458bd None admin] SCRIPT_NAME: `/identity` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:05:40.419214 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6054d0-cc0f-43aa-9750-f6d81c0458bd None admin] PATH_INFO: `/v3/projects/c515ec4395fe420e9ab0ba34fb1ada8f` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:05:40.421028 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab6054d0-cc0f-43aa-9750-f6d81c0458bd None admin] RBAC: Authorizing `identity:get_project(project_id=c515ec4395fe420e9ab0ba34fb1ada8f)` {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:05:40.423382 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab6054d0-cc0f-43aa-9750-f6d81c0458bd None admin] RBAC: Authorization granted {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:05:40.431948 dv-cinder-851351-1-smb devstack@keystone.service[416294]: [pid: 416294|app: 0|req: 109/207] 10.222.0.42 () {56 vars in 1186 bytes} [Thu Jul 28 09:05:40 2022] GET /identity/v3/projects/c515ec4395fe420e9ab0ba34fb1ada8f => generated 298 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:05:40.434124 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3bda948-7b4c-475c-8765-bd965920bde7 None admin] Authenticating user token {{(pid=416293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:05:40.559677 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3bda948-7b4c-475c-8765-bd965920bde7 None admin] Validating token access rules against request {{(pid=416293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:05:40.597453 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746f7cf2-9419-439a-a054-e90e9aeb0b84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:05:40.598005 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746f7cf2-9419-439a-a054-e90e9aeb0b84 None admin] REQUEST_METHOD: `GET` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:05:40.598293 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746f7cf2-9419-439a-a054-e90e9aeb0b84 None admin] SCRIPT_NAME: `/identity` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:05:40.598570 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746f7cf2-9419-439a-a054-e90e9aeb0b84 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:05:40.599378 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-746f7cf2-9419-439a-a054-e90e9aeb0b84 None admin] RBAC: Adding query filter params (role.id=071325426dc84e2cb2689d138bc2b032, scope.project.id=c515ec4395fe420e9ab0ba34fb1ada8f, user.id=7ebed970bd644c1aa9e856d13f0bfa52) {{(pid=416293) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 09:05:40.599688 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-746f7cf2-9419-439a-a054-e90e9aeb0b84 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:05:40.601186 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-746f7cf2-9419-439a-a054-e90e9aeb0b84 None admin] RBAC: Authorization granted {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:05:40.612780 dv-cinder-851351-1-smb devstack@keystone.service[416293]: [pid: 416293|app: 0|req: 99/208] 10.222.0.42 () {56 vars in 1374 bytes} [Thu Jul 28 09:05:40 2022] GET /identity/v3/role_assignments?user.id=7ebed970bd644c1aa9e856d13f0bfa52&scope.project.id=c515ec4395fe420e9ab0ba34fb1ada8f&role.id=071325426dc84e2cb2689d138bc2b032 => generated 608 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:05:41.035773 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195d40c8-774e-4c35-a8fd-16bd56b52e02 None None] REQUEST_METHOD: `GET` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:05:41.036065 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195d40c8-774e-4c35-a8fd-16bd56b52e02 None None] SCRIPT_NAME: `/identity` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:05:41.036342 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195d40c8-774e-4c35-a8fd-16bd56b52e02 None None] PATH_INFO: `/` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:05:41.037920 dv-cinder-851351-1-smb devstack@keystone.service[416294]: [pid: 416294|app: 0|req: 110/209] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 09:05:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 09:05:41.047115 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe506570-856c-472d-a535-556991e1de03 None None] REQUEST_METHOD: `POST` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:05:41.047115 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe506570-856c-472d-a535-556991e1de03 None None] SCRIPT_NAME: `/identity` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:05:41.047115 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe506570-856c-472d-a535-556991e1de03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:05:41.067007 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.auth.core [None req-fe506570-856c-472d-a535-556991e1de03 None None] MFA Rules not processed for user `dbf87abab90e4fdf9e75408f4199918e`. Rule list: `[]` (Enabled: `True`). {{(pid=416293) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 09:05:41.068626 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.fernet_utils [None req-fe506570-856c-472d-a535-556991e1de03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=416293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 09:05:41.120435 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG dbcounter [-] [416293] Writing DB stats keystone:SELECT=100 {{(pid=416293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:05:41.159388 dv-cinder-851351-1-smb devstack@keystone.service[416293]: [pid: 416293|app: 0|req: 100/210] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 09:05:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 09:05:41.183481 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195d40c8-774e-4c35-a8fd-16bd56b52e02 None None] Authenticating user token {{(pid=416294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:05:41.238919 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d36bc5-c8db-478b-883f-a3a04d4aedf0 None None] REQUEST_METHOD: `GET` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:05:41.239113 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d36bc5-c8db-478b-883f-a3a04d4aedf0 None None] SCRIPT_NAME: `/identity` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:05:41.239375 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d36bc5-c8db-478b-883f-a3a04d4aedf0 None None] PATH_INFO: `/` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:05:41.241075 dv-cinder-851351-1-smb devstack@keystone.service[416293]: [pid: 416293|app: 0|req: 101/211] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 09:05:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 28 09:05:41.247762 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fdbeea2-caae-4fa4-8222-a7974dfea188 None None] REQUEST_METHOD: `POST` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:05:41.248047 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fdbeea2-caae-4fa4-8222-a7974dfea188 None None] SCRIPT_NAME: `/identity` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:05:41.248328 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fdbeea2-caae-4fa4-8222-a7974dfea188 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:05:41.267257 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.auth.core [None req-5fdbeea2-caae-4fa4-8222-a7974dfea188 None None] MFA Rules not processed for user `dbf87abab90e4fdf9e75408f4199918e`. Rule list: `[]` (Enabled: `True`). {{(pid=416293) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 09:05:41.268446 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.fernet_utils [None req-5fdbeea2-caae-4fa4-8222-a7974dfea188 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=416293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 09:05:41.304844 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195d40c8-774e-4c35-a8fd-16bd56b52e02 None None] Validating token access rules against request {{(pid=416294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:05:41.342751 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0676db09-c3f8-48ad-952e-7df19c9eaf4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:05:41.343156 dv-cinder-851351-1-smb devstack@keystone.service[416293]: [pid: 416293|app: 0|req: 102/212] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 09:05:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 28 09:05:41.343490 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0676db09-c3f8-48ad-952e-7df19c9eaf4e None admin] REQUEST_METHOD: `GET` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:05:41.343777 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0676db09-c3f8-48ad-952e-7df19c9eaf4e None admin] SCRIPT_NAME: `/identity` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:05:41.344046 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0676db09-c3f8-48ad-952e-7df19c9eaf4e None admin] PATH_INFO: `/v3/domains/default` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:05:41.345302 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0676db09-c3f8-48ad-952e-7df19c9eaf4e None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:05:41.346892 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0676db09-c3f8-48ad-952e-7df19c9eaf4e None admin] RBAC: Authorization granted {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:05:41.348803 dv-cinder-851351-1-smb devstack@keystone.service[416294]: [pid: 416294|app: 0|req: 111/213] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 09:05:41 2022] GET /identity/v3/domains/default => generated 199 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:05:41.354331 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fdbeea2-caae-4fa4-8222-a7974dfea188 None None] Authenticating user token {{(pid=416293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:05:41.369498 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0676db09-c3f8-48ad-952e-7df19c9eaf4e None admin] Authenticating user token {{(pid=416294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:05:41.423179 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG dbcounter [-] [416294] Writing DB stats keystone:SELECT=100 {{(pid=416294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:05:41.472399 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fdbeea2-caae-4fa4-8222-a7974dfea188 None None] Validating token access rules against request {{(pid=416293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:05:41.474945 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG dbcounter [-] [416293] Writing DB stats keystone:SELECT=100 {{(pid=416293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:05:41.490061 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0676db09-c3f8-48ad-952e-7df19c9eaf4e None admin] Validating token access rules against request {{(pid=416294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:05:41.515137 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da97e08-b426-4a0b-8644-fe7750635709 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:05:41.516149 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da97e08-b426-4a0b-8644-fe7750635709 None admin] REQUEST_METHOD: `POST` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:05:41.516497 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da97e08-b426-4a0b-8644-fe7750635709 None admin] SCRIPT_NAME: `/identity` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:05:41.517005 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da97e08-b426-4a0b-8644-fe7750635709 None admin] PATH_INFO: `/v3/users` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:05:41.517785 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2da97e08-b426-4a0b-8644-fe7750635709 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:05:41.519393 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2da97e08-b426-4a0b-8644-fe7750635709 None admin] RBAC: Authorization granted {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:05:41.535674 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b77d86-8800-4df3-9188-e3873baab7df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:05:41.536905 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b77d86-8800-4df3-9188-e3873baab7df None admin] REQUEST_METHOD: `GET` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:05:41.537393 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b77d86-8800-4df3-9188-e3873baab7df None admin] SCRIPT_NAME: `/identity` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:05:41.538196 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b77d86-8800-4df3-9188-e3873baab7df None admin] PATH_INFO: `/v3/roles/member` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:05:41.546765 dv-cinder-851351-1-smb devstack@keystone.service[416293]: [pid: 416293|app: 0|req: 103/214] 10.222.0.42 () {60 vars in 1132 bytes} [Thu Jul 28 09:05:41 2022] POST /identity/v3/users => generated 297 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 28 09:05:41.559802 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01b77d86-8800-4df3-9188-e3873baab7df None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 09:05:41.566559 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application [None req-01b77d86-8800-4df3-9188-e3873baab7df None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 28 09:05:41.566559 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 09:05:41.566559 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 09:05:41.566559 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 09:05:41.566559 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 09:05:41.566559 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 09:05:41.566559 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 09:05:41.566559 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 09:05:41.566559 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 09:05:41.566559 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 09:05:41.566559 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 09:05:41.566559 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 09:05:41.566559 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 09:05:41.566559 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 09:05:41.566559 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 09:05:41.566559 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 09:05:41.567617 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 09:05:41.567617 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 09:05:41.567617 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 09:05:41.567617 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 09:05:41.567617 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 09:05:41.567617 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 09:05:41.567617 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 09:05:41.567617 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 09:05:41.567617 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 09:05:41.567617 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 09:05:41.567617 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 09:05:41.567617 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application with Lock( Jul 28 09:05:41.567617 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 09:05:41.567617 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return self._enter() Jul 28 09:05:41.567617 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 09:05:41.567617 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 09:05:41.568474 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 09:05:41.568474 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return self.creator() Jul 28 09:05:41.568474 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 09:05:41.568474 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application created_value = creator( Jul 28 09:05:41.568474 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 09:05:41.568474 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 09:05:41.568474 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 09:05:41.568474 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 09:05:41.568474 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 09:05:41.568474 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 09:05:41.568474 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 28 09:05:41.568474 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application Jul 28 09:05:41.571263 dv-cinder-851351-1-smb devstack@keystone.service[416294]: [pid: 416294|app: 0|req: 112/215] 10.222.0.42 () {56 vars in 1099 bytes} [Thu Jul 28 09:05:41 2022] GET /identity/v3/roles/member => generated 84 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 09:05:41.581976 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da97e08-b426-4a0b-8644-fe7750635709 None admin] Authenticating user token {{(pid=416293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:05:41.706992 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da97e08-b426-4a0b-8644-fe7750635709 None admin] Validating token access rules against request {{(pid=416293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:05:41.745285 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1dead54-26cb-4dfe-98c5-c4e434daccaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:05:41.746357 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1dead54-26cb-4dfe-98c5-c4e434daccaa None admin] REQUEST_METHOD: `GET` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:05:41.746859 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1dead54-26cb-4dfe-98c5-c4e434daccaa None admin] SCRIPT_NAME: `/identity` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:05:41.747332 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1dead54-26cb-4dfe-98c5-c4e434daccaa None admin] PATH_INFO: `/v3/roles` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:05:41.748283 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1dead54-26cb-4dfe-98c5-c4e434daccaa None admin] RBAC: Adding query filter params (name=member) {{(pid=416293) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 09:05:41.748818 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1dead54-26cb-4dfe-98c5-c4e434daccaa None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:05:41.750435 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1dead54-26cb-4dfe-98c5-c4e434daccaa None admin] RBAC: Authorization granted {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:05:41.760201 dv-cinder-851351-1-smb devstack@keystone.service[416293]: [pid: 416293|app: 0|req: 104/216] 10.222.0.42 () {56 vars in 1101 bytes} [Thu Jul 28 09:05:41 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:05:41.766261 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b77d86-8800-4df3-9188-e3873baab7df None admin] Authenticating user token {{(pid=416294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:05:41.877918 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b77d86-8800-4df3-9188-e3873baab7df None admin] Validating token access rules against request {{(pid=416294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:05:41.889700 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG dbcounter [-] [416294] Writing DB stats keystone:SELECT=100 {{(pid=416294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:05:41.916822 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19dba96d-adae-4bfd-addd-2b3cdc48e8f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:05:41.917491 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19dba96d-adae-4bfd-addd-2b3cdc48e8f0 None admin] REQUEST_METHOD: `GET` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:05:41.917771 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19dba96d-adae-4bfd-addd-2b3cdc48e8f0 None admin] SCRIPT_NAME: `/identity` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:05:41.918047 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19dba96d-adae-4bfd-addd-2b3cdc48e8f0 None admin] PATH_INFO: `/v3/users/ed63cc7cad4845519330ddab74fb2481` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:05:41.932636 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19dba96d-adae-4bfd-addd-2b3cdc48e8f0 None admin] RBAC: Authorizing `identity:get_user(user_id=ed63cc7cad4845519330ddab74fb2481)` {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:05:41.934173 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19dba96d-adae-4bfd-addd-2b3cdc48e8f0 None admin] RBAC: Authorization granted {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:05:41.936143 dv-cinder-851351-1-smb devstack@keystone.service[416294]: [pid: 416294|app: 0|req: 113/217] 10.222.0.42 () {56 vars in 1177 bytes} [Thu Jul 28 09:05:41 2022] GET /identity/v3/users/ed63cc7cad4845519330ddab74fb2481 => generated 297 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 09:05:41.941645 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1dead54-26cb-4dfe-98c5-c4e434daccaa None admin] Authenticating user token {{(pid=416293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:05:41.967106 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG dbcounter [-] [416293] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=416293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:05:42.061520 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1dead54-26cb-4dfe-98c5-c4e434daccaa None admin] Validating token access rules against request {{(pid=416293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:05:42.107757 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57d8f0e-d5ca-46af-a263-2e6d92808e53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:05:42.108409 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57d8f0e-d5ca-46af-a263-2e6d92808e53 None admin] REQUEST_METHOD: `GET` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:05:42.108721 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57d8f0e-d5ca-46af-a263-2e6d92808e53 None admin] SCRIPT_NAME: `/identity` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:05:42.109006 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57d8f0e-d5ca-46af-a263-2e6d92808e53 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:05:42.196424 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a57d8f0e-d5ca-46af-a263-2e6d92808e53 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:05:42.198010 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a57d8f0e-d5ca-46af-a263-2e6d92808e53 None admin] RBAC: Authorization granted {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:05:42.220414 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG dbcounter [-] [416293] Writing DB stats keystone:SELECT=100 {{(pid=416293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:05:42.327954 dv-cinder-851351-1-smb devstack@keystone.service[416293]: [pid: 416293|app: 0|req: 105/218] 10.222.0.42 () {58 vars in 1282 bytes} [Thu Jul 28 09:05:41 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 387 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 28 09:05:42.333623 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19dba96d-adae-4bfd-addd-2b3cdc48e8f0 None admin] Authenticating user token {{(pid=416294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:05:42.467161 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19dba96d-adae-4bfd-addd-2b3cdc48e8f0 None admin] Validating token access rules against request {{(pid=416294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:05:42.503339 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95727640-3ba9-4e16-acfb-86fec9270fad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:05:42.504005 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95727640-3ba9-4e16-acfb-86fec9270fad None admin] REQUEST_METHOD: `GET` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:05:42.504283 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95727640-3ba9-4e16-acfb-86fec9270fad None admin] SCRIPT_NAME: `/identity` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:05:42.504556 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95727640-3ba9-4e16-acfb-86fec9270fad None admin] PATH_INFO: `/v3/projects/5c46e2ed162f45cabaf6f30752f915a4` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:05:42.505794 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95727640-3ba9-4e16-acfb-86fec9270fad None admin] RBAC: Authorizing `identity:get_project(project_id=5c46e2ed162f45cabaf6f30752f915a4)` {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:05:42.507246 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95727640-3ba9-4e16-acfb-86fec9270fad None admin] RBAC: Authorization granted {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:05:42.509269 dv-cinder-851351-1-smb devstack@keystone.service[416294]: [pid: 416294|app: 0|req: 114/219] 10.222.0.42 () {56 vars in 1186 bytes} [Thu Jul 28 09:05:42 2022] GET /identity/v3/projects/5c46e2ed162f45cabaf6f30752f915a4 => generated 302 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:05:42.515100 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57d8f0e-d5ca-46af-a263-2e6d92808e53 None admin] Authenticating user token {{(pid=416293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:05:42.577040 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7b425c-5ce5-4a62-84c3-3df76a8a6391 None None] REQUEST_METHOD: `GET` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:05:42.577377 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7b425c-5ce5-4a62-84c3-3df76a8a6391 None None] SCRIPT_NAME: `/identity` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:05:42.577590 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7b425c-5ce5-4a62-84c3-3df76a8a6391 None None] PATH_INFO: `/` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:05:42.579042 dv-cinder-851351-1-smb devstack@keystone.service[416294]: [pid: 416294|app: 0|req: 115/220] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 09:05:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 28 09:05:42.585964 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c365c95b-2034-4655-b630-acc78eddadf6 None None] REQUEST_METHOD: `POST` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:05:42.586257 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c365c95b-2034-4655-b630-acc78eddadf6 None None] SCRIPT_NAME: `/identity` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:05:42.586540 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c365c95b-2034-4655-b630-acc78eddadf6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:05:42.621780 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.auth.core [None req-c365c95b-2034-4655-b630-acc78eddadf6 None None] MFA Rules not processed for user `dbf87abab90e4fdf9e75408f4199918e`. Rule list: `[]` (Enabled: `True`). {{(pid=416294) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 09:05:42.623011 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.fernet_utils [None req-c365c95b-2034-4655-b630-acc78eddadf6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=416294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 09:05:42.630830 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57d8f0e-d5ca-46af-a263-2e6d92808e53 None admin] Validating token access rules against request {{(pid=416293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:05:42.658423 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG dbcounter [-] [416293] Writing DB stats keystone:SELECT=100 {{(pid=416293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:05:42.670796 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0d6a26-2cd5-4891-8da9-bc622dad3c94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:05:42.671794 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0d6a26-2cd5-4891-8da9-bc622dad3c94 None admin] REQUEST_METHOD: `GET` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:05:42.672236 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0d6a26-2cd5-4891-8da9-bc622dad3c94 None admin] SCRIPT_NAME: `/identity` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:05:42.673380 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0d6a26-2cd5-4891-8da9-bc622dad3c94 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:05:42.674505 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e0d6a26-2cd5-4891-8da9-bc622dad3c94 None admin] RBAC: Adding query filter params (role.id=ba1a79dc27074d5a94dce2d994019d37, scope.project.id=5c46e2ed162f45cabaf6f30752f915a4, user.id=ed63cc7cad4845519330ddab74fb2481) {{(pid=416293) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 09:05:42.675080 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e0d6a26-2cd5-4891-8da9-bc622dad3c94 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:05:42.676776 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e0d6a26-2cd5-4891-8da9-bc622dad3c94 None admin] RBAC: Authorization granted {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:05:42.685522 dv-cinder-851351-1-smb devstack@keystone.service[416293]: [pid: 416293|app: 0|req: 106/221] 10.222.0.42 () {56 vars in 1374 bytes} [Thu Jul 28 09:05:42 2022] GET /identity/v3/role_assignments?user.id=ed63cc7cad4845519330ddab74fb2481&scope.project.id=5c46e2ed162f45cabaf6f30752f915a4&role.id=ba1a79dc27074d5a94dce2d994019d37 => generated 259 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:05:42.693034 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG dbcounter [-] [416294] Writing DB stats keystone:SELECT=100 {{(pid=416294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:05:42.755449 dv-cinder-851351-1-smb devstack@keystone.service[416294]: [pid: 416294|app: 0|req: 116/222] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 09:05:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 09:05:42.804582 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0d6a26-2cd5-4891-8da9-bc622dad3c94 None admin] Authenticating user token {{(pid=416293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:05:42.805173 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f50d29-3f9c-4e65-b4c7-9a5741f9e685 None None] REQUEST_METHOD: `GET` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:05:42.805470 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f50d29-3f9c-4e65-b4c7-9a5741f9e685 None None] SCRIPT_NAME: `/identity` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:05:42.805755 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f50d29-3f9c-4e65-b4c7-9a5741f9e685 None None] PATH_INFO: `/` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:05:42.809088 dv-cinder-851351-1-smb devstack@keystone.service[416294]: [pid: 416294|app: 0|req: 117/223] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 09:05:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 28 09:05:42.815963 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e248ab0-bcea-4eb1-b8f4-03fa56e722a7 None None] REQUEST_METHOD: `POST` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:05:42.816612 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e248ab0-bcea-4eb1-b8f4-03fa56e722a7 None None] SCRIPT_NAME: `/identity` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:05:42.817132 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e248ab0-bcea-4eb1-b8f4-03fa56e722a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:05:42.857195 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.auth.core [None req-8e248ab0-bcea-4eb1-b8f4-03fa56e722a7 None None] MFA Rules not processed for user `dbf87abab90e4fdf9e75408f4199918e`. Rule list: `[]` (Enabled: `True`). {{(pid=416294) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 09:05:42.858836 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.fernet_utils [None req-8e248ab0-bcea-4eb1-b8f4-03fa56e722a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=416294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 09:05:42.988936 dv-cinder-851351-1-smb devstack@keystone.service[416294]: [pid: 416294|app: 0|req: 118/224] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 09:05:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 28 09:05:42.996790 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0d6a26-2cd5-4891-8da9-bc622dad3c94 None admin] Validating token access rules against request {{(pid=416293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:05:43.031503 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8547d78-54d5-4339-840d-4d760887e95f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:05:43.032085 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8547d78-54d5-4339-840d-4d760887e95f None admin] REQUEST_METHOD: `GET` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:05:43.032373 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8547d78-54d5-4339-840d-4d760887e95f None admin] SCRIPT_NAME: `/identity` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:05:43.032653 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8547d78-54d5-4339-840d-4d760887e95f None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:05:43.034893 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e248ab0-bcea-4eb1-b8f4-03fa56e722a7 None None] Authenticating user token {{(pid=416294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:05:43.060592 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8547d78-54d5-4339-840d-4d760887e95f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 09:05:43.067246 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application [None req-c8547d78-54d5-4339-840d-4d760887e95f None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 28 09:05:43.067246 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 09:05:43.067246 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 09:05:43.067246 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 09:05:43.067246 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 09:05:43.067246 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 09:05:43.067246 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 09:05:43.067246 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 09:05:43.067246 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 09:05:43.067246 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 09:05:43.067246 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 09:05:43.067246 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 09:05:43.067246 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 09:05:43.067246 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 09:05:43.067246 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 09:05:43.067246 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 09:05:43.068183 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 09:05:43.068183 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 09:05:43.068183 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 09:05:43.068183 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 09:05:43.068183 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 09:05:43.068183 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 09:05:43.068183 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 09:05:43.068183 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 09:05:43.068183 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 09:05:43.068183 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 09:05:43.068183 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 09:05:43.068183 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application with Lock( Jul 28 09:05:43.068183 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 09:05:43.068183 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self._enter() Jul 28 09:05:43.068183 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 09:05:43.068183 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 09:05:43.069075 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 09:05:43.069075 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self.creator() Jul 28 09:05:43.069075 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 09:05:43.069075 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application created_value = creator( Jul 28 09:05:43.069075 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 09:05:43.069075 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 09:05:43.069075 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 09:05:43.069075 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 09:05:43.069075 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 09:05:43.069075 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 09:05:43.069075 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 28 09:05:43.069075 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application Jul 28 09:05:43.069075 dv-cinder-851351-1-smb devstack@keystone.service[416293]: [pid: 416293|app: 0|req: 107/225] 10.222.0.42 () {56 vars in 1114 bytes} [Thu Jul 28 09:05:42 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 264 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 09:05:43.080415 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8547d78-54d5-4339-840d-4d760887e95f None admin] Authenticating user token {{(pid=416293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:05:43.168820 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG dbcounter [-] [416293] Writing DB stats keystone:SELECT=100 {{(pid=416293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:05:43.228004 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG dbcounter [-] [416294] Writing DB stats keystone:SELECT=100 {{(pid=416294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:05:43.233770 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e248ab0-bcea-4eb1-b8f4-03fa56e722a7 None None] Validating token access rules against request {{(pid=416294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:05:43.278314 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8547d78-54d5-4339-840d-4d760887e95f None admin] Validating token access rules against request {{(pid=416293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:05:43.292341 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26cc4a25-c5fa-4ab5-bea3-1a3830b5b383 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:05:43.293492 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26cc4a25-c5fa-4ab5-bea3-1a3830b5b383 None admin] REQUEST_METHOD: `GET` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:05:43.295843 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26cc4a25-c5fa-4ab5-bea3-1a3830b5b383 None admin] SCRIPT_NAME: `/identity` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:05:43.296333 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26cc4a25-c5fa-4ab5-bea3-1a3830b5b383 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:05:43.324155 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26cc4a25-c5fa-4ab5-bea3-1a3830b5b383 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 09:05:43.330510 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application [None req-26cc4a25-c5fa-4ab5-bea3-1a3830b5b383 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 09:05:43.330510 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 09:05:43.330510 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 09:05:43.330510 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 09:05:43.330510 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 09:05:43.330510 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 09:05:43.330510 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 09:05:43.330510 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 09:05:43.330510 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 09:05:43.330510 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 09:05:43.330510 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 09:05:43.330510 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 09:05:43.330510 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 09:05:43.330510 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 09:05:43.330510 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 09:05:43.330510 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 09:05:43.331651 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 09:05:43.331651 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 09:05:43.331651 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 09:05:43.331651 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 09:05:43.331651 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 09:05:43.331651 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 09:05:43.331651 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 09:05:43.331651 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 09:05:43.331651 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 09:05:43.331651 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 09:05:43.331651 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 09:05:43.331651 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application with Lock( Jul 28 09:05:43.331651 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 09:05:43.331651 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return self._enter() Jul 28 09:05:43.331651 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 09:05:43.331651 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 09:05:43.332498 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 09:05:43.332498 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return self.creator() Jul 28 09:05:43.332498 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 09:05:43.332498 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application created_value = creator( Jul 28 09:05:43.332498 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 09:05:43.332498 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 09:05:43.332498 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 09:05:43.332498 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 09:05:43.332498 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 09:05:43.332498 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 09:05:43.332498 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 09:05:43.332498 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application Jul 28 09:05:43.336017 dv-cinder-851351-1-smb devstack@keystone.service[416294]: [pid: 416294|app: 0|req: 119/226] 10.222.0.42 () {56 vars in 1096 bytes} [Thu Jul 28 09:05:43 2022] GET /identity/v3/roles/admin => generated 83 bytes in 302 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 09:05:43.342753 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26cc4a25-c5fa-4ab5-bea3-1a3830b5b383 None admin] Authenticating user token {{(pid=416294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:05:43.373871 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4453f31-8897-4cfd-a62f-3bbe4e76c3aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:05:43.376137 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4453f31-8897-4cfd-a62f-3bbe4e76c3aa None admin] REQUEST_METHOD: `GET` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:05:43.377332 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4453f31-8897-4cfd-a62f-3bbe4e76c3aa None admin] SCRIPT_NAME: `/identity` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:05:43.379257 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4453f31-8897-4cfd-a62f-3bbe4e76c3aa None admin] PATH_INFO: `/v3/roles` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:05:43.380290 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4453f31-8897-4cfd-a62f-3bbe4e76c3aa None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=416293) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 09:05:43.380897 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4453f31-8897-4cfd-a62f-3bbe4e76c3aa None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:05:43.383399 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4453f31-8897-4cfd-a62f-3bbe4e76c3aa None admin] RBAC: Authorization granted {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:05:43.403627 dv-cinder-851351-1-smb devstack@keystone.service[416293]: [pid: 416293|app: 0|req: 108/227] 10.222.0.42 () {56 vars in 1111 bytes} [Thu Jul 28 09:05:43 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 323 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:05:43.407991 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4453f31-8897-4cfd-a62f-3bbe4e76c3aa None admin] Authenticating user token {{(pid=416293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:05:43.533034 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26cc4a25-c5fa-4ab5-bea3-1a3830b5b383 None admin] Validating token access rules against request {{(pid=416294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:05:43.599743 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4453f31-8897-4cfd-a62f-3bbe4e76c3aa None admin] Validating token access rules against request {{(pid=416293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:05:43.609256 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG dbcounter [-] [416293] Writing DB stats keystone:SELECT=100 {{(pid=416293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:05:43.611521 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e41d70-83f1-4c26-bfb5-88160902da51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:05:43.612215 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e41d70-83f1-4c26-bfb5-88160902da51 None admin] REQUEST_METHOD: `GET` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:05:43.612515 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e41d70-83f1-4c26-bfb5-88160902da51 None admin] SCRIPT_NAME: `/identity` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:05:43.612824 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e41d70-83f1-4c26-bfb5-88160902da51 None admin] PATH_INFO: `/v3/roles` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:05:43.613603 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3e41d70-83f1-4c26-bfb5-88160902da51 None admin] RBAC: Adding query filter params (name=admin) {{(pid=416294) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 09:05:43.613898 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3e41d70-83f1-4c26-bfb5-88160902da51 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:05:43.615306 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3e41d70-83f1-4c26-bfb5-88160902da51 None admin] RBAC: Authorization granted {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:05:43.640269 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d81be3-3dc1-494d-9ca7-bf3945fe97d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:05:43.641878 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d81be3-3dc1-494d-9ca7-bf3945fe97d4 None admin] REQUEST_METHOD: `GET` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:05:43.642364 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d81be3-3dc1-494d-9ca7-bf3945fe97d4 None admin] SCRIPT_NAME: `/identity` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:05:43.642870 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d81be3-3dc1-494d-9ca7-bf3945fe97d4 None admin] PATH_INFO: `/v3/users/738beb0bf3334354a3d964d6fadda0d8` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:05:43.644416 dv-cinder-851351-1-smb devstack@keystone.service[416294]: [pid: 416294|app: 0|req: 120/228] 10.222.0.42 () {56 vars in 1099 bytes} [Thu Jul 28 09:05:43 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 302 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:05:43.648987 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6d81be3-3dc1-494d-9ca7-bf3945fe97d4 None admin] RBAC: Authorizing `identity:get_user(user_id=738beb0bf3334354a3d964d6fadda0d8)` {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:05:43.650729 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6d81be3-3dc1-494d-9ca7-bf3945fe97d4 None admin] RBAC: Authorization granted {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:05:43.653699 dv-cinder-851351-1-smb devstack@keystone.service[416293]: [pid: 416293|app: 0|req: 109/229] 10.222.0.42 () {56 vars in 1177 bytes} [Thu Jul 28 09:05:43 2022] GET /identity/v3/users/738beb0bf3334354a3d964d6fadda0d8 => generated 283 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:05:43.657806 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d81be3-3dc1-494d-9ca7-bf3945fe97d4 None admin] Authenticating user token {{(pid=416293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:05:43.658944 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e41d70-83f1-4c26-bfb5-88160902da51 None admin] Authenticating user token {{(pid=416294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:05:43.704969 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG dbcounter [-] [416294] Writing DB stats keystone:SELECT=100 {{(pid=416294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:05:43.799613 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e41d70-83f1-4c26-bfb5-88160902da51 None admin] Validating token access rules against request {{(pid=416294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:05:43.838042 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd9ebf2-4d96-4c3b-89e4-b542482a452e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:05:43.839215 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd9ebf2-4d96-4c3b-89e4-b542482a452e None admin] REQUEST_METHOD: `GET` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:05:43.839723 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd9ebf2-4d96-4c3b-89e4-b542482a452e None admin] SCRIPT_NAME: `/identity` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:05:43.840747 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd9ebf2-4d96-4c3b-89e4-b542482a452e None admin] PATH_INFO: `/v3/users/738beb0bf3334354a3d964d6fadda0d8` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:05:43.842235 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcd9ebf2-4d96-4c3b-89e4-b542482a452e None admin] RBAC: Authorizing `identity:get_user(user_id=738beb0bf3334354a3d964d6fadda0d8)` {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:05:43.843918 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcd9ebf2-4d96-4c3b-89e4-b542482a452e None admin] RBAC: Authorization granted {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:05:43.846381 dv-cinder-851351-1-smb devstack@keystone.service[416294]: [pid: 416294|app: 0|req: 121/230] 10.222.0.42 () {56 vars in 1177 bytes} [Thu Jul 28 09:05:43 2022] GET /identity/v3/users/738beb0bf3334354a3d964d6fadda0d8 => generated 283 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:05:43.853224 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd9ebf2-4d96-4c3b-89e4-b542482a452e None admin] Authenticating user token {{(pid=416294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:05:43.955073 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG dbcounter [-] [416294] Writing DB stats keystone:SELECT=100 {{(pid=416294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:05:43.958685 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d81be3-3dc1-494d-9ca7-bf3945fe97d4 None admin] Validating token access rules against request {{(pid=416293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:05:43.975429 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd9ebf2-4d96-4c3b-89e4-b542482a452e None admin] Validating token access rules against request {{(pid=416294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:05:44.013499 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ccc0610-d1fa-469b-8351-19f55e5329c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:05:44.014717 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ccc0610-d1fa-469b-8351-19f55e5329c0 None admin] REQUEST_METHOD: `GET` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:05:44.015204 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ccc0610-d1fa-469b-8351-19f55e5329c0 None admin] SCRIPT_NAME: `/identity` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:05:44.015876 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ccc0610-d1fa-469b-8351-19f55e5329c0 None admin] PATH_INFO: `/v3/projects/5c46e2ed162f45cabaf6f30752f915a4` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:05:44.017629 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ccc0610-d1fa-469b-8351-19f55e5329c0 None admin] RBAC: Authorizing `identity:get_project(project_id=5c46e2ed162f45cabaf6f30752f915a4)` {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:05:44.019392 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ccc0610-d1fa-469b-8351-19f55e5329c0 None admin] RBAC: Authorization granted {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:05:44.021361 dv-cinder-851351-1-smb devstack@keystone.service[416294]: [pid: 416294|app: 0|req: 122/231] 10.222.0.42 () {56 vars in 1186 bytes} [Thu Jul 28 09:05:43 2022] GET /identity/v3/projects/5c46e2ed162f45cabaf6f30752f915a4 => generated 302 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 09:05:44.027332 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ccc0610-d1fa-469b-8351-19f55e5329c0 None admin] Authenticating user token {{(pid=416294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:05:44.062043 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0efadef7-0573-4de7-a86f-6d5102d7732c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:05:44.062636 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0efadef7-0573-4de7-a86f-6d5102d7732c None admin] REQUEST_METHOD: `GET` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:05:44.062927 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0efadef7-0573-4de7-a86f-6d5102d7732c None admin] SCRIPT_NAME: `/identity` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:05:44.063210 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0efadef7-0573-4de7-a86f-6d5102d7732c None admin] PATH_INFO: `/v3/projects/5c46e2ed162f45cabaf6f30752f915a4` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:05:44.069537 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0efadef7-0573-4de7-a86f-6d5102d7732c None admin] RBAC: Authorizing `identity:get_project(project_id=5c46e2ed162f45cabaf6f30752f915a4)` {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:05:44.071049 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0efadef7-0573-4de7-a86f-6d5102d7732c None admin] RBAC: Authorization granted {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:05:44.073013 dv-cinder-851351-1-smb devstack@keystone.service[416293]: [pid: 416293|app: 0|req: 110/232] 10.222.0.42 () {56 vars in 1186 bytes} [Thu Jul 28 09:05:43 2022] GET /identity/v3/projects/5c46e2ed162f45cabaf6f30752f915a4 => generated 302 bytes in 415 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:05:44.078903 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0efadef7-0573-4de7-a86f-6d5102d7732c None admin] Authenticating user token {{(pid=416293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:05:44.144435 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ccc0610-d1fa-469b-8351-19f55e5329c0 None admin] Validating token access rules against request {{(pid=416294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:05:44.163585 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG dbcounter [-] [416293] Writing DB stats keystone:SELECT=100 {{(pid=416293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:05:44.182732 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1159dc5f-7c7d-482f-bb85-edc26ef9e4ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:05:44.183621 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1159dc5f-7c7d-482f-bb85-edc26ef9e4ad None admin] REQUEST_METHOD: `PUT` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:05:44.184005 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1159dc5f-7c7d-482f-bb85-edc26ef9e4ad None admin] SCRIPT_NAME: `/identity` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:05:44.184382 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1159dc5f-7c7d-482f-bb85-edc26ef9e4ad None admin] PATH_INFO: `/v3/projects/5c46e2ed162f45cabaf6f30752f915a4/users/738beb0bf3334354a3d964d6fadda0d8/roles/c67085ec338243df8f9b7d6459036e23` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:05:44.186495 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1159dc5f-7c7d-482f-bb85-edc26ef9e4ad None admin] RBAC: Authorizing `identity:create_grant(project_id=5c46e2ed162f45cabaf6f30752f915a4, user_id=738beb0bf3334354a3d964d6fadda0d8, role_id=c67085ec338243df8f9b7d6459036e23)` {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:05:44.188361 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1159dc5f-7c7d-482f-bb85-edc26ef9e4ad None admin] RBAC: Authorization granted {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:05:44.205849 dv-cinder-851351-1-smb devstack@keystone.service[416294]: [pid: 416294|app: 0|req: 123/233] 10.222.0.42 () {58 vars in 1439 bytes} [Thu Jul 28 09:05:44 2022] PUT /identity/v3/projects/5c46e2ed162f45cabaf6f30752f915a4/users/738beb0bf3334354a3d964d6fadda0d8/roles/c67085ec338243df8f9b7d6459036e23 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 28 09:05:44.236468 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0efadef7-0573-4de7-a86f-6d5102d7732c None admin] Validating token access rules against request {{(pid=416293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:05:44.248579 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401b9dcd-1b1f-4370-a35e-b9585138d87e None None] REQUEST_METHOD: `GET` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:05:44.248930 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401b9dcd-1b1f-4370-a35e-b9585138d87e None None] SCRIPT_NAME: `/identity` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:05:44.249557 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401b9dcd-1b1f-4370-a35e-b9585138d87e None None] PATH_INFO: `/` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:05:44.250805 dv-cinder-851351-1-smb devstack@keystone.service[416294]: [pid: 416294|app: 0|req: 124/234] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 09:05:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 09:05:44.256132 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9038d1-121a-46e1-a096-628ff4aefbba None None] REQUEST_METHOD: `POST` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:05:44.256444 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9038d1-121a-46e1-a096-628ff4aefbba None None] SCRIPT_NAME: `/identity` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:05:44.256708 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9038d1-121a-46e1-a096-628ff4aefbba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:05:44.280737 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7258acbe-3f96-406c-8df1-7c672257c28a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:05:44.281966 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7258acbe-3f96-406c-8df1-7c672257c28a None admin] REQUEST_METHOD: `PUT` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:05:44.282462 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7258acbe-3f96-406c-8df1-7c672257c28a None admin] SCRIPT_NAME: `/identity` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:05:44.282977 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7258acbe-3f96-406c-8df1-7c672257c28a None admin] PATH_INFO: `/v3/projects/5c46e2ed162f45cabaf6f30752f915a4/users/738beb0bf3334354a3d964d6fadda0d8/roles/6194848862704a289bbaa3fda43a9050` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:05:44.285930 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7258acbe-3f96-406c-8df1-7c672257c28a None admin] RBAC: Authorizing `identity:create_grant(project_id=5c46e2ed162f45cabaf6f30752f915a4, user_id=738beb0bf3334354a3d964d6fadda0d8, role_id=6194848862704a289bbaa3fda43a9050)` {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:05:44.288569 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7258acbe-3f96-406c-8df1-7c672257c28a None admin] RBAC: Authorization granted {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:05:44.307817 dv-cinder-851351-1-smb devstack@keystone.service[416293]: [pid: 416293|app: 0|req: 111/235] 10.222.0.42 () {58 vars in 1439 bytes} [Thu Jul 28 09:05:44 2022] PUT /identity/v3/projects/5c46e2ed162f45cabaf6f30752f915a4/users/738beb0bf3334354a3d964d6fadda0d8/roles/6194848862704a289bbaa3fda43a9050 => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 09:05:44.312922 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.auth.core [None req-fa9038d1-121a-46e1-a096-628ff4aefbba None None] MFA Rules not processed for user `dbf87abab90e4fdf9e75408f4199918e`. Rule list: `[]` (Enabled: `True`). {{(pid=416294) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 09:05:44.312922 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.fernet_utils [None req-fa9038d1-121a-46e1-a096-628ff4aefbba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=416294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 09:05:44.341192 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG dbcounter [-] [416294] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=416294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:05:44.354545 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0dd07fc-f056-40cb-9341-01ee215b140c None None] REQUEST_METHOD: `GET` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:05:44.355382 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0dd07fc-f056-40cb-9341-01ee215b140c None None] SCRIPT_NAME: `/identity` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:05:44.355987 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0dd07fc-f056-40cb-9341-01ee215b140c None None] PATH_INFO: `/` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:05:44.359892 dv-cinder-851351-1-smb devstack@keystone.service[416293]: [pid: 416293|app: 0|req: 112/236] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 09:05:44 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 09:05:44.365780 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c579d78-d360-4f91-8cf1-c9b46268a354 None None] REQUEST_METHOD: `POST` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:05:44.366080 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c579d78-d360-4f91-8cf1-c9b46268a354 None None] SCRIPT_NAME: `/identity` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:05:44.366359 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c579d78-d360-4f91-8cf1-c9b46268a354 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:05:44.390167 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.auth.core [None req-6c579d78-d360-4f91-8cf1-c9b46268a354 None None] MFA Rules not processed for user `dbf87abab90e4fdf9e75408f4199918e`. Rule list: `[]` (Enabled: `True`). {{(pid=416293) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 09:05:44.391621 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.fernet_utils [None req-6c579d78-d360-4f91-8cf1-c9b46268a354 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=416293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 09:05:44.500169 dv-cinder-851351-1-smb devstack@keystone.service[416294]: [pid: 416294|app: 0|req: 125/237] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 09:05:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 245 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 09:05:44.515278 dv-cinder-851351-1-smb devstack@keystone.service[416293]: [pid: 416293|app: 0|req: 113/238] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 09:05:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 28 09:05:44.522592 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9038d1-121a-46e1-a096-628ff4aefbba None None] Authenticating user token {{(pid=416294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:05:44.544184 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c579d78-d360-4f91-8cf1-c9b46268a354 None None] Authenticating user token {{(pid=416293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:05:44.597030 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG dbcounter [-] [416293] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=416293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:05:44.644558 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9038d1-121a-46e1-a096-628ff4aefbba None None] Validating token access rules against request {{(pid=416294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:05:44.689707 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c579d78-d360-4f91-8cf1-c9b46268a354 None None] Validating token access rules against request {{(pid=416293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:05:44.705575 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88440035-d2e4-4f35-8ea9-0cecb5cf0b46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:05:44.706321 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88440035-d2e4-4f35-8ea9-0cecb5cf0b46 None admin] REQUEST_METHOD: `GET` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:05:44.706603 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88440035-d2e4-4f35-8ea9-0cecb5cf0b46 None admin] SCRIPT_NAME: `/identity` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:05:44.706881 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88440035-d2e4-4f35-8ea9-0cecb5cf0b46 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:05:44.728292 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88440035-d2e4-4f35-8ea9-0cecb5cf0b46 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 09:05:44.733319 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application [None req-88440035-d2e4-4f35-8ea9-0cecb5cf0b46 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 28 09:05:44.733319 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 09:05:44.733319 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 09:05:44.733319 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 09:05:44.733319 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 09:05:44.733319 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 09:05:44.733319 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 09:05:44.733319 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 09:05:44.733319 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 09:05:44.733319 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 09:05:44.733319 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 09:05:44.733319 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 09:05:44.733319 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 09:05:44.733319 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 09:05:44.733319 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 09:05:44.733319 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 09:05:44.734277 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 09:05:44.734277 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 09:05:44.734277 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 09:05:44.734277 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 09:05:44.734277 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 09:05:44.734277 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 09:05:44.734277 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 09:05:44.734277 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 09:05:44.734277 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 09:05:44.734277 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 09:05:44.734277 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 09:05:44.734277 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application with Lock( Jul 28 09:05:44.734277 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 09:05:44.734277 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return self._enter() Jul 28 09:05:44.734277 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 09:05:44.734277 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 09:05:44.735130 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 09:05:44.735130 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return self.creator() Jul 28 09:05:44.735130 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 09:05:44.735130 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application created_value = creator( Jul 28 09:05:44.735130 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 09:05:44.735130 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 09:05:44.735130 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 09:05:44.735130 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 09:05:44.735130 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 09:05:44.735130 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 09:05:44.735130 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 28 09:05:44.735130 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application Jul 28 09:05:44.736370 dv-cinder-851351-1-smb devstack@keystone.service[416294]: [pid: 416294|app: 0|req: 126/239] 10.222.0.42 () {56 vars in 1099 bytes} [Thu Jul 28 09:05:44 2022] GET /identity/v3/roles/reader => generated 84 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 09:05:44.740482 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88440035-d2e4-4f35-8ea9-0cecb5cf0b46 None admin] Authenticating user token {{(pid=416294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:05:44.750187 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG dbcounter [-] [416294] Writing DB stats keystone:SELECT=100 {{(pid=416294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:05:44.760552 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ef2aa2-f9d3-4472-b435-ef5ec0eacc35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:05:44.761252 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ef2aa2-f9d3-4472-b435-ef5ec0eacc35 None admin] REQUEST_METHOD: `GET` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:05:44.761532 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ef2aa2-f9d3-4472-b435-ef5ec0eacc35 None admin] SCRIPT_NAME: `/identity` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:05:44.761922 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ef2aa2-f9d3-4472-b435-ef5ec0eacc35 None admin] PATH_INFO: `/v3/domains/default` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:05:44.765353 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ef2aa2-f9d3-4472-b435-ef5ec0eacc35 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:05:44.766911 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ef2aa2-f9d3-4472-b435-ef5ec0eacc35 None admin] RBAC: Authorization granted {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:05:44.768751 dv-cinder-851351-1-smb devstack@keystone.service[416293]: [pid: 416293|app: 0|req: 114/240] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 09:05:44 2022] GET /identity/v3/domains/default => generated 199 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 09:05:44.777408 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ef2aa2-f9d3-4472-b435-ef5ec0eacc35 None admin] Authenticating user token {{(pid=416293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:05:44.881440 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88440035-d2e4-4f35-8ea9-0cecb5cf0b46 None admin] Validating token access rules against request {{(pid=416294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:05:44.929252 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d76e66-d8e7-4c56-b906-9c6e69461a19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:05:44.929910 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d76e66-d8e7-4c56-b906-9c6e69461a19 None admin] REQUEST_METHOD: `GET` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:05:44.930198 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d76e66-d8e7-4c56-b906-9c6e69461a19 None admin] SCRIPT_NAME: `/identity` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:05:44.930476 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d76e66-d8e7-4c56-b906-9c6e69461a19 None admin] PATH_INFO: `/v3/roles` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:05:44.931233 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d76e66-d8e7-4c56-b906-9c6e69461a19 None admin] RBAC: Adding query filter params (name=reader) {{(pid=416294) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 09:05:44.931540 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d76e66-d8e7-4c56-b906-9c6e69461a19 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:05:44.932990 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d76e66-d8e7-4c56-b906-9c6e69461a19 None admin] RBAC: Authorization granted {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:05:44.959769 dv-cinder-851351-1-smb devstack@keystone.service[416294]: [pid: 416294|app: 0|req: 127/241] 10.222.0.42 () {56 vars in 1101 bytes} [Thu Jul 28 09:05:44 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:05:44.969399 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d76e66-d8e7-4c56-b906-9c6e69461a19 None admin] Authenticating user token {{(pid=416294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:05:45.022139 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG dbcounter [-] [416293] Writing DB stats keystone:SELECT=100 {{(pid=416293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:05:45.034997 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ef2aa2-f9d3-4472-b435-ef5ec0eacc35 None admin] Validating token access rules against request {{(pid=416293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:05:45.064197 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG dbcounter [-] [416294] Writing DB stats keystone:SELECT=100 {{(pid=416294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:05:45.093277 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-424829b1-ae26-4fbb-8a6c-9b8477e4c2ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:05:45.093918 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424829b1-ae26-4fbb-8a6c-9b8477e4c2ec None admin] REQUEST_METHOD: `POST` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:05:45.094197 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424829b1-ae26-4fbb-8a6c-9b8477e4c2ec None admin] SCRIPT_NAME: `/identity` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:05:45.094473 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424829b1-ae26-4fbb-8a6c-9b8477e4c2ec None admin] PATH_INFO: `/v3/users` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:05:45.095174 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-424829b1-ae26-4fbb-8a6c-9b8477e4c2ec None admin] RBAC: Authorizing `identity:create_user()` {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:05:45.096786 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-424829b1-ae26-4fbb-8a6c-9b8477e4c2ec None admin] RBAC: Authorization granted {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:05:45.115280 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d76e66-d8e7-4c56-b906-9c6e69461a19 None admin] Validating token access rules against request {{(pid=416294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:05:45.122592 dv-cinder-851351-1-smb devstack@keystone.service[416293]: [pid: 416293|app: 0|req: 115/242] 10.222.0.42 () {60 vars in 1132 bytes} [Thu Jul 28 09:05:44 2022] POST /identity/v3/users => generated 293 bytes in 346 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 09:05:45.124350 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c6fecf-6c15-43bf-9895-c21951471bb6 None None] REQUEST_METHOD: `GET` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:05:45.124489 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c6fecf-6c15-43bf-9895-c21951471bb6 None None] SCRIPT_NAME: `/identity` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:05:45.124685 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c6fecf-6c15-43bf-9895-c21951471bb6 None None] PATH_INFO: `/` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:05:45.130847 dv-cinder-851351-1-smb devstack@keystone.service[416293]: [pid: 416293|app: 0|req: 116/243] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 09:05:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 09:05:45.132511 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87adca35-4fa9-46ae-9540-56a8782a376e None None] REQUEST_METHOD: `POST` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:05:45.132817 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87adca35-4fa9-46ae-9540-56a8782a376e None None] SCRIPT_NAME: `/identity` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:05:45.133130 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87adca35-4fa9-46ae-9540-56a8782a376e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:05:45.152385 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.auth.core [None req-87adca35-4fa9-46ae-9540-56a8782a376e None None] MFA Rules not processed for user `dbf87abab90e4fdf9e75408f4199918e`. Rule list: `[]` (Enabled: `True`). {{(pid=416293) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 09:05:45.153746 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.fernet_utils [None req-87adca35-4fa9-46ae-9540-56a8782a376e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=416293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 09:05:45.162870 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-243779bc-761d-492a-93fb-15a22a295718 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:05:45.164003 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243779bc-761d-492a-93fb-15a22a295718 None admin] REQUEST_METHOD: `GET` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:05:45.164529 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243779bc-761d-492a-93fb-15a22a295718 None admin] SCRIPT_NAME: `/identity` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:05:45.165139 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243779bc-761d-492a-93fb-15a22a295718 None admin] PATH_INFO: `/v3/users/5393134b447a4247b778c6754cc451d4` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:05:45.182676 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-243779bc-761d-492a-93fb-15a22a295718 None admin] RBAC: Authorizing `identity:get_user(user_id=5393134b447a4247b778c6754cc451d4)` {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:05:45.184966 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-243779bc-761d-492a-93fb-15a22a295718 None admin] RBAC: Authorization granted {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:05:45.187535 dv-cinder-851351-1-smb devstack@keystone.service[416294]: [pid: 416294|app: 0|req: 128/244] 10.222.0.42 () {56 vars in 1177 bytes} [Thu Jul 28 09:05:44 2022] GET /identity/v3/users/5393134b447a4247b778c6754cc451d4 => generated 297 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:05:45.193638 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-243779bc-761d-492a-93fb-15a22a295718 None admin] Authenticating user token {{(pid=416294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:05:45.236027 dv-cinder-851351-1-smb devstack@keystone.service[416293]: [pid: 416293|app: 0|req: 117/245] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 09:05:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 09:05:45.258661 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87adca35-4fa9-46ae-9540-56a8782a376e None None] Authenticating user token {{(pid=416293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:05:45.351915 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-243779bc-761d-492a-93fb-15a22a295718 None admin] Validating token access rules against request {{(pid=416294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:05:45.356331 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG dbcounter [-] [416293] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=416293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:05:45.375480 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87adca35-4fa9-46ae-9540-56a8782a376e None None] Validating token access rules against request {{(pid=416293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:05:45.391137 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG dbcounter [-] [416294] Writing DB stats keystone:SELECT=100 {{(pid=416294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:05:45.406535 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-441c5065-9fcd-4f56-aba1-ae6a95973b60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:05:45.407578 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441c5065-9fcd-4f56-aba1-ae6a95973b60 None admin] REQUEST_METHOD: `GET` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:05:45.408106 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441c5065-9fcd-4f56-aba1-ae6a95973b60 None admin] SCRIPT_NAME: `/identity` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:05:45.408593 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441c5065-9fcd-4f56-aba1-ae6a95973b60 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:05:45.447103 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f20aaca-9ee7-4c18-aa6e-1487ced86461 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:05:45.447774 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f20aaca-9ee7-4c18-aa6e-1487ced86461 None admin] REQUEST_METHOD: `GET` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:05:45.448054 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f20aaca-9ee7-4c18-aa6e-1487ced86461 None admin] SCRIPT_NAME: `/identity` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:05:45.448324 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f20aaca-9ee7-4c18-aa6e-1487ced86461 None admin] PATH_INFO: `/v3/roles/member` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:05:45.460907 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f20aaca-9ee7-4c18-aa6e-1487ced86461 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 09:05:45.466049 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application [None req-2f20aaca-9ee7-4c18-aa6e-1487ced86461 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 28 09:05:45.466049 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 09:05:45.466049 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 09:05:45.466049 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 09:05:45.466049 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 09:05:45.466049 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 09:05:45.466049 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 09:05:45.466049 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 09:05:45.466049 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 09:05:45.466049 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 09:05:45.466049 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 09:05:45.466049 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 09:05:45.466049 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 09:05:45.466049 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 09:05:45.466049 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 09:05:45.466049 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 09:05:45.467015 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 09:05:45.467015 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 09:05:45.467015 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 09:05:45.467015 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 09:05:45.467015 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 09:05:45.467015 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 09:05:45.467015 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 09:05:45.467015 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 09:05:45.467015 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 09:05:45.467015 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 09:05:45.467015 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 09:05:45.467015 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application with Lock( Jul 28 09:05:45.467015 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 09:05:45.467015 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self._enter() Jul 28 09:05:45.467015 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 09:05:45.467015 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 09:05:45.468352 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 09:05:45.468352 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self.creator() Jul 28 09:05:45.468352 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 09:05:45.468352 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application created_value = creator( Jul 28 09:05:45.468352 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 09:05:45.468352 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 09:05:45.468352 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 09:05:45.468352 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 09:05:45.468352 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 09:05:45.468352 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 09:05:45.468352 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 28 09:05:45.468352 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application Jul 28 09:05:45.468352 dv-cinder-851351-1-smb devstack@keystone.service[416293]: [pid: 416293|app: 0|req: 118/246] 10.222.0.42 () {56 vars in 1099 bytes} [Thu Jul 28 09:05:45 2022] GET /identity/v3/roles/member => generated 84 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 09:05:45.474159 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f20aaca-9ee7-4c18-aa6e-1487ced86461 None admin] Authenticating user token {{(pid=416293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:05:45.504790 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-441c5065-9fcd-4f56-aba1-ae6a95973b60 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:05:45.507175 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-441c5065-9fcd-4f56-aba1-ae6a95973b60 None admin] RBAC: Authorization granted {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:05:45.612486 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f20aaca-9ee7-4c18-aa6e-1487ced86461 None admin] Validating token access rules against request {{(pid=416293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:05:45.652624 dv-cinder-851351-1-smb devstack@keystone.service[416294]: [pid: 416294|app: 0|req: 129/247] 10.222.0.42 () {58 vars in 1282 bytes} [Thu Jul 28 09:05:45 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 460 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 28 09:05:45.657635 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-441c5065-9fcd-4f56-aba1-ae6a95973b60 None admin] Authenticating user token {{(pid=416294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:05:45.658632 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caaa9d17-0048-46b2-933d-0f0b4f3083df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:05:45.659503 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caaa9d17-0048-46b2-933d-0f0b4f3083df None admin] REQUEST_METHOD: `GET` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:05:45.659950 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caaa9d17-0048-46b2-933d-0f0b4f3083df None admin] SCRIPT_NAME: `/identity` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:05:45.660559 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caaa9d17-0048-46b2-933d-0f0b4f3083df None admin] PATH_INFO: `/v3/roles` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:05:45.662403 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caaa9d17-0048-46b2-933d-0f0b4f3083df None admin] RBAC: Adding query filter params (name=member) {{(pid=416293) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 09:05:45.662892 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caaa9d17-0048-46b2-933d-0f0b4f3083df None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:05:45.664462 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caaa9d17-0048-46b2-933d-0f0b4f3083df None admin] RBAC: Authorization granted {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:05:45.675842 dv-cinder-851351-1-smb devstack@keystone.service[416293]: [pid: 416293|app: 0|req: 119/248] 10.222.0.42 () {56 vars in 1101 bytes} [Thu Jul 28 09:05:45 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:05:45.681278 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caaa9d17-0048-46b2-933d-0f0b4f3083df None admin] Authenticating user token {{(pid=416293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:05:45.698293 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG dbcounter [-] [416294] Writing DB stats keystone:SELECT=100 {{(pid=416294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:05:45.699916 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG dbcounter [-] [416293] Writing DB stats keystone:SELECT=100 {{(pid=416293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:05:45.790317 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-441c5065-9fcd-4f56-aba1-ae6a95973b60 None admin] Validating token access rules against request {{(pid=416294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:05:45.820640 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caaa9d17-0048-46b2-933d-0f0b4f3083df None admin] Validating token access rules against request {{(pid=416293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:05:45.850742 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf68496a-746f-42ae-88e8-7915ddc0581a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:05:45.851414 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf68496a-746f-42ae-88e8-7915ddc0581a None admin] REQUEST_METHOD: `GET` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:05:45.851701 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf68496a-746f-42ae-88e8-7915ddc0581a None admin] SCRIPT_NAME: `/identity` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:05:45.851976 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf68496a-746f-42ae-88e8-7915ddc0581a None admin] PATH_INFO: `/v3/projects/5c46e2ed162f45cabaf6f30752f915a4` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:05:45.853359 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf68496a-746f-42ae-88e8-7915ddc0581a None admin] RBAC: Authorizing `identity:get_project(project_id=5c46e2ed162f45cabaf6f30752f915a4)` {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:05:45.854844 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf68496a-746f-42ae-88e8-7915ddc0581a None admin] RBAC: Authorization granted {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:05:45.856591 dv-cinder-851351-1-smb devstack@keystone.service[416294]: [pid: 416294|app: 0|req: 130/249] 10.222.0.42 () {56 vars in 1186 bytes} [Thu Jul 28 09:05:45 2022] GET /identity/v3/projects/5c46e2ed162f45cabaf6f30752f915a4 => generated 302 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 09:05:45.869572 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf68496a-746f-42ae-88e8-7915ddc0581a None admin] Authenticating user token {{(pid=416294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:05:45.875586 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb736458-f9ab-48e7-824d-f094023497a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:05:45.876545 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb736458-f9ab-48e7-824d-f094023497a2 None admin] REQUEST_METHOD: `GET` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:05:45.877134 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb736458-f9ab-48e7-824d-f094023497a2 None admin] SCRIPT_NAME: `/identity` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:05:45.877647 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb736458-f9ab-48e7-824d-f094023497a2 None admin] PATH_INFO: `/v3/users/ed63cc7cad4845519330ddab74fb2481` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:05:45.879356 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb736458-f9ab-48e7-824d-f094023497a2 None admin] RBAC: Authorizing `identity:get_user(user_id=ed63cc7cad4845519330ddab74fb2481)` {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:05:45.881375 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb736458-f9ab-48e7-824d-f094023497a2 None admin] RBAC: Authorization granted {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:05:45.883896 dv-cinder-851351-1-smb devstack@keystone.service[416293]: [pid: 416293|app: 0|req: 120/250] 10.222.0.42 () {56 vars in 1177 bytes} [Thu Jul 28 09:05:45 2022] GET /identity/v3/users/ed63cc7cad4845519330ddab74fb2481 => generated 297 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:05:45.889819 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb736458-f9ab-48e7-824d-f094023497a2 None admin] Authenticating user token {{(pid=416293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:05:45.980066 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG dbcounter [-] [416293] Writing DB stats keystone:SELECT=100 {{(pid=416293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:05:45.981745 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG dbcounter [-] [416294] Writing DB stats keystone:SELECT=100 {{(pid=416294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:05:45.993815 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf68496a-746f-42ae-88e8-7915ddc0581a None admin] Validating token access rules against request {{(pid=416294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:05:46.010187 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb736458-f9ab-48e7-824d-f094023497a2 None admin] Validating token access rules against request {{(pid=416293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:05:46.048218 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f96a3c9-f6f5-4337-8430-cbba375d6959 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:05:46.049053 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f96a3c9-f6f5-4337-8430-cbba375d6959 None admin] REQUEST_METHOD: `GET` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:05:46.049555 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f96a3c9-f6f5-4337-8430-cbba375d6959 None admin] SCRIPT_NAME: `/identity` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:05:46.049988 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f96a3c9-f6f5-4337-8430-cbba375d6959 None admin] PATH_INFO: `/v3/projects/5c46e2ed162f45cabaf6f30752f915a4` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:05:46.051309 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f96a3c9-f6f5-4337-8430-cbba375d6959 None admin] RBAC: Authorizing `identity:get_project(project_id=5c46e2ed162f45cabaf6f30752f915a4)` {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:05:46.052850 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f96a3c9-f6f5-4337-8430-cbba375d6959 None admin] RBAC: Authorization granted {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:05:46.054760 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35bc68e2-02eb-4e83-a741-74071081fda2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:05:46.054916 dv-cinder-851351-1-smb devstack@keystone.service[416293]: [pid: 416293|app: 0|req: 121/251] 10.222.0.42 () {56 vars in 1186 bytes} [Thu Jul 28 09:05:45 2022] GET /identity/v3/projects/5c46e2ed162f45cabaf6f30752f915a4 => generated 302 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:05:46.055409 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35bc68e2-02eb-4e83-a741-74071081fda2 None admin] REQUEST_METHOD: `GET` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:05:46.055700 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35bc68e2-02eb-4e83-a741-74071081fda2 None admin] SCRIPT_NAME: `/identity` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:05:46.055977 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35bc68e2-02eb-4e83-a741-74071081fda2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:05:46.056825 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35bc68e2-02eb-4e83-a741-74071081fda2 None admin] RBAC: Adding query filter params (role.id=071325426dc84e2cb2689d138bc2b032, scope.project.id=5c46e2ed162f45cabaf6f30752f915a4, user.id=5393134b447a4247b778c6754cc451d4) {{(pid=416294) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 09:05:46.057143 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35bc68e2-02eb-4e83-a741-74071081fda2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:05:46.058600 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35bc68e2-02eb-4e83-a741-74071081fda2 None admin] RBAC: Authorization granted {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:05:46.062634 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f96a3c9-f6f5-4337-8430-cbba375d6959 None admin] Authenticating user token {{(pid=416293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:05:46.065399 dv-cinder-851351-1-smb devstack@keystone.service[416294]: [pid: 416294|app: 0|req: 131/252] 10.222.0.42 () {56 vars in 1374 bytes} [Thu Jul 28 09:05:45 2022] GET /identity/v3/role_assignments?user.id=5393134b447a4247b778c6754cc451d4&scope.project.id=5c46e2ed162f45cabaf6f30752f915a4&role.id=071325426dc84e2cb2689d138bc2b032 => generated 259 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 09:05:46.228891 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f96a3c9-f6f5-4337-8430-cbba375d6959 None admin] Validating token access rules against request {{(pid=416293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:05:46.293394 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39bcba9b-4b9c-4e16-a26c-b958f8f8e06e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:05:46.294106 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39bcba9b-4b9c-4e16-a26c-b958f8f8e06e None admin] REQUEST_METHOD: `PUT` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:05:46.294397 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39bcba9b-4b9c-4e16-a26c-b958f8f8e06e None admin] SCRIPT_NAME: `/identity` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:05:46.294678 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39bcba9b-4b9c-4e16-a26c-b958f8f8e06e None admin] PATH_INFO: `/v3/projects/5c46e2ed162f45cabaf6f30752f915a4/users/ed63cc7cad4845519330ddab74fb2481/roles/ba1a79dc27074d5a94dce2d994019d37` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:05:46.296747 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39bcba9b-4b9c-4e16-a26c-b958f8f8e06e None admin] RBAC: Authorizing `identity:create_grant(project_id=5c46e2ed162f45cabaf6f30752f915a4, user_id=ed63cc7cad4845519330ddab74fb2481, role_id=ba1a79dc27074d5a94dce2d994019d37)` {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:05:46.298231 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39bcba9b-4b9c-4e16-a26c-b958f8f8e06e None admin] RBAC: Authorization granted {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:05:46.324805 dv-cinder-851351-1-smb devstack@keystone.service[416293]: [pid: 416293|app: 0|req: 122/253] 10.222.0.42 () {58 vars in 1439 bytes} [Thu Jul 28 09:05:46 2022] PUT /identity/v3/projects/5c46e2ed162f45cabaf6f30752f915a4/users/ed63cc7cad4845519330ddab74fb2481/roles/ba1a79dc27074d5a94dce2d994019d37 => generated 0 bytes in 262 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 28 09:05:46.677025 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1e5d27-de33-424b-9c70-7b40d0b3ef98 None None] REQUEST_METHOD: `GET` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:05:46.677559 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1e5d27-de33-424b-9c70-7b40d0b3ef98 None None] SCRIPT_NAME: `/identity` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:05:46.677559 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1e5d27-de33-424b-9c70-7b40d0b3ef98 None None] PATH_INFO: `/` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:05:46.678977 dv-cinder-851351-1-smb devstack@keystone.service[416294]: [pid: 416294|app: 0|req: 132/254] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 09:05:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 09:05:46.686737 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee06893-870e-42a5-bd54-8688dfc456a9 None None] REQUEST_METHOD: `POST` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:05:46.687031 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee06893-870e-42a5-bd54-8688dfc456a9 None None] SCRIPT_NAME: `/identity` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:05:46.687499 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee06893-870e-42a5-bd54-8688dfc456a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:05:46.695399 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG dbcounter [-] [416293] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=416293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:05:46.710666 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.auth.core [None req-8ee06893-870e-42a5-bd54-8688dfc456a9 None None] MFA Rules not processed for user `dbf87abab90e4fdf9e75408f4199918e`. Rule list: `[]` (Enabled: `True`). {{(pid=416293) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 09:05:46.713265 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.fernet_utils [None req-8ee06893-870e-42a5-bd54-8688dfc456a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=416293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 09:05:46.806674 dv-cinder-851351-1-smb devstack@keystone.service[416293]: [pid: 416293|app: 0|req: 123/255] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 09:05:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 09:05:46.855200 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1e5d27-de33-424b-9c70-7b40d0b3ef98 None None] Authenticating user token {{(pid=416294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:05:47.016489 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1e5d27-de33-424b-9c70-7b40d0b3ef98 None None] Validating token access rules against request {{(pid=416294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:05:47.066601 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878cc05c-8ab5-4e10-96f1-bdd5d7276558 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:05:47.067270 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878cc05c-8ab5-4e10-96f1-bdd5d7276558 None admin] REQUEST_METHOD: `GET` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:05:47.067551 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878cc05c-8ab5-4e10-96f1-bdd5d7276558 None admin] SCRIPT_NAME: `/identity` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:05:47.067838 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878cc05c-8ab5-4e10-96f1-bdd5d7276558 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:05:47.085611 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-878cc05c-8ab5-4e10-96f1-bdd5d7276558 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 09:05:47.090587 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application [None req-878cc05c-8ab5-4e10-96f1-bdd5d7276558 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 09:05:47.090587 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 09:05:47.090587 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 09:05:47.090587 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 09:05:47.090587 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 09:05:47.090587 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 09:05:47.090587 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 09:05:47.090587 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 09:05:47.090587 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 09:05:47.090587 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 09:05:47.090587 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 09:05:47.090587 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 09:05:47.090587 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 09:05:47.090587 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 09:05:47.090587 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 09:05:47.090587 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 09:05:47.091514 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 09:05:47.091514 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 09:05:47.091514 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 09:05:47.091514 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 09:05:47.091514 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 09:05:47.091514 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 09:05:47.091514 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 09:05:47.091514 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 09:05:47.091514 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 09:05:47.091514 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 09:05:47.091514 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 09:05:47.091514 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application with Lock( Jul 28 09:05:47.091514 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 09:05:47.091514 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return self._enter() Jul 28 09:05:47.091514 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 09:05:47.091514 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 09:05:47.092363 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 09:05:47.092363 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return self.creator() Jul 28 09:05:47.092363 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 09:05:47.092363 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application created_value = creator( Jul 28 09:05:47.092363 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 09:05:47.092363 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 09:05:47.092363 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 09:05:47.092363 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 09:05:47.092363 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 09:05:47.092363 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 09:05:47.092363 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 09:05:47.092363 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application Jul 28 09:05:47.092363 dv-cinder-851351-1-smb devstack@keystone.service[416294]: [pid: 416294|app: 0|req: 133/256] 10.222.0.42 () {56 vars in 1096 bytes} [Thu Jul 28 09:05:46 2022] GET /identity/v3/roles/admin => generated 83 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 09:05:47.097981 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee06893-870e-42a5-bd54-8688dfc456a9 None None] Authenticating user token {{(pid=416293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:05:47.116125 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92ec214-61be-46c3-af04-f9df83210de2 None None] REQUEST_METHOD: `GET` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:05:47.116445 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92ec214-61be-46c3-af04-f9df83210de2 None None] SCRIPT_NAME: `/identity` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:05:47.116701 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92ec214-61be-46c3-af04-f9df83210de2 None None] PATH_INFO: `/` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:05:47.118311 dv-cinder-851351-1-smb devstack@keystone.service[416294]: [pid: 416294|app: 0|req: 134/257] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 09:05:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 09:05:47.124439 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04fee2b5-df27-44f8-8533-a4fad6f8a135 None None] REQUEST_METHOD: `POST` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:05:47.124746 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04fee2b5-df27-44f8-8533-a4fad6f8a135 None None] SCRIPT_NAME: `/identity` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:05:47.125054 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04fee2b5-df27-44f8-8533-a4fad6f8a135 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:05:47.161720 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.auth.core [None req-04fee2b5-df27-44f8-8533-a4fad6f8a135 None None] MFA Rules not processed for user `dbf87abab90e4fdf9e75408f4199918e`. Rule list: `[]` (Enabled: `True`). {{(pid=416294) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 09:05:47.162956 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.fernet_utils [None req-04fee2b5-df27-44f8-8533-a4fad6f8a135 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=416294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 09:05:47.189036 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG dbcounter [-] [416294] Writing DB stats keystone:SELECT=100 {{(pid=416294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:05:47.213840 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee06893-870e-42a5-bd54-8688dfc456a9 None None] Validating token access rules against request {{(pid=416293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:05:47.250552 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f1dcbb-72e8-477c-9613-7b6497122b51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:05:47.251273 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f1dcbb-72e8-477c-9613-7b6497122b51 None admin] REQUEST_METHOD: `GET` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:05:47.251671 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f1dcbb-72e8-477c-9613-7b6497122b51 None admin] SCRIPT_NAME: `/identity` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:05:47.252055 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f1dcbb-72e8-477c-9613-7b6497122b51 None admin] PATH_INFO: `/v3/roles` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:05:47.253005 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5f1dcbb-72e8-477c-9613-7b6497122b51 None admin] RBAC: Adding query filter params (name=admin) {{(pid=416293) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 09:05:47.253529 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5f1dcbb-72e8-477c-9613-7b6497122b51 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:05:47.255188 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5f1dcbb-72e8-477c-9613-7b6497122b51 None admin] RBAC: Authorization granted {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:05:47.258278 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG dbcounter [-] [416293] Writing DB stats keystone:SELECT=100 {{(pid=416293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:05:47.276781 dv-cinder-851351-1-smb devstack@keystone.service[416293]: [pid: 416293|app: 0|req: 124/258] 10.222.0.42 () {56 vars in 1099 bytes} [Thu Jul 28 09:05:47 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:05:47.283527 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f1dcbb-72e8-477c-9613-7b6497122b51 None admin] Authenticating user token {{(pid=416293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:05:47.336784 dv-cinder-851351-1-smb devstack@keystone.service[416294]: [pid: 416294|app: 0|req: 135/259] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 09:05:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 09:05:47.398683 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04fee2b5-df27-44f8-8533-a4fad6f8a135 None None] Authenticating user token {{(pid=416294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:05:47.444195 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f1dcbb-72e8-477c-9613-7b6497122b51 None admin] Validating token access rules against request {{(pid=416293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:05:47.512332 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97d50c2-f378-4bc5-90c2-27c1ffaaf9fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:05:47.516688 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97d50c2-f378-4bc5-90c2-27c1ffaaf9fb None admin] REQUEST_METHOD: `GET` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:05:47.516688 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97d50c2-f378-4bc5-90c2-27c1ffaaf9fb None admin] SCRIPT_NAME: `/identity` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:05:47.516688 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97d50c2-f378-4bc5-90c2-27c1ffaaf9fb None admin] PATH_INFO: `/v3/users/738beb0bf3334354a3d964d6fadda0d8` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:05:47.517504 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c97d50c2-f378-4bc5-90c2-27c1ffaaf9fb None admin] RBAC: Authorizing `identity:get_user(user_id=738beb0bf3334354a3d964d6fadda0d8)` {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:05:47.519112 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c97d50c2-f378-4bc5-90c2-27c1ffaaf9fb None admin] RBAC: Authorization granted {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:05:47.521203 dv-cinder-851351-1-smb devstack@keystone.service[416293]: [pid: 416293|app: 0|req: 125/260] 10.222.0.42 () {56 vars in 1177 bytes} [Thu Jul 28 09:05:47 2022] GET /identity/v3/users/738beb0bf3334354a3d964d6fadda0d8 => generated 283 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 09:05:47.526900 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97d50c2-f378-4bc5-90c2-27c1ffaaf9fb None admin] Authenticating user token {{(pid=416293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:05:47.558841 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04fee2b5-df27-44f8-8533-a4fad6f8a135 None None] Validating token access rules against request {{(pid=416294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:05:47.602492 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47491a1b-b4e0-48e8-b3b9-50b1500c5cc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:05:47.603571 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47491a1b-b4e0-48e8-b3b9-50b1500c5cc1 None admin] REQUEST_METHOD: `GET` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:05:47.604489 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47491a1b-b4e0-48e8-b3b9-50b1500c5cc1 None admin] SCRIPT_NAME: `/identity` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:05:47.605035 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47491a1b-b4e0-48e8-b3b9-50b1500c5cc1 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:05:47.618574 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47491a1b-b4e0-48e8-b3b9-50b1500c5cc1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 09:05:47.624867 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application [None req-47491a1b-b4e0-48e8-b3b9-50b1500c5cc1 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 28 09:05:47.624867 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 09:05:47.624867 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 09:05:47.624867 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 09:05:47.624867 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 09:05:47.624867 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 09:05:47.624867 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 09:05:47.624867 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 09:05:47.624867 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 09:05:47.624867 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 09:05:47.624867 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 09:05:47.624867 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 09:05:47.624867 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 09:05:47.624867 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 09:05:47.624867 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 09:05:47.624867 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 09:05:47.625883 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 09:05:47.625883 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 09:05:47.625883 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 09:05:47.625883 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 09:05:47.625883 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 09:05:47.625883 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 09:05:47.625883 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 09:05:47.625883 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 09:05:47.625883 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 09:05:47.625883 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 09:05:47.625883 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 09:05:47.625883 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application with Lock( Jul 28 09:05:47.625883 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 09:05:47.625883 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return self._enter() Jul 28 09:05:47.625883 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 09:05:47.625883 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 09:05:47.626754 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 09:05:47.626754 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return self.creator() Jul 28 09:05:47.626754 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 09:05:47.626754 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application created_value = creator( Jul 28 09:05:47.626754 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 09:05:47.626754 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 09:05:47.626754 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 09:05:47.626754 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 09:05:47.626754 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 09:05:47.626754 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 09:05:47.626754 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 28 09:05:47.626754 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application Jul 28 09:05:47.630254 dv-cinder-851351-1-smb devstack@keystone.service[416294]: [pid: 416294|app: 0|req: 136/261] 10.222.0.42 () {56 vars in 1114 bytes} [Thu Jul 28 09:05:47 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 09:05:47.636552 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47491a1b-b4e0-48e8-b3b9-50b1500c5cc1 None admin] Authenticating user token {{(pid=416294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:05:47.647531 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG dbcounter [-] [416294] Writing DB stats keystone:SELECT=100 {{(pid=416294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:05:47.666168 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG dbcounter [-] [416293] Writing DB stats keystone:SELECT=100 {{(pid=416293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:05:47.759023 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97d50c2-f378-4bc5-90c2-27c1ffaaf9fb None admin] Validating token access rules against request {{(pid=416293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:05:47.811127 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e540cf3f-c6a6-4e7a-aac1-23b77272462c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:05:47.812133 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e540cf3f-c6a6-4e7a-aac1-23b77272462c None admin] REQUEST_METHOD: `GET` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:05:47.812688 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e540cf3f-c6a6-4e7a-aac1-23b77272462c None admin] SCRIPT_NAME: `/identity` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:05:47.813183 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e540cf3f-c6a6-4e7a-aac1-23b77272462c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:05:47.863150 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47491a1b-b4e0-48e8-b3b9-50b1500c5cc1 None admin] Validating token access rules against request {{(pid=416294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:05:47.888772 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e540cf3f-c6a6-4e7a-aac1-23b77272462c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:05:47.890623 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e540cf3f-c6a6-4e7a-aac1-23b77272462c None admin] RBAC: Authorization granted {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:05:47.969813 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG dbcounter [-] [416293] Writing DB stats keystone:SELECT=100 {{(pid=416293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:05:47.989464 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e5de59-4079-429e-8f13-a87fcae5b5c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:05:47.990119 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e5de59-4079-429e-8f13-a87fcae5b5c6 None admin] REQUEST_METHOD: `GET` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:05:47.990401 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e5de59-4079-429e-8f13-a87fcae5b5c6 None admin] SCRIPT_NAME: `/identity` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:05:47.990675 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e5de59-4079-429e-8f13-a87fcae5b5c6 None admin] PATH_INFO: `/v3/roles` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:05:47.991725 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00e5de59-4079-429e-8f13-a87fcae5b5c6 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=416294) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 09:05:47.992567 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00e5de59-4079-429e-8f13-a87fcae5b5c6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:05:47.993763 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00e5de59-4079-429e-8f13-a87fcae5b5c6 None admin] RBAC: Authorization granted {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:05:48.012548 dv-cinder-851351-1-smb devstack@keystone.service[416294]: [pid: 416294|app: 0|req: 137/262] 10.222.0.42 () {56 vars in 1111 bytes} [Thu Jul 28 09:05:47 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 377 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 09:05:48.018523 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e5de59-4079-429e-8f13-a87fcae5b5c6 None admin] Authenticating user token {{(pid=416294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:05:48.021815 dv-cinder-851351-1-smb devstack@keystone.service[416293]: [pid: 416293|app: 0|req: 126/263] 10.222.0.42 () {58 vars in 1282 bytes} [Thu Jul 28 09:05:47 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 495 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 28 09:05:48.029749 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e540cf3f-c6a6-4e7a-aac1-23b77272462c None admin] Authenticating user token {{(pid=416293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:05:48.173056 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG dbcounter [-] [416294] Writing DB stats keystone:SELECT=100 {{(pid=416294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:05:48.236127 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e540cf3f-c6a6-4e7a-aac1-23b77272462c None admin] Validating token access rules against request {{(pid=416293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:05:48.240310 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e5de59-4079-429e-8f13-a87fcae5b5c6 None admin] Validating token access rules against request {{(pid=416294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:05:48.284959 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1343047d-44c5-4903-b5a6-013c3cf1b4a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:05:48.285633 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1343047d-44c5-4903-b5a6-013c3cf1b4a0 None admin] REQUEST_METHOD: `GET` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:05:48.285925 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1343047d-44c5-4903-b5a6-013c3cf1b4a0 None admin] SCRIPT_NAME: `/identity` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:05:48.286211 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1343047d-44c5-4903-b5a6-013c3cf1b4a0 None admin] PATH_INFO: `/v3/projects/5c46e2ed162f45cabaf6f30752f915a4` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:05:48.287626 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1343047d-44c5-4903-b5a6-013c3cf1b4a0 None admin] RBAC: Authorizing `identity:get_project(project_id=5c46e2ed162f45cabaf6f30752f915a4)` {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:05:48.289161 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1343047d-44c5-4903-b5a6-013c3cf1b4a0 None admin] RBAC: Authorization granted {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:05:48.291274 dv-cinder-851351-1-smb devstack@keystone.service[416293]: [pid: 416293|app: 0|req: 127/264] 10.222.0.42 () {56 vars in 1186 bytes} [Thu Jul 28 09:05:48 2022] GET /identity/v3/projects/5c46e2ed162f45cabaf6f30752f915a4 => generated 302 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:05:48.297127 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1343047d-44c5-4903-b5a6-013c3cf1b4a0 None admin] Authenticating user token {{(pid=416293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:05:48.327349 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9169cc-b7d3-42cc-8147-0e3c4fd121e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:05:48.328039 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9169cc-b7d3-42cc-8147-0e3c4fd121e1 None admin] REQUEST_METHOD: `GET` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:05:48.328328 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9169cc-b7d3-42cc-8147-0e3c4fd121e1 None admin] SCRIPT_NAME: `/identity` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:05:48.328612 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9169cc-b7d3-42cc-8147-0e3c4fd121e1 None admin] PATH_INFO: `/v3/users/738beb0bf3334354a3d964d6fadda0d8` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:05:48.330218 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee9169cc-b7d3-42cc-8147-0e3c4fd121e1 None admin] RBAC: Authorizing `identity:get_user(user_id=738beb0bf3334354a3d964d6fadda0d8)` {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:05:48.331825 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee9169cc-b7d3-42cc-8147-0e3c4fd121e1 None admin] RBAC: Authorization granted {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:05:48.338896 dv-cinder-851351-1-smb devstack@keystone.service[416294]: [pid: 416294|app: 0|req: 138/265] 10.222.0.42 () {56 vars in 1177 bytes} [Thu Jul 28 09:05:48 2022] GET /identity/v3/users/738beb0bf3334354a3d964d6fadda0d8 => generated 283 bytes in 321 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:05:48.342313 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG dbcounter [-] [416293] Writing DB stats keystone:SELECT=100 {{(pid=416293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:05:48.346386 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9169cc-b7d3-42cc-8147-0e3c4fd121e1 None admin] Authenticating user token {{(pid=416294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:05:48.469217 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1343047d-44c5-4903-b5a6-013c3cf1b4a0 None admin] Validating token access rules against request {{(pid=416293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:05:48.517035 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2355e691-b026-4225-9e50-9c77738c7340 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:05:48.517944 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2355e691-b026-4225-9e50-9c77738c7340 None admin] REQUEST_METHOD: `GET` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:05:48.518475 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2355e691-b026-4225-9e50-9c77738c7340 None admin] SCRIPT_NAME: `/identity` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:05:48.518899 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2355e691-b026-4225-9e50-9c77738c7340 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:05:48.520193 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2355e691-b026-4225-9e50-9c77738c7340 None admin] RBAC: Adding query filter params (role.id=c67085ec338243df8f9b7d6459036e23, scope.project.id=5c46e2ed162f45cabaf6f30752f915a4, user.id=738beb0bf3334354a3d964d6fadda0d8) {{(pid=416293) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 09:05:48.520697 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2355e691-b026-4225-9e50-9c77738c7340 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:05:48.522310 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2355e691-b026-4225-9e50-9c77738c7340 None admin] RBAC: Authorization granted {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:05:48.535858 dv-cinder-851351-1-smb devstack@keystone.service[416293]: [pid: 416293|app: 0|req: 128/266] 10.222.0.42 () {56 vars in 1374 bytes} [Thu Jul 28 09:05:48 2022] GET /identity/v3/role_assignments?user.id=738beb0bf3334354a3d964d6fadda0d8&scope.project.id=5c46e2ed162f45cabaf6f30752f915a4&role.id=c67085ec338243df8f9b7d6459036e23 => generated 608 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:05:48.612382 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9169cc-b7d3-42cc-8147-0e3c4fd121e1 None admin] Validating token access rules against request {{(pid=416294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:05:48.667611 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2645f787-1218-45ab-92e5-28c576773120 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:05:48.668267 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2645f787-1218-45ab-92e5-28c576773120 None admin] REQUEST_METHOD: `GET` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:05:48.668556 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2645f787-1218-45ab-92e5-28c576773120 None admin] SCRIPT_NAME: `/identity` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:05:48.668862 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2645f787-1218-45ab-92e5-28c576773120 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:05:48.677970 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG dbcounter [-] [416294] Writing DB stats keystone:SELECT=100 {{(pid=416294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:05:48.754297 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2645f787-1218-45ab-92e5-28c576773120 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:05:48.755721 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2645f787-1218-45ab-92e5-28c576773120 None admin] RBAC: Authorization granted {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:05:49.016797 dv-cinder-851351-1-smb devstack@keystone.service[416294]: [pid: 416294|app: 0|req: 139/267] 10.222.0.42 () {58 vars in 1282 bytes} [Thu Jul 28 09:05:48 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 670 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 28 09:05:49.032713 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2355e691-b026-4225-9e50-9c77738c7340 None admin] Authenticating user token {{(pid=416293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:05:49.039755 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861a1635-0153-48ab-96b0-69f9ad251ef0 None None] REQUEST_METHOD: `GET` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:05:49.040048 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861a1635-0153-48ab-96b0-69f9ad251ef0 None None] SCRIPT_NAME: `/identity` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:05:49.040333 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861a1635-0153-48ab-96b0-69f9ad251ef0 None None] PATH_INFO: `/` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:05:49.044763 dv-cinder-851351-1-smb devstack@keystone.service[416294]: [pid: 416294|app: 0|req: 140/268] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 09:05:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 28 09:05:49.050990 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb021ad5-2e75-4292-a9c0-ac516bf33fd2 None None] REQUEST_METHOD: `POST` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:05:49.051280 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb021ad5-2e75-4292-a9c0-ac516bf33fd2 None None] SCRIPT_NAME: `/identity` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:05:49.051560 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb021ad5-2e75-4292-a9c0-ac516bf33fd2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:05:49.073235 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.auth.core [None req-cb021ad5-2e75-4292-a9c0-ac516bf33fd2 None None] MFA Rules not processed for user `dbf87abab90e4fdf9e75408f4199918e`. Rule list: `[]` (Enabled: `True`). {{(pid=416294) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 09:05:49.075165 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.fernet_utils [None req-cb021ad5-2e75-4292-a9c0-ac516bf33fd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=416294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 09:05:49.130583 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG dbcounter [-] [416294] Writing DB stats keystone:SELECT=100 {{(pid=416294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:05:49.187952 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG dbcounter [-] [416293] Writing DB stats keystone:SELECT=100 {{(pid=416293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:05:49.193065 dv-cinder-851351-1-smb devstack@keystone.service[416294]: [pid: 416294|app: 0|req: 141/269] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 09:05:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 09:05:49.194187 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e93de6-ccfb-4898-a8ea-dd9d6d768da6 None None] REQUEST_METHOD: `GET` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:05:49.194380 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2355e691-b026-4225-9e50-9c77738c7340 None admin] Validating token access rules against request {{(pid=416293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:05:49.194480 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e93de6-ccfb-4898-a8ea-dd9d6d768da6 None None] SCRIPT_NAME: `/identity` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:05:49.194742 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e93de6-ccfb-4898-a8ea-dd9d6d768da6 None None] PATH_INFO: `/` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:05:49.196124 dv-cinder-851351-1-smb devstack@keystone.service[416294]: [pid: 416294|app: 0|req: 142/270] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 09:05:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 09:05:49.205286 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb46e833-4a2d-4f90-b95a-db15f91392ce None None] REQUEST_METHOD: `GET` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:05:49.205585 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb46e833-4a2d-4f90-b95a-db15f91392ce None None] SCRIPT_NAME: `/identity` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:05:49.205915 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb46e833-4a2d-4f90-b95a-db15f91392ce None None] PATH_INFO: `/` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:05:49.209410 dv-cinder-851351-1-smb devstack@keystone.service[416294]: [pid: 416294|app: 0|req: 143/271] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 09:05:49 2022] GET /identity => generated 270 bytes in 13 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 09:05:49.212308 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36791913-efbf-4383-a535-14630c1a3307 None None] REQUEST_METHOD: `POST` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:05:49.212603 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36791913-efbf-4383-a535-14630c1a3307 None None] SCRIPT_NAME: `/identity` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:05:49.212913 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36791913-efbf-4383-a535-14630c1a3307 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:05:49.240563 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.auth.core [None req-36791913-efbf-4383-a535-14630c1a3307 None None] MFA Rules not processed for user `dbf87abab90e4fdf9e75408f4199918e`. Rule list: `[]` (Enabled: `True`). {{(pid=416294) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 09:05:49.241144 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa01fb3-20fb-46b3-a18a-1a509bd1a798 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:05:49.241870 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa01fb3-20fb-46b3-a18a-1a509bd1a798 None admin] REQUEST_METHOD: `GET` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:05:49.242195 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa01fb3-20fb-46b3-a18a-1a509bd1a798 None admin] SCRIPT_NAME: `/identity` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:05:49.242468 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa01fb3-20fb-46b3-a18a-1a509bd1a798 None admin] PATH_INFO: `/v3/projects/5c46e2ed162f45cabaf6f30752f915a4` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:05:49.243676 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aa01fb3-20fb-46b3-a18a-1a509bd1a798 None admin] RBAC: Authorizing `identity:get_project(project_id=5c46e2ed162f45cabaf6f30752f915a4)` {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:05:49.245018 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.fernet_utils [None req-36791913-efbf-4383-a535-14630c1a3307 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=416294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 09:05:49.245240 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aa01fb3-20fb-46b3-a18a-1a509bd1a798 None admin] RBAC: Authorization granted {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:05:49.247525 dv-cinder-851351-1-smb devstack@keystone.service[416293]: [pid: 416293|app: 0|req: 129/272] 10.222.0.42 () {56 vars in 1186 bytes} [Thu Jul 28 09:05:49 2022] GET /identity/v3/projects/5c46e2ed162f45cabaf6f30752f915a4 => generated 302 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:05:49.251293 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eadd4b2-5225-4855-bc9c-3cbd9e33b69d None None] REQUEST_METHOD: `POST` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:05:49.251293 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eadd4b2-5225-4855-bc9c-3cbd9e33b69d None None] SCRIPT_NAME: `/identity` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:05:49.251293 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eadd4b2-5225-4855-bc9c-3cbd9e33b69d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:05:49.273269 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.auth.core [None req-0eadd4b2-5225-4855-bc9c-3cbd9e33b69d None None] MFA Rules not processed for user `dbf87abab90e4fdf9e75408f4199918e`. Rule list: `[]` (Enabled: `True`). {{(pid=416293) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 09:05:49.274544 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.fernet_utils [None req-0eadd4b2-5225-4855-bc9c-3cbd9e33b69d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=416293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 09:05:49.332596 dv-cinder-851351-1-smb devstack@keystone.service[416294]: [pid: 416294|app: 0|req: 144/273] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 09:05:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 09:05:49.333957 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36791913-efbf-4383-a535-14630c1a3307 None None] Authenticating user token {{(pid=416294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:05:49.383018 dv-cinder-851351-1-smb devstack@keystone.service[416293]: [pid: 416293|app: 0|req: 130/274] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 09:05:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 09:05:49.383889 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eadd4b2-5225-4855-bc9c-3cbd9e33b69d None None] Authenticating user token {{(pid=416293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:05:49.452617 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG dbcounter [-] [416294] Writing DB stats keystone:SELECT=100 {{(pid=416294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:05:49.461176 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36791913-efbf-4383-a535-14630c1a3307 None None] Validating token access rules against request {{(pid=416294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:05:49.497292 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a85af42-d499-4fe8-b482-6b3022d690a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:05:49.497954 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a85af42-d499-4fe8-b482-6b3022d690a5 None admin] REQUEST_METHOD: `GET` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:05:49.498304 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a85af42-d499-4fe8-b482-6b3022d690a5 None admin] SCRIPT_NAME: `/identity` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:05:49.498574 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a85af42-d499-4fe8-b482-6b3022d690a5 None admin] PATH_INFO: `/v3/roles/member` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:05:49.501598 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG dbcounter [-] [416293] Writing DB stats keystone:SELECT=100 {{(pid=416293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:05:49.509488 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eadd4b2-5225-4855-bc9c-3cbd9e33b69d None None] Validating token access rules against request {{(pid=416293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:05:49.509777 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a85af42-d499-4fe8-b482-6b3022d690a5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 09:05:49.514799 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application [None req-0a85af42-d499-4fe8-b482-6b3022d690a5 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 28 09:05:49.514799 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 09:05:49.514799 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 09:05:49.514799 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 09:05:49.514799 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 09:05:49.514799 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 09:05:49.514799 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 09:05:49.514799 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 09:05:49.514799 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 09:05:49.514799 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 09:05:49.514799 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 09:05:49.514799 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 09:05:49.514799 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 09:05:49.514799 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 09:05:49.514799 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 09:05:49.514799 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 09:05:49.515824 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 09:05:49.515824 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 09:05:49.515824 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 09:05:49.515824 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 09:05:49.515824 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 09:05:49.515824 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 09:05:49.515824 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 09:05:49.515824 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 09:05:49.515824 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 09:05:49.515824 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 09:05:49.515824 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 09:05:49.515824 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application with Lock( Jul 28 09:05:49.515824 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 09:05:49.515824 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return self._enter() Jul 28 09:05:49.515824 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 09:05:49.515824 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 09:05:49.516779 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 09:05:49.516779 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return self.creator() Jul 28 09:05:49.516779 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 09:05:49.516779 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application created_value = creator( Jul 28 09:05:49.516779 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 09:05:49.516779 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 09:05:49.516779 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 09:05:49.516779 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 09:05:49.516779 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 09:05:49.516779 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 09:05:49.516779 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 28 09:05:49.516779 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application Jul 28 09:05:49.516779 dv-cinder-851351-1-smb devstack@keystone.service[416294]: [pid: 416294|app: 0|req: 145/275] 10.222.0.42 () {56 vars in 1099 bytes} [Thu Jul 28 09:05:49 2022] GET /identity/v3/roles/member => generated 84 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 09:05:49.516779 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a85af42-d499-4fe8-b482-6b3022d690a5 None admin] Authenticating user token {{(pid=416294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:05:49.546682 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76393b8-7859-4d7e-8fb3-063a6156b318 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:05:49.547228 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76393b8-7859-4d7e-8fb3-063a6156b318 None admin] REQUEST_METHOD: `GET` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:05:49.547651 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76393b8-7859-4d7e-8fb3-063a6156b318 None admin] SCRIPT_NAME: `/identity` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:05:49.547932 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76393b8-7859-4d7e-8fb3-063a6156b318 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:05:49.548779 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f76393b8-7859-4d7e-8fb3-063a6156b318 None admin] RBAC: Adding query filter params (role.id=6194848862704a289bbaa3fda43a9050, scope.project.id=5c46e2ed162f45cabaf6f30752f915a4, user.id=738beb0bf3334354a3d964d6fadda0d8) {{(pid=416293) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 09:05:49.549094 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f76393b8-7859-4d7e-8fb3-063a6156b318 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:05:49.550566 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f76393b8-7859-4d7e-8fb3-063a6156b318 None admin] RBAC: Authorization granted {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:05:49.556502 dv-cinder-851351-1-smb devstack@keystone.service[416293]: [pid: 416293|app: 0|req: 131/276] 10.222.0.42 () {56 vars in 1374 bytes} [Thu Jul 28 09:05:49 2022] GET /identity/v3/role_assignments?user.id=738beb0bf3334354a3d964d6fadda0d8&scope.project.id=5c46e2ed162f45cabaf6f30752f915a4&role.id=6194848862704a289bbaa3fda43a9050 => generated 608 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:05:49.557320 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76393b8-7859-4d7e-8fb3-063a6156b318 None admin] Authenticating user token {{(pid=416293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:05:49.647391 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a85af42-d499-4fe8-b482-6b3022d690a5 None admin] Validating token access rules against request {{(pid=416294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:05:49.684453 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ce9517-c6f2-492c-9d71-f6b5a8d8b09f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:05:49.685239 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ce9517-c6f2-492c-9d71-f6b5a8d8b09f None admin] REQUEST_METHOD: `GET` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:05:49.685536 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ce9517-c6f2-492c-9d71-f6b5a8d8b09f None admin] SCRIPT_NAME: `/identity` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:05:49.685820 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ce9517-c6f2-492c-9d71-f6b5a8d8b09f None admin] PATH_INFO: `/v3/roles/reader` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:05:49.688828 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76393b8-7859-4d7e-8fb3-063a6156b318 None admin] Validating token access rules against request {{(pid=416293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:05:49.697961 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33ce9517-c6f2-492c-9d71-f6b5a8d8b09f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 09:05:49.703529 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application [None req-33ce9517-c6f2-492c-9d71-f6b5a8d8b09f None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 28 09:05:49.703529 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 09:05:49.703529 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 09:05:49.703529 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 09:05:49.703529 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 09:05:49.703529 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 09:05:49.703529 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 09:05:49.703529 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 09:05:49.703529 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 09:05:49.703529 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 09:05:49.703529 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 09:05:49.703529 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 09:05:49.703529 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 09:05:49.703529 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 09:05:49.703529 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 09:05:49.703529 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 09:05:49.706560 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 09:05:49.706560 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 09:05:49.706560 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 09:05:49.706560 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 09:05:49.706560 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 09:05:49.706560 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 09:05:49.706560 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 09:05:49.706560 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 09:05:49.706560 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 09:05:49.706560 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 09:05:49.706560 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 09:05:49.706560 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application with Lock( Jul 28 09:05:49.706560 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 09:05:49.706560 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return self._enter() Jul 28 09:05:49.706560 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 09:05:49.706560 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 09:05:49.708192 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 09:05:49.708192 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return self.creator() Jul 28 09:05:49.708192 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 09:05:49.708192 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application created_value = creator( Jul 28 09:05:49.708192 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 09:05:49.708192 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 09:05:49.708192 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 09:05:49.708192 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 09:05:49.708192 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 09:05:49.708192 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 09:05:49.708192 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 28 09:05:49.708192 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application Jul 28 09:05:49.708192 dv-cinder-851351-1-smb devstack@keystone.service[416294]: [pid: 416294|app: 0|req: 146/277] 10.222.0.42 () {56 vars in 1099 bytes} [Thu Jul 28 09:05:49 2022] GET /identity/v3/roles/reader => generated 84 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 09:05:49.708192 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deae6d5a-60e8-4d79-9196-6d18b6ee1a25 None None] REQUEST_METHOD: `GET` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:05:49.711358 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deae6d5a-60e8-4d79-9196-6d18b6ee1a25 None None] SCRIPT_NAME: `/identity` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:05:49.711358 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deae6d5a-60e8-4d79-9196-6d18b6ee1a25 None None] PATH_INFO: `/` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:05:49.711358 dv-cinder-851351-1-smb devstack@keystone.service[416294]: [pid: 416294|app: 0|req: 147/278] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 09:05:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 09:05:49.711358 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deae6d5a-60e8-4d79-9196-6d18b6ee1a25 None None] Authenticating user token {{(pid=416294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:05:49.736582 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG dbcounter [-] [416294] Writing DB stats keystone:SELECT=100 {{(pid=416294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:05:49.745855 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387128bc-061c-40a6-8c1f-3285d9e971d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:05:49.746535 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387128bc-061c-40a6-8c1f-3285d9e971d8 None admin] REQUEST_METHOD: `GET` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:05:49.746823 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387128bc-061c-40a6-8c1f-3285d9e971d8 None admin] SCRIPT_NAME: `/identity` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:05:49.747393 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387128bc-061c-40a6-8c1f-3285d9e971d8 None admin] PATH_INFO: `/v3/domains/default` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:05:49.749790 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-387128bc-061c-40a6-8c1f-3285d9e971d8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:05:49.751234 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-387128bc-061c-40a6-8c1f-3285d9e971d8 None admin] RBAC: Authorization granted {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:05:49.757608 dv-cinder-851351-1-smb devstack@keystone.service[416293]: [pid: 416293|app: 0|req: 132/279] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 09:05:49 2022] GET /identity/v3/domains/default => generated 199 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:05:49.757608 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387128bc-061c-40a6-8c1f-3285d9e971d8 None admin] Authenticating user token {{(pid=416293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:05:49.795655 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG dbcounter [-] [416293] Writing DB stats keystone:SELECT=100 {{(pid=416293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:05:49.844792 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deae6d5a-60e8-4d79-9196-6d18b6ee1a25 None None] Validating token access rules against request {{(pid=416294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:05:49.874319 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387128bc-061c-40a6-8c1f-3285d9e971d8 None admin] Validating token access rules against request {{(pid=416293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:05:49.878962 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614e9fb4-205c-4426-8867-54ff385218cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:05:49.879595 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614e9fb4-205c-4426-8867-54ff385218cd None admin] REQUEST_METHOD: `GET` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:05:49.879875 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614e9fb4-205c-4426-8867-54ff385218cd None admin] SCRIPT_NAME: `/identity` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:05:49.880144 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614e9fb4-205c-4426-8867-54ff385218cd None admin] PATH_INFO: `/v3/roles` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:05:49.880941 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-614e9fb4-205c-4426-8867-54ff385218cd None admin] RBAC: Adding query filter params (name=member) {{(pid=416294) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 09:05:49.881266 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-614e9fb4-205c-4426-8867-54ff385218cd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:05:49.882702 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-614e9fb4-205c-4426-8867-54ff385218cd None admin] RBAC: Authorization granted {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:05:49.891192 dv-cinder-851351-1-smb devstack@keystone.service[416294]: [pid: 416294|app: 0|req: 148/280] 10.222.0.42 () {56 vars in 1101 bytes} [Thu Jul 28 09:05:49 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:05:49.892362 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50111e01-3681-403f-9cd6-466ecfe79436 None None] REQUEST_METHOD: `POST` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:05:49.892649 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50111e01-3681-403f-9cd6-466ecfe79436 None None] SCRIPT_NAME: `/identity` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:05:49.892959 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50111e01-3681-403f-9cd6-466ecfe79436 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:05:49.910818 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.auth.core [None req-50111e01-3681-403f-9cd6-466ecfe79436 None None] MFA Rules not processed for user `dbf87abab90e4fdf9e75408f4199918e`. Rule list: `[]` (Enabled: `True`). {{(pid=416294) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 09:05:49.912054 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.fernet_utils [None req-50111e01-3681-403f-9cd6-466ecfe79436 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=416294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 09:05:49.914568 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-481d4105-6dcd-49aa-8fe6-d00317bbd28d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:05:49.915220 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481d4105-6dcd-49aa-8fe6-d00317bbd28d None admin] REQUEST_METHOD: `GET` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:05:49.915515 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481d4105-6dcd-49aa-8fe6-d00317bbd28d None admin] SCRIPT_NAME: `/identity` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:05:49.915794 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481d4105-6dcd-49aa-8fe6-d00317bbd28d None admin] PATH_INFO: `/v3/roles` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:05:49.916534 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-481d4105-6dcd-49aa-8fe6-d00317bbd28d None admin] RBAC: Adding query filter params (name=reader) {{(pid=416293) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 09:05:49.916885 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-481d4105-6dcd-49aa-8fe6-d00317bbd28d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:05:49.918294 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-481d4105-6dcd-49aa-8fe6-d00317bbd28d None admin] RBAC: Authorization granted {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:05:49.927344 dv-cinder-851351-1-smb devstack@keystone.service[416293]: [pid: 416293|app: 0|req: 133/281] 10.222.0.42 () {56 vars in 1101 bytes} [Thu Jul 28 09:05:49 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:05:49.928166 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-481d4105-6dcd-49aa-8fe6-d00317bbd28d None admin] Authenticating user token {{(pid=416293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:05:49.985053 dv-cinder-851351-1-smb devstack@keystone.service[416294]: [pid: 416294|app: 0|req: 149/282] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 09:05:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 09:05:49.986014 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50111e01-3681-403f-9cd6-466ecfe79436 None None] Authenticating user token {{(pid=416294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:05:49.997478 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG dbcounter [-] [416294] Writing DB stats keystone:SELECT=100 {{(pid=416294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:05:50.025816 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG dbcounter [-] [416293] Writing DB stats keystone:SELECT=100 {{(pid=416293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:05:50.038278 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-481d4105-6dcd-49aa-8fe6-d00317bbd28d None admin] Validating token access rules against request {{(pid=416293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:05:50.072258 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6940dee3-e74b-4815-8f25-026dd6317729 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:05:50.072934 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6940dee3-e74b-4815-8f25-026dd6317729 None admin] REQUEST_METHOD: `POST` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:05:50.073218 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6940dee3-e74b-4815-8f25-026dd6317729 None admin] SCRIPT_NAME: `/identity` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:05:50.073499 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6940dee3-e74b-4815-8f25-026dd6317729 None admin] PATH_INFO: `/v3/users` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:05:50.074545 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6940dee3-e74b-4815-8f25-026dd6317729 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:05:50.076016 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6940dee3-e74b-4815-8f25-026dd6317729 None admin] RBAC: Authorization granted {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:05:50.096152 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50111e01-3681-403f-9cd6-466ecfe79436 None None] Validating token access rules against request {{(pid=416294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:05:50.097742 dv-cinder-851351-1-smb devstack@keystone.service[416293]: [pid: 416293|app: 0|req: 134/283] 10.222.0.42 () {60 vars in 1132 bytes} [Thu Jul 28 09:05:49 2022] POST /identity/v3/users => generated 293 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 09:05:50.098573 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6940dee3-e74b-4815-8f25-026dd6317729 None admin] Authenticating user token {{(pid=416293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:05:50.158270 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a30806-f900-44d8-af0e-71a31661b3c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:05:50.159100 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a30806-f900-44d8-af0e-71a31661b3c9 None admin] REQUEST_METHOD: `GET` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:05:50.159541 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a30806-f900-44d8-af0e-71a31661b3c9 None admin] SCRIPT_NAME: `/identity` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:05:50.159655 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a30806-f900-44d8-af0e-71a31661b3c9 None admin] PATH_INFO: `/v3/users/b63827f02a6649269cc2876fffc32174` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:05:50.175963 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a30806-f900-44d8-af0e-71a31661b3c9 None admin] RBAC: Authorizing `identity:get_user(user_id=b63827f02a6649269cc2876fffc32174)` {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:05:50.177562 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a30806-f900-44d8-af0e-71a31661b3c9 None admin] RBAC: Authorization granted {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:05:50.179380 dv-cinder-851351-1-smb devstack@keystone.service[416294]: [pid: 416294|app: 0|req: 150/284] 10.222.0.42 () {56 vars in 1177 bytes} [Thu Jul 28 09:05:49 2022] GET /identity/v3/users/b63827f02a6649269cc2876fffc32174 => generated 293 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:05:50.180238 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a30806-f900-44d8-af0e-71a31661b3c9 None admin] Authenticating user token {{(pid=416294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:05:50.230028 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6940dee3-e74b-4815-8f25-026dd6317729 None admin] Validating token access rules against request {{(pid=416293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:05:50.255701 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG dbcounter [-] [416294] Writing DB stats keystone:SELECT=100 {{(pid=416294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:05:50.266503 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0fe2d73-4c97-4a6e-b6af-15d804f7545a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:05:50.267597 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0fe2d73-4c97-4a6e-b6af-15d804f7545a None admin] REQUEST_METHOD: `GET` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:05:50.267597 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0fe2d73-4c97-4a6e-b6af-15d804f7545a None admin] SCRIPT_NAME: `/identity` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:05:50.267793 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0fe2d73-4c97-4a6e-b6af-15d804f7545a None admin] PATH_INFO: `/v3/users/5393134b447a4247b778c6754cc451d4` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:05:50.269212 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0fe2d73-4c97-4a6e-b6af-15d804f7545a None admin] RBAC: Authorizing `identity:get_user(user_id=5393134b447a4247b778c6754cc451d4)` {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:05:50.270670 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0fe2d73-4c97-4a6e-b6af-15d804f7545a None admin] RBAC: Authorization granted {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:05:50.272916 dv-cinder-851351-1-smb devstack@keystone.service[416293]: [pid: 416293|app: 0|req: 135/285] 10.222.0.42 () {56 vars in 1177 bytes} [Thu Jul 28 09:05:50 2022] GET /identity/v3/users/5393134b447a4247b778c6754cc451d4 => generated 297 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:05:50.272916 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0fe2d73-4c97-4a6e-b6af-15d804f7545a None admin] Authenticating user token {{(pid=416293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:05:50.288322 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG dbcounter [-] [416293] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=416293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:05:50.309334 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a30806-f900-44d8-af0e-71a31661b3c9 None admin] Validating token access rules against request {{(pid=416294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:05:50.357026 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9852a6-8355-4410-81d7-78dccf7b37f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:05:50.357766 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9852a6-8355-4410-81d7-78dccf7b37f5 None admin] REQUEST_METHOD: `GET` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:05:50.361310 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9852a6-8355-4410-81d7-78dccf7b37f5 None admin] SCRIPT_NAME: `/identity` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:05:50.361310 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9852a6-8355-4410-81d7-78dccf7b37f5 None admin] PATH_INFO: `/v3/roles/member` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:05:50.377913 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa9852a6-8355-4410-81d7-78dccf7b37f5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 09:05:50.383160 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application [None req-fa9852a6-8355-4410-81d7-78dccf7b37f5 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 28 09:05:50.383160 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 09:05:50.383160 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 09:05:50.383160 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 09:05:50.383160 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 09:05:50.383160 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 09:05:50.383160 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 09:05:50.383160 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 09:05:50.383160 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 09:05:50.383160 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 09:05:50.383160 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 09:05:50.383160 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 09:05:50.383160 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 09:05:50.383160 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 09:05:50.383160 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 09:05:50.383160 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 09:05:50.384167 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 09:05:50.384167 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 09:05:50.384167 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 09:05:50.384167 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 09:05:50.384167 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 09:05:50.384167 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 09:05:50.384167 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 09:05:50.384167 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 09:05:50.384167 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 09:05:50.384167 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 09:05:50.384167 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 09:05:50.384167 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application with Lock( Jul 28 09:05:50.384167 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 09:05:50.384167 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return self._enter() Jul 28 09:05:50.384167 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 09:05:50.384167 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 09:05:50.385097 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 09:05:50.385097 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return self.creator() Jul 28 09:05:50.385097 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 09:05:50.385097 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application created_value = creator( Jul 28 09:05:50.385097 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 09:05:50.385097 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 09:05:50.385097 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 09:05:50.385097 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 09:05:50.385097 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 09:05:50.385097 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 09:05:50.385097 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 28 09:05:50.385097 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application Jul 28 09:05:50.385097 dv-cinder-851351-1-smb devstack@keystone.service[416294]: [pid: 416294|app: 0|req: 151/286] 10.222.0.42 () {56 vars in 1099 bytes} [Thu Jul 28 09:05:50 2022] GET /identity/v3/roles/member => generated 84 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 09:05:50.386324 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9852a6-8355-4410-81d7-78dccf7b37f5 None admin] Authenticating user token {{(pid=416294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:05:50.403952 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0fe2d73-4c97-4a6e-b6af-15d804f7545a None admin] Validating token access rules against request {{(pid=416293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:05:50.449276 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd85947-b018-4207-9741-e42dadc0f9c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:05:50.449923 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd85947-b018-4207-9741-e42dadc0f9c5 None admin] REQUEST_METHOD: `GET` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:05:50.450213 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd85947-b018-4207-9741-e42dadc0f9c5 None admin] SCRIPT_NAME: `/identity` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:05:50.450497 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd85947-b018-4207-9741-e42dadc0f9c5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:05:50.451308 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dd85947-b018-4207-9741-e42dadc0f9c5 None admin] RBAC: Adding query filter params (role.id=ba1a79dc27074d5a94dce2d994019d37, user.id=b63827f02a6649269cc2876fffc32174, scope.system=all) {{(pid=416293) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 09:05:50.451624 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dd85947-b018-4207-9741-e42dadc0f9c5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:05:50.453334 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dd85947-b018-4207-9741-e42dadc0f9c5 None admin] RBAC: Authorization granted {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:05:50.459303 dv-cinder-851351-1-smb devstack@keystone.service[416293]: [pid: 416293|app: 0|req: 136/287] 10.222.0.42 () {56 vars in 1308 bytes} [Thu Jul 28 09:05:50 2022] GET /identity/v3/role_assignments?user.id=b63827f02a6649269cc2876fffc32174&scope.system=all&role.id=ba1a79dc27074d5a94dce2d994019d37 => generated 226 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:05:50.460302 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd85947-b018-4207-9741-e42dadc0f9c5 None admin] Authenticating user token {{(pid=416293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:05:50.539348 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9852a6-8355-4410-81d7-78dccf7b37f5 None admin] Validating token access rules against request {{(pid=416294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:05:50.569553 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG dbcounter [-] [416294] Writing DB stats keystone:SELECT=100 {{(pid=416294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:05:50.577853 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG dbcounter [-] [416293] Writing DB stats keystone:SELECT=100 {{(pid=416293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:05:50.581240 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e56a55e-8488-4b97-9ab4-0aca3a3f27dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:05:50.582252 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e56a55e-8488-4b97-9ab4-0aca3a3f27dd None admin] REQUEST_METHOD: `GET` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:05:50.582768 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e56a55e-8488-4b97-9ab4-0aca3a3f27dd None admin] SCRIPT_NAME: `/identity` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:05:50.583314 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e56a55e-8488-4b97-9ab4-0aca3a3f27dd None admin] PATH_INFO: `/v3/projects/5c46e2ed162f45cabaf6f30752f915a4` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:05:50.584892 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e56a55e-8488-4b97-9ab4-0aca3a3f27dd None admin] RBAC: Authorizing `identity:get_project(project_id=5c46e2ed162f45cabaf6f30752f915a4)` {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:05:50.586632 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e56a55e-8488-4b97-9ab4-0aca3a3f27dd None admin] RBAC: Authorization granted {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:05:50.588713 dv-cinder-851351-1-smb devstack@keystone.service[416294]: [pid: 416294|app: 0|req: 152/288] 10.222.0.42 () {56 vars in 1186 bytes} [Thu Jul 28 09:05:50 2022] GET /identity/v3/projects/5c46e2ed162f45cabaf6f30752f915a4 => generated 302 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:05:50.595174 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e56a55e-8488-4b97-9ab4-0aca3a3f27dd None admin] Authenticating user token {{(pid=416294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:05:50.608546 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd85947-b018-4207-9741-e42dadc0f9c5 None admin] Validating token access rules against request {{(pid=416293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:05:50.654850 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f026eec-2d56-4070-99db-5acb71255b71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:05:50.655512 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f026eec-2d56-4070-99db-5acb71255b71 None admin] REQUEST_METHOD: `GET` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:05:50.655794 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f026eec-2d56-4070-99db-5acb71255b71 None admin] SCRIPT_NAME: `/identity` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:05:50.656079 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f026eec-2d56-4070-99db-5acb71255b71 None admin] PATH_INFO: `/v3/roles` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:05:50.656861 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f026eec-2d56-4070-99db-5acb71255b71 None admin] RBAC: Adding query filter params (name=member) {{(pid=416293) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 09:05:50.657169 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f026eec-2d56-4070-99db-5acb71255b71 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:05:50.658594 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f026eec-2d56-4070-99db-5acb71255b71 None admin] RBAC: Authorization granted {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:05:50.682921 dv-cinder-851351-1-smb devstack@keystone.service[416293]: [pid: 416293|app: 0|req: 137/289] 10.222.0.42 () {56 vars in 1101 bytes} [Thu Jul 28 09:05:50 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:05:50.689025 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f026eec-2d56-4070-99db-5acb71255b71 None admin] Authenticating user token {{(pid=416293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:05:50.761127 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e56a55e-8488-4b97-9ab4-0aca3a3f27dd None admin] Validating token access rules against request {{(pid=416294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:05:50.818129 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f198955c-1ee9-40f8-8a13-9930e7f5b518 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:05:50.818832 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f198955c-1ee9-40f8-8a13-9930e7f5b518 None admin] REQUEST_METHOD: `PUT` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:05:50.819165 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f198955c-1ee9-40f8-8a13-9930e7f5b518 None admin] SCRIPT_NAME: `/identity` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:05:50.819445 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f198955c-1ee9-40f8-8a13-9930e7f5b518 None admin] PATH_INFO: `/v3/projects/5c46e2ed162f45cabaf6f30752f915a4/users/5393134b447a4247b778c6754cc451d4/roles/071325426dc84e2cb2689d138bc2b032` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:05:50.824352 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f198955c-1ee9-40f8-8a13-9930e7f5b518 None admin] RBAC: Authorizing `identity:create_grant(project_id=5c46e2ed162f45cabaf6f30752f915a4, user_id=5393134b447a4247b778c6754cc451d4, role_id=071325426dc84e2cb2689d138bc2b032)` {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:05:50.825847 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f198955c-1ee9-40f8-8a13-9930e7f5b518 None admin] RBAC: Authorization granted {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:05:50.851578 dv-cinder-851351-1-smb devstack@keystone.service[416294]: [pid: 416294|app: 0|req: 153/290] 10.222.0.42 () {58 vars in 1439 bytes} [Thu Jul 28 09:05:50 2022] PUT /identity/v3/projects/5c46e2ed162f45cabaf6f30752f915a4/users/5393134b447a4247b778c6754cc451d4/roles/071325426dc84e2cb2689d138bc2b032 => generated 0 bytes in 257 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 28 09:05:50.881271 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f026eec-2d56-4070-99db-5acb71255b71 None admin] Validating token access rules against request {{(pid=416293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:05:50.919122 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5fc7cf-1e05-4a14-a9bc-21314ef28757 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:05:50.919802 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5fc7cf-1e05-4a14-a9bc-21314ef28757 None admin] REQUEST_METHOD: `GET` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:05:50.920083 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5fc7cf-1e05-4a14-a9bc-21314ef28757 None admin] SCRIPT_NAME: `/identity` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:05:50.920360 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5fc7cf-1e05-4a14-a9bc-21314ef28757 None admin] PATH_INFO: `/v3/users/ed63cc7cad4845519330ddab74fb2481` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:05:50.921681 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b5fc7cf-1e05-4a14-a9bc-21314ef28757 None admin] RBAC: Authorizing `identity:get_user(user_id=ed63cc7cad4845519330ddab74fb2481)` {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:05:50.923246 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b5fc7cf-1e05-4a14-a9bc-21314ef28757 None admin] RBAC: Authorization granted {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:05:50.925482 dv-cinder-851351-1-smb devstack@keystone.service[416293]: [pid: 416293|app: 0|req: 138/291] 10.222.0.42 () {56 vars in 1177 bytes} [Thu Jul 28 09:05:50 2022] GET /identity/v3/users/ed63cc7cad4845519330ddab74fb2481 => generated 297 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:05:50.933229 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f198955c-1ee9-40f8-8a13-9930e7f5b518 None admin] Authenticating user token {{(pid=416294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:05:51.015649 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG dbcounter [-] [416294] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=416294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:05:51.080991 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f198955c-1ee9-40f8-8a13-9930e7f5b518 None admin] Validating token access rules against request {{(pid=416294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:05:51.128200 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f7d5f7-8def-4338-aa1f-7b732e67be2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:05:51.129334 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f7d5f7-8def-4338-aa1f-7b732e67be2d None admin] REQUEST_METHOD: `GET` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:05:51.129849 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f7d5f7-8def-4338-aa1f-7b732e67be2d None admin] SCRIPT_NAME: `/identity` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:05:51.130369 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f7d5f7-8def-4338-aa1f-7b732e67be2d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:05:51.262390 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3f7d5f7-8def-4338-aa1f-7b732e67be2d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:05:51.265268 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3f7d5f7-8def-4338-aa1f-7b732e67be2d None admin] RBAC: Authorization granted {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:05:51.366663 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG dbcounter [-] [416294] Writing DB stats keystone:SELECT=100 {{(pid=416294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:05:51.451333 dv-cinder-851351-1-smb devstack@keystone.service[416294]: [pid: 416294|app: 0|req: 154/292] 10.222.0.42 () {58 vars in 1282 bytes} [Thu Jul 28 09:05:50 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 519 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 28 09:05:51.461078 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5fc7cf-1e05-4a14-a9bc-21314ef28757 None admin] Authenticating user token {{(pid=416293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:05:51.477478 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG dbcounter [-] [416293] Writing DB stats keystone:SELECT=100 {{(pid=416293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:05:51.579258 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5fc7cf-1e05-4a14-a9bc-21314ef28757 None admin] Validating token access rules against request {{(pid=416293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:05:51.614747 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b7b7ed-652d-427c-bf75-1a7264a4eea3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:05:51.615418 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b7b7ed-652d-427c-bf75-1a7264a4eea3 None admin] REQUEST_METHOD: `GET` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:05:51.615705 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b7b7ed-652d-427c-bf75-1a7264a4eea3 None admin] SCRIPT_NAME: `/identity` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:05:51.615983 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b7b7ed-652d-427c-bf75-1a7264a4eea3 None admin] PATH_INFO: `/v3/projects/5c46e2ed162f45cabaf6f30752f915a4` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:05:51.617238 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b7b7ed-652d-427c-bf75-1a7264a4eea3 None admin] RBAC: Authorizing `identity:get_project(project_id=5c46e2ed162f45cabaf6f30752f915a4)` {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:05:51.618711 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b7b7ed-652d-427c-bf75-1a7264a4eea3 None admin] RBAC: Authorization granted {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:05:51.624910 dv-cinder-851351-1-smb devstack@keystone.service[416293]: [pid: 416293|app: 0|req: 139/293] 10.222.0.42 () {56 vars in 1186 bytes} [Thu Jul 28 09:05:51 2022] GET /identity/v3/projects/5c46e2ed162f45cabaf6f30752f915a4 => generated 302 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:05:51.626933 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f7d5f7-8def-4338-aa1f-7b732e67be2d None admin] Authenticating user token {{(pid=416294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:05:51.737831 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f7d5f7-8def-4338-aa1f-7b732e67be2d None admin] Validating token access rules against request {{(pid=416294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:05:51.804387 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0557b0d4-d269-47a2-9698-f9aebb269c5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:05:51.805465 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0557b0d4-d269-47a2-9698-f9aebb269c5e None admin] REQUEST_METHOD: `GET` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:05:51.806078 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0557b0d4-d269-47a2-9698-f9aebb269c5e None admin] SCRIPT_NAME: `/identity` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:05:51.806579 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0557b0d4-d269-47a2-9698-f9aebb269c5e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:05:51.807631 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0557b0d4-d269-47a2-9698-f9aebb269c5e None admin] RBAC: Adding query filter params (role.id=ba1a79dc27074d5a94dce2d994019d37, scope.project.id=5c46e2ed162f45cabaf6f30752f915a4, user.id=ed63cc7cad4845519330ddab74fb2481) {{(pid=416294) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 09:05:51.808151 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0557b0d4-d269-47a2-9698-f9aebb269c5e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:05:51.809841 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0557b0d4-d269-47a2-9698-f9aebb269c5e None admin] RBAC: Authorization granted {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:05:51.817340 dv-cinder-851351-1-smb devstack@keystone.service[416294]: [pid: 416294|app: 0|req: 155/294] 10.222.0.42 () {56 vars in 1374 bytes} [Thu Jul 28 09:05:51 2022] GET /identity/v3/role_assignments?user.id=ed63cc7cad4845519330ddab74fb2481&scope.project.id=5c46e2ed162f45cabaf6f30752f915a4&role.id=ba1a79dc27074d5a94dce2d994019d37 => generated 608 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:05:52.616884 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ca9c19-1501-46c6-b20b-b627a160de2c None None] REQUEST_METHOD: `GET` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:05:52.617423 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ca9c19-1501-46c6-b20b-b627a160de2c None None] SCRIPT_NAME: `/identity` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:05:52.617423 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ca9c19-1501-46c6-b20b-b627a160de2c None None] PATH_INFO: `/` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:05:52.619056 dv-cinder-851351-1-smb devstack@keystone.service[416293]: [pid: 416293|app: 0|req: 140/295] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 09:05:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 09:05:52.632549 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37528c43-0b53-4646-8e17-6cdce317e34d None None] REQUEST_METHOD: `POST` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:05:52.633096 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37528c43-0b53-4646-8e17-6cdce317e34d None None] SCRIPT_NAME: `/identity` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:05:52.633175 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37528c43-0b53-4646-8e17-6cdce317e34d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:05:52.654558 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.auth.core [None req-37528c43-0b53-4646-8e17-6cdce317e34d None None] MFA Rules not processed for user `dbf87abab90e4fdf9e75408f4199918e`. Rule list: `[]` (Enabled: `True`). {{(pid=416294) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 09:05:52.656539 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.fernet_utils [None req-37528c43-0b53-4646-8e17-6cdce317e34d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=416294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 09:05:52.677218 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7125b3-d35b-4d1f-a1b5-c69d52f56c4a None None] REQUEST_METHOD: `GET` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:05:52.677431 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7125b3-d35b-4d1f-a1b5-c69d52f56c4a None None] SCRIPT_NAME: `/identity` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:05:52.677707 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7125b3-d35b-4d1f-a1b5-c69d52f56c4a None None] PATH_INFO: `/` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:05:52.682972 dv-cinder-851351-1-smb devstack@keystone.service[416293]: [pid: 416293|app: 0|req: 141/296] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 09:05:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 28 09:05:52.683162 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG dbcounter [-] [416294] Writing DB stats keystone:SELECT=100 {{(pid=416294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:05:52.685734 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad711f5-a71d-4468-bf87-8d3a47d3b060 None None] REQUEST_METHOD: `POST` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:05:52.687123 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad711f5-a71d-4468-bf87-8d3a47d3b060 None None] SCRIPT_NAME: `/identity` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:05:52.687123 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad711f5-a71d-4468-bf87-8d3a47d3b060 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:05:52.715198 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.auth.core [None req-3ad711f5-a71d-4468-bf87-8d3a47d3b060 None None] MFA Rules not processed for user `dbf87abab90e4fdf9e75408f4199918e`. Rule list: `[]` (Enabled: `True`). {{(pid=416293) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 09:05:52.716365 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.fernet_utils [None req-3ad711f5-a71d-4468-bf87-8d3a47d3b060 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=416293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 09:05:52.772215 dv-cinder-851351-1-smb devstack@keystone.service[416294]: [pid: 416294|app: 0|req: 156/297] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 09:05:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 28 09:05:52.796621 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37528c43-0b53-4646-8e17-6cdce317e34d None None] Authenticating user token {{(pid=416294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:05:52.805063 dv-cinder-851351-1-smb devstack@keystone.service[416293]: [pid: 416293|app: 0|req: 142/298] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 09:05:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 28 09:05:52.828511 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad711f5-a71d-4468-bf87-8d3a47d3b060 None None] Authenticating user token {{(pid=416293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:05:52.832552 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG dbcounter [-] [416293] Writing DB stats keystone:SELECT=100 {{(pid=416293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:05:52.916876 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37528c43-0b53-4646-8e17-6cdce317e34d None None] Validating token access rules against request {{(pid=416294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:05:52.949011 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad711f5-a71d-4468-bf87-8d3a47d3b060 None None] Validating token access rules against request {{(pid=416293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:05:52.958924 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623052a0-7d1a-417e-9f80-43c1f02968f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:05:52.959827 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623052a0-7d1a-417e-9f80-43c1f02968f9 None admin] REQUEST_METHOD: `GET` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:05:52.960328 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623052a0-7d1a-417e-9f80-43c1f02968f9 None admin] SCRIPT_NAME: `/identity` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:05:52.960575 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623052a0-7d1a-417e-9f80-43c1f02968f9 None admin] PATH_INFO: `/v3/domains/default` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:05:52.961819 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-623052a0-7d1a-417e-9f80-43c1f02968f9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:05:52.963319 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-623052a0-7d1a-417e-9f80-43c1f02968f9 None admin] RBAC: Authorization granted {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:05:52.969841 dv-cinder-851351-1-smb devstack@keystone.service[416294]: [pid: 416294|app: 0|req: 157/299] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 09:05:52 2022] GET /identity/v3/domains/default => generated 199 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 09:05:52.971270 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7cdaba9-0124-4208-a5d7-cfc440b0946d None None] REQUEST_METHOD: `GET` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:05:52.971592 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7cdaba9-0124-4208-a5d7-cfc440b0946d None None] SCRIPT_NAME: `/identity` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:05:52.971960 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7cdaba9-0124-4208-a5d7-cfc440b0946d None None] PATH_INFO: `/` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:05:52.976707 dv-cinder-851351-1-smb devstack@keystone.service[416294]: [pid: 416294|app: 0|req: 158/300] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 09:05:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 09:05:52.976707 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7cdaba9-0124-4208-a5d7-cfc440b0946d None None] Authenticating user token {{(pid=416294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:05:52.998457 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG dbcounter [-] [416294] Writing DB stats keystone:SELECT=100 {{(pid=416294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:05:53.004967 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec4fc92-08c6-4d91-8ca7-40abb005deee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:05:53.006377 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec4fc92-08c6-4d91-8ca7-40abb005deee None admin] REQUEST_METHOD: `GET` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:05:53.006377 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec4fc92-08c6-4d91-8ca7-40abb005deee None admin] SCRIPT_NAME: `/identity` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:05:53.006377 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec4fc92-08c6-4d91-8ca7-40abb005deee None admin] PATH_INFO: `/v3/roles/reader` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:05:53.018016 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ec4fc92-08c6-4d91-8ca7-40abb005deee None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 09:05:53.023191 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application [None req-2ec4fc92-08c6-4d91-8ca7-40abb005deee None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 28 09:05:53.023191 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 09:05:53.023191 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 09:05:53.023191 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 09:05:53.023191 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 09:05:53.023191 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 09:05:53.023191 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 09:05:53.023191 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 09:05:53.023191 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 09:05:53.023191 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 09:05:53.023191 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 09:05:53.023191 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 09:05:53.023191 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 09:05:53.023191 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 09:05:53.023191 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 09:05:53.023191 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 09:05:53.024194 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 09:05:53.024194 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 09:05:53.024194 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 09:05:53.024194 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 09:05:53.024194 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 09:05:53.024194 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 09:05:53.024194 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 09:05:53.024194 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 09:05:53.024194 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 09:05:53.024194 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 09:05:53.024194 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 09:05:53.024194 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application with Lock( Jul 28 09:05:53.024194 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 09:05:53.024194 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self._enter() Jul 28 09:05:53.024194 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 09:05:53.024194 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 09:05:53.025104 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 09:05:53.025104 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self.creator() Jul 28 09:05:53.025104 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 09:05:53.025104 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application created_value = creator( Jul 28 09:05:53.025104 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 09:05:53.025104 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 09:05:53.025104 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 09:05:53.025104 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 09:05:53.025104 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 09:05:53.025104 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 09:05:53.025104 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 28 09:05:53.025104 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application Jul 28 09:05:53.025104 dv-cinder-851351-1-smb devstack@keystone.service[416293]: [pid: 416293|app: 0|req: 143/301] 10.222.0.42 () {56 vars in 1099 bytes} [Thu Jul 28 09:05:52 2022] GET /identity/v3/roles/reader => generated 84 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 09:05:53.025829 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3460edac-d582-40a4-88ae-47901e149d11 None None] REQUEST_METHOD: `POST` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:05:53.026442 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3460edac-d582-40a4-88ae-47901e149d11 None None] SCRIPT_NAME: `/identity` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:05:53.026832 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3460edac-d582-40a4-88ae-47901e149d11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:05:53.046662 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.auth.core [None req-3460edac-d582-40a4-88ae-47901e149d11 None None] MFA Rules not processed for user `dbf87abab90e4fdf9e75408f4199918e`. Rule list: `[]` (Enabled: `True`). {{(pid=416293) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 09:05:53.047879 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.fernet_utils [None req-3460edac-d582-40a4-88ae-47901e149d11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=416293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 09:05:53.107190 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7cdaba9-0124-4208-a5d7-cfc440b0946d None None] Validating token access rules against request {{(pid=416294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:05:53.118672 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG dbcounter [-] [416293] Writing DB stats keystone:SELECT=100 {{(pid=416293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:05:53.131258 dv-cinder-851351-1-smb devstack@keystone.service[416293]: [pid: 416293|app: 0|req: 144/302] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 09:05:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 09:05:53.132138 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3460edac-d582-40a4-88ae-47901e149d11 None None] Authenticating user token {{(pid=416293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:05:53.167853 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900ba33a-f57b-4f45-9fa2-ac25f6f9d662 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:05:53.168520 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900ba33a-f57b-4f45-9fa2-ac25f6f9d662 None admin] REQUEST_METHOD: `POST` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:05:53.168849 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900ba33a-f57b-4f45-9fa2-ac25f6f9d662 None admin] SCRIPT_NAME: `/identity` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:05:53.169137 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900ba33a-f57b-4f45-9fa2-ac25f6f9d662 None admin] PATH_INFO: `/v3/groups` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:05:53.169820 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-900ba33a-f57b-4f45-9fa2-ac25f6f9d662 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:05:53.171324 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-900ba33a-f57b-4f45-9fa2-ac25f6f9d662 None admin] RBAC: Authorization granted {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:05:53.196702 dv-cinder-851351-1-smb devstack@keystone.service[416294]: [pid: 416294|app: 0|req: 159/303] 10.222.0.42 () {60 vars in 1134 bytes} [Thu Jul 28 09:05:52 2022] POST /identity/v3/groups => generated 229 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 09:05:53.196702 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900ba33a-f57b-4f45-9fa2-ac25f6f9d662 None admin] Authenticating user token {{(pid=416294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:05:53.291536 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3460edac-d582-40a4-88ae-47901e149d11 None None] Validating token access rules against request {{(pid=416293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:05:53.302578 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG dbcounter [-] [416294] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=416294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:05:53.337853 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900ba33a-f57b-4f45-9fa2-ac25f6f9d662 None admin] Validating token access rules against request {{(pid=416294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:05:53.342499 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83621126-a469-495e-86c3-d99eb7116ea8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:05:53.343261 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83621126-a469-495e-86c3-d99eb7116ea8 None admin] REQUEST_METHOD: `GET` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:05:53.343614 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83621126-a469-495e-86c3-d99eb7116ea8 None admin] SCRIPT_NAME: `/identity` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:05:53.343966 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83621126-a469-495e-86c3-d99eb7116ea8 None admin] PATH_INFO: `/v3/roles` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:05:53.344839 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83621126-a469-495e-86c3-d99eb7116ea8 None admin] RBAC: Adding query filter params (name=reader) {{(pid=416293) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 09:05:53.345214 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83621126-a469-495e-86c3-d99eb7116ea8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:05:53.346849 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83621126-a469-495e-86c3-d99eb7116ea8 None admin] RBAC: Authorization granted {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:05:53.364239 dv-cinder-851351-1-smb devstack@keystone.service[416293]: [pid: 416293|app: 0|req: 145/304] 10.222.0.42 () {56 vars in 1101 bytes} [Thu Jul 28 09:05:53 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:05:53.365932 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83621126-a469-495e-86c3-d99eb7116ea8 None admin] Authenticating user token {{(pid=416293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:05:53.396862 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b677dd-d6b6-4a4b-8904-d4831798321c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:05:53.397536 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b677dd-d6b6-4a4b-8904-d4831798321c None admin] REQUEST_METHOD: `GET` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:05:53.397819 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b677dd-d6b6-4a4b-8904-d4831798321c None admin] SCRIPT_NAME: `/identity` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:05:53.398094 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b677dd-d6b6-4a4b-8904-d4831798321c None admin] PATH_INFO: `/v3/roles/member` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:05:53.413858 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5b677dd-d6b6-4a4b-8904-d4831798321c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 09:05:53.420165 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application [None req-b5b677dd-d6b6-4a4b-8904-d4831798321c None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 28 09:05:53.420165 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 09:05:53.420165 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 09:05:53.420165 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 09:05:53.420165 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 09:05:53.420165 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 09:05:53.420165 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 09:05:53.420165 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 09:05:53.420165 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 09:05:53.420165 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 09:05:53.420165 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 09:05:53.420165 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 09:05:53.420165 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 09:05:53.420165 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 09:05:53.420165 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 09:05:53.420165 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 09:05:53.421173 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 09:05:53.421173 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 09:05:53.421173 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 09:05:53.421173 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 09:05:53.421173 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 09:05:53.421173 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 09:05:53.421173 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 09:05:53.421173 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 09:05:53.421173 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 09:05:53.421173 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 09:05:53.421173 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 09:05:53.421173 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application with Lock( Jul 28 09:05:53.421173 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 09:05:53.421173 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return self._enter() Jul 28 09:05:53.421173 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 09:05:53.421173 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 09:05:53.422049 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 09:05:53.422049 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return self.creator() Jul 28 09:05:53.422049 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 09:05:53.422049 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application created_value = creator( Jul 28 09:05:53.422049 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 09:05:53.422049 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 09:05:53.422049 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 09:05:53.422049 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 09:05:53.422049 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 09:05:53.422049 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 09:05:53.422049 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 28 09:05:53.422049 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application Jul 28 09:05:53.422692 dv-cinder-851351-1-smb devstack@keystone.service[416294]: [pid: 416294|app: 0|req: 160/305] 10.222.0.42 () {56 vars in 1099 bytes} [Thu Jul 28 09:05:53 2022] GET /identity/v3/roles/member => generated 84 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 09:05:53.431406 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b677dd-d6b6-4a4b-8904-d4831798321c None admin] Authenticating user token {{(pid=416294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:05:53.446827 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG dbcounter [-] [416293] Writing DB stats keystone:SELECT=100 {{(pid=416293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:05:53.527790 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83621126-a469-495e-86c3-d99eb7116ea8 None admin] Validating token access rules against request {{(pid=416293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:05:53.558036 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b677dd-d6b6-4a4b-8904-d4831798321c None admin] Validating token access rules against request {{(pid=416294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:05:53.570546 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed3830f-dd5c-4e6b-b1f8-70579ff818d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:05:53.571230 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed3830f-dd5c-4e6b-b1f8-70579ff818d6 None admin] REQUEST_METHOD: `GET` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:05:53.571516 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed3830f-dd5c-4e6b-b1f8-70579ff818d6 None admin] SCRIPT_NAME: `/identity` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:05:53.571822 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed3830f-dd5c-4e6b-b1f8-70579ff818d6 None admin] PATH_INFO: `/v3/users/8fbb6d684807450cbaf19b215d6079ce` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:05:53.590912 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed3830f-dd5c-4e6b-b1f8-70579ff818d6 None admin] RBAC: Authorizing `identity:get_user(user_id=8fbb6d684807450cbaf19b215d6079ce)` {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:05:53.592523 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed3830f-dd5c-4e6b-b1f8-70579ff818d6 None admin] RBAC: Authorization granted {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:05:53.594629 dv-cinder-851351-1-smb devstack@keystone.service[416293]: [pid: 416293|app: 0|req: 146/306] 10.222.0.42 () {56 vars in 1177 bytes} [Thu Jul 28 09:05:53 2022] GET /identity/v3/users/8fbb6d684807450cbaf19b215d6079ce => generated 293 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 09:05:53.599103 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a3d4b1-a3ba-4546-9891-d5ea97c24a34 None None] REQUEST_METHOD: `GET` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:05:53.599887 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a3d4b1-a3ba-4546-9891-d5ea97c24a34 None None] SCRIPT_NAME: `/identity` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:05:53.600471 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a3d4b1-a3ba-4546-9891-d5ea97c24a34 None None] PATH_INFO: `/` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:05:53.603099 dv-cinder-851351-1-smb devstack@keystone.service[416293]: [pid: 416293|app: 0|req: 147/307] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 09:05:53 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 09:05:53.604282 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a3d4b1-a3ba-4546-9891-d5ea97c24a34 None None] Authenticating user token {{(pid=416293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:05:53.610408 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c2dc00-a23c-4183-826c-bbca5e5c988c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:05:53.611063 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c2dc00-a23c-4183-826c-bbca5e5c988c None admin] REQUEST_METHOD: `GET` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:05:53.611356 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c2dc00-a23c-4183-826c-bbca5e5c988c None admin] SCRIPT_NAME: `/identity` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:05:53.611634 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c2dc00-a23c-4183-826c-bbca5e5c988c None admin] PATH_INFO: `/v3/roles` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:05:53.612455 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3c2dc00-a23c-4183-826c-bbca5e5c988c None admin] RBAC: Adding query filter params (name=member) {{(pid=416294) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 09:05:53.612796 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3c2dc00-a23c-4183-826c-bbca5e5c988c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:05:53.614220 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3c2dc00-a23c-4183-826c-bbca5e5c988c None admin] RBAC: Authorization granted {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:05:53.616973 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG dbcounter [-] [416294] Writing DB stats keystone:SELECT=100 {{(pid=416294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:05:53.630947 dv-cinder-851351-1-smb devstack@keystone.service[416294]: [pid: 416294|app: 0|req: 161/308] 10.222.0.42 () {56 vars in 1101 bytes} [Thu Jul 28 09:05:53 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:05:53.630947 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418ffa71-8f12-49a6-be1d-dc77e18cfc6a None None] REQUEST_METHOD: `POST` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:05:53.630947 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418ffa71-8f12-49a6-be1d-dc77e18cfc6a None None] SCRIPT_NAME: `/identity` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:05:53.630947 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418ffa71-8f12-49a6-be1d-dc77e18cfc6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:05:53.647855 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.auth.core [None req-418ffa71-8f12-49a6-be1d-dc77e18cfc6a None None] MFA Rules not processed for user `dbf87abab90e4fdf9e75408f4199918e`. Rule list: `[]` (Enabled: `True`). {{(pid=416294) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 09:05:53.649124 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.fernet_utils [None req-418ffa71-8f12-49a6-be1d-dc77e18cfc6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=416294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 09:05:53.734735 dv-cinder-851351-1-smb devstack@keystone.service[416294]: [pid: 416294|app: 0|req: 162/309] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 09:05:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 09:05:53.735347 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-418ffa71-8f12-49a6-be1d-dc77e18cfc6a None None] Authenticating user token {{(pid=416294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:05:53.770192 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a3d4b1-a3ba-4546-9891-d5ea97c24a34 None None] Validating token access rules against request {{(pid=416293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:05:53.786989 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG dbcounter [-] [416293] Writing DB stats keystone:SELECT=100 {{(pid=416293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:05:53.813929 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d812c0c0-154f-4b54-be99-b4e338300981 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:05:53.814664 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d812c0c0-154f-4b54-be99-b4e338300981 None admin] REQUEST_METHOD: `GET` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:05:53.815045 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d812c0c0-154f-4b54-be99-b4e338300981 None admin] SCRIPT_NAME: `/identity` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:05:53.815531 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d812c0c0-154f-4b54-be99-b4e338300981 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:05:53.816620 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d812c0c0-154f-4b54-be99-b4e338300981 None admin] RBAC: Adding query filter params (role.id=071325426dc84e2cb2689d138bc2b032, user.id=8fbb6d684807450cbaf19b215d6079ce, scope.system=all) {{(pid=416293) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 09:05:53.816620 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d812c0c0-154f-4b54-be99-b4e338300981 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:05:53.818143 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d812c0c0-154f-4b54-be99-b4e338300981 None admin] RBAC: Authorization granted {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:05:53.833011 dv-cinder-851351-1-smb devstack@keystone.service[416293]: [pid: 416293|app: 0|req: 148/310] 10.222.0.42 () {56 vars in 1308 bytes} [Thu Jul 28 09:05:53 2022] GET /identity/v3/role_assignments?user.id=8fbb6d684807450cbaf19b215d6079ce&scope.system=all&role.id=071325426dc84e2cb2689d138bc2b032 => generated 226 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:05:53.833011 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d812c0c0-154f-4b54-be99-b4e338300981 None admin] Authenticating user token {{(pid=416293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:05:53.889007 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-418ffa71-8f12-49a6-be1d-dc77e18cfc6a None None] Validating token access rules against request {{(pid=416294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:05:53.932772 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG dbcounter [-] [416294] Writing DB stats keystone:SELECT=100 {{(pid=416294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:05:53.943910 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cdc96be-a1b4-47c4-914c-6c578bcdbbe2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:05:53.945034 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cdc96be-a1b4-47c4-914c-6c578bcdbbe2 None admin] REQUEST_METHOD: `GET` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:05:53.945446 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cdc96be-a1b4-47c4-914c-6c578bcdbbe2 None admin] SCRIPT_NAME: `/identity` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:05:53.945812 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cdc96be-a1b4-47c4-914c-6c578bcdbbe2 None admin] PATH_INFO: `/v3/users/b63827f02a6649269cc2876fffc32174` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:05:53.946615 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d812c0c0-154f-4b54-be99-b4e338300981 None admin] Validating token access rules against request {{(pid=416293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:05:53.947350 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cdc96be-a1b4-47c4-914c-6c578bcdbbe2 None admin] RBAC: Authorizing `identity:get_user(user_id=b63827f02a6649269cc2876fffc32174)` {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:05:53.950702 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cdc96be-a1b4-47c4-914c-6c578bcdbbe2 None admin] RBAC: Authorization granted {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:05:53.952998 dv-cinder-851351-1-smb devstack@keystone.service[416294]: [pid: 416294|app: 0|req: 163/311] 10.222.0.42 () {56 vars in 1177 bytes} [Thu Jul 28 09:05:53 2022] GET /identity/v3/users/b63827f02a6649269cc2876fffc32174 => generated 293 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:05:53.958723 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cdc96be-a1b4-47c4-914c-6c578bcdbbe2 None admin] Authenticating user token {{(pid=416294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:05:53.996199 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd61ade5-e7bc-4e10-adee-d0ec93168ae3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:05:53.997198 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd61ade5-e7bc-4e10-adee-d0ec93168ae3 None admin] REQUEST_METHOD: `GET` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:05:53.997641 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd61ade5-e7bc-4e10-adee-d0ec93168ae3 None admin] SCRIPT_NAME: `/identity` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:05:53.998096 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd61ade5-e7bc-4e10-adee-d0ec93168ae3 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:05:54.013031 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd61ade5-e7bc-4e10-adee-d0ec93168ae3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 09:05:54.020988 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application [None req-fd61ade5-e7bc-4e10-adee-d0ec93168ae3 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 28 09:05:54.020988 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 09:05:54.020988 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 09:05:54.020988 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 09:05:54.020988 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 09:05:54.020988 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 09:05:54.020988 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 09:05:54.020988 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 09:05:54.020988 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 09:05:54.020988 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 09:05:54.020988 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 09:05:54.020988 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 09:05:54.020988 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 09:05:54.020988 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 09:05:54.020988 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 09:05:54.020988 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 09:05:54.022232 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 09:05:54.022232 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 09:05:54.022232 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 09:05:54.022232 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 09:05:54.022232 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 09:05:54.022232 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 09:05:54.022232 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 09:05:54.022232 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 09:05:54.022232 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 09:05:54.022232 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 09:05:54.022232 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 09:05:54.022232 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application with Lock( Jul 28 09:05:54.022232 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 09:05:54.022232 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self._enter() Jul 28 09:05:54.022232 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 09:05:54.022232 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 09:05:54.023270 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 09:05:54.023270 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self.creator() Jul 28 09:05:54.023270 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 09:05:54.023270 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application created_value = creator( Jul 28 09:05:54.023270 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 09:05:54.023270 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 09:05:54.023270 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 09:05:54.023270 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 09:05:54.023270 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 09:05:54.023270 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 09:05:54.023270 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 28 09:05:54.023270 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application Jul 28 09:05:54.031029 dv-cinder-851351-1-smb devstack@keystone.service[416293]: [pid: 416293|app: 0|req: 149/312] 10.222.0.42 () {56 vars in 1099 bytes} [Thu Jul 28 09:05:53 2022] GET /identity/v3/roles/reader => generated 84 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 09:05:54.031648 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd61ade5-e7bc-4e10-adee-d0ec93168ae3 None admin] Authenticating user token {{(pid=416293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:05:54.090337 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG dbcounter [-] [416293] Writing DB stats keystone:SELECT=100 {{(pid=416293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:05:54.116925 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cdc96be-a1b4-47c4-914c-6c578bcdbbe2 None admin] Validating token access rules against request {{(pid=416294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:05:54.162790 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ba39a1-bf86-42ab-ae10-bf6e5ce5cd19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:05:54.163901 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ba39a1-bf86-42ab-ae10-bf6e5ce5cd19 None admin] REQUEST_METHOD: `PUT` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:05:54.164419 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ba39a1-bf86-42ab-ae10-bf6e5ce5cd19 None admin] SCRIPT_NAME: `/identity` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:05:54.164529 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd61ade5-e7bc-4e10-adee-d0ec93168ae3 None admin] Validating token access rules against request {{(pid=416293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:05:54.165033 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ba39a1-bf86-42ab-ae10-bf6e5ce5cd19 None admin] PATH_INFO: `/v3/system/users/b63827f02a6649269cc2876fffc32174/roles/ba1a79dc27074d5a94dce2d994019d37` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:05:54.168063 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70ba39a1-bf86-42ab-ae10-bf6e5ce5cd19 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=b63827f02a6649269cc2876fffc32174, role_id=ba1a79dc27074d5a94dce2d994019d37)` {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:05:54.169825 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70ba39a1-bf86-42ab-ae10-bf6e5ce5cd19 None admin] RBAC: Authorization granted {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:05:54.181521 dv-cinder-851351-1-smb devstack@keystone.service[416294]: [pid: 416294|app: 0|req: 164/313] 10.222.0.42 () {58 vars in 1334 bytes} [Thu Jul 28 09:05:53 2022] PUT /identity/v3/system/users/b63827f02a6649269cc2876fffc32174/roles/ba1a79dc27074d5a94dce2d994019d37 => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 28 09:05:54.224200 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e641052-612d-4024-9fee-d689bd63a3c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:05:54.225338 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e641052-612d-4024-9fee-d689bd63a3c6 None admin] REQUEST_METHOD: `GET` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:05:54.225829 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e641052-612d-4024-9fee-d689bd63a3c6 None admin] SCRIPT_NAME: `/identity` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:05:54.226305 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e641052-612d-4024-9fee-d689bd63a3c6 None admin] PATH_INFO: `/v3/roles` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:05:54.227372 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e641052-612d-4024-9fee-d689bd63a3c6 None admin] RBAC: Adding query filter params (name=reader) {{(pid=416293) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 09:05:54.227940 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e641052-612d-4024-9fee-d689bd63a3c6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:05:54.229636 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e641052-612d-4024-9fee-d689bd63a3c6 None admin] RBAC: Authorization granted {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:05:54.240364 dv-cinder-851351-1-smb devstack@keystone.service[416293]: [pid: 416293|app: 0|req: 150/314] 10.222.0.42 () {56 vars in 1101 bytes} [Thu Jul 28 09:05:54 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:05:54.246969 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ba39a1-bf86-42ab-ae10-bf6e5ce5cd19 None admin] Authenticating user token {{(pid=416294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:05:54.321415 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG dbcounter [-] [416294] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=416294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:05:54.371370 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ba39a1-bf86-42ab-ae10-bf6e5ce5cd19 None admin] Validating token access rules against request {{(pid=416294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:05:54.413494 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6c941a-2169-4ffd-8a27-8985ff59fdcc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:05:54.414160 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6c941a-2169-4ffd-8a27-8985ff59fdcc None admin] REQUEST_METHOD: `GET` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:05:54.414443 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6c941a-2169-4ffd-8a27-8985ff59fdcc None admin] SCRIPT_NAME: `/identity` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:05:54.414723 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6c941a-2169-4ffd-8a27-8985ff59fdcc None admin] PATH_INFO: `/v3/users/5393134b447a4247b778c6754cc451d4` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:05:54.415940 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de6c941a-2169-4ffd-8a27-8985ff59fdcc None admin] RBAC: Authorizing `identity:get_user(user_id=5393134b447a4247b778c6754cc451d4)` {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:05:54.417458 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de6c941a-2169-4ffd-8a27-8985ff59fdcc None admin] RBAC: Authorization granted {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:05:54.419422 dv-cinder-851351-1-smb devstack@keystone.service[416294]: [pid: 416294|app: 0|req: 165/315] 10.222.0.42 () {56 vars in 1177 bytes} [Thu Jul 28 09:05:54 2022] GET /identity/v3/users/5393134b447a4247b778c6754cc451d4 => generated 297 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:05:54.425329 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e641052-612d-4024-9fee-d689bd63a3c6 None admin] Authenticating user token {{(pid=416293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:05:54.534638 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e641052-612d-4024-9fee-d689bd63a3c6 None admin] Validating token access rules against request {{(pid=416293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:05:54.536311 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG dbcounter [-] [416293] Writing DB stats keystone:SELECT=100 {{(pid=416293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:05:54.571512 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b54b38a0-4575-4323-8799-b4de00fb127e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:05:54.572156 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54b38a0-4575-4323-8799-b4de00fb127e None admin] REQUEST_METHOD: `GET` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:05:54.572439 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54b38a0-4575-4323-8799-b4de00fb127e None admin] SCRIPT_NAME: `/identity` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:05:54.572752 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54b38a0-4575-4323-8799-b4de00fb127e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:05:54.646600 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b54b38a0-4575-4323-8799-b4de00fb127e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:05:54.648104 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b54b38a0-4575-4323-8799-b4de00fb127e None admin] RBAC: Authorization granted {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:05:54.753476 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG dbcounter [-] [416293] Writing DB stats keystone:SELECT=100 {{(pid=416293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:05:54.758162 dv-cinder-851351-1-smb devstack@keystone.service[416293]: [pid: 416293|app: 0|req: 151/316] 10.222.0.42 () {58 vars in 1282 bytes} [Thu Jul 28 09:05:54 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 28 09:05:54.763900 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6c941a-2169-4ffd-8a27-8985ff59fdcc None admin] Authenticating user token {{(pid=416294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:05:54.876134 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6c941a-2169-4ffd-8a27-8985ff59fdcc None admin] Validating token access rules against request {{(pid=416294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:05:54.905993 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG dbcounter [-] [416294] Writing DB stats keystone:SELECT=100 {{(pid=416294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:05:54.915171 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b0fc5c-b8f6-433e-bdc4-58dc135fa73d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:05:54.916125 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b0fc5c-b8f6-433e-bdc4-58dc135fa73d None admin] REQUEST_METHOD: `GET` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:05:54.916609 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b0fc5c-b8f6-433e-bdc4-58dc135fa73d None admin] SCRIPT_NAME: `/identity` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:05:54.917115 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b0fc5c-b8f6-433e-bdc4-58dc135fa73d None admin] PATH_INFO: `/v3/projects/5c46e2ed162f45cabaf6f30752f915a4` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:05:54.918502 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13b0fc5c-b8f6-433e-bdc4-58dc135fa73d None admin] RBAC: Authorizing `identity:get_project(project_id=5c46e2ed162f45cabaf6f30752f915a4)` {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:05:54.920142 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13b0fc5c-b8f6-433e-bdc4-58dc135fa73d None admin] RBAC: Authorization granted {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:05:54.922394 dv-cinder-851351-1-smb devstack@keystone.service[416294]: [pid: 416294|app: 0|req: 166/317] 10.222.0.42 () {56 vars in 1186 bytes} [Thu Jul 28 09:05:54 2022] GET /identity/v3/projects/5c46e2ed162f45cabaf6f30752f915a4 => generated 302 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:05:54.928690 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b54b38a0-4575-4323-8799-b4de00fb127e None admin] Authenticating user token {{(pid=416293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:05:55.052152 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b54b38a0-4575-4323-8799-b4de00fb127e None admin] Validating token access rules against request {{(pid=416293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:05:55.090150 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2530b41-438b-47fa-a1c1-e6bd686634b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:05:55.091181 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2530b41-438b-47fa-a1c1-e6bd686634b6 None admin] REQUEST_METHOD: `GET` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:05:55.091679 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2530b41-438b-47fa-a1c1-e6bd686634b6 None admin] SCRIPT_NAME: `/identity` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:05:55.092191 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2530b41-438b-47fa-a1c1-e6bd686634b6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:05:55.093261 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2530b41-438b-47fa-a1c1-e6bd686634b6 None admin] RBAC: Adding query filter params (role.id=071325426dc84e2cb2689d138bc2b032, scope.project.id=5c46e2ed162f45cabaf6f30752f915a4, user.id=5393134b447a4247b778c6754cc451d4) {{(pid=416293) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 09:05:55.093806 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2530b41-438b-47fa-a1c1-e6bd686634b6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:05:55.095508 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2530b41-438b-47fa-a1c1-e6bd686634b6 None admin] RBAC: Authorization granted {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:05:55.103172 dv-cinder-851351-1-smb devstack@keystone.service[416293]: [pid: 416293|app: 0|req: 152/318] 10.222.0.42 () {56 vars in 1374 bytes} [Thu Jul 28 09:05:54 2022] GET /identity/v3/role_assignments?user.id=5393134b447a4247b778c6754cc451d4&scope.project.id=5c46e2ed162f45cabaf6f30752f915a4&role.id=071325426dc84e2cb2689d138bc2b032 => generated 608 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:05:55.446447 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f79458-9a29-4419-b1fc-8100ec98a321 None None] REQUEST_METHOD: `GET` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:05:55.446707 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f79458-9a29-4419-b1fc-8100ec98a321 None None] SCRIPT_NAME: `/identity` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:05:55.446999 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f79458-9a29-4419-b1fc-8100ec98a321 None None] PATH_INFO: `/` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:05:55.449432 dv-cinder-851351-1-smb devstack@keystone.service[416294]: [pid: 416294|app: 0|req: 167/319] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 09:05:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 09:05:55.455496 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55fdab73-ef03-47f6-96e6-0ba4056298b0 None None] REQUEST_METHOD: `POST` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:05:55.455861 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55fdab73-ef03-47f6-96e6-0ba4056298b0 None None] SCRIPT_NAME: `/identity` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:05:55.456063 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55fdab73-ef03-47f6-96e6-0ba4056298b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:05:55.477557 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.auth.core [None req-55fdab73-ef03-47f6-96e6-0ba4056298b0 None None] MFA Rules not processed for user `dbf87abab90e4fdf9e75408f4199918e`. Rule list: `[]` (Enabled: `True`). {{(pid=416293) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 09:05:55.478776 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.fernet_utils [None req-55fdab73-ef03-47f6-96e6-0ba4056298b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=416293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 09:05:55.556687 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG dbcounter [-] [416293] Writing DB stats keystone:SELECT=100 {{(pid=416293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:05:55.576330 dv-cinder-851351-1-smb devstack@keystone.service[416293]: [pid: 416293|app: 0|req: 153/320] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 09:05:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 09:05:55.599069 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f79458-9a29-4419-b1fc-8100ec98a321 None None] Authenticating user token {{(pid=416294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:05:55.724566 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f79458-9a29-4419-b1fc-8100ec98a321 None None] Validating token access rules against request {{(pid=416294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:05:55.767833 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73752e4b-cd01-49b0-9226-7e3ed7c5062a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:05:55.768822 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73752e4b-cd01-49b0-9226-7e3ed7c5062a None admin] REQUEST_METHOD: `GET` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:05:55.768932 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73752e4b-cd01-49b0-9226-7e3ed7c5062a None admin] SCRIPT_NAME: `/identity` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:05:55.769363 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73752e4b-cd01-49b0-9226-7e3ed7c5062a None admin] PATH_INFO: `/v3/domains/default` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:05:55.770916 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73752e4b-cd01-49b0-9226-7e3ed7c5062a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:05:55.773358 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73752e4b-cd01-49b0-9226-7e3ed7c5062a None admin] RBAC: Authorization granted {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:05:55.775300 dv-cinder-851351-1-smb devstack@keystone.service[416294]: [pid: 416294|app: 0|req: 168/321] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 09:05:55 2022] GET /identity/v3/domains/default => generated 199 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:05:55.781007 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55fdab73-ef03-47f6-96e6-0ba4056298b0 None None] Authenticating user token {{(pid=416293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:05:55.908547 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55fdab73-ef03-47f6-96e6-0ba4056298b0 None None] Validating token access rules against request {{(pid=416293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:05:55.954952 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec9a45b-3d89-498b-8005-d3005fbc3eba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:05:55.955846 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec9a45b-3d89-498b-8005-d3005fbc3eba None admin] REQUEST_METHOD: `POST` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:05:55.955928 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec9a45b-3d89-498b-8005-d3005fbc3eba None admin] SCRIPT_NAME: `/identity` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:05:55.956195 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec9a45b-3d89-498b-8005-d3005fbc3eba None admin] PATH_INFO: `/v3/groups` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:05:55.957446 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aec9a45b-3d89-498b-8005-d3005fbc3eba None admin] RBAC: Authorizing `identity:create_group()` {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:05:55.958432 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aec9a45b-3d89-498b-8005-d3005fbc3eba None admin] RBAC: Authorization granted {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:05:55.987569 dv-cinder-851351-1-smb devstack@keystone.service[416293]: [pid: 416293|app: 0|req: 154/322] 10.222.0.42 () {60 vars in 1134 bytes} [Thu Jul 28 09:05:55 2022] POST /identity/v3/groups => generated 226 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 09:05:56.009747 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8932975-b126-4ccd-aaf2-465376cdbd54 None None] REQUEST_METHOD: `GET` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:05:56.010208 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8932975-b126-4ccd-aaf2-465376cdbd54 None None] SCRIPT_NAME: `/identity` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:05:56.010654 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8932975-b126-4ccd-aaf2-465376cdbd54 None None] PATH_INFO: `/` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:05:56.013376 dv-cinder-851351-1-smb devstack@keystone.service[416294]: [pid: 416294|app: 0|req: 169/323] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 09:05:56 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 09:05:56.019783 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c924cfc4-ed64-4595-bcd3-aac1109a5429 None None] REQUEST_METHOD: `POST` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:05:56.020151 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c924cfc4-ed64-4595-bcd3-aac1109a5429 None None] SCRIPT_NAME: `/identity` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:05:56.020346 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c924cfc4-ed64-4595-bcd3-aac1109a5429 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:05:56.043615 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.auth.core [None req-c924cfc4-ed64-4595-bcd3-aac1109a5429 None None] MFA Rules not processed for user `dbf87abab90e4fdf9e75408f4199918e`. Rule list: `[]` (Enabled: `True`). {{(pid=416293) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 09:05:56.044908 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.fernet_utils [None req-c924cfc4-ed64-4595-bcd3-aac1109a5429 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=416293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 09:05:56.119287 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG dbcounter [-] [416293] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=416293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:05:56.148705 dv-cinder-851351-1-smb devstack@keystone.service[416293]: [pid: 416293|app: 0|req: 155/324] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 09:05:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 09:05:56.173820 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8932975-b126-4ccd-aaf2-465376cdbd54 None None] Authenticating user token {{(pid=416294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:05:56.267029 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG dbcounter [-] [416294] Writing DB stats keystone:SELECT=100 {{(pid=416294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:05:56.325721 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8932975-b126-4ccd-aaf2-465376cdbd54 None None] Validating token access rules against request {{(pid=416294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:05:56.362268 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1605711d-a1e1-42e1-a5ba-2a36923d849d None None] REQUEST_METHOD: `GET` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:05:56.362535 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1605711d-a1e1-42e1-a5ba-2a36923d849d None None] SCRIPT_NAME: `/identity` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:05:56.362820 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1605711d-a1e1-42e1-a5ba-2a36923d849d None None] PATH_INFO: `/` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:05:56.364230 dv-cinder-851351-1-smb devstack@keystone.service[416293]: [pid: 416293|app: 0|req: 156/325] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 09:05:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 28 09:05:56.370993 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec85460-9dfe-46ca-8d8e-cc6e3f6cfb4d None None] REQUEST_METHOD: `POST` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:05:56.371298 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec85460-9dfe-46ca-8d8e-cc6e3f6cfb4d None None] SCRIPT_NAME: `/identity` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:05:56.371562 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec85460-9dfe-46ca-8d8e-cc6e3f6cfb4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:05:56.382384 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd3a55a-f4c1-4d15-8faa-6d4643062854 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:05:56.383118 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd3a55a-f4c1-4d15-8faa-6d4643062854 None admin] REQUEST_METHOD: `GET` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:05:56.383398 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd3a55a-f4c1-4d15-8faa-6d4643062854 None admin] SCRIPT_NAME: `/identity` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:05:56.383738 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd3a55a-f4c1-4d15-8faa-6d4643062854 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:05:56.396504 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccd3a55a-f4c1-4d15-8faa-6d4643062854 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 09:05:56.397627 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.auth.core [None req-aec85460-9dfe-46ca-8d8e-cc6e3f6cfb4d None None] MFA Rules not processed for user `dbf87abab90e4fdf9e75408f4199918e`. Rule list: `[]` (Enabled: `True`). {{(pid=416293) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 09:05:56.398838 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.fernet_utils [None req-aec85460-9dfe-46ca-8d8e-cc6e3f6cfb4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=416293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 09:05:56.402571 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application [None req-ccd3a55a-f4c1-4d15-8faa-6d4643062854 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 28 09:05:56.402571 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 09:05:56.402571 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 09:05:56.402571 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 09:05:56.402571 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 09:05:56.402571 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 09:05:56.402571 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 09:05:56.402571 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 09:05:56.402571 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 09:05:56.402571 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 09:05:56.402571 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 09:05:56.402571 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 09:05:56.402571 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 09:05:56.402571 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 09:05:56.402571 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 09:05:56.402571 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 09:05:56.403554 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 09:05:56.403554 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 09:05:56.403554 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 09:05:56.403554 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 09:05:56.403554 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 09:05:56.403554 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 09:05:56.403554 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 09:05:56.403554 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 09:05:56.403554 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 09:05:56.403554 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 09:05:56.403554 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 09:05:56.403554 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application with Lock( Jul 28 09:05:56.403554 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 09:05:56.403554 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return self._enter() Jul 28 09:05:56.403554 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 09:05:56.403554 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 09:05:56.404418 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 09:05:56.404418 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return self.creator() Jul 28 09:05:56.404418 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 09:05:56.404418 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application created_value = creator( Jul 28 09:05:56.404418 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 09:05:56.404418 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 09:05:56.404418 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 09:05:56.404418 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 09:05:56.404418 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 09:05:56.404418 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 09:05:56.404418 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 28 09:05:56.404418 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application Jul 28 09:05:56.404418 dv-cinder-851351-1-smb devstack@keystone.service[416294]: [pid: 416294|app: 0|req: 170/326] 10.222.0.42 () {56 vars in 1099 bytes} [Thu Jul 28 09:05:56 2022] GET /identity/v3/roles/reader => generated 84 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 09:05:56.411781 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd3a55a-f4c1-4d15-8faa-6d4643062854 None admin] Authenticating user token {{(pid=416294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:05:56.487804 dv-cinder-851351-1-smb devstack@keystone.service[416293]: [pid: 416293|app: 0|req: 157/327] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 09:05:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 28 09:05:56.514999 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec85460-9dfe-46ca-8d8e-cc6e3f6cfb4d None None] Authenticating user token {{(pid=416293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:05:56.563824 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd3a55a-f4c1-4d15-8faa-6d4643062854 None admin] Validating token access rules against request {{(pid=416294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:05:56.598387 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG dbcounter [-] [416294] Writing DB stats keystone:SELECT=100 {{(pid=416294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:05:56.624319 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da63da1-5adc-4489-825f-7a21d205f918 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:05:56.624995 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da63da1-5adc-4489-825f-7a21d205f918 None admin] REQUEST_METHOD: `GET` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:05:56.625281 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da63da1-5adc-4489-825f-7a21d205f918 None admin] SCRIPT_NAME: `/identity` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:05:56.625561 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da63da1-5adc-4489-825f-7a21d205f918 None admin] PATH_INFO: `/v3/roles` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:05:56.626313 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3da63da1-5adc-4489-825f-7a21d205f918 None admin] RBAC: Adding query filter params (name=reader) {{(pid=416294) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 09:05:56.626618 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3da63da1-5adc-4489-825f-7a21d205f918 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:05:56.628167 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3da63da1-5adc-4489-825f-7a21d205f918 None admin] RBAC: Authorization granted {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:05:56.638058 dv-cinder-851351-1-smb devstack@keystone.service[416294]: [pid: 416294|app: 0|req: 171/328] 10.222.0.42 () {56 vars in 1101 bytes} [Thu Jul 28 09:05:56 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:05:56.645803 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da63da1-5adc-4489-825f-7a21d205f918 None admin] Authenticating user token {{(pid=416294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:05:56.664439 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec85460-9dfe-46ca-8d8e-cc6e3f6cfb4d None None] Validating token access rules against request {{(pid=416293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:05:56.686730 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG dbcounter [-] [416293] Writing DB stats keystone:SELECT=100 {{(pid=416293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:05:56.717925 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d7166f0-05ba-4ac8-bc08-2ec81fa77bd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:05:56.718691 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7166f0-05ba-4ac8-bc08-2ec81fa77bd7 None admin] REQUEST_METHOD: `GET` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:05:56.719050 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7166f0-05ba-4ac8-bc08-2ec81fa77bd7 None admin] SCRIPT_NAME: `/identity` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:05:56.719385 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7166f0-05ba-4ac8-bc08-2ec81fa77bd7 None admin] PATH_INFO: `/v3/roles/member` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:05:56.736529 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d7166f0-05ba-4ac8-bc08-2ec81fa77bd7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 09:05:56.741967 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application [None req-6d7166f0-05ba-4ac8-bc08-2ec81fa77bd7 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 28 09:05:56.741967 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 09:05:56.741967 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 09:05:56.741967 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 09:05:56.741967 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 09:05:56.741967 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 09:05:56.741967 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 09:05:56.741967 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 09:05:56.741967 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 09:05:56.741967 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 09:05:56.741967 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 09:05:56.741967 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 09:05:56.741967 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 09:05:56.741967 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 09:05:56.741967 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 09:05:56.741967 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 09:05:56.742985 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 09:05:56.742985 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 09:05:56.742985 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 09:05:56.742985 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 09:05:56.742985 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 09:05:56.742985 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 09:05:56.742985 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 09:05:56.742985 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 09:05:56.742985 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 09:05:56.742985 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 09:05:56.742985 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 09:05:56.742985 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application with Lock( Jul 28 09:05:56.742985 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 09:05:56.742985 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self._enter() Jul 28 09:05:56.742985 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 09:05:56.742985 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 09:05:56.743886 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 09:05:56.743886 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self.creator() Jul 28 09:05:56.743886 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 09:05:56.743886 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application created_value = creator( Jul 28 09:05:56.743886 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 09:05:56.743886 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 09:05:56.743886 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 09:05:56.743886 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 09:05:56.743886 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 09:05:56.743886 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 09:05:56.743886 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 28 09:05:56.743886 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application Jul 28 09:05:56.743886 dv-cinder-851351-1-smb devstack@keystone.service[416293]: [pid: 416293|app: 0|req: 158/329] 10.222.0.42 () {56 vars in 1099 bytes} [Thu Jul 28 09:05:56 2022] GET /identity/v3/roles/member => generated 84 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 09:05:56.751943 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d7166f0-05ba-4ac8-bc08-2ec81fa77bd7 None admin] Authenticating user token {{(pid=416293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:05:56.818648 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da63da1-5adc-4489-825f-7a21d205f918 None admin] Validating token access rules against request {{(pid=416294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:05:56.861248 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122ef322-158b-47de-b6bf-61be75f58fba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:05:56.861996 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122ef322-158b-47de-b6bf-61be75f58fba None admin] REQUEST_METHOD: `GET` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:05:56.862278 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122ef322-158b-47de-b6bf-61be75f58fba None admin] SCRIPT_NAME: `/identity` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:05:56.862554 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122ef322-158b-47de-b6bf-61be75f58fba None admin] PATH_INFO: `/v3/users/8fbb6d684807450cbaf19b215d6079ce` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:05:56.863795 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-122ef322-158b-47de-b6bf-61be75f58fba None admin] RBAC: Authorizing `identity:get_user(user_id=8fbb6d684807450cbaf19b215d6079ce)` {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:05:56.865370 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-122ef322-158b-47de-b6bf-61be75f58fba None admin] RBAC: Authorization granted {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:05:56.867403 dv-cinder-851351-1-smb devstack@keystone.service[416294]: [pid: 416294|app: 0|req: 172/330] 10.222.0.42 () {56 vars in 1177 bytes} [Thu Jul 28 09:05:56 2022] GET /identity/v3/users/8fbb6d684807450cbaf19b215d6079ce => generated 293 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:05:56.873259 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122ef322-158b-47de-b6bf-61be75f58fba None admin] Authenticating user token {{(pid=416294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:05:56.892238 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d7166f0-05ba-4ac8-bc08-2ec81fa77bd7 None admin] Validating token access rules against request {{(pid=416293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:05:56.938402 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e021ad-ba24-4847-a96e-f115cd1dde71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:05:56.939329 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e021ad-ba24-4847-a96e-f115cd1dde71 None admin] REQUEST_METHOD: `GET` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:05:56.939617 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e021ad-ba24-4847-a96e-f115cd1dde71 None admin] SCRIPT_NAME: `/identity` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:05:56.939893 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e021ad-ba24-4847-a96e-f115cd1dde71 None admin] PATH_INFO: `/v3/roles` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:05:56.940891 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9e021ad-ba24-4847-a96e-f115cd1dde71 None admin] RBAC: Adding query filter params (name=member) {{(pid=416293) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 09:05:56.941205 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9e021ad-ba24-4847-a96e-f115cd1dde71 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:05:56.943099 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9e021ad-ba24-4847-a96e-f115cd1dde71 None admin] RBAC: Authorization granted {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:05:56.954997 dv-cinder-851351-1-smb devstack@keystone.service[416293]: [pid: 416293|app: 0|req: 159/331] 10.222.0.42 () {56 vars in 1101 bytes} [Thu Jul 28 09:05:56 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:05:56.956080 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG dbcounter [-] [416294] Writing DB stats keystone:SELECT=100 {{(pid=416294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:05:56.962596 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e021ad-ba24-4847-a96e-f115cd1dde71 None admin] Authenticating user token {{(pid=416293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:05:57.007711 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG dbcounter [-] [416293] Writing DB stats keystone:SELECT=100 {{(pid=416293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:05:57.041791 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122ef322-158b-47de-b6bf-61be75f58fba None admin] Validating token access rules against request {{(pid=416294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:05:57.093651 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e654759f-b7c6-48fe-b70b-9a7f7a94ed6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:05:57.095925 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e654759f-b7c6-48fe-b70b-9a7f7a94ed6a None admin] REQUEST_METHOD: `PUT` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:05:57.095925 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e654759f-b7c6-48fe-b70b-9a7f7a94ed6a None admin] SCRIPT_NAME: `/identity` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:05:57.095925 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e654759f-b7c6-48fe-b70b-9a7f7a94ed6a None admin] PATH_INFO: `/v3/system/users/8fbb6d684807450cbaf19b215d6079ce/roles/071325426dc84e2cb2689d138bc2b032` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:05:57.097267 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e654759f-b7c6-48fe-b70b-9a7f7a94ed6a None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=8fbb6d684807450cbaf19b215d6079ce, role_id=071325426dc84e2cb2689d138bc2b032)` {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:05:57.099425 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e654759f-b7c6-48fe-b70b-9a7f7a94ed6a None admin] RBAC: Authorization granted {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:05:57.109985 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e021ad-ba24-4847-a96e-f115cd1dde71 None admin] Validating token access rules against request {{(pid=416293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:05:57.117478 dv-cinder-851351-1-smb devstack@keystone.service[416294]: [pid: 416294|app: 0|req: 173/332] 10.222.0.42 () {58 vars in 1334 bytes} [Thu Jul 28 09:05:56 2022] PUT /identity/v3/system/users/8fbb6d684807450cbaf19b215d6079ce/roles/071325426dc84e2cb2689d138bc2b032 => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 09:05:57.156401 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8b7779-1e1e-4f3a-a515-655d1c40ff7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:05:57.157556 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8b7779-1e1e-4f3a-a515-655d1c40ff7e None admin] REQUEST_METHOD: `GET` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:05:57.158104 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8b7779-1e1e-4f3a-a515-655d1c40ff7e None admin] SCRIPT_NAME: `/identity` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:05:57.158594 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8b7779-1e1e-4f3a-a515-655d1c40ff7e None admin] PATH_INFO: `/v3/users/b63827f02a6649269cc2876fffc32174` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:05:57.160423 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac8b7779-1e1e-4f3a-a515-655d1c40ff7e None admin] RBAC: Authorizing `identity:get_user(user_id=b63827f02a6649269cc2876fffc32174)` {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:05:57.162308 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac8b7779-1e1e-4f3a-a515-655d1c40ff7e None admin] RBAC: Authorization granted {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:05:57.164946 dv-cinder-851351-1-smb devstack@keystone.service[416293]: [pid: 416293|app: 0|req: 160/333] 10.222.0.42 () {56 vars in 1177 bytes} [Thu Jul 28 09:05:56 2022] GET /identity/v3/users/b63827f02a6649269cc2876fffc32174 => generated 293 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:05:57.172020 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e654759f-b7c6-48fe-b70b-9a7f7a94ed6a None admin] Authenticating user token {{(pid=416294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:05:57.339295 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e654759f-b7c6-48fe-b70b-9a7f7a94ed6a None admin] Validating token access rules against request {{(pid=416294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:05:57.362174 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG dbcounter [-] [416294] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=416294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:05:57.384770 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e5cc06-2c1e-4f95-884e-7813a5389fc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:05:57.385432 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e5cc06-2c1e-4f95-884e-7813a5389fc6 None admin] REQUEST_METHOD: `GET` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:05:57.385722 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e5cc06-2c1e-4f95-884e-7813a5389fc6 None admin] SCRIPT_NAME: `/identity` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:05:57.386005 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e5cc06-2c1e-4f95-884e-7813a5389fc6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:05:57.386823 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e5cc06-2c1e-4f95-884e-7813a5389fc6 None admin] RBAC: Adding query filter params (role.id=ba1a79dc27074d5a94dce2d994019d37, user.id=b63827f02a6649269cc2876fffc32174, scope.system=all) {{(pid=416294) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 09:05:57.387312 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e5cc06-2c1e-4f95-884e-7813a5389fc6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:05:57.388827 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e5cc06-2c1e-4f95-884e-7813a5389fc6 None admin] RBAC: Authorization granted {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:05:57.405675 dv-cinder-851351-1-smb devstack@keystone.service[416294]: [pid: 416294|app: 0|req: 174/334] 10.222.0.42 () {56 vars in 1308 bytes} [Thu Jul 28 09:05:57 2022] GET /identity/v3/role_assignments?user.id=b63827f02a6649269cc2876fffc32174&scope.system=all&role.id=ba1a79dc27074d5a94dce2d994019d37 => generated 510 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:05:58.680712 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd48f22-678d-449d-a90f-438a0b08f9c9 None None] REQUEST_METHOD: `GET` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:05:58.681262 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd48f22-678d-449d-a90f-438a0b08f9c9 None None] SCRIPT_NAME: `/identity` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:05:58.681357 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd48f22-678d-449d-a90f-438a0b08f9c9 None None] PATH_INFO: `/` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:05:58.682997 dv-cinder-851351-1-smb devstack@keystone.service[416293]: [pid: 416293|app: 0|req: 161/335] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 09:05:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 09:05:58.688502 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f93944a-22c9-4758-9916-2a34f1ec9deb None None] REQUEST_METHOD: `POST` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:05:58.689015 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f93944a-22c9-4758-9916-2a34f1ec9deb None None] SCRIPT_NAME: `/identity` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:05:58.689169 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f93944a-22c9-4758-9916-2a34f1ec9deb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:05:58.718759 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.auth.core [None req-6f93944a-22c9-4758-9916-2a34f1ec9deb None None] MFA Rules not processed for user `dbf87abab90e4fdf9e75408f4199918e`. Rule list: `[]` (Enabled: `True`). {{(pid=416294) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 09:05:58.720000 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.fernet_utils [None req-6f93944a-22c9-4758-9916-2a34f1ec9deb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=416294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 09:05:58.815862 dv-cinder-851351-1-smb devstack@keystone.service[416294]: [pid: 416294|app: 0|req: 175/336] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 09:05:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 09:05:58.851473 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd48f22-678d-449d-a90f-438a0b08f9c9 None None] Authenticating user token {{(pid=416293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:05:58.880553 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e305a31f-bca0-4619-b170-ea1e52750d87 None None] REQUEST_METHOD: `GET` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:05:58.880922 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e305a31f-bca0-4619-b170-ea1e52750d87 None None] SCRIPT_NAME: `/identity` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:05:58.881163 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e305a31f-bca0-4619-b170-ea1e52750d87 None None] PATH_INFO: `/` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:05:58.882846 dv-cinder-851351-1-smb devstack@keystone.service[416294]: [pid: 416294|app: 0|req: 176/337] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 09:05:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 09:05:58.893946 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5d57f1-ed0b-47c0-847e-c9f922118fd8 None None] REQUEST_METHOD: `POST` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:05:58.894246 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5d57f1-ed0b-47c0-847e-c9f922118fd8 None None] SCRIPT_NAME: `/identity` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:05:58.894529 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5d57f1-ed0b-47c0-847e-c9f922118fd8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:05:58.929756 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.auth.core [None req-0f5d57f1-ed0b-47c0-847e-c9f922118fd8 None None] MFA Rules not processed for user `dbf87abab90e4fdf9e75408f4199918e`. Rule list: `[]` (Enabled: `True`). {{(pid=416294) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 09:05:58.931052 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.fernet_utils [None req-0f5d57f1-ed0b-47c0-847e-c9f922118fd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=416294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 09:05:59.009799 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd48f22-678d-449d-a90f-438a0b08f9c9 None None] Validating token access rules against request {{(pid=416293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:05:59.014832 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG dbcounter [-] [416293] Writing DB stats keystone:SELECT=100 {{(pid=416293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:05:59.076513 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be58517d-7048-488d-b485-8b2f2efa7488 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:05:59.077640 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be58517d-7048-488d-b485-8b2f2efa7488 None admin] REQUEST_METHOD: `GET` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:05:59.078269 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be58517d-7048-488d-b485-8b2f2efa7488 None admin] SCRIPT_NAME: `/identity` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:05:59.078757 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be58517d-7048-488d-b485-8b2f2efa7488 None admin] PATH_INFO: `/v3/roles/member` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:05:59.099079 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be58517d-7048-488d-b485-8b2f2efa7488 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 09:05:59.109027 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application [None req-be58517d-7048-488d-b485-8b2f2efa7488 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 28 09:05:59.109027 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 09:05:59.109027 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 09:05:59.109027 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 09:05:59.109027 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 09:05:59.109027 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 09:05:59.109027 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 09:05:59.109027 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 09:05:59.109027 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 09:05:59.109027 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 09:05:59.109027 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 09:05:59.109027 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 09:05:59.109027 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 09:05:59.109027 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 09:05:59.109027 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 09:05:59.109027 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 09:05:59.110109 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 09:05:59.110109 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 09:05:59.110109 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 09:05:59.110109 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 09:05:59.110109 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 09:05:59.110109 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 09:05:59.110109 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 09:05:59.110109 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 09:05:59.110109 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 09:05:59.110109 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 09:05:59.110109 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 09:05:59.110109 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application with Lock( Jul 28 09:05:59.110109 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 09:05:59.110109 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self._enter() Jul 28 09:05:59.110109 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 09:05:59.110109 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 09:05:59.111090 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 09:05:59.111090 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self.creator() Jul 28 09:05:59.111090 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 09:05:59.111090 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application created_value = creator( Jul 28 09:05:59.111090 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 09:05:59.111090 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 09:05:59.111090 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 09:05:59.111090 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 09:05:59.111090 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 09:05:59.111090 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 09:05:59.111090 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 28 09:05:59.111090 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application Jul 28 09:05:59.114126 dv-cinder-851351-1-smb devstack@keystone.service[416293]: [pid: 416293|app: 0|req: 162/338] 10.222.0.42 () {56 vars in 1099 bytes} [Thu Jul 28 09:05:58 2022] GET /identity/v3/roles/member => generated 84 bytes in 263 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 09:05:59.120541 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be58517d-7048-488d-b485-8b2f2efa7488 None admin] Authenticating user token {{(pid=416293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:05:59.131001 dv-cinder-851351-1-smb devstack@keystone.service[416294]: [pid: 416294|app: 0|req: 177/339] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 09:05:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 238 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 28 09:05:59.172989 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5d57f1-ed0b-47c0-847e-c9f922118fd8 None None] Authenticating user token {{(pid=416294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:05:59.266036 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG dbcounter [-] [416294] Writing DB stats keystone:SELECT=100 {{(pid=416294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:05:59.285033 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be58517d-7048-488d-b485-8b2f2efa7488 None admin] Validating token access rules against request {{(pid=416293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:05:59.344293 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad00190-cb26-480d-8e09-0c0841df1307 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:05:59.344992 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad00190-cb26-480d-8e09-0c0841df1307 None admin] REQUEST_METHOD: `GET` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:05:59.345313 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad00190-cb26-480d-8e09-0c0841df1307 None admin] SCRIPT_NAME: `/identity` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:05:59.345566 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad00190-cb26-480d-8e09-0c0841df1307 None admin] PATH_INFO: `/v3/roles` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:05:59.346399 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad00190-cb26-480d-8e09-0c0841df1307 None admin] RBAC: Adding query filter params (name=member) {{(pid=416293) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 09:05:59.346712 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad00190-cb26-480d-8e09-0c0841df1307 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:05:59.348149 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad00190-cb26-480d-8e09-0c0841df1307 None admin] RBAC: Authorization granted {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:05:59.362847 dv-cinder-851351-1-smb devstack@keystone.service[416293]: [pid: 416293|app: 0|req: 163/340] 10.222.0.42 () {56 vars in 1101 bytes} [Thu Jul 28 09:05:59 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 09:05:59.369821 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad00190-cb26-480d-8e09-0c0841df1307 None admin] Authenticating user token {{(pid=416293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:05:59.397440 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5d57f1-ed0b-47c0-847e-c9f922118fd8 None None] Validating token access rules against request {{(pid=416294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:05:59.418906 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG dbcounter [-] [416293] Writing DB stats keystone:SELECT=100 {{(pid=416293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:05:59.457508 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50676e2d-1c64-4536-acd0-99e4ba2e17f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:05:59.458199 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50676e2d-1c64-4536-acd0-99e4ba2e17f8 None admin] REQUEST_METHOD: `GET` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:05:59.458494 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50676e2d-1c64-4536-acd0-99e4ba2e17f8 None admin] SCRIPT_NAME: `/identity` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:05:59.458778 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50676e2d-1c64-4536-acd0-99e4ba2e17f8 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:05:59.474977 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50676e2d-1c64-4536-acd0-99e4ba2e17f8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 09:05:59.484584 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application [None req-50676e2d-1c64-4536-acd0-99e4ba2e17f8 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 28 09:05:59.484584 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 09:05:59.484584 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 09:05:59.484584 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 09:05:59.484584 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 09:05:59.484584 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 09:05:59.484584 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 09:05:59.484584 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 09:05:59.484584 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 09:05:59.484584 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 09:05:59.484584 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 09:05:59.484584 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 09:05:59.484584 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 09:05:59.484584 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 09:05:59.484584 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 09:05:59.484584 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 09:05:59.485733 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 09:05:59.485733 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 09:05:59.485733 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 09:05:59.485733 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 09:05:59.485733 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 09:05:59.485733 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 09:05:59.485733 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 09:05:59.485733 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 09:05:59.485733 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 09:05:59.485733 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 09:05:59.485733 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 09:05:59.485733 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application with Lock( Jul 28 09:05:59.485733 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 09:05:59.485733 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return self._enter() Jul 28 09:05:59.485733 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 09:05:59.485733 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 09:05:59.486662 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 09:05:59.486662 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return self.creator() Jul 28 09:05:59.486662 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 09:05:59.486662 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application created_value = creator( Jul 28 09:05:59.486662 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 09:05:59.486662 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 09:05:59.486662 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 09:05:59.486662 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 09:05:59.486662 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 09:05:59.486662 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 09:05:59.486662 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 28 09:05:59.486662 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application Jul 28 09:05:59.486662 dv-cinder-851351-1-smb devstack@keystone.service[416294]: [pid: 416294|app: 0|req: 178/341] 10.222.0.42 () {56 vars in 1114 bytes} [Thu Jul 28 09:05:59 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 314 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 09:05:59.493795 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50676e2d-1c64-4536-acd0-99e4ba2e17f8 None admin] Authenticating user token {{(pid=416294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:05:59.543940 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad00190-cb26-480d-8e09-0c0841df1307 None admin] Validating token access rules against request {{(pid=416293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:05:59.638449 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4779f8e5-536c-473e-b065-8334b207e1e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:05:59.639115 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4779f8e5-536c-473e-b065-8334b207e1e1 None admin] REQUEST_METHOD: `GET` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:05:59.639399 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4779f8e5-536c-473e-b065-8334b207e1e1 None admin] SCRIPT_NAME: `/identity` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:05:59.639671 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4779f8e5-536c-473e-b065-8334b207e1e1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:05:59.640365 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG dbcounter [-] [416294] Writing DB stats keystone:SELECT=100 {{(pid=416294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:05:59.656916 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50676e2d-1c64-4536-acd0-99e4ba2e17f8 None admin] Validating token access rules against request {{(pid=416294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:05:59.721562 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40591628-0f21-47fa-846d-8c882302cf5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:05:59.722232 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40591628-0f21-47fa-846d-8c882302cf5f None admin] REQUEST_METHOD: `GET` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:05:59.722521 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40591628-0f21-47fa-846d-8c882302cf5f None admin] SCRIPT_NAME: `/identity` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:05:59.722801 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40591628-0f21-47fa-846d-8c882302cf5f None admin] PATH_INFO: `/v3/roles` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:05:59.723558 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40591628-0f21-47fa-846d-8c882302cf5f None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=416294) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 09:05:59.723869 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40591628-0f21-47fa-846d-8c882302cf5f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:05:59.725349 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40591628-0f21-47fa-846d-8c882302cf5f None admin] RBAC: Authorization granted {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:05:59.731113 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4779f8e5-536c-473e-b065-8334b207e1e1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:05:59.732650 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4779f8e5-536c-473e-b065-8334b207e1e1 None admin] RBAC: Authorization granted {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:05:59.735457 dv-cinder-851351-1-smb devstack@keystone.service[416294]: [pid: 416294|app: 0|req: 179/342] 10.222.0.42 () {56 vars in 1111 bytes} [Thu Jul 28 09:05:59 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:05:59.741891 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40591628-0f21-47fa-846d-8c882302cf5f None admin] Authenticating user token {{(pid=416294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:05:59.766258 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG dbcounter [-] [416293] Writing DB stats keystone:SELECT=100 {{(pid=416293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:05:59.855820 dv-cinder-851351-1-smb devstack@keystone.service[416293]: [pid: 416293|app: 0|req: 164/343] 10.222.0.42 () {58 vars in 1282 bytes} [Thu Jul 28 09:05:59 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 486 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 28 09:05:59.861652 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4779f8e5-536c-473e-b065-8334b207e1e1 None admin] Authenticating user token {{(pid=416293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:05:59.896547 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40591628-0f21-47fa-846d-8c882302cf5f None admin] Validating token access rules against request {{(pid=416294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:05:59.953717 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-666e1924-3e3d-4a75-a901-45799c48a889 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:05:59.954382 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666e1924-3e3d-4a75-a901-45799c48a889 None admin] REQUEST_METHOD: `GET` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:05:59.954675 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666e1924-3e3d-4a75-a901-45799c48a889 None admin] SCRIPT_NAME: `/identity` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:05:59.955012 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666e1924-3e3d-4a75-a901-45799c48a889 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:05:59.995596 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4779f8e5-536c-473e-b065-8334b207e1e1 None admin] Validating token access rules against request {{(pid=416293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:06:00.026182 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG dbcounter [-] [416294] Writing DB stats keystone:SELECT=100 {{(pid=416294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:06:00.035335 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG dbcounter [-] [416293] Writing DB stats keystone:SELECT=100 {{(pid=416293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:06:00.045257 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff1ded9c-2f70-49eb-a12d-28c0ea91f3c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:06:00.046296 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1ded9c-2f70-49eb-a12d-28c0ea91f3c2 None admin] REQUEST_METHOD: `GET` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:06:00.046772 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1ded9c-2f70-49eb-a12d-28c0ea91f3c2 None admin] SCRIPT_NAME: `/identity` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:06:00.047244 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1ded9c-2f70-49eb-a12d-28c0ea91f3c2 None admin] PATH_INFO: `/v3/projects/c515ec4395fe420e9ab0ba34fb1ada8f` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:06:00.048914 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff1ded9c-2f70-49eb-a12d-28c0ea91f3c2 None admin] RBAC: Authorizing `identity:get_project(project_id=c515ec4395fe420e9ab0ba34fb1ada8f)` {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:06:00.050668 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff1ded9c-2f70-49eb-a12d-28c0ea91f3c2 None admin] RBAC: Authorization granted {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:06:00.054521 dv-cinder-851351-1-smb devstack@keystone.service[416293]: [pid: 416293|app: 0|req: 165/344] 10.222.0.42 () {56 vars in 1186 bytes} [Thu Jul 28 09:05:59 2022] GET /identity/v3/projects/c515ec4395fe420e9ab0ba34fb1ada8f => generated 298 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 09:06:00.060248 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-666e1924-3e3d-4a75-a901-45799c48a889 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:06:00.060475 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff1ded9c-2f70-49eb-a12d-28c0ea91f3c2 None admin] Authenticating user token {{(pid=416293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:06:00.062167 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-666e1924-3e3d-4a75-a901-45799c48a889 None admin] RBAC: Authorization granted {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:06:00.175821 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff1ded9c-2f70-49eb-a12d-28c0ea91f3c2 None admin] Validating token access rules against request {{(pid=416293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:06:00.221943 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ba518b-6191-4911-b543-6ff598ff4d95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:06:00.223112 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ba518b-6191-4911-b543-6ff598ff4d95 None admin] REQUEST_METHOD: `GET` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:06:00.223604 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ba518b-6191-4911-b543-6ff598ff4d95 None admin] SCRIPT_NAME: `/identity` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:06:00.224175 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ba518b-6191-4911-b543-6ff598ff4d95 None admin] PATH_INFO: `/v3/groups/7f607738424745bf955f57e2c8966ff8` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:06:00.229874 dv-cinder-851351-1-smb devstack@keystone.service[416294]: [pid: 416294|app: 0|req: 180/345] 10.222.0.42 () {58 vars in 1282 bytes} [Thu Jul 28 09:05:59 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 488 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 28 09:06:00.232029 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ba518b-6191-4911-b543-6ff598ff4d95 None admin] RBAC: Authorizing `identity:get_group(group_id=7f607738424745bf955f57e2c8966ff8)` {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:06:00.233806 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ba518b-6191-4911-b543-6ff598ff4d95 None admin] RBAC: Authorization granted {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:06:00.235416 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-666e1924-3e3d-4a75-a901-45799c48a889 None admin] Authenticating user token {{(pid=416294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:06:00.236347 dv-cinder-851351-1-smb devstack@keystone.service[416293]: [pid: 416293|app: 0|req: 166/346] 10.222.0.42 () {56 vars in 1180 bytes} [Thu Jul 28 09:06:00 2022] GET /identity/v3/groups/7f607738424745bf955f57e2c8966ff8 => generated 226 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 09:06:00.242706 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ba518b-6191-4911-b543-6ff598ff4d95 None admin] Authenticating user token {{(pid=416293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:06:00.315346 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG dbcounter [-] [416294] Writing DB stats keystone:SELECT=100 {{(pid=416294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:06:00.316892 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG dbcounter [-] [416293] Writing DB stats keystone:SELECT=100 {{(pid=416293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:06:00.379683 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ba518b-6191-4911-b543-6ff598ff4d95 None admin] Validating token access rules against request {{(pid=416293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:06:00.391775 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-666e1924-3e3d-4a75-a901-45799c48a889 None admin] Validating token access rules against request {{(pid=416294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:06:00.442603 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5314a433-5e2b-4ebc-b47f-b8c380ddd69f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:06:00.443599 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5314a433-5e2b-4ebc-b47f-b8c380ddd69f None admin] REQUEST_METHOD: `GET` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:06:00.444083 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5314a433-5e2b-4ebc-b47f-b8c380ddd69f None admin] SCRIPT_NAME: `/identity` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:06:00.444558 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5314a433-5e2b-4ebc-b47f-b8c380ddd69f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:06:00.445657 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5314a433-5e2b-4ebc-b47f-b8c380ddd69f None admin] RBAC: Adding query filter params (group.id=7f607738424745bf955f57e2c8966ff8, role.id=ba1a79dc27074d5a94dce2d994019d37, scope.project.id=c515ec4395fe420e9ab0ba34fb1ada8f) {{(pid=416293) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 09:06:00.446224 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5314a433-5e2b-4ebc-b47f-b8c380ddd69f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:06:00.447925 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5314a433-5e2b-4ebc-b47f-b8c380ddd69f None admin] RBAC: Authorization granted {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:06:00.461185 dv-cinder-851351-1-smb devstack@keystone.service[416293]: [pid: 416293|app: 0|req: 167/347] 10.222.0.42 () {56 vars in 1376 bytes} [Thu Jul 28 09:06:00 2022] GET /identity/v3/role_assignments?group.id=7f607738424745bf955f57e2c8966ff8&scope.project.id=c515ec4395fe420e9ab0ba34fb1ada8f&role.id=ba1a79dc27074d5a94dce2d994019d37 => generated 260 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 09:06:00.470136 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b29ec2-cc81-45e4-a9f3-072c174fd12a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:06:00.470871 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b29ec2-cc81-45e4-a9f3-072c174fd12a None admin] REQUEST_METHOD: `GET` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:06:00.471220 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b29ec2-cc81-45e4-a9f3-072c174fd12a None admin] SCRIPT_NAME: `/identity` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:06:00.471512 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b29ec2-cc81-45e4-a9f3-072c174fd12a None admin] PATH_INFO: `/v3/projects/c515ec4395fe420e9ab0ba34fb1ada8f` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:06:00.477693 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21b29ec2-cc81-45e4-a9f3-072c174fd12a None admin] RBAC: Authorizing `identity:get_project(project_id=c515ec4395fe420e9ab0ba34fb1ada8f)` {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:06:00.478480 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef111d2-2d09-420c-b009-f02af87857f3 None None] REQUEST_METHOD: `GET` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:06:00.478994 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef111d2-2d09-420c-b009-f02af87857f3 None None] SCRIPT_NAME: `/identity` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:06:00.479210 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21b29ec2-cc81-45e4-a9f3-072c174fd12a None admin] RBAC: Authorization granted {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:06:00.479673 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef111d2-2d09-420c-b009-f02af87857f3 None None] PATH_INFO: `/` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:06:00.481340 dv-cinder-851351-1-smb devstack@keystone.service[416293]: [pid: 416293|app: 0|req: 168/348] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 09:06:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 28 09:06:00.484711 dv-cinder-851351-1-smb devstack@keystone.service[416294]: [pid: 416294|app: 0|req: 181/349] 10.222.0.42 () {56 vars in 1186 bytes} [Thu Jul 28 09:06:00 2022] GET /identity/v3/projects/c515ec4395fe420e9ab0ba34fb1ada8f => generated 298 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 09:06:00.491796 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b29ec2-cc81-45e4-a9f3-072c174fd12a None admin] Authenticating user token {{(pid=416294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:06:00.492658 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5dbc4f5-17e2-4f8c-9134-7d4c487fcb2d None None] REQUEST_METHOD: `POST` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:06:00.493194 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5dbc4f5-17e2-4f8c-9134-7d4c487fcb2d None None] SCRIPT_NAME: `/identity` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:06:00.493674 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5dbc4f5-17e2-4f8c-9134-7d4c487fcb2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:06:00.522045 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.auth.core [None req-a5dbc4f5-17e2-4f8c-9134-7d4c487fcb2d None None] MFA Rules not processed for user `dbf87abab90e4fdf9e75408f4199918e`. Rule list: `[]` (Enabled: `True`). {{(pid=416293) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 09:06:00.523723 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.fernet_utils [None req-a5dbc4f5-17e2-4f8c-9134-7d4c487fcb2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=416293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 09:06:00.620177 dv-cinder-851351-1-smb devstack@keystone.service[416293]: [pid: 416293|app: 0|req: 169/350] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 09:06:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 09:06:00.664131 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5dbc4f5-17e2-4f8c-9134-7d4c487fcb2d None None] Authenticating user token {{(pid=416293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:06:00.763607 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG dbcounter [-] [416293] Writing DB stats keystone:SELECT=100 {{(pid=416293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:06:00.778871 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b29ec2-cc81-45e4-a9f3-072c174fd12a None admin] Validating token access rules against request {{(pid=416294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:06:00.810604 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5dbc4f5-17e2-4f8c-9134-7d4c487fcb2d None None] Validating token access rules against request {{(pid=416293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:06:00.828581 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG dbcounter [-] [416294] Writing DB stats keystone:SELECT=100 {{(pid=416294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:06:00.848481 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d885fd0-ff88-4c58-b60c-7e39084e66f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:06:00.849196 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d885fd0-ff88-4c58-b60c-7e39084e66f9 None admin] REQUEST_METHOD: `GET` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:06:00.849492 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d885fd0-ff88-4c58-b60c-7e39084e66f9 None admin] SCRIPT_NAME: `/identity` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:06:00.849759 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d885fd0-ff88-4c58-b60c-7e39084e66f9 None admin] PATH_INFO: `/v3/groups/7f607738424745bf955f57e2c8966ff8` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:06:00.850983 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d885fd0-ff88-4c58-b60c-7e39084e66f9 None admin] RBAC: Authorizing `identity:get_group(group_id=7f607738424745bf955f57e2c8966ff8)` {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:06:00.852484 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d885fd0-ff88-4c58-b60c-7e39084e66f9 None admin] RBAC: Authorization granted {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:06:00.858717 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81fd0e9e-f6f3-42e6-a3d9-a6ba0fab5f84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:06:00.859235 dv-cinder-851351-1-smb devstack@keystone.service[416294]: [pid: 416294|app: 0|req: 182/351] 10.222.0.42 () {56 vars in 1180 bytes} [Thu Jul 28 09:06:00 2022] GET /identity/v3/groups/7f607738424745bf955f57e2c8966ff8 => generated 226 bytes in 368 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 09:06:00.859903 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81fd0e9e-f6f3-42e6-a3d9-a6ba0fab5f84 None admin] REQUEST_METHOD: `GET` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:06:00.860389 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81fd0e9e-f6f3-42e6-a3d9-a6ba0fab5f84 None admin] SCRIPT_NAME: `/identity` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:06:00.860640 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d24f626-686e-467e-bae5-35b18e195c3a None None] REQUEST_METHOD: `GET` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:06:00.860968 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d24f626-686e-467e-bae5-35b18e195c3a None None] SCRIPT_NAME: `/identity` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:06:00.861252 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d24f626-686e-467e-bae5-35b18e195c3a None None] PATH_INFO: `/` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:06:00.861477 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81fd0e9e-f6f3-42e6-a3d9-a6ba0fab5f84 None admin] PATH_INFO: `/v3/roles/member` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:06:00.862823 dv-cinder-851351-1-smb devstack@keystone.service[416294]: [pid: 416294|app: 0|req: 183/352] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 09:06:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 09:06:00.866235 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d24f626-686e-467e-bae5-35b18e195c3a None None] Authenticating user token {{(pid=416294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:06:00.875756 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81fd0e9e-f6f3-42e6-a3d9-a6ba0fab5f84 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 09:06:00.882733 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application [None req-81fd0e9e-f6f3-42e6-a3d9-a6ba0fab5f84 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 28 09:06:00.882733 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 09:06:00.882733 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 09:06:00.882733 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 09:06:00.882733 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 09:06:00.882733 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 09:06:00.882733 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 09:06:00.882733 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 09:06:00.882733 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 09:06:00.882733 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 09:06:00.882733 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 09:06:00.882733 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 09:06:00.882733 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 09:06:00.882733 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 09:06:00.882733 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 09:06:00.882733 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 09:06:00.883797 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 09:06:00.883797 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 09:06:00.883797 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 09:06:00.883797 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 09:06:00.883797 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 09:06:00.883797 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 09:06:00.883797 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 09:06:00.883797 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 09:06:00.883797 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 09:06:00.883797 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 09:06:00.883797 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 09:06:00.883797 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application with Lock( Jul 28 09:06:00.883797 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 09:06:00.883797 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self._enter() Jul 28 09:06:00.883797 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 09:06:00.883797 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 09:06:00.884747 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 09:06:00.884747 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self.creator() Jul 28 09:06:00.884747 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 09:06:00.884747 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application created_value = creator( Jul 28 09:06:00.884747 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 09:06:00.884747 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 09:06:00.884747 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 09:06:00.884747 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 09:06:00.884747 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 09:06:00.884747 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 09:06:00.884747 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 28 09:06:00.884747 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application Jul 28 09:06:00.887493 dv-cinder-851351-1-smb devstack@keystone.service[416293]: [pid: 416293|app: 0|req: 170/353] 10.222.0.42 () {56 vars in 1099 bytes} [Thu Jul 28 09:06:00 2022] GET /identity/v3/roles/member => generated 84 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 09:06:00.889007 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1c8e40-b5f5-4b82-b13a-bdfb6aaa53d2 None None] REQUEST_METHOD: `POST` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:06:00.889469 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1c8e40-b5f5-4b82-b13a-bdfb6aaa53d2 None None] SCRIPT_NAME: `/identity` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:06:00.889897 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1c8e40-b5f5-4b82-b13a-bdfb6aaa53d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:06:00.910200 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.auth.core [None req-0b1c8e40-b5f5-4b82-b13a-bdfb6aaa53d2 None None] MFA Rules not processed for user `dbf87abab90e4fdf9e75408f4199918e`. Rule list: `[]` (Enabled: `True`). {{(pid=416293) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 09:06:00.911866 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.fernet_utils [None req-0b1c8e40-b5f5-4b82-b13a-bdfb6aaa53d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=416293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 09:06:00.995041 dv-cinder-851351-1-smb devstack@keystone.service[416293]: [pid: 416293|app: 0|req: 171/354] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 09:06:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 09:06:00.997187 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c325ad6-6b21-43eb-9a08-a3dce050f11b None None] REQUEST_METHOD: `GET` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:06:00.997340 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d24f626-686e-467e-bae5-35b18e195c3a None None] Validating token access rules against request {{(pid=416294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:06:00.997780 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c325ad6-6b21-43eb-9a08-a3dce050f11b None None] SCRIPT_NAME: `/identity` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:06:00.998223 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c325ad6-6b21-43eb-9a08-a3dce050f11b None None] PATH_INFO: `/` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:06:01.000196 dv-cinder-851351-1-smb devstack@keystone.service[416293]: [pid: 416293|app: 0|req: 172/355] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 09:06:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 09:06:01.001168 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c325ad6-6b21-43eb-9a08-a3dce050f11b None None] Authenticating user token {{(pid=416293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:06:01.038487 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250a2983-ef41-4cff-b154-d1d264d9636d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:06:01.039102 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250a2983-ef41-4cff-b154-d1d264d9636d None admin] REQUEST_METHOD: `GET` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:06:01.039388 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250a2983-ef41-4cff-b154-d1d264d9636d None admin] SCRIPT_NAME: `/identity` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:06:01.039669 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250a2983-ef41-4cff-b154-d1d264d9636d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:06:01.040539 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-250a2983-ef41-4cff-b154-d1d264d9636d None admin] RBAC: Adding query filter params (group.id=7f607738424745bf955f57e2c8966ff8, role.id=6194848862704a289bbaa3fda43a9050, scope.project.id=c515ec4395fe420e9ab0ba34fb1ada8f) {{(pid=416294) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 09:06:01.040893 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-250a2983-ef41-4cff-b154-d1d264d9636d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:06:01.042433 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-250a2983-ef41-4cff-b154-d1d264d9636d None admin] RBAC: Authorization granted {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:06:01.052839 dv-cinder-851351-1-smb devstack@keystone.service[416294]: [pid: 416294|app: 0|req: 184/356] 10.222.0.42 () {56 vars in 1376 bytes} [Thu Jul 28 09:06:00 2022] GET /identity/v3/role_assignments?group.id=7f607738424745bf955f57e2c8966ff8&scope.project.id=c515ec4395fe420e9ab0ba34fb1ada8f&role.id=6194848862704a289bbaa3fda43a9050 => generated 260 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:06:01.054127 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG dbcounter [-] [416293] Writing DB stats keystone:SELECT=100 {{(pid=416293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:06:01.055037 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9416604d-947e-41e4-90c7-8588f45cc79c None None] REQUEST_METHOD: `POST` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:06:01.055322 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9416604d-947e-41e4-90c7-8588f45cc79c None None] SCRIPT_NAME: `/identity` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:06:01.055642 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9416604d-947e-41e4-90c7-8588f45cc79c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:06:01.086005 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.auth.core [None req-9416604d-947e-41e4-90c7-8588f45cc79c None None] MFA Rules not processed for user `dbf87abab90e4fdf9e75408f4199918e`. Rule list: `[]` (Enabled: `True`). {{(pid=416294) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 09:06:01.087357 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.fernet_utils [None req-9416604d-947e-41e4-90c7-8588f45cc79c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=416294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 09:06:01.124753 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c325ad6-6b21-43eb-9a08-a3dce050f11b None None] Validating token access rules against request {{(pid=416293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:06:01.166681 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd7886ad-e8c9-4337-b678-0bcc53ba496d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:06:01.167745 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7886ad-e8c9-4337-b678-0bcc53ba496d None admin] REQUEST_METHOD: `GET` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:06:01.168304 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7886ad-e8c9-4337-b678-0bcc53ba496d None admin] SCRIPT_NAME: `/identity` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:06:01.168779 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7886ad-e8c9-4337-b678-0bcc53ba496d None admin] PATH_INFO: `/v3/roles` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:06:01.169769 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd7886ad-e8c9-4337-b678-0bcc53ba496d None admin] RBAC: Adding query filter params (name=member) {{(pid=416293) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 09:06:01.170571 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG dbcounter [-] [416294] Writing DB stats keystone:SELECT=100 {{(pid=416294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:06:01.171146 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd7886ad-e8c9-4337-b678-0bcc53ba496d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:06:01.172959 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd7886ad-e8c9-4337-b678-0bcc53ba496d None admin] RBAC: Authorization granted {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:06:01.184344 dv-cinder-851351-1-smb devstack@keystone.service[416293]: [pid: 416293|app: 0|req: 173/357] 10.222.0.42 () {56 vars in 1101 bytes} [Thu Jul 28 09:06:01 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:06:01.185569 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd7886ad-e8c9-4337-b678-0bcc53ba496d None admin] Authenticating user token {{(pid=416293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:06:01.200350 dv-cinder-851351-1-smb devstack@keystone.service[416294]: [pid: 416294|app: 0|req: 185/358] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 09:06:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 09:06:01.201354 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9416604d-947e-41e4-90c7-8588f45cc79c None None] Authenticating user token {{(pid=416294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:06:01.305419 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd7886ad-e8c9-4337-b678-0bcc53ba496d None admin] Validating token access rules against request {{(pid=416293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:06:01.314737 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG dbcounter [-] [416293] Writing DB stats keystone:SELECT=100 {{(pid=416293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:06:01.349245 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4cc9908-739b-4cdf-8abd-dc7a4eaebcac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:06:01.350320 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4cc9908-739b-4cdf-8abd-dc7a4eaebcac None admin] REQUEST_METHOD: `GET` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:06:01.350706 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4cc9908-739b-4cdf-8abd-dc7a4eaebcac None admin] SCRIPT_NAME: `/identity` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:06:01.351084 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4cc9908-739b-4cdf-8abd-dc7a4eaebcac None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:06:01.363865 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4cc9908-739b-4cdf-8abd-dc7a4eaebcac None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 09:06:01.370487 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application [None req-f4cc9908-739b-4cdf-8abd-dc7a4eaebcac None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 28 09:06:01.370487 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 09:06:01.370487 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 09:06:01.370487 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 09:06:01.370487 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 09:06:01.370487 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 09:06:01.370487 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 09:06:01.370487 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 09:06:01.370487 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 09:06:01.370487 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 09:06:01.370487 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 09:06:01.370487 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 09:06:01.370487 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 09:06:01.370487 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 09:06:01.370487 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 09:06:01.370487 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 09:06:01.371724 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 09:06:01.371724 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 09:06:01.371724 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 09:06:01.371724 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 09:06:01.371724 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 09:06:01.371724 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 09:06:01.371724 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 09:06:01.371724 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 09:06:01.371724 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 09:06:01.371724 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 09:06:01.371724 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 09:06:01.371724 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application with Lock( Jul 28 09:06:01.371724 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 09:06:01.371724 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self._enter() Jul 28 09:06:01.371724 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 09:06:01.371724 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 09:06:01.372940 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 09:06:01.372940 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self.creator() Jul 28 09:06:01.372940 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 09:06:01.372940 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application created_value = creator( Jul 28 09:06:01.372940 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 09:06:01.372940 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 09:06:01.372940 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 09:06:01.372940 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 09:06:01.372940 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 09:06:01.372940 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 09:06:01.372940 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 28 09:06:01.372940 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application Jul 28 09:06:01.374584 dv-cinder-851351-1-smb devstack@keystone.service[416293]: [pid: 416293|app: 0|req: 174/359] 10.222.0.42 () {56 vars in 1114 bytes} [Thu Jul 28 09:06:01 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 09:06:01.379897 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4cc9908-739b-4cdf-8abd-dc7a4eaebcac None admin] Authenticating user token {{(pid=416293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:06:01.387147 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9416604d-947e-41e4-90c7-8588f45cc79c None None] Validating token access rules against request {{(pid=416294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:06:01.449682 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d626fb-102f-4a9a-a86f-acdf1b3454b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:06:01.450879 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d626fb-102f-4a9a-a86f-acdf1b3454b4 None admin] REQUEST_METHOD: `GET` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:06:01.451166 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d626fb-102f-4a9a-a86f-acdf1b3454b4 None admin] SCRIPT_NAME: `/identity` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:06:01.451739 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d626fb-102f-4a9a-a86f-acdf1b3454b4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:06:01.514948 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4cc9908-739b-4cdf-8abd-dc7a4eaebcac None admin] Validating token access rules against request {{(pid=416293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:06:01.544297 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG dbcounter [-] [416294] Writing DB stats keystone:SELECT=100 {{(pid=416294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:06:01.560148 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e112e4-f6dc-4d7a-8605-503e50cbb9ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:06:01.560937 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e112e4-f6dc-4d7a-8605-503e50cbb9ea None admin] REQUEST_METHOD: `GET` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:06:01.561222 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e112e4-f6dc-4d7a-8605-503e50cbb9ea None admin] SCRIPT_NAME: `/identity` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:06:01.562059 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e112e4-f6dc-4d7a-8605-503e50cbb9ea None admin] PATH_INFO: `/v3/roles/reader` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:06:01.563841 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76d626fb-102f-4a9a-a86f-acdf1b3454b4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:06:01.565702 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76d626fb-102f-4a9a-a86f-acdf1b3454b4 None admin] RBAC: Authorization granted {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:06:01.576006 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10e112e4-f6dc-4d7a-8605-503e50cbb9ea None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 09:06:01.582691 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application [None req-10e112e4-f6dc-4d7a-8605-503e50cbb9ea None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 28 09:06:01.582691 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 09:06:01.582691 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 09:06:01.582691 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 09:06:01.582691 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 09:06:01.582691 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 09:06:01.582691 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 09:06:01.582691 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 09:06:01.582691 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 09:06:01.582691 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 09:06:01.582691 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 09:06:01.582691 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 09:06:01.582691 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 09:06:01.582691 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 09:06:01.582691 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 09:06:01.582691 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 09:06:01.583732 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 09:06:01.583732 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 09:06:01.583732 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 09:06:01.583732 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 09:06:01.583732 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 09:06:01.583732 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 09:06:01.583732 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 09:06:01.583732 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 09:06:01.583732 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 09:06:01.583732 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 09:06:01.583732 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 09:06:01.583732 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application with Lock( Jul 28 09:06:01.583732 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 09:06:01.583732 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self._enter() Jul 28 09:06:01.583732 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 09:06:01.583732 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 09:06:01.584601 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 09:06:01.584601 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self.creator() Jul 28 09:06:01.584601 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 09:06:01.584601 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application created_value = creator( Jul 28 09:06:01.584601 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 09:06:01.584601 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 09:06:01.584601 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 09:06:01.584601 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 09:06:01.584601 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 09:06:01.584601 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 09:06:01.584601 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 28 09:06:01.584601 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application Jul 28 09:06:01.584601 dv-cinder-851351-1-smb devstack@keystone.service[416293]: [pid: 416293|app: 0|req: 175/360] 10.222.0.42 () {56 vars in 1099 bytes} [Thu Jul 28 09:06:01 2022] GET /identity/v3/roles/reader => generated 84 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 09:06:01.585404 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e112e4-f6dc-4d7a-8605-503e50cbb9ea None admin] Authenticating user token {{(pid=416293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:06:01.620584 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG dbcounter [-] [416293] Writing DB stats keystone:SELECT=100 {{(pid=416293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:06:01.701659 dv-cinder-851351-1-smb devstack@keystone.service[416294]: [pid: 416294|app: 0|req: 186/361] 10.222.0.42 () {58 vars in 1282 bytes} [Thu Jul 28 09:06:01 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 501 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 28 09:06:01.702991 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffdee97c-a115-4971-ad5f-319307e3c596 None None] REQUEST_METHOD: `GET` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:06:01.703285 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffdee97c-a115-4971-ad5f-319307e3c596 None None] SCRIPT_NAME: `/identity` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:06:01.703565 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffdee97c-a115-4971-ad5f-319307e3c596 None None] PATH_INFO: `/` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:06:01.708117 dv-cinder-851351-1-smb devstack@keystone.service[416294]: [pid: 416294|app: 0|req: 187/362] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 09:06:01 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 09:06:01.708117 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffdee97c-a115-4971-ad5f-319307e3c596 None None] Authenticating user token {{(pid=416294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:06:01.730405 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e112e4-f6dc-4d7a-8605-503e50cbb9ea None admin] Validating token access rules against request {{(pid=416293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:06:01.778451 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cacd23cb-db53-4f92-a2c3-12ed3572652e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:06:01.779121 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cacd23cb-db53-4f92-a2c3-12ed3572652e None admin] REQUEST_METHOD: `GET` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:06:01.779382 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cacd23cb-db53-4f92-a2c3-12ed3572652e None admin] SCRIPT_NAME: `/identity` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:06:01.779670 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cacd23cb-db53-4f92-a2c3-12ed3572652e None admin] PATH_INFO: `/v3/roles` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:06:01.780797 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cacd23cb-db53-4f92-a2c3-12ed3572652e None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=416293) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 09:06:01.781172 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cacd23cb-db53-4f92-a2c3-12ed3572652e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:06:01.782871 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cacd23cb-db53-4f92-a2c3-12ed3572652e None admin] RBAC: Authorization granted {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:06:01.798554 dv-cinder-851351-1-smb devstack@keystone.service[416293]: [pid: 416293|app: 0|req: 176/363] 10.222.0.42 () {56 vars in 1111 bytes} [Thu Jul 28 09:06:01 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:06:01.799521 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cacd23cb-db53-4f92-a2c3-12ed3572652e None admin] Authenticating user token {{(pid=416293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:06:01.827242 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG dbcounter [-] [416294] Writing DB stats keystone:SELECT=100 {{(pid=416294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:06:01.850227 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffdee97c-a115-4971-ad5f-319307e3c596 None None] Validating token access rules against request {{(pid=416294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:06:01.893905 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0f4f90-33c5-4181-9616-48b9065667ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:06:01.894660 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0f4f90-33c5-4181-9616-48b9065667ca None admin] REQUEST_METHOD: `GET` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:06:01.895006 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0f4f90-33c5-4181-9616-48b9065667ca None admin] SCRIPT_NAME: `/identity` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:06:01.895352 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0f4f90-33c5-4181-9616-48b9065667ca None admin] PATH_INFO: `/v3/roles` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:06:01.896204 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e0f4f90-33c5-4181-9616-48b9065667ca None admin] RBAC: Adding query filter params (name=reader) {{(pid=416294) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 09:06:01.896577 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e0f4f90-33c5-4181-9616-48b9065667ca None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:06:01.898267 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e0f4f90-33c5-4181-9616-48b9065667ca None admin] RBAC: Authorization granted {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:06:01.908971 dv-cinder-851351-1-smb devstack@keystone.service[416294]: [pid: 416294|app: 0|req: 188/364] 10.222.0.42 () {56 vars in 1101 bytes} [Thu Jul 28 09:06:01 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:06:01.910152 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8dbfb68-b0a3-4f3c-8e1e-4d714f059c7c None None] REQUEST_METHOD: `POST` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:06:01.910509 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8dbfb68-b0a3-4f3c-8e1e-4d714f059c7c None None] SCRIPT_NAME: `/identity` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:06:01.910859 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8dbfb68-b0a3-4f3c-8e1e-4d714f059c7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:06:01.923991 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG dbcounter [-] [416293] Writing DB stats keystone:SELECT=100 {{(pid=416293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:06:01.932313 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.auth.core [None req-a8dbfb68-b0a3-4f3c-8e1e-4d714f059c7c None None] MFA Rules not processed for user `dbf87abab90e4fdf9e75408f4199918e`. Rule list: `[]` (Enabled: `True`). {{(pid=416294) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 09:06:01.933758 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.fernet_utils [None req-a8dbfb68-b0a3-4f3c-8e1e-4d714f059c7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=416294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 09:06:01.946893 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cacd23cb-db53-4f92-a2c3-12ed3572652e None admin] Validating token access rules against request {{(pid=416293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:06:02.002788 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e06070-d926-4f66-a736-9d7dcb247963 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:06:02.003901 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e06070-d926-4f66-a736-9d7dcb247963 None admin] REQUEST_METHOD: `GET` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:06:02.004377 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e06070-d926-4f66-a736-9d7dcb247963 None admin] SCRIPT_NAME: `/identity` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:06:02.004895 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e06070-d926-4f66-a736-9d7dcb247963 None admin] PATH_INFO: `/v3/projects/5c46e2ed162f45cabaf6f30752f915a4` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:06:02.006480 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99e06070-d926-4f66-a736-9d7dcb247963 None admin] RBAC: Authorizing `identity:get_project(project_id=5c46e2ed162f45cabaf6f30752f915a4)` {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:06:02.008289 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99e06070-d926-4f66-a736-9d7dcb247963 None admin] RBAC: Authorization granted {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:06:02.010512 dv-cinder-851351-1-smb devstack@keystone.service[416293]: [pid: 416293|app: 0|req: 177/365] 10.222.0.42 () {56 vars in 1186 bytes} [Thu Jul 28 09:06:01 2022] GET /identity/v3/projects/5c46e2ed162f45cabaf6f30752f915a4 => generated 302 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:06:02.012538 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e06070-d926-4f66-a736-9d7dcb247963 None admin] Authenticating user token {{(pid=416293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:06:02.040581 dv-cinder-851351-1-smb devstack@keystone.service[416294]: [pid: 416294|app: 0|req: 189/366] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 09:06:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 09:06:02.041769 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8dbfb68-b0a3-4f3c-8e1e-4d714f059c7c None None] Authenticating user token {{(pid=416294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:06:02.127596 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e06070-d926-4f66-a736-9d7dcb247963 None admin] Validating token access rules against request {{(pid=416293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:06:02.135648 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG dbcounter [-] [416294] Writing DB stats keystone:SELECT=100 {{(pid=416294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:06:02.159693 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8dbfb68-b0a3-4f3c-8e1e-4d714f059c7c None None] Validating token access rules against request {{(pid=416294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:06:02.168394 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-806eb66b-957c-4504-b6a9-a4cecabca960 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:06:02.169072 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806eb66b-957c-4504-b6a9-a4cecabca960 None admin] REQUEST_METHOD: `GET` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:06:02.169800 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806eb66b-957c-4504-b6a9-a4cecabca960 None admin] SCRIPT_NAME: `/identity` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:06:02.169800 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806eb66b-957c-4504-b6a9-a4cecabca960 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:06:02.197279 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG dbcounter [-] [416293] Writing DB stats keystone:SELECT=100 {{(pid=416293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:06:02.202029 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95417748-0f8e-4097-b863-5ccbdd583590 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:06:02.203045 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95417748-0f8e-4097-b863-5ccbdd583590 None admin] REQUEST_METHOD: `GET` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:06:02.203554 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95417748-0f8e-4097-b863-5ccbdd583590 None admin] SCRIPT_NAME: `/identity` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:06:02.204052 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95417748-0f8e-4097-b863-5ccbdd583590 None admin] PATH_INFO: `/v3/users/8fbb6d684807450cbaf19b215d6079ce` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:06:02.207333 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95417748-0f8e-4097-b863-5ccbdd583590 None admin] RBAC: Authorizing `identity:get_user(user_id=8fbb6d684807450cbaf19b215d6079ce)` {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:06:02.209175 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95417748-0f8e-4097-b863-5ccbdd583590 None admin] RBAC: Authorization granted {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:06:02.211485 dv-cinder-851351-1-smb devstack@keystone.service[416294]: [pid: 416294|app: 0|req: 190/367] 10.222.0.42 () {56 vars in 1177 bytes} [Thu Jul 28 09:06:02 2022] GET /identity/v3/users/8fbb6d684807450cbaf19b215d6079ce => generated 293 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:06:02.212485 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95417748-0f8e-4097-b863-5ccbdd583590 None admin] Authenticating user token {{(pid=416294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:06:02.246851 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-806eb66b-957c-4504-b6a9-a4cecabca960 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:06:02.248526 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-806eb66b-957c-4504-b6a9-a4cecabca960 None admin] RBAC: Authorization granted {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:06:02.325191 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95417748-0f8e-4097-b863-5ccbdd583590 None admin] Validating token access rules against request {{(pid=416294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:06:02.360014 dv-cinder-851351-1-smb devstack@keystone.service[416293]: [pid: 416293|app: 0|req: 178/368] 10.222.0.42 () {58 vars in 1282 bytes} [Thu Jul 28 09:06:02 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 349 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 28 09:06:02.363416 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e795e82-b8c7-4bf4-890f-06770ae1dbae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:06:02.364338 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e795e82-b8c7-4bf4-890f-06770ae1dbae None admin] REQUEST_METHOD: `GET` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:06:02.364894 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e795e82-b8c7-4bf4-890f-06770ae1dbae None admin] SCRIPT_NAME: `/identity` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:06:02.365019 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-806eb66b-957c-4504-b6a9-a4cecabca960 None admin] Authenticating user token {{(pid=416293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:06:02.365516 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e795e82-b8c7-4bf4-890f-06770ae1dbae None admin] PATH_INFO: `/v3/groups/7f607738424745bf955f57e2c8966ff8` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:06:02.367006 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e795e82-b8c7-4bf4-890f-06770ae1dbae None admin] RBAC: Authorizing `identity:get_group(group_id=7f607738424745bf955f57e2c8966ff8)` {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:06:02.368717 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e795e82-b8c7-4bf4-890f-06770ae1dbae None admin] RBAC: Authorization granted {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:06:02.370899 dv-cinder-851351-1-smb devstack@keystone.service[416294]: [pid: 416294|app: 0|req: 191/369] 10.222.0.42 () {56 vars in 1180 bytes} [Thu Jul 28 09:06:02 2022] GET /identity/v3/groups/7f607738424745bf955f57e2c8966ff8 => generated 226 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:06:02.371955 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e795e82-b8c7-4bf4-890f-06770ae1dbae None admin] Authenticating user token {{(pid=416294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:06:02.394042 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG dbcounter [-] [416294] Writing DB stats keystone:SELECT=100 {{(pid=416294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:06:02.436679 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG dbcounter [-] [416293] Writing DB stats keystone:SELECT=100 {{(pid=416293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:06:02.486964 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-806eb66b-957c-4504-b6a9-a4cecabca960 None admin] Validating token access rules against request {{(pid=416293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:06:02.489871 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e795e82-b8c7-4bf4-890f-06770ae1dbae None admin] Validating token access rules against request {{(pid=416294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:06:02.526056 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-207ba6b3-d00e-4aae-b082-0c524da501fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:06:02.526722 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207ba6b3-d00e-4aae-b082-0c524da501fc None admin] REQUEST_METHOD: `GET` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:06:02.527011 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207ba6b3-d00e-4aae-b082-0c524da501fc None admin] SCRIPT_NAME: `/identity` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:06:02.527291 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207ba6b3-d00e-4aae-b082-0c524da501fc None admin] PATH_INFO: `/v3/roles/admin` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:06:02.530206 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23bcbf3f-96da-42f2-8d84-fe043dc61a2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:06:02.531111 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23bcbf3f-96da-42f2-8d84-fe043dc61a2b None admin] REQUEST_METHOD: `GET` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:06:02.531614 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23bcbf3f-96da-42f2-8d84-fe043dc61a2b None admin] SCRIPT_NAME: `/identity` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:06:02.532132 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23bcbf3f-96da-42f2-8d84-fe043dc61a2b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:06:02.533278 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23bcbf3f-96da-42f2-8d84-fe043dc61a2b None admin] RBAC: Adding query filter params (role.id=071325426dc84e2cb2689d138bc2b032, user.id=8fbb6d684807450cbaf19b215d6079ce, scope.system=all) {{(pid=416294) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 09:06:02.534081 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23bcbf3f-96da-42f2-8d84-fe043dc61a2b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:06:02.535993 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23bcbf3f-96da-42f2-8d84-fe043dc61a2b None admin] RBAC: Authorization granted {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:06:02.539366 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-207ba6b3-d00e-4aae-b082-0c524da501fc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 09:06:02.545649 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application [None req-207ba6b3-d00e-4aae-b082-0c524da501fc None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 09:06:02.545649 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 09:06:02.545649 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 09:06:02.545649 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 09:06:02.545649 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 09:06:02.545649 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 09:06:02.545649 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 09:06:02.545649 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 09:06:02.545649 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 09:06:02.545649 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 09:06:02.545649 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 09:06:02.545649 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 09:06:02.545649 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 09:06:02.545649 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 09:06:02.545649 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 09:06:02.545649 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 09:06:02.546693 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 09:06:02.546693 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 09:06:02.546693 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 09:06:02.546693 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 09:06:02.546693 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 09:06:02.546693 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 09:06:02.546693 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 09:06:02.546693 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 09:06:02.546693 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 09:06:02.546693 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 09:06:02.546693 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 09:06:02.546693 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application with Lock( Jul 28 09:06:02.546693 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 09:06:02.546693 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self._enter() Jul 28 09:06:02.546693 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 09:06:02.546693 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 09:06:02.547584 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 09:06:02.547584 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self.creator() Jul 28 09:06:02.547584 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 09:06:02.547584 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application created_value = creator( Jul 28 09:06:02.547584 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 09:06:02.547584 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 09:06:02.547584 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 09:06:02.547584 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 09:06:02.547584 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 09:06:02.547584 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 09:06:02.547584 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 09:06:02.547584 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application Jul 28 09:06:02.547584 dv-cinder-851351-1-smb devstack@keystone.service[416293]: [pid: 416293|app: 0|req: 179/370] 10.222.0.42 () {56 vars in 1096 bytes} [Thu Jul 28 09:06:02 2022] GET /identity/v3/roles/admin => generated 83 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 09:06:02.548319 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-207ba6b3-d00e-4aae-b082-0c524da501fc None admin] Authenticating user token {{(pid=416293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:06:02.556715 dv-cinder-851351-1-smb devstack@keystone.service[416294]: [pid: 416294|app: 0|req: 192/371] 10.222.0.42 () {56 vars in 1308 bytes} [Thu Jul 28 09:06:02 2022] GET /identity/v3/role_assignments?user.id=8fbb6d684807450cbaf19b215d6079ce&scope.system=all&role.id=071325426dc84e2cb2689d138bc2b032 => generated 510 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:06:02.557604 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23bcbf3f-96da-42f2-8d84-fe043dc61a2b None admin] Authenticating user token {{(pid=416294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:06:02.653312 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG dbcounter [-] [416294] Writing DB stats keystone:SELECT=100 {{(pid=416294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:06:02.684105 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23bcbf3f-96da-42f2-8d84-fe043dc61a2b None admin] Validating token access rules against request {{(pid=416294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:06:02.707422 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-207ba6b3-d00e-4aae-b082-0c524da501fc None admin] Validating token access rules against request {{(pid=416293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:06:02.724618 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101d3dbf-0d2f-43b7-a779-0dbf78433c4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:06:02.725775 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101d3dbf-0d2f-43b7-a779-0dbf78433c4f None admin] REQUEST_METHOD: `GET` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:06:02.726325 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101d3dbf-0d2f-43b7-a779-0dbf78433c4f None admin] SCRIPT_NAME: `/identity` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:06:02.726832 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101d3dbf-0d2f-43b7-a779-0dbf78433c4f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:06:02.727917 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-101d3dbf-0d2f-43b7-a779-0dbf78433c4f None admin] RBAC: Adding query filter params (group.id=7f607738424745bf955f57e2c8966ff8, role.id=ba1a79dc27074d5a94dce2d994019d37, scope.project.id=5c46e2ed162f45cabaf6f30752f915a4) {{(pid=416294) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 09:06:02.728490 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-101d3dbf-0d2f-43b7-a779-0dbf78433c4f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:06:02.730266 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-101d3dbf-0d2f-43b7-a779-0dbf78433c4f None admin] RBAC: Authorization granted {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:06:02.737435 dv-cinder-851351-1-smb devstack@keystone.service[416294]: [pid: 416294|app: 0|req: 193/372] 10.222.0.42 () {56 vars in 1376 bytes} [Thu Jul 28 09:06:02 2022] GET /identity/v3/role_assignments?group.id=7f607738424745bf955f57e2c8966ff8&scope.project.id=5c46e2ed162f45cabaf6f30752f915a4&role.id=ba1a79dc27074d5a94dce2d994019d37 => generated 260 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:06:02.738715 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101d3dbf-0d2f-43b7-a779-0dbf78433c4f None admin] Authenticating user token {{(pid=416294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:06:02.742098 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG dbcounter [-] [416293] Writing DB stats keystone:SELECT=100 {{(pid=416293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:06:02.793816 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99741a9b-ecbb-499c-83c4-1dc0bc7b8f58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:06:02.794507 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99741a9b-ecbb-499c-83c4-1dc0bc7b8f58 None admin] REQUEST_METHOD: `GET` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:06:02.794616 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99741a9b-ecbb-499c-83c4-1dc0bc7b8f58 None admin] SCRIPT_NAME: `/identity` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:06:02.794867 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99741a9b-ecbb-499c-83c4-1dc0bc7b8f58 None admin] PATH_INFO: `/v3/projects/5c46e2ed162f45cabaf6f30752f915a4` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:06:02.801695 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99741a9b-ecbb-499c-83c4-1dc0bc7b8f58 None admin] RBAC: Authorizing `identity:get_project(project_id=5c46e2ed162f45cabaf6f30752f915a4)` {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:06:02.803241 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99741a9b-ecbb-499c-83c4-1dc0bc7b8f58 None admin] RBAC: Authorization granted {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:06:02.805167 dv-cinder-851351-1-smb devstack@keystone.service[416293]: [pid: 416293|app: 0|req: 180/373] 10.222.0.42 () {56 vars in 1186 bytes} [Thu Jul 28 09:06:02 2022] GET /identity/v3/projects/5c46e2ed162f45cabaf6f30752f915a4 => generated 302 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:06:02.813823 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99741a9b-ecbb-499c-83c4-1dc0bc7b8f58 None admin] Authenticating user token {{(pid=416293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:06:02.868136 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101d3dbf-0d2f-43b7-a779-0dbf78433c4f None admin] Validating token access rules against request {{(pid=416294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:06:02.909933 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc9c132-5758-44d4-8168-6627eebea2e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:06:02.910977 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc9c132-5758-44d4-8168-6627eebea2e7 None admin] REQUEST_METHOD: `GET` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:06:02.911631 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc9c132-5758-44d4-8168-6627eebea2e7 None admin] SCRIPT_NAME: `/identity` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:06:02.912197 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc9c132-5758-44d4-8168-6627eebea2e7 None admin] PATH_INFO: `/v3/roles` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:06:02.913227 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bc9c132-5758-44d4-8168-6627eebea2e7 None admin] RBAC: Adding query filter params (name=admin) {{(pid=416294) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 09:06:02.913764 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bc9c132-5758-44d4-8168-6627eebea2e7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:06:02.915477 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bc9c132-5758-44d4-8168-6627eebea2e7 None admin] RBAC: Authorization granted {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:06:02.926570 dv-cinder-851351-1-smb devstack@keystone.service[416294]: [pid: 416294|app: 0|req: 194/374] 10.222.0.42 () {56 vars in 1099 bytes} [Thu Jul 28 09:06:02 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:06:02.929094 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG dbcounter [-] [416294] Writing DB stats keystone:SELECT=100 {{(pid=416294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:06:02.935703 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc9c132-5758-44d4-8168-6627eebea2e7 None admin] Authenticating user token {{(pid=416294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:06:02.987673 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99741a9b-ecbb-499c-83c4-1dc0bc7b8f58 None admin] Validating token access rules against request {{(pid=416293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:06:03.042257 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e961ce72-5f9a-48a0-bdd0-0b8a0f24299e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:06:03.042945 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e961ce72-5f9a-48a0-bdd0-0b8a0f24299e None admin] REQUEST_METHOD: `GET` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:06:03.043235 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e961ce72-5f9a-48a0-bdd0-0b8a0f24299e None admin] SCRIPT_NAME: `/identity` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:06:03.043516 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e961ce72-5f9a-48a0-bdd0-0b8a0f24299e None admin] PATH_INFO: `/v3/groups/7f607738424745bf955f57e2c8966ff8` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:06:03.044771 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e961ce72-5f9a-48a0-bdd0-0b8a0f24299e None admin] RBAC: Authorizing `identity:get_group(group_id=7f607738424745bf955f57e2c8966ff8)` {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:06:03.046275 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e961ce72-5f9a-48a0-bdd0-0b8a0f24299e None admin] RBAC: Authorization granted {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:06:03.048289 dv-cinder-851351-1-smb devstack@keystone.service[416293]: [pid: 416293|app: 0|req: 181/375] 10.222.0.42 () {56 vars in 1180 bytes} [Thu Jul 28 09:06:02 2022] GET /identity/v3/groups/7f607738424745bf955f57e2c8966ff8 => generated 226 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:06:03.057792 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e961ce72-5f9a-48a0-bdd0-0b8a0f24299e None admin] Authenticating user token {{(pid=416293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:06:03.084948 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc9c132-5758-44d4-8168-6627eebea2e7 None admin] Validating token access rules against request {{(pid=416294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:06:03.122375 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce43f8cb-4bf9-4c65-8687-ed808321632a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:06:03.123074 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce43f8cb-4bf9-4c65-8687-ed808321632a None admin] REQUEST_METHOD: `GET` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:06:03.123366 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce43f8cb-4bf9-4c65-8687-ed808321632a None admin] SCRIPT_NAME: `/identity` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:06:03.123706 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce43f8cb-4bf9-4c65-8687-ed808321632a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:06:03.137619 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG dbcounter [-] [416293] Writing DB stats keystone:SELECT=100 {{(pid=416293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:06:03.201228 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG dbcounter [-] [416294] Writing DB stats keystone:SELECT=100 {{(pid=416294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:06:03.201696 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e961ce72-5f9a-48a0-bdd0-0b8a0f24299e None admin] Validating token access rules against request {{(pid=416293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:06:03.202664 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce43f8cb-4bf9-4c65-8687-ed808321632a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:06:03.204421 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce43f8cb-4bf9-4c65-8687-ed808321632a None admin] RBAC: Authorization granted {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:06:03.244758 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a0e353-2180-4d93-be1b-a68d857d82a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:06:03.245696 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a0e353-2180-4d93-be1b-a68d857d82a2 None admin] REQUEST_METHOD: `GET` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:06:03.246147 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a0e353-2180-4d93-be1b-a68d857d82a2 None admin] SCRIPT_NAME: `/identity` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:06:03.246588 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a0e353-2180-4d93-be1b-a68d857d82a2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:06:03.247562 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71a0e353-2180-4d93-be1b-a68d857d82a2 None admin] RBAC: Adding query filter params (group.id=7f607738424745bf955f57e2c8966ff8, role.id=6194848862704a289bbaa3fda43a9050, scope.project.id=5c46e2ed162f45cabaf6f30752f915a4) {{(pid=416293) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 09:06:03.248041 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71a0e353-2180-4d93-be1b-a68d857d82a2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:06:03.249711 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71a0e353-2180-4d93-be1b-a68d857d82a2 None admin] RBAC: Authorization granted {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:06:03.256527 dv-cinder-851351-1-smb devstack@keystone.service[416293]: [pid: 416293|app: 0|req: 182/376] 10.222.0.42 () {56 vars in 1376 bytes} [Thu Jul 28 09:06:03 2022] GET /identity/v3/role_assignments?group.id=7f607738424745bf955f57e2c8966ff8&scope.project.id=5c46e2ed162f45cabaf6f30752f915a4&role.id=6194848862704a289bbaa3fda43a9050 => generated 260 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:06:03.258058 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e61dc31-b022-403c-8697-cabc02e8e984 None None] REQUEST_METHOD: `GET` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:06:03.258519 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e61dc31-b022-403c-8697-cabc02e8e984 None None] SCRIPT_NAME: `/identity` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:06:03.258949 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e61dc31-b022-403c-8697-cabc02e8e984 None None] PATH_INFO: `/` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:06:03.260630 dv-cinder-851351-1-smb devstack@keystone.service[416293]: [pid: 416293|app: 0|req: 183/377] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 09:06:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 09:06:03.270498 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40da32f4-2126-403a-8d75-5a621fb2de9c None None] REQUEST_METHOD: `POST` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:06:03.270788 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40da32f4-2126-403a-8d75-5a621fb2de9c None None] SCRIPT_NAME: `/identity` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:06:03.271258 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40da32f4-2126-403a-8d75-5a621fb2de9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:06:03.292015 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.auth.core [None req-40da32f4-2126-403a-8d75-5a621fb2de9c None None] MFA Rules not processed for user `dbf87abab90e4fdf9e75408f4199918e`. Rule list: `[]` (Enabled: `True`). {{(pid=416293) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 09:06:03.293470 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.fernet_utils [None req-40da32f4-2126-403a-8d75-5a621fb2de9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=416293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 09:06:03.322741 dv-cinder-851351-1-smb devstack@keystone.service[416294]: [pid: 416294|app: 0|req: 195/378] 10.222.0.42 () {58 vars in 1282 bytes} [Thu Jul 28 09:06:02 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 387 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 28 09:06:03.330603 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce43f8cb-4bf9-4c65-8687-ed808321632a None admin] Authenticating user token {{(pid=416294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:06:03.375836 dv-cinder-851351-1-smb devstack@keystone.service[416293]: [pid: 416293|app: 0|req: 184/379] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 09:06:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 28 09:06:03.402492 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40da32f4-2126-403a-8d75-5a621fb2de9c None None] Authenticating user token {{(pid=416293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:06:03.444895 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG dbcounter [-] [416294] Writing DB stats keystone:SELECT=100 {{(pid=416294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:06:03.448117 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce43f8cb-4bf9-4c65-8687-ed808321632a None admin] Validating token access rules against request {{(pid=416294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:06:03.460742 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG dbcounter [-] [416293] Writing DB stats keystone:SELECT=100 {{(pid=416293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:06:03.490576 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9df1ff-3db1-4aec-a409-0d4eb15e8939 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:06:03.491367 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9df1ff-3db1-4aec-a409-0d4eb15e8939 None admin] REQUEST_METHOD: `GET` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:06:03.491660 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9df1ff-3db1-4aec-a409-0d4eb15e8939 None admin] SCRIPT_NAME: `/identity` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:06:03.491935 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9df1ff-3db1-4aec-a409-0d4eb15e8939 None admin] PATH_INFO: `/v3/projects/0b5d78d12a0c4dfdbf387a60d6572e81` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:06:03.493202 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa9df1ff-3db1-4aec-a409-0d4eb15e8939 None admin] RBAC: Authorizing `identity:get_project(project_id=0b5d78d12a0c4dfdbf387a60d6572e81)` {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:06:03.494756 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa9df1ff-3db1-4aec-a409-0d4eb15e8939 None admin] RBAC: Authorization granted {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:06:03.496889 dv-cinder-851351-1-smb devstack@keystone.service[416294]: [pid: 416294|app: 0|req: 196/380] 10.222.0.42 () {56 vars in 1186 bytes} [Thu Jul 28 09:06:03 2022] GET /identity/v3/projects/0b5d78d12a0c4dfdbf387a60d6572e81 => generated 344 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 09:06:03.503876 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9df1ff-3db1-4aec-a409-0d4eb15e8939 None admin] Authenticating user token {{(pid=416294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:06:03.531508 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40da32f4-2126-403a-8d75-5a621fb2de9c None None] Validating token access rules against request {{(pid=416293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:06:03.582556 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cadcd903-8770-41a0-a95f-c595b6616346 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:06:03.583245 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cadcd903-8770-41a0-a95f-c595b6616346 None admin] REQUEST_METHOD: `GET` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:06:03.583532 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cadcd903-8770-41a0-a95f-c595b6616346 None admin] SCRIPT_NAME: `/identity` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:06:03.583813 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cadcd903-8770-41a0-a95f-c595b6616346 None admin] PATH_INFO: `/v3/roles/member` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:06:03.601617 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cadcd903-8770-41a0-a95f-c595b6616346 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 09:06:03.606795 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application [None req-cadcd903-8770-41a0-a95f-c595b6616346 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 28 09:06:03.606795 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 09:06:03.606795 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 09:06:03.606795 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 09:06:03.606795 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 09:06:03.606795 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 09:06:03.606795 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 09:06:03.606795 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 09:06:03.606795 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 09:06:03.606795 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 09:06:03.606795 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 09:06:03.606795 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 09:06:03.606795 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 09:06:03.606795 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 09:06:03.606795 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 09:06:03.606795 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 09:06:03.607826 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 09:06:03.607826 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 09:06:03.607826 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 09:06:03.607826 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 09:06:03.607826 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 09:06:03.607826 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 09:06:03.607826 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 09:06:03.607826 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 09:06:03.607826 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 09:06:03.607826 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 09:06:03.607826 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 09:06:03.607826 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application with Lock( Jul 28 09:06:03.607826 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 09:06:03.607826 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self._enter() Jul 28 09:06:03.607826 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 09:06:03.607826 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 09:06:03.608701 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 09:06:03.608701 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self.creator() Jul 28 09:06:03.608701 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 09:06:03.608701 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application created_value = creator( Jul 28 09:06:03.608701 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 09:06:03.608701 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 09:06:03.608701 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 09:06:03.608701 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 09:06:03.608701 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 09:06:03.608701 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 09:06:03.608701 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 28 09:06:03.608701 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application Jul 28 09:06:03.609393 dv-cinder-851351-1-smb devstack@keystone.service[416293]: [pid: 416293|app: 0|req: 185/381] 10.222.0.42 () {56 vars in 1099 bytes} [Thu Jul 28 09:06:03 2022] GET /identity/v3/roles/member => generated 84 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 09:06:03.615824 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cadcd903-8770-41a0-a95f-c595b6616346 None admin] Authenticating user token {{(pid=416293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:06:03.621204 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9df1ff-3db1-4aec-a409-0d4eb15e8939 None admin] Validating token access rules against request {{(pid=416294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:06:03.661860 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be01b8fc-b9c8-4f17-a7da-c6e68d9e065d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:06:03.663045 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be01b8fc-b9c8-4f17-a7da-c6e68d9e065d None admin] REQUEST_METHOD: `GET` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:06:03.663473 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be01b8fc-b9c8-4f17-a7da-c6e68d9e065d None admin] SCRIPT_NAME: `/identity` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:06:03.663751 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be01b8fc-b9c8-4f17-a7da-c6e68d9e065d None admin] PATH_INFO: `/v3/groups/cd980c6f6d8c4ac99e1a021d719db0c2` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:06:03.671741 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be01b8fc-b9c8-4f17-a7da-c6e68d9e065d None admin] RBAC: Authorizing `identity:get_group(group_id=cd980c6f6d8c4ac99e1a021d719db0c2)` {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:06:03.673270 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be01b8fc-b9c8-4f17-a7da-c6e68d9e065d None admin] RBAC: Authorization granted {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:06:03.676502 dv-cinder-851351-1-smb devstack@keystone.service[416294]: [pid: 416294|app: 0|req: 197/382] 10.222.0.42 () {56 vars in 1180 bytes} [Thu Jul 28 09:06:03 2022] GET /identity/v3/groups/cd980c6f6d8c4ac99e1a021d719db0c2 => generated 229 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:06:03.684919 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be01b8fc-b9c8-4f17-a7da-c6e68d9e065d None admin] Authenticating user token {{(pid=416294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:06:03.724191 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG dbcounter [-] [416294] Writing DB stats keystone:SELECT=100 {{(pid=416294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:06:03.813809 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be01b8fc-b9c8-4f17-a7da-c6e68d9e065d None admin] Validating token access rules against request {{(pid=416294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:06:03.832984 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cadcd903-8770-41a0-a95f-c595b6616346 None admin] Validating token access rules against request {{(pid=416293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:06:03.838860 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG dbcounter [-] [416293] Writing DB stats keystone:SELECT=100 {{(pid=416293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:06:03.856556 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7100ee78-620f-4a58-b8d3-14b6ea7ae23d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:06:03.857627 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7100ee78-620f-4a58-b8d3-14b6ea7ae23d None admin] REQUEST_METHOD: `GET` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:06:03.858103 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7100ee78-620f-4a58-b8d3-14b6ea7ae23d None admin] SCRIPT_NAME: `/identity` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:06:03.858390 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7100ee78-620f-4a58-b8d3-14b6ea7ae23d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:06:03.859207 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7100ee78-620f-4a58-b8d3-14b6ea7ae23d None admin] RBAC: Adding query filter params (group.id=cd980c6f6d8c4ac99e1a021d719db0c2, role.id=c67085ec338243df8f9b7d6459036e23, scope.project.id=0b5d78d12a0c4dfdbf387a60d6572e81) {{(pid=416294) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 09:06:03.859524 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7100ee78-620f-4a58-b8d3-14b6ea7ae23d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:06:03.861154 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7100ee78-620f-4a58-b8d3-14b6ea7ae23d None admin] RBAC: Authorization granted {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:06:03.868727 dv-cinder-851351-1-smb devstack@keystone.service[416294]: [pid: 416294|app: 0|req: 198/383] 10.222.0.42 () {56 vars in 1376 bytes} [Thu Jul 28 09:06:03 2022] GET /identity/v3/role_assignments?group.id=cd980c6f6d8c4ac99e1a021d719db0c2&scope.project.id=0b5d78d12a0c4dfdbf387a60d6572e81&role.id=c67085ec338243df8f9b7d6459036e23 => generated 260 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:06:03.915540 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb2b1f6-0d8f-46b6-800b-7779fb4729a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:06:03.916201 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb2b1f6-0d8f-46b6-800b-7779fb4729a2 None admin] REQUEST_METHOD: `GET` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:06:03.916489 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb2b1f6-0d8f-46b6-800b-7779fb4729a2 None admin] SCRIPT_NAME: `/identity` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:06:03.916875 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb2b1f6-0d8f-46b6-800b-7779fb4729a2 None admin] PATH_INFO: `/v3/roles` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:06:03.917640 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb2b1f6-0d8f-46b6-800b-7779fb4729a2 None admin] RBAC: Adding query filter params (name=member) {{(pid=416293) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 09:06:03.917955 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb2b1f6-0d8f-46b6-800b-7779fb4729a2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:06:03.919388 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb2b1f6-0d8f-46b6-800b-7779fb4729a2 None admin] RBAC: Authorization granted {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:06:03.934981 dv-cinder-851351-1-smb devstack@keystone.service[416293]: [pid: 416293|app: 0|req: 186/384] 10.222.0.42 () {56 vars in 1101 bytes} [Thu Jul 28 09:06:03 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 319 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:06:03.941233 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7100ee78-620f-4a58-b8d3-14b6ea7ae23d None admin] Authenticating user token {{(pid=416294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:06:04.078387 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7100ee78-620f-4a58-b8d3-14b6ea7ae23d None admin] Validating token access rules against request {{(pid=416294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:06:04.081316 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG dbcounter [-] [416294] Writing DB stats keystone:SELECT=100 {{(pid=416294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:06:04.118410 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44eaaaa-977e-434a-bfb9-45f99fe48fde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:06:04.119088 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44eaaaa-977e-434a-bfb9-45f99fe48fde None admin] REQUEST_METHOD: `GET` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:06:04.119376 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44eaaaa-977e-434a-bfb9-45f99fe48fde None admin] SCRIPT_NAME: `/identity` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:06:04.119658 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44eaaaa-977e-434a-bfb9-45f99fe48fde None admin] PATH_INFO: `/v3/groups/7f607738424745bf955f57e2c8966ff8` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:06:04.120894 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b44eaaaa-977e-434a-bfb9-45f99fe48fde None admin] RBAC: Authorizing `identity:get_group(group_id=7f607738424745bf955f57e2c8966ff8)` {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:06:04.122369 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b44eaaaa-977e-434a-bfb9-45f99fe48fde None admin] RBAC: Authorization granted {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:06:04.124394 dv-cinder-851351-1-smb devstack@keystone.service[416294]: [pid: 416294|app: 0|req: 199/385] 10.222.0.42 () {56 vars in 1180 bytes} [Thu Jul 28 09:06:03 2022] GET /identity/v3/groups/7f607738424745bf955f57e2c8966ff8 => generated 226 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:06:04.130213 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb2b1f6-0d8f-46b6-800b-7779fb4729a2 None admin] Authenticating user token {{(pid=416293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:06:04.277365 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb2b1f6-0d8f-46b6-800b-7779fb4729a2 None admin] Validating token access rules against request {{(pid=416293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:06:04.284645 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47fe72a1-9747-4322-b591-729c82d656f9 None None] REQUEST_METHOD: `GET` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:06:04.285110 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47fe72a1-9747-4322-b591-729c82d656f9 None None] SCRIPT_NAME: `/identity` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:06:04.285497 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47fe72a1-9747-4322-b591-729c82d656f9 None None] PATH_INFO: `/` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:06:04.287011 dv-cinder-851351-1-smb devstack@keystone.service[416294]: [pid: 416294|app: 0|req: 200/386] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 09:06:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 28 09:06:04.293526 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5dffa26-557c-42fa-9ba2-180bf2e40c57 None None] REQUEST_METHOD: `POST` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:06:04.293985 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5dffa26-557c-42fa-9ba2-180bf2e40c57 None None] SCRIPT_NAME: `/identity` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:06:04.294561 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5dffa26-557c-42fa-9ba2-180bf2e40c57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:06:04.324852 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9c0359-c8a2-461f-9622-4a3772245b03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:06:04.325727 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.auth.core [None req-b5dffa26-557c-42fa-9ba2-180bf2e40c57 None None] MFA Rules not processed for user `dbf87abab90e4fdf9e75408f4199918e`. Rule list: `[]` (Enabled: `True`). {{(pid=416294) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 09:06:04.326183 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9c0359-c8a2-461f-9622-4a3772245b03 None admin] REQUEST_METHOD: `GET` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:06:04.326621 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9c0359-c8a2-461f-9622-4a3772245b03 None admin] SCRIPT_NAME: `/identity` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:06:04.327064 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9c0359-c8a2-461f-9622-4a3772245b03 None admin] PATH_INFO: `/v3/projects/c515ec4395fe420e9ab0ba34fb1ada8f` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:06:04.327348 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.fernet_utils [None req-b5dffa26-557c-42fa-9ba2-180bf2e40c57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=416294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 09:06:04.328779 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f9c0359-c8a2-461f-9622-4a3772245b03 None admin] RBAC: Authorizing `identity:get_project(project_id=c515ec4395fe420e9ab0ba34fb1ada8f)` {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:06:04.330489 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f9c0359-c8a2-461f-9622-4a3772245b03 None admin] RBAC: Authorization granted {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:06:04.332750 dv-cinder-851351-1-smb devstack@keystone.service[416293]: [pid: 416293|app: 0|req: 187/387] 10.222.0.42 () {56 vars in 1186 bytes} [Thu Jul 28 09:06:04 2022] GET /identity/v3/projects/c515ec4395fe420e9ab0ba34fb1ada8f => generated 298 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:06:04.338697 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9c0359-c8a2-461f-9622-4a3772245b03 None admin] Authenticating user token {{(pid=416293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:06:04.379420 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG dbcounter [-] [416293] Writing DB stats keystone:SELECT=100 {{(pid=416293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:06:04.453593 dv-cinder-851351-1-smb devstack@keystone.service[416294]: [pid: 416294|app: 0|req: 201/388] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 09:06:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 09:06:04.461823 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9c0359-c8a2-461f-9622-4a3772245b03 None admin] Validating token access rules against request {{(pid=416293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:06:04.495001 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5dffa26-557c-42fa-9ba2-180bf2e40c57 None None] Authenticating user token {{(pid=416294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:06:04.498545 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d263c78d-665a-42f7-b545-e35085dc0ef2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:06:04.499419 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d263c78d-665a-42f7-b545-e35085dc0ef2 None admin] REQUEST_METHOD: `PUT` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:06:04.499888 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d263c78d-665a-42f7-b545-e35085dc0ef2 None admin] SCRIPT_NAME: `/identity` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:06:04.500333 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d263c78d-665a-42f7-b545-e35085dc0ef2 None admin] PATH_INFO: `/v3/projects/c515ec4395fe420e9ab0ba34fb1ada8f/groups/7f607738424745bf955f57e2c8966ff8/roles/ba1a79dc27074d5a94dce2d994019d37` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:06:04.502729 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d263c78d-665a-42f7-b545-e35085dc0ef2 None admin] RBAC: Authorizing `identity:create_grant(project_id=c515ec4395fe420e9ab0ba34fb1ada8f, group_id=7f607738424745bf955f57e2c8966ff8, role_id=ba1a79dc27074d5a94dce2d994019d37)` {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:06:04.504360 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d263c78d-665a-42f7-b545-e35085dc0ef2 None admin] RBAC: Authorization granted {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:06:04.524562 dv-cinder-851351-1-smb devstack@keystone.service[416293]: [pid: 416293|app: 0|req: 188/389] 10.222.0.42 () {58 vars in 1442 bytes} [Thu Jul 28 09:06:04 2022] PUT /identity/v3/projects/c515ec4395fe420e9ab0ba34fb1ada8f/groups/7f607738424745bf955f57e2c8966ff8/roles/ba1a79dc27074d5a94dce2d994019d37 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 28 09:06:04.629668 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG dbcounter [-] [416294] Writing DB stats keystone:SELECT=100 {{(pid=416294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:06:04.639988 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5dffa26-557c-42fa-9ba2-180bf2e40c57 None None] Validating token access rules against request {{(pid=416294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:06:04.691081 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88879e15-0756-4487-99ef-c3227786511b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:06:04.691756 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88879e15-0756-4487-99ef-c3227786511b None admin] REQUEST_METHOD: `GET` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:06:04.692047 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88879e15-0756-4487-99ef-c3227786511b None admin] SCRIPT_NAME: `/identity` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:06:04.692436 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88879e15-0756-4487-99ef-c3227786511b None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:06:04.713099 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88879e15-0756-4487-99ef-c3227786511b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 09:06:04.720493 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application [None req-88879e15-0756-4487-99ef-c3227786511b None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 28 09:06:04.720493 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 09:06:04.720493 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 09:06:04.720493 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 09:06:04.720493 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 09:06:04.720493 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 09:06:04.720493 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 09:06:04.720493 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 09:06:04.720493 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 09:06:04.720493 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 09:06:04.720493 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 09:06:04.720493 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 09:06:04.720493 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 09:06:04.720493 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 09:06:04.720493 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 09:06:04.720493 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 09:06:04.722942 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 09:06:04.722942 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 09:06:04.722942 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 09:06:04.722942 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 09:06:04.722942 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 09:06:04.722942 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 09:06:04.722942 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 09:06:04.722942 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 09:06:04.722942 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 09:06:04.722942 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 09:06:04.722942 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 09:06:04.722942 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application with Lock( Jul 28 09:06:04.722942 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 09:06:04.722942 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return self._enter() Jul 28 09:06:04.722942 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 09:06:04.722942 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 09:06:04.723791 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 09:06:04.723791 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return self.creator() Jul 28 09:06:04.723791 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 09:06:04.723791 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application created_value = creator( Jul 28 09:06:04.723791 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 09:06:04.723791 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 09:06:04.723791 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 09:06:04.723791 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 09:06:04.723791 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 09:06:04.723791 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 09:06:04.723791 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 28 09:06:04.723791 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application Jul 28 09:06:04.723791 dv-cinder-851351-1-smb devstack@keystone.service[416294]: [pid: 416294|app: 0|req: 202/390] 10.222.0.42 () {56 vars in 1114 bytes} [Thu Jul 28 09:06:04 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 09:06:04.728602 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d263c78d-665a-42f7-b545-e35085dc0ef2 None admin] Authenticating user token {{(pid=416293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:06:04.859004 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG dbcounter [-] [416293] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=416293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:06:04.869810 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d263c78d-665a-42f7-b545-e35085dc0ef2 None admin] Validating token access rules against request {{(pid=416293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:06:04.923352 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8fd7ca-66e3-4680-80bd-f3bf8224b2dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:06:04.923951 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8fd7ca-66e3-4680-80bd-f3bf8224b2dc None admin] REQUEST_METHOD: `GET` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:06:04.924333 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8fd7ca-66e3-4680-80bd-f3bf8224b2dc None admin] SCRIPT_NAME: `/identity` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:06:04.924612 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8fd7ca-66e3-4680-80bd-f3bf8224b2dc None admin] PATH_INFO: `/v3/roles` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:06:04.925404 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a8fd7ca-66e3-4680-80bd-f3bf8224b2dc None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=416293) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 09:06:04.925716 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a8fd7ca-66e3-4680-80bd-f3bf8224b2dc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:06:04.927148 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a8fd7ca-66e3-4680-80bd-f3bf8224b2dc None admin] RBAC: Authorization granted {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:06:04.937402 dv-cinder-851351-1-smb devstack@keystone.service[416293]: [pid: 416293|app: 0|req: 189/391] 10.222.0.42 () {56 vars in 1111 bytes} [Thu Jul 28 09:06:04 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:06:04.942948 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88879e15-0756-4487-99ef-c3227786511b None admin] Authenticating user token {{(pid=416294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:06:05.075553 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88879e15-0756-4487-99ef-c3227786511b None admin] Validating token access rules against request {{(pid=416294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:06:05.111747 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac153632-c527-4fa8-9245-26178712b3f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:06:05.112416 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac153632-c527-4fa8-9245-26178712b3f8 None admin] REQUEST_METHOD: `GET` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:06:05.112728 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac153632-c527-4fa8-9245-26178712b3f8 None admin] SCRIPT_NAME: `/identity` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:06:05.113012 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac153632-c527-4fa8-9245-26178712b3f8 None admin] PATH_INFO: `/v3/groups/7f607738424745bf955f57e2c8966ff8` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:06:05.114212 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac153632-c527-4fa8-9245-26178712b3f8 None admin] RBAC: Authorizing `identity:get_group(group_id=7f607738424745bf955f57e2c8966ff8)` {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:06:05.115674 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac153632-c527-4fa8-9245-26178712b3f8 None admin] RBAC: Authorization granted {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:06:05.117651 dv-cinder-851351-1-smb devstack@keystone.service[416294]: [pid: 416294|app: 0|req: 203/392] 10.222.0.42 () {56 vars in 1180 bytes} [Thu Jul 28 09:06:04 2022] GET /identity/v3/groups/7f607738424745bf955f57e2c8966ff8 => generated 226 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:06:05.123073 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8fd7ca-66e3-4680-80bd-f3bf8224b2dc None admin] Authenticating user token {{(pid=416293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:06:05.239897 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8fd7ca-66e3-4680-80bd-f3bf8224b2dc None admin] Validating token access rules against request {{(pid=416293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:06:05.277022 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9200bb4-203a-48b8-8ef2-2ae6ec0fbab3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:06:05.277690 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9200bb4-203a-48b8-8ef2-2ae6ec0fbab3 None admin] REQUEST_METHOD: `GET` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:06:05.277978 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9200bb4-203a-48b8-8ef2-2ae6ec0fbab3 None admin] SCRIPT_NAME: `/identity` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:06:05.278261 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9200bb4-203a-48b8-8ef2-2ae6ec0fbab3 None admin] PATH_INFO: `/v3/projects/c515ec4395fe420e9ab0ba34fb1ada8f` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:06:05.279461 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9200bb4-203a-48b8-8ef2-2ae6ec0fbab3 None admin] RBAC: Authorizing `identity:get_project(project_id=c515ec4395fe420e9ab0ba34fb1ada8f)` {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:06:05.280990 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9200bb4-203a-48b8-8ef2-2ae6ec0fbab3 None admin] RBAC: Authorization granted {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:06:05.283317 dv-cinder-851351-1-smb devstack@keystone.service[416293]: [pid: 416293|app: 0|req: 190/393] 10.222.0.42 () {56 vars in 1186 bytes} [Thu Jul 28 09:06:05 2022] GET /identity/v3/projects/c515ec4395fe420e9ab0ba34fb1ada8f => generated 298 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 09:06:05.289109 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac153632-c527-4fa8-9245-26178712b3f8 None admin] Authenticating user token {{(pid=416294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:06:05.316092 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG dbcounter [-] [416294] Writing DB stats keystone:SELECT=100 {{(pid=416294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:06:05.406047 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac153632-c527-4fa8-9245-26178712b3f8 None admin] Validating token access rules against request {{(pid=416294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:06:05.443234 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d42944-dd1a-4abc-8f00-5258146c12f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:06:05.443931 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d42944-dd1a-4abc-8f00-5258146c12f4 None admin] REQUEST_METHOD: `PUT` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:06:05.444219 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d42944-dd1a-4abc-8f00-5258146c12f4 None admin] SCRIPT_NAME: `/identity` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:06:05.444501 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d42944-dd1a-4abc-8f00-5258146c12f4 None admin] PATH_INFO: `/v3/projects/c515ec4395fe420e9ab0ba34fb1ada8f/groups/7f607738424745bf955f57e2c8966ff8/roles/6194848862704a289bbaa3fda43a9050` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:06:05.446859 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5d42944-dd1a-4abc-8f00-5258146c12f4 None admin] RBAC: Authorizing `identity:create_grant(project_id=c515ec4395fe420e9ab0ba34fb1ada8f, group_id=7f607738424745bf955f57e2c8966ff8, role_id=6194848862704a289bbaa3fda43a9050)` {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:06:05.448393 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5d42944-dd1a-4abc-8f00-5258146c12f4 None admin] RBAC: Authorization granted {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:06:05.464033 dv-cinder-851351-1-smb devstack@keystone.service[416294]: [pid: 416294|app: 0|req: 204/394] 10.222.0.42 () {58 vars in 1442 bytes} [Thu Jul 28 09:06:05 2022] PUT /identity/v3/projects/c515ec4395fe420e9ab0ba34fb1ada8f/groups/7f607738424745bf955f57e2c8966ff8/roles/6194848862704a289bbaa3fda43a9050 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 09:06:05.883735 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5c3b26-d256-475e-9599-2428e9cf8362 None None] REQUEST_METHOD: `GET` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:06:05.884295 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5c3b26-d256-475e-9599-2428e9cf8362 None None] SCRIPT_NAME: `/identity` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:06:05.884295 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5c3b26-d256-475e-9599-2428e9cf8362 None None] PATH_INFO: `/` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:06:05.886546 dv-cinder-851351-1-smb devstack@keystone.service[416293]: [pid: 416293|app: 0|req: 191/395] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 09:06:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 09:06:05.894547 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b15ac7-7953-4b54-b85e-06e347af6ad4 None None] REQUEST_METHOD: `POST` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:06:05.895073 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b15ac7-7953-4b54-b85e-06e347af6ad4 None None] SCRIPT_NAME: `/identity` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:06:05.895578 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b15ac7-7953-4b54-b85e-06e347af6ad4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:06:05.919229 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.auth.core [None req-26b15ac7-7953-4b54-b85e-06e347af6ad4 None None] MFA Rules not processed for user `dbf87abab90e4fdf9e75408f4199918e`. Rule list: `[]` (Enabled: `True`). {{(pid=416294) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 09:06:05.920446 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.fernet_utils [None req-26b15ac7-7953-4b54-b85e-06e347af6ad4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=416294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 09:06:06.032638 dv-cinder-851351-1-smb devstack@keystone.service[416294]: [pid: 416294|app: 0|req: 205/396] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 09:06:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 09:06:06.068637 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f5c3b26-d256-475e-9599-2428e9cf8362 None None] Authenticating user token {{(pid=416293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:06:06.082500 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83bfa2a0-c945-4bef-b14c-66b892b4d27b None None] REQUEST_METHOD: `GET` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:06:06.082841 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83bfa2a0-c945-4bef-b14c-66b892b4d27b None None] SCRIPT_NAME: `/identity` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:06:06.083044 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83bfa2a0-c945-4bef-b14c-66b892b4d27b None None] PATH_INFO: `/` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:06:06.084727 dv-cinder-851351-1-smb devstack@keystone.service[416294]: [pid: 416294|app: 0|req: 206/397] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 09:06:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 09:06:06.094363 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fcbba05-cc3c-45c0-9ba8-893db06c71dd None None] REQUEST_METHOD: `POST` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:06:06.094659 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fcbba05-cc3c-45c0-9ba8-893db06c71dd None None] SCRIPT_NAME: `/identity` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:06:06.094920 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fcbba05-cc3c-45c0-9ba8-893db06c71dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:06:06.125316 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG dbcounter [-] [416293] Writing DB stats keystone:SELECT=100 {{(pid=416293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:06:06.134070 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.auth.core [None req-3fcbba05-cc3c-45c0-9ba8-893db06c71dd None None] MFA Rules not processed for user `dbf87abab90e4fdf9e75408f4199918e`. Rule list: `[]` (Enabled: `True`). {{(pid=416294) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 09:06:06.135223 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.fernet_utils [None req-3fcbba05-cc3c-45c0-9ba8-893db06c71dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=416294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 09:06:06.159308 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG dbcounter [-] [416294] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=416294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:06:06.269436 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f5c3b26-d256-475e-9599-2428e9cf8362 None None] Validating token access rules against request {{(pid=416293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:06:06.293928 dv-cinder-851351-1-smb devstack@keystone.service[416294]: [pid: 416294|app: 0|req: 207/398] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 09:06:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 28 09:06:06.315754 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f92dac8f-14b4-4c8b-9d08-b06a74278405 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:06:06.316409 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92dac8f-14b4-4c8b-9d08-b06a74278405 None admin] REQUEST_METHOD: `GET` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:06:06.316743 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92dac8f-14b4-4c8b-9d08-b06a74278405 None admin] SCRIPT_NAME: `/identity` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:06:06.317027 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92dac8f-14b4-4c8b-9d08-b06a74278405 None admin] PATH_INFO: `/v3/roles/member` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:06:06.328638 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f92dac8f-14b4-4c8b-9d08-b06a74278405 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 09:06:06.331398 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fcbba05-cc3c-45c0-9ba8-893db06c71dd None None] Authenticating user token {{(pid=416294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:06:06.348187 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application [None req-f92dac8f-14b4-4c8b-9d08-b06a74278405 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 28 09:06:06.348187 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 09:06:06.348187 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 09:06:06.348187 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 09:06:06.348187 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 09:06:06.348187 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 09:06:06.348187 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 09:06:06.348187 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 09:06:06.348187 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 09:06:06.348187 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 09:06:06.348187 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 09:06:06.348187 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 09:06:06.348187 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 09:06:06.348187 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 09:06:06.348187 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 09:06:06.348187 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 09:06:06.349257 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 09:06:06.349257 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 09:06:06.349257 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 09:06:06.349257 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 09:06:06.349257 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 09:06:06.349257 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 09:06:06.349257 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 09:06:06.349257 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 09:06:06.349257 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 09:06:06.349257 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 09:06:06.349257 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 09:06:06.349257 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application with Lock( Jul 28 09:06:06.349257 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 09:06:06.349257 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self._enter() Jul 28 09:06:06.349257 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 09:06:06.349257 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 09:06:06.350126 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 09:06:06.350126 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self.creator() Jul 28 09:06:06.350126 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 09:06:06.350126 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application created_value = creator( Jul 28 09:06:06.350126 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 09:06:06.350126 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 09:06:06.350126 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 09:06:06.350126 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 09:06:06.350126 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 09:06:06.350126 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 09:06:06.350126 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 28 09:06:06.350126 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application Jul 28 09:06:06.353586 dv-cinder-851351-1-smb devstack@keystone.service[416293]: [pid: 416293|app: 0|req: 192/399] 10.222.0.42 () {56 vars in 1099 bytes} [Thu Jul 28 09:06:06 2022] GET /identity/v3/roles/member => generated 84 bytes in 286 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 09:06:06.359643 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f92dac8f-14b4-4c8b-9d08-b06a74278405 None admin] Authenticating user token {{(pid=416293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:06:06.496009 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG dbcounter [-] [416293] Writing DB stats keystone:SELECT=100 {{(pid=416293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:06:06.500855 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fcbba05-cc3c-45c0-9ba8-893db06c71dd None None] Validating token access rules against request {{(pid=416294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:06:06.515869 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f92dac8f-14b4-4c8b-9d08-b06a74278405 None admin] Validating token access rules against request {{(pid=416293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:06:06.541656 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef09a03-c3a7-4481-a4de-23c2928b736f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:06:06.542364 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef09a03-c3a7-4481-a4de-23c2928b736f None admin] REQUEST_METHOD: `GET` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:06:06.542650 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef09a03-c3a7-4481-a4de-23c2928b736f None admin] SCRIPT_NAME: `/identity` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:06:06.542982 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef09a03-c3a7-4481-a4de-23c2928b736f None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:06:06.555358 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ef09a03-c3a7-4481-a4de-23c2928b736f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 09:06:06.557158 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a59947a-6dd4-4f29-9586-0cfbe5458bc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:06:06.557930 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a59947a-6dd4-4f29-9586-0cfbe5458bc6 None admin] REQUEST_METHOD: `GET` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:06:06.558320 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a59947a-6dd4-4f29-9586-0cfbe5458bc6 None admin] SCRIPT_NAME: `/identity` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:06:06.558721 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a59947a-6dd4-4f29-9586-0cfbe5458bc6 None admin] PATH_INFO: `/v3/roles` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:06:06.559573 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a59947a-6dd4-4f29-9586-0cfbe5458bc6 None admin] RBAC: Adding query filter params (name=member) {{(pid=416293) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 09:06:06.559990 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a59947a-6dd4-4f29-9586-0cfbe5458bc6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:06:06.561554 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a59947a-6dd4-4f29-9586-0cfbe5458bc6 None admin] RBAC: Authorization granted {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:06:06.561854 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application [None req-8ef09a03-c3a7-4481-a4de-23c2928b736f None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 28 09:06:06.561854 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 09:06:06.561854 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 09:06:06.561854 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 09:06:06.561854 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 09:06:06.561854 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 09:06:06.561854 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 09:06:06.561854 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 09:06:06.561854 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 09:06:06.561854 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 09:06:06.561854 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 09:06:06.561854 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 09:06:06.561854 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 09:06:06.561854 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 09:06:06.561854 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 09:06:06.561854 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 09:06:06.562940 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 09:06:06.562940 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 09:06:06.562940 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 09:06:06.562940 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 09:06:06.562940 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 09:06:06.562940 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 09:06:06.562940 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 09:06:06.562940 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 09:06:06.562940 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 09:06:06.562940 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 09:06:06.562940 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 09:06:06.562940 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application with Lock( Jul 28 09:06:06.562940 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 09:06:06.562940 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return self._enter() Jul 28 09:06:06.562940 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 09:06:06.562940 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 09:06:06.563819 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 09:06:06.563819 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return self.creator() Jul 28 09:06:06.563819 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 09:06:06.563819 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application created_value = creator( Jul 28 09:06:06.563819 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 09:06:06.563819 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 09:06:06.563819 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 09:06:06.563819 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 09:06:06.563819 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 09:06:06.563819 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 09:06:06.563819 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 28 09:06:06.563819 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application Jul 28 09:06:06.563819 dv-cinder-851351-1-smb devstack@keystone.service[416294]: [pid: 416294|app: 0|req: 208/400] 10.222.0.42 () {56 vars in 1114 bytes} [Thu Jul 28 09:06:06 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 09:06:06.564900 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7844a30-1771-43f1-884c-165f3927323a None None] REQUEST_METHOD: `GET` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:06:06.568708 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7844a30-1771-43f1-884c-165f3927323a None None] SCRIPT_NAME: `/identity` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:06:06.568708 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7844a30-1771-43f1-884c-165f3927323a None None] PATH_INFO: `/` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:06:06.568708 dv-cinder-851351-1-smb devstack@keystone.service[416294]: [pid: 416294|app: 0|req: 209/401] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 09:06:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 09:06:06.572458 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7844a30-1771-43f1-884c-165f3927323a None None] Authenticating user token {{(pid=416294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:06:06.574714 dv-cinder-851351-1-smb devstack@keystone.service[416293]: [pid: 416293|app: 0|req: 193/402] 10.222.0.42 () {56 vars in 1101 bytes} [Thu Jul 28 09:06:06 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 09:06:06.576158 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467c0f6c-95b7-4bf3-abd1-441129410beb None None] REQUEST_METHOD: `POST` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:06:06.576530 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467c0f6c-95b7-4bf3-abd1-441129410beb None None] SCRIPT_NAME: `/identity` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:06:06.576849 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467c0f6c-95b7-4bf3-abd1-441129410beb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:06:06.577118 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG dbcounter [-] [416294] Writing DB stats keystone:SELECT=100 {{(pid=416294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:06:06.598161 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.auth.core [None req-467c0f6c-95b7-4bf3-abd1-441129410beb None None] MFA Rules not processed for user `dbf87abab90e4fdf9e75408f4199918e`. Rule list: `[]` (Enabled: `True`). {{(pid=416293) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 09:06:06.599420 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.fernet_utils [None req-467c0f6c-95b7-4bf3-abd1-441129410beb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=416293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 09:06:06.678257 dv-cinder-851351-1-smb devstack@keystone.service[416293]: [pid: 416293|app: 0|req: 194/403] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 09:06:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 09:06:06.679200 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-467c0f6c-95b7-4bf3-abd1-441129410beb None None] Authenticating user token {{(pid=416293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:06:06.696312 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7844a30-1771-43f1-884c-165f3927323a None None] Validating token access rules against request {{(pid=416294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:06:06.738275 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c9e7e38-fd20-468b-a65d-e872d3c834ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:06:06.738923 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9e7e38-fd20-468b-a65d-e872d3c834ff None admin] REQUEST_METHOD: `GET` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:06:06.739208 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9e7e38-fd20-468b-a65d-e872d3c834ff None admin] SCRIPT_NAME: `/identity` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:06:06.739486 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9e7e38-fd20-468b-a65d-e872d3c834ff None admin] PATH_INFO: `/v3/roles` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:06:06.740293 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c9e7e38-fd20-468b-a65d-e872d3c834ff None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=416294) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 09:06:06.740604 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c9e7e38-fd20-468b-a65d-e872d3c834ff None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:06:06.742231 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c9e7e38-fd20-468b-a65d-e872d3c834ff None admin] RBAC: Authorization granted {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:06:06.754257 dv-cinder-851351-1-smb devstack@keystone.service[416294]: [pid: 416294|app: 0|req: 210/404] 10.222.0.42 () {56 vars in 1111 bytes} [Thu Jul 28 09:06:06 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:06:06.755076 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c9e7e38-fd20-468b-a65d-e872d3c834ff None admin] Authenticating user token {{(pid=416294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:06:06.770469 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG dbcounter [-] [416293] Writing DB stats keystone:SELECT=100 {{(pid=416293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:06:06.798356 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-467c0f6c-95b7-4bf3-abd1-441129410beb None None] Validating token access rules against request {{(pid=416293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:06:06.838461 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a1cf418-0dc5-434b-93ab-7e7e28c4b91e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:06:06.839447 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1cf418-0dc5-434b-93ab-7e7e28c4b91e None admin] REQUEST_METHOD: `GET` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:06:06.839892 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1cf418-0dc5-434b-93ab-7e7e28c4b91e None admin] SCRIPT_NAME: `/identity` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:06:06.840327 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1cf418-0dc5-434b-93ab-7e7e28c4b91e None admin] PATH_INFO: `/v3/groups/7f607738424745bf955f57e2c8966ff8` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:06:06.840455 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG dbcounter [-] [416294] Writing DB stats keystone:SELECT=100 {{(pid=416294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:06:06.842146 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a1cf418-0dc5-434b-93ab-7e7e28c4b91e None admin] RBAC: Authorizing `identity:get_group(group_id=7f607738424745bf955f57e2c8966ff8)` {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:06:06.843992 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a1cf418-0dc5-434b-93ab-7e7e28c4b91e None admin] RBAC: Authorization granted {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:06:06.846703 dv-cinder-851351-1-smb devstack@keystone.service[416293]: [pid: 416293|app: 0|req: 195/405] 10.222.0.42 () {56 vars in 1180 bytes} [Thu Jul 28 09:06:06 2022] GET /identity/v3/groups/7f607738424745bf955f57e2c8966ff8 => generated 226 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:06:06.847714 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a1cf418-0dc5-434b-93ab-7e7e28c4b91e None admin] Authenticating user token {{(pid=416293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:06:06.870166 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c9e7e38-fd20-468b-a65d-e872d3c834ff None admin] Validating token access rules against request {{(pid=416294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:06:06.910172 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8ea1da-9ea6-4282-b176-d905e1c5c89a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:06:06.910851 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8ea1da-9ea6-4282-b176-d905e1c5c89a None admin] REQUEST_METHOD: `GET` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:06:06.911136 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8ea1da-9ea6-4282-b176-d905e1c5c89a None admin] SCRIPT_NAME: `/identity` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:06:06.911416 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8ea1da-9ea6-4282-b176-d905e1c5c89a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:06:06.922925 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e8ea1da-9ea6-4282-b176-d905e1c5c89a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 09:06:06.929360 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application [None req-4e8ea1da-9ea6-4282-b176-d905e1c5c89a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 09:06:06.929360 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 09:06:06.929360 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 09:06:06.929360 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 09:06:06.929360 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 09:06:06.929360 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 09:06:06.929360 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 09:06:06.929360 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 09:06:06.929360 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 09:06:06.929360 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 09:06:06.929360 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 09:06:06.929360 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 09:06:06.929360 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 09:06:06.929360 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 09:06:06.929360 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 09:06:06.929360 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 09:06:06.930385 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 09:06:06.930385 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 09:06:06.930385 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 09:06:06.930385 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 09:06:06.930385 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 09:06:06.930385 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 09:06:06.930385 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 09:06:06.930385 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 09:06:06.930385 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 09:06:06.930385 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 09:06:06.930385 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 09:06:06.930385 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application with Lock( Jul 28 09:06:06.930385 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 09:06:06.930385 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return self._enter() Jul 28 09:06:06.930385 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 09:06:06.930385 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 09:06:06.931310 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 09:06:06.931310 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return self.creator() Jul 28 09:06:06.931310 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 09:06:06.931310 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application created_value = creator( Jul 28 09:06:06.931310 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 09:06:06.931310 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 09:06:06.931310 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 09:06:06.931310 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 09:06:06.931310 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 09:06:06.931310 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 09:06:06.931310 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 09:06:06.931310 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application Jul 28 09:06:06.931310 dv-cinder-851351-1-smb devstack@keystone.service[416294]: [pid: 416294|app: 0|req: 211/406] 10.222.0.42 () {56 vars in 1096 bytes} [Thu Jul 28 09:06:06 2022] GET /identity/v3/roles/admin => generated 83 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 09:06:06.932044 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8ea1da-9ea6-4282-b176-d905e1c5c89a None admin] Authenticating user token {{(pid=416294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:06:06.965497 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a1cf418-0dc5-434b-93ab-7e7e28c4b91e None admin] Validating token access rules against request {{(pid=416293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:06:07.008700 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2491ecb8-4cbe-4516-9d51-f8a4a3e87d22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:06:07.009654 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2491ecb8-4cbe-4516-9d51-f8a4a3e87d22 None admin] REQUEST_METHOD: `GET` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:06:07.010117 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2491ecb8-4cbe-4516-9d51-f8a4a3e87d22 None admin] SCRIPT_NAME: `/identity` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:06:07.010549 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2491ecb8-4cbe-4516-9d51-f8a4a3e87d22 None admin] PATH_INFO: `/v3/groups/7f607738424745bf955f57e2c8966ff8` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:06:07.011928 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2491ecb8-4cbe-4516-9d51-f8a4a3e87d22 None admin] RBAC: Authorizing `identity:get_group(group_id=7f607738424745bf955f57e2c8966ff8)` {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:06:07.013664 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2491ecb8-4cbe-4516-9d51-f8a4a3e87d22 None admin] RBAC: Authorization granted {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:06:07.015802 dv-cinder-851351-1-smb devstack@keystone.service[416293]: [pid: 416293|app: 0|req: 196/407] 10.222.0.42 () {56 vars in 1180 bytes} [Thu Jul 28 09:06:06 2022] GET /identity/v3/groups/7f607738424745bf955f57e2c8966ff8 => generated 226 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:06:07.016791 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2491ecb8-4cbe-4516-9d51-f8a4a3e87d22 None admin] Authenticating user token {{(pid=416293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:06:07.033551 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG dbcounter [-] [416293] Writing DB stats keystone:SELECT=100 {{(pid=416293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:06:07.060039 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8ea1da-9ea6-4282-b176-d905e1c5c89a None admin] Validating token access rules against request {{(pid=416294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:06:07.089150 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG dbcounter [-] [416294] Writing DB stats keystone:SELECT=100 {{(pid=416294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:06:07.098052 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95dbe4de-3181-4130-be83-2c504c3b1aa2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:06:07.098871 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95dbe4de-3181-4130-be83-2c504c3b1aa2 None admin] REQUEST_METHOD: `GET` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:06:07.099315 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95dbe4de-3181-4130-be83-2c504c3b1aa2 None admin] SCRIPT_NAME: `/identity` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:06:07.099728 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95dbe4de-3181-4130-be83-2c504c3b1aa2 None admin] PATH_INFO: `/v3/projects/5c46e2ed162f45cabaf6f30752f915a4` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:06:07.101267 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95dbe4de-3181-4130-be83-2c504c3b1aa2 None admin] RBAC: Authorizing `identity:get_project(project_id=5c46e2ed162f45cabaf6f30752f915a4)` {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:06:07.102923 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95dbe4de-3181-4130-be83-2c504c3b1aa2 None admin] RBAC: Authorization granted {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:06:07.105158 dv-cinder-851351-1-smb devstack@keystone.service[416294]: [pid: 416294|app: 0|req: 212/408] 10.222.0.42 () {56 vars in 1186 bytes} [Thu Jul 28 09:06:06 2022] GET /identity/v3/projects/5c46e2ed162f45cabaf6f30752f915a4 => generated 302 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:06:07.106136 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95dbe4de-3181-4130-be83-2c504c3b1aa2 None admin] Authenticating user token {{(pid=416294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:06:07.136462 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2491ecb8-4cbe-4516-9d51-f8a4a3e87d22 None admin] Validating token access rules against request {{(pid=416293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:06:07.179211 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0fcdb5-e2af-45f3-bdc8-cc23c1f4f6d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:06:07.180155 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0fcdb5-e2af-45f3-bdc8-cc23c1f4f6d7 None admin] REQUEST_METHOD: `GET` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:06:07.180596 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0fcdb5-e2af-45f3-bdc8-cc23c1f4f6d7 None admin] SCRIPT_NAME: `/identity` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:06:07.181061 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0fcdb5-e2af-45f3-bdc8-cc23c1f4f6d7 None admin] PATH_INFO: `/v3/roles` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:06:07.181960 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f0fcdb5-e2af-45f3-bdc8-cc23c1f4f6d7 None admin] RBAC: Adding query filter params (name=admin) {{(pid=416293) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 09:06:07.182462 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f0fcdb5-e2af-45f3-bdc8-cc23c1f4f6d7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:06:07.184090 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f0fcdb5-e2af-45f3-bdc8-cc23c1f4f6d7 None admin] RBAC: Authorization granted {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:06:07.194235 dv-cinder-851351-1-smb devstack@keystone.service[416293]: [pid: 416293|app: 0|req: 197/409] 10.222.0.42 () {56 vars in 1099 bytes} [Thu Jul 28 09:06:07 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:06:07.195355 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0fcdb5-e2af-45f3-bdc8-cc23c1f4f6d7 None admin] Authenticating user token {{(pid=416293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:06:07.223279 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95dbe4de-3181-4130-be83-2c504c3b1aa2 None admin] Validating token access rules against request {{(pid=416294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:06:07.278882 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998bfa9c-1194-44b5-a9a7-1a9a8ca37608 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:06:07.279939 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998bfa9c-1194-44b5-a9a7-1a9a8ca37608 None admin] REQUEST_METHOD: `GET` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:06:07.280449 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998bfa9c-1194-44b5-a9a7-1a9a8ca37608 None admin] SCRIPT_NAME: `/identity` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:06:07.280972 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998bfa9c-1194-44b5-a9a7-1a9a8ca37608 None admin] PATH_INFO: `/v3/projects/5c46e2ed162f45cabaf6f30752f915a4` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:06:07.282377 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-998bfa9c-1194-44b5-a9a7-1a9a8ca37608 None admin] RBAC: Authorizing `identity:get_project(project_id=5c46e2ed162f45cabaf6f30752f915a4)` {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:06:07.284148 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG dbcounter [-] [416293] Writing DB stats keystone:SELECT=100 {{(pid=416293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:06:07.285299 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-998bfa9c-1194-44b5-a9a7-1a9a8ca37608 None admin] RBAC: Authorization granted {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:06:07.287662 dv-cinder-851351-1-smb devstack@keystone.service[416294]: [pid: 416294|app: 0|req: 213/410] 10.222.0.42 () {56 vars in 1186 bytes} [Thu Jul 28 09:06:07 2022] GET /identity/v3/projects/5c46e2ed162f45cabaf6f30752f915a4 => generated 302 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:06:07.288935 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998bfa9c-1194-44b5-a9a7-1a9a8ca37608 None admin] Authenticating user token {{(pid=416294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:06:07.321719 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0fcdb5-e2af-45f3-bdc8-cc23c1f4f6d7 None admin] Validating token access rules against request {{(pid=416293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:06:07.367052 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG dbcounter [-] [416294] Writing DB stats keystone:SELECT=100 {{(pid=416294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:06:07.370684 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c126fe-866d-4de7-bad6-0c467124f524 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:06:07.371482 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c126fe-866d-4de7-bad6-0c467124f524 None admin] REQUEST_METHOD: `PUT` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:06:07.372327 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c126fe-866d-4de7-bad6-0c467124f524 None admin] SCRIPT_NAME: `/identity` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:06:07.372611 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c126fe-866d-4de7-bad6-0c467124f524 None admin] PATH_INFO: `/v3/projects/5c46e2ed162f45cabaf6f30752f915a4/groups/7f607738424745bf955f57e2c8966ff8/roles/ba1a79dc27074d5a94dce2d994019d37` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:06:07.375074 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c126fe-866d-4de7-bad6-0c467124f524 None admin] RBAC: Authorizing `identity:create_grant(project_id=5c46e2ed162f45cabaf6f30752f915a4, group_id=7f607738424745bf955f57e2c8966ff8, role_id=ba1a79dc27074d5a94dce2d994019d37)` {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:06:07.376610 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c126fe-866d-4de7-bad6-0c467124f524 None admin] RBAC: Authorization granted {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:06:07.404808 dv-cinder-851351-1-smb devstack@keystone.service[416293]: [pid: 416293|app: 0|req: 198/411] 10.222.0.42 () {58 vars in 1442 bytes} [Thu Jul 28 09:06:07 2022] PUT /identity/v3/projects/5c46e2ed162f45cabaf6f30752f915a4/groups/7f607738424745bf955f57e2c8966ff8/roles/ba1a79dc27074d5a94dce2d994019d37 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 09:06:07.406316 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c126fe-866d-4de7-bad6-0c467124f524 None admin] Authenticating user token {{(pid=416293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:06:07.446416 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998bfa9c-1194-44b5-a9a7-1a9a8ca37608 None admin] Validating token access rules against request {{(pid=416294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:06:07.543524 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e1ff09-6141-4391-9de9-0715634d32c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:06:07.544581 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e1ff09-6141-4391-9de9-0715634d32c6 None admin] REQUEST_METHOD: `GET` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:06:07.544973 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e1ff09-6141-4391-9de9-0715634d32c6 None admin] SCRIPT_NAME: `/identity` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:06:07.545329 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e1ff09-6141-4391-9de9-0715634d32c6 None admin] PATH_INFO: `/v3/groups/cd980c6f6d8c4ac99e1a021d719db0c2` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:06:07.546891 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e1ff09-6141-4391-9de9-0715634d32c6 None admin] RBAC: Authorizing `identity:get_group(group_id=cd980c6f6d8c4ac99e1a021d719db0c2)` {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:06:07.548458 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e1ff09-6141-4391-9de9-0715634d32c6 None admin] RBAC: Authorization granted {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:06:07.550560 dv-cinder-851351-1-smb devstack@keystone.service[416294]: [pid: 416294|app: 0|req: 214/412] 10.222.0.42 () {56 vars in 1180 bytes} [Thu Jul 28 09:06:07 2022] GET /identity/v3/groups/cd980c6f6d8c4ac99e1a021d719db0c2 => generated 229 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:06:07.551624 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f9d87e-4eb0-49a5-b07e-c1e229bdf0bf None None] REQUEST_METHOD: `GET` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:06:07.551890 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f9d87e-4eb0-49a5-b07e-c1e229bdf0bf None None] SCRIPT_NAME: `/identity` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:06:07.552166 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f9d87e-4eb0-49a5-b07e-c1e229bdf0bf None None] PATH_INFO: `/` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:06:07.553435 dv-cinder-851351-1-smb devstack@keystone.service[416294]: [pid: 416294|app: 0|req: 215/413] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 09:06:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 09:06:07.556866 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f9d87e-4eb0-49a5-b07e-c1e229bdf0bf None None] Authenticating user token {{(pid=416294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:06:07.567879 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c126fe-866d-4de7-bad6-0c467124f524 None admin] Validating token access rules against request {{(pid=416293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:06:07.615871 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a476c12b-3820-4e80-bf40-5a1e25af66b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:06:07.616965 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a476c12b-3820-4e80-bf40-5a1e25af66b2 None admin] REQUEST_METHOD: `PUT` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:06:07.617444 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a476c12b-3820-4e80-bf40-5a1e25af66b2 None admin] SCRIPT_NAME: `/identity` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:06:07.617943 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a476c12b-3820-4e80-bf40-5a1e25af66b2 None admin] PATH_INFO: `/v3/projects/5c46e2ed162f45cabaf6f30752f915a4/groups/7f607738424745bf955f57e2c8966ff8/roles/6194848862704a289bbaa3fda43a9050` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:06:07.621474 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a476c12b-3820-4e80-bf40-5a1e25af66b2 None admin] RBAC: Authorizing `identity:create_grant(project_id=5c46e2ed162f45cabaf6f30752f915a4, group_id=7f607738424745bf955f57e2c8966ff8, role_id=6194848862704a289bbaa3fda43a9050)` {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:06:07.624228 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a476c12b-3820-4e80-bf40-5a1e25af66b2 None admin] RBAC: Authorization granted {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:06:07.628206 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG dbcounter [-] [416293] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=416293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:06:07.647615 dv-cinder-851351-1-smb devstack@keystone.service[416293]: [pid: 416293|app: 0|req: 199/414] 10.222.0.42 () {58 vars in 1442 bytes} [Thu Jul 28 09:06:07 2022] PUT /identity/v3/projects/5c46e2ed162f45cabaf6f30752f915a4/groups/7f607738424745bf955f57e2c8966ff8/roles/6194848862704a289bbaa3fda43a9050 => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 09:06:07.648696 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cee80b7-d671-409b-854a-5e4d426d1e97 None None] REQUEST_METHOD: `POST` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:06:07.648985 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cee80b7-d671-409b-854a-5e4d426d1e97 None None] SCRIPT_NAME: `/identity` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:06:07.649265 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cee80b7-d671-409b-854a-5e4d426d1e97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:06:07.675585 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.auth.core [None req-1cee80b7-d671-409b-854a-5e4d426d1e97 None None] MFA Rules not processed for user `dbf87abab90e4fdf9e75408f4199918e`. Rule list: `[]` (Enabled: `True`). {{(pid=416293) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 09:06:07.678722 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.fernet_utils [None req-1cee80b7-d671-409b-854a-5e4d426d1e97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=416293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 09:06:07.693235 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f9d87e-4eb0-49a5-b07e-c1e229bdf0bf None None] Validating token access rules against request {{(pid=416294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:06:07.736112 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG dbcounter [-] [416294] Writing DB stats keystone:SELECT=100 {{(pid=416294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:06:07.762637 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea3dd2b-7894-4dd2-a38f-c4d46fa598cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:06:07.763930 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea3dd2b-7894-4dd2-a38f-c4d46fa598cd None admin] REQUEST_METHOD: `GET` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:06:07.765177 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea3dd2b-7894-4dd2-a38f-c4d46fa598cd None admin] SCRIPT_NAME: `/identity` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:06:07.765692 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea3dd2b-7894-4dd2-a38f-c4d46fa598cd None admin] PATH_INFO: `/v3/projects/0b5d78d12a0c4dfdbf387a60d6572e81` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:06:07.768799 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ea3dd2b-7894-4dd2-a38f-c4d46fa598cd None admin] RBAC: Authorizing `identity:get_project(project_id=0b5d78d12a0c4dfdbf387a60d6572e81)` {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:06:07.771223 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ea3dd2b-7894-4dd2-a38f-c4d46fa598cd None admin] RBAC: Authorization granted {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:06:07.774949 dv-cinder-851351-1-smb devstack@keystone.service[416294]: [pid: 416294|app: 0|req: 216/415] 10.222.0.42 () {56 vars in 1186 bytes} [Thu Jul 28 09:06:07 2022] GET /identity/v3/projects/0b5d78d12a0c4dfdbf387a60d6572e81 => generated 344 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:06:07.780967 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea3dd2b-7894-4dd2-a38f-c4d46fa598cd None admin] Authenticating user token {{(pid=416294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:06:07.804805 dv-cinder-851351-1-smb devstack@keystone.service[416293]: [pid: 416293|app: 0|req: 200/416] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 09:06:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 09:06:07.830449 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cee80b7-d671-409b-854a-5e4d426d1e97 None None] Authenticating user token {{(pid=416293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:06:07.958700 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea3dd2b-7894-4dd2-a38f-c4d46fa598cd None admin] Validating token access rules against request {{(pid=416294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:06:07.994261 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cee80b7-d671-409b-854a-5e4d426d1e97 None None] Validating token access rules against request {{(pid=416293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:06:08.005232 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4085d96b-7d7a-46fb-9dbf-3dd8cda80cfe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:06:08.006231 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4085d96b-7d7a-46fb-9dbf-3dd8cda80cfe None admin] REQUEST_METHOD: `PUT` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:06:08.006682 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4085d96b-7d7a-46fb-9dbf-3dd8cda80cfe None admin] SCRIPT_NAME: `/identity` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:06:08.007117 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4085d96b-7d7a-46fb-9dbf-3dd8cda80cfe None admin] PATH_INFO: `/v3/projects/0b5d78d12a0c4dfdbf387a60d6572e81/groups/cd980c6f6d8c4ac99e1a021d719db0c2/roles/c67085ec338243df8f9b7d6459036e23` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:06:08.009363 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4085d96b-7d7a-46fb-9dbf-3dd8cda80cfe None admin] RBAC: Authorizing `identity:create_grant(project_id=0b5d78d12a0c4dfdbf387a60d6572e81, group_id=cd980c6f6d8c4ac99e1a021d719db0c2, role_id=c67085ec338243df8f9b7d6459036e23)` {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:06:08.011006 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4085d96b-7d7a-46fb-9dbf-3dd8cda80cfe None admin] RBAC: Authorization granted {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:06:08.023807 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG dbcounter [-] [416293] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=416293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:06:08.029683 dv-cinder-851351-1-smb devstack@keystone.service[416294]: [pid: 416294|app: 0|req: 217/417] 10.222.0.42 () {58 vars in 1442 bytes} [Thu Jul 28 09:06:07 2022] PUT /identity/v3/projects/0b5d78d12a0c4dfdbf387a60d6572e81/groups/cd980c6f6d8c4ac99e1a021d719db0c2/roles/c67085ec338243df8f9b7d6459036e23 => generated 0 bytes in 249 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 09:06:08.049641 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19609b3-c746-4639-bbfe-2577832e49f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:06:08.051434 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19609b3-c746-4639-bbfe-2577832e49f8 None admin] REQUEST_METHOD: `GET` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:06:08.052174 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19609b3-c746-4639-bbfe-2577832e49f8 None admin] SCRIPT_NAME: `/identity` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:06:08.052867 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19609b3-c746-4639-bbfe-2577832e49f8 None admin] PATH_INFO: `/v3/roles/member` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:06:08.067837 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a19609b3-c746-4639-bbfe-2577832e49f8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 09:06:08.073919 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application [None req-a19609b3-c746-4639-bbfe-2577832e49f8 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 28 09:06:08.073919 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 09:06:08.073919 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 09:06:08.073919 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 09:06:08.073919 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 09:06:08.073919 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 09:06:08.073919 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 09:06:08.073919 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 09:06:08.073919 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 09:06:08.073919 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 09:06:08.073919 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 09:06:08.073919 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 09:06:08.073919 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 09:06:08.073919 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 09:06:08.073919 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 09:06:08.073919 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 09:06:08.074953 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 09:06:08.074953 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 09:06:08.074953 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 09:06:08.074953 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 09:06:08.074953 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 09:06:08.074953 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 09:06:08.074953 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 09:06:08.074953 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 09:06:08.074953 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 09:06:08.074953 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 09:06:08.074953 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 09:06:08.074953 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application with Lock( Jul 28 09:06:08.074953 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 09:06:08.074953 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self._enter() Jul 28 09:06:08.074953 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 09:06:08.074953 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 09:06:08.075918 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 09:06:08.075918 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self.creator() Jul 28 09:06:08.075918 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 09:06:08.075918 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application created_value = creator( Jul 28 09:06:08.075918 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 09:06:08.075918 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 09:06:08.075918 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 09:06:08.075918 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 09:06:08.075918 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 09:06:08.075918 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 09:06:08.075918 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 28 09:06:08.075918 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application Jul 28 09:06:08.078563 dv-cinder-851351-1-smb devstack@keystone.service[416293]: [pid: 416293|app: 0|req: 201/418] 10.222.0.42 () {56 vars in 1099 bytes} [Thu Jul 28 09:06:07 2022] GET /identity/v3/roles/member => generated 84 bytes in 249 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 09:06:08.086479 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4085d96b-7d7a-46fb-9dbf-3dd8cda80cfe None admin] Authenticating user token {{(pid=416294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:06:08.189737 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG dbcounter [-] [416294] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=416294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:06:08.237422 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33872d99-bfed-4d59-a18e-f1fde3af416a None None] REQUEST_METHOD: `GET` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:06:08.237710 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33872d99-bfed-4d59-a18e-f1fde3af416a None None] SCRIPT_NAME: `/identity` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:06:08.237993 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33872d99-bfed-4d59-a18e-f1fde3af416a None None] PATH_INFO: `/` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:06:08.241022 dv-cinder-851351-1-smb devstack@keystone.service[416293]: [pid: 416293|app: 0|req: 202/419] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 09:06:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 09:06:08.245642 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee6dc5d-1d71-4852-ba0f-812151efa494 None None] REQUEST_METHOD: `POST` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:06:08.245934 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee6dc5d-1d71-4852-ba0f-812151efa494 None None] SCRIPT_NAME: `/identity` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:06:08.246216 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee6dc5d-1d71-4852-ba0f-812151efa494 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:06:08.262938 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4085d96b-7d7a-46fb-9dbf-3dd8cda80cfe None admin] Validating token access rules against request {{(pid=416294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:06:08.270816 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.auth.core [None req-fee6dc5d-1d71-4852-ba0f-812151efa494 None None] MFA Rules not processed for user `dbf87abab90e4fdf9e75408f4199918e`. Rule list: `[]` (Enabled: `True`). {{(pid=416293) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 09:06:08.272148 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.fernet_utils [None req-fee6dc5d-1d71-4852-ba0f-812151efa494 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=416293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 09:06:08.306054 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e54a07-f871-43d8-8c3c-ab4a89f5d45f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:06:08.306971 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e54a07-f871-43d8-8c3c-ab4a89f5d45f None admin] REQUEST_METHOD: `GET` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:06:08.307427 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e54a07-f871-43d8-8c3c-ab4a89f5d45f None admin] SCRIPT_NAME: `/identity` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:06:08.307855 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e54a07-f871-43d8-8c3c-ab4a89f5d45f None admin] PATH_INFO: `/v3/roles` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:06:08.308877 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7e54a07-f871-43d8-8c3c-ab4a89f5d45f None admin] RBAC: Adding query filter params (name=member) {{(pid=416294) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 09:06:08.309349 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7e54a07-f871-43d8-8c3c-ab4a89f5d45f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:06:08.311019 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7e54a07-f871-43d8-8c3c-ab4a89f5d45f None admin] RBAC: Authorization granted {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:06:08.321631 dv-cinder-851351-1-smb devstack@keystone.service[416294]: [pid: 416294|app: 0|req: 218/420] 10.222.0.42 () {56 vars in 1101 bytes} [Thu Jul 28 09:06:08 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:06:08.327729 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e54a07-f871-43d8-8c3c-ab4a89f5d45f None admin] Authenticating user token {{(pid=416294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:06:08.350582 dv-cinder-851351-1-smb devstack@keystone.service[416293]: [pid: 416293|app: 0|req: 203/421] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 09:06:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 28 09:06:08.371758 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee6dc5d-1d71-4852-ba0f-812151efa494 None None] Authenticating user token {{(pid=416293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:06:08.447976 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e54a07-f871-43d8-8c3c-ab4a89f5d45f None admin] Validating token access rules against request {{(pid=416294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:06:08.467888 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG dbcounter [-] [416294] Writing DB stats keystone:SELECT=100 {{(pid=416294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:06:08.483494 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee6dc5d-1d71-4852-ba0f-812151efa494 None None] Validating token access rules against request {{(pid=416293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:06:08.489575 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afabfb86-4f9d-4a06-a7b1-be7a30e9e390 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:06:08.490427 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afabfb86-4f9d-4a06-a7b1-be7a30e9e390 None admin] REQUEST_METHOD: `GET` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:06:08.490975 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afabfb86-4f9d-4a06-a7b1-be7a30e9e390 None admin] SCRIPT_NAME: `/identity` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:06:08.491396 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afabfb86-4f9d-4a06-a7b1-be7a30e9e390 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:06:08.498309 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG dbcounter [-] [416293] Writing DB stats keystone:SELECT=100 {{(pid=416293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:06:08.520811 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b995438-8d9a-4531-86b6-76ee308c8738 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:06:08.521484 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b995438-8d9a-4531-86b6-76ee308c8738 None admin] REQUEST_METHOD: `GET` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:06:08.521773 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b995438-8d9a-4531-86b6-76ee308c8738 None admin] SCRIPT_NAME: `/identity` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:06:08.522049 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b995438-8d9a-4531-86b6-76ee308c8738 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:06:08.536082 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b995438-8d9a-4531-86b6-76ee308c8738 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 09:06:08.541357 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application [None req-9b995438-8d9a-4531-86b6-76ee308c8738 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 28 09:06:08.541357 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 09:06:08.541357 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 09:06:08.541357 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 09:06:08.541357 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 09:06:08.541357 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 09:06:08.541357 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 09:06:08.541357 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 09:06:08.541357 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 09:06:08.541357 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 09:06:08.541357 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 09:06:08.541357 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 09:06:08.541357 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 09:06:08.541357 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 09:06:08.541357 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 09:06:08.541357 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 09:06:08.542499 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 09:06:08.542499 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 09:06:08.542499 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 09:06:08.542499 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 09:06:08.542499 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 09:06:08.542499 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 09:06:08.542499 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 09:06:08.542499 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 09:06:08.542499 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 09:06:08.542499 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 09:06:08.542499 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 09:06:08.542499 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application with Lock( Jul 28 09:06:08.542499 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 09:06:08.542499 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self._enter() Jul 28 09:06:08.542499 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 09:06:08.542499 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 09:06:08.543581 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 09:06:08.543581 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self.creator() Jul 28 09:06:08.543581 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 09:06:08.543581 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application created_value = creator( Jul 28 09:06:08.543581 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 09:06:08.543581 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 09:06:08.543581 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 09:06:08.543581 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 09:06:08.543581 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 09:06:08.543581 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 09:06:08.543581 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 28 09:06:08.543581 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application Jul 28 09:06:08.547726 dv-cinder-851351-1-smb devstack@keystone.service[416293]: [pid: 416293|app: 0|req: 204/422] 10.222.0.42 () {56 vars in 1114 bytes} [Thu Jul 28 09:06:08 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 09:06:08.549144 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b995438-8d9a-4531-86b6-76ee308c8738 None admin] Authenticating user token {{(pid=416293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:06:08.576069 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afabfb86-4f9d-4a06-a7b1-be7a30e9e390 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:06:08.577976 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afabfb86-4f9d-4a06-a7b1-be7a30e9e390 None admin] RBAC: Authorization granted {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:06:08.662351 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b995438-8d9a-4531-86b6-76ee308c8738 None admin] Validating token access rules against request {{(pid=416293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:06:08.688372 dv-cinder-851351-1-smb devstack@keystone.service[416294]: [pid: 416294|app: 0|req: 219/423] 10.222.0.42 () {58 vars in 1282 bytes} [Thu Jul 28 09:06:08 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 361 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 28 09:06:08.698009 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afabfb86-4f9d-4a06-a7b1-be7a30e9e390 None admin] Authenticating user token {{(pid=416294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:06:08.701196 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227d468a-05b9-462a-bc55-2a24bb9e6e09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:06:08.702811 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227d468a-05b9-462a-bc55-2a24bb9e6e09 None admin] REQUEST_METHOD: `GET` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:06:08.702811 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227d468a-05b9-462a-bc55-2a24bb9e6e09 None admin] SCRIPT_NAME: `/identity` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:06:08.702811 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227d468a-05b9-462a-bc55-2a24bb9e6e09 None admin] PATH_INFO: `/v3/roles` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:06:08.703519 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-227d468a-05b9-462a-bc55-2a24bb9e6e09 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=416293) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 09:06:08.703893 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-227d468a-05b9-462a-bc55-2a24bb9e6e09 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:06:08.705556 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-227d468a-05b9-462a-bc55-2a24bb9e6e09 None admin] RBAC: Authorization granted {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:06:08.719719 dv-cinder-851351-1-smb devstack@keystone.service[416293]: [pid: 416293|app: 0|req: 205/424] 10.222.0.42 () {56 vars in 1111 bytes} [Thu Jul 28 09:06:08 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:06:08.721329 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227d468a-05b9-462a-bc55-2a24bb9e6e09 None admin] Authenticating user token {{(pid=416293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:06:08.724845 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG dbcounter [-] [416294] Writing DB stats keystone:SELECT=100 {{(pid=416294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:06:08.761996 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG dbcounter [-] [416293] Writing DB stats keystone:SELECT=100 {{(pid=416293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:06:08.821406 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afabfb86-4f9d-4a06-a7b1-be7a30e9e390 None admin] Validating token access rules against request {{(pid=416294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:06:08.837731 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227d468a-05b9-462a-bc55-2a24bb9e6e09 None admin] Validating token access rules against request {{(pid=416293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:06:08.862580 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe8c419-3d03-499d-a62c-11fadeef745d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:06:08.863687 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe8c419-3d03-499d-a62c-11fadeef745d None admin] REQUEST_METHOD: `GET` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:06:08.864219 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe8c419-3d03-499d-a62c-11fadeef745d None admin] SCRIPT_NAME: `/identity` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:06:08.864739 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe8c419-3d03-499d-a62c-11fadeef745d None admin] PATH_INFO: `/v3/projects/c515ec4395fe420e9ab0ba34fb1ada8f` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:06:08.866280 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbe8c419-3d03-499d-a62c-11fadeef745d None admin] RBAC: Authorizing `identity:get_project(project_id=c515ec4395fe420e9ab0ba34fb1ada8f)` {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:06:08.868117 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbe8c419-3d03-499d-a62c-11fadeef745d None admin] RBAC: Authorization granted {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:06:08.870586 dv-cinder-851351-1-smb devstack@keystone.service[416294]: [pid: 416294|app: 0|req: 220/425] 10.222.0.42 () {56 vars in 1186 bytes} [Thu Jul 28 09:06:08 2022] GET /identity/v3/projects/c515ec4395fe420e9ab0ba34fb1ada8f => generated 298 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:06:08.877283 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe8c419-3d03-499d-a62c-11fadeef745d None admin] Authenticating user token {{(pid=416294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:06:08.880226 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb6ee9a-1240-4408-9f44-7065a8a4270f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:06:08.880902 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb6ee9a-1240-4408-9f44-7065a8a4270f None admin] REQUEST_METHOD: `GET` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:06:08.881184 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb6ee9a-1240-4408-9f44-7065a8a4270f None admin] SCRIPT_NAME: `/identity` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:06:08.881459 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb6ee9a-1240-4408-9f44-7065a8a4270f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:06:09.010598 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb6ee9a-1240-4408-9f44-7065a8a4270f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:06:09.012075 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb6ee9a-1240-4408-9f44-7065a8a4270f None admin] RBAC: Authorization granted {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:06:09.041504 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG dbcounter [-] [416294] Writing DB stats keystone:SELECT=100 {{(pid=416294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:06:09.069460 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe8c419-3d03-499d-a62c-11fadeef745d None admin] Validating token access rules against request {{(pid=416294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:06:09.086748 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG dbcounter [-] [416293] Writing DB stats keystone:SELECT=100 {{(pid=416293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:06:09.135729 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e44784c5-a282-4340-814f-811793876d97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:06:09.136402 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44784c5-a282-4340-814f-811793876d97 None admin] REQUEST_METHOD: `GET` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:06:09.136592 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44784c5-a282-4340-814f-811793876d97 None admin] SCRIPT_NAME: `/identity` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:06:09.136889 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44784c5-a282-4340-814f-811793876d97 None admin] PATH_INFO: `/v3/groups/7f607738424745bf955f57e2c8966ff8` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:06:09.140457 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e44784c5-a282-4340-814f-811793876d97 None admin] RBAC: Authorizing `identity:get_group(group_id=7f607738424745bf955f57e2c8966ff8)` {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:06:09.141944 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e44784c5-a282-4340-814f-811793876d97 None admin] RBAC: Authorization granted {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:06:09.143645 dv-cinder-851351-1-smb devstack@keystone.service[416294]: [pid: 416294|app: 0|req: 221/426] 10.222.0.42 () {56 vars in 1180 bytes} [Thu Jul 28 09:06:08 2022] GET /identity/v3/groups/7f607738424745bf955f57e2c8966ff8 => generated 226 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 09:06:09.149654 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e44784c5-a282-4340-814f-811793876d97 None admin] Authenticating user token {{(pid=416294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:06:09.215239 dv-cinder-851351-1-smb devstack@keystone.service[416293]: [pid: 416293|app: 0|req: 206/427] 10.222.0.42 () {58 vars in 1282 bytes} [Thu Jul 28 09:06:08 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 495 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 28 09:06:09.230757 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb6ee9a-1240-4408-9f44-7065a8a4270f None admin] Authenticating user token {{(pid=416293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:06:09.304740 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e44784c5-a282-4340-814f-811793876d97 None admin] Validating token access rules against request {{(pid=416294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:06:09.353057 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb356f9-67fe-466a-936c-c2dba0325a51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:06:09.353698 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb356f9-67fe-466a-936c-c2dba0325a51 None admin] REQUEST_METHOD: `GET` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:06:09.353980 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb356f9-67fe-466a-936c-c2dba0325a51 None admin] SCRIPT_NAME: `/identity` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:06:09.354258 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb356f9-67fe-466a-936c-c2dba0325a51 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:06:09.355058 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fb356f9-67fe-466a-936c-c2dba0325a51 None admin] RBAC: Adding query filter params (group.id=7f607738424745bf955f57e2c8966ff8, role.id=ba1a79dc27074d5a94dce2d994019d37, scope.project.id=c515ec4395fe420e9ab0ba34fb1ada8f) {{(pid=416294) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 09:06:09.355366 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fb356f9-67fe-466a-936c-c2dba0325a51 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:06:09.356844 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fb356f9-67fe-466a-936c-c2dba0325a51 None admin] RBAC: Authorization granted {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:06:09.371113 dv-cinder-851351-1-smb devstack@keystone.service[416294]: [pid: 416294|app: 0|req: 222/428] 10.222.0.42 () {56 vars in 1376 bytes} [Thu Jul 28 09:06:09 2022] GET /identity/v3/role_assignments?group.id=7f607738424745bf955f57e2c8966ff8&scope.project.id=c515ec4395fe420e9ab0ba34fb1ada8f&role.id=ba1a79dc27074d5a94dce2d994019d37 => generated 611 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:06:09.396129 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb6ee9a-1240-4408-9f44-7065a8a4270f None admin] Validating token access rules against request {{(pid=416293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:06:09.444303 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8029345a-5c5c-4a81-af85-e3ada2d3a7c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:06:09.445010 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8029345a-5c5c-4a81-af85-e3ada2d3a7c6 None admin] REQUEST_METHOD: `GET` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:06:09.445298 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8029345a-5c5c-4a81-af85-e3ada2d3a7c6 None admin] SCRIPT_NAME: `/identity` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:06:09.445576 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8029345a-5c5c-4a81-af85-e3ada2d3a7c6 None admin] PATH_INFO: `/v3/projects/c515ec4395fe420e9ab0ba34fb1ada8f` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:06:09.446771 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8029345a-5c5c-4a81-af85-e3ada2d3a7c6 None admin] RBAC: Authorizing `identity:get_project(project_id=c515ec4395fe420e9ab0ba34fb1ada8f)` {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:06:09.448235 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8029345a-5c5c-4a81-af85-e3ada2d3a7c6 None admin] RBAC: Authorization granted {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:06:09.451324 dv-cinder-851351-1-smb devstack@keystone.service[416293]: [pid: 416293|app: 0|req: 207/429] 10.222.0.42 () {56 vars in 1186 bytes} [Thu Jul 28 09:06:09 2022] GET /identity/v3/projects/c515ec4395fe420e9ab0ba34fb1ada8f => generated 298 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:06:09.456133 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb356f9-67fe-466a-936c-c2dba0325a51 None admin] Authenticating user token {{(pid=416294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:06:09.482126 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG dbcounter [-] [416294] Writing DB stats keystone:SELECT=100 {{(pid=416294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:06:09.585882 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb356f9-67fe-466a-936c-c2dba0325a51 None admin] Validating token access rules against request {{(pid=416294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:06:09.632545 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320a2a0a-22b3-4ddc-a3bc-d01de3837e79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:06:09.633265 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320a2a0a-22b3-4ddc-a3bc-d01de3837e79 None admin] REQUEST_METHOD: `GET` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:06:09.633549 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320a2a0a-22b3-4ddc-a3bc-d01de3837e79 None admin] SCRIPT_NAME: `/identity` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:06:09.633827 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320a2a0a-22b3-4ddc-a3bc-d01de3837e79 None admin] PATH_INFO: `/v3/groups/7f607738424745bf955f57e2c8966ff8` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:06:09.635193 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-320a2a0a-22b3-4ddc-a3bc-d01de3837e79 None admin] RBAC: Authorizing `identity:get_group(group_id=7f607738424745bf955f57e2c8966ff8)` {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:06:09.636751 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-320a2a0a-22b3-4ddc-a3bc-d01de3837e79 None admin] RBAC: Authorization granted {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:06:09.639645 dv-cinder-851351-1-smb devstack@keystone.service[416294]: [pid: 416294|app: 0|req: 223/430] 10.222.0.42 () {56 vars in 1180 bytes} [Thu Jul 28 09:06:09 2022] GET /identity/v3/groups/7f607738424745bf955f57e2c8966ff8 => generated 226 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:06:09.644894 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8029345a-5c5c-4a81-af85-e3ada2d3a7c6 None admin] Authenticating user token {{(pid=416293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:06:09.650335 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG dbcounter [-] [416293] Writing DB stats keystone:SELECT=100 {{(pid=416293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:06:09.760655 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8029345a-5c5c-4a81-af85-e3ada2d3a7c6 None admin] Validating token access rules against request {{(pid=416293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:06:09.800494 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-204da607-6f91-49a3-b08a-5d1f2918b0b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:06:09.801174 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204da607-6f91-49a3-b08a-5d1f2918b0b6 None admin] REQUEST_METHOD: `GET` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:06:09.801456 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204da607-6f91-49a3-b08a-5d1f2918b0b6 None admin] SCRIPT_NAME: `/identity` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:06:09.801731 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204da607-6f91-49a3-b08a-5d1f2918b0b6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:06:09.802601 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-204da607-6f91-49a3-b08a-5d1f2918b0b6 None admin] RBAC: Adding query filter params (group.id=7f607738424745bf955f57e2c8966ff8, role.id=6194848862704a289bbaa3fda43a9050, scope.project.id=c515ec4395fe420e9ab0ba34fb1ada8f) {{(pid=416293) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 09:06:09.802912 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-204da607-6f91-49a3-b08a-5d1f2918b0b6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:06:09.804484 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-204da607-6f91-49a3-b08a-5d1f2918b0b6 None admin] RBAC: Authorization granted {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:06:09.811839 dv-cinder-851351-1-smb devstack@keystone.service[416293]: [pid: 416293|app: 0|req: 208/431] 10.222.0.42 () {56 vars in 1376 bytes} [Thu Jul 28 09:06:09 2022] GET /identity/v3/role_assignments?group.id=7f607738424745bf955f57e2c8966ff8&scope.project.id=c515ec4395fe420e9ab0ba34fb1ada8f&role.id=6194848862704a289bbaa3fda43a9050 => generated 611 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:06:10.051659 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d4cdbf-b588-4912-8dd5-44e4ea118979 None None] REQUEST_METHOD: `GET` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:06:10.051945 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d4cdbf-b588-4912-8dd5-44e4ea118979 None None] SCRIPT_NAME: `/identity` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:06:10.052229 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d4cdbf-b588-4912-8dd5-44e4ea118979 None None] PATH_INFO: `/` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:06:10.054017 dv-cinder-851351-1-smb devstack@keystone.service[416294]: [pid: 416294|app: 0|req: 224/432] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 09:06:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 09:06:10.059572 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81c1ad5-0623-4f84-a832-044ca0486cb7 None None] REQUEST_METHOD: `POST` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:06:10.060069 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81c1ad5-0623-4f84-a832-044ca0486cb7 None None] SCRIPT_NAME: `/identity` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:06:10.060173 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81c1ad5-0623-4f84-a832-044ca0486cb7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:06:10.085032 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.auth.core [None req-d81c1ad5-0623-4f84-a832-044ca0486cb7 None None] MFA Rules not processed for user `dbf87abab90e4fdf9e75408f4199918e`. Rule list: `[]` (Enabled: `True`). {{(pid=416293) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 09:06:10.086735 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.fernet_utils [None req-d81c1ad5-0623-4f84-a832-044ca0486cb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=416293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 09:06:10.160678 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG dbcounter [-] [416293] Writing DB stats keystone:SELECT=100 {{(pid=416293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:06:10.167056 dv-cinder-851351-1-smb devstack@keystone.service[416293]: [pid: 416293|app: 0|req: 209/433] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 09:06:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 09:06:10.190706 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d4cdbf-b588-4912-8dd5-44e4ea118979 None None] Authenticating user token {{(pid=416294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:06:10.208881 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d92fff7-e79f-4d3f-8ece-cdcf88d26927 None None] REQUEST_METHOD: `GET` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:06:10.209221 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d92fff7-e79f-4d3f-8ece-cdcf88d26927 None None] SCRIPT_NAME: `/identity` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:06:10.209449 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d92fff7-e79f-4d3f-8ece-cdcf88d26927 None None] PATH_INFO: `/` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:06:10.211142 dv-cinder-851351-1-smb devstack@keystone.service[416293]: [pid: 416293|app: 0|req: 210/434] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 09:06:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 28 09:06:10.218214 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eefd4a6-d639-4cfc-9c7a-5923ec488530 None None] REQUEST_METHOD: `POST` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:06:10.218601 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eefd4a6-d639-4cfc-9c7a-5923ec488530 None None] SCRIPT_NAME: `/identity` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:06:10.218984 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eefd4a6-d639-4cfc-9c7a-5923ec488530 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:06:10.240544 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.auth.core [None req-5eefd4a6-d639-4cfc-9c7a-5923ec488530 None None] MFA Rules not processed for user `dbf87abab90e4fdf9e75408f4199918e`. Rule list: `[]` (Enabled: `True`). {{(pid=416293) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 09:06:10.242093 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.fernet_utils [None req-5eefd4a6-d639-4cfc-9c7a-5923ec488530 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=416293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 09:06:10.300972 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG dbcounter [-] [416294] Writing DB stats keystone:SELECT=100 {{(pid=416294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:06:10.322091 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d4cdbf-b588-4912-8dd5-44e4ea118979 None None] Validating token access rules against request {{(pid=416294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:06:10.329718 dv-cinder-851351-1-smb devstack@keystone.service[416293]: [pid: 416293|app: 0|req: 211/435] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 09:06:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 09:06:10.353780 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eefd4a6-d639-4cfc-9c7a-5923ec488530 None None] Authenticating user token {{(pid=416293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:06:10.366007 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e7a54d7-5ffe-4acf-b2b9-3302c562513c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:06:10.366674 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7a54d7-5ffe-4acf-b2b9-3302c562513c None admin] REQUEST_METHOD: `GET` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:06:10.367281 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7a54d7-5ffe-4acf-b2b9-3302c562513c None admin] SCRIPT_NAME: `/identity` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:06:10.367560 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7a54d7-5ffe-4acf-b2b9-3302c562513c None admin] PATH_INFO: `/v3/roles/member` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:06:10.381483 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e7a54d7-5ffe-4acf-b2b9-3302c562513c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 09:06:10.387057 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application [None req-5e7a54d7-5ffe-4acf-b2b9-3302c562513c None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 28 09:06:10.387057 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 09:06:10.387057 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 09:06:10.387057 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 09:06:10.387057 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 09:06:10.387057 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 09:06:10.387057 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 09:06:10.387057 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 09:06:10.387057 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 09:06:10.387057 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 09:06:10.387057 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 09:06:10.387057 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 09:06:10.387057 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 09:06:10.387057 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 09:06:10.387057 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 09:06:10.387057 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 09:06:10.388075 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 09:06:10.388075 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 09:06:10.388075 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 09:06:10.388075 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 09:06:10.388075 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 09:06:10.388075 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 09:06:10.388075 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 09:06:10.388075 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 09:06:10.388075 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 09:06:10.388075 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 09:06:10.388075 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 09:06:10.388075 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application with Lock( Jul 28 09:06:10.388075 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 09:06:10.388075 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return self._enter() Jul 28 09:06:10.388075 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 09:06:10.388075 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 09:06:10.389015 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 09:06:10.389015 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return self.creator() Jul 28 09:06:10.389015 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 09:06:10.389015 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application created_value = creator( Jul 28 09:06:10.389015 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 09:06:10.389015 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 09:06:10.389015 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 09:06:10.389015 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 09:06:10.389015 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 09:06:10.389015 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 09:06:10.389015 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 28 09:06:10.389015 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application Jul 28 09:06:10.389015 dv-cinder-851351-1-smb devstack@keystone.service[416294]: [pid: 416294|app: 0|req: 225/436] 10.222.0.42 () {56 vars in 1099 bytes} [Thu Jul 28 09:06:10 2022] GET /identity/v3/roles/member => generated 84 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 09:06:10.396202 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e7a54d7-5ffe-4acf-b2b9-3302c562513c None admin] Authenticating user token {{(pid=416294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:06:10.494346 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eefd4a6-d639-4cfc-9c7a-5923ec488530 None None] Validating token access rules against request {{(pid=416293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:06:10.516417 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e7a54d7-5ffe-4acf-b2b9-3302c562513c None admin] Validating token access rules against request {{(pid=416294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:06:10.523313 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG dbcounter [-] [416293] Writing DB stats keystone:SELECT=100 {{(pid=416293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:06:10.535337 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53022fa-1e0c-4ba9-aa2a-0bee733affcd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:06:10.536062 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53022fa-1e0c-4ba9-aa2a-0bee733affcd None admin] REQUEST_METHOD: `GET` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:06:10.536343 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53022fa-1e0c-4ba9-aa2a-0bee733affcd None admin] SCRIPT_NAME: `/identity` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:06:10.536581 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53022fa-1e0c-4ba9-aa2a-0bee733affcd None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:06:10.551950 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e53022fa-1e0c-4ba9-aa2a-0bee733affcd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 09:06:10.552231 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb0f9091-eb44-445d-b612-623940990301 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:06:10.552881 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0f9091-eb44-445d-b612-623940990301 None admin] REQUEST_METHOD: `GET` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:06:10.553168 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0f9091-eb44-445d-b612-623940990301 None admin] SCRIPT_NAME: `/identity` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:06:10.553446 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0f9091-eb44-445d-b612-623940990301 None admin] PATH_INFO: `/v3/roles` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:06:10.554184 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb0f9091-eb44-445d-b612-623940990301 None admin] RBAC: Adding query filter params (name=member) {{(pid=416294) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 09:06:10.554491 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb0f9091-eb44-445d-b612-623940990301 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:06:10.555878 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb0f9091-eb44-445d-b612-623940990301 None admin] RBAC: Authorization granted {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:06:10.557117 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application [None req-e53022fa-1e0c-4ba9-aa2a-0bee733affcd None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 28 09:06:10.557117 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 09:06:10.557117 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 09:06:10.557117 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 09:06:10.557117 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 09:06:10.557117 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 09:06:10.557117 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 09:06:10.557117 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 09:06:10.557117 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 09:06:10.557117 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 09:06:10.557117 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 09:06:10.557117 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 09:06:10.557117 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 09:06:10.557117 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 09:06:10.557117 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 09:06:10.557117 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 09:06:10.558120 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 09:06:10.558120 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 09:06:10.558120 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 09:06:10.558120 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 09:06:10.558120 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 09:06:10.558120 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 09:06:10.558120 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 09:06:10.558120 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 09:06:10.558120 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 09:06:10.558120 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 09:06:10.558120 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 09:06:10.558120 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application with Lock( Jul 28 09:06:10.558120 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 09:06:10.558120 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self._enter() Jul 28 09:06:10.558120 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 09:06:10.558120 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 09:06:10.559020 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 09:06:10.559020 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self.creator() Jul 28 09:06:10.559020 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 09:06:10.559020 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application created_value = creator( Jul 28 09:06:10.559020 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 09:06:10.559020 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 09:06:10.559020 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 09:06:10.559020 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 09:06:10.559020 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 09:06:10.559020 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 09:06:10.559020 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 28 09:06:10.559020 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application Jul 28 09:06:10.559687 dv-cinder-851351-1-smb devstack@keystone.service[416293]: [pid: 416293|app: 0|req: 212/437] 10.222.0.42 () {56 vars in 1114 bytes} [Thu Jul 28 09:06:10 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 09:06:10.564997 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53022fa-1e0c-4ba9-aa2a-0bee733affcd None admin] Authenticating user token {{(pid=416293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:06:10.570117 dv-cinder-851351-1-smb devstack@keystone.service[416294]: [pid: 416294|app: 0|req: 226/438] 10.222.0.42 () {56 vars in 1101 bytes} [Thu Jul 28 09:06:10 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 09:06:10.575950 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb0f9091-eb44-445d-b612-623940990301 None admin] Authenticating user token {{(pid=416294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:06:10.587872 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG dbcounter [-] [416294] Writing DB stats keystone:SELECT=100 {{(pid=416294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:06:10.684940 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53022fa-1e0c-4ba9-aa2a-0bee733affcd None admin] Validating token access rules against request {{(pid=416293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:06:10.686180 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb0f9091-eb44-445d-b612-623940990301 None admin] Validating token access rules against request {{(pid=416294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:06:10.720385 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52c5bbd-bdf6-4fe0-af25-14b5b5f96cb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:06:10.721105 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52c5bbd-bdf6-4fe0-af25-14b5b5f96cb3 None admin] REQUEST_METHOD: `GET` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:06:10.721414 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52c5bbd-bdf6-4fe0-af25-14b5b5f96cb3 None admin] SCRIPT_NAME: `/identity` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:06:10.721689 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52c5bbd-bdf6-4fe0-af25-14b5b5f96cb3 None admin] PATH_INFO: `/v3/roles` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:06:10.721989 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f961d13-da4e-40ae-841d-3dfba730a29f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:06:10.722413 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e52c5bbd-bdf6-4fe0-af25-14b5b5f96cb3 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=416293) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 09:06:10.722627 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f961d13-da4e-40ae-841d-3dfba730a29f None admin] REQUEST_METHOD: `GET` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:06:10.722742 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e52c5bbd-bdf6-4fe0-af25-14b5b5f96cb3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:06:10.722914 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f961d13-da4e-40ae-841d-3dfba730a29f None admin] SCRIPT_NAME: `/identity` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:06:10.723192 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f961d13-da4e-40ae-841d-3dfba730a29f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:06:10.724125 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e52c5bbd-bdf6-4fe0-af25-14b5b5f96cb3 None admin] RBAC: Authorization granted {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:06:10.732248 dv-cinder-851351-1-smb devstack@keystone.service[416293]: [pid: 416293|app: 0|req: 213/439] 10.222.0.42 () {56 vars in 1111 bytes} [Thu Jul 28 09:06:10 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:06:10.733478 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856b87cd-e31c-497a-9aff-66bdee5d50dd None None] REQUEST_METHOD: `GET` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:06:10.733756 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856b87cd-e31c-497a-9aff-66bdee5d50dd None None] SCRIPT_NAME: `/identity` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:06:10.734030 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856b87cd-e31c-497a-9aff-66bdee5d50dd None None] PATH_INFO: `/` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:06:10.735289 dv-cinder-851351-1-smb devstack@keystone.service[416293]: [pid: 416293|app: 0|req: 214/440] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 09:06:10 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 09:06:10.737992 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-856b87cd-e31c-497a-9aff-66bdee5d50dd None None] Authenticating user token {{(pid=416293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:06:10.792574 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG dbcounter [-] [416293] Writing DB stats keystone:SELECT=100 {{(pid=416293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:06:10.794822 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f961d13-da4e-40ae-841d-3dfba730a29f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:06:10.796577 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f961d13-da4e-40ae-841d-3dfba730a29f None admin] RBAC: Authorization granted {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:06:10.806656 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG dbcounter [-] [416294] Writing DB stats keystone:SELECT=100 {{(pid=416294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:06:10.848179 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-856b87cd-e31c-497a-9aff-66bdee5d50dd None None] Validating token access rules against request {{(pid=416293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:06:10.881776 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb95e1f8-6dad-44c2-86d1-c7025d014b0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:06:10.882406 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb95e1f8-6dad-44c2-86d1-c7025d014b0c None admin] REQUEST_METHOD: `GET` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:06:10.882694 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb95e1f8-6dad-44c2-86d1-c7025d014b0c None admin] SCRIPT_NAME: `/identity` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:06:10.882973 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb95e1f8-6dad-44c2-86d1-c7025d014b0c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:06:10.902092 dv-cinder-851351-1-smb devstack@keystone.service[416294]: [pid: 416294|app: 0|req: 227/441] 10.222.0.42 () {58 vars in 1282 bytes} [Thu Jul 28 09:06:10 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 28 09:06:10.903394 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53fecea1-2662-476a-8055-0af27b49075b None None] REQUEST_METHOD: `POST` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:06:10.905227 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53fecea1-2662-476a-8055-0af27b49075b None None] SCRIPT_NAME: `/identity` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:06:10.905227 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53fecea1-2662-476a-8055-0af27b49075b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:06:10.923338 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.auth.core [None req-53fecea1-2662-476a-8055-0af27b49075b None None] MFA Rules not processed for user `dbf87abab90e4fdf9e75408f4199918e`. Rule list: `[]` (Enabled: `True`). {{(pid=416294) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 09:06:10.924649 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.fernet_utils [None req-53fecea1-2662-476a-8055-0af27b49075b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=416294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 09:06:10.953787 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb95e1f8-6dad-44c2-86d1-c7025d014b0c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:06:10.955427 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb95e1f8-6dad-44c2-86d1-c7025d014b0c None admin] RBAC: Authorization granted {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:06:10.994779 dv-cinder-851351-1-smb devstack@keystone.service[416294]: [pid: 416294|app: 0|req: 228/442] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 09:06:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 09:06:10.995649 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53fecea1-2662-476a-8055-0af27b49075b None None] Authenticating user token {{(pid=416294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:06:11.017041 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG dbcounter [-] [416293] Writing DB stats keystone:SELECT=100 {{(pid=416293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:06:11.039328 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG dbcounter [-] [416294] Writing DB stats keystone:SELECT=100 {{(pid=416294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:06:11.070133 dv-cinder-851351-1-smb devstack@keystone.service[416293]: [pid: 416293|app: 0|req: 215/443] 10.222.0.42 () {58 vars in 1282 bytes} [Thu Jul 28 09:06:10 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 28 09:06:11.070907 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb95e1f8-6dad-44c2-86d1-c7025d014b0c None admin] Authenticating user token {{(pid=416293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:06:11.105514 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53fecea1-2662-476a-8055-0af27b49075b None None] Validating token access rules against request {{(pid=416294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:06:11.138873 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d5fe804-5e88-44d8-82df-e8692f2ca149 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:06:11.139518 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5fe804-5e88-44d8-82df-e8692f2ca149 None admin] REQUEST_METHOD: `GET` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:06:11.139801 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5fe804-5e88-44d8-82df-e8692f2ca149 None admin] SCRIPT_NAME: `/identity` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:06:11.140076 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5fe804-5e88-44d8-82df-e8692f2ca149 None admin] PATH_INFO: `/v3/projects/5c46e2ed162f45cabaf6f30752f915a4` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:06:11.141274 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d5fe804-5e88-44d8-82df-e8692f2ca149 None admin] RBAC: Authorizing `identity:get_project(project_id=5c46e2ed162f45cabaf6f30752f915a4)` {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:06:11.142830 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d5fe804-5e88-44d8-82df-e8692f2ca149 None admin] RBAC: Authorization granted {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:06:11.144698 dv-cinder-851351-1-smb devstack@keystone.service[416294]: [pid: 416294|app: 0|req: 229/444] 10.222.0.42 () {56 vars in 1186 bytes} [Thu Jul 28 09:06:10 2022] GET /identity/v3/projects/5c46e2ed162f45cabaf6f30752f915a4 => generated 302 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:06:11.145373 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d5fe804-5e88-44d8-82df-e8692f2ca149 None admin] Authenticating user token {{(pid=416294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:06:11.175007 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb95e1f8-6dad-44c2-86d1-c7025d014b0c None admin] Validating token access rules against request {{(pid=416293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:06:11.210507 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6cd860-ebde-42c1-ab05-194245cacb3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:06:11.211185 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6cd860-ebde-42c1-ab05-194245cacb3a None admin] REQUEST_METHOD: `GET` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:06:11.211474 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6cd860-ebde-42c1-ab05-194245cacb3a None admin] SCRIPT_NAME: `/identity` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:06:11.211753 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6cd860-ebde-42c1-ab05-194245cacb3a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:06:11.222485 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c6cd860-ebde-42c1-ab05-194245cacb3a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 09:06:11.227707 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application [None req-7c6cd860-ebde-42c1-ab05-194245cacb3a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 09:06:11.227707 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 09:06:11.227707 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 09:06:11.227707 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 09:06:11.227707 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 09:06:11.227707 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 09:06:11.227707 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 09:06:11.227707 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 09:06:11.227707 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 09:06:11.227707 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 09:06:11.227707 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 09:06:11.227707 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 09:06:11.227707 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 09:06:11.227707 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 09:06:11.227707 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 09:06:11.227707 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 09:06:11.228722 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 09:06:11.228722 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 09:06:11.228722 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 09:06:11.228722 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 09:06:11.228722 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 09:06:11.228722 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 09:06:11.228722 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 09:06:11.228722 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 09:06:11.228722 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 09:06:11.228722 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 09:06:11.228722 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 09:06:11.228722 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application with Lock( Jul 28 09:06:11.228722 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 09:06:11.228722 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self._enter() Jul 28 09:06:11.228722 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 09:06:11.228722 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 09:06:11.229634 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 09:06:11.229634 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self.creator() Jul 28 09:06:11.229634 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 09:06:11.229634 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application created_value = creator( Jul 28 09:06:11.229634 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 09:06:11.229634 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 09:06:11.229634 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 09:06:11.229634 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 09:06:11.229634 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 09:06:11.229634 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 09:06:11.229634 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 09:06:11.229634 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application Jul 28 09:06:11.229634 dv-cinder-851351-1-smb devstack@keystone.service[416293]: [pid: 416293|app: 0|req: 216/445] 10.222.0.42 () {56 vars in 1096 bytes} [Thu Jul 28 09:06:11 2022] GET /identity/v3/roles/admin => generated 83 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 09:06:11.231031 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6cd860-ebde-42c1-ab05-194245cacb3a None admin] Authenticating user token {{(pid=416293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:06:11.242855 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG dbcounter [-] [416293] Writing DB stats keystone:SELECT=100 {{(pid=416293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:06:11.251922 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d5fe804-5e88-44d8-82df-e8692f2ca149 None admin] Validating token access rules against request {{(pid=416294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:06:11.259632 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG dbcounter [-] [416294] Writing DB stats keystone:SELECT=100 {{(pid=416294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:06:11.291491 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bbfd035-b412-4950-8edd-69590ad4ccf9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:06:11.292150 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbfd035-b412-4950-8edd-69590ad4ccf9 None admin] REQUEST_METHOD: `GET` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:06:11.292436 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbfd035-b412-4950-8edd-69590ad4ccf9 None admin] SCRIPT_NAME: `/identity` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:06:11.292752 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbfd035-b412-4950-8edd-69590ad4ccf9 None admin] PATH_INFO: `/v3/projects/5c46e2ed162f45cabaf6f30752f915a4` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:06:11.293956 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bbfd035-b412-4950-8edd-69590ad4ccf9 None admin] RBAC: Authorizing `identity:get_project(project_id=5c46e2ed162f45cabaf6f30752f915a4)` {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:06:11.295416 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bbfd035-b412-4950-8edd-69590ad4ccf9 None admin] RBAC: Authorization granted {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:06:11.297181 dv-cinder-851351-1-smb devstack@keystone.service[416294]: [pid: 416294|app: 0|req: 230/446] 10.222.0.42 () {56 vars in 1186 bytes} [Thu Jul 28 09:06:11 2022] GET /identity/v3/projects/5c46e2ed162f45cabaf6f30752f915a4 => generated 302 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:06:11.297959 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bbfd035-b412-4950-8edd-69590ad4ccf9 None admin] Authenticating user token {{(pid=416294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:06:11.338862 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6cd860-ebde-42c1-ab05-194245cacb3a None admin] Validating token access rules against request {{(pid=416293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:06:11.381200 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e268e3af-3346-4bd0-a6f9-9674db7c630e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:06:11.381971 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e268e3af-3346-4bd0-a6f9-9674db7c630e None admin] REQUEST_METHOD: `GET` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:06:11.382312 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e268e3af-3346-4bd0-a6f9-9674db7c630e None admin] SCRIPT_NAME: `/identity` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:06:11.382619 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e268e3af-3346-4bd0-a6f9-9674db7c630e None admin] PATH_INFO: `/v3/groups/7f607738424745bf955f57e2c8966ff8` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:06:11.383939 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e268e3af-3346-4bd0-a6f9-9674db7c630e None admin] RBAC: Authorizing `identity:get_group(group_id=7f607738424745bf955f57e2c8966ff8)` {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:06:11.385465 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e268e3af-3346-4bd0-a6f9-9674db7c630e None admin] RBAC: Authorization granted {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:06:11.387121 dv-cinder-851351-1-smb devstack@keystone.service[416293]: [pid: 416293|app: 0|req: 217/447] 10.222.0.42 () {56 vars in 1180 bytes} [Thu Jul 28 09:06:11 2022] GET /identity/v3/groups/7f607738424745bf955f57e2c8966ff8 => generated 226 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:06:11.388021 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e268e3af-3346-4bd0-a6f9-9674db7c630e None admin] Authenticating user token {{(pid=416293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:06:11.414004 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bbfd035-b412-4950-8edd-69590ad4ccf9 None admin] Validating token access rules against request {{(pid=416294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:06:11.449040 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f0f9f6-644b-4be2-92a7-1a2f9495a2de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:06:11.449677 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f0f9f6-644b-4be2-92a7-1a2f9495a2de None admin] REQUEST_METHOD: `GET` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:06:11.449960 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f0f9f6-644b-4be2-92a7-1a2f9495a2de None admin] SCRIPT_NAME: `/identity` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:06:11.450238 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f0f9f6-644b-4be2-92a7-1a2f9495a2de None admin] PATH_INFO: `/v3/roles` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:06:11.450967 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17f0f9f6-644b-4be2-92a7-1a2f9495a2de None admin] RBAC: Adding query filter params (name=admin) {{(pid=416294) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 09:06:11.451274 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17f0f9f6-644b-4be2-92a7-1a2f9495a2de None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:06:11.452657 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17f0f9f6-644b-4be2-92a7-1a2f9495a2de None admin] RBAC: Authorization granted {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:06:11.461420 dv-cinder-851351-1-smb devstack@keystone.service[416294]: [pid: 416294|app: 0|req: 231/448] 10.222.0.42 () {56 vars in 1099 bytes} [Thu Jul 28 09:06:11 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:06:11.462495 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f0f9f6-644b-4be2-92a7-1a2f9495a2de None admin] Authenticating user token {{(pid=416294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:06:11.480432 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG dbcounter [-] [416293] Writing DB stats keystone:SELECT=100 {{(pid=416293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:06:11.500291 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG dbcounter [-] [416294] Writing DB stats keystone:SELECT=100 {{(pid=416294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:06:11.504141 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e268e3af-3346-4bd0-a6f9-9674db7c630e None admin] Validating token access rules against request {{(pid=416293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:06:11.539005 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a169d3cb-72d4-4845-9cd9-477a608b7cb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:06:11.539655 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a169d3cb-72d4-4845-9cd9-477a608b7cb4 None admin] REQUEST_METHOD: `GET` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:06:11.539936 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a169d3cb-72d4-4845-9cd9-477a608b7cb4 None admin] SCRIPT_NAME: `/identity` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:06:11.540210 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a169d3cb-72d4-4845-9cd9-477a608b7cb4 None admin] PATH_INFO: `/v3/groups/7f607738424745bf955f57e2c8966ff8` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:06:11.541428 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a169d3cb-72d4-4845-9cd9-477a608b7cb4 None admin] RBAC: Authorizing `identity:get_group(group_id=7f607738424745bf955f57e2c8966ff8)` {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:06:11.542862 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a169d3cb-72d4-4845-9cd9-477a608b7cb4 None admin] RBAC: Authorization granted {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:06:11.544480 dv-cinder-851351-1-smb devstack@keystone.service[416293]: [pid: 416293|app: 0|req: 218/449] 10.222.0.42 () {56 vars in 1180 bytes} [Thu Jul 28 09:06:11 2022] GET /identity/v3/groups/7f607738424745bf955f57e2c8966ff8 => generated 226 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:06:11.545284 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a169d3cb-72d4-4845-9cd9-477a608b7cb4 None admin] Authenticating user token {{(pid=416293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:06:11.573145 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f0f9f6-644b-4be2-92a7-1a2f9495a2de None admin] Validating token access rules against request {{(pid=416294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:06:11.608815 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58bfcdb9-16de-49bd-9b18-381c6759f272 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:06:11.609359 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58bfcdb9-16de-49bd-9b18-381c6759f272 None admin] REQUEST_METHOD: `GET` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:06:11.609662 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58bfcdb9-16de-49bd-9b18-381c6759f272 None admin] SCRIPT_NAME: `/identity` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:06:11.609931 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58bfcdb9-16de-49bd-9b18-381c6759f272 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:06:11.610729 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58bfcdb9-16de-49bd-9b18-381c6759f272 None admin] RBAC: Adding query filter params (group.id=7f607738424745bf955f57e2c8966ff8, role.id=ba1a79dc27074d5a94dce2d994019d37, scope.project.id=5c46e2ed162f45cabaf6f30752f915a4) {{(pid=416294) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 09:06:11.611033 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58bfcdb9-16de-49bd-9b18-381c6759f272 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:06:11.612583 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58bfcdb9-16de-49bd-9b18-381c6759f272 None admin] RBAC: Authorization granted {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:06:11.618624 dv-cinder-851351-1-smb devstack@keystone.service[416294]: [pid: 416294|app: 0|req: 232/450] 10.222.0.42 () {56 vars in 1376 bytes} [Thu Jul 28 09:06:11 2022] GET /identity/v3/role_assignments?group.id=7f607738424745bf955f57e2c8966ff8&scope.project.id=5c46e2ed162f45cabaf6f30752f915a4&role.id=ba1a79dc27074d5a94dce2d994019d37 => generated 611 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:06:11.628989 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58bfcdb9-16de-49bd-9b18-381c6759f272 None admin] Authenticating user token {{(pid=416294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:06:11.660725 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a169d3cb-72d4-4845-9cd9-477a608b7cb4 None admin] Validating token access rules against request {{(pid=416293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:06:11.702695 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c8d85c8-8c27-43fe-8088-f19cdb37d6bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:06:11.703346 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8d85c8-8c27-43fe-8088-f19cdb37d6bb None admin] REQUEST_METHOD: `GET` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:06:11.703641 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8d85c8-8c27-43fe-8088-f19cdb37d6bb None admin] SCRIPT_NAME: `/identity` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:06:11.703920 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8d85c8-8c27-43fe-8088-f19cdb37d6bb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:06:11.722402 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG dbcounter [-] [416293] Writing DB stats keystone:SELECT=100 {{(pid=416293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:06:11.749650 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG dbcounter [-] [416294] Writing DB stats keystone:SELECT=100 {{(pid=416294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:06:11.753639 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58bfcdb9-16de-49bd-9b18-381c6759f272 None admin] Validating token access rules against request {{(pid=416294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:06:11.788657 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c8d85c8-8c27-43fe-8088-f19cdb37d6bb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:06:11.790215 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c8d85c8-8c27-43fe-8088-f19cdb37d6bb None admin] RBAC: Authorization granted {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:06:11.797779 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13361728-8351-428d-b257-8e0d6071d0c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:06:11.798431 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13361728-8351-428d-b257-8e0d6071d0c3 None admin] REQUEST_METHOD: `GET` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:06:11.798712 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13361728-8351-428d-b257-8e0d6071d0c3 None admin] SCRIPT_NAME: `/identity` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:06:11.799547 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13361728-8351-428d-b257-8e0d6071d0c3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:06:11.800705 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13361728-8351-428d-b257-8e0d6071d0c3 None admin] RBAC: Adding query filter params (group.id=7f607738424745bf955f57e2c8966ff8, role.id=6194848862704a289bbaa3fda43a9050, scope.project.id=5c46e2ed162f45cabaf6f30752f915a4) {{(pid=416294) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 09:06:11.800705 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13361728-8351-428d-b257-8e0d6071d0c3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:06:11.801895 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13361728-8351-428d-b257-8e0d6071d0c3 None admin] RBAC: Authorization granted {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:06:11.809031 dv-cinder-851351-1-smb devstack@keystone.service[416294]: [pid: 416294|app: 0|req: 233/451] 10.222.0.42 () {56 vars in 1376 bytes} [Thu Jul 28 09:06:11 2022] GET /identity/v3/role_assignments?group.id=7f607738424745bf955f57e2c8966ff8&scope.project.id=5c46e2ed162f45cabaf6f30752f915a4&role.id=6194848862704a289bbaa3fda43a9050 => generated 611 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:06:11.915968 dv-cinder-851351-1-smb devstack@keystone.service[416293]: [pid: 416293|app: 0|req: 219/452] 10.222.0.42 () {58 vars in 1282 bytes} [Thu Jul 28 09:06:11 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 371 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 28 09:06:11.922328 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13361728-8351-428d-b257-8e0d6071d0c3 None admin] Authenticating user token {{(pid=416294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:06:12.046377 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13361728-8351-428d-b257-8e0d6071d0c3 None admin] Validating token access rules against request {{(pid=416294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:06:12.082817 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e245ba5c-fd02-4c33-b9b3-9b1dcff3856a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:06:12.083486 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e245ba5c-fd02-4c33-b9b3-9b1dcff3856a None admin] REQUEST_METHOD: `GET` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:06:12.083772 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e245ba5c-fd02-4c33-b9b3-9b1dcff3856a None admin] SCRIPT_NAME: `/identity` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:06:12.084052 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e245ba5c-fd02-4c33-b9b3-9b1dcff3856a None admin] PATH_INFO: `/v3/projects/0b5d78d12a0c4dfdbf387a60d6572e81` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:06:12.085290 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e245ba5c-fd02-4c33-b9b3-9b1dcff3856a None admin] RBAC: Authorizing `identity:get_project(project_id=0b5d78d12a0c4dfdbf387a60d6572e81)` {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:06:12.086773 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e245ba5c-fd02-4c33-b9b3-9b1dcff3856a None admin] RBAC: Authorization granted {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:06:12.088510 dv-cinder-851351-1-smb devstack@keystone.service[416294]: [pid: 416294|app: 0|req: 234/453] 10.222.0.42 () {56 vars in 1186 bytes} [Thu Jul 28 09:06:11 2022] GET /identity/v3/projects/0b5d78d12a0c4dfdbf387a60d6572e81 => generated 344 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:06:12.094275 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c8d85c8-8c27-43fe-8088-f19cdb37d6bb None admin] Authenticating user token {{(pid=416293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:06:12.145259 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG dbcounter [-] [416293] Writing DB stats keystone:SELECT=100 {{(pid=416293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:06:12.203524 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c8d85c8-8c27-43fe-8088-f19cdb37d6bb None admin] Validating token access rules against request {{(pid=416293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:06:12.239454 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c03d1d6-22a7-4ac9-90bf-2391d2bacc00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:06:12.240554 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c03d1d6-22a7-4ac9-90bf-2391d2bacc00 None admin] REQUEST_METHOD: `GET` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:06:12.240981 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c03d1d6-22a7-4ac9-90bf-2391d2bacc00 None admin] SCRIPT_NAME: `/identity` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:06:12.241263 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c03d1d6-22a7-4ac9-90bf-2391d2bacc00 None admin] PATH_INFO: `/v3/groups/cd980c6f6d8c4ac99e1a021d719db0c2` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:06:12.242854 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c03d1d6-22a7-4ac9-90bf-2391d2bacc00 None admin] RBAC: Authorizing `identity:get_group(group_id=cd980c6f6d8c4ac99e1a021d719db0c2)` {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:06:12.245424 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c03d1d6-22a7-4ac9-90bf-2391d2bacc00 None admin] RBAC: Authorization granted {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:06:12.248757 dv-cinder-851351-1-smb devstack@keystone.service[416293]: [pid: 416293|app: 0|req: 220/454] 10.222.0.42 () {56 vars in 1180 bytes} [Thu Jul 28 09:06:12 2022] GET /identity/v3/groups/cd980c6f6d8c4ac99e1a021d719db0c2 => generated 229 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:06:12.255108 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e245ba5c-fd02-4c33-b9b3-9b1dcff3856a None admin] Authenticating user token {{(pid=416294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:06:12.289013 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG dbcounter [-] [416294] Writing DB stats keystone:SELECT=100 {{(pid=416294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:06:12.360476 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e245ba5c-fd02-4c33-b9b3-9b1dcff3856a None admin] Validating token access rules against request {{(pid=416294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:06:12.395508 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69580b1b-2d03-449d-a44d-b15ae45b230c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:06:12.396131 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69580b1b-2d03-449d-a44d-b15ae45b230c None admin] REQUEST_METHOD: `GET` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:06:12.396411 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69580b1b-2d03-449d-a44d-b15ae45b230c None admin] SCRIPT_NAME: `/identity` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:06:12.396688 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69580b1b-2d03-449d-a44d-b15ae45b230c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:06:12.397489 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69580b1b-2d03-449d-a44d-b15ae45b230c None admin] RBAC: Adding query filter params (group.id=cd980c6f6d8c4ac99e1a021d719db0c2, role.id=c67085ec338243df8f9b7d6459036e23, scope.project.id=0b5d78d12a0c4dfdbf387a60d6572e81) {{(pid=416294) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 09:06:12.397809 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69580b1b-2d03-449d-a44d-b15ae45b230c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:06:12.399253 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69580b1b-2d03-449d-a44d-b15ae45b230c None admin] RBAC: Authorization granted {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:06:12.405305 dv-cinder-851351-1-smb devstack@keystone.service[416294]: [pid: 416294|app: 0|req: 235/455] 10.222.0.42 () {56 vars in 1376 bytes} [Thu Jul 28 09:06:12 2022] GET /identity/v3/role_assignments?group.id=cd980c6f6d8c4ac99e1a021d719db0c2&scope.project.id=0b5d78d12a0c4dfdbf387a60d6572e81&role.id=c67085ec338243df8f9b7d6459036e23 => generated 611 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:06:14.798059 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f92f14b-8125-4c80-ab30-378c83b109e5 None None] REQUEST_METHOD: `GET` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:06:14.798605 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f92f14b-8125-4c80-ab30-378c83b109e5 None None] SCRIPT_NAME: `/identity` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:06:14.798605 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f92f14b-8125-4c80-ab30-378c83b109e5 None None] PATH_INFO: `/` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:06:14.800600 dv-cinder-851351-1-smb devstack@keystone.service[416293]: [pid: 416293|app: 0|req: 221/456] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 09:06:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 09:06:14.818448 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6109c4-5840-47c0-bdb3-ec21aaa84b35 None None] REQUEST_METHOD: `POST` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:06:14.819405 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6109c4-5840-47c0-bdb3-ec21aaa84b35 None None] SCRIPT_NAME: `/identity` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:06:14.819896 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6109c4-5840-47c0-bdb3-ec21aaa84b35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:06:14.849677 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.auth.core [None req-ed6109c4-5840-47c0-bdb3-ec21aaa84b35 None None] MFA Rules not processed for user `dbf87abab90e4fdf9e75408f4199918e`. Rule list: `[]` (Enabled: `True`). {{(pid=416294) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 09:06:14.851312 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.fernet_utils [None req-ed6109c4-5840-47c0-bdb3-ec21aaa84b35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=416294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 09:06:14.953942 dv-cinder-851351-1-smb devstack@keystone.service[416294]: [pid: 416294|app: 0|req: 236/457] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 09:06:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 28 09:06:14.994880 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f92f14b-8125-4c80-ab30-378c83b109e5 None None] Authenticating user token {{(pid=416293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:06:15.141747 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f92f14b-8125-4c80-ab30-378c83b109e5 None None] Validating token access rules against request {{(pid=416293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:06:15.167843 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG dbcounter [-] [416293] Writing DB stats keystone:SELECT=100 {{(pid=416293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:06:15.194907 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e03e3c8-d377-46cc-94cb-631a7b96052e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:06:15.195586 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e03e3c8-d377-46cc-94cb-631a7b96052e None admin] REQUEST_METHOD: `GET` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:06:15.195872 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e03e3c8-d377-46cc-94cb-631a7b96052e None admin] SCRIPT_NAME: `/identity` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:06:15.196151 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e03e3c8-d377-46cc-94cb-631a7b96052e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:06:15.212616 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e03e3c8-d377-46cc-94cb-631a7b96052e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:06:15.214125 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e03e3c8-d377-46cc-94cb-631a7b96052e None admin] RBAC: Authorization granted {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:06:15.233068 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application [None req-5e03e3c8-d377-46cc-94cb-631a7b96052e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 09:06:15.233068 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 09:06:15.233068 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 09:06:15.233068 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 09:06:15.233068 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 09:06:15.233068 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 09:06:15.233068 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 09:06:15.233068 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 09:06:15.233068 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 09:06:15.233068 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 09:06:15.233068 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 09:06:15.233068 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 09:06:15.233068 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 09:06:15.233068 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 09:06:15.233068 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 09:06:15.234061 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 09:06:15.234061 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 09:06:15.234061 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 09:06:15.234061 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 09:06:15.234061 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 09:06:15.234061 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 09:06:15.234061 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 09:06:15.234061 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 09:06:15.234061 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application with Lock( Jul 28 09:06:15.234061 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 09:06:15.234061 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self._enter() Jul 28 09:06:15.234061 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 09:06:15.234061 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 09:06:15.234061 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 09:06:15.234061 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self.creator() Jul 28 09:06:15.234061 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 09:06:15.234061 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application created_value = creator( Jul 28 09:06:15.234987 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 09:06:15.234987 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 09:06:15.234987 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 09:06:15.234987 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application Jul 28 09:06:15.234987 dv-cinder-851351-1-smb devstack@keystone.service[416293]: [pid: 416293|app: 0|req: 222/458] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 09:06:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 09:06:15.242544 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6109c4-5840-47c0-bdb3-ec21aaa84b35 None None] Authenticating user token {{(pid=416294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:06:15.283793 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6c8940-3571-4964-9d03-92a946d48617 None None] REQUEST_METHOD: `GET` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:06:15.284168 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6c8940-3571-4964-9d03-92a946d48617 None None] SCRIPT_NAME: `/identity` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:06:15.284358 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6c8940-3571-4964-9d03-92a946d48617 None None] PATH_INFO: `/` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:06:15.286580 dv-cinder-851351-1-smb devstack@keystone.service[416293]: [pid: 416293|app: 0|req: 223/459] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 09:06:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 28 09:06:15.297515 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914e11b9-8666-4f7d-a42e-e2fe75098912 None None] REQUEST_METHOD: `POST` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:06:15.297869 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914e11b9-8666-4f7d-a42e-e2fe75098912 None None] SCRIPT_NAME: `/identity` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:06:15.298079 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914e11b9-8666-4f7d-a42e-e2fe75098912 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:06:15.301861 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG dbcounter [-] [416294] Writing DB stats keystone:SELECT=100 {{(pid=416294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:06:15.321153 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.auth.core [None req-914e11b9-8666-4f7d-a42e-e2fe75098912 None None] MFA Rules not processed for user `dbf87abab90e4fdf9e75408f4199918e`. Rule list: `[]` (Enabled: `True`). {{(pid=416293) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 09:06:15.322396 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.fernet_utils [None req-914e11b9-8666-4f7d-a42e-e2fe75098912 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=416293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 09:06:15.417984 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6109c4-5840-47c0-bdb3-ec21aaa84b35 None None] Validating token access rules against request {{(pid=416294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:06:15.424783 dv-cinder-851351-1-smb devstack@keystone.service[416293]: [pid: 416293|app: 0|req: 224/460] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 09:06:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 28 09:06:15.426231 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485ba150-a090-4eb4-9f79-f63ac79a31a8 None None] REQUEST_METHOD: `GET` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:06:15.426536 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485ba150-a090-4eb4-9f79-f63ac79a31a8 None None] SCRIPT_NAME: `/identity` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:06:15.426819 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485ba150-a090-4eb4-9f79-f63ac79a31a8 None None] PATH_INFO: `/` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:06:15.430465 dv-cinder-851351-1-smb devstack@keystone.service[416293]: [pid: 416293|app: 0|req: 225/461] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 09:06:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 09:06:15.434570 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80fe2f47-dd41-49f3-a179-d92a0090b18c None None] REQUEST_METHOD: `POST` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:06:15.434865 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80fe2f47-dd41-49f3-a179-d92a0090b18c None None] SCRIPT_NAME: `/identity` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:06:15.435150 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80fe2f47-dd41-49f3-a179-d92a0090b18c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:06:15.464187 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.auth.core [None req-80fe2f47-dd41-49f3-a179-d92a0090b18c None None] MFA Rules not processed for user `dbf87abab90e4fdf9e75408f4199918e`. Rule list: `[]` (Enabled: `True`). {{(pid=416293) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 09:06:15.465409 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.fernet_utils [None req-80fe2f47-dd41-49f3-a179-d92a0090b18c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=416293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 09:06:15.465560 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3253df2-5acb-4e21-84d5-b6e56b67a03c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:06:15.466292 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3253df2-5acb-4e21-84d5-b6e56b67a03c None admin] REQUEST_METHOD: `GET` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:06:15.466681 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3253df2-5acb-4e21-84d5-b6e56b67a03c None admin] SCRIPT_NAME: `/identity` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:06:15.467062 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3253df2-5acb-4e21-84d5-b6e56b67a03c None admin] PATH_INFO: `/v3/domains` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:06:15.467886 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3253df2-5acb-4e21-84d5-b6e56b67a03c None admin] RBAC: Adding query filter params (name=Default) {{(pid=416294) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 09:06:15.468297 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3253df2-5acb-4e21-84d5-b6e56b67a03c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:06:15.469809 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3253df2-5acb-4e21-84d5-b6e56b67a03c None admin] RBAC: Authorization granted {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:06:15.482531 dv-cinder-851351-1-smb devstack@keystone.service[416294]: [pid: 416294|app: 0|req: 237/462] 10.222.0.42 () {56 vars in 1109 bytes} [Thu Jul 28 09:06:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:06:15.483487 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3253df2-5acb-4e21-84d5-b6e56b67a03c None admin] Authenticating user token {{(pid=416294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:06:15.553823 dv-cinder-851351-1-smb devstack@keystone.service[416293]: [pid: 416293|app: 0|req: 226/463] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 09:06:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 09:06:15.554950 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80fe2f47-dd41-49f3-a179-d92a0090b18c None None] Authenticating user token {{(pid=416293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:06:15.586362 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG dbcounter [-] [416293] Writing DB stats keystone:SELECT=100 {{(pid=416293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:06:15.596646 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG dbcounter [-] [416294] Writing DB stats keystone:SELECT=100 {{(pid=416294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:06:15.613035 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3253df2-5acb-4e21-84d5-b6e56b67a03c None admin] Validating token access rules against request {{(pid=416294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:06:15.649301 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e81043-1067-4c26-ada6-79927fb3be9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:06:15.649972 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e81043-1067-4c26-ada6-79927fb3be9d None admin] REQUEST_METHOD: `GET` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:06:15.650261 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e81043-1067-4c26-ada6-79927fb3be9d None admin] SCRIPT_NAME: `/identity` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:06:15.650545 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e81043-1067-4c26-ada6-79927fb3be9d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:06:15.662597 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16e81043-1067-4c26-ada6-79927fb3be9d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:06:15.664092 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16e81043-1067-4c26-ada6-79927fb3be9d None admin] RBAC: Authorization granted {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:06:15.664896 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80fe2f47-dd41-49f3-a179-d92a0090b18c None None] Validating token access rules against request {{(pid=416293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:06:15.679828 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application [None req-16e81043-1067-4c26-ada6-79927fb3be9d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 09:06:15.679828 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 09:06:15.679828 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 09:06:15.679828 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 09:06:15.679828 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 09:06:15.679828 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 09:06:15.679828 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 09:06:15.679828 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 09:06:15.679828 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 09:06:15.679828 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 09:06:15.679828 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 09:06:15.679828 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 09:06:15.679828 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 09:06:15.679828 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 09:06:15.679828 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 09:06:15.680795 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 09:06:15.680795 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 09:06:15.680795 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 09:06:15.680795 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 09:06:15.680795 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 09:06:15.680795 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 09:06:15.680795 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 09:06:15.680795 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 09:06:15.680795 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application with Lock( Jul 28 09:06:15.680795 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 09:06:15.680795 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return self._enter() Jul 28 09:06:15.680795 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 09:06:15.680795 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 09:06:15.680795 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 09:06:15.680795 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return self.creator() Jul 28 09:06:15.680795 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 09:06:15.680795 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application created_value = creator( Jul 28 09:06:15.681742 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 09:06:15.681742 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 09:06:15.681742 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 09:06:15.681742 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application Jul 28 09:06:15.681742 dv-cinder-851351-1-smb devstack@keystone.service[416294]: [pid: 416294|app: 0|req: 238/464] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 09:06:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 09:06:15.682563 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9e9e33-6b65-4166-8a1c-76dcd17ee616 None None] REQUEST_METHOD: `GET` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:06:15.682563 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9e9e33-6b65-4166-8a1c-76dcd17ee616 None None] SCRIPT_NAME: `/identity` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:06:15.682821 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9e9e33-6b65-4166-8a1c-76dcd17ee616 None None] PATH_INFO: `/` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:06:15.688226 dv-cinder-851351-1-smb devstack@keystone.service[416294]: [pid: 416294|app: 0|req: 239/465] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 09:06:15 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 09:06:15.689035 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9e9e33-6b65-4166-8a1c-76dcd17ee616 None None] Authenticating user token {{(pid=416294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:06:15.707059 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569ad402-a316-4a31-91f2-a8d23fbefe62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:06:15.707697 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569ad402-a316-4a31-91f2-a8d23fbefe62 None admin] REQUEST_METHOD: `POST` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:06:15.707984 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569ad402-a316-4a31-91f2-a8d23fbefe62 None admin] SCRIPT_NAME: `/identity` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:06:15.708257 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569ad402-a316-4a31-91f2-a8d23fbefe62 None admin] PATH_INFO: `/v3/users` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:06:15.708988 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-569ad402-a316-4a31-91f2-a8d23fbefe62 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:06:15.710447 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-569ad402-a316-4a31-91f2-a8d23fbefe62 None admin] RBAC: Authorization granted {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:06:15.732032 dv-cinder-851351-1-smb devstack@keystone.service[416293]: [pid: 416293|app: 0|req: 227/466] 10.222.0.42 () {60 vars in 1132 bytes} [Thu Jul 28 09:06:15 2022] POST /identity/v3/users => generated 246 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 09:06:15.733075 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569ad402-a316-4a31-91f2-a8d23fbefe62 None admin] Authenticating user token {{(pid=416293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:06:15.826372 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9e9e33-6b65-4166-8a1c-76dcd17ee616 None None] Validating token access rules against request {{(pid=416294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:06:15.848613 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG dbcounter [-] [416293] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=416293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:06:15.873985 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf7a9666-a5ca-44dc-a258-f168ae4620ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:06:15.874672 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7a9666-a5ca-44dc-a258-f168ae4620ab None admin] REQUEST_METHOD: `GET` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:06:15.874964 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7a9666-a5ca-44dc-a258-f168ae4620ab None admin] SCRIPT_NAME: `/identity` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:06:15.875240 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7a9666-a5ca-44dc-a258-f168ae4620ab None admin] PATH_INFO: `/v3/domains/Default` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:06:15.880790 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569ad402-a316-4a31-91f2-a8d23fbefe62 None admin] Validating token access rules against request {{(pid=416293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:06:15.884895 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG dbcounter [-] [416294] Writing DB stats keystone:SELECT=100 {{(pid=416294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:06:15.890880 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf7a9666-a5ca-44dc-a258-f168ae4620ab None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:06:15.893155 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf7a9666-a5ca-44dc-a258-f168ae4620ab None admin] RBAC: Authorization granted {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:06:15.911660 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application [None req-cf7a9666-a5ca-44dc-a258-f168ae4620ab None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 09:06:15.911660 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 09:06:15.911660 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 09:06:15.911660 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 09:06:15.911660 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 09:06:15.911660 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 09:06:15.911660 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 09:06:15.911660 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 09:06:15.911660 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 09:06:15.911660 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 09:06:15.911660 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 09:06:15.911660 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 09:06:15.911660 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 09:06:15.911660 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 09:06:15.911660 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 09:06:15.912701 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 09:06:15.912701 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 09:06:15.912701 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 09:06:15.912701 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 09:06:15.912701 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 09:06:15.912701 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 09:06:15.912701 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 09:06:15.912701 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 09:06:15.912701 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application with Lock( Jul 28 09:06:15.912701 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 09:06:15.912701 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return self._enter() Jul 28 09:06:15.912701 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 09:06:15.912701 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 09:06:15.912701 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 09:06:15.912701 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return self.creator() Jul 28 09:06:15.912701 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 09:06:15.912701 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application created_value = creator( Jul 28 09:06:15.913633 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 09:06:15.913633 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 09:06:15.913633 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 09:06:15.913633 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application Jul 28 09:06:15.918265 dv-cinder-851351-1-smb devstack@keystone.service[416294]: [pid: 416294|app: 0|req: 240/467] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 09:06:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 09:06:15.919931 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fafe74f-91ed-48d1-afa6-4d1fb37c0b69 None None] REQUEST_METHOD: `POST` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:06:15.920214 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fafe74f-91ed-48d1-afa6-4d1fb37c0b69 None None] SCRIPT_NAME: `/identity` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:06:15.920585 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fafe74f-91ed-48d1-afa6-4d1fb37c0b69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:06:15.922973 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-409e607a-db4b-4966-b394-c652e48276bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:06:15.923626 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409e607a-db4b-4966-b394-c652e48276bc None admin] REQUEST_METHOD: `GET` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:06:15.923964 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409e607a-db4b-4966-b394-c652e48276bc None admin] SCRIPT_NAME: `/identity` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:06:15.924245 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409e607a-db4b-4966-b394-c652e48276bc None admin] PATH_INFO: `/v3/domains` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:06:15.925026 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-409e607a-db4b-4966-b394-c652e48276bc None admin] RBAC: Adding query filter params (name=Default) {{(pid=416293) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 09:06:15.925340 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-409e607a-db4b-4966-b394-c652e48276bc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:06:15.926988 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-409e607a-db4b-4966-b394-c652e48276bc None admin] RBAC: Authorization granted {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:06:15.941360 dv-cinder-851351-1-smb devstack@keystone.service[416293]: [pid: 416293|app: 0|req: 228/468] 10.222.0.42 () {56 vars in 1109 bytes} [Thu Jul 28 09:06:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:06:15.942131 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-409e607a-db4b-4966-b394-c652e48276bc None admin] Authenticating user token {{(pid=416293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:06:15.946417 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.auth.core [None req-0fafe74f-91ed-48d1-afa6-4d1fb37c0b69 None None] MFA Rules not processed for user `dbf87abab90e4fdf9e75408f4199918e`. Rule list: `[]` (Enabled: `True`). {{(pid=416294) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 09:06:15.949141 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.fernet_utils [None req-0fafe74f-91ed-48d1-afa6-4d1fb37c0b69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=416294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 09:06:16.050758 dv-cinder-851351-1-smb devstack@keystone.service[416294]: [pid: 416294|app: 0|req: 241/469] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 09:06:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 09:06:16.057698 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fafe74f-91ed-48d1-afa6-4d1fb37c0b69 None None] Authenticating user token {{(pid=416294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:06:16.091729 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-409e607a-db4b-4966-b394-c652e48276bc None admin] Validating token access rules against request {{(pid=416293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:06:16.141359 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-455b83b4-46a2-4418-be81-95aeff0f9399 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:06:16.142930 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455b83b4-46a2-4418-be81-95aeff0f9399 None admin] REQUEST_METHOD: `GET` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:06:16.143993 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455b83b4-46a2-4418-be81-95aeff0f9399 None admin] SCRIPT_NAME: `/identity` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:06:16.144851 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455b83b4-46a2-4418-be81-95aeff0f9399 None admin] PATH_INFO: `/v3/domains` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:06:16.147003 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-455b83b4-46a2-4418-be81-95aeff0f9399 None admin] RBAC: Adding query filter params (name=Default) {{(pid=416293) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 09:06:16.148021 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-455b83b4-46a2-4418-be81-95aeff0f9399 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:06:16.150327 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-455b83b4-46a2-4418-be81-95aeff0f9399 None admin] RBAC: Authorization granted {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:06:16.166995 dv-cinder-851351-1-smb devstack@keystone.service[416293]: [pid: 416293|app: 0|req: 229/470] 10.222.0.42 () {56 vars in 1109 bytes} [Thu Jul 28 09:06:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:06:16.168065 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-455b83b4-46a2-4418-be81-95aeff0f9399 None admin] Authenticating user token {{(pid=416293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:06:16.171084 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG dbcounter [-] [416293] Writing DB stats keystone:SELECT=100 {{(pid=416293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:06:16.200474 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fafe74f-91ed-48d1-afa6-4d1fb37c0b69 None None] Validating token access rules against request {{(pid=416294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:06:16.230349 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG dbcounter [-] [416294] Writing DB stats keystone:SELECT=100 {{(pid=416294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:06:16.253622 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e8ce80-cbbd-40b0-8574-9b0166c98aa7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:06:16.254257 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e8ce80-cbbd-40b0-8574-9b0166c98aa7 None admin] REQUEST_METHOD: `POST` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:06:16.254541 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e8ce80-cbbd-40b0-8574-9b0166c98aa7 None admin] SCRIPT_NAME: `/identity` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:06:16.254816 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e8ce80-cbbd-40b0-8574-9b0166c98aa7 None admin] PATH_INFO: `/v3/users` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:06:16.255515 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e8ce80-cbbd-40b0-8574-9b0166c98aa7 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:06:16.257057 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e8ce80-cbbd-40b0-8574-9b0166c98aa7 None admin] RBAC: Authorization granted {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:06:16.282430 dv-cinder-851351-1-smb devstack@keystone.service[416294]: [pid: 416294|app: 0|req: 242/471] 10.222.0.42 () {60 vars in 1132 bytes} [Thu Jul 28 09:06:16 2022] POST /identity/v3/users => generated 248 bytes in 231 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 09:06:16.283082 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e8ce80-cbbd-40b0-8574-9b0166c98aa7 None admin] Authenticating user token {{(pid=416294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:06:16.295529 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-455b83b4-46a2-4418-be81-95aeff0f9399 None admin] Validating token access rules against request {{(pid=416293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:06:16.336276 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-212f4aeb-e253-4144-9812-3ae3ce1e5669 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:06:16.337002 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212f4aeb-e253-4144-9812-3ae3ce1e5669 None admin] REQUEST_METHOD: `GET` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:06:16.337329 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212f4aeb-e253-4144-9812-3ae3ce1e5669 None admin] SCRIPT_NAME: `/identity` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:06:16.337623 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212f4aeb-e253-4144-9812-3ae3ce1e5669 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:06:16.352430 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-212f4aeb-e253-4144-9812-3ae3ce1e5669 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:06:16.354148 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-212f4aeb-e253-4144-9812-3ae3ce1e5669 None admin] RBAC: Authorization granted {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:06:16.371248 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application [None req-212f4aeb-e253-4144-9812-3ae3ce1e5669 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 09:06:16.371248 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 09:06:16.371248 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 09:06:16.371248 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 09:06:16.371248 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 09:06:16.371248 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 09:06:16.371248 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 09:06:16.371248 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 09:06:16.371248 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 09:06:16.371248 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 09:06:16.371248 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 09:06:16.371248 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 09:06:16.371248 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 09:06:16.371248 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 09:06:16.371248 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 09:06:16.372241 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 09:06:16.372241 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 09:06:16.372241 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 09:06:16.372241 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 09:06:16.372241 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 09:06:16.372241 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 09:06:16.372241 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 09:06:16.372241 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 09:06:16.372241 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application with Lock( Jul 28 09:06:16.372241 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 09:06:16.372241 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self._enter() Jul 28 09:06:16.372241 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 09:06:16.372241 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 09:06:16.372241 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 09:06:16.372241 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self.creator() Jul 28 09:06:16.372241 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 09:06:16.372241 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application created_value = creator( Jul 28 09:06:16.373245 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 09:06:16.373245 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 09:06:16.373245 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 09:06:16.373245 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application Jul 28 09:06:16.377914 dv-cinder-851351-1-smb devstack@keystone.service[416293]: [pid: 416293|app: 0|req: 230/472] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 09:06:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 09:06:16.379365 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1abb5096-7793-4a35-ad2b-f2e92baa0001 None None] REQUEST_METHOD: `GET` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:06:16.379664 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1abb5096-7793-4a35-ad2b-f2e92baa0001 None None] SCRIPT_NAME: `/identity` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:06:16.379954 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1abb5096-7793-4a35-ad2b-f2e92baa0001 None None] PATH_INFO: `/` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:06:16.385765 dv-cinder-851351-1-smb devstack@keystone.service[416293]: [pid: 416293|app: 0|req: 231/473] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 09:06:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 09:06:16.385765 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1abb5096-7793-4a35-ad2b-f2e92baa0001 None None] Authenticating user token {{(pid=416293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:06:16.429866 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e8ce80-cbbd-40b0-8574-9b0166c98aa7 None admin] Validating token access rules against request {{(pid=416294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:06:16.455463 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG dbcounter [-] [416293] Writing DB stats keystone:SELECT=100 {{(pid=416293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:06:16.479544 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a45c9e58-6178-4776-aec5-8fc2f013142a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:06:16.480569 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45c9e58-6178-4776-aec5-8fc2f013142a None admin] REQUEST_METHOD: `POST` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:06:16.481112 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45c9e58-6178-4776-aec5-8fc2f013142a None admin] SCRIPT_NAME: `/identity` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:06:16.481548 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45c9e58-6178-4776-aec5-8fc2f013142a None admin] PATH_INFO: `/v3/users` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:06:16.482420 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a45c9e58-6178-4776-aec5-8fc2f013142a None admin] RBAC: Authorizing `identity:create_user()` {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:06:16.483954 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a45c9e58-6178-4776-aec5-8fc2f013142a None admin] RBAC: Authorization granted {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:06:16.514773 dv-cinder-851351-1-smb devstack@keystone.service[416294]: [pid: 416294|app: 0|req: 243/474] 10.222.0.42 () {60 vars in 1132 bytes} [Thu Jul 28 09:06:16 2022] POST /identity/v3/users => generated 248 bytes in 232 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 09:06:16.515938 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18d7d69-8b07-4f0b-abc3-bbfbc1823558 None None] REQUEST_METHOD: `POST` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:06:16.516453 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18d7d69-8b07-4f0b-abc3-bbfbc1823558 None None] SCRIPT_NAME: `/identity` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:06:16.516853 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18d7d69-8b07-4f0b-abc3-bbfbc1823558 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:06:16.517936 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1abb5096-7793-4a35-ad2b-f2e92baa0001 None None] Validating token access rules against request {{(pid=416293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:06:16.538986 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.auth.core [None req-b18d7d69-8b07-4f0b-abc3-bbfbc1823558 None None] MFA Rules not processed for user `dbf87abab90e4fdf9e75408f4199918e`. Rule list: `[]` (Enabled: `True`). {{(pid=416294) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 09:06:16.540371 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.fernet_utils [None req-b18d7d69-8b07-4f0b-abc3-bbfbc1823558 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=416294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 09:06:16.564065 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3bbc991-e071-49af-9cd8-778bc8496604 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:06:16.565054 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3bbc991-e071-49af-9cd8-778bc8496604 None admin] REQUEST_METHOD: `GET` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:06:16.565369 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3bbc991-e071-49af-9cd8-778bc8496604 None admin] SCRIPT_NAME: `/identity` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:06:16.565731 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3bbc991-e071-49af-9cd8-778bc8496604 None admin] PATH_INFO: `/v3/domains` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:06:16.566905 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3bbc991-e071-49af-9cd8-778bc8496604 None admin] RBAC: Adding query filter params (name=Default) {{(pid=416293) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 09:06:16.567422 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3bbc991-e071-49af-9cd8-778bc8496604 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:06:16.570148 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3bbc991-e071-49af-9cd8-778bc8496604 None admin] RBAC: Authorization granted {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:06:16.583541 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG dbcounter [-] [416294] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=416294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:06:16.591388 dv-cinder-851351-1-smb devstack@keystone.service[416293]: [pid: 416293|app: 0|req: 232/475] 10.222.0.42 () {56 vars in 1109 bytes} [Thu Jul 28 09:06:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:06:16.598649 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3bbc991-e071-49af-9cd8-778bc8496604 None admin] Authenticating user token {{(pid=416293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:06:16.644795 dv-cinder-851351-1-smb devstack@keystone.service[416294]: [pid: 416294|app: 0|req: 244/476] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 09:06:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 09:06:16.672003 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18d7d69-8b07-4f0b-abc3-bbfbc1823558 None None] Authenticating user token {{(pid=416294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:06:16.773434 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3bbc991-e071-49af-9cd8-778bc8496604 None admin] Validating token access rules against request {{(pid=416293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:06:16.795969 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG dbcounter [-] [416293] Writing DB stats keystone:SELECT=100 {{(pid=416293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:06:16.821943 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50fc5ae-d36f-4aa2-afb0-9b7f024f3fce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:06:16.823100 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50fc5ae-d36f-4aa2-afb0-9b7f024f3fce None admin] REQUEST_METHOD: `POST` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:06:16.824015 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50fc5ae-d36f-4aa2-afb0-9b7f024f3fce None admin] SCRIPT_NAME: `/identity` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:06:16.825781 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50fc5ae-d36f-4aa2-afb0-9b7f024f3fce None admin] PATH_INFO: `/v3/users` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:06:16.826692 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18d7d69-8b07-4f0b-abc3-bbfbc1823558 None None] Validating token access rules against request {{(pid=416294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:06:16.827344 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e50fc5ae-d36f-4aa2-afb0-9b7f024f3fce None admin] RBAC: Authorizing `identity:create_user()` {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:06:16.829299 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e50fc5ae-d36f-4aa2-afb0-9b7f024f3fce None admin] RBAC: Authorization granted {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:06:16.859215 dv-cinder-851351-1-smb devstack@keystone.service[416293]: [pid: 416293|app: 0|req: 233/477] 10.222.0.42 () {60 vars in 1132 bytes} [Thu Jul 28 09:06:16 2022] POST /identity/v3/users => generated 249 bytes in 261 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 09:06:16.870624 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0236880f-9acb-4501-a639-3644d4bbd8c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:06:16.871297 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0236880f-9acb-4501-a639-3644d4bbd8c0 None admin] REQUEST_METHOD: `POST` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:06:16.871581 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0236880f-9acb-4501-a639-3644d4bbd8c0 None admin] SCRIPT_NAME: `/identity` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:06:16.871856 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0236880f-9acb-4501-a639-3644d4bbd8c0 None admin] PATH_INFO: `/v3/roles` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:06:16.872632 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0236880f-9acb-4501-a639-3644d4bbd8c0 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:06:16.874155 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0236880f-9acb-4501-a639-3644d4bbd8c0 None admin] RBAC: Authorization granted {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:06:16.884225 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.sql.core [None req-0236880f-9acb-4501-a639-3644d4bbd8c0 None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jul 28 09:06:16.884225 dv-cinder-851351-1-smb devstack@keystone.service[416294]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Jul 28 09:06:16.884225 dv-cinder-851351-1-smb devstack@keystone.service[416294]: [parameters: {'id': '8cd1792ac71943db828f6b63ad6fc65a', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Jul 28 09:06:16.884225 dv-cinder-851351-1-smb devstack@keystone.service[416294]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=416294) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jul 28 09:06:16.903089 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application [None req-0236880f-9acb-4501-a639-3644d4bbd8c0 None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Jul 28 09:06:16.903089 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 09:06:16.903089 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 28 09:06:16.903089 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 28 09:06:16.903089 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 28 09:06:16.903089 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 28 09:06:16.903089 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 28 09:06:16.903089 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application result = self._query(query) Jul 28 09:06:16.903089 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 28 09:06:16.903089 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application conn.query(q) Jul 28 09:06:16.903089 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 28 09:06:16.903089 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 28 09:06:16.903089 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 28 09:06:16.903089 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application result.read() Jul 28 09:06:16.903089 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 28 09:06:16.904180 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 28 09:06:16.904180 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 28 09:06:16.904180 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 28 09:06:16.904180 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 28 09:06:16.904180 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 28 09:06:16.904180 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 28 09:06:16.904180 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 28 09:06:16.904180 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jul 28 09:06:16.904180 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application Jul 28 09:06:16.904180 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jul 28 09:06:16.904180 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application Jul 28 09:06:16.904180 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 09:06:16.904180 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jul 28 09:06:16.904180 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jul 28 09:06:16.904180 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role Jul 28 09:06:16.904180 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return ref.to_dict() Jul 28 09:06:16.904180 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 28 09:06:16.904180 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application next(self.gen) Jul 28 09:06:16.905313 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jul 28 09:06:16.905313 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application yield resource Jul 28 09:06:16.905313 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 28 09:06:16.905313 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application next(self.gen) Jul 28 09:06:16.905313 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jul 28 09:06:16.905313 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application self.session.rollback() Jul 28 09:06:16.905313 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 28 09:06:16.905313 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application self.force_reraise() Jul 28 09:06:16.905313 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 28 09:06:16.905313 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application raise self.value Jul 28 09:06:16.905313 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jul 28 09:06:16.905313 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jul 28 09:06:16.905313 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jul 28 09:06:16.905313 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application session.commit() Jul 28 09:06:16.905313 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jul 28 09:06:16.905313 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jul 28 09:06:16.905313 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jul 28 09:06:16.906294 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application self._prepare_impl() Jul 28 09:06:16.906294 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jul 28 09:06:16.906294 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application self.session.flush() Jul 28 09:06:16.906294 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jul 28 09:06:16.906294 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application self._flush(objects) Jul 28 09:06:16.906294 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jul 28 09:06:16.906294 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jul 28 09:06:16.906294 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jul 28 09:06:16.906294 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application compat.raise_( Jul 28 09:06:16.906294 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 28 09:06:16.906294 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application raise exception Jul 28 09:06:16.906294 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jul 28 09:06:16.906294 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application flush_context.execute() Jul 28 09:06:16.906294 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jul 28 09:06:16.906294 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application rec.execute(self) Jul 28 09:06:16.906294 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jul 28 09:06:16.906294 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jul 28 09:06:16.907297 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jul 28 09:06:16.907297 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application _emit_insert_statements( Jul 28 09:06:16.907297 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Jul 28 09:06:16.907297 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application c = connection._execute_20( Jul 28 09:06:16.907297 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jul 28 09:06:16.907297 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jul 28 09:06:16.907297 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Jul 28 09:06:16.907297 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jul 28 09:06:16.907297 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jul 28 09:06:16.907297 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application ret = self._execute_context( Jul 28 09:06:16.907297 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jul 28 09:06:16.907297 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jul 28 09:06:16.907297 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jul 28 09:06:16.907297 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jul 28 09:06:16.907297 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 28 09:06:16.907297 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application raise exception Jul 28 09:06:16.908342 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 28 09:06:16.908342 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 28 09:06:16.908342 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 28 09:06:16.908342 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 28 09:06:16.908342 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 28 09:06:16.908342 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application result = self._query(query) Jul 28 09:06:16.908342 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 28 09:06:16.908342 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application conn.query(q) Jul 28 09:06:16.908342 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 28 09:06:16.908342 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 28 09:06:16.908342 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 28 09:06:16.908342 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application result.read() Jul 28 09:06:16.908342 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 28 09:06:16.908342 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 28 09:06:16.908342 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 28 09:06:16.908342 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 28 09:06:16.910999 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 28 09:06:16.910999 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 28 09:06:16.910999 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 28 09:06:16.910999 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 28 09:06:16.910999 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jul 28 09:06:16.910999 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Jul 28 09:06:16.910999 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application [parameters: {'id': '8cd1792ac71943db828f6b63ad6fc65a', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Jul 28 09:06:16.910999 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jul 28 09:06:16.910999 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application Jul 28 09:06:16.910999 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 28 09:06:16.910999 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application Jul 28 09:06:16.910999 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 09:06:16.910999 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 09:06:16.910999 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 09:06:16.910999 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 09:06:16.910999 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 09:06:16.913120 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 09:06:16.913120 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 09:06:16.913120 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 09:06:16.913120 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 09:06:16.913120 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 09:06:16.913120 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 09:06:16.913120 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post Jul 28 09:06:16.913120 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( Jul 28 09:06:16.913120 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 09:06:16.913120 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 09:06:16.913120 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role Jul 28 09:06:16.913120 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) Jul 28 09:06:16.913120 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jul 28 09:06:16.913120 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jul 28 09:06:16.913120 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Jul 28 09:06:16.913120 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application Jul 28 09:06:16.917455 dv-cinder-851351-1-smb devstack@keystone.service[416294]: [pid: 416294|app: 0|req: 245/478] 10.222.0.42 () {60 vars in 1131 bytes} [Thu Jul 28 09:06:16 2022] POST /identity/v3/roles => generated 144 bytes in 234 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Jul 28 09:06:16.917601 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50fc5ae-d36f-4aa2-afb0-9b7f024f3fce None admin] Authenticating user token {{(pid=416293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:06:17.039336 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50fc5ae-d36f-4aa2-afb0-9b7f024f3fce None admin] Validating token access rules against request {{(pid=416293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:06:17.085489 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda69f4b-5bdf-40e6-9654-7992a827a645 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:06:17.086657 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda69f4b-5bdf-40e6-9654-7992a827a645 None admin] REQUEST_METHOD: `GET` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:06:17.087362 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda69f4b-5bdf-40e6-9654-7992a827a645 None admin] SCRIPT_NAME: `/identity` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:06:17.087874 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda69f4b-5bdf-40e6-9654-7992a827a645 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:06:17.103828 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda69f4b-5bdf-40e6-9654-7992a827a645 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 09:06:17.109456 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application [None req-bda69f4b-5bdf-40e6-9654-7992a827a645 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 28 09:06:17.109456 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 09:06:17.109456 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 09:06:17.109456 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 09:06:17.109456 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 09:06:17.109456 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 09:06:17.109456 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 09:06:17.109456 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 09:06:17.109456 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 09:06:17.109456 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 09:06:17.109456 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 09:06:17.109456 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 09:06:17.109456 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 09:06:17.109456 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 09:06:17.109456 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 09:06:17.109456 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 09:06:17.110839 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 09:06:17.110839 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 09:06:17.110839 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 09:06:17.110839 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 09:06:17.110839 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 09:06:17.110839 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 09:06:17.110839 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 09:06:17.110839 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 09:06:17.110839 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 09:06:17.110839 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 09:06:17.110839 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 09:06:17.110839 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application with Lock( Jul 28 09:06:17.110839 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 09:06:17.110839 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self._enter() Jul 28 09:06:17.110839 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 09:06:17.110839 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 09:06:17.112244 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 09:06:17.112244 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self.creator() Jul 28 09:06:17.112244 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 09:06:17.112244 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application created_value = creator( Jul 28 09:06:17.112244 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 09:06:17.112244 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 09:06:17.112244 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 09:06:17.112244 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 09:06:17.112244 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 09:06:17.112244 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 09:06:17.112244 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 28 09:06:17.112244 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application Jul 28 09:06:17.112244 dv-cinder-851351-1-smb devstack@keystone.service[416293]: [pid: 416293|app: 0|req: 234/479] 10.222.0.42 () {56 vars in 1114 bytes} [Thu Jul 28 09:06:16 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 09:06:17.119597 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0236880f-9acb-4501-a639-3644d4bbd8c0 None admin] Authenticating user token {{(pid=416294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:06:17.181074 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG dbcounter [-] [416294] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=416294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:06:17.249291 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0236880f-9acb-4501-a639-3644d4bbd8c0 None admin] Validating token access rules against request {{(pid=416294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:06:17.294376 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4296bd5-dad0-4e91-af9a-735a88327cf1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:06:17.294954 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4296bd5-dad0-4e91-af9a-735a88327cf1 None admin] REQUEST_METHOD: `GET` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:06:17.295243 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4296bd5-dad0-4e91-af9a-735a88327cf1 None admin] SCRIPT_NAME: `/identity` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:06:17.295513 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4296bd5-dad0-4e91-af9a-735a88327cf1 None admin] PATH_INFO: `/v3/roles` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:06:17.296269 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4296bd5-dad0-4e91-af9a-735a88327cf1 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=416294) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 09:06:17.296578 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4296bd5-dad0-4e91-af9a-735a88327cf1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:06:17.298038 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4296bd5-dad0-4e91-af9a-735a88327cf1 None admin] RBAC: Authorization granted {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:06:17.307362 dv-cinder-851351-1-smb devstack@keystone.service[416294]: [pid: 416294|app: 0|req: 246/480] 10.222.0.42 () {56 vars in 1111 bytes} [Thu Jul 28 09:06:17 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:06:18.166040 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88242c1-1fba-47e4-a0aa-78a01c9996d2 None None] REQUEST_METHOD: `GET` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:06:18.167147 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88242c1-1fba-47e4-a0aa-78a01c9996d2 None None] SCRIPT_NAME: `/identity` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:06:18.167645 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88242c1-1fba-47e4-a0aa-78a01c9996d2 None None] PATH_INFO: `/` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:06:18.169568 dv-cinder-851351-1-smb devstack@keystone.service[416293]: [pid: 416293|app: 0|req: 235/481] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 09:06:18 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 09:06:18.175055 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d14c867-9f91-4f30-b11c-9b9c998bde95 None None] REQUEST_METHOD: `POST` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:06:18.176008 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d14c867-9f91-4f30-b11c-9b9c998bde95 None None] SCRIPT_NAME: `/identity` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:06:18.176499 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d14c867-9f91-4f30-b11c-9b9c998bde95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:06:18.204861 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.auth.core [None req-7d14c867-9f91-4f30-b11c-9b9c998bde95 None None] MFA Rules not processed for user `dbf87abab90e4fdf9e75408f4199918e`. Rule list: `[]` (Enabled: `True`). {{(pid=416294) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 09:06:18.206490 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.fernet_utils [None req-7d14c867-9f91-4f30-b11c-9b9c998bde95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=416294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 09:06:18.300467 dv-cinder-851351-1-smb devstack@keystone.service[416294]: [pid: 416294|app: 0|req: 247/482] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 09:06:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 09:06:18.337997 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e88242c1-1fba-47e4-a0aa-78a01c9996d2 None None] Authenticating user token {{(pid=416293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:06:18.383299 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG dbcounter [-] [416293] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=416293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:06:18.480586 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e88242c1-1fba-47e4-a0aa-78a01c9996d2 None None] Validating token access rules against request {{(pid=416293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:06:18.527785 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3572a74-e548-4f62-991a-1a6f4b498855 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:06:18.528900 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3572a74-e548-4f62-991a-1a6f4b498855 None admin] REQUEST_METHOD: `GET` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:06:18.529399 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3572a74-e548-4f62-991a-1a6f4b498855 None admin] SCRIPT_NAME: `/identity` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:06:18.529886 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3572a74-e548-4f62-991a-1a6f4b498855 None admin] PATH_INFO: `/v3/roles/service` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:06:18.542063 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3572a74-e548-4f62-991a-1a6f4b498855 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 09:06:18.547485 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application [None req-c3572a74-e548-4f62-991a-1a6f4b498855 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 28 09:06:18.547485 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 09:06:18.547485 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 09:06:18.547485 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 09:06:18.547485 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 09:06:18.547485 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 09:06:18.547485 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 09:06:18.547485 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 09:06:18.547485 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 09:06:18.547485 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 09:06:18.547485 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 09:06:18.547485 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 09:06:18.547485 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 09:06:18.547485 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 09:06:18.547485 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 09:06:18.547485 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 09:06:18.548450 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 09:06:18.548450 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 09:06:18.548450 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 09:06:18.548450 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 09:06:18.548450 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 09:06:18.548450 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 09:06:18.548450 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 09:06:18.548450 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 09:06:18.548450 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 09:06:18.548450 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 09:06:18.548450 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 09:06:18.548450 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application with Lock( Jul 28 09:06:18.548450 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 09:06:18.548450 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self._enter() Jul 28 09:06:18.548450 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 09:06:18.548450 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 09:06:18.549453 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 09:06:18.549453 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self.creator() Jul 28 09:06:18.549453 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 09:06:18.549453 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application created_value = creator( Jul 28 09:06:18.549453 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 09:06:18.549453 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 09:06:18.549453 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 09:06:18.549453 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 09:06:18.549453 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 09:06:18.549453 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 09:06:18.549453 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 28 09:06:18.549453 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application Jul 28 09:06:18.552334 dv-cinder-851351-1-smb devstack@keystone.service[416293]: [pid: 416293|app: 0|req: 236/483] 10.222.0.42 () {56 vars in 1102 bytes} [Thu Jul 28 09:06:18 2022] GET /identity/v3/roles/service => generated 85 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 09:06:18.558133 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d14c867-9f91-4f30-b11c-9b9c998bde95 None None] Authenticating user token {{(pid=416294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:06:18.585476 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG dbcounter [-] [416294] Writing DB stats keystone:SELECT=100 {{(pid=416294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:06:18.699208 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d14c867-9f91-4f30-b11c-9b9c998bde95 None None] Validating token access rules against request {{(pid=416294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:06:18.755917 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76bb0a12-d626-4d55-bb25-b8eb6c8476db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:06:18.756572 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76bb0a12-d626-4d55-bb25-b8eb6c8476db None admin] REQUEST_METHOD: `GET` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:06:18.756881 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76bb0a12-d626-4d55-bb25-b8eb6c8476db None admin] SCRIPT_NAME: `/identity` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:06:18.757233 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76bb0a12-d626-4d55-bb25-b8eb6c8476db None admin] PATH_INFO: `/v3/roles` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:06:18.757981 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76bb0a12-d626-4d55-bb25-b8eb6c8476db None admin] RBAC: Adding query filter params (name=service) {{(pid=416294) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 09:06:18.758343 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76bb0a12-d626-4d55-bb25-b8eb6c8476db None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:06:18.759774 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76bb0a12-d626-4d55-bb25-b8eb6c8476db None admin] RBAC: Authorization granted {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:06:18.772934 dv-cinder-851351-1-smb devstack@keystone.service[416294]: [pid: 416294|app: 0|req: 248/484] 10.222.0.42 () {56 vars in 1103 bytes} [Thu Jul 28 09:06:18 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:06:18.778889 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3572a74-e548-4f62-991a-1a6f4b498855 None admin] Authenticating user token {{(pid=416293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:06:18.915731 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG dbcounter [-] [416293] Writing DB stats keystone:SELECT=100 {{(pid=416293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:06:18.932908 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3572a74-e548-4f62-991a-1a6f4b498855 None admin] Validating token access rules against request {{(pid=416293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:06:18.968502 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30f45f8-3b80-4ab8-94d8-2fc23064942b None None] REQUEST_METHOD: `GET` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:06:18.968861 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30f45f8-3b80-4ab8-94d8-2fc23064942b None None] SCRIPT_NAME: `/identity` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:06:18.969113 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30f45f8-3b80-4ab8-94d8-2fc23064942b None None] PATH_INFO: `/` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:06:18.970516 dv-cinder-851351-1-smb devstack@keystone.service[416294]: [pid: 416294|app: 0|req: 249/485] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 09:06:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 09:06:18.979812 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137e4c78-fb79-487e-abd8-110c1a83316e None None] REQUEST_METHOD: `POST` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:06:18.979812 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137e4c78-fb79-487e-abd8-110c1a83316e None None] SCRIPT_NAME: `/identity` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:06:18.979812 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137e4c78-fb79-487e-abd8-110c1a83316e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:06:18.982377 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22c1b2f-ce63-40cc-8546-4134fd67b296 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:06:18.988719 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22c1b2f-ce63-40cc-8546-4134fd67b296 None admin] REQUEST_METHOD: `GET` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:06:18.988719 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22c1b2f-ce63-40cc-8546-4134fd67b296 None admin] SCRIPT_NAME: `/identity` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:06:18.988719 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22c1b2f-ce63-40cc-8546-4134fd67b296 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:06:18.996437 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f22c1b2f-ce63-40cc-8546-4134fd67b296 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:06:18.998001 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f22c1b2f-ce63-40cc-8546-4134fd67b296 None admin] RBAC: Authorization granted {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:06:19.019240 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application [None req-f22c1b2f-ce63-40cc-8546-4134fd67b296 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 09:06:19.019240 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 09:06:19.019240 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 09:06:19.019240 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 09:06:19.019240 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 09:06:19.019240 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 09:06:19.019240 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 09:06:19.019240 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 09:06:19.019240 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 09:06:19.019240 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 09:06:19.019240 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 09:06:19.019240 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 09:06:19.019240 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 09:06:19.019240 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 09:06:19.019240 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 09:06:19.020228 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 09:06:19.020228 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 09:06:19.020228 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 09:06:19.020228 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 09:06:19.020228 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 09:06:19.020228 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 09:06:19.020228 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 09:06:19.020228 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 09:06:19.020228 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application with Lock( Jul 28 09:06:19.020228 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 09:06:19.020228 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self._enter() Jul 28 09:06:19.020228 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 09:06:19.020228 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 09:06:19.020228 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 09:06:19.020228 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self.creator() Jul 28 09:06:19.020228 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 09:06:19.020228 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application created_value = creator( Jul 28 09:06:19.021230 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 09:06:19.021230 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 09:06:19.021230 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 09:06:19.021230 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application Jul 28 09:06:19.021904 dv-cinder-851351-1-smb devstack@keystone.service[416293]: [pid: 416293|app: 0|req: 237/486] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 09:06:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 243 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 09:06:19.028610 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.auth.core [None req-137e4c78-fb79-487e-abd8-110c1a83316e None None] MFA Rules not processed for user `dbf87abab90e4fdf9e75408f4199918e`. Rule list: `[]` (Enabled: `True`). {{(pid=416294) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 09:06:19.028935 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22c1b2f-ce63-40cc-8546-4134fd67b296 None admin] Authenticating user token {{(pid=416293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:06:19.029864 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.fernet_utils [None req-137e4c78-fb79-487e-abd8-110c1a83316e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=416294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 09:06:19.186666 dv-cinder-851351-1-smb devstack@keystone.service[416294]: [pid: 416294|app: 0|req: 250/487] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 09:06:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 09:06:19.207261 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22c1b2f-ce63-40cc-8546-4134fd67b296 None admin] Validating token access rules against request {{(pid=416293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:06:19.221739 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137e4c78-fb79-487e-abd8-110c1a83316e None None] Authenticating user token {{(pid=416294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:06:19.236309 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG dbcounter [-] [416294] Writing DB stats keystone:SELECT=100 {{(pid=416294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:06:19.279257 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104bd0cd-1769-424f-9ad1-0cf347acc6cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:06:19.279899 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104bd0cd-1769-424f-9ad1-0cf347acc6cb None admin] REQUEST_METHOD: `GET` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:06:19.280181 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104bd0cd-1769-424f-9ad1-0cf347acc6cb None admin] SCRIPT_NAME: `/identity` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:06:19.280464 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104bd0cd-1769-424f-9ad1-0cf347acc6cb None admin] PATH_INFO: `/v3/domains` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:06:19.281202 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-104bd0cd-1769-424f-9ad1-0cf347acc6cb None admin] RBAC: Adding query filter params (name=Default) {{(pid=416293) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 09:06:19.281510 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-104bd0cd-1769-424f-9ad1-0cf347acc6cb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:06:19.282944 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-104bd0cd-1769-424f-9ad1-0cf347acc6cb None admin] RBAC: Authorization granted {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:06:19.307347 dv-cinder-851351-1-smb devstack@keystone.service[416293]: [pid: 416293|app: 0|req: 238/488] 10.222.0.42 () {56 vars in 1109 bytes} [Thu Jul 28 09:06:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 279 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 09:06:19.326498 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104bd0cd-1769-424f-9ad1-0cf347acc6cb None admin] Authenticating user token {{(pid=416293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:06:19.335185 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG dbcounter [-] [416293] Writing DB stats keystone:SELECT=100 {{(pid=416293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:06:19.382686 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137e4c78-fb79-487e-abd8-110c1a83316e None None] Validating token access rules against request {{(pid=416294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:06:19.428314 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78991645-937f-443c-922c-a29b8e06e276 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:06:19.429036 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78991645-937f-443c-922c-a29b8e06e276 None admin] REQUEST_METHOD: `GET` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:06:19.429317 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78991645-937f-443c-922c-a29b8e06e276 None admin] SCRIPT_NAME: `/identity` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:06:19.429592 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78991645-937f-443c-922c-a29b8e06e276 None admin] PATH_INFO: `/v3/roles/service` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:06:19.443580 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78991645-937f-443c-922c-a29b8e06e276 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 09:06:19.448014 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application [None req-78991645-937f-443c-922c-a29b8e06e276 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 28 09:06:19.448014 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 09:06:19.448014 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 09:06:19.448014 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 09:06:19.448014 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 09:06:19.448014 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 09:06:19.448014 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 09:06:19.448014 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 09:06:19.448014 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 09:06:19.448014 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 09:06:19.448014 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 09:06:19.448014 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 09:06:19.448014 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 09:06:19.448014 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 09:06:19.448014 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 09:06:19.448014 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 09:06:19.449516 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 09:06:19.449516 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 09:06:19.449516 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 09:06:19.449516 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 09:06:19.449516 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 09:06:19.449516 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 09:06:19.449516 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 09:06:19.449516 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 09:06:19.449516 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 09:06:19.449516 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 09:06:19.449516 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 09:06:19.449516 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application with Lock( Jul 28 09:06:19.449516 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 09:06:19.449516 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return self._enter() Jul 28 09:06:19.449516 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 09:06:19.449516 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 09:06:19.450393 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 09:06:19.450393 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return self.creator() Jul 28 09:06:19.450393 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 09:06:19.450393 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application created_value = creator( Jul 28 09:06:19.450393 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 09:06:19.450393 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 09:06:19.450393 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 09:06:19.450393 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 09:06:19.450393 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 09:06:19.450393 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 09:06:19.450393 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 28 09:06:19.450393 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application Jul 28 09:06:19.450393 dv-cinder-851351-1-smb devstack@keystone.service[416294]: [pid: 416294|app: 0|req: 251/489] 10.222.0.42 () {56 vars in 1102 bytes} [Thu Jul 28 09:06:19 2022] GET /identity/v3/roles/service => generated 85 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 09:06:19.451638 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58cc0336-cc85-4576-896b-c6d608432305 None None] REQUEST_METHOD: `GET` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:06:19.451866 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58cc0336-cc85-4576-896b-c6d608432305 None None] SCRIPT_NAME: `/identity` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:06:19.452143 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58cc0336-cc85-4576-896b-c6d608432305 None None] PATH_INFO: `/` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:06:19.458390 dv-cinder-851351-1-smb devstack@keystone.service[416294]: [pid: 416294|app: 0|req: 252/490] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 09:06:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 09:06:19.458390 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58cc0336-cc85-4576-896b-c6d608432305 None None] Authenticating user token {{(pid=416294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:06:19.488819 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104bd0cd-1769-424f-9ad1-0cf347acc6cb None admin] Validating token access rules against request {{(pid=416293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:06:19.530080 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4cf287e-44fe-4847-aa6c-5ef215647aab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:06:19.530817 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4cf287e-44fe-4847-aa6c-5ef215647aab None admin] REQUEST_METHOD: `GET` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:06:19.531106 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4cf287e-44fe-4847-aa6c-5ef215647aab None admin] SCRIPT_NAME: `/identity` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:06:19.531389 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4cf287e-44fe-4847-aa6c-5ef215647aab None admin] PATH_INFO: `/v3/users/nova` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:06:19.540165 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4cf287e-44fe-4847-aa6c-5ef215647aab None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:06:19.541723 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4cf287e-44fe-4847-aa6c-5ef215647aab None admin] RBAC: Authorization granted {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:06:19.541932 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG dbcounter [-] [416294] Writing DB stats keystone:SELECT=100 {{(pid=416294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:06:19.556834 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application [None req-d4cf287e-44fe-4847-aa6c-5ef215647aab None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 28 09:06:19.556834 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 09:06:19.556834 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 09:06:19.556834 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 09:06:19.556834 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 09:06:19.556834 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 09:06:19.556834 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 09:06:19.556834 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 09:06:19.556834 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 09:06:19.556834 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 09:06:19.556834 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 09:06:19.556834 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 09:06:19.556834 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 28 09:06:19.556834 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 28 09:06:19.556834 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 28 09:06:19.556834 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 28 09:06:19.557993 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 09:06:19.557993 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 09:06:19.557993 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 28 09:06:19.557993 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 09:06:19.557993 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 28 09:06:19.557993 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 09:06:19.557993 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 09:06:19.557993 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 09:06:19.557993 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 09:06:19.557993 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 09:06:19.557993 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 09:06:19.557993 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application with Lock( Jul 28 09:06:19.557993 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 09:06:19.557993 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self._enter() Jul 28 09:06:19.557993 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 09:06:19.557993 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 09:06:19.557993 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 09:06:19.557993 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self.creator() Jul 28 09:06:19.558995 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 09:06:19.558995 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application created_value = creator( Jul 28 09:06:19.558995 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 28 09:06:19.558995 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 28 09:06:19.558995 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 28 09:06:19.558995 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 28 09:06:19.558995 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 28 09:06:19.558995 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 28 09:06:19.558995 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 28 09:06:19.558995 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application Jul 28 09:06:19.558995 dv-cinder-851351-1-smb devstack@keystone.service[416293]: [pid: 416293|app: 0|req: 239/491] 10.222.0.42 () {56 vars in 1093 bytes} [Thu Jul 28 09:06:19 2022] GET /identity/v3/users/nova => generated 82 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 09:06:19.559611 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66f33c0-eaa4-42cb-9e25-d5528f8772ef None None] REQUEST_METHOD: `POST` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:06:19.560478 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66f33c0-eaa4-42cb-9e25-d5528f8772ef None None] SCRIPT_NAME: `/identity` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:06:19.560478 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66f33c0-eaa4-42cb-9e25-d5528f8772ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:06:19.580619 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.auth.core [None req-d66f33c0-eaa4-42cb-9e25-d5528f8772ef None None] MFA Rules not processed for user `dbf87abab90e4fdf9e75408f4199918e`. Rule list: `[]` (Enabled: `True`). {{(pid=416293) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 09:06:19.581900 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.fernet_utils [None req-d66f33c0-eaa4-42cb-9e25-d5528f8772ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=416293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 09:06:19.586332 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58cc0336-cc85-4576-896b-c6d608432305 None None] Validating token access rules against request {{(pid=416294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:06:19.623958 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b06e81-ec39-44bd-858f-c41fdb070fe1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:06:19.624596 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b06e81-ec39-44bd-858f-c41fdb070fe1 None admin] REQUEST_METHOD: `GET` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:06:19.624905 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b06e81-ec39-44bd-858f-c41fdb070fe1 None admin] SCRIPT_NAME: `/identity` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:06:19.625179 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b06e81-ec39-44bd-858f-c41fdb070fe1 None admin] PATH_INFO: `/v3/roles` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:06:19.625915 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91b06e81-ec39-44bd-858f-c41fdb070fe1 None admin] RBAC: Adding query filter params (name=service) {{(pid=416294) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 09:06:19.626218 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91b06e81-ec39-44bd-858f-c41fdb070fe1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:06:19.627700 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91b06e81-ec39-44bd-858f-c41fdb070fe1 None admin] RBAC: Authorization granted {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:06:19.636982 dv-cinder-851351-1-smb devstack@keystone.service[416294]: [pid: 416294|app: 0|req: 253/492] 10.222.0.42 () {56 vars in 1103 bytes} [Thu Jul 28 09:06:19 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:06:19.638265 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd40e077-8442-4d08-b9f4-0628928341b0 None None] REQUEST_METHOD: `GET` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:06:19.638551 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd40e077-8442-4d08-b9f4-0628928341b0 None None] SCRIPT_NAME: `/identity` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:06:19.638829 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd40e077-8442-4d08-b9f4-0628928341b0 None None] PATH_INFO: `/` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:06:19.640250 dv-cinder-851351-1-smb devstack@keystone.service[416294]: [pid: 416294|app: 0|req: 254/493] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 09:06:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 09:06:19.640804 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd40e077-8442-4d08-b9f4-0628928341b0 None None] Authenticating user token {{(pid=416294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:06:19.655958 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG dbcounter [-] [416293] Writing DB stats keystone:SELECT=100 {{(pid=416293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:06:19.668363 dv-cinder-851351-1-smb devstack@keystone.service[416293]: [pid: 416293|app: 0|req: 240/494] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 09:06:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 09:06:19.669599 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66f33c0-eaa4-42cb-9e25-d5528f8772ef None None] Authenticating user token {{(pid=416293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:06:19.765222 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd40e077-8442-4d08-b9f4-0628928341b0 None None] Validating token access rules against request {{(pid=416294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:06:19.786310 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66f33c0-eaa4-42cb-9e25-d5528f8772ef None None] Validating token access rules against request {{(pid=416293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:06:19.798952 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG dbcounter [-] [416294] Writing DB stats keystone:SELECT=100 {{(pid=416294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:06:19.805096 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d446c335-5d97-403c-a83e-fe6be1c053df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:06:19.805732 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d446c335-5d97-403c-a83e-fe6be1c053df None admin] REQUEST_METHOD: `GET` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:06:19.806020 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d446c335-5d97-403c-a83e-fe6be1c053df None admin] SCRIPT_NAME: `/identity` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:06:19.806292 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d446c335-5d97-403c-a83e-fe6be1c053df None admin] PATH_INFO: `/v3/users` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:06:19.807104 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d446c335-5d97-403c-a83e-fe6be1c053df None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=416294) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 09:06:19.807409 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d446c335-5d97-403c-a83e-fe6be1c053df None admin] RBAC: Authorizing `identity:list_users()` {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:06:19.808883 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d446c335-5d97-403c-a83e-fe6be1c053df None admin] RBAC: Authorization granted {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:06:19.827104 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2716ec0-52c0-424d-bc6d-21445a50e233 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:06:19.827784 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2716ec0-52c0-424d-bc6d-21445a50e233 None admin] REQUEST_METHOD: `GET` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:06:19.828071 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2716ec0-52c0-424d-bc6d-21445a50e233 None admin] SCRIPT_NAME: `/identity` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:06:19.828348 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2716ec0-52c0-424d-bc6d-21445a50e233 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:06:19.841276 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2716ec0-52c0-424d-bc6d-21445a50e233 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:06:19.842796 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2716ec0-52c0-424d-bc6d-21445a50e233 None admin] RBAC: Authorization granted {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:06:19.851332 dv-cinder-851351-1-smb devstack@keystone.service[416294]: [pid: 416294|app: 0|req: 255/495] 10.222.0.42 () {56 vars in 1133 bytes} [Thu Jul 28 09:06:19 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:06:19.852946 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c68094-d457-4d7c-8dfc-91155cc68d63 None None] REQUEST_METHOD: `POST` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:06:19.853453 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c68094-d457-4d7c-8dfc-91155cc68d63 None None] SCRIPT_NAME: `/identity` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:06:19.853729 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c68094-d457-4d7c-8dfc-91155cc68d63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:06:19.864647 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application [None req-f2716ec0-52c0-424d-bc6d-21445a50e233 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 09:06:19.864647 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 09:06:19.864647 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 09:06:19.864647 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 09:06:19.864647 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 09:06:19.864647 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 09:06:19.864647 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 09:06:19.864647 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 09:06:19.864647 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 09:06:19.864647 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 09:06:19.864647 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 09:06:19.864647 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 09:06:19.864647 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 09:06:19.864647 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 09:06:19.864647 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 09:06:19.865762 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 09:06:19.865762 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 09:06:19.865762 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 09:06:19.865762 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 09:06:19.865762 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 09:06:19.865762 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 09:06:19.865762 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 09:06:19.865762 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 09:06:19.865762 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application with Lock( Jul 28 09:06:19.865762 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 09:06:19.865762 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self._enter() Jul 28 09:06:19.865762 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 09:06:19.865762 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 09:06:19.865762 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 09:06:19.865762 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self.creator() Jul 28 09:06:19.865762 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 09:06:19.865762 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application created_value = creator( Jul 28 09:06:19.871853 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 09:06:19.871853 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 09:06:19.871853 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 09:06:19.871853 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application Jul 28 09:06:19.871853 dv-cinder-851351-1-smb devstack@keystone.service[416293]: [pid: 416293|app: 0|req: 241/496] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 09:06:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 09:06:19.871853 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2716ec0-52c0-424d-bc6d-21445a50e233 None admin] Authenticating user token {{(pid=416293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:06:19.873367 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.auth.core [None req-41c68094-d457-4d7c-8dfc-91155cc68d63 None None] MFA Rules not processed for user `dbf87abab90e4fdf9e75408f4199918e`. Rule list: `[]` (Enabled: `True`). {{(pid=416294) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 09:06:19.874935 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.fernet_utils [None req-41c68094-d457-4d7c-8dfc-91155cc68d63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=416294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 09:06:19.924211 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG dbcounter [-] [416293] Writing DB stats keystone:SELECT=100 {{(pid=416293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:06:19.969016 dv-cinder-851351-1-smb devstack@keystone.service[416294]: [pid: 416294|app: 0|req: 256/497] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 09:06:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 09:06:19.969909 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c68094-d457-4d7c-8dfc-91155cc68d63 None None] Authenticating user token {{(pid=416294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:06:19.994760 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2716ec0-52c0-424d-bc6d-21445a50e233 None admin] Validating token access rules against request {{(pid=416293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:06:20.032293 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720076db-9c81-4382-8783-bce684c363c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:06:20.032912 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720076db-9c81-4382-8783-bce684c363c7 None admin] REQUEST_METHOD: `GET` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:06:20.033254 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720076db-9c81-4382-8783-bce684c363c7 None admin] SCRIPT_NAME: `/identity` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:06:20.033538 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720076db-9c81-4382-8783-bce684c363c7 None admin] PATH_INFO: `/v3/roles/service` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:06:20.045018 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-720076db-9c81-4382-8783-bce684c363c7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 09:06:20.051632 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application [None req-720076db-9c81-4382-8783-bce684c363c7 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 28 09:06:20.051632 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 09:06:20.051632 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 09:06:20.051632 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 09:06:20.051632 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 09:06:20.051632 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 09:06:20.051632 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 09:06:20.051632 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 09:06:20.051632 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 09:06:20.051632 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 09:06:20.051632 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 09:06:20.051632 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 09:06:20.051632 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 09:06:20.051632 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 09:06:20.051632 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 09:06:20.051632 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 09:06:20.052928 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 09:06:20.052928 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 09:06:20.052928 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 09:06:20.052928 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 09:06:20.052928 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 09:06:20.052928 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 09:06:20.052928 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 09:06:20.052928 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 09:06:20.052928 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 09:06:20.052928 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 09:06:20.052928 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 09:06:20.052928 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application with Lock( Jul 28 09:06:20.052928 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 09:06:20.052928 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self._enter() Jul 28 09:06:20.052928 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 09:06:20.052928 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 09:06:20.053806 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 09:06:20.053806 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self.creator() Jul 28 09:06:20.053806 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 09:06:20.053806 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application created_value = creator( Jul 28 09:06:20.053806 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 09:06:20.053806 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 09:06:20.053806 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 09:06:20.053806 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 09:06:20.053806 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 09:06:20.053806 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 09:06:20.053806 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 28 09:06:20.053806 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application Jul 28 09:06:20.053806 dv-cinder-851351-1-smb devstack@keystone.service[416293]: [pid: 416293|app: 0|req: 242/498] 10.222.0.42 () {56 vars in 1102 bytes} [Thu Jul 28 09:06:19 2022] GET /identity/v3/roles/service => generated 85 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 09:06:20.053806 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720076db-9c81-4382-8783-bce684c363c7 None admin] Authenticating user token {{(pid=416293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:06:20.097502 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c68094-d457-4d7c-8dfc-91155cc68d63 None None] Validating token access rules against request {{(pid=416294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:06:20.123731 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG dbcounter [-] [416294] Writing DB stats keystone:SELECT=100 {{(pid=416294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:06:20.139463 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c1f234-590b-4d99-83f1-03d11dcdb9d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:06:20.140113 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c1f234-590b-4d99-83f1-03d11dcdb9d7 None admin] REQUEST_METHOD: `GET` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:06:20.140390 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c1f234-590b-4d99-83f1-03d11dcdb9d7 None admin] SCRIPT_NAME: `/identity` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:06:20.140681 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c1f234-590b-4d99-83f1-03d11dcdb9d7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:06:20.165599 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720076db-9c81-4382-8783-bce684c363c7 None admin] Validating token access rules against request {{(pid=416293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:06:20.168156 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG dbcounter [-] [416293] Writing DB stats keystone:SELECT=100 {{(pid=416293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:06:20.205570 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df040e1e-d186-4bab-a565-67a9689d4755 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:06:20.206214 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df040e1e-d186-4bab-a565-67a9689d4755 None admin] REQUEST_METHOD: `GET` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:06:20.206483 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df040e1e-d186-4bab-a565-67a9689d4755 None admin] SCRIPT_NAME: `/identity` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:06:20.206777 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df040e1e-d186-4bab-a565-67a9689d4755 None admin] PATH_INFO: `/v3/domains` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:06:20.207499 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df040e1e-d186-4bab-a565-67a9689d4755 None admin] RBAC: Adding query filter params (name=Default) {{(pid=416293) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 09:06:20.208283 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df040e1e-d186-4bab-a565-67a9689d4755 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:06:20.209287 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df040e1e-d186-4bab-a565-67a9689d4755 None admin] RBAC: Authorization granted {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:06:20.223109 dv-cinder-851351-1-smb devstack@keystone.service[416293]: [pid: 416293|app: 0|req: 243/499] 10.222.0.42 () {56 vars in 1109 bytes} [Thu Jul 28 09:06:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:06:20.223421 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38c1f234-590b-4d99-83f1-03d11dcdb9d7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:06:20.224224 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df040e1e-d186-4bab-a565-67a9689d4755 None admin] Authenticating user token {{(pid=416293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:06:20.224844 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38c1f234-590b-4d99-83f1-03d11dcdb9d7 None admin] RBAC: Authorization granted {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:06:20.335742 dv-cinder-851351-1-smb devstack@keystone.service[416294]: [pid: 416294|app: 0|req: 257/500] 10.222.0.42 () {58 vars in 1282 bytes} [Thu Jul 28 09:06:19 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 366 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 28 09:06:20.336627 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c1f234-590b-4d99-83f1-03d11dcdb9d7 None admin] Authenticating user token {{(pid=416294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:06:20.343688 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df040e1e-d186-4bab-a565-67a9689d4755 None admin] Validating token access rules against request {{(pid=416293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:06:20.358751 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG dbcounter [-] [416294] Writing DB stats keystone:SELECT=100 {{(pid=416294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:06:20.378730 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b305671d-aafb-40e0-984f-d9685065e268 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:06:20.379391 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b305671d-aafb-40e0-984f-d9685065e268 None admin] REQUEST_METHOD: `GET` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:06:20.379676 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b305671d-aafb-40e0-984f-d9685065e268 None admin] SCRIPT_NAME: `/identity` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:06:20.379961 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b305671d-aafb-40e0-984f-d9685065e268 None admin] PATH_INFO: `/v3/roles/service` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:06:20.391637 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b305671d-aafb-40e0-984f-d9685065e268 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 09:06:20.396771 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application [None req-b305671d-aafb-40e0-984f-d9685065e268 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 28 09:06:20.396771 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 09:06:20.396771 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 09:06:20.396771 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 09:06:20.396771 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 09:06:20.396771 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 09:06:20.396771 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 09:06:20.396771 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 09:06:20.396771 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 09:06:20.396771 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 09:06:20.396771 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 09:06:20.396771 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 09:06:20.396771 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 09:06:20.396771 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 09:06:20.396771 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 09:06:20.396771 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 09:06:20.397815 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 09:06:20.397815 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 09:06:20.397815 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 09:06:20.397815 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 09:06:20.397815 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 09:06:20.397815 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 09:06:20.397815 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 09:06:20.397815 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 09:06:20.397815 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 09:06:20.397815 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 09:06:20.397815 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 09:06:20.397815 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application with Lock( Jul 28 09:06:20.397815 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 09:06:20.397815 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self._enter() Jul 28 09:06:20.397815 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 09:06:20.397815 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 09:06:20.398778 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 09:06:20.398778 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self.creator() Jul 28 09:06:20.398778 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 09:06:20.398778 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application created_value = creator( Jul 28 09:06:20.398778 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 09:06:20.398778 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 09:06:20.398778 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 09:06:20.398778 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 09:06:20.398778 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 09:06:20.398778 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 09:06:20.398778 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 28 09:06:20.398778 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application Jul 28 09:06:20.398778 dv-cinder-851351-1-smb devstack@keystone.service[416293]: [pid: 416293|app: 0|req: 244/501] 10.222.0.42 () {56 vars in 1102 bytes} [Thu Jul 28 09:06:20 2022] GET /identity/v3/roles/service => generated 85 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 09:06:20.399500 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06bd1b7-2039-437e-926c-cc33cc1a07a5 None None] REQUEST_METHOD: `GET` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:06:20.399786 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06bd1b7-2039-437e-926c-cc33cc1a07a5 None None] SCRIPT_NAME: `/identity` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:06:20.400124 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06bd1b7-2039-437e-926c-cc33cc1a07a5 None None] PATH_INFO: `/` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:06:20.401437 dv-cinder-851351-1-smb devstack@keystone.service[416293]: [pid: 416293|app: 0|req: 245/502] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 09:06:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 09:06:20.402126 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06bd1b7-2039-437e-926c-cc33cc1a07a5 None None] Authenticating user token {{(pid=416293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:06:20.427898 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG dbcounter [-] [416293] Writing DB stats keystone:SELECT=100 {{(pid=416293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:06:20.448846 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c1f234-590b-4d99-83f1-03d11dcdb9d7 None admin] Validating token access rules against request {{(pid=416294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:06:20.484419 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201f5636-1ed2-4ce2-8deb-476f00ca933b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:06:20.485088 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201f5636-1ed2-4ce2-8deb-476f00ca933b None admin] REQUEST_METHOD: `GET` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:06:20.485380 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201f5636-1ed2-4ce2-8deb-476f00ca933b None admin] SCRIPT_NAME: `/identity` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:06:20.485665 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201f5636-1ed2-4ce2-8deb-476f00ca933b None admin] PATH_INFO: `/v3/roles` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:06:20.486398 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-201f5636-1ed2-4ce2-8deb-476f00ca933b None admin] RBAC: Adding query filter params (name=service) {{(pid=416294) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 09:06:20.486706 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-201f5636-1ed2-4ce2-8deb-476f00ca933b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:06:20.488104 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-201f5636-1ed2-4ce2-8deb-476f00ca933b None admin] RBAC: Authorization granted {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:06:20.496354 dv-cinder-851351-1-smb devstack@keystone.service[416294]: [pid: 416294|app: 0|req: 258/503] 10.222.0.42 () {56 vars in 1103 bytes} [Thu Jul 28 09:06:20 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:06:20.501593 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201f5636-1ed2-4ce2-8deb-476f00ca933b None admin] Authenticating user token {{(pid=416294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:06:20.506728 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06bd1b7-2039-437e-926c-cc33cc1a07a5 None None] Validating token access rules against request {{(pid=416293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:06:20.543042 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2092a844-d119-4008-86ec-b14d59d8dab5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:06:20.543663 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2092a844-d119-4008-86ec-b14d59d8dab5 None admin] REQUEST_METHOD: `GET` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:06:20.543949 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2092a844-d119-4008-86ec-b14d59d8dab5 None admin] SCRIPT_NAME: `/identity` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:06:20.544230 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2092a844-d119-4008-86ec-b14d59d8dab5 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:06:20.551811 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2092a844-d119-4008-86ec-b14d59d8dab5 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:06:20.553586 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2092a844-d119-4008-86ec-b14d59d8dab5 None admin] RBAC: Authorization granted {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:06:20.565892 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application [None req-2092a844-d119-4008-86ec-b14d59d8dab5 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jul 28 09:06:20.565892 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 09:06:20.565892 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 09:06:20.565892 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 09:06:20.565892 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 09:06:20.565892 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 09:06:20.565892 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 09:06:20.565892 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 09:06:20.565892 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 09:06:20.565892 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 09:06:20.565892 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 09:06:20.565892 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 09:06:20.565892 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 28 09:06:20.565892 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 28 09:06:20.565892 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 28 09:06:20.565892 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 28 09:06:20.566986 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 09:06:20.566986 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 09:06:20.566986 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 28 09:06:20.566986 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 09:06:20.566986 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 28 09:06:20.566986 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 09:06:20.566986 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 09:06:20.566986 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 09:06:20.566986 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 09:06:20.566986 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 09:06:20.566986 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 09:06:20.566986 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application with Lock( Jul 28 09:06:20.566986 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 09:06:20.566986 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self._enter() Jul 28 09:06:20.566986 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 09:06:20.566986 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 09:06:20.566986 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 09:06:20.566986 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self.creator() Jul 28 09:06:20.567946 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 09:06:20.567946 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application created_value = creator( Jul 28 09:06:20.567946 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 28 09:06:20.567946 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 28 09:06:20.567946 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 28 09:06:20.567946 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 28 09:06:20.567946 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 28 09:06:20.567946 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 28 09:06:20.567946 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jul 28 09:06:20.567946 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application Jul 28 09:06:20.567946 dv-cinder-851351-1-smb devstack@keystone.service[416293]: [pid: 416293|app: 0|req: 246/504] 10.222.0.42 () {56 vars in 1099 bytes} [Thu Jul 28 09:06:20 2022] GET /identity/v3/users/cinder => generated 84 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 09:06:20.569015 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2092a844-d119-4008-86ec-b14d59d8dab5 None admin] Authenticating user token {{(pid=416293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:06:20.590581 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG dbcounter [-] [416294] Writing DB stats keystone:SELECT=100 {{(pid=416294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:06:20.611005 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201f5636-1ed2-4ce2-8deb-476f00ca933b None admin] Validating token access rules against request {{(pid=416294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:06:20.645326 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501abea5-3df8-4800-b076-7aa2ead5ed73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:06:20.645983 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501abea5-3df8-4800-b076-7aa2ead5ed73 None admin] REQUEST_METHOD: `GET` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:06:20.646265 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501abea5-3df8-4800-b076-7aa2ead5ed73 None admin] SCRIPT_NAME: `/identity` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:06:20.646539 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501abea5-3df8-4800-b076-7aa2ead5ed73 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:06:20.657274 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-501abea5-3df8-4800-b076-7aa2ead5ed73 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:06:20.658813 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-501abea5-3df8-4800-b076-7aa2ead5ed73 None admin] RBAC: Authorization granted {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:06:20.659129 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG dbcounter [-] [416293] Writing DB stats keystone:SELECT=100 {{(pid=416293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:06:20.674553 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application [None req-501abea5-3df8-4800-b076-7aa2ead5ed73 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 09:06:20.674553 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 09:06:20.674553 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 09:06:20.674553 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 09:06:20.674553 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 09:06:20.674553 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 09:06:20.674553 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 09:06:20.674553 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 09:06:20.674553 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 09:06:20.674553 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 09:06:20.674553 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 09:06:20.674553 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 09:06:20.674553 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 09:06:20.674553 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 09:06:20.674553 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 09:06:20.675565 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 09:06:20.675565 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 09:06:20.675565 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 09:06:20.675565 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 09:06:20.675565 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 09:06:20.675565 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 09:06:20.675565 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 09:06:20.675565 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 09:06:20.675565 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application with Lock( Jul 28 09:06:20.675565 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 09:06:20.675565 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return self._enter() Jul 28 09:06:20.675565 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 09:06:20.675565 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 09:06:20.675565 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 09:06:20.675565 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return self.creator() Jul 28 09:06:20.675565 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 09:06:20.675565 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application created_value = creator( Jul 28 09:06:20.676498 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 09:06:20.676498 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 09:06:20.676498 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 09:06:20.676498 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application Jul 28 09:06:20.678086 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2092a844-d119-4008-86ec-b14d59d8dab5 None admin] Validating token access rules against request {{(pid=416293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:06:20.680351 dv-cinder-851351-1-smb devstack@keystone.service[416294]: [pid: 416294|app: 0|req: 259/505] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 09:06:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 09:06:20.681742 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a240361-5a11-4a67-bd62-200d48176681 None None] REQUEST_METHOD: `POST` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:06:20.681999 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a240361-5a11-4a67-bd62-200d48176681 None None] SCRIPT_NAME: `/identity` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:06:20.682308 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a240361-5a11-4a67-bd62-200d48176681 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:06:20.702343 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.auth.core [None req-1a240361-5a11-4a67-bd62-200d48176681 None None] MFA Rules not processed for user `dbf87abab90e4fdf9e75408f4199918e`. Rule list: `[]` (Enabled: `True`). {{(pid=416294) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 09:06:20.703579 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.fernet_utils [None req-1a240361-5a11-4a67-bd62-200d48176681 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=416294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 09:06:20.715500 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ed82e7-bc56-4436-af00-733410657e98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:06:20.716145 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ed82e7-bc56-4436-af00-733410657e98 None admin] REQUEST_METHOD: `GET` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:06:20.716431 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ed82e7-bc56-4436-af00-733410657e98 None admin] SCRIPT_NAME: `/identity` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:06:20.716742 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ed82e7-bc56-4436-af00-733410657e98 None admin] PATH_INFO: `/v3/roles` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:06:20.717486 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ed82e7-bc56-4436-af00-733410657e98 None admin] RBAC: Adding query filter params (name=service) {{(pid=416293) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 09:06:20.717796 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ed82e7-bc56-4436-af00-733410657e98 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:06:20.719200 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ed82e7-bc56-4436-af00-733410657e98 None admin] RBAC: Authorization granted {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:06:20.727751 dv-cinder-851351-1-smb devstack@keystone.service[416293]: [pid: 416293|app: 0|req: 247/506] 10.222.0.42 () {56 vars in 1103 bytes} [Thu Jul 28 09:06:20 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:06:20.728617 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ed82e7-bc56-4436-af00-733410657e98 None admin] Authenticating user token {{(pid=416293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:06:20.778796 dv-cinder-851351-1-smb devstack@keystone.service[416294]: [pid: 416294|app: 0|req: 260/507] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 09:06:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 09:06:20.779742 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a240361-5a11-4a67-bd62-200d48176681 None None] Authenticating user token {{(pid=416294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:06:20.835218 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ed82e7-bc56-4436-af00-733410657e98 None admin] Validating token access rules against request {{(pid=416293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:06:20.845664 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG dbcounter [-] [416294] Writing DB stats keystone:SELECT=100 {{(pid=416294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:06:20.870890 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3ad582-f484-42b1-8d38-46df8fc323c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:06:20.871553 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3ad582-f484-42b1-8d38-46df8fc323c5 None admin] REQUEST_METHOD: `GET` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:06:20.871846 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3ad582-f484-42b1-8d38-46df8fc323c5 None admin] SCRIPT_NAME: `/identity` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:06:20.872128 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3ad582-f484-42b1-8d38-46df8fc323c5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:06:20.883212 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa3ad582-f484-42b1-8d38-46df8fc323c5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:06:20.884742 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa3ad582-f484-42b1-8d38-46df8fc323c5 None admin] RBAC: Authorization granted {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:06:20.884845 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a240361-5a11-4a67-bd62-200d48176681 None None] Validating token access rules against request {{(pid=416294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:06:20.891267 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG dbcounter [-] [416293] Writing DB stats keystone:SELECT=100 {{(pid=416293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:06:20.901010 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application [None req-fa3ad582-f484-42b1-8d38-46df8fc323c5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 09:06:20.901010 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 09:06:20.901010 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 09:06:20.901010 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 09:06:20.901010 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 09:06:20.901010 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 09:06:20.901010 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 09:06:20.901010 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 09:06:20.901010 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 09:06:20.901010 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 09:06:20.901010 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 09:06:20.901010 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 09:06:20.901010 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 09:06:20.901010 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 09:06:20.901010 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 09:06:20.902101 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 09:06:20.902101 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 09:06:20.902101 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 09:06:20.902101 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 09:06:20.902101 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 09:06:20.902101 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 09:06:20.902101 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 09:06:20.902101 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 09:06:20.902101 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application with Lock( Jul 28 09:06:20.902101 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 09:06:20.902101 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self._enter() Jul 28 09:06:20.902101 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 09:06:20.902101 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 09:06:20.902101 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 09:06:20.902101 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self.creator() Jul 28 09:06:20.902101 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 09:06:20.902101 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application created_value = creator( Jul 28 09:06:20.903027 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 09:06:20.903027 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 09:06:20.903027 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 09:06:20.903027 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application Jul 28 09:06:20.903027 dv-cinder-851351-1-smb devstack@keystone.service[416293]: [pid: 416293|app: 0|req: 248/508] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 09:06:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 09:06:20.903310 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3ad582-f484-42b1-8d38-46df8fc323c5 None admin] Authenticating user token {{(pid=416293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:06:20.924961 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005e0b7d-cbae-40a7-8838-26463e083970 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:06:20.925614 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005e0b7d-cbae-40a7-8838-26463e083970 None admin] REQUEST_METHOD: `GET` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:06:20.925879 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005e0b7d-cbae-40a7-8838-26463e083970 None admin] SCRIPT_NAME: `/identity` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:06:20.926146 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005e0b7d-cbae-40a7-8838-26463e083970 None admin] PATH_INFO: `/v3/users` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:06:20.926949 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-005e0b7d-cbae-40a7-8838-26463e083970 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=416294) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 09:06:20.927265 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-005e0b7d-cbae-40a7-8838-26463e083970 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:06:20.928707 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-005e0b7d-cbae-40a7-8838-26463e083970 None admin] RBAC: Authorization granted {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:06:20.946803 dv-cinder-851351-1-smb devstack@keystone.service[416294]: [pid: 416294|app: 0|req: 261/509] 10.222.0.42 () {56 vars in 1137 bytes} [Thu Jul 28 09:06:20 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:06:20.947679 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005e0b7d-cbae-40a7-8838-26463e083970 None admin] Authenticating user token {{(pid=416294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:06:21.011117 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3ad582-f484-42b1-8d38-46df8fc323c5 None admin] Validating token access rules against request {{(pid=416293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:06:21.050921 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8ed47a-1fab-435b-9622-37a2dd34990e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:06:21.051573 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8ed47a-1fab-435b-9622-37a2dd34990e None admin] REQUEST_METHOD: `GET` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:06:21.051857 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8ed47a-1fab-435b-9622-37a2dd34990e None admin] SCRIPT_NAME: `/identity` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:06:21.052131 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8ed47a-1fab-435b-9622-37a2dd34990e None admin] PATH_INFO: `/v3/domains` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:06:21.052869 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc8ed47a-1fab-435b-9622-37a2dd34990e None admin] RBAC: Adding query filter params (name=Default) {{(pid=416293) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 09:06:21.053181 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc8ed47a-1fab-435b-9622-37a2dd34990e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:06:21.054581 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc8ed47a-1fab-435b-9622-37a2dd34990e None admin] RBAC: Authorization granted {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:06:21.060782 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005e0b7d-cbae-40a7-8838-26463e083970 None admin] Validating token access rules against request {{(pid=416294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:06:21.067882 dv-cinder-851351-1-smb devstack@keystone.service[416293]: [pid: 416293|app: 0|req: 249/510] 10.222.0.42 () {56 vars in 1109 bytes} [Thu Jul 28 09:06:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:06:21.068796 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8ed47a-1fab-435b-9622-37a2dd34990e None admin] Authenticating user token {{(pid=416293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:06:21.090500 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG dbcounter [-] [416294] Writing DB stats keystone:SELECT=100 {{(pid=416294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:06:21.103722 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d072a2dd-288b-4439-be14-7b519bd52d1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:06:21.104381 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d072a2dd-288b-4439-be14-7b519bd52d1b None admin] REQUEST_METHOD: `GET` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:06:21.104652 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d072a2dd-288b-4439-be14-7b519bd52d1b None admin] SCRIPT_NAME: `/identity` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:06:21.104956 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d072a2dd-288b-4439-be14-7b519bd52d1b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:06:21.116431 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d072a2dd-288b-4439-be14-7b519bd52d1b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:06:21.117931 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d072a2dd-288b-4439-be14-7b519bd52d1b None admin] RBAC: Authorization granted {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:06:21.133249 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG dbcounter [-] [416293] Writing DB stats keystone:SELECT=100 {{(pid=416293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:06:21.134148 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application [None req-d072a2dd-288b-4439-be14-7b519bd52d1b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 09:06:21.134148 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 09:06:21.134148 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 09:06:21.134148 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 09:06:21.134148 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 09:06:21.134148 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 09:06:21.134148 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 09:06:21.134148 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 09:06:21.134148 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 09:06:21.134148 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 09:06:21.134148 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 09:06:21.134148 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 09:06:21.134148 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 09:06:21.134148 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 09:06:21.134148 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 09:06:21.135060 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 09:06:21.135060 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 09:06:21.135060 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 09:06:21.135060 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 09:06:21.135060 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 09:06:21.135060 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 09:06:21.135060 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 09:06:21.135060 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 09:06:21.135060 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application with Lock( Jul 28 09:06:21.135060 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 09:06:21.135060 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return self._enter() Jul 28 09:06:21.135060 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 09:06:21.135060 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 09:06:21.135060 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 09:06:21.135060 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return self.creator() Jul 28 09:06:21.135060 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 09:06:21.135060 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application created_value = creator( Jul 28 09:06:21.136025 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 09:06:21.136025 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 09:06:21.136025 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 09:06:21.136025 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application Jul 28 09:06:21.136025 dv-cinder-851351-1-smb devstack@keystone.service[416294]: [pid: 416294|app: 0|req: 262/511] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 09:06:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 09:06:21.136311 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d072a2dd-288b-4439-be14-7b519bd52d1b None admin] Authenticating user token {{(pid=416294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:06:21.179830 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8ed47a-1fab-435b-9622-37a2dd34990e None admin] Validating token access rules against request {{(pid=416293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:06:21.215654 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf606a6-3cda-41a1-a87f-e8d15ee323fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:06:21.216344 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf606a6-3cda-41a1-a87f-e8d15ee323fd None admin] REQUEST_METHOD: `GET` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:06:21.216590 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf606a6-3cda-41a1-a87f-e8d15ee323fd None admin] SCRIPT_NAME: `/identity` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:06:21.216896 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf606a6-3cda-41a1-a87f-e8d15ee323fd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:06:21.227995 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edf606a6-3cda-41a1-a87f-e8d15ee323fd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:06:21.229517 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edf606a6-3cda-41a1-a87f-e8d15ee323fd None admin] RBAC: Authorization granted {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:06:21.245918 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application [None req-edf606a6-3cda-41a1-a87f-e8d15ee323fd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 09:06:21.245918 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 09:06:21.245918 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 09:06:21.245918 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 09:06:21.245918 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 09:06:21.245918 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 09:06:21.245918 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 09:06:21.245918 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 09:06:21.245918 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 09:06:21.245918 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 09:06:21.245918 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 09:06:21.245918 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 09:06:21.245918 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 09:06:21.245918 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 09:06:21.245918 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 09:06:21.247088 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 09:06:21.247088 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 09:06:21.247088 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 09:06:21.247088 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 09:06:21.247088 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 09:06:21.247088 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 09:06:21.247088 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 09:06:21.247088 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 09:06:21.247088 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application with Lock( Jul 28 09:06:21.247088 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 09:06:21.247088 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self._enter() Jul 28 09:06:21.247088 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 09:06:21.247088 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 09:06:21.247088 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 09:06:21.247088 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self.creator() Jul 28 09:06:21.247088 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 09:06:21.247088 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application created_value = creator( Jul 28 09:06:21.248203 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 09:06:21.248203 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 09:06:21.248203 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 09:06:21.248203 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application Jul 28 09:06:21.248203 dv-cinder-851351-1-smb devstack@keystone.service[416293]: [pid: 416293|app: 0|req: 250/512] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 09:06:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 09:06:21.248203 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf606a6-3cda-41a1-a87f-e8d15ee323fd None admin] Authenticating user token {{(pid=416293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:06:21.253228 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d072a2dd-288b-4439-be14-7b519bd52d1b None admin] Validating token access rules against request {{(pid=416294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:06:21.290187 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f9d089-8392-439b-8d12-2a173ad8fb87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:06:21.290840 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f9d089-8392-439b-8d12-2a173ad8fb87 None admin] REQUEST_METHOD: `GET` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:06:21.291149 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f9d089-8392-439b-8d12-2a173ad8fb87 None admin] SCRIPT_NAME: `/identity` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:06:21.291424 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f9d089-8392-439b-8d12-2a173ad8fb87 None admin] PATH_INFO: `/v3/domains` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:06:21.292126 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47f9d089-8392-439b-8d12-2a173ad8fb87 None admin] RBAC: Adding query filter params (name=Default) {{(pid=416294) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 09:06:21.292431 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47f9d089-8392-439b-8d12-2a173ad8fb87 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:06:21.293907 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47f9d089-8392-439b-8d12-2a173ad8fb87 None admin] RBAC: Authorization granted {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:06:21.306188 dv-cinder-851351-1-smb devstack@keystone.service[416294]: [pid: 416294|app: 0|req: 263/513] 10.222.0.42 () {56 vars in 1109 bytes} [Thu Jul 28 09:06:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:06:21.307072 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f9d089-8392-439b-8d12-2a173ad8fb87 None admin] Authenticating user token {{(pid=416294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:06:21.343145 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG dbcounter [-] [416294] Writing DB stats keystone:SELECT=100 {{(pid=416294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:06:21.359292 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf606a6-3cda-41a1-a87f-e8d15ee323fd None admin] Validating token access rules against request {{(pid=416293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:06:21.370603 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG dbcounter [-] [416293] Writing DB stats keystone:SELECT=100 {{(pid=416293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:06:21.395924 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-329410df-e0a7-47ec-b125-886708b8d4cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:06:21.396568 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329410df-e0a7-47ec-b125-886708b8d4cf None admin] REQUEST_METHOD: `GET` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:06:21.396892 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329410df-e0a7-47ec-b125-886708b8d4cf None admin] SCRIPT_NAME: `/identity` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:06:21.397171 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329410df-e0a7-47ec-b125-886708b8d4cf None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:06:21.411074 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f9d089-8392-439b-8d12-2a173ad8fb87 None admin] Validating token access rules against request {{(pid=416294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:06:21.450685 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4138243-f89f-4bb3-b964-e82adcc6ce1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:06:21.451343 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4138243-f89f-4bb3-b964-e82adcc6ce1a None admin] REQUEST_METHOD: `GET` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:06:21.451648 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4138243-f89f-4bb3-b964-e82adcc6ce1a None admin] SCRIPT_NAME: `/identity` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:06:21.451918 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4138243-f89f-4bb3-b964-e82adcc6ce1a None admin] PATH_INFO: `/v3/projects/service` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:06:21.459042 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4138243-f89f-4bb3-b964-e82adcc6ce1a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:06:21.460533 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4138243-f89f-4bb3-b964-e82adcc6ce1a None admin] RBAC: Authorization granted {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:06:21.466920 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-329410df-e0a7-47ec-b125-886708b8d4cf None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:06:21.468392 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-329410df-e0a7-47ec-b125-886708b8d4cf None admin] RBAC: Authorization granted {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:06:21.472564 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application [None req-d4138243-f89f-4bb3-b964-e82adcc6ce1a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 09:06:21.472564 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 09:06:21.472564 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 09:06:21.472564 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 09:06:21.472564 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 09:06:21.472564 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 09:06:21.472564 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 09:06:21.472564 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 09:06:21.472564 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 09:06:21.472564 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 09:06:21.472564 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 09:06:21.472564 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 09:06:21.472564 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 28 09:06:21.472564 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 28 09:06:21.472564 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 28 09:06:21.473545 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 28 09:06:21.473545 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 09:06:21.473545 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 09:06:21.473545 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 09:06:21.473545 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 09:06:21.473545 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 09:06:21.473545 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 09:06:21.473545 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 09:06:21.473545 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application with Lock( Jul 28 09:06:21.473545 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 09:06:21.473545 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return self._enter() Jul 28 09:06:21.473545 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 09:06:21.473545 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 09:06:21.473545 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 09:06:21.473545 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return self.creator() Jul 28 09:06:21.473545 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 09:06:21.473545 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application created_value = creator( Jul 28 09:06:21.474487 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 28 09:06:21.474487 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 28 09:06:21.474487 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 28 09:06:21.474487 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 28 09:06:21.474487 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 28 09:06:21.474487 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 28 09:06:21.474487 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 09:06:21.474487 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application Jul 28 09:06:21.474487 dv-cinder-851351-1-smb devstack@keystone.service[416294]: [pid: 416294|app: 0|req: 264/514] 10.222.0.42 () {56 vars in 1111 bytes} [Thu Jul 28 09:06:21 2022] GET /identity/v3/projects/service => generated 88 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 09:06:21.475015 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4138243-f89f-4bb3-b964-e82adcc6ce1a None admin] Authenticating user token {{(pid=416294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:06:21.570210 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG dbcounter [-] [416294] Writing DB stats keystone:SELECT=100 {{(pid=416294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:06:21.572641 dv-cinder-851351-1-smb devstack@keystone.service[416293]: [pid: 416293|app: 0|req: 251/515] 10.222.0.42 () {58 vars in 1282 bytes} [Thu Jul 28 09:06:21 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 28 09:06:21.573934 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-329410df-e0a7-47ec-b125-886708b8d4cf None admin] Authenticating user token {{(pid=416293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:06:21.580616 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4138243-f89f-4bb3-b964-e82adcc6ce1a None admin] Validating token access rules against request {{(pid=416294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:06:21.587332 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG dbcounter [-] [416293] Writing DB stats keystone:SELECT=100 {{(pid=416293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:06:21.616233 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e55957-3bbb-4163-8b0e-541cdb60b887 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:06:21.616822 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e55957-3bbb-4163-8b0e-541cdb60b887 None admin] REQUEST_METHOD: `GET` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:06:21.617114 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e55957-3bbb-4163-8b0e-541cdb60b887 None admin] SCRIPT_NAME: `/identity` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:06:21.617396 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e55957-3bbb-4163-8b0e-541cdb60b887 None admin] PATH_INFO: `/v3/domains` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:06:21.618104 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e55957-3bbb-4163-8b0e-541cdb60b887 None admin] RBAC: Adding query filter params (name=Default) {{(pid=416294) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 09:06:21.618413 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e55957-3bbb-4163-8b0e-541cdb60b887 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:06:21.619812 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e55957-3bbb-4163-8b0e-541cdb60b887 None admin] RBAC: Authorization granted {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:06:21.636213 dv-cinder-851351-1-smb devstack@keystone.service[416294]: [pid: 416294|app: 0|req: 265/516] 10.222.0.42 () {56 vars in 1109 bytes} [Thu Jul 28 09:06:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:06:21.637154 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e55957-3bbb-4163-8b0e-541cdb60b887 None admin] Authenticating user token {{(pid=416294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:06:21.687577 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-329410df-e0a7-47ec-b125-886708b8d4cf None admin] Validating token access rules against request {{(pid=416293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:06:21.721528 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b27de80-5a34-4dee-b8c3-bc257c66f6bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:06:21.722155 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b27de80-5a34-4dee-b8c3-bc257c66f6bd None admin] REQUEST_METHOD: `GET` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:06:21.722442 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b27de80-5a34-4dee-b8c3-bc257c66f6bd None admin] SCRIPT_NAME: `/identity` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:06:21.722720 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b27de80-5a34-4dee-b8c3-bc257c66f6bd None admin] PATH_INFO: `/v3/domains` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:06:21.723433 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b27de80-5a34-4dee-b8c3-bc257c66f6bd None admin] RBAC: Adding query filter params (name=Default) {{(pid=416293) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 09:06:21.723733 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b27de80-5a34-4dee-b8c3-bc257c66f6bd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:06:21.725177 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b27de80-5a34-4dee-b8c3-bc257c66f6bd None admin] RBAC: Authorization granted {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:06:21.736649 dv-cinder-851351-1-smb devstack@keystone.service[416293]: [pid: 416293|app: 0|req: 252/517] 10.222.0.42 () {56 vars in 1109 bytes} [Thu Jul 28 09:06:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:06:21.737493 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b27de80-5a34-4dee-b8c3-bc257c66f6bd None admin] Authenticating user token {{(pid=416293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:06:21.742590 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e55957-3bbb-4163-8b0e-541cdb60b887 None admin] Validating token access rules against request {{(pid=416294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:06:21.778150 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ecac3d2-3ce9-40d6-bd16-2db1d876f114 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:06:21.778806 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ecac3d2-3ce9-40d6-bd16-2db1d876f114 None admin] REQUEST_METHOD: `GET` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:06:21.779081 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ecac3d2-3ce9-40d6-bd16-2db1d876f114 None admin] SCRIPT_NAME: `/identity` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:06:21.779382 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ecac3d2-3ce9-40d6-bd16-2db1d876f114 None admin] PATH_INFO: `/v3/users/glance` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:06:21.787158 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ecac3d2-3ce9-40d6-bd16-2db1d876f114 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:06:21.788644 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ecac3d2-3ce9-40d6-bd16-2db1d876f114 None admin] RBAC: Authorization granted {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:06:21.801592 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application [None req-6ecac3d2-3ce9-40d6-bd16-2db1d876f114 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jul 28 09:06:21.801592 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 09:06:21.801592 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 09:06:21.801592 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 09:06:21.801592 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 09:06:21.801592 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 09:06:21.801592 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 09:06:21.801592 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 09:06:21.801592 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 09:06:21.801592 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 09:06:21.801592 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 09:06:21.801592 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 09:06:21.801592 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 28 09:06:21.801592 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 28 09:06:21.801592 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 28 09:06:21.801592 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 28 09:06:21.802610 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 09:06:21.802610 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 09:06:21.802610 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 28 09:06:21.802610 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 09:06:21.802610 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 28 09:06:21.802610 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 09:06:21.802610 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 09:06:21.802610 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 09:06:21.802610 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 09:06:21.802610 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 09:06:21.802610 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 09:06:21.802610 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application with Lock( Jul 28 09:06:21.802610 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 09:06:21.802610 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return self._enter() Jul 28 09:06:21.802610 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 09:06:21.802610 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 09:06:21.802610 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 09:06:21.802610 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return self.creator() Jul 28 09:06:21.803565 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 09:06:21.803565 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application created_value = creator( Jul 28 09:06:21.803565 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 28 09:06:21.803565 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 28 09:06:21.803565 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 28 09:06:21.803565 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 28 09:06:21.803565 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 28 09:06:21.803565 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 28 09:06:21.803565 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jul 28 09:06:21.803565 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application Jul 28 09:06:21.803565 dv-cinder-851351-1-smb devstack@keystone.service[416294]: [pid: 416294|app: 0|req: 266/518] 10.222.0.42 () {56 vars in 1099 bytes} [Thu Jul 28 09:06:21 2022] GET /identity/v3/users/glance => generated 84 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 09:06:21.804168 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ecac3d2-3ce9-40d6-bd16-2db1d876f114 None admin] Authenticating user token {{(pid=416294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:06:21.814840 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG dbcounter [-] [416293] Writing DB stats keystone:SELECT=100 {{(pid=416293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:06:21.820896 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG dbcounter [-] [416294] Writing DB stats keystone:SELECT=100 {{(pid=416294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:06:21.848122 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b27de80-5a34-4dee-b8c3-bc257c66f6bd None admin] Validating token access rules against request {{(pid=416293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:06:21.882389 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78dc6f12-fc38-4496-b399-6825df5c91c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:06:21.882944 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78dc6f12-fc38-4496-b399-6825df5c91c3 None admin] REQUEST_METHOD: `GET` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:06:21.883227 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78dc6f12-fc38-4496-b399-6825df5c91c3 None admin] SCRIPT_NAME: `/identity` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:06:21.883501 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78dc6f12-fc38-4496-b399-6825df5c91c3 None admin] PATH_INFO: `/v3/projects` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:06:21.884258 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78dc6f12-fc38-4496-b399-6825df5c91c3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=416293) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 09:06:21.884562 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78dc6f12-fc38-4496-b399-6825df5c91c3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:06:21.886075 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78dc6f12-fc38-4496-b399-6825df5c91c3 None admin] RBAC: Authorization granted {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:06:21.905489 dv-cinder-851351-1-smb devstack@keystone.service[416293]: [pid: 416293|app: 0|req: 253/519] 10.222.0.42 () {56 vars in 1148 bytes} [Thu Jul 28 09:06:21 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:06:21.906854 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78dc6f12-fc38-4496-b399-6825df5c91c3 None admin] Authenticating user token {{(pid=416293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:06:21.912317 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ecac3d2-3ce9-40d6-bd16-2db1d876f114 None admin] Validating token access rules against request {{(pid=416294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:06:21.956656 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd26fa4-7f1d-4245-9329-7676128b11b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:06:21.957414 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd26fa4-7f1d-4245-9329-7676128b11b7 None admin] REQUEST_METHOD: `GET` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:06:21.957699 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd26fa4-7f1d-4245-9329-7676128b11b7 None admin] SCRIPT_NAME: `/identity` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:06:21.957978 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd26fa4-7f1d-4245-9329-7676128b11b7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:06:21.971484 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd26fa4-7f1d-4245-9329-7676128b11b7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:06:21.973083 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd26fa4-7f1d-4245-9329-7676128b11b7 None admin] RBAC: Authorization granted {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:06:21.991697 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application [None req-2fd26fa4-7f1d-4245-9329-7676128b11b7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 09:06:21.991697 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 09:06:21.991697 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 09:06:21.991697 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 09:06:21.991697 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 09:06:21.991697 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 09:06:21.991697 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 09:06:21.991697 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 09:06:21.991697 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 09:06:21.991697 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 09:06:21.991697 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 09:06:21.991697 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 09:06:21.991697 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 09:06:21.991697 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 09:06:21.991697 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 09:06:21.992918 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 09:06:21.992918 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 09:06:21.992918 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 09:06:21.992918 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 09:06:21.992918 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 09:06:21.992918 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 09:06:21.992918 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 09:06:21.992918 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 09:06:21.992918 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application with Lock( Jul 28 09:06:21.992918 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 09:06:21.992918 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return self._enter() Jul 28 09:06:21.992918 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 09:06:21.992918 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 09:06:21.992918 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 09:06:21.992918 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return self.creator() Jul 28 09:06:21.992918 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 09:06:21.992918 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application created_value = creator( Jul 28 09:06:21.993879 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 09:06:21.993879 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 09:06:21.993879 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 09:06:21.993879 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application Jul 28 09:06:21.993879 dv-cinder-851351-1-smb devstack@keystone.service[416294]: [pid: 416294|app: 0|req: 267/520] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 09:06:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 09:06:21.994491 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd26fa4-7f1d-4245-9329-7676128b11b7 None admin] Authenticating user token {{(pid=416294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:06:22.024781 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78dc6f12-fc38-4496-b399-6825df5c91c3 None admin] Validating token access rules against request {{(pid=416293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:06:22.055071 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG dbcounter [-] [416293] Writing DB stats keystone:SELECT=100 {{(pid=416293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:06:22.061055 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a547877d-46df-4d33-8f26-d1a1ed5fc21b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:06:22.061723 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a547877d-46df-4d33-8f26-d1a1ed5fc21b None admin] REQUEST_METHOD: `GET` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:06:22.062003 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a547877d-46df-4d33-8f26-d1a1ed5fc21b None admin] SCRIPT_NAME: `/identity` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:06:22.062284 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a547877d-46df-4d33-8f26-d1a1ed5fc21b None admin] PATH_INFO: `/v3/users/neutron` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:06:22.063011 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG dbcounter [-] [416294] Writing DB stats keystone:SELECT=100 {{(pid=416294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:06:22.070172 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a547877d-46df-4d33-8f26-d1a1ed5fc21b None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:06:22.071657 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a547877d-46df-4d33-8f26-d1a1ed5fc21b None admin] RBAC: Authorization granted {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:06:22.084104 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application [None req-a547877d-46df-4d33-8f26-d1a1ed5fc21b None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jul 28 09:06:22.084104 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 09:06:22.084104 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 09:06:22.084104 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 09:06:22.084104 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 09:06:22.084104 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 09:06:22.084104 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 09:06:22.084104 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 09:06:22.084104 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 09:06:22.084104 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 09:06:22.084104 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 09:06:22.084104 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 09:06:22.084104 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 28 09:06:22.084104 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 28 09:06:22.084104 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 28 09:06:22.084104 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 28 09:06:22.085335 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 09:06:22.085335 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 09:06:22.085335 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 28 09:06:22.085335 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 09:06:22.085335 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 28 09:06:22.085335 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 09:06:22.085335 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 09:06:22.085335 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 09:06:22.085335 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 09:06:22.085335 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 09:06:22.085335 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 09:06:22.085335 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application with Lock( Jul 28 09:06:22.085335 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 09:06:22.085335 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self._enter() Jul 28 09:06:22.085335 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 09:06:22.085335 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 09:06:22.085335 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 09:06:22.085335 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self.creator() Jul 28 09:06:22.086519 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 09:06:22.086519 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application created_value = creator( Jul 28 09:06:22.086519 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 28 09:06:22.086519 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 28 09:06:22.086519 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 28 09:06:22.086519 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 28 09:06:22.086519 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 28 09:06:22.086519 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 28 09:06:22.086519 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jul 28 09:06:22.086519 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application Jul 28 09:06:22.086519 dv-cinder-851351-1-smb devstack@keystone.service[416293]: [pid: 416293|app: 0|req: 254/521] 10.222.0.42 () {56 vars in 1102 bytes} [Thu Jul 28 09:06:21 2022] GET /identity/v3/users/neutron => generated 85 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 09:06:22.086519 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a547877d-46df-4d33-8f26-d1a1ed5fc21b None admin] Authenticating user token {{(pid=416293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:06:22.102841 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd26fa4-7f1d-4245-9329-7676128b11b7 None admin] Validating token access rules against request {{(pid=416294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:06:22.136212 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df622379-cfec-4e7a-b5b2-4db04554f2b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:06:22.136786 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df622379-cfec-4e7a-b5b2-4db04554f2b8 None admin] REQUEST_METHOD: `POST` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:06:22.137077 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df622379-cfec-4e7a-b5b2-4db04554f2b8 None admin] SCRIPT_NAME: `/identity` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:06:22.137352 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df622379-cfec-4e7a-b5b2-4db04554f2b8 None admin] PATH_INFO: `/v3/users` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:06:22.138040 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df622379-cfec-4e7a-b5b2-4db04554f2b8 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:06:22.139511 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df622379-cfec-4e7a-b5b2-4db04554f2b8 None admin] RBAC: Authorization granted {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:06:22.162956 dv-cinder-851351-1-smb devstack@keystone.service[416294]: [pid: 416294|app: 0|req: 268/522] 10.222.0.42 () {60 vars in 1132 bytes} [Thu Jul 28 09:06:21 2022] POST /identity/v3/users => generated 247 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 09:06:22.163880 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df622379-cfec-4e7a-b5b2-4db04554f2b8 None admin] Authenticating user token {{(pid=416294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:06:22.206585 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a547877d-46df-4d33-8f26-d1a1ed5fc21b None admin] Validating token access rules against request {{(pid=416293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:06:22.251229 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8cdb3c-02ba-4fb0-8c51-562b2a609e69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:06:22.251940 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8cdb3c-02ba-4fb0-8c51-562b2a609e69 None admin] REQUEST_METHOD: `GET` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:06:22.252186 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8cdb3c-02ba-4fb0-8c51-562b2a609e69 None admin] SCRIPT_NAME: `/identity` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:06:22.252423 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8cdb3c-02ba-4fb0-8c51-562b2a609e69 None admin] PATH_INFO: `/v3/users` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:06:22.253295 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea8cdb3c-02ba-4fb0-8c51-562b2a609e69 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=416293) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 09:06:22.253606 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea8cdb3c-02ba-4fb0-8c51-562b2a609e69 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:06:22.255138 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea8cdb3c-02ba-4fb0-8c51-562b2a609e69 None admin] RBAC: Authorization granted {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:06:22.285418 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df622379-cfec-4e7a-b5b2-4db04554f2b8 None admin] Validating token access rules against request {{(pid=416294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:06:22.299749 dv-cinder-851351-1-smb devstack@keystone.service[416293]: [pid: 416293|app: 0|req: 255/523] 10.222.0.42 () {56 vars in 1137 bytes} [Thu Jul 28 09:06:22 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:06:22.300650 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8cdb3c-02ba-4fb0-8c51-562b2a609e69 None admin] Authenticating user token {{(pid=416293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:06:22.327333 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG dbcounter [-] [416294] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=416294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:06:22.348262 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5b2949-b422-4cb1-aaf7-3a43f9490a1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:06:22.348961 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5b2949-b422-4cb1-aaf7-3a43f9490a1e None admin] REQUEST_METHOD: `GET` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:06:22.349244 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5b2949-b422-4cb1-aaf7-3a43f9490a1e None admin] SCRIPT_NAME: `/identity` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:06:22.349515 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5b2949-b422-4cb1-aaf7-3a43f9490a1e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:06:22.350319 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f5b2949-b422-4cb1-aaf7-3a43f9490a1e None admin] RBAC: Adding query filter params (role.id=13417fbdbc5145a69bc01ff0f931fd96, scope.project.id=6c4349445f224184b093d9dfd0dfc642, user.id=62f7da38a7044000bdf5790da751a45e) {{(pid=416294) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 09:06:22.350627 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f5b2949-b422-4cb1-aaf7-3a43f9490a1e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:06:22.352077 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f5b2949-b422-4cb1-aaf7-3a43f9490a1e None admin] RBAC: Authorization granted {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:06:22.358628 dv-cinder-851351-1-smb devstack@keystone.service[416294]: [pid: 416294|app: 0|req: 269/524] 10.222.0.42 () {56 vars in 1374 bytes} [Thu Jul 28 09:06:22 2022] GET /identity/v3/role_assignments?user.id=62f7da38a7044000bdf5790da751a45e&scope.project.id=6c4349445f224184b093d9dfd0dfc642&role.id=13417fbdbc5145a69bc01ff0f931fd96 => generated 259 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:06:22.359328 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5b2949-b422-4cb1-aaf7-3a43f9490a1e None admin] Authenticating user token {{(pid=416294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:06:22.369965 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG dbcounter [-] [416293] Writing DB stats keystone:SELECT=100 {{(pid=416293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:06:22.445557 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8cdb3c-02ba-4fb0-8c51-562b2a609e69 None admin] Validating token access rules against request {{(pid=416293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:06:22.491127 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4863ca2b-57a1-4e5c-bfc5-1873225b26b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:06:22.491790 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4863ca2b-57a1-4e5c-bfc5-1873225b26b3 None admin] REQUEST_METHOD: `GET` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:06:22.492080 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4863ca2b-57a1-4e5c-bfc5-1873225b26b3 None admin] SCRIPT_NAME: `/identity` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:06:22.492359 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4863ca2b-57a1-4e5c-bfc5-1873225b26b3 None admin] PATH_INFO: `/v3/domains` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:06:22.493174 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4863ca2b-57a1-4e5c-bfc5-1873225b26b3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=416293) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 09:06:22.493488 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4863ca2b-57a1-4e5c-bfc5-1873225b26b3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:06:22.494985 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4863ca2b-57a1-4e5c-bfc5-1873225b26b3 None admin] RBAC: Authorization granted {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:06:22.502934 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5b2949-b422-4cb1-aaf7-3a43f9490a1e None admin] Validating token access rules against request {{(pid=416294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:06:22.509228 dv-cinder-851351-1-smb devstack@keystone.service[416293]: [pid: 416293|app: 0|req: 256/525] 10.222.0.42 () {56 vars in 1109 bytes} [Thu Jul 28 09:06:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:06:22.510533 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4863ca2b-57a1-4e5c-bfc5-1873225b26b3 None admin] Authenticating user token {{(pid=416293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:06:22.541832 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a3c825-8d15-476d-8b98-be51ee2687e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:06:22.542483 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a3c825-8d15-476d-8b98-be51ee2687e6 None admin] REQUEST_METHOD: `GET` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:06:22.542768 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a3c825-8d15-476d-8b98-be51ee2687e6 None admin] SCRIPT_NAME: `/identity` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:06:22.543042 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a3c825-8d15-476d-8b98-be51ee2687e6 None admin] PATH_INFO: `/v3/users` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:06:22.543860 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a3c825-8d15-476d-8b98-be51ee2687e6 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=416294) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 09:06:22.544167 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a3c825-8d15-476d-8b98-be51ee2687e6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:06:22.545682 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a3c825-8d15-476d-8b98-be51ee2687e6 None admin] RBAC: Authorization granted {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:06:22.566377 dv-cinder-851351-1-smb devstack@keystone.service[416294]: [pid: 416294|app: 0|req: 270/526] 10.222.0.42 () {56 vars in 1139 bytes} [Thu Jul 28 09:06:22 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:06:22.567265 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a3c825-8d15-476d-8b98-be51ee2687e6 None admin] Authenticating user token {{(pid=416294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:06:22.620887 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG dbcounter [-] [416294] Writing DB stats keystone:SELECT=100 {{(pid=416294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:06:22.648548 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4863ca2b-57a1-4e5c-bfc5-1873225b26b3 None admin] Validating token access rules against request {{(pid=416293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:06:22.659281 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG dbcounter [-] [416293] Writing DB stats keystone:SELECT=100 {{(pid=416293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:06:22.691026 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c599bad6-0a12-4708-b069-2b60fe1649ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:06:22.691669 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c599bad6-0a12-4708-b069-2b60fe1649ff None admin] REQUEST_METHOD: `GET` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:06:22.691953 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c599bad6-0a12-4708-b069-2b60fe1649ff None admin] SCRIPT_NAME: `/identity` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:06:22.692229 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c599bad6-0a12-4708-b069-2b60fe1649ff None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:06:22.704293 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a3c825-8d15-476d-8b98-be51ee2687e6 None admin] Validating token access rules against request {{(pid=416294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:06:22.759489 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccafc7c5-ee40-451d-b8d5-76aa47fbac7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:06:22.760620 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccafc7c5-ee40-451d-b8d5-76aa47fbac7c None admin] REQUEST_METHOD: `GET` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:06:22.761092 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccafc7c5-ee40-451d-b8d5-76aa47fbac7c None admin] SCRIPT_NAME: `/identity` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:06:22.761853 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccafc7c5-ee40-451d-b8d5-76aa47fbac7c None admin] PATH_INFO: `/v3/projects/service` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:06:22.768993 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c599bad6-0a12-4708-b069-2b60fe1649ff None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:06:22.770798 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c599bad6-0a12-4708-b069-2b60fe1649ff None admin] RBAC: Authorization granted {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:06:22.771881 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccafc7c5-ee40-451d-b8d5-76aa47fbac7c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:06:22.773764 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccafc7c5-ee40-451d-b8d5-76aa47fbac7c None admin] RBAC: Authorization granted {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:06:22.789891 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application [None req-ccafc7c5-ee40-451d-b8d5-76aa47fbac7c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 09:06:22.789891 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 09:06:22.789891 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 09:06:22.789891 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 09:06:22.789891 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 09:06:22.789891 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 09:06:22.789891 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 09:06:22.789891 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 09:06:22.789891 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 09:06:22.789891 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 09:06:22.789891 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 09:06:22.789891 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 09:06:22.789891 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 28 09:06:22.789891 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 28 09:06:22.789891 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 28 09:06:22.791035 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 28 09:06:22.791035 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 09:06:22.791035 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 09:06:22.791035 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 09:06:22.791035 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 09:06:22.791035 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 09:06:22.791035 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 09:06:22.791035 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 09:06:22.791035 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application with Lock( Jul 28 09:06:22.791035 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 09:06:22.791035 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return self._enter() Jul 28 09:06:22.791035 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 09:06:22.791035 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 09:06:22.791035 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 09:06:22.791035 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return self.creator() Jul 28 09:06:22.791035 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 09:06:22.791035 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application created_value = creator( Jul 28 09:06:22.792152 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 28 09:06:22.792152 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 28 09:06:22.792152 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 28 09:06:22.792152 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 28 09:06:22.792152 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 28 09:06:22.792152 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 28 09:06:22.792152 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 09:06:22.792152 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application Jul 28 09:06:22.799917 dv-cinder-851351-1-smb devstack@keystone.service[416294]: [pid: 416294|app: 0|req: 271/527] 10.222.0.42 () {56 vars in 1111 bytes} [Thu Jul 28 09:06:22 2022] GET /identity/v3/projects/service => generated 88 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 09:06:22.801704 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccafc7c5-ee40-451d-b8d5-76aa47fbac7c None admin] Authenticating user token {{(pid=416294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:06:22.896482 dv-cinder-851351-1-smb devstack@keystone.service[416293]: [pid: 416293|app: 0|req: 257/528] 10.222.0.42 () {58 vars in 1282 bytes} [Thu Jul 28 09:06:22 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 386 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 28 09:06:22.897640 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c599bad6-0a12-4708-b069-2b60fe1649ff None admin] Authenticating user token {{(pid=416293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:06:22.908686 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG dbcounter [-] [416293] Writing DB stats keystone:SELECT=100 {{(pid=416293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:06:22.929146 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccafc7c5-ee40-451d-b8d5-76aa47fbac7c None admin] Validating token access rules against request {{(pid=416294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:06:22.932936 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG dbcounter [-] [416294] Writing DB stats keystone:SELECT=100 {{(pid=416294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:06:22.988809 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f30ec12d-c02d-4646-9e7d-8e766cc43f76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:06:22.989469 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30ec12d-c02d-4646-9e7d-8e766cc43f76 None admin] REQUEST_METHOD: `GET` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:06:22.989755 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30ec12d-c02d-4646-9e7d-8e766cc43f76 None admin] SCRIPT_NAME: `/identity` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:06:22.990185 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30ec12d-c02d-4646-9e7d-8e766cc43f76 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:06:23.007670 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c599bad6-0a12-4708-b069-2b60fe1649ff None admin] Validating token access rules against request {{(pid=416293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:06:23.048388 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e179000d-3c04-4e36-88ca-b81707534129 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:06:23.049822 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e179000d-3c04-4e36-88ca-b81707534129 None admin] REQUEST_METHOD: `GET` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:06:23.050108 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e179000d-3c04-4e36-88ca-b81707534129 None admin] SCRIPT_NAME: `/identity` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:06:23.050385 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e179000d-3c04-4e36-88ca-b81707534129 None admin] PATH_INFO: `/v3/projects` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:06:23.051148 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e179000d-3c04-4e36-88ca-b81707534129 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=416293) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 09:06:23.051454 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e179000d-3c04-4e36-88ca-b81707534129 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:06:23.054428 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e179000d-3c04-4e36-88ca-b81707534129 None admin] RBAC: Authorization granted {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:06:23.072220 dv-cinder-851351-1-smb devstack@keystone.service[416293]: [pid: 416293|app: 0|req: 258/529] 10.222.0.42 () {56 vars in 1148 bytes} [Thu Jul 28 09:06:22 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:06:23.073881 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e179000d-3c04-4e36-88ca-b81707534129 None admin] Authenticating user token {{(pid=416293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:06:23.087515 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f30ec12d-c02d-4646-9e7d-8e766cc43f76 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:06:23.089209 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f30ec12d-c02d-4646-9e7d-8e766cc43f76 None admin] RBAC: Authorization granted {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:06:23.166823 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG dbcounter [-] [416293] Writing DB stats keystone:SELECT=100 {{(pid=416293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:06:23.211999 dv-cinder-851351-1-smb devstack@keystone.service[416294]: [pid: 416294|app: 0|req: 272/530] 10.222.0.42 () {58 vars in 1282 bytes} [Thu Jul 28 09:06:22 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 411 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 28 09:06:23.213297 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f30ec12d-c02d-4646-9e7d-8e766cc43f76 None admin] Authenticating user token {{(pid=416294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:06:23.213725 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e179000d-3c04-4e36-88ca-b81707534129 None admin] Validating token access rules against request {{(pid=416293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:06:23.218263 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG dbcounter [-] [416294] Writing DB stats keystone:SELECT=100 {{(pid=416294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:06:23.257024 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a4b997-dc6f-458a-a216-631593d236ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:06:23.257580 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a4b997-dc6f-458a-a216-631593d236ab None admin] REQUEST_METHOD: `GET` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:06:23.257982 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a4b997-dc6f-458a-a216-631593d236ab None admin] SCRIPT_NAME: `/identity` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:06:23.258348 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a4b997-dc6f-458a-a216-631593d236ab None admin] PATH_INFO: `/v3/domains/Default` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:06:23.272176 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73a4b997-dc6f-458a-a216-631593d236ab None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:06:23.274059 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73a4b997-dc6f-458a-a216-631593d236ab None admin] RBAC: Authorization granted {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:06:23.289400 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application [None req-73a4b997-dc6f-458a-a216-631593d236ab None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 09:06:23.289400 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 09:06:23.289400 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 09:06:23.289400 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 09:06:23.289400 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 09:06:23.289400 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 09:06:23.289400 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 09:06:23.289400 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 09:06:23.289400 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 09:06:23.289400 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 09:06:23.289400 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 09:06:23.289400 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 09:06:23.289400 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 09:06:23.289400 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 09:06:23.289400 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 09:06:23.290327 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 09:06:23.290327 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 09:06:23.290327 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 09:06:23.290327 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 09:06:23.290327 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 09:06:23.290327 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 09:06:23.290327 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 09:06:23.290327 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 09:06:23.290327 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application with Lock( Jul 28 09:06:23.290327 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 09:06:23.290327 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self._enter() Jul 28 09:06:23.290327 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 09:06:23.290327 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 09:06:23.290327 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 09:06:23.290327 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self.creator() Jul 28 09:06:23.290327 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 09:06:23.290327 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application created_value = creator( Jul 28 09:06:23.291962 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 09:06:23.291962 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 09:06:23.291962 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 09:06:23.291962 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application Jul 28 09:06:23.294419 dv-cinder-851351-1-smb devstack@keystone.service[416293]: [pid: 416293|app: 0|req: 259/531] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 09:06:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 09:06:23.295685 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a4b997-dc6f-458a-a216-631593d236ab None admin] Authenticating user token {{(pid=416293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:06:23.329939 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f30ec12d-c02d-4646-9e7d-8e766cc43f76 None admin] Validating token access rules against request {{(pid=416294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:06:23.373090 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48be8ea2-381f-4a76-b249-bf1497786c9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:06:23.373090 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48be8ea2-381f-4a76-b249-bf1497786c9b None admin] REQUEST_METHOD: `GET` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:06:23.373090 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48be8ea2-381f-4a76-b249-bf1497786c9b None admin] SCRIPT_NAME: `/identity` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:06:23.373090 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48be8ea2-381f-4a76-b249-bf1497786c9b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:06:23.373543 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48be8ea2-381f-4a76-b249-bf1497786c9b None admin] RBAC: Adding query filter params (role.id=13417fbdbc5145a69bc01ff0f931fd96, scope.project.id=6c4349445f224184b093d9dfd0dfc642, user.id=12179aeb7c45432992616973fc5bdf77) {{(pid=416294) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 09:06:23.373543 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48be8ea2-381f-4a76-b249-bf1497786c9b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:06:23.374972 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48be8ea2-381f-4a76-b249-bf1497786c9b None admin] RBAC: Authorization granted {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:06:23.381493 dv-cinder-851351-1-smb devstack@keystone.service[416294]: [pid: 416294|app: 0|req: 273/532] 10.222.0.42 () {56 vars in 1374 bytes} [Thu Jul 28 09:06:23 2022] GET /identity/v3/role_assignments?user.id=12179aeb7c45432992616973fc5bdf77&scope.project.id=6c4349445f224184b093d9dfd0dfc642&role.id=13417fbdbc5145a69bc01ff0f931fd96 => generated 259 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:06:23.382596 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48be8ea2-381f-4a76-b249-bf1497786c9b None admin] Authenticating user token {{(pid=416294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:06:23.464264 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a4b997-dc6f-458a-a216-631593d236ab None admin] Validating token access rules against request {{(pid=416293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:06:23.489905 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG dbcounter [-] [416293] Writing DB stats keystone:SELECT=100 {{(pid=416293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:06:23.515314 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-239ea3ce-318c-4672-beba-81b87a81214b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:06:23.515906 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239ea3ce-318c-4672-beba-81b87a81214b None admin] REQUEST_METHOD: `GET` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:06:23.516192 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239ea3ce-318c-4672-beba-81b87a81214b None admin] SCRIPT_NAME: `/identity` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:06:23.516753 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239ea3ce-318c-4672-beba-81b87a81214b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:06:23.526609 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG dbcounter [-] [416294] Writing DB stats keystone:SELECT=100 {{(pid=416294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:06:23.546559 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-239ea3ce-318c-4672-beba-81b87a81214b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:06:23.548383 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-239ea3ce-318c-4672-beba-81b87a81214b None admin] RBAC: Authorization granted {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:06:23.577674 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application [None req-239ea3ce-318c-4672-beba-81b87a81214b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 09:06:23.577674 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 09:06:23.577674 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 09:06:23.577674 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 09:06:23.577674 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 09:06:23.577674 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 09:06:23.577674 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 09:06:23.577674 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 09:06:23.577674 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 09:06:23.577674 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 09:06:23.577674 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 09:06:23.577674 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 09:06:23.577674 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 09:06:23.577674 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 09:06:23.577674 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 09:06:23.579360 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 09:06:23.579360 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 09:06:23.579360 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 09:06:23.579360 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 09:06:23.579360 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 09:06:23.579360 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 09:06:23.579360 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 09:06:23.579360 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 09:06:23.579360 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application with Lock( Jul 28 09:06:23.579360 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 09:06:23.579360 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self._enter() Jul 28 09:06:23.579360 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 09:06:23.579360 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 09:06:23.579360 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 09:06:23.579360 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self.creator() Jul 28 09:06:23.579360 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 09:06:23.579360 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application created_value = creator( Jul 28 09:06:23.580569 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 09:06:23.580569 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 09:06:23.580569 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 09:06:23.580569 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application Jul 28 09:06:23.587008 dv-cinder-851351-1-smb devstack@keystone.service[416293]: [pid: 416293|app: 0|req: 260/533] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 09:06:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 292 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 09:06:23.596695 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-239ea3ce-318c-4672-beba-81b87a81214b None admin] Authenticating user token {{(pid=416293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:06:23.604464 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48be8ea2-381f-4a76-b249-bf1497786c9b None admin] Validating token access rules against request {{(pid=416294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:06:23.649772 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a49472a-db3b-4845-b38b-4d4b6463de14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:06:23.650445 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a49472a-db3b-4845-b38b-4d4b6463de14 None admin] REQUEST_METHOD: `GET` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:06:23.650736 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a49472a-db3b-4845-b38b-4d4b6463de14 None admin] SCRIPT_NAME: `/identity` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:06:23.651017 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a49472a-db3b-4845-b38b-4d4b6463de14 None admin] PATH_INFO: `/v3/domains` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:06:23.651734 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a49472a-db3b-4845-b38b-4d4b6463de14 None admin] RBAC: Adding query filter params (name=Default) {{(pid=416294) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 09:06:23.652032 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a49472a-db3b-4845-b38b-4d4b6463de14 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:06:23.653571 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a49472a-db3b-4845-b38b-4d4b6463de14 None admin] RBAC: Authorization granted {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:06:23.667935 dv-cinder-851351-1-smb devstack@keystone.service[416294]: [pid: 416294|app: 0|req: 274/534] 10.222.0.42 () {56 vars in 1109 bytes} [Thu Jul 28 09:06:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 286 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:06:23.680691 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a49472a-db3b-4845-b38b-4d4b6463de14 None admin] Authenticating user token {{(pid=416294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:06:23.758039 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-239ea3ce-318c-4672-beba-81b87a81214b None admin] Validating token access rules against request {{(pid=416293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:06:23.809503 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22c4b3e-c853-405d-a614-6dba651c6b31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:06:23.810062 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22c4b3e-c853-405d-a614-6dba651c6b31 None admin] REQUEST_METHOD: `GET` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:06:23.810352 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22c4b3e-c853-405d-a614-6dba651c6b31 None admin] SCRIPT_NAME: `/identity` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:06:23.810633 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22c4b3e-c853-405d-a614-6dba651c6b31 None admin] PATH_INFO: `/v3/domains` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:06:23.811354 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d22c4b3e-c853-405d-a614-6dba651c6b31 None admin] RBAC: Adding query filter params (name=Default) {{(pid=416293) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 09:06:23.811667 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d22c4b3e-c853-405d-a614-6dba651c6b31 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:06:23.813129 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d22c4b3e-c853-405d-a614-6dba651c6b31 None admin] RBAC: Authorization granted {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:06:23.838879 dv-cinder-851351-1-smb devstack@keystone.service[416293]: [pid: 416293|app: 0|req: 261/535] 10.222.0.42 () {56 vars in 1109 bytes} [Thu Jul 28 09:06:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:06:23.839510 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a49472a-db3b-4845-b38b-4d4b6463de14 None admin] Validating token access rules against request {{(pid=416294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:06:23.849269 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22c4b3e-c853-405d-a614-6dba651c6b31 None admin] Authenticating user token {{(pid=416293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:06:23.897038 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG dbcounter [-] [416294] Writing DB stats keystone:SELECT=100 {{(pid=416294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:06:23.910562 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453a6e09-307a-452d-ad85-a9775f8689c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:06:23.911374 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453a6e09-307a-452d-ad85-a9775f8689c5 None admin] REQUEST_METHOD: `GET` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:06:23.911680 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453a6e09-307a-452d-ad85-a9775f8689c5 None admin] SCRIPT_NAME: `/identity` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:06:23.911937 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453a6e09-307a-452d-ad85-a9775f8689c5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:06:23.917027 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG dbcounter [-] [416293] Writing DB stats keystone:SELECT=100 {{(pid=416293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:06:23.929809 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-453a6e09-307a-452d-ad85-a9775f8689c5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:06:23.933490 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-453a6e09-307a-452d-ad85-a9775f8689c5 None admin] RBAC: Authorization granted {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:06:23.956703 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application [None req-453a6e09-307a-452d-ad85-a9775f8689c5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 09:06:23.956703 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 09:06:23.956703 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 09:06:23.956703 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 09:06:23.956703 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 09:06:23.956703 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 09:06:23.956703 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 09:06:23.956703 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 09:06:23.956703 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 09:06:23.956703 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 09:06:23.956703 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 09:06:23.956703 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 09:06:23.956703 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 28 09:06:23.956703 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 28 09:06:23.956703 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 28 09:06:23.957944 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 28 09:06:23.957944 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 09:06:23.957944 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 09:06:23.957944 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 09:06:23.957944 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 09:06:23.957944 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 09:06:23.957944 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 09:06:23.957944 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 09:06:23.957944 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application with Lock( Jul 28 09:06:23.957944 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 09:06:23.957944 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return self._enter() Jul 28 09:06:23.957944 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 09:06:23.957944 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 09:06:23.957944 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 09:06:23.957944 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return self.creator() Jul 28 09:06:23.957944 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 09:06:23.957944 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application created_value = creator( Jul 28 09:06:23.958904 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 28 09:06:23.958904 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 28 09:06:23.958904 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 28 09:06:23.958904 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 28 09:06:23.958904 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 28 09:06:23.958904 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 28 09:06:23.958904 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 09:06:23.958904 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application Jul 28 09:06:23.970293 dv-cinder-851351-1-smb devstack@keystone.service[416294]: [pid: 416294|app: 0|req: 275/536] 10.222.0.42 () {56 vars in 1111 bytes} [Thu Jul 28 09:06:23 2022] GET /identity/v3/projects/service => generated 88 bytes in 297 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 09:06:23.976347 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453a6e09-307a-452d-ad85-a9775f8689c5 None admin] Authenticating user token {{(pid=416294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:06:24.065562 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22c4b3e-c853-405d-a614-6dba651c6b31 None admin] Validating token access rules against request {{(pid=416293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:06:24.134606 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2559d3d2-2f18-49e2-b188-a25dd75def4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:06:24.137258 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2559d3d2-2f18-49e2-b188-a25dd75def4a None admin] REQUEST_METHOD: `GET` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:06:24.137775 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2559d3d2-2f18-49e2-b188-a25dd75def4a None admin] SCRIPT_NAME: `/identity` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:06:24.139407 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2559d3d2-2f18-49e2-b188-a25dd75def4a None admin] PATH_INFO: `/v3/projects/service` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:06:24.154806 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2559d3d2-2f18-49e2-b188-a25dd75def4a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:06:24.156892 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2559d3d2-2f18-49e2-b188-a25dd75def4a None admin] RBAC: Authorization granted {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:06:24.179799 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application [None req-2559d3d2-2f18-49e2-b188-a25dd75def4a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 09:06:24.179799 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 09:06:24.179799 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 09:06:24.179799 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 09:06:24.179799 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 09:06:24.179799 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 09:06:24.179799 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 09:06:24.179799 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 09:06:24.179799 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 09:06:24.179799 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 09:06:24.179799 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 09:06:24.179799 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 09:06:24.179799 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 28 09:06:24.179799 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 28 09:06:24.179799 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 28 09:06:24.180849 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 28 09:06:24.180849 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 09:06:24.180849 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 09:06:24.180849 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 09:06:24.180849 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 09:06:24.180849 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 09:06:24.180849 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 09:06:24.180849 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 09:06:24.180849 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application with Lock( Jul 28 09:06:24.180849 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 09:06:24.180849 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self._enter() Jul 28 09:06:24.180849 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 09:06:24.180849 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 09:06:24.180849 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 09:06:24.180849 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self.creator() Jul 28 09:06:24.180849 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 09:06:24.180849 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application created_value = creator( Jul 28 09:06:24.181887 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 28 09:06:24.181887 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 28 09:06:24.181887 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 28 09:06:24.181887 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 28 09:06:24.181887 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 28 09:06:24.181887 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 28 09:06:24.181887 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 09:06:24.181887 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application Jul 28 09:06:24.185207 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453a6e09-307a-452d-ad85-a9775f8689c5 None admin] Validating token access rules against request {{(pid=416294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:06:24.195675 dv-cinder-851351-1-smb devstack@keystone.service[416293]: [pid: 416293|app: 0|req: 262/537] 10.222.0.42 () {56 vars in 1111 bytes} [Thu Jul 28 09:06:23 2022] GET /identity/v3/projects/service => generated 88 bytes in 347 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 09:06:24.201423 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2559d3d2-2f18-49e2-b188-a25dd75def4a None admin] Authenticating user token {{(pid=416293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:06:24.255489 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff17733-8c77-4710-ae1a-4e64e46aefab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:06:24.256143 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff17733-8c77-4710-ae1a-4e64e46aefab None admin] REQUEST_METHOD: `GET` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:06:24.256428 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff17733-8c77-4710-ae1a-4e64e46aefab None admin] SCRIPT_NAME: `/identity` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:06:24.256727 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff17733-8c77-4710-ae1a-4e64e46aefab None admin] PATH_INFO: `/v3/projects` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:06:24.257510 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aff17733-8c77-4710-ae1a-4e64e46aefab None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=416294) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 09:06:24.257823 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aff17733-8c77-4710-ae1a-4e64e46aefab None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:06:24.259311 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aff17733-8c77-4710-ae1a-4e64e46aefab None admin] RBAC: Authorization granted {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:06:24.313857 dv-cinder-851351-1-smb devstack@keystone.service[416294]: [pid: 416294|app: 0|req: 276/538] 10.222.0.42 () {56 vars in 1148 bytes} [Thu Jul 28 09:06:23 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 330 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:06:24.314923 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff17733-8c77-4710-ae1a-4e64e46aefab None admin] Authenticating user token {{(pid=416294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:06:24.408322 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG dbcounter [-] [416293] Writing DB stats keystone:SELECT=100 {{(pid=416293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:06:24.426773 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2559d3d2-2f18-49e2-b188-a25dd75def4a None admin] Validating token access rules against request {{(pid=416293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:06:24.431892 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG dbcounter [-] [416294] Writing DB stats keystone:SELECT=100 {{(pid=416294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:06:24.507267 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ac76fa-a51d-432c-b3f8-55da95d4de0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:06:24.507918 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ac76fa-a51d-432c-b3f8-55da95d4de0f None admin] REQUEST_METHOD: `GET` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:06:24.508205 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ac76fa-a51d-432c-b3f8-55da95d4de0f None admin] SCRIPT_NAME: `/identity` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:06:24.508488 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ac76fa-a51d-432c-b3f8-55da95d4de0f None admin] PATH_INFO: `/v3/projects` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:06:24.509311 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ac76fa-a51d-432c-b3f8-55da95d4de0f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=416293) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 09:06:24.509625 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ac76fa-a51d-432c-b3f8-55da95d4de0f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:06:24.511093 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ac76fa-a51d-432c-b3f8-55da95d4de0f None admin] RBAC: Authorization granted {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:06:24.525692 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff17733-8c77-4710-ae1a-4e64e46aefab None admin] Validating token access rules against request {{(pid=416294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:06:24.543347 dv-cinder-851351-1-smb devstack@keystone.service[416293]: [pid: 416293|app: 0|req: 263/539] 10.222.0.42 () {56 vars in 1148 bytes} [Thu Jul 28 09:06:24 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 342 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:06:24.549124 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ac76fa-a51d-432c-b3f8-55da95d4de0f None admin] Authenticating user token {{(pid=416293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:06:24.563241 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ad0d73-0dc0-4a50-9a0b-e075a5a44caa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:06:24.563961 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ad0d73-0dc0-4a50-9a0b-e075a5a44caa None admin] REQUEST_METHOD: `GET` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:06:24.564304 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ad0d73-0dc0-4a50-9a0b-e075a5a44caa None admin] SCRIPT_NAME: `/identity` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:06:24.564592 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ad0d73-0dc0-4a50-9a0b-e075a5a44caa None admin] PATH_INFO: `/v3/role_assignments` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:06:24.565459 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ad0d73-0dc0-4a50-9a0b-e075a5a44caa None admin] RBAC: Adding query filter params (role.id=13417fbdbc5145a69bc01ff0f931fd96, scope.project.id=6c4349445f224184b093d9dfd0dfc642, user.id=4d16bdaefceb45c190e3cfdc2b5b29e1) {{(pid=416294) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 09:06:24.566882 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ad0d73-0dc0-4a50-9a0b-e075a5a44caa None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:06:24.568505 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ad0d73-0dc0-4a50-9a0b-e075a5a44caa None admin] RBAC: Authorization granted {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:06:24.581448 dv-cinder-851351-1-smb devstack@keystone.service[416294]: [pid: 416294|app: 0|req: 277/540] 10.222.0.42 () {56 vars in 1374 bytes} [Thu Jul 28 09:06:24 2022] GET /identity/v3/role_assignments?user.id=4d16bdaefceb45c190e3cfdc2b5b29e1&scope.project.id=6c4349445f224184b093d9dfd0dfc642&role.id=13417fbdbc5145a69bc01ff0f931fd96 => generated 259 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:06:24.607357 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb48c13e-9912-4861-8753-3789dffb82df None None] REQUEST_METHOD: `GET` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:06:24.607708 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb48c13e-9912-4861-8753-3789dffb82df None None] SCRIPT_NAME: `/identity` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:06:24.607913 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb48c13e-9912-4861-8753-3789dffb82df None None] PATH_INFO: `/` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:06:24.610016 dv-cinder-851351-1-smb devstack@keystone.service[416294]: [pid: 416294|app: 0|req: 278/541] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 09:06:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 28 09:06:24.618820 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe5aafc-e4ac-444e-ae0d-40ab58ba7b03 None None] REQUEST_METHOD: `POST` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:06:24.619166 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe5aafc-e4ac-444e-ae0d-40ab58ba7b03 None None] SCRIPT_NAME: `/identity` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:06:24.619409 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe5aafc-e4ac-444e-ae0d-40ab58ba7b03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:06:24.666092 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.auth.core [None req-fbe5aafc-e4ac-444e-ae0d-40ab58ba7b03 None None] MFA Rules not processed for user `dbf87abab90e4fdf9e75408f4199918e`. Rule list: `[]` (Enabled: `True`). {{(pid=416294) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 09:06:24.667302 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.fernet_utils [None req-fbe5aafc-e4ac-444e-ae0d-40ab58ba7b03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=416294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 09:06:24.743409 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ac76fa-a51d-432c-b3f8-55da95d4de0f None admin] Validating token access rules against request {{(pid=416293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:06:24.789876 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c5a3fc5-637a-4efd-93a1-628133433304 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:06:24.790532 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5a3fc5-637a-4efd-93a1-628133433304 None admin] REQUEST_METHOD: `GET` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:06:24.790966 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5a3fc5-637a-4efd-93a1-628133433304 None admin] SCRIPT_NAME: `/identity` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:06:24.791271 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5a3fc5-637a-4efd-93a1-628133433304 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:06:24.792217 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c5a3fc5-637a-4efd-93a1-628133433304 None admin] RBAC: Adding query filter params (role.id=13417fbdbc5145a69bc01ff0f931fd96, scope.project.id=6c4349445f224184b093d9dfd0dfc642, user.id=1a6b3c06f2fb4c4c8b9089ca32caf7c5) {{(pid=416293) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 09:06:24.792598 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c5a3fc5-637a-4efd-93a1-628133433304 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:06:24.794711 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c5a3fc5-637a-4efd-93a1-628133433304 None admin] RBAC: Authorization granted {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:06:24.802333 dv-cinder-851351-1-smb devstack@keystone.service[416293]: [pid: 416293|app: 0|req: 264/542] 10.222.0.42 () {56 vars in 1374 bytes} [Thu Jul 28 09:06:24 2022] GET /identity/v3/role_assignments?user.id=1a6b3c06f2fb4c4c8b9089ca32caf7c5&scope.project.id=6c4349445f224184b093d9dfd0dfc642&role.id=13417fbdbc5145a69bc01ff0f931fd96 => generated 259 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:06:24.805622 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92322de8-a4c8-4b85-be6c-54ec42419900 None None] REQUEST_METHOD: `GET` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:06:24.806305 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92322de8-a4c8-4b85-be6c-54ec42419900 None None] SCRIPT_NAME: `/identity` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:06:24.806599 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92322de8-a4c8-4b85-be6c-54ec42419900 None None] PATH_INFO: `/` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:06:24.808167 dv-cinder-851351-1-smb devstack@keystone.service[416293]: [pid: 416293|app: 0|req: 265/543] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 09:06:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 09:06:24.815172 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f090022a-1c06-4d6c-b1f7-77efed2c60ce None None] REQUEST_METHOD: `POST` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:06:24.815172 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f090022a-1c06-4d6c-b1f7-77efed2c60ce None None] SCRIPT_NAME: `/identity` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:06:24.815172 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f090022a-1c06-4d6c-b1f7-77efed2c60ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:06:24.816766 dv-cinder-851351-1-smb devstack@keystone.service[416294]: [pid: 416294|app: 0|req: 279/544] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 09:06:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 28 09:06:24.838375 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.auth.core [None req-f090022a-1c06-4d6c-b1f7-77efed2c60ce None None] MFA Rules not processed for user `dbf87abab90e4fdf9e75408f4199918e`. Rule list: `[]` (Enabled: `True`). {{(pid=416293) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 09:06:24.839653 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.fernet_utils [None req-f090022a-1c06-4d6c-b1f7-77efed2c60ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=416293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 09:06:24.851919 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe5aafc-e4ac-444e-ae0d-40ab58ba7b03 None None] Authenticating user token {{(pid=416294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:06:24.857090 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG dbcounter [-] [416293] Writing DB stats keystone:SELECT=100 {{(pid=416293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:06:24.920791 dv-cinder-851351-1-smb devstack@keystone.service[416293]: [pid: 416293|app: 0|req: 266/545] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 09:06:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 28 09:06:24.948072 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f090022a-1c06-4d6c-b1f7-77efed2c60ce None None] Authenticating user token {{(pid=416293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:06:24.949991 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG dbcounter [-] [416294] Writing DB stats keystone:SELECT=100 {{(pid=416294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:06:25.070135 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f090022a-1c06-4d6c-b1f7-77efed2c60ce None None] Validating token access rules against request {{(pid=416293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:06:25.085028 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe5aafc-e4ac-444e-ae0d-40ab58ba7b03 None None] Validating token access rules against request {{(pid=416294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:06:25.121261 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0888ce-7555-4623-93fe-7343538a704b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:06:25.122338 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0888ce-7555-4623-93fe-7343538a704b None admin] REQUEST_METHOD: `GET` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:06:25.122862 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0888ce-7555-4623-93fe-7343538a704b None admin] SCRIPT_NAME: `/identity` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:06:25.123375 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0888ce-7555-4623-93fe-7343538a704b None admin] PATH_INFO: `/v3/roles/service` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:06:25.140098 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e0888ce-7555-4623-93fe-7343538a704b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 09:06:25.145686 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application [None req-4e0888ce-7555-4623-93fe-7343538a704b None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 28 09:06:25.145686 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 09:06:25.145686 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 09:06:25.145686 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 09:06:25.145686 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 09:06:25.145686 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 09:06:25.145686 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 09:06:25.145686 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 09:06:25.145686 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 09:06:25.145686 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 09:06:25.145686 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 09:06:25.145686 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 09:06:25.145686 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 09:06:25.145686 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 09:06:25.145686 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 09:06:25.145686 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 09:06:25.146729 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 09:06:25.146729 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 09:06:25.146729 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 09:06:25.146729 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 09:06:25.146729 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 09:06:25.146729 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 09:06:25.146729 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 09:06:25.146729 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 09:06:25.146729 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 09:06:25.146729 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 09:06:25.146729 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 09:06:25.146729 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application with Lock( Jul 28 09:06:25.146729 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 09:06:25.146729 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self._enter() Jul 28 09:06:25.146729 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 09:06:25.146729 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 09:06:25.147630 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 09:06:25.147630 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self.creator() Jul 28 09:06:25.147630 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 09:06:25.147630 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application created_value = creator( Jul 28 09:06:25.147630 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 09:06:25.147630 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 09:06:25.147630 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 09:06:25.147630 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 09:06:25.147630 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 09:06:25.147630 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 09:06:25.147630 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 28 09:06:25.147630 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application Jul 28 09:06:25.150904 dv-cinder-851351-1-smb devstack@keystone.service[416293]: [pid: 416293|app: 0|req: 267/546] 10.222.0.42 () {56 vars in 1102 bytes} [Thu Jul 28 09:06:24 2022] GET /identity/v3/roles/service => generated 85 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 09:06:25.156614 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0888ce-7555-4623-93fe-7343538a704b None admin] Authenticating user token {{(pid=416293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:06:25.162732 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea57291a-3109-4616-897e-59dc8176ea7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:06:25.163704 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea57291a-3109-4616-897e-59dc8176ea7a None admin] REQUEST_METHOD: `GET` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:06:25.164200 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea57291a-3109-4616-897e-59dc8176ea7a None admin] SCRIPT_NAME: `/identity` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:06:25.165026 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea57291a-3109-4616-897e-59dc8176ea7a None admin] PATH_INFO: `/v3/roles/service` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:06:25.177198 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG dbcounter [-] [416293] Writing DB stats keystone:SELECT=100 {{(pid=416293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:06:25.197017 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea57291a-3109-4616-897e-59dc8176ea7a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 09:06:25.206025 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application [None req-ea57291a-3109-4616-897e-59dc8176ea7a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 28 09:06:25.206025 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 09:06:25.206025 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 09:06:25.206025 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 09:06:25.206025 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 09:06:25.206025 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 09:06:25.206025 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 09:06:25.206025 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 09:06:25.206025 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 09:06:25.206025 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 09:06:25.206025 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 09:06:25.206025 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 09:06:25.206025 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 09:06:25.206025 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 09:06:25.206025 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 09:06:25.206025 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 09:06:25.207155 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 09:06:25.207155 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 09:06:25.207155 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 09:06:25.207155 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 09:06:25.207155 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 09:06:25.207155 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 09:06:25.207155 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 09:06:25.207155 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 09:06:25.207155 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 09:06:25.207155 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 09:06:25.207155 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 09:06:25.207155 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application with Lock( Jul 28 09:06:25.207155 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 09:06:25.207155 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return self._enter() Jul 28 09:06:25.207155 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 09:06:25.207155 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 09:06:25.208064 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 09:06:25.208064 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return self.creator() Jul 28 09:06:25.208064 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 09:06:25.208064 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application created_value = creator( Jul 28 09:06:25.208064 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 09:06:25.208064 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 09:06:25.208064 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 09:06:25.208064 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 09:06:25.208064 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 09:06:25.208064 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 09:06:25.208064 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 28 09:06:25.208064 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application Jul 28 09:06:25.208064 dv-cinder-851351-1-smb devstack@keystone.service[416294]: [pid: 416294|app: 0|req: 280/547] 10.222.0.42 () {56 vars in 1102 bytes} [Thu Jul 28 09:06:24 2022] GET /identity/v3/roles/service => generated 85 bytes in 356 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 09:06:25.214330 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea57291a-3109-4616-897e-59dc8176ea7a None admin] Authenticating user token {{(pid=416294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:06:25.347848 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea57291a-3109-4616-897e-59dc8176ea7a None admin] Validating token access rules against request {{(pid=416294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:06:25.349570 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG dbcounter [-] [416294] Writing DB stats keystone:SELECT=100 {{(pid=416294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:06:25.406011 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8fa6b05-da50-4b63-bec7-c2dd999b684d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:06:25.406670 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8fa6b05-da50-4b63-bec7-c2dd999b684d None admin] REQUEST_METHOD: `GET` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:06:25.407483 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8fa6b05-da50-4b63-bec7-c2dd999b684d None admin] SCRIPT_NAME: `/identity` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:06:25.407778 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8fa6b05-da50-4b63-bec7-c2dd999b684d None admin] PATH_INFO: `/v3/roles` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:06:25.408618 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8fa6b05-da50-4b63-bec7-c2dd999b684d None admin] RBAC: Adding query filter params (name=service) {{(pid=416294) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 09:06:25.408974 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8fa6b05-da50-4b63-bec7-c2dd999b684d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:06:25.410414 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8fa6b05-da50-4b63-bec7-c2dd999b684d None admin] RBAC: Authorization granted {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:06:25.425397 dv-cinder-851351-1-smb devstack@keystone.service[416294]: [pid: 416294|app: 0|req: 281/548] 10.222.0.42 () {56 vars in 1103 bytes} [Thu Jul 28 09:06:25 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:06:25.433587 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8fa6b05-da50-4b63-bec7-c2dd999b684d None admin] Authenticating user token {{(pid=416294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:06:25.486478 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0888ce-7555-4623-93fe-7343538a704b None admin] Validating token access rules against request {{(pid=416293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:06:25.562841 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c016ac1-79e9-46ed-b29e-71e0a9a362d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:06:25.563495 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c016ac1-79e9-46ed-b29e-71e0a9a362d3 None admin] REQUEST_METHOD: `GET` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:06:25.563782 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c016ac1-79e9-46ed-b29e-71e0a9a362d3 None admin] SCRIPT_NAME: `/identity` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:06:25.564062 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c016ac1-79e9-46ed-b29e-71e0a9a362d3 None admin] PATH_INFO: `/v3/roles` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:06:25.564914 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c016ac1-79e9-46ed-b29e-71e0a9a362d3 None admin] RBAC: Adding query filter params (name=service) {{(pid=416293) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 09:06:25.565225 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c016ac1-79e9-46ed-b29e-71e0a9a362d3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:06:25.566672 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c016ac1-79e9-46ed-b29e-71e0a9a362d3 None admin] RBAC: Authorization granted {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:06:25.590731 dv-cinder-851351-1-smb devstack@keystone.service[416293]: [pid: 416293|app: 0|req: 268/549] 10.222.0.42 () {56 vars in 1103 bytes} [Thu Jul 28 09:06:25 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 434 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:06:25.596383 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c016ac1-79e9-46ed-b29e-71e0a9a362d3 None admin] Authenticating user token {{(pid=416293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:06:25.633167 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8fa6b05-da50-4b63-bec7-c2dd999b684d None admin] Validating token access rules against request {{(pid=416294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:06:25.698873 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd7e22d1-82ec-4752-be77-113b8e176a36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:06:25.699459 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7e22d1-82ec-4752-be77-113b8e176a36 None admin] REQUEST_METHOD: `GET` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:06:25.699736 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7e22d1-82ec-4752-be77-113b8e176a36 None admin] SCRIPT_NAME: `/identity` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:06:25.700009 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7e22d1-82ec-4752-be77-113b8e176a36 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:06:25.718340 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd7e22d1-82ec-4752-be77-113b8e176a36 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:06:25.720863 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd7e22d1-82ec-4752-be77-113b8e176a36 None admin] RBAC: Authorization granted {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:06:25.730407 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG dbcounter [-] [416293] Writing DB stats keystone:SELECT=100 {{(pid=416293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:06:25.756915 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application [None req-bd7e22d1-82ec-4752-be77-113b8e176a36 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 09:06:25.756915 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 09:06:25.756915 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 09:06:25.756915 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 09:06:25.756915 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 09:06:25.756915 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 09:06:25.756915 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 09:06:25.756915 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 09:06:25.756915 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 09:06:25.756915 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 09:06:25.756915 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 09:06:25.756915 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 09:06:25.756915 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 09:06:25.756915 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 09:06:25.756915 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 09:06:25.757969 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 09:06:25.757969 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 09:06:25.757969 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 09:06:25.757969 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 09:06:25.757969 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 09:06:25.757969 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 09:06:25.757969 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 09:06:25.757969 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 09:06:25.757969 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application with Lock( Jul 28 09:06:25.757969 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 09:06:25.757969 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return self._enter() Jul 28 09:06:25.757969 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 09:06:25.757969 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 09:06:25.757969 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 09:06:25.757969 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return self.creator() Jul 28 09:06:25.757969 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 09:06:25.757969 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application created_value = creator( Jul 28 09:06:25.758938 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 09:06:25.758938 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 09:06:25.758938 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 09:06:25.758938 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application Jul 28 09:06:25.761226 dv-cinder-851351-1-smb devstack@keystone.service[416294]: [pid: 416294|app: 0|req: 282/550] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 09:06:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 329 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 09:06:25.765740 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd7e22d1-82ec-4752-be77-113b8e176a36 None admin] Authenticating user token {{(pid=416294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:06:25.795674 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG dbcounter [-] [416294] Writing DB stats keystone:SELECT=100 {{(pid=416294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:06:25.797729 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c016ac1-79e9-46ed-b29e-71e0a9a362d3 None admin] Validating token access rules against request {{(pid=416293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:06:25.861546 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff45e9bc-5150-458a-80e1-48cfb80bce5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:06:25.862223 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff45e9bc-5150-458a-80e1-48cfb80bce5b None admin] REQUEST_METHOD: `GET` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:06:25.862517 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff45e9bc-5150-458a-80e1-48cfb80bce5b None admin] SCRIPT_NAME: `/identity` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:06:25.862792 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff45e9bc-5150-458a-80e1-48cfb80bce5b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:06:25.886016 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff45e9bc-5150-458a-80e1-48cfb80bce5b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:06:25.888040 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff45e9bc-5150-458a-80e1-48cfb80bce5b None admin] RBAC: Authorization granted {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:06:25.915098 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd7e22d1-82ec-4752-be77-113b8e176a36 None admin] Validating token access rules against request {{(pid=416294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:06:25.919019 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application [None req-ff45e9bc-5150-458a-80e1-48cfb80bce5b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 09:06:25.919019 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 09:06:25.919019 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 09:06:25.919019 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 09:06:25.919019 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 09:06:25.919019 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 09:06:25.919019 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 09:06:25.919019 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 09:06:25.919019 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 09:06:25.919019 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 09:06:25.919019 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 09:06:25.919019 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 09:06:25.919019 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 09:06:25.919019 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 09:06:25.919019 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 09:06:25.920038 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 09:06:25.920038 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 09:06:25.920038 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 09:06:25.920038 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 09:06:25.920038 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 09:06:25.920038 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 09:06:25.920038 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 09:06:25.920038 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 09:06:25.920038 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application with Lock( Jul 28 09:06:25.920038 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 09:06:25.920038 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self._enter() Jul 28 09:06:25.920038 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 09:06:25.920038 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 09:06:25.920038 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 09:06:25.920038 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self.creator() Jul 28 09:06:25.920038 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 09:06:25.920038 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application created_value = creator( Jul 28 09:06:25.921416 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 09:06:25.921416 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 09:06:25.921416 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 09:06:25.921416 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application Jul 28 09:06:25.921416 dv-cinder-851351-1-smb devstack@keystone.service[416293]: [pid: 416293|app: 0|req: 269/551] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 09:06:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 325 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 09:06:25.927504 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff45e9bc-5150-458a-80e1-48cfb80bce5b None admin] Authenticating user token {{(pid=416293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:06:25.979910 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-863b6885-ea3b-4e7b-be07-51d0f69ff93d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:06:25.980574 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863b6885-ea3b-4e7b-be07-51d0f69ff93d None admin] REQUEST_METHOD: `GET` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:06:25.981716 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863b6885-ea3b-4e7b-be07-51d0f69ff93d None admin] SCRIPT_NAME: `/identity` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:06:25.981999 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863b6885-ea3b-4e7b-be07-51d0f69ff93d None admin] PATH_INFO: `/v3/domains` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:06:25.982719 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-863b6885-ea3b-4e7b-be07-51d0f69ff93d None admin] RBAC: Adding query filter params (name=Default) {{(pid=416294) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 09:06:25.983040 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-863b6885-ea3b-4e7b-be07-51d0f69ff93d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:06:25.984487 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-863b6885-ea3b-4e7b-be07-51d0f69ff93d None admin] RBAC: Authorization granted {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:06:26.010013 dv-cinder-851351-1-smb devstack@keystone.service[416294]: [pid: 416294|app: 0|req: 283/552] 10.222.0.42 () {56 vars in 1109 bytes} [Thu Jul 28 09:06:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 09:06:26.015362 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-863b6885-ea3b-4e7b-be07-51d0f69ff93d None admin] Authenticating user token {{(pid=416294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:06:26.094371 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff45e9bc-5150-458a-80e1-48cfb80bce5b None admin] Validating token access rules against request {{(pid=416293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:06:26.125074 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG dbcounter [-] [416293] Writing DB stats keystone:SELECT=100 {{(pid=416293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:06:26.133183 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG dbcounter [-] [416294] Writing DB stats keystone:SELECT=100 {{(pid=416294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:06:26.147050 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d33a7f-e441-45c2-b170-5070ced34d71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:06:26.147873 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d33a7f-e441-45c2-b170-5070ced34d71 None admin] REQUEST_METHOD: `GET` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:06:26.148262 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d33a7f-e441-45c2-b170-5070ced34d71 None admin] SCRIPT_NAME: `/identity` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:06:26.148644 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d33a7f-e441-45c2-b170-5070ced34d71 None admin] PATH_INFO: `/v3/domains` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:06:26.149768 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38d33a7f-e441-45c2-b170-5070ced34d71 None admin] RBAC: Adding query filter params (name=Default) {{(pid=416293) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 09:06:26.150268 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38d33a7f-e441-45c2-b170-5070ced34d71 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:06:26.151749 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38d33a7f-e441-45c2-b170-5070ced34d71 None admin] RBAC: Authorization granted {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:06:26.167877 dv-cinder-851351-1-smb devstack@keystone.service[416293]: [pid: 416293|app: 0|req: 270/553] 10.222.0.42 () {56 vars in 1109 bytes} [Thu Jul 28 09:06:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:06:26.170029 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337ab005-1dd9-4ba0-9192-4a2f93464a04 None None] REQUEST_METHOD: `GET` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:06:26.170465 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337ab005-1dd9-4ba0-9192-4a2f93464a04 None None] SCRIPT_NAME: `/identity` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:06:26.170841 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337ab005-1dd9-4ba0-9192-4a2f93464a04 None None] PATH_INFO: `/` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:06:26.177059 dv-cinder-851351-1-smb devstack@keystone.service[416293]: [pid: 416293|app: 0|req: 271/554] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 09:06:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 09:06:26.178281 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337ab005-1dd9-4ba0-9192-4a2f93464a04 None None] Authenticating user token {{(pid=416293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:06:26.180746 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-863b6885-ea3b-4e7b-be07-51d0f69ff93d None admin] Validating token access rules against request {{(pid=416294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:06:26.220011 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ccf4d7d-094a-49a4-8fef-9521ac47adec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:06:26.220913 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ccf4d7d-094a-49a4-8fef-9521ac47adec None admin] REQUEST_METHOD: `GET` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:06:26.221311 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ccf4d7d-094a-49a4-8fef-9521ac47adec None admin] SCRIPT_NAME: `/identity` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:06:26.221663 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ccf4d7d-094a-49a4-8fef-9521ac47adec None admin] PATH_INFO: `/v3/users/nova` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:06:26.229329 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ccf4d7d-094a-49a4-8fef-9521ac47adec None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:06:26.230958 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ccf4d7d-094a-49a4-8fef-9521ac47adec None admin] RBAC: Authorization granted {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:06:26.243055 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application [None req-9ccf4d7d-094a-49a4-8fef-9521ac47adec None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 28 09:06:26.243055 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 09:06:26.243055 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 09:06:26.243055 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 09:06:26.243055 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 09:06:26.243055 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 09:06:26.243055 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 09:06:26.243055 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 09:06:26.243055 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 09:06:26.243055 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 09:06:26.243055 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 09:06:26.243055 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 09:06:26.243055 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 28 09:06:26.243055 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 28 09:06:26.243055 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 28 09:06:26.243055 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 28 09:06:26.244266 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 09:06:26.244266 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 09:06:26.244266 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 28 09:06:26.244266 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 09:06:26.244266 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 28 09:06:26.244266 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 09:06:26.244266 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 09:06:26.244266 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 09:06:26.244266 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 09:06:26.244266 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 09:06:26.244266 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 09:06:26.244266 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application with Lock( Jul 28 09:06:26.244266 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 09:06:26.244266 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return self._enter() Jul 28 09:06:26.244266 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 09:06:26.244266 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 09:06:26.244266 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 09:06:26.244266 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return self.creator() Jul 28 09:06:26.245360 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 09:06:26.245360 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application created_value = creator( Jul 28 09:06:26.245360 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 28 09:06:26.245360 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 28 09:06:26.245360 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 28 09:06:26.245360 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 28 09:06:26.245360 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 28 09:06:26.245360 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 28 09:06:26.245360 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 28 09:06:26.245360 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application Jul 28 09:06:26.246130 dv-cinder-851351-1-smb devstack@keystone.service[416294]: [pid: 416294|app: 0|req: 284/555] 10.222.0.42 () {56 vars in 1093 bytes} [Thu Jul 28 09:06:26 2022] GET /identity/v3/users/nova => generated 82 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 09:06:26.247374 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16efa05-ec82-430b-8714-ded8dd52a28f None None] REQUEST_METHOD: `POST` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:06:26.247759 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16efa05-ec82-430b-8714-ded8dd52a28f None None] SCRIPT_NAME: `/identity` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:06:26.248134 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16efa05-ec82-430b-8714-ded8dd52a28f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:06:26.269146 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.auth.core [None req-c16efa05-ec82-430b-8714-ded8dd52a28f None None] MFA Rules not processed for user `dbf87abab90e4fdf9e75408f4199918e`. Rule list: `[]` (Enabled: `True`). {{(pid=416294) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 09:06:26.270564 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.fernet_utils [None req-c16efa05-ec82-430b-8714-ded8dd52a28f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=416294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 09:06:26.306389 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337ab005-1dd9-4ba0-9192-4a2f93464a04 None None] Validating token access rules against request {{(pid=416293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:06:26.346403 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95162d63-1e03-4096-8940-63c093056b24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:06:26.347497 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95162d63-1e03-4096-8940-63c093056b24 None admin] REQUEST_METHOD: `GET` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:06:26.347991 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95162d63-1e03-4096-8940-63c093056b24 None admin] SCRIPT_NAME: `/identity` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:06:26.348471 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95162d63-1e03-4096-8940-63c093056b24 None admin] PATH_INFO: `/v3/users/swift` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:06:26.348951 dv-cinder-851351-1-smb devstack@keystone.service[416294]: [pid: 416294|app: 0|req: 285/556] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 09:06:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 09:06:26.349942 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16efa05-ec82-430b-8714-ded8dd52a28f None None] Authenticating user token {{(pid=416294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:06:26.357600 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95162d63-1e03-4096-8940-63c093056b24 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:06:26.359605 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95162d63-1e03-4096-8940-63c093056b24 None admin] RBAC: Authorization granted {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:06:26.373129 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application [None req-95162d63-1e03-4096-8940-63c093056b24 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 28 09:06:26.373129 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 09:06:26.373129 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 09:06:26.373129 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 09:06:26.373129 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 09:06:26.373129 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 09:06:26.373129 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 09:06:26.373129 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 09:06:26.373129 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 09:06:26.373129 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 09:06:26.373129 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 09:06:26.373129 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 09:06:26.373129 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 28 09:06:26.373129 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 28 09:06:26.373129 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 28 09:06:26.373129 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 28 09:06:26.374269 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 09:06:26.374269 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 09:06:26.374269 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 28 09:06:26.374269 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 09:06:26.374269 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 28 09:06:26.374269 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 09:06:26.374269 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 09:06:26.374269 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 09:06:26.374269 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 09:06:26.374269 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 09:06:26.374269 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 09:06:26.374269 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application with Lock( Jul 28 09:06:26.374269 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 09:06:26.374269 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self._enter() Jul 28 09:06:26.374269 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 09:06:26.374269 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 09:06:26.374269 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 09:06:26.374269 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self.creator() Jul 28 09:06:26.375377 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 09:06:26.375377 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application created_value = creator( Jul 28 09:06:26.375377 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 28 09:06:26.375377 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 28 09:06:26.375377 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 28 09:06:26.375377 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 28 09:06:26.375377 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 28 09:06:26.375377 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 28 09:06:26.375377 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 28 09:06:26.375377 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application Jul 28 09:06:26.378446 dv-cinder-851351-1-smb devstack@keystone.service[416293]: [pid: 416293|app: 0|req: 272/557] 10.222.0.42 () {56 vars in 1096 bytes} [Thu Jul 28 09:06:26 2022] GET /identity/v3/users/swift => generated 83 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 09:06:26.384913 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95162d63-1e03-4096-8940-63c093056b24 None admin] Authenticating user token {{(pid=416293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:06:26.441389 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG dbcounter [-] [416294] Writing DB stats keystone:SELECT=100 {{(pid=416294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:06:26.451988 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG dbcounter [-] [416293] Writing DB stats keystone:SELECT=100 {{(pid=416293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:06:26.483252 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16efa05-ec82-430b-8714-ded8dd52a28f None None] Validating token access rules against request {{(pid=416294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:06:26.524495 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392c0fe2-f7eb-4d96-90f6-41bff3e433b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:06:26.525324 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392c0fe2-f7eb-4d96-90f6-41bff3e433b4 None admin] REQUEST_METHOD: `GET` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:06:26.525615 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392c0fe2-f7eb-4d96-90f6-41bff3e433b4 None admin] SCRIPT_NAME: `/identity` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:06:26.525895 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392c0fe2-f7eb-4d96-90f6-41bff3e433b4 None admin] PATH_INFO: `/v3/users` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:06:26.526781 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-392c0fe2-f7eb-4d96-90f6-41bff3e433b4 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=416294) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 09:06:26.527153 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-392c0fe2-f7eb-4d96-90f6-41bff3e433b4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:06:26.528656 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-392c0fe2-f7eb-4d96-90f6-41bff3e433b4 None admin] RBAC: Authorization granted {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:06:26.531138 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95162d63-1e03-4096-8940-63c093056b24 None admin] Validating token access rules against request {{(pid=416293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:06:26.553074 dv-cinder-851351-1-smb devstack@keystone.service[416294]: [pid: 416294|app: 0|req: 286/558] 10.222.0.42 () {56 vars in 1133 bytes} [Thu Jul 28 09:06:26 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:06:26.554354 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392c0fe2-f7eb-4d96-90f6-41bff3e433b4 None admin] Authenticating user token {{(pid=416294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:06:26.608197 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892a32c4-c933-4c47-9563-df7ac3173069 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:06:26.609269 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892a32c4-c933-4c47-9563-df7ac3173069 None admin] REQUEST_METHOD: `GET` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:06:26.609735 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892a32c4-c933-4c47-9563-df7ac3173069 None admin] SCRIPT_NAME: `/identity` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:06:26.610190 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892a32c4-c933-4c47-9563-df7ac3173069 None admin] PATH_INFO: `/v3/users` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:06:26.611764 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-892a32c4-c933-4c47-9563-df7ac3173069 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=416293) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 09:06:26.612288 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-892a32c4-c933-4c47-9563-df7ac3173069 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:06:26.615150 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-892a32c4-c933-4c47-9563-df7ac3173069 None admin] RBAC: Authorization granted {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:06:26.648703 dv-cinder-851351-1-smb devstack@keystone.service[416293]: [pid: 416293|app: 0|req: 273/559] 10.222.0.42 () {56 vars in 1135 bytes} [Thu Jul 28 09:06:26 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:06:26.650253 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892a32c4-c933-4c47-9563-df7ac3173069 None admin] Authenticating user token {{(pid=416293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:06:26.691420 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392c0fe2-f7eb-4d96-90f6-41bff3e433b4 None admin] Validating token access rules against request {{(pid=416294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:06:26.724448 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG dbcounter [-] [416294] Writing DB stats keystone:SELECT=100 {{(pid=416294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:06:26.739688 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c9f1b50-eee7-4cf3-b106-41c6f5c37a5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:06:26.741119 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9f1b50-eee7-4cf3-b106-41c6f5c37a5d None admin] REQUEST_METHOD: `GET` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:06:26.741837 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9f1b50-eee7-4cf3-b106-41c6f5c37a5d None admin] SCRIPT_NAME: `/identity` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:06:26.742271 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9f1b50-eee7-4cf3-b106-41c6f5c37a5d None admin] PATH_INFO: `/v3/roles/service` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:06:26.755750 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c9f1b50-eee7-4cf3-b106-41c6f5c37a5d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 09:06:26.764285 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application [None req-8c9f1b50-eee7-4cf3-b106-41c6f5c37a5d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 28 09:06:26.764285 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 09:06:26.764285 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 09:06:26.764285 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 09:06:26.764285 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 09:06:26.764285 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 09:06:26.764285 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 09:06:26.764285 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 09:06:26.764285 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 09:06:26.764285 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 09:06:26.764285 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 09:06:26.764285 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 09:06:26.764285 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 09:06:26.764285 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 09:06:26.764285 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 09:06:26.764285 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 09:06:26.765464 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 09:06:26.765464 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 09:06:26.765464 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 09:06:26.765464 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 09:06:26.765464 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 09:06:26.765464 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 09:06:26.765464 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 09:06:26.765464 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 09:06:26.765464 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 09:06:26.765464 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 09:06:26.765464 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 09:06:26.765464 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application with Lock( Jul 28 09:06:26.765464 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 09:06:26.765464 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return self._enter() Jul 28 09:06:26.765464 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 09:06:26.765464 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 09:06:26.766387 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 09:06:26.766387 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return self.creator() Jul 28 09:06:26.766387 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 09:06:26.766387 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application created_value = creator( Jul 28 09:06:26.766387 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 09:06:26.766387 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 09:06:26.766387 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 09:06:26.766387 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 09:06:26.766387 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 09:06:26.766387 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 09:06:26.766387 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 28 09:06:26.766387 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application Jul 28 09:06:26.772904 dv-cinder-851351-1-smb devstack@keystone.service[416294]: [pid: 416294|app: 0|req: 287/560] 10.222.0.42 () {56 vars in 1102 bytes} [Thu Jul 28 09:06:26 2022] GET /identity/v3/roles/service => generated 85 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 09:06:26.774305 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c9f1b50-eee7-4cf3-b106-41c6f5c37a5d None admin] Authenticating user token {{(pid=416294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:06:26.797683 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG dbcounter [-] [416293] Writing DB stats keystone:SELECT=100 {{(pid=416293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:06:26.804880 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892a32c4-c933-4c47-9563-df7ac3173069 None admin] Validating token access rules against request {{(pid=416293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:06:26.853320 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7393393d-6f6e-4e9a-9373-68022b6c3239 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:06:26.854312 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7393393d-6f6e-4e9a-9373-68022b6c3239 None admin] REQUEST_METHOD: `GET` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:06:26.854754 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7393393d-6f6e-4e9a-9373-68022b6c3239 None admin] SCRIPT_NAME: `/identity` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:06:26.855610 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7393393d-6f6e-4e9a-9373-68022b6c3239 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:06:26.876799 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7393393d-6f6e-4e9a-9373-68022b6c3239 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:06:26.878983 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7393393d-6f6e-4e9a-9373-68022b6c3239 None admin] RBAC: Authorization granted {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:06:26.907006 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application [None req-7393393d-6f6e-4e9a-9373-68022b6c3239 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 09:06:26.907006 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 09:06:26.907006 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 09:06:26.907006 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 09:06:26.907006 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 09:06:26.907006 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 09:06:26.907006 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 09:06:26.907006 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 09:06:26.907006 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 09:06:26.907006 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 09:06:26.907006 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 09:06:26.907006 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 09:06:26.907006 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 09:06:26.907006 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 09:06:26.907006 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 09:06:26.908392 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 09:06:26.908392 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 09:06:26.908392 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 09:06:26.908392 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 09:06:26.908392 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 09:06:26.908392 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 09:06:26.908392 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 09:06:26.908392 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 09:06:26.908392 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application with Lock( Jul 28 09:06:26.908392 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 09:06:26.908392 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self._enter() Jul 28 09:06:26.908392 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 09:06:26.908392 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 09:06:26.908392 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 09:06:26.908392 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self.creator() Jul 28 09:06:26.908392 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 09:06:26.908392 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application created_value = creator( Jul 28 09:06:26.909511 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 09:06:26.909511 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 09:06:26.909511 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 09:06:26.909511 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application Jul 28 09:06:26.913161 dv-cinder-851351-1-smb devstack@keystone.service[416293]: [pid: 416293|app: 0|req: 274/561] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 09:06:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 264 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 09:06:26.914773 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7393393d-6f6e-4e9a-9373-68022b6c3239 None admin] Authenticating user token {{(pid=416293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:06:26.945296 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c9f1b50-eee7-4cf3-b106-41c6f5c37a5d None admin] Validating token access rules against request {{(pid=416294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:06:27.000074 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b5ea74-62e8-440c-b2d3-27e46fff22b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:06:27.000643 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b5ea74-62e8-440c-b2d3-27e46fff22b9 None admin] REQUEST_METHOD: `GET` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:06:27.000977 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b5ea74-62e8-440c-b2d3-27e46fff22b9 None admin] SCRIPT_NAME: `/identity` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:06:27.001257 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b5ea74-62e8-440c-b2d3-27e46fff22b9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:06:27.044268 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7393393d-6f6e-4e9a-9373-68022b6c3239 None admin] Validating token access rules against request {{(pid=416293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:06:27.070512 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG dbcounter [-] [416294] Writing DB stats keystone:SELECT=100 {{(pid=416294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:06:27.084432 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a55799-a049-4e57-935e-4142dcaf339c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:06:27.085114 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a55799-a049-4e57-935e-4142dcaf339c None admin] REQUEST_METHOD: `GET` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:06:27.085399 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a55799-a049-4e57-935e-4142dcaf339c None admin] SCRIPT_NAME: `/identity` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:06:27.085676 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a55799-a049-4e57-935e-4142dcaf339c None admin] PATH_INFO: `/v3/roles` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:06:27.086421 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6a55799-a049-4e57-935e-4142dcaf339c None admin] RBAC: Adding query filter params (name=service) {{(pid=416293) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 09:06:27.086726 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6a55799-a049-4e57-935e-4142dcaf339c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:06:27.088179 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6a55799-a049-4e57-935e-4142dcaf339c None admin] RBAC: Authorization granted {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:06:27.089749 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66b5ea74-62e8-440c-b2d3-27e46fff22b9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:06:27.091179 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66b5ea74-62e8-440c-b2d3-27e46fff22b9 None admin] RBAC: Authorization granted {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:06:27.097360 dv-cinder-851351-1-smb devstack@keystone.service[416293]: [pid: 416293|app: 0|req: 275/562] 10.222.0.42 () {56 vars in 1103 bytes} [Thu Jul 28 09:06:26 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:06:27.098230 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a55799-a049-4e57-935e-4142dcaf339c None admin] Authenticating user token {{(pid=416293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:06:27.115772 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG dbcounter [-] [416293] Writing DB stats keystone:SELECT=100 {{(pid=416293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:06:27.202403 dv-cinder-851351-1-smb devstack@keystone.service[416294]: [pid: 416294|app: 0|req: 288/563] 10.222.0.42 () {58 vars in 1282 bytes} [Thu Jul 28 09:06:26 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 429 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 28 09:06:27.203747 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7561c0-63e6-4eed-882c-76415a0ae25d None None] REQUEST_METHOD: `GET` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:06:27.204044 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7561c0-63e6-4eed-882c-76415a0ae25d None None] SCRIPT_NAME: `/identity` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:06:27.204325 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7561c0-63e6-4eed-882c-76415a0ae25d None None] PATH_INFO: `/` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:06:27.207671 dv-cinder-851351-1-smb devstack@keystone.service[416294]: [pid: 416294|app: 0|req: 289/564] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 09:06:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 09:06:27.207671 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648fa7f2-6dd5-4101-8750-6bd9b62d2333 None None] REQUEST_METHOD: `GET` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:06:27.207671 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648fa7f2-6dd5-4101-8750-6bd9b62d2333 None None] SCRIPT_NAME: `/identity` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:06:27.207671 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648fa7f2-6dd5-4101-8750-6bd9b62d2333 None None] PATH_INFO: `/` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:06:27.208533 dv-cinder-851351-1-smb devstack@keystone.service[416294]: [pid: 416294|app: 0|req: 290/565] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 09:06:27 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 09:06:27.209291 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-648fa7f2-6dd5-4101-8750-6bd9b62d2333 None None] Authenticating user token {{(pid=416294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:06:27.215712 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a55799-a049-4e57-935e-4142dcaf339c None admin] Validating token access rules against request {{(pid=416293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:06:27.253434 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c2f6fa-bad7-441b-9441-ee3cc2b29719 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:06:27.253988 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c2f6fa-bad7-441b-9441-ee3cc2b29719 None admin] REQUEST_METHOD: `GET` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:06:27.254273 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c2f6fa-bad7-441b-9441-ee3cc2b29719 None admin] SCRIPT_NAME: `/identity` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:06:27.254567 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c2f6fa-bad7-441b-9441-ee3cc2b29719 None admin] PATH_INFO: `/v3/domains` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:06:27.255370 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c2f6fa-bad7-441b-9441-ee3cc2b29719 None admin] RBAC: Adding query filter params (name=Default) {{(pid=416293) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 09:06:27.255683 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c2f6fa-bad7-441b-9441-ee3cc2b29719 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:06:27.257141 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c2f6fa-bad7-441b-9441-ee3cc2b29719 None admin] RBAC: Authorization granted {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:06:27.271209 dv-cinder-851351-1-smb devstack@keystone.service[416293]: [pid: 416293|app: 0|req: 276/566] 10.222.0.42 () {56 vars in 1109 bytes} [Thu Jul 28 09:06:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:06:27.272102 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c2f6fa-bad7-441b-9441-ee3cc2b29719 None admin] Authenticating user token {{(pid=416293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:06:27.307430 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG dbcounter [-] [416294] Writing DB stats keystone:SELECT=100 {{(pid=416294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:06:27.333084 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-648fa7f2-6dd5-4101-8750-6bd9b62d2333 None None] Validating token access rules against request {{(pid=416294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:06:27.358954 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG dbcounter [-] [416293] Writing DB stats keystone:SELECT=100 {{(pid=416293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:06:27.382686 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a988dc-1dc2-4d20-a2c4-b33028638508 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:06:27.383396 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a988dc-1dc2-4d20-a2c4-b33028638508 None admin] REQUEST_METHOD: `GET` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:06:27.383593 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a988dc-1dc2-4d20-a2c4-b33028638508 None admin] SCRIPT_NAME: `/identity` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:06:27.383964 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a988dc-1dc2-4d20-a2c4-b33028638508 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:06:27.394438 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c2f6fa-bad7-441b-9441-ee3cc2b29719 None admin] Validating token access rules against request {{(pid=416293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:06:27.395911 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79a988dc-1dc2-4d20-a2c4-b33028638508 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:06:27.397458 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79a988dc-1dc2-4d20-a2c4-b33028638508 None admin] RBAC: Authorization granted {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:06:27.414481 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application [None req-79a988dc-1dc2-4d20-a2c4-b33028638508 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 09:06:27.414481 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 09:06:27.414481 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 09:06:27.414481 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 09:06:27.414481 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 09:06:27.414481 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 09:06:27.414481 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 09:06:27.414481 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 09:06:27.414481 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 09:06:27.414481 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 09:06:27.414481 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 09:06:27.414481 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 09:06:27.414481 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 09:06:27.414481 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 09:06:27.414481 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 09:06:27.415556 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 09:06:27.415556 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 09:06:27.415556 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 09:06:27.415556 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 09:06:27.415556 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 09:06:27.415556 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 09:06:27.415556 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 09:06:27.415556 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 09:06:27.415556 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application with Lock( Jul 28 09:06:27.415556 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 09:06:27.415556 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return self._enter() Jul 28 09:06:27.415556 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 09:06:27.415556 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 09:06:27.415556 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 09:06:27.415556 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return self.creator() Jul 28 09:06:27.415556 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 09:06:27.415556 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application created_value = creator( Jul 28 09:06:27.416524 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 09:06:27.416524 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 09:06:27.416524 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 09:06:27.416524 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application Jul 28 09:06:27.416524 dv-cinder-851351-1-smb devstack@keystone.service[416294]: [pid: 416294|app: 0|req: 291/567] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 09:06:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 09:06:27.417337 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa1112e-d023-4b75-93b3-2664bbda5da1 None None] REQUEST_METHOD: `POST` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:06:27.417337 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa1112e-d023-4b75-93b3-2664bbda5da1 None None] SCRIPT_NAME: `/identity` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:06:27.417554 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa1112e-d023-4b75-93b3-2664bbda5da1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:06:27.436445 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.auth.core [None req-1aa1112e-d023-4b75-93b3-2664bbda5da1 None None] MFA Rules not processed for user `dbf87abab90e4fdf9e75408f4199918e`. Rule list: `[]` (Enabled: `True`). {{(pid=416294) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 09:06:27.437667 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103fdabb-24c4-4bd4-a1e9-69b67f3ee41e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:06:27.437808 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.fernet_utils [None req-1aa1112e-d023-4b75-93b3-2664bbda5da1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=416294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 09:06:27.438346 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103fdabb-24c4-4bd4-a1e9-69b67f3ee41e None admin] REQUEST_METHOD: `GET` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:06:27.438635 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103fdabb-24c4-4bd4-a1e9-69b67f3ee41e None admin] SCRIPT_NAME: `/identity` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:06:27.438911 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103fdabb-24c4-4bd4-a1e9-69b67f3ee41e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:06:27.451222 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-103fdabb-24c4-4bd4-a1e9-69b67f3ee41e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:06:27.452750 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-103fdabb-24c4-4bd4-a1e9-69b67f3ee41e None admin] RBAC: Authorization granted {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:06:27.468504 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application [None req-103fdabb-24c4-4bd4-a1e9-69b67f3ee41e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 09:06:27.468504 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 09:06:27.468504 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 09:06:27.468504 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 09:06:27.468504 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 09:06:27.468504 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 09:06:27.468504 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 09:06:27.468504 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 09:06:27.468504 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 09:06:27.468504 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 09:06:27.468504 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 09:06:27.468504 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 09:06:27.468504 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 09:06:27.468504 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 09:06:27.468504 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 09:06:27.469753 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 09:06:27.469753 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 09:06:27.469753 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 09:06:27.469753 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 09:06:27.469753 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 09:06:27.469753 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 09:06:27.469753 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 09:06:27.469753 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 09:06:27.469753 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application with Lock( Jul 28 09:06:27.469753 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 09:06:27.469753 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self._enter() Jul 28 09:06:27.469753 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 09:06:27.469753 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 09:06:27.469753 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 09:06:27.469753 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self.creator() Jul 28 09:06:27.469753 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 09:06:27.469753 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application created_value = creator( Jul 28 09:06:27.471107 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 09:06:27.471107 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 09:06:27.471107 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 09:06:27.471107 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application Jul 28 09:06:27.471107 dv-cinder-851351-1-smb devstack@keystone.service[416293]: [pid: 416293|app: 0|req: 277/568] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 09:06:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 09:06:27.471107 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ebe7bc-ed1c-40b6-95b5-4f013dd3800f None None] REQUEST_METHOD: `POST` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:06:27.471461 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ebe7bc-ed1c-40b6-95b5-4f013dd3800f None None] SCRIPT_NAME: `/identity` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:06:27.471560 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ebe7bc-ed1c-40b6-95b5-4f013dd3800f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:06:27.490807 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.auth.core [None req-97ebe7bc-ed1c-40b6-95b5-4f013dd3800f None None] MFA Rules not processed for user `dbf87abab90e4fdf9e75408f4199918e`. Rule list: `[]` (Enabled: `True`). {{(pid=416293) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 09:06:27.492021 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.fernet_utils [None req-97ebe7bc-ed1c-40b6-95b5-4f013dd3800f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=416293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 09:06:27.511814 dv-cinder-851351-1-smb devstack@keystone.service[416294]: [pid: 416294|app: 0|req: 292/569] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 09:06:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 09:06:27.512631 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa1112e-d023-4b75-93b3-2664bbda5da1 None None] Authenticating user token {{(pid=416294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:06:27.567847 dv-cinder-851351-1-smb devstack@keystone.service[416293]: [pid: 416293|app: 0|req: 278/570] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 09:06:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 09:06:27.568783 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ebe7bc-ed1c-40b6-95b5-4f013dd3800f None None] Authenticating user token {{(pid=416293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:06:27.587606 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG dbcounter [-] [416294] Writing DB stats keystone:SELECT=100 {{(pid=416294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:06:27.624510 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa1112e-d023-4b75-93b3-2664bbda5da1 None None] Validating token access rules against request {{(pid=416294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:06:27.638884 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG dbcounter [-] [416293] Writing DB stats keystone:SELECT=100 {{(pid=416293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:06:27.669204 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5873e37d-3834-453c-9f0b-afb89dc0bf4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:06:27.669868 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5873e37d-3834-453c-9f0b-afb89dc0bf4a None admin] REQUEST_METHOD: `GET` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:06:27.670152 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5873e37d-3834-453c-9f0b-afb89dc0bf4a None admin] SCRIPT_NAME: `/identity` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:06:27.670428 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5873e37d-3834-453c-9f0b-afb89dc0bf4a None admin] PATH_INFO: `/v3/projects/service` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:06:27.677739 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5873e37d-3834-453c-9f0b-afb89dc0bf4a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:06:27.679216 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5873e37d-3834-453c-9f0b-afb89dc0bf4a None admin] RBAC: Authorization granted {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:06:27.691128 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application [None req-5873e37d-3834-453c-9f0b-afb89dc0bf4a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 09:06:27.691128 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 09:06:27.691128 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 09:06:27.691128 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 09:06:27.691128 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 09:06:27.691128 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 09:06:27.691128 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 09:06:27.691128 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 09:06:27.691128 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 09:06:27.691128 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 09:06:27.691128 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 09:06:27.691128 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 09:06:27.691128 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 28 09:06:27.691128 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 28 09:06:27.691128 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 28 09:06:27.692223 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 28 09:06:27.692223 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 09:06:27.692223 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 09:06:27.692223 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 09:06:27.692223 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 09:06:27.692223 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 09:06:27.692223 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 09:06:27.692223 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 09:06:27.692223 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application with Lock( Jul 28 09:06:27.692223 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 09:06:27.692223 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return self._enter() Jul 28 09:06:27.692223 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 09:06:27.692223 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 09:06:27.692223 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 09:06:27.692223 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return self.creator() Jul 28 09:06:27.692223 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 09:06:27.692223 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application created_value = creator( Jul 28 09:06:27.693702 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 28 09:06:27.693702 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 28 09:06:27.693702 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 28 09:06:27.693702 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 28 09:06:27.693702 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 28 09:06:27.693702 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 28 09:06:27.693702 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 09:06:27.693702 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application Jul 28 09:06:27.693702 dv-cinder-851351-1-smb devstack@keystone.service[416294]: [pid: 416294|app: 0|req: 293/571] 10.222.0.42 () {56 vars in 1111 bytes} [Thu Jul 28 09:06:27 2022] GET /identity/v3/projects/service => generated 88 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 09:06:27.693702 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5873e37d-3834-453c-9f0b-afb89dc0bf4a None admin] Authenticating user token {{(pid=416294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:06:27.699046 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ebe7bc-ed1c-40b6-95b5-4f013dd3800f None None] Validating token access rules against request {{(pid=416293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:06:27.742653 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378dfcf9-7fe4-496d-8655-de4be1e3ca41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:06:27.743341 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378dfcf9-7fe4-496d-8655-de4be1e3ca41 None admin] REQUEST_METHOD: `GET` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:06:27.743653 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378dfcf9-7fe4-496d-8655-de4be1e3ca41 None admin] SCRIPT_NAME: `/identity` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:06:27.743929 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378dfcf9-7fe4-496d-8655-de4be1e3ca41 None admin] PATH_INFO: `/v3/domains` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:06:27.744749 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-378dfcf9-7fe4-496d-8655-de4be1e3ca41 None admin] RBAC: Adding query filter params (name=Default) {{(pid=416293) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 09:06:27.745085 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-378dfcf9-7fe4-496d-8655-de4be1e3ca41 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:06:27.746663 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-378dfcf9-7fe4-496d-8655-de4be1e3ca41 None admin] RBAC: Authorization granted {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:06:27.762996 dv-cinder-851351-1-smb devstack@keystone.service[416293]: [pid: 416293|app: 0|req: 279/572] 10.222.0.42 () {56 vars in 1109 bytes} [Thu Jul 28 09:06:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:06:27.763842 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378dfcf9-7fe4-496d-8655-de4be1e3ca41 None admin] Authenticating user token {{(pid=416293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:06:27.825721 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5873e37d-3834-453c-9f0b-afb89dc0bf4a None admin] Validating token access rules against request {{(pid=416294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:06:27.855617 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG dbcounter [-] [416294] Writing DB stats keystone:SELECT=100 {{(pid=416294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:06:27.866124 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f569616d-da87-47ed-92bd-b379dd3f0fc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:06:27.866793 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f569616d-da87-47ed-92bd-b379dd3f0fc7 None admin] REQUEST_METHOD: `GET` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:06:27.867080 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f569616d-da87-47ed-92bd-b379dd3f0fc7 None admin] SCRIPT_NAME: `/identity` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:06:27.867361 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f569616d-da87-47ed-92bd-b379dd3f0fc7 None admin] PATH_INFO: `/v3/domains` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:06:27.868080 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f569616d-da87-47ed-92bd-b379dd3f0fc7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=416294) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 09:06:27.868391 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f569616d-da87-47ed-92bd-b379dd3f0fc7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:06:27.869860 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f569616d-da87-47ed-92bd-b379dd3f0fc7 None admin] RBAC: Authorization granted {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:06:27.883992 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378dfcf9-7fe4-496d-8655-de4be1e3ca41 None admin] Validating token access rules against request {{(pid=416293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:06:27.890238 dv-cinder-851351-1-smb devstack@keystone.service[416294]: [pid: 416294|app: 0|req: 294/573] 10.222.0.42 () {56 vars in 1109 bytes} [Thu Jul 28 09:06:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:06:27.890238 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f569616d-da87-47ed-92bd-b379dd3f0fc7 None admin] Authenticating user token {{(pid=416294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:06:27.904674 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG dbcounter [-] [416293] Writing DB stats keystone:SELECT=100 {{(pid=416293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:06:27.932769 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36eedb60-9e4e-4ea1-8da4-5a372da86f32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:06:27.933451 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36eedb60-9e4e-4ea1-8da4-5a372da86f32 None admin] REQUEST_METHOD: `GET` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:06:27.933739 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36eedb60-9e4e-4ea1-8da4-5a372da86f32 None admin] SCRIPT_NAME: `/identity` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:06:27.934019 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36eedb60-9e4e-4ea1-8da4-5a372da86f32 None admin] PATH_INFO: `/v3/roles/service` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:06:27.946467 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36eedb60-9e4e-4ea1-8da4-5a372da86f32 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 09:06:27.952311 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application [None req-36eedb60-9e4e-4ea1-8da4-5a372da86f32 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 28 09:06:27.952311 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 09:06:27.952311 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 09:06:27.952311 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 09:06:27.952311 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 09:06:27.952311 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 09:06:27.952311 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 09:06:27.952311 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 09:06:27.952311 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 09:06:27.952311 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 09:06:27.952311 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 09:06:27.952311 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 09:06:27.952311 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 09:06:27.952311 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 09:06:27.952311 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 09:06:27.952311 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 09:06:27.953549 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 09:06:27.953549 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 09:06:27.953549 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 09:06:27.953549 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 09:06:27.953549 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 09:06:27.953549 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 09:06:27.953549 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 09:06:27.953549 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 09:06:27.953549 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 09:06:27.953549 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 09:06:27.953549 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 09:06:27.953549 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application with Lock( Jul 28 09:06:27.953549 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 09:06:27.953549 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self._enter() Jul 28 09:06:27.953549 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 09:06:27.953549 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 09:06:27.955090 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 09:06:27.955090 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self.creator() Jul 28 09:06:27.955090 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 09:06:27.955090 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application created_value = creator( Jul 28 09:06:27.955090 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 09:06:27.955090 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 09:06:27.955090 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 09:06:27.955090 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 09:06:27.955090 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 09:06:27.955090 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 09:06:27.955090 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 28 09:06:27.955090 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application Jul 28 09:06:27.955090 dv-cinder-851351-1-smb devstack@keystone.service[416293]: [pid: 416293|app: 0|req: 280/574] 10.222.0.42 () {56 vars in 1102 bytes} [Thu Jul 28 09:06:27 2022] GET /identity/v3/roles/service => generated 85 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 09:06:27.955090 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36eedb60-9e4e-4ea1-8da4-5a372da86f32 None admin] Authenticating user token {{(pid=416293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:06:28.013218 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f569616d-da87-47ed-92bd-b379dd3f0fc7 None admin] Validating token access rules against request {{(pid=416294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:06:28.058701 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca050631-57b2-4376-8ceb-44ea73df9b7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:06:28.059367 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca050631-57b2-4376-8ceb-44ea73df9b7c None admin] REQUEST_METHOD: `GET` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:06:28.059638 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca050631-57b2-4376-8ceb-44ea73df9b7c None admin] SCRIPT_NAME: `/identity` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:06:28.059917 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca050631-57b2-4376-8ceb-44ea73df9b7c None admin] PATH_INFO: `/v3/roles/service` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:06:28.075200 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca050631-57b2-4376-8ceb-44ea73df9b7c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 09:06:28.080331 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application [None req-ca050631-57b2-4376-8ceb-44ea73df9b7c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 28 09:06:28.080331 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 09:06:28.080331 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 09:06:28.080331 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 09:06:28.080331 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 09:06:28.080331 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 09:06:28.080331 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 09:06:28.080331 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 09:06:28.080331 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 09:06:28.080331 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 09:06:28.080331 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 09:06:28.080331 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 09:06:28.080331 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 09:06:28.080331 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 09:06:28.080331 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 09:06:28.080331 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 09:06:28.082120 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 09:06:28.082120 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 09:06:28.082120 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 09:06:28.082120 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 09:06:28.082120 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 09:06:28.082120 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 09:06:28.082120 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 09:06:28.082120 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 09:06:28.082120 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 09:06:28.082120 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 09:06:28.082120 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 09:06:28.082120 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application with Lock( Jul 28 09:06:28.082120 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 09:06:28.082120 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return self._enter() Jul 28 09:06:28.082120 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 09:06:28.082120 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 09:06:28.084061 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 09:06:28.084061 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return self.creator() Jul 28 09:06:28.084061 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 09:06:28.084061 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application created_value = creator( Jul 28 09:06:28.084061 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 09:06:28.084061 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 09:06:28.084061 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 09:06:28.084061 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 09:06:28.084061 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 09:06:28.084061 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 09:06:28.084061 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 28 09:06:28.084061 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application Jul 28 09:06:28.084061 dv-cinder-851351-1-smb devstack@keystone.service[416294]: [pid: 416294|app: 0|req: 295/575] 10.222.0.42 () {56 vars in 1102 bytes} [Thu Jul 28 09:06:27 2022] GET /identity/v3/roles/service => generated 85 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 09:06:28.084061 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca050631-57b2-4376-8ceb-44ea73df9b7c None admin] Authenticating user token {{(pid=416294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:06:28.100552 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36eedb60-9e4e-4ea1-8da4-5a372da86f32 None admin] Validating token access rules against request {{(pid=416293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:06:28.137106 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185f01b7-6622-44cd-b0a2-c66c6e683ee2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:06:28.137766 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185f01b7-6622-44cd-b0a2-c66c6e683ee2 None admin] REQUEST_METHOD: `GET` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:06:28.138042 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185f01b7-6622-44cd-b0a2-c66c6e683ee2 None admin] SCRIPT_NAME: `/identity` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:06:28.138317 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185f01b7-6622-44cd-b0a2-c66c6e683ee2 None admin] PATH_INFO: `/v3/projects` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:06:28.139082 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-185f01b7-6622-44cd-b0a2-c66c6e683ee2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=416293) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 09:06:28.139388 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-185f01b7-6622-44cd-b0a2-c66c6e683ee2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:06:28.140910 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-185f01b7-6622-44cd-b0a2-c66c6e683ee2 None admin] RBAC: Authorization granted {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:06:28.144691 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG dbcounter [-] [416294] Writing DB stats keystone:SELECT=100 {{(pid=416294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:06:28.154278 dv-cinder-851351-1-smb devstack@keystone.service[416293]: [pid: 416293|app: 0|req: 281/576] 10.222.0.42 () {56 vars in 1148 bytes} [Thu Jul 28 09:06:27 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:06:28.155152 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185f01b7-6622-44cd-b0a2-c66c6e683ee2 None admin] Authenticating user token {{(pid=416293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:06:28.190919 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG dbcounter [-] [416293] Writing DB stats keystone:SELECT=100 {{(pid=416293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:06:28.224460 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca050631-57b2-4376-8ceb-44ea73df9b7c None admin] Validating token access rules against request {{(pid=416294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:06:28.261366 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185f01b7-6622-44cd-b0a2-c66c6e683ee2 None admin] Validating token access rules against request {{(pid=416293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:06:28.264342 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e563ed-2245-462b-98aa-42a9b5fc9480 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:06:28.264976 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e563ed-2245-462b-98aa-42a9b5fc9480 None admin] REQUEST_METHOD: `GET` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:06:28.265263 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e563ed-2245-462b-98aa-42a9b5fc9480 None admin] SCRIPT_NAME: `/identity` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:06:28.265537 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e563ed-2245-462b-98aa-42a9b5fc9480 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:06:28.276436 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15e563ed-2245-462b-98aa-42a9b5fc9480 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:06:28.278350 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15e563ed-2245-462b-98aa-42a9b5fc9480 None admin] RBAC: Authorization granted {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:06:28.291936 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application [None req-15e563ed-2245-462b-98aa-42a9b5fc9480 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jul 28 09:06:28.291936 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 09:06:28.291936 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 09:06:28.291936 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 09:06:28.291936 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 09:06:28.291936 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 09:06:28.291936 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 09:06:28.291936 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 09:06:28.291936 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 09:06:28.291936 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 09:06:28.291936 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 09:06:28.291936 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 09:06:28.291936 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 28 09:06:28.291936 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 28 09:06:28.291936 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 28 09:06:28.291936 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 28 09:06:28.293287 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 09:06:28.293287 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 09:06:28.293287 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 28 09:06:28.293287 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 09:06:28.293287 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 28 09:06:28.293287 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 09:06:28.293287 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 09:06:28.293287 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 09:06:28.293287 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 09:06:28.293287 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 09:06:28.293287 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 09:06:28.293287 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application with Lock( Jul 28 09:06:28.293287 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 09:06:28.293287 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return self._enter() Jul 28 09:06:28.293287 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 09:06:28.293287 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 09:06:28.293287 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 09:06:28.293287 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return self.creator() Jul 28 09:06:28.294796 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 09:06:28.294796 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application created_value = creator( Jul 28 09:06:28.294796 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 28 09:06:28.294796 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 28 09:06:28.294796 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 28 09:06:28.294796 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 28 09:06:28.294796 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 28 09:06:28.294796 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 28 09:06:28.294796 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jul 28 09:06:28.294796 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application Jul 28 09:06:28.294796 dv-cinder-851351-1-smb devstack@keystone.service[416294]: [pid: 416294|app: 0|req: 296/577] 10.222.0.42 () {56 vars in 1099 bytes} [Thu Jul 28 09:06:28 2022] GET /identity/v3/users/cinder => generated 84 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 09:06:28.294796 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e563ed-2245-462b-98aa-42a9b5fc9480 None admin] Authenticating user token {{(pid=416294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:06:28.301840 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d48bc3-b124-446f-9af1-1bbf628403d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:06:28.302521 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d48bc3-b124-446f-9af1-1bbf628403d6 None admin] REQUEST_METHOD: `GET` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:06:28.302762 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d48bc3-b124-446f-9af1-1bbf628403d6 None admin] SCRIPT_NAME: `/identity` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:06:28.303065 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d48bc3-b124-446f-9af1-1bbf628403d6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:06:28.310552 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28d48bc3-b124-446f-9af1-1bbf628403d6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:06:28.312049 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28d48bc3-b124-446f-9af1-1bbf628403d6 None admin] RBAC: Authorization granted {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:06:28.324462 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application [None req-28d48bc3-b124-446f-9af1-1bbf628403d6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 09:06:28.324462 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 09:06:28.324462 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 09:06:28.324462 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 09:06:28.324462 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 09:06:28.324462 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 09:06:28.324462 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 09:06:28.324462 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 09:06:28.324462 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 09:06:28.324462 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 09:06:28.324462 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 09:06:28.324462 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 09:06:28.324462 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 28 09:06:28.324462 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 28 09:06:28.324462 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 28 09:06:28.325638 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 28 09:06:28.325638 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 09:06:28.325638 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 09:06:28.325638 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 09:06:28.325638 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 09:06:28.325638 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 09:06:28.325638 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 09:06:28.325638 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 09:06:28.325638 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application with Lock( Jul 28 09:06:28.325638 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 09:06:28.325638 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self._enter() Jul 28 09:06:28.325638 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 09:06:28.325638 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 09:06:28.325638 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 09:06:28.325638 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self.creator() Jul 28 09:06:28.325638 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 09:06:28.325638 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application created_value = creator( Jul 28 09:06:28.326644 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 28 09:06:28.326644 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 28 09:06:28.326644 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 28 09:06:28.326644 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 28 09:06:28.326644 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 28 09:06:28.326644 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 28 09:06:28.326644 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 09:06:28.326644 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application Jul 28 09:06:28.326644 dv-cinder-851351-1-smb devstack@keystone.service[416293]: [pid: 416293|app: 0|req: 282/578] 10.222.0.42 () {56 vars in 1111 bytes} [Thu Jul 28 09:06:28 2022] GET /identity/v3/projects/service => generated 88 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 09:06:28.326644 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d48bc3-b124-446f-9af1-1bbf628403d6 None admin] Authenticating user token {{(pid=416293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:06:28.404932 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e563ed-2245-462b-98aa-42a9b5fc9480 None admin] Validating token access rules against request {{(pid=416294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:06:28.412912 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG dbcounter [-] [416294] Writing DB stats keystone:SELECT=100 {{(pid=416294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:06:28.431203 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG dbcounter [-] [416293] Writing DB stats keystone:SELECT=100 {{(pid=416293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:06:28.439613 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d48bc3-b124-446f-9af1-1bbf628403d6 None admin] Validating token access rules against request {{(pid=416293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:06:28.444001 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c967889-d68e-43da-8302-24fbb5afae7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:06:28.444654 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c967889-d68e-43da-8302-24fbb5afae7d None admin] REQUEST_METHOD: `GET` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:06:28.444964 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c967889-d68e-43da-8302-24fbb5afae7d None admin] SCRIPT_NAME: `/identity` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:06:28.445236 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c967889-d68e-43da-8302-24fbb5afae7d None admin] PATH_INFO: `/v3/roles` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:06:28.445981 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c967889-d68e-43da-8302-24fbb5afae7d None admin] RBAC: Adding query filter params (name=service) {{(pid=416294) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 09:06:28.446431 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c967889-d68e-43da-8302-24fbb5afae7d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:06:28.448866 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c967889-d68e-43da-8302-24fbb5afae7d None admin] RBAC: Authorization granted {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:06:28.460268 dv-cinder-851351-1-smb devstack@keystone.service[416294]: [pid: 416294|app: 0|req: 297/579] 10.222.0.42 () {56 vars in 1103 bytes} [Thu Jul 28 09:06:28 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:06:28.461147 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c967889-d68e-43da-8302-24fbb5afae7d None admin] Authenticating user token {{(pid=416294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:06:28.481930 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2002a524-d440-4581-89ec-e6c44137f5fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:06:28.482587 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2002a524-d440-4581-89ec-e6c44137f5fd None admin] REQUEST_METHOD: `GET` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:06:28.482875 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2002a524-d440-4581-89ec-e6c44137f5fd None admin] SCRIPT_NAME: `/identity` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:06:28.483155 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2002a524-d440-4581-89ec-e6c44137f5fd None admin] PATH_INFO: `/v3/roles` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:06:28.483904 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2002a524-d440-4581-89ec-e6c44137f5fd None admin] RBAC: Adding query filter params (name=service) {{(pid=416293) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 09:06:28.484219 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2002a524-d440-4581-89ec-e6c44137f5fd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:06:28.485681 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2002a524-d440-4581-89ec-e6c44137f5fd None admin] RBAC: Authorization granted {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:06:28.494635 dv-cinder-851351-1-smb devstack@keystone.service[416293]: [pid: 416293|app: 0|req: 283/580] 10.222.0.42 () {56 vars in 1103 bytes} [Thu Jul 28 09:06:28 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:06:28.495586 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2002a524-d440-4581-89ec-e6c44137f5fd None admin] Authenticating user token {{(pid=416293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:06:28.582683 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c967889-d68e-43da-8302-24fbb5afae7d None admin] Validating token access rules against request {{(pid=416294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:06:28.604155 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2002a524-d440-4581-89ec-e6c44137f5fd None admin] Validating token access rules against request {{(pid=416293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:06:28.620085 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c445d45-bbca-4de8-a05f-1c0fe71cc5c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:06:28.620803 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c445d45-bbca-4de8-a05f-1c0fe71cc5c8 None admin] REQUEST_METHOD: `PUT` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:06:28.621089 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c445d45-bbca-4de8-a05f-1c0fe71cc5c8 None admin] SCRIPT_NAME: `/identity` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:06:28.621365 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c445d45-bbca-4de8-a05f-1c0fe71cc5c8 None admin] PATH_INFO: `/v3/projects/6c4349445f224184b093d9dfd0dfc642/users/62f7da38a7044000bdf5790da751a45e/roles/13417fbdbc5145a69bc01ff0f931fd96` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:06:28.637210 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c445d45-bbca-4de8-a05f-1c0fe71cc5c8 None admin] RBAC: Authorizing `identity:create_grant(project_id=6c4349445f224184b093d9dfd0dfc642, user_id=62f7da38a7044000bdf5790da751a45e, role_id=13417fbdbc5145a69bc01ff0f931fd96)` {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:06:28.638682 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c445d45-bbca-4de8-a05f-1c0fe71cc5c8 None admin] RBAC: Authorization granted {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:06:28.640832 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54db4ac-2c63-4537-b230-6efa8bdce1a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:06:28.641479 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54db4ac-2c63-4537-b230-6efa8bdce1a0 None admin] REQUEST_METHOD: `GET` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:06:28.641769 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54db4ac-2c63-4537-b230-6efa8bdce1a0 None admin] SCRIPT_NAME: `/identity` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:06:28.642048 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54db4ac-2c63-4537-b230-6efa8bdce1a0 None admin] PATH_INFO: `/v3/users` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:06:28.642895 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a54db4ac-2c63-4537-b230-6efa8bdce1a0 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=416293) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 09:06:28.643290 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a54db4ac-2c63-4537-b230-6efa8bdce1a0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:06:28.644877 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a54db4ac-2c63-4537-b230-6efa8bdce1a0 None admin] RBAC: Authorization granted {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:06:28.654017 dv-cinder-851351-1-smb devstack@keystone.service[416294]: [pid: 416294|app: 0|req: 298/581] 10.222.0.42 () {58 vars in 1439 bytes} [Thu Jul 28 09:06:28 2022] PUT /identity/v3/projects/6c4349445f224184b093d9dfd0dfc642/users/62f7da38a7044000bdf5790da751a45e/roles/13417fbdbc5145a69bc01ff0f931fd96 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 09:06:28.655110 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c445d45-bbca-4de8-a05f-1c0fe71cc5c8 None admin] Authenticating user token {{(pid=416294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:06:28.670017 dv-cinder-851351-1-smb devstack@keystone.service[416293]: [pid: 416293|app: 0|req: 284/582] 10.222.0.42 () {56 vars in 1137 bytes} [Thu Jul 28 09:06:28 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:06:28.671073 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54db4ac-2c63-4537-b230-6efa8bdce1a0 None admin] Authenticating user token {{(pid=416293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:06:28.677656 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG dbcounter [-] [416294] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=416294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:06:28.693437 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG dbcounter [-] [416293] Writing DB stats keystone:SELECT=100 {{(pid=416293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:06:28.784226 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c445d45-bbca-4de8-a05f-1c0fe71cc5c8 None admin] Validating token access rules against request {{(pid=416294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:06:28.791666 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54db4ac-2c63-4537-b230-6efa8bdce1a0 None admin] Validating token access rules against request {{(pid=416293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:06:28.824177 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a5e2041-2a7a-45b4-a885-f6ce3072bab7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:06:28.824872 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5e2041-2a7a-45b4-a885-f6ce3072bab7 None admin] REQUEST_METHOD: `GET` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:06:28.825159 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5e2041-2a7a-45b4-a885-f6ce3072bab7 None admin] SCRIPT_NAME: `/identity` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:06:28.825514 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5e2041-2a7a-45b4-a885-f6ce3072bab7 None admin] PATH_INFO: `/v3/projects` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:06:28.826195 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a5e2041-2a7a-45b4-a885-f6ce3072bab7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=416294) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 09:06:28.826505 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a5e2041-2a7a-45b4-a885-f6ce3072bab7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:06:28.827997 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a5e2041-2a7a-45b4-a885-f6ce3072bab7 None admin] RBAC: Authorization granted {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:06:28.839369 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-724da881-7581-4b7b-9880-eb0dfa19f5da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:06:28.839982 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724da881-7581-4b7b-9880-eb0dfa19f5da None admin] REQUEST_METHOD: `GET` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:06:28.840277 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724da881-7581-4b7b-9880-eb0dfa19f5da None admin] SCRIPT_NAME: `/identity` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:06:28.840563 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724da881-7581-4b7b-9880-eb0dfa19f5da None admin] PATH_INFO: `/v3/domains/Default` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:06:28.843642 dv-cinder-851351-1-smb devstack@keystone.service[416294]: [pid: 416294|app: 0|req: 299/583] 10.222.0.42 () {56 vars in 1148 bytes} [Thu Jul 28 09:06:28 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:06:28.844536 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a5e2041-2a7a-45b4-a885-f6ce3072bab7 None admin] Authenticating user token {{(pid=416294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:06:28.852378 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-724da881-7581-4b7b-9880-eb0dfa19f5da None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:06:28.853900 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-724da881-7581-4b7b-9880-eb0dfa19f5da None admin] RBAC: Authorization granted {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:06:28.875622 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application [None req-724da881-7581-4b7b-9880-eb0dfa19f5da None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 09:06:28.875622 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 09:06:28.875622 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 09:06:28.875622 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 09:06:28.875622 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 09:06:28.875622 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 09:06:28.875622 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 09:06:28.875622 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 09:06:28.875622 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 09:06:28.875622 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 09:06:28.875622 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 09:06:28.875622 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 09:06:28.875622 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 09:06:28.875622 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 09:06:28.875622 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 09:06:28.876750 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 09:06:28.876750 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 09:06:28.876750 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 09:06:28.876750 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 09:06:28.876750 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 09:06:28.876750 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 09:06:28.876750 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 09:06:28.876750 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 09:06:28.876750 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application with Lock( Jul 28 09:06:28.876750 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 09:06:28.876750 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self._enter() Jul 28 09:06:28.876750 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 09:06:28.876750 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 09:06:28.876750 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 09:06:28.876750 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self.creator() Jul 28 09:06:28.876750 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 09:06:28.876750 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application created_value = creator( Jul 28 09:06:28.877774 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 09:06:28.877774 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 09:06:28.877774 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 09:06:28.877774 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application Jul 28 09:06:28.878180 dv-cinder-851351-1-smb devstack@keystone.service[416293]: [pid: 416293|app: 0|req: 285/584] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 09:06:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 09:06:28.883195 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-724da881-7581-4b7b-9880-eb0dfa19f5da None admin] Authenticating user token {{(pid=416293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:06:28.937670 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG dbcounter [-] [416294] Writing DB stats keystone:SELECT=100 {{(pid=416294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:06:28.955064 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG dbcounter [-] [416293] Writing DB stats keystone:SELECT=100 {{(pid=416293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:06:28.964390 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a5e2041-2a7a-45b4-a885-f6ce3072bab7 None admin] Validating token access rules against request {{(pid=416294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:06:29.004825 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-724da881-7581-4b7b-9880-eb0dfa19f5da None admin] Validating token access rules against request {{(pid=416293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:06:29.009280 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b6698b-10e4-4379-8a37-e75a26073958 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:06:29.010072 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b6698b-10e4-4379-8a37-e75a26073958 None admin] REQUEST_METHOD: `GET` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:06:29.010418 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b6698b-10e4-4379-8a37-e75a26073958 None admin] SCRIPT_NAME: `/identity` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:06:29.010758 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b6698b-10e4-4379-8a37-e75a26073958 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:06:29.023286 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1b6698b-10e4-4379-8a37-e75a26073958 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:06:29.024925 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1b6698b-10e4-4379-8a37-e75a26073958 None admin] RBAC: Authorization granted {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:06:29.041540 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application [None req-d1b6698b-10e4-4379-8a37-e75a26073958 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 09:06:29.041540 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 09:06:29.041540 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 09:06:29.041540 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 09:06:29.041540 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 09:06:29.041540 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 09:06:29.041540 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 09:06:29.041540 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 09:06:29.041540 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 09:06:29.041540 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 09:06:29.041540 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 09:06:29.041540 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 09:06:29.041540 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 09:06:29.041540 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 09:06:29.041540 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 09:06:29.042609 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 09:06:29.042609 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 09:06:29.042609 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 09:06:29.042609 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 09:06:29.042609 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 09:06:29.042609 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 09:06:29.042609 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 09:06:29.042609 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 09:06:29.042609 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application with Lock( Jul 28 09:06:29.042609 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 09:06:29.042609 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return self._enter() Jul 28 09:06:29.042609 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 09:06:29.042609 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 09:06:29.042609 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 09:06:29.042609 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return self.creator() Jul 28 09:06:29.042609 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 09:06:29.042609 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application created_value = creator( Jul 28 09:06:29.043614 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 09:06:29.043614 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 09:06:29.043614 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 09:06:29.043614 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application Jul 28 09:06:29.043614 dv-cinder-851351-1-smb devstack@keystone.service[416294]: [pid: 416294|app: 0|req: 300/585] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 09:06:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 09:06:29.043614 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b6698b-10e4-4379-8a37-e75a26073958 None admin] Authenticating user token {{(pid=416294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:06:29.050440 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a40867-676f-4345-b4b9-0a6649cbe3aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:06:29.050899 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a40867-676f-4345-b4b9-0a6649cbe3aa None admin] REQUEST_METHOD: `GET` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:06:29.051186 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a40867-676f-4345-b4b9-0a6649cbe3aa None admin] SCRIPT_NAME: `/identity` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:06:29.051465 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a40867-676f-4345-b4b9-0a6649cbe3aa None admin] PATH_INFO: `/v3/domains/Default` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:06:29.064443 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04a40867-676f-4345-b4b9-0a6649cbe3aa None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:06:29.066046 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04a40867-676f-4345-b4b9-0a6649cbe3aa None admin] RBAC: Authorization granted {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:06:29.082591 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application [None req-04a40867-676f-4345-b4b9-0a6649cbe3aa None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 09:06:29.082591 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 09:06:29.082591 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 09:06:29.082591 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 09:06:29.082591 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 09:06:29.082591 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 09:06:29.082591 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 09:06:29.082591 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 09:06:29.082591 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 09:06:29.082591 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 09:06:29.082591 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 09:06:29.082591 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 09:06:29.082591 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 09:06:29.082591 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 09:06:29.082591 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 09:06:29.083614 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 09:06:29.083614 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 09:06:29.083614 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 09:06:29.083614 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 09:06:29.083614 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 09:06:29.083614 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 09:06:29.083614 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 09:06:29.083614 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 09:06:29.083614 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application with Lock( Jul 28 09:06:29.083614 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 09:06:29.083614 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self._enter() Jul 28 09:06:29.083614 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 09:06:29.083614 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 09:06:29.083614 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 09:06:29.083614 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self.creator() Jul 28 09:06:29.083614 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 09:06:29.083614 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application created_value = creator( Jul 28 09:06:29.084584 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 09:06:29.084584 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 09:06:29.084584 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 09:06:29.084584 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application Jul 28 09:06:29.084584 dv-cinder-851351-1-smb devstack@keystone.service[416293]: [pid: 416293|app: 0|req: 286/586] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 09:06:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 09:06:29.085300 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a40867-676f-4345-b4b9-0a6649cbe3aa None admin] Authenticating user token {{(pid=416293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:06:29.173771 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b6698b-10e4-4379-8a37-e75a26073958 None admin] Validating token access rules against request {{(pid=416294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:06:29.206253 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a40867-676f-4345-b4b9-0a6649cbe3aa None admin] Validating token access rules against request {{(pid=416293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:06:29.206479 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG dbcounter [-] [416294] Writing DB stats keystone:SELECT=100 {{(pid=416294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:06:29.213890 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1cd041-280e-4a47-9c84-fe91ad0e956c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:06:29.214535 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1cd041-280e-4a47-9c84-fe91ad0e956c None admin] REQUEST_METHOD: `GET` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:06:29.215356 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1cd041-280e-4a47-9c84-fe91ad0e956c None admin] SCRIPT_NAME: `/identity` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:06:29.215653 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1cd041-280e-4a47-9c84-fe91ad0e956c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:06:29.216474 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd1cd041-280e-4a47-9c84-fe91ad0e956c None admin] RBAC: Adding query filter params (role.id=13417fbdbc5145a69bc01ff0f931fd96, scope.project.id=6c4349445f224184b093d9dfd0dfc642, user.id=1a2e0811e3e347a387717df1e23d61bf) {{(pid=416294) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 09:06:29.216815 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd1cd041-280e-4a47-9c84-fe91ad0e956c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:06:29.219068 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd1cd041-280e-4a47-9c84-fe91ad0e956c None admin] RBAC: Authorization granted {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:06:29.225612 dv-cinder-851351-1-smb devstack@keystone.service[416294]: [pid: 416294|app: 0|req: 301/587] 10.222.0.42 () {56 vars in 1374 bytes} [Thu Jul 28 09:06:29 2022] GET /identity/v3/role_assignments?user.id=1a2e0811e3e347a387717df1e23d61bf&scope.project.id=6c4349445f224184b093d9dfd0dfc642&role.id=13417fbdbc5145a69bc01ff0f931fd96 => generated 259 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:06:29.226214 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG dbcounter [-] [416293] Writing DB stats keystone:SELECT=100 {{(pid=416293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:06:29.237794 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1cd041-280e-4a47-9c84-fe91ad0e956c None admin] Authenticating user token {{(pid=416294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:06:29.251271 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ed124f-0483-4b61-bf55-de4549855d20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:06:29.253384 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ed124f-0483-4b61-bf55-de4549855d20 None admin] REQUEST_METHOD: `GET` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:06:29.253998 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ed124f-0483-4b61-bf55-de4549855d20 None admin] SCRIPT_NAME: `/identity` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:06:29.255118 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ed124f-0483-4b61-bf55-de4549855d20 None admin] PATH_INFO: `/v3/domains` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:06:29.256163 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29ed124f-0483-4b61-bf55-de4549855d20 None admin] RBAC: Adding query filter params (name=Default) {{(pid=416293) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 09:06:29.257115 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29ed124f-0483-4b61-bf55-de4549855d20 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:06:29.258667 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29ed124f-0483-4b61-bf55-de4549855d20 None admin] RBAC: Authorization granted {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:06:29.281840 dv-cinder-851351-1-smb devstack@keystone.service[416293]: [pid: 416293|app: 0|req: 287/588] 10.222.0.42 () {56 vars in 1109 bytes} [Thu Jul 28 09:06:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:06:29.283251 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ed124f-0483-4b61-bf55-de4549855d20 None admin] Authenticating user token {{(pid=416293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:06:29.398940 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1cd041-280e-4a47-9c84-fe91ad0e956c None admin] Validating token access rules against request {{(pid=416294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:06:29.434389 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ed124f-0483-4b61-bf55-de4549855d20 None admin] Validating token access rules against request {{(pid=416293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:06:29.453554 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5bdcbbd-168d-4288-92fd-affca0fe8eb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:06:29.454598 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5bdcbbd-168d-4288-92fd-affca0fe8eb4 None admin] REQUEST_METHOD: `GET` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:06:29.454891 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5bdcbbd-168d-4288-92fd-affca0fe8eb4 None admin] SCRIPT_NAME: `/identity` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:06:29.455178 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5bdcbbd-168d-4288-92fd-affca0fe8eb4 None admin] PATH_INFO: `/v3/domains` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:06:29.455893 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5bdcbbd-168d-4288-92fd-affca0fe8eb4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=416294) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 09:06:29.456202 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5bdcbbd-168d-4288-92fd-affca0fe8eb4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:06:29.458250 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5bdcbbd-168d-4288-92fd-affca0fe8eb4 None admin] RBAC: Authorization granted {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:06:29.472466 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-730a5f5f-9be4-4042-a80a-88e0c6f14c82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:06:29.473259 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730a5f5f-9be4-4042-a80a-88e0c6f14c82 None admin] REQUEST_METHOD: `GET` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:06:29.473603 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730a5f5f-9be4-4042-a80a-88e0c6f14c82 None admin] SCRIPT_NAME: `/identity` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:06:29.473943 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730a5f5f-9be4-4042-a80a-88e0c6f14c82 None admin] PATH_INFO: `/v3/domains` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:06:29.474726 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-730a5f5f-9be4-4042-a80a-88e0c6f14c82 None admin] RBAC: Adding query filter params (name=Default) {{(pid=416293) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 09:06:29.475088 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-730a5f5f-9be4-4042-a80a-88e0c6f14c82 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:06:29.476629 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-730a5f5f-9be4-4042-a80a-88e0c6f14c82 None admin] RBAC: Authorization granted {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:06:29.479188 dv-cinder-851351-1-smb devstack@keystone.service[416294]: [pid: 416294|app: 0|req: 302/589] 10.222.0.42 () {56 vars in 1109 bytes} [Thu Jul 28 09:06:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:06:29.480842 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5bdcbbd-168d-4288-92fd-affca0fe8eb4 None admin] Authenticating user token {{(pid=416294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:06:29.490957 dv-cinder-851351-1-smb devstack@keystone.service[416293]: [pid: 416293|app: 0|req: 288/590] 10.222.0.42 () {56 vars in 1109 bytes} [Thu Jul 28 09:06:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:06:29.492108 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-730a5f5f-9be4-4042-a80a-88e0c6f14c82 None admin] Authenticating user token {{(pid=416293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:06:29.540975 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG dbcounter [-] [416293] Writing DB stats keystone:SELECT=100 {{(pid=416293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:06:29.558072 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG dbcounter [-] [416294] Writing DB stats keystone:SELECT=100 {{(pid=416294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:06:29.620518 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5bdcbbd-168d-4288-92fd-affca0fe8eb4 None admin] Validating token access rules against request {{(pid=416294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:06:29.625333 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-730a5f5f-9be4-4042-a80a-88e0c6f14c82 None admin] Validating token access rules against request {{(pid=416293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:06:29.666173 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c239df-0dae-4e54-80d0-f5cd0563254f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:06:29.667106 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c239df-0dae-4e54-80d0-f5cd0563254f None admin] REQUEST_METHOD: `GET` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:06:29.667597 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c239df-0dae-4e54-80d0-f5cd0563254f None admin] SCRIPT_NAME: `/identity` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:06:29.667979 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c239df-0dae-4e54-80d0-f5cd0563254f None admin] PATH_INFO: `/v3/users/glance` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:06:29.669980 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e37711-d0c3-48df-9b44-3532571d5ef3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:06:29.671140 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e37711-d0c3-48df-9b44-3532571d5ef3 None admin] REQUEST_METHOD: `GET` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:06:29.672384 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e37711-d0c3-48df-9b44-3532571d5ef3 None admin] SCRIPT_NAME: `/identity` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:06:29.672890 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e37711-d0c3-48df-9b44-3532571d5ef3 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:06:29.677782 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84c239df-0dae-4e54-80d0-f5cd0563254f None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:06:29.679407 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84c239df-0dae-4e54-80d0-f5cd0563254f None admin] RBAC: Authorization granted {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:06:29.683362 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e37711-d0c3-48df-9b44-3532571d5ef3 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:06:29.685133 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e37711-d0c3-48df-9b44-3532571d5ef3 None admin] RBAC: Authorization granted {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:06:29.693615 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application [None req-84c239df-0dae-4e54-80d0-f5cd0563254f None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jul 28 09:06:29.693615 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 09:06:29.693615 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 09:06:29.693615 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 09:06:29.693615 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 09:06:29.693615 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 09:06:29.693615 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 09:06:29.693615 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 09:06:29.693615 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 09:06:29.693615 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 09:06:29.693615 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 09:06:29.693615 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 09:06:29.693615 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 28 09:06:29.693615 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 28 09:06:29.693615 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 28 09:06:29.693615 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 28 09:06:29.694915 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 09:06:29.694915 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 09:06:29.694915 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 28 09:06:29.694915 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 09:06:29.694915 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 28 09:06:29.694915 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 09:06:29.694915 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 09:06:29.694915 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 09:06:29.694915 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 09:06:29.694915 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 09:06:29.694915 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 09:06:29.694915 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application with Lock( Jul 28 09:06:29.694915 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 09:06:29.694915 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return self._enter() Jul 28 09:06:29.694915 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 09:06:29.694915 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 09:06:29.694915 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 09:06:29.694915 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return self.creator() Jul 28 09:06:29.696195 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 09:06:29.696195 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application created_value = creator( Jul 28 09:06:29.696195 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 28 09:06:29.696195 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 28 09:06:29.696195 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 28 09:06:29.696195 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 28 09:06:29.696195 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 28 09:06:29.696195 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 28 09:06:29.696195 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jul 28 09:06:29.696195 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application Jul 28 09:06:29.702959 dv-cinder-851351-1-smb devstack@keystone.service[416294]: [pid: 416294|app: 0|req: 303/591] 10.222.0.42 () {56 vars in 1099 bytes} [Thu Jul 28 09:06:29 2022] GET /identity/v3/users/glance => generated 84 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 09:06:29.702959 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c239df-0dae-4e54-80d0-f5cd0563254f None admin] Authenticating user token {{(pid=416294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:06:29.708482 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application [None req-e2e37711-d0c3-48df-9b44-3532571d5ef3 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jul 28 09:06:29.708482 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 09:06:29.708482 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 09:06:29.708482 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 09:06:29.708482 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 09:06:29.708482 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 09:06:29.708482 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 09:06:29.708482 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 09:06:29.708482 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 09:06:29.708482 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 09:06:29.708482 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 09:06:29.708482 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 09:06:29.708482 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 28 09:06:29.708482 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 28 09:06:29.708482 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 28 09:06:29.708482 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 28 09:06:29.709795 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 09:06:29.709795 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 09:06:29.709795 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 28 09:06:29.709795 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 09:06:29.709795 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 28 09:06:29.709795 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 09:06:29.709795 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 09:06:29.709795 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 09:06:29.709795 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 09:06:29.709795 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 09:06:29.709795 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 09:06:29.709795 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application with Lock( Jul 28 09:06:29.709795 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 09:06:29.709795 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self._enter() Jul 28 09:06:29.709795 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 09:06:29.709795 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 09:06:29.709795 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 09:06:29.709795 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self.creator() Jul 28 09:06:29.711059 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 09:06:29.711059 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application created_value = creator( Jul 28 09:06:29.711059 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 28 09:06:29.711059 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 28 09:06:29.711059 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 28 09:06:29.711059 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 28 09:06:29.711059 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 28 09:06:29.711059 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 28 09:06:29.711059 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jul 28 09:06:29.711059 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application Jul 28 09:06:29.718646 dv-cinder-851351-1-smb devstack@keystone.service[416293]: [pid: 416293|app: 0|req: 289/592] 10.222.0.42 () {56 vars in 1102 bytes} [Thu Jul 28 09:06:29 2022] GET /identity/v3/users/neutron => generated 85 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 09:06:29.718646 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e37711-d0c3-48df-9b44-3532571d5ef3 None admin] Authenticating user token {{(pid=416293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:06:29.837275 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c239df-0dae-4e54-80d0-f5cd0563254f None admin] Validating token access rules against request {{(pid=416294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:06:29.837955 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG dbcounter [-] [416293] Writing DB stats keystone:SELECT=100 {{(pid=416293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:06:29.842773 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e37711-d0c3-48df-9b44-3532571d5ef3 None admin] Validating token access rules against request {{(pid=416293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:06:29.861409 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG dbcounter [-] [416294] Writing DB stats keystone:SELECT=100 {{(pid=416294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:06:29.885712 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c242fa1-b916-426b-bafc-c8cfe1406245 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:06:29.886331 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c242fa1-b916-426b-bafc-c8cfe1406245 None admin] REQUEST_METHOD: `GET` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:06:29.886705 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c242fa1-b916-426b-bafc-c8cfe1406245 None admin] SCRIPT_NAME: `/identity` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:06:29.887117 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c242fa1-b916-426b-bafc-c8cfe1406245 None admin] PATH_INFO: `/v3/users` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:06:29.888001 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c242fa1-b916-426b-bafc-c8cfe1406245 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=416293) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 09:06:29.888406 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c242fa1-b916-426b-bafc-c8cfe1406245 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:06:29.890003 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c242fa1-b916-426b-bafc-c8cfe1406245 None admin] RBAC: Authorization granted {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:06:29.891648 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f82fd27-3022-435c-82d8-93ad3b408648 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:06:29.892852 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f82fd27-3022-435c-82d8-93ad3b408648 None admin] REQUEST_METHOD: `GET` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:06:29.894221 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f82fd27-3022-435c-82d8-93ad3b408648 None admin] SCRIPT_NAME: `/identity` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:06:29.894678 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f82fd27-3022-435c-82d8-93ad3b408648 None admin] PATH_INFO: `/v3/projects/service` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:06:29.903965 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f82fd27-3022-435c-82d8-93ad3b408648 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:06:29.905737 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f82fd27-3022-435c-82d8-93ad3b408648 None admin] RBAC: Authorization granted {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:06:29.914563 dv-cinder-851351-1-smb devstack@keystone.service[416293]: [pid: 416293|app: 0|req: 290/593] 10.222.0.42 () {56 vars in 1137 bytes} [Thu Jul 28 09:06:29 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:06:29.914563 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c242fa1-b916-426b-bafc-c8cfe1406245 None admin] Authenticating user token {{(pid=416293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:06:29.928453 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application [None req-9f82fd27-3022-435c-82d8-93ad3b408648 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 09:06:29.928453 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 09:06:29.928453 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 09:06:29.928453 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 09:06:29.928453 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 09:06:29.928453 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 09:06:29.928453 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 09:06:29.928453 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 09:06:29.928453 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 09:06:29.928453 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 09:06:29.928453 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 09:06:29.928453 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 09:06:29.928453 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 28 09:06:29.928453 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 28 09:06:29.928453 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 28 09:06:29.929672 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 28 09:06:29.929672 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 09:06:29.929672 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 09:06:29.929672 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 09:06:29.929672 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 09:06:29.929672 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 09:06:29.929672 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 09:06:29.929672 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 09:06:29.929672 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application with Lock( Jul 28 09:06:29.929672 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 09:06:29.929672 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return self._enter() Jul 28 09:06:29.929672 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 09:06:29.929672 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 09:06:29.929672 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 09:06:29.929672 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return self.creator() Jul 28 09:06:29.929672 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 09:06:29.929672 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application created_value = creator( Jul 28 09:06:29.930849 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 28 09:06:29.930849 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 28 09:06:29.930849 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 28 09:06:29.930849 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 28 09:06:29.930849 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 28 09:06:29.930849 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 28 09:06:29.930849 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 09:06:29.930849 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application Jul 28 09:06:29.933141 dv-cinder-851351-1-smb devstack@keystone.service[416294]: [pid: 416294|app: 0|req: 304/594] 10.222.0.42 () {56 vars in 1111 bytes} [Thu Jul 28 09:06:29 2022] GET /identity/v3/projects/service => generated 88 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 09:06:29.934244 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f82fd27-3022-435c-82d8-93ad3b408648 None admin] Authenticating user token {{(pid=416294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:06:30.025317 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c242fa1-b916-426b-bafc-c8cfe1406245 None admin] Validating token access rules against request {{(pid=416293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:06:30.067025 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f72892f-a565-4326-84ee-ac535e40e380 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:06:30.068201 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f72892f-a565-4326-84ee-ac535e40e380 None admin] REQUEST_METHOD: `GET` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:06:30.068584 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f72892f-a565-4326-84ee-ac535e40e380 None admin] SCRIPT_NAME: `/identity` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:06:30.069025 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f72892f-a565-4326-84ee-ac535e40e380 None admin] PATH_INFO: `/v3/users` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:06:30.070350 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f72892f-a565-4326-84ee-ac535e40e380 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=416293) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 09:06:30.071037 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f72892f-a565-4326-84ee-ac535e40e380 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:06:30.072957 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f82fd27-3022-435c-82d8-93ad3b408648 None admin] Validating token access rules against request {{(pid=416294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:06:30.074044 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f72892f-a565-4326-84ee-ac535e40e380 None admin] RBAC: Authorization granted {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:06:30.102796 dv-cinder-851351-1-smb devstack@keystone.service[416293]: [pid: 416293|app: 0|req: 291/595] 10.222.0.42 () {56 vars in 1139 bytes} [Thu Jul 28 09:06:29 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:06:30.103864 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f72892f-a565-4326-84ee-ac535e40e380 None admin] Authenticating user token {{(pid=416293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:06:30.116705 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da44730-185d-45d7-8810-7508b8cd2fdd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:06:30.117831 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da44730-185d-45d7-8810-7508b8cd2fdd None admin] REQUEST_METHOD: `GET` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:06:30.118152 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da44730-185d-45d7-8810-7508b8cd2fdd None admin] SCRIPT_NAME: `/identity` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:06:30.118445 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da44730-185d-45d7-8810-7508b8cd2fdd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:06:30.129183 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG dbcounter [-] [416293] Writing DB stats keystone:SELECT=100 {{(pid=416293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:06:30.134498 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4da44730-185d-45d7-8810-7508b8cd2fdd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:06:30.137251 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4da44730-185d-45d7-8810-7508b8cd2fdd None admin] RBAC: Authorization granted {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:06:30.159498 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application [None req-4da44730-185d-45d7-8810-7508b8cd2fdd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 09:06:30.159498 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 09:06:30.159498 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 09:06:30.159498 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 09:06:30.159498 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 09:06:30.159498 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 09:06:30.159498 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 09:06:30.159498 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 09:06:30.159498 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 09:06:30.159498 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 09:06:30.159498 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 09:06:30.159498 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 09:06:30.159498 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 09:06:30.159498 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 09:06:30.159498 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 09:06:30.160629 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 09:06:30.160629 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 09:06:30.160629 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 09:06:30.160629 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 09:06:30.160629 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 09:06:30.160629 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 09:06:30.160629 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 09:06:30.160629 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 09:06:30.160629 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application with Lock( Jul 28 09:06:30.160629 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 09:06:30.160629 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return self._enter() Jul 28 09:06:30.160629 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 09:06:30.160629 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 09:06:30.160629 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 09:06:30.160629 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return self.creator() Jul 28 09:06:30.160629 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 09:06:30.160629 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application created_value = creator( Jul 28 09:06:30.161723 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 09:06:30.161723 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 09:06:30.161723 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 09:06:30.161723 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application Jul 28 09:06:30.161723 dv-cinder-851351-1-smb devstack@keystone.service[416294]: [pid: 416294|app: 0|req: 305/596] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 09:06:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 09:06:30.162060 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da44730-185d-45d7-8810-7508b8cd2fdd None admin] Authenticating user token {{(pid=416294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:06:30.197347 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG dbcounter [-] [416294] Writing DB stats keystone:SELECT=100 {{(pid=416294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:06:30.234197 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f72892f-a565-4326-84ee-ac535e40e380 None admin] Validating token access rules against request {{(pid=416293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:06:30.283530 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b0dd376-53ad-4ec7-b827-0623a565c22a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:06:30.284181 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0dd376-53ad-4ec7-b827-0623a565c22a None admin] REQUEST_METHOD: `GET` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:06:30.284462 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0dd376-53ad-4ec7-b827-0623a565c22a None admin] SCRIPT_NAME: `/identity` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:06:30.284855 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0dd376-53ad-4ec7-b827-0623a565c22a None admin] PATH_INFO: `/v3/projects` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:06:30.286095 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b0dd376-53ad-4ec7-b827-0623a565c22a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=416293) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 09:06:30.286410 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b0dd376-53ad-4ec7-b827-0623a565c22a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:06:30.288181 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b0dd376-53ad-4ec7-b827-0623a565c22a None admin] RBAC: Authorization granted {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:06:30.291633 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da44730-185d-45d7-8810-7508b8cd2fdd None admin] Validating token access rules against request {{(pid=416294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:06:30.304175 dv-cinder-851351-1-smb devstack@keystone.service[416293]: [pid: 416293|app: 0|req: 292/597] 10.222.0.42 () {56 vars in 1148 bytes} [Thu Jul 28 09:06:30 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:06:30.305143 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b0dd376-53ad-4ec7-b827-0623a565c22a None admin] Authenticating user token {{(pid=416293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:06:30.357944 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d75450-99df-42c7-8fd3-d23167eae226 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:06:30.359529 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d75450-99df-42c7-8fd3-d23167eae226 None admin] REQUEST_METHOD: `GET` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:06:30.360331 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d75450-99df-42c7-8fd3-d23167eae226 None admin] SCRIPT_NAME: `/identity` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:06:30.361429 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d75450-99df-42c7-8fd3-d23167eae226 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:06:30.381346 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76d75450-99df-42c7-8fd3-d23167eae226 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:06:30.383267 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76d75450-99df-42c7-8fd3-d23167eae226 None admin] RBAC: Authorization granted {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:06:30.398252 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG dbcounter [-] [416293] Writing DB stats keystone:SELECT=100 {{(pid=416293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:06:30.405304 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application [None req-76d75450-99df-42c7-8fd3-d23167eae226 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 09:06:30.405304 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 09:06:30.405304 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 09:06:30.405304 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 09:06:30.405304 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 09:06:30.405304 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 09:06:30.405304 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 09:06:30.405304 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 09:06:30.405304 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 09:06:30.405304 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 09:06:30.405304 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 09:06:30.405304 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 09:06:30.405304 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 09:06:30.405304 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 09:06:30.405304 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 09:06:30.407126 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 09:06:30.407126 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 09:06:30.407126 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 09:06:30.407126 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 09:06:30.407126 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 09:06:30.407126 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 09:06:30.407126 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 09:06:30.407126 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 09:06:30.407126 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application with Lock( Jul 28 09:06:30.407126 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 09:06:30.407126 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return self._enter() Jul 28 09:06:30.407126 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 09:06:30.407126 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 09:06:30.407126 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 09:06:30.407126 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return self.creator() Jul 28 09:06:30.407126 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 09:06:30.407126 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application created_value = creator( Jul 28 09:06:30.409649 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 09:06:30.409649 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 09:06:30.409649 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 09:06:30.409649 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application Jul 28 09:06:30.412272 dv-cinder-851351-1-smb devstack@keystone.service[416294]: [pid: 416294|app: 0|req: 306/598] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 09:06:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 250 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 09:06:30.413545 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d75450-99df-42c7-8fd3-d23167eae226 None admin] Authenticating user token {{(pid=416294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:06:30.438946 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b0dd376-53ad-4ec7-b827-0623a565c22a None admin] Validating token access rules against request {{(pid=416293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:06:30.492121 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85fec435-061c-4e0c-9ad1-6b5a22683eb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:06:30.492886 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85fec435-061c-4e0c-9ad1-6b5a22683eb0 None admin] REQUEST_METHOD: `GET` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:06:30.493276 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85fec435-061c-4e0c-9ad1-6b5a22683eb0 None admin] SCRIPT_NAME: `/identity` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:06:30.493658 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85fec435-061c-4e0c-9ad1-6b5a22683eb0 None admin] PATH_INFO: `/v3/domains` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:06:30.494493 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85fec435-061c-4e0c-9ad1-6b5a22683eb0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=416293) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 09:06:30.494908 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85fec435-061c-4e0c-9ad1-6b5a22683eb0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:06:30.496416 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85fec435-061c-4e0c-9ad1-6b5a22683eb0 None admin] RBAC: Authorization granted {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:06:30.513200 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG dbcounter [-] [416294] Writing DB stats keystone:SELECT=100 {{(pid=416294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:06:30.514610 dv-cinder-851351-1-smb devstack@keystone.service[416293]: [pid: 416293|app: 0|req: 293/599] 10.222.0.42 () {56 vars in 1109 bytes} [Thu Jul 28 09:06:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:06:30.515636 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85fec435-061c-4e0c-9ad1-6b5a22683eb0 None admin] Authenticating user token {{(pid=416293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:06:30.543429 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d75450-99df-42c7-8fd3-d23167eae226 None admin] Validating token access rules against request {{(pid=416294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:06:30.592415 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c90de956-27be-4d48-bd66-2956edadae73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:06:30.593690 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90de956-27be-4d48-bd66-2956edadae73 None admin] REQUEST_METHOD: `PUT` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:06:30.594141 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90de956-27be-4d48-bd66-2956edadae73 None admin] SCRIPT_NAME: `/identity` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:06:30.594576 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90de956-27be-4d48-bd66-2956edadae73 None admin] PATH_INFO: `/v3/projects/6c4349445f224184b093d9dfd0dfc642/users/12179aeb7c45432992616973fc5bdf77/roles/13417fbdbc5145a69bc01ff0f931fd96` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:06:30.617896 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c90de956-27be-4d48-bd66-2956edadae73 None admin] RBAC: Authorizing `identity:create_grant(project_id=6c4349445f224184b093d9dfd0dfc642, user_id=12179aeb7c45432992616973fc5bdf77, role_id=13417fbdbc5145a69bc01ff0f931fd96)` {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:06:30.619721 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c90de956-27be-4d48-bd66-2956edadae73 None admin] RBAC: Authorization granted {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:06:30.639465 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85fec435-061c-4e0c-9ad1-6b5a22683eb0 None admin] Validating token access rules against request {{(pid=416293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:06:30.648806 dv-cinder-851351-1-smb devstack@keystone.service[416294]: [pid: 416294|app: 0|req: 307/600] 10.222.0.42 () {58 vars in 1439 bytes} [Thu Jul 28 09:06:30 2022] PUT /identity/v3/projects/6c4349445f224184b093d9dfd0dfc642/users/12179aeb7c45432992616973fc5bdf77/roles/13417fbdbc5145a69bc01ff0f931fd96 => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 09:06:30.648806 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c90de956-27be-4d48-bd66-2956edadae73 None admin] Authenticating user token {{(pid=416294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:06:30.722163 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-243d88d3-7868-47b5-bdb1-3061da39bda7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:06:30.723227 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243d88d3-7868-47b5-bdb1-3061da39bda7 None admin] REQUEST_METHOD: `GET` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:06:30.727448 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243d88d3-7868-47b5-bdb1-3061da39bda7 None admin] SCRIPT_NAME: `/identity` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:06:30.727901 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243d88d3-7868-47b5-bdb1-3061da39bda7 None admin] PATH_INFO: `/v3/domains` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:06:30.728829 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-243d88d3-7868-47b5-bdb1-3061da39bda7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=416293) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 09:06:30.729259 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-243d88d3-7868-47b5-bdb1-3061da39bda7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:06:30.730932 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-243d88d3-7868-47b5-bdb1-3061da39bda7 None admin] RBAC: Authorization granted {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:06:30.734943 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG dbcounter [-] [416293] Writing DB stats keystone:SELECT=100 {{(pid=416293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:06:30.756774 dv-cinder-851351-1-smb devstack@keystone.service[416293]: [pid: 416293|app: 0|req: 294/601] 10.222.0.42 () {56 vars in 1109 bytes} [Thu Jul 28 09:06:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:06:30.765994 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-243d88d3-7868-47b5-bdb1-3061da39bda7 None admin] Authenticating user token {{(pid=416293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:06:30.829037 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c90de956-27be-4d48-bd66-2956edadae73 None admin] Validating token access rules against request {{(pid=416294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:06:30.862360 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG dbcounter [-] [416294] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=416294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:06:30.873166 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0176b6a2-03d7-4424-80f9-9e3826cb0538 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:06:30.873930 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0176b6a2-03d7-4424-80f9-9e3826cb0538 None admin] REQUEST_METHOD: `GET` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:06:30.874349 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0176b6a2-03d7-4424-80f9-9e3826cb0538 None admin] SCRIPT_NAME: `/identity` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:06:30.874632 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0176b6a2-03d7-4424-80f9-9e3826cb0538 None admin] PATH_INFO: `/v3/projects/service` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:06:30.885283 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0176b6a2-03d7-4424-80f9-9e3826cb0538 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:06:30.888006 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0176b6a2-03d7-4424-80f9-9e3826cb0538 None admin] RBAC: Authorization granted {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:06:30.900459 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application [None req-0176b6a2-03d7-4424-80f9-9e3826cb0538 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 09:06:30.900459 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 09:06:30.900459 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 09:06:30.900459 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 09:06:30.900459 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 09:06:30.900459 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 09:06:30.900459 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 09:06:30.900459 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 09:06:30.900459 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 09:06:30.900459 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 09:06:30.900459 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 09:06:30.900459 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 09:06:30.900459 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 28 09:06:30.900459 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 28 09:06:30.900459 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 28 09:06:30.901675 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 28 09:06:30.901675 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 09:06:30.901675 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 09:06:30.901675 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 09:06:30.901675 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 09:06:30.901675 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 09:06:30.901675 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 09:06:30.901675 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 09:06:30.901675 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application with Lock( Jul 28 09:06:30.901675 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 09:06:30.901675 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return self._enter() Jul 28 09:06:30.901675 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 09:06:30.901675 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 09:06:30.901675 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 09:06:30.901675 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return self.creator() Jul 28 09:06:30.901675 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 09:06:30.901675 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application created_value = creator( Jul 28 09:06:30.902799 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 28 09:06:30.902799 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 28 09:06:30.902799 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 28 09:06:30.902799 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 28 09:06:30.902799 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 28 09:06:30.902799 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 28 09:06:30.902799 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 09:06:30.902799 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application Jul 28 09:06:30.902799 dv-cinder-851351-1-smb devstack@keystone.service[416294]: [pid: 416294|app: 0|req: 308/602] 10.222.0.42 () {56 vars in 1111 bytes} [Thu Jul 28 09:06:30 2022] GET /identity/v3/projects/service => generated 88 bytes in 257 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 09:06:30.903450 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9571b5a4-9dc6-46dd-8b64-218a93ab471c None None] REQUEST_METHOD: `GET` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:06:30.903450 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9571b5a4-9dc6-46dd-8b64-218a93ab471c None None] SCRIPT_NAME: `/identity` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:06:30.903645 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9571b5a4-9dc6-46dd-8b64-218a93ab471c None None] PATH_INFO: `/` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:06:30.908964 dv-cinder-851351-1-smb devstack@keystone.service[416294]: [pid: 416294|app: 0|req: 309/603] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 09:06:30 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 09:06:30.910651 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9571b5a4-9dc6-46dd-8b64-218a93ab471c None None] Authenticating user token {{(pid=416294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:06:30.916631 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-243d88d3-7868-47b5-bdb1-3061da39bda7 None admin] Validating token access rules against request {{(pid=416293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:06:30.966391 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5ee496-3725-4004-a61f-132bc73a5168 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:06:30.967498 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5ee496-3725-4004-a61f-132bc73a5168 None admin] REQUEST_METHOD: `GET` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:06:30.967951 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5ee496-3725-4004-a61f-132bc73a5168 None admin] SCRIPT_NAME: `/identity` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:06:30.968384 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5ee496-3725-4004-a61f-132bc73a5168 None admin] PATH_INFO: `/v3/projects/service` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:06:30.977026 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e5ee496-3725-4004-a61f-132bc73a5168 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:06:30.978772 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e5ee496-3725-4004-a61f-132bc73a5168 None admin] RBAC: Authorization granted {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:06:30.992288 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application [None req-9e5ee496-3725-4004-a61f-132bc73a5168 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 09:06:30.992288 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 09:06:30.992288 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 09:06:30.992288 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 09:06:30.992288 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 09:06:30.992288 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 09:06:30.992288 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 09:06:30.992288 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 09:06:30.992288 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 09:06:30.992288 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 09:06:30.992288 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 09:06:30.992288 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 09:06:30.992288 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 28 09:06:30.992288 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 28 09:06:30.992288 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 28 09:06:30.993575 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 28 09:06:30.993575 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 09:06:30.993575 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 09:06:30.993575 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 09:06:30.993575 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 09:06:30.993575 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 09:06:30.993575 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 09:06:30.993575 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 09:06:30.993575 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application with Lock( Jul 28 09:06:30.993575 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 09:06:30.993575 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self._enter() Jul 28 09:06:30.993575 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 09:06:30.993575 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 09:06:30.993575 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 09:06:30.993575 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self.creator() Jul 28 09:06:30.993575 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 09:06:30.993575 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application created_value = creator( Jul 28 09:06:30.994759 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 28 09:06:30.994759 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 28 09:06:30.994759 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 28 09:06:30.994759 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 28 09:06:30.994759 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 28 09:06:30.994759 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 28 09:06:30.994759 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 09:06:30.994759 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application Jul 28 09:06:30.997222 dv-cinder-851351-1-smb devstack@keystone.service[416293]: [pid: 416293|app: 0|req: 295/604] 10.222.0.42 () {56 vars in 1111 bytes} [Thu Jul 28 09:06:30 2022] GET /identity/v3/projects/service => generated 88 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 09:06:31.003291 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d82c36-2ae0-4021-8d92-26098bca9055 None None] REQUEST_METHOD: `POST` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:06:31.003961 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d82c36-2ae0-4021-8d92-26098bca9055 None None] SCRIPT_NAME: `/identity` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:06:31.004415 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d82c36-2ae0-4021-8d92-26098bca9055 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:06:31.024295 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.auth.core [None req-84d82c36-2ae0-4021-8d92-26098bca9055 None None] MFA Rules not processed for user `dbf87abab90e4fdf9e75408f4199918e`. Rule list: `[]` (Enabled: `True`). {{(pid=416293) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 09:06:31.025890 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.fernet_utils [None req-84d82c36-2ae0-4021-8d92-26098bca9055 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=416293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 09:06:31.049495 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9571b5a4-9dc6-46dd-8b64-218a93ab471c None None] Validating token access rules against request {{(pid=416294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:06:31.090435 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG dbcounter [-] [416293] Writing DB stats keystone:SELECT=100 {{(pid=416293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:06:31.108805 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9544850e-d9a1-4bb9-bc4f-7e1672701ef0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:06:31.110565 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9544850e-d9a1-4bb9-bc4f-7e1672701ef0 None admin] REQUEST_METHOD: `GET` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:06:31.111167 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9544850e-d9a1-4bb9-bc4f-7e1672701ef0 None admin] SCRIPT_NAME: `/identity` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:06:31.111679 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9544850e-d9a1-4bb9-bc4f-7e1672701ef0 None admin] PATH_INFO: `/v3/projects` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:06:31.112722 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9544850e-d9a1-4bb9-bc4f-7e1672701ef0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=416294) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 09:06:31.113280 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9544850e-d9a1-4bb9-bc4f-7e1672701ef0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:06:31.120704 dv-cinder-851351-1-smb devstack@keystone.service[416293]: [pid: 416293|app: 0|req: 296/605] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 09:06:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 09:06:31.120704 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d82c36-2ae0-4021-8d92-26098bca9055 None None] Authenticating user token {{(pid=416293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:06:31.121653 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9544850e-d9a1-4bb9-bc4f-7e1672701ef0 None admin] RBAC: Authorization granted {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:06:31.140914 dv-cinder-851351-1-smb devstack@keystone.service[416294]: [pid: 416294|app: 0|req: 310/606] 10.222.0.42 () {56 vars in 1148 bytes} [Thu Jul 28 09:06:30 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:06:31.147626 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9544850e-d9a1-4bb9-bc4f-7e1672701ef0 None admin] Authenticating user token {{(pid=416294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:06:31.221148 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG dbcounter [-] [416294] Writing DB stats keystone:SELECT=100 {{(pid=416294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:06:31.268777 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d82c36-2ae0-4021-8d92-26098bca9055 None None] Validating token access rules against request {{(pid=416293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:06:31.295897 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9544850e-d9a1-4bb9-bc4f-7e1672701ef0 None admin] Validating token access rules against request {{(pid=416294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:06:31.323271 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3efca6-87bf-430e-9831-32d604bf1ae0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:06:31.324855 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3efca6-87bf-430e-9831-32d604bf1ae0 None admin] REQUEST_METHOD: `GET` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:06:31.325692 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3efca6-87bf-430e-9831-32d604bf1ae0 None admin] SCRIPT_NAME: `/identity` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:06:31.326421 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3efca6-87bf-430e-9831-32d604bf1ae0 None admin] PATH_INFO: `/v3/projects` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:06:31.327631 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c3efca6-87bf-430e-9831-32d604bf1ae0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=416293) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 09:06:31.328506 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c3efca6-87bf-430e-9831-32d604bf1ae0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:06:31.330904 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c3efca6-87bf-430e-9831-32d604bf1ae0 None admin] RBAC: Authorization granted {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:06:31.333255 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75da28b8-7703-4489-a661-c197db60f878 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:06:31.333918 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75da28b8-7703-4489-a661-c197db60f878 None admin] REQUEST_METHOD: `GET` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:06:31.334200 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75da28b8-7703-4489-a661-c197db60f878 None admin] SCRIPT_NAME: `/identity` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:06:31.334478 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75da28b8-7703-4489-a661-c197db60f878 None admin] PATH_INFO: `/v3/roles/service` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:06:31.346254 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75da28b8-7703-4489-a661-c197db60f878 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 09:06:31.347836 dv-cinder-851351-1-smb devstack@keystone.service[416293]: [pid: 416293|app: 0|req: 297/607] 10.222.0.42 () {56 vars in 1148 bytes} [Thu Jul 28 09:06:31 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:06:31.348958 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3efca6-87bf-430e-9831-32d604bf1ae0 None admin] Authenticating user token {{(pid=416293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:06:31.352032 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application [None req-75da28b8-7703-4489-a661-c197db60f878 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 28 09:06:31.352032 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 09:06:31.352032 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 09:06:31.352032 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 09:06:31.352032 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 09:06:31.352032 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 09:06:31.352032 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 09:06:31.352032 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 09:06:31.352032 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 09:06:31.352032 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 09:06:31.352032 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 09:06:31.352032 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 09:06:31.352032 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 09:06:31.352032 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 09:06:31.352032 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 09:06:31.352032 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 09:06:31.353288 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 09:06:31.353288 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 09:06:31.353288 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 09:06:31.353288 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 09:06:31.353288 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 09:06:31.353288 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 09:06:31.353288 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 09:06:31.353288 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 09:06:31.353288 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 09:06:31.353288 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 09:06:31.353288 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 09:06:31.353288 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application with Lock( Jul 28 09:06:31.353288 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 09:06:31.353288 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return self._enter() Jul 28 09:06:31.353288 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 09:06:31.353288 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 09:06:31.354337 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 09:06:31.354337 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return self.creator() Jul 28 09:06:31.354337 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 09:06:31.354337 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application created_value = creator( Jul 28 09:06:31.354337 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 09:06:31.354337 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 09:06:31.354337 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 09:06:31.354337 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 09:06:31.354337 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 09:06:31.354337 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 09:06:31.354337 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 28 09:06:31.354337 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application Jul 28 09:06:31.354337 dv-cinder-851351-1-smb devstack@keystone.service[416294]: [pid: 416294|app: 0|req: 311/608] 10.222.0.42 () {56 vars in 1102 bytes} [Thu Jul 28 09:06:31 2022] GET /identity/v3/roles/service => generated 85 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 09:06:31.355142 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972dfeb2-ad1f-48a6-850a-c18afdad725a None None] REQUEST_METHOD: `GET` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:06:31.355142 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972dfeb2-ad1f-48a6-850a-c18afdad725a None None] SCRIPT_NAME: `/identity` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:06:31.355354 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972dfeb2-ad1f-48a6-850a-c18afdad725a None None] PATH_INFO: `/` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:06:31.357170 dv-cinder-851351-1-smb devstack@keystone.service[416294]: [pid: 416294|app: 0|req: 312/609] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 09:06:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 09:06:31.357553 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972dfeb2-ad1f-48a6-850a-c18afdad725a None None] Authenticating user token {{(pid=416294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:06:31.413108 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG dbcounter [-] [416293] Writing DB stats keystone:SELECT=100 {{(pid=416293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:06:31.473831 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972dfeb2-ad1f-48a6-850a-c18afdad725a None None] Validating token access rules against request {{(pid=416294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:06:31.475580 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3efca6-87bf-430e-9831-32d604bf1ae0 None admin] Validating token access rules against request {{(pid=416293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:06:31.483748 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG dbcounter [-] [416294] Writing DB stats keystone:SELECT=100 {{(pid=416294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:06:31.512062 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12de7baf-f02c-47ea-bb6c-f7c95503951d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:06:31.512804 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12de7baf-f02c-47ea-bb6c-f7c95503951d None admin] REQUEST_METHOD: `PUT` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:06:31.513090 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12de7baf-f02c-47ea-bb6c-f7c95503951d None admin] SCRIPT_NAME: `/identity` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:06:31.513366 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12de7baf-f02c-47ea-bb6c-f7c95503951d None admin] PATH_INFO: `/v3/projects/6c4349445f224184b093d9dfd0dfc642/users/1a6b3c06f2fb4c4c8b9089ca32caf7c5/roles/13417fbdbc5145a69bc01ff0f931fd96` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:06:31.514241 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb10ef9b-fd25-4ace-9dc5-02d2cbee1db9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:06:31.514934 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb10ef9b-fd25-4ace-9dc5-02d2cbee1db9 None admin] REQUEST_METHOD: `PUT` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:06:31.515221 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb10ef9b-fd25-4ace-9dc5-02d2cbee1db9 None admin] SCRIPT_NAME: `/identity` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:06:31.515497 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb10ef9b-fd25-4ace-9dc5-02d2cbee1db9 None admin] PATH_INFO: `/v3/projects/6c4349445f224184b093d9dfd0dfc642/users/4d16bdaefceb45c190e3cfdc2b5b29e1/roles/13417fbdbc5145a69bc01ff0f931fd96` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:06:31.529131 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12de7baf-f02c-47ea-bb6c-f7c95503951d None admin] RBAC: Authorizing `identity:create_grant(project_id=6c4349445f224184b093d9dfd0dfc642, user_id=1a6b3c06f2fb4c4c8b9089ca32caf7c5, role_id=13417fbdbc5145a69bc01ff0f931fd96)` {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:06:31.530606 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12de7baf-f02c-47ea-bb6c-f7c95503951d None admin] RBAC: Authorization granted {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:06:31.532234 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb10ef9b-fd25-4ace-9dc5-02d2cbee1db9 None admin] RBAC: Authorizing `identity:create_grant(project_id=6c4349445f224184b093d9dfd0dfc642, user_id=4d16bdaefceb45c190e3cfdc2b5b29e1, role_id=13417fbdbc5145a69bc01ff0f931fd96)` {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:06:31.534129 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb10ef9b-fd25-4ace-9dc5-02d2cbee1db9 None admin] RBAC: Authorization granted {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:06:31.546346 dv-cinder-851351-1-smb devstack@keystone.service[416294]: [pid: 416294|app: 0|req: 313/610] 10.222.0.42 () {58 vars in 1439 bytes} [Thu Jul 28 09:06:31 2022] PUT /identity/v3/projects/6c4349445f224184b093d9dfd0dfc642/users/1a6b3c06f2fb4c4c8b9089ca32caf7c5/roles/13417fbdbc5145a69bc01ff0f931fd96 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 09:06:31.547537 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12de7baf-f02c-47ea-bb6c-f7c95503951d None admin] Authenticating user token {{(pid=416294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:06:31.551742 dv-cinder-851351-1-smb devstack@keystone.service[416293]: [pid: 416293|app: 0|req: 298/611] 10.222.0.42 () {58 vars in 1439 bytes} [Thu Jul 28 09:06:31 2022] PUT /identity/v3/projects/6c4349445f224184b093d9dfd0dfc642/users/4d16bdaefceb45c190e3cfdc2b5b29e1/roles/13417fbdbc5145a69bc01ff0f931fd96 => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 09:06:31.553541 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900bffb2-9abb-4bd1-b786-29aba687155d None None] REQUEST_METHOD: `POST` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:06:31.554114 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900bffb2-9abb-4bd1-b786-29aba687155d None None] SCRIPT_NAME: `/identity` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:06:31.554656 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900bffb2-9abb-4bd1-b786-29aba687155d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:06:31.576195 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.auth.core [None req-900bffb2-9abb-4bd1-b786-29aba687155d None None] MFA Rules not processed for user `dbf87abab90e4fdf9e75408f4199918e`. Rule list: `[]` (Enabled: `True`). {{(pid=416293) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 09:06:31.578321 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.fernet_utils [None req-900bffb2-9abb-4bd1-b786-29aba687155d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=416293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 09:06:31.663371 dv-cinder-851351-1-smb devstack@keystone.service[416293]: [pid: 416293|app: 0|req: 299/612] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 09:06:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 09:06:31.707355 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900bffb2-9abb-4bd1-b786-29aba687155d None None] Authenticating user token {{(pid=416293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:06:31.777955 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG dbcounter [-] [416293] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=416293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:06:31.792952 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12de7baf-f02c-47ea-bb6c-f7c95503951d None admin] Validating token access rules against request {{(pid=416294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:06:31.836632 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b3d49c-7e83-4529-9745-4b2955b8370e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:06:31.837324 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b3d49c-7e83-4529-9745-4b2955b8370e None admin] REQUEST_METHOD: `GET` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:06:31.837611 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b3d49c-7e83-4529-9745-4b2955b8370e None admin] SCRIPT_NAME: `/identity` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:06:31.837886 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b3d49c-7e83-4529-9745-4b2955b8370e None admin] PATH_INFO: `/v3/roles` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:06:31.838618 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4b3d49c-7e83-4529-9745-4b2955b8370e None admin] RBAC: Adding query filter params (name=service) {{(pid=416294) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 09:06:31.838937 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4b3d49c-7e83-4529-9745-4b2955b8370e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:06:31.840380 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4b3d49c-7e83-4529-9745-4b2955b8370e None admin] RBAC: Authorization granted {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:06:31.849788 dv-cinder-851351-1-smb devstack@keystone.service[416294]: [pid: 416294|app: 0|req: 314/613] 10.222.0.42 () {56 vars in 1103 bytes} [Thu Jul 28 09:06:31 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 302 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:06:31.860435 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b3d49c-7e83-4529-9745-4b2955b8370e None admin] Authenticating user token {{(pid=416294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:06:31.884732 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900bffb2-9abb-4bd1-b786-29aba687155d None None] Validating token access rules against request {{(pid=416293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:06:31.891680 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG dbcounter [-] [416294] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=416294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:06:31.937719 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50e4f29-31cd-4ecc-a7b5-d4f4d07dbd0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:06:31.938563 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50e4f29-31cd-4ecc-a7b5-d4f4d07dbd0f None admin] REQUEST_METHOD: `GET` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:06:31.938853 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50e4f29-31cd-4ecc-a7b5-d4f4d07dbd0f None admin] SCRIPT_NAME: `/identity` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:06:31.939228 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50e4f29-31cd-4ecc-a7b5-d4f4d07dbd0f None admin] PATH_INFO: `/v3/roles/service` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:06:31.952756 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b50e4f29-31cd-4ecc-a7b5-d4f4d07dbd0f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 09:06:31.958384 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application [None req-b50e4f29-31cd-4ecc-a7b5-d4f4d07dbd0f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 28 09:06:31.958384 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 09:06:31.958384 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 09:06:31.958384 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 09:06:31.958384 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 09:06:31.958384 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 09:06:31.958384 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 09:06:31.958384 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 09:06:31.958384 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 09:06:31.958384 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 09:06:31.958384 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 09:06:31.958384 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 09:06:31.958384 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 09:06:31.958384 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 09:06:31.958384 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 09:06:31.958384 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 09:06:31.959472 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 09:06:31.959472 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 09:06:31.959472 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 09:06:31.959472 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 09:06:31.959472 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 09:06:31.959472 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 09:06:31.959472 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 09:06:31.959472 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 09:06:31.959472 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 09:06:31.959472 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 09:06:31.959472 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 09:06:31.959472 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application with Lock( Jul 28 09:06:31.959472 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 09:06:31.959472 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self._enter() Jul 28 09:06:31.959472 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 09:06:31.959472 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 09:06:31.960369 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 09:06:31.960369 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self.creator() Jul 28 09:06:31.960369 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 09:06:31.960369 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application created_value = creator( Jul 28 09:06:31.960369 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 09:06:31.960369 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 09:06:31.960369 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 09:06:31.960369 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 09:06:31.960369 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 09:06:31.960369 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 09:06:31.960369 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 28 09:06:31.960369 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application Jul 28 09:06:31.960369 dv-cinder-851351-1-smb devstack@keystone.service[416293]: [pid: 416293|app: 0|req: 300/614] 10.222.0.42 () {56 vars in 1102 bytes} [Thu Jul 28 09:06:31 2022] GET /identity/v3/roles/service => generated 85 bytes in 253 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 09:06:31.974050 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50e4f29-31cd-4ecc-a7b5-d4f4d07dbd0f None admin] Authenticating user token {{(pid=416293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:06:31.993395 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b3d49c-7e83-4529-9745-4b2955b8370e None admin] Validating token access rules against request {{(pid=416294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:06:32.029661 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e86ea7-044a-4567-9312-27339fdea664 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:06:32.030598 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e86ea7-044a-4567-9312-27339fdea664 None admin] REQUEST_METHOD: `GET` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:06:32.030598 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e86ea7-044a-4567-9312-27339fdea664 None admin] SCRIPT_NAME: `/identity` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:06:32.030936 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e86ea7-044a-4567-9312-27339fdea664 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:06:32.043125 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43e86ea7-044a-4567-9312-27339fdea664 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:06:32.044451 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43e86ea7-044a-4567-9312-27339fdea664 None admin] RBAC: Authorization granted {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:06:32.072269 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application [None req-43e86ea7-044a-4567-9312-27339fdea664 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 09:06:32.072269 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 09:06:32.072269 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 09:06:32.072269 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 09:06:32.072269 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 09:06:32.072269 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 09:06:32.072269 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 09:06:32.072269 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 09:06:32.072269 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 09:06:32.072269 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 09:06:32.072269 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 09:06:32.072269 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 09:06:32.072269 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 09:06:32.072269 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 09:06:32.072269 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 09:06:32.073380 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 09:06:32.073380 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 09:06:32.073380 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 09:06:32.073380 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 09:06:32.073380 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 09:06:32.073380 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 09:06:32.073380 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 09:06:32.073380 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 09:06:32.073380 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application with Lock( Jul 28 09:06:32.073380 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 09:06:32.073380 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return self._enter() Jul 28 09:06:32.073380 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 09:06:32.073380 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 09:06:32.073380 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 09:06:32.073380 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return self.creator() Jul 28 09:06:32.073380 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 09:06:32.073380 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application created_value = creator( Jul 28 09:06:32.074708 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 09:06:32.074708 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 09:06:32.074708 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 09:06:32.074708 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application Jul 28 09:06:32.074960 dv-cinder-851351-1-smb devstack@keystone.service[416294]: [pid: 416294|app: 0|req: 315/615] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 09:06:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 09:06:32.083265 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e86ea7-044a-4567-9312-27339fdea664 None admin] Authenticating user token {{(pid=416294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:06:32.173044 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG dbcounter [-] [416293] Writing DB stats keystone:SELECT=100 {{(pid=416293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:06:32.184619 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50e4f29-31cd-4ecc-a7b5-d4f4d07dbd0f None admin] Validating token access rules against request {{(pid=416293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:06:32.247967 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef60d4df-abc9-462c-b9f8-4c633e811361 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:06:32.248682 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef60d4df-abc9-462c-b9f8-4c633e811361 None admin] REQUEST_METHOD: `GET` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:06:32.248983 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef60d4df-abc9-462c-b9f8-4c633e811361 None admin] SCRIPT_NAME: `/identity` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:06:32.249258 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef60d4df-abc9-462c-b9f8-4c633e811361 None admin] PATH_INFO: `/v3/roles` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:06:32.250006 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef60d4df-abc9-462c-b9f8-4c633e811361 None admin] RBAC: Adding query filter params (name=service) {{(pid=416293) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 09:06:32.250311 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef60d4df-abc9-462c-b9f8-4c633e811361 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:06:32.251789 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef60d4df-abc9-462c-b9f8-4c633e811361 None admin] RBAC: Authorization granted {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:06:32.253966 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG dbcounter [-] [416294] Writing DB stats keystone:SELECT=100 {{(pid=416294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:06:32.272457 dv-cinder-851351-1-smb devstack@keystone.service[416293]: [pid: 416293|app: 0|req: 301/616] 10.222.0.42 () {56 vars in 1103 bytes} [Thu Jul 28 09:06:31 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 299 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 09:06:32.289642 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef60d4df-abc9-462c-b9f8-4c633e811361 None admin] Authenticating user token {{(pid=416293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:06:32.314288 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e86ea7-044a-4567-9312-27339fdea664 None admin] Validating token access rules against request {{(pid=416294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:06:32.395763 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d88deac-24b7-4a60-b2e2-a94bbcb6aff3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:06:32.396467 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d88deac-24b7-4a60-b2e2-a94bbcb6aff3 None admin] REQUEST_METHOD: `GET` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:06:32.396778 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d88deac-24b7-4a60-b2e2-a94bbcb6aff3 None admin] SCRIPT_NAME: `/identity` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:06:32.397048 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d88deac-24b7-4a60-b2e2-a94bbcb6aff3 None admin] PATH_INFO: `/v3/domains` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:06:32.397761 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d88deac-24b7-4a60-b2e2-a94bbcb6aff3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=416294) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 09:06:32.398066 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d88deac-24b7-4a60-b2e2-a94bbcb6aff3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:06:32.399473 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d88deac-24b7-4a60-b2e2-a94bbcb6aff3 None admin] RBAC: Authorization granted {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:06:32.435072 dv-cinder-851351-1-smb devstack@keystone.service[416294]: [pid: 416294|app: 0|req: 316/617] 10.222.0.42 () {56 vars in 1109 bytes} [Thu Jul 28 09:06:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 352 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:06:32.445762 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d88deac-24b7-4a60-b2e2-a94bbcb6aff3 None admin] Authenticating user token {{(pid=416294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:06:32.468471 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef60d4df-abc9-462c-b9f8-4c633e811361 None admin] Validating token access rules against request {{(pid=416293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:06:32.533036 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4acbab6f-26d2-4bfe-bfdf-8c48186f14d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:06:32.533735 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4acbab6f-26d2-4bfe-bfdf-8c48186f14d5 None admin] REQUEST_METHOD: `GET` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:06:32.534024 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4acbab6f-26d2-4bfe-bfdf-8c48186f14d5 None admin] SCRIPT_NAME: `/identity` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:06:32.534305 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4acbab6f-26d2-4bfe-bfdf-8c48186f14d5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:06:32.557937 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4acbab6f-26d2-4bfe-bfdf-8c48186f14d5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:06:32.559448 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4acbab6f-26d2-4bfe-bfdf-8c48186f14d5 None admin] RBAC: Authorization granted {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:06:32.574997 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG dbcounter [-] [416293] Writing DB stats keystone:SELECT=100 {{(pid=416293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:06:32.594107 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application [None req-4acbab6f-26d2-4bfe-bfdf-8c48186f14d5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 09:06:32.594107 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 09:06:32.594107 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 09:06:32.594107 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 09:06:32.594107 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 09:06:32.594107 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 09:06:32.594107 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 09:06:32.594107 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 09:06:32.594107 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 09:06:32.594107 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 09:06:32.594107 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 09:06:32.594107 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 09:06:32.594107 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 09:06:32.594107 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 09:06:32.594107 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 09:06:32.595266 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 09:06:32.595266 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 09:06:32.595266 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 09:06:32.595266 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 09:06:32.595266 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 09:06:32.595266 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 09:06:32.595266 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 09:06:32.595266 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 09:06:32.595266 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application with Lock( Jul 28 09:06:32.595266 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 09:06:32.595266 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self._enter() Jul 28 09:06:32.595266 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 09:06:32.595266 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 09:06:32.595266 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 09:06:32.595266 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self.creator() Jul 28 09:06:32.595266 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 09:06:32.595266 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application created_value = creator( Jul 28 09:06:32.596287 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 09:06:32.596287 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 09:06:32.596287 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 09:06:32.596287 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application Jul 28 09:06:32.600848 dv-cinder-851351-1-smb devstack@keystone.service[416293]: [pid: 416293|app: 0|req: 302/618] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 09:06:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 312 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 09:06:32.604978 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d88deac-24b7-4a60-b2e2-a94bbcb6aff3 None admin] Validating token access rules against request {{(pid=416294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:06:32.606527 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4acbab6f-26d2-4bfe-bfdf-8c48186f14d5 None admin] Authenticating user token {{(pid=416293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:06:32.673058 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG dbcounter [-] [416294] Writing DB stats keystone:SELECT=100 {{(pid=416294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:06:32.684625 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770d9d14-87a3-45e2-87b4-9bd5fb487aa7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:06:32.685390 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770d9d14-87a3-45e2-87b4-9bd5fb487aa7 None admin] REQUEST_METHOD: `GET` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:06:32.685615 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770d9d14-87a3-45e2-87b4-9bd5fb487aa7 None admin] SCRIPT_NAME: `/identity` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:06:32.685891 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770d9d14-87a3-45e2-87b4-9bd5fb487aa7 None admin] PATH_INFO: `/v3/users/nova` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:06:32.698783 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-770d9d14-87a3-45e2-87b4-9bd5fb487aa7 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:06:32.700287 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-770d9d14-87a3-45e2-87b4-9bd5fb487aa7 None admin] RBAC: Authorization granted {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:06:32.725259 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application [None req-770d9d14-87a3-45e2-87b4-9bd5fb487aa7 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 28 09:06:32.725259 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 09:06:32.725259 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 09:06:32.725259 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 09:06:32.725259 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 09:06:32.725259 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 09:06:32.725259 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 09:06:32.725259 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 09:06:32.725259 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 09:06:32.725259 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 09:06:32.725259 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 09:06:32.725259 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 09:06:32.725259 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 28 09:06:32.725259 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 28 09:06:32.725259 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 28 09:06:32.725259 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 28 09:06:32.726410 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 09:06:32.726410 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 09:06:32.726410 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 28 09:06:32.726410 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 09:06:32.726410 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 28 09:06:32.726410 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 09:06:32.726410 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 09:06:32.726410 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 09:06:32.726410 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 09:06:32.726410 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 09:06:32.726410 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 09:06:32.726410 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application with Lock( Jul 28 09:06:32.726410 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 09:06:32.726410 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return self._enter() Jul 28 09:06:32.726410 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 09:06:32.726410 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 09:06:32.726410 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 09:06:32.726410 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return self.creator() Jul 28 09:06:32.727446 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 09:06:32.727446 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application created_value = creator( Jul 28 09:06:32.727446 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 28 09:06:32.727446 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 28 09:06:32.727446 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 28 09:06:32.727446 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 28 09:06:32.727446 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 28 09:06:32.727446 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 28 09:06:32.727446 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 28 09:06:32.727446 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application Jul 28 09:06:32.739199 dv-cinder-851351-1-smb devstack@keystone.service[416294]: [pid: 416294|app: 0|req: 317/619] 10.222.0.42 () {56 vars in 1093 bytes} [Thu Jul 28 09:06:32 2022] GET /identity/v3/users/nova => generated 82 bytes in 293 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 09:06:32.740158 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770d9d14-87a3-45e2-87b4-9bd5fb487aa7 None admin] Authenticating user token {{(pid=416294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:06:32.815520 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4acbab6f-26d2-4bfe-bfdf-8c48186f14d5 None admin] Validating token access rules against request {{(pid=416293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:06:32.888428 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a3fb87-e9d5-4aa7-a745-7a824d90bbd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:06:32.889144 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a3fb87-e9d5-4aa7-a745-7a824d90bbd0 None admin] REQUEST_METHOD: `GET` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:06:32.889434 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a3fb87-e9d5-4aa7-a745-7a824d90bbd0 None admin] SCRIPT_NAME: `/identity` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:06:32.889724 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a3fb87-e9d5-4aa7-a745-7a824d90bbd0 None admin] PATH_INFO: `/v3/domains` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:06:32.896720 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74a3fb87-e9d5-4aa7-a745-7a824d90bbd0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=416293) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 09:06:32.896720 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74a3fb87-e9d5-4aa7-a745-7a824d90bbd0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:06:32.896720 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74a3fb87-e9d5-4aa7-a745-7a824d90bbd0 None admin] RBAC: Authorization granted {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:06:32.908739 dv-cinder-851351-1-smb devstack@keystone.service[416293]: [pid: 416293|app: 0|req: 303/620] 10.222.0.42 () {56 vars in 1109 bytes} [Thu Jul 28 09:06:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 300 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 09:06:32.912371 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a3fb87-e9d5-4aa7-a745-7a824d90bbd0 None admin] Authenticating user token {{(pid=416293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:06:32.923678 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770d9d14-87a3-45e2-87b4-9bd5fb487aa7 None admin] Validating token access rules against request {{(pid=416294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:06:32.988487 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85dfbbc0-242e-4165-89cd-0c7e15c76456 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:06:32.989474 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85dfbbc0-242e-4165-89cd-0c7e15c76456 None admin] REQUEST_METHOD: `GET` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:06:32.989761 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85dfbbc0-242e-4165-89cd-0c7e15c76456 None admin] SCRIPT_NAME: `/identity` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:06:32.990043 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85dfbbc0-242e-4165-89cd-0c7e15c76456 None admin] PATH_INFO: `/v3/users` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:06:32.991041 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85dfbbc0-242e-4165-89cd-0c7e15c76456 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=416294) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 09:06:32.991390 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85dfbbc0-242e-4165-89cd-0c7e15c76456 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:06:32.993537 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85dfbbc0-242e-4165-89cd-0c7e15c76456 None admin] RBAC: Authorization granted {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:06:33.006620 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG dbcounter [-] [416293] Writing DB stats keystone:SELECT=100 {{(pid=416293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:06:33.021783 dv-cinder-851351-1-smb devstack@keystone.service[416294]: [pid: 416294|app: 0|req: 318/621] 10.222.0.42 () {56 vars in 1133 bytes} [Thu Jul 28 09:06:32 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 282 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:06:33.023527 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3dd1bcb-71d8-401c-b901-5d68b14d7e8b None None] REQUEST_METHOD: `GET` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:06:33.024054 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3dd1bcb-71d8-401c-b901-5d68b14d7e8b None None] SCRIPT_NAME: `/identity` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:06:33.024548 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3dd1bcb-71d8-401c-b901-5d68b14d7e8b None None] PATH_INFO: `/` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:06:33.026964 dv-cinder-851351-1-smb devstack@keystone.service[416294]: [pid: 416294|app: 0|req: 319/622] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 09:06:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 09:06:33.028067 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3dd1bcb-71d8-401c-b901-5d68b14d7e8b None None] Authenticating user token {{(pid=416294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:06:33.063481 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a3fb87-e9d5-4aa7-a745-7a824d90bbd0 None admin] Validating token access rules against request {{(pid=416293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:06:33.105533 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff8e64ba-8171-4ecc-956f-68ca33d08260 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:06:33.106646 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8e64ba-8171-4ecc-956f-68ca33d08260 None admin] REQUEST_METHOD: `GET` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:06:33.107307 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8e64ba-8171-4ecc-956f-68ca33d08260 None admin] SCRIPT_NAME: `/identity` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:06:33.107818 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8e64ba-8171-4ecc-956f-68ca33d08260 None admin] PATH_INFO: `/v3/users/swift` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:06:33.109468 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG dbcounter [-] [416294] Writing DB stats keystone:SELECT=100 {{(pid=416294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:06:33.117832 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff8e64ba-8171-4ecc-956f-68ca33d08260 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:06:33.119688 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff8e64ba-8171-4ecc-956f-68ca33d08260 None admin] RBAC: Authorization granted {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:06:33.134616 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application [None req-ff8e64ba-8171-4ecc-956f-68ca33d08260 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 28 09:06:33.134616 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 09:06:33.134616 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 09:06:33.134616 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 09:06:33.134616 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 09:06:33.134616 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 09:06:33.134616 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 09:06:33.134616 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 09:06:33.134616 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 09:06:33.134616 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 09:06:33.134616 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 09:06:33.134616 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 09:06:33.134616 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 28 09:06:33.134616 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 28 09:06:33.134616 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 28 09:06:33.134616 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 28 09:06:33.135697 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 09:06:33.135697 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 09:06:33.135697 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 28 09:06:33.135697 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 09:06:33.135697 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 28 09:06:33.135697 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 09:06:33.135697 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 09:06:33.135697 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 09:06:33.135697 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 09:06:33.135697 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 09:06:33.135697 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 09:06:33.135697 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application with Lock( Jul 28 09:06:33.135697 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 09:06:33.135697 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self._enter() Jul 28 09:06:33.135697 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 09:06:33.135697 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 09:06:33.135697 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 09:06:33.135697 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self.creator() Jul 28 09:06:33.136790 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 09:06:33.136790 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application created_value = creator( Jul 28 09:06:33.136790 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 28 09:06:33.136790 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 28 09:06:33.136790 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 28 09:06:33.136790 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 28 09:06:33.136790 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 28 09:06:33.136790 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 28 09:06:33.136790 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 28 09:06:33.136790 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application Jul 28 09:06:33.139670 dv-cinder-851351-1-smb devstack@keystone.service[416293]: [pid: 416293|app: 0|req: 304/623] 10.222.0.42 () {56 vars in 1096 bytes} [Thu Jul 28 09:06:32 2022] GET /identity/v3/users/swift => generated 83 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 09:06:33.141108 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6d44f4-a258-4b24-9376-0c6afc8db306 None None] REQUEST_METHOD: `POST` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:06:33.141563 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6d44f4-a258-4b24-9376-0c6afc8db306 None None] SCRIPT_NAME: `/identity` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:06:33.141987 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6d44f4-a258-4b24-9376-0c6afc8db306 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:06:33.164228 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.auth.core [None req-ed6d44f4-a258-4b24-9376-0c6afc8db306 None None] MFA Rules not processed for user `dbf87abab90e4fdf9e75408f4199918e`. Rule list: `[]` (Enabled: `True`). {{(pid=416293) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 09:06:33.166069 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.fernet_utils [None req-ed6d44f4-a258-4b24-9376-0c6afc8db306 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=416293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 09:06:33.194038 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3dd1bcb-71d8-401c-b901-5d68b14d7e8b None None] Validating token access rules against request {{(pid=416294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:06:33.244159 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c84d84a3-a601-4f60-887f-d9f9f9e6ca2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:06:33.245546 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84d84a3-a601-4f60-887f-d9f9f9e6ca2c None admin] REQUEST_METHOD: `GET` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:06:33.246226 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84d84a3-a601-4f60-887f-d9f9f9e6ca2c None admin] SCRIPT_NAME: `/identity` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:06:33.246685 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84d84a3-a601-4f60-887f-d9f9f9e6ca2c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:06:33.256992 dv-cinder-851351-1-smb devstack@keystone.service[416293]: [pid: 416293|app: 0|req: 305/624] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 09:06:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 09:06:33.258226 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6d44f4-a258-4b24-9376-0c6afc8db306 None None] Authenticating user token {{(pid=416293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:06:33.331737 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG dbcounter [-] [416293] Writing DB stats keystone:SELECT=100 {{(pid=416293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:06:33.344983 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c84d84a3-a601-4f60-887f-d9f9f9e6ca2c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:06:33.348092 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c84d84a3-a601-4f60-887f-d9f9f9e6ca2c None admin] RBAC: Authorization granted {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:06:33.399636 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6d44f4-a258-4b24-9376-0c6afc8db306 None None] Validating token access rules against request {{(pid=416293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:06:33.440406 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG dbcounter [-] [416294] Writing DB stats keystone:SELECT=100 {{(pid=416294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:06:33.446237 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f4cf53-5e02-46d7-9b6b-fe416324d64d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:06:33.447160 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f4cf53-5e02-46d7-9b6b-fe416324d64d None admin] REQUEST_METHOD: `GET` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:06:33.447644 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f4cf53-5e02-46d7-9b6b-fe416324d64d None admin] SCRIPT_NAME: `/identity` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:06:33.448094 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f4cf53-5e02-46d7-9b6b-fe416324d64d None admin] PATH_INFO: `/v3/users` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:06:33.450173 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f4cf53-5e02-46d7-9b6b-fe416324d64d None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=416293) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 09:06:33.450682 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f4cf53-5e02-46d7-9b6b-fe416324d64d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:06:33.452655 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f4cf53-5e02-46d7-9b6b-fe416324d64d None admin] RBAC: Authorization granted {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:06:33.475506 dv-cinder-851351-1-smb devstack@keystone.service[416293]: [pid: 416293|app: 0|req: 306/625] 10.222.0.42 () {56 vars in 1135 bytes} [Thu Jul 28 09:06:33 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:06:33.476653 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f4cf53-5e02-46d7-9b6b-fe416324d64d None admin] Authenticating user token {{(pid=416293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:06:33.528418 dv-cinder-851351-1-smb devstack@keystone.service[416294]: [pid: 416294|app: 0|req: 320/626] 10.222.0.42 () {58 vars in 1282 bytes} [Thu Jul 28 09:06:33 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 500 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 28 09:06:33.529561 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c84d84a3-a601-4f60-887f-d9f9f9e6ca2c None admin] Authenticating user token {{(pid=416294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:06:33.635292 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f4cf53-5e02-46d7-9b6b-fe416324d64d None admin] Validating token access rules against request {{(pid=416293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:06:33.646602 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG dbcounter [-] [416293] Writing DB stats keystone:SELECT=100 {{(pid=416293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:06:33.681948 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c84d84a3-a601-4f60-887f-d9f9f9e6ca2c None admin] Validating token access rules against request {{(pid=416294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:06:33.683103 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18411bb7-576e-48ce-a231-ceedd2e85b42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:06:33.684239 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18411bb7-576e-48ce-a231-ceedd2e85b42 None admin] REQUEST_METHOD: `GET` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:06:33.684711 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18411bb7-576e-48ce-a231-ceedd2e85b42 None admin] SCRIPT_NAME: `/identity` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:06:33.686082 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18411bb7-576e-48ce-a231-ceedd2e85b42 None admin] PATH_INFO: `/v3/roles/service` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:06:33.700290 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18411bb7-576e-48ce-a231-ceedd2e85b42 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 09:06:33.707180 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application [None req-18411bb7-576e-48ce-a231-ceedd2e85b42 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 28 09:06:33.707180 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 09:06:33.707180 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 09:06:33.707180 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 09:06:33.707180 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 09:06:33.707180 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 09:06:33.707180 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 09:06:33.707180 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 09:06:33.707180 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 09:06:33.707180 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 09:06:33.707180 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 09:06:33.707180 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 09:06:33.707180 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 09:06:33.707180 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 09:06:33.707180 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 09:06:33.707180 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 09:06:33.708398 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 09:06:33.708398 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 09:06:33.708398 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 09:06:33.708398 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 09:06:33.708398 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 09:06:33.708398 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 09:06:33.708398 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 09:06:33.708398 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 09:06:33.708398 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 09:06:33.708398 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 09:06:33.708398 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 09:06:33.708398 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application with Lock( Jul 28 09:06:33.708398 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 09:06:33.708398 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self._enter() Jul 28 09:06:33.708398 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 09:06:33.708398 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 09:06:33.709516 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 09:06:33.709516 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self.creator() Jul 28 09:06:33.709516 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 09:06:33.709516 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application created_value = creator( Jul 28 09:06:33.709516 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 09:06:33.709516 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 09:06:33.709516 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 09:06:33.709516 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 09:06:33.709516 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 09:06:33.709516 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 09:06:33.709516 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 28 09:06:33.709516 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application Jul 28 09:06:33.712799 dv-cinder-851351-1-smb devstack@keystone.service[416293]: [pid: 416293|app: 0|req: 307/627] 10.222.0.42 () {56 vars in 1102 bytes} [Thu Jul 28 09:06:33 2022] GET /identity/v3/roles/service => generated 85 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 09:06:33.714334 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18411bb7-576e-48ce-a231-ceedd2e85b42 None admin] Authenticating user token {{(pid=416293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:06:33.733785 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc01817-6209-4769-a9e5-d03ff53fb506 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:06:33.734487 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc01817-6209-4769-a9e5-d03ff53fb506 None admin] REQUEST_METHOD: `GET` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:06:33.734833 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc01817-6209-4769-a9e5-d03ff53fb506 None admin] SCRIPT_NAME: `/identity` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:06:33.735109 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc01817-6209-4769-a9e5-d03ff53fb506 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:06:33.750804 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fc01817-6209-4769-a9e5-d03ff53fb506 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:06:33.752557 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fc01817-6209-4769-a9e5-d03ff53fb506 None admin] RBAC: Authorization granted {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:06:33.772858 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application [None req-1fc01817-6209-4769-a9e5-d03ff53fb506 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 09:06:33.772858 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 09:06:33.772858 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 09:06:33.772858 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 09:06:33.772858 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 09:06:33.772858 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 09:06:33.772858 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 09:06:33.772858 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 09:06:33.772858 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 09:06:33.772858 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 09:06:33.772858 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 09:06:33.772858 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 09:06:33.772858 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 09:06:33.772858 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 09:06:33.772858 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 09:06:33.774019 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 09:06:33.774019 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 09:06:33.774019 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 09:06:33.774019 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 09:06:33.774019 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 09:06:33.774019 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 09:06:33.774019 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 09:06:33.774019 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 09:06:33.774019 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application with Lock( Jul 28 09:06:33.774019 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 09:06:33.774019 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return self._enter() Jul 28 09:06:33.774019 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 09:06:33.774019 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 09:06:33.774019 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 09:06:33.774019 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return self.creator() Jul 28 09:06:33.774019 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 09:06:33.774019 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application created_value = creator( Jul 28 09:06:33.775006 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 09:06:33.775006 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 09:06:33.775006 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 09:06:33.775006 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application Jul 28 09:06:33.775006 dv-cinder-851351-1-smb devstack@keystone.service[416294]: [pid: 416294|app: 0|req: 321/628] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 09:06:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 245 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 09:06:33.779702 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc01817-6209-4769-a9e5-d03ff53fb506 None admin] Authenticating user token {{(pid=416294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:06:33.782808 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG dbcounter [-] [416294] Writing DB stats keystone:SELECT=100 {{(pid=416294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:06:33.855063 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18411bb7-576e-48ce-a231-ceedd2e85b42 None admin] Validating token access rules against request {{(pid=416293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:06:33.894673 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc01817-6209-4769-a9e5-d03ff53fb506 None admin] Validating token access rules against request {{(pid=416294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:06:33.896478 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb6a21b-5f4d-4e4f-8d8e-20ae5619b699 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:06:33.897179 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb6a21b-5f4d-4e4f-8d8e-20ae5619b699 None admin] REQUEST_METHOD: `GET` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:06:33.897466 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb6a21b-5f4d-4e4f-8d8e-20ae5619b699 None admin] SCRIPT_NAME: `/identity` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:06:33.897742 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb6a21b-5f4d-4e4f-8d8e-20ae5619b699 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:06:33.909122 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffb6a21b-5f4d-4e4f-8d8e-20ae5619b699 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:06:33.910753 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffb6a21b-5f4d-4e4f-8d8e-20ae5619b699 None admin] RBAC: Authorization granted {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:06:33.927051 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application [None req-ffb6a21b-5f4d-4e4f-8d8e-20ae5619b699 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 09:06:33.927051 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 09:06:33.927051 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 09:06:33.927051 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 09:06:33.927051 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 09:06:33.927051 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 09:06:33.927051 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 09:06:33.927051 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 09:06:33.927051 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 09:06:33.927051 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 09:06:33.927051 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 09:06:33.927051 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 09:06:33.927051 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 09:06:33.927051 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 09:06:33.927051 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 09:06:33.928098 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 09:06:33.928098 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 09:06:33.928098 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 09:06:33.928098 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 09:06:33.928098 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 09:06:33.928098 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 09:06:33.928098 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 09:06:33.928098 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 09:06:33.928098 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application with Lock( Jul 28 09:06:33.928098 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 09:06:33.928098 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self._enter() Jul 28 09:06:33.928098 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 09:06:33.928098 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 09:06:33.928098 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 09:06:33.928098 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self.creator() Jul 28 09:06:33.928098 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 09:06:33.928098 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application created_value = creator( Jul 28 09:06:33.929100 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 09:06:33.929100 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 09:06:33.929100 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 09:06:33.929100 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application Jul 28 09:06:33.929100 dv-cinder-851351-1-smb devstack@keystone.service[416293]: [pid: 416293|app: 0|req: 308/629] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 09:06:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 09:06:33.929415 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb6a21b-5f4d-4e4f-8d8e-20ae5619b699 None admin] Authenticating user token {{(pid=416293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:06:33.951212 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb41c3b-58c4-4178-8d74-aa69eb30558a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:06:33.952498 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb41c3b-58c4-4178-8d74-aa69eb30558a None admin] REQUEST_METHOD: `GET` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:06:33.952998 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb41c3b-58c4-4178-8d74-aa69eb30558a None admin] SCRIPT_NAME: `/identity` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:06:33.953285 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb41c3b-58c4-4178-8d74-aa69eb30558a None admin] PATH_INFO: `/v3/roles` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:06:33.954031 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcb41c3b-58c4-4178-8d74-aa69eb30558a None admin] RBAC: Adding query filter params (name=service) {{(pid=416294) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 09:06:33.954341 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcb41c3b-58c4-4178-8d74-aa69eb30558a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:06:33.955971 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcb41c3b-58c4-4178-8d74-aa69eb30558a None admin] RBAC: Authorization granted {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:06:33.959725 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG dbcounter [-] [416293] Writing DB stats keystone:SELECT=100 {{(pid=416293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:06:33.974167 dv-cinder-851351-1-smb devstack@keystone.service[416294]: [pid: 416294|app: 0|req: 322/630] 10.222.0.42 () {56 vars in 1103 bytes} [Thu Jul 28 09:06:33 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:06:33.974167 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332838e2-d03f-4e2b-b4a9-38ad75f55c82 None None] REQUEST_METHOD: `GET` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:06:33.974167 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332838e2-d03f-4e2b-b4a9-38ad75f55c82 None None] SCRIPT_NAME: `/identity` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:06:33.974167 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332838e2-d03f-4e2b-b4a9-38ad75f55c82 None None] PATH_INFO: `/` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:06:33.974167 dv-cinder-851351-1-smb devstack@keystone.service[416294]: [pid: 416294|app: 0|req: 323/631] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 09:06:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 09:06:33.974167 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332838e2-d03f-4e2b-b4a9-38ad75f55c82 None None] Authenticating user token {{(pid=416294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:06:34.042554 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG dbcounter [-] [416294] Writing DB stats keystone:SELECT=100 {{(pid=416294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:06:34.058160 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb6a21b-5f4d-4e4f-8d8e-20ae5619b699 None admin] Validating token access rules against request {{(pid=416293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:06:34.082122 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332838e2-d03f-4e2b-b4a9-38ad75f55c82 None None] Validating token access rules against request {{(pid=416294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:06:34.092644 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7545f59-9e34-4f52-8e80-d56c493bfe38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:06:34.093332 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7545f59-9e34-4f52-8e80-d56c493bfe38 None admin] REQUEST_METHOD: `GET` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:06:34.093635 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7545f59-9e34-4f52-8e80-d56c493bfe38 None admin] SCRIPT_NAME: `/identity` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:06:34.093902 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7545f59-9e34-4f52-8e80-d56c493bfe38 None admin] PATH_INFO: `/v3/domains` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:06:34.094608 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7545f59-9e34-4f52-8e80-d56c493bfe38 None admin] RBAC: Adding query filter params (name=Default) {{(pid=416293) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 09:06:34.094912 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7545f59-9e34-4f52-8e80-d56c493bfe38 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:06:34.096334 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7545f59-9e34-4f52-8e80-d56c493bfe38 None admin] RBAC: Authorization granted {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:06:34.108613 dv-cinder-851351-1-smb devstack@keystone.service[416293]: [pid: 416293|app: 0|req: 309/632] 10.222.0.42 () {56 vars in 1109 bytes} [Thu Jul 28 09:06:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:06:34.109979 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12203da4-6934-43a8-b2be-4960293863af None None] REQUEST_METHOD: `GET` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:06:34.110270 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12203da4-6934-43a8-b2be-4960293863af None None] SCRIPT_NAME: `/identity` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:06:34.110565 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12203da4-6934-43a8-b2be-4960293863af None None] PATH_INFO: `/` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:06:34.112121 dv-cinder-851351-1-smb devstack@keystone.service[416293]: [pid: 416293|app: 0|req: 310/633] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 09:06:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 09:06:34.116705 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12203da4-6934-43a8-b2be-4960293863af None None] Authenticating user token {{(pid=416293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:06:34.116854 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-459c29ef-4945-4432-a182-45db4ae0dff2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:06:34.117314 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459c29ef-4945-4432-a182-45db4ae0dff2 None admin] REQUEST_METHOD: `GET` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:06:34.117596 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459c29ef-4945-4432-a182-45db4ae0dff2 None admin] SCRIPT_NAME: `/identity` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:06:34.117874 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459c29ef-4945-4432-a182-45db4ae0dff2 None admin] PATH_INFO: `/v3/domains` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:06:34.118547 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-459c29ef-4945-4432-a182-45db4ae0dff2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=416294) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 09:06:34.118851 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-459c29ef-4945-4432-a182-45db4ae0dff2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:06:34.120263 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-459c29ef-4945-4432-a182-45db4ae0dff2 None admin] RBAC: Authorization granted {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:06:34.132076 dv-cinder-851351-1-smb devstack@keystone.service[416294]: [pid: 416294|app: 0|req: 324/634] 10.222.0.42 () {56 vars in 1109 bytes} [Thu Jul 28 09:06:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:06:34.133300 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82597fe-c3b8-4a7d-b747-783cc086412b None None] REQUEST_METHOD: `POST` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:06:34.133572 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82597fe-c3b8-4a7d-b747-783cc086412b None None] SCRIPT_NAME: `/identity` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:06:34.133851 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82597fe-c3b8-4a7d-b747-783cc086412b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:06:34.151394 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.auth.core [None req-d82597fe-c3b8-4a7d-b747-783cc086412b None None] MFA Rules not processed for user `dbf87abab90e4fdf9e75408f4199918e`. Rule list: `[]` (Enabled: `True`). {{(pid=416294) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 09:06:34.152600 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.fernet_utils [None req-d82597fe-c3b8-4a7d-b747-783cc086412b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=416294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 09:06:34.195763 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG dbcounter [-] [416293] Writing DB stats keystone:SELECT=100 {{(pid=416293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:06:34.218874 dv-cinder-851351-1-smb devstack@keystone.service[416294]: [pid: 416294|app: 0|req: 325/635] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 09:06:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 09:06:34.219419 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12203da4-6934-43a8-b2be-4960293863af None None] Validating token access rules against request {{(pid=416293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:06:34.219818 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82597fe-c3b8-4a7d-b747-783cc086412b None None] Authenticating user token {{(pid=416294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:06:34.270575 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87222d70-dd05-40f3-8a4b-e0b71074a99c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:06:34.271231 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87222d70-dd05-40f3-8a4b-e0b71074a99c None admin] REQUEST_METHOD: `GET` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:06:34.271517 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87222d70-dd05-40f3-8a4b-e0b71074a99c None admin] SCRIPT_NAME: `/identity` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:06:34.271796 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87222d70-dd05-40f3-8a4b-e0b71074a99c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:06:34.275890 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG dbcounter [-] [416294] Writing DB stats keystone:SELECT=100 {{(pid=416294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:06:34.282657 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87222d70-dd05-40f3-8a4b-e0b71074a99c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:06:34.284145 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87222d70-dd05-40f3-8a4b-e0b71074a99c None admin] RBAC: Authorization granted {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:06:34.306639 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application [None req-87222d70-dd05-40f3-8a4b-e0b71074a99c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 09:06:34.306639 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 09:06:34.306639 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 09:06:34.306639 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 09:06:34.306639 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 09:06:34.306639 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 09:06:34.306639 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 09:06:34.306639 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 09:06:34.306639 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 09:06:34.306639 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 09:06:34.306639 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 09:06:34.306639 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 09:06:34.306639 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 09:06:34.306639 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 09:06:34.306639 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 09:06:34.307718 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 09:06:34.307718 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 09:06:34.307718 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 09:06:34.307718 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 09:06:34.307718 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 09:06:34.307718 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 09:06:34.307718 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 09:06:34.307718 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 09:06:34.307718 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application with Lock( Jul 28 09:06:34.307718 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 09:06:34.307718 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self._enter() Jul 28 09:06:34.307718 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 09:06:34.307718 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 09:06:34.307718 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 09:06:34.307718 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self.creator() Jul 28 09:06:34.307718 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 09:06:34.307718 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application created_value = creator( Jul 28 09:06:34.308707 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 09:06:34.308707 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 09:06:34.308707 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 09:06:34.308707 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application Jul 28 09:06:34.308707 dv-cinder-851351-1-smb devstack@keystone.service[416293]: [pid: 416293|app: 0|req: 311/636] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 09:06:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 09:06:34.309374 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab304ac-4568-4d19-b705-b90749c893a0 None None] REQUEST_METHOD: `POST` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:06:34.309722 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab304ac-4568-4d19-b705-b90749c893a0 None None] SCRIPT_NAME: `/identity` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:06:34.309900 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab304ac-4568-4d19-b705-b90749c893a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:06:34.327005 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82597fe-c3b8-4a7d-b747-783cc086412b None None] Validating token access rules against request {{(pid=416294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:06:34.329203 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.auth.core [None req-dab304ac-4568-4d19-b705-b90749c893a0 None None] MFA Rules not processed for user `dbf87abab90e4fdf9e75408f4199918e`. Rule list: `[]` (Enabled: `True`). {{(pid=416293) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 09:06:34.330982 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.fernet_utils [None req-dab304ac-4568-4d19-b705-b90749c893a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=416293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 09:06:34.365816 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f16ff8c-a512-4e62-9094-18f609b72e4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:06:34.366484 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f16ff8c-a512-4e62-9094-18f609b72e4e None admin] REQUEST_METHOD: `GET` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:06:34.366793 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f16ff8c-a512-4e62-9094-18f609b72e4e None admin] SCRIPT_NAME: `/identity` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:06:34.367067 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f16ff8c-a512-4e62-9094-18f609b72e4e None admin] PATH_INFO: `/v3/projects/service` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:06:34.373921 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f16ff8c-a512-4e62-9094-18f609b72e4e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:06:34.375416 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f16ff8c-a512-4e62-9094-18f609b72e4e None admin] RBAC: Authorization granted {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:06:34.387102 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application [None req-7f16ff8c-a512-4e62-9094-18f609b72e4e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 09:06:34.387102 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 09:06:34.387102 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 09:06:34.387102 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 09:06:34.387102 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 09:06:34.387102 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 09:06:34.387102 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 09:06:34.387102 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 09:06:34.387102 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 09:06:34.387102 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 09:06:34.387102 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 09:06:34.387102 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 09:06:34.387102 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 28 09:06:34.387102 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 28 09:06:34.387102 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 28 09:06:34.388271 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 28 09:06:34.388271 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 09:06:34.388271 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 09:06:34.388271 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 09:06:34.388271 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 09:06:34.388271 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 09:06:34.388271 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 09:06:34.388271 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 09:06:34.388271 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application with Lock( Jul 28 09:06:34.388271 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 09:06:34.388271 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return self._enter() Jul 28 09:06:34.388271 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 09:06:34.388271 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 09:06:34.388271 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 09:06:34.388271 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return self.creator() Jul 28 09:06:34.388271 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 09:06:34.388271 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application created_value = creator( Jul 28 09:06:34.389276 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 28 09:06:34.389276 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 28 09:06:34.389276 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 28 09:06:34.389276 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 28 09:06:34.389276 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 28 09:06:34.389276 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 28 09:06:34.389276 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 09:06:34.389276 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application Jul 28 09:06:34.389276 dv-cinder-851351-1-smb devstack@keystone.service[416294]: [pid: 416294|app: 0|req: 326/637] 10.222.0.42 () {56 vars in 1111 bytes} [Thu Jul 28 09:06:34 2022] GET /identity/v3/projects/service => generated 88 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 09:06:34.389276 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f16ff8c-a512-4e62-9094-18f609b72e4e None admin] Authenticating user token {{(pid=416294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:06:34.403278 dv-cinder-851351-1-smb devstack@keystone.service[416293]: [pid: 416293|app: 0|req: 312/638] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 09:06:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 09:06:34.404362 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab304ac-4568-4d19-b705-b90749c893a0 None None] Authenticating user token {{(pid=416293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:06:34.465201 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG dbcounter [-] [416293] Writing DB stats keystone:SELECT=100 {{(pid=416293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:06:34.502416 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f16ff8c-a512-4e62-9094-18f609b72e4e None admin] Validating token access rules against request {{(pid=416294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:06:34.508867 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab304ac-4568-4d19-b705-b90749c893a0 None None] Validating token access rules against request {{(pid=416293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:06:34.516076 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG dbcounter [-] [416294] Writing DB stats keystone:SELECT=100 {{(pid=416294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:06:34.538527 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6106eebf-063d-4c24-a858-1d51fddc7f42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:06:34.539190 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6106eebf-063d-4c24-a858-1d51fddc7f42 None admin] REQUEST_METHOD: `GET` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:06:34.539460 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6106eebf-063d-4c24-a858-1d51fddc7f42 None admin] SCRIPT_NAME: `/identity` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:06:34.539750 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6106eebf-063d-4c24-a858-1d51fddc7f42 None admin] PATH_INFO: `/v3/projects/service` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:06:34.545061 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d8941d-229e-4459-88ae-fa3b19da16d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:06:34.545720 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d8941d-229e-4459-88ae-fa3b19da16d7 None admin] REQUEST_METHOD: `GET` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:06:34.546007 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d8941d-229e-4459-88ae-fa3b19da16d7 None admin] SCRIPT_NAME: `/identity` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:06:34.546282 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d8941d-229e-4459-88ae-fa3b19da16d7 None admin] PATH_INFO: `/v3/roles/service` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:06:34.546578 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6106eebf-063d-4c24-a858-1d51fddc7f42 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:06:34.548057 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6106eebf-063d-4c24-a858-1d51fddc7f42 None admin] RBAC: Authorization granted {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:06:34.556876 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84d8941d-229e-4459-88ae-fa3b19da16d7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 09:06:34.560146 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application [None req-6106eebf-063d-4c24-a858-1d51fddc7f42 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 09:06:34.560146 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 09:06:34.560146 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 09:06:34.560146 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 09:06:34.560146 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 09:06:34.560146 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 09:06:34.560146 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 09:06:34.560146 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 09:06:34.560146 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 09:06:34.560146 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 09:06:34.560146 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 09:06:34.560146 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 09:06:34.560146 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 28 09:06:34.560146 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 28 09:06:34.560146 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 28 09:06:34.561210 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 28 09:06:34.561210 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 09:06:34.561210 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 09:06:34.561210 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 09:06:34.561210 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 09:06:34.561210 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 09:06:34.561210 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 09:06:34.561210 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 09:06:34.561210 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application with Lock( Jul 28 09:06:34.561210 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 09:06:34.561210 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return self._enter() Jul 28 09:06:34.561210 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 09:06:34.561210 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 09:06:34.561210 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 09:06:34.561210 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return self.creator() Jul 28 09:06:34.561210 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 09:06:34.561210 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application created_value = creator( Jul 28 09:06:34.562289 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 28 09:06:34.562289 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 28 09:06:34.562289 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 28 09:06:34.562289 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 28 09:06:34.562289 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 28 09:06:34.562289 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 28 09:06:34.562289 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 09:06:34.562289 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application Jul 28 09:06:34.562289 dv-cinder-851351-1-smb devstack@keystone.service[416294]: [pid: 416294|app: 0|req: 327/639] 10.222.0.42 () {56 vars in 1111 bytes} [Thu Jul 28 09:06:34 2022] GET /identity/v3/projects/service => generated 88 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 09:06:34.562890 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application [None req-84d8941d-229e-4459-88ae-fa3b19da16d7 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 28 09:06:34.562890 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 09:06:34.562890 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 09:06:34.562890 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 09:06:34.562890 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 09:06:34.562890 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 09:06:34.562890 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 09:06:34.562890 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 09:06:34.562890 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 09:06:34.562890 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 09:06:34.562890 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 09:06:34.562890 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 09:06:34.562890 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 09:06:34.562890 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 09:06:34.562890 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 09:06:34.562890 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 09:06:34.564186 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 09:06:34.564186 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 09:06:34.564186 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 09:06:34.564186 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 09:06:34.564186 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 09:06:34.564186 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 09:06:34.564186 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 09:06:34.564186 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 09:06:34.564186 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 09:06:34.564186 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 09:06:34.564186 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 09:06:34.564186 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application with Lock( Jul 28 09:06:34.564186 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 09:06:34.564186 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self._enter() Jul 28 09:06:34.564186 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 09:06:34.564186 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 09:06:34.565194 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 09:06:34.565194 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self.creator() Jul 28 09:06:34.565194 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 09:06:34.565194 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application created_value = creator( Jul 28 09:06:34.565194 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 09:06:34.565194 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 09:06:34.565194 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 09:06:34.565194 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 09:06:34.565194 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 09:06:34.565194 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 09:06:34.565194 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 28 09:06:34.565194 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application Jul 28 09:06:34.565906 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6106eebf-063d-4c24-a858-1d51fddc7f42 None admin] Authenticating user token {{(pid=416294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:06:34.566091 dv-cinder-851351-1-smb devstack@keystone.service[416293]: [pid: 416293|app: 0|req: 313/640] 10.222.0.42 () {56 vars in 1102 bytes} [Thu Jul 28 09:06:34 2022] GET /identity/v3/roles/service => generated 85 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 09:06:34.566091 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d8941d-229e-4459-88ae-fa3b19da16d7 None admin] Authenticating user token {{(pid=416293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:06:34.673141 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d8941d-229e-4459-88ae-fa3b19da16d7 None admin] Validating token access rules against request {{(pid=416293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:06:34.673709 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6106eebf-063d-4c24-a858-1d51fddc7f42 None admin] Validating token access rules against request {{(pid=416294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:06:34.694040 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG dbcounter [-] [416293] Writing DB stats keystone:SELECT=100 {{(pid=416293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:06:34.709654 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd73030d-a752-4f6d-91a7-9bcb3def5d7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:06:34.710289 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd73030d-a752-4f6d-91a7-9bcb3def5d7e None admin] REQUEST_METHOD: `GET` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:06:34.710572 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd73030d-a752-4f6d-91a7-9bcb3def5d7e None admin] SCRIPT_NAME: `/identity` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:06:34.710676 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93db64fe-b12d-49a0-b84f-7fbdfce51bc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:06:34.710833 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd73030d-a752-4f6d-91a7-9bcb3def5d7e None admin] PATH_INFO: `/v3/domains` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:06:34.711239 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93db64fe-b12d-49a0-b84f-7fbdfce51bc9 None admin] REQUEST_METHOD: `GET` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:06:34.711526 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93db64fe-b12d-49a0-b84f-7fbdfce51bc9 None admin] SCRIPT_NAME: `/identity` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:06:34.711622 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd73030d-a752-4f6d-91a7-9bcb3def5d7e None admin] RBAC: Adding query filter params (name=Default) {{(pid=416294) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 09:06:34.711805 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93db64fe-b12d-49a0-b84f-7fbdfce51bc9 None admin] PATH_INFO: `/v3/projects` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:06:34.711904 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd73030d-a752-4f6d-91a7-9bcb3def5d7e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:06:34.712570 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93db64fe-b12d-49a0-b84f-7fbdfce51bc9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=416293) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 09:06:34.712912 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93db64fe-b12d-49a0-b84f-7fbdfce51bc9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:06:34.713254 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd73030d-a752-4f6d-91a7-9bcb3def5d7e None admin] RBAC: Authorization granted {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:06:34.714351 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93db64fe-b12d-49a0-b84f-7fbdfce51bc9 None admin] RBAC: Authorization granted {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:06:34.725271 dv-cinder-851351-1-smb devstack@keystone.service[416294]: [pid: 416294|app: 0|req: 328/641] 10.222.0.42 () {56 vars in 1109 bytes} [Thu Jul 28 09:06:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:06:34.731162 dv-cinder-851351-1-smb devstack@keystone.service[416293]: [pid: 416293|app: 0|req: 314/642] 10.222.0.42 () {56 vars in 1148 bytes} [Thu Jul 28 09:06:34 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:06:34.731316 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd73030d-a752-4f6d-91a7-9bcb3def5d7e None admin] Authenticating user token {{(pid=416294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:06:34.731429 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93db64fe-b12d-49a0-b84f-7fbdfce51bc9 None admin] Authenticating user token {{(pid=416293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:06:34.766218 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG dbcounter [-] [416294] Writing DB stats keystone:SELECT=100 {{(pid=416294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:06:34.831412 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93db64fe-b12d-49a0-b84f-7fbdfce51bc9 None admin] Validating token access rules against request {{(pid=416293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:06:34.835520 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd73030d-a752-4f6d-91a7-9bcb3def5d7e None admin] Validating token access rules against request {{(pid=416294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:06:34.866676 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494710f5-36ec-4124-b33e-8935f8df1fd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:06:34.867286 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494710f5-36ec-4124-b33e-8935f8df1fd8 None admin] REQUEST_METHOD: `GET` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:06:34.867589 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494710f5-36ec-4124-b33e-8935f8df1fd8 None admin] SCRIPT_NAME: `/identity` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:06:34.867865 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494710f5-36ec-4124-b33e-8935f8df1fd8 None admin] PATH_INFO: `/v3/projects` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:06:34.868711 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-494710f5-36ec-4124-b33e-8935f8df1fd8 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=416293) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 09:06:34.868945 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-494710f5-36ec-4124-b33e-8935f8df1fd8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:06:34.870048 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53de398-fd56-4a56-bc9c-4132d463a1f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:06:34.870435 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-494710f5-36ec-4124-b33e-8935f8df1fd8 None admin] RBAC: Authorization granted {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:06:34.870543 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53de398-fd56-4a56-bc9c-4132d463a1f2 None admin] REQUEST_METHOD: `GET` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:06:34.870783 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53de398-fd56-4a56-bc9c-4132d463a1f2 None admin] SCRIPT_NAME: `/identity` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:06:34.871079 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53de398-fd56-4a56-bc9c-4132d463a1f2 None admin] PATH_INFO: `/v3/roles/service` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:06:34.883091 dv-cinder-851351-1-smb devstack@keystone.service[416293]: [pid: 416293|app: 0|req: 315/643] 10.222.0.42 () {56 vars in 1148 bytes} [Thu Jul 28 09:06:34 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:06:34.883421 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f53de398-fd56-4a56-bc9c-4132d463a1f2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 09:06:34.883924 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494710f5-36ec-4124-b33e-8935f8df1fd8 None admin] Authenticating user token {{(pid=416293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:06:34.888898 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application [None req-f53de398-fd56-4a56-bc9c-4132d463a1f2 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 28 09:06:34.888898 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 09:06:34.888898 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 09:06:34.888898 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 09:06:34.888898 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 09:06:34.888898 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 09:06:34.888898 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 09:06:34.888898 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 09:06:34.888898 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 09:06:34.888898 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 09:06:34.888898 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 09:06:34.888898 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 09:06:34.888898 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 09:06:34.888898 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 09:06:34.888898 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 09:06:34.888898 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 09:06:34.890103 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 09:06:34.890103 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 09:06:34.890103 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 09:06:34.890103 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 09:06:34.890103 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 09:06:34.890103 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 09:06:34.890103 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 09:06:34.890103 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 09:06:34.890103 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 09:06:34.890103 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 09:06:34.890103 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 09:06:34.890103 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application with Lock( Jul 28 09:06:34.890103 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 09:06:34.890103 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return self._enter() Jul 28 09:06:34.890103 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 09:06:34.890103 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 09:06:34.891240 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 09:06:34.891240 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return self.creator() Jul 28 09:06:34.891240 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 09:06:34.891240 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application created_value = creator( Jul 28 09:06:34.891240 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 09:06:34.891240 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 09:06:34.891240 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 09:06:34.891240 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 09:06:34.891240 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 09:06:34.891240 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 09:06:34.891240 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 28 09:06:34.891240 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application Jul 28 09:06:34.891240 dv-cinder-851351-1-smb devstack@keystone.service[416294]: [pid: 416294|app: 0|req: 329/644] 10.222.0.42 () {56 vars in 1102 bytes} [Thu Jul 28 09:06:34 2022] GET /identity/v3/roles/service => generated 85 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 09:06:34.891240 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53de398-fd56-4a56-bc9c-4132d463a1f2 None admin] Authenticating user token {{(pid=416294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:06:34.929260 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG dbcounter [-] [416293] Writing DB stats keystone:SELECT=100 {{(pid=416293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:06:34.991514 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494710f5-36ec-4124-b33e-8935f8df1fd8 None admin] Validating token access rules against request {{(pid=416293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:06:34.997522 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG dbcounter [-] [416294] Writing DB stats keystone:SELECT=100 {{(pid=416294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:06:35.005148 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53de398-fd56-4a56-bc9c-4132d463a1f2 None admin] Validating token access rules against request {{(pid=416294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:06:35.027376 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cffdae8-6e34-45e7-b4d7-dd5f3bd02696 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:06:35.028019 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cffdae8-6e34-45e7-b4d7-dd5f3bd02696 None admin] REQUEST_METHOD: `GET` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:06:35.028301 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cffdae8-6e34-45e7-b4d7-dd5f3bd02696 None admin] SCRIPT_NAME: `/identity` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:06:35.028575 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cffdae8-6e34-45e7-b4d7-dd5f3bd02696 None admin] PATH_INFO: `/v3/roles` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:06:35.029347 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cffdae8-6e34-45e7-b4d7-dd5f3bd02696 None admin] RBAC: Adding query filter params (name=service) {{(pid=416293) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 09:06:35.029654 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cffdae8-6e34-45e7-b4d7-dd5f3bd02696 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:06:35.031060 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cffdae8-6e34-45e7-b4d7-dd5f3bd02696 None admin] RBAC: Authorization granted {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:06:35.039695 dv-cinder-851351-1-smb devstack@keystone.service[416293]: [pid: 416293|app: 0|req: 316/645] 10.222.0.42 () {56 vars in 1103 bytes} [Thu Jul 28 09:06:34 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:06:35.040084 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34cca8d9-606a-461b-84e4-d0ce4fd4c69f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:06:35.040519 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cffdae8-6e34-45e7-b4d7-dd5f3bd02696 None admin] Authenticating user token {{(pid=416293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:06:35.040829 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34cca8d9-606a-461b-84e4-d0ce4fd4c69f None admin] REQUEST_METHOD: `PUT` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:06:35.041119 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34cca8d9-606a-461b-84e4-d0ce4fd4c69f None admin] SCRIPT_NAME: `/identity` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:06:35.041400 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34cca8d9-606a-461b-84e4-d0ce4fd4c69f None admin] PATH_INFO: `/v3/projects/6c4349445f224184b093d9dfd0dfc642/users/1a2e0811e3e347a387717df1e23d61bf/roles/13417fbdbc5145a69bc01ff0f931fd96` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:06:35.057671 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34cca8d9-606a-461b-84e4-d0ce4fd4c69f None admin] RBAC: Authorizing `identity:create_grant(project_id=6c4349445f224184b093d9dfd0dfc642, user_id=1a2e0811e3e347a387717df1e23d61bf, role_id=13417fbdbc5145a69bc01ff0f931fd96)` {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:06:35.059145 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34cca8d9-606a-461b-84e4-d0ce4fd4c69f None admin] RBAC: Authorization granted {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:06:35.072979 dv-cinder-851351-1-smb devstack@keystone.service[416294]: [pid: 416294|app: 0|req: 330/646] 10.222.0.42 () {58 vars in 1439 bytes} [Thu Jul 28 09:06:34 2022] PUT /identity/v3/projects/6c4349445f224184b093d9dfd0dfc642/users/1a2e0811e3e347a387717df1e23d61bf/roles/13417fbdbc5145a69bc01ff0f931fd96 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 09:06:35.074243 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34cca8d9-606a-461b-84e4-d0ce4fd4c69f None admin] Authenticating user token {{(pid=416294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:06:35.156227 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cffdae8-6e34-45e7-b4d7-dd5f3bd02696 None admin] Validating token access rules against request {{(pid=416293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:06:35.160694 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG dbcounter [-] [416293] Writing DB stats keystone:SELECT=100 {{(pid=416293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:06:35.190927 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34cca8d9-606a-461b-84e4-d0ce4fd4c69f None admin] Validating token access rules against request {{(pid=416294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:06:35.203168 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6258aae-0c60-4939-b9ad-cb3837f72dcf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:06:35.203855 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6258aae-0c60-4939-b9ad-cb3837f72dcf None admin] REQUEST_METHOD: `GET` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:06:35.204132 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6258aae-0c60-4939-b9ad-cb3837f72dcf None admin] SCRIPT_NAME: `/identity` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:06:35.204409 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6258aae-0c60-4939-b9ad-cb3837f72dcf None admin] PATH_INFO: `/v3/users/cinder` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:06:35.213617 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6258aae-0c60-4939-b9ad-cb3837f72dcf None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:06:35.215103 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6258aae-0c60-4939-b9ad-cb3837f72dcf None admin] RBAC: Authorization granted {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:06:35.230524 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application [None req-d6258aae-0c60-4939-b9ad-cb3837f72dcf None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jul 28 09:06:35.230524 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 09:06:35.230524 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 09:06:35.230524 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 09:06:35.230524 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 09:06:35.230524 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 09:06:35.230524 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 09:06:35.230524 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 09:06:35.230524 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 09:06:35.230524 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 09:06:35.230524 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 09:06:35.230524 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 09:06:35.230524 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 28 09:06:35.230524 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 28 09:06:35.230524 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 28 09:06:35.230524 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 28 09:06:35.231646 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 09:06:35.231646 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 09:06:35.231646 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 28 09:06:35.231646 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 09:06:35.231646 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 28 09:06:35.231646 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 09:06:35.231646 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 09:06:35.231646 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 09:06:35.231646 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 09:06:35.231646 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 09:06:35.231646 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 09:06:35.231646 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application with Lock( Jul 28 09:06:35.231646 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 09:06:35.231646 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self._enter() Jul 28 09:06:35.231646 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 09:06:35.231646 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 09:06:35.231646 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 09:06:35.231646 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self.creator() Jul 28 09:06:35.232702 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 09:06:35.232702 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application created_value = creator( Jul 28 09:06:35.232702 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 28 09:06:35.232702 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 28 09:06:35.232702 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 28 09:06:35.232702 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 28 09:06:35.232702 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 28 09:06:35.232702 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 28 09:06:35.232702 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jul 28 09:06:35.232702 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application Jul 28 09:06:35.232702 dv-cinder-851351-1-smb devstack@keystone.service[416293]: [pid: 416293|app: 0|req: 317/647] 10.222.0.42 () {56 vars in 1099 bytes} [Thu Jul 28 09:06:35 2022] GET /identity/v3/users/cinder => generated 84 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 09:06:35.233379 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6258aae-0c60-4939-b9ad-cb3837f72dcf None admin] Authenticating user token {{(pid=416293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:06:35.235637 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4df406-e776-47a8-a842-df666ee9136e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:06:35.236491 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4df406-e776-47a8-a842-df666ee9136e None admin] REQUEST_METHOD: `GET` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:06:35.236984 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4df406-e776-47a8-a842-df666ee9136e None admin] SCRIPT_NAME: `/identity` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:06:35.237430 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4df406-e776-47a8-a842-df666ee9136e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:06:35.238414 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa4df406-e776-47a8-a842-df666ee9136e None admin] RBAC: Adding query filter params (role.id=13417fbdbc5145a69bc01ff0f931fd96, scope.project.id=6c4349445f224184b093d9dfd0dfc642, user.id=62f7da38a7044000bdf5790da751a45e) {{(pid=416294) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 09:06:35.238730 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa4df406-e776-47a8-a842-df666ee9136e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:06:35.240196 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa4df406-e776-47a8-a842-df666ee9136e None admin] RBAC: Authorization granted {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:06:35.248843 dv-cinder-851351-1-smb devstack@keystone.service[416294]: [pid: 416294|app: 0|req: 331/648] 10.222.0.42 () {56 vars in 1374 bytes} [Thu Jul 28 09:06:35 2022] GET /identity/v3/role_assignments?user.id=62f7da38a7044000bdf5790da751a45e&scope.project.id=6c4349445f224184b093d9dfd0dfc642&role.id=13417fbdbc5145a69bc01ff0f931fd96 => generated 608 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:06:35.250100 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4df406-e776-47a8-a842-df666ee9136e None admin] Authenticating user token {{(pid=416294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:06:35.266716 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG dbcounter [-] [416294] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=416294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:06:35.365492 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6258aae-0c60-4939-b9ad-cb3837f72dcf None admin] Validating token access rules against request {{(pid=416293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:06:35.407765 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4df406-e776-47a8-a842-df666ee9136e None admin] Validating token access rules against request {{(pid=416294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:06:35.407991 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb0d3be-9360-48f8-989f-d67dea10619f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:06:35.408492 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb0d3be-9360-48f8-989f-d67dea10619f None admin] REQUEST_METHOD: `GET` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:06:35.408865 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb0d3be-9360-48f8-989f-d67dea10619f None admin] SCRIPT_NAME: `/identity` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:06:35.409159 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb0d3be-9360-48f8-989f-d67dea10619f None admin] PATH_INFO: `/v3/roles` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:06:35.409930 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecb0d3be-9360-48f8-989f-d67dea10619f None admin] RBAC: Adding query filter params (name=service) {{(pid=416293) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 09:06:35.410247 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecb0d3be-9360-48f8-989f-d67dea10619f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:06:35.411709 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecb0d3be-9360-48f8-989f-d67dea10619f None admin] RBAC: Authorization granted {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:06:35.421457 dv-cinder-851351-1-smb devstack@keystone.service[416293]: [pid: 416293|app: 0|req: 318/649] 10.222.0.42 () {56 vars in 1103 bytes} [Thu Jul 28 09:06:35 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:06:35.422428 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb0d3be-9360-48f8-989f-d67dea10619f None admin] Authenticating user token {{(pid=416293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:06:35.457116 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG dbcounter [-] [416293] Writing DB stats keystone:SELECT=100 {{(pid=416293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:06:35.462781 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8a48a5-a2a6-4aec-98be-5eccb1731974 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:06:35.463461 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8a48a5-a2a6-4aec-98be-5eccb1731974 None admin] REQUEST_METHOD: `GET` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:06:35.463744 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8a48a5-a2a6-4aec-98be-5eccb1731974 None admin] SCRIPT_NAME: `/identity` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:06:35.464020 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8a48a5-a2a6-4aec-98be-5eccb1731974 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:06:35.480517 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d8a48a5-a2a6-4aec-98be-5eccb1731974 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:06:35.482641 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d8a48a5-a2a6-4aec-98be-5eccb1731974 None admin] RBAC: Authorization granted {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:06:35.502283 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application [None req-1d8a48a5-a2a6-4aec-98be-5eccb1731974 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 09:06:35.502283 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 09:06:35.502283 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 09:06:35.502283 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 09:06:35.502283 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 09:06:35.502283 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 09:06:35.502283 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 09:06:35.502283 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 09:06:35.502283 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 09:06:35.502283 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 09:06:35.502283 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 09:06:35.502283 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 09:06:35.502283 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 09:06:35.502283 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 09:06:35.502283 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 09:06:35.503330 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 09:06:35.503330 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 09:06:35.503330 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 09:06:35.503330 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 09:06:35.503330 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 09:06:35.503330 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 09:06:35.503330 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 09:06:35.503330 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 09:06:35.503330 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application with Lock( Jul 28 09:06:35.503330 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 09:06:35.503330 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return self._enter() Jul 28 09:06:35.503330 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 09:06:35.503330 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 09:06:35.503330 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 09:06:35.503330 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return self.creator() Jul 28 09:06:35.503330 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 09:06:35.503330 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application created_value = creator( Jul 28 09:06:35.504293 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 09:06:35.504293 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 09:06:35.504293 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 09:06:35.504293 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application Jul 28 09:06:35.508746 dv-cinder-851351-1-smb devstack@keystone.service[416294]: [pid: 416294|app: 0|req: 332/650] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 09:06:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 254 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 09:06:35.510074 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8a48a5-a2a6-4aec-98be-5eccb1731974 None admin] Authenticating user token {{(pid=416294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:06:35.558139 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb0d3be-9360-48f8-989f-d67dea10619f None admin] Validating token access rules against request {{(pid=416293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:06:35.583426 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG dbcounter [-] [416294] Writing DB stats keystone:SELECT=100 {{(pid=416294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:06:35.600197 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee479be3-974b-4007-ab32-f9e669433357 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:06:35.601283 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee479be3-974b-4007-ab32-f9e669433357 None admin] REQUEST_METHOD: `GET` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:06:35.601789 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee479be3-974b-4007-ab32-f9e669433357 None admin] SCRIPT_NAME: `/identity` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:06:35.602273 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee479be3-974b-4007-ab32-f9e669433357 None admin] PATH_INFO: `/v3/users` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:06:35.603290 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee479be3-974b-4007-ab32-f9e669433357 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=416293) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 09:06:35.603812 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee479be3-974b-4007-ab32-f9e669433357 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:06:35.605369 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee479be3-974b-4007-ab32-f9e669433357 None admin] RBAC: Authorization granted {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:06:35.625171 dv-cinder-851351-1-smb devstack@keystone.service[416293]: [pid: 416293|app: 0|req: 319/651] 10.222.0.42 () {56 vars in 1137 bytes} [Thu Jul 28 09:06:35 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:06:35.626234 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee479be3-974b-4007-ab32-f9e669433357 None admin] Authenticating user token {{(pid=416293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:06:35.646358 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8a48a5-a2a6-4aec-98be-5eccb1731974 None admin] Validating token access rules against request {{(pid=416294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:06:35.706593 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5763a8-f415-482c-a081-b7972914e656 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:06:35.707444 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5763a8-f415-482c-a081-b7972914e656 None admin] REQUEST_METHOD: `GET` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:06:35.708108 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5763a8-f415-482c-a081-b7972914e656 None admin] SCRIPT_NAME: `/identity` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:06:35.708395 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5763a8-f415-482c-a081-b7972914e656 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:06:35.720556 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca5763a8-f415-482c-a081-b7972914e656 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:06:35.722209 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca5763a8-f415-482c-a081-b7972914e656 None admin] RBAC: Authorization granted {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:06:35.729276 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG dbcounter [-] [416293] Writing DB stats keystone:SELECT=100 {{(pid=416293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:06:35.740143 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application [None req-ca5763a8-f415-482c-a081-b7972914e656 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 09:06:35.740143 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 09:06:35.740143 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 09:06:35.740143 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 09:06:35.740143 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 09:06:35.740143 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 09:06:35.740143 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 09:06:35.740143 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 09:06:35.740143 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 09:06:35.740143 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 09:06:35.740143 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 09:06:35.740143 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 09:06:35.740143 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 09:06:35.740143 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 09:06:35.740143 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 09:06:35.741346 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 09:06:35.741346 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 09:06:35.741346 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 09:06:35.741346 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 09:06:35.741346 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 09:06:35.741346 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 09:06:35.741346 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 09:06:35.741346 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 09:06:35.741346 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application with Lock( Jul 28 09:06:35.741346 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 09:06:35.741346 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return self._enter() Jul 28 09:06:35.741346 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 09:06:35.741346 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 09:06:35.741346 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 09:06:35.741346 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return self.creator() Jul 28 09:06:35.741346 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 09:06:35.741346 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application created_value = creator( Jul 28 09:06:35.742324 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 09:06:35.742324 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 09:06:35.742324 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 09:06:35.742324 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application Jul 28 09:06:35.742324 dv-cinder-851351-1-smb devstack@keystone.service[416294]: [pid: 416294|app: 0|req: 333/652] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 09:06:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 09:06:35.743612 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5763a8-f415-482c-a081-b7972914e656 None admin] Authenticating user token {{(pid=416294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:06:35.755662 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee479be3-974b-4007-ab32-f9e669433357 None admin] Validating token access rules against request {{(pid=416293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:06:35.794527 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af5ebe1-4a48-4c7f-abdc-0c86dc37dd18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:06:35.795177 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af5ebe1-4a48-4c7f-abdc-0c86dc37dd18 None admin] REQUEST_METHOD: `GET` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:06:35.795522 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af5ebe1-4a48-4c7f-abdc-0c86dc37dd18 None admin] SCRIPT_NAME: `/identity` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:06:35.795814 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af5ebe1-4a48-4c7f-abdc-0c86dc37dd18 None admin] PATH_INFO: `/v3/domains` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:06:35.796566 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af5ebe1-4a48-4c7f-abdc-0c86dc37dd18 None admin] RBAC: Adding query filter params (name=Default) {{(pid=416293) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 09:06:35.796909 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af5ebe1-4a48-4c7f-abdc-0c86dc37dd18 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:06:35.798654 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af5ebe1-4a48-4c7f-abdc-0c86dc37dd18 None admin] RBAC: Authorization granted {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:06:35.811766 dv-cinder-851351-1-smb devstack@keystone.service[416293]: [pid: 416293|app: 0|req: 320/653] 10.222.0.42 () {56 vars in 1109 bytes} [Thu Jul 28 09:06:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:06:35.812643 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af5ebe1-4a48-4c7f-abdc-0c86dc37dd18 None admin] Authenticating user token {{(pid=416293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:06:35.881810 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5763a8-f415-482c-a081-b7972914e656 None admin] Validating token access rules against request {{(pid=416294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:06:35.905629 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG dbcounter [-] [416294] Writing DB stats keystone:SELECT=100 {{(pid=416294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:06:35.929295 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e193445-d4c1-4f26-a56c-745d595323bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:06:35.930065 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e193445-d4c1-4f26-a56c-745d595323bb None admin] REQUEST_METHOD: `GET` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:06:35.930425 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e193445-d4c1-4f26-a56c-745d595323bb None admin] SCRIPT_NAME: `/identity` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:06:35.930780 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e193445-d4c1-4f26-a56c-745d595323bb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:06:35.934128 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af5ebe1-4a48-4c7f-abdc-0c86dc37dd18 None admin] Validating token access rules against request {{(pid=416293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:06:35.990741 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5af91e4-9190-4f9f-a5bd-357ad1e6e7cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:06:35.991406 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5af91e4-9190-4f9f-a5bd-357ad1e6e7cb None admin] REQUEST_METHOD: `GET` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:06:35.991696 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5af91e4-9190-4f9f-a5bd-357ad1e6e7cb None admin] SCRIPT_NAME: `/identity` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:06:35.991981 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5af91e4-9190-4f9f-a5bd-357ad1e6e7cb None admin] PATH_INFO: `/v3/domains` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:06:35.993236 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5af91e4-9190-4f9f-a5bd-357ad1e6e7cb None admin] RBAC: Adding query filter params (name=Default) {{(pid=416293) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 09:06:35.993625 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5af91e4-9190-4f9f-a5bd-357ad1e6e7cb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:06:35.995307 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5af91e4-9190-4f9f-a5bd-357ad1e6e7cb None admin] RBAC: Authorization granted {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:06:36.016781 dv-cinder-851351-1-smb devstack@keystone.service[416293]: [pid: 416293|app: 0|req: 321/654] 10.222.0.42 () {56 vars in 1109 bytes} [Thu Jul 28 09:06:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:06:36.016781 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5af91e4-9190-4f9f-a5bd-357ad1e6e7cb None admin] Authenticating user token {{(pid=416293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:06:36.017144 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG dbcounter [-] [416293] Writing DB stats keystone:SELECT=100 {{(pid=416293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:06:36.022953 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e193445-d4c1-4f26-a56c-745d595323bb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:06:36.024671 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e193445-d4c1-4f26-a56c-745d595323bb None admin] RBAC: Authorization granted {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:06:36.151547 dv-cinder-851351-1-smb devstack@keystone.service[416294]: [pid: 416294|app: 0|req: 334/655] 10.222.0.42 () {58 vars in 1282 bytes} [Thu Jul 28 09:06:35 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 409 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 28 09:06:36.152593 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e193445-d4c1-4f26-a56c-745d595323bb None admin] Authenticating user token {{(pid=416294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:06:36.168925 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5af91e4-9190-4f9f-a5bd-357ad1e6e7cb None admin] Validating token access rules against request {{(pid=416293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:06:36.173512 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG dbcounter [-] [416294] Writing DB stats keystone:SELECT=100 {{(pid=416294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:06:36.242930 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11392350-ec32-4667-8243-48ded7b23066 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:06:36.243966 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11392350-ec32-4667-8243-48ded7b23066 None admin] REQUEST_METHOD: `GET` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:06:36.244480 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11392350-ec32-4667-8243-48ded7b23066 None admin] SCRIPT_NAME: `/identity` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:06:36.245038 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11392350-ec32-4667-8243-48ded7b23066 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:06:36.258413 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11392350-ec32-4667-8243-48ded7b23066 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:06:36.261267 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11392350-ec32-4667-8243-48ded7b23066 None admin] RBAC: Authorization granted {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:06:36.278893 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e193445-d4c1-4f26-a56c-745d595323bb None admin] Validating token access rules against request {{(pid=416294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:06:36.284761 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application [None req-11392350-ec32-4667-8243-48ded7b23066 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jul 28 09:06:36.284761 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 09:06:36.284761 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 09:06:36.284761 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 09:06:36.284761 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 09:06:36.284761 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 09:06:36.284761 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 09:06:36.284761 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 09:06:36.284761 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 09:06:36.284761 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 09:06:36.284761 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 09:06:36.284761 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 09:06:36.284761 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 28 09:06:36.284761 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 28 09:06:36.284761 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 28 09:06:36.284761 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 28 09:06:36.285855 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 09:06:36.285855 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 09:06:36.285855 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 28 09:06:36.285855 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 09:06:36.285855 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 28 09:06:36.285855 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 09:06:36.285855 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 09:06:36.285855 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 09:06:36.285855 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 09:06:36.285855 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 09:06:36.285855 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 09:06:36.285855 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application with Lock( Jul 28 09:06:36.285855 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 09:06:36.285855 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self._enter() Jul 28 09:06:36.285855 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 09:06:36.285855 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 09:06:36.285855 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 09:06:36.285855 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self.creator() Jul 28 09:06:36.286881 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 09:06:36.286881 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application created_value = creator( Jul 28 09:06:36.286881 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 28 09:06:36.286881 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 28 09:06:36.286881 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 28 09:06:36.286881 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 28 09:06:36.286881 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 28 09:06:36.286881 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 28 09:06:36.286881 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jul 28 09:06:36.286881 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application Jul 28 09:06:36.292976 dv-cinder-851351-1-smb devstack@keystone.service[416293]: [pid: 416293|app: 0|req: 322/656] 10.222.0.42 () {56 vars in 1102 bytes} [Thu Jul 28 09:06:36 2022] GET /identity/v3/users/neutron => generated 85 bytes in 274 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 09:06:36.294700 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11392350-ec32-4667-8243-48ded7b23066 None admin] Authenticating user token {{(pid=416293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:06:36.324053 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56088104-4b50-4f36-88e2-61ab51ece5ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:06:36.324917 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56088104-4b50-4f36-88e2-61ab51ece5ab None admin] REQUEST_METHOD: `GET` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:06:36.325204 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56088104-4b50-4f36-88e2-61ab51ece5ab None admin] SCRIPT_NAME: `/identity` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:06:36.325483 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56088104-4b50-4f36-88e2-61ab51ece5ab None admin] PATH_INFO: `/v3/users/glance` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:06:36.334558 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56088104-4b50-4f36-88e2-61ab51ece5ab None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:06:36.336023 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56088104-4b50-4f36-88e2-61ab51ece5ab None admin] RBAC: Authorization granted {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:06:36.352137 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application [None req-56088104-4b50-4f36-88e2-61ab51ece5ab None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jul 28 09:06:36.352137 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 09:06:36.352137 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 09:06:36.352137 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 09:06:36.352137 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 09:06:36.352137 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 09:06:36.352137 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 09:06:36.352137 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 09:06:36.352137 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 09:06:36.352137 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 09:06:36.352137 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 09:06:36.352137 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 09:06:36.352137 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 28 09:06:36.352137 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 28 09:06:36.352137 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 28 09:06:36.352137 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 28 09:06:36.354292 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 09:06:36.354292 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 09:06:36.354292 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 28 09:06:36.354292 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 09:06:36.354292 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 28 09:06:36.354292 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 09:06:36.354292 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 09:06:36.354292 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 09:06:36.354292 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 09:06:36.354292 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 09:06:36.354292 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 09:06:36.354292 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application with Lock( Jul 28 09:06:36.354292 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 09:06:36.354292 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return self._enter() Jul 28 09:06:36.354292 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 09:06:36.354292 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 09:06:36.354292 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 09:06:36.354292 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return self.creator() Jul 28 09:06:36.356433 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 09:06:36.356433 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application created_value = creator( Jul 28 09:06:36.356433 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 28 09:06:36.356433 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 28 09:06:36.356433 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 28 09:06:36.356433 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 28 09:06:36.356433 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 28 09:06:36.356433 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 28 09:06:36.356433 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jul 28 09:06:36.356433 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application Jul 28 09:06:36.356433 dv-cinder-851351-1-smb devstack@keystone.service[416294]: [pid: 416294|app: 0|req: 335/657] 10.222.0.42 () {56 vars in 1099 bytes} [Thu Jul 28 09:06:36 2022] GET /identity/v3/users/glance => generated 84 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 09:06:36.356433 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56088104-4b50-4f36-88e2-61ab51ece5ab None admin] Authenticating user token {{(pid=416294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:06:36.417727 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG dbcounter [-] [416293] Writing DB stats keystone:SELECT=100 {{(pid=416293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:06:36.451895 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG dbcounter [-] [416294] Writing DB stats keystone:SELECT=100 {{(pid=416294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:06:36.482409 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11392350-ec32-4667-8243-48ded7b23066 None admin] Validating token access rules against request {{(pid=416293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:06:36.493699 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56088104-4b50-4f36-88e2-61ab51ece5ab None admin] Validating token access rules against request {{(pid=416294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:06:36.531698 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b0ed06c-c799-4e09-9f98-045fb75dee05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:06:36.532398 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0ed06c-c799-4e09-9f98-045fb75dee05 None admin] REQUEST_METHOD: `GET` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:06:36.532765 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0ed06c-c799-4e09-9f98-045fb75dee05 None admin] SCRIPT_NAME: `/identity` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:06:36.533327 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0ed06c-c799-4e09-9f98-045fb75dee05 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:06:36.539828 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9071c4ce-8a5e-4603-baa6-afc3b1c49bbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:06:36.540580 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9071c4ce-8a5e-4603-baa6-afc3b1c49bbb None admin] REQUEST_METHOD: `GET` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:06:36.540973 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9071c4ce-8a5e-4603-baa6-afc3b1c49bbb None admin] SCRIPT_NAME: `/identity` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:06:36.541338 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9071c4ce-8a5e-4603-baa6-afc3b1c49bbb None admin] PATH_INFO: `/v3/users` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:06:36.542243 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9071c4ce-8a5e-4603-baa6-afc3b1c49bbb None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=416294) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 09:06:36.543377 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9071c4ce-8a5e-4603-baa6-afc3b1c49bbb None admin] RBAC: Authorizing `identity:list_users()` {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:06:36.545587 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9071c4ce-8a5e-4603-baa6-afc3b1c49bbb None admin] RBAC: Authorization granted {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:06:36.547216 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b0ed06c-c799-4e09-9f98-045fb75dee05 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:06:36.550210 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b0ed06c-c799-4e09-9f98-045fb75dee05 None admin] RBAC: Authorization granted {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:06:36.569725 dv-cinder-851351-1-smb devstack@keystone.service[416294]: [pid: 416294|app: 0|req: 336/658] 10.222.0.42 () {56 vars in 1139 bytes} [Thu Jul 28 09:06:36 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:06:36.570727 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9071c4ce-8a5e-4603-baa6-afc3b1c49bbb None admin] Authenticating user token {{(pid=416294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:06:36.576585 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application [None req-5b0ed06c-c799-4e09-9f98-045fb75dee05 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 09:06:36.576585 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 09:06:36.576585 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 09:06:36.576585 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 09:06:36.576585 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 09:06:36.576585 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 09:06:36.576585 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 09:06:36.576585 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 09:06:36.576585 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 09:06:36.576585 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 09:06:36.576585 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 09:06:36.576585 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 09:06:36.576585 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 09:06:36.576585 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 09:06:36.576585 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 09:06:36.577662 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 09:06:36.577662 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 09:06:36.577662 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 09:06:36.577662 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 09:06:36.577662 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 09:06:36.577662 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 09:06:36.577662 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 09:06:36.577662 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 09:06:36.577662 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application with Lock( Jul 28 09:06:36.577662 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 09:06:36.577662 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self._enter() Jul 28 09:06:36.577662 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 09:06:36.577662 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 09:06:36.577662 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 09:06:36.577662 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self.creator() Jul 28 09:06:36.577662 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 09:06:36.577662 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application created_value = creator( Jul 28 09:06:36.578641 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 09:06:36.578641 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 09:06:36.578641 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 09:06:36.578641 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application Jul 28 09:06:36.583426 dv-cinder-851351-1-smb devstack@keystone.service[416293]: [pid: 416293|app: 0|req: 323/659] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 09:06:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 285 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 09:06:36.585430 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b0ed06c-c799-4e09-9f98-045fb75dee05 None admin] Authenticating user token {{(pid=416293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:06:36.703992 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b0ed06c-c799-4e09-9f98-045fb75dee05 None admin] Validating token access rules against request {{(pid=416293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:06:36.719038 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9071c4ce-8a5e-4603-baa6-afc3b1c49bbb None admin] Validating token access rules against request {{(pid=416294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:06:36.721928 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG dbcounter [-] [416293] Writing DB stats keystone:SELECT=100 {{(pid=416293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:06:36.751808 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790b71b9-3f99-40e8-9eff-0037e4573e04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:06:36.752717 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790b71b9-3f99-40e8-9eff-0037e4573e04 None admin] REQUEST_METHOD: `GET` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:06:36.753017 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790b71b9-3f99-40e8-9eff-0037e4573e04 None admin] SCRIPT_NAME: `/identity` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:06:36.753301 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790b71b9-3f99-40e8-9eff-0037e4573e04 None admin] PATH_INFO: `/v3/domains` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:06:36.753979 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG dbcounter [-] [416294] Writing DB stats keystone:SELECT=100 {{(pid=416294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:06:36.755655 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-790b71b9-3f99-40e8-9eff-0037e4573e04 None admin] RBAC: Adding query filter params (name=Default) {{(pid=416293) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 09:06:36.755988 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-790b71b9-3f99-40e8-9eff-0037e4573e04 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:06:36.757773 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-790b71b9-3f99-40e8-9eff-0037e4573e04 None admin] RBAC: Authorization granted {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:06:36.760433 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b7c411e-b440-41c2-8ded-5fd263f65dfb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:06:36.761295 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7c411e-b440-41c2-8ded-5fd263f65dfb None admin] REQUEST_METHOD: `GET` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:06:36.761686 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7c411e-b440-41c2-8ded-5fd263f65dfb None admin] SCRIPT_NAME: `/identity` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:06:36.762168 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7c411e-b440-41c2-8ded-5fd263f65dfb None admin] PATH_INFO: `/v3/users` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:06:36.763158 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b7c411e-b440-41c2-8ded-5fd263f65dfb None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=416294) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 09:06:36.763561 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b7c411e-b440-41c2-8ded-5fd263f65dfb None admin] RBAC: Authorizing `identity:list_users()` {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:06:36.765237 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b7c411e-b440-41c2-8ded-5fd263f65dfb None admin] RBAC: Authorization granted {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:06:36.781116 dv-cinder-851351-1-smb devstack@keystone.service[416293]: [pid: 416293|app: 0|req: 324/660] 10.222.0.42 () {56 vars in 1109 bytes} [Thu Jul 28 09:06:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 09:06:36.782859 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790b71b9-3f99-40e8-9eff-0037e4573e04 None admin] Authenticating user token {{(pid=416293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:06:36.785778 dv-cinder-851351-1-smb devstack@keystone.service[416294]: [pid: 416294|app: 0|req: 337/661] 10.222.0.42 () {56 vars in 1137 bytes} [Thu Jul 28 09:06:36 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:06:36.788481 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b7c411e-b440-41c2-8ded-5fd263f65dfb None admin] Authenticating user token {{(pid=416294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:06:36.896948 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790b71b9-3f99-40e8-9eff-0037e4573e04 None admin] Validating token access rules against request {{(pid=416293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:06:36.922488 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b7c411e-b440-41c2-8ded-5fd263f65dfb None admin] Validating token access rules against request {{(pid=416294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:06:36.943635 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb9d25e-318a-4c4a-af14-5c434456708d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:06:36.944287 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb9d25e-318a-4c4a-af14-5c434456708d None admin] REQUEST_METHOD: `GET` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:06:36.945093 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb9d25e-318a-4c4a-af14-5c434456708d None admin] SCRIPT_NAME: `/identity` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:06:36.945383 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb9d25e-318a-4c4a-af14-5c434456708d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:06:36.960333 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4aa89d-edf0-484e-a374-46ef17011158 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:06:36.961337 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4aa89d-edf0-484e-a374-46ef17011158 None admin] REQUEST_METHOD: `GET` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:06:36.961719 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4aa89d-edf0-484e-a374-46ef17011158 None admin] SCRIPT_NAME: `/identity` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:06:36.962094 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4aa89d-edf0-484e-a374-46ef17011158 None admin] PATH_INFO: `/v3/projects/service` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:06:36.975649 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f4aa89d-edf0-484e-a374-46ef17011158 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:06:36.977584 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f4aa89d-edf0-484e-a374-46ef17011158 None admin] RBAC: Authorization granted {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:06:36.994059 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application [None req-7f4aa89d-edf0-484e-a374-46ef17011158 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 09:06:36.994059 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 09:06:36.994059 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 09:06:36.994059 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 09:06:36.994059 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 09:06:36.994059 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 09:06:36.994059 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 09:06:36.994059 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 09:06:36.994059 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 09:06:36.994059 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 09:06:36.994059 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 09:06:36.994059 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 09:06:36.994059 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 28 09:06:36.994059 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 28 09:06:36.994059 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 28 09:06:36.995109 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 28 09:06:36.995109 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 09:06:36.995109 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 09:06:36.995109 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 09:06:36.995109 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 09:06:36.995109 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 09:06:36.995109 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 09:06:36.995109 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 09:06:36.995109 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application with Lock( Jul 28 09:06:36.995109 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 09:06:36.995109 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return self._enter() Jul 28 09:06:36.995109 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 09:06:36.995109 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 09:06:36.995109 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 09:06:36.995109 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return self.creator() Jul 28 09:06:36.995109 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 09:06:36.995109 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application created_value = creator( Jul 28 09:06:36.996087 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 28 09:06:36.996087 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 28 09:06:36.996087 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 28 09:06:36.996087 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 28 09:06:36.996087 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 28 09:06:36.996087 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 28 09:06:36.996087 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 09:06:36.996087 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application Jul 28 09:06:36.998971 dv-cinder-851351-1-smb devstack@keystone.service[416294]: [pid: 416294|app: 0|req: 338/662] 10.222.0.42 () {56 vars in 1111 bytes} [Thu Jul 28 09:06:36 2022] GET /identity/v3/projects/service => generated 88 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 09:06:37.000182 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4aa89d-edf0-484e-a374-46ef17011158 None admin] Authenticating user token {{(pid=416294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:06:37.012284 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG dbcounter [-] [416293] Writing DB stats keystone:SELECT=100 {{(pid=416293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:06:37.046273 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fb9d25e-318a-4c4a-af14-5c434456708d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:06:37.047886 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fb9d25e-318a-4c4a-af14-5c434456708d None admin] RBAC: Authorization granted {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:06:37.059305 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG dbcounter [-] [416294] Writing DB stats keystone:SELECT=100 {{(pid=416294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:06:37.135820 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4aa89d-edf0-484e-a374-46ef17011158 None admin] Validating token access rules against request {{(pid=416294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:06:37.168840 dv-cinder-851351-1-smb devstack@keystone.service[416293]: [pid: 416293|app: 0|req: 325/663] 10.222.0.42 () {58 vars in 1282 bytes} [Thu Jul 28 09:06:36 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 387 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 28 09:06:37.170090 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb9d25e-318a-4c4a-af14-5c434456708d None admin] Authenticating user token {{(pid=416293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:06:37.178529 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60f270e-80a9-4e86-b82b-3ab1b5553b49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:06:37.179180 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60f270e-80a9-4e86-b82b-3ab1b5553b49 None admin] REQUEST_METHOD: `GET` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:06:37.179478 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60f270e-80a9-4e86-b82b-3ab1b5553b49 None admin] SCRIPT_NAME: `/identity` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:06:37.179755 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60f270e-80a9-4e86-b82b-3ab1b5553b49 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:06:37.254440 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG dbcounter [-] [416293] Writing DB stats keystone:SELECT=100 {{(pid=416293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:06:37.255255 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f60f270e-80a9-4e86-b82b-3ab1b5553b49 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:06:37.257307 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f60f270e-80a9-4e86-b82b-3ab1b5553b49 None admin] RBAC: Authorization granted {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:06:37.286890 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb9d25e-318a-4c4a-af14-5c434456708d None admin] Validating token access rules against request {{(pid=416293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:06:37.310545 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG dbcounter [-] [416294] Writing DB stats keystone:SELECT=100 {{(pid=416294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:06:37.327765 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec31b57f-79d8-48aa-8d08-0c67bcc80e69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:06:37.328824 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec31b57f-79d8-48aa-8d08-0c67bcc80e69 None admin] REQUEST_METHOD: `GET` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:06:37.329309 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec31b57f-79d8-48aa-8d08-0c67bcc80e69 None admin] SCRIPT_NAME: `/identity` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:06:37.329870 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec31b57f-79d8-48aa-8d08-0c67bcc80e69 None admin] PATH_INFO: `/v3/projects` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:06:37.330806 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec31b57f-79d8-48aa-8d08-0c67bcc80e69 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=416293) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 09:06:37.331280 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec31b57f-79d8-48aa-8d08-0c67bcc80e69 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:06:37.332995 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec31b57f-79d8-48aa-8d08-0c67bcc80e69 None admin] RBAC: Authorization granted {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:06:37.351688 dv-cinder-851351-1-smb devstack@keystone.service[416293]: [pid: 416293|app: 0|req: 326/664] 10.222.0.42 () {56 vars in 1148 bytes} [Thu Jul 28 09:06:37 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:06:37.352914 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec31b57f-79d8-48aa-8d08-0c67bcc80e69 None admin] Authenticating user token {{(pid=416293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:06:37.368820 dv-cinder-851351-1-smb devstack@keystone.service[416294]: [pid: 416294|app: 0|req: 339/665] 10.222.0.42 () {58 vars in 1282 bytes} [Thu Jul 28 09:06:36 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 369 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 28 09:06:37.370128 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec597ed-d47d-46bd-8663-5a46d1b82432 None None] REQUEST_METHOD: `GET` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:06:37.370422 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec597ed-d47d-46bd-8663-5a46d1b82432 None None] SCRIPT_NAME: `/identity` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:06:37.370702 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec597ed-d47d-46bd-8663-5a46d1b82432 None None] PATH_INFO: `/` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:06:37.376145 dv-cinder-851351-1-smb devstack@keystone.service[416294]: [pid: 416294|app: 0|req: 340/666] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 09:06:37 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 09:06:37.376938 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec597ed-d47d-46bd-8663-5a46d1b82432 None None] Authenticating user token {{(pid=416294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:06:37.477241 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec31b57f-79d8-48aa-8d08-0c67bcc80e69 None admin] Validating token access rules against request {{(pid=416293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:06:37.492381 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec597ed-d47d-46bd-8663-5a46d1b82432 None None] Validating token access rules against request {{(pid=416294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:06:37.515340 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef36ddc-1ba1-4348-94ce-07dca13c1539 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:06:37.515998 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef36ddc-1ba1-4348-94ce-07dca13c1539 None admin] REQUEST_METHOD: `GET` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:06:37.516282 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef36ddc-1ba1-4348-94ce-07dca13c1539 None admin] SCRIPT_NAME: `/identity` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:06:37.516553 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef36ddc-1ba1-4348-94ce-07dca13c1539 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:06:37.518625 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG dbcounter [-] [416293] Writing DB stats keystone:SELECT=100 {{(pid=416293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:06:37.527688 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90cf6139-2c21-476d-a9d3-8860410bd369 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:06:37.528322 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90cf6139-2c21-476d-a9d3-8860410bd369 None admin] REQUEST_METHOD: `GET` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:06:37.528612 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90cf6139-2c21-476d-a9d3-8860410bd369 None admin] SCRIPT_NAME: `/identity` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:06:37.528761 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ef36ddc-1ba1-4348-94ce-07dca13c1539 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:06:37.528926 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90cf6139-2c21-476d-a9d3-8860410bd369 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:06:37.529729 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90cf6139-2c21-476d-a9d3-8860410bd369 None admin] RBAC: Adding query filter params (role.id=13417fbdbc5145a69bc01ff0f931fd96, scope.project.id=6c4349445f224184b093d9dfd0dfc642, user.id=12179aeb7c45432992616973fc5bdf77) {{(pid=416294) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 09:06:37.530047 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90cf6139-2c21-476d-a9d3-8860410bd369 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:06:37.530214 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ef36ddc-1ba1-4348-94ce-07dca13c1539 None admin] RBAC: Authorization granted {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:06:37.531481 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90cf6139-2c21-476d-a9d3-8860410bd369 None admin] RBAC: Authorization granted {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:06:37.537690 dv-cinder-851351-1-smb devstack@keystone.service[416294]: [pid: 416294|app: 0|req: 341/667] 10.222.0.42 () {56 vars in 1374 bytes} [Thu Jul 28 09:06:37 2022] GET /identity/v3/role_assignments?user.id=12179aeb7c45432992616973fc5bdf77&scope.project.id=6c4349445f224184b093d9dfd0dfc642&role.id=13417fbdbc5145a69bc01ff0f931fd96 => generated 608 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:06:37.538432 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90cf6139-2c21-476d-a9d3-8860410bd369 None admin] Authenticating user token {{(pid=416294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:06:37.545449 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application [None req-3ef36ddc-1ba1-4348-94ce-07dca13c1539 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 09:06:37.545449 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 09:06:37.545449 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 09:06:37.545449 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 09:06:37.545449 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 09:06:37.545449 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 09:06:37.545449 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 09:06:37.545449 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 09:06:37.545449 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 09:06:37.545449 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 09:06:37.545449 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 09:06:37.545449 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 09:06:37.545449 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 09:06:37.545449 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 09:06:37.545449 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 09:06:37.546504 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 09:06:37.546504 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 09:06:37.546504 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 09:06:37.546504 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 09:06:37.546504 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 09:06:37.546504 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 09:06:37.546504 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 09:06:37.546504 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 09:06:37.546504 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application with Lock( Jul 28 09:06:37.546504 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 09:06:37.546504 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self._enter() Jul 28 09:06:37.546504 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 09:06:37.546504 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 09:06:37.546504 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 09:06:37.546504 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self.creator() Jul 28 09:06:37.546504 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 09:06:37.546504 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application created_value = creator( Jul 28 09:06:37.547485 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 09:06:37.547485 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 09:06:37.547485 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 09:06:37.547485 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application Jul 28 09:06:37.554673 dv-cinder-851351-1-smb devstack@keystone.service[416293]: [pid: 416293|app: 0|req: 327/668] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 09:06:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 09:06:37.554673 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48cb3e9-a0f1-4028-85c3-bd20ef74f66a None None] REQUEST_METHOD: `POST` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:06:37.554673 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48cb3e9-a0f1-4028-85c3-bd20ef74f66a None None] SCRIPT_NAME: `/identity` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:06:37.554673 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48cb3e9-a0f1-4028-85c3-bd20ef74f66a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:06:37.556003 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG dbcounter [-] [416294] Writing DB stats keystone:SELECT=100 {{(pid=416294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:06:37.574830 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.auth.core [None req-c48cb3e9-a0f1-4028-85c3-bd20ef74f66a None None] MFA Rules not processed for user `dbf87abab90e4fdf9e75408f4199918e`. Rule list: `[]` (Enabled: `True`). {{(pid=416293) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 09:06:37.576111 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.fernet_utils [None req-c48cb3e9-a0f1-4028-85c3-bd20ef74f66a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=416293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 09:06:37.661840 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90cf6139-2c21-476d-a9d3-8860410bd369 None admin] Validating token access rules against request {{(pid=416294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:06:37.665067 dv-cinder-851351-1-smb devstack@keystone.service[416293]: [pid: 416293|app: 0|req: 328/669] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 09:06:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 09:06:37.666936 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd389c8-3fe3-474f-8738-f271f9cd230f None None] REQUEST_METHOD: `GET` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:06:37.667498 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd389c8-3fe3-474f-8738-f271f9cd230f None None] SCRIPT_NAME: `/identity` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:06:37.667992 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd389c8-3fe3-474f-8738-f271f9cd230f None None] PATH_INFO: `/` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:06:37.675284 dv-cinder-851351-1-smb devstack@keystone.service[416293]: [pid: 416293|app: 0|req: 329/670] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 09:06:37 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 09:06:37.675284 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd389c8-3fe3-474f-8738-f271f9cd230f None None] Authenticating user token {{(pid=416293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:06:37.705814 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86327949-0063-490b-b8bc-af7d98482ccd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:06:37.706478 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86327949-0063-490b-b8bc-af7d98482ccd None admin] REQUEST_METHOD: `GET` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:06:37.707255 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86327949-0063-490b-b8bc-af7d98482ccd None admin] SCRIPT_NAME: `/identity` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:06:37.707255 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86327949-0063-490b-b8bc-af7d98482ccd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:06:37.719689 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86327949-0063-490b-b8bc-af7d98482ccd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:06:37.721425 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86327949-0063-490b-b8bc-af7d98482ccd None admin] RBAC: Authorization granted {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:06:37.745734 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application [None req-86327949-0063-490b-b8bc-af7d98482ccd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 09:06:37.745734 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 09:06:37.745734 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 09:06:37.745734 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 09:06:37.745734 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 09:06:37.745734 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 09:06:37.745734 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 09:06:37.745734 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 09:06:37.745734 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 09:06:37.745734 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 09:06:37.745734 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 09:06:37.745734 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 09:06:37.745734 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 09:06:37.745734 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 09:06:37.745734 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 09:06:37.747027 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 09:06:37.747027 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 09:06:37.747027 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 09:06:37.747027 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 09:06:37.747027 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 09:06:37.747027 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 09:06:37.747027 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 09:06:37.747027 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 09:06:37.747027 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application with Lock( Jul 28 09:06:37.747027 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 09:06:37.747027 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return self._enter() Jul 28 09:06:37.747027 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 09:06:37.747027 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 09:06:37.747027 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 09:06:37.747027 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return self.creator() Jul 28 09:06:37.747027 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 09:06:37.747027 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application created_value = creator( Jul 28 09:06:37.748173 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 09:06:37.748173 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 09:06:37.748173 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 09:06:37.748173 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application Jul 28 09:06:37.748173 dv-cinder-851351-1-smb devstack@keystone.service[416294]: [pid: 416294|app: 0|req: 342/671] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 09:06:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 09:06:37.748173 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085fa8ad-2ebf-493a-b59b-c7fd27019d11 None None] REQUEST_METHOD: `POST` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:06:37.748612 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085fa8ad-2ebf-493a-b59b-c7fd27019d11 None None] SCRIPT_NAME: `/identity` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:06:37.748747 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085fa8ad-2ebf-493a-b59b-c7fd27019d11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:06:37.771374 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.auth.core [None req-085fa8ad-2ebf-493a-b59b-c7fd27019d11 None None] MFA Rules not processed for user `dbf87abab90e4fdf9e75408f4199918e`. Rule list: `[]` (Enabled: `True`). {{(pid=416294) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 09:06:37.772610 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.fernet_utils [None req-085fa8ad-2ebf-493a-b59b-c7fd27019d11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=416294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 09:06:37.804018 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd389c8-3fe3-474f-8738-f271f9cd230f None None] Validating token access rules against request {{(pid=416293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:06:37.821892 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG dbcounter [-] [416293] Writing DB stats keystone:SELECT=100 {{(pid=416293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:06:37.841891 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e65101-c7b9-4e7d-b5ae-5c49a7946c24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:06:37.842645 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e65101-c7b9-4e7d-b5ae-5c49a7946c24 None admin] REQUEST_METHOD: `GET` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:06:37.842932 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e65101-c7b9-4e7d-b5ae-5c49a7946c24 None admin] SCRIPT_NAME: `/identity` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:06:37.843208 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e65101-c7b9-4e7d-b5ae-5c49a7946c24 None admin] PATH_INFO: `/v3/domains` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:06:37.843918 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76e65101-c7b9-4e7d-b5ae-5c49a7946c24 None admin] RBAC: Adding query filter params (name=Default) {{(pid=416293) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 09:06:37.844221 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76e65101-c7b9-4e7d-b5ae-5c49a7946c24 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:06:37.844987 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG dbcounter [-] [416294] Writing DB stats keystone:SELECT=100 {{(pid=416294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:06:37.845755 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76e65101-c7b9-4e7d-b5ae-5c49a7946c24 None admin] RBAC: Authorization granted {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:06:37.856395 dv-cinder-851351-1-smb devstack@keystone.service[416294]: [pid: 416294|app: 0|req: 343/672] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 09:06:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 09:06:37.857423 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085fa8ad-2ebf-493a-b59b-c7fd27019d11 None None] Authenticating user token {{(pid=416294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:06:37.868964 dv-cinder-851351-1-smb devstack@keystone.service[416293]: [pid: 416293|app: 0|req: 330/673] 10.222.0.42 () {56 vars in 1109 bytes} [Thu Jul 28 09:06:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:06:37.869850 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e65101-c7b9-4e7d-b5ae-5c49a7946c24 None admin] Authenticating user token {{(pid=416293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:06:37.980592 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085fa8ad-2ebf-493a-b59b-c7fd27019d11 None None] Validating token access rules against request {{(pid=416294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:06:37.999187 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e65101-c7b9-4e7d-b5ae-5c49a7946c24 None admin] Validating token access rules against request {{(pid=416293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:06:38.018521 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9823f3-9f42-4289-b53a-ddc96a8b2221 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:06:38.019189 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9823f3-9f42-4289-b53a-ddc96a8b2221 None admin] REQUEST_METHOD: `GET` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:06:38.019476 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9823f3-9f42-4289-b53a-ddc96a8b2221 None admin] SCRIPT_NAME: `/identity` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:06:38.019778 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9823f3-9f42-4289-b53a-ddc96a8b2221 None admin] PATH_INFO: `/v3/roles/service` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:06:38.030940 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d9823f3-9f42-4289-b53a-ddc96a8b2221 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 09:06:38.036000 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application [None req-8d9823f3-9f42-4289-b53a-ddc96a8b2221 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 28 09:06:38.036000 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 09:06:38.036000 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 09:06:38.036000 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 09:06:38.036000 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 09:06:38.036000 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 09:06:38.036000 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 09:06:38.036000 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 09:06:38.036000 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 09:06:38.036000 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 09:06:38.036000 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 09:06:38.036000 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 09:06:38.036000 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 09:06:38.036000 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 09:06:38.036000 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 09:06:38.036000 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 09:06:38.037311 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 09:06:38.037311 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 09:06:38.037311 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 09:06:38.037311 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 09:06:38.037311 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 09:06:38.037311 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 09:06:38.037311 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 09:06:38.037311 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 09:06:38.037311 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 09:06:38.037311 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 09:06:38.037311 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 09:06:38.037311 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application with Lock( Jul 28 09:06:38.037311 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 09:06:38.037311 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return self._enter() Jul 28 09:06:38.037311 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 09:06:38.037311 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 09:06:38.038241 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 09:06:38.038241 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return self.creator() Jul 28 09:06:38.038241 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 09:06:38.038241 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application created_value = creator( Jul 28 09:06:38.038241 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 09:06:38.038241 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 09:06:38.038241 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 09:06:38.038241 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 09:06:38.038241 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 09:06:38.038241 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 09:06:38.038241 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 28 09:06:38.038241 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application Jul 28 09:06:38.038241 dv-cinder-851351-1-smb devstack@keystone.service[416294]: [pid: 416294|app: 0|req: 344/674] 10.222.0.42 () {56 vars in 1102 bytes} [Thu Jul 28 09:06:37 2022] GET /identity/v3/roles/service => generated 85 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 09:06:38.038998 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9823f3-9f42-4289-b53a-ddc96a8b2221 None admin] Authenticating user token {{(pid=416294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:06:38.046628 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34347eea-7cf3-4ed6-ba6a-07e9846a5812 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:06:38.047560 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34347eea-7cf3-4ed6-ba6a-07e9846a5812 None admin] REQUEST_METHOD: `GET` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:06:38.048009 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34347eea-7cf3-4ed6-ba6a-07e9846a5812 None admin] SCRIPT_NAME: `/identity` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:06:38.048578 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34347eea-7cf3-4ed6-ba6a-07e9846a5812 None admin] PATH_INFO: `/v3/domains` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:06:38.049498 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34347eea-7cf3-4ed6-ba6a-07e9846a5812 None admin] RBAC: Adding query filter params (name=Default) {{(pid=416293) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 09:06:38.050000 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34347eea-7cf3-4ed6-ba6a-07e9846a5812 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:06:38.051650 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34347eea-7cf3-4ed6-ba6a-07e9846a5812 None admin] RBAC: Authorization granted {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:06:38.065809 dv-cinder-851351-1-smb devstack@keystone.service[416293]: [pid: 416293|app: 0|req: 331/675] 10.222.0.42 () {56 vars in 1109 bytes} [Thu Jul 28 09:06:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:06:38.066623 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34347eea-7cf3-4ed6-ba6a-07e9846a5812 None admin] Authenticating user token {{(pid=416293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:06:38.114248 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG dbcounter [-] [416293] Writing DB stats keystone:SELECT=100 {{(pid=416293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:06:38.192872 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34347eea-7cf3-4ed6-ba6a-07e9846a5812 None admin] Validating token access rules against request {{(pid=416293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:06:38.231581 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e25b7d85-58fd-47c2-a031-aea1c59aae95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:06:38.232248 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25b7d85-58fd-47c2-a031-aea1c59aae95 None admin] REQUEST_METHOD: `GET` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:06:38.232537 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25b7d85-58fd-47c2-a031-aea1c59aae95 None admin] SCRIPT_NAME: `/identity` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:06:38.232853 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25b7d85-58fd-47c2-a031-aea1c59aae95 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:06:38.233208 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG dbcounter [-] [416294] Writing DB stats keystone:SELECT=100 {{(pid=416294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:06:38.245379 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e25b7d85-58fd-47c2-a031-aea1c59aae95 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 09:06:38.250404 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application [None req-e25b7d85-58fd-47c2-a031-aea1c59aae95 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 09:06:38.250404 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 09:06:38.250404 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 09:06:38.250404 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 09:06:38.250404 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 09:06:38.250404 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 09:06:38.250404 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 09:06:38.250404 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 09:06:38.250404 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 09:06:38.250404 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 09:06:38.250404 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 09:06:38.250404 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 09:06:38.250404 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 09:06:38.250404 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 09:06:38.250404 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 09:06:38.250404 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 09:06:38.251617 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 09:06:38.251617 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 09:06:38.251617 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 09:06:38.251617 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 09:06:38.251617 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 09:06:38.251617 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 09:06:38.251617 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 09:06:38.251617 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 09:06:38.251617 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 09:06:38.251617 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 09:06:38.251617 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 09:06:38.251617 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application with Lock( Jul 28 09:06:38.251617 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 09:06:38.251617 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self._enter() Jul 28 09:06:38.251617 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 09:06:38.251617 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 09:06:38.252580 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 09:06:38.252580 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self.creator() Jul 28 09:06:38.252580 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 09:06:38.252580 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application created_value = creator( Jul 28 09:06:38.252580 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 09:06:38.252580 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 09:06:38.252580 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 09:06:38.252580 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 09:06:38.252580 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 09:06:38.252580 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 09:06:38.252580 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 09:06:38.252580 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application Jul 28 09:06:38.252580 dv-cinder-851351-1-smb devstack@keystone.service[416293]: [pid: 416293|app: 0|req: 332/676] 10.222.0.42 () {56 vars in 1096 bytes} [Thu Jul 28 09:06:38 2022] GET /identity/v3/roles/admin => generated 83 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 09:06:38.252580 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e25b7d85-58fd-47c2-a031-aea1c59aae95 None admin] Authenticating user token {{(pid=416293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:06:38.288119 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9823f3-9f42-4289-b53a-ddc96a8b2221 None admin] Validating token access rules against request {{(pid=416294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:06:38.330548 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39df68d-84f0-462f-a2eb-5ea0ac74554a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:06:38.331469 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39df68d-84f0-462f-a2eb-5ea0ac74554a None admin] REQUEST_METHOD: `GET` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:06:38.331755 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39df68d-84f0-462f-a2eb-5ea0ac74554a None admin] SCRIPT_NAME: `/identity` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:06:38.332067 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39df68d-84f0-462f-a2eb-5ea0ac74554a None admin] PATH_INFO: `/v3/projects/service` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:06:38.340903 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c39df68d-84f0-462f-a2eb-5ea0ac74554a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:06:38.342689 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c39df68d-84f0-462f-a2eb-5ea0ac74554a None admin] RBAC: Authorization granted {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:06:38.359125 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application [None req-c39df68d-84f0-462f-a2eb-5ea0ac74554a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 09:06:38.359125 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 09:06:38.359125 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 09:06:38.359125 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 09:06:38.359125 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 09:06:38.359125 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 09:06:38.359125 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 09:06:38.359125 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 09:06:38.359125 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 09:06:38.359125 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 09:06:38.359125 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 09:06:38.359125 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 09:06:38.359125 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 28 09:06:38.359125 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 28 09:06:38.359125 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 28 09:06:38.360141 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 28 09:06:38.360141 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 09:06:38.360141 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 09:06:38.360141 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 09:06:38.360141 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 09:06:38.360141 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 09:06:38.360141 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 09:06:38.360141 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 09:06:38.360141 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application with Lock( Jul 28 09:06:38.360141 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 09:06:38.360141 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return self._enter() Jul 28 09:06:38.360141 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 09:06:38.360141 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 09:06:38.360141 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 09:06:38.360141 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return self.creator() Jul 28 09:06:38.360141 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 09:06:38.360141 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application created_value = creator( Jul 28 09:06:38.361157 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 28 09:06:38.361157 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 28 09:06:38.361157 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 28 09:06:38.361157 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 28 09:06:38.361157 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 28 09:06:38.361157 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 28 09:06:38.361157 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 09:06:38.361157 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application Jul 28 09:06:38.361621 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG dbcounter [-] [416293] Writing DB stats keystone:SELECT=100 {{(pid=416293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:06:38.363338 dv-cinder-851351-1-smb devstack@keystone.service[416294]: [pid: 416294|app: 0|req: 345/677] 10.222.0.42 () {56 vars in 1111 bytes} [Thu Jul 28 09:06:38 2022] GET /identity/v3/projects/service => generated 88 bytes in 325 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 09:06:38.364545 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39df68d-84f0-462f-a2eb-5ea0ac74554a None admin] Authenticating user token {{(pid=416294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:06:38.372931 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e25b7d85-58fd-47c2-a031-aea1c59aae95 None admin] Validating token access rules against request {{(pid=416293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:06:38.413619 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba148a64-b3a6-4c74-95e5-067f0d652e71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:06:38.414261 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba148a64-b3a6-4c74-95e5-067f0d652e71 None admin] REQUEST_METHOD: `GET` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:06:38.414546 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba148a64-b3a6-4c74-95e5-067f0d652e71 None admin] SCRIPT_NAME: `/identity` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:06:38.414823 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba148a64-b3a6-4c74-95e5-067f0d652e71 None admin] PATH_INFO: `/v3/roles` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:06:38.415563 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba148a64-b3a6-4c74-95e5-067f0d652e71 None admin] RBAC: Adding query filter params (name=service) {{(pid=416293) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 09:06:38.415869 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba148a64-b3a6-4c74-95e5-067f0d652e71 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:06:38.417314 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba148a64-b3a6-4c74-95e5-067f0d652e71 None admin] RBAC: Authorization granted {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:06:38.426454 dv-cinder-851351-1-smb devstack@keystone.service[416293]: [pid: 416293|app: 0|req: 333/678] 10.222.0.42 () {56 vars in 1103 bytes} [Thu Jul 28 09:06:38 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:06:38.427425 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba148a64-b3a6-4c74-95e5-067f0d652e71 None admin] Authenticating user token {{(pid=416293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:06:38.485747 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39df68d-84f0-462f-a2eb-5ea0ac74554a None admin] Validating token access rules against request {{(pid=416294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:06:38.503265 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG dbcounter [-] [416294] Writing DB stats keystone:SELECT=100 {{(pid=416294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:06:38.525400 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297b220f-dd8c-45e7-ad8f-db10959169c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:06:38.526060 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297b220f-dd8c-45e7-ad8f-db10959169c2 None admin] REQUEST_METHOD: `GET` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:06:38.526346 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297b220f-dd8c-45e7-ad8f-db10959169c2 None admin] SCRIPT_NAME: `/identity` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:06:38.526620 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297b220f-dd8c-45e7-ad8f-db10959169c2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:06:38.533597 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-297b220f-dd8c-45e7-ad8f-db10959169c2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:06:38.535070 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-297b220f-dd8c-45e7-ad8f-db10959169c2 None admin] RBAC: Authorization granted {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:06:38.538451 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba148a64-b3a6-4c74-95e5-067f0d652e71 None admin] Validating token access rules against request {{(pid=416293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:06:38.551398 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application [None req-297b220f-dd8c-45e7-ad8f-db10959169c2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 09:06:38.551398 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 09:06:38.551398 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 09:06:38.551398 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 09:06:38.551398 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 09:06:38.551398 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 09:06:38.551398 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 09:06:38.551398 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 09:06:38.551398 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 09:06:38.551398 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 09:06:38.551398 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 09:06:38.551398 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 09:06:38.551398 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 28 09:06:38.551398 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 28 09:06:38.551398 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 28 09:06:38.552536 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 28 09:06:38.552536 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 09:06:38.552536 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 09:06:38.552536 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 09:06:38.552536 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 09:06:38.552536 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 09:06:38.552536 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 09:06:38.552536 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 09:06:38.552536 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application with Lock( Jul 28 09:06:38.552536 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 09:06:38.552536 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return self._enter() Jul 28 09:06:38.552536 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 09:06:38.552536 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 09:06:38.552536 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 09:06:38.552536 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return self.creator() Jul 28 09:06:38.552536 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 09:06:38.552536 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application created_value = creator( Jul 28 09:06:38.553976 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 28 09:06:38.553976 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 28 09:06:38.553976 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 28 09:06:38.553976 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 28 09:06:38.553976 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 28 09:06:38.553976 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 28 09:06:38.553976 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 09:06:38.553976 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application Jul 28 09:06:38.553976 dv-cinder-851351-1-smb devstack@keystone.service[416294]: [pid: 416294|app: 0|req: 346/679] 10.222.0.42 () {56 vars in 1111 bytes} [Thu Jul 28 09:06:38 2022] GET /identity/v3/projects/service => generated 88 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 09:06:38.553976 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297b220f-dd8c-45e7-ad8f-db10959169c2 None admin] Authenticating user token {{(pid=416294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:06:38.582125 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c69a03-a305-4371-b327-b96fc19bf60a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:06:38.582673 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c69a03-a305-4371-b327-b96fc19bf60a None admin] REQUEST_METHOD: `GET` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:06:38.582957 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c69a03-a305-4371-b327-b96fc19bf60a None admin] SCRIPT_NAME: `/identity` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:06:38.583233 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c69a03-a305-4371-b327-b96fc19bf60a None admin] PATH_INFO: `/v3/roles` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:06:38.583980 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c69a03-a305-4371-b327-b96fc19bf60a None admin] RBAC: Adding query filter params (name=admin) {{(pid=416293) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 09:06:38.584264 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c69a03-a305-4371-b327-b96fc19bf60a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:06:38.585722 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c69a03-a305-4371-b327-b96fc19bf60a None admin] RBAC: Authorization granted {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:06:38.599528 dv-cinder-851351-1-smb devstack@keystone.service[416293]: [pid: 416293|app: 0|req: 334/680] 10.222.0.42 () {56 vars in 1099 bytes} [Thu Jul 28 09:06:38 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:06:38.599528 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c69a03-a305-4371-b327-b96fc19bf60a None admin] Authenticating user token {{(pid=416293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:06:38.623582 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG dbcounter [-] [416293] Writing DB stats keystone:SELECT=100 {{(pid=416293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:06:38.667160 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297b220f-dd8c-45e7-ad8f-db10959169c2 None admin] Validating token access rules against request {{(pid=416294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:06:38.707161 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52283ffe-387c-43a2-be7c-635ca0065050 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:06:38.707821 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52283ffe-387c-43a2-be7c-635ca0065050 None admin] REQUEST_METHOD: `GET` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:06:38.708110 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52283ffe-387c-43a2-be7c-635ca0065050 None admin] SCRIPT_NAME: `/identity` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:06:38.708396 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52283ffe-387c-43a2-be7c-635ca0065050 None admin] PATH_INFO: `/v3/projects` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:06:38.709222 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52283ffe-387c-43a2-be7c-635ca0065050 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=416294) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 09:06:38.709536 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52283ffe-387c-43a2-be7c-635ca0065050 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:06:38.710021 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c69a03-a305-4371-b327-b96fc19bf60a None admin] Validating token access rules against request {{(pid=416293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:06:38.711081 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52283ffe-387c-43a2-be7c-635ca0065050 None admin] RBAC: Authorization granted {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:06:38.730173 dv-cinder-851351-1-smb devstack@keystone.service[416294]: [pid: 416294|app: 0|req: 347/681] 10.222.0.42 () {56 vars in 1148 bytes} [Thu Jul 28 09:06:38 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:06:38.730173 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52283ffe-387c-43a2-be7c-635ca0065050 None admin] Authenticating user token {{(pid=416294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:06:38.754663 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0abcfa7-2498-4d87-b454-2ea7ce7245cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:06:38.755631 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0abcfa7-2498-4d87-b454-2ea7ce7245cc None admin] REQUEST_METHOD: `GET` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:06:38.756085 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0abcfa7-2498-4d87-b454-2ea7ce7245cc None admin] SCRIPT_NAME: `/identity` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:06:38.756365 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0abcfa7-2498-4d87-b454-2ea7ce7245cc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:06:38.766226 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG dbcounter [-] [416294] Writing DB stats keystone:SELECT=100 {{(pid=416294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:06:38.767964 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0abcfa7-2498-4d87-b454-2ea7ce7245cc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:06:38.769503 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0abcfa7-2498-4d87-b454-2ea7ce7245cc None admin] RBAC: Authorization granted {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:06:38.784604 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application [None req-f0abcfa7-2498-4d87-b454-2ea7ce7245cc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 09:06:38.784604 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 09:06:38.784604 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 09:06:38.784604 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 09:06:38.784604 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 09:06:38.784604 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 09:06:38.784604 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 09:06:38.784604 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 09:06:38.784604 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 09:06:38.784604 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 09:06:38.784604 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 09:06:38.784604 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 09:06:38.784604 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 09:06:38.784604 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 09:06:38.784604 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 09:06:38.785821 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 09:06:38.785821 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 09:06:38.785821 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 09:06:38.785821 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 09:06:38.785821 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 09:06:38.785821 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 09:06:38.785821 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 09:06:38.785821 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 09:06:38.785821 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application with Lock( Jul 28 09:06:38.785821 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 09:06:38.785821 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self._enter() Jul 28 09:06:38.785821 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 09:06:38.785821 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 09:06:38.785821 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 09:06:38.785821 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self.creator() Jul 28 09:06:38.785821 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 09:06:38.785821 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application created_value = creator( Jul 28 09:06:38.787158 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 09:06:38.787158 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 09:06:38.787158 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 09:06:38.787158 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application Jul 28 09:06:38.790844 dv-cinder-851351-1-smb devstack@keystone.service[416293]: [pid: 416293|app: 0|req: 335/682] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 09:06:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 09:06:38.791556 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0abcfa7-2498-4d87-b454-2ea7ce7245cc None admin] Authenticating user token {{(pid=416293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:06:38.847793 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52283ffe-387c-43a2-be7c-635ca0065050 None admin] Validating token access rules against request {{(pid=416294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:06:38.875605 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG dbcounter [-] [416293] Writing DB stats keystone:SELECT=100 {{(pid=416293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:06:38.883719 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9cf2419-3338-4488-a761-34d1e6015934 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:06:38.884355 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9cf2419-3338-4488-a761-34d1e6015934 None admin] REQUEST_METHOD: `GET` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:06:38.884649 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9cf2419-3338-4488-a761-34d1e6015934 None admin] SCRIPT_NAME: `/identity` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:06:38.884948 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9cf2419-3338-4488-a761-34d1e6015934 None admin] PATH_INFO: `/v3/projects` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:06:38.885709 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9cf2419-3338-4488-a761-34d1e6015934 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=416294) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 09:06:38.886018 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9cf2419-3338-4488-a761-34d1e6015934 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:06:38.887630 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9cf2419-3338-4488-a761-34d1e6015934 None admin] RBAC: Authorization granted {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:06:38.905459 dv-cinder-851351-1-smb devstack@keystone.service[416294]: [pid: 416294|app: 0|req: 348/683] 10.222.0.42 () {56 vars in 1148 bytes} [Thu Jul 28 09:06:38 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:06:38.905459 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9cf2419-3338-4488-a761-34d1e6015934 None admin] Authenticating user token {{(pid=416294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:06:38.918857 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0abcfa7-2498-4d87-b454-2ea7ce7245cc None admin] Validating token access rules against request {{(pid=416293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:06:38.958963 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe419916-30b8-4df9-baad-cd840cf26f30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:06:38.959917 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe419916-30b8-4df9-baad-cd840cf26f30 None admin] REQUEST_METHOD: `GET` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:06:38.960213 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe419916-30b8-4df9-baad-cd840cf26f30 None admin] SCRIPT_NAME: `/identity` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:06:38.960496 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe419916-30b8-4df9-baad-cd840cf26f30 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:06:38.973880 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe419916-30b8-4df9-baad-cd840cf26f30 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:06:38.975375 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe419916-30b8-4df9-baad-cd840cf26f30 None admin] RBAC: Authorization granted {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:06:38.991488 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application [None req-fe419916-30b8-4df9-baad-cd840cf26f30 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 09:06:38.991488 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 09:06:38.991488 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 09:06:38.991488 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 09:06:38.991488 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 09:06:38.991488 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 09:06:38.991488 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 09:06:38.991488 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 09:06:38.991488 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 09:06:38.991488 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 09:06:38.991488 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 09:06:38.991488 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 09:06:38.991488 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 09:06:38.991488 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 09:06:38.991488 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 09:06:38.992610 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 09:06:38.992610 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 09:06:38.992610 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 09:06:38.992610 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 09:06:38.992610 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 09:06:38.992610 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 09:06:38.992610 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 09:06:38.992610 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 09:06:38.992610 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application with Lock( Jul 28 09:06:38.992610 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 09:06:38.992610 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self._enter() Jul 28 09:06:38.992610 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 09:06:38.992610 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 09:06:38.992610 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 09:06:38.992610 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self.creator() Jul 28 09:06:38.992610 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 09:06:38.992610 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application created_value = creator( Jul 28 09:06:38.993736 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 09:06:38.993736 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 09:06:38.993736 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 09:06:38.993736 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application Jul 28 09:06:38.993736 dv-cinder-851351-1-smb devstack@keystone.service[416293]: [pid: 416293|app: 0|req: 336/684] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 09:06:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 09:06:38.993736 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe419916-30b8-4df9-baad-cd840cf26f30 None admin] Authenticating user token {{(pid=416293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:06:39.017005 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG dbcounter [-] [416294] Writing DB stats keystone:SELECT=100 {{(pid=416294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:06:39.027022 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9cf2419-3338-4488-a761-34d1e6015934 None admin] Validating token access rules against request {{(pid=416294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:06:39.065297 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3bc51e-5319-4439-ae71-b11b9cbdb60e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:06:39.066266 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3bc51e-5319-4439-ae71-b11b9cbdb60e None admin] REQUEST_METHOD: `GET` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:06:39.066733 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3bc51e-5319-4439-ae71-b11b9cbdb60e None admin] SCRIPT_NAME: `/identity` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:06:39.067159 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3bc51e-5319-4439-ae71-b11b9cbdb60e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:06:39.068143 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe3bc51e-5319-4439-ae71-b11b9cbdb60e None admin] RBAC: Adding query filter params (role.id=13417fbdbc5145a69bc01ff0f931fd96, scope.project.id=6c4349445f224184b093d9dfd0dfc642, user.id=1a6b3c06f2fb4c4c8b9089ca32caf7c5) {{(pid=416294) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 09:06:39.068594 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe3bc51e-5319-4439-ae71-b11b9cbdb60e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:06:39.070212 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe3bc51e-5319-4439-ae71-b11b9cbdb60e None admin] RBAC: Authorization granted {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:06:39.077263 dv-cinder-851351-1-smb devstack@keystone.service[416294]: [pid: 416294|app: 0|req: 349/685] 10.222.0.42 () {56 vars in 1374 bytes} [Thu Jul 28 09:06:38 2022] GET /identity/v3/role_assignments?user.id=1a6b3c06f2fb4c4c8b9089ca32caf7c5&scope.project.id=6c4349445f224184b093d9dfd0dfc642&role.id=13417fbdbc5145a69bc01ff0f931fd96 => generated 608 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:06:39.078379 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3bc51e-5319-4439-ae71-b11b9cbdb60e None admin] Authenticating user token {{(pid=416294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:06:39.121003 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe419916-30b8-4df9-baad-cd840cf26f30 None admin] Validating token access rules against request {{(pid=416293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:06:39.154704 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG dbcounter [-] [416293] Writing DB stats keystone:SELECT=100 {{(pid=416293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:06:39.169737 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e5b8e4-ca45-4949-bce7-702e8a04dfa7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:06:39.170684 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e5b8e4-ca45-4949-bce7-702e8a04dfa7 None admin] REQUEST_METHOD: `GET` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:06:39.171138 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e5b8e4-ca45-4949-bce7-702e8a04dfa7 None admin] SCRIPT_NAME: `/identity` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:06:39.171611 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e5b8e4-ca45-4949-bce7-702e8a04dfa7 None admin] PATH_INFO: `/v3/domains` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:06:39.172627 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5e5b8e4-ca45-4949-bce7-702e8a04dfa7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=416293) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 09:06:39.173185 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5e5b8e4-ca45-4949-bce7-702e8a04dfa7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:06:39.174822 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5e5b8e4-ca45-4949-bce7-702e8a04dfa7 None admin] RBAC: Authorization granted {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:06:39.190195 dv-cinder-851351-1-smb devstack@keystone.service[416293]: [pid: 416293|app: 0|req: 337/686] 10.222.0.42 () {56 vars in 1109 bytes} [Thu Jul 28 09:06:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:06:39.191500 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e5b8e4-ca45-4949-bce7-702e8a04dfa7 None admin] Authenticating user token {{(pid=416293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:06:39.238718 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3bc51e-5319-4439-ae71-b11b9cbdb60e None admin] Validating token access rules against request {{(pid=416294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:06:39.285407 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb7bf136-8b7a-480b-80b8-44875b85a685 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:06:39.286063 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7bf136-8b7a-480b-80b8-44875b85a685 None admin] REQUEST_METHOD: `GET` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:06:39.286347 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7bf136-8b7a-480b-80b8-44875b85a685 None admin] SCRIPT_NAME: `/identity` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:06:39.286688 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7bf136-8b7a-480b-80b8-44875b85a685 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:06:39.287627 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb7bf136-8b7a-480b-80b8-44875b85a685 None admin] RBAC: Adding query filter params (role.id=13417fbdbc5145a69bc01ff0f931fd96, scope.project.id=6c4349445f224184b093d9dfd0dfc642, user.id=4d16bdaefceb45c190e3cfdc2b5b29e1) {{(pid=416294) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 09:06:39.287794 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb7bf136-8b7a-480b-80b8-44875b85a685 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:06:39.289275 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb7bf136-8b7a-480b-80b8-44875b85a685 None admin] RBAC: Authorization granted {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:06:39.297556 dv-cinder-851351-1-smb devstack@keystone.service[416294]: [pid: 416294|app: 0|req: 350/687] 10.222.0.42 () {56 vars in 1374 bytes} [Thu Jul 28 09:06:39 2022] GET /identity/v3/role_assignments?user.id=4d16bdaefceb45c190e3cfdc2b5b29e1&scope.project.id=6c4349445f224184b093d9dfd0dfc642&role.id=13417fbdbc5145a69bc01ff0f931fd96 => generated 608 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:06:39.298490 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb7bf136-8b7a-480b-80b8-44875b85a685 None admin] Authenticating user token {{(pid=416294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:06:39.337896 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e5b8e4-ca45-4949-bce7-702e8a04dfa7 None admin] Validating token access rules against request {{(pid=416293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:06:39.340922 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG dbcounter [-] [416294] Writing DB stats keystone:SELECT=100 {{(pid=416294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:06:39.377840 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5093c5f-a66f-4693-900c-540ef7cac926 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:06:39.378420 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5093c5f-a66f-4693-900c-540ef7cac926 None admin] REQUEST_METHOD: `GET` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:06:39.378707 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5093c5f-a66f-4693-900c-540ef7cac926 None admin] SCRIPT_NAME: `/identity` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:06:39.378984 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5093c5f-a66f-4693-900c-540ef7cac926 None admin] PATH_INFO: `/v3/domains` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:06:39.379716 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5093c5f-a66f-4693-900c-540ef7cac926 None admin] RBAC: Adding query filter params (name=Default) {{(pid=416293) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 09:06:39.380028 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5093c5f-a66f-4693-900c-540ef7cac926 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:06:39.381524 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5093c5f-a66f-4693-900c-540ef7cac926 None admin] RBAC: Authorization granted {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:06:39.396013 dv-cinder-851351-1-smb devstack@keystone.service[416293]: [pid: 416293|app: 0|req: 338/688] 10.222.0.42 () {56 vars in 1109 bytes} [Thu Jul 28 09:06:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:06:39.402487 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5093c5f-a66f-4693-900c-540ef7cac926 None admin] Authenticating user token {{(pid=416293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:06:39.436964 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb7bf136-8b7a-480b-80b8-44875b85a685 None admin] Validating token access rules against request {{(pid=416294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:06:39.460136 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG dbcounter [-] [416293] Writing DB stats keystone:SELECT=100 {{(pid=416293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:06:39.483629 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc2fb19-feb6-47b8-bfd3-62608e701fb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:06:39.484646 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc2fb19-feb6-47b8-bfd3-62608e701fb6 None admin] REQUEST_METHOD: `GET` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:06:39.485267 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc2fb19-feb6-47b8-bfd3-62608e701fb6 None admin] SCRIPT_NAME: `/identity` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:06:39.485795 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc2fb19-feb6-47b8-bfd3-62608e701fb6 None admin] PATH_INFO: `/v3/users/swift` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:06:39.495816 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afc2fb19-feb6-47b8-bfd3-62608e701fb6 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:06:39.497874 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afc2fb19-feb6-47b8-bfd3-62608e701fb6 None admin] RBAC: Authorization granted {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:06:39.513755 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application [None req-afc2fb19-feb6-47b8-bfd3-62608e701fb6 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 28 09:06:39.513755 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 09:06:39.513755 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 09:06:39.513755 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 09:06:39.513755 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 09:06:39.513755 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 09:06:39.513755 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 09:06:39.513755 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 09:06:39.513755 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 09:06:39.513755 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 09:06:39.513755 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 09:06:39.513755 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 09:06:39.513755 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 28 09:06:39.513755 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 28 09:06:39.513755 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 28 09:06:39.513755 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 28 09:06:39.514888 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 09:06:39.514888 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 09:06:39.514888 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 28 09:06:39.514888 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 09:06:39.514888 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 28 09:06:39.514888 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 09:06:39.514888 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 09:06:39.514888 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 09:06:39.514888 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 09:06:39.514888 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 09:06:39.514888 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 09:06:39.514888 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application with Lock( Jul 28 09:06:39.514888 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 09:06:39.514888 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return self._enter() Jul 28 09:06:39.514888 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 09:06:39.514888 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 09:06:39.514888 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 09:06:39.514888 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return self.creator() Jul 28 09:06:39.516058 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 09:06:39.516058 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application created_value = creator( Jul 28 09:06:39.516058 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 28 09:06:39.516058 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 28 09:06:39.516058 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 28 09:06:39.516058 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 28 09:06:39.516058 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 28 09:06:39.516058 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 28 09:06:39.516058 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 28 09:06:39.516058 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application Jul 28 09:06:39.519143 dv-cinder-851351-1-smb devstack@keystone.service[416294]: [pid: 416294|app: 0|req: 351/689] 10.222.0.42 () {56 vars in 1096 bytes} [Thu Jul 28 09:06:39 2022] GET /identity/v3/users/swift => generated 83 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 09:06:39.526897 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc2fb19-feb6-47b8-bfd3-62608e701fb6 None admin] Authenticating user token {{(pid=416294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:06:39.538188 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5093c5f-a66f-4693-900c-540ef7cac926 None admin] Validating token access rules against request {{(pid=416293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:06:39.585358 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486d6c1a-b461-43fc-97a6-0914358d03e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:06:39.586502 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486d6c1a-b461-43fc-97a6-0914358d03e5 None admin] REQUEST_METHOD: `GET` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:06:39.587017 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486d6c1a-b461-43fc-97a6-0914358d03e5 None admin] SCRIPT_NAME: `/identity` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:06:39.587721 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486d6c1a-b461-43fc-97a6-0914358d03e5 None admin] PATH_INFO: `/v3/users/nova` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:06:39.597382 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-486d6c1a-b461-43fc-97a6-0914358d03e5 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:06:39.599350 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-486d6c1a-b461-43fc-97a6-0914358d03e5 None admin] RBAC: Authorization granted {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:06:39.613250 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application [None req-486d6c1a-b461-43fc-97a6-0914358d03e5 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 28 09:06:39.613250 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 09:06:39.613250 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 09:06:39.613250 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 09:06:39.613250 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 09:06:39.613250 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 09:06:39.613250 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 09:06:39.613250 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 09:06:39.613250 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 09:06:39.613250 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 09:06:39.613250 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 09:06:39.613250 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 09:06:39.613250 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 28 09:06:39.613250 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 28 09:06:39.613250 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 28 09:06:39.613250 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 28 09:06:39.614355 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 09:06:39.614355 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 09:06:39.614355 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 28 09:06:39.614355 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 09:06:39.614355 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 28 09:06:39.614355 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 09:06:39.614355 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 09:06:39.614355 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 09:06:39.614355 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 09:06:39.614355 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 09:06:39.614355 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 09:06:39.614355 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application with Lock( Jul 28 09:06:39.614355 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 09:06:39.614355 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self._enter() Jul 28 09:06:39.614355 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 09:06:39.614355 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 09:06:39.614355 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 09:06:39.614355 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self.creator() Jul 28 09:06:39.615382 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 09:06:39.615382 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application created_value = creator( Jul 28 09:06:39.615382 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 28 09:06:39.615382 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 28 09:06:39.615382 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 28 09:06:39.615382 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 28 09:06:39.615382 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 28 09:06:39.615382 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 28 09:06:39.615382 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 28 09:06:39.615382 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application Jul 28 09:06:39.618481 dv-cinder-851351-1-smb devstack@keystone.service[416293]: [pid: 416293|app: 0|req: 339/690] 10.222.0.42 () {56 vars in 1093 bytes} [Thu Jul 28 09:06:39 2022] GET /identity/v3/users/nova => generated 82 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 09:06:39.623851 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486d6c1a-b461-43fc-97a6-0914358d03e5 None admin] Authenticating user token {{(pid=416293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:06:39.651031 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG dbcounter [-] [416294] Writing DB stats keystone:SELECT=100 {{(pid=416294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:06:39.682444 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc2fb19-feb6-47b8-bfd3-62608e701fb6 None admin] Validating token access rules against request {{(pid=416294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:06:39.739107 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f1f7724-9a28-4bbb-8a7f-37d79a82d5e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:06:39.740527 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1f7724-9a28-4bbb-8a7f-37d79a82d5e9 None admin] REQUEST_METHOD: `GET` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:06:39.740885 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1f7724-9a28-4bbb-8a7f-37d79a82d5e9 None admin] SCRIPT_NAME: `/identity` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:06:39.741557 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1f7724-9a28-4bbb-8a7f-37d79a82d5e9 None admin] PATH_INFO: `/v3/users` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:06:39.742408 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f1f7724-9a28-4bbb-8a7f-37d79a82d5e9 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=416294) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 09:06:39.742710 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f1f7724-9a28-4bbb-8a7f-37d79a82d5e9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:06:39.745768 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f1f7724-9a28-4bbb-8a7f-37d79a82d5e9 None admin] RBAC: Authorization granted {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:06:39.766227 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486d6c1a-b461-43fc-97a6-0914358d03e5 None admin] Validating token access rules against request {{(pid=416293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:06:39.766449 dv-cinder-851351-1-smb devstack@keystone.service[416294]: [pid: 416294|app: 0|req: 352/691] 10.222.0.42 () {56 vars in 1135 bytes} [Thu Jul 28 09:06:39 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:06:39.768792 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec48d288-b623-4497-b28d-eb442b3e8eb2 None None] REQUEST_METHOD: `GET` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:06:39.768792 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec48d288-b623-4497-b28d-eb442b3e8eb2 None None] SCRIPT_NAME: `/identity` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:06:39.768792 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec48d288-b623-4497-b28d-eb442b3e8eb2 None None] PATH_INFO: `/` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:06:39.774458 dv-cinder-851351-1-smb devstack@keystone.service[416294]: [pid: 416294|app: 0|req: 353/692] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 09:06:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 09:06:39.775665 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG dbcounter [-] [416293] Writing DB stats keystone:SELECT=100 {{(pid=416293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:06:39.775796 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec48d288-b623-4497-b28d-eb442b3e8eb2 None None] Authenticating user token {{(pid=416294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:06:39.817146 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84b380e-83d6-4463-bc8f-4afa717b66cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:06:39.818318 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84b380e-83d6-4463-bc8f-4afa717b66cb None admin] REQUEST_METHOD: `GET` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:06:39.818614 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84b380e-83d6-4463-bc8f-4afa717b66cb None admin] SCRIPT_NAME: `/identity` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:06:39.818894 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84b380e-83d6-4463-bc8f-4afa717b66cb None admin] PATH_INFO: `/v3/users` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:06:39.819714 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f84b380e-83d6-4463-bc8f-4afa717b66cb None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=416293) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 09:06:39.820028 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f84b380e-83d6-4463-bc8f-4afa717b66cb None admin] RBAC: Authorizing `identity:list_users()` {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:06:39.822200 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f84b380e-83d6-4463-bc8f-4afa717b66cb None admin] RBAC: Authorization granted {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:06:39.846763 dv-cinder-851351-1-smb devstack@keystone.service[416293]: [pid: 416293|app: 0|req: 340/693] 10.222.0.42 () {56 vars in 1133 bytes} [Thu Jul 28 09:06:39 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 09:06:39.848810 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc1c0fb-5a07-4a0f-b4f2-ece518423986 None None] REQUEST_METHOD: `POST` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:06:39.849118 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc1c0fb-5a07-4a0f-b4f2-ece518423986 None None] SCRIPT_NAME: `/identity` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:06:39.849406 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc1c0fb-5a07-4a0f-b4f2-ece518423986 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:06:39.873492 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.auth.core [None req-dcc1c0fb-5a07-4a0f-b4f2-ece518423986 None None] MFA Rules not processed for user `dbf87abab90e4fdf9e75408f4199918e`. Rule list: `[]` (Enabled: `True`). {{(pid=416293) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 09:06:39.874831 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.fernet_utils [None req-dcc1c0fb-5a07-4a0f-b4f2-ece518423986 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=416293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 09:06:39.924105 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec48d288-b623-4497-b28d-eb442b3e8eb2 None None] Validating token access rules against request {{(pid=416294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:06:39.956488 dv-cinder-851351-1-smb devstack@keystone.service[416293]: [pid: 416293|app: 0|req: 341/694] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 09:06:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 09:06:39.957632 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc1c0fb-5a07-4a0f-b4f2-ece518423986 None None] Authenticating user token {{(pid=416293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:06:39.985584 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09cb4ba-d474-46e8-8307-07414552d814 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:06:39.986686 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09cb4ba-d474-46e8-8307-07414552d814 None admin] REQUEST_METHOD: `GET` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:06:39.987460 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09cb4ba-d474-46e8-8307-07414552d814 None admin] SCRIPT_NAME: `/identity` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:06:39.987921 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09cb4ba-d474-46e8-8307-07414552d814 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:06:40.005698 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG dbcounter [-] [416294] Writing DB stats keystone:SELECT=100 {{(pid=416294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:06:40.086909 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b09cb4ba-d474-46e8-8307-07414552d814 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:06:40.088885 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b09cb4ba-d474-46e8-8307-07414552d814 None admin] RBAC: Authorization granted {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:06:40.111888 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG dbcounter [-] [416293] Writing DB stats keystone:SELECT=100 {{(pid=416293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:06:40.127075 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc1c0fb-5a07-4a0f-b4f2-ece518423986 None None] Validating token access rules against request {{(pid=416293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:06:40.173560 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f6f76c-556c-4622-a9e4-4d2d46321099 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:06:40.174656 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f6f76c-556c-4622-a9e4-4d2d46321099 None admin] REQUEST_METHOD: `GET` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:06:40.175119 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f6f76c-556c-4622-a9e4-4d2d46321099 None admin] SCRIPT_NAME: `/identity` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:06:40.175555 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f6f76c-556c-4622-a9e4-4d2d46321099 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:06:40.216407 dv-cinder-851351-1-smb devstack@keystone.service[416294]: [pid: 416294|app: 0|req: 354/695] 10.222.0.42 () {58 vars in 1282 bytes} [Thu Jul 28 09:06:39 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 441 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 28 09:06:40.217868 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09cb4ba-d474-46e8-8307-07414552d814 None admin] Authenticating user token {{(pid=416294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:06:40.266441 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG dbcounter [-] [416294] Writing DB stats keystone:SELECT=100 {{(pid=416294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:06:40.272840 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f6f76c-556c-4622-a9e4-4d2d46321099 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:06:40.275828 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f6f76c-556c-4622-a9e4-4d2d46321099 None admin] RBAC: Authorization granted {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:06:40.346617 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09cb4ba-d474-46e8-8307-07414552d814 None admin] Validating token access rules against request {{(pid=416294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:06:40.384188 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG dbcounter [-] [416293] Writing DB stats keystone:SELECT=100 {{(pid=416293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:06:40.396602 dv-cinder-851351-1-smb devstack@keystone.service[416293]: [pid: 416293|app: 0|req: 342/696] 10.222.0.42 () {58 vars in 1282 bytes} [Thu Jul 28 09:06:39 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 439 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 28 09:06:40.398073 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f6f76c-556c-4622-a9e4-4d2d46321099 None admin] Authenticating user token {{(pid=416293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:06:40.407013 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3fd029-09cf-4a67-a3cf-24f35f2cdf82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:06:40.408155 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3fd029-09cf-4a67-a3cf-24f35f2cdf82 None admin] REQUEST_METHOD: `GET` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:06:40.409234 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3fd029-09cf-4a67-a3cf-24f35f2cdf82 None admin] SCRIPT_NAME: `/identity` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:06:40.409705 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3fd029-09cf-4a67-a3cf-24f35f2cdf82 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:06:40.410526 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a3fd029-09cf-4a67-a3cf-24f35f2cdf82 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:06:40.412898 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a3fd029-09cf-4a67-a3cf-24f35f2cdf82 None admin] RBAC: Authorization granted {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:06:40.428583 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application [None req-9a3fd029-09cf-4a67-a3cf-24f35f2cdf82 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 28 09:06:40.428583 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 09:06:40.428583 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 28 09:06:40.428583 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 28 09:06:40.428583 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 28 09:06:40.428583 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 28 09:06:40.428583 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 28 09:06:40.428583 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 09:06:40.428583 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 28 09:06:40.428583 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application Jul 28 09:06:40.428583 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 28 09:06:40.428583 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application Jul 28 09:06:40.428583 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 09:06:40.428583 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 09:06:40.428583 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 09:06:40.428583 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 09:06:40.430035 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 09:06:40.430035 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 09:06:40.430035 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 09:06:40.430035 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 09:06:40.430035 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 09:06:40.430035 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 09:06:40.430035 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 09:06:40.430035 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 28 09:06:40.430035 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 28 09:06:40.430035 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 28 09:06:40.430035 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 28 09:06:40.430035 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 09:06:40.430035 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 09:06:40.430035 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 09:06:40.430035 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 09:06:40.430035 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 09:06:40.431197 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 09:06:40.431197 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 09:06:40.431197 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application with Lock( Jul 28 09:06:40.431197 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 09:06:40.431197 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return self._enter() Jul 28 09:06:40.431197 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 09:06:40.431197 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 09:06:40.431197 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 09:06:40.431197 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return self.creator() Jul 28 09:06:40.431197 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 09:06:40.431197 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application created_value = creator( Jul 28 09:06:40.431197 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 28 09:06:40.431197 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 09:06:40.431197 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 28 09:06:40.431197 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application Jul 28 09:06:40.433861 dv-cinder-851351-1-smb devstack@keystone.service[416294]: [pid: 416294|app: 0|req: 355/697] 10.222.0.42 () {56 vars in 1129 bytes} [Thu Jul 28 09:06:40 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 09:06:40.435009 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3fd029-09cf-4a67-a3cf-24f35f2cdf82 None admin] Authenticating user token {{(pid=416294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:06:40.538434 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f6f76c-556c-4622-a9e4-4d2d46321099 None admin] Validating token access rules against request {{(pid=416293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:06:40.563020 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3fd029-09cf-4a67-a3cf-24f35f2cdf82 None admin] Validating token access rules against request {{(pid=416294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:06:40.566900 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG dbcounter [-] [416294] Writing DB stats keystone:SELECT=100 {{(pid=416294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:06:40.592569 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00a4a34-067a-4766-806d-8a1bfb36aafe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:06:40.593290 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00a4a34-067a-4766-806d-8a1bfb36aafe None admin] REQUEST_METHOD: `GET` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:06:40.593630 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00a4a34-067a-4766-806d-8a1bfb36aafe None admin] SCRIPT_NAME: `/identity` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:06:40.593918 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00a4a34-067a-4766-806d-8a1bfb36aafe None admin] PATH_INFO: `/v3/domains/Default` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:06:40.606755 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f00a4a34-067a-4766-806d-8a1bfb36aafe None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:06:40.608194 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de98b611-72d0-4d82-9308-23363b477b4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:06:40.608500 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f00a4a34-067a-4766-806d-8a1bfb36aafe None admin] RBAC: Authorization granted {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:06:40.609342 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de98b611-72d0-4d82-9308-23363b477b4a None admin] REQUEST_METHOD: `GET` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:06:40.609801 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de98b611-72d0-4d82-9308-23363b477b4a None admin] SCRIPT_NAME: `/identity` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:06:40.610252 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de98b611-72d0-4d82-9308-23363b477b4a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:06:40.622821 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de98b611-72d0-4d82-9308-23363b477b4a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:06:40.624722 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de98b611-72d0-4d82-9308-23363b477b4a None admin] RBAC: Authorization granted {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:06:40.626841 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application [None req-f00a4a34-067a-4766-806d-8a1bfb36aafe None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 09:06:40.626841 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 09:06:40.626841 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 09:06:40.626841 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 09:06:40.626841 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 09:06:40.626841 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 09:06:40.626841 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 09:06:40.626841 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 09:06:40.626841 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 09:06:40.626841 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 09:06:40.626841 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 09:06:40.626841 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 09:06:40.626841 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 09:06:40.626841 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 09:06:40.626841 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 09:06:40.628010 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 09:06:40.628010 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 09:06:40.628010 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 09:06:40.628010 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 09:06:40.628010 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 09:06:40.628010 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 09:06:40.628010 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 09:06:40.628010 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 09:06:40.628010 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application with Lock( Jul 28 09:06:40.628010 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 09:06:40.628010 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self._enter() Jul 28 09:06:40.628010 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 09:06:40.628010 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 09:06:40.628010 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 09:06:40.628010 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self.creator() Jul 28 09:06:40.628010 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 09:06:40.628010 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application created_value = creator( Jul 28 09:06:40.629276 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 09:06:40.629276 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 09:06:40.629276 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 09:06:40.629276 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application Jul 28 09:06:40.629276 dv-cinder-851351-1-smb devstack@keystone.service[416293]: [pid: 416293|app: 0|req: 343/698] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 09:06:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 09:06:40.629276 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00a4a34-067a-4766-806d-8a1bfb36aafe None admin] Authenticating user token {{(pid=416293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:06:40.649335 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application [None req-de98b611-72d0-4d82-9308-23363b477b4a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 09:06:40.649335 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 09:06:40.649335 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 09:06:40.649335 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 09:06:40.649335 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 09:06:40.649335 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 09:06:40.649335 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 09:06:40.649335 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 09:06:40.649335 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 09:06:40.649335 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 09:06:40.649335 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 09:06:40.649335 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 09:06:40.649335 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 09:06:40.649335 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 09:06:40.649335 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 09:06:40.650606 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 09:06:40.650606 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 09:06:40.650606 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 09:06:40.650606 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 09:06:40.650606 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 09:06:40.650606 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 09:06:40.650606 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 09:06:40.650606 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 09:06:40.650606 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application with Lock( Jul 28 09:06:40.650606 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 09:06:40.650606 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return self._enter() Jul 28 09:06:40.650606 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 09:06:40.650606 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 09:06:40.650606 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 09:06:40.650606 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return self.creator() Jul 28 09:06:40.650606 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 09:06:40.650606 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application created_value = creator( Jul 28 09:06:40.651740 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 09:06:40.651740 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 09:06:40.651740 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 09:06:40.651740 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application Jul 28 09:06:40.653894 dv-cinder-851351-1-smb devstack@keystone.service[416294]: [pid: 416294|app: 0|req: 356/699] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 09:06:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 09:06:40.655042 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de98b611-72d0-4d82-9308-23363b477b4a None admin] Authenticating user token {{(pid=416294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:06:40.694516 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG dbcounter [-] [416293] Writing DB stats keystone:SELECT=100 {{(pid=416293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:06:40.774042 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00a4a34-067a-4766-806d-8a1bfb36aafe None admin] Validating token access rules against request {{(pid=416293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:06:40.810156 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de98b611-72d0-4d82-9308-23363b477b4a None admin] Validating token access rules against request {{(pid=416294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:06:40.822036 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e6a2e6-b532-47f6-b71b-2dd4918c9459 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:06:40.822427 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e6a2e6-b532-47f6-b71b-2dd4918c9459 None admin] REQUEST_METHOD: `GET` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:06:40.822722 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e6a2e6-b532-47f6-b71b-2dd4918c9459 None admin] SCRIPT_NAME: `/identity` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:06:40.823004 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e6a2e6-b532-47f6-b71b-2dd4918c9459 None admin] PATH_INFO: `/v3/services` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:06:40.824077 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e6a2e6-b532-47f6-b71b-2dd4918c9459 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=416293) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 09:06:40.824390 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e6a2e6-b532-47f6-b71b-2dd4918c9459 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:06:40.826068 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e6a2e6-b532-47f6-b71b-2dd4918c9459 None admin] RBAC: Authorization granted {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:06:40.836823 dv-cinder-851351-1-smb devstack@keystone.service[416293]: [pid: 416293|app: 0|req: 344/700] 10.222.0.42 () {56 vars in 1124 bytes} [Thu Jul 28 09:06:40 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:06:40.837925 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e6a2e6-b532-47f6-b71b-2dd4918c9459 None admin] Authenticating user token {{(pid=416293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:06:40.852230 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be8750a-bd90-4a3f-abd5-3cc6a6bdb016 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:06:40.853267 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be8750a-bd90-4a3f-abd5-3cc6a6bdb016 None admin] REQUEST_METHOD: `GET` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:06:40.853872 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be8750a-bd90-4a3f-abd5-3cc6a6bdb016 None admin] SCRIPT_NAME: `/identity` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:06:40.854377 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be8750a-bd90-4a3f-abd5-3cc6a6bdb016 None admin] PATH_INFO: `/v3/domains` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:06:40.855273 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2be8750a-bd90-4a3f-abd5-3cc6a6bdb016 None admin] RBAC: Adding query filter params (name=Default) {{(pid=416294) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 09:06:40.855772 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2be8750a-bd90-4a3f-abd5-3cc6a6bdb016 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:06:40.857388 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2be8750a-bd90-4a3f-abd5-3cc6a6bdb016 None admin] RBAC: Authorization granted {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:06:40.870824 dv-cinder-851351-1-smb devstack@keystone.service[416294]: [pid: 416294|app: 0|req: 357/701] 10.222.0.42 () {56 vars in 1109 bytes} [Thu Jul 28 09:06:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:06:40.872168 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be8750a-bd90-4a3f-abd5-3cc6a6bdb016 None admin] Authenticating user token {{(pid=416294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:06:40.893698 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG dbcounter [-] [416294] Writing DB stats keystone:SELECT=100 {{(pid=416294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:06:40.957082 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e6a2e6-b532-47f6-b71b-2dd4918c9459 None admin] Validating token access rules against request {{(pid=416293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:06:40.968284 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG dbcounter [-] [416293] Writing DB stats keystone:SELECT=100 {{(pid=416293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:06:40.999940 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be8750a-bd90-4a3f-abd5-3cc6a6bdb016 None admin] Validating token access rules against request {{(pid=416294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:06:41.005987 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55455e97-953c-4cbf-89de-8f02dc733f36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:06:41.006650 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55455e97-953c-4cbf-89de-8f02dc733f36 None admin] REQUEST_METHOD: `GET` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:06:41.006941 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55455e97-953c-4cbf-89de-8f02dc733f36 None admin] SCRIPT_NAME: `/identity` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:06:41.007226 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55455e97-953c-4cbf-89de-8f02dc733f36 None admin] PATH_INFO: `/v3/domains` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:06:41.007949 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55455e97-953c-4cbf-89de-8f02dc733f36 None admin] RBAC: Adding query filter params (name=Default) {{(pid=416293) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 09:06:41.008262 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55455e97-953c-4cbf-89de-8f02dc733f36 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:06:41.009712 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55455e97-953c-4cbf-89de-8f02dc733f36 None admin] RBAC: Authorization granted {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:06:41.028703 dv-cinder-851351-1-smb devstack@keystone.service[416293]: [pid: 416293|app: 0|req: 345/702] 10.222.0.42 () {56 vars in 1109 bytes} [Thu Jul 28 09:06:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:06:41.030057 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55455e97-953c-4cbf-89de-8f02dc733f36 None admin] Authenticating user token {{(pid=416293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:06:41.042590 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c336ec3b-0f37-4741-95ee-d061c1309c77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:06:41.043682 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c336ec3b-0f37-4741-95ee-d061c1309c77 None admin] REQUEST_METHOD: `GET` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:06:41.044235 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c336ec3b-0f37-4741-95ee-d061c1309c77 None admin] SCRIPT_NAME: `/identity` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:06:41.044756 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c336ec3b-0f37-4741-95ee-d061c1309c77 None admin] PATH_INFO: `/v3/services` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:06:41.045774 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c336ec3b-0f37-4741-95ee-d061c1309c77 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=416294) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 09:06:41.046345 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c336ec3b-0f37-4741-95ee-d061c1309c77 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:06:41.048036 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c336ec3b-0f37-4741-95ee-d061c1309c77 None admin] RBAC: Authorization granted {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:06:41.055538 dv-cinder-851351-1-smb devstack@keystone.service[416294]: [pid: 416294|app: 0|req: 358/703] 10.222.0.42 () {56 vars in 1124 bytes} [Thu Jul 28 09:06:40 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:06:41.056841 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c336ec3b-0f37-4741-95ee-d061c1309c77 None admin] Authenticating user token {{(pid=416294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:06:41.215704 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55455e97-953c-4cbf-89de-8f02dc733f36 None admin] Validating token access rules against request {{(pid=416293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:06:41.269429 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG dbcounter [-] [416294] Writing DB stats keystone:SELECT=100 {{(pid=416294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:06:41.297582 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124e841f-498e-464f-a62e-46c9d6e99dad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:06:41.298952 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124e841f-498e-464f-a62e-46c9d6e99dad None admin] REQUEST_METHOD: `GET` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:06:41.299434 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124e841f-498e-464f-a62e-46c9d6e99dad None admin] SCRIPT_NAME: `/identity` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:06:41.299927 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124e841f-498e-464f-a62e-46c9d6e99dad None admin] PATH_INFO: `/v3/projects/service` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:06:41.300393 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c336ec3b-0f37-4741-95ee-d061c1309c77 None admin] Validating token access rules against request {{(pid=416294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:06:41.309767 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-124e841f-498e-464f-a62e-46c9d6e99dad None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:06:41.312334 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-124e841f-498e-464f-a62e-46c9d6e99dad None admin] RBAC: Authorization granted {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:06:41.329941 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application [None req-124e841f-498e-464f-a62e-46c9d6e99dad None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 09:06:41.329941 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 09:06:41.329941 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 09:06:41.329941 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 09:06:41.329941 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 09:06:41.329941 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 09:06:41.329941 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 09:06:41.329941 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 09:06:41.329941 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 09:06:41.329941 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 09:06:41.329941 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 09:06:41.329941 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 09:06:41.329941 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 28 09:06:41.329941 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 28 09:06:41.329941 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 28 09:06:41.331001 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 28 09:06:41.331001 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 09:06:41.331001 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 09:06:41.331001 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 09:06:41.331001 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 09:06:41.331001 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 09:06:41.331001 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 09:06:41.331001 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 09:06:41.331001 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application with Lock( Jul 28 09:06:41.331001 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 09:06:41.331001 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self._enter() Jul 28 09:06:41.331001 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 09:06:41.331001 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 09:06:41.331001 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 09:06:41.331001 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self.creator() Jul 28 09:06:41.331001 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 09:06:41.331001 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application created_value = creator( Jul 28 09:06:41.331980 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 28 09:06:41.331980 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 28 09:06:41.331980 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 28 09:06:41.331980 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 28 09:06:41.331980 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 28 09:06:41.331980 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 28 09:06:41.331980 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 09:06:41.331980 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application Jul 28 09:06:41.335393 dv-cinder-851351-1-smb devstack@keystone.service[416293]: [pid: 416293|app: 0|req: 346/704] 10.222.0.42 () {56 vars in 1111 bytes} [Thu Jul 28 09:06:41 2022] GET /identity/v3/projects/service => generated 88 bytes in 306 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 09:06:41.342540 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124e841f-498e-464f-a62e-46c9d6e99dad None admin] Authenticating user token {{(pid=416293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:06:41.350447 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebbb89fe-963b-4bf1-ad95-8ec2816433aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:06:41.351273 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebbb89fe-963b-4bf1-ad95-8ec2816433aa None admin] REQUEST_METHOD: `GET` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:06:41.351667 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebbb89fe-963b-4bf1-ad95-8ec2816433aa None admin] SCRIPT_NAME: `/identity` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:06:41.351953 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebbb89fe-963b-4bf1-ad95-8ec2816433aa None admin] PATH_INFO: `/v3/projects/service` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:06:41.361780 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebbb89fe-963b-4bf1-ad95-8ec2816433aa None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:06:41.363455 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebbb89fe-963b-4bf1-ad95-8ec2816433aa None admin] RBAC: Authorization granted {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:06:41.376524 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application [None req-ebbb89fe-963b-4bf1-ad95-8ec2816433aa None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 09:06:41.376524 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 09:06:41.376524 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 09:06:41.376524 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 09:06:41.376524 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 09:06:41.376524 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 09:06:41.376524 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 09:06:41.376524 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 09:06:41.376524 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 09:06:41.376524 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 09:06:41.376524 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 09:06:41.376524 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 09:06:41.376524 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 28 09:06:41.376524 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 28 09:06:41.376524 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 28 09:06:41.377810 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 28 09:06:41.377810 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 09:06:41.377810 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 09:06:41.377810 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 09:06:41.377810 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 09:06:41.377810 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 09:06:41.377810 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 09:06:41.377810 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 09:06:41.377810 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application with Lock( Jul 28 09:06:41.377810 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 09:06:41.377810 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return self._enter() Jul 28 09:06:41.377810 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 09:06:41.377810 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 09:06:41.377810 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 09:06:41.377810 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return self.creator() Jul 28 09:06:41.377810 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 09:06:41.377810 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application created_value = creator( Jul 28 09:06:41.379038 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 28 09:06:41.379038 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 28 09:06:41.379038 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 28 09:06:41.379038 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 28 09:06:41.379038 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 28 09:06:41.379038 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 28 09:06:41.379038 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 09:06:41.379038 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application Jul 28 09:06:41.382849 dv-cinder-851351-1-smb devstack@keystone.service[416294]: [pid: 416294|app: 0|req: 359/705] 10.222.0.42 () {56 vars in 1111 bytes} [Thu Jul 28 09:06:41 2022] GET /identity/v3/projects/service => generated 88 bytes in 326 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 09:06:41.383818 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebbb89fe-963b-4bf1-ad95-8ec2816433aa None admin] Authenticating user token {{(pid=416294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:06:41.402559 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG dbcounter [-] [416293] Writing DB stats keystone:SELECT=100 {{(pid=416293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:06:41.504816 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebbb89fe-963b-4bf1-ad95-8ec2816433aa None admin] Validating token access rules against request {{(pid=416294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:06:41.544701 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dabfcf97-bd67-49e4-ada4-9855592940e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:06:41.544701 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabfcf97-bd67-49e4-ada4-9855592940e3 None admin] REQUEST_METHOD: `GET` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:06:41.544701 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabfcf97-bd67-49e4-ada4-9855592940e3 None admin] SCRIPT_NAME: `/identity` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:06:41.544701 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabfcf97-bd67-49e4-ada4-9855592940e3 None admin] PATH_INFO: `/v3/projects` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:06:41.545222 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dabfcf97-bd67-49e4-ada4-9855592940e3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=416294) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 09:06:41.545222 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dabfcf97-bd67-49e4-ada4-9855592940e3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:06:41.545222 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dabfcf97-bd67-49e4-ada4-9855592940e3 None admin] RBAC: Authorization granted {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:06:41.550770 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124e841f-498e-464f-a62e-46c9d6e99dad None admin] Validating token access rules against request {{(pid=416293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:06:41.561061 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG dbcounter [-] [416294] Writing DB stats keystone:SELECT=100 {{(pid=416294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:06:41.566236 dv-cinder-851351-1-smb devstack@keystone.service[416294]: [pid: 416294|app: 0|req: 360/706] 10.222.0.42 () {56 vars in 1148 bytes} [Thu Jul 28 09:06:41 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 09:06:41.567988 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dabfcf97-bd67-49e4-ada4-9855592940e3 None admin] Authenticating user token {{(pid=416294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:06:41.637462 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79754e0b-ec87-4886-987a-b8f9e95e3ced None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:06:41.638464 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79754e0b-ec87-4886-987a-b8f9e95e3ced None admin] REQUEST_METHOD: `GET` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:06:41.638931 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79754e0b-ec87-4886-987a-b8f9e95e3ced None admin] SCRIPT_NAME: `/identity` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:06:41.639367 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79754e0b-ec87-4886-987a-b8f9e95e3ced None admin] PATH_INFO: `/v3/projects` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:06:41.640306 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79754e0b-ec87-4886-987a-b8f9e95e3ced None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=416293) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 09:06:41.640823 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79754e0b-ec87-4886-987a-b8f9e95e3ced None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:06:41.642572 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79754e0b-ec87-4886-987a-b8f9e95e3ced None admin] RBAC: Authorization granted {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:06:41.670089 dv-cinder-851351-1-smb devstack@keystone.service[416293]: [pid: 416293|app: 0|req: 347/707] 10.222.0.42 () {56 vars in 1148 bytes} [Thu Jul 28 09:06:41 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 325 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 09:06:41.671390 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79754e0b-ec87-4886-987a-b8f9e95e3ced None admin] Authenticating user token {{(pid=416293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:06:41.685818 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dabfcf97-bd67-49e4-ada4-9855592940e3 None admin] Validating token access rules against request {{(pid=416294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:06:41.723706 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d0029d-f819-43e4-b47e-82400b72b2af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:06:41.724363 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d0029d-f819-43e4-b47e-82400b72b2af None admin] REQUEST_METHOD: `GET` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:06:41.724687 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d0029d-f819-43e4-b47e-82400b72b2af None admin] SCRIPT_NAME: `/identity` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:06:41.725354 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d0029d-f819-43e4-b47e-82400b72b2af None admin] PATH_INFO: `/v3/role_assignments` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:06:41.726184 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d0029d-f819-43e4-b47e-82400b72b2af None admin] RBAC: Adding query filter params (role.id=c67085ec338243df8f9b7d6459036e23, scope.project.id=6c4349445f224184b093d9dfd0dfc642, user.id=62f7da38a7044000bdf5790da751a45e) {{(pid=416294) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 09:06:41.726507 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d0029d-f819-43e4-b47e-82400b72b2af None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:06:41.728003 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d0029d-f819-43e4-b47e-82400b72b2af None admin] RBAC: Authorization granted {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:06:41.734930 dv-cinder-851351-1-smb devstack@keystone.service[416294]: [pid: 416294|app: 0|req: 361/708] 10.222.0.42 () {56 vars in 1374 bytes} [Thu Jul 28 09:06:41 2022] GET /identity/v3/role_assignments?user.id=62f7da38a7044000bdf5790da751a45e&scope.project.id=6c4349445f224184b093d9dfd0dfc642&role.id=c67085ec338243df8f9b7d6459036e23 => generated 259 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:06:41.742231 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1929f2a-b8aa-44af-8441-b48f1e65dcde None None] REQUEST_METHOD: `GET` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:06:41.742524 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1929f2a-b8aa-44af-8441-b48f1e65dcde None None] SCRIPT_NAME: `/identity` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:06:41.742812 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1929f2a-b8aa-44af-8441-b48f1e65dcde None None] PATH_INFO: `/` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:06:41.746039 dv-cinder-851351-1-smb devstack@keystone.service[416294]: [pid: 416294|app: 0|req: 362/709] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 09:06:41 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 09:06:41.750068 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad8aeae-adae-4b8c-aaf4-cfaab2c61919 None None] REQUEST_METHOD: `POST` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:06:41.750361 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad8aeae-adae-4b8c-aaf4-cfaab2c61919 None None] SCRIPT_NAME: `/identity` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:06:41.750650 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad8aeae-adae-4b8c-aaf4-cfaab2c61919 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:06:41.777474 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.auth.core [None req-6ad8aeae-adae-4b8c-aaf4-cfaab2c61919 None None] MFA Rules not processed for user `dbf87abab90e4fdf9e75408f4199918e`. Rule list: `[]` (Enabled: `True`). {{(pid=416294) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 09:06:41.779104 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.fernet_utils [None req-6ad8aeae-adae-4b8c-aaf4-cfaab2c61919 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=416294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 09:06:41.787313 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG dbcounter [-] [416293] Writing DB stats keystone:SELECT=100 {{(pid=416293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:06:41.801605 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79754e0b-ec87-4886-987a-b8f9e95e3ced None admin] Validating token access rules against request {{(pid=416293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:06:41.845003 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651ccfe0-6188-4170-8b6c-7d3fa3c970f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:06:41.845991 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651ccfe0-6188-4170-8b6c-7d3fa3c970f2 None admin] REQUEST_METHOD: `GET` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:06:41.846454 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651ccfe0-6188-4170-8b6c-7d3fa3c970f2 None admin] SCRIPT_NAME: `/identity` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:06:41.846735 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651ccfe0-6188-4170-8b6c-7d3fa3c970f2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:06:41.847576 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-651ccfe0-6188-4170-8b6c-7d3fa3c970f2 None admin] RBAC: Adding query filter params (role.id=13417fbdbc5145a69bc01ff0f931fd96, scope.project.id=6c4349445f224184b093d9dfd0dfc642, user.id=1a2e0811e3e347a387717df1e23d61bf) {{(pid=416293) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 09:06:41.847895 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-651ccfe0-6188-4170-8b6c-7d3fa3c970f2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:06:41.849499 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-651ccfe0-6188-4170-8b6c-7d3fa3c970f2 None admin] RBAC: Authorization granted {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:06:41.857103 dv-cinder-851351-1-smb devstack@keystone.service[416293]: [pid: 416293|app: 0|req: 348/710] 10.222.0.42 () {56 vars in 1374 bytes} [Thu Jul 28 09:06:41 2022] GET /identity/v3/role_assignments?user.id=1a2e0811e3e347a387717df1e23d61bf&scope.project.id=6c4349445f224184b093d9dfd0dfc642&role.id=13417fbdbc5145a69bc01ff0f931fd96 => generated 608 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:06:41.858614 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd37d05b-670e-4fbf-a8c9-2fc1048502fb None None] REQUEST_METHOD: `GET` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:06:41.858904 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd37d05b-670e-4fbf-a8c9-2fc1048502fb None None] SCRIPT_NAME: `/identity` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:06:41.859189 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd37d05b-670e-4fbf-a8c9-2fc1048502fb None None] PATH_INFO: `/` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:06:41.864958 dv-cinder-851351-1-smb devstack@keystone.service[416293]: [pid: 416293|app: 0|req: 349/711] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 09:06:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 09:06:41.866720 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095c1090-3fa2-485c-9651-a8f63bbc5bff None None] REQUEST_METHOD: `POST` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:06:41.867016 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095c1090-3fa2-485c-9651-a8f63bbc5bff None None] SCRIPT_NAME: `/identity` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:06:41.867299 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095c1090-3fa2-485c-9651-a8f63bbc5bff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:06:41.870060 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG dbcounter [-] [416294] Writing DB stats keystone:SELECT=100 {{(pid=416294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:06:41.883671 dv-cinder-851351-1-smb devstack@keystone.service[416294]: [pid: 416294|app: 0|req: 363/712] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 09:06:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 28 09:06:41.901056 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.auth.core [None req-095c1090-3fa2-485c-9651-a8f63bbc5bff None None] MFA Rules not processed for user `dbf87abab90e4fdf9e75408f4199918e`. Rule list: `[]` (Enabled: `True`). {{(pid=416293) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 09:06:41.902338 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.fernet_utils [None req-095c1090-3fa2-485c-9651-a8f63bbc5bff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=416293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 09:06:41.911063 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad8aeae-adae-4b8c-aaf4-cfaab2c61919 None None] Authenticating user token {{(pid=416294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:06:42.065145 dv-cinder-851351-1-smb devstack@keystone.service[416293]: [pid: 416293|app: 0|req: 350/713] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 09:06:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 09:06:42.081459 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad8aeae-adae-4b8c-aaf4-cfaab2c61919 None None] Validating token access rules against request {{(pid=416294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:06:42.090965 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-095c1090-3fa2-485c-9651-a8f63bbc5bff None None] Authenticating user token {{(pid=416293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:06:42.130120 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b7b175c-382c-44f2-926c-8aba6305c284 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:06:42.131408 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7b175c-382c-44f2-926c-8aba6305c284 None admin] REQUEST_METHOD: `GET` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:06:42.131881 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7b175c-382c-44f2-926c-8aba6305c284 None admin] SCRIPT_NAME: `/identity` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:06:42.132356 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7b175c-382c-44f2-926c-8aba6305c284 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:06:42.146865 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b7b175c-382c-44f2-926c-8aba6305c284 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:06:42.149536 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b7b175c-382c-44f2-926c-8aba6305c284 None admin] RBAC: Authorization granted {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:06:42.170878 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application [None req-5b7b175c-382c-44f2-926c-8aba6305c284 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 09:06:42.170878 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 09:06:42.170878 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 09:06:42.170878 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 09:06:42.170878 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 09:06:42.170878 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 09:06:42.170878 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 09:06:42.170878 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 09:06:42.170878 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 09:06:42.170878 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 09:06:42.170878 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 09:06:42.170878 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 09:06:42.170878 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 09:06:42.170878 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 09:06:42.170878 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 09:06:42.172044 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 09:06:42.172044 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 09:06:42.172044 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 09:06:42.172044 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 09:06:42.172044 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 09:06:42.172044 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 09:06:42.172044 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 09:06:42.172044 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 09:06:42.172044 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application with Lock( Jul 28 09:06:42.172044 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 09:06:42.172044 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return self._enter() Jul 28 09:06:42.172044 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 09:06:42.172044 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 09:06:42.172044 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 09:06:42.172044 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return self.creator() Jul 28 09:06:42.172044 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 09:06:42.172044 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application created_value = creator( Jul 28 09:06:42.173117 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 09:06:42.173117 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 09:06:42.173117 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 09:06:42.173117 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application Jul 28 09:06:42.175719 dv-cinder-851351-1-smb devstack@keystone.service[416294]: [pid: 416294|app: 0|req: 364/714] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 09:06:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 265 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 09:06:42.181804 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b7b175c-382c-44f2-926c-8aba6305c284 None admin] Authenticating user token {{(pid=416294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:06:42.201034 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG dbcounter [-] [416293] Writing DB stats keystone:SELECT=100 {{(pid=416293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:06:42.222143 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-095c1090-3fa2-485c-9651-a8f63bbc5bff None None] Validating token access rules against request {{(pid=416293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:06:42.237821 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG dbcounter [-] [416294] Writing DB stats keystone:SELECT=100 {{(pid=416294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:06:42.260913 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb6793d-33ba-46ec-961a-3ca2d452abda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:06:42.261769 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb6793d-33ba-46ec-961a-3ca2d452abda None admin] REQUEST_METHOD: `GET` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:06:42.262166 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb6793d-33ba-46ec-961a-3ca2d452abda None admin] SCRIPT_NAME: `/identity` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:06:42.262553 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb6793d-33ba-46ec-961a-3ca2d452abda None admin] PATH_INFO: `/v3/services/network` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:06:42.263308 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cb6793d-33ba-46ec-961a-3ca2d452abda None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:06:42.264949 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cb6793d-33ba-46ec-961a-3ca2d452abda None admin] RBAC: Authorization granted {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:06:42.277701 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application [None req-4cb6793d-33ba-46ec-961a-3ca2d452abda None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jul 28 09:06:42.277701 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 09:06:42.277701 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 28 09:06:42.277701 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 28 09:06:42.277701 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 28 09:06:42.277701 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 28 09:06:42.277701 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 28 09:06:42.277701 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 09:06:42.277701 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 28 09:06:42.277701 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application Jul 28 09:06:42.277701 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 28 09:06:42.277701 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application Jul 28 09:06:42.277701 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 09:06:42.277701 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 09:06:42.277701 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 09:06:42.277701 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 09:06:42.277701 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 09:06:42.279082 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 09:06:42.279082 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 09:06:42.279082 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 09:06:42.279082 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 09:06:42.279082 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 09:06:42.279082 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 09:06:42.279082 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 28 09:06:42.279082 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 28 09:06:42.279082 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 28 09:06:42.279082 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 28 09:06:42.279082 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 09:06:42.279082 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 09:06:42.279082 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 09:06:42.279082 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 09:06:42.279082 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 09:06:42.279082 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 09:06:42.280169 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 09:06:42.280169 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application with Lock( Jul 28 09:06:42.280169 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 09:06:42.280169 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self._enter() Jul 28 09:06:42.280169 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 09:06:42.280169 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 09:06:42.280169 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 09:06:42.280169 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self.creator() Jul 28 09:06:42.280169 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 09:06:42.280169 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application created_value = creator( Jul 28 09:06:42.280169 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 28 09:06:42.280169 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 09:06:42.280169 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 28 09:06:42.280169 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application Jul 28 09:06:42.282377 dv-cinder-851351-1-smb devstack@keystone.service[416293]: [pid: 416293|app: 0|req: 351/715] 10.222.0.42 () {56 vars in 1111 bytes} [Thu Jul 28 09:06:42 2022] GET /identity/v3/services/network => generated 88 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 09:06:42.291041 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb6793d-33ba-46ec-961a-3ca2d452abda None admin] Authenticating user token {{(pid=416293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:06:42.311514 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b7b175c-382c-44f2-926c-8aba6305c284 None admin] Validating token access rules against request {{(pid=416294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:06:42.389268 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff345da1-cb4c-45ab-a509-dfcb7e590559 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:06:42.390052 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff345da1-cb4c-45ab-a509-dfcb7e590559 None admin] REQUEST_METHOD: `GET` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:06:42.390344 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff345da1-cb4c-45ab-a509-dfcb7e590559 None admin] SCRIPT_NAME: `/identity` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:06:42.390626 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff345da1-cb4c-45ab-a509-dfcb7e590559 None admin] PATH_INFO: `/v3/domains` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:06:42.391460 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff345da1-cb4c-45ab-a509-dfcb7e590559 None admin] RBAC: Adding query filter params (name=Default) {{(pid=416294) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 09:06:42.391821 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff345da1-cb4c-45ab-a509-dfcb7e590559 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:06:42.394264 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff345da1-cb4c-45ab-a509-dfcb7e590559 None admin] RBAC: Authorization granted {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:06:42.409558 dv-cinder-851351-1-smb devstack@keystone.service[416294]: [pid: 416294|app: 0|req: 365/716] 10.222.0.42 () {56 vars in 1109 bytes} [Thu Jul 28 09:06:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 09:06:42.415315 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff345da1-cb4c-45ab-a509-dfcb7e590559 None admin] Authenticating user token {{(pid=416294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:06:42.439990 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb6793d-33ba-46ec-961a-3ca2d452abda None admin] Validating token access rules against request {{(pid=416293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:06:42.483855 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc905d6-eb96-4f3d-9a17-ce00cdb0bd2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:06:42.484506 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc905d6-eb96-4f3d-9a17-ce00cdb0bd2b None admin] REQUEST_METHOD: `GET` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:06:42.484846 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc905d6-eb96-4f3d-9a17-ce00cdb0bd2b None admin] SCRIPT_NAME: `/identity` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:06:42.485130 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc905d6-eb96-4f3d-9a17-ce00cdb0bd2b None admin] PATH_INFO: `/v3/services` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:06:42.485924 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc905d6-eb96-4f3d-9a17-ce00cdb0bd2b None admin] RBAC: Adding query filter params (name=network) {{(pid=416293) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 09:06:42.486328 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc905d6-eb96-4f3d-9a17-ce00cdb0bd2b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:06:42.488115 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc905d6-eb96-4f3d-9a17-ce00cdb0bd2b None admin] RBAC: Authorization granted {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:06:42.494081 dv-cinder-851351-1-smb devstack@keystone.service[416293]: [pid: 416293|app: 0|req: 352/717] 10.222.0.42 () {56 vars in 1112 bytes} [Thu Jul 28 09:06:42 2022] GET /identity/v3/services?name=network => generated 124 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:06:42.500978 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc905d6-eb96-4f3d-9a17-ce00cdb0bd2b None admin] Authenticating user token {{(pid=416293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:06:42.521909 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG dbcounter [-] [416293] Writing DB stats keystone:SELECT=100 {{(pid=416293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:06:42.583225 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff345da1-cb4c-45ab-a509-dfcb7e590559 None admin] Validating token access rules against request {{(pid=416294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:06:42.599679 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG dbcounter [-] [416294] Writing DB stats keystone:SELECT=100 {{(pid=416294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:06:42.668779 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76e5eaa-a3f2-410d-94d0-c0b3f8a41a06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:06:42.668779 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76e5eaa-a3f2-410d-94d0-c0b3f8a41a06 None admin] REQUEST_METHOD: `POST` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:06:42.669248 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76e5eaa-a3f2-410d-94d0-c0b3f8a41a06 None admin] SCRIPT_NAME: `/identity` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:06:42.669563 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76e5eaa-a3f2-410d-94d0-c0b3f8a41a06 None admin] PATH_INFO: `/v3/users` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:06:42.670313 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b76e5eaa-a3f2-410d-94d0-c0b3f8a41a06 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:06:42.671800 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b76e5eaa-a3f2-410d-94d0-c0b3f8a41a06 None admin] RBAC: Authorization granted {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:06:42.735748 dv-cinder-851351-1-smb devstack@keystone.service[416294]: [pid: 416294|app: 0|req: 366/718] 10.222.0.42 () {60 vars in 1132 bytes} [Thu Jul 28 09:06:42 2022] POST /identity/v3/users => generated 254 bytes in 321 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 09:06:42.737345 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc905d6-eb96-4f3d-9a17-ce00cdb0bd2b None admin] Validating token access rules against request {{(pid=416293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:06:42.792782 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f0799c-caa8-4d9a-b735-a340696c209b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:06:42.793495 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f0799c-caa8-4d9a-b735-a340696c209b None admin] REQUEST_METHOD: `GET` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:06:42.793847 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f0799c-caa8-4d9a-b735-a340696c209b None admin] SCRIPT_NAME: `/identity` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:06:42.794073 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f0799c-caa8-4d9a-b735-a340696c209b None admin] PATH_INFO: `/v3/services` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:06:42.794793 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4f0799c-caa8-4d9a-b735-a340696c209b None admin] RBAC: Adding query filter params (type=network) {{(pid=416293) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 09:06:42.795150 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4f0799c-caa8-4d9a-b735-a340696c209b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:06:42.796577 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4f0799c-caa8-4d9a-b735-a340696c209b None admin] RBAC: Authorization granted {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:06:42.805910 dv-cinder-851351-1-smb devstack@keystone.service[416293]: [pid: 416293|app: 0|req: 353/719] 10.222.0.42 () {56 vars in 1112 bytes} [Thu Jul 28 09:06:42 2022] GET /identity/v3/services?type=network => generated 124 bytes in 306 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:06:43.424582 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6a57bb-e6d1-4f35-901a-931efbb6ac1f None None] REQUEST_METHOD: `GET` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:06:43.425223 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6a57bb-e6d1-4f35-901a-931efbb6ac1f None None] SCRIPT_NAME: `/identity` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:06:43.425223 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6a57bb-e6d1-4f35-901a-931efbb6ac1f None None] PATH_INFO: `/` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:06:43.426827 dv-cinder-851351-1-smb devstack@keystone.service[416294]: [pid: 416294|app: 0|req: 367/720] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 09:06:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 09:06:43.432402 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597dba58-e4a6-4777-87b8-ea9972a69bb3 None None] REQUEST_METHOD: `POST` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:06:43.432921 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597dba58-e4a6-4777-87b8-ea9972a69bb3 None None] SCRIPT_NAME: `/identity` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:06:43.433004 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597dba58-e4a6-4777-87b8-ea9972a69bb3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:06:43.461847 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.auth.core [None req-597dba58-e4a6-4777-87b8-ea9972a69bb3 None None] MFA Rules not processed for user `dbf87abab90e4fdf9e75408f4199918e`. Rule list: `[]` (Enabled: `True`). {{(pid=416293) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 09:06:43.463084 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.fernet_utils [None req-597dba58-e4a6-4777-87b8-ea9972a69bb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=416293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 09:06:43.701462 dv-cinder-851351-1-smb devstack@keystone.service[416293]: [pid: 416293|app: 0|req: 354/721] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 09:06:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 270 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 28 09:06:43.726679 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6a57bb-e6d1-4f35-901a-931efbb6ac1f None None] Authenticating user token {{(pid=416294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:06:43.883345 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6a57bb-e6d1-4f35-901a-931efbb6ac1f None None] Validating token access rules against request {{(pid=416294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:06:43.956132 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e2cc97d-9553-4d13-9697-113fbf560d29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:06:43.957236 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2cc97d-9553-4d13-9697-113fbf560d29 None admin] REQUEST_METHOD: `POST` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:06:43.957741 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2cc97d-9553-4d13-9697-113fbf560d29 None admin] SCRIPT_NAME: `/identity` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:06:43.958232 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2cc97d-9553-4d13-9697-113fbf560d29 None admin] PATH_INFO: `/v3/services` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:06:43.959187 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e2cc97d-9553-4d13-9697-113fbf560d29 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:06:43.960920 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e2cc97d-9553-4d13-9697-113fbf560d29 None admin] RBAC: Authorization granted {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:06:43.998636 dv-cinder-851351-1-smb devstack@keystone.service[416294]: [pid: 416294|app: 0|req: 368/722] 10.222.0.42 () {60 vars in 1141 bytes} [Thu Jul 28 09:06:43 2022] POST /identity/v3/services => generated 251 bytes in 272 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 09:06:44.272054 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87303352-1a3b-4afc-9c01-b5ec8ec2ddf0 None None] REQUEST_METHOD: `GET` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:06:44.272263 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87303352-1a3b-4afc-9c01-b5ec8ec2ddf0 None None] SCRIPT_NAME: `/identity` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:06:44.272522 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87303352-1a3b-4afc-9c01-b5ec8ec2ddf0 None None] PATH_INFO: `/` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:06:44.274402 dv-cinder-851351-1-smb devstack@keystone.service[416293]: [pid: 416293|app: 0|req: 355/723] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 09:06:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 09:06:44.280519 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668bef2e-a995-41f3-aa2e-3fae26c7afdd None None] REQUEST_METHOD: `POST` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:06:44.280876 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668bef2e-a995-41f3-aa2e-3fae26c7afdd None None] SCRIPT_NAME: `/identity` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:06:44.281165 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668bef2e-a995-41f3-aa2e-3fae26c7afdd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:06:44.307269 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.auth.core [None req-668bef2e-a995-41f3-aa2e-3fae26c7afdd None None] MFA Rules not processed for user `dbf87abab90e4fdf9e75408f4199918e`. Rule list: `[]` (Enabled: `True`). {{(pid=416294) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 09:06:44.308578 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.fernet_utils [None req-668bef2e-a995-41f3-aa2e-3fae26c7afdd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=416294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 09:06:44.328150 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG dbcounter [-] [416294] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=416294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:06:44.395968 dv-cinder-851351-1-smb devstack@keystone.service[416294]: [pid: 416294|app: 0|req: 369/724] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 09:06:44 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 09:06:44.417663 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87303352-1a3b-4afc-9c01-b5ec8ec2ddf0 None None] Authenticating user token {{(pid=416293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:06:44.422894 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG dbcounter [-] [416293] Writing DB stats keystone:SELECT=100 {{(pid=416293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:06:44.546166 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87303352-1a3b-4afc-9c01-b5ec8ec2ddf0 None None] Validating token access rules against request {{(pid=416293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:06:44.586753 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61591881-248c-459d-b902-7f9722ee1d0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:06:44.587613 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61591881-248c-459d-b902-7f9722ee1d0e None admin] REQUEST_METHOD: `GET` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:06:44.587899 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61591881-248c-459d-b902-7f9722ee1d0e None admin] SCRIPT_NAME: `/identity` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:06:44.588178 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61591881-248c-459d-b902-7f9722ee1d0e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:06:44.602656 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61591881-248c-459d-b902-7f9722ee1d0e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 09:06:44.607983 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application [None req-61591881-248c-459d-b902-7f9722ee1d0e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 09:06:44.607983 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 09:06:44.607983 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 09:06:44.607983 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 09:06:44.607983 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 09:06:44.607983 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 09:06:44.607983 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 09:06:44.607983 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 09:06:44.607983 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 09:06:44.607983 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 09:06:44.607983 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 09:06:44.607983 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 09:06:44.607983 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 09:06:44.607983 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 09:06:44.607983 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 09:06:44.607983 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 09:06:44.609071 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 09:06:44.609071 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 09:06:44.609071 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 09:06:44.609071 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 09:06:44.609071 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 09:06:44.609071 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 09:06:44.609071 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 09:06:44.609071 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 09:06:44.609071 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 09:06:44.609071 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 09:06:44.609071 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 09:06:44.609071 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application with Lock( Jul 28 09:06:44.609071 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 09:06:44.609071 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self._enter() Jul 28 09:06:44.609071 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 09:06:44.609071 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 09:06:44.610008 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 09:06:44.610008 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self.creator() Jul 28 09:06:44.610008 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 09:06:44.610008 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application created_value = creator( Jul 28 09:06:44.610008 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 09:06:44.610008 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 09:06:44.610008 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 09:06:44.610008 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 09:06:44.610008 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 09:06:44.610008 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 09:06:44.610008 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 09:06:44.610008 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application Jul 28 09:06:44.610008 dv-cinder-851351-1-smb devstack@keystone.service[416293]: [pid: 416293|app: 0|req: 356/725] 10.222.0.42 () {56 vars in 1096 bytes} [Thu Jul 28 09:06:44 2022] GET /identity/v3/roles/admin => generated 83 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 09:06:44.615820 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668bef2e-a995-41f3-aa2e-3fae26c7afdd None None] Authenticating user token {{(pid=416294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:06:44.738809 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668bef2e-a995-41f3-aa2e-3fae26c7afdd None None] Validating token access rules against request {{(pid=416294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:06:44.787851 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa638ae-e81b-4433-99ca-0e555ab6e8d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:06:44.788527 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa638ae-e81b-4433-99ca-0e555ab6e8d6 None admin] REQUEST_METHOD: `GET` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:06:44.788886 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa638ae-e81b-4433-99ca-0e555ab6e8d6 None admin] SCRIPT_NAME: `/identity` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:06:44.789208 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa638ae-e81b-4433-99ca-0e555ab6e8d6 None admin] PATH_INFO: `/v3/roles` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:06:44.789988 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa638ae-e81b-4433-99ca-0e555ab6e8d6 None admin] RBAC: Adding query filter params (name=admin) {{(pid=416294) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 09:06:44.790302 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa638ae-e81b-4433-99ca-0e555ab6e8d6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:06:44.791862 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa638ae-e81b-4433-99ca-0e555ab6e8d6 None admin] RBAC: Authorization granted {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:06:44.805411 dv-cinder-851351-1-smb devstack@keystone.service[416294]: [pid: 416294|app: 0|req: 370/726] 10.222.0.42 () {56 vars in 1099 bytes} [Thu Jul 28 09:06:44 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:06:44.809081 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1dd7dd-ef9e-483a-a053-5494c0dd7f7f None None] REQUEST_METHOD: `GET` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:06:44.809368 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1dd7dd-ef9e-483a-a053-5494c0dd7f7f None None] SCRIPT_NAME: `/identity` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:06:44.809707 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1dd7dd-ef9e-483a-a053-5494c0dd7f7f None None] PATH_INFO: `/` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:06:44.811445 dv-cinder-851351-1-smb devstack@keystone.service[416293]: [pid: 416293|app: 0|req: 357/727] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 09:06:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 09:06:44.813355 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa638ae-e81b-4433-99ca-0e555ab6e8d6 None admin] Authenticating user token {{(pid=416294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:06:44.817644 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043ada45-b32e-4a4f-b8e1-40e67c82a484 None None] REQUEST_METHOD: `POST` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:06:44.818013 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043ada45-b32e-4a4f-b8e1-40e67c82a484 None None] SCRIPT_NAME: `/identity` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:06:44.818368 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043ada45-b32e-4a4f-b8e1-40e67c82a484 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:06:44.827957 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG dbcounter [-] [416294] Writing DB stats keystone:SELECT=100 {{(pid=416294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:06:44.849860 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.auth.core [None req-043ada45-b32e-4a4f-b8e1-40e67c82a484 None None] MFA Rules not processed for user `dbf87abab90e4fdf9e75408f4199918e`. Rule list: `[]` (Enabled: `True`). {{(pid=416293) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 09:06:44.851100 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.fernet_utils [None req-043ada45-b32e-4a4f-b8e1-40e67c82a484 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=416293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 09:06:44.984888 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG dbcounter [-] [416293] Writing DB stats keystone:SELECT=100 {{(pid=416293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:06:44.997483 dv-cinder-851351-1-smb devstack@keystone.service[416293]: [pid: 416293|app: 0|req: 358/728] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 09:06:44 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 09:06:45.024159 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa638ae-e81b-4433-99ca-0e555ab6e8d6 None admin] Validating token access rules against request {{(pid=416294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:06:45.032568 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-043ada45-b32e-4a4f-b8e1-40e67c82a484 None None] Authenticating user token {{(pid=416293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:06:45.119293 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28eaadbe-c433-4612-ba3a-8f12474044b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:06:45.119293 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28eaadbe-c433-4612-ba3a-8f12474044b8 None admin] REQUEST_METHOD: `GET` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:06:45.119293 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28eaadbe-c433-4612-ba3a-8f12474044b8 None admin] SCRIPT_NAME: `/identity` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:06:45.119293 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28eaadbe-c433-4612-ba3a-8f12474044b8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:06:45.145924 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28eaadbe-c433-4612-ba3a-8f12474044b8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:06:45.147425 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28eaadbe-c433-4612-ba3a-8f12474044b8 None admin] RBAC: Authorization granted {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:06:45.158156 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-043ada45-b32e-4a4f-b8e1-40e67c82a484 None None] Validating token access rules against request {{(pid=416293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:06:45.182334 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application [None req-28eaadbe-c433-4612-ba3a-8f12474044b8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 09:06:45.182334 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 09:06:45.182334 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 09:06:45.182334 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 09:06:45.182334 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 09:06:45.182334 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 09:06:45.182334 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 09:06:45.182334 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 09:06:45.182334 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 09:06:45.182334 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 09:06:45.182334 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 09:06:45.182334 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 09:06:45.182334 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 09:06:45.182334 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 09:06:45.182334 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 09:06:45.183394 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 09:06:45.183394 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 09:06:45.183394 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 09:06:45.183394 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 09:06:45.183394 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 09:06:45.183394 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 09:06:45.183394 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 09:06:45.183394 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 09:06:45.183394 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application with Lock( Jul 28 09:06:45.183394 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 09:06:45.183394 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return self._enter() Jul 28 09:06:45.183394 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 09:06:45.183394 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 09:06:45.183394 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 09:06:45.183394 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return self.creator() Jul 28 09:06:45.183394 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 09:06:45.183394 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application created_value = creator( Jul 28 09:06:45.184378 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 09:06:45.184378 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 09:06:45.184378 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 09:06:45.184378 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application Jul 28 09:06:45.193082 dv-cinder-851351-1-smb devstack@keystone.service[416294]: [pid: 416294|app: 0|req: 371/729] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 09:06:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 380 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 09:06:45.194075 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28eaadbe-c433-4612-ba3a-8f12474044b8 None admin] Authenticating user token {{(pid=416294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:06:45.201573 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-385bbc90-1555-4a83-b9dc-65e8f3702245 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:06:45.202668 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385bbc90-1555-4a83-b9dc-65e8f3702245 None admin] REQUEST_METHOD: `GET` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:06:45.203187 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385bbc90-1555-4a83-b9dc-65e8f3702245 None admin] SCRIPT_NAME: `/identity` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:06:45.203688 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385bbc90-1555-4a83-b9dc-65e8f3702245 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:06:45.216609 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-385bbc90-1555-4a83-b9dc-65e8f3702245 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 09:06:45.222511 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application [None req-385bbc90-1555-4a83-b9dc-65e8f3702245 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 09:06:45.222511 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 09:06:45.222511 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 09:06:45.222511 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 09:06:45.222511 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 09:06:45.222511 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 09:06:45.222511 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 09:06:45.222511 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 09:06:45.222511 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 09:06:45.222511 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 09:06:45.222511 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 09:06:45.222511 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 09:06:45.222511 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 09:06:45.222511 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 09:06:45.222511 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 09:06:45.222511 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 09:06:45.223563 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 09:06:45.223563 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 09:06:45.223563 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 09:06:45.223563 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 09:06:45.223563 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 09:06:45.223563 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 09:06:45.223563 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 09:06:45.223563 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 09:06:45.223563 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 09:06:45.223563 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 09:06:45.223563 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 09:06:45.223563 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application with Lock( Jul 28 09:06:45.223563 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 09:06:45.223563 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self._enter() Jul 28 09:06:45.223563 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 09:06:45.223563 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 09:06:45.224485 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 09:06:45.224485 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self.creator() Jul 28 09:06:45.224485 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 09:06:45.224485 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application created_value = creator( Jul 28 09:06:45.224485 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 09:06:45.224485 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 09:06:45.224485 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 09:06:45.224485 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 09:06:45.224485 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 09:06:45.224485 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 09:06:45.224485 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 09:06:45.224485 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application Jul 28 09:06:45.227408 dv-cinder-851351-1-smb devstack@keystone.service[416293]: [pid: 416293|app: 0|req: 359/730] 10.222.0.42 () {56 vars in 1096 bytes} [Thu Jul 28 09:06:45 2022] GET /identity/v3/roles/admin => generated 83 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 09:06:45.234120 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-385bbc90-1555-4a83-b9dc-65e8f3702245 None admin] Authenticating user token {{(pid=416293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:06:45.297375 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG dbcounter [-] [416294] Writing DB stats keystone:SELECT=100 {{(pid=416294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:06:45.337146 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG dbcounter [-] [416293] Writing DB stats keystone:SELECT=100 {{(pid=416293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:06:45.341839 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28eaadbe-c433-4612-ba3a-8f12474044b8 None admin] Validating token access rules against request {{(pid=416294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:06:45.384773 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa623f4-ae47-49f5-951a-3c629d4f45d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:06:45.385640 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa623f4-ae47-49f5-951a-3c629d4f45d5 None admin] REQUEST_METHOD: `GET` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:06:45.385998 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa623f4-ae47-49f5-951a-3c629d4f45d5 None admin] SCRIPT_NAME: `/identity` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:06:45.386356 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa623f4-ae47-49f5-951a-3c629d4f45d5 None admin] PATH_INFO: `/v3/domains` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:06:45.386759 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-385bbc90-1555-4a83-b9dc-65e8f3702245 None admin] Validating token access rules against request {{(pid=416293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:06:45.387252 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baa623f4-ae47-49f5-951a-3c629d4f45d5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=416294) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 09:06:45.387629 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baa623f4-ae47-49f5-951a-3c629d4f45d5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:06:45.389437 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baa623f4-ae47-49f5-951a-3c629d4f45d5 None admin] RBAC: Authorization granted {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:06:45.408430 dv-cinder-851351-1-smb devstack@keystone.service[416294]: [pid: 416294|app: 0|req: 372/731] 10.222.0.42 () {56 vars in 1109 bytes} [Thu Jul 28 09:06:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:06:45.410037 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e68eed-e534-4371-a0c0-a9982d5cd5df None None] REQUEST_METHOD: `GET` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:06:45.410491 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e68eed-e534-4371-a0c0-a9982d5cd5df None None] SCRIPT_NAME: `/identity` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:06:45.410842 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e68eed-e534-4371-a0c0-a9982d5cd5df None None] PATH_INFO: `/` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:06:45.412525 dv-cinder-851351-1-smb devstack@keystone.service[416294]: [pid: 416294|app: 0|req: 373/732] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 09:06:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 09:06:45.413509 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e68eed-e534-4371-a0c0-a9982d5cd5df None None] Authenticating user token {{(pid=416294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:06:45.425841 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b50bea-6c81-4ca4-abc0-bf50c4b97230 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:06:45.426494 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b50bea-6c81-4ca4-abc0-bf50c4b97230 None admin] REQUEST_METHOD: `GET` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:06:45.426784 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b50bea-6c81-4ca4-abc0-bf50c4b97230 None admin] SCRIPT_NAME: `/identity` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:06:45.427068 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b50bea-6c81-4ca4-abc0-bf50c4b97230 None admin] PATH_INFO: `/v3/roles` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:06:45.427817 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8b50bea-6c81-4ca4-abc0-bf50c4b97230 None admin] RBAC: Adding query filter params (name=admin) {{(pid=416293) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 09:06:45.428127 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8b50bea-6c81-4ca4-abc0-bf50c4b97230 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:06:45.429602 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8b50bea-6c81-4ca4-abc0-bf50c4b97230 None admin] RBAC: Authorization granted {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:06:45.439233 dv-cinder-851351-1-smb devstack@keystone.service[416293]: [pid: 416293|app: 0|req: 360/733] 10.222.0.42 () {56 vars in 1099 bytes} [Thu Jul 28 09:06:45 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:06:45.440616 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ea3bd8-10ef-45a1-a09b-70f2af4f9058 None None] REQUEST_METHOD: `POST` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:06:45.440940 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ea3bd8-10ef-45a1-a09b-70f2af4f9058 None None] SCRIPT_NAME: `/identity` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:06:45.441226 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ea3bd8-10ef-45a1-a09b-70f2af4f9058 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:06:45.465065 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.auth.core [None req-b5ea3bd8-10ef-45a1-a09b-70f2af4f9058 None None] MFA Rules not processed for user `dbf87abab90e4fdf9e75408f4199918e`. Rule list: `[]` (Enabled: `True`). {{(pid=416293) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 09:06:45.466849 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.fernet_utils [None req-b5ea3bd8-10ef-45a1-a09b-70f2af4f9058 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=416293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 09:06:45.535518 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e68eed-e534-4371-a0c0-a9982d5cd5df None None] Validating token access rules against request {{(pid=416294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:06:45.562568 dv-cinder-851351-1-smb devstack@keystone.service[416293]: [pid: 416293|app: 0|req: 361/734] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 09:06:45 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 09:06:45.563438 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG dbcounter [-] [416294] Writing DB stats keystone:SELECT=100 {{(pid=416294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:06:45.564727 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ea3bd8-10ef-45a1-a09b-70f2af4f9058 None None] Authenticating user token {{(pid=416293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:06:45.579225 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a3c499-dcd9-49fa-97c6-ae2cb2ef97f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:06:45.580247 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a3c499-dcd9-49fa-97c6-ae2cb2ef97f9 None admin] REQUEST_METHOD: `GET` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:06:45.580650 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a3c499-dcd9-49fa-97c6-ae2cb2ef97f9 None admin] SCRIPT_NAME: `/identity` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:06:45.581125 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a3c499-dcd9-49fa-97c6-ae2cb2ef97f9 None admin] PATH_INFO: `/v3/users/nova` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:06:45.590486 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82a3c499-dcd9-49fa-97c6-ae2cb2ef97f9 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:06:45.592045 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82a3c499-dcd9-49fa-97c6-ae2cb2ef97f9 None admin] RBAC: Authorization granted {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:06:45.606454 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application [None req-82a3c499-dcd9-49fa-97c6-ae2cb2ef97f9 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 28 09:06:45.606454 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 09:06:45.606454 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 09:06:45.606454 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 09:06:45.606454 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 09:06:45.606454 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 09:06:45.606454 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 09:06:45.606454 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 09:06:45.606454 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 09:06:45.606454 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 09:06:45.606454 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 09:06:45.606454 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 09:06:45.606454 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 28 09:06:45.606454 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 28 09:06:45.606454 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 28 09:06:45.606454 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 28 09:06:45.607789 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 09:06:45.607789 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 09:06:45.607789 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 28 09:06:45.607789 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 09:06:45.607789 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 28 09:06:45.607789 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 09:06:45.607789 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 09:06:45.607789 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 09:06:45.607789 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 09:06:45.607789 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 09:06:45.607789 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 09:06:45.607789 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application with Lock( Jul 28 09:06:45.607789 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 09:06:45.607789 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return self._enter() Jul 28 09:06:45.607789 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 09:06:45.607789 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 09:06:45.607789 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 09:06:45.607789 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return self.creator() Jul 28 09:06:45.609099 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 09:06:45.609099 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application created_value = creator( Jul 28 09:06:45.609099 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 28 09:06:45.609099 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 28 09:06:45.609099 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 28 09:06:45.609099 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 28 09:06:45.609099 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 28 09:06:45.609099 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 28 09:06:45.609099 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 28 09:06:45.609099 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application Jul 28 09:06:45.610627 dv-cinder-851351-1-smb devstack@keystone.service[416294]: [pid: 416294|app: 0|req: 374/735] 10.222.0.42 () {56 vars in 1093 bytes} [Thu Jul 28 09:06:45 2022] GET /identity/v3/users/nova => generated 82 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 09:06:45.618176 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a3c499-dcd9-49fa-97c6-ae2cb2ef97f9 None admin] Authenticating user token {{(pid=416294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:06:45.630888 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG dbcounter [-] [416293] Writing DB stats keystone:SELECT=100 {{(pid=416293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:06:45.706184 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ea3bd8-10ef-45a1-a09b-70f2af4f9058 None None] Validating token access rules against request {{(pid=416293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:06:45.744941 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ae0914-2698-48e5-b5ff-d4dd600cae4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:06:45.745641 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ae0914-2698-48e5-b5ff-d4dd600cae4d None admin] REQUEST_METHOD: `GET` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:06:45.745923 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ae0914-2698-48e5-b5ff-d4dd600cae4d None admin] SCRIPT_NAME: `/identity` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:06:45.746199 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ae0914-2698-48e5-b5ff-d4dd600cae4d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:06:45.747165 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a3c499-dcd9-49fa-97c6-ae2cb2ef97f9 None admin] Validating token access rules against request {{(pid=416294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:06:45.759433 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58ae0914-2698-48e5-b5ff-d4dd600cae4d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:06:45.760983 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58ae0914-2698-48e5-b5ff-d4dd600cae4d None admin] RBAC: Authorization granted {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:06:45.777207 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application [None req-58ae0914-2698-48e5-b5ff-d4dd600cae4d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 09:06:45.777207 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 09:06:45.777207 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 09:06:45.777207 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 09:06:45.777207 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 09:06:45.777207 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 09:06:45.777207 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 09:06:45.777207 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 09:06:45.777207 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 09:06:45.777207 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 09:06:45.777207 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 09:06:45.777207 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 09:06:45.777207 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 09:06:45.777207 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 09:06:45.777207 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 09:06:45.778435 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 09:06:45.778435 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 09:06:45.778435 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 09:06:45.778435 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 09:06:45.778435 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 09:06:45.778435 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 09:06:45.778435 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 09:06:45.778435 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 09:06:45.778435 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application with Lock( Jul 28 09:06:45.778435 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 09:06:45.778435 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self._enter() Jul 28 09:06:45.778435 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 09:06:45.778435 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 09:06:45.778435 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 09:06:45.778435 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self.creator() Jul 28 09:06:45.778435 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 09:06:45.778435 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application created_value = creator( Jul 28 09:06:45.779630 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 09:06:45.779630 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 09:06:45.779630 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 09:06:45.779630 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application Jul 28 09:06:45.779630 dv-cinder-851351-1-smb devstack@keystone.service[416293]: [pid: 416293|app: 0|req: 362/736] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 09:06:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 09:06:45.786033 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ae0914-2698-48e5-b5ff-d4dd600cae4d None admin] Authenticating user token {{(pid=416293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:06:45.788436 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50dc636c-3359-44c2-b8bb-a15ba5f498b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:06:45.789121 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50dc636c-3359-44c2-b8bb-a15ba5f498b2 None admin] REQUEST_METHOD: `POST` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:06:45.789424 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50dc636c-3359-44c2-b8bb-a15ba5f498b2 None admin] SCRIPT_NAME: `/identity` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:06:45.789791 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50dc636c-3359-44c2-b8bb-a15ba5f498b2 None admin] PATH_INFO: `/v3/services` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:06:45.790398 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50dc636c-3359-44c2-b8bb-a15ba5f498b2 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:06:45.792261 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50dc636c-3359-44c2-b8bb-a15ba5f498b2 None admin] RBAC: Authorization granted {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:06:45.809185 dv-cinder-851351-1-smb devstack@keystone.service[416294]: [pid: 416294|app: 0|req: 375/737] 10.222.0.42 () {60 vars in 1141 bytes} [Thu Jul 28 09:06:45 2022] POST /identity/v3/services => generated 240 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 09:06:45.810511 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c5c3b2-2518-4c57-a24f-8c0ef2ccee62 None None] REQUEST_METHOD: `GET` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:06:45.810805 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c5c3b2-2518-4c57-a24f-8c0ef2ccee62 None None] SCRIPT_NAME: `/identity` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:06:45.811087 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c5c3b2-2518-4c57-a24f-8c0ef2ccee62 None None] PATH_INFO: `/` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:06:45.812532 dv-cinder-851351-1-smb devstack@keystone.service[416294]: [pid: 416294|app: 0|req: 376/738] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 09:06:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 09:06:45.817955 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c5c3b2-2518-4c57-a24f-8c0ef2ccee62 None None] Authenticating user token {{(pid=416294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:06:45.894604 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG dbcounter [-] [416294] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=416294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:06:45.952330 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG dbcounter [-] [416293] Writing DB stats keystone:SELECT=100 {{(pid=416293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:06:45.958095 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ae0914-2698-48e5-b5ff-d4dd600cae4d None admin] Validating token access rules against request {{(pid=416293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:06:46.009573 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c5c3b2-2518-4c57-a24f-8c0ef2ccee62 None None] Validating token access rules against request {{(pid=416294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:06:46.028375 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ab1795-6ec6-486e-aa33-da407b3883ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:06:46.029227 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ab1795-6ec6-486e-aa33-da407b3883ea None admin] REQUEST_METHOD: `GET` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:06:46.029575 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ab1795-6ec6-486e-aa33-da407b3883ea None admin] SCRIPT_NAME: `/identity` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:06:46.029923 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ab1795-6ec6-486e-aa33-da407b3883ea None admin] PATH_INFO: `/v3/users` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:06:46.031472 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81ab1795-6ec6-486e-aa33-da407b3883ea None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=416293) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 09:06:46.031472 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81ab1795-6ec6-486e-aa33-da407b3883ea None admin] RBAC: Authorizing `identity:list_users()` {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:06:46.032788 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81ab1795-6ec6-486e-aa33-da407b3883ea None admin] RBAC: Authorization granted {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:06:46.061564 dv-cinder-851351-1-smb devstack@keystone.service[416293]: [pid: 416293|app: 0|req: 363/739] 10.222.0.42 () {56 vars in 1133 bytes} [Thu Jul 28 09:06:45 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 282 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:06:46.066570 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ce9f45-4bb8-4461-938d-636399287293 None None] REQUEST_METHOD: `POST` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:06:46.066570 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ce9f45-4bb8-4461-938d-636399287293 None None] SCRIPT_NAME: `/identity` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:06:46.066570 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ce9f45-4bb8-4461-938d-636399287293 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:06:46.081784 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7fb2f7-fa2f-46f9-bda2-3aea88e168bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:06:46.083176 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7fb2f7-fa2f-46f9-bda2-3aea88e168bf None admin] REQUEST_METHOD: `GET` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:06:46.083889 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7fb2f7-fa2f-46f9-bda2-3aea88e168bf None admin] SCRIPT_NAME: `/identity` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:06:46.084638 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7fb2f7-fa2f-46f9-bda2-3aea88e168bf None admin] PATH_INFO: `/v3/domains` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:06:46.086114 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa7fb2f7-fa2f-46f9-bda2-3aea88e168bf None admin] RBAC: Adding query filter params (name=Default) {{(pid=416294) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 09:06:46.086861 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa7fb2f7-fa2f-46f9-bda2-3aea88e168bf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:06:46.089544 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa7fb2f7-fa2f-46f9-bda2-3aea88e168bf None admin] RBAC: Authorization granted {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:06:46.097207 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.auth.core [None req-a8ce9f45-4bb8-4461-938d-636399287293 None None] MFA Rules not processed for user `dbf87abab90e4fdf9e75408f4199918e`. Rule list: `[]` (Enabled: `True`). {{(pid=416293) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 09:06:46.099121 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.fernet_utils [None req-a8ce9f45-4bb8-4461-938d-636399287293 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=416293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 09:06:46.110930 dv-cinder-851351-1-smb devstack@keystone.service[416294]: [pid: 416294|app: 0|req: 377/740] 10.222.0.42 () {56 vars in 1109 bytes} [Thu Jul 28 09:06:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 298 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:06:46.118252 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7fb2f7-fa2f-46f9-bda2-3aea88e168bf None admin] Authenticating user token {{(pid=416294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:06:46.232804 dv-cinder-851351-1-smb devstack@keystone.service[416293]: [pid: 416293|app: 0|req: 364/741] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 09:06:46 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 09:06:46.232804 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ce9f45-4bb8-4461-938d-636399287293 None None] Authenticating user token {{(pid=416293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:06:46.338788 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7fb2f7-fa2f-46f9-bda2-3aea88e168bf None admin] Validating token access rules against request {{(pid=416294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:06:46.358162 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG dbcounter [-] [416294] Writing DB stats keystone:SELECT=100 {{(pid=416294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:06:46.383665 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG dbcounter [-] [416293] Writing DB stats keystone:SELECT=100 {{(pid=416293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:06:46.398565 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec1f3aa-be0c-4215-bcbc-eb51a6f831d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:06:46.400073 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec1f3aa-be0c-4215-bcbc-eb51a6f831d2 None admin] REQUEST_METHOD: `GET` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:06:46.400827 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec1f3aa-be0c-4215-bcbc-eb51a6f831d2 None admin] SCRIPT_NAME: `/identity` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:06:46.401545 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec1f3aa-be0c-4215-bcbc-eb51a6f831d2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:06:46.414216 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ce9f45-4bb8-4461-938d-636399287293 None None] Validating token access rules against request {{(pid=416293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:06:46.420909 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ec1f3aa-be0c-4215-bcbc-eb51a6f831d2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:06:46.423793 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ec1f3aa-be0c-4215-bcbc-eb51a6f831d2 None admin] RBAC: Authorization granted {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:06:46.450614 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application [None req-2ec1f3aa-be0c-4215-bcbc-eb51a6f831d2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 09:06:46.450614 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 09:06:46.450614 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 09:06:46.450614 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 09:06:46.450614 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 09:06:46.450614 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 09:06:46.450614 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 09:06:46.450614 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 09:06:46.450614 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 09:06:46.450614 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 09:06:46.450614 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 09:06:46.450614 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 09:06:46.450614 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 09:06:46.450614 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 09:06:46.450614 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 09:06:46.452484 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 09:06:46.452484 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 09:06:46.452484 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 09:06:46.452484 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 09:06:46.452484 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 09:06:46.452484 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 09:06:46.452484 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 09:06:46.452484 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 09:06:46.452484 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application with Lock( Jul 28 09:06:46.452484 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 09:06:46.452484 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return self._enter() Jul 28 09:06:46.452484 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 09:06:46.452484 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 09:06:46.452484 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 09:06:46.452484 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return self.creator() Jul 28 09:06:46.452484 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 09:06:46.452484 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application created_value = creator( Jul 28 09:06:46.454504 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 09:06:46.454504 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 09:06:46.454504 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 09:06:46.454504 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application Jul 28 09:06:46.465146 dv-cinder-851351-1-smb devstack@keystone.service[416294]: [pid: 416294|app: 0|req: 378/742] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 09:06:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 348 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 09:06:46.467019 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec1f3aa-be0c-4215-bcbc-eb51a6f831d2 None admin] Authenticating user token {{(pid=416294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:06:46.476022 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3bffca-372b-448e-b2cb-4196f7ebfad4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:06:46.477096 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3bffca-372b-448e-b2cb-4196f7ebfad4 None admin] REQUEST_METHOD: `GET` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:06:46.477640 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3bffca-372b-448e-b2cb-4196f7ebfad4 None admin] SCRIPT_NAME: `/identity` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:06:46.478117 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3bffca-372b-448e-b2cb-4196f7ebfad4 None admin] PATH_INFO: `/v3/users/swift` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:06:46.491561 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf3bffca-372b-448e-b2cb-4196f7ebfad4 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:06:46.494054 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf3bffca-372b-448e-b2cb-4196f7ebfad4 None admin] RBAC: Authorization granted {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:06:46.519682 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application [None req-bf3bffca-372b-448e-b2cb-4196f7ebfad4 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 28 09:06:46.519682 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 09:06:46.519682 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 09:06:46.519682 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 09:06:46.519682 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 09:06:46.519682 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 09:06:46.519682 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 09:06:46.519682 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 09:06:46.519682 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 09:06:46.519682 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 09:06:46.519682 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 09:06:46.519682 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 09:06:46.519682 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 28 09:06:46.519682 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 28 09:06:46.519682 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 28 09:06:46.519682 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 28 09:06:46.522008 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 09:06:46.522008 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 09:06:46.522008 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 28 09:06:46.522008 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 09:06:46.522008 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 28 09:06:46.522008 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 09:06:46.522008 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 09:06:46.522008 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 09:06:46.522008 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 09:06:46.522008 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 09:06:46.522008 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 09:06:46.522008 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application with Lock( Jul 28 09:06:46.522008 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 09:06:46.522008 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self._enter() Jul 28 09:06:46.522008 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 09:06:46.522008 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 09:06:46.522008 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 09:06:46.522008 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self.creator() Jul 28 09:06:46.523988 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 09:06:46.523988 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application created_value = creator( Jul 28 09:06:46.523988 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 28 09:06:46.523988 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 28 09:06:46.523988 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 28 09:06:46.523988 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 28 09:06:46.523988 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 28 09:06:46.523988 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 28 09:06:46.523988 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 28 09:06:46.523988 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application Jul 28 09:06:46.525095 dv-cinder-851351-1-smb devstack@keystone.service[416293]: [pid: 416293|app: 0|req: 365/743] 10.222.0.42 () {56 vars in 1096 bytes} [Thu Jul 28 09:06:46 2022] GET /identity/v3/users/swift => generated 83 bytes in 299 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 09:06:46.526536 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3bffca-372b-448e-b2cb-4196f7ebfad4 None admin] Authenticating user token {{(pid=416293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:06:46.649208 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec1f3aa-be0c-4215-bcbc-eb51a6f831d2 None admin] Validating token access rules against request {{(pid=416294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:06:46.704356 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3bffca-372b-448e-b2cb-4196f7ebfad4 None admin] Validating token access rules against request {{(pid=416293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:06:46.706168 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614dec7b-f114-4831-933e-62753c08fc2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:06:46.707292 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614dec7b-f114-4831-933e-62753c08fc2b None admin] REQUEST_METHOD: `GET` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:06:46.707824 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614dec7b-f114-4831-933e-62753c08fc2b None admin] SCRIPT_NAME: `/identity` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:06:46.708361 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614dec7b-f114-4831-933e-62753c08fc2b None admin] PATH_INFO: `/v3/roles/service` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:06:46.724938 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-614dec7b-f114-4831-933e-62753c08fc2b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 09:06:46.735004 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application [None req-614dec7b-f114-4831-933e-62753c08fc2b None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 28 09:06:46.735004 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 09:06:46.735004 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 09:06:46.735004 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 09:06:46.735004 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 09:06:46.735004 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 09:06:46.735004 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 09:06:46.735004 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 09:06:46.735004 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 09:06:46.735004 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 09:06:46.735004 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 09:06:46.735004 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 09:06:46.735004 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 09:06:46.735004 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 09:06:46.735004 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 09:06:46.735004 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 09:06:46.736150 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 09:06:46.736150 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 09:06:46.736150 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 09:06:46.736150 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 09:06:46.736150 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 09:06:46.736150 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 09:06:46.736150 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 09:06:46.736150 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 09:06:46.736150 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 09:06:46.736150 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 09:06:46.736150 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 09:06:46.736150 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application with Lock( Jul 28 09:06:46.736150 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 09:06:46.736150 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return self._enter() Jul 28 09:06:46.736150 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 09:06:46.736150 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 09:06:46.737124 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 09:06:46.737124 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return self.creator() Jul 28 09:06:46.737124 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 09:06:46.737124 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application created_value = creator( Jul 28 09:06:46.737124 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 09:06:46.737124 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 09:06:46.737124 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 09:06:46.737124 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 09:06:46.737124 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 09:06:46.737124 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 09:06:46.737124 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 28 09:06:46.737124 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application Jul 28 09:06:46.741037 dv-cinder-851351-1-smb devstack@keystone.service[416294]: [pid: 416294|app: 0|req: 379/744] 10.222.0.42 () {56 vars in 1102 bytes} [Thu Jul 28 09:06:46 2022] GET /identity/v3/roles/service => generated 85 bytes in 275 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 09:06:46.742250 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614dec7b-f114-4831-933e-62753c08fc2b None admin] Authenticating user token {{(pid=416294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:06:46.757618 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG dbcounter [-] [416294] Writing DB stats keystone:SELECT=100 {{(pid=416294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:06:46.757973 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f384eae-dcfb-490a-a6c9-0bc35df25956 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:06:46.759059 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f384eae-dcfb-490a-a6c9-0bc35df25956 None admin] REQUEST_METHOD: `GET` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:06:46.759492 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f384eae-dcfb-490a-a6c9-0bc35df25956 None admin] SCRIPT_NAME: `/identity` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:06:46.759880 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f384eae-dcfb-490a-a6c9-0bc35df25956 None admin] PATH_INFO: `/v3/domains` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:06:46.760952 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f384eae-dcfb-490a-a6c9-0bc35df25956 None admin] RBAC: Adding query filter params (name=Default) {{(pid=416293) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 09:06:46.761398 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f384eae-dcfb-490a-a6c9-0bc35df25956 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:06:46.763527 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f384eae-dcfb-490a-a6c9-0bc35df25956 None admin] RBAC: Authorization granted {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:06:46.781648 dv-cinder-851351-1-smb devstack@keystone.service[416293]: [pid: 416293|app: 0|req: 366/745] 10.222.0.42 () {56 vars in 1109 bytes} [Thu Jul 28 09:06:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:06:46.782992 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079f7591-0741-4de2-b7f6-63a6e4a9784b None None] REQUEST_METHOD: `GET` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:06:46.783284 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079f7591-0741-4de2-b7f6-63a6e4a9784b None None] SCRIPT_NAME: `/identity` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:06:46.783551 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079f7591-0741-4de2-b7f6-63a6e4a9784b None None] PATH_INFO: `/` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:06:46.784839 dv-cinder-851351-1-smb devstack@keystone.service[416293]: [pid: 416293|app: 0|req: 367/746] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 09:06:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 09:06:46.785532 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079f7591-0741-4de2-b7f6-63a6e4a9784b None None] Authenticating user token {{(pid=416293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:06:46.797899 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG dbcounter [-] [416293] Writing DB stats keystone:SELECT=100 {{(pid=416293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:06:46.860260 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614dec7b-f114-4831-933e-62753c08fc2b None admin] Validating token access rules against request {{(pid=416294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:06:46.898253 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37783d6-4044-4ca5-8f7c-23c85f98bafa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:06:46.898896 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37783d6-4044-4ca5-8f7c-23c85f98bafa None admin] REQUEST_METHOD: `GET` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:06:46.899182 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37783d6-4044-4ca5-8f7c-23c85f98bafa None admin] SCRIPT_NAME: `/identity` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:06:46.899462 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37783d6-4044-4ca5-8f7c-23c85f98bafa None admin] PATH_INFO: `/v3/users` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:06:46.900279 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d37783d6-4044-4ca5-8f7c-23c85f98bafa None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=416294) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 09:06:46.900386 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079f7591-0741-4de2-b7f6-63a6e4a9784b None None] Validating token access rules against request {{(pid=416293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:06:46.900645 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d37783d6-4044-4ca5-8f7c-23c85f98bafa None admin] RBAC: Authorizing `identity:list_users()` {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:06:46.902251 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d37783d6-4044-4ca5-8f7c-23c85f98bafa None admin] RBAC: Authorization granted {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:06:46.923055 dv-cinder-851351-1-smb devstack@keystone.service[416294]: [pid: 416294|app: 0|req: 380/747] 10.222.0.42 () {56 vars in 1135 bytes} [Thu Jul 28 09:06:46 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:06:46.923903 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37783d6-4044-4ca5-8f7c-23c85f98bafa None admin] Authenticating user token {{(pid=416294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:06:46.944864 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ada4af5-d07b-4902-b8c5-f70d598fbd45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:06:46.945662 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ada4af5-d07b-4902-b8c5-f70d598fbd45 None admin] REQUEST_METHOD: `GET` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:06:46.945946 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ada4af5-d07b-4902-b8c5-f70d598fbd45 None admin] SCRIPT_NAME: `/identity` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:06:46.946220 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ada4af5-d07b-4902-b8c5-f70d598fbd45 None admin] PATH_INFO: `/v3/roles` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:06:46.946978 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ada4af5-d07b-4902-b8c5-f70d598fbd45 None admin] RBAC: Adding query filter params (name=service) {{(pid=416293) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 09:06:46.947288 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ada4af5-d07b-4902-b8c5-f70d598fbd45 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:06:46.949250 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ada4af5-d07b-4902-b8c5-f70d598fbd45 None admin] RBAC: Authorization granted {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:06:46.959469 dv-cinder-851351-1-smb devstack@keystone.service[416293]: [pid: 416293|app: 0|req: 368/748] 10.222.0.42 () {56 vars in 1103 bytes} [Thu Jul 28 09:06:46 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:06:46.965571 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffcc875b-b2ef-4d6a-85b2-118697cccee0 None None] REQUEST_METHOD: `POST` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:06:46.965918 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffcc875b-b2ef-4d6a-85b2-118697cccee0 None None] SCRIPT_NAME: `/identity` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:06:46.966541 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffcc875b-b2ef-4d6a-85b2-118697cccee0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:06:46.989725 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.auth.core [None req-ffcc875b-b2ef-4d6a-85b2-118697cccee0 None None] MFA Rules not processed for user `dbf87abab90e4fdf9e75408f4199918e`. Rule list: `[]` (Enabled: `True`). {{(pid=416293) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 09:06:46.990956 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.fernet_utils [None req-ffcc875b-b2ef-4d6a-85b2-118697cccee0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=416293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 09:06:47.005386 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG dbcounter [-] [416294] Writing DB stats keystone:SELECT=100 {{(pid=416294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:06:47.043714 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37783d6-4044-4ca5-8f7c-23c85f98bafa None admin] Validating token access rules against request {{(pid=416294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:06:47.064948 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG dbcounter [-] [416293] Writing DB stats keystone:SELECT=100 {{(pid=416293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:06:47.076896 dv-cinder-851351-1-smb devstack@keystone.service[416293]: [pid: 416293|app: 0|req: 369/749] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 09:06:46 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 09:06:47.078084 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffcc875b-b2ef-4d6a-85b2-118697cccee0 None None] Authenticating user token {{(pid=416293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:06:47.084253 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ce90b9-f8fa-4414-8da4-0ab18ae5d077 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:06:47.085136 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ce90b9-f8fa-4414-8da4-0ab18ae5d077 None admin] REQUEST_METHOD: `GET` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:06:47.085512 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ce90b9-f8fa-4414-8da4-0ab18ae5d077 None admin] SCRIPT_NAME: `/identity` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:06:47.085864 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ce90b9-f8fa-4414-8da4-0ab18ae5d077 None admin] PATH_INFO: `/v3/projects/service` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:06:47.094229 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8ce90b9-f8fa-4414-8da4-0ab18ae5d077 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:06:47.095816 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8ce90b9-f8fa-4414-8da4-0ab18ae5d077 None admin] RBAC: Authorization granted {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:06:47.108736 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application [None req-a8ce90b9-f8fa-4414-8da4-0ab18ae5d077 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 09:06:47.108736 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 09:06:47.108736 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 09:06:47.108736 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 09:06:47.108736 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 09:06:47.108736 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 09:06:47.108736 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 09:06:47.108736 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 09:06:47.108736 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 09:06:47.108736 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 09:06:47.108736 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 09:06:47.108736 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 09:06:47.108736 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 28 09:06:47.108736 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 28 09:06:47.108736 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 28 09:06:47.109937 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 28 09:06:47.109937 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 09:06:47.109937 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 09:06:47.109937 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 09:06:47.109937 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 09:06:47.109937 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 09:06:47.109937 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 09:06:47.109937 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 09:06:47.109937 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application with Lock( Jul 28 09:06:47.109937 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 09:06:47.109937 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return self._enter() Jul 28 09:06:47.109937 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 09:06:47.109937 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 09:06:47.109937 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 09:06:47.109937 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return self.creator() Jul 28 09:06:47.109937 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 09:06:47.109937 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application created_value = creator( Jul 28 09:06:47.110990 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 28 09:06:47.110990 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 28 09:06:47.110990 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 28 09:06:47.110990 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 28 09:06:47.110990 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 28 09:06:47.110990 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 28 09:06:47.110990 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 09:06:47.110990 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application Jul 28 09:06:47.110990 dv-cinder-851351-1-smb devstack@keystone.service[416294]: [pid: 416294|app: 0|req: 381/750] 10.222.0.42 () {56 vars in 1111 bytes} [Thu Jul 28 09:06:46 2022] GET /identity/v3/projects/service => generated 88 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 09:06:47.111687 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ce90b9-f8fa-4414-8da4-0ab18ae5d077 None admin] Authenticating user token {{(pid=416294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:06:47.186917 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffcc875b-b2ef-4d6a-85b2-118697cccee0 None None] Validating token access rules against request {{(pid=416293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:06:47.224749 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebdd2351-de50-4a8b-a7da-1d65b15b5db6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:06:47.225385 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebdd2351-de50-4a8b-a7da-1d65b15b5db6 None admin] REQUEST_METHOD: `GET` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:06:47.225669 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebdd2351-de50-4a8b-a7da-1d65b15b5db6 None admin] SCRIPT_NAME: `/identity` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:06:47.225776 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ce90b9-f8fa-4414-8da4-0ab18ae5d077 None admin] Validating token access rules against request {{(pid=416294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:06:47.226004 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebdd2351-de50-4a8b-a7da-1d65b15b5db6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:06:47.257129 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG dbcounter [-] [416294] Writing DB stats keystone:SELECT=100 {{(pid=416294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:06:47.266213 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd5640a-7b1f-443c-a037-59f9da0df8f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:06:47.266874 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd5640a-7b1f-443c-a037-59f9da0df8f5 None admin] REQUEST_METHOD: `GET` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:06:47.267156 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd5640a-7b1f-443c-a037-59f9da0df8f5 None admin] SCRIPT_NAME: `/identity` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:06:47.267431 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd5640a-7b1f-443c-a037-59f9da0df8f5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:06:47.278511 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cd5640a-7b1f-443c-a037-59f9da0df8f5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:06:47.279977 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cd5640a-7b1f-443c-a037-59f9da0df8f5 None admin] RBAC: Authorization granted {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:06:47.294740 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application [None req-8cd5640a-7b1f-443c-a037-59f9da0df8f5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 09:06:47.294740 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 09:06:47.294740 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 09:06:47.294740 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 09:06:47.294740 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 09:06:47.294740 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 09:06:47.294740 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 09:06:47.294740 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 09:06:47.294740 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 09:06:47.294740 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 09:06:47.294740 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 09:06:47.294740 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 09:06:47.294740 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 09:06:47.294740 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 09:06:47.294740 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 09:06:47.295751 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 09:06:47.295751 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 09:06:47.295751 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 09:06:47.295751 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 09:06:47.295751 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 09:06:47.295751 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 09:06:47.295751 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 09:06:47.295751 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 09:06:47.295751 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application with Lock( Jul 28 09:06:47.295751 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 09:06:47.295751 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return self._enter() Jul 28 09:06:47.295751 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 09:06:47.295751 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 09:06:47.295751 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 09:06:47.295751 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return self.creator() Jul 28 09:06:47.295751 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 09:06:47.295751 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application created_value = creator( Jul 28 09:06:47.296734 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 09:06:47.296734 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 09:06:47.296734 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 09:06:47.296734 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application Jul 28 09:06:47.296734 dv-cinder-851351-1-smb devstack@keystone.service[416294]: [pid: 416294|app: 0|req: 382/751] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 09:06:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 09:06:47.297502 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd5640a-7b1f-443c-a037-59f9da0df8f5 None admin] Authenticating user token {{(pid=416294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:06:47.304097 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG dbcounter [-] [416293] Writing DB stats keystone:SELECT=100 {{(pid=416293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:06:47.307920 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebdd2351-de50-4a8b-a7da-1d65b15b5db6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:06:47.310200 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebdd2351-de50-4a8b-a7da-1d65b15b5db6 None admin] RBAC: Authorization granted {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:06:47.409202 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd5640a-7b1f-443c-a037-59f9da0df8f5 None admin] Validating token access rules against request {{(pid=416294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:06:47.435389 dv-cinder-851351-1-smb devstack@keystone.service[416293]: [pid: 416293|app: 0|req: 370/752] 10.222.0.42 () {58 vars in 1282 bytes} [Thu Jul 28 09:06:47 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 358 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 28 09:06:47.436320 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebdd2351-de50-4a8b-a7da-1d65b15b5db6 None admin] Authenticating user token {{(pid=416293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:06:47.455148 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23af8f96-96c7-4764-973c-6dd6bc50c66c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:06:47.455835 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23af8f96-96c7-4764-973c-6dd6bc50c66c None admin] REQUEST_METHOD: `GET` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:06:47.456120 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23af8f96-96c7-4764-973c-6dd6bc50c66c None admin] SCRIPT_NAME: `/identity` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:06:47.456402 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23af8f96-96c7-4764-973c-6dd6bc50c66c None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:06:47.457093 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23af8f96-96c7-4764-973c-6dd6bc50c66c None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:06:47.458531 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23af8f96-96c7-4764-973c-6dd6bc50c66c None admin] RBAC: Authorization granted {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:06:47.469213 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application [None req-23af8f96-96c7-4764-973c-6dd6bc50c66c None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 28 09:06:47.469213 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 09:06:47.469213 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 28 09:06:47.469213 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 28 09:06:47.469213 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 28 09:06:47.469213 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 28 09:06:47.469213 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 28 09:06:47.469213 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 09:06:47.469213 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 28 09:06:47.469213 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application Jul 28 09:06:47.469213 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 28 09:06:47.469213 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application Jul 28 09:06:47.469213 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 09:06:47.469213 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 09:06:47.469213 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 09:06:47.469213 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 09:06:47.470480 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 09:06:47.470480 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 09:06:47.470480 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 09:06:47.470480 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 09:06:47.470480 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 09:06:47.470480 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 09:06:47.470480 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 09:06:47.470480 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 28 09:06:47.470480 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 28 09:06:47.470480 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 28 09:06:47.470480 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 28 09:06:47.470480 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 09:06:47.470480 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 09:06:47.470480 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 09:06:47.470480 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 09:06:47.470480 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 09:06:47.471420 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 09:06:47.471420 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 09:06:47.471420 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application with Lock( Jul 28 09:06:47.471420 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 09:06:47.471420 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return self._enter() Jul 28 09:06:47.471420 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 09:06:47.471420 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 09:06:47.471420 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 09:06:47.471420 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return self.creator() Jul 28 09:06:47.471420 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 09:06:47.471420 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application created_value = creator( Jul 28 09:06:47.471420 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 28 09:06:47.471420 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 09:06:47.471420 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 28 09:06:47.471420 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application Jul 28 09:06:47.471420 dv-cinder-851351-1-smb devstack@keystone.service[416294]: [pid: 416294|app: 0|req: 383/753] 10.222.0.42 () {56 vars in 1129 bytes} [Thu Jul 28 09:06:47 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 09:06:47.472340 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23af8f96-96c7-4764-973c-6dd6bc50c66c None admin] Authenticating user token {{(pid=416294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:06:47.535994 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG dbcounter [-] [416294] Writing DB stats keystone:SELECT=100 {{(pid=416294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:06:47.557447 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG dbcounter [-] [416293] Writing DB stats keystone:SELECT=100 {{(pid=416293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:06:47.561427 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebdd2351-de50-4a8b-a7da-1d65b15b5db6 None admin] Validating token access rules against request {{(pid=416293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:06:47.597384 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23af8f96-96c7-4764-973c-6dd6bc50c66c None admin] Validating token access rules against request {{(pid=416294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:06:47.599119 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748360fa-7504-4baa-b9ff-d8a4da1380c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:06:47.599873 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748360fa-7504-4baa-b9ff-d8a4da1380c4 None admin] REQUEST_METHOD: `GET` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:06:47.600155 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748360fa-7504-4baa-b9ff-d8a4da1380c4 None admin] SCRIPT_NAME: `/identity` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:06:47.600427 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748360fa-7504-4baa-b9ff-d8a4da1380c4 None admin] PATH_INFO: `/v3/projects` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:06:47.601225 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-748360fa-7504-4baa-b9ff-d8a4da1380c4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=416293) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 09:06:47.601531 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-748360fa-7504-4baa-b9ff-d8a4da1380c4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:06:47.602982 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-748360fa-7504-4baa-b9ff-d8a4da1380c4 None admin] RBAC: Authorization granted {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:06:47.616867 dv-cinder-851351-1-smb devstack@keystone.service[416293]: [pid: 416293|app: 0|req: 371/754] 10.222.0.42 () {56 vars in 1148 bytes} [Thu Jul 28 09:06:47 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:06:47.617738 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748360fa-7504-4baa-b9ff-d8a4da1380c4 None admin] Authenticating user token {{(pid=416293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:06:47.642074 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ccec7c-23de-40ed-8714-004b47728bbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:06:47.643088 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ccec7c-23de-40ed-8714-004b47728bbc None admin] REQUEST_METHOD: `GET` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:06:47.643574 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ccec7c-23de-40ed-8714-004b47728bbc None admin] SCRIPT_NAME: `/identity` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:06:47.644059 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ccec7c-23de-40ed-8714-004b47728bbc None admin] PATH_INFO: `/v3/domains` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:06:47.644997 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08ccec7c-23de-40ed-8714-004b47728bbc None admin] RBAC: Adding query filter params (name=Default) {{(pid=416294) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 09:06:47.645522 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08ccec7c-23de-40ed-8714-004b47728bbc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:06:47.646927 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08ccec7c-23de-40ed-8714-004b47728bbc None admin] RBAC: Authorization granted {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:06:47.664724 dv-cinder-851351-1-smb devstack@keystone.service[416294]: [pid: 416294|app: 0|req: 384/755] 10.222.0.42 () {56 vars in 1109 bytes} [Thu Jul 28 09:06:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:06:47.664724 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ccec7c-23de-40ed-8714-004b47728bbc None admin] Authenticating user token {{(pid=416294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:06:47.739732 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748360fa-7504-4baa-b9ff-d8a4da1380c4 None admin] Validating token access rules against request {{(pid=416293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:06:47.770572 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ccec7c-23de-40ed-8714-004b47728bbc None admin] Validating token access rules against request {{(pid=416294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:06:47.774175 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG dbcounter [-] [416294] Writing DB stats keystone:SELECT=100 {{(pid=416294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:06:47.778560 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce894eb8-c75a-4579-92f8-cc64f2a8a508 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:06:47.779478 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce894eb8-c75a-4579-92f8-cc64f2a8a508 None admin] REQUEST_METHOD: `GET` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:06:47.779478 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce894eb8-c75a-4579-92f8-cc64f2a8a508 None admin] SCRIPT_NAME: `/identity` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:06:47.779699 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce894eb8-c75a-4579-92f8-cc64f2a8a508 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:06:47.791759 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce894eb8-c75a-4579-92f8-cc64f2a8a508 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:06:47.793183 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce894eb8-c75a-4579-92f8-cc64f2a8a508 None admin] RBAC: Authorization granted {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:06:47.808254 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application [None req-ce894eb8-c75a-4579-92f8-cc64f2a8a508 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 09:06:47.808254 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 09:06:47.808254 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 09:06:47.808254 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 09:06:47.808254 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 09:06:47.808254 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 09:06:47.808254 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 09:06:47.808254 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 09:06:47.808254 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 09:06:47.808254 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 09:06:47.808254 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 09:06:47.808254 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 09:06:47.808254 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 09:06:47.808254 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 09:06:47.808254 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 09:06:47.809431 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 09:06:47.809431 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 09:06:47.809431 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 09:06:47.809431 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 09:06:47.809431 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 09:06:47.809431 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 09:06:47.809431 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 09:06:47.809431 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 09:06:47.809431 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application with Lock( Jul 28 09:06:47.809431 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 09:06:47.809431 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self._enter() Jul 28 09:06:47.809431 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 09:06:47.809431 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 09:06:47.809431 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 09:06:47.809431 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self.creator() Jul 28 09:06:47.809431 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 09:06:47.809431 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application created_value = creator( Jul 28 09:06:47.810480 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 09:06:47.810480 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 09:06:47.810480 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 09:06:47.810480 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application Jul 28 09:06:47.810480 dv-cinder-851351-1-smb devstack@keystone.service[416293]: [pid: 416293|app: 0|req: 372/756] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 09:06:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 09:06:47.810797 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce894eb8-c75a-4579-92f8-cc64f2a8a508 None admin] Authenticating user token {{(pid=416293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:06:47.814858 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e59f6f9-aa03-4e7e-8a0f-037a3c230d99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:06:47.815509 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e59f6f9-aa03-4e7e-8a0f-037a3c230d99 None admin] REQUEST_METHOD: `GET` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:06:47.815801 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e59f6f9-aa03-4e7e-8a0f-037a3c230d99 None admin] SCRIPT_NAME: `/identity` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:06:47.816086 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e59f6f9-aa03-4e7e-8a0f-037a3c230d99 None admin] PATH_INFO: `/v3/services` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:06:47.816807 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e59f6f9-aa03-4e7e-8a0f-037a3c230d99 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=416294) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 09:06:47.817117 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e59f6f9-aa03-4e7e-8a0f-037a3c230d99 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:06:47.818513 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e59f6f9-aa03-4e7e-8a0f-037a3c230d99 None admin] RBAC: Authorization granted {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:06:47.828985 dv-cinder-851351-1-smb devstack@keystone.service[416294]: [pid: 416294|app: 0|req: 385/757] 10.222.0.42 () {56 vars in 1124 bytes} [Thu Jul 28 09:06:47 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:06:47.828985 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e59f6f9-aa03-4e7e-8a0f-037a3c230d99 None admin] Authenticating user token {{(pid=416294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:06:47.831290 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG dbcounter [-] [416293] Writing DB stats keystone:SELECT=100 {{(pid=416293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:06:47.928293 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce894eb8-c75a-4579-92f8-cc64f2a8a508 None admin] Validating token access rules against request {{(pid=416293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:06:47.929715 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e59f6f9-aa03-4e7e-8a0f-037a3c230d99 None admin] Validating token access rules against request {{(pid=416294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:06:47.966918 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e7404f-6cc8-4494-b742-b85735da332b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:06:47.967587 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e7404f-6cc8-4494-b742-b85735da332b None admin] REQUEST_METHOD: `GET` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:06:47.967864 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e7404f-6cc8-4494-b742-b85735da332b None admin] SCRIPT_NAME: `/identity` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:06:47.968062 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef4e2251-c1c9-4e21-a574-a7ec885dac0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:06:47.968179 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e7404f-6cc8-4494-b742-b85735da332b None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:06:47.968801 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4e2251-c1c9-4e21-a574-a7ec885dac0d None admin] REQUEST_METHOD: `PUT` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:06:47.969093 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4e2251-c1c9-4e21-a574-a7ec885dac0d None admin] SCRIPT_NAME: `/identity` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:06:47.969374 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4e2251-c1c9-4e21-a574-a7ec885dac0d None admin] PATH_INFO: `/v3/projects/6c4349445f224184b093d9dfd0dfc642/users/62f7da38a7044000bdf5790da751a45e/roles/c67085ec338243df8f9b7d6459036e23` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:06:47.971475 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef4e2251-c1c9-4e21-a574-a7ec885dac0d None admin] RBAC: Authorizing `identity:create_grant(project_id=6c4349445f224184b093d9dfd0dfc642, user_id=62f7da38a7044000bdf5790da751a45e, role_id=c67085ec338243df8f9b7d6459036e23)` {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:06:47.973002 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef4e2251-c1c9-4e21-a574-a7ec885dac0d None admin] RBAC: Authorization granted {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:06:47.977454 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7e7404f-6cc8-4494-b742-b85735da332b None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:06:47.979011 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7e7404f-6cc8-4494-b742-b85735da332b None admin] RBAC: Authorization granted {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:06:47.987673 dv-cinder-851351-1-smb devstack@keystone.service[416293]: [pid: 416293|app: 0|req: 373/758] 10.222.0.42 () {58 vars in 1439 bytes} [Thu Jul 28 09:06:47 2022] PUT /identity/v3/projects/6c4349445f224184b093d9dfd0dfc642/users/62f7da38a7044000bdf5790da751a45e/roles/c67085ec338243df8f9b7d6459036e23 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 09:06:47.988516 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef4e2251-c1c9-4e21-a574-a7ec885dac0d None admin] Authenticating user token {{(pid=416293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:06:47.991111 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application [None req-e7e7404f-6cc8-4494-b742-b85735da332b None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 28 09:06:47.991111 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 09:06:47.991111 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 09:06:47.991111 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 09:06:47.991111 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 09:06:47.991111 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 09:06:47.991111 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 09:06:47.991111 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 09:06:47.991111 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 09:06:47.991111 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 09:06:47.991111 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 09:06:47.991111 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 09:06:47.991111 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 28 09:06:47.991111 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 28 09:06:47.991111 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 28 09:06:47.991111 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 28 09:06:47.992344 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 09:06:47.992344 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 09:06:47.992344 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 28 09:06:47.992344 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 09:06:47.992344 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 28 09:06:47.992344 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 09:06:47.992344 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 09:06:47.992344 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 09:06:47.992344 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 09:06:47.992344 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 09:06:47.992344 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 09:06:47.992344 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application with Lock( Jul 28 09:06:47.992344 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 09:06:47.992344 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return self._enter() Jul 28 09:06:47.992344 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 09:06:47.992344 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 09:06:47.992344 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 09:06:47.992344 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return self.creator() Jul 28 09:06:47.994051 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 09:06:47.994051 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application created_value = creator( Jul 28 09:06:47.994051 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 28 09:06:47.994051 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 28 09:06:47.994051 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 28 09:06:47.994051 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 28 09:06:47.994051 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 28 09:06:47.994051 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 28 09:06:47.994051 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 28 09:06:47.994051 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application Jul 28 09:06:47.994051 dv-cinder-851351-1-smb devstack@keystone.service[416294]: [pid: 416294|app: 0|req: 386/759] 10.222.0.42 () {56 vars in 1117 bytes} [Thu Jul 28 09:06:47 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 09:06:47.994051 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e7404f-6cc8-4494-b742-b85735da332b None admin] Authenticating user token {{(pid=416294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:06:48.031481 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG dbcounter [-] [416294] Writing DB stats keystone:SELECT=100 {{(pid=416294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:06:48.092893 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG dbcounter [-] [416293] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=416293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:06:48.121975 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e7404f-6cc8-4494-b742-b85735da332b None admin] Validating token access rules against request {{(pid=416294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:06:48.131830 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef4e2251-c1c9-4e21-a574-a7ec885dac0d None admin] Validating token access rules against request {{(pid=416293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:06:48.169310 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88522d51-4a63-490e-83d9-6e7bbd843062 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:06:48.169955 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88522d51-4a63-490e-83d9-6e7bbd843062 None admin] REQUEST_METHOD: `GET` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:06:48.170234 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88522d51-4a63-490e-83d9-6e7bbd843062 None admin] SCRIPT_NAME: `/identity` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:06:48.170773 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88522d51-4a63-490e-83d9-6e7bbd843062 None admin] PATH_INFO: `/v3/services` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:06:48.171192 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88522d51-4a63-490e-83d9-6e7bbd843062 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=416294) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 09:06:48.171492 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88522d51-4a63-490e-83d9-6e7bbd843062 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:06:48.172961 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88522d51-4a63-490e-83d9-6e7bbd843062 None admin] RBAC: Authorization granted {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:06:48.176152 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73cf8dcc-bcdb-4dc5-87fe-b28bdbb3b5a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:06:48.176835 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73cf8dcc-bcdb-4dc5-87fe-b28bdbb3b5a0 None admin] REQUEST_METHOD: `GET` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:06:48.177126 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73cf8dcc-bcdb-4dc5-87fe-b28bdbb3b5a0 None admin] SCRIPT_NAME: `/identity` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:06:48.177409 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73cf8dcc-bcdb-4dc5-87fe-b28bdbb3b5a0 None admin] PATH_INFO: `/v3/domains` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:06:48.178129 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73cf8dcc-bcdb-4dc5-87fe-b28bdbb3b5a0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=416293) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 09:06:48.181590 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73cf8dcc-bcdb-4dc5-87fe-b28bdbb3b5a0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:06:48.181746 dv-cinder-851351-1-smb devstack@keystone.service[416294]: [pid: 416294|app: 0|req: 387/760] 10.222.0.42 () {56 vars in 1124 bytes} [Thu Jul 28 09:06:47 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:06:48.181746 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0758f4-b56d-43df-aa44-1631a9c0e3a6 None None] REQUEST_METHOD: `GET` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:06:48.181897 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73cf8dcc-bcdb-4dc5-87fe-b28bdbb3b5a0 None admin] RBAC: Authorization granted {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:06:48.181973 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0758f4-b56d-43df-aa44-1631a9c0e3a6 None None] SCRIPT_NAME: `/identity` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:06:48.181973 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0758f4-b56d-43df-aa44-1631a9c0e3a6 None None] PATH_INFO: `/` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:06:48.181973 dv-cinder-851351-1-smb devstack@keystone.service[416294]: [pid: 416294|app: 0|req: 388/761] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 09:06:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 09:06:48.182501 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0758f4-b56d-43df-aa44-1631a9c0e3a6 None None] Authenticating user token {{(pid=416294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:06:48.197741 dv-cinder-851351-1-smb devstack@keystone.service[416293]: [pid: 416293|app: 0|req: 374/762] 10.222.0.42 () {56 vars in 1109 bytes} [Thu Jul 28 09:06:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:06:48.198981 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73cf8dcc-bcdb-4dc5-87fe-b28bdbb3b5a0 None admin] Authenticating user token {{(pid=416293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:06:48.300058 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG dbcounter [-] [416294] Writing DB stats keystone:SELECT=100 {{(pid=416294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:06:48.313623 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0758f4-b56d-43df-aa44-1631a9c0e3a6 None None] Validating token access rules against request {{(pid=416294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:06:48.314447 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73cf8dcc-bcdb-4dc5-87fe-b28bdbb3b5a0 None admin] Validating token access rules against request {{(pid=416293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:06:48.349384 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG dbcounter [-] [416293] Writing DB stats keystone:SELECT=100 {{(pid=416293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:06:48.351510 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a291c1-3932-4024-8ac5-96040ab052b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:06:48.352103 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a291c1-3932-4024-8ac5-96040ab052b4 None admin] REQUEST_METHOD: `GET` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:06:48.352439 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a291c1-3932-4024-8ac5-96040ab052b4 None admin] SCRIPT_NAME: `/identity` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:06:48.352686 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a291c1-3932-4024-8ac5-96040ab052b4 None admin] PATH_INFO: `/v3/users` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:06:48.353558 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a291c1-3932-4024-8ac5-96040ab052b4 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=416294) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 09:06:48.353872 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a291c1-3932-4024-8ac5-96040ab052b4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:06:48.355337 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a291c1-3932-4024-8ac5-96040ab052b4 None admin] RBAC: Authorization granted {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:06:48.357814 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e2d870f-90a0-43d0-b992-92442da523e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:06:48.358485 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2d870f-90a0-43d0-b992-92442da523e7 None admin] REQUEST_METHOD: `GET` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:06:48.358787 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2d870f-90a0-43d0-b992-92442da523e7 None admin] SCRIPT_NAME: `/identity` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:06:48.359054 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2d870f-90a0-43d0-b992-92442da523e7 None admin] PATH_INFO: `/v3/endpoints` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:06:48.359876 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e2d870f-90a0-43d0-b992-92442da523e7 None admin] RBAC: Adding query filter params (interface=public, service_id=330c63d2517f4315953a61fbc94b6a6b, region_id=RegionOne) {{(pid=416293) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 09:06:48.360194 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e2d870f-90a0-43d0-b992-92442da523e7 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:06:48.361805 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e2d870f-90a0-43d0-b992-92442da523e7 None admin] RBAC: Authorization granted {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:06:48.372811 dv-cinder-851351-1-smb devstack@keystone.service[416293]: [pid: 416293|app: 0|req: 375/763] 10.222.0.42 () {56 vars in 1251 bytes} [Thu Jul 28 09:06:48 2022] GET /identity/v3/endpoints?service_id=330c63d2517f4315953a61fbc94b6a6b&interface=public®ion_id=RegionOne => generated 194 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:06:48.377788 dv-cinder-851351-1-smb devstack@keystone.service[416294]: [pid: 416294|app: 0|req: 389/764] 10.222.0.42 () {56 vars in 1149 bytes} [Thu Jul 28 09:06:48 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:06:48.378735 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a291c1-3932-4024-8ac5-96040ab052b4 None admin] Authenticating user token {{(pid=416294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:06:48.379939 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27fa6bc7-f4d1-42d0-a81d-dc42f486a173 None None] REQUEST_METHOD: `POST` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:06:48.380618 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27fa6bc7-f4d1-42d0-a81d-dc42f486a173 None None] SCRIPT_NAME: `/identity` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:06:48.381863 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27fa6bc7-f4d1-42d0-a81d-dc42f486a173 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:06:48.404340 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.auth.core [None req-27fa6bc7-f4d1-42d0-a81d-dc42f486a173 None None] MFA Rules not processed for user `dbf87abab90e4fdf9e75408f4199918e`. Rule list: `[]` (Enabled: `True`). {{(pid=416293) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 09:06:48.405609 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.fernet_utils [None req-27fa6bc7-f4d1-42d0-a81d-dc42f486a173 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=416293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 09:06:48.488933 dv-cinder-851351-1-smb devstack@keystone.service[416293]: [pid: 416293|app: 0|req: 376/765] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 09:06:48 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 09:06:48.488933 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27fa6bc7-f4d1-42d0-a81d-dc42f486a173 None None] Authenticating user token {{(pid=416293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:06:48.503937 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a291c1-3932-4024-8ac5-96040ab052b4 None admin] Validating token access rules against request {{(pid=416294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:06:48.541773 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae5170f-86a5-4329-90c8-7f6202b2806f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:06:48.542756 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae5170f-86a5-4329-90c8-7f6202b2806f None admin] REQUEST_METHOD: `GET` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:06:48.543191 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae5170f-86a5-4329-90c8-7f6202b2806f None admin] SCRIPT_NAME: `/identity` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:06:48.543732 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae5170f-86a5-4329-90c8-7f6202b2806f None admin] PATH_INFO: `/v3/projects/service` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:06:48.552631 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ae5170f-86a5-4329-90c8-7f6202b2806f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:06:48.554353 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ae5170f-86a5-4329-90c8-7f6202b2806f None admin] RBAC: Authorization granted {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:06:48.566800 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application [None req-0ae5170f-86a5-4329-90c8-7f6202b2806f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 09:06:48.566800 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 09:06:48.566800 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 09:06:48.566800 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 09:06:48.566800 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 09:06:48.566800 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 09:06:48.566800 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 09:06:48.566800 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 09:06:48.566800 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 09:06:48.566800 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 09:06:48.566800 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 09:06:48.566800 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 09:06:48.566800 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 28 09:06:48.566800 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 28 09:06:48.566800 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 28 09:06:48.567861 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 28 09:06:48.567861 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 09:06:48.567861 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 09:06:48.567861 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 09:06:48.567861 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 09:06:48.567861 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 09:06:48.567861 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 09:06:48.567861 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 09:06:48.567861 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application with Lock( Jul 28 09:06:48.567861 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 09:06:48.567861 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return self._enter() Jul 28 09:06:48.567861 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 09:06:48.567861 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 09:06:48.567861 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 09:06:48.567861 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return self.creator() Jul 28 09:06:48.567861 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 09:06:48.567861 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application created_value = creator( Jul 28 09:06:48.568912 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 28 09:06:48.568912 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 28 09:06:48.568912 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 28 09:06:48.568912 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 28 09:06:48.568912 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 28 09:06:48.568912 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 28 09:06:48.568912 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 09:06:48.568912 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application Jul 28 09:06:48.573003 dv-cinder-851351-1-smb devstack@keystone.service[416294]: [pid: 416294|app: 0|req: 390/766] 10.222.0.42 () {56 vars in 1111 bytes} [Thu Jul 28 09:06:48 2022] GET /identity/v3/projects/service => generated 88 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 09:06:48.573959 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae5170f-86a5-4329-90c8-7f6202b2806f None admin] Authenticating user token {{(pid=416294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:06:48.586546 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG dbcounter [-] [416294] Writing DB stats keystone:SELECT=100 {{(pid=416294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:06:48.601364 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27fa6bc7-f4d1-42d0-a81d-dc42f486a173 None None] Validating token access rules against request {{(pid=416293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:06:48.630305 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG dbcounter [-] [416293] Writing DB stats keystone:SELECT=100 {{(pid=416293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:06:48.644271 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a3fbab-3377-413b-bdd6-cad3d8687615 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:06:48.644957 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a3fbab-3377-413b-bdd6-cad3d8687615 None admin] REQUEST_METHOD: `GET` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:06:48.645246 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a3fbab-3377-413b-bdd6-cad3d8687615 None admin] SCRIPT_NAME: `/identity` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:06:48.645530 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a3fbab-3377-413b-bdd6-cad3d8687615 None admin] PATH_INFO: `/v3/services` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:06:48.646212 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a3fbab-3377-413b-bdd6-cad3d8687615 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:06:48.647645 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a3fbab-3377-413b-bdd6-cad3d8687615 None admin] RBAC: Authorization granted {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:06:48.660001 dv-cinder-851351-1-smb devstack@keystone.service[416293]: [pid: 416293|app: 0|req: 377/767] 10.222.0.42 () {56 vars in 1087 bytes} [Thu Jul 28 09:06:48 2022] GET /identity/v3/services => generated 772 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:06:48.660001 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a3fbab-3377-413b-bdd6-cad3d8687615 None admin] Authenticating user token {{(pid=416293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:06:48.709522 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae5170f-86a5-4329-90c8-7f6202b2806f None admin] Validating token access rules against request {{(pid=416294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:06:48.763883 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7a3f10-5288-4dd6-8ad5-c9934a5a3024 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:06:48.765340 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7a3f10-5288-4dd6-8ad5-c9934a5a3024 None admin] REQUEST_METHOD: `GET` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:06:48.767443 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7a3f10-5288-4dd6-8ad5-c9934a5a3024 None admin] SCRIPT_NAME: `/identity` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:06:48.768409 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7a3f10-5288-4dd6-8ad5-c9934a5a3024 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:06:48.812718 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a3fbab-3377-413b-bdd6-cad3d8687615 None admin] Validating token access rules against request {{(pid=416293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:06:48.855757 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e7a3f10-5288-4dd6-8ad5-c9934a5a3024 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:06:48.856967 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e7a3f10-5288-4dd6-8ad5-c9934a5a3024 None admin] RBAC: Authorization granted {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:06:48.865119 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b0d1c4a-5827-4bdf-9295-e64222983f7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:06:48.865802 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0d1c4a-5827-4bdf-9295-e64222983f7a None admin] REQUEST_METHOD: `GET` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:06:48.866109 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0d1c4a-5827-4bdf-9295-e64222983f7a None admin] SCRIPT_NAME: `/identity` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:06:48.866364 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0d1c4a-5827-4bdf-9295-e64222983f7a None admin] PATH_INFO: `/v3/services/network` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:06:48.867018 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b0d1c4a-5827-4bdf-9295-e64222983f7a None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:06:48.868440 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b0d1c4a-5827-4bdf-9295-e64222983f7a None admin] RBAC: Authorization granted {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:06:48.871020 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG dbcounter [-] [416294] Writing DB stats keystone:SELECT=100 {{(pid=416294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:06:48.881235 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application [None req-4b0d1c4a-5827-4bdf-9295-e64222983f7a None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jul 28 09:06:48.881235 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 09:06:48.881235 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 28 09:06:48.881235 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 28 09:06:48.881235 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 28 09:06:48.881235 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 28 09:06:48.881235 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 28 09:06:48.881235 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 09:06:48.881235 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 28 09:06:48.881235 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application Jul 28 09:06:48.881235 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 28 09:06:48.881235 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application Jul 28 09:06:48.881235 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 09:06:48.881235 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 09:06:48.881235 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 09:06:48.881235 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 09:06:48.881235 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 09:06:48.882408 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 09:06:48.882408 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 09:06:48.882408 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 09:06:48.882408 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 09:06:48.882408 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 09:06:48.882408 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 09:06:48.882408 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 28 09:06:48.882408 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 28 09:06:48.882408 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 28 09:06:48.882408 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 28 09:06:48.882408 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 09:06:48.882408 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 09:06:48.882408 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 09:06:48.882408 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 09:06:48.882408 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 09:06:48.882408 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 09:06:48.883995 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 09:06:48.883995 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application with Lock( Jul 28 09:06:48.883995 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 09:06:48.883995 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self._enter() Jul 28 09:06:48.883995 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 09:06:48.883995 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 09:06:48.883995 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 09:06:48.883995 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self.creator() Jul 28 09:06:48.883995 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 09:06:48.883995 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application created_value = creator( Jul 28 09:06:48.883995 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 28 09:06:48.883995 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 09:06:48.883995 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 28 09:06:48.883995 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application Jul 28 09:06:48.883995 dv-cinder-851351-1-smb devstack@keystone.service[416293]: [pid: 416293|app: 0|req: 378/768] 10.222.0.42 () {56 vars in 1111 bytes} [Thu Jul 28 09:06:48 2022] GET /identity/v3/services/network => generated 88 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 09:06:48.885007 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b0d1c4a-5827-4bdf-9295-e64222983f7a None admin] Authenticating user token {{(pid=416293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:06:48.953311 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG dbcounter [-] [416293] Writing DB stats keystone:SELECT=100 {{(pid=416293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:06:48.984132 dv-cinder-851351-1-smb devstack@keystone.service[416294]: [pid: 416294|app: 0|req: 391/769] 10.222.0.42 () {58 vars in 1282 bytes} [Thu Jul 28 09:06:48 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 411 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 28 09:06:48.985543 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7a3f10-5288-4dd6-8ad5-c9934a5a3024 None admin] Authenticating user token {{(pid=416294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:06:48.999729 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b0d1c4a-5827-4bdf-9295-e64222983f7a None admin] Validating token access rules against request {{(pid=416293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:06:49.035593 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3931a9-1287-4dd1-88ca-9546e837ff99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:06:49.036248 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3931a9-1287-4dd1-88ca-9546e837ff99 None admin] REQUEST_METHOD: `GET` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:06:49.036534 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3931a9-1287-4dd1-88ca-9546e837ff99 None admin] SCRIPT_NAME: `/identity` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:06:49.036859 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3931a9-1287-4dd1-88ca-9546e837ff99 None admin] PATH_INFO: `/v3/projects` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:06:49.037890 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa3931a9-1287-4dd1-88ca-9546e837ff99 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=416293) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 09:06:49.038029 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa3931a9-1287-4dd1-88ca-9546e837ff99 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:06:49.039379 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa3931a9-1287-4dd1-88ca-9546e837ff99 None admin] RBAC: Authorization granted {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:06:49.056789 dv-cinder-851351-1-smb devstack@keystone.service[416293]: [pid: 416293|app: 0|req: 379/770] 10.222.0.42 () {56 vars in 1148 bytes} [Thu Jul 28 09:06:48 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:06:49.057731 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3931a9-1287-4dd1-88ca-9546e837ff99 None admin] Authenticating user token {{(pid=416293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:06:49.098391 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7a3f10-5288-4dd6-8ad5-c9934a5a3024 None admin] Validating token access rules against request {{(pid=416294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:06:49.111222 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG dbcounter [-] [416294] Writing DB stats keystone:SELECT=100 {{(pid=416294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:06:49.140775 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a59e3ed-ef89-4c89-af13-23269b20d82a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:06:49.141991 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a59e3ed-ef89-4c89-af13-23269b20d82a None admin] REQUEST_METHOD: `GET` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:06:49.142494 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a59e3ed-ef89-4c89-af13-23269b20d82a None admin] SCRIPT_NAME: `/identity` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:06:49.143013 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a59e3ed-ef89-4c89-af13-23269b20d82a None admin] PATH_INFO: `/v3/services` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:06:49.144003 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a59e3ed-ef89-4c89-af13-23269b20d82a None admin] RBAC: Adding query filter params (name=network) {{(pid=416294) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 09:06:49.144548 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a59e3ed-ef89-4c89-af13-23269b20d82a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:06:49.146260 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a59e3ed-ef89-4c89-af13-23269b20d82a None admin] RBAC: Authorization granted {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:06:49.152321 dv-cinder-851351-1-smb devstack@keystone.service[416294]: [pid: 416294|app: 0|req: 392/771] 10.222.0.42 () {56 vars in 1112 bytes} [Thu Jul 28 09:06:48 2022] GET /identity/v3/services?name=network => generated 124 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:06:49.153724 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a59e3ed-ef89-4c89-af13-23269b20d82a None admin] Authenticating user token {{(pid=416294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:06:49.173898 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3931a9-1287-4dd1-88ca-9546e837ff99 None admin] Validating token access rules against request {{(pid=416293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:06:49.191279 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG dbcounter [-] [416293] Writing DB stats keystone:SELECT=100 {{(pid=416293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:06:49.228219 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f51f37-5357-4942-89ab-717f20e90dee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:06:49.229305 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f51f37-5357-4942-89ab-717f20e90dee None admin] REQUEST_METHOD: `GET` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:06:49.229814 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f51f37-5357-4942-89ab-717f20e90dee None admin] SCRIPT_NAME: `/identity` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:06:49.230456 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f51f37-5357-4942-89ab-717f20e90dee None admin] PATH_INFO: `/v3/domains/Default` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:06:49.245028 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f51f37-5357-4942-89ab-717f20e90dee None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:06:49.247094 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f51f37-5357-4942-89ab-717f20e90dee None admin] RBAC: Authorization granted {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:06:49.267778 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a59e3ed-ef89-4c89-af13-23269b20d82a None admin] Validating token access rules against request {{(pid=416294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:06:49.269175 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application [None req-04f51f37-5357-4942-89ab-717f20e90dee None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 09:06:49.269175 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 09:06:49.269175 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 09:06:49.269175 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 09:06:49.269175 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 09:06:49.269175 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 09:06:49.269175 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 09:06:49.269175 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 09:06:49.269175 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 09:06:49.269175 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 09:06:49.269175 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 09:06:49.269175 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 09:06:49.269175 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 09:06:49.269175 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 09:06:49.269175 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 09:06:49.270140 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 09:06:49.270140 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 09:06:49.270140 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 09:06:49.270140 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 09:06:49.270140 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 09:06:49.270140 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 09:06:49.270140 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 09:06:49.270140 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 09:06:49.270140 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application with Lock( Jul 28 09:06:49.270140 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 09:06:49.270140 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self._enter() Jul 28 09:06:49.270140 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 09:06:49.270140 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 09:06:49.270140 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 09:06:49.270140 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self.creator() Jul 28 09:06:49.270140 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 09:06:49.270140 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application created_value = creator( Jul 28 09:06:49.271145 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 09:06:49.271145 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 09:06:49.271145 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 09:06:49.271145 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application Jul 28 09:06:49.279224 dv-cinder-851351-1-smb devstack@keystone.service[416293]: [pid: 416293|app: 0|req: 380/772] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 09:06:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 09:06:49.280373 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f51f37-5357-4942-89ab-717f20e90dee None admin] Authenticating user token {{(pid=416293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:06:49.308805 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137a2535-c431-4220-9dd4-9576ef27094c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:06:49.309629 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137a2535-c431-4220-9dd4-9576ef27094c None admin] REQUEST_METHOD: `GET` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:06:49.310014 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137a2535-c431-4220-9dd4-9576ef27094c None admin] SCRIPT_NAME: `/identity` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:06:49.310390 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137a2535-c431-4220-9dd4-9576ef27094c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:06:49.311515 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-137a2535-c431-4220-9dd4-9576ef27094c None admin] RBAC: Adding query filter params (role.id=c67085ec338243df8f9b7d6459036e23, scope.project.id=6c4349445f224184b093d9dfd0dfc642, user.id=1a2e0811e3e347a387717df1e23d61bf) {{(pid=416294) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 09:06:49.311671 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-137a2535-c431-4220-9dd4-9576ef27094c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:06:49.313321 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-137a2535-c431-4220-9dd4-9576ef27094c None admin] RBAC: Authorization granted {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:06:49.324772 dv-cinder-851351-1-smb devstack@keystone.service[416294]: [pid: 416294|app: 0|req: 393/773] 10.222.0.42 () {56 vars in 1374 bytes} [Thu Jul 28 09:06:49 2022] GET /identity/v3/role_assignments?user.id=1a2e0811e3e347a387717df1e23d61bf&scope.project.id=6c4349445f224184b093d9dfd0dfc642&role.id=c67085ec338243df8f9b7d6459036e23 => generated 259 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:06:49.325878 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137a2535-c431-4220-9dd4-9576ef27094c None admin] Authenticating user token {{(pid=416294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:06:49.415851 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f51f37-5357-4942-89ab-717f20e90dee None admin] Validating token access rules against request {{(pid=416293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:06:49.459367 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG dbcounter [-] [416294] Writing DB stats keystone:SELECT=100 {{(pid=416294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:06:49.460064 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e59fb3-04cd-49f3-a32c-f46e1f0228c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:06:49.461040 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e59fb3-04cd-49f3-a32c-f46e1f0228c7 None admin] REQUEST_METHOD: `GET` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:06:49.464938 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e59fb3-04cd-49f3-a32c-f46e1f0228c7 None admin] SCRIPT_NAME: `/identity` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:06:49.464938 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e59fb3-04cd-49f3-a32c-f46e1f0228c7 None admin] PATH_INFO: `/v3/services` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:06:49.464938 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89e59fb3-04cd-49f3-a32c-f46e1f0228c7 None admin] RBAC: Adding query filter params (type=network) {{(pid=416293) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 09:06:49.464938 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89e59fb3-04cd-49f3-a32c-f46e1f0228c7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:06:49.464938 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89e59fb3-04cd-49f3-a32c-f46e1f0228c7 None admin] RBAC: Authorization granted {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:06:49.477294 dv-cinder-851351-1-smb devstack@keystone.service[416293]: [pid: 416293|app: 0|req: 381/774] 10.222.0.42 () {56 vars in 1112 bytes} [Thu Jul 28 09:06:49 2022] GET /identity/v3/services?type=network => generated 350 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:06:49.479903 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e59fb3-04cd-49f3-a32c-f46e1f0228c7 None admin] Authenticating user token {{(pid=416293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:06:49.518065 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG dbcounter [-] [416293] Writing DB stats keystone:SELECT=100 {{(pid=416293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:06:49.610253 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e59fb3-04cd-49f3-a32c-f46e1f0228c7 None admin] Validating token access rules against request {{(pid=416293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:06:49.653154 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15ac991-b2d1-4b65-891a-9dd392c58b3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:06:49.654186 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15ac991-b2d1-4b65-891a-9dd392c58b3b None admin] REQUEST_METHOD: `GET` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:06:49.655573 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15ac991-b2d1-4b65-891a-9dd392c58b3b None admin] SCRIPT_NAME: `/identity` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:06:49.656075 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15ac991-b2d1-4b65-891a-9dd392c58b3b None admin] PATH_INFO: `/v3/endpoints` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:06:49.656429 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137a2535-c431-4220-9dd4-9576ef27094c None admin] Validating token access rules against request {{(pid=416294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:06:49.657452 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b15ac991-b2d1-4b65-891a-9dd392c58b3b None admin] RBAC: Adding query filter params (interface=public, service_id=bf83b21e5ac44bb29b5c5da36cc4a427, region_id=RegionOne) {{(pid=416293) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 09:06:49.657994 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b15ac991-b2d1-4b65-891a-9dd392c58b3b None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:06:49.659829 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b15ac991-b2d1-4b65-891a-9dd392c58b3b None admin] RBAC: Authorization granted {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:06:49.667876 dv-cinder-851351-1-smb devstack@keystone.service[416293]: [pid: 416293|app: 0|req: 382/775] 10.222.0.42 () {56 vars in 1251 bytes} [Thu Jul 28 09:06:49 2022] GET /identity/v3/endpoints?service_id=bf83b21e5ac44bb29b5c5da36cc4a427&interface=public®ion_id=RegionOne => generated 194 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:06:49.674484 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15ac991-b2d1-4b65-891a-9dd392c58b3b None admin] Authenticating user token {{(pid=416293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:06:49.785146 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG dbcounter [-] [416293] Writing DB stats keystone:SELECT=100 {{(pid=416293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:06:49.798171 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15ac991-b2d1-4b65-891a-9dd392c58b3b None admin] Validating token access rules against request {{(pid=416293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:06:49.809461 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e7cd581-470d-41bb-a315-64610017b291 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:06:49.810189 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7cd581-470d-41bb-a315-64610017b291 None admin] REQUEST_METHOD: `GET` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:06:49.810396 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7cd581-470d-41bb-a315-64610017b291 None admin] SCRIPT_NAME: `/identity` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:06:49.810678 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7cd581-470d-41bb-a315-64610017b291 None admin] PATH_INFO: `/v3/domains` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:06:49.811406 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e7cd581-470d-41bb-a315-64610017b291 None admin] RBAC: Adding query filter params (name=Default) {{(pid=416294) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 09:06:49.811719 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e7cd581-470d-41bb-a315-64610017b291 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:06:49.813165 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e7cd581-470d-41bb-a315-64610017b291 None admin] RBAC: Authorization granted {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:06:49.848487 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9634fa8b-c978-49ad-8567-4141bd1f0aac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:06:49.850025 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9634fa8b-c978-49ad-8567-4141bd1f0aac None admin] REQUEST_METHOD: `GET` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:06:49.850530 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9634fa8b-c978-49ad-8567-4141bd1f0aac None admin] SCRIPT_NAME: `/identity` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:06:49.851045 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9634fa8b-c978-49ad-8567-4141bd1f0aac None admin] PATH_INFO: `/v3/services` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:06:49.851944 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9634fa8b-c978-49ad-8567-4141bd1f0aac None admin] RBAC: Authorizing `identity:list_services()` {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:06:49.853661 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9634fa8b-c978-49ad-8567-4141bd1f0aac None admin] RBAC: Authorization granted {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:06:49.855064 dv-cinder-851351-1-smb devstack@keystone.service[416294]: [pid: 416294|app: 0|req: 394/776] 10.222.0.42 () {56 vars in 1109 bytes} [Thu Jul 28 09:06:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 530 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:06:49.866176 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e7cd581-470d-41bb-a315-64610017b291 None admin] Authenticating user token {{(pid=416294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:06:49.867499 dv-cinder-851351-1-smb devstack@keystone.service[416293]: [pid: 416293|app: 0|req: 383/777] 10.222.0.42 () {56 vars in 1087 bytes} [Thu Jul 28 09:06:49 2022] GET /identity/v3/services => generated 772 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:06:50.144691 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG dbcounter [-] [416294] Writing DB stats keystone:SELECT=100 {{(pid=416294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:06:50.160530 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e7cd581-470d-41bb-a315-64610017b291 None admin] Validating token access rules against request {{(pid=416294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:06:50.204805 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ebebbc8-a694-4332-b390-62ecfbdfd025 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:06:50.205636 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ebebbc8-a694-4332-b390-62ecfbdfd025 None admin] REQUEST_METHOD: `GET` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:06:50.206051 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ebebbc8-a694-4332-b390-62ecfbdfd025 None admin] SCRIPT_NAME: `/identity` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:06:50.206365 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ebebbc8-a694-4332-b390-62ecfbdfd025 None admin] PATH_INFO: `/v3/projects/service` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:06:50.214380 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ebebbc8-a694-4332-b390-62ecfbdfd025 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:06:50.215844 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ebebbc8-a694-4332-b390-62ecfbdfd025 None admin] RBAC: Authorization granted {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:06:50.227937 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application [None req-0ebebbc8-a694-4332-b390-62ecfbdfd025 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 09:06:50.227937 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 09:06:50.227937 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 09:06:50.227937 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 09:06:50.227937 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 09:06:50.227937 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 09:06:50.227937 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 09:06:50.227937 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 09:06:50.227937 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 09:06:50.227937 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 09:06:50.227937 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 09:06:50.227937 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 09:06:50.227937 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 28 09:06:50.227937 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 28 09:06:50.227937 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 28 09:06:50.229055 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 28 09:06:50.229055 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 09:06:50.229055 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 09:06:50.229055 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 09:06:50.229055 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 09:06:50.229055 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 09:06:50.229055 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 09:06:50.229055 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 09:06:50.229055 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application with Lock( Jul 28 09:06:50.229055 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 09:06:50.229055 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return self._enter() Jul 28 09:06:50.229055 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 09:06:50.229055 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 09:06:50.229055 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 09:06:50.229055 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return self.creator() Jul 28 09:06:50.229055 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 09:06:50.229055 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application created_value = creator( Jul 28 09:06:50.230751 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 28 09:06:50.230751 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 28 09:06:50.230751 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 28 09:06:50.230751 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 28 09:06:50.230751 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 28 09:06:50.230751 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 28 09:06:50.230751 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 09:06:50.230751 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application Jul 28 09:06:50.230751 dv-cinder-851351-1-smb devstack@keystone.service[416294]: [pid: 416294|app: 0|req: 395/778] 10.222.0.42 () {56 vars in 1111 bytes} [Thu Jul 28 09:06:49 2022] GET /identity/v3/projects/service => generated 88 bytes in 364 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 09:06:50.237829 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9634fa8b-c978-49ad-8567-4141bd1f0aac None admin] Authenticating user token {{(pid=416293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:06:50.343877 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9634fa8b-c978-49ad-8567-4141bd1f0aac None admin] Validating token access rules against request {{(pid=416293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:06:50.380376 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77da641a-8380-4fbe-be28-068bc1ab1e78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:06:50.381085 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77da641a-8380-4fbe-be28-068bc1ab1e78 None admin] REQUEST_METHOD: `GET` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:06:50.381426 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77da641a-8380-4fbe-be28-068bc1ab1e78 None admin] SCRIPT_NAME: `/identity` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:06:50.381608 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77da641a-8380-4fbe-be28-068bc1ab1e78 None admin] PATH_INFO: `/v3/projects` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:06:50.382374 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77da641a-8380-4fbe-be28-068bc1ab1e78 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=416293) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 09:06:50.382678 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77da641a-8380-4fbe-be28-068bc1ab1e78 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:06:50.384133 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77da641a-8380-4fbe-be28-068bc1ab1e78 None admin] RBAC: Authorization granted {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:06:50.398279 dv-cinder-851351-1-smb devstack@keystone.service[416293]: [pid: 416293|app: 0|req: 384/779] 10.222.0.42 () {56 vars in 1148 bytes} [Thu Jul 28 09:06:50 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:06:50.405841 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ebebbc8-a694-4332-b390-62ecfbdfd025 None admin] Authenticating user token {{(pid=416294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:06:50.464415 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb25d69-77d8-4fc4-9dc2-c72f53a95a24 None None] REQUEST_METHOD: `GET` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:06:50.464854 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb25d69-77d8-4fc4-9dc2-c72f53a95a24 None None] SCRIPT_NAME: `/identity` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:06:50.465392 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb25d69-77d8-4fc4-9dc2-c72f53a95a24 None None] PATH_INFO: `/` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:06:50.467440 dv-cinder-851351-1-smb devstack@keystone.service[416293]: [pid: 416293|app: 0|req: 385/780] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 09:06:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 28 09:06:50.473902 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a029d88-9af2-46bc-97e6-4df0af1754e6 None None] REQUEST_METHOD: `POST` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:06:50.474200 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a029d88-9af2-46bc-97e6-4df0af1754e6 None None] SCRIPT_NAME: `/identity` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:06:50.474450 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a029d88-9af2-46bc-97e6-4df0af1754e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:06:50.495088 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.auth.core [None req-1a029d88-9af2-46bc-97e6-4df0af1754e6 None None] MFA Rules not processed for user `dbf87abab90e4fdf9e75408f4199918e`. Rule list: `[]` (Enabled: `True`). {{(pid=416293) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 09:06:50.496239 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.fernet_utils [None req-1a029d88-9af2-46bc-97e6-4df0af1754e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=416293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 09:06:50.514189 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG dbcounter [-] [416293] Writing DB stats keystone:SELECT=100 {{(pid=416293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:06:50.599524 dv-cinder-851351-1-smb devstack@keystone.service[416293]: [pid: 416293|app: 0|req: 386/781] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 09:06:50 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 28 09:06:50.623068 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ebebbc8-a694-4332-b390-62ecfbdfd025 None admin] Validating token access rules against request {{(pid=416294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:06:50.658321 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a029d88-9af2-46bc-97e6-4df0af1754e6 None None] Authenticating user token {{(pid=416293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:06:50.682598 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d619d36a-85f6-4312-8413-db571444cc4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:06:50.684626 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d619d36a-85f6-4312-8413-db571444cc4d None admin] REQUEST_METHOD: `GET` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:06:50.687592 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d619d36a-85f6-4312-8413-db571444cc4d None admin] SCRIPT_NAME: `/identity` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:06:50.688713 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d619d36a-85f6-4312-8413-db571444cc4d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:06:50.690118 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d619d36a-85f6-4312-8413-db571444cc4d None admin] RBAC: Adding query filter params (role.id=13417fbdbc5145a69bc01ff0f931fd96, scope.project.id=6c4349445f224184b093d9dfd0dfc642, user.id=f5b664bdc0d04af8ac60a11e9a136c91) {{(pid=416294) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 09:06:50.691708 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d619d36a-85f6-4312-8413-db571444cc4d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:06:50.693710 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d619d36a-85f6-4312-8413-db571444cc4d None admin] RBAC: Authorization granted {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:06:50.707470 dv-cinder-851351-1-smb devstack@keystone.service[416294]: [pid: 416294|app: 0|req: 396/782] 10.222.0.42 () {56 vars in 1374 bytes} [Thu Jul 28 09:06:50 2022] GET /identity/v3/role_assignments?user.id=f5b664bdc0d04af8ac60a11e9a136c91&scope.project.id=6c4349445f224184b093d9dfd0dfc642&role.id=13417fbdbc5145a69bc01ff0f931fd96 => generated 259 bytes in 301 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:06:50.818663 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a029d88-9af2-46bc-97e6-4df0af1754e6 None None] Validating token access rules against request {{(pid=416293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:06:50.869444 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7cd7bd-15d9-4fa6-b6b1-f865f3b99ef4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:06:50.870960 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7cd7bd-15d9-4fa6-b6b1-f865f3b99ef4 None admin] REQUEST_METHOD: `GET` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:06:50.871480 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7cd7bd-15d9-4fa6-b6b1-f865f3b99ef4 None admin] SCRIPT_NAME: `/identity` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:06:50.871965 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7cd7bd-15d9-4fa6-b6b1-f865f3b99ef4 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:06:50.884690 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d7cd7bd-15d9-4fa6-b6b1-f865f3b99ef4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 09:06:50.890647 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application [None req-3d7cd7bd-15d9-4fa6-b6b1-f865f3b99ef4 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 09:06:50.890647 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 09:06:50.890647 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 09:06:50.890647 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 09:06:50.890647 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 09:06:50.890647 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 09:06:50.890647 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 09:06:50.890647 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 09:06:50.890647 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 09:06:50.890647 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 09:06:50.890647 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 09:06:50.890647 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 09:06:50.890647 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 09:06:50.890647 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 09:06:50.890647 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 09:06:50.890647 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 09:06:50.891800 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 09:06:50.891800 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 09:06:50.891800 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 09:06:50.891800 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 09:06:50.891800 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 09:06:50.891800 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 09:06:50.891800 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 09:06:50.891800 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 09:06:50.891800 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 09:06:50.891800 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 09:06:50.891800 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 09:06:50.891800 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application with Lock( Jul 28 09:06:50.891800 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 09:06:50.891800 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self._enter() Jul 28 09:06:50.891800 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 09:06:50.891800 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 09:06:50.892804 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 09:06:50.892804 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self.creator() Jul 28 09:06:50.892804 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 09:06:50.892804 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application created_value = creator( Jul 28 09:06:50.892804 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 09:06:50.892804 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 09:06:50.892804 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 09:06:50.892804 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 09:06:50.892804 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 09:06:50.892804 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 09:06:50.892804 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 09:06:50.892804 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application Jul 28 09:06:50.895891 dv-cinder-851351-1-smb devstack@keystone.service[416293]: [pid: 416293|app: 0|req: 387/783] 10.222.0.42 () {56 vars in 1096 bytes} [Thu Jul 28 09:06:50 2022] GET /identity/v3/roles/admin => generated 83 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 09:06:50.901747 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d619d36a-85f6-4312-8413-db571444cc4d None admin] Authenticating user token {{(pid=416294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:06:50.929832 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1e5354-67bd-4898-b734-b92e83a0ab62 None None] REQUEST_METHOD: `GET` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:06:50.930522 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1e5354-67bd-4898-b734-b92e83a0ab62 None None] SCRIPT_NAME: `/identity` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:06:50.931013 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1e5354-67bd-4898-b734-b92e83a0ab62 None None] PATH_INFO: `/` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:06:50.932983 dv-cinder-851351-1-smb devstack@keystone.service[416293]: [pid: 416293|app: 0|req: 388/784] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 09:06:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 28 09:06:50.938440 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG dbcounter [-] [416294] Writing DB stats keystone:SELECT=100 {{(pid=416294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:06:50.939579 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4c8edf-4e91-4a06-b093-45dd23b64147 None None] REQUEST_METHOD: `POST` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:06:50.940022 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4c8edf-4e91-4a06-b093-45dd23b64147 None None] SCRIPT_NAME: `/identity` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:06:50.940190 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4c8edf-4e91-4a06-b093-45dd23b64147 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:06:50.956454 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG dbcounter [-] [416293] Writing DB stats keystone:SELECT=100 {{(pid=416293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:06:50.966340 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.auth.core [None req-8f4c8edf-4e91-4a06-b093-45dd23b64147 None None] MFA Rules not processed for user `dbf87abab90e4fdf9e75408f4199918e`. Rule list: `[]` (Enabled: `True`). {{(pid=416293) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 09:06:50.970024 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.fernet_utils [None req-8f4c8edf-4e91-4a06-b093-45dd23b64147 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=416293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 09:06:51.048528 dv-cinder-851351-1-smb devstack@keystone.service[416293]: [pid: 416293|app: 0|req: 389/785] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 09:06:50 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 28 09:06:51.060173 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d619d36a-85f6-4312-8413-db571444cc4d None admin] Validating token access rules against request {{(pid=416294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:06:51.112363 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7b2d3f-155f-42b2-82b6-19446bfe1013 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:06:51.113049 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7b2d3f-155f-42b2-82b6-19446bfe1013 None admin] REQUEST_METHOD: `GET` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:06:51.113342 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7b2d3f-155f-42b2-82b6-19446bfe1013 None admin] SCRIPT_NAME: `/identity` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:06:51.113623 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7b2d3f-155f-42b2-82b6-19446bfe1013 None admin] PATH_INFO: `/v3/roles` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:06:51.114364 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da7b2d3f-155f-42b2-82b6-19446bfe1013 None admin] RBAC: Adding query filter params (name=admin) {{(pid=416294) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 09:06:51.114672 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da7b2d3f-155f-42b2-82b6-19446bfe1013 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:06:51.116069 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da7b2d3f-155f-42b2-82b6-19446bfe1013 None admin] RBAC: Authorization granted {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:06:51.132487 dv-cinder-851351-1-smb devstack@keystone.service[416294]: [pid: 416294|app: 0|req: 397/786] 10.222.0.42 () {56 vars in 1099 bytes} [Thu Jul 28 09:06:50 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:06:51.134134 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f4c8edf-4e91-4a06-b093-45dd23b64147 None None] Authenticating user token {{(pid=416293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:06:51.135545 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7b2d3f-155f-42b2-82b6-19446bfe1013 None admin] Authenticating user token {{(pid=416294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:06:51.239240 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG dbcounter [-] [416294] Writing DB stats keystone:SELECT=100 {{(pid=416294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:06:51.260391 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7b2d3f-155f-42b2-82b6-19446bfe1013 None admin] Validating token access rules against request {{(pid=416294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:06:51.309836 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e80668-c1ae-4386-965d-f485cc50954c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:06:51.310848 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e80668-c1ae-4386-965d-f485cc50954c None admin] REQUEST_METHOD: `GET` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:06:51.311296 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e80668-c1ae-4386-965d-f485cc50954c None admin] SCRIPT_NAME: `/identity` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:06:51.311740 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e80668-c1ae-4386-965d-f485cc50954c None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:06:51.312564 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3e80668-c1ae-4386-965d-f485cc50954c None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:06:51.314371 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3e80668-c1ae-4386-965d-f485cc50954c None admin] RBAC: Authorization granted {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:06:51.335480 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application [None req-c3e80668-c1ae-4386-965d-f485cc50954c None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 28 09:06:51.335480 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 09:06:51.335480 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 28 09:06:51.335480 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 28 09:06:51.335480 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 28 09:06:51.335480 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 28 09:06:51.335480 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 28 09:06:51.335480 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 09:06:51.335480 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 28 09:06:51.335480 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application Jul 28 09:06:51.335480 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 28 09:06:51.335480 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application Jul 28 09:06:51.335480 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 09:06:51.335480 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 09:06:51.335480 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 09:06:51.335480 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 09:06:51.336863 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 09:06:51.336863 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 09:06:51.336863 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 09:06:51.336863 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 09:06:51.336863 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 09:06:51.336863 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 09:06:51.336863 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 09:06:51.336863 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 28 09:06:51.336863 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 28 09:06:51.336863 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 28 09:06:51.336863 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 28 09:06:51.336863 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 09:06:51.336863 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 09:06:51.336863 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 09:06:51.336863 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 09:06:51.336863 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 09:06:51.338018 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 09:06:51.338018 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 09:06:51.338018 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application with Lock( Jul 28 09:06:51.338018 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 09:06:51.338018 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return self._enter() Jul 28 09:06:51.338018 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 09:06:51.338018 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 09:06:51.338018 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 09:06:51.338018 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return self.creator() Jul 28 09:06:51.338018 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 09:06:51.338018 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application created_value = creator( Jul 28 09:06:51.338018 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 28 09:06:51.338018 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 09:06:51.338018 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 28 09:06:51.338018 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application Jul 28 09:06:51.341622 dv-cinder-851351-1-smb devstack@keystone.service[416294]: [pid: 416294|app: 0|req: 398/787] 10.222.0.42 () {56 vars in 1129 bytes} [Thu Jul 28 09:06:51 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 09:06:51.348546 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e80668-c1ae-4386-965d-f485cc50954c None admin] Authenticating user token {{(pid=416294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:06:51.371873 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f4c8edf-4e91-4a06-b093-45dd23b64147 None None] Validating token access rules against request {{(pid=416293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:06:51.414882 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4302466-6bea-45c8-83af-8028a89ef251 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:06:51.415830 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4302466-6bea-45c8-83af-8028a89ef251 None admin] REQUEST_METHOD: `GET` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:06:51.416293 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4302466-6bea-45c8-83af-8028a89ef251 None admin] SCRIPT_NAME: `/identity` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:06:51.416764 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4302466-6bea-45c8-83af-8028a89ef251 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:06:51.420009 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG dbcounter [-] [416293] Writing DB stats keystone:SELECT=100 {{(pid=416293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:06:51.432542 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4302466-6bea-45c8-83af-8028a89ef251 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:06:51.434297 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4302466-6bea-45c8-83af-8028a89ef251 None admin] RBAC: Authorization granted {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:06:51.452037 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application [None req-a4302466-6bea-45c8-83af-8028a89ef251 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 09:06:51.452037 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 09:06:51.452037 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 09:06:51.452037 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 09:06:51.452037 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 09:06:51.452037 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 09:06:51.452037 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 09:06:51.452037 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 09:06:51.452037 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 09:06:51.452037 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 09:06:51.452037 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 09:06:51.452037 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 09:06:51.452037 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 09:06:51.452037 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 09:06:51.452037 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 09:06:51.453330 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 09:06:51.453330 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 09:06:51.453330 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 09:06:51.453330 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 09:06:51.453330 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 09:06:51.453330 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 09:06:51.453330 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 09:06:51.453330 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 09:06:51.453330 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application with Lock( Jul 28 09:06:51.453330 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 09:06:51.453330 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self._enter() Jul 28 09:06:51.453330 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 09:06:51.453330 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 09:06:51.453330 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 09:06:51.453330 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self.creator() Jul 28 09:06:51.453330 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 09:06:51.453330 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application created_value = creator( Jul 28 09:06:51.454606 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 09:06:51.454606 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 09:06:51.454606 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 09:06:51.454606 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application Jul 28 09:06:51.457173 dv-cinder-851351-1-smb devstack@keystone.service[416293]: [pid: 416293|app: 0|req: 390/788] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 09:06:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 324 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 09:06:51.463372 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4302466-6bea-45c8-83af-8028a89ef251 None admin] Authenticating user token {{(pid=416293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:06:51.586196 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4302466-6bea-45c8-83af-8028a89ef251 None admin] Validating token access rules against request {{(pid=416293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:06:51.632779 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eefe8e81-1bf4-4cec-9635-10e2b3840c68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:06:51.633741 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eefe8e81-1bf4-4cec-9635-10e2b3840c68 None admin] REQUEST_METHOD: `GET` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:06:51.634188 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eefe8e81-1bf4-4cec-9635-10e2b3840c68 None admin] SCRIPT_NAME: `/identity` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:06:51.634642 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eefe8e81-1bf4-4cec-9635-10e2b3840c68 None admin] PATH_INFO: `/v3/domains` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:06:51.635562 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eefe8e81-1bf4-4cec-9635-10e2b3840c68 None admin] RBAC: Adding query filter params (name=Default) {{(pid=416293) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 09:06:51.636042 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eefe8e81-1bf4-4cec-9635-10e2b3840c68 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:06:51.638471 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eefe8e81-1bf4-4cec-9635-10e2b3840c68 None admin] RBAC: Authorization granted {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:06:51.647158 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e80668-c1ae-4386-965d-f485cc50954c None admin] Validating token access rules against request {{(pid=416294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:06:51.655504 dv-cinder-851351-1-smb devstack@keystone.service[416293]: [pid: 416293|app: 0|req: 391/789] 10.222.0.42 () {56 vars in 1109 bytes} [Thu Jul 28 09:06:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 09:06:51.661430 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eefe8e81-1bf4-4cec-9635-10e2b3840c68 None admin] Authenticating user token {{(pid=416293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:06:51.731995 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG dbcounter [-] [416293] Writing DB stats keystone:SELECT=100 {{(pid=416293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:06:51.753428 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b5454f4-9506-4b2c-91f4-cc2486ebeb1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:06:51.754496 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5454f4-9506-4b2c-91f4-cc2486ebeb1c None admin] REQUEST_METHOD: `GET` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:06:51.754496 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5454f4-9506-4b2c-91f4-cc2486ebeb1c None admin] SCRIPT_NAME: `/identity` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:06:51.754706 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5454f4-9506-4b2c-91f4-cc2486ebeb1c None admin] PATH_INFO: `/v3/services` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:06:51.755345 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b5454f4-9506-4b2c-91f4-cc2486ebeb1c None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=416294) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 09:06:51.755649 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b5454f4-9506-4b2c-91f4-cc2486ebeb1c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:06:51.757090 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b5454f4-9506-4b2c-91f4-cc2486ebeb1c None admin] RBAC: Authorization granted {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:06:51.771035 dv-cinder-851351-1-smb devstack@keystone.service[416294]: [pid: 416294|app: 0|req: 399/790] 10.222.0.42 () {56 vars in 1124 bytes} [Thu Jul 28 09:06:51 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 423 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:06:51.776888 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b5454f4-9506-4b2c-91f4-cc2486ebeb1c None admin] Authenticating user token {{(pid=416294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:06:51.793865 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eefe8e81-1bf4-4cec-9635-10e2b3840c68 None admin] Validating token access rules against request {{(pid=416293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:06:51.810232 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG dbcounter [-] [416294] Writing DB stats keystone:SELECT=100 {{(pid=416294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:06:51.864129 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ed4319-1b3b-4425-8449-181bd9cc8f36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:06:51.864836 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ed4319-1b3b-4425-8449-181bd9cc8f36 None admin] REQUEST_METHOD: `GET` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:06:51.865182 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ed4319-1b3b-4425-8449-181bd9cc8f36 None admin] SCRIPT_NAME: `/identity` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:06:51.865459 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ed4319-1b3b-4425-8449-181bd9cc8f36 None admin] PATH_INFO: `/v3/users/nova` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:06:51.877574 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00ed4319-1b3b-4425-8449-181bd9cc8f36 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:06:51.879076 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00ed4319-1b3b-4425-8449-181bd9cc8f36 None admin] RBAC: Authorization granted {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:06:51.895519 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application [None req-00ed4319-1b3b-4425-8449-181bd9cc8f36 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 28 09:06:51.895519 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 09:06:51.895519 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 09:06:51.895519 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 09:06:51.895519 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 09:06:51.895519 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 09:06:51.895519 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 09:06:51.895519 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 09:06:51.895519 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 09:06:51.895519 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 09:06:51.895519 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 09:06:51.895519 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 09:06:51.895519 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 28 09:06:51.895519 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 28 09:06:51.895519 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 28 09:06:51.895519 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 28 09:06:51.896618 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 09:06:51.896618 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 09:06:51.896618 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 28 09:06:51.896618 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 09:06:51.896618 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 28 09:06:51.896618 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 09:06:51.896618 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 09:06:51.896618 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 09:06:51.896618 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 09:06:51.896618 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 09:06:51.896618 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 09:06:51.896618 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application with Lock( Jul 28 09:06:51.896618 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 09:06:51.896618 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self._enter() Jul 28 09:06:51.896618 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 09:06:51.896618 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 09:06:51.896618 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 09:06:51.896618 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self.creator() Jul 28 09:06:51.897731 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 09:06:51.897731 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application created_value = creator( Jul 28 09:06:51.897731 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 28 09:06:51.897731 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 28 09:06:51.897731 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 28 09:06:51.897731 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 28 09:06:51.897731 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 28 09:06:51.897731 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 28 09:06:51.897731 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 28 09:06:51.897731 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application Jul 28 09:06:51.901326 dv-cinder-851351-1-smb devstack@keystone.service[416293]: [pid: 416293|app: 0|req: 392/791] 10.222.0.42 () {56 vars in 1093 bytes} [Thu Jul 28 09:06:51 2022] GET /identity/v3/users/nova => generated 82 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 09:06:51.902696 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53977ce2-32f0-458c-9b2a-48addd9f42d9 None None] REQUEST_METHOD: `GET` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:06:51.903158 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53977ce2-32f0-458c-9b2a-48addd9f42d9 None None] SCRIPT_NAME: `/identity` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:06:51.903441 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53977ce2-32f0-458c-9b2a-48addd9f42d9 None None] PATH_INFO: `/` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:06:51.909123 dv-cinder-851351-1-smb devstack@keystone.service[416293]: [pid: 416293|app: 0|req: 393/792] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 09:06:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 09:06:51.910648 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53977ce2-32f0-458c-9b2a-48addd9f42d9 None None] Authenticating user token {{(pid=416293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:06:51.917013 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b5454f4-9506-4b2c-91f4-cc2486ebeb1c None admin] Validating token access rules against request {{(pid=416294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:06:51.961322 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e80bc09-6810-489d-bcb0-c6b279925134 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:06:51.962424 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e80bc09-6810-489d-bcb0-c6b279925134 None admin] REQUEST_METHOD: `GET` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:06:51.962707 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e80bc09-6810-489d-bcb0-c6b279925134 None admin] SCRIPT_NAME: `/identity` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:06:51.962983 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e80bc09-6810-489d-bcb0-c6b279925134 None admin] PATH_INFO: `/v3/services` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:06:51.966359 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e80bc09-6810-489d-bcb0-c6b279925134 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=416294) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 09:06:51.966359 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e80bc09-6810-489d-bcb0-c6b279925134 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:06:51.966359 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e80bc09-6810-489d-bcb0-c6b279925134 None admin] RBAC: Authorization granted {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:06:51.977586 dv-cinder-851351-1-smb devstack@keystone.service[416294]: [pid: 416294|app: 0|req: 400/793] 10.222.0.42 () {56 vars in 1124 bytes} [Thu Jul 28 09:06:51 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 09:06:51.977586 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5bdb75-2160-49e2-a5ab-927e841cca53 None None] REQUEST_METHOD: `POST` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:06:51.977586 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5bdb75-2160-49e2-a5ab-927e841cca53 None None] SCRIPT_NAME: `/identity` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:06:51.977586 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5bdb75-2160-49e2-a5ab-927e841cca53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:06:52.002262 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.auth.core [None req-5b5bdb75-2160-49e2-a5ab-927e841cca53 None None] MFA Rules not processed for user `dbf87abab90e4fdf9e75408f4199918e`. Rule list: `[]` (Enabled: `True`). {{(pid=416294) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 09:06:52.004814 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.fernet_utils [None req-5b5bdb75-2160-49e2-a5ab-927e841cca53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=416294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 09:06:52.046787 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53977ce2-32f0-458c-9b2a-48addd9f42d9 None None] Validating token access rules against request {{(pid=416293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:06:52.058532 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG dbcounter [-] [416293] Writing DB stats keystone:SELECT=100 {{(pid=416293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:06:52.092776 dv-cinder-851351-1-smb devstack@keystone.service[416294]: [pid: 416294|app: 0|req: 401/794] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 09:06:51 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 09:06:52.094041 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5bdb75-2160-49e2-a5ab-927e841cca53 None None] Authenticating user token {{(pid=416294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:06:52.107181 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b65219-0f6a-4b4e-8e17-8b262c2b8ac9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:06:52.108200 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b65219-0f6a-4b4e-8e17-8b262c2b8ac9 None admin] REQUEST_METHOD: `GET` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:06:52.108738 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b65219-0f6a-4b4e-8e17-8b262c2b8ac9 None admin] SCRIPT_NAME: `/identity` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:06:52.108997 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG dbcounter [-] [416294] Writing DB stats keystone:SELECT=100 {{(pid=416294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:06:52.109226 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b65219-0f6a-4b4e-8e17-8b262c2b8ac9 None admin] PATH_INFO: `/v3/users` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:06:52.110115 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01b65219-0f6a-4b4e-8e17-8b262c2b8ac9 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=416293) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 09:06:52.110435 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01b65219-0f6a-4b4e-8e17-8b262c2b8ac9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:06:52.111928 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01b65219-0f6a-4b4e-8e17-8b262c2b8ac9 None admin] RBAC: Authorization granted {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:06:52.134022 dv-cinder-851351-1-smb devstack@keystone.service[416293]: [pid: 416293|app: 0|req: 394/795] 10.222.0.42 () {56 vars in 1133 bytes} [Thu Jul 28 09:06:51 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:06:52.134897 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b65219-0f6a-4b4e-8e17-8b262c2b8ac9 None admin] Authenticating user token {{(pid=416293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:06:52.244516 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5bdb75-2160-49e2-a5ab-927e841cca53 None None] Validating token access rules against request {{(pid=416294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:06:52.253444 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b65219-0f6a-4b4e-8e17-8b262c2b8ac9 None admin] Validating token access rules against request {{(pid=416293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:06:52.291916 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe40738-23af-44f3-b6b1-f1030b6d3d30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:06:52.292774 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe40738-23af-44f3-b6b1-f1030b6d3d30 None admin] REQUEST_METHOD: `GET` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:06:52.293162 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe40738-23af-44f3-b6b1-f1030b6d3d30 None admin] SCRIPT_NAME: `/identity` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:06:52.293565 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe40738-23af-44f3-b6b1-f1030b6d3d30 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:06:52.294779 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cba0a7f-85d7-4d26-acec-c00f7fcefdc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:06:52.295422 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cba0a7f-85d7-4d26-acec-c00f7fcefdc1 None admin] REQUEST_METHOD: `POST` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:06:52.295971 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cba0a7f-85d7-4d26-acec-c00f7fcefdc1 None admin] SCRIPT_NAME: `/identity` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:06:52.296251 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cba0a7f-85d7-4d26-acec-c00f7fcefdc1 None admin] PATH_INFO: `/v3/endpoints` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:06:52.297768 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cba0a7f-85d7-4d26-acec-c00f7fcefdc1 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:06:52.299477 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cba0a7f-85d7-4d26-acec-c00f7fcefdc1 None admin] RBAC: Authorization granted {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:06:52.305610 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fe40738-23af-44f3-b6b1-f1030b6d3d30 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 09:06:52.311141 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application [None req-7fe40738-23af-44f3-b6b1-f1030b6d3d30 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 09:06:52.311141 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 09:06:52.311141 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 09:06:52.311141 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 09:06:52.311141 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 09:06:52.311141 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 09:06:52.311141 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 09:06:52.311141 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 09:06:52.311141 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 09:06:52.311141 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 09:06:52.311141 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 09:06:52.311141 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 09:06:52.311141 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 09:06:52.311141 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 09:06:52.311141 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 09:06:52.311141 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 09:06:52.312369 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 09:06:52.312369 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 09:06:52.312369 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 09:06:52.312369 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 09:06:52.312369 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 09:06:52.312369 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 09:06:52.312369 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 09:06:52.312369 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 09:06:52.312369 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 09:06:52.312369 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 09:06:52.312369 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 09:06:52.312369 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application with Lock( Jul 28 09:06:52.312369 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 09:06:52.312369 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self._enter() Jul 28 09:06:52.312369 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 09:06:52.312369 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 09:06:52.314389 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 09:06:52.314389 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self.creator() Jul 28 09:06:52.314389 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 09:06:52.314389 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application created_value = creator( Jul 28 09:06:52.314389 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 09:06:52.314389 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 09:06:52.314389 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 09:06:52.314389 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 09:06:52.314389 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 09:06:52.314389 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 09:06:52.314389 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 09:06:52.314389 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application Jul 28 09:06:52.314389 dv-cinder-851351-1-smb devstack@keystone.service[416293]: [pid: 416293|app: 0|req: 395/796] 10.222.0.42 () {56 vars in 1096 bytes} [Thu Jul 28 09:06:52 2022] GET /identity/v3/roles/admin => generated 83 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 09:06:52.320791 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe40738-23af-44f3-b6b1-f1030b6d3d30 None admin] Authenticating user token {{(pid=416293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:06:52.332410 dv-cinder-851351-1-smb devstack@keystone.service[416294]: [pid: 416294|app: 0|req: 402/797] 10.222.0.42 () {60 vars in 1144 bytes} [Thu Jul 28 09:06:52 2022] POST /identity/v3/endpoints => generated 346 bytes in 239 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 09:06:52.333653 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cba0a7f-85d7-4d26-acec-c00f7fcefdc1 None admin] Authenticating user token {{(pid=416294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:06:52.376583 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG dbcounter [-] [416293] Writing DB stats keystone:SELECT=100 {{(pid=416293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:06:52.419456 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG dbcounter [-] [416294] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=416294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:06:52.515103 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cba0a7f-85d7-4d26-acec-c00f7fcefdc1 None admin] Validating token access rules against request {{(pid=416294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:06:52.562188 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe40738-23af-44f3-b6b1-f1030b6d3d30 None admin] Validating token access rules against request {{(pid=416293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:06:52.586547 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ada387c-6e36-448c-ab3e-de5c4611728a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:06:52.588408 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ada387c-6e36-448c-ab3e-de5c4611728a None admin] REQUEST_METHOD: `GET` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:06:52.589141 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ada387c-6e36-448c-ab3e-de5c4611728a None admin] SCRIPT_NAME: `/identity` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:06:52.589777 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ada387c-6e36-448c-ab3e-de5c4611728a None admin] PATH_INFO: `/v3/roles` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:06:52.590866 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ada387c-6e36-448c-ab3e-de5c4611728a None admin] RBAC: Adding query filter params (name=admin) {{(pid=416294) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 09:06:52.591183 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ada387c-6e36-448c-ab3e-de5c4611728a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:06:52.593425 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ada387c-6e36-448c-ab3e-de5c4611728a None admin] RBAC: Authorization granted {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:06:52.603651 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2927ea-4a4e-438b-b92c-cfaf4edd1c75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:06:52.604824 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2927ea-4a4e-438b-b92c-cfaf4edd1c75 None admin] REQUEST_METHOD: `GET` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:06:52.605345 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2927ea-4a4e-438b-b92c-cfaf4edd1c75 None admin] SCRIPT_NAME: `/identity` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:06:52.605662 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2927ea-4a4e-438b-b92c-cfaf4edd1c75 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:06:52.606767 dv-cinder-851351-1-smb devstack@keystone.service[416294]: [pid: 416294|app: 0|req: 403/798] 10.222.0.42 () {56 vars in 1099 bytes} [Thu Jul 28 09:06:52 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:06:52.614877 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ada387c-6e36-448c-ab3e-de5c4611728a None admin] Authenticating user token {{(pid=416294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:06:52.694174 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc2927ea-4a4e-438b-b92c-cfaf4edd1c75 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:06:52.695645 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc2927ea-4a4e-438b-b92c-cfaf4edd1c75 None admin] RBAC: Authorization granted {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:06:52.731459 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG dbcounter [-] [416293] Writing DB stats keystone:SELECT=100 {{(pid=416293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:06:52.764976 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ada387c-6e36-448c-ab3e-de5c4611728a None admin] Validating token access rules against request {{(pid=416294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:06:52.788005 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG dbcounter [-] [416294] Writing DB stats keystone:SELECT=100 {{(pid=416294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:06:52.808246 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20f655d-5ea0-4277-9d97-403134dcc5f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:06:52.809289 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20f655d-5ea0-4277-9d97-403134dcc5f1 None admin] REQUEST_METHOD: `GET` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:06:52.810399 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20f655d-5ea0-4277-9d97-403134dcc5f1 None admin] SCRIPT_NAME: `/identity` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:06:52.810904 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20f655d-5ea0-4277-9d97-403134dcc5f1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:06:52.827142 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b20f655d-5ea0-4277-9d97-403134dcc5f1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:06:52.829609 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b20f655d-5ea0-4277-9d97-403134dcc5f1 None admin] RBAC: Authorization granted {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:06:52.844911 dv-cinder-851351-1-smb devstack@keystone.service[416293]: [pid: 416293|app: 0|req: 396/799] 10.222.0.42 () {58 vars in 1282 bytes} [Thu Jul 28 09:06:52 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 530 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 28 09:06:52.846730 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31e3f3e-8470-45ef-bf4e-d0d86d0a6ccf None None] REQUEST_METHOD: `GET` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:06:52.847414 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31e3f3e-8470-45ef-bf4e-d0d86d0a6ccf None None] SCRIPT_NAME: `/identity` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:06:52.849063 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31e3f3e-8470-45ef-bf4e-d0d86d0a6ccf None None] PATH_INFO: `/` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:06:52.854566 dv-cinder-851351-1-smb devstack@keystone.service[416293]: [pid: 416293|app: 0|req: 397/800] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 09:06:52 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 09:06:52.854566 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f31e3f3e-8470-45ef-bf4e-d0d86d0a6ccf None None] Authenticating user token {{(pid=416293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:06:52.855829 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application [None req-b20f655d-5ea0-4277-9d97-403134dcc5f1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 09:06:52.855829 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 09:06:52.855829 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 09:06:52.855829 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 09:06:52.855829 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 09:06:52.855829 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 09:06:52.855829 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 09:06:52.855829 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 09:06:52.855829 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 09:06:52.855829 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 09:06:52.855829 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 09:06:52.855829 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 09:06:52.855829 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 09:06:52.855829 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 09:06:52.855829 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 09:06:52.856819 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 09:06:52.856819 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 09:06:52.856819 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 09:06:52.856819 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 09:06:52.856819 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 09:06:52.856819 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 09:06:52.856819 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 09:06:52.856819 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 09:06:52.856819 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application with Lock( Jul 28 09:06:52.856819 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 09:06:52.856819 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return self._enter() Jul 28 09:06:52.856819 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 09:06:52.856819 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 09:06:52.856819 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 09:06:52.856819 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return self.creator() Jul 28 09:06:52.856819 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 09:06:52.856819 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application created_value = creator( Jul 28 09:06:52.859250 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 09:06:52.859250 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 09:06:52.859250 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 09:06:52.859250 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application Jul 28 09:06:52.859250 dv-cinder-851351-1-smb devstack@keystone.service[416294]: [pid: 416294|app: 0|req: 404/801] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 09:06:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 243 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 09:06:52.859250 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d00884b-cc37-4cc0-833c-82ddf4cc5656 None None] REQUEST_METHOD: `POST` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:06:52.859250 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d00884b-cc37-4cc0-833c-82ddf4cc5656 None None] SCRIPT_NAME: `/identity` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:06:52.859250 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d00884b-cc37-4cc0-833c-82ddf4cc5656 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:06:52.887800 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.auth.core [None req-6d00884b-cc37-4cc0-833c-82ddf4cc5656 None None] MFA Rules not processed for user `dbf87abab90e4fdf9e75408f4199918e`. Rule list: `[]` (Enabled: `True`). {{(pid=416294) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 09:06:52.889758 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.fernet_utils [None req-6d00884b-cc37-4cc0-833c-82ddf4cc5656 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=416294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 09:06:52.988272 dv-cinder-851351-1-smb devstack@keystone.service[416294]: [pid: 416294|app: 0|req: 405/802] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 09:06:52 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 09:06:52.990126 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d00884b-cc37-4cc0-833c-82ddf4cc5656 None None] Authenticating user token {{(pid=416294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:06:52.995589 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f31e3f3e-8470-45ef-bf4e-d0d86d0a6ccf None None] Validating token access rules against request {{(pid=416293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:06:53.023452 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG dbcounter [-] [416293] Writing DB stats keystone:SELECT=100 {{(pid=416293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:06:53.033296 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08063aef-1f2c-41a8-bd37-88aafed1d94e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:06:53.034719 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08063aef-1f2c-41a8-bd37-88aafed1d94e None admin] REQUEST_METHOD: `GET` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:06:53.034719 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08063aef-1f2c-41a8-bd37-88aafed1d94e None admin] SCRIPT_NAME: `/identity` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:06:53.034719 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08063aef-1f2c-41a8-bd37-88aafed1d94e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:06:53.045466 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08063aef-1f2c-41a8-bd37-88aafed1d94e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:06:53.046937 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08063aef-1f2c-41a8-bd37-88aafed1d94e None admin] RBAC: Authorization granted {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:06:53.063920 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application [None req-08063aef-1f2c-41a8-bd37-88aafed1d94e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 09:06:53.063920 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 09:06:53.063920 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 09:06:53.063920 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 09:06:53.063920 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 09:06:53.063920 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 09:06:53.063920 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 09:06:53.063920 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 09:06:53.063920 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 09:06:53.063920 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 09:06:53.063920 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 09:06:53.063920 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 09:06:53.063920 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 09:06:53.063920 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 09:06:53.063920 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 09:06:53.070225 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 09:06:53.070225 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 09:06:53.070225 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 09:06:53.070225 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 09:06:53.070225 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 09:06:53.070225 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 09:06:53.070225 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 09:06:53.070225 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 09:06:53.070225 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application with Lock( Jul 28 09:06:53.070225 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 09:06:53.070225 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self._enter() Jul 28 09:06:53.070225 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 09:06:53.070225 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 09:06:53.070225 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 09:06:53.070225 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self.creator() Jul 28 09:06:53.070225 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 09:06:53.070225 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application created_value = creator( Jul 28 09:06:53.071220 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 09:06:53.071220 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 09:06:53.071220 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 09:06:53.071220 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application Jul 28 09:06:53.071220 dv-cinder-851351-1-smb devstack@keystone.service[416293]: [pid: 416293|app: 0|req: 398/803] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 09:06:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 09:06:53.071220 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c718700b-00eb-45dd-9588-e1bb96fafdd5 None None] REQUEST_METHOD: `GET` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:06:53.071220 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c718700b-00eb-45dd-9588-e1bb96fafdd5 None None] SCRIPT_NAME: `/identity` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:06:53.071220 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c718700b-00eb-45dd-9588-e1bb96fafdd5 None None] PATH_INFO: `/` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:06:53.071220 dv-cinder-851351-1-smb devstack@keystone.service[416293]: [pid: 416293|app: 0|req: 399/804] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 09:06:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 09:06:53.071781 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c718700b-00eb-45dd-9588-e1bb96fafdd5 None None] Authenticating user token {{(pid=416293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:06:53.110534 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d00884b-cc37-4cc0-833c-82ddf4cc5656 None None] Validating token access rules against request {{(pid=416294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:06:53.112222 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG dbcounter [-] [416294] Writing DB stats keystone:SELECT=100 {{(pid=416294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:06:53.149011 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b5bea9d-e5d1-49b4-9a2c-5445ade2d90d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:06:53.149651 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5bea9d-e5d1-49b4-9a2c-5445ade2d90d None admin] REQUEST_METHOD: `GET` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:06:53.149935 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5bea9d-e5d1-49b4-9a2c-5445ade2d90d None admin] SCRIPT_NAME: `/identity` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:06:53.150209 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5bea9d-e5d1-49b4-9a2c-5445ade2d90d None admin] PATH_INFO: `/v3/domains` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:06:53.150908 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b5bea9d-e5d1-49b4-9a2c-5445ade2d90d None admin] RBAC: Adding query filter params (name=Default) {{(pid=416294) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 09:06:53.151216 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b5bea9d-e5d1-49b4-9a2c-5445ade2d90d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:06:53.152701 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b5bea9d-e5d1-49b4-9a2c-5445ade2d90d None admin] RBAC: Authorization granted {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:06:53.171474 dv-cinder-851351-1-smb devstack@keystone.service[416294]: [pid: 416294|app: 0|req: 406/805] 10.222.0.42 () {56 vars in 1109 bytes} [Thu Jul 28 09:06:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:06:53.171474 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b5bea9d-e5d1-49b4-9a2c-5445ade2d90d None admin] Authenticating user token {{(pid=416294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:06:53.187446 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c718700b-00eb-45dd-9588-e1bb96fafdd5 None None] Validating token access rules against request {{(pid=416293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:06:53.228632 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7e70a0-7f42-41dd-bafd-0bf58f9ee871 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:06:53.229329 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7e70a0-7f42-41dd-bafd-0bf58f9ee871 None admin] REQUEST_METHOD: `GET` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:06:53.229639 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7e70a0-7f42-41dd-bafd-0bf58f9ee871 None admin] SCRIPT_NAME: `/identity` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:06:53.229896 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7e70a0-7f42-41dd-bafd-0bf58f9ee871 None admin] PATH_INFO: `/v3/services/network` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:06:53.230542 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da7e70a0-7f42-41dd-bafd-0bf58f9ee871 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:06:53.231939 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da7e70a0-7f42-41dd-bafd-0bf58f9ee871 None admin] RBAC: Authorization granted {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:06:53.241325 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application [None req-da7e70a0-7f42-41dd-bafd-0bf58f9ee871 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jul 28 09:06:53.241325 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 09:06:53.241325 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 28 09:06:53.241325 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 28 09:06:53.241325 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 28 09:06:53.241325 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 28 09:06:53.241325 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 28 09:06:53.241325 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 09:06:53.241325 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 28 09:06:53.241325 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application Jul 28 09:06:53.241325 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 28 09:06:53.241325 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application Jul 28 09:06:53.241325 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 09:06:53.241325 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 09:06:53.241325 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 09:06:53.241325 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 09:06:53.241325 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 09:06:53.242422 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 09:06:53.242422 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 09:06:53.242422 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 09:06:53.242422 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 09:06:53.242422 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 09:06:53.242422 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 09:06:53.242422 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 28 09:06:53.242422 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 28 09:06:53.242422 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 28 09:06:53.242422 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 28 09:06:53.242422 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 09:06:53.242422 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 09:06:53.242422 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 09:06:53.242422 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 09:06:53.242422 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 09:06:53.242422 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 09:06:53.243375 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 09:06:53.243375 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application with Lock( Jul 28 09:06:53.243375 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 09:06:53.243375 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self._enter() Jul 28 09:06:53.243375 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 09:06:53.243375 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 09:06:53.243375 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 09:06:53.243375 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self.creator() Jul 28 09:06:53.243375 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 09:06:53.243375 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application created_value = creator( Jul 28 09:06:53.243375 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 28 09:06:53.243375 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 09:06:53.243375 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 28 09:06:53.243375 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application Jul 28 09:06:53.243375 dv-cinder-851351-1-smb devstack@keystone.service[416293]: [pid: 416293|app: 0|req: 400/806] 10.222.0.42 () {56 vars in 1111 bytes} [Thu Jul 28 09:06:53 2022] GET /identity/v3/services/network => generated 88 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 09:06:53.245381 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d24e8c-5e49-472d-98fc-7fcd8b924819 None None] REQUEST_METHOD: `POST` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:06:53.245381 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d24e8c-5e49-472d-98fc-7fcd8b924819 None None] SCRIPT_NAME: `/identity` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:06:53.245381 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d24e8c-5e49-472d-98fc-7fcd8b924819 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:06:53.263586 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.auth.core [None req-d9d24e8c-5e49-472d-98fc-7fcd8b924819 None None] MFA Rules not processed for user `dbf87abab90e4fdf9e75408f4199918e`. Rule list: `[]` (Enabled: `True`). {{(pid=416293) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 09:06:53.264835 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.fernet_utils [None req-d9d24e8c-5e49-472d-98fc-7fcd8b924819 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=416293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 09:06:53.287514 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b5bea9d-e5d1-49b4-9a2c-5445ade2d90d None admin] Validating token access rules against request {{(pid=416294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:06:53.310721 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG dbcounter [-] [416293] Writing DB stats keystone:SELECT=100 {{(pid=416293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:06:53.333414 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7708e4aa-a09f-4b25-9401-b5e6125bcaf1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:06:53.334074 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7708e4aa-a09f-4b25-9401-b5e6125bcaf1 None admin] REQUEST_METHOD: `GET` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:06:53.334812 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7708e4aa-a09f-4b25-9401-b5e6125bcaf1 None admin] SCRIPT_NAME: `/identity` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:06:53.334812 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7708e4aa-a09f-4b25-9401-b5e6125bcaf1 None admin] PATH_INFO: `/v3/domains` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:06:53.335337 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7708e4aa-a09f-4b25-9401-b5e6125bcaf1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=416294) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 09:06:53.335644 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7708e4aa-a09f-4b25-9401-b5e6125bcaf1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:06:53.337095 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7708e4aa-a09f-4b25-9401-b5e6125bcaf1 None admin] RBAC: Authorization granted {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:06:53.350357 dv-cinder-851351-1-smb devstack@keystone.service[416294]: [pid: 416294|app: 0|req: 407/807] 10.222.0.42 () {56 vars in 1109 bytes} [Thu Jul 28 09:06:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:06:53.351061 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7708e4aa-a09f-4b25-9401-b5e6125bcaf1 None admin] Authenticating user token {{(pid=416294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:06:53.355759 dv-cinder-851351-1-smb devstack@keystone.service[416293]: [pid: 416293|app: 0|req: 401/808] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 09:06:53 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 09:06:53.356703 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d24e8c-5e49-472d-98fc-7fcd8b924819 None None] Authenticating user token {{(pid=416293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:06:53.393970 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG dbcounter [-] [416294] Writing DB stats keystone:SELECT=100 {{(pid=416294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:06:53.489253 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d24e8c-5e49-472d-98fc-7fcd8b924819 None None] Validating token access rules against request {{(pid=416293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:06:53.489848 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7708e4aa-a09f-4b25-9401-b5e6125bcaf1 None admin] Validating token access rules against request {{(pid=416294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:06:53.527292 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0699a49-27f6-4a59-a65c-a474c365bb0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:06:53.527953 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0699a49-27f6-4a59-a65c-a474c365bb0f None admin] REQUEST_METHOD: `GET` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:06:53.528391 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0699a49-27f6-4a59-a65c-a474c365bb0f None admin] SCRIPT_NAME: `/identity` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:06:53.528815 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0699a49-27f6-4a59-a65c-a474c365bb0f None admin] PATH_INFO: `/v3/services` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:06:53.529559 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0699a49-27f6-4a59-a65c-a474c365bb0f None admin] RBAC: Adding query filter params (name=network) {{(pid=416293) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 09:06:53.529991 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0699a49-27f6-4a59-a65c-a474c365bb0f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:06:53.531447 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2abf1df-9337-4b8a-b157-dd11f747c96a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:06:53.531654 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0699a49-27f6-4a59-a65c-a474c365bb0f None admin] RBAC: Authorization granted {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:06:53.532142 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2abf1df-9337-4b8a-b157-dd11f747c96a None admin] REQUEST_METHOD: `GET` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:06:53.532493 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2abf1df-9337-4b8a-b157-dd11f747c96a None admin] SCRIPT_NAME: `/identity` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:06:53.532778 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2abf1df-9337-4b8a-b157-dd11f747c96a None admin] PATH_INFO: `/v3/users/swift` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:06:53.545366 dv-cinder-851351-1-smb devstack@keystone.service[416293]: [pid: 416293|app: 0|req: 402/809] 10.222.0.42 () {56 vars in 1112 bytes} [Thu Jul 28 09:06:53 2022] GET /identity/v3/services?name=network => generated 124 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:06:53.545592 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2abf1df-9337-4b8a-b157-dd11f747c96a None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:06:53.545749 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0699a49-27f6-4a59-a65c-a474c365bb0f None admin] Authenticating user token {{(pid=416293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:06:53.545848 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2abf1df-9337-4b8a-b157-dd11f747c96a None admin] RBAC: Authorization granted {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:06:53.559286 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application [None req-f2abf1df-9337-4b8a-b157-dd11f747c96a None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 28 09:06:53.559286 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 09:06:53.559286 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 09:06:53.559286 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 09:06:53.559286 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 09:06:53.559286 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 09:06:53.559286 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 09:06:53.559286 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 09:06:53.559286 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 09:06:53.559286 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 09:06:53.559286 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 09:06:53.559286 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 09:06:53.559286 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 28 09:06:53.559286 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 28 09:06:53.559286 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 28 09:06:53.559286 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 28 09:06:53.560982 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 09:06:53.560982 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 09:06:53.560982 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 28 09:06:53.560982 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 09:06:53.560982 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 28 09:06:53.560982 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 09:06:53.560982 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 09:06:53.560982 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 09:06:53.560982 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 09:06:53.560982 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 09:06:53.560982 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 09:06:53.560982 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application with Lock( Jul 28 09:06:53.560982 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 09:06:53.560982 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return self._enter() Jul 28 09:06:53.560982 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 09:06:53.560982 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 09:06:53.560982 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 09:06:53.560982 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return self.creator() Jul 28 09:06:53.562221 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 09:06:53.562221 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application created_value = creator( Jul 28 09:06:53.562221 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 28 09:06:53.562221 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 28 09:06:53.562221 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 28 09:06:53.562221 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 28 09:06:53.562221 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 28 09:06:53.562221 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 28 09:06:53.562221 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 28 09:06:53.562221 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application Jul 28 09:06:53.564842 dv-cinder-851351-1-smb devstack@keystone.service[416294]: [pid: 416294|app: 0|req: 408/810] 10.222.0.42 () {56 vars in 1096 bytes} [Thu Jul 28 09:06:53 2022] GET /identity/v3/users/swift => generated 83 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 09:06:53.566397 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2abf1df-9337-4b8a-b157-dd11f747c96a None admin] Authenticating user token {{(pid=416294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:06:53.588244 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG dbcounter [-] [416293] Writing DB stats keystone:SELECT=100 {{(pid=416293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:06:53.665370 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG dbcounter [-] [416294] Writing DB stats keystone:SELECT=100 {{(pid=416294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:06:53.669847 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0699a49-27f6-4a59-a65c-a474c365bb0f None admin] Validating token access rules against request {{(pid=416293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:06:53.689708 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2abf1df-9337-4b8a-b157-dd11f747c96a None admin] Validating token access rules against request {{(pid=416294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:06:53.709263 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b9479d7-d667-41d5-b373-0bb2c8b2cdcf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:06:53.709952 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9479d7-d667-41d5-b373-0bb2c8b2cdcf None admin] REQUEST_METHOD: `GET` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:06:53.710229 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9479d7-d667-41d5-b373-0bb2c8b2cdcf None admin] SCRIPT_NAME: `/identity` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:06:53.710510 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9479d7-d667-41d5-b373-0bb2c8b2cdcf None admin] PATH_INFO: `/v3/projects/service` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:06:53.717943 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b9479d7-d667-41d5-b373-0bb2c8b2cdcf None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:06:53.719425 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b9479d7-d667-41d5-b373-0bb2c8b2cdcf None admin] RBAC: Authorization granted {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:06:53.726335 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e115a64-0d1d-4375-8a12-41be35b570e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:06:53.726988 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e115a64-0d1d-4375-8a12-41be35b570e5 None admin] REQUEST_METHOD: `GET` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:06:53.727270 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e115a64-0d1d-4375-8a12-41be35b570e5 None admin] SCRIPT_NAME: `/identity` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:06:53.727543 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e115a64-0d1d-4375-8a12-41be35b570e5 None admin] PATH_INFO: `/v3/roles/service` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:06:53.731075 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application [None req-2b9479d7-d667-41d5-b373-0bb2c8b2cdcf None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 09:06:53.731075 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 09:06:53.731075 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 09:06:53.731075 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 09:06:53.731075 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 09:06:53.731075 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 09:06:53.731075 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 09:06:53.731075 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 09:06:53.731075 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 09:06:53.731075 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 09:06:53.731075 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 09:06:53.731075 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 09:06:53.731075 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 28 09:06:53.731075 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 28 09:06:53.731075 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 28 09:06:53.732118 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 28 09:06:53.732118 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 09:06:53.732118 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 09:06:53.732118 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 09:06:53.732118 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 09:06:53.732118 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 09:06:53.732118 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 09:06:53.732118 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 09:06:53.732118 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application with Lock( Jul 28 09:06:53.732118 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 09:06:53.732118 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self._enter() Jul 28 09:06:53.732118 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 09:06:53.732118 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 09:06:53.732118 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 09:06:53.732118 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self.creator() Jul 28 09:06:53.732118 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 09:06:53.732118 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application created_value = creator( Jul 28 09:06:53.733100 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 28 09:06:53.733100 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 28 09:06:53.733100 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 28 09:06:53.733100 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 28 09:06:53.733100 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 28 09:06:53.733100 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 28 09:06:53.733100 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 09:06:53.733100 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application Jul 28 09:06:53.733100 dv-cinder-851351-1-smb devstack@keystone.service[416293]: [pid: 416293|app: 0|req: 403/811] 10.222.0.42 () {56 vars in 1111 bytes} [Thu Jul 28 09:06:53 2022] GET /identity/v3/projects/service => generated 88 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 09:06:53.733651 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b9479d7-d667-41d5-b373-0bb2c8b2cdcf None admin] Authenticating user token {{(pid=416293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:06:53.744773 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e115a64-0d1d-4375-8a12-41be35b570e5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 09:06:53.751177 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application [None req-2e115a64-0d1d-4375-8a12-41be35b570e5 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 28 09:06:53.751177 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 09:06:53.751177 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 09:06:53.751177 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 09:06:53.751177 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 09:06:53.751177 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 09:06:53.751177 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 09:06:53.751177 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 09:06:53.751177 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 09:06:53.751177 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 09:06:53.751177 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 09:06:53.751177 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 09:06:53.751177 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 09:06:53.751177 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 09:06:53.751177 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 09:06:53.751177 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 09:06:53.757320 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 09:06:53.757320 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 09:06:53.757320 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 09:06:53.757320 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 09:06:53.757320 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 09:06:53.757320 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 09:06:53.757320 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 09:06:53.757320 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 09:06:53.757320 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 09:06:53.757320 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 09:06:53.757320 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 09:06:53.757320 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application with Lock( Jul 28 09:06:53.757320 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 09:06:53.757320 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return self._enter() Jul 28 09:06:53.757320 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 09:06:53.757320 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 09:06:53.758268 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 09:06:53.758268 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return self.creator() Jul 28 09:06:53.758268 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 09:06:53.758268 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application created_value = creator( Jul 28 09:06:53.758268 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 09:06:53.758268 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 09:06:53.758268 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 09:06:53.758268 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 09:06:53.758268 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 09:06:53.758268 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 09:06:53.758268 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 28 09:06:53.758268 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application Jul 28 09:06:53.758268 dv-cinder-851351-1-smb devstack@keystone.service[416294]: [pid: 416294|app: 0|req: 409/812] 10.222.0.42 () {56 vars in 1102 bytes} [Thu Jul 28 09:06:53 2022] GET /identity/v3/roles/service => generated 85 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 09:06:53.758268 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e115a64-0d1d-4375-8a12-41be35b570e5 None admin] Authenticating user token {{(pid=416294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:06:53.847716 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG dbcounter [-] [416293] Writing DB stats keystone:SELECT=100 {{(pid=416293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:06:53.855351 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b9479d7-d667-41d5-b373-0bb2c8b2cdcf None admin] Validating token access rules against request {{(pid=416293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:06:53.867249 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e115a64-0d1d-4375-8a12-41be35b570e5 None admin] Validating token access rules against request {{(pid=416294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:06:53.892488 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a78d18-f6b9-48b9-92fd-d71d2b779e11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:06:53.893325 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a78d18-f6b9-48b9-92fd-d71d2b779e11 None admin] REQUEST_METHOD: `GET` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:06:53.893578 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a78d18-f6b9-48b9-92fd-d71d2b779e11 None admin] SCRIPT_NAME: `/identity` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:06:53.893855 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a78d18-f6b9-48b9-92fd-d71d2b779e11 None admin] PATH_INFO: `/v3/services` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:06:53.894545 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14a78d18-f6b9-48b9-92fd-d71d2b779e11 None admin] RBAC: Adding query filter params (type=network) {{(pid=416293) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 09:06:53.894849 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14a78d18-f6b9-48b9-92fd-d71d2b779e11 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:06:53.896257 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14a78d18-f6b9-48b9-92fd-d71d2b779e11 None admin] RBAC: Authorization granted {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:06:53.906170 dv-cinder-851351-1-smb devstack@keystone.service[416293]: [pid: 416293|app: 0|req: 404/813] 10.222.0.42 () {56 vars in 1112 bytes} [Thu Jul 28 09:06:53 2022] GET /identity/v3/services?type=network => generated 350 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:06:53.906170 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a78d18-f6b9-48b9-92fd-d71d2b779e11 None admin] Authenticating user token {{(pid=416293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:06:53.909387 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3b9156-7ff7-4993-81cd-d02b9d40dff0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:06:53.910031 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3b9156-7ff7-4993-81cd-d02b9d40dff0 None admin] REQUEST_METHOD: `GET` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:06:53.910316 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3b9156-7ff7-4993-81cd-d02b9d40dff0 None admin] SCRIPT_NAME: `/identity` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:06:53.910585 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3b9156-7ff7-4993-81cd-d02b9d40dff0 None admin] PATH_INFO: `/v3/users` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:06:53.911387 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b3b9156-7ff7-4993-81cd-d02b9d40dff0 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=416294) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 09:06:53.911689 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b3b9156-7ff7-4993-81cd-d02b9d40dff0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:06:53.913160 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b3b9156-7ff7-4993-81cd-d02b9d40dff0 None admin] RBAC: Authorization granted {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:06:53.928581 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG dbcounter [-] [416294] Writing DB stats keystone:SELECT=100 {{(pid=416294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:06:53.937489 dv-cinder-851351-1-smb devstack@keystone.service[416294]: [pid: 416294|app: 0|req: 410/814] 10.222.0.42 () {56 vars in 1135 bytes} [Thu Jul 28 09:06:53 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:06:53.938425 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3b9156-7ff7-4993-81cd-d02b9d40dff0 None admin] Authenticating user token {{(pid=416294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:06:54.015689 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a78d18-f6b9-48b9-92fd-d71d2b779e11 None admin] Validating token access rules against request {{(pid=416293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:06:54.050875 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ffdad5-09ed-4862-b255-0a4f030a1c03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:06:54.051514 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ffdad5-09ed-4862-b255-0a4f030a1c03 None admin] REQUEST_METHOD: `GET` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:06:54.051649 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3b9156-7ff7-4993-81cd-d02b9d40dff0 None admin] Validating token access rules against request {{(pid=416294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:06:54.052050 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ffdad5-09ed-4862-b255-0a4f030a1c03 None admin] SCRIPT_NAME: `/identity` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:06:54.052050 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ffdad5-09ed-4862-b255-0a4f030a1c03 None admin] PATH_INFO: `/v3/projects` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:06:54.052853 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49ffdad5-09ed-4862-b255-0a4f030a1c03 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=416293) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 09:06:54.053170 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49ffdad5-09ed-4862-b255-0a4f030a1c03 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:06:54.054624 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49ffdad5-09ed-4862-b255-0a4f030a1c03 None admin] RBAC: Authorization granted {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:06:54.067193 dv-cinder-851351-1-smb devstack@keystone.service[416293]: [pid: 416293|app: 0|req: 405/815] 10.222.0.42 () {56 vars in 1148 bytes} [Thu Jul 28 09:06:53 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:06:54.067997 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ffdad5-09ed-4862-b255-0a4f030a1c03 None admin] Authenticating user token {{(pid=416293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:06:54.092041 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG dbcounter [-] [416293] Writing DB stats keystone:SELECT=100 {{(pid=416293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:06:54.093073 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8299bb-758c-490c-b855-7750045be596 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:06:54.094005 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8299bb-758c-490c-b855-7750045be596 None admin] REQUEST_METHOD: `GET` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:06:54.094005 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8299bb-758c-490c-b855-7750045be596 None admin] SCRIPT_NAME: `/identity` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:06:54.094225 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8299bb-758c-490c-b855-7750045be596 None admin] PATH_INFO: `/v3/roles` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:06:54.095072 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a8299bb-758c-490c-b855-7750045be596 None admin] RBAC: Adding query filter params (name=service) {{(pid=416294) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 09:06:54.095381 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a8299bb-758c-490c-b855-7750045be596 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:06:54.096774 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a8299bb-758c-490c-b855-7750045be596 None admin] RBAC: Authorization granted {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:06:54.109850 dv-cinder-851351-1-smb devstack@keystone.service[416294]: [pid: 416294|app: 0|req: 411/816] 10.222.0.42 () {56 vars in 1103 bytes} [Thu Jul 28 09:06:53 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:06:54.109850 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8299bb-758c-490c-b855-7750045be596 None admin] Authenticating user token {{(pid=416294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:06:54.177294 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG dbcounter [-] [416294] Writing DB stats keystone:SELECT=100 {{(pid=416294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:06:54.186999 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ffdad5-09ed-4862-b255-0a4f030a1c03 None admin] Validating token access rules against request {{(pid=416293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:06:54.220785 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8299bb-758c-490c-b855-7750045be596 None admin] Validating token access rules against request {{(pid=416294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:06:54.223771 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd0962a-5e66-4afb-93cd-b1b4794eda19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:06:54.224413 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd0962a-5e66-4afb-93cd-b1b4794eda19 None admin] REQUEST_METHOD: `POST` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:06:54.224723 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd0962a-5e66-4afb-93cd-b1b4794eda19 None admin] SCRIPT_NAME: `/identity` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:06:54.225005 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd0962a-5e66-4afb-93cd-b1b4794eda19 None admin] PATH_INFO: `/v3/endpoints` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:06:54.225731 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efd0962a-5e66-4afb-93cd-b1b4794eda19 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:06:54.227120 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efd0962a-5e66-4afb-93cd-b1b4794eda19 None admin] RBAC: Authorization granted {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:06:54.250879 dv-cinder-851351-1-smb devstack@keystone.service[416293]: [pid: 416293|app: 0|req: 406/817] 10.222.0.42 () {60 vars in 1144 bytes} [Thu Jul 28 09:06:54 2022] POST /identity/v3/endpoints => generated 327 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 09:06:54.251762 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd0962a-5e66-4afb-93cd-b1b4794eda19 None admin] Authenticating user token {{(pid=416293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:06:54.275561 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e87041-e0d2-418d-a06f-ad27779c67f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:06:54.276739 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e87041-e0d2-418d-a06f-ad27779c67f0 None admin] REQUEST_METHOD: `GET` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:06:54.277281 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e87041-e0d2-418d-a06f-ad27779c67f0 None admin] SCRIPT_NAME: `/identity` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:06:54.277885 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e87041-e0d2-418d-a06f-ad27779c67f0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:06:54.291715 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97e87041-e0d2-418d-a06f-ad27779c67f0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:06:54.293914 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97e87041-e0d2-418d-a06f-ad27779c67f0 None admin] RBAC: Authorization granted {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:06:54.311453 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application [None req-97e87041-e0d2-418d-a06f-ad27779c67f0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 09:06:54.311453 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 09:06:54.311453 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 09:06:54.311453 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 09:06:54.311453 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 09:06:54.311453 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 09:06:54.311453 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 09:06:54.311453 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 09:06:54.311453 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 09:06:54.311453 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 09:06:54.311453 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 09:06:54.311453 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 09:06:54.311453 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 09:06:54.311453 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 09:06:54.311453 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 09:06:54.312547 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 09:06:54.312547 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 09:06:54.312547 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 09:06:54.312547 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 09:06:54.312547 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 09:06:54.312547 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 09:06:54.312547 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 09:06:54.312547 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 09:06:54.312547 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application with Lock( Jul 28 09:06:54.312547 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 09:06:54.312547 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return self._enter() Jul 28 09:06:54.312547 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 09:06:54.312547 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 09:06:54.312547 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 09:06:54.312547 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return self.creator() Jul 28 09:06:54.312547 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 09:06:54.312547 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application created_value = creator( Jul 28 09:06:54.313695 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 09:06:54.313695 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 09:06:54.313695 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 09:06:54.313695 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application Jul 28 09:06:54.317145 dv-cinder-851351-1-smb devstack@keystone.service[416294]: [pid: 416294|app: 0|req: 412/818] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 09:06:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 09:06:54.319029 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e87041-e0d2-418d-a06f-ad27779c67f0 None admin] Authenticating user token {{(pid=416294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:06:54.374977 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG dbcounter [-] [416293] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=416293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:06:54.413120 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd0962a-5e66-4afb-93cd-b1b4794eda19 None admin] Validating token access rules against request {{(pid=416293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:06:54.467476 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e87041-e0d2-418d-a06f-ad27779c67f0 None admin] Validating token access rules against request {{(pid=416294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:06:54.471162 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109e45ca-eaf3-4384-b446-a319d57a8035 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:06:54.472067 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109e45ca-eaf3-4384-b446-a319d57a8035 None admin] REQUEST_METHOD: `GET` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:06:54.472558 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109e45ca-eaf3-4384-b446-a319d57a8035 None admin] SCRIPT_NAME: `/identity` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:06:54.473082 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109e45ca-eaf3-4384-b446-a319d57a8035 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:06:54.474126 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-109e45ca-eaf3-4384-b446-a319d57a8035 None admin] RBAC: Adding query filter params (role.id=c67085ec338243df8f9b7d6459036e23, scope.project.id=6c4349445f224184b093d9dfd0dfc642, user.id=62f7da38a7044000bdf5790da751a45e) {{(pid=416293) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 09:06:54.474661 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-109e45ca-eaf3-4384-b446-a319d57a8035 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:06:54.476859 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-109e45ca-eaf3-4384-b446-a319d57a8035 None admin] RBAC: Authorization granted {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:06:54.483153 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG dbcounter [-] [416294] Writing DB stats keystone:SELECT=100 {{(pid=416294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:06:54.486200 dv-cinder-851351-1-smb devstack@keystone.service[416293]: [pid: 416293|app: 0|req: 407/819] 10.222.0.42 () {56 vars in 1374 bytes} [Thu Jul 28 09:06:54 2022] GET /identity/v3/role_assignments?user.id=62f7da38a7044000bdf5790da751a45e&scope.project.id=6c4349445f224184b093d9dfd0dfc642&role.id=c67085ec338243df8f9b7d6459036e23 => generated 608 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:06:54.487719 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109e45ca-eaf3-4384-b446-a319d57a8035 None admin] Authenticating user token {{(pid=416293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:06:54.518990 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c399542-d678-4dec-8a1f-a3c9a91c8d50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:06:54.519742 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c399542-d678-4dec-8a1f-a3c9a91c8d50 None admin] REQUEST_METHOD: `GET` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:06:54.520058 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c399542-d678-4dec-8a1f-a3c9a91c8d50 None admin] SCRIPT_NAME: `/identity` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:06:54.520732 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c399542-d678-4dec-8a1f-a3c9a91c8d50 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:06:54.535088 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c399542-d678-4dec-8a1f-a3c9a91c8d50 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:06:54.536683 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c399542-d678-4dec-8a1f-a3c9a91c8d50 None admin] RBAC: Authorization granted {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:06:54.553399 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application [None req-9c399542-d678-4dec-8a1f-a3c9a91c8d50 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 09:06:54.553399 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 09:06:54.553399 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 09:06:54.553399 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 09:06:54.553399 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 09:06:54.553399 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 09:06:54.553399 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 09:06:54.553399 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 09:06:54.553399 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 09:06:54.553399 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 09:06:54.553399 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 09:06:54.553399 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 09:06:54.553399 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 09:06:54.553399 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 09:06:54.553399 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 09:06:54.554649 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 09:06:54.554649 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 09:06:54.554649 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 09:06:54.554649 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 09:06:54.554649 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 09:06:54.554649 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 09:06:54.554649 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 09:06:54.554649 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 09:06:54.554649 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application with Lock( Jul 28 09:06:54.554649 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 09:06:54.554649 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return self._enter() Jul 28 09:06:54.554649 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 09:06:54.554649 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 09:06:54.554649 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 09:06:54.554649 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return self.creator() Jul 28 09:06:54.554649 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 09:06:54.554649 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application created_value = creator( Jul 28 09:06:54.556404 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 09:06:54.556404 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 09:06:54.556404 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 09:06:54.556404 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application Jul 28 09:06:54.556404 dv-cinder-851351-1-smb devstack@keystone.service[416294]: [pid: 416294|app: 0|req: 413/820] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 09:06:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 09:06:54.560821 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c399542-d678-4dec-8a1f-a3c9a91c8d50 None admin] Authenticating user token {{(pid=416294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:06:54.629883 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109e45ca-eaf3-4384-b446-a319d57a8035 None admin] Validating token access rules against request {{(pid=416293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:06:54.668854 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a70f98-aee0-42c7-8a4b-e928c3bf8215 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:06:54.669509 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a70f98-aee0-42c7-8a4b-e928c3bf8215 None admin] REQUEST_METHOD: `GET` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:06:54.669784 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a70f98-aee0-42c7-8a4b-e928c3bf8215 None admin] SCRIPT_NAME: `/identity` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:06:54.670057 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a70f98-aee0-42c7-8a4b-e928c3bf8215 None admin] PATH_INFO: `/v3/domains` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:06:54.670791 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9a70f98-aee0-42c7-8a4b-e928c3bf8215 None admin] RBAC: Adding query filter params (name=Default) {{(pid=416293) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 09:06:54.671096 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9a70f98-aee0-42c7-8a4b-e928c3bf8215 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:06:54.672590 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9a70f98-aee0-42c7-8a4b-e928c3bf8215 None admin] RBAC: Authorization granted {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:06:54.682914 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG dbcounter [-] [416293] Writing DB stats keystone:SELECT=100 {{(pid=416293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:06:54.693201 dv-cinder-851351-1-smb devstack@keystone.service[416293]: [pid: 416293|app: 0|req: 408/821] 10.222.0.42 () {56 vars in 1109 bytes} [Thu Jul 28 09:06:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:06:54.696495 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a70f98-aee0-42c7-8a4b-e928c3bf8215 None admin] Authenticating user token {{(pid=416293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:06:54.702254 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c399542-d678-4dec-8a1f-a3c9a91c8d50 None admin] Validating token access rules against request {{(pid=416294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:06:54.739539 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b68dc0-3b33-4ec4-b440-ff3e12fa4425 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:06:54.740500 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b68dc0-3b33-4ec4-b440-ff3e12fa4425 None admin] REQUEST_METHOD: `GET` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:06:54.740841 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b68dc0-3b33-4ec4-b440-ff3e12fa4425 None admin] SCRIPT_NAME: `/identity` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:06:54.741123 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b68dc0-3b33-4ec4-b440-ff3e12fa4425 None admin] PATH_INFO: `/v3/domains` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:06:54.741839 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b68dc0-3b33-4ec4-b440-ff3e12fa4425 None admin] RBAC: Adding query filter params (name=Default) {{(pid=416294) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 09:06:54.742158 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b68dc0-3b33-4ec4-b440-ff3e12fa4425 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:06:54.743578 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b68dc0-3b33-4ec4-b440-ff3e12fa4425 None admin] RBAC: Authorization granted {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:06:54.757917 dv-cinder-851351-1-smb devstack@keystone.service[416294]: [pid: 416294|app: 0|req: 414/822] 10.222.0.42 () {56 vars in 1109 bytes} [Thu Jul 28 09:06:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:06:54.762148 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05bd523-6262-4249-bc8f-9e4baec6d9d4 None None] REQUEST_METHOD: `GET` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:06:54.762148 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05bd523-6262-4249-bc8f-9e4baec6d9d4 None None] SCRIPT_NAME: `/identity` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:06:54.762148 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05bd523-6262-4249-bc8f-9e4baec6d9d4 None None] PATH_INFO: `/` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:06:54.764736 dv-cinder-851351-1-smb devstack@keystone.service[416294]: [pid: 416294|app: 0|req: 415/823] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 09:06:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 28 09:06:54.764736 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05bd523-6262-4249-bc8f-9e4baec6d9d4 None None] Authenticating user token {{(pid=416294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:06:54.790137 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG dbcounter [-] [416294] Writing DB stats keystone:SELECT=100 {{(pid=416294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:06:54.826712 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a70f98-aee0-42c7-8a4b-e928c3bf8215 None admin] Validating token access rules against request {{(pid=416293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:06:54.864781 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c888e30f-fe9b-4591-8ccb-ae5e1aec0186 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:06:54.865454 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c888e30f-fe9b-4591-8ccb-ae5e1aec0186 None admin] REQUEST_METHOD: `GET` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:06:54.865737 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c888e30f-fe9b-4591-8ccb-ae5e1aec0186 None admin] SCRIPT_NAME: `/identity` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:06:54.866016 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c888e30f-fe9b-4591-8ccb-ae5e1aec0186 None admin] PATH_INFO: `/v3/projects/service` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:06:54.873412 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c888e30f-fe9b-4591-8ccb-ae5e1aec0186 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:06:54.874902 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c888e30f-fe9b-4591-8ccb-ae5e1aec0186 None admin] RBAC: Authorization granted {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:06:54.883727 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05bd523-6262-4249-bc8f-9e4baec6d9d4 None None] Validating token access rules against request {{(pid=416294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:06:54.886885 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application [None req-c888e30f-fe9b-4591-8ccb-ae5e1aec0186 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 09:06:54.886885 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 09:06:54.886885 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 09:06:54.886885 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 09:06:54.886885 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 09:06:54.886885 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 09:06:54.886885 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 09:06:54.886885 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 09:06:54.886885 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 09:06:54.886885 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 09:06:54.886885 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 09:06:54.886885 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 09:06:54.886885 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 28 09:06:54.886885 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 28 09:06:54.886885 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 28 09:06:54.887831 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 28 09:06:54.887831 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 09:06:54.887831 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 09:06:54.887831 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 09:06:54.887831 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 09:06:54.887831 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 09:06:54.887831 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 09:06:54.887831 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 09:06:54.887831 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application with Lock( Jul 28 09:06:54.887831 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 09:06:54.887831 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self._enter() Jul 28 09:06:54.887831 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 09:06:54.887831 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 09:06:54.887831 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 09:06:54.887831 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self.creator() Jul 28 09:06:54.887831 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 09:06:54.887831 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application created_value = creator( Jul 28 09:06:54.893929 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 28 09:06:54.893929 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 28 09:06:54.893929 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 28 09:06:54.893929 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 28 09:06:54.893929 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 28 09:06:54.893929 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 28 09:06:54.893929 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 09:06:54.893929 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application Jul 28 09:06:54.893929 dv-cinder-851351-1-smb devstack@keystone.service[416293]: [pid: 416293|app: 0|req: 409/824] 10.222.0.42 () {56 vars in 1111 bytes} [Thu Jul 28 09:06:54 2022] GET /identity/v3/projects/service => generated 88 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 09:06:54.893929 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12842354-ccfd-46e0-aa74-879b2f64b87c None None] REQUEST_METHOD: `POST` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:06:54.893929 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12842354-ccfd-46e0-aa74-879b2f64b87c None None] SCRIPT_NAME: `/identity` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:06:54.894718 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12842354-ccfd-46e0-aa74-879b2f64b87c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:06:54.909975 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.auth.core [None req-12842354-ccfd-46e0-aa74-879b2f64b87c None None] MFA Rules not processed for user `dbf87abab90e4fdf9e75408f4199918e`. Rule list: `[]` (Enabled: `True`). {{(pid=416293) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 09:06:54.911224 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.fernet_utils [None req-12842354-ccfd-46e0-aa74-879b2f64b87c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=416293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 09:06:54.930286 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a934a7-99da-4362-b6ff-a37746e93cfb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:06:54.930943 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a934a7-99da-4362-b6ff-a37746e93cfb None admin] REQUEST_METHOD: `GET` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:06:54.931235 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a934a7-99da-4362-b6ff-a37746e93cfb None admin] SCRIPT_NAME: `/identity` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:06:54.931508 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a934a7-99da-4362-b6ff-a37746e93cfb None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:06:54.939830 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6a934a7-99da-4362-b6ff-a37746e93cfb None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:06:54.941537 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6a934a7-99da-4362-b6ff-a37746e93cfb None admin] RBAC: Authorization granted {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:06:54.955899 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application [None req-e6a934a7-99da-4362-b6ff-a37746e93cfb None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 28 09:06:54.955899 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 09:06:54.955899 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 09:06:54.955899 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 09:06:54.955899 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 09:06:54.955899 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 09:06:54.955899 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 09:06:54.955899 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 09:06:54.955899 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 09:06:54.955899 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 09:06:54.955899 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 09:06:54.955899 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 09:06:54.955899 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 28 09:06:54.955899 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 28 09:06:54.955899 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 28 09:06:54.955899 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 28 09:06:54.957322 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 09:06:54.957322 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 09:06:54.957322 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 28 09:06:54.957322 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 09:06:54.957322 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 28 09:06:54.957322 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 09:06:54.957322 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 09:06:54.957322 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 09:06:54.957322 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 09:06:54.957322 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 09:06:54.957322 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 09:06:54.957322 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application with Lock( Jul 28 09:06:54.957322 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 09:06:54.957322 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return self._enter() Jul 28 09:06:54.957322 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 09:06:54.957322 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 09:06:54.957322 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 09:06:54.957322 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return self.creator() Jul 28 09:06:54.963429 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 09:06:54.963429 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application created_value = creator( Jul 28 09:06:54.963429 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 28 09:06:54.963429 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 28 09:06:54.963429 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 28 09:06:54.963429 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 28 09:06:54.963429 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 28 09:06:54.963429 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 28 09:06:54.963429 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 28 09:06:54.963429 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application Jul 28 09:06:54.963429 dv-cinder-851351-1-smb devstack@keystone.service[416294]: [pid: 416294|app: 0|req: 416/825] 10.222.0.42 () {56 vars in 1117 bytes} [Thu Jul 28 09:06:54 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 09:06:54.963429 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a934a7-99da-4362-b6ff-a37746e93cfb None admin] Authenticating user token {{(pid=416294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:06:54.973496 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG dbcounter [-] [416293] Writing DB stats keystone:SELECT=100 {{(pid=416293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:06:54.997142 dv-cinder-851351-1-smb devstack@keystone.service[416293]: [pid: 416293|app: 0|req: 410/826] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 09:06:54 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 09:06:54.998473 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12842354-ccfd-46e0-aa74-879b2f64b87c None None] Authenticating user token {{(pid=416293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:06:55.052697 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG dbcounter [-] [416294] Writing DB stats keystone:SELECT=100 {{(pid=416294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:06:55.085224 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a934a7-99da-4362-b6ff-a37746e93cfb None admin] Validating token access rules against request {{(pid=416294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:06:55.123322 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12842354-ccfd-46e0-aa74-879b2f64b87c None None] Validating token access rules against request {{(pid=416293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:06:55.125257 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71ec64c-8277-4acc-97b5-22b77c98db98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:06:55.125951 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71ec64c-8277-4acc-97b5-22b77c98db98 None admin] REQUEST_METHOD: `GET` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:06:55.126231 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71ec64c-8277-4acc-97b5-22b77c98db98 None admin] SCRIPT_NAME: `/identity` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:06:55.126508 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71ec64c-8277-4acc-97b5-22b77c98db98 None admin] PATH_INFO: `/v3/projects` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:06:55.127291 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f71ec64c-8277-4acc-97b5-22b77c98db98 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=416294) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 09:06:55.127594 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f71ec64c-8277-4acc-97b5-22b77c98db98 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:06:55.129075 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f71ec64c-8277-4acc-97b5-22b77c98db98 None admin] RBAC: Authorization granted {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:06:55.146873 dv-cinder-851351-1-smb devstack@keystone.service[416294]: [pid: 416294|app: 0|req: 417/827] 10.222.0.42 () {56 vars in 1148 bytes} [Thu Jul 28 09:06:54 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:06:55.146873 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71ec64c-8277-4acc-97b5-22b77c98db98 None admin] Authenticating user token {{(pid=416294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:06:55.177326 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-165adb36-9491-4043-a89a-2350ddebcd9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:06:55.178416 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165adb36-9491-4043-a89a-2350ddebcd9b None admin] REQUEST_METHOD: `GET` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:06:55.178904 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165adb36-9491-4043-a89a-2350ddebcd9b None admin] SCRIPT_NAME: `/identity` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:06:55.179403 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165adb36-9491-4043-a89a-2350ddebcd9b None admin] PATH_INFO: `/v3/users` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:06:55.180846 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-165adb36-9491-4043-a89a-2350ddebcd9b None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=416293) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 09:06:55.181319 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-165adb36-9491-4043-a89a-2350ddebcd9b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:06:55.183596 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-165adb36-9491-4043-a89a-2350ddebcd9b None admin] RBAC: Authorization granted {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:06:55.210869 dv-cinder-851351-1-smb devstack@keystone.service[416293]: [pid: 416293|app: 0|req: 411/828] 10.222.0.42 () {56 vars in 1149 bytes} [Thu Jul 28 09:06:54 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:06:55.211699 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-165adb36-9491-4043-a89a-2350ddebcd9b None admin] Authenticating user token {{(pid=416293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:06:55.269064 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG dbcounter [-] [416293] Writing DB stats keystone:SELECT=100 {{(pid=416293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:06:55.281382 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71ec64c-8277-4acc-97b5-22b77c98db98 None admin] Validating token access rules against request {{(pid=416294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:06:55.318645 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00eff2ce-3a25-46f8-a6dd-e65fa6e8a42d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:06:55.319627 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00eff2ce-3a25-46f8-a6dd-e65fa6e8a42d None admin] REQUEST_METHOD: `GET` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:06:55.320092 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00eff2ce-3a25-46f8-a6dd-e65fa6e8a42d None admin] SCRIPT_NAME: `/identity` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:06:55.320232 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-165adb36-9491-4043-a89a-2350ddebcd9b None admin] Validating token access rules against request {{(pid=416293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:06:55.320697 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00eff2ce-3a25-46f8-a6dd-e65fa6e8a42d None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:06:55.321540 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00eff2ce-3a25-46f8-a6dd-e65fa6e8a42d None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:06:55.323256 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00eff2ce-3a25-46f8-a6dd-e65fa6e8a42d None admin] RBAC: Authorization granted {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:06:55.333457 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application [None req-00eff2ce-3a25-46f8-a6dd-e65fa6e8a42d None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 28 09:06:55.333457 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 09:06:55.333457 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 28 09:06:55.333457 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 28 09:06:55.333457 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 28 09:06:55.333457 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 28 09:06:55.333457 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 28 09:06:55.333457 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 09:06:55.333457 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 28 09:06:55.333457 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application Jul 28 09:06:55.333457 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 28 09:06:55.333457 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application Jul 28 09:06:55.333457 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 09:06:55.333457 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 09:06:55.333457 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 09:06:55.333457 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 09:06:55.333457 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 09:06:55.334653 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 09:06:55.334653 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 09:06:55.334653 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 09:06:55.334653 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 09:06:55.334653 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 09:06:55.334653 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 09:06:55.334653 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 28 09:06:55.334653 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 28 09:06:55.334653 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 28 09:06:55.334653 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 28 09:06:55.334653 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 09:06:55.334653 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 09:06:55.334653 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 09:06:55.334653 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 09:06:55.334653 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 09:06:55.334653 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 09:06:55.335754 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 09:06:55.335754 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application with Lock( Jul 28 09:06:55.335754 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 09:06:55.335754 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return self._enter() Jul 28 09:06:55.335754 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 09:06:55.335754 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 09:06:55.335754 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 09:06:55.335754 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return self.creator() Jul 28 09:06:55.335754 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 09:06:55.335754 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application created_value = creator( Jul 28 09:06:55.335754 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 28 09:06:55.335754 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 09:06:55.335754 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 28 09:06:55.335754 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application Jul 28 09:06:55.342922 dv-cinder-851351-1-smb devstack@keystone.service[416294]: [pid: 416294|app: 0|req: 418/829] 10.222.0.42 () {56 vars in 1114 bytes} [Thu Jul 28 09:06:55 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 09:06:55.342922 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00eff2ce-3a25-46f8-a6dd-e65fa6e8a42d None admin] Authenticating user token {{(pid=416294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:06:55.354217 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG dbcounter [-] [416294] Writing DB stats keystone:SELECT=100 {{(pid=416294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:06:55.360849 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a95048-2bbf-47da-ab12-7cc58d93e4db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:06:55.361550 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a95048-2bbf-47da-ab12-7cc58d93e4db None admin] REQUEST_METHOD: `PUT` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:06:55.361835 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a95048-2bbf-47da-ab12-7cc58d93e4db None admin] SCRIPT_NAME: `/identity` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:06:55.362121 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a95048-2bbf-47da-ab12-7cc58d93e4db None admin] PATH_INFO: `/v3/projects/6c4349445f224184b093d9dfd0dfc642/users/1a2e0811e3e347a387717df1e23d61bf/roles/c67085ec338243df8f9b7d6459036e23` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:06:55.364150 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14a95048-2bbf-47da-ab12-7cc58d93e4db None admin] RBAC: Authorizing `identity:create_grant(project_id=6c4349445f224184b093d9dfd0dfc642, user_id=1a2e0811e3e347a387717df1e23d61bf, role_id=c67085ec338243df8f9b7d6459036e23)` {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:06:55.365646 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14a95048-2bbf-47da-ab12-7cc58d93e4db None admin] RBAC: Authorization granted {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:06:55.382718 dv-cinder-851351-1-smb devstack@keystone.service[416293]: [pid: 416293|app: 0|req: 412/830] 10.222.0.42 () {58 vars in 1439 bytes} [Thu Jul 28 09:06:55 2022] PUT /identity/v3/projects/6c4349445f224184b093d9dfd0dfc642/users/1a2e0811e3e347a387717df1e23d61bf/roles/c67085ec338243df8f9b7d6459036e23 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 09:06:55.383593 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a95048-2bbf-47da-ab12-7cc58d93e4db None admin] Authenticating user token {{(pid=416293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:06:55.498891 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00eff2ce-3a25-46f8-a6dd-e65fa6e8a42d None admin] Validating token access rules against request {{(pid=416294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:06:55.522840 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a95048-2bbf-47da-ab12-7cc58d93e4db None admin] Validating token access rules against request {{(pid=416293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:06:55.538899 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG dbcounter [-] [416293] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=416293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:06:55.541179 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df19c3a0-fa5e-4b7c-bb6e-5ae750cda66f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:06:55.541897 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df19c3a0-fa5e-4b7c-bb6e-5ae750cda66f None admin] REQUEST_METHOD: `GET` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:06:55.543385 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df19c3a0-fa5e-4b7c-bb6e-5ae750cda66f None admin] SCRIPT_NAME: `/identity` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:06:55.543385 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df19c3a0-fa5e-4b7c-bb6e-5ae750cda66f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:06:55.559773 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df19c3a0-fa5e-4b7c-bb6e-5ae750cda66f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:06:55.562055 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df19c3a0-fa5e-4b7c-bb6e-5ae750cda66f None admin] RBAC: Authorization granted {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:06:55.581047 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d9d70c-6721-4a83-830e-32e769f4833a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:06:55.581706 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d9d70c-6721-4a83-830e-32e769f4833a None admin] REQUEST_METHOD: `GET` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:06:55.581993 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d9d70c-6721-4a83-830e-32e769f4833a None admin] SCRIPT_NAME: `/identity` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:06:55.582273 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d9d70c-6721-4a83-830e-32e769f4833a None admin] PATH_INFO: `/v3/services` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:06:55.583044 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d9d70c-6721-4a83-830e-32e769f4833a None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=416293) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 09:06:55.583358 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d9d70c-6721-4a83-830e-32e769f4833a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:06:55.584876 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d9d70c-6721-4a83-830e-32e769f4833a None admin] RBAC: Authorization granted {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:06:55.587744 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application [None req-df19c3a0-fa5e-4b7c-bb6e-5ae750cda66f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 09:06:55.587744 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 09:06:55.587744 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 09:06:55.587744 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 09:06:55.587744 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 09:06:55.587744 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 09:06:55.587744 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 09:06:55.587744 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 09:06:55.587744 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 09:06:55.587744 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 09:06:55.587744 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 09:06:55.587744 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 09:06:55.587744 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 09:06:55.587744 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 09:06:55.587744 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 09:06:55.588781 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 09:06:55.588781 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 09:06:55.588781 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 09:06:55.588781 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 09:06:55.588781 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 09:06:55.588781 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 09:06:55.588781 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 09:06:55.588781 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 09:06:55.588781 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application with Lock( Jul 28 09:06:55.588781 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 09:06:55.588781 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return self._enter() Jul 28 09:06:55.588781 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 09:06:55.588781 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 09:06:55.588781 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 09:06:55.588781 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return self.creator() Jul 28 09:06:55.588781 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 09:06:55.588781 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application created_value = creator( Jul 28 09:06:55.589786 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 09:06:55.589786 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 09:06:55.589786 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 09:06:55.589786 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application Jul 28 09:06:55.589786 dv-cinder-851351-1-smb devstack@keystone.service[416294]: [pid: 416294|app: 0|req: 419/831] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 09:06:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 251 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 09:06:55.594772 dv-cinder-851351-1-smb devstack@keystone.service[416293]: [pid: 416293|app: 0|req: 413/832] 10.222.0.42 () {56 vars in 1114 bytes} [Thu Jul 28 09:06:55 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:06:55.598523 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df19c3a0-fa5e-4b7c-bb6e-5ae750cda66f None admin] Authenticating user token {{(pid=416294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:06:55.598722 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d9d70c-6721-4a83-830e-32e769f4833a None admin] Authenticating user token {{(pid=416293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:06:55.665955 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG dbcounter [-] [416294] Writing DB stats keystone:SELECT=100 {{(pid=416294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:06:55.722198 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df19c3a0-fa5e-4b7c-bb6e-5ae750cda66f None admin] Validating token access rules against request {{(pid=416294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:06:55.725400 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d9d70c-6721-4a83-830e-32e769f4833a None admin] Validating token access rules against request {{(pid=416293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:06:55.770074 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a543ac-20b1-4d06-86e4-2ee9edce5ef6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:06:55.770736 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a543ac-20b1-4d06-86e4-2ee9edce5ef6 None admin] REQUEST_METHOD: `GET` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:06:55.771036 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d75e870b-a84b-4928-8a32-9f4350cba89b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:06:55.771172 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a543ac-20b1-4d06-86e4-2ee9edce5ef6 None admin] SCRIPT_NAME: `/identity` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:06:55.771423 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a543ac-20b1-4d06-86e4-2ee9edce5ef6 None admin] PATH_INFO: `/v3/domains` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:06:55.772162 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75e870b-a84b-4928-8a32-9f4350cba89b None admin] REQUEST_METHOD: `GET` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:06:55.772287 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8a543ac-20b1-4d06-86e4-2ee9edce5ef6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=416294) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 09:06:55.772554 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8a543ac-20b1-4d06-86e4-2ee9edce5ef6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:06:55.772945 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75e870b-a84b-4928-8a32-9f4350cba89b None admin] SCRIPT_NAME: `/identity` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:06:55.773400 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75e870b-a84b-4928-8a32-9f4350cba89b None admin] PATH_INFO: `/v3/services` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:06:55.774152 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8a543ac-20b1-4d06-86e4-2ee9edce5ef6 None admin] RBAC: Authorization granted {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:06:55.774485 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d75e870b-a84b-4928-8a32-9f4350cba89b None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=416293) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 09:06:55.774971 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d75e870b-a84b-4928-8a32-9f4350cba89b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:06:55.777519 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d75e870b-a84b-4928-8a32-9f4350cba89b None admin] RBAC: Authorization granted {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:06:55.784122 dv-cinder-851351-1-smb devstack@keystone.service[416293]: [pid: 416293|app: 0|req: 414/833] 10.222.0.42 () {56 vars in 1114 bytes} [Thu Jul 28 09:06:55 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:06:55.790712 dv-cinder-851351-1-smb devstack@keystone.service[416294]: [pid: 416294|app: 0|req: 420/834] 10.222.0.42 () {56 vars in 1109 bytes} [Thu Jul 28 09:06:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:06:55.796265 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d75e870b-a84b-4928-8a32-9f4350cba89b None admin] Authenticating user token {{(pid=416293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:06:55.849364 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG dbcounter [-] [416293] Writing DB stats keystone:SELECT=100 {{(pid=416293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:06:55.971052 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d75e870b-a84b-4928-8a32-9f4350cba89b None admin] Validating token access rules against request {{(pid=416293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:06:56.032341 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10a4d1b-1afb-4563-a2f5-19855ff01415 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:06:56.033997 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10a4d1b-1afb-4563-a2f5-19855ff01415 None admin] REQUEST_METHOD: `GET` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:06:56.034800 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10a4d1b-1afb-4563-a2f5-19855ff01415 None admin] SCRIPT_NAME: `/identity` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:06:56.035652 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10a4d1b-1afb-4563-a2f5-19855ff01415 None admin] PATH_INFO: `/v3/projects/service` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:06:56.048974 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c10a4d1b-1afb-4563-a2f5-19855ff01415 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:06:56.052093 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c10a4d1b-1afb-4563-a2f5-19855ff01415 None admin] RBAC: Authorization granted {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:06:56.074718 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application [None req-c10a4d1b-1afb-4563-a2f5-19855ff01415 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 09:06:56.074718 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 09:06:56.074718 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 09:06:56.074718 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 09:06:56.074718 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 09:06:56.074718 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 09:06:56.074718 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 09:06:56.074718 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 09:06:56.074718 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 09:06:56.074718 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 09:06:56.074718 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 09:06:56.074718 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 09:06:56.074718 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 28 09:06:56.074718 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 28 09:06:56.074718 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 28 09:06:56.076567 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 28 09:06:56.076567 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 09:06:56.076567 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 09:06:56.076567 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 09:06:56.076567 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 09:06:56.076567 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 09:06:56.076567 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 09:06:56.076567 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 09:06:56.076567 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application with Lock( Jul 28 09:06:56.076567 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 09:06:56.076567 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self._enter() Jul 28 09:06:56.076567 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 09:06:56.076567 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 09:06:56.076567 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 09:06:56.076567 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self.creator() Jul 28 09:06:56.076567 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 09:06:56.076567 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application created_value = creator( Jul 28 09:06:56.079012 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 28 09:06:56.079012 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 28 09:06:56.079012 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 28 09:06:56.079012 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 28 09:06:56.079012 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 28 09:06:56.079012 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 28 09:06:56.079012 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 09:06:56.079012 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application Jul 28 09:06:56.083532 dv-cinder-851351-1-smb devstack@keystone.service[416293]: [pid: 416293|app: 0|req: 415/835] 10.222.0.42 () {56 vars in 1111 bytes} [Thu Jul 28 09:06:55 2022] GET /identity/v3/projects/service => generated 88 bytes in 288 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 09:06:56.092802 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a543ac-20b1-4d06-86e4-2ee9edce5ef6 None admin] Authenticating user token {{(pid=416294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:06:56.214179 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a543ac-20b1-4d06-86e4-2ee9edce5ef6 None admin] Validating token access rules against request {{(pid=416294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:06:56.234491 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG dbcounter [-] [416294] Writing DB stats keystone:SELECT=100 {{(pid=416294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:06:56.253775 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a361c8a-0d89-4164-851a-f7496d9fba08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:06:56.254420 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a361c8a-0d89-4164-851a-f7496d9fba08 None admin] REQUEST_METHOD: `GET` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:06:56.254703 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a361c8a-0d89-4164-851a-f7496d9fba08 None admin] SCRIPT_NAME: `/identity` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:06:56.254977 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a361c8a-0d89-4164-851a-f7496d9fba08 None admin] PATH_INFO: `/v3/projects` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:06:56.255742 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a361c8a-0d89-4164-851a-f7496d9fba08 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=416294) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 09:06:56.256051 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a361c8a-0d89-4164-851a-f7496d9fba08 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:06:56.257548 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a361c8a-0d89-4164-851a-f7496d9fba08 None admin] RBAC: Authorization granted {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:06:56.270575 dv-cinder-851351-1-smb devstack@keystone.service[416294]: [pid: 416294|app: 0|req: 421/836] 10.222.0.42 () {56 vars in 1148 bytes} [Thu Jul 28 09:06:56 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:06:56.276751 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10a4d1b-1afb-4563-a2f5-19855ff01415 None admin] Authenticating user token {{(pid=416293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:06:56.399253 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG dbcounter [-] [416293] Writing DB stats keystone:SELECT=100 {{(pid=416293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:06:56.408967 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10a4d1b-1afb-4563-a2f5-19855ff01415 None admin] Validating token access rules against request {{(pid=416293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:06:56.471269 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a8b667-599e-4313-a01b-e5eb24707d7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:06:56.472403 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a8b667-599e-4313-a01b-e5eb24707d7a None admin] REQUEST_METHOD: `PUT` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:06:56.472943 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a8b667-599e-4313-a01b-e5eb24707d7a None admin] SCRIPT_NAME: `/identity` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:06:56.473437 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a8b667-599e-4313-a01b-e5eb24707d7a None admin] PATH_INFO: `/v3/projects/6c4349445f224184b093d9dfd0dfc642/users/f5b664bdc0d04af8ac60a11e9a136c91/roles/13417fbdbc5145a69bc01ff0f931fd96` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:06:56.501758 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6a8b667-599e-4313-a01b-e5eb24707d7a None admin] RBAC: Authorizing `identity:create_grant(project_id=6c4349445f224184b093d9dfd0dfc642, user_id=f5b664bdc0d04af8ac60a11e9a136c91, role_id=13417fbdbc5145a69bc01ff0f931fd96)` {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:06:56.504112 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6a8b667-599e-4313-a01b-e5eb24707d7a None admin] RBAC: Authorization granted {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:06:56.527709 dv-cinder-851351-1-smb devstack@keystone.service[416293]: [pid: 416293|app: 0|req: 416/837] 10.222.0.42 () {58 vars in 1439 bytes} [Thu Jul 28 09:06:56 2022] PUT /identity/v3/projects/6c4349445f224184b093d9dfd0dfc642/users/f5b664bdc0d04af8ac60a11e9a136c91/roles/13417fbdbc5145a69bc01ff0f931fd96 => generated 0 bytes in 251 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 09:06:56.682330 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89437e5a-5468-43da-b2a3-05ad5a5c690a None None] REQUEST_METHOD: `GET` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:06:56.682583 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89437e5a-5468-43da-b2a3-05ad5a5c690a None None] SCRIPT_NAME: `/identity` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:06:56.682982 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89437e5a-5468-43da-b2a3-05ad5a5c690a None None] PATH_INFO: `/` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:06:56.684555 dv-cinder-851351-1-smb devstack@keystone.service[416294]: [pid: 416294|app: 0|req: 422/838] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 09:06:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 09:06:56.690594 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc2b9e4-3a4e-440d-8009-b118f3535693 None None] REQUEST_METHOD: `POST` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:06:56.690883 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc2b9e4-3a4e-440d-8009-b118f3535693 None None] SCRIPT_NAME: `/identity` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:06:56.691185 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc2b9e4-3a4e-440d-8009-b118f3535693 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:06:56.718353 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.auth.core [None req-acc2b9e4-3a4e-440d-8009-b118f3535693 None None] MFA Rules not processed for user `dbf87abab90e4fdf9e75408f4199918e`. Rule list: `[]` (Enabled: `True`). {{(pid=416293) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 09:06:56.719677 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.fernet_utils [None req-acc2b9e4-3a4e-440d-8009-b118f3535693 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=416293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 09:06:56.812654 dv-cinder-851351-1-smb devstack@keystone.service[416293]: [pid: 416293|app: 0|req: 417/839] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 09:06:56 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 09:06:56.851389 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89437e5a-5468-43da-b2a3-05ad5a5c690a None None] Authenticating user token {{(pid=416294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:06:57.051160 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89437e5a-5468-43da-b2a3-05ad5a5c690a None None] Validating token access rules against request {{(pid=416294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:06:57.116287 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-928ef53f-85aa-44da-9db1-e34379e3c522 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:06:57.117445 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928ef53f-85aa-44da-9db1-e34379e3c522 None admin] REQUEST_METHOD: `GET` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:06:57.117946 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928ef53f-85aa-44da-9db1-e34379e3c522 None admin] SCRIPT_NAME: `/identity` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:06:57.118436 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928ef53f-85aa-44da-9db1-e34379e3c522 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:06:57.119702 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-928ef53f-85aa-44da-9db1-e34379e3c522 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:06:57.122476 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-928ef53f-85aa-44da-9db1-e34379e3c522 None admin] RBAC: Authorization granted {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:06:57.140925 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application [None req-928ef53f-85aa-44da-9db1-e34379e3c522 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 28 09:06:57.140925 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 09:06:57.140925 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 28 09:06:57.140925 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 28 09:06:57.140925 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 28 09:06:57.140925 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 28 09:06:57.140925 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 28 09:06:57.140925 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 09:06:57.140925 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 28 09:06:57.140925 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application Jul 28 09:06:57.140925 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 28 09:06:57.140925 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application Jul 28 09:06:57.140925 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 09:06:57.140925 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 09:06:57.140925 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 09:06:57.140925 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 09:06:57.142303 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 09:06:57.142303 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 09:06:57.142303 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 09:06:57.142303 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 09:06:57.142303 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 09:06:57.142303 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 09:06:57.142303 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 09:06:57.142303 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 28 09:06:57.142303 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 28 09:06:57.142303 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 28 09:06:57.142303 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 28 09:06:57.142303 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 09:06:57.142303 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 09:06:57.142303 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 09:06:57.142303 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 09:06:57.142303 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 09:06:57.143444 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 09:06:57.143444 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 09:06:57.143444 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application with Lock( Jul 28 09:06:57.143444 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 09:06:57.143444 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return self._enter() Jul 28 09:06:57.143444 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 09:06:57.143444 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 09:06:57.143444 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 09:06:57.143444 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return self.creator() Jul 28 09:06:57.143444 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 09:06:57.143444 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application created_value = creator( Jul 28 09:06:57.143444 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 28 09:06:57.143444 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 09:06:57.143444 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 28 09:06:57.143444 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application Jul 28 09:06:57.144477 dv-cinder-851351-1-smb devstack@keystone.service[416294]: [pid: 416294|app: 0|req: 423/840] 10.222.0.42 () {56 vars in 1132 bytes} [Thu Jul 28 09:06:56 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 293 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 09:06:57.150582 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc2b9e4-3a4e-440d-8009-b118f3535693 None None] Authenticating user token {{(pid=416293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:06:57.270570 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG dbcounter [-] [416293] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=416293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:06:57.300285 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc2b9e4-3a4e-440d-8009-b118f3535693 None None] Validating token access rules against request {{(pid=416293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:06:57.345026 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e1f9005-711b-436c-8331-3c0f81c3c8ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:06:57.346139 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1f9005-711b-436c-8331-3c0f81c3c8ed None admin] REQUEST_METHOD: `GET` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:06:57.346644 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1f9005-711b-436c-8331-3c0f81c3c8ed None admin] SCRIPT_NAME: `/identity` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:06:57.347156 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1f9005-711b-436c-8331-3c0f81c3c8ed None admin] PATH_INFO: `/v3/services` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:06:57.348442 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e1f9005-711b-436c-8331-3c0f81c3c8ed None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=416293) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 09:06:57.349042 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e1f9005-711b-436c-8331-3c0f81c3c8ed None admin] RBAC: Authorizing `identity:list_services()` {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:06:57.351606 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e1f9005-711b-436c-8331-3c0f81c3c8ed None admin] RBAC: Authorization granted {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:06:57.368819 dv-cinder-851351-1-smb devstack@keystone.service[416293]: [pid: 416293|app: 0|req: 418/841] 10.222.0.42 () {56 vars in 1126 bytes} [Thu Jul 28 09:06:57 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:06:57.372048 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-928ef53f-85aa-44da-9db1-e34379e3c522 None admin] Authenticating user token {{(pid=416294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:06:57.442242 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG dbcounter [-] [416294] Writing DB stats keystone:SELECT=100 {{(pid=416294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:06:57.533755 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-928ef53f-85aa-44da-9db1-e34379e3c522 None admin] Validating token access rules against request {{(pid=416294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:06:57.591740 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3357ddd3-dab3-4fea-ada7-d1d10b47d6c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:06:57.592779 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3357ddd3-dab3-4fea-ada7-d1d10b47d6c7 None admin] REQUEST_METHOD: `GET` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:06:57.593240 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3357ddd3-dab3-4fea-ada7-d1d10b47d6c7 None admin] SCRIPT_NAME: `/identity` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:06:57.593687 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3357ddd3-dab3-4fea-ada7-d1d10b47d6c7 None admin] PATH_INFO: `/v3/services` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:06:57.594892 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3357ddd3-dab3-4fea-ada7-d1d10b47d6c7 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=416294) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 09:06:57.595419 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3357ddd3-dab3-4fea-ada7-d1d10b47d6c7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:06:57.597773 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3357ddd3-dab3-4fea-ada7-d1d10b47d6c7 None admin] RBAC: Authorization granted {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:06:57.606622 dv-cinder-851351-1-smb devstack@keystone.service[416294]: [pid: 416294|app: 0|req: 424/842] 10.222.0.42 () {56 vars in 1126 bytes} [Thu Jul 28 09:06:57 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:06:57.857183 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1306e478-52f8-47a8-b166-928a2e924abd None None] REQUEST_METHOD: `GET` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:06:57.857608 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1306e478-52f8-47a8-b166-928a2e924abd None None] SCRIPT_NAME: `/identity` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:06:57.857817 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1306e478-52f8-47a8-b166-928a2e924abd None None] PATH_INFO: `/` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:06:57.859522 dv-cinder-851351-1-smb devstack@keystone.service[416293]: [pid: 416293|app: 0|req: 419/843] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 09:06:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 28 09:06:57.869279 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0dcbcad-eae8-4f8e-94ae-1270a7db5439 None None] REQUEST_METHOD: `POST` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:06:57.869698 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0dcbcad-eae8-4f8e-94ae-1270a7db5439 None None] SCRIPT_NAME: `/identity` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:06:57.869925 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0dcbcad-eae8-4f8e-94ae-1270a7db5439 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:06:57.892968 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.auth.core [None req-c0dcbcad-eae8-4f8e-94ae-1270a7db5439 None None] MFA Rules not processed for user `dbf87abab90e4fdf9e75408f4199918e`. Rule list: `[]` (Enabled: `True`). {{(pid=416294) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 09:06:57.894255 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.fernet_utils [None req-c0dcbcad-eae8-4f8e-94ae-1270a7db5439 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=416294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 09:06:57.991111 dv-cinder-851351-1-smb devstack@keystone.service[416294]: [pid: 416294|app: 0|req: 425/844] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 09:06:57 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 09:06:58.018816 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1306e478-52f8-47a8-b166-928a2e924abd None None] Authenticating user token {{(pid=416293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:06:58.146722 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1306e478-52f8-47a8-b166-928a2e924abd None None] Validating token access rules against request {{(pid=416293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:06:58.183557 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65225c9d-5f3d-4e05-b100-5c057845faec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:06:58.184256 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65225c9d-5f3d-4e05-b100-5c057845faec None admin] REQUEST_METHOD: `GET` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:06:58.184541 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65225c9d-5f3d-4e05-b100-5c057845faec None admin] SCRIPT_NAME: `/identity` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:06:58.184847 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65225c9d-5f3d-4e05-b100-5c057845faec None admin] PATH_INFO: `/v3/roles/admin` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:06:58.193778 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG dbcounter [-] [416293] Writing DB stats keystone:SELECT=100 {{(pid=416293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:06:58.197294 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65225c9d-5f3d-4e05-b100-5c057845faec None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 09:06:58.203152 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application [None req-65225c9d-5f3d-4e05-b100-5c057845faec None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 09:06:58.203152 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 09:06:58.203152 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 09:06:58.203152 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 09:06:58.203152 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 09:06:58.203152 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 09:06:58.203152 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 09:06:58.203152 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 09:06:58.203152 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 09:06:58.203152 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 09:06:58.203152 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 09:06:58.203152 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 09:06:58.203152 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 09:06:58.203152 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 09:06:58.203152 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 09:06:58.203152 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 09:06:58.204316 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 09:06:58.204316 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 09:06:58.204316 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 09:06:58.204316 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 09:06:58.204316 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 09:06:58.204316 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 09:06:58.204316 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 09:06:58.204316 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 09:06:58.204316 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 09:06:58.204316 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 09:06:58.204316 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 09:06:58.204316 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application with Lock( Jul 28 09:06:58.204316 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 09:06:58.204316 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self._enter() Jul 28 09:06:58.204316 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 09:06:58.204316 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 09:06:58.205340 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 09:06:58.205340 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self.creator() Jul 28 09:06:58.205340 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 09:06:58.205340 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application created_value = creator( Jul 28 09:06:58.205340 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 09:06:58.205340 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 09:06:58.205340 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 09:06:58.205340 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 09:06:58.205340 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 09:06:58.205340 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 09:06:58.205340 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 09:06:58.205340 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application Jul 28 09:06:58.205340 dv-cinder-851351-1-smb devstack@keystone.service[416293]: [pid: 416293|app: 0|req: 420/845] 10.222.0.42 () {56 vars in 1096 bytes} [Thu Jul 28 09:06:58 2022] GET /identity/v3/roles/admin => generated 83 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 09:06:58.211003 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0dcbcad-eae8-4f8e-94ae-1270a7db5439 None None] Authenticating user token {{(pid=416294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:06:58.249707 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG dbcounter [-] [416294] Writing DB stats keystone:SELECT=100 {{(pid=416294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:06:58.306255 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f8db08-d72c-4eaa-958b-8bf23838d00a None None] REQUEST_METHOD: `GET` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:06:58.306850 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f8db08-d72c-4eaa-958b-8bf23838d00a None None] SCRIPT_NAME: `/identity` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:06:58.307062 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f8db08-d72c-4eaa-958b-8bf23838d00a None None] PATH_INFO: `/` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:06:58.309430 dv-cinder-851351-1-smb devstack@keystone.service[416293]: [pid: 416293|app: 0|req: 421/846] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 09:06:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 09:06:58.314980 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bca54fe-0ffd-4239-9840-d100752ace52 None None] REQUEST_METHOD: `POST` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:06:58.315368 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bca54fe-0ffd-4239-9840-d100752ace52 None None] SCRIPT_NAME: `/identity` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:06:58.315741 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bca54fe-0ffd-4239-9840-d100752ace52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:06:58.325797 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0dcbcad-eae8-4f8e-94ae-1270a7db5439 None None] Validating token access rules against request {{(pid=416294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:06:58.339496 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.auth.core [None req-6bca54fe-0ffd-4239-9840-d100752ace52 None None] MFA Rules not processed for user `dbf87abab90e4fdf9e75408f4199918e`. Rule list: `[]` (Enabled: `True`). {{(pid=416293) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 09:06:58.341181 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.fernet_utils [None req-6bca54fe-0ffd-4239-9840-d100752ace52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=416293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 09:06:58.363383 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-957d0eb3-4e9d-4fd6-b23b-f77f3698e3ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:06:58.364084 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957d0eb3-4e9d-4fd6-b23b-f77f3698e3ef None admin] REQUEST_METHOD: `GET` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:06:58.364365 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957d0eb3-4e9d-4fd6-b23b-f77f3698e3ef None admin] SCRIPT_NAME: `/identity` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:06:58.364638 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957d0eb3-4e9d-4fd6-b23b-f77f3698e3ef None admin] PATH_INFO: `/v3/roles` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:06:58.367281 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-957d0eb3-4e9d-4fd6-b23b-f77f3698e3ef None admin] RBAC: Adding query filter params (name=admin) {{(pid=416294) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 09:06:58.367595 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-957d0eb3-4e9d-4fd6-b23b-f77f3698e3ef None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:06:58.372308 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-957d0eb3-4e9d-4fd6-b23b-f77f3698e3ef None admin] RBAC: Authorization granted {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:06:58.387554 dv-cinder-851351-1-smb devstack@keystone.service[416294]: [pid: 416294|app: 0|req: 426/847] 10.222.0.42 () {56 vars in 1099 bytes} [Thu Jul 28 09:06:58 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:06:58.392195 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-957d0eb3-4e9d-4fd6-b23b-f77f3698e3ef None admin] Authenticating user token {{(pid=416294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:06:58.426156 dv-cinder-851351-1-smb devstack@keystone.service[416293]: [pid: 416293|app: 0|req: 422/848] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 09:06:58 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 28 09:06:58.453061 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bca54fe-0ffd-4239-9840-d100752ace52 None None] Authenticating user token {{(pid=416293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:06:58.514811 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG dbcounter [-] [416294] Writing DB stats keystone:SELECT=100 {{(pid=416294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:06:58.523603 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-957d0eb3-4e9d-4fd6-b23b-f77f3698e3ef None admin] Validating token access rules against request {{(pid=416294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:06:58.566426 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70fee677-c7c2-4366-b407-c7e195b22aae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:06:58.567448 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70fee677-c7c2-4366-b407-c7e195b22aae None admin] REQUEST_METHOD: `GET` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:06:58.567930 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70fee677-c7c2-4366-b407-c7e195b22aae None admin] SCRIPT_NAME: `/identity` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:06:58.568402 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70fee677-c7c2-4366-b407-c7e195b22aae None admin] PATH_INFO: `/v3/domains/Default` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:06:58.580658 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bca54fe-0ffd-4239-9840-d100752ace52 None None] Validating token access rules against request {{(pid=416293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:06:58.581691 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70fee677-c7c2-4366-b407-c7e195b22aae None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:06:58.583464 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70fee677-c7c2-4366-b407-c7e195b22aae None admin] RBAC: Authorization granted {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:06:58.599831 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application [None req-70fee677-c7c2-4366-b407-c7e195b22aae None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 09:06:58.599831 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 09:06:58.599831 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 09:06:58.599831 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 09:06:58.599831 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 09:06:58.599831 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 09:06:58.599831 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 09:06:58.599831 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 09:06:58.599831 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 09:06:58.599831 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 09:06:58.599831 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 09:06:58.599831 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 09:06:58.599831 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 09:06:58.599831 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 09:06:58.599831 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 09:06:58.600939 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 09:06:58.600939 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 09:06:58.600939 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 09:06:58.600939 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 09:06:58.600939 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 09:06:58.600939 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 09:06:58.600939 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 09:06:58.600939 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 09:06:58.600939 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application with Lock( Jul 28 09:06:58.600939 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 09:06:58.600939 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return self._enter() Jul 28 09:06:58.600939 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 09:06:58.600939 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 09:06:58.600939 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 09:06:58.600939 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return self.creator() Jul 28 09:06:58.600939 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 09:06:58.600939 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application created_value = creator( Jul 28 09:06:58.601922 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 09:06:58.601922 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 09:06:58.601922 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 09:06:58.601922 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application Jul 28 09:06:58.604254 dv-cinder-851351-1-smb devstack@keystone.service[416294]: [pid: 416294|app: 0|req: 427/849] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 09:06:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 09:06:58.614261 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70fee677-c7c2-4366-b407-c7e195b22aae None admin] Authenticating user token {{(pid=416294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:06:58.618895 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG dbcounter [-] [416293] Writing DB stats keystone:SELECT=100 {{(pid=416293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:06:58.626563 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae59ad4-0e06-480c-b364-76042480f5d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:06:58.627474 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae59ad4-0e06-480c-b364-76042480f5d7 None admin] REQUEST_METHOD: `POST` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:06:58.627941 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae59ad4-0e06-480c-b364-76042480f5d7 None admin] SCRIPT_NAME: `/identity` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:06:58.628358 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae59ad4-0e06-480c-b364-76042480f5d7 None admin] PATH_INFO: `/v3/services` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:06:58.629267 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae59ad4-0e06-480c-b364-76042480f5d7 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:06:58.630869 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae59ad4-0e06-480c-b364-76042480f5d7 None admin] RBAC: Authorization granted {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:06:58.659005 dv-cinder-851351-1-smb devstack@keystone.service[416293]: [pid: 416293|app: 0|req: 423/850] 10.222.0.42 () {60 vars in 1141 bytes} [Thu Jul 28 09:06:58 2022] POST /identity/v3/services => generated 251 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 28 09:06:58.754104 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70fee677-c7c2-4366-b407-c7e195b22aae None admin] Validating token access rules against request {{(pid=416294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:06:58.815844 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ccaa28-18eb-4027-b03a-2d98687cecec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:06:58.817056 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ccaa28-18eb-4027-b03a-2d98687cecec None admin] REQUEST_METHOD: `GET` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:06:58.817548 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ccaa28-18eb-4027-b03a-2d98687cecec None admin] SCRIPT_NAME: `/identity` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:06:58.818038 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ccaa28-18eb-4027-b03a-2d98687cecec None admin] PATH_INFO: `/v3/domains` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:06:58.819429 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44ccaa28-18eb-4027-b03a-2d98687cecec None admin] RBAC: Adding query filter params (name=Default) {{(pid=416294) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 09:06:58.819978 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44ccaa28-18eb-4027-b03a-2d98687cecec None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:06:58.822856 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44ccaa28-18eb-4027-b03a-2d98687cecec None admin] RBAC: Authorization granted {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:06:58.848784 dv-cinder-851351-1-smb devstack@keystone.service[416294]: [pid: 416294|app: 0|req: 428/851] 10.222.0.42 () {56 vars in 1109 bytes} [Thu Jul 28 09:06:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 09:06:58.854595 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae59ad4-0e06-480c-b364-76042480f5d7 None admin] Authenticating user token {{(pid=416293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:06:58.940570 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68bb129-9564-4066-b3c0-7d4dd91648c6 None None] REQUEST_METHOD: `GET` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:06:58.941086 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68bb129-9564-4066-b3c0-7d4dd91648c6 None None] SCRIPT_NAME: `/identity` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:06:58.941577 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68bb129-9564-4066-b3c0-7d4dd91648c6 None None] PATH_INFO: `/` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:06:58.944210 dv-cinder-851351-1-smb devstack@keystone.service[416294]: [pid: 416294|app: 0|req: 429/852] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 09:06:58 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 28 09:06:58.950792 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437f27d3-332a-4857-827e-f4d80021d524 None None] REQUEST_METHOD: `POST` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:06:58.951236 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437f27d3-332a-4857-827e-f4d80021d524 None None] SCRIPT_NAME: `/identity` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:06:58.951627 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437f27d3-332a-4857-827e-f4d80021d524 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:06:58.966279 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG dbcounter [-] [416294] Writing DB stats keystone:SELECT=100 {{(pid=416294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:06:58.976703 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.auth.core [None req-437f27d3-332a-4857-827e-f4d80021d524 None None] MFA Rules not processed for user `dbf87abab90e4fdf9e75408f4199918e`. Rule list: `[]` (Enabled: `True`). {{(pid=416294) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 09:06:58.976703 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.fernet_utils [None req-437f27d3-332a-4857-827e-f4d80021d524 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=416294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 09:06:59.023715 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae59ad4-0e06-480c-b364-76042480f5d7 None admin] Validating token access rules against request {{(pid=416293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:06:59.063712 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1818bf9e-49fb-47d5-ac68-217841ea74f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:06:59.064413 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1818bf9e-49fb-47d5-ac68-217841ea74f9 None admin] REQUEST_METHOD: `GET` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:06:59.064733 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1818bf9e-49fb-47d5-ac68-217841ea74f9 None admin] SCRIPT_NAME: `/identity` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:06:59.065081 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1818bf9e-49fb-47d5-ac68-217841ea74f9 None admin] PATH_INFO: `/v3/users/swift` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:06:59.075343 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1818bf9e-49fb-47d5-ac68-217841ea74f9 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:06:59.076461 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1818bf9e-49fb-47d5-ac68-217841ea74f9 None admin] RBAC: Authorization granted {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:06:59.089798 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application [None req-1818bf9e-49fb-47d5-ac68-217841ea74f9 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 28 09:06:59.089798 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 09:06:59.089798 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 09:06:59.089798 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 09:06:59.089798 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 09:06:59.089798 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 09:06:59.089798 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 09:06:59.089798 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 09:06:59.089798 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 09:06:59.089798 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 09:06:59.089798 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 09:06:59.089798 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 09:06:59.089798 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 28 09:06:59.089798 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 28 09:06:59.089798 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 28 09:06:59.089798 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 28 09:06:59.091809 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 09:06:59.091809 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 09:06:59.091809 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 28 09:06:59.091809 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 09:06:59.091809 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 28 09:06:59.091809 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 09:06:59.091809 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 09:06:59.091809 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 09:06:59.091809 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 09:06:59.091809 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 09:06:59.091809 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 09:06:59.091809 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application with Lock( Jul 28 09:06:59.091809 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 09:06:59.091809 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self._enter() Jul 28 09:06:59.091809 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 09:06:59.091809 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 09:06:59.091809 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 09:06:59.091809 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self.creator() Jul 28 09:06:59.094528 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 09:06:59.094528 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application created_value = creator( Jul 28 09:06:59.094528 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 28 09:06:59.094528 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 28 09:06:59.094528 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 28 09:06:59.094528 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 28 09:06:59.094528 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 28 09:06:59.094528 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 28 09:06:59.094528 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 28 09:06:59.094528 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application Jul 28 09:06:59.094528 dv-cinder-851351-1-smb devstack@keystone.service[416293]: [pid: 416293|app: 0|req: 424/853] 10.222.0.42 () {56 vars in 1096 bytes} [Thu Jul 28 09:06:58 2022] GET /identity/v3/users/swift => generated 83 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 09:06:59.097308 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1818bf9e-49fb-47d5-ac68-217841ea74f9 None admin] Authenticating user token {{(pid=416293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:06:59.110260 dv-cinder-851351-1-smb devstack@keystone.service[416294]: [pid: 416294|app: 0|req: 430/854] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 09:06:58 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 28 09:06:59.135458 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437f27d3-332a-4857-827e-f4d80021d524 None None] Authenticating user token {{(pid=416294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:06:59.178083 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG dbcounter [-] [416293] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=416293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:06:59.239515 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1818bf9e-49fb-47d5-ac68-217841ea74f9 None admin] Validating token access rules against request {{(pid=416293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:06:59.292444 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f3e0635-3d4a-44c7-a9e5-7c26425d74a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:06:59.292444 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3e0635-3d4a-44c7-a9e5-7c26425d74a7 None admin] REQUEST_METHOD: `GET` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:06:59.292444 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3e0635-3d4a-44c7-a9e5-7c26425d74a7 None admin] SCRIPT_NAME: `/identity` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:06:59.292841 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3e0635-3d4a-44c7-a9e5-7c26425d74a7 None admin] PATH_INFO: `/v3/users` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:06:59.293752 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f3e0635-3d4a-44c7-a9e5-7c26425d74a7 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=416293) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 09:06:59.293941 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f3e0635-3d4a-44c7-a9e5-7c26425d74a7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:06:59.295384 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f3e0635-3d4a-44c7-a9e5-7c26425d74a7 None admin] RBAC: Authorization granted {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:06:59.330127 dv-cinder-851351-1-smb devstack@keystone.service[416293]: [pid: 416293|app: 0|req: 425/855] 10.222.0.42 () {56 vars in 1135 bytes} [Thu Jul 28 09:06:59 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 09:06:59.331577 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f3e0635-3d4a-44c7-a9e5-7c26425d74a7 None admin] Authenticating user token {{(pid=416293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:06:59.333086 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437f27d3-332a-4857-827e-f4d80021d524 None None] Validating token access rules against request {{(pid=416294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:06:59.375164 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb242a7c-6095-4f5b-84fd-5fae7c334258 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:06:59.376322 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb242a7c-6095-4f5b-84fd-5fae7c334258 None admin] REQUEST_METHOD: `GET` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:06:59.376937 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb242a7c-6095-4f5b-84fd-5fae7c334258 None admin] SCRIPT_NAME: `/identity` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:06:59.377437 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb242a7c-6095-4f5b-84fd-5fae7c334258 None admin] PATH_INFO: `/v3/roles/service` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:06:59.381122 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG dbcounter [-] [416294] Writing DB stats keystone:SELECT=100 {{(pid=416294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:06:59.394887 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb242a7c-6095-4f5b-84fd-5fae7c334258 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 09:06:59.400811 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application [None req-bb242a7c-6095-4f5b-84fd-5fae7c334258 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 28 09:06:59.400811 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 09:06:59.400811 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 09:06:59.400811 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 09:06:59.400811 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 09:06:59.400811 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 09:06:59.400811 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 09:06:59.400811 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 09:06:59.400811 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 09:06:59.400811 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 09:06:59.400811 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 09:06:59.400811 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 09:06:59.400811 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 09:06:59.400811 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 09:06:59.400811 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 09:06:59.400811 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 09:06:59.401859 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 09:06:59.401859 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 09:06:59.401859 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 09:06:59.401859 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 09:06:59.401859 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 09:06:59.401859 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 09:06:59.401859 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 09:06:59.401859 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 09:06:59.401859 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 09:06:59.401859 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 09:06:59.401859 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 09:06:59.401859 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application with Lock( Jul 28 09:06:59.401859 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 09:06:59.401859 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return self._enter() Jul 28 09:06:59.401859 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 09:06:59.401859 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 09:06:59.402802 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 09:06:59.402802 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return self.creator() Jul 28 09:06:59.402802 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 09:06:59.402802 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application created_value = creator( Jul 28 09:06:59.402802 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 09:06:59.402802 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 09:06:59.402802 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 09:06:59.402802 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 09:06:59.402802 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 09:06:59.402802 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 09:06:59.402802 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 28 09:06:59.402802 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application Jul 28 09:06:59.413061 dv-cinder-851351-1-smb devstack@keystone.service[416294]: [pid: 416294|app: 0|req: 431/856] 10.222.0.42 () {56 vars in 1102 bytes} [Thu Jul 28 09:06:59 2022] GET /identity/v3/roles/service => generated 85 bytes in 279 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 09:06:59.414436 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb242a7c-6095-4f5b-84fd-5fae7c334258 None admin] Authenticating user token {{(pid=416294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:06:59.461926 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f3e0635-3d4a-44c7-a9e5-7c26425d74a7 None admin] Validating token access rules against request {{(pid=416293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:06:59.472299 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG dbcounter [-] [416293] Writing DB stats keystone:SELECT=100 {{(pid=416293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:06:59.499888 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe99f538-b229-4cb9-a263-2c6a870ef68c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:06:59.500597 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe99f538-b229-4cb9-a263-2c6a870ef68c None admin] REQUEST_METHOD: `GET` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:06:59.500986 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe99f538-b229-4cb9-a263-2c6a870ef68c None admin] SCRIPT_NAME: `/identity` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:06:59.501268 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe99f538-b229-4cb9-a263-2c6a870ef68c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:06:59.539332 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb242a7c-6095-4f5b-84fd-5fae7c334258 None admin] Validating token access rules against request {{(pid=416294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:06:59.575998 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe99f538-b229-4cb9-a263-2c6a870ef68c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:06:59.577482 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe99f538-b229-4cb9-a263-2c6a870ef68c None admin] RBAC: Authorization granted {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:06:59.581101 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6846bc8-a87a-4b7e-9623-7963a4ef437b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:06:59.582068 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6846bc8-a87a-4b7e-9623-7963a4ef437b None admin] REQUEST_METHOD: `GET` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:06:59.582586 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6846bc8-a87a-4b7e-9623-7963a4ef437b None admin] SCRIPT_NAME: `/identity` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:06:59.583079 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6846bc8-a87a-4b7e-9623-7963a4ef437b None admin] PATH_INFO: `/v3/roles` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:06:59.584034 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6846bc8-a87a-4b7e-9623-7963a4ef437b None admin] RBAC: Adding query filter params (name=service) {{(pid=416294) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 09:06:59.584578 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6846bc8-a87a-4b7e-9623-7963a4ef437b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:06:59.586357 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6846bc8-a87a-4b7e-9623-7963a4ef437b None admin] RBAC: Authorization granted {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:06:59.603802 dv-cinder-851351-1-smb devstack@keystone.service[416294]: [pid: 416294|app: 0|req: 432/857] 10.222.0.42 () {56 vars in 1103 bytes} [Thu Jul 28 09:06:59 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:06:59.605854 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6846bc8-a87a-4b7e-9623-7963a4ef437b None admin] Authenticating user token {{(pid=416294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:06:59.679990 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG dbcounter [-] [416294] Writing DB stats keystone:SELECT=100 {{(pid=416294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:06:59.704706 dv-cinder-851351-1-smb devstack@keystone.service[416293]: [pid: 416293|app: 0|req: 426/858] 10.222.0.42 () {58 vars in 1282 bytes} [Thu Jul 28 09:06:59 2022] GET /identity/v3/auth/tokens => generated 1252 bytes in 369 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 28 09:06:59.711960 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe99f538-b229-4cb9-a263-2c6a870ef68c None admin] Authenticating user token {{(pid=416293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:06:59.724179 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG dbcounter [-] [416293] Writing DB stats keystone:SELECT=100 {{(pid=416293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:06:59.782955 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6846bc8-a87a-4b7e-9623-7963a4ef437b None admin] Validating token access rules against request {{(pid=416294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:06:59.836980 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53007721-b3f5-4b30-9db2-8a0500fff778 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:06:59.838404 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53007721-b3f5-4b30-9db2-8a0500fff778 None admin] REQUEST_METHOD: `GET` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:06:59.838863 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53007721-b3f5-4b30-9db2-8a0500fff778 None admin] SCRIPT_NAME: `/identity` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:06:59.839331 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53007721-b3f5-4b30-9db2-8a0500fff778 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:06:59.839520 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe99f538-b229-4cb9-a263-2c6a870ef68c None admin] Validating token access rules against request {{(pid=416293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:06:59.856804 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53007721-b3f5-4b30-9db2-8a0500fff778 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:06:59.859285 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53007721-b3f5-4b30-9db2-8a0500fff778 None admin] RBAC: Authorization granted {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:06:59.878404 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application [None req-53007721-b3f5-4b30-9db2-8a0500fff778 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 09:06:59.878404 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 09:06:59.878404 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 09:06:59.878404 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 09:06:59.878404 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 09:06:59.878404 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 09:06:59.878404 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 09:06:59.878404 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 09:06:59.878404 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 09:06:59.878404 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 09:06:59.878404 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 09:06:59.878404 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 09:06:59.878404 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 09:06:59.878404 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 09:06:59.878404 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 09:06:59.879479 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 09:06:59.879479 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 09:06:59.879479 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 09:06:59.879479 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 09:06:59.879479 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 09:06:59.879479 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 09:06:59.879479 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 09:06:59.879479 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 09:06:59.879479 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application with Lock( Jul 28 09:06:59.879479 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 09:06:59.879479 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return self._enter() Jul 28 09:06:59.879479 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 09:06:59.879479 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 09:06:59.879479 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 09:06:59.879479 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return self.creator() Jul 28 09:06:59.879479 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 09:06:59.879479 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application created_value = creator( Jul 28 09:06:59.880473 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 09:06:59.880473 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 09:06:59.880473 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 09:06:59.880473 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application Jul 28 09:06:59.880473 dv-cinder-851351-1-smb devstack@keystone.service[416294]: [pid: 416294|app: 0|req: 433/859] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 09:06:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 275 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 09:06:59.880849 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0746de-ef78-490d-859f-d359bba6d7e6 None None] REQUEST_METHOD: `GET` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:06:59.881464 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0746de-ef78-490d-859f-d359bba6d7e6 None None] SCRIPT_NAME: `/identity` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:06:59.881464 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0746de-ef78-490d-859f-d359bba6d7e6 None None] PATH_INFO: `/` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:06:59.882854 dv-cinder-851351-1-smb devstack@keystone.service[416294]: [pid: 416294|app: 0|req: 434/860] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 09:06:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 09:06:59.886921 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa0746de-ef78-490d-859f-d359bba6d7e6 None None] Authenticating user token {{(pid=416294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:06:59.887469 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7251180f-79e5-41e6-b6c8-fdec617f0251 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:06:59.888164 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7251180f-79e5-41e6-b6c8-fdec617f0251 None admin] REQUEST_METHOD: `GET` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:06:59.888455 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7251180f-79e5-41e6-b6c8-fdec617f0251 None admin] SCRIPT_NAME: `/identity` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:06:59.888828 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7251180f-79e5-41e6-b6c8-fdec617f0251 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:06:59.901982 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7251180f-79e5-41e6-b6c8-fdec617f0251 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:06:59.903477 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7251180f-79e5-41e6-b6c8-fdec617f0251 None admin] RBAC: Authorization granted {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:06:59.920979 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application [None req-7251180f-79e5-41e6-b6c8-fdec617f0251 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 09:06:59.920979 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 09:06:59.920979 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 09:06:59.920979 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 09:06:59.920979 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 09:06:59.920979 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 09:06:59.920979 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 09:06:59.920979 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 09:06:59.920979 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 09:06:59.920979 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 09:06:59.920979 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 09:06:59.920979 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 09:06:59.920979 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 09:06:59.920979 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 09:06:59.920979 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 09:06:59.922021 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 09:06:59.922021 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 09:06:59.922021 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 09:06:59.922021 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 09:06:59.922021 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 09:06:59.922021 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 09:06:59.922021 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 09:06:59.922021 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 09:06:59.922021 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application with Lock( Jul 28 09:06:59.922021 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 09:06:59.922021 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self._enter() Jul 28 09:06:59.922021 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 09:06:59.922021 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 09:06:59.922021 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 09:06:59.922021 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self.creator() Jul 28 09:06:59.922021 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 09:06:59.922021 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application created_value = creator( Jul 28 09:06:59.923057 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 09:06:59.923057 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 09:06:59.923057 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 09:06:59.923057 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application Jul 28 09:06:59.923057 dv-cinder-851351-1-smb devstack@keystone.service[416293]: [pid: 416293|app: 0|req: 427/861] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 09:06:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 09:06:59.923906 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb9eeab-eaec-44d2-b447-e8494fbf63a4 None None] REQUEST_METHOD: `POST` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:06:59.923906 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb9eeab-eaec-44d2-b447-e8494fbf63a4 None None] SCRIPT_NAME: `/identity` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:06:59.924069 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb9eeab-eaec-44d2-b447-e8494fbf63a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:06:59.945474 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.auth.core [None req-8bb9eeab-eaec-44d2-b447-e8494fbf63a4 None None] MFA Rules not processed for user `dbf87abab90e4fdf9e75408f4199918e`. Rule list: `[]` (Enabled: `True`). {{(pid=416293) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 09:06:59.946705 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.fernet_utils [None req-8bb9eeab-eaec-44d2-b447-e8494fbf63a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=416293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 09:07:00.009159 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG dbcounter [-] [416293] Writing DB stats keystone:SELECT=100 {{(pid=416293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:07:00.018529 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa0746de-ef78-490d-859f-d359bba6d7e6 None None] Validating token access rules against request {{(pid=416294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:07:00.020973 dv-cinder-851351-1-smb devstack@keystone.service[416293]: [pid: 416293|app: 0|req: 428/862] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 09:06:59 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 09:07:00.025630 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb9eeab-eaec-44d2-b447-e8494fbf63a4 None None] Authenticating user token {{(pid=416293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:07:00.032208 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG dbcounter [-] [416294] Writing DB stats keystone:SELECT=100 {{(pid=416294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:07:00.065485 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad7a35c8-c7c2-4339-9aeb-b1dc831a9017 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:07:00.066405 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7a35c8-c7c2-4339-9aeb-b1dc831a9017 None admin] REQUEST_METHOD: `GET` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:07:00.066845 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7a35c8-c7c2-4339-9aeb-b1dc831a9017 None admin] SCRIPT_NAME: `/identity` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:07:00.067277 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7a35c8-c7c2-4339-9aeb-b1dc831a9017 None admin] PATH_INFO: `/v3/domains` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:07:00.068276 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad7a35c8-c7c2-4339-9aeb-b1dc831a9017 None admin] RBAC: Adding query filter params (name=Default) {{(pid=416294) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 09:07:00.068913 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad7a35c8-c7c2-4339-9aeb-b1dc831a9017 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:07:00.070559 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad7a35c8-c7c2-4339-9aeb-b1dc831a9017 None admin] RBAC: Authorization granted {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:07:00.089652 dv-cinder-851351-1-smb devstack@keystone.service[416294]: [pid: 416294|app: 0|req: 435/863] 10.222.0.42 () {56 vars in 1109 bytes} [Thu Jul 28 09:06:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:07:00.090764 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad7a35c8-c7c2-4339-9aeb-b1dc831a9017 None admin] Authenticating user token {{(pid=416294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:07:00.163594 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb9eeab-eaec-44d2-b447-e8494fbf63a4 None None] Validating token access rules against request {{(pid=416293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:07:00.222369 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f776a089-9147-4a73-9f16-c5998fbcc465 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:07:00.223377 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f776a089-9147-4a73-9f16-c5998fbcc465 None admin] REQUEST_METHOD: `GET` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:07:00.223835 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f776a089-9147-4a73-9f16-c5998fbcc465 None admin] SCRIPT_NAME: `/identity` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:07:00.224286 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f776a089-9147-4a73-9f16-c5998fbcc465 None admin] PATH_INFO: `/v3/domains` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:07:00.225471 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f776a089-9147-4a73-9f16-c5998fbcc465 None admin] RBAC: Adding query filter params (name=Default) {{(pid=416293) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 09:07:00.225966 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f776a089-9147-4a73-9f16-c5998fbcc465 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:07:00.228226 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f776a089-9147-4a73-9f16-c5998fbcc465 None admin] RBAC: Authorization granted {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:07:00.239722 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad7a35c8-c7c2-4339-9aeb-b1dc831a9017 None admin] Validating token access rules against request {{(pid=416294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:07:00.253895 dv-cinder-851351-1-smb devstack@keystone.service[416293]: [pid: 416293|app: 0|req: 429/864] 10.222.0.42 () {56 vars in 1109 bytes} [Thu Jul 28 09:07:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:07:00.253895 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f776a089-9147-4a73-9f16-c5998fbcc465 None admin] Authenticating user token {{(pid=416293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:07:00.299592 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296e867e-4502-43e1-8fcf-1115d39513c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:07:00.300788 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296e867e-4502-43e1-8fcf-1115d39513c0 None admin] REQUEST_METHOD: `POST` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:07:00.301354 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296e867e-4502-43e1-8fcf-1115d39513c0 None admin] SCRIPT_NAME: `/identity` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:07:00.301927 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296e867e-4502-43e1-8fcf-1115d39513c0 None admin] PATH_INFO: `/v3/services` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:07:00.304107 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-296e867e-4502-43e1-8fcf-1115d39513c0 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:07:00.307967 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-296e867e-4502-43e1-8fcf-1115d39513c0 None admin] RBAC: Authorization granted {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:07:00.316939 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG dbcounter [-] [416293] Writing DB stats keystone:SELECT=100 {{(pid=416293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:07:00.348798 dv-cinder-851351-1-smb devstack@keystone.service[416294]: [pid: 416294|app: 0|req: 436/865] 10.222.0.42 () {60 vars in 1141 bytes} [Thu Jul 28 09:07:00 2022] POST /identity/v3/services => generated 269 bytes in 247 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 09:07:00.348798 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296e867e-4502-43e1-8fcf-1115d39513c0 None admin] Authenticating user token {{(pid=416294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:07:00.409936 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG dbcounter [-] [416294] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=416294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:07:00.427107 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f776a089-9147-4a73-9f16-c5998fbcc465 None admin] Validating token access rules against request {{(pid=416293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:07:00.488440 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c1f7d84-c075-4c38-8b20-4dd661b02372 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:07:00.489608 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1f7d84-c075-4c38-8b20-4dd661b02372 None admin] REQUEST_METHOD: `GET` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:07:00.490109 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1f7d84-c075-4c38-8b20-4dd661b02372 None admin] SCRIPT_NAME: `/identity` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:07:00.490670 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1f7d84-c075-4c38-8b20-4dd661b02372 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:07:00.499987 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c1f7d84-c075-4c38-8b20-4dd661b02372 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:07:00.501471 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296e867e-4502-43e1-8fcf-1115d39513c0 None admin] Validating token access rules against request {{(pid=416294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:07:00.502263 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c1f7d84-c075-4c38-8b20-4dd661b02372 None admin] RBAC: Authorization granted {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:07:00.516418 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application [None req-1c1f7d84-c075-4c38-8b20-4dd661b02372 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 28 09:07:00.516418 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 09:07:00.516418 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 09:07:00.516418 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 09:07:00.516418 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 09:07:00.516418 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 09:07:00.516418 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 09:07:00.516418 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 09:07:00.516418 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 09:07:00.516418 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 09:07:00.516418 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 09:07:00.516418 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 09:07:00.516418 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 28 09:07:00.516418 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 28 09:07:00.516418 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 28 09:07:00.516418 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 28 09:07:00.517747 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 09:07:00.517747 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 09:07:00.517747 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 28 09:07:00.517747 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 09:07:00.517747 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 28 09:07:00.517747 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 09:07:00.517747 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 09:07:00.517747 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 09:07:00.517747 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 09:07:00.517747 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 09:07:00.517747 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 09:07:00.517747 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application with Lock( Jul 28 09:07:00.517747 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 09:07:00.517747 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self._enter() Jul 28 09:07:00.517747 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 09:07:00.517747 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 09:07:00.517747 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 09:07:00.517747 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self.creator() Jul 28 09:07:00.518787 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 09:07:00.518787 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application created_value = creator( Jul 28 09:07:00.518787 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 28 09:07:00.518787 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 28 09:07:00.518787 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 28 09:07:00.518787 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 28 09:07:00.518787 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 28 09:07:00.518787 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 28 09:07:00.518787 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 28 09:07:00.518787 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application Jul 28 09:07:00.521936 dv-cinder-851351-1-smb devstack@keystone.service[416293]: [pid: 416293|app: 0|req: 430/866] 10.222.0.42 () {56 vars in 1117 bytes} [Thu Jul 28 09:07:00 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 272 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 09:07:00.529989 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c1f7d84-c075-4c38-8b20-4dd661b02372 None admin] Authenticating user token {{(pid=416293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:07:00.566822 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e71520-71ee-4864-8163-1fb2b780ece0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:07:00.566822 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e71520-71ee-4864-8163-1fb2b780ece0 None admin] REQUEST_METHOD: `GET` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:07:00.567165 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e71520-71ee-4864-8163-1fb2b780ece0 None admin] SCRIPT_NAME: `/identity` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:07:00.567247 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e71520-71ee-4864-8163-1fb2b780ece0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:07:00.576711 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19e71520-71ee-4864-8163-1fb2b780ece0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:07:00.578654 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19e71520-71ee-4864-8163-1fb2b780ece0 None admin] RBAC: Authorization granted {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:07:00.593465 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application [None req-19e71520-71ee-4864-8163-1fb2b780ece0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 09:07:00.593465 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 09:07:00.593465 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 09:07:00.593465 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 09:07:00.593465 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 09:07:00.593465 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 09:07:00.593465 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 09:07:00.593465 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 09:07:00.593465 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 09:07:00.593465 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 09:07:00.593465 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 09:07:00.593465 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 09:07:00.593465 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 28 09:07:00.593465 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 28 09:07:00.593465 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 28 09:07:00.595459 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 28 09:07:00.595459 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 09:07:00.595459 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 09:07:00.595459 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 09:07:00.595459 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 09:07:00.595459 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 09:07:00.595459 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 09:07:00.595459 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 09:07:00.595459 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application with Lock( Jul 28 09:07:00.595459 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 09:07:00.595459 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return self._enter() Jul 28 09:07:00.595459 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 09:07:00.595459 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 09:07:00.595459 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 09:07:00.595459 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return self.creator() Jul 28 09:07:00.595459 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 09:07:00.595459 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application created_value = creator( Jul 28 09:07:00.598139 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 28 09:07:00.598139 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 28 09:07:00.598139 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 28 09:07:00.598139 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 28 09:07:00.598139 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 28 09:07:00.598139 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 28 09:07:00.598139 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 09:07:00.598139 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application Jul 28 09:07:00.598139 dv-cinder-851351-1-smb devstack@keystone.service[416294]: [pid: 416294|app: 0|req: 437/867] 10.222.0.42 () {56 vars in 1111 bytes} [Thu Jul 28 09:07:00 2022] GET /identity/v3/projects/service => generated 88 bytes in 257 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 09:07:00.601564 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e71520-71ee-4864-8163-1fb2b780ece0 None admin] Authenticating user token {{(pid=416294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:07:00.680874 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c1f7d84-c075-4c38-8b20-4dd661b02372 None admin] Validating token access rules against request {{(pid=416293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:07:00.689993 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG dbcounter [-] [416293] Writing DB stats keystone:SELECT=100 {{(pid=416293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:07:00.734450 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c639e62-065f-43a7-bdd1-8e694fb8353b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:07:00.735544 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c639e62-065f-43a7-bdd1-8e694fb8353b None admin] REQUEST_METHOD: `GET` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:07:00.736045 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c639e62-065f-43a7-bdd1-8e694fb8353b None admin] SCRIPT_NAME: `/identity` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:07:00.736500 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c639e62-065f-43a7-bdd1-8e694fb8353b None admin] PATH_INFO: `/v3/users` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:07:00.737874 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c639e62-065f-43a7-bdd1-8e694fb8353b None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=416293) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 09:07:00.738375 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c639e62-065f-43a7-bdd1-8e694fb8353b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:07:00.740032 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c639e62-065f-43a7-bdd1-8e694fb8353b None admin] RBAC: Authorization granted {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:07:00.750606 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG dbcounter [-] [416294] Writing DB stats keystone:SELECT=100 {{(pid=416294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:07:00.762034 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e71520-71ee-4864-8163-1fb2b780ece0 None admin] Validating token access rules against request {{(pid=416294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:07:00.765113 dv-cinder-851351-1-smb devstack@keystone.service[416293]: [pid: 416293|app: 0|req: 431/868] 10.222.0.42 () {56 vars in 1149 bytes} [Thu Jul 28 09:07:00 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:07:00.766783 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c639e62-065f-43a7-bdd1-8e694fb8353b None admin] Authenticating user token {{(pid=416293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:07:00.800898 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9b5d3b-04b7-40e2-bac9-187e7083eddc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:07:00.801938 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9b5d3b-04b7-40e2-bac9-187e7083eddc None admin] REQUEST_METHOD: `GET` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:07:00.802451 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9b5d3b-04b7-40e2-bac9-187e7083eddc None admin] SCRIPT_NAME: `/identity` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:07:00.802939 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9b5d3b-04b7-40e2-bac9-187e7083eddc None admin] PATH_INFO: `/v3/projects` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:07:00.803936 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae9b5d3b-04b7-40e2-bac9-187e7083eddc None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=416294) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 09:07:00.804459 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae9b5d3b-04b7-40e2-bac9-187e7083eddc None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:07:00.806158 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae9b5d3b-04b7-40e2-bac9-187e7083eddc None admin] RBAC: Authorization granted {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:07:00.820290 dv-cinder-851351-1-smb devstack@keystone.service[416294]: [pid: 416294|app: 0|req: 438/869] 10.222.0.42 () {56 vars in 1148 bytes} [Thu Jul 28 09:07:00 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:07:00.827481 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9b5d3b-04b7-40e2-bac9-187e7083eddc None admin] Authenticating user token {{(pid=416294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:07:00.877931 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c639e62-065f-43a7-bdd1-8e694fb8353b None admin] Validating token access rules against request {{(pid=416293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:07:00.919997 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4311d9e-ecd9-4169-8859-3b90c2e19f2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:07:00.920650 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4311d9e-ecd9-4169-8859-3b90c2e19f2d None admin] REQUEST_METHOD: `GET` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:07:00.920966 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4311d9e-ecd9-4169-8859-3b90c2e19f2d None admin] SCRIPT_NAME: `/identity` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:07:00.921250 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4311d9e-ecd9-4169-8859-3b90c2e19f2d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:07:00.942526 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9b5d3b-04b7-40e2-bac9-187e7083eddc None admin] Validating token access rules against request {{(pid=416294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:07:00.955301 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG dbcounter [-] [416293] Writing DB stats keystone:SELECT=100 {{(pid=416293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:07:00.989428 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f4a6386-f078-4c55-8190-236fdc979912 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:07:00.990496 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4a6386-f078-4c55-8190-236fdc979912 None admin] REQUEST_METHOD: `GET` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:07:00.991387 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4a6386-f078-4c55-8190-236fdc979912 None admin] SCRIPT_NAME: `/identity` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:07:00.991885 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4a6386-f078-4c55-8190-236fdc979912 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:07:00.993206 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f4a6386-f078-4c55-8190-236fdc979912 None admin] RBAC: Adding query filter params (role.id=c67085ec338243df8f9b7d6459036e23, scope.project.id=6c4349445f224184b093d9dfd0dfc642, user.id=1a2e0811e3e347a387717df1e23d61bf) {{(pid=416294) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 09:07:00.993751 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f4a6386-f078-4c55-8190-236fdc979912 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:07:00.995598 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f4a6386-f078-4c55-8190-236fdc979912 None admin] RBAC: Authorization granted {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:07:01.008897 dv-cinder-851351-1-smb devstack@keystone.service[416294]: [pid: 416294|app: 0|req: 439/870] 10.222.0.42 () {56 vars in 1374 bytes} [Thu Jul 28 09:07:00 2022] GET /identity/v3/role_assignments?user.id=1a2e0811e3e347a387717df1e23d61bf&scope.project.id=6c4349445f224184b093d9dfd0dfc642&role.id=c67085ec338243df8f9b7d6459036e23 => generated 608 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 09:07:01.033238 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4311d9e-ecd9-4169-8859-3b90c2e19f2d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:07:01.036048 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4311d9e-ecd9-4169-8859-3b90c2e19f2d None admin] RBAC: Authorization granted {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:07:01.063706 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be33c7a-2668-4c2f-8087-f66e48b85305 None None] REQUEST_METHOD: `GET` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:07:01.064039 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be33c7a-2668-4c2f-8087-f66e48b85305 None None] SCRIPT_NAME: `/identity` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:07:01.064386 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be33c7a-2668-4c2f-8087-f66e48b85305 None None] PATH_INFO: `/` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:07:01.066178 dv-cinder-851351-1-smb devstack@keystone.service[416294]: [pid: 416294|app: 0|req: 440/871] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 09:07:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 09:07:01.077308 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8509ce6-ce34-4395-9fda-ac8df628dfe4 None None] REQUEST_METHOD: `POST` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:07:01.077961 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8509ce6-ce34-4395-9fda-ac8df628dfe4 None None] SCRIPT_NAME: `/identity` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:07:01.078573 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8509ce6-ce34-4395-9fda-ac8df628dfe4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:07:01.111695 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.auth.core [None req-f8509ce6-ce34-4395-9fda-ac8df628dfe4 None None] MFA Rules not processed for user `dbf87abab90e4fdf9e75408f4199918e`. Rule list: `[]` (Enabled: `True`). {{(pid=416294) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 09:07:01.113160 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.fernet_utils [None req-f8509ce6-ce34-4395-9fda-ac8df628dfe4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=416294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 09:07:01.126090 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG dbcounter [-] [416294] Writing DB stats keystone:SELECT=100 {{(pid=416294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:07:01.208817 dv-cinder-851351-1-smb devstack@keystone.service[416293]: [pid: 416293|app: 0|req: 432/872] 10.222.0.42 () {58 vars in 1282 bytes} [Thu Jul 28 09:07:00 2022] GET /identity/v3/auth/tokens => generated 1362 bytes in 436 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jul 28 09:07:01.211058 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4311d9e-ecd9-4169-8859-3b90c2e19f2d None admin] Authenticating user token {{(pid=416293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:07:01.232429 dv-cinder-851351-1-smb devstack@keystone.service[416294]: [pid: 416294|app: 0|req: 441/873] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 09:07:01 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 09:07:01.255591 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8509ce6-ce34-4395-9fda-ac8df628dfe4 None None] Authenticating user token {{(pid=416294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:07:01.297103 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG dbcounter [-] [416293] Writing DB stats keystone:SELECT=100 {{(pid=416293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:07:01.348095 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4311d9e-ecd9-4169-8859-3b90c2e19f2d None admin] Validating token access rules against request {{(pid=416293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:07:01.384639 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7932b6e-6b89-407d-a2e2-f860629930a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:07:01.385335 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7932b6e-6b89-407d-a2e2-f860629930a0 None admin] REQUEST_METHOD: `GET` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:07:01.385625 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7932b6e-6b89-407d-a2e2-f860629930a0 None admin] SCRIPT_NAME: `/identity` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:07:01.385956 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7932b6e-6b89-407d-a2e2-f860629930a0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:07:01.398797 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7932b6e-6b89-407d-a2e2-f860629930a0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:07:01.400284 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7932b6e-6b89-407d-a2e2-f860629930a0 None admin] RBAC: Authorization granted {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:07:01.400592 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8509ce6-ce34-4395-9fda-ac8df628dfe4 None None] Validating token access rules against request {{(pid=416294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:07:01.418106 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application [None req-d7932b6e-6b89-407d-a2e2-f860629930a0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 09:07:01.418106 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 09:07:01.418106 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 09:07:01.418106 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 09:07:01.418106 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 09:07:01.418106 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 09:07:01.418106 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 09:07:01.418106 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 09:07:01.418106 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 09:07:01.418106 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 09:07:01.418106 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 09:07:01.418106 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 09:07:01.418106 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 09:07:01.418106 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 09:07:01.418106 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 09:07:01.419348 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 09:07:01.419348 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 09:07:01.419348 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 09:07:01.419348 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 09:07:01.419348 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 09:07:01.419348 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 09:07:01.419348 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 09:07:01.419348 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 09:07:01.419348 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application with Lock( Jul 28 09:07:01.419348 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 09:07:01.419348 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self._enter() Jul 28 09:07:01.419348 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 09:07:01.419348 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 09:07:01.419348 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 09:07:01.419348 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self.creator() Jul 28 09:07:01.419348 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 09:07:01.419348 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application created_value = creator( Jul 28 09:07:01.420885 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 09:07:01.420885 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 09:07:01.420885 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 09:07:01.420885 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application Jul 28 09:07:01.420885 dv-cinder-851351-1-smb devstack@keystone.service[416293]: [pid: 416293|app: 0|req: 433/874] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 09:07:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 09:07:01.429704 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7932b6e-6b89-407d-a2e2-f860629930a0 None admin] Authenticating user token {{(pid=416293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:07:01.439074 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-935d5026-317a-49a4-a14c-bc32ca875bb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:07:01.439746 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935d5026-317a-49a4-a14c-bc32ca875bb1 None admin] REQUEST_METHOD: `GET` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:07:01.440032 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935d5026-317a-49a4-a14c-bc32ca875bb1 None admin] SCRIPT_NAME: `/identity` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:07:01.440313 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935d5026-317a-49a4-a14c-bc32ca875bb1 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:07:01.440989 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-935d5026-317a-49a4-a14c-bc32ca875bb1 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:07:01.442382 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-935d5026-317a-49a4-a14c-bc32ca875bb1 None admin] RBAC: Authorization granted {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:07:01.454812 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application [None req-935d5026-317a-49a4-a14c-bc32ca875bb1 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 28 09:07:01.454812 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 09:07:01.454812 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 28 09:07:01.454812 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 28 09:07:01.454812 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 28 09:07:01.454812 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 28 09:07:01.454812 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 28 09:07:01.454812 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 09:07:01.454812 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 28 09:07:01.454812 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application Jul 28 09:07:01.454812 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 28 09:07:01.454812 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application Jul 28 09:07:01.454812 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 09:07:01.454812 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 09:07:01.454812 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 09:07:01.454812 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 09:07:01.454812 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 09:07:01.456243 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 09:07:01.456243 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 09:07:01.456243 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 09:07:01.456243 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 09:07:01.456243 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 09:07:01.456243 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 09:07:01.456243 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 28 09:07:01.456243 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 28 09:07:01.456243 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 28 09:07:01.456243 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 28 09:07:01.456243 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 09:07:01.456243 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 09:07:01.456243 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 09:07:01.456243 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 09:07:01.456243 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 09:07:01.456243 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 09:07:01.457764 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 09:07:01.457764 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application with Lock( Jul 28 09:07:01.457764 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 09:07:01.457764 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return self._enter() Jul 28 09:07:01.457764 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 09:07:01.457764 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 09:07:01.457764 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 09:07:01.457764 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return self.creator() Jul 28 09:07:01.457764 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 09:07:01.457764 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application created_value = creator( Jul 28 09:07:01.457764 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 28 09:07:01.457764 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 09:07:01.457764 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 28 09:07:01.457764 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application Jul 28 09:07:01.461226 dv-cinder-851351-1-smb devstack@keystone.service[416294]: [pid: 416294|app: 0|req: 442/875] 10.222.0.42 () {56 vars in 1114 bytes} [Thu Jul 28 09:07:01 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 09:07:01.462332 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-935d5026-317a-49a4-a14c-bc32ca875bb1 None admin] Authenticating user token {{(pid=416294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:07:01.476423 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG dbcounter [-] [416294] Writing DB stats keystone:SELECT=100 {{(pid=416294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:07:01.601861 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7932b6e-6b89-407d-a2e2-f860629930a0 None admin] Validating token access rules against request {{(pid=416293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:07:01.627189 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG dbcounter [-] [416293] Writing DB stats keystone:SELECT=100 {{(pid=416293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:07:01.634730 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-935d5026-317a-49a4-a14c-bc32ca875bb1 None admin] Validating token access rules against request {{(pid=416294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:07:01.656283 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c0a39a-ffa9-4ef2-8279-a6f34632760a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:07:01.657078 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c0a39a-ffa9-4ef2-8279-a6f34632760a None admin] REQUEST_METHOD: `GET` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:07:01.657372 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c0a39a-ffa9-4ef2-8279-a6f34632760a None admin] SCRIPT_NAME: `/identity` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:07:01.657653 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c0a39a-ffa9-4ef2-8279-a6f34632760a None admin] PATH_INFO: `/v3/domains` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:07:01.658384 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c0a39a-ffa9-4ef2-8279-a6f34632760a None admin] RBAC: Adding query filter params (name=Default) {{(pid=416293) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 09:07:01.658695 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c0a39a-ffa9-4ef2-8279-a6f34632760a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:07:01.660237 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c0a39a-ffa9-4ef2-8279-a6f34632760a None admin] RBAC: Authorization granted {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:07:01.675345 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c50dd6-cc59-41e8-bf24-e0901301701d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:07:01.676103 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c50dd6-cc59-41e8-bf24-e0901301701d None admin] REQUEST_METHOD: `GET` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:07:01.676453 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c50dd6-cc59-41e8-bf24-e0901301701d None admin] SCRIPT_NAME: `/identity` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:07:01.676847 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c50dd6-cc59-41e8-bf24-e0901301701d None admin] PATH_INFO: `/v3/services` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:07:01.677612 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c50dd6-cc59-41e8-bf24-e0901301701d None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=416294) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 09:07:01.677984 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c50dd6-cc59-41e8-bf24-e0901301701d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:07:01.678189 dv-cinder-851351-1-smb devstack@keystone.service[416293]: [pid: 416293|app: 0|req: 434/876] 10.222.0.42 () {56 vars in 1109 bytes} [Thu Jul 28 09:07:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:07:01.679574 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c0a39a-ffa9-4ef2-8279-a6f34632760a None admin] Authenticating user token {{(pid=416293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:07:01.679693 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c50dd6-cc59-41e8-bf24-e0901301701d None admin] RBAC: Authorization granted {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:07:01.691773 dv-cinder-851351-1-smb devstack@keystone.service[416294]: [pid: 416294|app: 0|req: 443/877] 10.222.0.42 () {56 vars in 1114 bytes} [Thu Jul 28 09:07:01 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 09:07:01.692988 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c50dd6-cc59-41e8-bf24-e0901301701d None admin] Authenticating user token {{(pid=416294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:07:01.795823 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG dbcounter [-] [416294] Writing DB stats keystone:SELECT=100 {{(pid=416294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:07:01.807949 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c0a39a-ffa9-4ef2-8279-a6f34632760a None admin] Validating token access rules against request {{(pid=416293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:07:01.838574 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c50dd6-cc59-41e8-bf24-e0901301701d None admin] Validating token access rules against request {{(pid=416294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:07:01.846363 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c29362-cfc4-4d3e-bd19-aee220fab5a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:07:01.847041 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c29362-cfc4-4d3e-bd19-aee220fab5a4 None admin] REQUEST_METHOD: `GET` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:07:01.847323 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c29362-cfc4-4d3e-bd19-aee220fab5a4 None admin] SCRIPT_NAME: `/identity` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:07:01.847597 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c29362-cfc4-4d3e-bd19-aee220fab5a4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:07:01.855081 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c29362-cfc4-4d3e-bd19-aee220fab5a4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:07:01.856547 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c29362-cfc4-4d3e-bd19-aee220fab5a4 None admin] RBAC: Authorization granted {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:07:01.868701 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application [None req-e6c29362-cfc4-4d3e-bd19-aee220fab5a4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 09:07:01.868701 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 09:07:01.868701 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 09:07:01.868701 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 09:07:01.868701 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 09:07:01.868701 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 09:07:01.868701 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 09:07:01.868701 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 09:07:01.868701 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 09:07:01.868701 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 09:07:01.868701 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 09:07:01.868701 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 09:07:01.868701 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 28 09:07:01.868701 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 28 09:07:01.868701 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 28 09:07:01.869856 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 28 09:07:01.869856 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 09:07:01.869856 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 09:07:01.869856 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 09:07:01.869856 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 09:07:01.869856 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 09:07:01.869856 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 09:07:01.869856 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 09:07:01.869856 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application with Lock( Jul 28 09:07:01.869856 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 09:07:01.869856 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self._enter() Jul 28 09:07:01.869856 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 09:07:01.869856 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 09:07:01.869856 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 09:07:01.869856 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self.creator() Jul 28 09:07:01.869856 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 09:07:01.869856 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application created_value = creator( Jul 28 09:07:01.870819 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 28 09:07:01.870819 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 28 09:07:01.870819 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 28 09:07:01.870819 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 28 09:07:01.870819 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 28 09:07:01.870819 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 28 09:07:01.870819 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 09:07:01.870819 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application Jul 28 09:07:01.874830 dv-cinder-851351-1-smb devstack@keystone.service[416293]: [pid: 416293|app: 0|req: 435/878] 10.222.0.42 () {56 vars in 1111 bytes} [Thu Jul 28 09:07:01 2022] GET /identity/v3/projects/service => generated 88 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 09:07:01.876202 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c29362-cfc4-4d3e-bd19-aee220fab5a4 None admin] Authenticating user token {{(pid=416293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:07:01.882258 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb5cd2c-4652-4fea-a5d9-f5a15f0d1597 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:07:01.883208 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb5cd2c-4652-4fea-a5d9-f5a15f0d1597 None admin] REQUEST_METHOD: `GET` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:07:01.883829 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb5cd2c-4652-4fea-a5d9-f5a15f0d1597 None admin] SCRIPT_NAME: `/identity` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:07:01.884343 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb5cd2c-4652-4fea-a5d9-f5a15f0d1597 None admin] PATH_INFO: `/v3/services` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:07:01.885862 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fb5cd2c-4652-4fea-a5d9-f5a15f0d1597 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=416294) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 09:07:01.886401 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fb5cd2c-4652-4fea-a5d9-f5a15f0d1597 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:07:01.888688 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fb5cd2c-4652-4fea-a5d9-f5a15f0d1597 None admin] RBAC: Authorization granted {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:07:01.900989 dv-cinder-851351-1-smb devstack@keystone.service[416294]: [pid: 416294|app: 0|req: 444/879] 10.222.0.42 () {56 vars in 1114 bytes} [Thu Jul 28 09:07:01 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:07:01.905096 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb5cd2c-4652-4fea-a5d9-f5a15f0d1597 None admin] Authenticating user token {{(pid=416294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:07:01.919295 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG dbcounter [-] [416293] Writing DB stats keystone:SELECT=100 {{(pid=416293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:07:02.000737 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c29362-cfc4-4d3e-bd19-aee220fab5a4 None admin] Validating token access rules against request {{(pid=416293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:07:02.048051 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d678b4-b91d-4c5f-b16f-c03dea7e3e80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:07:02.049432 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d678b4-b91d-4c5f-b16f-c03dea7e3e80 None admin] REQUEST_METHOD: `GET` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:07:02.050319 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d678b4-b91d-4c5f-b16f-c03dea7e3e80 None admin] SCRIPT_NAME: `/identity` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:07:02.050797 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d678b4-b91d-4c5f-b16f-c03dea7e3e80 None admin] PATH_INFO: `/v3/projects` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:07:02.052016 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4d678b4-b91d-4c5f-b16f-c03dea7e3e80 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=416293) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 09:07:02.052587 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4d678b4-b91d-4c5f-b16f-c03dea7e3e80 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:07:02.053485 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb5cd2c-4652-4fea-a5d9-f5a15f0d1597 None admin] Validating token access rules against request {{(pid=416294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:07:02.054710 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4d678b4-b91d-4c5f-b16f-c03dea7e3e80 None admin] RBAC: Authorization granted {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:07:02.076156 dv-cinder-851351-1-smb devstack@keystone.service[416293]: [pid: 416293|app: 0|req: 436/880] 10.222.0.42 () {56 vars in 1148 bytes} [Thu Jul 28 09:07:01 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:07:02.085734 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d678b4-b91d-4c5f-b16f-c03dea7e3e80 None admin] Authenticating user token {{(pid=416293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:07:02.099083 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4bfd66f-2abe-487b-890b-0ad16cdf4caf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:07:02.100086 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4bfd66f-2abe-487b-890b-0ad16cdf4caf None admin] REQUEST_METHOD: `GET` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:07:02.100601 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4bfd66f-2abe-487b-890b-0ad16cdf4caf None admin] SCRIPT_NAME: `/identity` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:07:02.101141 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4bfd66f-2abe-487b-890b-0ad16cdf4caf None admin] PATH_INFO: `/v3/endpoints` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:07:02.102280 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4bfd66f-2abe-487b-890b-0ad16cdf4caf None admin] RBAC: Adding query filter params (interface=public, service_id=977bf138bb274daf9746a3316c27b4af, region_id=RegionOne) {{(pid=416294) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 09:07:02.102808 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4bfd66f-2abe-487b-890b-0ad16cdf4caf None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:07:02.104508 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4bfd66f-2abe-487b-890b-0ad16cdf4caf None admin] RBAC: Authorization granted {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:07:02.109885 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG dbcounter [-] [416294] Writing DB stats keystone:SELECT=100 {{(pid=416294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:07:02.115492 dv-cinder-851351-1-smb devstack@keystone.service[416294]: [pid: 416294|app: 0|req: 445/881] 10.222.0.42 () {56 vars in 1251 bytes} [Thu Jul 28 09:07:01 2022] GET /identity/v3/endpoints?service_id=977bf138bb274daf9746a3316c27b4af&interface=public®ion_id=RegionOne => generated 194 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:07:02.121622 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4bfd66f-2abe-487b-890b-0ad16cdf4caf None admin] Authenticating user token {{(pid=416294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:07:02.194451 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG dbcounter [-] [416293] Writing DB stats keystone:SELECT=100 {{(pid=416293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:07:02.201360 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d678b4-b91d-4c5f-b16f-c03dea7e3e80 None admin] Validating token access rules against request {{(pid=416293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:07:02.249592 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e4d055-db3c-4468-abcb-c2aa13d9b6c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:07:02.251012 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e4d055-db3c-4468-abcb-c2aa13d9b6c8 None admin] REQUEST_METHOD: `GET` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:07:02.251748 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e4d055-db3c-4468-abcb-c2aa13d9b6c8 None admin] SCRIPT_NAME: `/identity` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:07:02.252231 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e4d055-db3c-4468-abcb-c2aa13d9b6c8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:07:02.253980 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e4d055-db3c-4468-abcb-c2aa13d9b6c8 None admin] RBAC: Adding query filter params (role.id=13417fbdbc5145a69bc01ff0f931fd96, scope.project.id=6c4349445f224184b093d9dfd0dfc642, user.id=f5b664bdc0d04af8ac60a11e9a136c91) {{(pid=416293) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 09:07:02.254522 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e4d055-db3c-4468-abcb-c2aa13d9b6c8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:07:02.256451 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e4d055-db3c-4468-abcb-c2aa13d9b6c8 None admin] RBAC: Authorization granted {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:07:02.260248 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4bfd66f-2abe-487b-890b-0ad16cdf4caf None admin] Validating token access rules against request {{(pid=416294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:07:02.273358 dv-cinder-851351-1-smb devstack@keystone.service[416293]: [pid: 416293|app: 0|req: 437/882] 10.222.0.42 () {56 vars in 1374 bytes} [Thu Jul 28 09:07:02 2022] GET /identity/v3/role_assignments?user.id=f5b664bdc0d04af8ac60a11e9a136c91&scope.project.id=6c4349445f224184b093d9dfd0dfc642&role.id=13417fbdbc5145a69bc01ff0f931fd96 => generated 608 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:07:02.306676 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d9cc8f-c63e-463c-8fa9-bb5e81a7dba6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:07:02.307270 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d9cc8f-c63e-463c-8fa9-bb5e81a7dba6 None admin] REQUEST_METHOD: `GET` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:07:02.307556 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d9cc8f-c63e-463c-8fa9-bb5e81a7dba6 None admin] SCRIPT_NAME: `/identity` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:07:02.307835 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d9cc8f-c63e-463c-8fa9-bb5e81a7dba6 None admin] PATH_INFO: `/v3/services` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:07:02.308556 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84d9cc8f-c63e-463c-8fa9-bb5e81a7dba6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:07:02.310129 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84d9cc8f-c63e-463c-8fa9-bb5e81a7dba6 None admin] RBAC: Authorization granted {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:07:02.317723 dv-cinder-851351-1-smb devstack@keystone.service[416294]: [pid: 416294|app: 0|req: 446/883] 10.222.0.42 () {56 vars in 1087 bytes} [Thu Jul 28 09:07:02 2022] GET /identity/v3/services => generated 1268 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 09:07:02.634037 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcaea766-7492-4be1-9d40-1baaf2363c19 None None] REQUEST_METHOD: `GET` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:07:02.634593 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcaea766-7492-4be1-9d40-1baaf2363c19 None None] SCRIPT_NAME: `/identity` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:07:02.634593 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcaea766-7492-4be1-9d40-1baaf2363c19 None None] PATH_INFO: `/` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:07:02.636274 dv-cinder-851351-1-smb devstack@keystone.service[416293]: [pid: 416293|app: 0|req: 438/884] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 09:07:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 09:07:02.642014 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5edf91ac-4c10-4c64-a0ec-1aff8d3aabb6 None None] REQUEST_METHOD: `POST` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:07:02.642545 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5edf91ac-4c10-4c64-a0ec-1aff8d3aabb6 None None] SCRIPT_NAME: `/identity` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:07:02.642545 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5edf91ac-4c10-4c64-a0ec-1aff8d3aabb6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:07:02.661898 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.auth.core [None req-5edf91ac-4c10-4c64-a0ec-1aff8d3aabb6 None None] MFA Rules not processed for user `dbf87abab90e4fdf9e75408f4199918e`. Rule list: `[]` (Enabled: `True`). {{(pid=416294) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 09:07:02.663120 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.fernet_utils [None req-5edf91ac-4c10-4c64-a0ec-1aff8d3aabb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=416294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 09:07:02.728674 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG dbcounter [-] [416294] Writing DB stats keystone:SELECT=100 {{(pid=416294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:07:02.745032 dv-cinder-851351-1-smb devstack@keystone.service[416294]: [pid: 416294|app: 0|req: 447/885] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 09:07:02 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 09:07:02.762520 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcaea766-7492-4be1-9d40-1baaf2363c19 None None] Authenticating user token {{(pid=416293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:07:02.888381 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcaea766-7492-4be1-9d40-1baaf2363c19 None None] Validating token access rules against request {{(pid=416293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:07:02.934201 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00d409c-bd76-4df1-a43a-5589de6808e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:07:02.934873 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00d409c-bd76-4df1-a43a-5589de6808e1 None admin] REQUEST_METHOD: `GET` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:07:02.935162 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00d409c-bd76-4df1-a43a-5589de6808e1 None admin] SCRIPT_NAME: `/identity` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:07:02.935444 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00d409c-bd76-4df1-a43a-5589de6808e1 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:07:02.936104 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d00d409c-bd76-4df1-a43a-5589de6808e1 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:07:02.937661 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d00d409c-bd76-4df1-a43a-5589de6808e1 None admin] RBAC: Authorization granted {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:07:02.950060 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application [None req-d00d409c-bd76-4df1-a43a-5589de6808e1 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 28 09:07:02.950060 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 09:07:02.950060 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 28 09:07:02.950060 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 28 09:07:02.950060 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 28 09:07:02.950060 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 28 09:07:02.950060 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 28 09:07:02.950060 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 09:07:02.950060 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 28 09:07:02.950060 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application Jul 28 09:07:02.950060 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 28 09:07:02.950060 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application Jul 28 09:07:02.950060 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 09:07:02.950060 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 09:07:02.950060 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 09:07:02.950060 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 09:07:02.951195 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 09:07:02.951195 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 09:07:02.951195 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 09:07:02.951195 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 09:07:02.951195 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 09:07:02.951195 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 09:07:02.951195 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 09:07:02.951195 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 28 09:07:02.951195 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 28 09:07:02.951195 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 28 09:07:02.951195 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 28 09:07:02.951195 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 09:07:02.951195 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 09:07:02.951195 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 09:07:02.951195 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 09:07:02.951195 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 09:07:02.952356 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 09:07:02.952356 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 09:07:02.952356 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application with Lock( Jul 28 09:07:02.952356 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 09:07:02.952356 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self._enter() Jul 28 09:07:02.952356 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 09:07:02.952356 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 09:07:02.952356 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 09:07:02.952356 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self.creator() Jul 28 09:07:02.952356 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 09:07:02.952356 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application created_value = creator( Jul 28 09:07:02.952356 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 28 09:07:02.952356 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 09:07:02.952356 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 28 09:07:02.952356 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application Jul 28 09:07:02.952356 dv-cinder-851351-1-smb devstack@keystone.service[416293]: [pid: 416293|app: 0|req: 439/886] 10.222.0.42 () {56 vars in 1132 bytes} [Thu Jul 28 09:07:02 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 09:07:02.960271 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5edf91ac-4c10-4c64-a0ec-1aff8d3aabb6 None None] Authenticating user token {{(pid=416294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:07:03.079911 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5edf91ac-4c10-4c64-a0ec-1aff8d3aabb6 None None] Validating token access rules against request {{(pid=416294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:07:03.117010 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5008609d-a9bb-416c-a008-797792a5db57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:07:03.118144 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5008609d-a9bb-416c-a008-797792a5db57 None admin] REQUEST_METHOD: `GET` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:07:03.118644 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5008609d-a9bb-416c-a008-797792a5db57 None admin] SCRIPT_NAME: `/identity` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:07:03.119134 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5008609d-a9bb-416c-a008-797792a5db57 None admin] PATH_INFO: `/v3/services` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:07:03.120034 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5008609d-a9bb-416c-a008-797792a5db57 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=416294) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 09:07:03.120551 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5008609d-a9bb-416c-a008-797792a5db57 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:07:03.122176 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5008609d-a9bb-416c-a008-797792a5db57 None admin] RBAC: Authorization granted {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:07:03.132291 dv-cinder-851351-1-smb devstack@keystone.service[416294]: [pid: 416294|app: 0|req: 448/887] 10.222.0.42 () {56 vars in 1126 bytes} [Thu Jul 28 09:07:02 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:07:03.134037 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00d409c-bd76-4df1-a43a-5589de6808e1 None admin] Authenticating user token {{(pid=416293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:07:03.166019 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG dbcounter [-] [416293] Writing DB stats keystone:SELECT=100 {{(pid=416293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:07:03.267569 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00d409c-bd76-4df1-a43a-5589de6808e1 None admin] Validating token access rules against request {{(pid=416293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:07:03.303379 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c4ff2d-deb8-401b-a5c9-b0eab2a2e9b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:07:03.304084 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c4ff2d-deb8-401b-a5c9-b0eab2a2e9b9 None admin] REQUEST_METHOD: `GET` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:07:03.304377 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c4ff2d-deb8-401b-a5c9-b0eab2a2e9b9 None admin] SCRIPT_NAME: `/identity` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:07:03.304655 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c4ff2d-deb8-401b-a5c9-b0eab2a2e9b9 None admin] PATH_INFO: `/v3/services` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:07:03.305388 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02c4ff2d-deb8-401b-a5c9-b0eab2a2e9b9 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=416293) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 09:07:03.305696 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02c4ff2d-deb8-401b-a5c9-b0eab2a2e9b9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:07:03.307105 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02c4ff2d-deb8-401b-a5c9-b0eab2a2e9b9 None admin] RBAC: Authorization granted {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:07:03.313111 dv-cinder-851351-1-smb devstack@keystone.service[416293]: [pid: 416293|app: 0|req: 440/888] 10.222.0.42 () {56 vars in 1126 bytes} [Thu Jul 28 09:07:03 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:07:03.319218 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5008609d-a9bb-416c-a008-797792a5db57 None admin] Authenticating user token {{(pid=416294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:07:03.388090 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG dbcounter [-] [416294] Writing DB stats keystone:SELECT=100 {{(pid=416294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:07:03.393011 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734ee839-3c46-4af1-bc6d-ee472c9e2d3e None None] REQUEST_METHOD: `GET` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:07:03.393297 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734ee839-3c46-4af1-bc6d-ee472c9e2d3e None None] SCRIPT_NAME: `/identity` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:07:03.393850 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734ee839-3c46-4af1-bc6d-ee472c9e2d3e None None] PATH_INFO: `/` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:07:03.395668 dv-cinder-851351-1-smb devstack@keystone.service[416293]: [pid: 416293|app: 0|req: 441/889] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 09:07:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 09:07:03.402184 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec63889-7425-42a7-9cbd-dcae1ff911b7 None None] REQUEST_METHOD: `POST` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:07:03.402627 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec63889-7425-42a7-9cbd-dcae1ff911b7 None None] SCRIPT_NAME: `/identity` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:07:03.403003 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec63889-7425-42a7-9cbd-dcae1ff911b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:07:03.427469 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.auth.core [None req-cec63889-7425-42a7-9cbd-dcae1ff911b7 None None] MFA Rules not processed for user `dbf87abab90e4fdf9e75408f4199918e`. Rule list: `[]` (Enabled: `True`). {{(pid=416293) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 09:07:03.429047 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.fernet_utils [None req-cec63889-7425-42a7-9cbd-dcae1ff911b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=416293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 09:07:03.439924 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5008609d-a9bb-416c-a008-797792a5db57 None admin] Validating token access rules against request {{(pid=416294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:07:03.482319 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25cddb6b-194b-4a6c-b6a8-4f0698c6a354 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:07:03.483265 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25cddb6b-194b-4a6c-b6a8-4f0698c6a354 None admin] REQUEST_METHOD: `GET` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:07:03.483720 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25cddb6b-194b-4a6c-b6a8-4f0698c6a354 None admin] SCRIPT_NAME: `/identity` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:07:03.484204 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25cddb6b-194b-4a6c-b6a8-4f0698c6a354 None admin] PATH_INFO: `/v3/endpoints` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:07:03.485294 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25cddb6b-194b-4a6c-b6a8-4f0698c6a354 None admin] RBAC: Adding query filter params (interface=public, service_id=587b3909f6a24880ada2b3f37adabb83, region_id=RegionOne) {{(pid=416294) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 09:07:03.485774 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25cddb6b-194b-4a6c-b6a8-4f0698c6a354 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:07:03.487364 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25cddb6b-194b-4a6c-b6a8-4f0698c6a354 None admin] RBAC: Authorization granted {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:07:03.494269 dv-cinder-851351-1-smb devstack@keystone.service[416294]: [pid: 416294|app: 0|req: 449/890] 10.222.0.42 () {56 vars in 1251 bytes} [Thu Jul 28 09:07:03 2022] GET /identity/v3/endpoints?service_id=587b3909f6a24880ada2b3f37adabb83&interface=public®ion_id=RegionOne => generated 194 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:07:03.501262 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25cddb6b-194b-4a6c-b6a8-4f0698c6a354 None admin] Authenticating user token {{(pid=416294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:07:03.542448 dv-cinder-851351-1-smb devstack@keystone.service[416293]: [pid: 416293|app: 0|req: 442/891] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 09:07:03 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 28 09:07:03.565854 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec63889-7425-42a7-9cbd-dcae1ff911b7 None None] Authenticating user token {{(pid=416293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:07:03.600293 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG dbcounter [-] [416293] Writing DB stats keystone:SELECT=100 {{(pid=416293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:07:03.624204 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25cddb6b-194b-4a6c-b6a8-4f0698c6a354 None admin] Validating token access rules against request {{(pid=416294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:07:03.650778 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG dbcounter [-] [416294] Writing DB stats keystone:SELECT=100 {{(pid=416294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:07:03.665220 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c039efc-ccac-4b87-906f-fb4b4fed542b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:07:03.666288 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c039efc-ccac-4b87-906f-fb4b4fed542b None admin] REQUEST_METHOD: `GET` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:07:03.666791 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c039efc-ccac-4b87-906f-fb4b4fed542b None admin] SCRIPT_NAME: `/identity` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:07:03.667241 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c039efc-ccac-4b87-906f-fb4b4fed542b None admin] PATH_INFO: `/v3/services` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:07:03.668121 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c039efc-ccac-4b87-906f-fb4b4fed542b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:07:03.669825 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c039efc-ccac-4b87-906f-fb4b4fed542b None admin] RBAC: Authorization granted {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:07:03.682653 dv-cinder-851351-1-smb devstack@keystone.service[416294]: [pid: 416294|app: 0|req: 450/892] 10.222.0.42 () {56 vars in 1087 bytes} [Thu Jul 28 09:07:03 2022] GET /identity/v3/services => generated 1268 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 09:07:03.697203 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec63889-7425-42a7-9cbd-dcae1ff911b7 None None] Validating token access rules against request {{(pid=416293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:07:03.744010 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b15ac3-a1e5-4190-be83-19eefcf11db4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:07:03.744786 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b15ac3-a1e5-4190-be83-19eefcf11db4 None admin] REQUEST_METHOD: `GET` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:07:03.745208 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b15ac3-a1e5-4190-be83-19eefcf11db4 None admin] SCRIPT_NAME: `/identity` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:07:03.745522 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b15ac3-a1e5-4190-be83-19eefcf11db4 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:07:03.746219 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b15ac3-a1e5-4190-be83-19eefcf11db4 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:07:03.747763 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b15ac3-a1e5-4190-be83-19eefcf11db4 None admin] RBAC: Authorization granted {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:07:03.766575 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application [None req-38b15ac3-a1e5-4190-be83-19eefcf11db4 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 28 09:07:03.766575 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 09:07:03.766575 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 28 09:07:03.766575 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 28 09:07:03.766575 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 28 09:07:03.766575 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 28 09:07:03.766575 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 28 09:07:03.766575 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 09:07:03.766575 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 28 09:07:03.766575 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application Jul 28 09:07:03.766575 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 28 09:07:03.766575 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application Jul 28 09:07:03.766575 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 09:07:03.766575 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 09:07:03.766575 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 09:07:03.766575 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 09:07:03.766575 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 09:07:03.767813 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 09:07:03.767813 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 09:07:03.767813 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 09:07:03.767813 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 09:07:03.767813 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 09:07:03.767813 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 09:07:03.767813 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 28 09:07:03.767813 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 28 09:07:03.767813 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 28 09:07:03.767813 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 28 09:07:03.767813 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 09:07:03.767813 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 09:07:03.767813 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 09:07:03.767813 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 09:07:03.767813 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 09:07:03.767813 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 09:07:03.768758 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 09:07:03.768758 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application with Lock( Jul 28 09:07:03.768758 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 09:07:03.768758 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self._enter() Jul 28 09:07:03.768758 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 09:07:03.768758 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 09:07:03.768758 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 09:07:03.768758 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self.creator() Jul 28 09:07:03.768758 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 09:07:03.768758 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application created_value = creator( Jul 28 09:07:03.768758 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 28 09:07:03.768758 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 09:07:03.768758 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 28 09:07:03.768758 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application Jul 28 09:07:03.769586 dv-cinder-851351-1-smb devstack@keystone.service[416293]: [pid: 416293|app: 0|req: 443/893] 10.222.0.42 () {56 vars in 1126 bytes} [Thu Jul 28 09:07:03 2022] GET /identity/v3/services/object-store => generated 93 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 09:07:03.775274 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c039efc-ccac-4b87-906f-fb4b4fed542b None admin] Authenticating user token {{(pid=416294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:07:03.891697 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c039efc-ccac-4b87-906f-fb4b4fed542b None admin] Validating token access rules against request {{(pid=416294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:07:03.938835 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf73d7d-c613-44b3-858a-8d5752ee05b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:07:03.939409 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf73d7d-c613-44b3-858a-8d5752ee05b2 None admin] REQUEST_METHOD: `GET` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:07:03.939695 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf73d7d-c613-44b3-858a-8d5752ee05b2 None admin] SCRIPT_NAME: `/identity` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:07:03.939973 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf73d7d-c613-44b3-858a-8d5752ee05b2 None admin] PATH_INFO: `/v3/services` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:07:03.940718 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbf73d7d-c613-44b3-858a-8d5752ee05b2 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=416294) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 09:07:03.941072 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbf73d7d-c613-44b3-858a-8d5752ee05b2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:07:03.942545 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbf73d7d-c613-44b3-858a-8d5752ee05b2 None admin] RBAC: Authorization granted {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:07:03.948831 dv-cinder-851351-1-smb devstack@keystone.service[416294]: [pid: 416294|app: 0|req: 451/894] 10.222.0.42 () {56 vars in 1122 bytes} [Thu Jul 28 09:07:03 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:07:03.958239 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b15ac3-a1e5-4190-be83-19eefcf11db4 None admin] Authenticating user token {{(pid=416293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:07:04.079940 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG dbcounter [-] [416293] Writing DB stats keystone:SELECT=100 {{(pid=416293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:07:04.105227 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b15ac3-a1e5-4190-be83-19eefcf11db4 None admin] Validating token access rules against request {{(pid=416293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:07:04.143659 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce512b9-ab92-4f1c-a0bd-58ec2c60427e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:07:04.144774 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce512b9-ab92-4f1c-a0bd-58ec2c60427e None admin] REQUEST_METHOD: `GET` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:07:04.145287 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce512b9-ab92-4f1c-a0bd-58ec2c60427e None admin] SCRIPT_NAME: `/identity` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:07:04.145779 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce512b9-ab92-4f1c-a0bd-58ec2c60427e None admin] PATH_INFO: `/v3/services` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:07:04.146716 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ce512b9-ab92-4f1c-a0bd-58ec2c60427e None admin] RBAC: Adding query filter params (type=object-store) {{(pid=416293) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 09:07:04.147303 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ce512b9-ab92-4f1c-a0bd-58ec2c60427e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:07:04.148947 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ce512b9-ab92-4f1c-a0bd-58ec2c60427e None admin] RBAC: Authorization granted {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:07:04.155043 dv-cinder-851351-1-smb devstack@keystone.service[416293]: [pid: 416293|app: 0|req: 444/895] 10.222.0.42 () {56 vars in 1122 bytes} [Thu Jul 28 09:07:03 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:07:04.465636 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241e9358-f161-48af-8984-a877241b9f61 None None] REQUEST_METHOD: `GET` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:07:04.466059 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241e9358-f161-48af-8984-a877241b9f61 None None] SCRIPT_NAME: `/identity` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:07:04.466245 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241e9358-f161-48af-8984-a877241b9f61 None None] PATH_INFO: `/` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:07:04.467870 dv-cinder-851351-1-smb devstack@keystone.service[416294]: [pid: 416294|app: 0|req: 452/896] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 09:07:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 09:07:04.473797 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ac812d-303e-4640-be45-0bb5fb4dffd5 None None] REQUEST_METHOD: `POST` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:07:04.474093 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ac812d-303e-4640-be45-0bb5fb4dffd5 None None] SCRIPT_NAME: `/identity` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:07:04.474364 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ac812d-303e-4640-be45-0bb5fb4dffd5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:07:04.494489 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.auth.core [None req-e6ac812d-303e-4640-be45-0bb5fb4dffd5 None None] MFA Rules not processed for user `dbf87abab90e4fdf9e75408f4199918e`. Rule list: `[]` (Enabled: `True`). {{(pid=416293) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 09:07:04.495700 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.fernet_utils [None req-e6ac812d-303e-4640-be45-0bb5fb4dffd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=416293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 09:07:04.542353 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a349b7d-2e57-4a09-a829-30e40e3fc95d None None] REQUEST_METHOD: `GET` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:07:04.542672 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a349b7d-2e57-4a09-a829-30e40e3fc95d None None] SCRIPT_NAME: `/identity` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:07:04.542935 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a349b7d-2e57-4a09-a829-30e40e3fc95d None None] PATH_INFO: `/` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:07:04.544590 dv-cinder-851351-1-smb devstack@keystone.service[416294]: [pid: 416294|app: 0|req: 453/897] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 09:07:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 28 09:07:04.550039 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8b9ebb-9e1f-4c8d-b807-f6d59297fe76 None None] REQUEST_METHOD: `POST` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:07:04.550330 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8b9ebb-9e1f-4c8d-b807-f6d59297fe76 None None] SCRIPT_NAME: `/identity` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:07:04.550615 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8b9ebb-9e1f-4c8d-b807-f6d59297fe76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:07:04.570158 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.auth.core [None req-9a8b9ebb-9e1f-4c8d-b807-f6d59297fe76 None None] MFA Rules not processed for user `dbf87abab90e4fdf9e75408f4199918e`. Rule list: `[]` (Enabled: `True`). {{(pid=416294) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 09:07:04.571526 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.fernet_utils [None req-9a8b9ebb-9e1f-4c8d-b807-f6d59297fe76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=416294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 09:07:04.576778 dv-cinder-851351-1-smb devstack@keystone.service[416293]: [pid: 416293|app: 0|req: 445/898] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 09:07:04 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 09:07:04.596360 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ac812d-303e-4640-be45-0bb5fb4dffd5 None None] Authenticating user token {{(pid=416293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:07:04.630303 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG dbcounter [-] [416294] Writing DB stats keystone:SELECT=100 {{(pid=416294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:07:04.659572 dv-cinder-851351-1-smb devstack@keystone.service[416294]: [pid: 416294|app: 0|req: 454/899] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 09:07:04 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 09:07:04.683755 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a8b9ebb-9e1f-4c8d-b807-f6d59297fe76 None None] Authenticating user token {{(pid=416294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:07:04.689338 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG dbcounter [-] [416293] Writing DB stats keystone:SELECT=100 {{(pid=416293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:07:04.720773 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ac812d-303e-4640-be45-0bb5fb4dffd5 None None] Validating token access rules against request {{(pid=416293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:07:04.765194 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f95e137-2ce2-4fff-b633-6e20758dd964 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:07:04.766253 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f95e137-2ce2-4fff-b633-6e20758dd964 None admin] REQUEST_METHOD: `GET` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:07:04.767230 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f95e137-2ce2-4fff-b633-6e20758dd964 None admin] SCRIPT_NAME: `/identity` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:07:04.767729 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f95e137-2ce2-4fff-b633-6e20758dd964 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:07:04.768582 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f95e137-2ce2-4fff-b633-6e20758dd964 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:07:04.770873 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f95e137-2ce2-4fff-b633-6e20758dd964 None admin] RBAC: Authorization granted {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:07:04.782757 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application [None req-7f95e137-2ce2-4fff-b633-6e20758dd964 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 28 09:07:04.782757 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 09:07:04.782757 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 28 09:07:04.782757 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 28 09:07:04.782757 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 28 09:07:04.782757 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 28 09:07:04.782757 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 28 09:07:04.782757 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 09:07:04.782757 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 28 09:07:04.782757 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application Jul 28 09:07:04.782757 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 28 09:07:04.782757 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application Jul 28 09:07:04.782757 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 09:07:04.782757 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 09:07:04.782757 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 09:07:04.782757 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 09:07:04.782757 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 09:07:04.783925 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 09:07:04.783925 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 09:07:04.783925 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 09:07:04.783925 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 09:07:04.783925 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 09:07:04.783925 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 09:07:04.783925 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 28 09:07:04.783925 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 28 09:07:04.783925 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 28 09:07:04.783925 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 28 09:07:04.783925 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 09:07:04.783925 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 09:07:04.783925 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 09:07:04.783925 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 09:07:04.783925 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 09:07:04.783925 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 09:07:04.784888 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 09:07:04.784888 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application with Lock( Jul 28 09:07:04.784888 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 09:07:04.784888 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self._enter() Jul 28 09:07:04.784888 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 09:07:04.784888 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 09:07:04.784888 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 09:07:04.784888 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self.creator() Jul 28 09:07:04.784888 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 09:07:04.784888 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application created_value = creator( Jul 28 09:07:04.784888 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 28 09:07:04.784888 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 09:07:04.784888 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 28 09:07:04.784888 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application Jul 28 09:07:04.786368 dv-cinder-851351-1-smb devstack@keystone.service[416293]: [pid: 416293|app: 0|req: 446/900] 10.222.0.42 () {56 vars in 1114 bytes} [Thu Jul 28 09:07:04 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 09:07:04.795234 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f95e137-2ce2-4fff-b633-6e20758dd964 None admin] Authenticating user token {{(pid=416293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:07:04.800854 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a8b9ebb-9e1f-4c8d-b807-f6d59297fe76 None None] Validating token access rules against request {{(pid=416294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:07:04.837982 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f857c236-b2a3-467a-ba4a-7a8ef219bbea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:07:04.838695 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f857c236-b2a3-467a-ba4a-7a8ef219bbea None admin] REQUEST_METHOD: `GET` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:07:04.838979 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f857c236-b2a3-467a-ba4a-7a8ef219bbea None admin] SCRIPT_NAME: `/identity` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:07:04.839316 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f857c236-b2a3-467a-ba4a-7a8ef219bbea None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:07:04.853243 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f857c236-b2a3-467a-ba4a-7a8ef219bbea None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 09:07:04.858327 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application [None req-f857c236-b2a3-467a-ba4a-7a8ef219bbea None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 28 09:07:04.858327 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 09:07:04.858327 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 09:07:04.858327 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 09:07:04.858327 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 09:07:04.858327 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 09:07:04.858327 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 09:07:04.858327 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 09:07:04.858327 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 09:07:04.858327 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 09:07:04.858327 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 09:07:04.858327 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 09:07:04.858327 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 09:07:04.858327 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 09:07:04.858327 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 09:07:04.858327 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 09:07:04.859419 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 09:07:04.859419 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 09:07:04.859419 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 09:07:04.859419 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 09:07:04.859419 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 09:07:04.859419 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 09:07:04.859419 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 09:07:04.859419 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 09:07:04.859419 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 09:07:04.859419 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 09:07:04.859419 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 09:07:04.859419 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application with Lock( Jul 28 09:07:04.859419 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 09:07:04.859419 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return self._enter() Jul 28 09:07:04.859419 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 09:07:04.859419 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 09:07:04.860458 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 09:07:04.860458 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return self.creator() Jul 28 09:07:04.860458 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 09:07:04.860458 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application created_value = creator( Jul 28 09:07:04.860458 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 09:07:04.860458 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 09:07:04.860458 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 09:07:04.860458 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 09:07:04.860458 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 09:07:04.860458 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 09:07:04.860458 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 28 09:07:04.860458 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application Jul 28 09:07:04.864809 dv-cinder-851351-1-smb devstack@keystone.service[416294]: [pid: 416294|app: 0|req: 455/901] 10.222.0.42 () {56 vars in 1120 bytes} [Thu Jul 28 09:07:04 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 09:07:04.866188 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f857c236-b2a3-467a-ba4a-7a8ef219bbea None admin] Authenticating user token {{(pid=416294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:07:04.914446 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG dbcounter [-] [416294] Writing DB stats keystone:SELECT=100 {{(pid=416294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:07:04.950357 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f95e137-2ce2-4fff-b633-6e20758dd964 None admin] Validating token access rules against request {{(pid=416293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:07:04.986351 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f857c236-b2a3-467a-ba4a-7a8ef219bbea None admin] Validating token access rules against request {{(pid=416294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:07:04.998002 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2de078-4bab-447a-bc91-9b71da9b0c82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:07:04.999270 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2de078-4bab-447a-bc91-9b71da9b0c82 None admin] REQUEST_METHOD: `GET` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:07:04.999738 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2de078-4bab-447a-bc91-9b71da9b0c82 None admin] SCRIPT_NAME: `/identity` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:07:05.000435 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2de078-4bab-447a-bc91-9b71da9b0c82 None admin] PATH_INFO: `/v3/services` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:07:05.001382 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e2de078-4bab-447a-bc91-9b71da9b0c82 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=416293) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 09:07:05.002156 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e2de078-4bab-447a-bc91-9b71da9b0c82 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:07:05.004491 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e2de078-4bab-447a-bc91-9b71da9b0c82 None admin] RBAC: Authorization granted {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:07:05.011728 dv-cinder-851351-1-smb devstack@keystone.service[416293]: [pid: 416293|app: 0|req: 447/902] 10.222.0.42 () {56 vars in 1114 bytes} [Thu Jul 28 09:07:04 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:07:05.018608 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2de078-4bab-447a-bc91-9b71da9b0c82 None admin] Authenticating user token {{(pid=416293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:07:05.029338 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32afc6fb-66ad-47c8-9b97-042377624044 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:07:05.029971 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32afc6fb-66ad-47c8-9b97-042377624044 None admin] REQUEST_METHOD: `GET` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:07:05.030250 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32afc6fb-66ad-47c8-9b97-042377624044 None admin] SCRIPT_NAME: `/identity` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:07:05.030523 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32afc6fb-66ad-47c8-9b97-042377624044 None admin] PATH_INFO: `/v3/roles` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:07:05.031248 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32afc6fb-66ad-47c8-9b97-042377624044 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=416294) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 09:07:05.031551 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32afc6fb-66ad-47c8-9b97-042377624044 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:07:05.033009 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32afc6fb-66ad-47c8-9b97-042377624044 None admin] RBAC: Authorization granted {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:07:05.044866 dv-cinder-851351-1-smb devstack@keystone.service[416294]: [pid: 416294|app: 0|req: 456/903] 10.222.0.42 () {56 vars in 1115 bytes} [Thu Jul 28 09:07:04 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:07:05.045031 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG dbcounter [-] [416293] Writing DB stats keystone:SELECT=100 {{(pid=416293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:07:05.048276 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32afc6fb-66ad-47c8-9b97-042377624044 None admin] Authenticating user token {{(pid=416294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:07:05.136455 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2de078-4bab-447a-bc91-9b71da9b0c82 None admin] Validating token access rules against request {{(pid=416293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:07:05.172081 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-454ebd6b-0010-48ea-97bc-a26e03d86ef0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:07:05.172847 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454ebd6b-0010-48ea-97bc-a26e03d86ef0 None admin] REQUEST_METHOD: `GET` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:07:05.173141 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454ebd6b-0010-48ea-97bc-a26e03d86ef0 None admin] SCRIPT_NAME: `/identity` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:07:05.173413 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454ebd6b-0010-48ea-97bc-a26e03d86ef0 None admin] PATH_INFO: `/v3/services` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:07:05.174092 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-454ebd6b-0010-48ea-97bc-a26e03d86ef0 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=416293) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 09:07:05.174407 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-454ebd6b-0010-48ea-97bc-a26e03d86ef0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:07:05.175809 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-454ebd6b-0010-48ea-97bc-a26e03d86ef0 None admin] RBAC: Authorization granted {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:07:05.180472 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32afc6fb-66ad-47c8-9b97-042377624044 None admin] Validating token access rules against request {{(pid=416294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:07:05.185695 dv-cinder-851351-1-smb devstack@keystone.service[416293]: [pid: 416293|app: 0|req: 448/904] 10.222.0.42 () {56 vars in 1114 bytes} [Thu Jul 28 09:07:05 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:07:05.187879 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG dbcounter [-] [416294] Writing DB stats keystone:SELECT=100 {{(pid=416294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:07:05.189320 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-454ebd6b-0010-48ea-97bc-a26e03d86ef0 None admin] Authenticating user token {{(pid=416293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:07:05.225946 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7238556-d576-412d-ba5a-7b5fe724bfe5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:07:05.226700 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7238556-d576-412d-ba5a-7b5fe724bfe5 None admin] REQUEST_METHOD: `GET` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:07:05.227104 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7238556-d576-412d-ba5a-7b5fe724bfe5 None admin] SCRIPT_NAME: `/identity` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:07:05.227446 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7238556-d576-412d-ba5a-7b5fe724bfe5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:07:05.239221 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7238556-d576-412d-ba5a-7b5fe724bfe5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:07:05.240917 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7238556-d576-412d-ba5a-7b5fe724bfe5 None admin] RBAC: Authorization granted {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:07:05.257000 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application [None req-a7238556-d576-412d-ba5a-7b5fe724bfe5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 09:07:05.257000 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 09:07:05.257000 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 09:07:05.257000 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 09:07:05.257000 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 09:07:05.257000 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 09:07:05.257000 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 09:07:05.257000 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 09:07:05.257000 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 09:07:05.257000 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 09:07:05.257000 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 09:07:05.257000 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 09:07:05.257000 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 09:07:05.257000 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 09:07:05.257000 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 09:07:05.258075 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 09:07:05.258075 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 09:07:05.258075 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 09:07:05.258075 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 09:07:05.258075 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 09:07:05.258075 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 09:07:05.258075 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 09:07:05.258075 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 09:07:05.258075 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application with Lock( Jul 28 09:07:05.258075 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 09:07:05.258075 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return self._enter() Jul 28 09:07:05.258075 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 09:07:05.258075 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 09:07:05.258075 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 09:07:05.258075 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return self.creator() Jul 28 09:07:05.258075 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 09:07:05.258075 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application created_value = creator( Jul 28 09:07:05.259055 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 09:07:05.259055 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 09:07:05.259055 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 09:07:05.259055 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application Jul 28 09:07:05.263333 dv-cinder-851351-1-smb devstack@keystone.service[416294]: [pid: 416294|app: 0|req: 457/905] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 09:07:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 09:07:05.264593 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7238556-d576-412d-ba5a-7b5fe724bfe5 None admin] Authenticating user token {{(pid=416294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:07:05.282608 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG dbcounter [-] [416293] Writing DB stats keystone:SELECT=100 {{(pid=416293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:07:05.332562 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-454ebd6b-0010-48ea-97bc-a26e03d86ef0 None admin] Validating token access rules against request {{(pid=416293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:07:05.380376 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f349dbb4-93f2-46bb-9b5b-e225cd85753d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:07:05.380993 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7238556-d576-412d-ba5a-7b5fe724bfe5 None admin] Validating token access rules against request {{(pid=416294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:07:05.381606 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f349dbb4-93f2-46bb-9b5b-e225cd85753d None admin] REQUEST_METHOD: `POST` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:07:05.382087 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f349dbb4-93f2-46bb-9b5b-e225cd85753d None admin] SCRIPT_NAME: `/identity` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:07:05.382783 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f349dbb4-93f2-46bb-9b5b-e225cd85753d None admin] PATH_INFO: `/v3/endpoints` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:07:05.384620 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f349dbb4-93f2-46bb-9b5b-e225cd85753d None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:07:05.386245 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f349dbb4-93f2-46bb-9b5b-e225cd85753d None admin] RBAC: Authorization granted {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:07:05.424802 dv-cinder-851351-1-smb devstack@keystone.service[416293]: [pid: 416293|app: 0|req: 449/906] 10.222.0.42 () {60 vars in 1144 bytes} [Thu Jul 28 09:07:05 2022] POST /identity/v3/endpoints => generated 346 bytes in 231 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 09:07:05.435729 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46802f4-bbaf-4e00-9cd6-3deae024e24c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:07:05.436377 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46802f4-bbaf-4e00-9cd6-3deae024e24c None admin] REQUEST_METHOD: `GET` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:07:05.436755 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46802f4-bbaf-4e00-9cd6-3deae024e24c None admin] SCRIPT_NAME: `/identity` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:07:05.437191 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46802f4-bbaf-4e00-9cd6-3deae024e24c None admin] PATH_INFO: `/v3/domains` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:07:05.437974 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e46802f4-bbaf-4e00-9cd6-3deae024e24c None admin] RBAC: Adding query filter params (name=Default) {{(pid=416294) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 09:07:05.438633 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e46802f4-bbaf-4e00-9cd6-3deae024e24c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:07:05.440593 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e46802f4-bbaf-4e00-9cd6-3deae024e24c None admin] RBAC: Authorization granted {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:07:05.458353 dv-cinder-851351-1-smb devstack@keystone.service[416294]: [pid: 416294|app: 0|req: 458/907] 10.222.0.42 () {56 vars in 1109 bytes} [Thu Jul 28 09:07:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:07:05.474882 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f349dbb4-93f2-46bb-9b5b-e225cd85753d None admin] Authenticating user token {{(pid=416293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:07:05.602761 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f349dbb4-93f2-46bb-9b5b-e225cd85753d None admin] Validating token access rules against request {{(pid=416293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:07:05.631403 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG dbcounter [-] [416293] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=416293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:07:05.647024 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0c0bba-4c99-421e-8557-78261f919599 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:07:05.648247 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0c0bba-4c99-421e-8557-78261f919599 None admin] REQUEST_METHOD: `GET` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:07:05.648532 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0c0bba-4c99-421e-8557-78261f919599 None admin] SCRIPT_NAME: `/identity` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:07:05.648933 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0c0bba-4c99-421e-8557-78261f919599 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:07:05.658228 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c0c0bba-4c99-421e-8557-78261f919599 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:07:05.659766 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c0c0bba-4c99-421e-8557-78261f919599 None admin] RBAC: Authorization granted {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:07:05.672585 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application [None req-6c0c0bba-4c99-421e-8557-78261f919599 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 28 09:07:05.672585 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 09:07:05.672585 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 09:07:05.672585 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 09:07:05.672585 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 09:07:05.672585 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 09:07:05.672585 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 09:07:05.672585 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 09:07:05.672585 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 09:07:05.672585 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 09:07:05.672585 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 09:07:05.672585 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 09:07:05.672585 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 28 09:07:05.672585 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 28 09:07:05.672585 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 28 09:07:05.672585 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 28 09:07:05.673754 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 09:07:05.673754 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 09:07:05.673754 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 28 09:07:05.673754 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 09:07:05.673754 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 28 09:07:05.673754 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 09:07:05.673754 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 09:07:05.673754 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 09:07:05.673754 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 09:07:05.673754 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 09:07:05.673754 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 09:07:05.673754 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application with Lock( Jul 28 09:07:05.673754 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 09:07:05.673754 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self._enter() Jul 28 09:07:05.673754 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 09:07:05.673754 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 09:07:05.673754 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 09:07:05.673754 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self.creator() Jul 28 09:07:05.675074 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 09:07:05.675074 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application created_value = creator( Jul 28 09:07:05.675074 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 28 09:07:05.675074 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 28 09:07:05.675074 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 28 09:07:05.675074 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 28 09:07:05.675074 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 28 09:07:05.675074 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 28 09:07:05.675074 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 28 09:07:05.675074 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application Jul 28 09:07:05.675074 dv-cinder-851351-1-smb devstack@keystone.service[416293]: [pid: 416293|app: 0|req: 450/908] 10.222.0.42 () {56 vars in 1117 bytes} [Thu Jul 28 09:07:05 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 09:07:05.682099 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46802f4-bbaf-4e00-9cd6-3deae024e24c None admin] Authenticating user token {{(pid=416294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:07:05.697595 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG dbcounter [-] [416294] Writing DB stats keystone:SELECT=100 {{(pid=416294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:07:05.799684 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46802f4-bbaf-4e00-9cd6-3deae024e24c None admin] Validating token access rules against request {{(pid=416294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:07:05.837882 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f60373b-1673-4ca7-8102-c5c63e8c4d6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:07:05.840508 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f60373b-1673-4ca7-8102-c5c63e8c4d6b None admin] REQUEST_METHOD: `GET` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:07:05.840508 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f60373b-1673-4ca7-8102-c5c63e8c4d6b None admin] SCRIPT_NAME: `/identity` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:07:05.840508 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f60373b-1673-4ca7-8102-c5c63e8c4d6b None admin] PATH_INFO: `/v3/users` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:07:05.840508 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f60373b-1673-4ca7-8102-c5c63e8c4d6b None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=416294) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 09:07:05.841150 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f60373b-1673-4ca7-8102-c5c63e8c4d6b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:07:05.842812 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f60373b-1673-4ca7-8102-c5c63e8c4d6b None admin] RBAC: Authorization granted {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:07:05.867246 dv-cinder-851351-1-smb devstack@keystone.service[416294]: [pid: 416294|app: 0|req: 459/909] 10.222.0.42 () {56 vars in 1149 bytes} [Thu Jul 28 09:07:05 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:07:05.869234 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0c0bba-4c99-421e-8557-78261f919599 None admin] Authenticating user token {{(pid=416293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:07:05.870537 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc19233-40ef-412c-bd26-c37db49594d1 None None] REQUEST_METHOD: `GET` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:07:05.870999 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc19233-40ef-412c-bd26-c37db49594d1 None None] SCRIPT_NAME: `/identity` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:07:05.871443 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc19233-40ef-412c-bd26-c37db49594d1 None None] PATH_INFO: `/` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:07:05.874790 dv-cinder-851351-1-smb devstack@keystone.service[416294]: [pid: 416294|app: 0|req: 460/910] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 09:07:05 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 28 09:07:05.878723 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1818be-fb8b-4466-88be-211f7d3991f7 None None] REQUEST_METHOD: `POST` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:07:05.879018 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1818be-fb8b-4466-88be-211f7d3991f7 None None] SCRIPT_NAME: `/identity` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:07:05.879304 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1818be-fb8b-4466-88be-211f7d3991f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:07:05.898015 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.auth.core [None req-2e1818be-fb8b-4466-88be-211f7d3991f7 None None] MFA Rules not processed for user `dbf87abab90e4fdf9e75408f4199918e`. Rule list: `[]` (Enabled: `True`). {{(pid=416294) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 09:07:05.899256 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.fernet_utils [None req-2e1818be-fb8b-4466-88be-211f7d3991f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=416294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 09:07:05.973504 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG dbcounter [-] [416294] Writing DB stats keystone:SELECT=100 {{(pid=416294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:07:05.987382 dv-cinder-851351-1-smb devstack@keystone.service[416294]: [pid: 416294|app: 0|req: 461/911] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 09:07:05 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 28 09:07:06.005851 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0c0bba-4c99-421e-8557-78261f919599 None admin] Validating token access rules against request {{(pid=416293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:07:06.009872 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1818be-fb8b-4466-88be-211f7d3991f7 None None] Authenticating user token {{(pid=416294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:07:06.043267 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d6a3230-0947-4861-b83c-310dbd192d41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:07:06.043910 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6a3230-0947-4861-b83c-310dbd192d41 None admin] REQUEST_METHOD: `GET` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:07:06.044192 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6a3230-0947-4861-b83c-310dbd192d41 None admin] SCRIPT_NAME: `/identity` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:07:06.044469 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6a3230-0947-4861-b83c-310dbd192d41 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:07:06.104556 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG dbcounter [-] [416293] Writing DB stats keystone:SELECT=100 {{(pid=416293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:07:06.114777 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1818be-fb8b-4466-88be-211f7d3991f7 None None] Validating token access rules against request {{(pid=416294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:07:06.121977 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d6a3230-0947-4861-b83c-310dbd192d41 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:07:06.123507 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d6a3230-0947-4861-b83c-310dbd192d41 None admin] RBAC: Authorization granted {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:07:06.150425 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f97f42-2f97-4cc1-91fc-43de9ced6b7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:07:06.151098 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f97f42-2f97-4cc1-91fc-43de9ced6b7c None admin] REQUEST_METHOD: `GET` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:07:06.151385 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f97f42-2f97-4cc1-91fc-43de9ced6b7c None admin] SCRIPT_NAME: `/identity` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:07:06.151667 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f97f42-2f97-4cc1-91fc-43de9ced6b7c None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:07:06.152383 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25f97f42-2f97-4cc1-91fc-43de9ced6b7c None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:07:06.153905 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25f97f42-2f97-4cc1-91fc-43de9ced6b7c None admin] RBAC: Authorization granted {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:07:06.163384 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application [None req-25f97f42-2f97-4cc1-91fc-43de9ced6b7c None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 28 09:07:06.163384 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 09:07:06.163384 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 28 09:07:06.163384 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 28 09:07:06.163384 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 28 09:07:06.163384 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 28 09:07:06.163384 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 28 09:07:06.163384 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 09:07:06.163384 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 28 09:07:06.163384 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application Jul 28 09:07:06.163384 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 28 09:07:06.163384 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application Jul 28 09:07:06.163384 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 09:07:06.163384 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 09:07:06.163384 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 09:07:06.163384 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 09:07:06.164474 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 09:07:06.164474 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 09:07:06.164474 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 09:07:06.164474 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 09:07:06.164474 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 09:07:06.164474 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 09:07:06.164474 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 09:07:06.164474 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 28 09:07:06.164474 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 28 09:07:06.164474 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 28 09:07:06.164474 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 28 09:07:06.164474 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 09:07:06.164474 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 09:07:06.164474 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 09:07:06.164474 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 09:07:06.164474 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 09:07:06.165455 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 09:07:06.165455 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 09:07:06.165455 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application with Lock( Jul 28 09:07:06.165455 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 09:07:06.165455 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return self._enter() Jul 28 09:07:06.165455 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 09:07:06.165455 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 09:07:06.165455 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 09:07:06.165455 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return self.creator() Jul 28 09:07:06.165455 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 09:07:06.165455 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application created_value = creator( Jul 28 09:07:06.165455 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 28 09:07:06.165455 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 09:07:06.165455 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 28 09:07:06.165455 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application Jul 28 09:07:06.165455 dv-cinder-851351-1-smb devstack@keystone.service[416294]: [pid: 416294|app: 0|req: 462/912] 10.222.0.42 () {56 vars in 1132 bytes} [Thu Jul 28 09:07:06 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 09:07:06.173249 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f97f42-2f97-4cc1-91fc-43de9ced6b7c None admin] Authenticating user token {{(pid=416294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:07:06.243665 dv-cinder-851351-1-smb devstack@keystone.service[416293]: [pid: 416293|app: 0|req: 451/913] 10.222.0.42 () {58 vars in 1282 bytes} [Thu Jul 28 09:07:05 2022] GET /identity/v3/auth/tokens => generated 1362 bytes in 375 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 28 09:07:06.245026 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3405865-814d-444e-bae9-2c1218b2169b None None] REQUEST_METHOD: `GET` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:07:06.245319 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3405865-814d-444e-bae9-2c1218b2169b None None] SCRIPT_NAME: `/identity` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:07:06.245609 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3405865-814d-444e-bae9-2c1218b2169b None None] PATH_INFO: `/` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:07:06.245973 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG dbcounter [-] [416294] Writing DB stats keystone:SELECT=100 {{(pid=416294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:07:06.247143 dv-cinder-851351-1-smb devstack@keystone.service[416293]: [pid: 416293|app: 0|req: 452/914] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 09:07:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 09:07:06.250796 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3405865-814d-444e-bae9-2c1218b2169b None None] Authenticating user token {{(pid=416293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:07:06.291557 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f97f42-2f97-4cc1-91fc-43de9ced6b7c None admin] Validating token access rules against request {{(pid=416294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:07:06.330152 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-256fc7f9-cd92-4ee1-a88c-0f9e382752f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:07:06.330903 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256fc7f9-cd92-4ee1-a88c-0f9e382752f9 None admin] REQUEST_METHOD: `GET` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:07:06.331242 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256fc7f9-cd92-4ee1-a88c-0f9e382752f9 None admin] SCRIPT_NAME: `/identity` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:07:06.331535 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256fc7f9-cd92-4ee1-a88c-0f9e382752f9 None admin] PATH_INFO: `/v3/services` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:07:06.332398 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-256fc7f9-cd92-4ee1-a88c-0f9e382752f9 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=416294) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 09:07:06.332882 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-256fc7f9-cd92-4ee1-a88c-0f9e382752f9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:07:06.334895 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-256fc7f9-cd92-4ee1-a88c-0f9e382752f9 None admin] RBAC: Authorization granted {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:07:06.340936 dv-cinder-851351-1-smb devstack@keystone.service[416294]: [pid: 416294|app: 0|req: 463/915] 10.222.0.42 () {56 vars in 1126 bytes} [Thu Jul 28 09:07:06 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:07:06.342007 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92e88ff-1a53-433b-86b5-aab3ee34f667 None None] REQUEST_METHOD: `POST` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:07:06.342300 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92e88ff-1a53-433b-86b5-aab3ee34f667 None None] SCRIPT_NAME: `/identity` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:07:06.342580 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92e88ff-1a53-433b-86b5-aab3ee34f667 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:07:06.355790 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG dbcounter [-] [416293] Writing DB stats keystone:SELECT=100 {{(pid=416293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:07:06.364046 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.auth.core [None req-a92e88ff-1a53-433b-86b5-aab3ee34f667 None None] MFA Rules not processed for user `dbf87abab90e4fdf9e75408f4199918e`. Rule list: `[]` (Enabled: `True`). {{(pid=416294) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 09:07:06.365306 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.fernet_utils [None req-a92e88ff-1a53-433b-86b5-aab3ee34f667 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=416294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 09:07:06.376609 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3405865-814d-444e-bae9-2c1218b2169b None None] Validating token access rules against request {{(pid=416293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:07:06.416329 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743555af-9b98-40e8-a197-d55ff4339f09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:07:06.417369 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743555af-9b98-40e8-a197-d55ff4339f09 None admin] REQUEST_METHOD: `GET` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:07:06.417662 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743555af-9b98-40e8-a197-d55ff4339f09 None admin] SCRIPT_NAME: `/identity` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:07:06.417962 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743555af-9b98-40e8-a197-d55ff4339f09 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:07:06.428991 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-743555af-9b98-40e8-a197-d55ff4339f09 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:07:06.430483 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-743555af-9b98-40e8-a197-d55ff4339f09 None admin] RBAC: Authorization granted {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:07:06.438152 dv-cinder-851351-1-smb devstack@keystone.service[416294]: [pid: 416294|app: 0|req: 464/916] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 09:07:06 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 09:07:06.439022 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a92e88ff-1a53-433b-86b5-aab3ee34f667 None None] Authenticating user token {{(pid=416294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:07:06.459532 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application [None req-743555af-9b98-40e8-a197-d55ff4339f09 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 09:07:06.459532 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 09:07:06.459532 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 09:07:06.459532 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 09:07:06.459532 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 09:07:06.459532 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 09:07:06.459532 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 09:07:06.459532 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 09:07:06.459532 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 09:07:06.459532 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 09:07:06.459532 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 09:07:06.459532 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 09:07:06.459532 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 09:07:06.459532 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 09:07:06.459532 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 09:07:06.460550 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 09:07:06.460550 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 09:07:06.460550 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 09:07:06.460550 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 09:07:06.460550 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 09:07:06.460550 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 09:07:06.460550 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 09:07:06.460550 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 09:07:06.460550 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application with Lock( Jul 28 09:07:06.460550 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 09:07:06.460550 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self._enter() Jul 28 09:07:06.460550 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 09:07:06.460550 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 09:07:06.460550 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 09:07:06.460550 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self.creator() Jul 28 09:07:06.460550 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 09:07:06.460550 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application created_value = creator( Jul 28 09:07:06.461588 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 09:07:06.461588 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 09:07:06.461588 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 09:07:06.461588 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application Jul 28 09:07:06.467324 dv-cinder-851351-1-smb devstack@keystone.service[416293]: [pid: 416293|app: 0|req: 453/917] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 09:07:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 09:07:06.467324 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743555af-9b98-40e8-a197-d55ff4339f09 None admin] Authenticating user token {{(pid=416293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:07:06.505074 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG dbcounter [-] [416294] Writing DB stats keystone:SELECT=100 {{(pid=416294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:07:06.553049 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a92e88ff-1a53-433b-86b5-aab3ee34f667 None None] Validating token access rules against request {{(pid=416294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:07:06.577522 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743555af-9b98-40e8-a197-d55ff4339f09 None admin] Validating token access rules against request {{(pid=416293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:07:06.590078 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bee84c3-4234-4e68-90de-3f655fb2edf0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:07:06.590711 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bee84c3-4234-4e68-90de-3f655fb2edf0 None admin] REQUEST_METHOD: `GET` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:07:06.591415 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bee84c3-4234-4e68-90de-3f655fb2edf0 None admin] SCRIPT_NAME: `/identity` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:07:06.591415 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bee84c3-4234-4e68-90de-3f655fb2edf0 None admin] PATH_INFO: `/v3/services` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:07:06.591971 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bee84c3-4234-4e68-90de-3f655fb2edf0 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=416294) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 09:07:06.592277 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bee84c3-4234-4e68-90de-3f655fb2edf0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:07:06.593714 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bee84c3-4234-4e68-90de-3f655fb2edf0 None admin] RBAC: Authorization granted {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:07:06.599291 dv-cinder-851351-1-smb devstack@keystone.service[416294]: [pid: 416294|app: 0|req: 465/918] 10.222.0.42 () {56 vars in 1126 bytes} [Thu Jul 28 09:07:06 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:07:06.600034 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bee84c3-4234-4e68-90de-3f655fb2edf0 None admin] Authenticating user token {{(pid=416294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:07:06.625525 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d11aa63-425e-41d5-9ac6-252ad0880522 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:07:06.626544 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d11aa63-425e-41d5-9ac6-252ad0880522 None admin] REQUEST_METHOD: `POST` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:07:06.626898 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d11aa63-425e-41d5-9ac6-252ad0880522 None admin] SCRIPT_NAME: `/identity` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:07:06.627109 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d11aa63-425e-41d5-9ac6-252ad0880522 None admin] PATH_INFO: `/v3/services` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:07:06.627830 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d11aa63-425e-41d5-9ac6-252ad0880522 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:07:06.629320 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d11aa63-425e-41d5-9ac6-252ad0880522 None admin] RBAC: Authorization granted {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:07:06.634230 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG dbcounter [-] [416293] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=416293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:07:06.656695 dv-cinder-851351-1-smb devstack@keystone.service[416293]: [pid: 416293|app: 0|req: 454/919] 10.222.0.42 () {60 vars in 1141 bytes} [Thu Jul 28 09:07:06 2022] POST /identity/v3/services => generated 241 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 09:07:06.656695 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d11aa63-425e-41d5-9ac6-252ad0880522 None admin] Authenticating user token {{(pid=416293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:07:06.740720 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bee84c3-4234-4e68-90de-3f655fb2edf0 None admin] Validating token access rules against request {{(pid=416294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:07:06.766054 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG dbcounter [-] [416294] Writing DB stats keystone:SELECT=100 {{(pid=416294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:07:06.787511 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d11aa63-425e-41d5-9ac6-252ad0880522 None admin] Validating token access rules against request {{(pid=416293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:07:06.790387 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9887961a-82b9-416b-b761-5e0530bac4fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:07:06.791044 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9887961a-82b9-416b-b761-5e0530bac4fd None admin] REQUEST_METHOD: `GET` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:07:06.791325 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9887961a-82b9-416b-b761-5e0530bac4fd None admin] SCRIPT_NAME: `/identity` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:07:06.791604 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9887961a-82b9-416b-b761-5e0530bac4fd None admin] PATH_INFO: `/v3/domains` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:07:06.792319 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9887961a-82b9-416b-b761-5e0530bac4fd None admin] RBAC: Adding query filter params (name=Default) {{(pid=416294) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 09:07:06.792622 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9887961a-82b9-416b-b761-5e0530bac4fd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:07:06.794095 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9887961a-82b9-416b-b761-5e0530bac4fd None admin] RBAC: Authorization granted {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:07:06.808962 dv-cinder-851351-1-smb devstack@keystone.service[416294]: [pid: 416294|app: 0|req: 466/920] 10.222.0.42 () {56 vars in 1109 bytes} [Thu Jul 28 09:07:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:07:06.816825 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9887961a-82b9-416b-b761-5e0530bac4fd None admin] Authenticating user token {{(pid=416294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:07:06.831835 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c306c0-20e0-4c71-afb8-85b909af3fe7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:07:06.832491 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c306c0-20e0-4c71-afb8-85b909af3fe7 None admin] REQUEST_METHOD: `POST` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:07:06.832797 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c306c0-20e0-4c71-afb8-85b909af3fe7 None admin] SCRIPT_NAME: `/identity` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:07:06.833082 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c306c0-20e0-4c71-afb8-85b909af3fe7 None admin] PATH_INFO: `/v3/endpoints` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:07:06.833817 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47c306c0-20e0-4c71-afb8-85b909af3fe7 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:07:06.835210 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47c306c0-20e0-4c71-afb8-85b909af3fe7 None admin] RBAC: Authorization granted {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:07:06.859863 dv-cinder-851351-1-smb devstack@keystone.service[416293]: [pid: 416293|app: 0|req: 455/921] 10.222.0.42 () {60 vars in 1144 bytes} [Thu Jul 28 09:07:06 2022] POST /identity/v3/endpoints => generated 347 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 09:07:06.970694 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9887961a-82b9-416b-b761-5e0530bac4fd None admin] Validating token access rules against request {{(pid=416294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:07:07.022698 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca572ffd-6b7d-4af4-be11-a551aefc61fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:07:07.023371 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca572ffd-6b7d-4af4-be11-a551aefc61fa None admin] REQUEST_METHOD: `GET` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:07:07.023653 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca572ffd-6b7d-4af4-be11-a551aefc61fa None admin] SCRIPT_NAME: `/identity` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:07:07.023927 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca572ffd-6b7d-4af4-be11-a551aefc61fa None admin] PATH_INFO: `/v3/projects/service` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:07:07.036055 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca572ffd-6b7d-4af4-be11-a551aefc61fa None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:07:07.037599 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca572ffd-6b7d-4af4-be11-a551aefc61fa None admin] RBAC: Authorization granted {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:07:07.050358 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application [None req-ca572ffd-6b7d-4af4-be11-a551aefc61fa None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 09:07:07.050358 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 09:07:07.050358 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 09:07:07.050358 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 09:07:07.050358 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 09:07:07.050358 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 09:07:07.050358 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 09:07:07.050358 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 09:07:07.050358 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 09:07:07.050358 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 09:07:07.050358 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 09:07:07.050358 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 09:07:07.050358 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 28 09:07:07.050358 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 28 09:07:07.050358 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 28 09:07:07.051985 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 28 09:07:07.051985 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 09:07:07.051985 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 09:07:07.051985 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 09:07:07.051985 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 09:07:07.051985 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 09:07:07.051985 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 09:07:07.051985 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 09:07:07.051985 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application with Lock( Jul 28 09:07:07.051985 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 09:07:07.051985 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return self._enter() Jul 28 09:07:07.051985 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 09:07:07.051985 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 09:07:07.051985 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 09:07:07.051985 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return self.creator() Jul 28 09:07:07.051985 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 09:07:07.051985 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application created_value = creator( Jul 28 09:07:07.053627 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 28 09:07:07.053627 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 28 09:07:07.053627 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 28 09:07:07.053627 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 28 09:07:07.053627 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 28 09:07:07.053627 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 28 09:07:07.053627 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 09:07:07.053627 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application Jul 28 09:07:07.053627 dv-cinder-851351-1-smb devstack@keystone.service[416294]: [pid: 416294|app: 0|req: 467/922] 10.222.0.42 () {56 vars in 1111 bytes} [Thu Jul 28 09:07:06 2022] GET /identity/v3/projects/service => generated 88 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 09:07:07.058231 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c306c0-20e0-4c71-afb8-85b909af3fe7 None admin] Authenticating user token {{(pid=416293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:07:07.112698 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG dbcounter [-] [416293] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=416293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:07:07.168178 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c306c0-20e0-4c71-afb8-85b909af3fe7 None admin] Validating token access rules against request {{(pid=416293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:07:07.204423 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66552bb7-0e9a-4cf4-837e-1a7bd22869bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:07:07.205098 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66552bb7-0e9a-4cf4-837e-1a7bd22869bc None admin] REQUEST_METHOD: `GET` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:07:07.205382 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66552bb7-0e9a-4cf4-837e-1a7bd22869bc None admin] SCRIPT_NAME: `/identity` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:07:07.205659 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66552bb7-0e9a-4cf4-837e-1a7bd22869bc None admin] PATH_INFO: `/v3/projects` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:07:07.206426 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66552bb7-0e9a-4cf4-837e-1a7bd22869bc None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=416293) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 09:07:07.206729 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66552bb7-0e9a-4cf4-837e-1a7bd22869bc None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:07:07.208185 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66552bb7-0e9a-4cf4-837e-1a7bd22869bc None admin] RBAC: Authorization granted {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:07:07.222179 dv-cinder-851351-1-smb devstack@keystone.service[416293]: [pid: 416293|app: 0|req: 456/923] 10.222.0.42 () {56 vars in 1148 bytes} [Thu Jul 28 09:07:07 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 09:07:07.227956 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca572ffd-6b7d-4af4-be11-a551aefc61fa None admin] Authenticating user token {{(pid=416294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:07:07.262372 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG dbcounter [-] [416294] Writing DB stats keystone:SELECT=100 {{(pid=416294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:07:07.335438 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca572ffd-6b7d-4af4-be11-a551aefc61fa None admin] Validating token access rules against request {{(pid=416294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:07:07.371716 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01a4a77-36cd-432e-85a7-98fb6f103f8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:07:07.372773 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01a4a77-36cd-432e-85a7-98fb6f103f8c None admin] REQUEST_METHOD: `GET` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:07:07.373273 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01a4a77-36cd-432e-85a7-98fb6f103f8c None admin] SCRIPT_NAME: `/identity` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:07:07.373774 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01a4a77-36cd-432e-85a7-98fb6f103f8c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:07:07.374911 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b01a4a77-36cd-432e-85a7-98fb6f103f8c None admin] RBAC: Adding query filter params (role.id=4d94122535c54ae98fbaf3c8766c59be, scope.project.id=6c4349445f224184b093d9dfd0dfc642, user.id=f5b664bdc0d04af8ac60a11e9a136c91) {{(pid=416294) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 09:07:07.375479 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b01a4a77-36cd-432e-85a7-98fb6f103f8c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:07:07.377193 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b01a4a77-36cd-432e-85a7-98fb6f103f8c None admin] RBAC: Authorization granted {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:07:07.383797 dv-cinder-851351-1-smb devstack@keystone.service[416294]: [pid: 416294|app: 0|req: 468/924] 10.222.0.42 () {56 vars in 1374 bytes} [Thu Jul 28 09:07:07 2022] GET /identity/v3/role_assignments?user.id=f5b664bdc0d04af8ac60a11e9a136c91&scope.project.id=6c4349445f224184b093d9dfd0dfc642&role.id=4d94122535c54ae98fbaf3c8766c59be => generated 259 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:07:07.577262 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfef55a-8301-4341-925c-0c79177674d1 None None] REQUEST_METHOD: `GET` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:07:07.577654 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfef55a-8301-4341-925c-0c79177674d1 None None] SCRIPT_NAME: `/identity` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:07:07.577843 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfef55a-8301-4341-925c-0c79177674d1 None None] PATH_INFO: `/` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:07:07.579553 dv-cinder-851351-1-smb devstack@keystone.service[416293]: [pid: 416293|app: 0|req: 457/925] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 09:07:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 09:07:07.585037 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a2bb61-aa87-4191-8a8b-87d98051dfb7 None None] REQUEST_METHOD: `POST` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:07:07.585328 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a2bb61-aa87-4191-8a8b-87d98051dfb7 None None] SCRIPT_NAME: `/identity` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:07:07.585608 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a2bb61-aa87-4191-8a8b-87d98051dfb7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:07:07.604204 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.auth.core [None req-67a2bb61-aa87-4191-8a8b-87d98051dfb7 None None] MFA Rules not processed for user `dbf87abab90e4fdf9e75408f4199918e`. Rule list: `[]` (Enabled: `True`). {{(pid=416294) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 09:07:07.605428 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.fernet_utils [None req-67a2bb61-aa87-4191-8a8b-87d98051dfb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=416294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 09:07:07.680493 dv-cinder-851351-1-smb devstack@keystone.service[416294]: [pid: 416294|app: 0|req: 469/926] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 09:07:07 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 09:07:07.703491 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dfef55a-8301-4341-925c-0c79177674d1 None None] Authenticating user token {{(pid=416293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:07:07.814707 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dfef55a-8301-4341-925c-0c79177674d1 None None] Validating token access rules against request {{(pid=416293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:07:07.824982 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG dbcounter [-] [416293] Writing DB stats keystone:SELECT=100 {{(pid=416293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:07:07.851332 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ed7be4-38aa-4f87-b3b0-a77d198d153e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:07:07.851891 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ed7be4-38aa-4f87-b3b0-a77d198d153e None admin] REQUEST_METHOD: `POST` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:07:07.852179 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ed7be4-38aa-4f87-b3b0-a77d198d153e None admin] SCRIPT_NAME: `/identity` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:07:07.852458 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ed7be4-38aa-4f87-b3b0-a77d198d153e None admin] PATH_INFO: `/v3/projects` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:07:07.853197 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50ed7be4-38aa-4f87-b3b0-a77d198d153e None admin] RBAC: Authorizing `identity:create_project()` {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:07:07.854709 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50ed7be4-38aa-4f87-b3b0-a77d198d153e None admin] RBAC: Authorization granted {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:07:07.857508 dv-cinder-851351-1-smb devstack@keystone.service[416293]: WARNING keystone.server.flask.common [None req-50ed7be4-38aa-4f87-b3b0-a77d198d153e None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Jul 28 09:07:07.877508 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.sql.core [None req-50ed7be4-38aa-4f87-b3b0-a77d198d153e None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jul 28 09:07:07.877508 dv-cinder-851351-1-smb devstack@keystone.service[416293]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Jul 28 09:07:07.877508 dv-cinder-851351-1-smb devstack@keystone.service[416293]: [parameters: {'id': 'ecbc4079892f439ea3e0ea71f30eb145', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Jul 28 09:07:07.877508 dv-cinder-851351-1-smb devstack@keystone.service[416293]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=416293) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jul 28 09:07:07.894696 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application [None req-50ed7be4-38aa-4f87-b3b0-a77d198d153e None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id ecbc4079892f439ea3e0ea71f30eb145.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id ecbc4079892f439ea3e0ea71f30eb145. Jul 28 09:07:07.894696 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 09:07:07.894696 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 28 09:07:07.894696 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 28 09:07:07.894696 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 28 09:07:07.894696 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 28 09:07:07.894696 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 28 09:07:07.894696 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application result = self._query(query) Jul 28 09:07:07.894696 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 28 09:07:07.894696 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application conn.query(q) Jul 28 09:07:07.894696 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 28 09:07:07.894696 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 28 09:07:07.894696 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 28 09:07:07.895649 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application result.read() Jul 28 09:07:07.895649 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 28 09:07:07.895649 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 28 09:07:07.895649 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 28 09:07:07.895649 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 28 09:07:07.895649 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 28 09:07:07.895649 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 28 09:07:07.895649 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 28 09:07:07.895649 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 28 09:07:07.895649 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jul 28 09:07:07.895649 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application Jul 28 09:07:07.895649 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jul 28 09:07:07.895649 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application Jul 28 09:07:07.895649 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 09:07:07.895649 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jul 28 09:07:07.895649 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jul 28 09:07:07.895649 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Jul 28 09:07:07.895649 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return project_ref.to_dict() Jul 28 09:07:07.896757 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 28 09:07:07.896757 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application next(self.gen) Jul 28 09:07:07.896757 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jul 28 09:07:07.896757 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application yield resource Jul 28 09:07:07.896757 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 28 09:07:07.896757 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application next(self.gen) Jul 28 09:07:07.896757 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jul 28 09:07:07.896757 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application self.session.rollback() Jul 28 09:07:07.896757 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 28 09:07:07.896757 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application self.force_reraise() Jul 28 09:07:07.896757 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 28 09:07:07.896757 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application raise self.value Jul 28 09:07:07.896757 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jul 28 09:07:07.896757 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jul 28 09:07:07.896757 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jul 28 09:07:07.896757 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application session.commit() Jul 28 09:07:07.896757 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jul 28 09:07:07.897758 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jul 28 09:07:07.897758 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jul 28 09:07:07.897758 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application self._prepare_impl() Jul 28 09:07:07.897758 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jul 28 09:07:07.897758 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application self.session.flush() Jul 28 09:07:07.897758 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jul 28 09:07:07.897758 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application self._flush(objects) Jul 28 09:07:07.897758 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jul 28 09:07:07.897758 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jul 28 09:07:07.897758 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jul 28 09:07:07.897758 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application compat.raise_( Jul 28 09:07:07.897758 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 28 09:07:07.897758 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application raise exception Jul 28 09:07:07.897758 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jul 28 09:07:07.897758 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application flush_context.execute() Jul 28 09:07:07.897758 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jul 28 09:07:07.897758 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application rec.execute(self) Jul 28 09:07:07.898741 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jul 28 09:07:07.898741 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jul 28 09:07:07.898741 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jul 28 09:07:07.898741 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application _emit_insert_statements( Jul 28 09:07:07.898741 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Jul 28 09:07:07.898741 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application c = connection._execute_20( Jul 28 09:07:07.898741 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jul 28 09:07:07.898741 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jul 28 09:07:07.898741 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Jul 28 09:07:07.898741 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jul 28 09:07:07.898741 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jul 28 09:07:07.898741 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application ret = self._execute_context( Jul 28 09:07:07.898741 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jul 28 09:07:07.898741 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jul 28 09:07:07.898741 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jul 28 09:07:07.899609 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jul 28 09:07:07.899609 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 28 09:07:07.899609 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application raise exception Jul 28 09:07:07.899609 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 28 09:07:07.899609 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 28 09:07:07.899609 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 28 09:07:07.899609 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 28 09:07:07.899609 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 28 09:07:07.899609 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application result = self._query(query) Jul 28 09:07:07.899609 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 28 09:07:07.899609 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application conn.query(q) Jul 28 09:07:07.899609 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 28 09:07:07.899609 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 28 09:07:07.899609 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 28 09:07:07.899609 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application result.read() Jul 28 09:07:07.899609 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 28 09:07:07.899609 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 28 09:07:07.900552 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 28 09:07:07.900552 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 28 09:07:07.900552 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 28 09:07:07.900552 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 28 09:07:07.900552 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 28 09:07:07.900552 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 28 09:07:07.900552 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jul 28 09:07:07.900552 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Jul 28 09:07:07.900552 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application [parameters: {'id': 'ecbc4079892f439ea3e0ea71f30eb145', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Jul 28 09:07:07.900552 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jul 28 09:07:07.900552 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application Jul 28 09:07:07.900552 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 28 09:07:07.900552 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application Jul 28 09:07:07.900552 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 09:07:07.900552 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Jul 28 09:07:07.903448 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Jul 28 09:07:07.903448 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jul 28 09:07:07.903448 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jul 28 09:07:07.903448 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Jul 28 09:07:07.903448 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application Jul 28 09:07:07.903448 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 28 09:07:07.903448 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application Jul 28 09:07:07.903448 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 09:07:07.903448 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 09:07:07.903448 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 09:07:07.903448 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 09:07:07.903448 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 09:07:07.903448 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 09:07:07.903448 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 09:07:07.903448 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 09:07:07.903448 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 09:07:07.903448 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 09:07:07.907055 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 09:07:07.907055 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Jul 28 09:07:07.907055 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Jul 28 09:07:07.907055 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 09:07:07.907055 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 09:07:07.907055 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Jul 28 09:07:07.907055 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application raise exception.Conflict( Jul 28 09:07:07.907055 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id ecbc4079892f439ea3e0ea71f30eb145. Jul 28 09:07:07.907055 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application Jul 28 09:07:07.907055 dv-cinder-851351-1-smb devstack@keystone.service[416293]: [pid: 416293|app: 0|req: 458/927] 10.222.0.42 () {60 vars in 1140 bytes} [Thu Jul 28 09:07:07 2022] POST /identity/v3/projects => generated 262 bytes in 193 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Jul 28 09:07:07.914050 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a2bb61-aa87-4191-8a8b-87d98051dfb7 None None] Authenticating user token {{(pid=416294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:07:07.945071 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG dbcounter [-] [416294] Writing DB stats keystone:SELECT=100 {{(pid=416294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:07:08.014281 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a2bb61-aa87-4191-8a8b-87d98051dfb7 None None] Validating token access rules against request {{(pid=416294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:07:08.054063 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b30a47-7191-4d14-9760-b7ec1f023a77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:07:08.054987 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b30a47-7191-4d14-9760-b7ec1f023a77 None admin] REQUEST_METHOD: `GET` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:07:08.055449 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b30a47-7191-4d14-9760-b7ec1f023a77 None admin] SCRIPT_NAME: `/identity` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:07:08.055906 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b30a47-7191-4d14-9760-b7ec1f023a77 None admin] PATH_INFO: `/v3/projects/service` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:07:08.063362 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b30a47-7191-4d14-9760-b7ec1f023a77 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:07:08.065062 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b30a47-7191-4d14-9760-b7ec1f023a77 None admin] RBAC: Authorization granted {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:07:08.077581 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application [None req-38b30a47-7191-4d14-9760-b7ec1f023a77 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 09:07:08.077581 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 09:07:08.077581 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 09:07:08.077581 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 09:07:08.077581 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 09:07:08.077581 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 09:07:08.077581 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 09:07:08.077581 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 09:07:08.077581 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 09:07:08.077581 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 09:07:08.077581 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 09:07:08.077581 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 09:07:08.077581 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 28 09:07:08.077581 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 28 09:07:08.077581 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 28 09:07:08.078947 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 28 09:07:08.078947 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 09:07:08.078947 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 09:07:08.078947 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 09:07:08.078947 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 09:07:08.078947 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 09:07:08.078947 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 09:07:08.078947 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 09:07:08.078947 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application with Lock( Jul 28 09:07:08.078947 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 09:07:08.078947 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return self._enter() Jul 28 09:07:08.078947 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 09:07:08.078947 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 09:07:08.078947 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 09:07:08.078947 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return self.creator() Jul 28 09:07:08.078947 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 09:07:08.078947 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application created_value = creator( Jul 28 09:07:08.080146 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 28 09:07:08.080146 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 28 09:07:08.080146 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 28 09:07:08.080146 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 28 09:07:08.080146 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 28 09:07:08.080146 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 28 09:07:08.080146 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 09:07:08.080146 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application Jul 28 09:07:08.082535 dv-cinder-851351-1-smb devstack@keystone.service[416294]: [pid: 416294|app: 0|req: 470/928] 10.222.0.42 () {56 vars in 1111 bytes} [Thu Jul 28 09:07:07 2022] GET /identity/v3/projects/service => generated 88 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 09:07:08.089125 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ed7be4-38aa-4f87-b3b0-a77d198d153e None admin] Authenticating user token {{(pid=416293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:07:08.192431 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ed7be4-38aa-4f87-b3b0-a77d198d153e None admin] Validating token access rules against request {{(pid=416293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:07:08.231748 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3366ff42-0cd5-4b1c-b7bf-4137dbabe605 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:07:08.232387 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3366ff42-0cd5-4b1c-b7bf-4137dbabe605 None admin] REQUEST_METHOD: `GET` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:07:08.232687 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3366ff42-0cd5-4b1c-b7bf-4137dbabe605 None admin] SCRIPT_NAME: `/identity` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:07:08.232973 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3366ff42-0cd5-4b1c-b7bf-4137dbabe605 None admin] PATH_INFO: `/v3/projects` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:07:08.233704 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3366ff42-0cd5-4b1c-b7bf-4137dbabe605 None admin] RBAC: Adding query filter params (name=service) {{(pid=416293) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 09:07:08.234004 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3366ff42-0cd5-4b1c-b7bf-4137dbabe605 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:07:08.235718 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3366ff42-0cd5-4b1c-b7bf-4137dbabe605 None admin] RBAC: Authorization granted {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:07:08.256440 dv-cinder-851351-1-smb devstack@keystone.service[416293]: [pid: 416293|app: 0|req: 459/929] 10.222.0.42 () {56 vars in 1112 bytes} [Thu Jul 28 09:07:08 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:07:08.858037 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c3fac0-c7d2-4589-9cdc-a18c2d83cc98 None None] REQUEST_METHOD: `GET` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:07:08.858409 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c3fac0-c7d2-4589-9cdc-a18c2d83cc98 None None] SCRIPT_NAME: `/identity` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:07:08.858742 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c3fac0-c7d2-4589-9cdc-a18c2d83cc98 None None] PATH_INFO: `/` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:07:08.861968 dv-cinder-851351-1-smb devstack@keystone.service[416294]: [pid: 416294|app: 0|req: 471/930] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 09:07:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 09:07:08.866965 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fda86f1-a98e-4b17-9d9b-a0204aae5860 None None] REQUEST_METHOD: `POST` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:07:08.867417 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fda86f1-a98e-4b17-9d9b-a0204aae5860 None None] SCRIPT_NAME: `/identity` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:07:08.867826 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fda86f1-a98e-4b17-9d9b-a0204aae5860 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:07:08.890955 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.auth.core [None req-9fda86f1-a98e-4b17-9d9b-a0204aae5860 None None] MFA Rules not processed for user `dbf87abab90e4fdf9e75408f4199918e`. Rule list: `[]` (Enabled: `True`). {{(pid=416293) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 09:07:08.892575 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.fernet_utils [None req-9fda86f1-a98e-4b17-9d9b-a0204aae5860 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=416293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 09:07:08.912374 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG dbcounter [-] [416293] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=416293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:07:08.971065 dv-cinder-851351-1-smb devstack@keystone.service[416293]: [pid: 416293|app: 0|req: 460/931] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 09:07:08 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 09:07:09.000187 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c3fac0-c7d2-4589-9cdc-a18c2d83cc98 None None] Authenticating user token {{(pid=416294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:07:09.087673 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f45e5e3-1a78-457c-b047-44105f13cadc None None] REQUEST_METHOD: `GET` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:07:09.087967 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f45e5e3-1a78-457c-b047-44105f13cadc None None] SCRIPT_NAME: `/identity` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:07:09.088244 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f45e5e3-1a78-457c-b047-44105f13cadc None None] PATH_INFO: `/` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:07:09.091272 dv-cinder-851351-1-smb devstack@keystone.service[416293]: [pid: 416293|app: 0|req: 461/932] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 09:07:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 09:07:09.095844 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e1b0a8-876a-48c7-95a9-f128ec90c64f None None] REQUEST_METHOD: `POST` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:07:09.096119 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e1b0a8-876a-48c7-95a9-f128ec90c64f None None] SCRIPT_NAME: `/identity` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:07:09.096392 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e1b0a8-876a-48c7-95a9-f128ec90c64f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:07:09.111794 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG dbcounter [-] [416294] Writing DB stats keystone:SELECT=100 {{(pid=416294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:07:09.117392 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.auth.core [None req-34e1b0a8-876a-48c7-95a9-f128ec90c64f None None] MFA Rules not processed for user `dbf87abab90e4fdf9e75408f4199918e`. Rule list: `[]` (Enabled: `True`). {{(pid=416293) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 09:07:09.118807 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.fernet_utils [None req-34e1b0a8-876a-48c7-95a9-f128ec90c64f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=416293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 09:07:09.129984 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c3fac0-c7d2-4589-9cdc-a18c2d83cc98 None None] Validating token access rules against request {{(pid=416294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:07:09.192787 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea2cda60-4510-4d93-bad0-bc247cec7974 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:07:09.193939 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2cda60-4510-4d93-bad0-bc247cec7974 None admin] REQUEST_METHOD: `GET` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:07:09.194261 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2cda60-4510-4d93-bad0-bc247cec7974 None admin] SCRIPT_NAME: `/identity` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:07:09.194983 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2cda60-4510-4d93-bad0-bc247cec7974 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:07:09.195836 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea2cda60-4510-4d93-bad0-bc247cec7974 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:07:09.197337 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea2cda60-4510-4d93-bad0-bc247cec7974 None admin] RBAC: Authorization granted {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:07:09.211942 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application [None req-ea2cda60-4510-4d93-bad0-bc247cec7974 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 28 09:07:09.211942 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 09:07:09.211942 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 28 09:07:09.211942 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 28 09:07:09.211942 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 28 09:07:09.211942 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 28 09:07:09.211942 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 28 09:07:09.211942 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 09:07:09.211942 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 28 09:07:09.211942 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application Jul 28 09:07:09.211942 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 28 09:07:09.211942 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application Jul 28 09:07:09.211942 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 09:07:09.211942 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 09:07:09.211942 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 09:07:09.211942 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 09:07:09.211942 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 09:07:09.213272 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 09:07:09.213272 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 09:07:09.213272 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 09:07:09.213272 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 09:07:09.213272 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 09:07:09.213272 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 09:07:09.213272 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 28 09:07:09.213272 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 28 09:07:09.213272 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 28 09:07:09.213272 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 28 09:07:09.213272 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 09:07:09.213272 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 09:07:09.213272 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 09:07:09.213272 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 09:07:09.213272 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 09:07:09.213272 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 09:07:09.214285 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 09:07:09.214285 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application with Lock( Jul 28 09:07:09.214285 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 09:07:09.214285 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return self._enter() Jul 28 09:07:09.214285 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 09:07:09.214285 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 09:07:09.214285 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 09:07:09.214285 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return self.creator() Jul 28 09:07:09.214285 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 09:07:09.214285 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application created_value = creator( Jul 28 09:07:09.214285 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 28 09:07:09.214285 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 09:07:09.214285 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 28 09:07:09.214285 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application Jul 28 09:07:09.214285 dv-cinder-851351-1-smb devstack@keystone.service[416294]: [pid: 416294|app: 0|req: 472/933] 10.222.0.42 () {56 vars in 1126 bytes} [Thu Jul 28 09:07:08 2022] GET /identity/v3/services/object-store => generated 93 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 09:07:09.220414 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea2cda60-4510-4d93-bad0-bc247cec7974 None admin] Authenticating user token {{(pid=416294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:07:09.220993 dv-cinder-851351-1-smb devstack@keystone.service[416293]: [pid: 416293|app: 0|req: 462/934] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 09:07:09 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 28 09:07:09.247142 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e1b0a8-876a-48c7-95a9-f128ec90c64f None None] Authenticating user token {{(pid=416293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:07:09.355243 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG dbcounter [-] [416293] Writing DB stats keystone:SELECT=100 {{(pid=416293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:07:09.376629 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e1b0a8-876a-48c7-95a9-f128ec90c64f None None] Validating token access rules against request {{(pid=416293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:07:09.378897 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea2cda60-4510-4d93-bad0-bc247cec7974 None admin] Validating token access rules against request {{(pid=416294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:07:09.420965 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd62b7ee-2787-45f5-82c0-bc02cf32dda0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:07:09.421583 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce3cf83-8c21-45d0-8a75-ecd14b9a9836 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:07:09.422266 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce3cf83-8c21-45d0-8a75-ecd14b9a9836 None admin] REQUEST_METHOD: `GET` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:07:09.422601 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd62b7ee-2787-45f5-82c0-bc02cf32dda0 None admin] REQUEST_METHOD: `GET` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:07:09.422744 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce3cf83-8c21-45d0-8a75-ecd14b9a9836 None admin] SCRIPT_NAME: `/identity` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:07:09.422916 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce3cf83-8c21-45d0-8a75-ecd14b9a9836 None admin] PATH_INFO: `/v3/services/compute` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:07:09.423392 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd62b7ee-2787-45f5-82c0-bc02cf32dda0 None admin] SCRIPT_NAME: `/identity` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:07:09.423587 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ce3cf83-8c21-45d0-8a75-ecd14b9a9836 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:07:09.424059 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd62b7ee-2787-45f5-82c0-bc02cf32dda0 None admin] PATH_INFO: `/v3/services` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:07:09.424992 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd62b7ee-2787-45f5-82c0-bc02cf32dda0 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=416294) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 09:07:09.425133 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ce3cf83-8c21-45d0-8a75-ecd14b9a9836 None admin] RBAC: Authorization granted {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:07:09.425634 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd62b7ee-2787-45f5-82c0-bc02cf32dda0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:07:09.427438 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd62b7ee-2787-45f5-82c0-bc02cf32dda0 None admin] RBAC: Authorization granted {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:07:09.433351 dv-cinder-851351-1-smb devstack@keystone.service[416294]: [pid: 416294|app: 0|req: 473/935] 10.222.0.42 () {56 vars in 1122 bytes} [Thu Jul 28 09:07:09 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 09:07:09.435298 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application [None req-6ce3cf83-8c21-45d0-8a75-ecd14b9a9836 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jul 28 09:07:09.435298 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 09:07:09.435298 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 28 09:07:09.435298 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 28 09:07:09.435298 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 28 09:07:09.435298 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 28 09:07:09.435298 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 28 09:07:09.435298 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 09:07:09.435298 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 28 09:07:09.435298 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application Jul 28 09:07:09.435298 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 28 09:07:09.435298 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application Jul 28 09:07:09.435298 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 09:07:09.435298 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 09:07:09.435298 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 09:07:09.435298 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 09:07:09.435298 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 09:07:09.437082 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 09:07:09.437082 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 09:07:09.437082 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 09:07:09.437082 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 09:07:09.437082 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 09:07:09.437082 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 09:07:09.437082 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 28 09:07:09.437082 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 28 09:07:09.437082 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 28 09:07:09.437082 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 28 09:07:09.437082 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 09:07:09.437082 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 09:07:09.437082 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 09:07:09.437082 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 09:07:09.437082 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 09:07:09.437082 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 09:07:09.438245 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 09:07:09.438245 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application with Lock( Jul 28 09:07:09.438245 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 09:07:09.438245 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self._enter() Jul 28 09:07:09.438245 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 09:07:09.438245 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 09:07:09.438245 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 09:07:09.438245 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self.creator() Jul 28 09:07:09.438245 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 09:07:09.438245 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application created_value = creator( Jul 28 09:07:09.438245 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 28 09:07:09.438245 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 09:07:09.438245 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 28 09:07:09.438245 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application Jul 28 09:07:09.448010 dv-cinder-851351-1-smb devstack@keystone.service[416293]: [pid: 416293|app: 0|req: 463/936] 10.222.0.42 () {56 vars in 1111 bytes} [Thu Jul 28 09:07:09 2022] GET /identity/v3/services/compute => generated 88 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 09:07:09.448715 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd62b7ee-2787-45f5-82c0-bc02cf32dda0 None admin] Authenticating user token {{(pid=416294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:07:09.452059 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce3cf83-8c21-45d0-8a75-ecd14b9a9836 None admin] Authenticating user token {{(pid=416293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:07:09.477169 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG dbcounter [-] [416294] Writing DB stats keystone:SELECT=100 {{(pid=416294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:07:09.570590 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd62b7ee-2787-45f5-82c0-bc02cf32dda0 None admin] Validating token access rules against request {{(pid=416294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:07:09.585472 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce3cf83-8c21-45d0-8a75-ecd14b9a9836 None admin] Validating token access rules against request {{(pid=416293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:07:09.609239 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168f613b-fe6f-44ec-afa4-46a100041392 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:07:09.609995 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168f613b-fe6f-44ec-afa4-46a100041392 None admin] REQUEST_METHOD: `GET` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:07:09.610350 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168f613b-fe6f-44ec-afa4-46a100041392 None admin] SCRIPT_NAME: `/identity` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:07:09.610625 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168f613b-fe6f-44ec-afa4-46a100041392 None admin] PATH_INFO: `/v3/services` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:07:09.611317 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-168f613b-fe6f-44ec-afa4-46a100041392 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=416294) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 09:07:09.611695 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-168f613b-fe6f-44ec-afa4-46a100041392 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:07:09.613318 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-168f613b-fe6f-44ec-afa4-46a100041392 None admin] RBAC: Authorization granted {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:07:09.619232 dv-cinder-851351-1-smb devstack@keystone.service[416294]: [pid: 416294|app: 0|req: 474/937] 10.222.0.42 () {56 vars in 1122 bytes} [Thu Jul 28 09:07:09 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:07:09.620475 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360297df-47a8-4c4e-aa60-1b1cc98b944f None None] REQUEST_METHOD: `GET` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:07:09.620802 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360297df-47a8-4c4e-aa60-1b1cc98b944f None None] SCRIPT_NAME: `/identity` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:07:09.621082 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360297df-47a8-4c4e-aa60-1b1cc98b944f None None] PATH_INFO: `/` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:07:09.622526 dv-cinder-851351-1-smb devstack@keystone.service[416294]: [pid: 416294|app: 0|req: 475/938] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 09:07:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 09:07:09.627458 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-360297df-47a8-4c4e-aa60-1b1cc98b944f None None] Authenticating user token {{(pid=416294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:07:09.637767 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ef05d3-6f3b-4193-aaf7-82d1176c5afa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:07:09.638701 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ef05d3-6f3b-4193-aaf7-82d1176c5afa None admin] REQUEST_METHOD: `GET` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:07:09.639285 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ef05d3-6f3b-4193-aaf7-82d1176c5afa None admin] SCRIPT_NAME: `/identity` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:07:09.639601 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ef05d3-6f3b-4193-aaf7-82d1176c5afa None admin] PATH_INFO: `/v3/services` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:07:09.640365 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66ef05d3-6f3b-4193-aaf7-82d1176c5afa None admin] RBAC: Adding query filter params (name=compute) {{(pid=416293) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 09:07:09.640803 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66ef05d3-6f3b-4193-aaf7-82d1176c5afa None admin] RBAC: Authorizing `identity:list_services()` {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:07:09.642319 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66ef05d3-6f3b-4193-aaf7-82d1176c5afa None admin] RBAC: Authorization granted {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:07:09.653404 dv-cinder-851351-1-smb devstack@keystone.service[416293]: [pid: 416293|app: 0|req: 464/939] 10.222.0.42 () {56 vars in 1112 bytes} [Thu Jul 28 09:07:09 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 09:07:09.655309 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb37e08-8cb3-4f88-9573-7b65e8430696 None None] REQUEST_METHOD: `POST` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:07:09.655503 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb37e08-8cb3-4f88-9573-7b65e8430696 None None] SCRIPT_NAME: `/identity` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:07:09.655782 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb37e08-8cb3-4f88-9573-7b65e8430696 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:07:09.675575 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.auth.core [None req-cfb37e08-8cb3-4f88-9573-7b65e8430696 None None] MFA Rules not processed for user `dbf87abab90e4fdf9e75408f4199918e`. Rule list: `[]` (Enabled: `True`). {{(pid=416293) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 09:07:09.676823 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.fernet_utils [None req-cfb37e08-8cb3-4f88-9573-7b65e8430696 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=416293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 09:07:09.684994 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG dbcounter [-] [416293] Writing DB stats keystone:SELECT=100 {{(pid=416293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:07:09.733583 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG dbcounter [-] [416294] Writing DB stats keystone:SELECT=100 {{(pid=416294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:07:09.768721 dv-cinder-851351-1-smb devstack@keystone.service[416293]: [pid: 416293|app: 0|req: 465/940] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 09:07:09 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 09:07:09.768721 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb37e08-8cb3-4f88-9573-7b65e8430696 None None] Authenticating user token {{(pid=416293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:07:09.773454 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-360297df-47a8-4c4e-aa60-1b1cc98b944f None None] Validating token access rules against request {{(pid=416294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:07:09.817693 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7311ca-72af-46fe-b5cd-645fbd0d5232 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:07:09.818332 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7311ca-72af-46fe-b5cd-645fbd0d5232 None admin] REQUEST_METHOD: `GET` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:07:09.818614 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7311ca-72af-46fe-b5cd-645fbd0d5232 None admin] SCRIPT_NAME: `/identity` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:07:09.818971 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7311ca-72af-46fe-b5cd-645fbd0d5232 None admin] PATH_INFO: `/v3/endpoints` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:07:09.819854 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb7311ca-72af-46fe-b5cd-645fbd0d5232 None admin] RBAC: Adding query filter params (interface=public, service_id=5a3e16ed29594e9eaa06ceaf16b16d04, region_id=RegionOne) {{(pid=416294) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 09:07:09.820166 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb7311ca-72af-46fe-b5cd-645fbd0d5232 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:07:09.821717 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb7311ca-72af-46fe-b5cd-645fbd0d5232 None admin] RBAC: Authorization granted {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:07:09.828531 dv-cinder-851351-1-smb devstack@keystone.service[416294]: [pid: 416294|app: 0|req: 476/941] 10.222.0.42 () {56 vars in 1251 bytes} [Thu Jul 28 09:07:09 2022] GET /identity/v3/endpoints?service_id=5a3e16ed29594e9eaa06ceaf16b16d04&interface=public®ion_id=RegionOne => generated 194 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:07:09.829375 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7311ca-72af-46fe-b5cd-645fbd0d5232 None admin] Authenticating user token {{(pid=416294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:07:09.912597 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb37e08-8cb3-4f88-9573-7b65e8430696 None None] Validating token access rules against request {{(pid=416293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:07:09.946401 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7311ca-72af-46fe-b5cd-645fbd0d5232 None admin] Validating token access rules against request {{(pid=416294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:07:09.958472 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2113e1e0-e7d5-4155-8d1b-f0760b3322f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:07:09.959135 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2113e1e0-e7d5-4155-8d1b-f0760b3322f0 None admin] REQUEST_METHOD: `GET` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:07:09.959487 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2113e1e0-e7d5-4155-8d1b-f0760b3322f0 None admin] SCRIPT_NAME: `/identity` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:07:09.959841 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2113e1e0-e7d5-4155-8d1b-f0760b3322f0 None admin] PATH_INFO: `/v3/services` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:07:09.964501 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2113e1e0-e7d5-4155-8d1b-f0760b3322f0 None admin] RBAC: Adding query filter params (type=compute) {{(pid=416293) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 09:07:09.964501 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2113e1e0-e7d5-4155-8d1b-f0760b3322f0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:07:09.964501 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2113e1e0-e7d5-4155-8d1b-f0760b3322f0 None admin] RBAC: Authorization granted {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:07:09.980698 dv-cinder-851351-1-smb devstack@keystone.service[416293]: [pid: 416293|app: 0|req: 466/942] 10.222.0.42 () {56 vars in 1112 bytes} [Thu Jul 28 09:07:09 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:07:09.980698 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2113e1e0-e7d5-4155-8d1b-f0760b3322f0 None admin] Authenticating user token {{(pid=416293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:07:09.991379 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG dbcounter [-] [416293] Writing DB stats keystone:SELECT=100 {{(pid=416293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:07:10.014434 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc5fa3d8-9f4d-4457-9734-f58c8c087a53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:07:10.015219 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5fa3d8-9f4d-4457-9734-f58c8c087a53 None admin] REQUEST_METHOD: `GET` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:07:10.015578 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5fa3d8-9f4d-4457-9734-f58c8c087a53 None admin] SCRIPT_NAME: `/identity` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:07:10.015929 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5fa3d8-9f4d-4457-9734-f58c8c087a53 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:07:10.029599 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc5fa3d8-9f4d-4457-9734-f58c8c087a53 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 09:07:10.035851 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application [None req-bc5fa3d8-9f4d-4457-9734-f58c8c087a53 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 28 09:07:10.035851 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 09:07:10.035851 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 09:07:10.035851 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 09:07:10.035851 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 09:07:10.035851 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 09:07:10.035851 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 09:07:10.035851 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 09:07:10.035851 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 09:07:10.035851 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 09:07:10.035851 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 09:07:10.035851 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 09:07:10.035851 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 09:07:10.035851 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 09:07:10.035851 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 09:07:10.035851 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 09:07:10.037226 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 09:07:10.037226 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 09:07:10.037226 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 09:07:10.037226 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 09:07:10.037226 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 09:07:10.037226 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 09:07:10.037226 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 09:07:10.037226 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 09:07:10.037226 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 09:07:10.037226 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 09:07:10.037226 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 09:07:10.037226 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application with Lock( Jul 28 09:07:10.037226 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 09:07:10.037226 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return self._enter() Jul 28 09:07:10.037226 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 09:07:10.037226 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 09:07:10.038398 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 09:07:10.038398 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return self.creator() Jul 28 09:07:10.038398 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 09:07:10.038398 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application created_value = creator( Jul 28 09:07:10.038398 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 09:07:10.038398 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 09:07:10.038398 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 09:07:10.038398 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 09:07:10.038398 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 09:07:10.038398 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 09:07:10.038398 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 28 09:07:10.038398 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application Jul 28 09:07:10.039341 dv-cinder-851351-1-smb devstack@keystone.service[416294]: [pid: 416294|app: 0|req: 477/943] 10.222.0.42 () {56 vars in 1120 bytes} [Thu Jul 28 09:07:09 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 09:07:10.044580 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc5fa3d8-9f4d-4457-9734-f58c8c087a53 None admin] Authenticating user token {{(pid=416294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:07:10.050079 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG dbcounter [-] [416294] Writing DB stats keystone:SELECT=100 {{(pid=416294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:07:10.132056 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2113e1e0-e7d5-4155-8d1b-f0760b3322f0 None admin] Validating token access rules against request {{(pid=416293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:07:10.186222 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea5231aa-d34f-44b8-8f95-37d9c3892240 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:07:10.187072 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5231aa-d34f-44b8-8f95-37d9c3892240 None admin] REQUEST_METHOD: `GET` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:07:10.187760 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5231aa-d34f-44b8-8f95-37d9c3892240 None admin] SCRIPT_NAME: `/identity` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:07:10.188167 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5231aa-d34f-44b8-8f95-37d9c3892240 None admin] PATH_INFO: `/v3/services` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:07:10.188955 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea5231aa-d34f-44b8-8f95-37d9c3892240 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:07:10.190479 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea5231aa-d34f-44b8-8f95-37d9c3892240 None admin] RBAC: Authorization granted {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:07:10.198017 dv-cinder-851351-1-smb devstack@keystone.service[416293]: [pid: 416293|app: 0|req: 467/944] 10.222.0.42 () {56 vars in 1087 bytes} [Thu Jul 28 09:07:09 2022] GET /identity/v3/services => generated 1497 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 09:07:10.200247 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc5fa3d8-9f4d-4457-9734-f58c8c087a53 None admin] Validating token access rules against request {{(pid=416294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:07:10.244071 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce9df62-1568-453b-8ef2-207cb0f51358 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:07:10.245086 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce9df62-1568-453b-8ef2-207cb0f51358 None admin] REQUEST_METHOD: `GET` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:07:10.245528 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce9df62-1568-453b-8ef2-207cb0f51358 None admin] SCRIPT_NAME: `/identity` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:07:10.245961 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce9df62-1568-453b-8ef2-207cb0f51358 None admin] PATH_INFO: `/v3/roles` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:07:10.246893 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce9df62-1568-453b-8ef2-207cb0f51358 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=416294) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 09:07:10.247360 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce9df62-1568-453b-8ef2-207cb0f51358 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:07:10.249243 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce9df62-1568-453b-8ef2-207cb0f51358 None admin] RBAC: Authorization granted {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:07:10.260276 dv-cinder-851351-1-smb devstack@keystone.service[416294]: [pid: 416294|app: 0|req: 478/945] 10.222.0.42 () {56 vars in 1115 bytes} [Thu Jul 28 09:07:10 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 09:07:10.266730 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea5231aa-d34f-44b8-8f95-37d9c3892240 None admin] Authenticating user token {{(pid=416293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:07:10.358311 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG dbcounter [-] [416293] Writing DB stats keystone:SELECT=100 {{(pid=416293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:07:10.401184 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea5231aa-d34f-44b8-8f95-37d9c3892240 None admin] Validating token access rules against request {{(pid=416293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:07:10.445864 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db895c51-17b2-4d8d-8e70-8b7d699aae77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:07:10.446786 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db895c51-17b2-4d8d-8e70-8b7d699aae77 None admin] REQUEST_METHOD: `GET` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:07:10.447242 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db895c51-17b2-4d8d-8e70-8b7d699aae77 None admin] SCRIPT_NAME: `/identity` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:07:10.447674 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db895c51-17b2-4d8d-8e70-8b7d699aae77 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:07:10.460346 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db895c51-17b2-4d8d-8e70-8b7d699aae77 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:07:10.462152 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db895c51-17b2-4d8d-8e70-8b7d699aae77 None admin] RBAC: Authorization granted {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:07:10.482760 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application [None req-db895c51-17b2-4d8d-8e70-8b7d699aae77 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 09:07:10.482760 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 09:07:10.482760 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 09:07:10.482760 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 09:07:10.482760 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 09:07:10.482760 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 09:07:10.482760 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 09:07:10.482760 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 09:07:10.482760 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 09:07:10.482760 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 09:07:10.482760 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 09:07:10.482760 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 09:07:10.482760 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 09:07:10.482760 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 09:07:10.482760 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 09:07:10.483847 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 09:07:10.483847 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 09:07:10.483847 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 09:07:10.483847 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 09:07:10.483847 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 09:07:10.483847 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 09:07:10.483847 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 09:07:10.483847 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 09:07:10.483847 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application with Lock( Jul 28 09:07:10.483847 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 09:07:10.483847 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self._enter() Jul 28 09:07:10.483847 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 09:07:10.483847 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 09:07:10.483847 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 09:07:10.483847 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self.creator() Jul 28 09:07:10.483847 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 09:07:10.483847 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application created_value = creator( Jul 28 09:07:10.484907 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 09:07:10.484907 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 09:07:10.484907 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 09:07:10.484907 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application Jul 28 09:07:10.484907 dv-cinder-851351-1-smb devstack@keystone.service[416293]: [pid: 416293|app: 0|req: 468/946] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 09:07:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 09:07:10.491697 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce9df62-1568-453b-8ef2-207cb0f51358 None admin] Authenticating user token {{(pid=416294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:07:10.502105 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6613ac-0a3d-4abc-8089-e32daa95c575 None None] REQUEST_METHOD: `GET` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:07:10.502439 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6613ac-0a3d-4abc-8089-e32daa95c575 None None] SCRIPT_NAME: `/identity` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:07:10.502662 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6613ac-0a3d-4abc-8089-e32daa95c575 None None] PATH_INFO: `/` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:07:10.504591 dv-cinder-851351-1-smb devstack@keystone.service[416293]: [pid: 416293|app: 0|req: 469/947] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 09:07:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 28 09:07:10.510345 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17460c6c-115e-473e-9167-5d9f6ae84ff3 None None] REQUEST_METHOD: `POST` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:07:10.510653 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17460c6c-115e-473e-9167-5d9f6ae84ff3 None None] SCRIPT_NAME: `/identity` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:07:10.511013 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17460c6c-115e-473e-9167-5d9f6ae84ff3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:07:10.537927 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.auth.core [None req-17460c6c-115e-473e-9167-5d9f6ae84ff3 None None] MFA Rules not processed for user `dbf87abab90e4fdf9e75408f4199918e`. Rule list: `[]` (Enabled: `True`). {{(pid=416293) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 09:07:10.540323 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.fernet_utils [None req-17460c6c-115e-473e-9167-5d9f6ae84ff3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=416293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 09:07:10.569048 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG dbcounter [-] [416294] Writing DB stats keystone:SELECT=100 {{(pid=416294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:07:10.629487 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce9df62-1568-453b-8ef2-207cb0f51358 None admin] Validating token access rules against request {{(pid=416294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:07:10.632760 dv-cinder-851351-1-smb devstack@keystone.service[416293]: [pid: 416293|app: 0|req: 470/948] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 09:07:10 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 09:07:10.659534 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17460c6c-115e-473e-9167-5d9f6ae84ff3 None None] Authenticating user token {{(pid=416293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:07:10.679308 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27606e0f-2e4f-481e-a342-7c2f6155ad23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:07:10.680034 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27606e0f-2e4f-481e-a342-7c2f6155ad23 None admin] REQUEST_METHOD: `GET` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:07:10.680320 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27606e0f-2e4f-481e-a342-7c2f6155ad23 None admin] SCRIPT_NAME: `/identity` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:07:10.680653 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27606e0f-2e4f-481e-a342-7c2f6155ad23 None admin] PATH_INFO: `/v3/domains` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:07:10.681403 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27606e0f-2e4f-481e-a342-7c2f6155ad23 None admin] RBAC: Adding query filter params (name=Default) {{(pid=416294) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 09:07:10.681709 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27606e0f-2e4f-481e-a342-7c2f6155ad23 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:07:10.683576 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27606e0f-2e4f-481e-a342-7c2f6155ad23 None admin] RBAC: Authorization granted {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:07:10.701193 dv-cinder-851351-1-smb devstack@keystone.service[416294]: [pid: 416294|app: 0|req: 479/949] 10.222.0.42 () {56 vars in 1109 bytes} [Thu Jul 28 09:07:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:07:10.707118 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27606e0f-2e4f-481e-a342-7c2f6155ad23 None admin] Authenticating user token {{(pid=416294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:07:10.728519 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG dbcounter [-] [416293] Writing DB stats keystone:SELECT=100 {{(pid=416293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:07:10.786487 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17460c6c-115e-473e-9167-5d9f6ae84ff3 None None] Validating token access rules against request {{(pid=416293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:07:10.817260 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27606e0f-2e4f-481e-a342-7c2f6155ad23 None admin] Validating token access rules against request {{(pid=416294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:07:10.828418 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e50508e-3821-428e-ab5b-f5f8666ae35d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:07:10.829598 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e50508e-3821-428e-ab5b-f5f8666ae35d None admin] REQUEST_METHOD: `POST` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:07:10.830179 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e50508e-3821-428e-ab5b-f5f8666ae35d None admin] SCRIPT_NAME: `/identity` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:07:10.830699 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e50508e-3821-428e-ab5b-f5f8666ae35d None admin] PATH_INFO: `/v3/users` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:07:10.831620 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e50508e-3821-428e-ab5b-f5f8666ae35d None admin] RBAC: Authorizing `identity:create_user()` {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:07:10.833400 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e50508e-3821-428e-ab5b-f5f8666ae35d None admin] RBAC: Authorization granted {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:07:10.844227 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG dbcounter [-] [416294] Writing DB stats keystone:SELECT=100 {{(pid=416294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:07:10.852314 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.sql.core [None req-4e50508e-3821-428e-ab5b-f5f8666ae35d None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jul 28 09:07:10.852314 dv-cinder-851351-1-smb devstack@keystone.service[416293]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Jul 28 09:07:10.852314 dv-cinder-851351-1-smb devstack@keystone.service[416293]: [parameters: {'user_id': 'af8ff74398364097b03faa64fc63b7d7', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Jul 28 09:07:10.852314 dv-cinder-851351-1-smb devstack@keystone.service[416293]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=416293) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jul 28 09:07:10.858113 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2585889f-9097-4577-911c-0c30df3306a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:07:10.858855 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2585889f-9097-4577-911c-0c30df3306a3 None admin] REQUEST_METHOD: `GET` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:07:10.859138 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2585889f-9097-4577-911c-0c30df3306a3 None admin] SCRIPT_NAME: `/identity` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:07:10.859414 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2585889f-9097-4577-911c-0c30df3306a3 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:07:10.862262 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application [None req-4e50508e-3821-428e-ab5b-f5f8666ae35d None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Jul 28 09:07:10.862262 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 09:07:10.862262 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 28 09:07:10.862262 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 28 09:07:10.862262 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 28 09:07:10.862262 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 28 09:07:10.862262 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 28 09:07:10.862262 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application result = self._query(query) Jul 28 09:07:10.862262 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 28 09:07:10.862262 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application conn.query(q) Jul 28 09:07:10.862262 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 28 09:07:10.862262 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 28 09:07:10.862262 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 28 09:07:10.862262 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application result.read() Jul 28 09:07:10.862262 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 28 09:07:10.863332 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 28 09:07:10.863332 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 28 09:07:10.863332 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 28 09:07:10.863332 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 28 09:07:10.863332 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 28 09:07:10.863332 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 28 09:07:10.863332 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 28 09:07:10.863332 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jul 28 09:07:10.863332 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application Jul 28 09:07:10.863332 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jul 28 09:07:10.863332 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application Jul 28 09:07:10.863332 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 09:07:10.863332 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jul 28 09:07:10.863332 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jul 28 09:07:10.863332 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Jul 28 09:07:10.863332 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Jul 28 09:07:10.863332 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 28 09:07:10.863332 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application next(self.gen) Jul 28 09:07:10.864459 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jul 28 09:07:10.864459 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application yield resource Jul 28 09:07:10.864459 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 28 09:07:10.864459 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application next(self.gen) Jul 28 09:07:10.864459 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jul 28 09:07:10.864459 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application self.session.rollback() Jul 28 09:07:10.864459 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 28 09:07:10.864459 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application self.force_reraise() Jul 28 09:07:10.864459 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 28 09:07:10.864459 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application raise self.value Jul 28 09:07:10.864459 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jul 28 09:07:10.864459 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jul 28 09:07:10.864459 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jul 28 09:07:10.864459 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application session.commit() Jul 28 09:07:10.864459 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jul 28 09:07:10.864459 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jul 28 09:07:10.864459 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jul 28 09:07:10.866350 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application self._prepare_impl() Jul 28 09:07:10.866350 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jul 28 09:07:10.866350 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application self.session.flush() Jul 28 09:07:10.866350 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jul 28 09:07:10.866350 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application self._flush(objects) Jul 28 09:07:10.866350 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jul 28 09:07:10.866350 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jul 28 09:07:10.866350 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jul 28 09:07:10.866350 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application compat.raise_( Jul 28 09:07:10.866350 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 28 09:07:10.866350 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application raise exception Jul 28 09:07:10.866350 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jul 28 09:07:10.866350 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application flush_context.execute() Jul 28 09:07:10.866350 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jul 28 09:07:10.866350 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application rec.execute(self) Jul 28 09:07:10.866350 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jul 28 09:07:10.866350 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jul 28 09:07:10.867424 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jul 28 09:07:10.867424 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application _emit_insert_statements( Jul 28 09:07:10.867424 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Jul 28 09:07:10.867424 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application result = connection._execute_20( Jul 28 09:07:10.867424 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jul 28 09:07:10.867424 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jul 28 09:07:10.867424 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Jul 28 09:07:10.867424 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jul 28 09:07:10.867424 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jul 28 09:07:10.867424 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application ret = self._execute_context( Jul 28 09:07:10.867424 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jul 28 09:07:10.867424 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jul 28 09:07:10.867424 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jul 28 09:07:10.867424 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jul 28 09:07:10.867424 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 28 09:07:10.867424 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application raise exception Jul 28 09:07:10.869126 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 28 09:07:10.869126 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 28 09:07:10.869126 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 28 09:07:10.869126 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 28 09:07:10.869126 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 28 09:07:10.869126 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application result = self._query(query) Jul 28 09:07:10.869126 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 28 09:07:10.869126 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application conn.query(q) Jul 28 09:07:10.869126 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 28 09:07:10.869126 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 28 09:07:10.869126 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 28 09:07:10.869126 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application result.read() Jul 28 09:07:10.869126 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 28 09:07:10.869126 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 28 09:07:10.869126 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 28 09:07:10.869126 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 28 09:07:10.871923 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 28 09:07:10.871923 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 28 09:07:10.871923 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 28 09:07:10.871923 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 28 09:07:10.871923 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jul 28 09:07:10.871923 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Jul 28 09:07:10.871923 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application [parameters: {'user_id': 'af8ff74398364097b03faa64fc63b7d7', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Jul 28 09:07:10.871923 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jul 28 09:07:10.871923 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application Jul 28 09:07:10.871923 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 28 09:07:10.871923 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application Jul 28 09:07:10.871923 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 09:07:10.871923 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 09:07:10.871923 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 09:07:10.871923 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 09:07:10.874274 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 09:07:10.874274 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 09:07:10.874274 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 09:07:10.874274 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 09:07:10.874274 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 09:07:10.874274 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 09:07:10.874274 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 09:07:10.874274 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Jul 28 09:07:10.874274 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Jul 28 09:07:10.874274 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 09:07:10.874274 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 09:07:10.874274 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 28 09:07:10.874274 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 09:07:10.874274 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 28 09:07:10.874274 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 09:07:10.874274 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Jul 28 09:07:10.874274 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Jul 28 09:07:10.884093 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Jul 28 09:07:10.884093 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Jul 28 09:07:10.884093 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jul 28 09:07:10.884093 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jul 28 09:07:10.884093 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Jul 28 09:07:10.884093 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application Jul 28 09:07:10.885107 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2585889f-9097-4577-911c-0c30df3306a3 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:07:10.885107 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2585889f-9097-4577-911c-0c30df3306a3 None admin] RBAC: Authorization granted {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:07:10.885107 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application [None req-2585889f-9097-4577-911c-0c30df3306a3 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 28 09:07:10.885107 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 09:07:10.885107 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 09:07:10.885107 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 09:07:10.885107 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 09:07:10.885107 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 09:07:10.885107 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 09:07:10.885107 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 09:07:10.885107 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 09:07:10.885107 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 09:07:10.887214 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 09:07:10.887214 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 09:07:10.887214 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 28 09:07:10.887214 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 28 09:07:10.887214 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 28 09:07:10.887214 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 28 09:07:10.887214 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 09:07:10.887214 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 09:07:10.887214 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 28 09:07:10.887214 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 09:07:10.887214 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 28 09:07:10.887214 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 09:07:10.887214 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 09:07:10.887214 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 09:07:10.887214 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 09:07:10.887214 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 09:07:10.887214 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 09:07:10.887214 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application with Lock( Jul 28 09:07:10.891248 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 09:07:10.891248 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return self._enter() Jul 28 09:07:10.891248 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 09:07:10.891248 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 09:07:10.891248 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 09:07:10.891248 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return self.creator() Jul 28 09:07:10.891248 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 09:07:10.891248 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application created_value = creator( Jul 28 09:07:10.891248 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 28 09:07:10.891248 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 28 09:07:10.891248 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 28 09:07:10.891248 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 28 09:07:10.891248 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 28 09:07:10.891248 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 28 09:07:10.891248 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 28 09:07:10.891248 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application Jul 28 09:07:10.892633 dv-cinder-851351-1-smb devstack@keystone.service[416293]: [pid: 416293|app: 0|req: 471/951] 10.222.0.42 () {60 vars in 1131 bytes} [Thu Jul 28 09:07:10 2022] POST /identity/v3/users => generated 160 bytes in 229 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Jul 28 09:07:10.892941 dv-cinder-851351-1-smb devstack@keystone.service[416294]: [pid: 416294|app: 0|req: 480/951] 10.222.0.42 () {56 vars in 1117 bytes} [Thu Jul 28 09:07:10 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 09:07:10.892941 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2585889f-9097-4577-911c-0c30df3306a3 None admin] Authenticating user token {{(pid=416294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:07:10.894230 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e50508e-3821-428e-ab5b-f5f8666ae35d None admin] Authenticating user token {{(pid=416293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:07:11.059481 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e50508e-3821-428e-ab5b-f5f8666ae35d None admin] Validating token access rules against request {{(pid=416293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:07:11.064567 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2585889f-9097-4577-911c-0c30df3306a3 None admin] Validating token access rules against request {{(pid=416294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:07:11.082690 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG dbcounter [-] [416293] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=416293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:07:11.115397 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796357ca-1f51-4cf4-99f0-139cccdc9936 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:07:11.116424 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b9d100-de77-4667-a65c-8baa1a61f6d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:07:11.116653 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796357ca-1f51-4cf4-99f0-139cccdc9936 None admin] REQUEST_METHOD: `GET` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:07:11.117108 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796357ca-1f51-4cf4-99f0-139cccdc9936 None admin] SCRIPT_NAME: `/identity` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:07:11.117512 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b9d100-de77-4667-a65c-8baa1a61f6d1 None admin] REQUEST_METHOD: `GET` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:07:11.117807 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796357ca-1f51-4cf4-99f0-139cccdc9936 None admin] PATH_INFO: `/v3/users` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:07:11.117953 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b9d100-de77-4667-a65c-8baa1a61f6d1 None admin] SCRIPT_NAME: `/identity` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:07:11.118333 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b9d100-de77-4667-a65c-8baa1a61f6d1 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:07:11.119074 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-796357ca-1f51-4cf4-99f0-139cccdc9936 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=416294) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 09:07:11.119607 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-796357ca-1f51-4cf4-99f0-139cccdc9936 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:07:11.121682 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-796357ca-1f51-4cf4-99f0-139cccdc9936 None admin] RBAC: Authorization granted {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:07:11.129256 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10b9d100-de77-4667-a65c-8baa1a61f6d1 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:07:11.132222 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10b9d100-de77-4667-a65c-8baa1a61f6d1 None admin] RBAC: Authorization granted {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:07:11.153665 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application [None req-10b9d100-de77-4667-a65c-8baa1a61f6d1 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jul 28 09:07:11.153665 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 09:07:11.153665 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 09:07:11.153665 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 09:07:11.153665 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 09:07:11.153665 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 09:07:11.153665 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 09:07:11.153665 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 09:07:11.153665 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 09:07:11.153665 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 09:07:11.153665 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 09:07:11.153665 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 09:07:11.153665 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 28 09:07:11.153665 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 28 09:07:11.153665 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 28 09:07:11.153665 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 28 09:07:11.155989 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 09:07:11.155989 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 09:07:11.155989 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 28 09:07:11.155989 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 09:07:11.155989 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 28 09:07:11.155989 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 09:07:11.155989 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 09:07:11.155989 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 09:07:11.155989 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 09:07:11.155989 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 09:07:11.155989 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 09:07:11.155989 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application with Lock( Jul 28 09:07:11.155989 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 09:07:11.155989 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self._enter() Jul 28 09:07:11.155989 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 09:07:11.155989 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 09:07:11.155989 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 09:07:11.155989 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self.creator() Jul 28 09:07:11.157365 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 09:07:11.157365 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application created_value = creator( Jul 28 09:07:11.157365 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 28 09:07:11.157365 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 28 09:07:11.157365 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 28 09:07:11.157365 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 28 09:07:11.157365 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 28 09:07:11.157365 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 28 09:07:11.157365 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jul 28 09:07:11.157365 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application Jul 28 09:07:11.160092 dv-cinder-851351-1-smb devstack@keystone.service[416293]: [pid: 416293|app: 0|req: 472/952] 10.222.0.42 () {56 vars in 1099 bytes} [Thu Jul 28 09:07:10 2022] GET /identity/v3/users/cinder => generated 84 bytes in 271 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 09:07:11.162564 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b9d100-de77-4667-a65c-8baa1a61f6d1 None admin] Authenticating user token {{(pid=416293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:07:11.168332 dv-cinder-851351-1-smb devstack@keystone.service[416294]: [pid: 416294|app: 0|req: 481/953] 10.222.0.42 () {56 vars in 1149 bytes} [Thu Jul 28 09:07:10 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:07:11.174676 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796357ca-1f51-4cf4-99f0-139cccdc9936 None admin] Authenticating user token {{(pid=416294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:07:11.237160 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG dbcounter [-] [416294] Writing DB stats keystone:SELECT=100 {{(pid=416294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:07:11.293881 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796357ca-1f51-4cf4-99f0-139cccdc9936 None admin] Validating token access rules against request {{(pid=416294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:07:11.309800 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b9d100-de77-4667-a65c-8baa1a61f6d1 None admin] Validating token access rules against request {{(pid=416293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:07:11.331591 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6975d4ad-ca11-4736-bf20-2d9d95f2c383 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:07:11.332603 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6975d4ad-ca11-4736-bf20-2d9d95f2c383 None admin] REQUEST_METHOD: `GET` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:07:11.333159 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6975d4ad-ca11-4736-bf20-2d9d95f2c383 None admin] SCRIPT_NAME: `/identity` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:07:11.333669 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6975d4ad-ca11-4736-bf20-2d9d95f2c383 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:07:11.345836 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6975d4ad-ca11-4736-bf20-2d9d95f2c383 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:07:11.347785 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6975d4ad-ca11-4736-bf20-2d9d95f2c383 None admin] RBAC: Authorization granted {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:07:11.360100 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4167ee18-04fe-44eb-9a8e-dc03da565a9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:07:11.360785 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4167ee18-04fe-44eb-9a8e-dc03da565a9a None admin] REQUEST_METHOD: `GET` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:07:11.361075 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4167ee18-04fe-44eb-9a8e-dc03da565a9a None admin] SCRIPT_NAME: `/identity` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:07:11.361356 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4167ee18-04fe-44eb-9a8e-dc03da565a9a None admin] PATH_INFO: `/v3/users` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:07:11.362140 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4167ee18-04fe-44eb-9a8e-dc03da565a9a None admin] RBAC: Adding query filter params (name=cinder) {{(pid=416293) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 09:07:11.362451 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4167ee18-04fe-44eb-9a8e-dc03da565a9a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:07:11.363900 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4167ee18-04fe-44eb-9a8e-dc03da565a9a None admin] RBAC: Authorization granted {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:07:11.366423 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application [None req-6975d4ad-ca11-4736-bf20-2d9d95f2c383 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 09:07:11.366423 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 09:07:11.366423 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 09:07:11.366423 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 09:07:11.366423 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 09:07:11.366423 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 09:07:11.366423 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 09:07:11.366423 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 09:07:11.366423 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 09:07:11.366423 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 09:07:11.366423 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 09:07:11.366423 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 09:07:11.366423 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 09:07:11.366423 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 09:07:11.366423 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 09:07:11.367435 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 09:07:11.367435 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 09:07:11.367435 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 09:07:11.367435 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 09:07:11.367435 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 09:07:11.367435 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 09:07:11.367435 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 09:07:11.367435 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 09:07:11.367435 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application with Lock( Jul 28 09:07:11.367435 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 09:07:11.367435 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return self._enter() Jul 28 09:07:11.367435 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 09:07:11.367435 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 09:07:11.367435 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 09:07:11.367435 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return self.creator() Jul 28 09:07:11.367435 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 09:07:11.367435 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application created_value = creator( Jul 28 09:07:11.368437 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 09:07:11.368437 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 09:07:11.368437 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 09:07:11.368437 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application Jul 28 09:07:11.375294 dv-cinder-851351-1-smb devstack@keystone.service[416294]: [pid: 416294|app: 0|req: 482/954] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 09:07:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 09:07:11.376499 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6975d4ad-ca11-4736-bf20-2d9d95f2c383 None admin] Authenticating user token {{(pid=416294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:07:11.412698 dv-cinder-851351-1-smb devstack@keystone.service[416293]: [pid: 416293|app: 0|req: 473/955] 10.222.0.42 () {56 vars in 1101 bytes} [Thu Jul 28 09:07:11 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:07:11.500253 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG dbcounter [-] [416294] Writing DB stats keystone:SELECT=100 {{(pid=416294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:07:11.514175 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6975d4ad-ca11-4736-bf20-2d9d95f2c383 None admin] Validating token access rules against request {{(pid=416294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:07:11.580027 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07547fdf-dabf-41d5-8461-06905a14c519 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:07:11.581163 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07547fdf-dabf-41d5-8461-06905a14c519 None admin] REQUEST_METHOD: `GET` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:07:11.581691 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07547fdf-dabf-41d5-8461-06905a14c519 None admin] SCRIPT_NAME: `/identity` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:07:11.582170 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07547fdf-dabf-41d5-8461-06905a14c519 None admin] PATH_INFO: `/v3/domains` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:07:11.583409 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07547fdf-dabf-41d5-8461-06905a14c519 None admin] RBAC: Adding query filter params (name=Default) {{(pid=416294) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 09:07:11.583944 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07547fdf-dabf-41d5-8461-06905a14c519 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:07:11.586561 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07547fdf-dabf-41d5-8461-06905a14c519 None admin] RBAC: Authorization granted {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:07:11.609077 dv-cinder-851351-1-smb devstack@keystone.service[416294]: [pid: 416294|app: 0|req: 483/956] 10.222.0.42 () {56 vars in 1109 bytes} [Thu Jul 28 09:07:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:07:11.614865 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4167ee18-04fe-44eb-9a8e-dc03da565a9a None admin] Authenticating user token {{(pid=416293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:07:11.653006 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG dbcounter [-] [416293] Writing DB stats keystone:SELECT=100 {{(pid=416293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:07:11.725601 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4167ee18-04fe-44eb-9a8e-dc03da565a9a None admin] Validating token access rules against request {{(pid=416293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:07:11.761691 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789015a9-8708-48b4-92fa-3c15af4f9e4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:07:11.762273 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789015a9-8708-48b4-92fa-3c15af4f9e4a None admin] REQUEST_METHOD: `GET` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:07:11.762559 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789015a9-8708-48b4-92fa-3c15af4f9e4a None admin] SCRIPT_NAME: `/identity` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:07:11.762839 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789015a9-8708-48b4-92fa-3c15af4f9e4a None admin] PATH_INFO: `/v3/projects/service` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:07:11.770301 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-789015a9-8708-48b4-92fa-3c15af4f9e4a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:07:11.771822 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-789015a9-8708-48b4-92fa-3c15af4f9e4a None admin] RBAC: Authorization granted {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:07:11.784055 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application [None req-789015a9-8708-48b4-92fa-3c15af4f9e4a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 09:07:11.784055 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 09:07:11.784055 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 09:07:11.784055 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 09:07:11.784055 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 09:07:11.784055 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 09:07:11.784055 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 09:07:11.784055 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 09:07:11.784055 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 09:07:11.784055 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 09:07:11.784055 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 09:07:11.784055 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 09:07:11.784055 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 28 09:07:11.784055 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 28 09:07:11.784055 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 28 09:07:11.785135 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 28 09:07:11.785135 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 09:07:11.785135 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 09:07:11.785135 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 09:07:11.785135 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 09:07:11.785135 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 09:07:11.785135 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 09:07:11.785135 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 09:07:11.785135 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application with Lock( Jul 28 09:07:11.785135 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 09:07:11.785135 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self._enter() Jul 28 09:07:11.785135 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 09:07:11.785135 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 09:07:11.785135 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 09:07:11.785135 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self.creator() Jul 28 09:07:11.785135 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 09:07:11.785135 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application created_value = creator( Jul 28 09:07:11.786183 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 28 09:07:11.786183 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 28 09:07:11.786183 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 28 09:07:11.786183 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 28 09:07:11.786183 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 28 09:07:11.786183 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 28 09:07:11.786183 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 09:07:11.786183 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application Jul 28 09:07:11.786183 dv-cinder-851351-1-smb devstack@keystone.service[416293]: [pid: 416293|app: 0|req: 474/957] 10.222.0.42 () {56 vars in 1111 bytes} [Thu Jul 28 09:07:11 2022] GET /identity/v3/projects/service => generated 88 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 09:07:11.791368 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07547fdf-dabf-41d5-8461-06905a14c519 None admin] Authenticating user token {{(pid=416294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:07:11.919664 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07547fdf-dabf-41d5-8461-06905a14c519 None admin] Validating token access rules against request {{(pid=416294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:07:11.975567 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0454539-9147-4384-a3aa-4391c4293802 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:07:11.976215 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0454539-9147-4384-a3aa-4391c4293802 None admin] REQUEST_METHOD: `GET` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:07:11.976503 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0454539-9147-4384-a3aa-4391c4293802 None admin] SCRIPT_NAME: `/identity` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:07:11.976813 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0454539-9147-4384-a3aa-4391c4293802 None admin] PATH_INFO: `/v3/projects` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:07:11.977614 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0454539-9147-4384-a3aa-4391c4293802 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=416294) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 09:07:11.977897 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0454539-9147-4384-a3aa-4391c4293802 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:07:11.979370 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0454539-9147-4384-a3aa-4391c4293802 None admin] RBAC: Authorization granted {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:07:11.993099 dv-cinder-851351-1-smb devstack@keystone.service[416294]: [pid: 416294|app: 0|req: 484/958] 10.222.0.42 () {56 vars in 1148 bytes} [Thu Jul 28 09:07:11 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 09:07:11.999068 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789015a9-8708-48b4-92fa-3c15af4f9e4a None admin] Authenticating user token {{(pid=416293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:07:12.096218 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG dbcounter [-] [416293] Writing DB stats keystone:SELECT=100 {{(pid=416293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:07:12.106748 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789015a9-8708-48b4-92fa-3c15af4f9e4a None admin] Validating token access rules against request {{(pid=416293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:07:12.146675 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2cd197-e00e-4b6e-a763-0966d02b2d38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:07:12.147446 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2cd197-e00e-4b6e-a763-0966d02b2d38 None admin] REQUEST_METHOD: `PUT` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:07:12.147738 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2cd197-e00e-4b6e-a763-0966d02b2d38 None admin] SCRIPT_NAME: `/identity` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:07:12.148018 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2cd197-e00e-4b6e-a763-0966d02b2d38 None admin] PATH_INFO: `/v3/projects/6c4349445f224184b093d9dfd0dfc642/users/f5b664bdc0d04af8ac60a11e9a136c91/roles/4d94122535c54ae98fbaf3c8766c59be` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:07:12.150333 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a2cd197-e00e-4b6e-a763-0966d02b2d38 None admin] RBAC: Authorizing `identity:create_grant(project_id=6c4349445f224184b093d9dfd0dfc642, user_id=f5b664bdc0d04af8ac60a11e9a136c91, role_id=4d94122535c54ae98fbaf3c8766c59be)` {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:07:12.151788 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a2cd197-e00e-4b6e-a763-0966d02b2d38 None admin] RBAC: Authorization granted {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:07:12.166993 dv-cinder-851351-1-smb devstack@keystone.service[416293]: [pid: 416293|app: 0|req: 475/959] 10.222.0.42 () {58 vars in 1439 bytes} [Thu Jul 28 09:07:11 2022] PUT /identity/v3/projects/6c4349445f224184b093d9dfd0dfc642/users/f5b664bdc0d04af8ac60a11e9a136c91/roles/4d94122535c54ae98fbaf3c8766c59be => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 09:07:12.182306 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787d048e-7f0a-43f7-9644-0b588269489d None None] REQUEST_METHOD: `GET` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:07:12.182898 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787d048e-7f0a-43f7-9644-0b588269489d None None] SCRIPT_NAME: `/identity` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:07:12.182898 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787d048e-7f0a-43f7-9644-0b588269489d None None] PATH_INFO: `/` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:07:12.184607 dv-cinder-851351-1-smb devstack@keystone.service[416294]: [pid: 416294|app: 0|req: 485/960] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 09:07:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 28 09:07:12.190711 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150725a4-0342-4460-ad95-73a93beff8e6 None None] REQUEST_METHOD: `POST` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:07:12.190995 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150725a4-0342-4460-ad95-73a93beff8e6 None None] SCRIPT_NAME: `/identity` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:07:12.191283 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150725a4-0342-4460-ad95-73a93beff8e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:07:12.214417 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.auth.core [None req-150725a4-0342-4460-ad95-73a93beff8e6 None None] MFA Rules not processed for user `dbf87abab90e4fdf9e75408f4199918e`. Rule list: `[]` (Enabled: `True`). {{(pid=416293) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 09:07:12.216489 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.fernet_utils [None req-150725a4-0342-4460-ad95-73a93beff8e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=416293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 09:07:12.301715 dv-cinder-851351-1-smb devstack@keystone.service[416293]: [pid: 416293|app: 0|req: 476/961] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 09:07:12 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 09:07:12.324931 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787d048e-7f0a-43f7-9644-0b588269489d None None] Authenticating user token {{(pid=416294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:07:12.344971 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG dbcounter [-] [416294] Writing DB stats keystone:SELECT=100 {{(pid=416294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:07:12.439818 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787d048e-7f0a-43f7-9644-0b588269489d None None] Validating token access rules against request {{(pid=416294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:07:12.477902 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402262db-d697-4db3-b6d7-17f0aae8c9d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:07:12.478749 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402262db-d697-4db3-b6d7-17f0aae8c9d6 None admin] REQUEST_METHOD: `POST` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:07:12.479132 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402262db-d697-4db3-b6d7-17f0aae8c9d6 None admin] SCRIPT_NAME: `/identity` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:07:12.479507 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402262db-d697-4db3-b6d7-17f0aae8c9d6 None admin] PATH_INFO: `/v3/services` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:07:12.480313 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-402262db-d697-4db3-b6d7-17f0aae8c9d6 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:07:12.481835 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-402262db-d697-4db3-b6d7-17f0aae8c9d6 None admin] RBAC: Authorization granted {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:07:12.498525 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a257a991-1ecb-42f9-91af-0315ee3b05c7 None None] REQUEST_METHOD: `GET` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:07:12.498818 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a257a991-1ecb-42f9-91af-0315ee3b05c7 None None] SCRIPT_NAME: `/identity` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:07:12.499095 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a257a991-1ecb-42f9-91af-0315ee3b05c7 None None] PATH_INFO: `/` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:07:12.500808 dv-cinder-851351-1-smb devstack@keystone.service[416293]: [pid: 416293|app: 0|req: 477/962] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 09:07:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 28 09:07:12.507109 dv-cinder-851351-1-smb devstack@keystone.service[416294]: [pid: 416294|app: 0|req: 486/963] 10.222.0.42 () {60 vars in 1141 bytes} [Thu Jul 28 09:07:12 2022] POST /identity/v3/services => generated 242 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 09:07:12.507345 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784d48b9-150a-46b9-931d-f206b342c298 None None] REQUEST_METHOD: `POST` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:07:12.507345 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784d48b9-150a-46b9-931d-f206b342c298 None None] SCRIPT_NAME: `/identity` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:07:12.507345 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784d48b9-150a-46b9-931d-f206b342c298 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:07:12.526009 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.auth.core [None req-784d48b9-150a-46b9-931d-f206b342c298 None None] MFA Rules not processed for user `dbf87abab90e4fdf9e75408f4199918e`. Rule list: `[]` (Enabled: `True`). {{(pid=416293) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 09:07:12.527249 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.fernet_utils [None req-784d48b9-150a-46b9-931d-f206b342c298 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=416293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 09:07:12.618889 dv-cinder-851351-1-smb devstack@keystone.service[416293]: [pid: 416293|app: 0|req: 478/964] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 09:07:12 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 28 09:07:12.643058 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402262db-d697-4db3-b6d7-17f0aae8c9d6 None admin] Authenticating user token {{(pid=416294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:07:12.735424 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG dbcounter [-] [416294] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=416294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:07:12.765963 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402262db-d697-4db3-b6d7-17f0aae8c9d6 None admin] Validating token access rules against request {{(pid=416294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:07:12.808030 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0c1ad6-4b4c-4018-a0b0-b5c6ddeb80f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:07:12.808696 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0c1ad6-4b4c-4018-a0b0-b5c6ddeb80f5 None admin] REQUEST_METHOD: `GET` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:07:12.808988 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0c1ad6-4b4c-4018-a0b0-b5c6ddeb80f5 None admin] SCRIPT_NAME: `/identity` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:07:12.809260 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0c1ad6-4b4c-4018-a0b0-b5c6ddeb80f5 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:07:12.809898 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da0c1ad6-4b4c-4018-a0b0-b5c6ddeb80f5 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:07:12.811273 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da0c1ad6-4b4c-4018-a0b0-b5c6ddeb80f5 None admin] RBAC: Authorization granted {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:07:12.821477 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application [None req-da0c1ad6-4b4c-4018-a0b0-b5c6ddeb80f5 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 28 09:07:12.821477 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 09:07:12.821477 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 28 09:07:12.821477 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 28 09:07:12.821477 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 28 09:07:12.821477 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 28 09:07:12.821477 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 28 09:07:12.821477 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 09:07:12.821477 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 28 09:07:12.821477 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application Jul 28 09:07:12.821477 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 28 09:07:12.821477 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application Jul 28 09:07:12.821477 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 09:07:12.821477 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 09:07:12.821477 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 09:07:12.821477 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 09:07:12.821477 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 09:07:12.829549 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 09:07:12.829549 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 09:07:12.829549 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 09:07:12.829549 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 09:07:12.829549 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 09:07:12.829549 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 09:07:12.829549 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 28 09:07:12.829549 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 28 09:07:12.829549 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 28 09:07:12.829549 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 28 09:07:12.829549 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 09:07:12.829549 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 09:07:12.829549 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 09:07:12.829549 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 09:07:12.829549 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 09:07:12.829549 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 09:07:12.835309 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 09:07:12.835309 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application with Lock( Jul 28 09:07:12.835309 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 09:07:12.835309 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return self._enter() Jul 28 09:07:12.835309 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 09:07:12.835309 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 09:07:12.835309 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 09:07:12.835309 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return self.creator() Jul 28 09:07:12.835309 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 09:07:12.835309 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application created_value = creator( Jul 28 09:07:12.835309 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 28 09:07:12.835309 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 09:07:12.835309 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 28 09:07:12.835309 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application Jul 28 09:07:12.835309 dv-cinder-851351-1-smb devstack@keystone.service[416294]: [pid: 416294|app: 0|req: 487/965] 10.222.0.42 () {56 vars in 1126 bytes} [Thu Jul 28 09:07:12 2022] GET /identity/v3/services/object-store => generated 93 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 09:07:12.838878 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784d48b9-150a-46b9-931d-f206b342c298 None None] Authenticating user token {{(pid=416293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:07:12.849715 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG dbcounter [-] [416293] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=416293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:07:12.970935 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784d48b9-150a-46b9-931d-f206b342c298 None None] Validating token access rules against request {{(pid=416293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:07:13.014617 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ca6503-b680-42f1-9964-e40de66de177 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:07:13.015171 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ca6503-b680-42f1-9964-e40de66de177 None admin] REQUEST_METHOD: `GET` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:07:13.015453 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ca6503-b680-42f1-9964-e40de66de177 None admin] SCRIPT_NAME: `/identity` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:07:13.015725 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ca6503-b680-42f1-9964-e40de66de177 None admin] PATH_INFO: `/v3/services` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:07:13.016473 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0ca6503-b680-42f1-9964-e40de66de177 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=416293) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 09:07:13.016812 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0ca6503-b680-42f1-9964-e40de66de177 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:07:13.018206 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0ca6503-b680-42f1-9964-e40de66de177 None admin] RBAC: Authorization granted {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:07:13.024179 dv-cinder-851351-1-smb devstack@keystone.service[416293]: [pid: 416293|app: 0|req: 479/966] 10.222.0.42 () {56 vars in 1122 bytes} [Thu Jul 28 09:07:12 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:07:13.030311 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0c1ad6-4b4c-4018-a0b0-b5c6ddeb80f5 None admin] Authenticating user token {{(pid=416294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:07:13.150992 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0c1ad6-4b4c-4018-a0b0-b5c6ddeb80f5 None admin] Validating token access rules against request {{(pid=416294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:07:13.189694 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7601750d-38a2-4309-913d-5593e0a63378 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:07:13.190387 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7601750d-38a2-4309-913d-5593e0a63378 None admin] REQUEST_METHOD: `GET` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:07:13.190645 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7601750d-38a2-4309-913d-5593e0a63378 None admin] SCRIPT_NAME: `/identity` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:07:13.190859 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7601750d-38a2-4309-913d-5593e0a63378 None admin] PATH_INFO: `/v3/services` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:07:13.191563 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7601750d-38a2-4309-913d-5593e0a63378 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=416294) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 09:07:13.191867 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7601750d-38a2-4309-913d-5593e0a63378 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:07:13.193295 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7601750d-38a2-4309-913d-5593e0a63378 None admin] RBAC: Authorization granted {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:07:13.199597 dv-cinder-851351-1-smb devstack@keystone.service[416294]: [pid: 416294|app: 0|req: 488/967] 10.222.0.42 () {56 vars in 1122 bytes} [Thu Jul 28 09:07:13 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:07:13.205564 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ca6503-b680-42f1-9964-e40de66de177 None admin] Authenticating user token {{(pid=416293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:07:13.284125 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG dbcounter [-] [416293] Writing DB stats keystone:SELECT=100 {{(pid=416293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:07:13.318812 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ca6503-b680-42f1-9964-e40de66de177 None admin] Validating token access rules against request {{(pid=416293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:07:13.361517 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9374ad-4d99-4b3e-a15b-170d0b4ca159 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:07:13.362368 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9374ad-4d99-4b3e-a15b-170d0b4ca159 None admin] REQUEST_METHOD: `POST` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:07:13.362774 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9374ad-4d99-4b3e-a15b-170d0b4ca159 None admin] SCRIPT_NAME: `/identity` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:07:13.363144 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9374ad-4d99-4b3e-a15b-170d0b4ca159 None admin] PATH_INFO: `/v3/endpoints` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:07:13.363986 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb9374ad-4d99-4b3e-a15b-170d0b4ca159 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:07:13.365579 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb9374ad-4d99-4b3e-a15b-170d0b4ca159 None admin] RBAC: Authorization granted {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:07:13.396726 dv-cinder-851351-1-smb devstack@keystone.service[416293]: [pid: 416293|app: 0|req: 480/968] 10.222.0.42 () {60 vars in 1144 bytes} [Thu Jul 28 09:07:13 2022] POST /identity/v3/endpoints => generated 349 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 09:07:14.251355 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66802f09-7862-4203-9846-a61fbbdd9a7c None None] REQUEST_METHOD: `GET` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:07:14.251916 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66802f09-7862-4203-9846-a61fbbdd9a7c None None] SCRIPT_NAME: `/identity` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:07:14.251916 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66802f09-7862-4203-9846-a61fbbdd9a7c None None] PATH_INFO: `/` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:07:14.253408 dv-cinder-851351-1-smb devstack@keystone.service[416294]: [pid: 416294|app: 0|req: 489/969] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 09:07:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 09:07:14.258621 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f8770b-c365-4b4f-af67-209d67c9371c None None] REQUEST_METHOD: `POST` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:07:14.259066 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f8770b-c365-4b4f-af67-209d67c9371c None None] SCRIPT_NAME: `/identity` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:07:14.259149 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f8770b-c365-4b4f-af67-209d67c9371c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:07:14.278024 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.auth.core [None req-e6f8770b-c365-4b4f-af67-209d67c9371c None None] MFA Rules not processed for user `dbf87abab90e4fdf9e75408f4199918e`. Rule list: `[]` (Enabled: `True`). {{(pid=416293) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 09:07:14.279235 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.fernet_utils [None req-e6f8770b-c365-4b4f-af67-209d67c9371c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=416293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 09:07:14.359214 dv-cinder-851351-1-smb devstack@keystone.service[416293]: [pid: 416293|app: 0|req: 481/970] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 09:07:14 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 09:07:14.382455 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66802f09-7862-4203-9846-a61fbbdd9a7c None None] Authenticating user token {{(pid=416294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:07:14.385627 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG dbcounter [-] [416294] Writing DB stats keystone:SELECT=100 {{(pid=416294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:07:14.493041 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66802f09-7862-4203-9846-a61fbbdd9a7c None None] Validating token access rules against request {{(pid=416294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:07:14.529450 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929b0a4e-54a4-4633-b9f9-a314653bce48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:07:14.530050 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929b0a4e-54a4-4633-b9f9-a314653bce48 None admin] REQUEST_METHOD: `GET` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:07:14.530338 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929b0a4e-54a4-4633-b9f9-a314653bce48 None admin] SCRIPT_NAME: `/identity` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:07:14.530617 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929b0a4e-54a4-4633-b9f9-a314653bce48 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:07:14.543585 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-929b0a4e-54a4-4633-b9f9-a314653bce48 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 09:07:14.548698 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application [None req-929b0a4e-54a4-4633-b9f9-a314653bce48 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 28 09:07:14.548698 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 09:07:14.548698 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 09:07:14.548698 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 09:07:14.548698 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 09:07:14.548698 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 09:07:14.548698 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 09:07:14.548698 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 09:07:14.548698 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 09:07:14.548698 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 09:07:14.548698 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 09:07:14.548698 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 09:07:14.548698 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 09:07:14.548698 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 09:07:14.548698 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 09:07:14.548698 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 09:07:14.549798 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 09:07:14.549798 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 09:07:14.549798 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 09:07:14.549798 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 09:07:14.549798 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 09:07:14.549798 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 09:07:14.549798 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 09:07:14.549798 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 09:07:14.549798 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 09:07:14.549798 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 09:07:14.549798 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 09:07:14.549798 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application with Lock( Jul 28 09:07:14.549798 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 09:07:14.549798 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return self._enter() Jul 28 09:07:14.549798 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 09:07:14.549798 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 09:07:14.550718 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 09:07:14.550718 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return self.creator() Jul 28 09:07:14.550718 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 09:07:14.550718 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application created_value = creator( Jul 28 09:07:14.550718 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 09:07:14.550718 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 09:07:14.550718 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 09:07:14.550718 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 09:07:14.550718 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 09:07:14.550718 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 09:07:14.550718 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 28 09:07:14.550718 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application Jul 28 09:07:14.552208 dv-cinder-851351-1-smb devstack@keystone.service[416294]: [pid: 416294|app: 0|req: 490/971] 10.222.0.42 () {56 vars in 1120 bytes} [Thu Jul 28 09:07:14 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 09:07:14.556417 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f8770b-c365-4b4f-af67-209d67c9371c None None] Authenticating user token {{(pid=416293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:07:14.590164 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ec6f38-f8c5-446b-840e-bca460e78172 None None] REQUEST_METHOD: `GET` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:07:14.590456 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ec6f38-f8c5-446b-840e-bca460e78172 None None] SCRIPT_NAME: `/identity` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:07:14.590741 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ec6f38-f8c5-446b-840e-bca460e78172 None None] PATH_INFO: `/` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:07:14.592122 dv-cinder-851351-1-smb devstack@keystone.service[416294]: [pid: 416294|app: 0|req: 491/972] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 09:07:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 28 09:07:14.597515 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90ab03f-03cb-4d44-b214-7473fb0fbe13 None None] REQUEST_METHOD: `POST` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:07:14.597804 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90ab03f-03cb-4d44-b214-7473fb0fbe13 None None] SCRIPT_NAME: `/identity` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:07:14.598089 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90ab03f-03cb-4d44-b214-7473fb0fbe13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:07:14.617220 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.auth.core [None req-a90ab03f-03cb-4d44-b214-7473fb0fbe13 None None] MFA Rules not processed for user `dbf87abab90e4fdf9e75408f4199918e`. Rule list: `[]` (Enabled: `True`). {{(pid=416294) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 09:07:14.618461 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.fernet_utils [None req-a90ab03f-03cb-4d44-b214-7473fb0fbe13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=416294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 09:07:14.620208 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG dbcounter [-] [416293] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=416293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:07:14.670993 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f8770b-c365-4b4f-af67-209d67c9371c None None] Validating token access rules against request {{(pid=416293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:07:14.681021 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG dbcounter [-] [416294] Writing DB stats keystone:SELECT=100 {{(pid=416294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:07:14.693161 dv-cinder-851351-1-smb devstack@keystone.service[416294]: [pid: 416294|app: 0|req: 492/973] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 09:07:14 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 28 09:07:14.708077 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ef01ab-8e0f-45ec-92c8-0cda3bbde366 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:07:14.708763 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ef01ab-8e0f-45ec-92c8-0cda3bbde366 None admin] REQUEST_METHOD: `GET` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:07:14.709055 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ef01ab-8e0f-45ec-92c8-0cda3bbde366 None admin] SCRIPT_NAME: `/identity` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:07:14.709388 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ef01ab-8e0f-45ec-92c8-0cda3bbde366 None admin] PATH_INFO: `/v3/roles` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:07:14.710132 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1ef01ab-8e0f-45ec-92c8-0cda3bbde366 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=416293) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 09:07:14.710494 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1ef01ab-8e0f-45ec-92c8-0cda3bbde366 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:07:14.711897 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1ef01ab-8e0f-45ec-92c8-0cda3bbde366 None admin] RBAC: Authorization granted {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:07:14.715966 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a90ab03f-03cb-4d44-b214-7473fb0fbe13 None None] Authenticating user token {{(pid=416294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:07:14.722993 dv-cinder-851351-1-smb devstack@keystone.service[416293]: [pid: 416293|app: 0|req: 482/974] 10.222.0.42 () {56 vars in 1115 bytes} [Thu Jul 28 09:07:14 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:07:14.727671 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ef01ab-8e0f-45ec-92c8-0cda3bbde366 None admin] Authenticating user token {{(pid=416293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:07:14.824517 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a90ab03f-03cb-4d44-b214-7473fb0fbe13 None None] Validating token access rules against request {{(pid=416294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:07:14.840463 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ef01ab-8e0f-45ec-92c8-0cda3bbde366 None admin] Validating token access rules against request {{(pid=416293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:07:14.862427 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG dbcounter [-] [416293] Writing DB stats keystone:SELECT=100 {{(pid=416293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:07:14.868957 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afdf7966-ae35-480e-8afa-35443f006130 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:07:14.869791 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afdf7966-ae35-480e-8afa-35443f006130 None admin] REQUEST_METHOD: `GET` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:07:14.870175 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afdf7966-ae35-480e-8afa-35443f006130 None admin] SCRIPT_NAME: `/identity` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:07:14.870362 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afdf7966-ae35-480e-8afa-35443f006130 None admin] PATH_INFO: `/v3/services/compute` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:07:14.871069 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afdf7966-ae35-480e-8afa-35443f006130 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:07:14.872586 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afdf7966-ae35-480e-8afa-35443f006130 None admin] RBAC: Authorization granted {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:07:14.882763 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application [None req-afdf7966-ae35-480e-8afa-35443f006130 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jul 28 09:07:14.882763 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 09:07:14.882763 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 28 09:07:14.882763 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 28 09:07:14.882763 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 28 09:07:14.882763 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 28 09:07:14.882763 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 28 09:07:14.882763 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 09:07:14.882763 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 28 09:07:14.882763 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application Jul 28 09:07:14.882763 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 28 09:07:14.882763 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application Jul 28 09:07:14.882763 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 09:07:14.882763 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 09:07:14.882763 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 09:07:14.882763 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 09:07:14.882763 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 09:07:14.884071 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 09:07:14.884071 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 09:07:14.884071 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 09:07:14.884071 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 09:07:14.884071 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 09:07:14.884071 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 09:07:14.884071 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 28 09:07:14.884071 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 28 09:07:14.884071 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 28 09:07:14.884071 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 28 09:07:14.884071 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 09:07:14.884071 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 09:07:14.884071 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 09:07:14.884071 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 09:07:14.884071 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 09:07:14.884071 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 09:07:14.885219 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 09:07:14.885219 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application with Lock( Jul 28 09:07:14.885219 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 09:07:14.885219 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return self._enter() Jul 28 09:07:14.885219 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 09:07:14.885219 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 09:07:14.885219 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 09:07:14.885219 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return self.creator() Jul 28 09:07:14.885219 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 09:07:14.885219 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application created_value = creator( Jul 28 09:07:14.885219 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 28 09:07:14.885219 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 09:07:14.885219 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 28 09:07:14.885219 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application Jul 28 09:07:14.885219 dv-cinder-851351-1-smb devstack@keystone.service[416294]: [pid: 416294|app: 0|req: 493/975] 10.222.0.42 () {56 vars in 1111 bytes} [Thu Jul 28 09:07:14 2022] GET /identity/v3/services/compute => generated 88 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 09:07:14.890327 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afdf7966-ae35-480e-8afa-35443f006130 None admin] Authenticating user token {{(pid=416294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:07:14.891866 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58193e23-40a9-4a71-aa51-eb10bb859f40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:07:14.892733 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58193e23-40a9-4a71-aa51-eb10bb859f40 None admin] REQUEST_METHOD: `GET` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:07:14.893194 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58193e23-40a9-4a71-aa51-eb10bb859f40 None admin] SCRIPT_NAME: `/identity` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:07:14.893640 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58193e23-40a9-4a71-aa51-eb10bb859f40 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:07:14.906027 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58193e23-40a9-4a71-aa51-eb10bb859f40 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:07:14.907792 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58193e23-40a9-4a71-aa51-eb10bb859f40 None admin] RBAC: Authorization granted {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:07:14.924717 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application [None req-58193e23-40a9-4a71-aa51-eb10bb859f40 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 09:07:14.924717 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 09:07:14.924717 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 09:07:14.924717 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 09:07:14.924717 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 09:07:14.924717 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 09:07:14.924717 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 09:07:14.924717 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 09:07:14.924717 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 09:07:14.924717 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 09:07:14.924717 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 09:07:14.924717 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 09:07:14.924717 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 09:07:14.924717 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 09:07:14.924717 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 09:07:14.925983 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 09:07:14.925983 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 09:07:14.925983 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 09:07:14.925983 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 09:07:14.925983 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 09:07:14.925983 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 09:07:14.925983 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 09:07:14.925983 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 09:07:14.925983 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application with Lock( Jul 28 09:07:14.925983 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 09:07:14.925983 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self._enter() Jul 28 09:07:14.925983 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 09:07:14.925983 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 09:07:14.925983 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 09:07:14.925983 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self.creator() Jul 28 09:07:14.925983 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 09:07:14.925983 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application created_value = creator( Jul 28 09:07:14.927348 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 09:07:14.927348 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 09:07:14.927348 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 09:07:14.927348 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application Jul 28 09:07:14.931825 dv-cinder-851351-1-smb devstack@keystone.service[416293]: [pid: 416293|app: 0|req: 483/976] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 09:07:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 09:07:14.931825 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58193e23-40a9-4a71-aa51-eb10bb859f40 None admin] Authenticating user token {{(pid=416293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:07:14.955181 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG dbcounter [-] [416294] Writing DB stats keystone:SELECT=100 {{(pid=416294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:07:15.010754 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afdf7966-ae35-480e-8afa-35443f006130 None admin] Validating token access rules against request {{(pid=416294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:07:15.049315 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e72fc9-bdee-4155-add8-f9c256168137 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:07:15.049951 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e72fc9-bdee-4155-add8-f9c256168137 None admin] REQUEST_METHOD: `GET` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:07:15.050237 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e72fc9-bdee-4155-add8-f9c256168137 None admin] SCRIPT_NAME: `/identity` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:07:15.050508 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e72fc9-bdee-4155-add8-f9c256168137 None admin] PATH_INFO: `/v3/services` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:07:15.051205 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86e72fc9-bdee-4155-add8-f9c256168137 None admin] RBAC: Adding query filter params (name=compute) {{(pid=416294) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 09:07:15.051510 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86e72fc9-bdee-4155-add8-f9c256168137 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:07:15.052116 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58193e23-40a9-4a71-aa51-eb10bb859f40 None admin] Validating token access rules against request {{(pid=416293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:07:15.052918 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86e72fc9-bdee-4155-add8-f9c256168137 None admin] RBAC: Authorization granted {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:07:15.063750 dv-cinder-851351-1-smb devstack@keystone.service[416294]: [pid: 416294|app: 0|req: 494/977] 10.222.0.42 () {56 vars in 1112 bytes} [Thu Jul 28 09:07:14 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:07:15.064504 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e72fc9-bdee-4155-add8-f9c256168137 None admin] Authenticating user token {{(pid=416294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:07:15.093662 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8485f82f-1279-4b43-a7c4-0a22614d148d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:07:15.094267 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8485f82f-1279-4b43-a7c4-0a22614d148d None admin] REQUEST_METHOD: `GET` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:07:15.094551 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8485f82f-1279-4b43-a7c4-0a22614d148d None admin] SCRIPT_NAME: `/identity` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:07:15.094826 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8485f82f-1279-4b43-a7c4-0a22614d148d None admin] PATH_INFO: `/v3/domains` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:07:15.095531 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8485f82f-1279-4b43-a7c4-0a22614d148d None admin] RBAC: Adding query filter params (name=Default) {{(pid=416293) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 09:07:15.095835 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8485f82f-1279-4b43-a7c4-0a22614d148d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:07:15.097249 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8485f82f-1279-4b43-a7c4-0a22614d148d None admin] RBAC: Authorization granted {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:07:15.115610 dv-cinder-851351-1-smb devstack@keystone.service[416293]: [pid: 416293|app: 0|req: 484/978] 10.222.0.42 () {56 vars in 1109 bytes} [Thu Jul 28 09:07:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 09:07:15.116843 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8485f82f-1279-4b43-a7c4-0a22614d148d None admin] Authenticating user token {{(pid=416293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:07:15.149813 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG dbcounter [-] [416293] Writing DB stats keystone:SELECT=100 {{(pid=416293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:07:15.195850 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e72fc9-bdee-4155-add8-f9c256168137 None admin] Validating token access rules against request {{(pid=416294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:07:15.221776 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG dbcounter [-] [416294] Writing DB stats keystone:SELECT=100 {{(pid=416294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:07:15.238855 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c51bef7-5435-4f5b-bf20-dabf850d931d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:07:15.239498 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c51bef7-5435-4f5b-bf20-dabf850d931d None admin] REQUEST_METHOD: `GET` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:07:15.239787 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c51bef7-5435-4f5b-bf20-dabf850d931d None admin] SCRIPT_NAME: `/identity` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:07:15.240068 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c51bef7-5435-4f5b-bf20-dabf850d931d None admin] PATH_INFO: `/v3/services` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:07:15.240808 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c51bef7-5435-4f5b-bf20-dabf850d931d None admin] RBAC: Adding query filter params (type=compute) {{(pid=416294) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 09:07:15.241119 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c51bef7-5435-4f5b-bf20-dabf850d931d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:07:15.242516 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c51bef7-5435-4f5b-bf20-dabf850d931d None admin] RBAC: Authorization granted {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:07:15.253243 dv-cinder-851351-1-smb devstack@keystone.service[416294]: [pid: 416294|app: 0|req: 495/979] 10.222.0.42 () {56 vars in 1112 bytes} [Thu Jul 28 09:07:15 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 09:07:15.254354 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c51bef7-5435-4f5b-bf20-dabf850d931d None admin] Authenticating user token {{(pid=416294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:07:15.257335 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8485f82f-1279-4b43-a7c4-0a22614d148d None admin] Validating token access rules against request {{(pid=416293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:07:15.301131 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa047ba-4c34-4742-8a30-b2838b4e09e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:07:15.302105 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa047ba-4c34-4742-8a30-b2838b4e09e8 None admin] REQUEST_METHOD: `GET` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:07:15.302543 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa047ba-4c34-4742-8a30-b2838b4e09e8 None admin] SCRIPT_NAME: `/identity` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:07:15.302973 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa047ba-4c34-4742-8a30-b2838b4e09e8 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:07:15.312978 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaa047ba-4c34-4742-8a30-b2838b4e09e8 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:07:15.314458 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaa047ba-4c34-4742-8a30-b2838b4e09e8 None admin] RBAC: Authorization granted {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:07:15.327116 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application [None req-aaa047ba-4c34-4742-8a30-b2838b4e09e8 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 28 09:07:15.327116 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 09:07:15.327116 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 09:07:15.327116 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 09:07:15.327116 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 09:07:15.327116 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 09:07:15.327116 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 09:07:15.327116 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 09:07:15.327116 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 09:07:15.327116 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 09:07:15.327116 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 09:07:15.327116 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 09:07:15.327116 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 28 09:07:15.327116 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 28 09:07:15.327116 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 28 09:07:15.327116 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 28 09:07:15.328206 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 09:07:15.328206 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 09:07:15.328206 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 28 09:07:15.328206 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 09:07:15.328206 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 28 09:07:15.328206 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 09:07:15.328206 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 09:07:15.328206 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 09:07:15.328206 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 09:07:15.328206 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 09:07:15.328206 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 09:07:15.328206 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application with Lock( Jul 28 09:07:15.328206 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 09:07:15.328206 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self._enter() Jul 28 09:07:15.328206 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 09:07:15.328206 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 09:07:15.328206 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 09:07:15.328206 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self.creator() Jul 28 09:07:15.329314 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 09:07:15.329314 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application created_value = creator( Jul 28 09:07:15.329314 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 28 09:07:15.329314 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 28 09:07:15.329314 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 28 09:07:15.329314 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 28 09:07:15.329314 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 28 09:07:15.329314 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 28 09:07:15.329314 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 28 09:07:15.329314 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application Jul 28 09:07:15.329314 dv-cinder-851351-1-smb devstack@keystone.service[416293]: [pid: 416293|app: 0|req: 485/980] 10.222.0.42 () {56 vars in 1117 bytes} [Thu Jul 28 09:07:15 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 09:07:15.334123 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa047ba-4c34-4742-8a30-b2838b4e09e8 None admin] Authenticating user token {{(pid=416293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:07:15.400545 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c51bef7-5435-4f5b-bf20-dabf850d931d None admin] Validating token access rules against request {{(pid=416294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:07:15.444180 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f16ff1-f6ab-4bfe-8148-67e1c0f81f43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:07:15.444976 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f16ff1-f6ab-4bfe-8148-67e1c0f81f43 None admin] REQUEST_METHOD: `GET` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:07:15.445266 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f16ff1-f6ab-4bfe-8148-67e1c0f81f43 None admin] SCRIPT_NAME: `/identity` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:07:15.445653 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f16ff1-f6ab-4bfe-8148-67e1c0f81f43 None admin] PATH_INFO: `/v3/endpoints` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:07:15.446446 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f16ff1-f6ab-4bfe-8148-67e1c0f81f43 None admin] RBAC: Adding query filter params (interface=public, service_id=b6a81605ccce45bb965ca2a4b512f234, region_id=RegionOne) {{(pid=416294) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 09:07:15.446751 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f16ff1-f6ab-4bfe-8148-67e1c0f81f43 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:07:15.448693 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f16ff1-f6ab-4bfe-8148-67e1c0f81f43 None admin] RBAC: Authorization granted {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:07:15.452800 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG dbcounter [-] [416293] Writing DB stats keystone:SELECT=100 {{(pid=416293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:07:15.454875 dv-cinder-851351-1-smb devstack@keystone.service[416294]: [pid: 416294|app: 0|req: 496/981] 10.222.0.42 () {56 vars in 1251 bytes} [Thu Jul 28 09:07:15 2022] GET /identity/v3/endpoints?service_id=b6a81605ccce45bb965ca2a4b512f234&interface=public®ion_id=RegionOne => generated 194 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 09:07:15.456212 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b50fd2d-6f01-49be-8cf3-6ea7b993042e None None] REQUEST_METHOD: `GET` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:07:15.456509 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b50fd2d-6f01-49be-8cf3-6ea7b993042e None None] SCRIPT_NAME: `/identity` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:07:15.456829 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b50fd2d-6f01-49be-8cf3-6ea7b993042e None None] PATH_INFO: `/` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:07:15.460696 dv-cinder-851351-1-smb devstack@keystone.service[416294]: [pid: 416294|app: 0|req: 497/982] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 09:07:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 09:07:15.460696 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b50fd2d-6f01-49be-8cf3-6ea7b993042e None None] Authenticating user token {{(pid=416294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:07:15.469805 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa047ba-4c34-4742-8a30-b2838b4e09e8 None admin] Validating token access rules against request {{(pid=416293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:07:15.505105 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01c3039-53c5-434c-9237-04213db14f87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:07:15.505744 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01c3039-53c5-434c-9237-04213db14f87 None admin] REQUEST_METHOD: `GET` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:07:15.506026 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01c3039-53c5-434c-9237-04213db14f87 None admin] SCRIPT_NAME: `/identity` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:07:15.506300 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01c3039-53c5-434c-9237-04213db14f87 None admin] PATH_INFO: `/v3/users` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:07:15.507103 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f01c3039-53c5-434c-9237-04213db14f87 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=416293) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 09:07:15.507409 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f01c3039-53c5-434c-9237-04213db14f87 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:07:15.508884 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f01c3039-53c5-434c-9237-04213db14f87 None admin] RBAC: Authorization granted {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:07:15.515642 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG dbcounter [-] [416294] Writing DB stats keystone:SELECT=100 {{(pid=416294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:07:15.535478 dv-cinder-851351-1-smb devstack@keystone.service[416293]: [pid: 416293|app: 0|req: 486/983] 10.222.0.42 () {56 vars in 1149 bytes} [Thu Jul 28 09:07:15 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:07:15.535478 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2c7f73-7e04-4965-a443-cf6ced87c08d None None] REQUEST_METHOD: `POST` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:07:15.535478 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2c7f73-7e04-4965-a443-cf6ced87c08d None None] SCRIPT_NAME: `/identity` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:07:15.535478 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2c7f73-7e04-4965-a443-cf6ced87c08d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:07:15.554020 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.auth.core [None req-9e2c7f73-7e04-4965-a443-cf6ced87c08d None None] MFA Rules not processed for user `dbf87abab90e4fdf9e75408f4199918e`. Rule list: `[]` (Enabled: `True`). {{(pid=416293) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 09:07:15.555230 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.fernet_utils [None req-9e2c7f73-7e04-4965-a443-cf6ced87c08d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=416293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 09:07:15.577241 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b50fd2d-6f01-49be-8cf3-6ea7b993042e None None] Validating token access rules against request {{(pid=416294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:07:15.611652 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed656332-93d1-4867-8680-625866d696a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:07:15.612287 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed656332-93d1-4867-8680-625866d696a9 None admin] REQUEST_METHOD: `GET` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:07:15.612578 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed656332-93d1-4867-8680-625866d696a9 None admin] SCRIPT_NAME: `/identity` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:07:15.612887 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed656332-93d1-4867-8680-625866d696a9 None admin] PATH_INFO: `/v3/services` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:07:15.613559 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed656332-93d1-4867-8680-625866d696a9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:07:15.614947 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed656332-93d1-4867-8680-625866d696a9 None admin] RBAC: Authorization granted {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:07:15.621489 dv-cinder-851351-1-smb devstack@keystone.service[416294]: [pid: 416294|app: 0|req: 498/984] 10.222.0.42 () {56 vars in 1087 bytes} [Thu Jul 28 09:07:15 2022] GET /identity/v3/services => generated 1727 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 28 09:07:15.622217 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed656332-93d1-4867-8680-625866d696a9 None admin] Authenticating user token {{(pid=416294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:07:15.626894 dv-cinder-851351-1-smb devstack@keystone.service[416293]: [pid: 416293|app: 0|req: 487/985] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 09:07:15 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 09:07:15.650461 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2c7f73-7e04-4965-a443-cf6ced87c08d None None] Authenticating user token {{(pid=416293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:07:15.739986 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG dbcounter [-] [416293] Writing DB stats keystone:SELECT=100 {{(pid=416293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:07:15.745537 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed656332-93d1-4867-8680-625866d696a9 None admin] Validating token access rules against request {{(pid=416294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:07:15.762720 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG dbcounter [-] [416294] Writing DB stats keystone:SELECT=100 {{(pid=416294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:07:15.775598 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2c7f73-7e04-4965-a443-cf6ced87c08d None None] Validating token access rules against request {{(pid=416293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:07:15.793688 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca54b5d1-1b91-4c6e-a441-b2bf193c4d5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:07:15.794347 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca54b5d1-1b91-4c6e-a441-b2bf193c4d5e None admin] REQUEST_METHOD: `GET` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:07:15.794667 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca54b5d1-1b91-4c6e-a441-b2bf193c4d5e None admin] SCRIPT_NAME: `/identity` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:07:15.794918 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca54b5d1-1b91-4c6e-a441-b2bf193c4d5e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:07:15.825171 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31a31f8-f71f-4232-9896-ac42c1315a0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:07:15.825859 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31a31f8-f71f-4232-9896-ac42c1315a0e None admin] REQUEST_METHOD: `GET` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:07:15.826131 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31a31f8-f71f-4232-9896-ac42c1315a0e None admin] SCRIPT_NAME: `/identity` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:07:15.826421 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31a31f8-f71f-4232-9896-ac42c1315a0e None admin] PATH_INFO: `/v3/services/object-store` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:07:15.827051 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e31a31f8-f71f-4232-9896-ac42c1315a0e None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:07:15.828499 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e31a31f8-f71f-4232-9896-ac42c1315a0e None admin] RBAC: Authorization granted {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:07:15.838628 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application [None req-e31a31f8-f71f-4232-9896-ac42c1315a0e None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 28 09:07:15.838628 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 09:07:15.838628 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 28 09:07:15.838628 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 28 09:07:15.838628 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 28 09:07:15.838628 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 28 09:07:15.838628 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 28 09:07:15.838628 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 09:07:15.838628 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 28 09:07:15.838628 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application Jul 28 09:07:15.838628 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 28 09:07:15.838628 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application Jul 28 09:07:15.838628 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 09:07:15.838628 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 09:07:15.838628 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 09:07:15.838628 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 09:07:15.838628 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 09:07:15.839744 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 09:07:15.839744 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 09:07:15.839744 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 09:07:15.839744 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 09:07:15.839744 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 09:07:15.839744 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 09:07:15.839744 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 28 09:07:15.839744 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 28 09:07:15.839744 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 28 09:07:15.839744 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 28 09:07:15.839744 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 09:07:15.839744 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 09:07:15.839744 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 09:07:15.839744 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 09:07:15.839744 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 09:07:15.839744 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 09:07:15.840795 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 09:07:15.840795 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application with Lock( Jul 28 09:07:15.840795 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 09:07:15.840795 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self._enter() Jul 28 09:07:15.840795 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 09:07:15.840795 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 09:07:15.840795 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 09:07:15.840795 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self.creator() Jul 28 09:07:15.840795 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 09:07:15.840795 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application created_value = creator( Jul 28 09:07:15.840795 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 28 09:07:15.840795 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 09:07:15.840795 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 28 09:07:15.840795 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application Jul 28 09:07:15.840795 dv-cinder-851351-1-smb devstack@keystone.service[416293]: [pid: 416293|app: 0|req: 488/986] 10.222.0.42 () {56 vars in 1126 bytes} [Thu Jul 28 09:07:15 2022] GET /identity/v3/services/object-store => generated 93 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 09:07:15.845877 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31a31f8-f71f-4232-9896-ac42c1315a0e None admin] Authenticating user token {{(pid=416293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:07:15.877600 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca54b5d1-1b91-4c6e-a441-b2bf193c4d5e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:07:15.879235 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca54b5d1-1b91-4c6e-a441-b2bf193c4d5e None admin] RBAC: Authorization granted {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:07:15.982279 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31a31f8-f71f-4232-9896-ac42c1315a0e None admin] Validating token access rules against request {{(pid=416293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:07:16.004624 dv-cinder-851351-1-smb devstack@keystone.service[416294]: [pid: 416294|app: 0|req: 499/987] 10.222.0.42 () {58 vars in 1282 bytes} [Thu Jul 28 09:07:15 2022] GET /identity/v3/auth/tokens => generated 1560 bytes in 382 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 28 09:07:16.009996 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca54b5d1-1b91-4c6e-a441-b2bf193c4d5e None admin] Authenticating user token {{(pid=416294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:07:16.019687 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1cfd8c6-9bdf-4873-bf3b-b93f5af4177e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:07:16.020438 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1cfd8c6-9bdf-4873-bf3b-b93f5af4177e None admin] REQUEST_METHOD: `GET` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:07:16.020646 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1cfd8c6-9bdf-4873-bf3b-b93f5af4177e None admin] SCRIPT_NAME: `/identity` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:07:16.020929 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1cfd8c6-9bdf-4873-bf3b-b93f5af4177e None admin] PATH_INFO: `/v3/services` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:07:16.021625 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1cfd8c6-9bdf-4873-bf3b-b93f5af4177e None admin] RBAC: Adding query filter params (name=object-store) {{(pid=416293) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 09:07:16.021938 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1cfd8c6-9bdf-4873-bf3b-b93f5af4177e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:07:16.023354 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1cfd8c6-9bdf-4873-bf3b-b93f5af4177e None admin] RBAC: Authorization granted {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:07:16.025619 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG dbcounter [-] [416294] Writing DB stats keystone:SELECT=100 {{(pid=416294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:07:16.033430 dv-cinder-851351-1-smb devstack@keystone.service[416293]: [pid: 416293|app: 0|req: 489/988] 10.222.0.42 () {56 vars in 1122 bytes} [Thu Jul 28 09:07:15 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 09:07:16.034505 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1cfd8c6-9bdf-4873-bf3b-b93f5af4177e None admin] Authenticating user token {{(pid=416293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:07:16.038649 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG dbcounter [-] [416293] Writing DB stats keystone:SELECT=100 {{(pid=416293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:07:16.124754 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca54b5d1-1b91-4c6e-a441-b2bf193c4d5e None admin] Validating token access rules against request {{(pid=416294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:07:16.149477 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1cfd8c6-9bdf-4873-bf3b-b93f5af4177e None admin] Validating token access rules against request {{(pid=416293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:07:16.161305 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5957796-d3d2-40d9-9fca-84f2171e968a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:07:16.162239 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5957796-d3d2-40d9-9fca-84f2171e968a None admin] REQUEST_METHOD: `GET` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:07:16.162716 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5957796-d3d2-40d9-9fca-84f2171e968a None admin] SCRIPT_NAME: `/identity` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:07:16.163215 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5957796-d3d2-40d9-9fca-84f2171e968a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:07:16.176243 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5957796-d3d2-40d9-9fca-84f2171e968a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:07:16.178521 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5957796-d3d2-40d9-9fca-84f2171e968a None admin] RBAC: Authorization granted {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:07:16.190147 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e2d739-cb27-42c3-846b-0e4a8ac5c390 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:07:16.190791 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e2d739-cb27-42c3-846b-0e4a8ac5c390 None admin] REQUEST_METHOD: `GET` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:07:16.191078 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e2d739-cb27-42c3-846b-0e4a8ac5c390 None admin] SCRIPT_NAME: `/identity` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:07:16.191354 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e2d739-cb27-42c3-846b-0e4a8ac5c390 None admin] PATH_INFO: `/v3/services` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:07:16.192050 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88e2d739-cb27-42c3-846b-0e4a8ac5c390 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=416293) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 09:07:16.192354 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88e2d739-cb27-42c3-846b-0e4a8ac5c390 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:07:16.193786 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88e2d739-cb27-42c3-846b-0e4a8ac5c390 None admin] RBAC: Authorization granted {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:07:16.198687 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application [None req-b5957796-d3d2-40d9-9fca-84f2171e968a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 09:07:16.198687 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 09:07:16.198687 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 09:07:16.198687 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 09:07:16.198687 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 09:07:16.198687 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 09:07:16.198687 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 09:07:16.198687 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 09:07:16.198687 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 09:07:16.198687 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 09:07:16.198687 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 09:07:16.198687 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 09:07:16.198687 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 09:07:16.198687 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 09:07:16.198687 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 09:07:16.199639 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 09:07:16.199639 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 09:07:16.199639 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 09:07:16.199639 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 09:07:16.199639 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 09:07:16.199639 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 09:07:16.199639 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 09:07:16.199639 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 09:07:16.199639 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application with Lock( Jul 28 09:07:16.199639 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 09:07:16.199639 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return self._enter() Jul 28 09:07:16.199639 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 09:07:16.199639 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 09:07:16.199639 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 09:07:16.199639 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return self.creator() Jul 28 09:07:16.199639 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 09:07:16.199639 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application created_value = creator( Jul 28 09:07:16.200636 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 09:07:16.200636 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 09:07:16.200636 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 09:07:16.200636 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application Jul 28 09:07:16.202294 dv-cinder-851351-1-smb devstack@keystone.service[416294]: [pid: 416294|app: 0|req: 500/989] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 09:07:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 09:07:16.208711 dv-cinder-851351-1-smb devstack@keystone.service[416293]: [pid: 416293|app: 0|req: 490/990] 10.222.0.42 () {56 vars in 1122 bytes} [Thu Jul 28 09:07:16 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 09:07:16.209007 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5957796-d3d2-40d9-9fca-84f2171e968a None admin] Authenticating user token {{(pid=416294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:07:16.212962 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e2d739-cb27-42c3-846b-0e4a8ac5c390 None admin] Authenticating user token {{(pid=416293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:07:16.283583 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG dbcounter [-] [416294] Writing DB stats keystone:SELECT=100 {{(pid=416294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:07:16.286369 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG dbcounter [-] [416293] Writing DB stats keystone:SELECT=100 {{(pid=416293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:07:16.322468 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e2d739-cb27-42c3-846b-0e4a8ac5c390 None admin] Validating token access rules against request {{(pid=416293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:07:16.331123 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5957796-d3d2-40d9-9fca-84f2171e968a None admin] Validating token access rules against request {{(pid=416294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:07:16.359842 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0808bff-165c-48c6-aa60-bb93a521ef44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:07:16.360476 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0808bff-165c-48c6-aa60-bb93a521ef44 None admin] REQUEST_METHOD: `GET` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:07:16.360792 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0808bff-165c-48c6-aa60-bb93a521ef44 None admin] SCRIPT_NAME: `/identity` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:07:16.361073 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0808bff-165c-48c6-aa60-bb93a521ef44 None admin] PATH_INFO: `/v3/endpoints` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:07:16.361901 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0808bff-165c-48c6-aa60-bb93a521ef44 None admin] RBAC: Adding query filter params (interface=admin, service_id=5a3e16ed29594e9eaa06ceaf16b16d04, region_id=RegionOne) {{(pid=416293) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 09:07:16.362222 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0808bff-165c-48c6-aa60-bb93a521ef44 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:07:16.363646 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0808bff-165c-48c6-aa60-bb93a521ef44 None admin] RBAC: Authorization granted {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:07:16.367357 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0960668e-2002-4706-87d3-fb95f64bae35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:07:16.368015 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0960668e-2002-4706-87d3-fb95f64bae35 None admin] REQUEST_METHOD: `GET` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:07:16.368303 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0960668e-2002-4706-87d3-fb95f64bae35 None admin] SCRIPT_NAME: `/identity` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:07:16.368579 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0960668e-2002-4706-87d3-fb95f64bae35 None admin] PATH_INFO: `/v3/domains` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:07:16.369430 dv-cinder-851351-1-smb devstack@keystone.service[416293]: [pid: 416293|app: 0|req: 491/991] 10.222.0.42 () {56 vars in 1249 bytes} [Thu Jul 28 09:07:16 2022] GET /identity/v3/endpoints?service_id=5a3e16ed29594e9eaa06ceaf16b16d04&interface=admin®ion_id=RegionOne => generated 193 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 09:07:16.372743 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0960668e-2002-4706-87d3-fb95f64bae35 None admin] RBAC: Adding query filter params (name=Default) {{(pid=416294) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 09:07:16.373108 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0960668e-2002-4706-87d3-fb95f64bae35 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:07:16.374823 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0808bff-165c-48c6-aa60-bb93a521ef44 None admin] Authenticating user token {{(pid=416293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:07:16.374984 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0960668e-2002-4706-87d3-fb95f64bae35 None admin] RBAC: Authorization granted {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:07:16.392722 dv-cinder-851351-1-smb devstack@keystone.service[416294]: [pid: 416294|app: 0|req: 501/992] 10.222.0.42 () {56 vars in 1109 bytes} [Thu Jul 28 09:07:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 09:07:16.396700 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0960668e-2002-4706-87d3-fb95f64bae35 None admin] Authenticating user token {{(pid=416294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:07:16.488523 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0808bff-165c-48c6-aa60-bb93a521ef44 None admin] Validating token access rules against request {{(pid=416293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:07:16.509047 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0960668e-2002-4706-87d3-fb95f64bae35 None admin] Validating token access rules against request {{(pid=416294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:07:16.519590 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG dbcounter [-] [416293] Writing DB stats keystone:SELECT=100 {{(pid=416293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:07:16.526408 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a8a6d9-063a-406e-9098-a9025c6d0edd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:07:16.527053 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a8a6d9-063a-406e-9098-a9025c6d0edd None admin] REQUEST_METHOD: `GET` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:07:16.527388 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a8a6d9-063a-406e-9098-a9025c6d0edd None admin] SCRIPT_NAME: `/identity` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:07:16.527845 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a8a6d9-063a-406e-9098-a9025c6d0edd None admin] PATH_INFO: `/v3/services` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:07:16.528339 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a8a6d9-063a-406e-9098-a9025c6d0edd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:07:16.529779 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a8a6d9-063a-406e-9098-a9025c6d0edd None admin] RBAC: Authorization granted {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:07:16.535167 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG dbcounter [-] [416294] Writing DB stats keystone:SELECT=100 {{(pid=416294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:07:16.536405 dv-cinder-851351-1-smb devstack@keystone.service[416293]: [pid: 416293|app: 0|req: 492/993] 10.222.0.42 () {56 vars in 1087 bytes} [Thu Jul 28 09:07:16 2022] GET /identity/v3/services => generated 1727 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 28 09:07:16.553869 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f43172-c152-4067-adca-dd7422a20e9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:07:16.554561 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f43172-c152-4067-adca-dd7422a20e9d None admin] REQUEST_METHOD: `GET` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:07:16.554845 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f43172-c152-4067-adca-dd7422a20e9d None admin] SCRIPT_NAME: `/identity` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:07:16.555127 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f43172-c152-4067-adca-dd7422a20e9d None admin] PATH_INFO: `/v3/projects/service` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:07:16.563534 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40f43172-c152-4067-adca-dd7422a20e9d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:07:16.565093 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40f43172-c152-4067-adca-dd7422a20e9d None admin] RBAC: Authorization granted {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:07:16.578573 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application [None req-40f43172-c152-4067-adca-dd7422a20e9d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 09:07:16.578573 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 09:07:16.578573 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 09:07:16.578573 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 09:07:16.578573 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 09:07:16.578573 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 09:07:16.578573 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 09:07:16.578573 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 09:07:16.578573 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 09:07:16.578573 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 09:07:16.578573 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 09:07:16.578573 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 09:07:16.578573 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 28 09:07:16.578573 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 28 09:07:16.578573 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 28 09:07:16.579677 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 28 09:07:16.579677 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 09:07:16.579677 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 09:07:16.579677 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 09:07:16.579677 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 09:07:16.579677 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 09:07:16.579677 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 09:07:16.579677 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 09:07:16.579677 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application with Lock( Jul 28 09:07:16.579677 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 09:07:16.579677 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return self._enter() Jul 28 09:07:16.579677 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 09:07:16.579677 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 09:07:16.579677 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 09:07:16.579677 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return self.creator() Jul 28 09:07:16.579677 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 09:07:16.579677 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application created_value = creator( Jul 28 09:07:16.580718 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 28 09:07:16.580718 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 28 09:07:16.580718 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 28 09:07:16.580718 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 28 09:07:16.580718 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 28 09:07:16.580718 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 28 09:07:16.580718 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 09:07:16.580718 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application Jul 28 09:07:16.580718 dv-cinder-851351-1-smb devstack@keystone.service[416294]: [pid: 416294|app: 0|req: 502/994] 10.222.0.42 () {56 vars in 1111 bytes} [Thu Jul 28 09:07:16 2022] GET /identity/v3/projects/service => generated 88 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 09:07:16.585821 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a8a6d9-063a-406e-9098-a9025c6d0edd None admin] Authenticating user token {{(pid=416293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:07:16.704382 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a8a6d9-063a-406e-9098-a9025c6d0edd None admin] Validating token access rules against request {{(pid=416293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:07:16.741362 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae35e95-5c46-471d-9d11-c0848f741eef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:07:16.742396 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae35e95-5c46-471d-9d11-c0848f741eef None admin] REQUEST_METHOD: `GET` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:07:16.742923 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae35e95-5c46-471d-9d11-c0848f741eef None admin] SCRIPT_NAME: `/identity` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:07:16.743411 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae35e95-5c46-471d-9d11-c0848f741eef None admin] PATH_INFO: `/v3/projects` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:07:16.744381 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cae35e95-5c46-471d-9d11-c0848f741eef None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=416293) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 09:07:16.744981 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cae35e95-5c46-471d-9d11-c0848f741eef None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:07:16.746650 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cae35e95-5c46-471d-9d11-c0848f741eef None admin] RBAC: Authorization granted {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:07:16.760770 dv-cinder-851351-1-smb devstack@keystone.service[416293]: [pid: 416293|app: 0|req: 493/995] 10.222.0.42 () {56 vars in 1148 bytes} [Thu Jul 28 09:07:16 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 09:07:16.766842 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f43172-c152-4067-adca-dd7422a20e9d None admin] Authenticating user token {{(pid=416294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:07:16.875268 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f43172-c152-4067-adca-dd7422a20e9d None admin] Validating token access rules against request {{(pid=416294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:07:16.912161 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab9ce42-a164-4182-a64e-7dd6f77e2dc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:07:16.912828 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab9ce42-a164-4182-a64e-7dd6f77e2dc0 None admin] REQUEST_METHOD: `GET` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:07:16.913290 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab9ce42-a164-4182-a64e-7dd6f77e2dc0 None admin] SCRIPT_NAME: `/identity` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:07:16.913401 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab9ce42-a164-4182-a64e-7dd6f77e2dc0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:07:16.914190 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aab9ce42-a164-4182-a64e-7dd6f77e2dc0 None admin] RBAC: Adding query filter params (role.id=4d94122535c54ae98fbaf3c8766c59be, scope.project.id=6c4349445f224184b093d9dfd0dfc642, user.id=f5b664bdc0d04af8ac60a11e9a136c91) {{(pid=416294) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 09:07:16.914490 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aab9ce42-a164-4182-a64e-7dd6f77e2dc0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:07:16.915953 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aab9ce42-a164-4182-a64e-7dd6f77e2dc0 None admin] RBAC: Authorization granted {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:07:16.923284 dv-cinder-851351-1-smb devstack@keystone.service[416294]: [pid: 416294|app: 0|req: 503/996] 10.222.0.42 () {56 vars in 1374 bytes} [Thu Jul 28 09:07:16 2022] GET /identity/v3/role_assignments?user.id=f5b664bdc0d04af8ac60a11e9a136c91&scope.project.id=6c4349445f224184b093d9dfd0dfc642&role.id=4d94122535c54ae98fbaf3c8766c59be => generated 608 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:07:17.667953 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6bbe889-d794-4e63-92a8-be77975e37a8 None None] REQUEST_METHOD: `GET` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:07:17.668541 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6bbe889-d794-4e63-92a8-be77975e37a8 None None] SCRIPT_NAME: `/identity` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:07:17.668541 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6bbe889-d794-4e63-92a8-be77975e37a8 None None] PATH_INFO: `/` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:07:17.670228 dv-cinder-851351-1-smb devstack@keystone.service[416293]: [pid: 416293|app: 0|req: 494/997] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 09:07:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 09:07:17.675938 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97629e13-1dc1-400d-95b1-33debe682589 None None] REQUEST_METHOD: `POST` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:07:17.676479 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97629e13-1dc1-400d-95b1-33debe682589 None None] SCRIPT_NAME: `/identity` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:07:17.676479 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97629e13-1dc1-400d-95b1-33debe682589 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:07:17.696409 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.auth.core [None req-97629e13-1dc1-400d-95b1-33debe682589 None None] MFA Rules not processed for user `dbf87abab90e4fdf9e75408f4199918e`. Rule list: `[]` (Enabled: `True`). {{(pid=416294) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 09:07:17.697573 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.fernet_utils [None req-97629e13-1dc1-400d-95b1-33debe682589 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=416294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 09:07:17.750461 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG dbcounter [-] [416294] Writing DB stats keystone:SELECT=100 {{(pid=416294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:07:17.779037 dv-cinder-851351-1-smb devstack@keystone.service[416294]: [pid: 416294|app: 0|req: 504/998] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 09:07:17 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 09:07:17.801822 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6bbe889-d794-4e63-92a8-be77975e37a8 None None] Authenticating user token {{(pid=416293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:07:17.869749 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG dbcounter [-] [416293] Writing DB stats keystone:SELECT=100 {{(pid=416293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:07:17.925679 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6bbe889-d794-4e63-92a8-be77975e37a8 None None] Validating token access rules against request {{(pid=416293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:07:17.978581 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dec9d01-e5c9-413f-b480-c7c2cf0efb53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:07:17.979740 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dec9d01-e5c9-413f-b480-c7c2cf0efb53 None admin] REQUEST_METHOD: `GET` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:07:17.980003 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dec9d01-e5c9-413f-b480-c7c2cf0efb53 None admin] SCRIPT_NAME: `/identity` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:07:17.980306 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dec9d01-e5c9-413f-b480-c7c2cf0efb53 None admin] PATH_INFO: `/v3/services/compute` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:07:17.981001 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dec9d01-e5c9-413f-b480-c7c2cf0efb53 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:07:17.982439 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dec9d01-e5c9-413f-b480-c7c2cf0efb53 None admin] RBAC: Authorization granted {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:07:17.992698 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application [None req-2dec9d01-e5c9-413f-b480-c7c2cf0efb53 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jul 28 09:07:17.992698 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 09:07:17.992698 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 28 09:07:17.992698 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 28 09:07:17.992698 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 28 09:07:17.992698 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 28 09:07:17.992698 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 28 09:07:17.992698 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 09:07:17.992698 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 28 09:07:17.992698 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application Jul 28 09:07:17.992698 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 28 09:07:17.992698 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application Jul 28 09:07:17.992698 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 09:07:17.992698 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 09:07:17.992698 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 09:07:17.992698 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 09:07:17.992698 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 09:07:17.993894 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 09:07:17.993894 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 09:07:17.993894 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 09:07:17.993894 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 09:07:17.993894 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 09:07:17.993894 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 09:07:17.993894 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 28 09:07:17.993894 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 28 09:07:17.993894 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 28 09:07:17.993894 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 28 09:07:17.993894 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 09:07:17.993894 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 09:07:17.993894 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 09:07:17.993894 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 09:07:17.993894 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 09:07:17.993894 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 09:07:17.994918 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 09:07:17.994918 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application with Lock( Jul 28 09:07:17.994918 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 09:07:17.994918 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self._enter() Jul 28 09:07:17.994918 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 09:07:17.994918 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 09:07:17.994918 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 09:07:17.994918 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self.creator() Jul 28 09:07:17.994918 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 09:07:17.994918 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application created_value = creator( Jul 28 09:07:17.994918 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 28 09:07:17.994918 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 09:07:17.994918 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 28 09:07:17.994918 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application Jul 28 09:07:17.996713 dv-cinder-851351-1-smb devstack@keystone.service[416293]: [pid: 416293|app: 0|req: 495/999] 10.222.0.42 () {56 vars in 1111 bytes} [Thu Jul 28 09:07:17 2022] GET /identity/v3/services/compute => generated 88 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 09:07:18.000635 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97629e13-1dc1-400d-95b1-33debe682589 None None] Authenticating user token {{(pid=416294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:07:18.119266 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97629e13-1dc1-400d-95b1-33debe682589 None None] Validating token access rules against request {{(pid=416294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:07:18.156999 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1461b0-2605-4a8d-8e83-8267327017ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:07:18.157642 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1461b0-2605-4a8d-8e83-8267327017ea None admin] REQUEST_METHOD: `GET` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:07:18.157992 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1461b0-2605-4a8d-8e83-8267327017ea None admin] SCRIPT_NAME: `/identity` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:07:18.158269 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1461b0-2605-4a8d-8e83-8267327017ea None admin] PATH_INFO: `/v3/services` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:07:18.158966 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef1461b0-2605-4a8d-8e83-8267327017ea None admin] RBAC: Adding query filter params (name=compute) {{(pid=416294) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 09:07:18.159271 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef1461b0-2605-4a8d-8e83-8267327017ea None admin] RBAC: Authorizing `identity:list_services()` {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:07:18.160677 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef1461b0-2605-4a8d-8e83-8267327017ea None admin] RBAC: Authorization granted {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:07:18.166255 dv-cinder-851351-1-smb devstack@keystone.service[416294]: [pid: 416294|app: 0|req: 505/1000] 10.222.0.42 () {56 vars in 1112 bytes} [Thu Jul 28 09:07:17 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:07:18.172111 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dec9d01-e5c9-413f-b480-c7c2cf0efb53 None admin] Authenticating user token {{(pid=416293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:07:18.277153 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dec9d01-e5c9-413f-b480-c7c2cf0efb53 None admin] Validating token access rules against request {{(pid=416293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:07:18.297812 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG dbcounter [-] [416293] Writing DB stats keystone:SELECT=100 {{(pid=416293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:07:18.315498 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b90cab-efc0-4be9-bbd3-59dd179ec367 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:07:18.316136 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b90cab-efc0-4be9-bbd3-59dd179ec367 None admin] REQUEST_METHOD: `GET` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:07:18.316426 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b90cab-efc0-4be9-bbd3-59dd179ec367 None admin] SCRIPT_NAME: `/identity` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:07:18.316688 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b90cab-efc0-4be9-bbd3-59dd179ec367 None admin] PATH_INFO: `/v3/services` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:07:18.317408 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25b90cab-efc0-4be9-bbd3-59dd179ec367 None admin] RBAC: Adding query filter params (type=compute) {{(pid=416293) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 09:07:18.317724 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25b90cab-efc0-4be9-bbd3-59dd179ec367 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:07:18.319108 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25b90cab-efc0-4be9-bbd3-59dd179ec367 None admin] RBAC: Authorization granted {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:07:18.329859 dv-cinder-851351-1-smb devstack@keystone.service[416293]: [pid: 416293|app: 0|req: 496/1001] 10.222.0.42 () {56 vars in 1112 bytes} [Thu Jul 28 09:07:18 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:07:18.331502 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1461b0-2605-4a8d-8e83-8267327017ea None admin] Authenticating user token {{(pid=416294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:07:18.378359 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG dbcounter [-] [416294] Writing DB stats keystone:SELECT=100 {{(pid=416294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:07:18.439499 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1461b0-2605-4a8d-8e83-8267327017ea None admin] Validating token access rules against request {{(pid=416294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:07:18.476221 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cabadbd-272c-4f5b-8494-b078b8ce302e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:07:18.476908 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cabadbd-272c-4f5b-8494-b078b8ce302e None admin] REQUEST_METHOD: `POST` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:07:18.477195 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cabadbd-272c-4f5b-8494-b078b8ce302e None admin] SCRIPT_NAME: `/identity` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:07:18.477470 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cabadbd-272c-4f5b-8494-b078b8ce302e None admin] PATH_INFO: `/v3/endpoints` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:07:18.478233 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cabadbd-272c-4f5b-8494-b078b8ce302e None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:07:18.479710 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cabadbd-272c-4f5b-8494-b078b8ce302e None admin] RBAC: Authorization granted {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:07:18.504574 dv-cinder-851351-1-smb devstack@keystone.service[416294]: [pid: 416294|app: 0|req: 506/1002] 10.222.0.42 () {60 vars in 1144 bytes} [Thu Jul 28 09:07:18 2022] POST /identity/v3/endpoints => generated 334 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 09:07:18.601676 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6274fd36-bef2-4549-a857-8f71cef4b803 None None] REQUEST_METHOD: `GET` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:07:18.602048 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6274fd36-bef2-4549-a857-8f71cef4b803 None None] SCRIPT_NAME: `/identity` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:07:18.602224 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6274fd36-bef2-4549-a857-8f71cef4b803 None None] PATH_INFO: `/` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:07:18.603868 dv-cinder-851351-1-smb devstack@keystone.service[416293]: [pid: 416293|app: 0|req: 497/1003] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 09:07:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 09:07:18.609743 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f174d0-592b-4828-b0a7-4feef3602ba1 None None] REQUEST_METHOD: `POST` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:07:18.610071 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f174d0-592b-4828-b0a7-4feef3602ba1 None None] SCRIPT_NAME: `/identity` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:07:18.610329 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f174d0-592b-4828-b0a7-4feef3602ba1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:07:18.630286 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.auth.core [None req-62f174d0-592b-4828-b0a7-4feef3602ba1 None None] MFA Rules not processed for user `dbf87abab90e4fdf9e75408f4199918e`. Rule list: `[]` (Enabled: `True`). {{(pid=416294) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 09:07:18.631543 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.fernet_utils [None req-62f174d0-592b-4828-b0a7-4feef3602ba1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=416294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 09:07:18.719440 dv-cinder-851351-1-smb devstack@keystone.service[416294]: [pid: 416294|app: 0|req: 507/1004] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 09:07:18 2022] POST /identity/v3/auth/tokens => generated 1716 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 09:07:18.742712 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6274fd36-bef2-4549-a857-8f71cef4b803 None None] Authenticating user token {{(pid=416293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:07:18.858471 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6274fd36-bef2-4549-a857-8f71cef4b803 None None] Validating token access rules against request {{(pid=416293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:07:18.899302 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-272dd6c6-f5ce-4149-b08a-ef7de4433691 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:07:18.900102 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272dd6c6-f5ce-4149-b08a-ef7de4433691 None admin] REQUEST_METHOD: `GET` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:07:18.900502 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272dd6c6-f5ce-4149-b08a-ef7de4433691 None admin] SCRIPT_NAME: `/identity` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:07:18.900829 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272dd6c6-f5ce-4149-b08a-ef7de4433691 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:07:18.901640 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-272dd6c6-f5ce-4149-b08a-ef7de4433691 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:07:18.903303 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-272dd6c6-f5ce-4149-b08a-ef7de4433691 None admin] RBAC: Authorization granted {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:07:18.914785 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application [None req-272dd6c6-f5ce-4149-b08a-ef7de4433691 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 28 09:07:18.914785 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 09:07:18.914785 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 28 09:07:18.914785 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 28 09:07:18.914785 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 28 09:07:18.914785 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 28 09:07:18.914785 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 28 09:07:18.914785 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 09:07:18.914785 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 28 09:07:18.914785 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application Jul 28 09:07:18.914785 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 28 09:07:18.914785 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application Jul 28 09:07:18.914785 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 09:07:18.914785 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 09:07:18.914785 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 09:07:18.914785 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 09:07:18.914785 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 09:07:18.916293 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 09:07:18.916293 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 09:07:18.916293 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 09:07:18.916293 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 09:07:18.916293 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 09:07:18.916293 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 09:07:18.916293 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 28 09:07:18.916293 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 28 09:07:18.916293 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 28 09:07:18.916293 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 28 09:07:18.916293 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 09:07:18.916293 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 09:07:18.916293 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 09:07:18.916293 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 09:07:18.916293 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 09:07:18.916293 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 09:07:18.918113 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 09:07:18.918113 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application with Lock( Jul 28 09:07:18.918113 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 09:07:18.918113 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self._enter() Jul 28 09:07:18.918113 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 09:07:18.918113 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 09:07:18.918113 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 09:07:18.918113 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self.creator() Jul 28 09:07:18.918113 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 09:07:18.918113 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application created_value = creator( Jul 28 09:07:18.918113 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 28 09:07:18.918113 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 09:07:18.918113 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 28 09:07:18.918113 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application Jul 28 09:07:18.918113 dv-cinder-851351-1-smb devstack@keystone.service[416293]: [pid: 416293|app: 0|req: 498/1005] 10.222.0.42 () {56 vars in 1126 bytes} [Thu Jul 28 09:07:18 2022] GET /identity/v3/services/object-store => generated 93 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 09:07:18.923478 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f174d0-592b-4828-b0a7-4feef3602ba1 None None] Authenticating user token {{(pid=416294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:07:18.952410 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG dbcounter [-] [416294] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=416294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:07:19.011383 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8811421-3add-4532-9f0a-16931ec251b7 None None] REQUEST_METHOD: `GET` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:07:19.012275 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8811421-3add-4532-9f0a-16931ec251b7 None None] SCRIPT_NAME: `/identity` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:07:19.012569 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8811421-3add-4532-9f0a-16931ec251b7 None None] PATH_INFO: `/` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:07:19.014001 dv-cinder-851351-1-smb devstack@keystone.service[416293]: [pid: 416293|app: 0|req: 499/1006] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 09:07:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 28 09:07:19.019411 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b39ef63-a623-4de7-89f6-7b6f8b7667ed None None] REQUEST_METHOD: `POST` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:07:19.019964 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b39ef63-a623-4de7-89f6-7b6f8b7667ed None None] SCRIPT_NAME: `/identity` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:07:19.020247 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b39ef63-a623-4de7-89f6-7b6f8b7667ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:07:19.039659 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.auth.core [None req-7b39ef63-a623-4de7-89f6-7b6f8b7667ed None None] MFA Rules not processed for user `dbf87abab90e4fdf9e75408f4199918e`. Rule list: `[]` (Enabled: `True`). {{(pid=416293) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 09:07:19.041002 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.fernet_utils [None req-7b39ef63-a623-4de7-89f6-7b6f8b7667ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=416293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 09:07:19.047246 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f174d0-592b-4828-b0a7-4feef3602ba1 None None] Validating token access rules against request {{(pid=416294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:07:19.085881 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d73d34b-89b0-437c-a064-5cae13230047 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:07:19.086638 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d73d34b-89b0-437c-a064-5cae13230047 None admin] REQUEST_METHOD: `GET` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:07:19.086932 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d73d34b-89b0-437c-a064-5cae13230047 None admin] SCRIPT_NAME: `/identity` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:07:19.087389 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d73d34b-89b0-437c-a064-5cae13230047 None admin] PATH_INFO: `/v3/services` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:07:19.088183 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d73d34b-89b0-437c-a064-5cae13230047 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=416294) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 09:07:19.088492 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d73d34b-89b0-437c-a064-5cae13230047 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:07:19.089035 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG dbcounter [-] [416293] Writing DB stats keystone:SELECT=100 {{(pid=416293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:07:19.089927 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d73d34b-89b0-437c-a064-5cae13230047 None admin] RBAC: Authorization granted {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:07:19.100329 dv-cinder-851351-1-smb devstack@keystone.service[416294]: [pid: 416294|app: 0|req: 508/1007] 10.222.0.42 () {56 vars in 1122 bytes} [Thu Jul 28 09:07:18 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:07:19.101525 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d73d34b-89b0-437c-a064-5cae13230047 None admin] Authenticating user token {{(pid=416294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:07:19.127198 dv-cinder-851351-1-smb devstack@keystone.service[416293]: [pid: 416293|app: 0|req: 500/1008] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 09:07:19 2022] POST /identity/v3/auth/tokens => generated 1716 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 28 09:07:19.149180 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b39ef63-a623-4de7-89f6-7b6f8b7667ed None None] Authenticating user token {{(pid=416293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:07:19.195421 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG dbcounter [-] [416294] Writing DB stats keystone:SELECT=100 {{(pid=416294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:07:19.209386 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d73d34b-89b0-437c-a064-5cae13230047 None admin] Validating token access rules against request {{(pid=416294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:07:19.245916 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8e67ee-bf4d-489e-9a83-a9cab3766fa5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:07:19.246977 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8e67ee-bf4d-489e-9a83-a9cab3766fa5 None admin] REQUEST_METHOD: `GET` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:07:19.247439 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8e67ee-bf4d-489e-9a83-a9cab3766fa5 None admin] SCRIPT_NAME: `/identity` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:07:19.247939 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8e67ee-bf4d-489e-9a83-a9cab3766fa5 None admin] PATH_INFO: `/v3/services` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:07:19.248815 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb8e67ee-bf4d-489e-9a83-a9cab3766fa5 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=416294) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 09:07:19.249291 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb8e67ee-bf4d-489e-9a83-a9cab3766fa5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:07:19.250997 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb8e67ee-bf4d-489e-9a83-a9cab3766fa5 None admin] RBAC: Authorization granted {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:07:19.257252 dv-cinder-851351-1-smb devstack@keystone.service[416294]: [pid: 416294|app: 0|req: 509/1009] 10.222.0.42 () {56 vars in 1122 bytes} [Thu Jul 28 09:07:19 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:07:19.264486 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8e67ee-bf4d-489e-9a83-a9cab3766fa5 None admin] Authenticating user token {{(pid=416294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:07:19.264688 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b39ef63-a623-4de7-89f6-7b6f8b7667ed None None] Validating token access rules against request {{(pid=416293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:07:19.301197 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93466a5b-fb87-4978-85b2-1be5f1cad5f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:07:19.301970 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93466a5b-fb87-4978-85b2-1be5f1cad5f4 None admin] REQUEST_METHOD: `GET` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:07:19.302260 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93466a5b-fb87-4978-85b2-1be5f1cad5f4 None admin] SCRIPT_NAME: `/identity` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:07:19.302541 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93466a5b-fb87-4978-85b2-1be5f1cad5f4 None admin] PATH_INFO: `/v3/services/image` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:07:19.303187 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93466a5b-fb87-4978-85b2-1be5f1cad5f4 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:07:19.304595 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93466a5b-fb87-4978-85b2-1be5f1cad5f4 None admin] RBAC: Authorization granted {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:07:19.314828 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application [None req-93466a5b-fb87-4978-85b2-1be5f1cad5f4 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jul 28 09:07:19.314828 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 09:07:19.314828 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 28 09:07:19.314828 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 28 09:07:19.314828 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 28 09:07:19.314828 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 28 09:07:19.314828 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 28 09:07:19.314828 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 09:07:19.314828 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 28 09:07:19.314828 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application Jul 28 09:07:19.314828 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 28 09:07:19.314828 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application Jul 28 09:07:19.314828 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 09:07:19.314828 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 09:07:19.314828 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 09:07:19.314828 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 09:07:19.314828 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 09:07:19.316028 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 09:07:19.316028 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 09:07:19.316028 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 09:07:19.316028 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 09:07:19.316028 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 09:07:19.316028 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 09:07:19.316028 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 28 09:07:19.316028 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 28 09:07:19.316028 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 28 09:07:19.316028 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 28 09:07:19.316028 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 09:07:19.316028 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 09:07:19.316028 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 09:07:19.316028 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 09:07:19.316028 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 09:07:19.316028 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 09:07:19.317709 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 09:07:19.317709 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application with Lock( Jul 28 09:07:19.317709 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 09:07:19.317709 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self._enter() Jul 28 09:07:19.317709 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 09:07:19.317709 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 09:07:19.317709 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 09:07:19.317709 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self.creator() Jul 28 09:07:19.317709 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 09:07:19.317709 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application created_value = creator( Jul 28 09:07:19.317709 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 28 09:07:19.317709 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 09:07:19.317709 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 28 09:07:19.317709 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application Jul 28 09:07:19.317709 dv-cinder-851351-1-smb devstack@keystone.service[416293]: [pid: 416293|app: 0|req: 501/1010] 10.222.0.42 () {56 vars in 1105 bytes} [Thu Jul 28 09:07:19 2022] GET /identity/v3/services/image => generated 86 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 09:07:19.322071 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93466a5b-fb87-4978-85b2-1be5f1cad5f4 None admin] Authenticating user token {{(pid=416293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:07:19.370565 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG dbcounter [-] [416293] Writing DB stats keystone:SELECT=100 {{(pid=416293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:07:19.380156 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8e67ee-bf4d-489e-9a83-a9cab3766fa5 None admin] Validating token access rules against request {{(pid=416294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:07:19.416948 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6890318c-b381-4373-bd43-6c6b76d7be35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:07:19.417595 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6890318c-b381-4373-bd43-6c6b76d7be35 None admin] REQUEST_METHOD: `POST` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:07:19.417885 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6890318c-b381-4373-bd43-6c6b76d7be35 None admin] SCRIPT_NAME: `/identity` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:07:19.418169 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6890318c-b381-4373-bd43-6c6b76d7be35 None admin] PATH_INFO: `/v3/endpoints` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:07:19.418895 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6890318c-b381-4373-bd43-6c6b76d7be35 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:07:19.420294 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6890318c-b381-4373-bd43-6c6b76d7be35 None admin] RBAC: Authorization granted {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:07:19.436941 dv-cinder-851351-1-smb devstack@keystone.service[416294]: [pid: 416294|app: 0|req: 510/1011] 10.222.0.42 () {60 vars in 1144 bytes} [Thu Jul 28 09:07:19 2022] POST /identity/v3/endpoints => generated 325 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 28 09:07:19.441075 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93466a5b-fb87-4978-85b2-1be5f1cad5f4 None admin] Validating token access rules against request {{(pid=416293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:07:19.489622 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60bde87b-6286-4552-8a8e-f8a969db4fdb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:07:19.490287 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60bde87b-6286-4552-8a8e-f8a969db4fdb None admin] REQUEST_METHOD: `GET` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:07:19.490577 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60bde87b-6286-4552-8a8e-f8a969db4fdb None admin] SCRIPT_NAME: `/identity` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:07:19.490857 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60bde87b-6286-4552-8a8e-f8a969db4fdb None admin] PATH_INFO: `/v3/services` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:07:19.491582 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60bde87b-6286-4552-8a8e-f8a969db4fdb None admin] RBAC: Adding query filter params (name=image) {{(pid=416293) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 09:07:19.491883 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60bde87b-6286-4552-8a8e-f8a969db4fdb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:07:19.493396 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60bde87b-6286-4552-8a8e-f8a969db4fdb None admin] RBAC: Authorization granted {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:07:19.504391 dv-cinder-851351-1-smb devstack@keystone.service[416293]: [pid: 416293|app: 0|req: 502/1012] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 09:07:19 2022] GET /identity/v3/services?name=image => generated 122 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:07:19.505660 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6890318c-b381-4373-bd43-6c6b76d7be35 None admin] Authenticating user token {{(pid=416294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:07:19.525911 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG dbcounter [-] [416294] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=416294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:07:19.637813 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6890318c-b381-4373-bd43-6c6b76d7be35 None admin] Validating token access rules against request {{(pid=416294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:07:19.673221 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e98f3c-7ce4-41be-8c13-061961e3abbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:07:19.673872 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e98f3c-7ce4-41be-8c13-061961e3abbb None admin] REQUEST_METHOD: `GET` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:07:19.674160 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e98f3c-7ce4-41be-8c13-061961e3abbb None admin] SCRIPT_NAME: `/identity` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:07:19.674440 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e98f3c-7ce4-41be-8c13-061961e3abbb None admin] PATH_INFO: `/v3/services` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:07:19.675170 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8e98f3c-7ce4-41be-8c13-061961e3abbb None admin] RBAC: Adding query filter params (type=image) {{(pid=416294) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 09:07:19.675481 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8e98f3c-7ce4-41be-8c13-061961e3abbb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:07:19.676899 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8e98f3c-7ce4-41be-8c13-061961e3abbb None admin] RBAC: Authorization granted {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:07:19.681847 dv-cinder-851351-1-smb devstack@keystone.service[416294]: [pid: 416294|app: 0|req: 511/1013] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 09:07:19 2022] GET /identity/v3/services?type=image => generated 122 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:07:20.658611 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43739b5-85c6-4ad4-a851-37fed72d7150 None None] REQUEST_METHOD: `GET` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:07:20.659178 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43739b5-85c6-4ad4-a851-37fed72d7150 None None] SCRIPT_NAME: `/identity` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:07:20.659178 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43739b5-85c6-4ad4-a851-37fed72d7150 None None] PATH_INFO: `/` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:07:20.660763 dv-cinder-851351-1-smb devstack@keystone.service[416293]: [pid: 416293|app: 0|req: 503/1014] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 09:07:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 09:07:20.665999 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a745fea4-4349-40d5-90a6-87c69efc3fba None None] REQUEST_METHOD: `POST` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:07:20.666450 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a745fea4-4349-40d5-90a6-87c69efc3fba None None] SCRIPT_NAME: `/identity` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:07:20.666537 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a745fea4-4349-40d5-90a6-87c69efc3fba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:07:20.685000 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.auth.core [None req-a745fea4-4349-40d5-90a6-87c69efc3fba None None] MFA Rules not processed for user `dbf87abab90e4fdf9e75408f4199918e`. Rule list: `[]` (Enabled: `True`). {{(pid=416294) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 09:07:20.686194 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.fernet_utils [None req-a745fea4-4349-40d5-90a6-87c69efc3fba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=416294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 09:07:20.758941 dv-cinder-851351-1-smb devstack@keystone.service[416294]: [pid: 416294|app: 0|req: 512/1015] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 09:07:20 2022] POST /identity/v3/auth/tokens => generated 1863 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 09:07:20.781686 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e43739b5-85c6-4ad4-a851-37fed72d7150 None None] Authenticating user token {{(pid=416293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:07:20.892374 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e43739b5-85c6-4ad4-a851-37fed72d7150 None None] Validating token access rules against request {{(pid=416293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:07:20.893924 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG dbcounter [-] [416293] Writing DB stats keystone:SELECT=100 {{(pid=416293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:07:20.932272 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e6a294-09ac-468f-b87a-3485e8712f21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:07:20.932881 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e6a294-09ac-468f-b87a-3485e8712f21 None admin] REQUEST_METHOD: `GET` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:07:20.933175 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e6a294-09ac-468f-b87a-3485e8712f21 None admin] SCRIPT_NAME: `/identity` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:07:20.933458 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e6a294-09ac-468f-b87a-3485e8712f21 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:07:20.945217 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2e6a294-09ac-468f-b87a-3485e8712f21 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 09:07:20.950602 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application [None req-d2e6a294-09ac-468f-b87a-3485e8712f21 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 28 09:07:20.950602 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 09:07:20.950602 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 09:07:20.950602 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 09:07:20.950602 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 09:07:20.950602 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 09:07:20.950602 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 09:07:20.950602 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 09:07:20.950602 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 09:07:20.950602 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 09:07:20.950602 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 09:07:20.950602 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 09:07:20.950602 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 09:07:20.950602 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 09:07:20.950602 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 09:07:20.950602 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 09:07:20.951641 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 09:07:20.951641 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 09:07:20.951641 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 09:07:20.951641 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 09:07:20.951641 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 09:07:20.951641 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 09:07:20.951641 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 09:07:20.951641 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 09:07:20.951641 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 09:07:20.951641 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 09:07:20.951641 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 09:07:20.951641 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application with Lock( Jul 28 09:07:20.951641 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 09:07:20.951641 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self._enter() Jul 28 09:07:20.951641 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 09:07:20.951641 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 09:07:20.952564 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 09:07:20.952564 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self.creator() Jul 28 09:07:20.952564 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 09:07:20.952564 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application created_value = creator( Jul 28 09:07:20.952564 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 09:07:20.952564 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 09:07:20.952564 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 09:07:20.952564 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 09:07:20.952564 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 09:07:20.952564 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 09:07:20.952564 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 28 09:07:20.952564 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application Jul 28 09:07:20.952564 dv-cinder-851351-1-smb devstack@keystone.service[416293]: [pid: 416293|app: 0|req: 504/1016] 10.222.0.42 () {56 vars in 1120 bytes} [Thu Jul 28 09:07:20 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 09:07:20.959908 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a745fea4-4349-40d5-90a6-87c69efc3fba None None] Authenticating user token {{(pid=416294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:07:20.969104 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG dbcounter [-] [416294] Writing DB stats keystone:SELECT=100 {{(pid=416294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:07:21.070462 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a745fea4-4349-40d5-90a6-87c69efc3fba None None] Validating token access rules against request {{(pid=416294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:07:21.107974 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee28309-c593-4d16-9909-e954956c91c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:07:21.108610 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee28309-c593-4d16-9909-e954956c91c5 None admin] REQUEST_METHOD: `GET` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:07:21.108930 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee28309-c593-4d16-9909-e954956c91c5 None admin] SCRIPT_NAME: `/identity` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:07:21.109209 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee28309-c593-4d16-9909-e954956c91c5 None admin] PATH_INFO: `/v3/roles` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:07:21.109991 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee28309-c593-4d16-9909-e954956c91c5 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=416294) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 09:07:21.110303 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee28309-c593-4d16-9909-e954956c91c5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:07:21.111692 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee28309-c593-4d16-9909-e954956c91c5 None admin] RBAC: Authorization granted {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:07:21.125397 dv-cinder-851351-1-smb devstack@keystone.service[416294]: [pid: 416294|app: 0|req: 513/1017] 10.222.0.42 () {56 vars in 1115 bytes} [Thu Jul 28 09:07:20 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:07:21.126679 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e6a294-09ac-468f-b87a-3485e8712f21 None admin] Authenticating user token {{(pid=416293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:07:21.237720 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e6a294-09ac-468f-b87a-3485e8712f21 None admin] Validating token access rules against request {{(pid=416293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:07:21.273286 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19dd41ee-2dd4-4e8c-8b5e-4832800d823c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:07:21.273968 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19dd41ee-2dd4-4e8c-8b5e-4832800d823c None admin] REQUEST_METHOD: `GET` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:07:21.274251 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19dd41ee-2dd4-4e8c-8b5e-4832800d823c None admin] SCRIPT_NAME: `/identity` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:07:21.274535 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19dd41ee-2dd4-4e8c-8b5e-4832800d823c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:07:21.285826 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19dd41ee-2dd4-4e8c-8b5e-4832800d823c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:07:21.287288 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19dd41ee-2dd4-4e8c-8b5e-4832800d823c None admin] RBAC: Authorization granted {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:07:21.302379 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application [None req-19dd41ee-2dd4-4e8c-8b5e-4832800d823c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 09:07:21.302379 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 09:07:21.302379 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 09:07:21.302379 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 09:07:21.302379 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 09:07:21.302379 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 09:07:21.302379 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 09:07:21.302379 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 09:07:21.302379 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 09:07:21.302379 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 09:07:21.302379 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 09:07:21.302379 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 09:07:21.302379 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 09:07:21.302379 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 09:07:21.302379 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 09:07:21.303417 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 09:07:21.303417 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 09:07:21.303417 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 09:07:21.303417 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 09:07:21.303417 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 09:07:21.303417 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 09:07:21.303417 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 09:07:21.303417 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 09:07:21.303417 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application with Lock( Jul 28 09:07:21.303417 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 09:07:21.303417 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self._enter() Jul 28 09:07:21.303417 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 09:07:21.303417 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 09:07:21.303417 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 09:07:21.303417 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self.creator() Jul 28 09:07:21.303417 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 09:07:21.303417 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application created_value = creator( Jul 28 09:07:21.304506 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 09:07:21.304506 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 09:07:21.304506 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 09:07:21.304506 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application Jul 28 09:07:21.304506 dv-cinder-851351-1-smb devstack@keystone.service[416293]: [pid: 416293|app: 0|req: 505/1018] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 09:07:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 09:07:21.310928 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee28309-c593-4d16-9909-e954956c91c5 None admin] Authenticating user token {{(pid=416294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:07:21.382726 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG dbcounter [-] [416294] Writing DB stats keystone:SELECT=100 {{(pid=416294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:07:21.419334 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee28309-c593-4d16-9909-e954956c91c5 None admin] Validating token access rules against request {{(pid=416294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:07:21.454496 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7902845d-4233-445d-a825-17b7f1d1fecc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:07:21.455137 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7902845d-4233-445d-a825-17b7f1d1fecc None admin] REQUEST_METHOD: `GET` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:07:21.455424 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7902845d-4233-445d-a825-17b7f1d1fecc None admin] SCRIPT_NAME: `/identity` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:07:21.455703 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7902845d-4233-445d-a825-17b7f1d1fecc None admin] PATH_INFO: `/v3/domains` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:07:21.456443 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7902845d-4233-445d-a825-17b7f1d1fecc None admin] RBAC: Adding query filter params (name=Default) {{(pid=416294) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 09:07:21.456785 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7902845d-4233-445d-a825-17b7f1d1fecc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:07:21.458175 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7902845d-4233-445d-a825-17b7f1d1fecc None admin] RBAC: Authorization granted {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:07:21.471054 dv-cinder-851351-1-smb devstack@keystone.service[416294]: [pid: 416294|app: 0|req: 514/1019] 10.222.0.42 () {56 vars in 1109 bytes} [Thu Jul 28 09:07:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 09:07:21.476717 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19dd41ee-2dd4-4e8c-8b5e-4832800d823c None admin] Authenticating user token {{(pid=416293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:07:21.485831 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c97a69-c015-4846-86c3-2ce88f9410cd None None] REQUEST_METHOD: `GET` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:07:21.486113 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c97a69-c015-4846-86c3-2ce88f9410cd None None] SCRIPT_NAME: `/identity` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:07:21.486540 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c97a69-c015-4846-86c3-2ce88f9410cd None None] PATH_INFO: `/` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:07:21.488089 dv-cinder-851351-1-smb devstack@keystone.service[416294]: [pid: 416294|app: 0|req: 515/1020] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 09:07:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 09:07:21.493042 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27675d72-3fb9-420c-bfa8-655fb0bfc675 None None] REQUEST_METHOD: `POST` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:07:21.493328 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27675d72-3fb9-420c-bfa8-655fb0bfc675 None None] SCRIPT_NAME: `/identity` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:07:21.493623 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27675d72-3fb9-420c-bfa8-655fb0bfc675 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:07:21.495005 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG dbcounter [-] [416293] Writing DB stats keystone:SELECT=100 {{(pid=416293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:07:21.513627 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.auth.core [None req-27675d72-3fb9-420c-bfa8-655fb0bfc675 None None] MFA Rules not processed for user `dbf87abab90e4fdf9e75408f4199918e`. Rule list: `[]` (Enabled: `True`). {{(pid=416294) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 09:07:21.514835 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.fernet_utils [None req-27675d72-3fb9-420c-bfa8-655fb0bfc675 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=416294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 09:07:21.590238 dv-cinder-851351-1-smb devstack@keystone.service[416294]: [pid: 416294|app: 0|req: 516/1021] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 09:07:21 2022] POST /identity/v3/auth/tokens => generated 1863 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 09:07:21.590715 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19dd41ee-2dd4-4e8c-8b5e-4832800d823c None admin] Validating token access rules against request {{(pid=416293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:07:21.614393 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27675d72-3fb9-420c-bfa8-655fb0bfc675 None None] Authenticating user token {{(pid=416294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:07:21.640516 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f769101-ccfe-4bdf-98b2-c6e0f8e3ff63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:07:21.641341 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f769101-ccfe-4bdf-98b2-c6e0f8e3ff63 None admin] REQUEST_METHOD: `GET` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:07:21.641627 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f769101-ccfe-4bdf-98b2-c6e0f8e3ff63 None admin] SCRIPT_NAME: `/identity` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:07:21.641904 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f769101-ccfe-4bdf-98b2-c6e0f8e3ff63 None admin] PATH_INFO: `/v3/users/nova` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:07:21.650145 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f769101-ccfe-4bdf-98b2-c6e0f8e3ff63 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:07:21.651611 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f769101-ccfe-4bdf-98b2-c6e0f8e3ff63 None admin] RBAC: Authorization granted {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:07:21.663351 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application [None req-8f769101-ccfe-4bdf-98b2-c6e0f8e3ff63 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 28 09:07:21.663351 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 09:07:21.663351 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 09:07:21.663351 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 09:07:21.663351 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 09:07:21.663351 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 09:07:21.663351 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 09:07:21.663351 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 09:07:21.663351 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 09:07:21.663351 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 09:07:21.663351 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 09:07:21.663351 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 09:07:21.663351 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 28 09:07:21.663351 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 28 09:07:21.663351 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 28 09:07:21.663351 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 28 09:07:21.665043 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 09:07:21.665043 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 09:07:21.665043 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 28 09:07:21.665043 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 09:07:21.665043 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 28 09:07:21.665043 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 09:07:21.665043 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 09:07:21.665043 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 09:07:21.665043 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 09:07:21.665043 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 09:07:21.665043 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 09:07:21.665043 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application with Lock( Jul 28 09:07:21.665043 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 09:07:21.665043 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self._enter() Jul 28 09:07:21.665043 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 09:07:21.665043 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 09:07:21.665043 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 09:07:21.665043 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self.creator() Jul 28 09:07:21.666096 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 09:07:21.666096 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application created_value = creator( Jul 28 09:07:21.666096 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 28 09:07:21.666096 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 28 09:07:21.666096 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 28 09:07:21.666096 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 28 09:07:21.666096 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 28 09:07:21.666096 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 28 09:07:21.666096 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 28 09:07:21.666096 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application Jul 28 09:07:21.666096 dv-cinder-851351-1-smb devstack@keystone.service[416293]: [pid: 416293|app: 0|req: 506/1022] 10.222.0.42 () {56 vars in 1093 bytes} [Thu Jul 28 09:07:21 2022] GET /identity/v3/users/nova => generated 82 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 09:07:21.670324 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f769101-ccfe-4bdf-98b2-c6e0f8e3ff63 None admin] Authenticating user token {{(pid=416293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:07:21.681254 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG dbcounter [-] [416294] Writing DB stats keystone:SELECT=100 {{(pid=416294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:07:21.728435 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27675d72-3fb9-420c-bfa8-655fb0bfc675 None None] Validating token access rules against request {{(pid=416294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:07:21.754100 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG dbcounter [-] [416293] Writing DB stats keystone:SELECT=100 {{(pid=416293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:07:21.763515 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1278d3bf-6f0e-4374-95a1-1789345df587 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:07:21.764170 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1278d3bf-6f0e-4374-95a1-1789345df587 None admin] REQUEST_METHOD: `GET` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:07:21.764453 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1278d3bf-6f0e-4374-95a1-1789345df587 None admin] SCRIPT_NAME: `/identity` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:07:21.764741 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1278d3bf-6f0e-4374-95a1-1789345df587 None admin] PATH_INFO: `/v3/domains/default` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:07:21.765923 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1278d3bf-6f0e-4374-95a1-1789345df587 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:07:21.767402 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1278d3bf-6f0e-4374-95a1-1789345df587 None admin] RBAC: Authorization granted {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:07:21.774249 dv-cinder-851351-1-smb devstack@keystone.service[416294]: [pid: 416294|app: 0|req: 517/1023] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 09:07:21 2022] GET /identity/v3/domains/default => generated 199 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:07:21.774249 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18bd982a-4e7b-40e9-84ae-12fe77ef630c None None] REQUEST_METHOD: `GET` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:07:21.774249 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18bd982a-4e7b-40e9-84ae-12fe77ef630c None None] SCRIPT_NAME: `/identity` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:07:21.774249 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18bd982a-4e7b-40e9-84ae-12fe77ef630c None None] PATH_INFO: `/` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:07:21.774249 dv-cinder-851351-1-smb devstack@keystone.service[416294]: [pid: 416294|app: 0|req: 518/1024] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 09:07:21 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 09:07:21.777045 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18bd982a-4e7b-40e9-84ae-12fe77ef630c None None] Authenticating user token {{(pid=416294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:07:21.778461 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f769101-ccfe-4bdf-98b2-c6e0f8e3ff63 None admin] Validating token access rules against request {{(pid=416293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:07:21.816192 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf7dca2-1e79-45f4-92ff-6807dd1b5e98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:07:21.816862 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf7dca2-1e79-45f4-92ff-6807dd1b5e98 None admin] REQUEST_METHOD: `GET` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:07:21.817152 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf7dca2-1e79-45f4-92ff-6807dd1b5e98 None admin] SCRIPT_NAME: `/identity` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:07:21.817433 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf7dca2-1e79-45f4-92ff-6807dd1b5e98 None admin] PATH_INFO: `/v3/users` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:07:21.818242 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faf7dca2-1e79-45f4-92ff-6807dd1b5e98 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=416293) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 09:07:21.818568 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faf7dca2-1e79-45f4-92ff-6807dd1b5e98 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:07:21.820119 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faf7dca2-1e79-45f4-92ff-6807dd1b5e98 None admin] RBAC: Authorization granted {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:07:21.838293 dv-cinder-851351-1-smb devstack@keystone.service[416293]: [pid: 416293|app: 0|req: 507/1025] 10.222.0.42 () {56 vars in 1133 bytes} [Thu Jul 28 09:07:21 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 09:07:21.839592 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0709041f-085b-4381-844f-7808942c1ba6 None None] REQUEST_METHOD: `POST` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:07:21.839885 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0709041f-085b-4381-844f-7808942c1ba6 None None] SCRIPT_NAME: `/identity` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:07:21.840153 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0709041f-085b-4381-844f-7808942c1ba6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:07:21.859354 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.auth.core [None req-0709041f-085b-4381-844f-7808942c1ba6 None None] MFA Rules not processed for user `dbf87abab90e4fdf9e75408f4199918e`. Rule list: `[]` (Enabled: `True`). {{(pid=416293) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 09:07:21.860638 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.fernet_utils [None req-0709041f-085b-4381-844f-7808942c1ba6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=416293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 09:07:21.880602 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18bd982a-4e7b-40e9-84ae-12fe77ef630c None None] Validating token access rules against request {{(pid=416294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:07:21.906741 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG dbcounter [-] [416294] Writing DB stats keystone:SELECT=100 {{(pid=416294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:07:21.916378 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c023530e-7c5a-4b47-8dd4-e392cebc26ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:07:21.917041 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c023530e-7c5a-4b47-8dd4-e392cebc26ec None admin] REQUEST_METHOD: `POST` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:07:21.917312 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c023530e-7c5a-4b47-8dd4-e392cebc26ec None admin] SCRIPT_NAME: `/identity` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:07:21.917582 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c023530e-7c5a-4b47-8dd4-e392cebc26ec None admin] PATH_INFO: `/v3/projects` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:07:21.918268 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c023530e-7c5a-4b47-8dd4-e392cebc26ec None admin] RBAC: Authorizing `identity:create_project()` {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:07:21.919702 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c023530e-7c5a-4b47-8dd4-e392cebc26ec None admin] RBAC: Authorization granted {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:07:21.928363 dv-cinder-851351-1-smb devstack@keystone.service[416293]: [pid: 416293|app: 0|req: 508/1026] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 09:07:21 2022] POST /identity/v3/auth/tokens => generated 1863 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 09:07:21.929264 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0709041f-085b-4381-844f-7808942c1ba6 None None] Authenticating user token {{(pid=416293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:07:21.953704 dv-cinder-851351-1-smb devstack@keystone.service[416294]: [pid: 416294|app: 0|req: 519/1027] 10.222.0.42 () {60 vars in 1141 bytes} [Thu Jul 28 09:07:21 2022] POST /identity/v3/projects => generated 311 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 09:07:21.953704 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c023530e-7c5a-4b47-8dd4-e392cebc26ec None admin] Authenticating user token {{(pid=416294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:07:22.003874 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG dbcounter [-] [416293] Writing DB stats keystone:SELECT=100 {{(pid=416293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:07:22.050451 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0709041f-085b-4381-844f-7808942c1ba6 None None] Validating token access rules against request {{(pid=416293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:07:22.092539 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c023530e-7c5a-4b47-8dd4-e392cebc26ec None admin] Validating token access rules against request {{(pid=416294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:07:22.097958 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f3e2adf-2132-46b3-9fae-37fc2e682a9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:07:22.098613 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3e2adf-2132-46b3-9fae-37fc2e682a9d None admin] REQUEST_METHOD: `GET` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:07:22.098903 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3e2adf-2132-46b3-9fae-37fc2e682a9d None admin] SCRIPT_NAME: `/identity` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:07:22.099183 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3e2adf-2132-46b3-9fae-37fc2e682a9d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:07:22.138381 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad57127-3386-4286-b0d7-7ab54be87977 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:07:22.139044 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad57127-3386-4286-b0d7-7ab54be87977 None admin] REQUEST_METHOD: `POST` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:07:22.139327 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad57127-3386-4286-b0d7-7ab54be87977 None admin] SCRIPT_NAME: `/identity` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:07:22.139603 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad57127-3386-4286-b0d7-7ab54be87977 None admin] PATH_INFO: `/v3/services` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:07:22.140315 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fad57127-3386-4286-b0d7-7ab54be87977 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:07:22.141928 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fad57127-3386-4286-b0d7-7ab54be87977 None admin] RBAC: Authorization granted {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:07:22.158802 dv-cinder-851351-1-smb devstack@keystone.service[416294]: [pid: 416294|app: 0|req: 520/1028] 10.222.0.42 () {60 vars in 1141 bytes} [Thu Jul 28 09:07:21 2022] POST /identity/v3/services => generated 242 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 09:07:22.185936 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f3e2adf-2132-46b3-9fae-37fc2e682a9d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:07:22.187495 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f3e2adf-2132-46b3-9fae-37fc2e682a9d None admin] RBAC: Authorization granted {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:07:22.259537 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG dbcounter [-] [416293] Writing DB stats keystone:SELECT=100 {{(pid=416293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:07:22.306314 dv-cinder-851351-1-smb devstack@keystone.service[416293]: [pid: 416293|app: 0|req: 509/1029] 10.222.0.42 () {58 vars in 1282 bytes} [Thu Jul 28 09:07:21 2022] GET /identity/v3/auth/tokens => generated 1863 bytes in 377 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 28 09:07:22.312455 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad57127-3386-4286-b0d7-7ab54be87977 None admin] Authenticating user token {{(pid=416294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:07:22.362366 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG dbcounter [-] [416294] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=416294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:07:22.436327 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad57127-3386-4286-b0d7-7ab54be87977 None admin] Validating token access rules against request {{(pid=416294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:07:22.476415 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9343f9b3-9362-4fb9-b84a-53569e9c7907 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:07:22.477141 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9343f9b3-9362-4fb9-b84a-53569e9c7907 None admin] REQUEST_METHOD: `GET` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:07:22.477425 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9343f9b3-9362-4fb9-b84a-53569e9c7907 None admin] SCRIPT_NAME: `/identity` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:07:22.477699 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9343f9b3-9362-4fb9-b84a-53569e9c7907 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:07:22.489933 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9343f9b3-9362-4fb9-b84a-53569e9c7907 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:07:22.491449 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9343f9b3-9362-4fb9-b84a-53569e9c7907 None admin] RBAC: Authorization granted {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:07:22.508497 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application [None req-9343f9b3-9362-4fb9-b84a-53569e9c7907 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 09:07:22.508497 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 09:07:22.508497 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 09:07:22.508497 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 09:07:22.508497 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 09:07:22.508497 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 09:07:22.508497 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 09:07:22.508497 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 09:07:22.508497 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 09:07:22.508497 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 09:07:22.508497 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 09:07:22.508497 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 09:07:22.508497 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 09:07:22.508497 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 09:07:22.508497 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 09:07:22.509641 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 09:07:22.509641 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 09:07:22.509641 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 09:07:22.509641 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 09:07:22.509641 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 09:07:22.509641 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 09:07:22.509641 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 09:07:22.509641 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 09:07:22.509641 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application with Lock( Jul 28 09:07:22.509641 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 09:07:22.509641 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return self._enter() Jul 28 09:07:22.509641 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 09:07:22.509641 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 09:07:22.509641 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 09:07:22.509641 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return self.creator() Jul 28 09:07:22.509641 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 09:07:22.509641 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application created_value = creator( Jul 28 09:07:22.510640 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 09:07:22.510640 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 09:07:22.510640 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 09:07:22.510640 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application Jul 28 09:07:22.510640 dv-cinder-851351-1-smb devstack@keystone.service[416294]: [pid: 416294|app: 0|req: 521/1030] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 09:07:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 09:07:22.517206 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f3e2adf-2132-46b3-9fae-37fc2e682a9d None admin] Authenticating user token {{(pid=416293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:07:22.631902 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f3e2adf-2132-46b3-9fae-37fc2e682a9d None admin] Validating token access rules against request {{(pid=416293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:07:22.672306 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dfc6370-23ce-4f02-9986-1c51c46865b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:07:22.673058 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dfc6370-23ce-4f02-9986-1c51c46865b4 None admin] REQUEST_METHOD: `GET` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:07:22.673356 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dfc6370-23ce-4f02-9986-1c51c46865b4 None admin] SCRIPT_NAME: `/identity` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:07:22.673731 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dfc6370-23ce-4f02-9986-1c51c46865b4 None admin] PATH_INFO: `/v3/domains` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:07:22.674527 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dfc6370-23ce-4f02-9986-1c51c46865b4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=416293) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 09:07:22.674840 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dfc6370-23ce-4f02-9986-1c51c46865b4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:07:22.676432 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dfc6370-23ce-4f02-9986-1c51c46865b4 None admin] RBAC: Authorization granted {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:07:22.690159 dv-cinder-851351-1-smb devstack@keystone.service[416293]: [pid: 416293|app: 0|req: 510/1031] 10.222.0.42 () {56 vars in 1109 bytes} [Thu Jul 28 09:07:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:07:22.695950 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9343f9b3-9362-4fb9-b84a-53569e9c7907 None admin] Authenticating user token {{(pid=416294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:07:22.795820 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG dbcounter [-] [416294] Writing DB stats keystone:SELECT=100 {{(pid=416294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:07:22.814071 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9343f9b3-9362-4fb9-b84a-53569e9c7907 None admin] Validating token access rules against request {{(pid=416294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:07:22.851135 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a9bbfe5-f7fc-4d5b-b98c-73630f086e69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:07:22.851794 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9bbfe5-f7fc-4d5b-b98c-73630f086e69 None admin] REQUEST_METHOD: `GET` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:07:22.852080 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9bbfe5-f7fc-4d5b-b98c-73630f086e69 None admin] SCRIPT_NAME: `/identity` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:07:22.852344 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9bbfe5-f7fc-4d5b-b98c-73630f086e69 None admin] PATH_INFO: `/v3/projects/service` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:07:22.860514 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a9bbfe5-f7fc-4d5b-b98c-73630f086e69 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:07:22.862011 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a9bbfe5-f7fc-4d5b-b98c-73630f086e69 None admin] RBAC: Authorization granted {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:07:22.873776 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application [None req-3a9bbfe5-f7fc-4d5b-b98c-73630f086e69 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 09:07:22.873776 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 09:07:22.873776 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 09:07:22.873776 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 09:07:22.873776 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 09:07:22.873776 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 09:07:22.873776 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 09:07:22.873776 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 09:07:22.873776 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 09:07:22.873776 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 09:07:22.873776 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 09:07:22.873776 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 09:07:22.873776 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 28 09:07:22.873776 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 28 09:07:22.873776 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 28 09:07:22.874783 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 28 09:07:22.874783 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 09:07:22.874783 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 09:07:22.874783 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 09:07:22.874783 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 09:07:22.874783 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 09:07:22.874783 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 09:07:22.874783 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 09:07:22.874783 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application with Lock( Jul 28 09:07:22.874783 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 09:07:22.874783 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return self._enter() Jul 28 09:07:22.874783 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 09:07:22.874783 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 09:07:22.874783 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 09:07:22.874783 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return self.creator() Jul 28 09:07:22.874783 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 09:07:22.874783 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application created_value = creator( Jul 28 09:07:22.875796 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 28 09:07:22.875796 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 28 09:07:22.875796 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 28 09:07:22.875796 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 28 09:07:22.875796 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 28 09:07:22.875796 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 28 09:07:22.875796 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 09:07:22.875796 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application Jul 28 09:07:22.879852 dv-cinder-851351-1-smb devstack@keystone.service[416294]: [pid: 416294|app: 0|req: 522/1032] 10.222.0.42 () {56 vars in 1111 bytes} [Thu Jul 28 09:07:22 2022] GET /identity/v3/projects/service => generated 88 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 09:07:22.882277 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dfc6370-23ce-4f02-9986-1c51c46865b4 None admin] Authenticating user token {{(pid=416293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:07:22.909932 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG dbcounter [-] [416293] Writing DB stats keystone:SELECT=100 {{(pid=416293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:07:23.001814 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dfc6370-23ce-4f02-9986-1c51c46865b4 None admin] Validating token access rules against request {{(pid=416293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:07:23.039950 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa82d294-0947-4294-89e6-e1be04890c08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:07:23.040590 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa82d294-0947-4294-89e6-e1be04890c08 None admin] REQUEST_METHOD: `GET` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:07:23.040917 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa82d294-0947-4294-89e6-e1be04890c08 None admin] SCRIPT_NAME: `/identity` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:07:23.041193 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa82d294-0947-4294-89e6-e1be04890c08 None admin] PATH_INFO: `/v3/projects` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:07:23.041963 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa82d294-0947-4294-89e6-e1be04890c08 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=416293) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 09:07:23.042266 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa82d294-0947-4294-89e6-e1be04890c08 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:07:23.043747 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa82d294-0947-4294-89e6-e1be04890c08 None admin] RBAC: Authorization granted {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:07:23.057562 dv-cinder-851351-1-smb devstack@keystone.service[416293]: [pid: 416293|app: 0|req: 511/1033] 10.222.0.42 () {56 vars in 1148 bytes} [Thu Jul 28 09:07:22 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:07:23.064026 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a9bbfe5-f7fc-4d5b-b98c-73630f086e69 None admin] Authenticating user token {{(pid=416294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:07:23.190104 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a9bbfe5-f7fc-4d5b-b98c-73630f086e69 None admin] Validating token access rules against request {{(pid=416294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:07:23.227347 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84be0a49-aa0f-4aa6-be3d-c877ec733cc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:07:23.227971 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84be0a49-aa0f-4aa6-be3d-c877ec733cc2 None admin] REQUEST_METHOD: `GET` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:07:23.228250 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84be0a49-aa0f-4aa6-be3d-c877ec733cc2 None admin] SCRIPT_NAME: `/identity` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:07:23.228523 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84be0a49-aa0f-4aa6-be3d-c877ec733cc2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:07:23.229368 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84be0a49-aa0f-4aa6-be3d-c877ec733cc2 None admin] RBAC: Adding query filter params (role.id=4d94122535c54ae98fbaf3c8766c59be, scope.project.id=6c4349445f224184b093d9dfd0dfc642, user.id=62f7da38a7044000bdf5790da751a45e) {{(pid=416294) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 09:07:23.229674 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84be0a49-aa0f-4aa6-be3d-c877ec733cc2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:07:23.231151 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84be0a49-aa0f-4aa6-be3d-c877ec733cc2 None admin] RBAC: Authorization granted {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:07:23.237447 dv-cinder-851351-1-smb devstack@keystone.service[416294]: [pid: 416294|app: 0|req: 523/1034] 10.222.0.42 () {56 vars in 1374 bytes} [Thu Jul 28 09:07:23 2022] GET /identity/v3/role_assignments?user.id=62f7da38a7044000bdf5790da751a45e&scope.project.id=6c4349445f224184b093d9dfd0dfc642&role.id=4d94122535c54ae98fbaf3c8766c59be => generated 259 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 09:07:24.083025 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac9683b-144e-462d-951c-a5ca42834ad3 None None] REQUEST_METHOD: `GET` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:07:24.083585 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac9683b-144e-462d-951c-a5ca42834ad3 None None] SCRIPT_NAME: `/identity` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:07:24.083585 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac9683b-144e-462d-951c-a5ca42834ad3 None None] PATH_INFO: `/` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:07:24.085197 dv-cinder-851351-1-smb devstack@keystone.service[416293]: [pid: 416293|app: 0|req: 512/1035] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 09:07:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 09:07:24.090363 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e61b1dd-ca0a-40de-8eaa-0aa1c9b1ef19 None None] REQUEST_METHOD: `POST` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:07:24.090823 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e61b1dd-ca0a-40de-8eaa-0aa1c9b1ef19 None None] SCRIPT_NAME: `/identity` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:07:24.090920 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e61b1dd-ca0a-40de-8eaa-0aa1c9b1ef19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:07:24.110019 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.auth.core [None req-2e61b1dd-ca0a-40de-8eaa-0aa1c9b1ef19 None None] MFA Rules not processed for user `dbf87abab90e4fdf9e75408f4199918e`. Rule list: `[]` (Enabled: `True`). {{(pid=416294) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 09:07:24.111243 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.fernet_utils [None req-2e61b1dd-ca0a-40de-8eaa-0aa1c9b1ef19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=416294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 09:07:24.115013 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG dbcounter [-] [416294] Writing DB stats keystone:SELECT=100 {{(pid=416294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:07:24.203177 dv-cinder-851351-1-smb devstack@keystone.service[416294]: [pid: 416294|app: 0|req: 524/1036] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 09:07:24 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 09:07:24.223291 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd506616-41de-4a28-96cc-a16052457b23 None None] REQUEST_METHOD: `GET` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:07:24.223506 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd506616-41de-4a28-96cc-a16052457b23 None None] SCRIPT_NAME: `/identity` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:07:24.223709 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd506616-41de-4a28-96cc-a16052457b23 None None] PATH_INFO: `/` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:07:24.225317 dv-cinder-851351-1-smb devstack@keystone.service[416293]: [pid: 416293|app: 0|req: 513/1037] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 09:07:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 09:07:24.227536 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e61b1dd-ca0a-40de-8eaa-0aa1c9b1ef19 None None] Authenticating user token {{(pid=416294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:07:24.231912 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4511f61-4385-4670-8de7-e62d19c15f98 None None] REQUEST_METHOD: `POST` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:07:24.232200 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4511f61-4385-4670-8de7-e62d19c15f98 None None] SCRIPT_NAME: `/identity` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:07:24.232480 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4511f61-4385-4670-8de7-e62d19c15f98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:07:24.261080 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.auth.core [None req-e4511f61-4385-4670-8de7-e62d19c15f98 None None] MFA Rules not processed for user `dbf87abab90e4fdf9e75408f4199918e`. Rule list: `[]` (Enabled: `True`). {{(pid=416293) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 09:07:24.263038 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.fernet_utils [None req-e4511f61-4385-4670-8de7-e62d19c15f98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=416293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 09:07:24.361421 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e61b1dd-ca0a-40de-8eaa-0aa1c9b1ef19 None None] Validating token access rules against request {{(pid=416294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:07:24.369357 dv-cinder-851351-1-smb devstack@keystone.service[416293]: [pid: 416293|app: 0|req: 514/1038] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 09:07:24 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 09:07:24.392218 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4511f61-4385-4670-8de7-e62d19c15f98 None None] Authenticating user token {{(pid=416293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:07:24.408019 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG dbcounter [-] [416293] Writing DB stats keystone:SELECT=100 {{(pid=416293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:07:24.412435 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a7203d-b3e3-4191-ad64-edec26b153d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:07:24.413349 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a7203d-b3e3-4191-ad64-edec26b153d7 None admin] REQUEST_METHOD: `GET` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:07:24.413808 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a7203d-b3e3-4191-ad64-edec26b153d7 None admin] SCRIPT_NAME: `/identity` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:07:24.414063 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a7203d-b3e3-4191-ad64-edec26b153d7 None admin] PATH_INFO: `/v3/domains/default` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:07:24.415372 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a7203d-b3e3-4191-ad64-edec26b153d7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:07:24.417018 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a7203d-b3e3-4191-ad64-edec26b153d7 None admin] RBAC: Authorization granted {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:07:24.418982 dv-cinder-851351-1-smb devstack@keystone.service[416294]: [pid: 416294|app: 0|req: 525/1039] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 09:07:24 2022] GET /identity/v3/domains/default => generated 199 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:07:24.427395 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a7203d-b3e3-4191-ad64-edec26b153d7 None admin] Authenticating user token {{(pid=416294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:07:24.444396 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG dbcounter [-] [416294] Writing DB stats keystone:SELECT=100 {{(pid=416294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:07:24.525837 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4511f61-4385-4670-8de7-e62d19c15f98 None None] Validating token access rules against request {{(pid=416293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:07:24.562161 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72a9215-2901-4156-a102-f310f51085f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:07:24.562825 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72a9215-2901-4156-a102-f310f51085f6 None admin] REQUEST_METHOD: `GET` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:07:24.563122 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72a9215-2901-4156-a102-f310f51085f6 None admin] SCRIPT_NAME: `/identity` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:07:24.563397 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72a9215-2901-4156-a102-f310f51085f6 None admin] PATH_INFO: `/v3/services/image` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:07:24.564037 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c72a9215-2901-4156-a102-f310f51085f6 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:07:24.565491 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c72a9215-2901-4156-a102-f310f51085f6 None admin] RBAC: Authorization granted {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:07:24.568980 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a7203d-b3e3-4191-ad64-edec26b153d7 None admin] Validating token access rules against request {{(pid=416294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:07:24.575144 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application [None req-c72a9215-2901-4156-a102-f310f51085f6 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jul 28 09:07:24.575144 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 09:07:24.575144 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 28 09:07:24.575144 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 28 09:07:24.575144 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 28 09:07:24.575144 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 28 09:07:24.575144 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 28 09:07:24.575144 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 09:07:24.575144 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 28 09:07:24.575144 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application Jul 28 09:07:24.575144 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 28 09:07:24.575144 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application Jul 28 09:07:24.575144 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 09:07:24.575144 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 09:07:24.575144 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 09:07:24.575144 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 09:07:24.575144 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 09:07:24.576221 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 09:07:24.576221 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 09:07:24.576221 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 09:07:24.576221 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 09:07:24.576221 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 09:07:24.576221 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 09:07:24.576221 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 28 09:07:24.576221 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 28 09:07:24.576221 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 28 09:07:24.576221 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 28 09:07:24.576221 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 09:07:24.576221 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 09:07:24.576221 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 09:07:24.576221 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 09:07:24.576221 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 09:07:24.576221 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 09:07:24.582662 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 09:07:24.582662 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application with Lock( Jul 28 09:07:24.582662 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 09:07:24.582662 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self._enter() Jul 28 09:07:24.582662 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 09:07:24.582662 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 09:07:24.582662 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 09:07:24.582662 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self.creator() Jul 28 09:07:24.582662 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 09:07:24.582662 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application created_value = creator( Jul 28 09:07:24.582662 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 28 09:07:24.582662 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 09:07:24.582662 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 28 09:07:24.582662 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application Jul 28 09:07:24.582662 dv-cinder-851351-1-smb devstack@keystone.service[416293]: [pid: 416293|app: 0|req: 515/1040] 10.222.0.42 () {56 vars in 1105 bytes} [Thu Jul 28 09:07:24 2022] GET /identity/v3/services/image => generated 86 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 09:07:24.585615 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72a9215-2901-4156-a102-f310f51085f6 None admin] Authenticating user token {{(pid=416293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:07:24.611805 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c71068ee-3ded-476a-8df1-8bae48f915c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:07:24.612427 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71068ee-3ded-476a-8df1-8bae48f915c6 None admin] REQUEST_METHOD: `POST` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:07:24.612733 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71068ee-3ded-476a-8df1-8bae48f915c6 None admin] SCRIPT_NAME: `/identity` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:07:24.613012 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71068ee-3ded-476a-8df1-8bae48f915c6 None admin] PATH_INFO: `/v3/users` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:07:24.613687 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c71068ee-3ded-476a-8df1-8bae48f915c6 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:07:24.615121 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c71068ee-3ded-476a-8df1-8bae48f915c6 None admin] RBAC: Authorization granted {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:07:24.644712 dv-cinder-851351-1-smb devstack@keystone.service[416294]: [pid: 416294|app: 0|req: 526/1041] 10.222.0.42 () {60 vars in 1132 bytes} [Thu Jul 28 09:07:24 2022] POST /identity/v3/users => generated 285 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 28 09:07:24.699820 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG dbcounter [-] [416293] Writing DB stats keystone:SELECT=100 {{(pid=416293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:07:24.728284 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72a9215-2901-4156-a102-f310f51085f6 None admin] Validating token access rules against request {{(pid=416293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:07:24.784485 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8e839e-74aa-4fb5-a50b-9f5aec38ea65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:07:24.785461 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8e839e-74aa-4fb5-a50b-9f5aec38ea65 None admin] REQUEST_METHOD: `GET` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:07:24.785913 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8e839e-74aa-4fb5-a50b-9f5aec38ea65 None admin] SCRIPT_NAME: `/identity` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:07:24.786348 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8e839e-74aa-4fb5-a50b-9f5aec38ea65 None admin] PATH_INFO: `/v3/services` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:07:24.787532 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a8e839e-74aa-4fb5-a50b-9f5aec38ea65 None admin] RBAC: Adding query filter params (name=image) {{(pid=416293) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 09:07:24.788054 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a8e839e-74aa-4fb5-a50b-9f5aec38ea65 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:07:24.790692 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a8e839e-74aa-4fb5-a50b-9f5aec38ea65 None admin] RBAC: Authorization granted {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:07:24.800565 dv-cinder-851351-1-smb devstack@keystone.service[416293]: [pid: 416293|app: 0|req: 516/1042] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 09:07:24 2022] GET /identity/v3/services?name=image => generated 122 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:07:24.806303 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c71068ee-3ded-476a-8df1-8bae48f915c6 None admin] Authenticating user token {{(pid=416294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:07:24.901587 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG dbcounter [-] [416294] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=416294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:07:24.953676 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c71068ee-3ded-476a-8df1-8bae48f915c6 None admin] Validating token access rules against request {{(pid=416294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:07:24.995786 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d5fc048-e9b3-4f81-bec1-3e4f59f0ab94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:07:24.996580 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5fc048-e9b3-4f81-bec1-3e4f59f0ab94 None admin] REQUEST_METHOD: `GET` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:07:24.996822 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5fc048-e9b3-4f81-bec1-3e4f59f0ab94 None admin] SCRIPT_NAME: `/identity` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:07:24.996999 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5fc048-e9b3-4f81-bec1-3e4f59f0ab94 None admin] PATH_INFO: `/v3/services` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:07:24.997684 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d5fc048-e9b3-4f81-bec1-3e4f59f0ab94 None admin] RBAC: Adding query filter params (type=image) {{(pid=416294) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 09:07:24.997986 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d5fc048-e9b3-4f81-bec1-3e4f59f0ab94 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:07:24.999372 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d5fc048-e9b3-4f81-bec1-3e4f59f0ab94 None admin] RBAC: Authorization granted {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:07:25.009587 dv-cinder-851351-1-smb devstack@keystone.service[416294]: [pid: 416294|app: 0|req: 527/1043] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 09:07:24 2022] GET /identity/v3/services?type=image => generated 350 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 09:07:25.011214 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8e839e-74aa-4fb5-a50b-9f5aec38ea65 None admin] Authenticating user token {{(pid=416293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:07:25.120509 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8e839e-74aa-4fb5-a50b-9f5aec38ea65 None admin] Validating token access rules against request {{(pid=416293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:07:25.155381 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd7ff58-e2ed-4350-ad50-ad3c472db364 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:07:25.156027 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd7ff58-e2ed-4350-ad50-ad3c472db364 None admin] REQUEST_METHOD: `GET` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:07:25.156387 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd7ff58-e2ed-4350-ad50-ad3c472db364 None admin] SCRIPT_NAME: `/identity` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:07:25.156622 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd7ff58-e2ed-4350-ad50-ad3c472db364 None admin] PATH_INFO: `/v3/endpoints` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:07:25.157418 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd7ff58-e2ed-4350-ad50-ad3c472db364 None admin] RBAC: Adding query filter params (interface=public, service_id=6b173d7094194b75b2345dafd1cfae3d, region_id=RegionOne) {{(pid=416293) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 09:07:25.157726 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd7ff58-e2ed-4350-ad50-ad3c472db364 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:07:25.159115 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd7ff58-e2ed-4350-ad50-ad3c472db364 None admin] RBAC: Authorization granted {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:07:25.164779 dv-cinder-851351-1-smb devstack@keystone.service[416293]: [pid: 416293|app: 0|req: 517/1044] 10.222.0.42 () {56 vars in 1251 bytes} [Thu Jul 28 09:07:25 2022] GET /identity/v3/endpoints?service_id=6b173d7094194b75b2345dafd1cfae3d&interface=public®ion_id=RegionOne => generated 194 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 09:07:25.170252 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d5fc048-e9b3-4f81-bec1-3e4f59f0ab94 None admin] Authenticating user token {{(pid=416294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:07:25.280496 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d5fc048-e9b3-4f81-bec1-3e4f59f0ab94 None admin] Validating token access rules against request {{(pid=416294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:07:25.308841 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG dbcounter [-] [416294] Writing DB stats keystone:SELECT=100 {{(pid=416294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:07:25.318545 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1925bcb9-896c-4967-b009-2eb983f4ab75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:07:25.319153 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1925bcb9-896c-4967-b009-2eb983f4ab75 None admin] REQUEST_METHOD: `GET` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:07:25.319431 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1925bcb9-896c-4967-b009-2eb983f4ab75 None admin] SCRIPT_NAME: `/identity` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:07:25.319706 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1925bcb9-896c-4967-b009-2eb983f4ab75 None admin] PATH_INFO: `/v3/services` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:07:25.320379 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1925bcb9-896c-4967-b009-2eb983f4ab75 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:07:25.321781 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1925bcb9-896c-4967-b009-2eb983f4ab75 None admin] RBAC: Authorization granted {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:07:25.329625 dv-cinder-851351-1-smb devstack@keystone.service[416294]: [pid: 416294|app: 0|req: 528/1045] 10.222.0.42 () {56 vars in 1087 bytes} [Thu Jul 28 09:07:25 2022] GET /identity/v3/services => generated 1957 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 09:07:25.369567 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7b7f3c-eccc-458c-a694-2312a2db4c00 None None] REQUEST_METHOD: `GET` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:07:25.369932 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7b7f3c-eccc-458c-a694-2312a2db4c00 None None] SCRIPT_NAME: `/identity` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:07:25.370132 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7b7f3c-eccc-458c-a694-2312a2db4c00 None None] PATH_INFO: `/` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:07:25.371963 dv-cinder-851351-1-smb devstack@keystone.service[416293]: [pid: 416293|app: 0|req: 518/1046] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 09:07:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 09:07:25.377677 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a2e0c8-fdec-40dd-8e3f-12d263c59769 None None] REQUEST_METHOD: `POST` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:07:25.378043 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a2e0c8-fdec-40dd-8e3f-12d263c59769 None None] SCRIPT_NAME: `/identity` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:07:25.378229 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a2e0c8-fdec-40dd-8e3f-12d263c59769 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:07:25.399680 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.auth.core [None req-05a2e0c8-fdec-40dd-8e3f-12d263c59769 None None] MFA Rules not processed for user `dbf87abab90e4fdf9e75408f4199918e`. Rule list: `[]` (Enabled: `True`). {{(pid=416294) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 09:07:25.400956 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.fernet_utils [None req-05a2e0c8-fdec-40dd-8e3f-12d263c59769 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=416294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 09:07:25.483813 dv-cinder-851351-1-smb devstack@keystone.service[416294]: [pid: 416294|app: 0|req: 529/1047] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 09:07:25 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 09:07:25.507275 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7b7f3c-eccc-458c-a694-2312a2db4c00 None None] Authenticating user token {{(pid=416293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:07:25.513250 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG dbcounter [-] [416293] Writing DB stats keystone:SELECT=100 {{(pid=416293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:07:25.623430 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7b7f3c-eccc-458c-a694-2312a2db4c00 None None] Validating token access rules against request {{(pid=416293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:07:25.658415 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e46e7b9-18a5-4ecf-ab42-81bb0bf3bee6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:07:25.659082 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e46e7b9-18a5-4ecf-ab42-81bb0bf3bee6 None admin] REQUEST_METHOD: `GET` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:07:25.659371 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e46e7b9-18a5-4ecf-ab42-81bb0bf3bee6 None admin] SCRIPT_NAME: `/identity` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:07:25.659649 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e46e7b9-18a5-4ecf-ab42-81bb0bf3bee6 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:07:25.671154 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e46e7b9-18a5-4ecf-ab42-81bb0bf3bee6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 09:07:25.676252 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application [None req-8e46e7b9-18a5-4ecf-ab42-81bb0bf3bee6 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 28 09:07:25.676252 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 09:07:25.676252 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 09:07:25.676252 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 09:07:25.676252 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 09:07:25.676252 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 09:07:25.676252 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 09:07:25.676252 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 09:07:25.676252 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 09:07:25.676252 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 09:07:25.676252 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 09:07:25.676252 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 09:07:25.676252 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 09:07:25.676252 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 09:07:25.676252 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 09:07:25.676252 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 09:07:25.677588 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 09:07:25.677588 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 09:07:25.677588 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 09:07:25.677588 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 09:07:25.677588 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 09:07:25.677588 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 09:07:25.677588 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 09:07:25.677588 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 09:07:25.677588 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 09:07:25.677588 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 09:07:25.677588 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 09:07:25.677588 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application with Lock( Jul 28 09:07:25.677588 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 09:07:25.677588 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self._enter() Jul 28 09:07:25.677588 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 09:07:25.677588 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 09:07:25.678510 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 09:07:25.678510 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self.creator() Jul 28 09:07:25.678510 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 09:07:25.678510 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application created_value = creator( Jul 28 09:07:25.678510 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 09:07:25.678510 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 09:07:25.678510 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 09:07:25.678510 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 09:07:25.678510 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 09:07:25.678510 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 09:07:25.678510 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 28 09:07:25.678510 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application Jul 28 09:07:25.679749 dv-cinder-851351-1-smb devstack@keystone.service[416293]: [pid: 416293|app: 0|req: 519/1048] 10.222.0.42 () {56 vars in 1120 bytes} [Thu Jul 28 09:07:25 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 09:07:25.683941 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a2e0c8-fdec-40dd-8e3f-12d263c59769 None None] Authenticating user token {{(pid=416294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:07:25.793055 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a2e0c8-fdec-40dd-8e3f-12d263c59769 None None] Validating token access rules against request {{(pid=416294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:07:25.819214 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG dbcounter [-] [416294] Writing DB stats keystone:SELECT=100 {{(pid=416294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:07:25.833408 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db238bcc-c38d-4238-97f4-2bd1278cca9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:07:25.834058 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db238bcc-c38d-4238-97f4-2bd1278cca9a None admin] REQUEST_METHOD: `GET` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:07:25.834344 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db238bcc-c38d-4238-97f4-2bd1278cca9a None admin] SCRIPT_NAME: `/identity` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:07:25.834620 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db238bcc-c38d-4238-97f4-2bd1278cca9a None admin] PATH_INFO: `/v3/roles` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:07:25.835368 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db238bcc-c38d-4238-97f4-2bd1278cca9a None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=416294) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 09:07:25.835678 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db238bcc-c38d-4238-97f4-2bd1278cca9a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:07:25.837124 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db238bcc-c38d-4238-97f4-2bd1278cca9a None admin] RBAC: Authorization granted {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:07:25.847990 dv-cinder-851351-1-smb devstack@keystone.service[416294]: [pid: 416294|app: 0|req: 530/1049] 10.222.0.42 () {56 vars in 1115 bytes} [Thu Jul 28 09:07:25 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:07:25.854433 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e46e7b9-18a5-4ecf-ab42-81bb0bf3bee6 None admin] Authenticating user token {{(pid=416293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:07:25.923938 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG dbcounter [-] [416293] Writing DB stats keystone:SELECT=100 {{(pid=416293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:07:25.971393 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e46e7b9-18a5-4ecf-ab42-81bb0bf3bee6 None admin] Validating token access rules against request {{(pid=416293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:07:26.010729 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa780b6f-ba99-43a8-a73f-cd7fb9220c5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:07:26.011400 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa780b6f-ba99-43a8-a73f-cd7fb9220c5d None admin] REQUEST_METHOD: `GET` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:07:26.011684 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa780b6f-ba99-43a8-a73f-cd7fb9220c5d None admin] SCRIPT_NAME: `/identity` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:07:26.011961 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa780b6f-ba99-43a8-a73f-cd7fb9220c5d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:07:26.023484 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa780b6f-ba99-43a8-a73f-cd7fb9220c5d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:07:26.024999 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa780b6f-ba99-43a8-a73f-cd7fb9220c5d None admin] RBAC: Authorization granted {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:07:26.040481 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application [None req-aa780b6f-ba99-43a8-a73f-cd7fb9220c5d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 09:07:26.040481 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 09:07:26.040481 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 09:07:26.040481 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 09:07:26.040481 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 09:07:26.040481 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 09:07:26.040481 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 09:07:26.040481 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 09:07:26.040481 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 09:07:26.040481 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 09:07:26.040481 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 09:07:26.040481 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 09:07:26.040481 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 09:07:26.040481 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 09:07:26.040481 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 09:07:26.041674 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 09:07:26.041674 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 09:07:26.041674 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 09:07:26.041674 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 09:07:26.041674 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 09:07:26.041674 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 09:07:26.041674 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 09:07:26.041674 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 09:07:26.041674 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application with Lock( Jul 28 09:07:26.041674 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 09:07:26.041674 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self._enter() Jul 28 09:07:26.041674 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 09:07:26.041674 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 09:07:26.041674 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 09:07:26.041674 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self.creator() Jul 28 09:07:26.041674 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 09:07:26.041674 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application created_value = creator( Jul 28 09:07:26.047963 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 09:07:26.047963 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 09:07:26.047963 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 09:07:26.047963 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application Jul 28 09:07:26.047963 dv-cinder-851351-1-smb devstack@keystone.service[416293]: [pid: 416293|app: 0|req: 520/1050] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 09:07:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 09:07:26.048271 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db238bcc-c38d-4238-97f4-2bd1278cca9a None admin] Authenticating user token {{(pid=416294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:07:26.157577 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db238bcc-c38d-4238-97f4-2bd1278cca9a None admin] Validating token access rules against request {{(pid=416294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:07:26.194534 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93c1662-63da-4ac1-9a99-5188a7e95c86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:07:26.195188 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93c1662-63da-4ac1-9a99-5188a7e95c86 None admin] REQUEST_METHOD: `GET` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:07:26.195297 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93c1662-63da-4ac1-9a99-5188a7e95c86 None admin] SCRIPT_NAME: `/identity` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:07:26.195574 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93c1662-63da-4ac1-9a99-5188a7e95c86 None admin] PATH_INFO: `/v3/domains` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:07:26.196325 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b93c1662-63da-4ac1-9a99-5188a7e95c86 None admin] RBAC: Adding query filter params (name=Default) {{(pid=416294) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 09:07:26.196692 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b93c1662-63da-4ac1-9a99-5188a7e95c86 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:07:26.198094 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b93c1662-63da-4ac1-9a99-5188a7e95c86 None admin] RBAC: Authorization granted {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:07:26.217765 dv-cinder-851351-1-smb devstack@keystone.service[416294]: [pid: 416294|app: 0|req: 531/1051] 10.222.0.42 () {56 vars in 1109 bytes} [Thu Jul 28 09:07:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:07:26.223877 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa780b6f-ba99-43a8-a73f-cd7fb9220c5d None admin] Authenticating user token {{(pid=416293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:07:26.333481 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa780b6f-ba99-43a8-a73f-cd7fb9220c5d None admin] Validating token access rules against request {{(pid=416293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:07:26.351194 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG dbcounter [-] [416293] Writing DB stats keystone:SELECT=100 {{(pid=416293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:07:26.371393 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf81bcc0-26cc-42f0-b6d7-df5b667f6696 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:07:26.372373 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf81bcc0-26cc-42f0-b6d7-df5b667f6696 None admin] REQUEST_METHOD: `GET` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:07:26.372867 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf81bcc0-26cc-42f0-b6d7-df5b667f6696 None admin] SCRIPT_NAME: `/identity` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:07:26.373297 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf81bcc0-26cc-42f0-b6d7-df5b667f6696 None admin] PATH_INFO: `/v3/users/nova` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:07:26.382235 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf81bcc0-26cc-42f0-b6d7-df5b667f6696 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:07:26.383947 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf81bcc0-26cc-42f0-b6d7-df5b667f6696 None admin] RBAC: Authorization granted {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:07:26.397676 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application [None req-bf81bcc0-26cc-42f0-b6d7-df5b667f6696 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 28 09:07:26.397676 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 09:07:26.397676 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 09:07:26.397676 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 09:07:26.397676 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 09:07:26.397676 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 09:07:26.397676 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 09:07:26.397676 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 09:07:26.397676 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 09:07:26.397676 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 09:07:26.397676 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 09:07:26.397676 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 09:07:26.397676 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 28 09:07:26.397676 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 28 09:07:26.397676 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 28 09:07:26.397676 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 28 09:07:26.398963 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 09:07:26.398963 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 09:07:26.398963 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 28 09:07:26.398963 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 09:07:26.398963 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 28 09:07:26.398963 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 09:07:26.398963 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 09:07:26.398963 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 09:07:26.398963 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 09:07:26.398963 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 09:07:26.398963 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 09:07:26.398963 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application with Lock( Jul 28 09:07:26.398963 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 09:07:26.398963 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self._enter() Jul 28 09:07:26.398963 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 09:07:26.398963 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 09:07:26.398963 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 09:07:26.398963 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self.creator() Jul 28 09:07:26.400230 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 09:07:26.400230 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application created_value = creator( Jul 28 09:07:26.400230 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 28 09:07:26.400230 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 28 09:07:26.400230 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 28 09:07:26.400230 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 28 09:07:26.400230 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 28 09:07:26.400230 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 28 09:07:26.400230 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 28 09:07:26.400230 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application Jul 28 09:07:26.407088 dv-cinder-851351-1-smb devstack@keystone.service[416293]: [pid: 416293|app: 0|req: 521/1052] 10.222.0.42 () {56 vars in 1093 bytes} [Thu Jul 28 09:07:26 2022] GET /identity/v3/users/nova => generated 82 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 09:07:26.408369 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93c1662-63da-4ac1-9a99-5188a7e95c86 None admin] Authenticating user token {{(pid=416294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:07:26.464078 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG dbcounter [-] [416294] Writing DB stats keystone:SELECT=100 {{(pid=416294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:07:26.523486 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93c1662-63da-4ac1-9a99-5188a7e95c86 None admin] Validating token access rules against request {{(pid=416294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:07:26.566052 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb88dff9-5962-4366-9221-bcb559d911a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:07:26.566705 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb88dff9-5962-4366-9221-bcb559d911a9 None admin] REQUEST_METHOD: `GET` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:07:26.566987 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb88dff9-5962-4366-9221-bcb559d911a9 None admin] SCRIPT_NAME: `/identity` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:07:26.567267 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb88dff9-5962-4366-9221-bcb559d911a9 None admin] PATH_INFO: `/v3/users` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:07:26.568093 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb88dff9-5962-4366-9221-bcb559d911a9 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=416294) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 09:07:26.568408 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb88dff9-5962-4366-9221-bcb559d911a9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:07:26.569901 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb88dff9-5962-4366-9221-bcb559d911a9 None admin] RBAC: Authorization granted {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:07:26.590051 dv-cinder-851351-1-smb devstack@keystone.service[416294]: [pid: 416294|app: 0|req: 532/1053] 10.222.0.42 () {56 vars in 1133 bytes} [Thu Jul 28 09:07:26 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:07:26.595861 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf81bcc0-26cc-42f0-b6d7-df5b667f6696 None admin] Authenticating user token {{(pid=416293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:07:26.698656 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf81bcc0-26cc-42f0-b6d7-df5b667f6696 None admin] Validating token access rules against request {{(pid=416293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:07:26.733412 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08321a63-f3fe-4bf0-b34f-156ad2e26814 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:07:26.733991 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08321a63-f3fe-4bf0-b34f-156ad2e26814 None admin] REQUEST_METHOD: `GET` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:07:26.734277 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08321a63-f3fe-4bf0-b34f-156ad2e26814 None admin] SCRIPT_NAME: `/identity` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:07:26.734616 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08321a63-f3fe-4bf0-b34f-156ad2e26814 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:07:26.745936 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08321a63-f3fe-4bf0-b34f-156ad2e26814 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:07:26.747417 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08321a63-f3fe-4bf0-b34f-156ad2e26814 None admin] RBAC: Authorization granted {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:07:26.766043 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application [None req-08321a63-f3fe-4bf0-b34f-156ad2e26814 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 09:07:26.766043 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 09:07:26.766043 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 09:07:26.766043 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 09:07:26.766043 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 09:07:26.766043 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 09:07:26.766043 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 09:07:26.766043 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 09:07:26.766043 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 09:07:26.766043 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 09:07:26.766043 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 09:07:26.766043 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 09:07:26.766043 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 09:07:26.766043 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 09:07:26.766043 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 09:07:26.767082 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 09:07:26.767082 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 09:07:26.767082 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 09:07:26.767082 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 09:07:26.767082 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 09:07:26.767082 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 09:07:26.767082 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 09:07:26.767082 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 09:07:26.767082 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application with Lock( Jul 28 09:07:26.767082 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 09:07:26.767082 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self._enter() Jul 28 09:07:26.767082 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 09:07:26.767082 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 09:07:26.767082 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 09:07:26.767082 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self.creator() Jul 28 09:07:26.767082 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 09:07:26.767082 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application created_value = creator( Jul 28 09:07:26.768069 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 09:07:26.768069 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 09:07:26.768069 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 09:07:26.768069 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application Jul 28 09:07:26.772583 dv-cinder-851351-1-smb devstack@keystone.service[416293]: [pid: 416293|app: 0|req: 522/1054] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 09:07:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 09:07:26.772848 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353a9888-4898-4cd4-88b0-427d749381fd None None] REQUEST_METHOD: `GET` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:07:26.772848 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353a9888-4898-4cd4-88b0-427d749381fd None None] SCRIPT_NAME: `/identity` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:07:26.772848 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353a9888-4898-4cd4-88b0-427d749381fd None None] PATH_INFO: `/` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:07:26.772848 dv-cinder-851351-1-smb devstack@keystone.service[416294]: [pid: 416294|app: 0|req: 533/1055] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 09:07:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 09:07:26.773189 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08321a63-f3fe-4bf0-b34f-156ad2e26814 None admin] Authenticating user token {{(pid=416293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:07:26.777950 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2591723c-2dbd-47c0-bffe-ebcd72a382e8 None None] REQUEST_METHOD: `POST` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:07:26.778238 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2591723c-2dbd-47c0-bffe-ebcd72a382e8 None None] SCRIPT_NAME: `/identity` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:07:26.778519 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2591723c-2dbd-47c0-bffe-ebcd72a382e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:07:26.797142 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.auth.core [None req-2591723c-2dbd-47c0-bffe-ebcd72a382e8 None None] MFA Rules not processed for user `dbf87abab90e4fdf9e75408f4199918e`. Rule list: `[]` (Enabled: `True`). {{(pid=416294) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 09:07:26.798444 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.fernet_utils [None req-2591723c-2dbd-47c0-bffe-ebcd72a382e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=416294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 09:07:26.809384 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG dbcounter [-] [416293] Writing DB stats keystone:SELECT=100 {{(pid=416293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:07:26.869016 dv-cinder-851351-1-smb devstack@keystone.service[416294]: [pid: 416294|app: 0|req: 534/1056] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 09:07:26 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 09:07:26.892295 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2591723c-2dbd-47c0-bffe-ebcd72a382e8 None None] Authenticating user token {{(pid=416294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:07:26.894204 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08321a63-f3fe-4bf0-b34f-156ad2e26814 None admin] Validating token access rules against request {{(pid=416293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:07:26.925029 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG dbcounter [-] [416294] Writing DB stats keystone:SELECT=100 {{(pid=416294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:07:26.934958 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd692db-1ff9-4bd0-9912-9f0eee2c18bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:07:26.935627 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd692db-1ff9-4bd0-9912-9f0eee2c18bb None admin] REQUEST_METHOD: `GET` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:07:26.936052 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd692db-1ff9-4bd0-9912-9f0eee2c18bb None admin] SCRIPT_NAME: `/identity` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:07:26.936341 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd692db-1ff9-4bd0-9912-9f0eee2c18bb None admin] PATH_INFO: `/v3/domains` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:07:26.937135 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edd692db-1ff9-4bd0-9912-9f0eee2c18bb None admin] RBAC: Adding query filter params (name=Default) {{(pid=416293) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 09:07:26.937507 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edd692db-1ff9-4bd0-9912-9f0eee2c18bb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:07:26.939065 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edd692db-1ff9-4bd0-9912-9f0eee2c18bb None admin] RBAC: Authorization granted {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:07:26.954968 dv-cinder-851351-1-smb devstack@keystone.service[416293]: [pid: 416293|app: 0|req: 523/1057] 10.222.0.42 () {56 vars in 1109 bytes} [Thu Jul 28 09:07:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 09:07:26.961285 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd692db-1ff9-4bd0-9912-9f0eee2c18bb None admin] Authenticating user token {{(pid=416293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:07:27.023070 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2591723c-2dbd-47c0-bffe-ebcd72a382e8 None None] Validating token access rules against request {{(pid=416294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:07:27.061733 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f2e432-a83e-4624-ae2e-1adb71dcac86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:07:27.065121 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f2e432-a83e-4624-ae2e-1adb71dcac86 None admin] REQUEST_METHOD: `GET` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:07:27.065639 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f2e432-a83e-4624-ae2e-1adb71dcac86 None admin] SCRIPT_NAME: `/identity` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:07:27.066431 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG dbcounter [-] [416293] Writing DB stats keystone:SELECT=100 {{(pid=416293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:07:27.066610 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f2e432-a83e-4624-ae2e-1adb71dcac86 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:07:27.079902 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd692db-1ff9-4bd0-9912-9f0eee2c18bb None admin] Validating token access rules against request {{(pid=416293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:07:27.083133 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f2e432-a83e-4624-ae2e-1adb71dcac86 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 09:07:27.088502 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application [None req-73f2e432-a83e-4624-ae2e-1adb71dcac86 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 09:07:27.088502 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 09:07:27.088502 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 09:07:27.088502 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 09:07:27.088502 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 09:07:27.088502 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 09:07:27.088502 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 09:07:27.088502 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 09:07:27.088502 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 09:07:27.088502 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 09:07:27.088502 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 09:07:27.088502 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 09:07:27.088502 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 09:07:27.088502 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 09:07:27.088502 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 09:07:27.088502 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 09:07:27.089633 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 09:07:27.089633 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 09:07:27.089633 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 09:07:27.089633 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 09:07:27.089633 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 09:07:27.089633 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 09:07:27.089633 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 09:07:27.089633 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 09:07:27.089633 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 09:07:27.089633 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 09:07:27.089633 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 09:07:27.089633 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application with Lock( Jul 28 09:07:27.089633 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 09:07:27.089633 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return self._enter() Jul 28 09:07:27.089633 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 09:07:27.089633 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 09:07:27.090583 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 09:07:27.090583 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return self.creator() Jul 28 09:07:27.090583 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 09:07:27.090583 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application created_value = creator( Jul 28 09:07:27.090583 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 09:07:27.090583 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 09:07:27.090583 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 09:07:27.090583 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 09:07:27.090583 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 09:07:27.090583 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 09:07:27.090583 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 09:07:27.090583 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application Jul 28 09:07:27.094989 dv-cinder-851351-1-smb devstack@keystone.service[416294]: [pid: 416294|app: 0|req: 535/1058] 10.222.0.42 () {56 vars in 1096 bytes} [Thu Jul 28 09:07:26 2022] GET /identity/v3/roles/admin => generated 83 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 09:07:27.095879 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f2e432-a83e-4624-ae2e-1adb71dcac86 None admin] Authenticating user token {{(pid=416294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:07:27.120574 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d393e67e-a18e-4cdf-9cc8-b7e32dd568f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:07:27.121444 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d393e67e-a18e-4cdf-9cc8-b7e32dd568f8 None admin] REQUEST_METHOD: `GET` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:07:27.121734 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d393e67e-a18e-4cdf-9cc8-b7e32dd568f8 None admin] SCRIPT_NAME: `/identity` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:07:27.122013 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d393e67e-a18e-4cdf-9cc8-b7e32dd568f8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:07:27.129593 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d393e67e-a18e-4cdf-9cc8-b7e32dd568f8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:07:27.131092 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d393e67e-a18e-4cdf-9cc8-b7e32dd568f8 None admin] RBAC: Authorization granted {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:07:27.143130 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application [None req-d393e67e-a18e-4cdf-9cc8-b7e32dd568f8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 09:07:27.143130 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 09:07:27.143130 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 09:07:27.143130 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 09:07:27.143130 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 09:07:27.143130 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 09:07:27.143130 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 09:07:27.143130 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 09:07:27.143130 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 09:07:27.143130 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 09:07:27.143130 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 09:07:27.143130 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 09:07:27.143130 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 28 09:07:27.143130 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 28 09:07:27.143130 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 28 09:07:27.144285 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 28 09:07:27.144285 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 09:07:27.144285 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 09:07:27.144285 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 09:07:27.144285 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 09:07:27.144285 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 09:07:27.144285 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 09:07:27.144285 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 09:07:27.144285 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application with Lock( Jul 28 09:07:27.144285 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 09:07:27.144285 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self._enter() Jul 28 09:07:27.144285 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 09:07:27.144285 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 09:07:27.144285 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 09:07:27.144285 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self.creator() Jul 28 09:07:27.144285 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 09:07:27.144285 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application created_value = creator( Jul 28 09:07:27.146166 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 28 09:07:27.146166 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 28 09:07:27.146166 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 28 09:07:27.146166 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 28 09:07:27.146166 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 28 09:07:27.146166 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 28 09:07:27.146166 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 09:07:27.146166 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application Jul 28 09:07:27.146166 dv-cinder-851351-1-smb devstack@keystone.service[416293]: [pid: 416293|app: 0|req: 524/1059] 10.222.0.42 () {56 vars in 1111 bytes} [Thu Jul 28 09:07:26 2022] GET /identity/v3/projects/service => generated 88 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 09:07:27.150655 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d393e67e-a18e-4cdf-9cc8-b7e32dd568f8 None admin] Authenticating user token {{(pid=416293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:07:27.202127 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG dbcounter [-] [416294] Writing DB stats keystone:SELECT=100 {{(pid=416294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:07:27.220023 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f2e432-a83e-4624-ae2e-1adb71dcac86 None admin] Validating token access rules against request {{(pid=416294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:07:27.257364 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c49c735b-b96f-4ca0-b7e4-a2e6e038ec09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:07:27.258006 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49c735b-b96f-4ca0-b7e4-a2e6e038ec09 None admin] REQUEST_METHOD: `GET` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:07:27.258291 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49c735b-b96f-4ca0-b7e4-a2e6e038ec09 None admin] SCRIPT_NAME: `/identity` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:07:27.258572 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49c735b-b96f-4ca0-b7e4-a2e6e038ec09 None admin] PATH_INFO: `/v3/roles` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:07:27.259434 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c49c735b-b96f-4ca0-b7e4-a2e6e038ec09 None admin] RBAC: Adding query filter params (name=admin) {{(pid=416294) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 09:07:27.259741 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c49c735b-b96f-4ca0-b7e4-a2e6e038ec09 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:07:27.261167 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c49c735b-b96f-4ca0-b7e4-a2e6e038ec09 None admin] RBAC: Authorization granted {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:07:27.270539 dv-cinder-851351-1-smb devstack@keystone.service[416294]: [pid: 416294|app: 0|req: 536/1060] 10.222.0.42 () {56 vars in 1099 bytes} [Thu Jul 28 09:07:27 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:07:27.276529 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c49c735b-b96f-4ca0-b7e4-a2e6e038ec09 None admin] Authenticating user token {{(pid=416294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:07:27.277888 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d393e67e-a18e-4cdf-9cc8-b7e32dd568f8 None admin] Validating token access rules against request {{(pid=416293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:07:27.316242 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac52847d-c4dc-4f18-bb6d-d9276e808473 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:07:27.317091 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac52847d-c4dc-4f18-bb6d-d9276e808473 None admin] REQUEST_METHOD: `GET` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:07:27.317386 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac52847d-c4dc-4f18-bb6d-d9276e808473 None admin] SCRIPT_NAME: `/identity` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:07:27.317666 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac52847d-c4dc-4f18-bb6d-d9276e808473 None admin] PATH_INFO: `/v3/projects` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:07:27.318440 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac52847d-c4dc-4f18-bb6d-d9276e808473 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=416293) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 09:07:27.318752 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac52847d-c4dc-4f18-bb6d-d9276e808473 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:07:27.320269 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac52847d-c4dc-4f18-bb6d-d9276e808473 None admin] RBAC: Authorization granted {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:07:27.334094 dv-cinder-851351-1-smb devstack@keystone.service[416293]: [pid: 416293|app: 0|req: 525/1061] 10.222.0.42 () {56 vars in 1148 bytes} [Thu Jul 28 09:07:27 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 09:07:27.340576 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac52847d-c4dc-4f18-bb6d-d9276e808473 None admin] Authenticating user token {{(pid=416293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:07:27.358316 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG dbcounter [-] [416293] Writing DB stats keystone:SELECT=100 {{(pid=416293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:07:27.425525 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c49c735b-b96f-4ca0-b7e4-a2e6e038ec09 None admin] Validating token access rules against request {{(pid=416294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:07:27.462381 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3fefad1-582d-4faf-84d2-b8d7f303487d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:07:27.463055 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3fefad1-582d-4faf-84d2-b8d7f303487d None admin] REQUEST_METHOD: `GET` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:07:27.463344 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3fefad1-582d-4faf-84d2-b8d7f303487d None admin] SCRIPT_NAME: `/identity` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:07:27.463653 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3fefad1-582d-4faf-84d2-b8d7f303487d None admin] PATH_INFO: `/v3/users/6fd19afb108b4b4c95f71f27ff1d4a88` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:07:27.476623 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac52847d-c4dc-4f18-bb6d-d9276e808473 None admin] Validating token access rules against request {{(pid=416293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:07:27.477801 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3fefad1-582d-4faf-84d2-b8d7f303487d None admin] RBAC: Authorizing `identity:get_user(user_id=6fd19afb108b4b4c95f71f27ff1d4a88)` {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:07:27.479283 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3fefad1-582d-4faf-84d2-b8d7f303487d None admin] RBAC: Authorization granted {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:07:27.481181 dv-cinder-851351-1-smb devstack@keystone.service[416294]: [pid: 416294|app: 0|req: 537/1062] 10.222.0.42 () {56 vars in 1177 bytes} [Thu Jul 28 09:07:27 2022] GET /identity/v3/users/6fd19afb108b4b4c95f71f27ff1d4a88 => generated 285 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:07:27.486250 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82bd42bc-acdb-4031-8179-1761b4e2fd90 None None] REQUEST_METHOD: `GET` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:07:27.486699 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82bd42bc-acdb-4031-8179-1761b4e2fd90 None None] SCRIPT_NAME: `/identity` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:07:27.486988 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82bd42bc-acdb-4031-8179-1761b4e2fd90 None None] PATH_INFO: `/` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:07:27.488317 dv-cinder-851351-1-smb devstack@keystone.service[416294]: [pid: 416294|app: 0|req: 538/1063] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 09:07:27 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 09:07:27.489071 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82bd42bc-acdb-4031-8179-1761b4e2fd90 None None] Authenticating user token {{(pid=416294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:07:27.505444 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG dbcounter [-] [416294] Writing DB stats keystone:SELECT=100 {{(pid=416294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:07:27.513207 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b1d9ff-e2ea-4796-9499-6d4161210ec0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:07:27.513914 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b1d9ff-e2ea-4796-9499-6d4161210ec0 None admin] REQUEST_METHOD: `PUT` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:07:27.514200 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b1d9ff-e2ea-4796-9499-6d4161210ec0 None admin] SCRIPT_NAME: `/identity` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:07:27.514487 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b1d9ff-e2ea-4796-9499-6d4161210ec0 None admin] PATH_INFO: `/v3/projects/6c4349445f224184b093d9dfd0dfc642/users/62f7da38a7044000bdf5790da751a45e/roles/4d94122535c54ae98fbaf3c8766c59be` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:07:27.516966 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3b1d9ff-e2ea-4796-9499-6d4161210ec0 None admin] RBAC: Authorizing `identity:create_grant(project_id=6c4349445f224184b093d9dfd0dfc642, user_id=62f7da38a7044000bdf5790da751a45e, role_id=4d94122535c54ae98fbaf3c8766c59be)` {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:07:27.518432 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3b1d9ff-e2ea-4796-9499-6d4161210ec0 None admin] RBAC: Authorization granted {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:07:27.533778 dv-cinder-851351-1-smb devstack@keystone.service[416293]: [pid: 416293|app: 0|req: 526/1064] 10.222.0.42 () {58 vars in 1439 bytes} [Thu Jul 28 09:07:27 2022] PUT /identity/v3/projects/6c4349445f224184b093d9dfd0dfc642/users/62f7da38a7044000bdf5790da751a45e/roles/4d94122535c54ae98fbaf3c8766c59be => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 28 09:07:27.535381 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e22b24-335e-49be-a998-5cca63d0d63b None None] REQUEST_METHOD: `POST` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:07:27.535680 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e22b24-335e-49be-a998-5cca63d0d63b None None] SCRIPT_NAME: `/identity` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:07:27.535962 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e22b24-335e-49be-a998-5cca63d0d63b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:07:27.555419 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.auth.core [None req-73e22b24-335e-49be-a998-5cca63d0d63b None None] MFA Rules not processed for user `dbf87abab90e4fdf9e75408f4199918e`. Rule list: `[]` (Enabled: `True`). {{(pid=416293) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 09:07:27.556694 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.fernet_utils [None req-73e22b24-335e-49be-a998-5cca63d0d63b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=416293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 09:07:27.618918 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82bd42bc-acdb-4031-8179-1761b4e2fd90 None None] Validating token access rules against request {{(pid=416294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:07:27.635765 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG dbcounter [-] [416293] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=416293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:07:27.648688 dv-cinder-851351-1-smb devstack@keystone.service[416293]: [pid: 416293|app: 0|req: 527/1065] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 09:07:27 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 09:07:27.663649 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e22b24-335e-49be-a998-5cca63d0d63b None None] Authenticating user token {{(pid=416293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:07:27.663868 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d606f60-0e84-418f-8508-fc0941781e31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:07:27.664452 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d606f60-0e84-418f-8508-fc0941781e31 None admin] REQUEST_METHOD: `GET` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:07:27.664770 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d606f60-0e84-418f-8508-fc0941781e31 None admin] SCRIPT_NAME: `/identity` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:07:27.665051 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d606f60-0e84-418f-8508-fc0941781e31 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:07:27.747602 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d606f60-0e84-418f-8508-fc0941781e31 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:07:27.749111 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d606f60-0e84-418f-8508-fc0941781e31 None admin] RBAC: Authorization granted {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:07:27.763286 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG dbcounter [-] [416294] Writing DB stats keystone:SELECT=100 {{(pid=416294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:07:27.787016 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e22b24-335e-49be-a998-5cca63d0d63b None None] Validating token access rules against request {{(pid=416293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:07:27.823699 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-221e8160-b32d-433c-a619-1074dfdfe06f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:07:27.824380 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221e8160-b32d-433c-a619-1074dfdfe06f None admin] REQUEST_METHOD: `GET` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:07:27.824680 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221e8160-b32d-433c-a619-1074dfdfe06f None admin] SCRIPT_NAME: `/identity` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:07:27.824979 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221e8160-b32d-433c-a619-1074dfdfe06f None admin] PATH_INFO: `/v3/services/image` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:07:27.825634 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-221e8160-b32d-433c-a619-1074dfdfe06f None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:07:27.827043 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-221e8160-b32d-433c-a619-1074dfdfe06f None admin] RBAC: Authorization granted {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:07:27.837044 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application [None req-221e8160-b32d-433c-a619-1074dfdfe06f None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jul 28 09:07:27.837044 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 09:07:27.837044 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 28 09:07:27.837044 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 28 09:07:27.837044 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 28 09:07:27.837044 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 28 09:07:27.837044 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 28 09:07:27.837044 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 09:07:27.837044 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 28 09:07:27.837044 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application Jul 28 09:07:27.837044 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 28 09:07:27.837044 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application Jul 28 09:07:27.837044 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 09:07:27.837044 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 09:07:27.837044 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 09:07:27.837044 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 09:07:27.837044 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 09:07:27.838231 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 09:07:27.838231 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 09:07:27.838231 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 09:07:27.838231 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 09:07:27.838231 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 09:07:27.838231 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 09:07:27.838231 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 28 09:07:27.838231 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 28 09:07:27.838231 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 28 09:07:27.838231 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 28 09:07:27.838231 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 09:07:27.838231 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 09:07:27.838231 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 09:07:27.838231 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 09:07:27.838231 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 09:07:27.838231 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 09:07:27.839802 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 09:07:27.839802 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application with Lock( Jul 28 09:07:27.839802 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 09:07:27.839802 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self._enter() Jul 28 09:07:27.839802 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 09:07:27.839802 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 09:07:27.839802 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 09:07:27.839802 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self.creator() Jul 28 09:07:27.839802 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 09:07:27.839802 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application created_value = creator( Jul 28 09:07:27.839802 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 28 09:07:27.839802 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 09:07:27.839802 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 28 09:07:27.839802 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application Jul 28 09:07:27.839802 dv-cinder-851351-1-smb devstack@keystone.service[416293]: [pid: 416293|app: 0|req: 528/1066] 10.222.0.42 () {56 vars in 1105 bytes} [Thu Jul 28 09:07:27 2022] GET /identity/v3/services/image => generated 86 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 09:07:27.845181 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-221e8160-b32d-433c-a619-1074dfdfe06f None admin] Authenticating user token {{(pid=416293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:07:27.866866 dv-cinder-851351-1-smb devstack@keystone.service[416294]: [pid: 416294|app: 0|req: 539/1067] 10.222.0.42 () {58 vars in 1282 bytes} [Thu Jul 28 09:07:27 2022] GET /identity/v3/auth/tokens => generated 1959 bytes in 378 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 28 09:07:27.872739 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d606f60-0e84-418f-8508-fc0941781e31 None admin] Authenticating user token {{(pid=416294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:07:27.914353 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG dbcounter [-] [416293] Writing DB stats keystone:SELECT=100 {{(pid=416293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:07:27.958020 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-221e8160-b32d-433c-a619-1074dfdfe06f None admin] Validating token access rules against request {{(pid=416293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:07:27.988538 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d606f60-0e84-418f-8508-fc0941781e31 None admin] Validating token access rules against request {{(pid=416294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:07:28.001785 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953f6b8a-20df-46b8-a07b-54a9a632e830 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:07:28.002492 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953f6b8a-20df-46b8-a07b-54a9a632e830 None admin] REQUEST_METHOD: `GET` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:07:28.002778 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953f6b8a-20df-46b8-a07b-54a9a632e830 None admin] SCRIPT_NAME: `/identity` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:07:28.003057 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953f6b8a-20df-46b8-a07b-54a9a632e830 None admin] PATH_INFO: `/v3/services` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:07:28.003757 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-953f6b8a-20df-46b8-a07b-54a9a632e830 None admin] RBAC: Adding query filter params (name=image) {{(pid=416293) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 09:07:28.004073 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-953f6b8a-20df-46b8-a07b-54a9a632e830 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:07:28.005461 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG dbcounter [-] [416294] Writing DB stats keystone:SELECT=100 {{(pid=416294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:07:28.005584 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-953f6b8a-20df-46b8-a07b-54a9a632e830 None admin] RBAC: Authorization granted {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:07:28.011624 dv-cinder-851351-1-smb devstack@keystone.service[416293]: [pid: 416293|app: 0|req: 529/1068] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 09:07:27 2022] GET /identity/v3/services?name=image => generated 122 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 09:07:28.017360 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953f6b8a-20df-46b8-a07b-54a9a632e830 None admin] Authenticating user token {{(pid=416293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:07:28.032305 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81274210-6eeb-427c-8f64-90230cbad244 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:07:28.032888 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81274210-6eeb-427c-8f64-90230cbad244 None admin] REQUEST_METHOD: `GET` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:07:28.033175 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81274210-6eeb-427c-8f64-90230cbad244 None admin] SCRIPT_NAME: `/identity` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:07:28.033454 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81274210-6eeb-427c-8f64-90230cbad244 None admin] PATH_INFO: `/v3/projects/27de4a0415e44654ae7abbc9f508f846` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:07:28.034666 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81274210-6eeb-427c-8f64-90230cbad244 None admin] RBAC: Authorizing `identity:get_project(project_id=27de4a0415e44654ae7abbc9f508f846)` {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:07:28.036120 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81274210-6eeb-427c-8f64-90230cbad244 None admin] RBAC: Authorization granted {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:07:28.037944 dv-cinder-851351-1-smb devstack@keystone.service[416294]: [pid: 416294|app: 0|req: 540/1069] 10.222.0.42 () {56 vars in 1186 bytes} [Thu Jul 28 09:07:27 2022] GET /identity/v3/projects/27de4a0415e44654ae7abbc9f508f846 => generated 311 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 09:07:28.044094 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81274210-6eeb-427c-8f64-90230cbad244 None admin] Authenticating user token {{(pid=416294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:07:28.140538 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953f6b8a-20df-46b8-a07b-54a9a632e830 None admin] Validating token access rules against request {{(pid=416293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:07:28.169431 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81274210-6eeb-427c-8f64-90230cbad244 None admin] Validating token access rules against request {{(pid=416294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:07:28.175336 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG dbcounter [-] [416293] Writing DB stats keystone:SELECT=100 {{(pid=416293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:07:28.187693 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea27f3e1-297e-439e-b501-8c84b41463e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:07:28.188314 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea27f3e1-297e-439e-b501-8c84b41463e7 None admin] REQUEST_METHOD: `GET` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:07:28.188627 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea27f3e1-297e-439e-b501-8c84b41463e7 None admin] SCRIPT_NAME: `/identity` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:07:28.188947 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea27f3e1-297e-439e-b501-8c84b41463e7 None admin] PATH_INFO: `/v3/services` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:07:28.189645 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea27f3e1-297e-439e-b501-8c84b41463e7 None admin] RBAC: Adding query filter params (type=image) {{(pid=416293) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 09:07:28.189958 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea27f3e1-297e-439e-b501-8c84b41463e7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:07:28.191411 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea27f3e1-297e-439e-b501-8c84b41463e7 None admin] RBAC: Authorization granted {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:07:28.198535 dv-cinder-851351-1-smb devstack@keystone.service[416293]: [pid: 416293|app: 0|req: 530/1070] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 09:07:28 2022] GET /identity/v3/services?type=image => generated 350 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 09:07:28.204171 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea27f3e1-297e-439e-b501-8c84b41463e7 None admin] Authenticating user token {{(pid=416293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:07:28.208525 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e23c1a-1bd5-4bba-97f9-e87159b443d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:07:28.209152 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e23c1a-1bd5-4bba-97f9-e87159b443d0 None admin] REQUEST_METHOD: `GET` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:07:28.209152 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e23c1a-1bd5-4bba-97f9-e87159b443d0 None admin] SCRIPT_NAME: `/identity` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:07:28.209433 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e23c1a-1bd5-4bba-97f9-e87159b443d0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:07:28.210133 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37e23c1a-1bd5-4bba-97f9-e87159b443d0 None admin] RBAC: Adding query filter params (role.id=c67085ec338243df8f9b7d6459036e23, scope.project.id=27de4a0415e44654ae7abbc9f508f846, user.id=6fd19afb108b4b4c95f71f27ff1d4a88) {{(pid=416294) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 09:07:28.210448 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37e23c1a-1bd5-4bba-97f9-e87159b443d0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:07:28.211903 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37e23c1a-1bd5-4bba-97f9-e87159b443d0 None admin] RBAC: Authorization granted {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:07:28.218560 dv-cinder-851351-1-smb devstack@keystone.service[416294]: [pid: 416294|app: 0|req: 541/1071] 10.222.0.42 () {56 vars in 1374 bytes} [Thu Jul 28 09:07:28 2022] GET /identity/v3/role_assignments?user.id=6fd19afb108b4b4c95f71f27ff1d4a88&scope.project.id=27de4a0415e44654ae7abbc9f508f846&role.id=c67085ec338243df8f9b7d6459036e23 => generated 259 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 09:07:28.325775 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea27f3e1-297e-439e-b501-8c84b41463e7 None admin] Validating token access rules against request {{(pid=416293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:07:28.362950 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532f6c00-36ed-41ea-8f27-8658482c55c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:07:28.363658 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532f6c00-36ed-41ea-8f27-8658482c55c3 None admin] REQUEST_METHOD: `POST` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:07:28.363947 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532f6c00-36ed-41ea-8f27-8658482c55c3 None admin] SCRIPT_NAME: `/identity` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:07:28.364275 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532f6c00-36ed-41ea-8f27-8658482c55c3 None admin] PATH_INFO: `/v3/endpoints` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:07:28.365042 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-532f6c00-36ed-41ea-8f27-8658482c55c3 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:07:28.366471 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-532f6c00-36ed-41ea-8f27-8658482c55c3 None admin] RBAC: Authorization granted {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:07:28.388949 dv-cinder-851351-1-smb devstack@keystone.service[416293]: [pid: 416293|app: 0|req: 531/1072] 10.222.0.42 () {60 vars in 1144 bytes} [Thu Jul 28 09:07:28 2022] POST /identity/v3/endpoints => generated 327 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 28 09:07:29.536447 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c95a681-49ae-43e3-9638-9ce573bfdfb6 None None] REQUEST_METHOD: `GET` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:07:29.537046 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c95a681-49ae-43e3-9638-9ce573bfdfb6 None None] SCRIPT_NAME: `/identity` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:07:29.537046 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c95a681-49ae-43e3-9638-9ce573bfdfb6 None None] PATH_INFO: `/` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:07:29.538455 dv-cinder-851351-1-smb devstack@keystone.service[416294]: [pid: 416294|app: 0|req: 542/1073] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 09:07:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 09:07:29.543922 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51a72bf-d9b3-4e7b-b04e-5057f473f5c6 None None] REQUEST_METHOD: `POST` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:07:29.544395 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51a72bf-d9b3-4e7b-b04e-5057f473f5c6 None None] SCRIPT_NAME: `/identity` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:07:29.544483 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51a72bf-d9b3-4e7b-b04e-5057f473f5c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:07:29.566967 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.auth.core [None req-f51a72bf-d9b3-4e7b-b04e-5057f473f5c6 None None] MFA Rules not processed for user `dbf87abab90e4fdf9e75408f4199918e`. Rule list: `[]` (Enabled: `True`). {{(pid=416293) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 09:07:29.568199 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.fernet_utils [None req-f51a72bf-d9b3-4e7b-b04e-5057f473f5c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=416293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 09:07:29.613142 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG dbcounter [-] [416293] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=416293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:07:29.649609 dv-cinder-851351-1-smb devstack@keystone.service[416293]: [pid: 416293|app: 0|req: 532/1074] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 09:07:29 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 09:07:29.672939 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c95a681-49ae-43e3-9638-9ce573bfdfb6 None None] Authenticating user token {{(pid=416294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:07:29.725158 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG dbcounter [-] [416294] Writing DB stats keystone:SELECT=100 {{(pid=416294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:07:29.785419 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c95a681-49ae-43e3-9638-9ce573bfdfb6 None None] Validating token access rules against request {{(pid=416294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:07:29.820731 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26aac82c-9284-41ed-a391-a7a56954e198 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:07:29.821329 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26aac82c-9284-41ed-a391-a7a56954e198 None admin] REQUEST_METHOD: `GET` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:07:29.821650 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26aac82c-9284-41ed-a391-a7a56954e198 None admin] SCRIPT_NAME: `/identity` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:07:29.821927 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26aac82c-9284-41ed-a391-a7a56954e198 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:07:29.832925 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26aac82c-9284-41ed-a391-a7a56954e198 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 09:07:29.837787 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application [None req-26aac82c-9284-41ed-a391-a7a56954e198 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 28 09:07:29.837787 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 09:07:29.837787 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 09:07:29.837787 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 09:07:29.837787 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 09:07:29.837787 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 09:07:29.837787 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 09:07:29.837787 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 09:07:29.837787 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 09:07:29.837787 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 09:07:29.837787 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 09:07:29.837787 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 09:07:29.837787 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 09:07:29.837787 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 09:07:29.837787 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 09:07:29.837787 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 09:07:29.838792 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 09:07:29.838792 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 09:07:29.838792 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 09:07:29.838792 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 09:07:29.838792 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 09:07:29.838792 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 09:07:29.838792 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 09:07:29.838792 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 09:07:29.838792 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 09:07:29.838792 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 09:07:29.838792 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 09:07:29.838792 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application with Lock( Jul 28 09:07:29.838792 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 09:07:29.838792 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return self._enter() Jul 28 09:07:29.838792 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 09:07:29.838792 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 09:07:29.844884 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 09:07:29.844884 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return self.creator() Jul 28 09:07:29.844884 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 09:07:29.844884 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application created_value = creator( Jul 28 09:07:29.844884 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 09:07:29.844884 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 09:07:29.844884 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 09:07:29.844884 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 09:07:29.844884 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 09:07:29.844884 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 09:07:29.844884 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 28 09:07:29.844884 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application Jul 28 09:07:29.844884 dv-cinder-851351-1-smb devstack@keystone.service[416294]: [pid: 416294|app: 0|req: 543/1075] 10.222.0.42 () {56 vars in 1120 bytes} [Thu Jul 28 09:07:29 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 09:07:29.846228 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f51a72bf-d9b3-4e7b-b04e-5057f473f5c6 None None] Authenticating user token {{(pid=416293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:07:29.950766 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f51a72bf-d9b3-4e7b-b04e-5057f473f5c6 None None] Validating token access rules against request {{(pid=416293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:07:29.994434 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e868bac0-2f1a-41b2-86a7-6fe25a4fdea8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:07:29.995080 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e868bac0-2f1a-41b2-86a7-6fe25a4fdea8 None admin] REQUEST_METHOD: `GET` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:07:29.995364 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e868bac0-2f1a-41b2-86a7-6fe25a4fdea8 None admin] SCRIPT_NAME: `/identity` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:07:29.995721 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e868bac0-2f1a-41b2-86a7-6fe25a4fdea8 None admin] PATH_INFO: `/v3/roles` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:07:29.996489 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e868bac0-2f1a-41b2-86a7-6fe25a4fdea8 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=416293) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 09:07:29.996827 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e868bac0-2f1a-41b2-86a7-6fe25a4fdea8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:07:29.998234 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e868bac0-2f1a-41b2-86a7-6fe25a4fdea8 None admin] RBAC: Authorization granted {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:07:30.007397 dv-cinder-851351-1-smb devstack@keystone.service[416293]: [pid: 416293|app: 0|req: 533/1076] 10.222.0.42 () {56 vars in 1115 bytes} [Thu Jul 28 09:07:29 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:07:30.013057 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26aac82c-9284-41ed-a391-a7a56954e198 None admin] Authenticating user token {{(pid=416294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:07:30.119046 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26aac82c-9284-41ed-a391-a7a56954e198 None admin] Validating token access rules against request {{(pid=416294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:07:30.121566 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG dbcounter [-] [416294] Writing DB stats keystone:SELECT=100 {{(pid=416294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:07:30.156261 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7298f65-1cf1-4a06-a112-4b13aa56e586 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:07:30.156989 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7298f65-1cf1-4a06-a112-4b13aa56e586 None admin] REQUEST_METHOD: `GET` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:07:30.157270 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7298f65-1cf1-4a06-a112-4b13aa56e586 None admin] SCRIPT_NAME: `/identity` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:07:30.157539 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7298f65-1cf1-4a06-a112-4b13aa56e586 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:07:30.168209 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7298f65-1cf1-4a06-a112-4b13aa56e586 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:07:30.169786 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7298f65-1cf1-4a06-a112-4b13aa56e586 None admin] RBAC: Authorization granted {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:07:30.185414 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application [None req-c7298f65-1cf1-4a06-a112-4b13aa56e586 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 09:07:30.185414 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 09:07:30.185414 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 09:07:30.185414 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 09:07:30.185414 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 09:07:30.185414 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 09:07:30.185414 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 09:07:30.185414 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 09:07:30.185414 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 09:07:30.185414 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 09:07:30.185414 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 09:07:30.185414 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 09:07:30.185414 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 09:07:30.185414 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 09:07:30.185414 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 09:07:30.186515 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 09:07:30.186515 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 09:07:30.186515 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 09:07:30.186515 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 09:07:30.186515 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 09:07:30.186515 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 09:07:30.186515 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 09:07:30.186515 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 09:07:30.186515 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application with Lock( Jul 28 09:07:30.186515 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 09:07:30.186515 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return self._enter() Jul 28 09:07:30.186515 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 09:07:30.186515 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 09:07:30.186515 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 09:07:30.186515 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return self.creator() Jul 28 09:07:30.186515 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 09:07:30.186515 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application created_value = creator( Jul 28 09:07:30.187637 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 09:07:30.187637 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 09:07:30.187637 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 09:07:30.187637 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application Jul 28 09:07:30.189012 dv-cinder-851351-1-smb devstack@keystone.service[416294]: [pid: 416294|app: 0|req: 544/1077] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 09:07:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 09:07:30.193564 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e868bac0-2f1a-41b2-86a7-6fe25a4fdea8 None admin] Authenticating user token {{(pid=416293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:07:30.236120 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG dbcounter [-] [416293] Writing DB stats keystone:SELECT=100 {{(pid=416293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:07:30.242024 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98f3837-2a57-4951-9bc4-d6926724986a None None] REQUEST_METHOD: `GET` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:07:30.242344 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98f3837-2a57-4951-9bc4-d6926724986a None None] SCRIPT_NAME: `/identity` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:07:30.242653 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98f3837-2a57-4951-9bc4-d6926724986a None None] PATH_INFO: `/` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:07:30.244596 dv-cinder-851351-1-smb devstack@keystone.service[416294]: [pid: 416294|app: 0|req: 545/1078] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 09:07:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 09:07:30.250103 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1baaa9d1-6195-4a2e-b38f-07ace8599ed8 None None] REQUEST_METHOD: `POST` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:07:30.250442 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1baaa9d1-6195-4a2e-b38f-07ace8599ed8 None None] SCRIPT_NAME: `/identity` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:07:30.250739 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1baaa9d1-6195-4a2e-b38f-07ace8599ed8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:07:30.270174 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.auth.core [None req-1baaa9d1-6195-4a2e-b38f-07ace8599ed8 None None] MFA Rules not processed for user `dbf87abab90e4fdf9e75408f4199918e`. Rule list: `[]` (Enabled: `True`). {{(pid=416294) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 09:07:30.271390 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.fernet_utils [None req-1baaa9d1-6195-4a2e-b38f-07ace8599ed8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=416294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 09:07:30.327133 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e868bac0-2f1a-41b2-86a7-6fe25a4fdea8 None admin] Validating token access rules against request {{(pid=416293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:07:30.347008 dv-cinder-851351-1-smb devstack@keystone.service[416294]: [pid: 416294|app: 0|req: 546/1079] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 09:07:30 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 28 09:07:30.369330 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1baaa9d1-6195-4a2e-b38f-07ace8599ed8 None None] Authenticating user token {{(pid=416294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:07:30.372084 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3e6502-5372-46d7-b6f3-8206930d0798 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:07:30.373012 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3e6502-5372-46d7-b6f3-8206930d0798 None admin] REQUEST_METHOD: `GET` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:07:30.373481 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3e6502-5372-46d7-b6f3-8206930d0798 None admin] SCRIPT_NAME: `/identity` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:07:30.373760 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3e6502-5372-46d7-b6f3-8206930d0798 None admin] PATH_INFO: `/v3/domains` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:07:30.374750 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f3e6502-5372-46d7-b6f3-8206930d0798 None admin] RBAC: Adding query filter params (name=Default) {{(pid=416293) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 09:07:30.375115 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f3e6502-5372-46d7-b6f3-8206930d0798 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:07:30.376522 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f3e6502-5372-46d7-b6f3-8206930d0798 None admin] RBAC: Authorization granted {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:07:30.393136 dv-cinder-851351-1-smb devstack@keystone.service[416293]: [pid: 416293|app: 0|req: 534/1080] 10.222.0.42 () {56 vars in 1109 bytes} [Thu Jul 28 09:07:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:07:30.399426 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3e6502-5372-46d7-b6f3-8206930d0798 None admin] Authenticating user token {{(pid=416293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:07:30.466014 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG dbcounter [-] [416294] Writing DB stats keystone:SELECT=100 {{(pid=416294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:07:30.481493 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1baaa9d1-6195-4a2e-b38f-07ace8599ed8 None None] Validating token access rules against request {{(pid=416294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:07:30.503701 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG dbcounter [-] [416293] Writing DB stats keystone:SELECT=100 {{(pid=416293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:07:30.511710 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3e6502-5372-46d7-b6f3-8206930d0798 None admin] Validating token access rules against request {{(pid=416293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:07:30.517192 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f991660a-99b7-4715-afe5-adba2b8023c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:07:30.517856 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f991660a-99b7-4715-afe5-adba2b8023c0 None admin] REQUEST_METHOD: `GET` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:07:30.518133 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f991660a-99b7-4715-afe5-adba2b8023c0 None admin] SCRIPT_NAME: `/identity` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:07:30.518402 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f991660a-99b7-4715-afe5-adba2b8023c0 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:07:30.530090 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f991660a-99b7-4715-afe5-adba2b8023c0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 09:07:30.535240 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application [None req-f991660a-99b7-4715-afe5-adba2b8023c0 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 09:07:30.535240 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 09:07:30.535240 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 09:07:30.535240 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 09:07:30.535240 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 09:07:30.535240 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 09:07:30.535240 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 09:07:30.535240 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 09:07:30.535240 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 09:07:30.535240 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 09:07:30.535240 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 09:07:30.535240 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 09:07:30.535240 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 09:07:30.535240 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 09:07:30.535240 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 09:07:30.535240 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 09:07:30.536535 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 09:07:30.536535 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 09:07:30.536535 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 09:07:30.536535 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 09:07:30.536535 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 09:07:30.536535 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 09:07:30.536535 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 09:07:30.536535 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 09:07:30.536535 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 09:07:30.536535 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 09:07:30.536535 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 09:07:30.536535 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application with Lock( Jul 28 09:07:30.536535 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 09:07:30.536535 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return self._enter() Jul 28 09:07:30.536535 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 09:07:30.536535 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 09:07:30.537970 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 09:07:30.537970 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return self.creator() Jul 28 09:07:30.537970 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 09:07:30.537970 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application created_value = creator( Jul 28 09:07:30.537970 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 09:07:30.537970 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 09:07:30.537970 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 09:07:30.537970 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 09:07:30.537970 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 09:07:30.537970 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 09:07:30.537970 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 09:07:30.537970 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application Jul 28 09:07:30.537970 dv-cinder-851351-1-smb devstack@keystone.service[416294]: [pid: 416294|app: 0|req: 547/1081] 10.222.0.42 () {56 vars in 1096 bytes} [Thu Jul 28 09:07:30 2022] GET /identity/v3/roles/admin => generated 83 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 09:07:30.537970 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58209a4f-8204-42ac-a2f2-357e9f69c666 None None] REQUEST_METHOD: `GET` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:07:30.538812 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58209a4f-8204-42ac-a2f2-357e9f69c666 None None] SCRIPT_NAME: `/identity` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:07:30.538812 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58209a4f-8204-42ac-a2f2-357e9f69c666 None None] PATH_INFO: `/` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:07:30.539704 dv-cinder-851351-1-smb devstack@keystone.service[416294]: [pid: 416294|app: 0|req: 548/1082] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 09:07:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 09:07:30.544429 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58209a4f-8204-42ac-a2f2-357e9f69c666 None None] Authenticating user token {{(pid=416294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:07:30.550503 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ee8c63-8170-4df5-9ffa-1143c795865e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:07:30.551194 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ee8c63-8170-4df5-9ffa-1143c795865e None admin] REQUEST_METHOD: `GET` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:07:30.551461 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ee8c63-8170-4df5-9ffa-1143c795865e None admin] SCRIPT_NAME: `/identity` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:07:30.551741 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ee8c63-8170-4df5-9ffa-1143c795865e None admin] PATH_INFO: `/v3/users/nova` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:07:30.559982 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99ee8c63-8170-4df5-9ffa-1143c795865e None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:07:30.561507 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99ee8c63-8170-4df5-9ffa-1143c795865e None admin] RBAC: Authorization granted {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:07:30.574107 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application [None req-99ee8c63-8170-4df5-9ffa-1143c795865e None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 28 09:07:30.574107 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 09:07:30.574107 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 09:07:30.574107 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 09:07:30.574107 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 09:07:30.574107 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 09:07:30.574107 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 09:07:30.574107 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 09:07:30.574107 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 09:07:30.574107 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 09:07:30.574107 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 09:07:30.574107 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 09:07:30.574107 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 28 09:07:30.574107 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 28 09:07:30.574107 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 28 09:07:30.574107 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 28 09:07:30.575259 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 09:07:30.575259 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 09:07:30.575259 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 28 09:07:30.575259 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 09:07:30.575259 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 28 09:07:30.575259 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 09:07:30.575259 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 09:07:30.575259 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 09:07:30.575259 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 09:07:30.575259 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 09:07:30.575259 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 09:07:30.575259 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application with Lock( Jul 28 09:07:30.575259 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 09:07:30.575259 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self._enter() Jul 28 09:07:30.575259 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 09:07:30.575259 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 09:07:30.575259 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 09:07:30.575259 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self.creator() Jul 28 09:07:30.576329 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 09:07:30.576329 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application created_value = creator( Jul 28 09:07:30.576329 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 28 09:07:30.576329 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 28 09:07:30.576329 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 28 09:07:30.576329 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 28 09:07:30.576329 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 28 09:07:30.576329 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 28 09:07:30.576329 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 28 09:07:30.576329 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application Jul 28 09:07:30.576329 dv-cinder-851351-1-smb devstack@keystone.service[416293]: [pid: 416293|app: 0|req: 535/1083] 10.222.0.42 () {56 vars in 1093 bytes} [Thu Jul 28 09:07:30 2022] GET /identity/v3/users/nova => generated 82 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 09:07:30.577068 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e5214c-de4f-4a30-9f37-efcbdc4ea386 None None] REQUEST_METHOD: `POST` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:07:30.577157 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e5214c-de4f-4a30-9f37-efcbdc4ea386 None None] SCRIPT_NAME: `/identity` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:07:30.577485 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e5214c-de4f-4a30-9f37-efcbdc4ea386 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:07:30.597249 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.auth.core [None req-82e5214c-de4f-4a30-9f37-efcbdc4ea386 None None] MFA Rules not processed for user `dbf87abab90e4fdf9e75408f4199918e`. Rule list: `[]` (Enabled: `True`). {{(pid=416293) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 09:07:30.598624 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.fernet_utils [None req-82e5214c-de4f-4a30-9f37-efcbdc4ea386 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=416293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 09:07:30.671331 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58209a4f-8204-42ac-a2f2-357e9f69c666 None None] Validating token access rules against request {{(pid=416294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:07:30.678697 dv-cinder-851351-1-smb devstack@keystone.service[416293]: [pid: 416293|app: 0|req: 536/1084] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 09:07:30 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 09:07:30.679597 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e5214c-de4f-4a30-9f37-efcbdc4ea386 None None] Authenticating user token {{(pid=416293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:07:30.710088 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148b7f43-c7f3-4ae0-aa39-8b4c752bbac4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:07:30.710728 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148b7f43-c7f3-4ae0-aa39-8b4c752bbac4 None admin] REQUEST_METHOD: `GET` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:07:30.711013 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148b7f43-c7f3-4ae0-aa39-8b4c752bbac4 None admin] SCRIPT_NAME: `/identity` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:07:30.711284 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148b7f43-c7f3-4ae0-aa39-8b4c752bbac4 None admin] PATH_INFO: `/v3/roles` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:07:30.712012 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-148b7f43-c7f3-4ae0-aa39-8b4c752bbac4 None admin] RBAC: Adding query filter params (name=admin) {{(pid=416294) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 09:07:30.712317 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-148b7f43-c7f3-4ae0-aa39-8b4c752bbac4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:07:30.713739 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-148b7f43-c7f3-4ae0-aa39-8b4c752bbac4 None admin] RBAC: Authorization granted {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:07:30.722513 dv-cinder-851351-1-smb devstack@keystone.service[416294]: [pid: 416294|app: 0|req: 549/1085] 10.222.0.42 () {56 vars in 1099 bytes} [Thu Jul 28 09:07:30 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:07:30.723334 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148b7f43-c7f3-4ae0-aa39-8b4c752bbac4 None admin] Authenticating user token {{(pid=416294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:07:30.739585 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG dbcounter [-] [416294] Writing DB stats keystone:SELECT=100 {{(pid=416294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:07:30.769470 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG dbcounter [-] [416293] Writing DB stats keystone:SELECT=100 {{(pid=416293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:07:30.787948 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e5214c-de4f-4a30-9f37-efcbdc4ea386 None None] Validating token access rules against request {{(pid=416293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:07:30.824540 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be97ccb8-47a6-4b10-8d2a-6a37b292cbcc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:07:30.825207 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be97ccb8-47a6-4b10-8d2a-6a37b292cbcc None admin] REQUEST_METHOD: `GET` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:07:30.825466 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be97ccb8-47a6-4b10-8d2a-6a37b292cbcc None admin] SCRIPT_NAME: `/identity` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:07:30.825744 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be97ccb8-47a6-4b10-8d2a-6a37b292cbcc None admin] PATH_INFO: `/v3/users` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:07:30.826555 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be97ccb8-47a6-4b10-8d2a-6a37b292cbcc None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=416293) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 09:07:30.826861 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be97ccb8-47a6-4b10-8d2a-6a37b292cbcc None admin] RBAC: Authorizing `identity:list_users()` {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:07:30.828363 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be97ccb8-47a6-4b10-8d2a-6a37b292cbcc None admin] RBAC: Authorization granted {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:07:30.846593 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148b7f43-c7f3-4ae0-aa39-8b4c752bbac4 None admin] Validating token access rules against request {{(pid=416294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:07:30.853777 dv-cinder-851351-1-smb devstack@keystone.service[416293]: [pid: 416293|app: 0|req: 537/1086] 10.222.0.42 () {56 vars in 1133 bytes} [Thu Jul 28 09:07:30 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:07:30.853777 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be97ccb8-47a6-4b10-8d2a-6a37b292cbcc None admin] Authenticating user token {{(pid=416293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:07:30.892046 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f8f0ae3-6aa9-4431-b68d-bc5d163614fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:07:30.892870 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8f0ae3-6aa9-4431-b68d-bc5d163614fb None admin] REQUEST_METHOD: `GET` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:07:30.893266 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8f0ae3-6aa9-4431-b68d-bc5d163614fb None admin] SCRIPT_NAME: `/identity` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:07:30.893658 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8f0ae3-6aa9-4431-b68d-bc5d163614fb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:07:30.965032 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be97ccb8-47a6-4b10-8d2a-6a37b292cbcc None admin] Validating token access rules against request {{(pid=416293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:07:30.975463 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f8f0ae3-6aa9-4431-b68d-bc5d163614fb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:07:30.976974 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f8f0ae3-6aa9-4431-b68d-bc5d163614fb None admin] RBAC: Authorization granted {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:07:30.988091 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG dbcounter [-] [416294] Writing DB stats keystone:SELECT=100 {{(pid=416294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:07:31.004452 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2e2f9b-4760-4599-9519-2e4c3dbb33d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:07:31.005153 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2e2f9b-4760-4599-9519-2e4c3dbb33d9 None admin] REQUEST_METHOD: `GET` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:07:31.005446 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2e2f9b-4760-4599-9519-2e4c3dbb33d9 None admin] SCRIPT_NAME: `/identity` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:07:31.005727 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2e2f9b-4760-4599-9519-2e4c3dbb33d9 None admin] PATH_INFO: `/v3/users/6fd19afb108b4b4c95f71f27ff1d4a88` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:07:31.006958 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae2e2f9b-4760-4599-9519-2e4c3dbb33d9 None admin] RBAC: Authorizing `identity:get_user(user_id=6fd19afb108b4b4c95f71f27ff1d4a88)` {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:07:31.008497 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae2e2f9b-4760-4599-9519-2e4c3dbb33d9 None admin] RBAC: Authorization granted {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:07:31.010375 dv-cinder-851351-1-smb devstack@keystone.service[416293]: [pid: 416293|app: 0|req: 538/1087] 10.222.0.42 () {56 vars in 1177 bytes} [Thu Jul 28 09:07:30 2022] GET /identity/v3/users/6fd19afb108b4b4c95f71f27ff1d4a88 => generated 285 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:07:31.010997 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2e2f9b-4760-4599-9519-2e4c3dbb33d9 None admin] Authenticating user token {{(pid=416293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:07:31.024970 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG dbcounter [-] [416293] Writing DB stats keystone:SELECT=100 {{(pid=416293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:07:31.084466 dv-cinder-851351-1-smb devstack@keystone.service[416294]: [pid: 416294|app: 0|req: 550/1088] 10.222.0.42 () {58 vars in 1282 bytes} [Thu Jul 28 09:07:30 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 361 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 28 09:07:31.085460 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f8f0ae3-6aa9-4431-b68d-bc5d163614fb None admin] Authenticating user token {{(pid=416294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:07:31.121782 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2e2f9b-4760-4599-9519-2e4c3dbb33d9 None admin] Validating token access rules against request {{(pid=416293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:07:31.160167 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e842e34-faae-47d2-8808-a8a4bc2abc41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:07:31.160957 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e842e34-faae-47d2-8808-a8a4bc2abc41 None admin] REQUEST_METHOD: `GET` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:07:31.161155 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e842e34-faae-47d2-8808-a8a4bc2abc41 None admin] SCRIPT_NAME: `/identity` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:07:31.161419 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e842e34-faae-47d2-8808-a8a4bc2abc41 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:07:31.192299 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f8f0ae3-6aa9-4431-b68d-bc5d163614fb None admin] Validating token access rules against request {{(pid=416294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:07:31.202578 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG dbcounter [-] [416294] Writing DB stats keystone:SELECT=100 {{(pid=416294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:07:31.232131 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2290e43-b466-44f0-bc72-eefa0b115d0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:07:31.232732 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2290e43-b466-44f0-bc72-eefa0b115d0e None admin] REQUEST_METHOD: `GET` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:07:31.233017 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2290e43-b466-44f0-bc72-eefa0b115d0e None admin] SCRIPT_NAME: `/identity` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:07:31.233298 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2290e43-b466-44f0-bc72-eefa0b115d0e None admin] PATH_INFO: `/v3/projects/27de4a0415e44654ae7abbc9f508f846` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:07:31.234535 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2290e43-b466-44f0-bc72-eefa0b115d0e None admin] RBAC: Authorizing `identity:get_project(project_id=27de4a0415e44654ae7abbc9f508f846)` {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:07:31.236068 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2290e43-b466-44f0-bc72-eefa0b115d0e None admin] RBAC: Authorization granted {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:07:31.237724 dv-cinder-851351-1-smb devstack@keystone.service[416294]: [pid: 416294|app: 0|req: 551/1089] 10.222.0.42 () {56 vars in 1186 bytes} [Thu Jul 28 09:07:31 2022] GET /identity/v3/projects/27de4a0415e44654ae7abbc9f508f846 => generated 311 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:07:31.238507 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2290e43-b466-44f0-bc72-eefa0b115d0e None admin] Authenticating user token {{(pid=416294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:07:31.245485 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e842e34-faae-47d2-8808-a8a4bc2abc41 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:07:31.247117 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e842e34-faae-47d2-8808-a8a4bc2abc41 None admin] RBAC: Authorization granted {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:07:31.260532 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG dbcounter [-] [416293] Writing DB stats keystone:SELECT=100 {{(pid=416293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:07:31.346271 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2290e43-b466-44f0-bc72-eefa0b115d0e None admin] Validating token access rules against request {{(pid=416294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:07:31.356978 dv-cinder-851351-1-smb devstack@keystone.service[416293]: [pid: 416293|app: 0|req: 539/1090] 10.222.0.42 () {58 vars in 1282 bytes} [Thu Jul 28 09:07:31 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 346 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 28 09:07:31.357851 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e842e34-faae-47d2-8808-a8a4bc2abc41 None admin] Authenticating user token {{(pid=416293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:07:31.385294 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a7a58d6-f161-400e-84fa-cec269deee29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:07:31.385921 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7a58d6-f161-400e-84fa-cec269deee29 None admin] REQUEST_METHOD: `GET` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:07:31.386204 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7a58d6-f161-400e-84fa-cec269deee29 None admin] SCRIPT_NAME: `/identity` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:07:31.386482 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7a58d6-f161-400e-84fa-cec269deee29 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:07:31.398973 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a7a58d6-f161-400e-84fa-cec269deee29 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:07:31.400471 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a7a58d6-f161-400e-84fa-cec269deee29 None admin] RBAC: Authorization granted {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:07:31.415436 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application [None req-4a7a58d6-f161-400e-84fa-cec269deee29 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 09:07:31.415436 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 09:07:31.415436 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 09:07:31.415436 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 09:07:31.415436 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 09:07:31.415436 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 09:07:31.415436 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 09:07:31.415436 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 09:07:31.415436 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 09:07:31.415436 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 09:07:31.415436 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 09:07:31.415436 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 09:07:31.415436 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 09:07:31.415436 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 09:07:31.415436 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 09:07:31.416531 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 09:07:31.416531 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 09:07:31.416531 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 09:07:31.416531 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 09:07:31.416531 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 09:07:31.416531 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 09:07:31.416531 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 09:07:31.416531 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 09:07:31.416531 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application with Lock( Jul 28 09:07:31.416531 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 09:07:31.416531 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return self._enter() Jul 28 09:07:31.416531 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 09:07:31.416531 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 09:07:31.416531 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 09:07:31.416531 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return self.creator() Jul 28 09:07:31.416531 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 09:07:31.416531 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application created_value = creator( Jul 28 09:07:31.417553 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 09:07:31.417553 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 09:07:31.417553 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 09:07:31.417553 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application Jul 28 09:07:31.417553 dv-cinder-851351-1-smb devstack@keystone.service[416294]: [pid: 416294|app: 0|req: 552/1091] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 09:07:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 09:07:31.417884 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a7a58d6-f161-400e-84fa-cec269deee29 None admin] Authenticating user token {{(pid=416294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:07:31.453858 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG dbcounter [-] [416294] Writing DB stats keystone:SELECT=100 {{(pid=416294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:07:31.476501 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e842e34-faae-47d2-8808-a8a4bc2abc41 None admin] Validating token access rules against request {{(pid=416293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:07:31.491623 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG dbcounter [-] [416293] Writing DB stats keystone:SELECT=100 {{(pid=416293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:07:31.518935 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d17521a-2967-4ee8-bac8-194584a68929 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:07:31.519627 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d17521a-2967-4ee8-bac8-194584a68929 None admin] REQUEST_METHOD: `PUT` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:07:31.519912 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d17521a-2967-4ee8-bac8-194584a68929 None admin] SCRIPT_NAME: `/identity` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:07:31.520195 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d17521a-2967-4ee8-bac8-194584a68929 None admin] PATH_INFO: `/v3/projects/27de4a0415e44654ae7abbc9f508f846/users/6fd19afb108b4b4c95f71f27ff1d4a88/roles/c67085ec338243df8f9b7d6459036e23` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:07:31.522256 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d17521a-2967-4ee8-bac8-194584a68929 None admin] RBAC: Authorizing `identity:create_grant(project_id=27de4a0415e44654ae7abbc9f508f846, user_id=6fd19afb108b4b4c95f71f27ff1d4a88, role_id=c67085ec338243df8f9b7d6459036e23)` {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:07:31.523729 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d17521a-2967-4ee8-bac8-194584a68929 None admin] RBAC: Authorization granted {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:07:31.541266 dv-cinder-851351-1-smb devstack@keystone.service[416293]: [pid: 416293|app: 0|req: 540/1092] 10.222.0.42 () {58 vars in 1439 bytes} [Thu Jul 28 09:07:31 2022] PUT /identity/v3/projects/27de4a0415e44654ae7abbc9f508f846/users/6fd19afb108b4b4c95f71f27ff1d4a88/roles/c67085ec338243df8f9b7d6459036e23 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 09:07:31.542624 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d17521a-2967-4ee8-bac8-194584a68929 None admin] Authenticating user token {{(pid=416293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:07:31.554964 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a7a58d6-f161-400e-84fa-cec269deee29 None admin] Validating token access rules against request {{(pid=416294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:07:31.604123 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2690140e-d601-4611-9329-bb7e9866b512 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:07:31.605093 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2690140e-d601-4611-9329-bb7e9866b512 None admin] REQUEST_METHOD: `GET` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:07:31.605394 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2690140e-d601-4611-9329-bb7e9866b512 None admin] SCRIPT_NAME: `/identity` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:07:31.605684 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2690140e-d601-4611-9329-bb7e9866b512 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:07:31.619154 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2690140e-d601-4611-9329-bb7e9866b512 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:07:31.620716 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2690140e-d601-4611-9329-bb7e9866b512 None admin] RBAC: Authorization granted {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:07:31.643070 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application [None req-2690140e-d601-4611-9329-bb7e9866b512 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 09:07:31.643070 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 09:07:31.643070 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 09:07:31.643070 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 09:07:31.643070 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 09:07:31.643070 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 09:07:31.643070 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 09:07:31.643070 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 09:07:31.643070 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 09:07:31.643070 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 09:07:31.643070 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 09:07:31.643070 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 09:07:31.643070 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 09:07:31.643070 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 09:07:31.643070 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 09:07:31.644299 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 09:07:31.644299 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 09:07:31.644299 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 09:07:31.644299 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 09:07:31.644299 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 09:07:31.644299 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 09:07:31.644299 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 09:07:31.644299 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 09:07:31.644299 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application with Lock( Jul 28 09:07:31.644299 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 09:07:31.644299 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return self._enter() Jul 28 09:07:31.644299 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 09:07:31.644299 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 09:07:31.644299 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 09:07:31.644299 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return self.creator() Jul 28 09:07:31.644299 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 09:07:31.644299 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application created_value = creator( Jul 28 09:07:31.645715 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 09:07:31.645715 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 09:07:31.645715 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 09:07:31.645715 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application Jul 28 09:07:31.645715 dv-cinder-851351-1-smb devstack@keystone.service[416294]: [pid: 416294|app: 0|req: 553/1093] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 09:07:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 09:07:31.650598 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2690140e-d601-4611-9329-bb7e9866b512 None admin] Authenticating user token {{(pid=416294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:07:31.705820 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d17521a-2967-4ee8-bac8-194584a68929 None admin] Validating token access rules against request {{(pid=416293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:07:31.748220 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG dbcounter [-] [416294] Writing DB stats keystone:SELECT=100 {{(pid=416294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:07:31.751421 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e98e13-d5bb-4981-9b5d-864ffbb49bb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:07:31.752076 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e98e13-d5bb-4981-9b5d-864ffbb49bb3 None admin] REQUEST_METHOD: `GET` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:07:31.752357 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e98e13-d5bb-4981-9b5d-864ffbb49bb3 None admin] SCRIPT_NAME: `/identity` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:07:31.752638 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e98e13-d5bb-4981-9b5d-864ffbb49bb3 None admin] PATH_INFO: `/v3/domains` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:07:31.753375 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90e98e13-d5bb-4981-9b5d-864ffbb49bb3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=416293) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 09:07:31.753684 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90e98e13-d5bb-4981-9b5d-864ffbb49bb3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:07:31.755092 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90e98e13-d5bb-4981-9b5d-864ffbb49bb3 None admin] RBAC: Authorization granted {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:07:31.768023 dv-cinder-851351-1-smb devstack@keystone.service[416293]: [pid: 416293|app: 0|req: 541/1094] 10.222.0.42 () {56 vars in 1109 bytes} [Thu Jul 28 09:07:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:07:31.771497 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2690140e-d601-4611-9329-bb7e9866b512 None admin] Validating token access rules against request {{(pid=416294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:07:31.811522 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ff2bb3-f5c6-458a-a7fc-a98da4127e86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:07:31.812162 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ff2bb3-f5c6-458a-a7fc-a98da4127e86 None admin] REQUEST_METHOD: `GET` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:07:31.812514 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ff2bb3-f5c6-458a-a7fc-a98da4127e86 None admin] SCRIPT_NAME: `/identity` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:07:31.812827 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ff2bb3-f5c6-458a-a7fc-a98da4127e86 None admin] PATH_INFO: `/v3/domains` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:07:31.813542 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86ff2bb3-f5c6-458a-a7fc-a98da4127e86 None admin] RBAC: Adding query filter params (name=Default) {{(pid=416294) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 09:07:31.813848 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86ff2bb3-f5c6-458a-a7fc-a98da4127e86 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:07:31.815257 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86ff2bb3-f5c6-458a-a7fc-a98da4127e86 None admin] RBAC: Authorization granted {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:07:31.835182 dv-cinder-851351-1-smb devstack@keystone.service[416294]: [pid: 416294|app: 0|req: 554/1095] 10.222.0.42 () {56 vars in 1109 bytes} [Thu Jul 28 09:07:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 09:07:31.836580 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e98e13-d5bb-4981-9b5d-864ffbb49bb3 None admin] Authenticating user token {{(pid=416293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:07:31.873983 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG dbcounter [-] [416293] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=416293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:07:31.962473 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e98e13-d5bb-4981-9b5d-864ffbb49bb3 None admin] Validating token access rules against request {{(pid=416293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:07:32.003215 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e009b886-a194-4d1b-92c1-a2c2293df394 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:07:32.003793 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e009b886-a194-4d1b-92c1-a2c2293df394 None admin] REQUEST_METHOD: `GET` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:07:32.004074 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e009b886-a194-4d1b-92c1-a2c2293df394 None admin] SCRIPT_NAME: `/identity` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:07:32.004348 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e009b886-a194-4d1b-92c1-a2c2293df394 None admin] PATH_INFO: `/v3/projects/service` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:07:32.012007 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e009b886-a194-4d1b-92c1-a2c2293df394 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:07:32.013525 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e009b886-a194-4d1b-92c1-a2c2293df394 None admin] RBAC: Authorization granted {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:07:32.025898 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application [None req-e009b886-a194-4d1b-92c1-a2c2293df394 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 09:07:32.025898 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 09:07:32.025898 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 09:07:32.025898 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 09:07:32.025898 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 09:07:32.025898 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 09:07:32.025898 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 09:07:32.025898 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 09:07:32.025898 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 09:07:32.025898 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 09:07:32.025898 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 09:07:32.025898 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 09:07:32.025898 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 28 09:07:32.025898 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 28 09:07:32.025898 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 28 09:07:32.026965 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 28 09:07:32.026965 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 09:07:32.026965 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 09:07:32.026965 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 09:07:32.026965 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 09:07:32.026965 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 09:07:32.026965 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 09:07:32.026965 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 09:07:32.026965 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application with Lock( Jul 28 09:07:32.026965 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 09:07:32.026965 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self._enter() Jul 28 09:07:32.026965 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 09:07:32.026965 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 09:07:32.026965 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 09:07:32.026965 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self.creator() Jul 28 09:07:32.026965 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 09:07:32.026965 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application created_value = creator( Jul 28 09:07:32.028041 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 28 09:07:32.028041 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 28 09:07:32.028041 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 28 09:07:32.028041 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 28 09:07:32.028041 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 28 09:07:32.028041 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 28 09:07:32.028041 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 09:07:32.028041 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application Jul 28 09:07:32.028041 dv-cinder-851351-1-smb devstack@keystone.service[416293]: [pid: 416293|app: 0|req: 542/1096] 10.222.0.42 () {56 vars in 1111 bytes} [Thu Jul 28 09:07:31 2022] GET /identity/v3/projects/service => generated 88 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 09:07:32.033244 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ff2bb3-f5c6-458a-a7fc-a98da4127e86 None admin] Authenticating user token {{(pid=416294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:07:32.138877 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ff2bb3-f5c6-458a-a7fc-a98da4127e86 None admin] Validating token access rules against request {{(pid=416294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:07:32.174858 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd951958-c339-4572-a094-4ab642d32c93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:07:32.175498 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd951958-c339-4572-a094-4ab642d32c93 None admin] REQUEST_METHOD: `GET` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:07:32.175755 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd951958-c339-4572-a094-4ab642d32c93 None admin] SCRIPT_NAME: `/identity` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:07:32.176038 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd951958-c339-4572-a094-4ab642d32c93 None admin] PATH_INFO: `/v3/projects` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:07:32.176851 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd951958-c339-4572-a094-4ab642d32c93 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=416294) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 09:07:32.177157 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd951958-c339-4572-a094-4ab642d32c93 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:07:32.178606 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd951958-c339-4572-a094-4ab642d32c93 None admin] RBAC: Authorization granted {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:07:32.187543 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG dbcounter [-] [416294] Writing DB stats keystone:SELECT=100 {{(pid=416294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:07:32.191109 dv-cinder-851351-1-smb devstack@keystone.service[416294]: [pid: 416294|app: 0|req: 555/1097] 10.222.0.42 () {56 vars in 1148 bytes} [Thu Jul 28 09:07:32 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:07:32.197550 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e009b886-a194-4d1b-92c1-a2c2293df394 None admin] Authenticating user token {{(pid=416293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:07:32.306062 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG dbcounter [-] [416293] Writing DB stats keystone:SELECT=100 {{(pid=416293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:07:32.318382 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e009b886-a194-4d1b-92c1-a2c2293df394 None admin] Validating token access rules against request {{(pid=416293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:07:32.355945 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d864ea47-3918-4664-9f1f-1d95af768bd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:07:32.356579 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d864ea47-3918-4664-9f1f-1d95af768bd2 None admin] REQUEST_METHOD: `GET` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:07:32.356889 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d864ea47-3918-4664-9f1f-1d95af768bd2 None admin] SCRIPT_NAME: `/identity` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:07:32.357164 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d864ea47-3918-4664-9f1f-1d95af768bd2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:07:32.357958 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d864ea47-3918-4664-9f1f-1d95af768bd2 None admin] RBAC: Adding query filter params (role.id=4d94122535c54ae98fbaf3c8766c59be, scope.project.id=6c4349445f224184b093d9dfd0dfc642, user.id=62f7da38a7044000bdf5790da751a45e) {{(pid=416293) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 09:07:32.358266 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d864ea47-3918-4664-9f1f-1d95af768bd2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:07:32.359717 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d864ea47-3918-4664-9f1f-1d95af768bd2 None admin] RBAC: Authorization granted {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:07:32.366274 dv-cinder-851351-1-smb devstack@keystone.service[416293]: [pid: 416293|app: 0|req: 543/1098] 10.222.0.42 () {56 vars in 1374 bytes} [Thu Jul 28 09:07:32 2022] GET /identity/v3/role_assignments?user.id=62f7da38a7044000bdf5790da751a45e&scope.project.id=6c4349445f224184b093d9dfd0dfc642&role.id=4d94122535c54ae98fbaf3c8766c59be => generated 608 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:07:33.581780 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b339cc47-54c2-43bf-86bf-67902647fa42 None None] REQUEST_METHOD: `GET` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:07:33.582381 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b339cc47-54c2-43bf-86bf-67902647fa42 None None] SCRIPT_NAME: `/identity` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:07:33.582381 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b339cc47-54c2-43bf-86bf-67902647fa42 None None] PATH_INFO: `/` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:07:33.583686 dv-cinder-851351-1-smb devstack@keystone.service[416294]: [pid: 416294|app: 0|req: 556/1099] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 09:07:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 09:07:33.589358 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1eba22-ed13-4d9d-9fbc-2b33cb7d192e None None] REQUEST_METHOD: `POST` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:07:33.589789 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1eba22-ed13-4d9d-9fbc-2b33cb7d192e None None] SCRIPT_NAME: `/identity` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:07:33.589902 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1eba22-ed13-4d9d-9fbc-2b33cb7d192e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:07:33.609552 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.auth.core [None req-ca1eba22-ed13-4d9d-9fbc-2b33cb7d192e None None] MFA Rules not processed for user `dbf87abab90e4fdf9e75408f4199918e`. Rule list: `[]` (Enabled: `True`). {{(pid=416293) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 09:07:33.610767 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.fernet_utils [None req-ca1eba22-ed13-4d9d-9fbc-2b33cb7d192e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=416293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 09:07:33.682984 dv-cinder-851351-1-smb devstack@keystone.service[416293]: [pid: 416293|app: 0|req: 544/1100] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 09:07:33 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 09:07:33.706464 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b339cc47-54c2-43bf-86bf-67902647fa42 None None] Authenticating user token {{(pid=416294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:07:33.816317 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b339cc47-54c2-43bf-86bf-67902647fa42 None None] Validating token access rules against request {{(pid=416294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:07:33.852972 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c804882-b3bd-4361-8682-9ca2a7e069e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:07:33.853533 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c804882-b3bd-4361-8682-9ca2a7e069e9 None admin] REQUEST_METHOD: `GET` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:07:33.853832 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c804882-b3bd-4361-8682-9ca2a7e069e9 None admin] SCRIPT_NAME: `/identity` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:07:33.854104 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c804882-b3bd-4361-8682-9ca2a7e069e9 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:07:33.864989 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c804882-b3bd-4361-8682-9ca2a7e069e9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 09:07:33.869872 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application [None req-1c804882-b3bd-4361-8682-9ca2a7e069e9 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 09:07:33.869872 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 09:07:33.869872 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 09:07:33.869872 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 09:07:33.869872 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 09:07:33.869872 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 09:07:33.869872 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 09:07:33.869872 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 09:07:33.869872 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 09:07:33.869872 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 09:07:33.869872 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 09:07:33.869872 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 09:07:33.869872 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 09:07:33.869872 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 09:07:33.869872 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 09:07:33.869872 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 09:07:33.871129 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 09:07:33.871129 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 09:07:33.871129 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 09:07:33.871129 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 09:07:33.871129 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 09:07:33.871129 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 09:07:33.871129 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 09:07:33.871129 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 09:07:33.871129 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 09:07:33.871129 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 09:07:33.871129 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 09:07:33.871129 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application with Lock( Jul 28 09:07:33.871129 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 09:07:33.871129 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return self._enter() Jul 28 09:07:33.871129 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 09:07:33.871129 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 09:07:33.872374 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 09:07:33.872374 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return self.creator() Jul 28 09:07:33.872374 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 09:07:33.872374 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application created_value = creator( Jul 28 09:07:33.872374 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 09:07:33.872374 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 09:07:33.872374 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 09:07:33.872374 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 09:07:33.872374 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 09:07:33.872374 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 09:07:33.872374 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 09:07:33.872374 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application Jul 28 09:07:33.872374 dv-cinder-851351-1-smb devstack@keystone.service[416294]: [pid: 416294|app: 0|req: 557/1101] 10.222.0.42 () {56 vars in 1096 bytes} [Thu Jul 28 09:07:33 2022] GET /identity/v3/roles/admin => generated 83 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 09:07:33.877632 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca1eba22-ed13-4d9d-9fbc-2b33cb7d192e None None] Authenticating user token {{(pid=416293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:07:33.963423 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG dbcounter [-] [416293] Writing DB stats keystone:SELECT=100 {{(pid=416293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:07:33.980779 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca1eba22-ed13-4d9d-9fbc-2b33cb7d192e None None] Validating token access rules against request {{(pid=416293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:07:34.019511 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd65ee6d-5778-4595-956b-61687340d5d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:07:34.020159 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd65ee6d-5778-4595-956b-61687340d5d1 None admin] REQUEST_METHOD: `GET` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:07:34.020441 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd65ee6d-5778-4595-956b-61687340d5d1 None admin] SCRIPT_NAME: `/identity` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:07:34.020767 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd65ee6d-5778-4595-956b-61687340d5d1 None admin] PATH_INFO: `/v3/roles` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:07:34.021502 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd65ee6d-5778-4595-956b-61687340d5d1 None admin] RBAC: Adding query filter params (name=admin) {{(pid=416293) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 09:07:34.021804 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd65ee6d-5778-4595-956b-61687340d5d1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:07:34.023221 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd65ee6d-5778-4595-956b-61687340d5d1 None admin] RBAC: Authorization granted {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:07:34.033321 dv-cinder-851351-1-smb devstack@keystone.service[416293]: [pid: 416293|app: 0|req: 545/1102] 10.222.0.42 () {56 vars in 1099 bytes} [Thu Jul 28 09:07:33 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:07:34.039616 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c804882-b3bd-4361-8682-9ca2a7e069e9 None admin] Authenticating user token {{(pid=416294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:07:34.106695 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG dbcounter [-] [416294] Writing DB stats keystone:SELECT=100 {{(pid=416294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:07:34.150365 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c804882-b3bd-4361-8682-9ca2a7e069e9 None admin] Validating token access rules against request {{(pid=416294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:07:34.186954 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afbf9f99-315b-4ab1-a73f-d28159061056 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:07:34.187604 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbf9f99-315b-4ab1-a73f-d28159061056 None admin] REQUEST_METHOD: `GET` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:07:34.187883 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbf9f99-315b-4ab1-a73f-d28159061056 None admin] SCRIPT_NAME: `/identity` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:07:34.188163 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbf9f99-315b-4ab1-a73f-d28159061056 None admin] PATH_INFO: `/v3/users/6fd19afb108b4b4c95f71f27ff1d4a88` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:07:34.189382 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afbf9f99-315b-4ab1-a73f-d28159061056 None admin] RBAC: Authorizing `identity:get_user(user_id=6fd19afb108b4b4c95f71f27ff1d4a88)` {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:07:34.190838 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afbf9f99-315b-4ab1-a73f-d28159061056 None admin] RBAC: Authorization granted {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:07:34.192462 dv-cinder-851351-1-smb devstack@keystone.service[416294]: [pid: 416294|app: 0|req: 558/1103] 10.222.0.42 () {56 vars in 1177 bytes} [Thu Jul 28 09:07:34 2022] GET /identity/v3/users/6fd19afb108b4b4c95f71f27ff1d4a88 => generated 285 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:07:34.199013 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd65ee6d-5778-4595-956b-61687340d5d1 None admin] Authenticating user token {{(pid=416293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:07:34.305029 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd65ee6d-5778-4595-956b-61687340d5d1 None admin] Validating token access rules against request {{(pid=416293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:07:34.340345 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96fafb76-4f2a-4c84-8752-4f6d88722590 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:07:34.341023 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fafb76-4f2a-4c84-8752-4f6d88722590 None admin] REQUEST_METHOD: `GET` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:07:34.341306 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fafb76-4f2a-4c84-8752-4f6d88722590 None admin] SCRIPT_NAME: `/identity` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:07:34.341575 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fafb76-4f2a-4c84-8752-4f6d88722590 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:07:34.357087 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG dbcounter [-] [416293] Writing DB stats keystone:SELECT=100 {{(pid=416293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:07:34.413734 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96fafb76-4f2a-4c84-8752-4f6d88722590 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:07:34.415526 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96fafb76-4f2a-4c84-8752-4f6d88722590 None admin] RBAC: Authorization granted {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:07:34.520549 dv-cinder-851351-1-smb devstack@keystone.service[416293]: [pid: 416293|app: 0|req: 546/1104] 10.222.0.42 () {58 vars in 1282 bytes} [Thu Jul 28 09:07:34 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 28 09:07:34.526756 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afbf9f99-315b-4ab1-a73f-d28159061056 None admin] Authenticating user token {{(pid=416294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:07:34.634939 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afbf9f99-315b-4ab1-a73f-d28159061056 None admin] Validating token access rules against request {{(pid=416294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:07:34.661993 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG dbcounter [-] [416294] Writing DB stats keystone:SELECT=100 {{(pid=416294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:07:34.671360 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a1245b-cf3e-41ba-8da0-3100d2ec419d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:07:34.672062 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a1245b-cf3e-41ba-8da0-3100d2ec419d None admin] REQUEST_METHOD: `GET` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:07:34.672348 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a1245b-cf3e-41ba-8da0-3100d2ec419d None admin] SCRIPT_NAME: `/identity` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:07:34.672627 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a1245b-cf3e-41ba-8da0-3100d2ec419d None admin] PATH_INFO: `/v3/projects/27de4a0415e44654ae7abbc9f508f846` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:07:34.674061 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a1245b-cf3e-41ba-8da0-3100d2ec419d None admin] RBAC: Authorizing `identity:get_project(project_id=27de4a0415e44654ae7abbc9f508f846)` {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:07:34.675557 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a1245b-cf3e-41ba-8da0-3100d2ec419d None admin] RBAC: Authorization granted {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:07:34.677321 dv-cinder-851351-1-smb devstack@keystone.service[416294]: [pid: 416294|app: 0|req: 559/1105] 10.222.0.42 () {56 vars in 1186 bytes} [Thu Jul 28 09:07:34 2022] GET /identity/v3/projects/27de4a0415e44654ae7abbc9f508f846 => generated 311 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:07:34.684110 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96fafb76-4f2a-4c84-8752-4f6d88722590 None admin] Authenticating user token {{(pid=416293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:07:34.733636 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG dbcounter [-] [416293] Writing DB stats keystone:SELECT=100 {{(pid=416293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:07:34.789704 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96fafb76-4f2a-4c84-8752-4f6d88722590 None admin] Validating token access rules against request {{(pid=416293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:07:34.828235 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27160a3e-cd07-4ecf-9828-d3efce33c7f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:07:34.828896 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27160a3e-cd07-4ecf-9828-d3efce33c7f3 None admin] REQUEST_METHOD: `GET` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:07:34.829188 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27160a3e-cd07-4ecf-9828-d3efce33c7f3 None admin] SCRIPT_NAME: `/identity` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:07:34.829465 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27160a3e-cd07-4ecf-9828-d3efce33c7f3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:07:34.830264 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27160a3e-cd07-4ecf-9828-d3efce33c7f3 None admin] RBAC: Adding query filter params (role.id=c67085ec338243df8f9b7d6459036e23, scope.project.id=27de4a0415e44654ae7abbc9f508f846, user.id=6fd19afb108b4b4c95f71f27ff1d4a88) {{(pid=416293) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 09:07:34.830577 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27160a3e-cd07-4ecf-9828-d3efce33c7f3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:07:34.832028 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27160a3e-cd07-4ecf-9828-d3efce33c7f3 None admin] RBAC: Authorization granted {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:07:34.838452 dv-cinder-851351-1-smb devstack@keystone.service[416293]: [pid: 416293|app: 0|req: 547/1106] 10.222.0.42 () {56 vars in 1374 bytes} [Thu Jul 28 09:07:34 2022] GET /identity/v3/role_assignments?user.id=6fd19afb108b4b4c95f71f27ff1d4a88&scope.project.id=27de4a0415e44654ae7abbc9f508f846&role.id=c67085ec338243df8f9b7d6459036e23 => generated 608 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:07:36.842288 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb3709a-e198-4cd9-a873-d76169df8d54 None None] REQUEST_METHOD: `GET` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:07:36.842895 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb3709a-e198-4cd9-a873-d76169df8d54 None None] SCRIPT_NAME: `/identity` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:07:36.842895 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb3709a-e198-4cd9-a873-d76169df8d54 None None] PATH_INFO: `/` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:07:36.844576 dv-cinder-851351-1-smb devstack@keystone.service[416294]: [pid: 416294|app: 0|req: 560/1107] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 09:07:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 09:07:36.852201 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55cd3deb-9953-4276-81f5-64320c25f5e7 None None] REQUEST_METHOD: `POST` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:07:36.852908 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55cd3deb-9953-4276-81f5-64320c25f5e7 None None] SCRIPT_NAME: `/identity` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:07:36.852908 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55cd3deb-9953-4276-81f5-64320c25f5e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:07:36.873235 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.auth.core [None req-55cd3deb-9953-4276-81f5-64320c25f5e7 None None] MFA Rules not processed for user `dbf87abab90e4fdf9e75408f4199918e`. Rule list: `[]` (Enabled: `True`). {{(pid=416293) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 09:07:36.874446 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.fernet_utils [None req-55cd3deb-9953-4276-81f5-64320c25f5e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=416293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 09:07:36.954156 dv-cinder-851351-1-smb devstack@keystone.service[416293]: [pid: 416293|app: 0|req: 548/1108] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 09:07:36 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 09:07:36.979247 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb3709a-e198-4cd9-a873-d76169df8d54 None None] Authenticating user token {{(pid=416294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:07:37.095227 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb3709a-e198-4cd9-a873-d76169df8d54 None None] Validating token access rules against request {{(pid=416294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:07:37.133190 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be338aa4-6497-47af-bf56-37fb1b1b9cb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:07:37.133844 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be338aa4-6497-47af-bf56-37fb1b1b9cb6 None admin] REQUEST_METHOD: `GET` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:07:37.134121 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be338aa4-6497-47af-bf56-37fb1b1b9cb6 None admin] SCRIPT_NAME: `/identity` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:07:37.134390 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be338aa4-6497-47af-bf56-37fb1b1b9cb6 None admin] PATH_INFO: `/v3/domains/default` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:07:37.135619 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be338aa4-6497-47af-bf56-37fb1b1b9cb6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:07:37.137111 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be338aa4-6497-47af-bf56-37fb1b1b9cb6 None admin] RBAC: Authorization granted {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:07:37.138762 dv-cinder-851351-1-smb devstack@keystone.service[416294]: [pid: 416294|app: 0|req: 561/1109] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 09:07:36 2022] GET /identity/v3/domains/default => generated 199 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:07:37.145317 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55cd3deb-9953-4276-81f5-64320c25f5e7 None None] Authenticating user token {{(pid=416293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:07:37.195613 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG dbcounter [-] [416293] Writing DB stats keystone:SELECT=100 {{(pid=416293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:07:37.261827 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55cd3deb-9953-4276-81f5-64320c25f5e7 None None] Validating token access rules against request {{(pid=416293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:07:37.300463 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c2ef34-ee57-4828-9486-bb66e2dad5dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:07:37.301153 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c2ef34-ee57-4828-9486-bb66e2dad5dc None admin] REQUEST_METHOD: `POST` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:07:37.301438 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c2ef34-ee57-4828-9486-bb66e2dad5dc None admin] SCRIPT_NAME: `/identity` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:07:37.301716 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c2ef34-ee57-4828-9486-bb66e2dad5dc None admin] PATH_INFO: `/v3/users` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:07:37.302431 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c2ef34-ee57-4828-9486-bb66e2dad5dc None admin] RBAC: Authorizing `identity:create_user()` {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:07:37.303925 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c2ef34-ee57-4828-9486-bb66e2dad5dc None admin] RBAC: Authorization granted {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:07:37.328911 dv-cinder-851351-1-smb devstack@keystone.service[416293]: [pid: 416293|app: 0|req: 549/1110] 10.222.0.42 () {60 vars in 1132 bytes} [Thu Jul 28 09:07:37 2022] POST /identity/v3/users => generated 286 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 09:07:39.378886 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f6db03-883d-4fde-b91e-b6474321433b None None] REQUEST_METHOD: `GET` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:07:39.379526 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f6db03-883d-4fde-b91e-b6474321433b None None] SCRIPT_NAME: `/identity` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:07:39.379526 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f6db03-883d-4fde-b91e-b6474321433b None None] PATH_INFO: `/` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:07:39.380833 dv-cinder-851351-1-smb devstack@keystone.service[416294]: [pid: 416294|app: 0|req: 562/1111] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 09:07:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 09:07:39.387227 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff84262f-95e6-40db-b507-540545b2f003 None None] REQUEST_METHOD: `POST` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:07:39.387700 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff84262f-95e6-40db-b507-540545b2f003 None None] SCRIPT_NAME: `/identity` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:07:39.387807 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff84262f-95e6-40db-b507-540545b2f003 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:07:39.408195 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.auth.core [None req-ff84262f-95e6-40db-b507-540545b2f003 None None] MFA Rules not processed for user `dbf87abab90e4fdf9e75408f4199918e`. Rule list: `[]` (Enabled: `True`). {{(pid=416293) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 09:07:39.409458 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.fernet_utils [None req-ff84262f-95e6-40db-b507-540545b2f003 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=416293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 09:07:39.479636 dv-cinder-851351-1-smb devstack@keystone.service[416293]: [pid: 416293|app: 0|req: 550/1112] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 09:07:39 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 09:07:39.503543 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f6db03-883d-4fde-b91e-b6474321433b None None] Authenticating user token {{(pid=416294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:07:39.572644 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG dbcounter [-] [416294] Writing DB stats keystone:SELECT=100 {{(pid=416294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:07:39.614401 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f6db03-883d-4fde-b91e-b6474321433b None None] Validating token access rules against request {{(pid=416294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:07:39.655177 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e4a179-dfda-497d-b43e-34dee32636c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:07:39.655983 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e4a179-dfda-497d-b43e-34dee32636c3 None admin] REQUEST_METHOD: `GET` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:07:39.656365 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e4a179-dfda-497d-b43e-34dee32636c3 None admin] SCRIPT_NAME: `/identity` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:07:39.656744 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e4a179-dfda-497d-b43e-34dee32636c3 None admin] PATH_INFO: `/v3/roles/6194848862704a289bbaa3fda43a9050` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:07:39.659277 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e4a179-dfda-497d-b43e-34dee32636c3 None admin] RBAC: Authorizing `identity:get_role(role_id=6194848862704a289bbaa3fda43a9050)` {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:07:39.661529 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e4a179-dfda-497d-b43e-34dee32636c3 None admin] RBAC: Authorization granted {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:07:39.663639 dv-cinder-851351-1-smb devstack@keystone.service[416294]: [pid: 416294|app: 0|req: 563/1113] 10.222.0.42 () {56 vars in 1177 bytes} [Thu Jul 28 09:07:39 2022] GET /identity/v3/roles/6194848862704a289bbaa3fda43a9050 => generated 223 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:07:39.669867 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff84262f-95e6-40db-b507-540545b2f003 None None] Authenticating user token {{(pid=416293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:07:39.697074 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG dbcounter [-] [416293] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=416293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:07:39.777085 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff84262f-95e6-40db-b507-540545b2f003 None None] Validating token access rules against request {{(pid=416293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:07:39.812323 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbef0b1c-b610-49bd-9ff6-edaba4870594 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:07:39.813022 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbef0b1c-b610-49bd-9ff6-edaba4870594 None admin] REQUEST_METHOD: `GET` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:07:39.813313 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbef0b1c-b610-49bd-9ff6-edaba4870594 None admin] SCRIPT_NAME: `/identity` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:07:39.813562 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbef0b1c-b610-49bd-9ff6-edaba4870594 None admin] PATH_INFO: `/v3/users/2c8dbffc33a84af3a3621d00f9f91fe6` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:07:39.827426 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbef0b1c-b610-49bd-9ff6-edaba4870594 None admin] RBAC: Authorizing `identity:get_user(user_id=2c8dbffc33a84af3a3621d00f9f91fe6)` {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:07:39.828958 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbef0b1c-b610-49bd-9ff6-edaba4870594 None admin] RBAC: Authorization granted {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:07:39.830617 dv-cinder-851351-1-smb devstack@keystone.service[416293]: [pid: 416293|app: 0|req: 551/1114] 10.222.0.42 () {56 vars in 1177 bytes} [Thu Jul 28 09:07:39 2022] GET /identity/v3/users/2c8dbffc33a84af3a3621d00f9f91fe6 => generated 286 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:07:39.836784 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e4a179-dfda-497d-b43e-34dee32636c3 None admin] Authenticating user token {{(pid=416294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:07:39.959977 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e4a179-dfda-497d-b43e-34dee32636c3 None admin] Validating token access rules against request {{(pid=416294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:07:39.990766 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG dbcounter [-] [416294] Writing DB stats keystone:SELECT=100 {{(pid=416294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:07:39.997156 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92121c3a-7e2d-49b4-aa1f-0f71f3038868 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:07:39.997811 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92121c3a-7e2d-49b4-aa1f-0f71f3038868 None admin] REQUEST_METHOD: `GET` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:07:39.998100 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92121c3a-7e2d-49b4-aa1f-0f71f3038868 None admin] SCRIPT_NAME: `/identity` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:07:39.998365 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92121c3a-7e2d-49b4-aa1f-0f71f3038868 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:07:40.069533 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92121c3a-7e2d-49b4-aa1f-0f71f3038868 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:07:40.071007 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92121c3a-7e2d-49b4-aa1f-0f71f3038868 None admin] RBAC: Authorization granted {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:07:40.175019 dv-cinder-851351-1-smb devstack@keystone.service[416294]: [pid: 416294|app: 0|req: 564/1115] 10.222.0.42 () {58 vars in 1282 bytes} [Thu Jul 28 09:07:39 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 28 09:07:40.181342 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbef0b1c-b610-49bd-9ff6-edaba4870594 None admin] Authenticating user token {{(pid=416293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:07:40.287641 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG dbcounter [-] [416293] Writing DB stats keystone:SELECT=100 {{(pid=416293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:07:40.305780 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbef0b1c-b610-49bd-9ff6-edaba4870594 None admin] Validating token access rules against request {{(pid=416293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:07:40.347392 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba4ff44-6681-4b96-9cac-feb786f78906 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:07:40.348032 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba4ff44-6681-4b96-9cac-feb786f78906 None admin] REQUEST_METHOD: `GET` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:07:40.348310 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba4ff44-6681-4b96-9cac-feb786f78906 None admin] SCRIPT_NAME: `/identity` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:07:40.348585 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba4ff44-6681-4b96-9cac-feb786f78906 None admin] PATH_INFO: `/v3/projects/27de4a0415e44654ae7abbc9f508f846` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:07:40.349902 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ba4ff44-6681-4b96-9cac-feb786f78906 None admin] RBAC: Authorizing `identity:get_project(project_id=27de4a0415e44654ae7abbc9f508f846)` {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:07:40.351356 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ba4ff44-6681-4b96-9cac-feb786f78906 None admin] RBAC: Authorization granted {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:07:40.353111 dv-cinder-851351-1-smb devstack@keystone.service[416293]: [pid: 416293|app: 0|req: 552/1116] 10.222.0.42 () {56 vars in 1186 bytes} [Thu Jul 28 09:07:40 2022] GET /identity/v3/projects/27de4a0415e44654ae7abbc9f508f846 => generated 311 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:07:40.359705 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92121c3a-7e2d-49b4-aa1f-0f71f3038868 None admin] Authenticating user token {{(pid=416294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:07:40.392268 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG dbcounter [-] [416294] Writing DB stats keystone:SELECT=100 {{(pid=416294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:07:40.462621 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92121c3a-7e2d-49b4-aa1f-0f71f3038868 None admin] Validating token access rules against request {{(pid=416294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:07:40.498356 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a6ecbd-f63b-4a1d-8ac5-90e811669ad7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:07:40.498981 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a6ecbd-f63b-4a1d-8ac5-90e811669ad7 None admin] REQUEST_METHOD: `GET` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:07:40.499260 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a6ecbd-f63b-4a1d-8ac5-90e811669ad7 None admin] SCRIPT_NAME: `/identity` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:07:40.499534 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a6ecbd-f63b-4a1d-8ac5-90e811669ad7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:07:40.500386 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30a6ecbd-f63b-4a1d-8ac5-90e811669ad7 None admin] RBAC: Adding query filter params (role.id=6194848862704a289bbaa3fda43a9050, scope.project.id=27de4a0415e44654ae7abbc9f508f846, user.id=2c8dbffc33a84af3a3621d00f9f91fe6) {{(pid=416294) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 09:07:40.500711 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30a6ecbd-f63b-4a1d-8ac5-90e811669ad7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:07:40.502156 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30a6ecbd-f63b-4a1d-8ac5-90e811669ad7 None admin] RBAC: Authorization granted {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:07:40.508015 dv-cinder-851351-1-smb devstack@keystone.service[416294]: [pid: 416294|app: 0|req: 565/1117] 10.222.0.42 () {56 vars in 1374 bytes} [Thu Jul 28 09:07:40 2022] GET /identity/v3/role_assignments?user.id=2c8dbffc33a84af3a3621d00f9f91fe6&scope.project.id=27de4a0415e44654ae7abbc9f508f846&role.id=6194848862704a289bbaa3fda43a9050 => generated 259 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:07:42.467155 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dddecfd-b11b-46af-9886-82b92d9d6ac0 None None] REQUEST_METHOD: `GET` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:07:42.467774 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dddecfd-b11b-46af-9886-82b92d9d6ac0 None None] SCRIPT_NAME: `/identity` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:07:42.467774 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dddecfd-b11b-46af-9886-82b92d9d6ac0 None None] PATH_INFO: `/` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:07:42.469174 dv-cinder-851351-1-smb devstack@keystone.service[416293]: [pid: 416293|app: 0|req: 553/1118] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 09:07:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 09:07:42.475512 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092bddd6-4c9b-4f13-a2d7-ff4c56ed8a2a None None] REQUEST_METHOD: `POST` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:07:42.476261 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092bddd6-4c9b-4f13-a2d7-ff4c56ed8a2a None None] SCRIPT_NAME: `/identity` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:07:42.476431 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092bddd6-4c9b-4f13-a2d7-ff4c56ed8a2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:07:42.499490 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.auth.core [None req-092bddd6-4c9b-4f13-a2d7-ff4c56ed8a2a None None] MFA Rules not processed for user `dbf87abab90e4fdf9e75408f4199918e`. Rule list: `[]` (Enabled: `True`). {{(pid=416294) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 09:07:42.500632 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.fernet_utils [None req-092bddd6-4c9b-4f13-a2d7-ff4c56ed8a2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=416294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 09:07:42.589262 dv-cinder-851351-1-smb devstack@keystone.service[416294]: [pid: 416294|app: 0|req: 566/1119] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 09:07:42 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 09:07:42.611729 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dddecfd-b11b-46af-9886-82b92d9d6ac0 None None] Authenticating user token {{(pid=416293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:07:42.719214 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dddecfd-b11b-46af-9886-82b92d9d6ac0 None None] Validating token access rules against request {{(pid=416293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:07:42.755284 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f8b0c5-c2b8-45bb-be3b-5852dd4d705a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:07:42.755947 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f8b0c5-c2b8-45bb-be3b-5852dd4d705a None admin] REQUEST_METHOD: `GET` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:07:42.756230 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f8b0c5-c2b8-45bb-be3b-5852dd4d705a None admin] SCRIPT_NAME: `/identity` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:07:42.756505 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f8b0c5-c2b8-45bb-be3b-5852dd4d705a None admin] PATH_INFO: `/v3/roles/6194848862704a289bbaa3fda43a9050` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:07:42.758042 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67f8b0c5-c2b8-45bb-be3b-5852dd4d705a None admin] RBAC: Authorizing `identity:get_role(role_id=6194848862704a289bbaa3fda43a9050)` {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:07:42.759433 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67f8b0c5-c2b8-45bb-be3b-5852dd4d705a None admin] RBAC: Authorization granted {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:07:42.760863 dv-cinder-851351-1-smb devstack@keystone.service[416293]: [pid: 416293|app: 0|req: 554/1120] 10.222.0.42 () {56 vars in 1177 bytes} [Thu Jul 28 09:07:42 2022] GET /identity/v3/roles/6194848862704a289bbaa3fda43a9050 => generated 223 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:07:42.767114 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-092bddd6-4c9b-4f13-a2d7-ff4c56ed8a2a None None] Authenticating user token {{(pid=416294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:07:42.795186 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG dbcounter [-] [416294] Writing DB stats keystone:SELECT=100 {{(pid=416294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:07:42.874439 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-092bddd6-4c9b-4f13-a2d7-ff4c56ed8a2a None None] Validating token access rules against request {{(pid=416294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:07:42.911634 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d259149-8f81-4566-a5cc-7a358ee7fe44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:07:42.912298 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d259149-8f81-4566-a5cc-7a358ee7fe44 None admin] REQUEST_METHOD: `GET` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:07:42.912621 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d259149-8f81-4566-a5cc-7a358ee7fe44 None admin] SCRIPT_NAME: `/identity` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:07:42.912924 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d259149-8f81-4566-a5cc-7a358ee7fe44 None admin] PATH_INFO: `/v3/users/2c8dbffc33a84af3a3621d00f9f91fe6` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:07:42.914164 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d259149-8f81-4566-a5cc-7a358ee7fe44 None admin] RBAC: Authorizing `identity:get_user(user_id=2c8dbffc33a84af3a3621d00f9f91fe6)` {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:07:42.915628 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d259149-8f81-4566-a5cc-7a358ee7fe44 None admin] RBAC: Authorization granted {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:07:42.917339 dv-cinder-851351-1-smb devstack@keystone.service[416294]: [pid: 416294|app: 0|req: 567/1121] 10.222.0.42 () {56 vars in 1177 bytes} [Thu Jul 28 09:07:42 2022] GET /identity/v3/users/2c8dbffc33a84af3a3621d00f9f91fe6 => generated 286 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:07:42.923627 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f8b0c5-c2b8-45bb-be3b-5852dd4d705a None admin] Authenticating user token {{(pid=416293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:07:42.948456 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG dbcounter [-] [416293] Writing DB stats keystone:SELECT=100 {{(pid=416293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:07:43.036563 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f8b0c5-c2b8-45bb-be3b-5852dd4d705a None admin] Validating token access rules against request {{(pid=416293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:07:43.073808 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a9365ca-709b-4c66-b464-0287e34a4c1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:07:43.074469 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9365ca-709b-4c66-b464-0287e34a4c1b None admin] REQUEST_METHOD: `GET` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:07:43.074756 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9365ca-709b-4c66-b464-0287e34a4c1b None admin] SCRIPT_NAME: `/identity` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:07:43.075035 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9365ca-709b-4c66-b464-0287e34a4c1b None admin] PATH_INFO: `/v3/projects/27de4a0415e44654ae7abbc9f508f846` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:07:43.076266 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a9365ca-709b-4c66-b464-0287e34a4c1b None admin] RBAC: Authorizing `identity:get_project(project_id=27de4a0415e44654ae7abbc9f508f846)` {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:07:43.077799 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a9365ca-709b-4c66-b464-0287e34a4c1b None admin] RBAC: Authorization granted {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:07:43.079521 dv-cinder-851351-1-smb devstack@keystone.service[416293]: [pid: 416293|app: 0|req: 555/1122] 10.222.0.42 () {56 vars in 1186 bytes} [Thu Jul 28 09:07:42 2022] GET /identity/v3/projects/27de4a0415e44654ae7abbc9f508f846 => generated 311 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:07:43.085908 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d259149-8f81-4566-a5cc-7a358ee7fe44 None admin] Authenticating user token {{(pid=416294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:07:43.191875 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG dbcounter [-] [416294] Writing DB stats keystone:SELECT=100 {{(pid=416294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:07:43.200193 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d259149-8f81-4566-a5cc-7a358ee7fe44 None admin] Validating token access rules against request {{(pid=416294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:07:43.237037 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c165d6-f97b-4707-bcd0-581414807518 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:07:43.237727 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c165d6-f97b-4707-bcd0-581414807518 None admin] REQUEST_METHOD: `PUT` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:07:43.238015 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c165d6-f97b-4707-bcd0-581414807518 None admin] SCRIPT_NAME: `/identity` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:07:43.238297 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c165d6-f97b-4707-bcd0-581414807518 None admin] PATH_INFO: `/v3/projects/27de4a0415e44654ae7abbc9f508f846/users/2c8dbffc33a84af3a3621d00f9f91fe6/roles/6194848862704a289bbaa3fda43a9050` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:07:43.240561 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1c165d6-f97b-4707-bcd0-581414807518 None admin] RBAC: Authorizing `identity:create_grant(project_id=27de4a0415e44654ae7abbc9f508f846, user_id=2c8dbffc33a84af3a3621d00f9f91fe6, role_id=6194848862704a289bbaa3fda43a9050)` {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:07:43.242049 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1c165d6-f97b-4707-bcd0-581414807518 None admin] RBAC: Authorization granted {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:07:43.255511 dv-cinder-851351-1-smb devstack@keystone.service[416294]: [pid: 416294|app: 0|req: 568/1123] 10.222.0.42 () {58 vars in 1439 bytes} [Thu Jul 28 09:07:43 2022] PUT /identity/v3/projects/27de4a0415e44654ae7abbc9f508f846/users/2c8dbffc33a84af3a3621d00f9f91fe6/roles/6194848862704a289bbaa3fda43a9050 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 09:07:45.238956 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2ebea9-2760-4603-846f-384892cfdf90 None None] REQUEST_METHOD: `GET` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:07:45.239501 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2ebea9-2760-4603-846f-384892cfdf90 None None] SCRIPT_NAME: `/identity` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:07:45.239501 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2ebea9-2760-4603-846f-384892cfdf90 None None] PATH_INFO: `/` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:07:45.240872 dv-cinder-851351-1-smb devstack@keystone.service[416293]: [pid: 416293|app: 0|req: 556/1124] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 09:07:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 09:07:45.248650 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ccfdcd-ccca-4c3d-bcc3-c1e5eb2d98b0 None None] REQUEST_METHOD: `POST` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:07:45.249171 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ccfdcd-ccca-4c3d-bcc3-c1e5eb2d98b0 None None] SCRIPT_NAME: `/identity` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:07:45.249276 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ccfdcd-ccca-4c3d-bcc3-c1e5eb2d98b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:07:45.268121 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.auth.core [None req-79ccfdcd-ccca-4c3d-bcc3-c1e5eb2d98b0 None None] MFA Rules not processed for user `dbf87abab90e4fdf9e75408f4199918e`. Rule list: `[]` (Enabled: `True`). {{(pid=416294) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 09:07:45.269389 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.fernet_utils [None req-79ccfdcd-ccca-4c3d-bcc3-c1e5eb2d98b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=416294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 09:07:45.340222 dv-cinder-851351-1-smb devstack@keystone.service[416294]: [pid: 416294|app: 0|req: 569/1125] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 09:07:45 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 28 09:07:45.364136 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2ebea9-2760-4603-846f-384892cfdf90 None None] Authenticating user token {{(pid=416293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:07:45.471385 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG dbcounter [-] [416293] Writing DB stats keystone:SELECT=100 {{(pid=416293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:07:45.487420 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2ebea9-2760-4603-846f-384892cfdf90 None None] Validating token access rules against request {{(pid=416293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:07:45.530995 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983991b5-7401-4ac9-aa44-aa1fc4ee37c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:07:45.531571 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983991b5-7401-4ac9-aa44-aa1fc4ee37c5 None admin] REQUEST_METHOD: `GET` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:07:45.531860 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983991b5-7401-4ac9-aa44-aa1fc4ee37c5 None admin] SCRIPT_NAME: `/identity` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:07:45.532144 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983991b5-7401-4ac9-aa44-aa1fc4ee37c5 None admin] PATH_INFO: `/v3/roles/6194848862704a289bbaa3fda43a9050` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:07:45.533844 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-983991b5-7401-4ac9-aa44-aa1fc4ee37c5 None admin] RBAC: Authorizing `identity:get_role(role_id=6194848862704a289bbaa3fda43a9050)` {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:07:45.535279 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-983991b5-7401-4ac9-aa44-aa1fc4ee37c5 None admin] RBAC: Authorization granted {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:07:45.536769 dv-cinder-851351-1-smb devstack@keystone.service[416293]: [pid: 416293|app: 0|req: 557/1126] 10.222.0.42 () {56 vars in 1177 bytes} [Thu Jul 28 09:07:45 2022] GET /identity/v3/roles/6194848862704a289bbaa3fda43a9050 => generated 223 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:07:45.543070 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ccfdcd-ccca-4c3d-bcc3-c1e5eb2d98b0 None None] Authenticating user token {{(pid=416294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:07:45.648127 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG dbcounter [-] [416294] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=416294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:07:45.677557 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ccfdcd-ccca-4c3d-bcc3-c1e5eb2d98b0 None None] Validating token access rules against request {{(pid=416294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:07:45.716310 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453c7e3c-f000-4a3f-b92e-108294741507 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:07:45.717017 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453c7e3c-f000-4a3f-b92e-108294741507 None admin] REQUEST_METHOD: `GET` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:07:45.717306 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453c7e3c-f000-4a3f-b92e-108294741507 None admin] SCRIPT_NAME: `/identity` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:07:45.717592 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453c7e3c-f000-4a3f-b92e-108294741507 None admin] PATH_INFO: `/v3/users/2c8dbffc33a84af3a3621d00f9f91fe6` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:07:45.718992 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-453c7e3c-f000-4a3f-b92e-108294741507 None admin] RBAC: Authorizing `identity:get_user(user_id=2c8dbffc33a84af3a3621d00f9f91fe6)` {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:07:45.720475 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-453c7e3c-f000-4a3f-b92e-108294741507 None admin] RBAC: Authorization granted {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:07:45.722207 dv-cinder-851351-1-smb devstack@keystone.service[416294]: [pid: 416294|app: 0|req: 570/1127] 10.222.0.42 () {56 vars in 1177 bytes} [Thu Jul 28 09:07:45 2022] GET /identity/v3/users/2c8dbffc33a84af3a3621d00f9f91fe6 => generated 286 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:07:45.728582 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983991b5-7401-4ac9-aa44-aa1fc4ee37c5 None admin] Authenticating user token {{(pid=416293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:07:45.842172 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983991b5-7401-4ac9-aa44-aa1fc4ee37c5 None admin] Validating token access rules against request {{(pid=416293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:07:45.880111 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f255df-6fed-40ee-8a10-52101d195e85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:07:45.880786 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f255df-6fed-40ee-8a10-52101d195e85 None admin] REQUEST_METHOD: `GET` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:07:45.881075 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f255df-6fed-40ee-8a10-52101d195e85 None admin] SCRIPT_NAME: `/identity` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:07:45.881347 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f255df-6fed-40ee-8a10-52101d195e85 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:07:45.910454 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG dbcounter [-] [416293] Writing DB stats keystone:SELECT=100 {{(pid=416293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:07:45.960482 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f255df-6fed-40ee-8a10-52101d195e85 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:07:45.962049 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f255df-6fed-40ee-8a10-52101d195e85 None admin] RBAC: Authorization granted {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:07:46.071489 dv-cinder-851351-1-smb devstack@keystone.service[416293]: [pid: 416293|app: 0|req: 558/1128] 10.222.0.42 () {58 vars in 1282 bytes} [Thu Jul 28 09:07:45 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 343 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 28 09:07:46.078350 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453c7e3c-f000-4a3f-b92e-108294741507 None admin] Authenticating user token {{(pid=416294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:07:46.188058 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453c7e3c-f000-4a3f-b92e-108294741507 None admin] Validating token access rules against request {{(pid=416294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:07:46.225972 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd65d58b-0221-4b3d-9f67-2485d3bc8433 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:07:46.226717 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd65d58b-0221-4b3d-9f67-2485d3bc8433 None admin] REQUEST_METHOD: `GET` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:07:46.227048 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd65d58b-0221-4b3d-9f67-2485d3bc8433 None admin] SCRIPT_NAME: `/identity` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:07:46.227373 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd65d58b-0221-4b3d-9f67-2485d3bc8433 None admin] PATH_INFO: `/v3/projects/27de4a0415e44654ae7abbc9f508f846` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:07:46.228722 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd65d58b-0221-4b3d-9f67-2485d3bc8433 None admin] RBAC: Authorizing `identity:get_project(project_id=27de4a0415e44654ae7abbc9f508f846)` {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:07:46.230314 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd65d58b-0221-4b3d-9f67-2485d3bc8433 None admin] RBAC: Authorization granted {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:07:46.232279 dv-cinder-851351-1-smb devstack@keystone.service[416294]: [pid: 416294|app: 0|req: 571/1129] 10.222.0.42 () {56 vars in 1186 bytes} [Thu Jul 28 09:07:46 2022] GET /identity/v3/projects/27de4a0415e44654ae7abbc9f508f846 => generated 311 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:07:46.239049 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f255df-6fed-40ee-8a10-52101d195e85 None admin] Authenticating user token {{(pid=416293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:07:46.303800 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG dbcounter [-] [416293] Writing DB stats keystone:SELECT=100 {{(pid=416293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:07:46.353840 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f255df-6fed-40ee-8a10-52101d195e85 None admin] Validating token access rules against request {{(pid=416293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:07:46.390322 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f6fde0-5a34-42ef-b53e-8334e21ebe19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:07:46.390966 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f6fde0-5a34-42ef-b53e-8334e21ebe19 None admin] REQUEST_METHOD: `GET` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:07:46.391255 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f6fde0-5a34-42ef-b53e-8334e21ebe19 None admin] SCRIPT_NAME: `/identity` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:07:46.391533 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f6fde0-5a34-42ef-b53e-8334e21ebe19 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:07:46.392345 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5f6fde0-5a34-42ef-b53e-8334e21ebe19 None admin] RBAC: Adding query filter params (role.id=6194848862704a289bbaa3fda43a9050, scope.project.id=27de4a0415e44654ae7abbc9f508f846, user.id=2c8dbffc33a84af3a3621d00f9f91fe6) {{(pid=416293) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 09:07:46.392698 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5f6fde0-5a34-42ef-b53e-8334e21ebe19 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:07:46.394156 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5f6fde0-5a34-42ef-b53e-8334e21ebe19 None admin] RBAC: Authorization granted {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:07:46.400484 dv-cinder-851351-1-smb devstack@keystone.service[416293]: [pid: 416293|app: 0|req: 559/1130] 10.222.0.42 () {56 vars in 1374 bytes} [Thu Jul 28 09:07:46 2022] GET /identity/v3/role_assignments?user.id=2c8dbffc33a84af3a3621d00f9f91fe6&scope.project.id=27de4a0415e44654ae7abbc9f508f846&role.id=6194848862704a289bbaa3fda43a9050 => generated 608 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:07:48.517490 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa85055-78b9-4beb-a2f9-d6f744b43f0a None None] REQUEST_METHOD: `GET` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:07:48.518144 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa85055-78b9-4beb-a2f9-d6f744b43f0a None None] SCRIPT_NAME: `/identity` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:07:48.518144 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa85055-78b9-4beb-a2f9-d6f744b43f0a None None] PATH_INFO: `/` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:07:48.519587 dv-cinder-851351-1-smb devstack@keystone.service[416294]: [pid: 416294|app: 0|req: 572/1131] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 09:07:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 09:07:48.525675 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5aeac64-4bd2-4f32-a9c2-726ed9ff5ef9 None None] REQUEST_METHOD: `POST` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:07:48.526257 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5aeac64-4bd2-4f32-a9c2-726ed9ff5ef9 None None] SCRIPT_NAME: `/identity` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:07:48.526257 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5aeac64-4bd2-4f32-a9c2-726ed9ff5ef9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:07:48.545886 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.auth.core [None req-a5aeac64-4bd2-4f32-a9c2-726ed9ff5ef9 None None] MFA Rules not processed for user `dbf87abab90e4fdf9e75408f4199918e`. Rule list: `[]` (Enabled: `True`). {{(pid=416293) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 09:07:48.547206 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.fernet_utils [None req-a5aeac64-4bd2-4f32-a9c2-726ed9ff5ef9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=416293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 09:07:48.624845 dv-cinder-851351-1-smb devstack@keystone.service[416293]: [pid: 416293|app: 0|req: 560/1132] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 09:07:48 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 09:07:48.648904 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa85055-78b9-4beb-a2f9-d6f744b43f0a None None] Authenticating user token {{(pid=416294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:07:48.677726 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG dbcounter [-] [416294] Writing DB stats keystone:SELECT=100 {{(pid=416294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:07:48.777498 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa85055-78b9-4beb-a2f9-d6f744b43f0a None None] Validating token access rules against request {{(pid=416294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:07:48.820714 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10cf741e-9b93-4d1d-8835-b47855d6a70f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:07:48.821513 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10cf741e-9b93-4d1d-8835-b47855d6a70f None admin] REQUEST_METHOD: `GET` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:07:48.821847 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10cf741e-9b93-4d1d-8835-b47855d6a70f None admin] SCRIPT_NAME: `/identity` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:07:48.822172 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10cf741e-9b93-4d1d-8835-b47855d6a70f None admin] PATH_INFO: `/v3/domains/default` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:07:48.823920 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10cf741e-9b93-4d1d-8835-b47855d6a70f None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:07:48.825482 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10cf741e-9b93-4d1d-8835-b47855d6a70f None admin] RBAC: Authorization granted {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:07:48.827210 dv-cinder-851351-1-smb devstack@keystone.service[416294]: [pid: 416294|app: 0|req: 573/1133] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 09:07:48 2022] GET /identity/v3/domains/default => generated 199 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:07:48.833971 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5aeac64-4bd2-4f32-a9c2-726ed9ff5ef9 None None] Authenticating user token {{(pid=416293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:07:48.895557 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG dbcounter [-] [416293] Writing DB stats keystone:SELECT=100 {{(pid=416293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:07:48.952698 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5aeac64-4bd2-4f32-a9c2-726ed9ff5ef9 None None] Validating token access rules against request {{(pid=416293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:07:48.992555 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf864039-d308-4ec0-9343-176e3f26403b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:07:48.993252 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf864039-d308-4ec0-9343-176e3f26403b None admin] REQUEST_METHOD: `POST` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:07:48.993545 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf864039-d308-4ec0-9343-176e3f26403b None admin] SCRIPT_NAME: `/identity` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:07:48.993828 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf864039-d308-4ec0-9343-176e3f26403b None admin] PATH_INFO: `/v3/projects` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:07:48.994547 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf864039-d308-4ec0-9343-176e3f26403b None admin] RBAC: Authorizing `identity:create_project()` {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:07:48.996038 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf864039-d308-4ec0-9343-176e3f26403b None admin] RBAC: Authorization granted {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:07:49.026629 dv-cinder-851351-1-smb devstack@keystone.service[416293]: [pid: 416293|app: 0|req: 561/1134] 10.222.0.42 () {60 vars in 1141 bytes} [Thu Jul 28 09:07:48 2022] POST /identity/v3/projects => generated 311 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 09:07:51.196037 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47374d4c-952e-4343-80f8-68ffea39ad92 None None] REQUEST_METHOD: `GET` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:07:51.196651 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47374d4c-952e-4343-80f8-68ffea39ad92 None None] SCRIPT_NAME: `/identity` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:07:51.196651 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47374d4c-952e-4343-80f8-68ffea39ad92 None None] PATH_INFO: `/` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:07:51.197992 dv-cinder-851351-1-smb devstack@keystone.service[416294]: [pid: 416294|app: 0|req: 574/1135] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 09:07:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 09:07:51.203813 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fc0677-b845-4681-91ec-1a3babb4312b None None] REQUEST_METHOD: `POST` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:07:51.204270 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fc0677-b845-4681-91ec-1a3babb4312b None None] SCRIPT_NAME: `/identity` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:07:51.204385 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fc0677-b845-4681-91ec-1a3babb4312b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:07:51.223716 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.auth.core [None req-75fc0677-b845-4681-91ec-1a3babb4312b None None] MFA Rules not processed for user `dbf87abab90e4fdf9e75408f4199918e`. Rule list: `[]` (Enabled: `True`). {{(pid=416293) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 09:07:51.224896 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.fernet_utils [None req-75fc0677-b845-4681-91ec-1a3babb4312b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=416293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 09:07:51.296473 dv-cinder-851351-1-smb devstack@keystone.service[416293]: [pid: 416293|app: 0|req: 562/1136] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 09:07:51 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 09:07:51.321441 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47374d4c-952e-4343-80f8-68ffea39ad92 None None] Authenticating user token {{(pid=416294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:07:51.419672 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG dbcounter [-] [416294] Writing DB stats keystone:SELECT=100 {{(pid=416294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:07:51.434090 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47374d4c-952e-4343-80f8-68ffea39ad92 None None] Validating token access rules against request {{(pid=416294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:07:51.471160 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27a68b7-49ee-4ef4-8281-12b9f1b2c25c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:07:51.471815 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27a68b7-49ee-4ef4-8281-12b9f1b2c25c None admin] REQUEST_METHOD: `GET` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:07:51.472101 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27a68b7-49ee-4ef4-8281-12b9f1b2c25c None admin] SCRIPT_NAME: `/identity` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:07:51.472378 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27a68b7-49ee-4ef4-8281-12b9f1b2c25c None admin] PATH_INFO: `/v3/domains/default` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:07:51.473642 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d27a68b7-49ee-4ef4-8281-12b9f1b2c25c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:07:51.475166 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d27a68b7-49ee-4ef4-8281-12b9f1b2c25c None admin] RBAC: Authorization granted {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:07:51.476749 dv-cinder-851351-1-smb devstack@keystone.service[416294]: [pid: 416294|app: 0|req: 575/1137] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 09:07:51 2022] GET /identity/v3/domains/default => generated 199 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:07:51.482947 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75fc0677-b845-4681-91ec-1a3babb4312b None None] Authenticating user token {{(pid=416293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:07:51.514805 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG dbcounter [-] [416293] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=416293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:07:51.589534 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75fc0677-b845-4681-91ec-1a3babb4312b None None] Validating token access rules against request {{(pid=416293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:07:51.625623 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f4ee82-118d-4069-b44b-20d72ac048bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:07:51.626254 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f4ee82-118d-4069-b44b-20d72ac048bf None admin] REQUEST_METHOD: `POST` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:07:51.626539 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f4ee82-118d-4069-b44b-20d72ac048bf None admin] SCRIPT_NAME: `/identity` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:07:51.626815 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f4ee82-118d-4069-b44b-20d72ac048bf None admin] PATH_INFO: `/v3/users` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:07:51.627509 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35f4ee82-118d-4069-b44b-20d72ac048bf None admin] RBAC: Authorizing `identity:create_user()` {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:07:51.629105 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35f4ee82-118d-4069-b44b-20d72ac048bf None admin] RBAC: Authorization granted {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:07:51.652552 dv-cinder-851351-1-smb devstack@keystone.service[416293]: [pid: 416293|app: 0|req: 563/1138] 10.222.0.42 () {60 vars in 1132 bytes} [Thu Jul 28 09:07:51 2022] POST /identity/v3/users => generated 286 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 09:07:53.711253 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92276455-eb87-4238-841d-2143aafb8085 None None] REQUEST_METHOD: `GET` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:07:53.711946 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92276455-eb87-4238-841d-2143aafb8085 None None] SCRIPT_NAME: `/identity` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:07:53.711946 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92276455-eb87-4238-841d-2143aafb8085 None None] PATH_INFO: `/` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:07:53.713286 dv-cinder-851351-1-smb devstack@keystone.service[416294]: [pid: 416294|app: 0|req: 576/1139] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 09:07:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 09:07:53.718714 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66825ac-eb0c-4be1-b948-5fdfec2fdcc6 None None] REQUEST_METHOD: `POST` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:07:53.719169 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66825ac-eb0c-4be1-b948-5fdfec2fdcc6 None None] SCRIPT_NAME: `/identity` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:07:53.719267 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66825ac-eb0c-4be1-b948-5fdfec2fdcc6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:07:53.738203 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.auth.core [None req-c66825ac-eb0c-4be1-b948-5fdfec2fdcc6 None None] MFA Rules not processed for user `dbf87abab90e4fdf9e75408f4199918e`. Rule list: `[]` (Enabled: `True`). {{(pid=416293) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 09:07:53.739413 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.fernet_utils [None req-c66825ac-eb0c-4be1-b948-5fdfec2fdcc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=416293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 09:07:53.815938 dv-cinder-851351-1-smb devstack@keystone.service[416293]: [pid: 416293|app: 0|req: 564/1140] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 09:07:53 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 09:07:53.840890 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92276455-eb87-4238-841d-2143aafb8085 None None] Authenticating user token {{(pid=416294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:07:53.952694 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92276455-eb87-4238-841d-2143aafb8085 None None] Validating token access rules against request {{(pid=416294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:07:53.987990 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067be221-84b1-48e1-9bef-2c5e7fead774 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:07:53.988655 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067be221-84b1-48e1-9bef-2c5e7fead774 None admin] REQUEST_METHOD: `GET` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:07:53.988976 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067be221-84b1-48e1-9bef-2c5e7fead774 None admin] SCRIPT_NAME: `/identity` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:07:53.989251 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067be221-84b1-48e1-9bef-2c5e7fead774 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:07:54.001248 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-067be221-84b1-48e1-9bef-2c5e7fead774 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 09:07:54.006154 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application [None req-067be221-84b1-48e1-9bef-2c5e7fead774 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 09:07:54.006154 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 09:07:54.006154 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 09:07:54.006154 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 09:07:54.006154 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 09:07:54.006154 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 09:07:54.006154 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 09:07:54.006154 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 09:07:54.006154 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 09:07:54.006154 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 09:07:54.006154 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 09:07:54.006154 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 09:07:54.006154 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 09:07:54.006154 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 09:07:54.006154 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 09:07:54.006154 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 09:07:54.007271 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 09:07:54.007271 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 09:07:54.007271 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 09:07:54.007271 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 09:07:54.007271 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 09:07:54.007271 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 09:07:54.007271 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 09:07:54.007271 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 09:07:54.007271 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 09:07:54.007271 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 09:07:54.007271 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 09:07:54.007271 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application with Lock( Jul 28 09:07:54.007271 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 09:07:54.007271 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return self._enter() Jul 28 09:07:54.007271 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 09:07:54.007271 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 09:07:54.008246 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 09:07:54.008246 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return self.creator() Jul 28 09:07:54.008246 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 09:07:54.008246 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application created_value = creator( Jul 28 09:07:54.008246 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 09:07:54.008246 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 09:07:54.008246 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 09:07:54.008246 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 09:07:54.008246 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 09:07:54.008246 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 09:07:54.008246 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 09:07:54.008246 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application Jul 28 09:07:54.008246 dv-cinder-851351-1-smb devstack@keystone.service[416294]: [pid: 416294|app: 0|req: 577/1141] 10.222.0.42 () {56 vars in 1096 bytes} [Thu Jul 28 09:07:53 2022] GET /identity/v3/roles/admin => generated 83 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 09:07:54.013842 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66825ac-eb0c-4be1-b948-5fdfec2fdcc6 None None] Authenticating user token {{(pid=416293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:07:54.033053 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG dbcounter [-] [416293] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=416293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:07:54.116784 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66825ac-eb0c-4be1-b948-5fdfec2fdcc6 None None] Validating token access rules against request {{(pid=416293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:07:54.152504 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2bc2cc-6eaf-4d02-8624-323448b93578 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:07:54.153160 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2bc2cc-6eaf-4d02-8624-323448b93578 None admin] REQUEST_METHOD: `GET` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:07:54.153448 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2bc2cc-6eaf-4d02-8624-323448b93578 None admin] SCRIPT_NAME: `/identity` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:07:54.153728 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2bc2cc-6eaf-4d02-8624-323448b93578 None admin] PATH_INFO: `/v3/roles` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:07:54.154434 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c2bc2cc-6eaf-4d02-8624-323448b93578 None admin] RBAC: Adding query filter params (name=admin) {{(pid=416293) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 09:07:54.154767 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c2bc2cc-6eaf-4d02-8624-323448b93578 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:07:54.156355 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c2bc2cc-6eaf-4d02-8624-323448b93578 None admin] RBAC: Authorization granted {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:07:54.166919 dv-cinder-851351-1-smb devstack@keystone.service[416293]: [pid: 416293|app: 0|req: 565/1142] 10.222.0.42 () {56 vars in 1099 bytes} [Thu Jul 28 09:07:54 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 09:07:54.174616 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067be221-84b1-48e1-9bef-2c5e7fead774 None admin] Authenticating user token {{(pid=416294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:07:54.195800 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG dbcounter [-] [416294] Writing DB stats keystone:SELECT=100 {{(pid=416294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:07:54.284947 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067be221-84b1-48e1-9bef-2c5e7fead774 None admin] Validating token access rules against request {{(pid=416294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:07:54.321305 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc4526a-e8e7-408d-97f3-833ba552cd95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:07:54.321973 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc4526a-e8e7-408d-97f3-833ba552cd95 None admin] REQUEST_METHOD: `GET` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:07:54.322256 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc4526a-e8e7-408d-97f3-833ba552cd95 None admin] SCRIPT_NAME: `/identity` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:07:54.322531 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc4526a-e8e7-408d-97f3-833ba552cd95 None admin] PATH_INFO: `/v3/users/0118d961db4049f083498d1bb1940684` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:07:54.337835 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdc4526a-e8e7-408d-97f3-833ba552cd95 None admin] RBAC: Authorizing `identity:get_user(user_id=0118d961db4049f083498d1bb1940684)` {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:07:54.339313 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdc4526a-e8e7-408d-97f3-833ba552cd95 None admin] RBAC: Authorization granted {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:07:54.341005 dv-cinder-851351-1-smb devstack@keystone.service[416294]: [pid: 416294|app: 0|req: 578/1143] 10.222.0.42 () {56 vars in 1177 bytes} [Thu Jul 28 09:07:54 2022] GET /identity/v3/users/0118d961db4049f083498d1bb1940684 => generated 286 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:07:54.347319 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2bc2cc-6eaf-4d02-8624-323448b93578 None admin] Authenticating user token {{(pid=416293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:07:54.435283 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG dbcounter [-] [416293] Writing DB stats keystone:SELECT=100 {{(pid=416293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:07:54.457698 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2bc2cc-6eaf-4d02-8624-323448b93578 None admin] Validating token access rules against request {{(pid=416293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:07:54.493923 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf49462-5893-4604-a14f-2ca91ba979c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:07:54.494561 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf49462-5893-4604-a14f-2ca91ba979c8 None admin] REQUEST_METHOD: `GET` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:07:54.494849 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf49462-5893-4604-a14f-2ca91ba979c8 None admin] SCRIPT_NAME: `/identity` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:07:54.495131 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf49462-5893-4604-a14f-2ca91ba979c8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:07:54.566689 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abf49462-5893-4604-a14f-2ca91ba979c8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:07:54.568064 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abf49462-5893-4604-a14f-2ca91ba979c8 None admin] RBAC: Authorization granted {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:07:54.651027 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG dbcounter [-] [416293] Writing DB stats keystone:SELECT=100 {{(pid=416293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:07:54.672147 dv-cinder-851351-1-smb devstack@keystone.service[416293]: [pid: 416293|app: 0|req: 566/1144] 10.222.0.42 () {58 vars in 1282 bytes} [Thu Jul 28 09:07:54 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 28 09:07:54.678384 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc4526a-e8e7-408d-97f3-833ba552cd95 None admin] Authenticating user token {{(pid=416294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:07:54.757432 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG dbcounter [-] [416294] Writing DB stats keystone:SELECT=100 {{(pid=416294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:07:54.784574 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc4526a-e8e7-408d-97f3-833ba552cd95 None admin] Validating token access rules against request {{(pid=416294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:07:54.818523 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27703cf-4c94-4f16-b8e9-56e2f52e5ca0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:07:54.819075 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27703cf-4c94-4f16-b8e9-56e2f52e5ca0 None admin] REQUEST_METHOD: `GET` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:07:54.819358 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27703cf-4c94-4f16-b8e9-56e2f52e5ca0 None admin] SCRIPT_NAME: `/identity` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:07:54.819632 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27703cf-4c94-4f16-b8e9-56e2f52e5ca0 None admin] PATH_INFO: `/v3/projects/5045d6feb591464cac7a848321f2e124` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:07:54.820835 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a27703cf-4c94-4f16-b8e9-56e2f52e5ca0 None admin] RBAC: Authorizing `identity:get_project(project_id=5045d6feb591464cac7a848321f2e124)` {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:07:54.822279 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a27703cf-4c94-4f16-b8e9-56e2f52e5ca0 None admin] RBAC: Authorization granted {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:07:54.824341 dv-cinder-851351-1-smb devstack@keystone.service[416294]: [pid: 416294|app: 0|req: 579/1145] 10.222.0.42 () {56 vars in 1186 bytes} [Thu Jul 28 09:07:54 2022] GET /identity/v3/projects/5045d6feb591464cac7a848321f2e124 => generated 311 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:07:54.831189 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf49462-5893-4604-a14f-2ca91ba979c8 None admin] Authenticating user token {{(pid=416293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:07:54.941265 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf49462-5893-4604-a14f-2ca91ba979c8 None admin] Validating token access rules against request {{(pid=416293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:07:54.978612 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa484f6d-3014-40aa-9592-90cb3bc8878a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:07:54.979248 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa484f6d-3014-40aa-9592-90cb3bc8878a None admin] REQUEST_METHOD: `GET` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:07:54.979532 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa484f6d-3014-40aa-9592-90cb3bc8878a None admin] SCRIPT_NAME: `/identity` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:07:54.979806 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa484f6d-3014-40aa-9592-90cb3bc8878a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:07:54.980609 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa484f6d-3014-40aa-9592-90cb3bc8878a None admin] RBAC: Adding query filter params (role.id=c67085ec338243df8f9b7d6459036e23, scope.project.id=5045d6feb591464cac7a848321f2e124, user.id=0118d961db4049f083498d1bb1940684) {{(pid=416293) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 09:07:54.980943 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa484f6d-3014-40aa-9592-90cb3bc8878a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:07:54.982395 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa484f6d-3014-40aa-9592-90cb3bc8878a None admin] RBAC: Authorization granted {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:07:54.988688 dv-cinder-851351-1-smb devstack@keystone.service[416293]: [pid: 416293|app: 0|req: 567/1146] 10.222.0.42 () {56 vars in 1374 bytes} [Thu Jul 28 09:07:54 2022] GET /identity/v3/role_assignments?user.id=0118d961db4049f083498d1bb1940684&scope.project.id=5045d6feb591464cac7a848321f2e124&role.id=c67085ec338243df8f9b7d6459036e23 => generated 259 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:07:56.988089 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbd07d1-72ef-419d-a1f7-7e065d299ca9 None None] REQUEST_METHOD: `GET` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:07:56.988938 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbd07d1-72ef-419d-a1f7-7e065d299ca9 None None] SCRIPT_NAME: `/identity` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:07:56.988938 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbd07d1-72ef-419d-a1f7-7e065d299ca9 None None] PATH_INFO: `/` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:07:56.990082 dv-cinder-851351-1-smb devstack@keystone.service[416294]: [pid: 416294|app: 0|req: 580/1147] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 09:07:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 09:07:56.995948 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a1caef-acc6-4e83-ab43-63bbbd5a9f58 None None] REQUEST_METHOD: `POST` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:07:56.996492 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a1caef-acc6-4e83-ab43-63bbbd5a9f58 None None] SCRIPT_NAME: `/identity` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:07:56.996492 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a1caef-acc6-4e83-ab43-63bbbd5a9f58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:07:57.016862 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.auth.core [None req-90a1caef-acc6-4e83-ab43-63bbbd5a9f58 None None] MFA Rules not processed for user `dbf87abab90e4fdf9e75408f4199918e`. Rule list: `[]` (Enabled: `True`). {{(pid=416293) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 09:07:57.018107 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.fernet_utils [None req-90a1caef-acc6-4e83-ab43-63bbbd5a9f58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=416293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 09:07:57.075409 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG dbcounter [-] [416293] Writing DB stats keystone:SELECT=100 {{(pid=416293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:07:57.106134 dv-cinder-851351-1-smb devstack@keystone.service[416293]: [pid: 416293|app: 0|req: 568/1148] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 09:07:56 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 09:07:57.129783 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acbd07d1-72ef-419d-a1f7-7e065d299ca9 None None] Authenticating user token {{(pid=416294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:07:57.248718 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acbd07d1-72ef-419d-a1f7-7e065d299ca9 None None] Validating token access rules against request {{(pid=416294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:07:57.291263 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e5c59d-5b8f-4144-978a-70c0b610ce28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:07:57.291927 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e5c59d-5b8f-4144-978a-70c0b610ce28 None admin] REQUEST_METHOD: `GET` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:07:57.292214 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e5c59d-5b8f-4144-978a-70c0b610ce28 None admin] SCRIPT_NAME: `/identity` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:07:57.292494 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e5c59d-5b8f-4144-978a-70c0b610ce28 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:07:57.304911 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95e5c59d-5b8f-4144-978a-70c0b610ce28 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 09:07:57.309978 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application [None req-95e5c59d-5b8f-4144-978a-70c0b610ce28 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 09:07:57.309978 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 09:07:57.309978 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 09:07:57.309978 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 09:07:57.309978 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 09:07:57.309978 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 09:07:57.309978 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 09:07:57.309978 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 09:07:57.309978 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 09:07:57.309978 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 09:07:57.309978 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 09:07:57.309978 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 09:07:57.309978 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 09:07:57.309978 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 09:07:57.309978 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 09:07:57.309978 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 09:07:57.311538 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 09:07:57.311538 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 09:07:57.311538 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 09:07:57.311538 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 09:07:57.311538 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 09:07:57.311538 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 09:07:57.311538 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 09:07:57.311538 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 09:07:57.311538 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 09:07:57.311538 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 09:07:57.311538 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 09:07:57.311538 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application with Lock( Jul 28 09:07:57.311538 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 09:07:57.311538 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return self._enter() Jul 28 09:07:57.311538 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 09:07:57.311538 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 09:07:57.313357 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 09:07:57.313357 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return self.creator() Jul 28 09:07:57.313357 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 09:07:57.313357 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application created_value = creator( Jul 28 09:07:57.313357 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 09:07:57.313357 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 09:07:57.313357 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 09:07:57.313357 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 09:07:57.313357 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 09:07:57.313357 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 09:07:57.313357 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 09:07:57.313357 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application Jul 28 09:07:57.313357 dv-cinder-851351-1-smb devstack@keystone.service[416294]: [pid: 416294|app: 0|req: 581/1149] 10.222.0.42 () {56 vars in 1096 bytes} [Thu Jul 28 09:07:57 2022] GET /identity/v3/roles/admin => generated 83 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 09:07:57.318020 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a1caef-acc6-4e83-ab43-63bbbd5a9f58 None None] Authenticating user token {{(pid=416293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:07:57.426977 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a1caef-acc6-4e83-ab43-63bbbd5a9f58 None None] Validating token access rules against request {{(pid=416293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:07:57.464692 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f55dbc2-948e-4e71-a29d-49f7b154cd69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:07:57.465369 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f55dbc2-948e-4e71-a29d-49f7b154cd69 None admin] REQUEST_METHOD: `GET` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:07:57.465643 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f55dbc2-948e-4e71-a29d-49f7b154cd69 None admin] SCRIPT_NAME: `/identity` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:07:57.465918 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f55dbc2-948e-4e71-a29d-49f7b154cd69 None admin] PATH_INFO: `/v3/roles` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:07:57.466652 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f55dbc2-948e-4e71-a29d-49f7b154cd69 None admin] RBAC: Adding query filter params (name=admin) {{(pid=416293) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 09:07:57.466957 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f55dbc2-948e-4e71-a29d-49f7b154cd69 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:07:57.468381 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f55dbc2-948e-4e71-a29d-49f7b154cd69 None admin] RBAC: Authorization granted {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:07:57.477706 dv-cinder-851351-1-smb devstack@keystone.service[416293]: [pid: 416293|app: 0|req: 569/1150] 10.222.0.42 () {56 vars in 1099 bytes} [Thu Jul 28 09:07:57 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 09:07:57.483984 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e5c59d-5b8f-4144-978a-70c0b610ce28 None admin] Authenticating user token {{(pid=416294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:07:57.487900 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG dbcounter [-] [416294] Writing DB stats keystone:SELECT=100 {{(pid=416294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:07:57.595885 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e5c59d-5b8f-4144-978a-70c0b610ce28 None admin] Validating token access rules against request {{(pid=416294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:07:57.635800 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b533ae-0b93-4d5e-9a7c-17f924995a4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:07:57.636479 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b533ae-0b93-4d5e-9a7c-17f924995a4f None admin] REQUEST_METHOD: `GET` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:07:57.636796 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b533ae-0b93-4d5e-9a7c-17f924995a4f None admin] SCRIPT_NAME: `/identity` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:07:57.637081 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b533ae-0b93-4d5e-9a7c-17f924995a4f None admin] PATH_INFO: `/v3/users/0118d961db4049f083498d1bb1940684` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:07:57.638468 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14b533ae-0b93-4d5e-9a7c-17f924995a4f None admin] RBAC: Authorizing `identity:get_user(user_id=0118d961db4049f083498d1bb1940684)` {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:07:57.640030 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14b533ae-0b93-4d5e-9a7c-17f924995a4f None admin] RBAC: Authorization granted {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:07:57.641825 dv-cinder-851351-1-smb devstack@keystone.service[416294]: [pid: 416294|app: 0|req: 582/1151] 10.222.0.42 () {56 vars in 1177 bytes} [Thu Jul 28 09:07:57 2022] GET /identity/v3/users/0118d961db4049f083498d1bb1940684 => generated 286 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:07:57.648270 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f55dbc2-948e-4e71-a29d-49f7b154cd69 None admin] Authenticating user token {{(pid=416293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:07:57.686710 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG dbcounter [-] [416293] Writing DB stats keystone:SELECT=100 {{(pid=416293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:07:57.760543 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f55dbc2-948e-4e71-a29d-49f7b154cd69 None admin] Validating token access rules against request {{(pid=416293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:07:57.797427 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a20b0c8-0ea4-4c2c-91fd-169ac8f1c902 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:07:57.798128 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a20b0c8-0ea4-4c2c-91fd-169ac8f1c902 None admin] REQUEST_METHOD: `GET` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:07:57.798415 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a20b0c8-0ea4-4c2c-91fd-169ac8f1c902 None admin] SCRIPT_NAME: `/identity` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:07:57.798697 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a20b0c8-0ea4-4c2c-91fd-169ac8f1c902 None admin] PATH_INFO: `/v3/projects/5045d6feb591464cac7a848321f2e124` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:07:57.799922 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a20b0c8-0ea4-4c2c-91fd-169ac8f1c902 None admin] RBAC: Authorizing `identity:get_project(project_id=5045d6feb591464cac7a848321f2e124)` {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:07:57.801424 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a20b0c8-0ea4-4c2c-91fd-169ac8f1c902 None admin] RBAC: Authorization granted {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:07:57.803139 dv-cinder-851351-1-smb devstack@keystone.service[416293]: [pid: 416293|app: 0|req: 570/1152] 10.222.0.42 () {56 vars in 1186 bytes} [Thu Jul 28 09:07:57 2022] GET /identity/v3/projects/5045d6feb591464cac7a848321f2e124 => generated 311 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:07:57.809729 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b533ae-0b93-4d5e-9a7c-17f924995a4f None admin] Authenticating user token {{(pid=416294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:07:57.887016 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG dbcounter [-] [416294] Writing DB stats keystone:SELECT=100 {{(pid=416294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:07:57.929522 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b533ae-0b93-4d5e-9a7c-17f924995a4f None admin] Validating token access rules against request {{(pid=416294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:07:58.002176 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79ff967-6f4d-4286-a322-adbfc730097b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:07:58.003346 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79ff967-6f4d-4286-a322-adbfc730097b None admin] REQUEST_METHOD: `PUT` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:07:58.003851 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79ff967-6f4d-4286-a322-adbfc730097b None admin] SCRIPT_NAME: `/identity` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:07:58.004354 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79ff967-6f4d-4286-a322-adbfc730097b None admin] PATH_INFO: `/v3/projects/5045d6feb591464cac7a848321f2e124/users/0118d961db4049f083498d1bb1940684/roles/c67085ec338243df8f9b7d6459036e23` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:07:58.007922 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e79ff967-6f4d-4286-a322-adbfc730097b None admin] RBAC: Authorizing `identity:create_grant(project_id=5045d6feb591464cac7a848321f2e124, user_id=0118d961db4049f083498d1bb1940684, role_id=c67085ec338243df8f9b7d6459036e23)` {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:07:58.010765 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e79ff967-6f4d-4286-a322-adbfc730097b None admin] RBAC: Authorization granted {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:07:58.034325 dv-cinder-851351-1-smb devstack@keystone.service[416294]: [pid: 416294|app: 0|req: 583/1153] 10.222.0.42 () {58 vars in 1439 bytes} [Thu Jul 28 09:07:57 2022] PUT /identity/v3/projects/5045d6feb591464cac7a848321f2e124/users/0118d961db4049f083498d1bb1940684/roles/c67085ec338243df8f9b7d6459036e23 => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 09:08:00.075654 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e01008-bd32-4e8e-9e4a-0228e94ee273 None None] REQUEST_METHOD: `GET` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:08:00.076252 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e01008-bd32-4e8e-9e4a-0228e94ee273 None None] SCRIPT_NAME: `/identity` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:08:00.076252 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e01008-bd32-4e8e-9e4a-0228e94ee273 None None] PATH_INFO: `/` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:08:00.077816 dv-cinder-851351-1-smb devstack@keystone.service[416293]: [pid: 416293|app: 0|req: 571/1154] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 09:08:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 09:08:00.086995 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7f774b-11bd-482d-b059-98aec0744c25 None None] REQUEST_METHOD: `POST` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:08:00.086995 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7f774b-11bd-482d-b059-98aec0744c25 None None] SCRIPT_NAME: `/identity` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:08:00.086995 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7f774b-11bd-482d-b059-98aec0744c25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:08:00.105610 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.auth.core [None req-ae7f774b-11bd-482d-b059-98aec0744c25 None None] MFA Rules not processed for user `dbf87abab90e4fdf9e75408f4199918e`. Rule list: `[]` (Enabled: `True`). {{(pid=416294) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 09:08:00.106839 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.fernet_utils [None req-ae7f774b-11bd-482d-b059-98aec0744c25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=416294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 09:08:00.181153 dv-cinder-851351-1-smb devstack@keystone.service[416294]: [pid: 416294|app: 0|req: 584/1155] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 09:08:00 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 28 09:08:00.205350 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e01008-bd32-4e8e-9e4a-0228e94ee273 None None] Authenticating user token {{(pid=416293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:08:00.317722 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e01008-bd32-4e8e-9e4a-0228e94ee273 None None] Validating token access rules against request {{(pid=416293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:08:00.320206 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG dbcounter [-] [416293] Writing DB stats keystone:SELECT=100 {{(pid=416293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:08:00.354163 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b18ef5-0ff1-4735-92f5-9bcadbfbc021 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:08:00.354793 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b18ef5-0ff1-4735-92f5-9bcadbfbc021 None admin] REQUEST_METHOD: `GET` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:08:00.355076 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b18ef5-0ff1-4735-92f5-9bcadbfbc021 None admin] SCRIPT_NAME: `/identity` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:08:00.355351 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b18ef5-0ff1-4735-92f5-9bcadbfbc021 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:08:00.372148 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54b18ef5-0ff1-4735-92f5-9bcadbfbc021 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 09:08:00.379982 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application [None req-54b18ef5-0ff1-4735-92f5-9bcadbfbc021 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 09:08:00.379982 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 09:08:00.379982 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 09:08:00.379982 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 09:08:00.379982 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 09:08:00.379982 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 09:08:00.379982 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 09:08:00.379982 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 09:08:00.379982 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 09:08:00.379982 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 09:08:00.379982 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 09:08:00.379982 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 09:08:00.379982 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 09:08:00.379982 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 09:08:00.379982 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 09:08:00.379982 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 09:08:00.381319 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 09:08:00.381319 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 09:08:00.381319 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 09:08:00.381319 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 09:08:00.381319 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 09:08:00.381319 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 09:08:00.381319 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 09:08:00.381319 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 09:08:00.381319 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 09:08:00.381319 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 09:08:00.381319 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 09:08:00.381319 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application with Lock( Jul 28 09:08:00.381319 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 09:08:00.381319 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self._enter() Jul 28 09:08:00.381319 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 09:08:00.381319 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 09:08:00.382291 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 09:08:00.382291 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self.creator() Jul 28 09:08:00.382291 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 09:08:00.382291 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application created_value = creator( Jul 28 09:08:00.382291 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 09:08:00.382291 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 09:08:00.382291 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 09:08:00.382291 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 09:08:00.382291 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 09:08:00.382291 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 09:08:00.382291 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 09:08:00.382291 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application Jul 28 09:08:00.382291 dv-cinder-851351-1-smb devstack@keystone.service[416293]: [pid: 416293|app: 0|req: 572/1156] 10.222.0.42 () {56 vars in 1096 bytes} [Thu Jul 28 09:08:00 2022] GET /identity/v3/roles/admin => generated 83 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 09:08:00.391181 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7f774b-11bd-482d-b059-98aec0744c25 None None] Authenticating user token {{(pid=416294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:08:00.462027 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG dbcounter [-] [416294] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=416294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:08:00.507969 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7f774b-11bd-482d-b059-98aec0744c25 None None] Validating token access rules against request {{(pid=416294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:08:00.547906 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63cdaaf-1e32-4d52-93ac-ed58c50675c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:08:00.548558 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63cdaaf-1e32-4d52-93ac-ed58c50675c9 None admin] REQUEST_METHOD: `GET` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:08:00.548879 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63cdaaf-1e32-4d52-93ac-ed58c50675c9 None admin] SCRIPT_NAME: `/identity` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:08:00.549161 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63cdaaf-1e32-4d52-93ac-ed58c50675c9 None admin] PATH_INFO: `/v3/roles` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:08:00.549919 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a63cdaaf-1e32-4d52-93ac-ed58c50675c9 None admin] RBAC: Adding query filter params (name=admin) {{(pid=416294) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 09:08:00.550229 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a63cdaaf-1e32-4d52-93ac-ed58c50675c9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:08:00.551683 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a63cdaaf-1e32-4d52-93ac-ed58c50675c9 None admin] RBAC: Authorization granted {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:08:00.562078 dv-cinder-851351-1-smb devstack@keystone.service[416294]: [pid: 416294|app: 0|req: 585/1157] 10.222.0.42 () {56 vars in 1099 bytes} [Thu Jul 28 09:08:00 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:08:00.568635 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b18ef5-0ff1-4735-92f5-9bcadbfbc021 None admin] Authenticating user token {{(pid=416293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:08:00.698654 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b18ef5-0ff1-4735-92f5-9bcadbfbc021 None admin] Validating token access rules against request {{(pid=416293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:08:00.738076 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d9ef75-c624-45b6-a73a-e938ed69697a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:08:00.738747 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d9ef75-c624-45b6-a73a-e938ed69697a None admin] REQUEST_METHOD: `GET` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:08:00.739031 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d9ef75-c624-45b6-a73a-e938ed69697a None admin] SCRIPT_NAME: `/identity` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:08:00.739307 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d9ef75-c624-45b6-a73a-e938ed69697a None admin] PATH_INFO: `/v3/users/0118d961db4049f083498d1bb1940684` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:08:00.740555 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80d9ef75-c624-45b6-a73a-e938ed69697a None admin] RBAC: Authorizing `identity:get_user(user_id=0118d961db4049f083498d1bb1940684)` {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:08:00.742065 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80d9ef75-c624-45b6-a73a-e938ed69697a None admin] RBAC: Authorization granted {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:08:00.743772 dv-cinder-851351-1-smb devstack@keystone.service[416293]: [pid: 416293|app: 0|req: 573/1158] 10.222.0.42 () {56 vars in 1177 bytes} [Thu Jul 28 09:08:00 2022] GET /identity/v3/users/0118d961db4049f083498d1bb1940684 => generated 286 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:08:00.750106 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63cdaaf-1e32-4d52-93ac-ed58c50675c9 None admin] Authenticating user token {{(pid=416294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:08:00.865670 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63cdaaf-1e32-4d52-93ac-ed58c50675c9 None admin] Validating token access rules against request {{(pid=416294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:08:00.892626 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG dbcounter [-] [416294] Writing DB stats keystone:SELECT=100 {{(pid=416294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:08:00.906304 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acba27e3-afa1-4648-b51a-b6a9510ef85a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:08:00.906952 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acba27e3-afa1-4648-b51a-b6a9510ef85a None admin] REQUEST_METHOD: `GET` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:08:00.907237 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acba27e3-afa1-4648-b51a-b6a9510ef85a None admin] SCRIPT_NAME: `/identity` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:08:00.907512 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acba27e3-afa1-4648-b51a-b6a9510ef85a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:08:00.990486 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acba27e3-afa1-4648-b51a-b6a9510ef85a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:08:00.991989 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acba27e3-afa1-4648-b51a-b6a9510ef85a None admin] RBAC: Authorization granted {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:08:01.111332 dv-cinder-851351-1-smb devstack@keystone.service[416294]: [pid: 416294|app: 0|req: 586/1159] 10.222.0.42 () {58 vars in 1282 bytes} [Thu Jul 28 09:08:00 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 362 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 28 09:08:01.117954 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d9ef75-c624-45b6-a73a-e938ed69697a None admin] Authenticating user token {{(pid=416293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:08:01.153349 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG dbcounter [-] [416293] Writing DB stats keystone:SELECT=100 {{(pid=416293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:08:01.234845 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d9ef75-c624-45b6-a73a-e938ed69697a None admin] Validating token access rules against request {{(pid=416293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:08:01.275318 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18513aa-aec5-487a-b86a-443a84efa988 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:08:01.275978 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18513aa-aec5-487a-b86a-443a84efa988 None admin] REQUEST_METHOD: `GET` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:08:01.276261 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18513aa-aec5-487a-b86a-443a84efa988 None admin] SCRIPT_NAME: `/identity` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:08:01.276535 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18513aa-aec5-487a-b86a-443a84efa988 None admin] PATH_INFO: `/v3/projects/5045d6feb591464cac7a848321f2e124` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:08:01.277812 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b18513aa-aec5-487a-b86a-443a84efa988 None admin] RBAC: Authorizing `identity:get_project(project_id=5045d6feb591464cac7a848321f2e124)` {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:08:01.279312 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b18513aa-aec5-487a-b86a-443a84efa988 None admin] RBAC: Authorization granted {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:08:01.281127 dv-cinder-851351-1-smb devstack@keystone.service[416293]: [pid: 416293|app: 0|req: 574/1160] 10.222.0.42 () {56 vars in 1186 bytes} [Thu Jul 28 09:08:01 2022] GET /identity/v3/projects/5045d6feb591464cac7a848321f2e124 => generated 311 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 09:08:01.288228 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acba27e3-afa1-4648-b51a-b6a9510ef85a None admin] Authenticating user token {{(pid=416294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:08:01.317573 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG dbcounter [-] [416294] Writing DB stats keystone:SELECT=100 {{(pid=416294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:08:01.411149 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acba27e3-afa1-4648-b51a-b6a9510ef85a None admin] Validating token access rules against request {{(pid=416294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:08:01.454981 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917947e2-c435-4a77-b975-ecf205a2f83b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:08:01.455632 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917947e2-c435-4a77-b975-ecf205a2f83b None admin] REQUEST_METHOD: `GET` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:08:01.455915 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917947e2-c435-4a77-b975-ecf205a2f83b None admin] SCRIPT_NAME: `/identity` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:08:01.456185 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917947e2-c435-4a77-b975-ecf205a2f83b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:08:01.457050 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-917947e2-c435-4a77-b975-ecf205a2f83b None admin] RBAC: Adding query filter params (role.id=c67085ec338243df8f9b7d6459036e23, scope.project.id=5045d6feb591464cac7a848321f2e124, user.id=0118d961db4049f083498d1bb1940684) {{(pid=416294) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 09:08:01.457360 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-917947e2-c435-4a77-b975-ecf205a2f83b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:08:01.458854 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-917947e2-c435-4a77-b975-ecf205a2f83b None admin] RBAC: Authorization granted {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:08:01.466318 dv-cinder-851351-1-smb devstack@keystone.service[416294]: [pid: 416294|app: 0|req: 587/1161] 10.222.0.42 () {56 vars in 1374 bytes} [Thu Jul 28 09:08:01 2022] GET /identity/v3/role_assignments?user.id=0118d961db4049f083498d1bb1940684&scope.project.id=5045d6feb591464cac7a848321f2e124&role.id=c67085ec338243df8f9b7d6459036e23 => generated 608 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:08:03.551390 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b30a3a-13ae-4810-b8c3-7e8957813cef None None] REQUEST_METHOD: `GET` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:08:03.552090 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b30a3a-13ae-4810-b8c3-7e8957813cef None None] SCRIPT_NAME: `/identity` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:08:03.552090 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b30a3a-13ae-4810-b8c3-7e8957813cef None None] PATH_INFO: `/` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:08:03.553382 dv-cinder-851351-1-smb devstack@keystone.service[416293]: [pid: 416293|app: 0|req: 575/1162] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 09:08:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 28 09:08:03.559166 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb92c62-e299-4402-9f52-d50a2f9f3472 None None] REQUEST_METHOD: `POST` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:08:03.559736 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb92c62-e299-4402-9f52-d50a2f9f3472 None None] SCRIPT_NAME: `/identity` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:08:03.559736 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb92c62-e299-4402-9f52-d50a2f9f3472 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:08:03.580067 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.auth.core [None req-2fb92c62-e299-4402-9f52-d50a2f9f3472 None None] MFA Rules not processed for user `dbf87abab90e4fdf9e75408f4199918e`. Rule list: `[]` (Enabled: `True`). {{(pid=416294) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 09:08:03.581336 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.fernet_utils [None req-2fb92c62-e299-4402-9f52-d50a2f9f3472 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=416294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 09:08:03.660723 dv-cinder-851351-1-smb devstack@keystone.service[416294]: [pid: 416294|app: 0|req: 588/1163] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 09:08:03 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 09:08:03.694863 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b30a3a-13ae-4810-b8c3-7e8957813cef None None] Authenticating user token {{(pid=416293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:08:03.808410 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG dbcounter [-] [416293] Writing DB stats keystone:SELECT=100 {{(pid=416293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:08:03.813930 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b30a3a-13ae-4810-b8c3-7e8957813cef None None] Validating token access rules against request {{(pid=416293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:08:03.870381 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f93589-95e8-4acd-af1a-b3809588f0fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:08:03.871416 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f93589-95e8-4acd-af1a-b3809588f0fd None admin] REQUEST_METHOD: `GET` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:08:03.871917 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f93589-95e8-4acd-af1a-b3809588f0fd None admin] SCRIPT_NAME: `/identity` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:08:03.872409 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f93589-95e8-4acd-af1a-b3809588f0fd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:08:03.992389 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85f93589-95e8-4acd-af1a-b3809588f0fd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:08:03.993987 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85f93589-95e8-4acd-af1a-b3809588f0fd None admin] RBAC: Authorization granted {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:08:04.161948 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG dbcounter [-] [416293] Writing DB stats keystone:SELECT=100 {{(pid=416293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:08:04.168006 dv-cinder-851351-1-smb devstack@keystone.service[416293]: [pid: 416293|app: 0|req: 576/1164] 10.222.0.42 () {58 vars in 1282 bytes} [Thu Jul 28 09:08:03 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 473 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 28 09:08:04.174084 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb92c62-e299-4402-9f52-d50a2f9f3472 None None] Authenticating user token {{(pid=416294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:08:04.194578 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG dbcounter [-] [416294] Writing DB stats keystone:SELECT=100 {{(pid=416294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:08:04.287041 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb92c62-e299-4402-9f52-d50a2f9f3472 None None] Validating token access rules against request {{(pid=416294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:08:04.326518 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dda7bb6-1ff3-4142-a5a4-a751a4a93a63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:08:04.327234 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dda7bb6-1ff3-4142-a5a4-a751a4a93a63 None admin] REQUEST_METHOD: `GET` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:08:04.327518 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dda7bb6-1ff3-4142-a5a4-a751a4a93a63 None admin] SCRIPT_NAME: `/identity` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:08:04.327822 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dda7bb6-1ff3-4142-a5a4-a751a4a93a63 None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:08:04.335595 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dda7bb6-1ff3-4142-a5a4-a751a4a93a63 None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:08:04.337117 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dda7bb6-1ff3-4142-a5a4-a751a4a93a63 None admin] RBAC: Authorization granted {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:08:04.350667 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application [None req-1dda7bb6-1ff3-4142-a5a4-a751a4a93a63 None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Jul 28 09:08:04.350667 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 09:08:04.350667 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Jul 28 09:08:04.350667 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Jul 28 09:08:04.350667 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 28 09:08:04.350667 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 28 09:08:04.350667 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 28 09:08:04.350667 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 28 09:08:04.350667 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. Jul 28 09:08:04.350667 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application Jul 28 09:08:04.350667 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 28 09:08:04.350667 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application Jul 28 09:08:04.350667 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 09:08:04.350667 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 09:08:04.350667 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 09:08:04.350667 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 09:08:04.350667 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 09:08:04.352945 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 09:08:04.352945 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 09:08:04.352945 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 09:08:04.352945 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 09:08:04.352945 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 09:08:04.352945 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 09:08:04.352945 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 09:08:04.352945 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 09:08:04.352945 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 09:08:04.352945 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 09:08:04.352945 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 09:08:04.352945 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 09:08:04.352945 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 09:08:04.352945 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 09:08:04.352945 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 09:08:04.352945 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 09:08:04.354872 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 09:08:04.354872 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application with Lock( Jul 28 09:08:04.354872 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 09:08:04.354872 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return self._enter() Jul 28 09:08:04.354872 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 09:08:04.354872 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 09:08:04.354872 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 09:08:04.354872 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return self.creator() Jul 28 09:08:04.354872 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 09:08:04.354872 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application created_value = creator( Jul 28 09:08:04.354872 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Jul 28 09:08:04.354872 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 09:08:04.354872 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. Jul 28 09:08:04.354872 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application Jul 28 09:08:04.354872 dv-cinder-851351-1-smb devstack@keystone.service[416294]: [pid: 416294|app: 0|req: 589/1165] 10.222.0.42 () {56 vars in 1117 bytes} [Thu Jul 28 09:08:04 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 09:08:04.361624 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f93589-95e8-4acd-af1a-b3809588f0fd None admin] Authenticating user token {{(pid=416293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:08:04.474830 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f93589-95e8-4acd-af1a-b3809588f0fd None admin] Validating token access rules against request {{(pid=416293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:08:04.512247 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b29747-619f-482b-8ade-190df1b1db08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:08:04.512977 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b29747-619f-482b-8ade-190df1b1db08 None admin] REQUEST_METHOD: `GET` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:08:04.513319 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b29747-619f-482b-8ade-190df1b1db08 None admin] SCRIPT_NAME: `/identity` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:08:04.513638 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b29747-619f-482b-8ade-190df1b1db08 None admin] PATH_INFO: `/v3/domains` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:08:04.514408 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2b29747-619f-482b-8ade-190df1b1db08 None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=416293) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 09:08:04.514755 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2b29747-619f-482b-8ade-190df1b1db08 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:08:04.516231 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2b29747-619f-482b-8ade-190df1b1db08 None admin] RBAC: Authorization granted {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:08:04.524834 dv-cinder-851351-1-smb devstack@keystone.service[416293]: [pid: 416293|app: 0|req: 577/1166] 10.222.0.42 () {56 vars in 1115 bytes} [Thu Jul 28 09:08:04 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:08:06.551904 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a87d068-d297-4115-89cb-a5cae5248867 None None] REQUEST_METHOD: `GET` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:08:06.552573 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a87d068-d297-4115-89cb-a5cae5248867 None None] SCRIPT_NAME: `/identity` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:08:06.552573 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a87d068-d297-4115-89cb-a5cae5248867 None None] PATH_INFO: `/` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:08:06.553893 dv-cinder-851351-1-smb devstack@keystone.service[416294]: [pid: 416294|app: 0|req: 590/1167] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 09:08:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 28 09:08:06.560260 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94211816-af0e-4b68-b5c6-13024260f405 None None] REQUEST_METHOD: `POST` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:08:06.560926 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94211816-af0e-4b68-b5c6-13024260f405 None None] SCRIPT_NAME: `/identity` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:08:06.560926 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94211816-af0e-4b68-b5c6-13024260f405 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:08:06.582799 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.auth.core [None req-94211816-af0e-4b68-b5c6-13024260f405 None None] MFA Rules not processed for user `dbf87abab90e4fdf9e75408f4199918e`. Rule list: `[]` (Enabled: `True`). {{(pid=416293) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 09:08:06.584092 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.fernet_utils [None req-94211816-af0e-4b68-b5c6-13024260f405 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=416293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 09:08:06.692084 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG dbcounter [-] [416293] Writing DB stats keystone:SELECT=100 {{(pid=416293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:08:06.709281 dv-cinder-851351-1-smb devstack@keystone.service[416293]: [pid: 416293|app: 0|req: 578/1168] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 09:08:06 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 09:08:06.750909 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a87d068-d297-4115-89cb-a5cae5248867 None None] Authenticating user token {{(pid=416294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:08:06.890948 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG dbcounter [-] [416294] Writing DB stats keystone:SELECT=100 {{(pid=416294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:08:06.923163 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a87d068-d297-4115-89cb-a5cae5248867 None None] Validating token access rules against request {{(pid=416294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:08:06.968483 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f797dd5a-4a11-4c38-bd41-9bbac43cdf7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:08:06.969243 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f797dd5a-4a11-4c38-bd41-9bbac43cdf7a None admin] REQUEST_METHOD: `POST` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:08:06.969574 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f797dd5a-4a11-4c38-bd41-9bbac43cdf7a None admin] SCRIPT_NAME: `/identity` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:08:06.969899 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f797dd5a-4a11-4c38-bd41-9bbac43cdf7a None admin] PATH_INFO: `/v3/domains` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:08:06.970709 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f797dd5a-4a11-4c38-bd41-9bbac43cdf7a None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:08:06.972228 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f797dd5a-4a11-4c38-bd41-9bbac43cdf7a None admin] RBAC: Authorization granted {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:08:06.998179 dv-cinder-851351-1-smb devstack@keystone.service[416294]: [pid: 416294|app: 0|req: 591/1169] 10.222.0.42 () {60 vars in 1138 bytes} [Thu Jul 28 09:08:06 2022] POST /identity/v3/domains => generated 267 bytes in 248 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 09:08:09.130645 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935762e8-967a-4f82-abbd-123ae1bc4bcc None None] REQUEST_METHOD: `GET` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:08:09.131266 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935762e8-967a-4f82-abbd-123ae1bc4bcc None None] SCRIPT_NAME: `/identity` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:08:09.131266 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935762e8-967a-4f82-abbd-123ae1bc4bcc None None] PATH_INFO: `/` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:08:09.132623 dv-cinder-851351-1-smb devstack@keystone.service[416293]: [pid: 416293|app: 0|req: 579/1170] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 09:08:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 09:08:09.138988 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f751d4ab-9872-4d5a-8db0-14484b62b0d2 None None] REQUEST_METHOD: `POST` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:08:09.139612 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f751d4ab-9872-4d5a-8db0-14484b62b0d2 None None] SCRIPT_NAME: `/identity` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:08:09.139612 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f751d4ab-9872-4d5a-8db0-14484b62b0d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:08:09.159603 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.auth.core [None req-f751d4ab-9872-4d5a-8db0-14484b62b0d2 None None] MFA Rules not processed for user `dbf87abab90e4fdf9e75408f4199918e`. Rule list: `[]` (Enabled: `True`). {{(pid=416294) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 09:08:09.160892 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.fernet_utils [None req-f751d4ab-9872-4d5a-8db0-14484b62b0d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=416294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 09:08:09.238014 dv-cinder-851351-1-smb devstack@keystone.service[416294]: [pid: 416294|app: 0|req: 592/1171] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 09:08:09 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 28 09:08:09.262087 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-935762e8-967a-4f82-abbd-123ae1bc4bcc None None] Authenticating user token {{(pid=416293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:08:09.376031 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-935762e8-967a-4f82-abbd-123ae1bc4bcc None None] Validating token access rules against request {{(pid=416293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:08:09.416759 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67043e82-0b0a-4727-93bf-623c7ce1c155 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:08:09.417453 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67043e82-0b0a-4727-93bf-623c7ce1c155 None admin] REQUEST_METHOD: `GET` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:08:09.417740 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67043e82-0b0a-4727-93bf-623c7ce1c155 None admin] SCRIPT_NAME: `/identity` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:08:09.418020 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67043e82-0b0a-4727-93bf-623c7ce1c155 None admin] PATH_INFO: `/v3/domains/819f771fd0b842acb6c7a697c29ff826` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:08:09.431517 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67043e82-0b0a-4727-93bf-623c7ce1c155 None admin] RBAC: Authorizing `identity:get_domain(domain_id=819f771fd0b842acb6c7a697c29ff826)` {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:08:09.433069 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67043e82-0b0a-4727-93bf-623c7ce1c155 None admin] RBAC: Authorization granted {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:08:09.434875 dv-cinder-851351-1-smb devstack@keystone.service[416293]: [pid: 416293|app: 0|req: 580/1172] 10.222.0.42 () {56 vars in 1183 bytes} [Thu Jul 28 09:08:09 2022] GET /identity/v3/domains/819f771fd0b842acb6c7a697c29ff826 => generated 267 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 09:08:09.441551 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f751d4ab-9872-4d5a-8db0-14484b62b0d2 None None] Authenticating user token {{(pid=416294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:08:09.515338 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG dbcounter [-] [416294] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=416294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:08:09.560058 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f751d4ab-9872-4d5a-8db0-14484b62b0d2 None None] Validating token access rules against request {{(pid=416294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:08:09.602648 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e97d9ca-d24b-43e9-86ee-dcdc3f09c6b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:08:09.603728 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e97d9ca-d24b-43e9-86ee-dcdc3f09c6b4 None admin] REQUEST_METHOD: `POST` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:08:09.604238 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e97d9ca-d24b-43e9-86ee-dcdc3f09c6b4 None admin] SCRIPT_NAME: `/identity` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:08:09.604772 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e97d9ca-d24b-43e9-86ee-dcdc3f09c6b4 None admin] PATH_INFO: `/v3/projects` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:08:09.606022 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e97d9ca-d24b-43e9-86ee-dcdc3f09c6b4 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:08:09.608812 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e97d9ca-d24b-43e9-86ee-dcdc3f09c6b4 None admin] RBAC: Authorization granted {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:08:09.647683 dv-cinder-851351-1-smb devstack@keystone.service[416294]: [pid: 416294|app: 0|req: 593/1173] 10.222.0.42 () {60 vars in 1141 bytes} [Thu Jul 28 09:08:09 2022] POST /identity/v3/projects => generated 361 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 09:08:11.823901 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7d7e6d-b7c8-4cc4-af80-2e68bb831708 None None] REQUEST_METHOD: `GET` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:08:11.824516 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7d7e6d-b7c8-4cc4-af80-2e68bb831708 None None] SCRIPT_NAME: `/identity` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:08:11.824516 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7d7e6d-b7c8-4cc4-af80-2e68bb831708 None None] PATH_INFO: `/` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:08:11.826071 dv-cinder-851351-1-smb devstack@keystone.service[416293]: [pid: 416293|app: 0|req: 581/1174] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 09:08:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 09:08:11.832569 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19a7c04-08cd-486c-a7f4-d9673cd0d6e9 None None] REQUEST_METHOD: `POST` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:08:11.833241 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19a7c04-08cd-486c-a7f4-d9673cd0d6e9 None None] SCRIPT_NAME: `/identity` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:08:11.833241 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19a7c04-08cd-486c-a7f4-d9673cd0d6e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:08:11.852901 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.auth.core [None req-d19a7c04-08cd-486c-a7f4-d9673cd0d6e9 None None] MFA Rules not processed for user `dbf87abab90e4fdf9e75408f4199918e`. Rule list: `[]` (Enabled: `True`). {{(pid=416294) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 09:08:11.854136 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.fernet_utils [None req-d19a7c04-08cd-486c-a7f4-d9673cd0d6e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=416294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 09:08:11.930609 dv-cinder-851351-1-smb devstack@keystone.service[416294]: [pid: 416294|app: 0|req: 594/1175] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 09:08:11 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 09:08:11.956494 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7d7e6d-b7c8-4cc4-af80-2e68bb831708 None None] Authenticating user token {{(pid=416293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:08:12.024246 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG dbcounter [-] [416293] Writing DB stats keystone:SELECT=100 {{(pid=416293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:08:12.078006 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7d7e6d-b7c8-4cc4-af80-2e68bb831708 None None] Validating token access rules against request {{(pid=416293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:08:12.116434 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-113406c9-9bb7-4edb-b576-ecd645d37d76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:08:12.117154 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113406c9-9bb7-4edb-b576-ecd645d37d76 None admin] REQUEST_METHOD: `GET` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:08:12.117439 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113406c9-9bb7-4edb-b576-ecd645d37d76 None admin] SCRIPT_NAME: `/identity` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:08:12.117718 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113406c9-9bb7-4edb-b576-ecd645d37d76 None admin] PATH_INFO: `/v3/domains/819f771fd0b842acb6c7a697c29ff826` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:08:12.119020 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-113406c9-9bb7-4edb-b576-ecd645d37d76 None admin] RBAC: Authorizing `identity:get_domain(domain_id=819f771fd0b842acb6c7a697c29ff826)` {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:08:12.120518 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-113406c9-9bb7-4edb-b576-ecd645d37d76 None admin] RBAC: Authorization granted {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:08:12.122235 dv-cinder-851351-1-smb devstack@keystone.service[416293]: [pid: 416293|app: 0|req: 582/1176] 10.222.0.42 () {56 vars in 1183 bytes} [Thu Jul 28 09:08:11 2022] GET /identity/v3/domains/819f771fd0b842acb6c7a697c29ff826 => generated 267 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:08:12.128819 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d19a7c04-08cd-486c-a7f4-d9673cd0d6e9 None None] Authenticating user token {{(pid=416294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:08:12.184311 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG dbcounter [-] [416294] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=416294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:08:12.244088 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d19a7c04-08cd-486c-a7f4-d9673cd0d6e9 None None] Validating token access rules against request {{(pid=416294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:08:12.282374 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda93e0f-f328-463a-b600-65ea08f3517d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:08:12.283012 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda93e0f-f328-463a-b600-65ea08f3517d None admin] REQUEST_METHOD: `POST` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:08:12.283300 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda93e0f-f328-463a-b600-65ea08f3517d None admin] SCRIPT_NAME: `/identity` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:08:12.283574 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda93e0f-f328-463a-b600-65ea08f3517d None admin] PATH_INFO: `/v3/users` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:08:12.284281 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dda93e0f-f328-463a-b600-65ea08f3517d None admin] RBAC: Authorizing `identity:create_user()` {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:08:12.285776 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dda93e0f-f328-463a-b600-65ea08f3517d None admin] RBAC: Authorization granted {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:08:12.308818 dv-cinder-851351-1-smb devstack@keystone.service[416294]: [pid: 416294|app: 0|req: 595/1177] 10.222.0.42 () {60 vars in 1132 bytes} [Thu Jul 28 09:08:12 2022] POST /identity/v3/users => generated 311 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 09:08:14.417363 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85bed919-1040-49b5-95a7-992b2cbd1f97 None None] REQUEST_METHOD: `GET` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:08:14.418037 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85bed919-1040-49b5-95a7-992b2cbd1f97 None None] SCRIPT_NAME: `/identity` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:08:14.418037 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85bed919-1040-49b5-95a7-992b2cbd1f97 None None] PATH_INFO: `/` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:08:14.419470 dv-cinder-851351-1-smb devstack@keystone.service[416293]: [pid: 416293|app: 0|req: 583/1178] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 09:08:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 09:08:14.425713 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd714c4-d095-4637-9a74-0e5d4d766657 None None] REQUEST_METHOD: `POST` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:08:14.426309 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd714c4-d095-4637-9a74-0e5d4d766657 None None] SCRIPT_NAME: `/identity` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:08:14.426309 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd714c4-d095-4637-9a74-0e5d4d766657 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:08:14.447504 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.auth.core [None req-bfd714c4-d095-4637-9a74-0e5d4d766657 None None] MFA Rules not processed for user `dbf87abab90e4fdf9e75408f4199918e`. Rule list: `[]` (Enabled: `True`). {{(pid=416294) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 09:08:14.449237 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.fernet_utils [None req-bfd714c4-d095-4637-9a74-0e5d4d766657 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=416294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 09:08:14.525352 dv-cinder-851351-1-smb devstack@keystone.service[416294]: [pid: 416294|app: 0|req: 596/1179] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 09:08:14 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 09:08:14.549253 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85bed919-1040-49b5-95a7-992b2cbd1f97 None None] Authenticating user token {{(pid=416293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:08:14.667203 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85bed919-1040-49b5-95a7-992b2cbd1f97 None None] Validating token access rules against request {{(pid=416293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:08:14.693287 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG dbcounter [-] [416293] Writing DB stats keystone:SELECT=100 {{(pid=416293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:08:14.706561 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4e51b5-f75a-486f-be9b-83ba41156504 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:08:14.707245 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4e51b5-f75a-486f-be9b-83ba41156504 None admin] REQUEST_METHOD: `GET` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:08:14.707533 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4e51b5-f75a-486f-be9b-83ba41156504 None admin] SCRIPT_NAME: `/identity` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:08:14.707814 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4e51b5-f75a-486f-be9b-83ba41156504 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:08:14.720965 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff4e51b5-f75a-486f-be9b-83ba41156504 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 09:08:14.726041 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application [None req-ff4e51b5-f75a-486f-be9b-83ba41156504 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 09:08:14.726041 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 09:08:14.726041 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 09:08:14.726041 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 09:08:14.726041 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 09:08:14.726041 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 09:08:14.726041 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 09:08:14.726041 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 09:08:14.726041 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 09:08:14.726041 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 09:08:14.726041 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 09:08:14.726041 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 09:08:14.726041 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 09:08:14.726041 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 09:08:14.726041 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 09:08:14.726041 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 09:08:14.727752 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 09:08:14.727752 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 09:08:14.727752 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 09:08:14.727752 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 09:08:14.727752 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 09:08:14.727752 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 09:08:14.727752 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 09:08:14.727752 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 09:08:14.727752 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 09:08:14.727752 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 09:08:14.727752 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 09:08:14.727752 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application with Lock( Jul 28 09:08:14.727752 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 09:08:14.727752 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self._enter() Jul 28 09:08:14.727752 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 09:08:14.727752 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 09:08:14.729882 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 09:08:14.729882 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self.creator() Jul 28 09:08:14.729882 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 09:08:14.729882 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application created_value = creator( Jul 28 09:08:14.729882 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 09:08:14.729882 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 09:08:14.729882 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 09:08:14.729882 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 09:08:14.729882 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 09:08:14.729882 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 09:08:14.729882 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 09:08:14.729882 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application Jul 28 09:08:14.729882 dv-cinder-851351-1-smb devstack@keystone.service[416293]: [pid: 416293|app: 0|req: 584/1180] 10.222.0.42 () {56 vars in 1096 bytes} [Thu Jul 28 09:08:14 2022] GET /identity/v3/roles/admin => generated 83 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 09:08:14.735463 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd714c4-d095-4637-9a74-0e5d4d766657 None None] Authenticating user token {{(pid=416294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:08:14.772955 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG dbcounter [-] [416294] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=416294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:08:14.849225 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd714c4-d095-4637-9a74-0e5d4d766657 None None] Validating token access rules against request {{(pid=416294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:08:14.891260 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e4ef1d-d9c2-4234-9834-5aee913df32d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:08:14.891931 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e4ef1d-d9c2-4234-9834-5aee913df32d None admin] REQUEST_METHOD: `GET` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:08:14.892217 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e4ef1d-d9c2-4234-9834-5aee913df32d None admin] SCRIPT_NAME: `/identity` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:08:14.892496 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e4ef1d-d9c2-4234-9834-5aee913df32d None admin] PATH_INFO: `/v3/roles` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:08:14.893313 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66e4ef1d-d9c2-4234-9834-5aee913df32d None admin] RBAC: Adding query filter params (name=admin) {{(pid=416294) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 09:08:14.893623 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66e4ef1d-d9c2-4234-9834-5aee913df32d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:08:14.895090 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66e4ef1d-d9c2-4234-9834-5aee913df32d None admin] RBAC: Authorization granted {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:08:14.905515 dv-cinder-851351-1-smb devstack@keystone.service[416294]: [pid: 416294|app: 0|req: 597/1181] 10.222.0.42 () {56 vars in 1099 bytes} [Thu Jul 28 09:08:14 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:08:14.912084 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4e51b5-f75a-486f-be9b-83ba41156504 None admin] Authenticating user token {{(pid=416293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:08:15.037551 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4e51b5-f75a-486f-be9b-83ba41156504 None admin] Validating token access rules against request {{(pid=416293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:08:15.079591 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a622e6e-68ab-4534-83ec-6bede76aee22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:08:15.080280 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a622e6e-68ab-4534-83ec-6bede76aee22 None admin] REQUEST_METHOD: `GET` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:08:15.080570 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a622e6e-68ab-4534-83ec-6bede76aee22 None admin] SCRIPT_NAME: `/identity` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:08:15.080886 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a622e6e-68ab-4534-83ec-6bede76aee22 None admin] PATH_INFO: `/v3/users/802b9e917ace47babdd2d57a0bf5ce07` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:08:15.098130 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a622e6e-68ab-4534-83ec-6bede76aee22 None admin] RBAC: Authorizing `identity:get_user(user_id=802b9e917ace47babdd2d57a0bf5ce07)` {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:08:15.099650 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a622e6e-68ab-4534-83ec-6bede76aee22 None admin] RBAC: Authorization granted {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:08:15.101536 dv-cinder-851351-1-smb devstack@keystone.service[416293]: [pid: 416293|app: 0|req: 585/1182] 10.222.0.42 () {56 vars in 1177 bytes} [Thu Jul 28 09:08:14 2022] GET /identity/v3/users/802b9e917ace47babdd2d57a0bf5ce07 => generated 311 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 09:08:15.110493 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e4ef1d-d9c2-4234-9834-5aee913df32d None admin] Authenticating user token {{(pid=416294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:08:15.229496 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG dbcounter [-] [416294] Writing DB stats keystone:SELECT=100 {{(pid=416294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:08:15.237375 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e4ef1d-d9c2-4234-9834-5aee913df32d None admin] Validating token access rules against request {{(pid=416294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:08:15.278997 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f6ad138-9f69-4d2a-8552-1d2cff3c7690 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:08:15.279657 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6ad138-9f69-4d2a-8552-1d2cff3c7690 None admin] REQUEST_METHOD: `GET` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:08:15.279990 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6ad138-9f69-4d2a-8552-1d2cff3c7690 None admin] SCRIPT_NAME: `/identity` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:08:15.280298 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6ad138-9f69-4d2a-8552-1d2cff3c7690 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:08:15.358349 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f6ad138-9f69-4d2a-8552-1d2cff3c7690 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:08:15.359844 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f6ad138-9f69-4d2a-8552-1d2cff3c7690 None admin] RBAC: Authorization granted {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:08:15.464646 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG dbcounter [-] [416294] Writing DB stats keystone:SELECT=100 {{(pid=416294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:08:15.472785 dv-cinder-851351-1-smb devstack@keystone.service[416294]: [pid: 416294|app: 0|req: 598/1183] 10.222.0.42 () {58 vars in 1282 bytes} [Thu Jul 28 09:08:15 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 363 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 28 09:08:15.479191 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a622e6e-68ab-4534-83ec-6bede76aee22 None admin] Authenticating user token {{(pid=416293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:08:15.528758 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG dbcounter [-] [416293] Writing DB stats keystone:SELECT=100 {{(pid=416293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:08:15.595637 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a622e6e-68ab-4534-83ec-6bede76aee22 None admin] Validating token access rules against request {{(pid=416293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:08:15.634856 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b969a211-ab9b-4e97-9d04-ee1d14703a8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:08:15.635604 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b969a211-ab9b-4e97-9d04-ee1d14703a8a None admin] REQUEST_METHOD: `GET` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:08:15.635952 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b969a211-ab9b-4e97-9d04-ee1d14703a8a None admin] SCRIPT_NAME: `/identity` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:08:15.636262 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b969a211-ab9b-4e97-9d04-ee1d14703a8a None admin] PATH_INFO: `/v3/projects/dcf8f891cf3f421da99510eb1a74b563` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:08:15.637610 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b969a211-ab9b-4e97-9d04-ee1d14703a8a None admin] RBAC: Authorizing `identity:get_project(project_id=dcf8f891cf3f421da99510eb1a74b563)` {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:08:15.639130 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b969a211-ab9b-4e97-9d04-ee1d14703a8a None admin] RBAC: Authorization granted {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:08:15.641043 dv-cinder-851351-1-smb devstack@keystone.service[416293]: [pid: 416293|app: 0|req: 586/1184] 10.222.0.42 () {56 vars in 1186 bytes} [Thu Jul 28 09:08:15 2022] GET /identity/v3/projects/dcf8f891cf3f421da99510eb1a74b563 => generated 361 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:08:15.647774 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f6ad138-9f69-4d2a-8552-1d2cff3c7690 None admin] Authenticating user token {{(pid=416294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:08:15.771860 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f6ad138-9f69-4d2a-8552-1d2cff3c7690 None admin] Validating token access rules against request {{(pid=416294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:08:15.810985 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f949e90-50df-40ea-823e-7676ae845e79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:08:15.811625 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f949e90-50df-40ea-823e-7676ae845e79 None admin] REQUEST_METHOD: `GET` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:08:15.811891 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f949e90-50df-40ea-823e-7676ae845e79 None admin] SCRIPT_NAME: `/identity` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:08:15.812175 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f949e90-50df-40ea-823e-7676ae845e79 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:08:15.813017 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f949e90-50df-40ea-823e-7676ae845e79 None admin] RBAC: Adding query filter params (role.id=c67085ec338243df8f9b7d6459036e23, scope.project.id=dcf8f891cf3f421da99510eb1a74b563, user.id=802b9e917ace47babdd2d57a0bf5ce07) {{(pid=416294) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 09:08:15.813315 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f949e90-50df-40ea-823e-7676ae845e79 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:08:15.814781 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f949e90-50df-40ea-823e-7676ae845e79 None admin] RBAC: Authorization granted {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:08:15.821510 dv-cinder-851351-1-smb devstack@keystone.service[416294]: [pid: 416294|app: 0|req: 599/1185] 10.222.0.42 () {56 vars in 1374 bytes} [Thu Jul 28 09:08:15 2022] GET /identity/v3/role_assignments?user.id=802b9e917ace47babdd2d57a0bf5ce07&scope.project.id=dcf8f891cf3f421da99510eb1a74b563&role.id=c67085ec338243df8f9b7d6459036e23 => generated 259 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:08:17.869962 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5e0617-9a3d-42b3-bd24-3c97888dbf8b None None] REQUEST_METHOD: `GET` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:08:17.870543 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5e0617-9a3d-42b3-bd24-3c97888dbf8b None None] SCRIPT_NAME: `/identity` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:08:17.870695 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5e0617-9a3d-42b3-bd24-3c97888dbf8b None None] PATH_INFO: `/` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:08:17.872246 dv-cinder-851351-1-smb devstack@keystone.service[416293]: [pid: 416293|app: 0|req: 587/1186] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 09:08:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 09:08:17.878688 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f866a0-fdf9-4ceb-8197-dc0701e27b29 None None] REQUEST_METHOD: `POST` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:08:17.879282 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f866a0-fdf9-4ceb-8197-dc0701e27b29 None None] SCRIPT_NAME: `/identity` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:08:17.879282 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f866a0-fdf9-4ceb-8197-dc0701e27b29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:08:17.899204 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.auth.core [None req-61f866a0-fdf9-4ceb-8197-dc0701e27b29 None None] MFA Rules not processed for user `dbf87abab90e4fdf9e75408f4199918e`. Rule list: `[]` (Enabled: `True`). {{(pid=416294) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 09:08:17.900449 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.fernet_utils [None req-61f866a0-fdf9-4ceb-8197-dc0701e27b29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=416294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 09:08:17.964317 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG dbcounter [-] [416294] Writing DB stats keystone:SELECT=100 {{(pid=416294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:08:17.979942 dv-cinder-851351-1-smb devstack@keystone.service[416294]: [pid: 416294|app: 0|req: 600/1187] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 09:08:17 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 09:08:18.002881 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5e0617-9a3d-42b3-bd24-3c97888dbf8b None None] Authenticating user token {{(pid=416293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:08:18.124725 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5e0617-9a3d-42b3-bd24-3c97888dbf8b None None] Validating token access rules against request {{(pid=416293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:08:18.135886 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG dbcounter [-] [416293] Writing DB stats keystone:SELECT=100 {{(pid=416293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:08:18.165280 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba28aa6f-65b7-4b2d-865c-3032d0234a7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:08:18.165983 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba28aa6f-65b7-4b2d-865c-3032d0234a7d None admin] REQUEST_METHOD: `GET` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:08:18.166273 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba28aa6f-65b7-4b2d-865c-3032d0234a7d None admin] SCRIPT_NAME: `/identity` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:08:18.166583 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba28aa6f-65b7-4b2d-865c-3032d0234a7d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:08:18.178607 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba28aa6f-65b7-4b2d-865c-3032d0234a7d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 09:08:18.183726 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application [None req-ba28aa6f-65b7-4b2d-865c-3032d0234a7d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 09:08:18.183726 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 09:08:18.183726 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 09:08:18.183726 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 09:08:18.183726 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 09:08:18.183726 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 09:08:18.183726 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 09:08:18.183726 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 09:08:18.183726 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 09:08:18.183726 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 09:08:18.183726 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 09:08:18.183726 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 09:08:18.183726 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 09:08:18.183726 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 09:08:18.183726 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 09:08:18.183726 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 09:08:18.185603 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 09:08:18.185603 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 09:08:18.185603 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 09:08:18.185603 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 09:08:18.185603 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 09:08:18.185603 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 09:08:18.185603 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 09:08:18.185603 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 09:08:18.185603 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 09:08:18.185603 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 09:08:18.185603 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 09:08:18.185603 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application with Lock( Jul 28 09:08:18.185603 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 09:08:18.185603 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self._enter() Jul 28 09:08:18.185603 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 09:08:18.185603 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 09:08:18.187369 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 09:08:18.187369 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self.creator() Jul 28 09:08:18.187369 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 09:08:18.187369 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application created_value = creator( Jul 28 09:08:18.187369 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 09:08:18.187369 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 09:08:18.187369 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 09:08:18.187369 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 09:08:18.187369 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 09:08:18.187369 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 09:08:18.187369 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 09:08:18.187369 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application Jul 28 09:08:18.187369 dv-cinder-851351-1-smb devstack@keystone.service[416293]: [pid: 416293|app: 0|req: 588/1188] 10.222.0.42 () {56 vars in 1096 bytes} [Thu Jul 28 09:08:18 2022] GET /identity/v3/roles/admin => generated 83 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 09:08:18.192478 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f866a0-fdf9-4ceb-8197-dc0701e27b29 None None] Authenticating user token {{(pid=416294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:08:18.303011 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f866a0-fdf9-4ceb-8197-dc0701e27b29 None None] Validating token access rules against request {{(pid=416294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:08:18.341779 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e26393-6ce9-4c07-b98e-b29276c90f3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:08:18.342513 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e26393-6ce9-4c07-b98e-b29276c90f3d None admin] REQUEST_METHOD: `GET` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:08:18.342829 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e26393-6ce9-4c07-b98e-b29276c90f3d None admin] SCRIPT_NAME: `/identity` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:08:18.343109 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e26393-6ce9-4c07-b98e-b29276c90f3d None admin] PATH_INFO: `/v3/roles` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:08:18.343871 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3e26393-6ce9-4c07-b98e-b29276c90f3d None admin] RBAC: Adding query filter params (name=admin) {{(pid=416294) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 09:08:18.344184 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3e26393-6ce9-4c07-b98e-b29276c90f3d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:08:18.345694 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3e26393-6ce9-4c07-b98e-b29276c90f3d None admin] RBAC: Authorization granted {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:08:18.356047 dv-cinder-851351-1-smb devstack@keystone.service[416294]: [pid: 416294|app: 0|req: 601/1189] 10.222.0.42 () {56 vars in 1099 bytes} [Thu Jul 28 09:08:18 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:08:18.362775 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba28aa6f-65b7-4b2d-865c-3032d0234a7d None admin] Authenticating user token {{(pid=416293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:08:18.477442 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba28aa6f-65b7-4b2d-865c-3032d0234a7d None admin] Validating token access rules against request {{(pid=416293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:08:18.517709 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9482ae-a934-4c02-89cc-c098bb957fc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:08:18.518430 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9482ae-a934-4c02-89cc-c098bb957fc2 None admin] REQUEST_METHOD: `GET` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:08:18.518769 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9482ae-a934-4c02-89cc-c098bb957fc2 None admin] SCRIPT_NAME: `/identity` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:08:18.519092 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9482ae-a934-4c02-89cc-c098bb957fc2 None admin] PATH_INFO: `/v3/users/802b9e917ace47babdd2d57a0bf5ce07` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:08:18.520519 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc9482ae-a934-4c02-89cc-c098bb957fc2 None admin] RBAC: Authorizing `identity:get_user(user_id=802b9e917ace47babdd2d57a0bf5ce07)` {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:08:18.522118 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc9482ae-a934-4c02-89cc-c098bb957fc2 None admin] RBAC: Authorization granted {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:08:18.523922 dv-cinder-851351-1-smb devstack@keystone.service[416293]: [pid: 416293|app: 0|req: 589/1190] 10.222.0.42 () {56 vars in 1177 bytes} [Thu Jul 28 09:08:18 2022] GET /identity/v3/users/802b9e917ace47babdd2d57a0bf5ce07 => generated 311 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:08:18.530545 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e26393-6ce9-4c07-b98e-b29276c90f3d None admin] Authenticating user token {{(pid=416294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:08:18.591234 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG dbcounter [-] [416294] Writing DB stats keystone:SELECT=100 {{(pid=416294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:08:18.642741 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e26393-6ce9-4c07-b98e-b29276c90f3d None admin] Validating token access rules against request {{(pid=416294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:08:18.678739 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce4277b-6b37-442a-8f89-52eaf7e5c343 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:08:18.679392 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce4277b-6b37-442a-8f89-52eaf7e5c343 None admin] REQUEST_METHOD: `GET` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:08:18.679669 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce4277b-6b37-442a-8f89-52eaf7e5c343 None admin] SCRIPT_NAME: `/identity` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:08:18.679945 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce4277b-6b37-442a-8f89-52eaf7e5c343 None admin] PATH_INFO: `/v3/projects/dcf8f891cf3f421da99510eb1a74b563` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:08:18.681167 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ce4277b-6b37-442a-8f89-52eaf7e5c343 None admin] RBAC: Authorizing `identity:get_project(project_id=dcf8f891cf3f421da99510eb1a74b563)` {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:08:18.682617 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ce4277b-6b37-442a-8f89-52eaf7e5c343 None admin] RBAC: Authorization granted {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:08:18.684300 dv-cinder-851351-1-smb devstack@keystone.service[416294]: [pid: 416294|app: 0|req: 602/1191] 10.222.0.42 () {56 vars in 1186 bytes} [Thu Jul 28 09:08:18 2022] GET /identity/v3/projects/dcf8f891cf3f421da99510eb1a74b563 => generated 361 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 09:08:18.690992 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9482ae-a934-4c02-89cc-c098bb957fc2 None admin] Authenticating user token {{(pid=416293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:08:18.729034 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG dbcounter [-] [416293] Writing DB stats keystone:SELECT=100 {{(pid=416293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:08:18.801249 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9482ae-a934-4c02-89cc-c098bb957fc2 None admin] Validating token access rules against request {{(pid=416293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:08:18.838115 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fae9eac-073a-44cc-94a8-e4316939bde4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:08:18.838812 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fae9eac-073a-44cc-94a8-e4316939bde4 None admin] REQUEST_METHOD: `PUT` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:08:18.839110 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fae9eac-073a-44cc-94a8-e4316939bde4 None admin] SCRIPT_NAME: `/identity` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:08:18.839381 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fae9eac-073a-44cc-94a8-e4316939bde4 None admin] PATH_INFO: `/v3/projects/dcf8f891cf3f421da99510eb1a74b563/users/802b9e917ace47babdd2d57a0bf5ce07/roles/c67085ec338243df8f9b7d6459036e23` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:08:18.841456 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fae9eac-073a-44cc-94a8-e4316939bde4 None admin] RBAC: Authorizing `identity:create_grant(project_id=dcf8f891cf3f421da99510eb1a74b563, user_id=802b9e917ace47babdd2d57a0bf5ce07, role_id=c67085ec338243df8f9b7d6459036e23)` {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:08:18.843039 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fae9eac-073a-44cc-94a8-e4316939bde4 None admin] RBAC: Authorization granted {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:08:18.862916 dv-cinder-851351-1-smb devstack@keystone.service[416293]: [pid: 416293|app: 0|req: 590/1192] 10.222.0.42 () {58 vars in 1439 bytes} [Thu Jul 28 09:08:18 2022] PUT /identity/v3/projects/dcf8f891cf3f421da99510eb1a74b563/users/802b9e917ace47babdd2d57a0bf5ce07/roles/c67085ec338243df8f9b7d6459036e23 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 09:08:20.933599 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc898e61-0991-44a4-8dee-cf56951bae6a None None] REQUEST_METHOD: `GET` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:08:20.934254 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc898e61-0991-44a4-8dee-cf56951bae6a None None] SCRIPT_NAME: `/identity` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:08:20.934254 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc898e61-0991-44a4-8dee-cf56951bae6a None None] PATH_INFO: `/` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:08:20.935517 dv-cinder-851351-1-smb devstack@keystone.service[416294]: [pid: 416294|app: 0|req: 603/1193] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 09:08:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 09:08:20.941613 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52af119-4256-4150-b80c-b1f7e52e9ded None None] REQUEST_METHOD: `POST` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:08:20.942455 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52af119-4256-4150-b80c-b1f7e52e9ded None None] SCRIPT_NAME: `/identity` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:08:20.942455 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52af119-4256-4150-b80c-b1f7e52e9ded None None] PATH_INFO: `/v3/auth/tokens` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:08:20.963254 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.auth.core [None req-b52af119-4256-4150-b80c-b1f7e52e9ded None None] MFA Rules not processed for user `dbf87abab90e4fdf9e75408f4199918e`. Rule list: `[]` (Enabled: `True`). {{(pid=416293) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 09:08:20.965088 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.fernet_utils [None req-b52af119-4256-4150-b80c-b1f7e52e9ded None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=416293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 09:08:21.044445 dv-cinder-851351-1-smb devstack@keystone.service[416293]: [pid: 416293|app: 0|req: 591/1194] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 09:08:20 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 09:08:21.068937 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc898e61-0991-44a4-8dee-cf56951bae6a None None] Authenticating user token {{(pid=416294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:08:21.189564 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc898e61-0991-44a4-8dee-cf56951bae6a None None] Validating token access rules against request {{(pid=416294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:08:21.213865 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG dbcounter [-] [416294] Writing DB stats keystone:SELECT=100 {{(pid=416294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:08:21.234057 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba44fe1-1ff8-430e-b341-7b31d2c07062 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:08:21.234808 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba44fe1-1ff8-430e-b341-7b31d2c07062 None admin] REQUEST_METHOD: `GET` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:08:21.235141 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba44fe1-1ff8-430e-b341-7b31d2c07062 None admin] SCRIPT_NAME: `/identity` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:08:21.235468 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba44fe1-1ff8-430e-b341-7b31d2c07062 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:08:21.254464 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ba44fe1-1ff8-430e-b341-7b31d2c07062 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 09:08:21.259529 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application [None req-9ba44fe1-1ff8-430e-b341-7b31d2c07062 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 09:08:21.259529 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 09:08:21.259529 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 09:08:21.259529 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 09:08:21.259529 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 09:08:21.259529 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 09:08:21.259529 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 09:08:21.259529 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 09:08:21.259529 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 09:08:21.259529 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 09:08:21.259529 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 09:08:21.259529 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 09:08:21.259529 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 09:08:21.259529 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 09:08:21.259529 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 09:08:21.259529 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 09:08:21.260922 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 09:08:21.260922 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 09:08:21.260922 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 09:08:21.260922 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 09:08:21.260922 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 09:08:21.260922 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 09:08:21.260922 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 09:08:21.260922 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 09:08:21.260922 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 09:08:21.260922 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 09:08:21.260922 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 09:08:21.260922 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application with Lock( Jul 28 09:08:21.260922 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 09:08:21.260922 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return self._enter() Jul 28 09:08:21.260922 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 09:08:21.260922 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 09:08:21.262847 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 09:08:21.262847 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return self.creator() Jul 28 09:08:21.262847 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 09:08:21.262847 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application created_value = creator( Jul 28 09:08:21.262847 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 09:08:21.262847 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 09:08:21.262847 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 09:08:21.262847 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 09:08:21.262847 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 09:08:21.262847 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 09:08:21.262847 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 09:08:21.262847 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application Jul 28 09:08:21.262847 dv-cinder-851351-1-smb devstack@keystone.service[416294]: [pid: 416294|app: 0|req: 604/1195] 10.222.0.42 () {56 vars in 1096 bytes} [Thu Jul 28 09:08:21 2022] GET /identity/v3/roles/admin => generated 83 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 09:08:21.267387 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52af119-4256-4150-b80c-b1f7e52e9ded None None] Authenticating user token {{(pid=416293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:08:21.299733 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG dbcounter [-] [416293] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=416293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:08:21.436263 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52af119-4256-4150-b80c-b1f7e52e9ded None None] Validating token access rules against request {{(pid=416293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:08:21.501882 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e19143-cb53-43aa-ad5e-de89a32b119b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:08:21.502903 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e19143-cb53-43aa-ad5e-de89a32b119b None admin] REQUEST_METHOD: `GET` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:08:21.503418 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e19143-cb53-43aa-ad5e-de89a32b119b None admin] SCRIPT_NAME: `/identity` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:08:21.503927 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e19143-cb53-43aa-ad5e-de89a32b119b None admin] PATH_INFO: `/v3/roles` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:08:21.505378 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67e19143-cb53-43aa-ad5e-de89a32b119b None admin] RBAC: Adding query filter params (name=admin) {{(pid=416293) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 09:08:21.505954 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67e19143-cb53-43aa-ad5e-de89a32b119b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:08:21.508690 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67e19143-cb53-43aa-ad5e-de89a32b119b None admin] RBAC: Authorization granted {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:08:21.532571 dv-cinder-851351-1-smb devstack@keystone.service[416293]: [pid: 416293|app: 0|req: 592/1196] 10.222.0.42 () {56 vars in 1099 bytes} [Thu Jul 28 09:08:21 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 09:08:21.539176 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba44fe1-1ff8-430e-b341-7b31d2c07062 None admin] Authenticating user token {{(pid=416294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:08:21.657059 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba44fe1-1ff8-430e-b341-7b31d2c07062 None admin] Validating token access rules against request {{(pid=416294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:08:21.695966 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a13a3546-9483-41da-b298-8a82b46af1ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:08:21.696815 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13a3546-9483-41da-b298-8a82b46af1ca None admin] REQUEST_METHOD: `GET` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:08:21.697197 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13a3546-9483-41da-b298-8a82b46af1ca None admin] SCRIPT_NAME: `/identity` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:08:21.697574 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13a3546-9483-41da-b298-8a82b46af1ca None admin] PATH_INFO: `/v3/users/802b9e917ace47babdd2d57a0bf5ce07` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:08:21.699389 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a13a3546-9483-41da-b298-8a82b46af1ca None admin] RBAC: Authorizing `identity:get_user(user_id=802b9e917ace47babdd2d57a0bf5ce07)` {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:08:21.700952 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a13a3546-9483-41da-b298-8a82b46af1ca None admin] RBAC: Authorization granted {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:08:21.702793 dv-cinder-851351-1-smb devstack@keystone.service[416294]: [pid: 416294|app: 0|req: 605/1197] 10.222.0.42 () {56 vars in 1177 bytes} [Thu Jul 28 09:08:21 2022] GET /identity/v3/users/802b9e917ace47babdd2d57a0bf5ce07 => generated 311 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:08:21.709313 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e19143-cb53-43aa-ad5e-de89a32b119b None admin] Authenticating user token {{(pid=416293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:08:21.816015 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG dbcounter [-] [416293] Writing DB stats keystone:SELECT=100 {{(pid=416293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:08:21.830324 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e19143-cb53-43aa-ad5e-de89a32b119b None admin] Validating token access rules against request {{(pid=416293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:08:21.868499 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73cb9839-bf71-401c-988e-ac3f533d74cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:08:21.869176 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73cb9839-bf71-401c-988e-ac3f533d74cf None admin] REQUEST_METHOD: `GET` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:08:21.869459 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73cb9839-bf71-401c-988e-ac3f533d74cf None admin] SCRIPT_NAME: `/identity` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:08:21.869737 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73cb9839-bf71-401c-988e-ac3f533d74cf None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:08:21.945436 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73cb9839-bf71-401c-988e-ac3f533d74cf None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:08:21.946980 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73cb9839-bf71-401c-988e-ac3f533d74cf None admin] RBAC: Authorization granted {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:08:22.049352 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG dbcounter [-] [416293] Writing DB stats keystone:SELECT=100 {{(pid=416293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:08:22.065214 dv-cinder-851351-1-smb devstack@keystone.service[416293]: [pid: 416293|app: 0|req: 593/1198] 10.222.0.42 () {58 vars in 1282 bytes} [Thu Jul 28 09:08:21 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 357 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 28 09:08:22.071794 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a13a3546-9483-41da-b298-8a82b46af1ca None admin] Authenticating user token {{(pid=416294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:08:22.130423 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG dbcounter [-] [416294] Writing DB stats keystone:SELECT=100 {{(pid=416294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:08:22.190162 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a13a3546-9483-41da-b298-8a82b46af1ca None admin] Validating token access rules against request {{(pid=416294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:08:22.229762 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b2097d-16fc-4016-8911-d131f070221f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:08:22.230438 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b2097d-16fc-4016-8911-d131f070221f None admin] REQUEST_METHOD: `GET` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:08:22.230706 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b2097d-16fc-4016-8911-d131f070221f None admin] SCRIPT_NAME: `/identity` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:08:22.230996 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b2097d-16fc-4016-8911-d131f070221f None admin] PATH_INFO: `/v3/projects/dcf8f891cf3f421da99510eb1a74b563` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:08:22.232302 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85b2097d-16fc-4016-8911-d131f070221f None admin] RBAC: Authorizing `identity:get_project(project_id=dcf8f891cf3f421da99510eb1a74b563)` {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:08:22.233952 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85b2097d-16fc-4016-8911-d131f070221f None admin] RBAC: Authorization granted {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:08:22.235759 dv-cinder-851351-1-smb devstack@keystone.service[416294]: [pid: 416294|app: 0|req: 606/1199] 10.222.0.42 () {56 vars in 1186 bytes} [Thu Jul 28 09:08:22 2022] GET /identity/v3/projects/dcf8f891cf3f421da99510eb1a74b563 => generated 361 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:08:22.242515 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73cb9839-bf71-401c-988e-ac3f533d74cf None admin] Authenticating user token {{(pid=416293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:08:22.364123 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73cb9839-bf71-401c-988e-ac3f533d74cf None admin] Validating token access rules against request {{(pid=416293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:08:22.404834 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce561a3-ec20-4cb1-a2d4-82171b5c6a09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:08:22.405550 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce561a3-ec20-4cb1-a2d4-82171b5c6a09 None admin] REQUEST_METHOD: `GET` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:08:22.405881 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce561a3-ec20-4cb1-a2d4-82171b5c6a09 None admin] SCRIPT_NAME: `/identity` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:08:22.406208 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce561a3-ec20-4cb1-a2d4-82171b5c6a09 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:08:22.407076 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce561a3-ec20-4cb1-a2d4-82171b5c6a09 None admin] RBAC: Adding query filter params (role.id=c67085ec338243df8f9b7d6459036e23, scope.project.id=dcf8f891cf3f421da99510eb1a74b563, user.id=802b9e917ace47babdd2d57a0bf5ce07) {{(pid=416293) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 09:08:22.407428 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce561a3-ec20-4cb1-a2d4-82171b5c6a09 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:08:22.409040 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce561a3-ec20-4cb1-a2d4-82171b5c6a09 None admin] RBAC: Authorization granted {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:08:22.416053 dv-cinder-851351-1-smb devstack@keystone.service[416293]: [pid: 416293|app: 0|req: 594/1200] 10.222.0.42 () {56 vars in 1374 bytes} [Thu Jul 28 09:08:22 2022] GET /identity/v3/role_assignments?user.id=802b9e917ace47babdd2d57a0bf5ce07&scope.project.id=dcf8f891cf3f421da99510eb1a74b563&role.id=c67085ec338243df8f9b7d6459036e23 => generated 608 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:08:32.224775 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG dbcounter [-] [416294] Writing DB stats keystone:SELECT=42 {{(pid=416294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:08:32.412943 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG dbcounter [-] [416293] Writing DB stats keystone:SELECT=74 {{(pid=416293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:09:21.725900 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d612175-033a-4fd0-8f32-fb4152e575ab None None] REQUEST_METHOD: `GET` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:09:21.726612 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d612175-033a-4fd0-8f32-fb4152e575ab None None] SCRIPT_NAME: `/identity` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:09:21.727232 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d612175-033a-4fd0-8f32-fb4152e575ab None None] PATH_INFO: `/` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:09:21.730082 dv-cinder-851351-1-smb devstack@keystone.service[416294]: [pid: 416294|app: 0|req: 607/1201] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 09:09:21 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 09:09:21.740371 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a6807c-1441-413b-9d7f-75f13b36e7b0 None None] REQUEST_METHOD: `POST` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:09:21.741087 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a6807c-1441-413b-9d7f-75f13b36e7b0 None None] SCRIPT_NAME: `/identity` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:09:21.741537 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a6807c-1441-413b-9d7f-75f13b36e7b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:09:21.781117 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.auth.core [None req-f4a6807c-1441-413b-9d7f-75f13b36e7b0 None None] MFA Rules not processed for user `dbf87abab90e4fdf9e75408f4199918e`. Rule list: `[]` (Enabled: `True`). {{(pid=416293) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 09:09:21.783712 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.fernet_utils [None req-f4a6807c-1441-413b-9d7f-75f13b36e7b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=416293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 09:09:21.955381 dv-cinder-851351-1-smb devstack@keystone.service[416293]: [pid: 416293|app: 0|req: 595/1202] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 09:09:21 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 28 09:09:22.004734 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d612175-033a-4fd0-8f32-fb4152e575ab None None] Authenticating user token {{(pid=416294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:09:22.213433 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d612175-033a-4fd0-8f32-fb4152e575ab None None] Validating token access rules against request {{(pid=416294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:09:22.277504 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7f39f6-5284-40fb-a075-691a75e5fc6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:09:22.278349 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7f39f6-5284-40fb-a075-691a75e5fc6e None admin] REQUEST_METHOD: `GET` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:09:22.278641 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7f39f6-5284-40fb-a075-691a75e5fc6e None admin] SCRIPT_NAME: `/identity` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:09:22.279086 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7f39f6-5284-40fb-a075-691a75e5fc6e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:09:22.294963 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc7f39f6-5284-40fb-a075-691a75e5fc6e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:09:22.296762 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc7f39f6-5284-40fb-a075-691a75e5fc6e None admin] RBAC: Authorization granted {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:09:22.327736 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application [None req-cc7f39f6-5284-40fb-a075-691a75e5fc6e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 09:09:22.327736 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 09:09:22.327736 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 09:09:22.327736 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 09:09:22.327736 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 09:09:22.327736 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 09:09:22.327736 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 09:09:22.327736 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 09:09:22.327736 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 09:09:22.327736 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 09:09:22.327736 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 09:09:22.327736 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 09:09:22.327736 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 09:09:22.327736 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 09:09:22.327736 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 09:09:22.328994 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 09:09:22.328994 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 09:09:22.328994 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 09:09:22.328994 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 09:09:22.328994 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 09:09:22.328994 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 09:09:22.328994 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 09:09:22.328994 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 09:09:22.328994 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application with Lock( Jul 28 09:09:22.328994 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 09:09:22.328994 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return self._enter() Jul 28 09:09:22.328994 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 09:09:22.328994 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 09:09:22.328994 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 09:09:22.328994 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return self.creator() Jul 28 09:09:22.328994 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 09:09:22.328994 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application created_value = creator( Jul 28 09:09:22.330101 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 09:09:22.330101 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 09:09:22.330101 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 09:09:22.330101 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application Jul 28 09:09:22.330101 dv-cinder-851351-1-smb devstack@keystone.service[416294]: [pid: 416294|app: 0|req: 608/1203] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 09:09:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 326 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 09:09:22.338823 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a6807c-1441-413b-9d7f-75f13b36e7b0 None None] Authenticating user token {{(pid=416293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:09:22.503131 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a6807c-1441-413b-9d7f-75f13b36e7b0 None None] Validating token access rules against request {{(pid=416293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:09:22.553424 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG dbcounter [-] [416293] Writing DB stats keystone:SELECT=100 {{(pid=416293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:09:22.561706 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6285a77-c272-4894-8651-c9a8b4f9f7ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:09:22.562361 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6285a77-c272-4894-8651-c9a8b4f9f7ea None admin] REQUEST_METHOD: `GET` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:09:22.562649 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6285a77-c272-4894-8651-c9a8b4f9f7ea None admin] SCRIPT_NAME: `/identity` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:09:22.562931 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6285a77-c272-4894-8651-c9a8b4f9f7ea None admin] PATH_INFO: `/v3/domains` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:09:22.563658 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6285a77-c272-4894-8651-c9a8b4f9f7ea None admin] RBAC: Adding query filter params (name=Default) {{(pid=416293) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 09:09:22.563970 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6285a77-c272-4894-8651-c9a8b4f9f7ea None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:09:22.565655 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6285a77-c272-4894-8651-c9a8b4f9f7ea None admin] RBAC: Authorization granted {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:09:22.583882 dv-cinder-851351-1-smb devstack@keystone.service[416293]: [pid: 416293|app: 0|req: 596/1204] 10.222.0.42 () {56 vars in 1109 bytes} [Thu Jul 28 09:09:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 09:09:22.594323 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7f39f6-5284-40fb-a075-691a75e5fc6e None admin] Authenticating user token {{(pid=416294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:09:22.682800 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG dbcounter [-] [416294] Writing DB stats keystone:SELECT=100 {{(pid=416294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:09:22.755272 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7f39f6-5284-40fb-a075-691a75e5fc6e None admin] Validating token access rules against request {{(pid=416294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:09:22.810611 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44578c09-6103-4981-8cca-580ba6a28871 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:09:22.811501 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44578c09-6103-4981-8cca-580ba6a28871 None admin] REQUEST_METHOD: `POST` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:09:22.811930 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44578c09-6103-4981-8cca-580ba6a28871 None admin] SCRIPT_NAME: `/identity` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:09:22.812355 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44578c09-6103-4981-8cca-580ba6a28871 None admin] PATH_INFO: `/v3/users` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:09:22.813495 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44578c09-6103-4981-8cca-580ba6a28871 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:09:22.815916 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44578c09-6103-4981-8cca-580ba6a28871 None admin] RBAC: Authorization granted {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:09:22.857851 dv-cinder-851351-1-smb devstack@keystone.service[416294]: [pid: 416294|app: 0|req: 609/1205] 10.222.0.42 () {60 vars in 1132 bytes} [Thu Jul 28 09:09:22 2022] POST /identity/v3/users => generated 251 bytes in 265 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 09:09:25.273426 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71866bcb-ae75-4dfa-a71f-e201d25a4719 None None] REQUEST_METHOD: `GET` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:09:25.274411 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71866bcb-ae75-4dfa-a71f-e201d25a4719 None None] SCRIPT_NAME: `/identity` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:09:25.274411 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71866bcb-ae75-4dfa-a71f-e201d25a4719 None None] PATH_INFO: `/` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:09:25.275676 dv-cinder-851351-1-smb devstack@keystone.service[416293]: [pid: 416293|app: 0|req: 597/1206] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 09:09:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 09:09:25.282932 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e751c1-ecea-42bb-945a-3578951a7997 None None] REQUEST_METHOD: `POST` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:09:25.283828 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e751c1-ecea-42bb-945a-3578951a7997 None None] SCRIPT_NAME: `/identity` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:09:25.284578 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e751c1-ecea-42bb-945a-3578951a7997 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:09:25.321487 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.auth.core [None req-e0e751c1-ecea-42bb-945a-3578951a7997 None None] MFA Rules not processed for user `dbf87abab90e4fdf9e75408f4199918e`. Rule list: `[]` (Enabled: `True`). {{(pid=416294) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 09:09:25.324092 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.fernet_utils [None req-e0e751c1-ecea-42bb-945a-3578951a7997 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=416294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 09:09:25.464548 dv-cinder-851351-1-smb devstack@keystone.service[416294]: [pid: 416294|app: 0|req: 610/1207] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 09:09:25 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 09:09:25.508098 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71866bcb-ae75-4dfa-a71f-e201d25a4719 None None] Authenticating user token {{(pid=416293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:09:25.730778 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71866bcb-ae75-4dfa-a71f-e201d25a4719 None None] Validating token access rules against request {{(pid=416293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:09:25.781206 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2851dc4-e3d6-4d36-a385-f9e8e365036d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:09:25.782247 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2851dc4-e3d6-4d36-a385-f9e8e365036d None admin] REQUEST_METHOD: `GET` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:09:25.782622 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2851dc4-e3d6-4d36-a385-f9e8e365036d None admin] SCRIPT_NAME: `/identity` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:09:25.782916 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2851dc4-e3d6-4d36-a385-f9e8e365036d None admin] PATH_INFO: `/v3/roles/service` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:09:25.799704 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2851dc4-e3d6-4d36-a385-f9e8e365036d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 09:09:25.807053 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application [None req-e2851dc4-e3d6-4d36-a385-f9e8e365036d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 28 09:09:25.807053 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 09:09:25.807053 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 09:09:25.807053 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 09:09:25.807053 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 09:09:25.807053 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 09:09:25.807053 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 09:09:25.807053 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 09:09:25.807053 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 09:09:25.807053 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 09:09:25.807053 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 09:09:25.807053 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 09:09:25.807053 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 09:09:25.807053 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 09:09:25.807053 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 09:09:25.807053 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 09:09:25.808947 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 09:09:25.808947 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 09:09:25.808947 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 09:09:25.808947 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 09:09:25.808947 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 09:09:25.808947 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 09:09:25.808947 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 09:09:25.808947 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 09:09:25.808947 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 09:09:25.808947 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 09:09:25.808947 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 09:09:25.808947 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application with Lock( Jul 28 09:09:25.808947 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 09:09:25.808947 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self._enter() Jul 28 09:09:25.808947 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 09:09:25.808947 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 09:09:25.811404 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 09:09:25.811404 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self.creator() Jul 28 09:09:25.811404 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 09:09:25.811404 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application created_value = creator( Jul 28 09:09:25.811404 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 09:09:25.811404 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 09:09:25.811404 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 09:09:25.811404 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 09:09:25.811404 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 09:09:25.811404 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 09:09:25.811404 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 28 09:09:25.811404 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application Jul 28 09:09:25.811404 dv-cinder-851351-1-smb devstack@keystone.service[416293]: [pid: 416293|app: 0|req: 598/1208] 10.222.0.42 () {56 vars in 1102 bytes} [Thu Jul 28 09:09:25 2022] GET /identity/v3/roles/service => generated 85 bytes in 302 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 09:09:25.815967 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e751c1-ecea-42bb-945a-3578951a7997 None None] Authenticating user token {{(pid=416294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:09:25.892244 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG dbcounter [-] [416294] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=416294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:09:26.014026 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e751c1-ecea-42bb-945a-3578951a7997 None None] Validating token access rules against request {{(pid=416294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:09:26.081356 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000f82e1-7cb5-4b2d-b7dd-2c99bcd056ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:09:26.082203 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000f82e1-7cb5-4b2d-b7dd-2c99bcd056ad None admin] REQUEST_METHOD: `GET` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:09:26.082612 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000f82e1-7cb5-4b2d-b7dd-2c99bcd056ad None admin] SCRIPT_NAME: `/identity` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:09:26.083022 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000f82e1-7cb5-4b2d-b7dd-2c99bcd056ad None admin] PATH_INFO: `/v3/roles` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:09:26.083909 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-000f82e1-7cb5-4b2d-b7dd-2c99bcd056ad None admin] RBAC: Adding query filter params (name=service) {{(pid=416294) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 09:09:26.084342 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-000f82e1-7cb5-4b2d-b7dd-2c99bcd056ad None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:09:26.086564 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-000f82e1-7cb5-4b2d-b7dd-2c99bcd056ad None admin] RBAC: Authorization granted {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:09:26.103120 dv-cinder-851351-1-smb devstack@keystone.service[416294]: [pid: 416294|app: 0|req: 611/1209] 10.222.0.42 () {56 vars in 1103 bytes} [Thu Jul 28 09:09:25 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 288 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:09:26.111940 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2851dc4-e3d6-4d36-a385-f9e8e365036d None admin] Authenticating user token {{(pid=416293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:09:26.202497 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG dbcounter [-] [416293] Writing DB stats keystone:SELECT=100 {{(pid=416293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:09:26.327266 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2851dc4-e3d6-4d36-a385-f9e8e365036d None admin] Validating token access rules against request {{(pid=416293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:09:26.401655 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a974d15-804f-400a-b098-d6fe05cd2923 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:09:26.402777 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a974d15-804f-400a-b098-d6fe05cd2923 None admin] REQUEST_METHOD: `GET` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:09:26.403349 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a974d15-804f-400a-b098-d6fe05cd2923 None admin] SCRIPT_NAME: `/identity` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:09:26.403831 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a974d15-804f-400a-b098-d6fe05cd2923 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:09:26.431255 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a974d15-804f-400a-b098-d6fe05cd2923 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:09:26.437512 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a974d15-804f-400a-b098-d6fe05cd2923 None admin] RBAC: Authorization granted {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:09:26.463716 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application [None req-4a974d15-804f-400a-b098-d6fe05cd2923 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 09:09:26.463716 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 09:09:26.463716 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 09:09:26.463716 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 09:09:26.463716 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 09:09:26.463716 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 09:09:26.463716 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 09:09:26.463716 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 09:09:26.463716 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 09:09:26.463716 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 09:09:26.463716 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 09:09:26.463716 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 09:09:26.463716 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 09:09:26.463716 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 09:09:26.463716 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 09:09:26.469657 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 09:09:26.469657 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 09:09:26.469657 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 09:09:26.469657 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 09:09:26.469657 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 09:09:26.469657 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 09:09:26.469657 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 09:09:26.469657 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 09:09:26.469657 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application with Lock( Jul 28 09:09:26.469657 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 09:09:26.469657 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self._enter() Jul 28 09:09:26.469657 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 09:09:26.469657 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 09:09:26.469657 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 09:09:26.469657 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self.creator() Jul 28 09:09:26.469657 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 09:09:26.469657 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application created_value = creator( Jul 28 09:09:26.471069 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 09:09:26.471069 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 09:09:26.471069 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 09:09:26.471069 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application Jul 28 09:09:26.471069 dv-cinder-851351-1-smb devstack@keystone.service[416293]: [pid: 416293|app: 0|req: 599/1210] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 09:09:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 354 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 09:09:26.476765 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000f82e1-7cb5-4b2d-b7dd-2c99bcd056ad None admin] Authenticating user token {{(pid=416294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:09:26.667663 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG dbcounter [-] [416294] Writing DB stats keystone:SELECT=100 {{(pid=416294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:09:26.672384 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000f82e1-7cb5-4b2d-b7dd-2c99bcd056ad None admin] Validating token access rules against request {{(pid=416294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:09:26.728843 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3edb2339-cbdf-4099-a187-fd9c02e6f1d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:09:26.729695 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3edb2339-cbdf-4099-a187-fd9c02e6f1d4 None admin] REQUEST_METHOD: `GET` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:09:26.730087 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3edb2339-cbdf-4099-a187-fd9c02e6f1d4 None admin] SCRIPT_NAME: `/identity` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:09:26.730657 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3edb2339-cbdf-4099-a187-fd9c02e6f1d4 None admin] PATH_INFO: `/v3/domains` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:09:26.731927 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3edb2339-cbdf-4099-a187-fd9c02e6f1d4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=416294) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 09:09:26.732429 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3edb2339-cbdf-4099-a187-fd9c02e6f1d4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:09:26.734445 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3edb2339-cbdf-4099-a187-fd9c02e6f1d4 None admin] RBAC: Authorization granted {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:09:26.754884 dv-cinder-851351-1-smb devstack@keystone.service[416294]: [pid: 416294|app: 0|req: 612/1211] 10.222.0.42 () {56 vars in 1109 bytes} [Thu Jul 28 09:09:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 281 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 09:09:26.762298 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a974d15-804f-400a-b098-d6fe05cd2923 None admin] Authenticating user token {{(pid=416293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:09:26.929468 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a974d15-804f-400a-b098-d6fe05cd2923 None admin] Validating token access rules against request {{(pid=416293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:09:26.931753 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG dbcounter [-] [416293] Writing DB stats keystone:SELECT=100 {{(pid=416293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:09:26.992792 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554be897-9d05-413c-be77-bbcb1376bb8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:09:26.993996 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554be897-9d05-413c-be77-bbcb1376bb8a None admin] REQUEST_METHOD: `GET` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:09:26.994506 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554be897-9d05-413c-be77-bbcb1376bb8a None admin] SCRIPT_NAME: `/identity` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:09:26.994889 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554be897-9d05-413c-be77-bbcb1376bb8a None admin] PATH_INFO: `/v3/users/placement` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:09:27.010892 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-554be897-9d05-413c-be77-bbcb1376bb8a None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:09:27.013518 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-554be897-9d05-413c-be77-bbcb1376bb8a None admin] RBAC: Authorization granted {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:09:27.037717 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application [None req-554be897-9d05-413c-be77-bbcb1376bb8a None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 28 09:09:27.037717 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 09:09:27.037717 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 09:09:27.037717 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 09:09:27.037717 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 09:09:27.037717 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 09:09:27.037717 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 09:09:27.037717 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 09:09:27.037717 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 09:09:27.037717 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 09:09:27.037717 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 09:09:27.037717 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 09:09:27.037717 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 28 09:09:27.037717 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 28 09:09:27.037717 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 28 09:09:27.037717 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 28 09:09:27.039329 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 09:09:27.039329 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 09:09:27.039329 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 28 09:09:27.039329 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 09:09:27.039329 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 28 09:09:27.039329 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 09:09:27.039329 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 09:09:27.039329 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 09:09:27.039329 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 09:09:27.039329 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 09:09:27.039329 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 09:09:27.039329 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application with Lock( Jul 28 09:09:27.039329 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 09:09:27.039329 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self._enter() Jul 28 09:09:27.039329 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 09:09:27.039329 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 09:09:27.039329 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 09:09:27.039329 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self.creator() Jul 28 09:09:27.041090 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 09:09:27.041090 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application created_value = creator( Jul 28 09:09:27.041090 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 28 09:09:27.041090 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 28 09:09:27.041090 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 28 09:09:27.041090 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 28 09:09:27.041090 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 28 09:09:27.041090 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 28 09:09:27.041090 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 28 09:09:27.041090 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application Jul 28 09:09:27.041090 dv-cinder-851351-1-smb devstack@keystone.service[416293]: [pid: 416293|app: 0|req: 600/1212] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 09:09:26 2022] GET /identity/v3/users/placement => generated 87 bytes in 279 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 09:09:27.048139 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3edb2339-cbdf-4099-a187-fd9c02e6f1d4 None admin] Authenticating user token {{(pid=416294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:09:27.207937 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3edb2339-cbdf-4099-a187-fd9c02e6f1d4 None admin] Validating token access rules against request {{(pid=416294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:09:27.248957 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a83cb9-8db5-42ce-b14a-b6f8bedf199e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:09:27.249592 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a83cb9-8db5-42ce-b14a-b6f8bedf199e None admin] REQUEST_METHOD: `GET` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:09:27.249871 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a83cb9-8db5-42ce-b14a-b6f8bedf199e None admin] SCRIPT_NAME: `/identity` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:09:27.250141 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a83cb9-8db5-42ce-b14a-b6f8bedf199e None admin] PATH_INFO: `/v3/users` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:09:27.250957 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88a83cb9-8db5-42ce-b14a-b6f8bedf199e None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=416294) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 09:09:27.251265 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88a83cb9-8db5-42ce-b14a-b6f8bedf199e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:09:27.252732 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88a83cb9-8db5-42ce-b14a-b6f8bedf199e None admin] RBAC: Authorization granted {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:09:27.273636 dv-cinder-851351-1-smb devstack@keystone.service[416294]: [pid: 416294|app: 0|req: 613/1213] 10.222.0.42 () {56 vars in 1143 bytes} [Thu Jul 28 09:09:27 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 09:09:27.280650 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554be897-9d05-413c-be77-bbcb1376bb8a None admin] Authenticating user token {{(pid=416293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:09:27.436789 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554be897-9d05-413c-be77-bbcb1376bb8a None admin] Validating token access rules against request {{(pid=416293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:09:27.488762 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc19ffb-f6fd-440d-9466-e9f3a734b3be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:09:27.489629 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc19ffb-f6fd-440d-9466-e9f3a734b3be None admin] REQUEST_METHOD: `GET` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:09:27.490012 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc19ffb-f6fd-440d-9466-e9f3a734b3be None admin] SCRIPT_NAME: `/identity` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:09:27.490638 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc19ffb-f6fd-440d-9466-e9f3a734b3be None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:09:27.536966 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG dbcounter [-] [416293] Writing DB stats keystone:SELECT=100 {{(pid=416293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:09:27.588423 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcc19ffb-f6fd-440d-9466-e9f3a734b3be None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:09:27.590641 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcc19ffb-f6fd-440d-9466-e9f3a734b3be None admin] RBAC: Authorization granted {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:09:27.731130 dv-cinder-851351-1-smb devstack@keystone.service[416293]: [pid: 416293|app: 0|req: 601/1214] 10.222.0.42 () {58 vars in 1282 bytes} [Thu Jul 28 09:09:27 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 451 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 28 09:09:27.739593 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a83cb9-8db5-42ce-b14a-b6f8bedf199e None admin] Authenticating user token {{(pid=416294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:09:27.769831 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG dbcounter [-] [416294] Writing DB stats keystone:SELECT=100 {{(pid=416294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:09:27.915520 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a83cb9-8db5-42ce-b14a-b6f8bedf199e None admin] Validating token access rules against request {{(pid=416294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:09:27.967212 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a3009d-0763-40ae-bdc5-4467a9e3e0fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:09:27.969014 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a3009d-0763-40ae-bdc5-4467a9e3e0fb None admin] REQUEST_METHOD: `GET` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:09:27.969176 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a3009d-0763-40ae-bdc5-4467a9e3e0fb None admin] SCRIPT_NAME: `/identity` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:09:27.969613 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a3009d-0763-40ae-bdc5-4467a9e3e0fb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:09:27.990328 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a3009d-0763-40ae-bdc5-4467a9e3e0fb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:09:27.992859 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a3009d-0763-40ae-bdc5-4467a9e3e0fb None admin] RBAC: Authorization granted {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:09:28.020313 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application [None req-42a3009d-0763-40ae-bdc5-4467a9e3e0fb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 09:09:28.020313 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 09:09:28.020313 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 09:09:28.020313 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 09:09:28.020313 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 09:09:28.020313 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 09:09:28.020313 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 09:09:28.020313 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 09:09:28.020313 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 09:09:28.020313 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 09:09:28.020313 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 09:09:28.020313 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 09:09:28.020313 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 09:09:28.020313 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 09:09:28.020313 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 09:09:28.022717 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 09:09:28.022717 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 09:09:28.022717 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 09:09:28.022717 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 09:09:28.022717 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 09:09:28.022717 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 09:09:28.022717 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 09:09:28.022717 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 09:09:28.022717 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application with Lock( Jul 28 09:09:28.022717 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 09:09:28.022717 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return self._enter() Jul 28 09:09:28.022717 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 09:09:28.022717 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 09:09:28.022717 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 09:09:28.022717 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return self.creator() Jul 28 09:09:28.022717 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 09:09:28.022717 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application created_value = creator( Jul 28 09:09:28.024561 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 09:09:28.024561 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 09:09:28.024561 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 09:09:28.024561 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application Jul 28 09:09:28.024561 dv-cinder-851351-1-smb devstack@keystone.service[416294]: [pid: 416294|app: 0|req: 614/1215] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 09:09:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 284 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 09:09:28.028942 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc19ffb-f6fd-440d-9466-e9f3a734b3be None admin] Authenticating user token {{(pid=416293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:09:28.129535 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG dbcounter [-] [416293] Writing DB stats keystone:SELECT=100 {{(pid=416293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:09:28.189881 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc19ffb-f6fd-440d-9466-e9f3a734b3be None admin] Validating token access rules against request {{(pid=416293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:09:28.238239 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ab4f39-96d5-44c1-aff7-d1411764c084 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:09:28.239231 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ab4f39-96d5-44c1-aff7-d1411764c084 None admin] REQUEST_METHOD: `GET` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:09:28.239682 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ab4f39-96d5-44c1-aff7-d1411764c084 None admin] SCRIPT_NAME: `/identity` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:09:28.240238 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ab4f39-96d5-44c1-aff7-d1411764c084 None admin] PATH_INFO: `/v3/domains` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:09:28.241512 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33ab4f39-96d5-44c1-aff7-d1411764c084 None admin] RBAC: Adding query filter params (name=Default) {{(pid=416293) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 09:09:28.241909 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33ab4f39-96d5-44c1-aff7-d1411764c084 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:09:28.243724 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33ab4f39-96d5-44c1-aff7-d1411764c084 None admin] RBAC: Authorization granted {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:09:28.261277 dv-cinder-851351-1-smb devstack@keystone.service[416293]: [pid: 416293|app: 0|req: 602/1216] 10.222.0.42 () {56 vars in 1109 bytes} [Thu Jul 28 09:09:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:09:28.270645 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a3009d-0763-40ae-bdc5-4467a9e3e0fb None admin] Authenticating user token {{(pid=416294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:09:28.377968 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG dbcounter [-] [416294] Writing DB stats keystone:SELECT=100 {{(pid=416294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:09:28.420865 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a3009d-0763-40ae-bdc5-4467a9e3e0fb None admin] Validating token access rules against request {{(pid=416294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:09:28.478643 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34688e32-1644-4632-9384-64116cb201e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:09:28.479664 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34688e32-1644-4632-9384-64116cb201e5 None admin] REQUEST_METHOD: `GET` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:09:28.480051 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34688e32-1644-4632-9384-64116cb201e5 None admin] SCRIPT_NAME: `/identity` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:09:28.480429 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34688e32-1644-4632-9384-64116cb201e5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:09:28.490146 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34688e32-1644-4632-9384-64116cb201e5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:09:28.492246 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34688e32-1644-4632-9384-64116cb201e5 None admin] RBAC: Authorization granted {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:09:28.506723 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application [None req-34688e32-1644-4632-9384-64116cb201e5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 09:09:28.506723 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 09:09:28.506723 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 09:09:28.506723 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 09:09:28.506723 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 09:09:28.506723 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 09:09:28.506723 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 09:09:28.506723 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 09:09:28.506723 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 09:09:28.506723 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 09:09:28.506723 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 09:09:28.506723 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 09:09:28.506723 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 28 09:09:28.506723 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 28 09:09:28.506723 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 28 09:09:28.510509 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 28 09:09:28.510509 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 09:09:28.510509 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 09:09:28.510509 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 09:09:28.510509 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 09:09:28.510509 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 09:09:28.510509 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 09:09:28.510509 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 09:09:28.510509 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application with Lock( Jul 28 09:09:28.510509 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 09:09:28.510509 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return self._enter() Jul 28 09:09:28.510509 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 09:09:28.510509 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 09:09:28.510509 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 09:09:28.510509 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return self.creator() Jul 28 09:09:28.510509 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 09:09:28.510509 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application created_value = creator( Jul 28 09:09:28.512750 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 28 09:09:28.512750 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 28 09:09:28.512750 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 28 09:09:28.512750 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 28 09:09:28.512750 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 28 09:09:28.512750 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 28 09:09:28.512750 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 09:09:28.512750 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application Jul 28 09:09:28.512750 dv-cinder-851351-1-smb devstack@keystone.service[416294]: [pid: 416294|app: 0|req: 615/1217] 10.222.0.42 () {56 vars in 1111 bytes} [Thu Jul 28 09:09:28 2022] GET /identity/v3/projects/service => generated 88 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 09:09:28.517279 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ab4f39-96d5-44c1-aff7-d1411764c084 None admin] Authenticating user token {{(pid=416293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:09:28.670889 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ab4f39-96d5-44c1-aff7-d1411764c084 None admin] Validating token access rules against request {{(pid=416293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:09:28.699453 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG dbcounter [-] [416293] Writing DB stats keystone:SELECT=100 {{(pid=416293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:09:28.716518 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b940db6-87f2-4d11-9e0b-c9a2e6270818 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:09:28.717620 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b940db6-87f2-4d11-9e0b-c9a2e6270818 None admin] REQUEST_METHOD: `GET` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:09:28.718048 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b940db6-87f2-4d11-9e0b-c9a2e6270818 None admin] SCRIPT_NAME: `/identity` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:09:28.718575 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b940db6-87f2-4d11-9e0b-c9a2e6270818 None admin] PATH_INFO: `/v3/projects` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:09:28.719652 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b940db6-87f2-4d11-9e0b-c9a2e6270818 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=416293) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 09:09:28.720086 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b940db6-87f2-4d11-9e0b-c9a2e6270818 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:09:28.722642 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b940db6-87f2-4d11-9e0b-c9a2e6270818 None admin] RBAC: Authorization granted {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:09:28.741980 dv-cinder-851351-1-smb devstack@keystone.service[416293]: [pid: 416293|app: 0|req: 603/1218] 10.222.0.42 () {56 vars in 1148 bytes} [Thu Jul 28 09:09:28 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:09:28.749530 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34688e32-1644-4632-9384-64116cb201e5 None admin] Authenticating user token {{(pid=416294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:09:28.905101 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34688e32-1644-4632-9384-64116cb201e5 None admin] Validating token access rules against request {{(pid=416294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:09:28.940304 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG dbcounter [-] [416294] Writing DB stats keystone:SELECT=100 {{(pid=416294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:09:28.950113 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b76137-9593-43d3-b5cf-162d9db9759c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:09:28.950834 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b76137-9593-43d3-b5cf-162d9db9759c None admin] REQUEST_METHOD: `GET` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:09:28.951114 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b76137-9593-43d3-b5cf-162d9db9759c None admin] SCRIPT_NAME: `/identity` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:09:28.951460 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b76137-9593-43d3-b5cf-162d9db9759c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:09:28.952312 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4b76137-9593-43d3-b5cf-162d9db9759c None admin] RBAC: Adding query filter params (role.id=13417fbdbc5145a69bc01ff0f931fd96, scope.project.id=6c4349445f224184b093d9dfd0dfc642, user.id=72e6aedb591140ca936b41c52bc0d470) {{(pid=416294) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 09:09:28.952625 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4b76137-9593-43d3-b5cf-162d9db9759c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:09:28.954328 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4b76137-9593-43d3-b5cf-162d9db9759c None admin] RBAC: Authorization granted {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:09:28.964324 dv-cinder-851351-1-smb devstack@keystone.service[416294]: [pid: 416294|app: 0|req: 616/1219] 10.222.0.42 () {56 vars in 1374 bytes} [Thu Jul 28 09:09:28 2022] GET /identity/v3/role_assignments?user.id=72e6aedb591140ca936b41c52bc0d470&scope.project.id=6c4349445f224184b093d9dfd0dfc642&role.id=13417fbdbc5145a69bc01ff0f931fd96 => generated 259 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:09:31.283360 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ba6ea0-5846-490f-907a-e4284a473f56 None None] REQUEST_METHOD: `GET` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:09:31.283921 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ba6ea0-5846-490f-907a-e4284a473f56 None None] SCRIPT_NAME: `/identity` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:09:31.283921 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ba6ea0-5846-490f-907a-e4284a473f56 None None] PATH_INFO: `/` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:09:31.285761 dv-cinder-851351-1-smb devstack@keystone.service[416293]: [pid: 416293|app: 0|req: 604/1220] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 09:09:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 09:09:31.295641 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8367fbbb-f115-4e00-a30e-f01dbe36bd95 None None] REQUEST_METHOD: `POST` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:09:31.295641 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8367fbbb-f115-4e00-a30e-f01dbe36bd95 None None] SCRIPT_NAME: `/identity` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:09:31.295641 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8367fbbb-f115-4e00-a30e-f01dbe36bd95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:09:31.314169 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.auth.core [None req-8367fbbb-f115-4e00-a30e-f01dbe36bd95 None None] MFA Rules not processed for user `dbf87abab90e4fdf9e75408f4199918e`. Rule list: `[]` (Enabled: `True`). {{(pid=416294) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 09:09:31.315486 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.fernet_utils [None req-8367fbbb-f115-4e00-a30e-f01dbe36bd95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=416294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 09:09:31.400078 dv-cinder-851351-1-smb devstack@keystone.service[416294]: [pid: 416294|app: 0|req: 617/1221] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 09:09:31 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 28 09:09:31.429235 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ba6ea0-5846-490f-907a-e4284a473f56 None None] Authenticating user token {{(pid=416293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:09:31.588887 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ba6ea0-5846-490f-907a-e4284a473f56 None None] Validating token access rules against request {{(pid=416293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:09:31.632476 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd981ca-6b22-4a48-9951-4dfe1e318e36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:09:31.633204 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd981ca-6b22-4a48-9951-4dfe1e318e36 None admin] REQUEST_METHOD: `GET` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:09:31.633487 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd981ca-6b22-4a48-9951-4dfe1e318e36 None admin] SCRIPT_NAME: `/identity` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:09:31.633767 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd981ca-6b22-4a48-9951-4dfe1e318e36 None admin] PATH_INFO: `/v3/roles/service` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:09:31.646937 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afd981ca-6b22-4a48-9951-4dfe1e318e36 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 09:09:31.653104 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application [None req-afd981ca-6b22-4a48-9951-4dfe1e318e36 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 28 09:09:31.653104 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 09:09:31.653104 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 09:09:31.653104 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 09:09:31.653104 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 09:09:31.653104 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 09:09:31.653104 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 09:09:31.653104 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 09:09:31.653104 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 09:09:31.653104 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 09:09:31.653104 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 09:09:31.653104 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 09:09:31.653104 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 09:09:31.653104 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 09:09:31.653104 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 09:09:31.653104 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 09:09:31.654416 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 09:09:31.654416 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 09:09:31.654416 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 09:09:31.654416 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 09:09:31.654416 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 09:09:31.654416 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 09:09:31.654416 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 09:09:31.654416 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 09:09:31.654416 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 09:09:31.654416 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 09:09:31.654416 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 09:09:31.654416 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application with Lock( Jul 28 09:09:31.654416 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 09:09:31.654416 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self._enter() Jul 28 09:09:31.654416 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 09:09:31.654416 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 09:09:31.656316 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 09:09:31.656316 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self.creator() Jul 28 09:09:31.656316 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 09:09:31.656316 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application created_value = creator( Jul 28 09:09:31.656316 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 09:09:31.656316 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 09:09:31.656316 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 09:09:31.656316 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 09:09:31.656316 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 09:09:31.656316 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 09:09:31.656316 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 28 09:09:31.656316 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application Jul 28 09:09:31.656316 dv-cinder-851351-1-smb devstack@keystone.service[416293]: [pid: 416293|app: 0|req: 605/1222] 10.222.0.42 () {56 vars in 1102 bytes} [Thu Jul 28 09:09:31 2022] GET /identity/v3/roles/service => generated 85 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 09:09:31.663028 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8367fbbb-f115-4e00-a30e-f01dbe36bd95 None None] Authenticating user token {{(pid=416294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:09:31.836870 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8367fbbb-f115-4e00-a30e-f01dbe36bd95 None None] Validating token access rules against request {{(pid=416294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:09:31.867579 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG dbcounter [-] [416294] Writing DB stats keystone:SELECT=100 {{(pid=416294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:09:31.883178 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be52f2e-e5a9-496e-a07e-ca3a60d6420c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:09:31.884206 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be52f2e-e5a9-496e-a07e-ca3a60d6420c None admin] REQUEST_METHOD: `GET` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:09:31.884768 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be52f2e-e5a9-496e-a07e-ca3a60d6420c None admin] SCRIPT_NAME: `/identity` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:09:31.885259 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be52f2e-e5a9-496e-a07e-ca3a60d6420c None admin] PATH_INFO: `/v3/roles` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:09:31.886702 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6be52f2e-e5a9-496e-a07e-ca3a60d6420c None admin] RBAC: Adding query filter params (name=service) {{(pid=416294) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 09:09:31.887313 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6be52f2e-e5a9-496e-a07e-ca3a60d6420c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:09:31.889043 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6be52f2e-e5a9-496e-a07e-ca3a60d6420c None admin] RBAC: Authorization granted {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:09:31.902794 dv-cinder-851351-1-smb devstack@keystone.service[416294]: [pid: 416294|app: 0|req: 618/1223] 10.222.0.42 () {56 vars in 1103 bytes} [Thu Jul 28 09:09:31 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:09:31.910005 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd981ca-6b22-4a48-9951-4dfe1e318e36 None admin] Authenticating user token {{(pid=416293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:09:31.966076 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG dbcounter [-] [416293] Writing DB stats keystone:SELECT=100 {{(pid=416293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:09:32.064706 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd981ca-6b22-4a48-9951-4dfe1e318e36 None admin] Validating token access rules against request {{(pid=416293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:09:32.107702 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcaf65df-8cb7-4a94-b145-0bcd7854da1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:09:32.108486 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcaf65df-8cb7-4a94-b145-0bcd7854da1f None admin] REQUEST_METHOD: `GET` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:09:32.108903 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcaf65df-8cb7-4a94-b145-0bcd7854da1f None admin] SCRIPT_NAME: `/identity` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:09:32.109183 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcaf65df-8cb7-4a94-b145-0bcd7854da1f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:09:32.124543 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcaf65df-8cb7-4a94-b145-0bcd7854da1f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:09:32.126012 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcaf65df-8cb7-4a94-b145-0bcd7854da1f None admin] RBAC: Authorization granted {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:09:32.147145 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application [None req-bcaf65df-8cb7-4a94-b145-0bcd7854da1f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 09:09:32.147145 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 09:09:32.147145 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 09:09:32.147145 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 09:09:32.147145 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 09:09:32.147145 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 09:09:32.147145 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 09:09:32.147145 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 09:09:32.147145 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 09:09:32.147145 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 09:09:32.147145 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 09:09:32.147145 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 09:09:32.147145 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 09:09:32.147145 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 09:09:32.147145 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 09:09:32.149264 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 09:09:32.149264 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 09:09:32.149264 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 09:09:32.149264 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 09:09:32.149264 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 09:09:32.149264 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 09:09:32.149264 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 09:09:32.149264 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 09:09:32.149264 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application with Lock( Jul 28 09:09:32.149264 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 09:09:32.149264 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self._enter() Jul 28 09:09:32.149264 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 09:09:32.149264 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 09:09:32.149264 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 09:09:32.149264 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self.creator() Jul 28 09:09:32.149264 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 09:09:32.149264 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application created_value = creator( Jul 28 09:09:32.151511 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 09:09:32.151511 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 09:09:32.151511 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 09:09:32.151511 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application Jul 28 09:09:32.151511 dv-cinder-851351-1-smb devstack@keystone.service[416293]: [pid: 416293|app: 0|req: 606/1224] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 09:09:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 09:09:32.156041 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be52f2e-e5a9-496e-a07e-ca3a60d6420c None admin] Authenticating user token {{(pid=416294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:09:32.333796 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be52f2e-e5a9-496e-a07e-ca3a60d6420c None admin] Validating token access rules against request {{(pid=416294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:09:32.375084 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff5e053-018c-43ff-8003-eaba24ae8b44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:09:32.376014 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff5e053-018c-43ff-8003-eaba24ae8b44 None admin] REQUEST_METHOD: `GET` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:09:32.376465 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff5e053-018c-43ff-8003-eaba24ae8b44 None admin] SCRIPT_NAME: `/identity` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:09:32.377033 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff5e053-018c-43ff-8003-eaba24ae8b44 None admin] PATH_INFO: `/v3/domains` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:09:32.377825 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cff5e053-018c-43ff-8003-eaba24ae8b44 None admin] RBAC: Adding query filter params (name=Default) {{(pid=416294) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 09:09:32.378396 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cff5e053-018c-43ff-8003-eaba24ae8b44 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:09:32.379952 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cff5e053-018c-43ff-8003-eaba24ae8b44 None admin] RBAC: Authorization granted {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:09:32.397516 dv-cinder-851351-1-smb devstack@keystone.service[416294]: [pid: 416294|app: 0|req: 619/1225] 10.222.0.42 () {56 vars in 1109 bytes} [Thu Jul 28 09:09:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:09:32.405172 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcaf65df-8cb7-4a94-b145-0bcd7854da1f None admin] Authenticating user token {{(pid=416293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:09:32.537915 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG dbcounter [-] [416293] Writing DB stats keystone:SELECT=100 {{(pid=416293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:09:32.548231 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcaf65df-8cb7-4a94-b145-0bcd7854da1f None admin] Validating token access rules against request {{(pid=416293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:09:32.595746 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80339d87-15a8-49f8-a6cb-18bf3bdaa3c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:09:32.596543 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80339d87-15a8-49f8-a6cb-18bf3bdaa3c5 None admin] REQUEST_METHOD: `GET` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:09:32.597010 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80339d87-15a8-49f8-a6cb-18bf3bdaa3c5 None admin] SCRIPT_NAME: `/identity` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:09:32.597436 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80339d87-15a8-49f8-a6cb-18bf3bdaa3c5 None admin] PATH_INFO: `/v3/users/placement` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:09:32.608387 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80339d87-15a8-49f8-a6cb-18bf3bdaa3c5 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:09:32.610245 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80339d87-15a8-49f8-a6cb-18bf3bdaa3c5 None admin] RBAC: Authorization granted {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:09:32.625351 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application [None req-80339d87-15a8-49f8-a6cb-18bf3bdaa3c5 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 28 09:09:32.625351 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 09:09:32.625351 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 09:09:32.625351 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 09:09:32.625351 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 09:09:32.625351 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 09:09:32.625351 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 09:09:32.625351 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 09:09:32.625351 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 09:09:32.625351 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 09:09:32.625351 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 09:09:32.625351 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 09:09:32.625351 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 28 09:09:32.625351 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 28 09:09:32.625351 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 28 09:09:32.625351 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 28 09:09:32.627494 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 09:09:32.627494 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 09:09:32.627494 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 28 09:09:32.627494 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 09:09:32.627494 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 28 09:09:32.627494 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 09:09:32.627494 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 09:09:32.627494 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 09:09:32.627494 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 09:09:32.627494 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 09:09:32.627494 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 09:09:32.627494 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application with Lock( Jul 28 09:09:32.627494 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 09:09:32.627494 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self._enter() Jul 28 09:09:32.627494 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 09:09:32.627494 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 09:09:32.627494 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 09:09:32.627494 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self.creator() Jul 28 09:09:32.629001 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 09:09:32.629001 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application created_value = creator( Jul 28 09:09:32.629001 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 28 09:09:32.629001 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 28 09:09:32.629001 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 28 09:09:32.629001 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 28 09:09:32.629001 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 28 09:09:32.629001 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 28 09:09:32.629001 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 28 09:09:32.629001 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application Jul 28 09:09:32.629001 dv-cinder-851351-1-smb devstack@keystone.service[416293]: [pid: 416293|app: 0|req: 607/1226] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 09:09:32 2022] GET /identity/v3/users/placement => generated 87 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 09:09:32.633091 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff5e053-018c-43ff-8003-eaba24ae8b44 None admin] Authenticating user token {{(pid=416294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:09:32.692018 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG dbcounter [-] [416294] Writing DB stats keystone:SELECT=100 {{(pid=416294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:09:32.753326 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff5e053-018c-43ff-8003-eaba24ae8b44 None admin] Validating token access rules against request {{(pid=416294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:09:32.800121 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc8beed-6565-437f-8481-fcf4de656657 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:09:32.801346 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc8beed-6565-437f-8481-fcf4de656657 None admin] REQUEST_METHOD: `GET` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:09:32.801646 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc8beed-6565-437f-8481-fcf4de656657 None admin] SCRIPT_NAME: `/identity` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:09:32.802152 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc8beed-6565-437f-8481-fcf4de656657 None admin] PATH_INFO: `/v3/users` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:09:32.803736 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cc8beed-6565-437f-8481-fcf4de656657 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=416294) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 09:09:32.804281 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cc8beed-6565-437f-8481-fcf4de656657 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:09:32.807091 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cc8beed-6565-437f-8481-fcf4de656657 None admin] RBAC: Authorization granted {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:09:32.836637 dv-cinder-851351-1-smb devstack@keystone.service[416294]: [pid: 416294|app: 0|req: 620/1227] 10.222.0.42 () {56 vars in 1143 bytes} [Thu Jul 28 09:09:32 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:09:32.843489 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80339d87-15a8-49f8-a6cb-18bf3bdaa3c5 None admin] Authenticating user token {{(pid=416293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:09:33.000215 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80339d87-15a8-49f8-a6cb-18bf3bdaa3c5 None admin] Validating token access rules against request {{(pid=416293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:09:33.060131 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201de816-f35b-4a63-b1f5-00efd4190c9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:09:33.060895 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201de816-f35b-4a63-b1f5-00efd4190c9a None admin] REQUEST_METHOD: `GET` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:09:33.061173 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201de816-f35b-4a63-b1f5-00efd4190c9a None admin] SCRIPT_NAME: `/identity` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:09:33.061455 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201de816-f35b-4a63-b1f5-00efd4190c9a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:09:33.076928 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-201de816-f35b-4a63-b1f5-00efd4190c9a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:09:33.078597 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-201de816-f35b-4a63-b1f5-00efd4190c9a None admin] RBAC: Authorization granted {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:09:33.096321 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application [None req-201de816-f35b-4a63-b1f5-00efd4190c9a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 09:09:33.096321 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 09:09:33.096321 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 09:09:33.096321 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 09:09:33.096321 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 09:09:33.096321 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 09:09:33.096321 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 09:09:33.096321 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 09:09:33.096321 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 09:09:33.096321 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 09:09:33.096321 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 09:09:33.096321 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 09:09:33.096321 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 09:09:33.096321 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 09:09:33.096321 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 09:09:33.098389 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 09:09:33.098389 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 09:09:33.098389 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 09:09:33.098389 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 09:09:33.098389 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 09:09:33.098389 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 09:09:33.098389 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 09:09:33.098389 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 09:09:33.098389 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application with Lock( Jul 28 09:09:33.098389 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 09:09:33.098389 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self._enter() Jul 28 09:09:33.098389 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 09:09:33.098389 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 09:09:33.098389 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 09:09:33.098389 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self.creator() Jul 28 09:09:33.098389 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 09:09:33.098389 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application created_value = creator( Jul 28 09:09:33.100252 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 09:09:33.100252 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 09:09:33.100252 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 09:09:33.100252 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application Jul 28 09:09:33.100252 dv-cinder-851351-1-smb devstack@keystone.service[416293]: [pid: 416293|app: 0|req: 608/1228] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 09:09:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 255 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 09:09:33.105272 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc8beed-6565-437f-8481-fcf4de656657 None admin] Authenticating user token {{(pid=416294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:09:33.266358 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc8beed-6565-437f-8481-fcf4de656657 None admin] Validating token access rules against request {{(pid=416294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:09:33.269184 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG dbcounter [-] [416294] Writing DB stats keystone:SELECT=100 {{(pid=416294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:09:33.323224 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ac82fb-4df1-4459-8997-02073eb1a7b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:09:33.324315 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ac82fb-4df1-4459-8997-02073eb1a7b4 None admin] REQUEST_METHOD: `GET` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:09:33.324885 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ac82fb-4df1-4459-8997-02073eb1a7b4 None admin] SCRIPT_NAME: `/identity` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:09:33.325408 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ac82fb-4df1-4459-8997-02073eb1a7b4 None admin] PATH_INFO: `/v3/domains` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:09:33.326711 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4ac82fb-4df1-4459-8997-02073eb1a7b4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=416294) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 09:09:33.327260 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4ac82fb-4df1-4459-8997-02073eb1a7b4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:09:33.329981 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4ac82fb-4df1-4459-8997-02073eb1a7b4 None admin] RBAC: Authorization granted {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:09:33.347988 dv-cinder-851351-1-smb devstack@keystone.service[416294]: [pid: 416294|app: 0|req: 621/1229] 10.222.0.42 () {56 vars in 1109 bytes} [Thu Jul 28 09:09:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:09:33.358087 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201de816-f35b-4a63-b1f5-00efd4190c9a None admin] Authenticating user token {{(pid=416293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:09:33.375752 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG dbcounter [-] [416293] Writing DB stats keystone:SELECT=100 {{(pid=416293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:09:33.540872 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201de816-f35b-4a63-b1f5-00efd4190c9a None admin] Validating token access rules against request {{(pid=416293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:09:33.581212 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56fd7814-c939-442b-aa1f-4e4de4f1700a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:09:33.581885 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56fd7814-c939-442b-aa1f-4e4de4f1700a None admin] REQUEST_METHOD: `GET` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:09:33.582167 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56fd7814-c939-442b-aa1f-4e4de4f1700a None admin] SCRIPT_NAME: `/identity` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:09:33.582446 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56fd7814-c939-442b-aa1f-4e4de4f1700a None admin] PATH_INFO: `/v3/projects/service` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:09:33.591360 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56fd7814-c939-442b-aa1f-4e4de4f1700a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:09:33.593152 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56fd7814-c939-442b-aa1f-4e4de4f1700a None admin] RBAC: Authorization granted {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:09:33.607202 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application [None req-56fd7814-c939-442b-aa1f-4e4de4f1700a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 09:09:33.607202 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 09:09:33.607202 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 09:09:33.607202 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 09:09:33.607202 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 09:09:33.607202 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 09:09:33.607202 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 09:09:33.607202 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 09:09:33.607202 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 09:09:33.607202 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 09:09:33.607202 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 09:09:33.607202 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 09:09:33.607202 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 28 09:09:33.607202 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 28 09:09:33.607202 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 28 09:09:33.609197 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 28 09:09:33.609197 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 09:09:33.609197 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 09:09:33.609197 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 09:09:33.609197 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 09:09:33.609197 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 09:09:33.609197 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 09:09:33.609197 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 09:09:33.609197 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application with Lock( Jul 28 09:09:33.609197 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 09:09:33.609197 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self._enter() Jul 28 09:09:33.609197 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 09:09:33.609197 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 09:09:33.609197 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 09:09:33.609197 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self.creator() Jul 28 09:09:33.609197 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 09:09:33.609197 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application created_value = creator( Jul 28 09:09:33.611146 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 28 09:09:33.611146 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 28 09:09:33.611146 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 28 09:09:33.611146 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 28 09:09:33.611146 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 28 09:09:33.611146 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 28 09:09:33.611146 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 09:09:33.611146 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application Jul 28 09:09:33.611146 dv-cinder-851351-1-smb devstack@keystone.service[416293]: [pid: 416293|app: 0|req: 609/1230] 10.222.0.42 () {56 vars in 1111 bytes} [Thu Jul 28 09:09:33 2022] GET /identity/v3/projects/service => generated 88 bytes in 252 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 09:09:33.616957 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ac82fb-4df1-4459-8997-02073eb1a7b4 None admin] Authenticating user token {{(pid=416294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:09:33.761810 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ac82fb-4df1-4459-8997-02073eb1a7b4 None admin] Validating token access rules against request {{(pid=416294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:09:33.809694 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-367c7ab5-157c-4c75-9b4b-b8814f72777e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:09:33.810562 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367c7ab5-157c-4c75-9b4b-b8814f72777e None admin] REQUEST_METHOD: `GET` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:09:33.811021 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367c7ab5-157c-4c75-9b4b-b8814f72777e None admin] SCRIPT_NAME: `/identity` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:09:33.811449 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367c7ab5-157c-4c75-9b4b-b8814f72777e None admin] PATH_INFO: `/v3/projects` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:09:33.812565 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-367c7ab5-157c-4c75-9b4b-b8814f72777e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=416294) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 09:09:33.813086 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-367c7ab5-157c-4c75-9b4b-b8814f72777e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:09:33.815200 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-367c7ab5-157c-4c75-9b4b-b8814f72777e None admin] RBAC: Authorization granted {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:09:33.831401 dv-cinder-851351-1-smb devstack@keystone.service[416294]: [pid: 416294|app: 0|req: 622/1231] 10.222.0.42 () {56 vars in 1148 bytes} [Thu Jul 28 09:09:33 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 09:09:33.838942 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56fd7814-c939-442b-aa1f-4e4de4f1700a None admin] Authenticating user token {{(pid=416293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:09:33.952144 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG dbcounter [-] [416293] Writing DB stats keystone:SELECT=100 {{(pid=416293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:09:34.014620 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56fd7814-c939-442b-aa1f-4e4de4f1700a None admin] Validating token access rules against request {{(pid=416293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:09:34.065869 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542051f4-816f-4ea3-acf0-c54924f5c194 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:09:34.066942 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542051f4-816f-4ea3-acf0-c54924f5c194 None admin] REQUEST_METHOD: `PUT` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:09:34.067437 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542051f4-816f-4ea3-acf0-c54924f5c194 None admin] SCRIPT_NAME: `/identity` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:09:34.067900 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542051f4-816f-4ea3-acf0-c54924f5c194 None admin] PATH_INFO: `/v3/projects/6c4349445f224184b093d9dfd0dfc642/users/72e6aedb591140ca936b41c52bc0d470/roles/13417fbdbc5145a69bc01ff0f931fd96` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:09:34.087162 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-542051f4-816f-4ea3-acf0-c54924f5c194 None admin] RBAC: Authorizing `identity:create_grant(project_id=6c4349445f224184b093d9dfd0dfc642, user_id=72e6aedb591140ca936b41c52bc0d470, role_id=13417fbdbc5145a69bc01ff0f931fd96)` {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:09:34.088844 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-542051f4-816f-4ea3-acf0-c54924f5c194 None admin] RBAC: Authorization granted {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:09:34.106867 dv-cinder-851351-1-smb devstack@keystone.service[416293]: [pid: 416293|app: 0|req: 610/1232] 10.222.0.42 () {58 vars in 1439 bytes} [Thu Jul 28 09:09:33 2022] PUT /identity/v3/projects/6c4349445f224184b093d9dfd0dfc642/users/72e6aedb591140ca936b41c52bc0d470/roles/13417fbdbc5145a69bc01ff0f931fd96 => generated 0 bytes in 269 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 09:09:36.433894 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a13850-1eb3-450e-b3c6-157dde99e99d None None] REQUEST_METHOD: `GET` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:09:36.435097 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a13850-1eb3-450e-b3c6-157dde99e99d None None] SCRIPT_NAME: `/identity` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:09:36.435097 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a13850-1eb3-450e-b3c6-157dde99e99d None None] PATH_INFO: `/` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:09:36.437445 dv-cinder-851351-1-smb devstack@keystone.service[416294]: [pid: 416294|app: 0|req: 623/1233] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 09:09:36 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 09:09:36.444953 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cece7ec8-102c-4c39-a4a0-7ef61c70df83 None None] REQUEST_METHOD: `POST` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:09:36.445735 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cece7ec8-102c-4c39-a4a0-7ef61c70df83 None None] SCRIPT_NAME: `/identity` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:09:36.445962 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cece7ec8-102c-4c39-a4a0-7ef61c70df83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:09:36.470138 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.auth.core [None req-cece7ec8-102c-4c39-a4a0-7ef61c70df83 None None] MFA Rules not processed for user `dbf87abab90e4fdf9e75408f4199918e`. Rule list: `[]` (Enabled: `True`). {{(pid=416293) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 09:09:36.471410 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.fernet_utils [None req-cece7ec8-102c-4c39-a4a0-7ef61c70df83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=416293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 09:09:36.564995 dv-cinder-851351-1-smb devstack@keystone.service[416293]: [pid: 416293|app: 0|req: 611/1234] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 09:09:36 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 09:09:36.608531 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a13850-1eb3-450e-b3c6-157dde99e99d None None] Authenticating user token {{(pid=416294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:09:36.643480 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG dbcounter [-] [416294] Writing DB stats keystone:SELECT=100 {{(pid=416294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:09:36.778692 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a13850-1eb3-450e-b3c6-157dde99e99d None None] Validating token access rules against request {{(pid=416294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:09:36.836139 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71b925d-d077-47b8-b458-01152bc1f786 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:09:36.836915 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71b925d-d077-47b8-b458-01152bc1f786 None admin] REQUEST_METHOD: `GET` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:09:36.837390 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71b925d-d077-47b8-b458-01152bc1f786 None admin] SCRIPT_NAME: `/identity` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:09:36.837788 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71b925d-d077-47b8-b458-01152bc1f786 None admin] PATH_INFO: `/v3/roles/service` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:09:36.850734 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b71b925d-d077-47b8-b458-01152bc1f786 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 09:09:36.855947 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application [None req-b71b925d-d077-47b8-b458-01152bc1f786 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 28 09:09:36.855947 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 09:09:36.855947 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 09:09:36.855947 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 09:09:36.855947 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 09:09:36.855947 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 09:09:36.855947 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 09:09:36.855947 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 09:09:36.855947 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 09:09:36.855947 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 09:09:36.855947 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 09:09:36.855947 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 09:09:36.855947 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 09:09:36.855947 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 09:09:36.855947 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 09:09:36.855947 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 09:09:36.858883 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 09:09:36.858883 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 09:09:36.858883 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 09:09:36.858883 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 09:09:36.858883 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 09:09:36.858883 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 09:09:36.858883 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 09:09:36.858883 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 09:09:36.858883 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 09:09:36.858883 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 09:09:36.858883 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 09:09:36.858883 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application with Lock( Jul 28 09:09:36.858883 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 09:09:36.858883 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return self._enter() Jul 28 09:09:36.858883 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 09:09:36.858883 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 09:09:36.861633 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 09:09:36.861633 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return self.creator() Jul 28 09:09:36.861633 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 09:09:36.861633 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application created_value = creator( Jul 28 09:09:36.861633 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 09:09:36.861633 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 09:09:36.861633 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 09:09:36.861633 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 09:09:36.861633 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 09:09:36.861633 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 09:09:36.861633 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 28 09:09:36.861633 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application Jul 28 09:09:36.861633 dv-cinder-851351-1-smb devstack@keystone.service[416294]: [pid: 416294|app: 0|req: 624/1235] 10.222.0.42 () {56 vars in 1102 bytes} [Thu Jul 28 09:09:36 2022] GET /identity/v3/roles/service => generated 85 bytes in 250 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 09:09:36.867340 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cece7ec8-102c-4c39-a4a0-7ef61c70df83 None None] Authenticating user token {{(pid=416293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:09:36.950273 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG dbcounter [-] [416293] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=416293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:09:37.052119 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cece7ec8-102c-4c39-a4a0-7ef61c70df83 None None] Validating token access rules against request {{(pid=416293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:09:37.132084 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75385605-dd30-4d4e-bfc4-c98b4e7e531d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:09:37.133157 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75385605-dd30-4d4e-bfc4-c98b4e7e531d None admin] REQUEST_METHOD: `GET` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:09:37.133618 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75385605-dd30-4d4e-bfc4-c98b4e7e531d None admin] SCRIPT_NAME: `/identity` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:09:37.134043 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75385605-dd30-4d4e-bfc4-c98b4e7e531d None admin] PATH_INFO: `/v3/roles` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:09:37.135667 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75385605-dd30-4d4e-bfc4-c98b4e7e531d None admin] RBAC: Adding query filter params (name=service) {{(pid=416293) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 09:09:37.136247 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75385605-dd30-4d4e-bfc4-c98b4e7e531d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:09:37.139610 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75385605-dd30-4d4e-bfc4-c98b4e7e531d None admin] RBAC: Authorization granted {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:09:37.157516 dv-cinder-851351-1-smb devstack@keystone.service[416293]: [pid: 416293|app: 0|req: 612/1236] 10.222.0.42 () {56 vars in 1103 bytes} [Thu Jul 28 09:09:36 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 291 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 09:09:37.167685 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71b925d-d077-47b8-b458-01152bc1f786 None admin] Authenticating user token {{(pid=416294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:09:37.294699 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG dbcounter [-] [416294] Writing DB stats keystone:SELECT=100 {{(pid=416294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:09:37.318950 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71b925d-d077-47b8-b458-01152bc1f786 None admin] Validating token access rules against request {{(pid=416294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:09:37.380572 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e26e803-9f6e-42c8-97eb-542bc4f52d5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:09:37.381277 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e26e803-9f6e-42c8-97eb-542bc4f52d5f None admin] REQUEST_METHOD: `GET` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:09:37.381561 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e26e803-9f6e-42c8-97eb-542bc4f52d5f None admin] SCRIPT_NAME: `/identity` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:09:37.381835 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e26e803-9f6e-42c8-97eb-542bc4f52d5f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:09:37.393682 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e26e803-9f6e-42c8-97eb-542bc4f52d5f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:09:37.395169 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e26e803-9f6e-42c8-97eb-542bc4f52d5f None admin] RBAC: Authorization granted {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:09:37.412320 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application [None req-4e26e803-9f6e-42c8-97eb-542bc4f52d5f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 09:09:37.412320 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 09:09:37.412320 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 09:09:37.412320 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 09:09:37.412320 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 09:09:37.412320 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 09:09:37.412320 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 09:09:37.412320 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 09:09:37.412320 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 09:09:37.412320 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 09:09:37.412320 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 09:09:37.412320 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 09:09:37.412320 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 09:09:37.412320 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 09:09:37.412320 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 09:09:37.414750 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 09:09:37.414750 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 09:09:37.414750 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 09:09:37.414750 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 09:09:37.414750 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 09:09:37.414750 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 09:09:37.414750 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 09:09:37.414750 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 09:09:37.414750 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application with Lock( Jul 28 09:09:37.414750 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 09:09:37.414750 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return self._enter() Jul 28 09:09:37.414750 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 09:09:37.414750 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 09:09:37.414750 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 09:09:37.414750 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return self.creator() Jul 28 09:09:37.414750 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 09:09:37.414750 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application created_value = creator( Jul 28 09:09:37.416775 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 09:09:37.416775 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 09:09:37.416775 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 09:09:37.416775 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application Jul 28 09:09:37.416775 dv-cinder-851351-1-smb devstack@keystone.service[416294]: [pid: 416294|app: 0|req: 625/1237] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 09:09:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 247 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 09:09:37.420927 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75385605-dd30-4d4e-bfc4-c98b4e7e531d None admin] Authenticating user token {{(pid=416293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:09:37.597859 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75385605-dd30-4d4e-bfc4-c98b4e7e531d None admin] Validating token access rules against request {{(pid=416293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:09:37.611426 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG dbcounter [-] [416293] Writing DB stats keystone:SELECT=100 {{(pid=416293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:09:37.644537 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de9f35b-f5c0-4a78-8a13-176575dadc76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:09:37.645216 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de9f35b-f5c0-4a78-8a13-176575dadc76 None admin] REQUEST_METHOD: `GET` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:09:37.645499 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de9f35b-f5c0-4a78-8a13-176575dadc76 None admin] SCRIPT_NAME: `/identity` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:09:37.645790 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de9f35b-f5c0-4a78-8a13-176575dadc76 None admin] PATH_INFO: `/v3/domains` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:09:37.646473 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8de9f35b-f5c0-4a78-8a13-176575dadc76 None admin] RBAC: Adding query filter params (name=Default) {{(pid=416293) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 09:09:37.646776 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8de9f35b-f5c0-4a78-8a13-176575dadc76 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:09:37.648178 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8de9f35b-f5c0-4a78-8a13-176575dadc76 None admin] RBAC: Authorization granted {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:09:37.672006 dv-cinder-851351-1-smb devstack@keystone.service[416293]: [pid: 416293|app: 0|req: 613/1238] 10.222.0.42 () {56 vars in 1109 bytes} [Thu Jul 28 09:09:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:09:37.674756 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e26e803-9f6e-42c8-97eb-542bc4f52d5f None admin] Authenticating user token {{(pid=416294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:09:37.854988 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e26e803-9f6e-42c8-97eb-542bc4f52d5f None admin] Validating token access rules against request {{(pid=416294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:09:37.909235 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d0dad2-825a-4214-9297-6919d47e451c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:09:37.910063 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d0dad2-825a-4214-9297-6919d47e451c None admin] REQUEST_METHOD: `GET` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:09:37.910356 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d0dad2-825a-4214-9297-6919d47e451c None admin] SCRIPT_NAME: `/identity` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:09:37.910663 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d0dad2-825a-4214-9297-6919d47e451c None admin] PATH_INFO: `/v3/users/placement` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:09:37.914853 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG dbcounter [-] [416294] Writing DB stats keystone:SELECT=100 {{(pid=416294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:09:37.922740 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d0dad2-825a-4214-9297-6919d47e451c None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:09:37.924715 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d0dad2-825a-4214-9297-6919d47e451c None admin] RBAC: Authorization granted {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:09:37.939455 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application [None req-d9d0dad2-825a-4214-9297-6919d47e451c None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 28 09:09:37.939455 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 09:09:37.939455 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 09:09:37.939455 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 09:09:37.939455 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 09:09:37.939455 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 09:09:37.939455 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 09:09:37.939455 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 09:09:37.939455 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 09:09:37.939455 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 09:09:37.939455 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 09:09:37.939455 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 09:09:37.939455 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 28 09:09:37.939455 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 28 09:09:37.939455 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 28 09:09:37.939455 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 28 09:09:37.941606 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 09:09:37.941606 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 09:09:37.941606 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 28 09:09:37.941606 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 09:09:37.941606 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 28 09:09:37.941606 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 09:09:37.941606 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 09:09:37.941606 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 09:09:37.941606 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 09:09:37.941606 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 09:09:37.941606 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 09:09:37.941606 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application with Lock( Jul 28 09:09:37.941606 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 09:09:37.941606 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return self._enter() Jul 28 09:09:37.941606 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 09:09:37.941606 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 09:09:37.941606 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 09:09:37.941606 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return self.creator() Jul 28 09:09:37.943609 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 09:09:37.943609 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application created_value = creator( Jul 28 09:09:37.943609 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 28 09:09:37.943609 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 28 09:09:37.943609 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 28 09:09:37.943609 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 28 09:09:37.943609 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 28 09:09:37.943609 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 28 09:09:37.943609 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 28 09:09:37.943609 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application Jul 28 09:09:37.943609 dv-cinder-851351-1-smb devstack@keystone.service[416294]: [pid: 416294|app: 0|req: 626/1239] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 09:09:37 2022] GET /identity/v3/users/placement => generated 87 bytes in 268 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 09:09:37.950785 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de9f35b-f5c0-4a78-8a13-176575dadc76 None admin] Authenticating user token {{(pid=416293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:09:38.107831 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de9f35b-f5c0-4a78-8a13-176575dadc76 None admin] Validating token access rules against request {{(pid=416293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:09:38.159417 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ad258f-3619-4016-8940-30485ba33f17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:09:38.160193 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ad258f-3619-4016-8940-30485ba33f17 None admin] REQUEST_METHOD: `GET` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:09:38.160604 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ad258f-3619-4016-8940-30485ba33f17 None admin] SCRIPT_NAME: `/identity` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:09:38.161033 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ad258f-3619-4016-8940-30485ba33f17 None admin] PATH_INFO: `/v3/users` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:09:38.161948 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44ad258f-3619-4016-8940-30485ba33f17 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=416293) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 09:09:38.162354 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44ad258f-3619-4016-8940-30485ba33f17 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:09:38.163946 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44ad258f-3619-4016-8940-30485ba33f17 None admin] RBAC: Authorization granted {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:09:38.185203 dv-cinder-851351-1-smb devstack@keystone.service[416293]: [pid: 416293|app: 0|req: 614/1240] 10.222.0.42 () {56 vars in 1143 bytes} [Thu Jul 28 09:09:37 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:09:38.193775 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d0dad2-825a-4214-9297-6919d47e451c None admin] Authenticating user token {{(pid=416294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:09:38.329369 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d0dad2-825a-4214-9297-6919d47e451c None admin] Validating token access rules against request {{(pid=416294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:09:38.380923 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d9b6dd-04d9-41cf-8613-8539d6cee896 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:09:38.382224 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d9b6dd-04d9-41cf-8613-8539d6cee896 None admin] REQUEST_METHOD: `GET` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:09:38.382770 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d9b6dd-04d9-41cf-8613-8539d6cee896 None admin] SCRIPT_NAME: `/identity` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:09:38.383529 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d9b6dd-04d9-41cf-8613-8539d6cee896 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:09:38.497695 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG dbcounter [-] [416294] Writing DB stats keystone:SELECT=100 {{(pid=416294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:09:38.505463 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d9b6dd-04d9-41cf-8613-8539d6cee896 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:09:38.506973 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d9b6dd-04d9-41cf-8613-8539d6cee896 None admin] RBAC: Authorization granted {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:09:38.630774 dv-cinder-851351-1-smb devstack@keystone.service[416294]: [pid: 416294|app: 0|req: 627/1241] 10.222.0.42 () {58 vars in 1282 bytes} [Thu Jul 28 09:09:38 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 438 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 28 09:09:38.638153 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ad258f-3619-4016-8940-30485ba33f17 None admin] Authenticating user token {{(pid=416293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:09:38.679083 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG dbcounter [-] [416293] Writing DB stats keystone:SELECT=100 {{(pid=416293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:09:38.779443 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ad258f-3619-4016-8940-30485ba33f17 None admin] Validating token access rules against request {{(pid=416293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:09:38.823378 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86df0fde-edfd-41eb-bde4-e6e255d2e1d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:09:38.824149 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86df0fde-edfd-41eb-bde4-e6e255d2e1d5 None admin] REQUEST_METHOD: `GET` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:09:38.824588 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86df0fde-edfd-41eb-bde4-e6e255d2e1d5 None admin] SCRIPT_NAME: `/identity` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:09:38.824832 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86df0fde-edfd-41eb-bde4-e6e255d2e1d5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:09:38.839395 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86df0fde-edfd-41eb-bde4-e6e255d2e1d5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:09:38.842871 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86df0fde-edfd-41eb-bde4-e6e255d2e1d5 None admin] RBAC: Authorization granted {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:09:38.874007 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application [None req-86df0fde-edfd-41eb-bde4-e6e255d2e1d5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 09:09:38.874007 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 09:09:38.874007 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 09:09:38.874007 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 09:09:38.874007 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 09:09:38.874007 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 09:09:38.874007 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 09:09:38.874007 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 09:09:38.874007 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 09:09:38.874007 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 09:09:38.874007 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 09:09:38.874007 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 09:09:38.874007 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 09:09:38.874007 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 09:09:38.874007 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 09:09:38.876426 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 09:09:38.876426 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 09:09:38.876426 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 09:09:38.876426 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 09:09:38.876426 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 09:09:38.876426 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 09:09:38.876426 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 09:09:38.876426 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 09:09:38.876426 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application with Lock( Jul 28 09:09:38.876426 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 09:09:38.876426 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self._enter() Jul 28 09:09:38.876426 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 09:09:38.876426 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 09:09:38.876426 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 09:09:38.876426 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self.creator() Jul 28 09:09:38.876426 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 09:09:38.876426 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application created_value = creator( Jul 28 09:09:38.878722 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 09:09:38.878722 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 09:09:38.878722 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 09:09:38.878722 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application Jul 28 09:09:38.878722 dv-cinder-851351-1-smb devstack@keystone.service[416293]: [pid: 416293|app: 0|req: 615/1242] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 09:09:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 09:09:38.882675 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d9b6dd-04d9-41cf-8613-8539d6cee896 None admin] Authenticating user token {{(pid=416294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:09:39.043873 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG dbcounter [-] [416294] Writing DB stats keystone:SELECT=100 {{(pid=416294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:09:39.055098 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d9b6dd-04d9-41cf-8613-8539d6cee896 None admin] Validating token access rules against request {{(pid=416294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:09:39.109336 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156744c3-0c58-40fe-9393-5042ff679d71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:09:39.110395 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156744c3-0c58-40fe-9393-5042ff679d71 None admin] REQUEST_METHOD: `GET` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:09:39.110878 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156744c3-0c58-40fe-9393-5042ff679d71 None admin] SCRIPT_NAME: `/identity` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:09:39.111359 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156744c3-0c58-40fe-9393-5042ff679d71 None admin] PATH_INFO: `/v3/domains` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:09:39.112645 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-156744c3-0c58-40fe-9393-5042ff679d71 None admin] RBAC: Adding query filter params (name=Default) {{(pid=416294) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 09:09:39.113190 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-156744c3-0c58-40fe-9393-5042ff679d71 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:09:39.115709 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-156744c3-0c58-40fe-9393-5042ff679d71 None admin] RBAC: Authorization granted {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:09:39.136038 dv-cinder-851351-1-smb devstack@keystone.service[416294]: [pid: 416294|app: 0|req: 628/1243] 10.222.0.42 () {56 vars in 1109 bytes} [Thu Jul 28 09:09:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:09:39.144393 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86df0fde-edfd-41eb-bde4-e6e255d2e1d5 None admin] Authenticating user token {{(pid=416293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:09:39.267940 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG dbcounter [-] [416293] Writing DB stats keystone:SELECT=100 {{(pid=416293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:09:39.309632 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86df0fde-edfd-41eb-bde4-e6e255d2e1d5 None admin] Validating token access rules against request {{(pid=416293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:09:39.367172 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dacefd7f-f3ae-4130-a0e1-dc8a400a18a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:09:39.368443 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dacefd7f-f3ae-4130-a0e1-dc8a400a18a8 None admin] REQUEST_METHOD: `GET` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:09:39.369033 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dacefd7f-f3ae-4130-a0e1-dc8a400a18a8 None admin] SCRIPT_NAME: `/identity` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:09:39.369611 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dacefd7f-f3ae-4130-a0e1-dc8a400a18a8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:09:39.384524 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dacefd7f-f3ae-4130-a0e1-dc8a400a18a8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:09:39.388057 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dacefd7f-f3ae-4130-a0e1-dc8a400a18a8 None admin] RBAC: Authorization granted {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:09:39.414486 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application [None req-dacefd7f-f3ae-4130-a0e1-dc8a400a18a8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 09:09:39.414486 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 09:09:39.414486 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 09:09:39.414486 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 09:09:39.414486 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 09:09:39.414486 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 09:09:39.414486 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 09:09:39.414486 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 09:09:39.414486 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 09:09:39.414486 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 09:09:39.414486 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 09:09:39.414486 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 09:09:39.414486 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 28 09:09:39.414486 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 28 09:09:39.414486 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 28 09:09:39.416649 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 28 09:09:39.416649 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 09:09:39.416649 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 09:09:39.416649 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 09:09:39.416649 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 09:09:39.416649 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 09:09:39.416649 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 09:09:39.416649 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 09:09:39.416649 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application with Lock( Jul 28 09:09:39.416649 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 09:09:39.416649 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self._enter() Jul 28 09:09:39.416649 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 09:09:39.416649 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 09:09:39.416649 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 09:09:39.416649 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self.creator() Jul 28 09:09:39.416649 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 09:09:39.416649 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application created_value = creator( Jul 28 09:09:39.424203 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 28 09:09:39.424203 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 28 09:09:39.424203 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 28 09:09:39.424203 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 28 09:09:39.424203 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 28 09:09:39.424203 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 28 09:09:39.424203 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 09:09:39.424203 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application Jul 28 09:09:39.424203 dv-cinder-851351-1-smb devstack@keystone.service[416293]: [pid: 416293|app: 0|req: 616/1244] 10.222.0.42 () {56 vars in 1111 bytes} [Thu Jul 28 09:09:39 2022] GET /identity/v3/projects/service => generated 88 bytes in 273 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 09:09:39.425219 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156744c3-0c58-40fe-9393-5042ff679d71 None admin] Authenticating user token {{(pid=416294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:09:39.588426 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156744c3-0c58-40fe-9393-5042ff679d71 None admin] Validating token access rules against request {{(pid=416294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:09:39.637834 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a8a9636-5d3f-4e15-80a1-ebe106b806bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:09:39.638792 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8a9636-5d3f-4e15-80a1-ebe106b806bb None admin] REQUEST_METHOD: `GET` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:09:39.639169 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8a9636-5d3f-4e15-80a1-ebe106b806bb None admin] SCRIPT_NAME: `/identity` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:09:39.639538 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8a9636-5d3f-4e15-80a1-ebe106b806bb None admin] PATH_INFO: `/v3/projects` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:09:39.640433 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a8a9636-5d3f-4e15-80a1-ebe106b806bb None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=416294) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 09:09:39.640999 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a8a9636-5d3f-4e15-80a1-ebe106b806bb None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:09:39.643067 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a8a9636-5d3f-4e15-80a1-ebe106b806bb None admin] RBAC: Authorization granted {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:09:39.661214 dv-cinder-851351-1-smb devstack@keystone.service[416294]: [pid: 416294|app: 0|req: 629/1245] 10.222.0.42 () {56 vars in 1148 bytes} [Thu Jul 28 09:09:39 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 09:09:39.667963 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dacefd7f-f3ae-4130-a0e1-dc8a400a18a8 None admin] Authenticating user token {{(pid=416293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:09:39.789913 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dacefd7f-f3ae-4130-a0e1-dc8a400a18a8 None admin] Validating token access rules against request {{(pid=416293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:09:39.861695 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999a9257-0221-457a-88ae-9a4a8c4ec8f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:09:39.862608 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999a9257-0221-457a-88ae-9a4a8c4ec8f0 None admin] REQUEST_METHOD: `GET` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:09:39.863204 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999a9257-0221-457a-88ae-9a4a8c4ec8f0 None admin] SCRIPT_NAME: `/identity` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:09:39.863510 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999a9257-0221-457a-88ae-9a4a8c4ec8f0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:09:39.864829 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-999a9257-0221-457a-88ae-9a4a8c4ec8f0 None admin] RBAC: Adding query filter params (role.id=13417fbdbc5145a69bc01ff0f931fd96, scope.project.id=6c4349445f224184b093d9dfd0dfc642, user.id=72e6aedb591140ca936b41c52bc0d470) {{(pid=416293) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 09:09:39.865230 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-999a9257-0221-457a-88ae-9a4a8c4ec8f0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:09:39.867392 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-999a9257-0221-457a-88ae-9a4a8c4ec8f0 None admin] RBAC: Authorization granted {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:09:39.877143 dv-cinder-851351-1-smb devstack@keystone.service[416293]: [pid: 416293|app: 0|req: 617/1246] 10.222.0.42 () {56 vars in 1374 bytes} [Thu Jul 28 09:09:39 2022] GET /identity/v3/role_assignments?user.id=72e6aedb591140ca936b41c52bc0d470&scope.project.id=6c4349445f224184b093d9dfd0dfc642&role.id=13417fbdbc5145a69bc01ff0f931fd96 => generated 608 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:09:42.376580 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57b1237-212a-4f5a-a85e-e6d743a8560f None None] REQUEST_METHOD: `GET` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:09:42.377575 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57b1237-212a-4f5a-a85e-e6d743a8560f None None] SCRIPT_NAME: `/identity` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:09:42.377575 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57b1237-212a-4f5a-a85e-e6d743a8560f None None] PATH_INFO: `/` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:09:42.379312 dv-cinder-851351-1-smb devstack@keystone.service[416294]: [pid: 416294|app: 0|req: 630/1247] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 09:09:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 09:09:42.385763 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd21cbb7-db71-4b97-8db3-eac3d4c07acb None None] REQUEST_METHOD: `POST` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:09:42.386525 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd21cbb7-db71-4b97-8db3-eac3d4c07acb None None] SCRIPT_NAME: `/identity` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:09:42.386525 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd21cbb7-db71-4b97-8db3-eac3d4c07acb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:09:42.395298 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG dbcounter [-] [416293] Writing DB stats keystone:SELECT=100 {{(pid=416293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:09:42.415454 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.auth.core [None req-dd21cbb7-db71-4b97-8db3-eac3d4c07acb None None] MFA Rules not processed for user `dbf87abab90e4fdf9e75408f4199918e`. Rule list: `[]` (Enabled: `True`). {{(pid=416293) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 09:09:42.417626 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.fernet_utils [None req-dd21cbb7-db71-4b97-8db3-eac3d4c07acb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=416293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 09:09:42.531997 dv-cinder-851351-1-smb devstack@keystone.service[416293]: [pid: 416293|app: 0|req: 618/1248] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 09:09:42 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 09:09:42.560276 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57b1237-212a-4f5a-a85e-e6d743a8560f None None] Authenticating user token {{(pid=416294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:09:42.600363 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG dbcounter [-] [416294] Writing DB stats keystone:SELECT=100 {{(pid=416294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:09:42.731200 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57b1237-212a-4f5a-a85e-e6d743a8560f None None] Validating token access rules against request {{(pid=416294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:09:42.784709 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80590b46-3441-44bb-8719-67bbc0313b90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:09:42.785651 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80590b46-3441-44bb-8719-67bbc0313b90 None admin] REQUEST_METHOD: `GET` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:09:42.786068 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80590b46-3441-44bb-8719-67bbc0313b90 None admin] SCRIPT_NAME: `/identity` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:09:42.786507 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80590b46-3441-44bb-8719-67bbc0313b90 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:09:42.805646 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80590b46-3441-44bb-8719-67bbc0313b90 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 09:09:42.813142 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application [None req-80590b46-3441-44bb-8719-67bbc0313b90 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 09:09:42.813142 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 09:09:42.813142 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 09:09:42.813142 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 09:09:42.813142 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 09:09:42.813142 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 09:09:42.813142 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 09:09:42.813142 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 09:09:42.813142 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 09:09:42.813142 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 09:09:42.813142 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 09:09:42.813142 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 09:09:42.813142 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 09:09:42.813142 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 09:09:42.813142 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 09:09:42.813142 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 09:09:42.815146 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 09:09:42.815146 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 09:09:42.815146 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 09:09:42.815146 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 09:09:42.815146 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 09:09:42.815146 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 09:09:42.815146 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 09:09:42.815146 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 09:09:42.815146 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 09:09:42.815146 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 09:09:42.815146 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 09:09:42.815146 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application with Lock( Jul 28 09:09:42.815146 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 09:09:42.815146 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return self._enter() Jul 28 09:09:42.815146 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 09:09:42.815146 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 09:09:42.817408 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 09:09:42.817408 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return self.creator() Jul 28 09:09:42.817408 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 09:09:42.817408 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application created_value = creator( Jul 28 09:09:42.817408 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 09:09:42.817408 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 09:09:42.817408 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 09:09:42.817408 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 09:09:42.817408 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 09:09:42.817408 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 09:09:42.817408 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 09:09:42.817408 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application Jul 28 09:09:42.817408 dv-cinder-851351-1-smb devstack@keystone.service[416294]: [pid: 416294|app: 0|req: 631/1249] 10.222.0.42 () {56 vars in 1096 bytes} [Thu Jul 28 09:09:42 2022] GET /identity/v3/roles/admin => generated 83 bytes in 256 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 09:09:42.823804 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd21cbb7-db71-4b97-8db3-eac3d4c07acb None None] Authenticating user token {{(pid=416293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:09:42.971570 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd21cbb7-db71-4b97-8db3-eac3d4c07acb None None] Validating token access rules against request {{(pid=416293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:09:43.013233 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG dbcounter [-] [416293] Writing DB stats keystone:SELECT=100 {{(pid=416293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:09:43.021347 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65421fe3-4942-413e-a136-745e0115c4a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:09:43.022345 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65421fe3-4942-413e-a136-745e0115c4a0 None admin] REQUEST_METHOD: `GET` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:09:43.022698 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65421fe3-4942-413e-a136-745e0115c4a0 None admin] SCRIPT_NAME: `/identity` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:09:43.023170 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65421fe3-4942-413e-a136-745e0115c4a0 None admin] PATH_INFO: `/v3/roles` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:09:43.024130 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65421fe3-4942-413e-a136-745e0115c4a0 None admin] RBAC: Adding query filter params (name=admin) {{(pid=416293) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 09:09:43.024595 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65421fe3-4942-413e-a136-745e0115c4a0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:09:43.026325 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65421fe3-4942-413e-a136-745e0115c4a0 None admin] RBAC: Authorization granted {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:09:43.037641 dv-cinder-851351-1-smb devstack@keystone.service[416293]: [pid: 416293|app: 0|req: 619/1250] 10.222.0.42 () {56 vars in 1099 bytes} [Thu Jul 28 09:09:42 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 09:09:43.046434 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80590b46-3441-44bb-8719-67bbc0313b90 None admin] Authenticating user token {{(pid=416294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:09:43.180189 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG dbcounter [-] [416294] Writing DB stats keystone:SELECT=100 {{(pid=416294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:09:43.224007 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80590b46-3441-44bb-8719-67bbc0313b90 None admin] Validating token access rules against request {{(pid=416294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:09:43.283773 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7251428c-96d2-438e-9f42-413bac7d5e2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:09:43.284274 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7251428c-96d2-438e-9f42-413bac7d5e2d None admin] REQUEST_METHOD: `GET` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:09:43.284538 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7251428c-96d2-438e-9f42-413bac7d5e2d None admin] SCRIPT_NAME: `/identity` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:09:43.284869 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7251428c-96d2-438e-9f42-413bac7d5e2d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:09:43.299869 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7251428c-96d2-438e-9f42-413bac7d5e2d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:09:43.302370 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7251428c-96d2-438e-9f42-413bac7d5e2d None admin] RBAC: Authorization granted {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:09:43.323437 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application [None req-7251428c-96d2-438e-9f42-413bac7d5e2d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 09:09:43.323437 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 09:09:43.323437 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 09:09:43.323437 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 09:09:43.323437 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 09:09:43.323437 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 09:09:43.323437 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 09:09:43.323437 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 09:09:43.323437 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 09:09:43.323437 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 09:09:43.323437 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 09:09:43.323437 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 09:09:43.323437 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 09:09:43.323437 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 09:09:43.323437 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 09:09:43.325481 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 09:09:43.325481 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 09:09:43.325481 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 09:09:43.325481 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 09:09:43.325481 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 09:09:43.325481 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 09:09:43.325481 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 09:09:43.325481 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 09:09:43.325481 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application with Lock( Jul 28 09:09:43.325481 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 09:09:43.325481 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return self._enter() Jul 28 09:09:43.325481 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 09:09:43.325481 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 09:09:43.325481 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 09:09:43.325481 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return self.creator() Jul 28 09:09:43.325481 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 09:09:43.325481 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application created_value = creator( Jul 28 09:09:43.327629 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 09:09:43.327629 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 09:09:43.327629 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 09:09:43.327629 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application Jul 28 09:09:43.327629 dv-cinder-851351-1-smb devstack@keystone.service[416294]: [pid: 416294|app: 0|req: 632/1251] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 09:09:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 280 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 09:09:43.332653 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65421fe3-4942-413e-a136-745e0115c4a0 None admin] Authenticating user token {{(pid=416293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:09:43.478519 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65421fe3-4942-413e-a136-745e0115c4a0 None admin] Validating token access rules against request {{(pid=416293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:09:43.534643 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b5f4e68-604c-4375-9cb6-1b930c6c095e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:09:43.535610 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5f4e68-604c-4375-9cb6-1b930c6c095e None admin] REQUEST_METHOD: `GET` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:09:43.536100 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5f4e68-604c-4375-9cb6-1b930c6c095e None admin] SCRIPT_NAME: `/identity` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:09:43.536576 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5f4e68-604c-4375-9cb6-1b930c6c095e None admin] PATH_INFO: `/v3/domains` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:09:43.537884 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b5f4e68-604c-4375-9cb6-1b930c6c095e None admin] RBAC: Adding query filter params (name=Default) {{(pid=416293) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 09:09:43.538472 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b5f4e68-604c-4375-9cb6-1b930c6c095e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:09:43.541090 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b5f4e68-604c-4375-9cb6-1b930c6c095e None admin] RBAC: Authorization granted {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:09:43.558301 dv-cinder-851351-1-smb devstack@keystone.service[416293]: [pid: 416293|app: 0|req: 620/1252] 10.222.0.42 () {56 vars in 1109 bytes} [Thu Jul 28 09:09:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:09:43.567426 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7251428c-96d2-438e-9f42-413bac7d5e2d None admin] Authenticating user token {{(pid=416294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:09:43.718435 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7251428c-96d2-438e-9f42-413bac7d5e2d None admin] Validating token access rules against request {{(pid=416294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:09:43.755813 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG dbcounter [-] [416294] Writing DB stats keystone:SELECT=100 {{(pid=416294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:09:43.767268 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1b54c3-26fb-477e-a430-249e94113f56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:09:43.768065 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1b54c3-26fb-477e-a430-249e94113f56 None admin] REQUEST_METHOD: `GET` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:09:43.768400 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1b54c3-26fb-477e-a430-249e94113f56 None admin] SCRIPT_NAME: `/identity` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:09:43.768774 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1b54c3-26fb-477e-a430-249e94113f56 None admin] PATH_INFO: `/v3/users/placement` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:09:43.782949 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a1b54c3-26fb-477e-a430-249e94113f56 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:09:43.785451 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a1b54c3-26fb-477e-a430-249e94113f56 None admin] RBAC: Authorization granted {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:09:43.801765 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application [None req-1a1b54c3-26fb-477e-a430-249e94113f56 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 28 09:09:43.801765 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 09:09:43.801765 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 09:09:43.801765 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 09:09:43.801765 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 09:09:43.801765 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 09:09:43.801765 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 09:09:43.801765 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 09:09:43.801765 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 09:09:43.801765 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 09:09:43.801765 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 09:09:43.801765 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 09:09:43.801765 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 28 09:09:43.801765 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 28 09:09:43.801765 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 28 09:09:43.801765 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 28 09:09:43.804000 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 09:09:43.804000 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 09:09:43.804000 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 28 09:09:43.804000 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 09:09:43.804000 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 28 09:09:43.804000 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 09:09:43.804000 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 09:09:43.804000 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 09:09:43.804000 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 09:09:43.804000 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 09:09:43.804000 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 09:09:43.804000 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application with Lock( Jul 28 09:09:43.804000 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 09:09:43.804000 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return self._enter() Jul 28 09:09:43.804000 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 09:09:43.804000 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 09:09:43.804000 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 09:09:43.804000 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return self.creator() Jul 28 09:09:43.805633 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 09:09:43.805633 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application created_value = creator( Jul 28 09:09:43.805633 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 28 09:09:43.805633 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 28 09:09:43.805633 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 28 09:09:43.805633 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 28 09:09:43.805633 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 28 09:09:43.805633 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 28 09:09:43.805633 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 28 09:09:43.805633 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application Jul 28 09:09:43.805633 dv-cinder-851351-1-smb devstack@keystone.service[416294]: [pid: 416294|app: 0|req: 633/1253] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 09:09:43 2022] GET /identity/v3/users/placement => generated 87 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 09:09:43.812221 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b5f4e68-604c-4375-9cb6-1b930c6c095e None admin] Authenticating user token {{(pid=416293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:09:43.899059 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG dbcounter [-] [416293] Writing DB stats keystone:SELECT=100 {{(pid=416293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:09:43.965921 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b5f4e68-604c-4375-9cb6-1b930c6c095e None admin] Validating token access rules against request {{(pid=416293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:09:44.033141 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87fae066-03d0-47a1-926c-a761cb6b49a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:09:44.034240 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87fae066-03d0-47a1-926c-a761cb6b49a9 None admin] REQUEST_METHOD: `GET` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:09:44.034706 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87fae066-03d0-47a1-926c-a761cb6b49a9 None admin] SCRIPT_NAME: `/identity` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:09:44.036061 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87fae066-03d0-47a1-926c-a761cb6b49a9 None admin] PATH_INFO: `/v3/users` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:09:44.038858 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87fae066-03d0-47a1-926c-a761cb6b49a9 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=416293) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 09:09:44.039401 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87fae066-03d0-47a1-926c-a761cb6b49a9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:09:44.042247 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87fae066-03d0-47a1-926c-a761cb6b49a9 None admin] RBAC: Authorization granted {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:09:44.069667 dv-cinder-851351-1-smb devstack@keystone.service[416293]: [pid: 416293|app: 0|req: 621/1254] 10.222.0.42 () {56 vars in 1143 bytes} [Thu Jul 28 09:09:43 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:09:44.077012 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1b54c3-26fb-477e-a430-249e94113f56 None admin] Authenticating user token {{(pid=416294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:09:44.225802 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1b54c3-26fb-477e-a430-249e94113f56 None admin] Validating token access rules against request {{(pid=416294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:09:44.288204 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2facd59-5bf1-4608-9564-0bcb976863ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:09:44.289006 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2facd59-5bf1-4608-9564-0bcb976863ad None admin] REQUEST_METHOD: `GET` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:09:44.289534 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2facd59-5bf1-4608-9564-0bcb976863ad None admin] SCRIPT_NAME: `/identity` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:09:44.289945 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2facd59-5bf1-4608-9564-0bcb976863ad None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:09:44.378369 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG dbcounter [-] [416294] Writing DB stats keystone:SELECT=100 {{(pid=416294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:09:44.402041 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2facd59-5bf1-4608-9564-0bcb976863ad None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:09:44.404185 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2facd59-5bf1-4608-9564-0bcb976863ad None admin] RBAC: Authorization granted {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:09:44.580694 dv-cinder-851351-1-smb devstack@keystone.service[416294]: [pid: 416294|app: 0|req: 634/1255] 10.222.0.42 () {58 vars in 1282 bytes} [Thu Jul 28 09:09:44 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 505 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 28 09:09:44.591086 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87fae066-03d0-47a1-926c-a761cb6b49a9 None admin] Authenticating user token {{(pid=416293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:09:44.761779 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87fae066-03d0-47a1-926c-a761cb6b49a9 None admin] Validating token access rules against request {{(pid=416293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:09:44.783260 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG dbcounter [-] [416293] Writing DB stats keystone:SELECT=100 {{(pid=416293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:09:44.815233 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b08b2cb0-60c2-470b-952b-25d9bd1cdfdf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:09:44.816162 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08b2cb0-60c2-470b-952b-25d9bd1cdfdf None admin] REQUEST_METHOD: `GET` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:09:44.816545 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08b2cb0-60c2-470b-952b-25d9bd1cdfdf None admin] SCRIPT_NAME: `/identity` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:09:44.817029 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08b2cb0-60c2-470b-952b-25d9bd1cdfdf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:09:44.832453 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b08b2cb0-60c2-470b-952b-25d9bd1cdfdf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:09:44.835324 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b08b2cb0-60c2-470b-952b-25d9bd1cdfdf None admin] RBAC: Authorization granted {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:09:44.857714 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application [None req-b08b2cb0-60c2-470b-952b-25d9bd1cdfdf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 09:09:44.857714 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 09:09:44.857714 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 09:09:44.857714 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 09:09:44.857714 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 09:09:44.857714 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 09:09:44.857714 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 09:09:44.857714 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 09:09:44.857714 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 09:09:44.857714 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 09:09:44.857714 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 09:09:44.857714 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 09:09:44.857714 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 09:09:44.857714 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 09:09:44.857714 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 09:09:44.859603 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 09:09:44.859603 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 09:09:44.859603 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 09:09:44.859603 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 09:09:44.859603 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 09:09:44.859603 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 09:09:44.859603 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 09:09:44.859603 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 09:09:44.859603 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application with Lock( Jul 28 09:09:44.859603 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 09:09:44.859603 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self._enter() Jul 28 09:09:44.859603 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 09:09:44.859603 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 09:09:44.859603 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 09:09:44.859603 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self.creator() Jul 28 09:09:44.859603 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 09:09:44.859603 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application created_value = creator( Jul 28 09:09:44.861324 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 09:09:44.861324 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 09:09:44.861324 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 09:09:44.861324 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application Jul 28 09:09:44.861324 dv-cinder-851351-1-smb devstack@keystone.service[416293]: [pid: 416293|app: 0|req: 622/1256] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 09:09:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 270 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 09:09:44.866136 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2facd59-5bf1-4608-9564-0bcb976863ad None admin] Authenticating user token {{(pid=416294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:09:45.004061 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG dbcounter [-] [416294] Writing DB stats keystone:SELECT=100 {{(pid=416294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:09:45.023784 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2facd59-5bf1-4608-9564-0bcb976863ad None admin] Validating token access rules against request {{(pid=416294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:09:45.081346 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63ba715-6e4e-4e66-84e9-7066089b0aba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:09:45.082771 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63ba715-6e4e-4e66-84e9-7066089b0aba None admin] REQUEST_METHOD: `GET` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:09:45.083205 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63ba715-6e4e-4e66-84e9-7066089b0aba None admin] SCRIPT_NAME: `/identity` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:09:45.083719 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63ba715-6e4e-4e66-84e9-7066089b0aba None admin] PATH_INFO: `/v3/domains` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:09:45.084998 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c63ba715-6e4e-4e66-84e9-7066089b0aba None admin] RBAC: Adding query filter params (name=Default) {{(pid=416294) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 09:09:45.085548 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c63ba715-6e4e-4e66-84e9-7066089b0aba None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:09:45.088520 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c63ba715-6e4e-4e66-84e9-7066089b0aba None admin] RBAC: Authorization granted {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:09:45.108170 dv-cinder-851351-1-smb devstack@keystone.service[416294]: [pid: 416294|app: 0|req: 635/1257] 10.222.0.42 () {56 vars in 1109 bytes} [Thu Jul 28 09:09:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:09:45.114908 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b08b2cb0-60c2-470b-952b-25d9bd1cdfdf None admin] Authenticating user token {{(pid=416293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:09:45.273300 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b08b2cb0-60c2-470b-952b-25d9bd1cdfdf None admin] Validating token access rules against request {{(pid=416293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:09:45.329583 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d73446-76b1-4fc3-8e6c-31a912ee6e2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:09:45.330420 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d73446-76b1-4fc3-8e6c-31a912ee6e2a None admin] REQUEST_METHOD: `GET` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:09:45.330765 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d73446-76b1-4fc3-8e6c-31a912ee6e2a None admin] SCRIPT_NAME: `/identity` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:09:45.331107 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d73446-76b1-4fc3-8e6c-31a912ee6e2a None admin] PATH_INFO: `/v3/projects/service` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:09:45.342798 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d73446-76b1-4fc3-8e6c-31a912ee6e2a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:09:45.345500 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d73446-76b1-4fc3-8e6c-31a912ee6e2a None admin] RBAC: Authorization granted {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:09:45.364797 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application [None req-81d73446-76b1-4fc3-8e6c-31a912ee6e2a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 09:09:45.364797 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 09:09:45.364797 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 09:09:45.364797 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 09:09:45.364797 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 09:09:45.364797 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 09:09:45.364797 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 09:09:45.364797 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 09:09:45.364797 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 09:09:45.364797 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 09:09:45.364797 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 09:09:45.364797 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 09:09:45.364797 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 28 09:09:45.364797 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 28 09:09:45.364797 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 28 09:09:45.366804 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 28 09:09:45.366804 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 09:09:45.366804 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 09:09:45.366804 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 09:09:45.366804 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 09:09:45.366804 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 09:09:45.366804 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 09:09:45.366804 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 09:09:45.366804 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application with Lock( Jul 28 09:09:45.366804 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 09:09:45.366804 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self._enter() Jul 28 09:09:45.366804 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 09:09:45.366804 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 09:09:45.366804 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 09:09:45.366804 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self.creator() Jul 28 09:09:45.366804 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 09:09:45.366804 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application created_value = creator( Jul 28 09:09:45.368752 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 28 09:09:45.368752 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 28 09:09:45.368752 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 28 09:09:45.368752 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 28 09:09:45.368752 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 28 09:09:45.368752 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 28 09:09:45.368752 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 09:09:45.368752 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application Jul 28 09:09:45.368752 dv-cinder-851351-1-smb devstack@keystone.service[416293]: [pid: 416293|app: 0|req: 623/1258] 10.222.0.42 () {56 vars in 1111 bytes} [Thu Jul 28 09:09:45 2022] GET /identity/v3/projects/service => generated 88 bytes in 254 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 09:09:45.374817 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63ba715-6e4e-4e66-84e9-7066089b0aba None admin] Authenticating user token {{(pid=416294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:09:45.523510 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63ba715-6e4e-4e66-84e9-7066089b0aba None admin] Validating token access rules against request {{(pid=416294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:09:45.575739 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625c5b8a-1299-47cf-913f-de856d10226d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:09:45.576650 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625c5b8a-1299-47cf-913f-de856d10226d None admin] REQUEST_METHOD: `GET` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:09:45.577056 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625c5b8a-1299-47cf-913f-de856d10226d None admin] SCRIPT_NAME: `/identity` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:09:45.577489 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625c5b8a-1299-47cf-913f-de856d10226d None admin] PATH_INFO: `/v3/projects` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:09:45.578865 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-625c5b8a-1299-47cf-913f-de856d10226d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=416294) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 09:09:45.579321 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-625c5b8a-1299-47cf-913f-de856d10226d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:09:45.580969 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-625c5b8a-1299-47cf-913f-de856d10226d None admin] RBAC: Authorization granted {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:09:45.598829 dv-cinder-851351-1-smb devstack@keystone.service[416294]: [pid: 416294|app: 0|req: 636/1259] 10.222.0.42 () {56 vars in 1148 bytes} [Thu Jul 28 09:09:45 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:09:45.606772 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d73446-76b1-4fc3-8e6c-31a912ee6e2a None admin] Authenticating user token {{(pid=416293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:09:45.644725 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG dbcounter [-] [416293] Writing DB stats keystone:SELECT=100 {{(pid=416293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:09:45.771165 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d73446-76b1-4fc3-8e6c-31a912ee6e2a None admin] Validating token access rules against request {{(pid=416293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:09:45.814939 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff70bae-bdab-4d1c-b2ed-12b4faae31fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:09:45.815591 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff70bae-bdab-4d1c-b2ed-12b4faae31fe None admin] REQUEST_METHOD: `GET` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:09:45.815872 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff70bae-bdab-4d1c-b2ed-12b4faae31fe None admin] SCRIPT_NAME: `/identity` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:09:45.816149 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff70bae-bdab-4d1c-b2ed-12b4faae31fe None admin] PATH_INFO: `/v3/role_assignments` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:09:45.817002 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff70bae-bdab-4d1c-b2ed-12b4faae31fe None admin] RBAC: Adding query filter params (role.id=c67085ec338243df8f9b7d6459036e23, scope.project.id=6c4349445f224184b093d9dfd0dfc642, user.id=72e6aedb591140ca936b41c52bc0d470) {{(pid=416293) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 09:09:45.817312 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff70bae-bdab-4d1c-b2ed-12b4faae31fe None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:09:45.818793 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff70bae-bdab-4d1c-b2ed-12b4faae31fe None admin] RBAC: Authorization granted {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:09:45.828715 dv-cinder-851351-1-smb devstack@keystone.service[416293]: [pid: 416293|app: 0|req: 624/1260] 10.222.0.42 () {56 vars in 1374 bytes} [Thu Jul 28 09:09:45 2022] GET /identity/v3/role_assignments?user.id=72e6aedb591140ca936b41c52bc0d470&scope.project.id=6c4349445f224184b093d9dfd0dfc642&role.id=c67085ec338243df8f9b7d6459036e23 => generated 259 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 09:09:48.107980 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05fa411a-60b7-49af-a927-0da9e051b6dc None None] REQUEST_METHOD: `GET` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:09:48.108646 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05fa411a-60b7-49af-a927-0da9e051b6dc None None] SCRIPT_NAME: `/identity` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:09:48.109026 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05fa411a-60b7-49af-a927-0da9e051b6dc None None] PATH_INFO: `/` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:09:48.111625 dv-cinder-851351-1-smb devstack@keystone.service[416294]: [pid: 416294|app: 0|req: 637/1261] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 09:09:48 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 09:09:48.121341 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33825430-6976-4fe3-ab17-2dbfe70349f6 None None] REQUEST_METHOD: `POST` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:09:48.121998 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33825430-6976-4fe3-ab17-2dbfe70349f6 None None] SCRIPT_NAME: `/identity` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:09:48.122367 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33825430-6976-4fe3-ab17-2dbfe70349f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:09:48.154574 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.auth.core [None req-33825430-6976-4fe3-ab17-2dbfe70349f6 None None] MFA Rules not processed for user `dbf87abab90e4fdf9e75408f4199918e`. Rule list: `[]` (Enabled: `True`). {{(pid=416293) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 09:09:48.156788 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.fernet_utils [None req-33825430-6976-4fe3-ab17-2dbfe70349f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=416293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 09:09:48.255202 dv-cinder-851351-1-smb devstack@keystone.service[416293]: [pid: 416293|app: 0|req: 625/1262] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 09:09:48 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 09:09:48.279030 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05fa411a-60b7-49af-a927-0da9e051b6dc None None] Authenticating user token {{(pid=416294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:09:48.292278 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG dbcounter [-] [416294] Writing DB stats keystone:SELECT=100 {{(pid=416294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:09:48.410168 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05fa411a-60b7-49af-a927-0da9e051b6dc None None] Validating token access rules against request {{(pid=416294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:09:48.482346 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e25a41-0eb6-417a-9208-94e1db2bd02a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:09:48.484158 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e25a41-0eb6-417a-9208-94e1db2bd02a None admin] REQUEST_METHOD: `GET` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:09:48.484158 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e25a41-0eb6-417a-9208-94e1db2bd02a None admin] SCRIPT_NAME: `/identity` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:09:48.485040 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e25a41-0eb6-417a-9208-94e1db2bd02a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:09:48.508808 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2e25a41-0eb6-417a-9208-94e1db2bd02a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 09:09:48.511349 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application [None req-f2e25a41-0eb6-417a-9208-94e1db2bd02a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 09:09:48.511349 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 09:09:48.511349 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 09:09:48.511349 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 09:09:48.511349 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 09:09:48.511349 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 09:09:48.511349 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 09:09:48.511349 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 09:09:48.511349 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 09:09:48.511349 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 09:09:48.511349 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 09:09:48.511349 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 09:09:48.511349 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 09:09:48.511349 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 09:09:48.511349 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 09:09:48.511349 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 09:09:48.513664 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 09:09:48.513664 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 09:09:48.513664 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 09:09:48.513664 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 09:09:48.513664 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 09:09:48.513664 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 09:09:48.513664 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 09:09:48.513664 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 09:09:48.513664 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 09:09:48.513664 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 09:09:48.513664 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 09:09:48.513664 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application with Lock( Jul 28 09:09:48.513664 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 09:09:48.513664 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return self._enter() Jul 28 09:09:48.513664 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 09:09:48.513664 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 09:09:48.515529 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 09:09:48.515529 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return self.creator() Jul 28 09:09:48.515529 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 09:09:48.515529 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application created_value = creator( Jul 28 09:09:48.515529 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 09:09:48.515529 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 09:09:48.515529 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 09:09:48.515529 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 09:09:48.515529 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 09:09:48.515529 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 09:09:48.515529 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 09:09:48.515529 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application Jul 28 09:09:48.515529 dv-cinder-851351-1-smb devstack@keystone.service[416294]: [pid: 416294|app: 0|req: 638/1263] 10.222.0.42 () {56 vars in 1096 bytes} [Thu Jul 28 09:09:48 2022] GET /identity/v3/roles/admin => generated 83 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 09:09:48.520358 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33825430-6976-4fe3-ab17-2dbfe70349f6 None None] Authenticating user token {{(pid=416293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:09:48.547317 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG dbcounter [-] [416293] Writing DB stats keystone:SELECT=100 {{(pid=416293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:09:48.667260 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33825430-6976-4fe3-ab17-2dbfe70349f6 None None] Validating token access rules against request {{(pid=416293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:09:48.721564 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a124f8e-0645-46f9-b0dc-c97e94e5df14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:09:48.722515 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a124f8e-0645-46f9-b0dc-c97e94e5df14 None admin] REQUEST_METHOD: `GET` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:09:48.722953 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a124f8e-0645-46f9-b0dc-c97e94e5df14 None admin] SCRIPT_NAME: `/identity` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:09:48.723304 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a124f8e-0645-46f9-b0dc-c97e94e5df14 None admin] PATH_INFO: `/v3/roles` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:09:48.724161 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a124f8e-0645-46f9-b0dc-c97e94e5df14 None admin] RBAC: Adding query filter params (name=admin) {{(pid=416293) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 09:09:48.724540 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a124f8e-0645-46f9-b0dc-c97e94e5df14 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:09:48.726190 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a124f8e-0645-46f9-b0dc-c97e94e5df14 None admin] RBAC: Authorization granted {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:09:48.739982 dv-cinder-851351-1-smb devstack@keystone.service[416293]: [pid: 416293|app: 0|req: 626/1264] 10.222.0.42 () {56 vars in 1099 bytes} [Thu Jul 28 09:09:48 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:09:48.746802 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e25a41-0eb6-417a-9208-94e1db2bd02a None admin] Authenticating user token {{(pid=416294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:09:48.822201 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG dbcounter [-] [416294] Writing DB stats keystone:SELECT=100 {{(pid=416294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:09:48.859849 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e25a41-0eb6-417a-9208-94e1db2bd02a None admin] Validating token access rules against request {{(pid=416294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:09:48.899588 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc88d38c-a9e9-4c4f-8459-ba7a783ef168 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:09:48.900252 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc88d38c-a9e9-4c4f-8459-ba7a783ef168 None admin] REQUEST_METHOD: `GET` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:09:48.900542 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc88d38c-a9e9-4c4f-8459-ba7a783ef168 None admin] SCRIPT_NAME: `/identity` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:09:48.900857 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc88d38c-a9e9-4c4f-8459-ba7a783ef168 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:09:48.912585 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc88d38c-a9e9-4c4f-8459-ba7a783ef168 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:09:48.914136 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc88d38c-a9e9-4c4f-8459-ba7a783ef168 None admin] RBAC: Authorization granted {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:09:48.930044 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application [None req-bc88d38c-a9e9-4c4f-8459-ba7a783ef168 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 09:09:48.930044 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 09:09:48.930044 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 09:09:48.930044 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 09:09:48.930044 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 09:09:48.930044 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 09:09:48.930044 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 09:09:48.930044 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 09:09:48.930044 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 09:09:48.930044 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 09:09:48.930044 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 09:09:48.930044 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 09:09:48.930044 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 09:09:48.930044 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 09:09:48.930044 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 09:09:48.931884 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 09:09:48.931884 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 09:09:48.931884 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 09:09:48.931884 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 09:09:48.931884 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 09:09:48.931884 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 09:09:48.931884 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 09:09:48.931884 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 09:09:48.931884 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application with Lock( Jul 28 09:09:48.931884 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 09:09:48.931884 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return self._enter() Jul 28 09:09:48.931884 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 09:09:48.931884 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 09:09:48.931884 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 09:09:48.931884 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return self.creator() Jul 28 09:09:48.931884 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 09:09:48.931884 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application created_value = creator( Jul 28 09:09:48.933786 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 09:09:48.933786 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 09:09:48.933786 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 09:09:48.933786 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application Jul 28 09:09:48.933786 dv-cinder-851351-1-smb devstack@keystone.service[416294]: [pid: 416294|app: 0|req: 639/1265] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 09:09:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 09:09:48.940398 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a124f8e-0645-46f9-b0dc-c97e94e5df14 None admin] Authenticating user token {{(pid=416293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:09:49.034746 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG dbcounter [-] [416293] Writing DB stats keystone:SELECT=100 {{(pid=416293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:09:49.061741 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a124f8e-0645-46f9-b0dc-c97e94e5df14 None admin] Validating token access rules against request {{(pid=416293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:09:49.102471 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f27efb-ad5d-4011-842a-b3946f5acf3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:09:49.103117 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f27efb-ad5d-4011-842a-b3946f5acf3a None admin] REQUEST_METHOD: `GET` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:09:49.103401 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f27efb-ad5d-4011-842a-b3946f5acf3a None admin] SCRIPT_NAME: `/identity` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:09:49.103680 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f27efb-ad5d-4011-842a-b3946f5acf3a None admin] PATH_INFO: `/v3/domains` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:09:49.104385 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f27efb-ad5d-4011-842a-b3946f5acf3a None admin] RBAC: Adding query filter params (name=Default) {{(pid=416293) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 09:09:49.104703 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f27efb-ad5d-4011-842a-b3946f5acf3a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:09:49.106200 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f27efb-ad5d-4011-842a-b3946f5acf3a None admin] RBAC: Authorization granted {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:09:49.119471 dv-cinder-851351-1-smb devstack@keystone.service[416293]: [pid: 416293|app: 0|req: 627/1266] 10.222.0.42 () {56 vars in 1109 bytes} [Thu Jul 28 09:09:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:09:49.125662 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc88d38c-a9e9-4c4f-8459-ba7a783ef168 None admin] Authenticating user token {{(pid=416294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:09:49.239897 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc88d38c-a9e9-4c4f-8459-ba7a783ef168 None admin] Validating token access rules against request {{(pid=416294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:09:49.261546 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG dbcounter [-] [416294] Writing DB stats keystone:SELECT=100 {{(pid=416294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:09:49.278040 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64419214-4e28-4b12-a3f7-45fb3626b6d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:09:49.278706 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64419214-4e28-4b12-a3f7-45fb3626b6d7 None admin] REQUEST_METHOD: `GET` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:09:49.278995 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64419214-4e28-4b12-a3f7-45fb3626b6d7 None admin] SCRIPT_NAME: `/identity` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:09:49.279273 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64419214-4e28-4b12-a3f7-45fb3626b6d7 None admin] PATH_INFO: `/v3/users/placement` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:09:49.287669 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64419214-4e28-4b12-a3f7-45fb3626b6d7 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:09:49.289167 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64419214-4e28-4b12-a3f7-45fb3626b6d7 None admin] RBAC: Authorization granted {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:09:49.301726 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application [None req-64419214-4e28-4b12-a3f7-45fb3626b6d7 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 28 09:09:49.301726 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 09:09:49.301726 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 09:09:49.301726 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 09:09:49.301726 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 09:09:49.301726 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 09:09:49.301726 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 09:09:49.301726 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 09:09:49.301726 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 09:09:49.301726 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 09:09:49.301726 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 09:09:49.301726 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 09:09:49.301726 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 28 09:09:49.301726 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 28 09:09:49.301726 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 28 09:09:49.301726 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 28 09:09:49.303872 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 09:09:49.303872 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 09:09:49.303872 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 28 09:09:49.303872 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 09:09:49.303872 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 28 09:09:49.303872 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 09:09:49.303872 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 09:09:49.303872 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 09:09:49.303872 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 09:09:49.303872 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 09:09:49.303872 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 09:09:49.303872 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application with Lock( Jul 28 09:09:49.303872 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 09:09:49.303872 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return self._enter() Jul 28 09:09:49.303872 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 09:09:49.303872 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 09:09:49.303872 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 09:09:49.303872 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return self.creator() Jul 28 09:09:49.305875 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 09:09:49.305875 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application created_value = creator( Jul 28 09:09:49.305875 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 28 09:09:49.305875 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 28 09:09:49.305875 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 28 09:09:49.305875 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 28 09:09:49.305875 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 28 09:09:49.305875 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 28 09:09:49.305875 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 28 09:09:49.305875 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application Jul 28 09:09:49.305875 dv-cinder-851351-1-smb devstack@keystone.service[416294]: [pid: 416294|app: 0|req: 640/1267] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 09:09:49 2022] GET /identity/v3/users/placement => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 09:09:49.309086 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f27efb-ad5d-4011-842a-b3946f5acf3a None admin] Authenticating user token {{(pid=416293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:09:49.427811 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f27efb-ad5d-4011-842a-b3946f5acf3a None admin] Validating token access rules against request {{(pid=416293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:09:49.479422 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f12208e-0d21-4d5b-8d74-7673f4445386 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:09:49.480137 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f12208e-0d21-4d5b-8d74-7673f4445386 None admin] REQUEST_METHOD: `GET` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:09:49.480465 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f12208e-0d21-4d5b-8d74-7673f4445386 None admin] SCRIPT_NAME: `/identity` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:09:49.480860 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f12208e-0d21-4d5b-8d74-7673f4445386 None admin] PATH_INFO: `/v3/users` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:09:49.481721 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f12208e-0d21-4d5b-8d74-7673f4445386 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=416293) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 09:09:49.482079 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f12208e-0d21-4d5b-8d74-7673f4445386 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:09:49.483608 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f12208e-0d21-4d5b-8d74-7673f4445386 None admin] RBAC: Authorization granted {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:09:49.494139 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG dbcounter [-] [416293] Writing DB stats keystone:SELECT=100 {{(pid=416293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:09:49.512686 dv-cinder-851351-1-smb devstack@keystone.service[416293]: [pid: 416293|app: 0|req: 628/1268] 10.222.0.42 () {56 vars in 1143 bytes} [Thu Jul 28 09:09:49 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:09:49.518635 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64419214-4e28-4b12-a3f7-45fb3626b6d7 None admin] Authenticating user token {{(pid=416294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:09:49.631257 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64419214-4e28-4b12-a3f7-45fb3626b6d7 None admin] Validating token access rules against request {{(pid=416294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:09:49.673096 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d43d9d-00be-4373-adc5-69625ffc644f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:09:49.673779 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d43d9d-00be-4373-adc5-69625ffc644f None admin] REQUEST_METHOD: `GET` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:09:49.674064 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d43d9d-00be-4373-adc5-69625ffc644f None admin] SCRIPT_NAME: `/identity` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:09:49.674329 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d43d9d-00be-4373-adc5-69625ffc644f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:09:49.688033 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50d43d9d-00be-4373-adc5-69625ffc644f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:09:49.689684 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50d43d9d-00be-4373-adc5-69625ffc644f None admin] RBAC: Authorization granted {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:09:49.706775 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application [None req-50d43d9d-00be-4373-adc5-69625ffc644f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 09:09:49.706775 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 09:09:49.706775 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 09:09:49.706775 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 09:09:49.706775 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 09:09:49.706775 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 09:09:49.706775 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 09:09:49.706775 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 09:09:49.706775 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 09:09:49.706775 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 09:09:49.706775 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 09:09:49.706775 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 09:09:49.706775 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 09:09:49.706775 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 09:09:49.706775 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 09:09:49.708600 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 09:09:49.708600 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 09:09:49.708600 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 09:09:49.708600 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 09:09:49.708600 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 09:09:49.708600 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 09:09:49.708600 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 09:09:49.708600 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 09:09:49.708600 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application with Lock( Jul 28 09:09:49.708600 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 09:09:49.708600 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return self._enter() Jul 28 09:09:49.708600 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 09:09:49.708600 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 09:09:49.708600 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 09:09:49.708600 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return self.creator() Jul 28 09:09:49.708600 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 09:09:49.708600 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application created_value = creator( Jul 28 09:09:49.710220 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 09:09:49.710220 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 09:09:49.710220 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 09:09:49.710220 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application Jul 28 09:09:49.710220 dv-cinder-851351-1-smb devstack@keystone.service[416294]: [pid: 416294|app: 0|req: 641/1269] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 09:09:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 09:09:49.717470 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f12208e-0d21-4d5b-8d74-7673f4445386 None admin] Authenticating user token {{(pid=416293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:09:49.835776 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f12208e-0d21-4d5b-8d74-7673f4445386 None admin] Validating token access rules against request {{(pid=416293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:09:49.874004 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ecdd72e-d61c-42ec-9d44-0247a746ff3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:09:49.874642 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ecdd72e-d61c-42ec-9d44-0247a746ff3c None admin] REQUEST_METHOD: `GET` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:09:49.874927 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ecdd72e-d61c-42ec-9d44-0247a746ff3c None admin] SCRIPT_NAME: `/identity` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:09:49.875204 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ecdd72e-d61c-42ec-9d44-0247a746ff3c None admin] PATH_INFO: `/v3/domains` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:09:49.875912 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ecdd72e-d61c-42ec-9d44-0247a746ff3c None admin] RBAC: Adding query filter params (name=Default) {{(pid=416293) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 09:09:49.876215 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ecdd72e-d61c-42ec-9d44-0247a746ff3c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:09:49.877643 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ecdd72e-d61c-42ec-9d44-0247a746ff3c None admin] RBAC: Authorization granted {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:09:49.890898 dv-cinder-851351-1-smb devstack@keystone.service[416293]: [pid: 416293|app: 0|req: 629/1270] 10.222.0.42 () {56 vars in 1109 bytes} [Thu Jul 28 09:09:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:09:49.897139 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d43d9d-00be-4373-adc5-69625ffc644f None admin] Authenticating user token {{(pid=416294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:09:49.932368 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG dbcounter [-] [416294] Writing DB stats keystone:SELECT=100 {{(pid=416294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:09:50.011691 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d43d9d-00be-4373-adc5-69625ffc644f None admin] Validating token access rules against request {{(pid=416294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:09:50.048822 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cce6d5c-3a95-465a-bcbd-8a4430a10f5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:09:50.049489 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cce6d5c-3a95-465a-bcbd-8a4430a10f5e None admin] REQUEST_METHOD: `GET` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:09:50.049766 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cce6d5c-3a95-465a-bcbd-8a4430a10f5e None admin] SCRIPT_NAME: `/identity` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:09:50.050038 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cce6d5c-3a95-465a-bcbd-8a4430a10f5e None admin] PATH_INFO: `/v3/projects/service` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:09:50.058155 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cce6d5c-3a95-465a-bcbd-8a4430a10f5e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:09:50.059914 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cce6d5c-3a95-465a-bcbd-8a4430a10f5e None admin] RBAC: Authorization granted {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:09:50.073260 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application [None req-2cce6d5c-3a95-465a-bcbd-8a4430a10f5e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 09:09:50.073260 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 09:09:50.073260 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 09:09:50.073260 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 09:09:50.073260 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 09:09:50.073260 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 09:09:50.073260 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 09:09:50.073260 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 09:09:50.073260 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 09:09:50.073260 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 09:09:50.073260 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 09:09:50.073260 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 09:09:50.073260 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 28 09:09:50.073260 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 28 09:09:50.073260 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 28 09:09:50.075201 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 28 09:09:50.075201 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 09:09:50.075201 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 09:09:50.075201 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 09:09:50.075201 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 09:09:50.075201 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 09:09:50.075201 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 09:09:50.075201 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 09:09:50.075201 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application with Lock( Jul 28 09:09:50.075201 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 09:09:50.075201 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return self._enter() Jul 28 09:09:50.075201 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 09:09:50.075201 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 09:09:50.075201 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 09:09:50.075201 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return self.creator() Jul 28 09:09:50.075201 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 09:09:50.075201 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application created_value = creator( Jul 28 09:09:50.077435 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 28 09:09:50.077435 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 28 09:09:50.077435 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 28 09:09:50.077435 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 28 09:09:50.077435 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 28 09:09:50.077435 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 28 09:09:50.077435 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 09:09:50.077435 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application Jul 28 09:09:50.077435 dv-cinder-851351-1-smb devstack@keystone.service[416294]: [pid: 416294|app: 0|req: 642/1271] 10.222.0.42 () {56 vars in 1111 bytes} [Thu Jul 28 09:09:49 2022] GET /identity/v3/projects/service => generated 88 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 09:09:50.082315 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ecdd72e-d61c-42ec-9d44-0247a746ff3c None admin] Authenticating user token {{(pid=416293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:09:50.149875 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG dbcounter [-] [416293] Writing DB stats keystone:SELECT=100 {{(pid=416293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:09:50.197370 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ecdd72e-d61c-42ec-9d44-0247a746ff3c None admin] Validating token access rules against request {{(pid=416293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:09:50.236105 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b11fb23-636d-4b13-8477-671a1e25dcf9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:09:50.236657 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b11fb23-636d-4b13-8477-671a1e25dcf9 None admin] REQUEST_METHOD: `GET` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:09:50.236952 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b11fb23-636d-4b13-8477-671a1e25dcf9 None admin] SCRIPT_NAME: `/identity` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:09:50.237259 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b11fb23-636d-4b13-8477-671a1e25dcf9 None admin] PATH_INFO: `/v3/projects` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:09:50.238026 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b11fb23-636d-4b13-8477-671a1e25dcf9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=416293) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 09:09:50.238335 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b11fb23-636d-4b13-8477-671a1e25dcf9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:09:50.239802 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b11fb23-636d-4b13-8477-671a1e25dcf9 None admin] RBAC: Authorization granted {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:09:50.253755 dv-cinder-851351-1-smb devstack@keystone.service[416293]: [pid: 416293|app: 0|req: 630/1272] 10.222.0.42 () {56 vars in 1148 bytes} [Thu Jul 28 09:09:50 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:09:50.260103 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cce6d5c-3a95-465a-bcbd-8a4430a10f5e None admin] Authenticating user token {{(pid=416294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:09:50.363109 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG dbcounter [-] [416294] Writing DB stats keystone:SELECT=100 {{(pid=416294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:09:50.373527 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cce6d5c-3a95-465a-bcbd-8a4430a10f5e None admin] Validating token access rules against request {{(pid=416294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:09:50.410967 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aefaa122-d2c7-47a9-8a3c-cd2d1dccda8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:09:50.411653 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aefaa122-d2c7-47a9-8a3c-cd2d1dccda8c None admin] REQUEST_METHOD: `PUT` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:09:50.411932 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aefaa122-d2c7-47a9-8a3c-cd2d1dccda8c None admin] SCRIPT_NAME: `/identity` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:09:50.412216 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aefaa122-d2c7-47a9-8a3c-cd2d1dccda8c None admin] PATH_INFO: `/v3/projects/6c4349445f224184b093d9dfd0dfc642/users/72e6aedb591140ca936b41c52bc0d470/roles/c67085ec338243df8f9b7d6459036e23` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:09:50.414352 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aefaa122-d2c7-47a9-8a3c-cd2d1dccda8c None admin] RBAC: Authorizing `identity:create_grant(project_id=6c4349445f224184b093d9dfd0dfc642, user_id=72e6aedb591140ca936b41c52bc0d470, role_id=c67085ec338243df8f9b7d6459036e23)` {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:09:50.415828 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aefaa122-d2c7-47a9-8a3c-cd2d1dccda8c None admin] RBAC: Authorization granted {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:09:50.435967 dv-cinder-851351-1-smb devstack@keystone.service[416294]: [pid: 416294|app: 0|req: 643/1273] 10.222.0.42 () {58 vars in 1439 bytes} [Thu Jul 28 09:09:50 2022] PUT /identity/v3/projects/6c4349445f224184b093d9dfd0dfc642/users/72e6aedb591140ca936b41c52bc0d470/roles/c67085ec338243df8f9b7d6459036e23 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 09:09:52.517550 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2dc52b-cec3-4408-90cd-6d214c0eb0a9 None None] REQUEST_METHOD: `GET` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:09:52.518230 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2dc52b-cec3-4408-90cd-6d214c0eb0a9 None None] SCRIPT_NAME: `/identity` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:09:52.518230 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2dc52b-cec3-4408-90cd-6d214c0eb0a9 None None] PATH_INFO: `/` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:09:52.519666 dv-cinder-851351-1-smb devstack@keystone.service[416293]: [pid: 416293|app: 0|req: 631/1274] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 09:09:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 09:09:52.528271 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f03d3ac-8be1-4f24-9b5d-4e9782649186 None None] REQUEST_METHOD: `POST` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:09:52.528880 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f03d3ac-8be1-4f24-9b5d-4e9782649186 None None] SCRIPT_NAME: `/identity` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:09:52.528880 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f03d3ac-8be1-4f24-9b5d-4e9782649186 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:09:52.548490 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.auth.core [None req-8f03d3ac-8be1-4f24-9b5d-4e9782649186 None None] MFA Rules not processed for user `dbf87abab90e4fdf9e75408f4199918e`. Rule list: `[]` (Enabled: `True`). {{(pid=416294) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 09:09:52.549635 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.fernet_utils [None req-8f03d3ac-8be1-4f24-9b5d-4e9782649186 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=416294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 09:09:52.627847 dv-cinder-851351-1-smb devstack@keystone.service[416294]: [pid: 416294|app: 0|req: 644/1275] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 09:09:52 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 09:09:52.651564 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a2dc52b-cec3-4408-90cd-6d214c0eb0a9 None None] Authenticating user token {{(pid=416293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:09:52.812530 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a2dc52b-cec3-4408-90cd-6d214c0eb0a9 None None] Validating token access rules against request {{(pid=416293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:09:52.848207 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG dbcounter [-] [416293] Writing DB stats keystone:SELECT=100 {{(pid=416293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:09:52.879004 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4036b38c-51c8-4f45-af0f-3cc7483f2e3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:09:52.880079 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4036b38c-51c8-4f45-af0f-3cc7483f2e3f None admin] REQUEST_METHOD: `GET` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:09:52.880569 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4036b38c-51c8-4f45-af0f-3cc7483f2e3f None admin] SCRIPT_NAME: `/identity` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:09:52.881093 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4036b38c-51c8-4f45-af0f-3cc7483f2e3f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:09:52.901047 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4036b38c-51c8-4f45-af0f-3cc7483f2e3f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 09:09:52.911214 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application [None req-4036b38c-51c8-4f45-af0f-3cc7483f2e3f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 09:09:52.911214 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 09:09:52.911214 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 09:09:52.911214 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 09:09:52.911214 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 09:09:52.911214 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 09:09:52.911214 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 09:09:52.911214 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 09:09:52.911214 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 09:09:52.911214 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 09:09:52.911214 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 09:09:52.911214 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 09:09:52.911214 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 09:09:52.911214 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 09:09:52.911214 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 09:09:52.911214 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 09:09:52.912808 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 09:09:52.912808 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 09:09:52.912808 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 09:09:52.912808 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 09:09:52.912808 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 09:09:52.912808 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 09:09:52.912808 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 09:09:52.912808 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 09:09:52.912808 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 09:09:52.912808 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 09:09:52.912808 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 09:09:52.912808 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application with Lock( Jul 28 09:09:52.912808 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 09:09:52.912808 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self._enter() Jul 28 09:09:52.912808 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 09:09:52.912808 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 09:09:52.914606 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 09:09:52.914606 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self.creator() Jul 28 09:09:52.914606 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 09:09:52.914606 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application created_value = creator( Jul 28 09:09:52.914606 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 09:09:52.914606 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 09:09:52.914606 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 09:09:52.914606 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 09:09:52.914606 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 09:09:52.914606 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 09:09:52.914606 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 09:09:52.914606 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application Jul 28 09:09:52.914606 dv-cinder-851351-1-smb devstack@keystone.service[416293]: [pid: 416293|app: 0|req: 632/1276] 10.222.0.42 () {56 vars in 1096 bytes} [Thu Jul 28 09:09:52 2022] GET /identity/v3/roles/admin => generated 83 bytes in 262 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 09:09:52.921283 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f03d3ac-8be1-4f24-9b5d-4e9782649186 None None] Authenticating user token {{(pid=416294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:09:53.015103 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG dbcounter [-] [416294] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=416294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:09:53.036609 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f03d3ac-8be1-4f24-9b5d-4e9782649186 None None] Validating token access rules against request {{(pid=416294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:09:53.072920 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a81d0aee-34ba-495a-af80-f88fad4e62aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:09:53.073478 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81d0aee-34ba-495a-af80-f88fad4e62aa None admin] REQUEST_METHOD: `GET` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:09:53.073765 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81d0aee-34ba-495a-af80-f88fad4e62aa None admin] SCRIPT_NAME: `/identity` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:09:53.074042 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81d0aee-34ba-495a-af80-f88fad4e62aa None admin] PATH_INFO: `/v3/roles` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:09:53.074863 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a81d0aee-34ba-495a-af80-f88fad4e62aa None admin] RBAC: Adding query filter params (name=admin) {{(pid=416294) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 09:09:53.075160 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a81d0aee-34ba-495a-af80-f88fad4e62aa None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:09:53.076568 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a81d0aee-34ba-495a-af80-f88fad4e62aa None admin] RBAC: Authorization granted {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:09:53.085882 dv-cinder-851351-1-smb devstack@keystone.service[416294]: [pid: 416294|app: 0|req: 645/1277] 10.222.0.42 () {56 vars in 1099 bytes} [Thu Jul 28 09:09:52 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:09:53.092238 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4036b38c-51c8-4f45-af0f-3cc7483f2e3f None admin] Authenticating user token {{(pid=416293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:09:53.198966 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4036b38c-51c8-4f45-af0f-3cc7483f2e3f None admin] Validating token access rules against request {{(pid=416293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:09:53.235080 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9a7f9d-5c27-486b-b660-86b6bda2519c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:09:53.235741 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9a7f9d-5c27-486b-b660-86b6bda2519c None admin] REQUEST_METHOD: `GET` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:09:53.236024 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9a7f9d-5c27-486b-b660-86b6bda2519c None admin] SCRIPT_NAME: `/identity` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:09:53.236302 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9a7f9d-5c27-486b-b660-86b6bda2519c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:09:53.247126 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f9a7f9d-5c27-486b-b660-86b6bda2519c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:09:53.248593 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f9a7f9d-5c27-486b-b660-86b6bda2519c None admin] RBAC: Authorization granted {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:09:53.263840 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application [None req-0f9a7f9d-5c27-486b-b660-86b6bda2519c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 09:09:53.263840 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 09:09:53.263840 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 09:09:53.263840 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 09:09:53.263840 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 09:09:53.263840 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 09:09:53.263840 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 09:09:53.263840 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 09:09:53.263840 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 09:09:53.263840 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 09:09:53.263840 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 09:09:53.263840 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 09:09:53.263840 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 09:09:53.263840 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 09:09:53.263840 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 09:09:53.264993 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 09:09:53.264993 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 09:09:53.264993 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 09:09:53.264993 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 09:09:53.264993 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 09:09:53.264993 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 09:09:53.264993 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 09:09:53.264993 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 09:09:53.264993 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application with Lock( Jul 28 09:09:53.264993 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 09:09:53.264993 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self._enter() Jul 28 09:09:53.264993 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 09:09:53.264993 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 09:09:53.264993 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 09:09:53.264993 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self.creator() Jul 28 09:09:53.264993 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 09:09:53.264993 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application created_value = creator( Jul 28 09:09:53.266139 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 09:09:53.266139 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 09:09:53.266139 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 09:09:53.266139 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application Jul 28 09:09:53.266139 dv-cinder-851351-1-smb devstack@keystone.service[416293]: [pid: 416293|app: 0|req: 633/1278] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 09:09:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 09:09:53.271329 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a81d0aee-34ba-495a-af80-f88fad4e62aa None admin] Authenticating user token {{(pid=416294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:09:53.378184 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a81d0aee-34ba-495a-af80-f88fad4e62aa None admin] Validating token access rules against request {{(pid=416294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:09:53.421759 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6853902d-dcda-4c66-b1a9-840d0356ac75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:09:53.422759 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6853902d-dcda-4c66-b1a9-840d0356ac75 None admin] REQUEST_METHOD: `GET` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:09:53.423133 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6853902d-dcda-4c66-b1a9-840d0356ac75 None admin] SCRIPT_NAME: `/identity` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:09:53.423542 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6853902d-dcda-4c66-b1a9-840d0356ac75 None admin] PATH_INFO: `/v3/domains` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:09:53.424559 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6853902d-dcda-4c66-b1a9-840d0356ac75 None admin] RBAC: Adding query filter params (name=Default) {{(pid=416294) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 09:09:53.425104 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6853902d-dcda-4c66-b1a9-840d0356ac75 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:09:53.427024 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6853902d-dcda-4c66-b1a9-840d0356ac75 None admin] RBAC: Authorization granted {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:09:53.446150 dv-cinder-851351-1-smb devstack@keystone.service[416294]: [pid: 416294|app: 0|req: 646/1279] 10.222.0.42 () {56 vars in 1109 bytes} [Thu Jul 28 09:09:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:09:53.453178 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9a7f9d-5c27-486b-b660-86b6bda2519c None admin] Authenticating user token {{(pid=416293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:09:53.505357 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG dbcounter [-] [416293] Writing DB stats keystone:SELECT=100 {{(pid=416293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:09:53.589019 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9a7f9d-5c27-486b-b660-86b6bda2519c None admin] Validating token access rules against request {{(pid=416293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:09:53.626073 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759a7a89-d594-4a12-94c2-a5117bb47d09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:09:53.626729 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759a7a89-d594-4a12-94c2-a5117bb47d09 None admin] REQUEST_METHOD: `GET` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:09:53.627013 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759a7a89-d594-4a12-94c2-a5117bb47d09 None admin] SCRIPT_NAME: `/identity` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:09:53.627281 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759a7a89-d594-4a12-94c2-a5117bb47d09 None admin] PATH_INFO: `/v3/users/placement` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:09:53.635844 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-759a7a89-d594-4a12-94c2-a5117bb47d09 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:09:53.637339 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-759a7a89-d594-4a12-94c2-a5117bb47d09 None admin] RBAC: Authorization granted {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:09:53.649424 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application [None req-759a7a89-d594-4a12-94c2-a5117bb47d09 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 28 09:09:53.649424 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 09:09:53.649424 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 09:09:53.649424 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 09:09:53.649424 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 09:09:53.649424 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 09:09:53.649424 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 09:09:53.649424 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 09:09:53.649424 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 09:09:53.649424 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 09:09:53.649424 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 09:09:53.649424 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 09:09:53.649424 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 28 09:09:53.649424 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 28 09:09:53.649424 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 28 09:09:53.649424 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 28 09:09:53.651160 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 09:09:53.651160 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 09:09:53.651160 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 28 09:09:53.651160 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 09:09:53.651160 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 28 09:09:53.651160 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 09:09:53.651160 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 09:09:53.651160 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 09:09:53.651160 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 09:09:53.651160 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 09:09:53.651160 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 09:09:53.651160 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application with Lock( Jul 28 09:09:53.651160 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 09:09:53.651160 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self._enter() Jul 28 09:09:53.651160 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 09:09:53.651160 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 09:09:53.651160 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 09:09:53.651160 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self.creator() Jul 28 09:09:53.652533 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 09:09:53.652533 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application created_value = creator( Jul 28 09:09:53.652533 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 28 09:09:53.652533 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 28 09:09:53.652533 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 28 09:09:53.652533 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 28 09:09:53.652533 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 28 09:09:53.652533 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 28 09:09:53.652533 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 28 09:09:53.652533 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application Jul 28 09:09:53.652533 dv-cinder-851351-1-smb devstack@keystone.service[416293]: [pid: 416293|app: 0|req: 634/1280] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 09:09:53 2022] GET /identity/v3/users/placement => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 09:09:53.657124 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6853902d-dcda-4c66-b1a9-840d0356ac75 None admin] Authenticating user token {{(pid=416294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:09:53.661396 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG dbcounter [-] [416294] Writing DB stats keystone:SELECT=100 {{(pid=416294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:09:53.766926 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6853902d-dcda-4c66-b1a9-840d0356ac75 None admin] Validating token access rules against request {{(pid=416294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:09:53.804421 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b300a7-0b49-4e76-8688-2b59d739e7bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:09:53.805087 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b300a7-0b49-4e76-8688-2b59d739e7bb None admin] REQUEST_METHOD: `GET` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:09:53.805374 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b300a7-0b49-4e76-8688-2b59d739e7bb None admin] SCRIPT_NAME: `/identity` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:09:53.805649 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b300a7-0b49-4e76-8688-2b59d739e7bb None admin] PATH_INFO: `/v3/users` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:09:53.806458 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22b300a7-0b49-4e76-8688-2b59d739e7bb None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=416294) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 09:09:53.808503 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22b300a7-0b49-4e76-8688-2b59d739e7bb None admin] RBAC: Authorizing `identity:list_users()` {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:09:53.808503 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22b300a7-0b49-4e76-8688-2b59d739e7bb None admin] RBAC: Authorization granted {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:09:53.827545 dv-cinder-851351-1-smb devstack@keystone.service[416294]: [pid: 416294|app: 0|req: 647/1281] 10.222.0.42 () {56 vars in 1143 bytes} [Thu Jul 28 09:09:53 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:09:53.833676 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759a7a89-d594-4a12-94c2-a5117bb47d09 None admin] Authenticating user token {{(pid=416293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:09:53.934001 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG dbcounter [-] [416293] Writing DB stats keystone:SELECT=100 {{(pid=416293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:09:53.946139 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759a7a89-d594-4a12-94c2-a5117bb47d09 None admin] Validating token access rules against request {{(pid=416293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:09:53.984326 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b29959-97c7-448d-817c-62e47ae4ddd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:09:53.985007 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b29959-97c7-448d-817c-62e47ae4ddd5 None admin] REQUEST_METHOD: `GET` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:09:53.985284 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b29959-97c7-448d-817c-62e47ae4ddd5 None admin] SCRIPT_NAME: `/identity` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:09:53.985561 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b29959-97c7-448d-817c-62e47ae4ddd5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:09:54.061356 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69b29959-97c7-448d-817c-62e47ae4ddd5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:09:54.062856 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69b29959-97c7-448d-817c-62e47ae4ddd5 None admin] RBAC: Authorization granted {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:09:54.158187 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG dbcounter [-] [416293] Writing DB stats keystone:SELECT=100 {{(pid=416293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:09:54.169582 dv-cinder-851351-1-smb devstack@keystone.service[416293]: [pid: 416293|app: 0|req: 635/1282] 10.222.0.42 () {58 vars in 1282 bytes} [Thu Jul 28 09:09:53 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 336 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 28 09:09:54.175839 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b300a7-0b49-4e76-8688-2b59d739e7bb None admin] Authenticating user token {{(pid=416294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:09:54.242331 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG dbcounter [-] [416294] Writing DB stats keystone:SELECT=100 {{(pid=416294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:09:54.283169 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b300a7-0b49-4e76-8688-2b59d739e7bb None admin] Validating token access rules against request {{(pid=416294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:09:54.318124 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25645fe8-3811-4ad5-b42a-11b6b5bca737 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:09:54.318787 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25645fe8-3811-4ad5-b42a-11b6b5bca737 None admin] REQUEST_METHOD: `GET` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:09:54.319066 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25645fe8-3811-4ad5-b42a-11b6b5bca737 None admin] SCRIPT_NAME: `/identity` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:09:54.319343 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25645fe8-3811-4ad5-b42a-11b6b5bca737 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:09:54.330729 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25645fe8-3811-4ad5-b42a-11b6b5bca737 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:09:54.332214 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25645fe8-3811-4ad5-b42a-11b6b5bca737 None admin] RBAC: Authorization granted {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:09:54.347808 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application [None req-25645fe8-3811-4ad5-b42a-11b6b5bca737 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 09:09:54.347808 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 09:09:54.347808 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 09:09:54.347808 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 09:09:54.347808 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 09:09:54.347808 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 09:09:54.347808 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 09:09:54.347808 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 09:09:54.347808 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 09:09:54.347808 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 09:09:54.347808 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 09:09:54.347808 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 09:09:54.347808 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 09:09:54.347808 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 09:09:54.347808 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 09:09:54.350078 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 09:09:54.350078 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 09:09:54.350078 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 09:09:54.350078 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 09:09:54.350078 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 09:09:54.350078 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 09:09:54.350078 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 09:09:54.350078 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 09:09:54.350078 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application with Lock( Jul 28 09:09:54.350078 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 09:09:54.350078 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return self._enter() Jul 28 09:09:54.350078 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 09:09:54.350078 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 09:09:54.350078 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 09:09:54.350078 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return self.creator() Jul 28 09:09:54.350078 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 09:09:54.350078 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application created_value = creator( Jul 28 09:09:54.352315 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 09:09:54.352315 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 09:09:54.352315 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 09:09:54.352315 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application Jul 28 09:09:54.352315 dv-cinder-851351-1-smb devstack@keystone.service[416294]: [pid: 416294|app: 0|req: 648/1283] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 09:09:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 09:09:54.355280 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b29959-97c7-448d-817c-62e47ae4ddd5 None admin] Authenticating user token {{(pid=416293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:09:54.477098 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b29959-97c7-448d-817c-62e47ae4ddd5 None admin] Validating token access rules against request {{(pid=416293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:09:54.515337 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d901536-8b47-4fc9-8c5a-f9e30237c233 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:09:54.515893 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d901536-8b47-4fc9-8c5a-f9e30237c233 None admin] REQUEST_METHOD: `GET` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:09:54.516210 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d901536-8b47-4fc9-8c5a-f9e30237c233 None admin] SCRIPT_NAME: `/identity` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:09:54.516496 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d901536-8b47-4fc9-8c5a-f9e30237c233 None admin] PATH_INFO: `/v3/domains` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:09:54.517283 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d901536-8b47-4fc9-8c5a-f9e30237c233 None admin] RBAC: Adding query filter params (name=Default) {{(pid=416293) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 09:09:54.517602 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d901536-8b47-4fc9-8c5a-f9e30237c233 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:09:54.519069 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d901536-8b47-4fc9-8c5a-f9e30237c233 None admin] RBAC: Authorization granted {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:09:54.534248 dv-cinder-851351-1-smb devstack@keystone.service[416293]: [pid: 416293|app: 0|req: 636/1284] 10.222.0.42 () {56 vars in 1109 bytes} [Thu Jul 28 09:09:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:09:54.540466 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25645fe8-3811-4ad5-b42a-11b6b5bca737 None admin] Authenticating user token {{(pid=416294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:09:54.650568 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25645fe8-3811-4ad5-b42a-11b6b5bca737 None admin] Validating token access rules against request {{(pid=416294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:09:54.665630 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG dbcounter [-] [416294] Writing DB stats keystone:SELECT=100 {{(pid=416294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:09:54.688311 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-404e6a4f-f37f-49c2-bcdd-59007ecfc43c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:09:54.689004 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404e6a4f-f37f-49c2-bcdd-59007ecfc43c None admin] REQUEST_METHOD: `GET` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:09:54.689294 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404e6a4f-f37f-49c2-bcdd-59007ecfc43c None admin] SCRIPT_NAME: `/identity` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:09:54.689576 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404e6a4f-f37f-49c2-bcdd-59007ecfc43c None admin] PATH_INFO: `/v3/projects/service` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:09:54.696697 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-404e6a4f-f37f-49c2-bcdd-59007ecfc43c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:09:54.698580 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-404e6a4f-f37f-49c2-bcdd-59007ecfc43c None admin] RBAC: Authorization granted {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:09:54.710513 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application [None req-404e6a4f-f37f-49c2-bcdd-59007ecfc43c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 09:09:54.710513 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 09:09:54.710513 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 09:09:54.710513 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 09:09:54.710513 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 09:09:54.710513 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 09:09:54.710513 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 09:09:54.710513 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 09:09:54.710513 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 09:09:54.710513 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 09:09:54.710513 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 09:09:54.710513 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 09:09:54.710513 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 28 09:09:54.710513 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 28 09:09:54.710513 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 28 09:09:54.712215 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 28 09:09:54.712215 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 09:09:54.712215 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 09:09:54.712215 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 09:09:54.712215 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 09:09:54.712215 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 09:09:54.712215 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 09:09:54.712215 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 09:09:54.712215 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application with Lock( Jul 28 09:09:54.712215 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 09:09:54.712215 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return self._enter() Jul 28 09:09:54.712215 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 09:09:54.712215 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 09:09:54.712215 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 09:09:54.712215 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return self.creator() Jul 28 09:09:54.712215 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 09:09:54.712215 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application created_value = creator( Jul 28 09:09:54.714164 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 28 09:09:54.714164 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 28 09:09:54.714164 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 28 09:09:54.714164 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 28 09:09:54.714164 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 28 09:09:54.714164 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 28 09:09:54.714164 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 09:09:54.714164 dv-cinder-851351-1-smb devstack@keystone.service[416294]: ERROR keystone.server.flask.application Jul 28 09:09:54.716840 dv-cinder-851351-1-smb devstack@keystone.service[416294]: [pid: 416294|app: 0|req: 649/1285] 10.222.0.42 () {56 vars in 1111 bytes} [Thu Jul 28 09:09:54 2022] GET /identity/v3/projects/service => generated 88 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 09:09:54.718855 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d901536-8b47-4fc9-8c5a-f9e30237c233 None admin] Authenticating user token {{(pid=416293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:09:54.808810 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG dbcounter [-] [416293] Writing DB stats keystone:SELECT=100 {{(pid=416293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:09:54.874991 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d901536-8b47-4fc9-8c5a-f9e30237c233 None admin] Validating token access rules against request {{(pid=416293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:09:54.918196 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d07d91-aca6-4ca6-836d-b5feedb52039 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:09:54.919272 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d07d91-aca6-4ca6-836d-b5feedb52039 None admin] REQUEST_METHOD: `GET` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:09:54.919884 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d07d91-aca6-4ca6-836d-b5feedb52039 None admin] SCRIPT_NAME: `/identity` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:09:54.920179 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d07d91-aca6-4ca6-836d-b5feedb52039 None admin] PATH_INFO: `/v3/projects` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:09:54.920991 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00d07d91-aca6-4ca6-836d-b5feedb52039 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=416293) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 09:09:54.921309 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00d07d91-aca6-4ca6-836d-b5feedb52039 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:09:54.922806 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00d07d91-aca6-4ca6-836d-b5feedb52039 None admin] RBAC: Authorization granted {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:09:54.937355 dv-cinder-851351-1-smb devstack@keystone.service[416293]: [pid: 416293|app: 0|req: 637/1286] 10.222.0.42 () {56 vars in 1148 bytes} [Thu Jul 28 09:09:54 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:09:54.943907 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-404e6a4f-f37f-49c2-bcdd-59007ecfc43c None admin] Authenticating user token {{(pid=416294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:09:55.063530 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-404e6a4f-f37f-49c2-bcdd-59007ecfc43c None admin] Validating token access rules against request {{(pid=416294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:09:55.102476 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c96783-1ed2-47b8-8e9c-04bef39288a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:09:55.103101 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c96783-1ed2-47b8-8e9c-04bef39288a9 None admin] REQUEST_METHOD: `GET` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:09:55.103740 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c96783-1ed2-47b8-8e9c-04bef39288a9 None admin] SCRIPT_NAME: `/identity` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:09:55.103740 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c96783-1ed2-47b8-8e9c-04bef39288a9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:09:55.104587 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9c96783-1ed2-47b8-8e9c-04bef39288a9 None admin] RBAC: Adding query filter params (role.id=c67085ec338243df8f9b7d6459036e23, scope.project.id=6c4349445f224184b093d9dfd0dfc642, user.id=72e6aedb591140ca936b41c52bc0d470) {{(pid=416294) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 09:09:55.104836 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9c96783-1ed2-47b8-8e9c-04bef39288a9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:09:55.106432 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9c96783-1ed2-47b8-8e9c-04bef39288a9 None admin] RBAC: Authorization granted {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:09:55.114394 dv-cinder-851351-1-smb devstack@keystone.service[416294]: [pid: 416294|app: 0|req: 650/1287] 10.222.0.42 () {56 vars in 1374 bytes} [Thu Jul 28 09:09:54 2022] GET /identity/v3/role_assignments?user.id=72e6aedb591140ca936b41c52bc0d470&scope.project.id=6c4349445f224184b093d9dfd0dfc642&role.id=c67085ec338243df8f9b7d6459036e23 => generated 608 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:09:57.220829 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e99fedb-b418-466f-908e-7cbabcc90d43 None None] REQUEST_METHOD: `GET` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:09:57.221390 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e99fedb-b418-466f-908e-7cbabcc90d43 None None] SCRIPT_NAME: `/identity` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:09:57.221390 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e99fedb-b418-466f-908e-7cbabcc90d43 None None] PATH_INFO: `/` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:09:57.222712 dv-cinder-851351-1-smb devstack@keystone.service[416293]: [pid: 416293|app: 0|req: 638/1288] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 09:09:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 09:09:57.228531 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c4c9af-7279-4792-b18d-9a1169c86a48 None None] REQUEST_METHOD: `POST` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:09:57.229176 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c4c9af-7279-4792-b18d-9a1169c86a48 None None] SCRIPT_NAME: `/identity` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:09:57.229176 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c4c9af-7279-4792-b18d-9a1169c86a48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:09:57.248636 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.auth.core [None req-73c4c9af-7279-4792-b18d-9a1169c86a48 None None] MFA Rules not processed for user `dbf87abab90e4fdf9e75408f4199918e`. Rule list: `[]` (Enabled: `True`). {{(pid=416294) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 09:09:57.249925 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.fernet_utils [None req-73c4c9af-7279-4792-b18d-9a1169c86a48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=416294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 09:09:57.284561 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG dbcounter [-] [416294] Writing DB stats keystone:SELECT=100 {{(pid=416294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:09:57.327175 dv-cinder-851351-1-smb devstack@keystone.service[416294]: [pid: 416294|app: 0|req: 651/1289] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 09:09:57 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 09:09:57.350319 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e99fedb-b418-466f-908e-7cbabcc90d43 None None] Authenticating user token {{(pid=416293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:09:57.496195 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e99fedb-b418-466f-908e-7cbabcc90d43 None None] Validating token access rules against request {{(pid=416293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:09:57.509139 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG dbcounter [-] [416293] Writing DB stats keystone:SELECT=100 {{(pid=416293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:09:57.538867 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a3e976-1b9f-450d-bca8-38aa0547d38f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:09:57.539561 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a3e976-1b9f-450d-bca8-38aa0547d38f None admin] REQUEST_METHOD: `GET` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:09:57.539853 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a3e976-1b9f-450d-bca8-38aa0547d38f None admin] SCRIPT_NAME: `/identity` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:09:57.540131 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a3e976-1b9f-450d-bca8-38aa0547d38f None admin] PATH_INFO: `/v3/services/placement` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:09:57.540850 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a3e976-1b9f-450d-bca8-38aa0547d38f None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:09:57.542325 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a3e976-1b9f-450d-bca8-38aa0547d38f None admin] RBAC: Authorization granted {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:09:57.552380 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application [None req-c3a3e976-1b9f-450d-bca8-38aa0547d38f None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jul 28 09:09:57.552380 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 09:09:57.552380 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 28 09:09:57.552380 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 28 09:09:57.552380 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 28 09:09:57.552380 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 28 09:09:57.552380 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 28 09:09:57.552380 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 09:09:57.552380 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 28 09:09:57.552380 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application Jul 28 09:09:57.552380 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 28 09:09:57.552380 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application Jul 28 09:09:57.552380 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 09:09:57.552380 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 09:09:57.552380 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 09:09:57.552380 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 09:09:57.552380 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 09:09:57.554013 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 09:09:57.554013 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 09:09:57.554013 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 09:09:57.554013 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 09:09:57.554013 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 09:09:57.554013 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 09:09:57.554013 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 28 09:09:57.554013 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 28 09:09:57.554013 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 28 09:09:57.554013 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 28 09:09:57.554013 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 09:09:57.554013 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 09:09:57.554013 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 09:09:57.554013 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 09:09:57.554013 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 09:09:57.554013 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 09:09:57.555221 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 09:09:57.555221 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application with Lock( Jul 28 09:09:57.555221 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 09:09:57.555221 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self._enter() Jul 28 09:09:57.555221 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 09:09:57.555221 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 09:09:57.555221 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 09:09:57.555221 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self.creator() Jul 28 09:09:57.555221 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 09:09:57.555221 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application created_value = creator( Jul 28 09:09:57.555221 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 28 09:09:57.555221 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 09:09:57.555221 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 28 09:09:57.555221 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application Jul 28 09:09:57.555221 dv-cinder-851351-1-smb devstack@keystone.service[416293]: [pid: 416293|app: 0|req: 639/1290] 10.222.0.42 () {56 vars in 1117 bytes} [Thu Jul 28 09:09:57 2022] GET /identity/v3/services/placement => generated 90 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 09:09:57.560226 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c4c9af-7279-4792-b18d-9a1169c86a48 None None] Authenticating user token {{(pid=416294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:09:57.671175 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c4c9af-7279-4792-b18d-9a1169c86a48 None None] Validating token access rules against request {{(pid=416294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:09:57.708814 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b4815d-c34b-4aae-825d-c6b2b60c8793 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:09:57.709445 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b4815d-c34b-4aae-825d-c6b2b60c8793 None admin] REQUEST_METHOD: `GET` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:09:57.709699 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b4815d-c34b-4aae-825d-c6b2b60c8793 None admin] SCRIPT_NAME: `/identity` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:09:57.710005 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b4815d-c34b-4aae-825d-c6b2b60c8793 None admin] PATH_INFO: `/v3/services` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:09:57.710691 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55b4815d-c34b-4aae-825d-c6b2b60c8793 None admin] RBAC: Adding query filter params (name=placement) {{(pid=416294) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 09:09:57.710994 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55b4815d-c34b-4aae-825d-c6b2b60c8793 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:09:57.712385 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55b4815d-c34b-4aae-825d-c6b2b60c8793 None admin] RBAC: Authorization granted {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:09:57.718467 dv-cinder-851351-1-smb devstack@keystone.service[416294]: [pid: 416294|app: 0|req: 652/1291] 10.222.0.42 () {56 vars in 1116 bytes} [Thu Jul 28 09:09:57 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:09:57.724643 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a3e976-1b9f-450d-bca8-38aa0547d38f None admin] Authenticating user token {{(pid=416293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:09:57.832115 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a3e976-1b9f-450d-bca8-38aa0547d38f None admin] Validating token access rules against request {{(pid=416293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:09:57.872216 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d3e665-38e0-4c14-ad42-8df6513da92a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:09:57.872897 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d3e665-38e0-4c14-ad42-8df6513da92a None admin] REQUEST_METHOD: `GET` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:09:57.873188 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d3e665-38e0-4c14-ad42-8df6513da92a None admin] SCRIPT_NAME: `/identity` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:09:57.873460 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d3e665-38e0-4c14-ad42-8df6513da92a None admin] PATH_INFO: `/v3/services` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:09:57.874185 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8d3e665-38e0-4c14-ad42-8df6513da92a None admin] RBAC: Adding query filter params (type=placement) {{(pid=416293) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 09:09:57.874499 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8d3e665-38e0-4c14-ad42-8df6513da92a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:09:57.875976 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8d3e665-38e0-4c14-ad42-8df6513da92a None admin] RBAC: Authorization granted {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:09:57.881903 dv-cinder-851351-1-smb devstack@keystone.service[416293]: [pid: 416293|app: 0|req: 640/1292] 10.222.0.42 () {56 vars in 1116 bytes} [Thu Jul 28 09:09:57 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:09:59.973705 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305c87be-f8a1-4318-b079-80a6d9e6ee12 None None] REQUEST_METHOD: `GET` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:09:59.974281 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305c87be-f8a1-4318-b079-80a6d9e6ee12 None None] SCRIPT_NAME: `/identity` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:09:59.974281 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305c87be-f8a1-4318-b079-80a6d9e6ee12 None None] PATH_INFO: `/` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:09:59.975678 dv-cinder-851351-1-smb devstack@keystone.service[416294]: [pid: 416294|app: 0|req: 653/1293] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 09:09:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 09:09:59.982352 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b42e19-c374-42d2-b3d8-a094838644a4 None None] REQUEST_METHOD: `POST` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:09:59.982907 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b42e19-c374-42d2-b3d8-a094838644a4 None None] SCRIPT_NAME: `/identity` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:09:59.983013 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b42e19-c374-42d2-b3d8-a094838644a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:10:00.003879 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.auth.core [None req-13b42e19-c374-42d2-b3d8-a094838644a4 None None] MFA Rules not processed for user `dbf87abab90e4fdf9e75408f4199918e`. Rule list: `[]` (Enabled: `True`). {{(pid=416293) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 09:10:00.005203 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.fernet_utils [None req-13b42e19-c374-42d2-b3d8-a094838644a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=416293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 09:10:00.043322 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG dbcounter [-] [416293] Writing DB stats keystone:SELECT=100 {{(pid=416293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:10:00.089369 dv-cinder-851351-1-smb devstack@keystone.service[416293]: [pid: 416293|app: 0|req: 641/1294] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 09:09:59 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 09:10:00.115073 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-305c87be-f8a1-4318-b079-80a6d9e6ee12 None None] Authenticating user token {{(pid=416294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:10:00.148820 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG dbcounter [-] [416294] Writing DB stats keystone:SELECT=100 {{(pid=416294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:10:00.224798 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-305c87be-f8a1-4318-b079-80a6d9e6ee12 None None] Validating token access rules against request {{(pid=416294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:10:00.261458 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a2a748-c317-4c61-945a-99991a43783e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:10:00.262114 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a2a748-c317-4c61-945a-99991a43783e None admin] REQUEST_METHOD: `POST` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:10:00.262397 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a2a748-c317-4c61-945a-99991a43783e None admin] SCRIPT_NAME: `/identity` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:10:00.262671 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a2a748-c317-4c61-945a-99991a43783e None admin] PATH_INFO: `/v3/services` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:10:00.263390 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a2a748-c317-4c61-945a-99991a43783e None admin] RBAC: Authorizing `identity:create_service()` {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:10:00.264806 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a2a748-c317-4c61-945a-99991a43783e None admin] RBAC: Authorization granted {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:10:00.282772 dv-cinder-851351-1-smb devstack@keystone.service[416294]: [pid: 416294|app: 0|req: 654/1295] 10.222.0.42 () {60 vars in 1141 bytes} [Thu Jul 28 09:10:00 2022] POST /identity/v3/services => generated 246 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 09:10:02.337484 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e76dce-5acf-42b5-a57e-92fcda13c3aa None None] REQUEST_METHOD: `GET` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:10:02.338120 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e76dce-5acf-42b5-a57e-92fcda13c3aa None None] SCRIPT_NAME: `/identity` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:10:02.338120 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e76dce-5acf-42b5-a57e-92fcda13c3aa None None] PATH_INFO: `/` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:10:02.339509 dv-cinder-851351-1-smb devstack@keystone.service[416293]: [pid: 416293|app: 0|req: 642/1296] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 09:10:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 09:10:02.345761 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee3bc1f-cde3-4d71-8cc9-2f06e8b8b0a6 None None] REQUEST_METHOD: `POST` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:10:02.346286 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee3bc1f-cde3-4d71-8cc9-2f06e8b8b0a6 None None] SCRIPT_NAME: `/identity` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:10:02.346417 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee3bc1f-cde3-4d71-8cc9-2f06e8b8b0a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:10:02.367151 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.auth.core [None req-cee3bc1f-cde3-4d71-8cc9-2f06e8b8b0a6 None None] MFA Rules not processed for user `dbf87abab90e4fdf9e75408f4199918e`. Rule list: `[]` (Enabled: `True`). {{(pid=416294) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 09:10:02.368411 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.fernet_utils [None req-cee3bc1f-cde3-4d71-8cc9-2f06e8b8b0a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=416294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 09:10:02.461654 dv-cinder-851351-1-smb devstack@keystone.service[416294]: [pid: 416294|app: 0|req: 655/1297] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 09:10:02 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 09:10:02.484880 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e76dce-5acf-42b5-a57e-92fcda13c3aa None None] Authenticating user token {{(pid=416293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:10:02.602100 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e76dce-5acf-42b5-a57e-92fcda13c3aa None None] Validating token access rules against request {{(pid=416293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:10:02.644428 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef18878b-e5ba-4ca3-8947-d951389a97f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:10:02.645134 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef18878b-e5ba-4ca3-8947-d951389a97f2 None admin] REQUEST_METHOD: `GET` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:10:02.645434 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef18878b-e5ba-4ca3-8947-d951389a97f2 None admin] SCRIPT_NAME: `/identity` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:10:02.645712 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef18878b-e5ba-4ca3-8947-d951389a97f2 None admin] PATH_INFO: `/v3/services/placement` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:10:02.646362 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef18878b-e5ba-4ca3-8947-d951389a97f2 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:10:02.647778 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef18878b-e5ba-4ca3-8947-d951389a97f2 None admin] RBAC: Authorization granted {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:10:02.658071 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application [None req-ef18878b-e5ba-4ca3-8947-d951389a97f2 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jul 28 09:10:02.658071 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 09:10:02.658071 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 28 09:10:02.658071 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 28 09:10:02.658071 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 28 09:10:02.658071 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 28 09:10:02.658071 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 28 09:10:02.658071 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 09:10:02.658071 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 28 09:10:02.658071 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application Jul 28 09:10:02.658071 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 28 09:10:02.658071 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application Jul 28 09:10:02.658071 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 09:10:02.658071 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 09:10:02.658071 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 09:10:02.658071 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 09:10:02.658071 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 09:10:02.660071 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 09:10:02.660071 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 09:10:02.660071 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 09:10:02.660071 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 09:10:02.660071 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 09:10:02.660071 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 09:10:02.660071 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 28 09:10:02.660071 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 28 09:10:02.660071 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 28 09:10:02.660071 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 28 09:10:02.660071 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 09:10:02.660071 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 09:10:02.660071 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 09:10:02.660071 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 09:10:02.660071 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 09:10:02.660071 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 09:10:02.661927 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 09:10:02.661927 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application with Lock( Jul 28 09:10:02.661927 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 09:10:02.661927 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self._enter() Jul 28 09:10:02.661927 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 09:10:02.661927 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 09:10:02.661927 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 09:10:02.661927 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self.creator() Jul 28 09:10:02.661927 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 09:10:02.661927 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application created_value = creator( Jul 28 09:10:02.661927 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 28 09:10:02.661927 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 09:10:02.661927 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 28 09:10:02.661927 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application Jul 28 09:10:02.661927 dv-cinder-851351-1-smb devstack@keystone.service[416293]: [pid: 416293|app: 0|req: 643/1298] 10.222.0.42 () {56 vars in 1117 bytes} [Thu Jul 28 09:10:02 2022] GET /identity/v3/services/placement => generated 90 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 09:10:02.667805 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee3bc1f-cde3-4d71-8cc9-2f06e8b8b0a6 None None] Authenticating user token {{(pid=416294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:10:02.688930 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG dbcounter [-] [416294] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=416294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:10:02.778921 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee3bc1f-cde3-4d71-8cc9-2f06e8b8b0a6 None None] Validating token access rules against request {{(pid=416294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:10:02.817476 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da11ed9b-8b1f-4cb3-b5e7-c0b4d1869f9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:10:02.818112 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da11ed9b-8b1f-4cb3-b5e7-c0b4d1869f9a None admin] REQUEST_METHOD: `GET` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:10:02.818398 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da11ed9b-8b1f-4cb3-b5e7-c0b4d1869f9a None admin] SCRIPT_NAME: `/identity` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:10:02.818676 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da11ed9b-8b1f-4cb3-b5e7-c0b4d1869f9a None admin] PATH_INFO: `/v3/services` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:10:02.819376 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da11ed9b-8b1f-4cb3-b5e7-c0b4d1869f9a None admin] RBAC: Adding query filter params (name=placement) {{(pid=416294) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 09:10:02.819684 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da11ed9b-8b1f-4cb3-b5e7-c0b4d1869f9a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:10:02.821109 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da11ed9b-8b1f-4cb3-b5e7-c0b4d1869f9a None admin] RBAC: Authorization granted {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:10:02.827429 dv-cinder-851351-1-smb devstack@keystone.service[416294]: [pid: 416294|app: 0|req: 656/1299] 10.222.0.42 () {56 vars in 1116 bytes} [Thu Jul 28 09:10:02 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:10:02.834041 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef18878b-e5ba-4ca3-8947-d951389a97f2 None admin] Authenticating user token {{(pid=416293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:10:02.870593 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG dbcounter [-] [416293] Writing DB stats keystone:SELECT=100 {{(pid=416293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:10:02.950286 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef18878b-e5ba-4ca3-8947-d951389a97f2 None admin] Validating token access rules against request {{(pid=416293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:10:02.986620 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1e7f78-3e63-46a2-bb8d-e9ad2870849d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:10:02.987268 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1e7f78-3e63-46a2-bb8d-e9ad2870849d None admin] REQUEST_METHOD: `GET` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:10:02.987555 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1e7f78-3e63-46a2-bb8d-e9ad2870849d None admin] SCRIPT_NAME: `/identity` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:10:02.987832 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1e7f78-3e63-46a2-bb8d-e9ad2870849d None admin] PATH_INFO: `/v3/endpoints` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:10:02.988602 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b1e7f78-3e63-46a2-bb8d-e9ad2870849d None admin] RBAC: Adding query filter params (interface=public, service_id=9070a44bc769420b8c70734feab0864c, region_id=RegionOne) {{(pid=416293) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 09:10:02.988941 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b1e7f78-3e63-46a2-bb8d-e9ad2870849d None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:10:02.990338 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b1e7f78-3e63-46a2-bb8d-e9ad2870849d None admin] RBAC: Authorization granted {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:10:02.997511 dv-cinder-851351-1-smb devstack@keystone.service[416293]: [pid: 416293|app: 0|req: 644/1300] 10.222.0.42 () {56 vars in 1251 bytes} [Thu Jul 28 09:10:02 2022] GET /identity/v3/endpoints?service_id=9070a44bc769420b8c70734feab0864c&interface=public®ion_id=RegionOne => generated 194 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:10:03.003513 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da11ed9b-8b1f-4cb3-b5e7-c0b4d1869f9a None admin] Authenticating user token {{(pid=416294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:10:03.090097 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG dbcounter [-] [416294] Writing DB stats keystone:SELECT=100 {{(pid=416294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:10:03.114489 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da11ed9b-8b1f-4cb3-b5e7-c0b4d1869f9a None admin] Validating token access rules against request {{(pid=416294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:10:03.156479 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71f9366-34ec-43d4-9ff2-b6f5a5c18f00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:10:03.157071 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71f9366-34ec-43d4-9ff2-b6f5a5c18f00 None admin] REQUEST_METHOD: `GET` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:10:03.157366 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71f9366-34ec-43d4-9ff2-b6f5a5c18f00 None admin] SCRIPT_NAME: `/identity` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:10:03.157639 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71f9366-34ec-43d4-9ff2-b6f5a5c18f00 None admin] PATH_INFO: `/v3/services` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:10:03.158335 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a71f9366-34ec-43d4-9ff2-b6f5a5c18f00 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:10:03.159766 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a71f9366-34ec-43d4-9ff2-b6f5a5c18f00 None admin] RBAC: Authorization granted {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:10:03.167786 dv-cinder-851351-1-smb devstack@keystone.service[416294]: [pid: 416294|app: 0|req: 657/1301] 10.222.0.42 () {56 vars in 1087 bytes} [Thu Jul 28 09:10:03 2022] GET /identity/v3/services => generated 2191 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 09:10:05.232954 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb5524f-4b18-408d-95e6-4c41d1d2fde6 None None] REQUEST_METHOD: `GET` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:10:05.233619 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb5524f-4b18-408d-95e6-4c41d1d2fde6 None None] SCRIPT_NAME: `/identity` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:10:05.233619 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb5524f-4b18-408d-95e6-4c41d1d2fde6 None None] PATH_INFO: `/` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:10:05.234894 dv-cinder-851351-1-smb devstack@keystone.service[416293]: [pid: 416293|app: 0|req: 645/1302] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 09:10:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 09:10:05.241159 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ef0c41-ae76-4f11-acd5-a4dfbbf2009b None None] REQUEST_METHOD: `POST` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:10:05.241765 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ef0c41-ae76-4f11-acd5-a4dfbbf2009b None None] SCRIPT_NAME: `/identity` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:10:05.241765 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ef0c41-ae76-4f11-acd5-a4dfbbf2009b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:10:05.260533 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.auth.core [None req-81ef0c41-ae76-4f11-acd5-a4dfbbf2009b None None] MFA Rules not processed for user `dbf87abab90e4fdf9e75408f4199918e`. Rule list: `[]` (Enabled: `True`). {{(pid=416294) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 09:10:05.261800 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.fernet_utils [None req-81ef0c41-ae76-4f11-acd5-a4dfbbf2009b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=416294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 09:10:05.334067 dv-cinder-851351-1-smb devstack@keystone.service[416294]: [pid: 416294|app: 0|req: 658/1303] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 09:10:05 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 09:10:05.357297 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb5524f-4b18-408d-95e6-4c41d1d2fde6 None None] Authenticating user token {{(pid=416293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:10:05.471390 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG dbcounter [-] [416293] Writing DB stats keystone:SELECT=100 {{(pid=416293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:10:05.479137 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb5524f-4b18-408d-95e6-4c41d1d2fde6 None None] Validating token access rules against request {{(pid=416293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:10:05.518506 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55cbf1d-97a6-4ebe-bb4d-6e106bdef844 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:10:05.519087 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55cbf1d-97a6-4ebe-bb4d-6e106bdef844 None admin] REQUEST_METHOD: `GET` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:10:05.519370 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55cbf1d-97a6-4ebe-bb4d-6e106bdef844 None admin] SCRIPT_NAME: `/identity` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:10:05.519647 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55cbf1d-97a6-4ebe-bb4d-6e106bdef844 None admin] PATH_INFO: `/v3/services/placement` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:10:05.520292 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f55cbf1d-97a6-4ebe-bb4d-6e106bdef844 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:10:05.521744 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f55cbf1d-97a6-4ebe-bb4d-6e106bdef844 None admin] RBAC: Authorization granted {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:10:05.531394 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application [None req-f55cbf1d-97a6-4ebe-bb4d-6e106bdef844 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jul 28 09:10:05.531394 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 09:10:05.531394 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 28 09:10:05.531394 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 28 09:10:05.531394 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 28 09:10:05.531394 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 28 09:10:05.531394 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 28 09:10:05.531394 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 09:10:05.531394 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 28 09:10:05.531394 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application Jul 28 09:10:05.531394 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 28 09:10:05.531394 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application Jul 28 09:10:05.531394 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 09:10:05.531394 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 09:10:05.531394 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 09:10:05.531394 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 09:10:05.531394 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 09:10:05.532947 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 09:10:05.532947 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 09:10:05.532947 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 09:10:05.532947 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 09:10:05.532947 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 09:10:05.532947 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 09:10:05.532947 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 28 09:10:05.532947 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 28 09:10:05.532947 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 28 09:10:05.532947 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 28 09:10:05.532947 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 09:10:05.532947 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 09:10:05.532947 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 09:10:05.532947 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 09:10:05.532947 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 09:10:05.532947 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 09:10:05.534173 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 09:10:05.534173 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application with Lock( Jul 28 09:10:05.534173 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 09:10:05.534173 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self._enter() Jul 28 09:10:05.534173 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 09:10:05.534173 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 09:10:05.534173 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 09:10:05.534173 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application return self.creator() Jul 28 09:10:05.534173 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 09:10:05.534173 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application created_value = creator( Jul 28 09:10:05.534173 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 28 09:10:05.534173 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 09:10:05.534173 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 28 09:10:05.534173 dv-cinder-851351-1-smb devstack@keystone.service[416293]: ERROR keystone.server.flask.application Jul 28 09:10:05.534173 dv-cinder-851351-1-smb devstack@keystone.service[416293]: [pid: 416293|app: 0|req: 646/1304] 10.222.0.42 () {56 vars in 1117 bytes} [Thu Jul 28 09:10:05 2022] GET /identity/v3/services/placement => generated 90 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 09:10:05.539449 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ef0c41-ae76-4f11-acd5-a4dfbbf2009b None None] Authenticating user token {{(pid=416294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:10:05.624542 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG dbcounter [-] [416294] Writing DB stats keystone:SELECT=100 {{(pid=416294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:10:05.650819 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ef0c41-ae76-4f11-acd5-a4dfbbf2009b None None] Validating token access rules against request {{(pid=416294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:10:05.700681 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d8a89be-d58e-4cdf-a76a-fbc4d8cfb2d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:10:05.701313 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8a89be-d58e-4cdf-a76a-fbc4d8cfb2d5 None admin] REQUEST_METHOD: `GET` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:10:05.701597 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8a89be-d58e-4cdf-a76a-fbc4d8cfb2d5 None admin] SCRIPT_NAME: `/identity` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:10:05.701881 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8a89be-d58e-4cdf-a76a-fbc4d8cfb2d5 None admin] PATH_INFO: `/v3/services` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:10:05.702584 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d8a89be-d58e-4cdf-a76a-fbc4d8cfb2d5 None admin] RBAC: Adding query filter params (name=placement) {{(pid=416294) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 09:10:05.702907 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d8a89be-d58e-4cdf-a76a-fbc4d8cfb2d5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:10:05.704320 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d8a89be-d58e-4cdf-a76a-fbc4d8cfb2d5 None admin] RBAC: Authorization granted {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:10:05.710457 dv-cinder-851351-1-smb devstack@keystone.service[416294]: [pid: 416294|app: 0|req: 659/1305] 10.222.0.42 () {56 vars in 1116 bytes} [Thu Jul 28 09:10:05 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:10:05.716959 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55cbf1d-97a6-4ebe-bb4d-6e106bdef844 None admin] Authenticating user token {{(pid=416293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:10:05.827278 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55cbf1d-97a6-4ebe-bb4d-6e106bdef844 None admin] Validating token access rules against request {{(pid=416293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:10:05.863284 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d13f354-8c02-439f-b63c-719474aa8f02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dbf87abab90e4fdf9e75408f4199918e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:10:05.863928 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d13f354-8c02-439f-b63c-719474aa8f02 None admin] REQUEST_METHOD: `POST` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:10:05.864223 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d13f354-8c02-439f-b63c-719474aa8f02 None admin] SCRIPT_NAME: `/identity` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:10:05.864496 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d13f354-8c02-439f-b63c-719474aa8f02 None admin] PATH_INFO: `/v3/endpoints` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:10:05.865256 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d13f354-8c02-439f-b63c-719474aa8f02 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:10:05.866651 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d13f354-8c02-439f-b63c-719474aa8f02 None admin] RBAC: Authorization granted {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:10:05.889565 dv-cinder-851351-1-smb devstack@keystone.service[416293]: [pid: 416293|app: 0|req: 647/1306] 10.222.0.42 () {60 vars in 1144 bytes} [Thu Jul 28 09:10:05 2022] POST /identity/v3/endpoints => generated 331 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 09:10:15.706966 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG dbcounter [-] [416294] Writing DB stats keystone:SELECT=30 {{(pid=416294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:10:15.884514 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG dbcounter [-] [416293] Writing DB stats keystone:SELECT=91,keystone:INSERT=1 {{(pid=416293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:11:14.561682 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0181fd7-0e54-481f-a2b0-65f696a1d8bc None None] REQUEST_METHOD: `GET` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:11:14.562257 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0181fd7-0e54-481f-a2b0-65f696a1d8bc None None] SCRIPT_NAME: `/identity` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:11:14.562257 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0181fd7-0e54-481f-a2b0-65f696a1d8bc None None] PATH_INFO: `/` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:11:14.565025 dv-cinder-851351-1-smb devstack@keystone.service[416294]: [pid: 416294|app: 0|req: 660/1307] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 09:11:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 09:11:14.568923 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e72fe9c-16c9-40d6-9f42-d8cf249e8afe None None] REQUEST_METHOD: `POST` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:11:14.569382 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e72fe9c-16c9-40d6-9f42-d8cf249e8afe None None] SCRIPT_NAME: `/identity` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:11:14.569499 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e72fe9c-16c9-40d6-9f42-d8cf249e8afe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:11:14.762624 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.auth.core [None req-1e72fe9c-16c9-40d6-9f42-d8cf249e8afe None None] MFA Rules not processed for user `dbf87abab90e4fdf9e75408f4199918e`. Rule list: `[]` (Enabled: `True`). {{(pid=416293) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 09:11:14.763903 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.fernet_utils [None req-1e72fe9c-16c9-40d6-9f42-d8cf249e8afe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=416293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 09:11:15.073257 dv-cinder-851351-1-smb devstack@keystone.service[416293]: [pid: 416293|app: 0|req: 648/1308] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 09:11:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 505 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 09:11:15.130985 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dcbf9f0-87f9-4b7c-b179-69337fdea20f None None] REQUEST_METHOD: `GET` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:11:15.131381 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dcbf9f0-87f9-4b7c-b179-69337fdea20f None None] SCRIPT_NAME: `/identity` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:11:15.131864 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dcbf9f0-87f9-4b7c-b179-69337fdea20f None None] PATH_INFO: `/` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:11:15.133938 dv-cinder-851351-1-smb devstack@keystone.service[416294]: [pid: 416294|app: 0|req: 661/1309] 10.222.0.42 () {54 vars in 965 bytes} [Thu Jul 28 09:11:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 09:11:15.148364 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da24e453-6c79-46f2-8bcc-90b06f822448 None None] REQUEST_METHOD: `POST` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:11:15.149245 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da24e453-6c79-46f2-8bcc-90b06f822448 None None] SCRIPT_NAME: `/identity` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:11:15.150516 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da24e453-6c79-46f2-8bcc-90b06f822448 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:11:15.297834 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.auth.core [None req-da24e453-6c79-46f2-8bcc-90b06f822448 None None] MFA Rules not processed for user `1a6b3c06f2fb4c4c8b9089ca32caf7c5`. Rule list: `[]` (Enabled: `True`). {{(pid=416293) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 09:11:15.299090 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.fernet_utils [None req-da24e453-6c79-46f2-8bcc-90b06f822448 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=416293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 09:11:15.326324 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG dbcounter [-] [416293] Writing DB stats keystone:SELECT=100 {{(pid=416293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:11:15.414582 dv-cinder-851351-1-smb devstack@keystone.service[416293]: [pid: 416293|app: 0|req: 649/1310] 10.222.0.42 () {58 vars in 1062 bytes} [Thu Jul 28 09:11:15 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 270 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 09:11:15.415610 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dcbf9f0-87f9-4b7c-b179-69337fdea20f None None] Authenticating user token {{(pid=416294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:11:15.417518 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.fernet_utils [None req-4dcbf9f0-87f9-4b7c-b179-69337fdea20f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=416294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 09:11:15.645233 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dcbf9f0-87f9-4b7c-b179-69337fdea20f None None] Validating token access rules against request {{(pid=416294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:11:15.812180 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8399f686-eb8a-438c-9250-3c09045a3d22 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6b3c06f2fb4c4c8b9089ca32caf7c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4349445f224184b093d9dfd0dfc642', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:11:15.812786 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8399f686-eb8a-438c-9250-3c09045a3d22 service neutron] REQUEST_METHOD: `GET` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:11:15.813066 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8399f686-eb8a-438c-9250-3c09045a3d22 service neutron] SCRIPT_NAME: `/identity` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:11:15.813349 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8399f686-eb8a-438c-9250-3c09045a3d22 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:11:15.815068 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.fernet_utils [None req-8399f686-eb8a-438c-9250-3c09045a3d22 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=416294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 09:11:15.941455 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG dbcounter [-] [416294] Writing DB stats keystone:SELECT=100 {{(pid=416294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:11:16.027566 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8399f686-eb8a-438c-9250-3c09045a3d22 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:11:16.029497 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8399f686-eb8a-438c-9250-3c09045a3d22 service neutron] RBAC: Authorization granted {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:11:16.066144 dv-cinder-851351-1-smb devstack@keystone.service[416294]: [pid: 416294|app: 0|req: 662/1311] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Jul 28 09:11:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 651 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 28 09:11:18.788826 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db82920-0b8d-48a7-85ed-becca67dc954 None None] REQUEST_METHOD: `GET` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:11:18.789391 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db82920-0b8d-48a7-85ed-becca67dc954 None None] SCRIPT_NAME: `/identity` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:11:18.789391 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db82920-0b8d-48a7-85ed-becca67dc954 None None] PATH_INFO: `/` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:11:18.790842 dv-cinder-851351-1-smb devstack@keystone.service[416293]: [pid: 416293|app: 0|req: 650/1312] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 09:11:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 09:11:18.796561 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d0278f-d514-4a65-8e2a-6eaa8e100ae0 None None] REQUEST_METHOD: `POST` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:11:18.797095 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d0278f-d514-4a65-8e2a-6eaa8e100ae0 None None] SCRIPT_NAME: `/identity` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:11:18.797193 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d0278f-d514-4a65-8e2a-6eaa8e100ae0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:11:18.878461 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.auth.core [None req-25d0278f-d514-4a65-8e2a-6eaa8e100ae0 None None] MFA Rules not processed for user `dbf87abab90e4fdf9e75408f4199918e`. Rule list: `[]` (Enabled: `True`). {{(pid=416294) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 09:11:18.879713 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.fernet_utils [None req-25d0278f-d514-4a65-8e2a-6eaa8e100ae0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=416294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 09:11:18.992647 dv-cinder-851351-1-smb devstack@keystone.service[416294]: [pid: 416294|app: 0|req: 663/1313] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 09:11:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 09:11:19.031549 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db82920-0b8d-48a7-85ed-becca67dc954 None None] Authenticating user token {{(pid=416293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:11:19.033170 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.fernet_utils [None req-3db82920-0b8d-48a7-85ed-becca67dc954 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=416293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 09:11:19.144362 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db82920-0b8d-48a7-85ed-becca67dc954 None None] Validating token access rules against request {{(pid=416293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:11:19.220939 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG dbcounter [-] [416293] Writing DB stats keystone:SELECT=100 {{(pid=416293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:11:19.223789 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10101ddb-322e-44fa-8037-a5f9a2047aad service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6b3c06f2fb4c4c8b9089ca32caf7c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4349445f224184b093d9dfd0dfc642', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:11:19.224416 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10101ddb-322e-44fa-8037-a5f9a2047aad service neutron] REQUEST_METHOD: `GET` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:11:19.224724 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10101ddb-322e-44fa-8037-a5f9a2047aad service neutron] SCRIPT_NAME: `/identity` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:11:19.225009 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10101ddb-322e-44fa-8037-a5f9a2047aad service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:11:19.227296 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.fernet_utils [None req-10101ddb-322e-44fa-8037-a5f9a2047aad service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=416293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 09:11:19.346130 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10101ddb-322e-44fa-8037-a5f9a2047aad service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:11:19.347593 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10101ddb-322e-44fa-8037-a5f9a2047aad service neutron] RBAC: Authorization granted {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:11:19.367036 dv-cinder-851351-1-smb devstack@keystone.service[416293]: [pid: 416293|app: 0|req: 651/1314] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Jul 28 09:11:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 336 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 09:11:21.670399 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6294e14a-059a-42f3-80d5-68024df42785 None None] REQUEST_METHOD: `GET` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:11:21.671018 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6294e14a-059a-42f3-80d5-68024df42785 None None] SCRIPT_NAME: `/identity` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:11:21.671018 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6294e14a-059a-42f3-80d5-68024df42785 None None] PATH_INFO: `/` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:11:21.672320 dv-cinder-851351-1-smb devstack@keystone.service[416294]: [pid: 416294|app: 0|req: 664/1315] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 09:11:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 09:11:21.677775 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5575871b-a018-4bbe-9232-071df5d34c2f None None] REQUEST_METHOD: `POST` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:11:21.678232 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5575871b-a018-4bbe-9232-071df5d34c2f None None] SCRIPT_NAME: `/identity` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:11:21.678343 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5575871b-a018-4bbe-9232-071df5d34c2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:11:21.747460 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.auth.core [None req-5575871b-a018-4bbe-9232-071df5d34c2f None None] MFA Rules not processed for user `d8807d513cea475c9faa3106083edd8a`. Rule list: `[]` (Enabled: `True`). {{(pid=416293) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 09:11:21.748716 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.fernet_utils [None req-5575871b-a018-4bbe-9232-071df5d34c2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=416293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 09:11:21.810135 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG dbcounter [-] [416293] Writing DB stats keystone:SELECT=100 {{(pid=416293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:11:21.865063 dv-cinder-851351-1-smb devstack@keystone.service[416293]: [pid: 416293|app: 0|req: 652/1316] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 09:11:21 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 09:11:21.905523 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6294e14a-059a-42f3-80d5-68024df42785 None None] Authenticating user token {{(pid=416294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:11:21.907116 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.fernet_utils [None req-6294e14a-059a-42f3-80d5-68024df42785 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=416294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 09:11:21.917720 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG dbcounter [-] [416294] Writing DB stats keystone:SELECT=100 {{(pid=416294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:11:22.029774 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6294e14a-059a-42f3-80d5-68024df42785 None None] Validating token access rules against request {{(pid=416294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:11:22.112569 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee5e44b-2aaf-479d-9d3c-d23c9920acca service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6b3c06f2fb4c4c8b9089ca32caf7c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4349445f224184b093d9dfd0dfc642', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:11:22.113237 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee5e44b-2aaf-479d-9d3c-d23c9920acca service neutron] REQUEST_METHOD: `GET` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:11:22.113523 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee5e44b-2aaf-479d-9d3c-d23c9920acca service neutron] SCRIPT_NAME: `/identity` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:11:22.113801 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee5e44b-2aaf-479d-9d3c-d23c9920acca service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:11:22.115511 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.fernet_utils [None req-0ee5e44b-2aaf-479d-9d3c-d23c9920acca service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=416294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 09:11:22.184049 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG dbcounter [-] [416294] Writing DB stats keystone:SELECT=100 {{(pid=416294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:11:22.236043 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee5e44b-2aaf-479d-9d3c-d23c9920acca service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:11:22.237452 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee5e44b-2aaf-479d-9d3c-d23c9920acca service neutron] RBAC: Authorization granted {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:11:22.257035 dv-cinder-851351-1-smb devstack@keystone.service[416294]: [pid: 416294|app: 0|req: 665/1317] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Jul 28 09:11:21 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 352 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 09:11:24.836417 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76e1ee2-3d98-4106-b781-7f9782f2b3eb None None] REQUEST_METHOD: `GET` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:11:24.837041 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76e1ee2-3d98-4106-b781-7f9782f2b3eb None None] SCRIPT_NAME: `/identity` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:11:24.837041 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76e1ee2-3d98-4106-b781-7f9782f2b3eb None None] PATH_INFO: `/` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:11:24.838729 dv-cinder-851351-1-smb devstack@keystone.service[416293]: [pid: 416293|app: 0|req: 653/1318] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 09:11:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 09:11:24.843972 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad47aef-fa47-402b-bc57-4e617552b0aa None None] REQUEST_METHOD: `POST` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:11:24.844412 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad47aef-fa47-402b-bc57-4e617552b0aa None None] SCRIPT_NAME: `/identity` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:11:24.844509 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad47aef-fa47-402b-bc57-4e617552b0aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:11:24.913156 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.auth.core [None req-dad47aef-fa47-402b-bc57-4e617552b0aa None None] MFA Rules not processed for user `dbf87abab90e4fdf9e75408f4199918e`. Rule list: `[]` (Enabled: `True`). {{(pid=416294) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 09:11:24.914404 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.fernet_utils [None req-dad47aef-fa47-402b-bc57-4e617552b0aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=416294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 09:11:25.027780 dv-cinder-851351-1-smb devstack@keystone.service[416294]: [pid: 416294|app: 0|req: 666/1319] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 09:11:24 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 09:11:25.074947 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76e1ee2-3d98-4106-b781-7f9782f2b3eb None None] Authenticating user token {{(pid=416293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:11:25.076895 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.fernet_utils [None req-b76e1ee2-3d98-4106-b781-7f9782f2b3eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=416293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 09:11:25.201631 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76e1ee2-3d98-4106-b781-7f9782f2b3eb None None] Validating token access rules against request {{(pid=416293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:11:25.286866 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f2f5f3-fb77-4e57-8cce-261793c93a4b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6b3c06f2fb4c4c8b9089ca32caf7c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4349445f224184b093d9dfd0dfc642', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:11:25.287501 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f2f5f3-fb77-4e57-8cce-261793c93a4b service neutron] REQUEST_METHOD: `GET` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:11:25.287784 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f2f5f3-fb77-4e57-8cce-261793c93a4b service neutron] SCRIPT_NAME: `/identity` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:11:25.288057 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f2f5f3-fb77-4e57-8cce-261793c93a4b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:11:25.289742 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.fernet_utils [None req-e5f2f5f3-fb77-4e57-8cce-261793c93a4b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=416293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 09:11:25.297651 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG dbcounter [-] [416293] Writing DB stats keystone:SELECT=100 {{(pid=416293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:11:25.400602 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5f2f5f3-fb77-4e57-8cce-261793c93a4b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:11:25.402085 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5f2f5f3-fb77-4e57-8cce-261793c93a4b service neutron] RBAC: Authorization granted {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:11:25.421961 dv-cinder-851351-1-smb devstack@keystone.service[416293]: [pid: 416293|app: 0|req: 654/1320] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Jul 28 09:11:25 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 348 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 09:11:28.144151 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c4d983-e714-4bb5-9cf3-3ace67803af9 None None] REQUEST_METHOD: `GET` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:11:28.144774 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c4d983-e714-4bb5-9cf3-3ace67803af9 None None] SCRIPT_NAME: `/identity` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:11:28.144774 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c4d983-e714-4bb5-9cf3-3ace67803af9 None None] PATH_INFO: `/` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:11:28.146123 dv-cinder-851351-1-smb devstack@keystone.service[416294]: [pid: 416294|app: 0|req: 667/1321] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 09:11:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 09:11:28.151650 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce39ed1-775c-4a80-b6a8-45304efbb0a3 None None] REQUEST_METHOD: `POST` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:11:28.152127 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce39ed1-775c-4a80-b6a8-45304efbb0a3 None None] SCRIPT_NAME: `/identity` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:11:28.152228 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce39ed1-775c-4a80-b6a8-45304efbb0a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:11:28.222055 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.auth.core [None req-1ce39ed1-775c-4a80-b6a8-45304efbb0a3 None None] MFA Rules not processed for user `dbf87abab90e4fdf9e75408f4199918e`. Rule list: `[]` (Enabled: `True`). {{(pid=416293) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 09:11:28.223205 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.fernet_utils [None req-1ce39ed1-775c-4a80-b6a8-45304efbb0a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=416293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 09:11:28.295921 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG dbcounter [-] [416293] Writing DB stats keystone:SELECT=100 {{(pid=416293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:11:28.342593 dv-cinder-851351-1-smb devstack@keystone.service[416293]: [pid: 416293|app: 0|req: 655/1322] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 09:11:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 09:11:28.380083 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c4d983-e714-4bb5-9cf3-3ace67803af9 None None] Authenticating user token {{(pid=416294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:11:28.381728 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.fernet_utils [None req-79c4d983-e714-4bb5-9cf3-3ace67803af9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=416294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 09:11:28.404298 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG dbcounter [-] [416294] Writing DB stats keystone:SELECT=100 {{(pid=416294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:11:28.504502 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c4d983-e714-4bb5-9cf3-3ace67803af9 None None] Validating token access rules against request {{(pid=416294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:11:28.594091 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d067c63-9250-45ab-b4dd-089854cb7414 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6b3c06f2fb4c4c8b9089ca32caf7c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4349445f224184b093d9dfd0dfc642', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:11:28.594712 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d067c63-9250-45ab-b4dd-089854cb7414 service neutron] REQUEST_METHOD: `GET` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:11:28.594988 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d067c63-9250-45ab-b4dd-089854cb7414 service neutron] SCRIPT_NAME: `/identity` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:11:28.595261 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d067c63-9250-45ab-b4dd-089854cb7414 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:11:28.597008 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.fernet_utils [None req-3d067c63-9250-45ab-b4dd-089854cb7414 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=416294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 09:11:28.680451 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG dbcounter [-] [416294] Writing DB stats keystone:SELECT=100 {{(pid=416294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:11:28.724582 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d067c63-9250-45ab-b4dd-089854cb7414 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:11:28.726105 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d067c63-9250-45ab-b4dd-089854cb7414 service neutron] RBAC: Authorization granted {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:11:28.747442 dv-cinder-851351-1-smb devstack@keystone.service[416294]: [pid: 416294|app: 0|req: 668/1323] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Jul 28 09:11:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 368 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 09:11:30.813597 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0adda9f6-dc68-490a-b5c9-3367f96a060e None None] REQUEST_METHOD: `GET` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:11:30.814058 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0adda9f6-dc68-490a-b5c9-3367f96a060e None None] SCRIPT_NAME: `/identity` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:11:30.814175 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0adda9f6-dc68-490a-b5c9-3367f96a060e None None] PATH_INFO: `/` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:11:30.818169 dv-cinder-851351-1-smb devstack@keystone.service[416293]: [pid: 416293|app: 0|req: 656/1324] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 09:11:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 09:11:30.821378 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7182fb6-bdb5-448d-99fb-8c63051ba2fd None None] REQUEST_METHOD: `POST` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:11:30.821970 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7182fb6-bdb5-448d-99fb-8c63051ba2fd None None] SCRIPT_NAME: `/identity` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:11:30.822161 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7182fb6-bdb5-448d-99fb-8c63051ba2fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:11:30.903651 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.auth.core [None req-a7182fb6-bdb5-448d-99fb-8c63051ba2fd None None] MFA Rules not processed for user `dbf87abab90e4fdf9e75408f4199918e`. Rule list: `[]` (Enabled: `True`). {{(pid=416294) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 09:11:30.904980 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.fernet_utils [None req-a7182fb6-bdb5-448d-99fb-8c63051ba2fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=416294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 09:11:31.028827 dv-cinder-851351-1-smb devstack@keystone.service[416294]: [pid: 416294|app: 0|req: 669/1325] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 09:11:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 09:11:31.063834 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0adda9f6-dc68-490a-b5c9-3367f96a060e None None] Authenticating user token {{(pid=416293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:11:31.065447 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.fernet_utils [None req-0adda9f6-dc68-490a-b5c9-3367f96a060e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=416293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 09:11:31.195458 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0adda9f6-dc68-490a-b5c9-3367f96a060e None None] Validating token access rules against request {{(pid=416293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:11:31.273879 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83036140-396d-4c14-9860-798fa531f936 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6b3c06f2fb4c4c8b9089ca32caf7c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4349445f224184b093d9dfd0dfc642', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:11:31.274418 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83036140-396d-4c14-9860-798fa531f936 service neutron] REQUEST_METHOD: `GET` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:11:31.274745 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83036140-396d-4c14-9860-798fa531f936 service neutron] SCRIPT_NAME: `/identity` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:11:31.275044 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83036140-396d-4c14-9860-798fa531f936 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:11:31.276787 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.fernet_utils [None req-83036140-396d-4c14-9860-798fa531f936 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=416293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 09:11:31.294861 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG dbcounter [-] [416293] Writing DB stats keystone:SELECT=100 {{(pid=416293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:11:31.394099 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83036140-396d-4c14-9860-798fa531f936 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:11:31.395580 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83036140-396d-4c14-9860-798fa531f936 service neutron] RBAC: Authorization granted {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:11:31.415934 dv-cinder-851351-1-smb devstack@keystone.service[416293]: [pid: 416293|app: 0|req: 657/1326] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Jul 28 09:11:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 353 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 09:11:33.462417 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44bf525f-ea50-4145-8875-24bc33ecf7c2 None None] REQUEST_METHOD: `GET` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:11:33.462994 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44bf525f-ea50-4145-8875-24bc33ecf7c2 None None] SCRIPT_NAME: `/identity` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:11:33.462994 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44bf525f-ea50-4145-8875-24bc33ecf7c2 None None] PATH_INFO: `/` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:11:33.464334 dv-cinder-851351-1-smb devstack@keystone.service[416294]: [pid: 416294|app: 0|req: 670/1327] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 09:11:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 09:11:33.469767 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbacb846-1c39-49bb-b42c-f4007236fd32 None None] REQUEST_METHOD: `POST` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:11:33.470244 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbacb846-1c39-49bb-b42c-f4007236fd32 None None] SCRIPT_NAME: `/identity` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:11:33.470348 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbacb846-1c39-49bb-b42c-f4007236fd32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:11:33.542194 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.auth.core [None req-dbacb846-1c39-49bb-b42c-f4007236fd32 None None] MFA Rules not processed for user `d8807d513cea475c9faa3106083edd8a`. Rule list: `[]` (Enabled: `True`). {{(pid=416293) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 09:11:33.543523 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.fernet_utils [None req-dbacb846-1c39-49bb-b42c-f4007236fd32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=416293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 09:11:33.614114 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG dbcounter [-] [416293] Writing DB stats keystone:SELECT=100 {{(pid=416293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:11:33.650161 dv-cinder-851351-1-smb devstack@keystone.service[416293]: [pid: 416293|app: 0|req: 658/1328] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 09:11:33 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 09:11:33.703371 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d9f04c-cef5-45d6-8510-e5bfa321a473 None None] REQUEST_METHOD: `GET` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:11:33.703612 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d9f04c-cef5-45d6-8510-e5bfa321a473 None None] SCRIPT_NAME: `/identity` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:11:33.703916 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d9f04c-cef5-45d6-8510-e5bfa321a473 None None] PATH_INFO: `/` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:11:33.705364 dv-cinder-851351-1-smb devstack@keystone.service[416294]: [pid: 416294|app: 0|req: 671/1329] 10.222.0.42 () {54 vars in 965 bytes} [Thu Jul 28 09:11:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 09:11:33.711599 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4e1c69-a45b-4db4-9bb9-fe7a7b7fbb49 None None] REQUEST_METHOD: `POST` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:11:33.711888 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4e1c69-a45b-4db4-9bb9-fe7a7b7fbb49 None None] SCRIPT_NAME: `/identity` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:11:33.712166 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4e1c69-a45b-4db4-9bb9-fe7a7b7fbb49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:11:33.794380 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.auth.core [None req-8c4e1c69-a45b-4db4-9bb9-fe7a7b7fbb49 None None] MFA Rules not processed for user `1a6b3c06f2fb4c4c8b9089ca32caf7c5`. Rule list: `[]` (Enabled: `True`). {{(pid=416293) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 09:11:33.795517 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.fernet_utils [None req-8c4e1c69-a45b-4db4-9bb9-fe7a7b7fbb49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=416293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 09:11:33.876700 dv-cinder-851351-1-smb devstack@keystone.service[416293]: [pid: 416293|app: 0|req: 659/1330] 10.222.0.42 () {58 vars in 1062 bytes} [Thu Jul 28 09:11:33 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 09:11:33.886251 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d9f04c-cef5-45d6-8510-e5bfa321a473 None None] Authenticating user token {{(pid=416294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:11:33.887808 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.fernet_utils [None req-b3d9f04c-cef5-45d6-8510-e5bfa321a473 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=416294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 09:11:33.920065 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG dbcounter [-] [416294] Writing DB stats keystone:SELECT=100 {{(pid=416294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:11:33.997676 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d9f04c-cef5-45d6-8510-e5bfa321a473 None None] Validating token access rules against request {{(pid=416294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:11:34.076913 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f500ecac-de5d-48d3-96b5-37ed1876b271 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6b3c06f2fb4c4c8b9089ca32caf7c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4349445f224184b093d9dfd0dfc642', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:11:34.077567 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f500ecac-de5d-48d3-96b5-37ed1876b271 service neutron] REQUEST_METHOD: `GET` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:11:34.077848 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f500ecac-de5d-48d3-96b5-37ed1876b271 service neutron] SCRIPT_NAME: `/identity` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:11:34.078117 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f500ecac-de5d-48d3-96b5-37ed1876b271 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:11:34.079912 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.fernet_utils [None req-f500ecac-de5d-48d3-96b5-37ed1876b271 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=416294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 09:11:34.168408 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG dbcounter [-] [416294] Writing DB stats keystone:SELECT=100 {{(pid=416294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:11:34.202772 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f500ecac-de5d-48d3-96b5-37ed1876b271 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:11:34.204248 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f500ecac-de5d-48d3-96b5-37ed1876b271 service neutron] RBAC: Authorization granted {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:11:34.224942 dv-cinder-851351-1-smb devstack@keystone.service[416294]: [pid: 416294|app: 0|req: 672/1331] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Jul 28 09:11:33 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 09:11:36.858007 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8732ee61-0ce7-4f63-bfa1-2aacbd4571ef None None] REQUEST_METHOD: `GET` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:11:36.858604 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8732ee61-0ce7-4f63-bfa1-2aacbd4571ef None None] SCRIPT_NAME: `/identity` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:11:36.858604 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8732ee61-0ce7-4f63-bfa1-2aacbd4571ef None None] PATH_INFO: `/` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:11:36.860005 dv-cinder-851351-1-smb devstack@keystone.service[416293]: [pid: 416293|app: 0|req: 660/1332] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 09:11:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 09:11:36.865800 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4c4702-037f-45e6-b318-7b26f5b655c6 None None] REQUEST_METHOD: `POST` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:11:36.866322 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4c4702-037f-45e6-b318-7b26f5b655c6 None None] SCRIPT_NAME: `/identity` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:11:36.866322 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4c4702-037f-45e6-b318-7b26f5b655c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:11:36.943682 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.auth.core [None req-4c4c4702-037f-45e6-b318-7b26f5b655c6 None None] MFA Rules not processed for user `dbf87abab90e4fdf9e75408f4199918e`. Rule list: `[]` (Enabled: `True`). {{(pid=416294) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 09:11:36.944972 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.fernet_utils [None req-4c4c4702-037f-45e6-b318-7b26f5b655c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=416294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 09:11:37.049006 dv-cinder-851351-1-smb devstack@keystone.service[416294]: [pid: 416294|app: 0|req: 673/1333] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 09:11:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 09:11:37.085561 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8732ee61-0ce7-4f63-bfa1-2aacbd4571ef None None] Authenticating user token {{(pid=416293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:11:37.087281 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.fernet_utils [None req-8732ee61-0ce7-4f63-bfa1-2aacbd4571ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=416293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 09:11:37.161863 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG dbcounter [-] [416293] Writing DB stats keystone:SELECT=100 {{(pid=416293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:11:37.200126 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8732ee61-0ce7-4f63-bfa1-2aacbd4571ef None None] Validating token access rules against request {{(pid=416293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:11:37.285272 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1dc562-4026-4fc4-a0c1-9075c6ef5aa0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6b3c06f2fb4c4c8b9089ca32caf7c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4349445f224184b093d9dfd0dfc642', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:11:37.285944 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1dc562-4026-4fc4-a0c1-9075c6ef5aa0 service neutron] REQUEST_METHOD: `GET` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:11:37.286227 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1dc562-4026-4fc4-a0c1-9075c6ef5aa0 service neutron] SCRIPT_NAME: `/identity` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:11:37.286507 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1dc562-4026-4fc4-a0c1-9075c6ef5aa0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:11:37.288176 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.fernet_utils [None req-4c1dc562-4026-4fc4-a0c1-9075c6ef5aa0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=416293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 09:11:37.406827 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c1dc562-4026-4fc4-a0c1-9075c6ef5aa0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:11:37.408293 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c1dc562-4026-4fc4-a0c1-9075c6ef5aa0 service neutron] RBAC: Authorization granted {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:11:37.418945 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG dbcounter [-] [416293] Writing DB stats keystone:SELECT=100 {{(pid=416293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:11:37.427888 dv-cinder-851351-1-smb devstack@keystone.service[416293]: [pid: 416293|app: 0|req: 661/1334] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Jul 28 09:11:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 343 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 09:11:39.500198 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0e7f2d-7a72-4739-958b-d4bfb5036e48 None None] REQUEST_METHOD: `GET` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:11:39.500860 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0e7f2d-7a72-4739-958b-d4bfb5036e48 None None] SCRIPT_NAME: `/identity` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:11:39.500860 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0e7f2d-7a72-4739-958b-d4bfb5036e48 None None] PATH_INFO: `/` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:11:39.502122 dv-cinder-851351-1-smb devstack@keystone.service[416294]: [pid: 416294|app: 0|req: 674/1335] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 09:11:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 09:11:39.507776 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d76cf6d-eb6b-4dd3-912f-f91d5e1bb292 None None] REQUEST_METHOD: `POST` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:11:39.508265 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d76cf6d-eb6b-4dd3-912f-f91d5e1bb292 None None] SCRIPT_NAME: `/identity` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:11:39.508388 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d76cf6d-eb6b-4dd3-912f-f91d5e1bb292 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:11:39.581033 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.auth.core [None req-3d76cf6d-eb6b-4dd3-912f-f91d5e1bb292 None None] MFA Rules not processed for user `dbf87abab90e4fdf9e75408f4199918e`. Rule list: `[]` (Enabled: `True`). {{(pid=416293) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 09:11:39.582304 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.fernet_utils [None req-3d76cf6d-eb6b-4dd3-912f-f91d5e1bb292 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=416293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 09:11:39.696727 dv-cinder-851351-1-smb devstack@keystone.service[416293]: [pid: 416293|app: 0|req: 662/1336] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 09:11:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 09:11:39.741736 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b0e7f2d-7a72-4739-958b-d4bfb5036e48 None None] Authenticating user token {{(pid=416294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:11:39.743330 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.fernet_utils [None req-7b0e7f2d-7a72-4739-958b-d4bfb5036e48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=416294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 09:11:39.791534 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG dbcounter [-] [416294] Writing DB stats keystone:SELECT=100 {{(pid=416294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:11:39.858457 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b0e7f2d-7a72-4739-958b-d4bfb5036e48 None None] Validating token access rules against request {{(pid=416294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:11:39.948605 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac62e812-5fb1-4974-8340-f30e58b05294 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6b3c06f2fb4c4c8b9089ca32caf7c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4349445f224184b093d9dfd0dfc642', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:11:39.949314 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac62e812-5fb1-4974-8340-f30e58b05294 service neutron] REQUEST_METHOD: `GET` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:11:39.949601 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac62e812-5fb1-4974-8340-f30e58b05294 service neutron] SCRIPT_NAME: `/identity` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:11:39.949876 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac62e812-5fb1-4974-8340-f30e58b05294 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:11:39.951612 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.fernet_utils [None req-ac62e812-5fb1-4974-8340-f30e58b05294 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=416294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 09:11:40.056844 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG dbcounter [-] [416294] Writing DB stats keystone:SELECT=100 {{(pid=416294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:11:40.083197 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac62e812-5fb1-4974-8340-f30e58b05294 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:11:40.084650 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac62e812-5fb1-4974-8340-f30e58b05294 service neutron] RBAC: Authorization granted {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:11:40.103826 dv-cinder-851351-1-smb devstack@keystone.service[416294]: [pid: 416294|app: 0|req: 675/1337] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Jul 28 09:11:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 363 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 09:11:42.528779 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83911e5c-9b32-4e3a-ba44-e9095fdaa47f None None] REQUEST_METHOD: `GET` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:11:42.529426 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83911e5c-9b32-4e3a-ba44-e9095fdaa47f None None] SCRIPT_NAME: `/identity` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:11:42.529426 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83911e5c-9b32-4e3a-ba44-e9095fdaa47f None None] PATH_INFO: `/` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:11:42.530733 dv-cinder-851351-1-smb devstack@keystone.service[416293]: [pid: 416293|app: 0|req: 663/1338] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 09:11:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 09:11:42.536280 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58745aa-fe97-43d4-a4ac-4163d5e8a393 None None] REQUEST_METHOD: `POST` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:11:42.536785 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58745aa-fe97-43d4-a4ac-4163d5e8a393 None None] SCRIPT_NAME: `/identity` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:11:42.536901 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58745aa-fe97-43d4-a4ac-4163d5e8a393 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:11:42.606357 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.auth.core [None req-b58745aa-fe97-43d4-a4ac-4163d5e8a393 None None] MFA Rules not processed for user `dbf87abab90e4fdf9e75408f4199918e`. Rule list: `[]` (Enabled: `True`). {{(pid=416294) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 09:11:42.607622 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.fernet_utils [None req-b58745aa-fe97-43d4-a4ac-4163d5e8a393 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=416294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 09:11:42.706227 dv-cinder-851351-1-smb devstack@keystone.service[416294]: [pid: 416294|app: 0|req: 676/1339] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 09:11:42 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 09:11:42.743460 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83911e5c-9b32-4e3a-ba44-e9095fdaa47f None None] Authenticating user token {{(pid=416293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:11:42.745107 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.fernet_utils [None req-83911e5c-9b32-4e3a-ba44-e9095fdaa47f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=416293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 09:11:42.833190 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG dbcounter [-] [416293] Writing DB stats keystone:SELECT=100 {{(pid=416293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:11:42.864262 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83911e5c-9b32-4e3a-ba44-e9095fdaa47f None None] Validating token access rules against request {{(pid=416293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:11:42.943156 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e90154-f422-4393-81e4-556a6d7ddfa6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6b3c06f2fb4c4c8b9089ca32caf7c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4349445f224184b093d9dfd0dfc642', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:11:42.943802 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e90154-f422-4393-81e4-556a6d7ddfa6 service neutron] REQUEST_METHOD: `GET` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:11:42.944090 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e90154-f422-4393-81e4-556a6d7ddfa6 service neutron] SCRIPT_NAME: `/identity` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:11:42.944375 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e90154-f422-4393-81e4-556a6d7ddfa6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:11:42.946070 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.fernet_utils [None req-c6e90154-f422-4393-81e4-556a6d7ddfa6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=416293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 09:11:43.058480 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6e90154-f422-4393-81e4-556a6d7ddfa6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:11:43.059836 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6e90154-f422-4393-81e4-556a6d7ddfa6 service neutron] RBAC: Authorization granted {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:11:43.079352 dv-cinder-851351-1-smb devstack@keystone.service[416293]: [pid: 416293|app: 0|req: 664/1340] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Jul 28 09:11:42 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 336 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 09:11:47.221620 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33714dfe-954c-4e10-a395-4f465d7e16e0 None None] REQUEST_METHOD: `GET` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:11:47.222096 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33714dfe-954c-4e10-a395-4f465d7e16e0 None None] SCRIPT_NAME: `/identity` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:11:47.222309 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33714dfe-954c-4e10-a395-4f465d7e16e0 None None] PATH_INFO: `/` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:11:47.223615 dv-cinder-851351-1-smb devstack@keystone.service[416294]: [pid: 416294|app: 0|req: 677/1341] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 09:11:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 09:11:47.229194 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f09ff6-c391-45c7-b55f-2ecc854fa799 None None] REQUEST_METHOD: `POST` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:11:47.229727 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f09ff6-c391-45c7-b55f-2ecc854fa799 None None] SCRIPT_NAME: `/identity` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:11:47.229833 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f09ff6-c391-45c7-b55f-2ecc854fa799 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:11:47.235847 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG dbcounter [-] [416293] Writing DB stats keystone:SELECT=100 {{(pid=416293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:11:47.308168 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.auth.core [None req-b3f09ff6-c391-45c7-b55f-2ecc854fa799 None None] MFA Rules not processed for user `dbf87abab90e4fdf9e75408f4199918e`. Rule list: `[]` (Enabled: `True`). {{(pid=416293) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 09:11:47.309452 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.fernet_utils [None req-b3f09ff6-c391-45c7-b55f-2ecc854fa799 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=416293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 09:11:47.416212 dv-cinder-851351-1-smb devstack@keystone.service[416293]: [pid: 416293|app: 0|req: 665/1342] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 09:11:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 09:11:47.458331 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33714dfe-954c-4e10-a395-4f465d7e16e0 None None] Authenticating user token {{(pid=416294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:11:47.460008 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.fernet_utils [None req-33714dfe-954c-4e10-a395-4f465d7e16e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=416294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 09:11:47.513653 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG dbcounter [-] [416294] Writing DB stats keystone:SELECT=100 {{(pid=416294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:11:47.568497 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33714dfe-954c-4e10-a395-4f465d7e16e0 None None] Validating token access rules against request {{(pid=416294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:11:47.647696 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ce66a3-59e4-4c6b-8f7b-48423e520037 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6b3c06f2fb4c4c8b9089ca32caf7c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4349445f224184b093d9dfd0dfc642', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:11:47.648395 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ce66a3-59e4-4c6b-8f7b-48423e520037 service neutron] REQUEST_METHOD: `GET` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:11:47.648694 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ce66a3-59e4-4c6b-8f7b-48423e520037 service neutron] SCRIPT_NAME: `/identity` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:11:47.648978 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ce66a3-59e4-4c6b-8f7b-48423e520037 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:11:47.650764 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.fernet_utils [None req-79ce66a3-59e4-4c6b-8f7b-48423e520037 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=416294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 09:11:47.750086 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG dbcounter [-] [416294] Writing DB stats keystone:SELECT=100 {{(pid=416294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:11:47.767987 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ce66a3-59e4-4c6b-8f7b-48423e520037 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:11:47.769386 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ce66a3-59e4-4c6b-8f7b-48423e520037 service neutron] RBAC: Authorization granted {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:11:47.788059 dv-cinder-851351-1-smb devstack@keystone.service[416294]: [pid: 416294|app: 0|req: 678/1343] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Jul 28 09:11:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 09:11:50.710571 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc034f00-0e6c-48af-8153-2e222870078f None None] REQUEST_METHOD: `GET` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:11:50.711167 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc034f00-0e6c-48af-8153-2e222870078f None None] SCRIPT_NAME: `/identity` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:11:50.711167 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc034f00-0e6c-48af-8153-2e222870078f None None] PATH_INFO: `/` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:11:50.712722 dv-cinder-851351-1-smb devstack@keystone.service[416293]: [pid: 416293|app: 0|req: 666/1344] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 09:11:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 28 09:11:50.718576 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5c7240-4067-446e-9272-bb78d9497b27 None None] REQUEST_METHOD: `POST` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:11:50.719094 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5c7240-4067-446e-9272-bb78d9497b27 None None] SCRIPT_NAME: `/identity` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:11:50.719206 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5c7240-4067-446e-9272-bb78d9497b27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:11:50.797768 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.auth.core [None req-fc5c7240-4067-446e-9272-bb78d9497b27 None None] MFA Rules not processed for user `dbf87abab90e4fdf9e75408f4199918e`. Rule list: `[]` (Enabled: `True`). {{(pid=416294) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 09:11:50.799034 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.fernet_utils [None req-fc5c7240-4067-446e-9272-bb78d9497b27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=416294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 09:11:50.918726 dv-cinder-851351-1-smb devstack@keystone.service[416294]: [pid: 416294|app: 0|req: 679/1345] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 09:11:50 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 09:11:50.957236 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc034f00-0e6c-48af-8153-2e222870078f None None] Authenticating user token {{(pid=416293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:11:50.958886 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.fernet_utils [None req-cc034f00-0e6c-48af-8153-2e222870078f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=416293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 09:11:51.063575 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG dbcounter [-] [416293] Writing DB stats keystone:SELECT=100 {{(pid=416293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:11:51.082186 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc034f00-0e6c-48af-8153-2e222870078f None None] Validating token access rules against request {{(pid=416293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:11:51.183464 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d6814a-d35f-4bb2-b344-c77fa57e4d5f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6b3c06f2fb4c4c8b9089ca32caf7c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4349445f224184b093d9dfd0dfc642', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:11:51.184180 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d6814a-d35f-4bb2-b344-c77fa57e4d5f service neutron] REQUEST_METHOD: `GET` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:11:51.184474 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d6814a-d35f-4bb2-b344-c77fa57e4d5f service neutron] SCRIPT_NAME: `/identity` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:11:51.184806 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d6814a-d35f-4bb2-b344-c77fa57e4d5f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:11:51.186775 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.fernet_utils [None req-08d6814a-d35f-4bb2-b344-c77fa57e4d5f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=416293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 09:11:51.343390 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08d6814a-d35f-4bb2-b344-c77fa57e4d5f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:11:51.344928 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08d6814a-d35f-4bb2-b344-c77fa57e4d5f service neutron] RBAC: Authorization granted {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:11:51.370384 dv-cinder-851351-1-smb devstack@keystone.service[416293]: [pid: 416293|app: 0|req: 667/1346] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Jul 28 09:11:50 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 414 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 09:11:56.383954 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742f53b2-d8b3-4fc6-a466-d98a8c3ad2dc None None] REQUEST_METHOD: `GET` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:11:56.384554 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742f53b2-d8b3-4fc6-a466-d98a8c3ad2dc None None] SCRIPT_NAME: `/identity` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:11:56.384655 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742f53b2-d8b3-4fc6-a466-d98a8c3ad2dc None None] PATH_INFO: `/` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:11:56.387327 dv-cinder-851351-1-smb devstack@keystone.service[416294]: [pid: 416294|app: 0|req: 680/1347] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 09:11:56 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 09:11:56.393363 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3a8267-dafc-40ca-b32e-3dbe284ec9aa None None] REQUEST_METHOD: `POST` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:11:56.393941 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3a8267-dafc-40ca-b32e-3dbe284ec9aa None None] SCRIPT_NAME: `/identity` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:11:56.393941 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3a8267-dafc-40ca-b32e-3dbe284ec9aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:11:56.411246 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG dbcounter [-] [416293] Writing DB stats keystone:SELECT=100 {{(pid=416293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:11:56.483825 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.auth.core [None req-8f3a8267-dafc-40ca-b32e-3dbe284ec9aa None None] MFA Rules not processed for user `dbf87abab90e4fdf9e75408f4199918e`. Rule list: `[]` (Enabled: `True`). {{(pid=416293) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 09:11:56.485745 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.fernet_utils [None req-8f3a8267-dafc-40ca-b32e-3dbe284ec9aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=416293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 09:11:56.606620 dv-cinder-851351-1-smb devstack@keystone.service[416293]: [pid: 416293|app: 0|req: 668/1348] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 09:11:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 09:11:56.654769 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-742f53b2-d8b3-4fc6-a466-d98a8c3ad2dc None None] Authenticating user token {{(pid=416294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:11:56.656541 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.fernet_utils [None req-742f53b2-d8b3-4fc6-a466-d98a8c3ad2dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=416294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 09:11:56.735072 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG dbcounter [-] [416294] Writing DB stats keystone:SELECT=100 {{(pid=416294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:11:56.793899 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-742f53b2-d8b3-4fc6-a466-d98a8c3ad2dc None None] Validating token access rules against request {{(pid=416294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:11:56.879862 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b30301f-9b07-4228-9e4c-27be4f030f8f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1a6b3c06f2fb4c4c8b9089ca32caf7c5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4349445f224184b093d9dfd0dfc642', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:11:56.880490 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b30301f-9b07-4228-9e4c-27be4f030f8f service neutron] REQUEST_METHOD: `GET` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:11:56.880802 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b30301f-9b07-4228-9e4c-27be4f030f8f service neutron] SCRIPT_NAME: `/identity` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:11:56.881079 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b30301f-9b07-4228-9e4c-27be4f030f8f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:11:56.882747 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.fernet_utils [None req-4b30301f-9b07-4228-9e4c-27be4f030f8f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=416294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 09:11:57.022702 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG dbcounter [-] [416294] Writing DB stats keystone:SELECT=100 {{(pid=416294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:11:57.027111 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b30301f-9b07-4228-9e4c-27be4f030f8f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:11:57.028892 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b30301f-9b07-4228-9e4c-27be4f030f8f service neutron] RBAC: Authorization granted {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:11:57.049327 dv-cinder-851351-1-smb devstack@keystone.service[416294]: [pid: 416294|app: 0|req: 681/1349] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Jul 28 09:11:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 396 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 09:12:02.821437 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbee0b8-a2a3-49e9-b519-51ef563dd65e None None] REQUEST_METHOD: `GET` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:12:02.821437 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbee0b8-a2a3-49e9-b519-51ef563dd65e None None] SCRIPT_NAME: `/identity` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:12:02.821935 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbee0b8-a2a3-49e9-b519-51ef563dd65e None None] PATH_INFO: `/` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:12:02.823917 dv-cinder-851351-1-smb devstack@keystone.service[416293]: [pid: 416293|app: 0|req: 669/1350] 10.222.0.42 () {54 vars in 921 bytes} [Thu Jul 28 09:12:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 09:12:02.832108 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f459f12-200b-43ed-ac0d-78e74fa1d20f None None] REQUEST_METHOD: `POST` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:12:02.832684 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f459f12-200b-43ed-ac0d-78e74fa1d20f None None] SCRIPT_NAME: `/identity` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:12:02.832684 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f459f12-200b-43ed-ac0d-78e74fa1d20f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:12:02.957652 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.auth.core [None req-0f459f12-200b-43ed-ac0d-78e74fa1d20f None None] MFA Rules not processed for user `72e6aedb591140ca936b41c52bc0d470`. Rule list: `[]` (Enabled: `True`). {{(pid=416294) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 09:12:02.959148 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.fernet_utils [None req-0f459f12-200b-43ed-ac0d-78e74fa1d20f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=416294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 09:12:03.134319 dv-cinder-851351-1-smb devstack@keystone.service[416294]: [pid: 416294|app: 0|req: 682/1351] 10.222.0.42 () {58 vars in 1018 bytes} [Thu Jul 28 09:12:02 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 303 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 09:12:06.603574 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG dbcounter [-] [416293] Writing DB stats keystone:SELECT=59 {{(pid=416293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:12:08.334148 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ec998f-406e-4477-a8aa-78a3ec02d759 None None] REQUEST_METHOD: `GET` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:12:08.334870 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ec998f-406e-4477-a8aa-78a3ec02d759 None None] SCRIPT_NAME: `/identity` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:12:08.334870 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ec998f-406e-4477-a8aa-78a3ec02d759 None None] PATH_INFO: `/` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:12:08.336390 dv-cinder-851351-1-smb devstack@keystone.service[416293]: [pid: 416293|app: 0|req: 670/1352] 10.222.0.42 () {54 vars in 921 bytes} [Thu Jul 28 09:12:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 09:12:08.344207 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477fa08a-6658-4d98-ae78-2736e5d6c660 None None] REQUEST_METHOD: `POST` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:12:08.345105 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477fa08a-6658-4d98-ae78-2736e5d6c660 None None] SCRIPT_NAME: `/identity` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:12:08.345105 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477fa08a-6658-4d98-ae78-2736e5d6c660 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:12:08.410472 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG dbcounter [-] [416294] Writing DB stats keystone:SELECT=100 {{(pid=416294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:12:08.438052 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.auth.core [None req-477fa08a-6658-4d98-ae78-2736e5d6c660 None None] MFA Rules not processed for user `72e6aedb591140ca936b41c52bc0d470`. Rule list: `[]` (Enabled: `True`). {{(pid=416294) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 09:12:08.439305 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.fernet_utils [None req-477fa08a-6658-4d98-ae78-2736e5d6c660 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=416294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 09:12:08.561608 dv-cinder-851351-1-smb devstack@keystone.service[416294]: [pid: 416294|app: 0|req: 683/1353] 10.222.0.42 () {58 vars in 1018 bytes} [Thu Jul 28 09:12:08 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 09:12:10.247352 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf918178-34c7-4471-b261-5203a96e2195 None None] REQUEST_METHOD: `GET` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:12:10.248006 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf918178-34c7-4471-b261-5203a96e2195 None None] SCRIPT_NAME: `/identity` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:12:10.248214 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf918178-34c7-4471-b261-5203a96e2195 None None] PATH_INFO: `/` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:12:10.250402 dv-cinder-851351-1-smb devstack@keystone.service[416293]: [pid: 416293|app: 0|req: 671/1354] 10.222.0.42 () {54 vars in 921 bytes} [Thu Jul 28 09:12:10 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 09:12:10.256589 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6099efa2-9627-4a55-9712-800dd948cca3 None None] REQUEST_METHOD: `POST` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:12:10.257555 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6099efa2-9627-4a55-9712-800dd948cca3 None None] SCRIPT_NAME: `/identity` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:12:10.257555 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6099efa2-9627-4a55-9712-800dd948cca3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:12:10.373054 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.auth.core [None req-6099efa2-9627-4a55-9712-800dd948cca3 None None] MFA Rules not processed for user `72e6aedb591140ca936b41c52bc0d470`. Rule list: `[]` (Enabled: `True`). {{(pid=416294) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 09:12:10.374847 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.fernet_utils [None req-6099efa2-9627-4a55-9712-800dd948cca3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=416294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 09:12:10.436303 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG dbcounter [-] [416294] Writing DB stats keystone:SELECT=100 {{(pid=416294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:12:10.529802 dv-cinder-851351-1-smb devstack@keystone.service[416294]: [pid: 416294|app: 0|req: 684/1355] 10.222.0.42 () {58 vars in 1018 bytes} [Thu Jul 28 09:12:10 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 274 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 09:12:14.047178 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac02ef25-28c6-4341-aa74-a83e07e687df None None] REQUEST_METHOD: `GET` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:12:14.047697 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac02ef25-28c6-4341-aa74-a83e07e687df None None] SCRIPT_NAME: `/identity` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:12:14.047697 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac02ef25-28c6-4341-aa74-a83e07e687df None None] PATH_INFO: `/` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:12:14.049077 dv-cinder-851351-1-smb devstack@keystone.service[416293]: [pid: 416293|app: 0|req: 672/1356] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 09:12:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 09:12:14.054652 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ca7304-6434-4293-9df1-0ab7fbed136e None None] REQUEST_METHOD: `POST` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:12:14.055165 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ca7304-6434-4293-9df1-0ab7fbed136e None None] SCRIPT_NAME: `/identity` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:12:14.055281 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ca7304-6434-4293-9df1-0ab7fbed136e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:12:14.171077 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.auth.core [None req-59ca7304-6434-4293-9df1-0ab7fbed136e None None] MFA Rules not processed for user `dbf87abab90e4fdf9e75408f4199918e`. Rule list: `[]` (Enabled: `True`). {{(pid=416294) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 09:12:14.172470 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.fernet_utils [None req-59ca7304-6434-4293-9df1-0ab7fbed136e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=416294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 09:12:14.346309 dv-cinder-851351-1-smb devstack@keystone.service[416294]: [pid: 416294|app: 0|req: 685/1357] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 09:12:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 293 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 09:12:14.418070 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa4fd7f-9d70-454e-a019-77e4b759323f None None] REQUEST_METHOD: `GET` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:12:14.418955 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa4fd7f-9d70-454e-a019-77e4b759323f None None] SCRIPT_NAME: `/identity` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:12:14.419549 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa4fd7f-9d70-454e-a019-77e4b759323f None None] PATH_INFO: `/` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:12:14.422432 dv-cinder-851351-1-smb devstack@keystone.service[416293]: [pid: 416293|app: 0|req: 673/1358] 10.222.0.42 () {54 vars in 962 bytes} [Thu Jul 28 09:12:14 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 28 09:12:14.436220 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8409f82a-c238-4d1e-86f4-1aedd8fa5efb None None] REQUEST_METHOD: `POST` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:12:14.436608 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8409f82a-c238-4d1e-86f4-1aedd8fa5efb None None] SCRIPT_NAME: `/identity` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:12:14.436951 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8409f82a-c238-4d1e-86f4-1aedd8fa5efb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:12:14.464177 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG dbcounter [-] [416294] Writing DB stats keystone:SELECT=100 {{(pid=416294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:12:14.542858 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.auth.core [None req-8409f82a-c238-4d1e-86f4-1aedd8fa5efb None None] MFA Rules not processed for user `62f7da38a7044000bdf5790da751a45e`. Rule list: `[]` (Enabled: `True`). {{(pid=416294) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 09:12:14.543991 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.fernet_utils [None req-8409f82a-c238-4d1e-86f4-1aedd8fa5efb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=416294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 09:12:14.687039 dv-cinder-851351-1-smb devstack@keystone.service[416294]: [pid: 416294|app: 0|req: 686/1359] 10.222.0.42 () {58 vars in 1059 bytes} [Thu Jul 28 09:12:14 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 252 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 09:12:14.695186 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa4fd7f-9d70-454e-a019-77e4b759323f None None] Authenticating user token {{(pid=416293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:12:14.697541 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.fernet_utils [None req-caa4fd7f-9d70-454e-a019-77e4b759323f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=416293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 09:12:14.905553 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa4fd7f-9d70-454e-a019-77e4b759323f None None] Validating token access rules against request {{(pid=416293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:12:15.047426 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG dbcounter [-] [416293] Writing DB stats keystone:SELECT=100 {{(pid=416293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:12:15.114783 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2d94aa-2b38-4aa3-ac45-46fe0615055a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62f7da38a7044000bdf5790da751a45e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4349445f224184b093d9dfd0dfc642', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:12:15.115667 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2d94aa-2b38-4aa3-ac45-46fe0615055a service nova] REQUEST_METHOD: `GET` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:12:15.116054 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2d94aa-2b38-4aa3-ac45-46fe0615055a service nova] SCRIPT_NAME: `/identity` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:12:15.116535 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2d94aa-2b38-4aa3-ac45-46fe0615055a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:12:15.118687 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.fernet_utils [None req-eb2d94aa-2b38-4aa3-ac45-46fe0615055a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=416293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 09:12:15.261466 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb2d94aa-2b38-4aa3-ac45-46fe0615055a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:12:15.263506 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb2d94aa-2b38-4aa3-ac45-46fe0615055a service nova] RBAC: Authorization granted {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:12:15.290489 dv-cinder-851351-1-smb devstack@keystone.service[416293]: [pid: 416293|app: 0|req: 674/1360] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Jul 28 09:12:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 596 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 09:12:17.723880 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fbcaf57-6e09-42fd-98d6-10528fc209e1 None None] REQUEST_METHOD: `GET` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:12:17.724911 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fbcaf57-6e09-42fd-98d6-10528fc209e1 None None] SCRIPT_NAME: `/identity` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:12:17.724911 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fbcaf57-6e09-42fd-98d6-10528fc209e1 None None] PATH_INFO: `/` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:12:17.726490 dv-cinder-851351-1-smb devstack@keystone.service[416294]: [pid: 416294|app: 0|req: 687/1361] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 09:12:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 28 09:12:17.732514 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540da109-dd6e-4415-af33-e23876bdd7ac None None] REQUEST_METHOD: `POST` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:12:17.733163 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540da109-dd6e-4415-af33-e23876bdd7ac None None] SCRIPT_NAME: `/identity` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:12:17.733322 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540da109-dd6e-4415-af33-e23876bdd7ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:12:17.850508 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.auth.core [None req-540da109-dd6e-4415-af33-e23876bdd7ac None None] MFA Rules not processed for user `dbf87abab90e4fdf9e75408f4199918e`. Rule list: `[]` (Enabled: `True`). {{(pid=416293) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 09:12:17.852508 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.fernet_utils [None req-540da109-dd6e-4415-af33-e23876bdd7ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=416293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 09:12:17.927560 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG dbcounter [-] [416293] Writing DB stats keystone:SELECT=100 {{(pid=416293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:12:18.060881 dv-cinder-851351-1-smb devstack@keystone.service[416293]: [pid: 416293|app: 0|req: 675/1362] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 09:12:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 326 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 09:12:18.124504 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fbcaf57-6e09-42fd-98d6-10528fc209e1 None None] Authenticating user token {{(pid=416294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:12:18.126336 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.fernet_utils [None req-4fbcaf57-6e09-42fd-98d6-10528fc209e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=416294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 09:12:18.223751 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG dbcounter [-] [416294] Writing DB stats keystone:SELECT=100 {{(pid=416294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:12:18.349004 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fbcaf57-6e09-42fd-98d6-10528fc209e1 None None] Validating token access rules against request {{(pid=416294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:12:18.509891 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280e8687-6a04-4c63-be0b-939c6a85ac98 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62f7da38a7044000bdf5790da751a45e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4349445f224184b093d9dfd0dfc642', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:12:18.510673 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280e8687-6a04-4c63-be0b-939c6a85ac98 service nova] REQUEST_METHOD: `GET` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:12:18.511024 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280e8687-6a04-4c63-be0b-939c6a85ac98 service nova] SCRIPT_NAME: `/identity` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:12:18.511371 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280e8687-6a04-4c63-be0b-939c6a85ac98 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:12:18.513225 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.fernet_utils [None req-280e8687-6a04-4c63-be0b-939c6a85ac98 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=416294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 09:12:18.545296 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG dbcounter [-] [416294] Writing DB stats keystone:SELECT=100 {{(pid=416294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:12:18.659486 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-280e8687-6a04-4c63-be0b-939c6a85ac98 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:12:18.662295 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-280e8687-6a04-4c63-be0b-939c6a85ac98 service nova] RBAC: Authorization granted {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:12:18.704789 dv-cinder-851351-1-smb devstack@keystone.service[416294]: [pid: 416294|app: 0|req: 688/1363] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Jul 28 09:12:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 581 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 09:12:21.231013 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64c2f57-c4fb-435e-b669-6d9215e6435d None None] REQUEST_METHOD: `GET` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:12:21.231682 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64c2f57-c4fb-435e-b669-6d9215e6435d None None] SCRIPT_NAME: `/identity` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:12:21.231682 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64c2f57-c4fb-435e-b669-6d9215e6435d None None] PATH_INFO: `/` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:12:21.233061 dv-cinder-851351-1-smb devstack@keystone.service[416293]: [pid: 416293|app: 0|req: 676/1364] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 09:12:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 09:12:21.239542 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feef1160-5786-4a2e-97d5-cf8471f5b9c0 None None] REQUEST_METHOD: `POST` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:12:21.240083 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feef1160-5786-4a2e-97d5-cf8471f5b9c0 None None] SCRIPT_NAME: `/identity` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:12:21.240197 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feef1160-5786-4a2e-97d5-cf8471f5b9c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:12:21.324654 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.auth.core [None req-feef1160-5786-4a2e-97d5-cf8471f5b9c0 None None] MFA Rules not processed for user `dbf87abab90e4fdf9e75408f4199918e`. Rule list: `[]` (Enabled: `True`). {{(pid=416294) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 09:12:21.326226 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.fernet_utils [None req-feef1160-5786-4a2e-97d5-cf8471f5b9c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=416294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 09:12:21.449316 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG dbcounter [-] [416294] Writing DB stats keystone:SELECT=100 {{(pid=416294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:12:21.452392 dv-cinder-851351-1-smb devstack@keystone.service[416294]: [pid: 416294|app: 0|req: 689/1365] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 09:12:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 09:12:21.513367 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf4edc1-f570-4207-8871-7b377edd08c8 None None] REQUEST_METHOD: `GET` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:12:21.513734 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf4edc1-f570-4207-8871-7b377edd08c8 None None] SCRIPT_NAME: `/identity` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:12:21.513987 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf4edc1-f570-4207-8871-7b377edd08c8 None None] PATH_INFO: `/` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:12:21.515961 dv-cinder-851351-1-smb devstack@keystone.service[416293]: [pid: 416293|app: 0|req: 677/1366] 10.222.0.42 () {54 vars in 962 bytes} [Thu Jul 28 09:12:21 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 09:12:21.523366 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd339a7f-793b-4792-9e41-521f25fc361c None None] REQUEST_METHOD: `POST` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:12:21.523940 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd339a7f-793b-4792-9e41-521f25fc361c None None] SCRIPT_NAME: `/identity` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:12:21.524329 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd339a7f-793b-4792-9e41-521f25fc361c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:12:21.627897 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.auth.core [None req-cd339a7f-793b-4792-9e41-521f25fc361c None None] MFA Rules not processed for user `62f7da38a7044000bdf5790da751a45e`. Rule list: `[]` (Enabled: `True`). {{(pid=416294) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 09:12:21.629369 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.fernet_utils [None req-cd339a7f-793b-4792-9e41-521f25fc361c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=416294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 09:12:21.783677 dv-cinder-851351-1-smb devstack@keystone.service[416294]: [pid: 416294|app: 0|req: 690/1367] 10.222.0.42 () {58 vars in 1059 bytes} [Thu Jul 28 09:12:21 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 261 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 09:12:21.793128 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf4edc1-f570-4207-8871-7b377edd08c8 None None] Authenticating user token {{(pid=416293) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:12:21.796274 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.fernet_utils [None req-edf4edc1-f570-4207-8871-7b377edd08c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=416293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 09:12:21.992640 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf4edc1-f570-4207-8871-7b377edd08c8 None None] Validating token access rules against request {{(pid=416293) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:12:22.023118 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG dbcounter [-] [416293] Writing DB stats keystone:SELECT=100 {{(pid=416293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:12:22.167654 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ee1c40-1995-402f-9371-7fbc95f7364e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62f7da38a7044000bdf5790da751a45e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4349445f224184b093d9dfd0dfc642', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416293) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:12:22.168476 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ee1c40-1995-402f-9371-7fbc95f7364e service nova] REQUEST_METHOD: `GET` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:12:22.168913 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ee1c40-1995-402f-9371-7fbc95f7364e service nova] SCRIPT_NAME: `/identity` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:12:22.169293 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ee1c40-1995-402f-9371-7fbc95f7364e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:12:22.171337 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.fernet_utils [None req-03ee1c40-1995-402f-9371-7fbc95f7364e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=416293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 09:12:22.287084 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ee1c40-1995-402f-9371-7fbc95f7364e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:12:22.289068 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ee1c40-1995-402f-9371-7fbc95f7364e service nova] RBAC: Authorization granted {{(pid=416293) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:12:22.311712 dv-cinder-851351-1-smb devstack@keystone.service[416293]: [pid: 416293|app: 0|req: 678/1368] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Jul 28 09:12:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 519 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 09:12:23.015645 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55edf3f4-d309-402e-bd83-2315714e0f3a None None] REQUEST_METHOD: `GET` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:12:23.016256 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55edf3f4-d309-402e-bd83-2315714e0f3a None None] SCRIPT_NAME: `/identity` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:12:23.016256 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55edf3f4-d309-402e-bd83-2315714e0f3a None None] PATH_INFO: `/` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:12:23.017653 dv-cinder-851351-1-smb devstack@keystone.service[416294]: [pid: 416294|app: 0|req: 691/1369] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 09:12:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 09:12:23.023971 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6203fd13-5385-4710-b6ba-08ee42a9a574 None None] REQUEST_METHOD: `POST` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:12:23.024425 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6203fd13-5385-4710-b6ba-08ee42a9a574 None None] SCRIPT_NAME: `/identity` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:12:23.024841 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6203fd13-5385-4710-b6ba-08ee42a9a574 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:12:23.066696 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG dbcounter [-] [416293] Writing DB stats keystone:SELECT=100 {{(pid=416293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:12:23.116098 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.auth.core [None req-6203fd13-5385-4710-b6ba-08ee42a9a574 None None] MFA Rules not processed for user `dbf87abab90e4fdf9e75408f4199918e`. Rule list: `[]` (Enabled: `True`). {{(pid=416293) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 09:12:23.118097 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.fernet_utils [None req-6203fd13-5385-4710-b6ba-08ee42a9a574 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=416293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 09:12:23.253006 dv-cinder-851351-1-smb devstack@keystone.service[416293]: [pid: 416293|app: 0|req: 679/1370] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 09:12:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 230 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 09:12:24.478875 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7314f3-8c22-4a09-8b39-f48128cf3470 None None] REQUEST_METHOD: `GET` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:12:24.479421 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7314f3-8c22-4a09-8b39-f48128cf3470 None None] SCRIPT_NAME: `/identity` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:12:24.479421 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7314f3-8c22-4a09-8b39-f48128cf3470 None None] PATH_INFO: `/` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:12:24.484531 dv-cinder-851351-1-smb devstack@keystone.service[416294]: [pid: 416294|app: 0|req: 692/1371] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 09:12:24 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 09:12:24.490877 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa621b88-e705-495e-8584-19d6ac3c2d4c None None] REQUEST_METHOD: `POST` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:12:24.491856 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa621b88-e705-495e-8584-19d6ac3c2d4c None None] SCRIPT_NAME: `/identity` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:12:24.492181 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa621b88-e705-495e-8584-19d6ac3c2d4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=416293) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:12:24.581768 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.auth.core [None req-fa621b88-e705-495e-8584-19d6ac3c2d4c None None] MFA Rules not processed for user `dbf87abab90e4fdf9e75408f4199918e`. Rule list: `[]` (Enabled: `True`). {{(pid=416293) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 09:12:24.583113 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG keystone.common.fernet_utils [None req-fa621b88-e705-495e-8584-19d6ac3c2d4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=416293) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 09:12:24.643796 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG dbcounter [-] [416293] Writing DB stats keystone:SELECT=100 {{(pid=416293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:12:24.696603 dv-cinder-851351-1-smb devstack@keystone.service[416293]: [pid: 416293|app: 0|req: 680/1372] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 09:12:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 09:12:24.741804 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7314f3-8c22-4a09-8b39-f48128cf3470 None None] Authenticating user token {{(pid=416294) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:12:24.743344 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.fernet_utils [None req-9a7314f3-8c22-4a09-8b39-f48128cf3470 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=416294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 09:12:24.798618 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG dbcounter [-] [416294] Writing DB stats keystone:SELECT=100 {{(pid=416294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:12:24.905494 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7314f3-8c22-4a09-8b39-f48128cf3470 None None] Validating token access rules against request {{(pid=416294) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:12:25.165161 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-129ffbd2-9525-4782-94e0-2a841f192a85 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62f7da38a7044000bdf5790da751a45e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6c4349445f224184b093d9dfd0dfc642', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'ResellerAdmin', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=416294) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:12:25.165925 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129ffbd2-9525-4782-94e0-2a841f192a85 service nova] REQUEST_METHOD: `GET` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:12:25.166288 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129ffbd2-9525-4782-94e0-2a841f192a85 service nova] SCRIPT_NAME: `/identity` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:12:25.166644 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129ffbd2-9525-4782-94e0-2a841f192a85 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=416294) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:12:25.168577 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.fernet_utils [None req-129ffbd2-9525-4782-94e0-2a841f192a85 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=416294) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 09:12:25.220250 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG dbcounter [-] [416294] Writing DB stats keystone:SELECT=100 {{(pid=416294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:12:25.350770 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-129ffbd2-9525-4782-94e0-2a841f192a85 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:12:25.350770 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-129ffbd2-9525-4782-94e0-2a841f192a85 service nova] RBAC: Authorization granted {{(pid=416294) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:12:25.359081 dv-cinder-851351-1-smb devstack@keystone.service[416294]: [pid: 416294|app: 0|req: 693/1373] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Jul 28 09:12:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 618 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 09:12:34.694486 dv-cinder-851351-1-smb devstack@keystone.service[416293]: DEBUG dbcounter [-] [416293] Writing DB stats keystone:SELECT=19 {{(pid=416293) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:12:35.355938 dv-cinder-851351-1-smb devstack@keystone.service[416294]: DEBUG dbcounter [-] [416294] Writing DB stats keystone:SELECT=41 {{(pid=416294) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:12:44.921929 dv-cinder-851351-1-smb devstack@keystone.service[416282]: Thu Jul 28 09:12:44 2022 - graceful shutdown triggered... Jul 28 09:12:44.921759 dv-cinder-851351-1-smb systemd[1]: Stopping Devstack devstack@keystone.service... Jul 28 09:12:44.922888 dv-cinder-851351-1-smb devstack@keystone.service[416294]: Gracefully killing worker 2 (pid: 416294)... Jul 28 09:12:44.924263 dv-cinder-851351-1-smb devstack@keystone.service[416293]: Gracefully killing worker 1 (pid: 416293)... Jul 28 09:12:45.922419 dv-cinder-851351-1-smb devstack@keystone.service[416282]: worker 1 buried after 1 seconds Jul 28 09:12:45.922419 dv-cinder-851351-1-smb devstack@keystone.service[416282]: worker 2 buried after 1 seconds Jul 28 09:12:45.922419 dv-cinder-851351-1-smb devstack@keystone.service[416282]: goodbye to uWSGI. Jul 28 09:12:45.924197 dv-cinder-851351-1-smb systemd[1]: devstack@keystone.service: Succeeded. Jul 28 09:12:45.924795 dv-cinder-851351-1-smb systemd[1]: Stopped Devstack devstack@keystone.service. Jul 28 09:17:34.248917 dv-cinder-851351-1-smb systemd[1]: Starting Devstack devstack@keystone.service... Jul 28 09:17:34.263969 dv-cinder-851351-1-smb devstack@keystone.service[479838]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Jul 28 09:17:34.263969 dv-cinder-851351-1-smb devstack@keystone.service[479838]: *** Starting uWSGI 2.0.18-debian (64bit) on [Thu Jul 28 09:17:34 2022] *** Jul 28 09:17:34.263969 dv-cinder-851351-1-smb devstack@keystone.service[479838]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jul 28 09:17:34.263969 dv-cinder-851351-1-smb devstack@keystone.service[479838]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jul 28 09:17:34.263969 dv-cinder-851351-1-smb devstack@keystone.service[479838]: nodename: dv-cinder-851351-1-smb Jul 28 09:17:34.263969 dv-cinder-851351-1-smb devstack@keystone.service[479838]: machine: x86_64 Jul 28 09:17:34.263969 dv-cinder-851351-1-smb devstack@keystone.service[479838]: clock source: unix Jul 28 09:17:34.263969 dv-cinder-851351-1-smb devstack@keystone.service[479838]: pcre jit disabled Jul 28 09:17:34.263969 dv-cinder-851351-1-smb devstack@keystone.service[479838]: detected number of CPU cores: 4 Jul 28 09:17:34.263969 dv-cinder-851351-1-smb devstack@keystone.service[479838]: current working directory: / Jul 28 09:17:34.263969 dv-cinder-851351-1-smb devstack@keystone.service[479838]: detected binary path: /usr/bin/uwsgi-core Jul 28 09:17:34.263969 dv-cinder-851351-1-smb devstack@keystone.service[479838]: your processes number limit is 47680 Jul 28 09:17:34.263969 dv-cinder-851351-1-smb devstack@keystone.service[479838]: your memory page size is 4096 bytes Jul 28 09:17:34.263969 dv-cinder-851351-1-smb devstack@keystone.service[479838]: detected max file descriptor number: 2048 Jul 28 09:17:34.263969 dv-cinder-851351-1-smb devstack@keystone.service[479838]: lock engine: pthread robust mutexes Jul 28 09:17:34.263969 dv-cinder-851351-1-smb devstack@keystone.service[479838]: thunder lock: enabled Jul 28 09:17:34.263969 dv-cinder-851351-1-smb devstack@keystone.service[479838]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Jul 28 09:17:34.263969 dv-cinder-851351-1-smb devstack@keystone.service[479838]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Jul 28 09:17:34.298389 dv-cinder-851351-1-smb devstack@keystone.service[479838]: Python main interpreter initialized at 0x557a757479d0 Jul 28 09:17:34.298389 dv-cinder-851351-1-smb devstack@keystone.service[479838]: python threads support enabled Jul 28 09:17:34.298389 dv-cinder-851351-1-smb devstack@keystone.service[479838]: your server socket listen backlog is limited to 100 connections Jul 28 09:17:34.298389 dv-cinder-851351-1-smb devstack@keystone.service[479838]: your mercy for graceful operations on workers is 90 seconds Jul 28 09:17:34.298833 dv-cinder-851351-1-smb devstack@keystone.service[479838]: mapped 403077 bytes (393 KB) for 2 cores Jul 28 09:17:34.298833 dv-cinder-851351-1-smb devstack@keystone.service[479838]: *** Operational MODE: preforking *** Jul 28 09:17:34.299126 dv-cinder-851351-1-smb devstack@keystone.service[479838]: *** uWSGI is running in multiple interpreter mode *** Jul 28 09:17:34.299126 dv-cinder-851351-1-smb devstack@keystone.service[479838]: spawned uWSGI master process (pid: 479838) Jul 28 09:17:34.299349 dv-cinder-851351-1-smb systemd[1]: Started Devstack devstack@keystone.service. Jul 28 09:17:34.300380 dv-cinder-851351-1-smb devstack@keystone.service[479838]: spawned uWSGI worker 1 (pid: 479851, cores: 1) Jul 28 09:17:34.300380 dv-cinder-851351-1-smb devstack@keystone.service[479838]: spawned uWSGI worker 2 (pid: 479852, cores: 1) Jul 28 09:17:34.300588 dv-cinder-851351-1-smb devstack@keystone.service[479838]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jul 28 09:17:39.822147 dv-cinder-851351-1-smb devstack@keystone.service[479851]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 28 09:17:39.822147 dv-cinder-851351-1-smb devstack@keystone.service[479851]: from cryptography.utils import int_from_bytes Jul 28 09:17:39.823108 dv-cinder-851351-1-smb devstack@keystone.service[479852]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 28 09:17:39.823108 dv-cinder-851351-1-smb devstack@keystone.service[479852]: from cryptography.utils import int_from_bytes Jul 28 09:17:39.823649 dv-cinder-851351-1-smb devstack@keystone.service[479851]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 28 09:17:39.823649 dv-cinder-851351-1-smb devstack@keystone.service[479851]: from cryptography.utils import int_from_bytes Jul 28 09:17:39.823781 dv-cinder-851351-1-smb devstack@keystone.service[479852]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 28 09:17:39.823781 dv-cinder-851351-1-smb devstack@keystone.service[479852]: from cryptography.utils import int_from_bytes Jul 28 09:17:39.871804 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=479851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 28 09:17:39.872043 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=479852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 28 09:17:39.872143 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=479851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 28 09:17:39.872250 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=479852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 28 09:17:39.872339 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG uwsgi [-] command line args: [] {{(pid=479851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 28 09:17:39.872431 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG uwsgi [-] command line args: [] {{(pid=479852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 28 09:17:39.872508 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=479851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 28 09:17:39.872585 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG uwsgi [-] ================================================================================ {{(pid=479851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 28 09:17:39.872696 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=479852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 28 09:17:39.872785 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG uwsgi [-] ================================================================================ {{(pid=479852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 28 09:17:39.872863 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG uwsgi [-] admin_token = **** {{(pid=479851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:17:39.873038 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG uwsgi [-] admin_token = **** {{(pid=479852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:17:39.873143 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG uwsgi [-] config_dir = [] {{(pid=479851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:17:39.873239 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=479851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:17:39.873312 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG uwsgi [-] config_dir = [] {{(pid=479852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:17:39.873389 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG uwsgi [-] config_source = [] {{(pid=479851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:17:39.873471 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=479852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:17:39.873613 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG uwsgi [-] debug = True {{(pid=479851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:17:39.873789 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG uwsgi [-] config_source = [] {{(pid=479852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:17:39.873901 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=479851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:17:39.874156 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG uwsgi [-] debug = True {{(pid=479852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:17:39.874156 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=479852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:17:39.874366 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=479851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:17:39.874457 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=479852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:17:39.874543 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG uwsgi [-] insecure_debug = False {{(pid=479851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:17:39.874633 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG uwsgi [-] insecure_debug = False {{(pid=479852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:17:39.874711 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=479851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:17:39.874789 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=479852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:17:39.874867 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=479851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:17:39.874944 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=479852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:17:39.875027 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG uwsgi [-] list_limit = None {{(pid=479851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:17:39.875105 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG uwsgi [-] list_limit = None {{(pid=479852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:17:39.875187 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG uwsgi [-] log_config_append = None {{(pid=479851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:17:39.875259 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG uwsgi [-] log_config_append = None {{(pid=479852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:17:39.875334 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=479851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:17:39.875412 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=479852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:17:39.875495 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG uwsgi [-] log_dir = None {{(pid=479851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:17:39.875583 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG uwsgi [-] log_dir = None {{(pid=479852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:17:39.875660 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG uwsgi [-] log_file = None {{(pid=479851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:17:39.875748 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG uwsgi [-] log_file = None {{(pid=479852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:17:39.876014 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=479851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:17:39.876116 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=479852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:17:39.876204 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=479851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:17:39.876283 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=479852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:17:39.876367 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=479851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:17:39.876451 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=479852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:17:39.876599 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=479851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:17:39.876767 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=479852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:17:39.876868 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=479851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:17:39.876959 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=479852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:17:39.877039 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=479851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:17:39.877149 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=479852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:17:39.877240 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=479851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:17:39.877320 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=479852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:17:39.877476 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=479851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:17:39.877654 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=479852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:17:39.877744 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=479851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:17:39.877831 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=479852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:17:39.877918 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=479851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:17:39.877998 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=479852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:17:39.878277 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=479851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:17:39.878433 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=479852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:17:39.878544 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=479851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:17:39.878640 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=479852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:17:39.878746 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=479851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:17:39.878839 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=479852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:17:39.878965 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG uwsgi [-] notification_format = cadf {{(pid=479851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:17:39.879069 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG uwsgi [-] notification_format = cadf {{(pid=479852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:17:39.879161 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=479851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:17:39.879253 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=479852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:17:39.879603 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.42/identity {{(pid=479851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:17:39.879813 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.42/identity {{(pid=479852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:17:39.879992 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG uwsgi [-] publish_errors = False {{(pid=479851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:17:39.880144 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG uwsgi [-] publish_errors = False {{(pid=479852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:17:39.880297 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=479851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:17:39.880442 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=479852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:17:39.880580 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=479851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:17:39.880751 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=479852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:17:39.880909 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=479851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:17:39.881063 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=479852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:17:39.881173 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=479851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:17:39.881270 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=479852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:17:39.881368 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=479851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:17:39.881462 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=479852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:17:39.881554 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG uwsgi [-] standard_threads = False {{(pid=479851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:17:39.881647 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG uwsgi [-] standard_threads = False {{(pid=479852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:17:39.881752 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG uwsgi [-] strict_password_check = False {{(pid=479851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:17:39.881852 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG uwsgi [-] strict_password_check = False {{(pid=479852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:17:39.881955 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=479851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:17:39.882048 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=479852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:17:39.882134 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG uwsgi [-] use_eventlog = False {{(pid=479851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:17:39.882225 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG uwsgi [-] use_eventlog = False {{(pid=479852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:17:39.882322 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG uwsgi [-] use_journal = False {{(pid=479851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:17:39.882425 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG uwsgi [-] use_journal = False {{(pid=479852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:17:39.882512 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG uwsgi [-] use_json = False {{(pid=479851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:17:39.882633 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG uwsgi [-] use_json = False {{(pid=479852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:17:39.882727 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG uwsgi [-] use_stderr = False {{(pid=479851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:17:39.882812 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG uwsgi [-] use_stderr = False {{(pid=479852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:17:39.882907 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG uwsgi [-] use_syslog = False {{(pid=479851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:17:39.882999 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG uwsgi [-] use_syslog = False {{(pid=479852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:17:39.883089 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG uwsgi [-] watch_log_file = False {{(pid=479851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:17:39.883193 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG uwsgi [-] watch_log_file = False {{(pid=479852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 09:17:39.883294 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=479851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:17:39.883386 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=479852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:17:39.883483 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=479851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:17:39.883578 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=479852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:17:39.883681 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=479851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:17:39.883774 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=479852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:17:39.883860 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=479851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:17:39.883951 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=479852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:17:39.884047 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=479851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:17:39.884139 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=479852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:17:39.884229 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=479851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:17:39.884328 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=479852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:17:39.884419 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=479851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:17:39.884510 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=479852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:17:39.884607 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=479851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:17:39.884723 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=479852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:17:39.884817 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=479851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:17:39.884908 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=479852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:17:39.885016 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=479851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:17:39.885111 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=479852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:17:39.885210 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=479851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:17:39.885393 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=479852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:17:39.885564 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=479851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:17:39.885669 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=479852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:17:39.885772 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=479851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:17:39.885871 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=479852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:17:39.885967 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=479851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:17:39.886060 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=479852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:17:39.886151 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=479851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:17:39.886342 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=479852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:17:39.886496 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=479851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:17:39.886659 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=479852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:17:39.886769 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=479851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:17:39.886866 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=479852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:17:39.886958 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=479851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:17:39.887049 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=479852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:17:39.887145 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=479851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:17:39.887292 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=479852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:17:39.887406 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=479851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:17:39.887572 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=479851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:17:39.887709 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=479852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:17:39.887874 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=479852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:17:39.887974 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=479851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:17:39.888179 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=479852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:17:39.888270 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=479851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:17:39.888377 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=479852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:17:39.888470 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=479851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:17:39.888562 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=479852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:17:39.888653 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=479851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:17:39.888855 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=479851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:17:39.888954 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=479852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:17:39.889055 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=479851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:17:39.889148 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=479852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:17:39.889240 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=479851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:17:39.889331 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=479852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:17:39.889430 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=479851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:17:39.889529 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=479852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:17:39.889691 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=479851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:17:39.889857 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=479852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:17:39.890048 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=479851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:17:39.890163 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=479852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:17:39.890267 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=479851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:17:39.890360 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=479852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:17:39.890452 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=479851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:17:39.890553 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=479852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:17:39.890639 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=479851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:17:39.890739 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=479852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:17:39.890836 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=479851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:17:39.890929 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=479852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:17:39.891061 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=479851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:17:39.891175 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=479852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:17:39.891337 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=479851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:17:39.891481 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=479852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:17:39.891596 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=479851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:17:39.891687 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=479852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:17:39.891779 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=479851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:17:39.891891 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=479852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:17:39.891981 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=479851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:17:39.892073 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=479852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:17:39.892204 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=479851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:17:39.892344 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=479852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:17:39.892450 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=479851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:17:39.892545 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=479852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:17:39.892781 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=479851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:17:39.892992 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=479852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:17:39.893161 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=479851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:17:39.893312 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=479852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:17:39.893454 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=479851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:17:39.893603 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=479852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:17:39.893603 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=479852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:17:39.893873 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=479851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:17:39.893873 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=479851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:17:39.894192 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=479852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:17:39.894339 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=479851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:17:39.894491 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=479852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:17:39.894647 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=479851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:17:39.894794 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=479852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:17:39.894948 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=479851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:17:39.895094 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=479852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:17:39.895234 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=479851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:17:39.895379 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=479852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:17:39.895527 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=479851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:17:39.895679 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=479852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:17:39.895825 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=479851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:17:39.895988 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=479852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:17:39.896135 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=479851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:17:39.896284 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=479852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:17:39.896433 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=479851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:17:39.896584 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=479852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:17:39.896751 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=479851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:17:39.896852 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=479852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:17:39.896946 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=479851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:17:39.897039 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=479852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:17:39.897125 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=479851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:17:39.897220 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=479852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:17:39.897313 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=479851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:17:39.897408 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=479852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:17:39.897495 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=479851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:17:39.897585 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=479852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:17:39.897683 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=479851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:17:39.897790 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=479852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:17:39.897883 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=479851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:17:39.897971 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=479852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:17:39.898055 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=479851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:17:39.898154 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=479852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:17:39.898254 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=479851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:17:39.898428 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=479852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:17:39.898527 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=479851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:17:39.898626 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=479852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:17:39.898724 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=479851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:17:39.898816 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=479852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:17:39.898909 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=479851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:17:39.899020 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=479852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:17:39.899122 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=479851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:17:39.899214 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=479852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:17:39.899306 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=479851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:17:39.899399 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=479852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:17:39.899492 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=479851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:17:39.899588 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=479852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:17:39.899681 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=479851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:17:39.899782 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=479852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:17:39.899875 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=479851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:17:39.899967 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=479852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:17:39.900069 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=479851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:17:39.900175 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=479852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:17:39.900269 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=479851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:17:39.900370 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=479852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:17:39.900457 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=479851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:17:39.900558 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=479852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:17:39.900651 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG uwsgi [-] cache.enabled = True {{(pid=479851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:17:39.900805 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=479852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:17:39.900900 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=479851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:17:39.900989 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG uwsgi [-] cache.enabled = True {{(pid=479852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:17:39.901080 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=479851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:17:39.901183 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=479852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:17:39.901270 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=479851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:17:39.901368 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=479852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:17:39.901461 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=479851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:17:39.901553 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=479852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:17:39.901640 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=479851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:17:39.901731 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=479852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:17:39.901823 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=479851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:17:39.902040 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=479852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:17:39.902143 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=479851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:17:39.902237 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=479852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:17:39.902324 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=479851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:17:39.902416 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=479852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:17:39.902503 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=479851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:17:39.902598 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=479852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:17:39.902686 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=479851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:17:39.902786 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=479852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:17:39.902878 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=479851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:17:39.902971 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=479852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:17:39.903064 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=479851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:17:39.903217 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=479852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:17:39.903325 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=479851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:17:39.903419 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=479852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:17:39.903511 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=479851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:17:39.903616 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=479852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:17:39.903710 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=479851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:17:39.903862 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=479852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:17:39.903975 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=479851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:17:39.904105 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=479852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:17:39.904226 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=479851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:17:39.904349 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=479852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:17:39.904459 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=479851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:17:39.904557 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=479851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:17:39.904694 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=479852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:17:39.904794 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=479851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:17:39.904889 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=479852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:17:39.905062 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=479851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:17:39.905206 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=479852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:17:39.905377 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=479852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:17:39.905472 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=479851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:17:39.905567 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=479852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:17:39.905660 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=479851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:17:39.905748 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=479852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:17:39.905847 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=479851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:17:39.905946 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=479852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:17:39.906050 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=479851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:17:39.906222 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=479852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:17:39.906377 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=479851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:17:39.906472 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=479852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:17:39.906566 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=479851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:17:39.906666 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=479851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:17:39.906760 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=479852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:17:39.906931 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG uwsgi [-] auth.external = None {{(pid=479851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:17:39.907088 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=479852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:17:39.907190 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG uwsgi [-] auth.mapped = None {{(pid=479851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:17:39.907279 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=479852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:17:39.907375 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG uwsgi [-] auth.external = None {{(pid=479852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:17:39.907467 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=479851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:17:39.907646 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG uwsgi [-] auth.mapped = None {{(pid=479852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:17:39.907805 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=479851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:17:39.908006 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG uwsgi [-] auth.password = None {{(pid=479851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:17:39.908098 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=479852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:17:39.908192 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG uwsgi [-] auth.token = None {{(pid=479851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:17:39.908287 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=479852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:17:39.908390 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=479851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:17:39.908476 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG uwsgi [-] auth.password = None {{(pid=479852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:17:39.908563 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG uwsgi [-] catalog.caching = True {{(pid=479851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:17:39.908654 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG uwsgi [-] auth.token = None {{(pid=479852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:17:39.908791 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=479851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:17:39.908893 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=479852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:17:39.908986 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=479851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:17:39.909077 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG uwsgi [-] catalog.caching = True {{(pid=479852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:17:39.909270 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=479851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:17:39.909414 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=479852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:17:39.909519 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=479851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:17:39.909624 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=479852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:17:39.909723 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=479851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:17:39.909809 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=479852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:17:39.909971 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG uwsgi [-] credential.caching = True {{(pid=479851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:17:39.910133 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=479852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:17:39.910237 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG uwsgi [-] credential.driver = sql {{(pid=479851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:17:39.910340 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=479852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:17:39.910444 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=479851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:17:39.910537 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG uwsgi [-] credential.caching = True {{(pid=479852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:17:39.910654 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=479851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:17:39.910754 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG uwsgi [-] credential.driver = sql {{(pid=479852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:17:39.910932 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=479851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:17:39.911088 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=479852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:17:39.911192 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=479851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:17:39.911288 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=479852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:17:39.911375 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=479851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:17:39.911473 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=479852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:17:39.911646 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=479852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:17:39.911787 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=479851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:17:39.911903 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=479852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:17:39.912001 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=479851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:17:39.912094 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=479851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:17:39.912187 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=479852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:17:39.912365 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=479851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:17:39.912509 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=479852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:17:39.912613 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=479852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:17:39.912750 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=479851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:17:39.912842 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=479852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:17:39.912989 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=479851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:17:39.913136 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=479851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:17:39.913248 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=479852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:17:39.913380 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=479851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:17:39.913491 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=479852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:17:39.913664 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=479851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:17:39.913808 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=479852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:17:39.913922 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG uwsgi [-] federation.caching = True {{(pid=479851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:17:39.914013 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=479852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:17:39.914121 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=479851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:17:39.914221 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=479852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:17:39.914361 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG uwsgi [-] federation.driver = sql {{(pid=479851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:17:39.914476 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG uwsgi [-] federation.caching = True {{(pid=479852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:17:39.914584 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=479852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:17:39.914671 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=479851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:17:39.914863 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=479851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:17:39.915016 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG uwsgi [-] federation.driver = sql {{(pid=479852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:17:39.915120 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=479852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:17:39.915226 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=479851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:17:39.915331 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=479851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:17:39.915424 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=479852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:17:39.915585 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=479851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:17:39.915740 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=479852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:17:39.915843 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=479852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:17:39.915937 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=479851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:17:39.916036 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=479852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:17:39.916130 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=479851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:17:39.916294 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=479852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:17:39.916438 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=479851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:17:39.916544 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=479851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:17:39.916639 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=479852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:17:39.916774 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG uwsgi [-] identity.caching = True {{(pid=479851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:17:39.916871 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=479852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:17:39.917006 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=479851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:17:39.917101 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=479852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:17:39.917258 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=479851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:17:39.917352 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG uwsgi [-] identity.caching = True {{(pid=479852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:17:39.917501 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=479851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:17:39.917596 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=479852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:17:39.917740 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=479851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:17:39.917834 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=479852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:17:39.917979 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=479852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:17:39.918078 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG uwsgi [-] identity.driver = sql {{(pid=479851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:17:39.918210 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=479851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:17:39.918305 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=479852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:17:39.918451 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=479851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:17:39.918544 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG uwsgi [-] identity.driver = sql {{(pid=479852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:17:39.918684 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=479852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:17:39.918786 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=479851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:17:39.918928 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=479852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:17:39.919022 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=479851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:17:39.919161 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=479851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:17:39.919255 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=479852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:17:39.919394 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=479851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:17:39.919496 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=479852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:17:39.919630 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=479851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:17:39.919731 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=479852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:17:39.919870 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=479852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:17:39.919969 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=479851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:17:39.920108 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=479852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:17:39.920223 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=479851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:17:39.920353 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=479851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:17:39.920453 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=479852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:17:39.920604 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=479852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:17:39.920744 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=479851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:17:39.920880 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=479851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:17:39.920983 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=479852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:17:39.921170 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=479852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:17:39.921320 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=479851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:17:39.921419 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=479851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:17:39.921505 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=479852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:17:39.921589 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=479851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:17:39.921687 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=479852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:17:39.921821 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=479851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:17:39.921916 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=479852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:17:39.922059 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=479851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:17:39.922160 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=479852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:17:39.922291 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=479851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:17:39.922396 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=479852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:17:39.922528 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=479851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:17:39.922621 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=479852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:17:39.922768 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=479851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:17:39.922869 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=479852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:17:39.923006 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=479852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:17:39.923110 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=479851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:17:39.923268 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=479851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:17:39.923365 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=479852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:17:39.923458 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=479851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:17:39.923551 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=479852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:17:39.923707 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=479851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:17:39.923814 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=479852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:17:39.923946 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=479852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:17:39.924053 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=479851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:17:39.924182 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=479851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:17:39.924275 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=479852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:17:39.924432 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=479851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:17:39.924544 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=479852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:17:39.924686 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=479852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:17:39.924802 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=479851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:17:39.924921 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=479851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:17:39.925021 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=479852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:17:39.925161 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=479851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:17:39.925267 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=479852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:17:39.925394 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG uwsgi [-] ldap.password = **** {{(pid=479851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:17:39.925488 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=479852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:17:39.925633 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=479851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:17:39.925734 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=479852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:17:39.925866 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG uwsgi [-] ldap.password = **** {{(pid=479852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:17:39.925977 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=479851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:17:39.926104 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=479851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:17:39.926203 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=479852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:17:39.926342 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=479852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:17:39.926453 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=479851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:17:39.926578 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=479851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:17:39.926681 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=479852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:17:39.926823 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=479852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:17:39.926923 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=479851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:17:39.927065 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=479852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:17:39.927165 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=479851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:17:39.927294 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=479851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:17:39.927399 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=479852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:17:39.927529 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=479851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:17:39.927639 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=479852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:17:39.927780 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=479852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:17:39.927879 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=479851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:17:39.928015 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=479852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:17:39.928117 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=479851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:17:39.928248 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=479851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:17:39.928347 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=479852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:17:39.928487 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=479851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:17:39.928588 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=479852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:17:39.928752 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=479851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:17:39.928866 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=479852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:17:39.928987 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG uwsgi [-] ldap.user = None {{(pid=479851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:17:39.929081 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=479852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:17:39.929224 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=479852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:17:39.929316 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=479851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:17:39.929482 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG uwsgi [-] ldap.user = None {{(pid=479852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:17:39.929622 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=479851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:17:39.929763 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=479851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:17:39.929857 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=479852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:17:39.930016 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=479851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:17:39.930119 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=479852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:17:39.930289 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=479852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:17:39.930377 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=479851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:17:39.930492 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=479852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:17:39.930585 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=479851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:17:39.930734 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=479851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:17:39.930827 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=479852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:17:39.930967 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=479851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:17:39.931069 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=479852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:17:39.931203 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=479851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:17:39.931297 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=479852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:17:39.931436 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=479852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:17:39.931535 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=479851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:17:39.931670 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=479851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:17:39.931781 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=479852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:17:39.931904 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=479851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:17:39.931998 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=479852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:17:39.932142 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=479852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:17:39.932233 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=479851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:17:39.932378 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=479852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:17:39.932479 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=479851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:17:39.932623 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=479851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:17:39.932784 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=479852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:17:39.932885 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=479852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:17:39.933006 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=479851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:17:39.933136 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=479852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:17:39.933264 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=479851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:17:39.933500 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=479852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:17:39.933600 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=479851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:17:39.933750 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=479851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:17:39.933842 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=479852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:17:39.933984 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=479852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:17:39.934087 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=479851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:17:39.934222 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=479851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:17:39.934319 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=479852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:17:39.934462 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=479851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:17:39.934556 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=479852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:17:39.934700 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=479852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:17:39.934793 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=479851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:17:39.934941 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=479852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:17:39.935033 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=479851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:17:39.935181 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=479852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:17:39.935273 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=479851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:17:39.935418 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=479851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:17:39.935511 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=479852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:17:39.935671 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=479852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:17:39.935769 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG uwsgi [-] policy.driver = sql {{(pid=479851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:17:39.935902 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=479851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:17:39.936002 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=479852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:17:39.936151 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=479851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:17:39.936253 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG uwsgi [-] policy.driver = sql {{(pid=479852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:17:39.936383 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=479852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:17:39.936481 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=479851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:17:39.936616 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG uwsgi [-] receipt.caching = True {{(pid=479851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:17:39.936727 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=479852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:17:39.936878 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=479851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:17:39.936973 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=479852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:17:39.937127 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=479851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:17:39.937228 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG uwsgi [-] receipt.caching = True {{(pid=479852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:17:39.937364 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=479852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:17:39.937504 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=479851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:17:39.937611 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=479851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:17:39.937705 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=479852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:17:39.937804 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=479851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:17:39.937890 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=479852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:17:39.938049 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG uwsgi [-] resource.caching = True {{(pid=479851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:17:39.938145 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=479852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:17:39.938301 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=479852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:17:39.938400 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=479851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:17:39.938546 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG uwsgi [-] resource.caching = True {{(pid=479852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:17:39.938640 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG uwsgi [-] resource.driver = sql {{(pid=479851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:17:39.938788 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=479851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:17:39.938889 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=479852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:17:39.938999 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=479851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:17:39.939085 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG uwsgi [-] resource.driver = sql {{(pid=479852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:17:39.939263 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=479851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:17:39.939357 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=479852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:17:39.939501 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG uwsgi [-] revoke.caching = True {{(pid=479851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:17:39.939609 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=479852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:17:39.939750 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=479851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:17:39.939851 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=479852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:17:39.939987 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG uwsgi [-] revoke.caching = True {{(pid=479852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:17:39.940085 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=479851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:17:39.940223 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG uwsgi [-] role.cache_time = None {{(pid=479851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:17:39.940324 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=479852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:17:39.940460 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG uwsgi [-] role.caching = True {{(pid=479851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:17:39.940561 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=479852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:17:39.940721 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG uwsgi [-] role.cache_time = None {{(pid=479852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:17:39.940817 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG uwsgi [-] role.driver = sql {{(pid=479851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:17:39.940959 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG uwsgi [-] role.list_limit = None {{(pid=479851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:17:39.941059 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG uwsgi [-] role.caching = True {{(pid=479852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:17:39.941210 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG uwsgi [-] role.driver = sql {{(pid=479852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:17:39.941309 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=479851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:17:39.941447 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG uwsgi [-] role.list_limit = None {{(pid=479852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:17:39.941610 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=479851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:17:39.941704 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=479852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:17:39.941873 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=479851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:17:39.941982 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=479852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:17:39.942126 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=479851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:17:39.942220 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=479852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:17:39.942377 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=479851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:17:39.942484 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=479852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:17:39.942628 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=479851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:17:39.942729 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=479852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:17:39.942879 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=479851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:17:39.942973 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=479852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:17:39.943127 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=479852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:17:39.943218 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=479851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:17:39.943360 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=479851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:17:39.943460 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=479852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:17:39.943602 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=479852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:17:39.943712 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=479851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:17:39.943850 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=479851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:17:39.943942 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=479852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:17:39.944098 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=479852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:17:39.944197 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=479851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:17:39.944348 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=479851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:17:39.944447 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=479852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:17:39.944595 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=479852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:17:39.944787 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=479851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:17:39.945030 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=479851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:17:39.945124 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=479852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:17:39.945301 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=479852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:17:39.945392 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=479851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:17:39.945555 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=479851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:17:39.945648 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=479852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:17:39.945806 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=479851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:17:39.945901 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=479852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:17:39.946056 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=479852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:17:39.946167 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=479851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:17:39.946299 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=479851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:17:39.946715 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=479852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:17:39.946862 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=479852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:17:39.946956 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=479851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:17:39.947113 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=479851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:17:39.947206 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=479852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:17:39.947355 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=479851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:17:39.947461 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=479852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:17:39.947641 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=479851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:17:39.947738 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=479852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:17:39.947830 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=479851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:17:39.947923 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=479852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:17:39.948084 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=479851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:17:39.948242 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=479852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:17:39.948242 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=479852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:17:39.948413 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=479851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:17:39.948498 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=479852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:17:39.948582 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=479851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:17:39.948767 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=479852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:17:39.948879 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=479851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:17:39.949010 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=479851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:17:39.949110 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=479852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:17:39.949249 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=479851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:17:39.949343 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=479852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:17:39.949482 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG uwsgi [-] token.cache_time = None {{(pid=479851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:17:39.949588 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=479852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:17:39.949715 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG uwsgi [-] token.cache_time = None {{(pid=479852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:17:39.949814 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG uwsgi [-] token.caching = True {{(pid=479851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:17:39.949952 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=479851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:17:39.950043 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG uwsgi [-] token.caching = True {{(pid=479852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:17:39.950194 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=479852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:17:39.950301 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG uwsgi [-] token.provider = fernet {{(pid=479851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:17:39.950437 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=479851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:17:39.950529 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG uwsgi [-] token.provider = fernet {{(pid=479852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:17:39.950680 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=479852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:17:39.950796 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=479851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:17:39.950940 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=479851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:17:39.951047 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=479852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:17:39.951179 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=479851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:17:39.951279 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=479852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:17:39.951415 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=479852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:17:39.951519 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=479851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:17:39.951656 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=479851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:17:39.951758 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=479852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:17:39.951900 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=479852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:17:39.951998 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG uwsgi [-] trust.driver = sql {{(pid=479851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:17:39.952135 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=479851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:17:39.952241 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG uwsgi [-] trust.driver = sql {{(pid=479852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:17:39.952372 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=479851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:17:39.952479 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=479852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:17:39.952606 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=479851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:17:39.952730 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=479852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:17:39.952879 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=479851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:17:39.952979 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=479852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:17:39.953129 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=479852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:17:39.953235 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=479851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:17:39.953357 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=479851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:17:39.953463 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=479852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:17:39.953602 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=479852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:17:39.953693 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=479851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:17:39.953850 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=479852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:17:39.954021 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=479851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:17:39.954146 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG uwsgi [-] database.connection = **** {{(pid=479851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:17:39.954246 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=479852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:17:39.954392 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=479851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:17:39.954508 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG uwsgi [-] database.connection = **** {{(pid=479852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:17:39.954643 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=479851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:17:39.954750 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=479852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:17:39.954869 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=479851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:17:39.954957 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=479852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:17:39.955110 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=479851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:17:39.955204 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=479852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:17:39.955345 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=479851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:17:39.955439 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=479852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:17:39.955582 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=479852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:17:39.955689 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=479851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:17:39.955814 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=479851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:17:39.955907 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=479852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:17:39.956051 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=479852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:17:39.956143 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=479851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:17:39.956291 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=479852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:17:39.956385 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=479851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:17:39.956525 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=479851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:17:39.956618 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=479852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:17:39.956796 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=479851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:17:39.956890 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=479852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:17:39.957017 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=479851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:17:39.957113 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=479852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:17:39.957263 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=479852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:17:39.957354 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=479851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:17:39.957497 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=479851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:17:39.957595 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=479852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:17:39.957742 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=479852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:17:39.957835 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=479851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:17:39.957973 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=479851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:17:39.958065 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=479852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:17:39.958214 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=479852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:17:39.958312 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=479851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:17:39.958449 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=479851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:17:39.958542 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=479852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:17:39.958628 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=479851) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 28 09:17:39.958712 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=479852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 09:17:39.958846 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=479852) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 28 09:17:39.988072 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=479851) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 09:17:39.988302 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=479851) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 09:17:39.988409 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=479852) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 09:17:39.988533 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=479851) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 09:17:39.988635 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=479852) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 09:17:39.988842 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=479852) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 09:17:39.997171 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=479851) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 09:17:39.997385 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=479852) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 09:17:40.028788 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=479851) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 09:17:40.029062 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=479852) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 09:17:40.029166 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=479851) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 09:17:40.029382 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=479852) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 09:17:40.083525 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=479852) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 09:17:40.084046 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=479851) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 09:17:40.134720 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=479852) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 09:17:40.134971 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=479852) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 09:17:40.135209 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=479851) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 09:17:40.135448 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=479851) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 09:17:40.201416 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=479851) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 09:17:40.202129 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=479852) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 09:17:40.202257 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=479851) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 09:17:40.202344 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=479852) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 09:17:40.202568 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=479851) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 09:17:40.203448 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=479852) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 09:17:40.203558 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=479851) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 09:17:40.203702 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=479852) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 09:17:40.203800 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=479851) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 09:17:40.203888 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=479852) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 09:17:40.204185 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=479851) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 09:17:40.204334 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=479852) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 09:17:40.226114 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=479852) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 09:17:40.226308 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=479851) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 09:17:40.226453 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=479851) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 09:17:40.226588 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=479852) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 09:17:40.226668 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=479852) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 09:17:40.226762 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=479851) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 09:17:40.226921 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=479852) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 09:17:40.227034 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=479851) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 09:17:40.227123 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=479852) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 09:17:40.227211 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=479851) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 09:17:40.227293 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=479852) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 09:17:40.227389 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=479851) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 09:17:40.227483 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=479852) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 09:17:40.227586 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=479851) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 09:17:40.238949 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=479852) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 09:17:40.239174 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=479851) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 09:17:40.251805 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=479852) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 09:17:40.252015 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=479852) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 09:17:40.252250 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=479852) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 09:17:40.252414 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=479851) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 09:17:40.252515 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=479852) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 09:17:40.252600 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=479851) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 09:17:40.252710 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=479852) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 09:17:40.252825 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=479851) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 09:17:40.252915 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=479852) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 09:17:40.252996 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=479851) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 09:17:40.253083 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=479852) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 09:17:40.253204 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=479851) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 09:17:40.253446 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=479851) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 09:17:40.253691 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=479851) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 28 09:17:40.270291 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=479852) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 09:17:40.270472 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=479852) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jul 28 09:17:40.270831 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=479852) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 09:17:40.270993 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=479852) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jul 28 09:17:40.271297 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=479852) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 09:17:40.271565 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=479852) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 09:17:40.271828 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=479852) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 09:17:40.272081 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=479852) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 09:17:40.277406 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=479851) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 09:17:40.277763 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=479851) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jul 28 09:17:40.278332 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=479851) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 09:17:40.278670 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=479851) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jul 28 09:17:40.279124 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=479851) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 09:17:40.279572 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=479851) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 09:17:40.280024 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=479851) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 09:17:40.280488 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=479851) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 09:17:40.281922 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=479852) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 09:17:40.282205 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=479852) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 09:17:40.282481 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=479852) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 09:17:40.282766 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=479852) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 09:17:40.289822 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=479852) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 28 09:17:40.294681 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=479852) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 28 09:17:40.294964 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=479852) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 09:17:40.295260 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=479852) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 09:17:40.295546 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=479852) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 09:17:40.295830 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=479852) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 09:17:40.296095 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=479852) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 09:17:40.296376 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=479852) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 09:17:40.296695 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=479852) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 09:17:40.296977 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=479852) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 09:17:40.297263 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=479852) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 09:17:40.297516 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=479852) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 09:17:40.299578 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=479851) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 09:17:40.300050 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=479851) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 09:17:40.300463 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=479851) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 09:17:40.300958 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=479851) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 09:17:40.314821 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=479851) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 28 09:17:40.320811 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=479852) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 09:17:40.322664 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=479852) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 28 09:17:40.322948 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=479852) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 09:17:40.323643 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=479851) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 28 09:17:40.324127 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=479851) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 09:17:40.324614 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=479851) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 09:17:40.325119 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=479851) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 09:17:40.325603 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=479851) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 09:17:40.326057 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=479851) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 09:17:40.326531 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=479851) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 09:17:40.327041 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=479851) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 09:17:40.327533 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=479851) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 09:17:40.327676 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=479852) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 28 09:17:40.327909 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=479852) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 09:17:40.328051 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=479851) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 09:17:40.328168 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=479852) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 09:17:40.328479 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=479851) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 09:17:40.334944 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=479852) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 28 09:17:40.335171 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=479852) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 09:17:40.339482 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=479852) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 28 09:17:40.339776 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=479852) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 09:17:40.340053 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=479852) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 09:17:40.340360 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=479852) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 09:17:40.340639 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=479852) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 09:17:40.340967 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=479852) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 09:17:40.341242 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=479852) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 09:17:40.341523 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=479852) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 09:17:40.357649 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=479852) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 09:17:40.357928 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=479852) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 09:17:40.361921 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=479852) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 28 09:17:40.365108 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=479852) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 09:17:40.365409 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=479852) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 09:17:40.369867 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=479852) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 28 09:17:40.373119 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=479852) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 28 09:17:40.374792 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=479851) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 09:17:40.376294 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=479852) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 09:17:40.376598 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=479852) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 09:17:40.376933 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=479852) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 09:17:40.377225 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=479852) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 09:17:40.377411 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=479851) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 28 09:17:40.377524 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=479852) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 09:17:40.377799 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=479852) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 09:17:40.377956 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=479851) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 09:17:40.386356 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=479851) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 28 09:17:40.386805 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=479851) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 09:17:40.387258 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=479851) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 09:17:40.393964 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=479852) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 28 09:17:40.394264 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=479852) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 09:17:40.394539 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=479852) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 09:17:40.394779 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=479852) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 09:17:40.400061 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=479851) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 28 09:17:40.400531 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=479851) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 09:17:40.401842 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=479852) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 09:17:40.403417 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=479852) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 09:17:40.403700 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=479852) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 09:17:40.406567 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=479852) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 28 09:17:40.406858 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=479852) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 09:17:40.407157 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=479852) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 09:17:40.407445 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=479852) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 09:17:40.407742 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=479852) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 09:17:40.408245 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=479851) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 28 09:17:40.408757 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=479851) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 09:17:40.409232 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=479851) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 09:17:40.409704 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=479851) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 09:17:40.410163 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=479851) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 09:17:40.410650 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=479851) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 09:17:40.411085 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=479851) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 09:17:40.411550 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=479851) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 09:17:40.419340 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=479852) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 28 09:17:40.419626 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=479852) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 09:17:40.419912 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=479852) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 09:17:40.420194 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=479852) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 09:17:40.420479 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=479852) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 09:17:40.420786 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=479852) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 09:17:40.421098 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=479852) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 09:17:40.436789 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=479852) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 28 09:17:40.439773 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=479852) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 28 09:17:40.441464 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=479851) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 09:17:40.441915 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=479851) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 09:17:40.442795 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=479852) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 09:17:40.445473 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=479852) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 09:17:40.447449 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=479852) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 28 09:17:40.447746 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=479852) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 09:17:40.448032 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=479852) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 09:17:40.449643 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=479851) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 28 09:17:40.454578 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=479852) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 09:17:40.455322 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=479851) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 09:17:40.455792 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=479851) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 09:17:40.456200 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=479852) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 28 09:17:40.459180 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=479852) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 09:17:40.459476 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=479852) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 09:17:40.459763 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=479852) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 09:17:40.460039 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=479852) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 09:17:40.464035 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=479851) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 28 09:17:40.468190 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=479852) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 28 09:17:40.468485 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=479852) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 09:17:40.468800 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=479852) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 09:17:40.469783 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=479851) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 28 09:17:40.475636 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=479851) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 09:17:40.475797 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=479852) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 28 09:17:40.475984 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=479852) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 09:17:40.476148 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=479851) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 09:17:40.476240 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=479852) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 09:17:40.476606 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=479852) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 09:17:40.476786 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=479851) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 09:17:40.476903 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=479852) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 09:17:40.477150 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=479851) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 09:17:40.477293 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=479852) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 09:17:40.477452 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=479852) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 09:17:40.477623 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=479851) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 09:17:40.477721 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=479852) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 09:17:40.478094 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=479852) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 09:17:40.478246 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=479851) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 09:17:40.478371 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=479852) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 09:17:40.478695 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=479852) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 09:17:40.478966 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=479852) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 09:17:40.479248 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=479852) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 09:17:40.479515 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=479852) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 09:17:40.510219 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=479851) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 28 09:17:40.510718 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=479851) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 09:17:40.511192 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=479851) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 09:17:40.511651 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=479851) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 09:17:40.513335 dv-cinder-851351-1-smb devstack@keystone.service[479852]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x557a757479d0 pid: 479852 (default app) Jul 28 09:17:40.516788 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331ad13e-59d7-4234-817d-f707f64aff29 None None] REQUEST_METHOD: `GET` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:17:40.517087 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331ad13e-59d7-4234-817d-f707f64aff29 None None] SCRIPT_NAME: `/identity` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:17:40.517361 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331ad13e-59d7-4234-817d-f707f64aff29 None None] PATH_INFO: `/v3` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:17:40.521724 dv-cinder-851351-1-smb devstack@keystone.service[479852]: [pid: 479852|app: 0|req: 1/1] 10.222.0.42 () {50 vars in 791 bytes} [Thu Jul 28 09:17:40 2022] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:17:40.524897 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=479851) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 09:17:40.527831 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=479851) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 09:17:40.528293 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=479851) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 09:17:40.533530 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=479851) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 28 09:17:40.534008 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=479851) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 09:17:40.534483 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=479851) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 09:17:40.534981 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=479851) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 09:17:40.535408 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=479851) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 09:17:40.557177 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=479851) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 28 09:17:40.557631 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=479851) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 09:17:40.558094 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=479851) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 09:17:40.558544 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=479851) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 09:17:40.559029 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=479851) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 09:17:40.559479 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=479851) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 09:17:40.559915 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=479851) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 09:17:40.590284 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=479851) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 28 09:17:40.596005 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=479851) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 28 09:17:40.601786 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=479851) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 09:17:40.606695 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=479851) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 09:17:40.609200 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=479851) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 28 09:17:40.612728 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=479851) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 09:17:40.612728 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=479851) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 09:17:40.622909 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=479851) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 09:17:40.638071 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=479851) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 28 09:17:40.638071 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=479851) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 09:17:40.638071 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=479851) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 09:17:40.638071 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=479851) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 09:17:40.638071 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=479851) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 09:17:40.648243 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=479851) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 28 09:17:40.649080 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=479851) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 09:17:40.649741 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=479851) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 09:17:40.663151 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=479851) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 28 09:17:40.663962 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=479851) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 09:17:40.664635 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=479851) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 09:17:40.665326 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=479851) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 09:17:40.665968 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=479851) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 09:17:40.666638 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=479851) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 09:17:40.667077 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=479851) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 09:17:40.667507 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=479851) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 09:17:40.668121 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=479851) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 09:17:40.668553 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=479851) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 09:17:40.669072 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=479851) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 09:17:40.669527 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=479851) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 09:17:40.669978 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=479851) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 09:17:40.670421 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=479851) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 28 09:17:40.736139 dv-cinder-851351-1-smb devstack@keystone.service[479851]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x557a757479d0 pid: 479851 (default app) Jul 28 09:17:48.166988 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1c5f46-d69c-45d2-a98c-a8023658d11d None None] REQUEST_METHOD: `GET` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:17:48.167626 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1c5f46-d69c-45d2-a98c-a8023658d11d None None] SCRIPT_NAME: `/identity` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:17:48.167626 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1c5f46-d69c-45d2-a98c-a8023658d11d None None] PATH_INFO: `/` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:17:48.168923 dv-cinder-851351-1-smb devstack@keystone.service[479852]: [pid: 479852|app: 0|req: 2/2] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 09:17:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 28 09:17:48.176856 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0890074f-e820-4711-926d-fc7bce2cb592 None None] REQUEST_METHOD: `POST` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:17:48.177364 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0890074f-e820-4711-926d-fc7bce2cb592 None None] SCRIPT_NAME: `/identity` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:17:48.177481 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0890074f-e820-4711-926d-fc7bce2cb592 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:17:48.249169 dv-cinder-851351-1-smb devstack@keystone.service[479851]: INFO dbcounter [None req-0890074f-e820-4711-926d-fc7bce2cb592 None None] Registered counter for database keystone Jul 28 09:17:48.271252 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG oslo_db.sqlalchemy.engines [None req-0890074f-e820-4711-926d-fc7bce2cb592 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=479851) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 28 09:17:48.279032 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG dbcounter [-] [479851] Writer thread running {{(pid=479851) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 28 09:17:48.462055 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG passlib.handlers.bcrypt [None req-0890074f-e820-4711-926d-fc7bce2cb592 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=479851) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Jul 28 09:17:48.462394 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG passlib.handlers.bcrypt [None req-0890074f-e820-4711-926d-fc7bce2cb592 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=479851) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Jul 28 09:17:48.516462 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.auth.core [None req-0890074f-e820-4711-926d-fc7bce2cb592 None None] MFA Rules not processed for user `c198f91a4ae84d2b9cc730a6e304c2be`. Rule list: `[]` (Enabled: `True`). {{(pid=479851) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 09:17:48.518163 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.fernet_utils [None req-0890074f-e820-4711-926d-fc7bce2cb592 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=479851) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 09:17:48.646436 dv-cinder-851351-1-smb devstack@keystone.service[479851]: [pid: 479851|app: 0|req: 1/3] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 09:17:48 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 473 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jul 28 09:17:48.673518 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1c5f46-d69c-45d2-a98c-a8023658d11d None None] Authenticating user token {{(pid=479852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:17:48.742853 dv-cinder-851351-1-smb devstack@keystone.service[479852]: INFO dbcounter [None req-4c1c5f46-d69c-45d2-a98c-a8023658d11d None None] Registered counter for database keystone Jul 28 09:17:48.762367 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG oslo_db.sqlalchemy.engines [None req-4c1c5f46-d69c-45d2-a98c-a8023658d11d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=479852) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 28 09:17:48.769738 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG dbcounter [-] [479852] Writer thread running {{(pid=479852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 28 09:17:48.889405 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1c5f46-d69c-45d2-a98c-a8023658d11d None None] Validating token access rules against request {{(pid=479852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:17:48.894382 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ac8097-2172-4f86-ac03-af9d3db73771 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cd1eb20d96b430f96760c31423a47ce', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:17:48.895036 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ac8097-2172-4f86-ac03-af9d3db73771 admin admin] REQUEST_METHOD: `GET` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:17:48.895314 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ac8097-2172-4f86-ac03-af9d3db73771 admin admin] SCRIPT_NAME: `/identity` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:17:48.895614 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ac8097-2172-4f86-ac03-af9d3db73771 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:17:48.904105 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76ac8097-2172-4f86-ac03-af9d3db73771 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:17:48.955089 dv-cinder-851351-1-smb devstack@keystone.service[479852]: WARNING keystone.common.rbac_enforcer.enforcer [None req-76ac8097-2172-4f86-ac03-af9d3db73771 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Jul 28 09:17:48.955427 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76ac8097-2172-4f86-ac03-af9d3db73771 admin admin] RBAC: Authorization granted {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:17:48.965935 dv-cinder-851351-1-smb devstack@keystone.service[479852]: [pid: 479852|app: 0|req: 3/4] 10.222.0.42 () {58 vars in 1324 bytes} [Thu Jul 28 09:17:48 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 293 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 28 09:17:48.972440 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0890074f-e820-4711-926d-fc7bce2cb592 None None] Authenticating user token {{(pid=479851) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:17:48.987782 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0890074f-e820-4711-926d-fc7bce2cb592 None None] Validating token access rules against request {{(pid=479851) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:17:48.993779 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed4c98b-e065-48a7-b1b8-07b8a8d1e5b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cd1eb20d96b430f96760c31423a47ce', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479851) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:17:48.994858 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed4c98b-e065-48a7-b1b8-07b8a8d1e5b7 admin admin] REQUEST_METHOD: `GET` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:17:48.995144 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed4c98b-e065-48a7-b1b8-07b8a8d1e5b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:17:48.995439 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed4c98b-e065-48a7-b1b8-07b8a8d1e5b7 admin admin] PATH_INFO: `/v3/projects/5cd1eb20d96b430f96760c31423a47ce` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:17:48.997254 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ed4c98b-e065-48a7-b1b8-07b8a8d1e5b7 admin admin] RBAC: Authorizing `identity:get_project(project_id=5cd1eb20d96b430f96760c31423a47ce)` {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:17:49.047120 dv-cinder-851351-1-smb devstack@keystone.service[479851]: WARNING keystone.common.rbac_enforcer.enforcer [None req-6ed4c98b-e065-48a7-b1b8-07b8a8d1e5b7 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Jul 28 09:17:49.047466 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ed4c98b-e065-48a7-b1b8-07b8a8d1e5b7 admin admin] RBAC: Authorization granted {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:17:49.052298 dv-cinder-851351-1-smb devstack@keystone.service[479851]: [pid: 479851|app: 0|req: 2/5] 10.222.0.42 () {56 vars in 1207 bytes} [Thu Jul 28 09:17:48 2022] GET /identity/v3/projects/5cd1eb20d96b430f96760c31423a47ce => generated 344 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:17:51.032484 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b47215-ccbe-4d1a-80ea-cc880cd7c581 None None] REQUEST_METHOD: `GET` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:17:51.033140 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b47215-ccbe-4d1a-80ea-cc880cd7c581 None None] SCRIPT_NAME: `/identity` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:17:51.033140 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b47215-ccbe-4d1a-80ea-cc880cd7c581 None None] PATH_INFO: `/` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:17:51.037761 dv-cinder-851351-1-smb devstack@keystone.service[479852]: [pid: 479852|app: 0|req: 4/6] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 09:17:51 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 28 09:17:51.043365 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd43a6b-6ca7-4205-929b-ad528fc8c63c None None] REQUEST_METHOD: `POST` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:17:51.043894 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd43a6b-6ca7-4205-929b-ad528fc8c63c None None] SCRIPT_NAME: `/identity` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:17:51.043894 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd43a6b-6ca7-4205-929b-ad528fc8c63c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:17:51.065158 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.auth.core [None req-edd43a6b-6ca7-4205-929b-ad528fc8c63c None None] MFA Rules not processed for user `c198f91a4ae84d2b9cc730a6e304c2be`. Rule list: `[]` (Enabled: `True`). {{(pid=479851) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 09:17:51.066697 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.fernet_utils [None req-edd43a6b-6ca7-4205-929b-ad528fc8c63c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=479851) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 09:17:51.076531 dv-cinder-851351-1-smb devstack@keystone.service[479851]: [pid: 479851|app: 0|req: 3/7] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 09:17:51 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jul 28 09:17:51.099051 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b47215-ccbe-4d1a-80ea-cc880cd7c581 None None] Authenticating user token {{(pid=479852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:17:51.113140 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b47215-ccbe-4d1a-80ea-cc880cd7c581 None None] Validating token access rules against request {{(pid=479852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:17:51.118060 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e071c4-9d26-4339-bf03-f94edbd6348e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cd1eb20d96b430f96760c31423a47ce', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:17:51.118695 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e071c4-9d26-4339-bf03-f94edbd6348e admin admin] REQUEST_METHOD: `GET` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:17:51.118948 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e071c4-9d26-4339-bf03-f94edbd6348e admin admin] SCRIPT_NAME: `/identity` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:17:51.119256 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e071c4-9d26-4339-bf03-f94edbd6348e admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:17:51.127715 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12e071c4-9d26-4339-bf03-f94edbd6348e admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:17:51.129572 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12e071c4-9d26-4339-bf03-f94edbd6348e admin admin] RBAC: Authorization granted {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:17:51.140601 dv-cinder-851351-1-smb devstack@keystone.service[479852]: [pid: 479852|app: 0|req: 5/8] 10.222.0.42 () {58 vars in 1324 bytes} [Thu Jul 28 09:17:51 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 28 09:17:51.146786 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd43a6b-6ca7-4205-929b-ad528fc8c63c None None] Authenticating user token {{(pid=479851) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:17:51.156825 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd43a6b-6ca7-4205-929b-ad528fc8c63c None None] Validating token access rules against request {{(pid=479851) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:17:51.162969 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca4dd2ac-9799-4277-ad3c-1d36511acafb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5cd1eb20d96b430f96760c31423a47ce', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479851) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:17:51.163636 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4dd2ac-9799-4277-ad3c-1d36511acafb admin admin] REQUEST_METHOD: `GET` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:17:51.163921 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4dd2ac-9799-4277-ad3c-1d36511acafb admin admin] SCRIPT_NAME: `/identity` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:17:51.164201 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4dd2ac-9799-4277-ad3c-1d36511acafb admin admin] PATH_INFO: `/v3/users/c198f91a4ae84d2b9cc730a6e304c2be` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:17:51.165767 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca4dd2ac-9799-4277-ad3c-1d36511acafb admin admin] RBAC: Authorizing `identity:get_user(user_id=c198f91a4ae84d2b9cc730a6e304c2be)` {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:17:51.167644 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca4dd2ac-9799-4277-ad3c-1d36511acafb admin admin] RBAC: Authorization granted {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:17:51.169296 dv-cinder-851351-1-smb devstack@keystone.service[479851]: [pid: 479851|app: 0|req: 4/9] 10.222.0.42 () {56 vars in 1198 bytes} [Thu Jul 28 09:17:51 2022] GET /identity/v3/users/c198f91a4ae84d2b9cc730a6e304c2be => generated 247 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:17:53.256916 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c313c2c5-0de2-4e1a-8905-c85780b74b0a None None] REQUEST_METHOD: `GET` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:17:53.257565 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c313c2c5-0de2-4e1a-8905-c85780b74b0a None None] SCRIPT_NAME: `/identity` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:17:53.257565 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c313c2c5-0de2-4e1a-8905-c85780b74b0a None None] PATH_INFO: `/` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:17:53.258911 dv-cinder-851351-1-smb devstack@keystone.service[479852]: [pid: 479852|app: 0|req: 6/10] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 09:17:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 09:17:53.267477 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5fe8f2-abb3-4ca0-8dea-d72a84a38ceb None None] REQUEST_METHOD: `POST` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:17:53.267985 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5fe8f2-abb3-4ca0-8dea-d72a84a38ceb None None] SCRIPT_NAME: `/identity` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:17:53.268091 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5fe8f2-abb3-4ca0-8dea-d72a84a38ceb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:17:53.288558 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.auth.core [None req-0a5fe8f2-abb3-4ca0-8dea-d72a84a38ceb None None] MFA Rules not processed for user `c198f91a4ae84d2b9cc730a6e304c2be`. Rule list: `[]` (Enabled: `True`). {{(pid=479851) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 09:17:53.289837 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.fernet_utils [None req-0a5fe8f2-abb3-4ca0-8dea-d72a84a38ceb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=479851) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 09:17:53.329865 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec2814a-2e48-4c4d-868b-98d9d33ae040 None None] REQUEST_METHOD: `GET` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:17:53.330153 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec2814a-2e48-4c4d-868b-98d9d33ae040 None None] SCRIPT_NAME: `/identity` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:17:53.330428 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec2814a-2e48-4c4d-868b-98d9d33ae040 None None] PATH_INFO: `/` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:17:53.331951 dv-cinder-851351-1-smb devstack@keystone.service[479852]: [pid: 479852|app: 0|req: 7/11] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 09:17:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 09:17:53.337038 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6e36ef-a237-4a22-b7c0-35fdf8873351 None None] REQUEST_METHOD: `POST` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:17:53.337330 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6e36ef-a237-4a22-b7c0-35fdf8873351 None None] SCRIPT_NAME: `/identity` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:17:53.337813 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6e36ef-a237-4a22-b7c0-35fdf8873351 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:17:53.381607 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG passlib.handlers.bcrypt [None req-8b6e36ef-a237-4a22-b7c0-35fdf8873351 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=479852) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Jul 28 09:17:53.382042 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG passlib.handlers.bcrypt [None req-8b6e36ef-a237-4a22-b7c0-35fdf8873351 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=479852) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Jul 28 09:17:53.385925 dv-cinder-851351-1-smb devstack@keystone.service[479851]: [pid: 479851|app: 0|req: 5/12] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 09:17:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 09:17:53.408595 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5fe8f2-abb3-4ca0-8dea-d72a84a38ceb None None] Authenticating user token {{(pid=479851) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:17:53.427132 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.auth.core [None req-8b6e36ef-a237-4a22-b7c0-35fdf8873351 None None] MFA Rules not processed for user `c198f91a4ae84d2b9cc730a6e304c2be`. Rule list: `[]` (Enabled: `True`). {{(pid=479852) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 09:17:53.428846 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.fernet_utils [None req-8b6e36ef-a237-4a22-b7c0-35fdf8873351 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=479852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 09:17:53.432904 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG dbcounter [-] [479851] Writing DB stats keystone:SELECT=100 {{(pid=479851) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:17:53.529005 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5fe8f2-abb3-4ca0-8dea-d72a84a38ceb None None] Validating token access rules against request {{(pid=479851) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:17:53.535811 dv-cinder-851351-1-smb devstack@keystone.service[479852]: [pid: 479852|app: 0|req: 8/13] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 09:17:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 28 09:17:53.557933 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b6e36ef-a237-4a22-b7c0-35fdf8873351 None None] Authenticating user token {{(pid=479852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:17:53.573272 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb90c399-024e-40f7-b5c6-6ce72f98793b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479851) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:17:53.573951 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb90c399-024e-40f7-b5c6-6ce72f98793b None admin] REQUEST_METHOD: `GET` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:17:53.574239 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb90c399-024e-40f7-b5c6-6ce72f98793b None admin] SCRIPT_NAME: `/identity` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:17:53.574522 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb90c399-024e-40f7-b5c6-6ce72f98793b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:17:53.586827 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb90c399-024e-40f7-b5c6-6ce72f98793b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 09:17:53.598840 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application [None req-fb90c399-024e-40f7-b5c6-6ce72f98793b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 09:17:53.598840 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 09:17:53.598840 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 09:17:53.598840 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 09:17:53.598840 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 09:17:53.598840 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 09:17:53.598840 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 09:17:53.598840 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 09:17:53.598840 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 09:17:53.598840 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 09:17:53.598840 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 09:17:53.598840 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 09:17:53.598840 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 09:17:53.598840 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 09:17:53.598840 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 09:17:53.598840 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 09:17:53.600149 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 09:17:53.600149 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 09:17:53.600149 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 09:17:53.600149 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 09:17:53.600149 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 09:17:53.600149 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 09:17:53.600149 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 09:17:53.600149 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 09:17:53.600149 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 09:17:53.600149 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 09:17:53.600149 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 09:17:53.600149 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application with Lock( Jul 28 09:17:53.600149 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 09:17:53.600149 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return self._enter() Jul 28 09:17:53.600149 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 09:17:53.600149 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 09:17:53.601208 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 09:17:53.601208 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return self.creator() Jul 28 09:17:53.601208 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 09:17:53.601208 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application created_value = creator( Jul 28 09:17:53.601208 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 09:17:53.601208 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 09:17:53.601208 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 09:17:53.601208 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 09:17:53.601208 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 09:17:53.601208 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 09:17:53.601208 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 09:17:53.601208 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application Jul 28 09:17:53.601208 dv-cinder-851351-1-smb devstack@keystone.service[479851]: [pid: 479851|app: 0|req: 6/14] 10.222.0.42 () {56 vars in 1096 bytes} [Thu Jul 28 09:17:53 2022] GET /identity/v3/roles/admin => generated 83 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 09:17:53.606685 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb90c399-024e-40f7-b5c6-6ce72f98793b None admin] Authenticating user token {{(pid=479851) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:17:53.666578 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b6e36ef-a237-4a22-b7c0-35fdf8873351 None None] Validating token access rules against request {{(pid=479852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:17:53.668994 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG dbcounter [-] [479852] Writing DB stats keystone:SELECT=100 {{(pid=479852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:17:53.694676 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG dbcounter [-] [479851] Writing DB stats keystone:SELECT=100 {{(pid=479851) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:17:53.705733 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-856d8ae0-2b54-4470-87d5-4cd408715bd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:17:53.706724 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856d8ae0-2b54-4470-87d5-4cd408715bd6 None admin] REQUEST_METHOD: `GET` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:17:53.707080 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856d8ae0-2b54-4470-87d5-4cd408715bd6 None admin] SCRIPT_NAME: `/identity` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:17:53.707429 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856d8ae0-2b54-4470-87d5-4cd408715bd6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:17:53.713744 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb90c399-024e-40f7-b5c6-6ce72f98793b None admin] Validating token access rules against request {{(pid=479851) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:17:53.747682 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b05169-65e7-4117-a6ad-7e90945af330 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479851) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:17:53.748320 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b05169-65e7-4117-a6ad-7e90945af330 None admin] REQUEST_METHOD: `GET` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:17:53.748613 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b05169-65e7-4117-a6ad-7e90945af330 None admin] SCRIPT_NAME: `/identity` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:17:53.748926 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b05169-65e7-4117-a6ad-7e90945af330 None admin] PATH_INFO: `/v3/roles` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:17:53.749681 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b05169-65e7-4117-a6ad-7e90945af330 None admin] RBAC: Adding query filter params (name=admin) {{(pid=479851) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 09:17:53.749996 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b05169-65e7-4117-a6ad-7e90945af330 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:17:53.751425 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b05169-65e7-4117-a6ad-7e90945af330 None admin] RBAC: Authorization granted {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:17:53.764417 dv-cinder-851351-1-smb devstack@keystone.service[479851]: [pid: 479851|app: 0|req: 7/15] 10.222.0.42 () {56 vars in 1099 bytes} [Thu Jul 28 09:17:53 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 09:17:53.770163 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b05169-65e7-4117-a6ad-7e90945af330 None admin] Authenticating user token {{(pid=479851) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:17:53.777034 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-856d8ae0-2b54-4470-87d5-4cd408715bd6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:17:53.778584 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-856d8ae0-2b54-4470-87d5-4cd408715bd6 None admin] RBAC: Authorization granted {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:17:53.873726 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b05169-65e7-4117-a6ad-7e90945af330 None admin] Validating token access rules against request {{(pid=479851) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:17:53.878888 dv-cinder-851351-1-smb devstack@keystone.service[479852]: [pid: 479852|app: 0|req: 9/16] 10.222.0.42 () {58 vars in 1282 bytes} [Thu Jul 28 09:17:53 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 28 09:17:53.885163 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-856d8ae0-2b54-4470-87d5-4cd408715bd6 None admin] Authenticating user token {{(pid=479852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:17:53.888488 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG dbcounter [-] [479852] Writing DB stats keystone:SELECT=100 {{(pid=479852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:17:54.000612 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-856d8ae0-2b54-4470-87d5-4cd408715bd6 None admin] Validating token access rules against request {{(pid=479852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:17:54.022458 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc822749-d1ac-4e55-a083-20c6339cc9d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479851) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:17:54.023178 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc822749-d1ac-4e55-a083-20c6339cc9d8 None admin] REQUEST_METHOD: `GET` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:17:54.023463 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc822749-d1ac-4e55-a083-20c6339cc9d8 None admin] SCRIPT_NAME: `/identity` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:17:54.023748 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc822749-d1ac-4e55-a083-20c6339cc9d8 None admin] PATH_INFO: `/v3/users/c198f91a4ae84d2b9cc730a6e304c2be` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:17:54.025017 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc822749-d1ac-4e55-a083-20c6339cc9d8 None admin] RBAC: Authorizing `identity:get_user(user_id=c198f91a4ae84d2b9cc730a6e304c2be)` {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:17:54.026508 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc822749-d1ac-4e55-a083-20c6339cc9d8 None admin] RBAC: Authorization granted {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:17:54.028162 dv-cinder-851351-1-smb devstack@keystone.service[479851]: [pid: 479851|app: 0|req: 8/17] 10.222.0.42 () {56 vars in 1177 bytes} [Thu Jul 28 09:17:53 2022] GET /identity/v3/users/c198f91a4ae84d2b9cc730a6e304c2be => generated 247 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 09:17:54.034028 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc822749-d1ac-4e55-a083-20c6339cc9d8 None admin] Authenticating user token {{(pid=479851) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:17:54.038910 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba1f4fed-177e-46b2-8775-20bc47ac021b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:17:54.039819 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1f4fed-177e-46b2-8775-20bc47ac021b None admin] REQUEST_METHOD: `GET` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:17:54.040103 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1f4fed-177e-46b2-8775-20bc47ac021b None admin] SCRIPT_NAME: `/identity` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:17:54.040350 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1f4fed-177e-46b2-8775-20bc47ac021b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:17:54.049534 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG dbcounter [-] [479851] Writing DB stats keystone:SELECT=100 {{(pid=479851) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:17:54.059802 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba1f4fed-177e-46b2-8775-20bc47ac021b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:17:54.061433 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba1f4fed-177e-46b2-8775-20bc47ac021b None admin] RBAC: Authorization granted {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:17:54.080445 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application [None req-ba1f4fed-177e-46b2-8775-20bc47ac021b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 09:17:54.080445 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 09:17:54.080445 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 09:17:54.080445 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 09:17:54.080445 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 09:17:54.080445 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 09:17:54.080445 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 09:17:54.080445 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 09:17:54.080445 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 09:17:54.080445 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 09:17:54.080445 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 09:17:54.080445 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 09:17:54.080445 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 09:17:54.080445 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 09:17:54.080445 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 09:17:54.081683 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 09:17:54.081683 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 09:17:54.081683 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 09:17:54.081683 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 09:17:54.081683 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 09:17:54.081683 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 09:17:54.081683 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 09:17:54.081683 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 09:17:54.081683 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application with Lock( Jul 28 09:17:54.081683 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 09:17:54.081683 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self._enter() Jul 28 09:17:54.081683 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 09:17:54.081683 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 09:17:54.081683 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 09:17:54.081683 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self.creator() Jul 28 09:17:54.081683 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 09:17:54.081683 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application created_value = creator( Jul 28 09:17:54.083108 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 09:17:54.083108 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 09:17:54.083108 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 09:17:54.083108 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application Jul 28 09:17:54.083108 dv-cinder-851351-1-smb devstack@keystone.service[479852]: [pid: 479852|app: 0|req: 10/18] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 09:17:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 09:17:54.087794 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba1f4fed-177e-46b2-8775-20bc47ac021b None admin] Authenticating user token {{(pid=479852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:17:54.139030 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc822749-d1ac-4e55-a083-20c6339cc9d8 None admin] Validating token access rules against request {{(pid=479851) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:17:54.146199 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG dbcounter [-] [479852] Writing DB stats keystone:SELECT=100 {{(pid=479852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:17:54.174432 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c4de59-7eb1-44b8-901d-1512e8ca9b6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479851) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:17:54.175105 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c4de59-7eb1-44b8-901d-1512e8ca9b6e None admin] REQUEST_METHOD: `GET` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:17:54.175390 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c4de59-7eb1-44b8-901d-1512e8ca9b6e None admin] SCRIPT_NAME: `/identity` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:17:54.175694 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c4de59-7eb1-44b8-901d-1512e8ca9b6e None admin] PATH_INFO: `/v3/domains/default` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:17:54.176947 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87c4de59-7eb1-44b8-901d-1512e8ca9b6e None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:17:54.178439 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87c4de59-7eb1-44b8-901d-1512e8ca9b6e None admin] RBAC: Authorization granted {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:17:54.180176 dv-cinder-851351-1-smb devstack@keystone.service[479851]: [pid: 479851|app: 0|req: 9/19] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 09:17:54 2022] GET /identity/v3/domains/default => generated 199 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:17:54.186022 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c4de59-7eb1-44b8-901d-1512e8ca9b6e None admin] Authenticating user token {{(pid=479851) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:17:54.191162 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba1f4fed-177e-46b2-8775-20bc47ac021b None admin] Validating token access rules against request {{(pid=479852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:17:54.224533 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c84dde-0f7f-4a76-8b03-5e549d38ce9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:17:54.225185 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c84dde-0f7f-4a76-8b03-5e549d38ce9a None admin] REQUEST_METHOD: `GET` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:17:54.225464 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c84dde-0f7f-4a76-8b03-5e549d38ce9a None admin] SCRIPT_NAME: `/identity` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:17:54.225736 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c84dde-0f7f-4a76-8b03-5e549d38ce9a None admin] PATH_INFO: `/v3/domains` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:17:54.226473 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c84dde-0f7f-4a76-8b03-5e549d38ce9a None admin] RBAC: Adding query filter params (name=Default) {{(pid=479852) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 09:17:54.226766 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c84dde-0f7f-4a76-8b03-5e549d38ce9a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:17:54.228183 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c84dde-0f7f-4a76-8b03-5e549d38ce9a None admin] RBAC: Authorization granted {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:17:54.246206 dv-cinder-851351-1-smb devstack@keystone.service[479852]: [pid: 479852|app: 0|req: 11/20] 10.222.0.42 () {56 vars in 1109 bytes} [Thu Jul 28 09:17:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 09:17:54.273272 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG dbcounter [-] [479851] Writing DB stats keystone:SELECT=100 {{(pid=479851) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:17:54.295994 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c4de59-7eb1-44b8-901d-1512e8ca9b6e None admin] Validating token access rules against request {{(pid=479851) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:17:54.336581 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b547c2fb-6e63-4041-807a-2b3be702e3e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479851) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:17:54.337269 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b547c2fb-6e63-4041-807a-2b3be702e3e0 None admin] REQUEST_METHOD: `GET` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:17:54.337565 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b547c2fb-6e63-4041-807a-2b3be702e3e0 None admin] SCRIPT_NAME: `/identity` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:17:54.337850 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b547c2fb-6e63-4041-807a-2b3be702e3e0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:17:54.338682 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b547c2fb-6e63-4041-807a-2b3be702e3e0 None admin] RBAC: Adding query filter params (role.id=685084310b35477b9b2d0c7934d0f803, scope.domain.id=default, user.id=c198f91a4ae84d2b9cc730a6e304c2be) {{(pid=479851) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 09:17:54.339000 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b547c2fb-6e63-4041-807a-2b3be702e3e0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:17:54.340505 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b547c2fb-6e63-4041-807a-2b3be702e3e0 None admin] RBAC: Authorization granted {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:17:54.348589 dv-cinder-851351-1-smb devstack@keystone.service[479851]: [pid: 479851|app: 0|req: 10/21] 10.222.0.42 () {56 vars in 1322 bytes} [Thu Jul 28 09:17:54 2022] GET /identity/v3/role_assignments?user.id=c198f91a4ae84d2b9cc730a6e304c2be&scope.domain.id=default&role.id=685084310b35477b9b2d0c7934d0f803 => generated 233 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 09:17:56.710425 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634f7f9c-f15e-4188-af58-dfc85be78fdf None None] REQUEST_METHOD: `GET` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:17:56.711381 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634f7f9c-f15e-4188-af58-dfc85be78fdf None None] SCRIPT_NAME: `/identity` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:17:56.711870 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634f7f9c-f15e-4188-af58-dfc85be78fdf None None] PATH_INFO: `/` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:17:56.713529 dv-cinder-851351-1-smb devstack@keystone.service[479852]: [pid: 479852|app: 0|req: 12/22] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 09:17:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 09:17:56.719317 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d101fb-4527-4d18-9777-41294c4e7e0a None None] REQUEST_METHOD: `POST` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:17:56.720236 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d101fb-4527-4d18-9777-41294c4e7e0a None None] SCRIPT_NAME: `/identity` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:17:56.720730 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d101fb-4527-4d18-9777-41294c4e7e0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:17:56.745769 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.auth.core [None req-02d101fb-4527-4d18-9777-41294c4e7e0a None None] MFA Rules not processed for user `c198f91a4ae84d2b9cc730a6e304c2be`. Rule list: `[]` (Enabled: `True`). {{(pid=479851) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 09:17:56.747360 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.fernet_utils [None req-02d101fb-4527-4d18-9777-41294c4e7e0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=479851) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 09:17:56.836392 dv-cinder-851351-1-smb devstack@keystone.service[479851]: [pid: 479851|app: 0|req: 11/23] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 09:17:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 09:17:56.857083 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785bb8dc-a990-46b8-9928-164f9e6a4d5b None None] REQUEST_METHOD: `GET` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:17:56.857711 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785bb8dc-a990-46b8-9928-164f9e6a4d5b None None] SCRIPT_NAME: `/identity` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:17:56.860040 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785bb8dc-a990-46b8-9928-164f9e6a4d5b None None] PATH_INFO: `/` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:17:56.861710 dv-cinder-851351-1-smb devstack@keystone.service[479852]: [pid: 479852|app: 0|req: 13/24] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 09:17:56 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 09:17:56.870092 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a19fc63-d380-4f24-8ff2-1e43724a5615 None None] REQUEST_METHOD: `POST` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:17:56.870701 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a19fc63-d380-4f24-8ff2-1e43724a5615 None None] SCRIPT_NAME: `/identity` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:17:56.871182 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a19fc63-d380-4f24-8ff2-1e43724a5615 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:17:56.882125 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-785bb8dc-a990-46b8-9928-164f9e6a4d5b None None] Authenticating user token {{(pid=479852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:17:56.900316 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.auth.core [None req-5a19fc63-d380-4f24-8ff2-1e43724a5615 None None] MFA Rules not processed for user `c198f91a4ae84d2b9cc730a6e304c2be`. Rule list: `[]` (Enabled: `True`). {{(pid=479851) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 09:17:56.901895 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.fernet_utils [None req-5a19fc63-d380-4f24-8ff2-1e43724a5615 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=479851) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 09:17:57.015966 dv-cinder-851351-1-smb devstack@keystone.service[479851]: [pid: 479851|app: 0|req: 12/25] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 09:17:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 09:17:57.020685 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7bb7cf-1a8d-43c9-8893-7ba1ba9c6ae1 None None] REQUEST_METHOD: `GET` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:17:57.020685 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7bb7cf-1a8d-43c9-8893-7ba1ba9c6ae1 None None] SCRIPT_NAME: `/identity` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:17:57.020685 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7bb7cf-1a8d-43c9-8893-7ba1ba9c6ae1 None None] PATH_INFO: `/` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:17:57.021807 dv-cinder-851351-1-smb devstack@keystone.service[479851]: [pid: 479851|app: 0|req: 13/26] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 09:17:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 09:17:57.028205 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24eb809-c6a1-4a69-a912-a483d94efe16 None None] REQUEST_METHOD: `POST` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:17:57.028716 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24eb809-c6a1-4a69-a912-a483d94efe16 None None] SCRIPT_NAME: `/identity` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:17:57.029340 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24eb809-c6a1-4a69-a912-a483d94efe16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:17:57.059118 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG dbcounter [-] [479851] Writing DB stats keystone:SELECT=100 {{(pid=479851) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:17:57.079233 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.auth.core [None req-c24eb809-c6a1-4a69-a912-a483d94efe16 None None] MFA Rules not processed for user `c198f91a4ae84d2b9cc730a6e304c2be`. Rule list: `[]` (Enabled: `True`). {{(pid=479851) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 09:17:57.082269 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.fernet_utils [None req-c24eb809-c6a1-4a69-a912-a483d94efe16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=479851) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 09:17:57.125277 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-785bb8dc-a990-46b8-9928-164f9e6a4d5b None None] Validating token access rules against request {{(pid=479852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:17:57.159887 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG dbcounter [-] [479852] Writing DB stats keystone:SELECT=100 {{(pid=479852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:17:57.196075 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d36664e4-8ad0-438c-be15-c22adf6012c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:17:57.197463 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36664e4-8ad0-438c-be15-c22adf6012c2 None admin] REQUEST_METHOD: `GET` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:17:57.197929 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36664e4-8ad0-438c-be15-c22adf6012c2 None admin] SCRIPT_NAME: `/identity` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:17:57.198380 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36664e4-8ad0-438c-be15-c22adf6012c2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:17:57.221353 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d36664e4-8ad0-438c-be15-c22adf6012c2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:17:57.223513 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d36664e4-8ad0-438c-be15-c22adf6012c2 None admin] RBAC: Authorization granted {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:17:57.226341 dv-cinder-851351-1-smb devstack@keystone.service[479851]: [pid: 479851|app: 0|req: 14/27] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 09:17:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 09:17:57.227372 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24eb809-c6a1-4a69-a912-a483d94efe16 None None] Authenticating user token {{(pid=479851) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:17:57.255480 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application [None req-d36664e4-8ad0-438c-be15-c22adf6012c2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 09:17:57.255480 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 09:17:57.255480 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 09:17:57.255480 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 09:17:57.255480 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 09:17:57.255480 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 09:17:57.255480 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 09:17:57.255480 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 09:17:57.255480 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 09:17:57.255480 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 09:17:57.255480 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 09:17:57.255480 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 09:17:57.255480 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 09:17:57.255480 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 09:17:57.255480 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 09:17:57.256571 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 09:17:57.256571 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 09:17:57.256571 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 09:17:57.256571 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 09:17:57.256571 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 09:17:57.256571 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 09:17:57.256571 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 09:17:57.256571 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 09:17:57.256571 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application with Lock( Jul 28 09:17:57.256571 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 09:17:57.256571 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self._enter() Jul 28 09:17:57.256571 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 09:17:57.256571 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 09:17:57.256571 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 09:17:57.256571 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self.creator() Jul 28 09:17:57.256571 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 09:17:57.256571 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application created_value = creator( Jul 28 09:17:57.257963 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 09:17:57.257963 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 09:17:57.257963 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 09:17:57.257963 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application Jul 28 09:17:57.259730 dv-cinder-851351-1-smb devstack@keystone.service[479852]: [pid: 479852|app: 0|req: 14/28] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 09:17:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 378 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 09:17:57.261220 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f736d941-aec6-41ce-8435-13f670c906a6 None None] REQUEST_METHOD: `GET` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:17:57.261847 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f736d941-aec6-41ce-8435-13f670c906a6 None None] SCRIPT_NAME: `/identity` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:17:57.262343 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f736d941-aec6-41ce-8435-13f670c906a6 None None] PATH_INFO: `/` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:17:57.264103 dv-cinder-851351-1-smb devstack@keystone.service[479852]: [pid: 479852|app: 0|req: 15/29] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 09:17:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 09:17:57.270525 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d981ca7-28f4-43aa-bc8d-07df041b293e None None] REQUEST_METHOD: `POST` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:17:57.271107 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d981ca7-28f4-43aa-bc8d-07df041b293e None None] SCRIPT_NAME: `/identity` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:17:57.271612 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d981ca7-28f4-43aa-bc8d-07df041b293e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:17:57.299337 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.auth.core [None req-8d981ca7-28f4-43aa-bc8d-07df041b293e None None] MFA Rules not processed for user `c198f91a4ae84d2b9cc730a6e304c2be`. Rule list: `[]` (Enabled: `True`). {{(pid=479852) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 09:17:57.301132 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.fernet_utils [None req-8d981ca7-28f4-43aa-bc8d-07df041b293e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=479852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 09:17:57.361154 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24eb809-c6a1-4a69-a912-a483d94efe16 None None] Validating token access rules against request {{(pid=479851) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:17:57.376011 dv-cinder-851351-1-smb devstack@keystone.service[479852]: [pid: 479852|app: 0|req: 16/30] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 09:17:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 09:17:57.382907 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d981ca7-28f4-43aa-bc8d-07df041b293e None None] Authenticating user token {{(pid=479852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:17:57.414434 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51095751-0b0a-4269-bf64-d1f753215170 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479851) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:17:57.415142 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51095751-0b0a-4269-bf64-d1f753215170 None admin] REQUEST_METHOD: `POST` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:17:57.415377 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51095751-0b0a-4269-bf64-d1f753215170 None admin] SCRIPT_NAME: `/identity` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:17:57.415667 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51095751-0b0a-4269-bf64-d1f753215170 None admin] PATH_INFO: `/v3/roles` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:17:57.416429 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51095751-0b0a-4269-bf64-d1f753215170 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:17:57.417881 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51095751-0b0a-4269-bf64-d1f753215170 None admin] RBAC: Authorization granted {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:17:57.422497 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG dbcounter [-] [479851] Writing DB stats keystone:SELECT=100 {{(pid=479851) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:17:57.494445 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG dbcounter [-] [479852] Writing DB stats keystone:SELECT=100 {{(pid=479852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:17:57.499868 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d981ca7-28f4-43aa-bc8d-07df041b293e None None] Validating token access rules against request {{(pid=479852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:17:57.547470 dv-cinder-851351-1-smb devstack@keystone.service[479851]: [pid: 479851|app: 0|req: 15/31] 10.222.0.42 () {60 vars in 1131 bytes} [Thu Jul 28 09:17:57 2022] POST /identity/v3/roles => generated 219 bytes in 320 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 09:17:57.552828 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51095751-0b0a-4269-bf64-d1f753215170 None admin] Authenticating user token {{(pid=479851) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:17:57.680692 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51095751-0b0a-4269-bf64-d1f753215170 None admin] Validating token access rules against request {{(pid=479851) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:17:57.717615 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0717ee56-5deb-472d-b97c-3f832017fc04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479851) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:17:57.718289 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0717ee56-5deb-472d-b97c-3f832017fc04 None admin] REQUEST_METHOD: `POST` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:17:57.718583 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0717ee56-5deb-472d-b97c-3f832017fc04 None admin] SCRIPT_NAME: `/identity` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:17:57.718873 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0717ee56-5deb-472d-b97c-3f832017fc04 None admin] PATH_INFO: `/v3/roles` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:17:57.719629 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0717ee56-5deb-472d-b97c-3f832017fc04 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:17:57.721258 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0717ee56-5deb-472d-b97c-3f832017fc04 None admin] RBAC: Authorization granted {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:17:57.739258 dv-cinder-851351-1-smb devstack@keystone.service[479851]: [pid: 479851|app: 0|req: 16/32] 10.222.0.42 () {60 vars in 1131 bytes} [Thu Jul 28 09:17:57 2022] POST /identity/v3/roles => generated 225 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 09:17:57.740529 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0717ee56-5deb-472d-b97c-3f832017fc04 None admin] Authenticating user token {{(pid=479851) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:17:57.766466 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116e3557-cc04-4e7c-85d3-0621a721a7a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:17:57.767221 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116e3557-cc04-4e7c-85d3-0621a721a7a0 None admin] REQUEST_METHOD: `GET` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:17:57.767394 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116e3557-cc04-4e7c-85d3-0621a721a7a0 None admin] SCRIPT_NAME: `/identity` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:17:57.767680 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116e3557-cc04-4e7c-85d3-0621a721a7a0 None admin] PATH_INFO: `/v3/domains` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:17:57.768413 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-116e3557-cc04-4e7c-85d3-0621a721a7a0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=479852) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 09:17:57.768748 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-116e3557-cc04-4e7c-85d3-0621a721a7a0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:17:57.770268 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-116e3557-cc04-4e7c-85d3-0621a721a7a0 None admin] RBAC: Authorization granted {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:17:57.795625 dv-cinder-851351-1-smb devstack@keystone.service[479852]: [pid: 479852|app: 0|req: 17/33] 10.222.0.42 () {56 vars in 1109 bytes} [Thu Jul 28 09:17:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 418 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:17:57.804436 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116e3557-cc04-4e7c-85d3-0621a721a7a0 None admin] Authenticating user token {{(pid=479852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:17:57.818859 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG dbcounter [-] [479851] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=479851) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:17:57.878155 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0717ee56-5deb-472d-b97c-3f832017fc04 None admin] Validating token access rules against request {{(pid=479851) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:17:57.918649 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3c17ea-2051-4c54-96e9-37a5adf8ef20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479851) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:17:57.919800 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3c17ea-2051-4c54-96e9-37a5adf8ef20 None admin] REQUEST_METHOD: `GET` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:17:57.920384 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3c17ea-2051-4c54-96e9-37a5adf8ef20 None admin] SCRIPT_NAME: `/identity` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:17:57.920931 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3c17ea-2051-4c54-96e9-37a5adf8ef20 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:17:57.933764 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b3c17ea-2051-4c54-96e9-37a5adf8ef20 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 09:17:57.939898 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application [None req-7b3c17ea-2051-4c54-96e9-37a5adf8ef20 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 09:17:57.939898 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 09:17:57.939898 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 09:17:57.939898 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 09:17:57.939898 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 09:17:57.939898 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 09:17:57.939898 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 09:17:57.939898 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 09:17:57.939898 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 09:17:57.939898 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 09:17:57.939898 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 09:17:57.939898 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 09:17:57.939898 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 09:17:57.939898 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 09:17:57.939898 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 09:17:57.939898 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 09:17:57.941080 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 09:17:57.941080 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 09:17:57.941080 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 09:17:57.941080 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 09:17:57.941080 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 09:17:57.941080 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 09:17:57.941080 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 09:17:57.941080 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 09:17:57.941080 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 09:17:57.941080 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 09:17:57.941080 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 09:17:57.941080 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application with Lock( Jul 28 09:17:57.941080 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 09:17:57.941080 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return self._enter() Jul 28 09:17:57.941080 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 09:17:57.941080 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 09:17:57.942053 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 09:17:57.942053 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return self.creator() Jul 28 09:17:57.942053 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 09:17:57.942053 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application created_value = creator( Jul 28 09:17:57.942053 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 09:17:57.942053 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 09:17:57.942053 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 09:17:57.942053 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 09:17:57.942053 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 09:17:57.942053 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 09:17:57.942053 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 09:17:57.942053 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application Jul 28 09:17:57.944773 dv-cinder-851351-1-smb devstack@keystone.service[479851]: [pid: 479851|app: 0|req: 17/34] 10.222.0.42 () {56 vars in 1096 bytes} [Thu Jul 28 09:17:57 2022] GET /identity/v3/roles/admin => generated 83 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 09:17:57.951607 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3c17ea-2051-4c54-96e9-37a5adf8ef20 None admin] Authenticating user token {{(pid=479851) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:17:57.983078 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116e3557-cc04-4e7c-85d3-0621a721a7a0 None admin] Validating token access rules against request {{(pid=479852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:17:58.021489 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-361642c7-eed7-4d73-ae40-c0a52b5664b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:17:58.022078 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361642c7-eed7-4d73-ae40-c0a52b5664b8 None admin] REQUEST_METHOD: `POST` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:17:58.022365 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361642c7-eed7-4d73-ae40-c0a52b5664b8 None admin] SCRIPT_NAME: `/identity` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:17:58.022644 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361642c7-eed7-4d73-ae40-c0a52b5664b8 None admin] PATH_INFO: `/v3/projects` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:17:58.023707 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-361642c7-eed7-4d73-ae40-c0a52b5664b8 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:17:58.025223 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-361642c7-eed7-4d73-ae40-c0a52b5664b8 None admin] RBAC: Authorization granted {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:17:58.082432 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3c17ea-2051-4c54-96e9-37a5adf8ef20 None admin] Validating token access rules against request {{(pid=479851) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:17:58.101270 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG dbcounter [-] [479851] Writing DB stats keystone:SELECT=100 {{(pid=479851) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:17:58.125271 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a8233d-4199-454d-864c-8d826e0e78b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479851) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:17:58.126383 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a8233d-4199-454d-864c-8d826e0e78b1 None admin] REQUEST_METHOD: `GET` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:17:58.126911 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a8233d-4199-454d-864c-8d826e0e78b1 None admin] SCRIPT_NAME: `/identity` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:17:58.127414 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a8233d-4199-454d-864c-8d826e0e78b1 None admin] PATH_INFO: `/v3/roles` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:17:58.128366 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80a8233d-4199-454d-864c-8d826e0e78b1 None admin] RBAC: Adding query filter params (name=admin) {{(pid=479851) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 09:17:58.128936 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80a8233d-4199-454d-864c-8d826e0e78b1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:17:58.130603 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80a8233d-4199-454d-864c-8d826e0e78b1 None admin] RBAC: Authorization granted {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:17:58.140299 dv-cinder-851351-1-smb devstack@keystone.service[479851]: [pid: 479851|app: 0|req: 18/35] 10.222.0.42 () {56 vars in 1099 bytes} [Thu Jul 28 09:17:57 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 09:17:58.142142 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a736844-e5b7-41f7-9f4e-ba95f31287ca None None] REQUEST_METHOD: `GET` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:17:58.142710 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a736844-e5b7-41f7-9f4e-ba95f31287ca None None] SCRIPT_NAME: `/identity` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:17:58.143235 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a736844-e5b7-41f7-9f4e-ba95f31287ca None None] PATH_INFO: `/` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:17:58.145640 dv-cinder-851351-1-smb devstack@keystone.service[479851]: [pid: 479851|app: 0|req: 19/36] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 09:17:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 09:17:58.146625 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a736844-e5b7-41f7-9f4e-ba95f31287ca None None] Authenticating user token {{(pid=479851) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:17:58.178455 dv-cinder-851351-1-smb devstack@keystone.service[479852]: [pid: 479852|app: 0|req: 18/37] 10.222.0.42 () {60 vars in 1141 bytes} [Thu Jul 28 09:17:57 2022] POST /identity/v3/projects => generated 301 bytes in 375 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 28 09:17:58.180074 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0afc01f-59d6-4f11-82af-ba4ba03d02e4 None None] REQUEST_METHOD: `POST` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:17:58.180372 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0afc01f-59d6-4f11-82af-ba4ba03d02e4 None None] SCRIPT_NAME: `/identity` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:17:58.180657 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0afc01f-59d6-4f11-82af-ba4ba03d02e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:17:58.203454 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.auth.core [None req-b0afc01f-59d6-4f11-82af-ba4ba03d02e4 None None] MFA Rules not processed for user `c198f91a4ae84d2b9cc730a6e304c2be`. Rule list: `[]` (Enabled: `True`). {{(pid=479852) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 09:17:58.205212 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.fernet_utils [None req-b0afc01f-59d6-4f11-82af-ba4ba03d02e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=479852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 09:17:58.208820 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG dbcounter [-] [479852] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=479852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:17:58.284336 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a736844-e5b7-41f7-9f4e-ba95f31287ca None None] Validating token access rules against request {{(pid=479851) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:17:58.294900 dv-cinder-851351-1-smb devstack@keystone.service[479852]: [pid: 479852|app: 0|req: 19/38] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 09:17:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 09:17:58.297093 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832b6815-71ea-47d9-8478-4ef8bc878cb0 None None] REQUEST_METHOD: `GET` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:17:58.297093 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832b6815-71ea-47d9-8478-4ef8bc878cb0 None None] SCRIPT_NAME: `/identity` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:17:58.297093 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832b6815-71ea-47d9-8478-4ef8bc878cb0 None None] PATH_INFO: `/` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:17:58.298740 dv-cinder-851351-1-smb devstack@keystone.service[479852]: [pid: 479852|app: 0|req: 20/39] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 09:17:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 09:17:58.306450 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57df3c7-8acb-4251-b2c5-cbb5f48289ca None None] REQUEST_METHOD: `POST` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:17:58.306897 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57df3c7-8acb-4251-b2c5-cbb5f48289ca None None] SCRIPT_NAME: `/identity` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:17:58.307312 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57df3c7-8acb-4251-b2c5-cbb5f48289ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:17:58.329803 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.auth.core [None req-b57df3c7-8acb-4251-b2c5-cbb5f48289ca None None] MFA Rules not processed for user `c198f91a4ae84d2b9cc730a6e304c2be`. Rule list: `[]` (Enabled: `True`). {{(pid=479852) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 09:17:58.331113 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.fernet_utils [None req-b57df3c7-8acb-4251-b2c5-cbb5f48289ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=479852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 09:17:58.337682 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8194224f-fd27-4e9f-bdc8-dcd645973772 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479851) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:17:58.338288 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8194224f-fd27-4e9f-bdc8-dcd645973772 None admin] REQUEST_METHOD: `GET` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:17:58.338583 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8194224f-fd27-4e9f-bdc8-dcd645973772 None admin] SCRIPT_NAME: `/identity` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:17:58.338870 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8194224f-fd27-4e9f-bdc8-dcd645973772 None admin] PATH_INFO: `/v3/users/c198f91a4ae84d2b9cc730a6e304c2be` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:17:58.340197 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8194224f-fd27-4e9f-bdc8-dcd645973772 None admin] RBAC: Authorizing `identity:get_user(user_id=c198f91a4ae84d2b9cc730a6e304c2be)` {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:17:58.341765 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8194224f-fd27-4e9f-bdc8-dcd645973772 None admin] RBAC: Authorization granted {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:17:58.343496 dv-cinder-851351-1-smb devstack@keystone.service[479851]: [pid: 479851|app: 0|req: 20/40] 10.222.0.42 () {56 vars in 1177 bytes} [Thu Jul 28 09:17:58 2022] GET /identity/v3/users/c198f91a4ae84d2b9cc730a6e304c2be => generated 247 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:17:58.344378 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8194224f-fd27-4e9f-bdc8-dcd645973772 None admin] Authenticating user token {{(pid=479851) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:17:58.411227 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG dbcounter [-] [479851] Writing DB stats keystone:SELECT=100 {{(pid=479851) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:17:58.415980 dv-cinder-851351-1-smb devstack@keystone.service[479852]: [pid: 479852|app: 0|req: 21/41] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 09:17:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 09:17:58.416944 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57df3c7-8acb-4251-b2c5-cbb5f48289ca None None] Authenticating user token {{(pid=479852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:17:58.480918 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8194224f-fd27-4e9f-bdc8-dcd645973772 None admin] Validating token access rules against request {{(pid=479851) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:17:58.493953 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG dbcounter [-] [479852] Writing DB stats keystone:SELECT=100 {{(pid=479852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:17:58.514601 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0872bb-8c34-456e-80ca-e1b15878d3fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479851) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:17:58.515271 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0872bb-8c34-456e-80ca-e1b15878d3fb None admin] REQUEST_METHOD: `GET` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:17:58.515564 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0872bb-8c34-456e-80ca-e1b15878d3fb None admin] SCRIPT_NAME: `/identity` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:17:58.515848 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0872bb-8c34-456e-80ca-e1b15878d3fb None admin] PATH_INFO: `/v3/domains/default` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:17:58.517182 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df0872bb-8c34-456e-80ca-e1b15878d3fb None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:17:58.518664 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df0872bb-8c34-456e-80ca-e1b15878d3fb None admin] RBAC: Authorization granted {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:17:58.520291 dv-cinder-851351-1-smb devstack@keystone.service[479851]: [pid: 479851|app: 0|req: 21/42] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 09:17:58 2022] GET /identity/v3/domains/default => generated 199 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:17:58.525148 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0872bb-8c34-456e-80ca-e1b15878d3fb None admin] Authenticating user token {{(pid=479851) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:17:58.526289 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57df3c7-8acb-4251-b2c5-cbb5f48289ca None None] Validating token access rules against request {{(pid=479852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:17:58.560486 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a54958-9d53-4b11-b783-64426a071b11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:17:58.561179 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a54958-9d53-4b11-b783-64426a071b11 None admin] REQUEST_METHOD: `GET` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:17:58.561471 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a54958-9d53-4b11-b783-64426a071b11 None admin] SCRIPT_NAME: `/identity` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:17:58.561756 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a54958-9d53-4b11-b783-64426a071b11 None admin] PATH_INFO: `/v3/domains/default` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:17:58.562938 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a54958-9d53-4b11-b783-64426a071b11 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:17:58.564550 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a54958-9d53-4b11-b783-64426a071b11 None admin] RBAC: Authorization granted {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:17:58.566219 dv-cinder-851351-1-smb devstack@keystone.service[479852]: [pid: 479852|app: 0|req: 22/43] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 09:17:58 2022] GET /identity/v3/domains/default => generated 199 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:17:58.566968 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a54958-9d53-4b11-b783-64426a071b11 None admin] Authenticating user token {{(pid=479852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:17:58.623508 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0872bb-8c34-456e-80ca-e1b15878d3fb None admin] Validating token access rules against request {{(pid=479851) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:17:58.636497 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG dbcounter [-] [479851] Writing DB stats keystone:SELECT=100 {{(pid=479851) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:17:58.659712 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5dc13b-8ca4-4dfa-b366-4e91eca43d20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479851) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:17:58.660354 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5dc13b-8ca4-4dfa-b366-4e91eca43d20 None admin] REQUEST_METHOD: `POST` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:17:58.660644 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5dc13b-8ca4-4dfa-b366-4e91eca43d20 None admin] SCRIPT_NAME: `/identity` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:17:58.660963 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5dc13b-8ca4-4dfa-b366-4e91eca43d20 None admin] PATH_INFO: `/v3/roles` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:17:58.661705 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e5dc13b-8ca4-4dfa-b366-4e91eca43d20 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:17:58.663129 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e5dc13b-8ca4-4dfa-b366-4e91eca43d20 None admin] RBAC: Authorization granted {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:17:58.669289 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a54958-9d53-4b11-b783-64426a071b11 None admin] Validating token access rules against request {{(pid=479852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:17:58.682835 dv-cinder-851351-1-smb devstack@keystone.service[479851]: [pid: 479851|app: 0|req: 22/44] 10.222.0.42 () {60 vars in 1131 bytes} [Thu Jul 28 09:17:58 2022] POST /identity/v3/roles => generated 223 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 09:17:58.683674 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5dc13b-8ca4-4dfa-b366-4e91eca43d20 None admin] Authenticating user token {{(pid=479851) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:17:58.711246 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e42083-328b-422b-a063-1e061d28dcde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:17:58.711918 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e42083-328b-422b-a063-1e061d28dcde None admin] REQUEST_METHOD: `POST` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:17:58.712261 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e42083-328b-422b-a063-1e061d28dcde None admin] SCRIPT_NAME: `/identity` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:17:58.712551 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e42083-328b-422b-a063-1e061d28dcde None admin] PATH_INFO: `/v3/projects` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:17:58.713328 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e42083-328b-422b-a063-1e061d28dcde None admin] RBAC: Authorizing `identity:create_project()` {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:17:58.714920 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e42083-328b-422b-a063-1e061d28dcde None admin] RBAC: Authorization granted {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:17:58.727152 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG dbcounter [-] [479852] Writing DB stats keystone:SELECT=100 {{(pid=479852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:17:58.750492 dv-cinder-851351-1-smb devstack@keystone.service[479852]: [pid: 479852|app: 0|req: 23/45] 10.222.0.42 () {60 vars in 1141 bytes} [Thu Jul 28 09:17:58 2022] POST /identity/v3/projects => generated 312 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 09:17:58.822114 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5dc13b-8ca4-4dfa-b366-4e91eca43d20 None admin] Validating token access rules against request {{(pid=479851) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:17:58.865076 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee66edfe-c3f9-4d0c-b38c-200244a9f580 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479851) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:17:58.865798 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee66edfe-c3f9-4d0c-b38c-200244a9f580 None admin] REQUEST_METHOD: `PUT` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:17:58.866096 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee66edfe-c3f9-4d0c-b38c-200244a9f580 None admin] SCRIPT_NAME: `/identity` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:17:58.866435 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee66edfe-c3f9-4d0c-b38c-200244a9f580 None admin] PATH_INFO: `/v3/domains/default/users/c198f91a4ae84d2b9cc730a6e304c2be/roles/685084310b35477b9b2d0c7934d0f803` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:17:58.868860 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee66edfe-c3f9-4d0c-b38c-200244a9f580 None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=c198f91a4ae84d2b9cc730a6e304c2be, role_id=685084310b35477b9b2d0c7934d0f803)` {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:17:58.870452 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee66edfe-c3f9-4d0c-b38c-200244a9f580 None admin] RBAC: Authorization granted {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:17:58.887962 dv-cinder-851351-1-smb devstack@keystone.service[479851]: [pid: 479851|app: 0|req: 23/46] 10.222.0.42 () {58 vars in 1361 bytes} [Thu Jul 28 09:17:58 2022] PUT /identity/v3/domains/default/users/c198f91a4ae84d2b9cc730a6e304c2be/roles/685084310b35477b9b2d0c7934d0f803 => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 09:18:00.774844 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e08dba-21d5-40ab-814d-046823a49d42 None None] REQUEST_METHOD: `GET` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:18:00.775443 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e08dba-21d5-40ab-814d-046823a49d42 None None] SCRIPT_NAME: `/identity` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:18:00.775443 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e08dba-21d5-40ab-814d-046823a49d42 None None] PATH_INFO: `/` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:18:00.776703 dv-cinder-851351-1-smb devstack@keystone.service[479852]: [pid: 479852|app: 0|req: 24/47] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 09:18:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 09:18:00.782170 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b18c81-1d68-4c1f-8185-50433fa017ac None None] REQUEST_METHOD: `POST` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:18:00.782647 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b18c81-1d68-4c1f-8185-50433fa017ac None None] SCRIPT_NAME: `/identity` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:18:00.782750 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b18c81-1d68-4c1f-8185-50433fa017ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:18:00.802600 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.auth.core [None req-20b18c81-1d68-4c1f-8185-50433fa017ac None None] MFA Rules not processed for user `c198f91a4ae84d2b9cc730a6e304c2be`. Rule list: `[]` (Enabled: `True`). {{(pid=479851) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 09:18:00.804228 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.fernet_utils [None req-20b18c81-1d68-4c1f-8185-50433fa017ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=479851) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 09:18:00.832085 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG dbcounter [-] [479851] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=479851) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:18:00.877886 dv-cinder-851351-1-smb devstack@keystone.service[479851]: [pid: 479851|app: 0|req: 24/48] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 09:18:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 09:18:00.883983 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dfec680-a8a5-4c0a-8a7a-260b98322056 None None] REQUEST_METHOD: `GET` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:18:00.884353 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dfec680-a8a5-4c0a-8a7a-260b98322056 None None] SCRIPT_NAME: `/identity` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:18:00.884731 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dfec680-a8a5-4c0a-8a7a-260b98322056 None None] PATH_INFO: `/` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:18:00.886247 dv-cinder-851351-1-smb devstack@keystone.service[479852]: [pid: 479852|app: 0|req: 25/49] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 09:18:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 09:18:00.891761 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f9e0c3-f9c8-4424-846b-1ed0ddcc35db None None] REQUEST_METHOD: `POST` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:18:00.892074 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f9e0c3-f9c8-4424-846b-1ed0ddcc35db None None] SCRIPT_NAME: `/identity` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:18:00.892363 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f9e0c3-f9c8-4424-846b-1ed0ddcc35db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:18:00.900410 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dfec680-a8a5-4c0a-8a7a-260b98322056 None None] Authenticating user token {{(pid=479852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:18:00.912739 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.auth.core [None req-06f9e0c3-f9c8-4424-846b-1ed0ddcc35db None None] MFA Rules not processed for user `c198f91a4ae84d2b9cc730a6e304c2be`. Rule list: `[]` (Enabled: `True`). {{(pid=479851) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 09:18:00.913996 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.fernet_utils [None req-06f9e0c3-f9c8-4424-846b-1ed0ddcc35db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=479851) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 09:18:00.985311 dv-cinder-851351-1-smb devstack@keystone.service[479851]: [pid: 479851|app: 0|req: 25/50] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 09:18:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 09:18:01.009060 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f9e0c3-f9c8-4424-846b-1ed0ddcc35db None None] Authenticating user token {{(pid=479851) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:18:01.009499 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dfec680-a8a5-4c0a-8a7a-260b98322056 None None] Validating token access rules against request {{(pid=479852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:18:01.045140 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb7afc8-ac86-4f4e-a8d4-a3c3cf124465 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:18:01.045716 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb7afc8-ac86-4f4e-a8d4-a3c3cf124465 None admin] REQUEST_METHOD: `GET` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:18:01.046003 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb7afc8-ac86-4f4e-a8d4-a3c3cf124465 None admin] SCRIPT_NAME: `/identity` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:18:01.046286 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb7afc8-ac86-4f4e-a8d4-a3c3cf124465 None admin] PATH_INFO: `/v3/domains/default` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:18:01.047490 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fb7afc8-ac86-4f4e-a8d4-a3c3cf124465 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:18:01.048999 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fb7afc8-ac86-4f4e-a8d4-a3c3cf124465 None admin] RBAC: Authorization granted {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:18:01.050651 dv-cinder-851351-1-smb devstack@keystone.service[479852]: [pid: 479852|app: 0|req: 26/51] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 09:18:00 2022] GET /identity/v3/domains/default => generated 199 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:18:01.056570 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb7afc8-ac86-4f4e-a8d4-a3c3cf124465 None admin] Authenticating user token {{(pid=479852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:18:01.103843 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG dbcounter [-] [479851] Writing DB stats keystone:SELECT=100 {{(pid=479851) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:18:01.113821 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f9e0c3-f9c8-4424-846b-1ed0ddcc35db None None] Validating token access rules against request {{(pid=479851) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:18:01.116743 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG dbcounter [-] [479852] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=479852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:18:01.150777 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811d622d-5315-43a9-9bff-eab9844bc625 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479851) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:18:01.151448 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811d622d-5315-43a9-9bff-eab9844bc625 None admin] REQUEST_METHOD: `GET` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:18:01.151740 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811d622d-5315-43a9-9bff-eab9844bc625 None admin] SCRIPT_NAME: `/identity` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:18:01.152028 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811d622d-5315-43a9-9bff-eab9844bc625 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:18:01.159563 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb7afc8-ac86-4f4e-a8d4-a3c3cf124465 None admin] Validating token access rules against request {{(pid=479852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:18:01.162462 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-811d622d-5315-43a9-9bff-eab9844bc625 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 09:18:01.167487 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application [None req-811d622d-5315-43a9-9bff-eab9844bc625 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 09:18:01.167487 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 09:18:01.167487 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 09:18:01.167487 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 09:18:01.167487 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 09:18:01.167487 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 09:18:01.167487 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 09:18:01.167487 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 09:18:01.167487 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 09:18:01.167487 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 09:18:01.167487 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 09:18:01.167487 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 09:18:01.167487 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 09:18:01.167487 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 09:18:01.167487 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 09:18:01.167487 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 09:18:01.168801 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 09:18:01.168801 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 09:18:01.168801 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 09:18:01.168801 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 09:18:01.168801 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 09:18:01.168801 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 09:18:01.168801 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 09:18:01.168801 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 09:18:01.168801 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 09:18:01.168801 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 09:18:01.168801 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 09:18:01.168801 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application with Lock( Jul 28 09:18:01.168801 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 09:18:01.168801 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return self._enter() Jul 28 09:18:01.168801 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 09:18:01.168801 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 09:18:01.169889 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 09:18:01.169889 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return self.creator() Jul 28 09:18:01.169889 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 09:18:01.169889 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application created_value = creator( Jul 28 09:18:01.169889 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 09:18:01.169889 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 09:18:01.169889 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 09:18:01.169889 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 09:18:01.169889 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 09:18:01.169889 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 09:18:01.169889 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 09:18:01.169889 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application Jul 28 09:18:01.169889 dv-cinder-851351-1-smb devstack@keystone.service[479851]: [pid: 479851|app: 0|req: 26/52] 10.222.0.42 () {56 vars in 1096 bytes} [Thu Jul 28 09:18:01 2022] GET /identity/v3/roles/admin => generated 83 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 09:18:01.176994 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811d622d-5315-43a9-9bff-eab9844bc625 None admin] Authenticating user token {{(pid=479851) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:18:01.196644 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2e31be-5f66-4756-b35a-2ac86e0f2390 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:18:01.197407 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2e31be-5f66-4756-b35a-2ac86e0f2390 None admin] REQUEST_METHOD: `POST` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:18:01.197698 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2e31be-5f66-4756-b35a-2ac86e0f2390 None admin] SCRIPT_NAME: `/identity` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:18:01.197980 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2e31be-5f66-4756-b35a-2ac86e0f2390 None admin] PATH_INFO: `/v3/projects` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:18:01.198697 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e2e31be-5f66-4756-b35a-2ac86e0f2390 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:18:01.200204 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e2e31be-5f66-4756-b35a-2ac86e0f2390 None admin] RBAC: Authorization granted {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:18:01.227832 dv-cinder-851351-1-smb devstack@keystone.service[479852]: [pid: 479852|app: 0|req: 27/53] 10.222.0.42 () {60 vars in 1140 bytes} [Thu Jul 28 09:18:01 2022] POST /identity/v3/projects => generated 298 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 28 09:18:01.284461 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811d622d-5315-43a9-9bff-eab9844bc625 None admin] Validating token access rules against request {{(pid=479851) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:18:01.324754 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf76e87a-4ad1-4d91-9ad3-3e662d8db306 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479851) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:18:01.325422 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf76e87a-4ad1-4d91-9ad3-3e662d8db306 None admin] REQUEST_METHOD: `GET` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:18:01.325719 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf76e87a-4ad1-4d91-9ad3-3e662d8db306 None admin] SCRIPT_NAME: `/identity` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:18:01.326008 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf76e87a-4ad1-4d91-9ad3-3e662d8db306 None admin] PATH_INFO: `/v3/roles` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:18:01.326768 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf76e87a-4ad1-4d91-9ad3-3e662d8db306 None admin] RBAC: Adding query filter params (name=admin) {{(pid=479851) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 09:18:01.327089 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf76e87a-4ad1-4d91-9ad3-3e662d8db306 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:18:01.328545 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf76e87a-4ad1-4d91-9ad3-3e662d8db306 None admin] RBAC: Authorization granted {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:18:01.338237 dv-cinder-851351-1-smb devstack@keystone.service[479851]: [pid: 479851|app: 0|req: 27/54] 10.222.0.42 () {56 vars in 1099 bytes} [Thu Jul 28 09:18:01 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 09:18:01.344350 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2e31be-5f66-4756-b35a-2ac86e0f2390 None admin] Authenticating user token {{(pid=479852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:18:01.451117 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2e31be-5f66-4756-b35a-2ac86e0f2390 None admin] Validating token access rules against request {{(pid=479852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:18:01.461592 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG dbcounter [-] [479852] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=479852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:18:01.486669 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b38132-c3f7-4f28-a1d3-c2d9b2a368e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:18:01.487360 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b38132-c3f7-4f28-a1d3-c2d9b2a368e9 None admin] REQUEST_METHOD: `GET` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:18:01.487650 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b38132-c3f7-4f28-a1d3-c2d9b2a368e9 None admin] SCRIPT_NAME: `/identity` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:18:01.487934 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b38132-c3f7-4f28-a1d3-c2d9b2a368e9 None admin] PATH_INFO: `/v3/users/c198f91a4ae84d2b9cc730a6e304c2be` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:18:01.489583 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3b38132-c3f7-4f28-a1d3-c2d9b2a368e9 None admin] RBAC: Authorizing `identity:get_user(user_id=c198f91a4ae84d2b9cc730a6e304c2be)` {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:18:01.491103 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3b38132-c3f7-4f28-a1d3-c2d9b2a368e9 None admin] RBAC: Authorization granted {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:18:01.492944 dv-cinder-851351-1-smb devstack@keystone.service[479852]: [pid: 479852|app: 0|req: 28/55] 10.222.0.42 () {56 vars in 1177 bytes} [Thu Jul 28 09:18:01 2022] GET /identity/v3/users/c198f91a4ae84d2b9cc730a6e304c2be => generated 247 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:18:01.499017 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf76e87a-4ad1-4d91-9ad3-3e662d8db306 None admin] Authenticating user token {{(pid=479851) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:18:01.518033 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG dbcounter [-] [479851] Writing DB stats keystone:SELECT=100 {{(pid=479851) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:18:01.609286 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf76e87a-4ad1-4d91-9ad3-3e662d8db306 None admin] Validating token access rules against request {{(pid=479851) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:18:01.644603 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854c8e9b-3925-4d9c-8360-3e6df8c0b343 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479851) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:18:01.645298 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854c8e9b-3925-4d9c-8360-3e6df8c0b343 None admin] REQUEST_METHOD: `GET` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:18:01.645584 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854c8e9b-3925-4d9c-8360-3e6df8c0b343 None admin] SCRIPT_NAME: `/identity` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:18:01.645864 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854c8e9b-3925-4d9c-8360-3e6df8c0b343 None admin] PATH_INFO: `/v3/domains/default` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:18:01.647107 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-854c8e9b-3925-4d9c-8360-3e6df8c0b343 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:18:01.648770 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-854c8e9b-3925-4d9c-8360-3e6df8c0b343 None admin] RBAC: Authorization granted {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:18:01.650448 dv-cinder-851351-1-smb devstack@keystone.service[479851]: [pid: 479851|app: 0|req: 28/56] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 09:18:01 2022] GET /identity/v3/domains/default => generated 199 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:18:01.656407 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b38132-c3f7-4f28-a1d3-c2d9b2a368e9 None admin] Authenticating user token {{(pid=479852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:18:01.767317 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b38132-c3f7-4f28-a1d3-c2d9b2a368e9 None admin] Validating token access rules against request {{(pid=479852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:18:01.801792 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09bf6265-dd48-44f2-8da5-5af3daa3b546 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:18:01.802442 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09bf6265-dd48-44f2-8da5-5af3daa3b546 None admin] REQUEST_METHOD: `GET` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:18:01.802713 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09bf6265-dd48-44f2-8da5-5af3daa3b546 None admin] SCRIPT_NAME: `/identity` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:18:01.803000 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09bf6265-dd48-44f2-8da5-5af3daa3b546 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:18:01.803808 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09bf6265-dd48-44f2-8da5-5af3daa3b546 None admin] RBAC: Adding query filter params (role.id=685084310b35477b9b2d0c7934d0f803, scope.domain.id=default, user.id=c198f91a4ae84d2b9cc730a6e304c2be) {{(pid=479852) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 09:18:01.804231 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09bf6265-dd48-44f2-8da5-5af3daa3b546 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:18:01.805781 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09bf6265-dd48-44f2-8da5-5af3daa3b546 None admin] RBAC: Authorization granted {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:18:01.815278 dv-cinder-851351-1-smb devstack@keystone.service[479852]: [pid: 479852|app: 0|req: 29/57] 10.222.0.42 () {56 vars in 1322 bytes} [Thu Jul 28 09:18:01 2022] GET /identity/v3/role_assignments?user.id=c198f91a4ae84d2b9cc730a6e304c2be&scope.domain.id=default&role.id=685084310b35477b9b2d0c7934d0f803 => generated 530 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:18:03.236793 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07443cd4-3d71-4d99-b5dc-ea82cd08857c None None] REQUEST_METHOD: `GET` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:18:03.237414 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07443cd4-3d71-4d99-b5dc-ea82cd08857c None None] SCRIPT_NAME: `/identity` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:18:03.237414 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07443cd4-3d71-4d99-b5dc-ea82cd08857c None None] PATH_INFO: `/` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:18:03.238706 dv-cinder-851351-1-smb devstack@keystone.service[479851]: [pid: 479851|app: 0|req: 29/58] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 09:18:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 09:18:03.244426 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86ac966-9c65-48d3-a108-7400d9e513f1 None None] REQUEST_METHOD: `POST` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:18:03.244949 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86ac966-9c65-48d3-a108-7400d9e513f1 None None] SCRIPT_NAME: `/identity` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:18:03.245058 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86ac966-9c65-48d3-a108-7400d9e513f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:18:03.263556 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.auth.core [None req-d86ac966-9c65-48d3-a108-7400d9e513f1 None None] MFA Rules not processed for user `c198f91a4ae84d2b9cc730a6e304c2be`. Rule list: `[]` (Enabled: `True`). {{(pid=479852) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 09:18:03.264805 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.fernet_utils [None req-d86ac966-9c65-48d3-a108-7400d9e513f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=479852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 09:18:03.301119 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG dbcounter [-] [479852] Writing DB stats keystone:SELECT=100 {{(pid=479852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:18:03.334404 dv-cinder-851351-1-smb devstack@keystone.service[479852]: [pid: 479852|app: 0|req: 30/59] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 09:18:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 28 09:18:03.358840 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07443cd4-3d71-4d99-b5dc-ea82cd08857c None None] Authenticating user token {{(pid=479851) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:18:03.445582 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG dbcounter [-] [479851] Writing DB stats keystone:SELECT=100 {{(pid=479851) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:18:03.466075 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07443cd4-3d71-4d99-b5dc-ea82cd08857c None None] Validating token access rules against request {{(pid=479851) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:18:03.501103 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7166344a-5a0f-4f74-b289-ea463e23f7f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479851) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:18:03.501680 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7166344a-5a0f-4f74-b289-ea463e23f7f4 None admin] REQUEST_METHOD: `GET` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:18:03.501968 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7166344a-5a0f-4f74-b289-ea463e23f7f4 None admin] SCRIPT_NAME: `/identity` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:18:03.502253 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7166344a-5a0f-4f74-b289-ea463e23f7f4 None admin] PATH_INFO: `/v3/domains/default` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:18:03.503492 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7166344a-5a0f-4f74-b289-ea463e23f7f4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:18:03.505013 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7166344a-5a0f-4f74-b289-ea463e23f7f4 None admin] RBAC: Authorization granted {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:18:03.506642 dv-cinder-851351-1-smb devstack@keystone.service[479851]: [pid: 479851|app: 0|req: 30/60] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 09:18:03 2022] GET /identity/v3/domains/default => generated 199 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:18:03.512600 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d86ac966-9c65-48d3-a108-7400d9e513f1 None None] Authenticating user token {{(pid=479852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:18:03.615705 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d86ac966-9c65-48d3-a108-7400d9e513f1 None None] Validating token access rules against request {{(pid=479852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:18:03.652351 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7d7440-87fd-437a-865b-78d88e2c5e3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:18:03.653003 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7d7440-87fd-437a-865b-78d88e2c5e3d None admin] REQUEST_METHOD: `POST` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:18:03.653291 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7d7440-87fd-437a-865b-78d88e2c5e3d None admin] SCRIPT_NAME: `/identity` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:18:03.653570 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7d7440-87fd-437a-865b-78d88e2c5e3d None admin] PATH_INFO: `/v3/users` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:18:03.654273 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a7d7440-87fd-437a-865b-78d88e2c5e3d None admin] RBAC: Authorizing `identity:create_user()` {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:18:03.655758 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a7d7440-87fd-437a-865b-78d88e2c5e3d None admin] RBAC: Authorization granted {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:18:03.684229 dv-cinder-851351-1-smb devstack@keystone.service[479852]: [pid: 479852|app: 0|req: 31/61] 10.222.0.42 () {60 vars in 1132 bytes} [Thu Jul 28 09:18:03 2022] POST /identity/v3/users => generated 275 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 09:18:06.826778 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37151671-e1ae-40d5-afa3-f7bf93fe9f2e None None] REQUEST_METHOD: `GET` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:18:06.827853 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37151671-e1ae-40d5-afa3-f7bf93fe9f2e None None] SCRIPT_NAME: `/identity` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:18:06.828364 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37151671-e1ae-40d5-afa3-f7bf93fe9f2e None None] PATH_INFO: `/` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:18:06.830040 dv-cinder-851351-1-smb devstack@keystone.service[479851]: [pid: 479851|app: 0|req: 31/62] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 09:18:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 09:18:06.835977 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8e4d67-5e34-45fc-bfea-e06da6198676 None None] REQUEST_METHOD: `POST` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:18:06.837028 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8e4d67-5e34-45fc-bfea-e06da6198676 None None] SCRIPT_NAME: `/identity` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:18:06.837705 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8e4d67-5e34-45fc-bfea-e06da6198676 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:18:06.857610 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.auth.core [None req-ae8e4d67-5e34-45fc-bfea-e06da6198676 None None] MFA Rules not processed for user `c198f91a4ae84d2b9cc730a6e304c2be`. Rule list: `[]` (Enabled: `True`). {{(pid=479852) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 09:18:06.859506 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.fernet_utils [None req-ae8e4d67-5e34-45fc-bfea-e06da6198676 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=479852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 09:18:06.885958 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG dbcounter [-] [479852] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=479852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:18:06.939097 dv-cinder-851351-1-smb devstack@keystone.service[479852]: [pid: 479852|app: 0|req: 32/63] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 09:18:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 09:18:06.980183 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37151671-e1ae-40d5-afa3-f7bf93fe9f2e None None] Authenticating user token {{(pid=479851) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:18:07.114048 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a561ccc8-17e0-4571-835e-db416ca41d16 None None] REQUEST_METHOD: `GET` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:18:07.114254 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37151671-e1ae-40d5-afa3-f7bf93fe9f2e None None] Validating token access rules against request {{(pid=479851) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:18:07.114847 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a561ccc8-17e0-4571-835e-db416ca41d16 None None] SCRIPT_NAME: `/identity` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:18:07.115347 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a561ccc8-17e0-4571-835e-db416ca41d16 None None] PATH_INFO: `/` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:18:07.117139 dv-cinder-851351-1-smb devstack@keystone.service[479852]: [pid: 479852|app: 0|req: 33/64] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 09:18:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 28 09:18:07.122934 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dfd94f3-2f67-437b-9b00-561e8209f1fc None None] REQUEST_METHOD: `POST` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:18:07.123550 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dfd94f3-2f67-437b-9b00-561e8209f1fc None None] SCRIPT_NAME: `/identity` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:18:07.124071 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dfd94f3-2f67-437b-9b00-561e8209f1fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:18:07.144407 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.auth.core [None req-1dfd94f3-2f67-437b-9b00-561e8209f1fc None None] MFA Rules not processed for user `c198f91a4ae84d2b9cc730a6e304c2be`. Rule list: `[]` (Enabled: `True`). {{(pid=479852) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 09:18:07.146560 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.fernet_utils [None req-1dfd94f3-2f67-437b-9b00-561e8209f1fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=479852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 09:18:07.185413 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7adfc1-3cfd-4f07-87ce-086fbba22f2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479851) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:18:07.186500 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7adfc1-3cfd-4f07-87ce-086fbba22f2b None admin] REQUEST_METHOD: `GET` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:18:07.187093 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7adfc1-3cfd-4f07-87ce-086fbba22f2b None admin] SCRIPT_NAME: `/identity` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:18:07.187600 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7adfc1-3cfd-4f07-87ce-086fbba22f2b None admin] PATH_INFO: `/v3/roles/member` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:18:07.213654 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b7adfc1-3cfd-4f07-87ce-086fbba22f2b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 09:18:07.222298 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application [None req-9b7adfc1-3cfd-4f07-87ce-086fbba22f2b None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 28 09:18:07.222298 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 09:18:07.222298 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 09:18:07.222298 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 09:18:07.222298 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 09:18:07.222298 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 09:18:07.222298 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 09:18:07.222298 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 09:18:07.222298 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 09:18:07.222298 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 09:18:07.222298 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 09:18:07.222298 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 09:18:07.222298 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 09:18:07.222298 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 09:18:07.222298 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 09:18:07.222298 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 09:18:07.223433 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 09:18:07.223433 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 09:18:07.223433 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 09:18:07.223433 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 09:18:07.223433 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 09:18:07.223433 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 09:18:07.223433 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 09:18:07.223433 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 09:18:07.223433 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 09:18:07.223433 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 09:18:07.223433 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 09:18:07.223433 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application with Lock( Jul 28 09:18:07.223433 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 09:18:07.223433 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return self._enter() Jul 28 09:18:07.223433 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 09:18:07.223433 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 09:18:07.224397 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 09:18:07.224397 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return self.creator() Jul 28 09:18:07.224397 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 09:18:07.224397 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application created_value = creator( Jul 28 09:18:07.224397 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 09:18:07.224397 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 09:18:07.224397 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 09:18:07.224397 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 09:18:07.224397 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 09:18:07.224397 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 09:18:07.224397 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 28 09:18:07.224397 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application Jul 28 09:18:07.228381 dv-cinder-851351-1-smb devstack@keystone.service[479851]: [pid: 479851|app: 0|req: 32/65] 10.222.0.42 () {56 vars in 1099 bytes} [Thu Jul 28 09:18:06 2022] GET /identity/v3/roles/member => generated 84 bytes in 249 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 09:18:07.230912 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25ff923-396a-420e-a1f2-2921fa510653 None None] REQUEST_METHOD: `GET` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:18:07.231231 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25ff923-396a-420e-a1f2-2921fa510653 None None] SCRIPT_NAME: `/identity` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:18:07.231543 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25ff923-396a-420e-a1f2-2921fa510653 None None] PATH_INFO: `/` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:18:07.232957 dv-cinder-851351-1-smb devstack@keystone.service[479851]: [pid: 479851|app: 0|req: 33/66] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 09:18:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 09:18:07.233681 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e25ff923-396a-420e-a1f2-2921fa510653 None None] Authenticating user token {{(pid=479851) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:18:07.250433 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG dbcounter [-] [479851] Writing DB stats keystone:SELECT=100 {{(pid=479851) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:18:07.260547 dv-cinder-851351-1-smb devstack@keystone.service[479852]: [pid: 479852|app: 0|req: 34/67] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 09:18:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 28 09:18:07.262239 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97325772-d592-4b07-bdcb-1fea10ecdf08 None None] REQUEST_METHOD: `POST` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:18:07.263043 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97325772-d592-4b07-bdcb-1fea10ecdf08 None None] SCRIPT_NAME: `/identity` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:18:07.263590 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97325772-d592-4b07-bdcb-1fea10ecdf08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:18:07.293800 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.auth.core [None req-97325772-d592-4b07-bdcb-1fea10ecdf08 None None] MFA Rules not processed for user `c198f91a4ae84d2b9cc730a6e304c2be`. Rule list: `[]` (Enabled: `True`). {{(pid=479852) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 09:18:07.295526 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.fernet_utils [None req-97325772-d592-4b07-bdcb-1fea10ecdf08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=479852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 09:18:07.369440 dv-cinder-851351-1-smb devstack@keystone.service[479852]: [pid: 479852|app: 0|req: 35/68] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 09:18:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 09:18:07.370646 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97325772-d592-4b07-bdcb-1fea10ecdf08 None None] Authenticating user token {{(pid=479852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:18:07.395694 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG dbcounter [-] [479852] Writing DB stats keystone:SELECT=100 {{(pid=479852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:18:07.406003 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e25ff923-396a-420e-a1f2-2921fa510653 None None] Validating token access rules against request {{(pid=479851) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:18:07.454910 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a7fbe5-c522-4b29-9295-a89e966287b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479851) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:18:07.456114 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a7fbe5-c522-4b29-9295-a89e966287b6 None admin] REQUEST_METHOD: `GET` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:18:07.456417 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a7fbe5-c522-4b29-9295-a89e966287b6 None admin] SCRIPT_NAME: `/identity` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:18:07.456882 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a7fbe5-c522-4b29-9295-a89e966287b6 None admin] PATH_INFO: `/v3/roles` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:18:07.458086 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3a7fbe5-c522-4b29-9295-a89e966287b6 None admin] RBAC: Adding query filter params (name=member) {{(pid=479851) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 09:18:07.458401 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3a7fbe5-c522-4b29-9295-a89e966287b6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:18:07.459860 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3a7fbe5-c522-4b29-9295-a89e966287b6 None admin] RBAC: Authorization granted {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:18:07.470648 dv-cinder-851351-1-smb devstack@keystone.service[479851]: [pid: 479851|app: 0|req: 34/69] 10.222.0.42 () {56 vars in 1101 bytes} [Thu Jul 28 09:18:07 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:18:07.470964 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a7fbe5-c522-4b29-9295-a89e966287b6 None admin] Authenticating user token {{(pid=479851) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:18:07.498316 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97325772-d592-4b07-bdcb-1fea10ecdf08 None None] Validating token access rules against request {{(pid=479852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:18:07.534439 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7882680f-a7e2-4b5a-9ed9-d9da4e5b201a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:18:07.535122 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7882680f-a7e2-4b5a-9ed9-d9da4e5b201a None admin] REQUEST_METHOD: `GET` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:18:07.535408 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7882680f-a7e2-4b5a-9ed9-d9da4e5b201a None admin] SCRIPT_NAME: `/identity` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:18:07.535694 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7882680f-a7e2-4b5a-9ed9-d9da4e5b201a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:18:07.553275 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7882680f-a7e2-4b5a-9ed9-d9da4e5b201a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 09:18:07.554295 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG dbcounter [-] [479851] Writing DB stats keystone:SELECT=100 {{(pid=479851) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:18:07.560278 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application [None req-7882680f-a7e2-4b5a-9ed9-d9da4e5b201a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 09:18:07.560278 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 09:18:07.560278 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 09:18:07.560278 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 09:18:07.560278 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 09:18:07.560278 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 09:18:07.560278 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 09:18:07.560278 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 09:18:07.560278 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 09:18:07.560278 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 09:18:07.560278 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 09:18:07.560278 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 09:18:07.560278 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 09:18:07.560278 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 09:18:07.560278 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 09:18:07.560278 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 09:18:07.561417 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 09:18:07.561417 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 09:18:07.561417 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 09:18:07.561417 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 09:18:07.561417 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 09:18:07.561417 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 09:18:07.561417 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 09:18:07.561417 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 09:18:07.561417 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 09:18:07.561417 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 09:18:07.561417 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 09:18:07.561417 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application with Lock( Jul 28 09:18:07.561417 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 09:18:07.561417 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self._enter() Jul 28 09:18:07.561417 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 09:18:07.561417 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 09:18:07.562359 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 09:18:07.562359 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self.creator() Jul 28 09:18:07.562359 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 09:18:07.562359 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application created_value = creator( Jul 28 09:18:07.562359 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 09:18:07.562359 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 09:18:07.562359 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 09:18:07.562359 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 09:18:07.562359 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 09:18:07.562359 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 09:18:07.562359 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 09:18:07.562359 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application Jul 28 09:18:07.562359 dv-cinder-851351-1-smb devstack@keystone.service[479852]: [pid: 479852|app: 0|req: 36/70] 10.222.0.42 () {56 vars in 1096 bytes} [Thu Jul 28 09:18:07 2022] GET /identity/v3/roles/admin => generated 83 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 09:18:07.563184 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1952e00-be0c-4c08-b466-82fd29a93939 None None] REQUEST_METHOD: `GET` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:18:07.563184 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1952e00-be0c-4c08-b466-82fd29a93939 None None] SCRIPT_NAME: `/identity` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:18:07.563892 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1952e00-be0c-4c08-b466-82fd29a93939 None None] PATH_INFO: `/` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:18:07.564780 dv-cinder-851351-1-smb devstack@keystone.service[479852]: [pid: 479852|app: 0|req: 37/71] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 09:18:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 09:18:07.568674 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e27d96-b218-4295-94cc-545999de68fd None None] REQUEST_METHOD: `GET` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:18:07.568978 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e27d96-b218-4295-94cc-545999de68fd None None] SCRIPT_NAME: `/identity` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:18:07.569249 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e27d96-b218-4295-94cc-545999de68fd None None] PATH_INFO: `/` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:18:07.570653 dv-cinder-851351-1-smb devstack@keystone.service[479852]: [pid: 479852|app: 0|req: 38/72] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 09:18:07 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 09:18:07.570653 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e27d96-b218-4295-94cc-545999de68fd None None] Authenticating user token {{(pid=479852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:18:07.592182 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a7fbe5-c522-4b29-9295-a89e966287b6 None admin] Validating token access rules against request {{(pid=479851) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:18:07.629999 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ac57a1-942f-4fdf-b61e-825c2d8fa093 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479851) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:18:07.630585 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ac57a1-942f-4fdf-b61e-825c2d8fa093 None admin] REQUEST_METHOD: `GET` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:18:07.630879 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ac57a1-942f-4fdf-b61e-825c2d8fa093 None admin] SCRIPT_NAME: `/identity` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:18:07.631174 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ac57a1-942f-4fdf-b61e-825c2d8fa093 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:18:07.644086 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0ac57a1-942f-4fdf-b61e-825c2d8fa093 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 09:18:07.649391 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application [None req-f0ac57a1-942f-4fdf-b61e-825c2d8fa093 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 28 09:18:07.649391 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 09:18:07.649391 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 09:18:07.649391 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 09:18:07.649391 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 09:18:07.649391 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 09:18:07.649391 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 09:18:07.649391 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 09:18:07.649391 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 09:18:07.649391 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 09:18:07.649391 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 09:18:07.649391 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 09:18:07.649391 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 09:18:07.649391 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 09:18:07.649391 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 09:18:07.649391 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 09:18:07.650633 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 09:18:07.650633 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 09:18:07.650633 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 09:18:07.650633 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 09:18:07.650633 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 09:18:07.650633 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 09:18:07.650633 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 09:18:07.650633 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 09:18:07.650633 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 09:18:07.650633 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 09:18:07.650633 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 09:18:07.650633 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application with Lock( Jul 28 09:18:07.650633 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 09:18:07.650633 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return self._enter() Jul 28 09:18:07.650633 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 09:18:07.650633 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 09:18:07.651771 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 09:18:07.651771 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return self.creator() Jul 28 09:18:07.651771 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 09:18:07.651771 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application created_value = creator( Jul 28 09:18:07.651771 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 09:18:07.651771 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 09:18:07.651771 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 09:18:07.651771 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 09:18:07.651771 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 09:18:07.651771 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 09:18:07.651771 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 28 09:18:07.651771 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application Jul 28 09:18:07.651771 dv-cinder-851351-1-smb devstack@keystone.service[479851]: [pid: 479851|app: 0|req: 35/73] 10.222.0.42 () {56 vars in 1114 bytes} [Thu Jul 28 09:18:07 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 09:18:07.653665 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ac57a1-942f-4fdf-b61e-825c2d8fa093 None admin] Authenticating user token {{(pid=479851) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:18:07.667567 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG dbcounter [-] [479852] Writing DB stats keystone:SELECT=100 {{(pid=479852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:18:07.696655 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e27d96-b218-4295-94cc-545999de68fd None None] Validating token access rules against request {{(pid=479852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:18:07.734915 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618d3485-d7bb-4970-bc54-818c5f6ac3e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:18:07.735581 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618d3485-d7bb-4970-bc54-818c5f6ac3e7 None admin] REQUEST_METHOD: `GET` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:18:07.735865 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618d3485-d7bb-4970-bc54-818c5f6ac3e7 None admin] SCRIPT_NAME: `/identity` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:18:07.736144 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618d3485-d7bb-4970-bc54-818c5f6ac3e7 None admin] PATH_INFO: `/v3/users/73be2aaaa3a047f395fae06ed9308ab6` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:18:07.757124 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-618d3485-d7bb-4970-bc54-818c5f6ac3e7 None admin] RBAC: Authorizing `identity:get_user(user_id=73be2aaaa3a047f395fae06ed9308ab6)` {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:18:07.757690 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-618d3485-d7bb-4970-bc54-818c5f6ac3e7 None admin] RBAC: Authorization granted {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:18:07.759684 dv-cinder-851351-1-smb devstack@keystone.service[479852]: [pid: 479852|app: 0|req: 39/74] 10.222.0.42 () {56 vars in 1177 bytes} [Thu Jul 28 09:18:07 2022] GET /identity/v3/users/73be2aaaa3a047f395fae06ed9308ab6 => generated 275 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:18:07.760826 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3edc79b9-38b9-4432-9be8-fd557aeadebf None None] REQUEST_METHOD: `POST` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:18:07.761923 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3edc79b9-38b9-4432-9be8-fd557aeadebf None None] SCRIPT_NAME: `/identity` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:18:07.761923 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3edc79b9-38b9-4432-9be8-fd557aeadebf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:18:07.775243 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ac57a1-942f-4fdf-b61e-825c2d8fa093 None admin] Validating token access rules against request {{(pid=479851) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:18:07.789204 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.auth.core [None req-3edc79b9-38b9-4432-9be8-fd557aeadebf None None] MFA Rules not processed for user `c198f91a4ae84d2b9cc730a6e304c2be`. Rule list: `[]` (Enabled: `True`). {{(pid=479852) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 09:18:07.790444 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.fernet_utils [None req-3edc79b9-38b9-4432-9be8-fd557aeadebf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=479852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 09:18:07.812417 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG dbcounter [-] [479851] Writing DB stats keystone:SELECT=100 {{(pid=479851) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:18:07.818637 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af37c0cd-5b8a-4509-b8ef-df11dba426c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479851) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:18:07.820311 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af37c0cd-5b8a-4509-b8ef-df11dba426c7 None admin] REQUEST_METHOD: `GET` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:18:07.820311 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af37c0cd-5b8a-4509-b8ef-df11dba426c7 None admin] SCRIPT_NAME: `/identity` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:18:07.820564 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af37c0cd-5b8a-4509-b8ef-df11dba426c7 None admin] PATH_INFO: `/v3/roles` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:18:07.821279 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af37c0cd-5b8a-4509-b8ef-df11dba426c7 None admin] RBAC: Adding query filter params (name=admin) {{(pid=479851) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 09:18:07.822272 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af37c0cd-5b8a-4509-b8ef-df11dba426c7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:18:07.823470 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af37c0cd-5b8a-4509-b8ef-df11dba426c7 None admin] RBAC: Authorization granted {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:18:07.833079 dv-cinder-851351-1-smb devstack@keystone.service[479851]: [pid: 479851|app: 0|req: 36/75] 10.222.0.42 () {56 vars in 1099 bytes} [Thu Jul 28 09:18:07 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:18:07.834533 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32c1488-ddd8-4398-a6c4-0fce062b37a8 None None] REQUEST_METHOD: `POST` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:18:07.835300 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32c1488-ddd8-4398-a6c4-0fce062b37a8 None None] SCRIPT_NAME: `/identity` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:18:07.835300 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32c1488-ddd8-4398-a6c4-0fce062b37a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:18:07.856636 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.auth.core [None req-b32c1488-ddd8-4398-a6c4-0fce062b37a8 None None] MFA Rules not processed for user `c198f91a4ae84d2b9cc730a6e304c2be`. Rule list: `[]` (Enabled: `True`). {{(pid=479851) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 09:18:07.857883 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.fernet_utils [None req-b32c1488-ddd8-4398-a6c4-0fce062b37a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=479851) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 09:18:07.865427 dv-cinder-851351-1-smb devstack@keystone.service[479852]: [pid: 479852|app: 0|req: 40/76] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 09:18:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 09:18:07.866190 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3edc79b9-38b9-4432-9be8-fd557aeadebf None None] Authenticating user token {{(pid=479852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:18:07.933474 dv-cinder-851351-1-smb devstack@keystone.service[479851]: [pid: 479851|app: 0|req: 37/77] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 09:18:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 09:18:07.937871 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32c1488-ddd8-4398-a6c4-0fce062b37a8 None None] Authenticating user token {{(pid=479851) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:18:07.944364 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG dbcounter [-] [479852] Writing DB stats keystone:SELECT=100 {{(pid=479852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:18:07.981851 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3edc79b9-38b9-4432-9be8-fd557aeadebf None None] Validating token access rules against request {{(pid=479852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:18:08.021454 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5d2de7-d238-48e3-9772-a923d1fe7aa7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:18:08.022145 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5d2de7-d238-48e3-9772-a923d1fe7aa7 None admin] REQUEST_METHOD: `GET` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:18:08.022432 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5d2de7-d238-48e3-9772-a923d1fe7aa7 None admin] SCRIPT_NAME: `/identity` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:18:08.022739 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5d2de7-d238-48e3-9772-a923d1fe7aa7 None admin] PATH_INFO: `/v3/roles` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:18:08.023476 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c5d2de7-d238-48e3-9772-a923d1fe7aa7 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=479852) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 09:18:08.023794 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c5d2de7-d238-48e3-9772-a923d1fe7aa7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:18:08.025262 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c5d2de7-d238-48e3-9772-a923d1fe7aa7 None admin] RBAC: Authorization granted {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:18:08.045672 dv-cinder-851351-1-smb devstack@keystone.service[479852]: [pid: 479852|app: 0|req: 41/78] 10.222.0.42 () {56 vars in 1111 bytes} [Thu Jul 28 09:18:07 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:18:08.045672 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5d2de7-d238-48e3-9772-a923d1fe7aa7 None admin] Authenticating user token {{(pid=479852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:18:08.057455 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32c1488-ddd8-4398-a6c4-0fce062b37a8 None None] Validating token access rules against request {{(pid=479851) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:18:08.089063 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG dbcounter [-] [479851] Writing DB stats keystone:SELECT=100 {{(pid=479851) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:18:08.105748 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0886781-4ce4-4f30-9c85-6f8595f37849 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479851) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:18:08.107423 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0886781-4ce4-4f30-9c85-6f8595f37849 None admin] REQUEST_METHOD: `GET` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:18:08.107722 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0886781-4ce4-4f30-9c85-6f8595f37849 None admin] SCRIPT_NAME: `/identity` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:18:08.108015 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0886781-4ce4-4f30-9c85-6f8595f37849 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:18:08.166161 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5d2de7-d238-48e3-9772-a923d1fe7aa7 None admin] Validating token access rules against request {{(pid=479852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:18:08.184759 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0886781-4ce4-4f30-9c85-6f8595f37849 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:18:08.186538 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0886781-4ce4-4f30-9c85-6f8595f37849 None admin] RBAC: Authorization granted {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:18:08.203266 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG dbcounter [-] [479852] Writing DB stats keystone:SELECT=100 {{(pid=479852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:18:08.212823 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1573033-8818-41c0-88a9-0a0667b960a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:18:08.213484 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1573033-8818-41c0-88a9-0a0667b960a6 None admin] REQUEST_METHOD: `GET` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:18:08.213810 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1573033-8818-41c0-88a9-0a0667b960a6 None admin] SCRIPT_NAME: `/identity` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:18:08.214060 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1573033-8818-41c0-88a9-0a0667b960a6 None admin] PATH_INFO: `/v3/users/c198f91a4ae84d2b9cc730a6e304c2be` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:18:08.215298 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1573033-8818-41c0-88a9-0a0667b960a6 None admin] RBAC: Authorizing `identity:get_user(user_id=c198f91a4ae84d2b9cc730a6e304c2be)` {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:18:08.216844 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1573033-8818-41c0-88a9-0a0667b960a6 None admin] RBAC: Authorization granted {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:18:08.218644 dv-cinder-851351-1-smb devstack@keystone.service[479852]: [pid: 479852|app: 0|req: 42/79] 10.222.0.42 () {56 vars in 1177 bytes} [Thu Jul 28 09:18:08 2022] GET /identity/v3/users/c198f91a4ae84d2b9cc730a6e304c2be => generated 247 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:18:08.224361 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1573033-8818-41c0-88a9-0a0667b960a6 None admin] Authenticating user token {{(pid=479852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:18:08.304713 dv-cinder-851351-1-smb devstack@keystone.service[479851]: [pid: 479851|app: 0|req: 38/80] 10.222.0.42 () {58 vars in 1282 bytes} [Thu Jul 28 09:18:07 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 371 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 28 09:18:08.305627 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0886781-4ce4-4f30-9c85-6f8595f37849 None admin] Authenticating user token {{(pid=479851) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:18:08.336146 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG dbcounter [-] [479851] Writing DB stats keystone:SELECT=100 {{(pid=479851) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:18:08.343002 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1573033-8818-41c0-88a9-0a0667b960a6 None admin] Validating token access rules against request {{(pid=479852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:18:08.384017 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40dae47-c2dc-4c72-94c3-2cc259e54ae1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:18:08.384707 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40dae47-c2dc-4c72-94c3-2cc259e54ae1 None admin] REQUEST_METHOD: `GET` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:18:08.384999 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40dae47-c2dc-4c72-94c3-2cc259e54ae1 None admin] SCRIPT_NAME: `/identity` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:18:08.385280 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40dae47-c2dc-4c72-94c3-2cc259e54ae1 None admin] PATH_INFO: `/v3/roles/member` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:18:08.398493 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c40dae47-c2dc-4c72-94c3-2cc259e54ae1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 09:18:08.404157 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application [None req-c40dae47-c2dc-4c72-94c3-2cc259e54ae1 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 28 09:18:08.404157 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 09:18:08.404157 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 09:18:08.404157 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 09:18:08.404157 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 09:18:08.404157 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 09:18:08.404157 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 09:18:08.404157 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 09:18:08.404157 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 09:18:08.404157 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 09:18:08.404157 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 09:18:08.404157 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 09:18:08.404157 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 09:18:08.404157 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 09:18:08.404157 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 09:18:08.404157 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 09:18:08.406023 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 09:18:08.406023 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 09:18:08.406023 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 09:18:08.406023 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 09:18:08.406023 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 09:18:08.406023 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 09:18:08.406023 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 09:18:08.406023 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 09:18:08.406023 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 09:18:08.406023 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 09:18:08.406023 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 09:18:08.406023 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application with Lock( Jul 28 09:18:08.406023 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 09:18:08.406023 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self._enter() Jul 28 09:18:08.406023 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 09:18:08.406023 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 09:18:08.407233 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 09:18:08.407233 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self.creator() Jul 28 09:18:08.407233 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 09:18:08.407233 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application created_value = creator( Jul 28 09:18:08.407233 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 09:18:08.407233 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 09:18:08.407233 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 09:18:08.407233 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 09:18:08.407233 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 09:18:08.407233 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 09:18:08.407233 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 28 09:18:08.407233 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application Jul 28 09:18:08.407233 dv-cinder-851351-1-smb devstack@keystone.service[479852]: [pid: 479852|app: 0|req: 43/81] 10.222.0.42 () {56 vars in 1099 bytes} [Thu Jul 28 09:18:08 2022] GET /identity/v3/roles/member => generated 84 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 09:18:08.407233 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40dae47-c2dc-4c72-94c3-2cc259e54ae1 None admin] Authenticating user token {{(pid=479852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:18:08.423999 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0886781-4ce4-4f30-9c85-6f8595f37849 None admin] Validating token access rules against request {{(pid=479851) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:18:08.468342 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d595a213-5b05-437f-94c9-709c21cfff63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479851) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:18:08.468957 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d595a213-5b05-437f-94c9-709c21cfff63 None admin] REQUEST_METHOD: `GET` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:18:08.469249 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d595a213-5b05-437f-94c9-709c21cfff63 None admin] SCRIPT_NAME: `/identity` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:18:08.469349 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG dbcounter [-] [479852] Writing DB stats keystone:SELECT=100 {{(pid=479852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:18:08.469544 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d595a213-5b05-437f-94c9-709c21cfff63 None admin] PATH_INFO: `/v3/domains/default` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:18:08.470804 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d595a213-5b05-437f-94c9-709c21cfff63 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:18:08.472356 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d595a213-5b05-437f-94c9-709c21cfff63 None admin] RBAC: Authorization granted {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:18:08.474052 dv-cinder-851351-1-smb devstack@keystone.service[479851]: [pid: 479851|app: 0|req: 39/82] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 09:18:08 2022] GET /identity/v3/domains/default => generated 199 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:18:08.475133 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d595a213-5b05-437f-94c9-709c21cfff63 None admin] Authenticating user token {{(pid=479851) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:18:08.524013 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40dae47-c2dc-4c72-94c3-2cc259e54ae1 None admin] Validating token access rules against request {{(pid=479852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:18:08.563673 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c3e601-8e10-4b72-9b67-14ec7e09ad13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:18:08.564538 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c3e601-8e10-4b72-9b67-14ec7e09ad13 None admin] REQUEST_METHOD: `GET` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:18:08.564709 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c3e601-8e10-4b72-9b67-14ec7e09ad13 None admin] SCRIPT_NAME: `/identity` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:18:08.564917 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c3e601-8e10-4b72-9b67-14ec7e09ad13 None admin] PATH_INFO: `/v3/users/73be2aaaa3a047f395fae06ed9308ab6` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:18:08.566170 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c3e601-8e10-4b72-9b67-14ec7e09ad13 None admin] RBAC: Authorizing `identity:get_user(user_id=73be2aaaa3a047f395fae06ed9308ab6)` {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:18:08.567657 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c3e601-8e10-4b72-9b67-14ec7e09ad13 None admin] RBAC: Authorization granted {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:18:08.569340 dv-cinder-851351-1-smb devstack@keystone.service[479852]: [pid: 479852|app: 0|req: 44/83] 10.222.0.42 () {56 vars in 1177 bytes} [Thu Jul 28 09:18:08 2022] GET /identity/v3/users/73be2aaaa3a047f395fae06ed9308ab6 => generated 275 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:18:08.570143 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c3e601-8e10-4b72-9b67-14ec7e09ad13 None admin] Authenticating user token {{(pid=479852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:18:08.588203 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG dbcounter [-] [479851] Writing DB stats keystone:SELECT=100 {{(pid=479851) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:18:08.598584 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d595a213-5b05-437f-94c9-709c21cfff63 None admin] Validating token access rules against request {{(pid=479851) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:18:08.641859 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e1c601-765d-4994-a685-c0a510d95190 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479851) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:18:08.642843 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e1c601-765d-4994-a685-c0a510d95190 None admin] REQUEST_METHOD: `GET` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:18:08.643311 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e1c601-765d-4994-a685-c0a510d95190 None admin] SCRIPT_NAME: `/identity` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:18:08.643791 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e1c601-765d-4994-a685-c0a510d95190 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:18:08.687145 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c3e601-8e10-4b72-9b67-14ec7e09ad13 None admin] Validating token access rules against request {{(pid=479852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:18:08.721301 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG dbcounter [-] [479852] Writing DB stats keystone:SELECT=100 {{(pid=479852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:18:08.726585 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e1c601-765d-4994-a685-c0a510d95190 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:18:08.730073 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e1c601-765d-4994-a685-c0a510d95190 None admin] RBAC: Authorization granted {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:18:08.734840 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d052c48-5c6a-47eb-9f55-79b18348dfe6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:18:08.735565 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d052c48-5c6a-47eb-9f55-79b18348dfe6 None admin] REQUEST_METHOD: `GET` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:18:08.735853 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d052c48-5c6a-47eb-9f55-79b18348dfe6 None admin] SCRIPT_NAME: `/identity` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:18:08.736160 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d052c48-5c6a-47eb-9f55-79b18348dfe6 None admin] PATH_INFO: `/v3/projects/580eb2f23f9049b18bb38dce6f6f9b4f` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:18:08.737410 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d052c48-5c6a-47eb-9f55-79b18348dfe6 None admin] RBAC: Authorizing `identity:get_project(project_id=580eb2f23f9049b18bb38dce6f6f9b4f)` {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:18:08.738895 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d052c48-5c6a-47eb-9f55-79b18348dfe6 None admin] RBAC: Authorization granted {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:18:08.740604 dv-cinder-851351-1-smb devstack@keystone.service[479852]: [pid: 479852|app: 0|req: 45/84] 10.222.0.42 () {56 vars in 1186 bytes} [Thu Jul 28 09:18:08 2022] GET /identity/v3/projects/580eb2f23f9049b18bb38dce6f6f9b4f => generated 298 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:18:08.744150 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d052c48-5c6a-47eb-9f55-79b18348dfe6 None admin] Authenticating user token {{(pid=479852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:18:08.858362 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG dbcounter [-] [479851] Writing DB stats keystone:SELECT=100 {{(pid=479851) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:18:08.868112 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d052c48-5c6a-47eb-9f55-79b18348dfe6 None admin] Validating token access rules against request {{(pid=479852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:18:08.869210 dv-cinder-851351-1-smb devstack@keystone.service[479851]: [pid: 479851|app: 0|req: 40/85] 10.222.0.42 () {58 vars in 1282 bytes} [Thu Jul 28 09:18:08 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 395 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 28 09:18:08.870086 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e1c601-765d-4994-a685-c0a510d95190 None admin] Authenticating user token {{(pid=479851) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:18:08.907460 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9539c8cf-ecf2-4e48-a2a3-9a73d57a316c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:18:08.908097 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9539c8cf-ecf2-4e48-a2a3-9a73d57a316c None admin] REQUEST_METHOD: `GET` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:18:08.908382 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9539c8cf-ecf2-4e48-a2a3-9a73d57a316c None admin] SCRIPT_NAME: `/identity` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:18:08.908684 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9539c8cf-ecf2-4e48-a2a3-9a73d57a316c None admin] PATH_INFO: `/v3/roles` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:18:08.909457 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9539c8cf-ecf2-4e48-a2a3-9a73d57a316c None admin] RBAC: Adding query filter params (name=member) {{(pid=479852) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 09:18:08.909768 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9539c8cf-ecf2-4e48-a2a3-9a73d57a316c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:18:08.911236 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9539c8cf-ecf2-4e48-a2a3-9a73d57a316c None admin] RBAC: Authorization granted {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:18:08.920492 dv-cinder-851351-1-smb devstack@keystone.service[479852]: [pid: 479852|app: 0|req: 46/86] 10.222.0.42 () {56 vars in 1101 bytes} [Thu Jul 28 09:18:08 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:18:08.921390 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9539c8cf-ecf2-4e48-a2a3-9a73d57a316c None admin] Authenticating user token {{(pid=479852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:18:08.980031 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG dbcounter [-] [479852] Writing DB stats keystone:SELECT=100 {{(pid=479852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:18:08.985529 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e1c601-765d-4994-a685-c0a510d95190 None admin] Validating token access rules against request {{(pid=479851) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:18:09.023612 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-221e98b4-4de7-4f24-8967-b89aa83d4a93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479851) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:18:09.024250 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221e98b4-4de7-4f24-8967-b89aa83d4a93 None admin] REQUEST_METHOD: `POST` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:18:09.024597 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221e98b4-4de7-4f24-8967-b89aa83d4a93 None admin] SCRIPT_NAME: `/identity` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:18:09.024912 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221e98b4-4de7-4f24-8967-b89aa83d4a93 None admin] PATH_INFO: `/v3/users` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:18:09.025651 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-221e98b4-4de7-4f24-8967-b89aa83d4a93 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:18:09.027134 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-221e98b4-4de7-4f24-8967-b89aa83d4a93 None admin] RBAC: Authorization granted {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:18:09.029867 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9539c8cf-ecf2-4e48-a2a3-9a73d57a316c None admin] Validating token access rules against request {{(pid=479852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:18:09.068696 dv-cinder-851351-1-smb devstack@keystone.service[479851]: [pid: 479851|app: 0|req: 41/87] 10.222.0.42 () {60 vars in 1132 bytes} [Thu Jul 28 09:18:08 2022] POST /identity/v3/users => generated 289 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 09:18:09.068696 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-221e98b4-4de7-4f24-8967-b89aa83d4a93 None admin] Authenticating user token {{(pid=479851) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:18:09.069654 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5476b44f-e726-41ca-82ef-b94e36303e02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:18:09.070328 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5476b44f-e726-41ca-82ef-b94e36303e02 None admin] REQUEST_METHOD: `GET` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:18:09.070612 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5476b44f-e726-41ca-82ef-b94e36303e02 None admin] SCRIPT_NAME: `/identity` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:18:09.070897 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5476b44f-e726-41ca-82ef-b94e36303e02 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:18:09.122048 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG dbcounter [-] [479851] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=479851) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:18:09.165542 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5476b44f-e726-41ca-82ef-b94e36303e02 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:18:09.167077 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5476b44f-e726-41ca-82ef-b94e36303e02 None admin] RBAC: Authorization granted {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:18:09.188928 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-221e98b4-4de7-4f24-8967-b89aa83d4a93 None admin] Validating token access rules against request {{(pid=479851) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:18:09.227080 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG dbcounter [-] [479852] Writing DB stats keystone:SELECT=100 {{(pid=479852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:18:09.231323 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c151b6ec-a5c2-4c65-8524-1afe0c5c13b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479851) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:18:09.231913 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c151b6ec-a5c2-4c65-8524-1afe0c5c13b5 None admin] REQUEST_METHOD: `GET` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:18:09.232206 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c151b6ec-a5c2-4c65-8524-1afe0c5c13b5 None admin] SCRIPT_NAME: `/identity` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:18:09.232488 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c151b6ec-a5c2-4c65-8524-1afe0c5c13b5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:18:09.233354 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c151b6ec-a5c2-4c65-8524-1afe0c5c13b5 None admin] RBAC: Adding query filter params (role.id=900fb424e172461d93a0db59afb0a12b, scope.project.id=580eb2f23f9049b18bb38dce6f6f9b4f, user.id=73be2aaaa3a047f395fae06ed9308ab6) {{(pid=479851) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 09:18:09.234790 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c151b6ec-a5c2-4c65-8524-1afe0c5c13b5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:18:09.235932 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c151b6ec-a5c2-4c65-8524-1afe0c5c13b5 None admin] RBAC: Authorization granted {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:18:09.244688 dv-cinder-851351-1-smb devstack@keystone.service[479851]: [pid: 479851|app: 0|req: 42/88] 10.222.0.42 () {56 vars in 1374 bytes} [Thu Jul 28 09:18:09 2022] GET /identity/v3/role_assignments?user.id=73be2aaaa3a047f395fae06ed9308ab6&scope.project.id=580eb2f23f9049b18bb38dce6f6f9b4f&role.id=900fb424e172461d93a0db59afb0a12b => generated 259 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:18:09.244688 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c151b6ec-a5c2-4c65-8524-1afe0c5c13b5 None admin] Authenticating user token {{(pid=479851) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:18:09.299677 dv-cinder-851351-1-smb devstack@keystone.service[479852]: [pid: 479852|app: 0|req: 47/89] 10.222.0.42 () {58 vars in 1282 bytes} [Thu Jul 28 09:18:08 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 379 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 28 09:18:09.300728 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5476b44f-e726-41ca-82ef-b94e36303e02 None admin] Authenticating user token {{(pid=479852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:18:09.396458 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c151b6ec-a5c2-4c65-8524-1afe0c5c13b5 None admin] Validating token access rules against request {{(pid=479851) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:18:09.414343 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG dbcounter [-] [479851] Writing DB stats keystone:SELECT=100 {{(pid=479851) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:18:09.425428 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5476b44f-e726-41ca-82ef-b94e36303e02 None admin] Validating token access rules against request {{(pid=479852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:18:09.441511 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aefd4537-6400-46bc-a759-6bf42b0dba20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479851) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:18:09.442959 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aefd4537-6400-46bc-a759-6bf42b0dba20 None admin] REQUEST_METHOD: `GET` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:18:09.443502 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aefd4537-6400-46bc-a759-6bf42b0dba20 None admin] SCRIPT_NAME: `/identity` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:18:09.443951 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aefd4537-6400-46bc-a759-6bf42b0dba20 None admin] PATH_INFO: `/v3/projects/580eb2f23f9049b18bb38dce6f6f9b4f` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:18:09.445511 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aefd4537-6400-46bc-a759-6bf42b0dba20 None admin] RBAC: Authorizing `identity:get_project(project_id=580eb2f23f9049b18bb38dce6f6f9b4f)` {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:18:09.447340 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aefd4537-6400-46bc-a759-6bf42b0dba20 None admin] RBAC: Authorization granted {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:18:09.450567 dv-cinder-851351-1-smb devstack@keystone.service[479851]: [pid: 479851|app: 0|req: 43/90] 10.222.0.42 () {56 vars in 1186 bytes} [Thu Jul 28 09:18:09 2022] GET /identity/v3/projects/580eb2f23f9049b18bb38dce6f6f9b4f => generated 298 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:18:09.451662 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aefd4537-6400-46bc-a759-6bf42b0dba20 None admin] Authenticating user token {{(pid=479851) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:18:09.472446 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb017b22-dad6-4f85-b8bd-d366411168d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:18:09.473932 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb017b22-dad6-4f85-b8bd-d366411168d4 None admin] REQUEST_METHOD: `GET` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:18:09.474451 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb017b22-dad6-4f85-b8bd-d366411168d4 None admin] SCRIPT_NAME: `/identity` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:18:09.475202 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb017b22-dad6-4f85-b8bd-d366411168d4 None admin] PATH_INFO: `/v3/users/73be2aaaa3a047f395fae06ed9308ab6` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:18:09.477258 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb017b22-dad6-4f85-b8bd-d366411168d4 None admin] RBAC: Authorizing `identity:get_user(user_id=73be2aaaa3a047f395fae06ed9308ab6)` {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:18:09.479011 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb017b22-dad6-4f85-b8bd-d366411168d4 None admin] RBAC: Authorization granted {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:18:09.481865 dv-cinder-851351-1-smb devstack@keystone.service[479852]: [pid: 479852|app: 0|req: 48/91] 10.222.0.42 () {56 vars in 1177 bytes} [Thu Jul 28 09:18:09 2022] GET /identity/v3/users/73be2aaaa3a047f395fae06ed9308ab6 => generated 275 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:18:09.483163 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb017b22-dad6-4f85-b8bd-d366411168d4 None admin] Authenticating user token {{(pid=479852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:18:09.525098 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG dbcounter [-] [479852] Writing DB stats keystone:SELECT=100 {{(pid=479852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:18:09.610988 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aefd4537-6400-46bc-a759-6bf42b0dba20 None admin] Validating token access rules against request {{(pid=479851) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:18:09.656852 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0784bb3b-2dee-4de4-bb8d-7dd1f7b16fca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479851) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:18:09.657620 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0784bb3b-2dee-4de4-bb8d-7dd1f7b16fca None admin] REQUEST_METHOD: `GET` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:18:09.657909 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0784bb3b-2dee-4de4-bb8d-7dd1f7b16fca None admin] SCRIPT_NAME: `/identity` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:18:09.658241 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0784bb3b-2dee-4de4-bb8d-7dd1f7b16fca None admin] PATH_INFO: `/v3/projects/580eb2f23f9049b18bb38dce6f6f9b4f` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:18:09.659452 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0784bb3b-2dee-4de4-bb8d-7dd1f7b16fca None admin] RBAC: Authorizing `identity:get_project(project_id=580eb2f23f9049b18bb38dce6f6f9b4f)` {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:18:09.661721 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0784bb3b-2dee-4de4-bb8d-7dd1f7b16fca None admin] RBAC: Authorization granted {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:18:09.663981 dv-cinder-851351-1-smb devstack@keystone.service[479851]: [pid: 479851|app: 0|req: 44/92] 10.222.0.42 () {56 vars in 1186 bytes} [Thu Jul 28 09:18:09 2022] GET /identity/v3/projects/580eb2f23f9049b18bb38dce6f6f9b4f => generated 298 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:18:09.665088 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0784bb3b-2dee-4de4-bb8d-7dd1f7b16fca None admin] Authenticating user token {{(pid=479851) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:18:09.690704 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb017b22-dad6-4f85-b8bd-d366411168d4 None admin] Validating token access rules against request {{(pid=479852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:18:09.722920 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG dbcounter [-] [479851] Writing DB stats keystone:SELECT=100 {{(pid=479851) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:18:09.781058 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc18fbc-436d-4f5a-9276-7fb8b31b4be5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:18:09.781624 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc18fbc-436d-4f5a-9276-7fb8b31b4be5 None admin] REQUEST_METHOD: `GET` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:18:09.781911 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc18fbc-436d-4f5a-9276-7fb8b31b4be5 None admin] SCRIPT_NAME: `/identity` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:18:09.782188 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc18fbc-436d-4f5a-9276-7fb8b31b4be5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:18:09.782998 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc18fbc-436d-4f5a-9276-7fb8b31b4be5 None admin] RBAC: Adding query filter params (role.id=685084310b35477b9b2d0c7934d0f803, scope.project.id=580eb2f23f9049b18bb38dce6f6f9b4f, user.id=c198f91a4ae84d2b9cc730a6e304c2be) {{(pid=479852) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 09:18:09.783312 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc18fbc-436d-4f5a-9276-7fb8b31b4be5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:18:09.783641 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0784bb3b-2dee-4de4-bb8d-7dd1f7b16fca None admin] Validating token access rules against request {{(pid=479851) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:18:09.793232 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc18fbc-436d-4f5a-9276-7fb8b31b4be5 None admin] RBAC: Authorization granted {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:18:09.803511 dv-cinder-851351-1-smb devstack@keystone.service[479852]: [pid: 479852|app: 0|req: 49/93] 10.222.0.42 () {56 vars in 1374 bytes} [Thu Jul 28 09:18:09 2022] GET /identity/v3/role_assignments?user.id=c198f91a4ae84d2b9cc730a6e304c2be&scope.project.id=580eb2f23f9049b18bb38dce6f6f9b4f&role.id=685084310b35477b9b2d0c7934d0f803 => generated 259 bytes in 321 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:18:09.804410 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc18fbc-436d-4f5a-9276-7fb8b31b4be5 None admin] Authenticating user token {{(pid=479852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:18:09.829695 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85999e60-c355-4510-9d18-264629bc74e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479851) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:18:09.830368 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85999e60-c355-4510-9d18-264629bc74e2 None admin] REQUEST_METHOD: `GET` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:18:09.830770 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85999e60-c355-4510-9d18-264629bc74e2 None admin] SCRIPT_NAME: `/identity` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:18:09.831105 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85999e60-c355-4510-9d18-264629bc74e2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:18:09.941781 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG dbcounter [-] [479852] Writing DB stats keystone:SELECT=100 {{(pid=479852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:18:09.959223 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc18fbc-436d-4f5a-9276-7fb8b31b4be5 None admin] Validating token access rules against request {{(pid=479852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:18:10.002870 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d46f272-46ce-4ca5-afd3-eedcd9697266 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:18:10.003533 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d46f272-46ce-4ca5-afd3-eedcd9697266 None admin] REQUEST_METHOD: `GET` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:18:10.003817 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d46f272-46ce-4ca5-afd3-eedcd9697266 None admin] SCRIPT_NAME: `/identity` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:18:10.004096 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d46f272-46ce-4ca5-afd3-eedcd9697266 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:18:10.004984 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d46f272-46ce-4ca5-afd3-eedcd9697266 None admin] RBAC: Adding query filter params (role.id=acf1d2de5e5448beb6363dae3d154a02, scope.project.id=580eb2f23f9049b18bb38dce6f6f9b4f, user.id=73be2aaaa3a047f395fae06ed9308ab6) {{(pid=479852) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 09:18:10.005301 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d46f272-46ce-4ca5-afd3-eedcd9697266 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:18:10.006872 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d46f272-46ce-4ca5-afd3-eedcd9697266 None admin] RBAC: Authorization granted {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:18:10.014148 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85999e60-c355-4510-9d18-264629bc74e2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:18:10.014820 dv-cinder-851351-1-smb devstack@keystone.service[479852]: [pid: 479852|app: 0|req: 50/94] 10.222.0.42 () {56 vars in 1374 bytes} [Thu Jul 28 09:18:09 2022] GET /identity/v3/role_assignments?user.id=73be2aaaa3a047f395fae06ed9308ab6&scope.project.id=580eb2f23f9049b18bb38dce6f6f9b4f&role.id=acf1d2de5e5448beb6363dae3d154a02 => generated 259 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:18:10.016119 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85999e60-c355-4510-9d18-264629bc74e2 None admin] RBAC: Authorization granted {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:18:10.074788 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG dbcounter [-] [479851] Writing DB stats keystone:SELECT=100 {{(pid=479851) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:18:10.149174 dv-cinder-851351-1-smb devstack@keystone.service[479851]: [pid: 479851|app: 0|req: 45/95] 10.222.0.42 () {58 vars in 1282 bytes} [Thu Jul 28 09:18:09 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 485 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 28 09:18:10.155355 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d46f272-46ce-4ca5-afd3-eedcd9697266 None admin] Authenticating user token {{(pid=479852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:18:10.282986 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d46f272-46ce-4ca5-afd3-eedcd9697266 None admin] Validating token access rules against request {{(pid=479852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:18:10.319688 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca4279e-abb8-41de-b729-2fea6c7a6f85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:18:10.320493 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca4279e-abb8-41de-b729-2fea6c7a6f85 None admin] REQUEST_METHOD: `GET` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:18:10.320809 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca4279e-abb8-41de-b729-2fea6c7a6f85 None admin] SCRIPT_NAME: `/identity` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:18:10.321148 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca4279e-abb8-41de-b729-2fea6c7a6f85 None admin] PATH_INFO: `/v3/projects/bbadce4d272544e6aea2ae9643be2628` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:18:10.322692 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ca4279e-abb8-41de-b729-2fea6c7a6f85 None admin] RBAC: Authorizing `identity:get_project(project_id=bbadce4d272544e6aea2ae9643be2628)` {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:18:10.324183 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ca4279e-abb8-41de-b729-2fea6c7a6f85 None admin] RBAC: Authorization granted {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:18:10.326270 dv-cinder-851351-1-smb devstack@keystone.service[479852]: [pid: 479852|app: 0|req: 51/96] 10.222.0.42 () {56 vars in 1186 bytes} [Thu Jul 28 09:18:10 2022] GET /identity/v3/projects/bbadce4d272544e6aea2ae9643be2628 => generated 312 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:18:10.332422 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85999e60-c355-4510-9d18-264629bc74e2 None admin] Authenticating user token {{(pid=479851) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:18:10.467436 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85999e60-c355-4510-9d18-264629bc74e2 None admin] Validating token access rules against request {{(pid=479851) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:18:10.504055 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5424d0ce-d638-4cec-8951-99c46f3f9344 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479851) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:18:10.505120 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5424d0ce-d638-4cec-8951-99c46f3f9344 None admin] REQUEST_METHOD: `GET` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:18:10.505653 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5424d0ce-d638-4cec-8951-99c46f3f9344 None admin] SCRIPT_NAME: `/identity` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:18:10.506159 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5424d0ce-d638-4cec-8951-99c46f3f9344 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:18:10.507254 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5424d0ce-d638-4cec-8951-99c46f3f9344 None admin] RBAC: Adding query filter params (role.id=900fb424e172461d93a0db59afb0a12b, scope.project.id=bbadce4d272544e6aea2ae9643be2628, user.id=73be2aaaa3a047f395fae06ed9308ab6) {{(pid=479851) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 09:18:10.507795 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5424d0ce-d638-4cec-8951-99c46f3f9344 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:18:10.509637 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5424d0ce-d638-4cec-8951-99c46f3f9344 None admin] RBAC: Authorization granted {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:18:10.516855 dv-cinder-851351-1-smb devstack@keystone.service[479851]: [pid: 479851|app: 0|req: 46/97] 10.222.0.42 () {56 vars in 1374 bytes} [Thu Jul 28 09:18:10 2022] GET /identity/v3/role_assignments?user.id=73be2aaaa3a047f395fae06ed9308ab6&scope.project.id=bbadce4d272544e6aea2ae9643be2628&role.id=900fb424e172461d93a0db59afb0a12b => generated 259 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:18:11.853155 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db165bd-2407-4f0f-bcad-ec1165295abb None None] REQUEST_METHOD: `GET` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:18:11.853851 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db165bd-2407-4f0f-bcad-ec1165295abb None None] SCRIPT_NAME: `/identity` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:18:11.853851 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db165bd-2407-4f0f-bcad-ec1165295abb None None] PATH_INFO: `/` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:18:11.855495 dv-cinder-851351-1-smb devstack@keystone.service[479852]: [pid: 479852|app: 0|req: 52/98] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 09:18:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 09:18:11.866404 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9367b105-e046-4bd8-a90d-dc64518db25c None None] REQUEST_METHOD: `POST` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:18:11.867457 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9367b105-e046-4bd8-a90d-dc64518db25c None None] SCRIPT_NAME: `/identity` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:18:11.867966 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9367b105-e046-4bd8-a90d-dc64518db25c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:18:11.890926 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.auth.core [None req-9367b105-e046-4bd8-a90d-dc64518db25c None None] MFA Rules not processed for user `c198f91a4ae84d2b9cc730a6e304c2be`. Rule list: `[]` (Enabled: `True`). {{(pid=479851) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 09:18:11.892562 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.fernet_utils [None req-9367b105-e046-4bd8-a90d-dc64518db25c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=479851) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 09:18:11.901101 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG dbcounter [-] [479851] Writing DB stats keystone:SELECT=100 {{(pid=479851) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:18:11.992695 dv-cinder-851351-1-smb devstack@keystone.service[479851]: [pid: 479851|app: 0|req: 47/99] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 09:18:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 09:18:12.025458 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db165bd-2407-4f0f-bcad-ec1165295abb None None] Authenticating user token {{(pid=479852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:18:12.058300 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG dbcounter [-] [479852] Writing DB stats keystone:SELECT=100 {{(pid=479852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:18:12.171942 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db165bd-2407-4f0f-bcad-ec1165295abb None None] Validating token access rules against request {{(pid=479852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:18:12.209026 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da5444a2-0187-4e8f-9ae8-80516282dfb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:18:12.210285 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5444a2-0187-4e8f-9ae8-80516282dfb2 None admin] REQUEST_METHOD: `GET` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:18:12.210848 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5444a2-0187-4e8f-9ae8-80516282dfb2 None admin] SCRIPT_NAME: `/identity` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:18:12.211423 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5444a2-0187-4e8f-9ae8-80516282dfb2 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:18:12.222918 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da5444a2-0187-4e8f-9ae8-80516282dfb2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 09:18:12.228735 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application [None req-da5444a2-0187-4e8f-9ae8-80516282dfb2 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 28 09:18:12.228735 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 09:18:12.228735 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 09:18:12.228735 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 09:18:12.228735 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 09:18:12.228735 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 09:18:12.228735 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 09:18:12.228735 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 09:18:12.228735 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 09:18:12.228735 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 09:18:12.228735 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 09:18:12.228735 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 09:18:12.228735 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 09:18:12.228735 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 09:18:12.228735 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 09:18:12.228735 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 09:18:12.229850 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 09:18:12.229850 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 09:18:12.229850 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 09:18:12.229850 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 09:18:12.229850 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 09:18:12.229850 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 09:18:12.229850 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 09:18:12.229850 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 09:18:12.229850 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 09:18:12.229850 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 09:18:12.229850 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 09:18:12.229850 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application with Lock( Jul 28 09:18:12.229850 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 09:18:12.229850 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self._enter() Jul 28 09:18:12.229850 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 09:18:12.229850 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 09:18:12.230882 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 09:18:12.230882 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self.creator() Jul 28 09:18:12.230882 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 09:18:12.230882 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application created_value = creator( Jul 28 09:18:12.230882 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 09:18:12.230882 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 09:18:12.230882 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 09:18:12.230882 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 09:18:12.230882 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 09:18:12.230882 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 09:18:12.230882 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 28 09:18:12.230882 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application Jul 28 09:18:12.233520 dv-cinder-851351-1-smb devstack@keystone.service[479852]: [pid: 479852|app: 0|req: 53/100] 10.222.0.42 () {56 vars in 1099 bytes} [Thu Jul 28 09:18:12 2022] GET /identity/v3/roles/reader => generated 84 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 09:18:12.239598 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9367b105-e046-4bd8-a90d-dc64518db25c None None] Authenticating user token {{(pid=479851) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:18:12.357032 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9367b105-e046-4bd8-a90d-dc64518db25c None None] Validating token access rules against request {{(pid=479851) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:18:12.381659 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf465365-3672-40a9-b3e4-01e9329bf422 None None] REQUEST_METHOD: `GET` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:18:12.382401 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf465365-3672-40a9-b3e4-01e9329bf422 None None] SCRIPT_NAME: `/identity` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:18:12.382902 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf465365-3672-40a9-b3e4-01e9329bf422 None None] PATH_INFO: `/` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:18:12.384572 dv-cinder-851351-1-smb devstack@keystone.service[479852]: [pid: 479852|app: 0|req: 54/101] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 09:18:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 09:18:12.391872 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e800753-d129-4704-8671-ec0a15d27665 None None] REQUEST_METHOD: `POST` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:18:12.392180 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e800753-d129-4704-8671-ec0a15d27665 None None] SCRIPT_NAME: `/identity` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:18:12.392432 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e800753-d129-4704-8671-ec0a15d27665 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:18:12.418977 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.auth.core [None req-7e800753-d129-4704-8671-ec0a15d27665 None None] MFA Rules not processed for user `c198f91a4ae84d2b9cc730a6e304c2be`. Rule list: `[]` (Enabled: `True`). {{(pid=479852) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 09:18:12.421445 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.fernet_utils [None req-7e800753-d129-4704-8671-ec0a15d27665 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=479852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 09:18:12.440849 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb11aa6-fa03-4d22-b0ae-50fb300b3cb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479851) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:18:12.441419 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb11aa6-fa03-4d22-b0ae-50fb300b3cb2 None admin] REQUEST_METHOD: `GET` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:18:12.441702 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb11aa6-fa03-4d22-b0ae-50fb300b3cb2 None admin] SCRIPT_NAME: `/identity` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:18:12.442183 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb11aa6-fa03-4d22-b0ae-50fb300b3cb2 None admin] PATH_INFO: `/v3/roles` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:18:12.443100 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eb11aa6-fa03-4d22-b0ae-50fb300b3cb2 None admin] RBAC: Adding query filter params (name=reader) {{(pid=479851) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 09:18:12.443582 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eb11aa6-fa03-4d22-b0ae-50fb300b3cb2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:18:12.445309 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eb11aa6-fa03-4d22-b0ae-50fb300b3cb2 None admin] RBAC: Authorization granted {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:18:12.455387 dv-cinder-851351-1-smb devstack@keystone.service[479851]: [pid: 479851|app: 0|req: 48/102] 10.222.0.42 () {56 vars in 1101 bytes} [Thu Jul 28 09:18:12 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:18:12.461318 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb11aa6-fa03-4d22-b0ae-50fb300b3cb2 None admin] Authenticating user token {{(pid=479851) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:18:12.481078 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG dbcounter [-] [479851] Writing DB stats keystone:SELECT=100 {{(pid=479851) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:18:12.571044 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb11aa6-fa03-4d22-b0ae-50fb300b3cb2 None admin] Validating token access rules against request {{(pid=479851) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:18:12.607188 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98cb60e-e60b-41bc-a2dc-d25bcc0cdfaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479851) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:18:12.608148 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98cb60e-e60b-41bc-a2dc-d25bcc0cdfaa None admin] REQUEST_METHOD: `GET` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:18:12.608598 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98cb60e-e60b-41bc-a2dc-d25bcc0cdfaa None admin] SCRIPT_NAME: `/identity` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:18:12.609074 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98cb60e-e60b-41bc-a2dc-d25bcc0cdfaa None admin] PATH_INFO: `/v3/users/2046089722a34a57bc743a56cc5e395a` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:18:12.624397 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f98cb60e-e60b-41bc-a2dc-d25bcc0cdfaa None admin] RBAC: Authorizing `identity:get_user(user_id=2046089722a34a57bc743a56cc5e395a)` {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:18:12.626439 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f98cb60e-e60b-41bc-a2dc-d25bcc0cdfaa None admin] RBAC: Authorization granted {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:18:12.628389 dv-cinder-851351-1-smb devstack@keystone.service[479851]: [pid: 479851|app: 0|req: 49/103] 10.222.0.42 () {56 vars in 1177 bytes} [Thu Jul 28 09:18:12 2022] GET /identity/v3/users/2046089722a34a57bc743a56cc5e395a => generated 289 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 09:18:12.634477 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98cb60e-e60b-41bc-a2dc-d25bcc0cdfaa None admin] Authenticating user token {{(pid=479851) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:18:12.638056 dv-cinder-851351-1-smb devstack@keystone.service[479852]: [pid: 479852|app: 0|req: 55/104] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 09:18:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 247 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 28 09:18:12.673851 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e800753-d129-4704-8671-ec0a15d27665 None None] Authenticating user token {{(pid=479852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:18:12.695716 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG dbcounter [-] [479852] Writing DB stats keystone:SELECT=100 {{(pid=479852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:18:12.741399 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG dbcounter [-] [479851] Writing DB stats keystone:SELECT=100 {{(pid=479851) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:18:12.771774 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98cb60e-e60b-41bc-a2dc-d25bcc0cdfaa None admin] Validating token access rules against request {{(pid=479851) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:18:12.816945 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d04ad59a-66cb-41fc-8bc4-f55d030075e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479851) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:18:12.817887 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04ad59a-66cb-41fc-8bc4-f55d030075e1 None admin] REQUEST_METHOD: `GET` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:18:12.818363 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04ad59a-66cb-41fc-8bc4-f55d030075e1 None admin] SCRIPT_NAME: `/identity` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:18:12.818809 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04ad59a-66cb-41fc-8bc4-f55d030075e1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:18:12.889864 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d04ad59a-66cb-41fc-8bc4-f55d030075e1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:18:12.892319 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d04ad59a-66cb-41fc-8bc4-f55d030075e1 None admin] RBAC: Authorization granted {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:18:12.918690 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e800753-d129-4704-8671-ec0a15d27665 None None] Validating token access rules against request {{(pid=479852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:18:12.957144 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG dbcounter [-] [479851] Writing DB stats keystone:SELECT=100 {{(pid=479851) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:18:12.998204 dv-cinder-851351-1-smb devstack@keystone.service[479851]: [pid: 479851|app: 0|req: 50/105] 10.222.0.42 () {58 vars in 1282 bytes} [Thu Jul 28 09:18:12 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 364 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 28 09:18:13.000097 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15851187-1b5e-4bfe-88c7-501d66b841d1 None None] REQUEST_METHOD: `GET` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:18:13.000644 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15851187-1b5e-4bfe-88c7-501d66b841d1 None None] SCRIPT_NAME: `/identity` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:18:13.001020 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a18cca-25e8-45c2-ab99-e70372c8e671 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:18:13.001196 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15851187-1b5e-4bfe-88c7-501d66b841d1 None None] PATH_INFO: `/` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:18:13.002027 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a18cca-25e8-45c2-ab99-e70372c8e671 None admin] REQUEST_METHOD: `GET` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:18:13.002440 dv-cinder-851351-1-smb devstack@keystone.service[479851]: [pid: 479851|app: 0|req: 51/106] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 09:18:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 09:18:13.002764 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a18cca-25e8-45c2-ab99-e70372c8e671 None admin] SCRIPT_NAME: `/identity` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:18:13.003053 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a18cca-25e8-45c2-ab99-e70372c8e671 None admin] PATH_INFO: `/v3/domains/default` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:18:13.004438 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5a18cca-25e8-45c2-ab99-e70372c8e671 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:18:13.006151 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5a18cca-25e8-45c2-ab99-e70372c8e671 None admin] RBAC: Authorization granted {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:18:13.009101 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8543905-f5d9-493c-af38-416a03edc271 None None] REQUEST_METHOD: `POST` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:18:13.009627 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8543905-f5d9-493c-af38-416a03edc271 None None] SCRIPT_NAME: `/identity` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:18:13.010106 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8543905-f5d9-493c-af38-416a03edc271 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:18:13.013591 dv-cinder-851351-1-smb devstack@keystone.service[479852]: [pid: 479852|app: 0|req: 56/107] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 09:18:12 2022] GET /identity/v3/domains/default => generated 199 bytes in 340 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:18:13.014647 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a18cca-25e8-45c2-ab99-e70372c8e671 None admin] Authenticating user token {{(pid=479852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:18:13.044780 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.auth.core [None req-c8543905-f5d9-493c-af38-416a03edc271 None None] MFA Rules not processed for user `c198f91a4ae84d2b9cc730a6e304c2be`. Rule list: `[]` (Enabled: `True`). {{(pid=479851) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 09:18:13.047169 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.fernet_utils [None req-c8543905-f5d9-493c-af38-416a03edc271 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=479851) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 09:18:13.130284 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG dbcounter [-] [479852] Writing DB stats keystone:SELECT=100 {{(pid=479852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:18:13.133488 dv-cinder-851351-1-smb devstack@keystone.service[479851]: [pid: 479851|app: 0|req: 52/108] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 09:18:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 09:18:13.134551 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8543905-f5d9-493c-af38-416a03edc271 None None] Authenticating user token {{(pid=479851) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:18:13.169776 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a18cca-25e8-45c2-ab99-e70372c8e671 None admin] Validating token access rules against request {{(pid=479852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:18:13.206248 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d42a16-986e-4c18-b60b-fb36f2e74403 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:18:13.207324 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d42a16-986e-4c18-b60b-fb36f2e74403 None admin] REQUEST_METHOD: `GET` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:18:13.207799 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d42a16-986e-4c18-b60b-fb36f2e74403 None admin] SCRIPT_NAME: `/identity` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:18:13.208268 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d42a16-986e-4c18-b60b-fb36f2e74403 None admin] PATH_INFO: `/v3/projects/580eb2f23f9049b18bb38dce6f6f9b4f` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:18:13.209689 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22d42a16-986e-4c18-b60b-fb36f2e74403 None admin] RBAC: Authorizing `identity:get_project(project_id=580eb2f23f9049b18bb38dce6f6f9b4f)` {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:18:13.211384 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22d42a16-986e-4c18-b60b-fb36f2e74403 None admin] RBAC: Authorization granted {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:18:13.213382 dv-cinder-851351-1-smb devstack@keystone.service[479852]: [pid: 479852|app: 0|req: 57/109] 10.222.0.42 () {56 vars in 1186 bytes} [Thu Jul 28 09:18:13 2022] GET /identity/v3/projects/580eb2f23f9049b18bb38dce6f6f9b4f => generated 298 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:18:13.214820 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5382c1ad-710d-4e89-bbea-fc383afced97 None None] REQUEST_METHOD: `GET` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:18:13.215107 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5382c1ad-710d-4e89-bbea-fc383afced97 None None] SCRIPT_NAME: `/identity` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:18:13.215382 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5382c1ad-710d-4e89-bbea-fc383afced97 None None] PATH_INFO: `/` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:18:13.216758 dv-cinder-851351-1-smb devstack@keystone.service[479852]: [pid: 479852|app: 0|req: 58/110] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 09:18:13 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 09:18:13.217654 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc66c8b-48b9-431c-906a-5b95a8632fc4 None None] REQUEST_METHOD: `GET` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:18:13.217937 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc66c8b-48b9-431c-906a-5b95a8632fc4 None None] SCRIPT_NAME: `/identity` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:18:13.218390 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc66c8b-48b9-431c-906a-5b95a8632fc4 None None] PATH_INFO: `/` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:18:13.219402 dv-cinder-851351-1-smb devstack@keystone.service[479852]: [pid: 479852|app: 0|req: 59/111] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 09:18:13 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 09:18:13.220100 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc66c8b-48b9-431c-906a-5b95a8632fc4 None None] Authenticating user token {{(pid=479852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:18:13.261216 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG dbcounter [-] [479851] Writing DB stats keystone:SELECT=100 {{(pid=479851) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:18:13.273757 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8543905-f5d9-493c-af38-416a03edc271 None None] Validating token access rules against request {{(pid=479851) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:18:13.312142 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abee4e7e-4c02-4f02-a206-67035327b048 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479851) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:18:13.312820 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abee4e7e-4c02-4f02-a206-67035327b048 None admin] REQUEST_METHOD: `POST` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:18:13.313116 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abee4e7e-4c02-4f02-a206-67035327b048 None admin] SCRIPT_NAME: `/identity` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:18:13.313403 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abee4e7e-4c02-4f02-a206-67035327b048 None admin] PATH_INFO: `/v3/projects` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:18:13.314114 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abee4e7e-4c02-4f02-a206-67035327b048 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:18:13.315604 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abee4e7e-4c02-4f02-a206-67035327b048 None admin] RBAC: Authorization granted {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:18:13.329231 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc66c8b-48b9-431c-906a-5b95a8632fc4 None None] Validating token access rules against request {{(pid=479852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:18:13.346587 dv-cinder-851351-1-smb devstack@keystone.service[479851]: [pid: 479851|app: 0|req: 53/112] 10.222.0.42 () {60 vars in 1141 bytes} [Thu Jul 28 09:18:13 2022] POST /identity/v3/projects => generated 302 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 09:18:13.357851 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abee4e7e-4c02-4f02-a206-67035327b048 None admin] Authenticating user token {{(pid=479851) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:18:13.368346 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e819352-5e2d-4f0a-a761-0e6e462506db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:18:13.369080 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e819352-5e2d-4f0a-a761-0e6e462506db None admin] REQUEST_METHOD: `GET` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:18:13.369371 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e819352-5e2d-4f0a-a761-0e6e462506db None admin] SCRIPT_NAME: `/identity` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:18:13.369674 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e819352-5e2d-4f0a-a761-0e6e462506db None admin] PATH_INFO: `/v3/roles/member` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:18:13.385733 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e819352-5e2d-4f0a-a761-0e6e462506db None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 09:18:13.390777 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application [None req-8e819352-5e2d-4f0a-a761-0e6e462506db None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 28 09:18:13.390777 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 09:18:13.390777 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 09:18:13.390777 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 09:18:13.390777 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 09:18:13.390777 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 09:18:13.390777 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 09:18:13.390777 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 09:18:13.390777 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 09:18:13.390777 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 09:18:13.390777 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 09:18:13.390777 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 09:18:13.390777 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 09:18:13.390777 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 09:18:13.390777 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 09:18:13.390777 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 09:18:13.391845 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 09:18:13.391845 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 09:18:13.391845 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 09:18:13.391845 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 09:18:13.391845 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 09:18:13.391845 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 09:18:13.391845 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 09:18:13.391845 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 09:18:13.391845 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 09:18:13.391845 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 09:18:13.391845 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 09:18:13.391845 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application with Lock( Jul 28 09:18:13.391845 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 09:18:13.391845 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self._enter() Jul 28 09:18:13.391845 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 09:18:13.391845 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 09:18:13.392865 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 09:18:13.392865 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self.creator() Jul 28 09:18:13.392865 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 09:18:13.392865 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application created_value = creator( Jul 28 09:18:13.392865 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 09:18:13.392865 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 09:18:13.392865 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 09:18:13.392865 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 09:18:13.392865 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 09:18:13.392865 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 09:18:13.392865 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 28 09:18:13.392865 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application Jul 28 09:18:13.397163 dv-cinder-851351-1-smb devstack@keystone.service[479852]: [pid: 479852|app: 0|req: 60/113] 10.222.0.42 () {56 vars in 1099 bytes} [Thu Jul 28 09:18:13 2022] GET /identity/v3/roles/member => generated 84 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 09:18:13.400941 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e519c02-bb25-4abf-a247-ee6a1136e3f3 None None] REQUEST_METHOD: `POST` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:18:13.401234 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e519c02-bb25-4abf-a247-ee6a1136e3f3 None None] SCRIPT_NAME: `/identity` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:18:13.401524 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e519c02-bb25-4abf-a247-ee6a1136e3f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:18:13.410113 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG dbcounter [-] [479852] Writing DB stats keystone:SELECT=100 {{(pid=479852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:18:13.425216 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.auth.core [None req-1e519c02-bb25-4abf-a247-ee6a1136e3f3 None None] MFA Rules not processed for user `c198f91a4ae84d2b9cc730a6e304c2be`. Rule list: `[]` (Enabled: `True`). {{(pid=479852) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 09:18:13.426473 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.fernet_utils [None req-1e519c02-bb25-4abf-a247-ee6a1136e3f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=479852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 09:18:13.502009 dv-cinder-851351-1-smb devstack@keystone.service[479852]: [pid: 479852|app: 0|req: 61/114] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 09:18:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 09:18:13.502894 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abee4e7e-4c02-4f02-a206-67035327b048 None admin] Validating token access rules against request {{(pid=479851) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:18:13.504035 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee05bf21-9320-40f6-9054-48dca443b133 None None] REQUEST_METHOD: `POST` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:18:13.504548 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee05bf21-9320-40f6-9054-48dca443b133 None None] SCRIPT_NAME: `/identity` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:18:13.504922 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee05bf21-9320-40f6-9054-48dca443b133 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:18:13.537885 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.auth.core [None req-ee05bf21-9320-40f6-9054-48dca443b133 None None] MFA Rules not processed for user `c198f91a4ae84d2b9cc730a6e304c2be`. Rule list: `[]` (Enabled: `True`). {{(pid=479852) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 09:18:13.539244 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.fernet_utils [None req-ee05bf21-9320-40f6-9054-48dca443b133 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=479852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 09:18:13.551228 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa95abf3-5c8d-46b5-b018-7c877c586fb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479851) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:18:13.551891 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa95abf3-5c8d-46b5-b018-7c877c586fb6 None admin] REQUEST_METHOD: `GET` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:18:13.552186 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa95abf3-5c8d-46b5-b018-7c877c586fb6 None admin] SCRIPT_NAME: `/identity` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:18:13.552475 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa95abf3-5c8d-46b5-b018-7c877c586fb6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:18:13.553341 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa95abf3-5c8d-46b5-b018-7c877c586fb6 None admin] RBAC: Adding query filter params (role.id=73525379110b4a99850473e0e9f217f1, scope.project.id=580eb2f23f9049b18bb38dce6f6f9b4f, user.id=2046089722a34a57bc743a56cc5e395a) {{(pid=479851) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 09:18:13.553905 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa95abf3-5c8d-46b5-b018-7c877c586fb6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:18:13.555344 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa95abf3-5c8d-46b5-b018-7c877c586fb6 None admin] RBAC: Authorization granted {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:18:13.561546 dv-cinder-851351-1-smb devstack@keystone.service[479851]: [pid: 479851|app: 0|req: 54/115] 10.222.0.42 () {56 vars in 1374 bytes} [Thu Jul 28 09:18:13 2022] GET /identity/v3/role_assignments?user.id=2046089722a34a57bc743a56cc5e395a&scope.project.id=580eb2f23f9049b18bb38dce6f6f9b4f&role.id=73525379110b4a99850473e0e9f217f1 => generated 259 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:18:13.562290 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa95abf3-5c8d-46b5-b018-7c877c586fb6 None admin] Authenticating user token {{(pid=479851) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:18:13.577608 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG dbcounter [-] [479851] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=479851) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:18:13.652023 dv-cinder-851351-1-smb devstack@keystone.service[479852]: [pid: 479852|app: 0|req: 62/116] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 09:18:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 09:18:13.658739 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3361cab-2591-406b-98fa-675ffee81fc3 None None] REQUEST_METHOD: `GET` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:18:13.658739 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3361cab-2591-406b-98fa-675ffee81fc3 None None] SCRIPT_NAME: `/identity` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:18:13.658739 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3361cab-2591-406b-98fa-675ffee81fc3 None None] PATH_INFO: `/` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:18:13.663369 dv-cinder-851351-1-smb devstack@keystone.service[479852]: [pid: 479852|app: 0|req: 63/117] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 09:18:13 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 09:18:13.670172 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3361cab-2591-406b-98fa-675ffee81fc3 None None] Authenticating user token {{(pid=479852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:18:13.711660 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa95abf3-5c8d-46b5-b018-7c877c586fb6 None admin] Validating token access rules against request {{(pid=479851) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:18:13.763055 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6125f368-faf7-445e-bab2-a4aacaaba883 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479851) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:18:13.764768 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6125f368-faf7-445e-bab2-a4aacaaba883 None admin] REQUEST_METHOD: `GET` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:18:13.765422 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6125f368-faf7-445e-bab2-a4aacaaba883 None admin] SCRIPT_NAME: `/identity` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:18:13.766962 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6125f368-faf7-445e-bab2-a4aacaaba883 None admin] PATH_INFO: `/v3/roles` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:18:13.768406 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG dbcounter [-] [479852] Writing DB stats keystone:SELECT=100 {{(pid=479852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:18:13.768624 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6125f368-faf7-445e-bab2-a4aacaaba883 None admin] RBAC: Adding query filter params (name=member) {{(pid=479851) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 09:18:13.768969 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6125f368-faf7-445e-bab2-a4aacaaba883 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:18:13.770400 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6125f368-faf7-445e-bab2-a4aacaaba883 None admin] RBAC: Authorization granted {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:18:13.783842 dv-cinder-851351-1-smb devstack@keystone.service[479851]: [pid: 479851|app: 0|req: 55/118] 10.222.0.42 () {56 vars in 1101 bytes} [Thu Jul 28 09:18:13 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:18:13.785549 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b734964-4cf9-44c1-a2bd-75e2d7c2fcea None None] REQUEST_METHOD: `POST` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:18:13.786140 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b734964-4cf9-44c1-a2bd-75e2d7c2fcea None None] SCRIPT_NAME: `/identity` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:18:13.786646 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b734964-4cf9-44c1-a2bd-75e2d7c2fcea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:18:13.808103 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.auth.core [None req-2b734964-4cf9-44c1-a2bd-75e2d7c2fcea None None] MFA Rules not processed for user `c198f91a4ae84d2b9cc730a6e304c2be`. Rule list: `[]` (Enabled: `True`). {{(pid=479851) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 09:18:13.809360 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.fernet_utils [None req-2b734964-4cf9-44c1-a2bd-75e2d7c2fcea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=479851) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 09:18:13.829787 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3361cab-2591-406b-98fa-675ffee81fc3 None None] Validating token access rules against request {{(pid=479852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:18:13.879193 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee66947-a014-4068-a46b-5a69ebe4a66d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:18:13.880334 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee66947-a014-4068-a46b-5a69ebe4a66d None admin] REQUEST_METHOD: `GET` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:18:13.880893 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee66947-a014-4068-a46b-5a69ebe4a66d None admin] SCRIPT_NAME: `/identity` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:18:13.881396 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee66947-a014-4068-a46b-5a69ebe4a66d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:18:13.895783 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee66947-a014-4068-a46b-5a69ebe4a66d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 09:18:13.896847 dv-cinder-851351-1-smb devstack@keystone.service[479851]: [pid: 479851|app: 0|req: 56/119] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 09:18:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 09:18:13.902768 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b734964-4cf9-44c1-a2bd-75e2d7c2fcea None None] Authenticating user token {{(pid=479851) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:18:13.902768 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG dbcounter [-] [479851] Writing DB stats keystone:SELECT=100 {{(pid=479851) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:18:13.913554 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application [None req-1ee66947-a014-4068-a46b-5a69ebe4a66d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 09:18:13.913554 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 09:18:13.913554 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 09:18:13.913554 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 09:18:13.913554 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 09:18:13.913554 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 09:18:13.913554 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 09:18:13.913554 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 09:18:13.913554 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 09:18:13.913554 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 09:18:13.913554 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 09:18:13.913554 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 09:18:13.913554 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 09:18:13.913554 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 09:18:13.913554 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 09:18:13.913554 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 09:18:13.914696 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 09:18:13.914696 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 09:18:13.914696 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 09:18:13.914696 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 09:18:13.914696 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 09:18:13.914696 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 09:18:13.914696 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 09:18:13.914696 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 09:18:13.914696 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 09:18:13.914696 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 09:18:13.914696 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 09:18:13.914696 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application with Lock( Jul 28 09:18:13.914696 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 09:18:13.914696 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self._enter() Jul 28 09:18:13.914696 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 09:18:13.914696 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 09:18:13.916310 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 09:18:13.916310 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self.creator() Jul 28 09:18:13.916310 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 09:18:13.916310 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application created_value = creator( Jul 28 09:18:13.916310 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 09:18:13.916310 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 09:18:13.916310 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 09:18:13.916310 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 09:18:13.916310 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 09:18:13.916310 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 09:18:13.916310 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 09:18:13.916310 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application Jul 28 09:18:13.916310 dv-cinder-851351-1-smb devstack@keystone.service[479852]: [pid: 479852|app: 0|req: 64/120] 10.222.0.42 () {56 vars in 1096 bytes} [Thu Jul 28 09:18:13 2022] GET /identity/v3/roles/admin => generated 83 bytes in 251 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 09:18:13.916310 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee66947-a014-4068-a46b-5a69ebe4a66d None admin] Authenticating user token {{(pid=479852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:18:14.032740 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b734964-4cf9-44c1-a2bd-75e2d7c2fcea None None] Validating token access rules against request {{(pid=479851) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:18:14.037425 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee66947-a014-4068-a46b-5a69ebe4a66d None admin] Validating token access rules against request {{(pid=479852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:18:14.070718 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG dbcounter [-] [479852] Writing DB stats keystone:SELECT=100 {{(pid=479852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:18:14.077391 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58666bff-4bf4-4bb4-ab49-68b9adad9f75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479851) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:18:14.078084 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58666bff-4bf4-4bb4-ab49-68b9adad9f75 None admin] REQUEST_METHOD: `GET` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:18:14.078379 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58666bff-4bf4-4bb4-ab49-68b9adad9f75 None admin] SCRIPT_NAME: `/identity` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:18:14.078783 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58666bff-4bf4-4bb4-ab49-68b9adad9f75 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:18:14.084748 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557237de-74b2-437e-9cc3-107bf5e13ac5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:18:14.085780 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557237de-74b2-437e-9cc3-107bf5e13ac5 None admin] REQUEST_METHOD: `GET` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:18:14.086156 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557237de-74b2-437e-9cc3-107bf5e13ac5 None admin] SCRIPT_NAME: `/identity` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:18:14.086631 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557237de-74b2-437e-9cc3-107bf5e13ac5 None admin] PATH_INFO: `/v3/users/73be2aaaa3a047f395fae06ed9308ab6` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:18:14.088012 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-557237de-74b2-437e-9cc3-107bf5e13ac5 None admin] RBAC: Authorizing `identity:get_user(user_id=73be2aaaa3a047f395fae06ed9308ab6)` {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:18:14.089642 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-557237de-74b2-437e-9cc3-107bf5e13ac5 None admin] RBAC: Authorization granted {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:18:14.090480 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58666bff-4bf4-4bb4-ab49-68b9adad9f75 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 09:18:14.091818 dv-cinder-851351-1-smb devstack@keystone.service[479852]: [pid: 479852|app: 0|req: 65/121] 10.222.0.42 () {56 vars in 1177 bytes} [Thu Jul 28 09:18:13 2022] GET /identity/v3/users/73be2aaaa3a047f395fae06ed9308ab6 => generated 275 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:18:14.095798 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application [None req-58666bff-4bf4-4bb4-ab49-68b9adad9f75 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 28 09:18:14.095798 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 09:18:14.095798 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 09:18:14.095798 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 09:18:14.095798 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 09:18:14.095798 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 09:18:14.095798 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 09:18:14.095798 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 09:18:14.095798 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 09:18:14.095798 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 09:18:14.095798 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 09:18:14.095798 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 09:18:14.095798 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 09:18:14.095798 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 09:18:14.095798 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 09:18:14.095798 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 09:18:14.097117 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 09:18:14.097117 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 09:18:14.097117 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 09:18:14.097117 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 09:18:14.097117 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 09:18:14.097117 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 09:18:14.097117 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 09:18:14.097117 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 09:18:14.097117 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 09:18:14.097117 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 09:18:14.097117 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 09:18:14.097117 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application with Lock( Jul 28 09:18:14.097117 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 09:18:14.097117 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return self._enter() Jul 28 09:18:14.097117 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 09:18:14.097117 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 09:18:14.098309 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 09:18:14.098309 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return self.creator() Jul 28 09:18:14.098309 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 09:18:14.098309 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application created_value = creator( Jul 28 09:18:14.098309 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 09:18:14.098309 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 09:18:14.098309 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 09:18:14.098309 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 09:18:14.098309 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 09:18:14.098309 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 09:18:14.098309 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 28 09:18:14.098309 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application Jul 28 09:18:14.098309 dv-cinder-851351-1-smb devstack@keystone.service[479851]: [pid: 479851|app: 0|req: 57/122] 10.222.0.42 () {56 vars in 1114 bytes} [Thu Jul 28 09:18:13 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 09:18:14.098309 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58666bff-4bf4-4bb4-ab49-68b9adad9f75 None admin] Authenticating user token {{(pid=479851) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:18:14.099701 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557237de-74b2-437e-9cc3-107bf5e13ac5 None admin] Authenticating user token {{(pid=479852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:18:14.169955 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG dbcounter [-] [479851] Writing DB stats keystone:SELECT=100 {{(pid=479851) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:18:14.216198 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58666bff-4bf4-4bb4-ab49-68b9adad9f75 None admin] Validating token access rules against request {{(pid=479851) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:18:14.224330 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557237de-74b2-437e-9cc3-107bf5e13ac5 None admin] Validating token access rules against request {{(pid=479852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:18:14.257247 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7b3675-3b01-4c54-a9d7-501eca6b5270 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479851) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:18:14.258021 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7b3675-3b01-4c54-a9d7-501eca6b5270 None admin] REQUEST_METHOD: `GET` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:18:14.258373 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7b3675-3b01-4c54-a9d7-501eca6b5270 None admin] SCRIPT_NAME: `/identity` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:18:14.258725 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7b3675-3b01-4c54-a9d7-501eca6b5270 None admin] PATH_INFO: `/v3/roles/member` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:18:14.270894 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42dcca0a-80d9-416b-948c-fa551b4d2160 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:18:14.271894 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42dcca0a-80d9-416b-948c-fa551b4d2160 None admin] REQUEST_METHOD: `GET` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:18:14.272581 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42dcca0a-80d9-416b-948c-fa551b4d2160 None admin] SCRIPT_NAME: `/identity` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:18:14.273203 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42dcca0a-80d9-416b-948c-fa551b4d2160 None admin] PATH_INFO: `/v3/roles` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:18:14.273480 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b7b3675-3b01-4c54-a9d7-501eca6b5270 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 09:18:14.274348 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42dcca0a-80d9-416b-948c-fa551b4d2160 None admin] RBAC: Adding query filter params (name=admin) {{(pid=479852) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 09:18:14.274859 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42dcca0a-80d9-416b-948c-fa551b4d2160 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:18:14.276500 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42dcca0a-80d9-416b-948c-fa551b4d2160 None admin] RBAC: Authorization granted {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:18:14.279856 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application [None req-1b7b3675-3b01-4c54-a9d7-501eca6b5270 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 28 09:18:14.279856 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 09:18:14.279856 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 09:18:14.279856 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 09:18:14.279856 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 09:18:14.279856 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 09:18:14.279856 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 09:18:14.279856 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 09:18:14.279856 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 09:18:14.279856 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 09:18:14.279856 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 09:18:14.279856 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 09:18:14.279856 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 09:18:14.279856 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 09:18:14.279856 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 09:18:14.279856 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 09:18:14.280930 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 09:18:14.280930 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 09:18:14.280930 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 09:18:14.280930 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 09:18:14.280930 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 09:18:14.280930 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 09:18:14.280930 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 09:18:14.280930 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 09:18:14.280930 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 09:18:14.280930 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 09:18:14.280930 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 09:18:14.280930 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application with Lock( Jul 28 09:18:14.280930 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 09:18:14.280930 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return self._enter() Jul 28 09:18:14.280930 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 09:18:14.280930 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 09:18:14.281913 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 09:18:14.281913 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return self.creator() Jul 28 09:18:14.281913 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 09:18:14.281913 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application created_value = creator( Jul 28 09:18:14.281913 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 09:18:14.281913 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 09:18:14.281913 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 09:18:14.281913 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 09:18:14.281913 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 09:18:14.281913 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 09:18:14.281913 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 28 09:18:14.281913 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application Jul 28 09:18:14.281913 dv-cinder-851351-1-smb devstack@keystone.service[479851]: [pid: 479851|app: 0|req: 58/123] 10.222.0.42 () {56 vars in 1099 bytes} [Thu Jul 28 09:18:14 2022] GET /identity/v3/roles/member => generated 84 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 09:18:14.281913 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7b3675-3b01-4c54-a9d7-501eca6b5270 None admin] Authenticating user token {{(pid=479851) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:18:14.296175 dv-cinder-851351-1-smb devstack@keystone.service[479852]: [pid: 479852|app: 0|req: 66/124] 10.222.0.42 () {56 vars in 1099 bytes} [Thu Jul 28 09:18:14 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:18:14.297429 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42dcca0a-80d9-416b-948c-fa551b4d2160 None admin] Authenticating user token {{(pid=479852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:18:14.380898 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG dbcounter [-] [479852] Writing DB stats keystone:SELECT=100 {{(pid=479852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:18:14.433337 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7b3675-3b01-4c54-a9d7-501eca6b5270 None admin] Validating token access rules against request {{(pid=479851) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:18:14.442381 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42dcca0a-80d9-416b-948c-fa551b4d2160 None admin] Validating token access rules against request {{(pid=479852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:18:14.460526 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG dbcounter [-] [479851] Writing DB stats keystone:SELECT=100 {{(pid=479851) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:18:14.481017 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd9be75-e67d-4c5f-8caa-1ef5f0686272 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479851) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:18:14.481697 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd9be75-e67d-4c5f-8caa-1ef5f0686272 None admin] REQUEST_METHOD: `GET` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:18:14.481992 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd9be75-e67d-4c5f-8caa-1ef5f0686272 None admin] SCRIPT_NAME: `/identity` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:18:14.482673 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd9be75-e67d-4c5f-8caa-1ef5f0686272 None admin] PATH_INFO: `/v3/projects/580eb2f23f9049b18bb38dce6f6f9b4f` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:18:14.484296 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd9be75-e67d-4c5f-8caa-1ef5f0686272 None admin] RBAC: Authorizing `identity:get_project(project_id=580eb2f23f9049b18bb38dce6f6f9b4f)` {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:18:14.485916 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd9be75-e67d-4c5f-8caa-1ef5f0686272 None admin] RBAC: Authorization granted {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:18:14.487883 dv-cinder-851351-1-smb devstack@keystone.service[479851]: [pid: 479851|app: 0|req: 59/125] 10.222.0.42 () {56 vars in 1186 bytes} [Thu Jul 28 09:18:14 2022] GET /identity/v3/projects/580eb2f23f9049b18bb38dce6f6f9b4f => generated 298 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:18:14.488330 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4a29cb-c7c8-40de-93cd-a584b5cbe24a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:18:14.488717 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd9be75-e67d-4c5f-8caa-1ef5f0686272 None admin] Authenticating user token {{(pid=479851) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:18:14.489552 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4a29cb-c7c8-40de-93cd-a584b5cbe24a None admin] REQUEST_METHOD: `GET` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:18:14.490080 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4a29cb-c7c8-40de-93cd-a584b5cbe24a None admin] SCRIPT_NAME: `/identity` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:18:14.490595 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4a29cb-c7c8-40de-93cd-a584b5cbe24a None admin] PATH_INFO: `/v3/roles` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:18:14.491849 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b4a29cb-c7c8-40de-93cd-a584b5cbe24a None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=479852) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 09:18:14.492392 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b4a29cb-c7c8-40de-93cd-a584b5cbe24a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:18:14.495014 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b4a29cb-c7c8-40de-93cd-a584b5cbe24a None admin] RBAC: Authorization granted {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:18:14.505695 dv-cinder-851351-1-smb devstack@keystone.service[479852]: [pid: 479852|app: 0|req: 67/126] 10.222.0.42 () {56 vars in 1111 bytes} [Thu Jul 28 09:18:14 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:18:14.507488 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4a29cb-c7c8-40de-93cd-a584b5cbe24a None admin] Authenticating user token {{(pid=479852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:18:14.628697 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd9be75-e67d-4c5f-8caa-1ef5f0686272 None admin] Validating token access rules against request {{(pid=479851) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:18:14.629859 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4a29cb-c7c8-40de-93cd-a584b5cbe24a None admin] Validating token access rules against request {{(pid=479852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:18:14.650953 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG dbcounter [-] [479852] Writing DB stats keystone:SELECT=100 {{(pid=479852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:18:14.674174 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-588e11a4-4295-40fd-a9ad-86bd41bc7368 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:18:14.675051 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588e11a4-4295-40fd-a9ad-86bd41bc7368 None admin] REQUEST_METHOD: `GET` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:18:14.675507 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588e11a4-4295-40fd-a9ad-86bd41bc7368 None admin] SCRIPT_NAME: `/identity` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:18:14.675881 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588e11a4-4295-40fd-a9ad-86bd41bc7368 None admin] PATH_INFO: `/v3/users/c198f91a4ae84d2b9cc730a6e304c2be` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:18:14.677378 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-588e11a4-4295-40fd-a9ad-86bd41bc7368 None admin] RBAC: Authorizing `identity:get_user(user_id=c198f91a4ae84d2b9cc730a6e304c2be)` {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:18:14.678887 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba62c348-1217-4d3f-9e4b-e0483063feb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479851) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:18:14.679237 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-588e11a4-4295-40fd-a9ad-86bd41bc7368 None admin] RBAC: Authorization granted {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:18:14.679572 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba62c348-1217-4d3f-9e4b-e0483063feb4 None admin] REQUEST_METHOD: `GET` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:18:14.679869 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba62c348-1217-4d3f-9e4b-e0483063feb4 None admin] SCRIPT_NAME: `/identity` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:18:14.680162 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba62c348-1217-4d3f-9e4b-e0483063feb4 None admin] PATH_INFO: `/v3/roles` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:18:14.680967 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba62c348-1217-4d3f-9e4b-e0483063feb4 None admin] RBAC: Adding query filter params (name=member) {{(pid=479851) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 09:18:14.681288 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba62c348-1217-4d3f-9e4b-e0483063feb4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:18:14.681555 dv-cinder-851351-1-smb devstack@keystone.service[479852]: [pid: 479852|app: 0|req: 68/127] 10.222.0.42 () {56 vars in 1177 bytes} [Thu Jul 28 09:18:14 2022] GET /identity/v3/users/c198f91a4ae84d2b9cc730a6e304c2be => generated 247 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:18:14.682446 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-588e11a4-4295-40fd-a9ad-86bd41bc7368 None admin] Authenticating user token {{(pid=479852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:18:14.686162 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba62c348-1217-4d3f-9e4b-e0483063feb4 None admin] RBAC: Authorization granted {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:18:14.704853 dv-cinder-851351-1-smb devstack@keystone.service[479851]: [pid: 479851|app: 0|req: 60/128] 10.222.0.42 () {56 vars in 1101 bytes} [Thu Jul 28 09:18:14 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:18:14.705769 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba62c348-1217-4d3f-9e4b-e0483063feb4 None admin] Authenticating user token {{(pid=479851) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:18:14.777095 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG dbcounter [-] [479851] Writing DB stats keystone:SELECT=100 {{(pid=479851) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:18:14.804332 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-588e11a4-4295-40fd-a9ad-86bd41bc7368 None admin] Validating token access rules against request {{(pid=479852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:18:14.837022 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba62c348-1217-4d3f-9e4b-e0483063feb4 None admin] Validating token access rules against request {{(pid=479851) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:18:14.851351 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362c848f-6c58-4342-8684-9ac351ea32b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:18:14.852499 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362c848f-6c58-4342-8684-9ac351ea32b5 None admin] REQUEST_METHOD: `PUT` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:18:14.853098 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362c848f-6c58-4342-8684-9ac351ea32b5 None admin] SCRIPT_NAME: `/identity` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:18:14.853397 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362c848f-6c58-4342-8684-9ac351ea32b5 None admin] PATH_INFO: `/v3/projects/580eb2f23f9049b18bb38dce6f6f9b4f/users/73be2aaaa3a047f395fae06ed9308ab6/roles/900fb424e172461d93a0db59afb0a12b` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:18:14.856058 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-362c848f-6c58-4342-8684-9ac351ea32b5 None admin] RBAC: Authorizing `identity:create_grant(project_id=580eb2f23f9049b18bb38dce6f6f9b4f, user_id=73be2aaaa3a047f395fae06ed9308ab6, role_id=900fb424e172461d93a0db59afb0a12b)` {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:18:14.857572 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-362c848f-6c58-4342-8684-9ac351ea32b5 None admin] RBAC: Authorization granted {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:18:14.873478 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed5596b6-f622-4889-b09d-f69899a27d41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479851) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:18:14.874354 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5596b6-f622-4889-b09d-f69899a27d41 None admin] REQUEST_METHOD: `GET` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:18:14.874704 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5596b6-f622-4889-b09d-f69899a27d41 None admin] SCRIPT_NAME: `/identity` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:18:14.875035 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5596b6-f622-4889-b09d-f69899a27d41 None admin] PATH_INFO: `/v3/users/73be2aaaa3a047f395fae06ed9308ab6` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:18:14.876313 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed5596b6-f622-4889-b09d-f69899a27d41 None admin] RBAC: Authorizing `identity:get_user(user_id=73be2aaaa3a047f395fae06ed9308ab6)` {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:18:14.876567 dv-cinder-851351-1-smb devstack@keystone.service[479852]: [pid: 479852|app: 0|req: 69/129] 10.222.0.42 () {58 vars in 1439 bytes} [Thu Jul 28 09:18:14 2022] PUT /identity/v3/projects/580eb2f23f9049b18bb38dce6f6f9b4f/users/73be2aaaa3a047f395fae06ed9308ab6/roles/900fb424e172461d93a0db59afb0a12b => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 09:18:14.877465 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362c848f-6c58-4342-8684-9ac351ea32b5 None admin] Authenticating user token {{(pid=479852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:18:14.886646 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed5596b6-f622-4889-b09d-f69899a27d41 None admin] RBAC: Authorization granted {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:18:14.888728 dv-cinder-851351-1-smb devstack@keystone.service[479851]: [pid: 479851|app: 0|req: 61/130] 10.222.0.42 () {56 vars in 1177 bytes} [Thu Jul 28 09:18:14 2022] GET /identity/v3/users/73be2aaaa3a047f395fae06ed9308ab6 => generated 275 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:18:14.889380 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed5596b6-f622-4889-b09d-f69899a27d41 None admin] Authenticating user token {{(pid=479851) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:18:14.974003 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG dbcounter [-] [479852] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=479852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:18:15.060250 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed5596b6-f622-4889-b09d-f69899a27d41 None admin] Validating token access rules against request {{(pid=479851) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:18:15.095632 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362c848f-6c58-4342-8684-9ac351ea32b5 None admin] Validating token access rules against request {{(pid=479852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:18:15.108680 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG dbcounter [-] [479851] Writing DB stats keystone:SELECT=100 {{(pid=479851) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:18:15.135062 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b28310-0670-4c20-a73b-fbd37ec3cbee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479851) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:18:15.136131 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b28310-0670-4c20-a73b-fbd37ec3cbee None admin] REQUEST_METHOD: `GET` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:18:15.136420 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b28310-0670-4c20-a73b-fbd37ec3cbee None admin] SCRIPT_NAME: `/identity` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:18:15.137068 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b28310-0670-4c20-a73b-fbd37ec3cbee None admin] PATH_INFO: `/v3/users/73be2aaaa3a047f395fae06ed9308ab6` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:18:15.138441 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b28310-0670-4c20-a73b-fbd37ec3cbee None admin] RBAC: Authorizing `identity:get_user(user_id=73be2aaaa3a047f395fae06ed9308ab6)` {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:18:15.140566 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b28310-0670-4c20-a73b-fbd37ec3cbee None admin] RBAC: Authorization granted {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:18:15.142959 dv-cinder-851351-1-smb devstack@keystone.service[479851]: [pid: 479851|app: 0|req: 62/131] 10.222.0.42 () {56 vars in 1177 bytes} [Thu Jul 28 09:18:14 2022] GET /identity/v3/users/73be2aaaa3a047f395fae06ed9308ab6 => generated 275 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:18:15.143901 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b28310-0670-4c20-a73b-fbd37ec3cbee None admin] Authenticating user token {{(pid=479851) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:18:15.153283 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7466b000-f507-49af-bbad-099d7a3e55b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:18:15.154038 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7466b000-f507-49af-bbad-099d7a3e55b8 None admin] REQUEST_METHOD: `GET` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:18:15.154325 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7466b000-f507-49af-bbad-099d7a3e55b8 None admin] SCRIPT_NAME: `/identity` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:18:15.155231 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7466b000-f507-49af-bbad-099d7a3e55b8 None admin] PATH_INFO: `/v3/projects/580eb2f23f9049b18bb38dce6f6f9b4f` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:18:15.156566 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7466b000-f507-49af-bbad-099d7a3e55b8 None admin] RBAC: Authorizing `identity:get_project(project_id=580eb2f23f9049b18bb38dce6f6f9b4f)` {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:18:15.159115 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7466b000-f507-49af-bbad-099d7a3e55b8 None admin] RBAC: Authorization granted {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:18:15.161631 dv-cinder-851351-1-smb devstack@keystone.service[479852]: [pid: 479852|app: 0|req: 70/132] 10.222.0.42 () {56 vars in 1186 bytes} [Thu Jul 28 09:18:14 2022] GET /identity/v3/projects/580eb2f23f9049b18bb38dce6f6f9b4f => generated 298 bytes in 284 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:18:15.163052 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7466b000-f507-49af-bbad-099d7a3e55b8 None admin] Authenticating user token {{(pid=479852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:18:15.327149 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b28310-0670-4c20-a73b-fbd37ec3cbee None admin] Validating token access rules against request {{(pid=479851) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:18:15.351687 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7466b000-f507-49af-bbad-099d7a3e55b8 None admin] Validating token access rules against request {{(pid=479852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:18:15.382836 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG dbcounter [-] [479852] Writing DB stats keystone:SELECT=100 {{(pid=479852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:18:15.410471 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee6c788-495d-4406-8064-3774decc85be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479851) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:18:15.411097 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee6c788-495d-4406-8064-3774decc85be None admin] REQUEST_METHOD: `GET` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:18:15.411383 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee6c788-495d-4406-8064-3774decc85be None admin] SCRIPT_NAME: `/identity` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:18:15.411665 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee6c788-495d-4406-8064-3774decc85be None admin] PATH_INFO: `/v3/projects/580eb2f23f9049b18bb38dce6f6f9b4f` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:18:15.416151 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ee6c788-495d-4406-8064-3774decc85be None admin] RBAC: Authorizing `identity:get_project(project_id=580eb2f23f9049b18bb38dce6f6f9b4f)` {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:18:15.417679 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ee6c788-495d-4406-8064-3774decc85be None admin] RBAC: Authorization granted {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:18:15.419419 dv-cinder-851351-1-smb devstack@keystone.service[479851]: [pid: 479851|app: 0|req: 63/133] 10.222.0.42 () {56 vars in 1186 bytes} [Thu Jul 28 09:18:15 2022] GET /identity/v3/projects/580eb2f23f9049b18bb38dce6f6f9b4f => generated 298 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:18:15.420176 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee6c788-495d-4406-8064-3774decc85be None admin] Authenticating user token {{(pid=479851) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:18:15.432438 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc7611e0-2f1d-4153-9527-bae3f5360121 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:18:15.433132 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7611e0-2f1d-4153-9527-bae3f5360121 None admin] REQUEST_METHOD: `GET` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:18:15.433419 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7611e0-2f1d-4153-9527-bae3f5360121 None admin] SCRIPT_NAME: `/identity` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:18:15.433695 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7611e0-2f1d-4153-9527-bae3f5360121 None admin] PATH_INFO: `/v3/projects/bbadce4d272544e6aea2ae9643be2628` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:18:15.434950 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc7611e0-2f1d-4153-9527-bae3f5360121 None admin] RBAC: Authorizing `identity:get_project(project_id=bbadce4d272544e6aea2ae9643be2628)` {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:18:15.436417 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc7611e0-2f1d-4153-9527-bae3f5360121 None admin] RBAC: Authorization granted {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:18:15.445007 dv-cinder-851351-1-smb devstack@keystone.service[479852]: [pid: 479852|app: 0|req: 71/134] 10.222.0.42 () {56 vars in 1186 bytes} [Thu Jul 28 09:18:15 2022] GET /identity/v3/projects/bbadce4d272544e6aea2ae9643be2628 => generated 312 bytes in 283 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:18:15.445894 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc7611e0-2f1d-4153-9527-bae3f5360121 None admin] Authenticating user token {{(pid=479852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:18:15.537287 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG dbcounter [-] [479851] Writing DB stats keystone:SELECT=100 {{(pid=479851) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:18:15.570015 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc7611e0-2f1d-4153-9527-bae3f5360121 None admin] Validating token access rules against request {{(pid=479852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:18:15.592580 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee6c788-495d-4406-8064-3774decc85be None admin] Validating token access rules against request {{(pid=479851) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:18:15.610255 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e48494-a560-4d69-86cd-f5c27459f0d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:18:15.610993 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e48494-a560-4d69-86cd-f5c27459f0d4 None admin] REQUEST_METHOD: `PUT` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:18:15.611279 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e48494-a560-4d69-86cd-f5c27459f0d4 None admin] SCRIPT_NAME: `/identity` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:18:15.611561 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e48494-a560-4d69-86cd-f5c27459f0d4 None admin] PATH_INFO: `/v3/projects/580eb2f23f9049b18bb38dce6f6f9b4f/users/73be2aaaa3a047f395fae06ed9308ab6/roles/acf1d2de5e5448beb6363dae3d154a02` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:18:15.616543 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9e48494-a560-4d69-86cd-f5c27459f0d4 None admin] RBAC: Authorizing `identity:create_grant(project_id=580eb2f23f9049b18bb38dce6f6f9b4f, user_id=73be2aaaa3a047f395fae06ed9308ab6, role_id=acf1d2de5e5448beb6363dae3d154a02)` {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:18:15.618086 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9e48494-a560-4d69-86cd-f5c27459f0d4 None admin] RBAC: Authorization granted {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:18:15.651983 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32e327d-4754-486b-b359-77cf4082f78d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479851) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:18:15.653433 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32e327d-4754-486b-b359-77cf4082f78d None admin] REQUEST_METHOD: `PUT` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:18:15.653784 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32e327d-4754-486b-b359-77cf4082f78d None admin] SCRIPT_NAME: `/identity` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:18:15.654080 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32e327d-4754-486b-b359-77cf4082f78d None admin] PATH_INFO: `/v3/projects/580eb2f23f9049b18bb38dce6f6f9b4f/users/c198f91a4ae84d2b9cc730a6e304c2be/roles/685084310b35477b9b2d0c7934d0f803` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:18:15.655701 dv-cinder-851351-1-smb devstack@keystone.service[479852]: [pid: 479852|app: 0|req: 72/135] 10.222.0.42 () {58 vars in 1439 bytes} [Thu Jul 28 09:18:15 2022] PUT /identity/v3/projects/580eb2f23f9049b18bb38dce6f6f9b4f/users/73be2aaaa3a047f395fae06ed9308ab6/roles/acf1d2de5e5448beb6363dae3d154a02 => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 09:18:15.656304 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e48494-a560-4d69-86cd-f5c27459f0d4 None admin] Authenticating user token {{(pid=479852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:18:15.658390 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d32e327d-4754-486b-b359-77cf4082f78d None admin] RBAC: Authorizing `identity:create_grant(project_id=580eb2f23f9049b18bb38dce6f6f9b4f, user_id=c198f91a4ae84d2b9cc730a6e304c2be, role_id=685084310b35477b9b2d0c7934d0f803)` {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:18:15.662575 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d32e327d-4754-486b-b359-77cf4082f78d None admin] RBAC: Authorization granted {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:18:15.692229 dv-cinder-851351-1-smb devstack@keystone.service[479851]: [pid: 479851|app: 0|req: 64/136] 10.222.0.42 () {58 vars in 1439 bytes} [Thu Jul 28 09:18:15 2022] PUT /identity/v3/projects/580eb2f23f9049b18bb38dce6f6f9b4f/users/c198f91a4ae84d2b9cc730a6e304c2be/roles/685084310b35477b9b2d0c7934d0f803 => generated 0 bytes in 272 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 09:18:15.693651 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54fb472b-2852-4f59-82ea-2e7106f1d27c None None] REQUEST_METHOD: `GET` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:18:15.693958 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54fb472b-2852-4f59-82ea-2e7106f1d27c None None] SCRIPT_NAME: `/identity` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:18:15.694325 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54fb472b-2852-4f59-82ea-2e7106f1d27c None None] PATH_INFO: `/` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:18:15.705258 dv-cinder-851351-1-smb devstack@keystone.service[479851]: [pid: 479851|app: 0|req: 65/137] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 09:18:15 2022] GET /identity => generated 270 bytes in 12 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 09:18:15.711106 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2bc0bae-7d0d-41f3-81c4-89c420a2c406 None None] REQUEST_METHOD: `POST` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:18:15.711410 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2bc0bae-7d0d-41f3-81c4-89c420a2c406 None None] SCRIPT_NAME: `/identity` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:18:15.711705 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2bc0bae-7d0d-41f3-81c4-89c420a2c406 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:18:15.731334 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG dbcounter [-] [479852] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=479852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:18:15.742590 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.auth.core [None req-f2bc0bae-7d0d-41f3-81c4-89c420a2c406 None None] MFA Rules not processed for user `c198f91a4ae84d2b9cc730a6e304c2be`. Rule list: `[]` (Enabled: `True`). {{(pid=479851) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 09:18:15.743939 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.fernet_utils [None req-f2bc0bae-7d0d-41f3-81c4-89c420a2c406 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=479851) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 09:18:15.859576 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e48494-a560-4d69-86cd-f5c27459f0d4 None admin] Validating token access rules against request {{(pid=479852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:18:15.860601 dv-cinder-851351-1-smb devstack@keystone.service[479851]: [pid: 479851|app: 0|req: 66/138] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 09:18:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 28 09:18:15.863251 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa04d84-a2d0-4e9a-908d-defd0df3fda1 None None] REQUEST_METHOD: `GET` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:18:15.863251 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa04d84-a2d0-4e9a-908d-defd0df3fda1 None None] SCRIPT_NAME: `/identity` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:18:15.863251 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa04d84-a2d0-4e9a-908d-defd0df3fda1 None None] PATH_INFO: `/` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:18:15.863992 dv-cinder-851351-1-smb devstack@keystone.service[479851]: [pid: 479851|app: 0|req: 67/139] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 09:18:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 09:18:15.869803 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a805519-e415-460a-a90f-c12c549caa23 None None] REQUEST_METHOD: `POST` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:18:15.870088 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a805519-e415-460a-a90f-c12c549caa23 None None] SCRIPT_NAME: `/identity` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:18:15.870454 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a805519-e415-460a-a90f-c12c549caa23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:18:15.890744 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.auth.core [None req-9a805519-e415-460a-a90f-c12c549caa23 None None] MFA Rules not processed for user `c198f91a4ae84d2b9cc730a6e304c2be`. Rule list: `[]` (Enabled: `True`). {{(pid=479851) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 09:18:15.891652 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.fernet_utils [None req-9a805519-e415-460a-a90f-c12c549caa23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=479851) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 09:18:15.908024 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904275ac-a5bd-4b7f-ab58-e8cb6ec0e14e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:18:15.909904 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904275ac-a5bd-4b7f-ab58-e8cb6ec0e14e None admin] REQUEST_METHOD: `PUT` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:18:15.910536 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904275ac-a5bd-4b7f-ab58-e8cb6ec0e14e None admin] SCRIPT_NAME: `/identity` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:18:15.911038 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904275ac-a5bd-4b7f-ab58-e8cb6ec0e14e None admin] PATH_INFO: `/v3/projects/bbadce4d272544e6aea2ae9643be2628/users/73be2aaaa3a047f395fae06ed9308ab6/roles/900fb424e172461d93a0db59afb0a12b` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:18:15.914308 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-904275ac-a5bd-4b7f-ab58-e8cb6ec0e14e None admin] RBAC: Authorizing `identity:create_grant(project_id=bbadce4d272544e6aea2ae9643be2628, user_id=73be2aaaa3a047f395fae06ed9308ab6, role_id=900fb424e172461d93a0db59afb0a12b)` {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:18:15.916224 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-904275ac-a5bd-4b7f-ab58-e8cb6ec0e14e None admin] RBAC: Authorization granted {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:18:15.936194 dv-cinder-851351-1-smb devstack@keystone.service[479852]: [pid: 479852|app: 0|req: 73/140] 10.222.0.42 () {58 vars in 1439 bytes} [Thu Jul 28 09:18:15 2022] PUT /identity/v3/projects/bbadce4d272544e6aea2ae9643be2628/users/73be2aaaa3a047f395fae06ed9308ab6/roles/900fb424e172461d93a0db59afb0a12b => generated 0 bytes in 280 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 09:18:15.938256 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904275ac-a5bd-4b7f-ab58-e8cb6ec0e14e None admin] Authenticating user token {{(pid=479852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:18:15.945970 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG dbcounter [-] [479851] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=479851) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:18:15.993719 dv-cinder-851351-1-smb devstack@keystone.service[479851]: [pid: 479851|app: 0|req: 68/141] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 09:18:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 09:18:16.031352 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a805519-e415-460a-a90f-c12c549caa23 None None] Authenticating user token {{(pid=479851) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:18:16.072786 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG dbcounter [-] [479852] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=479852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:18:16.078293 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904275ac-a5bd-4b7f-ab58-e8cb6ec0e14e None admin] Validating token access rules against request {{(pid=479852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:18:16.134881 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36bebfb9-2095-4571-a850-bf909f0f5dbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:18:16.135594 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36bebfb9-2095-4571-a850-bf909f0f5dbc None admin] REQUEST_METHOD: `GET` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:18:16.135842 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36bebfb9-2095-4571-a850-bf909f0f5dbc None admin] SCRIPT_NAME: `/identity` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:18:16.136128 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36bebfb9-2095-4571-a850-bf909f0f5dbc None admin] PATH_INFO: `/v3/roles/reader` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:18:16.162763 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36bebfb9-2095-4571-a850-bf909f0f5dbc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 09:18:16.168591 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application [None req-36bebfb9-2095-4571-a850-bf909f0f5dbc None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 28 09:18:16.168591 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 09:18:16.168591 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 09:18:16.168591 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 09:18:16.168591 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 09:18:16.168591 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 09:18:16.168591 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 09:18:16.168591 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 09:18:16.168591 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 09:18:16.168591 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 09:18:16.168591 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 09:18:16.168591 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 09:18:16.168591 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 09:18:16.168591 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 09:18:16.168591 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 09:18:16.168591 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 09:18:16.169679 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 09:18:16.169679 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 09:18:16.169679 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 09:18:16.169679 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 09:18:16.169679 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 09:18:16.169679 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 09:18:16.169679 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 09:18:16.169679 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 09:18:16.169679 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 09:18:16.169679 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 09:18:16.169679 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 09:18:16.169679 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application with Lock( Jul 28 09:18:16.169679 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 09:18:16.169679 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self._enter() Jul 28 09:18:16.169679 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 09:18:16.169679 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 09:18:16.170615 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 09:18:16.170615 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self.creator() Jul 28 09:18:16.170615 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 09:18:16.170615 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application created_value = creator( Jul 28 09:18:16.170615 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 09:18:16.170615 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 09:18:16.170615 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 09:18:16.170615 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 09:18:16.170615 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 09:18:16.170615 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 09:18:16.170615 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 28 09:18:16.170615 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application Jul 28 09:18:16.171331 dv-cinder-851351-1-smb devstack@keystone.service[479852]: [pid: 479852|app: 0|req: 74/142] 10.222.0.42 () {56 vars in 1099 bytes} [Thu Jul 28 09:18:15 2022] GET /identity/v3/roles/reader => generated 84 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 09:18:16.179324 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36bebfb9-2095-4571-a850-bf909f0f5dbc None admin] Authenticating user token {{(pid=479852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:18:16.204518 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a805519-e415-460a-a90f-c12c549caa23 None None] Validating token access rules against request {{(pid=479851) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:18:16.288839 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831cd97e-82ae-4610-adf6-251e46194bef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479851) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:18:16.289540 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831cd97e-82ae-4610-adf6-251e46194bef None admin] REQUEST_METHOD: `GET` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:18:16.289833 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831cd97e-82ae-4610-adf6-251e46194bef None admin] SCRIPT_NAME: `/identity` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:18:16.290120 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831cd97e-82ae-4610-adf6-251e46194bef None admin] PATH_INFO: `/v3/domains/default` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:18:16.292141 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-831cd97e-82ae-4610-adf6-251e46194bef None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:18:16.293697 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-831cd97e-82ae-4610-adf6-251e46194bef None admin] RBAC: Authorization granted {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:18:16.295411 dv-cinder-851351-1-smb devstack@keystone.service[479851]: [pid: 479851|app: 0|req: 69/143] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 09:18:16 2022] GET /identity/v3/domains/default => generated 199 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 09:18:16.302668 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831cd97e-82ae-4610-adf6-251e46194bef None admin] Authenticating user token {{(pid=479851) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:18:16.368271 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36bebfb9-2095-4571-a850-bf909f0f5dbc None admin] Validating token access rules against request {{(pid=479852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:18:16.400872 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG dbcounter [-] [479851] Writing DB stats keystone:SELECT=100 {{(pid=479851) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:18:16.421357 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f52b01-0ae3-4cb7-8bd4-d834a9fad743 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:18:16.422386 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f52b01-0ae3-4cb7-8bd4-d834a9fad743 None admin] REQUEST_METHOD: `GET` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:18:16.422899 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f52b01-0ae3-4cb7-8bd4-d834a9fad743 None admin] SCRIPT_NAME: `/identity` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:18:16.423410 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f52b01-0ae3-4cb7-8bd4-d834a9fad743 None admin] PATH_INFO: `/v3/roles` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:18:16.426858 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36f52b01-0ae3-4cb7-8bd4-d834a9fad743 None admin] RBAC: Adding query filter params (name=reader) {{(pid=479852) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 09:18:16.427448 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36f52b01-0ae3-4cb7-8bd4-d834a9fad743 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:18:16.429317 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36f52b01-0ae3-4cb7-8bd4-d834a9fad743 None admin] RBAC: Authorization granted {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:18:16.440826 dv-cinder-851351-1-smb devstack@keystone.service[479852]: [pid: 479852|app: 0|req: 75/144] 10.222.0.42 () {56 vars in 1101 bytes} [Thu Jul 28 09:18:16 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:18:16.447042 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f52b01-0ae3-4cb7-8bd4-d834a9fad743 None admin] Authenticating user token {{(pid=479852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:18:16.481024 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG dbcounter [-] [479852] Writing DB stats keystone:SELECT=100 {{(pid=479852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:18:16.528118 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831cd97e-82ae-4610-adf6-251e46194bef None admin] Validating token access rules against request {{(pid=479851) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:18:16.570697 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f52b01-0ae3-4cb7-8bd4-d834a9fad743 None admin] Validating token access rules against request {{(pid=479852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:18:16.604470 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10838395-3499-4315-a21a-0b467ab03f16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479851) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:18:16.605039 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10838395-3499-4315-a21a-0b467ab03f16 None admin] REQUEST_METHOD: `POST` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:18:16.605330 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10838395-3499-4315-a21a-0b467ab03f16 None admin] SCRIPT_NAME: `/identity` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:18:16.605609 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10838395-3499-4315-a21a-0b467ab03f16 None admin] PATH_INFO: `/v3/users` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:18:16.606344 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10838395-3499-4315-a21a-0b467ab03f16 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:18:16.607819 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10838395-3499-4315-a21a-0b467ab03f16 None admin] RBAC: Authorization granted {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:18:16.610691 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65aacb56-8f36-403b-8265-c4ae8682ab8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:18:16.611607 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65aacb56-8f36-403b-8265-c4ae8682ab8e None admin] REQUEST_METHOD: `GET` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:18:16.612115 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65aacb56-8f36-403b-8265-c4ae8682ab8e None admin] SCRIPT_NAME: `/identity` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:18:16.612591 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65aacb56-8f36-403b-8265-c4ae8682ab8e None admin] PATH_INFO: `/v3/users/2046089722a34a57bc743a56cc5e395a` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:18:16.614055 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65aacb56-8f36-403b-8265-c4ae8682ab8e None admin] RBAC: Authorizing `identity:get_user(user_id=2046089722a34a57bc743a56cc5e395a)` {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:18:16.615723 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65aacb56-8f36-403b-8265-c4ae8682ab8e None admin] RBAC: Authorization granted {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:18:16.617763 dv-cinder-851351-1-smb devstack@keystone.service[479852]: [pid: 479852|app: 0|req: 76/145] 10.222.0.42 () {56 vars in 1177 bytes} [Thu Jul 28 09:18:16 2022] GET /identity/v3/users/2046089722a34a57bc743a56cc5e395a => generated 289 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 09:18:16.623633 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65aacb56-8f36-403b-8265-c4ae8682ab8e None admin] Authenticating user token {{(pid=479852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:18:16.649523 dv-cinder-851351-1-smb devstack@keystone.service[479851]: [pid: 479851|app: 0|req: 70/146] 10.222.0.42 () {60 vars in 1132 bytes} [Thu Jul 28 09:18:16 2022] POST /identity/v3/users => generated 283 bytes in 347 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 09:18:16.785383 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG dbcounter [-] [479852] Writing DB stats keystone:SELECT=100 {{(pid=479852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:18:16.797059 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65aacb56-8f36-403b-8265-c4ae8682ab8e None admin] Validating token access rules against request {{(pid=479852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:18:16.835534 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697e9d53-73be-4ab7-ad21-a2987240d294 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:18:16.836638 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697e9d53-73be-4ab7-ad21-a2987240d294 None admin] REQUEST_METHOD: `GET` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:18:16.837187 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697e9d53-73be-4ab7-ad21-a2987240d294 None admin] SCRIPT_NAME: `/identity` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:18:16.837676 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697e9d53-73be-4ab7-ad21-a2987240d294 None admin] PATH_INFO: `/v3/projects/580eb2f23f9049b18bb38dce6f6f9b4f` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:18:16.839189 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-697e9d53-73be-4ab7-ad21-a2987240d294 None admin] RBAC: Authorizing `identity:get_project(project_id=580eb2f23f9049b18bb38dce6f6f9b4f)` {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:18:16.840963 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-697e9d53-73be-4ab7-ad21-a2987240d294 None admin] RBAC: Authorization granted {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:18:16.843551 dv-cinder-851351-1-smb devstack@keystone.service[479852]: [pid: 479852|app: 0|req: 77/147] 10.222.0.42 () {56 vars in 1186 bytes} [Thu Jul 28 09:18:16 2022] GET /identity/v3/projects/580eb2f23f9049b18bb38dce6f6f9b4f => generated 298 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:18:16.849171 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10838395-3499-4315-a21a-0b467ab03f16 None admin] Authenticating user token {{(pid=479851) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:18:16.958805 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG dbcounter [-] [479851] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=479851) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:18:16.963343 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10838395-3499-4315-a21a-0b467ab03f16 None admin] Validating token access rules against request {{(pid=479851) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:18:16.999874 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b8e4504-6bee-44ca-96d3-815ee045769c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479851) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:18:17.000977 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8e4504-6bee-44ca-96d3-815ee045769c None admin] REQUEST_METHOD: `PUT` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:18:17.001494 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8e4504-6bee-44ca-96d3-815ee045769c None admin] SCRIPT_NAME: `/identity` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:18:17.001976 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8e4504-6bee-44ca-96d3-815ee045769c None admin] PATH_INFO: `/v3/projects/580eb2f23f9049b18bb38dce6f6f9b4f/users/2046089722a34a57bc743a56cc5e395a/roles/73525379110b4a99850473e0e9f217f1` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:18:17.004387 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b8e4504-6bee-44ca-96d3-815ee045769c None admin] RBAC: Authorizing `identity:create_grant(project_id=580eb2f23f9049b18bb38dce6f6f9b4f, user_id=2046089722a34a57bc743a56cc5e395a, role_id=73525379110b4a99850473e0e9f217f1)` {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:18:17.006219 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b8e4504-6bee-44ca-96d3-815ee045769c None admin] RBAC: Authorization granted {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:18:17.024033 dv-cinder-851351-1-smb devstack@keystone.service[479851]: [pid: 479851|app: 0|req: 71/148] 10.222.0.42 () {58 vars in 1439 bytes} [Thu Jul 28 09:18:16 2022] PUT /identity/v3/projects/580eb2f23f9049b18bb38dce6f6f9b4f/users/2046089722a34a57bc743a56cc5e395a/roles/73525379110b4a99850473e0e9f217f1 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 09:18:17.562033 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ebe76a-254f-47db-bc4e-27b3bf23abbc None None] REQUEST_METHOD: `GET` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:18:17.563125 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ebe76a-254f-47db-bc4e-27b3bf23abbc None None] SCRIPT_NAME: `/identity` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:18:17.563643 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ebe76a-254f-47db-bc4e-27b3bf23abbc None None] PATH_INFO: `/` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:18:17.565387 dv-cinder-851351-1-smb devstack@keystone.service[479852]: [pid: 479852|app: 0|req: 78/149] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 09:18:17 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 09:18:17.572963 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d8a0b6-9d39-45c5-8b0d-cc99435174f3 None None] REQUEST_METHOD: `POST` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:18:17.573915 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d8a0b6-9d39-45c5-8b0d-cc99435174f3 None None] SCRIPT_NAME: `/identity` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:18:17.574420 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d8a0b6-9d39-45c5-8b0d-cc99435174f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:18:17.597967 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.auth.core [None req-53d8a0b6-9d39-45c5-8b0d-cc99435174f3 None None] MFA Rules not processed for user `c198f91a4ae84d2b9cc730a6e304c2be`. Rule list: `[]` (Enabled: `True`). {{(pid=479851) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 09:18:17.599596 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.fernet_utils [None req-53d8a0b6-9d39-45c5-8b0d-cc99435174f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=479851) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 09:18:17.687589 dv-cinder-851351-1-smb devstack@keystone.service[479851]: [pid: 479851|app: 0|req: 72/150] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 09:18:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 09:18:17.731148 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ebe76a-254f-47db-bc4e-27b3bf23abbc None None] Authenticating user token {{(pid=479852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:18:17.857454 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ebe76a-254f-47db-bc4e-27b3bf23abbc None None] Validating token access rules against request {{(pid=479852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:18:17.904280 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607549d5-3fdb-41c1-be29-4ade61b8220a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:18:17.905429 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607549d5-3fdb-41c1-be29-4ade61b8220a None admin] REQUEST_METHOD: `GET` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:18:17.905940 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607549d5-3fdb-41c1-be29-4ade61b8220a None admin] SCRIPT_NAME: `/identity` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:18:17.906416 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607549d5-3fdb-41c1-be29-4ade61b8220a None admin] PATH_INFO: `/v3/roles/member` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:18:17.920609 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-607549d5-3fdb-41c1-be29-4ade61b8220a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 09:18:17.927479 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application [None req-607549d5-3fdb-41c1-be29-4ade61b8220a None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 28 09:18:17.927479 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 09:18:17.927479 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 09:18:17.927479 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 09:18:17.927479 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 09:18:17.927479 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 09:18:17.927479 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 09:18:17.927479 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 09:18:17.927479 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 09:18:17.927479 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 09:18:17.927479 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 09:18:17.927479 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 09:18:17.927479 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 09:18:17.927479 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 09:18:17.927479 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 09:18:17.927479 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 09:18:17.928631 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 09:18:17.928631 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 09:18:17.928631 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 09:18:17.928631 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 09:18:17.928631 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 09:18:17.928631 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 09:18:17.928631 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 09:18:17.928631 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 09:18:17.928631 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 09:18:17.928631 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 09:18:17.928631 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 09:18:17.928631 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application with Lock( Jul 28 09:18:17.928631 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 09:18:17.928631 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self._enter() Jul 28 09:18:17.928631 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 09:18:17.928631 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 09:18:17.929622 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 09:18:17.929622 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self.creator() Jul 28 09:18:17.929622 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 09:18:17.929622 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application created_value = creator( Jul 28 09:18:17.929622 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 09:18:17.929622 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 09:18:17.929622 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 09:18:17.929622 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 09:18:17.929622 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 09:18:17.929622 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 09:18:17.929622 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 28 09:18:17.929622 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application Jul 28 09:18:17.936786 dv-cinder-851351-1-smb devstack@keystone.service[479852]: [pid: 479852|app: 0|req: 79/151] 10.222.0.42 () {56 vars in 1099 bytes} [Thu Jul 28 09:18:17 2022] GET /identity/v3/roles/member => generated 84 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 09:18:17.941914 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d8a0b6-9d39-45c5-8b0d-cc99435174f3 None None] Authenticating user token {{(pid=479851) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:18:18.062965 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG dbcounter [-] [479851] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=479851) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:18:18.082555 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d8a0b6-9d39-45c5-8b0d-cc99435174f3 None None] Validating token access rules against request {{(pid=479851) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:18:18.125890 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d59eb7-92ea-42ff-b06a-836ed2e60c76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479851) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:18:18.126550 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d59eb7-92ea-42ff-b06a-836ed2e60c76 None admin] REQUEST_METHOD: `GET` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:18:18.126862 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d59eb7-92ea-42ff-b06a-836ed2e60c76 None admin] SCRIPT_NAME: `/identity` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:18:18.127121 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d59eb7-92ea-42ff-b06a-836ed2e60c76 None admin] PATH_INFO: `/v3/roles` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:18:18.127853 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d59eb7-92ea-42ff-b06a-836ed2e60c76 None admin] RBAC: Adding query filter params (name=member) {{(pid=479851) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 09:18:18.128301 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d59eb7-92ea-42ff-b06a-836ed2e60c76 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:18:18.129773 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d59eb7-92ea-42ff-b06a-836ed2e60c76 None admin] RBAC: Authorization granted {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:18:18.139369 dv-cinder-851351-1-smb devstack@keystone.service[479851]: [pid: 479851|app: 0|req: 73/152] 10.222.0.42 () {56 vars in 1101 bytes} [Thu Jul 28 09:18:17 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:18:18.149876 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607549d5-3fdb-41c1-be29-4ade61b8220a None admin] Authenticating user token {{(pid=479852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:18:18.180694 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG dbcounter [-] [479852] Writing DB stats keystone:SELECT=100 {{(pid=479852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:18:18.282782 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607549d5-3fdb-41c1-be29-4ade61b8220a None admin] Validating token access rules against request {{(pid=479852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:18:18.326330 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77650c6d-b347-495d-9b4c-c8cdc826defa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:18:18.327377 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77650c6d-b347-495d-9b4c-c8cdc826defa None admin] REQUEST_METHOD: `GET` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:18:18.327888 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77650c6d-b347-495d-9b4c-c8cdc826defa None admin] SCRIPT_NAME: `/identity` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:18:18.328377 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77650c6d-b347-495d-9b4c-c8cdc826defa None admin] PATH_INFO: `/v3/users/73be2aaaa3a047f395fae06ed9308ab6` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:18:18.329862 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77650c6d-b347-495d-9b4c-c8cdc826defa None admin] RBAC: Authorizing `identity:get_user(user_id=73be2aaaa3a047f395fae06ed9308ab6)` {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:18:18.331619 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77650c6d-b347-495d-9b4c-c8cdc826defa None admin] RBAC: Authorization granted {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:18:18.335008 dv-cinder-851351-1-smb devstack@keystone.service[479852]: [pid: 479852|app: 0|req: 80/153] 10.222.0.42 () {56 vars in 1177 bytes} [Thu Jul 28 09:18:18 2022] GET /identity/v3/users/73be2aaaa3a047f395fae06ed9308ab6 => generated 275 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:18:18.340141 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d59eb7-92ea-42ff-b06a-836ed2e60c76 None admin] Authenticating user token {{(pid=479851) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:18:18.476570 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d59eb7-92ea-42ff-b06a-836ed2e60c76 None admin] Validating token access rules against request {{(pid=479851) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:18:18.524523 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e897b2d9-315a-4975-b97d-304a7449b7ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479851) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:18:18.525216 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e897b2d9-315a-4975-b97d-304a7449b7ef None admin] REQUEST_METHOD: `GET` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:18:18.525500 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e897b2d9-315a-4975-b97d-304a7449b7ef None admin] SCRIPT_NAME: `/identity` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:18:18.525782 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e897b2d9-315a-4975-b97d-304a7449b7ef None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:18:18.551248 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG dbcounter [-] [479851] Writing DB stats keystone:SELECT=100 {{(pid=479851) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:18:18.610453 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e897b2d9-315a-4975-b97d-304a7449b7ef None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:18:18.611981 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e897b2d9-315a-4975-b97d-304a7449b7ef None admin] RBAC: Authorization granted {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:18:18.672761 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533eda11-6f5b-44f8-98f6-acdb499aa016 None None] REQUEST_METHOD: `GET` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:18:18.675266 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533eda11-6f5b-44f8-98f6-acdb499aa016 None None] SCRIPT_NAME: `/identity` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:18:18.675266 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533eda11-6f5b-44f8-98f6-acdb499aa016 None None] PATH_INFO: `/` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:18:18.679401 dv-cinder-851351-1-smb devstack@keystone.service[479852]: [pid: 479852|app: 0|req: 81/154] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 09:18:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 09:18:18.682065 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a04d399-d33e-46b4-b562-347e95cdb32e None None] REQUEST_METHOD: `POST` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:18:18.682549 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a04d399-d33e-46b4-b562-347e95cdb32e None None] SCRIPT_NAME: `/identity` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:18:18.683014 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a04d399-d33e-46b4-b562-347e95cdb32e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:18:18.729760 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.auth.core [None req-7a04d399-d33e-46b4-b562-347e95cdb32e None None] MFA Rules not processed for user `c198f91a4ae84d2b9cc730a6e304c2be`. Rule list: `[]` (Enabled: `True`). {{(pid=479852) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 09:18:18.731309 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.fernet_utils [None req-7a04d399-d33e-46b4-b562-347e95cdb32e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=479852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 09:18:18.743801 dv-cinder-851351-1-smb devstack@keystone.service[479851]: [pid: 479851|app: 0|req: 74/155] 10.222.0.42 () {58 vars in 1282 bytes} [Thu Jul 28 09:18:18 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 404 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 28 09:18:18.760722 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e897b2d9-315a-4975-b97d-304a7449b7ef None admin] Authenticating user token {{(pid=479851) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:18:18.854017 dv-cinder-851351-1-smb devstack@keystone.service[479852]: [pid: 479852|app: 0|req: 82/156] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 09:18:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 28 09:18:18.857559 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG dbcounter [-] [479851] Writing DB stats keystone:SELECT=100 {{(pid=479851) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:18:18.928958 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a04d399-d33e-46b4-b562-347e95cdb32e None None] Authenticating user token {{(pid=479852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:18:18.956820 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e897b2d9-315a-4975-b97d-304a7449b7ef None admin] Validating token access rules against request {{(pid=479851) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:18:18.968757 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG dbcounter [-] [479852] Writing DB stats keystone:SELECT=100 {{(pid=479852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:18:19.052955 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d7a191e-98ac-4f22-8522-2ad08c3301b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479851) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:18:19.053865 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7a191e-98ac-4f22-8522-2ad08c3301b3 None admin] REQUEST_METHOD: `GET` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:18:19.054669 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7a191e-98ac-4f22-8522-2ad08c3301b3 None admin] SCRIPT_NAME: `/identity` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:18:19.054669 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7a191e-98ac-4f22-8522-2ad08c3301b3 None admin] PATH_INFO: `/v3/projects/580eb2f23f9049b18bb38dce6f6f9b4f` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:18:19.055631 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d7a191e-98ac-4f22-8522-2ad08c3301b3 None admin] RBAC: Authorizing `identity:get_project(project_id=580eb2f23f9049b18bb38dce6f6f9b4f)` {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:18:19.063372 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d7a191e-98ac-4f22-8522-2ad08c3301b3 None admin] RBAC: Authorization granted {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:18:19.069035 dv-cinder-851351-1-smb devstack@keystone.service[479851]: [pid: 479851|app: 0|req: 75/157] 10.222.0.42 () {56 vars in 1186 bytes} [Thu Jul 28 09:18:18 2022] GET /identity/v3/projects/580eb2f23f9049b18bb38dce6f6f9b4f => generated 298 bytes in 312 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 09:18:19.077629 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d7a191e-98ac-4f22-8522-2ad08c3301b3 None admin] Authenticating user token {{(pid=479851) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:18:19.137943 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a04d399-d33e-46b4-b562-347e95cdb32e None None] Validating token access rules against request {{(pid=479852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:18:19.219137 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c74957ac-3a4d-4186-a978-2abcab09b18c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:18:19.219975 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74957ac-3a4d-4186-a978-2abcab09b18c None admin] REQUEST_METHOD: `GET` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:18:19.220401 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74957ac-3a4d-4186-a978-2abcab09b18c None admin] SCRIPT_NAME: `/identity` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:18:19.220701 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74957ac-3a4d-4186-a978-2abcab09b18c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:18:19.252475 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c74957ac-3a4d-4186-a978-2abcab09b18c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 09:18:19.257726 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application [None req-c74957ac-3a4d-4186-a978-2abcab09b18c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 09:18:19.257726 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 09:18:19.257726 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 09:18:19.257726 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 09:18:19.257726 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 09:18:19.257726 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 09:18:19.257726 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 09:18:19.257726 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 09:18:19.257726 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 09:18:19.257726 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 09:18:19.257726 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 09:18:19.257726 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 09:18:19.257726 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 09:18:19.257726 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 09:18:19.257726 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 09:18:19.257726 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 09:18:19.258815 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 09:18:19.258815 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 09:18:19.258815 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 09:18:19.258815 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 09:18:19.258815 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 09:18:19.258815 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 09:18:19.258815 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 09:18:19.258815 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 09:18:19.258815 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 09:18:19.258815 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 09:18:19.258815 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 09:18:19.258815 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application with Lock( Jul 28 09:18:19.258815 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 09:18:19.258815 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self._enter() Jul 28 09:18:19.258815 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 09:18:19.258815 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 09:18:19.259784 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 09:18:19.259784 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self.creator() Jul 28 09:18:19.259784 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 09:18:19.259784 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application created_value = creator( Jul 28 09:18:19.259784 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 09:18:19.259784 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 09:18:19.259784 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 09:18:19.259784 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 09:18:19.259784 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 09:18:19.259784 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 09:18:19.259784 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 09:18:19.259784 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application Jul 28 09:18:19.259784 dv-cinder-851351-1-smb devstack@keystone.service[479852]: [pid: 479852|app: 0|req: 83/158] 10.222.0.42 () {56 vars in 1096 bytes} [Thu Jul 28 09:18:18 2022] GET /identity/v3/roles/admin => generated 83 bytes in 331 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 09:18:19.266915 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6759fd65-fee7-420d-b299-16c3ef4c142c None None] REQUEST_METHOD: `GET` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:18:19.267212 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6759fd65-fee7-420d-b299-16c3ef4c142c None None] SCRIPT_NAME: `/identity` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:18:19.267709 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6759fd65-fee7-420d-b299-16c3ef4c142c None None] PATH_INFO: `/` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:18:19.269181 dv-cinder-851351-1-smb devstack@keystone.service[479852]: [pid: 479852|app: 0|req: 84/159] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 09:18:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 09:18:19.269868 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6759fd65-fee7-420d-b299-16c3ef4c142c None None] Authenticating user token {{(pid=479852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:18:19.340977 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d7a191e-98ac-4f22-8522-2ad08c3301b3 None admin] Validating token access rules against request {{(pid=479851) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:18:19.381905 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG dbcounter [-] [479851] Writing DB stats keystone:SELECT=100 {{(pid=479851) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:18:19.422501 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de7f1ca-3d32-417e-bac6-e38251929583 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479851) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:18:19.423059 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de7f1ca-3d32-417e-bac6-e38251929583 None admin] REQUEST_METHOD: `GET` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:18:19.423344 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de7f1ca-3d32-417e-bac6-e38251929583 None admin] SCRIPT_NAME: `/identity` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:18:19.423623 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de7f1ca-3d32-417e-bac6-e38251929583 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:18:19.424437 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de7f1ca-3d32-417e-bac6-e38251929583 None admin] RBAC: Adding query filter params (role.id=900fb424e172461d93a0db59afb0a12b, scope.project.id=580eb2f23f9049b18bb38dce6f6f9b4f, user.id=73be2aaaa3a047f395fae06ed9308ab6) {{(pid=479851) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 09:18:19.424774 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de7f1ca-3d32-417e-bac6-e38251929583 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:18:19.426243 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de7f1ca-3d32-417e-bac6-e38251929583 None admin] RBAC: Authorization granted {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:18:19.439740 dv-cinder-851351-1-smb devstack@keystone.service[479851]: [pid: 479851|app: 0|req: 76/160] 10.222.0.42 () {56 vars in 1374 bytes} [Thu Jul 28 09:18:19 2022] GET /identity/v3/role_assignments?user.id=73be2aaaa3a047f395fae06ed9308ab6&scope.project.id=580eb2f23f9049b18bb38dce6f6f9b4f&role.id=900fb424e172461d93a0db59afb0a12b => generated 608 bytes in 363 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 09:18:19.440999 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596d1c18-a3cc-47fb-a2b2-87864d9fa082 None None] REQUEST_METHOD: `POST` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:18:19.441388 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596d1c18-a3cc-47fb-a2b2-87864d9fa082 None None] SCRIPT_NAME: `/identity` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:18:19.441566 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596d1c18-a3cc-47fb-a2b2-87864d9fa082 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:18:19.470266 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.auth.core [None req-596d1c18-a3cc-47fb-a2b2-87864d9fa082 None None] MFA Rules not processed for user `c198f91a4ae84d2b9cc730a6e304c2be`. Rule list: `[]` (Enabled: `True`). {{(pid=479851) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 09:18:19.471482 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.fernet_utils [None req-596d1c18-a3cc-47fb-a2b2-87864d9fa082 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=479851) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 09:18:19.481073 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG dbcounter [-] [479852] Writing DB stats keystone:SELECT=100 {{(pid=479852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:18:19.540821 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6759fd65-fee7-420d-b299-16c3ef4c142c None None] Validating token access rules against request {{(pid=479852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:18:19.627014 dv-cinder-851351-1-smb devstack@keystone.service[479851]: [pid: 479851|app: 0|req: 77/161] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 09:18:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 09:18:19.629317 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e075bd9-6a1e-4bcf-a1ab-a4b6c652f703 None None] REQUEST_METHOD: `GET` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:18:19.629891 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e075bd9-6a1e-4bcf-a1ab-a4b6c652f703 None None] SCRIPT_NAME: `/identity` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:18:19.630383 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e075bd9-6a1e-4bcf-a1ab-a4b6c652f703 None None] PATH_INFO: `/` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:18:19.631967 dv-cinder-851351-1-smb devstack@keystone.service[479851]: [pid: 479851|app: 0|req: 78/162] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 09:18:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 09:18:19.638963 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6a91ff-cb2f-4f91-bb5e-2bb56c3c5d56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:18:19.639589 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0348c09f-235a-4d8e-ab84-afd5f7996f17 None None] REQUEST_METHOD: `POST` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:18:19.639730 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6a91ff-cb2f-4f91-bb5e-2bb56c3c5d56 None admin] REQUEST_METHOD: `GET` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:18:19.639919 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6a91ff-cb2f-4f91-bb5e-2bb56c3c5d56 None admin] SCRIPT_NAME: `/identity` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:18:19.640175 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6a91ff-cb2f-4f91-bb5e-2bb56c3c5d56 None admin] PATH_INFO: `/v3/roles` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:18:19.640614 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0348c09f-235a-4d8e-ab84-afd5f7996f17 None None] SCRIPT_NAME: `/identity` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:18:19.640972 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a6a91ff-cb2f-4f91-bb5e-2bb56c3c5d56 None admin] RBAC: Adding query filter params (name=admin) {{(pid=479852) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 09:18:19.641283 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a6a91ff-cb2f-4f91-bb5e-2bb56c3c5d56 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:18:19.641571 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0348c09f-235a-4d8e-ab84-afd5f7996f17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:18:19.642722 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a6a91ff-cb2f-4f91-bb5e-2bb56c3c5d56 None admin] RBAC: Authorization granted {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:18:19.671229 dv-cinder-851351-1-smb devstack@keystone.service[479852]: [pid: 479852|app: 0|req: 85/163] 10.222.0.42 () {56 vars in 1099 bytes} [Thu Jul 28 09:18:19 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 401 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:18:19.672043 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6a91ff-cb2f-4f91-bb5e-2bb56c3c5d56 None admin] Authenticating user token {{(pid=479852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:18:19.677151 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.auth.core [None req-0348c09f-235a-4d8e-ab84-afd5f7996f17 None None] MFA Rules not processed for user `c198f91a4ae84d2b9cc730a6e304c2be`. Rule list: `[]` (Enabled: `True`). {{(pid=479851) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 09:18:19.679931 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.fernet_utils [None req-0348c09f-235a-4d8e-ab84-afd5f7996f17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=479851) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 09:18:19.840868 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6a91ff-cb2f-4f91-bb5e-2bb56c3c5d56 None admin] Validating token access rules against request {{(pid=479852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:18:19.875248 dv-cinder-851351-1-smb devstack@keystone.service[479851]: [pid: 479851|app: 0|req: 79/164] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 09:18:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 237 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 28 09:18:19.876548 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0348c09f-235a-4d8e-ab84-afd5f7996f17 None None] Authenticating user token {{(pid=479851) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:18:19.908233 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd056ae-a170-4dcc-be6d-6ec230a37bc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:18:19.909319 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd056ae-a170-4dcc-be6d-6ec230a37bc4 None admin] REQUEST_METHOD: `GET` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:18:19.909818 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd056ae-a170-4dcc-be6d-6ec230a37bc4 None admin] SCRIPT_NAME: `/identity` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:18:19.910312 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd056ae-a170-4dcc-be6d-6ec230a37bc4 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:18:19.924809 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG dbcounter [-] [479852] Writing DB stats keystone:SELECT=100 {{(pid=479852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:18:19.941316 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd056ae-a170-4dcc-be6d-6ec230a37bc4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 09:18:19.958478 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application [None req-5dd056ae-a170-4dcc-be6d-6ec230a37bc4 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 28 09:18:19.958478 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 09:18:19.958478 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 09:18:19.958478 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 09:18:19.958478 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 09:18:19.958478 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 09:18:19.958478 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 09:18:19.958478 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 09:18:19.958478 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 09:18:19.958478 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 09:18:19.958478 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 09:18:19.958478 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 09:18:19.958478 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 09:18:19.958478 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 09:18:19.958478 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 09:18:19.958478 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 09:18:19.959594 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 09:18:19.959594 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 09:18:19.959594 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 09:18:19.959594 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 09:18:19.959594 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 09:18:19.959594 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 09:18:19.959594 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 09:18:19.959594 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 09:18:19.959594 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 09:18:19.959594 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 09:18:19.959594 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 09:18:19.959594 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application with Lock( Jul 28 09:18:19.959594 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 09:18:19.959594 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self._enter() Jul 28 09:18:19.959594 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 09:18:19.959594 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 09:18:19.960607 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 09:18:19.960607 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self.creator() Jul 28 09:18:19.960607 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 09:18:19.960607 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application created_value = creator( Jul 28 09:18:19.960607 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 09:18:19.960607 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 09:18:19.960607 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 09:18:19.960607 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 09:18:19.960607 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 09:18:19.960607 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 09:18:19.960607 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 28 09:18:19.960607 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application Jul 28 09:18:19.960607 dv-cinder-851351-1-smb devstack@keystone.service[479852]: [pid: 479852|app: 0|req: 86/165] 10.222.0.42 () {56 vars in 1114 bytes} [Thu Jul 28 09:18:19 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 288 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 09:18:19.961442 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd056ae-a170-4dcc-be6d-6ec230a37bc4 None admin] Authenticating user token {{(pid=479852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:18:19.973825 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG dbcounter [-] [479851] Writing DB stats keystone:SELECT=100 {{(pid=479851) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:18:20.023213 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0348c09f-235a-4d8e-ab84-afd5f7996f17 None None] Validating token access rules against request {{(pid=479851) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:18:20.061246 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd8602c-dc73-45e6-bf1f-a2302671fc89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479851) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:18:20.061968 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd8602c-dc73-45e6-bf1f-a2302671fc89 None admin] REQUEST_METHOD: `GET` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:18:20.062258 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd8602c-dc73-45e6-bf1f-a2302671fc89 None admin] SCRIPT_NAME: `/identity` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:18:20.062536 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd8602c-dc73-45e6-bf1f-a2302671fc89 None admin] PATH_INFO: `/v3/users/c198f91a4ae84d2b9cc730a6e304c2be` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:18:20.063791 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bd8602c-dc73-45e6-bf1f-a2302671fc89 None admin] RBAC: Authorizing `identity:get_user(user_id=c198f91a4ae84d2b9cc730a6e304c2be)` {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:18:20.065482 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bd8602c-dc73-45e6-bf1f-a2302671fc89 None admin] RBAC: Authorization granted {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:18:20.067144 dv-cinder-851351-1-smb devstack@keystone.service[479851]: [pid: 479851|app: 0|req: 80/166] 10.222.0.42 () {56 vars in 1177 bytes} [Thu Jul 28 09:18:19 2022] GET /identity/v3/users/c198f91a4ae84d2b9cc730a6e304c2be => generated 247 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:18:20.068778 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd8602c-dc73-45e6-bf1f-a2302671fc89 None admin] Authenticating user token {{(pid=479851) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:18:20.129827 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd056ae-a170-4dcc-be6d-6ec230a37bc4 None admin] Validating token access rules against request {{(pid=479852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:18:20.197646 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a3431f-64e6-43d4-a78d-358914bb8f08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:18:20.198935 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a3431f-64e6-43d4-a78d-358914bb8f08 None admin] REQUEST_METHOD: `GET` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:18:20.199396 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a3431f-64e6-43d4-a78d-358914bb8f08 None admin] SCRIPT_NAME: `/identity` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:18:20.199823 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a3431f-64e6-43d4-a78d-358914bb8f08 None admin] PATH_INFO: `/v3/roles/member` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:18:20.231377 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73a3431f-64e6-43d4-a78d-358914bb8f08 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 09:18:20.238489 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application [None req-73a3431f-64e6-43d4-a78d-358914bb8f08 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 28 09:18:20.238489 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 09:18:20.238489 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 09:18:20.238489 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 09:18:20.238489 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 09:18:20.238489 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 09:18:20.238489 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 09:18:20.238489 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 09:18:20.238489 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 09:18:20.238489 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 09:18:20.238489 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 09:18:20.238489 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 09:18:20.238489 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 09:18:20.238489 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 09:18:20.238489 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 09:18:20.238489 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 09:18:20.239876 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 09:18:20.239876 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 09:18:20.239876 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 09:18:20.239876 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 09:18:20.239876 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 09:18:20.239876 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 09:18:20.239876 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 09:18:20.239876 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 09:18:20.239876 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 09:18:20.239876 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 09:18:20.239876 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 09:18:20.239876 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application with Lock( Jul 28 09:18:20.239876 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 09:18:20.239876 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self._enter() Jul 28 09:18:20.239876 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 09:18:20.239876 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 09:18:20.241072 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 09:18:20.241072 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self.creator() Jul 28 09:18:20.241072 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 09:18:20.241072 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application created_value = creator( Jul 28 09:18:20.241072 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 09:18:20.241072 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 09:18:20.241072 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 09:18:20.241072 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 09:18:20.241072 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 09:18:20.241072 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 09:18:20.241072 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 28 09:18:20.241072 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application Jul 28 09:18:20.249717 dv-cinder-851351-1-smb devstack@keystone.service[479852]: [pid: 479852|app: 0|req: 87/167] 10.222.0.42 () {56 vars in 1099 bytes} [Thu Jul 28 09:18:19 2022] GET /identity/v3/roles/member => generated 84 bytes in 289 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 09:18:20.251639 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a3431f-64e6-43d4-a78d-358914bb8f08 None admin] Authenticating user token {{(pid=479852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:18:20.279620 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd8602c-dc73-45e6-bf1f-a2302671fc89 None admin] Validating token access rules against request {{(pid=479851) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:18:20.300114 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG dbcounter [-] [479851] Writing DB stats keystone:SELECT=100 {{(pid=479851) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:18:20.348855 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f3313b1-d2d8-4f9a-a1a7-3f4740c1bce1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479851) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:18:20.349820 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3313b1-d2d8-4f9a-a1a7-3f4740c1bce1 None admin] REQUEST_METHOD: `GET` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:18:20.350271 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3313b1-d2d8-4f9a-a1a7-3f4740c1bce1 None admin] SCRIPT_NAME: `/identity` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:18:20.350749 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3313b1-d2d8-4f9a-a1a7-3f4740c1bce1 None admin] PATH_INFO: `/v3/roles` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:18:20.351655 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f3313b1-d2d8-4f9a-a1a7-3f4740c1bce1 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=479851) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 09:18:20.352134 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f3313b1-d2d8-4f9a-a1a7-3f4740c1bce1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:18:20.353747 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f3313b1-d2d8-4f9a-a1a7-3f4740c1bce1 None admin] RBAC: Authorization granted {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:18:20.367244 dv-cinder-851351-1-smb devstack@keystone.service[479851]: [pid: 479851|app: 0|req: 81/168] 10.222.0.42 () {56 vars in 1111 bytes} [Thu Jul 28 09:18:20 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 298 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:18:20.369019 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG dbcounter [-] [479852] Writing DB stats keystone:SELECT=100 {{(pid=479852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:18:20.373843 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f3313b1-d2d8-4f9a-a1a7-3f4740c1bce1 None admin] Authenticating user token {{(pid=479851) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:18:20.447633 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a3431f-64e6-43d4-a78d-358914bb8f08 None admin] Validating token access rules against request {{(pid=479852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:18:20.509792 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4cca8f-581a-4099-b9c4-39edfffe88d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:18:20.510353 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4cca8f-581a-4099-b9c4-39edfffe88d1 None admin] REQUEST_METHOD: `GET` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:18:20.510634 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4cca8f-581a-4099-b9c4-39edfffe88d1 None admin] SCRIPT_NAME: `/identity` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:18:20.510910 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4cca8f-581a-4099-b9c4-39edfffe88d1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:18:20.559483 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f3313b1-d2d8-4f9a-a1a7-3f4740c1bce1 None admin] Validating token access rules against request {{(pid=479851) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:18:20.620464 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d910ca95-aafb-4aa5-9247-3d6b04374d86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479851) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:18:20.621336 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d910ca95-aafb-4aa5-9247-3d6b04374d86 None admin] REQUEST_METHOD: `GET` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:18:20.621633 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d910ca95-aafb-4aa5-9247-3d6b04374d86 None admin] SCRIPT_NAME: `/identity` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:18:20.621918 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d910ca95-aafb-4aa5-9247-3d6b04374d86 None admin] PATH_INFO: `/v3/roles` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:18:20.622681 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d910ca95-aafb-4aa5-9247-3d6b04374d86 None admin] RBAC: Adding query filter params (name=member) {{(pid=479851) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 09:18:20.622994 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d910ca95-aafb-4aa5-9247-3d6b04374d86 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:18:20.624441 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d910ca95-aafb-4aa5-9247-3d6b04374d86 None admin] RBAC: Authorization granted {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:18:20.647471 dv-cinder-851351-1-smb devstack@keystone.service[479851]: [pid: 479851|app: 0|req: 82/169] 10.222.0.42 () {56 vars in 1101 bytes} [Thu Jul 28 09:18:20 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 279 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:18:20.648390 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d910ca95-aafb-4aa5-9247-3d6b04374d86 None admin] Authenticating user token {{(pid=479851) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:18:20.661924 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c4cca8f-581a-4099-b9c4-39edfffe88d1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:18:20.665482 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c4cca8f-581a-4099-b9c4-39edfffe88d1 None admin] RBAC: Authorization granted {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:18:20.763721 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG dbcounter [-] [479851] Writing DB stats keystone:SELECT=100 {{(pid=479851) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:18:20.797070 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG dbcounter [-] [479852] Writing DB stats keystone:SELECT=100 {{(pid=479852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:18:20.879459 dv-cinder-851351-1-smb devstack@keystone.service[479852]: [pid: 479852|app: 0|req: 88/170] 10.222.0.42 () {58 vars in 1282 bytes} [Thu Jul 28 09:18:20 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 628 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 28 09:18:20.881363 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4cca8f-581a-4099-b9c4-39edfffe88d1 None admin] Authenticating user token {{(pid=479852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:18:20.911516 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d910ca95-aafb-4aa5-9247-3d6b04374d86 None admin] Validating token access rules against request {{(pid=479851) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:18:20.998112 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b81cc4-5ba7-48da-b8e5-9e0ae1c72ee0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479851) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:18:20.998837 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b81cc4-5ba7-48da-b8e5-9e0ae1c72ee0 None admin] REQUEST_METHOD: `GET` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:18:20.999128 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b81cc4-5ba7-48da-b8e5-9e0ae1c72ee0 None admin] SCRIPT_NAME: `/identity` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:18:20.999412 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b81cc4-5ba7-48da-b8e5-9e0ae1c72ee0 None admin] PATH_INFO: `/v3/users/73be2aaaa3a047f395fae06ed9308ab6` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:18:21.005493 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1b81cc4-5ba7-48da-b8e5-9e0ae1c72ee0 None admin] RBAC: Authorizing `identity:get_user(user_id=73be2aaaa3a047f395fae06ed9308ab6)` {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:18:21.007087 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1b81cc4-5ba7-48da-b8e5-9e0ae1c72ee0 None admin] RBAC: Authorization granted {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:18:21.008844 dv-cinder-851351-1-smb devstack@keystone.service[479851]: [pid: 479851|app: 0|req: 83/171] 10.222.0.42 () {56 vars in 1177 bytes} [Thu Jul 28 09:18:20 2022] GET /identity/v3/users/73be2aaaa3a047f395fae06ed9308ab6 => generated 275 bytes in 361 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:18:21.010231 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66722cf0-160f-41f0-bb16-2053894435a0 None None] REQUEST_METHOD: `GET` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:18:21.010526 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66722cf0-160f-41f0-bb16-2053894435a0 None None] SCRIPT_NAME: `/identity` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:18:21.010811 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66722cf0-160f-41f0-bb16-2053894435a0 None None] PATH_INFO: `/` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:18:21.012246 dv-cinder-851351-1-smb devstack@keystone.service[479851]: [pid: 479851|app: 0|req: 84/172] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 09:18:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 09:18:21.017683 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66722cf0-160f-41f0-bb16-2053894435a0 None None] Authenticating user token {{(pid=479851) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:18:21.047462 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4cca8f-581a-4099-b9c4-39edfffe88d1 None admin] Validating token access rules against request {{(pid=479852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:18:21.087861 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b15c9df-21ff-4c24-a9b4-72ea9eb184e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:18:21.088596 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b15c9df-21ff-4c24-a9b4-72ea9eb184e2 None admin] REQUEST_METHOD: `GET` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:18:21.088910 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b15c9df-21ff-4c24-a9b4-72ea9eb184e2 None admin] SCRIPT_NAME: `/identity` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:18:21.089239 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b15c9df-21ff-4c24-a9b4-72ea9eb184e2 None admin] PATH_INFO: `/v3/users/73be2aaaa3a047f395fae06ed9308ab6` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:18:21.090503 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b15c9df-21ff-4c24-a9b4-72ea9eb184e2 None admin] RBAC: Authorizing `identity:get_user(user_id=73be2aaaa3a047f395fae06ed9308ab6)` {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:18:21.092695 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b15c9df-21ff-4c24-a9b4-72ea9eb184e2 None admin] RBAC: Authorization granted {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:18:21.094410 dv-cinder-851351-1-smb devstack@keystone.service[479852]: [pid: 479852|app: 0|req: 89/173] 10.222.0.42 () {56 vars in 1177 bytes} [Thu Jul 28 09:18:20 2022] GET /identity/v3/users/73be2aaaa3a047f395fae06ed9308ab6 => generated 275 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:18:21.095206 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b15c9df-21ff-4c24-a9b4-72ea9eb184e2 None admin] Authenticating user token {{(pid=479852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:18:21.127186 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG dbcounter [-] [479852] Writing DB stats keystone:SELECT=100 {{(pid=479852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:18:21.214964 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b15c9df-21ff-4c24-a9b4-72ea9eb184e2 None admin] Validating token access rules against request {{(pid=479852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:18:21.262957 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66722cf0-160f-41f0-bb16-2053894435a0 None None] Validating token access rules against request {{(pid=479851) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:18:21.266869 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG dbcounter [-] [479851] Writing DB stats keystone:SELECT=100 {{(pid=479851) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:18:21.269093 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a7c22ac-40a1-424a-a38d-c1051506a23a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:18:21.269775 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7c22ac-40a1-424a-a38d-c1051506a23a None admin] REQUEST_METHOD: `GET` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:18:21.270067 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7c22ac-40a1-424a-a38d-c1051506a23a None admin] SCRIPT_NAME: `/identity` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:18:21.270346 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7c22ac-40a1-424a-a38d-c1051506a23a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:18:21.301035 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc87aed9-0388-41d7-993e-befe43d357e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479851) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:18:21.301738 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc87aed9-0388-41d7-993e-befe43d357e3 None admin] REQUEST_METHOD: `GET` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:18:21.302025 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc87aed9-0388-41d7-993e-befe43d357e3 None admin] SCRIPT_NAME: `/identity` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:18:21.302304 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc87aed9-0388-41d7-993e-befe43d357e3 None admin] PATH_INFO: `/v3/projects/580eb2f23f9049b18bb38dce6f6f9b4f` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:18:21.303632 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc87aed9-0388-41d7-993e-befe43d357e3 None admin] RBAC: Authorizing `identity:get_project(project_id=580eb2f23f9049b18bb38dce6f6f9b4f)` {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:18:21.305168 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc87aed9-0388-41d7-993e-befe43d357e3 None admin] RBAC: Authorization granted {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:18:21.307098 dv-cinder-851351-1-smb devstack@keystone.service[479851]: [pid: 479851|app: 0|req: 85/174] 10.222.0.42 () {56 vars in 1186 bytes} [Thu Jul 28 09:18:21 2022] GET /identity/v3/projects/580eb2f23f9049b18bb38dce6f6f9b4f => generated 298 bytes in 294 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:18:21.313142 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b835e6ce-78f5-4f08-abe0-262eb8de3f31 None None] REQUEST_METHOD: `POST` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:18:21.313433 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b835e6ce-78f5-4f08-abe0-262eb8de3f31 None None] SCRIPT_NAME: `/identity` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:18:21.313721 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b835e6ce-78f5-4f08-abe0-262eb8de3f31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:18:21.334437 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.auth.core [None req-b835e6ce-78f5-4f08-abe0-262eb8de3f31 None None] MFA Rules not processed for user `c198f91a4ae84d2b9cc730a6e304c2be`. Rule list: `[]` (Enabled: `True`). {{(pid=479851) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 09:18:21.335757 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.fernet_utils [None req-b835e6ce-78f5-4f08-abe0-262eb8de3f31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=479851) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 09:18:21.359844 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a7c22ac-40a1-424a-a38d-c1051506a23a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:18:21.361477 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a7c22ac-40a1-424a-a38d-c1051506a23a None admin] RBAC: Authorization granted {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:18:21.394347 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG dbcounter [-] [479852] Writing DB stats keystone:SELECT=100 {{(pid=479852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:18:21.416704 dv-cinder-851351-1-smb devstack@keystone.service[479851]: [pid: 479851|app: 0|req: 86/175] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 09:18:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 09:18:21.416704 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b835e6ce-78f5-4f08-abe0-262eb8de3f31 None None] Authenticating user token {{(pid=479851) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:18:21.483410 dv-cinder-851351-1-smb devstack@keystone.service[479852]: [pid: 479852|app: 0|req: 90/176] 10.222.0.42 () {58 vars in 1282 bytes} [Thu Jul 28 09:18:21 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 388 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 28 09:18:21.488716 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4bfe877-84db-4ab2-a7cd-cc66c81215b5 None None] REQUEST_METHOD: `GET` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:18:21.488716 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4bfe877-84db-4ab2-a7cd-cc66c81215b5 None None] SCRIPT_NAME: `/identity` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:18:21.488716 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4bfe877-84db-4ab2-a7cd-cc66c81215b5 None None] PATH_INFO: `/` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:18:21.488716 dv-cinder-851351-1-smb devstack@keystone.service[479852]: [pid: 479852|app: 0|req: 91/177] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 09:18:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 09:18:21.491968 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4bfe877-84db-4ab2-a7cd-cc66c81215b5 None None] Authenticating user token {{(pid=479852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:18:21.525053 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG dbcounter [-] [479851] Writing DB stats keystone:SELECT=100 {{(pid=479851) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:18:21.528991 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b835e6ce-78f5-4f08-abe0-262eb8de3f31 None None] Validating token access rules against request {{(pid=479851) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:18:21.566710 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e23965-1986-45b9-a8cd-1a13823555b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479851) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:18:21.567353 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e23965-1986-45b9-a8cd-1a13823555b5 None admin] REQUEST_METHOD: `GET` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:18:21.567635 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e23965-1986-45b9-a8cd-1a13823555b5 None admin] SCRIPT_NAME: `/identity` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:18:21.567916 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e23965-1986-45b9-a8cd-1a13823555b5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:18:21.610101 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4bfe877-84db-4ab2-a7cd-cc66c81215b5 None None] Validating token access rules against request {{(pid=479852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:18:21.641260 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG dbcounter [-] [479852] Writing DB stats keystone:SELECT=100 {{(pid=479852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:18:21.641534 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4e23965-1986-45b9-a8cd-1a13823555b5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:18:21.643085 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4e23965-1986-45b9-a8cd-1a13823555b5 None admin] RBAC: Authorization granted {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:18:21.650779 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc7a489-c314-4e1d-8994-6d73e3d146b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:18:21.651779 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc7a489-c314-4e1d-8994-6d73e3d146b3 None admin] REQUEST_METHOD: `GET` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:18:21.651779 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc7a489-c314-4e1d-8994-6d73e3d146b3 None admin] SCRIPT_NAME: `/identity` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:18:21.652012 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc7a489-c314-4e1d-8994-6d73e3d146b3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:18:21.652791 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dc7a489-c314-4e1d-8994-6d73e3d146b3 None admin] RBAC: Adding query filter params (role.id=685084310b35477b9b2d0c7934d0f803, scope.project.id=580eb2f23f9049b18bb38dce6f6f9b4f, user.id=c198f91a4ae84d2b9cc730a6e304c2be) {{(pid=479852) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 09:18:21.653104 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dc7a489-c314-4e1d-8994-6d73e3d146b3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:18:21.654553 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dc7a489-c314-4e1d-8994-6d73e3d146b3 None admin] RBAC: Authorization granted {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:18:21.668696 dv-cinder-851351-1-smb devstack@keystone.service[479852]: [pid: 479852|app: 0|req: 92/178] 10.222.0.42 () {56 vars in 1374 bytes} [Thu Jul 28 09:18:21 2022] GET /identity/v3/role_assignments?user.id=c198f91a4ae84d2b9cc730a6e304c2be&scope.project.id=580eb2f23f9049b18bb38dce6f6f9b4f&role.id=685084310b35477b9b2d0c7934d0f803 => generated 608 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:18:21.668696 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32929496-888b-49ee-8437-661b7c6fd4c0 None None] REQUEST_METHOD: `GET` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:18:21.668696 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32929496-888b-49ee-8437-661b7c6fd4c0 None None] SCRIPT_NAME: `/identity` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:18:21.668696 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32929496-888b-49ee-8437-661b7c6fd4c0 None None] PATH_INFO: `/` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:18:21.668696 dv-cinder-851351-1-smb devstack@keystone.service[479852]: [pid: 479852|app: 0|req: 93/179] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 09:18:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 09:18:21.668696 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32929496-888b-49ee-8437-661b7c6fd4c0 None None] Authenticating user token {{(pid=479852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:18:21.773842 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG dbcounter [-] [479851] Writing DB stats keystone:SELECT=100 {{(pid=479851) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:18:21.784573 dv-cinder-851351-1-smb devstack@keystone.service[479851]: [pid: 479851|app: 0|req: 87/180] 10.222.0.42 () {58 vars in 1282 bytes} [Thu Jul 28 09:18:21 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 374 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 28 09:18:21.785848 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e23965-1986-45b9-a8cd-1a13823555b5 None admin] Authenticating user token {{(pid=479851) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:18:21.791695 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32929496-888b-49ee-8437-661b7c6fd4c0 None None] Validating token access rules against request {{(pid=479852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:18:21.841595 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bbc9962-cf13-4363-b761-db87d5e39869 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:18:21.843011 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbc9962-cf13-4363-b761-db87d5e39869 None admin] REQUEST_METHOD: `GET` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:18:21.843011 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbc9962-cf13-4363-b761-db87d5e39869 None admin] SCRIPT_NAME: `/identity` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:18:21.843011 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbc9962-cf13-4363-b761-db87d5e39869 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:18:21.858787 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bbc9962-cf13-4363-b761-db87d5e39869 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 09:18:21.867234 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application [None req-1bbc9962-cf13-4363-b761-db87d5e39869 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 09:18:21.867234 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 09:18:21.867234 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 09:18:21.867234 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 09:18:21.867234 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 09:18:21.867234 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 09:18:21.867234 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 09:18:21.867234 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 09:18:21.867234 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 09:18:21.867234 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 09:18:21.867234 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 09:18:21.867234 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 09:18:21.867234 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 09:18:21.867234 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 09:18:21.867234 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 09:18:21.867234 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 09:18:21.868448 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 09:18:21.868448 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 09:18:21.868448 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 09:18:21.868448 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 09:18:21.868448 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 09:18:21.868448 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 09:18:21.868448 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 09:18:21.868448 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 09:18:21.868448 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 09:18:21.868448 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 09:18:21.868448 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 09:18:21.868448 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application with Lock( Jul 28 09:18:21.868448 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 09:18:21.868448 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self._enter() Jul 28 09:18:21.868448 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 09:18:21.868448 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 09:18:21.869509 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 09:18:21.869509 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self.creator() Jul 28 09:18:21.869509 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 09:18:21.869509 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application created_value = creator( Jul 28 09:18:21.869509 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 09:18:21.869509 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 09:18:21.869509 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 09:18:21.869509 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 09:18:21.869509 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 09:18:21.869509 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 09:18:21.869509 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 09:18:21.869509 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application Jul 28 09:18:21.869509 dv-cinder-851351-1-smb devstack@keystone.service[479852]: [pid: 479852|app: 0|req: 94/181] 10.222.0.42 () {56 vars in 1096 bytes} [Thu Jul 28 09:18:21 2022] GET /identity/v3/roles/admin => generated 83 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 09:18:21.869509 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca336e6-0db2-4167-b7a9-196381eb47c7 None None] REQUEST_METHOD: `POST` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:18:21.870397 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca336e6-0db2-4167-b7a9-196381eb47c7 None None] SCRIPT_NAME: `/identity` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:18:21.870397 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca336e6-0db2-4167-b7a9-196381eb47c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:18:21.889845 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.auth.core [None req-fca336e6-0db2-4167-b7a9-196381eb47c7 None None] MFA Rules not processed for user `c198f91a4ae84d2b9cc730a6e304c2be`. Rule list: `[]` (Enabled: `True`). {{(pid=479852) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 09:18:21.890727 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.fernet_utils [None req-fca336e6-0db2-4167-b7a9-196381eb47c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=479852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 09:18:21.906994 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e23965-1986-45b9-a8cd-1a13823555b5 None admin] Validating token access rules against request {{(pid=479851) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:18:21.943994 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG dbcounter [-] [479852] Writing DB stats keystone:SELECT=100 {{(pid=479852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:18:21.945562 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7822bc20-c53d-47e9-ae6b-4f140bac78bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479851) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:18:21.946248 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7822bc20-c53d-47e9-ae6b-4f140bac78bf None admin] REQUEST_METHOD: `GET` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:18:21.946947 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7822bc20-c53d-47e9-ae6b-4f140bac78bf None admin] SCRIPT_NAME: `/identity` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:18:21.947234 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7822bc20-c53d-47e9-ae6b-4f140bac78bf None admin] PATH_INFO: `/v3/projects/580eb2f23f9049b18bb38dce6f6f9b4f` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:18:21.948622 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7822bc20-c53d-47e9-ae6b-4f140bac78bf None admin] RBAC: Authorizing `identity:get_project(project_id=580eb2f23f9049b18bb38dce6f6f9b4f)` {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:18:21.950059 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7822bc20-c53d-47e9-ae6b-4f140bac78bf None admin] RBAC: Authorization granted {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:18:21.951767 dv-cinder-851351-1-smb devstack@keystone.service[479851]: [pid: 479851|app: 0|req: 88/182] 10.222.0.42 () {56 vars in 1186 bytes} [Thu Jul 28 09:18:21 2022] GET /identity/v3/projects/580eb2f23f9049b18bb38dce6f6f9b4f => generated 298 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:18:21.952972 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa885231-38d2-4715-8bf7-4573ec9a6e35 None None] REQUEST_METHOD: `POST` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:18:21.953276 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa885231-38d2-4715-8bf7-4573ec9a6e35 None None] SCRIPT_NAME: `/identity` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:18:21.953526 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa885231-38d2-4715-8bf7-4573ec9a6e35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:18:21.967147 dv-cinder-851351-1-smb devstack@keystone.service[479852]: [pid: 479852|app: 0|req: 95/183] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 09:18:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 09:18:21.968386 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4c617f-f6a2-4350-b153-c07a9acafcd5 None None] REQUEST_METHOD: `GET` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:18:21.968709 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4c617f-f6a2-4350-b153-c07a9acafcd5 None None] SCRIPT_NAME: `/identity` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:18:21.968987 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4c617f-f6a2-4350-b153-c07a9acafcd5 None None] PATH_INFO: `/` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:18:21.972824 dv-cinder-851351-1-smb devstack@keystone.service[479852]: [pid: 479852|app: 0|req: 96/184] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 09:18:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 09:18:21.972824 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4c617f-f6a2-4350-b153-c07a9acafcd5 None None] Authenticating user token {{(pid=479852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:18:21.974704 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.auth.core [None req-fa885231-38d2-4715-8bf7-4573ec9a6e35 None None] MFA Rules not processed for user `c198f91a4ae84d2b9cc730a6e304c2be`. Rule list: `[]` (Enabled: `True`). {{(pid=479851) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 09:18:21.977445 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.fernet_utils [None req-fa885231-38d2-4715-8bf7-4573ec9a6e35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=479851) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 09:18:22.039782 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG dbcounter [-] [479851] Writing DB stats keystone:SELECT=100 {{(pid=479851) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:18:22.046305 dv-cinder-851351-1-smb devstack@keystone.service[479851]: [pid: 479851|app: 0|req: 89/185] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 09:18:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 09:18:22.052898 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa885231-38d2-4715-8bf7-4573ec9a6e35 None None] Authenticating user token {{(pid=479851) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:18:22.083073 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4c617f-f6a2-4350-b153-c07a9acafcd5 None None] Validating token access rules against request {{(pid=479852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:18:22.119870 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce2d536-acc5-4363-a917-1d5b79a47647 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:18:22.120512 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce2d536-acc5-4363-a917-1d5b79a47647 None admin] REQUEST_METHOD: `GET` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:18:22.120814 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce2d536-acc5-4363-a917-1d5b79a47647 None admin] SCRIPT_NAME: `/identity` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:18:22.121108 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce2d536-acc5-4363-a917-1d5b79a47647 None admin] PATH_INFO: `/v3/projects/bbadce4d272544e6aea2ae9643be2628` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:18:22.122270 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ce2d536-acc5-4363-a917-1d5b79a47647 None admin] RBAC: Authorizing `identity:get_project(project_id=bbadce4d272544e6aea2ae9643be2628)` {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:18:22.123763 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ce2d536-acc5-4363-a917-1d5b79a47647 None admin] RBAC: Authorization granted {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:18:22.125498 dv-cinder-851351-1-smb devstack@keystone.service[479852]: [pid: 479852|app: 0|req: 97/186] 10.222.0.42 () {56 vars in 1186 bytes} [Thu Jul 28 09:18:21 2022] GET /identity/v3/projects/bbadce4d272544e6aea2ae9643be2628 => generated 312 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:18:22.126257 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce2d536-acc5-4363-a917-1d5b79a47647 None admin] Authenticating user token {{(pid=479852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:18:22.155511 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa885231-38d2-4715-8bf7-4573ec9a6e35 None None] Validating token access rules against request {{(pid=479851) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:18:22.177582 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG dbcounter [-] [479852] Writing DB stats keystone:SELECT=100 {{(pid=479852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:18:22.191193 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2160a8-f255-4481-b569-dbb3132d8b6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479851) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:18:22.191841 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2160a8-f255-4481-b569-dbb3132d8b6b None admin] REQUEST_METHOD: `GET` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:18:22.192128 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2160a8-f255-4481-b569-dbb3132d8b6b None admin] SCRIPT_NAME: `/identity` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:18:22.192403 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2160a8-f255-4481-b569-dbb3132d8b6b None admin] PATH_INFO: `/v3/roles` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:18:22.193183 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b2160a8-f255-4481-b569-dbb3132d8b6b None admin] RBAC: Adding query filter params (name=admin) {{(pid=479851) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 09:18:22.193495 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b2160a8-f255-4481-b569-dbb3132d8b6b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:18:22.195490 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b2160a8-f255-4481-b569-dbb3132d8b6b None admin] RBAC: Authorization granted {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:18:22.205266 dv-cinder-851351-1-smb devstack@keystone.service[479851]: [pid: 479851|app: 0|req: 90/187] 10.222.0.42 () {56 vars in 1099 bytes} [Thu Jul 28 09:18:22 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:18:22.206521 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f23430-af35-45d0-a1da-3bb1a96ac995 None None] REQUEST_METHOD: `POST` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:18:22.206812 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f23430-af35-45d0-a1da-3bb1a96ac995 None None] SCRIPT_NAME: `/identity` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:18:22.207091 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f23430-af35-45d0-a1da-3bb1a96ac995 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:18:22.225651 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.auth.core [None req-b8f23430-af35-45d0-a1da-3bb1a96ac995 None None] MFA Rules not processed for user `c198f91a4ae84d2b9cc730a6e304c2be`. Rule list: `[]` (Enabled: `True`). {{(pid=479851) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 09:18:22.226864 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.fernet_utils [None req-b8f23430-af35-45d0-a1da-3bb1a96ac995 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=479851) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 09:18:22.230788 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce2d536-acc5-4363-a917-1d5b79a47647 None admin] Validating token access rules against request {{(pid=479852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:18:22.265512 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28daa4fb-fdc0-477b-a260-dc707db738b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:18:22.266152 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28daa4fb-fdc0-477b-a260-dc707db738b0 None admin] REQUEST_METHOD: `GET` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:18:22.266436 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28daa4fb-fdc0-477b-a260-dc707db738b0 None admin] SCRIPT_NAME: `/identity` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:18:22.266713 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28daa4fb-fdc0-477b-a260-dc707db738b0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:18:22.267524 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28daa4fb-fdc0-477b-a260-dc707db738b0 None admin] RBAC: Adding query filter params (role.id=acf1d2de5e5448beb6363dae3d154a02, scope.project.id=580eb2f23f9049b18bb38dce6f6f9b4f, user.id=73be2aaaa3a047f395fae06ed9308ab6) {{(pid=479852) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 09:18:22.267836 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28daa4fb-fdc0-477b-a260-dc707db738b0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:18:22.269351 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28daa4fb-fdc0-477b-a260-dc707db738b0 None admin] RBAC: Authorization granted {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:18:22.275787 dv-cinder-851351-1-smb devstack@keystone.service[479852]: [pid: 479852|app: 0|req: 98/188] 10.222.0.42 () {56 vars in 1374 bytes} [Thu Jul 28 09:18:22 2022] GET /identity/v3/role_assignments?user.id=73be2aaaa3a047f395fae06ed9308ab6&scope.project.id=580eb2f23f9049b18bb38dce6f6f9b4f&role.id=acf1d2de5e5448beb6363dae3d154a02 => generated 608 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:18:22.276633 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28daa4fb-fdc0-477b-a260-dc707db738b0 None admin] Authenticating user token {{(pid=479852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:18:22.286628 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG dbcounter [-] [479851] Writing DB stats keystone:SELECT=100 {{(pid=479851) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:18:22.302923 dv-cinder-851351-1-smb devstack@keystone.service[479851]: [pid: 479851|app: 0|req: 91/189] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 09:18:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 09:18:22.302923 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f23430-af35-45d0-a1da-3bb1a96ac995 None None] Authenticating user token {{(pid=479851) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:18:22.404996 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28daa4fb-fdc0-477b-a260-dc707db738b0 None admin] Validating token access rules against request {{(pid=479852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:18:22.421520 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG dbcounter [-] [479852] Writing DB stats keystone:SELECT=100 {{(pid=479852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:18:22.441143 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f23430-af35-45d0-a1da-3bb1a96ac995 None None] Validating token access rules against request {{(pid=479851) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:18:22.449129 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b5ff92-8425-4600-8cce-2a5e74343d63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:18:22.449571 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b5ff92-8425-4600-8cce-2a5e74343d63 None admin] REQUEST_METHOD: `GET` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:18:22.449847 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b5ff92-8425-4600-8cce-2a5e74343d63 None admin] SCRIPT_NAME: `/identity` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:18:22.450125 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b5ff92-8425-4600-8cce-2a5e74343d63 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:18:22.464870 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b5ff92-8425-4600-8cce-2a5e74343d63 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 09:18:22.470686 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application [None req-f8b5ff92-8425-4600-8cce-2a5e74343d63 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 28 09:18:22.470686 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 09:18:22.470686 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 09:18:22.470686 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 09:18:22.470686 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 09:18:22.470686 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 09:18:22.470686 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 09:18:22.470686 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 09:18:22.470686 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 09:18:22.470686 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 09:18:22.470686 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 09:18:22.470686 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 09:18:22.470686 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 09:18:22.470686 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 09:18:22.470686 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 09:18:22.470686 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 09:18:22.471802 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 09:18:22.471802 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 09:18:22.471802 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 09:18:22.471802 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 09:18:22.471802 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 09:18:22.471802 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 09:18:22.471802 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 09:18:22.471802 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 09:18:22.471802 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 09:18:22.471802 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 09:18:22.471802 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 09:18:22.471802 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application with Lock( Jul 28 09:18:22.471802 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 09:18:22.471802 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self._enter() Jul 28 09:18:22.471802 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 09:18:22.471802 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 09:18:22.476449 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 09:18:22.476449 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self.creator() Jul 28 09:18:22.476449 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 09:18:22.476449 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application created_value = creator( Jul 28 09:18:22.476449 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 09:18:22.476449 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 09:18:22.476449 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 09:18:22.476449 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 09:18:22.476449 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 09:18:22.476449 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 09:18:22.476449 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 28 09:18:22.476449 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application Jul 28 09:18:22.476449 dv-cinder-851351-1-smb devstack@keystone.service[479852]: [pid: 479852|app: 0|req: 99/190] 10.222.0.42 () {56 vars in 1099 bytes} [Thu Jul 28 09:18:22 2022] GET /identity/v3/roles/reader => generated 84 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 09:18:22.476449 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b5ff92-8425-4600-8cce-2a5e74343d63 None admin] Authenticating user token {{(pid=479852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:18:22.493569 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659bdac2-690c-4b6d-9517-dde934ceda96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479851) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:18:22.494247 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659bdac2-690c-4b6d-9517-dde934ceda96 None admin] REQUEST_METHOD: `GET` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:18:22.494533 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659bdac2-690c-4b6d-9517-dde934ceda96 None admin] SCRIPT_NAME: `/identity` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:18:22.494812 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659bdac2-690c-4b6d-9517-dde934ceda96 None admin] PATH_INFO: `/v3/domains/default` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:18:22.496142 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-659bdac2-690c-4b6d-9517-dde934ceda96 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:18:22.499380 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-659bdac2-690c-4b6d-9517-dde934ceda96 None admin] RBAC: Authorization granted {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:18:22.499524 dv-cinder-851351-1-smb devstack@keystone.service[479851]: [pid: 479851|app: 0|req: 92/191] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 09:18:22 2022] GET /identity/v3/domains/default => generated 199 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:18:22.502821 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659bdac2-690c-4b6d-9517-dde934ceda96 None admin] Authenticating user token {{(pid=479851) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:18:22.561279 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG dbcounter [-] [479851] Writing DB stats keystone:SELECT=100 {{(pid=479851) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:18:22.587205 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b5ff92-8425-4600-8cce-2a5e74343d63 None admin] Validating token access rules against request {{(pid=479852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:18:22.603921 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659bdac2-690c-4b6d-9517-dde934ceda96 None admin] Validating token access rules against request {{(pid=479851) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:18:22.621097 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c31c72-d6f1-4820-8899-06bfe9dfed70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:18:22.621733 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c31c72-d6f1-4820-8899-06bfe9dfed70 None admin] REQUEST_METHOD: `GET` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:18:22.622019 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c31c72-d6f1-4820-8899-06bfe9dfed70 None admin] SCRIPT_NAME: `/identity` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:18:22.622300 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c31c72-d6f1-4820-8899-06bfe9dfed70 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:18:22.623104 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c31c72-d6f1-4820-8899-06bfe9dfed70 None admin] RBAC: Adding query filter params (role.id=900fb424e172461d93a0db59afb0a12b, scope.project.id=bbadce4d272544e6aea2ae9643be2628, user.id=73be2aaaa3a047f395fae06ed9308ab6) {{(pid=479852) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 09:18:22.623420 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c31c72-d6f1-4820-8899-06bfe9dfed70 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:18:22.624922 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c31c72-d6f1-4820-8899-06bfe9dfed70 None admin] RBAC: Authorization granted {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:18:22.631297 dv-cinder-851351-1-smb devstack@keystone.service[479852]: [pid: 479852|app: 0|req: 100/192] 10.222.0.42 () {56 vars in 1374 bytes} [Thu Jul 28 09:18:22 2022] GET /identity/v3/role_assignments?user.id=73be2aaaa3a047f395fae06ed9308ab6&scope.project.id=bbadce4d272544e6aea2ae9643be2628&role.id=900fb424e172461d93a0db59afb0a12b => generated 608 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:18:22.632164 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c31c72-d6f1-4820-8899-06bfe9dfed70 None admin] Authenticating user token {{(pid=479852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:18:22.655949 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53fcb464-0aec-40c7-b1d7-b809f2543769 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479851) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:18:22.656636 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53fcb464-0aec-40c7-b1d7-b809f2543769 None admin] REQUEST_METHOD: `GET` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:18:22.656965 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53fcb464-0aec-40c7-b1d7-b809f2543769 None admin] SCRIPT_NAME: `/identity` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:18:22.657249 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53fcb464-0aec-40c7-b1d7-b809f2543769 None admin] PATH_INFO: `/v3/users/ab8fbe19586f4baf86846ca0a77ea800` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:18:22.675503 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53fcb464-0aec-40c7-b1d7-b809f2543769 None admin] RBAC: Authorizing `identity:get_user(user_id=ab8fbe19586f4baf86846ca0a77ea800)` {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:18:22.676151 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG dbcounter [-] [479852] Writing DB stats keystone:SELECT=100 {{(pid=479852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:18:22.678103 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53fcb464-0aec-40c7-b1d7-b809f2543769 None admin] RBAC: Authorization granted {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:18:22.680297 dv-cinder-851351-1-smb devstack@keystone.service[479851]: [pid: 479851|app: 0|req: 93/193] 10.222.0.42 () {56 vars in 1177 bytes} [Thu Jul 28 09:18:22 2022] GET /identity/v3/users/ab8fbe19586f4baf86846ca0a77ea800 => generated 283 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:18:22.681145 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53fcb464-0aec-40c7-b1d7-b809f2543769 None admin] Authenticating user token {{(pid=479851) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:18:22.758685 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c31c72-d6f1-4820-8899-06bfe9dfed70 None admin] Validating token access rules against request {{(pid=479852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:18:22.802960 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e8027f-68e7-4563-92a5-d310208e19ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:18:22.803736 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e8027f-68e7-4563-92a5-d310208e19ab None admin] REQUEST_METHOD: `GET` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:18:22.804018 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e8027f-68e7-4563-92a5-d310208e19ab None admin] SCRIPT_NAME: `/identity` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:18:22.804292 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e8027f-68e7-4563-92a5-d310208e19ab None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:18:22.804481 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53fcb464-0aec-40c7-b1d7-b809f2543769 None admin] Validating token access rules against request {{(pid=479851) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:18:22.822102 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60e8027f-68e7-4563-92a5-d310208e19ab None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 09:18:22.825993 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG dbcounter [-] [479851] Writing DB stats keystone:SELECT=100 {{(pid=479851) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:18:22.828595 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application [None req-60e8027f-68e7-4563-92a5-d310208e19ab None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 28 09:18:22.828595 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 09:18:22.828595 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 09:18:22.828595 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 09:18:22.828595 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 09:18:22.828595 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 09:18:22.828595 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 09:18:22.828595 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 09:18:22.828595 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 09:18:22.828595 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 09:18:22.828595 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 09:18:22.828595 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 09:18:22.828595 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 09:18:22.828595 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 09:18:22.828595 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 09:18:22.828595 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 09:18:22.829855 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 09:18:22.829855 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 09:18:22.829855 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 09:18:22.829855 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 09:18:22.829855 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 09:18:22.829855 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 09:18:22.829855 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 09:18:22.829855 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 09:18:22.829855 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 09:18:22.829855 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 09:18:22.829855 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 09:18:22.829855 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application with Lock( Jul 28 09:18:22.829855 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 09:18:22.829855 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self._enter() Jul 28 09:18:22.829855 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 09:18:22.829855 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 09:18:22.831661 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 09:18:22.831661 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self.creator() Jul 28 09:18:22.831661 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 09:18:22.831661 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application created_value = creator( Jul 28 09:18:22.831661 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 09:18:22.831661 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 09:18:22.831661 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 09:18:22.831661 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 09:18:22.831661 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 09:18:22.831661 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 09:18:22.831661 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 28 09:18:22.831661 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application Jul 28 09:18:22.831661 dv-cinder-851351-1-smb devstack@keystone.service[479852]: [pid: 479852|app: 0|req: 101/194] 10.222.0.42 () {56 vars in 1114 bytes} [Thu Jul 28 09:18:22 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 09:18:22.831661 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e8027f-68e7-4563-92a5-d310208e19ab None admin] Authenticating user token {{(pid=479852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:18:22.846639 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4ff40e-9be8-4821-b03c-3e87b5a41719 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479851) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:18:22.847288 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4ff40e-9be8-4821-b03c-3e87b5a41719 None admin] REQUEST_METHOD: `GET` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:18:22.847571 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4ff40e-9be8-4821-b03c-3e87b5a41719 None admin] SCRIPT_NAME: `/identity` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:18:22.847877 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4ff40e-9be8-4821-b03c-3e87b5a41719 None admin] PATH_INFO: `/v3/roles` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:18:22.848628 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b4ff40e-9be8-4821-b03c-3e87b5a41719 None admin] RBAC: Adding query filter params (name=reader) {{(pid=479851) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 09:18:22.850006 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b4ff40e-9be8-4821-b03c-3e87b5a41719 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:18:22.851418 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b4ff40e-9be8-4821-b03c-3e87b5a41719 None admin] RBAC: Authorization granted {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:18:22.862406 dv-cinder-851351-1-smb devstack@keystone.service[479851]: [pid: 479851|app: 0|req: 94/195] 10.222.0.42 () {56 vars in 1101 bytes} [Thu Jul 28 09:18:22 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:18:22.863265 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4ff40e-9be8-4821-b03c-3e87b5a41719 None admin] Authenticating user token {{(pid=479851) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:18:22.937374 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG dbcounter [-] [479852] Writing DB stats keystone:SELECT=100 {{(pid=479852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:18:22.944789 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e8027f-68e7-4563-92a5-d310208e19ab None admin] Validating token access rules against request {{(pid=479852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:18:22.970646 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4ff40e-9be8-4821-b03c-3e87b5a41719 None admin] Validating token access rules against request {{(pid=479851) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:18:22.979809 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7189d01f-6f7f-4109-92af-197431b1ea14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:18:22.980419 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7189d01f-6f7f-4109-92af-197431b1ea14 None admin] REQUEST_METHOD: `POST` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:18:22.980724 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7189d01f-6f7f-4109-92af-197431b1ea14 None admin] SCRIPT_NAME: `/identity` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:18:22.981002 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7189d01f-6f7f-4109-92af-197431b1ea14 None admin] PATH_INFO: `/v3/users` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:18:22.981709 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7189d01f-6f7f-4109-92af-197431b1ea14 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:18:22.983191 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7189d01f-6f7f-4109-92af-197431b1ea14 None admin] RBAC: Authorization granted {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:18:23.003963 dv-cinder-851351-1-smb devstack@keystone.service[479852]: [pid: 479852|app: 0|req: 102/196] 10.222.0.42 () {60 vars in 1132 bytes} [Thu Jul 28 09:18:22 2022] POST /identity/v3/users => generated 297 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 09:18:23.007336 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0f730f-d437-4a8c-842f-edf71ba355f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479851) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:18:23.007987 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0f730f-d437-4a8c-842f-edf71ba355f7 None admin] REQUEST_METHOD: `GET` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:18:23.008272 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0f730f-d437-4a8c-842f-edf71ba355f7 None admin] SCRIPT_NAME: `/identity` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:18:23.008549 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0f730f-d437-4a8c-842f-edf71ba355f7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:18:23.009861 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7189d01f-6f7f-4109-92af-197431b1ea14 None admin] Authenticating user token {{(pid=479852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:18:23.064552 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG dbcounter [-] [479851] Writing DB stats keystone:SELECT=100 {{(pid=479851) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:18:23.093127 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac0f730f-d437-4a8c-842f-edf71ba355f7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:18:23.094718 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac0f730f-d437-4a8c-842f-edf71ba355f7 None admin] RBAC: Authorization granted {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:18:23.141839 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7189d01f-6f7f-4109-92af-197431b1ea14 None admin] Validating token access rules against request {{(pid=479852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:18:23.180834 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98eca355-bd03-434c-b2fa-2f6cda454e3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:18:23.181434 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98eca355-bd03-434c-b2fa-2f6cda454e3c None admin] REQUEST_METHOD: `GET` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:18:23.181713 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98eca355-bd03-434c-b2fa-2f6cda454e3c None admin] SCRIPT_NAME: `/identity` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:18:23.181985 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98eca355-bd03-434c-b2fa-2f6cda454e3c None admin] PATH_INFO: `/v3/roles` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:18:23.182722 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98eca355-bd03-434c-b2fa-2f6cda454e3c None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=479852) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 09:18:23.183027 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98eca355-bd03-434c-b2fa-2f6cda454e3c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:18:23.184476 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98eca355-bd03-434c-b2fa-2f6cda454e3c None admin] RBAC: Authorization granted {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:18:23.199359 dv-cinder-851351-1-smb devstack@keystone.service[479852]: [pid: 479852|app: 0|req: 103/197] 10.222.0.42 () {56 vars in 1111 bytes} [Thu Jul 28 09:18:23 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:18:23.200403 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98eca355-bd03-434c-b2fa-2f6cda454e3c None admin] Authenticating user token {{(pid=479852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:18:23.218521 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG dbcounter [-] [479852] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=479852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:18:23.226098 dv-cinder-851351-1-smb devstack@keystone.service[479851]: [pid: 479851|app: 0|req: 95/198] 10.222.0.42 () {58 vars in 1282 bytes} [Thu Jul 28 09:18:22 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 357 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 28 09:18:23.226098 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0f730f-d437-4a8c-842f-edf71ba355f7 None admin] Authenticating user token {{(pid=479851) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:18:23.327310 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG dbcounter [-] [479851] Writing DB stats keystone:SELECT=100 {{(pid=479851) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:18:23.328909 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98eca355-bd03-434c-b2fa-2f6cda454e3c None admin] Validating token access rules against request {{(pid=479852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:18:23.356629 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0f730f-d437-4a8c-842f-edf71ba355f7 None admin] Validating token access rules against request {{(pid=479851) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:18:23.383691 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1578b95d-8bee-40fa-90f8-96d6ce75147b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:18:23.383691 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1578b95d-8bee-40fa-90f8-96d6ce75147b None admin] REQUEST_METHOD: `GET` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:18:23.383691 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1578b95d-8bee-40fa-90f8-96d6ce75147b None admin] SCRIPT_NAME: `/identity` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:18:23.383691 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1578b95d-8bee-40fa-90f8-96d6ce75147b None admin] PATH_INFO: `/v3/users/2046089722a34a57bc743a56cc5e395a` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:18:23.384870 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1578b95d-8bee-40fa-90f8-96d6ce75147b None admin] RBAC: Authorizing `identity:get_user(user_id=2046089722a34a57bc743a56cc5e395a)` {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:18:23.386033 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1578b95d-8bee-40fa-90f8-96d6ce75147b None admin] RBAC: Authorization granted {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:18:23.387687 dv-cinder-851351-1-smb devstack@keystone.service[479852]: [pid: 479852|app: 0|req: 104/199] 10.222.0.42 () {56 vars in 1177 bytes} [Thu Jul 28 09:18:23 2022] GET /identity/v3/users/2046089722a34a57bc743a56cc5e395a => generated 289 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:18:23.388459 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1578b95d-8bee-40fa-90f8-96d6ce75147b None admin] Authenticating user token {{(pid=479852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:18:23.404805 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b07f514d-276d-4df9-b669-850a5ff93b71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479851) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:18:23.405945 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07f514d-276d-4df9-b669-850a5ff93b71 None admin] REQUEST_METHOD: `GET` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:18:23.406298 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07f514d-276d-4df9-b669-850a5ff93b71 None admin] SCRIPT_NAME: `/identity` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:18:23.406653 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07f514d-276d-4df9-b669-850a5ff93b71 None admin] PATH_INFO: `/v3/users/ab8fbe19586f4baf86846ca0a77ea800` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:18:23.408252 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b07f514d-276d-4df9-b669-850a5ff93b71 None admin] RBAC: Authorizing `identity:get_user(user_id=ab8fbe19586f4baf86846ca0a77ea800)` {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:18:23.410267 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b07f514d-276d-4df9-b669-850a5ff93b71 None admin] RBAC: Authorization granted {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:18:23.412737 dv-cinder-851351-1-smb devstack@keystone.service[479851]: [pid: 479851|app: 0|req: 96/200] 10.222.0.42 () {56 vars in 1177 bytes} [Thu Jul 28 09:18:23 2022] GET /identity/v3/users/ab8fbe19586f4baf86846ca0a77ea800 => generated 283 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:18:23.413669 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b07f514d-276d-4df9-b669-850a5ff93b71 None admin] Authenticating user token {{(pid=479851) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:18:23.503937 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG dbcounter [-] [479852] Writing DB stats keystone:SELECT=100 {{(pid=479852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:18:23.513787 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1578b95d-8bee-40fa-90f8-96d6ce75147b None admin] Validating token access rules against request {{(pid=479852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:18:23.544216 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b07f514d-276d-4df9-b669-850a5ff93b71 None admin] Validating token access rules against request {{(pid=479851) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:18:23.558979 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25018274-b057-4a71-840a-d2ce4ce40180 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:18:23.559803 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25018274-b057-4a71-840a-d2ce4ce40180 None admin] REQUEST_METHOD: `GET` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:18:23.560091 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25018274-b057-4a71-840a-d2ce4ce40180 None admin] SCRIPT_NAME: `/identity` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:18:23.560372 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25018274-b057-4a71-840a-d2ce4ce40180 None admin] PATH_INFO: `/v3/projects/ef022c0e613d4a2bac6fe1e0e339b92c` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:18:23.562230 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25018274-b057-4a71-840a-d2ce4ce40180 None admin] RBAC: Authorizing `identity:get_project(project_id=ef022c0e613d4a2bac6fe1e0e339b92c)` {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:18:23.564132 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25018274-b057-4a71-840a-d2ce4ce40180 None admin] RBAC: Authorization granted {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:18:23.566258 dv-cinder-851351-1-smb devstack@keystone.service[479852]: [pid: 479852|app: 0|req: 105/201] 10.222.0.42 () {56 vars in 1186 bytes} [Thu Jul 28 09:18:23 2022] GET /identity/v3/projects/ef022c0e613d4a2bac6fe1e0e339b92c => generated 302 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:18:23.567144 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25018274-b057-4a71-840a-d2ce4ce40180 None admin] Authenticating user token {{(pid=479852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:18:23.589690 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643ffbaa-a5d1-40fd-bec3-49bf7fc2c6c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479851) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:18:23.590365 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643ffbaa-a5d1-40fd-bec3-49bf7fc2c6c4 None admin] REQUEST_METHOD: `GET` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:18:23.590784 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643ffbaa-a5d1-40fd-bec3-49bf7fc2c6c4 None admin] SCRIPT_NAME: `/identity` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:18:23.591073 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643ffbaa-a5d1-40fd-bec3-49bf7fc2c6c4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:18:23.609330 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG dbcounter [-] [479851] Writing DB stats keystone:SELECT=100 {{(pid=479851) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:18:23.671439 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-643ffbaa-a5d1-40fd-bec3-49bf7fc2c6c4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:18:23.673694 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-643ffbaa-a5d1-40fd-bec3-49bf7fc2c6c4 None admin] RBAC: Authorization granted {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:18:23.695775 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25018274-b057-4a71-840a-d2ce4ce40180 None admin] Validating token access rules against request {{(pid=479852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:18:23.741497 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb60abd-6132-4c5b-bde0-012e597e662a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:18:23.742151 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb60abd-6132-4c5b-bde0-012e597e662a None admin] REQUEST_METHOD: `GET` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:18:23.742695 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb60abd-6132-4c5b-bde0-012e597e662a None admin] SCRIPT_NAME: `/identity` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:18:23.742985 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb60abd-6132-4c5b-bde0-012e597e662a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:18:23.765097 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG dbcounter [-] [479852] Writing DB stats keystone:SELECT=100 {{(pid=479852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:18:23.799820 dv-cinder-851351-1-smb devstack@keystone.service[479851]: [pid: 479851|app: 0|req: 97/202] 10.222.0.42 () {58 vars in 1282 bytes} [Thu Jul 28 09:18:23 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 386 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 28 09:18:23.801430 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643ffbaa-a5d1-40fd-bec3-49bf7fc2c6c4 None admin] Authenticating user token {{(pid=479851) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:18:23.827524 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb60abd-6132-4c5b-bde0-012e597e662a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:18:23.829050 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb60abd-6132-4c5b-bde0-012e597e662a None admin] RBAC: Authorization granted {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:18:23.860599 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG dbcounter [-] [479851] Writing DB stats keystone:SELECT=100 {{(pid=479851) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:18:23.928335 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643ffbaa-a5d1-40fd-bec3-49bf7fc2c6c4 None admin] Validating token access rules against request {{(pid=479851) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:18:23.958308 dv-cinder-851351-1-smb devstack@keystone.service[479852]: [pid: 479852|app: 0|req: 106/203] 10.222.0.42 () {58 vars in 1282 bytes} [Thu Jul 28 09:18:23 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 391 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 28 09:18:23.959000 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb60abd-6132-4c5b-bde0-012e597e662a None admin] Authenticating user token {{(pid=479852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:18:23.979861 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d936b1e3-37ea-4e73-8151-7c3c7a87c847 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479851) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:18:23.980980 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d936b1e3-37ea-4e73-8151-7c3c7a87c847 None admin] REQUEST_METHOD: `GET` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:18:23.981489 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d936b1e3-37ea-4e73-8151-7c3c7a87c847 None admin] SCRIPT_NAME: `/identity` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:18:23.982068 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d936b1e3-37ea-4e73-8151-7c3c7a87c847 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:18:23.983225 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d936b1e3-37ea-4e73-8151-7c3c7a87c847 None admin] RBAC: Adding query filter params (role.id=685084310b35477b9b2d0c7934d0f803, scope.project.id=ef022c0e613d4a2bac6fe1e0e339b92c, user.id=ab8fbe19586f4baf86846ca0a77ea800) {{(pid=479851) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 09:18:23.983760 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d936b1e3-37ea-4e73-8151-7c3c7a87c847 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:18:23.985631 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d936b1e3-37ea-4e73-8151-7c3c7a87c847 None admin] RBAC: Authorization granted {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:18:23.993028 dv-cinder-851351-1-smb devstack@keystone.service[479851]: [pid: 479851|app: 0|req: 98/204] 10.222.0.42 () {56 vars in 1374 bytes} [Thu Jul 28 09:18:23 2022] GET /identity/v3/role_assignments?user.id=ab8fbe19586f4baf86846ca0a77ea800&scope.project.id=ef022c0e613d4a2bac6fe1e0e339b92c&role.id=685084310b35477b9b2d0c7934d0f803 => generated 259 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:18:23.994351 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d936b1e3-37ea-4e73-8151-7c3c7a87c847 None admin] Authenticating user token {{(pid=479851) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:18:24.059461 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG dbcounter [-] [479852] Writing DB stats keystone:SELECT=100 {{(pid=479852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:18:24.121415 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb60abd-6132-4c5b-bde0-012e597e662a None admin] Validating token access rules against request {{(pid=479852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:18:24.171038 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d936b1e3-37ea-4e73-8151-7c3c7a87c847 None admin] Validating token access rules against request {{(pid=479851) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:18:24.194980 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG dbcounter [-] [479851] Writing DB stats keystone:SELECT=100 {{(pid=479851) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:18:24.202790 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589dc6d9-0370-4ce3-83c8-cc03b089f624 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:18:24.203494 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589dc6d9-0370-4ce3-83c8-cc03b089f624 None admin] REQUEST_METHOD: `GET` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:18:24.203776 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589dc6d9-0370-4ce3-83c8-cc03b089f624 None admin] SCRIPT_NAME: `/identity` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:18:24.204054 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589dc6d9-0370-4ce3-83c8-cc03b089f624 None admin] PATH_INFO: `/v3/projects/580eb2f23f9049b18bb38dce6f6f9b4f` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:18:24.206751 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-589dc6d9-0370-4ce3-83c8-cc03b089f624 None admin] RBAC: Authorizing `identity:get_project(project_id=580eb2f23f9049b18bb38dce6f6f9b4f)` {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:18:24.208290 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-589dc6d9-0370-4ce3-83c8-cc03b089f624 None admin] RBAC: Authorization granted {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:18:24.210451 dv-cinder-851351-1-smb devstack@keystone.service[479852]: [pid: 479852|app: 0|req: 107/205] 10.222.0.42 () {56 vars in 1186 bytes} [Thu Jul 28 09:18:23 2022] GET /identity/v3/projects/580eb2f23f9049b18bb38dce6f6f9b4f => generated 298 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:18:24.218014 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589dc6d9-0370-4ce3-83c8-cc03b089f624 None admin] Authenticating user token {{(pid=479852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:18:24.247025 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-869d5012-8545-4926-9e06-0f3cce0b5b9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479851) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:18:24.247717 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869d5012-8545-4926-9e06-0f3cce0b5b9e None admin] REQUEST_METHOD: `GET` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:18:24.248006 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869d5012-8545-4926-9e06-0f3cce0b5b9e None admin] SCRIPT_NAME: `/identity` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:18:24.248289 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869d5012-8545-4926-9e06-0f3cce0b5b9e None admin] PATH_INFO: `/v3/projects/ef022c0e613d4a2bac6fe1e0e339b92c` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:18:24.251041 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-869d5012-8545-4926-9e06-0f3cce0b5b9e None admin] RBAC: Authorizing `identity:get_project(project_id=ef022c0e613d4a2bac6fe1e0e339b92c)` {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:18:24.251285 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-869d5012-8545-4926-9e06-0f3cce0b5b9e None admin] RBAC: Authorization granted {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:18:24.255442 dv-cinder-851351-1-smb devstack@keystone.service[479851]: [pid: 479851|app: 0|req: 99/206] 10.222.0.42 () {56 vars in 1186 bytes} [Thu Jul 28 09:18:23 2022] GET /identity/v3/projects/ef022c0e613d4a2bac6fe1e0e339b92c => generated 302 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:18:24.262941 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-869d5012-8545-4926-9e06-0f3cce0b5b9e None admin] Authenticating user token {{(pid=479851) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:18:24.357237 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589dc6d9-0370-4ce3-83c8-cc03b089f624 None admin] Validating token access rules against request {{(pid=479852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:18:24.377525 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG dbcounter [-] [479852] Writing DB stats keystone:SELECT=100 {{(pid=479852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:18:24.400705 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afdf80e3-0750-4500-9ec4-e422ad0f7ded None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:18:24.401344 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afdf80e3-0750-4500-9ec4-e422ad0f7ded None admin] REQUEST_METHOD: `GET` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:18:24.401632 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afdf80e3-0750-4500-9ec4-e422ad0f7ded None admin] SCRIPT_NAME: `/identity` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:18:24.401910 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afdf80e3-0750-4500-9ec4-e422ad0f7ded None admin] PATH_INFO: `/v3/role_assignments` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:18:24.402934 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afdf80e3-0750-4500-9ec4-e422ad0f7ded None admin] RBAC: Adding query filter params (role.id=73525379110b4a99850473e0e9f217f1, scope.project.id=580eb2f23f9049b18bb38dce6f6f9b4f, user.id=2046089722a34a57bc743a56cc5e395a) {{(pid=479852) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 09:18:24.403146 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afdf80e3-0750-4500-9ec4-e422ad0f7ded None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:18:24.404595 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afdf80e3-0750-4500-9ec4-e422ad0f7ded None admin] RBAC: Authorization granted {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:18:24.417232 dv-cinder-851351-1-smb devstack@keystone.service[479852]: [pid: 479852|app: 0|req: 108/207] 10.222.0.42 () {56 vars in 1374 bytes} [Thu Jul 28 09:18:24 2022] GET /identity/v3/role_assignments?user.id=2046089722a34a57bc743a56cc5e395a&scope.project.id=580eb2f23f9049b18bb38dce6f6f9b4f&role.id=73525379110b4a99850473e0e9f217f1 => generated 608 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:18:24.445588 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-869d5012-8545-4926-9e06-0f3cce0b5b9e None admin] Validating token access rules against request {{(pid=479851) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:18:24.500339 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f51bb0-7d09-488e-95aa-30e863d766fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479851) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:18:24.501027 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f51bb0-7d09-488e-95aa-30e863d766fc None admin] REQUEST_METHOD: `GET` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:18:24.501318 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f51bb0-7d09-488e-95aa-30e863d766fc None admin] SCRIPT_NAME: `/identity` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:18:24.501603 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f51bb0-7d09-488e-95aa-30e863d766fc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:18:24.502436 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33f51bb0-7d09-488e-95aa-30e863d766fc None admin] RBAC: Adding query filter params (role.id=acf1d2de5e5448beb6363dae3d154a02, scope.project.id=ef022c0e613d4a2bac6fe1e0e339b92c, user.id=ab8fbe19586f4baf86846ca0a77ea800) {{(pid=479851) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 09:18:24.502756 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33f51bb0-7d09-488e-95aa-30e863d766fc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:18:24.504293 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33f51bb0-7d09-488e-95aa-30e863d766fc None admin] RBAC: Authorization granted {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:18:24.511450 dv-cinder-851351-1-smb devstack@keystone.service[479851]: [pid: 479851|app: 0|req: 100/208] 10.222.0.42 () {56 vars in 1374 bytes} [Thu Jul 28 09:18:24 2022] GET /identity/v3/role_assignments?user.id=ab8fbe19586f4baf86846ca0a77ea800&scope.project.id=ef022c0e613d4a2bac6fe1e0e339b92c&role.id=acf1d2de5e5448beb6363dae3d154a02 => generated 259 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:18:25.264409 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74589a82-29cf-4e89-9f24-12e7773c10af None None] REQUEST_METHOD: `GET` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:18:25.265033 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74589a82-29cf-4e89-9f24-12e7773c10af None None] SCRIPT_NAME: `/identity` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:18:25.265033 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74589a82-29cf-4e89-9f24-12e7773c10af None None] PATH_INFO: `/` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:18:25.266384 dv-cinder-851351-1-smb devstack@keystone.service[479852]: [pid: 479852|app: 0|req: 109/209] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 09:18:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 09:18:25.271948 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ca69c0-a4be-4bec-a1e5-3b98acabdda2 None None] REQUEST_METHOD: `POST` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:18:25.272498 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ca69c0-a4be-4bec-a1e5-3b98acabdda2 None None] SCRIPT_NAME: `/identity` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:18:25.272588 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ca69c0-a4be-4bec-a1e5-3b98acabdda2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:18:25.291897 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.auth.core [None req-d7ca69c0-a4be-4bec-a1e5-3b98acabdda2 None None] MFA Rules not processed for user `c198f91a4ae84d2b9cc730a6e304c2be`. Rule list: `[]` (Enabled: `True`). {{(pid=479851) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 09:18:25.293153 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.fernet_utils [None req-d7ca69c0-a4be-4bec-a1e5-3b98acabdda2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=479851) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 09:18:25.332808 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG dbcounter [-] [479851] Writing DB stats keystone:SELECT=100 {{(pid=479851) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:18:25.367433 dv-cinder-851351-1-smb devstack@keystone.service[479851]: [pid: 479851|app: 0|req: 101/210] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 09:18:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 09:18:25.389827 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74589a82-29cf-4e89-9f24-12e7773c10af None None] Authenticating user token {{(pid=479852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:18:25.466770 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da58fdce-9871-4ae9-bf91-acf73ba1d713 None None] REQUEST_METHOD: `GET` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:18:25.467107 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da58fdce-9871-4ae9-bf91-acf73ba1d713 None None] SCRIPT_NAME: `/identity` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:18:25.467342 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da58fdce-9871-4ae9-bf91-acf73ba1d713 None None] PATH_INFO: `/` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:18:25.468902 dv-cinder-851351-1-smb devstack@keystone.service[479851]: [pid: 479851|app: 0|req: 102/211] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 09:18:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 28 09:18:25.475317 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a7999f-4b81-4485-86af-6382a4853aa7 None None] REQUEST_METHOD: `POST` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:18:25.475609 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a7999f-4b81-4485-86af-6382a4853aa7 None None] SCRIPT_NAME: `/identity` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:18:25.475894 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a7999f-4b81-4485-86af-6382a4853aa7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:18:25.495636 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.auth.core [None req-17a7999f-4b81-4485-86af-6382a4853aa7 None None] MFA Rules not processed for user `c198f91a4ae84d2b9cc730a6e304c2be`. Rule list: `[]` (Enabled: `True`). {{(pid=479851) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 09:18:25.496959 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.fernet_utils [None req-17a7999f-4b81-4485-86af-6382a4853aa7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=479851) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 09:18:25.498175 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74589a82-29cf-4e89-9f24-12e7773c10af None None] Validating token access rules against request {{(pid=479852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:18:25.538579 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da46e822-de66-4251-8f3d-4f87ff8df9c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:18:25.539207 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da46e822-de66-4251-8f3d-4f87ff8df9c7 None admin] REQUEST_METHOD: `GET` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:18:25.539499 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da46e822-de66-4251-8f3d-4f87ff8df9c7 None admin] SCRIPT_NAME: `/identity` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:18:25.539781 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da46e822-de66-4251-8f3d-4f87ff8df9c7 None admin] PATH_INFO: `/v3/roles/member` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:18:25.551245 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da46e822-de66-4251-8f3d-4f87ff8df9c7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 09:18:25.557448 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application [None req-da46e822-de66-4251-8f3d-4f87ff8df9c7 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 28 09:18:25.557448 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 09:18:25.557448 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 09:18:25.557448 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 09:18:25.557448 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 09:18:25.557448 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 09:18:25.557448 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 09:18:25.557448 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 09:18:25.557448 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 09:18:25.557448 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 09:18:25.557448 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 09:18:25.557448 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 09:18:25.557448 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 09:18:25.557448 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 09:18:25.557448 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 09:18:25.557448 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 09:18:25.558539 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 09:18:25.558539 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 09:18:25.558539 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 09:18:25.558539 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 09:18:25.558539 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 09:18:25.558539 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 09:18:25.558539 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 09:18:25.558539 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 09:18:25.558539 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 09:18:25.558539 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 09:18:25.558539 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 09:18:25.558539 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application with Lock( Jul 28 09:18:25.558539 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 09:18:25.558539 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self._enter() Jul 28 09:18:25.558539 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 09:18:25.558539 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 09:18:25.559612 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 09:18:25.559612 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self.creator() Jul 28 09:18:25.559612 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 09:18:25.559612 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application created_value = creator( Jul 28 09:18:25.559612 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 09:18:25.559612 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 09:18:25.559612 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 09:18:25.559612 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 09:18:25.559612 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 09:18:25.559612 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 09:18:25.559612 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 28 09:18:25.559612 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application Jul 28 09:18:25.563861 dv-cinder-851351-1-smb devstack@keystone.service[479852]: [pid: 479852|app: 0|req: 110/212] 10.222.0.42 () {56 vars in 1099 bytes} [Thu Jul 28 09:18:25 2022] GET /identity/v3/roles/member => generated 84 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 09:18:25.564878 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da46e822-de66-4251-8f3d-4f87ff8df9c7 None admin] Authenticating user token {{(pid=479852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:18:25.579626 dv-cinder-851351-1-smb devstack@keystone.service[479851]: [pid: 479851|app: 0|req: 103/213] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 09:18:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 28 09:18:25.603618 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a7999f-4b81-4485-86af-6382a4853aa7 None None] Authenticating user token {{(pid=479851) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:18:25.615386 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG dbcounter [-] [479852] Writing DB stats keystone:SELECT=100 {{(pid=479852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:18:25.681374 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da46e822-de66-4251-8f3d-4f87ff8df9c7 None admin] Validating token access rules against request {{(pid=479852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:18:25.718353 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60dfadad-cbaf-4c17-818c-036bb70d9647 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:18:25.719099 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60dfadad-cbaf-4c17-818c-036bb70d9647 None admin] REQUEST_METHOD: `GET` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:18:25.719441 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60dfadad-cbaf-4c17-818c-036bb70d9647 None admin] SCRIPT_NAME: `/identity` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:18:25.719790 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60dfadad-cbaf-4c17-818c-036bb70d9647 None admin] PATH_INFO: `/v3/roles` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:18:25.720593 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60dfadad-cbaf-4c17-818c-036bb70d9647 None admin] RBAC: Adding query filter params (name=member) {{(pid=479852) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 09:18:25.721004 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60dfadad-cbaf-4c17-818c-036bb70d9647 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:18:25.722463 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60dfadad-cbaf-4c17-818c-036bb70d9647 None admin] RBAC: Authorization granted {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:18:25.731935 dv-cinder-851351-1-smb devstack@keystone.service[479852]: [pid: 479852|app: 0|req: 111/214] 10.222.0.42 () {56 vars in 1101 bytes} [Thu Jul 28 09:18:25 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:18:25.737609 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60dfadad-cbaf-4c17-818c-036bb70d9647 None admin] Authenticating user token {{(pid=479852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:18:25.743791 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a7999f-4b81-4485-86af-6382a4853aa7 None None] Validating token access rules against request {{(pid=479851) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:18:25.746122 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG dbcounter [-] [479851] Writing DB stats keystone:SELECT=100 {{(pid=479851) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:18:25.795091 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b50767-9e34-4a03-a62f-191e4d6e1dff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479851) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:18:25.796410 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b50767-9e34-4a03-a62f-191e4d6e1dff None admin] REQUEST_METHOD: `GET` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:18:25.796947 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b50767-9e34-4a03-a62f-191e4d6e1dff None admin] SCRIPT_NAME: `/identity` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:18:25.797985 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b50767-9e34-4a03-a62f-191e4d6e1dff None admin] PATH_INFO: `/v3/domains/default` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:18:25.799675 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b50767-9e34-4a03-a62f-191e4d6e1dff None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:18:25.802054 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b50767-9e34-4a03-a62f-191e4d6e1dff None admin] RBAC: Authorization granted {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:18:25.804964 dv-cinder-851351-1-smb devstack@keystone.service[479851]: [pid: 479851|app: 0|req: 104/215] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 09:18:25 2022] GET /identity/v3/domains/default => generated 199 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 09:18:25.811016 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b50767-9e34-4a03-a62f-191e4d6e1dff None admin] Authenticating user token {{(pid=479851) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:18:25.894250 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60dfadad-cbaf-4c17-818c-036bb70d9647 None admin] Validating token access rules against request {{(pid=479852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:18:25.898429 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG dbcounter [-] [479852] Writing DB stats keystone:SELECT=100 {{(pid=479852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:18:25.938587 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556ed01f-2ab0-4418-9822-0d34e2f31612 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:18:25.939244 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556ed01f-2ab0-4418-9822-0d34e2f31612 None admin] REQUEST_METHOD: `GET` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:18:25.939577 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556ed01f-2ab0-4418-9822-0d34e2f31612 None admin] SCRIPT_NAME: `/identity` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:18:25.939851 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556ed01f-2ab0-4418-9822-0d34e2f31612 None admin] PATH_INFO: `/v3/users/ca3be4ca4e38489d97ebdcc8800b96c0` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:18:25.959008 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-556ed01f-2ab0-4418-9822-0d34e2f31612 None admin] RBAC: Authorizing `identity:get_user(user_id=ca3be4ca4e38489d97ebdcc8800b96c0)` {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:18:25.960653 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-556ed01f-2ab0-4418-9822-0d34e2f31612 None admin] RBAC: Authorization granted {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:18:25.962920 dv-cinder-851351-1-smb devstack@keystone.service[479852]: [pid: 479852|app: 0|req: 112/216] 10.222.0.42 () {56 vars in 1177 bytes} [Thu Jul 28 09:18:25 2022] GET /identity/v3/users/ca3be4ca4e38489d97ebdcc8800b96c0 => generated 297 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:18:25.971031 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556ed01f-2ab0-4418-9822-0d34e2f31612 None admin] Authenticating user token {{(pid=479852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:18:26.029322 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b50767-9e34-4a03-a62f-191e4d6e1dff None admin] Validating token access rules against request {{(pid=479851) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:18:26.078098 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4a1d88-48b3-49a2-a493-f5d6859d68ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479851) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:18:26.079038 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4a1d88-48b3-49a2-a493-f5d6859d68ee None admin] REQUEST_METHOD: `POST` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:18:26.079502 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4a1d88-48b3-49a2-a493-f5d6859d68ee None admin] SCRIPT_NAME: `/identity` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:18:26.080531 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4a1d88-48b3-49a2-a493-f5d6859d68ee None admin] PATH_INFO: `/v3/users` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:18:26.081563 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e4a1d88-48b3-49a2-a493-f5d6859d68ee None admin] RBAC: Authorizing `identity:create_user()` {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:18:26.083639 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e4a1d88-48b3-49a2-a493-f5d6859d68ee None admin] RBAC: Authorization granted {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:18:26.093091 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556ed01f-2ab0-4418-9822-0d34e2f31612 None admin] Validating token access rules against request {{(pid=479852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:18:26.121119 dv-cinder-851351-1-smb devstack@keystone.service[479851]: [pid: 479851|app: 0|req: 105/217] 10.222.0.42 () {60 vars in 1132 bytes} [Thu Jul 28 09:18:25 2022] POST /identity/v3/users => generated 297 bytes in 310 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 09:18:26.144080 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0275d2e6-ee89-44d9-b439-389fba2afff2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:18:26.144807 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0275d2e6-ee89-44d9-b439-389fba2afff2 None admin] REQUEST_METHOD: `GET` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:18:26.145143 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0275d2e6-ee89-44d9-b439-389fba2afff2 None admin] SCRIPT_NAME: `/identity` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:18:26.145481 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0275d2e6-ee89-44d9-b439-389fba2afff2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:18:26.183334 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG dbcounter [-] [479852] Writing DB stats keystone:SELECT=100 {{(pid=479852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:18:26.228299 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0275d2e6-ee89-44d9-b439-389fba2afff2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:18:26.229854 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0275d2e6-ee89-44d9-b439-389fba2afff2 None admin] RBAC: Authorization granted {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:18:26.262567 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809702c1-1513-4c7b-bbeb-0ef1193801d0 None None] REQUEST_METHOD: `GET` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:18:26.262907 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809702c1-1513-4c7b-bbeb-0ef1193801d0 None None] SCRIPT_NAME: `/identity` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:18:26.263136 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809702c1-1513-4c7b-bbeb-0ef1193801d0 None None] PATH_INFO: `/` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:18:26.268879 dv-cinder-851351-1-smb devstack@keystone.service[479851]: [pid: 479851|app: 0|req: 106/218] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 09:18:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 09:18:26.270706 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-addbda10-3377-4262-be03-53cafe91366d None None] REQUEST_METHOD: `POST` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:18:26.271007 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-addbda10-3377-4262-be03-53cafe91366d None None] SCRIPT_NAME: `/identity` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:18:26.271291 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-addbda10-3377-4262-be03-53cafe91366d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:18:26.290133 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.auth.core [None req-addbda10-3377-4262-be03-53cafe91366d None None] MFA Rules not processed for user `c198f91a4ae84d2b9cc730a6e304c2be`. Rule list: `[]` (Enabled: `True`). {{(pid=479851) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 09:18:26.291377 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.fernet_utils [None req-addbda10-3377-4262-be03-53cafe91366d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=479851) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 09:18:26.320570 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG dbcounter [-] [479851] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=479851) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:18:26.356413 dv-cinder-851351-1-smb devstack@keystone.service[479852]: [pid: 479852|app: 0|req: 113/219] 10.222.0.42 () {58 vars in 1282 bytes} [Thu Jul 28 09:18:25 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 386 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 28 09:18:26.362563 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0275d2e6-ee89-44d9-b439-389fba2afff2 None admin] Authenticating user token {{(pid=479852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:18:26.382255 dv-cinder-851351-1-smb devstack@keystone.service[479851]: [pid: 479851|app: 0|req: 107/220] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 09:18:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 09:18:26.406535 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-addbda10-3377-4262-be03-53cafe91366d None None] Authenticating user token {{(pid=479851) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:18:26.452864 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG dbcounter [-] [479852] Writing DB stats keystone:SELECT=100 {{(pid=479852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:18:26.500630 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0275d2e6-ee89-44d9-b439-389fba2afff2 None admin] Validating token access rules against request {{(pid=479852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:18:26.542383 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-addbda10-3377-4262-be03-53cafe91366d None None] Validating token access rules against request {{(pid=479851) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:18:26.551394 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70006b0b-666a-4b25-8ca5-56ac2738ca60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:18:26.552639 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70006b0b-666a-4b25-8ca5-56ac2738ca60 None admin] REQUEST_METHOD: `GET` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:18:26.553004 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70006b0b-666a-4b25-8ca5-56ac2738ca60 None admin] SCRIPT_NAME: `/identity` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:18:26.553281 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70006b0b-666a-4b25-8ca5-56ac2738ca60 None admin] PATH_INFO: `/v3/projects/ef022c0e613d4a2bac6fe1e0e339b92c` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:18:26.554699 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70006b0b-666a-4b25-8ca5-56ac2738ca60 None admin] RBAC: Authorizing `identity:get_project(project_id=ef022c0e613d4a2bac6fe1e0e339b92c)` {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:18:26.556274 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70006b0b-666a-4b25-8ca5-56ac2738ca60 None admin] RBAC: Authorization granted {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:18:26.559293 dv-cinder-851351-1-smb devstack@keystone.service[479852]: [pid: 479852|app: 0|req: 114/221] 10.222.0.42 () {56 vars in 1186 bytes} [Thu Jul 28 09:18:26 2022] GET /identity/v3/projects/ef022c0e613d4a2bac6fe1e0e339b92c => generated 302 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:18:26.564344 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70006b0b-666a-4b25-8ca5-56ac2738ca60 None admin] Authenticating user token {{(pid=479852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:18:26.592837 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb69658f-a39f-42d9-b2ce-7e42d98329a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479851) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:18:26.594199 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb69658f-a39f-42d9-b2ce-7e42d98329a1 None admin] REQUEST_METHOD: `GET` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:18:26.594705 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb69658f-a39f-42d9-b2ce-7e42d98329a1 None admin] SCRIPT_NAME: `/identity` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:18:26.595085 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb69658f-a39f-42d9-b2ce-7e42d98329a1 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:18:26.609814 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb69658f-a39f-42d9-b2ce-7e42d98329a1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 09:18:26.617199 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application [None req-cb69658f-a39f-42d9-b2ce-7e42d98329a1 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 09:18:26.617199 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 09:18:26.617199 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 09:18:26.617199 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 09:18:26.617199 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 09:18:26.617199 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 09:18:26.617199 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 09:18:26.617199 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 09:18:26.617199 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 09:18:26.617199 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 09:18:26.617199 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 09:18:26.617199 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 09:18:26.617199 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 09:18:26.617199 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 09:18:26.617199 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 09:18:26.617199 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 09:18:26.618330 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 09:18:26.618330 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 09:18:26.618330 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 09:18:26.618330 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 09:18:26.618330 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 09:18:26.618330 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 09:18:26.618330 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 09:18:26.618330 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 09:18:26.618330 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 09:18:26.618330 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 09:18:26.618330 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 09:18:26.618330 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application with Lock( Jul 28 09:18:26.618330 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 09:18:26.618330 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return self._enter() Jul 28 09:18:26.618330 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 09:18:26.618330 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 09:18:26.619319 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 09:18:26.619319 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return self.creator() Jul 28 09:18:26.619319 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 09:18:26.619319 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application created_value = creator( Jul 28 09:18:26.619319 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 09:18:26.619319 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 09:18:26.619319 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 09:18:26.619319 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 09:18:26.619319 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 09:18:26.619319 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 09:18:26.619319 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 09:18:26.619319 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application Jul 28 09:18:26.619319 dv-cinder-851351-1-smb devstack@keystone.service[479851]: [pid: 479851|app: 0|req: 108/222] 10.222.0.42 () {56 vars in 1096 bytes} [Thu Jul 28 09:18:26 2022] GET /identity/v3/roles/admin => generated 83 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 09:18:26.625163 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb69658f-a39f-42d9-b2ce-7e42d98329a1 None admin] Authenticating user token {{(pid=479851) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:18:26.645764 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG dbcounter [-] [479851] Writing DB stats keystone:SELECT=100 {{(pid=479851) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:18:26.681347 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70006b0b-666a-4b25-8ca5-56ac2738ca60 None admin] Validating token access rules against request {{(pid=479852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:18:26.744294 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG dbcounter [-] [479852] Writing DB stats keystone:SELECT=100 {{(pid=479852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:18:26.753610 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2237345-cb2c-4717-986b-8da93dafb574 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:18:26.754426 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2237345-cb2c-4717-986b-8da93dafb574 None admin] REQUEST_METHOD: `GET` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:18:26.754710 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2237345-cb2c-4717-986b-8da93dafb574 None admin] SCRIPT_NAME: `/identity` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:18:26.755376 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2237345-cb2c-4717-986b-8da93dafb574 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:18:26.756574 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2237345-cb2c-4717-986b-8da93dafb574 None admin] RBAC: Adding query filter params (role.id=900fb424e172461d93a0db59afb0a12b, scope.project.id=ef022c0e613d4a2bac6fe1e0e339b92c, user.id=ca3be4ca4e38489d97ebdcc8800b96c0) {{(pid=479852) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 09:18:26.756918 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2237345-cb2c-4717-986b-8da93dafb574 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:18:26.758832 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2237345-cb2c-4717-986b-8da93dafb574 None admin] RBAC: Authorization granted {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:18:26.766694 dv-cinder-851351-1-smb devstack@keystone.service[479852]: [pid: 479852|app: 0|req: 115/223] 10.222.0.42 () {56 vars in 1374 bytes} [Thu Jul 28 09:18:26 2022] GET /identity/v3/role_assignments?user.id=ca3be4ca4e38489d97ebdcc8800b96c0&scope.project.id=ef022c0e613d4a2bac6fe1e0e339b92c&role.id=900fb424e172461d93a0db59afb0a12b => generated 259 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:18:26.768496 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02fab776-9775-4238-9933-cc20e20ff602 None None] REQUEST_METHOD: `GET` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:18:26.769077 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02fab776-9775-4238-9933-cc20e20ff602 None None] SCRIPT_NAME: `/identity` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:18:26.769364 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02fab776-9775-4238-9933-cc20e20ff602 None None] PATH_INFO: `/` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:18:26.771492 dv-cinder-851351-1-smb devstack@keystone.service[479852]: [pid: 479852|app: 0|req: 116/224] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 09:18:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 09:18:26.777941 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d41baa-5c8f-4cd4-80c0-7e273f095779 None None] REQUEST_METHOD: `POST` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:18:26.778297 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d41baa-5c8f-4cd4-80c0-7e273f095779 None None] SCRIPT_NAME: `/identity` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:18:26.778404 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb69658f-a39f-42d9-b2ce-7e42d98329a1 None admin] Validating token access rules against request {{(pid=479851) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:18:26.778501 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d41baa-5c8f-4cd4-80c0-7e273f095779 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:18:26.805921 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.auth.core [None req-60d41baa-5c8f-4cd4-80c0-7e273f095779 None None] MFA Rules not processed for user `c198f91a4ae84d2b9cc730a6e304c2be`. Rule list: `[]` (Enabled: `True`). {{(pid=479852) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 09:18:26.807791 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.fernet_utils [None req-60d41baa-5c8f-4cd4-80c0-7e273f095779 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=479852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 09:18:26.881967 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15c6ad1-c4e4-44c9-831d-cde3a254f27c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479851) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:18:26.884160 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15c6ad1-c4e4-44c9-831d-cde3a254f27c None admin] REQUEST_METHOD: `GET` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:18:26.884722 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15c6ad1-c4e4-44c9-831d-cde3a254f27c None admin] SCRIPT_NAME: `/identity` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:18:26.887060 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15c6ad1-c4e4-44c9-831d-cde3a254f27c None admin] PATH_INFO: `/v3/roles` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:18:26.887991 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c15c6ad1-c4e4-44c9-831d-cde3a254f27c None admin] RBAC: Adding query filter params (name=admin) {{(pid=479851) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 09:18:26.888313 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c15c6ad1-c4e4-44c9-831d-cde3a254f27c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:18:26.891432 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c15c6ad1-c4e4-44c9-831d-cde3a254f27c None admin] RBAC: Authorization granted {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:18:26.910996 dv-cinder-851351-1-smb devstack@keystone.service[479851]: [pid: 479851|app: 0|req: 109/225] 10.222.0.42 () {56 vars in 1099 bytes} [Thu Jul 28 09:18:26 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 286 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 09:18:26.917016 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15c6ad1-c4e4-44c9-831d-cde3a254f27c None admin] Authenticating user token {{(pid=479851) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:18:26.933998 dv-cinder-851351-1-smb devstack@keystone.service[479852]: [pid: 479852|app: 0|req: 117/226] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 09:18:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 28 09:18:26.982057 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d41baa-5c8f-4cd4-80c0-7e273f095779 None None] Authenticating user token {{(pid=479852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:18:27.035875 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG dbcounter [-] [479851] Writing DB stats keystone:SELECT=100 {{(pid=479851) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:18:27.062754 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15c6ad1-c4e4-44c9-831d-cde3a254f27c None admin] Validating token access rules against request {{(pid=479851) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:18:27.129597 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8685b4fe-b4c8-4451-9123-a94f5318478a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479851) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:18:27.130674 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8685b4fe-b4c8-4451-9123-a94f5318478a None admin] REQUEST_METHOD: `GET` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:18:27.131198 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8685b4fe-b4c8-4451-9123-a94f5318478a None admin] SCRIPT_NAME: `/identity` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:18:27.131718 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8685b4fe-b4c8-4451-9123-a94f5318478a None admin] PATH_INFO: `/v3/users/ab8fbe19586f4baf86846ca0a77ea800` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:18:27.134591 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8685b4fe-b4c8-4451-9123-a94f5318478a None admin] RBAC: Authorizing `identity:get_user(user_id=ab8fbe19586f4baf86846ca0a77ea800)` {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:18:27.136351 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8685b4fe-b4c8-4451-9123-a94f5318478a None admin] RBAC: Authorization granted {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:18:27.138335 dv-cinder-851351-1-smb devstack@keystone.service[479851]: [pid: 479851|app: 0|req: 110/227] 10.222.0.42 () {56 vars in 1177 bytes} [Thu Jul 28 09:18:26 2022] GET /identity/v3/users/ab8fbe19586f4baf86846ca0a77ea800 => generated 283 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:18:27.153741 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8685b4fe-b4c8-4451-9123-a94f5318478a None admin] Authenticating user token {{(pid=479851) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:18:27.161292 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d41baa-5c8f-4cd4-80c0-7e273f095779 None None] Validating token access rules against request {{(pid=479852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:18:27.187627 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG dbcounter [-] [479852] Writing DB stats keystone:SELECT=100 {{(pid=479852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:18:27.202578 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2cc0cce-a8f4-4739-8338-fcdc5c58e40a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:18:27.203257 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2cc0cce-a8f4-4739-8338-fcdc5c58e40a None admin] REQUEST_METHOD: `GET` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:18:27.203537 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2cc0cce-a8f4-4739-8338-fcdc5c58e40a None admin] SCRIPT_NAME: `/identity` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:18:27.203812 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2cc0cce-a8f4-4739-8338-fcdc5c58e40a None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:18:27.225236 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2cc0cce-a8f4-4739-8338-fcdc5c58e40a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 09:18:27.230308 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application [None req-d2cc0cce-a8f4-4739-8338-fcdc5c58e40a None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 28 09:18:27.230308 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 09:18:27.230308 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 09:18:27.230308 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 09:18:27.230308 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 09:18:27.230308 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 09:18:27.230308 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 09:18:27.230308 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 09:18:27.230308 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 09:18:27.230308 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 09:18:27.230308 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 09:18:27.230308 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 09:18:27.230308 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 09:18:27.230308 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 09:18:27.230308 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 09:18:27.230308 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 09:18:27.231400 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 09:18:27.231400 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 09:18:27.231400 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 09:18:27.231400 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 09:18:27.231400 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 09:18:27.231400 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 09:18:27.231400 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 09:18:27.231400 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 09:18:27.231400 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 09:18:27.231400 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 09:18:27.231400 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 09:18:27.231400 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application with Lock( Jul 28 09:18:27.231400 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 09:18:27.231400 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self._enter() Jul 28 09:18:27.231400 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 09:18:27.231400 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 09:18:27.232379 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 09:18:27.232379 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self.creator() Jul 28 09:18:27.232379 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 09:18:27.232379 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application created_value = creator( Jul 28 09:18:27.232379 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 09:18:27.232379 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 09:18:27.232379 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 09:18:27.232379 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 09:18:27.232379 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 09:18:27.232379 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 09:18:27.232379 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 28 09:18:27.232379 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application Jul 28 09:18:27.236500 dv-cinder-851351-1-smb devstack@keystone.service[479852]: [pid: 479852|app: 0|req: 118/228] 10.222.0.42 () {56 vars in 1114 bytes} [Thu Jul 28 09:18:26 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 255 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 09:18:27.240492 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2cc0cce-a8f4-4739-8338-fcdc5c58e40a None admin] Authenticating user token {{(pid=479852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:18:27.327425 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8685b4fe-b4c8-4451-9123-a94f5318478a None admin] Validating token access rules against request {{(pid=479851) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:18:27.364536 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfae0282-4fc4-45f8-b001-2b203effa1d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479851) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:18:27.364536 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfae0282-4fc4-45f8-b001-2b203effa1d9 None admin] REQUEST_METHOD: `GET` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:18:27.364536 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfae0282-4fc4-45f8-b001-2b203effa1d9 None admin] SCRIPT_NAME: `/identity` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:18:27.364536 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfae0282-4fc4-45f8-b001-2b203effa1d9 None admin] PATH_INFO: `/v3/projects/ef022c0e613d4a2bac6fe1e0e339b92c` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:18:27.365061 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfae0282-4fc4-45f8-b001-2b203effa1d9 None admin] RBAC: Authorizing `identity:get_project(project_id=ef022c0e613d4a2bac6fe1e0e339b92c)` {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:18:27.366358 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfae0282-4fc4-45f8-b001-2b203effa1d9 None admin] RBAC: Authorization granted {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:18:27.368294 dv-cinder-851351-1-smb devstack@keystone.service[479851]: [pid: 479851|app: 0|req: 111/229] 10.222.0.42 () {56 vars in 1186 bytes} [Thu Jul 28 09:18:27 2022] GET /identity/v3/projects/ef022c0e613d4a2bac6fe1e0e339b92c => generated 302 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:18:27.379261 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfae0282-4fc4-45f8-b001-2b203effa1d9 None admin] Authenticating user token {{(pid=479851) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:18:27.390391 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2cc0cce-a8f4-4739-8338-fcdc5c58e40a None admin] Validating token access rules against request {{(pid=479852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:18:27.416556 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG dbcounter [-] [479851] Writing DB stats keystone:SELECT=100 {{(pid=479851) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:18:27.450825 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9fc5079-51d3-407f-9def-cef12a9e52d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:18:27.452015 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9fc5079-51d3-407f-9def-cef12a9e52d3 None admin] REQUEST_METHOD: `GET` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:18:27.454433 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9fc5079-51d3-407f-9def-cef12a9e52d3 None admin] SCRIPT_NAME: `/identity` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:18:27.454928 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9fc5079-51d3-407f-9def-cef12a9e52d3 None admin] PATH_INFO: `/v3/roles` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:18:27.455892 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9fc5079-51d3-407f-9def-cef12a9e52d3 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=479852) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 09:18:27.457295 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9fc5079-51d3-407f-9def-cef12a9e52d3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:18:27.458960 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9fc5079-51d3-407f-9def-cef12a9e52d3 None admin] RBAC: Authorization granted {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:18:27.476782 dv-cinder-851351-1-smb devstack@keystone.service[479852]: [pid: 479852|app: 0|req: 119/230] 10.222.0.42 () {56 vars in 1111 bytes} [Thu Jul 28 09:18:27 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:18:27.483231 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9fc5079-51d3-407f-9def-cef12a9e52d3 None admin] Authenticating user token {{(pid=479852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:18:27.548073 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfae0282-4fc4-45f8-b001-2b203effa1d9 None admin] Validating token access rules against request {{(pid=479851) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:18:27.601064 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG dbcounter [-] [479852] Writing DB stats keystone:SELECT=100 {{(pid=479852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:18:27.617363 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c86793d6-1875-4b20-8c7f-da06b84c3322 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479851) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:18:27.618507 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86793d6-1875-4b20-8c7f-da06b84c3322 None admin] REQUEST_METHOD: `PUT` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:18:27.619010 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86793d6-1875-4b20-8c7f-da06b84c3322 None admin] SCRIPT_NAME: `/identity` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:18:27.619498 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86793d6-1875-4b20-8c7f-da06b84c3322 None admin] PATH_INFO: `/v3/projects/ef022c0e613d4a2bac6fe1e0e339b92c/users/ab8fbe19586f4baf86846ca0a77ea800/roles/685084310b35477b9b2d0c7934d0f803` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:18:27.622002 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c86793d6-1875-4b20-8c7f-da06b84c3322 None admin] RBAC: Authorizing `identity:create_grant(project_id=ef022c0e613d4a2bac6fe1e0e339b92c, user_id=ab8fbe19586f4baf86846ca0a77ea800, role_id=685084310b35477b9b2d0c7934d0f803)` {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:18:27.626248 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c86793d6-1875-4b20-8c7f-da06b84c3322 None admin] RBAC: Authorization granted {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:18:27.646076 dv-cinder-851351-1-smb devstack@keystone.service[479851]: [pid: 479851|app: 0|req: 112/231] 10.222.0.42 () {58 vars in 1439 bytes} [Thu Jul 28 09:18:27 2022] PUT /identity/v3/projects/ef022c0e613d4a2bac6fe1e0e339b92c/users/ab8fbe19586f4baf86846ca0a77ea800/roles/685084310b35477b9b2d0c7934d0f803 => generated 0 bytes in 267 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 28 09:18:27.688557 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9fc5079-51d3-407f-9def-cef12a9e52d3 None admin] Validating token access rules against request {{(pid=479852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:18:27.727419 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e74a634-9beb-44cc-aa75-5a72fa75b6a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:18:27.728098 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e74a634-9beb-44cc-aa75-5a72fa75b6a7 None admin] REQUEST_METHOD: `GET` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:18:27.728376 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e74a634-9beb-44cc-aa75-5a72fa75b6a7 None admin] SCRIPT_NAME: `/identity` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:18:27.728651 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e74a634-9beb-44cc-aa75-5a72fa75b6a7 None admin] PATH_INFO: `/v3/users/ab8fbe19586f4baf86846ca0a77ea800` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:18:27.729958 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e74a634-9beb-44cc-aa75-5a72fa75b6a7 None admin] RBAC: Authorizing `identity:get_user(user_id=ab8fbe19586f4baf86846ca0a77ea800)` {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:18:27.731629 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e74a634-9beb-44cc-aa75-5a72fa75b6a7 None admin] RBAC: Authorization granted {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:18:27.733761 dv-cinder-851351-1-smb devstack@keystone.service[479852]: [pid: 479852|app: 0|req: 120/232] 10.222.0.42 () {56 vars in 1177 bytes} [Thu Jul 28 09:18:27 2022] GET /identity/v3/users/ab8fbe19586f4baf86846ca0a77ea800 => generated 283 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:18:27.741952 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c86793d6-1875-4b20-8c7f-da06b84c3322 None admin] Authenticating user token {{(pid=479851) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:18:27.834547 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG dbcounter [-] [479851] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=479851) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:18:27.864609 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c86793d6-1875-4b20-8c7f-da06b84c3322 None admin] Validating token access rules against request {{(pid=479851) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:18:27.902694 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d616cb37-92bd-4a4c-bcb0-58d6a5cb1108 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479851) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:18:27.903275 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d616cb37-92bd-4a4c-bcb0-58d6a5cb1108 None admin] REQUEST_METHOD: `GET` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:18:27.903559 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d616cb37-92bd-4a4c-bcb0-58d6a5cb1108 None admin] SCRIPT_NAME: `/identity` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:18:27.903836 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d616cb37-92bd-4a4c-bcb0-58d6a5cb1108 None admin] PATH_INFO: `/v3/projects/ef022c0e613d4a2bac6fe1e0e339b92c` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:18:27.905108 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d616cb37-92bd-4a4c-bcb0-58d6a5cb1108 None admin] RBAC: Authorizing `identity:get_project(project_id=ef022c0e613d4a2bac6fe1e0e339b92c)` {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:18:27.906589 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d616cb37-92bd-4a4c-bcb0-58d6a5cb1108 None admin] RBAC: Authorization granted {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:18:27.908647 dv-cinder-851351-1-smb devstack@keystone.service[479851]: [pid: 479851|app: 0|req: 113/233] 10.222.0.42 () {56 vars in 1186 bytes} [Thu Jul 28 09:18:27 2022] GET /identity/v3/projects/ef022c0e613d4a2bac6fe1e0e339b92c => generated 302 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:18:27.914530 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e74a634-9beb-44cc-aa75-5a72fa75b6a7 None admin] Authenticating user token {{(pid=479852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:18:28.035624 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e74a634-9beb-44cc-aa75-5a72fa75b6a7 None admin] Validating token access rules against request {{(pid=479852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:18:28.050975 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG dbcounter [-] [479852] Writing DB stats keystone:SELECT=100 {{(pid=479852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:18:28.076283 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0259a597-4185-49e0-9cad-37ba28a98c00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:18:28.077397 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0259a597-4185-49e0-9cad-37ba28a98c00 None admin] REQUEST_METHOD: `PUT` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:18:28.077898 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0259a597-4185-49e0-9cad-37ba28a98c00 None admin] SCRIPT_NAME: `/identity` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:18:28.078420 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0259a597-4185-49e0-9cad-37ba28a98c00 None admin] PATH_INFO: `/v3/projects/ef022c0e613d4a2bac6fe1e0e339b92c/users/ab8fbe19586f4baf86846ca0a77ea800/roles/acf1d2de5e5448beb6363dae3d154a02` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:18:28.086600 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0259a597-4185-49e0-9cad-37ba28a98c00 None admin] RBAC: Authorizing `identity:create_grant(project_id=ef022c0e613d4a2bac6fe1e0e339b92c, user_id=ab8fbe19586f4baf86846ca0a77ea800, role_id=acf1d2de5e5448beb6363dae3d154a02)` {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:18:28.088356 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0259a597-4185-49e0-9cad-37ba28a98c00 None admin] RBAC: Authorization granted {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:18:28.113101 dv-cinder-851351-1-smb devstack@keystone.service[479852]: [pid: 479852|app: 0|req: 121/234] 10.222.0.42 () {58 vars in 1439 bytes} [Thu Jul 28 09:18:27 2022] PUT /identity/v3/projects/ef022c0e613d4a2bac6fe1e0e339b92c/users/ab8fbe19586f4baf86846ca0a77ea800/roles/acf1d2de5e5448beb6363dae3d154a02 => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 09:18:28.711344 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2215aaa2-5da0-4cff-8888-b6e61b6a8044 None None] REQUEST_METHOD: `GET` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:18:28.711902 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2215aaa2-5da0-4cff-8888-b6e61b6a8044 None None] SCRIPT_NAME: `/identity` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:18:28.711902 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2215aaa2-5da0-4cff-8888-b6e61b6a8044 None None] PATH_INFO: `/` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:18:28.713547 dv-cinder-851351-1-smb devstack@keystone.service[479851]: [pid: 479851|app: 0|req: 114/235] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 09:18:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 09:18:28.719231 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09a97ea-1147-4444-8aa4-7f8b869086c9 None None] REQUEST_METHOD: `POST` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:18:28.719743 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09a97ea-1147-4444-8aa4-7f8b869086c9 None None] SCRIPT_NAME: `/identity` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:18:28.719877 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09a97ea-1147-4444-8aa4-7f8b869086c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:18:28.740477 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.auth.core [None req-f09a97ea-1147-4444-8aa4-7f8b869086c9 None None] MFA Rules not processed for user `c198f91a4ae84d2b9cc730a6e304c2be`. Rule list: `[]` (Enabled: `True`). {{(pid=479852) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 09:18:28.741806 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.fernet_utils [None req-f09a97ea-1147-4444-8aa4-7f8b869086c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=479852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 09:18:28.836259 dv-cinder-851351-1-smb devstack@keystone.service[479852]: [pid: 479852|app: 0|req: 122/236] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 09:18:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 09:18:28.875448 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2215aaa2-5da0-4cff-8888-b6e61b6a8044 None None] Authenticating user token {{(pid=479851) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:18:28.994251 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2215aaa2-5da0-4cff-8888-b6e61b6a8044 None None] Validating token access rules against request {{(pid=479851) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:18:29.007442 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1ad41a-62bb-4e1a-8454-bb62a621a5da None None] REQUEST_METHOD: `GET` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:18:29.007781 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1ad41a-62bb-4e1a-8454-bb62a621a5da None None] SCRIPT_NAME: `/identity` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:18:29.007993 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1ad41a-62bb-4e1a-8454-bb62a621a5da None None] PATH_INFO: `/` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:18:29.009402 dv-cinder-851351-1-smb devstack@keystone.service[479852]: [pid: 479852|app: 0|req: 123/237] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 09:18:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 09:18:29.014893 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75e2937-0793-44b0-9d31-1d13f3eb3f6a None None] REQUEST_METHOD: `POST` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:18:29.015227 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75e2937-0793-44b0-9d31-1d13f3eb3f6a None None] SCRIPT_NAME: `/identity` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:18:29.015510 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75e2937-0793-44b0-9d31-1d13f3eb3f6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:18:29.037372 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.auth.core [None req-d75e2937-0793-44b0-9d31-1d13f3eb3f6a None None] MFA Rules not processed for user `c198f91a4ae84d2b9cc730a6e304c2be`. Rule list: `[]` (Enabled: `True`). {{(pid=479852) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 09:18:29.039226 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.fernet_utils [None req-d75e2937-0793-44b0-9d31-1d13f3eb3f6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=479852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 09:18:29.042466 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e5734e-5dbb-41c9-ae04-c2e628139c8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479851) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:18:29.043128 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e5734e-5dbb-41c9-ae04-c2e628139c8d None admin] REQUEST_METHOD: `GET` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:18:29.043469 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e5734e-5dbb-41c9-ae04-c2e628139c8d None admin] SCRIPT_NAME: `/identity` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:18:29.043748 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e5734e-5dbb-41c9-ae04-c2e628139c8d None admin] PATH_INFO: `/v3/roles/reader` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:18:29.055459 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e5734e-5dbb-41c9-ae04-c2e628139c8d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 09:18:29.060952 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application [None req-51e5734e-5dbb-41c9-ae04-c2e628139c8d None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 28 09:18:29.060952 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 09:18:29.060952 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 09:18:29.060952 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 09:18:29.060952 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 09:18:29.060952 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 09:18:29.060952 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 09:18:29.060952 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 09:18:29.060952 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 09:18:29.060952 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 09:18:29.060952 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 09:18:29.060952 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 09:18:29.060952 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 09:18:29.060952 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 09:18:29.060952 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 09:18:29.060952 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 09:18:29.062077 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 09:18:29.062077 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 09:18:29.062077 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 09:18:29.062077 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 09:18:29.062077 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 09:18:29.062077 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 09:18:29.062077 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 09:18:29.062077 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 09:18:29.062077 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 09:18:29.062077 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 09:18:29.062077 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 09:18:29.062077 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application with Lock( Jul 28 09:18:29.062077 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 09:18:29.062077 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return self._enter() Jul 28 09:18:29.062077 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 09:18:29.062077 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 09:18:29.063059 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 09:18:29.063059 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return self.creator() Jul 28 09:18:29.063059 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 09:18:29.063059 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application created_value = creator( Jul 28 09:18:29.063059 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 09:18:29.063059 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 09:18:29.063059 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 09:18:29.063059 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 09:18:29.063059 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 09:18:29.063059 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 09:18:29.063059 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 28 09:18:29.063059 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application Jul 28 09:18:29.063059 dv-cinder-851351-1-smb devstack@keystone.service[479851]: [pid: 479851|app: 0|req: 115/238] 10.222.0.42 () {56 vars in 1099 bytes} [Thu Jul 28 09:18:28 2022] GET /identity/v3/roles/reader => generated 84 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 09:18:29.063878 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d4daef-fbc8-4a1f-a1f3-68ed648caf80 None None] REQUEST_METHOD: `GET` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:18:29.063878 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d4daef-fbc8-4a1f-a1f3-68ed648caf80 None None] SCRIPT_NAME: `/identity` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:18:29.063878 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d4daef-fbc8-4a1f-a1f3-68ed648caf80 None None] PATH_INFO: `/` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:18:29.065856 dv-cinder-851351-1-smb devstack@keystone.service[479851]: [pid: 479851|app: 0|req: 116/239] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 09:18:29 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 09:18:29.070682 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7fa8d6a-ebd2-4464-b4eb-9cf7970f12e4 None None] REQUEST_METHOD: `POST` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:18:29.070975 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7fa8d6a-ebd2-4464-b4eb-9cf7970f12e4 None None] SCRIPT_NAME: `/identity` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:18:29.071255 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7fa8d6a-ebd2-4464-b4eb-9cf7970f12e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:18:29.081239 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG dbcounter [-] [479851] Writing DB stats keystone:SELECT=100 {{(pid=479851) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:18:29.095301 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.auth.core [None req-b7fa8d6a-ebd2-4464-b4eb-9cf7970f12e4 None None] MFA Rules not processed for user `c198f91a4ae84d2b9cc730a6e304c2be`. Rule list: `[]` (Enabled: `True`). {{(pid=479851) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 09:18:29.096834 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.fernet_utils [None req-b7fa8d6a-ebd2-4464-b4eb-9cf7970f12e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=479851) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 09:18:29.140223 dv-cinder-851351-1-smb devstack@keystone.service[479852]: [pid: 479852|app: 0|req: 124/240] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 09:18:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 09:18:29.141298 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d75e2937-0793-44b0-9d31-1d13f3eb3f6a None None] Authenticating user token {{(pid=479852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:18:29.191107 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG dbcounter [-] [479852] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=479852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:18:29.195144 dv-cinder-851351-1-smb devstack@keystone.service[479851]: [pid: 479851|app: 0|req: 117/241] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 09:18:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 28 09:18:29.196049 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7fa8d6a-ebd2-4464-b4eb-9cf7970f12e4 None None] Authenticating user token {{(pid=479851) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:18:29.293340 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d75e2937-0793-44b0-9d31-1d13f3eb3f6a None None] Validating token access rules against request {{(pid=479852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:18:29.327331 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7fa8d6a-ebd2-4464-b4eb-9cf7970f12e4 None None] Validating token access rules against request {{(pid=479851) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:18:29.329623 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbfffe04-3c7b-4dc7-a9bf-f3ecdfe9b1a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:18:29.330343 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbfffe04-3c7b-4dc7-a9bf-f3ecdfe9b1a2 None admin] REQUEST_METHOD: `GET` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:18:29.330627 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbfffe04-3c7b-4dc7-a9bf-f3ecdfe9b1a2 None admin] SCRIPT_NAME: `/identity` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:18:29.330950 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbfffe04-3c7b-4dc7-a9bf-f3ecdfe9b1a2 None admin] PATH_INFO: `/v3/roles` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:18:29.331780 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbfffe04-3c7b-4dc7-a9bf-f3ecdfe9b1a2 None admin] RBAC: Adding query filter params (name=reader) {{(pid=479852) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 09:18:29.332085 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbfffe04-3c7b-4dc7-a9bf-f3ecdfe9b1a2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:18:29.333535 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbfffe04-3c7b-4dc7-a9bf-f3ecdfe9b1a2 None admin] RBAC: Authorization granted {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:18:29.342960 dv-cinder-851351-1-smb devstack@keystone.service[479852]: [pid: 479852|app: 0|req: 125/242] 10.222.0.42 () {56 vars in 1101 bytes} [Thu Jul 28 09:18:29 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:18:29.343795 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbfffe04-3c7b-4dc7-a9bf-f3ecdfe9b1a2 None admin] Authenticating user token {{(pid=479852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:18:29.360070 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG dbcounter [-] [479851] Writing DB stats keystone:SELECT=100 {{(pid=479851) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:18:29.367982 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64763e7d-5800-4439-b841-0df41a176987 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479851) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:18:29.368882 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64763e7d-5800-4439-b841-0df41a176987 None admin] REQUEST_METHOD: `GET` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:18:29.369286 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64763e7d-5800-4439-b841-0df41a176987 None admin] SCRIPT_NAME: `/identity` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:18:29.369579 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64763e7d-5800-4439-b841-0df41a176987 None admin] PATH_INFO: `/v3/domains/default` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:18:29.371573 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64763e7d-5800-4439-b841-0df41a176987 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:18:29.373632 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64763e7d-5800-4439-b841-0df41a176987 None admin] RBAC: Authorization granted {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:18:29.376161 dv-cinder-851351-1-smb devstack@keystone.service[479851]: [pid: 479851|app: 0|req: 118/243] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 09:18:29 2022] GET /identity/v3/domains/default => generated 199 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:18:29.376977 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64763e7d-5800-4439-b841-0df41a176987 None admin] Authenticating user token {{(pid=479851) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:18:29.464070 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG dbcounter [-] [479852] Writing DB stats keystone:SELECT=100 {{(pid=479852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:18:29.474804 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbfffe04-3c7b-4dc7-a9bf-f3ecdfe9b1a2 None admin] Validating token access rules against request {{(pid=479852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:18:29.501932 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64763e7d-5800-4439-b841-0df41a176987 None admin] Validating token access rules against request {{(pid=479851) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:18:29.512459 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e54b418a-218c-4d16-bf17-35b82861877a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:18:29.513507 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54b418a-218c-4d16-bf17-35b82861877a None admin] REQUEST_METHOD: `GET` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:18:29.514094 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54b418a-218c-4d16-bf17-35b82861877a None admin] SCRIPT_NAME: `/identity` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:18:29.514553 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54b418a-218c-4d16-bf17-35b82861877a None admin] PATH_INFO: `/v3/roles/member` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:18:29.526941 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e54b418a-218c-4d16-bf17-35b82861877a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 09:18:29.533479 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application [None req-e54b418a-218c-4d16-bf17-35b82861877a None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 28 09:18:29.533479 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 09:18:29.533479 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 09:18:29.533479 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 09:18:29.533479 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 09:18:29.533479 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 09:18:29.533479 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 09:18:29.533479 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 09:18:29.533479 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 09:18:29.533479 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 09:18:29.533479 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 09:18:29.533479 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 09:18:29.533479 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 09:18:29.533479 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 09:18:29.533479 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 09:18:29.533479 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 09:18:29.534579 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 09:18:29.534579 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 09:18:29.534579 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 09:18:29.534579 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 09:18:29.534579 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 09:18:29.534579 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 09:18:29.534579 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 09:18:29.534579 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 09:18:29.534579 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 09:18:29.534579 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 09:18:29.534579 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 09:18:29.534579 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application with Lock( Jul 28 09:18:29.534579 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 09:18:29.534579 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self._enter() Jul 28 09:18:29.534579 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 09:18:29.534579 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 09:18:29.535575 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 09:18:29.535575 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self.creator() Jul 28 09:18:29.535575 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 09:18:29.535575 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application created_value = creator( Jul 28 09:18:29.535575 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 09:18:29.535575 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 09:18:29.535575 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 09:18:29.535575 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 09:18:29.535575 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 09:18:29.535575 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 09:18:29.535575 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 28 09:18:29.535575 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application Jul 28 09:18:29.537997 dv-cinder-851351-1-smb devstack@keystone.service[479852]: [pid: 479852|app: 0|req: 126/244] 10.222.0.42 () {56 vars in 1099 bytes} [Thu Jul 28 09:18:29 2022] GET /identity/v3/roles/member => generated 84 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 09:18:29.539073 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e54b418a-218c-4d16-bf17-35b82861877a None admin] Authenticating user token {{(pid=479852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:18:29.542485 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca59be26-0895-42e6-ac3d-c67e6a68fc7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479851) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:18:29.543451 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca59be26-0895-42e6-ac3d-c67e6a68fc7a None admin] REQUEST_METHOD: `GET` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:18:29.543832 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca59be26-0895-42e6-ac3d-c67e6a68fc7a None admin] SCRIPT_NAME: `/identity` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:18:29.544161 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca59be26-0895-42e6-ac3d-c67e6a68fc7a None admin] PATH_INFO: `/v3/users/ed4bb27e9d6941bdb7e78c6d8cca0946` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:18:29.563608 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca59be26-0895-42e6-ac3d-c67e6a68fc7a None admin] RBAC: Authorizing `identity:get_user(user_id=ed4bb27e9d6941bdb7e78c6d8cca0946)` {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:18:29.565373 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca59be26-0895-42e6-ac3d-c67e6a68fc7a None admin] RBAC: Authorization granted {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:18:29.567598 dv-cinder-851351-1-smb devstack@keystone.service[479851]: [pid: 479851|app: 0|req: 119/245] 10.222.0.42 () {56 vars in 1177 bytes} [Thu Jul 28 09:18:29 2022] GET /identity/v3/users/ed4bb27e9d6941bdb7e78c6d8cca0946 => generated 297 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:18:29.568546 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca59be26-0895-42e6-ac3d-c67e6a68fc7a None admin] Authenticating user token {{(pid=479851) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:18:29.630696 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG dbcounter [-] [479851] Writing DB stats keystone:SELECT=100 {{(pid=479851) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:18:29.656056 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e54b418a-218c-4d16-bf17-35b82861877a None admin] Validating token access rules against request {{(pid=479852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:18:29.676865 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca59be26-0895-42e6-ac3d-c67e6a68fc7a None admin] Validating token access rules against request {{(pid=479851) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:18:29.697195 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f77ae7-86ea-4168-88ee-49456d966b51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:18:29.698227 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f77ae7-86ea-4168-88ee-49456d966b51 None admin] REQUEST_METHOD: `POST` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:18:29.698676 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f77ae7-86ea-4168-88ee-49456d966b51 None admin] SCRIPT_NAME: `/identity` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:18:29.699107 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f77ae7-86ea-4168-88ee-49456d966b51 None admin] PATH_INFO: `/v3/users` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:18:29.699973 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f77ae7-86ea-4168-88ee-49456d966b51 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:18:29.701754 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f77ae7-86ea-4168-88ee-49456d966b51 None admin] RBAC: Authorization granted {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:18:29.716821 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54c5724-5a9f-4632-9929-3dafd242ea4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479851) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:18:29.717639 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54c5724-5a9f-4632-9929-3dafd242ea4d None admin] REQUEST_METHOD: `GET` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:18:29.717999 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54c5724-5a9f-4632-9929-3dafd242ea4d None admin] SCRIPT_NAME: `/identity` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:18:29.718446 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54c5724-5a9f-4632-9929-3dafd242ea4d None admin] PATH_INFO: `/v3/roles` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:18:29.719276 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a54c5724-5a9f-4632-9929-3dafd242ea4d None admin] RBAC: Adding query filter params (name=member) {{(pid=479851) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 09:18:29.719595 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a54c5724-5a9f-4632-9929-3dafd242ea4d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:18:29.721094 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a54c5724-5a9f-4632-9929-3dafd242ea4d None admin] RBAC: Authorization granted {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:18:29.728308 dv-cinder-851351-1-smb devstack@keystone.service[479852]: [pid: 479852|app: 0|req: 127/246] 10.222.0.42 () {60 vars in 1132 bytes} [Thu Jul 28 09:18:29 2022] POST /identity/v3/users => generated 293 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 09:18:29.729985 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f77ae7-86ea-4168-88ee-49456d966b51 None admin] Authenticating user token {{(pid=479852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:18:29.730901 dv-cinder-851351-1-smb devstack@keystone.service[479851]: [pid: 479851|app: 0|req: 120/247] 10.222.0.42 () {56 vars in 1101 bytes} [Thu Jul 28 09:18:29 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:18:29.743210 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54c5724-5a9f-4632-9929-3dafd242ea4d None admin] Authenticating user token {{(pid=479851) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:18:29.765070 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG dbcounter [-] [479852] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=479852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:18:29.922038 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f77ae7-86ea-4168-88ee-49456d966b51 None admin] Validating token access rules against request {{(pid=479852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:18:29.961896 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54c5724-5a9f-4632-9929-3dafd242ea4d None admin] Validating token access rules against request {{(pid=479851) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:18:29.977153 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4df1fa-a634-4332-9cff-7773b0a05e73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:18:29.977858 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4df1fa-a634-4332-9cff-7773b0a05e73 None admin] REQUEST_METHOD: `GET` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:18:29.978147 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4df1fa-a634-4332-9cff-7773b0a05e73 None admin] SCRIPT_NAME: `/identity` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:18:29.978426 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4df1fa-a634-4332-9cff-7773b0a05e73 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:18:29.989859 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG dbcounter [-] [479851] Writing DB stats keystone:SELECT=100 {{(pid=479851) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:18:30.012337 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f67ff5a-44ce-4244-a7ed-2f18ed4e8da6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479851) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:18:30.013059 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f67ff5a-44ce-4244-a7ed-2f18ed4e8da6 None admin] REQUEST_METHOD: `GET` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:18:30.013594 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f67ff5a-44ce-4244-a7ed-2f18ed4e8da6 None admin] SCRIPT_NAME: `/identity` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:18:30.013890 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f67ff5a-44ce-4244-a7ed-2f18ed4e8da6 None admin] PATH_INFO: `/v3/users/ca3be4ca4e38489d97ebdcc8800b96c0` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:18:30.015592 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f67ff5a-44ce-4244-a7ed-2f18ed4e8da6 None admin] RBAC: Authorizing `identity:get_user(user_id=ca3be4ca4e38489d97ebdcc8800b96c0)` {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:18:30.017448 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f67ff5a-44ce-4244-a7ed-2f18ed4e8da6 None admin] RBAC: Authorization granted {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:18:30.020791 dv-cinder-851351-1-smb devstack@keystone.service[479851]: [pid: 479851|app: 0|req: 121/248] 10.222.0.42 () {56 vars in 1177 bytes} [Thu Jul 28 09:18:29 2022] GET /identity/v3/users/ca3be4ca4e38489d97ebdcc8800b96c0 => generated 297 bytes in 279 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:18:30.026616 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f67ff5a-44ce-4244-a7ed-2f18ed4e8da6 None admin] Authenticating user token {{(pid=479851) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:18:30.062626 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e4df1fa-a634-4332-9cff-7773b0a05e73 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:18:30.064189 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e4df1fa-a634-4332-9cff-7773b0a05e73 None admin] RBAC: Authorization granted {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:18:30.079679 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG dbcounter [-] [479852] Writing DB stats keystone:SELECT=100 {{(pid=479852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:18:30.141896 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f67ff5a-44ce-4244-a7ed-2f18ed4e8da6 None admin] Validating token access rules against request {{(pid=479851) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:18:30.174343 dv-cinder-851351-1-smb devstack@keystone.service[479852]: [pid: 479852|app: 0|req: 128/249] 10.222.0.42 () {58 vars in 1282 bytes} [Thu Jul 28 09:18:29 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 445 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 28 09:18:30.180487 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4df1fa-a634-4332-9cff-7773b0a05e73 None admin] Authenticating user token {{(pid=479852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:18:30.181433 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6ad7a7-e422-4562-ae64-043881f22f86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479851) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:18:30.182328 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6ad7a7-e422-4562-ae64-043881f22f86 None admin] REQUEST_METHOD: `GET` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:18:30.182832 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6ad7a7-e422-4562-ae64-043881f22f86 None admin] SCRIPT_NAME: `/identity` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:18:30.183322 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6ad7a7-e422-4562-ae64-043881f22f86 None admin] PATH_INFO: `/v3/projects/ef022c0e613d4a2bac6fe1e0e339b92c` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:18:30.189842 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce6ad7a7-e422-4562-ae64-043881f22f86 None admin] RBAC: Authorizing `identity:get_project(project_id=ef022c0e613d4a2bac6fe1e0e339b92c)` {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:18:30.191616 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce6ad7a7-e422-4562-ae64-043881f22f86 None admin] RBAC: Authorization granted {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:18:30.193654 dv-cinder-851351-1-smb devstack@keystone.service[479851]: [pid: 479851|app: 0|req: 122/250] 10.222.0.42 () {56 vars in 1186 bytes} [Thu Jul 28 09:18:30 2022] GET /identity/v3/projects/ef022c0e613d4a2bac6fe1e0e339b92c => generated 302 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 09:18:30.203861 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6ad7a7-e422-4562-ae64-043881f22f86 None admin] Authenticating user token {{(pid=479851) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:18:30.285641 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG dbcounter [-] [479851] Writing DB stats keystone:SELECT=100 {{(pid=479851) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:18:30.325762 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4df1fa-a634-4332-9cff-7773b0a05e73 None admin] Validating token access rules against request {{(pid=479852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:18:30.341999 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG dbcounter [-] [479852] Writing DB stats keystone:SELECT=100 {{(pid=479852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:18:30.359739 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6ad7a7-e422-4562-ae64-043881f22f86 None admin] Validating token access rules against request {{(pid=479851) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:18:30.365121 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae3df82f-a30c-414d-8123-ac7101916322 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:18:30.365921 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3df82f-a30c-414d-8123-ac7101916322 None admin] REQUEST_METHOD: `GET` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:18:30.366202 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3df82f-a30c-414d-8123-ac7101916322 None admin] SCRIPT_NAME: `/identity` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:18:30.366466 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3df82f-a30c-414d-8123-ac7101916322 None admin] PATH_INFO: `/v3/projects/ef022c0e613d4a2bac6fe1e0e339b92c` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:18:30.367991 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae3df82f-a30c-414d-8123-ac7101916322 None admin] RBAC: Authorizing `identity:get_project(project_id=ef022c0e613d4a2bac6fe1e0e339b92c)` {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:18:30.370031 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae3df82f-a30c-414d-8123-ac7101916322 None admin] RBAC: Authorization granted {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:18:30.373472 dv-cinder-851351-1-smb devstack@keystone.service[479852]: [pid: 479852|app: 0|req: 129/251] 10.222.0.42 () {56 vars in 1186 bytes} [Thu Jul 28 09:18:30 2022] GET /identity/v3/projects/ef022c0e613d4a2bac6fe1e0e339b92c => generated 302 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:18:30.375118 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94d61f4-cf12-421d-ae36-79a9bacc5c14 None None] REQUEST_METHOD: `GET` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:18:30.375392 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94d61f4-cf12-421d-ae36-79a9bacc5c14 None None] SCRIPT_NAME: `/identity` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:18:30.375656 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94d61f4-cf12-421d-ae36-79a9bacc5c14 None None] PATH_INFO: `/` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:18:30.378972 dv-cinder-851351-1-smb devstack@keystone.service[479852]: [pid: 479852|app: 0|req: 130/252] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 09:18:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 09:18:30.379153 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94d61f4-cf12-421d-ae36-79a9bacc5c14 None None] Authenticating user token {{(pid=479852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:18:30.417123 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be8cca28-b15c-4c57-88ba-2831d3ea5dee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479851) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:18:30.417968 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8cca28-b15c-4c57-88ba-2831d3ea5dee None admin] REQUEST_METHOD: `PUT` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:18:30.418319 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8cca28-b15c-4c57-88ba-2831d3ea5dee None admin] SCRIPT_NAME: `/identity` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:18:30.418607 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8cca28-b15c-4c57-88ba-2831d3ea5dee None admin] PATH_INFO: `/v3/projects/ef022c0e613d4a2bac6fe1e0e339b92c/users/ca3be4ca4e38489d97ebdcc8800b96c0/roles/900fb424e172461d93a0db59afb0a12b` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:18:30.421051 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be8cca28-b15c-4c57-88ba-2831d3ea5dee None admin] RBAC: Authorizing `identity:create_grant(project_id=ef022c0e613d4a2bac6fe1e0e339b92c, user_id=ca3be4ca4e38489d97ebdcc8800b96c0, role_id=900fb424e172461d93a0db59afb0a12b)` {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:18:30.422617 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be8cca28-b15c-4c57-88ba-2831d3ea5dee None admin] RBAC: Authorization granted {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:18:30.442142 dv-cinder-851351-1-smb devstack@keystone.service[479851]: [pid: 479851|app: 0|req: 123/253] 10.222.0.42 () {58 vars in 1439 bytes} [Thu Jul 28 09:18:30 2022] PUT /identity/v3/projects/ef022c0e613d4a2bac6fe1e0e339b92c/users/ca3be4ca4e38489d97ebdcc8800b96c0/roles/900fb424e172461d93a0db59afb0a12b => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 09:18:30.447266 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd96f75b-50a5-4fab-81bd-38678da1f55f None None] REQUEST_METHOD: `POST` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:18:30.447266 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd96f75b-50a5-4fab-81bd-38678da1f55f None None] SCRIPT_NAME: `/identity` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:18:30.447266 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd96f75b-50a5-4fab-81bd-38678da1f55f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:18:30.466395 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.auth.core [None req-fd96f75b-50a5-4fab-81bd-38678da1f55f None None] MFA Rules not processed for user `c198f91a4ae84d2b9cc730a6e304c2be`. Rule list: `[]` (Enabled: `True`). {{(pid=479851) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 09:18:30.467749 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.fernet_utils [None req-fd96f75b-50a5-4fab-81bd-38678da1f55f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=479851) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 09:18:30.532740 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94d61f4-cf12-421d-ae36-79a9bacc5c14 None None] Validating token access rules against request {{(pid=479852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:18:30.585714 dv-cinder-851351-1-smb devstack@keystone.service[479851]: [pid: 479851|app: 0|req: 124/254] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 09:18:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 09:18:30.599014 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796aaeeb-b206-4d74-8b69-b1c63c56c145 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:18:30.599657 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796aaeeb-b206-4d74-8b69-b1c63c56c145 None admin] REQUEST_METHOD: `GET` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:18:30.599932 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796aaeeb-b206-4d74-8b69-b1c63c56c145 None admin] SCRIPT_NAME: `/identity` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:18:30.600329 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796aaeeb-b206-4d74-8b69-b1c63c56c145 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:18:30.601205 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-796aaeeb-b206-4d74-8b69-b1c63c56c145 None admin] RBAC: Adding query filter params (role.id=73525379110b4a99850473e0e9f217f1, scope.project.id=ef022c0e613d4a2bac6fe1e0e339b92c, user.id=ed4bb27e9d6941bdb7e78c6d8cca0946) {{(pid=479852) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 09:18:30.601565 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-796aaeeb-b206-4d74-8b69-b1c63c56c145 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:18:30.603045 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-796aaeeb-b206-4d74-8b69-b1c63c56c145 None admin] RBAC: Authorization granted {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:18:30.610057 dv-cinder-851351-1-smb devstack@keystone.service[479852]: [pid: 479852|app: 0|req: 131/255] 10.222.0.42 () {56 vars in 1374 bytes} [Thu Jul 28 09:18:30 2022] GET /identity/v3/role_assignments?user.id=ed4bb27e9d6941bdb7e78c6d8cca0946&scope.project.id=ef022c0e613d4a2bac6fe1e0e339b92c&role.id=73525379110b4a99850473e0e9f217f1 => generated 259 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:18:30.629413 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd96f75b-50a5-4fab-81bd-38678da1f55f None None] Authenticating user token {{(pid=479851) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:18:30.689524 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG dbcounter [-] [479851] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=479851) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:18:30.757977 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd96f75b-50a5-4fab-81bd-38678da1f55f None None] Validating token access rules against request {{(pid=479851) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:18:30.776225 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709488dd-b25b-40c4-bf2d-3f6a404a6770 None None] REQUEST_METHOD: `GET` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:18:30.776825 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709488dd-b25b-40c4-bf2d-3f6a404a6770 None None] SCRIPT_NAME: `/identity` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:18:30.776825 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709488dd-b25b-40c4-bf2d-3f6a404a6770 None None] PATH_INFO: `/` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:18:30.778180 dv-cinder-851351-1-smb devstack@keystone.service[479852]: [pid: 479852|app: 0|req: 132/256] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 09:18:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 28 09:18:30.784427 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa32ff4-9d9e-4be4-8d77-f09539bb33b5 None None] REQUEST_METHOD: `POST` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:18:30.784808 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa32ff4-9d9e-4be4-8d77-f09539bb33b5 None None] SCRIPT_NAME: `/identity` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:18:30.785002 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa32ff4-9d9e-4be4-8d77-f09539bb33b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:18:30.808464 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a595339-2c5b-42ee-9a9d-9121a0b8c40f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479851) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:18:30.809180 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a595339-2c5b-42ee-9a9d-9121a0b8c40f None admin] REQUEST_METHOD: `GET` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:18:30.809465 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a595339-2c5b-42ee-9a9d-9121a0b8c40f None admin] SCRIPT_NAME: `/identity` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:18:30.809744 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a595339-2c5b-42ee-9a9d-9121a0b8c40f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:18:30.822490 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.auth.core [None req-eaa32ff4-9d9e-4be4-8d77-f09539bb33b5 None None] MFA Rules not processed for user `c198f91a4ae84d2b9cc730a6e304c2be`. Rule list: `[]` (Enabled: `True`). {{(pid=479852) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 09:18:30.823762 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.fernet_utils [None req-eaa32ff4-9d9e-4be4-8d77-f09539bb33b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=479852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 09:18:30.833232 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a595339-2c5b-42ee-9a9d-9121a0b8c40f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 09:18:30.838585 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application [None req-1a595339-2c5b-42ee-9a9d-9121a0b8c40f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 09:18:30.838585 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 09:18:30.838585 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 09:18:30.838585 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 09:18:30.838585 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 09:18:30.838585 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 09:18:30.838585 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 09:18:30.838585 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 09:18:30.838585 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 09:18:30.838585 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 09:18:30.838585 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 09:18:30.838585 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 09:18:30.838585 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 09:18:30.838585 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 09:18:30.838585 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 09:18:30.838585 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 09:18:30.839738 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 09:18:30.839738 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 09:18:30.839738 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 09:18:30.839738 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 09:18:30.839738 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 09:18:30.839738 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 09:18:30.839738 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 09:18:30.839738 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 09:18:30.839738 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 09:18:30.839738 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 09:18:30.839738 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 09:18:30.839738 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application with Lock( Jul 28 09:18:30.839738 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 09:18:30.839738 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return self._enter() Jul 28 09:18:30.839738 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 09:18:30.839738 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 09:18:30.841175 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 09:18:30.841175 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return self.creator() Jul 28 09:18:30.841175 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 09:18:30.841175 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application created_value = creator( Jul 28 09:18:30.841175 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 09:18:30.841175 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 09:18:30.841175 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 09:18:30.841175 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 09:18:30.841175 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 09:18:30.841175 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 09:18:30.841175 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 09:18:30.841175 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application Jul 28 09:18:30.845547 dv-cinder-851351-1-smb devstack@keystone.service[479851]: [pid: 479851|app: 0|req: 125/257] 10.222.0.42 () {56 vars in 1096 bytes} [Thu Jul 28 09:18:30 2022] GET /identity/v3/roles/admin => generated 83 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 09:18:30.846485 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a595339-2c5b-42ee-9a9d-9121a0b8c40f None admin] Authenticating user token {{(pid=479851) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:18:30.936039 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG dbcounter [-] [479852] Writing DB stats keystone:SELECT=100 {{(pid=479852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:18:30.978723 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a595339-2c5b-42ee-9a9d-9121a0b8c40f None admin] Validating token access rules against request {{(pid=479851) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:18:30.990498 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG dbcounter [-] [479851] Writing DB stats keystone:SELECT=100 {{(pid=479851) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:18:30.991885 dv-cinder-851351-1-smb devstack@keystone.service[479852]: [pid: 479852|app: 0|req: 133/258] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 09:18:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 09:18:31.019739 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa32ff4-9d9e-4be4-8d77-f09539bb33b5 None None] Authenticating user token {{(pid=479852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:18:31.069945 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989b7dca-b702-4419-9409-23723aecdfa7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479851) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:18:31.070591 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989b7dca-b702-4419-9409-23723aecdfa7 None admin] REQUEST_METHOD: `GET` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:18:31.070875 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989b7dca-b702-4419-9409-23723aecdfa7 None admin] SCRIPT_NAME: `/identity` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:18:31.071148 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989b7dca-b702-4419-9409-23723aecdfa7 None admin] PATH_INFO: `/v3/roles` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:18:31.072210 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-989b7dca-b702-4419-9409-23723aecdfa7 None admin] RBAC: Adding query filter params (name=admin) {{(pid=479851) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 09:18:31.072515 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-989b7dca-b702-4419-9409-23723aecdfa7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:18:31.078348 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-989b7dca-b702-4419-9409-23723aecdfa7 None admin] RBAC: Authorization granted {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:18:31.101872 dv-cinder-851351-1-smb devstack@keystone.service[479851]: [pid: 479851|app: 0|req: 126/259] 10.222.0.42 () {56 vars in 1099 bytes} [Thu Jul 28 09:18:30 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:18:31.107677 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989b7dca-b702-4419-9409-23723aecdfa7 None admin] Authenticating user token {{(pid=479851) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:18:31.171464 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa32ff4-9d9e-4be4-8d77-f09539bb33b5 None None] Validating token access rules against request {{(pid=479852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:18:31.213077 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75091d70-2f1b-479e-a160-cb9b28e99bb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:18:31.214122 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75091d70-2f1b-479e-a160-cb9b28e99bb5 None admin] REQUEST_METHOD: `GET` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:18:31.215202 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75091d70-2f1b-479e-a160-cb9b28e99bb5 None admin] SCRIPT_NAME: `/identity` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:18:31.215710 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75091d70-2f1b-479e-a160-cb9b28e99bb5 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:18:31.228655 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75091d70-2f1b-479e-a160-cb9b28e99bb5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 09:18:31.234777 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application [None req-75091d70-2f1b-479e-a160-cb9b28e99bb5 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 28 09:18:31.234777 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 09:18:31.234777 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 09:18:31.234777 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 09:18:31.234777 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 09:18:31.234777 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 09:18:31.234777 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 09:18:31.234777 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 09:18:31.234777 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 09:18:31.234777 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 09:18:31.234777 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 09:18:31.234777 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 09:18:31.234777 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 09:18:31.234777 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 09:18:31.234777 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 09:18:31.234777 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 09:18:31.235888 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 09:18:31.235888 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 09:18:31.235888 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 09:18:31.235888 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 09:18:31.235888 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 09:18:31.235888 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 09:18:31.235888 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 09:18:31.235888 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 09:18:31.235888 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 09:18:31.235888 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 09:18:31.235888 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 09:18:31.235888 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application with Lock( Jul 28 09:18:31.235888 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 09:18:31.235888 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self._enter() Jul 28 09:18:31.235888 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 09:18:31.235888 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 09:18:31.236871 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 09:18:31.236871 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self.creator() Jul 28 09:18:31.236871 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 09:18:31.236871 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application created_value = creator( Jul 28 09:18:31.236871 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 09:18:31.236871 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 09:18:31.236871 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 09:18:31.236871 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 09:18:31.236871 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 09:18:31.236871 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 09:18:31.236871 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 28 09:18:31.236871 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application Jul 28 09:18:31.240517 dv-cinder-851351-1-smb devstack@keystone.service[479852]: [pid: 479852|app: 0|req: 134/260] 10.222.0.42 () {56 vars in 1114 bytes} [Thu Jul 28 09:18:31 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 09:18:31.247040 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75091d70-2f1b-479e-a160-cb9b28e99bb5 None admin] Authenticating user token {{(pid=479852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:18:31.290900 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG dbcounter [-] [479852] Writing DB stats keystone:SELECT=100 {{(pid=479852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:18:31.370773 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75091d70-2f1b-479e-a160-cb9b28e99bb5 None admin] Validating token access rules against request {{(pid=479852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:18:31.416699 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e1117f-f963-4e2c-b3a2-28323b74e760 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:18:31.417846 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e1117f-f963-4e2c-b3a2-28323b74e760 None admin] REQUEST_METHOD: `GET` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:18:31.418342 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e1117f-f963-4e2c-b3a2-28323b74e760 None admin] SCRIPT_NAME: `/identity` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:18:31.418845 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e1117f-f963-4e2c-b3a2-28323b74e760 None admin] PATH_INFO: `/v3/roles` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:18:31.419781 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19e1117f-f963-4e2c-b3a2-28323b74e760 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=479852) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 09:18:31.420312 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19e1117f-f963-4e2c-b3a2-28323b74e760 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:18:31.422312 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19e1117f-f963-4e2c-b3a2-28323b74e760 None admin] RBAC: Authorization granted {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:18:31.430841 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989b7dca-b702-4419-9409-23723aecdfa7 None admin] Validating token access rules against request {{(pid=479851) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:18:31.433252 dv-cinder-851351-1-smb devstack@keystone.service[479852]: [pid: 479852|app: 0|req: 135/261] 10.222.0.42 () {56 vars in 1111 bytes} [Thu Jul 28 09:18:31 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:18:31.440267 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e1117f-f963-4e2c-b3a2-28323b74e760 None admin] Authenticating user token {{(pid=479852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:18:31.546041 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc60a7c5-f5bb-471e-9a5b-99eb7dbc5b40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479851) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:18:31.546641 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc60a7c5-f5bb-471e-9a5b-99eb7dbc5b40 None admin] REQUEST_METHOD: `GET` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:18:31.546930 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc60a7c5-f5bb-471e-9a5b-99eb7dbc5b40 None admin] SCRIPT_NAME: `/identity` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:18:31.547227 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc60a7c5-f5bb-471e-9a5b-99eb7dbc5b40 None admin] PATH_INFO: `/v3/users/ab8fbe19586f4baf86846ca0a77ea800` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:18:31.553480 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc60a7c5-f5bb-471e-9a5b-99eb7dbc5b40 None admin] RBAC: Authorizing `identity:get_user(user_id=ab8fbe19586f4baf86846ca0a77ea800)` {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:18:31.554989 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc60a7c5-f5bb-471e-9a5b-99eb7dbc5b40 None admin] RBAC: Authorization granted {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:18:31.557072 dv-cinder-851351-1-smb devstack@keystone.service[479851]: [pid: 479851|app: 0|req: 127/262] 10.222.0.42 () {56 vars in 1177 bytes} [Thu Jul 28 09:18:31 2022] GET /identity/v3/users/ab8fbe19586f4baf86846ca0a77ea800 => generated 283 bytes in 450 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:18:31.562174 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc60a7c5-f5bb-471e-9a5b-99eb7dbc5b40 None admin] Authenticating user token {{(pid=479851) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:18:31.662999 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG dbcounter [-] [479851] Writing DB stats keystone:SELECT=100 {{(pid=479851) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:18:31.697729 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG dbcounter [-] [479852] Writing DB stats keystone:SELECT=100 {{(pid=479852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:18:31.718952 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e1117f-f963-4e2c-b3a2-28323b74e760 None admin] Validating token access rules against request {{(pid=479852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:18:31.813494 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5877805f-e856-4c3e-88bf-3e42cb33861d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:18:31.814148 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5877805f-e856-4c3e-88bf-3e42cb33861d None admin] REQUEST_METHOD: `GET` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:18:31.814428 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5877805f-e856-4c3e-88bf-3e42cb33861d None admin] SCRIPT_NAME: `/identity` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:18:31.814732 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5877805f-e856-4c3e-88bf-3e42cb33861d None admin] PATH_INFO: `/v3/users/ab8fbe19586f4baf86846ca0a77ea800` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:18:31.816075 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5877805f-e856-4c3e-88bf-3e42cb33861d None admin] RBAC: Authorizing `identity:get_user(user_id=ab8fbe19586f4baf86846ca0a77ea800)` {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:18:31.817625 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5877805f-e856-4c3e-88bf-3e42cb33861d None admin] RBAC: Authorization granted {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:18:31.819774 dv-cinder-851351-1-smb devstack@keystone.service[479852]: [pid: 479852|app: 0|req: 136/263] 10.222.0.42 () {56 vars in 1177 bytes} [Thu Jul 28 09:18:31 2022] GET /identity/v3/users/ab8fbe19586f4baf86846ca0a77ea800 => generated 283 bytes in 380 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 09:18:31.821035 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc60a7c5-f5bb-471e-9a5b-99eb7dbc5b40 None admin] Validating token access rules against request {{(pid=479851) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:18:31.826728 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5877805f-e856-4c3e-88bf-3e42cb33861d None admin] Authenticating user token {{(pid=479852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:18:31.918660 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c608f6-f238-494c-b362-a368269a4a94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479851) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:18:31.919331 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c608f6-f238-494c-b362-a368269a4a94 None admin] REQUEST_METHOD: `GET` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:18:31.919617 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c608f6-f238-494c-b362-a368269a4a94 None admin] SCRIPT_NAME: `/identity` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:18:31.919901 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c608f6-f238-494c-b362-a368269a4a94 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:18:32.069280 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6c608f6-f238-494c-b362-a368269a4a94 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:18:32.070711 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6c608f6-f238-494c-b362-a368269a4a94 None admin] RBAC: Authorization granted {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:18:32.108539 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5877805f-e856-4c3e-88bf-3e42cb33861d None admin] Validating token access rules against request {{(pid=479852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:18:32.130253 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG dbcounter [-] [479851] Writing DB stats keystone:SELECT=100 {{(pid=479851) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:18:32.191477 dv-cinder-851351-1-smb devstack@keystone.service[479851]: [pid: 479851|app: 0|req: 128/264] 10.222.0.42 () {58 vars in 1282 bytes} [Thu Jul 28 09:18:31 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 630 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 28 09:18:32.197608 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c608f6-f238-494c-b362-a368269a4a94 None admin] Authenticating user token {{(pid=479851) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:18:32.201999 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e5dbbf-6c89-484b-bae8-61ef04022d73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:18:32.202690 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e5dbbf-6c89-484b-bae8-61ef04022d73 None admin] REQUEST_METHOD: `GET` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:18:32.202946 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e5dbbf-6c89-484b-bae8-61ef04022d73 None admin] SCRIPT_NAME: `/identity` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:18:32.203228 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e5dbbf-6c89-484b-bae8-61ef04022d73 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:18:32.262965 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG dbcounter [-] [479852] Writing DB stats keystone:SELECT=100 {{(pid=479852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:18:32.306639 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54e5dbbf-6c89-484b-bae8-61ef04022d73 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:18:32.308528 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54e5dbbf-6c89-484b-bae8-61ef04022d73 None admin] RBAC: Authorization granted {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:18:32.312695 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c608f6-f238-494c-b362-a368269a4a94 None admin] Validating token access rules against request {{(pid=479851) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:18:32.346028 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b71bef7-6b47-46bc-b668-f9d1f865a9a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479851) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:18:32.346695 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b71bef7-6b47-46bc-b668-f9d1f865a9a5 None admin] REQUEST_METHOD: `GET` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:18:32.346977 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b71bef7-6b47-46bc-b668-f9d1f865a9a5 None admin] SCRIPT_NAME: `/identity` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:18:32.347254 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b71bef7-6b47-46bc-b668-f9d1f865a9a5 None admin] PATH_INFO: `/v3/projects/ef022c0e613d4a2bac6fe1e0e339b92c` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:18:32.348466 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b71bef7-6b47-46bc-b668-f9d1f865a9a5 None admin] RBAC: Authorizing `identity:get_project(project_id=ef022c0e613d4a2bac6fe1e0e339b92c)` {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:18:32.349990 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b71bef7-6b47-46bc-b668-f9d1f865a9a5 None admin] RBAC: Authorization granted {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:18:32.352188 dv-cinder-851351-1-smb devstack@keystone.service[479851]: [pid: 479851|app: 0|req: 129/265] 10.222.0.42 () {56 vars in 1186 bytes} [Thu Jul 28 09:18:32 2022] GET /identity/v3/projects/ef022c0e613d4a2bac6fe1e0e339b92c => generated 302 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 09:18:32.362511 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b71bef7-6b47-46bc-b668-f9d1f865a9a5 None admin] Authenticating user token {{(pid=479851) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:18:32.369909 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG dbcounter [-] [479851] Writing DB stats keystone:SELECT=100 {{(pid=479851) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:18:32.473296 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b71bef7-6b47-46bc-b668-f9d1f865a9a5 None admin] Validating token access rules against request {{(pid=479851) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:18:32.508418 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948381bf-909e-423f-bf3e-714a5244d668 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479851) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:18:32.509097 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948381bf-909e-423f-bf3e-714a5244d668 None admin] REQUEST_METHOD: `GET` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:18:32.509388 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948381bf-909e-423f-bf3e-714a5244d668 None admin] SCRIPT_NAME: `/identity` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:18:32.509671 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948381bf-909e-423f-bf3e-714a5244d668 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:18:32.510489 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-948381bf-909e-423f-bf3e-714a5244d668 None admin] RBAC: Adding query filter params (role.id=685084310b35477b9b2d0c7934d0f803, scope.project.id=ef022c0e613d4a2bac6fe1e0e339b92c, user.id=ab8fbe19586f4baf86846ca0a77ea800) {{(pid=479851) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 09:18:32.510812 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-948381bf-909e-423f-bf3e-714a5244d668 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:18:32.513017 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-948381bf-909e-423f-bf3e-714a5244d668 None admin] RBAC: Authorization granted {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:18:32.522086 dv-cinder-851351-1-smb devstack@keystone.service[479851]: [pid: 479851|app: 0|req: 130/266] 10.222.0.42 () {56 vars in 1374 bytes} [Thu Jul 28 09:18:32 2022] GET /identity/v3/role_assignments?user.id=ab8fbe19586f4baf86846ca0a77ea800&scope.project.id=ef022c0e613d4a2bac6fe1e0e339b92c&role.id=685084310b35477b9b2d0c7934d0f803 => generated 608 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:18:32.566400 dv-cinder-851351-1-smb devstack@keystone.service[479852]: [pid: 479852|app: 0|req: 137/267] 10.222.0.42 () {58 vars in 1282 bytes} [Thu Jul 28 09:18:31 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 740 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 28 09:18:32.572828 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948381bf-909e-423f-bf3e-714a5244d668 None admin] Authenticating user token {{(pid=479851) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:18:32.663173 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG dbcounter [-] [479851] Writing DB stats keystone:SELECT=100 {{(pid=479851) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:18:32.700288 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948381bf-909e-423f-bf3e-714a5244d668 None admin] Validating token access rules against request {{(pid=479851) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:18:32.737874 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7442714a-499e-49ba-b0ec-5bb391cb02c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479851) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:18:32.738546 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7442714a-499e-49ba-b0ec-5bb391cb02c2 None admin] REQUEST_METHOD: `GET` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:18:32.738830 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7442714a-499e-49ba-b0ec-5bb391cb02c2 None admin] SCRIPT_NAME: `/identity` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:18:32.739106 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7442714a-499e-49ba-b0ec-5bb391cb02c2 None admin] PATH_INFO: `/v3/projects/ef022c0e613d4a2bac6fe1e0e339b92c` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:18:32.740305 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7442714a-499e-49ba-b0ec-5bb391cb02c2 None admin] RBAC: Authorizing `identity:get_project(project_id=ef022c0e613d4a2bac6fe1e0e339b92c)` {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:18:32.741865 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7442714a-499e-49ba-b0ec-5bb391cb02c2 None admin] RBAC: Authorization granted {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:18:32.743646 dv-cinder-851351-1-smb devstack@keystone.service[479851]: [pid: 479851|app: 0|req: 131/268] 10.222.0.42 () {56 vars in 1186 bytes} [Thu Jul 28 09:18:32 2022] GET /identity/v3/projects/ef022c0e613d4a2bac6fe1e0e339b92c => generated 302 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:18:32.749938 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e5dbbf-6c89-484b-bae8-61ef04022d73 None admin] Authenticating user token {{(pid=479852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:18:32.855715 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG dbcounter [-] [479852] Writing DB stats keystone:SELECT=100 {{(pid=479852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:18:32.905678 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e5dbbf-6c89-484b-bae8-61ef04022d73 None admin] Validating token access rules against request {{(pid=479852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:18:32.962486 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953418ec-207a-4b7f-86f8-e9c5a5f59231 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:18:32.963062 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953418ec-207a-4b7f-86f8-e9c5a5f59231 None admin] REQUEST_METHOD: `GET` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:18:32.963344 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953418ec-207a-4b7f-86f8-e9c5a5f59231 None admin] SCRIPT_NAME: `/identity` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:18:32.963625 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953418ec-207a-4b7f-86f8-e9c5a5f59231 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:18:32.964448 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-953418ec-207a-4b7f-86f8-e9c5a5f59231 None admin] RBAC: Adding query filter params (role.id=acf1d2de5e5448beb6363dae3d154a02, scope.project.id=ef022c0e613d4a2bac6fe1e0e339b92c, user.id=ab8fbe19586f4baf86846ca0a77ea800) {{(pid=479852) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 09:18:32.964791 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-953418ec-207a-4b7f-86f8-e9c5a5f59231 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:18:32.966271 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-953418ec-207a-4b7f-86f8-e9c5a5f59231 None admin] RBAC: Authorization granted {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:18:32.978013 dv-cinder-851351-1-smb devstack@keystone.service[479852]: [pid: 479852|app: 0|req: 138/269] 10.222.0.42 () {56 vars in 1374 bytes} [Thu Jul 28 09:18:32 2022] GET /identity/v3/role_assignments?user.id=ab8fbe19586f4baf86846ca0a77ea800&scope.project.id=ef022c0e613d4a2bac6fe1e0e339b92c&role.id=acf1d2de5e5448beb6363dae3d154a02 => generated 608 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:18:33.156774 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad51bc69-144f-435c-b62e-5169c87b0afd None None] REQUEST_METHOD: `GET` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:18:33.157819 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad51bc69-144f-435c-b62e-5169c87b0afd None None] SCRIPT_NAME: `/identity` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:18:33.158331 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad51bc69-144f-435c-b62e-5169c87b0afd None None] PATH_INFO: `/` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:18:33.160482 dv-cinder-851351-1-smb devstack@keystone.service[479851]: [pid: 479851|app: 0|req: 132/270] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 09:18:33 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 09:18:33.166086 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfdc58ea-0ceb-4114-ad34-fa71d666d05b None None] REQUEST_METHOD: `POST` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:18:33.166723 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfdc58ea-0ceb-4114-ad34-fa71d666d05b None None] SCRIPT_NAME: `/identity` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:18:33.167201 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfdc58ea-0ceb-4114-ad34-fa71d666d05b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:18:33.193955 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.auth.core [None req-cfdc58ea-0ceb-4114-ad34-fa71d666d05b None None] MFA Rules not processed for user `c198f91a4ae84d2b9cc730a6e304c2be`. Rule list: `[]` (Enabled: `True`). {{(pid=479852) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 09:18:33.195591 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.fernet_utils [None req-cfdc58ea-0ceb-4114-ad34-fa71d666d05b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=479852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 09:18:33.286982 dv-cinder-851351-1-smb devstack@keystone.service[479852]: [pid: 479852|app: 0|req: 139/271] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 09:18:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 09:18:33.310291 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad51bc69-144f-435c-b62e-5169c87b0afd None None] Authenticating user token {{(pid=479851) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:18:33.354565 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074f1a68-1992-455b-9c17-3349a50b8c8c None None] REQUEST_METHOD: `GET` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:18:33.354565 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074f1a68-1992-455b-9c17-3349a50b8c8c None None] SCRIPT_NAME: `/identity` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:18:33.354565 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074f1a68-1992-455b-9c17-3349a50b8c8c None None] PATH_INFO: `/` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:18:33.355525 dv-cinder-851351-1-smb devstack@keystone.service[479852]: [pid: 479852|app: 0|req: 140/272] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 09:18:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 09:18:33.361978 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40d7596-7ec7-42e3-8631-4d6d3a45eaed None None] REQUEST_METHOD: `POST` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:18:33.362257 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40d7596-7ec7-42e3-8631-4d6d3a45eaed None None] SCRIPT_NAME: `/identity` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:18:33.362590 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40d7596-7ec7-42e3-8631-4d6d3a45eaed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:18:33.397616 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.auth.core [None req-b40d7596-7ec7-42e3-8631-4d6d3a45eaed None None] MFA Rules not processed for user `c198f91a4ae84d2b9cc730a6e304c2be`. Rule list: `[]` (Enabled: `True`). {{(pid=479852) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 09:18:33.398907 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.fernet_utils [None req-b40d7596-7ec7-42e3-8631-4d6d3a45eaed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=479852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 09:18:33.449968 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad51bc69-144f-435c-b62e-5169c87b0afd None None] Validating token access rules against request {{(pid=479851) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:18:33.469922 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG dbcounter [-] [479852] Writing DB stats keystone:SELECT=100 {{(pid=479852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:18:33.492243 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f954c1c0-dfd2-4b0f-bad5-50fdb0f9f8b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479851) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:18:33.492738 dv-cinder-851351-1-smb devstack@keystone.service[479852]: [pid: 479852|app: 0|req: 141/273] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 09:18:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 28 09:18:33.492967 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f954c1c0-dfd2-4b0f-bad5-50fdb0f9f8b1 None admin] REQUEST_METHOD: `GET` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:18:33.493260 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f954c1c0-dfd2-4b0f-bad5-50fdb0f9f8b1 None admin] SCRIPT_NAME: `/identity` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:18:33.493545 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f954c1c0-dfd2-4b0f-bad5-50fdb0f9f8b1 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:18:33.496531 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG dbcounter [-] [479851] Writing DB stats keystone:SELECT=100 {{(pid=479851) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:18:33.506532 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f954c1c0-dfd2-4b0f-bad5-50fdb0f9f8b1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 09:18:33.508361 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec31452-635d-4d32-8917-4322611035b6 None None] REQUEST_METHOD: `GET` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:18:33.508649 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec31452-635d-4d32-8917-4322611035b6 None None] SCRIPT_NAME: `/identity` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:18:33.508954 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec31452-635d-4d32-8917-4322611035b6 None None] PATH_INFO: `/` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:18:33.511787 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application [None req-f954c1c0-dfd2-4b0f-bad5-50fdb0f9f8b1 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 28 09:18:33.511787 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 09:18:33.511787 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 09:18:33.511787 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 09:18:33.511787 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 09:18:33.511787 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 09:18:33.511787 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 09:18:33.511787 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 09:18:33.511787 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 09:18:33.511787 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 09:18:33.511787 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 09:18:33.511787 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 09:18:33.511787 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 09:18:33.511787 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 09:18:33.511787 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 09:18:33.511787 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 09:18:33.512947 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 09:18:33.512947 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 09:18:33.512947 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 09:18:33.512947 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 09:18:33.512947 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 09:18:33.512947 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 09:18:33.512947 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 09:18:33.512947 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 09:18:33.512947 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 09:18:33.512947 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 09:18:33.512947 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 09:18:33.512947 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application with Lock( Jul 28 09:18:33.512947 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 09:18:33.512947 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return self._enter() Jul 28 09:18:33.512947 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 09:18:33.512947 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 09:18:33.513948 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 09:18:33.513948 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return self.creator() Jul 28 09:18:33.513948 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 09:18:33.513948 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application created_value = creator( Jul 28 09:18:33.513948 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 09:18:33.513948 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 09:18:33.513948 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 09:18:33.513948 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 09:18:33.513948 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 09:18:33.513948 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 09:18:33.513948 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 28 09:18:33.513948 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application Jul 28 09:18:33.513948 dv-cinder-851351-1-smb devstack@keystone.service[479851]: [pid: 479851|app: 0|req: 133/275] 10.222.0.42 () {56 vars in 1099 bytes} [Thu Jul 28 09:18:33 2022] GET /identity/v3/roles/reader => generated 84 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 09:18:33.514775 dv-cinder-851351-1-smb devstack@keystone.service[479852]: [pid: 479852|app: 0|req: 142/275] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 09:18:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 09:18:33.514997 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3eea406-18d2-4f4f-b26d-0ce53f04f668 None None] REQUEST_METHOD: `GET` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:18:33.515249 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3eea406-18d2-4f4f-b26d-0ce53f04f668 None None] SCRIPT_NAME: `/identity` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:18:33.515541 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3eea406-18d2-4f4f-b26d-0ce53f04f668 None None] PATH_INFO: `/` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:18:33.518409 dv-cinder-851351-1-smb devstack@keystone.service[479851]: [pid: 479851|app: 0|req: 134/276] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 09:18:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 09:18:33.519029 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3eea406-18d2-4f4f-b26d-0ce53f04f668 None None] Authenticating user token {{(pid=479851) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:18:33.519517 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2003ef36-7cd7-4add-82f2-bc78ea42790e None None] REQUEST_METHOD: `POST` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:18:33.519812 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2003ef36-7cd7-4add-82f2-bc78ea42790e None None] SCRIPT_NAME: `/identity` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:18:33.520090 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2003ef36-7cd7-4add-82f2-bc78ea42790e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:18:33.542767 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.auth.core [None req-2003ef36-7cd7-4add-82f2-bc78ea42790e None None] MFA Rules not processed for user `c198f91a4ae84d2b9cc730a6e304c2be`. Rule list: `[]` (Enabled: `True`). {{(pid=479852) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 09:18:33.543880 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.fernet_utils [None req-2003ef36-7cd7-4add-82f2-bc78ea42790e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=479852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 09:18:33.615388 dv-cinder-851351-1-smb devstack@keystone.service[479852]: [pid: 479852|app: 0|req: 143/277] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 09:18:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 28 09:18:33.616598 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2003ef36-7cd7-4add-82f2-bc78ea42790e None None] Authenticating user token {{(pid=479852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:18:33.620886 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3eea406-18d2-4f4f-b26d-0ce53f04f668 None None] Validating token access rules against request {{(pid=479851) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:18:33.657613 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f15fb1-51ce-49e9-94fc-cd36fd234f7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479851) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:18:33.658682 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f15fb1-51ce-49e9-94fc-cd36fd234f7d None admin] REQUEST_METHOD: `GET` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:18:33.659180 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f15fb1-51ce-49e9-94fc-cd36fd234f7d None admin] SCRIPT_NAME: `/identity` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:18:33.659672 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f15fb1-51ce-49e9-94fc-cd36fd234f7d None admin] PATH_INFO: `/v3/roles` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:18:33.661048 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6f15fb1-51ce-49e9-94fc-cd36fd234f7d None admin] RBAC: Adding query filter params (name=reader) {{(pid=479851) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 09:18:33.661601 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6f15fb1-51ce-49e9-94fc-cd36fd234f7d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:18:33.664286 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6f15fb1-51ce-49e9-94fc-cd36fd234f7d None admin] RBAC: Authorization granted {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:18:33.684598 dv-cinder-851351-1-smb devstack@keystone.service[479851]: [pid: 479851|app: 0|req: 135/278] 10.222.0.42 () {56 vars in 1101 bytes} [Thu Jul 28 09:18:33 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:18:33.684598 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb2c42d-0efb-4db3-8fc9-be5ca9d5183c None None] REQUEST_METHOD: `POST` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:18:33.684598 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb2c42d-0efb-4db3-8fc9-be5ca9d5183c None None] SCRIPT_NAME: `/identity` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:18:33.684598 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb2c42d-0efb-4db3-8fc9-be5ca9d5183c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:18:33.713107 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.auth.core [None req-afb2c42d-0efb-4db3-8fc9-be5ca9d5183c None None] MFA Rules not processed for user `c198f91a4ae84d2b9cc730a6e304c2be`. Rule list: `[]` (Enabled: `True`). {{(pid=479851) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 09:18:33.715214 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.fernet_utils [None req-afb2c42d-0efb-4db3-8fc9-be5ca9d5183c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=479851) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 09:18:33.721928 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2003ef36-7cd7-4add-82f2-bc78ea42790e None None] Validating token access rules against request {{(pid=479852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:18:33.739060 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG dbcounter [-] [479852] Writing DB stats keystone:SELECT=100 {{(pid=479852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:18:33.756581 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01adaccc-1aab-4f8a-b62a-142087a2d1bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:18:33.757277 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01adaccc-1aab-4f8a-b62a-142087a2d1bb None admin] REQUEST_METHOD: `GET` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:18:33.757563 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01adaccc-1aab-4f8a-b62a-142087a2d1bb None admin] SCRIPT_NAME: `/identity` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:18:33.757845 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01adaccc-1aab-4f8a-b62a-142087a2d1bb None admin] PATH_INFO: `/v3/roles/member` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:18:33.768175 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01adaccc-1aab-4f8a-b62a-142087a2d1bb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 09:18:33.773292 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application [None req-01adaccc-1aab-4f8a-b62a-142087a2d1bb None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 28 09:18:33.773292 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 09:18:33.773292 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 09:18:33.773292 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 09:18:33.773292 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 09:18:33.773292 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 09:18:33.773292 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 09:18:33.773292 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 09:18:33.773292 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 09:18:33.773292 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 09:18:33.773292 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 09:18:33.773292 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 09:18:33.773292 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 09:18:33.773292 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 09:18:33.773292 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 09:18:33.773292 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 09:18:33.774394 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 09:18:33.774394 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 09:18:33.774394 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 09:18:33.774394 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 09:18:33.774394 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 09:18:33.774394 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 09:18:33.774394 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 09:18:33.774394 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 09:18:33.774394 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 09:18:33.774394 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 09:18:33.774394 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 09:18:33.774394 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application with Lock( Jul 28 09:18:33.774394 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 09:18:33.774394 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self._enter() Jul 28 09:18:33.774394 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 09:18:33.774394 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 09:18:33.775364 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 09:18:33.775364 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self.creator() Jul 28 09:18:33.775364 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 09:18:33.775364 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application created_value = creator( Jul 28 09:18:33.775364 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 09:18:33.775364 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 09:18:33.775364 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 09:18:33.775364 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 09:18:33.775364 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 09:18:33.775364 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 09:18:33.775364 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 28 09:18:33.775364 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application Jul 28 09:18:33.775364 dv-cinder-851351-1-smb devstack@keystone.service[479852]: [pid: 479852|app: 0|req: 144/279] 10.222.0.42 () {56 vars in 1099 bytes} [Thu Jul 28 09:18:33 2022] GET /identity/v3/roles/member => generated 84 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 09:18:33.775364 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01adaccc-1aab-4f8a-b62a-142087a2d1bb None admin] Authenticating user token {{(pid=479852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:18:33.780980 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG dbcounter [-] [479851] Writing DB stats keystone:SELECT=100 {{(pid=479851) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:18:33.796443 dv-cinder-851351-1-smb devstack@keystone.service[479851]: [pid: 479851|app: 0|req: 136/280] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 09:18:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 09:18:33.797256 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb2c42d-0efb-4db3-8fc9-be5ca9d5183c None None] Authenticating user token {{(pid=479851) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:18:33.886594 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01adaccc-1aab-4f8a-b62a-142087a2d1bb None admin] Validating token access rules against request {{(pid=479852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:18:33.905694 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb2c42d-0efb-4db3-8fc9-be5ca9d5183c None None] Validating token access rules against request {{(pid=479851) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:18:33.925586 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872f0f17-c2ec-4f47-aa02-b83481cbe195 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:18:33.926249 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872f0f17-c2ec-4f47-aa02-b83481cbe195 None admin] REQUEST_METHOD: `GET` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:18:33.926537 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872f0f17-c2ec-4f47-aa02-b83481cbe195 None admin] SCRIPT_NAME: `/identity` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:18:33.926809 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872f0f17-c2ec-4f47-aa02-b83481cbe195 None admin] PATH_INFO: `/v3/roles/member` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:18:33.937393 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-872f0f17-c2ec-4f47-aa02-b83481cbe195 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 09:18:33.942810 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application [None req-872f0f17-c2ec-4f47-aa02-b83481cbe195 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 28 09:18:33.942810 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 09:18:33.942810 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 09:18:33.942810 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 09:18:33.942810 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 09:18:33.942810 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 09:18:33.942810 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 09:18:33.942810 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 09:18:33.942810 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 09:18:33.942810 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 09:18:33.942810 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 09:18:33.942810 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 09:18:33.942810 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 09:18:33.942810 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 09:18:33.942810 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 09:18:33.942810 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 09:18:33.944057 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 09:18:33.944057 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 09:18:33.944057 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 09:18:33.944057 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 09:18:33.944057 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 09:18:33.944057 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 09:18:33.944057 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 09:18:33.944057 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 09:18:33.944057 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 09:18:33.944057 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 09:18:33.944057 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 09:18:33.944057 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application with Lock( Jul 28 09:18:33.944057 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 09:18:33.944057 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self._enter() Jul 28 09:18:33.944057 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 09:18:33.944057 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 09:18:33.945078 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 09:18:33.945078 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self.creator() Jul 28 09:18:33.945078 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 09:18:33.945078 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application created_value = creator( Jul 28 09:18:33.945078 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 09:18:33.945078 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 09:18:33.945078 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 09:18:33.945078 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 09:18:33.945078 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 09:18:33.945078 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 09:18:33.945078 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 28 09:18:33.945078 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application Jul 28 09:18:33.945801 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9942ea92-d762-4393-8e0d-50e7bb72c95d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479851) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:18:33.945801 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9942ea92-d762-4393-8e0d-50e7bb72c95d None admin] REQUEST_METHOD: `GET` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:18:33.945994 dv-cinder-851351-1-smb devstack@keystone.service[479852]: [pid: 479852|app: 0|req: 145/281] 10.222.0.42 () {56 vars in 1099 bytes} [Thu Jul 28 09:18:33 2022] GET /identity/v3/roles/member => generated 84 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 09:18:33.946077 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9942ea92-d762-4393-8e0d-50e7bb72c95d None admin] SCRIPT_NAME: `/identity` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:18:33.946077 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9942ea92-d762-4393-8e0d-50e7bb72c95d None admin] PATH_INFO: `/v3/users/ed4bb27e9d6941bdb7e78c6d8cca0946` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:18:33.946222 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872f0f17-c2ec-4f47-aa02-b83481cbe195 None admin] Authenticating user token {{(pid=479852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:18:33.947650 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9942ea92-d762-4393-8e0d-50e7bb72c95d None admin] RBAC: Authorizing `identity:get_user(user_id=ed4bb27e9d6941bdb7e78c6d8cca0946)` {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:18:33.949277 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9942ea92-d762-4393-8e0d-50e7bb72c95d None admin] RBAC: Authorization granted {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:18:33.951029 dv-cinder-851351-1-smb devstack@keystone.service[479851]: [pid: 479851|app: 0|req: 137/282] 10.222.0.42 () {56 vars in 1177 bytes} [Thu Jul 28 09:18:33 2022] GET /identity/v3/users/ed4bb27e9d6941bdb7e78c6d8cca0946 => generated 297 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:18:33.951816 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9942ea92-d762-4393-8e0d-50e7bb72c95d None admin] Authenticating user token {{(pid=479851) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:18:33.992994 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG dbcounter [-] [479852] Writing DB stats keystone:SELECT=100 {{(pid=479852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:18:34.009958 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG dbcounter [-] [479851] Writing DB stats keystone:SELECT=100 {{(pid=479851) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:18:34.053833 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9942ea92-d762-4393-8e0d-50e7bb72c95d None admin] Validating token access rules against request {{(pid=479851) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:18:34.056049 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872f0f17-c2ec-4f47-aa02-b83481cbe195 None admin] Validating token access rules against request {{(pid=479852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:18:34.088376 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9b3d12-a307-4061-a1ac-bff790c47315 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479851) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:18:34.089096 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9b3d12-a307-4061-a1ac-bff790c47315 None admin] REQUEST_METHOD: `GET` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:18:34.089389 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9b3d12-a307-4061-a1ac-bff790c47315 None admin] SCRIPT_NAME: `/identity` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:18:34.089671 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9b3d12-a307-4061-a1ac-bff790c47315 None admin] PATH_INFO: `/v3/domains/default` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:18:34.090931 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b9b3d12-a307-4061-a1ac-bff790c47315 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:18:34.091880 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30260aca-fed7-4f59-91a0-21ce33e6d453 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:18:34.092409 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b9b3d12-a307-4061-a1ac-bff790c47315 None admin] RBAC: Authorization granted {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:18:34.092530 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30260aca-fed7-4f59-91a0-21ce33e6d453 None admin] REQUEST_METHOD: `GET` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:18:34.092824 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30260aca-fed7-4f59-91a0-21ce33e6d453 None admin] SCRIPT_NAME: `/identity` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:18:34.093105 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30260aca-fed7-4f59-91a0-21ce33e6d453 None admin] PATH_INFO: `/v3/roles` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:18:34.093831 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30260aca-fed7-4f59-91a0-21ce33e6d453 None admin] RBAC: Adding query filter params (name=member) {{(pid=479852) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 09:18:34.094084 dv-cinder-851351-1-smb devstack@keystone.service[479851]: [pid: 479851|app: 0|req: 138/283] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 09:18:33 2022] GET /identity/v3/domains/default => generated 199 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:18:34.094227 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30260aca-fed7-4f59-91a0-21ce33e6d453 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:18:34.094863 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9b3d12-a307-4061-a1ac-bff790c47315 None admin] Authenticating user token {{(pid=479851) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:18:34.095513 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30260aca-fed7-4f59-91a0-21ce33e6d453 None admin] RBAC: Authorization granted {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:18:34.104444 dv-cinder-851351-1-smb devstack@keystone.service[479852]: [pid: 479852|app: 0|req: 146/284] 10.222.0.42 () {56 vars in 1101 bytes} [Thu Jul 28 09:18:33 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:18:34.105169 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30260aca-fed7-4f59-91a0-21ce33e6d453 None admin] Authenticating user token {{(pid=479852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:18:34.200953 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9b3d12-a307-4061-a1ac-bff790c47315 None admin] Validating token access rules against request {{(pid=479851) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:18:34.205534 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG dbcounter [-] [479852] Writing DB stats keystone:SELECT=100 {{(pid=479852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:18:34.208739 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30260aca-fed7-4f59-91a0-21ce33e6d453 None admin] Validating token access rules against request {{(pid=479852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:18:34.224938 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG dbcounter [-] [479851] Writing DB stats keystone:SELECT=100 {{(pid=479851) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:18:34.235930 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c3d234-e7e7-4bba-8202-b949636c1539 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479851) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:18:34.236567 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c3d234-e7e7-4bba-8202-b949636c1539 None admin] REQUEST_METHOD: `GET` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:18:34.236892 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c3d234-e7e7-4bba-8202-b949636c1539 None admin] SCRIPT_NAME: `/identity` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:18:34.237174 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c3d234-e7e7-4bba-8202-b949636c1539 None admin] PATH_INFO: `/v3/roles` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:18:34.237906 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c3d234-e7e7-4bba-8202-b949636c1539 None admin] RBAC: Adding query filter params (name=member) {{(pid=479851) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 09:18:34.238213 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c3d234-e7e7-4bba-8202-b949636c1539 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:18:34.239592 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c3d234-e7e7-4bba-8202-b949636c1539 None admin] RBAC: Authorization granted {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:18:34.242788 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29cdcd26-1197-49bb-ad92-a1fe465adb1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:18:34.243439 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29cdcd26-1197-49bb-ad92-a1fe465adb1e None admin] REQUEST_METHOD: `GET` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:18:34.243717 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29cdcd26-1197-49bb-ad92-a1fe465adb1e None admin] SCRIPT_NAME: `/identity` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:18:34.243991 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29cdcd26-1197-49bb-ad92-a1fe465adb1e None admin] PATH_INFO: `/v3/projects/ef022c0e613d4a2bac6fe1e0e339b92c` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:18:34.245195 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29cdcd26-1197-49bb-ad92-a1fe465adb1e None admin] RBAC: Authorizing `identity:get_project(project_id=ef022c0e613d4a2bac6fe1e0e339b92c)` {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:18:34.246630 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29cdcd26-1197-49bb-ad92-a1fe465adb1e None admin] RBAC: Authorization granted {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:18:34.247918 dv-cinder-851351-1-smb devstack@keystone.service[479851]: [pid: 479851|app: 0|req: 139/285] 10.222.0.42 () {56 vars in 1101 bytes} [Thu Jul 28 09:18:34 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:18:34.253092 dv-cinder-851351-1-smb devstack@keystone.service[479852]: [pid: 479852|app: 0|req: 147/286] 10.222.0.42 () {56 vars in 1186 bytes} [Thu Jul 28 09:18:34 2022] GET /identity/v3/projects/ef022c0e613d4a2bac6fe1e0e339b92c => generated 302 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:18:34.253270 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c3d234-e7e7-4bba-8202-b949636c1539 None admin] Authenticating user token {{(pid=479851) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:18:34.253375 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29cdcd26-1197-49bb-ad92-a1fe465adb1e None admin] Authenticating user token {{(pid=479852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:18:34.348654 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29cdcd26-1197-49bb-ad92-a1fe465adb1e None admin] Validating token access rules against request {{(pid=479852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:18:34.353656 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c3d234-e7e7-4bba-8202-b949636c1539 None admin] Validating token access rules against request {{(pid=479851) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:18:34.385016 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535604ab-47f9-4313-834c-ab69e6d9ef80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:18:34.385695 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535604ab-47f9-4313-834c-ab69e6d9ef80 None admin] REQUEST_METHOD: `GET` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:18:34.385995 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535604ab-47f9-4313-834c-ab69e6d9ef80 None admin] SCRIPT_NAME: `/identity` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:18:34.386267 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535604ab-47f9-4313-834c-ab69e6d9ef80 None admin] PATH_INFO: `/v3/users/40042f730d784b379661387e73fe401c` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:18:34.390632 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a53c03-3032-4aba-af90-386ae4cafb20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479851) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:18:34.391269 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a53c03-3032-4aba-af90-386ae4cafb20 None admin] REQUEST_METHOD: `POST` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:18:34.391561 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a53c03-3032-4aba-af90-386ae4cafb20 None admin] SCRIPT_NAME: `/identity` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:18:34.391845 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a53c03-3032-4aba-af90-386ae4cafb20 None admin] PATH_INFO: `/v3/users` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:18:34.392553 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88a53c03-3032-4aba-af90-386ae4cafb20 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:18:34.394053 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88a53c03-3032-4aba-af90-386ae4cafb20 None admin] RBAC: Authorization granted {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:18:34.400077 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-535604ab-47f9-4313-834c-ab69e6d9ef80 None admin] RBAC: Authorizing `identity:get_user(user_id=40042f730d784b379661387e73fe401c)` {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:18:34.401572 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-535604ab-47f9-4313-834c-ab69e6d9ef80 None admin] RBAC: Authorization granted {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:18:34.403234 dv-cinder-851351-1-smb devstack@keystone.service[479852]: [pid: 479852|app: 0|req: 148/287] 10.222.0.42 () {56 vars in 1177 bytes} [Thu Jul 28 09:18:34 2022] GET /identity/v3/users/40042f730d784b379661387e73fe401c => generated 293 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:18:34.404012 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535604ab-47f9-4313-834c-ab69e6d9ef80 None admin] Authenticating user token {{(pid=479852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:18:34.426729 dv-cinder-851351-1-smb devstack@keystone.service[479851]: [pid: 479851|app: 0|req: 140/288] 10.222.0.42 () {60 vars in 1132 bytes} [Thu Jul 28 09:18:34 2022] POST /identity/v3/users => generated 293 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 09:18:34.426729 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a53c03-3032-4aba-af90-386ae4cafb20 None admin] Authenticating user token {{(pid=479851) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:18:34.453092 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG dbcounter [-] [479852] Writing DB stats keystone:SELECT=100 {{(pid=479852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:18:34.473216 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG dbcounter [-] [479851] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=479851) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:18:34.537963 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a53c03-3032-4aba-af90-386ae4cafb20 None admin] Validating token access rules against request {{(pid=479851) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:18:34.538203 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535604ab-47f9-4313-834c-ab69e6d9ef80 None admin] Validating token access rules against request {{(pid=479852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:18:34.577181 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4651918f-d512-42d8-aa5c-197146d415fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479851) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:18:34.578001 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4651918f-d512-42d8-aa5c-197146d415fb None admin] REQUEST_METHOD: `PUT` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:18:34.578296 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4651918f-d512-42d8-aa5c-197146d415fb None admin] SCRIPT_NAME: `/identity` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:18:34.578586 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4651918f-d512-42d8-aa5c-197146d415fb None admin] PATH_INFO: `/v3/projects/ef022c0e613d4a2bac6fe1e0e339b92c/users/ed4bb27e9d6941bdb7e78c6d8cca0946/roles/73525379110b4a99850473e0e9f217f1` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:18:34.580642 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4651918f-d512-42d8-aa5c-197146d415fb None admin] RBAC: Authorizing `identity:create_grant(project_id=ef022c0e613d4a2bac6fe1e0e339b92c, user_id=ed4bb27e9d6941bdb7e78c6d8cca0946, role_id=73525379110b4a99850473e0e9f217f1)` {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:18:34.582200 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4651918f-d512-42d8-aa5c-197146d415fb None admin] RBAC: Authorization granted {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:18:34.583372 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c109065f-5f1d-40f1-bd62-2274e00f38f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:18:34.584073 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c109065f-5f1d-40f1-bd62-2274e00f38f9 None admin] REQUEST_METHOD: `GET` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:18:34.584392 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c109065f-5f1d-40f1-bd62-2274e00f38f9 None admin] SCRIPT_NAME: `/identity` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:18:34.584755 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c109065f-5f1d-40f1-bd62-2274e00f38f9 None admin] PATH_INFO: `/v3/users/ca3be4ca4e38489d97ebdcc8800b96c0` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:18:34.586075 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c109065f-5f1d-40f1-bd62-2274e00f38f9 None admin] RBAC: Authorizing `identity:get_user(user_id=ca3be4ca4e38489d97ebdcc8800b96c0)` {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:18:34.587545 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c109065f-5f1d-40f1-bd62-2274e00f38f9 None admin] RBAC: Authorization granted {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:18:34.589241 dv-cinder-851351-1-smb devstack@keystone.service[479852]: [pid: 479852|app: 0|req: 149/289] 10.222.0.42 () {56 vars in 1177 bytes} [Thu Jul 28 09:18:34 2022] GET /identity/v3/users/ca3be4ca4e38489d97ebdcc8800b96c0 => generated 297 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:18:34.590192 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c109065f-5f1d-40f1-bd62-2274e00f38f9 None admin] Authenticating user token {{(pid=479852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:18:34.605141 dv-cinder-851351-1-smb devstack@keystone.service[479851]: [pid: 479851|app: 0|req: 141/290] 10.222.0.42 () {58 vars in 1439 bytes} [Thu Jul 28 09:18:34 2022] PUT /identity/v3/projects/ef022c0e613d4a2bac6fe1e0e339b92c/users/ed4bb27e9d6941bdb7e78c6d8cca0946/roles/73525379110b4a99850473e0e9f217f1 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 09:18:34.606366 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4651918f-d512-42d8-aa5c-197146d415fb None admin] Authenticating user token {{(pid=479851) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:18:34.728357 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG dbcounter [-] [479852] Writing DB stats keystone:SELECT=100 {{(pid=479852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:18:34.736230 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c109065f-5f1d-40f1-bd62-2274e00f38f9 None admin] Validating token access rules against request {{(pid=479852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:18:34.756032 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4651918f-d512-42d8-aa5c-197146d415fb None admin] Validating token access rules against request {{(pid=479851) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:18:34.757810 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG dbcounter [-] [479851] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=479851) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:18:34.801125 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d75bdc-ce74-4314-9ea0-7963d4a0c451 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:18:34.802387 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d75bdc-ce74-4314-9ea0-7963d4a0c451 None admin] REQUEST_METHOD: `GET` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:18:34.802895 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d75bdc-ce74-4314-9ea0-7963d4a0c451 None admin] SCRIPT_NAME: `/identity` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:18:34.803480 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d75bdc-ce74-4314-9ea0-7963d4a0c451 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:18:34.804529 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d75bdc-ce74-4314-9ea0-7963d4a0c451 None admin] RBAC: Adding query filter params (role.id=900fb424e172461d93a0db59afb0a12b, user.id=40042f730d784b379661387e73fe401c, scope.system=all) {{(pid=479852) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 09:18:34.805048 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d75bdc-ce74-4314-9ea0-7963d4a0c451 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:18:34.806263 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee0310e-3133-431a-a631-260637a15291 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479851) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:18:34.806953 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee0310e-3133-431a-a631-260637a15291 None admin] REQUEST_METHOD: `GET` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:18:34.807097 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d75bdc-ce74-4314-9ea0-7963d4a0c451 None admin] RBAC: Authorization granted {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:18:34.807285 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee0310e-3133-431a-a631-260637a15291 None admin] SCRIPT_NAME: `/identity` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:18:34.807523 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee0310e-3133-431a-a631-260637a15291 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:18:34.814404 dv-cinder-851351-1-smb devstack@keystone.service[479852]: [pid: 479852|app: 0|req: 150/291] 10.222.0.42 () {56 vars in 1308 bytes} [Thu Jul 28 09:18:34 2022] GET /identity/v3/role_assignments?user.id=40042f730d784b379661387e73fe401c&scope.system=all&role.id=900fb424e172461d93a0db59afb0a12b => generated 226 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:18:34.894639 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bee0310e-3133-431a-a631-260637a15291 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:18:34.896090 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bee0310e-3133-431a-a631-260637a15291 None admin] RBAC: Authorization granted {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:18:35.024307 dv-cinder-851351-1-smb devstack@keystone.service[479851]: [pid: 479851|app: 0|req: 142/292] 10.222.0.42 () {58 vars in 1282 bytes} [Thu Jul 28 09:18:34 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 418 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 28 09:18:35.030310 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d75bdc-ce74-4314-9ea0-7963d4a0c451 None admin] Authenticating user token {{(pid=479852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:18:35.154927 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d75bdc-ce74-4314-9ea0-7963d4a0c451 None admin] Validating token access rules against request {{(pid=479852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:18:35.198063 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f75e18f-8e61-49f3-800b-06f125274663 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:18:35.198730 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f75e18f-8e61-49f3-800b-06f125274663 None admin] REQUEST_METHOD: `GET` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:18:35.199015 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f75e18f-8e61-49f3-800b-06f125274663 None admin] SCRIPT_NAME: `/identity` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:18:35.199296 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f75e18f-8e61-49f3-800b-06f125274663 None admin] PATH_INFO: `/v3/projects/ef022c0e613d4a2bac6fe1e0e339b92c` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:18:35.200497 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f75e18f-8e61-49f3-800b-06f125274663 None admin] RBAC: Authorizing `identity:get_project(project_id=ef022c0e613d4a2bac6fe1e0e339b92c)` {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:18:35.201999 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f75e18f-8e61-49f3-800b-06f125274663 None admin] RBAC: Authorization granted {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:18:35.203895 dv-cinder-851351-1-smb devstack@keystone.service[479852]: [pid: 479852|app: 0|req: 151/293] 10.222.0.42 () {56 vars in 1186 bytes} [Thu Jul 28 09:18:35 2022] GET /identity/v3/projects/ef022c0e613d4a2bac6fe1e0e339b92c => generated 302 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:18:35.209829 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee0310e-3133-431a-a631-260637a15291 None admin] Authenticating user token {{(pid=479851) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:18:35.212066 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG dbcounter [-] [479851] Writing DB stats keystone:SELECT=100 {{(pid=479851) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:18:35.349407 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee0310e-3133-431a-a631-260637a15291 None admin] Validating token access rules against request {{(pid=479851) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:18:35.403558 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21837b28-00d0-4621-a73f-626158854d16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479851) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:18:35.404224 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21837b28-00d0-4621-a73f-626158854d16 None admin] REQUEST_METHOD: `GET` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:18:35.404512 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21837b28-00d0-4621-a73f-626158854d16 None admin] SCRIPT_NAME: `/identity` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:18:35.404902 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21837b28-00d0-4621-a73f-626158854d16 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:18:35.405793 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21837b28-00d0-4621-a73f-626158854d16 None admin] RBAC: Adding query filter params (role.id=900fb424e172461d93a0db59afb0a12b, scope.project.id=ef022c0e613d4a2bac6fe1e0e339b92c, user.id=ca3be4ca4e38489d97ebdcc8800b96c0) {{(pid=479851) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 09:18:35.406054 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21837b28-00d0-4621-a73f-626158854d16 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:18:35.407597 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21837b28-00d0-4621-a73f-626158854d16 None admin] RBAC: Authorization granted {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:18:35.418330 dv-cinder-851351-1-smb devstack@keystone.service[479851]: [pid: 479851|app: 0|req: 143/294] 10.222.0.42 () {56 vars in 1374 bytes} [Thu Jul 28 09:18:35 2022] GET /identity/v3/role_assignments?user.id=ca3be4ca4e38489d97ebdcc8800b96c0&scope.project.id=ef022c0e613d4a2bac6fe1e0e339b92c&role.id=900fb424e172461d93a0db59afb0a12b => generated 608 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:18:36.797893 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32c66e0-6146-4a7e-b499-815fbaab56af None None] REQUEST_METHOD: `GET` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:18:36.798446 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32c66e0-6146-4a7e-b499-815fbaab56af None None] SCRIPT_NAME: `/identity` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:18:36.798446 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32c66e0-6146-4a7e-b499-815fbaab56af None None] PATH_INFO: `/` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:18:36.800039 dv-cinder-851351-1-smb devstack@keystone.service[479852]: [pid: 479852|app: 0|req: 152/295] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 09:18:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 09:18:36.805910 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d49bb82-44fe-4b3f-954d-86193694b277 None None] REQUEST_METHOD: `POST` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:18:36.806412 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d49bb82-44fe-4b3f-954d-86193694b277 None None] SCRIPT_NAME: `/identity` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:18:36.806525 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d49bb82-44fe-4b3f-954d-86193694b277 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:18:36.825761 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.auth.core [None req-3d49bb82-44fe-4b3f-954d-86193694b277 None None] MFA Rules not processed for user `c198f91a4ae84d2b9cc730a6e304c2be`. Rule list: `[]` (Enabled: `True`). {{(pid=479851) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 09:18:36.826985 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.fernet_utils [None req-3d49bb82-44fe-4b3f-954d-86193694b277 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=479851) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 09:18:36.840549 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eef39d9-2c78-4b7a-b7ae-e55e6a4909dd None None] REQUEST_METHOD: `GET` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:18:36.840949 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eef39d9-2c78-4b7a-b7ae-e55e6a4909dd None None] SCRIPT_NAME: `/identity` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:18:36.841153 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eef39d9-2c78-4b7a-b7ae-e55e6a4909dd None None] PATH_INFO: `/` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:18:36.842650 dv-cinder-851351-1-smb devstack@keystone.service[479852]: [pid: 479852|app: 0|req: 153/296] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 09:18:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 28 09:18:36.849756 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607fa391-0223-4332-897a-ea45ae2bc6a9 None None] REQUEST_METHOD: `POST` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:18:36.849756 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607fa391-0223-4332-897a-ea45ae2bc6a9 None None] SCRIPT_NAME: `/identity` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:18:36.850060 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607fa391-0223-4332-897a-ea45ae2bc6a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:18:36.873218 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.auth.core [None req-607fa391-0223-4332-897a-ea45ae2bc6a9 None None] MFA Rules not processed for user `c198f91a4ae84d2b9cc730a6e304c2be`. Rule list: `[]` (Enabled: `True`). {{(pid=479852) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 09:18:36.874426 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.fernet_utils [None req-607fa391-0223-4332-897a-ea45ae2bc6a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=479852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 09:18:36.899012 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG dbcounter [-] [479852] Writing DB stats keystone:SELECT=100 {{(pid=479852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:18:36.910966 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG dbcounter [-] [479851] Writing DB stats keystone:SELECT=100 {{(pid=479851) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:18:36.921387 dv-cinder-851351-1-smb devstack@keystone.service[479851]: [pid: 479851|app: 0|req: 144/297] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 09:18:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 09:18:36.944340 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d49bb82-44fe-4b3f-954d-86193694b277 None None] Authenticating user token {{(pid=479851) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:18:36.966040 dv-cinder-851351-1-smb devstack@keystone.service[479852]: [pid: 479852|app: 0|req: 154/298] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 09:18:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 28 09:18:36.995137 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607fa391-0223-4332-897a-ea45ae2bc6a9 None None] Authenticating user token {{(pid=479852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:18:37.078829 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d49bb82-44fe-4b3f-954d-86193694b277 None None] Validating token access rules against request {{(pid=479851) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:18:37.115872 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607fa391-0223-4332-897a-ea45ae2bc6a9 None None] Validating token access rules against request {{(pid=479852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:18:37.120424 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5659776e-3e9b-4b55-a5f2-6f6bb5b6e6d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479851) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:18:37.121170 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5659776e-3e9b-4b55-a5f2-6f6bb5b6e6d4 None admin] REQUEST_METHOD: `GET` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:18:37.121467 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5659776e-3e9b-4b55-a5f2-6f6bb5b6e6d4 None admin] SCRIPT_NAME: `/identity` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:18:37.121751 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5659776e-3e9b-4b55-a5f2-6f6bb5b6e6d4 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:18:37.133683 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5659776e-3e9b-4b55-a5f2-6f6bb5b6e6d4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 09:18:37.138993 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application [None req-5659776e-3e9b-4b55-a5f2-6f6bb5b6e6d4 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 28 09:18:37.138993 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 09:18:37.138993 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 09:18:37.138993 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 09:18:37.138993 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 09:18:37.138993 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 09:18:37.138993 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 09:18:37.138993 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 09:18:37.138993 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 09:18:37.138993 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 09:18:37.138993 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 09:18:37.138993 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 09:18:37.138993 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 09:18:37.138993 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 09:18:37.138993 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 09:18:37.138993 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 09:18:37.140105 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 09:18:37.140105 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 09:18:37.140105 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 09:18:37.140105 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 09:18:37.140105 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 09:18:37.140105 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 09:18:37.140105 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 09:18:37.140105 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 09:18:37.140105 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 09:18:37.140105 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 09:18:37.140105 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 09:18:37.140105 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application with Lock( Jul 28 09:18:37.140105 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 09:18:37.140105 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return self._enter() Jul 28 09:18:37.140105 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 09:18:37.140105 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 09:18:37.141195 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 09:18:37.141195 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return self.creator() Jul 28 09:18:37.141195 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 09:18:37.141195 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application created_value = creator( Jul 28 09:18:37.141195 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 09:18:37.141195 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 09:18:37.141195 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 09:18:37.141195 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 09:18:37.141195 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 09:18:37.141195 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 09:18:37.141195 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 28 09:18:37.141195 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application Jul 28 09:18:37.141195 dv-cinder-851351-1-smb devstack@keystone.service[479851]: [pid: 479851|app: 0|req: 145/299] 10.222.0.42 () {56 vars in 1099 bytes} [Thu Jul 28 09:18:36 2022] GET /identity/v3/roles/reader => generated 84 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 09:18:37.141982 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9acf3ce7-0cc4-4fd5-8f7a-23c9bd96b8ec None None] REQUEST_METHOD: `GET` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:18:37.142985 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9acf3ce7-0cc4-4fd5-8f7a-23c9bd96b8ec None None] SCRIPT_NAME: `/identity` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:18:37.142985 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9acf3ce7-0cc4-4fd5-8f7a-23c9bd96b8ec None None] PATH_INFO: `/` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:18:37.143959 dv-cinder-851351-1-smb devstack@keystone.service[479851]: [pid: 479851|app: 0|req: 146/300] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 09:18:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 09:18:37.149780 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6576099d-cb01-4120-ba44-19d8d2dea33a None None] REQUEST_METHOD: `POST` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:18:37.150087 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6576099d-cb01-4120-ba44-19d8d2dea33a None None] SCRIPT_NAME: `/identity` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:18:37.150358 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6576099d-cb01-4120-ba44-19d8d2dea33a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:18:37.166956 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b686ce1f-2220-4aa9-99df-af463349583e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:18:37.167615 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b686ce1f-2220-4aa9-99df-af463349583e None admin] REQUEST_METHOD: `GET` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:18:37.167912 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b686ce1f-2220-4aa9-99df-af463349583e None admin] SCRIPT_NAME: `/identity` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:18:37.168182 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b686ce1f-2220-4aa9-99df-af463349583e None admin] PATH_INFO: `/v3/roles/reader` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:18:37.173566 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.auth.core [None req-6576099d-cb01-4120-ba44-19d8d2dea33a None None] MFA Rules not processed for user `c198f91a4ae84d2b9cc730a6e304c2be`. Rule list: `[]` (Enabled: `True`). {{(pid=479851) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 09:18:37.174782 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.fernet_utils [None req-6576099d-cb01-4120-ba44-19d8d2dea33a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=479851) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 09:18:37.183702 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b686ce1f-2220-4aa9-99df-af463349583e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 09:18:37.188860 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application [None req-b686ce1f-2220-4aa9-99df-af463349583e None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 28 09:18:37.188860 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 09:18:37.188860 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 09:18:37.188860 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 09:18:37.188860 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 09:18:37.188860 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 09:18:37.188860 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 09:18:37.188860 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 09:18:37.188860 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 09:18:37.188860 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 09:18:37.188860 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 09:18:37.188860 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 09:18:37.188860 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 09:18:37.188860 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 09:18:37.188860 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 09:18:37.188860 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 09:18:37.189952 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 09:18:37.189952 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 09:18:37.189952 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 09:18:37.189952 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 09:18:37.189952 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 09:18:37.189952 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 09:18:37.189952 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 09:18:37.189952 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 09:18:37.189952 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 09:18:37.189952 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 09:18:37.189952 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 09:18:37.189952 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application with Lock( Jul 28 09:18:37.189952 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 09:18:37.189952 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self._enter() Jul 28 09:18:37.189952 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 09:18:37.189952 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 09:18:37.190928 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 09:18:37.190928 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self.creator() Jul 28 09:18:37.190928 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 09:18:37.190928 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application created_value = creator( Jul 28 09:18:37.190928 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 09:18:37.190928 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 09:18:37.190928 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 09:18:37.190928 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 09:18:37.190928 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 09:18:37.190928 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 09:18:37.190928 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 28 09:18:37.190928 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application Jul 28 09:18:37.190928 dv-cinder-851351-1-smb devstack@keystone.service[479852]: [pid: 479852|app: 0|req: 155/301] 10.222.0.42 () {56 vars in 1099 bytes} [Thu Jul 28 09:18:36 2022] GET /identity/v3/roles/reader => generated 84 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 09:18:37.190928 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b686ce1f-2220-4aa9-99df-af463349583e None admin] Authenticating user token {{(pid=479852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:18:37.219081 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG dbcounter [-] [479852] Writing DB stats keystone:SELECT=100 {{(pid=479852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:18:37.241889 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG dbcounter [-] [479851] Writing DB stats keystone:SELECT=100 {{(pid=479851) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:18:37.261574 dv-cinder-851351-1-smb devstack@keystone.service[479851]: [pid: 479851|app: 0|req: 147/302] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 09:18:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 09:18:37.262448 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6576099d-cb01-4120-ba44-19d8d2dea33a None None] Authenticating user token {{(pid=479851) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:18:37.319236 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b686ce1f-2220-4aa9-99df-af463349583e None admin] Validating token access rules against request {{(pid=479852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:18:37.355197 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b007af3-f915-4b66-b2fb-af993f6fd5b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:18:37.355744 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b007af3-f915-4b66-b2fb-af993f6fd5b3 None admin] REQUEST_METHOD: `GET` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:18:37.356052 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b007af3-f915-4b66-b2fb-af993f6fd5b3 None admin] SCRIPT_NAME: `/identity` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:18:37.356315 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b007af3-f915-4b66-b2fb-af993f6fd5b3 None admin] PATH_INFO: `/v3/roles` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:18:37.357066 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b007af3-f915-4b66-b2fb-af993f6fd5b3 None admin] RBAC: Adding query filter params (name=reader) {{(pid=479852) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 09:18:37.357367 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b007af3-f915-4b66-b2fb-af993f6fd5b3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:18:37.358802 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b007af3-f915-4b66-b2fb-af993f6fd5b3 None admin] RBAC: Authorization granted {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:18:37.373171 dv-cinder-851351-1-smb devstack@keystone.service[479852]: [pid: 479852|app: 0|req: 156/303] 10.222.0.42 () {56 vars in 1101 bytes} [Thu Jul 28 09:18:37 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:18:37.373171 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8841b4-e2a5-4792-8759-d85ffdfa372a None None] REQUEST_METHOD: `GET` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:18:37.373171 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8841b4-e2a5-4792-8759-d85ffdfa372a None None] SCRIPT_NAME: `/identity` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:18:37.373171 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8841b4-e2a5-4792-8759-d85ffdfa372a None None] PATH_INFO: `/` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:18:37.373171 dv-cinder-851351-1-smb devstack@keystone.service[479852]: [pid: 479852|app: 0|req: 157/304] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 09:18:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 09:18:37.373171 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f8841b4-e2a5-4792-8759-d85ffdfa372a None None] Authenticating user token {{(pid=479852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:18:37.377645 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6576099d-cb01-4120-ba44-19d8d2dea33a None None] Validating token access rules against request {{(pid=479851) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:18:37.418701 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b0a601-d6c5-43bd-badd-1bf77c7431da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479851) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:18:37.419349 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b0a601-d6c5-43bd-badd-1bf77c7431da None admin] REQUEST_METHOD: `GET` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:18:37.419638 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b0a601-d6c5-43bd-badd-1bf77c7431da None admin] SCRIPT_NAME: `/identity` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:18:37.419920 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b0a601-d6c5-43bd-badd-1bf77c7431da None admin] PATH_INFO: `/v3/roles` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:18:37.420702 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99b0a601-d6c5-43bd-badd-1bf77c7431da None admin] RBAC: Adding query filter params (name=reader) {{(pid=479851) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 09:18:37.421016 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99b0a601-d6c5-43bd-badd-1bf77c7431da None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:18:37.422526 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99b0a601-d6c5-43bd-badd-1bf77c7431da None admin] RBAC: Authorization granted {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:18:37.434862 dv-cinder-851351-1-smb devstack@keystone.service[479851]: [pid: 479851|app: 0|req: 148/305] 10.222.0.42 () {56 vars in 1101 bytes} [Thu Jul 28 09:18:37 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:18:37.435727 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b0a601-d6c5-43bd-badd-1bf77c7431da None admin] Authenticating user token {{(pid=479851) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:18:37.462035 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG dbcounter [-] [479852] Writing DB stats keystone:SELECT=100 {{(pid=479852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:18:37.488878 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f8841b4-e2a5-4792-8759-d85ffdfa372a None None] Validating token access rules against request {{(pid=479852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:18:37.492688 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG dbcounter [-] [479851] Writing DB stats keystone:SELECT=100 {{(pid=479851) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:18:37.526224 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-230497a2-8e47-4582-9b35-31179bf773ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:18:37.526856 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230497a2-8e47-4582-9b35-31179bf773ed None admin] REQUEST_METHOD: `GET` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:18:37.527823 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230497a2-8e47-4582-9b35-31179bf773ed None admin] SCRIPT_NAME: `/identity` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:18:37.527823 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230497a2-8e47-4582-9b35-31179bf773ed None admin] PATH_INFO: `/v3/domains/default` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:18:37.529142 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-230497a2-8e47-4582-9b35-31179bf773ed None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:18:37.530228 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-230497a2-8e47-4582-9b35-31179bf773ed None admin] RBAC: Authorization granted {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:18:37.531861 dv-cinder-851351-1-smb devstack@keystone.service[479852]: [pid: 479852|app: 0|req: 158/306] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 09:18:37 2022] GET /identity/v3/domains/default => generated 199 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:18:37.533047 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9894ba3-9bd6-45fb-bd73-bf0098361dd0 None None] REQUEST_METHOD: `POST` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:18:37.533331 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9894ba3-9bd6-45fb-bd73-bf0098361dd0 None None] SCRIPT_NAME: `/identity` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:18:37.533602 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9894ba3-9bd6-45fb-bd73-bf0098361dd0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:18:37.551673 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.auth.core [None req-c9894ba3-9bd6-45fb-bd73-bf0098361dd0 None None] MFA Rules not processed for user `c198f91a4ae84d2b9cc730a6e304c2be`. Rule list: `[]` (Enabled: `True`). {{(pid=479852) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 09:18:37.552975 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.fernet_utils [None req-c9894ba3-9bd6-45fb-bd73-bf0098361dd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=479852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 09:18:37.554126 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b0a601-d6c5-43bd-badd-1bf77c7431da None admin] Validating token access rules against request {{(pid=479851) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:18:37.594423 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dcd7ac7-6fcc-4979-97c7-7dcf4225a372 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479851) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:18:37.595153 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dcd7ac7-6fcc-4979-97c7-7dcf4225a372 None admin] REQUEST_METHOD: `GET` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:18:37.595439 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dcd7ac7-6fcc-4979-97c7-7dcf4225a372 None admin] SCRIPT_NAME: `/identity` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:18:37.595722 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dcd7ac7-6fcc-4979-97c7-7dcf4225a372 None admin] PATH_INFO: `/v3/users/9ea021e6186744809ddd8a0f70c5a03f` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:18:37.610664 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dcd7ac7-6fcc-4979-97c7-7dcf4225a372 None admin] RBAC: Authorizing `identity:get_user(user_id=9ea021e6186744809ddd8a0f70c5a03f)` {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:18:37.612082 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dcd7ac7-6fcc-4979-97c7-7dcf4225a372 None admin] RBAC: Authorization granted {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:18:37.613847 dv-cinder-851351-1-smb devstack@keystone.service[479851]: [pid: 479851|app: 0|req: 149/307] 10.222.0.42 () {56 vars in 1177 bytes} [Thu Jul 28 09:18:37 2022] GET /identity/v3/users/9ea021e6186744809ddd8a0f70c5a03f => generated 293 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:18:37.614629 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dcd7ac7-6fcc-4979-97c7-7dcf4225a372 None admin] Authenticating user token {{(pid=479851) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:18:37.625449 dv-cinder-851351-1-smb devstack@keystone.service[479852]: [pid: 479852|app: 0|req: 159/308] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 09:18:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 09:18:37.636891 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9894ba3-9bd6-45fb-bd73-bf0098361dd0 None None] Authenticating user token {{(pid=479852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:18:37.710775 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG dbcounter [-] [479852] Writing DB stats keystone:SELECT=100 {{(pid=479852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:18:37.729278 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dcd7ac7-6fcc-4979-97c7-7dcf4225a372 None admin] Validating token access rules against request {{(pid=479851) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:18:37.737002 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG dbcounter [-] [479851] Writing DB stats keystone:SELECT=100 {{(pid=479851) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:18:37.737689 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9894ba3-9bd6-45fb-bd73-bf0098361dd0 None None] Validating token access rules against request {{(pid=479852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:18:37.767754 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f5bc89-c875-451f-b93c-e2ce1618a9f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479851) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:18:37.768449 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f5bc89-c875-451f-b93c-e2ce1618a9f8 None admin] REQUEST_METHOD: `GET` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:18:37.768760 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f5bc89-c875-451f-b93c-e2ce1618a9f8 None admin] SCRIPT_NAME: `/identity` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:18:37.769041 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f5bc89-c875-451f-b93c-e2ce1618a9f8 None admin] PATH_INFO: `/v3/users/ed4bb27e9d6941bdb7e78c6d8cca0946` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:18:37.770363 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05f5bc89-c875-451f-b93c-e2ce1618a9f8 None admin] RBAC: Authorizing `identity:get_user(user_id=ed4bb27e9d6941bdb7e78c6d8cca0946)` {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:18:37.771884 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05f5bc89-c875-451f-b93c-e2ce1618a9f8 None admin] RBAC: Authorization granted {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:18:37.778575 dv-cinder-851351-1-smb devstack@keystone.service[479851]: [pid: 479851|app: 0|req: 150/309] 10.222.0.42 () {56 vars in 1177 bytes} [Thu Jul 28 09:18:37 2022] GET /identity/v3/users/ed4bb27e9d6941bdb7e78c6d8cca0946 => generated 297 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:18:37.778575 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f5bc89-c875-451f-b93c-e2ce1618a9f8 None admin] Authenticating user token {{(pid=479851) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:18:37.778852 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c8d418-450a-4f1a-b9d9-cfb85b518f7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:18:37.779202 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c8d418-450a-4f1a-b9d9-cfb85b518f7e None admin] REQUEST_METHOD: `POST` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:18:37.779477 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c8d418-450a-4f1a-b9d9-cfb85b518f7e None admin] SCRIPT_NAME: `/identity` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:18:37.779750 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c8d418-450a-4f1a-b9d9-cfb85b518f7e None admin] PATH_INFO: `/v3/groups` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:18:37.780432 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99c8d418-450a-4f1a-b9d9-cfb85b518f7e None admin] RBAC: Authorizing `identity:create_group()` {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:18:37.781915 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99c8d418-450a-4f1a-b9d9-cfb85b518f7e None admin] RBAC: Authorization granted {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:18:37.803749 dv-cinder-851351-1-smb devstack@keystone.service[479852]: [pid: 479852|app: 0|req: 160/310] 10.222.0.42 () {60 vars in 1134 bytes} [Thu Jul 28 09:18:37 2022] POST /identity/v3/groups => generated 229 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 09:18:37.804604 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c8d418-450a-4f1a-b9d9-cfb85b518f7e None admin] Authenticating user token {{(pid=479852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:18:37.921638 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f5bc89-c875-451f-b93c-e2ce1618a9f8 None admin] Validating token access rules against request {{(pid=479851) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:18:37.949021 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c8d418-450a-4f1a-b9d9-cfb85b518f7e None admin] Validating token access rules against request {{(pid=479852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:18:37.966979 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52061914-8456-465b-80b4-d0dd5d483681 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479851) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:18:37.967633 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52061914-8456-465b-80b4-d0dd5d483681 None admin] REQUEST_METHOD: `GET` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:18:37.969003 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52061914-8456-465b-80b4-d0dd5d483681 None admin] SCRIPT_NAME: `/identity` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:18:37.969376 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52061914-8456-465b-80b4-d0dd5d483681 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:18:37.970216 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52061914-8456-465b-80b4-d0dd5d483681 None admin] RBAC: Adding query filter params (role.id=73525379110b4a99850473e0e9f217f1, user.id=9ea021e6186744809ddd8a0f70c5a03f, scope.system=all) {{(pid=479851) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 09:18:37.970931 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52061914-8456-465b-80b4-d0dd5d483681 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:18:37.972335 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52061914-8456-465b-80b4-d0dd5d483681 None admin] RBAC: Authorization granted {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:18:37.980121 dv-cinder-851351-1-smb devstack@keystone.service[479851]: [pid: 479851|app: 0|req: 151/311] 10.222.0.42 () {56 vars in 1308 bytes} [Thu Jul 28 09:18:37 2022] GET /identity/v3/role_assignments?user.id=9ea021e6186744809ddd8a0f70c5a03f&scope.system=all&role.id=73525379110b4a99850473e0e9f217f1 => generated 226 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:18:37.980121 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52061914-8456-465b-80b4-d0dd5d483681 None admin] Authenticating user token {{(pid=479851) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:18:38.000423 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00185de9-9167-473a-b186-8f757e2bdc1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:18:38.001634 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00185de9-9167-473a-b186-8f757e2bdc1f None admin] REQUEST_METHOD: `GET` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:18:38.002197 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00185de9-9167-473a-b186-8f757e2bdc1f None admin] SCRIPT_NAME: `/identity` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:18:38.002724 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00185de9-9167-473a-b186-8f757e2bdc1f None admin] PATH_INFO: `/v3/roles/member` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:18:38.007646 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG dbcounter [-] [479852] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=479852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:18:38.022008 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00185de9-9167-473a-b186-8f757e2bdc1f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 09:18:38.028282 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application [None req-00185de9-9167-473a-b186-8f757e2bdc1f None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 28 09:18:38.028282 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 09:18:38.028282 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 09:18:38.028282 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 09:18:38.028282 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 09:18:38.028282 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 09:18:38.028282 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 09:18:38.028282 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 09:18:38.028282 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 09:18:38.028282 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 09:18:38.028282 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 09:18:38.028282 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 09:18:38.028282 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 09:18:38.028282 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 09:18:38.028282 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 09:18:38.028282 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 09:18:38.029661 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 09:18:38.029661 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 09:18:38.029661 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 09:18:38.029661 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 09:18:38.029661 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 09:18:38.029661 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 09:18:38.029661 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 09:18:38.029661 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 09:18:38.029661 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 09:18:38.029661 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 09:18:38.029661 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 09:18:38.029661 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application with Lock( Jul 28 09:18:38.029661 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 09:18:38.029661 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self._enter() Jul 28 09:18:38.029661 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 09:18:38.029661 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 09:18:38.030728 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 09:18:38.030728 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self.creator() Jul 28 09:18:38.030728 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 09:18:38.030728 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application created_value = creator( Jul 28 09:18:38.030728 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 09:18:38.030728 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 09:18:38.030728 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 09:18:38.030728 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 09:18:38.030728 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 09:18:38.030728 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 09:18:38.030728 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 28 09:18:38.030728 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application Jul 28 09:18:38.030728 dv-cinder-851351-1-smb devstack@keystone.service[479852]: [pid: 479852|app: 0|req: 161/312] 10.222.0.42 () {56 vars in 1099 bytes} [Thu Jul 28 09:18:37 2022] GET /identity/v3/roles/member => generated 84 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 09:18:38.037137 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00185de9-9167-473a-b186-8f757e2bdc1f None admin] Authenticating user token {{(pid=479852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:18:38.051722 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG dbcounter [-] [479851] Writing DB stats keystone:SELECT=100 {{(pid=479851) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:18:38.138939 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52061914-8456-465b-80b4-d0dd5d483681 None admin] Validating token access rules against request {{(pid=479851) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:18:38.184557 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd8099df-fd09-4911-a294-14d978685884 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479851) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:18:38.185270 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8099df-fd09-4911-a294-14d978685884 None admin] REQUEST_METHOD: `GET` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:18:38.185565 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8099df-fd09-4911-a294-14d978685884 None admin] SCRIPT_NAME: `/identity` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:18:38.185845 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8099df-fd09-4911-a294-14d978685884 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:18:38.197204 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00185de9-9167-473a-b186-8f757e2bdc1f None admin] Validating token access rules against request {{(pid=479852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:18:38.246917 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d34cbf-7eba-42e8-b1f2-faefc4650345 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:18:38.248461 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d34cbf-7eba-42e8-b1f2-faefc4650345 None admin] REQUEST_METHOD: `GET` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:18:38.248930 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d34cbf-7eba-42e8-b1f2-faefc4650345 None admin] SCRIPT_NAME: `/identity` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:18:38.249358 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d34cbf-7eba-42e8-b1f2-faefc4650345 None admin] PATH_INFO: `/v3/roles` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:18:38.251002 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43d34cbf-7eba-42e8-b1f2-faefc4650345 None admin] RBAC: Adding query filter params (name=member) {{(pid=479852) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 09:18:38.251485 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43d34cbf-7eba-42e8-b1f2-faefc4650345 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:18:38.253528 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43d34cbf-7eba-42e8-b1f2-faefc4650345 None admin] RBAC: Authorization granted {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:18:38.264593 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd8099df-fd09-4911-a294-14d978685884 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:18:38.265552 dv-cinder-851351-1-smb devstack@keystone.service[479852]: [pid: 479852|app: 0|req: 162/313] 10.222.0.42 () {56 vars in 1101 bytes} [Thu Jul 28 09:18:38 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:18:38.270785 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd8099df-fd09-4911-a294-14d978685884 None admin] RBAC: Authorization granted {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:18:38.272273 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d34cbf-7eba-42e8-b1f2-faefc4650345 None admin] Authenticating user token {{(pid=479852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:18:38.318135 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG dbcounter [-] [479851] Writing DB stats keystone:SELECT=100 {{(pid=479851) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:18:38.361606 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG dbcounter [-] [479852] Writing DB stats keystone:SELECT=100 {{(pid=479852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:18:38.405304 dv-cinder-851351-1-smb devstack@keystone.service[479851]: [pid: 479851|app: 0|req: 152/314] 10.222.0.42 () {58 vars in 1282 bytes} [Thu Jul 28 09:18:37 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 426 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 28 09:18:38.411754 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd8099df-fd09-4911-a294-14d978685884 None admin] Authenticating user token {{(pid=479851) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:18:38.427625 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d34cbf-7eba-42e8-b1f2-faefc4650345 None admin] Validating token access rules against request {{(pid=479852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:18:38.473638 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f779400-0695-4900-b497-1782cefd6ae2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:18:38.475081 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f779400-0695-4900-b497-1782cefd6ae2 None admin] REQUEST_METHOD: `GET` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:18:38.475776 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f779400-0695-4900-b497-1782cefd6ae2 None admin] SCRIPT_NAME: `/identity` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:18:38.476244 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f779400-0695-4900-b497-1782cefd6ae2 None admin] PATH_INFO: `/v3/users/40042f730d784b379661387e73fe401c` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:18:38.477934 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f779400-0695-4900-b497-1782cefd6ae2 None admin] RBAC: Authorizing `identity:get_user(user_id=40042f730d784b379661387e73fe401c)` {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:18:38.480030 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f779400-0695-4900-b497-1782cefd6ae2 None admin] RBAC: Authorization granted {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:18:38.487179 dv-cinder-851351-1-smb devstack@keystone.service[479852]: [pid: 479852|app: 0|req: 163/315] 10.222.0.42 () {56 vars in 1177 bytes} [Thu Jul 28 09:18:38 2022] GET /identity/v3/users/40042f730d784b379661387e73fe401c => generated 293 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:18:38.488082 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f779400-0695-4900-b497-1782cefd6ae2 None admin] Authenticating user token {{(pid=479852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:18:38.544364 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd8099df-fd09-4911-a294-14d978685884 None admin] Validating token access rules against request {{(pid=479851) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:18:38.586045 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99310261-0822-4718-b909-9e4ea0a592c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479851) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:18:38.586723 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99310261-0822-4718-b909-9e4ea0a592c5 None admin] REQUEST_METHOD: `GET` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:18:38.587010 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99310261-0822-4718-b909-9e4ea0a592c5 None admin] SCRIPT_NAME: `/identity` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:18:38.587290 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99310261-0822-4718-b909-9e4ea0a592c5 None admin] PATH_INFO: `/v3/projects/ef022c0e613d4a2bac6fe1e0e339b92c` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:18:38.588562 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99310261-0822-4718-b909-9e4ea0a592c5 None admin] RBAC: Authorizing `identity:get_project(project_id=ef022c0e613d4a2bac6fe1e0e339b92c)` {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:18:38.590097 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99310261-0822-4718-b909-9e4ea0a592c5 None admin] RBAC: Authorization granted {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:18:38.597311 dv-cinder-851351-1-smb devstack@keystone.service[479851]: [pid: 479851|app: 0|req: 153/316] 10.222.0.42 () {56 vars in 1186 bytes} [Thu Jul 28 09:18:38 2022] GET /identity/v3/projects/ef022c0e613d4a2bac6fe1e0e339b92c => generated 302 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:18:38.598294 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99310261-0822-4718-b909-9e4ea0a592c5 None admin] Authenticating user token {{(pid=479851) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:18:38.608283 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG dbcounter [-] [479851] Writing DB stats keystone:SELECT=100 {{(pid=479851) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:18:38.636356 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f779400-0695-4900-b497-1782cefd6ae2 None admin] Validating token access rules against request {{(pid=479852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:18:38.666052 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG dbcounter [-] [479852] Writing DB stats keystone:SELECT=100 {{(pid=479852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:18:38.675687 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf92a22-6599-4833-b304-b33d5df528e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:18:38.676934 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf92a22-6599-4833-b304-b33d5df528e3 None admin] REQUEST_METHOD: `PUT` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:18:38.677511 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf92a22-6599-4833-b304-b33d5df528e3 None admin] SCRIPT_NAME: `/identity` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:18:38.677861 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf92a22-6599-4833-b304-b33d5df528e3 None admin] PATH_INFO: `/v3/system/users/40042f730d784b379661387e73fe401c/roles/900fb424e172461d93a0db59afb0a12b` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:18:38.679948 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daf92a22-6599-4833-b304-b33d5df528e3 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=40042f730d784b379661387e73fe401c, role_id=900fb424e172461d93a0db59afb0a12b)` {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:18:38.681474 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daf92a22-6599-4833-b304-b33d5df528e3 None admin] RBAC: Authorization granted {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:18:38.700703 dv-cinder-851351-1-smb devstack@keystone.service[479852]: [pid: 479852|app: 0|req: 164/317] 10.222.0.42 () {58 vars in 1334 bytes} [Thu Jul 28 09:18:38 2022] PUT /identity/v3/system/users/40042f730d784b379661387e73fe401c/roles/900fb424e172461d93a0db59afb0a12b => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 09:18:38.755287 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99310261-0822-4718-b909-9e4ea0a592c5 None admin] Validating token access rules against request {{(pid=479851) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:18:38.803382 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b1b9e5-0428-4e4b-b0cb-2b6fc0fec510 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479851) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:18:38.803949 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b1b9e5-0428-4e4b-b0cb-2b6fc0fec510 None admin] REQUEST_METHOD: `GET` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:18:38.804262 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b1b9e5-0428-4e4b-b0cb-2b6fc0fec510 None admin] SCRIPT_NAME: `/identity` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:18:38.804604 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b1b9e5-0428-4e4b-b0cb-2b6fc0fec510 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:18:38.805511 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b1b9e5-0428-4e4b-b0cb-2b6fc0fec510 None admin] RBAC: Adding query filter params (role.id=73525379110b4a99850473e0e9f217f1, scope.project.id=ef022c0e613d4a2bac6fe1e0e339b92c, user.id=ed4bb27e9d6941bdb7e78c6d8cca0946) {{(pid=479851) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 09:18:38.805830 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b1b9e5-0428-4e4b-b0cb-2b6fc0fec510 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:18:38.807365 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b1b9e5-0428-4e4b-b0cb-2b6fc0fec510 None admin] RBAC: Authorization granted {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:18:38.814953 dv-cinder-851351-1-smb devstack@keystone.service[479851]: [pid: 479851|app: 0|req: 154/318] 10.222.0.42 () {56 vars in 1374 bytes} [Thu Jul 28 09:18:38 2022] GET /identity/v3/role_assignments?user.id=ed4bb27e9d6941bdb7e78c6d8cca0946&scope.project.id=ef022c0e613d4a2bac6fe1e0e339b92c&role.id=73525379110b4a99850473e0e9f217f1 => generated 608 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:18:39.941093 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00232f3-94c8-4212-82c6-76e652ee6f5b None None] REQUEST_METHOD: `GET` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:18:39.941679 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00232f3-94c8-4212-82c6-76e652ee6f5b None None] SCRIPT_NAME: `/identity` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:18:39.941679 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00232f3-94c8-4212-82c6-76e652ee6f5b None None] PATH_INFO: `/` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:18:39.942992 dv-cinder-851351-1-smb devstack@keystone.service[479852]: [pid: 479852|app: 0|req: 165/319] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 09:18:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 09:18:39.949342 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67304075-11bd-49c0-aab4-caca7b9a0cd6 None None] REQUEST_METHOD: `POST` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:18:39.949867 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67304075-11bd-49c0-aab4-caca7b9a0cd6 None None] SCRIPT_NAME: `/identity` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:18:39.949867 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67304075-11bd-49c0-aab4-caca7b9a0cd6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:18:39.969535 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.auth.core [None req-67304075-11bd-49c0-aab4-caca7b9a0cd6 None None] MFA Rules not processed for user `c198f91a4ae84d2b9cc730a6e304c2be`. Rule list: `[]` (Enabled: `True`). {{(pid=479851) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 09:18:39.970802 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.fernet_utils [None req-67304075-11bd-49c0-aab4-caca7b9a0cd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=479851) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 09:18:40.045829 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG dbcounter [-] [479851] Writing DB stats keystone:SELECT=100 {{(pid=479851) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:18:40.057003 dv-cinder-851351-1-smb devstack@keystone.service[479851]: [pid: 479851|app: 0|req: 155/320] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 09:18:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 09:18:40.075548 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c00232f3-94c8-4212-82c6-76e652ee6f5b None None] Authenticating user token {{(pid=479852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:18:40.095083 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007bd493-4a6d-48dd-8f7b-51a7a9464adb None None] REQUEST_METHOD: `GET` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:18:40.095352 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007bd493-4a6d-48dd-8f7b-51a7a9464adb None None] SCRIPT_NAME: `/identity` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:18:40.095624 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007bd493-4a6d-48dd-8f7b-51a7a9464adb None None] PATH_INFO: `/` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:18:40.097063 dv-cinder-851351-1-smb devstack@keystone.service[479851]: [pid: 479851|app: 0|req: 156/321] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 09:18:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 28 09:18:40.102308 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227e4420-ebe5-4d95-aef2-b48e74c3fdac None None] REQUEST_METHOD: `POST` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:18:40.102619 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227e4420-ebe5-4d95-aef2-b48e74c3fdac None None] SCRIPT_NAME: `/identity` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:18:40.102896 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227e4420-ebe5-4d95-aef2-b48e74c3fdac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:18:40.121489 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.auth.core [None req-227e4420-ebe5-4d95-aef2-b48e74c3fdac None None] MFA Rules not processed for user `c198f91a4ae84d2b9cc730a6e304c2be`. Rule list: `[]` (Enabled: `True`). {{(pid=479851) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 09:18:40.122727 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.fernet_utils [None req-227e4420-ebe5-4d95-aef2-b48e74c3fdac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=479851) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 09:18:40.201869 dv-cinder-851351-1-smb devstack@keystone.service[479851]: [pid: 479851|app: 0|req: 157/322] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 09:18:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 28 09:18:40.216013 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c00232f3-94c8-4212-82c6-76e652ee6f5b None None] Validating token access rules against request {{(pid=479852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:18:40.224384 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227e4420-ebe5-4d95-aef2-b48e74c3fdac None None] Authenticating user token {{(pid=479851) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:18:40.256693 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e4e906-bdb8-4df8-bb45-46332e65d298 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:18:40.257407 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e4e906-bdb8-4df8-bb45-46332e65d298 None admin] REQUEST_METHOD: `GET` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:18:40.257685 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e4e906-bdb8-4df8-bb45-46332e65d298 None admin] SCRIPT_NAME: `/identity` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:18:40.258174 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e4e906-bdb8-4df8-bb45-46332e65d298 None admin] PATH_INFO: `/v3/domains/default` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:18:40.259405 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7e4e906-bdb8-4df8-bb45-46332e65d298 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:18:40.260907 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7e4e906-bdb8-4df8-bb45-46332e65d298 None admin] RBAC: Authorization granted {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:18:40.267651 dv-cinder-851351-1-smb devstack@keystone.service[479852]: [pid: 479852|app: 0|req: 166/323] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 09:18:40 2022] GET /identity/v3/domains/default => generated 199 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:18:40.268738 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e4e906-bdb8-4df8-bb45-46332e65d298 None admin] Authenticating user token {{(pid=479852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:18:40.346459 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG dbcounter [-] [479852] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=479852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:18:40.347114 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227e4420-ebe5-4d95-aef2-b48e74c3fdac None None] Validating token access rules against request {{(pid=479851) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:18:40.390130 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG dbcounter [-] [479851] Writing DB stats keystone:SELECT=100 {{(pid=479851) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:18:40.401371 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e4e906-bdb8-4df8-bb45-46332e65d298 None admin] Validating token access rules against request {{(pid=479852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:18:40.404313 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b2b449-594f-476a-a7b7-ba003c35e029 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479851) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:18:40.405053 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b2b449-594f-476a-a7b7-ba003c35e029 None admin] REQUEST_METHOD: `GET` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:18:40.405349 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b2b449-594f-476a-a7b7-ba003c35e029 None admin] SCRIPT_NAME: `/identity` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:18:40.405619 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b2b449-594f-476a-a7b7-ba003c35e029 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:18:40.419041 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82b2b449-594f-476a-a7b7-ba003c35e029 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 09:18:40.424083 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application [None req-82b2b449-594f-476a-a7b7-ba003c35e029 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 28 09:18:40.424083 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 09:18:40.424083 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 09:18:40.424083 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 09:18:40.424083 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 09:18:40.424083 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 09:18:40.424083 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 09:18:40.424083 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 09:18:40.424083 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 09:18:40.424083 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 09:18:40.424083 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 09:18:40.424083 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 09:18:40.424083 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 09:18:40.424083 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 09:18:40.424083 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 09:18:40.424083 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 09:18:40.425208 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 09:18:40.425208 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 09:18:40.425208 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 09:18:40.425208 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 09:18:40.425208 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 09:18:40.425208 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 09:18:40.425208 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 09:18:40.425208 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 09:18:40.425208 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 09:18:40.425208 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 09:18:40.425208 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 09:18:40.425208 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application with Lock( Jul 28 09:18:40.425208 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 09:18:40.425208 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return self._enter() Jul 28 09:18:40.425208 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 09:18:40.425208 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 09:18:40.430020 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 09:18:40.430020 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return self.creator() Jul 28 09:18:40.430020 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 09:18:40.430020 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application created_value = creator( Jul 28 09:18:40.430020 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 09:18:40.430020 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 09:18:40.430020 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 09:18:40.430020 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 09:18:40.430020 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 09:18:40.430020 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 09:18:40.430020 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 28 09:18:40.430020 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application Jul 28 09:18:40.430020 dv-cinder-851351-1-smb devstack@keystone.service[479851]: [pid: 479851|app: 0|req: 158/324] 10.222.0.42 () {56 vars in 1099 bytes} [Thu Jul 28 09:18:40 2022] GET /identity/v3/roles/reader => generated 84 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 09:18:40.431534 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b2b449-594f-476a-a7b7-ba003c35e029 None admin] Authenticating user token {{(pid=479851) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:18:40.450147 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1309aa-9223-434c-b6b7-2f41c24effa1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:18:40.451074 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1309aa-9223-434c-b6b7-2f41c24effa1 None admin] REQUEST_METHOD: `POST` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:18:40.451361 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1309aa-9223-434c-b6b7-2f41c24effa1 None admin] SCRIPT_NAME: `/identity` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:18:40.451643 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1309aa-9223-434c-b6b7-2f41c24effa1 None admin] PATH_INFO: `/v3/groups` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:18:40.452641 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae1309aa-9223-434c-b6b7-2f41c24effa1 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:18:40.454551 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae1309aa-9223-434c-b6b7-2f41c24effa1 None admin] RBAC: Authorization granted {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:18:40.477448 dv-cinder-851351-1-smb devstack@keystone.service[479852]: [pid: 479852|app: 0|req: 167/325] 10.222.0.42 () {60 vars in 1134 bytes} [Thu Jul 28 09:18:40 2022] POST /identity/v3/groups => generated 226 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 09:18:40.572606 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b2b449-594f-476a-a7b7-ba003c35e029 None admin] Validating token access rules against request {{(pid=479851) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:18:40.611485 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea21d5ad-cd9f-409c-b878-4090c7023c09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479851) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:18:40.612149 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea21d5ad-cd9f-409c-b878-4090c7023c09 None admin] REQUEST_METHOD: `GET` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:18:40.612437 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea21d5ad-cd9f-409c-b878-4090c7023c09 None admin] SCRIPT_NAME: `/identity` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:18:40.612752 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea21d5ad-cd9f-409c-b878-4090c7023c09 None admin] PATH_INFO: `/v3/roles` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:18:40.613521 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea21d5ad-cd9f-409c-b878-4090c7023c09 None admin] RBAC: Adding query filter params (name=reader) {{(pid=479851) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 09:18:40.613844 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea21d5ad-cd9f-409c-b878-4090c7023c09 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:18:40.615344 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea21d5ad-cd9f-409c-b878-4090c7023c09 None admin] RBAC: Authorization granted {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:18:40.625938 dv-cinder-851351-1-smb devstack@keystone.service[479851]: [pid: 479851|app: 0|req: 159/326] 10.222.0.42 () {56 vars in 1101 bytes} [Thu Jul 28 09:18:40 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 09:18:40.632025 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1309aa-9223-434c-b6b7-2f41c24effa1 None admin] Authenticating user token {{(pid=479852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:18:40.758213 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1309aa-9223-434c-b6b7-2f41c24effa1 None admin] Validating token access rules against request {{(pid=479852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:18:40.769698 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455dab85-b9df-4a25-a59a-01c7bb781946 None None] REQUEST_METHOD: `GET` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:18:40.770300 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455dab85-b9df-4a25-a59a-01c7bb781946 None None] SCRIPT_NAME: `/identity` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:18:40.770640 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455dab85-b9df-4a25-a59a-01c7bb781946 None None] PATH_INFO: `/` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:18:40.772968 dv-cinder-851351-1-smb devstack@keystone.service[479851]: [pid: 479851|app: 0|req: 160/327] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 09:18:40 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 09:18:40.779331 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c53298-d069-4cde-9f3c-32444f43c109 None None] REQUEST_METHOD: `POST` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:18:40.779663 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c53298-d069-4cde-9f3c-32444f43c109 None None] SCRIPT_NAME: `/identity` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:18:40.779910 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c53298-d069-4cde-9f3c-32444f43c109 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:18:40.782025 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG dbcounter [-] [479852] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=479852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:18:40.806160 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.auth.core [None req-85c53298-d069-4cde-9f3c-32444f43c109 None None] MFA Rules not processed for user `c198f91a4ae84d2b9cc730a6e304c2be`. Rule list: `[]` (Enabled: `True`). {{(pid=479851) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 09:18:40.807449 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.fernet_utils [None req-85c53298-d069-4cde-9f3c-32444f43c109 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=479851) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 09:18:40.807623 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6111fd-a8c6-4769-976d-6870da95eb3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:18:40.808182 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6111fd-a8c6-4769-976d-6870da95eb3c None admin] REQUEST_METHOD: `GET` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:18:40.808425 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6111fd-a8c6-4769-976d-6870da95eb3c None admin] SCRIPT_NAME: `/identity` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:18:40.808751 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6111fd-a8c6-4769-976d-6870da95eb3c None admin] PATH_INFO: `/v3/users/9ea021e6186744809ddd8a0f70c5a03f` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:18:40.809957 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f6111fd-a8c6-4769-976d-6870da95eb3c None admin] RBAC: Authorizing `identity:get_user(user_id=9ea021e6186744809ddd8a0f70c5a03f)` {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:18:40.811405 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f6111fd-a8c6-4769-976d-6870da95eb3c None admin] RBAC: Authorization granted {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:18:40.817623 dv-cinder-851351-1-smb devstack@keystone.service[479852]: [pid: 479852|app: 0|req: 168/328] 10.222.0.42 () {56 vars in 1177 bytes} [Thu Jul 28 09:18:40 2022] GET /identity/v3/users/9ea021e6186744809ddd8a0f70c5a03f => generated 293 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:18:40.822861 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6111fd-a8c6-4769-976d-6870da95eb3c None admin] Authenticating user token {{(pid=479852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:18:40.873138 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG dbcounter [-] [479851] Writing DB stats keystone:SELECT=100 {{(pid=479851) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:18:40.905634 dv-cinder-851351-1-smb devstack@keystone.service[479851]: [pid: 479851|app: 0|req: 161/329] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 09:18:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 09:18:40.928591 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c53298-d069-4cde-9f3c-32444f43c109 None None] Authenticating user token {{(pid=479851) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:18:40.973292 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6111fd-a8c6-4769-976d-6870da95eb3c None admin] Validating token access rules against request {{(pid=479852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:18:41.015047 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee775d49-9c46-4f09-8f8d-cd8288b3586e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:18:41.015666 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee775d49-9c46-4f09-8f8d-cd8288b3586e None admin] REQUEST_METHOD: `PUT` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:18:41.015955 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee775d49-9c46-4f09-8f8d-cd8288b3586e None admin] SCRIPT_NAME: `/identity` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:18:41.016269 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee775d49-9c46-4f09-8f8d-cd8288b3586e None admin] PATH_INFO: `/v3/system/users/9ea021e6186744809ddd8a0f70c5a03f/roles/73525379110b4a99850473e0e9f217f1` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:18:41.017910 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee775d49-9c46-4f09-8f8d-cd8288b3586e None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=9ea021e6186744809ddd8a0f70c5a03f, role_id=73525379110b4a99850473e0e9f217f1)` {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:18:41.019329 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee775d49-9c46-4f09-8f8d-cd8288b3586e None admin] RBAC: Authorization granted {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:18:41.036858 dv-cinder-851351-1-smb devstack@keystone.service[479852]: [pid: 479852|app: 0|req: 169/330] 10.222.0.42 () {58 vars in 1334 bytes} [Thu Jul 28 09:18:40 2022] PUT /identity/v3/system/users/9ea021e6186744809ddd8a0f70c5a03f/roles/73525379110b4a99850473e0e9f217f1 => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 28 09:18:41.074152 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c53298-d069-4cde-9f3c-32444f43c109 None None] Validating token access rules against request {{(pid=479851) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:18:41.123265 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c47241-9b47-4a4b-a0ee-29abf34144fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479851) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:18:41.123968 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c47241-9b47-4a4b-a0ee-29abf34144fb None admin] REQUEST_METHOD: `GET` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:18:41.124256 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c47241-9b47-4a4b-a0ee-29abf34144fb None admin] SCRIPT_NAME: `/identity` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:18:41.124537 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c47241-9b47-4a4b-a0ee-29abf34144fb None admin] PATH_INFO: `/v3/roles/member` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:18:41.139133 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53c47241-9b47-4a4b-a0ee-29abf34144fb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 09:18:41.144489 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application [None req-53c47241-9b47-4a4b-a0ee-29abf34144fb None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 28 09:18:41.144489 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 09:18:41.144489 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 09:18:41.144489 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 09:18:41.144489 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 09:18:41.144489 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 09:18:41.144489 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 09:18:41.144489 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 09:18:41.144489 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 09:18:41.144489 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 09:18:41.144489 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 09:18:41.144489 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 09:18:41.144489 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 09:18:41.144489 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 09:18:41.144489 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 09:18:41.144489 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 09:18:41.146848 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 09:18:41.146848 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 09:18:41.146848 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 09:18:41.146848 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 09:18:41.146848 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 09:18:41.146848 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 09:18:41.146848 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 09:18:41.146848 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 09:18:41.146848 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 09:18:41.146848 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 09:18:41.146848 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 09:18:41.146848 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application with Lock( Jul 28 09:18:41.146848 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 09:18:41.146848 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return self._enter() Jul 28 09:18:41.146848 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 09:18:41.146848 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 09:18:41.149047 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 09:18:41.149047 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return self.creator() Jul 28 09:18:41.149047 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 09:18:41.149047 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application created_value = creator( Jul 28 09:18:41.149047 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 09:18:41.149047 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 09:18:41.149047 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 09:18:41.149047 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 09:18:41.149047 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 09:18:41.149047 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 09:18:41.149047 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 28 09:18:41.149047 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application Jul 28 09:18:41.149047 dv-cinder-851351-1-smb devstack@keystone.service[479851]: [pid: 479851|app: 0|req: 162/331] 10.222.0.42 () {56 vars in 1099 bytes} [Thu Jul 28 09:18:40 2022] GET /identity/v3/roles/member => generated 84 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 09:18:41.156694 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee775d49-9c46-4f09-8f8d-cd8288b3586e None admin] Authenticating user token {{(pid=479852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:18:41.245008 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG dbcounter [-] [479852] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=479852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:18:41.305457 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee775d49-9c46-4f09-8f8d-cd8288b3586e None admin] Validating token access rules against request {{(pid=479852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:18:41.350162 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68461131-e5a1-4f20-ac63-cd3c62b578c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:18:41.350866 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68461131-e5a1-4f20-ac63-cd3c62b578c7 None admin] REQUEST_METHOD: `GET` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:18:41.351153 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68461131-e5a1-4f20-ac63-cd3c62b578c7 None admin] SCRIPT_NAME: `/identity` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:18:41.351430 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68461131-e5a1-4f20-ac63-cd3c62b578c7 None admin] PATH_INFO: `/v3/roles` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:18:41.352269 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68461131-e5a1-4f20-ac63-cd3c62b578c7 None admin] RBAC: Adding query filter params (name=member) {{(pid=479852) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 09:18:41.352580 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68461131-e5a1-4f20-ac63-cd3c62b578c7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:18:41.354057 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68461131-e5a1-4f20-ac63-cd3c62b578c7 None admin] RBAC: Authorization granted {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:18:41.368210 dv-cinder-851351-1-smb devstack@keystone.service[479852]: [pid: 479852|app: 0|req: 170/332] 10.222.0.42 () {56 vars in 1101 bytes} [Thu Jul 28 09:18:41 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:18:41.376075 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c47241-9b47-4a4b-a0ee-29abf34144fb None admin] Authenticating user token {{(pid=479851) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:18:41.429398 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG dbcounter [-] [479851] Writing DB stats keystone:SELECT=100 {{(pid=479851) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:18:41.495081 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c47241-9b47-4a4b-a0ee-29abf34144fb None admin] Validating token access rules against request {{(pid=479851) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:18:41.533153 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea9f231d-f181-4e91-aafa-c31cb271acf0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479851) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:18:41.533933 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9f231d-f181-4e91-aafa-c31cb271acf0 None admin] REQUEST_METHOD: `GET` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:18:41.534225 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9f231d-f181-4e91-aafa-c31cb271acf0 None admin] SCRIPT_NAME: `/identity` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:18:41.534504 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9f231d-f181-4e91-aafa-c31cb271acf0 None admin] PATH_INFO: `/v3/users/40042f730d784b379661387e73fe401c` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:18:41.535754 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea9f231d-f181-4e91-aafa-c31cb271acf0 None admin] RBAC: Authorizing `identity:get_user(user_id=40042f730d784b379661387e73fe401c)` {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:18:41.537258 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea9f231d-f181-4e91-aafa-c31cb271acf0 None admin] RBAC: Authorization granted {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:18:41.539274 dv-cinder-851351-1-smb devstack@keystone.service[479851]: [pid: 479851|app: 0|req: 163/333] 10.222.0.42 () {56 vars in 1177 bytes} [Thu Jul 28 09:18:41 2022] GET /identity/v3/users/40042f730d784b379661387e73fe401c => generated 293 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:18:41.545176 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68461131-e5a1-4f20-ac63-cd3c62b578c7 None admin] Authenticating user token {{(pid=479852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:18:41.666173 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68461131-e5a1-4f20-ac63-cd3c62b578c7 None admin] Validating token access rules against request {{(pid=479852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:18:41.681692 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG dbcounter [-] [479852] Writing DB stats keystone:SELECT=100 {{(pid=479852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:18:41.707683 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dac254c-ccb8-416e-bdbf-9ec1dc5a6ce6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:18:41.708338 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dac254c-ccb8-416e-bdbf-9ec1dc5a6ce6 None admin] REQUEST_METHOD: `GET` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:18:41.708625 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dac254c-ccb8-416e-bdbf-9ec1dc5a6ce6 None admin] SCRIPT_NAME: `/identity` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:18:41.708938 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dac254c-ccb8-416e-bdbf-9ec1dc5a6ce6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:18:41.709802 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dac254c-ccb8-416e-bdbf-9ec1dc5a6ce6 None admin] RBAC: Adding query filter params (role.id=900fb424e172461d93a0db59afb0a12b, user.id=40042f730d784b379661387e73fe401c, scope.system=all) {{(pid=479852) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 09:18:41.710117 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dac254c-ccb8-416e-bdbf-9ec1dc5a6ce6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:18:41.711577 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dac254c-ccb8-416e-bdbf-9ec1dc5a6ce6 None admin] RBAC: Authorization granted {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:18:41.725617 dv-cinder-851351-1-smb devstack@keystone.service[479852]: [pid: 479852|app: 0|req: 171/334] 10.222.0.42 () {56 vars in 1308 bytes} [Thu Jul 28 09:18:41 2022] GET /identity/v3/role_assignments?user.id=40042f730d784b379661387e73fe401c&scope.system=all&role.id=900fb424e172461d93a0db59afb0a12b => generated 510 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:18:43.120874 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7fe956-e1c7-4509-9062-811467fe2e6d None None] REQUEST_METHOD: `GET` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:18:43.121690 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7fe956-e1c7-4509-9062-811467fe2e6d None None] SCRIPT_NAME: `/identity` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:18:43.121690 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7fe956-e1c7-4509-9062-811467fe2e6d None None] PATH_INFO: `/` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:18:43.123381 dv-cinder-851351-1-smb devstack@keystone.service[479851]: [pid: 479851|app: 0|req: 164/335] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 09:18:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 09:18:43.129163 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe22489-783c-4d04-a358-1b123550d283 None None] REQUEST_METHOD: `POST` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:18:43.130059 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe22489-783c-4d04-a358-1b123550d283 None None] SCRIPT_NAME: `/identity` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:18:43.130059 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe22489-783c-4d04-a358-1b123550d283 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:18:43.159604 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.auth.core [None req-bfe22489-783c-4d04-a358-1b123550d283 None None] MFA Rules not processed for user `c198f91a4ae84d2b9cc730a6e304c2be`. Rule list: `[]` (Enabled: `True`). {{(pid=479852) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 09:18:43.160845 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.fernet_utils [None req-bfe22489-783c-4d04-a358-1b123550d283 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=479852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 09:18:43.254864 dv-cinder-851351-1-smb devstack@keystone.service[479852]: [pid: 479852|app: 0|req: 172/336] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 09:18:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 28 09:18:43.302260 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7fe956-e1c7-4509-9062-811467fe2e6d None None] Authenticating user token {{(pid=479851) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:18:43.458435 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7fe956-e1c7-4509-9062-811467fe2e6d None None] Validating token access rules against request {{(pid=479851) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:18:43.471683 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG dbcounter [-] [479851] Writing DB stats keystone:SELECT=100 {{(pid=479851) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:18:43.508373 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f583419c-9e66-479f-b6f3-5eeea28c5016 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479851) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:18:43.509097 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f583419c-9e66-479f-b6f3-5eeea28c5016 None admin] REQUEST_METHOD: `GET` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:18:43.509385 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f583419c-9e66-479f-b6f3-5eeea28c5016 None admin] SCRIPT_NAME: `/identity` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:18:43.509664 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f583419c-9e66-479f-b6f3-5eeea28c5016 None admin] PATH_INFO: `/v3/roles/member` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:18:43.526985 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f583419c-9e66-479f-b6f3-5eeea28c5016 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 09:18:43.532200 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application [None req-f583419c-9e66-479f-b6f3-5eeea28c5016 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 28 09:18:43.532200 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 09:18:43.532200 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 09:18:43.532200 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 09:18:43.532200 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 09:18:43.532200 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 09:18:43.532200 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 09:18:43.532200 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 09:18:43.532200 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 09:18:43.532200 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 09:18:43.532200 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 09:18:43.532200 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 09:18:43.532200 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 09:18:43.532200 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 09:18:43.532200 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 09:18:43.532200 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 09:18:43.533477 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 09:18:43.533477 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 09:18:43.533477 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 09:18:43.533477 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 09:18:43.533477 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 09:18:43.533477 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 09:18:43.533477 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 09:18:43.533477 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 09:18:43.533477 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 09:18:43.533477 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 09:18:43.533477 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 09:18:43.533477 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application with Lock( Jul 28 09:18:43.533477 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 09:18:43.533477 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return self._enter() Jul 28 09:18:43.533477 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 09:18:43.533477 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 09:18:43.534502 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 09:18:43.534502 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return self.creator() Jul 28 09:18:43.534502 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 09:18:43.534502 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application created_value = creator( Jul 28 09:18:43.534502 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 09:18:43.534502 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 09:18:43.534502 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 09:18:43.534502 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 09:18:43.534502 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 09:18:43.534502 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 09:18:43.534502 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 28 09:18:43.534502 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application Jul 28 09:18:43.534502 dv-cinder-851351-1-smb devstack@keystone.service[479851]: [pid: 479851|app: 0|req: 165/337] 10.222.0.42 () {56 vars in 1099 bytes} [Thu Jul 28 09:18:43 2022] GET /identity/v3/roles/member => generated 84 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 09:18:43.540228 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe22489-783c-4d04-a358-1b123550d283 None None] Authenticating user token {{(pid=479852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:18:43.707491 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG dbcounter [-] [479852] Writing DB stats keystone:SELECT=100 {{(pid=479852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:18:43.710904 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe22489-783c-4d04-a358-1b123550d283 None None] Validating token access rules against request {{(pid=479852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:18:43.757920 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ddba137-a44f-4ca2-9e73-8aeda32c730f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:18:43.758886 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ddba137-a44f-4ca2-9e73-8aeda32c730f None admin] REQUEST_METHOD: `GET` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:18:43.759335 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ddba137-a44f-4ca2-9e73-8aeda32c730f None admin] SCRIPT_NAME: `/identity` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:18:43.759777 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ddba137-a44f-4ca2-9e73-8aeda32c730f None admin] PATH_INFO: `/v3/roles` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:18:43.760703 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ddba137-a44f-4ca2-9e73-8aeda32c730f None admin] RBAC: Adding query filter params (name=member) {{(pid=479852) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 09:18:43.761188 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ddba137-a44f-4ca2-9e73-8aeda32c730f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:18:43.762777 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ddba137-a44f-4ca2-9e73-8aeda32c730f None admin] RBAC: Authorization granted {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:18:43.776796 dv-cinder-851351-1-smb devstack@keystone.service[479852]: [pid: 479852|app: 0|req: 173/338] 10.222.0.42 () {56 vars in 1101 bytes} [Thu Jul 28 09:18:43 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:18:43.779848 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f583419c-9e66-479f-b6f3-5eeea28c5016 None admin] Authenticating user token {{(pid=479851) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:18:43.937929 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f583419c-9e66-479f-b6f3-5eeea28c5016 None admin] Validating token access rules against request {{(pid=479851) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:18:43.979001 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3bbd5c8-da11-467f-bc87-7e719965a374 None None] REQUEST_METHOD: `GET` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:18:43.979786 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3bbd5c8-da11-467f-bc87-7e719965a374 None None] SCRIPT_NAME: `/identity` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:18:43.980275 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3bbd5c8-da11-467f-bc87-7e719965a374 None None] PATH_INFO: `/` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:18:43.983355 dv-cinder-851351-1-smb devstack@keystone.service[479852]: [pid: 479852|app: 0|req: 174/339] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 09:18:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 09:18:43.985366 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af7ae43-bfae-4675-9633-c65b778eb859 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479851) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:18:43.986013 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af7ae43-bfae-4675-9633-c65b778eb859 None admin] REQUEST_METHOD: `GET` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:18:43.986300 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af7ae43-bfae-4675-9633-c65b778eb859 None admin] SCRIPT_NAME: `/identity` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:18:43.986581 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af7ae43-bfae-4675-9633-c65b778eb859 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:18:43.999184 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9635c5f-831f-48a1-aaf0-6598d7219c2c None None] REQUEST_METHOD: `POST` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:18:43.999664 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9635c5f-831f-48a1-aaf0-6598d7219c2c None None] SCRIPT_NAME: `/identity` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:18:44.000150 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9635c5f-831f-48a1-aaf0-6598d7219c2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:18:44.042031 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG dbcounter [-] [479851] Writing DB stats keystone:SELECT=100 {{(pid=479851) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:18:44.058274 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.auth.core [None req-c9635c5f-831f-48a1-aaf0-6598d7219c2c None None] MFA Rules not processed for user `c198f91a4ae84d2b9cc730a6e304c2be`. Rule list: `[]` (Enabled: `True`). {{(pid=479852) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 09:18:44.060298 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.fernet_utils [None req-c9635c5f-831f-48a1-aaf0-6598d7219c2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=479852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 09:18:44.098667 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af7ae43-bfae-4675-9633-c65b778eb859 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:18:44.100250 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af7ae43-bfae-4675-9633-c65b778eb859 None admin] RBAC: Authorization granted {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:18:44.185177 dv-cinder-851351-1-smb devstack@keystone.service[479852]: [pid: 479852|app: 0|req: 175/340] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 09:18:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 09:18:44.186482 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1f685c-296f-485a-8e68-ce1b5c5f411b None None] REQUEST_METHOD: `GET` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:18:44.186765 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1f685c-296f-485a-8e68-ce1b5c5f411b None None] SCRIPT_NAME: `/identity` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:18:44.187040 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1f685c-296f-485a-8e68-ce1b5c5f411b None None] PATH_INFO: `/` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:18:44.193905 dv-cinder-851351-1-smb devstack@keystone.service[479852]: [pid: 479852|app: 0|req: 176/341] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 09:18:44 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 09:18:44.201858 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40643d56-73ac-4f01-af6b-62528f87136c None None] REQUEST_METHOD: `POST` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:18:44.202240 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40643d56-73ac-4f01-af6b-62528f87136c None None] SCRIPT_NAME: `/identity` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:18:44.202528 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40643d56-73ac-4f01-af6b-62528f87136c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:18:44.232792 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.auth.core [None req-40643d56-73ac-4f01-af6b-62528f87136c None None] MFA Rules not processed for user `c198f91a4ae84d2b9cc730a6e304c2be`. Rule list: `[]` (Enabled: `True`). {{(pid=479852) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 09:18:44.233919 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.fernet_utils [None req-40643d56-73ac-4f01-af6b-62528f87136c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=479852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 09:18:44.263360 dv-cinder-851351-1-smb devstack@keystone.service[479851]: [pid: 479851|app: 0|req: 166/342] 10.222.0.42 () {58 vars in 1282 bytes} [Thu Jul 28 09:18:43 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 484 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 28 09:18:44.264281 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af7ae43-bfae-4675-9633-c65b778eb859 None admin] Authenticating user token {{(pid=479851) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:18:44.354120 dv-cinder-851351-1-smb devstack@keystone.service[479852]: [pid: 479852|app: 0|req: 177/343] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 09:18:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 28 09:18:44.354778 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40643d56-73ac-4f01-af6b-62528f87136c None None] Authenticating user token {{(pid=479852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:18:44.405469 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG dbcounter [-] [479852] Writing DB stats keystone:SELECT=100 {{(pid=479852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:18:44.407169 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG dbcounter [-] [479851] Writing DB stats keystone:SELECT=100 {{(pid=479851) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:18:44.468781 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af7ae43-bfae-4675-9633-c65b778eb859 None admin] Validating token access rules against request {{(pid=479851) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:18:44.513801 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2e5c7b-ca59-4036-8165-a61436bf1a65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479851) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:18:44.515020 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2e5c7b-ca59-4036-8165-a61436bf1a65 None admin] REQUEST_METHOD: `GET` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:18:44.515486 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2e5c7b-ca59-4036-8165-a61436bf1a65 None admin] SCRIPT_NAME: `/identity` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:18:44.516082 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2e5c7b-ca59-4036-8165-a61436bf1a65 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:18:44.529390 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40643d56-73ac-4f01-af6b-62528f87136c None None] Validating token access rules against request {{(pid=479852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:18:44.542832 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e2e5c7b-ca59-4036-8165-a61436bf1a65 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 09:18:44.548766 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application [None req-8e2e5c7b-ca59-4036-8165-a61436bf1a65 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 28 09:18:44.548766 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 09:18:44.548766 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 09:18:44.548766 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 09:18:44.548766 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 09:18:44.548766 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 09:18:44.548766 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 09:18:44.548766 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 09:18:44.548766 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 09:18:44.548766 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 09:18:44.548766 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 09:18:44.548766 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 09:18:44.548766 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 09:18:44.548766 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 09:18:44.548766 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 09:18:44.548766 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 09:18:44.549895 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 09:18:44.549895 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 09:18:44.549895 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 09:18:44.549895 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 09:18:44.549895 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 09:18:44.549895 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 09:18:44.549895 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 09:18:44.549895 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 09:18:44.549895 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 09:18:44.549895 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 09:18:44.549895 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 09:18:44.549895 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application with Lock( Jul 28 09:18:44.549895 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 09:18:44.549895 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return self._enter() Jul 28 09:18:44.549895 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 09:18:44.549895 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 09:18:44.550865 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 09:18:44.550865 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return self.creator() Jul 28 09:18:44.550865 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 09:18:44.550865 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application created_value = creator( Jul 28 09:18:44.550865 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 09:18:44.550865 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 09:18:44.550865 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 09:18:44.550865 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 09:18:44.550865 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 09:18:44.550865 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 09:18:44.550865 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 28 09:18:44.550865 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application Jul 28 09:18:44.553698 dv-cinder-851351-1-smb devstack@keystone.service[479851]: [pid: 479851|app: 0|req: 167/344] 10.222.0.42 () {56 vars in 1114 bytes} [Thu Jul 28 09:18:44 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 290 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 09:18:44.554909 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2e5c7b-ca59-4036-8165-a61436bf1a65 None admin] Authenticating user token {{(pid=479851) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:18:44.584970 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c32b0cb-2a63-4e7d-8fae-e7d8f0c25cf0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:18:44.585653 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c32b0cb-2a63-4e7d-8fae-e7d8f0c25cf0 None admin] REQUEST_METHOD: `GET` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:18:44.585939 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c32b0cb-2a63-4e7d-8fae-e7d8f0c25cf0 None admin] SCRIPT_NAME: `/identity` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:18:44.586221 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c32b0cb-2a63-4e7d-8fae-e7d8f0c25cf0 None admin] PATH_INFO: `/v3/projects/580eb2f23f9049b18bb38dce6f6f9b4f` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:18:44.587478 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c32b0cb-2a63-4e7d-8fae-e7d8f0c25cf0 None admin] RBAC: Authorizing `identity:get_project(project_id=580eb2f23f9049b18bb38dce6f6f9b4f)` {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:18:44.588989 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c32b0cb-2a63-4e7d-8fae-e7d8f0c25cf0 None admin] RBAC: Authorization granted {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:18:44.595433 dv-cinder-851351-1-smb devstack@keystone.service[479852]: [pid: 479852|app: 0|req: 178/345] 10.222.0.42 () {56 vars in 1186 bytes} [Thu Jul 28 09:18:44 2022] GET /identity/v3/projects/580eb2f23f9049b18bb38dce6f6f9b4f => generated 298 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:18:44.596911 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b6d2ad-5cbd-48f4-853b-eae98c8123d4 None None] REQUEST_METHOD: `GET` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:18:44.597158 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b6d2ad-5cbd-48f4-853b-eae98c8123d4 None None] SCRIPT_NAME: `/identity` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:18:44.597443 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b6d2ad-5cbd-48f4-853b-eae98c8123d4 None None] PATH_INFO: `/` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:18:44.605742 dv-cinder-851351-1-smb devstack@keystone.service[479852]: [pid: 479852|app: 0|req: 179/346] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 09:18:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 09:18:44.605742 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b6d2ad-5cbd-48f4-853b-eae98c8123d4 None None] Authenticating user token {{(pid=479852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:18:44.696983 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2e5c7b-ca59-4036-8165-a61436bf1a65 None admin] Validating token access rules against request {{(pid=479851) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:18:44.727927 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG dbcounter [-] [479852] Writing DB stats keystone:SELECT=100 {{(pid=479852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:18:44.729774 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG dbcounter [-] [479851] Writing DB stats keystone:SELECT=100 {{(pid=479851) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:18:44.737307 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-858337b2-0dce-4a43-a0ad-bf3395652dd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479851) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:18:44.737990 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858337b2-0dce-4a43-a0ad-bf3395652dd6 None admin] REQUEST_METHOD: `GET` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:18:44.738276 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858337b2-0dce-4a43-a0ad-bf3395652dd6 None admin] SCRIPT_NAME: `/identity` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:18:44.738561 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858337b2-0dce-4a43-a0ad-bf3395652dd6 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:18:44.741727 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b6d2ad-5cbd-48f4-853b-eae98c8123d4 None None] Validating token access rules against request {{(pid=479852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:18:44.755420 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-858337b2-0dce-4a43-a0ad-bf3395652dd6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 09:18:44.761054 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application [None req-858337b2-0dce-4a43-a0ad-bf3395652dd6 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 28 09:18:44.761054 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 09:18:44.761054 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 09:18:44.761054 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 09:18:44.761054 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 09:18:44.761054 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 09:18:44.761054 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 09:18:44.761054 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 09:18:44.761054 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 09:18:44.761054 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 09:18:44.761054 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 09:18:44.761054 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 09:18:44.761054 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 09:18:44.761054 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 09:18:44.761054 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 09:18:44.761054 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 09:18:44.762195 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 09:18:44.762195 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 09:18:44.762195 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 09:18:44.762195 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 09:18:44.762195 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 09:18:44.762195 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 09:18:44.762195 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 09:18:44.762195 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 09:18:44.762195 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 09:18:44.762195 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 09:18:44.762195 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 09:18:44.762195 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application with Lock( Jul 28 09:18:44.762195 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 09:18:44.762195 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return self._enter() Jul 28 09:18:44.762195 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 09:18:44.762195 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 09:18:44.763918 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 09:18:44.763918 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return self.creator() Jul 28 09:18:44.763918 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 09:18:44.763918 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application created_value = creator( Jul 28 09:18:44.763918 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 09:18:44.763918 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 09:18:44.763918 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 09:18:44.763918 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 09:18:44.763918 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 09:18:44.763918 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 09:18:44.763918 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 28 09:18:44.763918 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application Jul 28 09:18:44.763918 dv-cinder-851351-1-smb devstack@keystone.service[479851]: [pid: 479851|app: 0|req: 168/347] 10.222.0.42 () {56 vars in 1099 bytes} [Thu Jul 28 09:18:44 2022] GET /identity/v3/roles/reader => generated 84 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 09:18:44.763918 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-858337b2-0dce-4a43-a0ad-bf3395652dd6 None admin] Authenticating user token {{(pid=479851) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:18:44.797665 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b071a3-d9e5-4538-974e-b9bada69e7c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:18:44.798069 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b071a3-d9e5-4538-974e-b9bada69e7c5 None admin] REQUEST_METHOD: `GET` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:18:44.798358 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b071a3-d9e5-4538-974e-b9bada69e7c5 None admin] SCRIPT_NAME: `/identity` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:18:44.798599 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b071a3-d9e5-4538-974e-b9bada69e7c5 None admin] PATH_INFO: `/v3/roles` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:18:44.799341 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4b071a3-d9e5-4538-974e-b9bada69e7c5 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=479852) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 09:18:44.799663 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4b071a3-d9e5-4538-974e-b9bada69e7c5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:18:44.801341 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4b071a3-d9e5-4538-974e-b9bada69e7c5 None admin] RBAC: Authorization granted {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:18:44.813480 dv-cinder-851351-1-smb devstack@keystone.service[479852]: [pid: 479852|app: 0|req: 180/348] 10.222.0.42 () {56 vars in 1111 bytes} [Thu Jul 28 09:18:44 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:18:44.813678 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3a6600-873e-4767-988b-f401cddcb783 None None] REQUEST_METHOD: `POST` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:18:44.813824 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3a6600-873e-4767-988b-f401cddcb783 None None] SCRIPT_NAME: `/identity` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:18:44.814103 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3a6600-873e-4767-988b-f401cddcb783 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:18:44.833820 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.auth.core [None req-fb3a6600-873e-4767-988b-f401cddcb783 None None] MFA Rules not processed for user `c198f91a4ae84d2b9cc730a6e304c2be`. Rule list: `[]` (Enabled: `True`). {{(pid=479852) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 09:18:44.835639 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.fernet_utils [None req-fb3a6600-873e-4767-988b-f401cddcb783 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=479852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 09:18:44.908702 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-858337b2-0dce-4a43-a0ad-bf3395652dd6 None admin] Validating token access rules against request {{(pid=479851) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:18:44.933247 dv-cinder-851351-1-smb devstack@keystone.service[479852]: [pid: 479852|app: 0|req: 181/349] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 09:18:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 09:18:44.934859 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4234abb-297e-4117-afe1-8dd913abaad6 None None] REQUEST_METHOD: `GET` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:18:44.935325 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4234abb-297e-4117-afe1-8dd913abaad6 None None] SCRIPT_NAME: `/identity` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:18:44.935606 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4234abb-297e-4117-afe1-8dd913abaad6 None None] PATH_INFO: `/` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:18:44.937892 dv-cinder-851351-1-smb devstack@keystone.service[479852]: [pid: 479852|app: 0|req: 182/350] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 09:18:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 09:18:44.938787 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4234abb-297e-4117-afe1-8dd913abaad6 None None] Authenticating user token {{(pid=479852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:18:44.949171 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3133cbf2-3eb2-4833-97ce-4311be518e99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479851) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:18:44.950296 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3133cbf2-3eb2-4833-97ce-4311be518e99 None admin] REQUEST_METHOD: `GET` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:18:44.950580 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3133cbf2-3eb2-4833-97ce-4311be518e99 None admin] SCRIPT_NAME: `/identity` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:18:44.950858 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3133cbf2-3eb2-4833-97ce-4311be518e99 None admin] PATH_INFO: `/v3/groups/10982903b2844ab4bdbbb8dd377d478f` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:18:44.960588 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3133cbf2-3eb2-4833-97ce-4311be518e99 None admin] RBAC: Authorizing `identity:get_group(group_id=10982903b2844ab4bdbbb8dd377d478f)` {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:18:44.964176 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3133cbf2-3eb2-4833-97ce-4311be518e99 None admin] RBAC: Authorization granted {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:18:44.966167 dv-cinder-851351-1-smb devstack@keystone.service[479851]: [pid: 479851|app: 0|req: 169/351] 10.222.0.42 () {56 vars in 1180 bytes} [Thu Jul 28 09:18:44 2022] GET /identity/v3/groups/10982903b2844ab4bdbbb8dd377d478f => generated 226 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:18:44.967399 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3133cbf2-3eb2-4833-97ce-4311be518e99 None admin] Authenticating user token {{(pid=479851) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:18:45.037605 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG dbcounter [-] [479851] Writing DB stats keystone:SELECT=100 {{(pid=479851) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:18:45.058127 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG dbcounter [-] [479852] Writing DB stats keystone:SELECT=100 {{(pid=479852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:18:45.091678 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4234abb-297e-4117-afe1-8dd913abaad6 None None] Validating token access rules against request {{(pid=479852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:18:45.100006 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3133cbf2-3eb2-4833-97ce-4311be518e99 None admin] Validating token access rules against request {{(pid=479851) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:18:45.138196 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04fea6c5-0696-4c18-aaf5-be0e864f2188 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479851) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:18:45.138959 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04fea6c5-0696-4c18-aaf5-be0e864f2188 None admin] REQUEST_METHOD: `GET` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:18:45.139246 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04fea6c5-0696-4c18-aaf5-be0e864f2188 None admin] SCRIPT_NAME: `/identity` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:18:45.139430 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1314a01-7509-4d2c-bd37-4b75d7e8261a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:18:45.139570 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04fea6c5-0696-4c18-aaf5-be0e864f2188 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:18:45.140096 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1314a01-7509-4d2c-bd37-4b75d7e8261a None admin] REQUEST_METHOD: `GET` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:18:45.140364 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1314a01-7509-4d2c-bd37-4b75d7e8261a None admin] SCRIPT_NAME: `/identity` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:18:45.140648 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1314a01-7509-4d2c-bd37-4b75d7e8261a None admin] PATH_INFO: `/v3/roles` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:18:45.141463 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1314a01-7509-4d2c-bd37-4b75d7e8261a None admin] RBAC: Adding query filter params (name=reader) {{(pid=479852) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 09:18:45.141776 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1314a01-7509-4d2c-bd37-4b75d7e8261a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:18:45.143424 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1314a01-7509-4d2c-bd37-4b75d7e8261a None admin] RBAC: Authorization granted {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:18:45.156209 dv-cinder-851351-1-smb devstack@keystone.service[479852]: [pid: 479852|app: 0|req: 183/352] 10.222.0.42 () {56 vars in 1101 bytes} [Thu Jul 28 09:18:44 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:18:45.157973 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e049322d-9dcb-4ba3-a44c-b85bf49b7fc0 None None] REQUEST_METHOD: `POST` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:18:45.158492 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e049322d-9dcb-4ba3-a44c-b85bf49b7fc0 None None] SCRIPT_NAME: `/identity` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:18:45.159005 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e049322d-9dcb-4ba3-a44c-b85bf49b7fc0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:18:45.180591 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.auth.core [None req-e049322d-9dcb-4ba3-a44c-b85bf49b7fc0 None None] MFA Rules not processed for user `c198f91a4ae84d2b9cc730a6e304c2be`. Rule list: `[]` (Enabled: `True`). {{(pid=479852) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 09:18:45.181862 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.fernet_utils [None req-e049322d-9dcb-4ba3-a44c-b85bf49b7fc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=479852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 09:18:45.232838 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04fea6c5-0696-4c18-aaf5-be0e864f2188 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:18:45.235774 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04fea6c5-0696-4c18-aaf5-be0e864f2188 None admin] RBAC: Authorization granted {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:18:45.272147 dv-cinder-851351-1-smb devstack@keystone.service[479852]: [pid: 479852|app: 0|req: 184/353] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 09:18:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 09:18:45.274028 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e049322d-9dcb-4ba3-a44c-b85bf49b7fc0 None None] Authenticating user token {{(pid=479852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:18:45.315261 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG dbcounter [-] [479851] Writing DB stats keystone:SELECT=100 {{(pid=479851) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:18:45.378604 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG dbcounter [-] [479852] Writing DB stats keystone:SELECT=100 {{(pid=479852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:18:45.391113 dv-cinder-851351-1-smb devstack@keystone.service[479851]: [pid: 479851|app: 0|req: 170/354] 10.222.0.42 () {58 vars in 1282 bytes} [Thu Jul 28 09:18:44 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 422 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 28 09:18:45.391113 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04fea6c5-0696-4c18-aaf5-be0e864f2188 None admin] Authenticating user token {{(pid=479851) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:18:45.428976 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e049322d-9dcb-4ba3-a44c-b85bf49b7fc0 None None] Validating token access rules against request {{(pid=479852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:18:45.477861 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e895b4dc-5022-4dc2-9bb7-aae5858c11c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:18:45.478540 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e895b4dc-5022-4dc2-9bb7-aae5858c11c7 None admin] REQUEST_METHOD: `GET` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:18:45.478819 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e895b4dc-5022-4dc2-9bb7-aae5858c11c7 None admin] SCRIPT_NAME: `/identity` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:18:45.479091 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e895b4dc-5022-4dc2-9bb7-aae5858c11c7 None admin] PATH_INFO: `/v3/roles/member` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:18:45.491596 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e895b4dc-5022-4dc2-9bb7-aae5858c11c7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 09:18:45.496833 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application [None req-e895b4dc-5022-4dc2-9bb7-aae5858c11c7 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 28 09:18:45.496833 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 09:18:45.496833 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 09:18:45.496833 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 09:18:45.496833 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 09:18:45.496833 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 09:18:45.496833 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 09:18:45.496833 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 09:18:45.496833 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 09:18:45.496833 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 09:18:45.496833 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 09:18:45.496833 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 09:18:45.496833 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 09:18:45.496833 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 09:18:45.496833 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 09:18:45.496833 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 09:18:45.497959 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 09:18:45.497959 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 09:18:45.497959 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 09:18:45.497959 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 09:18:45.497959 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 09:18:45.497959 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 09:18:45.497959 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 09:18:45.497959 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 09:18:45.497959 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 09:18:45.497959 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 09:18:45.497959 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 09:18:45.497959 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application with Lock( Jul 28 09:18:45.497959 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 09:18:45.497959 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self._enter() Jul 28 09:18:45.497959 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 09:18:45.497959 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 09:18:45.498927 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 09:18:45.498927 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self.creator() Jul 28 09:18:45.498927 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 09:18:45.498927 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application created_value = creator( Jul 28 09:18:45.498927 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 09:18:45.498927 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 09:18:45.498927 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 09:18:45.498927 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 09:18:45.498927 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 09:18:45.498927 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 09:18:45.498927 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 28 09:18:45.498927 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application Jul 28 09:18:45.498927 dv-cinder-851351-1-smb devstack@keystone.service[479852]: [pid: 479852|app: 0|req: 185/355] 10.222.0.42 () {56 vars in 1099 bytes} [Thu Jul 28 09:18:45 2022] GET /identity/v3/roles/member => generated 84 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 09:18:45.499815 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e895b4dc-5022-4dc2-9bb7-aae5858c11c7 None admin] Authenticating user token {{(pid=479852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:18:45.543205 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04fea6c5-0696-4c18-aaf5-be0e864f2188 None admin] Validating token access rules against request {{(pid=479851) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:18:45.582779 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa798a8-b4db-4865-8ae9-7632d6d7f2ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479851) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:18:45.583422 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa798a8-b4db-4865-8ae9-7632d6d7f2ce None admin] REQUEST_METHOD: `GET` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:18:45.583712 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa798a8-b4db-4865-8ae9-7632d6d7f2ce None admin] SCRIPT_NAME: `/identity` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:18:45.584020 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa798a8-b4db-4865-8ae9-7632d6d7f2ce None admin] PATH_INFO: `/v3/role_assignments` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:18:45.584872 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa798a8-b4db-4865-8ae9-7632d6d7f2ce None admin] RBAC: Adding query filter params (group.id=10982903b2844ab4bdbbb8dd377d478f, role.id=900fb424e172461d93a0db59afb0a12b, scope.project.id=580eb2f23f9049b18bb38dce6f6f9b4f) {{(pid=479851) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 09:18:45.585190 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa798a8-b4db-4865-8ae9-7632d6d7f2ce None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:18:45.587074 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa798a8-b4db-4865-8ae9-7632d6d7f2ce None admin] RBAC: Authorization granted {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:18:45.592642 dv-cinder-851351-1-smb devstack@keystone.service[479851]: [pid: 479851|app: 0|req: 171/356] 10.222.0.42 () {56 vars in 1376 bytes} [Thu Jul 28 09:18:45 2022] GET /identity/v3/role_assignments?group.id=10982903b2844ab4bdbbb8dd377d478f&scope.project.id=580eb2f23f9049b18bb38dce6f6f9b4f&role.id=900fb424e172461d93a0db59afb0a12b => generated 260 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:18:45.593581 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa798a8-b4db-4865-8ae9-7632d6d7f2ce None admin] Authenticating user token {{(pid=479851) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:18:45.622291 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG dbcounter [-] [479851] Writing DB stats keystone:SELECT=100 {{(pid=479851) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:18:45.632126 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e895b4dc-5022-4dc2-9bb7-aae5858c11c7 None admin] Validating token access rules against request {{(pid=479852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:18:45.688190 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-855d1bab-47d0-4f35-b9a4-1ca30e838f0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:18:45.689106 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855d1bab-47d0-4f35-b9a4-1ca30e838f0d None admin] REQUEST_METHOD: `GET` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:18:45.689389 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855d1bab-47d0-4f35-b9a4-1ca30e838f0d None admin] SCRIPT_NAME: `/identity` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:18:45.690664 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855d1bab-47d0-4f35-b9a4-1ca30e838f0d None admin] PATH_INFO: `/v3/users/9ea021e6186744809ddd8a0f70c5a03f` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:18:45.693390 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-855d1bab-47d0-4f35-b9a4-1ca30e838f0d None admin] RBAC: Authorizing `identity:get_user(user_id=9ea021e6186744809ddd8a0f70c5a03f)` {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:18:45.695043 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-855d1bab-47d0-4f35-b9a4-1ca30e838f0d None admin] RBAC: Authorization granted {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:18:45.700878 dv-cinder-851351-1-smb devstack@keystone.service[479852]: [pid: 479852|app: 0|req: 186/357] 10.222.0.42 () {56 vars in 1177 bytes} [Thu Jul 28 09:18:45 2022] GET /identity/v3/users/9ea021e6186744809ddd8a0f70c5a03f => generated 293 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:18:45.700878 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-855d1bab-47d0-4f35-b9a4-1ca30e838f0d None admin] Authenticating user token {{(pid=479852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:18:45.704131 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG dbcounter [-] [479852] Writing DB stats keystone:SELECT=100 {{(pid=479852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:18:45.752220 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa798a8-b4db-4865-8ae9-7632d6d7f2ce None admin] Validating token access rules against request {{(pid=479851) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:18:45.806806 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eadf8fc6-2d4a-437e-88d2-65bad0cbd7dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479851) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:18:45.806806 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eadf8fc6-2d4a-437e-88d2-65bad0cbd7dc None admin] REQUEST_METHOD: `GET` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:18:45.806806 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eadf8fc6-2d4a-437e-88d2-65bad0cbd7dc None admin] SCRIPT_NAME: `/identity` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:18:45.806806 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eadf8fc6-2d4a-437e-88d2-65bad0cbd7dc None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:18:45.822012 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eadf8fc6-2d4a-437e-88d2-65bad0cbd7dc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 09:18:45.827781 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application [None req-eadf8fc6-2d4a-437e-88d2-65bad0cbd7dc None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 28 09:18:45.827781 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 09:18:45.827781 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 09:18:45.827781 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 09:18:45.827781 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 09:18:45.827781 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 09:18:45.827781 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 09:18:45.827781 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 09:18:45.827781 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 09:18:45.827781 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 09:18:45.827781 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 09:18:45.827781 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 09:18:45.827781 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 09:18:45.827781 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 09:18:45.827781 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 09:18:45.827781 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 09:18:45.828964 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 09:18:45.828964 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 09:18:45.828964 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 09:18:45.828964 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 09:18:45.828964 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 09:18:45.828964 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 09:18:45.828964 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 09:18:45.828964 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 09:18:45.828964 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 09:18:45.828964 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 09:18:45.828964 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 09:18:45.828964 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application with Lock( Jul 28 09:18:45.828964 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 09:18:45.828964 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return self._enter() Jul 28 09:18:45.828964 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 09:18:45.828964 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 09:18:45.829941 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 09:18:45.829941 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return self.creator() Jul 28 09:18:45.829941 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 09:18:45.829941 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application created_value = creator( Jul 28 09:18:45.829941 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 09:18:45.829941 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 09:18:45.829941 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 09:18:45.829941 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 09:18:45.829941 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 09:18:45.829941 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 09:18:45.829941 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 28 09:18:45.829941 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application Jul 28 09:18:45.830685 dv-cinder-851351-1-smb devstack@keystone.service[479851]: [pid: 479851|app: 0|req: 172/358] 10.222.0.42 () {56 vars in 1114 bytes} [Thu Jul 28 09:18:45 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 09:18:45.831277 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eadf8fc6-2d4a-437e-88d2-65bad0cbd7dc None admin] Authenticating user token {{(pid=479851) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:18:45.840530 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-855d1bab-47d0-4f35-b9a4-1ca30e838f0d None admin] Validating token access rules against request {{(pid=479852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:18:45.889002 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4471783-c73b-46c0-b375-55a2611b1013 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:18:45.889677 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4471783-c73b-46c0-b375-55a2611b1013 None admin] REQUEST_METHOD: `GET` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:18:45.889962 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4471783-c73b-46c0-b375-55a2611b1013 None admin] SCRIPT_NAME: `/identity` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:18:45.890244 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4471783-c73b-46c0-b375-55a2611b1013 None admin] PATH_INFO: `/v3/projects/580eb2f23f9049b18bb38dce6f6f9b4f` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:18:45.891452 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4471783-c73b-46c0-b375-55a2611b1013 None admin] RBAC: Authorizing `identity:get_project(project_id=580eb2f23f9049b18bb38dce6f6f9b4f)` {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:18:45.892962 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4471783-c73b-46c0-b375-55a2611b1013 None admin] RBAC: Authorization granted {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:18:45.894765 dv-cinder-851351-1-smb devstack@keystone.service[479852]: [pid: 479852|app: 0|req: 187/359] 10.222.0.42 () {56 vars in 1186 bytes} [Thu Jul 28 09:18:45 2022] GET /identity/v3/projects/580eb2f23f9049b18bb38dce6f6f9b4f => generated 298 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:18:45.897433 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42893526-85b1-477a-837b-11a883cc6239 None None] REQUEST_METHOD: `GET` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:18:45.897715 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42893526-85b1-477a-837b-11a883cc6239 None None] SCRIPT_NAME: `/identity` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:18:45.897998 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42893526-85b1-477a-837b-11a883cc6239 None None] PATH_INFO: `/` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:18:45.899613 dv-cinder-851351-1-smb devstack@keystone.service[479852]: [pid: 479852|app: 0|req: 188/360] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 09:18:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 09:18:45.900829 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42893526-85b1-477a-837b-11a883cc6239 None None] Authenticating user token {{(pid=479852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:18:45.937129 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG dbcounter [-] [479851] Writing DB stats keystone:SELECT=100 {{(pid=479851) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:18:45.970085 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eadf8fc6-2d4a-437e-88d2-65bad0cbd7dc None admin] Validating token access rules against request {{(pid=479851) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:18:45.985766 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG dbcounter [-] [479852] Writing DB stats keystone:SELECT=100 {{(pid=479852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:18:46.016267 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2006f857-4d82-404a-9b1d-3069fdaed709 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479851) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:18:46.016971 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2006f857-4d82-404a-9b1d-3069fdaed709 None admin] REQUEST_METHOD: `GET` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:18:46.017253 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2006f857-4d82-404a-9b1d-3069fdaed709 None admin] SCRIPT_NAME: `/identity` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:18:46.017824 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2006f857-4d82-404a-9b1d-3069fdaed709 None admin] PATH_INFO: `/v3/roles` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:18:46.019864 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2006f857-4d82-404a-9b1d-3069fdaed709 None admin] RBAC: Adding query filter params (name=member) {{(pid=479851) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 09:18:46.019864 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2006f857-4d82-404a-9b1d-3069fdaed709 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:18:46.020042 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2006f857-4d82-404a-9b1d-3069fdaed709 None admin] RBAC: Authorization granted {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:18:46.033178 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42893526-85b1-477a-837b-11a883cc6239 None None] Validating token access rules against request {{(pid=479852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:18:46.035874 dv-cinder-851351-1-smb devstack@keystone.service[479851]: [pid: 479851|app: 0|req: 173/361] 10.222.0.42 () {56 vars in 1101 bytes} [Thu Jul 28 09:18:45 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:18:46.038026 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2006f857-4d82-404a-9b1d-3069fdaed709 None admin] Authenticating user token {{(pid=479851) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:18:46.079169 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b60e8517-b208-4a0e-93a8-eeb700b49aff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:18:46.080774 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60e8517-b208-4a0e-93a8-eeb700b49aff None admin] REQUEST_METHOD: `GET` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:18:46.081105 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60e8517-b208-4a0e-93a8-eeb700b49aff None admin] SCRIPT_NAME: `/identity` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:18:46.081388 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60e8517-b208-4a0e-93a8-eeb700b49aff None admin] PATH_INFO: `/v3/role_assignments` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:18:46.082199 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b60e8517-b208-4a0e-93a8-eeb700b49aff None admin] RBAC: Adding query filter params (role.id=73525379110b4a99850473e0e9f217f1, user.id=9ea021e6186744809ddd8a0f70c5a03f, scope.system=all) {{(pid=479852) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 09:18:46.082513 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b60e8517-b208-4a0e-93a8-eeb700b49aff None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:18:46.084352 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b60e8517-b208-4a0e-93a8-eeb700b49aff None admin] RBAC: Authorization granted {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:18:46.099461 dv-cinder-851351-1-smb devstack@keystone.service[479852]: [pid: 479852|app: 0|req: 189/362] 10.222.0.42 () {56 vars in 1308 bytes} [Thu Jul 28 09:18:45 2022] GET /identity/v3/role_assignments?user.id=9ea021e6186744809ddd8a0f70c5a03f&scope.system=all&role.id=73525379110b4a99850473e0e9f217f1 => generated 510 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:18:46.100134 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b60e8517-b208-4a0e-93a8-eeb700b49aff None admin] Authenticating user token {{(pid=479852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:18:46.179232 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2006f857-4d82-404a-9b1d-3069fdaed709 None admin] Validating token access rules against request {{(pid=479851) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:18:46.228568 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76efb86a-c133-4ee6-b0aa-19b72cd05faa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479851) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:18:46.229334 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76efb86a-c133-4ee6-b0aa-19b72cd05faa None admin] REQUEST_METHOD: `GET` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:18:46.229621 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76efb86a-c133-4ee6-b0aa-19b72cd05faa None admin] SCRIPT_NAME: `/identity` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:18:46.229902 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76efb86a-c133-4ee6-b0aa-19b72cd05faa None admin] PATH_INFO: `/v3/roles` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:18:46.230654 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76efb86a-c133-4ee6-b0aa-19b72cd05faa None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=479851) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 09:18:46.230967 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76efb86a-c133-4ee6-b0aa-19b72cd05faa None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:18:46.232423 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76efb86a-c133-4ee6-b0aa-19b72cd05faa None admin] RBAC: Authorization granted {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:18:46.242410 dv-cinder-851351-1-smb devstack@keystone.service[479851]: [pid: 479851|app: 0|req: 174/363] 10.222.0.42 () {56 vars in 1111 bytes} [Thu Jul 28 09:18:46 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:18:46.243914 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2beb1f-0b40-4967-b952-888986d16755 None None] REQUEST_METHOD: `POST` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:18:46.244213 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2beb1f-0b40-4967-b952-888986d16755 None None] SCRIPT_NAME: `/identity` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:18:46.244497 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2beb1f-0b40-4967-b952-888986d16755 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:18:46.248026 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b60e8517-b208-4a0e-93a8-eeb700b49aff None admin] Validating token access rules against request {{(pid=479852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:18:46.252173 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG dbcounter [-] [479851] Writing DB stats keystone:SELECT=100 {{(pid=479851) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:18:46.267688 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.auth.core [None req-7d2beb1f-0b40-4967-b952-888986d16755 None None] MFA Rules not processed for user `c198f91a4ae84d2b9cc730a6e304c2be`. Rule list: `[]` (Enabled: `True`). {{(pid=479851) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 09:18:46.269351 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.fernet_utils [None req-7d2beb1f-0b40-4967-b952-888986d16755 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=479851) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 09:18:46.288616 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG dbcounter [-] [479852] Writing DB stats keystone:SELECT=100 {{(pid=479852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:18:46.304320 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e26cac-67a0-4d83-9d4a-c9684c7c3dff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:18:46.305482 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e26cac-67a0-4d83-9d4a-c9684c7c3dff None admin] REQUEST_METHOD: `GET` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:18:46.306331 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e26cac-67a0-4d83-9d4a-c9684c7c3dff None admin] SCRIPT_NAME: `/identity` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:18:46.307058 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e26cac-67a0-4d83-9d4a-c9684c7c3dff None admin] PATH_INFO: `/v3/groups/10982903b2844ab4bdbbb8dd377d478f` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:18:46.308786 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e26cac-67a0-4d83-9d4a-c9684c7c3dff None admin] RBAC: Authorizing `identity:get_group(group_id=10982903b2844ab4bdbbb8dd377d478f)` {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:18:46.311109 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e26cac-67a0-4d83-9d4a-c9684c7c3dff None admin] RBAC: Authorization granted {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:18:46.315033 dv-cinder-851351-1-smb devstack@keystone.service[479852]: [pid: 479852|app: 0|req: 190/364] 10.222.0.42 () {56 vars in 1180 bytes} [Thu Jul 28 09:18:46 2022] GET /identity/v3/groups/10982903b2844ab4bdbbb8dd377d478f => generated 226 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:18:46.316431 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e26cac-67a0-4d83-9d4a-c9684c7c3dff None admin] Authenticating user token {{(pid=479852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:18:46.363409 dv-cinder-851351-1-smb devstack@keystone.service[479851]: [pid: 479851|app: 0|req: 175/365] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 09:18:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 09:18:46.363960 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d2beb1f-0b40-4967-b952-888986d16755 None None] Authenticating user token {{(pid=479851) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:18:46.453841 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e26cac-67a0-4d83-9d4a-c9684c7c3dff None admin] Validating token access rules against request {{(pid=479852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:18:46.503237 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f5e178-8430-47ed-a043-9aad90146f4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:18:46.504006 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f5e178-8430-47ed-a043-9aad90146f4f None admin] REQUEST_METHOD: `GET` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:18:46.504362 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f5e178-8430-47ed-a043-9aad90146f4f None admin] SCRIPT_NAME: `/identity` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:18:46.504799 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f5e178-8430-47ed-a043-9aad90146f4f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:18:46.517454 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d2beb1f-0b40-4967-b952-888986d16755 None None] Validating token access rules against request {{(pid=479851) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:18:46.554147 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG dbcounter [-] [479851] Writing DB stats keystone:SELECT=100 {{(pid=479851) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:18:46.560324 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df528d8e-ee9b-445e-816f-5a6e79710ff8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479851) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:18:46.563348 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df528d8e-ee9b-445e-816f-5a6e79710ff8 None admin] REQUEST_METHOD: `GET` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:18:46.563348 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df528d8e-ee9b-445e-816f-5a6e79710ff8 None admin] SCRIPT_NAME: `/identity` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:18:46.563348 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df528d8e-ee9b-445e-816f-5a6e79710ff8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:18:46.584475 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG dbcounter [-] [479852] Writing DB stats keystone:SELECT=100 {{(pid=479852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:18:46.598603 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27f5e178-8430-47ed-a043-9aad90146f4f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:18:46.598603 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27f5e178-8430-47ed-a043-9aad90146f4f None admin] RBAC: Authorization granted {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:18:46.670706 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df528d8e-ee9b-445e-816f-5a6e79710ff8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:18:46.672119 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df528d8e-ee9b-445e-816f-5a6e79710ff8 None admin] RBAC: Authorization granted {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:18:46.727513 dv-cinder-851351-1-smb devstack@keystone.service[479852]: [pid: 479852|app: 0|req: 191/366] 10.222.0.42 () {58 vars in 1282 bytes} [Thu Jul 28 09:18:46 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 411 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 28 09:18:46.728777 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f5e178-8430-47ed-a043-9aad90146f4f None admin] Authenticating user token {{(pid=479852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:18:46.800553 dv-cinder-851351-1-smb devstack@keystone.service[479851]: [pid: 479851|app: 0|req: 176/367] 10.222.0.42 () {58 vars in 1282 bytes} [Thu Jul 28 09:18:46 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 437 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 28 09:18:46.801757 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df528d8e-ee9b-445e-816f-5a6e79710ff8 None admin] Authenticating user token {{(pid=479851) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:18:46.848512 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG dbcounter [-] [479851] Writing DB stats keystone:SELECT=100 {{(pid=479851) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:18:46.851690 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG dbcounter [-] [479852] Writing DB stats keystone:SELECT=100 {{(pid=479852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:18:46.867068 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f5e178-8430-47ed-a043-9aad90146f4f None admin] Validating token access rules against request {{(pid=479852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:18:46.906569 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4250a3e3-0272-4184-9ecf-380b68f20c86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:18:46.907221 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4250a3e3-0272-4184-9ecf-380b68f20c86 None admin] REQUEST_METHOD: `GET` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:18:46.907506 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4250a3e3-0272-4184-9ecf-380b68f20c86 None admin] SCRIPT_NAME: `/identity` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:18:46.907847 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4250a3e3-0272-4184-9ecf-380b68f20c86 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:18:46.908598 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4250a3e3-0272-4184-9ecf-380b68f20c86 None admin] RBAC: Adding query filter params (group.id=10982903b2844ab4bdbbb8dd377d478f, role.id=acf1d2de5e5448beb6363dae3d154a02, scope.project.id=580eb2f23f9049b18bb38dce6f6f9b4f) {{(pid=479852) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 09:18:46.908943 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4250a3e3-0272-4184-9ecf-380b68f20c86 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:18:46.910393 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4250a3e3-0272-4184-9ecf-380b68f20c86 None admin] RBAC: Authorization granted {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:18:46.917662 dv-cinder-851351-1-smb devstack@keystone.service[479852]: [pid: 479852|app: 0|req: 192/368] 10.222.0.42 () {56 vars in 1376 bytes} [Thu Jul 28 09:18:46 2022] GET /identity/v3/role_assignments?group.id=10982903b2844ab4bdbbb8dd377d478f&scope.project.id=580eb2f23f9049b18bb38dce6f6f9b4f&role.id=acf1d2de5e5448beb6363dae3d154a02 => generated 260 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:18:46.918001 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4250a3e3-0272-4184-9ecf-380b68f20c86 None admin] Authenticating user token {{(pid=479852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:18:46.944600 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df528d8e-ee9b-445e-816f-5a6e79710ff8 None admin] Validating token access rules against request {{(pid=479851) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:18:46.987456 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e22bc0-f463-4ef3-a4d4-36c3df97f0c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479851) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:18:46.988641 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e22bc0-f463-4ef3-a4d4-36c3df97f0c9 None admin] REQUEST_METHOD: `GET` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:18:46.989306 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e22bc0-f463-4ef3-a4d4-36c3df97f0c9 None admin] SCRIPT_NAME: `/identity` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:18:46.989912 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e22bc0-f463-4ef3-a4d4-36c3df97f0c9 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:18:47.002606 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52e22bc0-f463-4ef3-a4d4-36c3df97f0c9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 09:18:47.008649 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application [None req-52e22bc0-f463-4ef3-a4d4-36c3df97f0c9 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 09:18:47.008649 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 09:18:47.008649 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 09:18:47.008649 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 09:18:47.008649 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 09:18:47.008649 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 09:18:47.008649 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 09:18:47.008649 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 09:18:47.008649 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 09:18:47.008649 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 09:18:47.008649 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 09:18:47.008649 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 09:18:47.008649 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 09:18:47.008649 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 09:18:47.008649 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 09:18:47.008649 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 09:18:47.009922 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 09:18:47.009922 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 09:18:47.009922 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 09:18:47.009922 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 09:18:47.009922 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 09:18:47.009922 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 09:18:47.009922 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 09:18:47.009922 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 09:18:47.009922 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 09:18:47.009922 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 09:18:47.009922 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 09:18:47.009922 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application with Lock( Jul 28 09:18:47.009922 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 09:18:47.009922 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return self._enter() Jul 28 09:18:47.009922 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 09:18:47.009922 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 09:18:47.010924 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 09:18:47.010924 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return self.creator() Jul 28 09:18:47.010924 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 09:18:47.010924 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application created_value = creator( Jul 28 09:18:47.010924 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 09:18:47.010924 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 09:18:47.010924 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 09:18:47.010924 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 09:18:47.010924 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 09:18:47.010924 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 09:18:47.010924 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 09:18:47.010924 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application Jul 28 09:18:47.014113 dv-cinder-851351-1-smb devstack@keystone.service[479851]: [pid: 479851|app: 0|req: 177/369] 10.222.0.42 () {56 vars in 1096 bytes} [Thu Jul 28 09:18:46 2022] GET /identity/v3/roles/admin => generated 83 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 09:18:47.019558 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e22bc0-f463-4ef3-a4d4-36c3df97f0c9 None admin] Authenticating user token {{(pid=479851) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:18:47.054832 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4250a3e3-0272-4184-9ecf-380b68f20c86 None admin] Validating token access rules against request {{(pid=479852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:18:47.101362 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1740b9d4-03c7-4421-ac53-d4b99770528e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:18:47.102041 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1740b9d4-03c7-4421-ac53-d4b99770528e None admin] REQUEST_METHOD: `GET` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:18:47.102326 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1740b9d4-03c7-4421-ac53-d4b99770528e None admin] SCRIPT_NAME: `/identity` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:18:47.102606 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1740b9d4-03c7-4421-ac53-d4b99770528e None admin] PATH_INFO: `/v3/projects/ef022c0e613d4a2bac6fe1e0e339b92c` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:18:47.103882 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1740b9d4-03c7-4421-ac53-d4b99770528e None admin] RBAC: Authorizing `identity:get_project(project_id=ef022c0e613d4a2bac6fe1e0e339b92c)` {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:18:47.106266 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1740b9d4-03c7-4421-ac53-d4b99770528e None admin] RBAC: Authorization granted {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:18:47.108747 dv-cinder-851351-1-smb devstack@keystone.service[479852]: [pid: 479852|app: 0|req: 193/370] 10.222.0.42 () {56 vars in 1186 bytes} [Thu Jul 28 09:18:46 2022] GET /identity/v3/projects/ef022c0e613d4a2bac6fe1e0e339b92c => generated 302 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:18:47.109907 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1740b9d4-03c7-4421-ac53-d4b99770528e None admin] Authenticating user token {{(pid=479852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:18:47.142693 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG dbcounter [-] [479851] Writing DB stats keystone:SELECT=100 {{(pid=479851) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:18:47.153648 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e22bc0-f463-4ef3-a4d4-36c3df97f0c9 None admin] Validating token access rules against request {{(pid=479851) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:18:47.154168 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG dbcounter [-] [479852] Writing DB stats keystone:SELECT=100 {{(pid=479852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:18:47.201442 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3852ad5f-1c09-4794-8a5f-a023ae60036d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479851) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:18:47.202120 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3852ad5f-1c09-4794-8a5f-a023ae60036d None admin] REQUEST_METHOD: `GET` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:18:47.202499 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3852ad5f-1c09-4794-8a5f-a023ae60036d None admin] SCRIPT_NAME: `/identity` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:18:47.202852 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3852ad5f-1c09-4794-8a5f-a023ae60036d None admin] PATH_INFO: `/v3/projects/ef022c0e613d4a2bac6fe1e0e339b92c` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:18:47.204155 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3852ad5f-1c09-4794-8a5f-a023ae60036d None admin] RBAC: Authorizing `identity:get_project(project_id=ef022c0e613d4a2bac6fe1e0e339b92c)` {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:18:47.205737 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3852ad5f-1c09-4794-8a5f-a023ae60036d None admin] RBAC: Authorization granted {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:18:47.207533 dv-cinder-851351-1-smb devstack@keystone.service[479851]: [pid: 479851|app: 0|req: 178/371] 10.222.0.42 () {56 vars in 1186 bytes} [Thu Jul 28 09:18:47 2022] GET /identity/v3/projects/ef022c0e613d4a2bac6fe1e0e339b92c => generated 302 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:18:47.208450 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3852ad5f-1c09-4794-8a5f-a023ae60036d None admin] Authenticating user token {{(pid=479851) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:18:47.255475 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1740b9d4-03c7-4421-ac53-d4b99770528e None admin] Validating token access rules against request {{(pid=479852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:18:47.309451 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dde27e7-4fac-4f21-88b4-8be0fbd5e91d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:18:47.310145 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dde27e7-4fac-4f21-88b4-8be0fbd5e91d None admin] REQUEST_METHOD: `GET` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:18:47.310367 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dde27e7-4fac-4f21-88b4-8be0fbd5e91d None admin] SCRIPT_NAME: `/identity` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:18:47.310643 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dde27e7-4fac-4f21-88b4-8be0fbd5e91d None admin] PATH_INFO: `/v3/roles` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:18:47.311377 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dde27e7-4fac-4f21-88b4-8be0fbd5e91d None admin] RBAC: Adding query filter params (name=admin) {{(pid=479852) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 09:18:47.311708 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dde27e7-4fac-4f21-88b4-8be0fbd5e91d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:18:47.313604 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dde27e7-4fac-4f21-88b4-8be0fbd5e91d None admin] RBAC: Authorization granted {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:18:47.323360 dv-cinder-851351-1-smb devstack@keystone.service[479852]: [pid: 479852|app: 0|req: 194/372] 10.222.0.42 () {56 vars in 1099 bytes} [Thu Jul 28 09:18:47 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:18:47.324030 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dde27e7-4fac-4f21-88b4-8be0fbd5e91d None admin] Authenticating user token {{(pid=479852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:18:47.350673 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3852ad5f-1c09-4794-8a5f-a023ae60036d None admin] Validating token access rules against request {{(pid=479851) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:18:47.402420 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0483f95a-dda1-4bd0-a03d-d9ce0b36d407 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479851) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:18:47.403847 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0483f95a-dda1-4bd0-a03d-d9ce0b36d407 None admin] REQUEST_METHOD: `GET` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:18:47.404195 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0483f95a-dda1-4bd0-a03d-d9ce0b36d407 None admin] SCRIPT_NAME: `/identity` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:18:47.404828 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0483f95a-dda1-4bd0-a03d-d9ce0b36d407 None admin] PATH_INFO: `/v3/groups/10982903b2844ab4bdbbb8dd377d478f` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:18:47.406233 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0483f95a-dda1-4bd0-a03d-d9ce0b36d407 None admin] RBAC: Authorizing `identity:get_group(group_id=10982903b2844ab4bdbbb8dd377d478f)` {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:18:47.408285 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0483f95a-dda1-4bd0-a03d-d9ce0b36d407 None admin] RBAC: Authorization granted {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:18:47.410469 dv-cinder-851351-1-smb devstack@keystone.service[479851]: [pid: 479851|app: 0|req: 179/373] 10.222.0.42 () {56 vars in 1180 bytes} [Thu Jul 28 09:18:47 2022] GET /identity/v3/groups/10982903b2844ab4bdbbb8dd377d478f => generated 226 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:18:47.411260 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0483f95a-dda1-4bd0-a03d-d9ce0b36d407 None admin] Authenticating user token {{(pid=479851) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:18:47.444364 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG dbcounter [-] [479852] Writing DB stats keystone:SELECT=100 {{(pid=479852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:18:47.456927 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG dbcounter [-] [479851] Writing DB stats keystone:SELECT=100 {{(pid=479851) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:18:47.459631 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dde27e7-4fac-4f21-88b4-8be0fbd5e91d None admin] Validating token access rules against request {{(pid=479852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:18:47.517394 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-174307b3-5513-42de-a5c6-54dbe0b52dfd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:18:47.518058 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174307b3-5513-42de-a5c6-54dbe0b52dfd None admin] REQUEST_METHOD: `GET` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:18:47.518336 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174307b3-5513-42de-a5c6-54dbe0b52dfd None admin] SCRIPT_NAME: `/identity` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:18:47.518608 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174307b3-5513-42de-a5c6-54dbe0b52dfd None admin] PATH_INFO: `/v3/groups/10982903b2844ab4bdbbb8dd377d478f` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:18:47.521804 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-174307b3-5513-42de-a5c6-54dbe0b52dfd None admin] RBAC: Authorizing `identity:get_group(group_id=10982903b2844ab4bdbbb8dd377d478f)` {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:18:47.523278 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-174307b3-5513-42de-a5c6-54dbe0b52dfd None admin] RBAC: Authorization granted {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:18:47.525577 dv-cinder-851351-1-smb devstack@keystone.service[479852]: [pid: 479852|app: 0|req: 195/374] 10.222.0.42 () {56 vars in 1180 bytes} [Thu Jul 28 09:18:47 2022] GET /identity/v3/groups/10982903b2844ab4bdbbb8dd377d478f => generated 226 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:18:47.526459 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-174307b3-5513-42de-a5c6-54dbe0b52dfd None admin] Authenticating user token {{(pid=479852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:18:47.555433 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0483f95a-dda1-4bd0-a03d-d9ce0b36d407 None admin] Validating token access rules against request {{(pid=479851) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:18:47.602649 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-902d685a-8238-4a4a-aa7a-239717ded5cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479851) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:18:47.603395 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902d685a-8238-4a4a-aa7a-239717ded5cd None admin] REQUEST_METHOD: `GET` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:18:47.603686 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902d685a-8238-4a4a-aa7a-239717ded5cd None admin] SCRIPT_NAME: `/identity` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:18:47.603968 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902d685a-8238-4a4a-aa7a-239717ded5cd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:18:47.646759 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-174307b3-5513-42de-a5c6-54dbe0b52dfd None admin] Validating token access rules against request {{(pid=479852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:18:47.690808 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0590b0-5c69-463c-90bc-4bf8f57c2fee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:18:47.691999 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0590b0-5c69-463c-90bc-4bf8f57c2fee None admin] REQUEST_METHOD: `GET` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:18:47.692284 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0590b0-5c69-463c-90bc-4bf8f57c2fee None admin] SCRIPT_NAME: `/identity` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:18:47.692557 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0590b0-5c69-463c-90bc-4bf8f57c2fee None admin] PATH_INFO: `/v3/role_assignments` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:18:47.693455 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e0590b0-5c69-463c-90bc-4bf8f57c2fee None admin] RBAC: Adding query filter params (group.id=10982903b2844ab4bdbbb8dd377d478f, role.id=900fb424e172461d93a0db59afb0a12b, scope.project.id=ef022c0e613d4a2bac6fe1e0e339b92c) {{(pid=479852) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 09:18:47.693822 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e0590b0-5c69-463c-90bc-4bf8f57c2fee None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:18:47.695444 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e0590b0-5c69-463c-90bc-4bf8f57c2fee None admin] RBAC: Authorization granted {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:18:47.700472 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-902d685a-8238-4a4a-aa7a-239717ded5cd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:18:47.702350 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-902d685a-8238-4a4a-aa7a-239717ded5cd None admin] RBAC: Authorization granted {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:18:47.702621 dv-cinder-851351-1-smb devstack@keystone.service[479852]: [pid: 479852|app: 0|req: 196/375] 10.222.0.42 () {56 vars in 1376 bytes} [Thu Jul 28 09:18:47 2022] GET /identity/v3/role_assignments?group.id=10982903b2844ab4bdbbb8dd377d478f&scope.project.id=ef022c0e613d4a2bac6fe1e0e339b92c&role.id=900fb424e172461d93a0db59afb0a12b => generated 260 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:18:47.703445 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0590b0-5c69-463c-90bc-4bf8f57c2fee None admin] Authenticating user token {{(pid=479852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:18:47.745569 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG dbcounter [-] [479852] Writing DB stats keystone:SELECT=100 {{(pid=479852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:18:47.752839 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG dbcounter [-] [479851] Writing DB stats keystone:SELECT=100 {{(pid=479851) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:18:47.841228 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0590b0-5c69-463c-90bc-4bf8f57c2fee None admin] Validating token access rules against request {{(pid=479852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:18:47.842471 dv-cinder-851351-1-smb devstack@keystone.service[479851]: [pid: 479851|app: 0|req: 180/376] 10.222.0.42 () {58 vars in 1282 bytes} [Thu Jul 28 09:18:47 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 431 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 28 09:18:47.848304 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2293c6d1-bc0c-4ae0-9abf-04d81658d2d6 None None] REQUEST_METHOD: `GET` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:18:47.848599 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2293c6d1-bc0c-4ae0-9abf-04d81658d2d6 None None] SCRIPT_NAME: `/identity` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:18:47.848911 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2293c6d1-bc0c-4ae0-9abf-04d81658d2d6 None None] PATH_INFO: `/` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:18:47.850740 dv-cinder-851351-1-smb devstack@keystone.service[479851]: [pid: 479851|app: 0|req: 181/377] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 09:18:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 09:18:47.851567 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2293c6d1-bc0c-4ae0-9abf-04d81658d2d6 None None] Authenticating user token {{(pid=479851) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:18:47.881860 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e352284-b2c8-4983-a607-87eae51575bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:18:47.882500 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e352284-b2c8-4983-a607-87eae51575bf None admin] REQUEST_METHOD: `GET` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:18:47.882780 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e352284-b2c8-4983-a607-87eae51575bf None admin] SCRIPT_NAME: `/identity` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:18:47.883156 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e352284-b2c8-4983-a607-87eae51575bf None admin] PATH_INFO: `/v3/role_assignments` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:18:47.884057 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e352284-b2c8-4983-a607-87eae51575bf None admin] RBAC: Adding query filter params (group.id=10982903b2844ab4bdbbb8dd377d478f, role.id=acf1d2de5e5448beb6363dae3d154a02, scope.project.id=ef022c0e613d4a2bac6fe1e0e339b92c) {{(pid=479852) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 09:18:47.884369 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e352284-b2c8-4983-a607-87eae51575bf None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:18:47.885884 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e352284-b2c8-4983-a607-87eae51575bf None admin] RBAC: Authorization granted {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:18:47.898497 dv-cinder-851351-1-smb devstack@keystone.service[479852]: [pid: 479852|app: 0|req: 197/378] 10.222.0.42 () {56 vars in 1376 bytes} [Thu Jul 28 09:18:47 2022] GET /identity/v3/role_assignments?group.id=10982903b2844ab4bdbbb8dd377d478f&scope.project.id=ef022c0e613d4a2bac6fe1e0e339b92c&role.id=acf1d2de5e5448beb6363dae3d154a02 => generated 260 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:18:47.900053 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05471618-6a8a-4494-9dff-42d57b085bd6 None None] REQUEST_METHOD: `POST` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:18:47.900339 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05471618-6a8a-4494-9dff-42d57b085bd6 None None] SCRIPT_NAME: `/identity` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:18:47.900615 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05471618-6a8a-4494-9dff-42d57b085bd6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:18:47.941954 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.auth.core [None req-05471618-6a8a-4494-9dff-42d57b085bd6 None None] MFA Rules not processed for user `c198f91a4ae84d2b9cc730a6e304c2be`. Rule list: `[]` (Enabled: `True`). {{(pid=479852) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 09:18:47.944151 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.fernet_utils [None req-05471618-6a8a-4494-9dff-42d57b085bd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=479852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 09:18:47.972044 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2293c6d1-bc0c-4ae0-9abf-04d81658d2d6 None None] Validating token access rules against request {{(pid=479851) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:18:48.011213 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG dbcounter [-] [479851] Writing DB stats keystone:SELECT=100 {{(pid=479851) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:18:48.022182 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee86ea65-5c04-4514-9292-2be195a68c1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479851) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:18:48.023172 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee86ea65-5c04-4514-9292-2be195a68c1a None admin] REQUEST_METHOD: `GET` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:18:48.023470 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee86ea65-5c04-4514-9292-2be195a68c1a None admin] SCRIPT_NAME: `/identity` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:18:48.023757 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee86ea65-5c04-4514-9292-2be195a68c1a None admin] PATH_INFO: `/v3/projects/5cd1eb20d96b430f96760c31423a47ce` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:18:48.025131 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee86ea65-5c04-4514-9292-2be195a68c1a None admin] RBAC: Authorizing `identity:get_project(project_id=5cd1eb20d96b430f96760c31423a47ce)` {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:18:48.026785 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee86ea65-5c04-4514-9292-2be195a68c1a None admin] RBAC: Authorization granted {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:18:48.033407 dv-cinder-851351-1-smb devstack@keystone.service[479851]: [pid: 479851|app: 0|req: 182/379] 10.222.0.42 () {56 vars in 1186 bytes} [Thu Jul 28 09:18:47 2022] GET /identity/v3/projects/5cd1eb20d96b430f96760c31423a47ce => generated 344 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:18:48.035217 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee86ea65-5c04-4514-9292-2be195a68c1a None admin] Authenticating user token {{(pid=479851) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:18:48.062493 dv-cinder-851351-1-smb devstack@keystone.service[479852]: [pid: 479852|app: 0|req: 198/380] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 09:18:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 09:18:48.098017 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05471618-6a8a-4494-9dff-42d57b085bd6 None None] Authenticating user token {{(pid=479852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:18:48.129050 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG dbcounter [-] [479852] Writing DB stats keystone:SELECT=100 {{(pid=479852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:18:48.157857 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee86ea65-5c04-4514-9292-2be195a68c1a None admin] Validating token access rules against request {{(pid=479851) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:18:48.199483 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6cce99-100b-49b2-b594-99aa911d405c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479851) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:18:48.200219 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6cce99-100b-49b2-b594-99aa911d405c None admin] REQUEST_METHOD: `GET` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:18:48.200517 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6cce99-100b-49b2-b594-99aa911d405c None admin] SCRIPT_NAME: `/identity` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:18:48.200863 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6cce99-100b-49b2-b594-99aa911d405c None admin] PATH_INFO: `/v3/groups/d6c4acea956a415795de5da3a5962b6b` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:18:48.212705 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b6cce99-100b-49b2-b594-99aa911d405c None admin] RBAC: Authorizing `identity:get_group(group_id=d6c4acea956a415795de5da3a5962b6b)` {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:18:48.212705 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b6cce99-100b-49b2-b594-99aa911d405c None admin] RBAC: Authorization granted {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:18:48.212705 dv-cinder-851351-1-smb devstack@keystone.service[479851]: [pid: 479851|app: 0|req: 183/381] 10.222.0.42 () {56 vars in 1180 bytes} [Thu Jul 28 09:18:48 2022] GET /identity/v3/groups/d6c4acea956a415795de5da3a5962b6b => generated 229 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:18:48.218108 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6cce99-100b-49b2-b594-99aa911d405c None admin] Authenticating user token {{(pid=479851) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:18:48.277297 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05471618-6a8a-4494-9dff-42d57b085bd6 None None] Validating token access rules against request {{(pid=479852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:18:48.285732 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG dbcounter [-] [479851] Writing DB stats keystone:SELECT=100 {{(pid=479851) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:18:48.346155 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6cce99-100b-49b2-b594-99aa911d405c None admin] Validating token access rules against request {{(pid=479851) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:18:48.359766 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f06fff-172c-498d-90cf-eb535c986fe6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:18:48.360474 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f06fff-172c-498d-90cf-eb535c986fe6 None admin] REQUEST_METHOD: `GET` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:18:48.360724 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f06fff-172c-498d-90cf-eb535c986fe6 None admin] SCRIPT_NAME: `/identity` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:18:48.361012 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f06fff-172c-498d-90cf-eb535c986fe6 None admin] PATH_INFO: `/v3/roles/member` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:18:48.372383 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6f06fff-172c-498d-90cf-eb535c986fe6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 09:18:48.377633 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application [None req-f6f06fff-172c-498d-90cf-eb535c986fe6 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 28 09:18:48.377633 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 09:18:48.377633 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 09:18:48.377633 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 09:18:48.377633 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 09:18:48.377633 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 09:18:48.377633 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 09:18:48.377633 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 09:18:48.377633 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 09:18:48.377633 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 09:18:48.377633 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 09:18:48.377633 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 09:18:48.377633 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 09:18:48.377633 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 09:18:48.377633 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 09:18:48.377633 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 09:18:48.378739 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 09:18:48.378739 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 09:18:48.378739 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 09:18:48.378739 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 09:18:48.378739 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 09:18:48.378739 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 09:18:48.378739 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 09:18:48.378739 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 09:18:48.378739 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 09:18:48.378739 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 09:18:48.378739 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 09:18:48.378739 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application with Lock( Jul 28 09:18:48.378739 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 09:18:48.378739 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self._enter() Jul 28 09:18:48.378739 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 09:18:48.378739 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 09:18:48.379700 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 09:18:48.379700 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self.creator() Jul 28 09:18:48.379700 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 09:18:48.379700 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application created_value = creator( Jul 28 09:18:48.379700 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 09:18:48.379700 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 09:18:48.379700 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 09:18:48.379700 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 09:18:48.379700 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 09:18:48.379700 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 09:18:48.379700 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 28 09:18:48.379700 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application Jul 28 09:18:48.379700 dv-cinder-851351-1-smb devstack@keystone.service[479852]: [pid: 479852|app: 0|req: 199/382] 10.222.0.42 () {56 vars in 1099 bytes} [Thu Jul 28 09:18:48 2022] GET /identity/v3/roles/member => generated 84 bytes in 282 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 09:18:48.398019 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f06fff-172c-498d-90cf-eb535c986fe6 None admin] Authenticating user token {{(pid=479852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:18:48.403904 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-244768a1-00a5-48ed-a6be-3df6d053d1a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479851) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:18:48.404594 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244768a1-00a5-48ed-a6be-3df6d053d1a1 None admin] REQUEST_METHOD: `GET` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:18:48.405003 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244768a1-00a5-48ed-a6be-3df6d053d1a1 None admin] SCRIPT_NAME: `/identity` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:18:48.405369 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244768a1-00a5-48ed-a6be-3df6d053d1a1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:18:48.406276 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-244768a1-00a5-48ed-a6be-3df6d053d1a1 None admin] RBAC: Adding query filter params (group.id=d6c4acea956a415795de5da3a5962b6b, role.id=685084310b35477b9b2d0c7934d0f803, scope.project.id=5cd1eb20d96b430f96760c31423a47ce) {{(pid=479851) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 09:18:48.406685 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-244768a1-00a5-48ed-a6be-3df6d053d1a1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:18:48.408258 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-244768a1-00a5-48ed-a6be-3df6d053d1a1 None admin] RBAC: Authorization granted {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:18:48.416715 dv-cinder-851351-1-smb devstack@keystone.service[479851]: [pid: 479851|app: 0|req: 184/383] 10.222.0.42 () {56 vars in 1376 bytes} [Thu Jul 28 09:18:48 2022] GET /identity/v3/role_assignments?group.id=d6c4acea956a415795de5da3a5962b6b&scope.project.id=5cd1eb20d96b430f96760c31423a47ce&role.id=685084310b35477b9b2d0c7934d0f803 => generated 260 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:18:48.552303 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG dbcounter [-] [479852] Writing DB stats keystone:SELECT=100 {{(pid=479852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:18:48.577687 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f06fff-172c-498d-90cf-eb535c986fe6 None admin] Validating token access rules against request {{(pid=479852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:18:48.619795 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b8cc201-5029-4def-a2a8-f278e23e487f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:18:48.620751 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8cc201-5029-4def-a2a8-f278e23e487f None admin] REQUEST_METHOD: `GET` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:18:48.621388 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8cc201-5029-4def-a2a8-f278e23e487f None admin] SCRIPT_NAME: `/identity` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:18:48.621866 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8cc201-5029-4def-a2a8-f278e23e487f None admin] PATH_INFO: `/v3/roles` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:18:48.622745 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b8cc201-5029-4def-a2a8-f278e23e487f None admin] RBAC: Adding query filter params (name=member) {{(pid=479852) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 09:18:48.623215 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b8cc201-5029-4def-a2a8-f278e23e487f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:18:48.624791 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b8cc201-5029-4def-a2a8-f278e23e487f None admin] RBAC: Authorization granted {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:18:48.635627 dv-cinder-851351-1-smb devstack@keystone.service[479852]: [pid: 479852|app: 0|req: 200/384] 10.222.0.42 () {56 vars in 1101 bytes} [Thu Jul 28 09:18:48 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:18:48.646307 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-244768a1-00a5-48ed-a6be-3df6d053d1a1 None admin] Authenticating user token {{(pid=479851) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:18:48.781072 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-244768a1-00a5-48ed-a6be-3df6d053d1a1 None admin] Validating token access rules against request {{(pid=479851) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:18:48.820707 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG dbcounter [-] [479851] Writing DB stats keystone:SELECT=100 {{(pid=479851) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:18:48.838333 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2548021-eda0-401c-b6d8-3400a9cea8de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479851) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:18:48.839028 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2548021-eda0-401c-b6d8-3400a9cea8de None admin] REQUEST_METHOD: `GET` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:18:48.839319 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2548021-eda0-401c-b6d8-3400a9cea8de None admin] SCRIPT_NAME: `/identity` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:18:48.839643 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2548021-eda0-401c-b6d8-3400a9cea8de None admin] PATH_INFO: `/v3/groups/10982903b2844ab4bdbbb8dd377d478f` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:18:48.840893 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2548021-eda0-401c-b6d8-3400a9cea8de None admin] RBAC: Authorizing `identity:get_group(group_id=10982903b2844ab4bdbbb8dd377d478f)` {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:18:48.842374 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2548021-eda0-401c-b6d8-3400a9cea8de None admin] RBAC: Authorization granted {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:18:48.844419 dv-cinder-851351-1-smb devstack@keystone.service[479851]: [pid: 479851|app: 0|req: 185/385] 10.222.0.42 () {56 vars in 1180 bytes} [Thu Jul 28 09:18:48 2022] GET /identity/v3/groups/10982903b2844ab4bdbbb8dd377d478f => generated 226 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:18:48.849787 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b8cc201-5029-4def-a2a8-f278e23e487f None admin] Authenticating user token {{(pid=479852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:18:48.990975 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b8cc201-5029-4def-a2a8-f278e23e487f None admin] Validating token access rules against request {{(pid=479852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:18:49.040221 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa47953a-9b13-4330-8e83-120a5dafc8fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:18:49.041325 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa47953a-9b13-4330-8e83-120a5dafc8fe None admin] REQUEST_METHOD: `GET` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:18:49.041855 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa47953a-9b13-4330-8e83-120a5dafc8fe None admin] SCRIPT_NAME: `/identity` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:18:49.042382 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa47953a-9b13-4330-8e83-120a5dafc8fe None admin] PATH_INFO: `/v3/projects/580eb2f23f9049b18bb38dce6f6f9b4f` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:18:49.043815 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa47953a-9b13-4330-8e83-120a5dafc8fe None admin] RBAC: Authorizing `identity:get_project(project_id=580eb2f23f9049b18bb38dce6f6f9b4f)` {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:18:49.045510 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa47953a-9b13-4330-8e83-120a5dafc8fe None admin] RBAC: Authorization granted {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:18:49.047498 dv-cinder-851351-1-smb devstack@keystone.service[479852]: [pid: 479852|app: 0|req: 201/386] 10.222.0.42 () {56 vars in 1186 bytes} [Thu Jul 28 09:18:48 2022] GET /identity/v3/projects/580eb2f23f9049b18bb38dce6f6f9b4f => generated 298 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:18:49.053489 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2548021-eda0-401c-b6d8-3400a9cea8de None admin] Authenticating user token {{(pid=479851) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:18:49.200486 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2548021-eda0-401c-b6d8-3400a9cea8de None admin] Validating token access rules against request {{(pid=479851) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:18:49.250654 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7de858b-32ad-47a7-992a-0602776acec0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479851) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:18:49.251375 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7de858b-32ad-47a7-992a-0602776acec0 None admin] REQUEST_METHOD: `PUT` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:18:49.251657 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7de858b-32ad-47a7-992a-0602776acec0 None admin] SCRIPT_NAME: `/identity` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:18:49.251935 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7de858b-32ad-47a7-992a-0602776acec0 None admin] PATH_INFO: `/v3/projects/580eb2f23f9049b18bb38dce6f6f9b4f/groups/10982903b2844ab4bdbbb8dd377d478f/roles/900fb424e172461d93a0db59afb0a12b` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:18:49.258056 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7de858b-32ad-47a7-992a-0602776acec0 None admin] RBAC: Authorizing `identity:create_grant(project_id=580eb2f23f9049b18bb38dce6f6f9b4f, group_id=10982903b2844ab4bdbbb8dd377d478f, role_id=900fb424e172461d93a0db59afb0a12b)` {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:18:49.259561 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7de858b-32ad-47a7-992a-0602776acec0 None admin] RBAC: Authorization granted {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:18:49.283884 dv-cinder-851351-1-smb devstack@keystone.service[479851]: [pid: 479851|app: 0|req: 186/387] 10.222.0.42 () {58 vars in 1442 bytes} [Thu Jul 28 09:18:49 2022] PUT /identity/v3/projects/580eb2f23f9049b18bb38dce6f6f9b4f/groups/10982903b2844ab4bdbbb8dd377d478f/roles/900fb424e172461d93a0db59afb0a12b => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 09:18:49.652338 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3bc0a31-cc53-4d71-9b92-1e160cc715b2 None None] REQUEST_METHOD: `GET` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:18:49.652979 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3bc0a31-cc53-4d71-9b92-1e160cc715b2 None None] SCRIPT_NAME: `/identity` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:18:49.652979 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3bc0a31-cc53-4d71-9b92-1e160cc715b2 None None] PATH_INFO: `/` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:18:49.654493 dv-cinder-851351-1-smb devstack@keystone.service[479852]: [pid: 479852|app: 0|req: 202/388] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 09:18:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 09:18:49.660086 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2c6953-fc0d-4e11-b87d-2e65a164cbca None None] REQUEST_METHOD: `POST` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:18:49.660955 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2c6953-fc0d-4e11-b87d-2e65a164cbca None None] SCRIPT_NAME: `/identity` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:18:49.661646 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2c6953-fc0d-4e11-b87d-2e65a164cbca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:18:49.681774 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.auth.core [None req-0d2c6953-fc0d-4e11-b87d-2e65a164cbca None None] MFA Rules not processed for user `c198f91a4ae84d2b9cc730a6e304c2be`. Rule list: `[]` (Enabled: `True`). {{(pid=479851) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 09:18:49.683448 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.fernet_utils [None req-0d2c6953-fc0d-4e11-b87d-2e65a164cbca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=479851) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 09:18:49.736469 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG dbcounter [-] [479851] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=479851) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:18:49.762153 dv-cinder-851351-1-smb devstack@keystone.service[479851]: [pid: 479851|app: 0|req: 187/389] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 09:18:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 28 09:18:49.796652 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3bc0a31-cc53-4d71-9b92-1e160cc715b2 None None] Authenticating user token {{(pid=479852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:18:49.812706 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG dbcounter [-] [479852] Writing DB stats keystone:SELECT=100 {{(pid=479852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:18:49.942642 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3bc0a31-cc53-4d71-9b92-1e160cc715b2 None None] Validating token access rules against request {{(pid=479852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:18:49.986801 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9b0836-dffd-4c12-bf80-d11003a8e35e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:18:49.987888 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9b0836-dffd-4c12-bf80-d11003a8e35e None admin] REQUEST_METHOD: `GET` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:18:49.988392 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9b0836-dffd-4c12-bf80-d11003a8e35e None admin] SCRIPT_NAME: `/identity` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:18:49.988946 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9b0836-dffd-4c12-bf80-d11003a8e35e None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:18:50.005442 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d9b0836-dffd-4c12-bf80-d11003a8e35e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 09:18:50.011637 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application [None req-2d9b0836-dffd-4c12-bf80-d11003a8e35e None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 28 09:18:50.011637 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 09:18:50.011637 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 09:18:50.011637 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 09:18:50.011637 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 09:18:50.011637 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 09:18:50.011637 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 09:18:50.011637 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 09:18:50.011637 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 09:18:50.011637 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 09:18:50.011637 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 09:18:50.011637 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 09:18:50.011637 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 09:18:50.011637 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 09:18:50.011637 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 09:18:50.011637 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 09:18:50.012787 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 09:18:50.012787 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 09:18:50.012787 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 09:18:50.012787 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 09:18:50.012787 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 09:18:50.012787 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 09:18:50.012787 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 09:18:50.012787 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 09:18:50.012787 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 09:18:50.012787 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 09:18:50.012787 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 09:18:50.012787 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application with Lock( Jul 28 09:18:50.012787 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 09:18:50.012787 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self._enter() Jul 28 09:18:50.012787 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 09:18:50.012787 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 09:18:50.013751 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 09:18:50.013751 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self.creator() Jul 28 09:18:50.013751 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 09:18:50.013751 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application created_value = creator( Jul 28 09:18:50.013751 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 09:18:50.013751 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 09:18:50.013751 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 09:18:50.013751 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 09:18:50.013751 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 09:18:50.013751 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 09:18:50.013751 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 28 09:18:50.013751 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application Jul 28 09:18:50.016381 dv-cinder-851351-1-smb devstack@keystone.service[479852]: [pid: 479852|app: 0|req: 203/390] 10.222.0.42 () {56 vars in 1114 bytes} [Thu Jul 28 09:18:49 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 09:18:50.022875 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d2c6953-fc0d-4e11-b87d-2e65a164cbca None None] Authenticating user token {{(pid=479851) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:18:50.133953 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d2c6953-fc0d-4e11-b87d-2e65a164cbca None None] Validating token access rules against request {{(pid=479851) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:18:50.171019 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b62791-80d4-4c0a-8ad1-d45cb4dec5e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479851) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:18:50.172058 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b62791-80d4-4c0a-8ad1-d45cb4dec5e2 None admin] REQUEST_METHOD: `GET` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:18:50.172551 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b62791-80d4-4c0a-8ad1-d45cb4dec5e2 None admin] SCRIPT_NAME: `/identity` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:18:50.173093 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b62791-80d4-4c0a-8ad1-d45cb4dec5e2 None admin] PATH_INFO: `/v3/roles` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:18:50.174040 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42b62791-80d4-4c0a-8ad1-d45cb4dec5e2 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=479851) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 09:18:50.174571 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42b62791-80d4-4c0a-8ad1-d45cb4dec5e2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:18:50.176198 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42b62791-80d4-4c0a-8ad1-d45cb4dec5e2 None admin] RBAC: Authorization granted {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:18:50.186229 dv-cinder-851351-1-smb devstack@keystone.service[479851]: [pid: 479851|app: 0|req: 188/391] 10.222.0.42 () {56 vars in 1111 bytes} [Thu Jul 28 09:18:50 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:18:50.194201 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9b0836-dffd-4c12-bf80-d11003a8e35e None admin] Authenticating user token {{(pid=479852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:18:50.247523 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0a452a-0bd0-43f9-b6d3-f5110de0f803 None None] REQUEST_METHOD: `GET` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:18:50.248186 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0a452a-0bd0-43f9-b6d3-f5110de0f803 None None] SCRIPT_NAME: `/identity` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:18:50.248689 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0a452a-0bd0-43f9-b6d3-f5110de0f803 None None] PATH_INFO: `/` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:18:50.250268 dv-cinder-851351-1-smb devstack@keystone.service[479851]: [pid: 479851|app: 0|req: 189/392] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 09:18:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 09:18:50.256451 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61640956-6a03-4b4b-8113-2a72168a99e2 None None] REQUEST_METHOD: `POST` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:18:50.257108 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61640956-6a03-4b4b-8113-2a72168a99e2 None None] SCRIPT_NAME: `/identity` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:18:50.257589 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61640956-6a03-4b4b-8113-2a72168a99e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:18:50.277502 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.auth.core [None req-61640956-6a03-4b4b-8113-2a72168a99e2 None None] MFA Rules not processed for user `c198f91a4ae84d2b9cc730a6e304c2be`. Rule list: `[]` (Enabled: `True`). {{(pid=479851) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 09:18:50.279162 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.fernet_utils [None req-61640956-6a03-4b4b-8113-2a72168a99e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=479851) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 09:18:50.309064 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG dbcounter [-] [479852] Writing DB stats keystone:SELECT=100 {{(pid=479852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:18:50.329070 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG dbcounter [-] [479851] Writing DB stats keystone:SELECT=100 {{(pid=479851) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:18:50.329666 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9b0836-dffd-4c12-bf80-d11003a8e35e None admin] Validating token access rules against request {{(pid=479852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:18:50.367876 dv-cinder-851351-1-smb devstack@keystone.service[479851]: [pid: 479851|app: 0|req: 190/393] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 09:18:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 28 09:18:50.368509 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007f76b1-f4c5-4c5d-84c6-d858be2b9c27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:18:50.369283 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007f76b1-f4c5-4c5d-84c6-d858be2b9c27 None admin] REQUEST_METHOD: `GET` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:18:50.369576 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007f76b1-f4c5-4c5d-84c6-d858be2b9c27 None admin] SCRIPT_NAME: `/identity` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:18:50.369859 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007f76b1-f4c5-4c5d-84c6-d858be2b9c27 None admin] PATH_INFO: `/v3/groups/10982903b2844ab4bdbbb8dd377d478f` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:18:50.370543 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba1ffd8-e521-4cbe-93bf-1d0f88a534e8 None None] REQUEST_METHOD: `GET` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:18:50.371043 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba1ffd8-e521-4cbe-93bf-1d0f88a534e8 None None] SCRIPT_NAME: `/identity` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:18:50.371549 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba1ffd8-e521-4cbe-93bf-1d0f88a534e8 None None] PATH_INFO: `/` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:18:50.373477 dv-cinder-851351-1-smb devstack@keystone.service[479851]: [pid: 479851|app: 0|req: 191/394] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 09:18:50 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 09:18:50.383487 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1061df-3454-4b81-9407-d4709730013c None None] REQUEST_METHOD: `POST` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:18:50.383487 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1061df-3454-4b81-9407-d4709730013c None None] SCRIPT_NAME: `/identity` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:18:50.383487 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1061df-3454-4b81-9407-d4709730013c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:18:50.386449 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-007f76b1-f4c5-4c5d-84c6-d858be2b9c27 None admin] RBAC: Authorizing `identity:get_group(group_id=10982903b2844ab4bdbbb8dd377d478f)` {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:18:50.388243 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-007f76b1-f4c5-4c5d-84c6-d858be2b9c27 None admin] RBAC: Authorization granted {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:18:50.390257 dv-cinder-851351-1-smb devstack@keystone.service[479852]: [pid: 479852|app: 0|req: 204/395] 10.222.0.42 () {56 vars in 1180 bytes} [Thu Jul 28 09:18:50 2022] GET /identity/v3/groups/10982903b2844ab4bdbbb8dd377d478f => generated 226 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:18:50.395668 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007f76b1-f4c5-4c5d-84c6-d858be2b9c27 None admin] Authenticating user token {{(pid=479852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:18:50.413622 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.auth.core [None req-1c1061df-3454-4b81-9407-d4709730013c None None] MFA Rules not processed for user `c198f91a4ae84d2b9cc730a6e304c2be`. Rule list: `[]` (Enabled: `True`). {{(pid=479851) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 09:18:50.415212 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.fernet_utils [None req-1c1061df-3454-4b81-9407-d4709730013c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=479851) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 09:18:50.504791 dv-cinder-851351-1-smb devstack@keystone.service[479851]: [pid: 479851|app: 0|req: 192/396] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 09:18:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 09:18:50.505926 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c1061df-3454-4b81-9407-d4709730013c None None] Authenticating user token {{(pid=479851) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:18:50.517245 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007f76b1-f4c5-4c5d-84c6-d858be2b9c27 None admin] Validating token access rules against request {{(pid=479852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:18:50.568194 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-349d7855-abfd-4846-813b-8a59fb4e7189 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:18:50.569027 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349d7855-abfd-4846-813b-8a59fb4e7189 None admin] REQUEST_METHOD: `GET` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:18:50.569531 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349d7855-abfd-4846-813b-8a59fb4e7189 None admin] SCRIPT_NAME: `/identity` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:18:50.569921 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349d7855-abfd-4846-813b-8a59fb4e7189 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:18:50.572985 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG dbcounter [-] [479852] Writing DB stats keystone:SELECT=100 {{(pid=479852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:18:50.587674 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-349d7855-abfd-4846-813b-8a59fb4e7189 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 09:18:50.595926 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application [None req-349d7855-abfd-4846-813b-8a59fb4e7189 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 28 09:18:50.595926 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 09:18:50.595926 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 09:18:50.595926 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 09:18:50.595926 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 09:18:50.595926 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 09:18:50.595926 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 09:18:50.595926 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 09:18:50.595926 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 09:18:50.595926 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 09:18:50.595926 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 09:18:50.595926 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 09:18:50.595926 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 09:18:50.595926 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 09:18:50.595926 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 09:18:50.595926 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 09:18:50.597167 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 09:18:50.597167 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 09:18:50.597167 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 09:18:50.597167 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 09:18:50.597167 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 09:18:50.597167 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 09:18:50.597167 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 09:18:50.597167 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 09:18:50.597167 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 09:18:50.597167 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 09:18:50.597167 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 09:18:50.597167 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application with Lock( Jul 28 09:18:50.597167 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 09:18:50.597167 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self._enter() Jul 28 09:18:50.597167 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 09:18:50.597167 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 09:18:50.598162 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 09:18:50.598162 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self.creator() Jul 28 09:18:50.598162 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 09:18:50.598162 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application created_value = creator( Jul 28 09:18:50.598162 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 09:18:50.598162 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 09:18:50.598162 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 09:18:50.598162 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 09:18:50.598162 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 09:18:50.598162 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 09:18:50.598162 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 28 09:18:50.598162 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application Jul 28 09:18:50.601720 dv-cinder-851351-1-smb devstack@keystone.service[479852]: [pid: 479852|app: 0|req: 205/397] 10.222.0.42 () {56 vars in 1114 bytes} [Thu Jul 28 09:18:50 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 09:18:50.603317 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-349d7855-abfd-4846-813b-8a59fb4e7189 None admin] Authenticating user token {{(pid=479852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:18:50.636746 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c1061df-3454-4b81-9407-d4709730013c None None] Validating token access rules against request {{(pid=479851) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:18:50.639966 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG dbcounter [-] [479851] Writing DB stats keystone:SELECT=100 {{(pid=479851) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:18:50.676043 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2685c991-88d3-4ea2-a2a2-63b486ea89be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479851) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:18:50.677559 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2685c991-88d3-4ea2-a2a2-63b486ea89be None admin] REQUEST_METHOD: `GET` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:18:50.678166 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2685c991-88d3-4ea2-a2a2-63b486ea89be None admin] SCRIPT_NAME: `/identity` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:18:50.678720 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2685c991-88d3-4ea2-a2a2-63b486ea89be None admin] PATH_INFO: `/v3/projects/580eb2f23f9049b18bb38dce6f6f9b4f` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:18:50.680312 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2685c991-88d3-4ea2-a2a2-63b486ea89be None admin] RBAC: Authorizing `identity:get_project(project_id=580eb2f23f9049b18bb38dce6f6f9b4f)` {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:18:50.682057 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2685c991-88d3-4ea2-a2a2-63b486ea89be None admin] RBAC: Authorization granted {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:18:50.684429 dv-cinder-851351-1-smb devstack@keystone.service[479851]: [pid: 479851|app: 0|req: 193/398] 10.222.0.42 () {56 vars in 1186 bytes} [Thu Jul 28 09:18:50 2022] GET /identity/v3/projects/580eb2f23f9049b18bb38dce6f6f9b4f => generated 298 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:18:50.685744 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2685c991-88d3-4ea2-a2a2-63b486ea89be None admin] Authenticating user token {{(pid=479851) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:18:50.716180 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-349d7855-abfd-4846-813b-8a59fb4e7189 None admin] Validating token access rules against request {{(pid=479852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:18:50.752425 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a9a8bd3-ae2d-4df3-8df4-766185876ae5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:18:50.753190 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9a8bd3-ae2d-4df3-8df4-766185876ae5 None admin] REQUEST_METHOD: `GET` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:18:50.753435 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9a8bd3-ae2d-4df3-8df4-766185876ae5 None admin] SCRIPT_NAME: `/identity` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:18:50.753715 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9a8bd3-ae2d-4df3-8df4-766185876ae5 None admin] PATH_INFO: `/v3/roles/member` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:18:50.765265 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a9a8bd3-ae2d-4df3-8df4-766185876ae5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 09:18:50.770875 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application [None req-3a9a8bd3-ae2d-4df3-8df4-766185876ae5 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 28 09:18:50.770875 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 09:18:50.770875 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 09:18:50.770875 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 09:18:50.770875 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 09:18:50.770875 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 09:18:50.770875 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 09:18:50.770875 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 09:18:50.770875 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 09:18:50.770875 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 09:18:50.770875 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 09:18:50.770875 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 09:18:50.770875 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 09:18:50.770875 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 09:18:50.770875 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 09:18:50.770875 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 09:18:50.772130 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 09:18:50.772130 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 09:18:50.772130 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 09:18:50.772130 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 09:18:50.772130 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 09:18:50.772130 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 09:18:50.772130 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 09:18:50.772130 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 09:18:50.772130 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 09:18:50.772130 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 09:18:50.772130 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 09:18:50.772130 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application with Lock( Jul 28 09:18:50.772130 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 09:18:50.772130 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self._enter() Jul 28 09:18:50.772130 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 09:18:50.772130 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 09:18:50.773112 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 09:18:50.773112 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self.creator() Jul 28 09:18:50.773112 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 09:18:50.773112 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application created_value = creator( Jul 28 09:18:50.773112 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 09:18:50.773112 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 09:18:50.773112 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 09:18:50.773112 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 09:18:50.773112 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 09:18:50.773112 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 09:18:50.773112 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 28 09:18:50.773112 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application Jul 28 09:18:50.773112 dv-cinder-851351-1-smb devstack@keystone.service[479852]: [pid: 479852|app: 0|req: 206/399] 10.222.0.42 () {56 vars in 1099 bytes} [Thu Jul 28 09:18:50 2022] GET /identity/v3/roles/member => generated 84 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 09:18:50.773900 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a9a8bd3-ae2d-4df3-8df4-766185876ae5 None admin] Authenticating user token {{(pid=479852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:18:50.801189 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2685c991-88d3-4ea2-a2a2-63b486ea89be None admin] Validating token access rules against request {{(pid=479851) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:18:50.833111 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG dbcounter [-] [479852] Writing DB stats keystone:SELECT=100 {{(pid=479852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:18:50.839443 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e3cc15a-9b33-4b41-bf88-c6e9af177e06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479851) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:18:50.840080 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3cc15a-9b33-4b41-bf88-c6e9af177e06 None admin] REQUEST_METHOD: `GET` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:18:50.840355 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3cc15a-9b33-4b41-bf88-c6e9af177e06 None admin] SCRIPT_NAME: `/identity` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:18:50.840643 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3cc15a-9b33-4b41-bf88-c6e9af177e06 None admin] PATH_INFO: `/v3/roles` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:18:50.841390 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e3cc15a-9b33-4b41-bf88-c6e9af177e06 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=479851) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 09:18:50.841712 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e3cc15a-9b33-4b41-bf88-c6e9af177e06 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:18:50.843111 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e3cc15a-9b33-4b41-bf88-c6e9af177e06 None admin] RBAC: Authorization granted {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:18:50.856515 dv-cinder-851351-1-smb devstack@keystone.service[479851]: [pid: 479851|app: 0|req: 194/400] 10.222.0.42 () {56 vars in 1111 bytes} [Thu Jul 28 09:18:50 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:18:50.856515 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6390d69-aedd-4f1d-8155-7c632e10dd8d None None] REQUEST_METHOD: `GET` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:18:50.856515 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6390d69-aedd-4f1d-8155-7c632e10dd8d None None] SCRIPT_NAME: `/identity` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:18:50.856515 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6390d69-aedd-4f1d-8155-7c632e10dd8d None None] PATH_INFO: `/` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:18:50.856515 dv-cinder-851351-1-smb devstack@keystone.service[479851]: [pid: 479851|app: 0|req: 195/401] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 09:18:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 09:18:50.856515 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6390d69-aedd-4f1d-8155-7c632e10dd8d None None] Authenticating user token {{(pid=479851) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:18:50.894166 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a9a8bd3-ae2d-4df3-8df4-766185876ae5 None admin] Validating token access rules against request {{(pid=479852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:18:50.903110 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG dbcounter [-] [479851] Writing DB stats keystone:SELECT=100 {{(pid=479851) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:18:50.937453 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-418e895c-b6eb-427e-9c70-7ade65777f91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:18:50.938151 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418e895c-b6eb-427e-9c70-7ade65777f91 None admin] REQUEST_METHOD: `PUT` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:18:50.938455 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418e895c-b6eb-427e-9c70-7ade65777f91 None admin] SCRIPT_NAME: `/identity` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:18:50.938807 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418e895c-b6eb-427e-9c70-7ade65777f91 None admin] PATH_INFO: `/v3/projects/580eb2f23f9049b18bb38dce6f6f9b4f/groups/10982903b2844ab4bdbbb8dd377d478f/roles/acf1d2de5e5448beb6363dae3d154a02` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:18:50.941188 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-418e895c-b6eb-427e-9c70-7ade65777f91 None admin] RBAC: Authorizing `identity:create_grant(project_id=580eb2f23f9049b18bb38dce6f6f9b4f, group_id=10982903b2844ab4bdbbb8dd377d478f, role_id=acf1d2de5e5448beb6363dae3d154a02)` {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:18:50.943040 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-418e895c-b6eb-427e-9c70-7ade65777f91 None admin] RBAC: Authorization granted {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:18:50.958174 dv-cinder-851351-1-smb devstack@keystone.service[479852]: [pid: 479852|app: 0|req: 207/402] 10.222.0.42 () {58 vars in 1442 bytes} [Thu Jul 28 09:18:50 2022] PUT /identity/v3/projects/580eb2f23f9049b18bb38dce6f6f9b4f/groups/10982903b2844ab4bdbbb8dd377d478f/roles/acf1d2de5e5448beb6363dae3d154a02 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 09:18:50.959226 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-418e895c-b6eb-427e-9c70-7ade65777f91 None admin] Authenticating user token {{(pid=479852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:18:51.003074 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6390d69-aedd-4f1d-8155-7c632e10dd8d None None] Validating token access rules against request {{(pid=479851) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:18:51.047196 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6332d93-8fdf-40d6-b013-56a411fe9548 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479851) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:18:51.048232 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6332d93-8fdf-40d6-b013-56a411fe9548 None admin] REQUEST_METHOD: `GET` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:18:51.048812 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6332d93-8fdf-40d6-b013-56a411fe9548 None admin] SCRIPT_NAME: `/identity` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:18:51.049321 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6332d93-8fdf-40d6-b013-56a411fe9548 None admin] PATH_INFO: `/v3/roles` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:18:51.050348 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6332d93-8fdf-40d6-b013-56a411fe9548 None admin] RBAC: Adding query filter params (name=member) {{(pid=479851) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 09:18:51.050927 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6332d93-8fdf-40d6-b013-56a411fe9548 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:18:51.052811 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6332d93-8fdf-40d6-b013-56a411fe9548 None admin] RBAC: Authorization granted {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:18:51.068768 dv-cinder-851351-1-smb devstack@keystone.service[479851]: [pid: 479851|app: 0|req: 196/403] 10.222.0.42 () {56 vars in 1101 bytes} [Thu Jul 28 09:18:50 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:18:51.070609 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41919772-044b-4fa4-bb6c-6f0a7778762b None None] REQUEST_METHOD: `POST` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:18:51.071127 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41919772-044b-4fa4-bb6c-6f0a7778762b None None] SCRIPT_NAME: `/identity` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:18:51.071959 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41919772-044b-4fa4-bb6c-6f0a7778762b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:18:51.083664 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-418e895c-b6eb-427e-9c70-7ade65777f91 None admin] Validating token access rules against request {{(pid=479852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:18:51.093133 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.auth.core [None req-41919772-044b-4fa4-bb6c-6f0a7778762b None None] MFA Rules not processed for user `c198f91a4ae84d2b9cc730a6e304c2be`. Rule list: `[]` (Enabled: `True`). {{(pid=479851) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 09:18:51.094779 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.fernet_utils [None req-41919772-044b-4fa4-bb6c-6f0a7778762b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=479851) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 09:18:51.100740 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG dbcounter [-] [479852] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=479852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:18:51.127441 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e65ea9-1ef2-4002-8c92-50cc099b8e15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:18:51.128109 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e65ea9-1ef2-4002-8c92-50cc099b8e15 None admin] REQUEST_METHOD: `GET` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:18:51.128423 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e65ea9-1ef2-4002-8c92-50cc099b8e15 None admin] SCRIPT_NAME: `/identity` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:18:51.128693 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e65ea9-1ef2-4002-8c92-50cc099b8e15 None admin] PATH_INFO: `/v3/groups/10982903b2844ab4bdbbb8dd377d478f` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:18:51.130666 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85e65ea9-1ef2-4002-8c92-50cc099b8e15 None admin] RBAC: Authorizing `identity:get_group(group_id=10982903b2844ab4bdbbb8dd377d478f)` {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:18:51.132368 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85e65ea9-1ef2-4002-8c92-50cc099b8e15 None admin] RBAC: Authorization granted {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:18:51.133514 dv-cinder-851351-1-smb devstack@keystone.service[479852]: [pid: 479852|app: 0|req: 208/404] 10.222.0.42 () {56 vars in 1180 bytes} [Thu Jul 28 09:18:50 2022] GET /identity/v3/groups/10982903b2844ab4bdbbb8dd377d478f => generated 226 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:18:51.134218 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e65ea9-1ef2-4002-8c92-50cc099b8e15 None admin] Authenticating user token {{(pid=479852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:18:51.184513 dv-cinder-851351-1-smb devstack@keystone.service[479851]: [pid: 479851|app: 0|req: 197/405] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 09:18:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 09:18:51.186081 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41919772-044b-4fa4-bb6c-6f0a7778762b None None] Authenticating user token {{(pid=479851) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:18:51.231403 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG dbcounter [-] [479851] Writing DB stats keystone:SELECT=100 {{(pid=479851) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:18:51.281463 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e65ea9-1ef2-4002-8c92-50cc099b8e15 None admin] Validating token access rules against request {{(pid=479852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:18:51.323146 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-017bbbcd-7ae0-4eb0-9455-a3929b90aacf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:18:51.324243 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017bbbcd-7ae0-4eb0-9455-a3929b90aacf None admin] REQUEST_METHOD: `GET` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:18:51.324761 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017bbbcd-7ae0-4eb0-9455-a3929b90aacf None admin] SCRIPT_NAME: `/identity` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:18:51.325056 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017bbbcd-7ae0-4eb0-9455-a3929b90aacf None admin] PATH_INFO: `/v3/groups/10982903b2844ab4bdbbb8dd377d478f` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:18:51.326353 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-017bbbcd-7ae0-4eb0-9455-a3929b90aacf None admin] RBAC: Authorizing `identity:get_group(group_id=10982903b2844ab4bdbbb8dd377d478f)` {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:18:51.327822 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-017bbbcd-7ae0-4eb0-9455-a3929b90aacf None admin] RBAC: Authorization granted {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:18:51.334410 dv-cinder-851351-1-smb devstack@keystone.service[479852]: [pid: 479852|app: 0|req: 209/406] 10.222.0.42 () {56 vars in 1180 bytes} [Thu Jul 28 09:18:51 2022] GET /identity/v3/groups/10982903b2844ab4bdbbb8dd377d478f => generated 226 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:18:51.334410 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-017bbbcd-7ae0-4eb0-9455-a3929b90aacf None admin] Authenticating user token {{(pid=479852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:18:51.337410 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41919772-044b-4fa4-bb6c-6f0a7778762b None None] Validating token access rules against request {{(pid=479851) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:18:51.394322 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f94645a-c607-411a-a4eb-653e7cd35cf1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479851) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:18:51.395644 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f94645a-c607-411a-a4eb-653e7cd35cf1 None admin] REQUEST_METHOD: `GET` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:18:51.396145 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f94645a-c607-411a-a4eb-653e7cd35cf1 None admin] SCRIPT_NAME: `/identity` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:18:51.397081 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f94645a-c607-411a-a4eb-653e7cd35cf1 None admin] PATH_INFO: `/v3/projects/ef022c0e613d4a2bac6fe1e0e339b92c` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:18:51.399453 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f94645a-c607-411a-a4eb-653e7cd35cf1 None admin] RBAC: Authorizing `identity:get_project(project_id=ef022c0e613d4a2bac6fe1e0e339b92c)` {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:18:51.401887 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG dbcounter [-] [479852] Writing DB stats keystone:SELECT=100 {{(pid=479852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:18:51.403090 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f94645a-c607-411a-a4eb-653e7cd35cf1 None admin] RBAC: Authorization granted {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:18:51.406440 dv-cinder-851351-1-smb devstack@keystone.service[479851]: [pid: 479851|app: 0|req: 198/407] 10.222.0.42 () {56 vars in 1186 bytes} [Thu Jul 28 09:18:51 2022] GET /identity/v3/projects/ef022c0e613d4a2bac6fe1e0e339b92c => generated 302 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:18:51.408317 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f94645a-c607-411a-a4eb-653e7cd35cf1 None admin] Authenticating user token {{(pid=479851) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:18:51.471907 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-017bbbcd-7ae0-4eb0-9455-a3929b90aacf None admin] Validating token access rules against request {{(pid=479852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:18:51.520327 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13123ec0-c70a-4b4d-b2c7-802ccbbf98d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:18:51.521363 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG dbcounter [-] [479851] Writing DB stats keystone:SELECT=100 {{(pid=479851) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:18:51.522607 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13123ec0-c70a-4b4d-b2c7-802ccbbf98d3 None admin] REQUEST_METHOD: `GET` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:18:51.523095 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13123ec0-c70a-4b4d-b2c7-802ccbbf98d3 None admin] SCRIPT_NAME: `/identity` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:18:51.524044 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13123ec0-c70a-4b4d-b2c7-802ccbbf98d3 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:18:51.531181 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f94645a-c607-411a-a4eb-653e7cd35cf1 None admin] Validating token access rules against request {{(pid=479851) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:18:51.539736 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13123ec0-c70a-4b4d-b2c7-802ccbbf98d3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 09:18:51.547343 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application [None req-13123ec0-c70a-4b4d-b2c7-802ccbbf98d3 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 09:18:51.547343 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 09:18:51.547343 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 09:18:51.547343 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 09:18:51.547343 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 09:18:51.547343 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 09:18:51.547343 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 09:18:51.547343 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 09:18:51.547343 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 09:18:51.547343 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 09:18:51.547343 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 09:18:51.547343 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 09:18:51.547343 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 09:18:51.547343 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 09:18:51.547343 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 09:18:51.547343 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 09:18:51.548427 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 09:18:51.548427 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 09:18:51.548427 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 09:18:51.548427 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 09:18:51.548427 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 09:18:51.548427 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 09:18:51.548427 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 09:18:51.548427 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 09:18:51.548427 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 09:18:51.548427 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 09:18:51.548427 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 09:18:51.548427 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application with Lock( Jul 28 09:18:51.548427 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 09:18:51.548427 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self._enter() Jul 28 09:18:51.548427 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 09:18:51.548427 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 09:18:51.549467 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 09:18:51.549467 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self.creator() Jul 28 09:18:51.549467 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 09:18:51.549467 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application created_value = creator( Jul 28 09:18:51.549467 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 09:18:51.549467 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 09:18:51.549467 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 09:18:51.549467 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 09:18:51.549467 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 09:18:51.549467 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 09:18:51.549467 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 09:18:51.549467 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application Jul 28 09:18:51.555564 dv-cinder-851351-1-smb devstack@keystone.service[479852]: [pid: 479852|app: 0|req: 210/408] 10.222.0.42 () {56 vars in 1096 bytes} [Thu Jul 28 09:18:51 2022] GET /identity/v3/roles/admin => generated 83 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 09:18:51.555564 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13123ec0-c70a-4b4d-b2c7-802ccbbf98d3 None admin] Authenticating user token {{(pid=479852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:18:51.578195 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f994c5f3-4a38-4d6f-9a4f-02b9e974477e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479851) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:18:51.579176 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f994c5f3-4a38-4d6f-9a4f-02b9e974477e None admin] REQUEST_METHOD: `GET` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:18:51.579671 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f994c5f3-4a38-4d6f-9a4f-02b9e974477e None admin] SCRIPT_NAME: `/identity` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:18:51.580205 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f994c5f3-4a38-4d6f-9a4f-02b9e974477e None admin] PATH_INFO: `/v3/projects/ef022c0e613d4a2bac6fe1e0e339b92c` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:18:51.581831 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f994c5f3-4a38-4d6f-9a4f-02b9e974477e None admin] RBAC: Authorizing `identity:get_project(project_id=ef022c0e613d4a2bac6fe1e0e339b92c)` {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:18:51.583685 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f994c5f3-4a38-4d6f-9a4f-02b9e974477e None admin] RBAC: Authorization granted {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:18:51.586218 dv-cinder-851351-1-smb devstack@keystone.service[479851]: [pid: 479851|app: 0|req: 199/409] 10.222.0.42 () {56 vars in 1186 bytes} [Thu Jul 28 09:18:51 2022] GET /identity/v3/projects/ef022c0e613d4a2bac6fe1e0e339b92c => generated 302 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:18:51.587548 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f994c5f3-4a38-4d6f-9a4f-02b9e974477e None admin] Authenticating user token {{(pid=479851) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:18:51.687723 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13123ec0-c70a-4b4d-b2c7-802ccbbf98d3 None admin] Validating token access rules against request {{(pid=479852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:18:51.700724 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f994c5f3-4a38-4d6f-9a4f-02b9e974477e None admin] Validating token access rules against request {{(pid=479851) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:18:51.701297 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG dbcounter [-] [479852] Writing DB stats keystone:SELECT=100 {{(pid=479852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:18:51.733632 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-470dc8e7-a875-445e-83a7-7473cb78ad00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:18:51.734315 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470dc8e7-a875-445e-83a7-7473cb78ad00 None admin] REQUEST_METHOD: `PUT` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:18:51.734597 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470dc8e7-a875-445e-83a7-7473cb78ad00 None admin] SCRIPT_NAME: `/identity` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:18:51.734878 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470dc8e7-a875-445e-83a7-7473cb78ad00 None admin] PATH_INFO: `/v3/projects/ef022c0e613d4a2bac6fe1e0e339b92c/groups/10982903b2844ab4bdbbb8dd377d478f/roles/acf1d2de5e5448beb6363dae3d154a02` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:18:51.737373 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-470dc8e7-a875-445e-83a7-7473cb78ad00 None admin] RBAC: Authorizing `identity:create_grant(project_id=ef022c0e613d4a2bac6fe1e0e339b92c, group_id=10982903b2844ab4bdbbb8dd377d478f, role_id=acf1d2de5e5448beb6363dae3d154a02)` {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:18:51.739157 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-470dc8e7-a875-445e-83a7-7473cb78ad00 None admin] RBAC: Authorization granted {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:18:51.741436 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1beeac6-a12c-4674-a898-eeaca7a35e9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479851) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:18:51.742371 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1beeac6-a12c-4674-a898-eeaca7a35e9c None admin] REQUEST_METHOD: `GET` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:18:51.742886 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1beeac6-a12c-4674-a898-eeaca7a35e9c None admin] SCRIPT_NAME: `/identity` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:18:51.743747 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1beeac6-a12c-4674-a898-eeaca7a35e9c None admin] PATH_INFO: `/v3/roles` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:18:51.744978 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1beeac6-a12c-4674-a898-eeaca7a35e9c None admin] RBAC: Adding query filter params (name=admin) {{(pid=479851) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 09:18:51.745322 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1beeac6-a12c-4674-a898-eeaca7a35e9c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:18:51.746839 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1beeac6-a12c-4674-a898-eeaca7a35e9c None admin] RBAC: Authorization granted {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:18:51.760850 dv-cinder-851351-1-smb devstack@keystone.service[479851]: [pid: 479851|app: 0|req: 200/410] 10.222.0.42 () {56 vars in 1099 bytes} [Thu Jul 28 09:18:51 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:18:51.760850 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1beeac6-a12c-4674-a898-eeaca7a35e9c None admin] Authenticating user token {{(pid=479851) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:18:51.761658 dv-cinder-851351-1-smb devstack@keystone.service[479852]: [pid: 479852|app: 0|req: 211/411] 10.222.0.42 () {58 vars in 1442 bytes} [Thu Jul 28 09:18:51 2022] PUT /identity/v3/projects/ef022c0e613d4a2bac6fe1e0e339b92c/groups/10982903b2844ab4bdbbb8dd377d478f/roles/acf1d2de5e5448beb6363dae3d154a02 => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 09:18:51.765071 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-470dc8e7-a875-445e-83a7-7473cb78ad00 None admin] Authenticating user token {{(pid=479852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:18:51.789608 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG dbcounter [-] [479851] Writing DB stats keystone:SELECT=100 {{(pid=479851) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:18:51.878223 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1beeac6-a12c-4674-a898-eeaca7a35e9c None admin] Validating token access rules against request {{(pid=479851) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:18:51.919194 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-372cdff7-728c-4c10-8106-27f310830bd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479851) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:18:51.920183 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372cdff7-728c-4c10-8106-27f310830bd9 None admin] REQUEST_METHOD: `PUT` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:18:51.920479 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372cdff7-728c-4c10-8106-27f310830bd9 None admin] SCRIPT_NAME: `/identity` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:18:51.921035 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372cdff7-728c-4c10-8106-27f310830bd9 None admin] PATH_INFO: `/v3/projects/ef022c0e613d4a2bac6fe1e0e339b92c/groups/10982903b2844ab4bdbbb8dd377d478f/roles/900fb424e172461d93a0db59afb0a12b` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:18:51.927486 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-372cdff7-728c-4c10-8106-27f310830bd9 None admin] RBAC: Authorizing `identity:create_grant(project_id=ef022c0e613d4a2bac6fe1e0e339b92c, group_id=10982903b2844ab4bdbbb8dd377d478f, role_id=900fb424e172461d93a0db59afb0a12b)` {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:18:51.929164 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-372cdff7-728c-4c10-8106-27f310830bd9 None admin] RBAC: Authorization granted {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:18:51.944496 dv-cinder-851351-1-smb devstack@keystone.service[479851]: [pid: 479851|app: 0|req: 201/412] 10.222.0.42 () {58 vars in 1442 bytes} [Thu Jul 28 09:18:51 2022] PUT /identity/v3/projects/ef022c0e613d4a2bac6fe1e0e339b92c/groups/10982903b2844ab4bdbbb8dd377d478f/roles/900fb424e172461d93a0db59afb0a12b => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 09:18:51.946195 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea843e4d-a6c9-4b15-9b76-c8a9f5174ff5 None None] REQUEST_METHOD: `GET` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:18:51.946853 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea843e4d-a6c9-4b15-9b76-c8a9f5174ff5 None None] SCRIPT_NAME: `/identity` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:18:51.947139 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea843e4d-a6c9-4b15-9b76-c8a9f5174ff5 None None] PATH_INFO: `/` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:18:51.948913 dv-cinder-851351-1-smb devstack@keystone.service[479851]: [pid: 479851|app: 0|req: 202/413] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 09:18:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 09:18:51.955519 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60cd17a0-bcf9-4c34-bf5e-b3160e847dad None None] REQUEST_METHOD: `POST` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:18:51.956149 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60cd17a0-bcf9-4c34-bf5e-b3160e847dad None None] SCRIPT_NAME: `/identity` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:18:51.956635 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60cd17a0-bcf9-4c34-bf5e-b3160e847dad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:18:51.968601 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-470dc8e7-a875-445e-83a7-7473cb78ad00 None admin] Validating token access rules against request {{(pid=479852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:18:51.991874 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.auth.core [None req-60cd17a0-bcf9-4c34-bf5e-b3160e847dad None None] MFA Rules not processed for user `c198f91a4ae84d2b9cc730a6e304c2be`. Rule list: `[]` (Enabled: `True`). {{(pid=479851) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 09:18:51.993207 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.fernet_utils [None req-60cd17a0-bcf9-4c34-bf5e-b3160e847dad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=479851) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 09:18:52.043639 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa38f00-f464-4251-b39d-952cdf7c50a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:18:52.044799 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa38f00-f464-4251-b39d-952cdf7c50a1 None admin] REQUEST_METHOD: `GET` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:18:52.045368 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa38f00-f464-4251-b39d-952cdf7c50a1 None admin] SCRIPT_NAME: `/identity` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:18:52.045975 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa38f00-f464-4251-b39d-952cdf7c50a1 None admin] PATH_INFO: `/v3/groups/d6c4acea956a415795de5da3a5962b6b` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:18:52.047537 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa38f00-f464-4251-b39d-952cdf7c50a1 None admin] RBAC: Authorizing `identity:get_group(group_id=d6c4acea956a415795de5da3a5962b6b)` {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:18:52.049588 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa38f00-f464-4251-b39d-952cdf7c50a1 None admin] RBAC: Authorization granted {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:18:52.052203 dv-cinder-851351-1-smb devstack@keystone.service[479852]: [pid: 479852|app: 0|req: 212/414] 10.222.0.42 () {56 vars in 1180 bytes} [Thu Jul 28 09:18:51 2022] GET /identity/v3/groups/d6c4acea956a415795de5da3a5962b6b => generated 229 bytes in 288 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 09:18:52.058441 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa38f00-f464-4251-b39d-952cdf7c50a1 None admin] Authenticating user token {{(pid=479852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:18:52.102105 dv-cinder-851351-1-smb devstack@keystone.service[479851]: [pid: 479851|app: 0|req: 203/415] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 09:18:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 09:18:52.118314 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG dbcounter [-] [479852] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=479852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:18:52.127587 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60cd17a0-bcf9-4c34-bf5e-b3160e847dad None None] Authenticating user token {{(pid=479851) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:18:52.146249 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG dbcounter [-] [479851] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=479851) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:18:52.199688 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa38f00-f464-4251-b39d-952cdf7c50a1 None admin] Validating token access rules against request {{(pid=479852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:18:52.248338 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50969ed6-b651-4371-a950-5534478aa64b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:18:52.249044 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50969ed6-b651-4371-a950-5534478aa64b None admin] REQUEST_METHOD: `GET` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:18:52.249328 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50969ed6-b651-4371-a950-5534478aa64b None admin] SCRIPT_NAME: `/identity` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:18:52.249605 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50969ed6-b651-4371-a950-5534478aa64b None admin] PATH_INFO: `/v3/projects/5cd1eb20d96b430f96760c31423a47ce` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:18:52.250910 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50969ed6-b651-4371-a950-5534478aa64b None admin] RBAC: Authorizing `identity:get_project(project_id=5cd1eb20d96b430f96760c31423a47ce)` {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:18:52.252601 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50969ed6-b651-4371-a950-5534478aa64b None admin] RBAC: Authorization granted {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:18:52.255291 dv-cinder-851351-1-smb devstack@keystone.service[479852]: [pid: 479852|app: 0|req: 213/416] 10.222.0.42 () {56 vars in 1186 bytes} [Thu Jul 28 09:18:52 2022] GET /identity/v3/projects/5cd1eb20d96b430f96760c31423a47ce => generated 344 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:18:52.255991 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60cd17a0-bcf9-4c34-bf5e-b3160e847dad None None] Validating token access rules against request {{(pid=479851) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:18:52.261848 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50969ed6-b651-4371-a950-5534478aa64b None admin] Authenticating user token {{(pid=479852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:18:52.324193 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e2642f-72f4-4f3f-ba64-f2349edf4417 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479851) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:18:52.324890 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e2642f-72f4-4f3f-ba64-f2349edf4417 None admin] REQUEST_METHOD: `GET` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:18:52.325176 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e2642f-72f4-4f3f-ba64-f2349edf4417 None admin] SCRIPT_NAME: `/identity` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:18:52.325457 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e2642f-72f4-4f3f-ba64-f2349edf4417 None admin] PATH_INFO: `/v3/roles/member` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:18:52.347814 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e2642f-72f4-4f3f-ba64-f2349edf4417 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 09:18:52.353030 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application [None req-55e2642f-72f4-4f3f-ba64-f2349edf4417 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 28 09:18:52.353030 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 09:18:52.353030 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 09:18:52.353030 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 09:18:52.353030 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 09:18:52.353030 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 09:18:52.353030 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 09:18:52.353030 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 09:18:52.353030 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 09:18:52.353030 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 09:18:52.353030 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 09:18:52.353030 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 09:18:52.353030 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 09:18:52.353030 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 09:18:52.353030 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 09:18:52.353030 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 09:18:52.354252 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 09:18:52.354252 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 09:18:52.354252 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 09:18:52.354252 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 09:18:52.354252 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 09:18:52.354252 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 09:18:52.354252 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 09:18:52.354252 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 09:18:52.354252 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 09:18:52.354252 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 09:18:52.354252 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 09:18:52.354252 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application with Lock( Jul 28 09:18:52.354252 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 09:18:52.354252 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return self._enter() Jul 28 09:18:52.354252 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 09:18:52.354252 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 09:18:52.355227 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 09:18:52.355227 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return self.creator() Jul 28 09:18:52.355227 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 09:18:52.355227 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application created_value = creator( Jul 28 09:18:52.355227 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 09:18:52.355227 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 09:18:52.355227 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 09:18:52.355227 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 09:18:52.355227 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 09:18:52.355227 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 09:18:52.355227 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 28 09:18:52.355227 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application Jul 28 09:18:52.355227 dv-cinder-851351-1-smb devstack@keystone.service[479851]: [pid: 479851|app: 0|req: 204/417] 10.222.0.42 () {56 vars in 1099 bytes} [Thu Jul 28 09:18:52 2022] GET /identity/v3/roles/member => generated 84 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 09:18:52.363139 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e2642f-72f4-4f3f-ba64-f2349edf4417 None admin] Authenticating user token {{(pid=479851) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:18:52.468799 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50969ed6-b651-4371-a950-5534478aa64b None admin] Validating token access rules against request {{(pid=479852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:18:52.482210 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG dbcounter [-] [479852] Writing DB stats keystone:SELECT=100 {{(pid=479852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:18:52.509128 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG dbcounter [-] [479851] Writing DB stats keystone:SELECT=100 {{(pid=479851) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:18:52.540051 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e2642f-72f4-4f3f-ba64-f2349edf4417 None admin] Validating token access rules against request {{(pid=479851) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:18:52.584337 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83bbb21-aced-4de7-aa03-fa35241d1709 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479851) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:18:52.585321 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f49410-c01f-4468-ab95-a2bbb11e4b00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:18:52.586199 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83bbb21-aced-4de7-aa03-fa35241d1709 None admin] REQUEST_METHOD: `GET` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:18:52.587072 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f49410-c01f-4468-ab95-a2bbb11e4b00 None admin] REQUEST_METHOD: `PUT` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:18:52.587537 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83bbb21-aced-4de7-aa03-fa35241d1709 None admin] SCRIPT_NAME: `/identity` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:18:52.587965 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83bbb21-aced-4de7-aa03-fa35241d1709 None admin] PATH_INFO: `/v3/roles` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:18:52.588401 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f49410-c01f-4468-ab95-a2bbb11e4b00 None admin] SCRIPT_NAME: `/identity` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:18:52.589340 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e83bbb21-aced-4de7-aa03-fa35241d1709 None admin] RBAC: Adding query filter params (name=member) {{(pid=479851) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 09:18:52.589780 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f49410-c01f-4468-ab95-a2bbb11e4b00 None admin] PATH_INFO: `/v3/projects/5cd1eb20d96b430f96760c31423a47ce/groups/d6c4acea956a415795de5da3a5962b6b/roles/685084310b35477b9b2d0c7934d0f803` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:18:52.591192 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e83bbb21-aced-4de7-aa03-fa35241d1709 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:18:52.592827 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e83bbb21-aced-4de7-aa03-fa35241d1709 None admin] RBAC: Authorization granted {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:18:52.595642 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f49410-c01f-4468-ab95-a2bbb11e4b00 None admin] RBAC: Authorizing `identity:create_grant(project_id=5cd1eb20d96b430f96760c31423a47ce, group_id=d6c4acea956a415795de5da3a5962b6b, role_id=685084310b35477b9b2d0c7934d0f803)` {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:18:52.597378 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f49410-c01f-4468-ab95-a2bbb11e4b00 None admin] RBAC: Authorization granted {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:18:52.611846 dv-cinder-851351-1-smb devstack@keystone.service[479851]: [pid: 479851|app: 0|req: 205/418] 10.222.0.42 () {56 vars in 1101 bytes} [Thu Jul 28 09:18:52 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:18:52.618644 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83bbb21-aced-4de7-aa03-fa35241d1709 None admin] Authenticating user token {{(pid=479851) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:18:52.626208 dv-cinder-851351-1-smb devstack@keystone.service[479852]: [pid: 479852|app: 0|req: 214/419] 10.222.0.42 () {58 vars in 1442 bytes} [Thu Jul 28 09:18:52 2022] PUT /identity/v3/projects/5cd1eb20d96b430f96760c31423a47ce/groups/d6c4acea956a415795de5da3a5962b6b/roles/685084310b35477b9b2d0c7934d0f803 => generated 0 bytes in 365 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 09:18:52.779493 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83bbb21-aced-4de7-aa03-fa35241d1709 None admin] Validating token access rules against request {{(pid=479851) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:18:52.830464 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c9562d-fac1-4d41-883e-24ee6917f880 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479851) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:18:52.831404 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c9562d-fac1-4d41-883e-24ee6917f880 None admin] REQUEST_METHOD: `GET` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:18:52.831890 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c9562d-fac1-4d41-883e-24ee6917f880 None admin] SCRIPT_NAME: `/identity` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:18:52.832333 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c9562d-fac1-4d41-883e-24ee6917f880 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:18:52.840134 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG dbcounter [-] [479851] Writing DB stats keystone:SELECT=100 {{(pid=479851) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:18:52.925374 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c9562d-fac1-4d41-883e-24ee6917f880 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:18:52.926973 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c9562d-fac1-4d41-883e-24ee6917f880 None admin] RBAC: Authorization granted {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:18:53.077165 dv-cinder-851351-1-smb devstack@keystone.service[479851]: [pid: 479851|app: 0|req: 206/420] 10.222.0.42 () {58 vars in 1282 bytes} [Thu Jul 28 09:18:52 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 459 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 28 09:18:53.085508 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f49410-c01f-4468-ab95-a2bbb11e4b00 None admin] Authenticating user token {{(pid=479852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:18:53.233215 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f49410-c01f-4468-ab95-a2bbb11e4b00 None admin] Validating token access rules against request {{(pid=479852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:18:53.279160 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a96324-471c-4f1f-9f15-2816be2a233c None None] REQUEST_METHOD: `GET` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:18:53.279553 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a96324-471c-4f1f-9f15-2816be2a233c None None] SCRIPT_NAME: `/identity` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:18:53.279913 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a96324-471c-4f1f-9f15-2816be2a233c None None] PATH_INFO: `/` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:18:53.280527 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d122373f-152d-4985-9358-259ea6494860 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:18:53.281316 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d122373f-152d-4985-9358-259ea6494860 None admin] REQUEST_METHOD: `GET` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:18:53.281603 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d122373f-152d-4985-9358-259ea6494860 None admin] SCRIPT_NAME: `/identity` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:18:53.282145 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d122373f-152d-4985-9358-259ea6494860 None admin] PATH_INFO: `/v3/projects/580eb2f23f9049b18bb38dce6f6f9b4f` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:18:53.282272 dv-cinder-851351-1-smb devstack@keystone.service[479851]: [pid: 479851|app: 0|req: 207/421] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 09:18:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 09:18:53.283849 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d122373f-152d-4985-9358-259ea6494860 None admin] RBAC: Authorizing `identity:get_project(project_id=580eb2f23f9049b18bb38dce6f6f9b4f)` {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:18:53.285495 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d122373f-152d-4985-9358-259ea6494860 None admin] RBAC: Authorization granted {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:18:53.287728 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c1dae4-b3ad-4b38-91de-777f3be3994f None None] REQUEST_METHOD: `POST` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:18:53.288069 dv-cinder-851351-1-smb devstack@keystone.service[479852]: [pid: 479852|app: 0|req: 215/422] 10.222.0.42 () {56 vars in 1186 bytes} [Thu Jul 28 09:18:53 2022] GET /identity/v3/projects/580eb2f23f9049b18bb38dce6f6f9b4f => generated 298 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:18:53.288205 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c1dae4-b3ad-4b38-91de-777f3be3994f None None] SCRIPT_NAME: `/identity` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:18:53.288367 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c1dae4-b3ad-4b38-91de-777f3be3994f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:18:53.295830 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d122373f-152d-4985-9358-259ea6494860 None admin] Authenticating user token {{(pid=479852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:18:53.338442 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.auth.core [None req-19c1dae4-b3ad-4b38-91de-777f3be3994f None None] MFA Rules not processed for user `c198f91a4ae84d2b9cc730a6e304c2be`. Rule list: `[]` (Enabled: `True`). {{(pid=479851) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 09:18:53.341936 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.fernet_utils [None req-19c1dae4-b3ad-4b38-91de-777f3be3994f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=479851) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 09:18:53.400812 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG dbcounter [-] [479852] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=479852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:18:53.419312 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG dbcounter [-] [479851] Writing DB stats keystone:SELECT=100 {{(pid=479851) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:18:53.531797 dv-cinder-851351-1-smb devstack@keystone.service[479851]: [pid: 479851|app: 0|req: 208/423] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 09:18:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 245 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 09:18:53.554462 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d122373f-152d-4985-9358-259ea6494860 None admin] Validating token access rules against request {{(pid=479852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:18:53.567321 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c1dae4-b3ad-4b38-91de-777f3be3994f None None] Authenticating user token {{(pid=479851) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:18:53.621937 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3008117-962f-4321-b4ed-cda55853b1e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:18:53.622523 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3008117-962f-4321-b4ed-cda55853b1e9 None admin] REQUEST_METHOD: `GET` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:18:53.622806 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3008117-962f-4321-b4ed-cda55853b1e9 None admin] SCRIPT_NAME: `/identity` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:18:53.623080 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3008117-962f-4321-b4ed-cda55853b1e9 None admin] PATH_INFO: `/v3/groups/10982903b2844ab4bdbbb8dd377d478f` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:18:53.629366 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3008117-962f-4321-b4ed-cda55853b1e9 None admin] RBAC: Authorizing `identity:get_group(group_id=10982903b2844ab4bdbbb8dd377d478f)` {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:18:53.630968 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3008117-962f-4321-b4ed-cda55853b1e9 None admin] RBAC: Authorization granted {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:18:53.633103 dv-cinder-851351-1-smb devstack@keystone.service[479852]: [pid: 479852|app: 0|req: 216/424] 10.222.0.42 () {56 vars in 1180 bytes} [Thu Jul 28 09:18:53 2022] GET /identity/v3/groups/10982903b2844ab4bdbbb8dd377d478f => generated 226 bytes in 339 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:18:53.639973 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3008117-962f-4321-b4ed-cda55853b1e9 None admin] Authenticating user token {{(pid=479852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:18:53.841191 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c1dae4-b3ad-4b38-91de-777f3be3994f None None] Validating token access rules against request {{(pid=479851) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:18:53.955594 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3008117-962f-4321-b4ed-cda55853b1e9 None admin] Validating token access rules against request {{(pid=479852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:18:53.960685 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG dbcounter [-] [479852] Writing DB stats keystone:SELECT=100 {{(pid=479852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:18:53.966564 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bebcca39-a94c-47b4-bf33-6277311a61ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479851) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:18:53.967710 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bebcca39-a94c-47b4-bf33-6277311a61ff None admin] REQUEST_METHOD: `GET` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:18:53.968002 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bebcca39-a94c-47b4-bf33-6277311a61ff None admin] SCRIPT_NAME: `/identity` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:18:53.968285 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bebcca39-a94c-47b4-bf33-6277311a61ff None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:18:53.991727 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bebcca39-a94c-47b4-bf33-6277311a61ff None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 09:18:54.011513 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application [None req-bebcca39-a94c-47b4-bf33-6277311a61ff None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 28 09:18:54.011513 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 09:18:54.011513 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 09:18:54.011513 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 09:18:54.011513 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 09:18:54.011513 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 09:18:54.011513 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 09:18:54.011513 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 09:18:54.011513 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 09:18:54.011513 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 09:18:54.011513 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 09:18:54.011513 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 09:18:54.011513 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 09:18:54.011513 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 09:18:54.011513 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 09:18:54.011513 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 09:18:54.012714 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 09:18:54.012714 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 09:18:54.012714 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 09:18:54.012714 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 09:18:54.012714 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 09:18:54.012714 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 09:18:54.012714 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 09:18:54.012714 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 09:18:54.012714 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 09:18:54.012714 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 09:18:54.012714 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 09:18:54.012714 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application with Lock( Jul 28 09:18:54.012714 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 09:18:54.012714 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return self._enter() Jul 28 09:18:54.012714 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 09:18:54.012714 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 09:18:54.013743 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 09:18:54.013743 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return self.creator() Jul 28 09:18:54.013743 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 09:18:54.013743 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application created_value = creator( Jul 28 09:18:54.013743 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 09:18:54.013743 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 09:18:54.013743 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 09:18:54.013743 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 09:18:54.013743 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 09:18:54.013743 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 09:18:54.013743 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 28 09:18:54.013743 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application Jul 28 09:18:54.013743 dv-cinder-851351-1-smb devstack@keystone.service[479851]: [pid: 479851|app: 0|req: 209/425] 10.222.0.42 () {56 vars in 1114 bytes} [Thu Jul 28 09:18:53 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 446 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 09:18:54.029866 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bebcca39-a94c-47b4-bf33-6277311a61ff None admin] Authenticating user token {{(pid=479851) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:18:54.038423 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b4c8c33-b24d-4ca9-8121-5bc994a76048 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:18:54.039387 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4c8c33-b24d-4ca9-8121-5bc994a76048 None admin] REQUEST_METHOD: `GET` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:18:54.041069 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4c8c33-b24d-4ca9-8121-5bc994a76048 None admin] SCRIPT_NAME: `/identity` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:18:54.041592 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4c8c33-b24d-4ca9-8121-5bc994a76048 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:18:54.042673 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b4c8c33-b24d-4ca9-8121-5bc994a76048 None admin] RBAC: Adding query filter params (group.id=10982903b2844ab4bdbbb8dd377d478f, role.id=900fb424e172461d93a0db59afb0a12b, scope.project.id=580eb2f23f9049b18bb38dce6f6f9b4f) {{(pid=479852) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 09:18:54.043226 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b4c8c33-b24d-4ca9-8121-5bc994a76048 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:18:54.044939 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b4c8c33-b24d-4ca9-8121-5bc994a76048 None admin] RBAC: Authorization granted {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:18:54.058210 dv-cinder-851351-1-smb devstack@keystone.service[479852]: [pid: 479852|app: 0|req: 217/426] 10.222.0.42 () {56 vars in 1376 bytes} [Thu Jul 28 09:18:53 2022] GET /identity/v3/role_assignments?group.id=10982903b2844ab4bdbbb8dd377d478f&scope.project.id=580eb2f23f9049b18bb38dce6f6f9b4f&role.id=900fb424e172461d93a0db59afb0a12b => generated 611 bytes in 419 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 09:18:54.093219 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG dbcounter [-] [479851] Writing DB stats keystone:SELECT=100 {{(pid=479851) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:18:54.213103 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bebcca39-a94c-47b4-bf33-6277311a61ff None admin] Validating token access rules against request {{(pid=479851) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:18:54.255073 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f99dc7d-1dff-4b82-aa30-d1058b924338 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479851) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:18:54.256932 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f99dc7d-1dff-4b82-aa30-d1058b924338 None admin] REQUEST_METHOD: `GET` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:18:54.257252 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f99dc7d-1dff-4b82-aa30-d1058b924338 None admin] SCRIPT_NAME: `/identity` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:18:54.257374 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d4727a-b65d-496f-8911-b6a99c03fba5 None None] REQUEST_METHOD: `GET` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:18:54.257823 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d4727a-b65d-496f-8911-b6a99c03fba5 None None] SCRIPT_NAME: `/identity` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:18:54.257913 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f99dc7d-1dff-4b82-aa30-d1058b924338 None admin] PATH_INFO: `/v3/roles` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:18:54.257993 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d4727a-b65d-496f-8911-b6a99c03fba5 None None] PATH_INFO: `/` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:18:54.258295 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f99dc7d-1dff-4b82-aa30-d1058b924338 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=479851) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 09:18:54.258611 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f99dc7d-1dff-4b82-aa30-d1058b924338 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:18:54.260035 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f99dc7d-1dff-4b82-aa30-d1058b924338 None admin] RBAC: Authorization granted {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:18:54.263197 dv-cinder-851351-1-smb devstack@keystone.service[479852]: [pid: 479852|app: 0|req: 218/427] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 09:18:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 28 09:18:54.265118 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b906b8e-be62-481d-b1dc-32a87ac8b9df None None] REQUEST_METHOD: `POST` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:18:54.265687 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b906b8e-be62-481d-b1dc-32a87ac8b9df None None] SCRIPT_NAME: `/identity` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:18:54.265971 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b906b8e-be62-481d-b1dc-32a87ac8b9df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:18:54.269222 dv-cinder-851351-1-smb devstack@keystone.service[479851]: [pid: 479851|app: 0|req: 210/428] 10.222.0.42 () {56 vars in 1111 bytes} [Thu Jul 28 09:18:54 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:18:54.274655 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f99dc7d-1dff-4b82-aa30-d1058b924338 None admin] Authenticating user token {{(pid=479851) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:18:54.289496 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.auth.core [None req-6b906b8e-be62-481d-b1dc-32a87ac8b9df None None] MFA Rules not processed for user `c198f91a4ae84d2b9cc730a6e304c2be`. Rule list: `[]` (Enabled: `True`). {{(pid=479852) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 09:18:54.291265 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.fernet_utils [None req-6b906b8e-be62-481d-b1dc-32a87ac8b9df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=479852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 09:18:54.380130 dv-cinder-851351-1-smb devstack@keystone.service[479852]: [pid: 479852|app: 0|req: 219/429] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 09:18:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 09:18:54.389594 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG dbcounter [-] [479851] Writing DB stats keystone:SELECT=100 {{(pid=479851) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:18:54.405652 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f99dc7d-1dff-4b82-aa30-d1058b924338 None admin] Validating token access rules against request {{(pid=479851) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:18:54.413282 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b906b8e-be62-481d-b1dc-32a87ac8b9df None None] Authenticating user token {{(pid=479852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:18:54.455949 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf78839-41af-4788-a837-07832668fa1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479851) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:18:54.457191 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf78839-41af-4788-a837-07832668fa1a None admin] REQUEST_METHOD: `GET` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:18:54.457774 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf78839-41af-4788-a837-07832668fa1a None admin] SCRIPT_NAME: `/identity` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:18:54.458266 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf78839-41af-4788-a837-07832668fa1a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:18:54.542733 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG dbcounter [-] [479852] Writing DB stats keystone:SELECT=100 {{(pid=479852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:18:54.546041 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daf78839-41af-4788-a837-07832668fa1a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:18:54.547887 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daf78839-41af-4788-a837-07832668fa1a None admin] RBAC: Authorization granted {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:18:54.548898 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b906b8e-be62-481d-b1dc-32a87ac8b9df None None] Validating token access rules against request {{(pid=479852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:18:54.598416 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db905cf4-919a-44dc-b71b-b53906feaecb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:18:54.599559 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db905cf4-919a-44dc-b71b-b53906feaecb None admin] REQUEST_METHOD: `GET` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:18:54.600107 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db905cf4-919a-44dc-b71b-b53906feaecb None admin] SCRIPT_NAME: `/identity` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:18:54.601001 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db905cf4-919a-44dc-b71b-b53906feaecb None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:18:54.617338 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db905cf4-919a-44dc-b71b-b53906feaecb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 09:18:54.624608 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application [None req-db905cf4-919a-44dc-b71b-b53906feaecb None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 28 09:18:54.624608 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 09:18:54.624608 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 09:18:54.624608 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 09:18:54.624608 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 09:18:54.624608 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 09:18:54.624608 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 09:18:54.624608 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 09:18:54.624608 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 09:18:54.624608 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 09:18:54.624608 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 09:18:54.624608 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 09:18:54.624608 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 09:18:54.624608 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 09:18:54.624608 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 09:18:54.624608 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 09:18:54.625745 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 09:18:54.625745 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 09:18:54.625745 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 09:18:54.625745 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 09:18:54.625745 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 09:18:54.625745 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 09:18:54.625745 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 09:18:54.625745 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 09:18:54.625745 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 09:18:54.625745 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 09:18:54.625745 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 09:18:54.625745 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application with Lock( Jul 28 09:18:54.625745 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 09:18:54.625745 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self._enter() Jul 28 09:18:54.625745 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 09:18:54.625745 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 09:18:54.628520 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 09:18:54.628520 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self.creator() Jul 28 09:18:54.628520 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 09:18:54.628520 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application created_value = creator( Jul 28 09:18:54.628520 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 09:18:54.628520 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 09:18:54.628520 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 09:18:54.628520 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 09:18:54.628520 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 09:18:54.628520 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 09:18:54.628520 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 28 09:18:54.628520 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application Jul 28 09:18:54.628520 dv-cinder-851351-1-smb devstack@keystone.service[479852]: [pid: 479852|app: 0|req: 220/430] 10.222.0.42 () {56 vars in 1114 bytes} [Thu Jul 28 09:18:54 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 09:18:54.628520 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d55619c-9611-4ebb-9166-5e741439f6d8 None None] REQUEST_METHOD: `GET` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:18:54.629444 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d55619c-9611-4ebb-9166-5e741439f6d8 None None] SCRIPT_NAME: `/identity` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:18:54.629444 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d55619c-9611-4ebb-9166-5e741439f6d8 None None] PATH_INFO: `/` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:18:54.630015 dv-cinder-851351-1-smb devstack@keystone.service[479852]: [pid: 479852|app: 0|req: 221/431] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 09:18:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 09:18:54.635132 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d55619c-9611-4ebb-9166-5e741439f6d8 None None] Authenticating user token {{(pid=479852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:18:54.670267 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG dbcounter [-] [479851] Writing DB stats keystone:SELECT=100 {{(pid=479851) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:18:54.685451 dv-cinder-851351-1-smb devstack@keystone.service[479851]: [pid: 479851|app: 0|req: 211/432] 10.222.0.42 () {58 vars in 1282 bytes} [Thu Jul 28 09:18:54 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 411 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 28 09:18:54.686794 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef73e63-f09d-4dfb-877f-28d0de762917 None None] REQUEST_METHOD: `POST` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:18:54.687139 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef73e63-f09d-4dfb-877f-28d0de762917 None None] SCRIPT_NAME: `/identity` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:18:54.687426 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef73e63-f09d-4dfb-877f-28d0de762917 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:18:54.709554 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.auth.core [None req-6ef73e63-f09d-4dfb-877f-28d0de762917 None None] MFA Rules not processed for user `c198f91a4ae84d2b9cc730a6e304c2be`. Rule list: `[]` (Enabled: `True`). {{(pid=479851) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 09:18:54.711104 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.fernet_utils [None req-6ef73e63-f09d-4dfb-877f-28d0de762917 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=479851) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 09:18:54.771851 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d55619c-9611-4ebb-9166-5e741439f6d8 None None] Validating token access rules against request {{(pid=479852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:18:54.789044 dv-cinder-851351-1-smb devstack@keystone.service[479851]: [pid: 479851|app: 0|req: 212/433] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 09:18:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 09:18:54.789044 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef73e63-f09d-4dfb-877f-28d0de762917 None None] Authenticating user token {{(pid=479851) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:18:54.826573 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a60f4e3-ebf3-46c3-8220-60310d4889f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:18:54.827354 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a60f4e3-ebf3-46c3-8220-60310d4889f5 None admin] REQUEST_METHOD: `GET` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:18:54.827696 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a60f4e3-ebf3-46c3-8220-60310d4889f5 None admin] SCRIPT_NAME: `/identity` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:18:54.828034 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a60f4e3-ebf3-46c3-8220-60310d4889f5 None admin] PATH_INFO: `/v3/roles` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:18:54.828940 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a60f4e3-ebf3-46c3-8220-60310d4889f5 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=479852) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 09:18:54.829174 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a60f4e3-ebf3-46c3-8220-60310d4889f5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:18:54.830618 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a60f4e3-ebf3-46c3-8220-60310d4889f5 None admin] RBAC: Authorization granted {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:18:54.839981 dv-cinder-851351-1-smb devstack@keystone.service[479852]: [pid: 479852|app: 0|req: 222/434] 10.222.0.42 () {56 vars in 1111 bytes} [Thu Jul 28 09:18:54 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 09:18:54.845245 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a60f4e3-ebf3-46c3-8220-60310d4889f5 None admin] Authenticating user token {{(pid=479852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:18:54.867236 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG dbcounter [-] [479852] Writing DB stats keystone:SELECT=100 {{(pid=479852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:18:54.899710 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef73e63-f09d-4dfb-877f-28d0de762917 None None] Validating token access rules against request {{(pid=479851) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:18:54.919469 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG dbcounter [-] [479851] Writing DB stats keystone:SELECT=100 {{(pid=479851) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:18:54.940348 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba1944a0-f72c-410e-bf37-deadc4ba6ee0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479851) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:18:54.941285 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1944a0-f72c-410e-bf37-deadc4ba6ee0 None admin] REQUEST_METHOD: `GET` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:18:54.941744 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1944a0-f72c-410e-bf37-deadc4ba6ee0 None admin] SCRIPT_NAME: `/identity` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:18:54.942229 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1944a0-f72c-410e-bf37-deadc4ba6ee0 None admin] PATH_INFO: `/v3/projects/580eb2f23f9049b18bb38dce6f6f9b4f` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:18:54.944027 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba1944a0-f72c-410e-bf37-deadc4ba6ee0 None admin] RBAC: Authorizing `identity:get_project(project_id=580eb2f23f9049b18bb38dce6f6f9b4f)` {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:18:54.946026 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba1944a0-f72c-410e-bf37-deadc4ba6ee0 None admin] RBAC: Authorization granted {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:18:54.948901 dv-cinder-851351-1-smb devstack@keystone.service[479851]: [pid: 479851|app: 0|req: 213/435] 10.222.0.42 () {56 vars in 1186 bytes} [Thu Jul 28 09:18:54 2022] GET /identity/v3/projects/580eb2f23f9049b18bb38dce6f6f9b4f => generated 298 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:18:54.955222 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba1944a0-f72c-410e-bf37-deadc4ba6ee0 None admin] Authenticating user token {{(pid=479851) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:18:54.971324 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a60f4e3-ebf3-46c3-8220-60310d4889f5 None admin] Validating token access rules against request {{(pid=479852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:18:55.011010 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a70c24-7377-48bd-ba22-a9461f357c89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:18:55.011666 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a70c24-7377-48bd-ba22-a9461f357c89 None admin] REQUEST_METHOD: `GET` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:18:55.012293 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a70c24-7377-48bd-ba22-a9461f357c89 None admin] SCRIPT_NAME: `/identity` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:18:55.012293 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a70c24-7377-48bd-ba22-a9461f357c89 None admin] PATH_INFO: `/v3/roles/member` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:18:55.024093 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5a70c24-7377-48bd-ba22-a9461f357c89 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 09:18:55.029531 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application [None req-a5a70c24-7377-48bd-ba22-a9461f357c89 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 28 09:18:55.029531 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 09:18:55.029531 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 09:18:55.029531 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 09:18:55.029531 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 09:18:55.029531 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 09:18:55.029531 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 09:18:55.029531 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 09:18:55.029531 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 09:18:55.029531 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 09:18:55.029531 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 09:18:55.029531 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 09:18:55.029531 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 09:18:55.029531 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 09:18:55.029531 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 09:18:55.029531 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 09:18:55.030624 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 09:18:55.030624 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 09:18:55.030624 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 09:18:55.030624 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 09:18:55.030624 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 09:18:55.030624 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 09:18:55.030624 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 09:18:55.030624 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 09:18:55.030624 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 09:18:55.030624 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 09:18:55.030624 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 09:18:55.030624 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application with Lock( Jul 28 09:18:55.030624 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 09:18:55.030624 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self._enter() Jul 28 09:18:55.030624 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 09:18:55.030624 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 09:18:55.036877 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 09:18:55.036877 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self.creator() Jul 28 09:18:55.036877 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 09:18:55.036877 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application created_value = creator( Jul 28 09:18:55.036877 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 09:18:55.036877 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 09:18:55.036877 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 09:18:55.036877 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 09:18:55.036877 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 09:18:55.036877 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 09:18:55.036877 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 28 09:18:55.036877 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application Jul 28 09:18:55.036877 dv-cinder-851351-1-smb devstack@keystone.service[479852]: [pid: 479852|app: 0|req: 223/436] 10.222.0.42 () {56 vars in 1099 bytes} [Thu Jul 28 09:18:54 2022] GET /identity/v3/roles/member => generated 84 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 09:18:55.036877 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a70c24-7377-48bd-ba22-a9461f357c89 None admin] Authenticating user token {{(pid=479852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:18:55.072395 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba1944a0-f72c-410e-bf37-deadc4ba6ee0 None admin] Validating token access rules against request {{(pid=479851) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:18:55.109534 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c261d8d-46e8-4d28-8ea0-debf0d0f7fb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479851) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:18:55.110093 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c261d8d-46e8-4d28-8ea0-debf0d0f7fb7 None admin] REQUEST_METHOD: `GET` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:18:55.110379 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c261d8d-46e8-4d28-8ea0-debf0d0f7fb7 None admin] SCRIPT_NAME: `/identity` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:18:55.110659 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c261d8d-46e8-4d28-8ea0-debf0d0f7fb7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:18:55.124426 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG dbcounter [-] [479852] Writing DB stats keystone:SELECT=100 {{(pid=479852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:18:55.148595 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a70c24-7377-48bd-ba22-a9461f357c89 None admin] Validating token access rules against request {{(pid=479852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:18:55.171907 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG dbcounter [-] [479851] Writing DB stats keystone:SELECT=100 {{(pid=479851) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:18:55.190569 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c261d8d-46e8-4d28-8ea0-debf0d0f7fb7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:18:55.192071 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c261d8d-46e8-4d28-8ea0-debf0d0f7fb7 None admin] RBAC: Authorization granted {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:18:55.193720 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91e1ed5-7c7c-4e10-9301-b88ea609419f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:18:55.194501 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91e1ed5-7c7c-4e10-9301-b88ea609419f None admin] REQUEST_METHOD: `GET` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:18:55.194800 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91e1ed5-7c7c-4e10-9301-b88ea609419f None admin] SCRIPT_NAME: `/identity` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:18:55.195073 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91e1ed5-7c7c-4e10-9301-b88ea609419f None admin] PATH_INFO: `/v3/groups/10982903b2844ab4bdbbb8dd377d478f` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:18:55.196622 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e91e1ed5-7c7c-4e10-9301-b88ea609419f None admin] RBAC: Authorizing `identity:get_group(group_id=10982903b2844ab4bdbbb8dd377d478f)` {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:18:55.198263 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e91e1ed5-7c7c-4e10-9301-b88ea609419f None admin] RBAC: Authorization granted {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:18:55.205101 dv-cinder-851351-1-smb devstack@keystone.service[479852]: [pid: 479852|app: 0|req: 224/437] 10.222.0.42 () {56 vars in 1180 bytes} [Thu Jul 28 09:18:55 2022] GET /identity/v3/groups/10982903b2844ab4bdbbb8dd377d478f => generated 226 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:18:55.205700 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91e1ed5-7c7c-4e10-9301-b88ea609419f None admin] Authenticating user token {{(pid=479852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:18:55.306694 dv-cinder-851351-1-smb devstack@keystone.service[479851]: [pid: 479851|app: 0|req: 214/438] 10.222.0.42 () {58 vars in 1282 bytes} [Thu Jul 28 09:18:54 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 347 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 28 09:18:55.306694 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c261d8d-46e8-4d28-8ea0-debf0d0f7fb7 None admin] Authenticating user token {{(pid=479851) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:18:55.321953 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91e1ed5-7c7c-4e10-9301-b88ea609419f None admin] Validating token access rules against request {{(pid=479852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:18:55.363390 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-326b67fc-cf39-45fe-ae72-c1d04d8df798 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:18:55.363948 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326b67fc-cf39-45fe-ae72-c1d04d8df798 None admin] REQUEST_METHOD: `GET` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:18:55.364239 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326b67fc-cf39-45fe-ae72-c1d04d8df798 None admin] SCRIPT_NAME: `/identity` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:18:55.364520 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326b67fc-cf39-45fe-ae72-c1d04d8df798 None admin] PATH_INFO: `/v3/roles` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:18:55.365301 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-326b67fc-cf39-45fe-ae72-c1d04d8df798 None admin] RBAC: Adding query filter params (name=member) {{(pid=479852) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 09:18:55.365616 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-326b67fc-cf39-45fe-ae72-c1d04d8df798 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:18:55.367029 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-326b67fc-cf39-45fe-ae72-c1d04d8df798 None admin] RBAC: Authorization granted {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:18:55.380649 dv-cinder-851351-1-smb devstack@keystone.service[479852]: [pid: 479852|app: 0|req: 225/439] 10.222.0.42 () {56 vars in 1101 bytes} [Thu Jul 28 09:18:55 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:18:55.380649 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-326b67fc-cf39-45fe-ae72-c1d04d8df798 None admin] Authenticating user token {{(pid=479852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:18:55.389800 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG dbcounter [-] [479852] Writing DB stats keystone:SELECT=100 {{(pid=479852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:18:55.392368 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG dbcounter [-] [479851] Writing DB stats keystone:SELECT=100 {{(pid=479851) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:18:55.407918 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c261d8d-46e8-4d28-8ea0-debf0d0f7fb7 None admin] Validating token access rules against request {{(pid=479851) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:18:55.441175 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e377e24a-4fc6-4223-9fee-f8aa55521edf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479851) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:18:55.441806 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e377e24a-4fc6-4223-9fee-f8aa55521edf None admin] REQUEST_METHOD: `GET` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:18:55.442085 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e377e24a-4fc6-4223-9fee-f8aa55521edf None admin] SCRIPT_NAME: `/identity` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:18:55.442362 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e377e24a-4fc6-4223-9fee-f8aa55521edf None admin] PATH_INFO: `/v3/role_assignments` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:18:55.443165 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e377e24a-4fc6-4223-9fee-f8aa55521edf None admin] RBAC: Adding query filter params (group.id=10982903b2844ab4bdbbb8dd377d478f, role.id=acf1d2de5e5448beb6363dae3d154a02, scope.project.id=580eb2f23f9049b18bb38dce6f6f9b4f) {{(pid=479851) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 09:18:55.443535 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e377e24a-4fc6-4223-9fee-f8aa55521edf None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:18:55.445013 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e377e24a-4fc6-4223-9fee-f8aa55521edf None admin] RBAC: Authorization granted {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:18:55.451096 dv-cinder-851351-1-smb devstack@keystone.service[479851]: [pid: 479851|app: 0|req: 215/440] 10.222.0.42 () {56 vars in 1376 bytes} [Thu Jul 28 09:18:55 2022] GET /identity/v3/role_assignments?group.id=10982903b2844ab4bdbbb8dd377d478f&scope.project.id=580eb2f23f9049b18bb38dce6f6f9b4f&role.id=acf1d2de5e5448beb6363dae3d154a02 => generated 611 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:18:55.452277 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3fa31e-3872-40ff-a3dd-51eabca5878f None None] REQUEST_METHOD: `GET` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:18:55.452563 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3fa31e-3872-40ff-a3dd-51eabca5878f None None] SCRIPT_NAME: `/identity` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:18:55.452871 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3fa31e-3872-40ff-a3dd-51eabca5878f None None] PATH_INFO: `/` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:18:55.454100 dv-cinder-851351-1-smb devstack@keystone.service[479851]: [pid: 479851|app: 0|req: 216/441] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 09:18:55 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 09:18:55.454815 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3fa31e-3872-40ff-a3dd-51eabca5878f None None] Authenticating user token {{(pid=479851) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:18:55.495966 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-326b67fc-cf39-45fe-ae72-c1d04d8df798 None admin] Validating token access rules against request {{(pid=479852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:18:55.537947 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af4fcce-3476-4d66-a1fd-294661368a3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:18:55.538689 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af4fcce-3476-4d66-a1fd-294661368a3b None admin] REQUEST_METHOD: `GET` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:18:55.538974 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af4fcce-3476-4d66-a1fd-294661368a3b None admin] SCRIPT_NAME: `/identity` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:18:55.539251 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af4fcce-3476-4d66-a1fd-294661368a3b None admin] PATH_INFO: `/v3/projects/ef022c0e613d4a2bac6fe1e0e339b92c` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:18:55.540541 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af4fcce-3476-4d66-a1fd-294661368a3b None admin] RBAC: Authorizing `identity:get_project(project_id=ef022c0e613d4a2bac6fe1e0e339b92c)` {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:18:55.542159 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af4fcce-3476-4d66-a1fd-294661368a3b None admin] RBAC: Authorization granted {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:18:55.548864 dv-cinder-851351-1-smb devstack@keystone.service[479852]: [pid: 479852|app: 0|req: 226/442] 10.222.0.42 () {56 vars in 1186 bytes} [Thu Jul 28 09:18:55 2022] GET /identity/v3/projects/ef022c0e613d4a2bac6fe1e0e339b92c => generated 302 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:18:55.550149 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0edc36-65d0-4dd3-a986-02b36c425c74 None None] REQUEST_METHOD: `POST` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:18:55.550455 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0edc36-65d0-4dd3-a986-02b36c425c74 None None] SCRIPT_NAME: `/identity` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:18:55.550867 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0edc36-65d0-4dd3-a986-02b36c425c74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:18:55.570603 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.auth.core [None req-9b0edc36-65d0-4dd3-a986-02b36c425c74 None None] MFA Rules not processed for user `c198f91a4ae84d2b9cc730a6e304c2be`. Rule list: `[]` (Enabled: `True`). {{(pid=479852) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 09:18:55.572163 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.fernet_utils [None req-9b0edc36-65d0-4dd3-a986-02b36c425c74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=479852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 09:18:55.578332 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3fa31e-3872-40ff-a3dd-51eabca5878f None None] Validating token access rules against request {{(pid=479851) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:18:55.622295 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e90a17d-3e44-4350-8631-08d75b296bad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479851) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:18:55.622852 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e90a17d-3e44-4350-8631-08d75b296bad None admin] REQUEST_METHOD: `GET` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:18:55.623143 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e90a17d-3e44-4350-8631-08d75b296bad None admin] SCRIPT_NAME: `/identity` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:18:55.623429 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e90a17d-3e44-4350-8631-08d75b296bad None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:18:55.646290 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG dbcounter [-] [479851] Writing DB stats keystone:SELECT=100 {{(pid=479851) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:18:55.660647 dv-cinder-851351-1-smb devstack@keystone.service[479852]: [pid: 479852|app: 0|req: 227/443] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 09:18:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 09:18:55.661494 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0edc36-65d0-4dd3-a986-02b36c425c74 None None] Authenticating user token {{(pid=479852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:18:55.670467 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG dbcounter [-] [479852] Writing DB stats keystone:SELECT=100 {{(pid=479852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:18:55.715301 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e90a17d-3e44-4350-8631-08d75b296bad None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:18:55.716940 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e90a17d-3e44-4350-8631-08d75b296bad None admin] RBAC: Authorization granted {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:18:55.783107 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0edc36-65d0-4dd3-a986-02b36c425c74 None None] Validating token access rules against request {{(pid=479852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:18:55.829390 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc0c287a-2c67-4390-872b-c0f9d2dce461 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:18:55.830062 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0c287a-2c67-4390-872b-c0f9d2dce461 None admin] REQUEST_METHOD: `GET` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:18:55.830347 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0c287a-2c67-4390-872b-c0f9d2dce461 None admin] SCRIPT_NAME: `/identity` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:18:55.830627 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0c287a-2c67-4390-872b-c0f9d2dce461 None admin] PATH_INFO: `/v3/groups/10982903b2844ab4bdbbb8dd377d478f` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:18:55.831933 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc0c287a-2c67-4390-872b-c0f9d2dce461 None admin] RBAC: Authorizing `identity:get_group(group_id=10982903b2844ab4bdbbb8dd377d478f)` {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:18:55.833424 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc0c287a-2c67-4390-872b-c0f9d2dce461 None admin] RBAC: Authorization granted {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:18:55.835183 dv-cinder-851351-1-smb devstack@keystone.service[479852]: [pid: 479852|app: 0|req: 228/444] 10.222.0.42 () {56 vars in 1180 bytes} [Thu Jul 28 09:18:55 2022] GET /identity/v3/groups/10982903b2844ab4bdbbb8dd377d478f => generated 226 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:18:55.836076 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc0c287a-2c67-4390-872b-c0f9d2dce461 None admin] Authenticating user token {{(pid=479852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:18:55.847356 dv-cinder-851351-1-smb devstack@keystone.service[479851]: [pid: 479851|app: 0|req: 217/445] 10.222.0.42 () {58 vars in 1282 bytes} [Thu Jul 28 09:18:55 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 388 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 28 09:18:55.847356 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e90a17d-3e44-4350-8631-08d75b296bad None admin] Authenticating user token {{(pid=479851) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:18:55.895527 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG dbcounter [-] [479851] Writing DB stats keystone:SELECT=100 {{(pid=479851) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:18:55.910986 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG dbcounter [-] [479852] Writing DB stats keystone:SELECT=100 {{(pid=479852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:18:55.937557 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc0c287a-2c67-4390-872b-c0f9d2dce461 None admin] Validating token access rules against request {{(pid=479852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:18:55.945647 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e90a17d-3e44-4350-8631-08d75b296bad None admin] Validating token access rules against request {{(pid=479851) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:18:55.973680 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efff7688-64af-4eea-8c9b-f50bc636fda3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:18:55.974299 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efff7688-64af-4eea-8c9b-f50bc636fda3 None admin] REQUEST_METHOD: `GET` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:18:55.975572 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efff7688-64af-4eea-8c9b-f50bc636fda3 None admin] SCRIPT_NAME: `/identity` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:18:55.976149 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efff7688-64af-4eea-8c9b-f50bc636fda3 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:18:55.980237 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84922b7-f49d-45cc-87cf-f113886a5a52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479851) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:18:55.980909 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84922b7-f49d-45cc-87cf-f113886a5a52 None admin] REQUEST_METHOD: `GET` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:18:55.981198 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84922b7-f49d-45cc-87cf-f113886a5a52 None admin] SCRIPT_NAME: `/identity` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:18:55.981479 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84922b7-f49d-45cc-87cf-f113886a5a52 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:18:55.982290 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f84922b7-f49d-45cc-87cf-f113886a5a52 None admin] RBAC: Adding query filter params (group.id=10982903b2844ab4bdbbb8dd377d478f, role.id=acf1d2de5e5448beb6363dae3d154a02, scope.project.id=ef022c0e613d4a2bac6fe1e0e339b92c) {{(pid=479851) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 09:18:55.982613 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f84922b7-f49d-45cc-87cf-f113886a5a52 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:18:55.984096 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f84922b7-f49d-45cc-87cf-f113886a5a52 None admin] RBAC: Authorization granted {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:18:55.986892 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efff7688-64af-4eea-8c9b-f50bc636fda3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 09:18:55.990035 dv-cinder-851351-1-smb devstack@keystone.service[479851]: [pid: 479851|app: 0|req: 218/446] 10.222.0.42 () {56 vars in 1376 bytes} [Thu Jul 28 09:18:55 2022] GET /identity/v3/role_assignments?group.id=10982903b2844ab4bdbbb8dd377d478f&scope.project.id=ef022c0e613d4a2bac6fe1e0e339b92c&role.id=acf1d2de5e5448beb6363dae3d154a02 => generated 611 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:18:55.991001 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84922b7-f49d-45cc-87cf-f113886a5a52 None admin] Authenticating user token {{(pid=479851) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:18:55.991928 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application [None req-efff7688-64af-4eea-8c9b-f50bc636fda3 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 09:18:55.991928 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 09:18:55.991928 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 09:18:55.991928 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 09:18:55.991928 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 09:18:55.991928 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 09:18:55.991928 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 09:18:55.991928 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 09:18:55.991928 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 09:18:55.991928 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 09:18:55.991928 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 09:18:55.991928 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 09:18:55.991928 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 09:18:55.991928 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 09:18:55.991928 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 09:18:55.991928 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 09:18:55.993045 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 09:18:55.993045 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 09:18:55.993045 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 09:18:55.993045 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 09:18:55.993045 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 09:18:55.993045 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 09:18:55.993045 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 09:18:55.993045 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 09:18:55.993045 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 09:18:55.993045 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 09:18:55.993045 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 09:18:55.993045 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application with Lock( Jul 28 09:18:55.993045 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 09:18:55.993045 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self._enter() Jul 28 09:18:55.993045 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 09:18:55.993045 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 09:18:55.997994 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 09:18:55.997994 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self.creator() Jul 28 09:18:55.997994 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 09:18:55.997994 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application created_value = creator( Jul 28 09:18:55.997994 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 09:18:55.997994 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 09:18:55.997994 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 09:18:55.997994 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 09:18:55.997994 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 09:18:55.997994 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 09:18:55.997994 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 09:18:55.997994 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application Jul 28 09:18:55.997994 dv-cinder-851351-1-smb devstack@keystone.service[479852]: [pid: 479852|app: 0|req: 229/447] 10.222.0.42 () {56 vars in 1096 bytes} [Thu Jul 28 09:18:55 2022] GET /identity/v3/roles/admin => generated 83 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 09:18:56.001730 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efff7688-64af-4eea-8c9b-f50bc636fda3 None admin] Authenticating user token {{(pid=479852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:18:56.112624 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84922b7-f49d-45cc-87cf-f113886a5a52 None admin] Validating token access rules against request {{(pid=479851) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:18:56.117195 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efff7688-64af-4eea-8c9b-f50bc636fda3 None admin] Validating token access rules against request {{(pid=479852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:18:56.128513 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG dbcounter [-] [479851] Writing DB stats keystone:SELECT=100 {{(pid=479851) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:18:56.151558 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da3c6ac-0086-4cab-889b-0e2596df79eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479851) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:18:56.152421 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da3c6ac-0086-4cab-889b-0e2596df79eb None admin] REQUEST_METHOD: `GET` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:18:56.152558 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da3c6ac-0086-4cab-889b-0e2596df79eb None admin] SCRIPT_NAME: `/identity` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:18:56.152898 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da3c6ac-0086-4cab-889b-0e2596df79eb None admin] PATH_INFO: `/v3/projects/ef022c0e613d4a2bac6fe1e0e339b92c` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:18:56.154859 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2da3c6ac-0086-4cab-889b-0e2596df79eb None admin] RBAC: Authorizing `identity:get_project(project_id=ef022c0e613d4a2bac6fe1e0e339b92c)` {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:18:56.155954 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b983bc8-b898-4c86-964d-68d67b7c8548 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:18:56.156345 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2da3c6ac-0086-4cab-889b-0e2596df79eb None admin] RBAC: Authorization granted {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:18:56.156592 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b983bc8-b898-4c86-964d-68d67b7c8548 None admin] REQUEST_METHOD: `GET` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:18:56.156908 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b983bc8-b898-4c86-964d-68d67b7c8548 None admin] SCRIPT_NAME: `/identity` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:18:56.157186 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b983bc8-b898-4c86-964d-68d67b7c8548 None admin] PATH_INFO: `/v3/roles` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:18:56.157916 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b983bc8-b898-4c86-964d-68d67b7c8548 None admin] RBAC: Adding query filter params (name=admin) {{(pid=479852) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 09:18:56.158263 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b983bc8-b898-4c86-964d-68d67b7c8548 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:18:56.159148 dv-cinder-851351-1-smb devstack@keystone.service[479851]: [pid: 479851|app: 0|req: 219/448] 10.222.0.42 () {56 vars in 1186 bytes} [Thu Jul 28 09:18:55 2022] GET /identity/v3/projects/ef022c0e613d4a2bac6fe1e0e339b92c => generated 302 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:18:56.159706 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b983bc8-b898-4c86-964d-68d67b7c8548 None admin] RBAC: Authorization granted {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:18:56.161396 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG dbcounter [-] [479852] Writing DB stats keystone:SELECT=100 {{(pid=479852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:18:56.165350 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da3c6ac-0086-4cab-889b-0e2596df79eb None admin] Authenticating user token {{(pid=479851) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:18:56.171355 dv-cinder-851351-1-smb devstack@keystone.service[479852]: [pid: 479852|app: 0|req: 230/449] 10.222.0.42 () {56 vars in 1099 bytes} [Thu Jul 28 09:18:55 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:18:56.177138 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b983bc8-b898-4c86-964d-68d67b7c8548 None admin] Authenticating user token {{(pid=479852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:18:56.273484 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da3c6ac-0086-4cab-889b-0e2596df79eb None admin] Validating token access rules against request {{(pid=479851) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:18:56.281033 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b983bc8-b898-4c86-964d-68d67b7c8548 None admin] Validating token access rules against request {{(pid=479852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:18:56.308016 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b5901d-51a2-46c7-847f-196fcadaf7ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479851) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:18:56.308690 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b5901d-51a2-46c7-847f-196fcadaf7ec None admin] REQUEST_METHOD: `GET` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:18:56.308989 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b5901d-51a2-46c7-847f-196fcadaf7ec None admin] SCRIPT_NAME: `/identity` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:18:56.309266 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b5901d-51a2-46c7-847f-196fcadaf7ec None admin] PATH_INFO: `/v3/groups/10982903b2844ab4bdbbb8dd377d478f` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:18:56.310491 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3b5901d-51a2-46c7-847f-196fcadaf7ec None admin] RBAC: Authorizing `identity:get_group(group_id=10982903b2844ab4bdbbb8dd377d478f)` {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:18:56.311948 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3b5901d-51a2-46c7-847f-196fcadaf7ec None admin] RBAC: Authorization granted {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:18:56.313779 dv-cinder-851351-1-smb devstack@keystone.service[479851]: [pid: 479851|app: 0|req: 220/450] 10.222.0.42 () {56 vars in 1180 bytes} [Thu Jul 28 09:18:56 2022] GET /identity/v3/groups/10982903b2844ab4bdbbb8dd377d478f => generated 226 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 09:18:56.315568 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a369746a-af5e-4781-8389-c6ad5c3d6ebf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:18:56.316203 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a369746a-af5e-4781-8389-c6ad5c3d6ebf None admin] REQUEST_METHOD: `GET` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:18:56.316484 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a369746a-af5e-4781-8389-c6ad5c3d6ebf None admin] SCRIPT_NAME: `/identity` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:18:56.316789 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a369746a-af5e-4781-8389-c6ad5c3d6ebf None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:18:56.319874 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b5901d-51a2-46c7-847f-196fcadaf7ec None admin] Authenticating user token {{(pid=479851) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:18:56.371722 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG dbcounter [-] [479851] Writing DB stats keystone:SELECT=100 {{(pid=479851) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:18:56.389181 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG dbcounter [-] [479852] Writing DB stats keystone:SELECT=100 {{(pid=479852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:18:56.397726 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a369746a-af5e-4781-8389-c6ad5c3d6ebf None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:18:56.399196 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a369746a-af5e-4781-8389-c6ad5c3d6ebf None admin] RBAC: Authorization granted {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:18:56.424017 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b5901d-51a2-46c7-847f-196fcadaf7ec None admin] Validating token access rules against request {{(pid=479851) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:18:56.458398 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4117c7-60d8-4c9b-a5d1-5e1d489a204e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479851) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:18:56.459090 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4117c7-60d8-4c9b-a5d1-5e1d489a204e None admin] REQUEST_METHOD: `GET` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:18:56.459371 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4117c7-60d8-4c9b-a5d1-5e1d489a204e None admin] SCRIPT_NAME: `/identity` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:18:56.459654 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4117c7-60d8-4c9b-a5d1-5e1d489a204e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:18:56.460454 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e4117c7-60d8-4c9b-a5d1-5e1d489a204e None admin] RBAC: Adding query filter params (group.id=10982903b2844ab4bdbbb8dd377d478f, role.id=900fb424e172461d93a0db59afb0a12b, scope.project.id=ef022c0e613d4a2bac6fe1e0e339b92c) {{(pid=479851) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 09:18:56.460795 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e4117c7-60d8-4c9b-a5d1-5e1d489a204e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:18:56.462258 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e4117c7-60d8-4c9b-a5d1-5e1d489a204e None admin] RBAC: Authorization granted {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:18:56.467979 dv-cinder-851351-1-smb devstack@keystone.service[479851]: [pid: 479851|app: 0|req: 221/451] 10.222.0.42 () {56 vars in 1376 bytes} [Thu Jul 28 09:18:56 2022] GET /identity/v3/role_assignments?group.id=10982903b2844ab4bdbbb8dd377d478f&scope.project.id=ef022c0e613d4a2bac6fe1e0e339b92c&role.id=900fb424e172461d93a0db59afb0a12b => generated 611 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 09:18:56.506228 dv-cinder-851351-1-smb devstack@keystone.service[479852]: [pid: 479852|app: 0|req: 231/452] 10.222.0.42 () {58 vars in 1282 bytes} [Thu Jul 28 09:18:56 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 28 09:18:56.512046 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4117c7-60d8-4c9b-a5d1-5e1d489a204e None admin] Authenticating user token {{(pid=479851) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:18:56.639525 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4117c7-60d8-4c9b-a5d1-5e1d489a204e None admin] Validating token access rules against request {{(pid=479851) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:18:56.654780 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG dbcounter [-] [479851] Writing DB stats keystone:SELECT=100 {{(pid=479851) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:18:56.677106 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7d5867-ae9f-43cd-990d-ea1fc0a6ba88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479851) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:18:56.677934 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7d5867-ae9f-43cd-990d-ea1fc0a6ba88 None admin] REQUEST_METHOD: `GET` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:18:56.678466 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7d5867-ae9f-43cd-990d-ea1fc0a6ba88 None admin] SCRIPT_NAME: `/identity` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:18:56.679030 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7d5867-ae9f-43cd-990d-ea1fc0a6ba88 None admin] PATH_INFO: `/v3/projects/5cd1eb20d96b430f96760c31423a47ce` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:18:56.681363 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b7d5867-ae9f-43cd-990d-ea1fc0a6ba88 None admin] RBAC: Authorizing `identity:get_project(project_id=5cd1eb20d96b430f96760c31423a47ce)` {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:18:56.683149 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b7d5867-ae9f-43cd-990d-ea1fc0a6ba88 None admin] RBAC: Authorization granted {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:18:56.685523 dv-cinder-851351-1-smb devstack@keystone.service[479851]: [pid: 479851|app: 0|req: 222/453] 10.222.0.42 () {56 vars in 1186 bytes} [Thu Jul 28 09:18:56 2022] GET /identity/v3/projects/5cd1eb20d96b430f96760c31423a47ce => generated 344 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:18:56.691374 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a369746a-af5e-4781-8389-c6ad5c3d6ebf None admin] Authenticating user token {{(pid=479852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:18:56.791926 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG dbcounter [-] [479852] Writing DB stats keystone:SELECT=100 {{(pid=479852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:18:56.798916 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a369746a-af5e-4781-8389-c6ad5c3d6ebf None admin] Validating token access rules against request {{(pid=479852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:18:56.835013 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3248ea0-b75e-4339-bf85-4ba054532d86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:18:56.835665 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3248ea0-b75e-4339-bf85-4ba054532d86 None admin] REQUEST_METHOD: `GET` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:18:56.835945 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3248ea0-b75e-4339-bf85-4ba054532d86 None admin] SCRIPT_NAME: `/identity` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:18:56.836219 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3248ea0-b75e-4339-bf85-4ba054532d86 None admin] PATH_INFO: `/v3/groups/d6c4acea956a415795de5da3a5962b6b` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:18:56.837504 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3248ea0-b75e-4339-bf85-4ba054532d86 None admin] RBAC: Authorizing `identity:get_group(group_id=d6c4acea956a415795de5da3a5962b6b)` {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:18:56.838915 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3248ea0-b75e-4339-bf85-4ba054532d86 None admin] RBAC: Authorization granted {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:18:56.840542 dv-cinder-851351-1-smb devstack@keystone.service[479852]: [pid: 479852|app: 0|req: 232/454] 10.222.0.42 () {56 vars in 1180 bytes} [Thu Jul 28 09:18:56 2022] GET /identity/v3/groups/d6c4acea956a415795de5da3a5962b6b => generated 229 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:18:56.846651 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7d5867-ae9f-43cd-990d-ea1fc0a6ba88 None admin] Authenticating user token {{(pid=479851) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:18:56.962406 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7d5867-ae9f-43cd-990d-ea1fc0a6ba88 None admin] Validating token access rules against request {{(pid=479851) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:18:56.995762 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad185cef-b2cd-4dcc-8440-8d49b46fcd85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479851) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:18:56.996392 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad185cef-b2cd-4dcc-8440-8d49b46fcd85 None admin] REQUEST_METHOD: `GET` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:18:56.996701 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad185cef-b2cd-4dcc-8440-8d49b46fcd85 None admin] SCRIPT_NAME: `/identity` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:18:56.996988 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad185cef-b2cd-4dcc-8440-8d49b46fcd85 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:18:56.997801 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad185cef-b2cd-4dcc-8440-8d49b46fcd85 None admin] RBAC: Adding query filter params (group.id=d6c4acea956a415795de5da3a5962b6b, role.id=685084310b35477b9b2d0c7934d0f803, scope.project.id=5cd1eb20d96b430f96760c31423a47ce) {{(pid=479851) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 09:18:56.998118 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad185cef-b2cd-4dcc-8440-8d49b46fcd85 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:18:56.999570 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad185cef-b2cd-4dcc-8440-8d49b46fcd85 None admin] RBAC: Authorization granted {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:18:57.005593 dv-cinder-851351-1-smb devstack@keystone.service[479851]: [pid: 479851|app: 0|req: 223/455] 10.222.0.42 () {56 vars in 1376 bytes} [Thu Jul 28 09:18:56 2022] GET /identity/v3/role_assignments?group.id=d6c4acea956a415795de5da3a5962b6b&scope.project.id=5cd1eb20d96b430f96760c31423a47ce&role.id=685084310b35477b9b2d0c7934d0f803 => generated 611 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:18:59.521765 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6747e3df-0922-47ac-9d32-81ae6bcded11 None None] REQUEST_METHOD: `GET` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:18:59.522317 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf520cb-cf98-472c-8c71-7ae8f6e31dc8 None None] REQUEST_METHOD: `GET` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:18:59.522317 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf520cb-cf98-472c-8c71-7ae8f6e31dc8 None None] SCRIPT_NAME: `/identity` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:18:59.522317 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf520cb-cf98-472c-8c71-7ae8f6e31dc8 None None] PATH_INFO: `/` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:18:59.523400 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6747e3df-0922-47ac-9d32-81ae6bcded11 None None] SCRIPT_NAME: `/identity` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:18:59.523951 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6747e3df-0922-47ac-9d32-81ae6bcded11 None None] PATH_INFO: `/` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:18:59.524064 dv-cinder-851351-1-smb devstack@keystone.service[479851]: [pid: 479851|app: 0|req: 224/456] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 09:18:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 09:18:59.525645 dv-cinder-851351-1-smb devstack@keystone.service[479852]: [pid: 479852|app: 0|req: 233/457] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 09:18:59 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 09:18:59.531083 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322ac594-952c-4b8e-98a5-0d08a2302a95 None None] REQUEST_METHOD: `POST` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:18:59.531357 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4fd3172-736a-4ef0-a0aa-49d66280ce03 None None] REQUEST_METHOD: `POST` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:18:59.531575 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4fd3172-736a-4ef0-a0aa-49d66280ce03 None None] SCRIPT_NAME: `/identity` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:18:59.531771 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4fd3172-736a-4ef0-a0aa-49d66280ce03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:18:59.532251 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322ac594-952c-4b8e-98a5-0d08a2302a95 None None] SCRIPT_NAME: `/identity` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:18:59.532790 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322ac594-952c-4b8e-98a5-0d08a2302a95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:18:59.559464 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.auth.core [None req-b4fd3172-736a-4ef0-a0aa-49d66280ce03 None None] MFA Rules not processed for user `c198f91a4ae84d2b9cc730a6e304c2be`. Rule list: `[]` (Enabled: `True`). {{(pid=479852) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 09:18:59.560719 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.fernet_utils [None req-b4fd3172-736a-4ef0-a0aa-49d66280ce03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=479852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 09:18:59.568434 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.auth.core [None req-322ac594-952c-4b8e-98a5-0d08a2302a95 None None] MFA Rules not processed for user `c198f91a4ae84d2b9cc730a6e304c2be`. Rule list: `[]` (Enabled: `True`). {{(pid=479851) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 09:18:59.570572 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.fernet_utils [None req-322ac594-952c-4b8e-98a5-0d08a2302a95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=479851) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 09:18:59.656741 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG dbcounter [-] [479851] Writing DB stats keystone:SELECT=100 {{(pid=479851) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:18:59.685866 dv-cinder-851351-1-smb devstack@keystone.service[479852]: [pid: 479852|app: 0|req: 234/458] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 09:18:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 09:18:59.696676 dv-cinder-851351-1-smb devstack@keystone.service[479851]: [pid: 479851|app: 0|req: 225/459] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 09:18:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 09:18:59.711784 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4fd3172-736a-4ef0-a0aa-49d66280ce03 None None] Authenticating user token {{(pid=479852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:18:59.722852 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322ac594-952c-4b8e-98a5-0d08a2302a95 None None] Authenticating user token {{(pid=479851) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:18:59.871858 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322ac594-952c-4b8e-98a5-0d08a2302a95 None None] Validating token access rules against request {{(pid=479851) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:18:59.873842 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG dbcounter [-] [479852] Writing DB stats keystone:SELECT=100 {{(pid=479852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:18:59.891237 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4fd3172-736a-4ef0-a0aa-49d66280ce03 None None] Validating token access rules against request {{(pid=479852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:18:59.914079 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e66104-eb4b-4374-ae77-1dd3e225bc24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479851) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:18:59.915799 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e66104-eb4b-4374-ae77-1dd3e225bc24 None admin] REQUEST_METHOD: `GET` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:18:59.916295 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e66104-eb4b-4374-ae77-1dd3e225bc24 None admin] SCRIPT_NAME: `/identity` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:18:59.916425 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e66104-eb4b-4374-ae77-1dd3e225bc24 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:18:59.935424 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0e66104-eb4b-4374-ae77-1dd3e225bc24 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:18:59.938179 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0e66104-eb4b-4374-ae77-1dd3e225bc24 None admin] RBAC: Authorization granted {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:18:59.956404 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application [None req-a0e66104-eb4b-4374-ae77-1dd3e225bc24 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 09:18:59.956404 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 09:18:59.956404 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 09:18:59.956404 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 09:18:59.956404 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 09:18:59.956404 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 09:18:59.956404 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 09:18:59.956404 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 09:18:59.956404 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 09:18:59.956404 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 09:18:59.956404 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 09:18:59.956404 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 09:18:59.956404 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 09:18:59.956404 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 09:18:59.956404 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 09:18:59.957700 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 09:18:59.957700 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 09:18:59.957700 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 09:18:59.957700 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 09:18:59.957700 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 09:18:59.957700 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 09:18:59.957700 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 09:18:59.957700 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 09:18:59.957700 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application with Lock( Jul 28 09:18:59.957700 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 09:18:59.957700 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return self._enter() Jul 28 09:18:59.957700 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 09:18:59.957700 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 09:18:59.957700 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 09:18:59.957700 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return self.creator() Jul 28 09:18:59.957700 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 09:18:59.957700 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application created_value = creator( Jul 28 09:18:59.958994 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 09:18:59.958994 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 09:18:59.958994 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 09:18:59.958994 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application Jul 28 09:18:59.961070 dv-cinder-851351-1-smb devstack@keystone.service[479851]: [pid: 479851|app: 0|req: 226/460] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 09:18:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 09:18:59.965558 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c79e97-674d-49df-8bc3-6f24352d4bd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:18:59.966680 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e66104-eb4b-4374-ae77-1dd3e225bc24 None admin] Authenticating user token {{(pid=479851) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:18:59.967555 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c79e97-674d-49df-8bc3-6f24352d4bd0 None admin] REQUEST_METHOD: `GET` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:18:59.968974 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c79e97-674d-49df-8bc3-6f24352d4bd0 None admin] SCRIPT_NAME: `/identity` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:18:59.970171 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c79e97-674d-49df-8bc3-6f24352d4bd0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:18:59.985414 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03c79e97-674d-49df-8bc3-6f24352d4bd0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:18:59.987353 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03c79e97-674d-49df-8bc3-6f24352d4bd0 None admin] RBAC: Authorization granted {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:19:00.008014 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application [None req-03c79e97-674d-49df-8bc3-6f24352d4bd0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 09:19:00.008014 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 09:19:00.008014 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 09:19:00.008014 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 09:19:00.008014 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 09:19:00.008014 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 09:19:00.008014 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 09:19:00.008014 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 09:19:00.008014 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 09:19:00.008014 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 09:19:00.008014 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 09:19:00.008014 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 09:19:00.008014 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 09:19:00.008014 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 09:19:00.008014 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 09:19:00.009392 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 09:19:00.009392 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 09:19:00.009392 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 09:19:00.009392 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 09:19:00.009392 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 09:19:00.009392 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 09:19:00.009392 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 09:19:00.009392 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 09:19:00.009392 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application with Lock( Jul 28 09:19:00.009392 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 09:19:00.009392 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self._enter() Jul 28 09:19:00.009392 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 09:19:00.009392 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 09:19:00.009392 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 09:19:00.009392 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self.creator() Jul 28 09:19:00.009392 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 09:19:00.009392 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application created_value = creator( Jul 28 09:19:00.010497 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 09:19:00.010497 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 09:19:00.010497 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 09:19:00.010497 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application Jul 28 09:19:00.011098 dv-cinder-851351-1-smb devstack@keystone.service[479852]: [pid: 479852|app: 0|req: 235/461] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 09:18:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 300 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 09:19:00.014222 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a527c85-23ec-426d-90e9-efcdf54730ac None None] REQUEST_METHOD: `GET` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:19:00.015030 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a527c85-23ec-426d-90e9-efcdf54730ac None None] SCRIPT_NAME: `/identity` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:19:00.015625 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a527c85-23ec-426d-90e9-efcdf54730ac None None] PATH_INFO: `/` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:19:00.021179 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG dbcounter [-] [479851] Writing DB stats keystone:SELECT=100 {{(pid=479851) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:19:00.022234 dv-cinder-851351-1-smb devstack@keystone.service[479852]: [pid: 479852|app: 0|req: 236/462] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 09:19:00 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 09:19:00.024421 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a527c85-23ec-426d-90e9-efcdf54730ac None None] Authenticating user token {{(pid=479852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:19:00.095651 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e66104-eb4b-4374-ae77-1dd3e225bc24 None admin] Validating token access rules against request {{(pid=479851) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:19:00.145239 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c15358-6e6d-48be-99f0-63c56ae45cac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479851) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:19:00.146483 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c15358-6e6d-48be-99f0-63c56ae45cac None admin] REQUEST_METHOD: `GET` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:19:00.146922 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c15358-6e6d-48be-99f0-63c56ae45cac None admin] SCRIPT_NAME: `/identity` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:19:00.147352 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c15358-6e6d-48be-99f0-63c56ae45cac None admin] PATH_INFO: `/v3/domains` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:19:00.148583 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c15358-6e6d-48be-99f0-63c56ae45cac None admin] RBAC: Adding query filter params (name=Default) {{(pid=479851) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 09:19:00.149476 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c15358-6e6d-48be-99f0-63c56ae45cac None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:19:00.151709 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c15358-6e6d-48be-99f0-63c56ae45cac None admin] RBAC: Authorization granted {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:19:00.157068 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a527c85-23ec-426d-90e9-efcdf54730ac None None] Validating token access rules against request {{(pid=479852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:19:00.180685 dv-cinder-851351-1-smb devstack@keystone.service[479851]: [pid: 479851|app: 0|req: 227/463] 10.222.0.42 () {56 vars in 1109 bytes} [Thu Jul 28 09:18:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:19:00.182524 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5252174-6108-4a7d-ac3d-93d3f40eab8c None None] REQUEST_METHOD: `POST` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:19:00.182825 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5252174-6108-4a7d-ac3d-93d3f40eab8c None None] SCRIPT_NAME: `/identity` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:19:00.183127 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5252174-6108-4a7d-ac3d-93d3f40eab8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:19:00.194844 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9178a6cc-4a68-4fde-bc67-39342b94fe8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:19:00.195483 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9178a6cc-4a68-4fde-bc67-39342b94fe8a None admin] REQUEST_METHOD: `GET` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:19:00.195769 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9178a6cc-4a68-4fde-bc67-39342b94fe8a None admin] SCRIPT_NAME: `/identity` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:19:00.196050 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9178a6cc-4a68-4fde-bc67-39342b94fe8a None admin] PATH_INFO: `/v3/domains` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:19:00.197158 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9178a6cc-4a68-4fde-bc67-39342b94fe8a None admin] RBAC: Adding query filter params (name=Default) {{(pid=479852) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 09:19:00.197476 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9178a6cc-4a68-4fde-bc67-39342b94fe8a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:19:00.198884 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9178a6cc-4a68-4fde-bc67-39342b94fe8a None admin] RBAC: Authorization granted {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:19:00.205977 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.auth.core [None req-a5252174-6108-4a7d-ac3d-93d3f40eab8c None None] MFA Rules not processed for user `c198f91a4ae84d2b9cc730a6e304c2be`. Rule list: `[]` (Enabled: `True`). {{(pid=479851) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 09:19:00.207838 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.fernet_utils [None req-a5252174-6108-4a7d-ac3d-93d3f40eab8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=479851) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 09:19:00.212628 dv-cinder-851351-1-smb devstack@keystone.service[479852]: [pid: 479852|app: 0|req: 237/464] 10.222.0.42 () {56 vars in 1109 bytes} [Thu Jul 28 09:19:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:19:00.213571 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9178a6cc-4a68-4fde-bc67-39342b94fe8a None admin] Authenticating user token {{(pid=479852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:19:00.223746 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG dbcounter [-] [479852] Writing DB stats keystone:SELECT=100 {{(pid=479852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:19:00.297361 dv-cinder-851351-1-smb devstack@keystone.service[479851]: [pid: 479851|app: 0|req: 228/465] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 09:19:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 09:19:00.298238 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5252174-6108-4a7d-ac3d-93d3f40eab8c None None] Authenticating user token {{(pid=479851) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:19:00.328511 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG dbcounter [-] [479851] Writing DB stats keystone:SELECT=100 {{(pid=479851) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:19:00.333662 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9178a6cc-4a68-4fde-bc67-39342b94fe8a None admin] Validating token access rules against request {{(pid=479852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:19:00.376618 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-268e2b43-4ad1-44ea-acd2-8e20831c7588 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:19:00.377212 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268e2b43-4ad1-44ea-acd2-8e20831c7588 None admin] REQUEST_METHOD: `POST` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:19:00.377500 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268e2b43-4ad1-44ea-acd2-8e20831c7588 None admin] SCRIPT_NAME: `/identity` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:19:00.377780 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268e2b43-4ad1-44ea-acd2-8e20831c7588 None admin] PATH_INFO: `/v3/users` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:19:00.378489 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-268e2b43-4ad1-44ea-acd2-8e20831c7588 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:19:00.379996 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-268e2b43-4ad1-44ea-acd2-8e20831c7588 None admin] RBAC: Authorization granted {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:19:00.406832 dv-cinder-851351-1-smb devstack@keystone.service[479852]: [pid: 479852|app: 0|req: 238/466] 10.222.0.42 () {60 vars in 1132 bytes} [Thu Jul 28 09:19:00 2022] POST /identity/v3/users => generated 246 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 09:19:00.408401 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a6b517-e0ff-4bb7-b545-3968a38942ff None None] REQUEST_METHOD: `GET` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:19:00.408707 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a6b517-e0ff-4bb7-b545-3968a38942ff None None] SCRIPT_NAME: `/identity` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:19:00.409013 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a6b517-e0ff-4bb7-b545-3968a38942ff None None] PATH_INFO: `/` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:19:00.412779 dv-cinder-851351-1-smb devstack@keystone.service[479852]: [pid: 479852|app: 0|req: 239/467] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 09:19:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 09:19:00.412779 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a6b517-e0ff-4bb7-b545-3968a38942ff None None] Authenticating user token {{(pid=479852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:19:00.447956 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5252174-6108-4a7d-ac3d-93d3f40eab8c None None] Validating token access rules against request {{(pid=479851) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:19:00.503377 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be2aea41-9b46-4299-aca3-23119d22d1c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479851) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:19:00.505074 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2aea41-9b46-4299-aca3-23119d22d1c7 None admin] REQUEST_METHOD: `POST` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:19:00.505575 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2aea41-9b46-4299-aca3-23119d22d1c7 None admin] SCRIPT_NAME: `/identity` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:19:00.506394 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2aea41-9b46-4299-aca3-23119d22d1c7 None admin] PATH_INFO: `/v3/users` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:19:00.507315 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be2aea41-9b46-4299-aca3-23119d22d1c7 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:19:00.510334 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be2aea41-9b46-4299-aca3-23119d22d1c7 None admin] RBAC: Authorization granted {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:19:00.512196 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG dbcounter [-] [479852] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=479852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:19:00.548371 dv-cinder-851351-1-smb devstack@keystone.service[479851]: [pid: 479851|app: 0|req: 229/468] 10.222.0.42 () {60 vars in 1132 bytes} [Thu Jul 28 09:19:00 2022] POST /identity/v3/users => generated 248 bytes in 250 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 09:19:00.550630 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7229643-d121-4731-909e-2eee7eca98ca None None] REQUEST_METHOD: `POST` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:19:00.551125 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7229643-d121-4731-909e-2eee7eca98ca None None] SCRIPT_NAME: `/identity` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:19:00.551563 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7229643-d121-4731-909e-2eee7eca98ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:19:00.576333 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.auth.core [None req-b7229643-d121-4731-909e-2eee7eca98ca None None] MFA Rules not processed for user `c198f91a4ae84d2b9cc730a6e304c2be`. Rule list: `[]` (Enabled: `True`). {{(pid=479851) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 09:19:00.578456 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.fernet_utils [None req-b7229643-d121-4731-909e-2eee7eca98ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=479851) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 09:19:00.587295 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a6b517-e0ff-4bb7-b545-3968a38942ff None None] Validating token access rules against request {{(pid=479852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:19:00.649042 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57626841-417d-4595-96f4-0d5534e37dd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:19:00.650125 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57626841-417d-4595-96f4-0d5534e37dd1 None admin] REQUEST_METHOD: `GET` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:19:00.650644 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57626841-417d-4595-96f4-0d5534e37dd1 None admin] SCRIPT_NAME: `/identity` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:19:00.651151 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57626841-417d-4595-96f4-0d5534e37dd1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:19:00.670560 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57626841-417d-4595-96f4-0d5534e37dd1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:19:00.672620 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57626841-417d-4595-96f4-0d5534e37dd1 None admin] RBAC: Authorization granted {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:19:00.677170 dv-cinder-851351-1-smb devstack@keystone.service[479851]: [pid: 479851|app: 0|req: 230/469] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 09:19:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 09:19:00.698153 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application [None req-57626841-417d-4595-96f4-0d5534e37dd1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 09:19:00.698153 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 09:19:00.698153 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 09:19:00.698153 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 09:19:00.698153 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 09:19:00.698153 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 09:19:00.698153 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 09:19:00.698153 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 09:19:00.698153 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 09:19:00.698153 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 09:19:00.698153 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 09:19:00.698153 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 09:19:00.698153 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 09:19:00.698153 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 09:19:00.698153 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 09:19:00.699240 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 09:19:00.699240 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 09:19:00.699240 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 09:19:00.699240 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 09:19:00.699240 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 09:19:00.699240 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 09:19:00.699240 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 09:19:00.699240 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 09:19:00.699240 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application with Lock( Jul 28 09:19:00.699240 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 09:19:00.699240 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self._enter() Jul 28 09:19:00.699240 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 09:19:00.699240 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 09:19:00.699240 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 09:19:00.699240 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self.creator() Jul 28 09:19:00.699240 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 09:19:00.699240 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application created_value = creator( Jul 28 09:19:00.700307 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 09:19:00.700307 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 09:19:00.700307 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 09:19:00.700307 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application Jul 28 09:19:00.702816 dv-cinder-851351-1-smb devstack@keystone.service[479852]: [pid: 479852|app: 0|req: 240/470] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 09:19:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 292 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 09:19:00.709079 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7229643-d121-4731-909e-2eee7eca98ca None None] Authenticating user token {{(pid=479851) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:19:00.714094 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG dbcounter [-] [479851] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=479851) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:19:00.717820 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57626841-417d-4595-96f4-0d5534e37dd1 None admin] Authenticating user token {{(pid=479852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:19:00.848882 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7229643-d121-4731-909e-2eee7eca98ca None None] Validating token access rules against request {{(pid=479851) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:19:00.859373 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57626841-417d-4595-96f4-0d5534e37dd1 None admin] Validating token access rules against request {{(pid=479852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:19:00.882749 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG dbcounter [-] [479852] Writing DB stats keystone:SELECT=100 {{(pid=479852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:19:00.909607 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f9c2a9-3d07-46a7-a076-71884024476d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479851) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:19:00.910260 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f9c2a9-3d07-46a7-a076-71884024476d None admin] REQUEST_METHOD: `GET` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:19:00.910559 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f9c2a9-3d07-46a7-a076-71884024476d None admin] SCRIPT_NAME: `/identity` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:19:00.910808 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f9c2a9-3d07-46a7-a076-71884024476d None admin] PATH_INFO: `/v3/domains` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:19:00.911524 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f9c2a9-3d07-46a7-a076-71884024476d None admin] RBAC: Adding query filter params (name=Default) {{(pid=479851) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 09:19:00.912549 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f9c2a9-3d07-46a7-a076-71884024476d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:19:00.913767 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f9c2a9-3d07-46a7-a076-71884024476d None admin] RBAC: Authorization granted {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:19:00.920043 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5080e36-7022-403d-8795-ff032cbb602a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:19:00.920043 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5080e36-7022-403d-8795-ff032cbb602a None admin] REQUEST_METHOD: `GET` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:19:00.920043 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5080e36-7022-403d-8795-ff032cbb602a None admin] SCRIPT_NAME: `/identity` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:19:00.920414 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5080e36-7022-403d-8795-ff032cbb602a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:19:00.926471 dv-cinder-851351-1-smb devstack@keystone.service[479851]: [pid: 479851|app: 0|req: 231/471] 10.222.0.42 () {56 vars in 1109 bytes} [Thu Jul 28 09:19:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:19:00.929046 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c96100-9ca9-43cc-b932-6cd2db626123 None None] REQUEST_METHOD: `GET` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:19:00.929772 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c96100-9ca9-43cc-b932-6cd2db626123 None None] SCRIPT_NAME: `/identity` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:19:00.930285 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c96100-9ca9-43cc-b932-6cd2db626123 None None] PATH_INFO: `/` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:19:00.936988 dv-cinder-851351-1-smb devstack@keystone.service[479851]: [pid: 479851|app: 0|req: 232/472] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 09:19:00 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 09:19:00.938301 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c96100-9ca9-43cc-b932-6cd2db626123 None None] Authenticating user token {{(pid=479851) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:19:00.942319 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5080e36-7022-403d-8795-ff032cbb602a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:19:00.944740 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5080e36-7022-403d-8795-ff032cbb602a None admin] RBAC: Authorization granted {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:19:00.967805 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application [None req-b5080e36-7022-403d-8795-ff032cbb602a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 09:19:00.967805 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 09:19:00.967805 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 09:19:00.967805 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 09:19:00.967805 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 09:19:00.967805 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 09:19:00.967805 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 09:19:00.967805 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 09:19:00.967805 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 09:19:00.967805 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 09:19:00.967805 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 09:19:00.967805 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 09:19:00.967805 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 09:19:00.967805 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 09:19:00.967805 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 09:19:00.968951 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 09:19:00.968951 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 09:19:00.968951 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 09:19:00.968951 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 09:19:00.968951 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 09:19:00.968951 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 09:19:00.968951 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 09:19:00.968951 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 09:19:00.968951 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application with Lock( Jul 28 09:19:00.968951 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 09:19:00.968951 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self._enter() Jul 28 09:19:00.968951 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 09:19:00.968951 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 09:19:00.968951 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 09:19:00.968951 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self.creator() Jul 28 09:19:00.968951 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 09:19:00.968951 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application created_value = creator( Jul 28 09:19:00.969974 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 09:19:00.969974 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 09:19:00.969974 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 09:19:00.969974 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application Jul 28 09:19:00.970464 dv-cinder-851351-1-smb devstack@keystone.service[479852]: [pid: 479852|app: 0|req: 241/473] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 09:19:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 253 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 09:19:00.973160 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50aa4178-12e2-48a9-9c0f-b1343bf0a2de None None] REQUEST_METHOD: `POST` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:19:00.973745 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50aa4178-12e2-48a9-9c0f-b1343bf0a2de None None] SCRIPT_NAME: `/identity` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:19:00.974281 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50aa4178-12e2-48a9-9c0f-b1343bf0a2de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:19:00.997511 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.auth.core [None req-50aa4178-12e2-48a9-9c0f-b1343bf0a2de None None] MFA Rules not processed for user `c198f91a4ae84d2b9cc730a6e304c2be`. Rule list: `[]` (Enabled: `True`). {{(pid=479852) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 09:19:00.998817 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.fernet_utils [None req-50aa4178-12e2-48a9-9c0f-b1343bf0a2de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=479852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 09:19:01.022909 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG dbcounter [-] [479851] Writing DB stats keystone:SELECT=100 {{(pid=479851) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:19:01.067869 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c96100-9ca9-43cc-b932-6cd2db626123 None None] Validating token access rules against request {{(pid=479851) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:19:01.080783 dv-cinder-851351-1-smb devstack@keystone.service[479852]: [pid: 479852|app: 0|req: 242/474] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 09:19:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 09:19:01.081783 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50aa4178-12e2-48a9-9c0f-b1343bf0a2de None None] Authenticating user token {{(pid=479852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:19:01.115174 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d0f4c8-0e91-4359-81a7-a88fe5475a88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479851) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:19:01.115959 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d0f4c8-0e91-4359-81a7-a88fe5475a88 None admin] REQUEST_METHOD: `POST` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:19:01.116253 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d0f4c8-0e91-4359-81a7-a88fe5475a88 None admin] SCRIPT_NAME: `/identity` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:19:01.116539 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d0f4c8-0e91-4359-81a7-a88fe5475a88 None admin] PATH_INFO: `/v3/users` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:19:01.117315 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08d0f4c8-0e91-4359-81a7-a88fe5475a88 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:19:01.119943 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08d0f4c8-0e91-4359-81a7-a88fe5475a88 None admin] RBAC: Authorization granted {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:19:01.150852 dv-cinder-851351-1-smb devstack@keystone.service[479851]: [pid: 479851|app: 0|req: 233/475] 10.222.0.42 () {60 vars in 1132 bytes} [Thu Jul 28 09:19:00 2022] POST /identity/v3/users => generated 248 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 09:19:01.151628 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d0f4c8-0e91-4359-81a7-a88fe5475a88 None admin] Authenticating user token {{(pid=479851) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:19:01.214311 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG dbcounter [-] [479852] Writing DB stats keystone:SELECT=100 {{(pid=479852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:19:01.222587 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50aa4178-12e2-48a9-9c0f-b1343bf0a2de None None] Validating token access rules against request {{(pid=479852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:19:01.263516 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb87c72-e8c0-4037-a437-034b6f83b7f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:19:01.264602 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb87c72-e8c0-4037-a437-034b6f83b7f8 None admin] REQUEST_METHOD: `GET` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:19:01.265011 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d0f4c8-0e91-4359-81a7-a88fe5475a88 None admin] Validating token access rules against request {{(pid=479851) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:19:01.265347 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb87c72-e8c0-4037-a437-034b6f83b7f8 None admin] SCRIPT_NAME: `/identity` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:19:01.265778 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb87c72-e8c0-4037-a437-034b6f83b7f8 None admin] PATH_INFO: `/v3/domains` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:19:01.266685 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cb87c72-e8c0-4037-a437-034b6f83b7f8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=479852) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 09:19:01.267396 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cb87c72-e8c0-4037-a437-034b6f83b7f8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:19:01.269824 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cb87c72-e8c0-4037-a437-034b6f83b7f8 None admin] RBAC: Authorization granted {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:19:01.286942 dv-cinder-851351-1-smb devstack@keystone.service[479852]: [pid: 479852|app: 0|req: 243/476] 10.222.0.42 () {56 vars in 1109 bytes} [Thu Jul 28 09:19:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:19:01.294575 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb87c72-e8c0-4037-a437-034b6f83b7f8 None admin] Authenticating user token {{(pid=479852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:19:01.299812 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG dbcounter [-] [479851] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=479851) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:19:01.320503 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7978cfa2-d9cc-436e-81d1-e67aec5ac0f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479851) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:19:01.321988 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7978cfa2-d9cc-436e-81d1-e67aec5ac0f5 None admin] REQUEST_METHOD: `POST` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:19:01.322537 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7978cfa2-d9cc-436e-81d1-e67aec5ac0f5 None admin] SCRIPT_NAME: `/identity` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:19:01.323067 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7978cfa2-d9cc-436e-81d1-e67aec5ac0f5 None admin] PATH_INFO: `/v3/roles` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:19:01.324039 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7978cfa2-d9cc-436e-81d1-e67aec5ac0f5 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:19:01.326596 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7978cfa2-d9cc-436e-81d1-e67aec5ac0f5 None admin] RBAC: Authorization granted {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:19:01.336646 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.sql.core [None req-7978cfa2-d9cc-436e-81d1-e67aec5ac0f5 None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jul 28 09:19:01.336646 dv-cinder-851351-1-smb devstack@keystone.service[479851]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Jul 28 09:19:01.336646 dv-cinder-851351-1-smb devstack@keystone.service[479851]: [parameters: {'id': '1b9151656971499c824c045434f67b81', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Jul 28 09:19:01.336646 dv-cinder-851351-1-smb devstack@keystone.service[479851]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=479851) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jul 28 09:19:01.364070 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application [None req-7978cfa2-d9cc-436e-81d1-e67aec5ac0f5 None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Jul 28 09:19:01.364070 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 09:19:01.364070 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 28 09:19:01.364070 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 28 09:19:01.364070 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 28 09:19:01.364070 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 28 09:19:01.364070 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 28 09:19:01.364070 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application result = self._query(query) Jul 28 09:19:01.364070 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 28 09:19:01.364070 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application conn.query(q) Jul 28 09:19:01.364070 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 28 09:19:01.364070 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 28 09:19:01.364070 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 28 09:19:01.364070 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application result.read() Jul 28 09:19:01.364070 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 28 09:19:01.365292 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 28 09:19:01.365292 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 28 09:19:01.365292 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 28 09:19:01.365292 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 28 09:19:01.365292 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 28 09:19:01.365292 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 28 09:19:01.365292 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 28 09:19:01.365292 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jul 28 09:19:01.365292 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application Jul 28 09:19:01.365292 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jul 28 09:19:01.365292 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application Jul 28 09:19:01.365292 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 09:19:01.365292 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jul 28 09:19:01.365292 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jul 28 09:19:01.365292 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role Jul 28 09:19:01.365292 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return ref.to_dict() Jul 28 09:19:01.365292 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 28 09:19:01.365292 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application next(self.gen) Jul 28 09:19:01.366407 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jul 28 09:19:01.366407 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application yield resource Jul 28 09:19:01.366407 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 28 09:19:01.366407 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application next(self.gen) Jul 28 09:19:01.366407 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jul 28 09:19:01.366407 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application self.session.rollback() Jul 28 09:19:01.366407 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 28 09:19:01.366407 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application self.force_reraise() Jul 28 09:19:01.366407 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 28 09:19:01.366407 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application raise self.value Jul 28 09:19:01.366407 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jul 28 09:19:01.366407 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jul 28 09:19:01.366407 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jul 28 09:19:01.366407 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application session.commit() Jul 28 09:19:01.366407 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jul 28 09:19:01.366407 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jul 28 09:19:01.366407 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jul 28 09:19:01.367700 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application self._prepare_impl() Jul 28 09:19:01.367700 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jul 28 09:19:01.367700 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application self.session.flush() Jul 28 09:19:01.367700 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jul 28 09:19:01.367700 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application self._flush(objects) Jul 28 09:19:01.367700 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jul 28 09:19:01.367700 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jul 28 09:19:01.367700 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jul 28 09:19:01.367700 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application compat.raise_( Jul 28 09:19:01.367700 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 28 09:19:01.367700 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application raise exception Jul 28 09:19:01.367700 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jul 28 09:19:01.367700 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application flush_context.execute() Jul 28 09:19:01.367700 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jul 28 09:19:01.367700 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application rec.execute(self) Jul 28 09:19:01.367700 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jul 28 09:19:01.367700 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jul 28 09:19:01.371362 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jul 28 09:19:01.371362 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application _emit_insert_statements( Jul 28 09:19:01.371362 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Jul 28 09:19:01.371362 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application c = connection._execute_20( Jul 28 09:19:01.371362 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jul 28 09:19:01.371362 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jul 28 09:19:01.371362 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Jul 28 09:19:01.371362 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jul 28 09:19:01.371362 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jul 28 09:19:01.371362 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application ret = self._execute_context( Jul 28 09:19:01.371362 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jul 28 09:19:01.371362 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jul 28 09:19:01.371362 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jul 28 09:19:01.371362 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jul 28 09:19:01.371362 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 28 09:19:01.371362 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application raise exception Jul 28 09:19:01.375424 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 28 09:19:01.375424 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 28 09:19:01.375424 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 28 09:19:01.375424 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 28 09:19:01.375424 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 28 09:19:01.375424 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application result = self._query(query) Jul 28 09:19:01.375424 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 28 09:19:01.375424 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application conn.query(q) Jul 28 09:19:01.375424 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 28 09:19:01.375424 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 28 09:19:01.375424 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 28 09:19:01.375424 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application result.read() Jul 28 09:19:01.375424 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 28 09:19:01.375424 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 28 09:19:01.375424 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 28 09:19:01.375424 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 28 09:19:01.377617 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 28 09:19:01.377617 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 28 09:19:01.377617 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 28 09:19:01.377617 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 28 09:19:01.377617 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jul 28 09:19:01.377617 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Jul 28 09:19:01.377617 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application [parameters: {'id': '1b9151656971499c824c045434f67b81', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Jul 28 09:19:01.377617 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jul 28 09:19:01.377617 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application Jul 28 09:19:01.377617 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 28 09:19:01.377617 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application Jul 28 09:19:01.377617 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 09:19:01.377617 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 09:19:01.377617 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 09:19:01.377617 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 09:19:01.377617 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 09:19:01.380290 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 09:19:01.380290 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 09:19:01.380290 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 09:19:01.380290 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 09:19:01.380290 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 09:19:01.380290 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 09:19:01.380290 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post Jul 28 09:19:01.380290 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( Jul 28 09:19:01.380290 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 09:19:01.380290 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 09:19:01.380290 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role Jul 28 09:19:01.380290 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) Jul 28 09:19:01.380290 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jul 28 09:19:01.380290 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jul 28 09:19:01.380290 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Jul 28 09:19:01.380290 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application Jul 28 09:19:01.383923 dv-cinder-851351-1-smb devstack@keystone.service[479851]: [pid: 479851|app: 0|req: 234/477] 10.222.0.42 () {60 vars in 1131 bytes} [Thu Jul 28 09:19:01 2022] POST /identity/v3/roles => generated 144 bytes in 215 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Jul 28 09:19:01.383923 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7978cfa2-d9cc-436e-81d1-e67aec5ac0f5 None admin] Authenticating user token {{(pid=479851) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:19:01.482025 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb87c72-e8c0-4037-a437-034b6f83b7f8 None admin] Validating token access rules against request {{(pid=479852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:19:01.521410 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e3b93e-c54f-469f-9c83-c210da98808f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:19:01.522089 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e3b93e-c54f-469f-9c83-c210da98808f None admin] REQUEST_METHOD: `POST` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:19:01.522373 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e3b93e-c54f-469f-9c83-c210da98808f None admin] SCRIPT_NAME: `/identity` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:19:01.522836 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e3b93e-c54f-469f-9c83-c210da98808f None admin] PATH_INFO: `/v3/users` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:19:01.523945 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92e3b93e-c54f-469f-9c83-c210da98808f None admin] RBAC: Authorizing `identity:create_user()` {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:19:01.525484 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92e3b93e-c54f-469f-9c83-c210da98808f None admin] RBAC: Authorization granted {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:19:01.542037 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7978cfa2-d9cc-436e-81d1-e67aec5ac0f5 None admin] Validating token access rules against request {{(pid=479851) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:19:01.560882 dv-cinder-851351-1-smb devstack@keystone.service[479852]: [pid: 479852|app: 0|req: 244/478] 10.222.0.42 () {60 vars in 1132 bytes} [Thu Jul 28 09:19:01 2022] POST /identity/v3/users => generated 249 bytes in 267 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 09:19:01.611944 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8edd9a0-0787-4636-926e-5c87be2b2090 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479851) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:19:01.613319 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8edd9a0-0787-4636-926e-5c87be2b2090 None admin] REQUEST_METHOD: `GET` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:19:01.613825 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8edd9a0-0787-4636-926e-5c87be2b2090 None admin] SCRIPT_NAME: `/identity` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:19:01.614285 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8edd9a0-0787-4636-926e-5c87be2b2090 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:19:01.634779 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8edd9a0-0787-4636-926e-5c87be2b2090 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 09:19:01.642553 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application [None req-f8edd9a0-0787-4636-926e-5c87be2b2090 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 28 09:19:01.642553 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 09:19:01.642553 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 09:19:01.642553 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 09:19:01.642553 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 09:19:01.642553 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 09:19:01.642553 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 09:19:01.642553 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 09:19:01.642553 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 09:19:01.642553 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 09:19:01.642553 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 09:19:01.642553 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 09:19:01.642553 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 09:19:01.642553 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 09:19:01.642553 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 09:19:01.642553 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 09:19:01.644975 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 09:19:01.644975 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 09:19:01.644975 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 09:19:01.644975 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 09:19:01.644975 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 09:19:01.644975 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 09:19:01.644975 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 09:19:01.644975 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 09:19:01.644975 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 09:19:01.644975 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 09:19:01.644975 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 09:19:01.644975 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application with Lock( Jul 28 09:19:01.644975 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 09:19:01.644975 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return self._enter() Jul 28 09:19:01.644975 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 09:19:01.644975 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 09:19:01.647228 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 09:19:01.647228 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return self.creator() Jul 28 09:19:01.647228 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 09:19:01.647228 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application created_value = creator( Jul 28 09:19:01.647228 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 09:19:01.647228 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 09:19:01.647228 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 09:19:01.647228 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 09:19:01.647228 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 09:19:01.647228 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 09:19:01.647228 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 28 09:19:01.647228 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application Jul 28 09:19:01.647228 dv-cinder-851351-1-smb devstack@keystone.service[479851]: [pid: 479851|app: 0|req: 235/479] 10.222.0.42 () {56 vars in 1114 bytes} [Thu Jul 28 09:19:01 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 269 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 09:19:01.652691 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e3b93e-c54f-469f-9c83-c210da98808f None admin] Authenticating user token {{(pid=479852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:19:01.677799 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG dbcounter [-] [479852] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=479852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:19:01.794308 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e3b93e-c54f-469f-9c83-c210da98808f None admin] Validating token access rules against request {{(pid=479852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:19:01.837709 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab0f3f3-3c9c-4c7b-b360-d21351cfa1d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:19:01.838433 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab0f3f3-3c9c-4c7b-b360-d21351cfa1d8 None admin] REQUEST_METHOD: `GET` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:19:01.838714 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab0f3f3-3c9c-4c7b-b360-d21351cfa1d8 None admin] SCRIPT_NAME: `/identity` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:19:01.838993 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab0f3f3-3c9c-4c7b-b360-d21351cfa1d8 None admin] PATH_INFO: `/v3/roles` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:19:01.839777 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ab0f3f3-3c9c-4c7b-b360-d21351cfa1d8 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=479852) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 09:19:01.840083 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ab0f3f3-3c9c-4c7b-b360-d21351cfa1d8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:19:01.841560 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ab0f3f3-3c9c-4c7b-b360-d21351cfa1d8 None admin] RBAC: Authorization granted {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:19:01.852919 dv-cinder-851351-1-smb devstack@keystone.service[479852]: [pid: 479852|app: 0|req: 245/480] 10.222.0.42 () {56 vars in 1111 bytes} [Thu Jul 28 09:19:01 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:19:02.941167 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9d94f7-89a7-470c-bbd3-541e7724fb1e None None] REQUEST_METHOD: `GET` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:19:02.942210 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9d94f7-89a7-470c-bbd3-541e7724fb1e None None] SCRIPT_NAME: `/identity` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:19:02.942210 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9d94f7-89a7-470c-bbd3-541e7724fb1e None None] PATH_INFO: `/` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:19:02.943590 dv-cinder-851351-1-smb devstack@keystone.service[479851]: [pid: 479851|app: 0|req: 236/481] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 09:19:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 09:19:02.950380 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f158f0-eeab-4de9-abc9-d21a98356cc4 None None] REQUEST_METHOD: `POST` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:19:02.951090 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f158f0-eeab-4de9-abc9-d21a98356cc4 None None] SCRIPT_NAME: `/identity` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:19:02.951090 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f158f0-eeab-4de9-abc9-d21a98356cc4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:19:02.981167 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.auth.core [None req-c2f158f0-eeab-4de9-abc9-d21a98356cc4 None None] MFA Rules not processed for user `c198f91a4ae84d2b9cc730a6e304c2be`. Rule list: `[]` (Enabled: `True`). {{(pid=479852) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 09:19:02.981167 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.fernet_utils [None req-c2f158f0-eeab-4de9-abc9-d21a98356cc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=479852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 09:19:03.075004 dv-cinder-851351-1-smb devstack@keystone.service[479852]: [pid: 479852|app: 0|req: 246/482] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 09:19:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 09:19:03.085492 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d16237-ea98-47c2-a450-cc0f0e2f5383 None None] REQUEST_METHOD: `GET` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:19:03.085844 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d16237-ea98-47c2-a450-cc0f0e2f5383 None None] SCRIPT_NAME: `/identity` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:19:03.086071 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d16237-ea98-47c2-a450-cc0f0e2f5383 None None] PATH_INFO: `/` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:19:03.087828 dv-cinder-851351-1-smb devstack@keystone.service[479851]: [pid: 479851|app: 0|req: 237/483] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 09:19:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 09:19:03.093074 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0450e39c-973a-4f0f-af23-43ecdea4b60e None None] REQUEST_METHOD: `POST` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:19:03.093653 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0450e39c-973a-4f0f-af23-43ecdea4b60e None None] SCRIPT_NAME: `/identity` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:19:03.094142 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0450e39c-973a-4f0f-af23-43ecdea4b60e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:19:03.098995 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d16237-ea98-47c2-a450-cc0f0e2f5383 None None] Authenticating user token {{(pid=479851) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:19:03.103185 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG dbcounter [-] [479852] Writing DB stats keystone:SELECT=100 {{(pid=479852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:19:03.120378 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.auth.core [None req-0450e39c-973a-4f0f-af23-43ecdea4b60e None None] MFA Rules not processed for user `c198f91a4ae84d2b9cc730a6e304c2be`. Rule list: `[]` (Enabled: `True`). {{(pid=479852) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 09:19:03.124637 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.fernet_utils [None req-0450e39c-973a-4f0f-af23-43ecdea4b60e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=479852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 09:19:03.179410 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG dbcounter [-] [479851] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=479851) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:19:03.266885 dv-cinder-851351-1-smb devstack@keystone.service[479852]: [pid: 479852|app: 0|req: 247/484] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 09:19:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 09:19:03.289459 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d16237-ea98-47c2-a450-cc0f0e2f5383 None None] Validating token access rules against request {{(pid=479851) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:19:03.292205 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0450e39c-973a-4f0f-af23-43ecdea4b60e None None] Authenticating user token {{(pid=479852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:19:03.373505 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8880923-445e-432d-ba09-09887d2dd9de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479851) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:19:03.374192 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8880923-445e-432d-ba09-09887d2dd9de None admin] REQUEST_METHOD: `GET` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:19:03.374476 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8880923-445e-432d-ba09-09887d2dd9de None admin] SCRIPT_NAME: `/identity` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:19:03.374755 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8880923-445e-432d-ba09-09887d2dd9de None admin] PATH_INFO: `/v3/roles/service` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:19:03.405177 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8880923-445e-432d-ba09-09887d2dd9de None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 09:19:03.410783 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application [None req-a8880923-445e-432d-ba09-09887d2dd9de None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 28 09:19:03.410783 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 09:19:03.410783 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 09:19:03.410783 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 09:19:03.410783 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 09:19:03.410783 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 09:19:03.410783 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 09:19:03.410783 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 09:19:03.410783 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 09:19:03.410783 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 09:19:03.410783 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 09:19:03.410783 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 09:19:03.410783 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 09:19:03.410783 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 09:19:03.410783 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 09:19:03.410783 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 09:19:03.412164 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 09:19:03.412164 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 09:19:03.412164 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 09:19:03.412164 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 09:19:03.412164 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 09:19:03.412164 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 09:19:03.412164 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 09:19:03.412164 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 09:19:03.412164 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 09:19:03.412164 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 09:19:03.412164 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 09:19:03.412164 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application with Lock( Jul 28 09:19:03.412164 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 09:19:03.412164 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return self._enter() Jul 28 09:19:03.412164 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 09:19:03.412164 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 09:19:03.413222 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 09:19:03.413222 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return self.creator() Jul 28 09:19:03.413222 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 09:19:03.413222 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application created_value = creator( Jul 28 09:19:03.413222 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 09:19:03.413222 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 09:19:03.413222 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 09:19:03.413222 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 09:19:03.413222 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 09:19:03.413222 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 09:19:03.413222 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 28 09:19:03.413222 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application Jul 28 09:19:03.421157 dv-cinder-851351-1-smb devstack@keystone.service[479851]: [pid: 479851|app: 0|req: 238/485] 10.222.0.42 () {56 vars in 1102 bytes} [Thu Jul 28 09:19:03 2022] GET /identity/v3/roles/service => generated 85 bytes in 322 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 09:19:03.426440 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0450e39c-973a-4f0f-af23-43ecdea4b60e None None] Validating token access rules against request {{(pid=479852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:19:03.427036 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8880923-445e-432d-ba09-09887d2dd9de None admin] Authenticating user token {{(pid=479851) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:19:03.466658 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ebc3443-058a-439c-9bd5-fea176adbdaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:19:03.468096 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ebc3443-058a-439c-9bd5-fea176adbdaf None admin] REQUEST_METHOD: `GET` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:19:03.468625 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ebc3443-058a-439c-9bd5-fea176adbdaf None admin] SCRIPT_NAME: `/identity` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:19:03.469150 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ebc3443-058a-439c-9bd5-fea176adbdaf None admin] PATH_INFO: `/v3/roles/service` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:19:03.471565 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG dbcounter [-] [479852] Writing DB stats keystone:SELECT=100 {{(pid=479852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:19:03.485402 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ebc3443-058a-439c-9bd5-fea176adbdaf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 09:19:03.491485 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application [None req-0ebc3443-058a-439c-9bd5-fea176adbdaf None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 28 09:19:03.491485 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 09:19:03.491485 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 09:19:03.491485 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 09:19:03.491485 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 09:19:03.491485 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 09:19:03.491485 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 09:19:03.491485 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 09:19:03.491485 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 09:19:03.491485 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 09:19:03.491485 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 09:19:03.491485 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 09:19:03.491485 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 09:19:03.491485 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 09:19:03.491485 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 09:19:03.491485 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 09:19:03.492623 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 09:19:03.492623 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 09:19:03.492623 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 09:19:03.492623 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 09:19:03.492623 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 09:19:03.492623 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 09:19:03.492623 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 09:19:03.492623 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 09:19:03.492623 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 09:19:03.492623 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 09:19:03.492623 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 09:19:03.492623 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application with Lock( Jul 28 09:19:03.492623 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 09:19:03.492623 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self._enter() Jul 28 09:19:03.492623 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 09:19:03.492623 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 09:19:03.493746 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 09:19:03.493746 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self.creator() Jul 28 09:19:03.493746 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 09:19:03.493746 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application created_value = creator( Jul 28 09:19:03.493746 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 09:19:03.493746 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 09:19:03.493746 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 09:19:03.493746 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 09:19:03.493746 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 09:19:03.493746 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 09:19:03.493746 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 28 09:19:03.493746 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application Jul 28 09:19:03.497205 dv-cinder-851351-1-smb devstack@keystone.service[479852]: [pid: 479852|app: 0|req: 248/486] 10.222.0.42 () {56 vars in 1102 bytes} [Thu Jul 28 09:19:03 2022] GET /identity/v3/roles/service => generated 85 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 09:19:03.504709 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ebc3443-058a-439c-9bd5-fea176adbdaf None admin] Authenticating user token {{(pid=479852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:19:03.632473 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ebc3443-058a-439c-9bd5-fea176adbdaf None admin] Validating token access rules against request {{(pid=479852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:19:03.677431 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f51eaaa1-569c-4625-8776-5e46c6861917 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:19:03.678078 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51eaaa1-569c-4625-8776-5e46c6861917 None admin] REQUEST_METHOD: `GET` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:19:03.678359 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51eaaa1-569c-4625-8776-5e46c6861917 None admin] SCRIPT_NAME: `/identity` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:19:03.678638 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51eaaa1-569c-4625-8776-5e46c6861917 None admin] PATH_INFO: `/v3/roles` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:19:03.679374 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f51eaaa1-569c-4625-8776-5e46c6861917 None admin] RBAC: Adding query filter params (name=service) {{(pid=479852) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 09:19:03.679684 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f51eaaa1-569c-4625-8776-5e46c6861917 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:19:03.686378 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f51eaaa1-569c-4625-8776-5e46c6861917 None admin] RBAC: Authorization granted {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:19:03.704806 dv-cinder-851351-1-smb devstack@keystone.service[479852]: [pid: 479852|app: 0|req: 249/487] 10.222.0.42 () {56 vars in 1103 bytes} [Thu Jul 28 09:19:03 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:19:03.711079 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f51eaaa1-569c-4625-8776-5e46c6861917 None admin] Authenticating user token {{(pid=479852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:19:03.716116 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8880923-445e-432d-ba09-09887d2dd9de None admin] Validating token access rules against request {{(pid=479851) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:19:03.723950 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG dbcounter [-] [479851] Writing DB stats keystone:SELECT=100 {{(pid=479851) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:19:03.794527 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc5c4b41-20a2-4fdb-8348-ba20c597fc4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479851) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:19:03.795178 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5c4b41-20a2-4fdb-8348-ba20c597fc4d None admin] REQUEST_METHOD: `GET` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:19:03.795462 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5c4b41-20a2-4fdb-8348-ba20c597fc4d None admin] SCRIPT_NAME: `/identity` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:19:03.795744 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5c4b41-20a2-4fdb-8348-ba20c597fc4d None admin] PATH_INFO: `/v3/roles` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:19:03.796491 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc5c4b41-20a2-4fdb-8348-ba20c597fc4d None admin] RBAC: Adding query filter params (name=service) {{(pid=479851) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 09:19:03.796830 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc5c4b41-20a2-4fdb-8348-ba20c597fc4d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:19:03.798266 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc5c4b41-20a2-4fdb-8348-ba20c597fc4d None admin] RBAC: Authorization granted {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:19:03.817345 dv-cinder-851351-1-smb devstack@keystone.service[479851]: [pid: 479851|app: 0|req: 239/488] 10.222.0.42 () {56 vars in 1103 bytes} [Thu Jul 28 09:19:03 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 391 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 09:19:03.824153 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc5c4b41-20a2-4fdb-8348-ba20c597fc4d None admin] Authenticating user token {{(pid=479851) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:19:03.837707 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG dbcounter [-] [479852] Writing DB stats keystone:SELECT=100 {{(pid=479852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:19:03.902269 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f51eaaa1-569c-4625-8776-5e46c6861917 None admin] Validating token access rules against request {{(pid=479852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:19:03.955860 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06356ce-a2bb-4ef2-a8ba-b58c075764fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:19:03.956555 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06356ce-a2bb-4ef2-a8ba-b58c075764fa None admin] REQUEST_METHOD: `GET` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:19:03.956856 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06356ce-a2bb-4ef2-a8ba-b58c075764fa None admin] SCRIPT_NAME: `/identity` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:19:03.957111 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06356ce-a2bb-4ef2-a8ba-b58c075764fa None admin] PATH_INFO: `/v3/domains/Default` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:19:03.973498 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a06356ce-a2bb-4ef2-a8ba-b58c075764fa None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:19:03.975356 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a06356ce-a2bb-4ef2-a8ba-b58c075764fa None admin] RBAC: Authorization granted {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:19:03.985083 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc5c4b41-20a2-4fdb-8348-ba20c597fc4d None admin] Validating token access rules against request {{(pid=479851) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:19:03.996425 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application [None req-a06356ce-a2bb-4ef2-a8ba-b58c075764fa None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 09:19:03.996425 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 09:19:03.996425 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 09:19:03.996425 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 09:19:03.996425 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 09:19:03.996425 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 09:19:03.996425 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 09:19:03.996425 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 09:19:03.996425 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 09:19:03.996425 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 09:19:03.996425 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 09:19:03.996425 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 09:19:03.996425 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 09:19:03.996425 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 09:19:03.996425 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 09:19:03.997858 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 09:19:03.997858 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 09:19:03.997858 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 09:19:03.997858 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 09:19:03.997858 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 09:19:03.997858 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 09:19:03.997858 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 09:19:03.997858 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 09:19:03.997858 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application with Lock( Jul 28 09:19:03.997858 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 09:19:03.997858 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self._enter() Jul 28 09:19:03.997858 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 09:19:03.997858 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 09:19:03.997858 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 09:19:03.997858 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self.creator() Jul 28 09:19:03.997858 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 09:19:03.997858 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application created_value = creator( Jul 28 09:19:03.999592 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 09:19:03.999592 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 09:19:03.999592 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 09:19:03.999592 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application Jul 28 09:19:03.999592 dv-cinder-851351-1-smb devstack@keystone.service[479852]: [pid: 479852|app: 0|req: 250/489] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 09:19:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 288 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 09:19:04.004769 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce98bc7a-10fa-40b2-80d9-9d9bc705cd90 None None] REQUEST_METHOD: `GET` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:19:04.004769 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce98bc7a-10fa-40b2-80d9-9d9bc705cd90 None None] SCRIPT_NAME: `/identity` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:19:04.004769 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce98bc7a-10fa-40b2-80d9-9d9bc705cd90 None None] PATH_INFO: `/` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:19:04.007307 dv-cinder-851351-1-smb devstack@keystone.service[479852]: [pid: 479852|app: 0|req: 251/490] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 09:19:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 09:19:04.008832 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce98bc7a-10fa-40b2-80d9-9d9bc705cd90 None None] Authenticating user token {{(pid=479852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:19:04.036656 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe0461a5-7b51-44b3-8f6c-023161fbd162 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479851) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:19:04.037686 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0461a5-7b51-44b3-8f6c-023161fbd162 None admin] REQUEST_METHOD: `GET` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:19:04.038415 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0461a5-7b51-44b3-8f6c-023161fbd162 None admin] SCRIPT_NAME: `/identity` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:19:04.038697 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0461a5-7b51-44b3-8f6c-023161fbd162 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:19:04.055773 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe0461a5-7b51-44b3-8f6c-023161fbd162 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:19:04.057928 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe0461a5-7b51-44b3-8f6c-023161fbd162 None admin] RBAC: Authorization granted {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:19:04.080160 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application [None req-fe0461a5-7b51-44b3-8f6c-023161fbd162 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 09:19:04.080160 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 09:19:04.080160 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 09:19:04.080160 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 09:19:04.080160 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 09:19:04.080160 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 09:19:04.080160 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 09:19:04.080160 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 09:19:04.080160 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 09:19:04.080160 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 09:19:04.080160 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 09:19:04.080160 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 09:19:04.080160 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 09:19:04.080160 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 09:19:04.080160 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 09:19:04.081960 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 09:19:04.081960 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 09:19:04.081960 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 09:19:04.081960 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 09:19:04.081960 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 09:19:04.081960 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 09:19:04.081960 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 09:19:04.081960 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 09:19:04.081960 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application with Lock( Jul 28 09:19:04.081960 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 09:19:04.081960 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return self._enter() Jul 28 09:19:04.081960 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 09:19:04.081960 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 09:19:04.081960 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 09:19:04.081960 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return self.creator() Jul 28 09:19:04.081960 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 09:19:04.081960 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application created_value = creator( Jul 28 09:19:04.087456 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 09:19:04.087456 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 09:19:04.087456 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 09:19:04.087456 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application Jul 28 09:19:04.087456 dv-cinder-851351-1-smb devstack@keystone.service[479851]: [pid: 479851|app: 0|req: 240/491] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 09:19:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 258 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 09:19:04.087456 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c911e5c-6a04-4527-890e-31a47728c7cc None None] REQUEST_METHOD: `POST` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:19:04.087456 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c911e5c-6a04-4527-890e-31a47728c7cc None None] SCRIPT_NAME: `/identity` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:19:04.087456 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c911e5c-6a04-4527-890e-31a47728c7cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:19:04.107464 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.auth.core [None req-3c911e5c-6a04-4527-890e-31a47728c7cc None None] MFA Rules not processed for user `c198f91a4ae84d2b9cc730a6e304c2be`. Rule list: `[]` (Enabled: `True`). {{(pid=479851) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 09:19:04.109699 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.fernet_utils [None req-3c911e5c-6a04-4527-890e-31a47728c7cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=479851) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 09:19:04.129327 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG dbcounter [-] [479851] Writing DB stats keystone:SELECT=100 {{(pid=479851) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:19:04.135852 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce98bc7a-10fa-40b2-80d9-9d9bc705cd90 None None] Validating token access rules against request {{(pid=479852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:19:04.150232 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG dbcounter [-] [479852] Writing DB stats keystone:SELECT=100 {{(pid=479852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:19:04.188625 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bbf00a0-a403-4d55-9fda-6a788d1e0067 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:19:04.190145 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bbf00a0-a403-4d55-9fda-6a788d1e0067 None admin] REQUEST_METHOD: `GET` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:19:04.190842 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bbf00a0-a403-4d55-9fda-6a788d1e0067 None admin] SCRIPT_NAME: `/identity` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:19:04.191291 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bbf00a0-a403-4d55-9fda-6a788d1e0067 None admin] PATH_INFO: `/v3/domains` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:19:04.192702 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bbf00a0-a403-4d55-9fda-6a788d1e0067 None admin] RBAC: Adding query filter params (name=Default) {{(pid=479852) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 09:19:04.193382 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bbf00a0-a403-4d55-9fda-6a788d1e0067 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:19:04.195594 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bbf00a0-a403-4d55-9fda-6a788d1e0067 None admin] RBAC: Authorization granted {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:19:04.204891 dv-cinder-851351-1-smb devstack@keystone.service[479851]: [pid: 479851|app: 0|req: 241/492] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 09:19:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 09:19:04.204891 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c911e5c-6a04-4527-890e-31a47728c7cc None None] Authenticating user token {{(pid=479851) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:19:04.222643 dv-cinder-851351-1-smb devstack@keystone.service[479852]: [pid: 479852|app: 0|req: 252/493] 10.222.0.42 () {56 vars in 1109 bytes} [Thu Jul 28 09:19:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:19:04.225259 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bbf00a0-a403-4d55-9fda-6a788d1e0067 None admin] Authenticating user token {{(pid=479852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:19:04.322847 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c911e5c-6a04-4527-890e-31a47728c7cc None None] Validating token access rules against request {{(pid=479851) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:19:04.346046 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bbf00a0-a403-4d55-9fda-6a788d1e0067 None admin] Validating token access rules against request {{(pid=479852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:19:04.365812 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f3e3c96-abc9-4532-9622-390b9b094b8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479851) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:19:04.366981 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3e3c96-abc9-4532-9622-390b9b094b8c None admin] REQUEST_METHOD: `GET` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:19:04.367561 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3e3c96-abc9-4532-9622-390b9b094b8c None admin] SCRIPT_NAME: `/identity` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:19:04.368074 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3e3c96-abc9-4532-9622-390b9b094b8c None admin] PATH_INFO: `/v3/domains` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:19:04.369090 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f3e3c96-abc9-4532-9622-390b9b094b8c None admin] RBAC: Adding query filter params (name=Default) {{(pid=479851) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 09:19:04.369643 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f3e3c96-abc9-4532-9622-390b9b094b8c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:19:04.371454 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f3e3c96-abc9-4532-9622-390b9b094b8c None admin] RBAC: Authorization granted {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:19:04.385711 dv-cinder-851351-1-smb devstack@keystone.service[479851]: [pid: 479851|app: 0|req: 242/494] 10.222.0.42 () {56 vars in 1109 bytes} [Thu Jul 28 09:19:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:19:04.396704 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44b6940-6dd0-48eb-8c2f-337889ba40d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:19:04.396704 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44b6940-6dd0-48eb-8c2f-337889ba40d4 None admin] REQUEST_METHOD: `GET` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:19:04.396704 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44b6940-6dd0-48eb-8c2f-337889ba40d4 None admin] SCRIPT_NAME: `/identity` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:19:04.396704 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44b6940-6dd0-48eb-8c2f-337889ba40d4 None admin] PATH_INFO: `/v3/users/glance` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:19:04.397197 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f3e3c96-abc9-4532-9622-390b9b094b8c None admin] Authenticating user token {{(pid=479851) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:19:04.400896 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f44b6940-6dd0-48eb-8c2f-337889ba40d4 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:19:04.402390 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f44b6940-6dd0-48eb-8c2f-337889ba40d4 None admin] RBAC: Authorization granted {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:19:04.405189 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG dbcounter [-] [479851] Writing DB stats keystone:SELECT=100 {{(pid=479851) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:19:04.417367 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application [None req-f44b6940-6dd0-48eb-8c2f-337889ba40d4 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jul 28 09:19:04.417367 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 09:19:04.417367 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 09:19:04.417367 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 09:19:04.417367 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 09:19:04.417367 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 09:19:04.417367 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 09:19:04.417367 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 09:19:04.417367 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 09:19:04.417367 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 09:19:04.417367 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 09:19:04.417367 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 09:19:04.417367 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 28 09:19:04.417367 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 28 09:19:04.417367 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 28 09:19:04.417367 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 28 09:19:04.418606 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 09:19:04.418606 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 09:19:04.418606 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 28 09:19:04.418606 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 09:19:04.418606 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 28 09:19:04.418606 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 09:19:04.418606 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 09:19:04.418606 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 09:19:04.418606 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 09:19:04.418606 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 09:19:04.418606 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 09:19:04.418606 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application with Lock( Jul 28 09:19:04.418606 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 09:19:04.418606 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self._enter() Jul 28 09:19:04.418606 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 09:19:04.418606 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 09:19:04.418606 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 09:19:04.418606 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self.creator() Jul 28 09:19:04.419768 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 09:19:04.419768 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application created_value = creator( Jul 28 09:19:04.419768 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 28 09:19:04.419768 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 28 09:19:04.419768 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 28 09:19:04.419768 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 28 09:19:04.419768 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 28 09:19:04.419768 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 28 09:19:04.419768 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jul 28 09:19:04.419768 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application Jul 28 09:19:04.419768 dv-cinder-851351-1-smb devstack@keystone.service[479852]: [pid: 479852|app: 0|req: 253/495] 10.222.0.42 () {56 vars in 1099 bytes} [Thu Jul 28 09:19:04 2022] GET /identity/v3/users/glance => generated 84 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 09:19:04.420488 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44b6940-6dd0-48eb-8c2f-337889ba40d4 None admin] Authenticating user token {{(pid=479852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:19:04.454699 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG dbcounter [-] [479852] Writing DB stats keystone:SELECT=100 {{(pid=479852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:19:04.510179 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f3e3c96-abc9-4532-9622-390b9b094b8c None admin] Validating token access rules against request {{(pid=479851) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:19:04.533006 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44b6940-6dd0-48eb-8c2f-337889ba40d4 None admin] Validating token access rules against request {{(pid=479852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:19:04.546698 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5fe96f8-94c3-4ae6-8f60-67f66824ec03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479851) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:19:04.547359 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5fe96f8-94c3-4ae6-8f60-67f66824ec03 None admin] REQUEST_METHOD: `GET` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:19:04.547642 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5fe96f8-94c3-4ae6-8f60-67f66824ec03 None admin] SCRIPT_NAME: `/identity` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:19:04.547917 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5fe96f8-94c3-4ae6-8f60-67f66824ec03 None admin] PATH_INFO: `/v3/roles/service` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:19:04.558712 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5fe96f8-94c3-4ae6-8f60-67f66824ec03 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 09:19:04.564425 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application [None req-c5fe96f8-94c3-4ae6-8f60-67f66824ec03 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 28 09:19:04.564425 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 09:19:04.564425 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 09:19:04.564425 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 09:19:04.564425 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 09:19:04.564425 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 09:19:04.564425 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 09:19:04.564425 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 09:19:04.564425 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 09:19:04.564425 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 09:19:04.564425 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 09:19:04.564425 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 09:19:04.564425 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 09:19:04.564425 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 09:19:04.564425 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 09:19:04.564425 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 09:19:04.565590 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 09:19:04.565590 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 09:19:04.565590 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 09:19:04.565590 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 09:19:04.565590 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 09:19:04.565590 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 09:19:04.565590 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 09:19:04.565590 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 09:19:04.565590 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 09:19:04.565590 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 09:19:04.565590 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 09:19:04.565590 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application with Lock( Jul 28 09:19:04.565590 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 09:19:04.565590 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return self._enter() Jul 28 09:19:04.565590 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 09:19:04.565590 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 09:19:04.566560 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 09:19:04.566560 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return self.creator() Jul 28 09:19:04.566560 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 09:19:04.566560 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application created_value = creator( Jul 28 09:19:04.566560 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 09:19:04.566560 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 09:19:04.566560 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 09:19:04.566560 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 09:19:04.566560 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 09:19:04.566560 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 09:19:04.566560 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 28 09:19:04.566560 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application Jul 28 09:19:04.566560 dv-cinder-851351-1-smb devstack@keystone.service[479851]: [pid: 479851|app: 0|req: 243/496] 10.222.0.42 () {56 vars in 1102 bytes} [Thu Jul 28 09:19:04 2022] GET /identity/v3/roles/service => generated 85 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 09:19:04.567369 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd7ee77-aeb2-4ea6-a214-6fba04e1fb81 None None] REQUEST_METHOD: `GET` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:19:04.567369 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd7ee77-aeb2-4ea6-a214-6fba04e1fb81 None None] SCRIPT_NAME: `/identity` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:19:04.567514 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd7ee77-aeb2-4ea6-a214-6fba04e1fb81 None None] PATH_INFO: `/` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:19:04.568784 dv-cinder-851351-1-smb devstack@keystone.service[479851]: [pid: 479851|app: 0|req: 244/497] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 09:19:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 09:19:04.569486 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd7ee77-aeb2-4ea6-a214-6fba04e1fb81 None None] Authenticating user token {{(pid=479851) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:19:04.582505 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e509cde-a513-4a12-b6e8-9e5d01b02245 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:19:04.583203 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e509cde-a513-4a12-b6e8-9e5d01b02245 None admin] REQUEST_METHOD: `GET` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:19:04.583519 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e509cde-a513-4a12-b6e8-9e5d01b02245 None admin] SCRIPT_NAME: `/identity` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:19:04.583841 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e509cde-a513-4a12-b6e8-9e5d01b02245 None admin] PATH_INFO: `/v3/users/nova` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:19:04.592051 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e509cde-a513-4a12-b6e8-9e5d01b02245 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:19:04.593546 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e509cde-a513-4a12-b6e8-9e5d01b02245 None admin] RBAC: Authorization granted {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:19:04.605270 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application [None req-7e509cde-a513-4a12-b6e8-9e5d01b02245 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 28 09:19:04.605270 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 09:19:04.605270 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 09:19:04.605270 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 09:19:04.605270 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 09:19:04.605270 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 09:19:04.605270 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 09:19:04.605270 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 09:19:04.605270 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 09:19:04.605270 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 09:19:04.605270 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 09:19:04.605270 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 09:19:04.605270 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 28 09:19:04.605270 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 28 09:19:04.605270 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 28 09:19:04.605270 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 28 09:19:04.606783 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 09:19:04.606783 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 09:19:04.606783 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 28 09:19:04.606783 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 09:19:04.606783 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 28 09:19:04.606783 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 09:19:04.606783 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 09:19:04.606783 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 09:19:04.606783 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 09:19:04.606783 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 09:19:04.606783 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 09:19:04.606783 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application with Lock( Jul 28 09:19:04.606783 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 09:19:04.606783 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self._enter() Jul 28 09:19:04.606783 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 09:19:04.606783 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 09:19:04.606783 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 09:19:04.606783 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self.creator() Jul 28 09:19:04.608569 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 09:19:04.608569 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application created_value = creator( Jul 28 09:19:04.608569 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 28 09:19:04.608569 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 28 09:19:04.608569 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 28 09:19:04.608569 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 28 09:19:04.608569 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 28 09:19:04.608569 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 28 09:19:04.608569 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 28 09:19:04.608569 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application Jul 28 09:19:04.608569 dv-cinder-851351-1-smb devstack@keystone.service[479852]: [pid: 479852|app: 0|req: 254/498] 10.222.0.42 () {56 vars in 1093 bytes} [Thu Jul 28 09:19:04 2022] GET /identity/v3/users/nova => generated 82 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 09:19:04.608569 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54bc30a7-58c5-4016-be98-d8767b51e897 None None] REQUEST_METHOD: `GET` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:19:04.608569 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54bc30a7-58c5-4016-be98-d8767b51e897 None None] SCRIPT_NAME: `/identity` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:19:04.609724 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54bc30a7-58c5-4016-be98-d8767b51e897 None None] PATH_INFO: `/` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:19:04.609724 dv-cinder-851351-1-smb devstack@keystone.service[479852]: [pid: 479852|app: 0|req: 255/499] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 09:19:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 09:19:04.610717 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54bc30a7-58c5-4016-be98-d8767b51e897 None None] Authenticating user token {{(pid=479852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:19:04.660831 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG dbcounter [-] [479851] Writing DB stats keystone:SELECT=100 {{(pid=479851) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:19:04.697566 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd7ee77-aeb2-4ea6-a214-6fba04e1fb81 None None] Validating token access rules against request {{(pid=479851) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:19:04.705888 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG dbcounter [-] [479852] Writing DB stats keystone:SELECT=100 {{(pid=479852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:19:04.718983 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54bc30a7-58c5-4016-be98-d8767b51e897 None None] Validating token access rules against request {{(pid=479852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:19:04.731878 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed7d992-1790-41e3-9c8c-754294baf46e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479851) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:19:04.732515 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed7d992-1790-41e3-9c8c-754294baf46e None admin] REQUEST_METHOD: `GET` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:19:04.732833 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed7d992-1790-41e3-9c8c-754294baf46e None admin] SCRIPT_NAME: `/identity` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:19:04.733120 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed7d992-1790-41e3-9c8c-754294baf46e None admin] PATH_INFO: `/v3/users` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:19:04.733938 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed7d992-1790-41e3-9c8c-754294baf46e None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=479851) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 09:19:04.734257 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed7d992-1790-41e3-9c8c-754294baf46e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:19:04.735735 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed7d992-1790-41e3-9c8c-754294baf46e None admin] RBAC: Authorization granted {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:19:04.752800 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a27b281-1df5-41f9-9023-61eb268f39b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:19:04.753437 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a27b281-1df5-41f9-9023-61eb268f39b2 None admin] REQUEST_METHOD: `GET` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:19:04.753720 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a27b281-1df5-41f9-9023-61eb268f39b2 None admin] SCRIPT_NAME: `/identity` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:19:04.754009 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a27b281-1df5-41f9-9023-61eb268f39b2 None admin] PATH_INFO: `/v3/roles` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:19:04.754736 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a27b281-1df5-41f9-9023-61eb268f39b2 None admin] RBAC: Adding query filter params (name=service) {{(pid=479852) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 09:19:04.755044 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a27b281-1df5-41f9-9023-61eb268f39b2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:19:04.756481 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a27b281-1df5-41f9-9023-61eb268f39b2 None admin] RBAC: Authorization granted {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:19:04.764831 dv-cinder-851351-1-smb devstack@keystone.service[479852]: [pid: 479852|app: 0|req: 256/500] 10.222.0.42 () {56 vars in 1103 bytes} [Thu Jul 28 09:19:04 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:19:04.765858 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e759ad-5784-4250-8144-46c86c734299 None None] REQUEST_METHOD: `POST` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:19:04.766145 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e759ad-5784-4250-8144-46c86c734299 None None] SCRIPT_NAME: `/identity` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:19:04.766421 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e759ad-5784-4250-8144-46c86c734299 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:19:04.776655 dv-cinder-851351-1-smb devstack@keystone.service[479851]: [pid: 479851|app: 0|req: 245/501] 10.222.0.42 () {56 vars in 1137 bytes} [Thu Jul 28 09:19:04 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:19:04.776655 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed7d992-1790-41e3-9c8c-754294baf46e None admin] Authenticating user token {{(pid=479851) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:19:04.790088 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.auth.core [None req-88e759ad-5784-4250-8144-46c86c734299 None None] MFA Rules not processed for user `c198f91a4ae84d2b9cc730a6e304c2be`. Rule list: `[]` (Enabled: `True`). {{(pid=479852) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 09:19:04.791329 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.fernet_utils [None req-88e759ad-5784-4250-8144-46c86c734299 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=479852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 09:19:04.860084 dv-cinder-851351-1-smb devstack@keystone.service[479852]: [pid: 479852|app: 0|req: 257/502] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 09:19:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 09:19:04.861652 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4225e9b7-2eaa-43c9-9918-d3b2d04d422a None None] REQUEST_METHOD: `POST` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:19:04.862012 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4225e9b7-2eaa-43c9-9918-d3b2d04d422a None None] SCRIPT_NAME: `/identity` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:19:04.862356 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4225e9b7-2eaa-43c9-9918-d3b2d04d422a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:19:04.884371 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed7d992-1790-41e3-9c8c-754294baf46e None admin] Validating token access rules against request {{(pid=479851) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:19:04.888920 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.auth.core [None req-4225e9b7-2eaa-43c9-9918-d3b2d04d422a None None] MFA Rules not processed for user `c198f91a4ae84d2b9cc730a6e304c2be`. Rule list: `[]` (Enabled: `True`). {{(pid=479852) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 09:19:04.890153 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.fernet_utils [None req-4225e9b7-2eaa-43c9-9918-d3b2d04d422a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=479852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 09:19:04.911260 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG dbcounter [-] [479851] Writing DB stats keystone:SELECT=100 {{(pid=479851) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:19:04.920713 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b41b31d-f4aa-4026-890c-55877d027fff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479851) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:19:04.921373 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b41b31d-f4aa-4026-890c-55877d027fff None admin] REQUEST_METHOD: `GET` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:19:04.921659 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b41b31d-f4aa-4026-890c-55877d027fff None admin] SCRIPT_NAME: `/identity` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:19:04.921938 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b41b31d-f4aa-4026-890c-55877d027fff None admin] PATH_INFO: `/v3/users` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:19:04.922750 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b41b31d-f4aa-4026-890c-55877d027fff None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=479851) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 09:19:04.923047 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b41b31d-f4aa-4026-890c-55877d027fff None admin] RBAC: Authorizing `identity:list_users()` {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:19:04.924530 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b41b31d-f4aa-4026-890c-55877d027fff None admin] RBAC: Authorization granted {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:19:04.941757 dv-cinder-851351-1-smb devstack@keystone.service[479851]: [pid: 479851|app: 0|req: 246/503] 10.222.0.42 () {56 vars in 1133 bytes} [Thu Jul 28 09:19:04 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:19:04.942583 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b41b31d-f4aa-4026-890c-55877d027fff None admin] Authenticating user token {{(pid=479851) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:19:04.959801 dv-cinder-851351-1-smb devstack@keystone.service[479852]: [pid: 479852|app: 0|req: 258/504] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 09:19:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 09:19:04.960583 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4225e9b7-2eaa-43c9-9918-d3b2d04d422a None None] Authenticating user token {{(pid=479852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:19:04.978411 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG dbcounter [-] [479852] Writing DB stats keystone:SELECT=100 {{(pid=479852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:19:05.051240 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b41b31d-f4aa-4026-890c-55877d027fff None admin] Validating token access rules against request {{(pid=479851) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:19:05.069745 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4225e9b7-2eaa-43c9-9918-d3b2d04d422a None None] Validating token access rules against request {{(pid=479852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:19:05.087311 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc3cb67-c90d-48dc-be09-d0b84c1c72e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479851) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:19:05.087970 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc3cb67-c90d-48dc-be09-d0b84c1c72e3 None admin] REQUEST_METHOD: `GET` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:19:05.088254 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc3cb67-c90d-48dc-be09-d0b84c1c72e3 None admin] SCRIPT_NAME: `/identity` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:19:05.088530 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc3cb67-c90d-48dc-be09-d0b84c1c72e3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:19:05.099456 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccc3cb67-c90d-48dc-be09-d0b84c1c72e3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:19:05.101077 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccc3cb67-c90d-48dc-be09-d0b84c1c72e3 None admin] RBAC: Authorization granted {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:19:05.107057 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf514223-441e-4643-b505-ae1d48295302 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:19:05.107684 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf514223-441e-4643-b505-ae1d48295302 None admin] REQUEST_METHOD: `GET` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:19:05.107964 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf514223-441e-4643-b505-ae1d48295302 None admin] SCRIPT_NAME: `/identity` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:19:05.108274 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf514223-441e-4643-b505-ae1d48295302 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:19:05.116728 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application [None req-ccc3cb67-c90d-48dc-be09-d0b84c1c72e3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 09:19:05.116728 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 09:19:05.116728 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 09:19:05.116728 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 09:19:05.116728 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 09:19:05.116728 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 09:19:05.116728 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 09:19:05.116728 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 09:19:05.116728 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 09:19:05.116728 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 09:19:05.116728 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 09:19:05.116728 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 09:19:05.116728 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 09:19:05.116728 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 09:19:05.116728 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 09:19:05.117974 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 09:19:05.117974 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 09:19:05.117974 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 09:19:05.117974 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 09:19:05.117974 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 09:19:05.117974 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 09:19:05.117974 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 09:19:05.117974 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 09:19:05.117974 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application with Lock( Jul 28 09:19:05.117974 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 09:19:05.117974 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return self._enter() Jul 28 09:19:05.117974 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 09:19:05.117974 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 09:19:05.117974 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 09:19:05.117974 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return self.creator() Jul 28 09:19:05.117974 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 09:19:05.117974 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application created_value = creator( Jul 28 09:19:05.119124 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 09:19:05.119124 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 09:19:05.119124 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 09:19:05.119124 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application Jul 28 09:19:05.120817 dv-cinder-851351-1-smb devstack@keystone.service[479851]: [pid: 479851|app: 0|req: 247/505] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 09:19:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 09:19:05.122048 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc3cb67-c90d-48dc-be09-d0b84c1c72e3 None admin] Authenticating user token {{(pid=479851) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:19:05.159472 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG dbcounter [-] [479851] Writing DB stats keystone:SELECT=100 {{(pid=479851) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:19:05.177548 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf514223-441e-4643-b505-ae1d48295302 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:19:05.179158 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf514223-441e-4643-b505-ae1d48295302 None admin] RBAC: Authorization granted {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:19:05.190594 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG dbcounter [-] [479852] Writing DB stats keystone:SELECT=100 {{(pid=479852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:19:05.226285 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc3cb67-c90d-48dc-be09-d0b84c1c72e3 None admin] Validating token access rules against request {{(pid=479851) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:19:05.262339 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfec3335-51ed-4387-a183-52d473ff101a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479851) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:19:05.263025 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfec3335-51ed-4387-a183-52d473ff101a None admin] REQUEST_METHOD: `GET` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:19:05.263307 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfec3335-51ed-4387-a183-52d473ff101a None admin] SCRIPT_NAME: `/identity` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:19:05.263603 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfec3335-51ed-4387-a183-52d473ff101a None admin] PATH_INFO: `/v3/roles/service` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:19:05.274739 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfec3335-51ed-4387-a183-52d473ff101a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 09:19:05.279949 dv-cinder-851351-1-smb devstack@keystone.service[479852]: [pid: 479852|app: 0|req: 259/506] 10.222.0.42 () {58 vars in 1282 bytes} [Thu Jul 28 09:19:04 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 28 09:19:05.280398 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application [None req-dfec3335-51ed-4387-a183-52d473ff101a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 28 09:19:05.280398 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 09:19:05.280398 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 09:19:05.280398 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 09:19:05.280398 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 09:19:05.280398 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 09:19:05.280398 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 09:19:05.280398 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 09:19:05.280398 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 09:19:05.280398 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 09:19:05.280398 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 09:19:05.280398 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 09:19:05.280398 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 09:19:05.280398 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 09:19:05.280398 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 09:19:05.280398 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 09:19:05.281612 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 09:19:05.281612 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 09:19:05.281612 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 09:19:05.281612 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 09:19:05.281612 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 09:19:05.281612 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 09:19:05.281612 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 09:19:05.281612 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 09:19:05.281612 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 09:19:05.281612 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 09:19:05.281612 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 09:19:05.281612 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application with Lock( Jul 28 09:19:05.281612 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 09:19:05.281612 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return self._enter() Jul 28 09:19:05.281612 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 09:19:05.281612 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 09:19:05.282591 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 09:19:05.282591 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return self.creator() Jul 28 09:19:05.282591 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 09:19:05.282591 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application created_value = creator( Jul 28 09:19:05.282591 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 09:19:05.282591 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 09:19:05.282591 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 09:19:05.282591 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 09:19:05.282591 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 09:19:05.282591 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 09:19:05.282591 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 28 09:19:05.282591 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application Jul 28 09:19:05.283363 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf514223-441e-4643-b505-ae1d48295302 None admin] Authenticating user token {{(pid=479852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:19:05.283465 dv-cinder-851351-1-smb devstack@keystone.service[479851]: [pid: 479851|app: 0|req: 248/507] 10.222.0.42 () {56 vars in 1102 bytes} [Thu Jul 28 09:19:05 2022] GET /identity/v3/roles/service => generated 85 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 09:19:05.283465 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfec3335-51ed-4387-a183-52d473ff101a None admin] Authenticating user token {{(pid=479851) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:19:05.378280 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG dbcounter [-] [479851] Writing DB stats keystone:SELECT=100 {{(pid=479851) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:19:05.384394 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf514223-441e-4643-b505-ae1d48295302 None admin] Validating token access rules against request {{(pid=479852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:19:05.385184 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfec3335-51ed-4387-a183-52d473ff101a None admin] Validating token access rules against request {{(pid=479851) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:19:05.396074 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG dbcounter [-] [479852] Writing DB stats keystone:SELECT=100 {{(pid=479852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:19:05.420579 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4acce49-7f54-4b05-920c-9d3c51485757 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:19:05.420809 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac304a1-bbe1-4cc8-ae0d-416054c2d77e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479851) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:19:05.421247 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4acce49-7f54-4b05-920c-9d3c51485757 None admin] REQUEST_METHOD: `GET` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:19:05.421390 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac304a1-bbe1-4cc8-ae0d-416054c2d77e None admin] REQUEST_METHOD: `GET` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:19:05.421562 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4acce49-7f54-4b05-920c-9d3c51485757 None admin] SCRIPT_NAME: `/identity` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:19:05.421670 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac304a1-bbe1-4cc8-ae0d-416054c2d77e None admin] SCRIPT_NAME: `/identity` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:19:05.421825 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4acce49-7f54-4b05-920c-9d3c51485757 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:19:05.421939 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac304a1-bbe1-4cc8-ae0d-416054c2d77e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:19:05.433084 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ac304a1-bbe1-4cc8-ae0d-416054c2d77e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:19:05.434589 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ac304a1-bbe1-4cc8-ae0d-416054c2d77e None admin] RBAC: Authorization granted {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:19:05.449885 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application [None req-9ac304a1-bbe1-4cc8-ae0d-416054c2d77e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 09:19:05.449885 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 09:19:05.449885 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 09:19:05.449885 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 09:19:05.449885 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 09:19:05.449885 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 09:19:05.449885 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 09:19:05.449885 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 09:19:05.449885 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 09:19:05.449885 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 09:19:05.449885 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 09:19:05.449885 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 09:19:05.449885 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 09:19:05.449885 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 09:19:05.449885 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 09:19:05.451413 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 09:19:05.451413 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 09:19:05.451413 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 09:19:05.451413 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 09:19:05.451413 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 09:19:05.451413 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 09:19:05.451413 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 09:19:05.451413 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 09:19:05.451413 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application with Lock( Jul 28 09:19:05.451413 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 09:19:05.451413 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return self._enter() Jul 28 09:19:05.451413 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 09:19:05.451413 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 09:19:05.451413 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 09:19:05.451413 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return self.creator() Jul 28 09:19:05.451413 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 09:19:05.451413 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application created_value = creator( Jul 28 09:19:05.453165 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 09:19:05.453165 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 09:19:05.453165 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 09:19:05.453165 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application Jul 28 09:19:05.453165 dv-cinder-851351-1-smb devstack@keystone.service[479851]: [pid: 479851|app: 0|req: 249/508] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 09:19:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 09:19:05.453165 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac304a1-bbe1-4cc8-ae0d-416054c2d77e None admin] Authenticating user token {{(pid=479851) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:19:05.494967 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4acce49-7f54-4b05-920c-9d3c51485757 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:19:05.496337 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4acce49-7f54-4b05-920c-9d3c51485757 None admin] RBAC: Authorization granted {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:19:05.556902 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac304a1-bbe1-4cc8-ae0d-416054c2d77e None admin] Validating token access rules against request {{(pid=479851) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:19:05.591346 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5589a857-3fc0-4f0f-8ff3-144a203da509 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479851) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:19:05.591854 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5589a857-3fc0-4f0f-8ff3-144a203da509 None admin] REQUEST_METHOD: `GET` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:19:05.592139 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5589a857-3fc0-4f0f-8ff3-144a203da509 None admin] SCRIPT_NAME: `/identity` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:19:05.592418 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5589a857-3fc0-4f0f-8ff3-144a203da509 None admin] PATH_INFO: `/v3/domains` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:19:05.593160 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5589a857-3fc0-4f0f-8ff3-144a203da509 None admin] RBAC: Adding query filter params (name=Default) {{(pid=479851) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 09:19:05.593465 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5589a857-3fc0-4f0f-8ff3-144a203da509 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:19:05.594893 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5589a857-3fc0-4f0f-8ff3-144a203da509 None admin] RBAC: Authorization granted {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:19:05.595470 dv-cinder-851351-1-smb devstack@keystone.service[479852]: [pid: 479852|app: 0|req: 260/509] 10.222.0.42 () {58 vars in 1282 bytes} [Thu Jul 28 09:19:05 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 28 09:19:05.596326 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4acce49-7f54-4b05-920c-9d3c51485757 None admin] Authenticating user token {{(pid=479852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:19:05.610911 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG dbcounter [-] [479852] Writing DB stats keystone:SELECT=100 {{(pid=479852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:19:05.611575 dv-cinder-851351-1-smb devstack@keystone.service[479851]: [pid: 479851|app: 0|req: 250/510] 10.222.0.42 () {56 vars in 1109 bytes} [Thu Jul 28 09:19:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:19:05.612433 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5589a857-3fc0-4f0f-8ff3-144a203da509 None admin] Authenticating user token {{(pid=479851) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:19:05.623931 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG dbcounter [-] [479851] Writing DB stats keystone:SELECT=100 {{(pid=479851) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:19:05.705023 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4acce49-7f54-4b05-920c-9d3c51485757 None admin] Validating token access rules against request {{(pid=479852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:19:05.722603 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5589a857-3fc0-4f0f-8ff3-144a203da509 None admin] Validating token access rules against request {{(pid=479851) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:19:05.740582 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b39bbd6b-97e0-4379-912f-db601394fca7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:19:05.741258 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39bbd6b-97e0-4379-912f-db601394fca7 None admin] REQUEST_METHOD: `GET` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:19:05.741538 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39bbd6b-97e0-4379-912f-db601394fca7 None admin] SCRIPT_NAME: `/identity` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:19:05.741812 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39bbd6b-97e0-4379-912f-db601394fca7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:19:05.752317 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b39bbd6b-97e0-4379-912f-db601394fca7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:19:05.753774 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b39bbd6b-97e0-4379-912f-db601394fca7 None admin] RBAC: Authorization granted {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:19:05.758723 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7289809-9361-48a8-9bcc-ca0dcb42ed99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479851) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:19:05.759442 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7289809-9361-48a8-9bcc-ca0dcb42ed99 None admin] REQUEST_METHOD: `GET` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:19:05.759726 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7289809-9361-48a8-9bcc-ca0dcb42ed99 None admin] SCRIPT_NAME: `/identity` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:19:05.760007 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7289809-9361-48a8-9bcc-ca0dcb42ed99 None admin] PATH_INFO: `/v3/roles` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:19:05.760784 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7289809-9361-48a8-9bcc-ca0dcb42ed99 None admin] RBAC: Adding query filter params (name=service) {{(pid=479851) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 09:19:05.761098 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7289809-9361-48a8-9bcc-ca0dcb42ed99 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:19:05.762500 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7289809-9361-48a8-9bcc-ca0dcb42ed99 None admin] RBAC: Authorization granted {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:19:05.769681 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application [None req-b39bbd6b-97e0-4379-912f-db601394fca7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 09:19:05.769681 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 09:19:05.769681 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 09:19:05.769681 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 09:19:05.769681 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 09:19:05.769681 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 09:19:05.769681 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 09:19:05.769681 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 09:19:05.769681 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 09:19:05.769681 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 09:19:05.769681 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 09:19:05.769681 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 09:19:05.769681 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 09:19:05.769681 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 09:19:05.769681 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 09:19:05.770931 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 09:19:05.770931 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 09:19:05.770931 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 09:19:05.770931 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 09:19:05.770931 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 09:19:05.770931 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 09:19:05.770931 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 09:19:05.770931 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 09:19:05.770931 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application with Lock( Jul 28 09:19:05.770931 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 09:19:05.770931 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self._enter() Jul 28 09:19:05.770931 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 09:19:05.770931 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 09:19:05.770931 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 09:19:05.770931 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self.creator() Jul 28 09:19:05.770931 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 09:19:05.770931 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application created_value = creator( Jul 28 09:19:05.772210 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 09:19:05.772210 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 09:19:05.772210 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 09:19:05.772210 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application Jul 28 09:19:05.772598 dv-cinder-851351-1-smb devstack@keystone.service[479851]: [pid: 479851|app: 0|req: 251/512] 10.222.0.42 () {56 vars in 1103 bytes} [Thu Jul 28 09:19:05 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:19:05.772598 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7289809-9361-48a8-9bcc-ca0dcb42ed99 None admin] Authenticating user token {{(pid=479851) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:19:05.772869 dv-cinder-851351-1-smb devstack@keystone.service[479852]: [pid: 479852|app: 0|req: 261/512] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 09:19:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 09:19:05.773746 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b39bbd6b-97e0-4379-912f-db601394fca7 None admin] Authenticating user token {{(pid=479852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:19:05.835528 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG dbcounter [-] [479852] Writing DB stats keystone:SELECT=100 {{(pid=479852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:19:05.846229 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG dbcounter [-] [479851] Writing DB stats keystone:SELECT=100 {{(pid=479851) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:19:05.875978 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b39bbd6b-97e0-4379-912f-db601394fca7 None admin] Validating token access rules against request {{(pid=479852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:19:05.879352 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7289809-9361-48a8-9bcc-ca0dcb42ed99 None admin] Validating token access rules against request {{(pid=479851) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:19:05.912184 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15acef9-44ae-4265-8e6f-c65f643259e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:19:05.912892 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15acef9-44ae-4265-8e6f-c65f643259e2 None admin] REQUEST_METHOD: `GET` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:19:05.913179 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15acef9-44ae-4265-8e6f-c65f643259e2 None admin] SCRIPT_NAME: `/identity` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:19:05.913459 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15acef9-44ae-4265-8e6f-c65f643259e2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:19:05.914017 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61da17c8-64a0-46e0-a14e-8980bfe37489 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479851) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:19:05.914658 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61da17c8-64a0-46e0-a14e-8980bfe37489 None admin] REQUEST_METHOD: `GET` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:19:05.914945 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61da17c8-64a0-46e0-a14e-8980bfe37489 None admin] SCRIPT_NAME: `/identity` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:19:05.915227 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61da17c8-64a0-46e0-a14e-8980bfe37489 None admin] PATH_INFO: `/v3/domains` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:19:05.915932 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61da17c8-64a0-46e0-a14e-8980bfe37489 None admin] RBAC: Adding query filter params (name=Default) {{(pid=479851) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 09:19:05.916246 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61da17c8-64a0-46e0-a14e-8980bfe37489 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:19:05.917715 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61da17c8-64a0-46e0-a14e-8980bfe37489 None admin] RBAC: Authorization granted {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:19:05.924573 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f15acef9-44ae-4265-8e6f-c65f643259e2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:19:05.926059 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f15acef9-44ae-4265-8e6f-c65f643259e2 None admin] RBAC: Authorization granted {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:19:05.929870 dv-cinder-851351-1-smb devstack@keystone.service[479851]: [pid: 479851|app: 0|req: 252/513] 10.222.0.42 () {56 vars in 1109 bytes} [Thu Jul 28 09:19:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:19:05.930801 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61da17c8-64a0-46e0-a14e-8980bfe37489 None admin] Authenticating user token {{(pid=479851) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:19:05.943154 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application [None req-f15acef9-44ae-4265-8e6f-c65f643259e2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 09:19:05.943154 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 09:19:05.943154 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 09:19:05.943154 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 09:19:05.943154 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 09:19:05.943154 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 09:19:05.943154 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 09:19:05.943154 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 09:19:05.943154 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 09:19:05.943154 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 09:19:05.943154 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 09:19:05.943154 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 09:19:05.943154 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 09:19:05.943154 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 09:19:05.943154 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 09:19:05.949333 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 09:19:05.949333 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 09:19:05.949333 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 09:19:05.949333 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 09:19:05.949333 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 09:19:05.949333 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 09:19:05.949333 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 09:19:05.949333 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 09:19:05.949333 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application with Lock( Jul 28 09:19:05.949333 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 09:19:05.949333 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self._enter() Jul 28 09:19:05.949333 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 09:19:05.949333 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 09:19:05.949333 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 09:19:05.949333 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self.creator() Jul 28 09:19:05.949333 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 09:19:05.949333 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application created_value = creator( Jul 28 09:19:05.950616 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 09:19:05.950616 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 09:19:05.950616 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 09:19:05.950616 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application Jul 28 09:19:05.950616 dv-cinder-851351-1-smb devstack@keystone.service[479852]: [pid: 479852|app: 0|req: 262/514] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 09:19:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 09:19:05.950616 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15acef9-44ae-4265-8e6f-c65f643259e2 None admin] Authenticating user token {{(pid=479852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:19:06.031163 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61da17c8-64a0-46e0-a14e-8980bfe37489 None admin] Validating token access rules against request {{(pid=479851) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:19:06.048455 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15acef9-44ae-4265-8e6f-c65f643259e2 None admin] Validating token access rules against request {{(pid=479852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:19:06.059319 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG dbcounter [-] [479851] Writing DB stats keystone:SELECT=100 {{(pid=479851) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:19:06.063083 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG dbcounter [-] [479852] Writing DB stats keystone:SELECT=100 {{(pid=479852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:19:06.066250 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94218248-df54-4a50-b9e1-118845bb65d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479851) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:19:06.066928 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94218248-df54-4a50-b9e1-118845bb65d5 None admin] REQUEST_METHOD: `GET` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:19:06.067209 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94218248-df54-4a50-b9e1-118845bb65d5 None admin] SCRIPT_NAME: `/identity` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:19:06.067486 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94218248-df54-4a50-b9e1-118845bb65d5 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:19:06.075579 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94218248-df54-4a50-b9e1-118845bb65d5 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:19:06.077074 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94218248-df54-4a50-b9e1-118845bb65d5 None admin] RBAC: Authorization granted {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:19:06.086277 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7bf4578-7872-433a-858c-d137887ad718 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:19:06.086905 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7bf4578-7872-433a-858c-d137887ad718 None admin] REQUEST_METHOD: `GET` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:19:06.087189 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7bf4578-7872-433a-858c-d137887ad718 None admin] SCRIPT_NAME: `/identity` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:19:06.087466 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7bf4578-7872-433a-858c-d137887ad718 None admin] PATH_INFO: `/v3/domains` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:19:06.088172 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7bf4578-7872-433a-858c-d137887ad718 None admin] RBAC: Adding query filter params (name=Default) {{(pid=479852) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 09:19:06.088480 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7bf4578-7872-433a-858c-d137887ad718 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:19:06.089886 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7bf4578-7872-433a-858c-d137887ad718 None admin] RBAC: Authorization granted {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:19:06.091028 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application [None req-94218248-df54-4a50-b9e1-118845bb65d5 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jul 28 09:19:06.091028 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 09:19:06.091028 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 09:19:06.091028 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 09:19:06.091028 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 09:19:06.091028 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 09:19:06.091028 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 09:19:06.091028 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 09:19:06.091028 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 09:19:06.091028 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 09:19:06.091028 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 09:19:06.091028 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 09:19:06.091028 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 28 09:19:06.091028 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 28 09:19:06.091028 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 28 09:19:06.091028 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 28 09:19:06.092133 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 09:19:06.092133 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 09:19:06.092133 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 28 09:19:06.092133 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 09:19:06.092133 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 28 09:19:06.092133 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 09:19:06.092133 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 09:19:06.092133 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 09:19:06.092133 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 09:19:06.092133 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 09:19:06.092133 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 09:19:06.092133 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application with Lock( Jul 28 09:19:06.092133 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 09:19:06.092133 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return self._enter() Jul 28 09:19:06.092133 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 09:19:06.092133 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 09:19:06.092133 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 09:19:06.092133 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return self.creator() Jul 28 09:19:06.093271 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 09:19:06.093271 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application created_value = creator( Jul 28 09:19:06.093271 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 28 09:19:06.093271 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 28 09:19:06.093271 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 28 09:19:06.093271 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 28 09:19:06.093271 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 28 09:19:06.093271 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 28 09:19:06.093271 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jul 28 09:19:06.093271 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application Jul 28 09:19:06.093271 dv-cinder-851351-1-smb devstack@keystone.service[479851]: [pid: 479851|app: 0|req: 253/515] 10.222.0.42 () {56 vars in 1099 bytes} [Thu Jul 28 09:19:05 2022] GET /identity/v3/users/cinder => generated 84 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 09:19:06.093271 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94218248-df54-4a50-b9e1-118845bb65d5 None admin] Authenticating user token {{(pid=479851) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:19:06.106744 dv-cinder-851351-1-smb devstack@keystone.service[479852]: [pid: 479852|app: 0|req: 263/516] 10.222.0.42 () {56 vars in 1109 bytes} [Thu Jul 28 09:19:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:19:06.107607 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7bf4578-7872-433a-858c-d137887ad718 None admin] Authenticating user token {{(pid=479852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:19:06.196008 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94218248-df54-4a50-b9e1-118845bb65d5 None admin] Validating token access rules against request {{(pid=479851) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:19:06.209538 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7bf4578-7872-433a-858c-d137887ad718 None admin] Validating token access rules against request {{(pid=479852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:19:06.230466 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f1efac-779d-4b85-bb42-3003ec7b5d1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479851) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:19:06.231147 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f1efac-779d-4b85-bb42-3003ec7b5d1b None admin] REQUEST_METHOD: `GET` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:19:06.231435 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f1efac-779d-4b85-bb42-3003ec7b5d1b None admin] SCRIPT_NAME: `/identity` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:19:06.231714 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f1efac-779d-4b85-bb42-3003ec7b5d1b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:19:06.242581 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23f1efac-779d-4b85-bb42-3003ec7b5d1b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:19:06.244114 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23f1efac-779d-4b85-bb42-3003ec7b5d1b None admin] RBAC: Authorization granted {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:19:06.244688 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea894398-47b2-4f8c-b77b-011a1d4b34e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:19:06.245333 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea894398-47b2-4f8c-b77b-011a1d4b34e6 None admin] REQUEST_METHOD: `POST` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:19:06.245621 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea894398-47b2-4f8c-b77b-011a1d4b34e6 None admin] SCRIPT_NAME: `/identity` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:19:06.246016 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea894398-47b2-4f8c-b77b-011a1d4b34e6 None admin] PATH_INFO: `/v3/users` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:19:06.246777 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea894398-47b2-4f8c-b77b-011a1d4b34e6 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:19:06.248265 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea894398-47b2-4f8c-b77b-011a1d4b34e6 None admin] RBAC: Authorization granted {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:19:06.258593 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application [None req-23f1efac-779d-4b85-bb42-3003ec7b5d1b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 09:19:06.258593 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 09:19:06.258593 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 09:19:06.258593 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 09:19:06.258593 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 09:19:06.258593 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 09:19:06.258593 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 09:19:06.258593 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 09:19:06.258593 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 09:19:06.258593 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 09:19:06.258593 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 09:19:06.258593 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 09:19:06.258593 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 09:19:06.258593 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 09:19:06.258593 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 09:19:06.259710 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 09:19:06.259710 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 09:19:06.259710 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 09:19:06.259710 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 09:19:06.259710 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 09:19:06.259710 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 09:19:06.259710 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 09:19:06.259710 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 09:19:06.259710 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application with Lock( Jul 28 09:19:06.259710 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 09:19:06.259710 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return self._enter() Jul 28 09:19:06.259710 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 09:19:06.259710 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 09:19:06.259710 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 09:19:06.259710 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return self.creator() Jul 28 09:19:06.259710 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 09:19:06.259710 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application created_value = creator( Jul 28 09:19:06.261304 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 09:19:06.261304 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 09:19:06.261304 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 09:19:06.261304 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application Jul 28 09:19:06.261304 dv-cinder-851351-1-smb devstack@keystone.service[479851]: [pid: 479851|app: 0|req: 254/517] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 09:19:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 09:19:06.261304 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f1efac-779d-4b85-bb42-3003ec7b5d1b None admin] Authenticating user token {{(pid=479851) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:19:06.292794 dv-cinder-851351-1-smb devstack@keystone.service[479852]: [pid: 479852|app: 0|req: 264/518] 10.222.0.42 () {60 vars in 1132 bytes} [Thu Jul 28 09:19:06 2022] POST /identity/v3/users => generated 247 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 09:19:06.292794 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea894398-47b2-4f8c-b77b-011a1d4b34e6 None admin] Authenticating user token {{(pid=479852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:19:06.310390 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG dbcounter [-] [479851] Writing DB stats keystone:SELECT=100 {{(pid=479851) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:19:06.313942 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG dbcounter [-] [479852] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=479852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:19:06.392296 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f1efac-779d-4b85-bb42-3003ec7b5d1b None admin] Validating token access rules against request {{(pid=479851) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:19:06.406623 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea894398-47b2-4f8c-b77b-011a1d4b34e6 None admin] Validating token access rules against request {{(pid=479852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:19:06.433493 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de959fe-0101-4165-95c4-a30f596632ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479851) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:19:06.434480 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de959fe-0101-4165-95c4-a30f596632ee None admin] REQUEST_METHOD: `GET` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:19:06.434760 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de959fe-0101-4165-95c4-a30f596632ee None admin] SCRIPT_NAME: `/identity` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:19:06.435048 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de959fe-0101-4165-95c4-a30f596632ee None admin] PATH_INFO: `/v3/domains` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:19:06.436434 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6de959fe-0101-4165-95c4-a30f596632ee None admin] RBAC: Adding query filter params (name=Default) {{(pid=479851) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 09:19:06.436794 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6de959fe-0101-4165-95c4-a30f596632ee None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:19:06.438246 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6de959fe-0101-4165-95c4-a30f596632ee None admin] RBAC: Authorization granted {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:19:06.446579 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9bc2f81-1a68-4872-bfa2-cc99fb1a9879 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:19:06.447216 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9bc2f81-1a68-4872-bfa2-cc99fb1a9879 None admin] REQUEST_METHOD: `GET` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:19:06.447500 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9bc2f81-1a68-4872-bfa2-cc99fb1a9879 None admin] SCRIPT_NAME: `/identity` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:19:06.447776 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9bc2f81-1a68-4872-bfa2-cc99fb1a9879 None admin] PATH_INFO: `/v3/users` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:19:06.448593 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9bc2f81-1a68-4872-bfa2-cc99fb1a9879 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=479852) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 09:19:06.448953 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9bc2f81-1a68-4872-bfa2-cc99fb1a9879 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:19:06.450399 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9bc2f81-1a68-4872-bfa2-cc99fb1a9879 None admin] RBAC: Authorization granted {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:19:06.452399 dv-cinder-851351-1-smb devstack@keystone.service[479851]: [pid: 479851|app: 0|req: 255/519] 10.222.0.42 () {56 vars in 1109 bytes} [Thu Jul 28 09:19:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:19:06.453584 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de959fe-0101-4165-95c4-a30f596632ee None admin] Authenticating user token {{(pid=479851) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:19:06.496600 dv-cinder-851351-1-smb devstack@keystone.service[479852]: [pid: 479852|app: 0|req: 265/520] 10.222.0.42 () {56 vars in 1137 bytes} [Thu Jul 28 09:19:06 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:19:06.497843 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9bc2f81-1a68-4872-bfa2-cc99fb1a9879 None admin] Authenticating user token {{(pid=479852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:19:06.577319 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de959fe-0101-4165-95c4-a30f596632ee None admin] Validating token access rules against request {{(pid=479851) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:19:06.579328 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG dbcounter [-] [479851] Writing DB stats keystone:SELECT=100 {{(pid=479851) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:19:06.595221 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG dbcounter [-] [479852] Writing DB stats keystone:SELECT=100 {{(pid=479852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:19:06.610000 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9bc2f81-1a68-4872-bfa2-cc99fb1a9879 None admin] Validating token access rules against request {{(pid=479852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:19:06.615670 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5878028-f51a-4d49-af04-74b7f27bf57b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479851) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:19:06.616327 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5878028-f51a-4d49-af04-74b7f27bf57b None admin] REQUEST_METHOD: `GET` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:19:06.616610 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5878028-f51a-4d49-af04-74b7f27bf57b None admin] SCRIPT_NAME: `/identity` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:19:06.616915 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5878028-f51a-4d49-af04-74b7f27bf57b None admin] PATH_INFO: `/v3/projects/service` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:19:06.624780 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5878028-f51a-4d49-af04-74b7f27bf57b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:19:06.626269 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5878028-f51a-4d49-af04-74b7f27bf57b None admin] RBAC: Authorization granted {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:19:06.638893 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application [None req-a5878028-f51a-4d49-af04-74b7f27bf57b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 09:19:06.638893 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 09:19:06.638893 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 09:19:06.638893 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 09:19:06.638893 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 09:19:06.638893 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 09:19:06.638893 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 09:19:06.638893 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 09:19:06.638893 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 09:19:06.638893 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 09:19:06.638893 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 09:19:06.638893 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 09:19:06.638893 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 28 09:19:06.638893 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 28 09:19:06.638893 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 28 09:19:06.640046 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 28 09:19:06.640046 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 09:19:06.640046 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 09:19:06.640046 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 09:19:06.640046 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 09:19:06.640046 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 09:19:06.640046 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 09:19:06.640046 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 09:19:06.640046 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application with Lock( Jul 28 09:19:06.640046 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 09:19:06.640046 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return self._enter() Jul 28 09:19:06.640046 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 09:19:06.640046 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 09:19:06.640046 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 09:19:06.640046 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return self.creator() Jul 28 09:19:06.640046 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 09:19:06.640046 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application created_value = creator( Jul 28 09:19:06.641169 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 28 09:19:06.641169 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 28 09:19:06.641169 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 28 09:19:06.641169 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 28 09:19:06.641169 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 28 09:19:06.641169 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 28 09:19:06.641169 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 09:19:06.641169 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application Jul 28 09:19:06.641169 dv-cinder-851351-1-smb devstack@keystone.service[479851]: [pid: 479851|app: 0|req: 256/521] 10.222.0.42 () {56 vars in 1111 bytes} [Thu Jul 28 09:19:06 2022] GET /identity/v3/projects/service => generated 88 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 09:19:06.641169 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5878028-f51a-4d49-af04-74b7f27bf57b None admin] Authenticating user token {{(pid=479851) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:19:06.655498 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a162cf7-39a9-4ad2-bb26-8c4e27ef0548 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:19:06.656500 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a162cf7-39a9-4ad2-bb26-8c4e27ef0548 None admin] REQUEST_METHOD: `GET` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:19:06.656837 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a162cf7-39a9-4ad2-bb26-8c4e27ef0548 None admin] SCRIPT_NAME: `/identity` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:19:06.657118 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a162cf7-39a9-4ad2-bb26-8c4e27ef0548 None admin] PATH_INFO: `/v3/domains` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:19:06.658247 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a162cf7-39a9-4ad2-bb26-8c4e27ef0548 None admin] RBAC: Adding query filter params (name=Default) {{(pid=479852) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 09:19:06.658803 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a162cf7-39a9-4ad2-bb26-8c4e27ef0548 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:19:06.660225 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a162cf7-39a9-4ad2-bb26-8c4e27ef0548 None admin] RBAC: Authorization granted {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:19:06.673610 dv-cinder-851351-1-smb devstack@keystone.service[479852]: [pid: 479852|app: 0|req: 266/522] 10.222.0.42 () {56 vars in 1109 bytes} [Thu Jul 28 09:19:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:19:06.675396 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a162cf7-39a9-4ad2-bb26-8c4e27ef0548 None admin] Authenticating user token {{(pid=479852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:19:06.783742 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a162cf7-39a9-4ad2-bb26-8c4e27ef0548 None admin] Validating token access rules against request {{(pid=479852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:19:06.787337 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5878028-f51a-4d49-af04-74b7f27bf57b None admin] Validating token access rules against request {{(pid=479851) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:19:06.825875 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a5ab7b-80e6-49aa-ae28-b6fd89087939 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479851) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:19:06.826648 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a5ab7b-80e6-49aa-ae28-b6fd89087939 None admin] REQUEST_METHOD: `GET` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:19:06.826944 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a5ab7b-80e6-49aa-ae28-b6fd89087939 None admin] SCRIPT_NAME: `/identity` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:19:06.827216 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a5ab7b-80e6-49aa-ae28-b6fd89087939 None admin] PATH_INFO: `/v3/projects/service` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:19:06.828363 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ecbf15-bcc3-4aaa-bd29-57fa1ce2a31f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:19:06.828980 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ecbf15-bcc3-4aaa-bd29-57fa1ce2a31f None admin] REQUEST_METHOD: `GET` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:19:06.829480 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ecbf15-bcc3-4aaa-bd29-57fa1ce2a31f None admin] SCRIPT_NAME: `/identity` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:19:06.829759 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ecbf15-bcc3-4aaa-bd29-57fa1ce2a31f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:19:06.834624 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a5ab7b-80e6-49aa-ae28-b6fd89087939 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:19:06.836096 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a5ab7b-80e6-49aa-ae28-b6fd89087939 None admin] RBAC: Authorization granted {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:19:06.847972 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application [None req-d2a5ab7b-80e6-49aa-ae28-b6fd89087939 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 09:19:06.847972 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 09:19:06.847972 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 09:19:06.847972 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 09:19:06.847972 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 09:19:06.847972 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 09:19:06.847972 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 09:19:06.847972 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 09:19:06.847972 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 09:19:06.847972 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 09:19:06.847972 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 09:19:06.847972 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 09:19:06.847972 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 28 09:19:06.847972 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 28 09:19:06.847972 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 28 09:19:06.849205 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 28 09:19:06.849205 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 09:19:06.849205 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 09:19:06.849205 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 09:19:06.849205 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 09:19:06.849205 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 09:19:06.849205 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 09:19:06.849205 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 09:19:06.849205 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application with Lock( Jul 28 09:19:06.849205 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 09:19:06.849205 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return self._enter() Jul 28 09:19:06.849205 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 09:19:06.849205 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 09:19:06.849205 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 09:19:06.849205 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return self.creator() Jul 28 09:19:06.849205 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 09:19:06.849205 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application created_value = creator( Jul 28 09:19:06.850285 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 28 09:19:06.850285 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 28 09:19:06.850285 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 28 09:19:06.850285 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 28 09:19:06.850285 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 28 09:19:06.850285 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 28 09:19:06.850285 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 09:19:06.850285 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application Jul 28 09:19:06.850285 dv-cinder-851351-1-smb devstack@keystone.service[479851]: [pid: 479851|app: 0|req: 257/523] 10.222.0.42 () {56 vars in 1111 bytes} [Thu Jul 28 09:19:06 2022] GET /identity/v3/projects/service => generated 88 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 09:19:06.850864 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a5ab7b-80e6-49aa-ae28-b6fd89087939 None admin] Authenticating user token {{(pid=479851) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:19:06.852583 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG dbcounter [-] [479852] Writing DB stats keystone:SELECT=100 {{(pid=479852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:19:06.876375 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG dbcounter [-] [479851] Writing DB stats keystone:SELECT=100 {{(pid=479851) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:19:06.916118 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6ecbf15-bcc3-4aaa-bd29-57fa1ce2a31f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:19:06.917619 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6ecbf15-bcc3-4aaa-bd29-57fa1ce2a31f None admin] RBAC: Authorization granted {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:19:06.962669 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a5ab7b-80e6-49aa-ae28-b6fd89087939 None admin] Validating token access rules against request {{(pid=479851) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:19:07.002582 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5293fbd9-847e-43e3-9c05-79cd74218767 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479851) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:19:07.003524 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5293fbd9-847e-43e3-9c05-79cd74218767 None admin] REQUEST_METHOD: `GET` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:19:07.003810 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5293fbd9-847e-43e3-9c05-79cd74218767 None admin] SCRIPT_NAME: `/identity` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:19:07.004091 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5293fbd9-847e-43e3-9c05-79cd74218767 None admin] PATH_INFO: `/v3/projects` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:19:07.005043 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5293fbd9-847e-43e3-9c05-79cd74218767 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=479851) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 09:19:07.005361 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5293fbd9-847e-43e3-9c05-79cd74218767 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:19:07.007246 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5293fbd9-847e-43e3-9c05-79cd74218767 None admin] RBAC: Authorization granted {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:19:07.025847 dv-cinder-851351-1-smb devstack@keystone.service[479851]: [pid: 479851|app: 0|req: 258/524] 10.222.0.42 () {56 vars in 1148 bytes} [Thu Jul 28 09:19:06 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:19:07.026726 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5293fbd9-847e-43e3-9c05-79cd74218767 None admin] Authenticating user token {{(pid=479851) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:19:07.032832 dv-cinder-851351-1-smb devstack@keystone.service[479852]: [pid: 479852|app: 0|req: 267/525] 10.222.0.42 () {58 vars in 1282 bytes} [Thu Jul 28 09:19:06 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 358 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 28 09:19:07.033755 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ecbf15-bcc3-4aaa-bd29-57fa1ce2a31f None admin] Authenticating user token {{(pid=479852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:19:07.088704 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG dbcounter [-] [479852] Writing DB stats keystone:SELECT=100 {{(pid=479852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:19:07.118273 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG dbcounter [-] [479851] Writing DB stats keystone:SELECT=100 {{(pid=479851) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:19:07.137768 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5293fbd9-847e-43e3-9c05-79cd74218767 None admin] Validating token access rules against request {{(pid=479851) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:19:07.146757 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ecbf15-bcc3-4aaa-bd29-57fa1ce2a31f None admin] Validating token access rules against request {{(pid=479852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:19:07.176252 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49477465-aaf9-43aa-911f-aa9a25e0b643 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479851) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:19:07.176954 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49477465-aaf9-43aa-911f-aa9a25e0b643 None admin] REQUEST_METHOD: `GET` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:19:07.177244 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49477465-aaf9-43aa-911f-aa9a25e0b643 None admin] SCRIPT_NAME: `/identity` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:19:07.177580 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49477465-aaf9-43aa-911f-aa9a25e0b643 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:19:07.182726 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec4b5f4f-6f73-4f07-95f0-c68d85a4af9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:19:07.183349 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4b5f4f-6f73-4f07-95f0-c68d85a4af9c None admin] REQUEST_METHOD: `GET` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:19:07.183631 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4b5f4f-6f73-4f07-95f0-c68d85a4af9c None admin] SCRIPT_NAME: `/identity` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:19:07.183905 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4b5f4f-6f73-4f07-95f0-c68d85a4af9c None admin] PATH_INFO: `/v3/projects` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:19:07.184693 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec4b5f4f-6f73-4f07-95f0-c68d85a4af9c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=479852) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 09:19:07.185000 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec4b5f4f-6f73-4f07-95f0-c68d85a4af9c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:19:07.185115 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49477465-aaf9-43aa-911f-aa9a25e0b643 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:19:07.186497 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec4b5f4f-6f73-4f07-95f0-c68d85a4af9c None admin] RBAC: Authorization granted {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:19:07.186618 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49477465-aaf9-43aa-911f-aa9a25e0b643 None admin] RBAC: Authorization granted {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:19:07.198926 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application [None req-49477465-aaf9-43aa-911f-aa9a25e0b643 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jul 28 09:19:07.198926 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 09:19:07.198926 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 09:19:07.198926 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 09:19:07.198926 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 09:19:07.198926 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 09:19:07.198926 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 09:19:07.198926 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 09:19:07.198926 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 09:19:07.198926 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 09:19:07.198926 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 09:19:07.198926 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 09:19:07.198926 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 28 09:19:07.198926 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 28 09:19:07.198926 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 28 09:19:07.198926 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 28 09:19:07.200069 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 09:19:07.200069 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 09:19:07.200069 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 28 09:19:07.200069 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 09:19:07.200069 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 28 09:19:07.200069 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 09:19:07.200069 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 09:19:07.200069 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 09:19:07.200069 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 09:19:07.200069 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 09:19:07.200069 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 09:19:07.200069 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application with Lock( Jul 28 09:19:07.200069 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 09:19:07.200069 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return self._enter() Jul 28 09:19:07.200069 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 09:19:07.200069 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 09:19:07.200069 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 09:19:07.200069 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return self.creator() Jul 28 09:19:07.206544 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 09:19:07.206544 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application created_value = creator( Jul 28 09:19:07.206544 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 28 09:19:07.206544 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 28 09:19:07.206544 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 28 09:19:07.206544 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 28 09:19:07.206544 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 28 09:19:07.206544 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 28 09:19:07.206544 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jul 28 09:19:07.206544 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application Jul 28 09:19:07.206544 dv-cinder-851351-1-smb devstack@keystone.service[479851]: [pid: 479851|app: 0|req: 259/526] 10.222.0.42 () {56 vars in 1102 bytes} [Thu Jul 28 09:19:07 2022] GET /identity/v3/users/neutron => generated 85 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 09:19:07.206544 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49477465-aaf9-43aa-911f-aa9a25e0b643 None admin] Authenticating user token {{(pid=479851) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:19:07.218601 dv-cinder-851351-1-smb devstack@keystone.service[479852]: [pid: 479852|app: 0|req: 268/527] 10.222.0.42 () {56 vars in 1148 bytes} [Thu Jul 28 09:19:07 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:19:07.218601 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec4b5f4f-6f73-4f07-95f0-c68d85a4af9c None admin] Authenticating user token {{(pid=479852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:19:07.313220 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49477465-aaf9-43aa-911f-aa9a25e0b643 None admin] Validating token access rules against request {{(pid=479851) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:19:07.325229 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec4b5f4f-6f73-4f07-95f0-c68d85a4af9c None admin] Validating token access rules against request {{(pid=479852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:19:07.334643 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG dbcounter [-] [479852] Writing DB stats keystone:SELECT=100 {{(pid=479852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:19:07.354801 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b4af19-7ef1-4d02-8c78-8f8c68d05d95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479851) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:19:07.355692 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b4af19-7ef1-4d02-8c78-8f8c68d05d95 None admin] REQUEST_METHOD: `GET` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:19:07.356126 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b4af19-7ef1-4d02-8c78-8f8c68d05d95 None admin] SCRIPT_NAME: `/identity` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:19:07.356551 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b4af19-7ef1-4d02-8c78-8f8c68d05d95 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:19:07.357521 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62b4af19-7ef1-4d02-8c78-8f8c68d05d95 None admin] RBAC: Adding query filter params (role.id=bd74dfcbc8d7412689d315fe24a1f247, scope.project.id=3a0fb8ea8010437bade8f92dcbcaacee, user.id=334c054f1e13456888926d8129f59f44) {{(pid=479851) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 09:19:07.358006 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62b4af19-7ef1-4d02-8c78-8f8c68d05d95 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:19:07.359689 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62b4af19-7ef1-4d02-8c78-8f8c68d05d95 None admin] RBAC: Authorization granted {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:19:07.361954 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78efbf1f-5e3c-4d33-bcc3-83a2e73884e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:19:07.362612 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78efbf1f-5e3c-4d33-bcc3-83a2e73884e7 None admin] REQUEST_METHOD: `GET` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:19:07.362897 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78efbf1f-5e3c-4d33-bcc3-83a2e73884e7 None admin] SCRIPT_NAME: `/identity` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:19:07.363193 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78efbf1f-5e3c-4d33-bcc3-83a2e73884e7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:19:07.366400 dv-cinder-851351-1-smb devstack@keystone.service[479851]: [pid: 479851|app: 0|req: 260/528] 10.222.0.42 () {56 vars in 1374 bytes} [Thu Jul 28 09:19:07 2022] GET /identity/v3/role_assignments?user.id=334c054f1e13456888926d8129f59f44&scope.project.id=3a0fb8ea8010437bade8f92dcbcaacee&role.id=bd74dfcbc8d7412689d315fe24a1f247 => generated 259 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:19:07.367354 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b4af19-7ef1-4d02-8c78-8f8c68d05d95 None admin] Authenticating user token {{(pid=479851) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:19:07.380972 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78efbf1f-5e3c-4d33-bcc3-83a2e73884e7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:19:07.382822 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78efbf1f-5e3c-4d33-bcc3-83a2e73884e7 None admin] RBAC: Authorization granted {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:19:07.393764 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG dbcounter [-] [479851] Writing DB stats keystone:SELECT=100 {{(pid=479851) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:19:07.402721 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application [None req-78efbf1f-5e3c-4d33-bcc3-83a2e73884e7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 09:19:07.402721 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 09:19:07.402721 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 09:19:07.402721 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 09:19:07.402721 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 09:19:07.402721 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 09:19:07.402721 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 09:19:07.402721 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 09:19:07.402721 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 09:19:07.402721 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 09:19:07.402721 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 09:19:07.402721 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 09:19:07.402721 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 09:19:07.402721 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 09:19:07.402721 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 09:19:07.403898 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 09:19:07.403898 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 09:19:07.403898 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 09:19:07.403898 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 09:19:07.403898 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 09:19:07.403898 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 09:19:07.403898 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 09:19:07.403898 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 09:19:07.403898 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application with Lock( Jul 28 09:19:07.403898 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 09:19:07.403898 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self._enter() Jul 28 09:19:07.403898 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 09:19:07.403898 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 09:19:07.403898 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 09:19:07.403898 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self.creator() Jul 28 09:19:07.403898 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 09:19:07.403898 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application created_value = creator( Jul 28 09:19:07.410028 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 09:19:07.410028 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 09:19:07.410028 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 09:19:07.410028 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application Jul 28 09:19:07.410028 dv-cinder-851351-1-smb devstack@keystone.service[479852]: [pid: 479852|app: 0|req: 269/529] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 09:19:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 09:19:07.410028 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78efbf1f-5e3c-4d33-bcc3-83a2e73884e7 None admin] Authenticating user token {{(pid=479852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:19:07.518044 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b4af19-7ef1-4d02-8c78-8f8c68d05d95 None admin] Validating token access rules against request {{(pid=479851) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:19:07.538019 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78efbf1f-5e3c-4d33-bcc3-83a2e73884e7 None admin] Validating token access rules against request {{(pid=479852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:19:07.560526 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcbf2e8b-d18e-4ac0-9e23-66bc185a7bab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479851) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:19:07.561672 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcbf2e8b-d18e-4ac0-9e23-66bc185a7bab None admin] REQUEST_METHOD: `GET` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:19:07.562175 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcbf2e8b-d18e-4ac0-9e23-66bc185a7bab None admin] SCRIPT_NAME: `/identity` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:19:07.562675 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcbf2e8b-d18e-4ac0-9e23-66bc185a7bab None admin] PATH_INFO: `/v3/users` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:19:07.563695 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcbf2e8b-d18e-4ac0-9e23-66bc185a7bab None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=479851) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 09:19:07.564214 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcbf2e8b-d18e-4ac0-9e23-66bc185a7bab None admin] RBAC: Authorizing `identity:list_users()` {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:19:07.565929 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcbf2e8b-d18e-4ac0-9e23-66bc185a7bab None admin] RBAC: Authorization granted {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:19:07.575102 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d7a2b1-6217-405b-b7a6-dedf7e3c3e35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:19:07.575731 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d7a2b1-6217-405b-b7a6-dedf7e3c3e35 None admin] REQUEST_METHOD: `GET` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:19:07.576022 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d7a2b1-6217-405b-b7a6-dedf7e3c3e35 None admin] SCRIPT_NAME: `/identity` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:19:07.576306 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d7a2b1-6217-405b-b7a6-dedf7e3c3e35 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:19:07.577134 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36d7a2b1-6217-405b-b7a6-dedf7e3c3e35 None admin] RBAC: Adding query filter params (role.id=bd74dfcbc8d7412689d315fe24a1f247, scope.project.id=3a0fb8ea8010437bade8f92dcbcaacee, user.id=c824cbfdc0dc4532ac6af71cbb6841fd) {{(pid=479852) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 09:19:07.577453 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36d7a2b1-6217-405b-b7a6-dedf7e3c3e35 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:19:07.578891 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36d7a2b1-6217-405b-b7a6-dedf7e3c3e35 None admin] RBAC: Authorization granted {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:19:07.585160 dv-cinder-851351-1-smb devstack@keystone.service[479852]: [pid: 479852|app: 0|req: 270/530] 10.222.0.42 () {56 vars in 1374 bytes} [Thu Jul 28 09:19:07 2022] GET /identity/v3/role_assignments?user.id=c824cbfdc0dc4532ac6af71cbb6841fd&scope.project.id=3a0fb8ea8010437bade8f92dcbcaacee&role.id=bd74dfcbc8d7412689d315fe24a1f247 => generated 259 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:19:07.586015 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d7a2b1-6217-405b-b7a6-dedf7e3c3e35 None admin] Authenticating user token {{(pid=479852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:19:07.593000 dv-cinder-851351-1-smb devstack@keystone.service[479851]: [pid: 479851|app: 0|req: 261/531] 10.222.0.42 () {56 vars in 1139 bytes} [Thu Jul 28 09:19:07 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:19:07.594818 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcbf2e8b-d18e-4ac0-9e23-66bc185a7bab None admin] Authenticating user token {{(pid=479851) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:19:07.615026 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG dbcounter [-] [479852] Writing DB stats keystone:SELECT=100 {{(pid=479852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:19:07.673022 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG dbcounter [-] [479851] Writing DB stats keystone:SELECT=100 {{(pid=479851) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:19:07.754066 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcbf2e8b-d18e-4ac0-9e23-66bc185a7bab None admin] Validating token access rules against request {{(pid=479851) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:19:07.760353 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d7a2b1-6217-405b-b7a6-dedf7e3c3e35 None admin] Validating token access rules against request {{(pid=479852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:19:07.822986 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51f1275-d120-43fe-9d23-11fce5de2cee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479851) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:19:07.824012 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51f1275-d120-43fe-9d23-11fce5de2cee None admin] REQUEST_METHOD: `GET` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:19:07.824502 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51f1275-d120-43fe-9d23-11fce5de2cee None admin] SCRIPT_NAME: `/identity` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:19:07.825038 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51f1275-d120-43fe-9d23-11fce5de2cee None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:19:07.832778 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e3daf80-cdad-4d3c-8030-a2d0e10ef5a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:19:07.833850 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3daf80-cdad-4d3c-8030-a2d0e10ef5a0 None admin] REQUEST_METHOD: `GET` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:19:07.834337 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3daf80-cdad-4d3c-8030-a2d0e10ef5a0 None admin] SCRIPT_NAME: `/identity` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:19:07.834881 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3daf80-cdad-4d3c-8030-a2d0e10ef5a0 None admin] PATH_INFO: `/v3/domains` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:19:07.835700 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e3daf80-cdad-4d3c-8030-a2d0e10ef5a0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=479852) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 09:19:07.836103 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e3daf80-cdad-4d3c-8030-a2d0e10ef5a0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:19:07.837725 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e3daf80-cdad-4d3c-8030-a2d0e10ef5a0 None admin] RBAC: Authorization granted {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:19:07.856722 dv-cinder-851351-1-smb devstack@keystone.service[479852]: [pid: 479852|app: 0|req: 271/532] 10.222.0.42 () {56 vars in 1109 bytes} [Thu Jul 28 09:19:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:19:07.862690 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e3daf80-cdad-4d3c-8030-a2d0e10ef5a0 None admin] Authenticating user token {{(pid=479852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:19:07.911089 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e51f1275-d120-43fe-9d23-11fce5de2cee None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:19:07.913227 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e51f1275-d120-43fe-9d23-11fce5de2cee None admin] RBAC: Authorization granted {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:19:08.005088 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG dbcounter [-] [479851] Writing DB stats keystone:SELECT=100 {{(pid=479851) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:19:08.032684 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG dbcounter [-] [479852] Writing DB stats keystone:SELECT=100 {{(pid=479852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:19:08.067814 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e3daf80-cdad-4d3c-8030-a2d0e10ef5a0 None admin] Validating token access rules against request {{(pid=479852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:19:08.090930 dv-cinder-851351-1-smb devstack@keystone.service[479851]: [pid: 479851|app: 0|req: 262/533] 10.222.0.42 () {58 vars in 1282 bytes} [Thu Jul 28 09:19:07 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 497 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 28 09:19:08.097691 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51f1275-d120-43fe-9d23-11fce5de2cee None admin] Authenticating user token {{(pid=479851) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:19:08.154584 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0630d6-be97-4380-9784-358e6ff5bdcc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:19:08.155552 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0630d6-be97-4380-9784-358e6ff5bdcc None admin] REQUEST_METHOD: `GET` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:19:08.156556 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0630d6-be97-4380-9784-358e6ff5bdcc None admin] SCRIPT_NAME: `/identity` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:19:08.157711 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0630d6-be97-4380-9784-358e6ff5bdcc None admin] PATH_INFO: `/v3/projects/service` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:19:08.172189 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c0630d6-be97-4380-9784-358e6ff5bdcc None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:19:08.173654 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c0630d6-be97-4380-9784-358e6ff5bdcc None admin] RBAC: Authorization granted {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:19:08.201095 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application [None req-6c0630d6-be97-4380-9784-358e6ff5bdcc None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 09:19:08.201095 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 09:19:08.201095 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 09:19:08.201095 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 09:19:08.201095 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 09:19:08.201095 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 09:19:08.201095 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 09:19:08.201095 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 09:19:08.201095 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 09:19:08.201095 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 09:19:08.201095 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 09:19:08.201095 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 09:19:08.201095 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 28 09:19:08.201095 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 28 09:19:08.201095 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 28 09:19:08.202208 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 28 09:19:08.202208 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 09:19:08.202208 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 09:19:08.202208 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 09:19:08.202208 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 09:19:08.202208 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 09:19:08.202208 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 09:19:08.202208 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 09:19:08.202208 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application with Lock( Jul 28 09:19:08.202208 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 09:19:08.202208 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self._enter() Jul 28 09:19:08.202208 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 09:19:08.202208 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 09:19:08.202208 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 09:19:08.202208 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self.creator() Jul 28 09:19:08.202208 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 09:19:08.202208 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application created_value = creator( Jul 28 09:19:08.203666 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 28 09:19:08.203666 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 28 09:19:08.203666 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 28 09:19:08.203666 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 28 09:19:08.203666 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 28 09:19:08.203666 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 28 09:19:08.203666 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 09:19:08.203666 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application Jul 28 09:19:08.203666 dv-cinder-851351-1-smb devstack@keystone.service[479852]: [pid: 479852|app: 0|req: 272/534] 10.222.0.42 () {56 vars in 1111 bytes} [Thu Jul 28 09:19:07 2022] GET /identity/v3/projects/service => generated 88 bytes in 340 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 09:19:08.210623 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0630d6-be97-4380-9784-358e6ff5bdcc None admin] Authenticating user token {{(pid=479852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:19:08.238961 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51f1275-d120-43fe-9d23-11fce5de2cee None admin] Validating token access rules against request {{(pid=479851) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:19:08.279409 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f58ff1f-216b-4527-a25d-dd51f3d0f5f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479851) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:19:08.280086 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f58ff1f-216b-4527-a25d-dd51f3d0f5f2 None admin] REQUEST_METHOD: `GET` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:19:08.280379 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f58ff1f-216b-4527-a25d-dd51f3d0f5f2 None admin] SCRIPT_NAME: `/identity` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:19:08.280685 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f58ff1f-216b-4527-a25d-dd51f3d0f5f2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:19:08.292038 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f58ff1f-216b-4527-a25d-dd51f3d0f5f2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:19:08.293608 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f58ff1f-216b-4527-a25d-dd51f3d0f5f2 None admin] RBAC: Authorization granted {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:19:08.310344 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application [None req-4f58ff1f-216b-4527-a25d-dd51f3d0f5f2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 09:19:08.310344 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 09:19:08.310344 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 09:19:08.310344 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 09:19:08.310344 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 09:19:08.310344 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 09:19:08.310344 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 09:19:08.310344 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 09:19:08.310344 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 09:19:08.310344 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 09:19:08.310344 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 09:19:08.310344 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 09:19:08.310344 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 09:19:08.310344 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 09:19:08.310344 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 09:19:08.311441 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 09:19:08.311441 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 09:19:08.311441 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 09:19:08.311441 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 09:19:08.311441 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 09:19:08.311441 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 09:19:08.311441 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 09:19:08.311441 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 09:19:08.311441 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application with Lock( Jul 28 09:19:08.311441 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 09:19:08.311441 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return self._enter() Jul 28 09:19:08.311441 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 09:19:08.311441 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 09:19:08.311441 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 09:19:08.311441 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return self.creator() Jul 28 09:19:08.311441 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 09:19:08.311441 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application created_value = creator( Jul 28 09:19:08.313141 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 09:19:08.313141 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 09:19:08.313141 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 09:19:08.313141 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application Jul 28 09:19:08.313141 dv-cinder-851351-1-smb devstack@keystone.service[479851]: [pid: 479851|app: 0|req: 263/535] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 09:19:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 09:19:08.317529 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f58ff1f-216b-4527-a25d-dd51f3d0f5f2 None admin] Authenticating user token {{(pid=479851) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:19:08.345020 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG dbcounter [-] [479851] Writing DB stats keystone:SELECT=100 {{(pid=479851) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:19:08.414898 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0630d6-be97-4380-9784-358e6ff5bdcc None admin] Validating token access rules against request {{(pid=479852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:19:08.432055 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f58ff1f-216b-4527-a25d-dd51f3d0f5f2 None admin] Validating token access rules against request {{(pid=479851) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:19:08.467900 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4eca6b-d9ed-43c1-9762-2ce1e82cd63a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:19:08.468570 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4eca6b-d9ed-43c1-9762-2ce1e82cd63a None admin] REQUEST_METHOD: `GET` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:19:08.468899 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4eca6b-d9ed-43c1-9762-2ce1e82cd63a None admin] SCRIPT_NAME: `/identity` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:19:08.469172 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4eca6b-d9ed-43c1-9762-2ce1e82cd63a None admin] PATH_INFO: `/v3/projects` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:19:08.469943 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac4eca6b-d9ed-43c1-9762-2ce1e82cd63a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=479852) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 09:19:08.470254 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac4eca6b-d9ed-43c1-9762-2ce1e82cd63a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:19:08.471657 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a823045c-9427-46e8-888b-41e803b61402 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479851) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:19:08.471807 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac4eca6b-d9ed-43c1-9762-2ce1e82cd63a None admin] RBAC: Authorization granted {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:19:08.472409 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a823045c-9427-46e8-888b-41e803b61402 None admin] REQUEST_METHOD: `GET` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:19:08.472794 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a823045c-9427-46e8-888b-41e803b61402 None admin] SCRIPT_NAME: `/identity` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:19:08.473145 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a823045c-9427-46e8-888b-41e803b61402 None admin] PATH_INFO: `/v3/domains` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:19:08.474046 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a823045c-9427-46e8-888b-41e803b61402 None admin] RBAC: Adding query filter params (name=Default) {{(pid=479851) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 09:19:08.474469 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a823045c-9427-46e8-888b-41e803b61402 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:19:08.476044 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a823045c-9427-46e8-888b-41e803b61402 None admin] RBAC: Authorization granted {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:19:08.489506 dv-cinder-851351-1-smb devstack@keystone.service[479851]: [pid: 479851|app: 0|req: 264/537] 10.222.0.42 () {56 vars in 1109 bytes} [Thu Jul 28 09:19:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:19:08.489752 dv-cinder-851351-1-smb devstack@keystone.service[479852]: [pid: 479852|app: 0|req: 273/537] 10.222.0.42 () {56 vars in 1148 bytes} [Thu Jul 28 09:19:08 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 279 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 09:19:08.497880 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4eca6b-d9ed-43c1-9762-2ce1e82cd63a None admin] Authenticating user token {{(pid=479852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:19:08.498120 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6b6c52-5139-47b9-bf76-cf1b6aca905c None None] REQUEST_METHOD: `GET` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:19:08.498469 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6b6c52-5139-47b9-bf76-cf1b6aca905c None None] SCRIPT_NAME: `/identity` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:19:08.498791 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6b6c52-5139-47b9-bf76-cf1b6aca905c None None] PATH_INFO: `/` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:19:08.500456 dv-cinder-851351-1-smb devstack@keystone.service[479851]: [pid: 479851|app: 0|req: 265/538] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 09:19:08 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 09:19:08.502647 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6b6c52-5139-47b9-bf76-cf1b6aca905c None None] Authenticating user token {{(pid=479851) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:19:08.503318 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG dbcounter [-] [479852] Writing DB stats keystone:SELECT=100 {{(pid=479852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:19:08.595669 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG dbcounter [-] [479851] Writing DB stats keystone:SELECT=100 {{(pid=479851) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:19:08.623681 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6b6c52-5139-47b9-bf76-cf1b6aca905c None None] Validating token access rules against request {{(pid=479851) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:19:08.635094 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4eca6b-d9ed-43c1-9762-2ce1e82cd63a None admin] Validating token access rules against request {{(pid=479852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:19:08.662760 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b25d7b-7ee0-4b82-8eca-e2a5b3fd9ead None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479851) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:19:08.663536 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b25d7b-7ee0-4b82-8eca-e2a5b3fd9ead None admin] REQUEST_METHOD: `GET` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:19:08.663892 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b25d7b-7ee0-4b82-8eca-e2a5b3fd9ead None admin] SCRIPT_NAME: `/identity` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:19:08.664247 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b25d7b-7ee0-4b82-8eca-e2a5b3fd9ead None admin] PATH_INFO: `/v3/projects/service` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:19:08.671995 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65b25d7b-7ee0-4b82-8eca-e2a5b3fd9ead None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:19:08.673758 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65b25d7b-7ee0-4b82-8eca-e2a5b3fd9ead None admin] RBAC: Authorization granted {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:19:08.676240 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3f6bce-6159-4e04-9ca7-d9318f2a1828 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:19:08.677448 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3f6bce-6159-4e04-9ca7-d9318f2a1828 None admin] REQUEST_METHOD: `GET` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:19:08.678125 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3f6bce-6159-4e04-9ca7-d9318f2a1828 None admin] SCRIPT_NAME: `/identity` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:19:08.678609 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3f6bce-6159-4e04-9ca7-d9318f2a1828 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:19:08.679787 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e3f6bce-6159-4e04-9ca7-d9318f2a1828 None admin] RBAC: Adding query filter params (role.id=bd74dfcbc8d7412689d315fe24a1f247, scope.project.id=3a0fb8ea8010437bade8f92dcbcaacee, user.id=754c4e4857fd440dbc2b7e59c8196db6) {{(pid=479852) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 09:19:08.680341 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e3f6bce-6159-4e04-9ca7-d9318f2a1828 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:19:08.682272 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e3f6bce-6159-4e04-9ca7-d9318f2a1828 None admin] RBAC: Authorization granted {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:19:08.687253 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application [None req-65b25d7b-7ee0-4b82-8eca-e2a5b3fd9ead None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 09:19:08.687253 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 09:19:08.687253 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 09:19:08.687253 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 09:19:08.687253 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 09:19:08.687253 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 09:19:08.687253 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 09:19:08.687253 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 09:19:08.687253 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 09:19:08.687253 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 09:19:08.687253 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 09:19:08.687253 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 09:19:08.687253 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 28 09:19:08.687253 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 28 09:19:08.687253 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 28 09:19:08.688380 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 28 09:19:08.688380 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 09:19:08.688380 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 09:19:08.688380 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 09:19:08.688380 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 09:19:08.688380 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 09:19:08.688380 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 09:19:08.688380 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 09:19:08.688380 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application with Lock( Jul 28 09:19:08.688380 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 09:19:08.688380 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return self._enter() Jul 28 09:19:08.688380 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 09:19:08.688380 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 09:19:08.688380 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 09:19:08.688380 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return self.creator() Jul 28 09:19:08.688380 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 09:19:08.688380 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application created_value = creator( Jul 28 09:19:08.689903 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 28 09:19:08.689903 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 28 09:19:08.689903 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 28 09:19:08.689903 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 28 09:19:08.689903 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 28 09:19:08.689903 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 28 09:19:08.689903 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 09:19:08.689903 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application Jul 28 09:19:08.696731 dv-cinder-851351-1-smb devstack@keystone.service[479851]: [pid: 479851|app: 0|req: 266/539] 10.222.0.42 () {56 vars in 1111 bytes} [Thu Jul 28 09:19:08 2022] GET /identity/v3/projects/service => generated 88 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 09:19:08.696731 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f8a65c-a058-44fa-8b91-fb2eb00b51fe None None] REQUEST_METHOD: `POST` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:19:08.696731 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f8a65c-a058-44fa-8b91-fb2eb00b51fe None None] SCRIPT_NAME: `/identity` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:19:08.696731 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f8a65c-a058-44fa-8b91-fb2eb00b51fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:19:08.697711 dv-cinder-851351-1-smb devstack@keystone.service[479852]: [pid: 479852|app: 0|req: 274/540] 10.222.0.42 () {56 vars in 1374 bytes} [Thu Jul 28 09:19:08 2022] GET /identity/v3/role_assignments?user.id=754c4e4857fd440dbc2b7e59c8196db6&scope.project.id=3a0fb8ea8010437bade8f92dcbcaacee&role.id=bd74dfcbc8d7412689d315fe24a1f247 => generated 259 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:19:08.699005 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3f6bce-6159-4e04-9ca7-d9318f2a1828 None admin] Authenticating user token {{(pid=479852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:19:08.715418 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.auth.core [None req-60f8a65c-a058-44fa-8b91-fb2eb00b51fe None None] MFA Rules not processed for user `c198f91a4ae84d2b9cc730a6e304c2be`. Rule list: `[]` (Enabled: `True`). {{(pid=479851) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 09:19:08.716834 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.fernet_utils [None req-60f8a65c-a058-44fa-8b91-fb2eb00b51fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=479851) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 09:19:08.796039 dv-cinder-851351-1-smb devstack@keystone.service[479851]: [pid: 479851|app: 0|req: 267/541] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 09:19:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 09:19:08.822578 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG dbcounter [-] [479852] Writing DB stats keystone:SELECT=100 {{(pid=479852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:19:08.824464 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f8a65c-a058-44fa-8b91-fb2eb00b51fe None None] Authenticating user token {{(pid=479851) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:19:08.916944 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3f6bce-6159-4e04-9ca7-d9318f2a1828 None admin] Validating token access rules against request {{(pid=479852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:19:08.949147 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG dbcounter [-] [479851] Writing DB stats keystone:SELECT=100 {{(pid=479851) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:19:08.963346 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-416029ef-66af-4881-8fd8-275c30418751 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:19:08.964036 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416029ef-66af-4881-8fd8-275c30418751 None admin] REQUEST_METHOD: `GET` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:19:08.964468 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416029ef-66af-4881-8fd8-275c30418751 None admin] SCRIPT_NAME: `/identity` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:19:08.964773 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416029ef-66af-4881-8fd8-275c30418751 None admin] PATH_INFO: `/v3/projects` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:19:08.965937 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-416029ef-66af-4881-8fd8-275c30418751 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=479852) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 09:19:08.966254 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-416029ef-66af-4881-8fd8-275c30418751 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:19:08.968133 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-416029ef-66af-4881-8fd8-275c30418751 None admin] RBAC: Authorization granted {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:19:09.001057 dv-cinder-851351-1-smb devstack@keystone.service[479852]: [pid: 479852|app: 0|req: 275/542] 10.222.0.42 () {56 vars in 1148 bytes} [Thu Jul 28 09:19:08 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 302 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:19:09.004898 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f8a65c-a058-44fa-8b91-fb2eb00b51fe None None] Validating token access rules against request {{(pid=479851) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:19:09.017104 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-416029ef-66af-4881-8fd8-275c30418751 None admin] Authenticating user token {{(pid=479852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:19:09.077294 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18793d7-7b7a-4ec5-8294-bd307182a0fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479851) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:19:09.077960 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18793d7-7b7a-4ec5-8294-bd307182a0fa None admin] REQUEST_METHOD: `GET` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:19:09.078242 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18793d7-7b7a-4ec5-8294-bd307182a0fa None admin] SCRIPT_NAME: `/identity` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:19:09.078517 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18793d7-7b7a-4ec5-8294-bd307182a0fa None admin] PATH_INFO: `/v3/roles/service` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:19:09.099207 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e18793d7-7b7a-4ec5-8294-bd307182a0fa None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 09:19:09.104764 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application [None req-e18793d7-7b7a-4ec5-8294-bd307182a0fa None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 28 09:19:09.104764 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 09:19:09.104764 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 09:19:09.104764 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 09:19:09.104764 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 09:19:09.104764 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 09:19:09.104764 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 09:19:09.104764 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 09:19:09.104764 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 09:19:09.104764 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 09:19:09.104764 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 09:19:09.104764 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 09:19:09.104764 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 09:19:09.104764 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 09:19:09.104764 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 09:19:09.104764 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 09:19:09.105864 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 09:19:09.105864 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 09:19:09.105864 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 09:19:09.105864 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 09:19:09.105864 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 09:19:09.105864 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 09:19:09.105864 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 09:19:09.105864 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 09:19:09.105864 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 09:19:09.105864 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 09:19:09.105864 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 09:19:09.105864 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application with Lock( Jul 28 09:19:09.105864 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 09:19:09.105864 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return self._enter() Jul 28 09:19:09.105864 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 09:19:09.105864 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 09:19:09.106865 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 09:19:09.106865 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return self.creator() Jul 28 09:19:09.106865 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 09:19:09.106865 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application created_value = creator( Jul 28 09:19:09.106865 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 09:19:09.106865 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 09:19:09.106865 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 09:19:09.106865 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 09:19:09.106865 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 09:19:09.106865 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 09:19:09.106865 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 28 09:19:09.106865 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application Jul 28 09:19:09.106865 dv-cinder-851351-1-smb devstack@keystone.service[479851]: [pid: 479851|app: 0|req: 268/543] 10.222.0.42 () {56 vars in 1102 bytes} [Thu Jul 28 09:19:08 2022] GET /identity/v3/roles/service => generated 85 bytes in 282 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 09:19:09.114045 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18793d7-7b7a-4ec5-8294-bd307182a0fa None admin] Authenticating user token {{(pid=479851) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:19:09.215579 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-416029ef-66af-4881-8fd8-275c30418751 None admin] Validating token access rules against request {{(pid=479852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:19:09.251372 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG dbcounter [-] [479852] Writing DB stats keystone:SELECT=100 {{(pid=479852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:19:09.263003 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7429abe-075d-43cf-9cbd-d544bbaf5e47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:19:09.263628 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7429abe-075d-43cf-9cbd-d544bbaf5e47 None admin] REQUEST_METHOD: `GET` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:19:09.263908 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7429abe-075d-43cf-9cbd-d544bbaf5e47 None admin] SCRIPT_NAME: `/identity` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:19:09.264181 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7429abe-075d-43cf-9cbd-d544bbaf5e47 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:19:09.265008 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7429abe-075d-43cf-9cbd-d544bbaf5e47 None admin] RBAC: Adding query filter params (role.id=bd74dfcbc8d7412689d315fe24a1f247, scope.project.id=3a0fb8ea8010437bade8f92dcbcaacee, user.id=e86286d4286c4a92bb581148d91a3b01) {{(pid=479852) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 09:19:09.265316 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7429abe-075d-43cf-9cbd-d544bbaf5e47 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:19:09.268283 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7429abe-075d-43cf-9cbd-d544bbaf5e47 None admin] RBAC: Authorization granted {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:19:09.281545 dv-cinder-851351-1-smb devstack@keystone.service[479852]: [pid: 479852|app: 0|req: 276/544] 10.222.0.42 () {56 vars in 1374 bytes} [Thu Jul 28 09:19:09 2022] GET /identity/v3/role_assignments?user.id=e86286d4286c4a92bb581148d91a3b01&scope.project.id=3a0fb8ea8010437bade8f92dcbcaacee&role.id=bd74dfcbc8d7412689d315fe24a1f247 => generated 259 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:19:09.324844 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18793d7-7b7a-4ec5-8294-bd307182a0fa None admin] Validating token access rules against request {{(pid=479851) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:19:09.365156 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG dbcounter [-] [479851] Writing DB stats keystone:SELECT=100 {{(pid=479851) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:19:09.380508 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9632ade7-e822-43d0-96b4-73752afbcef7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479851) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:19:09.381201 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9632ade7-e822-43d0-96b4-73752afbcef7 None admin] REQUEST_METHOD: `GET` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:19:09.381490 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9632ade7-e822-43d0-96b4-73752afbcef7 None admin] SCRIPT_NAME: `/identity` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:19:09.384473 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9632ade7-e822-43d0-96b4-73752afbcef7 None admin] PATH_INFO: `/v3/roles` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:19:09.384473 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9632ade7-e822-43d0-96b4-73752afbcef7 None admin] RBAC: Adding query filter params (name=service) {{(pid=479851) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 09:19:09.384473 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9632ade7-e822-43d0-96b4-73752afbcef7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:19:09.384473 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9632ade7-e822-43d0-96b4-73752afbcef7 None admin] RBAC: Authorization granted {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:19:09.399703 dv-cinder-851351-1-smb devstack@keystone.service[479851]: [pid: 479851|app: 0|req: 269/545] 10.222.0.42 () {56 vars in 1103 bytes} [Thu Jul 28 09:19:09 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 286 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:19:09.405673 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7429abe-075d-43cf-9cbd-d544bbaf5e47 None admin] Authenticating user token {{(pid=479852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:19:09.595349 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7429abe-075d-43cf-9cbd-d544bbaf5e47 None admin] Validating token access rules against request {{(pid=479852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:19:09.654437 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f38e0631-b2e5-475d-b27d-60d9ef93214f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:19:09.655576 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38e0631-b2e5-475d-b27d-60d9ef93214f None admin] REQUEST_METHOD: `GET` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:19:09.656074 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38e0631-b2e5-475d-b27d-60d9ef93214f None admin] SCRIPT_NAME: `/identity` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:19:09.656553 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38e0631-b2e5-475d-b27d-60d9ef93214f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:19:09.678715 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f38e0631-b2e5-475d-b27d-60d9ef93214f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:19:09.680907 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f38e0631-b2e5-475d-b27d-60d9ef93214f None admin] RBAC: Authorization granted {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:19:09.698721 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application [None req-f38e0631-b2e5-475d-b27d-60d9ef93214f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 09:19:09.698721 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 09:19:09.698721 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 09:19:09.698721 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 09:19:09.698721 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 09:19:09.698721 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 09:19:09.698721 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 09:19:09.698721 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 09:19:09.698721 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 09:19:09.698721 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 09:19:09.698721 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 09:19:09.698721 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 09:19:09.698721 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 09:19:09.698721 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 09:19:09.698721 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 09:19:09.700047 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 09:19:09.700047 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 09:19:09.700047 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 09:19:09.700047 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 09:19:09.700047 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 09:19:09.700047 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 09:19:09.700047 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 09:19:09.700047 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 09:19:09.700047 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application with Lock( Jul 28 09:19:09.700047 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 09:19:09.700047 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self._enter() Jul 28 09:19:09.700047 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 09:19:09.700047 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 09:19:09.700047 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 09:19:09.700047 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self.creator() Jul 28 09:19:09.700047 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 09:19:09.700047 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application created_value = creator( Jul 28 09:19:09.701388 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 09:19:09.701388 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 09:19:09.701388 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 09:19:09.701388 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application Jul 28 09:19:09.704086 dv-cinder-851351-1-smb devstack@keystone.service[479852]: [pid: 479852|app: 0|req: 277/546] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 09:19:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 299 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 09:19:09.710875 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9632ade7-e822-43d0-96b4-73752afbcef7 None admin] Authenticating user token {{(pid=479851) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:19:09.834026 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c44328a-faa0-447e-9b75-6f1f48c10392 None None] REQUEST_METHOD: `GET` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:19:09.834376 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c44328a-faa0-447e-9b75-6f1f48c10392 None None] SCRIPT_NAME: `/identity` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:19:09.834576 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c44328a-faa0-447e-9b75-6f1f48c10392 None None] PATH_INFO: `/` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:19:09.836071 dv-cinder-851351-1-smb devstack@keystone.service[479852]: [pid: 479852|app: 0|req: 278/547] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 09:19:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 09:19:09.844552 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43090a43-ae14-4098-9ab5-37d26afdd159 None None] REQUEST_METHOD: `POST` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:19:09.845236 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43090a43-ae14-4098-9ab5-37d26afdd159 None None] SCRIPT_NAME: `/identity` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:19:09.845785 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43090a43-ae14-4098-9ab5-37d26afdd159 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:19:09.845899 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9632ade7-e822-43d0-96b4-73752afbcef7 None admin] Validating token access rules against request {{(pid=479851) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:19:09.885745 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95e79df-8ed1-4a21-a6da-885c966bd715 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479851) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:19:09.886387 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95e79df-8ed1-4a21-a6da-885c966bd715 None admin] REQUEST_METHOD: `GET` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:19:09.886674 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95e79df-8ed1-4a21-a6da-885c966bd715 None admin] SCRIPT_NAME: `/identity` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:19:09.886953 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95e79df-8ed1-4a21-a6da-885c966bd715 None admin] PATH_INFO: `/v3/domains` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:19:09.887660 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f95e79df-8ed1-4a21-a6da-885c966bd715 None admin] RBAC: Adding query filter params (name=Default) {{(pid=479851) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 09:19:09.887969 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f95e79df-8ed1-4a21-a6da-885c966bd715 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:19:09.888253 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.auth.core [None req-43090a43-ae14-4098-9ab5-37d26afdd159 None None] MFA Rules not processed for user `c198f91a4ae84d2b9cc730a6e304c2be`. Rule list: `[]` (Enabled: `True`). {{(pid=479852) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 09:19:09.889476 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f95e79df-8ed1-4a21-a6da-885c966bd715 None admin] RBAC: Authorization granted {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:19:09.889993 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.fernet_utils [None req-43090a43-ae14-4098-9ab5-37d26afdd159 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=479852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 09:19:09.906848 dv-cinder-851351-1-smb devstack@keystone.service[479851]: [pid: 479851|app: 0|req: 270/548] 10.222.0.42 () {56 vars in 1109 bytes} [Thu Jul 28 09:19:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:19:09.911548 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95e79df-8ed1-4a21-a6da-885c966bd715 None admin] Authenticating user token {{(pid=479851) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:19:09.970240 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG dbcounter [-] [479852] Writing DB stats keystone:SELECT=100 {{(pid=479852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:19:10.016001 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG dbcounter [-] [479851] Writing DB stats keystone:SELECT=100 {{(pid=479851) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:19:10.043028 dv-cinder-851351-1-smb devstack@keystone.service[479852]: [pid: 479852|app: 0|req: 279/549] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 09:19:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 28 09:19:10.082213 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43090a43-ae14-4098-9ab5-37d26afdd159 None None] Authenticating user token {{(pid=479852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:19:10.087657 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95e79df-8ed1-4a21-a6da-885c966bd715 None admin] Validating token access rules against request {{(pid=479851) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:19:10.182521 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e6a6d6-16a2-4f47-b6b4-beebd3b462c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479851) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:19:10.184040 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e6a6d6-16a2-4f47-b6b4-beebd3b462c3 None admin] REQUEST_METHOD: `GET` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:19:10.184751 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e6a6d6-16a2-4f47-b6b4-beebd3b462c3 None admin] SCRIPT_NAME: `/identity` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:19:10.185456 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e6a6d6-16a2-4f47-b6b4-beebd3b462c3 None admin] PATH_INFO: `/v3/users/swift` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:19:10.201761 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6e6a6d6-16a2-4f47-b6b4-beebd3b462c3 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:19:10.203293 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6e6a6d6-16a2-4f47-b6b4-beebd3b462c3 None admin] RBAC: Authorization granted {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:19:10.209396 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43090a43-ae14-4098-9ab5-37d26afdd159 None None] Validating token access rules against request {{(pid=479852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:19:10.221355 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application [None req-b6e6a6d6-16a2-4f47-b6b4-beebd3b462c3 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 28 09:19:10.221355 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 09:19:10.221355 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 09:19:10.221355 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 09:19:10.221355 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 09:19:10.221355 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 09:19:10.221355 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 09:19:10.221355 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 09:19:10.221355 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 09:19:10.221355 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 09:19:10.221355 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 09:19:10.221355 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 09:19:10.221355 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 28 09:19:10.221355 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 28 09:19:10.221355 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 28 09:19:10.221355 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 28 09:19:10.223079 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 09:19:10.223079 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 09:19:10.223079 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 28 09:19:10.223079 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 09:19:10.223079 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 28 09:19:10.223079 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 09:19:10.223079 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 09:19:10.223079 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 09:19:10.223079 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 09:19:10.223079 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 09:19:10.223079 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 09:19:10.223079 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application with Lock( Jul 28 09:19:10.223079 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 09:19:10.223079 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return self._enter() Jul 28 09:19:10.223079 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 09:19:10.223079 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 09:19:10.223079 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 09:19:10.223079 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return self.creator() Jul 28 09:19:10.225761 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 09:19:10.225761 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application created_value = creator( Jul 28 09:19:10.225761 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 28 09:19:10.225761 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 28 09:19:10.225761 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 28 09:19:10.225761 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 28 09:19:10.225761 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 28 09:19:10.225761 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 28 09:19:10.225761 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 28 09:19:10.225761 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application Jul 28 09:19:10.225761 dv-cinder-851351-1-smb devstack@keystone.service[479851]: [pid: 479851|app: 0|req: 271/550] 10.222.0.42 () {56 vars in 1096 bytes} [Thu Jul 28 09:19:09 2022] GET /identity/v3/users/swift => generated 83 bytes in 312 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 09:19:10.229229 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e6a6d6-16a2-4f47-b6b4-beebd3b462c3 None admin] Authenticating user token {{(pid=479851) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:19:10.253839 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b817d7-11fd-4bf0-82ff-f6fd87e40bab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:19:10.254588 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b817d7-11fd-4bf0-82ff-f6fd87e40bab None admin] REQUEST_METHOD: `GET` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:19:10.254860 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b817d7-11fd-4bf0-82ff-f6fd87e40bab None admin] SCRIPT_NAME: `/identity` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:19:10.255141 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b817d7-11fd-4bf0-82ff-f6fd87e40bab None admin] PATH_INFO: `/v3/roles/service` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:19:10.270259 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09b817d7-11fd-4bf0-82ff-f6fd87e40bab None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 09:19:10.276746 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application [None req-09b817d7-11fd-4bf0-82ff-f6fd87e40bab None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 28 09:19:10.276746 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 09:19:10.276746 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 09:19:10.276746 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 09:19:10.276746 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 09:19:10.276746 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 09:19:10.276746 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 09:19:10.276746 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 09:19:10.276746 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 09:19:10.276746 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 09:19:10.276746 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 09:19:10.276746 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 09:19:10.276746 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 09:19:10.276746 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 09:19:10.276746 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 09:19:10.276746 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 09:19:10.277907 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 09:19:10.277907 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 09:19:10.277907 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 09:19:10.277907 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 09:19:10.277907 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 09:19:10.277907 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 09:19:10.277907 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 09:19:10.277907 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 09:19:10.277907 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 09:19:10.277907 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 09:19:10.277907 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 09:19:10.277907 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application with Lock( Jul 28 09:19:10.277907 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 09:19:10.277907 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self._enter() Jul 28 09:19:10.277907 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 09:19:10.277907 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 09:19:10.278888 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 09:19:10.278888 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self.creator() Jul 28 09:19:10.278888 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 09:19:10.278888 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application created_value = creator( Jul 28 09:19:10.278888 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 09:19:10.278888 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 09:19:10.278888 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 09:19:10.278888 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 09:19:10.278888 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 09:19:10.278888 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 09:19:10.278888 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 28 09:19:10.278888 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application Jul 28 09:19:10.283156 dv-cinder-851351-1-smb devstack@keystone.service[479852]: [pid: 479852|app: 0|req: 280/551] 10.222.0.42 () {56 vars in 1102 bytes} [Thu Jul 28 09:19:10 2022] GET /identity/v3/roles/service => generated 85 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 09:19:10.285355 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b817d7-11fd-4bf0-82ff-f6fd87e40bab None admin] Authenticating user token {{(pid=479852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:19:10.350190 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e6a6d6-16a2-4f47-b6b4-beebd3b462c3 None admin] Validating token access rules against request {{(pid=479851) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:19:10.357119 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG dbcounter [-] [479852] Writing DB stats keystone:SELECT=100 {{(pid=479852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:19:10.364282 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG dbcounter [-] [479851] Writing DB stats keystone:SELECT=100 {{(pid=479851) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:19:10.401684 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d797a1-3906-4102-9203-069ed92b0853 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479851) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:19:10.401684 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d797a1-3906-4102-9203-069ed92b0853 None admin] REQUEST_METHOD: `GET` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:19:10.401684 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d797a1-3906-4102-9203-069ed92b0853 None admin] SCRIPT_NAME: `/identity` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:19:10.401684 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d797a1-3906-4102-9203-069ed92b0853 None admin] PATH_INFO: `/v3/users` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:19:10.402316 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21d797a1-3906-4102-9203-069ed92b0853 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=479851) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 09:19:10.402316 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21d797a1-3906-4102-9203-069ed92b0853 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:19:10.402316 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21d797a1-3906-4102-9203-069ed92b0853 None admin] RBAC: Authorization granted {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:19:10.425278 dv-cinder-851351-1-smb devstack@keystone.service[479851]: [pid: 479851|app: 0|req: 272/552] 10.222.0.42 () {56 vars in 1135 bytes} [Thu Jul 28 09:19:10 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:19:10.430250 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8b92a4-33de-4c69-9cc9-0f1f22279ba2 None None] REQUEST_METHOD: `GET` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:19:10.430553 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8b92a4-33de-4c69-9cc9-0f1f22279ba2 None None] SCRIPT_NAME: `/identity` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:19:10.430818 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8b92a4-33de-4c69-9cc9-0f1f22279ba2 None None] PATH_INFO: `/` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:19:10.432245 dv-cinder-851351-1-smb devstack@keystone.service[479851]: [pid: 479851|app: 0|req: 273/553] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 09:19:10 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 09:19:10.435677 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8b92a4-33de-4c69-9cc9-0f1f22279ba2 None None] Authenticating user token {{(pid=479851) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:19:10.452305 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b817d7-11fd-4bf0-82ff-f6fd87e40bab None admin] Validating token access rules against request {{(pid=479852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:19:10.500885 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abaadfb7-89a7-49ce-bcfe-c3f86017694a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:19:10.501706 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abaadfb7-89a7-49ce-bcfe-c3f86017694a None admin] REQUEST_METHOD: `GET` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:19:10.501990 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abaadfb7-89a7-49ce-bcfe-c3f86017694a None admin] SCRIPT_NAME: `/identity` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:19:10.502271 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abaadfb7-89a7-49ce-bcfe-c3f86017694a None admin] PATH_INFO: `/v3/roles` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:19:10.503130 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abaadfb7-89a7-49ce-bcfe-c3f86017694a None admin] RBAC: Adding query filter params (name=service) {{(pid=479852) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 09:19:10.503440 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abaadfb7-89a7-49ce-bcfe-c3f86017694a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:19:10.504888 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abaadfb7-89a7-49ce-bcfe-c3f86017694a None admin] RBAC: Authorization granted {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:19:10.521381 dv-cinder-851351-1-smb devstack@keystone.service[479852]: [pid: 479852|app: 0|req: 281/554] 10.222.0.42 () {56 vars in 1103 bytes} [Thu Jul 28 09:19:10 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 09:19:10.522817 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e8e03e-063d-4883-9251-3e39e80dda92 None None] REQUEST_METHOD: `POST` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:19:10.523111 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e8e03e-063d-4883-9251-3e39e80dda92 None None] SCRIPT_NAME: `/identity` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:19:10.523394 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e8e03e-063d-4883-9251-3e39e80dda92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:19:10.544917 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.auth.core [None req-27e8e03e-063d-4883-9251-3e39e80dda92 None None] MFA Rules not processed for user `c198f91a4ae84d2b9cc730a6e304c2be`. Rule list: `[]` (Enabled: `True`). {{(pid=479852) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 09:19:10.546210 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.fernet_utils [None req-27e8e03e-063d-4883-9251-3e39e80dda92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=479852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 09:19:10.577542 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8b92a4-33de-4c69-9cc9-0f1f22279ba2 None None] Validating token access rules against request {{(pid=479851) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:19:10.629419 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b818234d-b69d-4858-8048-19dbe9e8a776 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479851) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:19:10.630080 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b818234d-b69d-4858-8048-19dbe9e8a776 None admin] REQUEST_METHOD: `GET` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:19:10.630399 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b818234d-b69d-4858-8048-19dbe9e8a776 None admin] SCRIPT_NAME: `/identity` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:19:10.630690 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b818234d-b69d-4858-8048-19dbe9e8a776 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:19:10.632742 dv-cinder-851351-1-smb devstack@keystone.service[479852]: [pid: 479852|app: 0|req: 282/555] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 09:19:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 09:19:10.634020 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e8e03e-063d-4883-9251-3e39e80dda92 None None] Authenticating user token {{(pid=479852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:19:10.684191 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG dbcounter [-] [479852] Writing DB stats keystone:SELECT=100 {{(pid=479852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:19:10.703854 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG dbcounter [-] [479851] Writing DB stats keystone:SELECT=100 {{(pid=479851) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:19:10.753024 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b818234d-b69d-4858-8048-19dbe9e8a776 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:19:10.754665 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b818234d-b69d-4858-8048-19dbe9e8a776 None admin] RBAC: Authorization granted {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:19:10.789123 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e8e03e-063d-4883-9251-3e39e80dda92 None None] Validating token access rules against request {{(pid=479852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:19:10.841712 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ff7a86-67b3-4253-93da-563a7a15ac74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:19:10.842992 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ff7a86-67b3-4253-93da-563a7a15ac74 None admin] REQUEST_METHOD: `GET` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:19:10.843493 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ff7a86-67b3-4253-93da-563a7a15ac74 None admin] SCRIPT_NAME: `/identity` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:19:10.843977 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ff7a86-67b3-4253-93da-563a7a15ac74 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:19:10.860860 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08ff7a86-67b3-4253-93da-563a7a15ac74 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:19:10.862710 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08ff7a86-67b3-4253-93da-563a7a15ac74 None admin] RBAC: Authorization granted {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:19:10.877618 dv-cinder-851351-1-smb devstack@keystone.service[479851]: [pid: 479851|app: 0|req: 274/556] 10.222.0.42 () {58 vars in 1282 bytes} [Thu Jul 28 09:19:10 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 445 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 28 09:19:10.878541 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b818234d-b69d-4858-8048-19dbe9e8a776 None admin] Authenticating user token {{(pid=479851) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:19:10.880649 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application [None req-08ff7a86-67b3-4253-93da-563a7a15ac74 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 09:19:10.880649 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 09:19:10.880649 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 09:19:10.880649 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 09:19:10.880649 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 09:19:10.880649 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 09:19:10.880649 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 09:19:10.880649 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 09:19:10.880649 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 09:19:10.880649 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 09:19:10.880649 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 09:19:10.880649 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 09:19:10.880649 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 09:19:10.880649 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 09:19:10.880649 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 09:19:10.883468 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 09:19:10.883468 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 09:19:10.883468 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 09:19:10.883468 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 09:19:10.883468 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 09:19:10.883468 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 09:19:10.883468 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 09:19:10.883468 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 09:19:10.883468 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application with Lock( Jul 28 09:19:10.883468 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 09:19:10.883468 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self._enter() Jul 28 09:19:10.883468 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 09:19:10.883468 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 09:19:10.883468 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 09:19:10.883468 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self.creator() Jul 28 09:19:10.883468 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 09:19:10.883468 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application created_value = creator( Jul 28 09:19:10.886874 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 09:19:10.886874 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 09:19:10.886874 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 09:19:10.886874 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application Jul 28 09:19:10.896730 dv-cinder-851351-1-smb devstack@keystone.service[479852]: [pid: 479852|app: 0|req: 283/557] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 09:19:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 255 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 09:19:10.896730 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ff7a86-67b3-4253-93da-563a7a15ac74 None admin] Authenticating user token {{(pid=479852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:19:10.964408 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG dbcounter [-] [479851] Writing DB stats keystone:SELECT=100 {{(pid=479851) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:19:10.992549 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG dbcounter [-] [479852] Writing DB stats keystone:SELECT=100 {{(pid=479852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:19:11.007493 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b818234d-b69d-4858-8048-19dbe9e8a776 None admin] Validating token access rules against request {{(pid=479851) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:19:11.021284 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ff7a86-67b3-4253-93da-563a7a15ac74 None admin] Validating token access rules against request {{(pid=479852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:19:11.049679 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a49ff67-5054-440f-b98a-635a23b4da86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479851) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:19:11.050777 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a49ff67-5054-440f-b98a-635a23b4da86 None admin] REQUEST_METHOD: `GET` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:19:11.051192 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a49ff67-5054-440f-b98a-635a23b4da86 None admin] SCRIPT_NAME: `/identity` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:19:11.051694 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a49ff67-5054-440f-b98a-635a23b4da86 None admin] PATH_INFO: `/v3/roles/service` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:19:11.065362 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a49ff67-5054-440f-b98a-635a23b4da86 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 09:19:11.066444 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d9de88-7d9c-47fe-9730-630f370d0805 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:19:11.067607 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d9de88-7d9c-47fe-9730-630f370d0805 None admin] REQUEST_METHOD: `GET` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:19:11.068113 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d9de88-7d9c-47fe-9730-630f370d0805 None admin] SCRIPT_NAME: `/identity` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:19:11.068550 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d9de88-7d9c-47fe-9730-630f370d0805 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:19:11.071030 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application [None req-8a49ff67-5054-440f-b98a-635a23b4da86 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 28 09:19:11.071030 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 09:19:11.071030 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 09:19:11.071030 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 09:19:11.071030 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 09:19:11.071030 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 09:19:11.071030 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 09:19:11.071030 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 09:19:11.071030 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 09:19:11.071030 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 09:19:11.071030 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 09:19:11.071030 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 09:19:11.071030 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 09:19:11.071030 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 09:19:11.071030 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 09:19:11.071030 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 09:19:11.072848 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 09:19:11.072848 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 09:19:11.072848 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 09:19:11.072848 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 09:19:11.072848 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 09:19:11.072848 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 09:19:11.072848 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 09:19:11.072848 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 09:19:11.072848 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 09:19:11.072848 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 09:19:11.072848 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 09:19:11.072848 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application with Lock( Jul 28 09:19:11.072848 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 09:19:11.072848 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return self._enter() Jul 28 09:19:11.072848 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 09:19:11.072848 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 09:19:11.074066 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 09:19:11.074066 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return self.creator() Jul 28 09:19:11.074066 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 09:19:11.074066 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application created_value = creator( Jul 28 09:19:11.074066 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 09:19:11.074066 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 09:19:11.074066 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 09:19:11.074066 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 09:19:11.074066 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 09:19:11.074066 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 09:19:11.074066 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 28 09:19:11.074066 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application Jul 28 09:19:11.076819 dv-cinder-851351-1-smb devstack@keystone.service[479851]: [pid: 479851|app: 0|req: 275/558] 10.222.0.42 () {56 vars in 1102 bytes} [Thu Jul 28 09:19:10 2022] GET /identity/v3/roles/service => generated 85 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 09:19:11.077846 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a49ff67-5054-440f-b98a-635a23b4da86 None admin] Authenticating user token {{(pid=479851) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:19:11.088007 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59d9de88-7d9c-47fe-9730-630f370d0805 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:19:11.089941 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59d9de88-7d9c-47fe-9730-630f370d0805 None admin] RBAC: Authorization granted {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:19:11.112884 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application [None req-59d9de88-7d9c-47fe-9730-630f370d0805 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 09:19:11.112884 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 09:19:11.112884 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 09:19:11.112884 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 09:19:11.112884 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 09:19:11.112884 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 09:19:11.112884 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 09:19:11.112884 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 09:19:11.112884 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 09:19:11.112884 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 09:19:11.112884 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 09:19:11.112884 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 09:19:11.112884 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 09:19:11.112884 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 09:19:11.112884 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 09:19:11.114238 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 09:19:11.114238 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 09:19:11.114238 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 09:19:11.114238 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 09:19:11.114238 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 09:19:11.114238 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 09:19:11.114238 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 09:19:11.114238 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 09:19:11.114238 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application with Lock( Jul 28 09:19:11.114238 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 09:19:11.114238 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self._enter() Jul 28 09:19:11.114238 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 09:19:11.114238 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 09:19:11.114238 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 09:19:11.114238 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self.creator() Jul 28 09:19:11.114238 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 09:19:11.114238 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application created_value = creator( Jul 28 09:19:11.115594 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 09:19:11.115594 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 09:19:11.115594 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 09:19:11.115594 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application Jul 28 09:19:11.122234 dv-cinder-851351-1-smb devstack@keystone.service[479852]: [pid: 479852|app: 0|req: 284/559] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 09:19:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 09:19:11.124500 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d9de88-7d9c-47fe-9730-630f370d0805 None admin] Authenticating user token {{(pid=479852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:19:11.229345 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a49ff67-5054-440f-b98a-635a23b4da86 None admin] Validating token access rules against request {{(pid=479851) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:19:11.261271 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG dbcounter [-] [479851] Writing DB stats keystone:SELECT=100 {{(pid=479851) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:19:11.272761 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e5f81a-4d68-49ea-815e-acbe3c8e774c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479851) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:19:11.273434 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e5f81a-4d68-49ea-815e-acbe3c8e774c None admin] REQUEST_METHOD: `GET` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:19:11.273565 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d9de88-7d9c-47fe-9730-630f370d0805 None admin] Validating token access rules against request {{(pid=479852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:19:11.274025 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e5f81a-4d68-49ea-815e-acbe3c8e774c None admin] SCRIPT_NAME: `/identity` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:19:11.274025 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e5f81a-4d68-49ea-815e-acbe3c8e774c None admin] PATH_INFO: `/v3/domains` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:19:11.274734 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e5f81a-4d68-49ea-815e-acbe3c8e774c None admin] RBAC: Adding query filter params (name=Default) {{(pid=479851) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 09:19:11.275054 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e5f81a-4d68-49ea-815e-acbe3c8e774c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:19:11.276592 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e5f81a-4d68-49ea-815e-acbe3c8e774c None admin] RBAC: Authorization granted {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:19:11.293755 dv-cinder-851351-1-smb devstack@keystone.service[479851]: [pid: 479851|app: 0|req: 276/560] 10.222.0.42 () {56 vars in 1109 bytes} [Thu Jul 28 09:19:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:19:11.293755 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e5f81a-4d68-49ea-815e-acbe3c8e774c None admin] Authenticating user token {{(pid=479851) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:19:11.311952 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG dbcounter [-] [479852] Writing DB stats keystone:SELECT=100 {{(pid=479852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:19:11.319473 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dfab317-3ecc-4f47-8eea-8dbc77b4866f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:19:11.320148 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dfab317-3ecc-4f47-8eea-8dbc77b4866f None admin] REQUEST_METHOD: `GET` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:19:11.320485 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dfab317-3ecc-4f47-8eea-8dbc77b4866f None admin] SCRIPT_NAME: `/identity` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:19:11.320734 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dfab317-3ecc-4f47-8eea-8dbc77b4866f None admin] PATH_INFO: `/v3/roles` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:19:11.321827 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dfab317-3ecc-4f47-8eea-8dbc77b4866f None admin] RBAC: Adding query filter params (name=service) {{(pid=479852) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 09:19:11.322205 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dfab317-3ecc-4f47-8eea-8dbc77b4866f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:19:11.323546 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dfab317-3ecc-4f47-8eea-8dbc77b4866f None admin] RBAC: Authorization granted {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:19:11.342161 dv-cinder-851351-1-smb devstack@keystone.service[479852]: [pid: 479852|app: 0|req: 285/561] 10.222.0.42 () {56 vars in 1103 bytes} [Thu Jul 28 09:19:11 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:19:11.342161 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab882db-bf0a-4f91-96b8-f400c41dea4d None None] REQUEST_METHOD: `GET` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:19:11.342161 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab882db-bf0a-4f91-96b8-f400c41dea4d None None] SCRIPT_NAME: `/identity` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:19:11.342161 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab882db-bf0a-4f91-96b8-f400c41dea4d None None] PATH_INFO: `/` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:19:11.342161 dv-cinder-851351-1-smb devstack@keystone.service[479852]: [pid: 479852|app: 0|req: 286/562] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 09:19:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 09:19:11.342161 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab882db-bf0a-4f91-96b8-f400c41dea4d None None] Authenticating user token {{(pid=479852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:19:11.433338 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e5f81a-4d68-49ea-815e-acbe3c8e774c None admin] Validating token access rules against request {{(pid=479851) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:19:11.473386 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab882db-bf0a-4f91-96b8-f400c41dea4d None None] Validating token access rules against request {{(pid=479852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:19:11.475071 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9f3d1c-ec99-4ce3-82d9-764f0835e177 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479851) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:19:11.475944 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9f3d1c-ec99-4ce3-82d9-764f0835e177 None admin] REQUEST_METHOD: `GET` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:19:11.476493 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9f3d1c-ec99-4ce3-82d9-764f0835e177 None admin] SCRIPT_NAME: `/identity` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:19:11.476847 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9f3d1c-ec99-4ce3-82d9-764f0835e177 None admin] PATH_INFO: `/v3/domains` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:19:11.477547 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a9f3d1c-ec99-4ce3-82d9-764f0835e177 None admin] RBAC: Adding query filter params (name=Default) {{(pid=479851) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 09:19:11.477870 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a9f3d1c-ec99-4ce3-82d9-764f0835e177 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:19:11.479297 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a9f3d1c-ec99-4ce3-82d9-764f0835e177 None admin] RBAC: Authorization granted {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:19:11.500246 dv-cinder-851351-1-smb devstack@keystone.service[479851]: [pid: 479851|app: 0|req: 277/563] 10.222.0.42 () {56 vars in 1109 bytes} [Thu Jul 28 09:19:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:19:11.500246 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9f3d1c-ec99-4ce3-82d9-764f0835e177 None admin] Authenticating user token {{(pid=479851) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:19:11.521610 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b07b98-5ced-4af4-a6d2-ce09ed9937b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:19:11.522282 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b07b98-5ced-4af4-a6d2-ce09ed9937b5 None admin] REQUEST_METHOD: `GET` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:19:11.522572 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b07b98-5ced-4af4-a6d2-ce09ed9937b5 None admin] SCRIPT_NAME: `/identity` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:19:11.522888 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b07b98-5ced-4af4-a6d2-ce09ed9937b5 None admin] PATH_INFO: `/v3/users/glance` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:19:11.532550 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89b07b98-5ced-4af4-a6d2-ce09ed9937b5 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:19:11.534076 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89b07b98-5ced-4af4-a6d2-ce09ed9937b5 None admin] RBAC: Authorization granted {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:19:11.546858 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application [None req-89b07b98-5ced-4af4-a6d2-ce09ed9937b5 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jul 28 09:19:11.546858 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 09:19:11.546858 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 09:19:11.546858 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 09:19:11.546858 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 09:19:11.546858 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 09:19:11.546858 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 09:19:11.546858 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 09:19:11.546858 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 09:19:11.546858 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 09:19:11.546858 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 09:19:11.546858 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 09:19:11.546858 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 28 09:19:11.546858 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 28 09:19:11.546858 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 28 09:19:11.546858 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 28 09:19:11.548241 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 09:19:11.548241 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 09:19:11.548241 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 28 09:19:11.548241 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 09:19:11.548241 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 28 09:19:11.548241 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 09:19:11.548241 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 09:19:11.548241 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 09:19:11.548241 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 09:19:11.548241 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 09:19:11.548241 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 09:19:11.548241 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application with Lock( Jul 28 09:19:11.548241 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 09:19:11.548241 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self._enter() Jul 28 09:19:11.548241 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 09:19:11.548241 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 09:19:11.548241 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 09:19:11.548241 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self.creator() Jul 28 09:19:11.549405 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 09:19:11.549405 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application created_value = creator( Jul 28 09:19:11.549405 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 28 09:19:11.549405 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 28 09:19:11.549405 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 28 09:19:11.549405 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 28 09:19:11.549405 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 28 09:19:11.549405 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 28 09:19:11.549405 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jul 28 09:19:11.549405 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application Jul 28 09:19:11.549405 dv-cinder-851351-1-smb devstack@keystone.service[479852]: [pid: 479852|app: 0|req: 287/564] 10.222.0.42 () {56 vars in 1099 bytes} [Thu Jul 28 09:19:11 2022] GET /identity/v3/users/glance => generated 84 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 09:19:11.550094 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3b8ff9-1dc5-4682-b39d-2618ac9ef45b None None] REQUEST_METHOD: `POST` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:19:11.550094 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3b8ff9-1dc5-4682-b39d-2618ac9ef45b None None] SCRIPT_NAME: `/identity` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:19:11.550288 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3b8ff9-1dc5-4682-b39d-2618ac9ef45b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:19:11.560550 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG dbcounter [-] [479851] Writing DB stats keystone:SELECT=100 {{(pid=479851) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:19:11.569947 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.auth.core [None req-ea3b8ff9-1dc5-4682-b39d-2618ac9ef45b None None] MFA Rules not processed for user `c198f91a4ae84d2b9cc730a6e304c2be`. Rule list: `[]` (Enabled: `True`). {{(pid=479852) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 09:19:11.571167 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.fernet_utils [None req-ea3b8ff9-1dc5-4682-b39d-2618ac9ef45b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=479852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 09:19:11.626318 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9f3d1c-ec99-4ce3-82d9-764f0835e177 None admin] Validating token access rules against request {{(pid=479851) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:19:11.635022 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG dbcounter [-] [479852] Writing DB stats keystone:SELECT=100 {{(pid=479852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:19:11.656941 dv-cinder-851351-1-smb devstack@keystone.service[479852]: [pid: 479852|app: 0|req: 288/565] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 09:19:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 09:19:11.658165 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3b8ff9-1dc5-4682-b39d-2618ac9ef45b None None] Authenticating user token {{(pid=479852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:19:11.682679 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77114c00-6dd1-4ae1-9fda-a6b96fada8d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479851) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:19:11.683474 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77114c00-6dd1-4ae1-9fda-a6b96fada8d6 None admin] REQUEST_METHOD: `GET` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:19:11.683759 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77114c00-6dd1-4ae1-9fda-a6b96fada8d6 None admin] SCRIPT_NAME: `/identity` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:19:11.684034 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77114c00-6dd1-4ae1-9fda-a6b96fada8d6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:19:11.698145 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77114c00-6dd1-4ae1-9fda-a6b96fada8d6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:19:11.700605 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77114c00-6dd1-4ae1-9fda-a6b96fada8d6 None admin] RBAC: Authorization granted {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:19:11.717757 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application [None req-77114c00-6dd1-4ae1-9fda-a6b96fada8d6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 09:19:11.717757 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 09:19:11.717757 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 09:19:11.717757 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 09:19:11.717757 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 09:19:11.717757 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 09:19:11.717757 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 09:19:11.717757 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 09:19:11.717757 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 09:19:11.717757 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 09:19:11.717757 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 09:19:11.717757 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 09:19:11.717757 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 09:19:11.717757 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 09:19:11.717757 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 09:19:11.719424 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 09:19:11.719424 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 09:19:11.719424 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 09:19:11.719424 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 09:19:11.719424 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 09:19:11.719424 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 09:19:11.719424 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 09:19:11.719424 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 09:19:11.719424 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application with Lock( Jul 28 09:19:11.719424 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 09:19:11.719424 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return self._enter() Jul 28 09:19:11.719424 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 09:19:11.719424 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 09:19:11.719424 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 09:19:11.719424 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return self.creator() Jul 28 09:19:11.719424 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 09:19:11.719424 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application created_value = creator( Jul 28 09:19:11.721211 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 09:19:11.721211 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 09:19:11.721211 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 09:19:11.721211 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application Jul 28 09:19:11.721211 dv-cinder-851351-1-smb devstack@keystone.service[479851]: [pid: 479851|app: 0|req: 278/566] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 09:19:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 09:19:11.721211 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77114c00-6dd1-4ae1-9fda-a6b96fada8d6 None admin] Authenticating user token {{(pid=479851) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:19:11.781419 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3b8ff9-1dc5-4682-b39d-2618ac9ef45b None None] Validating token access rules against request {{(pid=479852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:19:11.822098 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a7ab8e3-f33a-4172-b1ec-c14497ff9716 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:19:11.822761 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7ab8e3-f33a-4172-b1ec-c14497ff9716 None admin] REQUEST_METHOD: `GET` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:19:11.823046 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7ab8e3-f33a-4172-b1ec-c14497ff9716 None admin] SCRIPT_NAME: `/identity` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:19:11.823324 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7ab8e3-f33a-4172-b1ec-c14497ff9716 None admin] PATH_INFO: `/v3/projects/service` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:19:11.829919 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG dbcounter [-] [479851] Writing DB stats keystone:SELECT=100 {{(pid=479851) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:19:11.831477 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a7ab8e3-f33a-4172-b1ec-c14497ff9716 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:19:11.833679 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a7ab8e3-f33a-4172-b1ec-c14497ff9716 None admin] RBAC: Authorization granted {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:19:11.834084 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77114c00-6dd1-4ae1-9fda-a6b96fada8d6 None admin] Validating token access rules against request {{(pid=479851) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:19:11.851461 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application [None req-2a7ab8e3-f33a-4172-b1ec-c14497ff9716 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 09:19:11.851461 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 09:19:11.851461 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 09:19:11.851461 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 09:19:11.851461 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 09:19:11.851461 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 09:19:11.851461 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 09:19:11.851461 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 09:19:11.851461 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 09:19:11.851461 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 09:19:11.851461 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 09:19:11.851461 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 09:19:11.851461 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 28 09:19:11.851461 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 28 09:19:11.851461 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 28 09:19:11.852651 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 28 09:19:11.852651 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 09:19:11.852651 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 09:19:11.852651 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 09:19:11.852651 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 09:19:11.852651 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 09:19:11.852651 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 09:19:11.852651 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 09:19:11.852651 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application with Lock( Jul 28 09:19:11.852651 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 09:19:11.852651 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self._enter() Jul 28 09:19:11.852651 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 09:19:11.852651 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 09:19:11.852651 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 09:19:11.852651 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self.creator() Jul 28 09:19:11.852651 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 09:19:11.852651 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application created_value = creator( Jul 28 09:19:11.853759 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 28 09:19:11.853759 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 28 09:19:11.853759 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 28 09:19:11.853759 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 28 09:19:11.853759 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 28 09:19:11.853759 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 28 09:19:11.853759 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 09:19:11.853759 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application Jul 28 09:19:11.853759 dv-cinder-851351-1-smb devstack@keystone.service[479852]: [pid: 479852|app: 0|req: 289/567] 10.222.0.42 () {56 vars in 1111 bytes} [Thu Jul 28 09:19:11 2022] GET /identity/v3/projects/service => generated 88 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 09:19:11.854326 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371f651b-61b0-49ee-b272-e5e2718e362c None None] REQUEST_METHOD: `GET` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:19:11.854326 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371f651b-61b0-49ee-b272-e5e2718e362c None None] SCRIPT_NAME: `/identity` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:19:11.854462 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371f651b-61b0-49ee-b272-e5e2718e362c None None] PATH_INFO: `/` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:19:11.855759 dv-cinder-851351-1-smb devstack@keystone.service[479852]: [pid: 479852|app: 0|req: 290/568] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 09:19:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 09:19:11.856492 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371f651b-61b0-49ee-b272-e5e2718e362c None None] Authenticating user token {{(pid=479852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:19:11.875936 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d03a9fc6-e503-4dde-8e36-21589be65de4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479851) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:19:11.876589 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03a9fc6-e503-4dde-8e36-21589be65de4 None admin] REQUEST_METHOD: `GET` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:19:11.876908 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03a9fc6-e503-4dde-8e36-21589be65de4 None admin] SCRIPT_NAME: `/identity` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:19:11.877391 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03a9fc6-e503-4dde-8e36-21589be65de4 None admin] PATH_INFO: `/v3/users` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:19:11.878013 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d03a9fc6-e503-4dde-8e36-21589be65de4 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=479851) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 09:19:11.878329 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d03a9fc6-e503-4dde-8e36-21589be65de4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:19:11.879820 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d03a9fc6-e503-4dde-8e36-21589be65de4 None admin] RBAC: Authorization granted {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:19:11.900440 dv-cinder-851351-1-smb devstack@keystone.service[479851]: [pid: 479851|app: 0|req: 279/569] 10.222.0.42 () {56 vars in 1137 bytes} [Thu Jul 28 09:19:11 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:19:11.901574 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d03a9fc6-e503-4dde-8e36-21589be65de4 None admin] Authenticating user token {{(pid=479851) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:19:11.911933 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG dbcounter [-] [479852] Writing DB stats keystone:SELECT=100 {{(pid=479852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:19:11.973007 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371f651b-61b0-49ee-b272-e5e2718e362c None None] Validating token access rules against request {{(pid=479852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:19:12.009158 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02193252-b2f0-48e0-87c4-a29eb39b6d47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:19:12.009791 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02193252-b2f0-48e0-87c4-a29eb39b6d47 None admin] REQUEST_METHOD: `GET` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:19:12.010070 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02193252-b2f0-48e0-87c4-a29eb39b6d47 None admin] SCRIPT_NAME: `/identity` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:19:12.010343 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02193252-b2f0-48e0-87c4-a29eb39b6d47 None admin] PATH_INFO: `/v3/roles/service` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:19:12.021149 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02193252-b2f0-48e0-87c4-a29eb39b6d47 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 09:19:12.023509 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d03a9fc6-e503-4dde-8e36-21589be65de4 None admin] Validating token access rules against request {{(pid=479851) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:19:12.026253 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application [None req-02193252-b2f0-48e0-87c4-a29eb39b6d47 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 28 09:19:12.026253 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 09:19:12.026253 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 09:19:12.026253 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 09:19:12.026253 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 09:19:12.026253 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 09:19:12.026253 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 09:19:12.026253 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 09:19:12.026253 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 09:19:12.026253 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 09:19:12.026253 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 09:19:12.026253 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 09:19:12.026253 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 09:19:12.026253 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 09:19:12.026253 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 09:19:12.026253 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 09:19:12.027419 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 09:19:12.027419 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 09:19:12.027419 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 09:19:12.027419 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 09:19:12.027419 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 09:19:12.027419 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 09:19:12.027419 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 09:19:12.027419 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 09:19:12.027419 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 09:19:12.027419 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 09:19:12.027419 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 09:19:12.027419 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application with Lock( Jul 28 09:19:12.027419 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 09:19:12.027419 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self._enter() Jul 28 09:19:12.027419 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 09:19:12.027419 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 09:19:12.028443 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 09:19:12.028443 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self.creator() Jul 28 09:19:12.028443 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 09:19:12.028443 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application created_value = creator( Jul 28 09:19:12.028443 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 09:19:12.028443 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 09:19:12.028443 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 09:19:12.028443 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 09:19:12.028443 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 09:19:12.028443 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 09:19:12.028443 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 28 09:19:12.028443 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application Jul 28 09:19:12.029206 dv-cinder-851351-1-smb devstack@keystone.service[479852]: [pid: 479852|app: 0|req: 291/570] 10.222.0.42 () {56 vars in 1102 bytes} [Thu Jul 28 09:19:11 2022] GET /identity/v3/roles/service => generated 85 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 09:19:12.030076 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02193252-b2f0-48e0-87c4-a29eb39b6d47 None admin] Authenticating user token {{(pid=479852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:19:12.060531 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf884334-ec90-46b7-a426-fb50772ade0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479851) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:19:12.061111 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf884334-ec90-46b7-a426-fb50772ade0b None admin] REQUEST_METHOD: `GET` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:19:12.061476 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf884334-ec90-46b7-a426-fb50772ade0b None admin] SCRIPT_NAME: `/identity` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:19:12.061675 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf884334-ec90-46b7-a426-fb50772ade0b None admin] PATH_INFO: `/v3/domains` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:19:12.062387 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf884334-ec90-46b7-a426-fb50772ade0b None admin] RBAC: Adding query filter params (name=Default) {{(pid=479851) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 09:19:12.062699 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf884334-ec90-46b7-a426-fb50772ade0b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:19:12.064102 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf884334-ec90-46b7-a426-fb50772ade0b None admin] RBAC: Authorization granted {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:19:12.077418 dv-cinder-851351-1-smb devstack@keystone.service[479851]: [pid: 479851|app: 0|req: 280/571] 10.222.0.42 () {56 vars in 1109 bytes} [Thu Jul 28 09:19:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:19:12.079657 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfa4e45-2a1a-44c0-96c2-c8f8e5cfcdf9 None None] REQUEST_METHOD: `POST` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:19:12.080160 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfa4e45-2a1a-44c0-96c2-c8f8e5cfcdf9 None None] SCRIPT_NAME: `/identity` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:19:12.080647 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfa4e45-2a1a-44c0-96c2-c8f8e5cfcdf9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:19:12.100980 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.auth.core [None req-1bfa4e45-2a1a-44c0-96c2-c8f8e5cfcdf9 None None] MFA Rules not processed for user `c198f91a4ae84d2b9cc730a6e304c2be`. Rule list: `[]` (Enabled: `True`). {{(pid=479851) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 09:19:12.102235 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.fernet_utils [None req-1bfa4e45-2a1a-44c0-96c2-c8f8e5cfcdf9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=479851) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 09:19:12.113597 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG dbcounter [-] [479851] Writing DB stats keystone:SELECT=100 {{(pid=479851) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:19:12.135294 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02193252-b2f0-48e0-87c4-a29eb39b6d47 None admin] Validating token access rules against request {{(pid=479852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:19:12.136935 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG dbcounter [-] [479852] Writing DB stats keystone:SELECT=100 {{(pid=479852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:19:12.170731 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8874b820-4a3b-4751-9b47-04b70f4cf8a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:19:12.171373 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8874b820-4a3b-4751-9b47-04b70f4cf8a0 None admin] REQUEST_METHOD: `GET` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:19:12.171654 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8874b820-4a3b-4751-9b47-04b70f4cf8a0 None admin] SCRIPT_NAME: `/identity` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:19:12.171861 dv-cinder-851351-1-smb devstack@keystone.service[479851]: [pid: 479851|app: 0|req: 281/572] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 09:19:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 09:19:12.171953 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8874b820-4a3b-4751-9b47-04b70f4cf8a0 None admin] PATH_INFO: `/v3/projects` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:19:12.172746 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8874b820-4a3b-4751-9b47-04b70f4cf8a0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=479852) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 09:19:12.172875 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bfa4e45-2a1a-44c0-96c2-c8f8e5cfcdf9 None None] Authenticating user token {{(pid=479851) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:19:12.173064 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8874b820-4a3b-4751-9b47-04b70f4cf8a0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:19:12.174539 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8874b820-4a3b-4751-9b47-04b70f4cf8a0 None admin] RBAC: Authorization granted {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:19:12.192344 dv-cinder-851351-1-smb devstack@keystone.service[479852]: [pid: 479852|app: 0|req: 292/573] 10.222.0.42 () {56 vars in 1148 bytes} [Thu Jul 28 09:19:12 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:19:12.193114 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8874b820-4a3b-4751-9b47-04b70f4cf8a0 None admin] Authenticating user token {{(pid=479852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:19:12.284344 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bfa4e45-2a1a-44c0-96c2-c8f8e5cfcdf9 None None] Validating token access rules against request {{(pid=479851) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:19:12.300362 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8874b820-4a3b-4751-9b47-04b70f4cf8a0 None admin] Validating token access rules against request {{(pid=479852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:19:12.320467 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6c59b1-db36-4464-9a06-c4fdeffea74e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479851) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:19:12.321075 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6c59b1-db36-4464-9a06-c4fdeffea74e None admin] REQUEST_METHOD: `GET` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:19:12.321669 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6c59b1-db36-4464-9a06-c4fdeffea74e None admin] SCRIPT_NAME: `/identity` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:19:12.321954 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6c59b1-db36-4464-9a06-c4fdeffea74e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:19:12.333288 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a6c59b1-db36-4464-9a06-c4fdeffea74e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:19:12.334889 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a6c59b1-db36-4464-9a06-c4fdeffea74e None admin] RBAC: Authorization granted {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:19:12.335895 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a43d89-4536-45dd-af38-c6f3140f2c56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:19:12.336535 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a43d89-4536-45dd-af38-c6f3140f2c56 None admin] REQUEST_METHOD: `GET` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:19:12.336866 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a43d89-4536-45dd-af38-c6f3140f2c56 None admin] SCRIPT_NAME: `/identity` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:19:12.337142 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a43d89-4536-45dd-af38-c6f3140f2c56 None admin] PATH_INFO: `/v3/roles` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:19:12.337879 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96a43d89-4536-45dd-af38-c6f3140f2c56 None admin] RBAC: Adding query filter params (name=service) {{(pid=479852) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 09:19:12.338192 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96a43d89-4536-45dd-af38-c6f3140f2c56 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:19:12.339570 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96a43d89-4536-45dd-af38-c6f3140f2c56 None admin] RBAC: Authorization granted {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:19:12.342378 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG dbcounter [-] [479851] Writing DB stats keystone:SELECT=100 {{(pid=479851) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:19:12.349034 dv-cinder-851351-1-smb devstack@keystone.service[479852]: [pid: 479852|app: 0|req: 293/574] 10.222.0.42 () {56 vars in 1103 bytes} [Thu Jul 28 09:19:12 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:19:12.350024 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a43d89-4536-45dd-af38-c6f3140f2c56 None admin] Authenticating user token {{(pid=479852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:19:12.351863 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application [None req-0a6c59b1-db36-4464-9a06-c4fdeffea74e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 09:19:12.351863 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 09:19:12.351863 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 09:19:12.351863 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 09:19:12.351863 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 09:19:12.351863 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 09:19:12.351863 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 09:19:12.351863 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 09:19:12.351863 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 09:19:12.351863 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 09:19:12.351863 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 09:19:12.351863 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 09:19:12.351863 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 09:19:12.351863 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 09:19:12.351863 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 09:19:12.352913 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 09:19:12.352913 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 09:19:12.352913 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 09:19:12.352913 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 09:19:12.352913 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 09:19:12.352913 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 09:19:12.352913 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 09:19:12.352913 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 09:19:12.352913 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application with Lock( Jul 28 09:19:12.352913 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 09:19:12.352913 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return self._enter() Jul 28 09:19:12.352913 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 09:19:12.352913 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 09:19:12.352913 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 09:19:12.352913 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return self.creator() Jul 28 09:19:12.352913 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 09:19:12.352913 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application created_value = creator( Jul 28 09:19:12.354755 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 09:19:12.354755 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 09:19:12.354755 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 09:19:12.354755 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application Jul 28 09:19:12.354755 dv-cinder-851351-1-smb devstack@keystone.service[479851]: [pid: 479851|app: 0|req: 282/575] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 09:19:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 09:19:12.354755 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6c59b1-db36-4464-9a06-c4fdeffea74e None admin] Authenticating user token {{(pid=479851) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:19:12.385521 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG dbcounter [-] [479852] Writing DB stats keystone:SELECT=100 {{(pid=479852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:19:12.463038 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6c59b1-db36-4464-9a06-c4fdeffea74e None admin] Validating token access rules against request {{(pid=479851) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:19:12.465456 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a43d89-4536-45dd-af38-c6f3140f2c56 None admin] Validating token access rules against request {{(pid=479852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:19:12.498867 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b95da04c-5c99-4b37-9c9a-d657fb2d64c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479851) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:19:12.499498 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95da04c-5c99-4b37-9c9a-d657fb2d64c1 None admin] REQUEST_METHOD: `GET` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:19:12.499781 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95da04c-5c99-4b37-9c9a-d657fb2d64c1 None admin] SCRIPT_NAME: `/identity` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:19:12.500061 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95da04c-5c99-4b37-9c9a-d657fb2d64c1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:19:12.500929 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b95da04c-5c99-4b37-9c9a-d657fb2d64c1 None admin] RBAC: Adding query filter params (role.id=bd74dfcbc8d7412689d315fe24a1f247, scope.project.id=3a0fb8ea8010437bade8f92dcbcaacee, user.id=213aa011e5004256aead7e486d7f2eba) {{(pid=479851) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 09:19:12.501248 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b95da04c-5c99-4b37-9c9a-d657fb2d64c1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:19:12.502373 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1542c68c-7fbb-4b00-aad5-ce74487be5c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:19:12.502718 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b95da04c-5c99-4b37-9c9a-d657fb2d64c1 None admin] RBAC: Authorization granted {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:19:12.503051 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1542c68c-7fbb-4b00-aad5-ce74487be5c3 None admin] REQUEST_METHOD: `GET` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:19:12.503360 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1542c68c-7fbb-4b00-aad5-ce74487be5c3 None admin] SCRIPT_NAME: `/identity` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:19:12.503635 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1542c68c-7fbb-4b00-aad5-ce74487be5c3 None admin] PATH_INFO: `/v3/users/nova` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:19:12.508646 dv-cinder-851351-1-smb devstack@keystone.service[479851]: [pid: 479851|app: 0|req: 283/576] 10.222.0.42 () {56 vars in 1374 bytes} [Thu Jul 28 09:19:12 2022] GET /identity/v3/role_assignments?user.id=213aa011e5004256aead7e486d7f2eba&scope.project.id=3a0fb8ea8010437bade8f92dcbcaacee&role.id=bd74dfcbc8d7412689d315fe24a1f247 => generated 259 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:19:12.509493 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b95da04c-5c99-4b37-9c9a-d657fb2d64c1 None admin] Authenticating user token {{(pid=479851) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:19:12.514909 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1542c68c-7fbb-4b00-aad5-ce74487be5c3 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:19:12.516512 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1542c68c-7fbb-4b00-aad5-ce74487be5c3 None admin] RBAC: Authorization granted {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:19:12.532880 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application [None req-1542c68c-7fbb-4b00-aad5-ce74487be5c3 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 28 09:19:12.532880 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 09:19:12.532880 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 09:19:12.532880 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 09:19:12.532880 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 09:19:12.532880 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 09:19:12.532880 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 09:19:12.532880 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 09:19:12.532880 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 09:19:12.532880 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 09:19:12.532880 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 09:19:12.532880 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 09:19:12.532880 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 28 09:19:12.532880 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 28 09:19:12.532880 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 28 09:19:12.532880 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 28 09:19:12.534524 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 09:19:12.534524 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 09:19:12.534524 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 28 09:19:12.534524 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 09:19:12.534524 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 28 09:19:12.534524 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 09:19:12.534524 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 09:19:12.534524 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 09:19:12.534524 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 09:19:12.534524 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 09:19:12.534524 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 09:19:12.534524 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application with Lock( Jul 28 09:19:12.534524 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 09:19:12.534524 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self._enter() Jul 28 09:19:12.534524 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 09:19:12.534524 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 09:19:12.534524 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 09:19:12.534524 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self.creator() Jul 28 09:19:12.535611 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 09:19:12.535611 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application created_value = creator( Jul 28 09:19:12.535611 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 28 09:19:12.535611 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 28 09:19:12.535611 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 28 09:19:12.535611 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 28 09:19:12.535611 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 28 09:19:12.535611 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 28 09:19:12.535611 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 28 09:19:12.535611 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application Jul 28 09:19:12.535611 dv-cinder-851351-1-smb devstack@keystone.service[479852]: [pid: 479852|app: 0|req: 294/577] 10.222.0.42 () {56 vars in 1093 bytes} [Thu Jul 28 09:19:12 2022] GET /identity/v3/users/nova => generated 82 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 09:19:12.535611 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1542c68c-7fbb-4b00-aad5-ce74487be5c3 None admin] Authenticating user token {{(pid=479852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:19:12.599648 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG dbcounter [-] [479851] Writing DB stats keystone:SELECT=100 {{(pid=479851) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:19:12.637802 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG dbcounter [-] [479852] Writing DB stats keystone:SELECT=100 {{(pid=479852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:19:12.651199 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b95da04c-5c99-4b37-9c9a-d657fb2d64c1 None admin] Validating token access rules against request {{(pid=479851) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:19:12.657552 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1542c68c-7fbb-4b00-aad5-ce74487be5c3 None admin] Validating token access rules against request {{(pid=479852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:19:12.696531 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-108e3a7a-918c-4cd9-8573-5ba76ff595d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479851) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:19:12.697621 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108e3a7a-918c-4cd9-8573-5ba76ff595d9 None admin] REQUEST_METHOD: `GET` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:19:12.698146 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108e3a7a-918c-4cd9-8573-5ba76ff595d9 None admin] SCRIPT_NAME: `/identity` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:19:12.698352 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92357c16-06a7-44e6-931f-7ce1ebb28de3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:19:12.698873 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108e3a7a-918c-4cd9-8573-5ba76ff595d9 None admin] PATH_INFO: `/v3/roles/service` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:19:12.698987 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92357c16-06a7-44e6-931f-7ce1ebb28de3 None admin] REQUEST_METHOD: `GET` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:19:12.699252 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92357c16-06a7-44e6-931f-7ce1ebb28de3 None admin] SCRIPT_NAME: `/identity` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:19:12.699534 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92357c16-06a7-44e6-931f-7ce1ebb28de3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:19:12.710930 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-108e3a7a-918c-4cd9-8573-5ba76ff595d9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 09:19:12.714059 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92357c16-06a7-44e6-931f-7ce1ebb28de3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:19:12.715553 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92357c16-06a7-44e6-931f-7ce1ebb28de3 None admin] RBAC: Authorization granted {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:19:12.716477 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application [None req-108e3a7a-918c-4cd9-8573-5ba76ff595d9 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 28 09:19:12.716477 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 09:19:12.716477 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 09:19:12.716477 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 09:19:12.716477 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 09:19:12.716477 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 09:19:12.716477 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 09:19:12.716477 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 09:19:12.716477 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 09:19:12.716477 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 09:19:12.716477 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 09:19:12.716477 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 09:19:12.716477 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 09:19:12.716477 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 09:19:12.716477 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 09:19:12.716477 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 09:19:12.717700 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 09:19:12.717700 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 09:19:12.717700 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 09:19:12.717700 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 09:19:12.717700 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 09:19:12.717700 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 09:19:12.717700 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 09:19:12.717700 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 09:19:12.717700 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 09:19:12.717700 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 09:19:12.717700 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 09:19:12.717700 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application with Lock( Jul 28 09:19:12.717700 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 09:19:12.717700 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return self._enter() Jul 28 09:19:12.717700 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 09:19:12.717700 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 09:19:12.718663 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 09:19:12.718663 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return self.creator() Jul 28 09:19:12.718663 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 09:19:12.718663 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application created_value = creator( Jul 28 09:19:12.718663 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 09:19:12.718663 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 09:19:12.718663 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 09:19:12.718663 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 09:19:12.718663 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 09:19:12.718663 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 09:19:12.718663 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 28 09:19:12.718663 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application Jul 28 09:19:12.718663 dv-cinder-851351-1-smb devstack@keystone.service[479851]: [pid: 479851|app: 0|req: 284/578] 10.222.0.42 () {56 vars in 1102 bytes} [Thu Jul 28 09:19:12 2022] GET /identity/v3/roles/service => generated 85 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 09:19:12.718663 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-108e3a7a-918c-4cd9-8573-5ba76ff595d9 None admin] Authenticating user token {{(pid=479851) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:19:12.737783 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application [None req-92357c16-06a7-44e6-931f-7ce1ebb28de3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 09:19:12.737783 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 09:19:12.737783 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 09:19:12.737783 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 09:19:12.737783 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 09:19:12.737783 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 09:19:12.737783 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 09:19:12.737783 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 09:19:12.737783 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 09:19:12.737783 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 09:19:12.737783 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 09:19:12.737783 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 09:19:12.737783 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 09:19:12.737783 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 09:19:12.737783 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 09:19:12.738910 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 09:19:12.738910 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 09:19:12.738910 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 09:19:12.738910 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 09:19:12.738910 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 09:19:12.738910 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 09:19:12.738910 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 09:19:12.738910 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 09:19:12.738910 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application with Lock( Jul 28 09:19:12.738910 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 09:19:12.738910 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self._enter() Jul 28 09:19:12.738910 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 09:19:12.738910 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 09:19:12.738910 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 09:19:12.738910 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self.creator() Jul 28 09:19:12.738910 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 09:19:12.738910 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application created_value = creator( Jul 28 09:19:12.739993 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 09:19:12.739993 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 09:19:12.739993 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 09:19:12.739993 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application Jul 28 09:19:12.739993 dv-cinder-851351-1-smb devstack@keystone.service[479852]: [pid: 479852|app: 0|req: 295/579] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 09:19:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 09:19:12.739993 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92357c16-06a7-44e6-931f-7ce1ebb28de3 None admin] Authenticating user token {{(pid=479852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:19:12.833057 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-108e3a7a-918c-4cd9-8573-5ba76ff595d9 None admin] Validating token access rules against request {{(pid=479851) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:19:12.851045 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92357c16-06a7-44e6-931f-7ce1ebb28de3 None admin] Validating token access rules against request {{(pid=479852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:19:12.860428 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG dbcounter [-] [479851] Writing DB stats keystone:SELECT=100 {{(pid=479851) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:19:12.873980 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c6ea97-9fbd-4a13-b1e7-fa85f7493f89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479851) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:19:12.874773 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c6ea97-9fbd-4a13-b1e7-fa85f7493f89 None admin] REQUEST_METHOD: `GET` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:19:12.875166 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c6ea97-9fbd-4a13-b1e7-fa85f7493f89 None admin] SCRIPT_NAME: `/identity` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:19:12.875546 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c6ea97-9fbd-4a13-b1e7-fa85f7493f89 None admin] PATH_INFO: `/v3/domains` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:19:12.876431 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86c6ea97-9fbd-4a13-b1e7-fa85f7493f89 None admin] RBAC: Adding query filter params (name=Default) {{(pid=479851) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 09:19:12.876895 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86c6ea97-9fbd-4a13-b1e7-fa85f7493f89 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:19:12.878451 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86c6ea97-9fbd-4a13-b1e7-fa85f7493f89 None admin] RBAC: Authorization granted {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:19:12.897505 dv-cinder-851351-1-smb devstack@keystone.service[479851]: [pid: 479851|app: 0|req: 285/580] 10.222.0.42 () {56 vars in 1109 bytes} [Thu Jul 28 09:19:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:19:12.899036 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c6ea97-9fbd-4a13-b1e7-fa85f7493f89 None admin] Authenticating user token {{(pid=479851) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:19:12.904423 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9dd53bb-2fff-41c8-95e0-af42758356b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:19:12.905539 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9dd53bb-2fff-41c8-95e0-af42758356b1 None admin] REQUEST_METHOD: `GET` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:19:12.906197 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9dd53bb-2fff-41c8-95e0-af42758356b1 None admin] SCRIPT_NAME: `/identity` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:19:12.906619 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9dd53bb-2fff-41c8-95e0-af42758356b1 None admin] PATH_INFO: `/v3/users` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:19:12.907525 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9dd53bb-2fff-41c8-95e0-af42758356b1 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=479852) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 09:19:12.908088 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9dd53bb-2fff-41c8-95e0-af42758356b1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:19:12.910374 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9dd53bb-2fff-41c8-95e0-af42758356b1 None admin] RBAC: Authorization granted {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:19:12.915092 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG dbcounter [-] [479852] Writing DB stats keystone:SELECT=100 {{(pid=479852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:19:12.933723 dv-cinder-851351-1-smb devstack@keystone.service[479852]: [pid: 479852|app: 0|req: 296/581] 10.222.0.42 () {56 vars in 1133 bytes} [Thu Jul 28 09:19:12 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:19:12.934730 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9dd53bb-2fff-41c8-95e0-af42758356b1 None admin] Authenticating user token {{(pid=479852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:19:13.030144 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c6ea97-9fbd-4a13-b1e7-fa85f7493f89 None admin] Validating token access rules against request {{(pid=479851) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:19:13.046663 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9dd53bb-2fff-41c8-95e0-af42758356b1 None admin] Validating token access rules against request {{(pid=479852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:19:13.069345 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11eb30f0-8357-41eb-ace0-b7072be44943 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479851) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:19:13.070177 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11eb30f0-8357-41eb-ace0-b7072be44943 None admin] REQUEST_METHOD: `GET` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:19:13.070554 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11eb30f0-8357-41eb-ace0-b7072be44943 None admin] SCRIPT_NAME: `/identity` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:19:13.070905 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11eb30f0-8357-41eb-ace0-b7072be44943 None admin] PATH_INFO: `/v3/roles` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:19:13.072038 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11eb30f0-8357-41eb-ace0-b7072be44943 None admin] RBAC: Adding query filter params (name=service) {{(pid=479851) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 09:19:13.072543 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11eb30f0-8357-41eb-ace0-b7072be44943 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:19:13.074171 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11eb30f0-8357-41eb-ace0-b7072be44943 None admin] RBAC: Authorization granted {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:19:13.088025 dv-cinder-851351-1-smb devstack@keystone.service[479851]: [pid: 479851|app: 0|req: 286/582] 10.222.0.42 () {56 vars in 1103 bytes} [Thu Jul 28 09:19:12 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:19:13.088025 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11eb30f0-8357-41eb-ace0-b7072be44943 None admin] Authenticating user token {{(pid=479851) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:19:13.089201 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4baa0e25-7eba-4527-835d-28e0f95d43ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:19:13.089945 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4baa0e25-7eba-4527-835d-28e0f95d43ae None admin] REQUEST_METHOD: `GET` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:19:13.090305 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4baa0e25-7eba-4527-835d-28e0f95d43ae None admin] SCRIPT_NAME: `/identity` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:19:13.090653 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4baa0e25-7eba-4527-835d-28e0f95d43ae None admin] PATH_INFO: `/v3/domains` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:19:13.091547 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4baa0e25-7eba-4527-835d-28e0f95d43ae None admin] RBAC: Adding query filter params (name=Default) {{(pid=479852) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 09:19:13.091917 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4baa0e25-7eba-4527-835d-28e0f95d43ae None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:19:13.093762 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4baa0e25-7eba-4527-835d-28e0f95d43ae None admin] RBAC: Authorization granted {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:19:13.111682 dv-cinder-851351-1-smb devstack@keystone.service[479852]: [pid: 479852|app: 0|req: 297/583] 10.222.0.42 () {56 vars in 1109 bytes} [Thu Jul 28 09:19:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:19:13.111682 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4baa0e25-7eba-4527-835d-28e0f95d43ae None admin] Authenticating user token {{(pid=479852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:19:13.136864 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG dbcounter [-] [479851] Writing DB stats keystone:SELECT=100 {{(pid=479851) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:19:13.182723 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG dbcounter [-] [479852] Writing DB stats keystone:SELECT=100 {{(pid=479852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:19:13.203065 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11eb30f0-8357-41eb-ace0-b7072be44943 None admin] Validating token access rules against request {{(pid=479851) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:19:13.240538 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4baa0e25-7eba-4527-835d-28e0f95d43ae None admin] Validating token access rules against request {{(pid=479852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:19:13.252209 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6992c024-2033-411f-bc68-62133b160a10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479851) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:19:13.253470 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6992c024-2033-411f-bc68-62133b160a10 None admin] REQUEST_METHOD: `GET` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:19:13.253941 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6992c024-2033-411f-bc68-62133b160a10 None admin] SCRIPT_NAME: `/identity` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:19:13.254560 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6992c024-2033-411f-bc68-62133b160a10 None admin] PATH_INFO: `/v3/projects/service` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:19:13.263387 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6992c024-2033-411f-bc68-62133b160a10 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:19:13.264920 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6992c024-2033-411f-bc68-62133b160a10 None admin] RBAC: Authorization granted {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:19:13.278213 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application [None req-6992c024-2033-411f-bc68-62133b160a10 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 09:19:13.278213 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 09:19:13.278213 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 09:19:13.278213 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 09:19:13.278213 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 09:19:13.278213 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 09:19:13.278213 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 09:19:13.278213 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 09:19:13.278213 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 09:19:13.278213 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 09:19:13.278213 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 09:19:13.278213 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 09:19:13.278213 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 28 09:19:13.278213 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 28 09:19:13.278213 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 28 09:19:13.279437 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 28 09:19:13.279437 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 09:19:13.279437 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 09:19:13.279437 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 09:19:13.279437 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 09:19:13.279437 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 09:19:13.279437 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 09:19:13.279437 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 09:19:13.279437 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application with Lock( Jul 28 09:19:13.279437 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 09:19:13.279437 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return self._enter() Jul 28 09:19:13.279437 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 09:19:13.279437 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 09:19:13.279437 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 09:19:13.279437 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return self.creator() Jul 28 09:19:13.279437 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 09:19:13.279437 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application created_value = creator( Jul 28 09:19:13.281327 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 28 09:19:13.281327 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 28 09:19:13.281327 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 28 09:19:13.281327 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 28 09:19:13.281327 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 28 09:19:13.281327 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 28 09:19:13.281327 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 09:19:13.281327 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application Jul 28 09:19:13.281912 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371b580d-4f77-43ee-bd6a-2cf0c139af6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:19:13.281912 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371b580d-4f77-43ee-bd6a-2cf0c139af6d None admin] REQUEST_METHOD: `GET` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:19:13.281912 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371b580d-4f77-43ee-bd6a-2cf0c139af6d None admin] SCRIPT_NAME: `/identity` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:19:13.282163 dv-cinder-851351-1-smb devstack@keystone.service[479851]: [pid: 479851|app: 0|req: 287/584] 10.222.0.42 () {56 vars in 1111 bytes} [Thu Jul 28 09:19:13 2022] GET /identity/v3/projects/service => generated 88 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 09:19:13.282163 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6992c024-2033-411f-bc68-62133b160a10 None admin] Authenticating user token {{(pid=479851) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:19:13.284240 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371b580d-4f77-43ee-bd6a-2cf0c139af6d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:19:13.297345 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-371b580d-4f77-43ee-bd6a-2cf0c139af6d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:19:13.298806 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-371b580d-4f77-43ee-bd6a-2cf0c139af6d None admin] RBAC: Authorization granted {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:19:13.313941 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application [None req-371b580d-4f77-43ee-bd6a-2cf0c139af6d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 09:19:13.313941 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 09:19:13.313941 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 09:19:13.313941 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 09:19:13.313941 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 09:19:13.313941 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 09:19:13.313941 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 09:19:13.313941 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 09:19:13.313941 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 09:19:13.313941 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 09:19:13.313941 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 09:19:13.313941 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 09:19:13.313941 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 09:19:13.313941 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 09:19:13.313941 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 09:19:13.315711 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 09:19:13.315711 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 09:19:13.315711 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 09:19:13.315711 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 09:19:13.315711 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 09:19:13.315711 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 09:19:13.315711 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 09:19:13.315711 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 09:19:13.315711 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application with Lock( Jul 28 09:19:13.315711 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 09:19:13.315711 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self._enter() Jul 28 09:19:13.315711 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 09:19:13.315711 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 09:19:13.315711 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 09:19:13.315711 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self.creator() Jul 28 09:19:13.315711 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 09:19:13.315711 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application created_value = creator( Jul 28 09:19:13.317123 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 09:19:13.317123 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 09:19:13.317123 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 09:19:13.317123 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application Jul 28 09:19:13.317123 dv-cinder-851351-1-smb devstack@keystone.service[479852]: [pid: 479852|app: 0|req: 298/585] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 09:19:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 09:19:13.317123 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371b580d-4f77-43ee-bd6a-2cf0c139af6d None admin] Authenticating user token {{(pid=479852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:19:13.402432 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6992c024-2033-411f-bc68-62133b160a10 None admin] Validating token access rules against request {{(pid=479851) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:19:13.404913 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG dbcounter [-] [479851] Writing DB stats keystone:SELECT=100 {{(pid=479851) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:19:13.439492 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20705b48-1598-4be0-9e5e-2a2f277f3c05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479851) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:19:13.440162 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20705b48-1598-4be0-9e5e-2a2f277f3c05 None admin] REQUEST_METHOD: `GET` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:19:13.440451 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20705b48-1598-4be0-9e5e-2a2f277f3c05 None admin] SCRIPT_NAME: `/identity` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:19:13.440799 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20705b48-1598-4be0-9e5e-2a2f277f3c05 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:19:13.441542 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371b580d-4f77-43ee-bd6a-2cf0c139af6d None admin] Validating token access rules against request {{(pid=479852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:19:13.449991 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG dbcounter [-] [479852] Writing DB stats keystone:SELECT=100 {{(pid=479852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:19:13.455053 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20705b48-1598-4be0-9e5e-2a2f277f3c05 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:19:13.456828 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20705b48-1598-4be0-9e5e-2a2f277f3c05 None admin] RBAC: Authorization granted {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:19:13.472487 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application [None req-20705b48-1598-4be0-9e5e-2a2f277f3c05 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 09:19:13.472487 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 09:19:13.472487 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 09:19:13.472487 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 09:19:13.472487 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 09:19:13.472487 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 09:19:13.472487 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 09:19:13.472487 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 09:19:13.472487 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 09:19:13.472487 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 09:19:13.472487 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 09:19:13.472487 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 09:19:13.472487 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 09:19:13.472487 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 09:19:13.472487 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 09:19:13.474213 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 09:19:13.474213 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 09:19:13.474213 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 09:19:13.474213 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 09:19:13.474213 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 09:19:13.474213 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 09:19:13.474213 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 09:19:13.474213 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 09:19:13.474213 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application with Lock( Jul 28 09:19:13.474213 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 09:19:13.474213 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return self._enter() Jul 28 09:19:13.474213 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 09:19:13.474213 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 09:19:13.474213 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 09:19:13.474213 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return self.creator() Jul 28 09:19:13.474213 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 09:19:13.474213 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application created_value = creator( Jul 28 09:19:13.475334 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 09:19:13.475334 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 09:19:13.475334 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 09:19:13.475334 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application Jul 28 09:19:13.475334 dv-cinder-851351-1-smb devstack@keystone.service[479851]: [pid: 479851|app: 0|req: 288/586] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 09:19:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 09:19:13.475334 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20705b48-1598-4be0-9e5e-2a2f277f3c05 None admin] Authenticating user token {{(pid=479851) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:19:13.486215 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6873c69d-421b-44c0-9abf-a125cec6e8e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:19:13.486883 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6873c69d-421b-44c0-9abf-a125cec6e8e5 None admin] REQUEST_METHOD: `GET` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:19:13.487170 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6873c69d-421b-44c0-9abf-a125cec6e8e5 None admin] SCRIPT_NAME: `/identity` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:19:13.487839 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6873c69d-421b-44c0-9abf-a125cec6e8e5 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:19:13.496067 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6873c69d-421b-44c0-9abf-a125cec6e8e5 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:19:13.497789 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6873c69d-421b-44c0-9abf-a125cec6e8e5 None admin] RBAC: Authorization granted {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:19:13.510462 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application [None req-6873c69d-421b-44c0-9abf-a125cec6e8e5 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jul 28 09:19:13.510462 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 09:19:13.510462 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 09:19:13.510462 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 09:19:13.510462 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 09:19:13.510462 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 09:19:13.510462 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 09:19:13.510462 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 09:19:13.510462 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 09:19:13.510462 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 09:19:13.510462 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 09:19:13.510462 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 09:19:13.510462 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 28 09:19:13.510462 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 28 09:19:13.510462 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 28 09:19:13.510462 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 28 09:19:13.511839 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 09:19:13.511839 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 09:19:13.511839 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 28 09:19:13.511839 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 09:19:13.511839 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 28 09:19:13.511839 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 09:19:13.511839 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 09:19:13.511839 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 09:19:13.511839 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 09:19:13.511839 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 09:19:13.511839 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 09:19:13.511839 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application with Lock( Jul 28 09:19:13.511839 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 09:19:13.511839 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self._enter() Jul 28 09:19:13.511839 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 09:19:13.511839 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 09:19:13.511839 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 09:19:13.511839 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self.creator() Jul 28 09:19:13.513242 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 09:19:13.513242 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application created_value = creator( Jul 28 09:19:13.513242 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 28 09:19:13.513242 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 28 09:19:13.513242 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 28 09:19:13.513242 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 28 09:19:13.513242 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 28 09:19:13.513242 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 28 09:19:13.513242 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jul 28 09:19:13.513242 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application Jul 28 09:19:13.518600 dv-cinder-851351-1-smb devstack@keystone.service[479852]: [pid: 479852|app: 0|req: 299/587] 10.222.0.42 () {56 vars in 1099 bytes} [Thu Jul 28 09:19:13 2022] GET /identity/v3/users/cinder => generated 84 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 09:19:13.518600 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6873c69d-421b-44c0-9abf-a125cec6e8e5 None admin] Authenticating user token {{(pid=479852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:19:13.591171 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20705b48-1598-4be0-9e5e-2a2f277f3c05 None admin] Validating token access rules against request {{(pid=479851) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:19:13.627458 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6873c69d-421b-44c0-9abf-a125cec6e8e5 None admin] Validating token access rules against request {{(pid=479852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:19:13.632798 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-212e6254-d68b-41ef-9f9a-11f3338e2c45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479851) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:19:13.633567 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212e6254-d68b-41ef-9f9a-11f3338e2c45 None admin] REQUEST_METHOD: `GET` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:19:13.633930 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212e6254-d68b-41ef-9f9a-11f3338e2c45 None admin] SCRIPT_NAME: `/identity` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:19:13.634284 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212e6254-d68b-41ef-9f9a-11f3338e2c45 None admin] PATH_INFO: `/v3/projects` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:19:13.635146 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-212e6254-d68b-41ef-9f9a-11f3338e2c45 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=479851) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 09:19:13.635539 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-212e6254-d68b-41ef-9f9a-11f3338e2c45 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:19:13.637844 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-212e6254-d68b-41ef-9f9a-11f3338e2c45 None admin] RBAC: Authorization granted {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:19:13.652092 dv-cinder-851351-1-smb devstack@keystone.service[479851]: [pid: 479851|app: 0|req: 289/588] 10.222.0.42 () {56 vars in 1148 bytes} [Thu Jul 28 09:19:13 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:19:13.652970 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-212e6254-d68b-41ef-9f9a-11f3338e2c45 None admin] Authenticating user token {{(pid=479851) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:19:13.670676 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-467fbe76-0b83-4f87-9234-fa35038bda6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:19:13.671501 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467fbe76-0b83-4f87-9234-fa35038bda6f None admin] REQUEST_METHOD: `GET` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:19:13.671786 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467fbe76-0b83-4f87-9234-fa35038bda6f None admin] SCRIPT_NAME: `/identity` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:19:13.672069 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467fbe76-0b83-4f87-9234-fa35038bda6f None admin] PATH_INFO: `/v3/domains` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:19:13.672823 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-467fbe76-0b83-4f87-9234-fa35038bda6f None admin] RBAC: Adding query filter params (name=Default) {{(pid=479852) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 09:19:13.673144 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-467fbe76-0b83-4f87-9234-fa35038bda6f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:19:13.674553 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-467fbe76-0b83-4f87-9234-fa35038bda6f None admin] RBAC: Authorization granted {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:19:13.674976 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG dbcounter [-] [479851] Writing DB stats keystone:SELECT=100 {{(pid=479851) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:19:13.688211 dv-cinder-851351-1-smb devstack@keystone.service[479852]: [pid: 479852|app: 0|req: 300/589] 10.222.0.42 () {56 vars in 1109 bytes} [Thu Jul 28 09:19:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:19:13.693652 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-467fbe76-0b83-4f87-9234-fa35038bda6f None admin] Authenticating user token {{(pid=479852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:19:13.723677 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG dbcounter [-] [479852] Writing DB stats keystone:SELECT=100 {{(pid=479852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:19:13.767671 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-212e6254-d68b-41ef-9f9a-11f3338e2c45 None admin] Validating token access rules against request {{(pid=479851) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:19:13.805661 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-467fbe76-0b83-4f87-9234-fa35038bda6f None admin] Validating token access rules against request {{(pid=479852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:19:13.806631 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a214aa-e4bf-4197-8b37-bc08f4d9f032 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479851) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:19:13.807370 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a214aa-e4bf-4197-8b37-bc08f4d9f032 None admin] REQUEST_METHOD: `GET` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:19:13.807803 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a214aa-e4bf-4197-8b37-bc08f4d9f032 None admin] SCRIPT_NAME: `/identity` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:19:13.808136 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a214aa-e4bf-4197-8b37-bc08f4d9f032 None admin] PATH_INFO: `/v3/domains` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:19:13.809005 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a214aa-e4bf-4197-8b37-bc08f4d9f032 None admin] RBAC: Adding query filter params (name=Default) {{(pid=479851) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 09:19:13.809418 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a214aa-e4bf-4197-8b37-bc08f4d9f032 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:19:13.810865 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a214aa-e4bf-4197-8b37-bc08f4d9f032 None admin] RBAC: Authorization granted {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:19:13.822977 dv-cinder-851351-1-smb devstack@keystone.service[479851]: [pid: 479851|app: 0|req: 290/590] 10.222.0.42 () {56 vars in 1109 bytes} [Thu Jul 28 09:19:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:19:13.823788 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a214aa-e4bf-4197-8b37-bc08f4d9f032 None admin] Authenticating user token {{(pid=479851) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:19:13.849183 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf3709d-920b-47c0-b9cb-161ab394c0ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:19:13.849925 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf3709d-920b-47c0-b9cb-161ab394c0ca None admin] REQUEST_METHOD: `GET` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:19:13.850085 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf3709d-920b-47c0-b9cb-161ab394c0ca None admin] SCRIPT_NAME: `/identity` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:19:13.850349 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf3709d-920b-47c0-b9cb-161ab394c0ca None admin] PATH_INFO: `/v3/users` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:19:13.851173 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf3709d-920b-47c0-b9cb-161ab394c0ca None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=479852) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 09:19:13.851475 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf3709d-920b-47c0-b9cb-161ab394c0ca None admin] RBAC: Authorizing `identity:list_users()` {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:19:13.852946 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf3709d-920b-47c0-b9cb-161ab394c0ca None admin] RBAC: Authorization granted {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:19:13.876379 dv-cinder-851351-1-smb devstack@keystone.service[479852]: [pid: 479852|app: 0|req: 301/591] 10.222.0.42 () {56 vars in 1137 bytes} [Thu Jul 28 09:19:13 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:19:13.876379 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf3709d-920b-47c0-b9cb-161ab394c0ca None admin] Authenticating user token {{(pid=479852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:19:13.920109 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG dbcounter [-] [479851] Writing DB stats keystone:SELECT=100 {{(pid=479851) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:19:13.950616 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a214aa-e4bf-4197-8b37-bc08f4d9f032 None admin] Validating token access rules against request {{(pid=479851) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:19:13.990031 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7cfa41f-5ed4-4e34-8d08-5b05f239ab4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479851) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:19:13.990773 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7cfa41f-5ed4-4e34-8d08-5b05f239ab4a None admin] REQUEST_METHOD: `PUT` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:19:13.991232 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7cfa41f-5ed4-4e34-8d08-5b05f239ab4a None admin] SCRIPT_NAME: `/identity` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:19:13.991437 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7cfa41f-5ed4-4e34-8d08-5b05f239ab4a None admin] PATH_INFO: `/v3/projects/3a0fb8ea8010437bade8f92dcbcaacee/users/334c054f1e13456888926d8129f59f44/roles/bd74dfcbc8d7412689d315fe24a1f247` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:19:13.992243 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG dbcounter [-] [479852] Writing DB stats keystone:SELECT=100 {{(pid=479852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:19:14.010299 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7cfa41f-5ed4-4e34-8d08-5b05f239ab4a None admin] RBAC: Authorizing `identity:create_grant(project_id=3a0fb8ea8010437bade8f92dcbcaacee, user_id=334c054f1e13456888926d8129f59f44, role_id=bd74dfcbc8d7412689d315fe24a1f247)` {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:19:14.011822 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7cfa41f-5ed4-4e34-8d08-5b05f239ab4a None admin] RBAC: Authorization granted {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:19:14.012216 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf3709d-920b-47c0-b9cb-161ab394c0ca None admin] Validating token access rules against request {{(pid=479852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:19:14.036700 dv-cinder-851351-1-smb devstack@keystone.service[479851]: [pid: 479851|app: 0|req: 291/592] 10.222.0.42 () {58 vars in 1439 bytes} [Thu Jul 28 09:19:13 2022] PUT /identity/v3/projects/3a0fb8ea8010437bade8f92dcbcaacee/users/334c054f1e13456888926d8129f59f44/roles/bd74dfcbc8d7412689d315fe24a1f247 => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 09:19:14.036700 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7cfa41f-5ed4-4e34-8d08-5b05f239ab4a None admin] Authenticating user token {{(pid=479851) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:19:14.065369 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf86a81-17ab-4338-abd5-c37dd9eb34ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:19:14.066281 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf86a81-17ab-4338-abd5-c37dd9eb34ac None admin] REQUEST_METHOD: `GET` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:19:14.066624 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf86a81-17ab-4338-abd5-c37dd9eb34ac None admin] SCRIPT_NAME: `/identity` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:19:14.066983 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf86a81-17ab-4338-abd5-c37dd9eb34ac None admin] PATH_INFO: `/v3/projects/service` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:19:14.075968 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf86a81-17ab-4338-abd5-c37dd9eb34ac None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:19:14.077594 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf86a81-17ab-4338-abd5-c37dd9eb34ac None admin] RBAC: Authorization granted {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:19:14.091230 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application [None req-7bf86a81-17ab-4338-abd5-c37dd9eb34ac None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 09:19:14.091230 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 09:19:14.091230 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 09:19:14.091230 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 09:19:14.091230 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 09:19:14.091230 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 09:19:14.091230 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 09:19:14.091230 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 09:19:14.091230 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 09:19:14.091230 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 09:19:14.091230 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 09:19:14.091230 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 09:19:14.091230 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 28 09:19:14.091230 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 28 09:19:14.091230 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 28 09:19:14.093497 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 28 09:19:14.093497 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 09:19:14.093497 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 09:19:14.093497 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 09:19:14.093497 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 09:19:14.093497 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 09:19:14.093497 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 09:19:14.093497 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 09:19:14.093497 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application with Lock( Jul 28 09:19:14.093497 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 09:19:14.093497 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self._enter() Jul 28 09:19:14.093497 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 09:19:14.093497 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 09:19:14.093497 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 09:19:14.093497 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self.creator() Jul 28 09:19:14.093497 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 09:19:14.093497 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application created_value = creator( Jul 28 09:19:14.095798 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 28 09:19:14.095798 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 28 09:19:14.095798 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 28 09:19:14.095798 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 28 09:19:14.095798 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 28 09:19:14.095798 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 28 09:19:14.095798 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 09:19:14.095798 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application Jul 28 09:19:14.095798 dv-cinder-851351-1-smb devstack@keystone.service[479852]: [pid: 479852|app: 0|req: 302/593] 10.222.0.42 () {56 vars in 1111 bytes} [Thu Jul 28 09:19:13 2022] GET /identity/v3/projects/service => generated 88 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 09:19:14.095798 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf86a81-17ab-4338-abd5-c37dd9eb34ac None admin] Authenticating user token {{(pid=479852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:19:14.193240 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7cfa41f-5ed4-4e34-8d08-5b05f239ab4a None admin] Validating token access rules against request {{(pid=479851) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:19:14.219079 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf86a81-17ab-4338-abd5-c37dd9eb34ac None admin] Validating token access rules against request {{(pid=479852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:19:14.238336 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG dbcounter [-] [479851] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=479851) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:19:14.251216 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a41f41-cf76-45ac-986e-4c39802f7094 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479851) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:19:14.252492 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a41f41-cf76-45ac-986e-4c39802f7094 None admin] REQUEST_METHOD: `GET` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:19:14.253136 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a41f41-cf76-45ac-986e-4c39802f7094 None admin] SCRIPT_NAME: `/identity` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:19:14.253650 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a41f41-cf76-45ac-986e-4c39802f7094 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:19:14.264794 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0a41f41-cf76-45ac-986e-4c39802f7094 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:19:14.266822 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0a41f41-cf76-45ac-986e-4c39802f7094 None admin] RBAC: Authorization granted {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:19:14.268277 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59781337-2a94-4a31-a9b0-16c29f097287 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:19:14.269000 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59781337-2a94-4a31-a9b0-16c29f097287 None admin] REQUEST_METHOD: `GET` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:19:14.269279 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59781337-2a94-4a31-a9b0-16c29f097287 None admin] SCRIPT_NAME: `/identity` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:19:14.269574 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59781337-2a94-4a31-a9b0-16c29f097287 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:19:14.282802 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application [None req-f0a41f41-cf76-45ac-986e-4c39802f7094 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jul 28 09:19:14.282802 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 09:19:14.282802 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 09:19:14.282802 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 09:19:14.282802 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 09:19:14.282802 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 09:19:14.282802 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 09:19:14.282802 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 09:19:14.282802 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 09:19:14.282802 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 09:19:14.282802 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 09:19:14.282802 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 09:19:14.282802 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 28 09:19:14.282802 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 28 09:19:14.282802 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 28 09:19:14.282802 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 28 09:19:14.284153 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 09:19:14.284153 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 09:19:14.284153 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 28 09:19:14.284153 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 09:19:14.284153 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 28 09:19:14.284153 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 09:19:14.284153 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 09:19:14.284153 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 09:19:14.284153 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 09:19:14.284153 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 09:19:14.284153 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 09:19:14.284153 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application with Lock( Jul 28 09:19:14.284153 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 09:19:14.284153 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return self._enter() Jul 28 09:19:14.284153 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 09:19:14.284153 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 09:19:14.284153 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 09:19:14.284153 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return self.creator() Jul 28 09:19:14.285461 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 09:19:14.285461 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application created_value = creator( Jul 28 09:19:14.285461 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 28 09:19:14.285461 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 28 09:19:14.285461 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 28 09:19:14.285461 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 28 09:19:14.285461 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 28 09:19:14.285461 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 28 09:19:14.285461 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jul 28 09:19:14.285461 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application Jul 28 09:19:14.286098 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59781337-2a94-4a31-a9b0-16c29f097287 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:19:14.286098 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59781337-2a94-4a31-a9b0-16c29f097287 None admin] RBAC: Authorization granted {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:19:14.287823 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG dbcounter [-] [479852] Writing DB stats keystone:SELECT=100 {{(pid=479852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:19:14.287978 dv-cinder-851351-1-smb devstack@keystone.service[479851]: [pid: 479851|app: 0|req: 292/594] 10.222.0.42 () {56 vars in 1102 bytes} [Thu Jul 28 09:19:14 2022] GET /identity/v3/users/neutron => generated 85 bytes in 259 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 09:19:14.288887 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a41f41-cf76-45ac-986e-4c39802f7094 None admin] Authenticating user token {{(pid=479851) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:19:14.302993 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application [None req-59781337-2a94-4a31-a9b0-16c29f097287 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 09:19:14.302993 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 09:19:14.302993 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 09:19:14.302993 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 09:19:14.302993 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 09:19:14.302993 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 09:19:14.302993 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 09:19:14.302993 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 09:19:14.302993 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 09:19:14.302993 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 09:19:14.302993 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 09:19:14.302993 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 09:19:14.302993 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 09:19:14.302993 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 09:19:14.302993 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 09:19:14.304151 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 09:19:14.304151 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 09:19:14.304151 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 09:19:14.304151 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 09:19:14.304151 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 09:19:14.304151 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 09:19:14.304151 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 09:19:14.304151 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 09:19:14.304151 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application with Lock( Jul 28 09:19:14.304151 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 09:19:14.304151 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self._enter() Jul 28 09:19:14.304151 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 09:19:14.304151 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 09:19:14.304151 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 09:19:14.304151 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self.creator() Jul 28 09:19:14.304151 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 09:19:14.304151 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application created_value = creator( Jul 28 09:19:14.305644 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 09:19:14.305644 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 09:19:14.305644 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 09:19:14.305644 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application Jul 28 09:19:14.305644 dv-cinder-851351-1-smb devstack@keystone.service[479852]: [pid: 479852|app: 0|req: 303/595] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 09:19:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 09:19:14.305644 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59781337-2a94-4a31-a9b0-16c29f097287 None admin] Authenticating user token {{(pid=479852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:19:14.420127 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a41f41-cf76-45ac-986e-4c39802f7094 None admin] Validating token access rules against request {{(pid=479851) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:19:14.451330 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59781337-2a94-4a31-a9b0-16c29f097287 None admin] Validating token access rules against request {{(pid=479852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:19:14.466060 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b87c906-ca74-4b7f-9bdb-65663bb4e883 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479851) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:19:14.467062 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b87c906-ca74-4b7f-9bdb-65663bb4e883 None admin] REQUEST_METHOD: `GET` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:19:14.467417 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b87c906-ca74-4b7f-9bdb-65663bb4e883 None admin] SCRIPT_NAME: `/identity` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:19:14.467769 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b87c906-ca74-4b7f-9bdb-65663bb4e883 None admin] PATH_INFO: `/v3/projects` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:19:14.468685 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b87c906-ca74-4b7f-9bdb-65663bb4e883 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=479851) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 09:19:14.469065 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b87c906-ca74-4b7f-9bdb-65663bb4e883 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:19:14.470605 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b87c906-ca74-4b7f-9bdb-65663bb4e883 None admin] RBAC: Authorization granted {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:19:14.488743 dv-cinder-851351-1-smb devstack@keystone.service[479851]: [pid: 479851|app: 0|req: 293/596] 10.222.0.42 () {56 vars in 1148 bytes} [Thu Jul 28 09:19:14 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:19:14.488743 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b87c906-ca74-4b7f-9bdb-65663bb4e883 None admin] Authenticating user token {{(pid=479851) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:19:14.503687 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc89698-beb0-4b76-ac7b-0b1845c1ee66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:19:14.504437 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc89698-beb0-4b76-ac7b-0b1845c1ee66 None admin] REQUEST_METHOD: `GET` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:19:14.504748 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc89698-beb0-4b76-ac7b-0b1845c1ee66 None admin] SCRIPT_NAME: `/identity` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:19:14.505131 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc89698-beb0-4b76-ac7b-0b1845c1ee66 None admin] PATH_INFO: `/v3/users` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:19:14.506843 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddc89698-beb0-4b76-ac7b-0b1845c1ee66 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=479852) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 09:19:14.507438 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddc89698-beb0-4b76-ac7b-0b1845c1ee66 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:19:14.509367 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddc89698-beb0-4b76-ac7b-0b1845c1ee66 None admin] RBAC: Authorization granted {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:19:14.535561 dv-cinder-851351-1-smb devstack@keystone.service[479852]: [pid: 479852|app: 0|req: 304/597] 10.222.0.42 () {56 vars in 1139 bytes} [Thu Jul 28 09:19:14 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:19:14.535561 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc89698-beb0-4b76-ac7b-0b1845c1ee66 None admin] Authenticating user token {{(pid=479852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:19:14.545162 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG dbcounter [-] [479851] Writing DB stats keystone:SELECT=100 {{(pid=479851) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:19:14.598157 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG dbcounter [-] [479852] Writing DB stats keystone:SELECT=100 {{(pid=479852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:19:14.616783 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b87c906-ca74-4b7f-9bdb-65663bb4e883 None admin] Validating token access rules against request {{(pid=479851) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:19:14.649352 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc89698-beb0-4b76-ac7b-0b1845c1ee66 None admin] Validating token access rules against request {{(pid=479852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:19:14.658210 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616119ec-f879-4255-8881-65a99f5ff8cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479851) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:19:14.659141 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616119ec-f879-4255-8881-65a99f5ff8cb None admin] REQUEST_METHOD: `GET` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:19:14.659436 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616119ec-f879-4255-8881-65a99f5ff8cb None admin] SCRIPT_NAME: `/identity` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:19:14.659721 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616119ec-f879-4255-8881-65a99f5ff8cb None admin] PATH_INFO: `/v3/domains` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:19:14.660438 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-616119ec-f879-4255-8881-65a99f5ff8cb None admin] RBAC: Adding query filter params (name=Default) {{(pid=479851) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 09:19:14.660796 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-616119ec-f879-4255-8881-65a99f5ff8cb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:19:14.662250 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-616119ec-f879-4255-8881-65a99f5ff8cb None admin] RBAC: Authorization granted {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:19:14.678845 dv-cinder-851351-1-smb devstack@keystone.service[479851]: [pid: 479851|app: 0|req: 294/598] 10.222.0.42 () {56 vars in 1109 bytes} [Thu Jul 28 09:19:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:19:14.678845 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616119ec-f879-4255-8881-65a99f5ff8cb None admin] Authenticating user token {{(pid=479851) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:19:14.691968 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849433f0-187d-4856-bef6-a2632b3c1eeb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:19:14.692672 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849433f0-187d-4856-bef6-a2632b3c1eeb None admin] REQUEST_METHOD: `PUT` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:19:14.693094 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849433f0-187d-4856-bef6-a2632b3c1eeb None admin] SCRIPT_NAME: `/identity` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:19:14.693375 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849433f0-187d-4856-bef6-a2632b3c1eeb None admin] PATH_INFO: `/v3/projects/3a0fb8ea8010437bade8f92dcbcaacee/users/c824cbfdc0dc4532ac6af71cbb6841fd/roles/bd74dfcbc8d7412689d315fe24a1f247` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:19:14.710770 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-849433f0-187d-4856-bef6-a2632b3c1eeb None admin] RBAC: Authorizing `identity:create_grant(project_id=3a0fb8ea8010437bade8f92dcbcaacee, user_id=c824cbfdc0dc4532ac6af71cbb6841fd, role_id=bd74dfcbc8d7412689d315fe24a1f247)` {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:19:14.712162 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-849433f0-187d-4856-bef6-a2632b3c1eeb None admin] RBAC: Authorization granted {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:19:14.725748 dv-cinder-851351-1-smb devstack@keystone.service[479852]: [pid: 479852|app: 0|req: 305/599] 10.222.0.42 () {58 vars in 1439 bytes} [Thu Jul 28 09:19:14 2022] PUT /identity/v3/projects/3a0fb8ea8010437bade8f92dcbcaacee/users/c824cbfdc0dc4532ac6af71cbb6841fd/roles/bd74dfcbc8d7412689d315fe24a1f247 => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 09:19:14.727023 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84e39d7-a570-4c51-bafb-f4d707d7da36 None None] REQUEST_METHOD: `GET` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:19:14.727305 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84e39d7-a570-4c51-bafb-f4d707d7da36 None None] SCRIPT_NAME: `/identity` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:19:14.727578 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84e39d7-a570-4c51-bafb-f4d707d7da36 None None] PATH_INFO: `/` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:19:14.729052 dv-cinder-851351-1-smb devstack@keystone.service[479852]: [pid: 479852|app: 0|req: 306/600] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 09:19:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 09:19:14.733908 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84e39d7-a570-4c51-bafb-f4d707d7da36 None None] Authenticating user token {{(pid=479852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:19:14.809152 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616119ec-f879-4255-8881-65a99f5ff8cb None admin] Validating token access rules against request {{(pid=479851) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:19:14.817385 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG dbcounter [-] [479851] Writing DB stats keystone:SELECT=100 {{(pid=479851) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:19:14.851609 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcbd0b77-d293-4ee1-9033-a0e09ad5407e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479851) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:19:14.852284 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcbd0b77-d293-4ee1-9033-a0e09ad5407e None admin] REQUEST_METHOD: `GET` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:19:14.852588 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcbd0b77-d293-4ee1-9033-a0e09ad5407e None admin] SCRIPT_NAME: `/identity` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:19:14.852997 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcbd0b77-d293-4ee1-9033-a0e09ad5407e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:19:14.865085 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84e39d7-a570-4c51-bafb-f4d707d7da36 None None] Validating token access rules against request {{(pid=479852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:19:14.865639 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcbd0b77-d293-4ee1-9033-a0e09ad5407e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:19:14.867272 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcbd0b77-d293-4ee1-9033-a0e09ad5407e None admin] RBAC: Authorization granted {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:19:14.869302 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG dbcounter [-] [479852] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=479852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:19:14.891633 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application [None req-dcbd0b77-d293-4ee1-9033-a0e09ad5407e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 09:19:14.891633 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 09:19:14.891633 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 09:19:14.891633 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 09:19:14.891633 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 09:19:14.891633 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 09:19:14.891633 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 09:19:14.891633 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 09:19:14.891633 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 09:19:14.891633 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 09:19:14.891633 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 09:19:14.891633 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 09:19:14.891633 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 09:19:14.891633 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 09:19:14.891633 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 09:19:14.892859 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 09:19:14.892859 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 09:19:14.892859 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 09:19:14.892859 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 09:19:14.892859 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 09:19:14.892859 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 09:19:14.892859 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 09:19:14.892859 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 09:19:14.892859 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application with Lock( Jul 28 09:19:14.892859 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 09:19:14.892859 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return self._enter() Jul 28 09:19:14.892859 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 09:19:14.892859 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 09:19:14.892859 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 09:19:14.892859 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return self.creator() Jul 28 09:19:14.892859 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 09:19:14.892859 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application created_value = creator( Jul 28 09:19:14.894011 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 09:19:14.894011 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 09:19:14.894011 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 09:19:14.894011 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application Jul 28 09:19:14.896845 dv-cinder-851351-1-smb devstack@keystone.service[479851]: [pid: 479851|app: 0|req: 295/601] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 09:19:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 09:19:14.899943 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1edeb0-aa04-414f-8713-0d710e8492d7 None None] REQUEST_METHOD: `POST` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:19:14.900608 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1edeb0-aa04-414f-8713-0d710e8492d7 None None] SCRIPT_NAME: `/identity` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:19:14.902782 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1edeb0-aa04-414f-8713-0d710e8492d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:19:14.924847 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.auth.core [None req-ee1edeb0-aa04-414f-8713-0d710e8492d7 None None] MFA Rules not processed for user `c198f91a4ae84d2b9cc730a6e304c2be`. Rule list: `[]` (Enabled: `True`). {{(pid=479851) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 09:19:14.926269 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.fernet_utils [None req-ee1edeb0-aa04-414f-8713-0d710e8492d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=479851) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 09:19:14.944743 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3414c9-51ba-408c-b2fd-7886899fa15e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:19:14.946525 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3414c9-51ba-408c-b2fd-7886899fa15e None admin] REQUEST_METHOD: `GET` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:19:14.947252 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3414c9-51ba-408c-b2fd-7886899fa15e None admin] SCRIPT_NAME: `/identity` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:19:14.947948 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3414c9-51ba-408c-b2fd-7886899fa15e None admin] PATH_INFO: `/v3/projects/service` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:19:14.962357 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e3414c9-51ba-408c-b2fd-7886899fa15e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:19:14.965569 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e3414c9-51ba-408c-b2fd-7886899fa15e None admin] RBAC: Authorization granted {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:19:14.986446 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application [None req-5e3414c9-51ba-408c-b2fd-7886899fa15e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 09:19:14.986446 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 09:19:14.986446 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 09:19:14.986446 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 09:19:14.986446 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 09:19:14.986446 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 09:19:14.986446 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 09:19:14.986446 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 09:19:14.986446 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 09:19:14.986446 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 09:19:14.986446 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 09:19:14.986446 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 09:19:14.986446 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 28 09:19:14.986446 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 28 09:19:14.986446 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 28 09:19:14.987584 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 28 09:19:14.987584 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 09:19:14.987584 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 09:19:14.987584 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 09:19:14.987584 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 09:19:14.987584 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 09:19:14.987584 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 09:19:14.987584 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 09:19:14.987584 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application with Lock( Jul 28 09:19:14.987584 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 09:19:14.987584 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self._enter() Jul 28 09:19:14.987584 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 09:19:14.987584 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 09:19:14.987584 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 09:19:14.987584 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self.creator() Jul 28 09:19:14.987584 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 09:19:14.987584 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application created_value = creator( Jul 28 09:19:14.988650 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 28 09:19:14.988650 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 28 09:19:14.988650 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 28 09:19:14.988650 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 28 09:19:14.988650 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 28 09:19:14.988650 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 28 09:19:14.988650 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 09:19:14.988650 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application Jul 28 09:19:14.988650 dv-cinder-851351-1-smb devstack@keystone.service[479852]: [pid: 479852|app: 0|req: 307/602] 10.222.0.42 () {56 vars in 1111 bytes} [Thu Jul 28 09:19:14 2022] GET /identity/v3/projects/service => generated 88 bytes in 259 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 09:19:14.990045 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3414c9-51ba-408c-b2fd-7886899fa15e None admin] Authenticating user token {{(pid=479852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:19:15.026485 dv-cinder-851351-1-smb devstack@keystone.service[479851]: [pid: 479851|app: 0|req: 296/603] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 09:19:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 09:19:15.027373 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1edeb0-aa04-414f-8713-0d710e8492d7 None None] Authenticating user token {{(pid=479851) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:19:15.122720 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG dbcounter [-] [479851] Writing DB stats keystone:SELECT=100 {{(pid=479851) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:19:15.137585 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1edeb0-aa04-414f-8713-0d710e8492d7 None None] Validating token access rules against request {{(pid=479851) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:19:15.175774 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c244390-bf0f-4342-9467-6e188a1231b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479851) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:19:15.176417 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c244390-bf0f-4342-9467-6e188a1231b0 None admin] REQUEST_METHOD: `GET` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:19:15.176751 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c244390-bf0f-4342-9467-6e188a1231b0 None admin] SCRIPT_NAME: `/identity` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:19:15.177033 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c244390-bf0f-4342-9467-6e188a1231b0 None admin] PATH_INFO: `/v3/projects` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:19:15.177934 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c244390-bf0f-4342-9467-6e188a1231b0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=479851) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 09:19:15.178248 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c244390-bf0f-4342-9467-6e188a1231b0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:19:15.179826 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c244390-bf0f-4342-9467-6e188a1231b0 None admin] RBAC: Authorization granted {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:19:15.193192 dv-cinder-851351-1-smb devstack@keystone.service[479851]: [pid: 479851|app: 0|req: 297/604] 10.222.0.42 () {56 vars in 1148 bytes} [Thu Jul 28 09:19:15 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:19:15.194054 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c244390-bf0f-4342-9467-6e188a1231b0 None admin] Authenticating user token {{(pid=479851) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:19:15.207048 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3414c9-51ba-408c-b2fd-7886899fa15e None admin] Validating token access rules against request {{(pid=479852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:19:15.268044 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb02bc4-8e27-4019-9378-97b5d0bb8125 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:19:15.269029 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb02bc4-8e27-4019-9378-97b5d0bb8125 None admin] REQUEST_METHOD: `GET` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:19:15.269516 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb02bc4-8e27-4019-9378-97b5d0bb8125 None admin] SCRIPT_NAME: `/identity` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:19:15.269958 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb02bc4-8e27-4019-9378-97b5d0bb8125 None admin] PATH_INFO: `/v3/domains` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:19:15.271260 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecb02bc4-8e27-4019-9378-97b5d0bb8125 None admin] RBAC: Adding query filter params (name=Default) {{(pid=479852) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 09:19:15.271799 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecb02bc4-8e27-4019-9378-97b5d0bb8125 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:19:15.274361 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecb02bc4-8e27-4019-9378-97b5d0bb8125 None admin] RBAC: Authorization granted {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:19:15.304811 dv-cinder-851351-1-smb devstack@keystone.service[479852]: [pid: 479852|app: 0|req: 308/605] 10.222.0.42 () {56 vars in 1109 bytes} [Thu Jul 28 09:19:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 310 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:19:15.306330 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb02bc4-8e27-4019-9378-97b5d0bb8125 None admin] Authenticating user token {{(pid=479852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:19:15.313461 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c244390-bf0f-4342-9467-6e188a1231b0 None admin] Validating token access rules against request {{(pid=479851) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:19:15.351795 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d9d54e7-38bb-4f34-abb3-178403f41867 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479851) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:19:15.352708 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG dbcounter [-] [479852] Writing DB stats keystone:SELECT=100 {{(pid=479852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:19:15.353317 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9d54e7-38bb-4f34-abb3-178403f41867 None admin] REQUEST_METHOD: `GET` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:19:15.353577 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9d54e7-38bb-4f34-abb3-178403f41867 None admin] SCRIPT_NAME: `/identity` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:19:15.353870 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9d54e7-38bb-4f34-abb3-178403f41867 None admin] PATH_INFO: `/v3/roles/service` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:19:15.366623 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d9d54e7-38bb-4f34-abb3-178403f41867 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 09:19:15.372354 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application [None req-0d9d54e7-38bb-4f34-abb3-178403f41867 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 28 09:19:15.372354 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 09:19:15.372354 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 09:19:15.372354 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 09:19:15.372354 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 09:19:15.372354 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 09:19:15.372354 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 09:19:15.372354 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 09:19:15.372354 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 09:19:15.372354 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 09:19:15.372354 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 09:19:15.372354 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 09:19:15.372354 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 09:19:15.372354 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 09:19:15.372354 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 09:19:15.372354 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 09:19:15.374681 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 09:19:15.374681 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 09:19:15.374681 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 09:19:15.374681 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 09:19:15.374681 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 09:19:15.374681 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 09:19:15.374681 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 09:19:15.374681 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 09:19:15.374681 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 09:19:15.374681 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 09:19:15.374681 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 09:19:15.374681 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application with Lock( Jul 28 09:19:15.374681 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 09:19:15.374681 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return self._enter() Jul 28 09:19:15.374681 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 09:19:15.374681 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 09:19:15.377107 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 09:19:15.377107 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return self.creator() Jul 28 09:19:15.377107 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 09:19:15.377107 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application created_value = creator( Jul 28 09:19:15.377107 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 09:19:15.377107 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 09:19:15.377107 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 09:19:15.377107 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 09:19:15.377107 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 09:19:15.377107 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 09:19:15.377107 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 28 09:19:15.377107 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application Jul 28 09:19:15.377107 dv-cinder-851351-1-smb devstack@keystone.service[479851]: [pid: 479851|app: 0|req: 298/606] 10.222.0.42 () {56 vars in 1102 bytes} [Thu Jul 28 09:19:15 2022] GET /identity/v3/roles/service => generated 85 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 09:19:15.377107 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d9d54e7-38bb-4f34-abb3-178403f41867 None admin] Authenticating user token {{(pid=479851) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:19:15.386923 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG dbcounter [-] [479851] Writing DB stats keystone:SELECT=100 {{(pid=479851) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:19:15.487070 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d9d54e7-38bb-4f34-abb3-178403f41867 None admin] Validating token access rules against request {{(pid=479851) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:19:15.492797 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb02bc4-8e27-4019-9378-97b5d0bb8125 None admin] Validating token access rules against request {{(pid=479852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:19:15.527037 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381b9c74-f914-4509-8dd7-ab40f713d790 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479851) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:19:15.528503 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381b9c74-f914-4509-8dd7-ab40f713d790 None admin] REQUEST_METHOD: `GET` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:19:15.529035 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381b9c74-f914-4509-8dd7-ab40f713d790 None admin] SCRIPT_NAME: `/identity` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:19:15.529545 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381b9c74-f914-4509-8dd7-ab40f713d790 None admin] PATH_INFO: `/v3/projects/service` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:19:15.537613 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-381b9c74-f914-4509-8dd7-ab40f713d790 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:19:15.539563 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-381b9c74-f914-4509-8dd7-ab40f713d790 None admin] RBAC: Authorization granted {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:19:15.552007 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a595b7-16c5-425f-a9b0-95a3d363de5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:19:15.553250 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a595b7-16c5-425f-a9b0-95a3d363de5b None admin] REQUEST_METHOD: `PUT` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:19:15.553740 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a595b7-16c5-425f-a9b0-95a3d363de5b None admin] SCRIPT_NAME: `/identity` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:19:15.553951 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application [None req-381b9c74-f914-4509-8dd7-ab40f713d790 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 09:19:15.553951 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 09:19:15.553951 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 09:19:15.553951 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 09:19:15.553951 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 09:19:15.553951 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 09:19:15.553951 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 09:19:15.553951 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 09:19:15.553951 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 09:19:15.553951 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 09:19:15.553951 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 09:19:15.553951 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 09:19:15.553951 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 28 09:19:15.553951 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 28 09:19:15.553951 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 28 09:19:15.555055 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 28 09:19:15.555055 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 09:19:15.555055 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 09:19:15.555055 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 09:19:15.555055 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 09:19:15.555055 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 09:19:15.555055 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 09:19:15.555055 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 09:19:15.555055 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application with Lock( Jul 28 09:19:15.555055 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 09:19:15.555055 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return self._enter() Jul 28 09:19:15.555055 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 09:19:15.555055 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 09:19:15.555055 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 09:19:15.555055 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return self.creator() Jul 28 09:19:15.555055 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 09:19:15.555055 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application created_value = creator( Jul 28 09:19:15.556140 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 28 09:19:15.556140 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 28 09:19:15.556140 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 28 09:19:15.556140 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 28 09:19:15.556140 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 28 09:19:15.556140 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 28 09:19:15.556140 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 09:19:15.556140 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application Jul 28 09:19:15.556658 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a595b7-16c5-425f-a9b0-95a3d363de5b None admin] PATH_INFO: `/v3/projects/3a0fb8ea8010437bade8f92dcbcaacee/users/754c4e4857fd440dbc2b7e59c8196db6/roles/bd74dfcbc8d7412689d315fe24a1f247` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:19:15.562882 dv-cinder-851351-1-smb devstack@keystone.service[479851]: [pid: 479851|app: 0|req: 299/607] 10.222.0.42 () {56 vars in 1111 bytes} [Thu Jul 28 09:19:15 2022] GET /identity/v3/projects/service => generated 88 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 09:19:15.562882 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381b9c74-f914-4509-8dd7-ab40f713d790 None admin] Authenticating user token {{(pid=479851) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:19:15.578979 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82a595b7-16c5-425f-a9b0-95a3d363de5b None admin] RBAC: Authorizing `identity:create_grant(project_id=3a0fb8ea8010437bade8f92dcbcaacee, user_id=754c4e4857fd440dbc2b7e59c8196db6, role_id=bd74dfcbc8d7412689d315fe24a1f247)` {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:19:15.580475 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82a595b7-16c5-425f-a9b0-95a3d363de5b None admin] RBAC: Authorization granted {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:19:15.605022 dv-cinder-851351-1-smb devstack@keystone.service[479852]: [pid: 479852|app: 0|req: 309/608] 10.222.0.42 () {58 vars in 1439 bytes} [Thu Jul 28 09:19:15 2022] PUT /identity/v3/projects/3a0fb8ea8010437bade8f92dcbcaacee/users/754c4e4857fd440dbc2b7e59c8196db6/roles/bd74dfcbc8d7412689d315fe24a1f247 => generated 0 bytes in 295 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 09:19:15.605022 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a595b7-16c5-425f-a9b0-95a3d363de5b None admin] Authenticating user token {{(pid=479852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:19:15.670110 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG dbcounter [-] [479851] Writing DB stats keystone:SELECT=100 {{(pid=479851) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:19:15.741092 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG dbcounter [-] [479852] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=479852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:19:15.766528 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a595b7-16c5-425f-a9b0-95a3d363de5b None admin] Validating token access rules against request {{(pid=479852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:19:15.794912 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381b9c74-f914-4509-8dd7-ab40f713d790 None admin] Validating token access rules against request {{(pid=479851) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:19:15.809491 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f4cc162-26e7-4a00-b163-ec5fa77f13f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:19:15.810133 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4cc162-26e7-4a00-b163-ec5fa77f13f9 None admin] REQUEST_METHOD: `GET` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:19:15.810413 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4cc162-26e7-4a00-b163-ec5fa77f13f9 None admin] SCRIPT_NAME: `/identity` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:19:15.810686 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4cc162-26e7-4a00-b163-ec5fa77f13f9 None admin] PATH_INFO: `/v3/projects` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:19:15.811453 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f4cc162-26e7-4a00-b163-ec5fa77f13f9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=479852) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 09:19:15.811758 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f4cc162-26e7-4a00-b163-ec5fa77f13f9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:19:15.813939 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f4cc162-26e7-4a00-b163-ec5fa77f13f9 None admin] RBAC: Authorization granted {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:19:15.831370 dv-cinder-851351-1-smb devstack@keystone.service[479852]: [pid: 479852|app: 0|req: 310/609] 10.222.0.42 () {56 vars in 1148 bytes} [Thu Jul 28 09:19:15 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:19:15.837940 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f4cc162-26e7-4a00-b163-ec5fa77f13f9 None admin] Authenticating user token {{(pid=479852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:19:15.857274 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f3605f-20d7-4397-aec0-d950bef292f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479851) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:19:15.857924 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f3605f-20d7-4397-aec0-d950bef292f0 None admin] REQUEST_METHOD: `GET` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:19:15.858209 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f3605f-20d7-4397-aec0-d950bef292f0 None admin] SCRIPT_NAME: `/identity` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:19:15.858485 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f3605f-20d7-4397-aec0-d950bef292f0 None admin] PATH_INFO: `/v3/roles` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:19:15.859706 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35f3605f-20d7-4397-aec0-d950bef292f0 None admin] RBAC: Adding query filter params (name=service) {{(pid=479851) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 09:19:15.860019 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35f3605f-20d7-4397-aec0-d950bef292f0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:19:15.861739 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35f3605f-20d7-4397-aec0-d950bef292f0 None admin] RBAC: Authorization granted {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:19:15.873179 dv-cinder-851351-1-smb devstack@keystone.service[479851]: [pid: 479851|app: 0|req: 300/610] 10.222.0.42 () {56 vars in 1103 bytes} [Thu Jul 28 09:19:15 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 314 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:19:15.879475 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f3605f-20d7-4397-aec0-d950bef292f0 None admin] Authenticating user token {{(pid=479851) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:19:15.964397 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f4cc162-26e7-4a00-b163-ec5fa77f13f9 None admin] Validating token access rules against request {{(pid=479852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:19:16.006632 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6812f0e3-ff50-4a8a-a6c3-7bf873875542 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:19:16.008762 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6812f0e3-ff50-4a8a-a6c3-7bf873875542 None admin] REQUEST_METHOD: `PUT` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:19:16.009358 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6812f0e3-ff50-4a8a-a6c3-7bf873875542 None admin] SCRIPT_NAME: `/identity` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:19:16.009870 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6812f0e3-ff50-4a8a-a6c3-7bf873875542 None admin] PATH_INFO: `/v3/projects/3a0fb8ea8010437bade8f92dcbcaacee/users/e86286d4286c4a92bb581148d91a3b01/roles/bd74dfcbc8d7412689d315fe24a1f247` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:19:16.017643 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG dbcounter [-] [479852] Writing DB stats keystone:SELECT=100 {{(pid=479852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:19:16.022336 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f3605f-20d7-4397-aec0-d950bef292f0 None admin] Validating token access rules against request {{(pid=479851) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:19:16.049350 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6812f0e3-ff50-4a8a-a6c3-7bf873875542 None admin] RBAC: Authorizing `identity:create_grant(project_id=3a0fb8ea8010437bade8f92dcbcaacee, user_id=e86286d4286c4a92bb581148d91a3b01, role_id=bd74dfcbc8d7412689d315fe24a1f247)` {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:19:16.051231 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6812f0e3-ff50-4a8a-a6c3-7bf873875542 None admin] RBAC: Authorization granted {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:19:16.079229 dv-cinder-851351-1-smb devstack@keystone.service[479852]: [pid: 479852|app: 0|req: 311/611] 10.222.0.42 () {58 vars in 1439 bytes} [Thu Jul 28 09:19:15 2022] PUT /identity/v3/projects/3a0fb8ea8010437bade8f92dcbcaacee/users/e86286d4286c4a92bb581148d91a3b01/roles/bd74dfcbc8d7412689d315fe24a1f247 => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 28 09:19:16.091324 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG dbcounter [-] [479851] Writing DB stats keystone:SELECT=100 {{(pid=479851) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:19:16.100984 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0a4559-4cbd-4238-9752-c17e6403a83c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479851) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:19:16.102123 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0a4559-4cbd-4238-9752-c17e6403a83c None admin] REQUEST_METHOD: `GET` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:19:16.102630 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0a4559-4cbd-4238-9752-c17e6403a83c None admin] SCRIPT_NAME: `/identity` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:19:16.103201 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0a4559-4cbd-4238-9752-c17e6403a83c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:19:16.121710 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c0a4559-4cbd-4238-9752-c17e6403a83c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:19:16.123775 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c0a4559-4cbd-4238-9752-c17e6403a83c None admin] RBAC: Authorization granted {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:19:16.144443 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application [None req-5c0a4559-4cbd-4238-9752-c17e6403a83c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 09:19:16.144443 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 09:19:16.144443 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 09:19:16.144443 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 09:19:16.144443 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 09:19:16.144443 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 09:19:16.144443 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 09:19:16.144443 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 09:19:16.144443 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 09:19:16.144443 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 09:19:16.144443 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 09:19:16.144443 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 09:19:16.144443 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 09:19:16.144443 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 09:19:16.144443 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 09:19:16.145636 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 09:19:16.145636 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 09:19:16.145636 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 09:19:16.145636 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 09:19:16.145636 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 09:19:16.145636 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 09:19:16.145636 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 09:19:16.145636 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 09:19:16.145636 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application with Lock( Jul 28 09:19:16.145636 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 09:19:16.145636 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return self._enter() Jul 28 09:19:16.145636 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 09:19:16.145636 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 09:19:16.145636 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 09:19:16.145636 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return self.creator() Jul 28 09:19:16.145636 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 09:19:16.145636 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application created_value = creator( Jul 28 09:19:16.146777 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 09:19:16.146777 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 09:19:16.146777 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 09:19:16.146777 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application Jul 28 09:19:16.149375 dv-cinder-851351-1-smb devstack@keystone.service[479851]: [pid: 479851|app: 0|req: 301/612] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 09:19:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 271 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 09:19:16.157992 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6812f0e3-ff50-4a8a-a6c3-7bf873875542 None admin] Authenticating user token {{(pid=479852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:19:16.283244 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6812f0e3-ff50-4a8a-a6c3-7bf873875542 None admin] Validating token access rules against request {{(pid=479852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:19:16.326210 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3654e788-27e7-4e56-9387-b8415ba8bf64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:19:16.327127 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3654e788-27e7-4e56-9387-b8415ba8bf64 None admin] REQUEST_METHOD: `GET` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:19:16.327591 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3654e788-27e7-4e56-9387-b8415ba8bf64 None admin] SCRIPT_NAME: `/identity` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:19:16.328024 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3654e788-27e7-4e56-9387-b8415ba8bf64 None admin] PATH_INFO: `/v3/domains` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:19:16.328935 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3654e788-27e7-4e56-9387-b8415ba8bf64 None admin] RBAC: Adding query filter params (name=Default) {{(pid=479852) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 09:19:16.329413 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3654e788-27e7-4e56-9387-b8415ba8bf64 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:19:16.330983 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3654e788-27e7-4e56-9387-b8415ba8bf64 None admin] RBAC: Authorization granted {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:19:16.349463 dv-cinder-851351-1-smb devstack@keystone.service[479852]: [pid: 479852|app: 0|req: 312/613] 10.222.0.42 () {56 vars in 1109 bytes} [Thu Jul 28 09:19:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:19:16.355370 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0a4559-4cbd-4238-9752-c17e6403a83c None admin] Authenticating user token {{(pid=479851) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:19:16.496992 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0a4559-4cbd-4238-9752-c17e6403a83c None admin] Validating token access rules against request {{(pid=479851) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:19:16.533270 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87933a18-e1e0-46dd-a7e3-01240128f527 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479851) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:19:16.534746 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87933a18-e1e0-46dd-a7e3-01240128f527 None admin] REQUEST_METHOD: `GET` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:19:16.535202 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87933a18-e1e0-46dd-a7e3-01240128f527 None admin] SCRIPT_NAME: `/identity` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:19:16.535645 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87933a18-e1e0-46dd-a7e3-01240128f527 None admin] PATH_INFO: `/v3/users/swift` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:19:16.544849 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87933a18-e1e0-46dd-a7e3-01240128f527 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:19:16.546587 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87933a18-e1e0-46dd-a7e3-01240128f527 None admin] RBAC: Authorization granted {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:19:16.559305 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application [None req-87933a18-e1e0-46dd-a7e3-01240128f527 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 28 09:19:16.559305 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 09:19:16.559305 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 09:19:16.559305 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 09:19:16.559305 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 09:19:16.559305 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 09:19:16.559305 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 09:19:16.559305 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 09:19:16.559305 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 09:19:16.559305 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 09:19:16.559305 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 09:19:16.559305 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 09:19:16.559305 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 28 09:19:16.559305 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 28 09:19:16.559305 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 28 09:19:16.559305 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 28 09:19:16.560719 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 09:19:16.560719 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 09:19:16.560719 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 28 09:19:16.560719 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 09:19:16.560719 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 28 09:19:16.560719 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 09:19:16.560719 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 09:19:16.560719 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 09:19:16.560719 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 09:19:16.560719 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 09:19:16.560719 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 09:19:16.560719 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application with Lock( Jul 28 09:19:16.560719 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 09:19:16.560719 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return self._enter() Jul 28 09:19:16.560719 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 09:19:16.560719 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 09:19:16.560719 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 09:19:16.560719 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return self.creator() Jul 28 09:19:16.562026 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 09:19:16.562026 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application created_value = creator( Jul 28 09:19:16.562026 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 28 09:19:16.562026 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 28 09:19:16.562026 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 28 09:19:16.562026 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 28 09:19:16.562026 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 28 09:19:16.562026 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 28 09:19:16.562026 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 28 09:19:16.562026 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application Jul 28 09:19:16.564583 dv-cinder-851351-1-smb devstack@keystone.service[479851]: [pid: 479851|app: 0|req: 302/614] 10.222.0.42 () {56 vars in 1096 bytes} [Thu Jul 28 09:19:16 2022] GET /identity/v3/users/swift => generated 83 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 09:19:16.577929 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3654e788-27e7-4e56-9387-b8415ba8bf64 None admin] Authenticating user token {{(pid=479852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:19:16.632027 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1500210-904d-489d-bcbf-f24ac6140f17 None None] REQUEST_METHOD: `GET` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:19:16.632397 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1500210-904d-489d-bcbf-f24ac6140f17 None None] SCRIPT_NAME: `/identity` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:19:16.632632 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1500210-904d-489d-bcbf-f24ac6140f17 None None] PATH_INFO: `/` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:19:16.634250 dv-cinder-851351-1-smb devstack@keystone.service[479851]: [pid: 479851|app: 0|req: 303/615] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 09:19:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 28 09:19:16.640399 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00df55fc-50cc-4612-ace3-04fa73d4d827 None None] REQUEST_METHOD: `POST` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:19:16.641120 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00df55fc-50cc-4612-ace3-04fa73d4d827 None None] SCRIPT_NAME: `/identity` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:19:16.641637 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00df55fc-50cc-4612-ace3-04fa73d4d827 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:19:16.664643 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG dbcounter [-] [479852] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=479852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:19:16.673293 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.auth.core [None req-00df55fc-50cc-4612-ace3-04fa73d4d827 None None] MFA Rules not processed for user `c198f91a4ae84d2b9cc730a6e304c2be`. Rule list: `[]` (Enabled: `True`). {{(pid=479851) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 09:19:16.674911 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.fernet_utils [None req-00df55fc-50cc-4612-ace3-04fa73d4d827 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=479851) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 09:19:16.742258 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG dbcounter [-] [479851] Writing DB stats keystone:SELECT=100 {{(pid=479851) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:19:16.794684 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3654e788-27e7-4e56-9387-b8415ba8bf64 None admin] Validating token access rules against request {{(pid=479852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:19:16.804615 dv-cinder-851351-1-smb devstack@keystone.service[479851]: [pid: 479851|app: 0|req: 304/616] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 09:19:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 28 09:19:16.841475 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9723b6fb-b7a1-424f-82f6-a4dc0d21dbe1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:19:16.842496 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9723b6fb-b7a1-424f-82f6-a4dc0d21dbe1 None admin] REQUEST_METHOD: `GET` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:19:16.843076 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9723b6fb-b7a1-424f-82f6-a4dc0d21dbe1 None admin] SCRIPT_NAME: `/identity` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:19:16.843674 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9723b6fb-b7a1-424f-82f6-a4dc0d21dbe1 None admin] PATH_INFO: `/v3/users` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:19:16.844751 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9723b6fb-b7a1-424f-82f6-a4dc0d21dbe1 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=479852) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 09:19:16.845349 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9723b6fb-b7a1-424f-82f6-a4dc0d21dbe1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:19:16.847325 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9723b6fb-b7a1-424f-82f6-a4dc0d21dbe1 None admin] RBAC: Authorization granted {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:19:16.851760 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00df55fc-50cc-4612-ace3-04fa73d4d827 None None] Authenticating user token {{(pid=479851) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:19:16.884538 dv-cinder-851351-1-smb devstack@keystone.service[479852]: [pid: 479852|app: 0|req: 313/617] 10.222.0.42 () {56 vars in 1135 bytes} [Thu Jul 28 09:19:16 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 307 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:19:16.903084 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9723b6fb-b7a1-424f-82f6-a4dc0d21dbe1 None admin] Authenticating user token {{(pid=479852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:19:16.970584 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00df55fc-50cc-4612-ace3-04fa73d4d827 None None] Validating token access rules against request {{(pid=479851) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:19:17.015516 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-928c8eeb-51e8-44bf-969b-931ef549c53b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479851) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:19:17.016709 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928c8eeb-51e8-44bf-969b-931ef549c53b None admin] REQUEST_METHOD: `GET` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:19:17.017247 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928c8eeb-51e8-44bf-969b-931ef549c53b None admin] SCRIPT_NAME: `/identity` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:19:17.017787 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928c8eeb-51e8-44bf-969b-931ef549c53b None admin] PATH_INFO: `/v3/roles/service` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:19:17.030303 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-928c8eeb-51e8-44bf-969b-931ef549c53b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 09:19:17.036225 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application [None req-928c8eeb-51e8-44bf-969b-931ef549c53b None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 28 09:19:17.036225 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 09:19:17.036225 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 09:19:17.036225 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 09:19:17.036225 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 09:19:17.036225 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 09:19:17.036225 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 09:19:17.036225 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 09:19:17.036225 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 09:19:17.036225 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 09:19:17.036225 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 09:19:17.036225 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 09:19:17.036225 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 09:19:17.036225 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 09:19:17.036225 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 09:19:17.036225 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 09:19:17.037565 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 09:19:17.037565 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 09:19:17.037565 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 09:19:17.037565 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 09:19:17.037565 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 09:19:17.037565 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 09:19:17.037565 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 09:19:17.037565 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 09:19:17.037565 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 09:19:17.037565 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 09:19:17.037565 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 09:19:17.037565 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application with Lock( Jul 28 09:19:17.037565 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 09:19:17.037565 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return self._enter() Jul 28 09:19:17.037565 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 09:19:17.037565 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 09:19:17.038632 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 09:19:17.038632 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return self.creator() Jul 28 09:19:17.038632 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 09:19:17.038632 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application created_value = creator( Jul 28 09:19:17.038632 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 09:19:17.038632 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 09:19:17.038632 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 09:19:17.038632 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 09:19:17.038632 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 09:19:17.038632 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 09:19:17.038632 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 28 09:19:17.038632 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application Jul 28 09:19:17.041890 dv-cinder-851351-1-smb devstack@keystone.service[479851]: [pid: 479851|app: 0|req: 305/618] 10.222.0.42 () {56 vars in 1102 bytes} [Thu Jul 28 09:19:16 2022] GET /identity/v3/roles/service => generated 85 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 09:19:17.054448 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-928c8eeb-51e8-44bf-969b-931ef549c53b None admin] Authenticating user token {{(pid=479851) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:19:17.095939 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG dbcounter [-] [479851] Writing DB stats keystone:SELECT=100 {{(pid=479851) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:19:17.158889 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9723b6fb-b7a1-424f-82f6-a4dc0d21dbe1 None admin] Validating token access rules against request {{(pid=479852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:19:17.161195 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG dbcounter [-] [479852] Writing DB stats keystone:SELECT=100 {{(pid=479852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:19:17.172202 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-928c8eeb-51e8-44bf-969b-931ef549c53b None admin] Validating token access rules against request {{(pid=479851) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:19:17.206121 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9817b9-a6bb-43e1-b7b9-70b1907ed160 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:19:17.206781 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9817b9-a6bb-43e1-b7b9-70b1907ed160 None admin] REQUEST_METHOD: `GET` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:19:17.207081 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9817b9-a6bb-43e1-b7b9-70b1907ed160 None admin] SCRIPT_NAME: `/identity` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:19:17.207461 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9817b9-a6bb-43e1-b7b9-70b1907ed160 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:19:17.210863 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7700b4bc-99e5-441a-8705-937cbf8c75e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479851) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:19:17.211596 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7700b4bc-99e5-441a-8705-937cbf8c75e6 None admin] REQUEST_METHOD: `GET` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:19:17.211953 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7700b4bc-99e5-441a-8705-937cbf8c75e6 None admin] SCRIPT_NAME: `/identity` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:19:17.212306 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7700b4bc-99e5-441a-8705-937cbf8c75e6 None admin] PATH_INFO: `/v3/roles` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:19:17.213223 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7700b4bc-99e5-441a-8705-937cbf8c75e6 None admin] RBAC: Adding query filter params (name=service) {{(pid=479851) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 09:19:17.213605 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7700b4bc-99e5-441a-8705-937cbf8c75e6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:19:17.215169 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7700b4bc-99e5-441a-8705-937cbf8c75e6 None admin] RBAC: Authorization granted {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:19:17.218891 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e9817b9-a6bb-43e1-b7b9-70b1907ed160 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:19:17.220364 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e9817b9-a6bb-43e1-b7b9-70b1907ed160 None admin] RBAC: Authorization granted {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:19:17.224893 dv-cinder-851351-1-smb devstack@keystone.service[479851]: [pid: 479851|app: 0|req: 306/619] 10.222.0.42 () {56 vars in 1103 bytes} [Thu Jul 28 09:19:17 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 09:19:17.226340 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125ab04f-5e4c-4b28-98d1-2ac6747de8bc None None] REQUEST_METHOD: `GET` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:19:17.226701 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125ab04f-5e4c-4b28-98d1-2ac6747de8bc None None] SCRIPT_NAME: `/identity` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:19:17.227075 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125ab04f-5e4c-4b28-98d1-2ac6747de8bc None None] PATH_INFO: `/` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:19:17.228723 dv-cinder-851351-1-smb devstack@keystone.service[479851]: [pid: 479851|app: 0|req: 307/620] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 09:19:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 09:19:17.233747 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-125ab04f-5e4c-4b28-98d1-2ac6747de8bc None None] Authenticating user token {{(pid=479851) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:19:17.243389 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application [None req-0e9817b9-a6bb-43e1-b7b9-70b1907ed160 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 09:19:17.243389 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 09:19:17.243389 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 09:19:17.243389 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 09:19:17.243389 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 09:19:17.243389 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 09:19:17.243389 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 09:19:17.243389 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 09:19:17.243389 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 09:19:17.243389 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 09:19:17.243389 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 09:19:17.243389 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 09:19:17.243389 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 09:19:17.243389 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 09:19:17.243389 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 09:19:17.244653 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 09:19:17.244653 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 09:19:17.244653 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 09:19:17.244653 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 09:19:17.244653 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 09:19:17.244653 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 09:19:17.244653 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 09:19:17.244653 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 09:19:17.244653 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application with Lock( Jul 28 09:19:17.244653 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 09:19:17.244653 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self._enter() Jul 28 09:19:17.244653 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 09:19:17.244653 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 09:19:17.244653 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 09:19:17.244653 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self.creator() Jul 28 09:19:17.244653 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 09:19:17.244653 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application created_value = creator( Jul 28 09:19:17.245735 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 09:19:17.245735 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 09:19:17.245735 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 09:19:17.245735 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application Jul 28 09:19:17.245735 dv-cinder-851351-1-smb devstack@keystone.service[479852]: [pid: 479852|app: 0|req: 314/621] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 09:19:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 342 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 09:19:17.246163 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26def84a-d4a3-4c07-8188-060cdf522deb None None] REQUEST_METHOD: `POST` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:19:17.246442 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26def84a-d4a3-4c07-8188-060cdf522deb None None] SCRIPT_NAME: `/identity` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:19:17.246658 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26def84a-d4a3-4c07-8188-060cdf522deb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:19:17.268186 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.auth.core [None req-26def84a-d4a3-4c07-8188-060cdf522deb None None] MFA Rules not processed for user `c198f91a4ae84d2b9cc730a6e304c2be`. Rule list: `[]` (Enabled: `True`). {{(pid=479852) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 09:19:17.269702 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.fernet_utils [None req-26def84a-d4a3-4c07-8188-060cdf522deb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=479852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 09:19:17.356181 dv-cinder-851351-1-smb devstack@keystone.service[479852]: [pid: 479852|app: 0|req: 315/622] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 09:19:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 09:19:17.357600 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26def84a-d4a3-4c07-8188-060cdf522deb None None] Authenticating user token {{(pid=479852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:19:17.365380 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG dbcounter [-] [479851] Writing DB stats keystone:SELECT=100 {{(pid=479851) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:19:17.373751 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-125ab04f-5e4c-4b28-98d1-2ac6747de8bc None None] Validating token access rules against request {{(pid=479851) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:19:17.416452 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a84b353f-025c-4433-aed2-be5a03b21e6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479851) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:19:17.417971 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84b353f-025c-4433-aed2-be5a03b21e6c None admin] REQUEST_METHOD: `GET` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:19:17.418548 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84b353f-025c-4433-aed2-be5a03b21e6c None admin] SCRIPT_NAME: `/identity` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:19:17.419133 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84b353f-025c-4433-aed2-be5a03b21e6c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:19:17.433194 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a84b353f-025c-4433-aed2-be5a03b21e6c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:19:17.435317 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a84b353f-025c-4433-aed2-be5a03b21e6c None admin] RBAC: Authorization granted {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:19:17.450963 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG dbcounter [-] [479852] Writing DB stats keystone:SELECT=100 {{(pid=479852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:19:17.457710 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application [None req-a84b353f-025c-4433-aed2-be5a03b21e6c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 09:19:17.457710 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 09:19:17.457710 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 09:19:17.457710 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 09:19:17.457710 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 09:19:17.457710 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 09:19:17.457710 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 09:19:17.457710 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 09:19:17.457710 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 09:19:17.457710 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 09:19:17.457710 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 09:19:17.457710 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 09:19:17.457710 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 09:19:17.457710 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 09:19:17.457710 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 09:19:17.458959 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 09:19:17.458959 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 09:19:17.458959 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 09:19:17.458959 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 09:19:17.458959 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 09:19:17.458959 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 09:19:17.458959 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 09:19:17.458959 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 09:19:17.458959 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application with Lock( Jul 28 09:19:17.458959 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 09:19:17.458959 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return self._enter() Jul 28 09:19:17.458959 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 09:19:17.458959 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 09:19:17.458959 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 09:19:17.458959 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return self.creator() Jul 28 09:19:17.458959 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 09:19:17.458959 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application created_value = creator( Jul 28 09:19:17.460651 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 09:19:17.460651 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 09:19:17.460651 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 09:19:17.460651 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application Jul 28 09:19:17.464725 dv-cinder-851351-1-smb devstack@keystone.service[479851]: [pid: 479851|app: 0|req: 308/623] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 09:19:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 09:19:17.466637 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a84b353f-025c-4433-aed2-be5a03b21e6c None admin] Authenticating user token {{(pid=479851) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:19:17.471519 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26def84a-d4a3-4c07-8188-060cdf522deb None None] Validating token access rules against request {{(pid=479852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:19:17.507908 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8e697e-fd9d-43a6-8b29-ddfba68ee5e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:19:17.508547 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8e697e-fd9d-43a6-8b29-ddfba68ee5e8 None admin] REQUEST_METHOD: `GET` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:19:17.508934 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8e697e-fd9d-43a6-8b29-ddfba68ee5e8 None admin] SCRIPT_NAME: `/identity` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:19:17.509124 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8e697e-fd9d-43a6-8b29-ddfba68ee5e8 None admin] PATH_INFO: `/v3/domains` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:19:17.509828 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a8e697e-fd9d-43a6-8b29-ddfba68ee5e8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=479852) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 09:19:17.510159 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a8e697e-fd9d-43a6-8b29-ddfba68ee5e8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:19:17.511538 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a8e697e-fd9d-43a6-8b29-ddfba68ee5e8 None admin] RBAC: Authorization granted {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:19:17.529382 dv-cinder-851351-1-smb devstack@keystone.service[479852]: [pid: 479852|app: 0|req: 316/624] 10.222.0.42 () {56 vars in 1109 bytes} [Thu Jul 28 09:19:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:19:17.529382 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8e697e-fd9d-43a6-8b29-ddfba68ee5e8 None admin] Authenticating user token {{(pid=479852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:19:17.615782 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a84b353f-025c-4433-aed2-be5a03b21e6c None admin] Validating token access rules against request {{(pid=479851) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:19:17.635218 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8e697e-fd9d-43a6-8b29-ddfba68ee5e8 None admin] Validating token access rules against request {{(pid=479852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:19:17.654586 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7fa88fb-d219-4b81-bc16-59d7cb0215b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479851) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:19:17.655670 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7fa88fb-d219-4b81-bc16-59d7cb0215b9 None admin] REQUEST_METHOD: `GET` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:19:17.656184 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7fa88fb-d219-4b81-bc16-59d7cb0215b9 None admin] SCRIPT_NAME: `/identity` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:19:17.656727 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7fa88fb-d219-4b81-bc16-59d7cb0215b9 None admin] PATH_INFO: `/v3/roles/service` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:19:17.668529 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7fa88fb-d219-4b81-bc16-59d7cb0215b9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 09:19:17.673294 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e236b2b-a8d5-4179-b9aa-a616d2168ccc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:19:17.674075 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e236b2b-a8d5-4179-b9aa-a616d2168ccc None admin] REQUEST_METHOD: `GET` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:19:17.674360 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e236b2b-a8d5-4179-b9aa-a616d2168ccc None admin] SCRIPT_NAME: `/identity` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:19:17.674633 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e236b2b-a8d5-4179-b9aa-a616d2168ccc None admin] PATH_INFO: `/v3/domains` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:19:17.675347 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e236b2b-a8d5-4179-b9aa-a616d2168ccc None admin] RBAC: Adding query filter params (name=Default) {{(pid=479852) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 09:19:17.675655 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e236b2b-a8d5-4179-b9aa-a616d2168ccc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:19:17.676930 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application [None req-f7fa88fb-d219-4b81-bc16-59d7cb0215b9 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 28 09:19:17.676930 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 09:19:17.676930 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 09:19:17.676930 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 09:19:17.676930 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 09:19:17.676930 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 09:19:17.676930 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 09:19:17.676930 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 09:19:17.676930 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 09:19:17.676930 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 09:19:17.676930 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 09:19:17.676930 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 09:19:17.676930 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 09:19:17.676930 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 09:19:17.676930 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 09:19:17.676930 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 09:19:17.678154 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 09:19:17.678154 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 09:19:17.678154 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 09:19:17.678154 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 09:19:17.678154 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 09:19:17.678154 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 09:19:17.678154 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 09:19:17.678154 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 09:19:17.678154 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 09:19:17.678154 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 09:19:17.678154 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 09:19:17.678154 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application with Lock( Jul 28 09:19:17.678154 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 09:19:17.678154 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return self._enter() Jul 28 09:19:17.678154 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 09:19:17.678154 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 09:19:17.679182 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 09:19:17.679182 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return self.creator() Jul 28 09:19:17.679182 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 09:19:17.679182 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application created_value = creator( Jul 28 09:19:17.679182 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 09:19:17.679182 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 09:19:17.679182 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 09:19:17.679182 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 09:19:17.679182 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 09:19:17.679182 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 09:19:17.679182 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 28 09:19:17.679182 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application Jul 28 09:19:17.679960 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e236b2b-a8d5-4179-b9aa-a616d2168ccc None admin] RBAC: Authorization granted {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:19:17.682338 dv-cinder-851351-1-smb devstack@keystone.service[479851]: [pid: 479851|app: 0|req: 309/625] 10.222.0.42 () {56 vars in 1102 bytes} [Thu Jul 28 09:19:17 2022] GET /identity/v3/roles/service => generated 85 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 09:19:17.683567 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7fa88fb-d219-4b81-bc16-59d7cb0215b9 None admin] Authenticating user token {{(pid=479851) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:19:17.696688 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG dbcounter [-] [479851] Writing DB stats keystone:SELECT=100 {{(pid=479851) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:19:17.696904 dv-cinder-851351-1-smb devstack@keystone.service[479852]: [pid: 479852|app: 0|req: 317/626] 10.222.0.42 () {56 vars in 1109 bytes} [Thu Jul 28 09:19:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:19:17.698204 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e236b2b-a8d5-4179-b9aa-a616d2168ccc None admin] Authenticating user token {{(pid=479852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:19:17.703117 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG dbcounter [-] [479852] Writing DB stats keystone:SELECT=100 {{(pid=479852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:19:17.797777 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7fa88fb-d219-4b81-bc16-59d7cb0215b9 None admin] Validating token access rules against request {{(pid=479851) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:19:17.813577 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e236b2b-a8d5-4179-b9aa-a616d2168ccc None admin] Validating token access rules against request {{(pid=479852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:19:17.835792 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc52ddf-b166-4917-b6c1-6d42b70fbe86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479851) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:19:17.836892 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc52ddf-b166-4917-b6c1-6d42b70fbe86 None admin] REQUEST_METHOD: `GET` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:19:17.837437 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc52ddf-b166-4917-b6c1-6d42b70fbe86 None admin] SCRIPT_NAME: `/identity` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:19:17.837968 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc52ddf-b166-4917-b6c1-6d42b70fbe86 None admin] PATH_INFO: `/v3/projects/service` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:19:17.846232 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc52ddf-b166-4917-b6c1-6d42b70fbe86 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:19:17.848204 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc52ddf-b166-4917-b6c1-6d42b70fbe86 None admin] RBAC: Authorization granted {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:19:17.851925 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02fdb3cd-e0f3-40cd-90dc-d1b92d649da9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:19:17.852550 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02fdb3cd-e0f3-40cd-90dc-d1b92d649da9 None admin] REQUEST_METHOD: `GET` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:19:17.852877 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02fdb3cd-e0f3-40cd-90dc-d1b92d649da9 None admin] SCRIPT_NAME: `/identity` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:19:17.853152 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02fdb3cd-e0f3-40cd-90dc-d1b92d649da9 None admin] PATH_INFO: `/v3/roles` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:19:17.853885 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02fdb3cd-e0f3-40cd-90dc-d1b92d649da9 None admin] RBAC: Adding query filter params (name=service) {{(pid=479852) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 09:19:17.854208 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02fdb3cd-e0f3-40cd-90dc-d1b92d649da9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:19:17.855599 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02fdb3cd-e0f3-40cd-90dc-d1b92d649da9 None admin] RBAC: Authorization granted {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:19:17.863515 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application [None req-4cc52ddf-b166-4917-b6c1-6d42b70fbe86 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 09:19:17.863515 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 09:19:17.863515 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 09:19:17.863515 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 09:19:17.863515 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 09:19:17.863515 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 09:19:17.863515 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 09:19:17.863515 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 09:19:17.863515 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 09:19:17.863515 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 09:19:17.863515 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 09:19:17.863515 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 09:19:17.863515 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 28 09:19:17.863515 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 28 09:19:17.863515 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 28 09:19:17.864700 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 28 09:19:17.864700 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 09:19:17.864700 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 09:19:17.864700 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 09:19:17.864700 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 09:19:17.864700 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 09:19:17.864700 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 09:19:17.864700 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 09:19:17.864700 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application with Lock( Jul 28 09:19:17.864700 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 09:19:17.864700 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return self._enter() Jul 28 09:19:17.864700 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 09:19:17.864700 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 09:19:17.864700 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 09:19:17.864700 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return self.creator() Jul 28 09:19:17.864700 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 09:19:17.864700 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application created_value = creator( Jul 28 09:19:17.865779 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 28 09:19:17.865779 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 28 09:19:17.865779 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 28 09:19:17.865779 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 28 09:19:17.865779 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 28 09:19:17.865779 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 28 09:19:17.865779 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 09:19:17.865779 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application Jul 28 09:19:17.866332 dv-cinder-851351-1-smb devstack@keystone.service[479852]: [pid: 479852|app: 0|req: 318/627] 10.222.0.42 () {56 vars in 1103 bytes} [Thu Jul 28 09:19:17 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:19:17.866332 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02fdb3cd-e0f3-40cd-90dc-d1b92d649da9 None admin] Authenticating user token {{(pid=479852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:19:17.873268 dv-cinder-851351-1-smb devstack@keystone.service[479851]: [pid: 479851|app: 0|req: 310/628] 10.222.0.42 () {56 vars in 1111 bytes} [Thu Jul 28 09:19:17 2022] GET /identity/v3/projects/service => generated 88 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 09:19:17.874527 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc52ddf-b166-4917-b6c1-6d42b70fbe86 None admin] Authenticating user token {{(pid=479851) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:19:17.937799 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG dbcounter [-] [479852] Writing DB stats keystone:SELECT=100 {{(pid=479852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:19:17.946665 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG dbcounter [-] [479851] Writing DB stats keystone:SELECT=100 {{(pid=479851) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:19:17.978065 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02fdb3cd-e0f3-40cd-90dc-d1b92d649da9 None admin] Validating token access rules against request {{(pid=479852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:19:17.984031 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc52ddf-b166-4917-b6c1-6d42b70fbe86 None admin] Validating token access rules against request {{(pid=479851) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:19:18.013878 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c422871-518c-44a5-85a3-ed004751b283 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:19:18.014645 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c422871-518c-44a5-85a3-ed004751b283 None admin] REQUEST_METHOD: `GET` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:19:18.014937 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c422871-518c-44a5-85a3-ed004751b283 None admin] SCRIPT_NAME: `/identity` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:19:18.015209 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c422871-518c-44a5-85a3-ed004751b283 None admin] PATH_INFO: `/v3/users/glance` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:19:18.019806 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c9389c-de4b-40c8-9be8-e5b13f2e9632 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479851) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:19:18.020532 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c9389c-de4b-40c8-9be8-e5b13f2e9632 None admin] REQUEST_METHOD: `GET` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:19:18.020951 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c9389c-de4b-40c8-9be8-e5b13f2e9632 None admin] SCRIPT_NAME: `/identity` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:19:18.021297 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c9389c-de4b-40c8-9be8-e5b13f2e9632 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:19:18.023925 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c422871-518c-44a5-85a3-ed004751b283 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:19:18.025727 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c422871-518c-44a5-85a3-ed004751b283 None admin] RBAC: Authorization granted {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:19:18.032773 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30c9389c-de4b-40c8-9be8-e5b13f2e9632 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:19:18.034335 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30c9389c-de4b-40c8-9be8-e5b13f2e9632 None admin] RBAC: Authorization granted {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:19:18.039441 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application [None req-7c422871-518c-44a5-85a3-ed004751b283 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jul 28 09:19:18.039441 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 09:19:18.039441 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 09:19:18.039441 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 09:19:18.039441 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 09:19:18.039441 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 09:19:18.039441 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 09:19:18.039441 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 09:19:18.039441 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 09:19:18.039441 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 09:19:18.039441 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 09:19:18.039441 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 09:19:18.039441 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 28 09:19:18.039441 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 28 09:19:18.039441 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 28 09:19:18.039441 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 28 09:19:18.040895 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 09:19:18.040895 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 09:19:18.040895 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 28 09:19:18.040895 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 09:19:18.040895 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 28 09:19:18.040895 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 09:19:18.040895 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 09:19:18.040895 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 09:19:18.040895 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 09:19:18.040895 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 09:19:18.040895 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 09:19:18.040895 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application with Lock( Jul 28 09:19:18.040895 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 09:19:18.040895 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self._enter() Jul 28 09:19:18.040895 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 09:19:18.040895 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 09:19:18.040895 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 09:19:18.040895 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self.creator() Jul 28 09:19:18.042259 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 09:19:18.042259 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application created_value = creator( Jul 28 09:19:18.042259 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 28 09:19:18.042259 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 28 09:19:18.042259 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 28 09:19:18.042259 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 28 09:19:18.042259 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 28 09:19:18.042259 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 28 09:19:18.042259 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jul 28 09:19:18.042259 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application Jul 28 09:19:18.044844 dv-cinder-851351-1-smb devstack@keystone.service[479852]: [pid: 479852|app: 0|req: 319/629] 10.222.0.42 () {56 vars in 1099 bytes} [Thu Jul 28 09:19:17 2022] GET /identity/v3/users/glance => generated 84 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 09:19:18.045790 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c422871-518c-44a5-85a3-ed004751b283 None admin] Authenticating user token {{(pid=479852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:19:18.055179 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application [None req-30c9389c-de4b-40c8-9be8-e5b13f2e9632 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 09:19:18.055179 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 09:19:18.055179 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 09:19:18.055179 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 09:19:18.055179 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 09:19:18.055179 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 09:19:18.055179 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 09:19:18.055179 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 09:19:18.055179 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 09:19:18.055179 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 09:19:18.055179 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 09:19:18.055179 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 09:19:18.055179 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 09:19:18.055179 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 09:19:18.055179 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 09:19:18.056413 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 09:19:18.056413 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 09:19:18.056413 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 09:19:18.056413 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 09:19:18.056413 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 09:19:18.056413 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 09:19:18.056413 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 09:19:18.056413 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 09:19:18.056413 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application with Lock( Jul 28 09:19:18.056413 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 09:19:18.056413 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return self._enter() Jul 28 09:19:18.056413 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 09:19:18.056413 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 09:19:18.056413 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 09:19:18.056413 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return self.creator() Jul 28 09:19:18.056413 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 09:19:18.056413 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application created_value = creator( Jul 28 09:19:18.057734 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 09:19:18.057734 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 09:19:18.057734 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 09:19:18.057734 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application Jul 28 09:19:18.063466 dv-cinder-851351-1-smb devstack@keystone.service[479851]: [pid: 479851|app: 0|req: 311/630] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 09:19:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 09:19:18.063466 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3070e0e3-d538-43e5-9a14-6cc1356ebd57 None None] REQUEST_METHOD: `GET` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:19:18.063466 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3070e0e3-d538-43e5-9a14-6cc1356ebd57 None None] SCRIPT_NAME: `/identity` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:19:18.063466 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3070e0e3-d538-43e5-9a14-6cc1356ebd57 None None] PATH_INFO: `/` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:19:18.063466 dv-cinder-851351-1-smb devstack@keystone.service[479851]: [pid: 479851|app: 0|req: 312/631] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 09:19:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 09:19:18.063466 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3070e0e3-d538-43e5-9a14-6cc1356ebd57 None None] Authenticating user token {{(pid=479851) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:19:18.156315 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c422871-518c-44a5-85a3-ed004751b283 None admin] Validating token access rules against request {{(pid=479852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:19:18.179224 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3070e0e3-d538-43e5-9a14-6cc1356ebd57 None None] Validating token access rules against request {{(pid=479851) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:19:18.183828 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG dbcounter [-] [479852] Writing DB stats keystone:SELECT=100 {{(pid=479852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:19:18.194442 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee5c305-fd29-40bc-bb23-e772826036ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:19:18.195201 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee5c305-fd29-40bc-bb23-e772826036ed None admin] REQUEST_METHOD: `GET` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:19:18.195576 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee5c305-fd29-40bc-bb23-e772826036ed None admin] SCRIPT_NAME: `/identity` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:19:18.195950 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee5c305-fd29-40bc-bb23-e772826036ed None admin] PATH_INFO: `/v3/projects` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:19:18.197203 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ee5c305-fd29-40bc-bb23-e772826036ed None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=479852) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 09:19:18.197603 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ee5c305-fd29-40bc-bb23-e772826036ed None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:19:18.199162 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ee5c305-fd29-40bc-bb23-e772826036ed None admin] RBAC: Authorization granted {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:19:18.199381 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG dbcounter [-] [479851] Writing DB stats keystone:SELECT=100 {{(pid=479851) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:19:18.212502 dv-cinder-851351-1-smb devstack@keystone.service[479852]: [pid: 479852|app: 0|req: 320/632] 10.222.0.42 () {56 vars in 1148 bytes} [Thu Jul 28 09:19:18 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:19:18.213378 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee5c305-fd29-40bc-bb23-e772826036ed None admin] Authenticating user token {{(pid=479852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:19:18.223621 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2897cc36-e746-4673-a301-4222d1fd9974 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479851) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:19:18.224391 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2897cc36-e746-4673-a301-4222d1fd9974 None admin] REQUEST_METHOD: `GET` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:19:18.224780 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2897cc36-e746-4673-a301-4222d1fd9974 None admin] SCRIPT_NAME: `/identity` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:19:18.225140 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2897cc36-e746-4673-a301-4222d1fd9974 None admin] PATH_INFO: `/v3/users` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:19:18.226324 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2897cc36-e746-4673-a301-4222d1fd9974 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=479851) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 09:19:18.226965 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2897cc36-e746-4673-a301-4222d1fd9974 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:19:18.228216 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2897cc36-e746-4673-a301-4222d1fd9974 None admin] RBAC: Authorization granted {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:19:18.247947 dv-cinder-851351-1-smb devstack@keystone.service[479851]: [pid: 479851|app: 0|req: 313/633] 10.222.0.42 () {56 vars in 1137 bytes} [Thu Jul 28 09:19:18 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:19:18.249116 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a948547a-01fb-40b6-bed6-8a123b311c1b None None] REQUEST_METHOD: `POST` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:19:18.249409 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a948547a-01fb-40b6-bed6-8a123b311c1b None None] SCRIPT_NAME: `/identity` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:19:18.249692 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a948547a-01fb-40b6-bed6-8a123b311c1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:19:18.268901 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.auth.core [None req-a948547a-01fb-40b6-bed6-8a123b311c1b None None] MFA Rules not processed for user `c198f91a4ae84d2b9cc730a6e304c2be`. Rule list: `[]` (Enabled: `True`). {{(pid=479851) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 09:19:18.270174 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.fernet_utils [None req-a948547a-01fb-40b6-bed6-8a123b311c1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=479851) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 09:19:18.332333 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee5c305-fd29-40bc-bb23-e772826036ed None admin] Validating token access rules against request {{(pid=479852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:19:18.348461 dv-cinder-851351-1-smb devstack@keystone.service[479851]: [pid: 479851|app: 0|req: 314/634] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 09:19:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 09:19:18.348461 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a948547a-01fb-40b6-bed6-8a123b311c1b None None] Authenticating user token {{(pid=479851) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:19:18.379536 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e56694-bd31-4abe-9cd4-d76080567d56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:19:18.380195 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e56694-bd31-4abe-9cd4-d76080567d56 None admin] REQUEST_METHOD: `GET` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:19:18.380484 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e56694-bd31-4abe-9cd4-d76080567d56 None admin] SCRIPT_NAME: `/identity` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:19:18.380846 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e56694-bd31-4abe-9cd4-d76080567d56 None admin] PATH_INFO: `/v3/domains` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:19:18.383290 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e56694-bd31-4abe-9cd4-d76080567d56 None admin] RBAC: Adding query filter params (name=Default) {{(pid=479852) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 09:19:18.383290 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e56694-bd31-4abe-9cd4-d76080567d56 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:19:18.383290 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e56694-bd31-4abe-9cd4-d76080567d56 None admin] RBAC: Authorization granted {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:19:18.397376 dv-cinder-851351-1-smb devstack@keystone.service[479852]: [pid: 479852|app: 0|req: 321/635] 10.222.0.42 () {56 vars in 1109 bytes} [Thu Jul 28 09:19:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:19:18.398435 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e56694-bd31-4abe-9cd4-d76080567d56 None admin] Authenticating user token {{(pid=479852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:19:18.456017 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG dbcounter [-] [479852] Writing DB stats keystone:SELECT=100 {{(pid=479852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:19:18.464913 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a948547a-01fb-40b6-bed6-8a123b311c1b None None] Validating token access rules against request {{(pid=479851) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:19:18.473257 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG dbcounter [-] [479851] Writing DB stats keystone:SELECT=100 {{(pid=479851) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:19:18.500685 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1b7c78-58a5-44e0-9aad-b270593c7b52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479851) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:19:18.501384 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1b7c78-58a5-44e0-9aad-b270593c7b52 None admin] REQUEST_METHOD: `PUT` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:19:18.501689 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1b7c78-58a5-44e0-9aad-b270593c7b52 None admin] SCRIPT_NAME: `/identity` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:19:18.501978 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1b7c78-58a5-44e0-9aad-b270593c7b52 None admin] PATH_INFO: `/v3/projects/3a0fb8ea8010437bade8f92dcbcaacee/users/213aa011e5004256aead7e486d7f2eba/roles/bd74dfcbc8d7412689d315fe24a1f247` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:19:18.517200 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b1b7c78-58a5-44e0-9aad-b270593c7b52 None admin] RBAC: Authorizing `identity:create_grant(project_id=3a0fb8ea8010437bade8f92dcbcaacee, user_id=213aa011e5004256aead7e486d7f2eba, role_id=bd74dfcbc8d7412689d315fe24a1f247)` {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:19:18.518665 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b1b7c78-58a5-44e0-9aad-b270593c7b52 None admin] RBAC: Authorization granted {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:19:18.520655 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e56694-bd31-4abe-9cd4-d76080567d56 None admin] Validating token access rules against request {{(pid=479852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:19:18.533196 dv-cinder-851351-1-smb devstack@keystone.service[479851]: [pid: 479851|app: 0|req: 315/636] 10.222.0.42 () {58 vars in 1439 bytes} [Thu Jul 28 09:19:18 2022] PUT /identity/v3/projects/3a0fb8ea8010437bade8f92dcbcaacee/users/213aa011e5004256aead7e486d7f2eba/roles/bd74dfcbc8d7412689d315fe24a1f247 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 09:19:18.534411 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1b7c78-58a5-44e0-9aad-b270593c7b52 None admin] Authenticating user token {{(pid=479851) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:19:18.570380 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c59247-2851-4460-b878-145ca06c77a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:19:18.571972 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c59247-2851-4460-b878-145ca06c77a2 None admin] REQUEST_METHOD: `GET` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:19:18.572474 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c59247-2851-4460-b878-145ca06c77a2 None admin] SCRIPT_NAME: `/identity` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:19:18.572935 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c59247-2851-4460-b878-145ca06c77a2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:19:18.675430 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c59247-2851-4460-b878-145ca06c77a2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:19:18.677199 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c59247-2851-4460-b878-145ca06c77a2 None admin] RBAC: Authorization granted {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:19:18.680197 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1b7c78-58a5-44e0-9aad-b270593c7b52 None admin] Validating token access rules against request {{(pid=479851) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:19:18.723029 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818d3097-a897-4448-8ee1-cff75f4f68f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479851) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:19:18.724060 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818d3097-a897-4448-8ee1-cff75f4f68f9 None admin] REQUEST_METHOD: `GET` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:19:18.724349 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818d3097-a897-4448-8ee1-cff75f4f68f9 None admin] SCRIPT_NAME: `/identity` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:19:18.725219 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818d3097-a897-4448-8ee1-cff75f4f68f9 None admin] PATH_INFO: `/v3/roles/service` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:19:18.731986 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG dbcounter [-] [479852] Writing DB stats keystone:SELECT=100 {{(pid=479852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:19:18.737303 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-818d3097-a897-4448-8ee1-cff75f4f68f9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 09:19:18.742562 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application [None req-818d3097-a897-4448-8ee1-cff75f4f68f9 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 28 09:19:18.742562 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 09:19:18.742562 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 09:19:18.742562 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 09:19:18.742562 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 09:19:18.742562 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 09:19:18.742562 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 09:19:18.742562 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 09:19:18.742562 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 09:19:18.742562 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 09:19:18.742562 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 09:19:18.742562 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 09:19:18.742562 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 09:19:18.742562 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 09:19:18.742562 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 09:19:18.742562 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 09:19:18.743839 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 09:19:18.743839 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 09:19:18.743839 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 09:19:18.743839 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 09:19:18.743839 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 09:19:18.743839 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 09:19:18.743839 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 09:19:18.743839 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 09:19:18.743839 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 09:19:18.743839 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 09:19:18.743839 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 09:19:18.743839 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application with Lock( Jul 28 09:19:18.743839 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 09:19:18.743839 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return self._enter() Jul 28 09:19:18.743839 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 09:19:18.743839 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 09:19:18.744993 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 09:19:18.744993 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return self.creator() Jul 28 09:19:18.744993 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 09:19:18.744993 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application created_value = creator( Jul 28 09:19:18.744993 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 09:19:18.744993 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 09:19:18.744993 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 09:19:18.744993 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 09:19:18.744993 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 09:19:18.744993 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 09:19:18.744993 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 28 09:19:18.744993 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application Jul 28 09:19:18.744993 dv-cinder-851351-1-smb devstack@keystone.service[479851]: [pid: 479851|app: 0|req: 316/637] 10.222.0.42 () {56 vars in 1102 bytes} [Thu Jul 28 09:19:18 2022] GET /identity/v3/roles/service => generated 85 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 09:19:18.744993 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818d3097-a897-4448-8ee1-cff75f4f68f9 None admin] Authenticating user token {{(pid=479851) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:19:18.763956 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG dbcounter [-] [479851] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=479851) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:19:18.796224 dv-cinder-851351-1-smb devstack@keystone.service[479852]: [pid: 479852|app: 0|req: 322/638] 10.222.0.42 () {58 vars in 1282 bytes} [Thu Jul 28 09:19:18 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 394 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 28 09:19:18.796224 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1957c8a-3f72-459b-bbdd-bf8de22aeb28 None None] REQUEST_METHOD: `GET` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:19:18.796224 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1957c8a-3f72-459b-bbdd-bf8de22aeb28 None None] SCRIPT_NAME: `/identity` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:19:18.796224 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1957c8a-3f72-459b-bbdd-bf8de22aeb28 None None] PATH_INFO: `/` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:19:18.796224 dv-cinder-851351-1-smb devstack@keystone.service[479852]: [pid: 479852|app: 0|req: 323/639] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 09:19:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 09:19:18.796224 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1957c8a-3f72-459b-bbdd-bf8de22aeb28 None None] Authenticating user token {{(pid=479852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:19:18.858789 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818d3097-a897-4448-8ee1-cff75f4f68f9 None admin] Validating token access rules against request {{(pid=479851) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:19:18.901861 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1957c8a-3f72-459b-bbdd-bf8de22aeb28 None None] Validating token access rules against request {{(pid=479852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:19:18.902832 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee36cdc1-b769-42f5-936a-fd1cf046b004 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479851) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:19:18.903494 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee36cdc1-b769-42f5-936a-fd1cf046b004 None admin] REQUEST_METHOD: `GET` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:19:18.903785 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee36cdc1-b769-42f5-936a-fd1cf046b004 None admin] SCRIPT_NAME: `/identity` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:19:18.904046 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee36cdc1-b769-42f5-936a-fd1cf046b004 None admin] PATH_INFO: `/v3/users/nova` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:19:18.911792 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee36cdc1-b769-42f5-936a-fd1cf046b004 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:19:18.913310 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee36cdc1-b769-42f5-936a-fd1cf046b004 None admin] RBAC: Authorization granted {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:19:18.925867 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application [None req-ee36cdc1-b769-42f5-936a-fd1cf046b004 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 28 09:19:18.925867 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 09:19:18.925867 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 09:19:18.925867 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 09:19:18.925867 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 09:19:18.925867 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 09:19:18.925867 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 09:19:18.925867 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 09:19:18.925867 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 09:19:18.925867 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 09:19:18.925867 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 09:19:18.925867 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 09:19:18.925867 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 28 09:19:18.925867 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 28 09:19:18.925867 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 28 09:19:18.925867 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 28 09:19:18.927353 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 09:19:18.927353 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 09:19:18.927353 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 28 09:19:18.927353 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 09:19:18.927353 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 28 09:19:18.927353 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 09:19:18.927353 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 09:19:18.927353 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 09:19:18.927353 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 09:19:18.927353 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 09:19:18.927353 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 09:19:18.927353 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application with Lock( Jul 28 09:19:18.927353 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 09:19:18.927353 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return self._enter() Jul 28 09:19:18.927353 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 09:19:18.927353 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 09:19:18.927353 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 09:19:18.927353 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return self.creator() Jul 28 09:19:18.928948 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 09:19:18.928948 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application created_value = creator( Jul 28 09:19:18.928948 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 28 09:19:18.928948 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 28 09:19:18.928948 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 28 09:19:18.928948 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 28 09:19:18.928948 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 28 09:19:18.928948 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 28 09:19:18.928948 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 28 09:19:18.928948 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application Jul 28 09:19:18.931820 dv-cinder-851351-1-smb devstack@keystone.service[479851]: [pid: 479851|app: 0|req: 317/640] 10.222.0.42 () {56 vars in 1093 bytes} [Thu Jul 28 09:19:18 2022] GET /identity/v3/users/nova => generated 82 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 09:19:18.932715 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee36cdc1-b769-42f5-936a-fd1cf046b004 None admin] Authenticating user token {{(pid=479851) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:19:18.945519 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d703f9de-37d6-491a-97ee-be058ec72ab9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:19:18.946661 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d703f9de-37d6-491a-97ee-be058ec72ab9 None admin] REQUEST_METHOD: `GET` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:19:18.947037 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d703f9de-37d6-491a-97ee-be058ec72ab9 None admin] SCRIPT_NAME: `/identity` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:19:18.947409 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d703f9de-37d6-491a-97ee-be058ec72ab9 None admin] PATH_INFO: `/v3/roles` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:19:18.948267 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d703f9de-37d6-491a-97ee-be058ec72ab9 None admin] RBAC: Adding query filter params (name=service) {{(pid=479852) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 09:19:18.948688 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d703f9de-37d6-491a-97ee-be058ec72ab9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:19:18.950210 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d703f9de-37d6-491a-97ee-be058ec72ab9 None admin] RBAC: Authorization granted {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:19:18.959893 dv-cinder-851351-1-smb devstack@keystone.service[479852]: [pid: 479852|app: 0|req: 324/641] 10.222.0.42 () {56 vars in 1103 bytes} [Thu Jul 28 09:19:18 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:19:18.961168 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b7ffa2-64e4-472f-9877-dce6ab8576d2 None None] REQUEST_METHOD: `POST` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:19:18.961549 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b7ffa2-64e4-472f-9877-dce6ab8576d2 None None] SCRIPT_NAME: `/identity` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:19:18.961940 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b7ffa2-64e4-472f-9877-dce6ab8576d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:19:18.981566 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.auth.core [None req-68b7ffa2-64e4-472f-9877-dce6ab8576d2 None None] MFA Rules not processed for user `c198f91a4ae84d2b9cc730a6e304c2be`. Rule list: `[]` (Enabled: `True`). {{(pid=479852) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 09:19:18.982712 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.fernet_utils [None req-68b7ffa2-64e4-472f-9877-dce6ab8576d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=479852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 09:19:18.985243 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG dbcounter [-] [479852] Writing DB stats keystone:SELECT=100 {{(pid=479852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:19:19.023547 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG dbcounter [-] [479851] Writing DB stats keystone:SELECT=100 {{(pid=479851) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:19:19.049485 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee36cdc1-b769-42f5-936a-fd1cf046b004 None admin] Validating token access rules against request {{(pid=479851) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:19:19.058751 dv-cinder-851351-1-smb devstack@keystone.service[479852]: [pid: 479852|app: 0|req: 325/642] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 09:19:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 09:19:19.059663 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b7ffa2-64e4-472f-9877-dce6ab8576d2 None None] Authenticating user token {{(pid=479852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:19:19.098853 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0083de7d-fecc-4b73-8cfe-2542166f0c45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479851) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:19:19.099814 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0083de7d-fecc-4b73-8cfe-2542166f0c45 None admin] REQUEST_METHOD: `GET` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:19:19.100279 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0083de7d-fecc-4b73-8cfe-2542166f0c45 None admin] SCRIPT_NAME: `/identity` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:19:19.100859 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0083de7d-fecc-4b73-8cfe-2542166f0c45 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:19:19.112786 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0083de7d-fecc-4b73-8cfe-2542166f0c45 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:19:19.114725 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0083de7d-fecc-4b73-8cfe-2542166f0c45 None admin] RBAC: Authorization granted {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:19:19.130796 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application [None req-0083de7d-fecc-4b73-8cfe-2542166f0c45 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 09:19:19.130796 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 09:19:19.130796 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 09:19:19.130796 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 09:19:19.130796 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 09:19:19.130796 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 09:19:19.130796 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 09:19:19.130796 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 09:19:19.130796 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 09:19:19.130796 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 09:19:19.130796 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 09:19:19.130796 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 09:19:19.130796 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 09:19:19.130796 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 09:19:19.130796 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 09:19:19.132097 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 09:19:19.132097 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 09:19:19.132097 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 09:19:19.132097 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 09:19:19.132097 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 09:19:19.132097 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 09:19:19.132097 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 09:19:19.132097 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 09:19:19.132097 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application with Lock( Jul 28 09:19:19.132097 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 09:19:19.132097 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return self._enter() Jul 28 09:19:19.132097 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 09:19:19.132097 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 09:19:19.132097 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 09:19:19.132097 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return self.creator() Jul 28 09:19:19.132097 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 09:19:19.132097 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application created_value = creator( Jul 28 09:19:19.133367 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 09:19:19.133367 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 09:19:19.133367 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 09:19:19.133367 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application Jul 28 09:19:19.139656 dv-cinder-851351-1-smb devstack@keystone.service[479851]: [pid: 479851|app: 0|req: 318/643] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 09:19:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 09:19:19.140758 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0083de7d-fecc-4b73-8cfe-2542166f0c45 None admin] Authenticating user token {{(pid=479851) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:19:19.173408 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b7ffa2-64e4-472f-9877-dce6ab8576d2 None None] Validating token access rules against request {{(pid=479852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:19:19.210091 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf656fd-8bb3-4a3f-884e-ad08542a47d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:19:19.211106 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf656fd-8bb3-4a3f-884e-ad08542a47d7 None admin] REQUEST_METHOD: `GET` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:19:19.211409 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf656fd-8bb3-4a3f-884e-ad08542a47d7 None admin] SCRIPT_NAME: `/identity` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:19:19.211663 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf656fd-8bb3-4a3f-884e-ad08542a47d7 None admin] PATH_INFO: `/v3/users` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:19:19.212486 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf656fd-8bb3-4a3f-884e-ad08542a47d7 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=479852) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 09:19:19.212835 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf656fd-8bb3-4a3f-884e-ad08542a47d7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:19:19.214304 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf656fd-8bb3-4a3f-884e-ad08542a47d7 None admin] RBAC: Authorization granted {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:19:19.223234 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG dbcounter [-] [479852] Writing DB stats keystone:SELECT=100 {{(pid=479852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:19:19.236066 dv-cinder-851351-1-smb devstack@keystone.service[479852]: [pid: 479852|app: 0|req: 326/644] 10.222.0.42 () {56 vars in 1133 bytes} [Thu Jul 28 09:19:19 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:19:19.237523 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf656fd-8bb3-4a3f-884e-ad08542a47d7 None admin] Authenticating user token {{(pid=479852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:19:19.262830 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0083de7d-fecc-4b73-8cfe-2542166f0c45 None admin] Validating token access rules against request {{(pid=479851) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:19:19.290524 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG dbcounter [-] [479851] Writing DB stats keystone:SELECT=100 {{(pid=479851) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:19:19.299875 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3643b456-facb-42ae-9b94-35f9dc67075b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479851) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:19:19.300546 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3643b456-facb-42ae-9b94-35f9dc67075b None admin] REQUEST_METHOD: `GET` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:19:19.300869 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3643b456-facb-42ae-9b94-35f9dc67075b None admin] SCRIPT_NAME: `/identity` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:19:19.301147 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3643b456-facb-42ae-9b94-35f9dc67075b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:19:19.315030 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3643b456-facb-42ae-9b94-35f9dc67075b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:19:19.316552 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3643b456-facb-42ae-9b94-35f9dc67075b None admin] RBAC: Authorization granted {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:19:19.332163 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application [None req-3643b456-facb-42ae-9b94-35f9dc67075b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 09:19:19.332163 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 09:19:19.332163 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 09:19:19.332163 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 09:19:19.332163 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 09:19:19.332163 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 09:19:19.332163 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 09:19:19.332163 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 09:19:19.332163 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 09:19:19.332163 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 09:19:19.332163 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 09:19:19.332163 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 09:19:19.332163 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 09:19:19.332163 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 09:19:19.332163 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 09:19:19.333500 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 09:19:19.333500 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 09:19:19.333500 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 09:19:19.333500 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 09:19:19.333500 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 09:19:19.333500 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 09:19:19.333500 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 09:19:19.333500 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 09:19:19.333500 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application with Lock( Jul 28 09:19:19.333500 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 09:19:19.333500 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return self._enter() Jul 28 09:19:19.333500 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 09:19:19.333500 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 09:19:19.333500 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 09:19:19.333500 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return self.creator() Jul 28 09:19:19.333500 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 09:19:19.333500 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application created_value = creator( Jul 28 09:19:19.335014 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 09:19:19.335014 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 09:19:19.335014 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 09:19:19.335014 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application Jul 28 09:19:19.335014 dv-cinder-851351-1-smb devstack@keystone.service[479851]: [pid: 479851|app: 0|req: 319/645] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 09:19:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 09:19:19.335014 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3643b456-facb-42ae-9b94-35f9dc67075b None admin] Authenticating user token {{(pid=479851) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:19:19.363192 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf656fd-8bb3-4a3f-884e-ad08542a47d7 None admin] Validating token access rules against request {{(pid=479852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:19:19.419111 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb4af96-0123-4cc7-b412-0ac2b3920d50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:19:19.420263 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb4af96-0123-4cc7-b412-0ac2b3920d50 None admin] REQUEST_METHOD: `GET` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:19:19.420537 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb4af96-0123-4cc7-b412-0ac2b3920d50 None admin] SCRIPT_NAME: `/identity` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:19:19.420849 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb4af96-0123-4cc7-b412-0ac2b3920d50 None admin] PATH_INFO: `/v3/roles/service` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:19:19.434371 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eb4af96-0123-4cc7-b412-0ac2b3920d50 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 09:19:19.439327 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application [None req-1eb4af96-0123-4cc7-b412-0ac2b3920d50 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 28 09:19:19.439327 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 09:19:19.439327 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 09:19:19.439327 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 09:19:19.439327 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 09:19:19.439327 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 09:19:19.439327 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 09:19:19.439327 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 09:19:19.439327 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 09:19:19.439327 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 09:19:19.439327 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 09:19:19.439327 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 09:19:19.439327 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 09:19:19.439327 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 09:19:19.439327 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 09:19:19.439327 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 09:19:19.441509 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 09:19:19.441509 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 09:19:19.441509 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 09:19:19.441509 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 09:19:19.441509 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 09:19:19.441509 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 09:19:19.441509 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 09:19:19.441509 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 09:19:19.441509 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 09:19:19.441509 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 09:19:19.441509 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 09:19:19.441509 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application with Lock( Jul 28 09:19:19.441509 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 09:19:19.441509 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self._enter() Jul 28 09:19:19.441509 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 09:19:19.441509 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 09:19:19.443539 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 09:19:19.443539 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self.creator() Jul 28 09:19:19.443539 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 09:19:19.443539 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application created_value = creator( Jul 28 09:19:19.443539 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 09:19:19.443539 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 09:19:19.443539 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 09:19:19.443539 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 09:19:19.443539 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 09:19:19.443539 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 09:19:19.443539 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 28 09:19:19.443539 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application Jul 28 09:19:19.443539 dv-cinder-851351-1-smb devstack@keystone.service[479852]: [pid: 479852|app: 0|req: 327/646] 10.222.0.42 () {56 vars in 1102 bytes} [Thu Jul 28 09:19:19 2022] GET /identity/v3/roles/service => generated 85 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 09:19:19.446704 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb4af96-0123-4cc7-b412-0ac2b3920d50 None admin] Authenticating user token {{(pid=479852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:19:19.465724 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3643b456-facb-42ae-9b94-35f9dc67075b None admin] Validating token access rules against request {{(pid=479851) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:19:19.511743 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e25f16a-9a09-4686-ae65-a4bf9390acec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479851) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:19:19.512769 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e25f16a-9a09-4686-ae65-a4bf9390acec None admin] REQUEST_METHOD: `GET` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:19:19.513334 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e25f16a-9a09-4686-ae65-a4bf9390acec None admin] SCRIPT_NAME: `/identity` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:19:19.513808 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e25f16a-9a09-4686-ae65-a4bf9390acec None admin] PATH_INFO: `/v3/domains` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:19:19.515015 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e25f16a-9a09-4686-ae65-a4bf9390acec None admin] RBAC: Adding query filter params (name=Default) {{(pid=479851) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 09:19:19.515608 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e25f16a-9a09-4686-ae65-a4bf9390acec None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:19:19.517790 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e25f16a-9a09-4686-ae65-a4bf9390acec None admin] RBAC: Authorization granted {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:19:19.530544 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG dbcounter [-] [479852] Writing DB stats keystone:SELECT=100 {{(pid=479852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:19:19.540620 dv-cinder-851351-1-smb devstack@keystone.service[479851]: [pid: 479851|app: 0|req: 320/647] 10.222.0.42 () {56 vars in 1109 bytes} [Thu Jul 28 09:19:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:19:19.540620 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e25f16a-9a09-4686-ae65-a4bf9390acec None admin] Authenticating user token {{(pid=479851) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:19:19.587788 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG dbcounter [-] [479851] Writing DB stats keystone:SELECT=100 {{(pid=479851) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:19:19.595383 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb4af96-0123-4cc7-b412-0ac2b3920d50 None admin] Validating token access rules against request {{(pid=479852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:19:19.644888 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29990ea5-9358-4768-833f-e7797143ab23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:19:19.645524 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29990ea5-9358-4768-833f-e7797143ab23 None admin] REQUEST_METHOD: `GET` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:19:19.645878 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29990ea5-9358-4768-833f-e7797143ab23 None admin] SCRIPT_NAME: `/identity` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:19:19.646159 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29990ea5-9358-4768-833f-e7797143ab23 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:19:19.684637 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e25f16a-9a09-4686-ae65-a4bf9390acec None admin] Validating token access rules against request {{(pid=479851) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:19:19.731758 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d298c6-6494-47d2-bc3f-8d1f4aeafca6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479851) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:19:19.732192 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29990ea5-9358-4768-833f-e7797143ab23 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:19:19.732696 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d298c6-6494-47d2-bc3f-8d1f4aeafca6 None admin] REQUEST_METHOD: `GET` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:19:19.732696 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d298c6-6494-47d2-bc3f-8d1f4aeafca6 None admin] SCRIPT_NAME: `/identity` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:19:19.732974 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d298c6-6494-47d2-bc3f-8d1f4aeafca6 None admin] PATH_INFO: `/v3/domains` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:19:19.733680 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85d298c6-6494-47d2-bc3f-8d1f4aeafca6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=479851) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 09:19:19.733988 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85d298c6-6494-47d2-bc3f-8d1f4aeafca6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:19:19.734231 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29990ea5-9358-4768-833f-e7797143ab23 None admin] RBAC: Authorization granted {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:19:19.735389 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85d298c6-6494-47d2-bc3f-8d1f4aeafca6 None admin] RBAC: Authorization granted {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:19:19.747809 dv-cinder-851351-1-smb devstack@keystone.service[479851]: [pid: 479851|app: 0|req: 321/648] 10.222.0.42 () {56 vars in 1109 bytes} [Thu Jul 28 09:19:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:19:19.747809 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d298c6-6494-47d2-bc3f-8d1f4aeafca6 None admin] Authenticating user token {{(pid=479851) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:19:19.798098 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG dbcounter [-] [479852] Writing DB stats keystone:SELECT=100 {{(pid=479852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:19:19.849339 dv-cinder-851351-1-smb devstack@keystone.service[479852]: [pid: 479852|app: 0|req: 328/649] 10.222.0.42 () {58 vars in 1282 bytes} [Thu Jul 28 09:19:19 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 408 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 28 09:19:19.850476 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29990ea5-9358-4768-833f-e7797143ab23 None admin] Authenticating user token {{(pid=479852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:19:19.859939 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG dbcounter [-] [479851] Writing DB stats keystone:SELECT=100 {{(pid=479851) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:19:19.863563 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d298c6-6494-47d2-bc3f-8d1f4aeafca6 None admin] Validating token access rules against request {{(pid=479851) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:19:19.903705 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45db8d28-cf95-4d32-ac19-ed2904dd7eb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479851) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:19:19.904693 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45db8d28-cf95-4d32-ac19-ed2904dd7eb4 None admin] REQUEST_METHOD: `GET` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:19:19.905144 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45db8d28-cf95-4d32-ac19-ed2904dd7eb4 None admin] SCRIPT_NAME: `/identity` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:19:19.905605 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45db8d28-cf95-4d32-ac19-ed2904dd7eb4 None admin] PATH_INFO: `/v3/roles` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:19:19.906368 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45db8d28-cf95-4d32-ac19-ed2904dd7eb4 None admin] RBAC: Adding query filter params (name=service) {{(pid=479851) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 09:19:19.906681 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45db8d28-cf95-4d32-ac19-ed2904dd7eb4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:19:19.908099 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45db8d28-cf95-4d32-ac19-ed2904dd7eb4 None admin] RBAC: Authorization granted {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:19:19.921449 dv-cinder-851351-1-smb devstack@keystone.service[479851]: [pid: 479851|app: 0|req: 322/650] 10.222.0.42 () {56 vars in 1103 bytes} [Thu Jul 28 09:19:19 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:19:19.922193 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45db8d28-cf95-4d32-ac19-ed2904dd7eb4 None admin] Authenticating user token {{(pid=479851) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:19:19.957781 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29990ea5-9358-4768-833f-e7797143ab23 None admin] Validating token access rules against request {{(pid=479852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:19:19.994433 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b19608c-3b81-406c-a4df-61f86eb684ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:19:19.995252 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b19608c-3b81-406c-a4df-61f86eb684ad None admin] REQUEST_METHOD: `GET` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:19:19.995626 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b19608c-3b81-406c-a4df-61f86eb684ad None admin] SCRIPT_NAME: `/identity` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:19:19.995975 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b19608c-3b81-406c-a4df-61f86eb684ad None admin] PATH_INFO: `/v3/projects/service` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:19:20.003233 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b19608c-3b81-406c-a4df-61f86eb684ad None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:19:20.004736 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b19608c-3b81-406c-a4df-61f86eb684ad None admin] RBAC: Authorization granted {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:19:20.017324 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application [None req-7b19608c-3b81-406c-a4df-61f86eb684ad None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 09:19:20.017324 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 09:19:20.017324 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 09:19:20.017324 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 09:19:20.017324 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 09:19:20.017324 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 09:19:20.017324 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 09:19:20.017324 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 09:19:20.017324 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 09:19:20.017324 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 09:19:20.017324 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 09:19:20.017324 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 09:19:20.017324 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 28 09:19:20.017324 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 28 09:19:20.017324 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 28 09:19:20.018419 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 28 09:19:20.018419 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 09:19:20.018419 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 09:19:20.018419 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 09:19:20.018419 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 09:19:20.018419 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 09:19:20.018419 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 09:19:20.018419 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 09:19:20.018419 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application with Lock( Jul 28 09:19:20.018419 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 09:19:20.018419 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self._enter() Jul 28 09:19:20.018419 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 09:19:20.018419 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 09:19:20.018419 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 09:19:20.018419 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self.creator() Jul 28 09:19:20.018419 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 09:19:20.018419 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application created_value = creator( Jul 28 09:19:20.019529 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 28 09:19:20.019529 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 28 09:19:20.019529 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 28 09:19:20.019529 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 28 09:19:20.019529 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 28 09:19:20.019529 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 28 09:19:20.019529 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 09:19:20.019529 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application Jul 28 09:19:20.019529 dv-cinder-851351-1-smb devstack@keystone.service[479852]: [pid: 479852|app: 0|req: 329/651] 10.222.0.42 () {56 vars in 1111 bytes} [Thu Jul 28 09:19:19 2022] GET /identity/v3/projects/service => generated 88 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 09:19:20.020143 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b19608c-3b81-406c-a4df-61f86eb684ad None admin] Authenticating user token {{(pid=479852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:19:20.035804 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45db8d28-cf95-4d32-ac19-ed2904dd7eb4 None admin] Validating token access rules against request {{(pid=479851) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:19:20.040440 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG dbcounter [-] [479852] Writing DB stats keystone:SELECT=100 {{(pid=479852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:19:20.074860 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b3e8ac-cf0d-4182-8ed1-cf1d30433565 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479851) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:19:20.075698 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b3e8ac-cf0d-4182-8ed1-cf1d30433565 None admin] REQUEST_METHOD: `GET` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:19:20.076076 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b3e8ac-cf0d-4182-8ed1-cf1d30433565 None admin] SCRIPT_NAME: `/identity` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:19:20.076425 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b3e8ac-cf0d-4182-8ed1-cf1d30433565 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:19:20.084788 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27b3e8ac-cf0d-4182-8ed1-cf1d30433565 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:19:20.086400 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27b3e8ac-cf0d-4182-8ed1-cf1d30433565 None admin] RBAC: Authorization granted {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:19:20.098379 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application [None req-27b3e8ac-cf0d-4182-8ed1-cf1d30433565 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jul 28 09:19:20.098379 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 09:19:20.098379 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 09:19:20.098379 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 09:19:20.098379 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 09:19:20.098379 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 09:19:20.098379 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 09:19:20.098379 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 09:19:20.098379 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 09:19:20.098379 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 09:19:20.098379 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 09:19:20.098379 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 09:19:20.098379 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 28 09:19:20.098379 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 28 09:19:20.098379 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 28 09:19:20.098379 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 28 09:19:20.099983 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 09:19:20.099983 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 09:19:20.099983 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 28 09:19:20.099983 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 09:19:20.099983 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 28 09:19:20.099983 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 09:19:20.099983 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 09:19:20.099983 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 09:19:20.099983 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 09:19:20.099983 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 09:19:20.099983 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 09:19:20.099983 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application with Lock( Jul 28 09:19:20.099983 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 09:19:20.099983 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return self._enter() Jul 28 09:19:20.099983 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 09:19:20.099983 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 09:19:20.099983 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 09:19:20.099983 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return self.creator() Jul 28 09:19:20.101361 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 09:19:20.101361 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application created_value = creator( Jul 28 09:19:20.101361 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 28 09:19:20.101361 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 28 09:19:20.101361 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 28 09:19:20.101361 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 28 09:19:20.101361 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 28 09:19:20.101361 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 28 09:19:20.101361 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jul 28 09:19:20.101361 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application Jul 28 09:19:20.106458 dv-cinder-851351-1-smb devstack@keystone.service[479851]: [pid: 479851|app: 0|req: 323/652] 10.222.0.42 () {56 vars in 1099 bytes} [Thu Jul 28 09:19:19 2022] GET /identity/v3/users/cinder => generated 84 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 09:19:20.107405 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b3e8ac-cf0d-4182-8ed1-cf1d30433565 None admin] Authenticating user token {{(pid=479851) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:19:20.133499 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG dbcounter [-] [479851] Writing DB stats keystone:SELECT=100 {{(pid=479851) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:19:20.139807 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b19608c-3b81-406c-a4df-61f86eb684ad None admin] Validating token access rules against request {{(pid=479852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:19:20.177384 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee7437c-7561-4d02-8985-46e99c0bbe19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:19:20.178395 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee7437c-7561-4d02-8985-46e99c0bbe19 None admin] REQUEST_METHOD: `GET` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:19:20.178882 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee7437c-7561-4d02-8985-46e99c0bbe19 None admin] SCRIPT_NAME: `/identity` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:19:20.179348 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee7437c-7561-4d02-8985-46e99c0bbe19 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:19:20.190568 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ee7437c-7561-4d02-8985-46e99c0bbe19 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:19:20.192337 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ee7437c-7561-4d02-8985-46e99c0bbe19 None admin] RBAC: Authorization granted {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:19:20.208651 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application [None req-2ee7437c-7561-4d02-8985-46e99c0bbe19 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 09:19:20.208651 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 09:19:20.208651 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 09:19:20.208651 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 09:19:20.208651 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 09:19:20.208651 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 09:19:20.208651 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 09:19:20.208651 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 09:19:20.208651 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 09:19:20.208651 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 09:19:20.208651 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 09:19:20.208651 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 09:19:20.208651 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 09:19:20.208651 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 09:19:20.208651 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 09:19:20.209993 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 09:19:20.209993 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 09:19:20.209993 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 09:19:20.209993 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 09:19:20.209993 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 09:19:20.209993 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 09:19:20.209993 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 09:19:20.209993 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 09:19:20.209993 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application with Lock( Jul 28 09:19:20.209993 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 09:19:20.209993 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self._enter() Jul 28 09:19:20.209993 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 09:19:20.209993 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 09:19:20.209993 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 09:19:20.209993 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self.creator() Jul 28 09:19:20.209993 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 09:19:20.209993 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application created_value = creator( Jul 28 09:19:20.211200 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 09:19:20.211200 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 09:19:20.211200 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 09:19:20.211200 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application Jul 28 09:19:20.211200 dv-cinder-851351-1-smb devstack@keystone.service[479852]: [pid: 479852|app: 0|req: 330/653] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 09:19:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 09:19:20.211532 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee7437c-7561-4d02-8985-46e99c0bbe19 None admin] Authenticating user token {{(pid=479852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:19:20.224808 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b3e8ac-cf0d-4182-8ed1-cf1d30433565 None admin] Validating token access rules against request {{(pid=479851) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:19:20.262173 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be4a9149-6791-4b95-aa48-9dcfe7be6eab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479851) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:19:20.262836 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4a9149-6791-4b95-aa48-9dcfe7be6eab None admin] REQUEST_METHOD: `GET` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:19:20.263127 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4a9149-6791-4b95-aa48-9dcfe7be6eab None admin] SCRIPT_NAME: `/identity` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:19:20.263412 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4a9149-6791-4b95-aa48-9dcfe7be6eab None admin] PATH_INFO: `/v3/domains/Default` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:19:20.274561 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be4a9149-6791-4b95-aa48-9dcfe7be6eab None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:19:20.276039 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be4a9149-6791-4b95-aa48-9dcfe7be6eab None admin] RBAC: Authorization granted {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:19:20.288981 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG dbcounter [-] [479852] Writing DB stats keystone:SELECT=100 {{(pid=479852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:19:20.290709 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application [None req-be4a9149-6791-4b95-aa48-9dcfe7be6eab None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 09:19:20.290709 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 09:19:20.290709 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 09:19:20.290709 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 09:19:20.290709 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 09:19:20.290709 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 09:19:20.290709 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 09:19:20.290709 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 09:19:20.290709 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 09:19:20.290709 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 09:19:20.290709 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 09:19:20.290709 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 09:19:20.290709 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 09:19:20.290709 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 09:19:20.290709 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 09:19:20.291948 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 09:19:20.291948 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 09:19:20.291948 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 09:19:20.291948 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 09:19:20.291948 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 09:19:20.291948 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 09:19:20.291948 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 09:19:20.291948 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 09:19:20.291948 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application with Lock( Jul 28 09:19:20.291948 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 09:19:20.291948 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return self._enter() Jul 28 09:19:20.291948 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 09:19:20.291948 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 09:19:20.291948 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 09:19:20.291948 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return self.creator() Jul 28 09:19:20.291948 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 09:19:20.291948 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application created_value = creator( Jul 28 09:19:20.293063 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 09:19:20.293063 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 09:19:20.293063 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 09:19:20.293063 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application Jul 28 09:19:20.293063 dv-cinder-851351-1-smb devstack@keystone.service[479851]: [pid: 479851|app: 0|req: 324/654] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 09:19:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 09:19:20.293063 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be4a9149-6791-4b95-aa48-9dcfe7be6eab None admin] Authenticating user token {{(pid=479851) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:19:20.337416 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee7437c-7561-4d02-8985-46e99c0bbe19 None admin] Validating token access rules against request {{(pid=479852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:19:20.375727 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG dbcounter [-] [479851] Writing DB stats keystone:SELECT=100 {{(pid=479851) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:19:20.386041 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1415fe4-dd02-4a29-b03b-98009c70e20a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:19:20.386875 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1415fe4-dd02-4a29-b03b-98009c70e20a None admin] REQUEST_METHOD: `GET` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:19:20.387229 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1415fe4-dd02-4a29-b03b-98009c70e20a None admin] SCRIPT_NAME: `/identity` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:19:20.387515 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1415fe4-dd02-4a29-b03b-98009c70e20a None admin] PATH_INFO: `/v3/projects` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:19:20.388458 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1415fe4-dd02-4a29-b03b-98009c70e20a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=479852) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 09:19:20.389112 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1415fe4-dd02-4a29-b03b-98009c70e20a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:19:20.390571 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1415fe4-dd02-4a29-b03b-98009c70e20a None admin] RBAC: Authorization granted {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:19:20.405634 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be4a9149-6791-4b95-aa48-9dcfe7be6eab None admin] Validating token access rules against request {{(pid=479851) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:19:20.410887 dv-cinder-851351-1-smb devstack@keystone.service[479852]: [pid: 479852|app: 0|req: 331/655] 10.222.0.42 () {56 vars in 1148 bytes} [Thu Jul 28 09:19:20 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:19:20.410887 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1415fe4-dd02-4a29-b03b-98009c70e20a None admin] Authenticating user token {{(pid=479852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:19:20.449037 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eadc6ee-a7a5-4705-ad47-bbe2d8b4d7f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479851) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:19:20.450224 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eadc6ee-a7a5-4705-ad47-bbe2d8b4d7f6 None admin] REQUEST_METHOD: `GET` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:19:20.450224 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eadc6ee-a7a5-4705-ad47-bbe2d8b4d7f6 None admin] SCRIPT_NAME: `/identity` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:19:20.450501 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eadc6ee-a7a5-4705-ad47-bbe2d8b4d7f6 None admin] PATH_INFO: `/v3/users` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:19:20.451373 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eadc6ee-a7a5-4705-ad47-bbe2d8b4d7f6 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=479851) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 09:19:20.451741 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eadc6ee-a7a5-4705-ad47-bbe2d8b4d7f6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:19:20.453461 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eadc6ee-a7a5-4705-ad47-bbe2d8b4d7f6 None admin] RBAC: Authorization granted {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:19:20.472053 dv-cinder-851351-1-smb devstack@keystone.service[479851]: [pid: 479851|app: 0|req: 325/656] 10.222.0.42 () {56 vars in 1137 bytes} [Thu Jul 28 09:19:20 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:19:20.477351 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eadc6ee-a7a5-4705-ad47-bbe2d8b4d7f6 None admin] Authenticating user token {{(pid=479851) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:19:20.521723 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1415fe4-dd02-4a29-b03b-98009c70e20a None admin] Validating token access rules against request {{(pid=479852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:19:20.552698 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG dbcounter [-] [479852] Writing DB stats keystone:SELECT=100 {{(pid=479852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:19:20.561296 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714568fd-1723-4f1a-919d-9894ef95c19e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:19:20.561929 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714568fd-1723-4f1a-919d-9894ef95c19e None admin] REQUEST_METHOD: `GET` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:19:20.562210 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714568fd-1723-4f1a-919d-9894ef95c19e None admin] SCRIPT_NAME: `/identity` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:19:20.562483 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714568fd-1723-4f1a-919d-9894ef95c19e None admin] PATH_INFO: `/v3/domains` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:19:20.563192 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-714568fd-1723-4f1a-919d-9894ef95c19e None admin] RBAC: Adding query filter params (name=Default) {{(pid=479852) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 09:19:20.563499 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-714568fd-1723-4f1a-919d-9894ef95c19e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:19:20.564911 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-714568fd-1723-4f1a-919d-9894ef95c19e None admin] RBAC: Authorization granted {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:19:20.581539 dv-cinder-851351-1-smb devstack@keystone.service[479852]: [pid: 479852|app: 0|req: 332/657] 10.222.0.42 () {56 vars in 1109 bytes} [Thu Jul 28 09:19:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:19:20.581539 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714568fd-1723-4f1a-919d-9894ef95c19e None admin] Authenticating user token {{(pid=479852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:19:20.595764 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eadc6ee-a7a5-4705-ad47-bbe2d8b4d7f6 None admin] Validating token access rules against request {{(pid=479851) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:19:20.626031 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG dbcounter [-] [479851] Writing DB stats keystone:SELECT=100 {{(pid=479851) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:19:20.632408 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea78b908-d506-4e51-9148-80257ee06870 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479851) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:19:20.633491 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea78b908-d506-4e51-9148-80257ee06870 None admin] REQUEST_METHOD: `GET` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:19:20.633994 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea78b908-d506-4e51-9148-80257ee06870 None admin] SCRIPT_NAME: `/identity` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:19:20.634342 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea78b908-d506-4e51-9148-80257ee06870 None admin] PATH_INFO: `/v3/domains` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:19:20.635063 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea78b908-d506-4e51-9148-80257ee06870 None admin] RBAC: Adding query filter params (name=Default) {{(pid=479851) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 09:19:20.635569 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea78b908-d506-4e51-9148-80257ee06870 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:19:20.637214 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea78b908-d506-4e51-9148-80257ee06870 None admin] RBAC: Authorization granted {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:19:20.651536 dv-cinder-851351-1-smb devstack@keystone.service[479851]: [pid: 479851|app: 0|req: 326/658] 10.222.0.42 () {56 vars in 1109 bytes} [Thu Jul 28 09:19:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:19:20.652398 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea78b908-d506-4e51-9148-80257ee06870 None admin] Authenticating user token {{(pid=479851) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:19:20.682772 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714568fd-1723-4f1a-919d-9894ef95c19e None admin] Validating token access rules against request {{(pid=479852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:19:20.719233 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2a4040-6f30-4934-aa27-bfe7df2350c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:19:20.720192 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2a4040-6f30-4934-aa27-bfe7df2350c6 None admin] REQUEST_METHOD: `GET` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:19:20.720471 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2a4040-6f30-4934-aa27-bfe7df2350c6 None admin] SCRIPT_NAME: `/identity` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:19:20.720779 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2a4040-6f30-4934-aa27-bfe7df2350c6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:19:20.721591 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b2a4040-6f30-4934-aa27-bfe7df2350c6 None admin] RBAC: Adding query filter params (role.id=bd74dfcbc8d7412689d315fe24a1f247, scope.project.id=3a0fb8ea8010437bade8f92dcbcaacee, user.id=334c054f1e13456888926d8129f59f44) {{(pid=479852) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 09:19:20.721898 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b2a4040-6f30-4934-aa27-bfe7df2350c6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:19:20.723330 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b2a4040-6f30-4934-aa27-bfe7df2350c6 None admin] RBAC: Authorization granted {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:19:20.729421 dv-cinder-851351-1-smb devstack@keystone.service[479852]: [pid: 479852|app: 0|req: 333/659] 10.222.0.42 () {56 vars in 1374 bytes} [Thu Jul 28 09:19:20 2022] GET /identity/v3/role_assignments?user.id=334c054f1e13456888926d8129f59f44&scope.project.id=3a0fb8ea8010437bade8f92dcbcaacee&role.id=bd74dfcbc8d7412689d315fe24a1f247 => generated 608 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:19:20.730228 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2a4040-6f30-4934-aa27-bfe7df2350c6 None admin] Authenticating user token {{(pid=479852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:19:20.767030 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea78b908-d506-4e51-9148-80257ee06870 None admin] Validating token access rules against request {{(pid=479851) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:19:20.792645 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG dbcounter [-] [479852] Writing DB stats keystone:SELECT=100 {{(pid=479852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:19:20.809959 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43325917-47bf-4d14-9f77-2632975ddbc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479851) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:19:20.810902 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43325917-47bf-4d14-9f77-2632975ddbc8 None admin] REQUEST_METHOD: `GET` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:19:20.811382 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43325917-47bf-4d14-9f77-2632975ddbc8 None admin] SCRIPT_NAME: `/identity` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:19:20.811819 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43325917-47bf-4d14-9f77-2632975ddbc8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:19:20.850788 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2a4040-6f30-4934-aa27-bfe7df2350c6 None admin] Validating token access rules against request {{(pid=479852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:19:20.879526 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG dbcounter [-] [479851] Writing DB stats keystone:SELECT=100 {{(pid=479851) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:19:20.890877 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43325917-47bf-4d14-9f77-2632975ddbc8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:19:20.892018 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617be2f5-b971-479d-8d7f-9210c2d27e35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:19:20.892563 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43325917-47bf-4d14-9f77-2632975ddbc8 None admin] RBAC: Authorization granted {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:19:20.892862 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617be2f5-b971-479d-8d7f-9210c2d27e35 None admin] REQUEST_METHOD: `GET` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:19:20.893152 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617be2f5-b971-479d-8d7f-9210c2d27e35 None admin] SCRIPT_NAME: `/identity` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:19:20.893431 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617be2f5-b971-479d-8d7f-9210c2d27e35 None admin] PATH_INFO: `/v3/projects/service` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:19:20.902426 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-617be2f5-b971-479d-8d7f-9210c2d27e35 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:19:20.903589 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-617be2f5-b971-479d-8d7f-9210c2d27e35 None admin] RBAC: Authorization granted {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:19:20.916296 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application [None req-617be2f5-b971-479d-8d7f-9210c2d27e35 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 09:19:20.916296 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 09:19:20.916296 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 09:19:20.916296 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 09:19:20.916296 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 09:19:20.916296 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 09:19:20.916296 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 09:19:20.916296 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 09:19:20.916296 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 09:19:20.916296 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 09:19:20.916296 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 09:19:20.916296 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 09:19:20.916296 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 28 09:19:20.916296 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 28 09:19:20.916296 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 28 09:19:20.917577 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 28 09:19:20.917577 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 09:19:20.917577 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 09:19:20.917577 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 09:19:20.917577 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 09:19:20.917577 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 09:19:20.917577 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 09:19:20.917577 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 09:19:20.917577 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application with Lock( Jul 28 09:19:20.917577 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 09:19:20.917577 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self._enter() Jul 28 09:19:20.917577 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 09:19:20.917577 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 09:19:20.917577 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 09:19:20.917577 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self.creator() Jul 28 09:19:20.917577 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 09:19:20.917577 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application created_value = creator( Jul 28 09:19:20.918775 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 28 09:19:20.918775 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 28 09:19:20.918775 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 28 09:19:20.918775 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 28 09:19:20.918775 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 28 09:19:20.918775 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 28 09:19:20.918775 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 09:19:20.918775 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application Jul 28 09:19:20.920521 dv-cinder-851351-1-smb devstack@keystone.service[479852]: [pid: 479852|app: 0|req: 334/660] 10.222.0.42 () {56 vars in 1111 bytes} [Thu Jul 28 09:19:20 2022] GET /identity/v3/projects/service => generated 88 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 09:19:20.921975 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14163f5-673b-4fbe-9c41-39d9c838f771 None None] REQUEST_METHOD: `GET` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:19:20.922253 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14163f5-673b-4fbe-9c41-39d9c838f771 None None] SCRIPT_NAME: `/identity` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:19:20.922524 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14163f5-673b-4fbe-9c41-39d9c838f771 None None] PATH_INFO: `/` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:19:20.923922 dv-cinder-851351-1-smb devstack@keystone.service[479852]: [pid: 479852|app: 0|req: 335/661] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 09:19:20 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 09:19:20.924457 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14163f5-673b-4fbe-9c41-39d9c838f771 None None] Authenticating user token {{(pid=479852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:19:21.021026 dv-cinder-851351-1-smb devstack@keystone.service[479851]: [pid: 479851|app: 0|req: 327/662] 10.222.0.42 () {58 vars in 1282 bytes} [Thu Jul 28 09:19:20 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 369 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 28 09:19:21.022505 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43325917-47bf-4d14-9f77-2632975ddbc8 None admin] Authenticating user token {{(pid=479851) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:19:21.058259 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14163f5-673b-4fbe-9c41-39d9c838f771 None None] Validating token access rules against request {{(pid=479852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:19:21.073231 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG dbcounter [-] [479852] Writing DB stats keystone:SELECT=100 {{(pid=479852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:19:21.105275 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad38dab-d50f-42ed-841d-4cde050d1898 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:19:21.106003 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad38dab-d50f-42ed-841d-4cde050d1898 None admin] REQUEST_METHOD: `GET` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:19:21.106385 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad38dab-d50f-42ed-841d-4cde050d1898 None admin] SCRIPT_NAME: `/identity` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:19:21.106758 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad38dab-d50f-42ed-841d-4cde050d1898 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:19:21.117592 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ad38dab-d50f-42ed-841d-4cde050d1898 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:19:21.119418 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ad38dab-d50f-42ed-841d-4cde050d1898 None admin] RBAC: Authorization granted {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:19:21.125568 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG dbcounter [-] [479851] Writing DB stats keystone:SELECT=100 {{(pid=479851) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:19:21.134202 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application [None req-5ad38dab-d50f-42ed-841d-4cde050d1898 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jul 28 09:19:21.134202 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 09:19:21.134202 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 09:19:21.134202 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 09:19:21.134202 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 09:19:21.134202 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 09:19:21.134202 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 09:19:21.134202 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 09:19:21.134202 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 09:19:21.134202 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 09:19:21.134202 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 09:19:21.134202 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 09:19:21.134202 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 28 09:19:21.134202 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 28 09:19:21.134202 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 28 09:19:21.134202 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 28 09:19:21.135601 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 09:19:21.135601 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 09:19:21.135601 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 28 09:19:21.135601 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 09:19:21.135601 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 28 09:19:21.135601 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 09:19:21.135601 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 09:19:21.135601 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 09:19:21.135601 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 09:19:21.135601 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 09:19:21.135601 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 09:19:21.135601 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application with Lock( Jul 28 09:19:21.135601 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 09:19:21.135601 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self._enter() Jul 28 09:19:21.135601 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 09:19:21.135601 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 09:19:21.135601 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 09:19:21.135601 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self.creator() Jul 28 09:19:21.137046 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 09:19:21.137046 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application created_value = creator( Jul 28 09:19:21.137046 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 28 09:19:21.137046 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 28 09:19:21.137046 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 28 09:19:21.137046 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 28 09:19:21.137046 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 28 09:19:21.137046 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 28 09:19:21.137046 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jul 28 09:19:21.137046 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application Jul 28 09:19:21.137668 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43325917-47bf-4d14-9f77-2632975ddbc8 None admin] Validating token access rules against request {{(pid=479851) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:19:21.141363 dv-cinder-851351-1-smb devstack@keystone.service[479852]: [pid: 479852|app: 0|req: 336/663] 10.222.0.42 () {56 vars in 1102 bytes} [Thu Jul 28 09:19:20 2022] GET /identity/v3/users/neutron => generated 85 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 09:19:21.142838 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75a0ea9-f82e-4ca6-8473-1b4eb29287ec None None] REQUEST_METHOD: `POST` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:19:21.143135 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75a0ea9-f82e-4ca6-8473-1b4eb29287ec None None] SCRIPT_NAME: `/identity` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:19:21.143410 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75a0ea9-f82e-4ca6-8473-1b4eb29287ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:19:21.162397 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.auth.core [None req-b75a0ea9-f82e-4ca6-8473-1b4eb29287ec None None] MFA Rules not processed for user `c198f91a4ae84d2b9cc730a6e304c2be`. Rule list: `[]` (Enabled: `True`). {{(pid=479852) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 09:19:21.163623 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.fernet_utils [None req-b75a0ea9-f82e-4ca6-8473-1b4eb29287ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=479852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 09:19:21.173611 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-752c4553-7315-4084-9291-edcfac0482c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479851) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:19:21.174257 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752c4553-7315-4084-9291-edcfac0482c5 None admin] REQUEST_METHOD: `GET` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:19:21.174544 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752c4553-7315-4084-9291-edcfac0482c5 None admin] SCRIPT_NAME: `/identity` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:19:21.174820 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752c4553-7315-4084-9291-edcfac0482c5 None admin] PATH_INFO: `/v3/projects` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:19:21.175587 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-752c4553-7315-4084-9291-edcfac0482c5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=479851) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 09:19:21.175896 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-752c4553-7315-4084-9291-edcfac0482c5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:19:21.177477 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-752c4553-7315-4084-9291-edcfac0482c5 None admin] RBAC: Authorization granted {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:19:21.189889 dv-cinder-851351-1-smb devstack@keystone.service[479851]: [pid: 479851|app: 0|req: 328/664] 10.222.0.42 () {56 vars in 1148 bytes} [Thu Jul 28 09:19:21 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:19:21.190720 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-752c4553-7315-4084-9291-edcfac0482c5 None admin] Authenticating user token {{(pid=479851) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:19:21.242254 dv-cinder-851351-1-smb devstack@keystone.service[479852]: [pid: 479852|app: 0|req: 337/665] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 09:19:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 09:19:21.243585 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b75a0ea9-f82e-4ca6-8473-1b4eb29287ec None None] Authenticating user token {{(pid=479852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:19:21.306342 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-752c4553-7315-4084-9291-edcfac0482c5 None admin] Validating token access rules against request {{(pid=479851) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:19:21.343029 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5545f47-7fbd-41f9-9f75-99dcf7bafd6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479851) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:19:21.344107 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5545f47-7fbd-41f9-9f75-99dcf7bafd6b None admin] REQUEST_METHOD: `GET` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:19:21.344392 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5545f47-7fbd-41f9-9f75-99dcf7bafd6b None admin] SCRIPT_NAME: `/identity` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:19:21.344697 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5545f47-7fbd-41f9-9f75-99dcf7bafd6b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:19:21.356717 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5545f47-7fbd-41f9-9f75-99dcf7bafd6b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:19:21.358239 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5545f47-7fbd-41f9-9f75-99dcf7bafd6b None admin] RBAC: Authorization granted {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:19:21.369983 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b75a0ea9-f82e-4ca6-8473-1b4eb29287ec None None] Validating token access rules against request {{(pid=479852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:19:21.373983 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application [None req-f5545f47-7fbd-41f9-9f75-99dcf7bafd6b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 09:19:21.373983 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 09:19:21.373983 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 09:19:21.373983 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 09:19:21.373983 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 09:19:21.373983 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 09:19:21.373983 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 09:19:21.373983 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 09:19:21.373983 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 09:19:21.373983 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 09:19:21.373983 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 09:19:21.373983 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 09:19:21.373983 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 09:19:21.373983 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 09:19:21.373983 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 09:19:21.375084 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 09:19:21.375084 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 09:19:21.375084 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 09:19:21.375084 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 09:19:21.375084 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 09:19:21.375084 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 09:19:21.375084 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 09:19:21.375084 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 09:19:21.375084 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application with Lock( Jul 28 09:19:21.375084 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 09:19:21.375084 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return self._enter() Jul 28 09:19:21.375084 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 09:19:21.375084 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 09:19:21.375084 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 09:19:21.375084 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return self.creator() Jul 28 09:19:21.375084 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 09:19:21.375084 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application created_value = creator( Jul 28 09:19:21.376147 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 09:19:21.376147 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 09:19:21.376147 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 09:19:21.376147 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application Jul 28 09:19:21.379857 dv-cinder-851351-1-smb devstack@keystone.service[479851]: [pid: 479851|app: 0|req: 329/666] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 09:19:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 09:19:21.380908 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5545f47-7fbd-41f9-9f75-99dcf7bafd6b None admin] Authenticating user token {{(pid=479851) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:19:21.385484 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG dbcounter [-] [479851] Writing DB stats keystone:SELECT=100 {{(pid=479851) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:19:21.389393 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG dbcounter [-] [479852] Writing DB stats keystone:SELECT=100 {{(pid=479852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:19:21.419160 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c0e83b-316a-40bb-b509-5f5cb87095c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:19:21.420087 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c0e83b-316a-40bb-b509-5f5cb87095c7 None admin] REQUEST_METHOD: `GET` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:19:21.421302 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c0e83b-316a-40bb-b509-5f5cb87095c7 None admin] SCRIPT_NAME: `/identity` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:19:21.421591 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c0e83b-316a-40bb-b509-5f5cb87095c7 None admin] PATH_INFO: `/v3/users` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:19:21.422404 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c0e83b-316a-40bb-b509-5f5cb87095c7 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=479852) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 09:19:21.422715 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c0e83b-316a-40bb-b509-5f5cb87095c7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:19:21.424180 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c0e83b-316a-40bb-b509-5f5cb87095c7 None admin] RBAC: Authorization granted {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:19:21.451157 dv-cinder-851351-1-smb devstack@keystone.service[479852]: [pid: 479852|app: 0|req: 338/667] 10.222.0.42 () {56 vars in 1139 bytes} [Thu Jul 28 09:19:21 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:19:21.452240 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c0e83b-316a-40bb-b509-5f5cb87095c7 None admin] Authenticating user token {{(pid=479852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:19:21.495655 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5545f47-7fbd-41f9-9f75-99dcf7bafd6b None admin] Validating token access rules against request {{(pid=479851) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:19:21.532489 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53e0207-095b-478f-9ff4-08244c3a897a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479851) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:19:21.533436 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53e0207-095b-478f-9ff4-08244c3a897a None admin] REQUEST_METHOD: `GET` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:19:21.533900 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53e0207-095b-478f-9ff4-08244c3a897a None admin] SCRIPT_NAME: `/identity` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:19:21.534336 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53e0207-095b-478f-9ff4-08244c3a897a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:19:21.535309 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d53e0207-095b-478f-9ff4-08244c3a897a None admin] RBAC: Adding query filter params (role.id=bd74dfcbc8d7412689d315fe24a1f247, scope.project.id=3a0fb8ea8010437bade8f92dcbcaacee, user.id=c824cbfdc0dc4532ac6af71cbb6841fd) {{(pid=479851) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 09:19:21.535775 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d53e0207-095b-478f-9ff4-08244c3a897a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:19:21.537531 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d53e0207-095b-478f-9ff4-08244c3a897a None admin] RBAC: Authorization granted {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:19:21.553152 dv-cinder-851351-1-smb devstack@keystone.service[479851]: [pid: 479851|app: 0|req: 330/668] 10.222.0.42 () {56 vars in 1374 bytes} [Thu Jul 28 09:19:21 2022] GET /identity/v3/role_assignments?user.id=c824cbfdc0dc4532ac6af71cbb6841fd&scope.project.id=3a0fb8ea8010437bade8f92dcbcaacee&role.id=bd74dfcbc8d7412689d315fe24a1f247 => generated 608 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:19:21.554337 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53e0207-095b-478f-9ff4-08244c3a897a None admin] Authenticating user token {{(pid=479851) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:19:21.560188 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c0e83b-316a-40bb-b509-5f5cb87095c7 None admin] Validating token access rules against request {{(pid=479852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:19:21.601234 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d782d235-5ed3-4aa9-9a93-f4c6634f8e34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:19:21.602349 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d782d235-5ed3-4aa9-9a93-f4c6634f8e34 None admin] REQUEST_METHOD: `GET` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:19:21.602869 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d782d235-5ed3-4aa9-9a93-f4c6634f8e34 None admin] SCRIPT_NAME: `/identity` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:19:21.603362 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d782d235-5ed3-4aa9-9a93-f4c6634f8e34 None admin] PATH_INFO: `/v3/roles/service` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:19:21.616431 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d782d235-5ed3-4aa9-9a93-f4c6634f8e34 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 09:19:21.622313 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application [None req-d782d235-5ed3-4aa9-9a93-f4c6634f8e34 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 28 09:19:21.622313 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 09:19:21.622313 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 09:19:21.622313 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 09:19:21.622313 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 09:19:21.622313 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 09:19:21.622313 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 09:19:21.622313 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 09:19:21.622313 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 09:19:21.622313 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 09:19:21.622313 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 09:19:21.622313 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 09:19:21.622313 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 09:19:21.622313 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 09:19:21.622313 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 09:19:21.622313 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 09:19:21.623625 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 09:19:21.623625 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 09:19:21.623625 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 09:19:21.623625 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 09:19:21.623625 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 09:19:21.623625 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 09:19:21.623625 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 09:19:21.623625 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 09:19:21.623625 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 09:19:21.623625 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 09:19:21.623625 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 09:19:21.623625 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application with Lock( Jul 28 09:19:21.623625 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 09:19:21.623625 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self._enter() Jul 28 09:19:21.623625 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 09:19:21.623625 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 09:19:21.624618 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 09:19:21.624618 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self.creator() Jul 28 09:19:21.624618 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 09:19:21.624618 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application created_value = creator( Jul 28 09:19:21.624618 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 09:19:21.624618 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 09:19:21.624618 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 09:19:21.624618 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 09:19:21.624618 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 09:19:21.624618 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 09:19:21.624618 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 28 09:19:21.624618 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application Jul 28 09:19:21.627289 dv-cinder-851351-1-smb devstack@keystone.service[479852]: [pid: 479852|app: 0|req: 339/669] 10.222.0.42 () {56 vars in 1102 bytes} [Thu Jul 28 09:19:21 2022] GET /identity/v3/roles/service => generated 85 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 09:19:21.628351 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d782d235-5ed3-4aa9-9a93-f4c6634f8e34 None admin] Authenticating user token {{(pid=479852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:19:21.633961 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG dbcounter [-] [479851] Writing DB stats keystone:SELECT=100 {{(pid=479851) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:19:21.655219 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG dbcounter [-] [479852] Writing DB stats keystone:SELECT=100 {{(pid=479852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:19:21.678225 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53e0207-095b-478f-9ff4-08244c3a897a None admin] Validating token access rules against request {{(pid=479851) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:19:21.720482 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf016ba8-64ff-4986-bce3-fab8e262da35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479851) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:19:21.721488 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf016ba8-64ff-4986-bce3-fab8e262da35 None admin] REQUEST_METHOD: `GET` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:19:21.721928 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf016ba8-64ff-4986-bce3-fab8e262da35 None admin] SCRIPT_NAME: `/identity` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:19:21.722480 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf016ba8-64ff-4986-bce3-fab8e262da35 None admin] PATH_INFO: `/v3/domains` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:19:21.723372 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf016ba8-64ff-4986-bce3-fab8e262da35 None admin] RBAC: Adding query filter params (name=Default) {{(pid=479851) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 09:19:21.723914 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf016ba8-64ff-4986-bce3-fab8e262da35 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:19:21.725558 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf016ba8-64ff-4986-bce3-fab8e262da35 None admin] RBAC: Authorization granted {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:19:21.738465 dv-cinder-851351-1-smb devstack@keystone.service[479851]: [pid: 479851|app: 0|req: 331/670] 10.222.0.42 () {56 vars in 1109 bytes} [Thu Jul 28 09:19:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:19:21.739154 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf016ba8-64ff-4986-bce3-fab8e262da35 None admin] Authenticating user token {{(pid=479851) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:19:21.747169 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d782d235-5ed3-4aa9-9a93-f4c6634f8e34 None admin] Validating token access rules against request {{(pid=479852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:19:21.791768 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b783fb18-9bf3-46e9-b4f9-1ca9278259cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:19:21.792431 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b783fb18-9bf3-46e9-b4f9-1ca9278259cf None admin] REQUEST_METHOD: `GET` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:19:21.792745 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b783fb18-9bf3-46e9-b4f9-1ca9278259cf None admin] SCRIPT_NAME: `/identity` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:19:21.793300 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b783fb18-9bf3-46e9-b4f9-1ca9278259cf None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:19:21.875473 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf016ba8-64ff-4986-bce3-fab8e262da35 None admin] Validating token access rules against request {{(pid=479851) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:19:21.892200 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b783fb18-9bf3-46e9-b4f9-1ca9278259cf None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:19:21.894390 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b783fb18-9bf3-46e9-b4f9-1ca9278259cf None admin] RBAC: Authorization granted {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:19:21.906645 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG dbcounter [-] [479851] Writing DB stats keystone:SELECT=100 {{(pid=479851) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:19:21.915644 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f95a35a-ec69-4101-a2b6-86aa3a490eea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479851) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:19:21.916283 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f95a35a-ec69-4101-a2b6-86aa3a490eea None admin] REQUEST_METHOD: `GET` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:19:21.916569 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f95a35a-ec69-4101-a2b6-86aa3a490eea None admin] SCRIPT_NAME: `/identity` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:19:21.916880 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f95a35a-ec69-4101-a2b6-86aa3a490eea None admin] PATH_INFO: `/v3/roles` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:19:21.917770 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f95a35a-ec69-4101-a2b6-86aa3a490eea None admin] RBAC: Adding query filter params (name=service) {{(pid=479851) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 09:19:21.917911 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f95a35a-ec69-4101-a2b6-86aa3a490eea None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:19:21.919401 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f95a35a-ec69-4101-a2b6-86aa3a490eea None admin] RBAC: Authorization granted {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:19:21.929122 dv-cinder-851351-1-smb devstack@keystone.service[479851]: [pid: 479851|app: 0|req: 332/671] 10.222.0.42 () {56 vars in 1103 bytes} [Thu Jul 28 09:19:21 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:19:21.929354 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG dbcounter [-] [479852] Writing DB stats keystone:SELECT=100 {{(pid=479852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:19:21.929980 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f95a35a-ec69-4101-a2b6-86aa3a490eea None admin] Authenticating user token {{(pid=479851) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:19:22.019630 dv-cinder-851351-1-smb devstack@keystone.service[479852]: [pid: 479852|app: 0|req: 340/672] 10.222.0.42 () {58 vars in 1282 bytes} [Thu Jul 28 09:19:21 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 391 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 28 09:19:22.020595 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b783fb18-9bf3-46e9-b4f9-1ca9278259cf None admin] Authenticating user token {{(pid=479852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:19:22.063995 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f95a35a-ec69-4101-a2b6-86aa3a490eea None admin] Validating token access rules against request {{(pid=479851) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:19:22.105212 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8788aa0-10f8-4b61-b5be-f5584d72cd41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479851) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:19:22.105889 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8788aa0-10f8-4b61-b5be-f5584d72cd41 None admin] REQUEST_METHOD: `GET` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:19:22.106228 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8788aa0-10f8-4b61-b5be-f5584d72cd41 None admin] SCRIPT_NAME: `/identity` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:19:22.106514 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8788aa0-10f8-4b61-b5be-f5584d72cd41 None admin] PATH_INFO: `/v3/projects/service` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:19:22.114769 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8788aa0-10f8-4b61-b5be-f5584d72cd41 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:19:22.116645 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8788aa0-10f8-4b61-b5be-f5584d72cd41 None admin] RBAC: Authorization granted {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:19:22.129900 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application [None req-d8788aa0-10f8-4b61-b5be-f5584d72cd41 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 09:19:22.129900 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 09:19:22.129900 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 09:19:22.129900 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 09:19:22.129900 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 09:19:22.129900 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 09:19:22.129900 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 09:19:22.129900 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 09:19:22.129900 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 09:19:22.129900 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 09:19:22.129900 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 09:19:22.129900 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 09:19:22.129900 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 28 09:19:22.129900 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 28 09:19:22.129900 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 28 09:19:22.131073 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 28 09:19:22.131073 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 09:19:22.131073 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 09:19:22.131073 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 09:19:22.131073 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 09:19:22.131073 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 09:19:22.131073 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 09:19:22.131073 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 09:19:22.131073 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application with Lock( Jul 28 09:19:22.131073 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 09:19:22.131073 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return self._enter() Jul 28 09:19:22.131073 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 09:19:22.131073 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 09:19:22.131073 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 09:19:22.131073 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return self.creator() Jul 28 09:19:22.131073 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 09:19:22.131073 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application created_value = creator( Jul 28 09:19:22.132151 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 28 09:19:22.132151 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 28 09:19:22.132151 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 28 09:19:22.132151 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 28 09:19:22.132151 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 28 09:19:22.132151 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 28 09:19:22.132151 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 09:19:22.132151 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application Jul 28 09:19:22.132151 dv-cinder-851351-1-smb devstack@keystone.service[479851]: [pid: 479851|app: 0|req: 333/673] 10.222.0.42 () {56 vars in 1111 bytes} [Thu Jul 28 09:19:21 2022] GET /identity/v3/projects/service => generated 88 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 09:19:22.132786 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8788aa0-10f8-4b61-b5be-f5584d72cd41 None admin] Authenticating user token {{(pid=479851) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:19:22.161630 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b783fb18-9bf3-46e9-b4f9-1ca9278259cf None admin] Validating token access rules against request {{(pid=479852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:19:22.187742 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG dbcounter [-] [479852] Writing DB stats keystone:SELECT=100 {{(pid=479852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:19:22.191633 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG dbcounter [-] [479851] Writing DB stats keystone:SELECT=100 {{(pid=479851) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:19:22.207411 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c713571-dc60-4183-bcce-1d87c41f1aba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:19:22.208355 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c713571-dc60-4183-bcce-1d87c41f1aba None admin] REQUEST_METHOD: `GET` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:19:22.208766 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c713571-dc60-4183-bcce-1d87c41f1aba None admin] SCRIPT_NAME: `/identity` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:19:22.209168 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c713571-dc60-4183-bcce-1d87c41f1aba None admin] PATH_INFO: `/v3/domains/Default` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:19:22.221296 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c713571-dc60-4183-bcce-1d87c41f1aba None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:19:22.222992 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c713571-dc60-4183-bcce-1d87c41f1aba None admin] RBAC: Authorization granted {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:19:22.239843 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application [None req-9c713571-dc60-4183-bcce-1d87c41f1aba None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 09:19:22.239843 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 09:19:22.239843 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 09:19:22.239843 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 09:19:22.239843 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 09:19:22.239843 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 09:19:22.239843 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 09:19:22.239843 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 09:19:22.239843 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 09:19:22.239843 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 09:19:22.239843 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 09:19:22.239843 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 09:19:22.239843 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 09:19:22.239843 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 09:19:22.239843 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 09:19:22.241186 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 09:19:22.241186 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 09:19:22.241186 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 09:19:22.241186 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 09:19:22.241186 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 09:19:22.241186 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 09:19:22.241186 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 09:19:22.241186 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 09:19:22.241186 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application with Lock( Jul 28 09:19:22.241186 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 09:19:22.241186 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self._enter() Jul 28 09:19:22.241186 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 09:19:22.241186 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 09:19:22.241186 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 09:19:22.241186 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self.creator() Jul 28 09:19:22.241186 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 09:19:22.241186 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application created_value = creator( Jul 28 09:19:22.242490 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 09:19:22.242490 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 09:19:22.242490 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 09:19:22.242490 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application Jul 28 09:19:22.243880 dv-cinder-851351-1-smb devstack@keystone.service[479852]: [pid: 479852|app: 0|req: 341/674] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 09:19:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 09:19:22.245012 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c713571-dc60-4183-bcce-1d87c41f1aba None admin] Authenticating user token {{(pid=479852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:19:22.260388 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8788aa0-10f8-4b61-b5be-f5584d72cd41 None admin] Validating token access rules against request {{(pid=479851) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:19:22.303954 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a913af01-79c7-4eac-9a24-1b604c4a4587 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479851) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:19:22.305415 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a913af01-79c7-4eac-9a24-1b604c4a4587 None admin] REQUEST_METHOD: `GET` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:19:22.305901 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a913af01-79c7-4eac-9a24-1b604c4a4587 None admin] SCRIPT_NAME: `/identity` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:19:22.306498 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a913af01-79c7-4eac-9a24-1b604c4a4587 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:19:22.322953 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a913af01-79c7-4eac-9a24-1b604c4a4587 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:19:22.325547 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a913af01-79c7-4eac-9a24-1b604c4a4587 None admin] RBAC: Authorization granted {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:19:22.347598 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application [None req-a913af01-79c7-4eac-9a24-1b604c4a4587 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 09:19:22.347598 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 09:19:22.347598 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 09:19:22.347598 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 09:19:22.347598 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 09:19:22.347598 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 09:19:22.347598 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 09:19:22.347598 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 09:19:22.347598 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 09:19:22.347598 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 09:19:22.347598 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 09:19:22.347598 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 09:19:22.347598 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 09:19:22.347598 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 09:19:22.347598 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 09:19:22.348784 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 09:19:22.348784 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 09:19:22.348784 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 09:19:22.348784 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 09:19:22.348784 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 09:19:22.348784 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 09:19:22.348784 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 09:19:22.348784 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 09:19:22.348784 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application with Lock( Jul 28 09:19:22.348784 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 09:19:22.348784 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return self._enter() Jul 28 09:19:22.348784 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 09:19:22.348784 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 09:19:22.348784 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 09:19:22.348784 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return self.creator() Jul 28 09:19:22.348784 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 09:19:22.348784 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application created_value = creator( Jul 28 09:19:22.350027 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 09:19:22.350027 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 09:19:22.350027 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 09:19:22.350027 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application Jul 28 09:19:22.351159 dv-cinder-851351-1-smb devstack@keystone.service[479851]: [pid: 479851|app: 0|req: 334/675] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 09:19:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 09:19:22.351398 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a913af01-79c7-4eac-9a24-1b604c4a4587 None admin] Authenticating user token {{(pid=479851) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:19:22.361585 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c713571-dc60-4183-bcce-1d87c41f1aba None admin] Validating token access rules against request {{(pid=479852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:19:22.406517 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375894e7-144c-470e-aa50-2f4c199936be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:19:22.407180 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375894e7-144c-470e-aa50-2f4c199936be None admin] REQUEST_METHOD: `GET` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:19:22.407462 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375894e7-144c-470e-aa50-2f4c199936be None admin] SCRIPT_NAME: `/identity` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:19:22.407740 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375894e7-144c-470e-aa50-2f4c199936be None admin] PATH_INFO: `/v3/projects` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:19:22.408509 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-375894e7-144c-470e-aa50-2f4c199936be None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=479852) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 09:19:22.408850 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-375894e7-144c-470e-aa50-2f4c199936be None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:19:22.410327 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-375894e7-144c-470e-aa50-2f4c199936be None admin] RBAC: Authorization granted {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:19:22.424937 dv-cinder-851351-1-smb devstack@keystone.service[479852]: [pid: 479852|app: 0|req: 342/676] 10.222.0.42 () {56 vars in 1148 bytes} [Thu Jul 28 09:19:22 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:19:22.425920 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375894e7-144c-470e-aa50-2f4c199936be None admin] Authenticating user token {{(pid=479852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:19:22.461251 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG dbcounter [-] [479852] Writing DB stats keystone:SELECT=100 {{(pid=479852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:19:22.498615 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a913af01-79c7-4eac-9a24-1b604c4a4587 None admin] Validating token access rules against request {{(pid=479851) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:19:22.500629 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG dbcounter [-] [479851] Writing DB stats keystone:SELECT=100 {{(pid=479851) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:19:22.539513 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec1a3f3-890c-478a-9129-765c04f486e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479851) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:19:22.539747 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375894e7-144c-470e-aa50-2f4c199936be None admin] Validating token access rules against request {{(pid=479852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:19:22.540709 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec1a3f3-890c-478a-9129-765c04f486e1 None admin] REQUEST_METHOD: `GET` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:19:22.541339 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec1a3f3-890c-478a-9129-765c04f486e1 None admin] SCRIPT_NAME: `/identity` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:19:22.541856 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec1a3f3-890c-478a-9129-765c04f486e1 None admin] PATH_INFO: `/v3/domains` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:19:22.542845 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ec1a3f3-890c-478a-9129-765c04f486e1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=479851) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 09:19:22.543403 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ec1a3f3-890c-478a-9129-765c04f486e1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:19:22.545063 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ec1a3f3-890c-478a-9129-765c04f486e1 None admin] RBAC: Authorization granted {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:19:22.559388 dv-cinder-851351-1-smb devstack@keystone.service[479851]: [pid: 479851|app: 0|req: 335/677] 10.222.0.42 () {56 vars in 1109 bytes} [Thu Jul 28 09:19:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:19:22.560856 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec1a3f3-890c-478a-9129-765c04f486e1 None admin] Authenticating user token {{(pid=479851) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:19:22.577908 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e14f217-01b0-4093-a0a2-7c9e24456282 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:19:22.578593 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e14f217-01b0-4093-a0a2-7c9e24456282 None admin] REQUEST_METHOD: `GET` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:19:22.578882 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e14f217-01b0-4093-a0a2-7c9e24456282 None admin] SCRIPT_NAME: `/identity` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:19:22.579160 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e14f217-01b0-4093-a0a2-7c9e24456282 None admin] PATH_INFO: `/v3/domains` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:19:22.579872 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e14f217-01b0-4093-a0a2-7c9e24456282 None admin] RBAC: Adding query filter params (name=Default) {{(pid=479852) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 09:19:22.580179 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e14f217-01b0-4093-a0a2-7c9e24456282 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:19:22.581653 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e14f217-01b0-4093-a0a2-7c9e24456282 None admin] RBAC: Authorization granted {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:19:22.594663 dv-cinder-851351-1-smb devstack@keystone.service[479852]: [pid: 479852|app: 0|req: 343/678] 10.222.0.42 () {56 vars in 1109 bytes} [Thu Jul 28 09:19:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:19:22.595646 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e14f217-01b0-4093-a0a2-7c9e24456282 None admin] Authenticating user token {{(pid=479852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:19:22.676191 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec1a3f3-890c-478a-9129-765c04f486e1 None admin] Validating token access rules against request {{(pid=479851) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:19:22.696148 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG dbcounter [-] [479852] Writing DB stats keystone:SELECT=100 {{(pid=479852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:19:22.707562 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e14f217-01b0-4093-a0a2-7c9e24456282 None admin] Validating token access rules against request {{(pid=479852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:19:22.716285 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97783ffc-faea-44d0-a3f9-f432c24aad3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479851) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:19:22.717313 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97783ffc-faea-44d0-a3f9-f432c24aad3c None admin] REQUEST_METHOD: `GET` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:19:22.717861 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97783ffc-faea-44d0-a3f9-f432c24aad3c None admin] SCRIPT_NAME: `/identity` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:19:22.718366 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97783ffc-faea-44d0-a3f9-f432c24aad3c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:19:22.719441 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97783ffc-faea-44d0-a3f9-f432c24aad3c None admin] RBAC: Adding query filter params (role.id=bd74dfcbc8d7412689d315fe24a1f247, scope.project.id=3a0fb8ea8010437bade8f92dcbcaacee, user.id=754c4e4857fd440dbc2b7e59c8196db6) {{(pid=479851) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 09:19:22.720148 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97783ffc-faea-44d0-a3f9-f432c24aad3c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:19:22.722026 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97783ffc-faea-44d0-a3f9-f432c24aad3c None admin] RBAC: Authorization granted {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:19:22.729202 dv-cinder-851351-1-smb devstack@keystone.service[479851]: [pid: 479851|app: 0|req: 336/679] 10.222.0.42 () {56 vars in 1374 bytes} [Thu Jul 28 09:19:22 2022] GET /identity/v3/role_assignments?user.id=754c4e4857fd440dbc2b7e59c8196db6&scope.project.id=3a0fb8ea8010437bade8f92dcbcaacee&role.id=bd74dfcbc8d7412689d315fe24a1f247 => generated 608 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:19:22.730437 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97783ffc-faea-44d0-a3f9-f432c24aad3c None admin] Authenticating user token {{(pid=479851) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:19:22.746014 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961f214c-f420-491e-bdf4-ded361c8783d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:19:22.746644 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961f214c-f420-491e-bdf4-ded361c8783d None admin] REQUEST_METHOD: `GET` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:19:22.746914 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961f214c-f420-491e-bdf4-ded361c8783d None admin] SCRIPT_NAME: `/identity` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:19:22.747234 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961f214c-f420-491e-bdf4-ded361c8783d None admin] PATH_INFO: `/v3/users/swift` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:19:22.756721 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-961f214c-f420-491e-bdf4-ded361c8783d None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:19:22.758366 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-961f214c-f420-491e-bdf4-ded361c8783d None admin] RBAC: Authorization granted {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:19:22.765765 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG dbcounter [-] [479851] Writing DB stats keystone:SELECT=100 {{(pid=479851) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:19:22.773198 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application [None req-961f214c-f420-491e-bdf4-ded361c8783d None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 28 09:19:22.773198 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 09:19:22.773198 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 09:19:22.773198 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 09:19:22.773198 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 09:19:22.773198 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 09:19:22.773198 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 09:19:22.773198 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 09:19:22.773198 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 09:19:22.773198 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 09:19:22.773198 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 09:19:22.773198 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 09:19:22.773198 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 28 09:19:22.773198 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 28 09:19:22.773198 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 28 09:19:22.773198 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 28 09:19:22.774393 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 09:19:22.774393 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 09:19:22.774393 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 28 09:19:22.774393 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 09:19:22.774393 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 28 09:19:22.774393 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 09:19:22.774393 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 09:19:22.774393 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 09:19:22.774393 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 09:19:22.774393 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 09:19:22.774393 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 09:19:22.774393 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application with Lock( Jul 28 09:19:22.774393 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 09:19:22.774393 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self._enter() Jul 28 09:19:22.774393 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 09:19:22.774393 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 09:19:22.774393 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 09:19:22.774393 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self.creator() Jul 28 09:19:22.775524 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 09:19:22.775524 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application created_value = creator( Jul 28 09:19:22.775524 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 28 09:19:22.775524 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 28 09:19:22.775524 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 28 09:19:22.775524 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 28 09:19:22.775524 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 28 09:19:22.775524 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 28 09:19:22.775524 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 28 09:19:22.775524 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application Jul 28 09:19:22.775524 dv-cinder-851351-1-smb devstack@keystone.service[479852]: [pid: 479852|app: 0|req: 344/680] 10.222.0.42 () {56 vars in 1096 bytes} [Thu Jul 28 09:19:22 2022] GET /identity/v3/users/swift => generated 83 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 09:19:22.780644 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961f214c-f420-491e-bdf4-ded361c8783d None admin] Authenticating user token {{(pid=479852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:19:22.923172 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97783ffc-faea-44d0-a3f9-f432c24aad3c None admin] Validating token access rules against request {{(pid=479851) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:19:22.933811 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961f214c-f420-491e-bdf4-ded361c8783d None admin] Validating token access rules against request {{(pid=479852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:19:22.965985 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3aca02-50f5-433c-8bdf-5cff0a67da88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479851) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:19:22.967085 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3aca02-50f5-433c-8bdf-5cff0a67da88 None admin] REQUEST_METHOD: `GET` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:19:22.967608 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3aca02-50f5-433c-8bdf-5cff0a67da88 None admin] SCRIPT_NAME: `/identity` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:19:22.968102 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3aca02-50f5-433c-8bdf-5cff0a67da88 None admin] PATH_INFO: `/v3/projects/service` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:19:22.975512 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d26113-4fb9-474b-b89f-be2a82cd4249 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:19:22.976196 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d26113-4fb9-474b-b89f-be2a82cd4249 None admin] REQUEST_METHOD: `GET` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:19:22.976482 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d26113-4fb9-474b-b89f-be2a82cd4249 None admin] SCRIPT_NAME: `/identity` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:19:22.976786 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d26113-4fb9-474b-b89f-be2a82cd4249 None admin] PATH_INFO: `/v3/users` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:19:22.977636 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d26113-4fb9-474b-b89f-be2a82cd4249 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=479852) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 09:19:22.977969 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d26113-4fb9-474b-b89f-be2a82cd4249 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:19:22.979306 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f3aca02-50f5-433c-8bdf-5cff0a67da88 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:19:22.979434 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d26113-4fb9-474b-b89f-be2a82cd4249 None admin] RBAC: Authorization granted {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:19:22.981163 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f3aca02-50f5-433c-8bdf-5cff0a67da88 None admin] RBAC: Authorization granted {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:19:22.994036 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application [None req-0f3aca02-50f5-433c-8bdf-5cff0a67da88 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 09:19:22.994036 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 09:19:22.994036 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 09:19:22.994036 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 09:19:22.994036 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 09:19:22.994036 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 09:19:22.994036 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 09:19:22.994036 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 09:19:22.994036 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 09:19:22.994036 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 09:19:22.994036 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 09:19:22.994036 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 09:19:22.994036 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 28 09:19:22.994036 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 28 09:19:22.994036 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 28 09:19:22.995152 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 28 09:19:22.995152 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 09:19:22.995152 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 09:19:22.995152 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 09:19:22.995152 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 09:19:22.995152 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 09:19:22.995152 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 09:19:22.995152 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 09:19:22.995152 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application with Lock( Jul 28 09:19:22.995152 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 09:19:22.995152 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return self._enter() Jul 28 09:19:22.995152 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 09:19:22.995152 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 09:19:22.995152 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 09:19:22.995152 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return self.creator() Jul 28 09:19:22.995152 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 09:19:22.995152 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application created_value = creator( Jul 28 09:19:22.996218 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 28 09:19:22.996218 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 28 09:19:22.996218 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 28 09:19:22.996218 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 28 09:19:22.996218 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 28 09:19:22.996218 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 28 09:19:22.996218 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 09:19:22.996218 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application Jul 28 09:19:22.998924 dv-cinder-851351-1-smb devstack@keystone.service[479851]: [pid: 479851|app: 0|req: 337/681] 10.222.0.42 () {56 vars in 1111 bytes} [Thu Jul 28 09:19:22 2022] GET /identity/v3/projects/service => generated 88 bytes in 269 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 09:19:23.000596 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba15eac-59bd-447a-970e-0c1212f08fe5 None None] REQUEST_METHOD: `GET` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:19:23.001178 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba15eac-59bd-447a-970e-0c1212f08fe5 None None] SCRIPT_NAME: `/identity` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:19:23.001671 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba15eac-59bd-447a-970e-0c1212f08fe5 None None] PATH_INFO: `/` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:19:23.003487 dv-cinder-851351-1-smb devstack@keystone.service[479851]: [pid: 479851|app: 0|req: 338/683] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 09:19:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 09:19:23.006927 dv-cinder-851351-1-smb devstack@keystone.service[479852]: [pid: 479852|app: 0|req: 345/683] 10.222.0.42 () {56 vars in 1135 bytes} [Thu Jul 28 09:19:22 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:19:23.008345 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba15eac-59bd-447a-970e-0c1212f08fe5 None None] Authenticating user token {{(pid=479851) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:19:23.008945 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5b9ccc-3cee-43ad-8398-50401e9e58e2 None None] REQUEST_METHOD: `POST` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:19:23.009276 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5b9ccc-3cee-43ad-8398-50401e9e58e2 None None] SCRIPT_NAME: `/identity` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:19:23.009504 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5b9ccc-3cee-43ad-8398-50401e9e58e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:19:23.032066 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.auth.core [None req-fe5b9ccc-3cee-43ad-8398-50401e9e58e2 None None] MFA Rules not processed for user `c198f91a4ae84d2b9cc730a6e304c2be`. Rule list: `[]` (Enabled: `True`). {{(pid=479852) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 09:19:23.032820 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.fernet_utils [None req-fe5b9ccc-3cee-43ad-8398-50401e9e58e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=479852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 09:19:23.038213 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG dbcounter [-] [479852] Writing DB stats keystone:SELECT=100 {{(pid=479852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:19:23.120940 dv-cinder-851351-1-smb devstack@keystone.service[479852]: [pid: 479852|app: 0|req: 346/684] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 09:19:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 09:19:23.124752 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe5b9ccc-3cee-43ad-8398-50401e9e58e2 None None] Authenticating user token {{(pid=479852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:19:23.132409 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG dbcounter [-] [479851] Writing DB stats keystone:SELECT=100 {{(pid=479851) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:19:23.153662 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba15eac-59bd-447a-970e-0c1212f08fe5 None None] Validating token access rules against request {{(pid=479851) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:19:23.202405 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d7800e-6fd2-432d-b384-e142c97507e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479851) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:19:23.202996 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d7800e-6fd2-432d-b384-e142c97507e9 None admin] REQUEST_METHOD: `GET` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:19:23.203341 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d7800e-6fd2-432d-b384-e142c97507e9 None admin] SCRIPT_NAME: `/identity` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:19:23.203629 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d7800e-6fd2-432d-b384-e142c97507e9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:19:23.259058 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe5b9ccc-3cee-43ad-8398-50401e9e58e2 None None] Validating token access rules against request {{(pid=479852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:19:23.284291 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5d7800e-6fd2-432d-b384-e142c97507e9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:19:23.285998 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5d7800e-6fd2-432d-b384-e142c97507e9 None admin] RBAC: Authorization granted {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:19:23.296745 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e41177e-bef9-44ba-bbc2-9f140814db45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:19:23.297785 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e41177e-bef9-44ba-bbc2-9f140814db45 None admin] REQUEST_METHOD: `GET` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:19:23.298304 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e41177e-bef9-44ba-bbc2-9f140814db45 None admin] SCRIPT_NAME: `/identity` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:19:23.298782 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e41177e-bef9-44ba-bbc2-9f140814db45 None admin] PATH_INFO: `/v3/projects` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:19:23.299775 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e41177e-bef9-44ba-bbc2-9f140814db45 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=479852) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 09:19:23.300301 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e41177e-bef9-44ba-bbc2-9f140814db45 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:19:23.302058 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e41177e-bef9-44ba-bbc2-9f140814db45 None admin] RBAC: Authorization granted {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:19:23.311944 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG dbcounter [-] [479852] Writing DB stats keystone:SELECT=100 {{(pid=479852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:19:23.321582 dv-cinder-851351-1-smb devstack@keystone.service[479852]: [pid: 479852|app: 0|req: 347/685] 10.222.0.42 () {56 vars in 1148 bytes} [Thu Jul 28 09:19:23 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:19:23.322928 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e41177e-bef9-44ba-bbc2-9f140814db45 None admin] Authenticating user token {{(pid=479852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:19:23.391527 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG dbcounter [-] [479851] Writing DB stats keystone:SELECT=100 {{(pid=479851) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:19:23.411473 dv-cinder-851351-1-smb devstack@keystone.service[479851]: [pid: 479851|app: 0|req: 339/686] 10.222.0.42 () {58 vars in 1282 bytes} [Thu Jul 28 09:19:23 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 403 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 28 09:19:23.412450 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d7800e-6fd2-432d-b384-e142c97507e9 None admin] Authenticating user token {{(pid=479851) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:19:23.463528 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e41177e-bef9-44ba-bbc2-9f140814db45 None admin] Validating token access rules against request {{(pid=479852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:19:23.513071 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a00359-e046-4a1a-9c51-0c8c7b19af82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:19:23.513756 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a00359-e046-4a1a-9c51-0c8c7b19af82 None admin] REQUEST_METHOD: `GET` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:19:23.514045 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a00359-e046-4a1a-9c51-0c8c7b19af82 None admin] SCRIPT_NAME: `/identity` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:19:23.514321 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a00359-e046-4a1a-9c51-0c8c7b19af82 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:19:23.530426 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a00359-e046-4a1a-9c51-0c8c7b19af82 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:19:23.530686 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d7800e-6fd2-432d-b384-e142c97507e9 None admin] Validating token access rules against request {{(pid=479851) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:19:23.532187 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a00359-e046-4a1a-9c51-0c8c7b19af82 None admin] RBAC: Authorization granted {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:19:23.552942 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application [None req-24a00359-e046-4a1a-9c51-0c8c7b19af82 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 09:19:23.552942 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 09:19:23.552942 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 09:19:23.552942 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 09:19:23.552942 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 09:19:23.552942 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 09:19:23.552942 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 09:19:23.552942 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 09:19:23.552942 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 09:19:23.552942 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 09:19:23.552942 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 09:19:23.552942 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 09:19:23.552942 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 09:19:23.552942 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 09:19:23.552942 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 09:19:23.554066 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 09:19:23.554066 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 09:19:23.554066 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 09:19:23.554066 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 09:19:23.554066 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 09:19:23.554066 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 09:19:23.554066 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 09:19:23.554066 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 09:19:23.554066 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application with Lock( Jul 28 09:19:23.554066 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 09:19:23.554066 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self._enter() Jul 28 09:19:23.554066 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 09:19:23.554066 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 09:19:23.554066 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 09:19:23.554066 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self.creator() Jul 28 09:19:23.554066 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 09:19:23.554066 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application created_value = creator( Jul 28 09:19:23.555096 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 09:19:23.555096 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 09:19:23.555096 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 09:19:23.555096 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application Jul 28 09:19:23.555096 dv-cinder-851351-1-smb devstack@keystone.service[479852]: [pid: 479852|app: 0|req: 348/687] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 09:19:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 09:19:23.560539 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a00359-e046-4a1a-9c51-0c8c7b19af82 None admin] Authenticating user token {{(pid=479852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:19:23.572047 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1cde5e-862c-43b9-abe5-ae371f1c1be9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479851) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:19:23.572777 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1cde5e-862c-43b9-abe5-ae371f1c1be9 None admin] REQUEST_METHOD: `GET` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:19:23.573074 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1cde5e-862c-43b9-abe5-ae371f1c1be9 None admin] SCRIPT_NAME: `/identity` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:19:23.573351 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1cde5e-862c-43b9-abe5-ae371f1c1be9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:19:23.574235 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f1cde5e-862c-43b9-abe5-ae371f1c1be9 None admin] RBAC: Adding query filter params (role.id=bd74dfcbc8d7412689d315fe24a1f247, scope.project.id=3a0fb8ea8010437bade8f92dcbcaacee, user.id=e86286d4286c4a92bb581148d91a3b01) {{(pid=479851) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 09:19:23.574563 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f1cde5e-862c-43b9-abe5-ae371f1c1be9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:19:23.576157 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f1cde5e-862c-43b9-abe5-ae371f1c1be9 None admin] RBAC: Authorization granted {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:19:23.586902 dv-cinder-851351-1-smb devstack@keystone.service[479851]: [pid: 479851|app: 0|req: 340/688] 10.222.0.42 () {56 vars in 1374 bytes} [Thu Jul 28 09:19:23 2022] GET /identity/v3/role_assignments?user.id=e86286d4286c4a92bb581148d91a3b01&scope.project.id=3a0fb8ea8010437bade8f92dcbcaacee&role.id=bd74dfcbc8d7412689d315fe24a1f247 => generated 608 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:19:23.587995 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1cde5e-862c-43b9-abe5-ae371f1c1be9 None admin] Authenticating user token {{(pid=479851) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:19:23.624748 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG dbcounter [-] [479852] Writing DB stats keystone:SELECT=100 {{(pid=479852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:19:23.668294 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG dbcounter [-] [479851] Writing DB stats keystone:SELECT=100 {{(pid=479851) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:19:23.688591 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a00359-e046-4a1a-9c51-0c8c7b19af82 None admin] Validating token access rules against request {{(pid=479852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:19:23.730874 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d42256e-4d19-4fe3-a7ee-47fa4e7cf6e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:19:23.731562 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d42256e-4d19-4fe3-a7ee-47fa4e7cf6e6 None admin] REQUEST_METHOD: `GET` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:19:23.731848 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d42256e-4d19-4fe3-a7ee-47fa4e7cf6e6 None admin] SCRIPT_NAME: `/identity` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:19:23.732133 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d42256e-4d19-4fe3-a7ee-47fa4e7cf6e6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:19:23.746760 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1cde5e-862c-43b9-abe5-ae371f1c1be9 None admin] Validating token access rules against request {{(pid=479851) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:19:23.753985 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d42256e-4d19-4fe3-a7ee-47fa4e7cf6e6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:19:23.755635 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d42256e-4d19-4fe3-a7ee-47fa4e7cf6e6 None admin] RBAC: Authorization granted {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:19:23.790829 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application [None req-2d42256e-4d19-4fe3-a7ee-47fa4e7cf6e6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 09:19:23.790829 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 09:19:23.790829 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 09:19:23.790829 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 09:19:23.790829 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 09:19:23.790829 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 09:19:23.790829 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 09:19:23.790829 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 09:19:23.790829 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 09:19:23.790829 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 09:19:23.790829 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 09:19:23.790829 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 09:19:23.790829 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 09:19:23.790829 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 09:19:23.790829 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 09:19:23.793067 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 09:19:23.793067 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 09:19:23.793067 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 09:19:23.793067 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 09:19:23.793067 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 09:19:23.793067 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 09:19:23.793067 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 09:19:23.793067 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 09:19:23.793067 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application with Lock( Jul 28 09:19:23.793067 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 09:19:23.793067 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self._enter() Jul 28 09:19:23.793067 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 09:19:23.793067 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 09:19:23.793067 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 09:19:23.793067 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self.creator() Jul 28 09:19:23.793067 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 09:19:23.793067 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application created_value = creator( Jul 28 09:19:23.795293 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 09:19:23.795293 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 09:19:23.795293 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 09:19:23.795293 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application Jul 28 09:19:23.795293 dv-cinder-851351-1-smb devstack@keystone.service[479852]: [pid: 479852|app: 0|req: 349/689] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 09:19:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 09:19:23.802280 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d42256e-4d19-4fe3-a7ee-47fa4e7cf6e6 None admin] Authenticating user token {{(pid=479852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:19:23.802632 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efbcabaf-38ff-41f5-af14-ec072de3c434 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479851) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:19:23.803145 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbcabaf-38ff-41f5-af14-ec072de3c434 None admin] REQUEST_METHOD: `GET` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:19:23.803434 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbcabaf-38ff-41f5-af14-ec072de3c434 None admin] SCRIPT_NAME: `/identity` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:19:23.803718 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbcabaf-38ff-41f5-af14-ec072de3c434 None admin] PATH_INFO: `/v3/domains` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:19:23.804448 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efbcabaf-38ff-41f5-af14-ec072de3c434 None admin] RBAC: Adding query filter params (name=Default) {{(pid=479851) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 09:19:23.804788 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efbcabaf-38ff-41f5-af14-ec072de3c434 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:19:23.807776 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efbcabaf-38ff-41f5-af14-ec072de3c434 None admin] RBAC: Authorization granted {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:19:23.826728 dv-cinder-851351-1-smb devstack@keystone.service[479851]: [pid: 479851|app: 0|req: 341/690] 10.222.0.42 () {56 vars in 1109 bytes} [Thu Jul 28 09:19:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:19:23.829038 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3152d2d8-fe59-4efa-94d8-87560adacfd8 None None] REQUEST_METHOD: `GET` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:19:23.829333 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3152d2d8-fe59-4efa-94d8-87560adacfd8 None None] SCRIPT_NAME: `/identity` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:19:23.829617 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3152d2d8-fe59-4efa-94d8-87560adacfd8 None None] PATH_INFO: `/` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:19:23.831933 dv-cinder-851351-1-smb devstack@keystone.service[479851]: [pid: 479851|app: 0|req: 342/691] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 09:19:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 09:19:23.833037 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3152d2d8-fe59-4efa-94d8-87560adacfd8 None None] Authenticating user token {{(pid=479851) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:19:23.938277 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d42256e-4d19-4fe3-a7ee-47fa4e7cf6e6 None admin] Validating token access rules against request {{(pid=479852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:19:23.941719 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG dbcounter [-] [479852] Writing DB stats keystone:SELECT=100 {{(pid=479852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:19:23.983210 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3152d2d8-fe59-4efa-94d8-87560adacfd8 None None] Validating token access rules against request {{(pid=479851) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:19:23.992573 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c35bc89-ddeb-4e55-b63f-8d2e05d7234c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:19:23.993578 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c35bc89-ddeb-4e55-b63f-8d2e05d7234c None admin] REQUEST_METHOD: `GET` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:19:23.994029 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c35bc89-ddeb-4e55-b63f-8d2e05d7234c None admin] SCRIPT_NAME: `/identity` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:19:23.994480 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c35bc89-ddeb-4e55-b63f-8d2e05d7234c None admin] PATH_INFO: `/v3/domains` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:19:23.995664 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c35bc89-ddeb-4e55-b63f-8d2e05d7234c None admin] RBAC: Adding query filter params (name=Default) {{(pid=479852) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 09:19:23.996239 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c35bc89-ddeb-4e55-b63f-8d2e05d7234c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:19:23.998694 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c35bc89-ddeb-4e55-b63f-8d2e05d7234c None admin] RBAC: Authorization granted {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:19:24.006549 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG dbcounter [-] [479851] Writing DB stats keystone:SELECT=100 {{(pid=479851) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:19:24.021893 dv-cinder-851351-1-smb devstack@keystone.service[479852]: [pid: 479852|app: 0|req: 350/692] 10.222.0.42 () {56 vars in 1109 bytes} [Thu Jul 28 09:19:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 09:19:24.024108 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43be7316-89ed-4da5-8629-38b93d7e1e93 None None] REQUEST_METHOD: `POST` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:19:24.024567 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43be7316-89ed-4da5-8629-38b93d7e1e93 None None] SCRIPT_NAME: `/identity` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:19:24.025049 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43be7316-89ed-4da5-8629-38b93d7e1e93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:19:24.049825 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.auth.core [None req-43be7316-89ed-4da5-8629-38b93d7e1e93 None None] MFA Rules not processed for user `c198f91a4ae84d2b9cc730a6e304c2be`. Rule list: `[]` (Enabled: `True`). {{(pid=479852) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 09:19:24.051121 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.fernet_utils [None req-43be7316-89ed-4da5-8629-38b93d7e1e93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=479852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 09:19:24.052506 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96da784f-c64c-4c60-bc1c-9497c7ed374e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479851) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:19:24.053213 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96da784f-c64c-4c60-bc1c-9497c7ed374e None admin] REQUEST_METHOD: `POST` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:19:24.053877 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96da784f-c64c-4c60-bc1c-9497c7ed374e None admin] SCRIPT_NAME: `/identity` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:19:24.054167 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96da784f-c64c-4c60-bc1c-9497c7ed374e None admin] PATH_INFO: `/v3/users` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:19:24.056042 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96da784f-c64c-4c60-bc1c-9497c7ed374e None admin] RBAC: Authorizing `identity:create_user()` {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:19:24.057612 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96da784f-c64c-4c60-bc1c-9497c7ed374e None admin] RBAC: Authorization granted {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:19:24.094346 dv-cinder-851351-1-smb devstack@keystone.service[479851]: [pid: 479851|app: 0|req: 343/693] 10.222.0.42 () {60 vars in 1132 bytes} [Thu Jul 28 09:19:23 2022] POST /identity/v3/users => generated 254 bytes in 261 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 09:19:24.095581 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96da784f-c64c-4c60-bc1c-9497c7ed374e None admin] Authenticating user token {{(pid=479851) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:19:24.149060 dv-cinder-851351-1-smb devstack@keystone.service[479852]: [pid: 479852|app: 0|req: 351/694] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 09:19:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 09:19:24.180028 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43be7316-89ed-4da5-8629-38b93d7e1e93 None None] Authenticating user token {{(pid=479852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:19:24.230464 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96da784f-c64c-4c60-bc1c-9497c7ed374e None admin] Validating token access rules against request {{(pid=479851) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:19:24.298267 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fdac377-1422-4bb8-a517-3b4f8596bb17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479851) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:19:24.298895 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fdac377-1422-4bb8-a517-3b4f8596bb17 None admin] REQUEST_METHOD: `GET` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:19:24.299185 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fdac377-1422-4bb8-a517-3b4f8596bb17 None admin] SCRIPT_NAME: `/identity` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:19:24.299463 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fdac377-1422-4bb8-a517-3b4f8596bb17 None admin] PATH_INFO: `/v3/projects/service` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:19:24.315307 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fdac377-1422-4bb8-a517-3b4f8596bb17 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:19:24.318922 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fdac377-1422-4bb8-a517-3b4f8596bb17 None admin] RBAC: Authorization granted {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:19:24.345447 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application [None req-4fdac377-1422-4bb8-a517-3b4f8596bb17 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 09:19:24.345447 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 09:19:24.345447 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 09:19:24.345447 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 09:19:24.345447 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 09:19:24.345447 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 09:19:24.345447 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 09:19:24.345447 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 09:19:24.345447 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 09:19:24.345447 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 09:19:24.345447 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 09:19:24.345447 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 09:19:24.345447 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 28 09:19:24.345447 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 28 09:19:24.345447 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 28 09:19:24.346575 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 28 09:19:24.346575 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 09:19:24.346575 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 09:19:24.346575 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 09:19:24.346575 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 09:19:24.346575 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 09:19:24.346575 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 09:19:24.346575 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 09:19:24.346575 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application with Lock( Jul 28 09:19:24.346575 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 09:19:24.346575 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return self._enter() Jul 28 09:19:24.346575 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 09:19:24.346575 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 09:19:24.346575 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 09:19:24.346575 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return self.creator() Jul 28 09:19:24.346575 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 09:19:24.346575 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application created_value = creator( Jul 28 09:19:24.347622 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 28 09:19:24.347622 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 28 09:19:24.347622 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 28 09:19:24.347622 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 28 09:19:24.347622 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 28 09:19:24.347622 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 28 09:19:24.347622 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 09:19:24.347622 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application Jul 28 09:19:24.347622 dv-cinder-851351-1-smb devstack@keystone.service[479851]: [pid: 479851|app: 0|req: 344/695] 10.222.0.42 () {56 vars in 1111 bytes} [Thu Jul 28 09:19:24 2022] GET /identity/v3/projects/service => generated 88 bytes in 252 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 09:19:24.352893 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fdac377-1422-4bb8-a517-3b4f8596bb17 None admin] Authenticating user token {{(pid=479851) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:19:24.359420 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG dbcounter [-] [479852] Writing DB stats keystone:SELECT=100 {{(pid=479852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:19:24.369250 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43be7316-89ed-4da5-8629-38b93d7e1e93 None None] Validating token access rules against request {{(pid=479852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:19:24.396735 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG dbcounter [-] [479851] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=479851) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:19:24.414930 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad0cad2-15d2-4673-844a-508b43d98be2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:19:24.416953 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad0cad2-15d2-4673-844a-508b43d98be2 None admin] REQUEST_METHOD: `GET` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:19:24.417346 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad0cad2-15d2-4673-844a-508b43d98be2 None admin] SCRIPT_NAME: `/identity` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:19:24.417725 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad0cad2-15d2-4673-844a-508b43d98be2 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:19:24.431651 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ad0cad2-15d2-4673-844a-508b43d98be2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 09:19:24.437330 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application [None req-3ad0cad2-15d2-4673-844a-508b43d98be2 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 09:19:24.437330 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 09:19:24.437330 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 09:19:24.437330 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 09:19:24.437330 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 09:19:24.437330 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 09:19:24.437330 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 09:19:24.437330 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 09:19:24.437330 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 09:19:24.437330 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 09:19:24.437330 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 09:19:24.437330 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 09:19:24.437330 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 09:19:24.437330 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 09:19:24.437330 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 09:19:24.437330 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 09:19:24.438687 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 09:19:24.438687 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 09:19:24.438687 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 09:19:24.438687 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 09:19:24.438687 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 09:19:24.438687 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 09:19:24.438687 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 09:19:24.438687 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 09:19:24.438687 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 09:19:24.438687 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 09:19:24.438687 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 09:19:24.438687 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application with Lock( Jul 28 09:19:24.438687 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 09:19:24.438687 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self._enter() Jul 28 09:19:24.438687 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 09:19:24.438687 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 09:19:24.439900 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 09:19:24.439900 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self.creator() Jul 28 09:19:24.439900 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 09:19:24.439900 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application created_value = creator( Jul 28 09:19:24.439900 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 09:19:24.439900 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 09:19:24.439900 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 09:19:24.439900 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 09:19:24.439900 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 09:19:24.439900 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 09:19:24.439900 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 09:19:24.439900 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application Jul 28 09:19:24.441518 dv-cinder-851351-1-smb devstack@keystone.service[479852]: [pid: 479852|app: 0|req: 352/696] 10.222.0.42 () {56 vars in 1096 bytes} [Thu Jul 28 09:19:24 2022] GET /identity/v3/roles/admin => generated 83 bytes in 262 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 09:19:24.447639 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad0cad2-15d2-4673-844a-508b43d98be2 None admin] Authenticating user token {{(pid=479852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:19:24.575851 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad0cad2-15d2-4673-844a-508b43d98be2 None admin] Validating token access rules against request {{(pid=479852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:19:24.617657 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fdac377-1422-4bb8-a517-3b4f8596bb17 None admin] Validating token access rules against request {{(pid=479851) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:19:24.620939 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9ab38c-02c8-431a-9ee9-69c3ac956b92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:19:24.621886 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9ab38c-02c8-431a-9ee9-69c3ac956b92 None admin] REQUEST_METHOD: `GET` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:19:24.622384 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9ab38c-02c8-431a-9ee9-69c3ac956b92 None admin] SCRIPT_NAME: `/identity` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:19:24.622928 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9ab38c-02c8-431a-9ee9-69c3ac956b92 None admin] PATH_INFO: `/v3/roles` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:19:24.623885 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f9ab38c-02c8-431a-9ee9-69c3ac956b92 None admin] RBAC: Adding query filter params (name=admin) {{(pid=479852) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 09:19:24.624416 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f9ab38c-02c8-431a-9ee9-69c3ac956b92 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:19:24.626331 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f9ab38c-02c8-431a-9ee9-69c3ac956b92 None admin] RBAC: Authorization granted {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:19:24.639165 dv-cinder-851351-1-smb devstack@keystone.service[479852]: [pid: 479852|app: 0|req: 353/697] 10.222.0.42 () {56 vars in 1099 bytes} [Thu Jul 28 09:19:24 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 09:19:24.645436 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9ab38c-02c8-431a-9ee9-69c3ac956b92 None admin] Authenticating user token {{(pid=479852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:19:24.665405 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f294fca5-1040-4456-86d8-9683ca1e79ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479851) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:19:24.667624 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f294fca5-1040-4456-86d8-9683ca1e79ef None admin] REQUEST_METHOD: `GET` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:19:24.668146 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f294fca5-1040-4456-86d8-9683ca1e79ef None admin] SCRIPT_NAME: `/identity` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:19:24.668654 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f294fca5-1040-4456-86d8-9683ca1e79ef None admin] PATH_INFO: `/v3/projects` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:19:24.671112 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f294fca5-1040-4456-86d8-9683ca1e79ef None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=479851) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 09:19:24.671928 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f294fca5-1040-4456-86d8-9683ca1e79ef None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:19:24.677843 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG dbcounter [-] [479852] Writing DB stats keystone:SELECT=100 {{(pid=479852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:19:24.678437 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f294fca5-1040-4456-86d8-9683ca1e79ef None admin] RBAC: Authorization granted {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:19:24.708426 dv-cinder-851351-1-smb devstack@keystone.service[479851]: [pid: 479851|app: 0|req: 345/698] 10.222.0.42 () {56 vars in 1148 bytes} [Thu Jul 28 09:19:24 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 356 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:19:24.716597 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f294fca5-1040-4456-86d8-9683ca1e79ef None admin] Authenticating user token {{(pid=479851) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:19:24.882586 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9ab38c-02c8-431a-9ee9-69c3ac956b92 None admin] Validating token access rules against request {{(pid=479852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:19:24.926178 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667243bb-eb7c-4b8c-9bd2-c36d706a6ece None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:19:24.926860 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667243bb-eb7c-4b8c-9bd2-c36d706a6ece None admin] REQUEST_METHOD: `GET` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:19:24.927229 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667243bb-eb7c-4b8c-9bd2-c36d706a6ece None admin] SCRIPT_NAME: `/identity` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:19:24.927509 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667243bb-eb7c-4b8c-9bd2-c36d706a6ece None admin] PATH_INFO: `/v3/domains/Default` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:19:24.942218 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG dbcounter [-] [479851] Writing DB stats keystone:SELECT=100 {{(pid=479851) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:19:24.946732 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-667243bb-eb7c-4b8c-9bd2-c36d706a6ece None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:19:24.948370 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-667243bb-eb7c-4b8c-9bd2-c36d706a6ece None admin] RBAC: Authorization granted {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:19:24.966743 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application [None req-667243bb-eb7c-4b8c-9bd2-c36d706a6ece None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 09:19:24.966743 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 09:19:24.966743 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 09:19:24.966743 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 09:19:24.966743 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 09:19:24.966743 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 09:19:24.966743 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 09:19:24.966743 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 09:19:24.966743 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 09:19:24.966743 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 09:19:24.966743 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 09:19:24.966743 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 09:19:24.966743 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 09:19:24.966743 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 09:19:24.966743 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 09:19:24.967868 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 09:19:24.967868 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 09:19:24.967868 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 09:19:24.967868 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 09:19:24.967868 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 09:19:24.967868 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 09:19:24.967868 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 09:19:24.967868 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 09:19:24.967868 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application with Lock( Jul 28 09:19:24.967868 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 09:19:24.967868 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self._enter() Jul 28 09:19:24.967868 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 09:19:24.967868 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 09:19:24.967868 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 09:19:24.967868 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self.creator() Jul 28 09:19:24.967868 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 09:19:24.967868 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application created_value = creator( Jul 28 09:19:24.969681 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 09:19:24.969681 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 09:19:24.969681 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 09:19:24.969681 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application Jul 28 09:19:24.969681 dv-cinder-851351-1-smb devstack@keystone.service[479852]: [pid: 479852|app: 0|req: 354/699] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 09:19:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 323 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 09:19:24.974100 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667243bb-eb7c-4b8c-9bd2-c36d706a6ece None admin] Authenticating user token {{(pid=479852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:19:24.987085 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f294fca5-1040-4456-86d8-9683ca1e79ef None admin] Validating token access rules against request {{(pid=479851) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:19:25.064639 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG dbcounter [-] [479852] Writing DB stats keystone:SELECT=100 {{(pid=479852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:19:25.094033 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04db427f-476d-484a-aa9c-f65f2145559a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479851) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:19:25.094803 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04db427f-476d-484a-aa9c-f65f2145559a None admin] REQUEST_METHOD: `GET` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:19:25.095094 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04db427f-476d-484a-aa9c-f65f2145559a None admin] SCRIPT_NAME: `/identity` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:19:25.095375 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04db427f-476d-484a-aa9c-f65f2145559a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:19:25.096187 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04db427f-476d-484a-aa9c-f65f2145559a None admin] RBAC: Adding query filter params (role.id=bd74dfcbc8d7412689d315fe24a1f247, scope.project.id=3a0fb8ea8010437bade8f92dcbcaacee, user.id=213aa011e5004256aead7e486d7f2eba) {{(pid=479851) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 09:19:25.096501 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04db427f-476d-484a-aa9c-f65f2145559a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:19:25.098063 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04db427f-476d-484a-aa9c-f65f2145559a None admin] RBAC: Authorization granted {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:19:25.108411 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667243bb-eb7c-4b8c-9bd2-c36d706a6ece None admin] Validating token access rules against request {{(pid=479852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:19:25.119039 dv-cinder-851351-1-smb devstack@keystone.service[479851]: [pid: 479851|app: 0|req: 346/700] 10.222.0.42 () {56 vars in 1374 bytes} [Thu Jul 28 09:19:24 2022] GET /identity/v3/role_assignments?user.id=213aa011e5004256aead7e486d7f2eba&scope.project.id=3a0fb8ea8010437bade8f92dcbcaacee&role.id=bd74dfcbc8d7412689d315fe24a1f247 => generated 608 bytes in 403 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:19:25.151132 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81be90c0-985c-4aad-a07a-025291e7add5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:19:25.151694 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81be90c0-985c-4aad-a07a-025291e7add5 None admin] REQUEST_METHOD: `GET` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:19:25.151981 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81be90c0-985c-4aad-a07a-025291e7add5 None admin] SCRIPT_NAME: `/identity` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:19:25.152264 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81be90c0-985c-4aad-a07a-025291e7add5 None admin] PATH_INFO: `/v3/domains` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:19:25.153097 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81be90c0-985c-4aad-a07a-025291e7add5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=479852) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 09:19:25.153412 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81be90c0-985c-4aad-a07a-025291e7add5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:19:25.154942 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81be90c0-985c-4aad-a07a-025291e7add5 None admin] RBAC: Authorization granted {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:19:25.170954 dv-cinder-851351-1-smb devstack@keystone.service[479852]: [pid: 479852|app: 0|req: 355/701] 10.222.0.42 () {56 vars in 1109 bytes} [Thu Jul 28 09:19:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:19:25.176761 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04db427f-476d-484a-aa9c-f65f2145559a None admin] Authenticating user token {{(pid=479851) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:19:25.274968 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24be5b98-f16d-4e44-85d3-14f84a0ec8b6 None None] REQUEST_METHOD: `GET` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:19:25.276876 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24be5b98-f16d-4e44-85d3-14f84a0ec8b6 None None] SCRIPT_NAME: `/identity` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:19:25.276876 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24be5b98-f16d-4e44-85d3-14f84a0ec8b6 None None] PATH_INFO: `/` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:19:25.278601 dv-cinder-851351-1-smb devstack@keystone.service[479852]: [pid: 479852|app: 0|req: 356/702] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 09:19:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 09:19:25.290304 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0369e87-3fac-4171-9436-42b6a746a605 None None] REQUEST_METHOD: `POST` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:19:25.290680 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0369e87-3fac-4171-9436-42b6a746a605 None None] SCRIPT_NAME: `/identity` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:19:25.290874 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0369e87-3fac-4171-9436-42b6a746a605 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:19:25.316420 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04db427f-476d-484a-aa9c-f65f2145559a None admin] Validating token access rules against request {{(pid=479851) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:19:25.331820 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.auth.core [None req-d0369e87-3fac-4171-9436-42b6a746a605 None None] MFA Rules not processed for user `c198f91a4ae84d2b9cc730a6e304c2be`. Rule list: `[]` (Enabled: `True`). {{(pid=479852) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 09:19:25.333684 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.fernet_utils [None req-d0369e87-3fac-4171-9436-42b6a746a605 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=479852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 09:19:25.421312 dv-cinder-851351-1-smb devstack@keystone.service[479852]: [pid: 479852|app: 0|req: 357/703] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 09:19:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 09:19:25.421897 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3972123c-e528-4b89-9d14-ecdb0a668c33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479851) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:19:25.422584 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3972123c-e528-4b89-9d14-ecdb0a668c33 None admin] REQUEST_METHOD: `GET` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:19:25.422870 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3972123c-e528-4b89-9d14-ecdb0a668c33 None admin] SCRIPT_NAME: `/identity` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:19:25.423184 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3972123c-e528-4b89-9d14-ecdb0a668c33 None admin] PATH_INFO: `/v3/users/nova` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:19:25.441665 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3972123c-e528-4b89-9d14-ecdb0a668c33 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:19:25.443191 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3972123c-e528-4b89-9d14-ecdb0a668c33 None admin] RBAC: Authorization granted {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:19:25.466526 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0369e87-3fac-4171-9436-42b6a746a605 None None] Authenticating user token {{(pid=479852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:19:25.466861 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application [None req-3972123c-e528-4b89-9d14-ecdb0a668c33 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 28 09:19:25.466861 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 09:19:25.466861 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 09:19:25.466861 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 09:19:25.466861 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 09:19:25.466861 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 09:19:25.466861 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 09:19:25.466861 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 09:19:25.466861 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 09:19:25.466861 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 09:19:25.466861 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 09:19:25.466861 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 09:19:25.466861 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 28 09:19:25.466861 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 28 09:19:25.466861 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 28 09:19:25.466861 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 28 09:19:25.467978 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 09:19:25.467978 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 09:19:25.467978 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 28 09:19:25.467978 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 09:19:25.467978 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 28 09:19:25.467978 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 09:19:25.467978 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 09:19:25.467978 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 09:19:25.467978 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 09:19:25.467978 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 09:19:25.467978 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 09:19:25.467978 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application with Lock( Jul 28 09:19:25.467978 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 09:19:25.467978 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return self._enter() Jul 28 09:19:25.467978 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 09:19:25.467978 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 09:19:25.467978 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 09:19:25.467978 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return self.creator() Jul 28 09:19:25.469130 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 09:19:25.469130 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application created_value = creator( Jul 28 09:19:25.469130 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 28 09:19:25.469130 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 28 09:19:25.469130 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 28 09:19:25.469130 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 28 09:19:25.469130 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 28 09:19:25.469130 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 28 09:19:25.469130 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 28 09:19:25.469130 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application Jul 28 09:19:25.472796 dv-cinder-851351-1-smb devstack@keystone.service[479851]: [pid: 479851|app: 0|req: 347/704] 10.222.0.42 () {56 vars in 1093 bytes} [Thu Jul 28 09:19:25 2022] GET /identity/v3/users/nova => generated 82 bytes in 292 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 09:19:25.474842 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3972123c-e528-4b89-9d14-ecdb0a668c33 None admin] Authenticating user token {{(pid=479851) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:19:25.487251 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG dbcounter [-] [479851] Writing DB stats keystone:SELECT=100 {{(pid=479851) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:19:25.543034 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG dbcounter [-] [479852] Writing DB stats keystone:SELECT=100 {{(pid=479852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:19:25.601515 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0369e87-3fac-4171-9436-42b6a746a605 None None] Validating token access rules against request {{(pid=479852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:19:25.614487 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3972123c-e528-4b89-9d14-ecdb0a668c33 None admin] Validating token access rules against request {{(pid=479851) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:19:25.639134 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f27c447-37c6-4611-a67f-be2a457eb549 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:19:25.639854 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f27c447-37c6-4611-a67f-be2a457eb549 None admin] REQUEST_METHOD: `GET` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:19:25.640136 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f27c447-37c6-4611-a67f-be2a457eb549 None admin] SCRIPT_NAME: `/identity` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:19:25.640408 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f27c447-37c6-4611-a67f-be2a457eb549 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:19:25.641079 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f27c447-37c6-4611-a67f-be2a457eb549 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:19:25.642533 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f27c447-37c6-4611-a67f-be2a457eb549 None admin] RBAC: Authorization granted {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:19:25.654413 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application [None req-7f27c447-37c6-4611-a67f-be2a457eb549 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 28 09:19:25.654413 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 09:19:25.654413 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 28 09:19:25.654413 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 28 09:19:25.654413 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 28 09:19:25.654413 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 28 09:19:25.654413 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 28 09:19:25.654413 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 09:19:25.654413 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 28 09:19:25.654413 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application Jul 28 09:19:25.654413 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 28 09:19:25.654413 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application Jul 28 09:19:25.654413 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 09:19:25.654413 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 09:19:25.654413 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 09:19:25.654413 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 09:19:25.655726 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 09:19:25.655726 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 09:19:25.655726 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 09:19:25.655726 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 09:19:25.655726 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 09:19:25.655726 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 09:19:25.655726 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 09:19:25.655726 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 28 09:19:25.655726 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 28 09:19:25.655726 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 28 09:19:25.655726 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 28 09:19:25.655726 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 09:19:25.655726 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 09:19:25.655726 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 09:19:25.655726 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 09:19:25.655726 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 09:19:25.656791 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 09:19:25.656791 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 09:19:25.656791 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application with Lock( Jul 28 09:19:25.656791 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 09:19:25.656791 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self._enter() Jul 28 09:19:25.656791 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 09:19:25.656791 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 09:19:25.656791 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 09:19:25.656791 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self.creator() Jul 28 09:19:25.656791 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 09:19:25.656791 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application created_value = creator( Jul 28 09:19:25.656791 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 28 09:19:25.656791 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 09:19:25.656791 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 28 09:19:25.656791 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application Jul 28 09:19:25.656791 dv-cinder-851351-1-smb devstack@keystone.service[479852]: [pid: 479852|app: 0|req: 358/705] 10.222.0.42 () {56 vars in 1129 bytes} [Thu Jul 28 09:19:25 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 09:19:25.664705 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f27c447-37c6-4611-a67f-be2a457eb549 None admin] Authenticating user token {{(pid=479852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:19:25.669181 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e207f54-dfd7-43de-afff-7fdc520bff5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479851) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:19:25.670153 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e207f54-dfd7-43de-afff-7fdc520bff5e None admin] REQUEST_METHOD: `GET` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:19:25.670633 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e207f54-dfd7-43de-afff-7fdc520bff5e None admin] SCRIPT_NAME: `/identity` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:19:25.671090 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e207f54-dfd7-43de-afff-7fdc520bff5e None admin] PATH_INFO: `/v3/users` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:19:25.672272 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e207f54-dfd7-43de-afff-7fdc520bff5e None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=479851) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 09:19:25.672831 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e207f54-dfd7-43de-afff-7fdc520bff5e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:19:25.674523 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e207f54-dfd7-43de-afff-7fdc520bff5e None admin] RBAC: Authorization granted {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:19:25.697553 dv-cinder-851351-1-smb devstack@keystone.service[479851]: [pid: 479851|app: 0|req: 348/706] 10.222.0.42 () {56 vars in 1133 bytes} [Thu Jul 28 09:19:25 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 09:19:25.703163 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e207f54-dfd7-43de-afff-7fdc520bff5e None admin] Authenticating user token {{(pid=479851) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:19:25.792872 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG dbcounter [-] [479851] Writing DB stats keystone:SELECT=100 {{(pid=479851) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:19:25.803615 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f27c447-37c6-4611-a67f-be2a457eb549 None admin] Validating token access rules against request {{(pid=479852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:19:25.835504 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG dbcounter [-] [479852] Writing DB stats keystone:SELECT=100 {{(pid=479852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:19:25.851091 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de1318f-90c5-4a17-a6b4-fdc10a5a183f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:19:25.852174 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de1318f-90c5-4a17-a6b4-fdc10a5a183f None admin] REQUEST_METHOD: `GET` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:19:25.852623 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de1318f-90c5-4a17-a6b4-fdc10a5a183f None admin] SCRIPT_NAME: `/identity` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:19:25.853200 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de1318f-90c5-4a17-a6b4-fdc10a5a183f None admin] PATH_INFO: `/v3/services` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:19:25.854248 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de1318f-90c5-4a17-a6b4-fdc10a5a183f None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=479852) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 09:19:25.854721 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de1318f-90c5-4a17-a6b4-fdc10a5a183f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:19:25.856726 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de1318f-90c5-4a17-a6b4-fdc10a5a183f None admin] RBAC: Authorization granted {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:19:25.861125 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e207f54-dfd7-43de-afff-7fdc520bff5e None admin] Validating token access rules against request {{(pid=479851) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:19:25.863307 dv-cinder-851351-1-smb devstack@keystone.service[479852]: [pid: 479852|app: 0|req: 359/707] 10.222.0.42 () {56 vars in 1124 bytes} [Thu Jul 28 09:19:25 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 09:19:25.870282 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de1318f-90c5-4a17-a6b4-fdc10a5a183f None admin] Authenticating user token {{(pid=479852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:19:25.943936 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31cce358-266d-40ba-bfec-d0077b77bb2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479851) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:19:25.944701 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31cce358-266d-40ba-bfec-d0077b77bb2c None admin] REQUEST_METHOD: `GET` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:19:25.945094 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31cce358-266d-40ba-bfec-d0077b77bb2c None admin] SCRIPT_NAME: `/identity` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:19:25.945474 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31cce358-266d-40ba-bfec-d0077b77bb2c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:19:25.989865 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de1318f-90c5-4a17-a6b4-fdc10a5a183f None admin] Validating token access rules against request {{(pid=479852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:19:26.051191 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d826d9c5-1564-4fc0-9ceb-ffdc5791e2c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:19:26.051866 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d826d9c5-1564-4fc0-9ceb-ffdc5791e2c7 None admin] REQUEST_METHOD: `GET` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:19:26.052149 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d826d9c5-1564-4fc0-9ceb-ffdc5791e2c7 None admin] SCRIPT_NAME: `/identity` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:19:26.052427 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d826d9c5-1564-4fc0-9ceb-ffdc5791e2c7 None admin] PATH_INFO: `/v3/services` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:19:26.053164 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d826d9c5-1564-4fc0-9ceb-ffdc5791e2c7 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=479852) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 09:19:26.053474 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d826d9c5-1564-4fc0-9ceb-ffdc5791e2c7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:19:26.054873 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d826d9c5-1564-4fc0-9ceb-ffdc5791e2c7 None admin] RBAC: Authorization granted {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:19:26.061651 dv-cinder-851351-1-smb devstack@keystone.service[479852]: [pid: 479852|app: 0|req: 360/708] 10.222.0.42 () {56 vars in 1124 bytes} [Thu Jul 28 09:19:25 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 09:19:26.077368 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31cce358-266d-40ba-bfec-d0077b77bb2c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:19:26.079014 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31cce358-266d-40ba-bfec-d0077b77bb2c None admin] RBAC: Authorization granted {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:19:26.163768 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG dbcounter [-] [479851] Writing DB stats keystone:SELECT=100 {{(pid=479851) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:19:26.224639 dv-cinder-851351-1-smb devstack@keystone.service[479851]: [pid: 479851|app: 0|req: 349/709] 10.222.0.42 () {58 vars in 1282 bytes} [Thu Jul 28 09:19:25 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 522 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 28 09:19:26.230288 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d826d9c5-1564-4fc0-9ceb-ffdc5791e2c7 None admin] Authenticating user token {{(pid=479852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:19:26.282773 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d9c0b0-bb55-4a7e-9492-b74ce03835f7 None None] REQUEST_METHOD: `GET` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:19:26.283220 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d9c0b0-bb55-4a7e-9492-b74ce03835f7 None None] SCRIPT_NAME: `/identity` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:19:26.283645 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d9c0b0-bb55-4a7e-9492-b74ce03835f7 None None] PATH_INFO: `/` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:19:26.285415 dv-cinder-851351-1-smb devstack@keystone.service[479851]: [pid: 479851|app: 0|req: 350/710] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 09:19:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 28 09:19:26.291263 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7735cd3-996a-41ef-90d8-da40965c03ac None None] REQUEST_METHOD: `POST` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:19:26.291587 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7735cd3-996a-41ef-90d8-da40965c03ac None None] SCRIPT_NAME: `/identity` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:19:26.291834 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7735cd3-996a-41ef-90d8-da40965c03ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:19:26.316921 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG dbcounter [-] [479852] Writing DB stats keystone:SELECT=100 {{(pid=479852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:19:26.323328 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.auth.core [None req-f7735cd3-996a-41ef-90d8-da40965c03ac None None] MFA Rules not processed for user `c198f91a4ae84d2b9cc730a6e304c2be`. Rule list: `[]` (Enabled: `True`). {{(pid=479851) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 09:19:26.325209 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.fernet_utils [None req-f7735cd3-996a-41ef-90d8-da40965c03ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=479851) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 09:19:26.397836 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d826d9c5-1564-4fc0-9ceb-ffdc5791e2c7 None admin] Validating token access rules against request {{(pid=479852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:19:26.456903 dv-cinder-851351-1-smb devstack@keystone.service[479851]: [pid: 479851|app: 0|req: 351/711] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 09:19:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 09:19:26.469345 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06988398-37e3-4f03-859f-703be8bcf044 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:19:26.470351 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06988398-37e3-4f03-859f-703be8bcf044 None admin] REQUEST_METHOD: `GET` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:19:26.470883 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06988398-37e3-4f03-859f-703be8bcf044 None admin] SCRIPT_NAME: `/identity` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:19:26.471349 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06988398-37e3-4f03-859f-703be8bcf044 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:19:26.479396 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7735cd3-996a-41ef-90d8-da40965c03ac None None] Authenticating user token {{(pid=479851) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:19:26.497498 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06988398-37e3-4f03-859f-703be8bcf044 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:19:26.499396 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06988398-37e3-4f03-859f-703be8bcf044 None admin] RBAC: Authorization granted {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:19:26.518845 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application [None req-06988398-37e3-4f03-859f-703be8bcf044 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 09:19:26.518845 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 09:19:26.518845 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 09:19:26.518845 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 09:19:26.518845 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 09:19:26.518845 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 09:19:26.518845 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 09:19:26.518845 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 09:19:26.518845 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 09:19:26.518845 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 09:19:26.518845 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 09:19:26.518845 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 09:19:26.518845 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 09:19:26.518845 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 09:19:26.518845 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 09:19:26.519996 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 09:19:26.519996 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 09:19:26.519996 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 09:19:26.519996 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 09:19:26.519996 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 09:19:26.519996 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 09:19:26.519996 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 09:19:26.519996 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 09:19:26.519996 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application with Lock( Jul 28 09:19:26.519996 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 09:19:26.519996 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self._enter() Jul 28 09:19:26.519996 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 09:19:26.519996 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 09:19:26.519996 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 09:19:26.519996 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self.creator() Jul 28 09:19:26.519996 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 09:19:26.519996 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application created_value = creator( Jul 28 09:19:26.521196 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 09:19:26.521196 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 09:19:26.521196 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 09:19:26.521196 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application Jul 28 09:19:26.524801 dv-cinder-851351-1-smb devstack@keystone.service[479852]: [pid: 479852|app: 0|req: 361/712] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 09:19:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 295 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 09:19:26.535537 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06988398-37e3-4f03-859f-703be8bcf044 None admin] Authenticating user token {{(pid=479852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:19:26.645221 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7735cd3-996a-41ef-90d8-da40965c03ac None None] Validating token access rules against request {{(pid=479851) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:19:26.648984 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG dbcounter [-] [479851] Writing DB stats keystone:SELECT=100 {{(pid=479851) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:19:26.705475 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c60c914d-26cb-46ad-a088-7e33c718b221 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479851) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:19:26.706164 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60c914d-26cb-46ad-a088-7e33c718b221 None admin] REQUEST_METHOD: `GET` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:19:26.713143 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60c914d-26cb-46ad-a088-7e33c718b221 None admin] SCRIPT_NAME: `/identity` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:19:26.713449 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60c914d-26cb-46ad-a088-7e33c718b221 None admin] PATH_INFO: `/v3/services/network` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:19:26.714122 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c60c914d-26cb-46ad-a088-7e33c718b221 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:19:26.715572 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c60c914d-26cb-46ad-a088-7e33c718b221 None admin] RBAC: Authorization granted {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:19:26.721496 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06988398-37e3-4f03-859f-703be8bcf044 None admin] Validating token access rules against request {{(pid=479852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:19:26.723148 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG dbcounter [-] [479852] Writing DB stats keystone:SELECT=100 {{(pid=479852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:19:26.738696 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application [None req-c60c914d-26cb-46ad-a088-7e33c718b221 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jul 28 09:19:26.738696 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 09:19:26.738696 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 28 09:19:26.738696 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 28 09:19:26.738696 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 28 09:19:26.738696 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 28 09:19:26.738696 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 28 09:19:26.738696 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 09:19:26.738696 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 28 09:19:26.738696 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application Jul 28 09:19:26.738696 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 28 09:19:26.738696 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application Jul 28 09:19:26.738696 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 09:19:26.738696 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 09:19:26.738696 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 09:19:26.738696 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 09:19:26.738696 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 09:19:26.740034 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 09:19:26.740034 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 09:19:26.740034 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 09:19:26.740034 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 09:19:26.740034 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 09:19:26.740034 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 09:19:26.740034 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 28 09:19:26.740034 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 28 09:19:26.740034 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 28 09:19:26.740034 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 28 09:19:26.740034 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 09:19:26.740034 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 09:19:26.740034 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 09:19:26.740034 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 09:19:26.740034 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 09:19:26.740034 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 09:19:26.741088 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 09:19:26.741088 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application with Lock( Jul 28 09:19:26.741088 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 09:19:26.741088 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return self._enter() Jul 28 09:19:26.741088 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 09:19:26.741088 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 09:19:26.741088 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 09:19:26.741088 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return self.creator() Jul 28 09:19:26.741088 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 09:19:26.741088 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application created_value = creator( Jul 28 09:19:26.741088 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 28 09:19:26.741088 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 09:19:26.741088 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 28 09:19:26.741088 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application Jul 28 09:19:26.741088 dv-cinder-851351-1-smb devstack@keystone.service[479851]: [pid: 479851|app: 0|req: 352/713] 10.222.0.42 () {56 vars in 1111 bytes} [Thu Jul 28 09:19:26 2022] GET /identity/v3/services/network => generated 88 bytes in 261 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 09:19:26.746449 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c60c914d-26cb-46ad-a088-7e33c718b221 None admin] Authenticating user token {{(pid=479851) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:19:26.771414 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aad3042-7e25-4bb0-a083-dff251cf04ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:19:26.772068 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aad3042-7e25-4bb0-a083-dff251cf04ea None admin] REQUEST_METHOD: `GET` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:19:26.772351 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aad3042-7e25-4bb0-a083-dff251cf04ea None admin] SCRIPT_NAME: `/identity` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:19:26.772850 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aad3042-7e25-4bb0-a083-dff251cf04ea None admin] PATH_INFO: `/v3/domains` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:19:26.773417 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aad3042-7e25-4bb0-a083-dff251cf04ea None admin] RBAC: Adding query filter params (name=Default) {{(pid=479852) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 09:19:26.773756 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aad3042-7e25-4bb0-a083-dff251cf04ea None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:19:26.775339 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aad3042-7e25-4bb0-a083-dff251cf04ea None admin] RBAC: Authorization granted {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:19:26.813380 dv-cinder-851351-1-smb devstack@keystone.service[479852]: [pid: 479852|app: 0|req: 362/714] 10.222.0.42 () {56 vars in 1109 bytes} [Thu Jul 28 09:19:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 09:19:26.825479 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aad3042-7e25-4bb0-a083-dff251cf04ea None admin] Authenticating user token {{(pid=479852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:19:26.951424 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aad3042-7e25-4bb0-a083-dff251cf04ea None admin] Validating token access rules against request {{(pid=479852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:19:26.999478 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a99ad3f-f828-4d28-8a2a-9eb58efd822d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:19:27.000138 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a99ad3f-f828-4d28-8a2a-9eb58efd822d None admin] REQUEST_METHOD: `GET` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:19:27.000390 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a99ad3f-f828-4d28-8a2a-9eb58efd822d None admin] SCRIPT_NAME: `/identity` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:19:27.000593 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a99ad3f-f828-4d28-8a2a-9eb58efd822d None admin] PATH_INFO: `/v3/projects/service` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:19:27.008841 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c60c914d-26cb-46ad-a088-7e33c718b221 None admin] Validating token access rules against request {{(pid=479851) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:19:27.023505 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a99ad3f-f828-4d28-8a2a-9eb58efd822d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:19:27.025028 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a99ad3f-f828-4d28-8a2a-9eb58efd822d None admin] RBAC: Authorization granted {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:19:27.045369 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application [None req-0a99ad3f-f828-4d28-8a2a-9eb58efd822d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 09:19:27.045369 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 09:19:27.045369 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 09:19:27.045369 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 09:19:27.045369 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 09:19:27.045369 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 09:19:27.045369 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 09:19:27.045369 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 09:19:27.045369 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 09:19:27.045369 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 09:19:27.045369 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 09:19:27.045369 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 09:19:27.045369 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 28 09:19:27.045369 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 28 09:19:27.045369 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 28 09:19:27.046499 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 28 09:19:27.046499 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 09:19:27.046499 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 09:19:27.046499 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 09:19:27.046499 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 09:19:27.046499 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 09:19:27.046499 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 09:19:27.046499 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 09:19:27.046499 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application with Lock( Jul 28 09:19:27.046499 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 09:19:27.046499 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self._enter() Jul 28 09:19:27.046499 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 09:19:27.046499 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 09:19:27.046499 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 09:19:27.046499 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self.creator() Jul 28 09:19:27.046499 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 09:19:27.046499 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application created_value = creator( Jul 28 09:19:27.047555 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 28 09:19:27.047555 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 28 09:19:27.047555 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 28 09:19:27.047555 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 28 09:19:27.047555 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 28 09:19:27.047555 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 28 09:19:27.047555 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 09:19:27.047555 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application Jul 28 09:19:27.061738 dv-cinder-851351-1-smb devstack@keystone.service[479852]: [pid: 479852|app: 0|req: 363/715] 10.222.0.42 () {56 vars in 1111 bytes} [Thu Jul 28 09:19:26 2022] GET /identity/v3/projects/service => generated 88 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 09:19:27.062711 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a99ad3f-f828-4d28-8a2a-9eb58efd822d None admin] Authenticating user token {{(pid=479852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:19:27.090525 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f7a3ba-b14c-41ef-a6f1-46e764125b29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479851) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:19:27.091257 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f7a3ba-b14c-41ef-a6f1-46e764125b29 None admin] REQUEST_METHOD: `GET` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:19:27.091547 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f7a3ba-b14c-41ef-a6f1-46e764125b29 None admin] SCRIPT_NAME: `/identity` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:19:27.094601 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f7a3ba-b14c-41ef-a6f1-46e764125b29 None admin] PATH_INFO: `/v3/services` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:19:27.095365 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35f7a3ba-b14c-41ef-a6f1-46e764125b29 None admin] RBAC: Adding query filter params (name=network) {{(pid=479851) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 09:19:27.095686 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35f7a3ba-b14c-41ef-a6f1-46e764125b29 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:19:27.097154 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35f7a3ba-b14c-41ef-a6f1-46e764125b29 None admin] RBAC: Authorization granted {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:19:27.113232 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG dbcounter [-] [479852] Writing DB stats keystone:SELECT=100 {{(pid=479852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:19:27.114486 dv-cinder-851351-1-smb devstack@keystone.service[479851]: [pid: 479851|app: 0|req: 353/716] 10.222.0.42 () {56 vars in 1112 bytes} [Thu Jul 28 09:19:26 2022] GET /identity/v3/services?name=network => generated 124 bytes in 368 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 09:19:27.120885 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f7a3ba-b14c-41ef-a6f1-46e764125b29 None admin] Authenticating user token {{(pid=479851) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:19:27.210788 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a99ad3f-f828-4d28-8a2a-9eb58efd822d None admin] Validating token access rules against request {{(pid=479852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:19:27.214346 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG dbcounter [-] [479851] Writing DB stats keystone:SELECT=100 {{(pid=479851) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:19:27.249671 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259ed5ac-c166-4fa3-aa67-aecd7fec520c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:19:27.250669 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259ed5ac-c166-4fa3-aa67-aecd7fec520c None admin] REQUEST_METHOD: `GET` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:19:27.251180 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259ed5ac-c166-4fa3-aa67-aecd7fec520c None admin] SCRIPT_NAME: `/identity` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:19:27.251677 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259ed5ac-c166-4fa3-aa67-aecd7fec520c None admin] PATH_INFO: `/v3/projects` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:19:27.252707 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-259ed5ac-c166-4fa3-aa67-aecd7fec520c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=479852) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 09:19:27.253240 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-259ed5ac-c166-4fa3-aa67-aecd7fec520c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:19:27.254912 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-259ed5ac-c166-4fa3-aa67-aecd7fec520c None admin] RBAC: Authorization granted {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:19:27.269207 dv-cinder-851351-1-smb devstack@keystone.service[479852]: [pid: 479852|app: 0|req: 364/717] 10.222.0.42 () {56 vars in 1148 bytes} [Thu Jul 28 09:19:27 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:19:27.271048 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6aaf1f-0d4f-4812-b4b0-b475c9573f2a None None] REQUEST_METHOD: `GET` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:19:27.271571 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6aaf1f-0d4f-4812-b4b0-b475c9573f2a None None] SCRIPT_NAME: `/identity` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:19:27.272051 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6aaf1f-0d4f-4812-b4b0-b475c9573f2a None None] PATH_INFO: `/` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:19:27.277789 dv-cinder-851351-1-smb devstack@keystone.service[479852]: [pid: 479852|app: 0|req: 365/718] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 09:19:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 09:19:27.279380 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3dbdf0-3eee-484a-a4c2-1bc646cfae62 None None] REQUEST_METHOD: `POST` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:19:27.279897 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3dbdf0-3eee-484a-a4c2-1bc646cfae62 None None] SCRIPT_NAME: `/identity` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:19:27.280407 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3dbdf0-3eee-484a-a4c2-1bc646cfae62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:19:27.299985 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f7a3ba-b14c-41ef-a6f1-46e764125b29 None admin] Validating token access rules against request {{(pid=479851) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:19:27.302718 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.auth.core [None req-aa3dbdf0-3eee-484a-a4c2-1bc646cfae62 None None] MFA Rules not processed for user `c198f91a4ae84d2b9cc730a6e304c2be`. Rule list: `[]` (Enabled: `True`). {{(pid=479852) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 09:19:27.304431 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.fernet_utils [None req-aa3dbdf0-3eee-484a-a4c2-1bc646cfae62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=479852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 09:19:27.362008 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c91c04-e347-4b8d-98e7-2c8754db7d91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479851) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:19:27.363698 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c91c04-e347-4b8d-98e7-2c8754db7d91 None admin] REQUEST_METHOD: `GET` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:19:27.364303 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c91c04-e347-4b8d-98e7-2c8754db7d91 None admin] SCRIPT_NAME: `/identity` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:19:27.364928 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c91c04-e347-4b8d-98e7-2c8754db7d91 None admin] PATH_INFO: `/v3/services` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:19:27.366112 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83c91c04-e347-4b8d-98e7-2c8754db7d91 None admin] RBAC: Adding query filter params (type=network) {{(pid=479851) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 09:19:27.366639 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83c91c04-e347-4b8d-98e7-2c8754db7d91 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:19:27.369036 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83c91c04-e347-4b8d-98e7-2c8754db7d91 None admin] RBAC: Authorization granted {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:19:27.384712 dv-cinder-851351-1-smb devstack@keystone.service[479851]: [pid: 479851|app: 0|req: 354/719] 10.222.0.42 () {56 vars in 1112 bytes} [Thu Jul 28 09:19:27 2022] GET /identity/v3/services?type=network => generated 124 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:19:27.384712 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c91c04-e347-4b8d-98e7-2c8754db7d91 None admin] Authenticating user token {{(pid=479851) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:19:27.420315 dv-cinder-851351-1-smb devstack@keystone.service[479852]: [pid: 479852|app: 0|req: 366/720] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 09:19:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 09:19:27.459603 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa3dbdf0-3eee-484a-a4c2-1bc646cfae62 None None] Authenticating user token {{(pid=479852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:19:27.481789 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG dbcounter [-] [479852] Writing DB stats keystone:SELECT=100 {{(pid=479852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:19:27.551463 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG dbcounter [-] [479851] Writing DB stats keystone:SELECT=100 {{(pid=479851) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:19:27.574952 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c91c04-e347-4b8d-98e7-2c8754db7d91 None admin] Validating token access rules against request {{(pid=479851) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:19:27.637645 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef336f3-a5c9-46be-a942-d1e7a2a0b8f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479851) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:19:27.638292 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef336f3-a5c9-46be-a942-d1e7a2a0b8f1 None admin] REQUEST_METHOD: `GET` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:19:27.638667 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef336f3-a5c9-46be-a942-d1e7a2a0b8f1 None admin] SCRIPT_NAME: `/identity` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:19:27.638854 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef336f3-a5c9-46be-a942-d1e7a2a0b8f1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:19:27.639658 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef336f3-a5c9-46be-a942-d1e7a2a0b8f1 None admin] RBAC: Adding query filter params (role.id=685084310b35477b9b2d0c7934d0f803, scope.project.id=3a0fb8ea8010437bade8f92dcbcaacee, user.id=c824cbfdc0dc4532ac6af71cbb6841fd) {{(pid=479851) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 09:19:27.639972 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef336f3-a5c9-46be-a942-d1e7a2a0b8f1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:19:27.641602 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef336f3-a5c9-46be-a942-d1e7a2a0b8f1 None admin] RBAC: Authorization granted {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:19:27.648280 dv-cinder-851351-1-smb devstack@keystone.service[479851]: [pid: 479851|app: 0|req: 355/721] 10.222.0.42 () {56 vars in 1374 bytes} [Thu Jul 28 09:19:27 2022] GET /identity/v3/role_assignments?user.id=c824cbfdc0dc4532ac6af71cbb6841fd&scope.project.id=3a0fb8ea8010437bade8f92dcbcaacee&role.id=685084310b35477b9b2d0c7934d0f803 => generated 259 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:19:27.655167 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa3dbdf0-3eee-484a-a4c2-1bc646cfae62 None None] Validating token access rules against request {{(pid=479852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:19:27.702672 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c846207-ce6d-4b23-8956-83f07577e411 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:19:27.703352 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c846207-ce6d-4b23-8956-83f07577e411 None admin] REQUEST_METHOD: `GET` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:19:27.703634 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c846207-ce6d-4b23-8956-83f07577e411 None admin] SCRIPT_NAME: `/identity` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:19:27.703916 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c846207-ce6d-4b23-8956-83f07577e411 None admin] PATH_INFO: `/v3/roles/service` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:19:27.717326 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c846207-ce6d-4b23-8956-83f07577e411 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 09:19:27.722972 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application [None req-5c846207-ce6d-4b23-8956-83f07577e411 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 28 09:19:27.722972 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 09:19:27.722972 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 09:19:27.722972 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 09:19:27.722972 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 09:19:27.722972 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 09:19:27.722972 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 09:19:27.722972 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 09:19:27.722972 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 09:19:27.722972 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 09:19:27.722972 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 09:19:27.722972 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 09:19:27.722972 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 09:19:27.722972 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 09:19:27.722972 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 09:19:27.722972 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 09:19:27.724273 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 09:19:27.724273 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 09:19:27.724273 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 09:19:27.724273 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 09:19:27.724273 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 09:19:27.724273 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 09:19:27.724273 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 09:19:27.724273 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 09:19:27.724273 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 09:19:27.724273 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 09:19:27.724273 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 09:19:27.724273 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application with Lock( Jul 28 09:19:27.724273 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 09:19:27.724273 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self._enter() Jul 28 09:19:27.724273 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 09:19:27.724273 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 09:19:27.725309 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 09:19:27.725309 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self.creator() Jul 28 09:19:27.725309 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 09:19:27.725309 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application created_value = creator( Jul 28 09:19:27.725309 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 09:19:27.725309 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 09:19:27.725309 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 09:19:27.725309 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 09:19:27.725309 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 09:19:27.725309 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 09:19:27.725309 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 28 09:19:27.725309 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application Jul 28 09:19:27.725309 dv-cinder-851351-1-smb devstack@keystone.service[479852]: [pid: 479852|app: 0|req: 367/722] 10.222.0.42 () {56 vars in 1102 bytes} [Thu Jul 28 09:19:27 2022] GET /identity/v3/roles/service => generated 85 bytes in 266 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 09:19:27.733013 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef336f3-a5c9-46be-a942-d1e7a2a0b8f1 None admin] Authenticating user token {{(pid=479851) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:19:27.880196 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef336f3-a5c9-46be-a942-d1e7a2a0b8f1 None admin] Validating token access rules against request {{(pid=479851) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:19:27.918640 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6bde26-b341-4c00-986d-0de7d6fa40bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479851) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:19:27.919281 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6bde26-b341-4c00-986d-0de7d6fa40bf None admin] REQUEST_METHOD: `GET` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:19:27.919573 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6bde26-b341-4c00-986d-0de7d6fa40bf None admin] SCRIPT_NAME: `/identity` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:19:27.919859 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6bde26-b341-4c00-986d-0de7d6fa40bf None admin] PATH_INFO: `/v3/roles` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:19:27.920602 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e6bde26-b341-4c00-986d-0de7d6fa40bf None admin] RBAC: Adding query filter params (name=service) {{(pid=479851) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 09:19:27.920942 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e6bde26-b341-4c00-986d-0de7d6fa40bf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:19:27.922364 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e6bde26-b341-4c00-986d-0de7d6fa40bf None admin] RBAC: Authorization granted {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:19:27.932560 dv-cinder-851351-1-smb devstack@keystone.service[479851]: [pid: 479851|app: 0|req: 356/723] 10.222.0.42 () {56 vars in 1103 bytes} [Thu Jul 28 09:19:27 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:19:27.942126 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c846207-ce6d-4b23-8956-83f07577e411 None admin] Authenticating user token {{(pid=479852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:19:28.095068 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG dbcounter [-] [479852] Writing DB stats keystone:SELECT=100 {{(pid=479852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:19:28.139542 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c846207-ce6d-4b23-8956-83f07577e411 None admin] Validating token access rules against request {{(pid=479852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:19:28.196088 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f3bcc9-a0e0-4a35-8379-c415e3bee0a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:19:28.197125 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f3bcc9-a0e0-4a35-8379-c415e3bee0a8 None admin] REQUEST_METHOD: `GET` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:19:28.197412 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f3bcc9-a0e0-4a35-8379-c415e3bee0a8 None admin] SCRIPT_NAME: `/identity` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:19:28.197691 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f3bcc9-a0e0-4a35-8379-c415e3bee0a8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:19:28.216360 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78f3bcc9-a0e0-4a35-8379-c415e3bee0a8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:19:28.217926 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78f3bcc9-a0e0-4a35-8379-c415e3bee0a8 None admin] RBAC: Authorization granted {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:19:28.243820 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application [None req-78f3bcc9-a0e0-4a35-8379-c415e3bee0a8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 09:19:28.243820 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 09:19:28.243820 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 09:19:28.243820 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 09:19:28.243820 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 09:19:28.243820 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 09:19:28.243820 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 09:19:28.243820 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 09:19:28.243820 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 09:19:28.243820 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 09:19:28.243820 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 09:19:28.243820 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 09:19:28.243820 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 09:19:28.243820 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 09:19:28.243820 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 09:19:28.245038 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 09:19:28.245038 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 09:19:28.245038 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 09:19:28.245038 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 09:19:28.245038 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 09:19:28.245038 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 09:19:28.245038 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 09:19:28.245038 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 09:19:28.245038 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application with Lock( Jul 28 09:19:28.245038 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 09:19:28.245038 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self._enter() Jul 28 09:19:28.245038 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 09:19:28.245038 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 09:19:28.245038 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 09:19:28.245038 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self.creator() Jul 28 09:19:28.245038 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 09:19:28.245038 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application created_value = creator( Jul 28 09:19:28.246738 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 09:19:28.246738 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 09:19:28.246738 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 09:19:28.246738 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application Jul 28 09:19:28.246738 dv-cinder-851351-1-smb devstack@keystone.service[479852]: [pid: 479852|app: 0|req: 368/724] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 09:19:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 304 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 09:19:28.251498 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6bde26-b341-4c00-986d-0de7d6fa40bf None admin] Authenticating user token {{(pid=479851) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:19:28.303149 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG dbcounter [-] [479851] Writing DB stats keystone:SELECT=100 {{(pid=479851) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:19:28.447172 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6bde26-b341-4c00-986d-0de7d6fa40bf None admin] Validating token access rules against request {{(pid=479851) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:19:28.467887 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2e0a0c-5ee1-461b-9365-db44e8971621 None None] REQUEST_METHOD: `GET` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:19:28.468539 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2e0a0c-5ee1-461b-9365-db44e8971621 None None] SCRIPT_NAME: `/identity` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:19:28.469090 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2e0a0c-5ee1-461b-9365-db44e8971621 None None] PATH_INFO: `/` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:19:28.472138 dv-cinder-851351-1-smb devstack@keystone.service[479852]: [pid: 479852|app: 0|req: 369/725] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 09:19:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 09:19:28.477053 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb157beb-f5c5-49e1-86ad-719754ae2334 None None] REQUEST_METHOD: `POST` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:19:28.477644 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb157beb-f5c5-49e1-86ad-719754ae2334 None None] SCRIPT_NAME: `/identity` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:19:28.478131 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb157beb-f5c5-49e1-86ad-719754ae2334 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:19:28.499299 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.auth.core [None req-fb157beb-f5c5-49e1-86ad-719754ae2334 None None] MFA Rules not processed for user `c198f91a4ae84d2b9cc730a6e304c2be`. Rule list: `[]` (Enabled: `True`). {{(pid=479852) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 09:19:28.500990 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.fernet_utils [None req-fb157beb-f5c5-49e1-86ad-719754ae2334 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=479852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 09:19:28.502429 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f052d17-96b5-468c-b814-eb0cb73142eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479851) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:19:28.503323 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f052d17-96b5-468c-b814-eb0cb73142eb None admin] REQUEST_METHOD: `GET` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:19:28.503723 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f052d17-96b5-468c-b814-eb0cb73142eb None admin] SCRIPT_NAME: `/identity` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:19:28.504163 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f052d17-96b5-468c-b814-eb0cb73142eb None admin] PATH_INFO: `/v3/domains` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:19:28.506185 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f052d17-96b5-468c-b814-eb0cb73142eb None admin] RBAC: Adding query filter params (name=Default) {{(pid=479851) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 09:19:28.506185 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f052d17-96b5-468c-b814-eb0cb73142eb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:19:28.507846 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f052d17-96b5-468c-b814-eb0cb73142eb None admin] RBAC: Authorization granted {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:19:28.526897 dv-cinder-851351-1-smb devstack@keystone.service[479851]: [pid: 479851|app: 0|req: 357/726] 10.222.0.42 () {56 vars in 1109 bytes} [Thu Jul 28 09:19:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:19:28.538124 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f052d17-96b5-468c-b814-eb0cb73142eb None admin] Authenticating user token {{(pid=479851) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:19:28.584846 dv-cinder-851351-1-smb devstack@keystone.service[479852]: [pid: 479852|app: 0|req: 370/727] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 09:19:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 28 09:19:28.613480 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb157beb-f5c5-49e1-86ad-719754ae2334 None None] Authenticating user token {{(pid=479852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:19:28.680235 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG dbcounter [-] [479852] Writing DB stats keystone:SELECT=100 {{(pid=479852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:19:28.716605 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG dbcounter [-] [479851] Writing DB stats keystone:SELECT=100 {{(pid=479851) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:19:28.732919 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb157beb-f5c5-49e1-86ad-719754ae2334 None None] Validating token access rules against request {{(pid=479852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:19:28.755958 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f052d17-96b5-468c-b814-eb0cb73142eb None admin] Validating token access rules against request {{(pid=479851) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:19:28.773861 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e72925-7796-4fff-94c1-1678c4ed2222 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:19:28.774914 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e72925-7796-4fff-94c1-1678c4ed2222 None admin] REQUEST_METHOD: `GET` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:19:28.775432 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e72925-7796-4fff-94c1-1678c4ed2222 None admin] SCRIPT_NAME: `/identity` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:19:28.775938 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e72925-7796-4fff-94c1-1678c4ed2222 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:19:28.788856 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81e72925-7796-4fff-94c1-1678c4ed2222 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 09:19:28.794918 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application [None req-81e72925-7796-4fff-94c1-1678c4ed2222 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 09:19:28.794918 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 09:19:28.794918 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 09:19:28.794918 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 09:19:28.794918 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 09:19:28.794918 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 09:19:28.794918 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 09:19:28.794918 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 09:19:28.794918 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 09:19:28.794918 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 09:19:28.794918 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 09:19:28.794918 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 09:19:28.794918 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 09:19:28.794918 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 09:19:28.794918 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 09:19:28.794918 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 09:19:28.796154 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 09:19:28.796154 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 09:19:28.796154 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 09:19:28.796154 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 09:19:28.796154 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 09:19:28.796154 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 09:19:28.796154 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 09:19:28.796154 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 09:19:28.796154 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 09:19:28.796154 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 09:19:28.796154 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 09:19:28.796154 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application with Lock( Jul 28 09:19:28.796154 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 09:19:28.796154 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self._enter() Jul 28 09:19:28.796154 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 09:19:28.796154 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 09:19:28.797597 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 09:19:28.797597 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self.creator() Jul 28 09:19:28.797597 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 09:19:28.797597 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application created_value = creator( Jul 28 09:19:28.797597 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 09:19:28.797597 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 09:19:28.797597 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 09:19:28.797597 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 09:19:28.797597 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 09:19:28.797597 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 09:19:28.797597 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 09:19:28.797597 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application Jul 28 09:19:28.798365 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8b534a-cf65-4dde-9868-165f086abde1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479851) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:19:28.798365 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8b534a-cf65-4dde-9868-165f086abde1 None admin] REQUEST_METHOD: `GET` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:19:28.798365 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8b534a-cf65-4dde-9868-165f086abde1 None admin] SCRIPT_NAME: `/identity` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:19:28.798365 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8b534a-cf65-4dde-9868-165f086abde1 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:19:28.805548 dv-cinder-851351-1-smb devstack@keystone.service[479852]: [pid: 479852|app: 0|req: 371/728] 10.222.0.42 () {56 vars in 1096 bytes} [Thu Jul 28 09:19:28 2022] GET /identity/v3/roles/admin => generated 83 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 09:19:28.805763 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb8b534a-cf65-4dde-9868-165f086abde1 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:19:28.807175 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb8b534a-cf65-4dde-9868-165f086abde1 None admin] RBAC: Authorization granted {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:19:28.807774 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b97339-966c-4bfa-88ad-afdb317e88bd None None] REQUEST_METHOD: `GET` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:19:28.808272 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b97339-966c-4bfa-88ad-afdb317e88bd None None] SCRIPT_NAME: `/identity` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:19:28.808782 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b97339-966c-4bfa-88ad-afdb317e88bd None None] PATH_INFO: `/` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:19:28.810865 dv-cinder-851351-1-smb devstack@keystone.service[479852]: [pid: 479852|app: 0|req: 372/729] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 09:19:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 09:19:28.817981 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98bc8a0f-eea6-4388-bede-fddeb9db093c None None] REQUEST_METHOD: `POST` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:19:28.818279 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98bc8a0f-eea6-4388-bede-fddeb9db093c None None] SCRIPT_NAME: `/identity` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:19:28.818536 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98bc8a0f-eea6-4388-bede-fddeb9db093c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:19:28.824861 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application [None req-cb8b534a-cf65-4dde-9868-165f086abde1 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 28 09:19:28.824861 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 09:19:28.824861 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 09:19:28.824861 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 09:19:28.824861 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 09:19:28.824861 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 09:19:28.824861 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 09:19:28.824861 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 09:19:28.824861 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 09:19:28.824861 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 09:19:28.824861 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 09:19:28.824861 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 09:19:28.824861 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 28 09:19:28.824861 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 28 09:19:28.824861 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 28 09:19:28.824861 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 28 09:19:28.825957 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 09:19:28.825957 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 09:19:28.825957 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 28 09:19:28.825957 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 09:19:28.825957 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 28 09:19:28.825957 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 09:19:28.825957 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 09:19:28.825957 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 09:19:28.825957 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 09:19:28.825957 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 09:19:28.825957 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 09:19:28.825957 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application with Lock( Jul 28 09:19:28.825957 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 09:19:28.825957 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return self._enter() Jul 28 09:19:28.825957 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 09:19:28.825957 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 09:19:28.825957 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 09:19:28.825957 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return self.creator() Jul 28 09:19:28.827052 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 09:19:28.827052 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application created_value = creator( Jul 28 09:19:28.827052 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 28 09:19:28.827052 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 28 09:19:28.827052 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 28 09:19:28.827052 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 28 09:19:28.827052 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 28 09:19:28.827052 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 28 09:19:28.827052 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 28 09:19:28.827052 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application Jul 28 09:19:28.829877 dv-cinder-851351-1-smb devstack@keystone.service[479851]: [pid: 479851|app: 0|req: 358/730] 10.222.0.42 () {56 vars in 1117 bytes} [Thu Jul 28 09:19:28 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 292 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 09:19:28.834478 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8b534a-cf65-4dde-9868-165f086abde1 None admin] Authenticating user token {{(pid=479851) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:19:28.839284 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.auth.core [None req-98bc8a0f-eea6-4388-bede-fddeb9db093c None None] MFA Rules not processed for user `c198f91a4ae84d2b9cc730a6e304c2be`. Rule list: `[]` (Enabled: `True`). {{(pid=479852) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 09:19:28.840525 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.fernet_utils [None req-98bc8a0f-eea6-4388-bede-fddeb9db093c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=479852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 09:19:28.917094 dv-cinder-851351-1-smb devstack@keystone.service[479852]: [pid: 479852|app: 0|req: 373/731] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 09:19:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 09:19:28.917778 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98bc8a0f-eea6-4388-bede-fddeb9db093c None None] Authenticating user token {{(pid=479852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:19:28.951261 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8b534a-cf65-4dde-9868-165f086abde1 None admin] Validating token access rules against request {{(pid=479851) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:19:28.990816 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG dbcounter [-] [479852] Writing DB stats keystone:SELECT=100 {{(pid=479852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:19:28.994253 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec17d3e4-36a6-4de6-a5b3-dbea6adbfb1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479851) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:19:28.994961 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec17d3e4-36a6-4de6-a5b3-dbea6adbfb1a None admin] REQUEST_METHOD: `GET` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:19:28.995316 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec17d3e4-36a6-4de6-a5b3-dbea6adbfb1a None admin] SCRIPT_NAME: `/identity` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:19:28.995695 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec17d3e4-36a6-4de6-a5b3-dbea6adbfb1a None admin] PATH_INFO: `/v3/roles` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:19:28.996868 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec17d3e4-36a6-4de6-a5b3-dbea6adbfb1a None admin] RBAC: Adding query filter params (name=admin) {{(pid=479851) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 09:19:28.997251 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec17d3e4-36a6-4de6-a5b3-dbea6adbfb1a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:19:28.998972 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec17d3e4-36a6-4de6-a5b3-dbea6adbfb1a None admin] RBAC: Authorization granted {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:19:29.002044 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG dbcounter [-] [479851] Writing DB stats keystone:SELECT=100 {{(pid=479851) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:19:29.016784 dv-cinder-851351-1-smb devstack@keystone.service[479851]: [pid: 479851|app: 0|req: 359/732] 10.222.0.42 () {56 vars in 1099 bytes} [Thu Jul 28 09:19:28 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:19:29.017964 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec17d3e4-36a6-4de6-a5b3-dbea6adbfb1a None admin] Authenticating user token {{(pid=479851) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:19:29.075933 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98bc8a0f-eea6-4388-bede-fddeb9db093c None None] Validating token access rules against request {{(pid=479852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:19:29.116865 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d62be725-45ed-4381-9c0c-f594537eb322 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:19:29.117564 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62be725-45ed-4381-9c0c-f594537eb322 None admin] REQUEST_METHOD: `GET` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:19:29.117770 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62be725-45ed-4381-9c0c-f594537eb322 None admin] SCRIPT_NAME: `/identity` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:19:29.118048 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62be725-45ed-4381-9c0c-f594537eb322 None admin] PATH_INFO: `/v3/users` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:19:29.118872 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d62be725-45ed-4381-9c0c-f594537eb322 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=479852) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 09:19:29.119223 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d62be725-45ed-4381-9c0c-f594537eb322 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:19:29.120712 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d62be725-45ed-4381-9c0c-f594537eb322 None admin] RBAC: Authorization granted {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:19:29.146945 dv-cinder-851351-1-smb devstack@keystone.service[479852]: [pid: 479852|app: 0|req: 374/733] 10.222.0.42 () {56 vars in 1149 bytes} [Thu Jul 28 09:19:28 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:19:29.148550 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d62be725-45ed-4381-9c0c-f594537eb322 None admin] Authenticating user token {{(pid=479852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:19:29.153805 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec17d3e4-36a6-4de6-a5b3-dbea6adbfb1a None admin] Validating token access rules against request {{(pid=479851) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:19:29.200344 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b5a119-1c71-415e-ab3b-34f033653bcb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479851) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:19:29.201054 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b5a119-1c71-415e-ab3b-34f033653bcb None admin] REQUEST_METHOD: `POST` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:19:29.201339 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b5a119-1c71-415e-ab3b-34f033653bcb None admin] SCRIPT_NAME: `/identity` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:19:29.201615 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b5a119-1c71-415e-ab3b-34f033653bcb None admin] PATH_INFO: `/v3/services` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:19:29.202332 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b5a119-1c71-415e-ab3b-34f033653bcb None admin] RBAC: Authorizing `identity:create_service()` {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:19:29.204034 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b5a119-1c71-415e-ab3b-34f033653bcb None admin] RBAC: Authorization granted {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:19:29.229778 dv-cinder-851351-1-smb devstack@keystone.service[479851]: [pid: 479851|app: 0|req: 360/734] 10.222.0.42 () {60 vars in 1141 bytes} [Thu Jul 28 09:19:29 2022] POST /identity/v3/services => generated 251 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 09:19:29.230758 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b5a119-1c71-415e-ab3b-34f033653bcb None admin] Authenticating user token {{(pid=479851) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:19:29.314595 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG dbcounter [-] [479851] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=479851) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:19:29.354726 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d62be725-45ed-4381-9c0c-f594537eb322 None admin] Validating token access rules against request {{(pid=479852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:19:29.356807 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG dbcounter [-] [479852] Writing DB stats keystone:SELECT=100 {{(pid=479852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:19:29.422308 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b5a119-1c71-415e-ab3b-34f033653bcb None admin] Validating token access rules against request {{(pid=479851) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:19:29.448373 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9866ef-4f35-4c01-91ad-5a149203e7d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:19:29.449085 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9866ef-4f35-4c01-91ad-5a149203e7d8 None admin] REQUEST_METHOD: `GET` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:19:29.449365 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9866ef-4f35-4c01-91ad-5a149203e7d8 None admin] SCRIPT_NAME: `/identity` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:19:29.449645 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9866ef-4f35-4c01-91ad-5a149203e7d8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:19:29.472556 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905f1e03-6f0a-4676-949e-7ea3b921effc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479851) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:19:29.473249 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905f1e03-6f0a-4676-949e-7ea3b921effc None admin] REQUEST_METHOD: `GET` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:19:29.473532 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905f1e03-6f0a-4676-949e-7ea3b921effc None admin] SCRIPT_NAME: `/identity` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:19:29.474070 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905f1e03-6f0a-4676-949e-7ea3b921effc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:19:29.475110 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d9866ef-4f35-4c01-91ad-5a149203e7d8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:19:29.476600 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d9866ef-4f35-4c01-91ad-5a149203e7d8 None admin] RBAC: Authorization granted {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:19:29.507474 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application [None req-4d9866ef-4f35-4c01-91ad-5a149203e7d8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 09:19:29.507474 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 09:19:29.507474 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 09:19:29.507474 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 09:19:29.507474 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 09:19:29.507474 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 09:19:29.507474 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 09:19:29.507474 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 09:19:29.507474 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 09:19:29.507474 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 09:19:29.507474 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 09:19:29.507474 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 09:19:29.507474 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 09:19:29.507474 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 09:19:29.507474 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 09:19:29.508626 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 09:19:29.508626 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 09:19:29.508626 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 09:19:29.508626 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 09:19:29.508626 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 09:19:29.508626 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 09:19:29.508626 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 09:19:29.508626 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 09:19:29.508626 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application with Lock( Jul 28 09:19:29.508626 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 09:19:29.508626 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self._enter() Jul 28 09:19:29.508626 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 09:19:29.508626 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 09:19:29.508626 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 09:19:29.508626 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self.creator() Jul 28 09:19:29.508626 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 09:19:29.508626 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application created_value = creator( Jul 28 09:19:29.509707 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 09:19:29.509707 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 09:19:29.509707 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 09:19:29.509707 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application Jul 28 09:19:29.517351 dv-cinder-851351-1-smb devstack@keystone.service[479852]: [pid: 479852|app: 0|req: 375/735] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 09:19:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 370 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 09:19:29.523558 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9866ef-4f35-4c01-91ad-5a149203e7d8 None admin] Authenticating user token {{(pid=479852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:19:29.560106 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-905f1e03-6f0a-4676-949e-7ea3b921effc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:19:29.561825 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-905f1e03-6f0a-4676-949e-7ea3b921effc None admin] RBAC: Authorization granted {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:19:29.644975 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG dbcounter [-] [479851] Writing DB stats keystone:SELECT=100 {{(pid=479851) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:19:29.666031 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9866ef-4f35-4c01-91ad-5a149203e7d8 None admin] Validating token access rules against request {{(pid=479852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:19:29.709387 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccadefbe-6fae-416a-94d6-811e2ff1ed28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:19:29.709825 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccadefbe-6fae-416a-94d6-811e2ff1ed28 None admin] REQUEST_METHOD: `GET` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:19:29.710155 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccadefbe-6fae-416a-94d6-811e2ff1ed28 None admin] SCRIPT_NAME: `/identity` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:19:29.710625 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccadefbe-6fae-416a-94d6-811e2ff1ed28 None admin] PATH_INFO: `/v3/domains` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:19:29.711395 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccadefbe-6fae-416a-94d6-811e2ff1ed28 None admin] RBAC: Adding query filter params (name=Default) {{(pid=479852) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 09:19:29.711796 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccadefbe-6fae-416a-94d6-811e2ff1ed28 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:19:29.713151 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccadefbe-6fae-416a-94d6-811e2ff1ed28 None admin] RBAC: Authorization granted {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:19:29.719515 dv-cinder-851351-1-smb devstack@keystone.service[479851]: [pid: 479851|app: 0|req: 361/736] 10.222.0.42 () {58 vars in 1282 bytes} [Thu Jul 28 09:19:29 2022] GET /identity/v3/auth/tokens => generated 903 bytes in 489 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 28 09:19:29.725561 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905f1e03-6f0a-4676-949e-7ea3b921effc None admin] Authenticating user token {{(pid=479851) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:19:29.730730 dv-cinder-851351-1-smb devstack@keystone.service[479852]: [pid: 479852|app: 0|req: 376/737] 10.222.0.42 () {56 vars in 1109 bytes} [Thu Jul 28 09:19:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 09:19:29.742121 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccadefbe-6fae-416a-94d6-811e2ff1ed28 None admin] Authenticating user token {{(pid=479852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:19:29.765073 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG dbcounter [-] [479852] Writing DB stats keystone:SELECT=100 {{(pid=479852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:19:29.857908 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905f1e03-6f0a-4676-949e-7ea3b921effc None admin] Validating token access rules against request {{(pid=479851) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:19:29.882848 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccadefbe-6fae-416a-94d6-811e2ff1ed28 None admin] Validating token access rules against request {{(pid=479852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:19:29.902822 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97fb0f3c-31a8-4a1a-aa30-cfce27cfea83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479851) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:19:29.903924 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97fb0f3c-31a8-4a1a-aa30-cfce27cfea83 None admin] REQUEST_METHOD: `GET` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:19:29.904215 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97fb0f3c-31a8-4a1a-aa30-cfce27cfea83 None admin] SCRIPT_NAME: `/identity` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:19:29.904498 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97fb0f3c-31a8-4a1a-aa30-cfce27cfea83 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:19:29.919295 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97fb0f3c-31a8-4a1a-aa30-cfce27cfea83 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:19:29.921544 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97fb0f3c-31a8-4a1a-aa30-cfce27cfea83 None admin] RBAC: Authorization granted {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:19:29.929070 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00906cd8-b280-4bbf-8737-b1a3fffb5fdf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:19:29.929829 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00906cd8-b280-4bbf-8737-b1a3fffb5fdf None admin] REQUEST_METHOD: `GET` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:19:29.930742 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00906cd8-b280-4bbf-8737-b1a3fffb5fdf None admin] SCRIPT_NAME: `/identity` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:19:29.931075 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00906cd8-b280-4bbf-8737-b1a3fffb5fdf None admin] PATH_INFO: `/v3/users/swift` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:19:29.940115 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application [None req-97fb0f3c-31a8-4a1a-aa30-cfce27cfea83 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 09:19:29.940115 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 09:19:29.940115 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 09:19:29.940115 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 09:19:29.940115 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 09:19:29.940115 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 09:19:29.940115 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 09:19:29.940115 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 09:19:29.940115 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 09:19:29.940115 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 09:19:29.940115 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 09:19:29.940115 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 09:19:29.940115 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 09:19:29.940115 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 09:19:29.940115 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 09:19:29.941292 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 09:19:29.941292 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 09:19:29.941292 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 09:19:29.941292 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 09:19:29.941292 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 09:19:29.941292 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 09:19:29.941292 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 09:19:29.941292 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 09:19:29.941292 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application with Lock( Jul 28 09:19:29.941292 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 09:19:29.941292 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return self._enter() Jul 28 09:19:29.941292 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 09:19:29.941292 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 09:19:29.941292 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 09:19:29.941292 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return self.creator() Jul 28 09:19:29.941292 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 09:19:29.941292 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application created_value = creator( Jul 28 09:19:29.942979 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 09:19:29.942979 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 09:19:29.942979 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 09:19:29.942979 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application Jul 28 09:19:29.943238 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00906cd8-b280-4bbf-8737-b1a3fffb5fdf None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:19:29.943238 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00906cd8-b280-4bbf-8737-b1a3fffb5fdf None admin] RBAC: Authorization granted {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:19:29.943410 dv-cinder-851351-1-smb devstack@keystone.service[479851]: [pid: 479851|app: 0|req: 362/738] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 09:19:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 09:19:29.943410 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47419a2-e74e-44dc-b6cd-be471c01756e None None] REQUEST_METHOD: `GET` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:19:29.943558 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47419a2-e74e-44dc-b6cd-be471c01756e None None] SCRIPT_NAME: `/identity` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:19:29.944849 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47419a2-e74e-44dc-b6cd-be471c01756e None None] PATH_INFO: `/` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:19:29.946700 dv-cinder-851351-1-smb devstack@keystone.service[479851]: [pid: 479851|app: 0|req: 363/739] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 09:19:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 09:19:29.951633 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47419a2-e74e-44dc-b6cd-be471c01756e None None] Authenticating user token {{(pid=479851) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:19:29.962817 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG dbcounter [-] [479851] Writing DB stats keystone:SELECT=100 {{(pid=479851) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:19:30.079452 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47419a2-e74e-44dc-b6cd-be471c01756e None None] Validating token access rules against request {{(pid=479851) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:19:30.087828 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application [None req-00906cd8-b280-4bbf-8737-b1a3fffb5fdf None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 28 09:19:30.087828 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 09:19:30.087828 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 09:19:30.087828 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 09:19:30.087828 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 09:19:30.087828 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 09:19:30.087828 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 09:19:30.087828 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 09:19:30.087828 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 09:19:30.087828 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 09:19:30.087828 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 09:19:30.087828 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 09:19:30.087828 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 28 09:19:30.087828 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 28 09:19:30.087828 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 28 09:19:30.087828 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 28 09:19:30.089862 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 09:19:30.089862 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 09:19:30.089862 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 28 09:19:30.089862 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 09:19:30.089862 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 28 09:19:30.089862 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 09:19:30.089862 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 09:19:30.089862 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 09:19:30.089862 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 09:19:30.089862 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 09:19:30.089862 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 09:19:30.089862 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application with Lock( Jul 28 09:19:30.089862 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 09:19:30.089862 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self._enter() Jul 28 09:19:30.089862 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 09:19:30.089862 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 09:19:30.089862 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 09:19:30.089862 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self.creator() Jul 28 09:19:30.091219 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 09:19:30.091219 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application created_value = creator( Jul 28 09:19:30.091219 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 28 09:19:30.091219 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 28 09:19:30.091219 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 28 09:19:30.091219 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 28 09:19:30.091219 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 28 09:19:30.091219 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 28 09:19:30.091219 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 28 09:19:30.091219 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application Jul 28 09:19:30.091219 dv-cinder-851351-1-smb devstack@keystone.service[479852]: [pid: 479852|app: 0|req: 377/740] 10.222.0.42 () {56 vars in 1096 bytes} [Thu Jul 28 09:19:29 2022] GET /identity/v3/users/swift => generated 83 bytes in 348 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 09:19:30.091219 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19401dda-742d-4d44-8e5a-f2b95ba4d71f None None] REQUEST_METHOD: `POST` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:19:30.091219 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19401dda-742d-4d44-8e5a-f2b95ba4d71f None None] SCRIPT_NAME: `/identity` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:19:30.092064 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19401dda-742d-4d44-8e5a-f2b95ba4d71f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:19:30.109993 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.auth.core [None req-19401dda-742d-4d44-8e5a-f2b95ba4d71f None None] MFA Rules not processed for user `c198f91a4ae84d2b9cc730a6e304c2be`. Rule list: `[]` (Enabled: `True`). {{(pid=479852) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 09:19:30.111212 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.fernet_utils [None req-19401dda-742d-4d44-8e5a-f2b95ba4d71f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=479852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 09:19:30.124021 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a2183f-1e8f-4d7a-b658-98c3e6ae1b80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479851) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:19:30.124829 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a2183f-1e8f-4d7a-b658-98c3e6ae1b80 None admin] REQUEST_METHOD: `GET` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:19:30.125122 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a2183f-1e8f-4d7a-b658-98c3e6ae1b80 None admin] SCRIPT_NAME: `/identity` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:19:30.125408 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a2183f-1e8f-4d7a-b658-98c3e6ae1b80 None admin] PATH_INFO: `/v3/domains` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:19:30.126383 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82a2183f-1e8f-4d7a-b658-98c3e6ae1b80 None admin] RBAC: Adding query filter params (name=Default) {{(pid=479851) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 09:19:30.127193 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82a2183f-1e8f-4d7a-b658-98c3e6ae1b80 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:19:30.129447 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82a2183f-1e8f-4d7a-b658-98c3e6ae1b80 None admin] RBAC: Authorization granted {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:19:30.145316 dv-cinder-851351-1-smb devstack@keystone.service[479851]: [pid: 479851|app: 0|req: 364/741] 10.222.0.42 () {56 vars in 1109 bytes} [Thu Jul 28 09:19:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:19:30.147027 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6c866f-cab6-428b-86a2-820e40a94f5d None None] REQUEST_METHOD: `GET` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:19:30.147320 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6c866f-cab6-428b-86a2-820e40a94f5d None None] SCRIPT_NAME: `/identity` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:19:30.147603 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6c866f-cab6-428b-86a2-820e40a94f5d None None] PATH_INFO: `/` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:19:30.149079 dv-cinder-851351-1-smb devstack@keystone.service[479851]: [pid: 479851|app: 0|req: 365/742] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 09:19:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 09:19:30.149591 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c6c866f-cab6-428b-86a2-820e40a94f5d None None] Authenticating user token {{(pid=479851) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:19:30.189644 dv-cinder-851351-1-smb devstack@keystone.service[479852]: [pid: 479852|app: 0|req: 378/743] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 09:19:30 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 09:19:30.191236 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19401dda-742d-4d44-8e5a-f2b95ba4d71f None None] Authenticating user token {{(pid=479852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:19:30.198011 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG dbcounter [-] [479852] Writing DB stats keystone:SELECT=100 {{(pid=479852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:19:30.237244 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG dbcounter [-] [479851] Writing DB stats keystone:SELECT=100 {{(pid=479851) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:19:30.278306 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c6c866f-cab6-428b-86a2-820e40a94f5d None None] Validating token access rules against request {{(pid=479851) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:19:30.309613 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19401dda-742d-4d44-8e5a-f2b95ba4d71f None None] Validating token access rules against request {{(pid=479852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:19:30.315372 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6395b2-5fb3-4efa-8526-fa4c8313509d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479851) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:19:30.316098 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6395b2-5fb3-4efa-8526-fa4c8313509d None admin] REQUEST_METHOD: `GET` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:19:30.316305 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6395b2-5fb3-4efa-8526-fa4c8313509d None admin] SCRIPT_NAME: `/identity` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:19:30.316586 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6395b2-5fb3-4efa-8526-fa4c8313509d None admin] PATH_INFO: `/v3/users` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:19:30.317491 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e6395b2-5fb3-4efa-8526-fa4c8313509d None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=479851) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 09:19:30.317812 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e6395b2-5fb3-4efa-8526-fa4c8313509d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:19:30.319286 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e6395b2-5fb3-4efa-8526-fa4c8313509d None admin] RBAC: Authorization granted {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:19:30.339911 dv-cinder-851351-1-smb devstack@keystone.service[479851]: [pid: 479851|app: 0|req: 366/744] 10.222.0.42 () {56 vars in 1135 bytes} [Thu Jul 28 09:19:30 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:19:30.341655 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ecbc25-47b2-4a46-be22-9888de520953 None None] REQUEST_METHOD: `POST` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:19:30.342208 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ecbc25-47b2-4a46-be22-9888de520953 None None] SCRIPT_NAME: `/identity` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:19:30.342692 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ecbc25-47b2-4a46-be22-9888de520953 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:19:30.355131 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ac5ea6-93db-4df4-a40a-b1119bc620bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:19:30.355818 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ac5ea6-93db-4df4-a40a-b1119bc620bb None admin] REQUEST_METHOD: `GET` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:19:30.356108 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ac5ea6-93db-4df4-a40a-b1119bc620bb None admin] SCRIPT_NAME: `/identity` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:19:30.356924 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ac5ea6-93db-4df4-a40a-b1119bc620bb None admin] PATH_INFO: `/v3/projects/service` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:19:30.363178 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.auth.core [None req-97ecbc25-47b2-4a46-be22-9888de520953 None None] MFA Rules not processed for user `c198f91a4ae84d2b9cc730a6e304c2be`. Rule list: `[]` (Enabled: `True`). {{(pid=479851) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 09:19:30.364581 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.fernet_utils [None req-97ecbc25-47b2-4a46-be22-9888de520953 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=479851) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 09:19:30.365024 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40ac5ea6-93db-4df4-a40a-b1119bc620bb None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:19:30.366539 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40ac5ea6-93db-4df4-a40a-b1119bc620bb None admin] RBAC: Authorization granted {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:19:30.384248 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application [None req-40ac5ea6-93db-4df4-a40a-b1119bc620bb None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 09:19:30.384248 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 09:19:30.384248 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 09:19:30.384248 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 09:19:30.384248 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 09:19:30.384248 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 09:19:30.384248 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 09:19:30.384248 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 09:19:30.384248 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 09:19:30.384248 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 09:19:30.384248 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 09:19:30.384248 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 09:19:30.384248 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 28 09:19:30.384248 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 28 09:19:30.384248 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 28 09:19:30.385457 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 28 09:19:30.385457 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 09:19:30.385457 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 09:19:30.385457 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 09:19:30.385457 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 09:19:30.385457 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 09:19:30.385457 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 09:19:30.385457 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 09:19:30.385457 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application with Lock( Jul 28 09:19:30.385457 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 09:19:30.385457 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self._enter() Jul 28 09:19:30.385457 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 09:19:30.385457 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 09:19:30.385457 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 09:19:30.385457 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self.creator() Jul 28 09:19:30.385457 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 09:19:30.385457 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application created_value = creator( Jul 28 09:19:30.386534 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 28 09:19:30.386534 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 28 09:19:30.386534 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 28 09:19:30.386534 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 28 09:19:30.386534 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 28 09:19:30.386534 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 28 09:19:30.386534 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 09:19:30.386534 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application Jul 28 09:19:30.390484 dv-cinder-851351-1-smb devstack@keystone.service[479852]: [pid: 479852|app: 0|req: 379/745] 10.222.0.42 () {56 vars in 1111 bytes} [Thu Jul 28 09:19:30 2022] GET /identity/v3/projects/service => generated 88 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 09:19:30.391366 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ac5ea6-93db-4df4-a40a-b1119bc620bb None admin] Authenticating user token {{(pid=479852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:19:30.449382 dv-cinder-851351-1-smb devstack@keystone.service[479851]: [pid: 479851|app: 0|req: 367/746] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 09:19:30 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 28 09:19:30.453714 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ecbc25-47b2-4a46-be22-9888de520953 None None] Authenticating user token {{(pid=479851) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:19:30.477521 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG dbcounter [-] [479852] Writing DB stats keystone:SELECT=100 {{(pid=479852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:19:30.518294 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG dbcounter [-] [479851] Writing DB stats keystone:SELECT=100 {{(pid=479851) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:19:30.535517 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ac5ea6-93db-4df4-a40a-b1119bc620bb None admin] Validating token access rules against request {{(pid=479852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:19:30.570786 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ecbc25-47b2-4a46-be22-9888de520953 None None] Validating token access rules against request {{(pid=479851) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:19:30.577709 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22f2fd0-95bb-4259-afb4-e9aa9c2a525e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:19:30.578342 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22f2fd0-95bb-4259-afb4-e9aa9c2a525e None admin] REQUEST_METHOD: `POST` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:19:30.579080 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22f2fd0-95bb-4259-afb4-e9aa9c2a525e None admin] SCRIPT_NAME: `/identity` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:19:30.579360 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22f2fd0-95bb-4259-afb4-e9aa9c2a525e None admin] PATH_INFO: `/v3/services` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:19:30.580063 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c22f2fd0-95bb-4259-afb4-e9aa9c2a525e None admin] RBAC: Authorizing `identity:create_service()` {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:19:30.581821 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c22f2fd0-95bb-4259-afb4-e9aa9c2a525e None admin] RBAC: Authorization granted {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:19:30.602966 dv-cinder-851351-1-smb devstack@keystone.service[479852]: [pid: 479852|app: 0|req: 380/747] 10.222.0.42 () {60 vars in 1141 bytes} [Thu Jul 28 09:19:30 2022] POST /identity/v3/services => generated 240 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 09:19:30.608220 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22f2fd0-95bb-4259-afb4-e9aa9c2a525e None admin] Authenticating user token {{(pid=479852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:19:30.625278 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35655482-ae2f-4dc6-bfb7-b37768cdb101 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479851) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:19:30.626459 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35655482-ae2f-4dc6-bfb7-b37768cdb101 None admin] REQUEST_METHOD: `GET` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:19:30.627472 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35655482-ae2f-4dc6-bfb7-b37768cdb101 None admin] SCRIPT_NAME: `/identity` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:19:30.628050 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35655482-ae2f-4dc6-bfb7-b37768cdb101 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:19:30.784260 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35655482-ae2f-4dc6-bfb7-b37768cdb101 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:19:30.785734 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35655482-ae2f-4dc6-bfb7-b37768cdb101 None admin] RBAC: Authorization granted {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:19:30.786631 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22f2fd0-95bb-4259-afb4-e9aa9c2a525e None admin] Validating token access rules against request {{(pid=479852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:19:30.824844 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG dbcounter [-] [479852] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=479852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:19:30.854976 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d08556ca-c742-44bb-bd97-0ee01ac29651 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:19:30.856488 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08556ca-c742-44bb-bd97-0ee01ac29651 None admin] REQUEST_METHOD: `GET` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:19:30.857040 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08556ca-c742-44bb-bd97-0ee01ac29651 None admin] SCRIPT_NAME: `/identity` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:19:30.857563 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08556ca-c742-44bb-bd97-0ee01ac29651 None admin] PATH_INFO: `/v3/projects` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:19:30.859299 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d08556ca-c742-44bb-bd97-0ee01ac29651 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=479852) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 09:19:30.860094 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d08556ca-c742-44bb-bd97-0ee01ac29651 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:19:30.862823 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d08556ca-c742-44bb-bd97-0ee01ac29651 None admin] RBAC: Authorization granted {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:19:30.865389 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG dbcounter [-] [479851] Writing DB stats keystone:SELECT=100 {{(pid=479851) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:19:30.883079 dv-cinder-851351-1-smb devstack@keystone.service[479852]: [pid: 479852|app: 0|req: 381/748] 10.222.0.42 () {56 vars in 1148 bytes} [Thu Jul 28 09:19:30 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:19:30.884301 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d08556ca-c742-44bb-bd97-0ee01ac29651 None admin] Authenticating user token {{(pid=479852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:19:30.937341 dv-cinder-851351-1-smb devstack@keystone.service[479851]: [pid: 479851|app: 0|req: 368/749] 10.222.0.42 () {58 vars in 1282 bytes} [Thu Jul 28 09:19:30 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 487 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 28 09:19:30.940680 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35655482-ae2f-4dc6-bfb7-b37768cdb101 None admin] Authenticating user token {{(pid=479851) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:19:31.014898 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d08556ca-c742-44bb-bd97-0ee01ac29651 None admin] Validating token access rules against request {{(pid=479852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:19:31.055582 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c0bf8a-2a97-4a38-b50f-1719da606aa5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:19:31.056765 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c0bf8a-2a97-4a38-b50f-1719da606aa5 None admin] REQUEST_METHOD: `GET` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:19:31.057154 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c0bf8a-2a97-4a38-b50f-1719da606aa5 None admin] SCRIPT_NAME: `/identity` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:19:31.057500 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c0bf8a-2a97-4a38-b50f-1719da606aa5 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:19:31.072266 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c0bf8a-2a97-4a38-b50f-1719da606aa5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 09:19:31.077391 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35655482-ae2f-4dc6-bfb7-b37768cdb101 None admin] Validating token access rules against request {{(pid=479851) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:19:31.078623 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application [None req-e9c0bf8a-2a97-4a38-b50f-1719da606aa5 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 09:19:31.078623 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 09:19:31.078623 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 09:19:31.078623 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 09:19:31.078623 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 09:19:31.078623 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 09:19:31.078623 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 09:19:31.078623 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 09:19:31.078623 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 09:19:31.078623 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 09:19:31.078623 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 09:19:31.078623 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 09:19:31.078623 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 09:19:31.078623 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 09:19:31.078623 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 09:19:31.078623 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 09:19:31.079710 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 09:19:31.079710 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 09:19:31.079710 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 09:19:31.079710 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 09:19:31.079710 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 09:19:31.079710 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 09:19:31.079710 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 09:19:31.079710 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 09:19:31.079710 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 09:19:31.079710 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 09:19:31.079710 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 09:19:31.079710 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application with Lock( Jul 28 09:19:31.079710 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 09:19:31.079710 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self._enter() Jul 28 09:19:31.079710 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 09:19:31.079710 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 09:19:31.080819 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 09:19:31.080819 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self.creator() Jul 28 09:19:31.080819 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 09:19:31.080819 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application created_value = creator( Jul 28 09:19:31.080819 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 09:19:31.080819 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 09:19:31.080819 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 09:19:31.080819 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 09:19:31.080819 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 09:19:31.080819 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 09:19:31.080819 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 09:19:31.080819 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application Jul 28 09:19:31.080819 dv-cinder-851351-1-smb devstack@keystone.service[479852]: [pid: 479852|app: 0|req: 382/750] 10.222.0.42 () {56 vars in 1096 bytes} [Thu Jul 28 09:19:30 2022] GET /identity/v3/roles/admin => generated 83 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 09:19:31.081688 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c0bf8a-2a97-4a38-b50f-1719da606aa5 None admin] Authenticating user token {{(pid=479852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:19:31.132295 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69832921-f6e5-4fa3-815b-46a5e0a90a3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479851) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:19:31.133329 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69832921-f6e5-4fa3-815b-46a5e0a90a3b None admin] REQUEST_METHOD: `GET` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:19:31.133828 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69832921-f6e5-4fa3-815b-46a5e0a90a3b None admin] SCRIPT_NAME: `/identity` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:19:31.134292 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69832921-f6e5-4fa3-815b-46a5e0a90a3b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:19:31.135859 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69832921-f6e5-4fa3-815b-46a5e0a90a3b None admin] RBAC: Adding query filter params (role.id=bd74dfcbc8d7412689d315fe24a1f247, scope.project.id=3a0fb8ea8010437bade8f92dcbcaacee, user.id=87596a91a45f4326855265497fe69b65) {{(pid=479851) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 09:19:31.136377 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69832921-f6e5-4fa3-815b-46a5e0a90a3b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:19:31.138577 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69832921-f6e5-4fa3-815b-46a5e0a90a3b None admin] RBAC: Authorization granted {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:19:31.142635 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG dbcounter [-] [479852] Writing DB stats keystone:SELECT=100 {{(pid=479852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:19:31.151030 dv-cinder-851351-1-smb devstack@keystone.service[479851]: [pid: 479851|app: 0|req: 369/751] 10.222.0.42 () {56 vars in 1374 bytes} [Thu Jul 28 09:19:30 2022] GET /identity/v3/role_assignments?user.id=87596a91a45f4326855265497fe69b65&scope.project.id=3a0fb8ea8010437bade8f92dcbcaacee&role.id=bd74dfcbc8d7412689d315fe24a1f247 => generated 259 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:19:31.152466 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69832921-f6e5-4fa3-815b-46a5e0a90a3b None admin] Authenticating user token {{(pid=479851) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:19:31.178919 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG dbcounter [-] [479851] Writing DB stats keystone:SELECT=100 {{(pid=479851) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:19:31.257415 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c0bf8a-2a97-4a38-b50f-1719da606aa5 None admin] Validating token access rules against request {{(pid=479852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:19:31.331485 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024312b8-0a29-4c2c-9c34-78fdf74c9360 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:19:31.332201 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024312b8-0a29-4c2c-9c34-78fdf74c9360 None admin] REQUEST_METHOD: `GET` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:19:31.332624 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024312b8-0a29-4c2c-9c34-78fdf74c9360 None admin] SCRIPT_NAME: `/identity` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:19:31.332959 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024312b8-0a29-4c2c-9c34-78fdf74c9360 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:19:31.346336 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-024312b8-0a29-4c2c-9c34-78fdf74c9360 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:19:31.348425 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-024312b8-0a29-4c2c-9c34-78fdf74c9360 None admin] RBAC: Authorization granted {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:19:31.377693 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application [None req-024312b8-0a29-4c2c-9c34-78fdf74c9360 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 09:19:31.377693 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 09:19:31.377693 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 09:19:31.377693 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 09:19:31.377693 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 09:19:31.377693 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 09:19:31.377693 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 09:19:31.377693 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 09:19:31.377693 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 09:19:31.377693 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 09:19:31.377693 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 09:19:31.377693 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 09:19:31.377693 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 09:19:31.377693 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 09:19:31.377693 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 09:19:31.378844 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 09:19:31.378844 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 09:19:31.378844 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 09:19:31.378844 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 09:19:31.378844 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 09:19:31.378844 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 09:19:31.378844 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 09:19:31.378844 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 09:19:31.378844 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application with Lock( Jul 28 09:19:31.378844 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 09:19:31.378844 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self._enter() Jul 28 09:19:31.378844 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 09:19:31.378844 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 09:19:31.378844 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 09:19:31.378844 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self.creator() Jul 28 09:19:31.378844 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 09:19:31.378844 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application created_value = creator( Jul 28 09:19:31.380019 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 09:19:31.380019 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 09:19:31.380019 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 09:19:31.380019 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application Jul 28 09:19:31.382442 dv-cinder-851351-1-smb devstack@keystone.service[479852]: [pid: 479852|app: 0|req: 383/752] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 09:19:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 302 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 09:19:31.388369 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024312b8-0a29-4c2c-9c34-78fdf74c9360 None admin] Authenticating user token {{(pid=479852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:19:31.415700 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69832921-f6e5-4fa3-815b-46a5e0a90a3b None admin] Validating token access rules against request {{(pid=479851) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:19:31.489308 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-391791ea-1733-41ec-8ca2-5296f0bd4e2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479851) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:19:31.490550 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391791ea-1733-41ec-8ca2-5296f0bd4e2e None admin] REQUEST_METHOD: `GET` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:19:31.490969 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391791ea-1733-41ec-8ca2-5296f0bd4e2e None admin] SCRIPT_NAME: `/identity` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:19:31.491480 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391791ea-1733-41ec-8ca2-5296f0bd4e2e None admin] PATH_INFO: `/v3/roles` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:19:31.492985 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-391791ea-1733-41ec-8ca2-5296f0bd4e2e None admin] RBAC: Adding query filter params (name=admin) {{(pid=479851) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 09:19:31.493555 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-391791ea-1733-41ec-8ca2-5296f0bd4e2e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:19:31.496245 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-391791ea-1733-41ec-8ca2-5296f0bd4e2e None admin] RBAC: Authorization granted {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:19:31.518167 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG dbcounter [-] [479852] Writing DB stats keystone:SELECT=100 {{(pid=479852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:19:31.526606 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024312b8-0a29-4c2c-9c34-78fdf74c9360 None admin] Validating token access rules against request {{(pid=479852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:19:31.531507 dv-cinder-851351-1-smb devstack@keystone.service[479851]: [pid: 479851|app: 0|req: 370/753] 10.222.0.42 () {56 vars in 1099 bytes} [Thu Jul 28 09:19:31 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 379 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:19:31.537856 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-391791ea-1733-41ec-8ca2-5296f0bd4e2e None admin] Authenticating user token {{(pid=479851) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:19:31.574333 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0636ed-8caa-4f5b-9765-5c32b1c21a83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:19:31.575398 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0636ed-8caa-4f5b-9765-5c32b1c21a83 None admin] REQUEST_METHOD: `GET` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:19:31.575892 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0636ed-8caa-4f5b-9765-5c32b1c21a83 None admin] SCRIPT_NAME: `/identity` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:19:31.576374 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0636ed-8caa-4f5b-9765-5c32b1c21a83 None admin] PATH_INFO: `/v3/domains` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:19:31.578793 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d0636ed-8caa-4f5b-9765-5c32b1c21a83 None admin] RBAC: Adding query filter params (name=Default) {{(pid=479852) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 09:19:31.579327 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d0636ed-8caa-4f5b-9765-5c32b1c21a83 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:19:31.580977 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d0636ed-8caa-4f5b-9765-5c32b1c21a83 None admin] RBAC: Authorization granted {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:19:31.611016 dv-cinder-851351-1-smb devstack@keystone.service[479852]: [pid: 479852|app: 0|req: 384/754] 10.222.0.42 () {56 vars in 1109 bytes} [Thu Jul 28 09:19:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 09:19:31.618884 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0636ed-8caa-4f5b-9765-5c32b1c21a83 None admin] Authenticating user token {{(pid=479852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:19:31.667990 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG dbcounter [-] [479851] Writing DB stats keystone:SELECT=100 {{(pid=479851) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:19:31.700116 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-391791ea-1733-41ec-8ca2-5296f0bd4e2e None admin] Validating token access rules against request {{(pid=479851) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:19:31.748094 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-824a433c-8362-4a44-956c-4a1465908789 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479851) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:19:31.749217 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824a433c-8362-4a44-956c-4a1465908789 None admin] REQUEST_METHOD: `GET` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:19:31.749723 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824a433c-8362-4a44-956c-4a1465908789 None admin] SCRIPT_NAME: `/identity` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:19:31.750232 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824a433c-8362-4a44-956c-4a1465908789 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:19:31.767536 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-824a433c-8362-4a44-956c-4a1465908789 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:19:31.769944 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-824a433c-8362-4a44-956c-4a1465908789 None admin] RBAC: Authorization granted {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:19:31.791210 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application [None req-824a433c-8362-4a44-956c-4a1465908789 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 09:19:31.791210 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 09:19:31.791210 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 09:19:31.791210 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 09:19:31.791210 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 09:19:31.791210 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 09:19:31.791210 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 09:19:31.791210 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 09:19:31.791210 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 09:19:31.791210 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 09:19:31.791210 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 09:19:31.791210 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 09:19:31.791210 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 09:19:31.791210 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 09:19:31.791210 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 09:19:31.792320 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 09:19:31.792320 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 09:19:31.792320 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 09:19:31.792320 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 09:19:31.792320 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 09:19:31.792320 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 09:19:31.792320 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 09:19:31.792320 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 09:19:31.792320 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application with Lock( Jul 28 09:19:31.792320 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 09:19:31.792320 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return self._enter() Jul 28 09:19:31.792320 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 09:19:31.792320 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 09:19:31.792320 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 09:19:31.792320 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return self.creator() Jul 28 09:19:31.792320 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 09:19:31.792320 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application created_value = creator( Jul 28 09:19:31.793412 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 09:19:31.793412 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 09:19:31.793412 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 09:19:31.793412 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application Jul 28 09:19:31.796498 dv-cinder-851351-1-smb devstack@keystone.service[479851]: [pid: 479851|app: 0|req: 371/755] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 09:19:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 259 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 09:19:31.798416 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b5d424-a8d8-42da-9c85-024ef593b2a3 None None] REQUEST_METHOD: `GET` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:19:31.798900 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b5d424-a8d8-42da-9c85-024ef593b2a3 None None] SCRIPT_NAME: `/identity` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:19:31.799637 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b5d424-a8d8-42da-9c85-024ef593b2a3 None None] PATH_INFO: `/` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:19:31.801879 dv-cinder-851351-1-smb devstack@keystone.service[479851]: [pid: 479851|app: 0|req: 372/756] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 09:19:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 09:19:31.802835 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b5d424-a8d8-42da-9c85-024ef593b2a3 None None] Authenticating user token {{(pid=479851) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:19:31.828155 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0636ed-8caa-4f5b-9765-5c32b1c21a83 None admin] Validating token access rules against request {{(pid=479852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:19:31.869975 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71463e80-e070-4aad-bf74-7972c96062dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:19:31.870962 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71463e80-e070-4aad-bf74-7972c96062dc None admin] REQUEST_METHOD: `GET` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:19:31.871348 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71463e80-e070-4aad-bf74-7972c96062dc None admin] SCRIPT_NAME: `/identity` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:19:31.871730 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71463e80-e070-4aad-bf74-7972c96062dc None admin] PATH_INFO: `/v3/projects/service` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:19:31.882125 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71463e80-e070-4aad-bf74-7972c96062dc None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:19:31.884087 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71463e80-e070-4aad-bf74-7972c96062dc None admin] RBAC: Authorization granted {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:19:31.898183 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application [None req-71463e80-e070-4aad-bf74-7972c96062dc None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 09:19:31.898183 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 09:19:31.898183 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 09:19:31.898183 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 09:19:31.898183 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 09:19:31.898183 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 09:19:31.898183 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 09:19:31.898183 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 09:19:31.898183 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 09:19:31.898183 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 09:19:31.898183 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 09:19:31.898183 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 09:19:31.898183 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 28 09:19:31.898183 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 28 09:19:31.898183 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 28 09:19:31.899302 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 28 09:19:31.899302 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 09:19:31.899302 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 09:19:31.899302 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 09:19:31.899302 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 09:19:31.899302 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 09:19:31.899302 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 09:19:31.899302 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 09:19:31.899302 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application with Lock( Jul 28 09:19:31.899302 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 09:19:31.899302 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self._enter() Jul 28 09:19:31.899302 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 09:19:31.899302 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 09:19:31.899302 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 09:19:31.899302 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self.creator() Jul 28 09:19:31.899302 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 09:19:31.899302 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application created_value = creator( Jul 28 09:19:31.900359 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 28 09:19:31.900359 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 28 09:19:31.900359 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 28 09:19:31.900359 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 28 09:19:31.900359 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 28 09:19:31.900359 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 28 09:19:31.900359 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 09:19:31.900359 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application Jul 28 09:19:31.907554 dv-cinder-851351-1-smb devstack@keystone.service[479852]: [pid: 479852|app: 0|req: 385/757] 10.222.0.42 () {56 vars in 1111 bytes} [Thu Jul 28 09:19:31 2022] GET /identity/v3/projects/service => generated 88 bytes in 285 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 09:19:31.909339 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883d08bf-5b46-4091-b4fa-9c06bde7b3ab None None] REQUEST_METHOD: `POST` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:19:31.909865 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883d08bf-5b46-4091-b4fa-9c06bde7b3ab None None] SCRIPT_NAME: `/identity` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:19:31.910352 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883d08bf-5b46-4091-b4fa-9c06bde7b3ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:19:31.924625 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b5d424-a8d8-42da-9c85-024ef593b2a3 None None] Validating token access rules against request {{(pid=479851) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:19:31.929599 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.auth.core [None req-883d08bf-5b46-4091-b4fa-9c06bde7b3ab None None] MFA Rules not processed for user `c198f91a4ae84d2b9cc730a6e304c2be`. Rule list: `[]` (Enabled: `True`). {{(pid=479852) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 09:19:31.931094 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.fernet_utils [None req-883d08bf-5b46-4091-b4fa-9c06bde7b3ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=479852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 09:19:31.943158 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG dbcounter [-] [479852] Writing DB stats keystone:SELECT=100 {{(pid=479852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:19:31.959067 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG dbcounter [-] [479851] Writing DB stats keystone:SELECT=100 {{(pid=479851) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:19:31.971013 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-990c5c5e-aecf-4449-bbad-18794b7a06b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479851) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:19:31.971842 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990c5c5e-aecf-4449-bbad-18794b7a06b4 None admin] REQUEST_METHOD: `GET` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:19:31.972139 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990c5c5e-aecf-4449-bbad-18794b7a06b4 None admin] SCRIPT_NAME: `/identity` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:19:31.972425 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990c5c5e-aecf-4449-bbad-18794b7a06b4 None admin] PATH_INFO: `/v3/domains` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:19:31.974067 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-990c5c5e-aecf-4449-bbad-18794b7a06b4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=479851) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 09:19:31.974401 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-990c5c5e-aecf-4449-bbad-18794b7a06b4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:19:31.975823 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-990c5c5e-aecf-4449-bbad-18794b7a06b4 None admin] RBAC: Authorization granted {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:19:31.991815 dv-cinder-851351-1-smb devstack@keystone.service[479851]: [pid: 479851|app: 0|req: 373/758] 10.222.0.42 () {56 vars in 1109 bytes} [Thu Jul 28 09:19:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:19:31.992785 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-990c5c5e-aecf-4449-bbad-18794b7a06b4 None admin] Authenticating user token {{(pid=479851) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:19:32.016752 dv-cinder-851351-1-smb devstack@keystone.service[479852]: [pid: 479852|app: 0|req: 386/759] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 09:19:31 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 09:19:32.018100 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883d08bf-5b46-4091-b4fa-9c06bde7b3ab None None] Authenticating user token {{(pid=479852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:19:32.123573 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-990c5c5e-aecf-4449-bbad-18794b7a06b4 None admin] Validating token access rules against request {{(pid=479851) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:19:32.154368 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883d08bf-5b46-4091-b4fa-9c06bde7b3ab None None] Validating token access rules against request {{(pid=479852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:19:32.172828 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28717e84-51b6-495c-a8ec-e8ef7ca45d1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479851) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:19:32.173473 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28717e84-51b6-495c-a8ec-e8ef7ca45d1f None admin] REQUEST_METHOD: `GET` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:19:32.173758 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28717e84-51b6-495c-a8ec-e8ef7ca45d1f None admin] SCRIPT_NAME: `/identity` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:19:32.174039 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28717e84-51b6-495c-a8ec-e8ef7ca45d1f None admin] PATH_INFO: `/v3/projects` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:19:32.174810 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28717e84-51b6-495c-a8ec-e8ef7ca45d1f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=479851) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 09:19:32.175124 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28717e84-51b6-495c-a8ec-e8ef7ca45d1f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:19:32.176589 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28717e84-51b6-495c-a8ec-e8ef7ca45d1f None admin] RBAC: Authorization granted {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:19:32.197878 dv-cinder-851351-1-smb devstack@keystone.service[479851]: [pid: 479851|app: 0|req: 374/760] 10.222.0.42 () {56 vars in 1148 bytes} [Thu Jul 28 09:19:31 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:19:32.198747 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28717e84-51b6-495c-a8ec-e8ef7ca45d1f None admin] Authenticating user token {{(pid=479851) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:19:32.207534 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c05c7c72-f609-43e5-8bbc-cd7b93b059b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:19:32.209258 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05c7c72-f609-43e5-8bbc-cd7b93b059b6 None admin] REQUEST_METHOD: `GET` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:19:32.209747 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05c7c72-f609-43e5-8bbc-cd7b93b059b6 None admin] SCRIPT_NAME: `/identity` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:19:32.210220 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05c7c72-f609-43e5-8bbc-cd7b93b059b6 None admin] PATH_INFO: `/v3/users/nova` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:19:32.221251 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c05c7c72-f609-43e5-8bbc-cd7b93b059b6 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:19:32.223695 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c05c7c72-f609-43e5-8bbc-cd7b93b059b6 None admin] RBAC: Authorization granted {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:19:32.240510 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application [None req-c05c7c72-f609-43e5-8bbc-cd7b93b059b6 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 28 09:19:32.240510 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 09:19:32.240510 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 09:19:32.240510 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 09:19:32.240510 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 09:19:32.240510 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 09:19:32.240510 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 09:19:32.240510 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 09:19:32.240510 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 09:19:32.240510 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 09:19:32.240510 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 09:19:32.240510 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 09:19:32.240510 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 28 09:19:32.240510 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 28 09:19:32.240510 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 28 09:19:32.240510 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 28 09:19:32.241719 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 09:19:32.241719 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 09:19:32.241719 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 28 09:19:32.241719 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 09:19:32.241719 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 28 09:19:32.241719 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 09:19:32.241719 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 09:19:32.241719 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 09:19:32.241719 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 09:19:32.241719 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 09:19:32.241719 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 09:19:32.241719 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application with Lock( Jul 28 09:19:32.241719 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 09:19:32.241719 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self._enter() Jul 28 09:19:32.241719 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 09:19:32.241719 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 09:19:32.241719 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 09:19:32.241719 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self.creator() Jul 28 09:19:32.242826 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 09:19:32.242826 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application created_value = creator( Jul 28 09:19:32.242826 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 28 09:19:32.242826 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 28 09:19:32.242826 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 28 09:19:32.242826 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 28 09:19:32.242826 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 28 09:19:32.242826 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 28 09:19:32.242826 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 28 09:19:32.242826 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application Jul 28 09:19:32.242826 dv-cinder-851351-1-smb devstack@keystone.service[479852]: [pid: 479852|app: 0|req: 387/761] 10.222.0.42 () {56 vars in 1093 bytes} [Thu Jul 28 09:19:32 2022] GET /identity/v3/users/nova => generated 82 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 09:19:32.242826 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c05c7c72-f609-43e5-8bbc-cd7b93b059b6 None admin] Authenticating user token {{(pid=479852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:19:32.253811 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG dbcounter [-] [479852] Writing DB stats keystone:SELECT=100 {{(pid=479852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:19:32.258439 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG dbcounter [-] [479851] Writing DB stats keystone:SELECT=100 {{(pid=479851) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:19:32.325669 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28717e84-51b6-495c-a8ec-e8ef7ca45d1f None admin] Validating token access rules against request {{(pid=479851) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:19:32.363418 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f3833a-77a2-4b31-bcd6-6a3b120b3f1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479851) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:19:32.364321 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f3833a-77a2-4b31-bcd6-6a3b120b3f1a None admin] REQUEST_METHOD: `GET` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:19:32.364763 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f3833a-77a2-4b31-bcd6-6a3b120b3f1a None admin] SCRIPT_NAME: `/identity` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:19:32.365215 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f3833a-77a2-4b31-bcd6-6a3b120b3f1a None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:19:32.365925 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0f3833a-77a2-4b31-bcd6-6a3b120b3f1a None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:19:32.367613 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0f3833a-77a2-4b31-bcd6-6a3b120b3f1a None admin] RBAC: Authorization granted {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:19:32.378971 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c05c7c72-f609-43e5-8bbc-cd7b93b059b6 None admin] Validating token access rules against request {{(pid=479852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:19:32.380905 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application [None req-e0f3833a-77a2-4b31-bcd6-6a3b120b3f1a None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 28 09:19:32.380905 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 09:19:32.380905 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 28 09:19:32.380905 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 28 09:19:32.380905 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 28 09:19:32.380905 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 28 09:19:32.380905 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 28 09:19:32.380905 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 09:19:32.380905 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 28 09:19:32.380905 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application Jul 28 09:19:32.380905 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 28 09:19:32.380905 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application Jul 28 09:19:32.380905 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 09:19:32.380905 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 09:19:32.380905 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 09:19:32.380905 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 09:19:32.382181 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 09:19:32.382181 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 09:19:32.382181 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 09:19:32.382181 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 09:19:32.382181 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 09:19:32.382181 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 09:19:32.382181 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 09:19:32.382181 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 28 09:19:32.382181 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 28 09:19:32.382181 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 28 09:19:32.382181 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 28 09:19:32.382181 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 09:19:32.382181 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 09:19:32.382181 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 09:19:32.382181 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 09:19:32.382181 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 09:19:32.383403 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 09:19:32.383403 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 09:19:32.383403 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application with Lock( Jul 28 09:19:32.383403 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 09:19:32.383403 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return self._enter() Jul 28 09:19:32.383403 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 09:19:32.383403 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 09:19:32.383403 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 09:19:32.383403 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return self.creator() Jul 28 09:19:32.383403 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 09:19:32.383403 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application created_value = creator( Jul 28 09:19:32.383403 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 28 09:19:32.383403 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 09:19:32.383403 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 28 09:19:32.383403 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application Jul 28 09:19:32.389069 dv-cinder-851351-1-smb devstack@keystone.service[479851]: [pid: 479851|app: 0|req: 375/762] 10.222.0.42 () {56 vars in 1129 bytes} [Thu Jul 28 09:19:32 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 09:19:32.390236 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f3833a-77a2-4b31-bcd6-6a3b120b3f1a None admin] Authenticating user token {{(pid=479851) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:19:32.430574 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-243a0d26-ac44-4969-b1e7-17a28265b8e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:19:32.431881 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243a0d26-ac44-4969-b1e7-17a28265b8e8 None admin] REQUEST_METHOD: `GET` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:19:32.433285 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243a0d26-ac44-4969-b1e7-17a28265b8e8 None admin] SCRIPT_NAME: `/identity` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:19:32.433285 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243a0d26-ac44-4969-b1e7-17a28265b8e8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:19:32.434010 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-243a0d26-ac44-4969-b1e7-17a28265b8e8 None admin] RBAC: Adding query filter params (role.id=685084310b35477b9b2d0c7934d0f803, scope.project.id=3a0fb8ea8010437bade8f92dcbcaacee, user.id=213aa011e5004256aead7e486d7f2eba) {{(pid=479852) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 09:19:32.434334 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-243a0d26-ac44-4969-b1e7-17a28265b8e8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:19:32.435882 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-243a0d26-ac44-4969-b1e7-17a28265b8e8 None admin] RBAC: Authorization granted {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:19:32.449139 dv-cinder-851351-1-smb devstack@keystone.service[479852]: [pid: 479852|app: 0|req: 388/763] 10.222.0.42 () {56 vars in 1374 bytes} [Thu Jul 28 09:19:32 2022] GET /identity/v3/role_assignments?user.id=213aa011e5004256aead7e486d7f2eba&scope.project.id=3a0fb8ea8010437bade8f92dcbcaacee&role.id=685084310b35477b9b2d0c7934d0f803 => generated 259 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:19:32.450218 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-243a0d26-ac44-4969-b1e7-17a28265b8e8 None admin] Authenticating user token {{(pid=479852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:19:32.531649 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f3833a-77a2-4b31-bcd6-6a3b120b3f1a None admin] Validating token access rules against request {{(pid=479851) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:19:32.550706 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG dbcounter [-] [479851] Writing DB stats keystone:SELECT=100 {{(pid=479851) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:19:32.590821 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbfbcec6-2fb7-4334-8a5c-4c7c5d3cca3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479851) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:19:32.591954 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbfbcec6-2fb7-4334-8a5c-4c7c5d3cca3c None admin] REQUEST_METHOD: `GET` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:19:32.592480 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbfbcec6-2fb7-4334-8a5c-4c7c5d3cca3c None admin] SCRIPT_NAME: `/identity` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:19:32.593846 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbfbcec6-2fb7-4334-8a5c-4c7c5d3cca3c None admin] PATH_INFO: `/v3/users` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:19:32.594968 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbfbcec6-2fb7-4334-8a5c-4c7c5d3cca3c None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=479851) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 09:19:32.595503 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbfbcec6-2fb7-4334-8a5c-4c7c5d3cca3c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:19:32.597249 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbfbcec6-2fb7-4334-8a5c-4c7c5d3cca3c None admin] RBAC: Authorization granted {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:19:32.637395 dv-cinder-851351-1-smb devstack@keystone.service[479851]: [pid: 479851|app: 0|req: 376/764] 10.222.0.42 () {56 vars in 1133 bytes} [Thu Jul 28 09:19:32 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:19:32.639915 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG dbcounter [-] [479852] Writing DB stats keystone:SELECT=100 {{(pid=479852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:19:32.643562 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbfbcec6-2fb7-4334-8a5c-4c7c5d3cca3c None admin] Authenticating user token {{(pid=479851) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:19:32.701527 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-243a0d26-ac44-4969-b1e7-17a28265b8e8 None admin] Validating token access rules against request {{(pid=479852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:19:32.744958 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc26e2dc-338d-4ad5-9b1f-3b72f9818158 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:19:32.745914 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc26e2dc-338d-4ad5-9b1f-3b72f9818158 None admin] REQUEST_METHOD: `GET` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:19:32.746052 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc26e2dc-338d-4ad5-9b1f-3b72f9818158 None admin] SCRIPT_NAME: `/identity` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:19:32.746316 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc26e2dc-338d-4ad5-9b1f-3b72f9818158 None admin] PATH_INFO: `/v3/services` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:19:32.747116 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc26e2dc-338d-4ad5-9b1f-3b72f9818158 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=479852) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 09:19:32.747604 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc26e2dc-338d-4ad5-9b1f-3b72f9818158 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:19:32.749191 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc26e2dc-338d-4ad5-9b1f-3b72f9818158 None admin] RBAC: Authorization granted {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:19:32.754985 dv-cinder-851351-1-smb devstack@keystone.service[479852]: [pid: 479852|app: 0|req: 389/765] 10.222.0.42 () {56 vars in 1124 bytes} [Thu Jul 28 09:19:32 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 305 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:19:32.761289 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc26e2dc-338d-4ad5-9b1f-3b72f9818158 None admin] Authenticating user token {{(pid=479852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:19:32.842080 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbfbcec6-2fb7-4334-8a5c-4c7c5d3cca3c None admin] Validating token access rules against request {{(pid=479851) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:19:32.878737 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc26e2dc-338d-4ad5-9b1f-3b72f9818158 None admin] Validating token access rules against request {{(pid=479852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:19:32.880755 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e6e1235-7fe6-45f2-b9b6-25302886a050 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479851) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:19:32.881683 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6e1235-7fe6-45f2-b9b6-25302886a050 None admin] REQUEST_METHOD: `GET` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:19:32.882190 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6e1235-7fe6-45f2-b9b6-25302886a050 None admin] SCRIPT_NAME: `/identity` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:19:32.882696 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6e1235-7fe6-45f2-b9b6-25302886a050 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:19:32.893757 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e6e1235-7fe6-45f2-b9b6-25302886a050 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:19:32.895619 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e6e1235-7fe6-45f2-b9b6-25302886a050 None admin] RBAC: Authorization granted {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:19:32.911491 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application [None req-5e6e1235-7fe6-45f2-b9b6-25302886a050 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 09:19:32.911491 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 09:19:32.911491 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 09:19:32.911491 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 09:19:32.911491 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 09:19:32.911491 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 09:19:32.911491 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 09:19:32.911491 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 09:19:32.911491 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 09:19:32.911491 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 09:19:32.911491 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 09:19:32.911491 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 09:19:32.911491 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 09:19:32.911491 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 09:19:32.911491 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 09:19:32.912704 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 09:19:32.912704 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 09:19:32.912704 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 09:19:32.912704 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 09:19:32.912704 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 09:19:32.912704 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 09:19:32.912704 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 09:19:32.912704 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 09:19:32.912704 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application with Lock( Jul 28 09:19:32.912704 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 09:19:32.912704 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return self._enter() Jul 28 09:19:32.912704 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 09:19:32.912704 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 09:19:32.912704 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 09:19:32.912704 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return self.creator() Jul 28 09:19:32.912704 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 09:19:32.912704 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application created_value = creator( Jul 28 09:19:32.913888 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 09:19:32.913888 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 09:19:32.913888 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 09:19:32.913888 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application Jul 28 09:19:32.920694 dv-cinder-851351-1-smb devstack@keystone.service[479851]: [pid: 479851|app: 0|req: 377/766] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 09:19:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 274 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 09:19:32.922439 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a965f2-971f-4096-bec6-9c76b7db1f3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:19:32.922871 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e6e1235-7fe6-45f2-b9b6-25302886a050 None admin] Authenticating user token {{(pid=479851) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:19:32.923375 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a965f2-971f-4096-bec6-9c76b7db1f3b None admin] REQUEST_METHOD: `GET` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:19:32.923758 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a965f2-971f-4096-bec6-9c76b7db1f3b None admin] SCRIPT_NAME: `/identity` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:19:32.924161 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a965f2-971f-4096-bec6-9c76b7db1f3b None admin] PATH_INFO: `/v3/services` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:19:32.925048 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50a965f2-971f-4096-bec6-9c76b7db1f3b None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=479852) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 09:19:32.925458 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50a965f2-971f-4096-bec6-9c76b7db1f3b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:19:32.927221 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50a965f2-971f-4096-bec6-9c76b7db1f3b None admin] RBAC: Authorization granted {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:19:32.929179 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG dbcounter [-] [479852] Writing DB stats keystone:SELECT=100 {{(pid=479852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:19:32.937403 dv-cinder-851351-1-smb devstack@keystone.service[479852]: [pid: 479852|app: 0|req: 390/767] 10.222.0.42 () {56 vars in 1124 bytes} [Thu Jul 28 09:19:32 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 09:19:32.944343 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a965f2-971f-4096-bec6-9c76b7db1f3b None admin] Authenticating user token {{(pid=479852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:19:32.970905 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG dbcounter [-] [479851] Writing DB stats keystone:SELECT=100 {{(pid=479851) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:19:33.057986 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a965f2-971f-4096-bec6-9c76b7db1f3b None admin] Validating token access rules against request {{(pid=479852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:19:33.077805 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e6e1235-7fe6-45f2-b9b6-25302886a050 None admin] Validating token access rules against request {{(pid=479851) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:19:33.095244 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3be88b4-57d5-44a9-8b5f-9254b3b30f51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:19:33.096295 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3be88b4-57d5-44a9-8b5f-9254b3b30f51 None admin] REQUEST_METHOD: `GET` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:19:33.096891 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3be88b4-57d5-44a9-8b5f-9254b3b30f51 None admin] SCRIPT_NAME: `/identity` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:19:33.097392 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3be88b4-57d5-44a9-8b5f-9254b3b30f51 None admin] PATH_INFO: `/v3/endpoints` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:19:33.098364 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3be88b4-57d5-44a9-8b5f-9254b3b30f51 None admin] RBAC: Adding query filter params (interface=public, service_id=116d53f9162740feaece96a3e34395f3, region_id=RegionOne) {{(pid=479852) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 09:19:33.098961 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3be88b4-57d5-44a9-8b5f-9254b3b30f51 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:19:33.100560 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3be88b4-57d5-44a9-8b5f-9254b3b30f51 None admin] RBAC: Authorization granted {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:19:33.110684 dv-cinder-851351-1-smb devstack@keystone.service[479852]: [pid: 479852|app: 0|req: 391/768] 10.222.0.42 () {56 vars in 1251 bytes} [Thu Jul 28 09:19:32 2022] GET /identity/v3/endpoints?service_id=116d53f9162740feaece96a3e34395f3&interface=public®ion_id=RegionOne => generated 194 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 09:19:33.112702 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641bcbe0-a8cc-44f6-9377-de988801b0cb None None] REQUEST_METHOD: `GET` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:19:33.115210 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e480e054-665d-4609-852d-8a2f8cb20bdc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479851) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:19:33.115848 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e480e054-665d-4609-852d-8a2f8cb20bdc None admin] REQUEST_METHOD: `GET` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:19:33.116188 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e480e054-665d-4609-852d-8a2f8cb20bdc None admin] SCRIPT_NAME: `/identity` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:19:33.116466 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e480e054-665d-4609-852d-8a2f8cb20bdc None admin] PATH_INFO: `/v3/domains` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:19:33.117614 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e480e054-665d-4609-852d-8a2f8cb20bdc None admin] RBAC: Adding query filter params (name=Default) {{(pid=479851) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 09:19:33.117736 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641bcbe0-a8cc-44f6-9377-de988801b0cb None None] SCRIPT_NAME: `/identity` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:19:33.117927 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641bcbe0-a8cc-44f6-9377-de988801b0cb None None] PATH_INFO: `/` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:19:33.118040 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e480e054-665d-4609-852d-8a2f8cb20bdc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:19:33.119319 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e480e054-665d-4609-852d-8a2f8cb20bdc None admin] RBAC: Authorization granted {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:19:33.119588 dv-cinder-851351-1-smb devstack@keystone.service[479852]: [pid: 479852|app: 0|req: 392/769] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 09:19:33 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 09:19:33.120371 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641bcbe0-a8cc-44f6-9377-de988801b0cb None None] Authenticating user token {{(pid=479852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:19:33.138165 dv-cinder-851351-1-smb devstack@keystone.service[479851]: [pid: 479851|app: 0|req: 378/770] 10.222.0.42 () {56 vars in 1109 bytes} [Thu Jul 28 09:19:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:19:33.139602 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac09faa4-2379-435f-9b02-a81a1fcdfa34 None None] REQUEST_METHOD: `POST` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:19:33.139893 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac09faa4-2379-435f-9b02-a81a1fcdfa34 None None] SCRIPT_NAME: `/identity` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:19:33.140175 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac09faa4-2379-435f-9b02-a81a1fcdfa34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:19:33.160108 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.auth.core [None req-ac09faa4-2379-435f-9b02-a81a1fcdfa34 None None] MFA Rules not processed for user `c198f91a4ae84d2b9cc730a6e304c2be`. Rule list: `[]` (Enabled: `True`). {{(pid=479851) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 09:19:33.161356 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.fernet_utils [None req-ac09faa4-2379-435f-9b02-a81a1fcdfa34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=479851) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 09:19:33.191593 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG dbcounter [-] [479852] Writing DB stats keystone:SELECT=100 {{(pid=479852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:19:33.235739 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641bcbe0-a8cc-44f6-9377-de988801b0cb None None] Validating token access rules against request {{(pid=479852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:19:33.248826 dv-cinder-851351-1-smb devstack@keystone.service[479851]: [pid: 479851|app: 0|req: 379/771] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 09:19:33 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 09:19:33.250095 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac09faa4-2379-435f-9b02-a81a1fcdfa34 None None] Authenticating user token {{(pid=479851) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:19:33.276457 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d502225b-685a-4dc3-ad50-16802cfa6d00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:19:33.276457 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d502225b-685a-4dc3-ad50-16802cfa6d00 None admin] REQUEST_METHOD: `GET` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:19:33.276457 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d502225b-685a-4dc3-ad50-16802cfa6d00 None admin] SCRIPT_NAME: `/identity` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:19:33.276457 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d502225b-685a-4dc3-ad50-16802cfa6d00 None admin] PATH_INFO: `/v3/services` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:19:33.277042 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d502225b-685a-4dc3-ad50-16802cfa6d00 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:19:33.277042 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d502225b-685a-4dc3-ad50-16802cfa6d00 None admin] RBAC: Authorization granted {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:19:33.278679 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG dbcounter [-] [479851] Writing DB stats keystone:SELECT=100 {{(pid=479851) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:19:33.282861 dv-cinder-851351-1-smb devstack@keystone.service[479852]: [pid: 479852|app: 0|req: 393/772] 10.222.0.42 () {56 vars in 1087 bytes} [Thu Jul 28 09:19:33 2022] GET /identity/v3/services => generated 772 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:19:33.308516 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d502225b-685a-4dc3-ad50-16802cfa6d00 None admin] Authenticating user token {{(pid=479852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:19:33.440781 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac09faa4-2379-435f-9b02-a81a1fcdfa34 None None] Validating token access rules against request {{(pid=479851) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:19:33.514247 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f81a34-b616-4aab-be6a-280158d7cf5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479851) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:19:33.514918 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f81a34-b616-4aab-be6a-280158d7cf5e None admin] REQUEST_METHOD: `GET` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:19:33.515303 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f81a34-b616-4aab-be6a-280158d7cf5e None admin] SCRIPT_NAME: `/identity` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:19:33.515586 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f81a34-b616-4aab-be6a-280158d7cf5e None admin] PATH_INFO: `/v3/projects/service` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:19:33.522599 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d502225b-685a-4dc3-ad50-16802cfa6d00 None admin] Validating token access rules against request {{(pid=479852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:19:33.523127 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80f81a34-b616-4aab-be6a-280158d7cf5e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:19:33.524624 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80f81a34-b616-4aab-be6a-280158d7cf5e None admin] RBAC: Authorization granted {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:19:33.538016 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application [None req-80f81a34-b616-4aab-be6a-280158d7cf5e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 09:19:33.538016 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 09:19:33.538016 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 09:19:33.538016 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 09:19:33.538016 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 09:19:33.538016 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 09:19:33.538016 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 09:19:33.538016 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 09:19:33.538016 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 09:19:33.538016 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 09:19:33.538016 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 09:19:33.538016 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 09:19:33.538016 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 28 09:19:33.538016 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 28 09:19:33.538016 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 28 09:19:33.539648 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 28 09:19:33.539648 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 09:19:33.539648 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 09:19:33.539648 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 09:19:33.539648 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 09:19:33.539648 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 09:19:33.539648 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 09:19:33.539648 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 09:19:33.539648 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application with Lock( Jul 28 09:19:33.539648 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 09:19:33.539648 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return self._enter() Jul 28 09:19:33.539648 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 09:19:33.539648 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 09:19:33.539648 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 09:19:33.539648 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return self.creator() Jul 28 09:19:33.539648 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 09:19:33.539648 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application created_value = creator( Jul 28 09:19:33.540759 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 28 09:19:33.540759 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 28 09:19:33.540759 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 28 09:19:33.540759 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 28 09:19:33.540759 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 28 09:19:33.540759 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 28 09:19:33.540759 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 09:19:33.540759 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application Jul 28 09:19:33.540759 dv-cinder-851351-1-smb devstack@keystone.service[479851]: [pid: 479851|app: 0|req: 380/773] 10.222.0.42 () {56 vars in 1111 bytes} [Thu Jul 28 09:19:33 2022] GET /identity/v3/projects/service => generated 88 bytes in 290 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 09:19:33.545369 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f81a34-b616-4aab-be6a-280158d7cf5e None admin] Authenticating user token {{(pid=479851) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:19:33.552310 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG dbcounter [-] [479852] Writing DB stats keystone:SELECT=100 {{(pid=479852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:19:33.562399 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a786632c-ade9-4214-8f25-415b214c69e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:19:33.563355 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a786632c-ade9-4214-8f25-415b214c69e2 None admin] REQUEST_METHOD: `GET` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:19:33.563734 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a786632c-ade9-4214-8f25-415b214c69e2 None admin] SCRIPT_NAME: `/identity` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:19:33.564016 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a786632c-ade9-4214-8f25-415b214c69e2 None admin] PATH_INFO: `/v3/services/network` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:19:33.564697 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a786632c-ade9-4214-8f25-415b214c69e2 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:19:33.566235 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a786632c-ade9-4214-8f25-415b214c69e2 None admin] RBAC: Authorization granted {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:19:33.577186 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application [None req-a786632c-ade9-4214-8f25-415b214c69e2 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jul 28 09:19:33.577186 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 09:19:33.577186 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 28 09:19:33.577186 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 28 09:19:33.577186 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 28 09:19:33.577186 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 28 09:19:33.577186 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 28 09:19:33.577186 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 09:19:33.577186 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 28 09:19:33.577186 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application Jul 28 09:19:33.577186 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 28 09:19:33.577186 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application Jul 28 09:19:33.577186 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 09:19:33.577186 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 09:19:33.577186 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 09:19:33.577186 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 09:19:33.577186 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 09:19:33.579324 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 09:19:33.579324 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 09:19:33.579324 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 09:19:33.579324 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 09:19:33.579324 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 09:19:33.579324 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 09:19:33.579324 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 28 09:19:33.579324 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 28 09:19:33.579324 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 28 09:19:33.579324 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 28 09:19:33.579324 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 09:19:33.579324 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 09:19:33.579324 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 09:19:33.579324 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 09:19:33.579324 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 09:19:33.579324 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 09:19:33.580470 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 09:19:33.580470 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application with Lock( Jul 28 09:19:33.580470 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 09:19:33.580470 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self._enter() Jul 28 09:19:33.580470 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 09:19:33.580470 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 09:19:33.580470 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 09:19:33.580470 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self.creator() Jul 28 09:19:33.580470 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 09:19:33.580470 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application created_value = creator( Jul 28 09:19:33.580470 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 28 09:19:33.580470 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 09:19:33.580470 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 28 09:19:33.580470 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application Jul 28 09:19:33.580470 dv-cinder-851351-1-smb devstack@keystone.service[479852]: [pid: 479852|app: 0|req: 394/774] 10.222.0.42 () {56 vars in 1111 bytes} [Thu Jul 28 09:19:33 2022] GET /identity/v3/services/network => generated 88 bytes in 271 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 09:19:33.585798 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a786632c-ade9-4214-8f25-415b214c69e2 None admin] Authenticating user token {{(pid=479852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:19:33.627459 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG dbcounter [-] [479851] Writing DB stats keystone:SELECT=100 {{(pid=479851) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:19:33.660294 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f81a34-b616-4aab-be6a-280158d7cf5e None admin] Validating token access rules against request {{(pid=479851) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:19:33.701569 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a786632c-ade9-4214-8f25-415b214c69e2 None admin] Validating token access rules against request {{(pid=479852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:19:33.720242 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-badcd42c-b3ab-4385-890c-6c5468daa695 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479851) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:19:33.725025 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-badcd42c-b3ab-4385-890c-6c5468daa695 None admin] REQUEST_METHOD: `GET` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:19:33.725323 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-badcd42c-b3ab-4385-890c-6c5468daa695 None admin] SCRIPT_NAME: `/identity` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:19:33.725610 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-badcd42c-b3ab-4385-890c-6c5468daa695 None admin] PATH_INFO: `/v3/projects` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:19:33.726411 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-badcd42c-b3ab-4385-890c-6c5468daa695 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=479851) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 09:19:33.726722 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-badcd42c-b3ab-4385-890c-6c5468daa695 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:19:33.728184 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-badcd42c-b3ab-4385-890c-6c5468daa695 None admin] RBAC: Authorization granted {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:19:33.748396 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea4cd02-ea3e-4514-b7be-054969ce0880 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:19:33.751278 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea4cd02-ea3e-4514-b7be-054969ce0880 None admin] REQUEST_METHOD: `GET` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:19:33.751801 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea4cd02-ea3e-4514-b7be-054969ce0880 None admin] SCRIPT_NAME: `/identity` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:19:33.752236 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea4cd02-ea3e-4514-b7be-054969ce0880 None admin] PATH_INFO: `/v3/services` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:19:33.753121 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cea4cd02-ea3e-4514-b7be-054969ce0880 None admin] RBAC: Adding query filter params (name=network) {{(pid=479852) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 09:19:33.753592 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cea4cd02-ea3e-4514-b7be-054969ce0880 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:19:33.755228 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cea4cd02-ea3e-4514-b7be-054969ce0880 None admin] RBAC: Authorization granted {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:19:33.757715 dv-cinder-851351-1-smb devstack@keystone.service[479851]: [pid: 479851|app: 0|req: 381/775] 10.222.0.42 () {56 vars in 1148 bytes} [Thu Jul 28 09:19:33 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 09:19:33.761205 dv-cinder-851351-1-smb devstack@keystone.service[479852]: [pid: 479852|app: 0|req: 395/776] 10.222.0.42 () {56 vars in 1112 bytes} [Thu Jul 28 09:19:33 2022] GET /identity/v3/services?name=network => generated 124 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 09:19:33.766599 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-badcd42c-b3ab-4385-890c-6c5468daa695 None admin] Authenticating user token {{(pid=479851) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:19:33.769749 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea4cd02-ea3e-4514-b7be-054969ce0880 None admin] Authenticating user token {{(pid=479852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:19:33.856891 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG dbcounter [-] [479852] Writing DB stats keystone:SELECT=100 {{(pid=479852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:19:33.914682 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-badcd42c-b3ab-4385-890c-6c5468daa695 None admin] Validating token access rules against request {{(pid=479851) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:19:33.915499 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea4cd02-ea3e-4514-b7be-054969ce0880 None admin] Validating token access rules against request {{(pid=479852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:19:33.952804 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG dbcounter [-] [479851] Writing DB stats keystone:SELECT=100 {{(pid=479851) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:19:33.961391 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9881ec-a0ef-42fb-997b-d1aa951a46a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479851) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:19:33.962436 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9881ec-a0ef-42fb-997b-d1aa951a46a1 None admin] REQUEST_METHOD: `GET` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:19:33.962926 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9881ec-a0ef-42fb-997b-d1aa951a46a1 None admin] SCRIPT_NAME: `/identity` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:19:33.963425 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9881ec-a0ef-42fb-997b-d1aa951a46a1 None admin] PATH_INFO: `/v3/services` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:19:33.964411 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f2c8f1-6d08-40bd-aec3-00d465aeb0db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:19:33.964759 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f9881ec-a0ef-42fb-997b-d1aa951a46a1 None admin] RBAC: Adding query filter params (type=network) {{(pid=479851) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 09:19:33.965319 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f2c8f1-6d08-40bd-aec3-00d465aeb0db None admin] REQUEST_METHOD: `PUT` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:19:33.965445 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f9881ec-a0ef-42fb-997b-d1aa951a46a1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:19:33.965781 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f2c8f1-6d08-40bd-aec3-00d465aeb0db None admin] SCRIPT_NAME: `/identity` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:19:33.966161 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f2c8f1-6d08-40bd-aec3-00d465aeb0db None admin] PATH_INFO: `/v3/projects/3a0fb8ea8010437bade8f92dcbcaacee/users/c824cbfdc0dc4532ac6af71cbb6841fd/roles/685084310b35477b9b2d0c7934d0f803` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:19:33.968010 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f9881ec-a0ef-42fb-997b-d1aa951a46a1 None admin] RBAC: Authorization granted {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:19:33.968328 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39f2c8f1-6d08-40bd-aec3-00d465aeb0db None admin] RBAC: Authorizing `identity:create_grant(project_id=3a0fb8ea8010437bade8f92dcbcaacee, user_id=c824cbfdc0dc4532ac6af71cbb6841fd, role_id=685084310b35477b9b2d0c7934d0f803)` {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:19:33.969947 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39f2c8f1-6d08-40bd-aec3-00d465aeb0db None admin] RBAC: Authorization granted {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:19:33.977661 dv-cinder-851351-1-smb devstack@keystone.service[479851]: [pid: 479851|app: 0|req: 382/777] 10.222.0.42 () {56 vars in 1112 bytes} [Thu Jul 28 09:19:33 2022] GET /identity/v3/services?type=network => generated 350 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:19:33.979957 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8bc9d20-05fc-4231-bc5d-844d65095055 None None] REQUEST_METHOD: `GET` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:19:33.980477 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8bc9d20-05fc-4231-bc5d-844d65095055 None None] SCRIPT_NAME: `/identity` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:19:33.981040 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8bc9d20-05fc-4231-bc5d-844d65095055 None None] PATH_INFO: `/` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:19:33.984359 dv-cinder-851351-1-smb devstack@keystone.service[479851]: [pid: 479851|app: 0|req: 383/778] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 09:19:33 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 09:19:33.985752 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8bc9d20-05fc-4231-bc5d-844d65095055 None None] Authenticating user token {{(pid=479851) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:19:33.998757 dv-cinder-851351-1-smb devstack@keystone.service[479852]: [pid: 479852|app: 0|req: 396/779] 10.222.0.42 () {58 vars in 1439 bytes} [Thu Jul 28 09:19:33 2022] PUT /identity/v3/projects/3a0fb8ea8010437bade8f92dcbcaacee/users/c824cbfdc0dc4532ac6af71cbb6841fd/roles/685084310b35477b9b2d0c7934d0f803 => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 09:19:34.001061 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62fb861-3ca8-40fb-aa63-7dcd1ac7b8db None None] REQUEST_METHOD: `POST` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:19:34.001594 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62fb861-3ca8-40fb-aa63-7dcd1ac7b8db None None] SCRIPT_NAME: `/identity` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:19:34.002107 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62fb861-3ca8-40fb-aa63-7dcd1ac7b8db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:19:34.033673 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.auth.core [None req-d62fb861-3ca8-40fb-aa63-7dcd1ac7b8db None None] MFA Rules not processed for user `c198f91a4ae84d2b9cc730a6e304c2be`. Rule list: `[]` (Enabled: `True`). {{(pid=479852) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 09:19:34.035820 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.fernet_utils [None req-d62fb861-3ca8-40fb-aa63-7dcd1ac7b8db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=479852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 09:19:34.135327 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8bc9d20-05fc-4231-bc5d-844d65095055 None None] Validating token access rules against request {{(pid=479851) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:19:34.165384 dv-cinder-851351-1-smb devstack@keystone.service[479852]: [pid: 479852|app: 0|req: 397/780] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 09:19:33 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 09:19:34.197521 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b88d0f84-70e5-48b5-9f23-6f539254ef1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479851) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:19:34.198181 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88d0f84-70e5-48b5-9f23-6f539254ef1a None admin] REQUEST_METHOD: `GET` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:19:34.198466 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88d0f84-70e5-48b5-9f23-6f539254ef1a None admin] SCRIPT_NAME: `/identity` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:19:34.198746 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88d0f84-70e5-48b5-9f23-6f539254ef1a None admin] PATH_INFO: `/v3/endpoints` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:19:34.199533 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b88d0f84-70e5-48b5-9f23-6f539254ef1a None admin] RBAC: Adding query filter params (interface=public, service_id=c312bef7aca94c7d9ccbe808b708917e, region_id=RegionOne) {{(pid=479851) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 09:19:34.199847 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b88d0f84-70e5-48b5-9f23-6f539254ef1a None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:19:34.201334 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b88d0f84-70e5-48b5-9f23-6f539254ef1a None admin] RBAC: Authorization granted {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:19:34.207066 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d62fb861-3ca8-40fb-aa63-7dcd1ac7b8db None None] Authenticating user token {{(pid=479852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:19:34.219226 dv-cinder-851351-1-smb devstack@keystone.service[479851]: [pid: 479851|app: 0|req: 384/781] 10.222.0.42 () {56 vars in 1251 bytes} [Thu Jul 28 09:19:33 2022] GET /identity/v3/endpoints?service_id=c312bef7aca94c7d9ccbe808b708917e&interface=public®ion_id=RegionOne => generated 194 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:19:34.225189 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b88d0f84-70e5-48b5-9f23-6f539254ef1a None admin] Authenticating user token {{(pid=479851) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:19:34.308111 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG dbcounter [-] [479852] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=479852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:19:34.312340 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG dbcounter [-] [479851] Writing DB stats keystone:SELECT=100 {{(pid=479851) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:19:34.391711 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b88d0f84-70e5-48b5-9f23-6f539254ef1a None admin] Validating token access rules against request {{(pid=479851) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:19:34.409168 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d62fb861-3ca8-40fb-aa63-7dcd1ac7b8db None None] Validating token access rules against request {{(pid=479852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:19:34.465099 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5983d777-5172-415b-9a90-1e77f23d9e35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479851) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:19:34.465656 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5983d777-5172-415b-9a90-1e77f23d9e35 None admin] REQUEST_METHOD: `GET` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:19:34.465945 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5983d777-5172-415b-9a90-1e77f23d9e35 None admin] SCRIPT_NAME: `/identity` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:19:34.466228 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5983d777-5172-415b-9a90-1e77f23d9e35 None admin] PATH_INFO: `/v3/services` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:19:34.466906 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5983d777-5172-415b-9a90-1e77f23d9e35 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:19:34.468312 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5983d777-5172-415b-9a90-1e77f23d9e35 None admin] RBAC: Authorization granted {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:19:34.474618 dv-cinder-851351-1-smb devstack@keystone.service[479851]: [pid: 479851|app: 0|req: 385/782] 10.222.0.42 () {56 vars in 1087 bytes} [Thu Jul 28 09:19:34 2022] GET /identity/v3/services => generated 772 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 09:19:34.481532 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69df9e14-203f-4476-a098-9c107743302e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:19:34.482214 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69df9e14-203f-4476-a098-9c107743302e None admin] REQUEST_METHOD: `GET` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:19:34.482496 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69df9e14-203f-4476-a098-9c107743302e None admin] SCRIPT_NAME: `/identity` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:19:34.482768 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69df9e14-203f-4476-a098-9c107743302e None admin] PATH_INFO: `/v3/roles/service` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:19:34.494508 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69df9e14-203f-4476-a098-9c107743302e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 09:19:34.500002 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application [None req-69df9e14-203f-4476-a098-9c107743302e None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 28 09:19:34.500002 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 09:19:34.500002 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 09:19:34.500002 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 09:19:34.500002 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 09:19:34.500002 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 09:19:34.500002 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 09:19:34.500002 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 09:19:34.500002 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 09:19:34.500002 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 09:19:34.500002 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 09:19:34.500002 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 09:19:34.500002 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 09:19:34.500002 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 09:19:34.500002 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 09:19:34.500002 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 09:19:34.501394 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 09:19:34.501394 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 09:19:34.501394 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 09:19:34.501394 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 09:19:34.501394 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 09:19:34.501394 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 09:19:34.501394 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 09:19:34.501394 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 09:19:34.501394 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 09:19:34.501394 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 09:19:34.501394 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 09:19:34.501394 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application with Lock( Jul 28 09:19:34.501394 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 09:19:34.501394 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self._enter() Jul 28 09:19:34.501394 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 09:19:34.501394 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 09:19:34.502392 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 09:19:34.502392 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self.creator() Jul 28 09:19:34.502392 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 09:19:34.502392 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application created_value = creator( Jul 28 09:19:34.502392 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 09:19:34.502392 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 09:19:34.502392 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 09:19:34.502392 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 09:19:34.502392 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 09:19:34.502392 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 09:19:34.502392 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 28 09:19:34.502392 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application Jul 28 09:19:34.502392 dv-cinder-851351-1-smb devstack@keystone.service[479852]: [pid: 479852|app: 0|req: 398/783] 10.222.0.42 () {56 vars in 1102 bytes} [Thu Jul 28 09:19:34 2022] GET /identity/v3/roles/service => generated 85 bytes in 295 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 09:19:34.507905 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5983d777-5172-415b-9a90-1e77f23d9e35 None admin] Authenticating user token {{(pid=479851) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:19:34.674166 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5983d777-5172-415b-9a90-1e77f23d9e35 None admin] Validating token access rules against request {{(pid=479851) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:19:34.701467 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG dbcounter [-] [479851] Writing DB stats keystone:SELECT=100 {{(pid=479851) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:19:34.719618 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f07f60-ad6e-4d3e-8b30-19cf60c041e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479851) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:19:34.720194 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f07f60-ad6e-4d3e-8b30-19cf60c041e3 None admin] REQUEST_METHOD: `GET` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:19:34.720484 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f07f60-ad6e-4d3e-8b30-19cf60c041e3 None admin] SCRIPT_NAME: `/identity` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:19:34.720800 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f07f60-ad6e-4d3e-8b30-19cf60c041e3 None admin] PATH_INFO: `/v3/roles` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:19:34.721652 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18f07f60-ad6e-4d3e-8b30-19cf60c041e3 None admin] RBAC: Adding query filter params (name=service) {{(pid=479851) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 09:19:34.721968 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18f07f60-ad6e-4d3e-8b30-19cf60c041e3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:19:34.723386 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18f07f60-ad6e-4d3e-8b30-19cf60c041e3 None admin] RBAC: Authorization granted {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:19:34.738305 dv-cinder-851351-1-smb devstack@keystone.service[479851]: [pid: 479851|app: 0|req: 386/784] 10.222.0.42 () {56 vars in 1103 bytes} [Thu Jul 28 09:19:34 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:19:34.739890 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69df9e14-203f-4476-a098-9c107743302e None admin] Authenticating user token {{(pid=479852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:19:34.883247 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bac51b7-b552-4128-8f1c-51276e3dbea4 None None] REQUEST_METHOD: `GET` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:19:34.883704 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bac51b7-b552-4128-8f1c-51276e3dbea4 None None] SCRIPT_NAME: `/identity` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:19:34.883829 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bac51b7-b552-4128-8f1c-51276e3dbea4 None None] PATH_INFO: `/` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:19:34.885524 dv-cinder-851351-1-smb devstack@keystone.service[479851]: [pid: 479851|app: 0|req: 387/785] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 09:19:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 09:19:34.894320 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69df9e14-203f-4476-a098-9c107743302e None admin] Validating token access rules against request {{(pid=479852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:19:34.900392 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG dbcounter [-] [479852] Writing DB stats keystone:SELECT=100 {{(pid=479852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:19:34.900908 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c9ea84-04d8-4680-9917-0404a5d00cea None None] REQUEST_METHOD: `POST` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:19:34.901210 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c9ea84-04d8-4680-9917-0404a5d00cea None None] SCRIPT_NAME: `/identity` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:19:34.901500 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c9ea84-04d8-4680-9917-0404a5d00cea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:19:34.936050 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.auth.core [None req-29c9ea84-04d8-4680-9917-0404a5d00cea None None] MFA Rules not processed for user `c198f91a4ae84d2b9cc730a6e304c2be`. Rule list: `[]` (Enabled: `True`). {{(pid=479851) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 09:19:34.937326 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.fernet_utils [None req-29c9ea84-04d8-4680-9917-0404a5d00cea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=479851) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 09:19:34.952535 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a180377d-5457-4e25-8baa-48705950d0ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:19:34.953243 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a180377d-5457-4e25-8baa-48705950d0ca None admin] REQUEST_METHOD: `GET` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:19:34.953528 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a180377d-5457-4e25-8baa-48705950d0ca None admin] SCRIPT_NAME: `/identity` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:19:34.953808 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a180377d-5457-4e25-8baa-48705950d0ca None admin] PATH_INFO: `/v3/domains/Default` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:19:34.973169 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a180377d-5457-4e25-8baa-48705950d0ca None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:19:34.974721 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a180377d-5457-4e25-8baa-48705950d0ca None admin] RBAC: Authorization granted {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:19:35.004085 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application [None req-a180377d-5457-4e25-8baa-48705950d0ca None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 09:19:35.004085 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 09:19:35.004085 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 09:19:35.004085 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 09:19:35.004085 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 09:19:35.004085 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 09:19:35.004085 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 09:19:35.004085 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 09:19:35.004085 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 09:19:35.004085 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 09:19:35.004085 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 09:19:35.004085 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 09:19:35.004085 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 09:19:35.004085 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 09:19:35.004085 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 09:19:35.005315 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 09:19:35.005315 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 09:19:35.005315 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 09:19:35.005315 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 09:19:35.005315 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 09:19:35.005315 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 09:19:35.005315 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 09:19:35.005315 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 09:19:35.005315 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application with Lock( Jul 28 09:19:35.005315 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 09:19:35.005315 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self._enter() Jul 28 09:19:35.005315 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 09:19:35.005315 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 09:19:35.005315 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 09:19:35.005315 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self.creator() Jul 28 09:19:35.005315 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 09:19:35.005315 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application created_value = creator( Jul 28 09:19:35.006416 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 09:19:35.006416 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 09:19:35.006416 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 09:19:35.006416 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application Jul 28 09:19:35.006416 dv-cinder-851351-1-smb devstack@keystone.service[479852]: [pid: 479852|app: 0|req: 399/786] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 09:19:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 267 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 09:19:35.012620 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a180377d-5457-4e25-8baa-48705950d0ca None admin] Authenticating user token {{(pid=479852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:19:35.050057 dv-cinder-851351-1-smb devstack@keystone.service[479851]: [pid: 479851|app: 0|req: 388/787] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 09:19:34 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 28 09:19:35.086108 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c9ea84-04d8-4680-9917-0404a5d00cea None None] Authenticating user token {{(pid=479851) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:19:35.170171 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a180377d-5457-4e25-8baa-48705950d0ca None admin] Validating token access rules against request {{(pid=479852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:19:35.208217 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d5a25d-3618-4fe6-9a5d-3302ed9c8673 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:19:35.208888 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d5a25d-3618-4fe6-9a5d-3302ed9c8673 None admin] REQUEST_METHOD: `GET` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:19:35.209179 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d5a25d-3618-4fe6-9a5d-3302ed9c8673 None admin] SCRIPT_NAME: `/identity` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:19:35.209460 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d5a25d-3618-4fe6-9a5d-3302ed9c8673 None admin] PATH_INFO: `/v3/domains` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:19:35.210179 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35d5a25d-3618-4fe6-9a5d-3302ed9c8673 None admin] RBAC: Adding query filter params (name=Default) {{(pid=479852) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 09:19:35.210488 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35d5a25d-3618-4fe6-9a5d-3302ed9c8673 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:19:35.212002 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35d5a25d-3618-4fe6-9a5d-3302ed9c8673 None admin] RBAC: Authorization granted {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:19:35.225776 dv-cinder-851351-1-smb devstack@keystone.service[479852]: [pid: 479852|app: 0|req: 400/788] 10.222.0.42 () {56 vars in 1109 bytes} [Thu Jul 28 09:19:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:19:35.231311 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d5a25d-3618-4fe6-9a5d-3302ed9c8673 None admin] Authenticating user token {{(pid=479852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:19:35.252033 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG dbcounter [-] [479852] Writing DB stats keystone:SELECT=100 {{(pid=479852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:19:35.277193 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c9ea84-04d8-4680-9917-0404a5d00cea None None] Validating token access rules against request {{(pid=479851) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:19:35.317036 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG dbcounter [-] [479851] Writing DB stats keystone:SELECT=100 {{(pid=479851) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:19:35.338719 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875d5e33-a18c-4752-9c10-5ba51e2d2109 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479851) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:19:35.339426 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875d5e33-a18c-4752-9c10-5ba51e2d2109 None admin] REQUEST_METHOD: `GET` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:19:35.339718 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875d5e33-a18c-4752-9c10-5ba51e2d2109 None admin] SCRIPT_NAME: `/identity` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:19:35.339999 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875d5e33-a18c-4752-9c10-5ba51e2d2109 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:19:35.340911 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d5a25d-3618-4fe6-9a5d-3302ed9c8673 None admin] Validating token access rules against request {{(pid=479852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:19:35.358404 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-875d5e33-a18c-4752-9c10-5ba51e2d2109 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 09:19:35.374202 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application [None req-875d5e33-a18c-4752-9c10-5ba51e2d2109 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 09:19:35.374202 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 09:19:35.374202 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 09:19:35.374202 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 09:19:35.374202 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 09:19:35.374202 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 09:19:35.374202 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 09:19:35.374202 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 09:19:35.374202 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 09:19:35.374202 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 09:19:35.374202 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 09:19:35.374202 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 09:19:35.374202 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 09:19:35.374202 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 09:19:35.374202 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 09:19:35.374202 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 09:19:35.375377 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 09:19:35.375377 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 09:19:35.375377 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 09:19:35.375377 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 09:19:35.375377 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 09:19:35.375377 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 09:19:35.375377 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 09:19:35.375377 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 09:19:35.375377 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 09:19:35.375377 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 09:19:35.375377 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 09:19:35.375377 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application with Lock( Jul 28 09:19:35.375377 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 09:19:35.375377 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return self._enter() Jul 28 09:19:35.375377 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 09:19:35.375377 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 09:19:35.376375 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 09:19:35.376375 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return self.creator() Jul 28 09:19:35.376375 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 09:19:35.376375 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application created_value = creator( Jul 28 09:19:35.376375 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 09:19:35.376375 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 09:19:35.376375 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 09:19:35.376375 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 09:19:35.376375 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 09:19:35.376375 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 09:19:35.376375 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 09:19:35.376375 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application Jul 28 09:19:35.376375 dv-cinder-851351-1-smb devstack@keystone.service[479851]: [pid: 479851|app: 0|req: 389/789] 10.222.0.42 () {56 vars in 1096 bytes} [Thu Jul 28 09:19:35 2022] GET /identity/v3/roles/admin => generated 83 bytes in 290 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 09:19:35.389243 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff18289f-75c8-4d1f-b847-fa8fa2505f74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:19:35.389715 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875d5e33-a18c-4752-9c10-5ba51e2d2109 None admin] Authenticating user token {{(pid=479851) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:19:35.390038 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff18289f-75c8-4d1f-b847-fa8fa2505f74 None admin] REQUEST_METHOD: `GET` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:19:35.390325 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff18289f-75c8-4d1f-b847-fa8fa2505f74 None admin] SCRIPT_NAME: `/identity` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:19:35.390611 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff18289f-75c8-4d1f-b847-fa8fa2505f74 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:19:35.399311 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff18289f-75c8-4d1f-b847-fa8fa2505f74 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:19:35.400885 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff18289f-75c8-4d1f-b847-fa8fa2505f74 None admin] RBAC: Authorization granted {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:19:35.414982 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application [None req-ff18289f-75c8-4d1f-b847-fa8fa2505f74 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 28 09:19:35.414982 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 09:19:35.414982 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 09:19:35.414982 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 09:19:35.414982 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 09:19:35.414982 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 09:19:35.414982 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 09:19:35.414982 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 09:19:35.414982 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 09:19:35.414982 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 09:19:35.414982 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 09:19:35.414982 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 09:19:35.414982 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 28 09:19:35.414982 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 28 09:19:35.414982 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 28 09:19:35.414982 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 28 09:19:35.417456 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 09:19:35.417456 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 09:19:35.417456 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 28 09:19:35.417456 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 09:19:35.417456 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 28 09:19:35.417456 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 09:19:35.417456 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 09:19:35.417456 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 09:19:35.417456 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 09:19:35.417456 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 09:19:35.417456 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 09:19:35.417456 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application with Lock( Jul 28 09:19:35.417456 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 09:19:35.417456 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self._enter() Jul 28 09:19:35.417456 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 09:19:35.417456 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 09:19:35.417456 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 09:19:35.417456 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self.creator() Jul 28 09:19:35.419863 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 09:19:35.419863 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application created_value = creator( Jul 28 09:19:35.419863 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 28 09:19:35.419863 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 28 09:19:35.419863 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 28 09:19:35.419863 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 28 09:19:35.419863 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 28 09:19:35.419863 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 28 09:19:35.419863 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 28 09:19:35.419863 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application Jul 28 09:19:35.419863 dv-cinder-851351-1-smb devstack@keystone.service[479852]: [pid: 479852|app: 0|req: 401/790] 10.222.0.42 () {56 vars in 1117 bytes} [Thu Jul 28 09:19:35 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 09:19:35.422553 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff18289f-75c8-4d1f-b847-fa8fa2505f74 None admin] Authenticating user token {{(pid=479852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:19:35.567032 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG dbcounter [-] [479852] Writing DB stats keystone:SELECT=100 {{(pid=479852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:19:35.594332 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff18289f-75c8-4d1f-b847-fa8fa2505f74 None admin] Validating token access rules against request {{(pid=479852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:19:35.633967 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875d5e33-a18c-4752-9c10-5ba51e2d2109 None admin] Validating token access rules against request {{(pid=479851) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:19:35.636065 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f986b730-51eb-4ecf-8a15-9e37c10ca379 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:19:35.636745 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f986b730-51eb-4ecf-8a15-9e37c10ca379 None admin] REQUEST_METHOD: `GET` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:19:35.637031 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f986b730-51eb-4ecf-8a15-9e37c10ca379 None admin] SCRIPT_NAME: `/identity` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:19:35.637305 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f986b730-51eb-4ecf-8a15-9e37c10ca379 None admin] PATH_INFO: `/v3/users` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:19:35.638133 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f986b730-51eb-4ecf-8a15-9e37c10ca379 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=479852) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 09:19:35.638441 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f986b730-51eb-4ecf-8a15-9e37c10ca379 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:19:35.639990 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f986b730-51eb-4ecf-8a15-9e37c10ca379 None admin] RBAC: Authorization granted {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:19:35.682632 dv-cinder-851351-1-smb devstack@keystone.service[479852]: [pid: 479852|app: 0|req: 402/791] 10.222.0.42 () {56 vars in 1149 bytes} [Thu Jul 28 09:19:35 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 09:19:35.683717 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f986b730-51eb-4ecf-8a15-9e37c10ca379 None admin] Authenticating user token {{(pid=479852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:19:35.722112 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68961aeb-4423-4fc2-98de-6dc7e581d32f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479851) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:19:35.722877 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68961aeb-4423-4fc2-98de-6dc7e581d32f None admin] REQUEST_METHOD: `GET` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:19:35.723095 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68961aeb-4423-4fc2-98de-6dc7e581d32f None admin] SCRIPT_NAME: `/identity` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:19:35.723387 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68961aeb-4423-4fc2-98de-6dc7e581d32f None admin] PATH_INFO: `/v3/roles` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:19:35.724299 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68961aeb-4423-4fc2-98de-6dc7e581d32f None admin] RBAC: Adding query filter params (name=admin) {{(pid=479851) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 09:19:35.724691 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68961aeb-4423-4fc2-98de-6dc7e581d32f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:19:35.726170 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68961aeb-4423-4fc2-98de-6dc7e581d32f None admin] RBAC: Authorization granted {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:19:35.749901 dv-cinder-851351-1-smb devstack@keystone.service[479851]: [pid: 479851|app: 0|req: 390/792] 10.222.0.42 () {56 vars in 1099 bytes} [Thu Jul 28 09:19:35 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 360 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:19:35.753770 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68961aeb-4423-4fc2-98de-6dc7e581d32f None admin] Authenticating user token {{(pid=479851) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:19:35.845076 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG dbcounter [-] [479851] Writing DB stats keystone:SELECT=100 {{(pid=479851) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:19:35.890419 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f986b730-51eb-4ecf-8a15-9e37c10ca379 None admin] Validating token access rules against request {{(pid=479852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:19:35.928706 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca81669a-81cd-4735-8cb3-3262d047920b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:19:35.929532 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca81669a-81cd-4735-8cb3-3262d047920b None admin] REQUEST_METHOD: `GET` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:19:35.929761 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca81669a-81cd-4735-8cb3-3262d047920b None admin] SCRIPT_NAME: `/identity` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:19:35.930024 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca81669a-81cd-4735-8cb3-3262d047920b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:19:35.936621 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68961aeb-4423-4fc2-98de-6dc7e581d32f None admin] Validating token access rules against request {{(pid=479851) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:19:35.941087 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca81669a-81cd-4735-8cb3-3262d047920b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:19:35.942481 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca81669a-81cd-4735-8cb3-3262d047920b None admin] RBAC: Authorization granted {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:19:35.958552 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application [None req-ca81669a-81cd-4735-8cb3-3262d047920b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 09:19:35.958552 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 09:19:35.958552 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 09:19:35.958552 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 09:19:35.958552 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 09:19:35.958552 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 09:19:35.958552 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 09:19:35.958552 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 09:19:35.958552 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 09:19:35.958552 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 09:19:35.958552 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 09:19:35.958552 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 09:19:35.958552 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 09:19:35.958552 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 09:19:35.958552 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 09:19:35.959695 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 09:19:35.959695 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 09:19:35.959695 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 09:19:35.959695 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 09:19:35.959695 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 09:19:35.959695 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 09:19:35.959695 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 09:19:35.959695 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 09:19:35.959695 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application with Lock( Jul 28 09:19:35.959695 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 09:19:35.959695 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self._enter() Jul 28 09:19:35.959695 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 09:19:35.959695 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 09:19:35.959695 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 09:19:35.959695 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self.creator() Jul 28 09:19:35.959695 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 09:19:35.959695 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application created_value = creator( Jul 28 09:19:35.960805 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 09:19:35.960805 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 09:19:35.960805 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 09:19:35.960805 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application Jul 28 09:19:35.960805 dv-cinder-851351-1-smb devstack@keystone.service[479852]: [pid: 479852|app: 0|req: 403/793] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 09:19:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 277 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 09:19:35.960805 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG dbcounter [-] [479852] Writing DB stats keystone:SELECT=100 {{(pid=479852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:19:35.966130 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971e79d1-37a9-454c-9da7-c4d2d3cf339d None None] REQUEST_METHOD: `GET` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:19:35.966418 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971e79d1-37a9-454c-9da7-c4d2d3cf339d None None] SCRIPT_NAME: `/identity` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:19:35.966698 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971e79d1-37a9-454c-9da7-c4d2d3cf339d None None] PATH_INFO: `/` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:19:35.972265 dv-cinder-851351-1-smb devstack@keystone.service[479852]: [pid: 479852|app: 0|req: 404/794] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 09:19:35 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 09:19:35.972265 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971e79d1-37a9-454c-9da7-c4d2d3cf339d None None] Authenticating user token {{(pid=479852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:19:35.993820 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a4c727-5b1f-49c1-b60f-e1dc6b37788b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479851) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:19:35.994926 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a4c727-5b1f-49c1-b60f-e1dc6b37788b None admin] REQUEST_METHOD: `GET` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:19:35.995439 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a4c727-5b1f-49c1-b60f-e1dc6b37788b None admin] SCRIPT_NAME: `/identity` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:19:35.995936 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a4c727-5b1f-49c1-b60f-e1dc6b37788b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:19:36.011262 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a4c727-5b1f-49c1-b60f-e1dc6b37788b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:19:36.013904 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a4c727-5b1f-49c1-b60f-e1dc6b37788b None admin] RBAC: Authorization granted {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:19:36.032610 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application [None req-31a4c727-5b1f-49c1-b60f-e1dc6b37788b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 09:19:36.032610 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 09:19:36.032610 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 09:19:36.032610 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 09:19:36.032610 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 09:19:36.032610 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 09:19:36.032610 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 09:19:36.032610 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 09:19:36.032610 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 09:19:36.032610 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 09:19:36.032610 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 09:19:36.032610 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 09:19:36.032610 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 09:19:36.032610 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 09:19:36.032610 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 09:19:36.033752 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 09:19:36.033752 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 09:19:36.033752 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 09:19:36.033752 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 09:19:36.033752 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 09:19:36.033752 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 09:19:36.033752 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 09:19:36.033752 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 09:19:36.033752 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application with Lock( Jul 28 09:19:36.033752 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 09:19:36.033752 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return self._enter() Jul 28 09:19:36.033752 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 09:19:36.033752 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 09:19:36.033752 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 09:19:36.033752 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return self.creator() Jul 28 09:19:36.033752 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 09:19:36.033752 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application created_value = creator( Jul 28 09:19:36.034815 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 09:19:36.034815 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 09:19:36.034815 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 09:19:36.034815 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application Jul 28 09:19:36.041837 dv-cinder-851351-1-smb devstack@keystone.service[479851]: [pid: 479851|app: 0|req: 391/795] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 09:19:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 284 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 09:19:36.041837 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff332d3-04b2-4e51-bcd9-aa460dc59902 None None] REQUEST_METHOD: `POST` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:19:36.041837 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff332d3-04b2-4e51-bcd9-aa460dc59902 None None] SCRIPT_NAME: `/identity` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:19:36.041837 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff332d3-04b2-4e51-bcd9-aa460dc59902 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:19:36.064279 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.auth.core [None req-bff332d3-04b2-4e51-bcd9-aa460dc59902 None None] MFA Rules not processed for user `c198f91a4ae84d2b9cc730a6e304c2be`. Rule list: `[]` (Enabled: `True`). {{(pid=479851) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 09:19:36.065534 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.fernet_utils [None req-bff332d3-04b2-4e51-bcd9-aa460dc59902 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=479851) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 09:19:36.108499 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971e79d1-37a9-454c-9da7-c4d2d3cf339d None None] Validating token access rules against request {{(pid=479852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:19:36.140816 dv-cinder-851351-1-smb devstack@keystone.service[479851]: [pid: 479851|app: 0|req: 392/796] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 09:19:36 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 09:19:36.140816 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff332d3-04b2-4e51-bcd9-aa460dc59902 None None] Authenticating user token {{(pid=479851) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:19:36.170441 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f18248c4-587a-4daf-8d45-3683fb362a48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:19:36.171841 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18248c4-587a-4daf-8d45-3683fb362a48 None admin] REQUEST_METHOD: `GET` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:19:36.172323 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18248c4-587a-4daf-8d45-3683fb362a48 None admin] SCRIPT_NAME: `/identity` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:19:36.172994 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18248c4-587a-4daf-8d45-3683fb362a48 None admin] PATH_INFO: `/v3/domains` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:19:36.173149 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG dbcounter [-] [479851] Writing DB stats keystone:SELECT=100 {{(pid=479851) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:19:36.173914 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f18248c4-587a-4daf-8d45-3683fb362a48 None admin] RBAC: Adding query filter params (name=Default) {{(pid=479852) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 09:19:36.174228 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f18248c4-587a-4daf-8d45-3683fb362a48 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:19:36.176762 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f18248c4-587a-4daf-8d45-3683fb362a48 None admin] RBAC: Authorization granted {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:19:36.191328 dv-cinder-851351-1-smb devstack@keystone.service[479852]: [pid: 479852|app: 0|req: 405/797] 10.222.0.42 () {56 vars in 1109 bytes} [Thu Jul 28 09:19:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:19:36.196696 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f18248c4-587a-4daf-8d45-3683fb362a48 None admin] Authenticating user token {{(pid=479852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:19:36.244505 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG dbcounter [-] [479852] Writing DB stats keystone:SELECT=100 {{(pid=479852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:19:36.270115 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff332d3-04b2-4e51-bcd9-aa460dc59902 None None] Validating token access rules against request {{(pid=479851) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:19:36.305614 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f18248c4-587a-4daf-8d45-3683fb362a48 None admin] Validating token access rules against request {{(pid=479852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:19:36.308125 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d66b496-7c53-4639-8ce2-908fb03f1e4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479851) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:19:36.309102 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d66b496-7c53-4639-8ce2-908fb03f1e4e None admin] REQUEST_METHOD: `GET` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:19:36.309611 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d66b496-7c53-4639-8ce2-908fb03f1e4e None admin] SCRIPT_NAME: `/identity` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:19:36.310101 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d66b496-7c53-4639-8ce2-908fb03f1e4e None admin] PATH_INFO: `/v3/domains` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:19:36.311036 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d66b496-7c53-4639-8ce2-908fb03f1e4e None admin] RBAC: Adding query filter params (name=Default) {{(pid=479851) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 09:19:36.311596 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d66b496-7c53-4639-8ce2-908fb03f1e4e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:19:36.313389 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d66b496-7c53-4639-8ce2-908fb03f1e4e None admin] RBAC: Authorization granted {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:19:36.326795 dv-cinder-851351-1-smb devstack@keystone.service[479851]: [pid: 479851|app: 0|req: 393/798] 10.222.0.42 () {56 vars in 1109 bytes} [Thu Jul 28 09:19:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:19:36.328060 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d66b496-7c53-4639-8ce2-908fb03f1e4e None admin] Authenticating user token {{(pid=479851) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:19:36.349071 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ebf343-56b2-40f7-91f7-49491098b407 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:19:36.349550 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ebf343-56b2-40f7-91f7-49491098b407 None admin] REQUEST_METHOD: `GET` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:19:36.349833 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ebf343-56b2-40f7-91f7-49491098b407 None admin] SCRIPT_NAME: `/identity` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:19:36.350107 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ebf343-56b2-40f7-91f7-49491098b407 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:19:36.350807 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7ebf343-56b2-40f7-91f7-49491098b407 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:19:36.352247 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7ebf343-56b2-40f7-91f7-49491098b407 None admin] RBAC: Authorization granted {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:19:36.362315 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application [None req-f7ebf343-56b2-40f7-91f7-49491098b407 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 28 09:19:36.362315 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 09:19:36.362315 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 28 09:19:36.362315 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 28 09:19:36.362315 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 28 09:19:36.362315 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 28 09:19:36.362315 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 28 09:19:36.362315 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 09:19:36.362315 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 28 09:19:36.362315 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application Jul 28 09:19:36.362315 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 28 09:19:36.362315 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application Jul 28 09:19:36.362315 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 09:19:36.362315 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 09:19:36.362315 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 09:19:36.362315 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 09:19:36.363443 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 09:19:36.363443 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 09:19:36.363443 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 09:19:36.363443 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 09:19:36.363443 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 09:19:36.363443 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 09:19:36.363443 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 09:19:36.363443 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 28 09:19:36.363443 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 28 09:19:36.363443 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 28 09:19:36.363443 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 28 09:19:36.363443 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 09:19:36.363443 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 09:19:36.363443 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 09:19:36.363443 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 09:19:36.363443 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 09:19:36.364634 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 09:19:36.364634 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 09:19:36.364634 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application with Lock( Jul 28 09:19:36.364634 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 09:19:36.364634 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self._enter() Jul 28 09:19:36.364634 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 09:19:36.364634 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 09:19:36.364634 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 09:19:36.364634 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self.creator() Jul 28 09:19:36.364634 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 09:19:36.364634 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application created_value = creator( Jul 28 09:19:36.364634 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 28 09:19:36.364634 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 09:19:36.364634 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 28 09:19:36.364634 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application Jul 28 09:19:36.368455 dv-cinder-851351-1-smb devstack@keystone.service[479852]: [pid: 479852|app: 0|req: 406/799] 10.222.0.42 () {56 vars in 1129 bytes} [Thu Jul 28 09:19:36 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 09:19:36.369475 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ebf343-56b2-40f7-91f7-49491098b407 None admin] Authenticating user token {{(pid=479852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:19:36.438774 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG dbcounter [-] [479851] Writing DB stats keystone:SELECT=100 {{(pid=479851) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:19:36.460686 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d66b496-7c53-4639-8ce2-908fb03f1e4e None admin] Validating token access rules against request {{(pid=479851) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:19:36.484690 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ebf343-56b2-40f7-91f7-49491098b407 None admin] Validating token access rules against request {{(pid=479852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:19:36.496962 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG dbcounter [-] [479852] Writing DB stats keystone:SELECT=100 {{(pid=479852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:19:36.504387 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e054b7-c6df-46d2-8f35-002e1fd34698 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479851) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:19:36.505530 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e054b7-c6df-46d2-8f35-002e1fd34698 None admin] REQUEST_METHOD: `GET` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:19:36.506035 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e054b7-c6df-46d2-8f35-002e1fd34698 None admin] SCRIPT_NAME: `/identity` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:19:36.506549 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e054b7-c6df-46d2-8f35-002e1fd34698 None admin] PATH_INFO: `/v3/projects/service` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:19:36.514476 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39e054b7-c6df-46d2-8f35-002e1fd34698 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:19:36.516292 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39e054b7-c6df-46d2-8f35-002e1fd34698 None admin] RBAC: Authorization granted {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:19:36.526137 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6687eed0-a6c3-4eeb-8479-26b1911ecedd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:19:36.526794 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6687eed0-a6c3-4eeb-8479-26b1911ecedd None admin] REQUEST_METHOD: `GET` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:19:36.527152 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6687eed0-a6c3-4eeb-8479-26b1911ecedd None admin] SCRIPT_NAME: `/identity` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:19:36.527431 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6687eed0-a6c3-4eeb-8479-26b1911ecedd None admin] PATH_INFO: `/v3/users/swift` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:19:36.530707 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application [None req-39e054b7-c6df-46d2-8f35-002e1fd34698 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 09:19:36.530707 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 09:19:36.530707 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 09:19:36.530707 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 09:19:36.530707 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 09:19:36.530707 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 09:19:36.530707 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 09:19:36.530707 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 09:19:36.530707 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 09:19:36.530707 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 09:19:36.530707 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 09:19:36.530707 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 09:19:36.530707 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 28 09:19:36.530707 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 28 09:19:36.530707 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 28 09:19:36.531781 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 28 09:19:36.531781 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 09:19:36.531781 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 09:19:36.531781 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 09:19:36.531781 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 09:19:36.531781 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 09:19:36.531781 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 09:19:36.531781 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 09:19:36.531781 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application with Lock( Jul 28 09:19:36.531781 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 09:19:36.531781 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return self._enter() Jul 28 09:19:36.531781 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 09:19:36.531781 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 09:19:36.531781 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 09:19:36.531781 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return self.creator() Jul 28 09:19:36.531781 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 09:19:36.531781 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application created_value = creator( Jul 28 09:19:36.532908 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 28 09:19:36.532908 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 28 09:19:36.532908 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 28 09:19:36.532908 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 28 09:19:36.532908 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 28 09:19:36.532908 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 28 09:19:36.532908 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 09:19:36.532908 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application Jul 28 09:19:36.539928 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6687eed0-a6c3-4eeb-8479-26b1911ecedd None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:19:36.540166 dv-cinder-851351-1-smb devstack@keystone.service[479851]: [pid: 479851|app: 0|req: 394/800] 10.222.0.42 () {56 vars in 1111 bytes} [Thu Jul 28 09:19:36 2022] GET /identity/v3/projects/service => generated 88 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 09:19:36.540166 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e054b7-c6df-46d2-8f35-002e1fd34698 None admin] Authenticating user token {{(pid=479851) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:19:36.540370 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6687eed0-a6c3-4eeb-8479-26b1911ecedd None admin] RBAC: Authorization granted {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:19:36.552782 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application [None req-6687eed0-a6c3-4eeb-8479-26b1911ecedd None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 28 09:19:36.552782 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 09:19:36.552782 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 09:19:36.552782 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 09:19:36.552782 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 09:19:36.552782 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 09:19:36.552782 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 09:19:36.552782 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 09:19:36.552782 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 09:19:36.552782 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 09:19:36.552782 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 09:19:36.552782 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 09:19:36.552782 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 28 09:19:36.552782 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 28 09:19:36.552782 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 28 09:19:36.552782 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 28 09:19:36.553965 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 09:19:36.553965 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 09:19:36.553965 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 28 09:19:36.553965 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 09:19:36.553965 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 28 09:19:36.553965 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 09:19:36.553965 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 09:19:36.553965 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 09:19:36.553965 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 09:19:36.553965 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 09:19:36.553965 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 09:19:36.553965 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application with Lock( Jul 28 09:19:36.553965 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 09:19:36.553965 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self._enter() Jul 28 09:19:36.553965 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 09:19:36.553965 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 09:19:36.553965 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 09:19:36.553965 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self.creator() Jul 28 09:19:36.555087 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 09:19:36.555087 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application created_value = creator( Jul 28 09:19:36.555087 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 28 09:19:36.555087 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 28 09:19:36.555087 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 28 09:19:36.555087 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 28 09:19:36.555087 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 28 09:19:36.555087 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 28 09:19:36.555087 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 28 09:19:36.555087 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application Jul 28 09:19:36.555087 dv-cinder-851351-1-smb devstack@keystone.service[479852]: [pid: 479852|app: 0|req: 407/801] 10.222.0.42 () {56 vars in 1096 bytes} [Thu Jul 28 09:19:36 2022] GET /identity/v3/users/swift => generated 83 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 09:19:36.555784 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f082e863-74b8-42a8-849c-7ee22d99597a None None] REQUEST_METHOD: `GET` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:19:36.555784 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f082e863-74b8-42a8-849c-7ee22d99597a None None] SCRIPT_NAME: `/identity` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:19:36.555784 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f082e863-74b8-42a8-849c-7ee22d99597a None None] PATH_INFO: `/` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:19:36.557426 dv-cinder-851351-1-smb devstack@keystone.service[479852]: [pid: 479852|app: 0|req: 408/802] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 09:19:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 09:19:36.558241 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f082e863-74b8-42a8-849c-7ee22d99597a None None] Authenticating user token {{(pid=479852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:19:36.661819 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e054b7-c6df-46d2-8f35-002e1fd34698 None admin] Validating token access rules against request {{(pid=479851) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:19:36.670285 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f082e863-74b8-42a8-849c-7ee22d99597a None None] Validating token access rules against request {{(pid=479852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:19:36.700856 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39780ccc-39af-4ea9-b2d3-d6db54a4c271 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479851) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:19:36.702015 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39780ccc-39af-4ea9-b2d3-d6db54a4c271 None admin] REQUEST_METHOD: `GET` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:19:36.702543 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39780ccc-39af-4ea9-b2d3-d6db54a4c271 None admin] SCRIPT_NAME: `/identity` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:19:36.703040 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39780ccc-39af-4ea9-b2d3-d6db54a4c271 None admin] PATH_INFO: `/v3/services` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:19:36.704149 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39780ccc-39af-4ea9-b2d3-d6db54a4c271 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=479851) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 09:19:36.704832 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39780ccc-39af-4ea9-b2d3-d6db54a4c271 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:19:36.706584 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39780ccc-39af-4ea9-b2d3-d6db54a4c271 None admin] RBAC: Authorization granted {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:19:36.706708 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b264553-a266-4bee-a5ee-0cabadb8131b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:19:36.707244 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b264553-a266-4bee-a5ee-0cabadb8131b None admin] REQUEST_METHOD: `GET` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:19:36.707527 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b264553-a266-4bee-a5ee-0cabadb8131b None admin] SCRIPT_NAME: `/identity` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:19:36.707804 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b264553-a266-4bee-a5ee-0cabadb8131b None admin] PATH_INFO: `/v3/projects` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:19:36.708606 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b264553-a266-4bee-a5ee-0cabadb8131b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=479852) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 09:19:36.708958 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b264553-a266-4bee-a5ee-0cabadb8131b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:19:36.710412 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b264553-a266-4bee-a5ee-0cabadb8131b None admin] RBAC: Authorization granted {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:19:36.713438 dv-cinder-851351-1-smb devstack@keystone.service[479851]: [pid: 479851|app: 0|req: 395/803] 10.222.0.42 () {56 vars in 1124 bytes} [Thu Jul 28 09:19:36 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:19:36.714516 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39780ccc-39af-4ea9-b2d3-d6db54a4c271 None admin] Authenticating user token {{(pid=479851) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:19:36.719908 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG dbcounter [-] [479851] Writing DB stats keystone:SELECT=100 {{(pid=479851) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:19:36.725424 dv-cinder-851351-1-smb devstack@keystone.service[479852]: [pid: 479852|app: 0|req: 409/804] 10.222.0.42 () {56 vars in 1148 bytes} [Thu Jul 28 09:19:36 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:19:36.726703 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d77e6c-7c15-4cde-97ba-b9eaaf7051c5 None None] REQUEST_METHOD: `POST` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:19:36.726991 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d77e6c-7c15-4cde-97ba-b9eaaf7051c5 None None] SCRIPT_NAME: `/identity` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:19:36.727270 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d77e6c-7c15-4cde-97ba-b9eaaf7051c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:19:36.750416 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.auth.core [None req-27d77e6c-7c15-4cde-97ba-b9eaaf7051c5 None None] MFA Rules not processed for user `c198f91a4ae84d2b9cc730a6e304c2be`. Rule list: `[]` (Enabled: `True`). {{(pid=479852) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 09:19:36.751804 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.fernet_utils [None req-27d77e6c-7c15-4cde-97ba-b9eaaf7051c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=479852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 09:19:36.783154 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG dbcounter [-] [479852] Writing DB stats keystone:SELECT=100 {{(pid=479852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:19:36.834140 dv-cinder-851351-1-smb devstack@keystone.service[479852]: [pid: 479852|app: 0|req: 410/805] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 09:19:36 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 09:19:36.835028 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d77e6c-7c15-4cde-97ba-b9eaaf7051c5 None None] Authenticating user token {{(pid=479852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:19:36.842777 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39780ccc-39af-4ea9-b2d3-d6db54a4c271 None admin] Validating token access rules against request {{(pid=479851) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:19:36.879836 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca551a61-53a3-4c53-85a0-ed246cc1596e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479851) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:19:36.882206 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca551a61-53a3-4c53-85a0-ed246cc1596e None admin] REQUEST_METHOD: `GET` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:19:36.882206 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca551a61-53a3-4c53-85a0-ed246cc1596e None admin] SCRIPT_NAME: `/identity` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:19:36.882206 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca551a61-53a3-4c53-85a0-ed246cc1596e None admin] PATH_INFO: `/v3/users` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:19:36.882206 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca551a61-53a3-4c53-85a0-ed246cc1596e None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=479851) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 09:19:36.882595 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca551a61-53a3-4c53-85a0-ed246cc1596e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:19:36.883824 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca551a61-53a3-4c53-85a0-ed246cc1596e None admin] RBAC: Authorization granted {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:19:36.903866 dv-cinder-851351-1-smb devstack@keystone.service[479851]: [pid: 479851|app: 0|req: 396/806] 10.222.0.42 () {56 vars in 1135 bytes} [Thu Jul 28 09:19:36 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:19:36.904731 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca551a61-53a3-4c53-85a0-ed246cc1596e None admin] Authenticating user token {{(pid=479851) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:19:36.947390 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d77e6c-7c15-4cde-97ba-b9eaaf7051c5 None None] Validating token access rules against request {{(pid=479852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:19:36.971963 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG dbcounter [-] [479851] Writing DB stats keystone:SELECT=100 {{(pid=479851) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:19:36.983070 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26945df7-9ff1-4705-af84-203ce0ff5da1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:19:36.983699 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26945df7-9ff1-4705-af84-203ce0ff5da1 None admin] REQUEST_METHOD: `GET` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:19:36.983986 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26945df7-9ff1-4705-af84-203ce0ff5da1 None admin] SCRIPT_NAME: `/identity` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:19:36.984258 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26945df7-9ff1-4705-af84-203ce0ff5da1 None admin] PATH_INFO: `/v3/services` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:19:36.984985 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26945df7-9ff1-4705-af84-203ce0ff5da1 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=479852) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 09:19:36.985290 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26945df7-9ff1-4705-af84-203ce0ff5da1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:19:36.986666 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26945df7-9ff1-4705-af84-203ce0ff5da1 None admin] RBAC: Authorization granted {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:19:36.991805 dv-cinder-851351-1-smb devstack@keystone.service[479852]: [pid: 479852|app: 0|req: 411/807] 10.222.0.42 () {56 vars in 1124 bytes} [Thu Jul 28 09:19:36 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:19:36.993155 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9ca104-3d71-4ffb-8ce2-762338eb0006 None None] REQUEST_METHOD: `GET` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:19:36.993415 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9ca104-3d71-4ffb-8ce2-762338eb0006 None None] SCRIPT_NAME: `/identity` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:19:36.993685 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9ca104-3d71-4ffb-8ce2-762338eb0006 None None] PATH_INFO: `/` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:19:36.994937 dv-cinder-851351-1-smb devstack@keystone.service[479852]: [pid: 479852|app: 0|req: 412/808] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 09:19:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 09:19:36.995783 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9ca104-3d71-4ffb-8ce2-762338eb0006 None None] Authenticating user token {{(pid=479852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:19:37.022173 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG dbcounter [-] [479852] Writing DB stats keystone:SELECT=100 {{(pid=479852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:19:37.026991 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca551a61-53a3-4c53-85a0-ed246cc1596e None admin] Validating token access rules against request {{(pid=479851) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:19:37.070771 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c35c696-f3c4-430e-abd8-8524e678f6af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479851) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:19:37.071800 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c35c696-f3c4-430e-abd8-8524e678f6af None admin] REQUEST_METHOD: `PUT` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:19:37.072087 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c35c696-f3c4-430e-abd8-8524e678f6af None admin] SCRIPT_NAME: `/identity` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:19:37.072395 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c35c696-f3c4-430e-abd8-8524e678f6af None admin] PATH_INFO: `/v3/projects/3a0fb8ea8010437bade8f92dcbcaacee/users/87596a91a45f4326855265497fe69b65/roles/bd74dfcbc8d7412689d315fe24a1f247` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:19:37.089230 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c35c696-f3c4-430e-abd8-8524e678f6af None admin] RBAC: Authorizing `identity:create_grant(project_id=3a0fb8ea8010437bade8f92dcbcaacee, user_id=87596a91a45f4326855265497fe69b65, role_id=bd74dfcbc8d7412689d315fe24a1f247)` {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:19:37.090708 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c35c696-f3c4-430e-abd8-8524e678f6af None admin] RBAC: Authorization granted {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:19:37.104655 dv-cinder-851351-1-smb devstack@keystone.service[479851]: [pid: 479851|app: 0|req: 397/809] 10.222.0.42 () {58 vars in 1439 bytes} [Thu Jul 28 09:19:36 2022] PUT /identity/v3/projects/3a0fb8ea8010437bade8f92dcbcaacee/users/87596a91a45f4326855265497fe69b65/roles/bd74dfcbc8d7412689d315fe24a1f247 => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 09:19:37.105498 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c35c696-f3c4-430e-abd8-8524e678f6af None admin] Authenticating user token {{(pid=479851) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:19:37.108837 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9ca104-3d71-4ffb-8ce2-762338eb0006 None None] Validating token access rules against request {{(pid=479852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:19:37.153995 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf068c0c-312a-446a-95b9-bde79240b310 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:19:37.154728 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf068c0c-312a-446a-95b9-bde79240b310 None admin] REQUEST_METHOD: `GET` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:19:37.155009 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf068c0c-312a-446a-95b9-bde79240b310 None admin] SCRIPT_NAME: `/identity` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:19:37.155333 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf068c0c-312a-446a-95b9-bde79240b310 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:19:37.171968 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf068c0c-312a-446a-95b9-bde79240b310 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 09:19:37.177380 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application [None req-cf068c0c-312a-446a-95b9-bde79240b310 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 09:19:37.177380 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 09:19:37.177380 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 09:19:37.177380 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 09:19:37.177380 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 09:19:37.177380 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 09:19:37.177380 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 09:19:37.177380 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 09:19:37.177380 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 09:19:37.177380 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 09:19:37.177380 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 09:19:37.177380 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 09:19:37.177380 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 09:19:37.177380 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 09:19:37.177380 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 09:19:37.177380 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 09:19:37.178778 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 09:19:37.178778 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 09:19:37.178778 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 09:19:37.178778 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 09:19:37.178778 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 09:19:37.178778 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 09:19:37.178778 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 09:19:37.178778 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 09:19:37.178778 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 09:19:37.178778 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 09:19:37.178778 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 09:19:37.178778 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application with Lock( Jul 28 09:19:37.178778 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 09:19:37.178778 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self._enter() Jul 28 09:19:37.178778 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 09:19:37.178778 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 09:19:37.179803 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 09:19:37.179803 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self.creator() Jul 28 09:19:37.179803 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 09:19:37.179803 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application created_value = creator( Jul 28 09:19:37.179803 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 09:19:37.179803 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 09:19:37.179803 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 09:19:37.179803 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 09:19:37.179803 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 09:19:37.179803 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 09:19:37.179803 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 09:19:37.179803 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application Jul 28 09:19:37.179803 dv-cinder-851351-1-smb devstack@keystone.service[479852]: [pid: 479852|app: 0|req: 413/810] 10.222.0.42 () {56 vars in 1096 bytes} [Thu Jul 28 09:19:36 2022] GET /identity/v3/roles/admin => generated 83 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 09:19:37.179803 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf068c0c-312a-446a-95b9-bde79240b310 None admin] Authenticating user token {{(pid=479852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:19:37.236450 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c35c696-f3c4-430e-abd8-8524e678f6af None admin] Validating token access rules against request {{(pid=479851) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:19:37.252019 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG dbcounter [-] [479851] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=479851) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:19:37.281984 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG dbcounter [-] [479852] Writing DB stats keystone:SELECT=100 {{(pid=479852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:19:37.283614 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beecb7fb-039f-41ba-84d3-8c424346a934 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479851) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:19:37.284291 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beecb7fb-039f-41ba-84d3-8c424346a934 None admin] REQUEST_METHOD: `GET` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:19:37.284613 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beecb7fb-039f-41ba-84d3-8c424346a934 None admin] SCRIPT_NAME: `/identity` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:19:37.285019 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beecb7fb-039f-41ba-84d3-8c424346a934 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:19:37.297982 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beecb7fb-039f-41ba-84d3-8c424346a934 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:19:37.298402 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf068c0c-312a-446a-95b9-bde79240b310 None admin] Validating token access rules against request {{(pid=479852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:19:37.299468 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beecb7fb-039f-41ba-84d3-8c424346a934 None admin] RBAC: Authorization granted {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:19:37.315540 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application [None req-beecb7fb-039f-41ba-84d3-8c424346a934 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 09:19:37.315540 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 09:19:37.315540 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 09:19:37.315540 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 09:19:37.315540 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 09:19:37.315540 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 09:19:37.315540 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 09:19:37.315540 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 09:19:37.315540 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 09:19:37.315540 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 09:19:37.315540 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 09:19:37.315540 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 09:19:37.315540 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 09:19:37.315540 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 09:19:37.315540 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 09:19:37.316686 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 09:19:37.316686 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 09:19:37.316686 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 09:19:37.316686 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 09:19:37.316686 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 09:19:37.316686 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 09:19:37.316686 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 09:19:37.316686 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 09:19:37.316686 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application with Lock( Jul 28 09:19:37.316686 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 09:19:37.316686 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return self._enter() Jul 28 09:19:37.316686 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 09:19:37.316686 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 09:19:37.316686 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 09:19:37.316686 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return self.creator() Jul 28 09:19:37.316686 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 09:19:37.316686 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application created_value = creator( Jul 28 09:19:37.317878 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 09:19:37.317878 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 09:19:37.317878 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 09:19:37.317878 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application Jul 28 09:19:37.317878 dv-cinder-851351-1-smb devstack@keystone.service[479851]: [pid: 479851|app: 0|req: 398/811] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 09:19:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 09:19:37.318205 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d6dabd-dfbc-44cb-98bf-083fff70c048 None None] REQUEST_METHOD: `POST` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:19:37.318869 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d6dabd-dfbc-44cb-98bf-083fff70c048 None None] SCRIPT_NAME: `/identity` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:19:37.318869 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d6dabd-dfbc-44cb-98bf-083fff70c048 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:19:37.337490 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.auth.core [None req-97d6dabd-dfbc-44cb-98bf-083fff70c048 None None] MFA Rules not processed for user `c198f91a4ae84d2b9cc730a6e304c2be`. Rule list: `[]` (Enabled: `True`). {{(pid=479851) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 09:19:37.338688 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.fernet_utils [None req-97d6dabd-dfbc-44cb-98bf-083fff70c048 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=479851) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 09:19:37.342808 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a0dae7e-e597-43a3-8240-a57583783650 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:19:37.343763 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0dae7e-e597-43a3-8240-a57583783650 None admin] REQUEST_METHOD: `POST` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:19:37.344282 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0dae7e-e597-43a3-8240-a57583783650 None admin] SCRIPT_NAME: `/identity` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:19:37.344835 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0dae7e-e597-43a3-8240-a57583783650 None admin] PATH_INFO: `/v3/endpoints` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:19:37.345803 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a0dae7e-e597-43a3-8240-a57583783650 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:19:37.347516 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a0dae7e-e597-43a3-8240-a57583783650 None admin] RBAC: Authorization granted {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:19:37.378980 dv-cinder-851351-1-smb devstack@keystone.service[479852]: [pid: 479852|app: 0|req: 414/812] 10.222.0.42 () {60 vars in 1144 bytes} [Thu Jul 28 09:19:37 2022] POST /identity/v3/endpoints => generated 346 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 09:19:37.378980 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a0dae7e-e597-43a3-8240-a57583783650 None admin] Authenticating user token {{(pid=479852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:19:37.439271 dv-cinder-851351-1-smb devstack@keystone.service[479851]: [pid: 479851|app: 0|req: 399/813] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 09:19:37 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 09:19:37.440505 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d6dabd-dfbc-44cb-98bf-083fff70c048 None None] Authenticating user token {{(pid=479851) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:19:37.540750 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a0dae7e-e597-43a3-8240-a57583783650 None admin] Validating token access rules against request {{(pid=479852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:19:37.584726 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4b89e5-5b94-4a69-ac29-26b8659e178d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:19:37.585415 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4b89e5-5b94-4a69-ac29-26b8659e178d None admin] REQUEST_METHOD: `GET` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:19:37.585696 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4b89e5-5b94-4a69-ac29-26b8659e178d None admin] SCRIPT_NAME: `/identity` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:19:37.585970 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4b89e5-5b94-4a69-ac29-26b8659e178d None admin] PATH_INFO: `/v3/roles` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:19:37.586702 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de4b89e5-5b94-4a69-ac29-26b8659e178d None admin] RBAC: Adding query filter params (name=admin) {{(pid=479852) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 09:19:37.587013 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de4b89e5-5b94-4a69-ac29-26b8659e178d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:19:37.588499 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de4b89e5-5b94-4a69-ac29-26b8659e178d None admin] RBAC: Authorization granted {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:19:37.598391 dv-cinder-851351-1-smb devstack@keystone.service[479852]: [pid: 479852|app: 0|req: 415/814] 10.222.0.42 () {56 vars in 1099 bytes} [Thu Jul 28 09:19:37 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:19:37.599274 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4b89e5-5b94-4a69-ac29-26b8659e178d None admin] Authenticating user token {{(pid=479852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:19:37.602621 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG dbcounter [-] [479851] Writing DB stats keystone:SELECT=100 {{(pid=479851) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:19:37.604303 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG dbcounter [-] [479852] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=479852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:19:37.621588 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d6dabd-dfbc-44cb-98bf-083fff70c048 None None] Validating token access rules against request {{(pid=479851) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:19:37.661057 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d0e71f-cd33-45a3-ab10-b8fcf6ea0f7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479851) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:19:37.661700 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d0e71f-cd33-45a3-ab10-b8fcf6ea0f7e None admin] REQUEST_METHOD: `GET` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:19:37.661988 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d0e71f-cd33-45a3-ab10-b8fcf6ea0f7e None admin] SCRIPT_NAME: `/identity` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:19:37.662315 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d0e71f-cd33-45a3-ab10-b8fcf6ea0f7e None admin] PATH_INFO: `/v3/domains` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:19:37.663063 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89d0e71f-cd33-45a3-ab10-b8fcf6ea0f7e None admin] RBAC: Adding query filter params (name=Default) {{(pid=479851) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 09:19:37.663342 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89d0e71f-cd33-45a3-ab10-b8fcf6ea0f7e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:19:37.664898 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89d0e71f-cd33-45a3-ab10-b8fcf6ea0f7e None admin] RBAC: Authorization granted {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:19:37.678781 dv-cinder-851351-1-smb devstack@keystone.service[479851]: [pid: 479851|app: 0|req: 400/815] 10.222.0.42 () {56 vars in 1109 bytes} [Thu Jul 28 09:19:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:19:37.680085 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d0e71f-cd33-45a3-ab10-b8fcf6ea0f7e None admin] Authenticating user token {{(pid=479851) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:19:37.750020 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4b89e5-5b94-4a69-ac29-26b8659e178d None admin] Validating token access rules against request {{(pid=479852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:19:37.805811 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce06840c-cd9d-4961-b5eb-1e0fa1d0ab47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:19:37.807426 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce06840c-cd9d-4961-b5eb-1e0fa1d0ab47 None admin] REQUEST_METHOD: `GET` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:19:37.808273 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce06840c-cd9d-4961-b5eb-1e0fa1d0ab47 None admin] SCRIPT_NAME: `/identity` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:19:37.808893 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce06840c-cd9d-4961-b5eb-1e0fa1d0ab47 None admin] PATH_INFO: `/v3/services/network` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:19:37.810103 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce06840c-cd9d-4961-b5eb-1e0fa1d0ab47 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:19:37.810665 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d0e71f-cd33-45a3-ab10-b8fcf6ea0f7e None admin] Validating token access rules against request {{(pid=479851) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:19:37.813274 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce06840c-cd9d-4961-b5eb-1e0fa1d0ab47 None admin] RBAC: Authorization granted {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:19:37.839150 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application [None req-ce06840c-cd9d-4961-b5eb-1e0fa1d0ab47 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jul 28 09:19:37.839150 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 09:19:37.839150 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 28 09:19:37.839150 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 28 09:19:37.839150 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 28 09:19:37.839150 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 28 09:19:37.839150 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 28 09:19:37.839150 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 09:19:37.839150 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 28 09:19:37.839150 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application Jul 28 09:19:37.839150 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 28 09:19:37.839150 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application Jul 28 09:19:37.839150 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 09:19:37.839150 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 09:19:37.839150 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 09:19:37.839150 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 09:19:37.839150 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 09:19:37.840507 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 09:19:37.840507 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 09:19:37.840507 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 09:19:37.840507 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 09:19:37.840507 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 09:19:37.840507 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 09:19:37.840507 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 28 09:19:37.840507 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 28 09:19:37.840507 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 28 09:19:37.840507 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 28 09:19:37.840507 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 09:19:37.840507 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 09:19:37.840507 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 09:19:37.840507 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 09:19:37.840507 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 09:19:37.840507 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 09:19:37.841539 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 09:19:37.841539 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application with Lock( Jul 28 09:19:37.841539 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 09:19:37.841539 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self._enter() Jul 28 09:19:37.841539 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 09:19:37.841539 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 09:19:37.841539 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 09:19:37.841539 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self.creator() Jul 28 09:19:37.841539 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 09:19:37.841539 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application created_value = creator( Jul 28 09:19:37.841539 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 28 09:19:37.841539 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 09:19:37.841539 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 28 09:19:37.841539 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application Jul 28 09:19:37.843206 dv-cinder-851351-1-smb devstack@keystone.service[479852]: [pid: 479852|app: 0|req: 416/816] 10.222.0.42 () {56 vars in 1111 bytes} [Thu Jul 28 09:19:37 2022] GET /identity/v3/services/network => generated 88 bytes in 244 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 09:19:37.846773 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce06840c-cd9d-4961-b5eb-1e0fa1d0ab47 None admin] Authenticating user token {{(pid=479852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:19:37.860294 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb96af7-fb61-485b-bb53-48dad61421f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479851) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:19:37.861121 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb96af7-fb61-485b-bb53-48dad61421f2 None admin] REQUEST_METHOD: `GET` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:19:37.861469 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb96af7-fb61-485b-bb53-48dad61421f2 None admin] SCRIPT_NAME: `/identity` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:19:37.861811 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb96af7-fb61-485b-bb53-48dad61421f2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:19:37.874704 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fb96af7-fb61-485b-bb53-48dad61421f2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:19:37.876279 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fb96af7-fb61-485b-bb53-48dad61421f2 None admin] RBAC: Authorization granted {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:19:37.892250 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application [None req-6fb96af7-fb61-485b-bb53-48dad61421f2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 09:19:37.892250 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 09:19:37.892250 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 09:19:37.892250 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 09:19:37.892250 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 09:19:37.892250 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 09:19:37.892250 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 09:19:37.892250 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 09:19:37.892250 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 09:19:37.892250 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 09:19:37.892250 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 09:19:37.892250 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 09:19:37.892250 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 09:19:37.892250 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 09:19:37.892250 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 09:19:37.894282 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 09:19:37.894282 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 09:19:37.894282 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 09:19:37.894282 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 09:19:37.894282 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 09:19:37.894282 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 09:19:37.894282 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 09:19:37.894282 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 09:19:37.894282 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application with Lock( Jul 28 09:19:37.894282 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 09:19:37.894282 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return self._enter() Jul 28 09:19:37.894282 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 09:19:37.894282 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 09:19:37.894282 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 09:19:37.894282 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return self.creator() Jul 28 09:19:37.894282 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 09:19:37.894282 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application created_value = creator( Jul 28 09:19:37.896437 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 09:19:37.896437 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 09:19:37.896437 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 09:19:37.896437 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application Jul 28 09:19:37.904701 dv-cinder-851351-1-smb devstack@keystone.service[479851]: [pid: 479851|app: 0|req: 401/817] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 09:19:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 09:19:37.904701 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb96af7-fb61-485b-bb53-48dad61421f2 None admin] Authenticating user token {{(pid=479851) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:19:37.904701 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG dbcounter [-] [479851] Writing DB stats keystone:SELECT=100 {{(pid=479851) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:19:37.949040 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG dbcounter [-] [479852] Writing DB stats keystone:SELECT=100 {{(pid=479852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:19:37.999608 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce06840c-cd9d-4961-b5eb-1e0fa1d0ab47 None admin] Validating token access rules against request {{(pid=479852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:19:38.025175 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb96af7-fb61-485b-bb53-48dad61421f2 None admin] Validating token access rules against request {{(pid=479851) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:19:38.040938 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf106b7-6fc0-4775-9ee5-2ca4e09ac2ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:19:38.041590 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf106b7-6fc0-4775-9ee5-2ca4e09ac2ed None admin] REQUEST_METHOD: `GET` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:19:38.041991 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf106b7-6fc0-4775-9ee5-2ca4e09ac2ed None admin] SCRIPT_NAME: `/identity` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:19:38.042454 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf106b7-6fc0-4775-9ee5-2ca4e09ac2ed None admin] PATH_INFO: `/v3/projects/service` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:19:38.055755 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf106b7-6fc0-4775-9ee5-2ca4e09ac2ed None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:19:38.058762 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf106b7-6fc0-4775-9ee5-2ca4e09ac2ed None admin] RBAC: Authorization granted {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:19:38.073305 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4948884-dd95-4e9e-bdd6-df75a7e50d13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479851) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:19:38.074303 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4948884-dd95-4e9e-bdd6-df75a7e50d13 None admin] REQUEST_METHOD: `GET` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:19:38.074749 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4948884-dd95-4e9e-bdd6-df75a7e50d13 None admin] SCRIPT_NAME: `/identity` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:19:38.075189 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4948884-dd95-4e9e-bdd6-df75a7e50d13 None admin] PATH_INFO: `/v3/services` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:19:38.076062 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4948884-dd95-4e9e-bdd6-df75a7e50d13 None admin] RBAC: Adding query filter params (name=network) {{(pid=479851) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 09:19:38.076536 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4948884-dd95-4e9e-bdd6-df75a7e50d13 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:19:38.078144 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4948884-dd95-4e9e-bdd6-df75a7e50d13 None admin] RBAC: Authorization granted {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:19:38.081005 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application [None req-3bf106b7-6fc0-4775-9ee5-2ca4e09ac2ed None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 09:19:38.081005 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 09:19:38.081005 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 09:19:38.081005 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 09:19:38.081005 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 09:19:38.081005 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 09:19:38.081005 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 09:19:38.081005 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 09:19:38.081005 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 09:19:38.081005 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 09:19:38.081005 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 09:19:38.081005 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 09:19:38.081005 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 28 09:19:38.081005 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 28 09:19:38.081005 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 28 09:19:38.082279 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 28 09:19:38.082279 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 09:19:38.082279 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 09:19:38.082279 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 09:19:38.082279 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 09:19:38.082279 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 09:19:38.082279 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 09:19:38.082279 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 09:19:38.082279 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application with Lock( Jul 28 09:19:38.082279 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 09:19:38.082279 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self._enter() Jul 28 09:19:38.082279 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 09:19:38.082279 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 09:19:38.082279 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 09:19:38.082279 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self.creator() Jul 28 09:19:38.082279 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 09:19:38.082279 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application created_value = creator( Jul 28 09:19:38.083641 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 28 09:19:38.083641 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 28 09:19:38.083641 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 28 09:19:38.083641 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 28 09:19:38.083641 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 28 09:19:38.083641 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 28 09:19:38.083641 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 09:19:38.083641 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application Jul 28 09:19:38.087681 dv-cinder-851351-1-smb devstack@keystone.service[479851]: [pid: 479851|app: 0|req: 402/818] 10.222.0.42 () {56 vars in 1112 bytes} [Thu Jul 28 09:19:37 2022] GET /identity/v3/services?name=network => generated 124 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:19:38.088897 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4948884-dd95-4e9e-bdd6-df75a7e50d13 None admin] Authenticating user token {{(pid=479851) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:19:38.089671 dv-cinder-851351-1-smb devstack@keystone.service[479852]: [pid: 479852|app: 0|req: 417/819] 10.222.0.42 () {56 vars in 1111 bytes} [Thu Jul 28 09:19:37 2022] GET /identity/v3/projects/service => generated 88 bytes in 246 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 09:19:38.094425 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf106b7-6fc0-4775-9ee5-2ca4e09ac2ed None admin] Authenticating user token {{(pid=479852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:19:38.176833 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG dbcounter [-] [479851] Writing DB stats keystone:SELECT=100 {{(pid=479851) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:19:38.224354 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4948884-dd95-4e9e-bdd6-df75a7e50d13 None admin] Validating token access rules against request {{(pid=479851) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:19:38.236163 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf106b7-6fc0-4775-9ee5-2ca4e09ac2ed None admin] Validating token access rules against request {{(pid=479852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:19:38.266088 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d34948-e96c-4fc6-92e7-a92491cfdf73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479851) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:19:38.266694 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG dbcounter [-] [479852] Writing DB stats keystone:SELECT=100 {{(pid=479852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:19:38.267360 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d34948-e96c-4fc6-92e7-a92491cfdf73 None admin] REQUEST_METHOD: `GET` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:19:38.268605 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d34948-e96c-4fc6-92e7-a92491cfdf73 None admin] SCRIPT_NAME: `/identity` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:19:38.269115 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d34948-e96c-4fc6-92e7-a92491cfdf73 None admin] PATH_INFO: `/v3/domains` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:19:38.270245 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d34948-e96c-4fc6-92e7-a92491cfdf73 None admin] RBAC: Adding query filter params (name=Default) {{(pid=479851) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 09:19:38.271108 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d34948-e96c-4fc6-92e7-a92491cfdf73 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:19:38.273840 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d34948-e96c-4fc6-92e7-a92491cfdf73 None admin] RBAC: Authorization granted {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:19:38.277218 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c3b261-5229-4fd9-bfb1-1e8e5d0047fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:19:38.277667 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c3b261-5229-4fd9-bfb1-1e8e5d0047fc None admin] REQUEST_METHOD: `GET` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:19:38.277951 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c3b261-5229-4fd9-bfb1-1e8e5d0047fc None admin] SCRIPT_NAME: `/identity` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:19:38.278230 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c3b261-5229-4fd9-bfb1-1e8e5d0047fc None admin] PATH_INFO: `/v3/services` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:19:38.278935 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36c3b261-5229-4fd9-bfb1-1e8e5d0047fc None admin] RBAC: Adding query filter params (type=network) {{(pid=479852) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 09:19:38.279274 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36c3b261-5229-4fd9-bfb1-1e8e5d0047fc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:19:38.280695 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36c3b261-5229-4fd9-bfb1-1e8e5d0047fc None admin] RBAC: Authorization granted {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:19:38.291494 dv-cinder-851351-1-smb devstack@keystone.service[479852]: [pid: 479852|app: 0|req: 418/820] 10.222.0.42 () {56 vars in 1112 bytes} [Thu Jul 28 09:19:38 2022] GET /identity/v3/services?type=network => generated 350 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:19:38.291494 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c3b261-5229-4fd9-bfb1-1e8e5d0047fc None admin] Authenticating user token {{(pid=479852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:19:38.296142 dv-cinder-851351-1-smb devstack@keystone.service[479851]: [pid: 479851|app: 0|req: 403/821] 10.222.0.42 () {56 vars in 1109 bytes} [Thu Jul 28 09:19:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:19:38.301683 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d34948-e96c-4fc6-92e7-a92491cfdf73 None admin] Authenticating user token {{(pid=479851) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:19:38.403398 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c3b261-5229-4fd9-bfb1-1e8e5d0047fc None admin] Validating token access rules against request {{(pid=479852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:19:38.435252 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d34948-e96c-4fc6-92e7-a92491cfdf73 None admin] Validating token access rules against request {{(pid=479851) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:19:38.442483 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8a2951-bf74-445c-8fb7-d2448ad25f0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:19:38.443134 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8a2951-bf74-445c-8fb7-d2448ad25f0b None admin] REQUEST_METHOD: `GET` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:19:38.443417 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8a2951-bf74-445c-8fb7-d2448ad25f0b None admin] SCRIPT_NAME: `/identity` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:19:38.443694 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8a2951-bf74-445c-8fb7-d2448ad25f0b None admin] PATH_INFO: `/v3/projects` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:19:38.444480 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c8a2951-bf74-445c-8fb7-d2448ad25f0b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=479852) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 09:19:38.444823 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c8a2951-bf74-445c-8fb7-d2448ad25f0b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:19:38.446625 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c8a2951-bf74-445c-8fb7-d2448ad25f0b None admin] RBAC: Authorization granted {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:19:38.465902 dv-cinder-851351-1-smb devstack@keystone.service[479852]: [pid: 479852|app: 0|req: 419/822] 10.222.0.42 () {56 vars in 1148 bytes} [Thu Jul 28 09:19:38 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:19:38.465902 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8a2951-bf74-445c-8fb7-d2448ad25f0b None admin] Authenticating user token {{(pid=479852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:19:38.474740 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG dbcounter [-] [479851] Writing DB stats keystone:SELECT=100 {{(pid=479851) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:19:38.492523 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c942dcb1-310f-4b8d-8906-e75eb8331432 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479851) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:19:38.492523 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c942dcb1-310f-4b8d-8906-e75eb8331432 None admin] REQUEST_METHOD: `POST` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:19:38.492523 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c942dcb1-310f-4b8d-8906-e75eb8331432 None admin] SCRIPT_NAME: `/identity` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:19:38.492523 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c942dcb1-310f-4b8d-8906-e75eb8331432 None admin] PATH_INFO: `/v3/endpoints` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:19:38.493082 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c942dcb1-310f-4b8d-8906-e75eb8331432 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:19:38.493082 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c942dcb1-310f-4b8d-8906-e75eb8331432 None admin] RBAC: Authorization granted {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:19:38.520260 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG dbcounter [-] [479852] Writing DB stats keystone:SELECT=100 {{(pid=479852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:19:38.530196 dv-cinder-851351-1-smb devstack@keystone.service[479851]: [pid: 479851|app: 0|req: 404/823] 10.222.0.42 () {60 vars in 1144 bytes} [Thu Jul 28 09:19:38 2022] POST /identity/v3/endpoints => generated 327 bytes in 233 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 09:19:38.531637 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c942dcb1-310f-4b8d-8906-e75eb8331432 None admin] Authenticating user token {{(pid=479851) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:19:38.580256 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8a2951-bf74-445c-8fb7-d2448ad25f0b None admin] Validating token access rules against request {{(pid=479852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:19:38.642396 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a41237-d98f-4eaa-8a4d-2463be17dc7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:19:38.642992 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a41237-d98f-4eaa-8a4d-2463be17dc7f None admin] REQUEST_METHOD: `GET` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:19:38.643279 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a41237-d98f-4eaa-8a4d-2463be17dc7f None admin] SCRIPT_NAME: `/identity` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:19:38.643556 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a41237-d98f-4eaa-8a4d-2463be17dc7f None admin] PATH_INFO: `/v3/users/nova` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:19:38.661916 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2a41237-d98f-4eaa-8a4d-2463be17dc7f None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:19:38.663512 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2a41237-d98f-4eaa-8a4d-2463be17dc7f None admin] RBAC: Authorization granted {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:19:38.667932 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c942dcb1-310f-4b8d-8906-e75eb8331432 None admin] Validating token access rules against request {{(pid=479851) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:19:38.688521 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application [None req-e2a41237-d98f-4eaa-8a4d-2463be17dc7f None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 28 09:19:38.688521 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 09:19:38.688521 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 09:19:38.688521 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 09:19:38.688521 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 09:19:38.688521 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 09:19:38.688521 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 09:19:38.688521 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 09:19:38.688521 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 09:19:38.688521 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 09:19:38.688521 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 09:19:38.688521 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 09:19:38.688521 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 28 09:19:38.688521 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 28 09:19:38.688521 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 28 09:19:38.688521 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 28 09:19:38.689752 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 09:19:38.689752 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 09:19:38.689752 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 28 09:19:38.689752 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 09:19:38.689752 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 28 09:19:38.689752 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 09:19:38.689752 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 09:19:38.689752 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 09:19:38.689752 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 09:19:38.689752 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 09:19:38.689752 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 09:19:38.689752 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application with Lock( Jul 28 09:19:38.689752 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 09:19:38.689752 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self._enter() Jul 28 09:19:38.689752 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 09:19:38.689752 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 09:19:38.689752 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 09:19:38.689752 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self.creator() Jul 28 09:19:38.690994 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 09:19:38.690994 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application created_value = creator( Jul 28 09:19:38.690994 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 28 09:19:38.690994 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 28 09:19:38.690994 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 28 09:19:38.690994 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 28 09:19:38.690994 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 28 09:19:38.690994 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 28 09:19:38.690994 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 28 09:19:38.690994 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application Jul 28 09:19:38.690994 dv-cinder-851351-1-smb devstack@keystone.service[479852]: [pid: 479852|app: 0|req: 420/824] 10.222.0.42 () {56 vars in 1093 bytes} [Thu Jul 28 09:19:38 2022] GET /identity/v3/users/nova => generated 82 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 09:19:38.696941 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a41237-d98f-4eaa-8a4d-2463be17dc7f None admin] Authenticating user token {{(pid=479852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:19:38.712388 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c982bb6-31a6-4df4-b3f5-3f7e257a20ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479851) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:19:38.713555 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c982bb6-31a6-4df4-b3f5-3f7e257a20ac None admin] REQUEST_METHOD: `PUT` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:19:38.714050 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c982bb6-31a6-4df4-b3f5-3f7e257a20ac None admin] SCRIPT_NAME: `/identity` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:19:38.714538 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c982bb6-31a6-4df4-b3f5-3f7e257a20ac None admin] PATH_INFO: `/v3/projects/3a0fb8ea8010437bade8f92dcbcaacee/users/213aa011e5004256aead7e486d7f2eba/roles/685084310b35477b9b2d0c7934d0f803` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:19:38.716892 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c982bb6-31a6-4df4-b3f5-3f7e257a20ac None admin] RBAC: Authorizing `identity:create_grant(project_id=3a0fb8ea8010437bade8f92dcbcaacee, user_id=213aa011e5004256aead7e486d7f2eba, role_id=685084310b35477b9b2d0c7934d0f803)` {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:19:38.718760 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c982bb6-31a6-4df4-b3f5-3f7e257a20ac None admin] RBAC: Authorization granted {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:19:38.734703 dv-cinder-851351-1-smb devstack@keystone.service[479851]: [pid: 479851|app: 0|req: 405/825] 10.222.0.42 () {58 vars in 1439 bytes} [Thu Jul 28 09:19:38 2022] PUT /identity/v3/projects/3a0fb8ea8010437bade8f92dcbcaacee/users/213aa011e5004256aead7e486d7f2eba/roles/685084310b35477b9b2d0c7934d0f803 => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 09:19:38.871930 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a41237-d98f-4eaa-8a4d-2463be17dc7f None admin] Validating token access rules against request {{(pid=479852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:19:38.880718 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG dbcounter [-] [479852] Writing DB stats keystone:SELECT=100 {{(pid=479852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:19:38.912777 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17881e6e-79a4-4208-aad9-01430b371e55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:19:38.913328 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17881e6e-79a4-4208-aad9-01430b371e55 None admin] REQUEST_METHOD: `GET` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:19:38.913609 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17881e6e-79a4-4208-aad9-01430b371e55 None admin] SCRIPT_NAME: `/identity` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:19:38.913884 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17881e6e-79a4-4208-aad9-01430b371e55 None admin] PATH_INFO: `/v3/users` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:19:38.914704 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17881e6e-79a4-4208-aad9-01430b371e55 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=479852) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 09:19:38.915013 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17881e6e-79a4-4208-aad9-01430b371e55 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:19:38.916494 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17881e6e-79a4-4208-aad9-01430b371e55 None admin] RBAC: Authorization granted {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:19:38.938565 dv-cinder-851351-1-smb devstack@keystone.service[479852]: [pid: 479852|app: 0|req: 421/826] 10.222.0.42 () {56 vars in 1133 bytes} [Thu Jul 28 09:19:38 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 09:19:38.944501 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c982bb6-31a6-4df4-b3f5-3f7e257a20ac None admin] Authenticating user token {{(pid=479851) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:19:39.002999 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG dbcounter [-] [479851] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=479851) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:19:39.069253 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c982bb6-31a6-4df4-b3f5-3f7e257a20ac None admin] Validating token access rules against request {{(pid=479851) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:19:39.107049 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f4d2e0b-579f-48ce-aee8-adccddf1a4df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479851) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:19:39.107696 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4d2e0b-579f-48ce-aee8-adccddf1a4df None admin] REQUEST_METHOD: `GET` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:19:39.107984 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4d2e0b-579f-48ce-aee8-adccddf1a4df None admin] SCRIPT_NAME: `/identity` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:19:39.108265 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4d2e0b-579f-48ce-aee8-adccddf1a4df None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:19:39.187257 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f4d2e0b-579f-48ce-aee8-adccddf1a4df None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:19:39.188687 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f4d2e0b-579f-48ce-aee8-adccddf1a4df None admin] RBAC: Authorization granted {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:19:39.234460 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG dbcounter [-] [479851] Writing DB stats keystone:SELECT=100 {{(pid=479851) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:19:39.317226 dv-cinder-851351-1-smb devstack@keystone.service[479851]: [pid: 479851|app: 0|req: 406/827] 10.222.0.42 () {58 vars in 1282 bytes} [Thu Jul 28 09:19:38 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 373 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jul 28 09:19:39.327274 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17881e6e-79a4-4208-aad9-01430b371e55 None admin] Authenticating user token {{(pid=479852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:19:39.348855 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56177d37-d956-4456-9b24-3f411a347f67 None None] REQUEST_METHOD: `GET` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:19:39.349534 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56177d37-d956-4456-9b24-3f411a347f67 None None] SCRIPT_NAME: `/identity` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:19:39.350043 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56177d37-d956-4456-9b24-3f411a347f67 None None] PATH_INFO: `/` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:19:39.351938 dv-cinder-851351-1-smb devstack@keystone.service[479851]: [pid: 479851|app: 0|req: 407/828] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 09:19:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 28 09:19:39.357732 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaea3dd0-7453-4f4e-822d-f1756e5ce9a4 None None] REQUEST_METHOD: `POST` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:19:39.358357 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaea3dd0-7453-4f4e-822d-f1756e5ce9a4 None None] SCRIPT_NAME: `/identity` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:19:39.358847 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaea3dd0-7453-4f4e-822d-f1756e5ce9a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:19:39.383273 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.auth.core [None req-aaea3dd0-7453-4f4e-822d-f1756e5ce9a4 None None] MFA Rules not processed for user `c198f91a4ae84d2b9cc730a6e304c2be`. Rule list: `[]` (Enabled: `True`). {{(pid=479851) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 09:19:39.385737 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.fernet_utils [None req-aaea3dd0-7453-4f4e-822d-f1756e5ce9a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=479851) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 09:19:39.474913 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17881e6e-79a4-4208-aad9-01430b371e55 None admin] Validating token access rules against request {{(pid=479852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:19:39.487423 dv-cinder-851351-1-smb devstack@keystone.service[479851]: [pid: 479851|app: 0|req: 408/829] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 09:19:39 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 28 09:19:39.528100 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaea3dd0-7453-4f4e-822d-f1756e5ce9a4 None None] Authenticating user token {{(pid=479851) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:19:39.528824 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f8eaa6-0188-46fa-9307-b20889c0a662 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:19:39.530465 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f8eaa6-0188-46fa-9307-b20889c0a662 None admin] REQUEST_METHOD: `GET` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:19:39.531269 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f8eaa6-0188-46fa-9307-b20889c0a662 None admin] SCRIPT_NAME: `/identity` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:19:39.532070 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f8eaa6-0188-46fa-9307-b20889c0a662 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:19:39.552347 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00f8eaa6-0188-46fa-9307-b20889c0a662 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:19:39.555658 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00f8eaa6-0188-46fa-9307-b20889c0a662 None admin] RBAC: Authorization granted {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:19:39.585407 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application [None req-00f8eaa6-0188-46fa-9307-b20889c0a662 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 09:19:39.585407 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 09:19:39.585407 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 09:19:39.585407 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 09:19:39.585407 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 09:19:39.585407 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 09:19:39.585407 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 09:19:39.585407 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 09:19:39.585407 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 09:19:39.585407 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 09:19:39.585407 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 09:19:39.585407 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 09:19:39.585407 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 09:19:39.585407 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 09:19:39.585407 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 09:19:39.587606 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 09:19:39.587606 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 09:19:39.587606 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 09:19:39.587606 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 09:19:39.587606 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 09:19:39.587606 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 09:19:39.587606 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 09:19:39.587606 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 09:19:39.587606 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application with Lock( Jul 28 09:19:39.587606 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 09:19:39.587606 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self._enter() Jul 28 09:19:39.587606 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 09:19:39.587606 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 09:19:39.587606 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 09:19:39.587606 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self.creator() Jul 28 09:19:39.587606 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 09:19:39.587606 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application created_value = creator( Jul 28 09:19:39.589815 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 09:19:39.589815 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 09:19:39.589815 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 09:19:39.589815 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application Jul 28 09:19:39.593081 dv-cinder-851351-1-smb devstack@keystone.service[479852]: [pid: 479852|app: 0|req: 422/830] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 09:19:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 267 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 09:19:39.597993 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71489d5d-051a-4af6-971b-f403827a1b6c None None] REQUEST_METHOD: `GET` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:19:39.598315 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71489d5d-051a-4af6-971b-f403827a1b6c None None] SCRIPT_NAME: `/identity` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:19:39.598947 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71489d5d-051a-4af6-971b-f403827a1b6c None None] PATH_INFO: `/` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:19:39.600793 dv-cinder-851351-1-smb devstack@keystone.service[479852]: [pid: 479852|app: 0|req: 423/831] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 09:19:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 28 09:19:39.602067 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71489d5d-051a-4af6-971b-f403827a1b6c None None] Authenticating user token {{(pid=479852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:19:39.618138 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG dbcounter [-] [479851] Writing DB stats keystone:SELECT=100 {{(pid=479851) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:19:39.623090 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG dbcounter [-] [479852] Writing DB stats keystone:SELECT=100 {{(pid=479852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:19:39.652841 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaea3dd0-7453-4f4e-822d-f1756e5ce9a4 None None] Validating token access rules against request {{(pid=479851) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:19:39.689034 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e0ab93-aea3-4aa9-8e41-a736a1c3518c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479851) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:19:39.689812 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e0ab93-aea3-4aa9-8e41-a736a1c3518c None admin] REQUEST_METHOD: `GET` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:19:39.690231 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e0ab93-aea3-4aa9-8e41-a736a1c3518c None admin] SCRIPT_NAME: `/identity` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:19:39.690545 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e0ab93-aea3-4aa9-8e41-a736a1c3518c None admin] PATH_INFO: `/v3/roles/service` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:19:39.704305 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74e0ab93-aea3-4aa9-8e41-a736a1c3518c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 09:19:39.709885 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application [None req-74e0ab93-aea3-4aa9-8e41-a736a1c3518c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 28 09:19:39.709885 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 09:19:39.709885 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 09:19:39.709885 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 09:19:39.709885 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 09:19:39.709885 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 09:19:39.709885 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 09:19:39.709885 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 09:19:39.709885 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 09:19:39.709885 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 09:19:39.709885 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 09:19:39.709885 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 09:19:39.709885 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 09:19:39.709885 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 09:19:39.709885 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 09:19:39.709885 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 09:19:39.711046 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 09:19:39.711046 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 09:19:39.711046 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 09:19:39.711046 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 09:19:39.711046 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 09:19:39.711046 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 09:19:39.711046 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 09:19:39.711046 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 09:19:39.711046 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 09:19:39.711046 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 09:19:39.711046 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 09:19:39.711046 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application with Lock( Jul 28 09:19:39.711046 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 09:19:39.711046 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return self._enter() Jul 28 09:19:39.711046 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 09:19:39.711046 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 09:19:39.712064 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 09:19:39.712064 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return self.creator() Jul 28 09:19:39.712064 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 09:19:39.712064 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application created_value = creator( Jul 28 09:19:39.712064 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 09:19:39.712064 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 09:19:39.712064 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 09:19:39.712064 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 09:19:39.712064 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 09:19:39.712064 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 09:19:39.712064 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 28 09:19:39.712064 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application Jul 28 09:19:39.712064 dv-cinder-851351-1-smb devstack@keystone.service[479851]: [pid: 479851|app: 0|req: 409/832] 10.222.0.42 () {56 vars in 1102 bytes} [Thu Jul 28 09:19:39 2022] GET /identity/v3/roles/service => generated 85 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 09:19:39.713584 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcafa543-0f69-4ff0-b136-63afc01a14b6 None None] REQUEST_METHOD: `POST` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:19:39.713584 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcafa543-0f69-4ff0-b136-63afc01a14b6 None None] SCRIPT_NAME: `/identity` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:19:39.713584 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcafa543-0f69-4ff0-b136-63afc01a14b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:19:39.726312 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71489d5d-051a-4af6-971b-f403827a1b6c None None] Validating token access rules against request {{(pid=479852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:19:39.731748 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.auth.core [None req-dcafa543-0f69-4ff0-b136-63afc01a14b6 None None] MFA Rules not processed for user `c198f91a4ae84d2b9cc730a6e304c2be`. Rule list: `[]` (Enabled: `True`). {{(pid=479851) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 09:19:39.732978 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.fernet_utils [None req-dcafa543-0f69-4ff0-b136-63afc01a14b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=479851) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 09:19:39.764163 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c8fd67-7214-49fb-92d6-33bd6e64804d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:19:39.764829 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c8fd67-7214-49fb-92d6-33bd6e64804d None admin] REQUEST_METHOD: `GET` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:19:39.765111 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c8fd67-7214-49fb-92d6-33bd6e64804d None admin] SCRIPT_NAME: `/identity` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:19:39.765383 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c8fd67-7214-49fb-92d6-33bd6e64804d None admin] PATH_INFO: `/v3/domains` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:19:39.766085 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c8fd67-7214-49fb-92d6-33bd6e64804d None admin] RBAC: Adding query filter params (name=Default) {{(pid=479852) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 09:19:39.766392 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c8fd67-7214-49fb-92d6-33bd6e64804d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:19:39.767773 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c8fd67-7214-49fb-92d6-33bd6e64804d None admin] RBAC: Authorization granted {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:19:39.780789 dv-cinder-851351-1-smb devstack@keystone.service[479852]: [pid: 479852|app: 0|req: 424/833] 10.222.0.42 () {56 vars in 1109 bytes} [Thu Jul 28 09:19:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:19:39.785702 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c8fd67-7214-49fb-92d6-33bd6e64804d None admin] Authenticating user token {{(pid=479852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:19:39.818382 dv-cinder-851351-1-smb devstack@keystone.service[479851]: [pid: 479851|app: 0|req: 410/834] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 09:19:39 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 09:19:39.819364 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcafa543-0f69-4ff0-b136-63afc01a14b6 None None] Authenticating user token {{(pid=479851) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:19:39.882542 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG dbcounter [-] [479852] Writing DB stats keystone:SELECT=100 {{(pid=479852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:19:39.908305 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG dbcounter [-] [479851] Writing DB stats keystone:SELECT=100 {{(pid=479851) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:19:39.909665 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c8fd67-7214-49fb-92d6-33bd6e64804d None admin] Validating token access rules against request {{(pid=479852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:19:39.951473 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef260b0-ae43-468d-857d-f8729d11a7f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:19:39.952400 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef260b0-ae43-468d-857d-f8729d11a7f9 None admin] REQUEST_METHOD: `GET` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:19:39.952717 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef260b0-ae43-468d-857d-f8729d11a7f9 None admin] SCRIPT_NAME: `/identity` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:19:39.952998 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef260b0-ae43-468d-857d-f8729d11a7f9 None admin] PATH_INFO: `/v3/roles` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:19:39.953760 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ef260b0-ae43-468d-857d-f8729d11a7f9 None admin] RBAC: Adding query filter params (name=service) {{(pid=479852) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 09:19:39.954074 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ef260b0-ae43-468d-857d-f8729d11a7f9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:19:39.955518 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ef260b0-ae43-468d-857d-f8729d11a7f9 None admin] RBAC: Authorization granted {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:19:39.971729 dv-cinder-851351-1-smb devstack@keystone.service[479852]: [pid: 479852|app: 0|req: 425/835] 10.222.0.42 () {56 vars in 1103 bytes} [Thu Jul 28 09:19:39 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:19:39.971729 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef260b0-ae43-468d-857d-f8729d11a7f9 None admin] Authenticating user token {{(pid=479852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:19:39.982637 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcafa543-0f69-4ff0-b136-63afc01a14b6 None None] Validating token access rules against request {{(pid=479851) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:19:40.028185 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82dc9e27-33f4-4c38-9d6b-42494746d7a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479851) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:19:40.028888 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82dc9e27-33f4-4c38-9d6b-42494746d7a2 None admin] REQUEST_METHOD: `GET` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:19:40.029198 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82dc9e27-33f4-4c38-9d6b-42494746d7a2 None admin] SCRIPT_NAME: `/identity` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:19:40.029639 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82dc9e27-33f4-4c38-9d6b-42494746d7a2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:19:40.039394 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82dc9e27-33f4-4c38-9d6b-42494746d7a2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:19:40.041613 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82dc9e27-33f4-4c38-9d6b-42494746d7a2 None admin] RBAC: Authorization granted {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:19:40.056163 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application [None req-82dc9e27-33f4-4c38-9d6b-42494746d7a2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 09:19:40.056163 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 09:19:40.056163 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 09:19:40.056163 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 09:19:40.056163 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 09:19:40.056163 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 09:19:40.056163 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 09:19:40.056163 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 09:19:40.056163 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 09:19:40.056163 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 09:19:40.056163 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 09:19:40.056163 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 09:19:40.056163 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 28 09:19:40.056163 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 28 09:19:40.056163 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 28 09:19:40.057534 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 28 09:19:40.057534 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 09:19:40.057534 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 09:19:40.057534 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 09:19:40.057534 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 09:19:40.057534 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 09:19:40.057534 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 09:19:40.057534 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 09:19:40.057534 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application with Lock( Jul 28 09:19:40.057534 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 09:19:40.057534 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return self._enter() Jul 28 09:19:40.057534 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 09:19:40.057534 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 09:19:40.057534 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 09:19:40.057534 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return self.creator() Jul 28 09:19:40.057534 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 09:19:40.057534 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application created_value = creator( Jul 28 09:19:40.059390 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 28 09:19:40.059390 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 28 09:19:40.059390 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 28 09:19:40.059390 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 28 09:19:40.059390 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 28 09:19:40.059390 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 28 09:19:40.059390 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 09:19:40.059390 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application Jul 28 09:19:40.059390 dv-cinder-851351-1-smb devstack@keystone.service[479851]: [pid: 479851|app: 0|req: 411/836] 10.222.0.42 () {56 vars in 1111 bytes} [Thu Jul 28 09:19:39 2022] GET /identity/v3/projects/service => generated 88 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 09:19:40.059390 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82dc9e27-33f4-4c38-9d6b-42494746d7a2 None admin] Authenticating user token {{(pid=479851) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:19:40.097505 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef260b0-ae43-468d-857d-f8729d11a7f9 None admin] Validating token access rules against request {{(pid=479852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:19:40.140484 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-298d6424-70ba-4a2a-a1ba-a6b3ee5cac19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:19:40.141177 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298d6424-70ba-4a2a-a1ba-a6b3ee5cac19 None admin] REQUEST_METHOD: `GET` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:19:40.141461 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298d6424-70ba-4a2a-a1ba-a6b3ee5cac19 None admin] SCRIPT_NAME: `/identity` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:19:40.141738 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298d6424-70ba-4a2a-a1ba-a6b3ee5cac19 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:19:40.142410 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-298d6424-70ba-4a2a-a1ba-a6b3ee5cac19 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:19:40.143808 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-298d6424-70ba-4a2a-a1ba-a6b3ee5cac19 None admin] RBAC: Authorization granted {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:19:40.154101 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application [None req-298d6424-70ba-4a2a-a1ba-a6b3ee5cac19 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 28 09:19:40.154101 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 09:19:40.154101 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 28 09:19:40.154101 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 28 09:19:40.154101 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 28 09:19:40.154101 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 28 09:19:40.154101 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 28 09:19:40.154101 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 09:19:40.154101 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 28 09:19:40.154101 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application Jul 28 09:19:40.154101 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 28 09:19:40.154101 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application Jul 28 09:19:40.154101 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 09:19:40.154101 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 09:19:40.154101 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 09:19:40.154101 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 09:19:40.154101 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 09:19:40.155858 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 09:19:40.155858 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 09:19:40.155858 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 09:19:40.155858 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 09:19:40.155858 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 09:19:40.155858 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 09:19:40.155858 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 28 09:19:40.155858 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 28 09:19:40.155858 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 28 09:19:40.155858 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 28 09:19:40.155858 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 09:19:40.155858 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 09:19:40.155858 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 09:19:40.155858 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 09:19:40.155858 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 09:19:40.155858 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 09:19:40.157426 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 09:19:40.157426 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application with Lock( Jul 28 09:19:40.157426 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 09:19:40.157426 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self._enter() Jul 28 09:19:40.157426 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 09:19:40.157426 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 09:19:40.157426 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 09:19:40.157426 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self.creator() Jul 28 09:19:40.157426 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 09:19:40.157426 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application created_value = creator( Jul 28 09:19:40.157426 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 28 09:19:40.157426 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 09:19:40.157426 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 28 09:19:40.157426 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application Jul 28 09:19:40.157426 dv-cinder-851351-1-smb devstack@keystone.service[479852]: [pid: 479852|app: 0|req: 426/837] 10.222.0.42 () {56 vars in 1114 bytes} [Thu Jul 28 09:19:39 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 09:19:40.158552 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-298d6424-70ba-4a2a-a1ba-a6b3ee5cac19 None admin] Authenticating user token {{(pid=479852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:19:40.162540 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG dbcounter [-] [479852] Writing DB stats keystone:SELECT=100 {{(pid=479852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:19:40.178066 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82dc9e27-33f4-4c38-9d6b-42494746d7a2 None admin] Validating token access rules against request {{(pid=479851) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:19:40.204485 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG dbcounter [-] [479851] Writing DB stats keystone:SELECT=100 {{(pid=479851) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:19:40.220121 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-898cbf51-66d9-477e-a568-eab9c2af38ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479851) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:19:40.220952 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898cbf51-66d9-477e-a568-eab9c2af38ba None admin] REQUEST_METHOD: `GET` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:19:40.221297 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898cbf51-66d9-477e-a568-eab9c2af38ba None admin] SCRIPT_NAME: `/identity` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:19:40.221586 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898cbf51-66d9-477e-a568-eab9c2af38ba None admin] PATH_INFO: `/v3/domains/Default` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:19:40.234989 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-898cbf51-66d9-477e-a568-eab9c2af38ba None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:19:40.236510 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-898cbf51-66d9-477e-a568-eab9c2af38ba None admin] RBAC: Authorization granted {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:19:40.254612 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application [None req-898cbf51-66d9-477e-a568-eab9c2af38ba None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 09:19:40.254612 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 09:19:40.254612 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 09:19:40.254612 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 09:19:40.254612 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 09:19:40.254612 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 09:19:40.254612 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 09:19:40.254612 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 09:19:40.254612 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 09:19:40.254612 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 09:19:40.254612 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 09:19:40.254612 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 09:19:40.254612 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 09:19:40.254612 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 09:19:40.254612 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 09:19:40.256365 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 09:19:40.256365 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 09:19:40.256365 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 09:19:40.256365 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 09:19:40.256365 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 09:19:40.256365 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 09:19:40.256365 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 09:19:40.256365 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 09:19:40.256365 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application with Lock( Jul 28 09:19:40.256365 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 09:19:40.256365 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return self._enter() Jul 28 09:19:40.256365 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 09:19:40.256365 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 09:19:40.256365 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 09:19:40.256365 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return self.creator() Jul 28 09:19:40.256365 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 09:19:40.256365 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application created_value = creator( Jul 28 09:19:40.257961 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 09:19:40.257961 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 09:19:40.257961 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 09:19:40.257961 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application Jul 28 09:19:40.257961 dv-cinder-851351-1-smb devstack@keystone.service[479851]: [pid: 479851|app: 0|req: 412/838] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 09:19:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 09:19:40.257961 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-898cbf51-66d9-477e-a568-eab9c2af38ba None admin] Authenticating user token {{(pid=479851) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:19:40.281871 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-298d6424-70ba-4a2a-a1ba-a6b3ee5cac19 None admin] Validating token access rules against request {{(pid=479852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:19:40.323181 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab885e23-f84e-447e-8aaa-213a5bd306a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:19:40.323935 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab885e23-f84e-447e-8aaa-213a5bd306a0 None admin] REQUEST_METHOD: `GET` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:19:40.324262 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab885e23-f84e-447e-8aaa-213a5bd306a0 None admin] SCRIPT_NAME: `/identity` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:19:40.324540 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab885e23-f84e-447e-8aaa-213a5bd306a0 None admin] PATH_INFO: `/v3/projects` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:19:40.325343 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab885e23-f84e-447e-8aaa-213a5bd306a0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=479852) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 09:19:40.325660 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab885e23-f84e-447e-8aaa-213a5bd306a0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:19:40.327627 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab885e23-f84e-447e-8aaa-213a5bd306a0 None admin] RBAC: Authorization granted {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:19:40.341959 dv-cinder-851351-1-smb devstack@keystone.service[479852]: [pid: 479852|app: 0|req: 427/839] 10.222.0.42 () {56 vars in 1148 bytes} [Thu Jul 28 09:19:40 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:19:40.342828 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab885e23-f84e-447e-8aaa-213a5bd306a0 None admin] Authenticating user token {{(pid=479852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:19:40.400593 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-898cbf51-66d9-477e-a568-eab9c2af38ba None admin] Validating token access rules against request {{(pid=479851) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:19:40.434987 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG dbcounter [-] [479852] Writing DB stats keystone:SELECT=100 {{(pid=479852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:19:40.451131 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6062237-9c06-464a-9555-b39bb02089e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479851) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:19:40.452156 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6062237-9c06-464a-9555-b39bb02089e1 None admin] REQUEST_METHOD: `GET` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:19:40.452637 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6062237-9c06-464a-9555-b39bb02089e1 None admin] SCRIPT_NAME: `/identity` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:19:40.453137 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6062237-9c06-464a-9555-b39bb02089e1 None admin] PATH_INFO: `/v3/services` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:19:40.454066 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6062237-9c06-464a-9555-b39bb02089e1 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=479851) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 09:19:40.454569 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6062237-9c06-464a-9555-b39bb02089e1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:19:40.456209 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6062237-9c06-464a-9555-b39bb02089e1 None admin] RBAC: Authorization granted {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:19:40.463302 dv-cinder-851351-1-smb devstack@keystone.service[479851]: [pid: 479851|app: 0|req: 413/840] 10.222.0.42 () {56 vars in 1114 bytes} [Thu Jul 28 09:19:40 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:19:40.470938 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6062237-9c06-464a-9555-b39bb02089e1 None admin] Authenticating user token {{(pid=479851) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:19:40.494496 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab885e23-f84e-447e-8aaa-213a5bd306a0 None admin] Validating token access rules against request {{(pid=479852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:19:40.527590 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG dbcounter [-] [479851] Writing DB stats keystone:SELECT=100 {{(pid=479851) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:19:40.536498 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e351a35e-5c9e-48a9-a9fc-5c5d8341cec9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:19:40.537141 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e351a35e-5c9e-48a9-a9fc-5c5d8341cec9 None admin] REQUEST_METHOD: `GET` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:19:40.537423 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e351a35e-5c9e-48a9-a9fc-5c5d8341cec9 None admin] SCRIPT_NAME: `/identity` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:19:40.537715 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e351a35e-5c9e-48a9-a9fc-5c5d8341cec9 None admin] PATH_INFO: `/v3/domains` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:19:40.538715 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e351a35e-5c9e-48a9-a9fc-5c5d8341cec9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=479852) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 09:19:40.539379 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e351a35e-5c9e-48a9-a9fc-5c5d8341cec9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:19:40.540260 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e351a35e-5c9e-48a9-a9fc-5c5d8341cec9 None admin] RBAC: Authorization granted {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:19:40.563718 dv-cinder-851351-1-smb devstack@keystone.service[479852]: [pid: 479852|app: 0|req: 428/841] 10.222.0.42 () {56 vars in 1109 bytes} [Thu Jul 28 09:19:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:19:40.563718 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e351a35e-5c9e-48a9-a9fc-5c5d8341cec9 None admin] Authenticating user token {{(pid=479852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:19:40.612431 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6062237-9c06-464a-9555-b39bb02089e1 None admin] Validating token access rules against request {{(pid=479851) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:19:40.665436 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d3cd28-20ae-40d6-99ed-7c15fc7fb7c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479851) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:19:40.666070 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d3cd28-20ae-40d6-99ed-7c15fc7fb7c3 None admin] REQUEST_METHOD: `GET` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:19:40.666419 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d3cd28-20ae-40d6-99ed-7c15fc7fb7c3 None admin] SCRIPT_NAME: `/identity` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:19:40.666649 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d3cd28-20ae-40d6-99ed-7c15fc7fb7c3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:19:40.668079 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47d3cd28-20ae-40d6-99ed-7c15fc7fb7c3 None admin] RBAC: Adding query filter params (role.id=685084310b35477b9b2d0c7934d0f803, scope.project.id=3a0fb8ea8010437bade8f92dcbcaacee, user.id=c824cbfdc0dc4532ac6af71cbb6841fd) {{(pid=479851) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 09:19:40.668079 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47d3cd28-20ae-40d6-99ed-7c15fc7fb7c3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:19:40.669911 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47d3cd28-20ae-40d6-99ed-7c15fc7fb7c3 None admin] RBAC: Authorization granted {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:19:40.684878 dv-cinder-851351-1-smb devstack@keystone.service[479851]: [pid: 479851|app: 0|req: 414/842] 10.222.0.42 () {56 vars in 1374 bytes} [Thu Jul 28 09:19:40 2022] GET /identity/v3/role_assignments?user.id=c824cbfdc0dc4532ac6af71cbb6841fd&scope.project.id=3a0fb8ea8010437bade8f92dcbcaacee&role.id=685084310b35477b9b2d0c7934d0f803 => generated 608 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:19:40.692848 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d3cd28-20ae-40d6-99ed-7c15fc7fb7c3 None admin] Authenticating user token {{(pid=479851) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:19:40.718024 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e351a35e-5c9e-48a9-a9fc-5c5d8341cec9 None admin] Validating token access rules against request {{(pid=479852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:19:40.749613 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG dbcounter [-] [479852] Writing DB stats keystone:SELECT=100 {{(pid=479852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:19:40.770205 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a7cddc-2748-4bd8-8265-bf04d4d56925 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:19:40.771223 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a7cddc-2748-4bd8-8265-bf04d4d56925 None admin] REQUEST_METHOD: `GET` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:19:40.771508 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a7cddc-2748-4bd8-8265-bf04d4d56925 None admin] SCRIPT_NAME: `/identity` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:19:40.771789 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a7cddc-2748-4bd8-8265-bf04d4d56925 None admin] PATH_INFO: `/v3/services` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:19:40.772728 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2a7cddc-2748-4bd8-8265-bf04d4d56925 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=479852) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 09:19:40.773050 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2a7cddc-2748-4bd8-8265-bf04d4d56925 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:19:40.774865 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2a7cddc-2748-4bd8-8265-bf04d4d56925 None admin] RBAC: Authorization granted {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:19:40.784917 dv-cinder-851351-1-smb devstack@keystone.service[479852]: [pid: 479852|app: 0|req: 429/843] 10.222.0.42 () {56 vars in 1114 bytes} [Thu Jul 28 09:19:40 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:19:40.852066 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d3cd28-20ae-40d6-99ed-7c15fc7fb7c3 None admin] Validating token access rules against request {{(pid=479851) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:19:40.854244 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG dbcounter [-] [479851] Writing DB stats keystone:SELECT=100 {{(pid=479851) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:19:40.909299 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf31c0b-10d5-4274-8d82-882cc0b66c7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479851) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:19:40.910567 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf31c0b-10d5-4274-8d82-882cc0b66c7d None admin] REQUEST_METHOD: `GET` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:19:40.911169 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf31c0b-10d5-4274-8d82-882cc0b66c7d None admin] SCRIPT_NAME: `/identity` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:19:40.911781 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf31c0b-10d5-4274-8d82-882cc0b66c7d None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:19:40.923001 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdf31c0b-10d5-4274-8d82-882cc0b66c7d None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:19:40.925278 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdf31c0b-10d5-4274-8d82-882cc0b66c7d None admin] RBAC: Authorization granted {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:19:40.940411 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application [None req-bdf31c0b-10d5-4274-8d82-882cc0b66c7d None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 28 09:19:40.940411 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 09:19:40.940411 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 09:19:40.940411 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 09:19:40.940411 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 09:19:40.940411 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 09:19:40.940411 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 09:19:40.940411 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 09:19:40.940411 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 09:19:40.940411 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 09:19:40.940411 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 09:19:40.940411 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 09:19:40.940411 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 28 09:19:40.940411 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 28 09:19:40.940411 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 28 09:19:40.940411 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 28 09:19:40.941615 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 09:19:40.941615 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 09:19:40.941615 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 28 09:19:40.941615 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 09:19:40.941615 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 28 09:19:40.941615 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 09:19:40.941615 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 09:19:40.941615 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 09:19:40.941615 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 09:19:40.941615 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 09:19:40.941615 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 09:19:40.941615 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application with Lock( Jul 28 09:19:40.941615 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 09:19:40.941615 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return self._enter() Jul 28 09:19:40.941615 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 09:19:40.941615 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 09:19:40.941615 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 09:19:40.941615 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return self.creator() Jul 28 09:19:40.942854 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 09:19:40.942854 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application created_value = creator( Jul 28 09:19:40.942854 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 28 09:19:40.942854 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 28 09:19:40.942854 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 28 09:19:40.942854 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 28 09:19:40.942854 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 28 09:19:40.942854 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 28 09:19:40.942854 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 28 09:19:40.942854 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application Jul 28 09:19:40.946831 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd122c9-dfc2-4943-9d55-56e97bcc3753 None None] REQUEST_METHOD: `GET` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:19:40.947083 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd122c9-dfc2-4943-9d55-56e97bcc3753 None None] SCRIPT_NAME: `/identity` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:19:40.947432 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd122c9-dfc2-4943-9d55-56e97bcc3753 None None] PATH_INFO: `/` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:19:40.947739 dv-cinder-851351-1-smb devstack@keystone.service[479851]: [pid: 479851|app: 0|req: 415/844] 10.222.0.42 () {56 vars in 1117 bytes} [Thu Jul 28 09:19:40 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 261 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 09:19:40.949000 dv-cinder-851351-1-smb devstack@keystone.service[479852]: [pid: 479852|app: 0|req: 430/845] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 09:19:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 28 09:19:40.955471 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc13f3d2-f06e-4a92-bfd0-c562243f6540 None None] REQUEST_METHOD: `POST` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:19:40.955800 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc13f3d2-f06e-4a92-bfd0-c562243f6540 None None] SCRIPT_NAME: `/identity` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:19:40.956143 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc13f3d2-f06e-4a92-bfd0-c562243f6540 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:19:40.958659 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd122c9-dfc2-4943-9d55-56e97bcc3753 None None] Authenticating user token {{(pid=479852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:19:40.978823 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.auth.core [None req-cc13f3d2-f06e-4a92-bfd0-c562243f6540 None None] MFA Rules not processed for user `c198f91a4ae84d2b9cc730a6e304c2be`. Rule list: `[]` (Enabled: `True`). {{(pid=479851) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 09:19:40.980090 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.fernet_utils [None req-cc13f3d2-f06e-4a92-bfd0-c562243f6540 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=479851) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 09:19:41.075403 dv-cinder-851351-1-smb devstack@keystone.service[479851]: [pid: 479851|app: 0|req: 416/846] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 09:19:40 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 09:19:41.099183 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc13f3d2-f06e-4a92-bfd0-c562243f6540 None None] Authenticating user token {{(pid=479851) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:19:41.103681 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd122c9-dfc2-4943-9d55-56e97bcc3753 None None] Validating token access rules against request {{(pid=479852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:19:41.142684 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8043e360-5676-4b12-9f08-1a4a79c7dbcc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:19:41.143760 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8043e360-5676-4b12-9f08-1a4a79c7dbcc None admin] REQUEST_METHOD: `GET` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:19:41.144284 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8043e360-5676-4b12-9f08-1a4a79c7dbcc None admin] SCRIPT_NAME: `/identity` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:19:41.144824 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8043e360-5676-4b12-9f08-1a4a79c7dbcc None admin] PATH_INFO: `/v3/users` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:19:41.145993 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8043e360-5676-4b12-9f08-1a4a79c7dbcc None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=479852) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 09:19:41.146541 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8043e360-5676-4b12-9f08-1a4a79c7dbcc None admin] RBAC: Authorizing `identity:list_users()` {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:19:41.148246 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8043e360-5676-4b12-9f08-1a4a79c7dbcc None admin] RBAC: Authorization granted {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:19:41.168904 dv-cinder-851351-1-smb devstack@keystone.service[479852]: [pid: 479852|app: 0|req: 431/847] 10.222.0.42 () {56 vars in 1149 bytes} [Thu Jul 28 09:19:40 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:19:41.174950 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8043e360-5676-4b12-9f08-1a4a79c7dbcc None admin] Authenticating user token {{(pid=479852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:19:41.203238 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG dbcounter [-] [479851] Writing DB stats keystone:SELECT=100 {{(pid=479851) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:19:41.214123 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc13f3d2-f06e-4a92-bfd0-c562243f6540 None None] Validating token access rules against request {{(pid=479851) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:19:41.234905 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG dbcounter [-] [479852] Writing DB stats keystone:SELECT=100 {{(pid=479852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:19:41.256821 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fbc17f4-f7ef-43cf-bfa9-55d5c40d7061 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479851) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:19:41.257967 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fbc17f4-f7ef-43cf-bfa9-55d5c40d7061 None admin] REQUEST_METHOD: `GET` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:19:41.258355 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fbc17f4-f7ef-43cf-bfa9-55d5c40d7061 None admin] SCRIPT_NAME: `/identity` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:19:41.258736 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fbc17f4-f7ef-43cf-bfa9-55d5c40d7061 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:19:41.274041 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fbc17f4-f7ef-43cf-bfa9-55d5c40d7061 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 09:19:41.279001 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application [None req-4fbc17f4-f7ef-43cf-bfa9-55d5c40d7061 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 09:19:41.279001 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 09:19:41.279001 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 09:19:41.279001 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 09:19:41.279001 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 09:19:41.279001 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 09:19:41.279001 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 09:19:41.279001 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 09:19:41.279001 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 09:19:41.279001 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 09:19:41.279001 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 09:19:41.279001 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 09:19:41.279001 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 09:19:41.279001 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 09:19:41.279001 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 09:19:41.279001 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 09:19:41.280153 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 09:19:41.280153 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 09:19:41.280153 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 09:19:41.280153 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 09:19:41.280153 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 09:19:41.280153 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 09:19:41.280153 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 09:19:41.280153 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 09:19:41.280153 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 09:19:41.280153 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 09:19:41.280153 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 09:19:41.280153 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application with Lock( Jul 28 09:19:41.280153 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 09:19:41.280153 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return self._enter() Jul 28 09:19:41.280153 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 09:19:41.280153 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 09:19:41.281200 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 09:19:41.281200 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return self.creator() Jul 28 09:19:41.281200 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 09:19:41.281200 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application created_value = creator( Jul 28 09:19:41.281200 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 09:19:41.281200 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 09:19:41.281200 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 09:19:41.281200 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 09:19:41.281200 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 09:19:41.281200 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 09:19:41.281200 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 09:19:41.281200 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application Jul 28 09:19:41.285634 dv-cinder-851351-1-smb devstack@keystone.service[479851]: [pid: 479851|app: 0|req: 417/848] 10.222.0.42 () {56 vars in 1096 bytes} [Thu Jul 28 09:19:41 2022] GET /identity/v3/roles/admin => generated 83 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 09:19:41.286654 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fbc17f4-f7ef-43cf-bfa9-55d5c40d7061 None admin] Authenticating user token {{(pid=479851) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:19:41.303771 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8043e360-5676-4b12-9f08-1a4a79c7dbcc None admin] Validating token access rules against request {{(pid=479852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:19:41.341585 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e362918d-8784-4503-80ea-a488db2a91ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:19:41.343056 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e362918d-8784-4503-80ea-a488db2a91ec None admin] REQUEST_METHOD: `GET` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:19:41.343604 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e362918d-8784-4503-80ea-a488db2a91ec None admin] SCRIPT_NAME: `/identity` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:19:41.344104 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e362918d-8784-4503-80ea-a488db2a91ec None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:19:41.398762 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fbc17f4-f7ef-43cf-bfa9-55d5c40d7061 None admin] Validating token access rules against request {{(pid=479851) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:19:41.419770 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e362918d-8784-4503-80ea-a488db2a91ec None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:19:41.421438 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e362918d-8784-4503-80ea-a488db2a91ec None admin] RBAC: Authorization granted {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:19:41.439415 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbeb2a4c-9c87-4ed2-a23a-ff867c8b7ff6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479851) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:19:41.440290 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbeb2a4c-9c87-4ed2-a23a-ff867c8b7ff6 None admin] REQUEST_METHOD: `GET` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:19:41.440615 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbeb2a4c-9c87-4ed2-a23a-ff867c8b7ff6 None admin] SCRIPT_NAME: `/identity` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:19:41.440931 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbeb2a4c-9c87-4ed2-a23a-ff867c8b7ff6 None admin] PATH_INFO: `/v3/roles` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:19:41.441678 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbeb2a4c-9c87-4ed2-a23a-ff867c8b7ff6 None admin] RBAC: Adding query filter params (name=admin) {{(pid=479851) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 09:19:41.441995 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbeb2a4c-9c87-4ed2-a23a-ff867c8b7ff6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:19:41.443451 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbeb2a4c-9c87-4ed2-a23a-ff867c8b7ff6 None admin] RBAC: Authorization granted {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:19:41.458494 dv-cinder-851351-1-smb devstack@keystone.service[479851]: [pid: 479851|app: 0|req: 418/849] 10.222.0.42 () {56 vars in 1099 bytes} [Thu Jul 28 09:19:41 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:19:41.459489 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbeb2a4c-9c87-4ed2-a23a-ff867c8b7ff6 None admin] Authenticating user token {{(pid=479851) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:19:41.477429 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG dbcounter [-] [479851] Writing DB stats keystone:SELECT=100 {{(pid=479851) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:19:41.490387 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG dbcounter [-] [479852] Writing DB stats keystone:SELECT=100 {{(pid=479852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:19:41.576768 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbeb2a4c-9c87-4ed2-a23a-ff867c8b7ff6 None admin] Validating token access rules against request {{(pid=479851) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:19:41.581519 dv-cinder-851351-1-smb devstack@keystone.service[479852]: [pid: 479852|app: 0|req: 432/850] 10.222.0.42 () {58 vars in 1282 bytes} [Thu Jul 28 09:19:41 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 407 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jul 28 09:19:41.584062 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e362918d-8784-4503-80ea-a488db2a91ec None admin] Authenticating user token {{(pid=479852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:19:41.614521 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1736e95c-9226-4b31-bf79-4c23373d2f7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479851) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:19:41.615488 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1736e95c-9226-4b31-bf79-4c23373d2f7f None admin] REQUEST_METHOD: `GET` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:19:41.616006 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1736e95c-9226-4b31-bf79-4c23373d2f7f None admin] SCRIPT_NAME: `/identity` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:19:41.616446 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1736e95c-9226-4b31-bf79-4c23373d2f7f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:19:41.628176 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1736e95c-9226-4b31-bf79-4c23373d2f7f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:19:41.630106 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1736e95c-9226-4b31-bf79-4c23373d2f7f None admin] RBAC: Authorization granted {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:19:41.645182 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application [None req-1736e95c-9226-4b31-bf79-4c23373d2f7f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 09:19:41.645182 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 09:19:41.645182 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 09:19:41.645182 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 09:19:41.645182 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 09:19:41.645182 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 09:19:41.645182 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 09:19:41.645182 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 09:19:41.645182 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 09:19:41.645182 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 09:19:41.645182 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 09:19:41.645182 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 09:19:41.645182 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 09:19:41.645182 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 09:19:41.645182 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 09:19:41.646456 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 09:19:41.646456 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 09:19:41.646456 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 09:19:41.646456 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 09:19:41.646456 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 09:19:41.646456 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 09:19:41.646456 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 09:19:41.646456 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 09:19:41.646456 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application with Lock( Jul 28 09:19:41.646456 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 09:19:41.646456 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return self._enter() Jul 28 09:19:41.646456 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 09:19:41.646456 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 09:19:41.646456 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 09:19:41.646456 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return self.creator() Jul 28 09:19:41.646456 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 09:19:41.646456 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application created_value = creator( Jul 28 09:19:41.647739 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 09:19:41.647739 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 09:19:41.647739 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 09:19:41.647739 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application Jul 28 09:19:41.649643 dv-cinder-851351-1-smb devstack@keystone.service[479851]: [pid: 479851|app: 0|req: 419/851] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 09:19:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 09:19:41.656778 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1736e95c-9226-4b31-bf79-4c23373d2f7f None admin] Authenticating user token {{(pid=479851) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:19:41.729938 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG dbcounter [-] [479851] Writing DB stats keystone:SELECT=100 {{(pid=479851) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:19:41.749397 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e362918d-8784-4503-80ea-a488db2a91ec None admin] Validating token access rules against request {{(pid=479852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:19:41.767227 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1736e95c-9226-4b31-bf79-4c23373d2f7f None admin] Validating token access rules against request {{(pid=479851) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:19:41.787610 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5caf53-3950-411e-9c64-2c3fb92d9981 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:19:41.788268 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5caf53-3950-411e-9c64-2c3fb92d9981 None admin] REQUEST_METHOD: `GET` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:19:41.788555 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5caf53-3950-411e-9c64-2c3fb92d9981 None admin] SCRIPT_NAME: `/identity` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:19:41.788942 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5caf53-3950-411e-9c64-2c3fb92d9981 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:19:41.800883 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b5caf53-3950-411e-9c64-2c3fb92d9981 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:19:41.802348 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b5caf53-3950-411e-9c64-2c3fb92d9981 None admin] RBAC: Authorization granted {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:19:41.805142 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG dbcounter [-] [479852] Writing DB stats keystone:SELECT=100 {{(pid=479852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:19:41.805587 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94a3435-46d0-4bed-845e-24da1e31e49b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479851) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:19:41.806436 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94a3435-46d0-4bed-845e-24da1e31e49b None admin] REQUEST_METHOD: `GET` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:19:41.806885 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94a3435-46d0-4bed-845e-24da1e31e49b None admin] SCRIPT_NAME: `/identity` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:19:41.807324 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94a3435-46d0-4bed-845e-24da1e31e49b None admin] PATH_INFO: `/v3/domains` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:19:41.808201 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b94a3435-46d0-4bed-845e-24da1e31e49b None admin] RBAC: Adding query filter params (name=Default) {{(pid=479851) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 09:19:41.808709 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b94a3435-46d0-4bed-845e-24da1e31e49b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:19:41.810352 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b94a3435-46d0-4bed-845e-24da1e31e49b None admin] RBAC: Authorization granted {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:19:41.821009 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application [None req-1b5caf53-3950-411e-9c64-2c3fb92d9981 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 09:19:41.821009 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 09:19:41.821009 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 09:19:41.821009 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 09:19:41.821009 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 09:19:41.821009 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 09:19:41.821009 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 09:19:41.821009 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 09:19:41.821009 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 09:19:41.821009 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 09:19:41.821009 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 09:19:41.821009 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 09:19:41.821009 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 09:19:41.821009 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 09:19:41.821009 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 09:19:41.822602 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 09:19:41.822602 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 09:19:41.822602 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 09:19:41.822602 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 09:19:41.822602 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 09:19:41.822602 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 09:19:41.822602 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 09:19:41.822602 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 09:19:41.822602 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application with Lock( Jul 28 09:19:41.822602 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 09:19:41.822602 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self._enter() Jul 28 09:19:41.822602 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 09:19:41.822602 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 09:19:41.822602 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 09:19:41.822602 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self.creator() Jul 28 09:19:41.822602 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 09:19:41.822602 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application created_value = creator( Jul 28 09:19:41.823856 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 09:19:41.823856 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 09:19:41.823856 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 09:19:41.823856 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application Jul 28 09:19:41.826885 dv-cinder-851351-1-smb devstack@keystone.service[479851]: [pid: 479851|app: 0|req: 420/852] 10.222.0.42 () {56 vars in 1109 bytes} [Thu Jul 28 09:19:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:19:41.827882 dv-cinder-851351-1-smb devstack@keystone.service[479852]: [pid: 479852|app: 0|req: 433/853] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 09:19:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 245 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 09:19:41.832753 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94a3435-46d0-4bed-845e-24da1e31e49b None admin] Authenticating user token {{(pid=479851) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:19:41.832907 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5caf53-3950-411e-9c64-2c3fb92d9981 None admin] Authenticating user token {{(pid=479852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:19:41.943703 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94a3435-46d0-4bed-845e-24da1e31e49b None admin] Validating token access rules against request {{(pid=479851) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:19:41.943905 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5caf53-3950-411e-9c64-2c3fb92d9981 None admin] Validating token access rules against request {{(pid=479852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:19:41.985549 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa45c82-435e-4783-b125-ed9d199f2480 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:19:41.985897 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa45c82-435e-4783-b125-ed9d199f2480 None admin] REQUEST_METHOD: `GET` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:19:41.986012 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG dbcounter [-] [479851] Writing DB stats keystone:SELECT=100 {{(pid=479851) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:19:41.986167 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa45c82-435e-4783-b125-ed9d199f2480 None admin] SCRIPT_NAME: `/identity` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:19:41.986833 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa45c82-435e-4783-b125-ed9d199f2480 None admin] PATH_INFO: `/v3/domains` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:19:41.987683 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfa45c82-435e-4783-b125-ed9d199f2480 None admin] RBAC: Adding query filter params (name=Default) {{(pid=479852) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 09:19:41.987990 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfa45c82-435e-4783-b125-ed9d199f2480 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:19:41.989589 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfa45c82-435e-4783-b125-ed9d199f2480 None admin] RBAC: Authorization granted {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:19:41.992253 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041bc2f8-73bf-4655-a9fd-84e238b32ea2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479851) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:19:41.993285 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041bc2f8-73bf-4655-a9fd-84e238b32ea2 None admin] REQUEST_METHOD: `GET` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:19:41.994139 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041bc2f8-73bf-4655-a9fd-84e238b32ea2 None admin] SCRIPT_NAME: `/identity` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:19:41.994884 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041bc2f8-73bf-4655-a9fd-84e238b32ea2 None admin] PATH_INFO: `/v3/users/swift` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:19:42.006992 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-041bc2f8-73bf-4655-a9fd-84e238b32ea2 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:19:42.008071 dv-cinder-851351-1-smb devstack@keystone.service[479852]: [pid: 479852|app: 0|req: 434/854] 10.222.0.42 () {56 vars in 1109 bytes} [Thu Jul 28 09:19:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 09:19:42.009068 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa45c82-435e-4783-b125-ed9d199f2480 None admin] Authenticating user token {{(pid=479852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:19:42.009821 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-041bc2f8-73bf-4655-a9fd-84e238b32ea2 None admin] RBAC: Authorization granted {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:19:42.023310 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application [None req-041bc2f8-73bf-4655-a9fd-84e238b32ea2 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 28 09:19:42.023310 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 09:19:42.023310 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 09:19:42.023310 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 09:19:42.023310 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 09:19:42.023310 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 09:19:42.023310 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 09:19:42.023310 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 09:19:42.023310 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 09:19:42.023310 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 09:19:42.023310 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 09:19:42.023310 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 09:19:42.023310 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 28 09:19:42.023310 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 28 09:19:42.023310 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 28 09:19:42.023310 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 28 09:19:42.024539 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 09:19:42.024539 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 09:19:42.024539 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 28 09:19:42.024539 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 09:19:42.024539 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 28 09:19:42.024539 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 09:19:42.024539 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 09:19:42.024539 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 09:19:42.024539 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 09:19:42.024539 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 09:19:42.024539 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 09:19:42.024539 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application with Lock( Jul 28 09:19:42.024539 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 09:19:42.024539 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return self._enter() Jul 28 09:19:42.024539 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 09:19:42.024539 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 09:19:42.024539 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 09:19:42.024539 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return self.creator() Jul 28 09:19:42.025839 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 09:19:42.025839 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application created_value = creator( Jul 28 09:19:42.025839 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 28 09:19:42.025839 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 28 09:19:42.025839 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 28 09:19:42.025839 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 28 09:19:42.025839 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 28 09:19:42.025839 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 28 09:19:42.025839 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 28 09:19:42.025839 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application Jul 28 09:19:42.028341 dv-cinder-851351-1-smb devstack@keystone.service[479851]: [pid: 479851|app: 0|req: 421/855] 10.222.0.42 () {56 vars in 1096 bytes} [Thu Jul 28 09:19:41 2022] GET /identity/v3/users/swift => generated 83 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 09:19:42.034466 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041bc2f8-73bf-4655-a9fd-84e238b32ea2 None admin] Authenticating user token {{(pid=479851) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:19:42.077177 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG dbcounter [-] [479852] Writing DB stats keystone:SELECT=100 {{(pid=479852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:19:42.145009 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa45c82-435e-4783-b125-ed9d199f2480 None admin] Validating token access rules against request {{(pid=479852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:19:42.147444 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041bc2f8-73bf-4655-a9fd-84e238b32ea2 None admin] Validating token access rules against request {{(pid=479851) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:19:42.182230 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c964f2-02ff-44e7-94c3-c4219392a545 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:19:42.182891 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c964f2-02ff-44e7-94c3-c4219392a545 None admin] REQUEST_METHOD: `GET` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:19:42.183170 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c964f2-02ff-44e7-94c3-c4219392a545 None admin] SCRIPT_NAME: `/identity` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:19:42.183442 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c964f2-02ff-44e7-94c3-c4219392a545 None admin] PATH_INFO: `/v3/projects/service` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:19:42.186505 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b17bdf-3656-41ac-9777-b4f99802a25d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479851) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:19:42.187400 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b17bdf-3656-41ac-9777-b4f99802a25d None admin] REQUEST_METHOD: `GET` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:19:42.187851 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b17bdf-3656-41ac-9777-b4f99802a25d None admin] SCRIPT_NAME: `/identity` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:19:42.188359 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b17bdf-3656-41ac-9777-b4f99802a25d None admin] PATH_INFO: `/v3/users` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:19:42.189423 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b17bdf-3656-41ac-9777-b4f99802a25d None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=479851) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 09:19:42.189898 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b17bdf-3656-41ac-9777-b4f99802a25d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:19:42.190953 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30c964f2-02ff-44e7-94c3-c4219392a545 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:19:42.191800 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b17bdf-3656-41ac-9777-b4f99802a25d None admin] RBAC: Authorization granted {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:19:42.192497 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30c964f2-02ff-44e7-94c3-c4219392a545 None admin] RBAC: Authorization granted {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:19:42.205402 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application [None req-30c964f2-02ff-44e7-94c3-c4219392a545 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 09:19:42.205402 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 09:19:42.205402 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 09:19:42.205402 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 09:19:42.205402 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 09:19:42.205402 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 09:19:42.205402 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 09:19:42.205402 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 09:19:42.205402 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 09:19:42.205402 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 09:19:42.205402 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 09:19:42.205402 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 09:19:42.205402 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 28 09:19:42.205402 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 28 09:19:42.205402 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 28 09:19:42.206687 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 28 09:19:42.206687 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 09:19:42.206687 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 09:19:42.206687 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 09:19:42.206687 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 09:19:42.206687 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 09:19:42.206687 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 09:19:42.206687 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 09:19:42.206687 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application with Lock( Jul 28 09:19:42.206687 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 09:19:42.206687 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self._enter() Jul 28 09:19:42.206687 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 09:19:42.206687 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 09:19:42.206687 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 09:19:42.206687 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self.creator() Jul 28 09:19:42.206687 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 09:19:42.206687 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application created_value = creator( Jul 28 09:19:42.208031 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 28 09:19:42.208031 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 28 09:19:42.208031 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 28 09:19:42.208031 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 28 09:19:42.208031 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 28 09:19:42.208031 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 28 09:19:42.208031 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 09:19:42.208031 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application Jul 28 09:19:42.211481 dv-cinder-851351-1-smb devstack@keystone.service[479852]: [pid: 479852|app: 0|req: 435/856] 10.222.0.42 () {56 vars in 1111 bytes} [Thu Jul 28 09:19:42 2022] GET /identity/v3/projects/service => generated 88 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 09:19:42.212397 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c964f2-02ff-44e7-94c3-c4219392a545 None admin] Authenticating user token {{(pid=479852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:19:42.221975 dv-cinder-851351-1-smb devstack@keystone.service[479851]: [pid: 479851|app: 0|req: 422/857] 10.222.0.42 () {56 vars in 1135 bytes} [Thu Jul 28 09:19:42 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:19:42.223217 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b17bdf-3656-41ac-9777-b4f99802a25d None admin] Authenticating user token {{(pid=479851) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:19:42.274578 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG dbcounter [-] [479851] Writing DB stats keystone:SELECT=100 {{(pid=479851) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:19:42.327524 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c964f2-02ff-44e7-94c3-c4219392a545 None admin] Validating token access rules against request {{(pid=479852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:19:42.337406 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b17bdf-3656-41ac-9777-b4f99802a25d None admin] Validating token access rules against request {{(pid=479851) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:19:42.347202 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG dbcounter [-] [479852] Writing DB stats keystone:SELECT=100 {{(pid=479852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:19:42.370754 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e0f12e-c610-4bfb-b521-1c3203455eac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:19:42.371398 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e0f12e-c610-4bfb-b521-1c3203455eac None admin] REQUEST_METHOD: `GET` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:19:42.371687 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e0f12e-c610-4bfb-b521-1c3203455eac None admin] SCRIPT_NAME: `/identity` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:19:42.371960 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e0f12e-c610-4bfb-b521-1c3203455eac None admin] PATH_INFO: `/v3/projects` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:19:42.372884 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6e0f12e-c610-4bfb-b521-1c3203455eac None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=479852) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 09:19:42.373197 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6e0f12e-c610-4bfb-b521-1c3203455eac None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:19:42.374808 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6e0f12e-c610-4bfb-b521-1c3203455eac None admin] RBAC: Authorization granted {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:19:42.379452 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efdabe3a-d177-4dc6-8a89-8b17880e0484 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479851) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:19:42.380419 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efdabe3a-d177-4dc6-8a89-8b17880e0484 None admin] REQUEST_METHOD: `GET` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:19:42.380892 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efdabe3a-d177-4dc6-8a89-8b17880e0484 None admin] SCRIPT_NAME: `/identity` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:19:42.381329 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efdabe3a-d177-4dc6-8a89-8b17880e0484 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:19:42.394222 dv-cinder-851351-1-smb devstack@keystone.service[479852]: [pid: 479852|app: 0|req: 436/858] 10.222.0.42 () {56 vars in 1148 bytes} [Thu Jul 28 09:19:42 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:19:42.395501 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e0f12e-c610-4bfb-b521-1c3203455eac None admin] Authenticating user token {{(pid=479852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:19:42.484035 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efdabe3a-d177-4dc6-8a89-8b17880e0484 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:19:42.487180 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efdabe3a-d177-4dc6-8a89-8b17880e0484 None admin] RBAC: Authorization granted {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:19:42.512652 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e0f12e-c610-4bfb-b521-1c3203455eac None admin] Validating token access rules against request {{(pid=479852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:19:42.553929 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe850825-3a6d-4104-a711-8ee2e8c21cff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:19:42.555030 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe850825-3a6d-4104-a711-8ee2e8c21cff None admin] REQUEST_METHOD: `GET` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:19:42.555535 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe850825-3a6d-4104-a711-8ee2e8c21cff None admin] SCRIPT_NAME: `/identity` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:19:42.556034 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe850825-3a6d-4104-a711-8ee2e8c21cff None admin] PATH_INFO: `/v3/role_assignments` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:19:42.557980 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe850825-3a6d-4104-a711-8ee2e8c21cff None admin] RBAC: Adding query filter params (role.id=bd74dfcbc8d7412689d315fe24a1f247, scope.project.id=3a0fb8ea8010437bade8f92dcbcaacee, user.id=87596a91a45f4326855265497fe69b65) {{(pid=479852) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 09:19:42.557980 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe850825-3a6d-4104-a711-8ee2e8c21cff None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:19:42.559208 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe850825-3a6d-4104-a711-8ee2e8c21cff None admin] RBAC: Authorization granted {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:19:42.573003 dv-cinder-851351-1-smb devstack@keystone.service[479852]: [pid: 479852|app: 0|req: 437/859] 10.222.0.42 () {56 vars in 1374 bytes} [Thu Jul 28 09:19:42 2022] GET /identity/v3/role_assignments?user.id=87596a91a45f4326855265497fe69b65&scope.project.id=3a0fb8ea8010437bade8f92dcbcaacee&role.id=bd74dfcbc8d7412689d315fe24a1f247 => generated 608 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:19:42.574409 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG dbcounter [-] [479851] Writing DB stats keystone:SELECT=100 {{(pid=479851) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:19:42.639096 dv-cinder-851351-1-smb devstack@keystone.service[479851]: [pid: 479851|app: 0|req: 423/860] 10.222.0.42 () {58 vars in 1282 bytes} [Thu Jul 28 09:19:42 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 416 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 28 09:19:42.645406 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe850825-3a6d-4104-a711-8ee2e8c21cff None admin] Authenticating user token {{(pid=479852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:19:42.697196 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG dbcounter [-] [479852] Writing DB stats keystone:SELECT=100 {{(pid=479852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:19:42.769118 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe850825-3a6d-4104-a711-8ee2e8c21cff None admin] Validating token access rules against request {{(pid=479852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:19:42.809236 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a24418-80a6-4867-9e6e-15fabe6f3d0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:19:42.809904 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a24418-80a6-4867-9e6e-15fabe6f3d0c None admin] REQUEST_METHOD: `GET` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:19:42.810193 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a24418-80a6-4867-9e6e-15fabe6f3d0c None admin] SCRIPT_NAME: `/identity` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:19:42.810473 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a24418-80a6-4867-9e6e-15fabe6f3d0c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:19:42.823377 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79a24418-80a6-4867-9e6e-15fabe6f3d0c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:19:42.824885 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79a24418-80a6-4867-9e6e-15fabe6f3d0c None admin] RBAC: Authorization granted {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:19:42.847176 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application [None req-79a24418-80a6-4867-9e6e-15fabe6f3d0c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 09:19:42.847176 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 09:19:42.847176 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 09:19:42.847176 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 09:19:42.847176 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 09:19:42.847176 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 09:19:42.847176 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 09:19:42.847176 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 09:19:42.847176 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 09:19:42.847176 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 09:19:42.847176 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 09:19:42.847176 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 09:19:42.847176 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 09:19:42.847176 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 09:19:42.847176 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 09:19:42.848323 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 09:19:42.848323 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 09:19:42.848323 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 09:19:42.848323 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 09:19:42.848323 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 09:19:42.848323 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 09:19:42.848323 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 09:19:42.848323 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 09:19:42.848323 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application with Lock( Jul 28 09:19:42.848323 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 09:19:42.848323 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self._enter() Jul 28 09:19:42.848323 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 09:19:42.848323 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 09:19:42.848323 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 09:19:42.848323 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self.creator() Jul 28 09:19:42.848323 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 09:19:42.848323 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application created_value = creator( Jul 28 09:19:42.849419 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 09:19:42.849419 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 09:19:42.849419 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 09:19:42.849419 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application Jul 28 09:19:42.849419 dv-cinder-851351-1-smb devstack@keystone.service[479852]: [pid: 479852|app: 0|req: 438/861] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 09:19:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 09:19:42.857764 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efdabe3a-d177-4dc6-8a89-8b17880e0484 None admin] Authenticating user token {{(pid=479851) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:19:42.895530 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0aebe0-d241-4155-a174-54fd64f79af9 None None] REQUEST_METHOD: `GET` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:19:42.895810 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0aebe0-d241-4155-a174-54fd64f79af9 None None] SCRIPT_NAME: `/identity` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:19:42.896153 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0aebe0-d241-4155-a174-54fd64f79af9 None None] PATH_INFO: `/` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:19:42.897511 dv-cinder-851351-1-smb devstack@keystone.service[479852]: [pid: 479852|app: 0|req: 439/862] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 09:19:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 09:19:42.903363 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30d7d3f-0ccd-483c-a80f-331fb4b84817 None None] REQUEST_METHOD: `POST` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:19:42.903659 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30d7d3f-0ccd-483c-a80f-331fb4b84817 None None] SCRIPT_NAME: `/identity` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:19:42.903883 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30d7d3f-0ccd-483c-a80f-331fb4b84817 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:19:42.925553 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.auth.core [None req-f30d7d3f-0ccd-483c-a80f-331fb4b84817 None None] MFA Rules not processed for user `c198f91a4ae84d2b9cc730a6e304c2be`. Rule list: `[]` (Enabled: `True`). {{(pid=479852) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 09:19:42.926933 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.fernet_utils [None req-f30d7d3f-0ccd-483c-a80f-331fb4b84817 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=479852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 09:19:43.008905 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efdabe3a-d177-4dc6-8a89-8b17880e0484 None admin] Validating token access rules against request {{(pid=479851) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:19:43.025821 dv-cinder-851351-1-smb devstack@keystone.service[479852]: [pid: 479852|app: 0|req: 440/863] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 09:19:42 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 28 09:19:43.027437 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f3d873-4b98-4dd6-b13a-fd6e770c43ef None None] REQUEST_METHOD: `GET` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:19:43.027717 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f3d873-4b98-4dd6-b13a-fd6e770c43ef None None] SCRIPT_NAME: `/identity` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:19:43.027993 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f3d873-4b98-4dd6-b13a-fd6e770c43ef None None] PATH_INFO: `/` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:19:43.032222 dv-cinder-851351-1-smb devstack@keystone.service[479852]: [pid: 479852|app: 0|req: 441/864] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 09:19:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 09:19:43.035379 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e494467-7cdf-4ffc-9103-c2d076b09bae None None] REQUEST_METHOD: `POST` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:19:43.035665 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e494467-7cdf-4ffc-9103-c2d076b09bae None None] SCRIPT_NAME: `/identity` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:19:43.035982 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e494467-7cdf-4ffc-9103-c2d076b09bae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:19:43.056871 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.auth.core [None req-3e494467-7cdf-4ffc-9103-c2d076b09bae None None] MFA Rules not processed for user `c198f91a4ae84d2b9cc730a6e304c2be`. Rule list: `[]` (Enabled: `True`). {{(pid=479852) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 09:19:43.058408 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.fernet_utils [None req-3e494467-7cdf-4ffc-9103-c2d076b09bae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=479852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 09:19:43.069923 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d57073-b2d5-4956-9c01-ee6067b9a084 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479851) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:19:43.070928 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d57073-b2d5-4956-9c01-ee6067b9a084 None admin] REQUEST_METHOD: `GET` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:19:43.071898 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d57073-b2d5-4956-9c01-ee6067b9a084 None admin] SCRIPT_NAME: `/identity` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:19:43.071898 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d57073-b2d5-4956-9c01-ee6067b9a084 None admin] PATH_INFO: `/v3/domains` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:19:43.072761 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d57073-b2d5-4956-9c01-ee6067b9a084 None admin] RBAC: Adding query filter params (name=Default) {{(pid=479851) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 09:19:43.073261 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d57073-b2d5-4956-9c01-ee6067b9a084 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:19:43.075494 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d57073-b2d5-4956-9c01-ee6067b9a084 None admin] RBAC: Authorization granted {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:19:43.083685 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG dbcounter [-] [479852] Writing DB stats keystone:SELECT=100 {{(pid=479852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:19:43.095365 dv-cinder-851351-1-smb devstack@keystone.service[479851]: [pid: 479851|app: 0|req: 424/865] 10.222.0.42 () {56 vars in 1109 bytes} [Thu Jul 28 09:19:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:19:43.098001 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d57073-b2d5-4956-9c01-ee6067b9a084 None admin] Authenticating user token {{(pid=479851) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:19:43.106207 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG dbcounter [-] [479851] Writing DB stats keystone:SELECT=100 {{(pid=479851) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:19:43.165417 dv-cinder-851351-1-smb devstack@keystone.service[479852]: [pid: 479852|app: 0|req: 442/866] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 09:19:43 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 09:19:43.166689 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e494467-7cdf-4ffc-9103-c2d076b09bae None None] Authenticating user token {{(pid=479852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:19:43.283287 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d57073-b2d5-4956-9c01-ee6067b9a084 None admin] Validating token access rules against request {{(pid=479851) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:19:43.305546 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e494467-7cdf-4ffc-9103-c2d076b09bae None None] Validating token access rules against request {{(pid=479852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:19:43.320190 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c665257-cc33-448c-b1af-b73dc7c0524d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479851) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:19:43.320887 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c665257-cc33-448c-b1af-b73dc7c0524d None admin] REQUEST_METHOD: `GET` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:19:43.321484 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c665257-cc33-448c-b1af-b73dc7c0524d None admin] SCRIPT_NAME: `/identity` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:19:43.321825 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c665257-cc33-448c-b1af-b73dc7c0524d None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:19:43.322472 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c665257-cc33-448c-b1af-b73dc7c0524d None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:19:43.323864 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c665257-cc33-448c-b1af-b73dc7c0524d None admin] RBAC: Authorization granted {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:19:43.333469 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application [None req-1c665257-cc33-448c-b1af-b73dc7c0524d None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 28 09:19:43.333469 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 09:19:43.333469 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 28 09:19:43.333469 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 28 09:19:43.333469 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 28 09:19:43.333469 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 28 09:19:43.333469 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 28 09:19:43.333469 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 09:19:43.333469 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 28 09:19:43.333469 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application Jul 28 09:19:43.333469 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 28 09:19:43.333469 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application Jul 28 09:19:43.333469 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 09:19:43.333469 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 09:19:43.333469 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 09:19:43.333469 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 09:19:43.335433 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 09:19:43.335433 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 09:19:43.335433 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 09:19:43.335433 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 09:19:43.335433 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 09:19:43.335433 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 09:19:43.335433 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 09:19:43.335433 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 28 09:19:43.335433 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 28 09:19:43.335433 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 28 09:19:43.335433 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 28 09:19:43.335433 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 09:19:43.335433 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 09:19:43.335433 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 09:19:43.335433 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 09:19:43.335433 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 09:19:43.337149 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 09:19:43.337149 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 09:19:43.337149 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application with Lock( Jul 28 09:19:43.337149 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 09:19:43.337149 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return self._enter() Jul 28 09:19:43.337149 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 09:19:43.337149 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 09:19:43.337149 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 09:19:43.337149 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return self.creator() Jul 28 09:19:43.337149 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 09:19:43.337149 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application created_value = creator( Jul 28 09:19:43.337149 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 28 09:19:43.337149 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 09:19:43.337149 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 28 09:19:43.337149 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application Jul 28 09:19:43.337149 dv-cinder-851351-1-smb devstack@keystone.service[479851]: [pid: 479851|app: 0|req: 425/867] 10.222.0.42 () {56 vars in 1132 bytes} [Thu Jul 28 09:19:43 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 09:19:43.338539 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c665257-cc33-448c-b1af-b73dc7c0524d None admin] Authenticating user token {{(pid=479851) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:19:43.350875 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed01570-5f96-4cd3-afd2-7fe079307f01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:19:43.351583 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed01570-5f96-4cd3-afd2-7fe079307f01 None admin] REQUEST_METHOD: `GET` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:19:43.351838 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed01570-5f96-4cd3-afd2-7fe079307f01 None admin] SCRIPT_NAME: `/identity` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:19:43.352109 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed01570-5f96-4cd3-afd2-7fe079307f01 None admin] PATH_INFO: `/v3/projects/service` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:19:43.359285 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ed01570-5f96-4cd3-afd2-7fe079307f01 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:19:43.360763 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ed01570-5f96-4cd3-afd2-7fe079307f01 None admin] RBAC: Authorization granted {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:19:43.373323 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application [None req-3ed01570-5f96-4cd3-afd2-7fe079307f01 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 09:19:43.373323 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 09:19:43.373323 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 09:19:43.373323 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 09:19:43.373323 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 09:19:43.373323 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 09:19:43.373323 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 09:19:43.373323 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 09:19:43.373323 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 09:19:43.373323 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 09:19:43.373323 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 09:19:43.373323 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 09:19:43.373323 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 28 09:19:43.373323 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 28 09:19:43.373323 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 28 09:19:43.374407 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 28 09:19:43.374407 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 09:19:43.374407 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 09:19:43.374407 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 09:19:43.374407 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 09:19:43.374407 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 09:19:43.374407 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 09:19:43.374407 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 09:19:43.374407 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application with Lock( Jul 28 09:19:43.374407 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 09:19:43.374407 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self._enter() Jul 28 09:19:43.374407 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 09:19:43.374407 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 09:19:43.374407 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 09:19:43.374407 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self.creator() Jul 28 09:19:43.374407 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 09:19:43.374407 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application created_value = creator( Jul 28 09:19:43.375767 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 28 09:19:43.375767 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 28 09:19:43.375767 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 28 09:19:43.375767 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 28 09:19:43.375767 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 28 09:19:43.375767 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 28 09:19:43.375767 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 09:19:43.375767 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application Jul 28 09:19:43.375767 dv-cinder-851351-1-smb devstack@keystone.service[479852]: [pid: 479852|app: 0|req: 443/868] 10.222.0.42 () {56 vars in 1111 bytes} [Thu Jul 28 09:19:43 2022] GET /identity/v3/projects/service => generated 88 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 09:19:43.375767 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed01570-5f96-4cd3-afd2-7fe079307f01 None admin] Authenticating user token {{(pid=479852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:19:43.394808 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG dbcounter [-] [479852] Writing DB stats keystone:SELECT=100 {{(pid=479852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:19:43.427842 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG dbcounter [-] [479851] Writing DB stats keystone:SELECT=100 {{(pid=479851) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:19:43.469157 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c665257-cc33-448c-b1af-b73dc7c0524d None admin] Validating token access rules against request {{(pid=479851) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:19:43.491314 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed01570-5f96-4cd3-afd2-7fe079307f01 None admin] Validating token access rules against request {{(pid=479852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:19:43.512373 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6fab0f-903b-49a3-a140-f6129a028187 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479851) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:19:43.513265 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6fab0f-903b-49a3-a140-f6129a028187 None admin] REQUEST_METHOD: `POST` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:19:43.513691 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6fab0f-903b-49a3-a140-f6129a028187 None admin] SCRIPT_NAME: `/identity` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:19:43.514153 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6fab0f-903b-49a3-a140-f6129a028187 None admin] PATH_INFO: `/v3/services` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:19:43.515062 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f6fab0f-903b-49a3-a140-f6129a028187 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:19:43.516855 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f6fab0f-903b-49a3-a140-f6129a028187 None admin] RBAC: Authorization granted {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:19:43.540810 dv-cinder-851351-1-smb devstack@keystone.service[479851]: [pid: 479851|app: 0|req: 426/869] 10.222.0.42 () {60 vars in 1141 bytes} [Thu Jul 28 09:19:43 2022] POST /identity/v3/services => generated 251 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 09:19:43.540810 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6fab0f-903b-49a3-a140-f6129a028187 None admin] Authenticating user token {{(pid=479851) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:19:43.551956 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1cde059-70a8-45c6-8722-fecfc56177bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:19:43.552822 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1cde059-70a8-45c6-8722-fecfc56177bd None admin] REQUEST_METHOD: `GET` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:19:43.553226 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1cde059-70a8-45c6-8722-fecfc56177bd None admin] SCRIPT_NAME: `/identity` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:19:43.553567 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1cde059-70a8-45c6-8722-fecfc56177bd None admin] PATH_INFO: `/v3/services` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:19:43.554379 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1cde059-70a8-45c6-8722-fecfc56177bd None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=479852) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 09:19:43.554730 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1cde059-70a8-45c6-8722-fecfc56177bd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:19:43.556434 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1cde059-70a8-45c6-8722-fecfc56177bd None admin] RBAC: Authorization granted {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:19:43.563893 dv-cinder-851351-1-smb devstack@keystone.service[479852]: [pid: 479852|app: 0|req: 444/870] 10.222.0.42 () {56 vars in 1126 bytes} [Thu Jul 28 09:19:43 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:19:43.571923 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1cde059-70a8-45c6-8722-fecfc56177bd None admin] Authenticating user token {{(pid=479852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:19:43.704710 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG dbcounter [-] [479852] Writing DB stats keystone:SELECT=100 {{(pid=479852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:19:43.705284 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6fab0f-903b-49a3-a140-f6129a028187 None admin] Validating token access rules against request {{(pid=479851) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:19:43.745070 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1cde059-70a8-45c6-8722-fecfc56177bd None admin] Validating token access rules against request {{(pid=479852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:19:43.752116 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG dbcounter [-] [479851] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=479851) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:19:43.763692 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7460c9-ce9a-4a52-bed6-08719edbec0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479851) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:19:43.765016 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7460c9-ce9a-4a52-bed6-08719edbec0d None admin] REQUEST_METHOD: `GET` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:19:43.765318 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7460c9-ce9a-4a52-bed6-08719edbec0d None admin] SCRIPT_NAME: `/identity` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:19:43.765834 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7460c9-ce9a-4a52-bed6-08719edbec0d None admin] PATH_INFO: `/v3/projects` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:19:43.766619 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a7460c9-ce9a-4a52-bed6-08719edbec0d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=479851) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 09:19:43.767071 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a7460c9-ce9a-4a52-bed6-08719edbec0d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:19:43.768856 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a7460c9-ce9a-4a52-bed6-08719edbec0d None admin] RBAC: Authorization granted {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:19:43.787522 dv-cinder-851351-1-smb devstack@keystone.service[479851]: [pid: 479851|app: 0|req: 427/871] 10.222.0.42 () {56 vars in 1148 bytes} [Thu Jul 28 09:19:43 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:19:43.794897 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7460c9-ce9a-4a52-bed6-08719edbec0d None admin] Authenticating user token {{(pid=479851) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:19:43.801593 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe84188-7112-40f8-b6c2-001210cbbeea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:19:43.801979 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe84188-7112-40f8-b6c2-001210cbbeea None admin] REQUEST_METHOD: `GET` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:19:43.803080 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe84188-7112-40f8-b6c2-001210cbbeea None admin] SCRIPT_NAME: `/identity` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:19:43.803080 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe84188-7112-40f8-b6c2-001210cbbeea None admin] PATH_INFO: `/v3/services` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:19:43.803340 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fe84188-7112-40f8-b6c2-001210cbbeea None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=479852) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 09:19:43.803558 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fe84188-7112-40f8-b6c2-001210cbbeea None admin] RBAC: Authorizing `identity:list_services()` {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:19:43.805048 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fe84188-7112-40f8-b6c2-001210cbbeea None admin] RBAC: Authorization granted {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:19:43.811005 dv-cinder-851351-1-smb devstack@keystone.service[479852]: [pid: 479852|app: 0|req: 445/872] 10.222.0.42 () {56 vars in 1126 bytes} [Thu Jul 28 09:19:43 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:19:43.928960 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7460c9-ce9a-4a52-bed6-08719edbec0d None admin] Validating token access rules against request {{(pid=479851) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:19:43.969730 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0279f5-92c4-44b8-ad35-cdd6a71d2050 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479851) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:19:43.970382 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0279f5-92c4-44b8-ad35-cdd6a71d2050 None admin] REQUEST_METHOD: `GET` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:19:43.970666 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0279f5-92c4-44b8-ad35-cdd6a71d2050 None admin] SCRIPT_NAME: `/identity` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:19:43.970948 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0279f5-92c4-44b8-ad35-cdd6a71d2050 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:19:43.971767 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef0279f5-92c4-44b8-ad35-cdd6a71d2050 None admin] RBAC: Adding query filter params (role.id=685084310b35477b9b2d0c7934d0f803, scope.project.id=3a0fb8ea8010437bade8f92dcbcaacee, user.id=213aa011e5004256aead7e486d7f2eba) {{(pid=479851) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 09:19:43.972083 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef0279f5-92c4-44b8-ad35-cdd6a71d2050 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:19:43.973690 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef0279f5-92c4-44b8-ad35-cdd6a71d2050 None admin] RBAC: Authorization granted {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:19:43.981270 dv-cinder-851351-1-smb devstack@keystone.service[479851]: [pid: 479851|app: 0|req: 428/873] 10.222.0.42 () {56 vars in 1374 bytes} [Thu Jul 28 09:19:43 2022] GET /identity/v3/role_assignments?user.id=213aa011e5004256aead7e486d7f2eba&scope.project.id=3a0fb8ea8010437bade8f92dcbcaacee&role.id=685084310b35477b9b2d0c7934d0f803 => generated 608 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:19:44.904837 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2bcc4ad-34fe-471c-b798-9763ec5c8cc1 None None] REQUEST_METHOD: `GET` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:19:44.905434 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2bcc4ad-34fe-471c-b798-9763ec5c8cc1 None None] SCRIPT_NAME: `/identity` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:19:44.905740 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2bcc4ad-34fe-471c-b798-9763ec5c8cc1 None None] PATH_INFO: `/` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:19:44.908591 dv-cinder-851351-1-smb devstack@keystone.service[479852]: [pid: 479852|app: 0|req: 446/874] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 09:19:44 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 09:19:44.915545 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3e8efa-85fa-4900-9029-d6da8228c083 None None] REQUEST_METHOD: `POST` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:19:44.916089 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3e8efa-85fa-4900-9029-d6da8228c083 None None] SCRIPT_NAME: `/identity` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:19:44.916089 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3e8efa-85fa-4900-9029-d6da8228c083 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:19:44.937688 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.auth.core [None req-9d3e8efa-85fa-4900-9029-d6da8228c083 None None] MFA Rules not processed for user `c198f91a4ae84d2b9cc730a6e304c2be`. Rule list: `[]` (Enabled: `True`). {{(pid=479851) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 09:19:44.938925 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.fernet_utils [None req-9d3e8efa-85fa-4900-9029-d6da8228c083 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=479851) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 09:19:45.001446 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG dbcounter [-] [479851] Writing DB stats keystone:SELECT=100 {{(pid=479851) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:19:45.025998 dv-cinder-851351-1-smb devstack@keystone.service[479851]: [pid: 479851|app: 0|req: 429/875] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 09:19:44 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 28 09:19:45.049075 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2bcc4ad-34fe-471c-b798-9763ec5c8cc1 None None] Authenticating user token {{(pid=479852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:19:45.155113 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2bcc4ad-34fe-471c-b798-9763ec5c8cc1 None None] Validating token access rules against request {{(pid=479852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:19:45.191193 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f06e60-131b-4165-86c5-2975279870a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:19:45.192701 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f06e60-131b-4165-86c5-2975279870a5 None admin] REQUEST_METHOD: `GET` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:19:45.193441 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f06e60-131b-4165-86c5-2975279870a5 None admin] SCRIPT_NAME: `/identity` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:19:45.194108 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f06e60-131b-4165-86c5-2975279870a5 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:19:45.199336 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG dbcounter [-] [479852] Writing DB stats keystone:SELECT=100 {{(pid=479852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:19:45.212281 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10f06e60-131b-4165-86c5-2975279870a5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 09:19:45.217489 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application [None req-10f06e60-131b-4165-86c5-2975279870a5 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 28 09:19:45.217489 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 09:19:45.217489 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 09:19:45.217489 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 09:19:45.217489 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 09:19:45.217489 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 09:19:45.217489 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 09:19:45.217489 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 09:19:45.217489 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 09:19:45.217489 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 09:19:45.217489 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 09:19:45.217489 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 09:19:45.217489 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 09:19:45.217489 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 09:19:45.217489 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 09:19:45.217489 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 09:19:45.218801 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 09:19:45.218801 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 09:19:45.218801 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 09:19:45.218801 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 09:19:45.218801 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 09:19:45.218801 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 09:19:45.218801 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 09:19:45.218801 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 09:19:45.218801 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 09:19:45.218801 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 09:19:45.218801 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 09:19:45.218801 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application with Lock( Jul 28 09:19:45.218801 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 09:19:45.218801 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self._enter() Jul 28 09:19:45.218801 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 09:19:45.218801 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 09:19:45.220277 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 09:19:45.220277 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self.creator() Jul 28 09:19:45.220277 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 09:19:45.220277 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application created_value = creator( Jul 28 09:19:45.220277 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 09:19:45.220277 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 09:19:45.220277 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 09:19:45.220277 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 09:19:45.220277 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 09:19:45.220277 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 09:19:45.220277 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 28 09:19:45.220277 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application Jul 28 09:19:45.220277 dv-cinder-851351-1-smb devstack@keystone.service[479852]: [pid: 479852|app: 0|req: 447/876] 10.222.0.42 () {56 vars in 1120 bytes} [Thu Jul 28 09:19:45 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 09:19:45.225244 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3e8efa-85fa-4900-9029-d6da8228c083 None None] Authenticating user token {{(pid=479851) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:19:45.349498 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3e8efa-85fa-4900-9029-d6da8228c083 None None] Validating token access rules against request {{(pid=479851) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:19:45.402300 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d26ce5-2d35-43ad-9654-79ee2ca54c0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479851) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:19:45.403370 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d26ce5-2d35-43ad-9654-79ee2ca54c0a None admin] REQUEST_METHOD: `GET` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:19:45.403880 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d26ce5-2d35-43ad-9654-79ee2ca54c0a None admin] SCRIPT_NAME: `/identity` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:19:45.404402 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d26ce5-2d35-43ad-9654-79ee2ca54c0a None admin] PATH_INFO: `/v3/roles` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:19:45.405481 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d26ce5-2d35-43ad-9654-79ee2ca54c0a None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=479851) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 09:19:45.406017 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d26ce5-2d35-43ad-9654-79ee2ca54c0a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:19:45.407669 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d26ce5-2d35-43ad-9654-79ee2ca54c0a None admin] RBAC: Authorization granted {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:19:45.417323 dv-cinder-851351-1-smb devstack@keystone.service[479851]: [pid: 479851|app: 0|req: 430/877] 10.222.0.42 () {56 vars in 1115 bytes} [Thu Jul 28 09:19:45 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:19:45.425791 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f06e60-131b-4165-86c5-2975279870a5 None admin] Authenticating user token {{(pid=479852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:19:45.531104 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f06e60-131b-4165-86c5-2975279870a5 None admin] Validating token access rules against request {{(pid=479852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:19:45.568352 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e7eace-c7c6-4e10-92c0-0242b43f9610 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:19:45.569071 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e7eace-c7c6-4e10-92c0-0242b43f9610 None admin] REQUEST_METHOD: `GET` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:19:45.569404 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e7eace-c7c6-4e10-92c0-0242b43f9610 None admin] SCRIPT_NAME: `/identity` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:19:45.569787 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e7eace-c7c6-4e10-92c0-0242b43f9610 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:19:45.582301 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27e7eace-c7c6-4e10-92c0-0242b43f9610 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:19:45.583864 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27e7eace-c7c6-4e10-92c0-0242b43f9610 None admin] RBAC: Authorization granted {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:19:45.600570 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application [None req-27e7eace-c7c6-4e10-92c0-0242b43f9610 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 09:19:45.600570 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 09:19:45.600570 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 09:19:45.600570 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 09:19:45.600570 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 09:19:45.600570 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 09:19:45.600570 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 09:19:45.600570 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 09:19:45.600570 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 09:19:45.600570 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 09:19:45.600570 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 09:19:45.600570 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 09:19:45.600570 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 09:19:45.600570 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 09:19:45.600570 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 09:19:45.601819 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 09:19:45.601819 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 09:19:45.601819 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 09:19:45.601819 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 09:19:45.601819 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 09:19:45.601819 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 09:19:45.601819 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 09:19:45.601819 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 09:19:45.601819 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application with Lock( Jul 28 09:19:45.601819 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 09:19:45.601819 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self._enter() Jul 28 09:19:45.601819 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 09:19:45.601819 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 09:19:45.601819 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 09:19:45.601819 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self.creator() Jul 28 09:19:45.601819 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 09:19:45.601819 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application created_value = creator( Jul 28 09:19:45.602861 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 09:19:45.602861 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 09:19:45.602861 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 09:19:45.602861 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application Jul 28 09:19:45.602861 dv-cinder-851351-1-smb devstack@keystone.service[479852]: [pid: 479852|app: 0|req: 448/878] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 09:19:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 09:19:45.608302 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d26ce5-2d35-43ad-9654-79ee2ca54c0a None admin] Authenticating user token {{(pid=479851) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:19:45.678053 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG dbcounter [-] [479851] Writing DB stats keystone:SELECT=100 {{(pid=479851) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:19:45.742733 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d26ce5-2d35-43ad-9654-79ee2ca54c0a None admin] Validating token access rules against request {{(pid=479851) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:19:45.780972 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62dd61e-503b-4ffa-8650-eb6e8d507581 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479851) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:19:45.782091 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62dd61e-503b-4ffa-8650-eb6e8d507581 None admin] REQUEST_METHOD: `GET` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:19:45.782604 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62dd61e-503b-4ffa-8650-eb6e8d507581 None admin] SCRIPT_NAME: `/identity` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:19:45.783112 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62dd61e-503b-4ffa-8650-eb6e8d507581 None admin] PATH_INFO: `/v3/domains` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:19:45.784063 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c62dd61e-503b-4ffa-8650-eb6e8d507581 None admin] RBAC: Adding query filter params (name=Default) {{(pid=479851) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 09:19:45.784601 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c62dd61e-503b-4ffa-8650-eb6e8d507581 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:19:45.786543 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c62dd61e-503b-4ffa-8650-eb6e8d507581 None admin] RBAC: Authorization granted {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:19:45.802470 dv-cinder-851351-1-smb devstack@keystone.service[479851]: [pid: 479851|app: 0|req: 431/879] 10.222.0.42 () {56 vars in 1109 bytes} [Thu Jul 28 09:19:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:19:45.808793 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e7eace-c7c6-4e10-92c0-0242b43f9610 None admin] Authenticating user token {{(pid=479852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:19:45.861774 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG dbcounter [-] [479852] Writing DB stats keystone:SELECT=100 {{(pid=479852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:19:45.917648 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e7eace-c7c6-4e10-92c0-0242b43f9610 None admin] Validating token access rules against request {{(pid=479852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:19:45.930571 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8faaad8f-c0de-47e6-94ef-6afd4606e5d1 None None] REQUEST_METHOD: `GET` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:19:45.931127 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8faaad8f-c0de-47e6-94ef-6afd4606e5d1 None None] SCRIPT_NAME: `/identity` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:19:45.931127 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8faaad8f-c0de-47e6-94ef-6afd4606e5d1 None None] PATH_INFO: `/` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:19:45.932594 dv-cinder-851351-1-smb devstack@keystone.service[479851]: [pid: 479851|app: 0|req: 432/880] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 09:19:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 09:19:45.941679 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20dbb7b-8b14-423f-a506-d74fab963c67 None None] REQUEST_METHOD: `POST` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:19:45.942400 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20dbb7b-8b14-423f-a506-d74fab963c67 None None] SCRIPT_NAME: `/identity` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:19:45.942910 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20dbb7b-8b14-423f-a506-d74fab963c67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:19:45.957025 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321d016a-613f-454d-a648-a8bb94cb2d27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:19:45.957780 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321d016a-613f-454d-a648-a8bb94cb2d27 None admin] REQUEST_METHOD: `GET` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:19:45.958068 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321d016a-613f-454d-a648-a8bb94cb2d27 None admin] SCRIPT_NAME: `/identity` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:19:45.958339 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321d016a-613f-454d-a648-a8bb94cb2d27 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:19:45.963778 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.auth.core [None req-a20dbb7b-8b14-423f-a506-d74fab963c67 None None] MFA Rules not processed for user `c198f91a4ae84d2b9cc730a6e304c2be`. Rule list: `[]` (Enabled: `True`). {{(pid=479851) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 09:19:45.965347 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.fernet_utils [None req-a20dbb7b-8b14-423f-a506-d74fab963c67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=479851) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 09:19:45.966655 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-321d016a-613f-454d-a648-a8bb94cb2d27 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:19:45.968110 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-321d016a-613f-454d-a648-a8bb94cb2d27 None admin] RBAC: Authorization granted {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:19:45.980365 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application [None req-321d016a-613f-454d-a648-a8bb94cb2d27 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 28 09:19:45.980365 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 09:19:45.980365 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 09:19:45.980365 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 09:19:45.980365 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 09:19:45.980365 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 09:19:45.980365 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 09:19:45.980365 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 09:19:45.980365 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 09:19:45.980365 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 09:19:45.980365 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 09:19:45.980365 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 09:19:45.980365 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 28 09:19:45.980365 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 28 09:19:45.980365 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 28 09:19:45.980365 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 28 09:19:45.981622 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 09:19:45.981622 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 09:19:45.981622 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 28 09:19:45.981622 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 09:19:45.981622 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 28 09:19:45.981622 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 09:19:45.981622 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 09:19:45.981622 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 09:19:45.981622 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 09:19:45.981622 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 09:19:45.981622 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 09:19:45.981622 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application with Lock( Jul 28 09:19:45.981622 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 09:19:45.981622 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self._enter() Jul 28 09:19:45.981622 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 09:19:45.981622 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 09:19:45.981622 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 09:19:45.981622 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self.creator() Jul 28 09:19:45.982777 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 09:19:45.982777 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application created_value = creator( Jul 28 09:19:45.982777 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 28 09:19:45.982777 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 28 09:19:45.982777 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 28 09:19:45.982777 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 28 09:19:45.982777 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 28 09:19:45.982777 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 28 09:19:45.982777 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 28 09:19:45.982777 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application Jul 28 09:19:45.982777 dv-cinder-851351-1-smb devstack@keystone.service[479852]: [pid: 479852|app: 0|req: 449/881] 10.222.0.42 () {56 vars in 1117 bytes} [Thu Jul 28 09:19:45 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 09:19:45.982777 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b23088-d272-487c-abd7-84527e31e28e None None] REQUEST_METHOD: `GET` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:19:45.983596 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b23088-d272-487c-abd7-84527e31e28e None None] SCRIPT_NAME: `/identity` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:19:45.983596 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b23088-d272-487c-abd7-84527e31e28e None None] PATH_INFO: `/` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:19:45.984788 dv-cinder-851351-1-smb devstack@keystone.service[479852]: [pid: 479852|app: 0|req: 450/882] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 09:19:45 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 09:19:45.988847 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b23088-d272-487c-abd7-84527e31e28e None None] Authenticating user token {{(pid=479852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:19:46.056842 dv-cinder-851351-1-smb devstack@keystone.service[479851]: [pid: 479851|app: 0|req: 433/883] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 09:19:45 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 28 09:19:46.058619 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d924930-1b59-4130-b6bb-d5d9be60863d None None] REQUEST_METHOD: `POST` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:19:46.059107 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d924930-1b59-4130-b6bb-d5d9be60863d None None] SCRIPT_NAME: `/identity` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:19:46.059397 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d924930-1b59-4130-b6bb-d5d9be60863d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:19:46.088019 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.auth.core [None req-1d924930-1b59-4130-b6bb-d5d9be60863d None None] MFA Rules not processed for user `c198f91a4ae84d2b9cc730a6e304c2be`. Rule list: `[]` (Enabled: `True`). {{(pid=479851) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 09:19:46.089277 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.fernet_utils [None req-1d924930-1b59-4130-b6bb-d5d9be60863d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=479851) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 09:19:46.103822 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b23088-d272-487c-abd7-84527e31e28e None None] Validating token access rules against request {{(pid=479852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:19:46.114004 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG dbcounter [-] [479852] Writing DB stats keystone:SELECT=100 {{(pid=479852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:19:46.118119 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG dbcounter [-] [479851] Writing DB stats keystone:SELECT=100 {{(pid=479851) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:19:46.146110 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a255163-7daa-4799-9be6-9aa4bfe5b005 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:19:46.146759 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a255163-7daa-4799-9be6-9aa4bfe5b005 None admin] REQUEST_METHOD: `GET` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:19:46.147105 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a255163-7daa-4799-9be6-9aa4bfe5b005 None admin] SCRIPT_NAME: `/identity` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:19:46.147427 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a255163-7daa-4799-9be6-9aa4bfe5b005 None admin] PATH_INFO: `/v3/users` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:19:46.148275 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a255163-7daa-4799-9be6-9aa4bfe5b005 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=479852) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 09:19:46.148727 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a255163-7daa-4799-9be6-9aa4bfe5b005 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:19:46.150326 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a255163-7daa-4799-9be6-9aa4bfe5b005 None admin] RBAC: Authorization granted {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:19:46.160020 dv-cinder-851351-1-smb devstack@keystone.service[479851]: [pid: 479851|app: 0|req: 434/884] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 09:19:46 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 09:19:46.160894 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d924930-1b59-4130-b6bb-d5d9be60863d None None] Authenticating user token {{(pid=479851) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:19:46.178800 dv-cinder-851351-1-smb devstack@keystone.service[479852]: [pid: 479852|app: 0|req: 451/885] 10.222.0.42 () {56 vars in 1149 bytes} [Thu Jul 28 09:19:45 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 09:19:46.182399 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a255163-7daa-4799-9be6-9aa4bfe5b005 None admin] Authenticating user token {{(pid=479852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:19:46.272263 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d924930-1b59-4130-b6bb-d5d9be60863d None None] Validating token access rules against request {{(pid=479851) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:19:46.291483 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a255163-7daa-4799-9be6-9aa4bfe5b005 None admin] Validating token access rules against request {{(pid=479852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:19:46.308499 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb49d2da-f972-4bbc-8b44-1218ca6699ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479851) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:19:46.309197 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb49d2da-f972-4bbc-8b44-1218ca6699ee None admin] REQUEST_METHOD: `GET` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:19:46.309489 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb49d2da-f972-4bbc-8b44-1218ca6699ee None admin] SCRIPT_NAME: `/identity` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:19:46.309767 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb49d2da-f972-4bbc-8b44-1218ca6699ee None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:19:46.310414 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb49d2da-f972-4bbc-8b44-1218ca6699ee None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:19:46.311832 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb49d2da-f972-4bbc-8b44-1218ca6699ee None admin] RBAC: Authorization granted {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:19:46.321835 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application [None req-eb49d2da-f972-4bbc-8b44-1218ca6699ee None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 28 09:19:46.321835 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 09:19:46.321835 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 28 09:19:46.321835 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 28 09:19:46.321835 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 28 09:19:46.321835 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 28 09:19:46.321835 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 28 09:19:46.321835 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 09:19:46.321835 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 28 09:19:46.321835 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application Jul 28 09:19:46.321835 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 28 09:19:46.321835 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application Jul 28 09:19:46.321835 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 09:19:46.321835 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 09:19:46.321835 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 09:19:46.321835 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 09:19:46.321835 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 09:19:46.323266 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 09:19:46.323266 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 09:19:46.323266 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 09:19:46.323266 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 09:19:46.323266 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 09:19:46.323266 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 09:19:46.323266 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 28 09:19:46.323266 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 28 09:19:46.323266 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 28 09:19:46.323266 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 28 09:19:46.323266 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 09:19:46.323266 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 09:19:46.323266 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 09:19:46.323266 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 09:19:46.323266 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 09:19:46.323266 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 09:19:46.324263 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 09:19:46.324263 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application with Lock( Jul 28 09:19:46.324263 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 09:19:46.324263 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return self._enter() Jul 28 09:19:46.324263 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 09:19:46.324263 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 09:19:46.324263 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 09:19:46.324263 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return self.creator() Jul 28 09:19:46.324263 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 09:19:46.324263 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application created_value = creator( Jul 28 09:19:46.324263 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 28 09:19:46.324263 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 09:19:46.324263 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 28 09:19:46.324263 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application Jul 28 09:19:46.324263 dv-cinder-851351-1-smb devstack@keystone.service[479851]: [pid: 479851|app: 0|req: 435/886] 10.222.0.42 () {56 vars in 1114 bytes} [Thu Jul 28 09:19:46 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 09:19:46.326038 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb49d2da-f972-4bbc-8b44-1218ca6699ee None admin] Authenticating user token {{(pid=479851) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:19:46.328964 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f526db-1d64-4daf-8faa-be3ae65ca7ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:19:46.329638 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f526db-1d64-4daf-8faa-be3ae65ca7ac None admin] REQUEST_METHOD: `POST` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:19:46.329925 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f526db-1d64-4daf-8faa-be3ae65ca7ac None admin] SCRIPT_NAME: `/identity` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:19:46.330199 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f526db-1d64-4daf-8faa-be3ae65ca7ac None admin] PATH_INFO: `/v3/services` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:19:46.330919 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7f526db-1d64-4daf-8faa-be3ae65ca7ac None admin] RBAC: Authorizing `identity:create_service()` {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:19:46.332400 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7f526db-1d64-4daf-8faa-be3ae65ca7ac None admin] RBAC: Authorization granted {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:19:46.348654 dv-cinder-851351-1-smb devstack@keystone.service[479852]: [pid: 479852|app: 0|req: 452/887] 10.222.0.42 () {60 vars in 1141 bytes} [Thu Jul 28 09:19:46 2022] POST /identity/v3/services => generated 269 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 28 09:19:46.350315 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a5059e-dd30-4dfe-a16c-480ca6a10080 None None] REQUEST_METHOD: `GET` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:19:46.350605 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a5059e-dd30-4dfe-a16c-480ca6a10080 None None] SCRIPT_NAME: `/identity` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:19:46.350864 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a5059e-dd30-4dfe-a16c-480ca6a10080 None None] PATH_INFO: `/` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:19:46.352138 dv-cinder-851351-1-smb devstack@keystone.service[479852]: [pid: 479852|app: 0|req: 453/888] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 09:19:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 09:19:46.352901 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a5059e-dd30-4dfe-a16c-480ca6a10080 None None] Authenticating user token {{(pid=479852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:19:46.366728 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG dbcounter [-] [479851] Writing DB stats keystone:SELECT=100 {{(pid=479851) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:19:46.415635 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG dbcounter [-] [479852] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=479852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:19:46.459241 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb49d2da-f972-4bbc-8b44-1218ca6699ee None admin] Validating token access rules against request {{(pid=479851) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:19:46.516299 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a5059e-dd30-4dfe-a16c-480ca6a10080 None None] Validating token access rules against request {{(pid=479852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:19:46.525329 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6183f00-7bcc-45ba-b6cf-76f82940f5f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479851) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:19:46.526066 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6183f00-7bcc-45ba-b6cf-76f82940f5f8 None admin] REQUEST_METHOD: `GET` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:19:46.526571 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6183f00-7bcc-45ba-b6cf-76f82940f5f8 None admin] SCRIPT_NAME: `/identity` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:19:46.527514 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6183f00-7bcc-45ba-b6cf-76f82940f5f8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:19:46.562560 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e81050-2602-4f27-a499-306b83123aeb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:19:46.563200 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e81050-2602-4f27-a499-306b83123aeb None admin] REQUEST_METHOD: `GET` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:19:46.563476 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e81050-2602-4f27-a499-306b83123aeb None admin] SCRIPT_NAME: `/identity` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:19:46.563750 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e81050-2602-4f27-a499-306b83123aeb None admin] PATH_INFO: `/v3/services` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:19:46.564449 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71e81050-2602-4f27-a499-306b83123aeb None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=479852) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 09:19:46.564798 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71e81050-2602-4f27-a499-306b83123aeb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:19:46.566187 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71e81050-2602-4f27-a499-306b83123aeb None admin] RBAC: Authorization granted {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:19:46.572522 dv-cinder-851351-1-smb devstack@keystone.service[479852]: [pid: 479852|app: 0|req: 454/889] 10.222.0.42 () {56 vars in 1114 bytes} [Thu Jul 28 09:19:46 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:19:46.573967 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ad6db0-8b15-40f5-a488-cd0bd7187c04 None None] REQUEST_METHOD: `POST` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:19:46.574257 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ad6db0-8b15-40f5-a488-cd0bd7187c04 None None] SCRIPT_NAME: `/identity` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:19:46.574531 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ad6db0-8b15-40f5-a488-cd0bd7187c04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:19:46.596419 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.auth.core [None req-08ad6db0-8b15-40f5-a488-cd0bd7187c04 None None] MFA Rules not processed for user `c198f91a4ae84d2b9cc730a6e304c2be`. Rule list: `[]` (Enabled: `True`). {{(pid=479852) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 09:19:46.597704 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.fernet_utils [None req-08ad6db0-8b15-40f5-a488-cd0bd7187c04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=479852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 09:19:46.625431 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6183f00-7bcc-45ba-b6cf-76f82940f5f8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:19:46.626980 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6183f00-7bcc-45ba-b6cf-76f82940f5f8 None admin] RBAC: Authorization granted {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:19:46.660490 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG dbcounter [-] [479851] Writing DB stats keystone:SELECT=100 {{(pid=479851) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:19:46.676111 dv-cinder-851351-1-smb devstack@keystone.service[479852]: [pid: 479852|app: 0|req: 455/890] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 09:19:46 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 09:19:46.677271 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ad6db0-8b15-40f5-a488-cd0bd7187c04 None None] Authenticating user token {{(pid=479852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:19:46.701068 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG dbcounter [-] [479852] Writing DB stats keystone:SELECT=100 {{(pid=479852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:19:46.757646 dv-cinder-851351-1-smb devstack@keystone.service[479851]: [pid: 479851|app: 0|req: 436/891] 10.222.0.42 () {58 vars in 1282 bytes} [Thu Jul 28 09:19:46 2022] GET /identity/v3/auth/tokens => generated 1362 bytes in 429 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 28 09:19:46.757646 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6183f00-7bcc-45ba-b6cf-76f82940f5f8 None admin] Authenticating user token {{(pid=479851) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:19:46.789327 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ad6db0-8b15-40f5-a488-cd0bd7187c04 None None] Validating token access rules against request {{(pid=479852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:19:46.830232 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fab7252-ed57-46e5-afc0-283f964bd70d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:19:46.830883 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fab7252-ed57-46e5-afc0-283f964bd70d None admin] REQUEST_METHOD: `GET` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:19:46.831168 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fab7252-ed57-46e5-afc0-283f964bd70d None admin] SCRIPT_NAME: `/identity` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:19:46.831443 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fab7252-ed57-46e5-afc0-283f964bd70d None admin] PATH_INFO: `/v3/services` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:19:46.832135 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fab7252-ed57-46e5-afc0-283f964bd70d None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=479852) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 09:19:46.832442 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fab7252-ed57-46e5-afc0-283f964bd70d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:19:46.833972 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fab7252-ed57-46e5-afc0-283f964bd70d None admin] RBAC: Authorization granted {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:19:46.839390 dv-cinder-851351-1-smb devstack@keystone.service[479852]: [pid: 479852|app: 0|req: 456/892] 10.222.0.42 () {56 vars in 1114 bytes} [Thu Jul 28 09:19:46 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:19:46.840233 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fab7252-ed57-46e5-afc0-283f964bd70d None admin] Authenticating user token {{(pid=479852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:19:46.881759 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6183f00-7bcc-45ba-b6cf-76f82940f5f8 None admin] Validating token access rules against request {{(pid=479851) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:19:46.915705 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG dbcounter [-] [479851] Writing DB stats keystone:SELECT=100 {{(pid=479851) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:19:46.925835 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a064b770-07d0-489f-87d0-5d01fc3f6e31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479851) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:19:46.926654 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a064b770-07d0-489f-87d0-5d01fc3f6e31 None admin] REQUEST_METHOD: `GET` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:19:46.926950 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a064b770-07d0-489f-87d0-5d01fc3f6e31 None admin] SCRIPT_NAME: `/identity` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:19:46.927245 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a064b770-07d0-489f-87d0-5d01fc3f6e31 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:19:46.927896 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a064b770-07d0-489f-87d0-5d01fc3f6e31 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:19:46.929478 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a064b770-07d0-489f-87d0-5d01fc3f6e31 None admin] RBAC: Authorization granted {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:19:46.932820 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG dbcounter [-] [479852] Writing DB stats keystone:SELECT=100 {{(pid=479852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:19:46.940516 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application [None req-a064b770-07d0-489f-87d0-5d01fc3f6e31 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 28 09:19:46.940516 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 09:19:46.940516 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 28 09:19:46.940516 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 28 09:19:46.940516 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 28 09:19:46.940516 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 28 09:19:46.940516 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 28 09:19:46.940516 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 09:19:46.940516 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 28 09:19:46.940516 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application Jul 28 09:19:46.940516 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 28 09:19:46.940516 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application Jul 28 09:19:46.940516 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 09:19:46.940516 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 09:19:46.940516 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 09:19:46.940516 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 09:19:46.940516 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 09:19:46.942277 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 09:19:46.942277 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 09:19:46.942277 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 09:19:46.942277 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 09:19:46.942277 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 09:19:46.942277 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 09:19:46.942277 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 28 09:19:46.942277 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 28 09:19:46.942277 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 28 09:19:46.942277 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 28 09:19:46.942277 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 09:19:46.942277 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 09:19:46.942277 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 09:19:46.942277 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 09:19:46.942277 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 09:19:46.942277 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 09:19:46.943592 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 09:19:46.943592 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application with Lock( Jul 28 09:19:46.943592 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 09:19:46.943592 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return self._enter() Jul 28 09:19:46.943592 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 09:19:46.943592 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 09:19:46.943592 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 09:19:46.943592 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return self.creator() Jul 28 09:19:46.943592 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 09:19:46.943592 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application created_value = creator( Jul 28 09:19:46.943592 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 28 09:19:46.943592 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 09:19:46.943592 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 28 09:19:46.943592 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application Jul 28 09:19:46.943592 dv-cinder-851351-1-smb devstack@keystone.service[479851]: [pid: 479851|app: 0|req: 437/893] 10.222.0.42 () {56 vars in 1126 bytes} [Thu Jul 28 09:19:46 2022] GET /identity/v3/services/object-store => generated 93 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 09:19:46.944596 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a064b770-07d0-489f-87d0-5d01fc3f6e31 None admin] Authenticating user token {{(pid=479851) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:19:46.960559 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fab7252-ed57-46e5-afc0-283f964bd70d None admin] Validating token access rules against request {{(pid=479852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:19:47.002277 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b51ba0a-4377-4fff-80fc-7a3124b85b69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:19:47.002937 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b51ba0a-4377-4fff-80fc-7a3124b85b69 None admin] REQUEST_METHOD: `GET` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:19:47.003222 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b51ba0a-4377-4fff-80fc-7a3124b85b69 None admin] SCRIPT_NAME: `/identity` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:19:47.003502 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b51ba0a-4377-4fff-80fc-7a3124b85b69 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:19:47.015297 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b51ba0a-4377-4fff-80fc-7a3124b85b69 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:19:47.016759 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b51ba0a-4377-4fff-80fc-7a3124b85b69 None admin] RBAC: Authorization granted {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:19:47.034565 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application [None req-4b51ba0a-4377-4fff-80fc-7a3124b85b69 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 09:19:47.034565 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 09:19:47.034565 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 09:19:47.034565 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 09:19:47.034565 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 09:19:47.034565 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 09:19:47.034565 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 09:19:47.034565 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 09:19:47.034565 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 09:19:47.034565 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 09:19:47.034565 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 09:19:47.034565 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 09:19:47.034565 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 09:19:47.034565 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 09:19:47.034565 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 09:19:47.035943 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 09:19:47.035943 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 09:19:47.035943 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 09:19:47.035943 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 09:19:47.035943 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 09:19:47.035943 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 09:19:47.035943 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 09:19:47.035943 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 09:19:47.035943 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application with Lock( Jul 28 09:19:47.035943 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 09:19:47.035943 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self._enter() Jul 28 09:19:47.035943 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 09:19:47.035943 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 09:19:47.035943 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 09:19:47.035943 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self.creator() Jul 28 09:19:47.035943 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 09:19:47.035943 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application created_value = creator( Jul 28 09:19:47.042110 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 09:19:47.042110 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 09:19:47.042110 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 09:19:47.042110 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application Jul 28 09:19:47.042110 dv-cinder-851351-1-smb devstack@keystone.service[479852]: [pid: 479852|app: 0|req: 457/894] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 09:19:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 09:19:47.042110 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b51ba0a-4377-4fff-80fc-7a3124b85b69 None admin] Authenticating user token {{(pid=479852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:19:47.065704 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a064b770-07d0-489f-87d0-5d01fc3f6e31 None admin] Validating token access rules against request {{(pid=479851) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:19:47.109689 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b01368-9213-4c85-a12c-351eb68d49d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479851) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:19:47.110722 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b01368-9213-4c85-a12c-351eb68d49d7 None admin] REQUEST_METHOD: `GET` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:19:47.111175 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b01368-9213-4c85-a12c-351eb68d49d7 None admin] SCRIPT_NAME: `/identity` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:19:47.111605 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b01368-9213-4c85-a12c-351eb68d49d7 None admin] PATH_INFO: `/v3/endpoints` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:19:47.112972 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b01368-9213-4c85-a12c-351eb68d49d7 None admin] RBAC: Adding query filter params (interface=public, service_id=5203334144bb4dd798a26eaf54d56292, region_id=RegionOne) {{(pid=479851) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 09:19:47.113514 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b01368-9213-4c85-a12c-351eb68d49d7 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:19:47.115692 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b01368-9213-4c85-a12c-351eb68d49d7 None admin] RBAC: Authorization granted {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:19:47.122447 dv-cinder-851351-1-smb devstack@keystone.service[479851]: [pid: 479851|app: 0|req: 438/895] 10.222.0.42 () {56 vars in 1251 bytes} [Thu Jul 28 09:19:46 2022] GET /identity/v3/endpoints?service_id=5203334144bb4dd798a26eaf54d56292&interface=public®ion_id=RegionOne => generated 194 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:19:47.123831 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b01368-9213-4c85-a12c-351eb68d49d7 None admin] Authenticating user token {{(pid=479851) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:19:47.178860 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b51ba0a-4377-4fff-80fc-7a3124b85b69 None admin] Validating token access rules against request {{(pid=479852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:19:47.192454 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG dbcounter [-] [479851] Writing DB stats keystone:SELECT=100 {{(pid=479851) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:19:47.211881 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG dbcounter [-] [479852] Writing DB stats keystone:SELECT=100 {{(pid=479852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:19:47.217845 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279b4b3c-6851-47e7-9b9b-bba31bb3bb7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:19:47.218504 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279b4b3c-6851-47e7-9b9b-bba31bb3bb7a None admin] REQUEST_METHOD: `GET` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:19:47.218789 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279b4b3c-6851-47e7-9b9b-bba31bb3bb7a None admin] SCRIPT_NAME: `/identity` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:19:47.219095 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279b4b3c-6851-47e7-9b9b-bba31bb3bb7a None admin] PATH_INFO: `/v3/services` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:19:47.219882 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-279b4b3c-6851-47e7-9b9b-bba31bb3bb7a None admin] RBAC: Adding query filter params (name=object-store) {{(pid=479852) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 09:19:47.220326 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-279b4b3c-6851-47e7-9b9b-bba31bb3bb7a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:19:47.222090 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-279b4b3c-6851-47e7-9b9b-bba31bb3bb7a None admin] RBAC: Authorization granted {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:19:47.230055 dv-cinder-851351-1-smb devstack@keystone.service[479852]: [pid: 479852|app: 0|req: 458/896] 10.222.0.42 () {56 vars in 1122 bytes} [Thu Jul 28 09:19:47 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:19:47.237058 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279b4b3c-6851-47e7-9b9b-bba31bb3bb7a None admin] Authenticating user token {{(pid=479852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:19:47.243157 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b01368-9213-4c85-a12c-351eb68d49d7 None admin] Validating token access rules against request {{(pid=479851) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:19:47.281159 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1768479-84b9-478c-b2af-0f09b3dc1785 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479851) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:19:47.281710 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1768479-84b9-478c-b2af-0f09b3dc1785 None admin] REQUEST_METHOD: `GET` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:19:47.281994 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1768479-84b9-478c-b2af-0f09b3dc1785 None admin] SCRIPT_NAME: `/identity` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:19:47.282270 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1768479-84b9-478c-b2af-0f09b3dc1785 None admin] PATH_INFO: `/v3/domains` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:19:47.282985 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1768479-84b9-478c-b2af-0f09b3dc1785 None admin] RBAC: Adding query filter params (name=Default) {{(pid=479851) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 09:19:47.283298 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1768479-84b9-478c-b2af-0f09b3dc1785 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:19:47.284735 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1768479-84b9-478c-b2af-0f09b3dc1785 None admin] RBAC: Authorization granted {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:19:47.306449 dv-cinder-851351-1-smb devstack@keystone.service[479851]: [pid: 479851|app: 0|req: 439/897] 10.222.0.42 () {56 vars in 1109 bytes} [Thu Jul 28 09:19:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:19:47.306449 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1768479-84b9-478c-b2af-0f09b3dc1785 None admin] Authenticating user token {{(pid=479851) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:19:47.394938 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279b4b3c-6851-47e7-9b9b-bba31bb3bb7a None admin] Validating token access rules against request {{(pid=479852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:19:47.438707 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1768479-84b9-478c-b2af-0f09b3dc1785 None admin] Validating token access rules against request {{(pid=479851) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:19:47.439122 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a362f55-9d05-4fec-be12-9960c49fbb09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:19:47.439917 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a362f55-9d05-4fec-be12-9960c49fbb09 None admin] REQUEST_METHOD: `GET` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:19:47.440234 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a362f55-9d05-4fec-be12-9960c49fbb09 None admin] SCRIPT_NAME: `/identity` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:19:47.440833 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a362f55-9d05-4fec-be12-9960c49fbb09 None admin] PATH_INFO: `/v3/services` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:19:47.441664 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a362f55-9d05-4fec-be12-9960c49fbb09 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:19:47.443935 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a362f55-9d05-4fec-be12-9960c49fbb09 None admin] RBAC: Authorization granted {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:19:47.454920 dv-cinder-851351-1-smb devstack@keystone.service[479852]: [pid: 479852|app: 0|req: 459/898] 10.222.0.42 () {56 vars in 1087 bytes} [Thu Jul 28 09:19:47 2022] GET /identity/v3/services => generated 1268 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 09:19:47.457016 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a362f55-9d05-4fec-be12-9960c49fbb09 None admin] Authenticating user token {{(pid=479852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:19:47.466094 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG dbcounter [-] [479851] Writing DB stats keystone:SELECT=100 {{(pid=479851) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:19:47.495201 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccad22fc-db4b-4a70-8e91-21bd9399ed40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479851) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:19:47.497035 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccad22fc-db4b-4a70-8e91-21bd9399ed40 None admin] REQUEST_METHOD: `GET` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:19:47.497652 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccad22fc-db4b-4a70-8e91-21bd9399ed40 None admin] SCRIPT_NAME: `/identity` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:19:47.498418 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccad22fc-db4b-4a70-8e91-21bd9399ed40 None admin] PATH_INFO: `/v3/services` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:19:47.499335 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccad22fc-db4b-4a70-8e91-21bd9399ed40 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=479851) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 09:19:47.500019 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccad22fc-db4b-4a70-8e91-21bd9399ed40 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:19:47.502587 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccad22fc-db4b-4a70-8e91-21bd9399ed40 None admin] RBAC: Authorization granted {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:19:47.511059 dv-cinder-851351-1-smb devstack@keystone.service[479851]: [pid: 479851|app: 0|req: 440/899] 10.222.0.42 () {56 vars in 1122 bytes} [Thu Jul 28 09:19:47 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:19:47.569590 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG dbcounter [-] [479852] Writing DB stats keystone:SELECT=100 {{(pid=479852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:19:47.639909 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a362f55-9d05-4fec-be12-9960c49fbb09 None admin] Validating token access rules against request {{(pid=479852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:19:47.686984 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835eb910-b7e8-45d3-80bb-3fe9c90461c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:19:47.687738 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835eb910-b7e8-45d3-80bb-3fe9c90461c0 None admin] REQUEST_METHOD: `GET` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:19:47.688026 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835eb910-b7e8-45d3-80bb-3fe9c90461c0 None admin] SCRIPT_NAME: `/identity` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:19:47.688295 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835eb910-b7e8-45d3-80bb-3fe9c90461c0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:19:47.697602 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-835eb910-b7e8-45d3-80bb-3fe9c90461c0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:19:47.699173 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-835eb910-b7e8-45d3-80bb-3fe9c90461c0 None admin] RBAC: Authorization granted {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:19:47.712195 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application [None req-835eb910-b7e8-45d3-80bb-3fe9c90461c0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 09:19:47.712195 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 09:19:47.712195 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 09:19:47.712195 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 09:19:47.712195 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 09:19:47.712195 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 09:19:47.712195 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 09:19:47.712195 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 09:19:47.712195 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 09:19:47.712195 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 09:19:47.712195 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 09:19:47.712195 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 09:19:47.712195 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 28 09:19:47.712195 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 28 09:19:47.712195 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 28 09:19:47.713601 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 28 09:19:47.713601 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 09:19:47.713601 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 09:19:47.713601 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 09:19:47.713601 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 09:19:47.713601 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 09:19:47.713601 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 09:19:47.713601 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 09:19:47.713601 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application with Lock( Jul 28 09:19:47.713601 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 09:19:47.713601 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self._enter() Jul 28 09:19:47.713601 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 09:19:47.713601 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 09:19:47.713601 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 09:19:47.713601 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self.creator() Jul 28 09:19:47.713601 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 09:19:47.713601 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application created_value = creator( Jul 28 09:19:47.714778 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 28 09:19:47.714778 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 28 09:19:47.714778 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 28 09:19:47.714778 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 28 09:19:47.714778 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 28 09:19:47.714778 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 28 09:19:47.714778 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 09:19:47.714778 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application Jul 28 09:19:47.714778 dv-cinder-851351-1-smb devstack@keystone.service[479852]: [pid: 479852|app: 0|req: 460/900] 10.222.0.42 () {56 vars in 1111 bytes} [Thu Jul 28 09:19:47 2022] GET /identity/v3/projects/service => generated 88 bytes in 258 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 09:19:47.719858 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccad22fc-db4b-4a70-8e91-21bd9399ed40 None admin] Authenticating user token {{(pid=479851) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:19:47.844140 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccad22fc-db4b-4a70-8e91-21bd9399ed40 None admin] Validating token access rules against request {{(pid=479851) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:19:47.882517 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-847a98b0-3fe5-4fab-9834-791e4b1a0754 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479851) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:19:47.883570 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847a98b0-3fe5-4fab-9834-791e4b1a0754 None admin] REQUEST_METHOD: `GET` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:19:47.884081 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847a98b0-3fe5-4fab-9834-791e4b1a0754 None admin] SCRIPT_NAME: `/identity` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:19:47.884593 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847a98b0-3fe5-4fab-9834-791e4b1a0754 None admin] PATH_INFO: `/v3/projects` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:19:47.885842 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-847a98b0-3fe5-4fab-9834-791e4b1a0754 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=479851) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 09:19:47.886379 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-847a98b0-3fe5-4fab-9834-791e4b1a0754 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:19:47.888280 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-847a98b0-3fe5-4fab-9834-791e4b1a0754 None admin] RBAC: Authorization granted {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:19:47.902493 dv-cinder-851351-1-smb devstack@keystone.service[479851]: [pid: 479851|app: 0|req: 441/901] 10.222.0.42 () {56 vars in 1148 bytes} [Thu Jul 28 09:19:47 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:19:47.908349 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835eb910-b7e8-45d3-80bb-3fe9c90461c0 None admin] Authenticating user token {{(pid=479852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:19:48.022051 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835eb910-b7e8-45d3-80bb-3fe9c90461c0 None admin] Validating token access rules against request {{(pid=479852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:19:48.045491 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG dbcounter [-] [479852] Writing DB stats keystone:SELECT=100 {{(pid=479852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:19:48.063869 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6579d72a-72b5-4102-b7e2-fdcee2ad688d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:19:48.064543 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6579d72a-72b5-4102-b7e2-fdcee2ad688d None admin] REQUEST_METHOD: `GET` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:19:48.064869 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6579d72a-72b5-4102-b7e2-fdcee2ad688d None admin] SCRIPT_NAME: `/identity` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:19:48.065150 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6579d72a-72b5-4102-b7e2-fdcee2ad688d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:19:48.065984 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6579d72a-72b5-4102-b7e2-fdcee2ad688d None admin] RBAC: Adding query filter params (role.id=4a0748cb7fbb416eb81203fd028beb9a, scope.project.id=3a0fb8ea8010437bade8f92dcbcaacee, user.id=87596a91a45f4326855265497fe69b65) {{(pid=479852) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 09:19:48.066303 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6579d72a-72b5-4102-b7e2-fdcee2ad688d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:19:48.067926 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6579d72a-72b5-4102-b7e2-fdcee2ad688d None admin] RBAC: Authorization granted {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:19:48.075654 dv-cinder-851351-1-smb devstack@keystone.service[479852]: [pid: 479852|app: 0|req: 461/902] 10.222.0.42 () {56 vars in 1374 bytes} [Thu Jul 28 09:19:47 2022] GET /identity/v3/role_assignments?user.id=87596a91a45f4326855265497fe69b65&scope.project.id=3a0fb8ea8010437bade8f92dcbcaacee&role.id=4a0748cb7fbb416eb81203fd028beb9a => generated 259 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:19:48.575394 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc2445b-d875-4a6e-8c20-4665a0330c44 None None] REQUEST_METHOD: `GET` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:19:48.575975 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc2445b-d875-4a6e-8c20-4665a0330c44 None None] SCRIPT_NAME: `/identity` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:19:48.575975 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc2445b-d875-4a6e-8c20-4665a0330c44 None None] PATH_INFO: `/` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:19:48.577489 dv-cinder-851351-1-smb devstack@keystone.service[479851]: [pid: 479851|app: 0|req: 442/903] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 09:19:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 09:19:48.583136 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58087eaa-6719-4d5d-90b1-7e7fb5fb4760 None None] REQUEST_METHOD: `POST` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:19:48.583780 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58087eaa-6719-4d5d-90b1-7e7fb5fb4760 None None] SCRIPT_NAME: `/identity` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:19:48.584274 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58087eaa-6719-4d5d-90b1-7e7fb5fb4760 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:19:48.603476 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.auth.core [None req-58087eaa-6719-4d5d-90b1-7e7fb5fb4760 None None] MFA Rules not processed for user `c198f91a4ae84d2b9cc730a6e304c2be`. Rule list: `[]` (Enabled: `True`). {{(pid=479852) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 09:19:48.604724 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.fernet_utils [None req-58087eaa-6719-4d5d-90b1-7e7fb5fb4760 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=479852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 09:19:48.677934 dv-cinder-851351-1-smb devstack@keystone.service[479852]: [pid: 479852|app: 0|req: 462/904] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 09:19:48 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 09:19:48.702154 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc2445b-d875-4a6e-8c20-4665a0330c44 None None] Authenticating user token {{(pid=479851) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:19:48.752297 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG dbcounter [-] [479851] Writing DB stats keystone:SELECT=100 {{(pid=479851) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:19:48.817270 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc2445b-d875-4a6e-8c20-4665a0330c44 None None] Validating token access rules against request {{(pid=479851) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:19:48.854017 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d7e1f8f-87ad-4f5b-86be-1c3e70fc4751 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479851) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:19:48.854688 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7e1f8f-87ad-4f5b-86be-1c3e70fc4751 None admin] REQUEST_METHOD: `GET` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:19:48.854977 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7e1f8f-87ad-4f5b-86be-1c3e70fc4751 None admin] SCRIPT_NAME: `/identity` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:19:48.855269 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7e1f8f-87ad-4f5b-86be-1c3e70fc4751 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:19:48.855916 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d7e1f8f-87ad-4f5b-86be-1c3e70fc4751 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:19:48.857340 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d7e1f8f-87ad-4f5b-86be-1c3e70fc4751 None admin] RBAC: Authorization granted {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:19:48.866748 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application [None req-6d7e1f8f-87ad-4f5b-86be-1c3e70fc4751 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 28 09:19:48.866748 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 09:19:48.866748 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 28 09:19:48.866748 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 28 09:19:48.866748 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 28 09:19:48.866748 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 28 09:19:48.866748 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 28 09:19:48.866748 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 09:19:48.866748 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 28 09:19:48.866748 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application Jul 28 09:19:48.866748 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 28 09:19:48.866748 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application Jul 28 09:19:48.866748 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 09:19:48.866748 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 09:19:48.866748 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 09:19:48.866748 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 09:19:48.867851 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 09:19:48.867851 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 09:19:48.867851 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 09:19:48.867851 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 09:19:48.867851 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 09:19:48.867851 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 09:19:48.867851 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 09:19:48.867851 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 28 09:19:48.867851 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 28 09:19:48.867851 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 28 09:19:48.867851 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 28 09:19:48.867851 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 09:19:48.867851 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 09:19:48.867851 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 09:19:48.867851 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 09:19:48.867851 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 09:19:48.868876 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 09:19:48.868876 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 09:19:48.868876 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application with Lock( Jul 28 09:19:48.868876 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 09:19:48.868876 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return self._enter() Jul 28 09:19:48.868876 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 09:19:48.868876 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 09:19:48.868876 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 09:19:48.868876 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return self.creator() Jul 28 09:19:48.868876 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 09:19:48.868876 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application created_value = creator( Jul 28 09:19:48.868876 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 28 09:19:48.868876 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 09:19:48.868876 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 28 09:19:48.868876 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application Jul 28 09:19:48.868876 dv-cinder-851351-1-smb devstack@keystone.service[479851]: [pid: 479851|app: 0|req: 443/905] 10.222.0.42 () {56 vars in 1132 bytes} [Thu Jul 28 09:19:48 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 09:19:48.876592 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58087eaa-6719-4d5d-90b1-7e7fb5fb4760 None None] Authenticating user token {{(pid=479852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:19:49.017415 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58087eaa-6719-4d5d-90b1-7e7fb5fb4760 None None] Validating token access rules against request {{(pid=479852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:19:49.044567 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG dbcounter [-] [479852] Writing DB stats keystone:SELECT=100 {{(pid=479852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:19:49.077194 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63945e23-ec59-4ccb-a65d-0b4ea8337cfb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:19:49.078248 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63945e23-ec59-4ccb-a65d-0b4ea8337cfb None admin] REQUEST_METHOD: `GET` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:19:49.078755 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63945e23-ec59-4ccb-a65d-0b4ea8337cfb None admin] SCRIPT_NAME: `/identity` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:19:49.079273 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63945e23-ec59-4ccb-a65d-0b4ea8337cfb None admin] PATH_INFO: `/v3/services` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:19:49.080184 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63945e23-ec59-4ccb-a65d-0b4ea8337cfb None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=479852) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 09:19:49.080735 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63945e23-ec59-4ccb-a65d-0b4ea8337cfb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:19:49.082476 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63945e23-ec59-4ccb-a65d-0b4ea8337cfb None admin] RBAC: Authorization granted {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:19:49.088598 dv-cinder-851351-1-smb devstack@keystone.service[479852]: [pid: 479852|app: 0|req: 463/906] 10.222.0.42 () {56 vars in 1126 bytes} [Thu Jul 28 09:19:48 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:19:49.094817 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d7e1f8f-87ad-4f5b-86be-1c3e70fc4751 None admin] Authenticating user token {{(pid=479851) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:19:49.208288 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d7e1f8f-87ad-4f5b-86be-1c3e70fc4751 None admin] Validating token access rules against request {{(pid=479851) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:19:49.210860 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG dbcounter [-] [479851] Writing DB stats keystone:SELECT=100 {{(pid=479851) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:19:49.247430 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c9ad4d-eefc-49de-a94a-067abf8a85ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479851) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:19:49.248094 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c9ad4d-eefc-49de-a94a-067abf8a85ee None admin] REQUEST_METHOD: `GET` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:19:49.248381 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c9ad4d-eefc-49de-a94a-067abf8a85ee None admin] SCRIPT_NAME: `/identity` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:19:49.248680 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c9ad4d-eefc-49de-a94a-067abf8a85ee None admin] PATH_INFO: `/v3/services` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:19:49.249404 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94c9ad4d-eefc-49de-a94a-067abf8a85ee None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=479851) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 09:19:49.249716 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94c9ad4d-eefc-49de-a94a-067abf8a85ee None admin] RBAC: Authorizing `identity:list_services()` {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:19:49.251141 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94c9ad4d-eefc-49de-a94a-067abf8a85ee None admin] RBAC: Authorization granted {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:19:49.257476 dv-cinder-851351-1-smb devstack@keystone.service[479851]: [pid: 479851|app: 0|req: 444/907] 10.222.0.42 () {56 vars in 1126 bytes} [Thu Jul 28 09:19:49 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:19:49.263559 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63945e23-ec59-4ccb-a65d-0b4ea8337cfb None admin] Authenticating user token {{(pid=479852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:19:49.376857 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63945e23-ec59-4ccb-a65d-0b4ea8337cfb None admin] Validating token access rules against request {{(pid=479852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:19:49.419395 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df07fe52-8c1b-4cdf-86d6-0a8067ceba82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:19:49.420457 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df07fe52-8c1b-4cdf-86d6-0a8067ceba82 None admin] REQUEST_METHOD: `GET` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:19:49.421005 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df07fe52-8c1b-4cdf-86d6-0a8067ceba82 None admin] SCRIPT_NAME: `/identity` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:19:49.421720 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df07fe52-8c1b-4cdf-86d6-0a8067ceba82 None admin] PATH_INFO: `/v3/endpoints` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:19:49.423378 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df07fe52-8c1b-4cdf-86d6-0a8067ceba82 None admin] RBAC: Adding query filter params (interface=public, service_id=3c188ddff57f4fe0b321154142b06787, region_id=RegionOne) {{(pid=479852) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 09:19:49.424184 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df07fe52-8c1b-4cdf-86d6-0a8067ceba82 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:19:49.426164 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df07fe52-8c1b-4cdf-86d6-0a8067ceba82 None admin] RBAC: Authorization granted {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:19:49.433369 dv-cinder-851351-1-smb devstack@keystone.service[479852]: [pid: 479852|app: 0|req: 464/908] 10.222.0.42 () {56 vars in 1251 bytes} [Thu Jul 28 09:19:49 2022] GET /identity/v3/endpoints?service_id=3c188ddff57f4fe0b321154142b06787&interface=public®ion_id=RegionOne => generated 194 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:19:49.441498 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c9ad4d-eefc-49de-a94a-067abf8a85ee None admin] Authenticating user token {{(pid=479851) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:19:49.554917 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c9ad4d-eefc-49de-a94a-067abf8a85ee None admin] Validating token access rules against request {{(pid=479851) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:19:49.591195 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-747a348f-2ad1-4056-bc99-f5f77edd1957 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479851) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:19:49.591928 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747a348f-2ad1-4056-bc99-f5f77edd1957 None admin] REQUEST_METHOD: `GET` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:19:49.592188 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747a348f-2ad1-4056-bc99-f5f77edd1957 None admin] SCRIPT_NAME: `/identity` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:19:49.592454 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747a348f-2ad1-4056-bc99-f5f77edd1957 None admin] PATH_INFO: `/v3/services` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:19:49.593211 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-747a348f-2ad1-4056-bc99-f5f77edd1957 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:19:49.594617 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-747a348f-2ad1-4056-bc99-f5f77edd1957 None admin] RBAC: Authorization granted {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:19:49.601197 dv-cinder-851351-1-smb devstack@keystone.service[479851]: [pid: 479851|app: 0|req: 445/909] 10.222.0.42 () {56 vars in 1087 bytes} [Thu Jul 28 09:19:49 2022] GET /identity/v3/services => generated 1268 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 09:19:49.686700 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0613e68-ef2d-4722-88b9-dea40b4ac489 None None] REQUEST_METHOD: `GET` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:19:49.687042 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0613e68-ef2d-4722-88b9-dea40b4ac489 None None] SCRIPT_NAME: `/identity` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:19:49.687329 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0613e68-ef2d-4722-88b9-dea40b4ac489 None None] PATH_INFO: `/` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:19:49.689041 dv-cinder-851351-1-smb devstack@keystone.service[479852]: [pid: 479852|app: 0|req: 465/910] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 09:19:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 09:19:49.694860 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560cb200-4be7-4e6a-a62c-4da81506c30b None None] REQUEST_METHOD: `POST` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:19:49.695221 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560cb200-4be7-4e6a-a62c-4da81506c30b None None] SCRIPT_NAME: `/identity` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:19:49.695441 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560cb200-4be7-4e6a-a62c-4da81506c30b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:19:49.711427 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5529744-d3da-4fd4-a90b-a5635c1feaac None None] REQUEST_METHOD: `GET` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:19:49.712104 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5529744-d3da-4fd4-a90b-a5635c1feaac None None] SCRIPT_NAME: `/identity` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:19:49.712595 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5529744-d3da-4fd4-a90b-a5635c1feaac None None] PATH_INFO: `/` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:19:49.714589 dv-cinder-851351-1-smb devstack@keystone.service[479852]: [pid: 479852|app: 0|req: 466/911] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 09:19:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 28 09:19:49.716253 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.auth.core [None req-560cb200-4be7-4e6a-a62c-4da81506c30b None None] MFA Rules not processed for user `c198f91a4ae84d2b9cc730a6e304c2be`. Rule list: `[]` (Enabled: `True`). {{(pid=479851) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 09:19:49.717554 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.fernet_utils [None req-560cb200-4be7-4e6a-a62c-4da81506c30b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=479851) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 09:19:49.721413 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0df113-1908-4af2-8c85-1b3f7055b225 None None] REQUEST_METHOD: `POST` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:19:49.722052 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0df113-1908-4af2-8c85-1b3f7055b225 None None] SCRIPT_NAME: `/identity` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:19:49.722576 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0df113-1908-4af2-8c85-1b3f7055b225 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:19:49.747454 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.auth.core [None req-1e0df113-1908-4af2-8c85-1b3f7055b225 None None] MFA Rules not processed for user `c198f91a4ae84d2b9cc730a6e304c2be`. Rule list: `[]` (Enabled: `True`). {{(pid=479852) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 09:19:49.749419 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.fernet_utils [None req-1e0df113-1908-4af2-8c85-1b3f7055b225 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=479852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 09:19:49.749578 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG dbcounter [-] [479851] Writing DB stats keystone:SELECT=100 {{(pid=479851) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:19:49.799369 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG dbcounter [-] [479852] Writing DB stats keystone:SELECT=100 {{(pid=479852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:19:49.804028 dv-cinder-851351-1-smb devstack@keystone.service[479851]: [pid: 479851|app: 0|req: 446/912] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 09:19:49 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 09:19:49.826928 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560cb200-4be7-4e6a-a62c-4da81506c30b None None] Authenticating user token {{(pid=479851) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:19:49.838143 dv-cinder-851351-1-smb devstack@keystone.service[479852]: [pid: 479852|app: 0|req: 467/913] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 09:19:49 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 28 09:19:49.861489 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0df113-1908-4af2-8c85-1b3f7055b225 None None] Authenticating user token {{(pid=479852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:19:49.935197 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560cb200-4be7-4e6a-a62c-4da81506c30b None None] Validating token access rules against request {{(pid=479851) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:19:49.971226 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0df113-1908-4af2-8c85-1b3f7055b225 None None] Validating token access rules against request {{(pid=479852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:19:49.971473 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0775402-a3fd-426a-949d-35c36762ece9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479851) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:19:49.972136 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0775402-a3fd-426a-949d-35c36762ece9 None admin] REQUEST_METHOD: `GET` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:19:49.972428 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0775402-a3fd-426a-949d-35c36762ece9 None admin] SCRIPT_NAME: `/identity` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:19:49.972737 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0775402-a3fd-426a-949d-35c36762ece9 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:19:49.973444 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0775402-a3fd-426a-949d-35c36762ece9 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:19:49.975611 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0775402-a3fd-426a-949d-35c36762ece9 None admin] RBAC: Authorization granted {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:19:49.984232 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application [None req-e0775402-a3fd-426a-949d-35c36762ece9 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 28 09:19:49.984232 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 09:19:49.984232 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 28 09:19:49.984232 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 28 09:19:49.984232 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 28 09:19:49.984232 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 28 09:19:49.984232 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 28 09:19:49.984232 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 09:19:49.984232 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 28 09:19:49.984232 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application Jul 28 09:19:49.984232 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 28 09:19:49.984232 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application Jul 28 09:19:49.984232 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 09:19:49.984232 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 09:19:49.984232 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 09:19:49.984232 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 09:19:49.984232 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 09:19:49.985475 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 09:19:49.985475 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 09:19:49.985475 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 09:19:49.985475 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 09:19:49.985475 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 09:19:49.985475 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 09:19:49.985475 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 28 09:19:49.985475 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 28 09:19:49.985475 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 28 09:19:49.985475 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 28 09:19:49.985475 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 09:19:49.985475 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 09:19:49.985475 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 09:19:49.985475 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 09:19:49.985475 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 09:19:49.985475 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 09:19:49.986479 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 09:19:49.986479 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application with Lock( Jul 28 09:19:49.986479 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 09:19:49.986479 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return self._enter() Jul 28 09:19:49.986479 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 09:19:49.986479 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 09:19:49.986479 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 09:19:49.986479 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return self.creator() Jul 28 09:19:49.986479 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 09:19:49.986479 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application created_value = creator( Jul 28 09:19:49.986479 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 28 09:19:49.986479 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 09:19:49.986479 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 28 09:19:49.986479 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application Jul 28 09:19:49.986479 dv-cinder-851351-1-smb devstack@keystone.service[479851]: [pid: 479851|app: 0|req: 447/914] 10.222.0.42 () {56 vars in 1114 bytes} [Thu Jul 28 09:19:49 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 09:19:49.992207 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0775402-a3fd-426a-949d-35c36762ece9 None admin] Authenticating user token {{(pid=479851) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:19:50.015741 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b979cf7f-7b6b-44ce-a140-f82f96a24cb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:19:50.016496 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b979cf7f-7b6b-44ce-a140-f82f96a24cb0 None admin] REQUEST_METHOD: `POST` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:19:50.016815 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b979cf7f-7b6b-44ce-a140-f82f96a24cb0 None admin] SCRIPT_NAME: `/identity` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:19:50.017100 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b979cf7f-7b6b-44ce-a140-f82f96a24cb0 None admin] PATH_INFO: `/v3/services` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:19:50.017914 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b979cf7f-7b6b-44ce-a140-f82f96a24cb0 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:19:50.019365 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b979cf7f-7b6b-44ce-a140-f82f96a24cb0 None admin] RBAC: Authorization granted {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:19:50.023683 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG dbcounter [-] [479851] Writing DB stats keystone:SELECT=100 {{(pid=479851) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:19:50.045095 dv-cinder-851351-1-smb devstack@keystone.service[479852]: [pid: 479852|app: 0|req: 468/915] 10.222.0.42 () {60 vars in 1141 bytes} [Thu Jul 28 09:19:49 2022] POST /identity/v3/services => generated 241 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 28 09:19:50.122700 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0775402-a3fd-426a-949d-35c36762ece9 None admin] Validating token access rules against request {{(pid=479851) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:19:50.170660 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89881c12-bec1-491b-b089-cad81d901d2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479851) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:19:50.171607 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89881c12-bec1-491b-b089-cad81d901d2a None admin] REQUEST_METHOD: `GET` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:19:50.172065 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89881c12-bec1-491b-b089-cad81d901d2a None admin] SCRIPT_NAME: `/identity` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:19:50.172507 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89881c12-bec1-491b-b089-cad81d901d2a None admin] PATH_INFO: `/v3/services` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:19:50.173461 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89881c12-bec1-491b-b089-cad81d901d2a None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=479851) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 09:19:50.173955 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89881c12-bec1-491b-b089-cad81d901d2a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:19:50.175645 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89881c12-bec1-491b-b089-cad81d901d2a None admin] RBAC: Authorization granted {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:19:50.179008 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8b732f-ee57-4f8e-838e-5846218ffdb4 None None] REQUEST_METHOD: `GET` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:19:50.179455 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8b732f-ee57-4f8e-838e-5846218ffdb4 None None] SCRIPT_NAME: `/identity` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:19:50.179835 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8b732f-ee57-4f8e-838e-5846218ffdb4 None None] PATH_INFO: `/` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:19:50.182048 dv-cinder-851351-1-smb devstack@keystone.service[479852]: [pid: 479852|app: 0|req: 469/916] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 09:19:50 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 28 09:19:50.182751 dv-cinder-851351-1-smb devstack@keystone.service[479851]: [pid: 479851|app: 0|req: 448/917] 10.222.0.42 () {56 vars in 1114 bytes} [Thu Jul 28 09:19:49 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 09:19:50.188783 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2973b410-6d50-49a8-8251-3b188d997e50 None None] REQUEST_METHOD: `POST` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:19:50.189413 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2973b410-6d50-49a8-8251-3b188d997e50 None None] SCRIPT_NAME: `/identity` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:19:50.189778 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89881c12-bec1-491b-b089-cad81d901d2a None admin] Authenticating user token {{(pid=479851) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:19:50.190134 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2973b410-6d50-49a8-8251-3b188d997e50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:19:50.211261 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.auth.core [None req-2973b410-6d50-49a8-8251-3b188d997e50 None None] MFA Rules not processed for user `c198f91a4ae84d2b9cc730a6e304c2be`. Rule list: `[]` (Enabled: `True`). {{(pid=479852) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 09:19:50.212898 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.fernet_utils [None req-2973b410-6d50-49a8-8251-3b188d997e50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=479852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 09:19:50.243534 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG dbcounter [-] [479852] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=479852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:19:50.293726 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG dbcounter [-] [479851] Writing DB stats keystone:SELECT=100 {{(pid=479851) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:19:50.298524 dv-cinder-851351-1-smb devstack@keystone.service[479852]: [pid: 479852|app: 0|req: 470/918] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 09:19:50 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 09:19:50.314033 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89881c12-bec1-491b-b089-cad81d901d2a None admin] Validating token access rules against request {{(pid=479851) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:19:50.326115 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2973b410-6d50-49a8-8251-3b188d997e50 None None] Authenticating user token {{(pid=479852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:19:50.353244 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-016b977e-91ae-49ba-a366-5dce2c6aa973 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479851) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:19:50.353957 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016b977e-91ae-49ba-a366-5dce2c6aa973 None admin] REQUEST_METHOD: `GET` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:19:50.354339 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016b977e-91ae-49ba-a366-5dce2c6aa973 None admin] SCRIPT_NAME: `/identity` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:19:50.354632 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016b977e-91ae-49ba-a366-5dce2c6aa973 None admin] PATH_INFO: `/v3/services` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:19:50.355678 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-016b977e-91ae-49ba-a366-5dce2c6aa973 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=479851) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 09:19:50.356013 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-016b977e-91ae-49ba-a366-5dce2c6aa973 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:19:50.357732 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-016b977e-91ae-49ba-a366-5dce2c6aa973 None admin] RBAC: Authorization granted {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:19:50.364409 dv-cinder-851351-1-smb devstack@keystone.service[479851]: [pid: 479851|app: 0|req: 449/919] 10.222.0.42 () {56 vars in 1114 bytes} [Thu Jul 28 09:19:50 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:19:50.378093 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-016b977e-91ae-49ba-a366-5dce2c6aa973 None admin] Authenticating user token {{(pid=479851) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:19:50.479074 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2973b410-6d50-49a8-8251-3b188d997e50 None None] Validating token access rules against request {{(pid=479852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:19:50.498621 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-016b977e-91ae-49ba-a366-5dce2c6aa973 None admin] Validating token access rules against request {{(pid=479851) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:19:50.524047 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e52252b-eec3-4dba-a9a8-bf3e9092e4d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:19:50.525268 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e52252b-eec3-4dba-a9a8-bf3e9092e4d2 None admin] REQUEST_METHOD: `GET` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:19:50.525785 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e52252b-eec3-4dba-a9a8-bf3e9092e4d2 None admin] SCRIPT_NAME: `/identity` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:19:50.526291 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e52252b-eec3-4dba-a9a8-bf3e9092e4d2 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:19:50.541452 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e52252b-eec3-4dba-a9a8-bf3e9092e4d2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 09:19:50.544010 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f64c3b-b84e-4c0f-9635-bf1d00463b66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479851) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:19:50.544696 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f64c3b-b84e-4c0f-9635-bf1d00463b66 None admin] REQUEST_METHOD: `POST` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:19:50.544977 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f64c3b-b84e-4c0f-9635-bf1d00463b66 None admin] SCRIPT_NAME: `/identity` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:19:50.545261 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f64c3b-b84e-4c0f-9635-bf1d00463b66 None admin] PATH_INFO: `/v3/endpoints` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:19:50.546041 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00f64c3b-b84e-4c0f-9635-bf1d00463b66 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:19:50.547447 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00f64c3b-b84e-4c0f-9635-bf1d00463b66 None admin] RBAC: Authorization granted {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:19:50.548473 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application [None req-7e52252b-eec3-4dba-a9a8-bf3e9092e4d2 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 28 09:19:50.548473 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 09:19:50.548473 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 09:19:50.548473 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 09:19:50.548473 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 09:19:50.548473 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 09:19:50.548473 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 09:19:50.548473 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 09:19:50.548473 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 09:19:50.548473 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 09:19:50.548473 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 09:19:50.548473 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 09:19:50.548473 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 09:19:50.548473 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 09:19:50.548473 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 09:19:50.548473 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 09:19:50.549607 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 09:19:50.549607 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 09:19:50.549607 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 09:19:50.549607 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 09:19:50.549607 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 09:19:50.549607 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 09:19:50.549607 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 09:19:50.549607 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 09:19:50.549607 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 09:19:50.549607 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 09:19:50.549607 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 09:19:50.549607 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application with Lock( Jul 28 09:19:50.549607 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 09:19:50.549607 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self._enter() Jul 28 09:19:50.549607 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 09:19:50.549607 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 09:19:50.550659 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 09:19:50.550659 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self.creator() Jul 28 09:19:50.550659 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 09:19:50.550659 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application created_value = creator( Jul 28 09:19:50.550659 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 09:19:50.550659 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 09:19:50.550659 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 09:19:50.550659 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 09:19:50.550659 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 09:19:50.550659 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 09:19:50.550659 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 28 09:19:50.550659 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application Jul 28 09:19:50.554543 dv-cinder-851351-1-smb devstack@keystone.service[479852]: [pid: 479852|app: 0|req: 471/920] 10.222.0.42 () {56 vars in 1120 bytes} [Thu Jul 28 09:19:50 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 09:19:50.560264 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e52252b-eec3-4dba-a9a8-bf3e9092e4d2 None admin] Authenticating user token {{(pid=479852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:19:50.580702 dv-cinder-851351-1-smb devstack@keystone.service[479851]: [pid: 479851|app: 0|req: 450/921] 10.222.0.42 () {60 vars in 1144 bytes} [Thu Jul 28 09:19:50 2022] POST /identity/v3/endpoints => generated 346 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 28 09:19:50.593303 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG dbcounter [-] [479852] Writing DB stats keystone:SELECT=100 {{(pid=479852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:19:50.683139 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e52252b-eec3-4dba-a9a8-bf3e9092e4d2 None admin] Validating token access rules against request {{(pid=479852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:19:50.728067 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1ded19-8394-48ed-90df-9c4712fd88de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:19:50.728729 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1ded19-8394-48ed-90df-9c4712fd88de None admin] REQUEST_METHOD: `GET` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:19:50.729019 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1ded19-8394-48ed-90df-9c4712fd88de None admin] SCRIPT_NAME: `/identity` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:19:50.729297 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1ded19-8394-48ed-90df-9c4712fd88de None admin] PATH_INFO: `/v3/roles` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:19:50.730033 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e1ded19-8394-48ed-90df-9c4712fd88de None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=479852) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 09:19:50.730343 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e1ded19-8394-48ed-90df-9c4712fd88de None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:19:50.731741 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e1ded19-8394-48ed-90df-9c4712fd88de None admin] RBAC: Authorization granted {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:19:50.741212 dv-cinder-851351-1-smb devstack@keystone.service[479852]: [pid: 479852|app: 0|req: 472/922] 10.222.0.42 () {56 vars in 1115 bytes} [Thu Jul 28 09:19:50 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:19:50.746512 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f64c3b-b84e-4c0f-9635-bf1d00463b66 None admin] Authenticating user token {{(pid=479851) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:19:50.760786 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG dbcounter [-] [479851] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=479851) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:19:50.870143 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f64c3b-b84e-4c0f-9635-bf1d00463b66 None admin] Validating token access rules against request {{(pid=479851) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:19:50.905972 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90bb788-1d9e-45b3-a9e9-f10358e75319 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479851) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:19:50.906641 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90bb788-1d9e-45b3-a9e9-f10358e75319 None admin] REQUEST_METHOD: `GET` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:19:50.906932 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90bb788-1d9e-45b3-a9e9-f10358e75319 None admin] SCRIPT_NAME: `/identity` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:19:50.907218 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90bb788-1d9e-45b3-a9e9-f10358e75319 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:19:50.918779 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f90bb788-1d9e-45b3-a9e9-f10358e75319 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:19:50.920356 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f90bb788-1d9e-45b3-a9e9-f10358e75319 None admin] RBAC: Authorization granted {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:19:50.935496 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application [None req-f90bb788-1d9e-45b3-a9e9-f10358e75319 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 09:19:50.935496 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 09:19:50.935496 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 09:19:50.935496 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 09:19:50.935496 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 09:19:50.935496 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 09:19:50.935496 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 09:19:50.935496 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 09:19:50.935496 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 09:19:50.935496 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 09:19:50.935496 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 09:19:50.935496 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 09:19:50.935496 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 09:19:50.935496 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 09:19:50.935496 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 09:19:50.936610 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 09:19:50.936610 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 09:19:50.936610 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 09:19:50.936610 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 09:19:50.936610 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 09:19:50.936610 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 09:19:50.936610 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 09:19:50.936610 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 09:19:50.936610 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application with Lock( Jul 28 09:19:50.936610 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 09:19:50.936610 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return self._enter() Jul 28 09:19:50.936610 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 09:19:50.936610 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 09:19:50.936610 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 09:19:50.936610 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return self.creator() Jul 28 09:19:50.936610 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 09:19:50.936610 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application created_value = creator( Jul 28 09:19:50.938195 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 09:19:50.938195 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 09:19:50.938195 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 09:19:50.938195 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application Jul 28 09:19:50.938195 dv-cinder-851351-1-smb devstack@keystone.service[479851]: [pid: 479851|app: 0|req: 451/923] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 09:19:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 09:19:50.942858 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1ded19-8394-48ed-90df-9c4712fd88de None admin] Authenticating user token {{(pid=479852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:19:51.032113 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG dbcounter [-] [479852] Writing DB stats keystone:SELECT=100 {{(pid=479852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:19:51.059166 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1ded19-8394-48ed-90df-9c4712fd88de None admin] Validating token access rules against request {{(pid=479852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:19:51.097584 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-850afd61-e8c7-480c-8d56-08b77cafba06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:19:51.098305 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850afd61-e8c7-480c-8d56-08b77cafba06 None admin] REQUEST_METHOD: `GET` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:19:51.098588 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850afd61-e8c7-480c-8d56-08b77cafba06 None admin] SCRIPT_NAME: `/identity` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:19:51.098866 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850afd61-e8c7-480c-8d56-08b77cafba06 None admin] PATH_INFO: `/v3/domains` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:19:51.099581 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-850afd61-e8c7-480c-8d56-08b77cafba06 None admin] RBAC: Adding query filter params (name=Default) {{(pid=479852) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 09:19:51.099884 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-850afd61-e8c7-480c-8d56-08b77cafba06 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:19:51.101297 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-850afd61-e8c7-480c-8d56-08b77cafba06 None admin] RBAC: Authorization granted {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:19:51.114305 dv-cinder-851351-1-smb devstack@keystone.service[479852]: [pid: 479852|app: 0|req: 473/924] 10.222.0.42 () {56 vars in 1109 bytes} [Thu Jul 28 09:19:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:19:51.120019 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90bb788-1d9e-45b3-a9e9-f10358e75319 None admin] Authenticating user token {{(pid=479851) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:19:51.182250 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG dbcounter [-] [479851] Writing DB stats keystone:SELECT=100 {{(pid=479851) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:19:51.226298 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90bb788-1d9e-45b3-a9e9-f10358e75319 None admin] Validating token access rules against request {{(pid=479851) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:19:51.261193 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9e5bb9-c741-42ec-a11d-f7649cc0eb00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479851) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:19:51.261851 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9e5bb9-c741-42ec-a11d-f7649cc0eb00 None admin] REQUEST_METHOD: `GET` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:19:51.262189 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9e5bb9-c741-42ec-a11d-f7649cc0eb00 None admin] SCRIPT_NAME: `/identity` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:19:51.262469 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9e5bb9-c741-42ec-a11d-f7649cc0eb00 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:19:51.271066 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae9e5bb9-c741-42ec-a11d-f7649cc0eb00 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:19:51.272620 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae9e5bb9-c741-42ec-a11d-f7649cc0eb00 None admin] RBAC: Authorization granted {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:19:51.285917 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application [None req-ae9e5bb9-c741-42ec-a11d-f7649cc0eb00 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 28 09:19:51.285917 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 09:19:51.285917 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 09:19:51.285917 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 09:19:51.285917 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 09:19:51.285917 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 09:19:51.285917 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 09:19:51.285917 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 09:19:51.285917 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 09:19:51.285917 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 09:19:51.285917 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 09:19:51.285917 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 09:19:51.285917 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 28 09:19:51.285917 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 28 09:19:51.285917 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 28 09:19:51.285917 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 28 09:19:51.287115 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 09:19:51.287115 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 09:19:51.287115 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 28 09:19:51.287115 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 09:19:51.287115 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 28 09:19:51.287115 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 09:19:51.287115 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 09:19:51.287115 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 09:19:51.287115 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 09:19:51.287115 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 09:19:51.287115 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 09:19:51.287115 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application with Lock( Jul 28 09:19:51.287115 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 09:19:51.287115 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return self._enter() Jul 28 09:19:51.287115 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 09:19:51.287115 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 09:19:51.287115 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 09:19:51.287115 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return self.creator() Jul 28 09:19:51.288639 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 09:19:51.288639 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application created_value = creator( Jul 28 09:19:51.288639 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 28 09:19:51.288639 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 28 09:19:51.288639 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 28 09:19:51.288639 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 28 09:19:51.288639 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 28 09:19:51.288639 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 28 09:19:51.288639 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 28 09:19:51.288639 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application Jul 28 09:19:51.288639 dv-cinder-851351-1-smb devstack@keystone.service[479851]: [pid: 479851|app: 0|req: 452/925] 10.222.0.42 () {56 vars in 1117 bytes} [Thu Jul 28 09:19:51 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 09:19:51.293133 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-850afd61-e8c7-480c-8d56-08b77cafba06 None admin] Authenticating user token {{(pid=479852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:19:51.402625 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-850afd61-e8c7-480c-8d56-08b77cafba06 None admin] Validating token access rules against request {{(pid=479852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:19:51.442456 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-511e5808-36a1-4b73-8af2-85774cd823a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:19:51.443092 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511e5808-36a1-4b73-8af2-85774cd823a3 None admin] REQUEST_METHOD: `GET` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:19:51.443375 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511e5808-36a1-4b73-8af2-85774cd823a3 None admin] SCRIPT_NAME: `/identity` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:19:51.443652 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511e5808-36a1-4b73-8af2-85774cd823a3 None admin] PATH_INFO: `/v3/users` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:19:51.444466 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-511e5808-36a1-4b73-8af2-85774cd823a3 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=479852) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 09:19:51.444808 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-511e5808-36a1-4b73-8af2-85774cd823a3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:19:51.446574 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-511e5808-36a1-4b73-8af2-85774cd823a3 None admin] RBAC: Authorization granted {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:19:51.456077 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG dbcounter [-] [479852] Writing DB stats keystone:SELECT=100 {{(pid=479852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:19:51.468594 dv-cinder-851351-1-smb devstack@keystone.service[479852]: [pid: 479852|app: 0|req: 474/926] 10.222.0.42 () {56 vars in 1149 bytes} [Thu Jul 28 09:19:51 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:19:51.477780 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9e5bb9-c741-42ec-a11d-f7649cc0eb00 None admin] Authenticating user token {{(pid=479851) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:19:51.582322 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9e5bb9-c741-42ec-a11d-f7649cc0eb00 None admin] Validating token access rules against request {{(pid=479851) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:19:51.600606 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG dbcounter [-] [479851] Writing DB stats keystone:SELECT=100 {{(pid=479851) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:19:51.619014 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f776c88c-ac04-4e4b-8de5-74e9e21d08bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479851) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:19:51.619691 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f776c88c-ac04-4e4b-8de5-74e9e21d08bc None admin] REQUEST_METHOD: `GET` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:19:51.619977 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f776c88c-ac04-4e4b-8de5-74e9e21d08bc None admin] SCRIPT_NAME: `/identity` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:19:51.620255 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f776c88c-ac04-4e4b-8de5-74e9e21d08bc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:19:51.638563 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f776c88c-ac04-4e4b-8de5-74e9e21d08bc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:19:51.640093 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f776c88c-ac04-4e4b-8de5-74e9e21d08bc None admin] RBAC: Authorization granted {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:19:51.655405 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application [None req-f776c88c-ac04-4e4b-8de5-74e9e21d08bc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 09:19:51.655405 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 09:19:51.655405 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 09:19:51.655405 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 09:19:51.655405 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 09:19:51.655405 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 09:19:51.655405 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 09:19:51.655405 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 09:19:51.655405 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 09:19:51.655405 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 09:19:51.655405 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 09:19:51.655405 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 09:19:51.655405 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 09:19:51.655405 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 09:19:51.655405 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 09:19:51.656546 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 09:19:51.656546 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 09:19:51.656546 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 09:19:51.656546 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 09:19:51.656546 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 09:19:51.656546 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 09:19:51.656546 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 09:19:51.656546 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 09:19:51.656546 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application with Lock( Jul 28 09:19:51.656546 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 09:19:51.656546 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return self._enter() Jul 28 09:19:51.656546 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 09:19:51.656546 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 09:19:51.656546 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 09:19:51.656546 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return self.creator() Jul 28 09:19:51.656546 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 09:19:51.656546 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application created_value = creator( Jul 28 09:19:51.658088 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 09:19:51.658088 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 09:19:51.658088 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 09:19:51.658088 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application Jul 28 09:19:51.658088 dv-cinder-851351-1-smb devstack@keystone.service[479851]: [pid: 479851|app: 0|req: 453/927] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 09:19:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 09:19:51.662589 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-511e5808-36a1-4b73-8af2-85774cd823a3 None admin] Authenticating user token {{(pid=479852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:19:51.772205 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-511e5808-36a1-4b73-8af2-85774cd823a3 None admin] Validating token access rules against request {{(pid=479852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:19:51.808693 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90fb7874-2988-498c-99d5-797fd3668ff3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:19:51.809344 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90fb7874-2988-498c-99d5-797fd3668ff3 None admin] REQUEST_METHOD: `GET` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:19:51.809626 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90fb7874-2988-498c-99d5-797fd3668ff3 None admin] SCRIPT_NAME: `/identity` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:19:51.809902 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90fb7874-2988-498c-99d5-797fd3668ff3 None admin] PATH_INFO: `/v3/domains` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:19:51.810604 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90fb7874-2988-498c-99d5-797fd3668ff3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=479852) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 09:19:51.810908 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90fb7874-2988-498c-99d5-797fd3668ff3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:19:51.812306 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90fb7874-2988-498c-99d5-797fd3668ff3 None admin] RBAC: Authorization granted {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:19:51.825564 dv-cinder-851351-1-smb devstack@keystone.service[479852]: [pid: 479852|app: 0|req: 475/928] 10.222.0.42 () {56 vars in 1109 bytes} [Thu Jul 28 09:19:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:19:51.830662 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3638645d-507b-4954-a2cc-b28c12bdcdb7 None None] REQUEST_METHOD: `GET` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:19:51.831359 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90fb7874-2988-498c-99d5-797fd3668ff3 None admin] Authenticating user token {{(pid=479852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:19:51.831928 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3638645d-507b-4954-a2cc-b28c12bdcdb7 None None] SCRIPT_NAME: `/identity` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:19:51.832573 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3638645d-507b-4954-a2cc-b28c12bdcdb7 None None] PATH_INFO: `/` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:19:51.838692 dv-cinder-851351-1-smb devstack@keystone.service[479851]: [pid: 479851|app: 0|req: 454/929] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 09:19:51 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 09:19:51.841076 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c01a76-8b48-4592-89cf-2db8b84e40d2 None None] REQUEST_METHOD: `POST` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:19:51.841680 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c01a76-8b48-4592-89cf-2db8b84e40d2 None None] SCRIPT_NAME: `/identity` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:19:51.842193 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c01a76-8b48-4592-89cf-2db8b84e40d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:19:51.862472 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.auth.core [None req-17c01a76-8b48-4592-89cf-2db8b84e40d2 None None] MFA Rules not processed for user `c198f91a4ae84d2b9cc730a6e304c2be`. Rule list: `[]` (Enabled: `True`). {{(pid=479851) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 09:19:51.864203 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.fernet_utils [None req-17c01a76-8b48-4592-89cf-2db8b84e40d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=479851) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 09:19:51.894385 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG dbcounter [-] [479852] Writing DB stats keystone:SELECT=100 {{(pid=479852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:19:51.941121 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90fb7874-2988-498c-99d5-797fd3668ff3 None admin] Validating token access rules against request {{(pid=479852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:19:51.952683 dv-cinder-851351-1-smb devstack@keystone.service[479851]: [pid: 479851|app: 0|req: 455/930] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 09:19:51 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 09:19:51.969624 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c01a76-8b48-4592-89cf-2db8b84e40d2 None None] Authenticating user token {{(pid=479851) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:19:51.988030 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4f86e8-7945-4f45-a127-0c72a497405f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:19:51.989648 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4f86e8-7945-4f45-a127-0c72a497405f None admin] REQUEST_METHOD: `GET` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:19:51.990444 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4f86e8-7945-4f45-a127-0c72a497405f None admin] SCRIPT_NAME: `/identity` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:19:51.990961 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4f86e8-7945-4f45-a127-0c72a497405f None admin] PATH_INFO: `/v3/projects/service` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:19:52.001910 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc4f86e8-7945-4f45-a127-0c72a497405f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:19:52.003389 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc4f86e8-7945-4f45-a127-0c72a497405f None admin] RBAC: Authorization granted {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:19:52.015240 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application [None req-fc4f86e8-7945-4f45-a127-0c72a497405f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 09:19:52.015240 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 09:19:52.015240 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 09:19:52.015240 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 09:19:52.015240 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 09:19:52.015240 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 09:19:52.015240 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 09:19:52.015240 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 09:19:52.015240 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 09:19:52.015240 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 09:19:52.015240 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 09:19:52.015240 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 09:19:52.015240 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 28 09:19:52.015240 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 28 09:19:52.015240 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 28 09:19:52.016357 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 28 09:19:52.016357 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 09:19:52.016357 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 09:19:52.016357 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 09:19:52.016357 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 09:19:52.016357 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 09:19:52.016357 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 09:19:52.016357 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 09:19:52.016357 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application with Lock( Jul 28 09:19:52.016357 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 09:19:52.016357 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self._enter() Jul 28 09:19:52.016357 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 09:19:52.016357 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 09:19:52.016357 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 09:19:52.016357 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self.creator() Jul 28 09:19:52.016357 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 09:19:52.016357 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application created_value = creator( Jul 28 09:19:52.018079 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 28 09:19:52.018079 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 28 09:19:52.018079 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 28 09:19:52.018079 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 28 09:19:52.018079 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 28 09:19:52.018079 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 28 09:19:52.018079 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 09:19:52.018079 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application Jul 28 09:19:52.018079 dv-cinder-851351-1-smb devstack@keystone.service[479852]: [pid: 479852|app: 0|req: 476/931] 10.222.0.42 () {56 vars in 1111 bytes} [Thu Jul 28 09:19:51 2022] GET /identity/v3/projects/service => generated 88 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 09:19:52.022593 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4f86e8-7945-4f45-a127-0c72a497405f None admin] Authenticating user token {{(pid=479852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:19:52.088868 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG dbcounter [-] [479851] Writing DB stats keystone:SELECT=100 {{(pid=479851) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:19:52.092775 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c01a76-8b48-4592-89cf-2db8b84e40d2 None None] Validating token access rules against request {{(pid=479851) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:19:52.126792 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4f86e8-7945-4f45-a127-0c72a497405f None admin] Validating token access rules against request {{(pid=479852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:19:52.137419 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc52412-022a-4562-ab2b-7cf8dcfddf78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479851) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:19:52.138177 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc52412-022a-4562-ab2b-7cf8dcfddf78 None admin] REQUEST_METHOD: `GET` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:19:52.138943 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc52412-022a-4562-ab2b-7cf8dcfddf78 None admin] SCRIPT_NAME: `/identity` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:19:52.139296 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc52412-022a-4562-ab2b-7cf8dcfddf78 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:19:52.140332 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fc52412-022a-4562-ab2b-7cf8dcfddf78 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:19:52.142185 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fc52412-022a-4562-ab2b-7cf8dcfddf78 None admin] RBAC: Authorization granted {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:19:52.147686 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG dbcounter [-] [479852] Writing DB stats keystone:SELECT=100 {{(pid=479852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:19:52.157867 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application [None req-4fc52412-022a-4562-ab2b-7cf8dcfddf78 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 28 09:19:52.157867 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 09:19:52.157867 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 28 09:19:52.157867 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 28 09:19:52.157867 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 28 09:19:52.157867 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 28 09:19:52.157867 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 28 09:19:52.157867 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 09:19:52.157867 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 28 09:19:52.157867 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application Jul 28 09:19:52.157867 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 28 09:19:52.157867 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application Jul 28 09:19:52.157867 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 09:19:52.157867 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 09:19:52.157867 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 09:19:52.157867 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 09:19:52.159065 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 09:19:52.159065 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 09:19:52.159065 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 09:19:52.159065 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 09:19:52.159065 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 09:19:52.159065 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 09:19:52.159065 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 09:19:52.159065 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 28 09:19:52.159065 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 28 09:19:52.159065 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 28 09:19:52.159065 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 28 09:19:52.159065 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 09:19:52.159065 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 09:19:52.159065 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 09:19:52.159065 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 09:19:52.159065 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 09:19:52.160401 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 09:19:52.160401 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 09:19:52.160401 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application with Lock( Jul 28 09:19:52.160401 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 09:19:52.160401 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return self._enter() Jul 28 09:19:52.160401 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 09:19:52.160401 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 09:19:52.160401 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 09:19:52.160401 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return self.creator() Jul 28 09:19:52.160401 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 09:19:52.160401 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application created_value = creator( Jul 28 09:19:52.160401 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 28 09:19:52.160401 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 09:19:52.160401 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 28 09:19:52.160401 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application Jul 28 09:19:52.165108 dv-cinder-851351-1-smb devstack@keystone.service[479851]: [pid: 479851|app: 0|req: 456/932] 10.222.0.42 () {56 vars in 1132 bytes} [Thu Jul 28 09:19:51 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 09:19:52.166410 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc52412-022a-4562-ab2b-7cf8dcfddf78 None admin] Authenticating user token {{(pid=479851) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:19:52.175024 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4563330a-32b3-4e03-b56d-b23f1f8ed36c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:19:52.175988 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4563330a-32b3-4e03-b56d-b23f1f8ed36c None admin] REQUEST_METHOD: `GET` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:19:52.176537 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4563330a-32b3-4e03-b56d-b23f1f8ed36c None admin] SCRIPT_NAME: `/identity` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:19:52.177058 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4563330a-32b3-4e03-b56d-b23f1f8ed36c None admin] PATH_INFO: `/v3/projects` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:19:52.178649 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4563330a-32b3-4e03-b56d-b23f1f8ed36c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=479852) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 09:19:52.179169 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4563330a-32b3-4e03-b56d-b23f1f8ed36c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:19:52.181381 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4563330a-32b3-4e03-b56d-b23f1f8ed36c None admin] RBAC: Authorization granted {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:19:52.205209 dv-cinder-851351-1-smb devstack@keystone.service[479852]: [pid: 479852|app: 0|req: 477/933] 10.222.0.42 () {56 vars in 1148 bytes} [Thu Jul 28 09:19:52 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:19:52.206667 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4563330a-32b3-4e03-b56d-b23f1f8ed36c None admin] Authenticating user token {{(pid=479852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:19:52.279536 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc52412-022a-4562-ab2b-7cf8dcfddf78 None admin] Validating token access rules against request {{(pid=479851) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:19:52.318913 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb24175-1a83-4308-926a-5df7caeac8be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479851) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:19:52.319554 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb24175-1a83-4308-926a-5df7caeac8be None admin] REQUEST_METHOD: `GET` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:19:52.319845 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb24175-1a83-4308-926a-5df7caeac8be None admin] SCRIPT_NAME: `/identity` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:19:52.319971 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4563330a-32b3-4e03-b56d-b23f1f8ed36c None admin] Validating token access rules against request {{(pid=479852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:19:52.320156 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb24175-1a83-4308-926a-5df7caeac8be None admin] PATH_INFO: `/v3/services` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:19:52.320856 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb24175-1a83-4308-926a-5df7caeac8be None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=479851) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 09:19:52.321482 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb24175-1a83-4308-926a-5df7caeac8be None admin] RBAC: Authorizing `identity:list_services()` {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:19:52.322942 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb24175-1a83-4308-926a-5df7caeac8be None admin] RBAC: Authorization granted {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:19:52.328129 dv-cinder-851351-1-smb devstack@keystone.service[479851]: [pid: 479851|app: 0|req: 457/934] 10.222.0.42 () {56 vars in 1126 bytes} [Thu Jul 28 09:19:52 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:19:52.329402 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ceb42a-3131-4d20-8d1c-75e53e07260d None None] REQUEST_METHOD: `GET` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:19:52.329726 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ceb42a-3131-4d20-8d1c-75e53e07260d None None] SCRIPT_NAME: `/identity` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:19:52.329973 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ceb42a-3131-4d20-8d1c-75e53e07260d None None] PATH_INFO: `/` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:19:52.332756 dv-cinder-851351-1-smb devstack@keystone.service[479851]: [pid: 479851|app: 0|req: 458/935] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 09:19:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 09:19:52.334909 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ceb42a-3131-4d20-8d1c-75e53e07260d None None] Authenticating user token {{(pid=479851) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:19:52.364319 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502a08c3-542d-4f71-b27b-3ad8221bf287 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:19:52.365374 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502a08c3-542d-4f71-b27b-3ad8221bf287 None admin] REQUEST_METHOD: `PUT` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:19:52.365889 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502a08c3-542d-4f71-b27b-3ad8221bf287 None admin] SCRIPT_NAME: `/identity` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:19:52.366166 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502a08c3-542d-4f71-b27b-3ad8221bf287 None admin] PATH_INFO: `/v3/projects/3a0fb8ea8010437bade8f92dcbcaacee/users/87596a91a45f4326855265497fe69b65/roles/4a0748cb7fbb416eb81203fd028beb9a` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:19:52.366435 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG dbcounter [-] [479851] Writing DB stats keystone:SELECT=100 {{(pid=479851) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:19:52.368621 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-502a08c3-542d-4f71-b27b-3ad8221bf287 None admin] RBAC: Authorizing `identity:create_grant(project_id=3a0fb8ea8010437bade8f92dcbcaacee, user_id=87596a91a45f4326855265497fe69b65, role_id=4a0748cb7fbb416eb81203fd028beb9a)` {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:19:52.370726 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-502a08c3-542d-4f71-b27b-3ad8221bf287 None admin] RBAC: Authorization granted {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:19:52.385890 dv-cinder-851351-1-smb devstack@keystone.service[479852]: [pid: 479852|app: 0|req: 478/936] 10.222.0.42 () {58 vars in 1439 bytes} [Thu Jul 28 09:19:52 2022] PUT /identity/v3/projects/3a0fb8ea8010437bade8f92dcbcaacee/users/87596a91a45f4326855265497fe69b65/roles/4a0748cb7fbb416eb81203fd028beb9a => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 28 09:19:52.387224 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b4ef29-1ba1-4bd3-85fc-45a7ffb50701 None None] REQUEST_METHOD: `POST` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:19:52.387515 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b4ef29-1ba1-4bd3-85fc-45a7ffb50701 None None] SCRIPT_NAME: `/identity` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:19:52.387794 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b4ef29-1ba1-4bd3-85fc-45a7ffb50701 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:19:52.410065 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.auth.core [None req-00b4ef29-1ba1-4bd3-85fc-45a7ffb50701 None None] MFA Rules not processed for user `c198f91a4ae84d2b9cc730a6e304c2be`. Rule list: `[]` (Enabled: `True`). {{(pid=479852) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 09:19:52.411388 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.fernet_utils [None req-00b4ef29-1ba1-4bd3-85fc-45a7ffb50701 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=479852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 09:19:52.446930 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG dbcounter [-] [479852] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=479852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:19:52.494649 dv-cinder-851351-1-smb devstack@keystone.service[479852]: [pid: 479852|app: 0|req: 479/937] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 09:19:52 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 09:19:52.497984 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ceb42a-3131-4d20-8d1c-75e53e07260d None None] Validating token access rules against request {{(pid=479851) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:19:52.522316 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b4ef29-1ba1-4bd3-85fc-45a7ffb50701 None None] Authenticating user token {{(pid=479852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:19:52.538097 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa2d3688-16d6-4bcd-b631-1e56bcdaa998 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479851) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:19:52.539156 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2d3688-16d6-4bcd-b631-1e56bcdaa998 None admin] REQUEST_METHOD: `GET` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:19:52.539659 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2d3688-16d6-4bcd-b631-1e56bcdaa998 None admin] SCRIPT_NAME: `/identity` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:19:52.540155 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2d3688-16d6-4bcd-b631-1e56bcdaa998 None admin] PATH_INFO: `/v3/services` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:19:52.541116 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa2d3688-16d6-4bcd-b631-1e56bcdaa998 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=479851) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 09:19:52.541745 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa2d3688-16d6-4bcd-b631-1e56bcdaa998 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:19:52.543441 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa2d3688-16d6-4bcd-b631-1e56bcdaa998 None admin] RBAC: Authorization granted {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:19:52.554838 dv-cinder-851351-1-smb devstack@keystone.service[479851]: [pid: 479851|app: 0|req: 459/938] 10.222.0.42 () {56 vars in 1126 bytes} [Thu Jul 28 09:19:52 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 09:19:52.556597 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa2d3688-16d6-4bcd-b631-1e56bcdaa998 None admin] Authenticating user token {{(pid=479851) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:19:52.654374 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b4ef29-1ba1-4bd3-85fc-45a7ffb50701 None None] Validating token access rules against request {{(pid=479852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:19:52.680498 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG dbcounter [-] [479851] Writing DB stats keystone:SELECT=100 {{(pid=479851) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:19:52.698851 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa2d3688-16d6-4bcd-b631-1e56bcdaa998 None admin] Validating token access rules against request {{(pid=479851) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:19:52.701817 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d668ea-55a4-419d-a7c3-049dcc6132cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:19:52.703485 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d668ea-55a4-419d-a7c3-049dcc6132cf None admin] REQUEST_METHOD: `GET` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:19:52.703815 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d668ea-55a4-419d-a7c3-049dcc6132cf None admin] SCRIPT_NAME: `/identity` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:19:52.704115 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d668ea-55a4-419d-a7c3-049dcc6132cf None admin] PATH_INFO: `/v3/services/object-store` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:19:52.704808 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90d668ea-55a4-419d-a7c3-049dcc6132cf None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:19:52.706267 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90d668ea-55a4-419d-a7c3-049dcc6132cf None admin] RBAC: Authorization granted {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:19:52.720476 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application [None req-90d668ea-55a4-419d-a7c3-049dcc6132cf None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 28 09:19:52.720476 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 09:19:52.720476 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 28 09:19:52.720476 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 28 09:19:52.720476 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 28 09:19:52.720476 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 28 09:19:52.720476 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 28 09:19:52.720476 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 09:19:52.720476 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 28 09:19:52.720476 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application Jul 28 09:19:52.720476 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 28 09:19:52.720476 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application Jul 28 09:19:52.720476 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 09:19:52.720476 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 09:19:52.720476 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 09:19:52.720476 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 09:19:52.720476 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 09:19:52.721804 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 09:19:52.721804 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 09:19:52.721804 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 09:19:52.721804 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 09:19:52.721804 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 09:19:52.721804 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 09:19:52.721804 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 28 09:19:52.721804 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 28 09:19:52.721804 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 28 09:19:52.721804 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 28 09:19:52.721804 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 09:19:52.721804 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 09:19:52.721804 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 09:19:52.721804 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 09:19:52.721804 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 09:19:52.721804 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 09:19:52.723097 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 09:19:52.723097 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application with Lock( Jul 28 09:19:52.723097 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 09:19:52.723097 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self._enter() Jul 28 09:19:52.723097 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 09:19:52.723097 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 09:19:52.723097 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 09:19:52.723097 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self.creator() Jul 28 09:19:52.723097 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 09:19:52.723097 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application created_value = creator( Jul 28 09:19:52.723097 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 28 09:19:52.723097 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 09:19:52.723097 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 28 09:19:52.723097 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application Jul 28 09:19:52.723097 dv-cinder-851351-1-smb devstack@keystone.service[479852]: [pid: 479852|app: 0|req: 480/939] 10.222.0.42 () {56 vars in 1126 bytes} [Thu Jul 28 09:19:52 2022] GET /identity/v3/services/object-store => generated 93 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 09:19:52.729258 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d668ea-55a4-419d-a7c3-049dcc6132cf None admin] Authenticating user token {{(pid=479852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:19:52.750394 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a18816cc-dca1-42a6-9e3f-309bed6562b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479851) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:19:52.751047 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18816cc-dca1-42a6-9e3f-309bed6562b8 None admin] REQUEST_METHOD: `POST` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:19:52.751337 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18816cc-dca1-42a6-9e3f-309bed6562b8 None admin] SCRIPT_NAME: `/identity` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:19:52.752063 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18816cc-dca1-42a6-9e3f-309bed6562b8 None admin] PATH_INFO: `/v3/endpoints` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:19:52.752857 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a18816cc-dca1-42a6-9e3f-309bed6562b8 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:19:52.754605 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a18816cc-dca1-42a6-9e3f-309bed6562b8 None admin] RBAC: Authorization granted {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:19:52.781227 dv-cinder-851351-1-smb devstack@keystone.service[479851]: [pid: 479851|app: 0|req: 460/940] 10.222.0.42 () {60 vars in 1144 bytes} [Thu Jul 28 09:19:52 2022] POST /identity/v3/endpoints => generated 347 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 28 09:19:52.782678 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e441b29d-c9fd-4de9-91c1-d5f436d5b175 None None] REQUEST_METHOD: `GET` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:19:52.782977 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e441b29d-c9fd-4de9-91c1-d5f436d5b175 None None] SCRIPT_NAME: `/identity` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:19:52.783285 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e441b29d-c9fd-4de9-91c1-d5f436d5b175 None None] PATH_INFO: `/` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:19:52.784651 dv-cinder-851351-1-smb devstack@keystone.service[479851]: [pid: 479851|app: 0|req: 461/941] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 09:19:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 09:19:52.787270 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG dbcounter [-] [479852] Writing DB stats keystone:SELECT=100 {{(pid=479852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:19:52.800233 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7ff00d-99ed-4072-afc0-c7b8f3d3dd23 None None] REQUEST_METHOD: `POST` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:19:52.800594 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7ff00d-99ed-4072-afc0-c7b8f3d3dd23 None None] SCRIPT_NAME: `/identity` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:19:52.800921 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7ff00d-99ed-4072-afc0-c7b8f3d3dd23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:19:52.826976 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.auth.core [None req-6b7ff00d-99ed-4072-afc0-c7b8f3d3dd23 None None] MFA Rules not processed for user `c198f91a4ae84d2b9cc730a6e304c2be`. Rule list: `[]` (Enabled: `True`). {{(pid=479851) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 09:19:52.828193 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.fernet_utils [None req-6b7ff00d-99ed-4072-afc0-c7b8f3d3dd23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=479851) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 09:19:52.905898 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d668ea-55a4-419d-a7c3-049dcc6132cf None admin] Validating token access rules against request {{(pid=479852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:19:52.954049 dv-cinder-851351-1-smb devstack@keystone.service[479851]: [pid: 479851|app: 0|req: 462/942] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 09:19:52 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 28 09:19:52.968836 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c884f1-90e4-4cc6-863a-a72eebe10e56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:19:52.969570 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c884f1-90e4-4cc6-863a-a72eebe10e56 None admin] REQUEST_METHOD: `GET` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:19:52.969893 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c884f1-90e4-4cc6-863a-a72eebe10e56 None admin] SCRIPT_NAME: `/identity` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:19:52.970257 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c884f1-90e4-4cc6-863a-a72eebe10e56 None admin] PATH_INFO: `/v3/services` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:19:52.971078 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0c884f1-90e4-4cc6-863a-a72eebe10e56 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=479852) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 09:19:52.971526 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0c884f1-90e4-4cc6-863a-a72eebe10e56 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:19:52.973447 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0c884f1-90e4-4cc6-863a-a72eebe10e56 None admin] RBAC: Authorization granted {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:19:52.979811 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7ff00d-99ed-4072-afc0-c7b8f3d3dd23 None None] Authenticating user token {{(pid=479851) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:19:52.982767 dv-cinder-851351-1-smb devstack@keystone.service[479852]: [pid: 479852|app: 0|req: 481/943] 10.222.0.42 () {56 vars in 1122 bytes} [Thu Jul 28 09:19:52 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:19:52.989016 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c884f1-90e4-4cc6-863a-a72eebe10e56 None admin] Authenticating user token {{(pid=479852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:19:53.085675 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG dbcounter [-] [479851] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=479851) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:19:53.124579 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG dbcounter [-] [479852] Writing DB stats keystone:SELECT=100 {{(pid=479852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:19:53.132228 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7ff00d-99ed-4072-afc0-c7b8f3d3dd23 None None] Validating token access rules against request {{(pid=479851) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:19:53.134166 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c884f1-90e4-4cc6-863a-a72eebe10e56 None admin] Validating token access rules against request {{(pid=479852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:19:53.183413 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea7e1eeb-d8b9-4b39-b31d-da8fd02a6e72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:19:53.183968 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7e1eeb-d8b9-4b39-b31d-da8fd02a6e72 None admin] REQUEST_METHOD: `GET` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:19:53.184247 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7e1eeb-d8b9-4b39-b31d-da8fd02a6e72 None admin] SCRIPT_NAME: `/identity` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:19:53.184520 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7e1eeb-d8b9-4b39-b31d-da8fd02a6e72 None admin] PATH_INFO: `/v3/services` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:19:53.185788 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea7e1eeb-d8b9-4b39-b31d-da8fd02a6e72 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=479852) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 09:19:53.186094 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea7e1eeb-d8b9-4b39-b31d-da8fd02a6e72 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:19:53.187521 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea7e1eeb-d8b9-4b39-b31d-da8fd02a6e72 None admin] RBAC: Authorization granted {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:19:53.192401 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d35e83a-4e22-4375-88b6-1d1605044260 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479851) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:19:53.193518 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d35e83a-4e22-4375-88b6-1d1605044260 None admin] REQUEST_METHOD: `POST` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:19:53.194183 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d35e83a-4e22-4375-88b6-1d1605044260 None admin] SCRIPT_NAME: `/identity` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:19:53.194770 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d35e83a-4e22-4375-88b6-1d1605044260 None admin] PATH_INFO: `/v3/projects` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:19:53.195982 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d35e83a-4e22-4375-88b6-1d1605044260 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:19:53.198624 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d35e83a-4e22-4375-88b6-1d1605044260 None admin] RBAC: Authorization granted {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:19:53.199368 dv-cinder-851351-1-smb devstack@keystone.service[479852]: [pid: 479852|app: 0|req: 482/944] 10.222.0.42 () {56 vars in 1122 bytes} [Thu Jul 28 09:19:52 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 09:19:53.200399 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea7e1eeb-d8b9-4b39-b31d-da8fd02a6e72 None admin] Authenticating user token {{(pid=479852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:19:53.202804 dv-cinder-851351-1-smb devstack@keystone.service[479851]: WARNING keystone.server.flask.common [None req-7d35e83a-4e22-4375-88b6-1d1605044260 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Jul 28 09:19:53.226156 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.sql.core [None req-7d35e83a-4e22-4375-88b6-1d1605044260 None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jul 28 09:19:53.226156 dv-cinder-851351-1-smb devstack@keystone.service[479851]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Jul 28 09:19:53.226156 dv-cinder-851351-1-smb devstack@keystone.service[479851]: [parameters: {'id': '96bc38abade54841906eb45b18293cab', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Jul 28 09:19:53.226156 dv-cinder-851351-1-smb devstack@keystone.service[479851]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=479851) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jul 28 09:19:53.236771 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application [None req-7d35e83a-4e22-4375-88b6-1d1605044260 None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 96bc38abade54841906eb45b18293cab.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 96bc38abade54841906eb45b18293cab. Jul 28 09:19:53.236771 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 09:19:53.236771 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 28 09:19:53.236771 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 28 09:19:53.236771 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 28 09:19:53.236771 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 28 09:19:53.236771 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 28 09:19:53.236771 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application result = self._query(query) Jul 28 09:19:53.236771 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 28 09:19:53.236771 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application conn.query(q) Jul 28 09:19:53.236771 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 28 09:19:53.236771 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 28 09:19:53.236771 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 28 09:19:53.237856 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application result.read() Jul 28 09:19:53.237856 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 28 09:19:53.237856 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 28 09:19:53.237856 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 28 09:19:53.237856 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 28 09:19:53.237856 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 28 09:19:53.237856 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 28 09:19:53.237856 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 28 09:19:53.237856 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 28 09:19:53.237856 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jul 28 09:19:53.237856 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application Jul 28 09:19:53.237856 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jul 28 09:19:53.237856 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application Jul 28 09:19:53.237856 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 09:19:53.237856 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jul 28 09:19:53.237856 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jul 28 09:19:53.237856 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Jul 28 09:19:53.237856 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return project_ref.to_dict() Jul 28 09:19:53.239056 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 28 09:19:53.239056 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application next(self.gen) Jul 28 09:19:53.239056 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jul 28 09:19:53.239056 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application yield resource Jul 28 09:19:53.239056 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 28 09:19:53.239056 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application next(self.gen) Jul 28 09:19:53.239056 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jul 28 09:19:53.239056 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application self.session.rollback() Jul 28 09:19:53.239056 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 28 09:19:53.239056 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application self.force_reraise() Jul 28 09:19:53.239056 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 28 09:19:53.239056 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application raise self.value Jul 28 09:19:53.239056 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jul 28 09:19:53.239056 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jul 28 09:19:53.239056 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jul 28 09:19:53.239056 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application session.commit() Jul 28 09:19:53.239056 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jul 28 09:19:53.240146 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jul 28 09:19:53.240146 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jul 28 09:19:53.240146 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application self._prepare_impl() Jul 28 09:19:53.240146 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jul 28 09:19:53.240146 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application self.session.flush() Jul 28 09:19:53.240146 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jul 28 09:19:53.240146 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application self._flush(objects) Jul 28 09:19:53.240146 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jul 28 09:19:53.240146 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jul 28 09:19:53.240146 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jul 28 09:19:53.240146 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application compat.raise_( Jul 28 09:19:53.240146 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 28 09:19:53.240146 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application raise exception Jul 28 09:19:53.240146 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jul 28 09:19:53.240146 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application flush_context.execute() Jul 28 09:19:53.240146 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jul 28 09:19:53.240146 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application rec.execute(self) Jul 28 09:19:53.241244 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jul 28 09:19:53.241244 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jul 28 09:19:53.241244 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jul 28 09:19:53.241244 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application _emit_insert_statements( Jul 28 09:19:53.241244 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Jul 28 09:19:53.241244 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application c = connection._execute_20( Jul 28 09:19:53.241244 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jul 28 09:19:53.241244 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jul 28 09:19:53.241244 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Jul 28 09:19:53.241244 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jul 28 09:19:53.241244 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jul 28 09:19:53.241244 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application ret = self._execute_context( Jul 28 09:19:53.241244 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jul 28 09:19:53.241244 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jul 28 09:19:53.241244 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jul 28 09:19:53.243471 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jul 28 09:19:53.243471 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 28 09:19:53.243471 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application raise exception Jul 28 09:19:53.243471 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 28 09:19:53.243471 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 28 09:19:53.243471 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 28 09:19:53.243471 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 28 09:19:53.243471 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 28 09:19:53.243471 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application result = self._query(query) Jul 28 09:19:53.243471 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 28 09:19:53.243471 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application conn.query(q) Jul 28 09:19:53.243471 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 28 09:19:53.243471 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 28 09:19:53.243471 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 28 09:19:53.243471 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application result.read() Jul 28 09:19:53.243471 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 28 09:19:53.243471 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 28 09:19:53.251582 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 28 09:19:53.251582 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 28 09:19:53.251582 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 28 09:19:53.251582 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 28 09:19:53.251582 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 28 09:19:53.251582 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 28 09:19:53.251582 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jul 28 09:19:53.251582 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Jul 28 09:19:53.251582 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application [parameters: {'id': '96bc38abade54841906eb45b18293cab', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Jul 28 09:19:53.251582 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jul 28 09:19:53.251582 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application Jul 28 09:19:53.251582 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 28 09:19:53.251582 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application Jul 28 09:19:53.251582 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 09:19:53.251582 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Jul 28 09:19:53.253959 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Jul 28 09:19:53.253959 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jul 28 09:19:53.253959 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jul 28 09:19:53.253959 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Jul 28 09:19:53.253959 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application Jul 28 09:19:53.253959 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 28 09:19:53.253959 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application Jul 28 09:19:53.253959 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 09:19:53.253959 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 09:19:53.253959 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 09:19:53.253959 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 09:19:53.253959 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 09:19:53.253959 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 09:19:53.253959 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 09:19:53.253959 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 09:19:53.253959 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 09:19:53.253959 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 09:19:53.256829 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 09:19:53.256829 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Jul 28 09:19:53.256829 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Jul 28 09:19:53.256829 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 09:19:53.256829 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 09:19:53.256829 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Jul 28 09:19:53.256829 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application raise exception.Conflict( Jul 28 09:19:53.256829 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 96bc38abade54841906eb45b18293cab. Jul 28 09:19:53.256829 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application Jul 28 09:19:53.256829 dv-cinder-851351-1-smb devstack@keystone.service[479851]: [pid: 479851|app: 0|req: 463/945] 10.222.0.42 () {60 vars in 1140 bytes} [Thu Jul 28 09:19:52 2022] POST /identity/v3/projects => generated 262 bytes in 266 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Jul 28 09:19:53.256829 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d35e83a-4e22-4375-88b6-1d1605044260 None admin] Authenticating user token {{(pid=479851) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:19:53.367164 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea7e1eeb-d8b9-4b39-b31d-da8fd02a6e72 None admin] Validating token access rules against request {{(pid=479852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:19:53.398294 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d35e83a-4e22-4375-88b6-1d1605044260 None admin] Validating token access rules against request {{(pid=479851) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:19:53.413036 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7f6c3e-190a-4957-a6eb-e4d2801aca7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:19:53.413838 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7f6c3e-190a-4957-a6eb-e4d2801aca7b None admin] REQUEST_METHOD: `GET` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:19:53.414216 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7f6c3e-190a-4957-a6eb-e4d2801aca7b None admin] SCRIPT_NAME: `/identity` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:19:53.414739 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7f6c3e-190a-4957-a6eb-e4d2801aca7b None admin] PATH_INFO: `/v3/endpoints` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:19:53.415735 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e7f6c3e-190a-4957-a6eb-e4d2801aca7b None admin] RBAC: Adding query filter params (interface=public, service_id=724a27a8116d4456b6228102e22cfba1, region_id=RegionOne) {{(pid=479852) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 09:19:53.416148 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e7f6c3e-190a-4957-a6eb-e4d2801aca7b None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:19:53.417739 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e7f6c3e-190a-4957-a6eb-e4d2801aca7b None admin] RBAC: Authorization granted {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:19:53.424140 dv-cinder-851351-1-smb devstack@keystone.service[479852]: [pid: 479852|app: 0|req: 483/946] 10.222.0.42 () {56 vars in 1251 bytes} [Thu Jul 28 09:19:53 2022] GET /identity/v3/endpoints?service_id=724a27a8116d4456b6228102e22cfba1&interface=public®ion_id=RegionOne => generated 194 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 09:19:53.429781 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7f6c3e-190a-4957-a6eb-e4d2801aca7b None admin] Authenticating user token {{(pid=479852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:19:53.440420 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG dbcounter [-] [479851] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=479851) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:19:53.449523 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-031a7c9c-a56e-4b3e-99af-7cbc1a0d4852 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479851) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:19:53.450829 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031a7c9c-a56e-4b3e-99af-7cbc1a0d4852 None admin] REQUEST_METHOD: `GET` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:19:53.451869 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031a7c9c-a56e-4b3e-99af-7cbc1a0d4852 None admin] SCRIPT_NAME: `/identity` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:19:53.452527 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031a7c9c-a56e-4b3e-99af-7cbc1a0d4852 None admin] PATH_INFO: `/v3/projects/service` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:19:53.462326 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-031a7c9c-a56e-4b3e-99af-7cbc1a0d4852 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:19:53.463368 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG dbcounter [-] [479852] Writing DB stats keystone:SELECT=100 {{(pid=479852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:19:53.467450 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-031a7c9c-a56e-4b3e-99af-7cbc1a0d4852 None admin] RBAC: Authorization granted {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:19:53.484108 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application [None req-031a7c9c-a56e-4b3e-99af-7cbc1a0d4852 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 09:19:53.484108 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 09:19:53.484108 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 09:19:53.484108 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 09:19:53.484108 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 09:19:53.484108 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 09:19:53.484108 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 09:19:53.484108 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 09:19:53.484108 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 09:19:53.484108 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 09:19:53.484108 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 09:19:53.484108 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 09:19:53.484108 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 28 09:19:53.484108 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 28 09:19:53.484108 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 28 09:19:53.485484 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 28 09:19:53.485484 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 09:19:53.485484 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 09:19:53.485484 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 09:19:53.485484 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 09:19:53.485484 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 09:19:53.485484 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 09:19:53.485484 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 09:19:53.485484 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application with Lock( Jul 28 09:19:53.485484 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 09:19:53.485484 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return self._enter() Jul 28 09:19:53.485484 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 09:19:53.485484 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 09:19:53.485484 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 09:19:53.485484 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return self.creator() Jul 28 09:19:53.485484 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 09:19:53.485484 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application created_value = creator( Jul 28 09:19:53.486799 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 28 09:19:53.486799 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 28 09:19:53.486799 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 28 09:19:53.486799 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 28 09:19:53.486799 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 28 09:19:53.486799 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 28 09:19:53.486799 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 09:19:53.486799 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application Jul 28 09:19:53.494772 dv-cinder-851351-1-smb devstack@keystone.service[479851]: [pid: 479851|app: 0|req: 464/947] 10.222.0.42 () {56 vars in 1111 bytes} [Thu Jul 28 09:19:53 2022] GET /identity/v3/projects/service => generated 88 bytes in 244 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 09:19:53.496461 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-031a7c9c-a56e-4b3e-99af-7cbc1a0d4852 None admin] Authenticating user token {{(pid=479851) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:19:53.564924 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7f6c3e-190a-4957-a6eb-e4d2801aca7b None admin] Validating token access rules against request {{(pid=479852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:19:53.616487 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1a62fa-7610-451e-b465-6c8ca57182e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:19:53.617855 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1a62fa-7610-451e-b465-6c8ca57182e7 None admin] REQUEST_METHOD: `GET` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:19:53.618129 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1a62fa-7610-451e-b465-6c8ca57182e7 None admin] SCRIPT_NAME: `/identity` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:19:53.618507 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1a62fa-7610-451e-b465-6c8ca57182e7 None admin] PATH_INFO: `/v3/services` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:19:53.619364 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef1a62fa-7610-451e-b465-6c8ca57182e7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:19:53.621029 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef1a62fa-7610-451e-b465-6c8ca57182e7 None admin] RBAC: Authorization granted {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:19:53.635120 dv-cinder-851351-1-smb devstack@keystone.service[479852]: [pid: 479852|app: 0|req: 484/948] 10.222.0.42 () {56 vars in 1087 bytes} [Thu Jul 28 09:19:53 2022] GET /identity/v3/services => generated 1497 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 09:19:53.637980 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-031a7c9c-a56e-4b3e-99af-7cbc1a0d4852 None admin] Validating token access rules against request {{(pid=479851) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:19:53.683884 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d952a3d-986c-4d13-827f-97d52f98201e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479851) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:19:53.684976 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d952a3d-986c-4d13-827f-97d52f98201e None admin] REQUEST_METHOD: `GET` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:19:53.685522 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d952a3d-986c-4d13-827f-97d52f98201e None admin] SCRIPT_NAME: `/identity` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:19:53.685971 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d952a3d-986c-4d13-827f-97d52f98201e None admin] PATH_INFO: `/v3/projects` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:19:53.687075 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d952a3d-986c-4d13-827f-97d52f98201e None admin] RBAC: Adding query filter params (name=service) {{(pid=479851) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 09:19:53.687618 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d952a3d-986c-4d13-827f-97d52f98201e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:19:53.689350 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d952a3d-986c-4d13-827f-97d52f98201e None admin] RBAC: Authorization granted {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:19:53.715341 dv-cinder-851351-1-smb devstack@keystone.service[479851]: [pid: 479851|app: 0|req: 465/949] 10.222.0.42 () {56 vars in 1112 bytes} [Thu Jul 28 09:19:53 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:19:54.663094 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c65a9c2-c687-4625-8319-187789f90770 None None] REQUEST_METHOD: `GET` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:19:54.663631 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c65a9c2-c687-4625-8319-187789f90770 None None] SCRIPT_NAME: `/identity` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:19:54.663631 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c65a9c2-c687-4625-8319-187789f90770 None None] PATH_INFO: `/` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:19:54.665414 dv-cinder-851351-1-smb devstack@keystone.service[479852]: [pid: 479852|app: 0|req: 485/950] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 09:19:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 09:19:54.671431 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a55707e-b79c-46a4-8b63-a8124ebea80e None None] REQUEST_METHOD: `POST` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:19:54.671949 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a55707e-b79c-46a4-8b63-a8124ebea80e None None] SCRIPT_NAME: `/identity` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:19:54.672201 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a55707e-b79c-46a4-8b63-a8124ebea80e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:19:54.693314 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.auth.core [None req-8a55707e-b79c-46a4-8b63-a8124ebea80e None None] MFA Rules not processed for user `c198f91a4ae84d2b9cc730a6e304c2be`. Rule list: `[]` (Enabled: `True`). {{(pid=479851) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 09:19:54.695083 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.fernet_utils [None req-8a55707e-b79c-46a4-8b63-a8124ebea80e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=479851) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 09:19:54.751464 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG dbcounter [-] [479851] Writing DB stats keystone:SELECT=100 {{(pid=479851) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:19:54.781056 dv-cinder-851351-1-smb devstack@keystone.service[479851]: [pid: 479851|app: 0|req: 466/951] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 09:19:54 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 09:19:54.808525 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c65a9c2-c687-4625-8319-187789f90770 None None] Authenticating user token {{(pid=479852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:19:54.906365 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG dbcounter [-] [479852] Writing DB stats keystone:SELECT=100 {{(pid=479852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:19:54.922538 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c65a9c2-c687-4625-8319-187789f90770 None None] Validating token access rules against request {{(pid=479852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:19:54.962984 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6077d984-f37d-4ae7-ab6c-7ed88a7a4756 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:19:54.963640 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6077d984-f37d-4ae7-ab6c-7ed88a7a4756 None admin] REQUEST_METHOD: `GET` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:19:54.963920 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6077d984-f37d-4ae7-ab6c-7ed88a7a4756 None admin] SCRIPT_NAME: `/identity` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:19:54.964196 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6077d984-f37d-4ae7-ab6c-7ed88a7a4756 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:19:54.975661 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6077d984-f37d-4ae7-ab6c-7ed88a7a4756 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 09:19:54.980801 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application [None req-6077d984-f37d-4ae7-ab6c-7ed88a7a4756 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 28 09:19:54.980801 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 09:19:54.980801 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 09:19:54.980801 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 09:19:54.980801 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 09:19:54.980801 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 09:19:54.980801 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 09:19:54.980801 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 09:19:54.980801 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 09:19:54.980801 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 09:19:54.980801 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 09:19:54.980801 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 09:19:54.980801 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 09:19:54.980801 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 09:19:54.980801 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 09:19:54.980801 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 09:19:54.981877 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 09:19:54.981877 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 09:19:54.981877 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 09:19:54.981877 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 09:19:54.981877 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 09:19:54.981877 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 09:19:54.981877 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 09:19:54.981877 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 09:19:54.981877 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 09:19:54.981877 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 09:19:54.981877 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 09:19:54.981877 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application with Lock( Jul 28 09:19:54.981877 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 09:19:54.981877 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self._enter() Jul 28 09:19:54.981877 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 09:19:54.981877 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 09:19:54.982884 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 09:19:54.982884 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self.creator() Jul 28 09:19:54.982884 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 09:19:54.982884 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application created_value = creator( Jul 28 09:19:54.982884 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 09:19:54.982884 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 09:19:54.982884 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 09:19:54.982884 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 09:19:54.982884 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 09:19:54.982884 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 09:19:54.982884 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 28 09:19:54.982884 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application Jul 28 09:19:54.982884 dv-cinder-851351-1-smb devstack@keystone.service[479852]: [pid: 479852|app: 0|req: 486/952] 10.222.0.42 () {56 vars in 1120 bytes} [Thu Jul 28 09:19:54 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 09:19:54.988387 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a55707e-b79c-46a4-8b63-a8124ebea80e None None] Authenticating user token {{(pid=479851) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:19:55.143005 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a55707e-b79c-46a4-8b63-a8124ebea80e None None] Validating token access rules against request {{(pid=479851) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:19:55.202884 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afae47c0-d496-493f-a797-6a914191597f None None] REQUEST_METHOD: `GET` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:19:55.203093 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afae47c0-d496-493f-a797-6a914191597f None None] SCRIPT_NAME: `/identity` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:19:55.203356 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afae47c0-d496-493f-a797-6a914191597f None None] PATH_INFO: `/` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:19:55.205033 dv-cinder-851351-1-smb devstack@keystone.service[479852]: [pid: 479852|app: 0|req: 487/953] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 09:19:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 28 09:19:55.206289 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7214024d-3132-4980-8ffd-413f09c949b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479851) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:19:55.207341 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7214024d-3132-4980-8ffd-413f09c949b6 None admin] REQUEST_METHOD: `GET` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:19:55.207866 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7214024d-3132-4980-8ffd-413f09c949b6 None admin] SCRIPT_NAME: `/identity` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:19:55.208341 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7214024d-3132-4980-8ffd-413f09c949b6 None admin] PATH_INFO: `/v3/roles` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:19:55.209746 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7214024d-3132-4980-8ffd-413f09c949b6 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=479851) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 09:19:55.210055 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fefdf512-4155-48d7-b602-8c517c4a2d83 None None] REQUEST_METHOD: `POST` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:19:55.210276 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7214024d-3132-4980-8ffd-413f09c949b6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:19:55.210387 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fefdf512-4155-48d7-b602-8c517c4a2d83 None None] SCRIPT_NAME: `/identity` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:19:55.210610 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fefdf512-4155-48d7-b602-8c517c4a2d83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:19:55.212874 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7214024d-3132-4980-8ffd-413f09c949b6 None admin] RBAC: Authorization granted {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:19:55.230506 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.auth.core [None req-fefdf512-4155-48d7-b602-8c517c4a2d83 None None] MFA Rules not processed for user `c198f91a4ae84d2b9cc730a6e304c2be`. Rule list: `[]` (Enabled: `True`). {{(pid=479852) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 09:19:55.230742 dv-cinder-851351-1-smb devstack@keystone.service[479851]: [pid: 479851|app: 0|req: 467/954] 10.222.0.42 () {56 vars in 1115 bytes} [Thu Jul 28 09:19:54 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:19:55.231790 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.fernet_utils [None req-fefdf512-4155-48d7-b602-8c517c4a2d83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=479852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 09:19:55.240133 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7214024d-3132-4980-8ffd-413f09c949b6 None admin] Authenticating user token {{(pid=479851) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:19:55.294373 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG dbcounter [-] [479851] Writing DB stats keystone:SELECT=100 {{(pid=479851) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:19:55.308817 dv-cinder-851351-1-smb devstack@keystone.service[479852]: [pid: 479852|app: 0|req: 488/955] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 09:19:55 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 28 09:19:55.331374 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fefdf512-4155-48d7-b602-8c517c4a2d83 None None] Authenticating user token {{(pid=479852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:19:55.356902 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7214024d-3132-4980-8ffd-413f09c949b6 None admin] Validating token access rules against request {{(pid=479851) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:19:55.393483 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5609b6f3-a3a6-4966-98e0-2a9f928e2183 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479851) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:19:55.394199 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5609b6f3-a3a6-4966-98e0-2a9f928e2183 None admin] REQUEST_METHOD: `GET` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:19:55.394824 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5609b6f3-a3a6-4966-98e0-2a9f928e2183 None admin] SCRIPT_NAME: `/identity` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:19:55.395321 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5609b6f3-a3a6-4966-98e0-2a9f928e2183 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:19:55.407015 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5609b6f3-a3a6-4966-98e0-2a9f928e2183 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:19:55.408803 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5609b6f3-a3a6-4966-98e0-2a9f928e2183 None admin] RBAC: Authorization granted {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:19:55.411991 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG dbcounter [-] [479852] Writing DB stats keystone:SELECT=100 {{(pid=479852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:19:55.426963 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application [None req-5609b6f3-a3a6-4966-98e0-2a9f928e2183 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 09:19:55.426963 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 09:19:55.426963 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 09:19:55.426963 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 09:19:55.426963 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 09:19:55.426963 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 09:19:55.426963 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 09:19:55.426963 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 09:19:55.426963 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 09:19:55.426963 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 09:19:55.426963 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 09:19:55.426963 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 09:19:55.426963 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 09:19:55.426963 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 09:19:55.426963 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 09:19:55.428235 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 09:19:55.428235 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 09:19:55.428235 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 09:19:55.428235 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 09:19:55.428235 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 09:19:55.428235 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 09:19:55.428235 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 09:19:55.428235 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 09:19:55.428235 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application with Lock( Jul 28 09:19:55.428235 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 09:19:55.428235 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return self._enter() Jul 28 09:19:55.428235 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 09:19:55.428235 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 09:19:55.428235 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 09:19:55.428235 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return self.creator() Jul 28 09:19:55.428235 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 09:19:55.428235 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application created_value = creator( Jul 28 09:19:55.429371 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 09:19:55.429371 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 09:19:55.429371 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 09:19:55.429371 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application Jul 28 09:19:55.433705 dv-cinder-851351-1-smb devstack@keystone.service[479851]: [pid: 479851|app: 0|req: 468/956] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 09:19:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 09:19:55.434784 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5609b6f3-a3a6-4966-98e0-2a9f928e2183 None admin] Authenticating user token {{(pid=479851) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:19:55.437198 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fefdf512-4155-48d7-b602-8c517c4a2d83 None None] Validating token access rules against request {{(pid=479852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:19:55.476948 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5b00ff-fdae-4725-8ca5-700f066f7918 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:19:55.477701 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5b00ff-fdae-4725-8ca5-700f066f7918 None admin] REQUEST_METHOD: `GET` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:19:55.478231 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5b00ff-fdae-4725-8ca5-700f066f7918 None admin] SCRIPT_NAME: `/identity` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:19:55.478926 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5b00ff-fdae-4725-8ca5-700f066f7918 None admin] PATH_INFO: `/v3/services/compute` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:19:55.480083 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a5b00ff-fdae-4725-8ca5-700f066f7918 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:19:55.482051 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a5b00ff-fdae-4725-8ca5-700f066f7918 None admin] RBAC: Authorization granted {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:19:55.492986 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application [None req-1a5b00ff-fdae-4725-8ca5-700f066f7918 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jul 28 09:19:55.492986 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 09:19:55.492986 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 28 09:19:55.492986 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 28 09:19:55.492986 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 28 09:19:55.492986 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 28 09:19:55.492986 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 28 09:19:55.492986 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 09:19:55.492986 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 28 09:19:55.492986 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application Jul 28 09:19:55.492986 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 28 09:19:55.492986 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application Jul 28 09:19:55.492986 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 09:19:55.492986 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 09:19:55.492986 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 09:19:55.492986 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 09:19:55.492986 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 09:19:55.495595 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 09:19:55.495595 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 09:19:55.495595 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 09:19:55.495595 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 09:19:55.495595 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 09:19:55.495595 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 09:19:55.495595 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 28 09:19:55.495595 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 28 09:19:55.495595 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 28 09:19:55.495595 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 28 09:19:55.495595 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 09:19:55.495595 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 09:19:55.495595 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 09:19:55.495595 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 09:19:55.495595 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 09:19:55.495595 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 09:19:55.497950 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 09:19:55.497950 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application with Lock( Jul 28 09:19:55.497950 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 09:19:55.497950 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self._enter() Jul 28 09:19:55.497950 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 09:19:55.497950 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 09:19:55.497950 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 09:19:55.497950 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self.creator() Jul 28 09:19:55.497950 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 09:19:55.497950 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application created_value = creator( Jul 28 09:19:55.497950 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 28 09:19:55.497950 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 09:19:55.497950 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 28 09:19:55.497950 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application Jul 28 09:19:55.497950 dv-cinder-851351-1-smb devstack@keystone.service[479852]: [pid: 479852|app: 0|req: 489/957] 10.222.0.42 () {56 vars in 1111 bytes} [Thu Jul 28 09:19:55 2022] GET /identity/v3/services/compute => generated 88 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 09:19:55.505238 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5b00ff-fdae-4725-8ca5-700f066f7918 None admin] Authenticating user token {{(pid=479852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:19:55.547938 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG dbcounter [-] [479851] Writing DB stats keystone:SELECT=100 {{(pid=479851) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:19:55.557446 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5609b6f3-a3a6-4966-98e0-2a9f928e2183 None admin] Validating token access rules against request {{(pid=479851) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:19:55.599783 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0fae12-6734-4cfc-ac89-d2006b78e5b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479851) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:19:55.600875 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0fae12-6734-4cfc-ac89-d2006b78e5b8 None admin] REQUEST_METHOD: `GET` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:19:55.601346 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0fae12-6734-4cfc-ac89-d2006b78e5b8 None admin] SCRIPT_NAME: `/identity` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:19:55.601800 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0fae12-6734-4cfc-ac89-d2006b78e5b8 None admin] PATH_INFO: `/v3/domains` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:19:55.602670 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e0fae12-6734-4cfc-ac89-d2006b78e5b8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=479851) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 09:19:55.603147 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e0fae12-6734-4cfc-ac89-d2006b78e5b8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:19:55.604764 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e0fae12-6734-4cfc-ac89-d2006b78e5b8 None admin] RBAC: Authorization granted {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:19:55.619773 dv-cinder-851351-1-smb devstack@keystone.service[479851]: [pid: 479851|app: 0|req: 469/958] 10.222.0.42 () {56 vars in 1109 bytes} [Thu Jul 28 09:19:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:19:55.628845 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0fae12-6734-4cfc-ac89-d2006b78e5b8 None admin] Authenticating user token {{(pid=479851) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:19:55.666618 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5b00ff-fdae-4725-8ca5-700f066f7918 None admin] Validating token access rules against request {{(pid=479852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:19:55.708001 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be4d6f11-7812-4229-ab74-522ef8d5576a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:19:55.708657 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4d6f11-7812-4229-ab74-522ef8d5576a None admin] REQUEST_METHOD: `GET` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:19:55.708978 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4d6f11-7812-4229-ab74-522ef8d5576a None admin] SCRIPT_NAME: `/identity` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:19:55.709254 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4d6f11-7812-4229-ab74-522ef8d5576a None admin] PATH_INFO: `/v3/services` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:19:55.709948 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be4d6f11-7812-4229-ab74-522ef8d5576a None admin] RBAC: Adding query filter params (name=compute) {{(pid=479852) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 09:19:55.710250 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be4d6f11-7812-4229-ab74-522ef8d5576a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:19:55.711638 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be4d6f11-7812-4229-ab74-522ef8d5576a None admin] RBAC: Authorization granted {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:19:55.721665 dv-cinder-851351-1-smb devstack@keystone.service[479852]: [pid: 479852|app: 0|req: 490/959] 10.222.0.42 () {56 vars in 1112 bytes} [Thu Jul 28 09:19:55 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 09:19:55.722838 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be4d6f11-7812-4229-ab74-522ef8d5576a None admin] Authenticating user token {{(pid=479852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:19:55.734547 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG dbcounter [-] [479852] Writing DB stats keystone:SELECT=100 {{(pid=479852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:19:55.760844 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0fae12-6734-4cfc-ac89-d2006b78e5b8 None admin] Validating token access rules against request {{(pid=479851) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:19:55.810597 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b501f19-6ef4-4baa-8306-0af9970842c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479851) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:19:55.811267 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b501f19-6ef4-4baa-8306-0af9970842c8 None admin] REQUEST_METHOD: `GET` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:19:55.811554 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b501f19-6ef4-4baa-8306-0af9970842c8 None admin] SCRIPT_NAME: `/identity` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:19:55.811830 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b501f19-6ef4-4baa-8306-0af9970842c8 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:19:55.822136 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b501f19-6ef4-4baa-8306-0af9970842c8 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:19:55.825709 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b501f19-6ef4-4baa-8306-0af9970842c8 None admin] RBAC: Authorization granted {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:19:55.843455 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application [None req-0b501f19-6ef4-4baa-8306-0af9970842c8 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 28 09:19:55.843455 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 09:19:55.843455 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 09:19:55.843455 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 09:19:55.843455 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 09:19:55.843455 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 09:19:55.843455 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 09:19:55.843455 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 09:19:55.843455 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 09:19:55.843455 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 09:19:55.843455 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 09:19:55.843455 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 09:19:55.843455 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 28 09:19:55.843455 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 28 09:19:55.843455 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 28 09:19:55.843455 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 28 09:19:55.844760 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 09:19:55.844760 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 09:19:55.844760 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 28 09:19:55.844760 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 09:19:55.844760 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 28 09:19:55.844760 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 09:19:55.844760 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 09:19:55.844760 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 09:19:55.844760 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 09:19:55.844760 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 09:19:55.844760 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 09:19:55.844760 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application with Lock( Jul 28 09:19:55.844760 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 09:19:55.844760 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return self._enter() Jul 28 09:19:55.844760 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 09:19:55.844760 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 09:19:55.844760 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 09:19:55.844760 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return self.creator() Jul 28 09:19:55.845899 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 09:19:55.845899 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application created_value = creator( Jul 28 09:19:55.845899 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 28 09:19:55.845899 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 28 09:19:55.845899 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 28 09:19:55.845899 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 28 09:19:55.845899 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 28 09:19:55.845899 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 28 09:19:55.845899 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 28 09:19:55.845899 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application Jul 28 09:19:55.848745 dv-cinder-851351-1-smb devstack@keystone.service[479851]: [pid: 479851|app: 0|req: 470/960] 10.222.0.42 () {56 vars in 1117 bytes} [Thu Jul 28 09:19:55 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 09:19:55.850765 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b501f19-6ef4-4baa-8306-0af9970842c8 None admin] Authenticating user token {{(pid=479851) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:19:55.861169 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be4d6f11-7812-4229-ab74-522ef8d5576a None admin] Validating token access rules against request {{(pid=479852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:19:55.873675 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG dbcounter [-] [479851] Writing DB stats keystone:SELECT=100 {{(pid=479851) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:19:55.915816 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f95b1e6-9a28-45d3-b2b5-258a5fcdf5ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:19:55.916900 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f95b1e6-9a28-45d3-b2b5-258a5fcdf5ff None admin] REQUEST_METHOD: `GET` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:19:55.917394 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f95b1e6-9a28-45d3-b2b5-258a5fcdf5ff None admin] SCRIPT_NAME: `/identity` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:19:55.917882 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f95b1e6-9a28-45d3-b2b5-258a5fcdf5ff None admin] PATH_INFO: `/v3/services` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:19:55.918785 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f95b1e6-9a28-45d3-b2b5-258a5fcdf5ff None admin] RBAC: Adding query filter params (type=compute) {{(pid=479852) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 09:19:55.919317 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f95b1e6-9a28-45d3-b2b5-258a5fcdf5ff None admin] RBAC: Authorizing `identity:list_services()` {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:19:55.920950 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f95b1e6-9a28-45d3-b2b5-258a5fcdf5ff None admin] RBAC: Authorization granted {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:19:55.927157 dv-cinder-851351-1-smb devstack@keystone.service[479852]: [pid: 479852|app: 0|req: 491/961] 10.222.0.42 () {56 vars in 1112 bytes} [Thu Jul 28 09:19:55 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:19:56.025836 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b501f19-6ef4-4baa-8306-0af9970842c8 None admin] Validating token access rules against request {{(pid=479851) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:19:56.046102 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a56023f-fcb1-4d8c-b52a-a6e6193760ce None None] REQUEST_METHOD: `GET` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:19:56.047096 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a56023f-fcb1-4d8c-b52a-a6e6193760ce None None] SCRIPT_NAME: `/identity` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:19:56.047639 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a56023f-fcb1-4d8c-b52a-a6e6193760ce None None] PATH_INFO: `/` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:19:56.050523 dv-cinder-851351-1-smb devstack@keystone.service[479852]: [pid: 479852|app: 0|req: 492/962] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 09:19:56 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 28 09:19:56.057818 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec999a65-a5b4-4b89-8f05-eec7ff5bdf0f None None] REQUEST_METHOD: `POST` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:19:56.058096 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec999a65-a5b4-4b89-8f05-eec7ff5bdf0f None None] SCRIPT_NAME: `/identity` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:19:56.058418 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec999a65-a5b4-4b89-8f05-eec7ff5bdf0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:19:56.087725 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.auth.core [None req-ec999a65-a5b4-4b89-8f05-eec7ff5bdf0f None None] MFA Rules not processed for user `c198f91a4ae84d2b9cc730a6e304c2be`. Rule list: `[]` (Enabled: `True`). {{(pid=479852) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 09:19:56.089090 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.fernet_utils [None req-ec999a65-a5b4-4b89-8f05-eec7ff5bdf0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=479852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 09:19:56.097523 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d732df9-7226-41a7-84ae-e07740b75d15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479851) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:19:56.097523 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d732df9-7226-41a7-84ae-e07740b75d15 None admin] REQUEST_METHOD: `GET` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:19:56.097523 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d732df9-7226-41a7-84ae-e07740b75d15 None admin] SCRIPT_NAME: `/identity` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:19:56.097523 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d732df9-7226-41a7-84ae-e07740b75d15 None admin] PATH_INFO: `/v3/users` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:19:56.098306 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d732df9-7226-41a7-84ae-e07740b75d15 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=479851) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 09:19:56.098673 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d732df9-7226-41a7-84ae-e07740b75d15 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:19:56.099984 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d732df9-7226-41a7-84ae-e07740b75d15 None admin] RBAC: Authorization granted {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:19:56.120790 dv-cinder-851351-1-smb devstack@keystone.service[479851]: [pid: 479851|app: 0|req: 471/963] 10.222.0.42 () {56 vars in 1149 bytes} [Thu Jul 28 09:19:55 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:19:56.122182 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ca27b8-5089-4d25-b0a9-255f1e123eb7 None None] REQUEST_METHOD: `GET` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:19:56.122596 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ca27b8-5089-4d25-b0a9-255f1e123eb7 None None] SCRIPT_NAME: `/identity` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:19:56.122884 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ca27b8-5089-4d25-b0a9-255f1e123eb7 None None] PATH_INFO: `/` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:19:56.124143 dv-cinder-851351-1-smb devstack@keystone.service[479851]: [pid: 479851|app: 0|req: 472/964] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 09:19:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 09:19:56.130669 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8fbf58-bf2b-4b9d-8089-7db8033f45a9 None None] REQUEST_METHOD: `POST` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:19:56.130972 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8fbf58-bf2b-4b9d-8089-7db8033f45a9 None None] SCRIPT_NAME: `/identity` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:19:56.131330 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8fbf58-bf2b-4b9d-8089-7db8033f45a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:19:56.150969 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.auth.core [None req-ad8fbf58-bf2b-4b9d-8089-7db8033f45a9 None None] MFA Rules not processed for user `c198f91a4ae84d2b9cc730a6e304c2be`. Rule list: `[]` (Enabled: `True`). {{(pid=479851) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 09:19:56.152207 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.fernet_utils [None req-ad8fbf58-bf2b-4b9d-8089-7db8033f45a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=479851) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 09:19:56.164235 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG dbcounter [-] [479852] Writing DB stats keystone:SELECT=100 {{(pid=479852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:19:56.170091 dv-cinder-851351-1-smb devstack@keystone.service[479852]: [pid: 479852|app: 0|req: 493/965] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 09:19:56 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 28 09:19:56.170918 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec999a65-a5b4-4b89-8f05-eec7ff5bdf0f None None] Authenticating user token {{(pid=479852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:19:56.241842 dv-cinder-851351-1-smb devstack@keystone.service[479851]: [pid: 479851|app: 0|req: 473/966] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 09:19:56 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 09:19:56.242751 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad8fbf58-bf2b-4b9d-8089-7db8033f45a9 None None] Authenticating user token {{(pid=479851) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:19:56.245361 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG dbcounter [-] [479851] Writing DB stats keystone:SELECT=100 {{(pid=479851) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:19:56.298506 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec999a65-a5b4-4b89-8f05-eec7ff5bdf0f None None] Validating token access rules against request {{(pid=479852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:19:56.337681 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46cb0170-81f6-4577-a6f3-ed44a0b46e4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:19:56.338318 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46cb0170-81f6-4577-a6f3-ed44a0b46e4e None admin] REQUEST_METHOD: `GET` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:19:56.338700 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46cb0170-81f6-4577-a6f3-ed44a0b46e4e None admin] SCRIPT_NAME: `/identity` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:19:56.338876 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46cb0170-81f6-4577-a6f3-ed44a0b46e4e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:19:56.363871 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad8fbf58-bf2b-4b9d-8089-7db8033f45a9 None None] Validating token access rules against request {{(pid=479851) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:19:56.404845 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e266a73-12ab-43c7-b7e4-c0f4e4e2d752 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479851) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:19:56.405582 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e266a73-12ab-43c7-b7e4-c0f4e4e2d752 None admin] REQUEST_METHOD: `POST` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:19:56.405867 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e266a73-12ab-43c7-b7e4-c0f4e4e2d752 None admin] SCRIPT_NAME: `/identity` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:19:56.406143 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e266a73-12ab-43c7-b7e4-c0f4e4e2d752 None admin] PATH_INFO: `/v3/users` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:19:56.406831 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e266a73-12ab-43c7-b7e4-c0f4e4e2d752 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:19:56.408293 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e266a73-12ab-43c7-b7e4-c0f4e4e2d752 None admin] RBAC: Authorization granted {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:19:56.417181 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG dbcounter [-] [479852] Writing DB stats keystone:SELECT=100 {{(pid=479852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:19:56.421517 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46cb0170-81f6-4577-a6f3-ed44a0b46e4e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:19:56.423285 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46cb0170-81f6-4577-a6f3-ed44a0b46e4e None admin] RBAC: Authorization granted {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:19:56.423898 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.sql.core [None req-5e266a73-12ab-43c7-b7e4-c0f4e4e2d752 None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jul 28 09:19:56.423898 dv-cinder-851351-1-smb devstack@keystone.service[479851]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Jul 28 09:19:56.423898 dv-cinder-851351-1-smb devstack@keystone.service[479851]: [parameters: {'user_id': '274eef4360c44fb5991708686bfe54a6', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Jul 28 09:19:56.423898 dv-cinder-851351-1-smb devstack@keystone.service[479851]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=479851) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jul 28 09:19:56.432981 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application [None req-5e266a73-12ab-43c7-b7e4-c0f4e4e2d752 None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Jul 28 09:19:56.432981 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 09:19:56.432981 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 28 09:19:56.432981 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 28 09:19:56.432981 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 28 09:19:56.432981 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 28 09:19:56.432981 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 28 09:19:56.432981 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application result = self._query(query) Jul 28 09:19:56.432981 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 28 09:19:56.432981 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application conn.query(q) Jul 28 09:19:56.432981 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 28 09:19:56.432981 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 28 09:19:56.432981 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 28 09:19:56.432981 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application result.read() Jul 28 09:19:56.432981 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 28 09:19:56.434116 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 28 09:19:56.434116 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 28 09:19:56.434116 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 28 09:19:56.434116 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 28 09:19:56.434116 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 28 09:19:56.434116 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 28 09:19:56.434116 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 28 09:19:56.434116 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jul 28 09:19:56.434116 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application Jul 28 09:19:56.434116 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jul 28 09:19:56.434116 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application Jul 28 09:19:56.434116 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 09:19:56.434116 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jul 28 09:19:56.434116 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jul 28 09:19:56.434116 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Jul 28 09:19:56.434116 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Jul 28 09:19:56.434116 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 28 09:19:56.434116 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application next(self.gen) Jul 28 09:19:56.435550 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jul 28 09:19:56.435550 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application yield resource Jul 28 09:19:56.435550 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 28 09:19:56.435550 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application next(self.gen) Jul 28 09:19:56.435550 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jul 28 09:19:56.435550 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application self.session.rollback() Jul 28 09:19:56.435550 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 28 09:19:56.435550 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application self.force_reraise() Jul 28 09:19:56.435550 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 28 09:19:56.435550 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application raise self.value Jul 28 09:19:56.435550 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jul 28 09:19:56.435550 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jul 28 09:19:56.435550 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jul 28 09:19:56.435550 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application session.commit() Jul 28 09:19:56.435550 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jul 28 09:19:56.435550 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jul 28 09:19:56.435550 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jul 28 09:19:56.436920 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application self._prepare_impl() Jul 28 09:19:56.436920 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jul 28 09:19:56.436920 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application self.session.flush() Jul 28 09:19:56.436920 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jul 28 09:19:56.436920 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application self._flush(objects) Jul 28 09:19:56.436920 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jul 28 09:19:56.436920 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jul 28 09:19:56.436920 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jul 28 09:19:56.436920 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application compat.raise_( Jul 28 09:19:56.436920 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 28 09:19:56.436920 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application raise exception Jul 28 09:19:56.436920 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jul 28 09:19:56.436920 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application flush_context.execute() Jul 28 09:19:56.436920 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jul 28 09:19:56.436920 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application rec.execute(self) Jul 28 09:19:56.436920 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jul 28 09:19:56.436920 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jul 28 09:19:56.438018 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jul 28 09:19:56.438018 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application _emit_insert_statements( Jul 28 09:19:56.438018 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Jul 28 09:19:56.438018 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application result = connection._execute_20( Jul 28 09:19:56.438018 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jul 28 09:19:56.438018 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jul 28 09:19:56.438018 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Jul 28 09:19:56.438018 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jul 28 09:19:56.438018 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jul 28 09:19:56.438018 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application ret = self._execute_context( Jul 28 09:19:56.438018 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jul 28 09:19:56.438018 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jul 28 09:19:56.438018 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jul 28 09:19:56.438018 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jul 28 09:19:56.438018 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 28 09:19:56.438018 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application raise exception Jul 28 09:19:56.439256 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 28 09:19:56.439256 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 28 09:19:56.439256 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 28 09:19:56.439256 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 28 09:19:56.439256 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 28 09:19:56.439256 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application result = self._query(query) Jul 28 09:19:56.439256 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 28 09:19:56.439256 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application conn.query(q) Jul 28 09:19:56.439256 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 28 09:19:56.439256 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 28 09:19:56.439256 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 28 09:19:56.439256 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application result.read() Jul 28 09:19:56.439256 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 28 09:19:56.439256 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 28 09:19:56.439256 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 28 09:19:56.439256 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 28 09:19:56.440367 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 28 09:19:56.440367 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 28 09:19:56.440367 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 28 09:19:56.440367 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 28 09:19:56.440367 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jul 28 09:19:56.440367 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Jul 28 09:19:56.440367 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application [parameters: {'user_id': '274eef4360c44fb5991708686bfe54a6', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Jul 28 09:19:56.440367 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jul 28 09:19:56.440367 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application Jul 28 09:19:56.440367 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 28 09:19:56.440367 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application Jul 28 09:19:56.440367 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 09:19:56.440367 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 09:19:56.440367 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 09:19:56.440367 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 09:19:56.443382 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 09:19:56.443382 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 09:19:56.443382 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 09:19:56.443382 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 09:19:56.443382 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 09:19:56.443382 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 09:19:56.443382 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 09:19:56.443382 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Jul 28 09:19:56.443382 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Jul 28 09:19:56.443382 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 09:19:56.443382 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 09:19:56.443382 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 28 09:19:56.443382 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 09:19:56.443382 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 28 09:19:56.443382 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 09:19:56.443382 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Jul 28 09:19:56.443382 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Jul 28 09:19:56.447116 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Jul 28 09:19:56.447116 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Jul 28 09:19:56.447116 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jul 28 09:19:56.447116 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jul 28 09:19:56.447116 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Jul 28 09:19:56.447116 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application Jul 28 09:19:56.447116 dv-cinder-851351-1-smb devstack@keystone.service[479851]: [pid: 479851|app: 0|req: 474/967] 10.222.0.42 () {60 vars in 1131 bytes} [Thu Jul 28 09:19:56 2022] POST /identity/v3/users => generated 160 bytes in 194 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Jul 28 09:19:56.447116 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e266a73-12ab-43c7-b7e4-c0f4e4e2d752 None admin] Authenticating user token {{(pid=479851) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:19:56.534514 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG dbcounter [-] [479851] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=479851) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:19:56.549613 dv-cinder-851351-1-smb devstack@keystone.service[479852]: [pid: 479852|app: 0|req: 494/968] 10.222.0.42 () {58 vars in 1282 bytes} [Thu Jul 28 09:19:56 2022] GET /identity/v3/auth/tokens => generated 1464 bytes in 373 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 28 09:19:56.549613 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46cb0170-81f6-4577-a6f3-ed44a0b46e4e None admin] Authenticating user token {{(pid=479852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:19:56.587067 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e266a73-12ab-43c7-b7e4-c0f4e4e2d752 None admin] Validating token access rules against request {{(pid=479851) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:19:56.628383 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2664b43a-0e52-4fa2-9291-2a8b8a18b9f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479851) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:19:56.629431 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2664b43a-0e52-4fa2-9291-2a8b8a18b9f4 None admin] REQUEST_METHOD: `GET` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:19:56.629726 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2664b43a-0e52-4fa2-9291-2a8b8a18b9f4 None admin] SCRIPT_NAME: `/identity` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:19:56.630017 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2664b43a-0e52-4fa2-9291-2a8b8a18b9f4 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:19:56.630807 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2664b43a-0e52-4fa2-9291-2a8b8a18b9f4 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:19:56.632515 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2664b43a-0e52-4fa2-9291-2a8b8a18b9f4 None admin] RBAC: Authorization granted {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:19:56.642984 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application [None req-2664b43a-0e52-4fa2-9291-2a8b8a18b9f4 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 28 09:19:56.642984 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 09:19:56.642984 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 28 09:19:56.642984 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 28 09:19:56.642984 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 28 09:19:56.642984 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 28 09:19:56.642984 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 28 09:19:56.642984 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 09:19:56.642984 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 28 09:19:56.642984 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application Jul 28 09:19:56.642984 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 28 09:19:56.642984 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application Jul 28 09:19:56.642984 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 09:19:56.642984 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 09:19:56.642984 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 09:19:56.642984 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 09:19:56.642984 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 09:19:56.644445 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 09:19:56.644445 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 09:19:56.644445 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 09:19:56.644445 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 09:19:56.644445 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 09:19:56.644445 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 09:19:56.644445 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 28 09:19:56.644445 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 28 09:19:56.644445 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 28 09:19:56.644445 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 28 09:19:56.644445 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 09:19:56.644445 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 09:19:56.644445 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 09:19:56.644445 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 09:19:56.644445 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 09:19:56.644445 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 09:19:56.647404 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 09:19:56.647404 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application with Lock( Jul 28 09:19:56.647404 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 09:19:56.647404 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return self._enter() Jul 28 09:19:56.647404 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 09:19:56.647404 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 09:19:56.647404 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 09:19:56.647404 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return self.creator() Jul 28 09:19:56.647404 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 09:19:56.647404 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application created_value = creator( Jul 28 09:19:56.647404 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 28 09:19:56.647404 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 09:19:56.647404 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 28 09:19:56.647404 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application Jul 28 09:19:56.647404 dv-cinder-851351-1-smb devstack@keystone.service[479851]: [pid: 479851|app: 0|req: 475/969] 10.222.0.42 () {56 vars in 1126 bytes} [Thu Jul 28 09:19:56 2022] GET /identity/v3/services/object-store => generated 93 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 09:19:56.648398 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2664b43a-0e52-4fa2-9291-2a8b8a18b9f4 None admin] Authenticating user token {{(pid=479851) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:19:56.669774 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG dbcounter [-] [479852] Writing DB stats keystone:SELECT=100 {{(pid=479852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:19:56.674256 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46cb0170-81f6-4577-a6f3-ed44a0b46e4e None admin] Validating token access rules against request {{(pid=479852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:19:56.718809 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4abb37da-d37e-44cb-8549-be7f0e65943c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:19:56.719474 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abb37da-d37e-44cb-8549-be7f0e65943c None admin] REQUEST_METHOD: `GET` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:19:56.719837 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abb37da-d37e-44cb-8549-be7f0e65943c None admin] SCRIPT_NAME: `/identity` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:19:56.720022 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abb37da-d37e-44cb-8549-be7f0e65943c None admin] PATH_INFO: `/v3/users/cinder` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:19:56.728642 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4abb37da-d37e-44cb-8549-be7f0e65943c None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:19:56.730181 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4abb37da-d37e-44cb-8549-be7f0e65943c None admin] RBAC: Authorization granted {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:19:56.746465 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application [None req-4abb37da-d37e-44cb-8549-be7f0e65943c None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jul 28 09:19:56.746465 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 09:19:56.746465 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 09:19:56.746465 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 09:19:56.746465 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 09:19:56.746465 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 09:19:56.746465 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 09:19:56.746465 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 09:19:56.746465 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 09:19:56.746465 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 09:19:56.746465 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 09:19:56.746465 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 09:19:56.746465 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 28 09:19:56.746465 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 28 09:19:56.746465 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 28 09:19:56.746465 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 28 09:19:56.747667 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 09:19:56.747667 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 09:19:56.747667 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 28 09:19:56.747667 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 09:19:56.747667 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 28 09:19:56.747667 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 09:19:56.747667 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 09:19:56.747667 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 09:19:56.747667 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 09:19:56.747667 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 09:19:56.747667 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 09:19:56.747667 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application with Lock( Jul 28 09:19:56.747667 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 09:19:56.747667 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self._enter() Jul 28 09:19:56.747667 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 09:19:56.747667 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 09:19:56.747667 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 09:19:56.747667 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self.creator() Jul 28 09:19:56.748803 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 09:19:56.748803 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application created_value = creator( Jul 28 09:19:56.748803 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 28 09:19:56.748803 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 28 09:19:56.748803 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 28 09:19:56.748803 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 28 09:19:56.748803 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 28 09:19:56.748803 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 28 09:19:56.748803 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jul 28 09:19:56.748803 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application Jul 28 09:19:56.748803 dv-cinder-851351-1-smb devstack@keystone.service[479852]: [pid: 479852|app: 0|req: 495/970] 10.222.0.42 () {56 vars in 1099 bytes} [Thu Jul 28 09:19:56 2022] GET /identity/v3/users/cinder => generated 84 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 09:19:56.748803 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4abb37da-d37e-44cb-8549-be7f0e65943c None admin] Authenticating user token {{(pid=479852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:19:56.778151 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2664b43a-0e52-4fa2-9291-2a8b8a18b9f4 None admin] Validating token access rules against request {{(pid=479851) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:19:56.815760 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG dbcounter [-] [479851] Writing DB stats keystone:SELECT=100 {{(pid=479851) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:19:56.828942 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd97626-c358-4dfd-9f92-7b17dd8aca6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479851) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:19:56.829634 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd97626-c358-4dfd-9f92-7b17dd8aca6b None admin] REQUEST_METHOD: `GET` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:19:56.830162 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd97626-c358-4dfd-9f92-7b17dd8aca6b None admin] SCRIPT_NAME: `/identity` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:19:56.830343 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd97626-c358-4dfd-9f92-7b17dd8aca6b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:19:56.843908 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dd97626-c358-4dfd-9f92-7b17dd8aca6b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:19:56.845451 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dd97626-c358-4dfd-9f92-7b17dd8aca6b None admin] RBAC: Authorization granted {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:19:56.863887 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application [None req-6dd97626-c358-4dfd-9f92-7b17dd8aca6b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 09:19:56.863887 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 09:19:56.863887 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 09:19:56.863887 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 09:19:56.863887 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 09:19:56.863887 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 09:19:56.863887 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 09:19:56.863887 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 09:19:56.863887 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 09:19:56.863887 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 09:19:56.863887 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 09:19:56.863887 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 09:19:56.863887 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 09:19:56.863887 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 09:19:56.863887 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 09:19:56.865103 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 09:19:56.865103 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 09:19:56.865103 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 09:19:56.865103 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 09:19:56.865103 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 09:19:56.865103 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 09:19:56.865103 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 09:19:56.865103 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 09:19:56.865103 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application with Lock( Jul 28 09:19:56.865103 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 09:19:56.865103 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return self._enter() Jul 28 09:19:56.865103 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 09:19:56.865103 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 09:19:56.865103 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 09:19:56.865103 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return self.creator() Jul 28 09:19:56.865103 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 09:19:56.865103 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application created_value = creator( Jul 28 09:19:56.871245 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 09:19:56.871245 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 09:19:56.871245 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 09:19:56.871245 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application Jul 28 09:19:56.871245 dv-cinder-851351-1-smb devstack@keystone.service[479851]: [pid: 479851|app: 0|req: 476/971] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 09:19:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 09:19:56.871245 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd97626-c358-4dfd-9f92-7b17dd8aca6b None admin] Authenticating user token {{(pid=479851) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:19:56.888493 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4abb37da-d37e-44cb-8549-be7f0e65943c None admin] Validating token access rules against request {{(pid=479852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:19:56.926717 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c126665-d735-4b0b-a86a-2a929633dfdb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:19:56.927463 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c126665-d735-4b0b-a86a-2a929633dfdb None admin] REQUEST_METHOD: `GET` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:19:56.927811 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c126665-d735-4b0b-a86a-2a929633dfdb None admin] SCRIPT_NAME: `/identity` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:19:56.928096 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c126665-d735-4b0b-a86a-2a929633dfdb None admin] PATH_INFO: `/v3/services` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:19:56.928930 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c126665-d735-4b0b-a86a-2a929633dfdb None admin] RBAC: Adding query filter params (name=object-store) {{(pid=479852) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 09:19:56.929240 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c126665-d735-4b0b-a86a-2a929633dfdb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:19:56.930654 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c126665-d735-4b0b-a86a-2a929633dfdb None admin] RBAC: Authorization granted {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:19:56.936902 dv-cinder-851351-1-smb devstack@keystone.service[479852]: [pid: 479852|app: 0|req: 496/972] 10.222.0.42 () {56 vars in 1122 bytes} [Thu Jul 28 09:19:56 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:19:56.937601 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c126665-d735-4b0b-a86a-2a929633dfdb None admin] Authenticating user token {{(pid=479852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:19:56.968184 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG dbcounter [-] [479852] Writing DB stats keystone:SELECT=100 {{(pid=479852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:19:56.994295 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd97626-c358-4dfd-9f92-7b17dd8aca6b None admin] Validating token access rules against request {{(pid=479851) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:19:57.033211 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b25b97-749b-4763-888f-9a56880d5a92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479851) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:19:57.033851 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b25b97-749b-4763-888f-9a56880d5a92 None admin] REQUEST_METHOD: `GET` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:19:57.034135 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b25b97-749b-4763-888f-9a56880d5a92 None admin] SCRIPT_NAME: `/identity` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:19:57.034411 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b25b97-749b-4763-888f-9a56880d5a92 None admin] PATH_INFO: `/v3/users` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:19:57.035199 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7b25b97-749b-4763-888f-9a56880d5a92 None admin] RBAC: Adding query filter params (name=cinder) {{(pid=479851) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 09:19:57.035616 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7b25b97-749b-4763-888f-9a56880d5a92 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:19:57.037304 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7b25b97-749b-4763-888f-9a56880d5a92 None admin] RBAC: Authorization granted {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:19:57.053482 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c126665-d735-4b0b-a86a-2a929633dfdb None admin] Validating token access rules against request {{(pid=479852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:19:57.081310 dv-cinder-851351-1-smb devstack@keystone.service[479851]: [pid: 479851|app: 0|req: 477/973] 10.222.0.42 () {56 vars in 1101 bytes} [Thu Jul 28 09:19:56 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:19:57.083266 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b25b97-749b-4763-888f-9a56880d5a92 None admin] Authenticating user token {{(pid=479851) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:19:57.107320 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-432a8a03-8595-4398-9d64-5c0996b3894a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:19:57.108343 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432a8a03-8595-4398-9d64-5c0996b3894a None admin] REQUEST_METHOD: `GET` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:19:57.108849 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432a8a03-8595-4398-9d64-5c0996b3894a None admin] SCRIPT_NAME: `/identity` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:19:57.109352 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432a8a03-8595-4398-9d64-5c0996b3894a None admin] PATH_INFO: `/v3/domains` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:19:57.110252 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-432a8a03-8595-4398-9d64-5c0996b3894a None admin] RBAC: Adding query filter params (name=Default) {{(pid=479852) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 09:19:57.110726 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-432a8a03-8595-4398-9d64-5c0996b3894a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:19:57.112425 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-432a8a03-8595-4398-9d64-5c0996b3894a None admin] RBAC: Authorization granted {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:19:57.128002 dv-cinder-851351-1-smb devstack@keystone.service[479852]: [pid: 479852|app: 0|req: 497/974] 10.222.0.42 () {56 vars in 1109 bytes} [Thu Jul 28 09:19:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:19:57.140699 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-432a8a03-8595-4398-9d64-5c0996b3894a None admin] Authenticating user token {{(pid=479852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:19:57.142535 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG dbcounter [-] [479851] Writing DB stats keystone:SELECT=100 {{(pid=479851) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:19:57.234714 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b25b97-749b-4763-888f-9a56880d5a92 None admin] Validating token access rules against request {{(pid=479851) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:19:57.262274 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG dbcounter [-] [479852] Writing DB stats keystone:SELECT=100 {{(pid=479852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:19:57.284584 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-432a8a03-8595-4398-9d64-5c0996b3894a None admin] Validating token access rules against request {{(pid=479852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:19:57.286617 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a6bde4-df72-4f3f-8425-be25215b2ca0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479851) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:19:57.286777 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a6bde4-df72-4f3f-8425-be25215b2ca0 None admin] REQUEST_METHOD: `GET` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:19:57.287742 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a6bde4-df72-4f3f-8425-be25215b2ca0 None admin] SCRIPT_NAME: `/identity` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:19:57.287742 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a6bde4-df72-4f3f-8425-be25215b2ca0 None admin] PATH_INFO: `/v3/services` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:19:57.287962 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74a6bde4-df72-4f3f-8425-be25215b2ca0 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=479851) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 09:19:57.288922 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74a6bde4-df72-4f3f-8425-be25215b2ca0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:19:57.289705 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74a6bde4-df72-4f3f-8425-be25215b2ca0 None admin] RBAC: Authorization granted {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:19:57.295923 dv-cinder-851351-1-smb devstack@keystone.service[479851]: [pid: 479851|app: 0|req: 478/975] 10.222.0.42 () {56 vars in 1122 bytes} [Thu Jul 28 09:19:57 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:19:57.304245 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a6bde4-df72-4f3f-8425-be25215b2ca0 None admin] Authenticating user token {{(pid=479851) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:19:57.330599 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b464f65-d808-4a4c-b1c6-5aef02e3ff3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:19:57.331442 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b464f65-d808-4a4c-b1c6-5aef02e3ff3b None admin] REQUEST_METHOD: `GET` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:19:57.331584 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b464f65-d808-4a4c-b1c6-5aef02e3ff3b None admin] SCRIPT_NAME: `/identity` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:19:57.331798 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b464f65-d808-4a4c-b1c6-5aef02e3ff3b None admin] PATH_INFO: `/v3/projects/service` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:19:57.339874 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b464f65-d808-4a4c-b1c6-5aef02e3ff3b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:19:57.341378 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b464f65-d808-4a4c-b1c6-5aef02e3ff3b None admin] RBAC: Authorization granted {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:19:57.356547 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application [None req-6b464f65-d808-4a4c-b1c6-5aef02e3ff3b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 09:19:57.356547 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 09:19:57.356547 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 09:19:57.356547 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 09:19:57.356547 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 09:19:57.356547 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 09:19:57.356547 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 09:19:57.356547 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 09:19:57.356547 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 09:19:57.356547 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 09:19:57.356547 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 09:19:57.356547 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 09:19:57.356547 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 28 09:19:57.356547 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 28 09:19:57.356547 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 28 09:19:57.357848 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 28 09:19:57.357848 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 09:19:57.357848 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 09:19:57.357848 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 09:19:57.357848 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 09:19:57.357848 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 09:19:57.357848 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 09:19:57.357848 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 09:19:57.357848 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application with Lock( Jul 28 09:19:57.357848 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 09:19:57.357848 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self._enter() Jul 28 09:19:57.357848 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 09:19:57.357848 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 09:19:57.357848 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 09:19:57.357848 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self.creator() Jul 28 09:19:57.357848 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 09:19:57.357848 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application created_value = creator( Jul 28 09:19:57.359100 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 28 09:19:57.359100 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 28 09:19:57.359100 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 28 09:19:57.359100 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 28 09:19:57.359100 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 28 09:19:57.359100 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 28 09:19:57.359100 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 09:19:57.359100 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application Jul 28 09:19:57.359100 dv-cinder-851351-1-smb devstack@keystone.service[479852]: [pid: 479852|app: 0|req: 498/976] 10.222.0.42 () {56 vars in 1111 bytes} [Thu Jul 28 09:19:57 2022] GET /identity/v3/projects/service => generated 88 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 09:19:57.367449 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b464f65-d808-4a4c-b1c6-5aef02e3ff3b None admin] Authenticating user token {{(pid=479852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:19:57.431717 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a6bde4-df72-4f3f-8425-be25215b2ca0 None admin] Validating token access rules against request {{(pid=479851) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:19:57.433667 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG dbcounter [-] [479851] Writing DB stats keystone:SELECT=100 {{(pid=479851) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:19:57.470057 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12923064-fd29-427c-a54e-30b806c7d954 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479851) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:19:57.470709 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12923064-fd29-427c-a54e-30b806c7d954 None admin] REQUEST_METHOD: `POST` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:19:57.470995 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12923064-fd29-427c-a54e-30b806c7d954 None admin] SCRIPT_NAME: `/identity` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:19:57.471275 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12923064-fd29-427c-a54e-30b806c7d954 None admin] PATH_INFO: `/v3/endpoints` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:19:57.472004 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12923064-fd29-427c-a54e-30b806c7d954 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:19:57.473521 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12923064-fd29-427c-a54e-30b806c7d954 None admin] RBAC: Authorization granted {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:19:57.493599 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b464f65-d808-4a4c-b1c6-5aef02e3ff3b None admin] Validating token access rules against request {{(pid=479852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:19:57.504693 dv-cinder-851351-1-smb devstack@keystone.service[479851]: [pid: 479851|app: 0|req: 479/977] 10.222.0.42 () {60 vars in 1144 bytes} [Thu Jul 28 09:19:57 2022] POST /identity/v3/endpoints => generated 349 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 09:19:57.548047 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564ee228-619a-4a8a-93f6-6f187e407422 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:19:57.548802 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564ee228-619a-4a8a-93f6-6f187e407422 None admin] REQUEST_METHOD: `GET` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:19:57.548984 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564ee228-619a-4a8a-93f6-6f187e407422 None admin] SCRIPT_NAME: `/identity` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:19:57.549255 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564ee228-619a-4a8a-93f6-6f187e407422 None admin] PATH_INFO: `/v3/projects` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:19:57.550013 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-564ee228-619a-4a8a-93f6-6f187e407422 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=479852) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 09:19:57.550319 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-564ee228-619a-4a8a-93f6-6f187e407422 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:19:57.551810 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-564ee228-619a-4a8a-93f6-6f187e407422 None admin] RBAC: Authorization granted {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:19:57.561837 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG dbcounter [-] [479852] Writing DB stats keystone:SELECT=100 {{(pid=479852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:19:57.566252 dv-cinder-851351-1-smb devstack@keystone.service[479852]: [pid: 479852|app: 0|req: 499/978] 10.222.0.42 () {56 vars in 1148 bytes} [Thu Jul 28 09:19:57 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:19:57.573160 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12923064-fd29-427c-a54e-30b806c7d954 None admin] Authenticating user token {{(pid=479851) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:19:57.699601 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12923064-fd29-427c-a54e-30b806c7d954 None admin] Validating token access rules against request {{(pid=479851) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:19:57.736476 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f931503d-618f-4963-9d0d-0536333ac7f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479851) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:19:57.737148 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f931503d-618f-4963-9d0d-0536333ac7f0 None admin] REQUEST_METHOD: `GET` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:19:57.737445 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f931503d-618f-4963-9d0d-0536333ac7f0 None admin] SCRIPT_NAME: `/identity` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:19:57.737729 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f931503d-618f-4963-9d0d-0536333ac7f0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:19:57.738540 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f931503d-618f-4963-9d0d-0536333ac7f0 None admin] RBAC: Adding query filter params (role.id=4a0748cb7fbb416eb81203fd028beb9a, scope.project.id=3a0fb8ea8010437bade8f92dcbcaacee, user.id=87596a91a45f4326855265497fe69b65) {{(pid=479851) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 09:19:57.738896 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f931503d-618f-4963-9d0d-0536333ac7f0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:19:57.740380 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f931503d-618f-4963-9d0d-0536333ac7f0 None admin] RBAC: Authorization granted {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:19:57.747204 dv-cinder-851351-1-smb devstack@keystone.service[479851]: [pid: 479851|app: 0|req: 480/979] 10.222.0.42 () {56 vars in 1374 bytes} [Thu Jul 28 09:19:57 2022] GET /identity/v3/role_assignments?user.id=87596a91a45f4326855265497fe69b65&scope.project.id=3a0fb8ea8010437bade8f92dcbcaacee&role.id=4a0748cb7fbb416eb81203fd028beb9a => generated 608 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:19:58.007263 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30bf84c-3925-41a2-84a6-d19bd9c9bc26 None None] REQUEST_METHOD: `GET` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:19:58.007806 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30bf84c-3925-41a2-84a6-d19bd9c9bc26 None None] SCRIPT_NAME: `/identity` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:19:58.007806 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30bf84c-3925-41a2-84a6-d19bd9c9bc26 None None] PATH_INFO: `/` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:19:58.009108 dv-cinder-851351-1-smb devstack@keystone.service[479852]: [pid: 479852|app: 0|req: 500/980] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 09:19:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 09:19:58.014785 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95bf759a-2ae5-44ba-a080-14c43e96f438 None None] REQUEST_METHOD: `POST` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:19:58.015272 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95bf759a-2ae5-44ba-a080-14c43e96f438 None None] SCRIPT_NAME: `/identity` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:19:58.015368 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95bf759a-2ae5-44ba-a080-14c43e96f438 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:19:58.034587 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.auth.core [None req-95bf759a-2ae5-44ba-a080-14c43e96f438 None None] MFA Rules not processed for user `c198f91a4ae84d2b9cc730a6e304c2be`. Rule list: `[]` (Enabled: `True`). {{(pid=479851) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 09:19:58.036178 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.fernet_utils [None req-95bf759a-2ae5-44ba-a080-14c43e96f438 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=479851) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 09:19:58.055240 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG dbcounter [-] [479851] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=479851) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:19:58.110842 dv-cinder-851351-1-smb devstack@keystone.service[479851]: [pid: 479851|app: 0|req: 481/981] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 09:19:58 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 09:19:58.133005 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30bf84c-3925-41a2-84a6-d19bd9c9bc26 None None] Authenticating user token {{(pid=479852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:19:58.241778 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30bf84c-3925-41a2-84a6-d19bd9c9bc26 None None] Validating token access rules against request {{(pid=479852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:19:58.276725 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13aeea1-da19-4310-a07b-7a6802bb1529 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:19:58.277342 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13aeea1-da19-4310-a07b-7a6802bb1529 None admin] REQUEST_METHOD: `POST` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:19:58.277625 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13aeea1-da19-4310-a07b-7a6802bb1529 None admin] SCRIPT_NAME: `/identity` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:19:58.277899 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13aeea1-da19-4310-a07b-7a6802bb1529 None admin] PATH_INFO: `/v3/services` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:19:58.278614 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f13aeea1-da19-4310-a07b-7a6802bb1529 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:19:58.279985 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f13aeea1-da19-4310-a07b-7a6802bb1529 None admin] RBAC: Authorization granted {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:19:58.296066 dv-cinder-851351-1-smb devstack@keystone.service[479852]: [pid: 479852|app: 0|req: 501/982] 10.222.0.42 () {60 vars in 1141 bytes} [Thu Jul 28 09:19:58 2022] POST /identity/v3/services => generated 242 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 09:19:59.547961 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e8cbb7-410b-4e8c-9b22-c8248f3ac0a9 None None] REQUEST_METHOD: `GET` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:19:59.548574 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e8cbb7-410b-4e8c-9b22-c8248f3ac0a9 None None] SCRIPT_NAME: `/identity` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:19:59.548574 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e8cbb7-410b-4e8c-9b22-c8248f3ac0a9 None None] PATH_INFO: `/` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:19:59.550206 dv-cinder-851351-1-smb devstack@keystone.service[479851]: [pid: 479851|app: 0|req: 482/983] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 09:19:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 09:19:59.556075 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3b8fd8-3c6c-4a30-a6b1-a78e29ce66d2 None None] REQUEST_METHOD: `POST` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:19:59.556638 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3b8fd8-3c6c-4a30-a6b1-a78e29ce66d2 None None] SCRIPT_NAME: `/identity` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:19:59.556638 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3b8fd8-3c6c-4a30-a6b1-a78e29ce66d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:19:59.577687 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.auth.core [None req-3b3b8fd8-3c6c-4a30-a6b1-a78e29ce66d2 None None] MFA Rules not processed for user `c198f91a4ae84d2b9cc730a6e304c2be`. Rule list: `[]` (Enabled: `True`). {{(pid=479852) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 09:19:59.578914 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.fernet_utils [None req-3b3b8fd8-3c6c-4a30-a6b1-a78e29ce66d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=479852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 09:19:59.642629 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG dbcounter [-] [479852] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=479852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:19:59.662055 dv-cinder-851351-1-smb devstack@keystone.service[479852]: [pid: 479852|app: 0|req: 502/984] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 09:19:59 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 09:19:59.684447 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e8cbb7-410b-4e8c-9b22-c8248f3ac0a9 None None] Authenticating user token {{(pid=479851) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:19:59.795914 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e8cbb7-410b-4e8c-9b22-c8248f3ac0a9 None None] Validating token access rules against request {{(pid=479851) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:19:59.810747 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6de817-8650-4fd9-87ff-10616946ca7e None None] REQUEST_METHOD: `GET` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:19:59.811034 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6de817-8650-4fd9-87ff-10616946ca7e None None] SCRIPT_NAME: `/identity` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:19:59.811313 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6de817-8650-4fd9-87ff-10616946ca7e None None] PATH_INFO: `/` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:19:59.812737 dv-cinder-851351-1-smb devstack@keystone.service[479852]: [pid: 479852|app: 0|req: 503/985] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 09:19:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 09:19:59.817831 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39eca69b-7c4e-4372-9059-3d2a5e647c31 None None] REQUEST_METHOD: `POST` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:19:59.818122 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39eca69b-7c4e-4372-9059-3d2a5e647c31 None None] SCRIPT_NAME: `/identity` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:19:59.818397 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39eca69b-7c4e-4372-9059-3d2a5e647c31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:19:59.837830 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.auth.core [None req-39eca69b-7c4e-4372-9059-3d2a5e647c31 None None] MFA Rules not processed for user `c198f91a4ae84d2b9cc730a6e304c2be`. Rule list: `[]` (Enabled: `True`). {{(pid=479852) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 09:19:59.839044 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.fernet_utils [None req-39eca69b-7c4e-4372-9059-3d2a5e647c31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=479852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 09:19:59.841547 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c299f33e-b219-4df8-a0de-8012bfba24a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479851) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:19:59.842228 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c299f33e-b219-4df8-a0de-8012bfba24a0 None admin] REQUEST_METHOD: `GET` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:19:59.842516 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c299f33e-b219-4df8-a0de-8012bfba24a0 None admin] SCRIPT_NAME: `/identity` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:19:59.842803 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c299f33e-b219-4df8-a0de-8012bfba24a0 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:19:59.843452 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c299f33e-b219-4df8-a0de-8012bfba24a0 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:19:59.844877 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c299f33e-b219-4df8-a0de-8012bfba24a0 None admin] RBAC: Authorization granted {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:19:59.854306 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application [None req-c299f33e-b219-4df8-a0de-8012bfba24a0 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 28 09:19:59.854306 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 09:19:59.854306 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 28 09:19:59.854306 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 28 09:19:59.854306 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 28 09:19:59.854306 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 28 09:19:59.854306 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 28 09:19:59.854306 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 09:19:59.854306 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 28 09:19:59.854306 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application Jul 28 09:19:59.854306 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 28 09:19:59.854306 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application Jul 28 09:19:59.854306 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 09:19:59.854306 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 09:19:59.854306 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 09:19:59.854306 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 09:19:59.854306 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 09:19:59.855502 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 09:19:59.855502 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 09:19:59.855502 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 09:19:59.855502 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 09:19:59.855502 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 09:19:59.855502 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 09:19:59.855502 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 28 09:19:59.855502 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 28 09:19:59.855502 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 28 09:19:59.855502 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 28 09:19:59.855502 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 09:19:59.855502 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 09:19:59.855502 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 09:19:59.855502 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 09:19:59.855502 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 09:19:59.855502 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 09:19:59.856534 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 09:19:59.856534 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application with Lock( Jul 28 09:19:59.856534 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 09:19:59.856534 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return self._enter() Jul 28 09:19:59.856534 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 09:19:59.856534 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 09:19:59.856534 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 09:19:59.856534 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return self.creator() Jul 28 09:19:59.856534 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 09:19:59.856534 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application created_value = creator( Jul 28 09:19:59.856534 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 28 09:19:59.856534 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 09:19:59.856534 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 28 09:19:59.856534 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application Jul 28 09:19:59.856534 dv-cinder-851351-1-smb devstack@keystone.service[479851]: [pid: 479851|app: 0|req: 483/986] 10.222.0.42 () {56 vars in 1126 bytes} [Thu Jul 28 09:19:59 2022] GET /identity/v3/services/object-store => generated 93 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 09:19:59.861880 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c299f33e-b219-4df8-a0de-8012bfba24a0 None admin] Authenticating user token {{(pid=479851) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:19:59.885578 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG dbcounter [-] [479851] Writing DB stats keystone:SELECT=100 {{(pid=479851) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:19:59.916797 dv-cinder-851351-1-smb devstack@keystone.service[479852]: [pid: 479852|app: 0|req: 504/987] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 09:19:59 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 09:19:59.937405 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39eca69b-7c4e-4372-9059-3d2a5e647c31 None None] Authenticating user token {{(pid=479852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:19:59.974532 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c299f33e-b219-4df8-a0de-8012bfba24a0 None admin] Validating token access rules against request {{(pid=479851) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:20:00.013855 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9120120c-c79d-4911-8c33-239461636aa3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479851) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:20:00.014500 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9120120c-c79d-4911-8c33-239461636aa3 None admin] REQUEST_METHOD: `GET` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:20:00.014785 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9120120c-c79d-4911-8c33-239461636aa3 None admin] SCRIPT_NAME: `/identity` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:20:00.015084 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9120120c-c79d-4911-8c33-239461636aa3 None admin] PATH_INFO: `/v3/services` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:20:00.015760 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9120120c-c79d-4911-8c33-239461636aa3 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=479851) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 09:20:00.016080 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9120120c-c79d-4911-8c33-239461636aa3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:20:00.017517 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9120120c-c79d-4911-8c33-239461636aa3 None admin] RBAC: Authorization granted {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:20:00.023132 dv-cinder-851351-1-smb devstack@keystone.service[479851]: [pid: 479851|app: 0|req: 484/988] 10.222.0.42 () {56 vars in 1122 bytes} [Thu Jul 28 09:19:59 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 09:20:00.028864 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9120120c-c79d-4911-8c33-239461636aa3 None admin] Authenticating user token {{(pid=479851) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:20:00.052554 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39eca69b-7c4e-4372-9059-3d2a5e647c31 None None] Validating token access rules against request {{(pid=479852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:20:00.070912 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG dbcounter [-] [479852] Writing DB stats keystone:SELECT=100 {{(pid=479852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:20:00.092419 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-530bdc7b-5bfa-43ad-8871-6795b9b5f8f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:20:00.093116 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530bdc7b-5bfa-43ad-8871-6795b9b5f8f9 None admin] REQUEST_METHOD: `GET` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:20:00.093419 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530bdc7b-5bfa-43ad-8871-6795b9b5f8f9 None admin] SCRIPT_NAME: `/identity` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:20:00.093675 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530bdc7b-5bfa-43ad-8871-6795b9b5f8f9 None admin] PATH_INFO: `/v3/services/image` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:20:00.094434 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-530bdc7b-5bfa-43ad-8871-6795b9b5f8f9 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:20:00.095710 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-530bdc7b-5bfa-43ad-8871-6795b9b5f8f9 None admin] RBAC: Authorization granted {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:20:00.105297 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application [None req-530bdc7b-5bfa-43ad-8871-6795b9b5f8f9 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jul 28 09:20:00.105297 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 09:20:00.105297 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 28 09:20:00.105297 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 28 09:20:00.105297 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 28 09:20:00.105297 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 28 09:20:00.105297 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 28 09:20:00.105297 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 09:20:00.105297 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 28 09:20:00.105297 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application Jul 28 09:20:00.105297 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 28 09:20:00.105297 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application Jul 28 09:20:00.105297 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 09:20:00.105297 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 09:20:00.105297 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 09:20:00.105297 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 09:20:00.105297 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 09:20:00.106511 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 09:20:00.106511 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 09:20:00.106511 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 09:20:00.106511 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 09:20:00.106511 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 09:20:00.106511 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 09:20:00.106511 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 28 09:20:00.106511 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 28 09:20:00.106511 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 28 09:20:00.106511 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 28 09:20:00.106511 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 09:20:00.106511 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 09:20:00.106511 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 09:20:00.106511 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 09:20:00.106511 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 09:20:00.106511 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 09:20:00.107528 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 09:20:00.107528 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application with Lock( Jul 28 09:20:00.107528 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 09:20:00.107528 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self._enter() Jul 28 09:20:00.107528 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 09:20:00.107528 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 09:20:00.107528 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 09:20:00.107528 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self.creator() Jul 28 09:20:00.107528 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 09:20:00.107528 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application created_value = creator( Jul 28 09:20:00.107528 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 28 09:20:00.107528 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 09:20:00.107528 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 28 09:20:00.107528 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application Jul 28 09:20:00.111535 dv-cinder-851351-1-smb devstack@keystone.service[479852]: [pid: 479852|app: 0|req: 505/989] 10.222.0.42 () {56 vars in 1105 bytes} [Thu Jul 28 09:19:59 2022] GET /identity/v3/services/image => generated 86 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 09:20:00.112424 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-530bdc7b-5bfa-43ad-8871-6795b9b5f8f9 None admin] Authenticating user token {{(pid=479852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:20:00.117301 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG dbcounter [-] [479851] Writing DB stats keystone:SELECT=100 {{(pid=479851) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:20:00.137881 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9120120c-c79d-4911-8c33-239461636aa3 None admin] Validating token access rules against request {{(pid=479851) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:20:00.173787 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f748d3-1eaa-4bfd-afb1-0dabca188d21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479851) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:20:00.174337 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f748d3-1eaa-4bfd-afb1-0dabca188d21 None admin] REQUEST_METHOD: `GET` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:20:00.174626 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f748d3-1eaa-4bfd-afb1-0dabca188d21 None admin] SCRIPT_NAME: `/identity` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:20:00.174907 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f748d3-1eaa-4bfd-afb1-0dabca188d21 None admin] PATH_INFO: `/v3/services` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:20:00.175603 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f748d3-1eaa-4bfd-afb1-0dabca188d21 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=479851) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 09:20:00.175915 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f748d3-1eaa-4bfd-afb1-0dabca188d21 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:20:00.177401 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f748d3-1eaa-4bfd-afb1-0dabca188d21 None admin] RBAC: Authorization granted {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:20:00.182988 dv-cinder-851351-1-smb devstack@keystone.service[479851]: [pid: 479851|app: 0|req: 485/990] 10.222.0.42 () {56 vars in 1122 bytes} [Thu Jul 28 09:20:00 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 09:20:00.188996 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f748d3-1eaa-4bfd-afb1-0dabca188d21 None admin] Authenticating user token {{(pid=479851) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:20:00.229680 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-530bdc7b-5bfa-43ad-8871-6795b9b5f8f9 None admin] Validating token access rules against request {{(pid=479852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:20:00.267100 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97800707-b823-4fc8-bf22-9d2f423291fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:20:00.267848 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97800707-b823-4fc8-bf22-9d2f423291fc None admin] REQUEST_METHOD: `GET` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:20:00.268140 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97800707-b823-4fc8-bf22-9d2f423291fc None admin] SCRIPT_NAME: `/identity` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:20:00.268633 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97800707-b823-4fc8-bf22-9d2f423291fc None admin] PATH_INFO: `/v3/services` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:20:00.269145 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97800707-b823-4fc8-bf22-9d2f423291fc None admin] RBAC: Adding query filter params (name=image) {{(pid=479852) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 09:20:00.269454 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97800707-b823-4fc8-bf22-9d2f423291fc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:20:00.271252 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97800707-b823-4fc8-bf22-9d2f423291fc None admin] RBAC: Authorization granted {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:20:00.281208 dv-cinder-851351-1-smb devstack@keystone.service[479852]: [pid: 479852|app: 0|req: 506/991] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 09:20:00 2022] GET /identity/v3/services?name=image => generated 122 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:20:00.282306 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97800707-b823-4fc8-bf22-9d2f423291fc None admin] Authenticating user token {{(pid=479852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:20:00.298497 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f748d3-1eaa-4bfd-afb1-0dabca188d21 None admin] Validating token access rules against request {{(pid=479851) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:20:00.338389 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG dbcounter [-] [479852] Writing DB stats keystone:SELECT=100 {{(pid=479852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:20:00.353624 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c122702-9c28-4661-b82f-ecaaf59b6dc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479851) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:20:00.354525 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c122702-9c28-4661-b82f-ecaaf59b6dc8 None admin] REQUEST_METHOD: `GET` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:20:00.354875 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c122702-9c28-4661-b82f-ecaaf59b6dc8 None admin] SCRIPT_NAME: `/identity` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:20:00.355209 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c122702-9c28-4661-b82f-ecaaf59b6dc8 None admin] PATH_INFO: `/v3/endpoints` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:20:00.356266 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c122702-9c28-4661-b82f-ecaaf59b6dc8 None admin] RBAC: Adding query filter params (interface=admin, service_id=724a27a8116d4456b6228102e22cfba1, region_id=RegionOne) {{(pid=479851) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 09:20:00.356783 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c122702-9c28-4661-b82f-ecaaf59b6dc8 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:20:00.358519 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c122702-9c28-4661-b82f-ecaaf59b6dc8 None admin] RBAC: Authorization granted {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:20:00.365429 dv-cinder-851351-1-smb devstack@keystone.service[479851]: [pid: 479851|app: 0|req: 486/992] 10.222.0.42 () {56 vars in 1249 bytes} [Thu Jul 28 09:20:00 2022] GET /identity/v3/endpoints?service_id=724a27a8116d4456b6228102e22cfba1&interface=admin®ion_id=RegionOne => generated 193 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 09:20:00.367056 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad37301-d997-457b-a66c-271b62ecdf1b None None] REQUEST_METHOD: `GET` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:20:00.367398 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad37301-d997-457b-a66c-271b62ecdf1b None None] SCRIPT_NAME: `/identity` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:20:00.367801 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad37301-d997-457b-a66c-271b62ecdf1b None None] PATH_INFO: `/` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:20:00.369737 dv-cinder-851351-1-smb devstack@keystone.service[479851]: [pid: 479851|app: 0|req: 487/993] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 09:20:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 09:20:00.373681 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad37301-d997-457b-a66c-271b62ecdf1b None None] Authenticating user token {{(pid=479851) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:20:00.388445 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG dbcounter [-] [479851] Writing DB stats keystone:SELECT=100 {{(pid=479851) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:20:00.407368 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97800707-b823-4fc8-bf22-9d2f423291fc None admin] Validating token access rules against request {{(pid=479852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:20:00.442189 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c087e63-9d21-4dbe-b97e-a2a95d920885 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:20:00.442745 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c087e63-9d21-4dbe-b97e-a2a95d920885 None admin] REQUEST_METHOD: `GET` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:20:00.443028 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c087e63-9d21-4dbe-b97e-a2a95d920885 None admin] SCRIPT_NAME: `/identity` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:20:00.443308 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c087e63-9d21-4dbe-b97e-a2a95d920885 None admin] PATH_INFO: `/v3/services` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:20:00.444000 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c087e63-9d21-4dbe-b97e-a2a95d920885 None admin] RBAC: Adding query filter params (type=image) {{(pid=479852) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 09:20:00.444310 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c087e63-9d21-4dbe-b97e-a2a95d920885 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:20:00.445739 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c087e63-9d21-4dbe-b97e-a2a95d920885 None admin] RBAC: Authorization granted {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:20:00.450627 dv-cinder-851351-1-smb devstack@keystone.service[479852]: [pid: 479852|app: 0|req: 507/994] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 09:20:00 2022] GET /identity/v3/services?type=image => generated 122 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 09:20:00.460979 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92a519f-2d4b-4c78-989c-cef3e02309b1 None None] REQUEST_METHOD: `POST` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:20:00.460979 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92a519f-2d4b-4c78-989c-cef3e02309b1 None None] SCRIPT_NAME: `/identity` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:20:00.460979 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92a519f-2d4b-4c78-989c-cef3e02309b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:20:00.477057 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.auth.core [None req-c92a519f-2d4b-4c78-989c-cef3e02309b1 None None] MFA Rules not processed for user `c198f91a4ae84d2b9cc730a6e304c2be`. Rule list: `[]` (Enabled: `True`). {{(pid=479852) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 09:20:00.478370 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.fernet_utils [None req-c92a519f-2d4b-4c78-989c-cef3e02309b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=479852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 09:20:00.495752 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad37301-d997-457b-a66c-271b62ecdf1b None None] Validating token access rules against request {{(pid=479851) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:20:00.539629 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd97c906-663a-4143-805b-ccb3a6cb901e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479851) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:20:00.540538 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd97c906-663a-4143-805b-ccb3a6cb901e None admin] REQUEST_METHOD: `GET` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:20:00.540696 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd97c906-663a-4143-805b-ccb3a6cb901e None admin] SCRIPT_NAME: `/identity` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:20:00.540978 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd97c906-663a-4143-805b-ccb3a6cb901e None admin] PATH_INFO: `/v3/services` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:20:00.541658 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd97c906-663a-4143-805b-ccb3a6cb901e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:20:00.543088 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd97c906-663a-4143-805b-ccb3a6cb901e None admin] RBAC: Authorization granted {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:20:00.560698 dv-cinder-851351-1-smb devstack@keystone.service[479851]: [pid: 479851|app: 0|req: 488/995] 10.222.0.42 () {56 vars in 1087 bytes} [Thu Jul 28 09:20:00 2022] GET /identity/v3/services => generated 1727 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 09:20:00.566442 dv-cinder-851351-1-smb devstack@keystone.service[479852]: [pid: 479852|app: 0|req: 508/996] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 09:20:00 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 09:20:00.590828 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd97c906-663a-4143-805b-ccb3a6cb901e None admin] Authenticating user token {{(pid=479851) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:20:00.676393 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG dbcounter [-] [479851] Writing DB stats keystone:SELECT=100 {{(pid=479851) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:20:00.713784 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd97c906-663a-4143-805b-ccb3a6cb901e None admin] Validating token access rules against request {{(pid=479851) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:20:00.753174 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35bca7b7-30fb-4429-a5ef-7d73fa13c5de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479851) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:20:00.753837 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35bca7b7-30fb-4429-a5ef-7d73fa13c5de None admin] REQUEST_METHOD: `GET` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:20:00.754191 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35bca7b7-30fb-4429-a5ef-7d73fa13c5de None admin] SCRIPT_NAME: `/identity` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:20:00.754506 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35bca7b7-30fb-4429-a5ef-7d73fa13c5de None admin] PATH_INFO: `/v3/services/compute` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:20:00.755146 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35bca7b7-30fb-4429-a5ef-7d73fa13c5de None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:20:00.756539 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35bca7b7-30fb-4429-a5ef-7d73fa13c5de None admin] RBAC: Authorization granted {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:20:00.766160 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application [None req-35bca7b7-30fb-4429-a5ef-7d73fa13c5de None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jul 28 09:20:00.766160 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 09:20:00.766160 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 28 09:20:00.766160 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 28 09:20:00.766160 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 28 09:20:00.766160 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 28 09:20:00.766160 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 28 09:20:00.766160 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 09:20:00.766160 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 28 09:20:00.766160 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application Jul 28 09:20:00.766160 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 28 09:20:00.766160 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application Jul 28 09:20:00.766160 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 09:20:00.766160 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 09:20:00.766160 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 09:20:00.766160 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 09:20:00.766160 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 09:20:00.767386 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 09:20:00.767386 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 09:20:00.767386 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 09:20:00.767386 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 09:20:00.767386 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 09:20:00.767386 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 09:20:00.767386 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 28 09:20:00.767386 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 28 09:20:00.767386 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 28 09:20:00.767386 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 28 09:20:00.767386 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 09:20:00.767386 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 09:20:00.767386 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 09:20:00.767386 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 09:20:00.767386 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 09:20:00.767386 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 09:20:00.768408 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 09:20:00.768408 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application with Lock( Jul 28 09:20:00.768408 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 09:20:00.768408 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return self._enter() Jul 28 09:20:00.768408 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 09:20:00.768408 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 09:20:00.768408 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 09:20:00.768408 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return self.creator() Jul 28 09:20:00.768408 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 09:20:00.768408 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application created_value = creator( Jul 28 09:20:00.768408 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 28 09:20:00.768408 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 09:20:00.768408 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 28 09:20:00.768408 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application Jul 28 09:20:00.768408 dv-cinder-851351-1-smb devstack@keystone.service[479851]: [pid: 479851|app: 0|req: 489/997] 10.222.0.42 () {56 vars in 1111 bytes} [Thu Jul 28 09:20:00 2022] GET /identity/v3/services/compute => generated 88 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 09:20:00.773752 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c92a519f-2d4b-4c78-989c-cef3e02309b1 None None] Authenticating user token {{(pid=479852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:20:00.817724 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG dbcounter [-] [479852] Writing DB stats keystone:SELECT=100 {{(pid=479852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:20:00.889247 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c92a519f-2d4b-4c78-989c-cef3e02309b1 None None] Validating token access rules against request {{(pid=479852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:20:00.928569 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0e92ab-68fe-432e-a1dc-cb9b46758756 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:20:00.929299 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0e92ab-68fe-432e-a1dc-cb9b46758756 None admin] REQUEST_METHOD: `GET` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:20:00.929553 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0e92ab-68fe-432e-a1dc-cb9b46758756 None admin] SCRIPT_NAME: `/identity` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:20:00.929853 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0e92ab-68fe-432e-a1dc-cb9b46758756 None admin] PATH_INFO: `/v3/services` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:20:00.930595 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c0e92ab-68fe-432e-a1dc-cb9b46758756 None admin] RBAC: Adding query filter params (name=compute) {{(pid=479852) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 09:20:00.930906 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c0e92ab-68fe-432e-a1dc-cb9b46758756 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:20:00.932277 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c0e92ab-68fe-432e-a1dc-cb9b46758756 None admin] RBAC: Authorization granted {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:20:00.938019 dv-cinder-851351-1-smb devstack@keystone.service[479852]: [pid: 479852|app: 0|req: 509/998] 10.222.0.42 () {56 vars in 1112 bytes} [Thu Jul 28 09:20:00 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:20:00.943744 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35bca7b7-30fb-4429-a5ef-7d73fa13c5de None admin] Authenticating user token {{(pid=479851) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:20:01.048402 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35bca7b7-30fb-4429-a5ef-7d73fa13c5de None admin] Validating token access rules against request {{(pid=479851) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:20:01.083868 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea89085-cbea-467a-9fb4-bd76a5f49d48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479851) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:20:01.084504 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea89085-cbea-467a-9fb4-bd76a5f49d48 None admin] REQUEST_METHOD: `GET` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:20:01.084822 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea89085-cbea-467a-9fb4-bd76a5f49d48 None admin] SCRIPT_NAME: `/identity` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:20:01.085101 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea89085-cbea-467a-9fb4-bd76a5f49d48 None admin] PATH_INFO: `/v3/services` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:20:01.085794 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea89085-cbea-467a-9fb4-bd76a5f49d48 None admin] RBAC: Adding query filter params (type=compute) {{(pid=479851) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 09:20:01.086104 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea89085-cbea-467a-9fb4-bd76a5f49d48 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:20:01.087574 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea89085-cbea-467a-9fb4-bd76a5f49d48 None admin] RBAC: Authorization granted {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:20:01.089860 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG dbcounter [-] [479851] Writing DB stats keystone:SELECT=100 {{(pid=479851) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:20:01.097013 dv-cinder-851351-1-smb devstack@keystone.service[479851]: [pid: 479851|app: 0|req: 490/999] 10.222.0.42 () {56 vars in 1112 bytes} [Thu Jul 28 09:20:00 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:20:01.099853 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0e92ab-68fe-432e-a1dc-cb9b46758756 None admin] Authenticating user token {{(pid=479852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:20:01.204330 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0e92ab-68fe-432e-a1dc-cb9b46758756 None admin] Validating token access rules against request {{(pid=479852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:20:01.205954 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG dbcounter [-] [479852] Writing DB stats keystone:SELECT=100 {{(pid=479852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:20:01.246767 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd74a95-e7b3-41fa-a138-0e52e037dad6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:20:01.247400 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd74a95-e7b3-41fa-a138-0e52e037dad6 None admin] REQUEST_METHOD: `GET` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:20:01.247681 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd74a95-e7b3-41fa-a138-0e52e037dad6 None admin] SCRIPT_NAME: `/identity` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:20:01.247953 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd74a95-e7b3-41fa-a138-0e52e037dad6 None admin] PATH_INFO: `/v3/endpoints` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:20:01.248742 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdd74a95-e7b3-41fa-a138-0e52e037dad6 None admin] RBAC: Adding query filter params (interface=public, service_id=dda3852311ac4a81a15377730262c30d, region_id=RegionOne) {{(pid=479852) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 09:20:01.249053 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdd74a95-e7b3-41fa-a138-0e52e037dad6 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:20:01.250426 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdd74a95-e7b3-41fa-a138-0e52e037dad6 None admin] RBAC: Authorization granted {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:20:01.255965 dv-cinder-851351-1-smb devstack@keystone.service[479852]: [pid: 479852|app: 0|req: 510/1000] 10.222.0.42 () {56 vars in 1251 bytes} [Thu Jul 28 09:20:01 2022] GET /identity/v3/endpoints?service_id=dda3852311ac4a81a15377730262c30d&interface=public®ion_id=RegionOne => generated 194 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:20:01.261601 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea89085-cbea-467a-9fb4-bd76a5f49d48 None admin] Authenticating user token {{(pid=479851) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:20:01.383949 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea89085-cbea-467a-9fb4-bd76a5f49d48 None admin] Validating token access rules against request {{(pid=479851) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:20:01.421527 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ab3571-8bf2-4c7d-955c-3db70121d10a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479851) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:20:01.422172 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ab3571-8bf2-4c7d-955c-3db70121d10a None admin] REQUEST_METHOD: `GET` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:20:01.422459 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ab3571-8bf2-4c7d-955c-3db70121d10a None admin] SCRIPT_NAME: `/identity` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:20:01.422741 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ab3571-8bf2-4c7d-955c-3db70121d10a None admin] PATH_INFO: `/v3/services` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:20:01.423430 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59ab3571-8bf2-4c7d-955c-3db70121d10a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:20:01.424848 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59ab3571-8bf2-4c7d-955c-3db70121d10a None admin] RBAC: Authorization granted {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:20:01.436914 dv-cinder-851351-1-smb devstack@keystone.service[479851]: [pid: 479851|app: 0|req: 491/1001] 10.222.0.42 () {56 vars in 1087 bytes} [Thu Jul 28 09:20:01 2022] GET /identity/v3/services => generated 1727 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 09:20:02.491789 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30783014-7435-40ef-b161-7bd257cc5143 None None] REQUEST_METHOD: `GET` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:20:02.492356 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30783014-7435-40ef-b161-7bd257cc5143 None None] SCRIPT_NAME: `/identity` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:20:02.492356 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30783014-7435-40ef-b161-7bd257cc5143 None None] PATH_INFO: `/` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:20:02.493883 dv-cinder-851351-1-smb devstack@keystone.service[479852]: [pid: 479852|app: 0|req: 511/1002] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 09:20:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 09:20:02.499394 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a05a2ff-7e06-42ba-8b16-66147a543136 None None] REQUEST_METHOD: `POST` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:20:02.499962 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a05a2ff-7e06-42ba-8b16-66147a543136 None None] SCRIPT_NAME: `/identity` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:20:02.499962 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a05a2ff-7e06-42ba-8b16-66147a543136 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:20:02.520109 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.auth.core [None req-9a05a2ff-7e06-42ba-8b16-66147a543136 None None] MFA Rules not processed for user `c198f91a4ae84d2b9cc730a6e304c2be`. Rule list: `[]` (Enabled: `True`). {{(pid=479851) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 09:20:02.521347 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.fernet_utils [None req-9a05a2ff-7e06-42ba-8b16-66147a543136 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=479851) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 09:20:02.589859 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG dbcounter [-] [479851] Writing DB stats keystone:SELECT=100 {{(pid=479851) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:20:02.597448 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a70c0bf-c98e-4023-ae96-64b57a232632 None None] REQUEST_METHOD: `GET` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:20:02.597721 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a70c0bf-c98e-4023-ae96-64b57a232632 None None] SCRIPT_NAME: `/identity` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:20:02.598029 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a70c0bf-c98e-4023-ae96-64b57a232632 None None] PATH_INFO: `/` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:20:02.599416 dv-cinder-851351-1-smb devstack@keystone.service[479852]: [pid: 479852|app: 0|req: 512/1003] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 09:20:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 09:20:02.602735 dv-cinder-851351-1-smb devstack@keystone.service[479851]: [pid: 479851|app: 0|req: 492/1004] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 09:20:02 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 09:20:02.611244 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e3305c-1101-440d-be1c-5bd327c897fd None None] REQUEST_METHOD: `POST` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:20:02.611602 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e3305c-1101-440d-be1c-5bd327c897fd None None] SCRIPT_NAME: `/identity` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:20:02.611979 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e3305c-1101-440d-be1c-5bd327c897fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:20:02.625545 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a05a2ff-7e06-42ba-8b16-66147a543136 None None] Authenticating user token {{(pid=479851) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:20:02.631134 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.auth.core [None req-f0e3305c-1101-440d-be1c-5bd327c897fd None None] MFA Rules not processed for user `c198f91a4ae84d2b9cc730a6e304c2be`. Rule list: `[]` (Enabled: `True`). {{(pid=479852) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 09:20:02.632359 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.fernet_utils [None req-f0e3305c-1101-440d-be1c-5bd327c897fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=479852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 09:20:02.704337 dv-cinder-851351-1-smb devstack@keystone.service[479852]: [pid: 479852|app: 0|req: 513/1005] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 09:20:02 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 09:20:02.726744 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e3305c-1101-440d-be1c-5bd327c897fd None None] Authenticating user token {{(pid=479852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:20:02.736560 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a05a2ff-7e06-42ba-8b16-66147a543136 None None] Validating token access rules against request {{(pid=479851) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:20:02.772850 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed985e8-9afe-4670-95d2-1915668888b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479851) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:20:02.773330 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed985e8-9afe-4670-95d2-1915668888b2 None admin] REQUEST_METHOD: `POST` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:20:02.773608 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed985e8-9afe-4670-95d2-1915668888b2 None admin] SCRIPT_NAME: `/identity` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:20:02.773894 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed985e8-9afe-4670-95d2-1915668888b2 None admin] PATH_INFO: `/v3/services` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:20:02.774600 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ed985e8-9afe-4670-95d2-1915668888b2 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:20:02.776078 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ed985e8-9afe-4670-95d2-1915668888b2 None admin] RBAC: Authorization granted {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:20:02.793756 dv-cinder-851351-1-smb devstack@keystone.service[479851]: [pid: 479851|app: 0|req: 493/1006] 10.222.0.42 () {60 vars in 1141 bytes} [Thu Jul 28 09:20:02 2022] POST /identity/v3/services => generated 242 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 09:20:02.841536 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG dbcounter [-] [479852] Writing DB stats keystone:SELECT=100 {{(pid=479852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:20:02.849805 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e3305c-1101-440d-be1c-5bd327c897fd None None] Validating token access rules against request {{(pid=479852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:20:02.897932 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c34982b-39b8-4460-b719-a5b25482bafe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:20:02.898669 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c34982b-39b8-4460-b719-a5b25482bafe None admin] REQUEST_METHOD: `GET` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:20:02.898953 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c34982b-39b8-4460-b719-a5b25482bafe None admin] SCRIPT_NAME: `/identity` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:20:02.899229 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c34982b-39b8-4460-b719-a5b25482bafe None admin] PATH_INFO: `/v3/services/object-store` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:20:02.899869 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c34982b-39b8-4460-b719-a5b25482bafe None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:20:02.901343 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c34982b-39b8-4460-b719-a5b25482bafe None admin] RBAC: Authorization granted {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:20:02.912408 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application [None req-3c34982b-39b8-4460-b719-a5b25482bafe None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 28 09:20:02.912408 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 09:20:02.912408 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 28 09:20:02.912408 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 28 09:20:02.912408 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 28 09:20:02.912408 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 28 09:20:02.912408 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 28 09:20:02.912408 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 09:20:02.912408 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 28 09:20:02.912408 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application Jul 28 09:20:02.912408 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 28 09:20:02.912408 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application Jul 28 09:20:02.912408 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 09:20:02.912408 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 09:20:02.912408 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 09:20:02.912408 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 09:20:02.912408 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 09:20:02.919484 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 09:20:02.919484 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 09:20:02.919484 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 09:20:02.919484 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 09:20:02.919484 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 09:20:02.919484 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 09:20:02.919484 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 28 09:20:02.919484 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 28 09:20:02.919484 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 28 09:20:02.919484 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 28 09:20:02.919484 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 09:20:02.919484 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 09:20:02.919484 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 09:20:02.919484 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 09:20:02.919484 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 09:20:02.919484 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 09:20:02.920523 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 09:20:02.920523 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application with Lock( Jul 28 09:20:02.920523 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 09:20:02.920523 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self._enter() Jul 28 09:20:02.920523 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 09:20:02.920523 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 09:20:02.920523 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 09:20:02.920523 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self.creator() Jul 28 09:20:02.920523 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 09:20:02.920523 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application created_value = creator( Jul 28 09:20:02.920523 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 28 09:20:02.920523 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 09:20:02.920523 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 28 09:20:02.920523 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application Jul 28 09:20:02.920523 dv-cinder-851351-1-smb devstack@keystone.service[479852]: [pid: 479852|app: 0|req: 514/1007] 10.222.0.42 () {56 vars in 1126 bytes} [Thu Jul 28 09:20:02 2022] GET /identity/v3/services/object-store => generated 93 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 09:20:02.923653 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed985e8-9afe-4670-95d2-1915668888b2 None admin] Authenticating user token {{(pid=479851) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:20:02.988612 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG dbcounter [-] [479851] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=479851) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:20:03.038387 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed985e8-9afe-4670-95d2-1915668888b2 None admin] Validating token access rules against request {{(pid=479851) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:20:03.074525 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2435b2a-f849-42b7-8958-d9f31af249a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479851) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:20:03.075176 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2435b2a-f849-42b7-8958-d9f31af249a7 None admin] REQUEST_METHOD: `GET` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:20:03.075466 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2435b2a-f849-42b7-8958-d9f31af249a7 None admin] SCRIPT_NAME: `/identity` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:20:03.075756 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2435b2a-f849-42b7-8958-d9f31af249a7 None admin] PATH_INFO: `/v3/services` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:20:03.076454 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2435b2a-f849-42b7-8958-d9f31af249a7 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=479851) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 09:20:03.076809 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2435b2a-f849-42b7-8958-d9f31af249a7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:20:03.078227 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2435b2a-f849-42b7-8958-d9f31af249a7 None admin] RBAC: Authorization granted {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:20:03.083917 dv-cinder-851351-1-smb devstack@keystone.service[479851]: [pid: 479851|app: 0|req: 494/1008] 10.222.0.42 () {56 vars in 1122 bytes} [Thu Jul 28 09:20:02 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 09:20:03.089975 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c34982b-39b8-4460-b719-a5b25482bafe None admin] Authenticating user token {{(pid=479852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:20:03.196655 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c34982b-39b8-4460-b719-a5b25482bafe None admin] Validating token access rules against request {{(pid=479852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:20:03.231465 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a45b21-9fff-4968-a3d9-5d726dfb7d45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:20:03.232108 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a45b21-9fff-4968-a3d9-5d726dfb7d45 None admin] REQUEST_METHOD: `GET` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:20:03.232393 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a45b21-9fff-4968-a3d9-5d726dfb7d45 None admin] SCRIPT_NAME: `/identity` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:20:03.232691 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a45b21-9fff-4968-a3d9-5d726dfb7d45 None admin] PATH_INFO: `/v3/services` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:20:03.233418 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a45b21-9fff-4968-a3d9-5d726dfb7d45 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=479852) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 09:20:03.233729 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a45b21-9fff-4968-a3d9-5d726dfb7d45 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:20:03.235127 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a45b21-9fff-4968-a3d9-5d726dfb7d45 None admin] RBAC: Authorization granted {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:20:03.240777 dv-cinder-851351-1-smb devstack@keystone.service[479852]: [pid: 479852|app: 0|req: 515/1009] 10.222.0.42 () {56 vars in 1122 bytes} [Thu Jul 28 09:20:03 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:20:03.246629 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2435b2a-f849-42b7-8958-d9f31af249a7 None admin] Authenticating user token {{(pid=479851) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:20:03.365360 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2435b2a-f849-42b7-8958-d9f31af249a7 None admin] Validating token access rules against request {{(pid=479851) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:20:03.389160 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG dbcounter [-] [479851] Writing DB stats keystone:SELECT=100 {{(pid=479851) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:20:03.408679 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb75fc7b-17f1-4cb2-966a-c87c086c5835 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479851) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:20:03.409339 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb75fc7b-17f1-4cb2-966a-c87c086c5835 None admin] REQUEST_METHOD: `POST` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:20:03.409630 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb75fc7b-17f1-4cb2-966a-c87c086c5835 None admin] SCRIPT_NAME: `/identity` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:20:03.409914 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb75fc7b-17f1-4cb2-966a-c87c086c5835 None admin] PATH_INFO: `/v3/endpoints` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:20:03.410683 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb75fc7b-17f1-4cb2-966a-c87c086c5835 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:20:03.412075 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb75fc7b-17f1-4cb2-966a-c87c086c5835 None admin] RBAC: Authorization granted {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:20:03.436690 dv-cinder-851351-1-smb devstack@keystone.service[479851]: [pid: 479851|app: 0|req: 495/1010] 10.222.0.42 () {60 vars in 1144 bytes} [Thu Jul 28 09:20:03 2022] POST /identity/v3/endpoints => generated 325 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 09:20:03.502630 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b3e8ba-16d8-45ab-88af-354b0f57ec4a None None] REQUEST_METHOD: `GET` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:20:03.503219 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b3e8ba-16d8-45ab-88af-354b0f57ec4a None None] SCRIPT_NAME: `/identity` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:20:03.503219 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b3e8ba-16d8-45ab-88af-354b0f57ec4a None None] PATH_INFO: `/` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:20:03.504830 dv-cinder-851351-1-smb devstack@keystone.service[479852]: [pid: 479852|app: 0|req: 516/1011] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 09:20:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 09:20:03.510798 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d06a426-7ef6-4213-b41a-53ba588a3df4 None None] REQUEST_METHOD: `POST` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:20:03.511392 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d06a426-7ef6-4213-b41a-53ba588a3df4 None None] SCRIPT_NAME: `/identity` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:20:03.511392 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d06a426-7ef6-4213-b41a-53ba588a3df4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:20:03.531351 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.auth.core [None req-3d06a426-7ef6-4213-b41a-53ba588a3df4 None None] MFA Rules not processed for user `c198f91a4ae84d2b9cc730a6e304c2be`. Rule list: `[]` (Enabled: `True`). {{(pid=479851) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 09:20:03.532640 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.fernet_utils [None req-3d06a426-7ef6-4213-b41a-53ba588a3df4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=479851) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 09:20:03.618447 dv-cinder-851351-1-smb devstack@keystone.service[479851]: [pid: 479851|app: 0|req: 496/1012] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 09:20:03 2022] POST /identity/v3/auth/tokens => generated 1803 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 09:20:03.640910 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b3e8ba-16d8-45ab-88af-354b0f57ec4a None None] Authenticating user token {{(pid=479852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:20:03.666670 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG dbcounter [-] [479852] Writing DB stats keystone:SELECT=100 {{(pid=479852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:20:03.751065 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b3e8ba-16d8-45ab-88af-354b0f57ec4a None None] Validating token access rules against request {{(pid=479852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:20:03.787306 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da94f26-41b2-472a-aabe-f32646df690b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:20:03.787869 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da94f26-41b2-472a-aabe-f32646df690b None admin] REQUEST_METHOD: `GET` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:20:03.788155 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da94f26-41b2-472a-aabe-f32646df690b None admin] SCRIPT_NAME: `/identity` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:20:03.788491 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da94f26-41b2-472a-aabe-f32646df690b None admin] PATH_INFO: `/v3/services/compute` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:20:03.789095 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3da94f26-41b2-472a-aabe-f32646df690b None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:20:03.790461 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3da94f26-41b2-472a-aabe-f32646df690b None admin] RBAC: Authorization granted {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:20:03.799676 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application [None req-3da94f26-41b2-472a-aabe-f32646df690b None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jul 28 09:20:03.799676 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 09:20:03.799676 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 28 09:20:03.799676 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 28 09:20:03.799676 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 28 09:20:03.799676 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 28 09:20:03.799676 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 28 09:20:03.799676 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 09:20:03.799676 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 28 09:20:03.799676 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application Jul 28 09:20:03.799676 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 28 09:20:03.799676 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application Jul 28 09:20:03.799676 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 09:20:03.799676 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 09:20:03.799676 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 09:20:03.799676 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 09:20:03.799676 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 09:20:03.801159 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 09:20:03.801159 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 09:20:03.801159 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 09:20:03.801159 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 09:20:03.801159 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 09:20:03.801159 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 09:20:03.801159 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 28 09:20:03.801159 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 28 09:20:03.801159 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 28 09:20:03.801159 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 28 09:20:03.801159 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 09:20:03.801159 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 09:20:03.801159 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 09:20:03.801159 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 09:20:03.801159 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 09:20:03.801159 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 09:20:03.802167 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 09:20:03.802167 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application with Lock( Jul 28 09:20:03.802167 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 09:20:03.802167 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self._enter() Jul 28 09:20:03.802167 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 09:20:03.802167 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 09:20:03.802167 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 09:20:03.802167 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self.creator() Jul 28 09:20:03.802167 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 09:20:03.802167 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application created_value = creator( Jul 28 09:20:03.802167 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 28 09:20:03.802167 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 09:20:03.802167 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 28 09:20:03.802167 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application Jul 28 09:20:03.802167 dv-cinder-851351-1-smb devstack@keystone.service[479852]: [pid: 479852|app: 0|req: 517/1013] 10.222.0.42 () {56 vars in 1111 bytes} [Thu Jul 28 09:20:03 2022] GET /identity/v3/services/compute => generated 88 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 09:20:03.806883 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d06a426-7ef6-4213-b41a-53ba588a3df4 None None] Authenticating user token {{(pid=479851) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:20:03.911875 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d06a426-7ef6-4213-b41a-53ba588a3df4 None None] Validating token access rules against request {{(pid=479851) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:20:03.914508 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG dbcounter [-] [479851] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=479851) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:20:03.951218 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9d1ac4-6957-4a29-a23b-b37b72543add None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479851) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:20:03.951962 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9d1ac4-6957-4a29-a23b-b37b72543add None admin] REQUEST_METHOD: `GET` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:20:03.952322 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9d1ac4-6957-4a29-a23b-b37b72543add None admin] SCRIPT_NAME: `/identity` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:20:03.952730 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9d1ac4-6957-4a29-a23b-b37b72543add None admin] PATH_INFO: `/v3/services` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:20:03.953474 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb9d1ac4-6957-4a29-a23b-b37b72543add None admin] RBAC: Adding query filter params (name=compute) {{(pid=479851) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 09:20:03.953857 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb9d1ac4-6957-4a29-a23b-b37b72543add None admin] RBAC: Authorizing `identity:list_services()` {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:20:03.955383 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb9d1ac4-6957-4a29-a23b-b37b72543add None admin] RBAC: Authorization granted {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:20:03.961703 dv-cinder-851351-1-smb devstack@keystone.service[479851]: [pid: 479851|app: 0|req: 497/1014] 10.222.0.42 () {56 vars in 1112 bytes} [Thu Jul 28 09:20:03 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:20:03.967541 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da94f26-41b2-472a-aabe-f32646df690b None admin] Authenticating user token {{(pid=479852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:20:04.059032 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG dbcounter [-] [479852] Writing DB stats keystone:SELECT=100 {{(pid=479852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:20:04.076255 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da94f26-41b2-472a-aabe-f32646df690b None admin] Validating token access rules against request {{(pid=479852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:20:04.111451 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61442ebf-52c8-47e4-a8f9-7a8646c677ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:20:04.112475 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61442ebf-52c8-47e4-a8f9-7a8646c677ea None admin] REQUEST_METHOD: `GET` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:20:04.112870 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61442ebf-52c8-47e4-a8f9-7a8646c677ea None admin] SCRIPT_NAME: `/identity` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:20:04.113213 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61442ebf-52c8-47e4-a8f9-7a8646c677ea None admin] PATH_INFO: `/v3/services` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:20:04.114036 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61442ebf-52c8-47e4-a8f9-7a8646c677ea None admin] RBAC: Adding query filter params (type=compute) {{(pid=479852) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 09:20:04.114414 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61442ebf-52c8-47e4-a8f9-7a8646c677ea None admin] RBAC: Authorizing `identity:list_services()` {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:20:04.115868 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61442ebf-52c8-47e4-a8f9-7a8646c677ea None admin] RBAC: Authorization granted {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:20:04.126137 dv-cinder-851351-1-smb devstack@keystone.service[479852]: [pid: 479852|app: 0|req: 518/1015] 10.222.0.42 () {56 vars in 1112 bytes} [Thu Jul 28 09:20:03 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:20:04.127242 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9d1ac4-6957-4a29-a23b-b37b72543add None admin] Authenticating user token {{(pid=479851) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:20:04.232323 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9d1ac4-6957-4a29-a23b-b37b72543add None admin] Validating token access rules against request {{(pid=479851) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:20:04.269240 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e02c3e-63aa-4872-8215-6600a64a032c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479851) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:20:04.270048 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e02c3e-63aa-4872-8215-6600a64a032c None admin] REQUEST_METHOD: `POST` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:20:04.270402 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e02c3e-63aa-4872-8215-6600a64a032c None admin] SCRIPT_NAME: `/identity` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:20:04.270753 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e02c3e-63aa-4872-8215-6600a64a032c None admin] PATH_INFO: `/v3/endpoints` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:20:04.271576 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e02c3e-63aa-4872-8215-6600a64a032c None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:20:04.273114 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e02c3e-63aa-4872-8215-6600a64a032c None admin] RBAC: Authorization granted {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:20:04.302071 dv-cinder-851351-1-smb devstack@keystone.service[479851]: [pid: 479851|app: 0|req: 498/1016] 10.222.0.42 () {60 vars in 1144 bytes} [Thu Jul 28 09:20:04 2022] POST /identity/v3/endpoints => generated 334 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 09:20:04.876422 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e72f7ee-7a85-4d03-976a-9de4f5a24e12 None None] REQUEST_METHOD: `GET` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:20:04.877046 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e72f7ee-7a85-4d03-976a-9de4f5a24e12 None None] SCRIPT_NAME: `/identity` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:20:04.877046 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e72f7ee-7a85-4d03-976a-9de4f5a24e12 None None] PATH_INFO: `/` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:20:04.878477 dv-cinder-851351-1-smb devstack@keystone.service[479852]: [pid: 479852|app: 0|req: 519/1017] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 09:20:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 09:20:04.883861 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b535170e-1b1f-48c2-9c91-38fe0285c23e None None] REQUEST_METHOD: `POST` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:20:04.884375 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b535170e-1b1f-48c2-9c91-38fe0285c23e None None] SCRIPT_NAME: `/identity` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:20:04.884375 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b535170e-1b1f-48c2-9c91-38fe0285c23e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:20:04.903323 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.auth.core [None req-b535170e-1b1f-48c2-9c91-38fe0285c23e None None] MFA Rules not processed for user `c198f91a4ae84d2b9cc730a6e304c2be`. Rule list: `[]` (Enabled: `True`). {{(pid=479851) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 09:20:04.904518 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.fernet_utils [None req-b535170e-1b1f-48c2-9c91-38fe0285c23e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=479851) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 09:20:04.923677 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG dbcounter [-] [479851] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=479851) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:20:04.982596 dv-cinder-851351-1-smb devstack@keystone.service[479851]: [pid: 479851|app: 0|req: 499/1018] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 09:20:04 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 09:20:05.005156 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e72f7ee-7a85-4d03-976a-9de4f5a24e12 None None] Authenticating user token {{(pid=479852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:20:05.116135 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e72f7ee-7a85-4d03-976a-9de4f5a24e12 None None] Validating token access rules against request {{(pid=479852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:20:05.151608 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c987d4bc-0bba-4e36-9b62-70e5858c581f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:20:05.152177 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c987d4bc-0bba-4e36-9b62-70e5858c581f None admin] REQUEST_METHOD: `GET` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:20:05.152458 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c987d4bc-0bba-4e36-9b62-70e5858c581f None admin] SCRIPT_NAME: `/identity` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:20:05.152773 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c987d4bc-0bba-4e36-9b62-70e5858c581f None admin] PATH_INFO: `/v3/services/image` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:20:05.153421 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c987d4bc-0bba-4e36-9b62-70e5858c581f None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:20:05.154812 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c987d4bc-0bba-4e36-9b62-70e5858c581f None admin] RBAC: Authorization granted {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:20:05.164285 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application [None req-c987d4bc-0bba-4e36-9b62-70e5858c581f None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jul 28 09:20:05.164285 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 09:20:05.164285 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 28 09:20:05.164285 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 28 09:20:05.164285 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 28 09:20:05.164285 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 28 09:20:05.164285 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 28 09:20:05.164285 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 09:20:05.164285 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 28 09:20:05.164285 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application Jul 28 09:20:05.164285 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 28 09:20:05.164285 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application Jul 28 09:20:05.164285 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 09:20:05.164285 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 09:20:05.164285 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 09:20:05.164285 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 09:20:05.164285 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 09:20:05.170692 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 09:20:05.170692 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 09:20:05.170692 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 09:20:05.170692 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 09:20:05.170692 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 09:20:05.170692 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 09:20:05.170692 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 28 09:20:05.170692 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 28 09:20:05.170692 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 28 09:20:05.170692 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 28 09:20:05.170692 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 09:20:05.170692 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 09:20:05.170692 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 09:20:05.170692 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 09:20:05.170692 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 09:20:05.170692 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 09:20:05.171719 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 09:20:05.171719 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application with Lock( Jul 28 09:20:05.171719 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 09:20:05.171719 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self._enter() Jul 28 09:20:05.171719 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 09:20:05.171719 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 09:20:05.171719 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 09:20:05.171719 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self.creator() Jul 28 09:20:05.171719 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 09:20:05.171719 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application created_value = creator( Jul 28 09:20:05.171719 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 28 09:20:05.171719 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 09:20:05.171719 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 28 09:20:05.171719 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application Jul 28 09:20:05.171719 dv-cinder-851351-1-smb devstack@keystone.service[479852]: [pid: 479852|app: 0|req: 520/1019] 10.222.0.42 () {56 vars in 1105 bytes} [Thu Jul 28 09:20:05 2022] GET /identity/v3/services/image => generated 86 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 09:20:05.174185 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b535170e-1b1f-48c2-9c91-38fe0285c23e None None] Authenticating user token {{(pid=479851) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:20:05.277485 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b535170e-1b1f-48c2-9c91-38fe0285c23e None None] Validating token access rules against request {{(pid=479851) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:20:05.311975 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4552f1a-d28f-49a3-8577-745301f65963 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479851) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:20:05.312709 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4552f1a-d28f-49a3-8577-745301f65963 None admin] REQUEST_METHOD: `GET` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:20:05.313009 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4552f1a-d28f-49a3-8577-745301f65963 None admin] SCRIPT_NAME: `/identity` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:20:05.313319 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4552f1a-d28f-49a3-8577-745301f65963 None admin] PATH_INFO: `/v3/services` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:20:05.314075 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4552f1a-d28f-49a3-8577-745301f65963 None admin] RBAC: Adding query filter params (name=image) {{(pid=479851) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 09:20:05.314389 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4552f1a-d28f-49a3-8577-745301f65963 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:20:05.315776 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4552f1a-d28f-49a3-8577-745301f65963 None admin] RBAC: Authorization granted {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:20:05.324884 dv-cinder-851351-1-smb devstack@keystone.service[479851]: [pid: 479851|app: 0|req: 500/1020] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 09:20:05 2022] GET /identity/v3/services?name=image => generated 122 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:20:05.327238 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c987d4bc-0bba-4e36-9b62-70e5858c581f None admin] Authenticating user token {{(pid=479852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:20:05.344106 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG dbcounter [-] [479852] Writing DB stats keystone:SELECT=100 {{(pid=479852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:20:05.439166 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c987d4bc-0bba-4e36-9b62-70e5858c581f None admin] Validating token access rules against request {{(pid=479852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:20:05.475755 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e141a6cc-671f-4616-920f-b1310981ae72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:20:05.476401 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e141a6cc-671f-4616-920f-b1310981ae72 None admin] REQUEST_METHOD: `GET` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:20:05.476737 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e141a6cc-671f-4616-920f-b1310981ae72 None admin] SCRIPT_NAME: `/identity` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:20:05.476985 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e141a6cc-671f-4616-920f-b1310981ae72 None admin] PATH_INFO: `/v3/services` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:20:05.477110 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc19e9d-3b95-46a0-a2ac-217e40800e56 None None] REQUEST_METHOD: `GET` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:20:05.477315 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc19e9d-3b95-46a0-a2ac-217e40800e56 None None] SCRIPT_NAME: `/identity` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:20:05.477593 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc19e9d-3b95-46a0-a2ac-217e40800e56 None None] PATH_INFO: `/` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:20:05.477697 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e141a6cc-671f-4616-920f-b1310981ae72 None admin] RBAC: Adding query filter params (type=image) {{(pid=479852) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 09:20:05.477981 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e141a6cc-671f-4616-920f-b1310981ae72 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:20:05.479190 dv-cinder-851351-1-smb devstack@keystone.service[479851]: [pid: 479851|app: 0|req: 501/1021] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 09:20:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 09:20:05.479410 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e141a6cc-671f-4616-920f-b1310981ae72 None admin] RBAC: Authorization granted {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:20:05.484381 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7061eb-ed16-49e9-8015-f3ed3dd304d0 None None] REQUEST_METHOD: `POST` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:20:05.484696 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7061eb-ed16-49e9-8015-f3ed3dd304d0 None None] SCRIPT_NAME: `/identity` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:20:05.485036 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7061eb-ed16-49e9-8015-f3ed3dd304d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:20:05.488768 dv-cinder-851351-1-smb devstack@keystone.service[479852]: [pid: 479852|app: 0|req: 521/1022] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 09:20:05 2022] GET /identity/v3/services?type=image => generated 350 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:20:05.494312 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e141a6cc-671f-4616-920f-b1310981ae72 None admin] Authenticating user token {{(pid=479852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:20:05.506250 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.auth.core [None req-3c7061eb-ed16-49e9-8015-f3ed3dd304d0 None None] MFA Rules not processed for user `c198f91a4ae84d2b9cc730a6e304c2be`. Rule list: `[]` (Enabled: `True`). {{(pid=479851) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 09:20:05.507486 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.fernet_utils [None req-3c7061eb-ed16-49e9-8015-f3ed3dd304d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=479851) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 09:20:05.517976 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG dbcounter [-] [479851] Writing DB stats keystone:SELECT=100 {{(pid=479851) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:20:05.577984 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG dbcounter [-] [479852] Writing DB stats keystone:SELECT=100 {{(pid=479852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:20:05.583169 dv-cinder-851351-1-smb devstack@keystone.service[479851]: [pid: 479851|app: 0|req: 502/1023] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 09:20:05 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 28 09:20:05.605818 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c7061eb-ed16-49e9-8015-f3ed3dd304d0 None None] Authenticating user token {{(pid=479851) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:20:05.606057 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e141a6cc-671f-4616-920f-b1310981ae72 None admin] Validating token access rules against request {{(pid=479852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:20:05.642732 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba67220-b3d9-4de4-83de-b1887c601d09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:20:05.643366 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba67220-b3d9-4de4-83de-b1887c601d09 None admin] REQUEST_METHOD: `GET` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:20:05.643646 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba67220-b3d9-4de4-83de-b1887c601d09 None admin] SCRIPT_NAME: `/identity` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:20:05.643921 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba67220-b3d9-4de4-83de-b1887c601d09 None admin] PATH_INFO: `/v3/endpoints` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:20:05.644818 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ba67220-b3d9-4de4-83de-b1887c601d09 None admin] RBAC: Adding query filter params (interface=public, service_id=e651dde70fbf4e1a9ab1eaa5e3cec51a, region_id=RegionOne) {{(pid=479852) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 09:20:05.645139 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ba67220-b3d9-4de4-83de-b1887c601d09 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:20:05.646742 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ba67220-b3d9-4de4-83de-b1887c601d09 None admin] RBAC: Authorization granted {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:20:05.652082 dv-cinder-851351-1-smb devstack@keystone.service[479852]: [pid: 479852|app: 0|req: 522/1024] 10.222.0.42 () {56 vars in 1251 bytes} [Thu Jul 28 09:20:05 2022] GET /identity/v3/endpoints?service_id=e651dde70fbf4e1a9ab1eaa5e3cec51a&interface=public®ion_id=RegionOne => generated 194 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:20:05.657630 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba67220-b3d9-4de4-83de-b1887c601d09 None admin] Authenticating user token {{(pid=479852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:20:05.722557 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c7061eb-ed16-49e9-8015-f3ed3dd304d0 None None] Validating token access rules against request {{(pid=479851) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:20:05.758256 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6e371f-ef48-4fef-b200-048064616329 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479851) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:20:05.758915 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6e371f-ef48-4fef-b200-048064616329 None admin] REQUEST_METHOD: `GET` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:20:05.759200 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6e371f-ef48-4fef-b200-048064616329 None admin] SCRIPT_NAME: `/identity` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:20:05.759474 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6e371f-ef48-4fef-b200-048064616329 None admin] PATH_INFO: `/v3/domains/default` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:20:05.760640 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b6e371f-ef48-4fef-b200-048064616329 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:20:05.762120 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b6e371f-ef48-4fef-b200-048064616329 None admin] RBAC: Authorization granted {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:20:05.763752 dv-cinder-851351-1-smb devstack@keystone.service[479851]: [pid: 479851|app: 0|req: 503/1025] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 09:20:05 2022] GET /identity/v3/domains/default => generated 199 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:20:05.766153 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba67220-b3d9-4de4-83de-b1887c601d09 None admin] Validating token access rules against request {{(pid=479852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:20:05.769603 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6e371f-ef48-4fef-b200-048064616329 None admin] Authenticating user token {{(pid=479851) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:20:05.785758 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG dbcounter [-] [479851] Writing DB stats keystone:SELECT=100 {{(pid=479851) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:20:05.807175 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31093512-82fc-4a34-82e7-b129cfa7bb62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:20:05.807822 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31093512-82fc-4a34-82e7-b129cfa7bb62 None admin] REQUEST_METHOD: `GET` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:20:05.808104 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31093512-82fc-4a34-82e7-b129cfa7bb62 None admin] SCRIPT_NAME: `/identity` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:20:05.808380 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31093512-82fc-4a34-82e7-b129cfa7bb62 None admin] PATH_INFO: `/v3/services` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:20:05.809087 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31093512-82fc-4a34-82e7-b129cfa7bb62 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:20:05.810467 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31093512-82fc-4a34-82e7-b129cfa7bb62 None admin] RBAC: Authorization granted {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:20:05.817716 dv-cinder-851351-1-smb devstack@keystone.service[479852]: [pid: 479852|app: 0|req: 523/1026] 10.222.0.42 () {56 vars in 1087 bytes} [Thu Jul 28 09:20:05 2022] GET /identity/v3/services => generated 1957 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 28 09:20:05.884627 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6e371f-ef48-4fef-b200-048064616329 None admin] Validating token access rules against request {{(pid=479851) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:20:05.925160 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f81fa32c-9f72-4e0b-9fe2-0ff3182b9c9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479851) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:20:05.925813 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81fa32c-9f72-4e0b-9fe2-0ff3182b9c9a None admin] REQUEST_METHOD: `POST` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:20:05.926152 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81fa32c-9f72-4e0b-9fe2-0ff3182b9c9a None admin] SCRIPT_NAME: `/identity` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:20:05.926427 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81fa32c-9f72-4e0b-9fe2-0ff3182b9c9a None admin] PATH_INFO: `/v3/projects` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:20:05.927140 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f81fa32c-9f72-4e0b-9fe2-0ff3182b9c9a None admin] RBAC: Authorizing `identity:create_project()` {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:20:05.928611 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f81fa32c-9f72-4e0b-9fe2-0ff3182b9c9a None admin] RBAC: Authorization granted {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:20:05.960852 dv-cinder-851351-1-smb devstack@keystone.service[479851]: [pid: 479851|app: 0|req: 504/1027] 10.222.0.42 () {60 vars in 1141 bytes} [Thu Jul 28 09:20:05 2022] POST /identity/v3/projects => generated 311 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 28 09:20:06.407068 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4985f6eb-5a9e-4e19-8673-06588bbd3cb1 None None] REQUEST_METHOD: `GET` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:20:06.407673 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4985f6eb-5a9e-4e19-8673-06588bbd3cb1 None None] SCRIPT_NAME: `/identity` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:20:06.407673 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4985f6eb-5a9e-4e19-8673-06588bbd3cb1 None None] PATH_INFO: `/` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:20:06.409119 dv-cinder-851351-1-smb devstack@keystone.service[479852]: [pid: 479852|app: 0|req: 524/1028] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 09:20:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 09:20:06.415307 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c781cb-9df3-4768-932d-00d2ff116ffc None None] REQUEST_METHOD: `POST` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:20:06.415560 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c781cb-9df3-4768-932d-00d2ff116ffc None None] SCRIPT_NAME: `/identity` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:20:06.415824 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c781cb-9df3-4768-932d-00d2ff116ffc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:20:06.435431 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.auth.core [None req-23c781cb-9df3-4768-932d-00d2ff116ffc None None] MFA Rules not processed for user `c198f91a4ae84d2b9cc730a6e304c2be`. Rule list: `[]` (Enabled: `True`). {{(pid=479851) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 09:20:06.436691 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.fernet_utils [None req-23c781cb-9df3-4768-932d-00d2ff116ffc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=479851) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 09:20:06.506249 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG dbcounter [-] [479851] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=479851) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:20:06.520880 dv-cinder-851351-1-smb devstack@keystone.service[479851]: [pid: 479851|app: 0|req: 505/1029] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 09:20:06 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 09:20:06.541176 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4985f6eb-5a9e-4e19-8673-06588bbd3cb1 None None] Authenticating user token {{(pid=479852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:20:06.545415 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG dbcounter [-] [479852] Writing DB stats keystone:SELECT=100 {{(pid=479852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:20:06.665900 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4985f6eb-5a9e-4e19-8673-06588bbd3cb1 None None] Validating token access rules against request {{(pid=479852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:20:06.701464 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab1ccbf1-2c38-42e8-9e40-1dc3e780443d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:20:06.702121 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1ccbf1-2c38-42e8-9e40-1dc3e780443d None admin] REQUEST_METHOD: `GET` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:20:06.702386 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1ccbf1-2c38-42e8-9e40-1dc3e780443d None admin] SCRIPT_NAME: `/identity` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:20:06.702669 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1ccbf1-2c38-42e8-9e40-1dc3e780443d None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:20:06.714608 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab1ccbf1-2c38-42e8-9e40-1dc3e780443d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 09:20:06.719608 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application [None req-ab1ccbf1-2c38-42e8-9e40-1dc3e780443d None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 28 09:20:06.719608 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 09:20:06.719608 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 09:20:06.719608 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 09:20:06.719608 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 09:20:06.719608 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 09:20:06.719608 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 09:20:06.719608 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 09:20:06.719608 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 09:20:06.719608 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 09:20:06.719608 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 09:20:06.719608 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 09:20:06.719608 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 09:20:06.719608 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 09:20:06.719608 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 09:20:06.719608 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 09:20:06.721803 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 09:20:06.721803 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 09:20:06.721803 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 09:20:06.721803 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 09:20:06.721803 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 09:20:06.721803 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 09:20:06.721803 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 09:20:06.721803 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 09:20:06.721803 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 09:20:06.721803 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 09:20:06.721803 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 09:20:06.721803 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application with Lock( Jul 28 09:20:06.721803 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 09:20:06.721803 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self._enter() Jul 28 09:20:06.721803 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 09:20:06.721803 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 09:20:06.723965 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 09:20:06.723965 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self.creator() Jul 28 09:20:06.723965 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 09:20:06.723965 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application created_value = creator( Jul 28 09:20:06.723965 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 09:20:06.723965 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 09:20:06.723965 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 09:20:06.723965 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 09:20:06.723965 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 09:20:06.723965 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 09:20:06.723965 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 28 09:20:06.723965 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application Jul 28 09:20:06.727066 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c781cb-9df3-4768-932d-00d2ff116ffc None None] Authenticating user token {{(pid=479851) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:20:06.728890 dv-cinder-851351-1-smb devstack@keystone.service[479852]: [pid: 479852|app: 0|req: 525/1030] 10.222.0.42 () {56 vars in 1120 bytes} [Thu Jul 28 09:20:06 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 09:20:06.853675 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c781cb-9df3-4768-932d-00d2ff116ffc None None] Validating token access rules against request {{(pid=479851) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:20:06.890591 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-778a3da1-90d9-41b5-a111-7b9b94912bd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479851) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:20:06.892076 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778a3da1-90d9-41b5-a111-7b9b94912bd1 None admin] REQUEST_METHOD: `GET` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:20:06.892572 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778a3da1-90d9-41b5-a111-7b9b94912bd1 None admin] SCRIPT_NAME: `/identity` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:20:06.893132 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778a3da1-90d9-41b5-a111-7b9b94912bd1 None admin] PATH_INFO: `/v3/roles` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:20:06.894074 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-778a3da1-90d9-41b5-a111-7b9b94912bd1 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=479851) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 09:20:06.894636 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-778a3da1-90d9-41b5-a111-7b9b94912bd1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:20:06.896287 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-778a3da1-90d9-41b5-a111-7b9b94912bd1 None admin] RBAC: Authorization granted {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:20:06.905895 dv-cinder-851351-1-smb devstack@keystone.service[479851]: [pid: 479851|app: 0|req: 506/1031] 10.222.0.42 () {56 vars in 1115 bytes} [Thu Jul 28 09:20:06 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:20:06.911853 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab1ccbf1-2c38-42e8-9e40-1dc3e780443d None admin] Authenticating user token {{(pid=479852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:20:06.991983 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG dbcounter [-] [479852] Writing DB stats keystone:SELECT=100 {{(pid=479852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:20:07.034398 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab1ccbf1-2c38-42e8-9e40-1dc3e780443d None admin] Validating token access rules against request {{(pid=479852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:20:07.074081 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea9813b3-fc9d-4301-95d9-540be49cfb2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:20:07.074768 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9813b3-fc9d-4301-95d9-540be49cfb2a None admin] REQUEST_METHOD: `GET` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:20:07.075444 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9813b3-fc9d-4301-95d9-540be49cfb2a None admin] SCRIPT_NAME: `/identity` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:20:07.075444 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9813b3-fc9d-4301-95d9-540be49cfb2a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:20:07.093860 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea9813b3-fc9d-4301-95d9-540be49cfb2a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:20:07.095349 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea9813b3-fc9d-4301-95d9-540be49cfb2a None admin] RBAC: Authorization granted {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:20:07.111968 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application [None req-ea9813b3-fc9d-4301-95d9-540be49cfb2a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 09:20:07.111968 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 09:20:07.111968 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 09:20:07.111968 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 09:20:07.111968 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 09:20:07.111968 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 09:20:07.111968 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 09:20:07.111968 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 09:20:07.111968 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 09:20:07.111968 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 09:20:07.111968 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 09:20:07.111968 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 09:20:07.111968 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 09:20:07.111968 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 09:20:07.111968 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 09:20:07.120611 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 09:20:07.120611 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 09:20:07.120611 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 09:20:07.120611 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 09:20:07.120611 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 09:20:07.120611 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 09:20:07.120611 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 09:20:07.120611 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 09:20:07.120611 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application with Lock( Jul 28 09:20:07.120611 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 09:20:07.120611 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self._enter() Jul 28 09:20:07.120611 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 09:20:07.120611 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 09:20:07.120611 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 09:20:07.120611 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self.creator() Jul 28 09:20:07.120611 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 09:20:07.120611 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application created_value = creator( Jul 28 09:20:07.123263 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 09:20:07.123263 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 09:20:07.123263 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 09:20:07.123263 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application Jul 28 09:20:07.123263 dv-cinder-851351-1-smb devstack@keystone.service[479852]: [pid: 479852|app: 0|req: 526/1032] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 09:20:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 09:20:07.123955 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-778a3da1-90d9-41b5-a111-7b9b94912bd1 None admin] Authenticating user token {{(pid=479851) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:20:07.183834 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG dbcounter [-] [479851] Writing DB stats keystone:SELECT=100 {{(pid=479851) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:20:07.243412 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-778a3da1-90d9-41b5-a111-7b9b94912bd1 None admin] Validating token access rules against request {{(pid=479851) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:20:07.283041 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3630240e-12d8-40eb-b34f-8b82bdfe5f50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479851) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:20:07.283680 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3630240e-12d8-40eb-b34f-8b82bdfe5f50 None admin] REQUEST_METHOD: `GET` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:20:07.283964 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3630240e-12d8-40eb-b34f-8b82bdfe5f50 None admin] SCRIPT_NAME: `/identity` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:20:07.284244 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3630240e-12d8-40eb-b34f-8b82bdfe5f50 None admin] PATH_INFO: `/v3/domains` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:20:07.284983 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3630240e-12d8-40eb-b34f-8b82bdfe5f50 None admin] RBAC: Adding query filter params (name=Default) {{(pid=479851) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 09:20:07.285355 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3630240e-12d8-40eb-b34f-8b82bdfe5f50 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:20:07.287711 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3630240e-12d8-40eb-b34f-8b82bdfe5f50 None admin] RBAC: Authorization granted {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:20:07.307895 dv-cinder-851351-1-smb devstack@keystone.service[479851]: [pid: 479851|app: 0|req: 507/1033] 10.222.0.42 () {56 vars in 1109 bytes} [Thu Jul 28 09:20:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:20:07.309251 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea9813b3-fc9d-4301-95d9-540be49cfb2a None admin] Authenticating user token {{(pid=479852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:20:07.437671 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea9813b3-fc9d-4301-95d9-540be49cfb2a None admin] Validating token access rules against request {{(pid=479852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:20:07.467384 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG dbcounter [-] [479852] Writing DB stats keystone:SELECT=100 {{(pid=479852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:20:07.497462 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054b9fe2-9039-48dc-8625-1262b80d8271 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:20:07.498055 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054b9fe2-9039-48dc-8625-1262b80d8271 None admin] REQUEST_METHOD: `GET` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:20:07.498334 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054b9fe2-9039-48dc-8625-1262b80d8271 None admin] SCRIPT_NAME: `/identity` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:20:07.498591 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054b9fe2-9039-48dc-8625-1262b80d8271 None admin] PATH_INFO: `/v3/users/nova` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:20:07.506955 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-054b9fe2-9039-48dc-8625-1262b80d8271 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:20:07.508546 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-054b9fe2-9039-48dc-8625-1262b80d8271 None admin] RBAC: Authorization granted {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:20:07.520269 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application [None req-054b9fe2-9039-48dc-8625-1262b80d8271 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 28 09:20:07.520269 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 09:20:07.520269 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 09:20:07.520269 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 09:20:07.520269 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 09:20:07.520269 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 09:20:07.520269 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 09:20:07.520269 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 09:20:07.520269 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 09:20:07.520269 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 09:20:07.520269 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 09:20:07.520269 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 09:20:07.520269 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 28 09:20:07.520269 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 28 09:20:07.520269 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 28 09:20:07.520269 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 28 09:20:07.521458 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 09:20:07.521458 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 09:20:07.521458 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 28 09:20:07.521458 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 09:20:07.521458 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 28 09:20:07.521458 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 09:20:07.521458 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 09:20:07.521458 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 09:20:07.521458 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 09:20:07.521458 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 09:20:07.521458 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 09:20:07.521458 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application with Lock( Jul 28 09:20:07.521458 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 09:20:07.521458 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self._enter() Jul 28 09:20:07.521458 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 09:20:07.521458 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 09:20:07.521458 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 09:20:07.521458 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self.creator() Jul 28 09:20:07.522573 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 09:20:07.522573 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application created_value = creator( Jul 28 09:20:07.522573 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 28 09:20:07.522573 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 28 09:20:07.522573 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 28 09:20:07.522573 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 28 09:20:07.522573 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 28 09:20:07.522573 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 28 09:20:07.522573 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 28 09:20:07.522573 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application Jul 28 09:20:07.525011 dv-cinder-851351-1-smb devstack@keystone.service[479852]: [pid: 479852|app: 0|req: 527/1034] 10.222.0.42 () {56 vars in 1093 bytes} [Thu Jul 28 09:20:07 2022] GET /identity/v3/users/nova => generated 82 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 09:20:07.527336 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3630240e-12d8-40eb-b34f-8b82bdfe5f50 None admin] Authenticating user token {{(pid=479851) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:20:07.632024 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3630240e-12d8-40eb-b34f-8b82bdfe5f50 None admin] Validating token access rules against request {{(pid=479851) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:20:07.653545 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG dbcounter [-] [479851] Writing DB stats keystone:SELECT=100 {{(pid=479851) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:20:07.674327 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b80a47-db88-43cc-95fe-d544010f597d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479851) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:20:07.674998 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b80a47-db88-43cc-95fe-d544010f597d None admin] REQUEST_METHOD: `GET` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:20:07.675263 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b80a47-db88-43cc-95fe-d544010f597d None admin] SCRIPT_NAME: `/identity` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:20:07.675532 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b80a47-db88-43cc-95fe-d544010f597d None admin] PATH_INFO: `/v3/users` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:20:07.676760 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88b80a47-db88-43cc-95fe-d544010f597d None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=479851) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 09:20:07.677076 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88b80a47-db88-43cc-95fe-d544010f597d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:20:07.678549 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88b80a47-db88-43cc-95fe-d544010f597d None admin] RBAC: Authorization granted {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:20:07.699381 dv-cinder-851351-1-smb devstack@keystone.service[479851]: [pid: 479851|app: 0|req: 508/1035] 10.222.0.42 () {56 vars in 1133 bytes} [Thu Jul 28 09:20:07 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:20:07.705090 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054b9fe2-9039-48dc-8625-1262b80d8271 None admin] Authenticating user token {{(pid=479852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:20:07.809173 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054b9fe2-9039-48dc-8625-1262b80d8271 None admin] Validating token access rules against request {{(pid=479852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:20:07.848055 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f4be161-e8d5-41ef-b2ba-b41442d4203e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:20:07.848708 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4be161-e8d5-41ef-b2ba-b41442d4203e None admin] REQUEST_METHOD: `GET` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:20:07.849004 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4be161-e8d5-41ef-b2ba-b41442d4203e None admin] SCRIPT_NAME: `/identity` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:20:07.849278 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4be161-e8d5-41ef-b2ba-b41442d4203e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:20:07.884167 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b36cba-7a2a-4687-aa09-38d006a73f56 None None] REQUEST_METHOD: `GET` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:20:07.884554 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b36cba-7a2a-4687-aa09-38d006a73f56 None None] SCRIPT_NAME: `/identity` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:20:07.884924 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b36cba-7a2a-4687-aa09-38d006a73f56 None None] PATH_INFO: `/` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:20:07.886372 dv-cinder-851351-1-smb devstack@keystone.service[479851]: [pid: 479851|app: 0|req: 509/1036] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 09:20:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 09:20:07.893712 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95e70a0-6c3e-4274-b3e2-779ad12e0f7f None None] REQUEST_METHOD: `POST` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:20:07.894381 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95e70a0-6c3e-4274-b3e2-779ad12e0f7f None None] SCRIPT_NAME: `/identity` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:20:07.894381 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95e70a0-6c3e-4274-b3e2-779ad12e0f7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:20:07.897832 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG dbcounter [-] [479852] Writing DB stats keystone:SELECT=100 {{(pid=479852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:20:07.917730 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.auth.core [None req-b95e70a0-6c3e-4274-b3e2-779ad12e0f7f None None] MFA Rules not processed for user `c198f91a4ae84d2b9cc730a6e304c2be`. Rule list: `[]` (Enabled: `True`). {{(pid=479851) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 09:20:07.919108 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.fernet_utils [None req-b95e70a0-6c3e-4274-b3e2-779ad12e0f7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=479851) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 09:20:07.932065 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f4be161-e8d5-41ef-b2ba-b41442d4203e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:20:07.933829 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f4be161-e8d5-41ef-b2ba-b41442d4203e None admin] RBAC: Authorization granted {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:20:08.004748 dv-cinder-851351-1-smb devstack@keystone.service[479851]: [pid: 479851|app: 0|req: 510/1037] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 09:20:07 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 09:20:08.024514 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b95e70a0-6c3e-4274-b3e2-779ad12e0f7f None None] Authenticating user token {{(pid=479851) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:20:08.073805 dv-cinder-851351-1-smb devstack@keystone.service[479852]: [pid: 479852|app: 0|req: 528/1038] 10.222.0.42 () {58 vars in 1282 bytes} [Thu Jul 28 09:20:07 2022] GET /identity/v3/auth/tokens => generated 1959 bytes in 369 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 28 09:20:08.079438 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f4be161-e8d5-41ef-b2ba-b41442d4203e None admin] Authenticating user token {{(pid=479852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:20:08.144264 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b95e70a0-6c3e-4274-b3e2-779ad12e0f7f None None] Validating token access rules against request {{(pid=479851) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:20:08.146797 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG dbcounter [-] [479851] Writing DB stats keystone:SELECT=100 {{(pid=479851) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:20:08.183594 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG dbcounter [-] [479852] Writing DB stats keystone:SELECT=100 {{(pid=479852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:20:08.184094 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3180a9cd-ab22-4857-89bc-12f17660c232 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479851) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:20:08.185085 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3180a9cd-ab22-4857-89bc-12f17660c232 None admin] REQUEST_METHOD: `GET` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:20:08.185386 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3180a9cd-ab22-4857-89bc-12f17660c232 None admin] SCRIPT_NAME: `/identity` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:20:08.185732 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3180a9cd-ab22-4857-89bc-12f17660c232 None admin] PATH_INFO: `/v3/services/image` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:20:08.186499 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3180a9cd-ab22-4857-89bc-12f17660c232 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:20:08.187948 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3180a9cd-ab22-4857-89bc-12f17660c232 None admin] RBAC: Authorization granted {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:20:08.197787 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application [None req-3180a9cd-ab22-4857-89bc-12f17660c232 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jul 28 09:20:08.197787 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 09:20:08.197787 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 28 09:20:08.197787 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 28 09:20:08.197787 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 28 09:20:08.197787 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 28 09:20:08.197787 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 28 09:20:08.197787 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 09:20:08.197787 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 28 09:20:08.197787 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application Jul 28 09:20:08.197787 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 28 09:20:08.197787 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application Jul 28 09:20:08.197787 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 09:20:08.197787 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 09:20:08.197787 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 09:20:08.197787 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 09:20:08.197787 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 09:20:08.198956 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 09:20:08.198956 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 09:20:08.198956 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 09:20:08.198956 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 09:20:08.198956 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 09:20:08.198956 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 09:20:08.198956 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 28 09:20:08.198956 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 28 09:20:08.198956 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 28 09:20:08.198956 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 28 09:20:08.198956 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 09:20:08.198956 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 09:20:08.198956 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 09:20:08.198956 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 09:20:08.198956 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 09:20:08.198956 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 09:20:08.200033 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 09:20:08.200033 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application with Lock( Jul 28 09:20:08.200033 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 09:20:08.200033 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return self._enter() Jul 28 09:20:08.200033 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 09:20:08.200033 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 09:20:08.200033 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 09:20:08.200033 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return self.creator() Jul 28 09:20:08.200033 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 09:20:08.200033 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application created_value = creator( Jul 28 09:20:08.200033 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 28 09:20:08.200033 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 09:20:08.200033 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 28 09:20:08.200033 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application Jul 28 09:20:08.200033 dv-cinder-851351-1-smb devstack@keystone.service[479851]: [pid: 479851|app: 0|req: 511/1039] 10.222.0.42 () {56 vars in 1105 bytes} [Thu Jul 28 09:20:08 2022] GET /identity/v3/services/image => generated 86 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 09:20:08.201047 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058b3ed4-d019-4959-859e-c3ce28291c17 None None] REQUEST_METHOD: `GET` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:20:08.201047 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058b3ed4-d019-4959-859e-c3ce28291c17 None None] SCRIPT_NAME: `/identity` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:20:08.201198 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058b3ed4-d019-4959-859e-c3ce28291c17 None None] PATH_INFO: `/` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:20:08.202611 dv-cinder-851351-1-smb devstack@keystone.service[479851]: [pid: 479851|app: 0|req: 512/1040] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 09:20:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 09:20:08.205694 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058b3ed4-d019-4959-859e-c3ce28291c17 None None] Authenticating user token {{(pid=479851) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:20:08.212658 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f4be161-e8d5-41ef-b2ba-b41442d4203e None admin] Validating token access rules against request {{(pid=479852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:20:08.247983 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a76ab4-24de-4be8-afa5-1ef8ebcd7824 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:20:08.248630 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a76ab4-24de-4be8-afa5-1ef8ebcd7824 None admin] REQUEST_METHOD: `GET` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:20:08.248949 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a76ab4-24de-4be8-afa5-1ef8ebcd7824 None admin] SCRIPT_NAME: `/identity` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:20:08.249212 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a76ab4-24de-4be8-afa5-1ef8ebcd7824 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:20:08.260449 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09a76ab4-24de-4be8-afa5-1ef8ebcd7824 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:20:08.261945 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09a76ab4-24de-4be8-afa5-1ef8ebcd7824 None admin] RBAC: Authorization granted {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:20:08.277065 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application [None req-09a76ab4-24de-4be8-afa5-1ef8ebcd7824 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 09:20:08.277065 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 09:20:08.277065 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 09:20:08.277065 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 09:20:08.277065 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 09:20:08.277065 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 09:20:08.277065 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 09:20:08.277065 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 09:20:08.277065 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 09:20:08.277065 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 09:20:08.277065 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 09:20:08.277065 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 09:20:08.277065 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 09:20:08.277065 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 09:20:08.277065 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 09:20:08.278322 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 09:20:08.278322 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 09:20:08.278322 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 09:20:08.278322 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 09:20:08.278322 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 09:20:08.278322 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 09:20:08.278322 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 09:20:08.278322 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 09:20:08.278322 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application with Lock( Jul 28 09:20:08.278322 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 09:20:08.278322 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self._enter() Jul 28 09:20:08.278322 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 09:20:08.278322 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 09:20:08.278322 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 09:20:08.278322 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self.creator() Jul 28 09:20:08.278322 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 09:20:08.278322 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application created_value = creator( Jul 28 09:20:08.279748 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 09:20:08.279748 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 09:20:08.279748 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 09:20:08.279748 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application Jul 28 09:20:08.279748 dv-cinder-851351-1-smb devstack@keystone.service[479852]: [pid: 479852|app: 0|req: 529/1041] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 09:20:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 09:20:08.279748 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abead57c-fbcf-4a5c-949a-f20aa536311a None None] REQUEST_METHOD: `POST` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:20:08.279748 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abead57c-fbcf-4a5c-949a-f20aa536311a None None] SCRIPT_NAME: `/identity` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:20:08.280229 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abead57c-fbcf-4a5c-949a-f20aa536311a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:20:08.298467 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.auth.core [None req-abead57c-fbcf-4a5c-949a-f20aa536311a None None] MFA Rules not processed for user `c198f91a4ae84d2b9cc730a6e304c2be`. Rule list: `[]` (Enabled: `True`). {{(pid=479852) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 09:20:08.299691 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.fernet_utils [None req-abead57c-fbcf-4a5c-949a-f20aa536311a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=479852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 09:20:08.314061 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058b3ed4-d019-4959-859e-c3ce28291c17 None None] Validating token access rules against request {{(pid=479851) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:20:08.348118 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc772869-e935-41df-976a-381384e77bb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479851) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:20:08.348769 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc772869-e935-41df-976a-381384e77bb3 None admin] REQUEST_METHOD: `GET` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:20:08.349050 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc772869-e935-41df-976a-381384e77bb3 None admin] SCRIPT_NAME: `/identity` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:20:08.349327 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc772869-e935-41df-976a-381384e77bb3 None admin] PATH_INFO: `/v3/services` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:20:08.350007 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc772869-e935-41df-976a-381384e77bb3 None admin] RBAC: Adding query filter params (name=image) {{(pid=479851) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 09:20:08.350307 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc772869-e935-41df-976a-381384e77bb3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:20:08.351688 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc772869-e935-41df-976a-381384e77bb3 None admin] RBAC: Authorization granted {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:20:08.356538 dv-cinder-851351-1-smb devstack@keystone.service[479851]: [pid: 479851|app: 0|req: 513/1042] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 09:20:08 2022] GET /identity/v3/services?name=image => generated 122 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:20:08.357346 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc772869-e935-41df-976a-381384e77bb3 None admin] Authenticating user token {{(pid=479851) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:20:08.377159 dv-cinder-851351-1-smb devstack@keystone.service[479852]: [pid: 479852|app: 0|req: 530/1043] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 09:20:08 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 09:20:08.378031 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abead57c-fbcf-4a5c-949a-f20aa536311a None None] Authenticating user token {{(pid=479852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:20:08.394256 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG dbcounter [-] [479851] Writing DB stats keystone:SELECT=100 {{(pid=479851) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:20:08.441722 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG dbcounter [-] [479852] Writing DB stats keystone:SELECT=100 {{(pid=479852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:20:08.469184 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc772869-e935-41df-976a-381384e77bb3 None admin] Validating token access rules against request {{(pid=479851) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:20:08.487091 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abead57c-fbcf-4a5c-949a-f20aa536311a None None] Validating token access rules against request {{(pid=479852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:20:08.521136 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b28e0250-7270-430a-ae3a-1f108397500e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479851) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:20:08.521806 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28e0250-7270-430a-ae3a-1f108397500e None admin] REQUEST_METHOD: `GET` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:20:08.522073 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28e0250-7270-430a-ae3a-1f108397500e None admin] SCRIPT_NAME: `/identity` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:20:08.522363 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28e0250-7270-430a-ae3a-1f108397500e None admin] PATH_INFO: `/v3/domains` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:20:08.523076 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b28e0250-7270-430a-ae3a-1f108397500e None admin] RBAC: Adding query filter params (name=Default) {{(pid=479851) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 09:20:08.523393 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b28e0250-7270-430a-ae3a-1f108397500e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:20:08.524836 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b28e0250-7270-430a-ae3a-1f108397500e None admin] RBAC: Authorization granted {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:20:08.527727 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e540cffe-9c42-4821-95f2-cb6dfab1db02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:20:08.528373 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e540cffe-9c42-4821-95f2-cb6dfab1db02 None admin] REQUEST_METHOD: `GET` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:20:08.528657 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e540cffe-9c42-4821-95f2-cb6dfab1db02 None admin] SCRIPT_NAME: `/identity` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:20:08.528961 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e540cffe-9c42-4821-95f2-cb6dfab1db02 None admin] PATH_INFO: `/v3/services` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:20:08.529651 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e540cffe-9c42-4821-95f2-cb6dfab1db02 None admin] RBAC: Adding query filter params (type=image) {{(pid=479852) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 09:20:08.529959 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e540cffe-9c42-4821-95f2-cb6dfab1db02 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:20:08.531329 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e540cffe-9c42-4821-95f2-cb6dfab1db02 None admin] RBAC: Authorization granted {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:20:08.536392 dv-cinder-851351-1-smb devstack@keystone.service[479852]: [pid: 479852|app: 0|req: 531/1044] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 09:20:08 2022] GET /identity/v3/services?type=image => generated 350 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:20:08.537033 dv-cinder-851351-1-smb devstack@keystone.service[479851]: [pid: 479851|app: 0|req: 514/1045] 10.222.0.42 () {56 vars in 1109 bytes} [Thu Jul 28 09:20:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:20:08.537539 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e540cffe-9c42-4821-95f2-cb6dfab1db02 None admin] Authenticating user token {{(pid=479852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:20:08.542228 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b28e0250-7270-430a-ae3a-1f108397500e None admin] Authenticating user token {{(pid=479851) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:20:08.649706 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG dbcounter [-] [479851] Writing DB stats keystone:SELECT=100 {{(pid=479851) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:20:08.660460 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b28e0250-7270-430a-ae3a-1f108397500e None admin] Validating token access rules against request {{(pid=479851) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:20:08.663043 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e540cffe-9c42-4821-95f2-cb6dfab1db02 None admin] Validating token access rules against request {{(pid=479852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:20:08.687700 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG dbcounter [-] [479852] Writing DB stats keystone:SELECT=100 {{(pid=479852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:20:08.698769 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cbad16d-027b-48a7-a320-6b3a2f158da9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479851) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:20:08.699402 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbad16d-027b-48a7-a320-6b3a2f158da9 None admin] REQUEST_METHOD: `POST` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:20:08.699683 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbad16d-027b-48a7-a320-6b3a2f158da9 None admin] SCRIPT_NAME: `/identity` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:20:08.699959 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbad16d-027b-48a7-a320-6b3a2f158da9 None admin] PATH_INFO: `/v3/endpoints` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:20:08.700701 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cbad16d-027b-48a7-a320-6b3a2f158da9 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:20:08.702098 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cbad16d-027b-48a7-a320-6b3a2f158da9 None admin] RBAC: Authorization granted {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:20:08.702199 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7917c77f-fcc0-46c4-b139-f062b426ecca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:20:08.702800 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7917c77f-fcc0-46c4-b139-f062b426ecca None admin] REQUEST_METHOD: `GET` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:20:08.703085 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7917c77f-fcc0-46c4-b139-f062b426ecca None admin] SCRIPT_NAME: `/identity` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:20:08.703361 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7917c77f-fcc0-46c4-b139-f062b426ecca None admin] PATH_INFO: `/v3/domains/default` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:20:08.704561 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7917c77f-fcc0-46c4-b139-f062b426ecca None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:20:08.706058 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7917c77f-fcc0-46c4-b139-f062b426ecca None admin] RBAC: Authorization granted {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:20:08.707686 dv-cinder-851351-1-smb devstack@keystone.service[479852]: [pid: 479852|app: 0|req: 532/1046] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 09:20:08 2022] GET /identity/v3/domains/default => generated 199 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:20:08.708459 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7917c77f-fcc0-46c4-b139-f062b426ecca None admin] Authenticating user token {{(pid=479852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:20:08.723166 dv-cinder-851351-1-smb devstack@keystone.service[479851]: [pid: 479851|app: 0|req: 515/1047] 10.222.0.42 () {60 vars in 1144 bytes} [Thu Jul 28 09:20:08 2022] POST /identity/v3/endpoints => generated 327 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 28 09:20:08.724322 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cbad16d-027b-48a7-a320-6b3a2f158da9 None admin] Authenticating user token {{(pid=479851) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:20:08.830732 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7917c77f-fcc0-46c4-b139-f062b426ecca None admin] Validating token access rules against request {{(pid=479852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:20:08.863518 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cbad16d-027b-48a7-a320-6b3a2f158da9 None admin] Validating token access rules against request {{(pid=479851) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:20:08.877085 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a9a0d2-45a3-46fc-9e9b-91e6e0fb9c17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:20:08.878380 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a9a0d2-45a3-46fc-9e9b-91e6e0fb9c17 None admin] REQUEST_METHOD: `GET` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:20:08.878821 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a9a0d2-45a3-46fc-9e9b-91e6e0fb9c17 None admin] SCRIPT_NAME: `/identity` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:20:08.879852 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a9a0d2-45a3-46fc-9e9b-91e6e0fb9c17 None admin] PATH_INFO: `/v3/projects/service` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:20:08.889225 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5a9a0d2-45a3-46fc-9e9b-91e6e0fb9c17 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:20:08.890697 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5a9a0d2-45a3-46fc-9e9b-91e6e0fb9c17 None admin] RBAC: Authorization granted {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:20:08.905307 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application [None req-d5a9a0d2-45a3-46fc-9e9b-91e6e0fb9c17 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 09:20:08.905307 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 09:20:08.905307 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 09:20:08.905307 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 09:20:08.905307 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 09:20:08.905307 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 09:20:08.905307 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 09:20:08.905307 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 09:20:08.905307 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 09:20:08.905307 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 09:20:08.905307 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 09:20:08.905307 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 09:20:08.905307 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 28 09:20:08.905307 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 28 09:20:08.905307 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 28 09:20:08.906412 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 28 09:20:08.906412 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 09:20:08.906412 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 09:20:08.906412 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 09:20:08.906412 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 09:20:08.906412 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 09:20:08.906412 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 09:20:08.906412 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 09:20:08.906412 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application with Lock( Jul 28 09:20:08.906412 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 09:20:08.906412 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self._enter() Jul 28 09:20:08.906412 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 09:20:08.906412 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 09:20:08.906412 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 09:20:08.906412 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self.creator() Jul 28 09:20:08.906412 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 09:20:08.906412 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application created_value = creator( Jul 28 09:20:08.907550 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 28 09:20:08.907550 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 28 09:20:08.907550 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 28 09:20:08.907550 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 28 09:20:08.907550 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 28 09:20:08.907550 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 28 09:20:08.907550 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 09:20:08.907550 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application Jul 28 09:20:08.907550 dv-cinder-851351-1-smb devstack@keystone.service[479852]: [pid: 479852|app: 0|req: 533/1048] 10.222.0.42 () {56 vars in 1111 bytes} [Thu Jul 28 09:20:08 2022] GET /identity/v3/projects/service => generated 88 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 09:20:08.908964 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-187ac57b-8a9c-4d93-8828-d056f4bba907 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479851) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:20:08.909440 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187ac57b-8a9c-4d93-8828-d056f4bba907 None admin] REQUEST_METHOD: `POST` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:20:08.910863 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187ac57b-8a9c-4d93-8828-d056f4bba907 None admin] SCRIPT_NAME: `/identity` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:20:08.910863 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187ac57b-8a9c-4d93-8828-d056f4bba907 None admin] PATH_INFO: `/v3/users` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:20:08.910863 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-187ac57b-8a9c-4d93-8828-d056f4bba907 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:20:08.912697 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-187ac57b-8a9c-4d93-8828-d056f4bba907 None admin] RBAC: Authorization granted {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:20:08.912849 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a9a0d2-45a3-46fc-9e9b-91e6e0fb9c17 None admin] Authenticating user token {{(pid=479852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:20:08.933585 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG dbcounter [-] [479851] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=479851) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:20:08.940513 dv-cinder-851351-1-smb devstack@keystone.service[479851]: [pid: 479851|app: 0|req: 516/1049] 10.222.0.42 () {60 vars in 1132 bytes} [Thu Jul 28 09:20:08 2022] POST /identity/v3/users => generated 285 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 09:20:08.979219 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG dbcounter [-] [479852] Writing DB stats keystone:SELECT=100 {{(pid=479852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:20:09.040091 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a9a0d2-45a3-46fc-9e9b-91e6e0fb9c17 None admin] Validating token access rules against request {{(pid=479852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:20:09.079768 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d822e9e-6729-47f1-a46b-6c511dbbac6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:20:09.080422 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d822e9e-6729-47f1-a46b-6c511dbbac6a None admin] REQUEST_METHOD: `GET` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:20:09.080727 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d822e9e-6729-47f1-a46b-6c511dbbac6a None admin] SCRIPT_NAME: `/identity` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:20:09.081020 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d822e9e-6729-47f1-a46b-6c511dbbac6a None admin] PATH_INFO: `/v3/projects` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:20:09.081804 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d822e9e-6729-47f1-a46b-6c511dbbac6a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=479852) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 09:20:09.082190 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d822e9e-6729-47f1-a46b-6c511dbbac6a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:20:09.083731 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d822e9e-6729-47f1-a46b-6c511dbbac6a None admin] RBAC: Authorization granted {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:20:09.097422 dv-cinder-851351-1-smb devstack@keystone.service[479852]: [pid: 479852|app: 0|req: 534/1050] 10.222.0.42 () {56 vars in 1148 bytes} [Thu Jul 28 09:20:08 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 09:20:09.103676 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-187ac57b-8a9c-4d93-8828-d056f4bba907 None admin] Authenticating user token {{(pid=479851) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:20:09.223507 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-187ac57b-8a9c-4d93-8828-d056f4bba907 None admin] Validating token access rules against request {{(pid=479851) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:20:09.260492 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a392cec-3dfd-4284-bcdf-a989fc7dc6be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479851) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:20:09.261169 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a392cec-3dfd-4284-bcdf-a989fc7dc6be None admin] REQUEST_METHOD: `GET` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:20:09.261457 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a392cec-3dfd-4284-bcdf-a989fc7dc6be None admin] SCRIPT_NAME: `/identity` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:20:09.261742 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a392cec-3dfd-4284-bcdf-a989fc7dc6be None admin] PATH_INFO: `/v3/role_assignments` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:20:09.262615 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a392cec-3dfd-4284-bcdf-a989fc7dc6be None admin] RBAC: Adding query filter params (role.id=4a0748cb7fbb416eb81203fd028beb9a, scope.project.id=3a0fb8ea8010437bade8f92dcbcaacee, user.id=c824cbfdc0dc4532ac6af71cbb6841fd) {{(pid=479851) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 09:20:09.262933 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a392cec-3dfd-4284-bcdf-a989fc7dc6be None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:20:09.264397 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a392cec-3dfd-4284-bcdf-a989fc7dc6be None admin] RBAC: Authorization granted {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:20:09.270854 dv-cinder-851351-1-smb devstack@keystone.service[479851]: [pid: 479851|app: 0|req: 517/1051] 10.222.0.42 () {56 vars in 1374 bytes} [Thu Jul 28 09:20:09 2022] GET /identity/v3/role_assignments?user.id=c824cbfdc0dc4532ac6af71cbb6841fd&scope.project.id=3a0fb8ea8010437bade8f92dcbcaacee&role.id=4a0748cb7fbb416eb81203fd028beb9a => generated 259 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:20:10.765876 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c4b40f-f935-4a75-99c6-f46aca380f15 None None] REQUEST_METHOD: `GET` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:20:10.766415 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c4b40f-f935-4a75-99c6-f46aca380f15 None None] SCRIPT_NAME: `/identity` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:20:10.766696 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c4b40f-f935-4a75-99c6-f46aca380f15 None None] PATH_INFO: `/` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:20:10.768738 dv-cinder-851351-1-smb devstack@keystone.service[479852]: [pid: 479852|app: 0|req: 535/1052] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 09:20:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 09:20:10.774571 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9eb06b-2cc7-4d9f-b08f-08973f8b888f None None] REQUEST_METHOD: `POST` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:20:10.775130 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9eb06b-2cc7-4d9f-b08f-08973f8b888f None None] SCRIPT_NAME: `/identity` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:20:10.775130 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9eb06b-2cc7-4d9f-b08f-08973f8b888f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:20:10.794224 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.auth.core [None req-3e9eb06b-2cc7-4d9f-b08f-08973f8b888f None None] MFA Rules not processed for user `c198f91a4ae84d2b9cc730a6e304c2be`. Rule list: `[]` (Enabled: `True`). {{(pid=479851) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 09:20:10.795439 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.fernet_utils [None req-3e9eb06b-2cc7-4d9f-b08f-08973f8b888f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=479851) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 09:20:10.859752 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG dbcounter [-] [479851] Writing DB stats keystone:SELECT=100 {{(pid=479851) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:20:10.870231 dv-cinder-851351-1-smb devstack@keystone.service[479851]: [pid: 479851|app: 0|req: 518/1053] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 09:20:10 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 09:20:10.891798 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c4b40f-f935-4a75-99c6-f46aca380f15 None None] Authenticating user token {{(pid=479852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:20:10.998466 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c4b40f-f935-4a75-99c6-f46aca380f15 None None] Validating token access rules against request {{(pid=479852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:20:11.009372 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG dbcounter [-] [479852] Writing DB stats keystone:SELECT=100 {{(pid=479852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:20:11.035122 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4b1844-e75b-41f7-bb49-a6cb27dba78e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:20:11.035756 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4b1844-e75b-41f7-bb49-a6cb27dba78e None admin] REQUEST_METHOD: `GET` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:20:11.036031 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4b1844-e75b-41f7-bb49-a6cb27dba78e None admin] SCRIPT_NAME: `/identity` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:20:11.036311 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4b1844-e75b-41f7-bb49-a6cb27dba78e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:20:11.042368 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036c3c07-1c6f-4c60-a224-1b5b464e5aa5 None None] REQUEST_METHOD: `GET` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:20:11.042655 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036c3c07-1c6f-4c60-a224-1b5b464e5aa5 None None] SCRIPT_NAME: `/identity` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:20:11.042952 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036c3c07-1c6f-4c60-a224-1b5b464e5aa5 None None] PATH_INFO: `/` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:20:11.044606 dv-cinder-851351-1-smb devstack@keystone.service[479851]: [pid: 479851|app: 0|req: 519/1054] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 09:20:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 28 09:20:11.049647 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d04ae9-21c0-4745-b748-5060d8000d05 None None] REQUEST_METHOD: `POST` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:20:11.049933 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d04ae9-21c0-4745-b748-5060d8000d05 None None] SCRIPT_NAME: `/identity` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:20:11.050237 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d04ae9-21c0-4745-b748-5060d8000d05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:20:11.069298 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.auth.core [None req-29d04ae9-21c0-4745-b748-5060d8000d05 None None] MFA Rules not processed for user `c198f91a4ae84d2b9cc730a6e304c2be`. Rule list: `[]` (Enabled: `True`). {{(pid=479851) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 09:20:11.070533 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.fernet_utils [None req-29d04ae9-21c0-4745-b748-5060d8000d05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=479851) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 09:20:11.122873 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a4b1844-e75b-41f7-bb49-a6cb27dba78e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:20:11.124465 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a4b1844-e75b-41f7-bb49-a6cb27dba78e None admin] RBAC: Authorization granted {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:20:11.158502 dv-cinder-851351-1-smb devstack@keystone.service[479851]: [pid: 479851|app: 0|req: 520/1055] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 09:20:11 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 28 09:20:11.182384 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d04ae9-21c0-4745-b748-5060d8000d05 None None] Authenticating user token {{(pid=479851) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:20:11.235082 dv-cinder-851351-1-smb devstack@keystone.service[479852]: [pid: 479852|app: 0|req: 536/1056] 10.222.0.42 () {58 vars in 1282 bytes} [Thu Jul 28 09:20:10 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 344 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 28 09:20:11.241683 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4b1844-e75b-41f7-bb49-a6cb27dba78e None admin] Authenticating user token {{(pid=479852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:20:11.253144 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG dbcounter [-] [479852] Writing DB stats keystone:SELECT=100 {{(pid=479852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:20:11.293544 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d04ae9-21c0-4745-b748-5060d8000d05 None None] Validating token access rules against request {{(pid=479851) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:20:11.320261 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG dbcounter [-] [479851] Writing DB stats keystone:SELECT=100 {{(pid=479851) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:20:11.332579 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4734f61-1e1e-4f85-ae31-5e3d303383b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479851) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:20:11.333293 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4734f61-1e1e-4f85-ae31-5e3d303383b4 None admin] REQUEST_METHOD: `GET` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:20:11.333562 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4734f61-1e1e-4f85-ae31-5e3d303383b4 None admin] SCRIPT_NAME: `/identity` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:20:11.333840 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4734f61-1e1e-4f85-ae31-5e3d303383b4 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:20:11.344423 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4734f61-1e1e-4f85-ae31-5e3d303383b4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 09:20:11.345608 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4b1844-e75b-41f7-bb49-a6cb27dba78e None admin] Validating token access rules against request {{(pid=479852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:20:11.349502 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application [None req-f4734f61-1e1e-4f85-ae31-5e3d303383b4 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 09:20:11.349502 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 09:20:11.349502 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 09:20:11.349502 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 09:20:11.349502 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 09:20:11.349502 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 09:20:11.349502 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 09:20:11.349502 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 09:20:11.349502 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 09:20:11.349502 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 09:20:11.349502 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 09:20:11.349502 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 09:20:11.349502 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 09:20:11.349502 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 09:20:11.349502 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 09:20:11.349502 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 09:20:11.350829 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 09:20:11.350829 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 09:20:11.350829 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 09:20:11.350829 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 09:20:11.350829 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 09:20:11.350829 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 09:20:11.350829 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 09:20:11.350829 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 09:20:11.350829 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 09:20:11.350829 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 09:20:11.350829 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 09:20:11.350829 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application with Lock( Jul 28 09:20:11.350829 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 09:20:11.350829 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return self._enter() Jul 28 09:20:11.350829 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 09:20:11.350829 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 09:20:11.351908 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 09:20:11.351908 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return self.creator() Jul 28 09:20:11.351908 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 09:20:11.351908 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application created_value = creator( Jul 28 09:20:11.351908 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 09:20:11.351908 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 09:20:11.351908 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 09:20:11.351908 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 09:20:11.351908 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 09:20:11.351908 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 09:20:11.351908 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 09:20:11.351908 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application Jul 28 09:20:11.351908 dv-cinder-851351-1-smb devstack@keystone.service[479851]: [pid: 479851|app: 0|req: 521/1057] 10.222.0.42 () {56 vars in 1096 bytes} [Thu Jul 28 09:20:11 2022] GET /identity/v3/roles/admin => generated 83 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 09:20:11.353020 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f410c037-7570-4ad6-9bdb-1f869fc477a4 None None] REQUEST_METHOD: `GET` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:20:11.353304 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f410c037-7570-4ad6-9bdb-1f869fc477a4 None None] SCRIPT_NAME: `/identity` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:20:11.353585 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f410c037-7570-4ad6-9bdb-1f869fc477a4 None None] PATH_INFO: `/` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:20:11.355079 dv-cinder-851351-1-smb devstack@keystone.service[479851]: [pid: 479851|app: 0|req: 522/1058] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 09:20:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 09:20:11.357620 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f410c037-7570-4ad6-9bdb-1f869fc477a4 None None] Authenticating user token {{(pid=479851) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:20:11.386710 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1c3765-9887-4b56-b14b-cd0fe3f5faa0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:20:11.388355 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1c3765-9887-4b56-b14b-cd0fe3f5faa0 None admin] REQUEST_METHOD: `GET` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:20:11.388355 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1c3765-9887-4b56-b14b-cd0fe3f5faa0 None admin] SCRIPT_NAME: `/identity` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:20:11.388355 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1c3765-9887-4b56-b14b-cd0fe3f5faa0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:20:11.399287 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b1c3765-9887-4b56-b14b-cd0fe3f5faa0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:20:11.400931 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b1c3765-9887-4b56-b14b-cd0fe3f5faa0 None admin] RBAC: Authorization granted {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:20:11.416275 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application [None req-5b1c3765-9887-4b56-b14b-cd0fe3f5faa0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 09:20:11.416275 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 09:20:11.416275 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 09:20:11.416275 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 09:20:11.416275 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 09:20:11.416275 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 09:20:11.416275 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 09:20:11.416275 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 09:20:11.416275 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 09:20:11.416275 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 09:20:11.416275 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 09:20:11.416275 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 09:20:11.416275 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 09:20:11.416275 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 09:20:11.416275 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 09:20:11.417426 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 09:20:11.417426 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 09:20:11.417426 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 09:20:11.417426 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 09:20:11.417426 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 09:20:11.417426 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 09:20:11.417426 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 09:20:11.417426 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 09:20:11.417426 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application with Lock( Jul 28 09:20:11.417426 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 09:20:11.417426 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self._enter() Jul 28 09:20:11.417426 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 09:20:11.417426 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 09:20:11.417426 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 09:20:11.417426 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self.creator() Jul 28 09:20:11.417426 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 09:20:11.417426 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application created_value = creator( Jul 28 09:20:11.418546 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 09:20:11.418546 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 09:20:11.418546 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 09:20:11.418546 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application Jul 28 09:20:11.418546 dv-cinder-851351-1-smb devstack@keystone.service[479852]: [pid: 479852|app: 0|req: 537/1059] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 09:20:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 09:20:11.419309 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f7d29c-50e3-4ee9-be71-1069d89b3082 None None] REQUEST_METHOD: `POST` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:20:11.419309 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f7d29c-50e3-4ee9-be71-1069d89b3082 None None] SCRIPT_NAME: `/identity` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:20:11.419582 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f7d29c-50e3-4ee9-be71-1069d89b3082 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:20:11.438523 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.auth.core [None req-19f7d29c-50e3-4ee9-be71-1069d89b3082 None None] MFA Rules not processed for user `c198f91a4ae84d2b9cc730a6e304c2be`. Rule list: `[]` (Enabled: `True`). {{(pid=479852) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 09:20:11.439823 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.fernet_utils [None req-19f7d29c-50e3-4ee9-be71-1069d89b3082 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=479852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 09:20:11.481775 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f410c037-7570-4ad6-9bdb-1f869fc477a4 None None] Validating token access rules against request {{(pid=479851) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:20:11.508794 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG dbcounter [-] [479852] Writing DB stats keystone:SELECT=100 {{(pid=479852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:20:11.519760 dv-cinder-851351-1-smb devstack@keystone.service[479852]: [pid: 479852|app: 0|req: 538/1060] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 09:20:11 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 09:20:11.520909 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f7d29c-50e3-4ee9-be71-1069d89b3082 None None] Authenticating user token {{(pid=479852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:20:11.530135 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6c2c78-722f-4f97-9435-84d765098f26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479851) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:20:11.530815 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6c2c78-722f-4f97-9435-84d765098f26 None admin] REQUEST_METHOD: `GET` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:20:11.531104 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6c2c78-722f-4f97-9435-84d765098f26 None admin] SCRIPT_NAME: `/identity` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:20:11.531439 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6c2c78-722f-4f97-9435-84d765098f26 None admin] PATH_INFO: `/v3/roles` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:20:11.532211 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a6c2c78-722f-4f97-9435-84d765098f26 None admin] RBAC: Adding query filter params (name=admin) {{(pid=479851) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 09:20:11.532567 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a6c2c78-722f-4f97-9435-84d765098f26 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:20:11.534047 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a6c2c78-722f-4f97-9435-84d765098f26 None admin] RBAC: Authorization granted {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:20:11.543194 dv-cinder-851351-1-smb devstack@keystone.service[479851]: [pid: 479851|app: 0|req: 523/1061] 10.222.0.42 () {56 vars in 1099 bytes} [Thu Jul 28 09:20:11 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:20:11.544073 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6c2c78-722f-4f97-9435-84d765098f26 None admin] Authenticating user token {{(pid=479851) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:20:11.590170 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG dbcounter [-] [479851] Writing DB stats keystone:SELECT=100 {{(pid=479851) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:20:11.623972 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f7d29c-50e3-4ee9-be71-1069d89b3082 None None] Validating token access rules against request {{(pid=479852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:20:11.646311 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6c2c78-722f-4f97-9435-84d765098f26 None admin] Validating token access rules against request {{(pid=479851) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:20:11.659072 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b489277-75f0-46ad-bd5f-9a3879db83d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:20:11.659698 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b489277-75f0-46ad-bd5f-9a3879db83d4 None admin] REQUEST_METHOD: `GET` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:20:11.660007 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b489277-75f0-46ad-bd5f-9a3879db83d4 None admin] SCRIPT_NAME: `/identity` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:20:11.660310 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b489277-75f0-46ad-bd5f-9a3879db83d4 None admin] PATH_INFO: `/v3/domains` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:20:11.661067 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b489277-75f0-46ad-bd5f-9a3879db83d4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=479852) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 09:20:11.661378 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b489277-75f0-46ad-bd5f-9a3879db83d4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:20:11.662759 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b489277-75f0-46ad-bd5f-9a3879db83d4 None admin] RBAC: Authorization granted {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:20:11.674400 dv-cinder-851351-1-smb devstack@keystone.service[479852]: [pid: 479852|app: 0|req: 539/1062] 10.222.0.42 () {56 vars in 1109 bytes} [Thu Jul 28 09:20:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:20:11.675201 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b489277-75f0-46ad-bd5f-9a3879db83d4 None admin] Authenticating user token {{(pid=479852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:20:11.680023 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b0a802-e840-426e-83c5-fef32021547e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479851) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:20:11.680726 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b0a802-e840-426e-83c5-fef32021547e None admin] REQUEST_METHOD: `GET` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:20:11.681022 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b0a802-e840-426e-83c5-fef32021547e None admin] SCRIPT_NAME: `/identity` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:20:11.681356 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b0a802-e840-426e-83c5-fef32021547e None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:20:11.696918 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7b0a802-e840-426e-83c5-fef32021547e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 09:20:11.703371 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application [None req-f7b0a802-e840-426e-83c5-fef32021547e None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 28 09:20:11.703371 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 09:20:11.703371 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 09:20:11.703371 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 09:20:11.703371 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 09:20:11.703371 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 09:20:11.703371 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 09:20:11.703371 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 09:20:11.703371 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 09:20:11.703371 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 09:20:11.703371 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 09:20:11.703371 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 09:20:11.703371 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 09:20:11.703371 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 09:20:11.703371 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 09:20:11.703371 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 09:20:11.704560 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 09:20:11.704560 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 09:20:11.704560 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 09:20:11.704560 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 09:20:11.704560 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 09:20:11.704560 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 09:20:11.704560 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 09:20:11.704560 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 09:20:11.704560 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 09:20:11.704560 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 09:20:11.704560 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 09:20:11.704560 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application with Lock( Jul 28 09:20:11.704560 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 09:20:11.704560 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return self._enter() Jul 28 09:20:11.704560 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 09:20:11.704560 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 09:20:11.705641 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 09:20:11.705641 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return self.creator() Jul 28 09:20:11.705641 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 09:20:11.705641 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application created_value = creator( Jul 28 09:20:11.705641 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 09:20:11.705641 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 09:20:11.705641 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 09:20:11.705641 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 09:20:11.705641 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 09:20:11.705641 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 09:20:11.705641 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 28 09:20:11.705641 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application Jul 28 09:20:11.710686 dv-cinder-851351-1-smb devstack@keystone.service[479851]: [pid: 479851|app: 0|req: 524/1063] 10.222.0.42 () {56 vars in 1120 bytes} [Thu Jul 28 09:20:11 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 09:20:11.711505 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b0a802-e840-426e-83c5-fef32021547e None admin] Authenticating user token {{(pid=479851) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:20:11.748686 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG dbcounter [-] [479852] Writing DB stats keystone:SELECT=100 {{(pid=479852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:20:11.804586 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b489277-75f0-46ad-bd5f-9a3879db83d4 None admin] Validating token access rules against request {{(pid=479852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:20:11.832047 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b0a802-e840-426e-83c5-fef32021547e None admin] Validating token access rules against request {{(pid=479851) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:20:11.839848 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG dbcounter [-] [479851] Writing DB stats keystone:SELECT=100 {{(pid=479851) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:20:11.846347 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-213a1357-fcee-46d0-a6ab-abf8c3960eb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:20:11.847078 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213a1357-fcee-46d0-a6ab-abf8c3960eb2 None admin] REQUEST_METHOD: `GET` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:20:11.847356 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213a1357-fcee-46d0-a6ab-abf8c3960eb2 None admin] SCRIPT_NAME: `/identity` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:20:11.847653 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213a1357-fcee-46d0-a6ab-abf8c3960eb2 None admin] PATH_INFO: `/v3/users/c3fc567a0b1a47be973fe73937223e91` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:20:11.866575 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-213a1357-fcee-46d0-a6ab-abf8c3960eb2 None admin] RBAC: Authorizing `identity:get_user(user_id=c3fc567a0b1a47be973fe73937223e91)` {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:20:11.868133 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-213a1357-fcee-46d0-a6ab-abf8c3960eb2 None admin] RBAC: Authorization granted {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:20:11.870087 dv-cinder-851351-1-smb devstack@keystone.service[479852]: [pid: 479852|app: 0|req: 540/1064] 10.222.0.42 () {56 vars in 1177 bytes} [Thu Jul 28 09:20:11 2022] GET /identity/v3/users/c3fc567a0b1a47be973fe73937223e91 => generated 285 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:20:11.874085 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa49d868-5eaf-4db5-9328-4f0ce1160c7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479851) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:20:11.874774 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa49d868-5eaf-4db5-9328-4f0ce1160c7b None admin] REQUEST_METHOD: `GET` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:20:11.875123 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa49d868-5eaf-4db5-9328-4f0ce1160c7b None admin] SCRIPT_NAME: `/identity` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:20:11.875408 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa49d868-5eaf-4db5-9328-4f0ce1160c7b None admin] PATH_INFO: `/v3/roles` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:20:11.876144 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa49d868-5eaf-4db5-9328-4f0ce1160c7b None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=479851) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 09:20:11.876452 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa49d868-5eaf-4db5-9328-4f0ce1160c7b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:20:11.876653 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-213a1357-fcee-46d0-a6ab-abf8c3960eb2 None admin] Authenticating user token {{(pid=479852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:20:11.877893 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa49d868-5eaf-4db5-9328-4f0ce1160c7b None admin] RBAC: Authorization granted {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:20:11.888999 dv-cinder-851351-1-smb devstack@keystone.service[479851]: [pid: 479851|app: 0|req: 525/1065] 10.222.0.42 () {56 vars in 1115 bytes} [Thu Jul 28 09:20:11 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:20:11.896046 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa49d868-5eaf-4db5-9328-4f0ce1160c7b None admin] Authenticating user token {{(pid=479851) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:20:11.988971 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-213a1357-fcee-46d0-a6ab-abf8c3960eb2 None admin] Validating token access rules against request {{(pid=479852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:20:12.000646 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG dbcounter [-] [479852] Writing DB stats keystone:SELECT=100 {{(pid=479852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:20:12.007995 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa49d868-5eaf-4db5-9328-4f0ce1160c7b None admin] Validating token access rules against request {{(pid=479851) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:20:12.027511 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1851fc2-1fd6-46c8-bd97-83ec0c2924b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:20:12.028141 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1851fc2-1fd6-46c8-bd97-83ec0c2924b2 None admin] REQUEST_METHOD: `GET` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:20:12.028420 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1851fc2-1fd6-46c8-bd97-83ec0c2924b2 None admin] SCRIPT_NAME: `/identity` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:20:12.028717 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1851fc2-1fd6-46c8-bd97-83ec0c2924b2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:20:12.046009 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8814147c-4ef7-4916-be48-21c59475de41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479851) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:20:12.046643 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8814147c-4ef7-4916-be48-21c59475de41 None admin] REQUEST_METHOD: `GET` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:20:12.046948 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8814147c-4ef7-4916-be48-21c59475de41 None admin] SCRIPT_NAME: `/identity` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:20:12.047222 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8814147c-4ef7-4916-be48-21c59475de41 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:20:12.058355 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8814147c-4ef7-4916-be48-21c59475de41 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:20:12.059743 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8814147c-4ef7-4916-be48-21c59475de41 None admin] RBAC: Authorization granted {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:20:12.074920 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application [None req-8814147c-4ef7-4916-be48-21c59475de41 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 09:20:12.074920 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 09:20:12.074920 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 09:20:12.074920 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 09:20:12.074920 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 09:20:12.074920 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 09:20:12.074920 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 09:20:12.074920 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 09:20:12.074920 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 09:20:12.074920 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 09:20:12.074920 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 09:20:12.074920 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 09:20:12.074920 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 09:20:12.074920 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 09:20:12.074920 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 09:20:12.081396 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 09:20:12.081396 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 09:20:12.081396 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 09:20:12.081396 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 09:20:12.081396 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 09:20:12.081396 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 09:20:12.081396 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 09:20:12.081396 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 09:20:12.081396 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application with Lock( Jul 28 09:20:12.081396 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 09:20:12.081396 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return self._enter() Jul 28 09:20:12.081396 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 09:20:12.081396 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 09:20:12.081396 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 09:20:12.081396 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return self.creator() Jul 28 09:20:12.081396 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 09:20:12.081396 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application created_value = creator( Jul 28 09:20:12.082723 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 09:20:12.082723 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 09:20:12.082723 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 09:20:12.082723 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application Jul 28 09:20:12.082723 dv-cinder-851351-1-smb devstack@keystone.service[479851]: [pid: 479851|app: 0|req: 526/1066] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 09:20:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 09:20:12.082723 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8814147c-4ef7-4916-be48-21c59475de41 None admin] Authenticating user token {{(pid=479851) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:20:12.098265 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1851fc2-1fd6-46c8-bd97-83ec0c2924b2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:20:12.099755 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1851fc2-1fd6-46c8-bd97-83ec0c2924b2 None admin] RBAC: Authorization granted {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:20:12.104550 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG dbcounter [-] [479851] Writing DB stats keystone:SELECT=100 {{(pid=479851) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:20:12.187780 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8814147c-4ef7-4916-be48-21c59475de41 None admin] Validating token access rules against request {{(pid=479851) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:20:12.213951 dv-cinder-851351-1-smb devstack@keystone.service[479852]: [pid: 479852|app: 0|req: 541/1067] 10.222.0.42 () {58 vars in 1282 bytes} [Thu Jul 28 09:20:11 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 28 09:20:12.215200 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1851fc2-1fd6-46c8-bd97-83ec0c2924b2 None admin] Authenticating user token {{(pid=479852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:20:12.223869 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e2bee3-da6b-4ead-b012-0fac884c04da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479851) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:20:12.224509 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e2bee3-da6b-4ead-b012-0fac884c04da None admin] REQUEST_METHOD: `GET` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:20:12.224834 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e2bee3-da6b-4ead-b012-0fac884c04da None admin] SCRIPT_NAME: `/identity` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:20:12.225101 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e2bee3-da6b-4ead-b012-0fac884c04da None admin] PATH_INFO: `/v3/domains` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:20:12.225802 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2e2bee3-da6b-4ead-b012-0fac884c04da None admin] RBAC: Adding query filter params (name=Default) {{(pid=479851) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 09:20:12.226110 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2e2bee3-da6b-4ead-b012-0fac884c04da None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:20:12.226658 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG dbcounter [-] [479852] Writing DB stats keystone:SELECT=100 {{(pid=479852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:20:12.227510 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2e2bee3-da6b-4ead-b012-0fac884c04da None admin] RBAC: Authorization granted {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:20:12.241013 dv-cinder-851351-1-smb devstack@keystone.service[479851]: [pid: 479851|app: 0|req: 527/1068] 10.222.0.42 () {56 vars in 1109 bytes} [Thu Jul 28 09:20:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 09:20:12.247796 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e2bee3-da6b-4ead-b012-0fac884c04da None admin] Authenticating user token {{(pid=479851) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:20:12.319186 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1851fc2-1fd6-46c8-bd97-83ec0c2924b2 None admin] Validating token access rules against request {{(pid=479852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:20:12.333302 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG dbcounter [-] [479851] Writing DB stats keystone:SELECT=100 {{(pid=479851) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:20:12.353633 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e2bee3-da6b-4ead-b012-0fac884c04da None admin] Validating token access rules against request {{(pid=479851) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:20:12.357911 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f04645f3-9ae8-4d69-b617-319d2a373368 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:20:12.358688 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04645f3-9ae8-4d69-b617-319d2a373368 None admin] REQUEST_METHOD: `GET` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:20:12.358964 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04645f3-9ae8-4d69-b617-319d2a373368 None admin] SCRIPT_NAME: `/identity` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:20:12.359230 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04645f3-9ae8-4d69-b617-319d2a373368 None admin] PATH_INFO: `/v3/projects/7d20987a30d8467882bb453ffb442bf3` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:20:12.360550 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f04645f3-9ae8-4d69-b617-319d2a373368 None admin] RBAC: Authorizing `identity:get_project(project_id=7d20987a30d8467882bb453ffb442bf3)` {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:20:12.362152 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f04645f3-9ae8-4d69-b617-319d2a373368 None admin] RBAC: Authorization granted {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:20:12.364009 dv-cinder-851351-1-smb devstack@keystone.service[479852]: [pid: 479852|app: 0|req: 542/1069] 10.222.0.42 () {56 vars in 1186 bytes} [Thu Jul 28 09:20:12 2022] GET /identity/v3/projects/7d20987a30d8467882bb453ffb442bf3 => generated 311 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:20:12.370322 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f04645f3-9ae8-4d69-b617-319d2a373368 None admin] Authenticating user token {{(pid=479852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:20:12.391212 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dbaf555-a55e-44a9-9c0b-eafee00c9dc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479851) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:20:12.391951 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbaf555-a55e-44a9-9c0b-eafee00c9dc5 None admin] REQUEST_METHOD: `GET` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:20:12.392243 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbaf555-a55e-44a9-9c0b-eafee00c9dc5 None admin] SCRIPT_NAME: `/identity` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:20:12.392528 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbaf555-a55e-44a9-9c0b-eafee00c9dc5 None admin] PATH_INFO: `/v3/users/nova` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:20:12.400309 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dbaf555-a55e-44a9-9c0b-eafee00c9dc5 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:20:12.401849 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dbaf555-a55e-44a9-9c0b-eafee00c9dc5 None admin] RBAC: Authorization granted {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:20:12.416841 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application [None req-7dbaf555-a55e-44a9-9c0b-eafee00c9dc5 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 28 09:20:12.416841 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 09:20:12.416841 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 09:20:12.416841 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 09:20:12.416841 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 09:20:12.416841 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 09:20:12.416841 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 09:20:12.416841 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 09:20:12.416841 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 09:20:12.416841 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 09:20:12.416841 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 09:20:12.416841 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 09:20:12.416841 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 28 09:20:12.416841 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 28 09:20:12.416841 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 28 09:20:12.416841 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 28 09:20:12.418221 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 09:20:12.418221 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 09:20:12.418221 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 28 09:20:12.418221 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 09:20:12.418221 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 28 09:20:12.418221 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 09:20:12.418221 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 09:20:12.418221 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 09:20:12.418221 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 09:20:12.418221 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 09:20:12.418221 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 09:20:12.418221 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application with Lock( Jul 28 09:20:12.418221 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 09:20:12.418221 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return self._enter() Jul 28 09:20:12.418221 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 09:20:12.418221 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 09:20:12.418221 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 09:20:12.418221 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return self.creator() Jul 28 09:20:12.419433 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 09:20:12.419433 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application created_value = creator( Jul 28 09:20:12.419433 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 28 09:20:12.419433 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 28 09:20:12.419433 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 28 09:20:12.419433 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 28 09:20:12.419433 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 28 09:20:12.419433 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 28 09:20:12.419433 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 28 09:20:12.419433 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application Jul 28 09:20:12.419433 dv-cinder-851351-1-smb devstack@keystone.service[479851]: [pid: 479851|app: 0|req: 528/1070] 10.222.0.42 () {56 vars in 1093 bytes} [Thu Jul 28 09:20:12 2022] GET /identity/v3/users/nova => generated 82 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 09:20:12.422375 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dbaf555-a55e-44a9-9c0b-eafee00c9dc5 None admin] Authenticating user token {{(pid=479851) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:20:12.463469 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG dbcounter [-] [479852] Writing DB stats keystone:SELECT=100 {{(pid=479852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:20:12.489288 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f04645f3-9ae8-4d69-b617-319d2a373368 None admin] Validating token access rules against request {{(pid=479852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:20:12.525506 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc093ea-ef5d-4391-b546-60d5211c0d76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:20:12.526139 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc093ea-ef5d-4391-b546-60d5211c0d76 None admin] REQUEST_METHOD: `GET` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:20:12.526417 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc093ea-ef5d-4391-b546-60d5211c0d76 None admin] SCRIPT_NAME: `/identity` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:20:12.526688 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc093ea-ef5d-4391-b546-60d5211c0d76 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:20:12.527492 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc093ea-ef5d-4391-b546-60d5211c0d76 None admin] RBAC: Adding query filter params (role.id=685084310b35477b9b2d0c7934d0f803, scope.project.id=7d20987a30d8467882bb453ffb442bf3, user.id=c3fc567a0b1a47be973fe73937223e91) {{(pid=479852) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 09:20:12.527921 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc093ea-ef5d-4391-b546-60d5211c0d76 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:20:12.529283 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc093ea-ef5d-4391-b546-60d5211c0d76 None admin] RBAC: Authorization granted {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:20:12.535730 dv-cinder-851351-1-smb devstack@keystone.service[479852]: [pid: 479852|app: 0|req: 543/1071] 10.222.0.42 () {56 vars in 1374 bytes} [Thu Jul 28 09:20:12 2022] GET /identity/v3/role_assignments?user.id=c3fc567a0b1a47be973fe73937223e91&scope.project.id=7d20987a30d8467882bb453ffb442bf3&role.id=685084310b35477b9b2d0c7934d0f803 => generated 259 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:20:12.549717 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dbaf555-a55e-44a9-9c0b-eafee00c9dc5 None admin] Validating token access rules against request {{(pid=479851) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:20:12.599359 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c3261f-3ac0-40b5-a689-dd135f249396 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479851) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:20:12.600015 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c3261f-3ac0-40b5-a689-dd135f249396 None admin] REQUEST_METHOD: `GET` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:20:12.600301 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c3261f-3ac0-40b5-a689-dd135f249396 None admin] SCRIPT_NAME: `/identity` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:20:12.600583 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c3261f-3ac0-40b5-a689-dd135f249396 None admin] PATH_INFO: `/v3/users` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:20:12.601450 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c3261f-3ac0-40b5-a689-dd135f249396 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=479851) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 09:20:12.601761 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c3261f-3ac0-40b5-a689-dd135f249396 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:20:12.603275 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c3261f-3ac0-40b5-a689-dd135f249396 None admin] RBAC: Authorization granted {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:20:12.614525 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG dbcounter [-] [479851] Writing DB stats keystone:SELECT=100 {{(pid=479851) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:20:12.625510 dv-cinder-851351-1-smb devstack@keystone.service[479851]: [pid: 479851|app: 0|req: 529/1072] 10.222.0.42 () {56 vars in 1133 bytes} [Thu Jul 28 09:20:12 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 09:20:12.632159 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc093ea-ef5d-4391-b546-60d5211c0d76 None admin] Authenticating user token {{(pid=479852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:20:12.755339 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc093ea-ef5d-4391-b546-60d5211c0d76 None admin] Validating token access rules against request {{(pid=479852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:20:12.795516 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8ed366-ec20-44a1-912b-bebb2e057e33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:20:12.798636 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8ed366-ec20-44a1-912b-bebb2e057e33 None admin] REQUEST_METHOD: `GET` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:20:12.799008 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8ed366-ec20-44a1-912b-bebb2e057e33 None admin] SCRIPT_NAME: `/identity` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:20:12.799445 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8ed366-ec20-44a1-912b-bebb2e057e33 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:20:12.812695 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb8ed366-ec20-44a1-912b-bebb2e057e33 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:20:12.814167 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb8ed366-ec20-44a1-912b-bebb2e057e33 None admin] RBAC: Authorization granted {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:20:12.816137 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG dbcounter [-] [479852] Writing DB stats keystone:SELECT=100 {{(pid=479852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:20:12.830783 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application [None req-bb8ed366-ec20-44a1-912b-bebb2e057e33 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 09:20:12.830783 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 09:20:12.830783 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 09:20:12.830783 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 09:20:12.830783 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 09:20:12.830783 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 09:20:12.830783 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 09:20:12.830783 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 09:20:12.830783 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 09:20:12.830783 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 09:20:12.830783 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 09:20:12.830783 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 09:20:12.830783 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 09:20:12.830783 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 09:20:12.830783 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 09:20:12.832578 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 09:20:12.832578 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 09:20:12.832578 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 09:20:12.832578 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 09:20:12.832578 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 09:20:12.832578 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 09:20:12.832578 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 09:20:12.832578 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 09:20:12.832578 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application with Lock( Jul 28 09:20:12.832578 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 09:20:12.832578 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self._enter() Jul 28 09:20:12.832578 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 09:20:12.832578 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 09:20:12.832578 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 09:20:12.832578 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self.creator() Jul 28 09:20:12.832578 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 09:20:12.832578 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application created_value = creator( Jul 28 09:20:12.834214 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 09:20:12.834214 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 09:20:12.834214 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 09:20:12.834214 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application Jul 28 09:20:12.834214 dv-cinder-851351-1-smb devstack@keystone.service[479852]: [pid: 479852|app: 0|req: 544/1073] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 09:20:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 09:20:12.837981 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c3261f-3ac0-40b5-a689-dd135f249396 None admin] Authenticating user token {{(pid=479851) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:20:12.950725 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c3261f-3ac0-40b5-a689-dd135f249396 None admin] Validating token access rules against request {{(pid=479851) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:20:12.988990 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a5fc0c-947e-4de5-8298-6dedccab4a91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479851) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:20:12.989630 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a5fc0c-947e-4de5-8298-6dedccab4a91 None admin] REQUEST_METHOD: `GET` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:20:12.989917 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a5fc0c-947e-4de5-8298-6dedccab4a91 None admin] SCRIPT_NAME: `/identity` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:20:12.990190 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a5fc0c-947e-4de5-8298-6dedccab4a91 None admin] PATH_INFO: `/v3/domains` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:20:12.990912 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55a5fc0c-947e-4de5-8298-6dedccab4a91 None admin] RBAC: Adding query filter params (name=Default) {{(pid=479851) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 09:20:12.991232 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55a5fc0c-947e-4de5-8298-6dedccab4a91 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:20:12.992675 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55a5fc0c-947e-4de5-8298-6dedccab4a91 None admin] RBAC: Authorization granted {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:20:13.004807 dv-cinder-851351-1-smb devstack@keystone.service[479851]: [pid: 479851|app: 0|req: 530/1074] 10.222.0.42 () {56 vars in 1109 bytes} [Thu Jul 28 09:20:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:20:13.010487 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8ed366-ec20-44a1-912b-bebb2e057e33 None admin] Authenticating user token {{(pid=479852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:20:13.124827 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8ed366-ec20-44a1-912b-bebb2e057e33 None admin] Validating token access rules against request {{(pid=479852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:20:13.172608 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa062c4-588c-4467-81fc-ce97bda69cb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:20:13.173320 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa062c4-588c-4467-81fc-ce97bda69cb6 None admin] REQUEST_METHOD: `GET` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:20:13.173608 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa062c4-588c-4467-81fc-ce97bda69cb6 None admin] SCRIPT_NAME: `/identity` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:20:13.173888 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa062c4-588c-4467-81fc-ce97bda69cb6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:20:13.181217 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aa062c4-588c-4467-81fc-ce97bda69cb6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:20:13.182694 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aa062c4-588c-4467-81fc-ce97bda69cb6 None admin] RBAC: Authorization granted {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:20:13.194800 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application [None req-8aa062c4-588c-4467-81fc-ce97bda69cb6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 09:20:13.194800 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 09:20:13.194800 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 09:20:13.194800 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 09:20:13.194800 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 09:20:13.194800 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 09:20:13.194800 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 09:20:13.194800 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 09:20:13.194800 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 09:20:13.194800 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 09:20:13.194800 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 09:20:13.194800 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 09:20:13.194800 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 28 09:20:13.194800 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 28 09:20:13.194800 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 28 09:20:13.195913 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 28 09:20:13.195913 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 09:20:13.195913 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 09:20:13.195913 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 09:20:13.195913 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 09:20:13.195913 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 09:20:13.195913 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 09:20:13.195913 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 09:20:13.195913 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application with Lock( Jul 28 09:20:13.195913 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 09:20:13.195913 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self._enter() Jul 28 09:20:13.195913 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 09:20:13.195913 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 09:20:13.195913 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 09:20:13.195913 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self.creator() Jul 28 09:20:13.195913 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 09:20:13.195913 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application created_value = creator( Jul 28 09:20:13.197526 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 28 09:20:13.197526 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 28 09:20:13.197526 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 28 09:20:13.197526 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 28 09:20:13.197526 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 28 09:20:13.197526 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 28 09:20:13.197526 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 09:20:13.197526 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application Jul 28 09:20:13.197526 dv-cinder-851351-1-smb devstack@keystone.service[479852]: [pid: 479852|app: 0|req: 545/1075] 10.222.0.42 () {56 vars in 1111 bytes} [Thu Jul 28 09:20:13 2022] GET /identity/v3/projects/service => generated 88 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 09:20:13.202669 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a5fc0c-947e-4de5-8298-6dedccab4a91 None admin] Authenticating user token {{(pid=479851) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:20:13.264966 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG dbcounter [-] [479851] Writing DB stats keystone:SELECT=100 {{(pid=479851) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:20:13.310367 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a5fc0c-947e-4de5-8298-6dedccab4a91 None admin] Validating token access rules against request {{(pid=479851) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:20:13.346784 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892948c7-b939-4ead-89cb-9fb66f762761 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479851) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:20:13.347416 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892948c7-b939-4ead-89cb-9fb66f762761 None admin] REQUEST_METHOD: `GET` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:20:13.347757 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892948c7-b939-4ead-89cb-9fb66f762761 None admin] SCRIPT_NAME: `/identity` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:20:13.348041 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892948c7-b939-4ead-89cb-9fb66f762761 None admin] PATH_INFO: `/v3/projects` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:20:13.348865 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-892948c7-b939-4ead-89cb-9fb66f762761 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=479851) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 09:20:13.349161 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-892948c7-b939-4ead-89cb-9fb66f762761 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:20:13.350613 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-892948c7-b939-4ead-89cb-9fb66f762761 None admin] RBAC: Authorization granted {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:20:13.363112 dv-cinder-851351-1-smb devstack@keystone.service[479851]: [pid: 479851|app: 0|req: 531/1076] 10.222.0.42 () {56 vars in 1148 bytes} [Thu Jul 28 09:20:13 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:20:13.369622 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa062c4-588c-4467-81fc-ce97bda69cb6 None admin] Authenticating user token {{(pid=479852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:20:13.433741 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG dbcounter [-] [479852] Writing DB stats keystone:SELECT=100 {{(pid=479852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:20:13.482142 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa062c4-588c-4467-81fc-ce97bda69cb6 None admin] Validating token access rules against request {{(pid=479852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:20:13.517631 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74ccc03-f45e-431a-adea-e59b649b7410 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:20:13.518309 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74ccc03-f45e-431a-adea-e59b649b7410 None admin] REQUEST_METHOD: `PUT` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:20:13.518593 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74ccc03-f45e-431a-adea-e59b649b7410 None admin] SCRIPT_NAME: `/identity` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:20:13.518879 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74ccc03-f45e-431a-adea-e59b649b7410 None admin] PATH_INFO: `/v3/projects/3a0fb8ea8010437bade8f92dcbcaacee/users/c824cbfdc0dc4532ac6af71cbb6841fd/roles/4a0748cb7fbb416eb81203fd028beb9a` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:20:13.521246 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a74ccc03-f45e-431a-adea-e59b649b7410 None admin] RBAC: Authorizing `identity:create_grant(project_id=3a0fb8ea8010437bade8f92dcbcaacee, user_id=c824cbfdc0dc4532ac6af71cbb6841fd, role_id=4a0748cb7fbb416eb81203fd028beb9a)` {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:20:13.522730 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a74ccc03-f45e-431a-adea-e59b649b7410 None admin] RBAC: Authorization granted {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:20:13.537222 dv-cinder-851351-1-smb devstack@keystone.service[479852]: [pid: 479852|app: 0|req: 546/1077] 10.222.0.42 () {58 vars in 1439 bytes} [Thu Jul 28 09:20:13 2022] PUT /identity/v3/projects/3a0fb8ea8010437bade8f92dcbcaacee/users/c824cbfdc0dc4532ac6af71cbb6841fd/roles/4a0748cb7fbb416eb81203fd028beb9a => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 09:20:14.558958 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc33add-cc26-4692-87c1-097742f37fdc None None] REQUEST_METHOD: `GET` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:20:14.559638 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc33add-cc26-4692-87c1-097742f37fdc None None] SCRIPT_NAME: `/identity` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:20:14.559638 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc33add-cc26-4692-87c1-097742f37fdc None None] PATH_INFO: `/` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:20:14.560930 dv-cinder-851351-1-smb devstack@keystone.service[479851]: [pid: 479851|app: 0|req: 532/1078] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 09:20:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 09:20:14.566476 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08173df2-b302-4320-be74-284bd8ebfd65 None None] REQUEST_METHOD: `POST` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:20:14.567260 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08173df2-b302-4320-be74-284bd8ebfd65 None None] SCRIPT_NAME: `/identity` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:20:14.567260 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08173df2-b302-4320-be74-284bd8ebfd65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:20:14.586782 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.auth.core [None req-08173df2-b302-4320-be74-284bd8ebfd65 None None] MFA Rules not processed for user `c198f91a4ae84d2b9cc730a6e304c2be`. Rule list: `[]` (Enabled: `True`). {{(pid=479852) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 09:20:14.588000 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.fernet_utils [None req-08173df2-b302-4320-be74-284bd8ebfd65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=479852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 09:20:14.662644 dv-cinder-851351-1-smb devstack@keystone.service[479852]: [pid: 479852|app: 0|req: 547/1079] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 09:20:14 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 09:20:14.685457 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc33add-cc26-4692-87c1-097742f37fdc None None] Authenticating user token {{(pid=479851) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:20:14.805523 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc33add-cc26-4692-87c1-097742f37fdc None None] Validating token access rules against request {{(pid=479851) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:20:14.824411 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG dbcounter [-] [479851] Writing DB stats keystone:SELECT=100 {{(pid=479851) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:20:14.843774 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fea65bf-2059-4259-866f-e0c244fadf31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479851) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:20:14.844483 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fea65bf-2059-4259-866f-e0c244fadf31 None admin] REQUEST_METHOD: `GET` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:20:14.844803 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fea65bf-2059-4259-866f-e0c244fadf31 None admin] SCRIPT_NAME: `/identity` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:20:14.845087 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fea65bf-2059-4259-866f-e0c244fadf31 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:20:14.855818 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fea65bf-2059-4259-866f-e0c244fadf31 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 09:20:14.861116 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application [None req-1fea65bf-2059-4259-866f-e0c244fadf31 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 09:20:14.861116 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 09:20:14.861116 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 09:20:14.861116 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 09:20:14.861116 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 09:20:14.861116 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 09:20:14.861116 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 09:20:14.861116 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 09:20:14.861116 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 09:20:14.861116 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 09:20:14.861116 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 09:20:14.861116 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 09:20:14.861116 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 09:20:14.861116 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 09:20:14.861116 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 09:20:14.861116 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 09:20:14.862496 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 09:20:14.862496 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 09:20:14.862496 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 09:20:14.862496 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 09:20:14.862496 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 09:20:14.862496 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 09:20:14.862496 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 09:20:14.862496 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 09:20:14.862496 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 09:20:14.862496 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 09:20:14.862496 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 09:20:14.862496 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application with Lock( Jul 28 09:20:14.862496 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 09:20:14.862496 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return self._enter() Jul 28 09:20:14.862496 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 09:20:14.862496 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 09:20:14.863837 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 09:20:14.863837 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return self.creator() Jul 28 09:20:14.863837 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 09:20:14.863837 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application created_value = creator( Jul 28 09:20:14.863837 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 09:20:14.863837 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 09:20:14.863837 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 09:20:14.863837 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 09:20:14.863837 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 09:20:14.863837 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 09:20:14.863837 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 09:20:14.863837 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application Jul 28 09:20:14.863837 dv-cinder-851351-1-smb devstack@keystone.service[479851]: [pid: 479851|app: 0|req: 533/1080] 10.222.0.42 () {56 vars in 1096 bytes} [Thu Jul 28 09:20:14 2022] GET /identity/v3/roles/admin => generated 83 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 09:20:14.869087 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08173df2-b302-4320-be74-284bd8ebfd65 None None] Authenticating user token {{(pid=479852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:20:14.923941 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG dbcounter [-] [479852] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=479852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:20:14.984431 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08173df2-b302-4320-be74-284bd8ebfd65 None None] Validating token access rules against request {{(pid=479852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:20:15.019702 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38fa666-bddd-44fd-9202-c2570213cc1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:20:15.020336 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38fa666-bddd-44fd-9202-c2570213cc1a None admin] REQUEST_METHOD: `GET` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:20:15.020632 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38fa666-bddd-44fd-9202-c2570213cc1a None admin] SCRIPT_NAME: `/identity` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:20:15.020938 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38fa666-bddd-44fd-9202-c2570213cc1a None admin] PATH_INFO: `/v3/roles` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:20:15.021774 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c38fa666-bddd-44fd-9202-c2570213cc1a None admin] RBAC: Adding query filter params (name=admin) {{(pid=479852) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 09:20:15.022082 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c38fa666-bddd-44fd-9202-c2570213cc1a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:20:15.023472 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c38fa666-bddd-44fd-9202-c2570213cc1a None admin] RBAC: Authorization granted {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:20:15.032306 dv-cinder-851351-1-smb devstack@keystone.service[479852]: [pid: 479852|app: 0|req: 548/1081] 10.222.0.42 () {56 vars in 1099 bytes} [Thu Jul 28 09:20:14 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:20:15.038675 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fea65bf-2059-4259-866f-e0c244fadf31 None admin] Authenticating user token {{(pid=479851) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:20:15.153377 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fea65bf-2059-4259-866f-e0c244fadf31 None admin] Validating token access rules against request {{(pid=479851) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:20:15.190137 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be704805-ebb6-4819-88cf-ad4996c57266 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479851) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:20:15.190705 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be704805-ebb6-4819-88cf-ad4996c57266 None admin] REQUEST_METHOD: `GET` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:20:15.190994 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be704805-ebb6-4819-88cf-ad4996c57266 None admin] SCRIPT_NAME: `/identity` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:20:15.191260 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be704805-ebb6-4819-88cf-ad4996c57266 None admin] PATH_INFO: `/v3/users/c3fc567a0b1a47be973fe73937223e91` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:20:15.192523 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be704805-ebb6-4819-88cf-ad4996c57266 None admin] RBAC: Authorizing `identity:get_user(user_id=c3fc567a0b1a47be973fe73937223e91)` {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:20:15.194090 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be704805-ebb6-4819-88cf-ad4996c57266 None admin] RBAC: Authorization granted {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:20:15.195808 dv-cinder-851351-1-smb devstack@keystone.service[479851]: [pid: 479851|app: 0|req: 534/1082] 10.222.0.42 () {56 vars in 1177 bytes} [Thu Jul 28 09:20:15 2022] GET /identity/v3/users/c3fc567a0b1a47be973fe73937223e91 => generated 285 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:20:15.202036 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38fa666-bddd-44fd-9202-c2570213cc1a None admin] Authenticating user token {{(pid=479852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:20:15.307888 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38fa666-bddd-44fd-9202-c2570213cc1a None admin] Validating token access rules against request {{(pid=479852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:20:15.315437 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG dbcounter [-] [479852] Writing DB stats keystone:SELECT=100 {{(pid=479852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:20:15.344128 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a9b8163-4ba8-48f7-9498-fa425d5f3c6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:20:15.344948 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9b8163-4ba8-48f7-9498-fa425d5f3c6e None admin] REQUEST_METHOD: `GET` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:20:15.345197 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9b8163-4ba8-48f7-9498-fa425d5f3c6e None admin] SCRIPT_NAME: `/identity` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:20:15.345471 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9b8163-4ba8-48f7-9498-fa425d5f3c6e None admin] PATH_INFO: `/v3/projects/7d20987a30d8467882bb453ffb442bf3` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:20:15.346652 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a9b8163-4ba8-48f7-9498-fa425d5f3c6e None admin] RBAC: Authorizing `identity:get_project(project_id=7d20987a30d8467882bb453ffb442bf3)` {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:20:15.348100 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a9b8163-4ba8-48f7-9498-fa425d5f3c6e None admin] RBAC: Authorization granted {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:20:15.349847 dv-cinder-851351-1-smb devstack@keystone.service[479852]: [pid: 479852|app: 0|req: 549/1083] 10.222.0.42 () {56 vars in 1186 bytes} [Thu Jul 28 09:20:15 2022] GET /identity/v3/projects/7d20987a30d8467882bb453ffb442bf3 => generated 311 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:20:15.356202 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be704805-ebb6-4819-88cf-ad4996c57266 None admin] Authenticating user token {{(pid=479851) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:20:15.413848 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG dbcounter [-] [479851] Writing DB stats keystone:SELECT=100 {{(pid=479851) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:20:15.473610 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be704805-ebb6-4819-88cf-ad4996c57266 None admin] Validating token access rules against request {{(pid=479851) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:20:15.510379 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e376c4-5bd6-4a9e-96d9-3de9c210b81c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479851) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:20:15.511074 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e376c4-5bd6-4a9e-96d9-3de9c210b81c None admin] REQUEST_METHOD: `PUT` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:20:15.511360 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e376c4-5bd6-4a9e-96d9-3de9c210b81c None admin] SCRIPT_NAME: `/identity` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:20:15.511645 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e376c4-5bd6-4a9e-96d9-3de9c210b81c None admin] PATH_INFO: `/v3/projects/7d20987a30d8467882bb453ffb442bf3/users/c3fc567a0b1a47be973fe73937223e91/roles/685084310b35477b9b2d0c7934d0f803` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:20:15.513799 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6e376c4-5bd6-4a9e-96d9-3de9c210b81c None admin] RBAC: Authorizing `identity:create_grant(project_id=7d20987a30d8467882bb453ffb442bf3, user_id=c3fc567a0b1a47be973fe73937223e91, role_id=685084310b35477b9b2d0c7934d0f803)` {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:20:15.515254 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6e376c4-5bd6-4a9e-96d9-3de9c210b81c None admin] RBAC: Authorization granted {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:20:15.536406 dv-cinder-851351-1-smb devstack@keystone.service[479851]: [pid: 479851|app: 0|req: 535/1084] 10.222.0.42 () {58 vars in 1439 bytes} [Thu Jul 28 09:20:15 2022] PUT /identity/v3/projects/7d20987a30d8467882bb453ffb442bf3/users/c3fc567a0b1a47be973fe73937223e91/roles/685084310b35477b9b2d0c7934d0f803 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 09:20:15.560414 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e72b9e8-2ac5-4507-85ff-83041c5f37cb None None] REQUEST_METHOD: `GET` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:20:15.560729 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e72b9e8-2ac5-4507-85ff-83041c5f37cb None None] SCRIPT_NAME: `/identity` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:20:15.561000 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e72b9e8-2ac5-4507-85ff-83041c5f37cb None None] PATH_INFO: `/` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:20:15.562428 dv-cinder-851351-1-smb devstack@keystone.service[479852]: [pid: 479852|app: 0|req: 550/1085] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 09:20:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 09:20:15.569075 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c04bb6-e91c-4e14-9c5d-ded5cba29f56 None None] REQUEST_METHOD: `POST` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:20:15.569666 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c04bb6-e91c-4e14-9c5d-ded5cba29f56 None None] SCRIPT_NAME: `/identity` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:20:15.569666 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c04bb6-e91c-4e14-9c5d-ded5cba29f56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:20:15.590222 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.auth.core [None req-11c04bb6-e91c-4e14-9c5d-ded5cba29f56 None None] MFA Rules not processed for user `c198f91a4ae84d2b9cc730a6e304c2be`. Rule list: `[]` (Enabled: `True`). {{(pid=479851) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 09:20:15.591510 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.fernet_utils [None req-11c04bb6-e91c-4e14-9c5d-ded5cba29f56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=479851) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 09:20:15.667263 dv-cinder-851351-1-smb devstack@keystone.service[479851]: [pid: 479851|app: 0|req: 536/1086] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 09:20:15 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 09:20:15.690826 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e72b9e8-2ac5-4507-85ff-83041c5f37cb None None] Authenticating user token {{(pid=479852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:20:15.804162 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e72b9e8-2ac5-4507-85ff-83041c5f37cb None None] Validating token access rules against request {{(pid=479852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:20:15.839974 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e94b8e4-bd3a-473c-97da-4df5f90fa874 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:20:15.840622 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e94b8e4-bd3a-473c-97da-4df5f90fa874 None admin] REQUEST_METHOD: `GET` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:20:15.840929 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e94b8e4-bd3a-473c-97da-4df5f90fa874 None admin] SCRIPT_NAME: `/identity` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:20:15.841200 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e94b8e4-bd3a-473c-97da-4df5f90fa874 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:20:15.852588 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e94b8e4-bd3a-473c-97da-4df5f90fa874 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 09:20:15.857562 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application [None req-3e94b8e4-bd3a-473c-97da-4df5f90fa874 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 28 09:20:15.857562 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 09:20:15.857562 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 09:20:15.857562 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 09:20:15.857562 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 09:20:15.857562 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 09:20:15.857562 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 09:20:15.857562 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 09:20:15.857562 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 09:20:15.857562 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 09:20:15.857562 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 09:20:15.857562 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 09:20:15.857562 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 09:20:15.857562 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 09:20:15.857562 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 09:20:15.857562 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 09:20:15.858700 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 09:20:15.858700 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 09:20:15.858700 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 09:20:15.858700 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 09:20:15.858700 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 09:20:15.858700 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 09:20:15.858700 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 09:20:15.858700 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 09:20:15.858700 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 09:20:15.858700 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 09:20:15.858700 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 09:20:15.858700 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application with Lock( Jul 28 09:20:15.858700 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 09:20:15.858700 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self._enter() Jul 28 09:20:15.858700 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 09:20:15.858700 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 09:20:15.859692 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 09:20:15.859692 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self.creator() Jul 28 09:20:15.859692 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 09:20:15.859692 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application created_value = creator( Jul 28 09:20:15.859692 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 09:20:15.859692 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 09:20:15.859692 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 09:20:15.859692 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 09:20:15.859692 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 09:20:15.859692 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 09:20:15.859692 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 28 09:20:15.859692 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application Jul 28 09:20:15.859692 dv-cinder-851351-1-smb devstack@keystone.service[479852]: [pid: 479852|app: 0|req: 551/1087] 10.222.0.42 () {56 vars in 1120 bytes} [Thu Jul 28 09:20:15 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 09:20:15.865101 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c04bb6-e91c-4e14-9c5d-ded5cba29f56 None None] Authenticating user token {{(pid=479851) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:20:15.901777 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG dbcounter [-] [479851] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=479851) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:20:15.972397 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c04bb6-e91c-4e14-9c5d-ded5cba29f56 None None] Validating token access rules against request {{(pid=479851) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:20:16.009623 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afbb34a6-3bae-45ec-95b6-0dbc7218083c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479851) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:20:16.010261 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbb34a6-3bae-45ec-95b6-0dbc7218083c None admin] REQUEST_METHOD: `GET` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:20:16.010547 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbb34a6-3bae-45ec-95b6-0dbc7218083c None admin] SCRIPT_NAME: `/identity` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:20:16.010825 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbb34a6-3bae-45ec-95b6-0dbc7218083c None admin] PATH_INFO: `/v3/roles` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:20:16.011563 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afbb34a6-3bae-45ec-95b6-0dbc7218083c None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=479851) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 09:20:16.011872 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afbb34a6-3bae-45ec-95b6-0dbc7218083c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:20:16.013294 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afbb34a6-3bae-45ec-95b6-0dbc7218083c None admin] RBAC: Authorization granted {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:20:16.021596 dv-cinder-851351-1-smb devstack@keystone.service[479851]: [pid: 479851|app: 0|req: 537/1088] 10.222.0.42 () {56 vars in 1115 bytes} [Thu Jul 28 09:20:15 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:20:16.027329 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e94b8e4-bd3a-473c-97da-4df5f90fa874 None admin] Authenticating user token {{(pid=479852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:20:16.063718 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG dbcounter [-] [479852] Writing DB stats keystone:SELECT=100 {{(pid=479852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:20:16.133699 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e94b8e4-bd3a-473c-97da-4df5f90fa874 None admin] Validating token access rules against request {{(pid=479852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:20:16.169908 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5517fa52-e199-423d-a314-40ef4b50f8f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:20:16.170562 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5517fa52-e199-423d-a314-40ef4b50f8f7 None admin] REQUEST_METHOD: `GET` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:20:16.170844 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5517fa52-e199-423d-a314-40ef4b50f8f7 None admin] SCRIPT_NAME: `/identity` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:20:16.171118 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5517fa52-e199-423d-a314-40ef4b50f8f7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:20:16.182773 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5517fa52-e199-423d-a314-40ef4b50f8f7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:20:16.184239 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5517fa52-e199-423d-a314-40ef4b50f8f7 None admin] RBAC: Authorization granted {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:20:16.199606 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application [None req-5517fa52-e199-423d-a314-40ef4b50f8f7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 09:20:16.199606 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 09:20:16.199606 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 09:20:16.199606 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 09:20:16.199606 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 09:20:16.199606 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 09:20:16.199606 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 09:20:16.199606 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 09:20:16.199606 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 09:20:16.199606 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 09:20:16.199606 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 09:20:16.199606 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 09:20:16.199606 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 09:20:16.199606 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 09:20:16.199606 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 09:20:16.200759 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 09:20:16.200759 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 09:20:16.200759 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 09:20:16.200759 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 09:20:16.200759 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 09:20:16.200759 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 09:20:16.200759 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 09:20:16.200759 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 09:20:16.200759 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application with Lock( Jul 28 09:20:16.200759 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 09:20:16.200759 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self._enter() Jul 28 09:20:16.200759 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 09:20:16.200759 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 09:20:16.200759 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 09:20:16.200759 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self.creator() Jul 28 09:20:16.200759 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 09:20:16.200759 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application created_value = creator( Jul 28 09:20:16.201836 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 09:20:16.201836 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 09:20:16.201836 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 09:20:16.201836 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application Jul 28 09:20:16.201836 dv-cinder-851351-1-smb devstack@keystone.service[479852]: [pid: 479852|app: 0|req: 552/1089] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 09:20:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 09:20:16.206824 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afbb34a6-3bae-45ec-95b6-0dbc7218083c None admin] Authenticating user token {{(pid=479851) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:20:16.309157 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG dbcounter [-] [479851] Writing DB stats keystone:SELECT=100 {{(pid=479851) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:20:16.313942 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afbb34a6-3bae-45ec-95b6-0dbc7218083c None admin] Validating token access rules against request {{(pid=479851) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:20:16.350295 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f5f41d-f440-4d78-86c5-92ed5b0556fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479851) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:20:16.350934 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f5f41d-f440-4d78-86c5-92ed5b0556fe None admin] REQUEST_METHOD: `GET` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:20:16.351275 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f5f41d-f440-4d78-86c5-92ed5b0556fe None admin] SCRIPT_NAME: `/identity` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:20:16.351561 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f5f41d-f440-4d78-86c5-92ed5b0556fe None admin] PATH_INFO: `/v3/domains` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:20:16.352278 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45f5f41d-f440-4d78-86c5-92ed5b0556fe None admin] RBAC: Adding query filter params (name=Default) {{(pid=479851) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 09:20:16.352588 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45f5f41d-f440-4d78-86c5-92ed5b0556fe None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:20:16.354017 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45f5f41d-f440-4d78-86c5-92ed5b0556fe None admin] RBAC: Authorization granted {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:20:16.366847 dv-cinder-851351-1-smb devstack@keystone.service[479851]: [pid: 479851|app: 0|req: 538/1090] 10.222.0.42 () {56 vars in 1109 bytes} [Thu Jul 28 09:20:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:20:16.372988 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5517fa52-e199-423d-a314-40ef4b50f8f7 None admin] Authenticating user token {{(pid=479852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:20:16.474888 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG dbcounter [-] [479852] Writing DB stats keystone:SELECT=100 {{(pid=479852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:20:16.490782 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5517fa52-e199-423d-a314-40ef4b50f8f7 None admin] Validating token access rules against request {{(pid=479852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:20:16.526321 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49685a6c-d439-4272-9abc-4baf20050e0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:20:16.527087 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49685a6c-d439-4272-9abc-4baf20050e0e None admin] REQUEST_METHOD: `GET` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:20:16.527363 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49685a6c-d439-4272-9abc-4baf20050e0e None admin] SCRIPT_NAME: `/identity` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:20:16.527630 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49685a6c-d439-4272-9abc-4baf20050e0e None admin] PATH_INFO: `/v3/users/nova` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:20:16.536037 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49685a6c-d439-4272-9abc-4baf20050e0e None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:20:16.537521 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49685a6c-d439-4272-9abc-4baf20050e0e None admin] RBAC: Authorization granted {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:20:16.549373 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application [None req-49685a6c-d439-4272-9abc-4baf20050e0e None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 28 09:20:16.549373 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 09:20:16.549373 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 09:20:16.549373 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 09:20:16.549373 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 09:20:16.549373 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 09:20:16.549373 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 09:20:16.549373 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 09:20:16.549373 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 09:20:16.549373 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 09:20:16.549373 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 09:20:16.549373 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 09:20:16.549373 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 28 09:20:16.549373 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 28 09:20:16.549373 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 28 09:20:16.549373 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 28 09:20:16.550702 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 09:20:16.550702 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 09:20:16.550702 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 28 09:20:16.550702 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 09:20:16.550702 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 28 09:20:16.550702 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 09:20:16.550702 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 09:20:16.550702 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 09:20:16.550702 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 09:20:16.550702 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 09:20:16.550702 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 09:20:16.550702 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application with Lock( Jul 28 09:20:16.550702 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 09:20:16.550702 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self._enter() Jul 28 09:20:16.550702 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 09:20:16.550702 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 09:20:16.550702 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 09:20:16.550702 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self.creator() Jul 28 09:20:16.551876 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 09:20:16.551876 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application created_value = creator( Jul 28 09:20:16.551876 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 28 09:20:16.551876 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 28 09:20:16.551876 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 28 09:20:16.551876 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 28 09:20:16.551876 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 28 09:20:16.551876 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 28 09:20:16.551876 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 28 09:20:16.551876 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application Jul 28 09:20:16.551876 dv-cinder-851351-1-smb devstack@keystone.service[479852]: [pid: 479852|app: 0|req: 553/1091] 10.222.0.42 () {56 vars in 1093 bytes} [Thu Jul 28 09:20:16 2022] GET /identity/v3/users/nova => generated 82 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 09:20:16.556649 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f5f41d-f440-4d78-86c5-92ed5b0556fe None admin] Authenticating user token {{(pid=479851) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:20:16.662686 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f5f41d-f440-4d78-86c5-92ed5b0556fe None admin] Validating token access rules against request {{(pid=479851) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:20:16.699198 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd57ef7-15de-4a3e-9396-25209e638f37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479851) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:20:16.699834 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd57ef7-15de-4a3e-9396-25209e638f37 None admin] REQUEST_METHOD: `GET` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:20:16.700123 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd57ef7-15de-4a3e-9396-25209e638f37 None admin] SCRIPT_NAME: `/identity` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:20:16.700402 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd57ef7-15de-4a3e-9396-25209e638f37 None admin] PATH_INFO: `/v3/users` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:20:16.701243 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efd57ef7-15de-4a3e-9396-25209e638f37 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=479851) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 09:20:16.701551 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efd57ef7-15de-4a3e-9396-25209e638f37 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:20:16.703014 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efd57ef7-15de-4a3e-9396-25209e638f37 None admin] RBAC: Authorization granted {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:20:16.720550 dv-cinder-851351-1-smb devstack@keystone.service[479851]: [pid: 479851|app: 0|req: 539/1092] 10.222.0.42 () {56 vars in 1133 bytes} [Thu Jul 28 09:20:16 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:20:16.726654 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49685a6c-d439-4272-9abc-4baf20050e0e None admin] Authenticating user token {{(pid=479852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:20:16.845004 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49685a6c-d439-4272-9abc-4baf20050e0e None admin] Validating token access rules against request {{(pid=479852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:20:16.879813 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-511a62c8-ff3a-4d98-bffa-ae7510c1def6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:20:16.880442 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511a62c8-ff3a-4d98-bffa-ae7510c1def6 None admin] REQUEST_METHOD: `GET` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:20:16.880721 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511a62c8-ff3a-4d98-bffa-ae7510c1def6 None admin] SCRIPT_NAME: `/identity` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:20:16.881028 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511a62c8-ff3a-4d98-bffa-ae7510c1def6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:20:16.896889 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG dbcounter [-] [479852] Writing DB stats keystone:SELECT=100 {{(pid=479852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:20:16.952646 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-511a62c8-ff3a-4d98-bffa-ae7510c1def6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:20:16.954978 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-511a62c8-ff3a-4d98-bffa-ae7510c1def6 None admin] RBAC: Authorization granted {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:20:17.057739 dv-cinder-851351-1-smb devstack@keystone.service[479852]: [pid: 479852|app: 0|req: 554/1093] 10.222.0.42 () {58 vars in 1282 bytes} [Thu Jul 28 09:20:16 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 28 09:20:17.063731 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd57ef7-15de-4a3e-9396-25209e638f37 None admin] Authenticating user token {{(pid=479851) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:20:17.083374 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG dbcounter [-] [479851] Writing DB stats keystone:SELECT=100 {{(pid=479851) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:20:17.171307 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd57ef7-15de-4a3e-9396-25209e638f37 None admin] Validating token access rules against request {{(pid=479851) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:20:17.208920 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb860eb8-2d56-4616-ace0-3374deb4975a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479851) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:20:17.209510 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb860eb8-2d56-4616-ace0-3374deb4975a None admin] REQUEST_METHOD: `GET` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:20:17.209798 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb860eb8-2d56-4616-ace0-3374deb4975a None admin] SCRIPT_NAME: `/identity` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:20:17.210085 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb860eb8-2d56-4616-ace0-3374deb4975a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:20:17.221082 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb860eb8-2d56-4616-ace0-3374deb4975a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:20:17.222616 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb860eb8-2d56-4616-ace0-3374deb4975a None admin] RBAC: Authorization granted {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:20:17.238819 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application [None req-cb860eb8-2d56-4616-ace0-3374deb4975a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 09:20:17.238819 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 09:20:17.238819 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 09:20:17.238819 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 09:20:17.238819 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 09:20:17.238819 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 09:20:17.238819 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 09:20:17.238819 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 09:20:17.238819 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 09:20:17.238819 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 09:20:17.238819 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 09:20:17.238819 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 09:20:17.238819 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 09:20:17.238819 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 09:20:17.238819 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 09:20:17.239997 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 09:20:17.239997 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 09:20:17.239997 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 09:20:17.239997 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 09:20:17.239997 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 09:20:17.239997 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 09:20:17.239997 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 09:20:17.239997 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 09:20:17.239997 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application with Lock( Jul 28 09:20:17.239997 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 09:20:17.239997 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return self._enter() Jul 28 09:20:17.239997 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 09:20:17.239997 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 09:20:17.239997 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 09:20:17.239997 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return self.creator() Jul 28 09:20:17.239997 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 09:20:17.239997 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application created_value = creator( Jul 28 09:20:17.241532 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 09:20:17.241532 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 09:20:17.241532 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 09:20:17.241532 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application Jul 28 09:20:17.241532 dv-cinder-851351-1-smb devstack@keystone.service[479851]: [pid: 479851|app: 0|req: 540/1094] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 09:20:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 09:20:17.246012 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-511a62c8-ff3a-4d98-bffa-ae7510c1def6 None admin] Authenticating user token {{(pid=479852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:20:17.303019 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG dbcounter [-] [479852] Writing DB stats keystone:SELECT=100 {{(pid=479852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:20:17.364568 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-511a62c8-ff3a-4d98-bffa-ae7510c1def6 None admin] Validating token access rules against request {{(pid=479852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:20:17.401229 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12198a1-7f77-450c-ae76-b1f21bfaa32d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:20:17.401899 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12198a1-7f77-450c-ae76-b1f21bfaa32d None admin] REQUEST_METHOD: `GET` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:20:17.402137 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12198a1-7f77-450c-ae76-b1f21bfaa32d None admin] SCRIPT_NAME: `/identity` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:20:17.402445 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12198a1-7f77-450c-ae76-b1f21bfaa32d None admin] PATH_INFO: `/v3/domains` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:20:17.403138 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f12198a1-7f77-450c-ae76-b1f21bfaa32d None admin] RBAC: Adding query filter params (name=Default) {{(pid=479852) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 09:20:17.403421 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f12198a1-7f77-450c-ae76-b1f21bfaa32d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:20:17.404829 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f12198a1-7f77-450c-ae76-b1f21bfaa32d None admin] RBAC: Authorization granted {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:20:17.416510 dv-cinder-851351-1-smb devstack@keystone.service[479852]: [pid: 479852|app: 0|req: 555/1095] 10.222.0.42 () {56 vars in 1109 bytes} [Thu Jul 28 09:20:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:20:17.422079 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb860eb8-2d56-4616-ace0-3374deb4975a None admin] Authenticating user token {{(pid=479851) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:20:17.496729 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG dbcounter [-] [479851] Writing DB stats keystone:SELECT=100 {{(pid=479851) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:20:17.536885 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb860eb8-2d56-4616-ace0-3374deb4975a None admin] Validating token access rules against request {{(pid=479851) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:20:17.546283 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376e9006-220b-4806-8a3b-4419d6b46fa7 None None] REQUEST_METHOD: `GET` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:20:17.546891 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376e9006-220b-4806-8a3b-4419d6b46fa7 None None] SCRIPT_NAME: `/identity` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:20:17.547176 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376e9006-220b-4806-8a3b-4419d6b46fa7 None None] PATH_INFO: `/` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:20:17.548541 dv-cinder-851351-1-smb devstack@keystone.service[479852]: [pid: 479852|app: 0|req: 556/1096] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 09:20:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 09:20:17.553580 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ba43a2-4981-4381-a7c0-0fb3956f585e None None] REQUEST_METHOD: `POST` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:20:17.553866 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ba43a2-4981-4381-a7c0-0fb3956f585e None None] SCRIPT_NAME: `/identity` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:20:17.554146 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ba43a2-4981-4381-a7c0-0fb3956f585e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:20:17.572358 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee7be1b-9a5f-4f5d-b85a-e8f8789119ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479851) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:20:17.572604 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.auth.core [None req-80ba43a2-4981-4381-a7c0-0fb3956f585e None None] MFA Rules not processed for user `c198f91a4ae84d2b9cc730a6e304c2be`. Rule list: `[]` (Enabled: `True`). {{(pid=479852) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 09:20:17.573071 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee7be1b-9a5f-4f5d-b85a-e8f8789119ab None admin] REQUEST_METHOD: `GET` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:20:17.573363 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee7be1b-9a5f-4f5d-b85a-e8f8789119ab None admin] SCRIPT_NAME: `/identity` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:20:17.573647 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee7be1b-9a5f-4f5d-b85a-e8f8789119ab None admin] PATH_INFO: `/v3/projects/service` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:20:17.573800 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.fernet_utils [None req-80ba43a2-4981-4381-a7c0-0fb3956f585e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=479852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 09:20:17.581546 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ee7be1b-9a5f-4f5d-b85a-e8f8789119ab None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:20:17.583114 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ee7be1b-9a5f-4f5d-b85a-e8f8789119ab None admin] RBAC: Authorization granted {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:20:17.595558 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application [None req-6ee7be1b-9a5f-4f5d-b85a-e8f8789119ab None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 09:20:17.595558 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 09:20:17.595558 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 09:20:17.595558 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 09:20:17.595558 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 09:20:17.595558 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 09:20:17.595558 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 09:20:17.595558 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 09:20:17.595558 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 09:20:17.595558 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 09:20:17.595558 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 09:20:17.595558 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 09:20:17.595558 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 28 09:20:17.595558 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 28 09:20:17.595558 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 28 09:20:17.596820 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 28 09:20:17.596820 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 09:20:17.596820 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 09:20:17.596820 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 09:20:17.596820 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 09:20:17.596820 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 09:20:17.596820 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 09:20:17.596820 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 09:20:17.596820 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application with Lock( Jul 28 09:20:17.596820 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 09:20:17.596820 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return self._enter() Jul 28 09:20:17.596820 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 09:20:17.596820 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 09:20:17.596820 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 09:20:17.596820 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return self.creator() Jul 28 09:20:17.596820 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 09:20:17.596820 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application created_value = creator( Jul 28 09:20:17.598441 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 28 09:20:17.598441 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 28 09:20:17.598441 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 28 09:20:17.598441 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 28 09:20:17.598441 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 28 09:20:17.598441 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 28 09:20:17.598441 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 09:20:17.598441 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application Jul 28 09:20:17.598441 dv-cinder-851351-1-smb devstack@keystone.service[479851]: [pid: 479851|app: 0|req: 541/1097] 10.222.0.42 () {56 vars in 1111 bytes} [Thu Jul 28 09:20:17 2022] GET /identity/v3/projects/service => generated 88 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 09:20:17.602752 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee7be1b-9a5f-4f5d-b85a-e8f8789119ab None admin] Authenticating user token {{(pid=479851) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:20:17.646610 dv-cinder-851351-1-smb devstack@keystone.service[479852]: [pid: 479852|app: 0|req: 557/1098] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 09:20:17 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 28 09:20:17.669720 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ba43a2-4981-4381-a7c0-0fb3956f585e None None] Authenticating user token {{(pid=479852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:20:17.701862 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee7be1b-9a5f-4f5d-b85a-e8f8789119ab None admin] Validating token access rules against request {{(pid=479851) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:20:17.703563 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG dbcounter [-] [479852] Writing DB stats keystone:SELECT=100 {{(pid=479852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:20:17.728403 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG dbcounter [-] [479851] Writing DB stats keystone:SELECT=100 {{(pid=479851) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:20:17.737021 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7fe685-bbda-4c60-8bea-05b8eacc7609 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479851) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:20:17.737662 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7fe685-bbda-4c60-8bea-05b8eacc7609 None admin] REQUEST_METHOD: `GET` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:20:17.737966 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7fe685-bbda-4c60-8bea-05b8eacc7609 None admin] SCRIPT_NAME: `/identity` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:20:17.738260 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7fe685-bbda-4c60-8bea-05b8eacc7609 None admin] PATH_INFO: `/v3/projects` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:20:17.739024 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb7fe685-bbda-4c60-8bea-05b8eacc7609 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=479851) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 09:20:17.739343 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb7fe685-bbda-4c60-8bea-05b8eacc7609 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:20:17.740865 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb7fe685-bbda-4c60-8bea-05b8eacc7609 None admin] RBAC: Authorization granted {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:20:17.753609 dv-cinder-851351-1-smb devstack@keystone.service[479851]: [pid: 479851|app: 0|req: 542/1099] 10.222.0.42 () {56 vars in 1148 bytes} [Thu Jul 28 09:20:17 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 09:20:17.759859 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7fe685-bbda-4c60-8bea-05b8eacc7609 None admin] Authenticating user token {{(pid=479851) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:20:17.769744 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ba43a2-4981-4381-a7c0-0fb3956f585e None None] Validating token access rules against request {{(pid=479852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:20:17.807265 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36845fd3-8bcb-45cc-a76b-753b870aafc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:20:17.807927 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36845fd3-8bcb-45cc-a76b-753b870aafc2 None admin] REQUEST_METHOD: `GET` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:20:17.808213 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36845fd3-8bcb-45cc-a76b-753b870aafc2 None admin] SCRIPT_NAME: `/identity` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:20:17.808489 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36845fd3-8bcb-45cc-a76b-753b870aafc2 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:20:17.819423 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36845fd3-8bcb-45cc-a76b-753b870aafc2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 09:20:17.824819 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application [None req-36845fd3-8bcb-45cc-a76b-753b870aafc2 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 09:20:17.824819 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 09:20:17.824819 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 09:20:17.824819 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 09:20:17.824819 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 09:20:17.824819 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 09:20:17.824819 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 09:20:17.824819 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 09:20:17.824819 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 09:20:17.824819 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 09:20:17.824819 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 09:20:17.824819 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 09:20:17.824819 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 09:20:17.824819 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 09:20:17.824819 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 09:20:17.824819 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 09:20:17.825958 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 09:20:17.825958 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 09:20:17.825958 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 09:20:17.825958 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 09:20:17.825958 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 09:20:17.825958 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 09:20:17.825958 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 09:20:17.825958 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 09:20:17.825958 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 09:20:17.825958 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 09:20:17.825958 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 09:20:17.825958 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application with Lock( Jul 28 09:20:17.825958 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 09:20:17.825958 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self._enter() Jul 28 09:20:17.825958 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 09:20:17.825958 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 09:20:17.827055 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 09:20:17.827055 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self.creator() Jul 28 09:20:17.827055 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 09:20:17.827055 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application created_value = creator( Jul 28 09:20:17.827055 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 09:20:17.827055 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 09:20:17.827055 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 09:20:17.827055 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 09:20:17.827055 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 09:20:17.827055 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 09:20:17.827055 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 09:20:17.827055 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application Jul 28 09:20:17.827055 dv-cinder-851351-1-smb devstack@keystone.service[479852]: [pid: 479852|app: 0|req: 558/1100] 10.222.0.42 () {56 vars in 1096 bytes} [Thu Jul 28 09:20:17 2022] GET /identity/v3/roles/admin => generated 83 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 09:20:17.832228 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36845fd3-8bcb-45cc-a76b-753b870aafc2 None admin] Authenticating user token {{(pid=479852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:20:17.866936 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7fe685-bbda-4c60-8bea-05b8eacc7609 None admin] Validating token access rules against request {{(pid=479851) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:20:17.901044 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa66c2e-ab5e-423d-adaa-e8b1a38f2cd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479851) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:20:17.901674 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa66c2e-ab5e-423d-adaa-e8b1a38f2cd5 None admin] REQUEST_METHOD: `GET` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:20:17.901977 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa66c2e-ab5e-423d-adaa-e8b1a38f2cd5 None admin] SCRIPT_NAME: `/identity` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:20:17.902259 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa66c2e-ab5e-423d-adaa-e8b1a38f2cd5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:20:17.903062 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fa66c2e-ab5e-423d-adaa-e8b1a38f2cd5 None admin] RBAC: Adding query filter params (role.id=4a0748cb7fbb416eb81203fd028beb9a, scope.project.id=3a0fb8ea8010437bade8f92dcbcaacee, user.id=c824cbfdc0dc4532ac6af71cbb6841fd) {{(pid=479851) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 09:20:17.903379 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fa66c2e-ab5e-423d-adaa-e8b1a38f2cd5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:20:17.904851 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fa66c2e-ab5e-423d-adaa-e8b1a38f2cd5 None admin] RBAC: Authorization granted {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:20:17.910735 dv-cinder-851351-1-smb devstack@keystone.service[479851]: [pid: 479851|app: 0|req: 543/1101] 10.222.0.42 () {56 vars in 1374 bytes} [Thu Jul 28 09:20:17 2022] GET /identity/v3/role_assignments?user.id=c824cbfdc0dc4532ac6af71cbb6841fd&scope.project.id=3a0fb8ea8010437bade8f92dcbcaacee&role.id=4a0748cb7fbb416eb81203fd028beb9a => generated 608 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:20:17.930564 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG dbcounter [-] [479852] Writing DB stats keystone:SELECT=100 {{(pid=479852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:20:17.937351 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36845fd3-8bcb-45cc-a76b-753b870aafc2 None admin] Validating token access rules against request {{(pid=479852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:20:17.975619 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854b678c-9927-4dda-a457-43a4c203b1a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:20:17.976266 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854b678c-9927-4dda-a457-43a4c203b1a0 None admin] REQUEST_METHOD: `GET` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:20:17.976551 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854b678c-9927-4dda-a457-43a4c203b1a0 None admin] SCRIPT_NAME: `/identity` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:20:17.976863 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854b678c-9927-4dda-a457-43a4c203b1a0 None admin] PATH_INFO: `/v3/roles` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:20:17.977608 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-854b678c-9927-4dda-a457-43a4c203b1a0 None admin] RBAC: Adding query filter params (name=admin) {{(pid=479852) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 09:20:17.977915 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-854b678c-9927-4dda-a457-43a4c203b1a0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:20:17.979302 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-854b678c-9927-4dda-a457-43a4c203b1a0 None admin] RBAC: Authorization granted {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:20:17.997193 dv-cinder-851351-1-smb devstack@keystone.service[479852]: [pid: 479852|app: 0|req: 559/1102] 10.222.0.42 () {56 vars in 1099 bytes} [Thu Jul 28 09:20:17 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 09:20:18.003340 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa66c2e-ab5e-423d-adaa-e8b1a38f2cd5 None admin] Authenticating user token {{(pid=479851) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:20:18.061515 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG dbcounter [-] [479851] Writing DB stats keystone:SELECT=100 {{(pid=479851) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:20:18.114721 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa66c2e-ab5e-423d-adaa-e8b1a38f2cd5 None admin] Validating token access rules against request {{(pid=479851) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:20:18.149781 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b78c858-04cd-4b2a-9783-9bf3b0380b0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479851) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:20:18.150456 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b78c858-04cd-4b2a-9783-9bf3b0380b0a None admin] REQUEST_METHOD: `GET` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:20:18.150742 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b78c858-04cd-4b2a-9783-9bf3b0380b0a None admin] SCRIPT_NAME: `/identity` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:20:18.151024 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b78c858-04cd-4b2a-9783-9bf3b0380b0a None admin] PATH_INFO: `/v3/users/c3fc567a0b1a47be973fe73937223e91` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:20:18.152232 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b78c858-04cd-4b2a-9783-9bf3b0380b0a None admin] RBAC: Authorizing `identity:get_user(user_id=c3fc567a0b1a47be973fe73937223e91)` {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:20:18.153696 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b78c858-04cd-4b2a-9783-9bf3b0380b0a None admin] RBAC: Authorization granted {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:20:18.155351 dv-cinder-851351-1-smb devstack@keystone.service[479851]: [pid: 479851|app: 0|req: 544/1103] 10.222.0.42 () {56 vars in 1177 bytes} [Thu Jul 28 09:20:18 2022] GET /identity/v3/users/c3fc567a0b1a47be973fe73937223e91 => generated 285 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:20:18.161574 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854b678c-9927-4dda-a457-43a4c203b1a0 None admin] Authenticating user token {{(pid=479852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:20:18.271750 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854b678c-9927-4dda-a457-43a4c203b1a0 None admin] Validating token access rules against request {{(pid=479852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:20:18.308076 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9657243-9d92-49e8-bb85-351e5e04daed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:20:18.308820 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9657243-9d92-49e8-bb85-351e5e04daed None admin] REQUEST_METHOD: `GET` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:20:18.309103 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9657243-9d92-49e8-bb85-351e5e04daed None admin] SCRIPT_NAME: `/identity` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:20:18.309380 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9657243-9d92-49e8-bb85-351e5e04daed None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:20:18.337314 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG dbcounter [-] [479852] Writing DB stats keystone:SELECT=100 {{(pid=479852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:20:18.381525 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9657243-9d92-49e8-bb85-351e5e04daed None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:20:18.383329 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9657243-9d92-49e8-bb85-351e5e04daed None admin] RBAC: Authorization granted {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:20:18.483433 dv-cinder-851351-1-smb devstack@keystone.service[479852]: [pid: 479852|app: 0|req: 560/1104] 10.222.0.42 () {58 vars in 1282 bytes} [Thu Jul 28 09:20:18 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 28 09:20:18.489385 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b78c858-04cd-4b2a-9783-9bf3b0380b0a None admin] Authenticating user token {{(pid=479851) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:20:18.597464 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b78c858-04cd-4b2a-9783-9bf3b0380b0a None admin] Validating token access rules against request {{(pid=479851) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:20:18.619844 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG dbcounter [-] [479851] Writing DB stats keystone:SELECT=100 {{(pid=479851) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:20:18.636571 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62653431-aec1-42a4-82b1-8d309fd14d94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479851) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:20:18.637275 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62653431-aec1-42a4-82b1-8d309fd14d94 None admin] REQUEST_METHOD: `GET` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:20:18.637554 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62653431-aec1-42a4-82b1-8d309fd14d94 None admin] SCRIPT_NAME: `/identity` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:20:18.637828 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62653431-aec1-42a4-82b1-8d309fd14d94 None admin] PATH_INFO: `/v3/projects/7d20987a30d8467882bb453ffb442bf3` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:20:18.639016 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62653431-aec1-42a4-82b1-8d309fd14d94 None admin] RBAC: Authorizing `identity:get_project(project_id=7d20987a30d8467882bb453ffb442bf3)` {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:20:18.640467 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62653431-aec1-42a4-82b1-8d309fd14d94 None admin] RBAC: Authorization granted {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:20:18.642377 dv-cinder-851351-1-smb devstack@keystone.service[479851]: [pid: 479851|app: 0|req: 545/1105] 10.222.0.42 () {56 vars in 1186 bytes} [Thu Jul 28 09:20:18 2022] GET /identity/v3/projects/7d20987a30d8467882bb453ffb442bf3 => generated 311 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:20:18.648526 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9657243-9d92-49e8-bb85-351e5e04daed None admin] Authenticating user token {{(pid=479852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:20:18.709971 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG dbcounter [-] [479852] Writing DB stats keystone:SELECT=100 {{(pid=479852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:20:18.753232 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9657243-9d92-49e8-bb85-351e5e04daed None admin] Validating token access rules against request {{(pid=479852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:20:18.787619 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d164ff3-76db-4d2a-a2e0-596873a3b7e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:20:18.788303 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d164ff3-76db-4d2a-a2e0-596873a3b7e1 None admin] REQUEST_METHOD: `GET` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:20:18.788510 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d164ff3-76db-4d2a-a2e0-596873a3b7e1 None admin] SCRIPT_NAME: `/identity` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:20:18.788825 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d164ff3-76db-4d2a-a2e0-596873a3b7e1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:20:18.789628 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d164ff3-76db-4d2a-a2e0-596873a3b7e1 None admin] RBAC: Adding query filter params (role.id=685084310b35477b9b2d0c7934d0f803, scope.project.id=7d20987a30d8467882bb453ffb442bf3, user.id=c3fc567a0b1a47be973fe73937223e91) {{(pid=479852) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 09:20:18.789932 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d164ff3-76db-4d2a-a2e0-596873a3b7e1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:20:18.791364 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d164ff3-76db-4d2a-a2e0-596873a3b7e1 None admin] RBAC: Authorization granted {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:20:18.797315 dv-cinder-851351-1-smb devstack@keystone.service[479852]: [pid: 479852|app: 0|req: 561/1106] 10.222.0.42 () {56 vars in 1374 bytes} [Thu Jul 28 09:20:18 2022] GET /identity/v3/role_assignments?user.id=c3fc567a0b1a47be973fe73937223e91&scope.project.id=7d20987a30d8467882bb453ffb442bf3&role.id=685084310b35477b9b2d0c7934d0f803 => generated 608 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:20:20.832579 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71620d6f-5630-4689-a309-4b9113033ecd None None] REQUEST_METHOD: `GET` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:20:20.833196 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71620d6f-5630-4689-a309-4b9113033ecd None None] SCRIPT_NAME: `/identity` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:20:20.833196 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71620d6f-5630-4689-a309-4b9113033ecd None None] PATH_INFO: `/` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:20:20.834558 dv-cinder-851351-1-smb devstack@keystone.service[479851]: [pid: 479851|app: 0|req: 546/1107] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 09:20:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 09:20:20.839980 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365cfd8a-ce15-4663-9c31-8034b3f31450 None None] REQUEST_METHOD: `POST` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:20:20.840497 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365cfd8a-ce15-4663-9c31-8034b3f31450 None None] SCRIPT_NAME: `/identity` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:20:20.840497 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365cfd8a-ce15-4663-9c31-8034b3f31450 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:20:20.860294 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.auth.core [None req-365cfd8a-ce15-4663-9c31-8034b3f31450 None None] MFA Rules not processed for user `c198f91a4ae84d2b9cc730a6e304c2be`. Rule list: `[]` (Enabled: `True`). {{(pid=479852) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 09:20:20.861543 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.fernet_utils [None req-365cfd8a-ce15-4663-9c31-8034b3f31450 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=479852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 09:20:20.933774 dv-cinder-851351-1-smb devstack@keystone.service[479852]: [pid: 479852|app: 0|req: 562/1108] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 09:20:20 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 09:20:20.959391 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71620d6f-5630-4689-a309-4b9113033ecd None None] Authenticating user token {{(pid=479851) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:20:21.076209 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71620d6f-5630-4689-a309-4b9113033ecd None None] Validating token access rules against request {{(pid=479851) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:20:21.112432 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a33536d8-aca1-473a-a21d-83bf17712108 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479851) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:20:21.113023 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33536d8-aca1-473a-a21d-83bf17712108 None admin] REQUEST_METHOD: `GET` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:20:21.113385 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33536d8-aca1-473a-a21d-83bf17712108 None admin] SCRIPT_NAME: `/identity` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:20:21.113669 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33536d8-aca1-473a-a21d-83bf17712108 None admin] PATH_INFO: `/v3/domains/default` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:20:21.114909 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a33536d8-aca1-473a-a21d-83bf17712108 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:20:21.116377 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a33536d8-aca1-473a-a21d-83bf17712108 None admin] RBAC: Authorization granted {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:20:21.118123 dv-cinder-851351-1-smb devstack@keystone.service[479851]: [pid: 479851|app: 0|req: 547/1109] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 09:20:20 2022] GET /identity/v3/domains/default => generated 199 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:20:21.124292 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-365cfd8a-ce15-4663-9c31-8034b3f31450 None None] Authenticating user token {{(pid=479852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:20:21.180912 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG dbcounter [-] [479852] Writing DB stats keystone:SELECT=100 {{(pid=479852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:20:21.231440 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-365cfd8a-ce15-4663-9c31-8034b3f31450 None None] Validating token access rules against request {{(pid=479852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:20:21.266808 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b51128-dad7-46b8-b730-87377e982b8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:20:21.267464 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b51128-dad7-46b8-b730-87377e982b8c None admin] REQUEST_METHOD: `POST` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:20:21.267741 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b51128-dad7-46b8-b730-87377e982b8c None admin] SCRIPT_NAME: `/identity` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:20:21.268014 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b51128-dad7-46b8-b730-87377e982b8c None admin] PATH_INFO: `/v3/users` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:20:21.268710 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49b51128-dad7-46b8-b730-87377e982b8c None admin] RBAC: Authorizing `identity:create_user()` {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:20:21.270216 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49b51128-dad7-46b8-b730-87377e982b8c None admin] RBAC: Authorization granted {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:20:21.292297 dv-cinder-851351-1-smb devstack@keystone.service[479852]: [pid: 479852|app: 0|req: 563/1110] 10.222.0.42 () {60 vars in 1132 bytes} [Thu Jul 28 09:20:21 2022] POST /identity/v3/users => generated 286 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 09:20:23.325731 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2dc048f-0367-44e3-9326-089cdba34d96 None None] REQUEST_METHOD: `GET` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:20:23.326361 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2dc048f-0367-44e3-9326-089cdba34d96 None None] SCRIPT_NAME: `/identity` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:20:23.326361 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2dc048f-0367-44e3-9326-089cdba34d96 None None] PATH_INFO: `/` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:20:23.327663 dv-cinder-851351-1-smb devstack@keystone.service[479851]: [pid: 479851|app: 0|req: 548/1111] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 09:20:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 09:20:23.333599 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf292209-aa56-46da-9c0a-cb718b77f005 None None] REQUEST_METHOD: `POST` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:20:23.334137 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf292209-aa56-46da-9c0a-cb718b77f005 None None] SCRIPT_NAME: `/identity` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:20:23.334255 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf292209-aa56-46da-9c0a-cb718b77f005 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:20:23.354555 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.auth.core [None req-cf292209-aa56-46da-9c0a-cb718b77f005 None None] MFA Rules not processed for user `c198f91a4ae84d2b9cc730a6e304c2be`. Rule list: `[]` (Enabled: `True`). {{(pid=479852) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 09:20:23.355771 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.fernet_utils [None req-cf292209-aa56-46da-9c0a-cb718b77f005 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=479852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 09:20:23.434470 dv-cinder-851351-1-smb devstack@keystone.service[479852]: [pid: 479852|app: 0|req: 564/1112] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 09:20:23 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 28 09:20:23.458605 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2dc048f-0367-44e3-9326-089cdba34d96 None None] Authenticating user token {{(pid=479851) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:20:23.523228 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG dbcounter [-] [479851] Writing DB stats keystone:SELECT=100 {{(pid=479851) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:20:23.574978 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2dc048f-0367-44e3-9326-089cdba34d96 None None] Validating token access rules against request {{(pid=479851) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:20:23.611555 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5cfab6f-de0f-4f25-8322-ca0e85541ab2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479851) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:20:23.612124 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5cfab6f-de0f-4f25-8322-ca0e85541ab2 None admin] REQUEST_METHOD: `GET` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:20:23.612405 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5cfab6f-de0f-4f25-8322-ca0e85541ab2 None admin] SCRIPT_NAME: `/identity` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:20:23.612711 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5cfab6f-de0f-4f25-8322-ca0e85541ab2 None admin] PATH_INFO: `/v3/roles/acf1d2de5e5448beb6363dae3d154a02` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:20:23.614321 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5cfab6f-de0f-4f25-8322-ca0e85541ab2 None admin] RBAC: Authorizing `identity:get_role(role_id=acf1d2de5e5448beb6363dae3d154a02)` {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:20:23.615718 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5cfab6f-de0f-4f25-8322-ca0e85541ab2 None admin] RBAC: Authorization granted {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:20:23.617174 dv-cinder-851351-1-smb devstack@keystone.service[479851]: [pid: 479851|app: 0|req: 549/1113] 10.222.0.42 () {56 vars in 1177 bytes} [Thu Jul 28 09:20:23 2022] GET /identity/v3/roles/acf1d2de5e5448beb6363dae3d154a02 => generated 223 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:20:23.623433 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf292209-aa56-46da-9c0a-cb718b77f005 None None] Authenticating user token {{(pid=479852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:20:23.664190 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG dbcounter [-] [479852] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=479852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:20:23.728010 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf292209-aa56-46da-9c0a-cb718b77f005 None None] Validating token access rules against request {{(pid=479852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:20:23.765465 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538a6b79-9dd3-4fff-98a8-bb21768f3201 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:20:23.766130 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538a6b79-9dd3-4fff-98a8-bb21768f3201 None admin] REQUEST_METHOD: `GET` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:20:23.766412 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538a6b79-9dd3-4fff-98a8-bb21768f3201 None admin] SCRIPT_NAME: `/identity` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:20:23.766687 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538a6b79-9dd3-4fff-98a8-bb21768f3201 None admin] PATH_INFO: `/v3/users/0e12100381a249e59e1b59e01c444f0f` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:20:23.781459 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-538a6b79-9dd3-4fff-98a8-bb21768f3201 None admin] RBAC: Authorizing `identity:get_user(user_id=0e12100381a249e59e1b59e01c444f0f)` {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:20:23.782924 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-538a6b79-9dd3-4fff-98a8-bb21768f3201 None admin] RBAC: Authorization granted {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:20:23.784632 dv-cinder-851351-1-smb devstack@keystone.service[479852]: [pid: 479852|app: 0|req: 565/1114] 10.222.0.42 () {56 vars in 1177 bytes} [Thu Jul 28 09:20:23 2022] GET /identity/v3/users/0e12100381a249e59e1b59e01c444f0f => generated 286 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:20:23.791007 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5cfab6f-de0f-4f25-8322-ca0e85541ab2 None admin] Authenticating user token {{(pid=479851) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:20:23.902564 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5cfab6f-de0f-4f25-8322-ca0e85541ab2 None admin] Validating token access rules against request {{(pid=479851) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:20:23.926938 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG dbcounter [-] [479851] Writing DB stats keystone:SELECT=100 {{(pid=479851) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:20:23.939076 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df30fee6-233d-4a80-8f7f-5aec0c789b26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479851) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:20:23.939715 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df30fee6-233d-4a80-8f7f-5aec0c789b26 None admin] REQUEST_METHOD: `GET` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:20:23.940003 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df30fee6-233d-4a80-8f7f-5aec0c789b26 None admin] SCRIPT_NAME: `/identity` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:20:23.940283 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df30fee6-233d-4a80-8f7f-5aec0c789b26 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:20:24.016236 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df30fee6-233d-4a80-8f7f-5aec0c789b26 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:20:24.017770 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df30fee6-233d-4a80-8f7f-5aec0c789b26 None admin] RBAC: Authorization granted {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:20:24.121598 dv-cinder-851351-1-smb devstack@keystone.service[479851]: [pid: 479851|app: 0|req: 550/1115] 10.222.0.42 () {58 vars in 1282 bytes} [Thu Jul 28 09:20:23 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 28 09:20:24.127880 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538a6b79-9dd3-4fff-98a8-bb21768f3201 None admin] Authenticating user token {{(pid=479852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:20:24.226644 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG dbcounter [-] [479852] Writing DB stats keystone:SELECT=100 {{(pid=479852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:20:24.233495 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538a6b79-9dd3-4fff-98a8-bb21768f3201 None admin] Validating token access rules against request {{(pid=479852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:20:24.269484 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-600ea335-a945-4c2a-be35-47cb953fd3be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:20:24.270153 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600ea335-a945-4c2a-be35-47cb953fd3be None admin] REQUEST_METHOD: `GET` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:20:24.270440 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600ea335-a945-4c2a-be35-47cb953fd3be None admin] SCRIPT_NAME: `/identity` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:20:24.270722 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600ea335-a945-4c2a-be35-47cb953fd3be None admin] PATH_INFO: `/v3/projects/7d20987a30d8467882bb453ffb442bf3` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:20:24.271931 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-600ea335-a945-4c2a-be35-47cb953fd3be None admin] RBAC: Authorizing `identity:get_project(project_id=7d20987a30d8467882bb453ffb442bf3)` {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:20:24.273431 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-600ea335-a945-4c2a-be35-47cb953fd3be None admin] RBAC: Authorization granted {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:20:24.275138 dv-cinder-851351-1-smb devstack@keystone.service[479852]: [pid: 479852|app: 0|req: 566/1116] 10.222.0.42 () {56 vars in 1186 bytes} [Thu Jul 28 09:20:24 2022] GET /identity/v3/projects/7d20987a30d8467882bb453ffb442bf3 => generated 311 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:20:24.281609 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df30fee6-233d-4a80-8f7f-5aec0c789b26 None admin] Authenticating user token {{(pid=479851) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:20:24.308184 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG dbcounter [-] [479851] Writing DB stats keystone:SELECT=100 {{(pid=479851) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:20:24.387795 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df30fee6-233d-4a80-8f7f-5aec0c789b26 None admin] Validating token access rules against request {{(pid=479851) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:20:24.423991 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7fb7ccd-b879-4c50-83d5-2b4ea68df622 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479851) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:20:24.424623 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7fb7ccd-b879-4c50-83d5-2b4ea68df622 None admin] REQUEST_METHOD: `GET` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:20:24.424947 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7fb7ccd-b879-4c50-83d5-2b4ea68df622 None admin] SCRIPT_NAME: `/identity` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:20:24.425225 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7fb7ccd-b879-4c50-83d5-2b4ea68df622 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:20:24.426101 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7fb7ccd-b879-4c50-83d5-2b4ea68df622 None admin] RBAC: Adding query filter params (role.id=acf1d2de5e5448beb6363dae3d154a02, scope.project.id=7d20987a30d8467882bb453ffb442bf3, user.id=0e12100381a249e59e1b59e01c444f0f) {{(pid=479851) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 09:20:24.426418 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7fb7ccd-b879-4c50-83d5-2b4ea68df622 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:20:24.427874 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7fb7ccd-b879-4c50-83d5-2b4ea68df622 None admin] RBAC: Authorization granted {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:20:24.433588 dv-cinder-851351-1-smb devstack@keystone.service[479851]: [pid: 479851|app: 0|req: 551/1117] 10.222.0.42 () {56 vars in 1374 bytes} [Thu Jul 28 09:20:24 2022] GET /identity/v3/role_assignments?user.id=0e12100381a249e59e1b59e01c444f0f&scope.project.id=7d20987a30d8467882bb453ffb442bf3&role.id=acf1d2de5e5448beb6363dae3d154a02 => generated 259 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:20:26.407346 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23909c0-0efe-47bd-9f2a-064badf95c2e None None] REQUEST_METHOD: `GET` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:20:26.407888 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23909c0-0efe-47bd-9f2a-064badf95c2e None None] SCRIPT_NAME: `/identity` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:20:26.407888 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23909c0-0efe-47bd-9f2a-064badf95c2e None None] PATH_INFO: `/` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:20:26.409312 dv-cinder-851351-1-smb devstack@keystone.service[479852]: [pid: 479852|app: 0|req: 567/1118] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 09:20:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 09:20:26.414644 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0de2cb4-6a5c-475d-9754-e2d6647d0496 None None] REQUEST_METHOD: `POST` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:20:26.415112 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0de2cb4-6a5c-475d-9754-e2d6647d0496 None None] SCRIPT_NAME: `/identity` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:20:26.415227 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0de2cb4-6a5c-475d-9754-e2d6647d0496 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:20:26.433903 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.auth.core [None req-a0de2cb4-6a5c-475d-9754-e2d6647d0496 None None] MFA Rules not processed for user `c198f91a4ae84d2b9cc730a6e304c2be`. Rule list: `[]` (Enabled: `True`). {{(pid=479851) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 09:20:26.435105 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.fernet_utils [None req-a0de2cb4-6a5c-475d-9754-e2d6647d0496 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=479851) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 09:20:26.504508 dv-cinder-851351-1-smb devstack@keystone.service[479851]: [pid: 479851|app: 0|req: 552/1119] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 09:20:26 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 09:20:26.526530 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f23909c0-0efe-47bd-9f2a-064badf95c2e None None] Authenticating user token {{(pid=479852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:20:26.633391 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f23909c0-0efe-47bd-9f2a-064badf95c2e None None] Validating token access rules against request {{(pid=479852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:20:26.670306 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135f6b9f-48bd-4ddd-8c0d-dc9d380047d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:20:26.670882 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135f6b9f-48bd-4ddd-8c0d-dc9d380047d4 None admin] REQUEST_METHOD: `GET` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:20:26.671150 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135f6b9f-48bd-4ddd-8c0d-dc9d380047d4 None admin] SCRIPT_NAME: `/identity` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:20:26.671426 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135f6b9f-48bd-4ddd-8c0d-dc9d380047d4 None admin] PATH_INFO: `/v3/roles/acf1d2de5e5448beb6363dae3d154a02` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:20:26.672963 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-135f6b9f-48bd-4ddd-8c0d-dc9d380047d4 None admin] RBAC: Authorizing `identity:get_role(role_id=acf1d2de5e5448beb6363dae3d154a02)` {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:20:26.674344 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-135f6b9f-48bd-4ddd-8c0d-dc9d380047d4 None admin] RBAC: Authorization granted {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:20:26.675828 dv-cinder-851351-1-smb devstack@keystone.service[479852]: [pid: 479852|app: 0|req: 568/1120] 10.222.0.42 () {56 vars in 1177 bytes} [Thu Jul 28 09:20:26 2022] GET /identity/v3/roles/acf1d2de5e5448beb6363dae3d154a02 => generated 223 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:20:26.682273 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0de2cb4-6a5c-475d-9754-e2d6647d0496 None None] Authenticating user token {{(pid=479851) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:20:26.703145 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG dbcounter [-] [479851] Writing DB stats keystone:SELECT=100 {{(pid=479851) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:20:26.795233 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0de2cb4-6a5c-475d-9754-e2d6647d0496 None None] Validating token access rules against request {{(pid=479851) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:20:26.833016 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4546ae-3f99-4f5b-8f45-983e9e2a0443 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479851) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:20:26.833688 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4546ae-3f99-4f5b-8f45-983e9e2a0443 None admin] REQUEST_METHOD: `GET` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:20:26.833982 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4546ae-3f99-4f5b-8f45-983e9e2a0443 None admin] SCRIPT_NAME: `/identity` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:20:26.834267 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4546ae-3f99-4f5b-8f45-983e9e2a0443 None admin] PATH_INFO: `/v3/users/0e12100381a249e59e1b59e01c444f0f` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:20:26.835547 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba4546ae-3f99-4f5b-8f45-983e9e2a0443 None admin] RBAC: Authorizing `identity:get_user(user_id=0e12100381a249e59e1b59e01c444f0f)` {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:20:26.837051 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba4546ae-3f99-4f5b-8f45-983e9e2a0443 None admin] RBAC: Authorization granted {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:20:26.838880 dv-cinder-851351-1-smb devstack@keystone.service[479851]: [pid: 479851|app: 0|req: 553/1121] 10.222.0.42 () {56 vars in 1177 bytes} [Thu Jul 28 09:20:26 2022] GET /identity/v3/users/0e12100381a249e59e1b59e01c444f0f => generated 286 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:20:26.845223 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135f6b9f-48bd-4ddd-8c0d-dc9d380047d4 None admin] Authenticating user token {{(pid=479852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:20:26.878232 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG dbcounter [-] [479852] Writing DB stats keystone:SELECT=100 {{(pid=479852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:20:26.950848 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135f6b9f-48bd-4ddd-8c0d-dc9d380047d4 None admin] Validating token access rules against request {{(pid=479852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:20:26.991210 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aedea40d-90e6-42b4-9ba3-ec21ad51bfe9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:20:26.991857 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aedea40d-90e6-42b4-9ba3-ec21ad51bfe9 None admin] REQUEST_METHOD: `GET` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:20:26.992143 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aedea40d-90e6-42b4-9ba3-ec21ad51bfe9 None admin] SCRIPT_NAME: `/identity` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:20:26.992424 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aedea40d-90e6-42b4-9ba3-ec21ad51bfe9 None admin] PATH_INFO: `/v3/projects/7d20987a30d8467882bb453ffb442bf3` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:20:26.993685 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aedea40d-90e6-42b4-9ba3-ec21ad51bfe9 None admin] RBAC: Authorizing `identity:get_project(project_id=7d20987a30d8467882bb453ffb442bf3)` {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:20:26.995134 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aedea40d-90e6-42b4-9ba3-ec21ad51bfe9 None admin] RBAC: Authorization granted {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:20:26.996855 dv-cinder-851351-1-smb devstack@keystone.service[479852]: [pid: 479852|app: 0|req: 569/1122] 10.222.0.42 () {56 vars in 1186 bytes} [Thu Jul 28 09:20:26 2022] GET /identity/v3/projects/7d20987a30d8467882bb453ffb442bf3 => generated 311 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:20:27.003224 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4546ae-3f99-4f5b-8f45-983e9e2a0443 None admin] Authenticating user token {{(pid=479851) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:20:27.093234 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG dbcounter [-] [479851] Writing DB stats keystone:SELECT=100 {{(pid=479851) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:20:27.109831 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4546ae-3f99-4f5b-8f45-983e9e2a0443 None admin] Validating token access rules against request {{(pid=479851) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:20:27.148348 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f49065-654f-4d18-8eb1-1e585ac4ea96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479851) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:20:27.149077 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f49065-654f-4d18-8eb1-1e585ac4ea96 None admin] REQUEST_METHOD: `PUT` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:20:27.149362 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f49065-654f-4d18-8eb1-1e585ac4ea96 None admin] SCRIPT_NAME: `/identity` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:20:27.149640 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f49065-654f-4d18-8eb1-1e585ac4ea96 None admin] PATH_INFO: `/v3/projects/7d20987a30d8467882bb453ffb442bf3/users/0e12100381a249e59e1b59e01c444f0f/roles/acf1d2de5e5448beb6363dae3d154a02` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:20:27.152023 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f49065-654f-4d18-8eb1-1e585ac4ea96 None admin] RBAC: Authorizing `identity:create_grant(project_id=7d20987a30d8467882bb453ffb442bf3, user_id=0e12100381a249e59e1b59e01c444f0f, role_id=acf1d2de5e5448beb6363dae3d154a02)` {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:20:27.153523 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f49065-654f-4d18-8eb1-1e585ac4ea96 None admin] RBAC: Authorization granted {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:20:27.168695 dv-cinder-851351-1-smb devstack@keystone.service[479851]: [pid: 479851|app: 0|req: 554/1123] 10.222.0.42 () {58 vars in 1439 bytes} [Thu Jul 28 09:20:27 2022] PUT /identity/v3/projects/7d20987a30d8467882bb453ffb442bf3/users/0e12100381a249e59e1b59e01c444f0f/roles/acf1d2de5e5448beb6363dae3d154a02 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 09:20:29.188894 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d1ac90-bcbb-4597-9365-b54d9eea78b2 None None] REQUEST_METHOD: `GET` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:20:29.189816 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d1ac90-bcbb-4597-9365-b54d9eea78b2 None None] SCRIPT_NAME: `/identity` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:20:29.189816 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d1ac90-bcbb-4597-9365-b54d9eea78b2 None None] PATH_INFO: `/` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:20:29.191348 dv-cinder-851351-1-smb devstack@keystone.service[479852]: [pid: 479852|app: 0|req: 570/1124] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 09:20:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 09:20:29.197580 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d044e08-e100-4f7a-aa38-d26830c7ec3e None None] REQUEST_METHOD: `POST` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:20:29.198177 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d044e08-e100-4f7a-aa38-d26830c7ec3e None None] SCRIPT_NAME: `/identity` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:20:29.198177 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d044e08-e100-4f7a-aa38-d26830c7ec3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:20:29.217236 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.auth.core [None req-6d044e08-e100-4f7a-aa38-d26830c7ec3e None None] MFA Rules not processed for user `c198f91a4ae84d2b9cc730a6e304c2be`. Rule list: `[]` (Enabled: `True`). {{(pid=479851) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 09:20:29.218518 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.fernet_utils [None req-6d044e08-e100-4f7a-aa38-d26830c7ec3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=479851) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 09:20:29.290864 dv-cinder-851351-1-smb devstack@keystone.service[479851]: [pid: 479851|app: 0|req: 555/1125] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 09:20:29 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 09:20:29.314418 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d1ac90-bcbb-4597-9365-b54d9eea78b2 None None] Authenticating user token {{(pid=479852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:20:29.447926 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG dbcounter [-] [479852] Writing DB stats keystone:SELECT=100 {{(pid=479852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:20:29.452823 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d1ac90-bcbb-4597-9365-b54d9eea78b2 None None] Validating token access rules against request {{(pid=479852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:20:29.494070 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802e3535-bdf9-42c3-9b90-3ae02b04d6f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:20:29.494731 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802e3535-bdf9-42c3-9b90-3ae02b04d6f7 None admin] REQUEST_METHOD: `GET` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:20:29.495016 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802e3535-bdf9-42c3-9b90-3ae02b04d6f7 None admin] SCRIPT_NAME: `/identity` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:20:29.495295 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802e3535-bdf9-42c3-9b90-3ae02b04d6f7 None admin] PATH_INFO: `/v3/roles/acf1d2de5e5448beb6363dae3d154a02` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:20:29.496925 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-802e3535-bdf9-42c3-9b90-3ae02b04d6f7 None admin] RBAC: Authorizing `identity:get_role(role_id=acf1d2de5e5448beb6363dae3d154a02)` {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:20:29.498351 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-802e3535-bdf9-42c3-9b90-3ae02b04d6f7 None admin] RBAC: Authorization granted {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:20:29.500284 dv-cinder-851351-1-smb devstack@keystone.service[479852]: [pid: 479852|app: 0|req: 571/1126] 10.222.0.42 () {56 vars in 1177 bytes} [Thu Jul 28 09:20:29 2022] GET /identity/v3/roles/acf1d2de5e5448beb6363dae3d154a02 => generated 223 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:20:29.506687 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d044e08-e100-4f7a-aa38-d26830c7ec3e None None] Authenticating user token {{(pid=479851) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:20:29.590745 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG dbcounter [-] [479851] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=479851) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:20:29.616273 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d044e08-e100-4f7a-aa38-d26830c7ec3e None None] Validating token access rules against request {{(pid=479851) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:20:29.654026 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68b36a1-351c-4ebe-9202-5858193d31f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479851) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:20:29.654698 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68b36a1-351c-4ebe-9202-5858193d31f7 None admin] REQUEST_METHOD: `GET` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:20:29.654984 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68b36a1-351c-4ebe-9202-5858193d31f7 None admin] SCRIPT_NAME: `/identity` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:20:29.655268 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68b36a1-351c-4ebe-9202-5858193d31f7 None admin] PATH_INFO: `/v3/users/0e12100381a249e59e1b59e01c444f0f` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:20:29.656485 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a68b36a1-351c-4ebe-9202-5858193d31f7 None admin] RBAC: Authorizing `identity:get_user(user_id=0e12100381a249e59e1b59e01c444f0f)` {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:20:29.658030 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a68b36a1-351c-4ebe-9202-5858193d31f7 None admin] RBAC: Authorization granted {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:20:29.659729 dv-cinder-851351-1-smb devstack@keystone.service[479851]: [pid: 479851|app: 0|req: 556/1127] 10.222.0.42 () {56 vars in 1177 bytes} [Thu Jul 28 09:20:29 2022] GET /identity/v3/users/0e12100381a249e59e1b59e01c444f0f => generated 286 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:20:29.668995 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802e3535-bdf9-42c3-9b90-3ae02b04d6f7 None admin] Authenticating user token {{(pid=479852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:20:29.778567 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802e3535-bdf9-42c3-9b90-3ae02b04d6f7 None admin] Validating token access rules against request {{(pid=479852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:20:29.815414 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fedd1154-c783-4eba-8bdc-d4e296828c2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:20:29.816236 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fedd1154-c783-4eba-8bdc-d4e296828c2e None admin] REQUEST_METHOD: `GET` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:20:29.816561 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fedd1154-c783-4eba-8bdc-d4e296828c2e None admin] SCRIPT_NAME: `/identity` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:20:29.816909 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fedd1154-c783-4eba-8bdc-d4e296828c2e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:20:29.854848 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG dbcounter [-] [479852] Writing DB stats keystone:SELECT=100 {{(pid=479852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:20:29.899384 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fedd1154-c783-4eba-8bdc-d4e296828c2e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:20:29.900903 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fedd1154-c783-4eba-8bdc-d4e296828c2e None admin] RBAC: Authorization granted {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:20:30.014239 dv-cinder-851351-1-smb devstack@keystone.service[479852]: [pid: 479852|app: 0|req: 572/1128] 10.222.0.42 () {58 vars in 1282 bytes} [Thu Jul 28 09:20:29 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 346 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 28 09:20:30.020910 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68b36a1-351c-4ebe-9202-5858193d31f7 None admin] Authenticating user token {{(pid=479851) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:20:30.131781 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68b36a1-351c-4ebe-9202-5858193d31f7 None admin] Validating token access rules against request {{(pid=479851) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:20:30.169118 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0d0107-6499-4a2a-a520-64037dd40231 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479851) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:20:30.169882 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0d0107-6499-4a2a-a520-64037dd40231 None admin] REQUEST_METHOD: `GET` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:20:30.170203 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0d0107-6499-4a2a-a520-64037dd40231 None admin] SCRIPT_NAME: `/identity` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:20:30.170524 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0d0107-6499-4a2a-a520-64037dd40231 None admin] PATH_INFO: `/v3/projects/7d20987a30d8467882bb453ffb442bf3` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:20:30.171942 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb0d0107-6499-4a2a-a520-64037dd40231 None admin] RBAC: Authorizing `identity:get_project(project_id=7d20987a30d8467882bb453ffb442bf3)` {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:20:30.173786 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb0d0107-6499-4a2a-a520-64037dd40231 None admin] RBAC: Authorization granted {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:20:30.175775 dv-cinder-851351-1-smb devstack@keystone.service[479851]: [pid: 479851|app: 0|req: 557/1129] 10.222.0.42 () {56 vars in 1186 bytes} [Thu Jul 28 09:20:30 2022] GET /identity/v3/projects/7d20987a30d8467882bb453ffb442bf3 => generated 311 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:20:30.182346 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fedd1154-c783-4eba-8bdc-d4e296828c2e None admin] Authenticating user token {{(pid=479852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:20:30.288464 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG dbcounter [-] [479852] Writing DB stats keystone:SELECT=100 {{(pid=479852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:20:30.338046 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fedd1154-c783-4eba-8bdc-d4e296828c2e None admin] Validating token access rules against request {{(pid=479852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:20:30.381267 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bdf5ff1-5d4e-4f14-89c6-300c546e34eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:20:30.382428 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bdf5ff1-5d4e-4f14-89c6-300c546e34eb None admin] REQUEST_METHOD: `GET` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:20:30.382858 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bdf5ff1-5d4e-4f14-89c6-300c546e34eb None admin] SCRIPT_NAME: `/identity` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:20:30.383394 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bdf5ff1-5d4e-4f14-89c6-300c546e34eb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:20:30.384225 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bdf5ff1-5d4e-4f14-89c6-300c546e34eb None admin] RBAC: Adding query filter params (role.id=acf1d2de5e5448beb6363dae3d154a02, scope.project.id=7d20987a30d8467882bb453ffb442bf3, user.id=0e12100381a249e59e1b59e01c444f0f) {{(pid=479852) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 09:20:30.384543 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bdf5ff1-5d4e-4f14-89c6-300c546e34eb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:20:30.386132 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bdf5ff1-5d4e-4f14-89c6-300c546e34eb None admin] RBAC: Authorization granted {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:20:30.396829 dv-cinder-851351-1-smb devstack@keystone.service[479852]: [pid: 479852|app: 0|req: 573/1130] 10.222.0.42 () {56 vars in 1374 bytes} [Thu Jul 28 09:20:30 2022] GET /identity/v3/role_assignments?user.id=0e12100381a249e59e1b59e01c444f0f&scope.project.id=7d20987a30d8467882bb453ffb442bf3&role.id=acf1d2de5e5448beb6363dae3d154a02 => generated 608 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:20:32.493431 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e1c135-2d2f-4bb1-93e3-259c7554b95a None None] REQUEST_METHOD: `GET` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:20:32.494052 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e1c135-2d2f-4bb1-93e3-259c7554b95a None None] SCRIPT_NAME: `/identity` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:20:32.494052 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e1c135-2d2f-4bb1-93e3-259c7554b95a None None] PATH_INFO: `/` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:20:32.495552 dv-cinder-851351-1-smb devstack@keystone.service[479851]: [pid: 479851|app: 0|req: 558/1131] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 09:20:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 09:20:32.502046 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d433d4ac-1a4f-48f6-8740-c0b71ec72fd8 None None] REQUEST_METHOD: `POST` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:20:32.502908 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d433d4ac-1a4f-48f6-8740-c0b71ec72fd8 None None] SCRIPT_NAME: `/identity` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:20:32.502908 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d433d4ac-1a4f-48f6-8740-c0b71ec72fd8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:20:32.522331 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.auth.core [None req-d433d4ac-1a4f-48f6-8740-c0b71ec72fd8 None None] MFA Rules not processed for user `c198f91a4ae84d2b9cc730a6e304c2be`. Rule list: `[]` (Enabled: `True`). {{(pid=479852) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 09:20:32.523572 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.fernet_utils [None req-d433d4ac-1a4f-48f6-8740-c0b71ec72fd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=479852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 09:20:32.601417 dv-cinder-851351-1-smb devstack@keystone.service[479852]: [pid: 479852|app: 0|req: 574/1132] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 09:20:32 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 09:20:32.627558 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e1c135-2d2f-4bb1-93e3-259c7554b95a None None] Authenticating user token {{(pid=479851) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:20:32.643818 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG dbcounter [-] [479851] Writing DB stats keystone:SELECT=100 {{(pid=479851) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:20:32.735293 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e1c135-2d2f-4bb1-93e3-259c7554b95a None None] Validating token access rules against request {{(pid=479851) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:20:32.784819 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04174df4-a996-4e98-984e-5490e957d3e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479851) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:20:32.785511 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04174df4-a996-4e98-984e-5490e957d3e9 None admin] REQUEST_METHOD: `GET` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:20:32.785794 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04174df4-a996-4e98-984e-5490e957d3e9 None admin] SCRIPT_NAME: `/identity` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:20:32.786069 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04174df4-a996-4e98-984e-5490e957d3e9 None admin] PATH_INFO: `/v3/domains/default` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:20:32.787419 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04174df4-a996-4e98-984e-5490e957d3e9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:20:32.788940 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04174df4-a996-4e98-984e-5490e957d3e9 None admin] RBAC: Authorization granted {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:20:32.790763 dv-cinder-851351-1-smb devstack@keystone.service[479851]: [pid: 479851|app: 0|req: 559/1133] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 09:20:32 2022] GET /identity/v3/domains/default => generated 199 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:20:32.797719 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d433d4ac-1a4f-48f6-8740-c0b71ec72fd8 None None] Authenticating user token {{(pid=479852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:20:32.878533 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG dbcounter [-] [479852] Writing DB stats keystone:SELECT=100 {{(pid=479852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:20:32.936538 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d433d4ac-1a4f-48f6-8740-c0b71ec72fd8 None None] Validating token access rules against request {{(pid=479852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:20:32.993753 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d68fc3-09d5-4001-8ae5-e22d35f68c76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:20:32.994828 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d68fc3-09d5-4001-8ae5-e22d35f68c76 None admin] REQUEST_METHOD: `POST` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:20:32.995338 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d68fc3-09d5-4001-8ae5-e22d35f68c76 None admin] SCRIPT_NAME: `/identity` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:20:32.995839 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d68fc3-09d5-4001-8ae5-e22d35f68c76 None admin] PATH_INFO: `/v3/projects` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:20:32.997180 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11d68fc3-09d5-4001-8ae5-e22d35f68c76 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:20:32.999694 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11d68fc3-09d5-4001-8ae5-e22d35f68c76 None admin] RBAC: Authorization granted {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:20:33.037821 dv-cinder-851351-1-smb devstack@keystone.service[479852]: [pid: 479852|app: 0|req: 575/1134] 10.222.0.42 () {60 vars in 1141 bytes} [Thu Jul 28 09:20:32 2022] POST /identity/v3/projects => generated 311 bytes in 241 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 09:20:35.155553 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27c32fd-ac2a-4722-9abe-4c8bfbabb79a None None] REQUEST_METHOD: `GET` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:20:35.156173 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27c32fd-ac2a-4722-9abe-4c8bfbabb79a None None] SCRIPT_NAME: `/identity` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:20:35.156173 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27c32fd-ac2a-4722-9abe-4c8bfbabb79a None None] PATH_INFO: `/` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:20:35.157615 dv-cinder-851351-1-smb devstack@keystone.service[479851]: [pid: 479851|app: 0|req: 560/1135] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 09:20:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 09:20:35.163416 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9eaec04-5319-4342-861c-e44a3947b048 None None] REQUEST_METHOD: `POST` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:20:35.163961 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9eaec04-5319-4342-861c-e44a3947b048 None None] SCRIPT_NAME: `/identity` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:20:35.163961 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9eaec04-5319-4342-861c-e44a3947b048 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:20:35.182883 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.auth.core [None req-c9eaec04-5319-4342-861c-e44a3947b048 None None] MFA Rules not processed for user `c198f91a4ae84d2b9cc730a6e304c2be`. Rule list: `[]` (Enabled: `True`). {{(pid=479852) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 09:20:35.184125 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.fernet_utils [None req-c9eaec04-5319-4342-861c-e44a3947b048 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=479852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 09:20:35.258442 dv-cinder-851351-1-smb devstack@keystone.service[479852]: [pid: 479852|app: 0|req: 576/1136] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 09:20:35 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 09:20:35.283325 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f27c32fd-ac2a-4722-9abe-4c8bfbabb79a None None] Authenticating user token {{(pid=479851) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:20:35.373445 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG dbcounter [-] [479851] Writing DB stats keystone:SELECT=100 {{(pid=479851) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:20:35.397142 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f27c32fd-ac2a-4722-9abe-4c8bfbabb79a None None] Validating token access rules against request {{(pid=479851) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:20:35.433194 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be8417f8-1165-41bf-9ec0-89c4b01564fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479851) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:20:35.433763 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8417f8-1165-41bf-9ec0-89c4b01564fc None admin] REQUEST_METHOD: `GET` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:20:35.434052 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8417f8-1165-41bf-9ec0-89c4b01564fc None admin] SCRIPT_NAME: `/identity` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:20:35.434323 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8417f8-1165-41bf-9ec0-89c4b01564fc None admin] PATH_INFO: `/v3/domains/default` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:20:35.435530 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be8417f8-1165-41bf-9ec0-89c4b01564fc None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:20:35.437077 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be8417f8-1165-41bf-9ec0-89c4b01564fc None admin] RBAC: Authorization granted {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:20:35.438727 dv-cinder-851351-1-smb devstack@keystone.service[479851]: [pid: 479851|app: 0|req: 561/1137] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 09:20:35 2022] GET /identity/v3/domains/default => generated 199 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:20:35.444843 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9eaec04-5319-4342-861c-e44a3947b048 None None] Authenticating user token {{(pid=479852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:20:35.494870 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG dbcounter [-] [479852] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=479852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:20:35.557467 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9eaec04-5319-4342-861c-e44a3947b048 None None] Validating token access rules against request {{(pid=479852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:20:35.601487 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d47451d-625c-4651-9709-e9c98a3e9876 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:20:35.602414 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d47451d-625c-4651-9709-e9c98a3e9876 None admin] REQUEST_METHOD: `POST` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:20:35.602414 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d47451d-625c-4651-9709-e9c98a3e9876 None admin] SCRIPT_NAME: `/identity` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:20:35.602723 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d47451d-625c-4651-9709-e9c98a3e9876 None admin] PATH_INFO: `/v3/users` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:20:35.603356 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d47451d-625c-4651-9709-e9c98a3e9876 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:20:35.604845 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d47451d-625c-4651-9709-e9c98a3e9876 None admin] RBAC: Authorization granted {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:20:35.628772 dv-cinder-851351-1-smb devstack@keystone.service[479852]: [pid: 479852|app: 0|req: 577/1138] 10.222.0.42 () {60 vars in 1132 bytes} [Thu Jul 28 09:20:35 2022] POST /identity/v3/users => generated 286 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 09:20:37.694109 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211649a8-354b-4e34-b05c-165fa403e3fb None None] REQUEST_METHOD: `GET` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:20:37.694669 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211649a8-354b-4e34-b05c-165fa403e3fb None None] SCRIPT_NAME: `/identity` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:20:37.694669 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211649a8-354b-4e34-b05c-165fa403e3fb None None] PATH_INFO: `/` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:20:37.695945 dv-cinder-851351-1-smb devstack@keystone.service[479851]: [pid: 479851|app: 0|req: 562/1139] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 09:20:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 09:20:37.701659 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44aa6311-1b77-49c6-b9fa-285b1b745395 None None] REQUEST_METHOD: `POST` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:20:37.702117 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44aa6311-1b77-49c6-b9fa-285b1b745395 None None] SCRIPT_NAME: `/identity` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:20:37.702237 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44aa6311-1b77-49c6-b9fa-285b1b745395 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:20:37.722431 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.auth.core [None req-44aa6311-1b77-49c6-b9fa-285b1b745395 None None] MFA Rules not processed for user `c198f91a4ae84d2b9cc730a6e304c2be`. Rule list: `[]` (Enabled: `True`). {{(pid=479852) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 09:20:37.723661 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.fernet_utils [None req-44aa6311-1b77-49c6-b9fa-285b1b745395 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=479852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 09:20:37.798570 dv-cinder-851351-1-smb devstack@keystone.service[479852]: [pid: 479852|app: 0|req: 578/1140] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 09:20:37 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 09:20:37.822686 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211649a8-354b-4e34-b05c-165fa403e3fb None None] Authenticating user token {{(pid=479851) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:20:37.931207 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211649a8-354b-4e34-b05c-165fa403e3fb None None] Validating token access rules against request {{(pid=479851) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:20:37.971185 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357632b4-ff2f-4022-9d70-28088b36d99f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479851) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:20:37.971749 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357632b4-ff2f-4022-9d70-28088b36d99f None admin] REQUEST_METHOD: `GET` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:20:37.972118 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357632b4-ff2f-4022-9d70-28088b36d99f None admin] SCRIPT_NAME: `/identity` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:20:37.972368 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357632b4-ff2f-4022-9d70-28088b36d99f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:20:37.983372 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-357632b4-ff2f-4022-9d70-28088b36d99f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 09:20:37.988453 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application [None req-357632b4-ff2f-4022-9d70-28088b36d99f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 09:20:37.988453 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 09:20:37.988453 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 09:20:37.988453 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 09:20:37.988453 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 09:20:37.988453 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 09:20:37.988453 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 09:20:37.988453 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 09:20:37.988453 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 09:20:37.988453 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 09:20:37.988453 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 09:20:37.988453 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 09:20:37.988453 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 09:20:37.988453 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 09:20:37.988453 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 09:20:37.988453 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 09:20:37.989748 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 09:20:37.989748 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 09:20:37.989748 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 09:20:37.989748 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 09:20:37.989748 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 09:20:37.989748 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 09:20:37.989748 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 09:20:37.989748 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 09:20:37.989748 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 09:20:37.989748 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 09:20:37.989748 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 09:20:37.989748 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application with Lock( Jul 28 09:20:37.989748 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 09:20:37.989748 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return self._enter() Jul 28 09:20:37.989748 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 09:20:37.989748 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 09:20:37.990919 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 09:20:37.990919 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return self.creator() Jul 28 09:20:37.990919 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 09:20:37.990919 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application created_value = creator( Jul 28 09:20:37.990919 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 09:20:37.990919 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 09:20:37.990919 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 09:20:37.990919 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 09:20:37.990919 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 09:20:37.990919 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 09:20:37.990919 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 09:20:37.990919 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application Jul 28 09:20:37.990919 dv-cinder-851351-1-smb devstack@keystone.service[479851]: [pid: 479851|app: 0|req: 563/1141] 10.222.0.42 () {56 vars in 1096 bytes} [Thu Jul 28 09:20:37 2022] GET /identity/v3/roles/admin => generated 83 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 09:20:37.999896 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44aa6311-1b77-49c6-b9fa-285b1b745395 None None] Authenticating user token {{(pid=479852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:20:38.033684 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG dbcounter [-] [479852] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=479852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:20:38.112368 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44aa6311-1b77-49c6-b9fa-285b1b745395 None None] Validating token access rules against request {{(pid=479852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:20:38.147762 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd08c8b0-fc58-4c70-a7e0-991ead59a83e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:20:38.148380 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd08c8b0-fc58-4c70-a7e0-991ead59a83e None admin] REQUEST_METHOD: `GET` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:20:38.148694 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd08c8b0-fc58-4c70-a7e0-991ead59a83e None admin] SCRIPT_NAME: `/identity` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:20:38.148971 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd08c8b0-fc58-4c70-a7e0-991ead59a83e None admin] PATH_INFO: `/v3/roles` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:20:38.149718 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd08c8b0-fc58-4c70-a7e0-991ead59a83e None admin] RBAC: Adding query filter params (name=admin) {{(pid=479852) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 09:20:38.150021 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd08c8b0-fc58-4c70-a7e0-991ead59a83e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:20:38.151388 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd08c8b0-fc58-4c70-a7e0-991ead59a83e None admin] RBAC: Authorization granted {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:20:38.159865 dv-cinder-851351-1-smb devstack@keystone.service[479852]: [pid: 479852|app: 0|req: 579/1142] 10.222.0.42 () {56 vars in 1099 bytes} [Thu Jul 28 09:20:37 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:20:38.165970 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357632b4-ff2f-4022-9d70-28088b36d99f None admin] Authenticating user token {{(pid=479851) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:20:38.177778 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG dbcounter [-] [479851] Writing DB stats keystone:SELECT=100 {{(pid=479851) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:20:38.268954 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357632b4-ff2f-4022-9d70-28088b36d99f None admin] Validating token access rules against request {{(pid=479851) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:20:38.304353 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de58767d-ba90-4e68-aa56-f2f8330cde4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479851) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:20:38.305087 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de58767d-ba90-4e68-aa56-f2f8330cde4c None admin] REQUEST_METHOD: `GET` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:20:38.305375 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de58767d-ba90-4e68-aa56-f2f8330cde4c None admin] SCRIPT_NAME: `/identity` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:20:38.305649 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de58767d-ba90-4e68-aa56-f2f8330cde4c None admin] PATH_INFO: `/v3/users/c7b834171fd743338880d14968fa0adf` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:20:38.321448 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de58767d-ba90-4e68-aa56-f2f8330cde4c None admin] RBAC: Authorizing `identity:get_user(user_id=c7b834171fd743338880d14968fa0adf)` {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:20:38.322921 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de58767d-ba90-4e68-aa56-f2f8330cde4c None admin] RBAC: Authorization granted {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:20:38.324692 dv-cinder-851351-1-smb devstack@keystone.service[479851]: [pid: 479851|app: 0|req: 564/1143] 10.222.0.42 () {56 vars in 1177 bytes} [Thu Jul 28 09:20:38 2022] GET /identity/v3/users/c7b834171fd743338880d14968fa0adf => generated 286 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:20:38.331224 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd08c8b0-fc58-4c70-a7e0-991ead59a83e None admin] Authenticating user token {{(pid=479852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:20:38.437104 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG dbcounter [-] [479852] Writing DB stats keystone:SELECT=100 {{(pid=479852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:20:38.447902 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd08c8b0-fc58-4c70-a7e0-991ead59a83e None admin] Validating token access rules against request {{(pid=479852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:20:38.484079 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb6be1d-3ba1-4e35-b12d-a25b12adf199 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:20:38.484778 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb6be1d-3ba1-4e35-b12d-a25b12adf199 None admin] REQUEST_METHOD: `GET` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:20:38.485058 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb6be1d-3ba1-4e35-b12d-a25b12adf199 None admin] SCRIPT_NAME: `/identity` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:20:38.485328 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb6be1d-3ba1-4e35-b12d-a25b12adf199 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:20:38.559777 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feb6be1d-3ba1-4e35-b12d-a25b12adf199 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:20:38.561190 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feb6be1d-3ba1-4e35-b12d-a25b12adf199 None admin] RBAC: Authorization granted {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:20:38.664624 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG dbcounter [-] [479852] Writing DB stats keystone:SELECT=100 {{(pid=479852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:20:38.677698 dv-cinder-851351-1-smb devstack@keystone.service[479852]: [pid: 479852|app: 0|req: 580/1144] 10.222.0.42 () {58 vars in 1282 bytes} [Thu Jul 28 09:20:38 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 347 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 28 09:20:38.684303 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de58767d-ba90-4e68-aa56-f2f8330cde4c None admin] Authenticating user token {{(pid=479851) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:20:38.757126 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG dbcounter [-] [479851] Writing DB stats keystone:SELECT=100 {{(pid=479851) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:20:38.794873 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de58767d-ba90-4e68-aa56-f2f8330cde4c None admin] Validating token access rules against request {{(pid=479851) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:20:38.834209 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac620f7d-136c-4259-a667-a34285772f37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479851) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:20:38.834971 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac620f7d-136c-4259-a667-a34285772f37 None admin] REQUEST_METHOD: `GET` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:20:38.835269 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac620f7d-136c-4259-a667-a34285772f37 None admin] SCRIPT_NAME: `/identity` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:20:38.835559 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac620f7d-136c-4259-a667-a34285772f37 None admin] PATH_INFO: `/v3/projects/7ea42ae4e099466382a31c2fe739b0c2` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:20:38.836857 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac620f7d-136c-4259-a667-a34285772f37 None admin] RBAC: Authorizing `identity:get_project(project_id=7ea42ae4e099466382a31c2fe739b0c2)` {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:20:38.839037 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac620f7d-136c-4259-a667-a34285772f37 None admin] RBAC: Authorization granted {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:20:38.841228 dv-cinder-851351-1-smb devstack@keystone.service[479851]: [pid: 479851|app: 0|req: 565/1145] 10.222.0.42 () {56 vars in 1186 bytes} [Thu Jul 28 09:20:38 2022] GET /identity/v3/projects/7ea42ae4e099466382a31c2fe739b0c2 => generated 311 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:20:38.850114 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb6be1d-3ba1-4e35-b12d-a25b12adf199 None admin] Authenticating user token {{(pid=479852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:20:38.963662 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb6be1d-3ba1-4e35-b12d-a25b12adf199 None admin] Validating token access rules against request {{(pid=479852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:20:39.000838 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9941c0e0-16ff-4629-9ffe-68e874d477f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:20:39.001466 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9941c0e0-16ff-4629-9ffe-68e874d477f8 None admin] REQUEST_METHOD: `GET` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:20:39.001746 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9941c0e0-16ff-4629-9ffe-68e874d477f8 None admin] SCRIPT_NAME: `/identity` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:20:39.002028 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9941c0e0-16ff-4629-9ffe-68e874d477f8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:20:39.002832 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9941c0e0-16ff-4629-9ffe-68e874d477f8 None admin] RBAC: Adding query filter params (role.id=685084310b35477b9b2d0c7934d0f803, scope.project.id=7ea42ae4e099466382a31c2fe739b0c2, user.id=c7b834171fd743338880d14968fa0adf) {{(pid=479852) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 09:20:39.003143 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9941c0e0-16ff-4629-9ffe-68e874d477f8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:20:39.004654 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9941c0e0-16ff-4629-9ffe-68e874d477f8 None admin] RBAC: Authorization granted {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:20:39.010697 dv-cinder-851351-1-smb devstack@keystone.service[479852]: [pid: 479852|app: 0|req: 581/1146] 10.222.0.42 () {56 vars in 1374 bytes} [Thu Jul 28 09:20:38 2022] GET /identity/v3/role_assignments?user.id=c7b834171fd743338880d14968fa0adf&scope.project.id=7ea42ae4e099466382a31c2fe739b0c2&role.id=685084310b35477b9b2d0c7934d0f803 => generated 259 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:20:40.999643 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c13974-f372-495c-909e-97f358f9b840 None None] REQUEST_METHOD: `GET` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:20:41.000334 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c13974-f372-495c-909e-97f358f9b840 None None] SCRIPT_NAME: `/identity` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:20:41.000334 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c13974-f372-495c-909e-97f358f9b840 None None] PATH_INFO: `/` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:20:41.001693 dv-cinder-851351-1-smb devstack@keystone.service[479851]: [pid: 479851|app: 0|req: 566/1147] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 09:20:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 09:20:41.007417 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60d1fb0-0b05-41c6-8c64-6898569e4fb6 None None] REQUEST_METHOD: `POST` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:20:41.007920 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60d1fb0-0b05-41c6-8c64-6898569e4fb6 None None] SCRIPT_NAME: `/identity` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:20:41.008104 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60d1fb0-0b05-41c6-8c64-6898569e4fb6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:20:41.027873 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.auth.core [None req-a60d1fb0-0b05-41c6-8c64-6898569e4fb6 None None] MFA Rules not processed for user `c198f91a4ae84d2b9cc730a6e304c2be`. Rule list: `[]` (Enabled: `True`). {{(pid=479852) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 09:20:41.029159 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.fernet_utils [None req-a60d1fb0-0b05-41c6-8c64-6898569e4fb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=479852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 09:20:41.085165 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG dbcounter [-] [479852] Writing DB stats keystone:SELECT=100 {{(pid=479852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:20:41.103952 dv-cinder-851351-1-smb devstack@keystone.service[479852]: [pid: 479852|app: 0|req: 582/1148] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 09:20:41 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 09:20:41.126763 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c13974-f372-495c-909e-97f358f9b840 None None] Authenticating user token {{(pid=479851) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:20:41.238913 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c13974-f372-495c-909e-97f358f9b840 None None] Validating token access rules against request {{(pid=479851) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:20:41.275419 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf35f39-da6c-4ee6-91f4-30861d6d09f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479851) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:20:41.276118 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf35f39-da6c-4ee6-91f4-30861d6d09f0 None admin] REQUEST_METHOD: `GET` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:20:41.276503 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf35f39-da6c-4ee6-91f4-30861d6d09f0 None admin] SCRIPT_NAME: `/identity` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:20:41.277035 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf35f39-da6c-4ee6-91f4-30861d6d09f0 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:20:41.279220 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG dbcounter [-] [479851] Writing DB stats keystone:SELECT=100 {{(pid=479851) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:20:41.290106 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdf35f39-da6c-4ee6-91f4-30861d6d09f0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 09:20:41.295100 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application [None req-cdf35f39-da6c-4ee6-91f4-30861d6d09f0 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 09:20:41.295100 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 09:20:41.295100 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 09:20:41.295100 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 09:20:41.295100 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 09:20:41.295100 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 09:20:41.295100 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 09:20:41.295100 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 09:20:41.295100 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 09:20:41.295100 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 09:20:41.295100 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 09:20:41.295100 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 09:20:41.295100 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 09:20:41.295100 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 09:20:41.295100 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 09:20:41.295100 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 09:20:41.297089 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 09:20:41.297089 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 09:20:41.297089 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 09:20:41.297089 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 09:20:41.297089 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 09:20:41.297089 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 09:20:41.297089 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 09:20:41.297089 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 09:20:41.297089 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 09:20:41.297089 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 09:20:41.297089 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 09:20:41.297089 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application with Lock( Jul 28 09:20:41.297089 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 09:20:41.297089 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return self._enter() Jul 28 09:20:41.297089 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 09:20:41.297089 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 09:20:41.298620 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 09:20:41.298620 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return self.creator() Jul 28 09:20:41.298620 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 09:20:41.298620 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application created_value = creator( Jul 28 09:20:41.298620 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 09:20:41.298620 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 09:20:41.298620 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 09:20:41.298620 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 09:20:41.298620 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 09:20:41.298620 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 09:20:41.298620 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 09:20:41.298620 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application Jul 28 09:20:41.298620 dv-cinder-851351-1-smb devstack@keystone.service[479851]: [pid: 479851|app: 0|req: 567/1149] 10.222.0.42 () {56 vars in 1096 bytes} [Thu Jul 28 09:20:41 2022] GET /identity/v3/roles/admin => generated 83 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 09:20:41.306208 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60d1fb0-0b05-41c6-8c64-6898569e4fb6 None None] Authenticating user token {{(pid=479852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:20:41.479841 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60d1fb0-0b05-41c6-8c64-6898569e4fb6 None None] Validating token access rules against request {{(pid=479852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:20:41.541433 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b5a1f5-b3fc-419d-aad1-9b132bc7512a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:20:41.542390 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b5a1f5-b3fc-419d-aad1-9b132bc7512a None admin] REQUEST_METHOD: `GET` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:20:41.542873 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b5a1f5-b3fc-419d-aad1-9b132bc7512a None admin] SCRIPT_NAME: `/identity` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:20:41.543439 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b5a1f5-b3fc-419d-aad1-9b132bc7512a None admin] PATH_INFO: `/v3/roles` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:20:41.544880 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87b5a1f5-b3fc-419d-aad1-9b132bc7512a None admin] RBAC: Adding query filter params (name=admin) {{(pid=479852) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 09:20:41.545440 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87b5a1f5-b3fc-419d-aad1-9b132bc7512a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:20:41.548031 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87b5a1f5-b3fc-419d-aad1-9b132bc7512a None admin] RBAC: Authorization granted {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:20:41.563841 dv-cinder-851351-1-smb devstack@keystone.service[479852]: [pid: 479852|app: 0|req: 583/1150] 10.222.0.42 () {56 vars in 1099 bytes} [Thu Jul 28 09:20:41 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:20:41.570211 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf35f39-da6c-4ee6-91f4-30861d6d09f0 None admin] Authenticating user token {{(pid=479851) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:20:41.680601 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf35f39-da6c-4ee6-91f4-30861d6d09f0 None admin] Validating token access rules against request {{(pid=479851) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:20:41.718237 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be3f4900-a240-4a60-ad2e-ad8b6228b818 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479851) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:20:41.718978 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3f4900-a240-4a60-ad2e-ad8b6228b818 None admin] REQUEST_METHOD: `GET` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:20:41.719411 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3f4900-a240-4a60-ad2e-ad8b6228b818 None admin] SCRIPT_NAME: `/identity` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:20:41.719736 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3f4900-a240-4a60-ad2e-ad8b6228b818 None admin] PATH_INFO: `/v3/users/c7b834171fd743338880d14968fa0adf` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:20:41.721059 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be3f4900-a240-4a60-ad2e-ad8b6228b818 None admin] RBAC: Authorizing `identity:get_user(user_id=c7b834171fd743338880d14968fa0adf)` {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:20:41.722697 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be3f4900-a240-4a60-ad2e-ad8b6228b818 None admin] RBAC: Authorization granted {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:20:41.724580 dv-cinder-851351-1-smb devstack@keystone.service[479851]: [pid: 479851|app: 0|req: 568/1151] 10.222.0.42 () {56 vars in 1177 bytes} [Thu Jul 28 09:20:41 2022] GET /identity/v3/users/c7b834171fd743338880d14968fa0adf => generated 286 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:20:41.730923 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b5a1f5-b3fc-419d-aad1-9b132bc7512a None admin] Authenticating user token {{(pid=479852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:20:41.785219 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG dbcounter [-] [479852] Writing DB stats keystone:SELECT=100 {{(pid=479852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:20:41.842995 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b5a1f5-b3fc-419d-aad1-9b132bc7512a None admin] Validating token access rules against request {{(pid=479852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:20:41.888296 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbcde68e-33c3-4841-a0b3-1e8e76fb76d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:20:41.889468 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbcde68e-33c3-4841-a0b3-1e8e76fb76d7 None admin] REQUEST_METHOD: `GET` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:20:41.889976 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbcde68e-33c3-4841-a0b3-1e8e76fb76d7 None admin] SCRIPT_NAME: `/identity` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:20:41.890355 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbcde68e-33c3-4841-a0b3-1e8e76fb76d7 None admin] PATH_INFO: `/v3/projects/7ea42ae4e099466382a31c2fe739b0c2` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:20:41.892897 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbcde68e-33c3-4841-a0b3-1e8e76fb76d7 None admin] RBAC: Authorizing `identity:get_project(project_id=7ea42ae4e099466382a31c2fe739b0c2)` {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:20:41.894997 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbcde68e-33c3-4841-a0b3-1e8e76fb76d7 None admin] RBAC: Authorization granted {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:20:41.896840 dv-cinder-851351-1-smb devstack@keystone.service[479852]: [pid: 479852|app: 0|req: 584/1152] 10.222.0.42 () {56 vars in 1186 bytes} [Thu Jul 28 09:20:41 2022] GET /identity/v3/projects/7ea42ae4e099466382a31c2fe739b0c2 => generated 311 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:20:41.903536 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be3f4900-a240-4a60-ad2e-ad8b6228b818 None admin] Authenticating user token {{(pid=479851) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:20:41.972687 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG dbcounter [-] [479851] Writing DB stats keystone:SELECT=100 {{(pid=479851) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:20:42.015599 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be3f4900-a240-4a60-ad2e-ad8b6228b818 None admin] Validating token access rules against request {{(pid=479851) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:20:42.054276 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a67f37b-7027-40e4-b58b-896b749e99a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479851) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:20:42.054970 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a67f37b-7027-40e4-b58b-896b749e99a2 None admin] REQUEST_METHOD: `PUT` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:20:42.055264 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a67f37b-7027-40e4-b58b-896b749e99a2 None admin] SCRIPT_NAME: `/identity` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:20:42.055539 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a67f37b-7027-40e4-b58b-896b749e99a2 None admin] PATH_INFO: `/v3/projects/7ea42ae4e099466382a31c2fe739b0c2/users/c7b834171fd743338880d14968fa0adf/roles/685084310b35477b9b2d0c7934d0f803` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:20:42.057644 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a67f37b-7027-40e4-b58b-896b749e99a2 None admin] RBAC: Authorizing `identity:create_grant(project_id=7ea42ae4e099466382a31c2fe739b0c2, user_id=c7b834171fd743338880d14968fa0adf, role_id=685084310b35477b9b2d0c7934d0f803)` {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:20:42.059106 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a67f37b-7027-40e4-b58b-896b749e99a2 None admin] RBAC: Authorization granted {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:20:42.074840 dv-cinder-851351-1-smb devstack@keystone.service[479851]: [pid: 479851|app: 0|req: 569/1153] 10.222.0.42 () {58 vars in 1439 bytes} [Thu Jul 28 09:20:41 2022] PUT /identity/v3/projects/7ea42ae4e099466382a31c2fe739b0c2/users/c7b834171fd743338880d14968fa0adf/roles/685084310b35477b9b2d0c7934d0f803 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 09:20:44.103868 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2854e93-4fa1-4058-a335-3f5acd9012fe None None] REQUEST_METHOD: `GET` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:20:44.104492 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2854e93-4fa1-4058-a335-3f5acd9012fe None None] SCRIPT_NAME: `/identity` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:20:44.104492 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2854e93-4fa1-4058-a335-3f5acd9012fe None None] PATH_INFO: `/` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:20:44.106221 dv-cinder-851351-1-smb devstack@keystone.service[479852]: [pid: 479852|app: 0|req: 585/1154] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 09:20:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 09:20:44.112833 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf0199e-9747-447c-9123-5a1ca6cc5bd8 None None] REQUEST_METHOD: `POST` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:20:44.113478 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf0199e-9747-447c-9123-5a1ca6cc5bd8 None None] SCRIPT_NAME: `/identity` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:20:44.113478 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf0199e-9747-447c-9123-5a1ca6cc5bd8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:20:44.133511 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.auth.core [None req-2cf0199e-9747-447c-9123-5a1ca6cc5bd8 None None] MFA Rules not processed for user `c198f91a4ae84d2b9cc730a6e304c2be`. Rule list: `[]` (Enabled: `True`). {{(pid=479851) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 09:20:44.134769 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.fernet_utils [None req-2cf0199e-9747-447c-9123-5a1ca6cc5bd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=479851) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 09:20:44.214947 dv-cinder-851351-1-smb devstack@keystone.service[479851]: [pid: 479851|app: 0|req: 570/1155] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 09:20:44 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 28 09:20:44.238711 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2854e93-4fa1-4058-a335-3f5acd9012fe None None] Authenticating user token {{(pid=479852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:20:44.358259 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2854e93-4fa1-4058-a335-3f5acd9012fe None None] Validating token access rules against request {{(pid=479852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:20:44.387760 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG dbcounter [-] [479852] Writing DB stats keystone:SELECT=100 {{(pid=479852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:20:44.408257 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd596f56-2059-4b24-b37f-8648f22c382e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:20:44.408999 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd596f56-2059-4b24-b37f-8648f22c382e None admin] REQUEST_METHOD: `GET` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:20:44.411054 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd596f56-2059-4b24-b37f-8648f22c382e None admin] SCRIPT_NAME: `/identity` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:20:44.411054 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd596f56-2059-4b24-b37f-8648f22c382e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:20:44.422721 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd596f56-2059-4b24-b37f-8648f22c382e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 09:20:44.427904 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application [None req-dd596f56-2059-4b24-b37f-8648f22c382e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 09:20:44.427904 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 09:20:44.427904 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 09:20:44.427904 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 09:20:44.427904 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 09:20:44.427904 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 09:20:44.427904 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 09:20:44.427904 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 09:20:44.427904 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 09:20:44.427904 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 09:20:44.427904 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 09:20:44.427904 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 09:20:44.427904 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 09:20:44.427904 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 09:20:44.427904 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 09:20:44.427904 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 09:20:44.430195 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 09:20:44.430195 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 09:20:44.430195 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 09:20:44.430195 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 09:20:44.430195 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 09:20:44.430195 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 09:20:44.430195 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 09:20:44.430195 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 09:20:44.430195 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 09:20:44.430195 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 09:20:44.430195 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 09:20:44.430195 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application with Lock( Jul 28 09:20:44.430195 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 09:20:44.430195 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self._enter() Jul 28 09:20:44.430195 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 09:20:44.430195 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 09:20:44.431977 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 09:20:44.431977 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self.creator() Jul 28 09:20:44.431977 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 09:20:44.431977 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application created_value = creator( Jul 28 09:20:44.431977 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 09:20:44.431977 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 09:20:44.431977 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 09:20:44.431977 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 09:20:44.431977 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 09:20:44.431977 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 09:20:44.431977 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 09:20:44.431977 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application Jul 28 09:20:44.431977 dv-cinder-851351-1-smb devstack@keystone.service[479852]: [pid: 479852|app: 0|req: 586/1156] 10.222.0.42 () {56 vars in 1096 bytes} [Thu Jul 28 09:20:44 2022] GET /identity/v3/roles/admin => generated 83 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 09:20:44.439270 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf0199e-9747-447c-9123-5a1ca6cc5bd8 None None] Authenticating user token {{(pid=479851) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:20:44.498287 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG dbcounter [-] [479851] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=479851) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:20:44.553943 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf0199e-9747-447c-9123-5a1ca6cc5bd8 None None] Validating token access rules against request {{(pid=479851) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:20:44.594010 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a12a95-4cb2-4587-a417-e147820fae36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479851) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:20:44.594667 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a12a95-4cb2-4587-a417-e147820fae36 None admin] REQUEST_METHOD: `GET` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:20:44.594953 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a12a95-4cb2-4587-a417-e147820fae36 None admin] SCRIPT_NAME: `/identity` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:20:44.595229 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a12a95-4cb2-4587-a417-e147820fae36 None admin] PATH_INFO: `/v3/roles` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:20:44.595978 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04a12a95-4cb2-4587-a417-e147820fae36 None admin] RBAC: Adding query filter params (name=admin) {{(pid=479851) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 09:20:44.596287 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04a12a95-4cb2-4587-a417-e147820fae36 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:20:44.597851 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04a12a95-4cb2-4587-a417-e147820fae36 None admin] RBAC: Authorization granted {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:20:44.607694 dv-cinder-851351-1-smb devstack@keystone.service[479851]: [pid: 479851|app: 0|req: 571/1157] 10.222.0.42 () {56 vars in 1099 bytes} [Thu Jul 28 09:20:44 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:20:44.614346 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd596f56-2059-4b24-b37f-8648f22c382e None admin] Authenticating user token {{(pid=479852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:20:44.758483 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd596f56-2059-4b24-b37f-8648f22c382e None admin] Validating token access rules against request {{(pid=479852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:20:44.803932 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7390a274-5e0b-4120-abe1-a3f6c1a072c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:20:44.804641 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7390a274-5e0b-4120-abe1-a3f6c1a072c1 None admin] REQUEST_METHOD: `GET` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:20:44.804967 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7390a274-5e0b-4120-abe1-a3f6c1a072c1 None admin] SCRIPT_NAME: `/identity` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:20:44.805246 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7390a274-5e0b-4120-abe1-a3f6c1a072c1 None admin] PATH_INFO: `/v3/users/c7b834171fd743338880d14968fa0adf` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:20:44.806627 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7390a274-5e0b-4120-abe1-a3f6c1a072c1 None admin] RBAC: Authorizing `identity:get_user(user_id=c7b834171fd743338880d14968fa0adf)` {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:20:44.808140 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7390a274-5e0b-4120-abe1-a3f6c1a072c1 None admin] RBAC: Authorization granted {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:20:44.809908 dv-cinder-851351-1-smb devstack@keystone.service[479852]: [pid: 479852|app: 0|req: 587/1158] 10.222.0.42 () {56 vars in 1177 bytes} [Thu Jul 28 09:20:44 2022] GET /identity/v3/users/c7b834171fd743338880d14968fa0adf => generated 286 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:20:44.816633 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a12a95-4cb2-4587-a417-e147820fae36 None admin] Authenticating user token {{(pid=479851) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:20:44.932523 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a12a95-4cb2-4587-a417-e147820fae36 None admin] Validating token access rules against request {{(pid=479851) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:20:44.948818 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG dbcounter [-] [479851] Writing DB stats keystone:SELECT=100 {{(pid=479851) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:20:44.973032 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7e7674-2ebb-4cb8-8d29-2cb94c1379dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479851) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:20:44.973676 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7e7674-2ebb-4cb8-8d29-2cb94c1379dc None admin] REQUEST_METHOD: `GET` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:20:44.973960 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7e7674-2ebb-4cb8-8d29-2cb94c1379dc None admin] SCRIPT_NAME: `/identity` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:20:44.974236 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7e7674-2ebb-4cb8-8d29-2cb94c1379dc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:20:45.065648 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db7e7674-2ebb-4cb8-8d29-2cb94c1379dc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:20:45.067456 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db7e7674-2ebb-4cb8-8d29-2cb94c1379dc None admin] RBAC: Authorization granted {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:20:45.174424 dv-cinder-851351-1-smb devstack@keystone.service[479851]: [pid: 479851|app: 0|req: 572/1159] 10.222.0.42 () {58 vars in 1282 bytes} [Thu Jul 28 09:20:44 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 358 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 28 09:20:45.181155 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7390a274-5e0b-4120-abe1-a3f6c1a072c1 None admin] Authenticating user token {{(pid=479852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:20:45.234841 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG dbcounter [-] [479852] Writing DB stats keystone:SELECT=100 {{(pid=479852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:20:45.296907 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7390a274-5e0b-4120-abe1-a3f6c1a072c1 None admin] Validating token access rules against request {{(pid=479852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:20:45.337711 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28965dae-9546-4f0a-b506-024e727f4df1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:20:45.338471 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28965dae-9546-4f0a-b506-024e727f4df1 None admin] REQUEST_METHOD: `GET` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:20:45.338799 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28965dae-9546-4f0a-b506-024e727f4df1 None admin] SCRIPT_NAME: `/identity` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:20:45.339120 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28965dae-9546-4f0a-b506-024e727f4df1 None admin] PATH_INFO: `/v3/projects/7ea42ae4e099466382a31c2fe739b0c2` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:20:45.340628 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28965dae-9546-4f0a-b506-024e727f4df1 None admin] RBAC: Authorizing `identity:get_project(project_id=7ea42ae4e099466382a31c2fe739b0c2)` {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:20:45.342254 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28965dae-9546-4f0a-b506-024e727f4df1 None admin] RBAC: Authorization granted {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:20:45.344017 dv-cinder-851351-1-smb devstack@keystone.service[479852]: [pid: 479852|app: 0|req: 588/1160] 10.222.0.42 () {56 vars in 1186 bytes} [Thu Jul 28 09:20:45 2022] GET /identity/v3/projects/7ea42ae4e099466382a31c2fe739b0c2 => generated 311 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:20:45.350867 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7e7674-2ebb-4cb8-8d29-2cb94c1379dc None admin] Authenticating user token {{(pid=479851) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:20:45.368225 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG dbcounter [-] [479851] Writing DB stats keystone:SELECT=100 {{(pid=479851) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:20:45.522228 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7e7674-2ebb-4cb8-8d29-2cb94c1379dc None admin] Validating token access rules against request {{(pid=479851) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:20:45.586514 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5ef125-d3c1-483a-9720-a0730975ce83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479851) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:20:45.587577 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5ef125-d3c1-483a-9720-a0730975ce83 None admin] REQUEST_METHOD: `GET` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:20:45.588073 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5ef125-d3c1-483a-9720-a0730975ce83 None admin] SCRIPT_NAME: `/identity` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:20:45.588560 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5ef125-d3c1-483a-9720-a0730975ce83 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:20:45.590106 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd5ef125-d3c1-483a-9720-a0730975ce83 None admin] RBAC: Adding query filter params (role.id=685084310b35477b9b2d0c7934d0f803, scope.project.id=7ea42ae4e099466382a31c2fe739b0c2, user.id=c7b834171fd743338880d14968fa0adf) {{(pid=479851) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 09:20:45.590652 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd5ef125-d3c1-483a-9720-a0730975ce83 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:20:45.593271 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd5ef125-d3c1-483a-9720-a0730975ce83 None admin] RBAC: Authorization granted {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:20:45.602526 dv-cinder-851351-1-smb devstack@keystone.service[479851]: [pid: 479851|app: 0|req: 573/1161] 10.222.0.42 () {56 vars in 1374 bytes} [Thu Jul 28 09:20:45 2022] GET /identity/v3/role_assignments?user.id=c7b834171fd743338880d14968fa0adf&scope.project.id=7ea42ae4e099466382a31c2fe739b0c2&role.id=685084310b35477b9b2d0c7934d0f803 => generated 608 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:20:47.672376 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17106bf-26c4-4b23-8b5b-f2c448992112 None None] REQUEST_METHOD: `GET` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:20:47.673042 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17106bf-26c4-4b23-8b5b-f2c448992112 None None] SCRIPT_NAME: `/identity` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:20:47.673042 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17106bf-26c4-4b23-8b5b-f2c448992112 None None] PATH_INFO: `/` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:20:47.674439 dv-cinder-851351-1-smb devstack@keystone.service[479852]: [pid: 479852|app: 0|req: 589/1162] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 09:20:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 09:20:47.680827 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e4994d-3e16-421c-a8a5-14188119db3b None None] REQUEST_METHOD: `POST` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:20:47.681537 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e4994d-3e16-421c-a8a5-14188119db3b None None] SCRIPT_NAME: `/identity` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:20:47.681537 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e4994d-3e16-421c-a8a5-14188119db3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:20:47.702287 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.auth.core [None req-61e4994d-3e16-421c-a8a5-14188119db3b None None] MFA Rules not processed for user `c198f91a4ae84d2b9cc730a6e304c2be`. Rule list: `[]` (Enabled: `True`). {{(pid=479851) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 09:20:47.703542 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.fernet_utils [None req-61e4994d-3e16-421c-a8a5-14188119db3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=479851) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 09:20:47.780334 dv-cinder-851351-1-smb devstack@keystone.service[479851]: [pid: 479851|app: 0|req: 574/1163] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 09:20:47 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 09:20:47.803281 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e17106bf-26c4-4b23-8b5b-f2c448992112 None None] Authenticating user token {{(pid=479852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:20:47.920774 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e17106bf-26c4-4b23-8b5b-f2c448992112 None None] Validating token access rules against request {{(pid=479852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:20:47.935485 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG dbcounter [-] [479852] Writing DB stats keystone:SELECT=100 {{(pid=479852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:20:47.960317 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ceff97e-3817-45d9-91e1-b9da12159acc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:20:47.961003 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ceff97e-3817-45d9-91e1-b9da12159acc None admin] REQUEST_METHOD: `GET` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:20:47.961285 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ceff97e-3817-45d9-91e1-b9da12159acc None admin] SCRIPT_NAME: `/identity` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:20:47.961560 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ceff97e-3817-45d9-91e1-b9da12159acc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:20:48.049075 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ceff97e-3817-45d9-91e1-b9da12159acc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:20:48.051906 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ceff97e-3817-45d9-91e1-b9da12159acc None admin] RBAC: Authorization granted {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:20:48.236869 dv-cinder-851351-1-smb devstack@keystone.service[479852]: [pid: 479852|app: 0|req: 590/1164] 10.222.0.42 () {58 vars in 1282 bytes} [Thu Jul 28 09:20:47 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 433 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 28 09:20:48.242204 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e4994d-3e16-421c-a8a5-14188119db3b None None] Authenticating user token {{(pid=479851) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:20:48.253309 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG dbcounter [-] [479851] Writing DB stats keystone:SELECT=100 {{(pid=479851) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:20:48.351586 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e4994d-3e16-421c-a8a5-14188119db3b None None] Validating token access rules against request {{(pid=479851) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:20:48.388930 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb908011-b510-49cc-b472-f9db6788b03c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479851) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:20:48.391567 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb908011-b510-49cc-b472-f9db6788b03c None admin] REQUEST_METHOD: `GET` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:20:48.392338 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb908011-b510-49cc-b472-f9db6788b03c None admin] SCRIPT_NAME: `/identity` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:20:48.392905 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb908011-b510-49cc-b472-f9db6788b03c None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:20:48.404770 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb908011-b510-49cc-b472-f9db6788b03c None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:20:48.406273 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb908011-b510-49cc-b472-f9db6788b03c None admin] RBAC: Authorization granted {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:20:48.418999 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application [None req-fb908011-b510-49cc-b472-f9db6788b03c None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Jul 28 09:20:48.418999 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 09:20:48.418999 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Jul 28 09:20:48.418999 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Jul 28 09:20:48.418999 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 28 09:20:48.418999 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 28 09:20:48.418999 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 28 09:20:48.418999 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 28 09:20:48.418999 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. Jul 28 09:20:48.418999 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application Jul 28 09:20:48.418999 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 28 09:20:48.418999 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application Jul 28 09:20:48.418999 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 09:20:48.418999 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 09:20:48.418999 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 09:20:48.418999 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 09:20:48.418999 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 09:20:48.420624 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 09:20:48.420624 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 09:20:48.420624 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 09:20:48.420624 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 09:20:48.420624 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 09:20:48.420624 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 09:20:48.420624 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 09:20:48.420624 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 09:20:48.420624 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 09:20:48.420624 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 09:20:48.420624 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 09:20:48.420624 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 09:20:48.420624 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 09:20:48.420624 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 09:20:48.420624 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 09:20:48.420624 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 09:20:48.422303 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 09:20:48.422303 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application with Lock( Jul 28 09:20:48.422303 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 09:20:48.422303 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return self._enter() Jul 28 09:20:48.422303 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 09:20:48.422303 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 09:20:48.422303 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 09:20:48.422303 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return self.creator() Jul 28 09:20:48.422303 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 09:20:48.422303 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application created_value = creator( Jul 28 09:20:48.422303 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Jul 28 09:20:48.422303 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 09:20:48.422303 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. Jul 28 09:20:48.422303 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application Jul 28 09:20:48.422303 dv-cinder-851351-1-smb devstack@keystone.service[479851]: [pid: 479851|app: 0|req: 575/1165] 10.222.0.42 () {56 vars in 1117 bytes} [Thu Jul 28 09:20:48 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 09:20:48.426924 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ceff97e-3817-45d9-91e1-b9da12159acc None admin] Authenticating user token {{(pid=479852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:20:48.445378 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG dbcounter [-] [479852] Writing DB stats keystone:SELECT=100 {{(pid=479852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:20:48.551340 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ceff97e-3817-45d9-91e1-b9da12159acc None admin] Validating token access rules against request {{(pid=479852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:20:48.593331 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9526fe3e-185f-48e7-88a3-67f2c9dde652 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:20:48.593989 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9526fe3e-185f-48e7-88a3-67f2c9dde652 None admin] REQUEST_METHOD: `GET` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:20:48.594275 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9526fe3e-185f-48e7-88a3-67f2c9dde652 None admin] SCRIPT_NAME: `/identity` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:20:48.594555 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9526fe3e-185f-48e7-88a3-67f2c9dde652 None admin] PATH_INFO: `/v3/domains` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:20:48.595285 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9526fe3e-185f-48e7-88a3-67f2c9dde652 None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=479852) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 09:20:48.595595 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9526fe3e-185f-48e7-88a3-67f2c9dde652 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:20:48.597181 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9526fe3e-185f-48e7-88a3-67f2c9dde652 None admin] RBAC: Authorization granted {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:20:48.606167 dv-cinder-851351-1-smb devstack@keystone.service[479852]: [pid: 479852|app: 0|req: 591/1166] 10.222.0.42 () {56 vars in 1115 bytes} [Thu Jul 28 09:20:48 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:20:50.668809 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a01de8c-b51c-4550-8c1d-70db525aa218 None None] REQUEST_METHOD: `GET` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:20:50.669426 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a01de8c-b51c-4550-8c1d-70db525aa218 None None] SCRIPT_NAME: `/identity` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:20:50.669426 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a01de8c-b51c-4550-8c1d-70db525aa218 None None] PATH_INFO: `/` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:20:50.670869 dv-cinder-851351-1-smb devstack@keystone.service[479851]: [pid: 479851|app: 0|req: 576/1167] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 09:20:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 09:20:50.677192 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9b3673-c042-4cdd-8fde-28fc0c0f5659 None None] REQUEST_METHOD: `POST` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:20:50.677880 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9b3673-c042-4cdd-8fde-28fc0c0f5659 None None] SCRIPT_NAME: `/identity` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:20:50.677880 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9b3673-c042-4cdd-8fde-28fc0c0f5659 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:20:50.698330 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.auth.core [None req-2d9b3673-c042-4cdd-8fde-28fc0c0f5659 None None] MFA Rules not processed for user `c198f91a4ae84d2b9cc730a6e304c2be`. Rule list: `[]` (Enabled: `True`). {{(pid=479852) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 09:20:50.699616 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.fernet_utils [None req-2d9b3673-c042-4cdd-8fde-28fc0c0f5659 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=479852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 09:20:50.776899 dv-cinder-851351-1-smb devstack@keystone.service[479852]: [pid: 479852|app: 0|req: 592/1168] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 09:20:50 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 09:20:50.800390 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a01de8c-b51c-4550-8c1d-70db525aa218 None None] Authenticating user token {{(pid=479851) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:20:50.884075 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG dbcounter [-] [479851] Writing DB stats keystone:SELECT=100 {{(pid=479851) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:20:50.927439 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a01de8c-b51c-4550-8c1d-70db525aa218 None None] Validating token access rules against request {{(pid=479851) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:20:50.971481 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d51d5f2-6cbb-4b15-9b42-cff624045aa7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479851) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:20:50.972182 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d51d5f2-6cbb-4b15-9b42-cff624045aa7 None admin] REQUEST_METHOD: `POST` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:20:50.972473 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d51d5f2-6cbb-4b15-9b42-cff624045aa7 None admin] SCRIPT_NAME: `/identity` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:20:50.972789 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d51d5f2-6cbb-4b15-9b42-cff624045aa7 None admin] PATH_INFO: `/v3/domains` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:20:50.973570 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d51d5f2-6cbb-4b15-9b42-cff624045aa7 None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:20:50.975091 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d51d5f2-6cbb-4b15-9b42-cff624045aa7 None admin] RBAC: Authorization granted {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:20:50.994263 dv-cinder-851351-1-smb devstack@keystone.service[479851]: [pid: 479851|app: 0|req: 577/1169] 10.222.0.42 () {60 vars in 1138 bytes} [Thu Jul 28 09:20:50 2022] POST /identity/v3/domains => generated 267 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 09:20:53.085720 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b354425-9dcf-4ed5-a3e2-d659c42432e4 None None] REQUEST_METHOD: `GET` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:20:53.086336 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b354425-9dcf-4ed5-a3e2-d659c42432e4 None None] SCRIPT_NAME: `/identity` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:20:53.086336 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b354425-9dcf-4ed5-a3e2-d659c42432e4 None None] PATH_INFO: `/` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:20:53.087703 dv-cinder-851351-1-smb devstack@keystone.service[479852]: [pid: 479852|app: 0|req: 593/1170] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 09:20:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 09:20:53.093787 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53e715a-54b5-4df1-ad51-13c9b98d9468 None None] REQUEST_METHOD: `POST` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:20:53.094345 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53e715a-54b5-4df1-ad51-13c9b98d9468 None None] SCRIPT_NAME: `/identity` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:20:53.094345 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53e715a-54b5-4df1-ad51-13c9b98d9468 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:20:53.115884 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.auth.core [None req-b53e715a-54b5-4df1-ad51-13c9b98d9468 None None] MFA Rules not processed for user `c198f91a4ae84d2b9cc730a6e304c2be`. Rule list: `[]` (Enabled: `True`). {{(pid=479851) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 09:20:53.117199 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.fernet_utils [None req-b53e715a-54b5-4df1-ad51-13c9b98d9468 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=479851) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 09:20:53.194089 dv-cinder-851351-1-smb devstack@keystone.service[479851]: [pid: 479851|app: 0|req: 578/1171] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 09:20:53 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 09:20:53.218555 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b354425-9dcf-4ed5-a3e2-d659c42432e4 None None] Authenticating user token {{(pid=479852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:20:53.228202 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG dbcounter [-] [479852] Writing DB stats keystone:SELECT=100 {{(pid=479852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:20:53.337980 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b354425-9dcf-4ed5-a3e2-d659c42432e4 None None] Validating token access rules against request {{(pid=479852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:20:53.376914 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc585d9f-4c0d-497e-ad5e-f72e5359757b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:20:53.377718 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc585d9f-4c0d-497e-ad5e-f72e5359757b None admin] REQUEST_METHOD: `GET` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:20:53.378071 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc585d9f-4c0d-497e-ad5e-f72e5359757b None admin] SCRIPT_NAME: `/identity` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:20:53.378386 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc585d9f-4c0d-497e-ad5e-f72e5359757b None admin] PATH_INFO: `/v3/domains/e5ece954039b468c8ad9779fbbfc6525` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:20:53.391508 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc585d9f-4c0d-497e-ad5e-f72e5359757b None admin] RBAC: Authorizing `identity:get_domain(domain_id=e5ece954039b468c8ad9779fbbfc6525)` {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:20:53.393067 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc585d9f-4c0d-497e-ad5e-f72e5359757b None admin] RBAC: Authorization granted {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:20:53.394862 dv-cinder-851351-1-smb devstack@keystone.service[479852]: [pid: 479852|app: 0|req: 594/1172] 10.222.0.42 () {56 vars in 1183 bytes} [Thu Jul 28 09:20:53 2022] GET /identity/v3/domains/e5ece954039b468c8ad9779fbbfc6525 => generated 267 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:20:53.401377 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53e715a-54b5-4df1-ad51-13c9b98d9468 None None] Authenticating user token {{(pid=479851) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:20:53.465367 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG dbcounter [-] [479851] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=479851) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:20:53.512205 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53e715a-54b5-4df1-ad51-13c9b98d9468 None None] Validating token access rules against request {{(pid=479851) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:20:53.551018 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9036f4b5-c217-405b-bcf4-be8a15bafb09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479851) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:20:53.551654 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9036f4b5-c217-405b-bcf4-be8a15bafb09 None admin] REQUEST_METHOD: `POST` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:20:53.551936 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9036f4b5-c217-405b-bcf4-be8a15bafb09 None admin] SCRIPT_NAME: `/identity` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:20:53.552212 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9036f4b5-c217-405b-bcf4-be8a15bafb09 None admin] PATH_INFO: `/v3/projects` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:20:53.552944 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9036f4b5-c217-405b-bcf4-be8a15bafb09 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:20:53.554407 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9036f4b5-c217-405b-bcf4-be8a15bafb09 None admin] RBAC: Authorization granted {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:20:53.584716 dv-cinder-851351-1-smb devstack@keystone.service[479851]: [pid: 479851|app: 0|req: 579/1173] 10.222.0.42 () {60 vars in 1141 bytes} [Thu Jul 28 09:20:53 2022] POST /identity/v3/projects => generated 361 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 09:20:55.681244 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa79009-1ff9-4e7b-9f46-452a9c75fa0c None None] REQUEST_METHOD: `GET` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:20:55.682125 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa79009-1ff9-4e7b-9f46-452a9c75fa0c None None] SCRIPT_NAME: `/identity` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:20:55.682125 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa79009-1ff9-4e7b-9f46-452a9c75fa0c None None] PATH_INFO: `/` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:20:55.683259 dv-cinder-851351-1-smb devstack@keystone.service[479852]: [pid: 479852|app: 0|req: 595/1174] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 09:20:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 09:20:55.689321 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391bee91-72b7-4e36-9517-0c6ead00cd04 None None] REQUEST_METHOD: `POST` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:20:55.689885 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391bee91-72b7-4e36-9517-0c6ead00cd04 None None] SCRIPT_NAME: `/identity` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:20:55.690028 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391bee91-72b7-4e36-9517-0c6ead00cd04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:20:55.710281 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.auth.core [None req-391bee91-72b7-4e36-9517-0c6ead00cd04 None None] MFA Rules not processed for user `c198f91a4ae84d2b9cc730a6e304c2be`. Rule list: `[]` (Enabled: `True`). {{(pid=479851) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 09:20:55.711525 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.fernet_utils [None req-391bee91-72b7-4e36-9517-0c6ead00cd04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=479851) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 09:20:55.787583 dv-cinder-851351-1-smb devstack@keystone.service[479851]: [pid: 479851|app: 0|req: 580/1175] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 09:20:55 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 09:20:55.812514 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa79009-1ff9-4e7b-9f46-452a9c75fa0c None None] Authenticating user token {{(pid=479852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:20:55.890623 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG dbcounter [-] [479852] Writing DB stats keystone:SELECT=100 {{(pid=479852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:20:55.934685 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa79009-1ff9-4e7b-9f46-452a9c75fa0c None None] Validating token access rules against request {{(pid=479852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:20:55.976701 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7820e1f-31cd-464f-a62e-ec523a2caf78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:20:55.977428 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7820e1f-31cd-464f-a62e-ec523a2caf78 None admin] REQUEST_METHOD: `GET` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:20:55.977752 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7820e1f-31cd-464f-a62e-ec523a2caf78 None admin] SCRIPT_NAME: `/identity` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:20:55.978068 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7820e1f-31cd-464f-a62e-ec523a2caf78 None admin] PATH_INFO: `/v3/domains/e5ece954039b468c8ad9779fbbfc6525` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:20:55.979670 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7820e1f-31cd-464f-a62e-ec523a2caf78 None admin] RBAC: Authorizing `identity:get_domain(domain_id=e5ece954039b468c8ad9779fbbfc6525)` {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:20:55.981266 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7820e1f-31cd-464f-a62e-ec523a2caf78 None admin] RBAC: Authorization granted {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:20:55.983017 dv-cinder-851351-1-smb devstack@keystone.service[479852]: [pid: 479852|app: 0|req: 596/1176] 10.222.0.42 () {56 vars in 1183 bytes} [Thu Jul 28 09:20:55 2022] GET /identity/v3/domains/e5ece954039b468c8ad9779fbbfc6525 => generated 267 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 09:20:55.990035 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-391bee91-72b7-4e36-9517-0c6ead00cd04 None None] Authenticating user token {{(pid=479851) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:20:56.038081 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG dbcounter [-] [479851] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=479851) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:20:56.108106 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-391bee91-72b7-4e36-9517-0c6ead00cd04 None None] Validating token access rules against request {{(pid=479851) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:20:56.147397 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb7dc3b-ae76-452e-9bcc-911595f8a2e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479851) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:20:56.148077 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb7dc3b-ae76-452e-9bcc-911595f8a2e2 None admin] REQUEST_METHOD: `POST` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:20:56.148403 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb7dc3b-ae76-452e-9bcc-911595f8a2e2 None admin] SCRIPT_NAME: `/identity` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:20:56.148739 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb7dc3b-ae76-452e-9bcc-911595f8a2e2 None admin] PATH_INFO: `/v3/users` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:20:56.149591 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb7dc3b-ae76-452e-9bcc-911595f8a2e2 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:20:56.151145 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb7dc3b-ae76-452e-9bcc-911595f8a2e2 None admin] RBAC: Authorization granted {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:20:56.174497 dv-cinder-851351-1-smb devstack@keystone.service[479851]: [pid: 479851|app: 0|req: 581/1177] 10.222.0.42 () {60 vars in 1132 bytes} [Thu Jul 28 09:20:55 2022] POST /identity/v3/users => generated 311 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 09:20:58.299346 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21fb15b-6622-4655-9478-dcf42e595885 None None] REQUEST_METHOD: `GET` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:20:58.300001 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21fb15b-6622-4655-9478-dcf42e595885 None None] SCRIPT_NAME: `/identity` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:20:58.300001 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21fb15b-6622-4655-9478-dcf42e595885 None None] PATH_INFO: `/` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:20:58.301388 dv-cinder-851351-1-smb devstack@keystone.service[479852]: [pid: 479852|app: 0|req: 597/1178] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 09:20:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 28 09:20:58.307877 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99223919-9aca-4680-8819-5b22c1976fd6 None None] REQUEST_METHOD: `POST` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:20:58.308504 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99223919-9aca-4680-8819-5b22c1976fd6 None None] SCRIPT_NAME: `/identity` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:20:58.308504 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99223919-9aca-4680-8819-5b22c1976fd6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:20:58.334821 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.auth.core [None req-99223919-9aca-4680-8819-5b22c1976fd6 None None] MFA Rules not processed for user `c198f91a4ae84d2b9cc730a6e304c2be`. Rule list: `[]` (Enabled: `True`). {{(pid=479851) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 09:20:58.336068 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.fernet_utils [None req-99223919-9aca-4680-8819-5b22c1976fd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=479851) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 09:20:58.414008 dv-cinder-851351-1-smb devstack@keystone.service[479851]: [pid: 479851|app: 0|req: 582/1179] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 09:20:58 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 09:20:58.437682 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21fb15b-6622-4655-9478-dcf42e595885 None None] Authenticating user token {{(pid=479852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:20:58.549222 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21fb15b-6622-4655-9478-dcf42e595885 None None] Validating token access rules against request {{(pid=479852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:20:58.591675 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ed2bb3-8eef-4789-8291-d7c2976c9c2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:20:58.592328 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ed2bb3-8eef-4789-8291-d7c2976c9c2e None admin] REQUEST_METHOD: `GET` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:20:58.592609 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ed2bb3-8eef-4789-8291-d7c2976c9c2e None admin] SCRIPT_NAME: `/identity` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:20:58.592900 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ed2bb3-8eef-4789-8291-d7c2976c9c2e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:20:58.595077 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG dbcounter [-] [479852] Writing DB stats keystone:SELECT=100 {{(pid=479852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:20:58.608705 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84ed2bb3-8eef-4789-8291-d7c2976c9c2e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 09:20:58.613801 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application [None req-84ed2bb3-8eef-4789-8291-d7c2976c9c2e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 09:20:58.613801 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 09:20:58.613801 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 09:20:58.613801 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 09:20:58.613801 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 09:20:58.613801 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 09:20:58.613801 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 09:20:58.613801 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 09:20:58.613801 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 09:20:58.613801 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 09:20:58.613801 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 09:20:58.613801 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 09:20:58.613801 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 09:20:58.613801 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 09:20:58.613801 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 09:20:58.613801 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 09:20:58.615863 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 09:20:58.615863 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 09:20:58.615863 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 09:20:58.615863 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 09:20:58.615863 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 09:20:58.615863 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 09:20:58.615863 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 09:20:58.615863 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 09:20:58.615863 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 09:20:58.615863 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 09:20:58.615863 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 09:20:58.615863 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application with Lock( Jul 28 09:20:58.615863 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 09:20:58.615863 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self._enter() Jul 28 09:20:58.615863 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 09:20:58.615863 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 09:20:58.617214 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 09:20:58.617214 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self.creator() Jul 28 09:20:58.617214 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 09:20:58.617214 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application created_value = creator( Jul 28 09:20:58.617214 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 09:20:58.617214 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 09:20:58.617214 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 09:20:58.617214 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 09:20:58.617214 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 09:20:58.617214 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 09:20:58.617214 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 09:20:58.617214 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application Jul 28 09:20:58.617214 dv-cinder-851351-1-smb devstack@keystone.service[479852]: [pid: 479852|app: 0|req: 598/1180] 10.222.0.42 () {56 vars in 1096 bytes} [Thu Jul 28 09:20:58 2022] GET /identity/v3/roles/admin => generated 83 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 09:20:58.621556 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99223919-9aca-4680-8819-5b22c1976fd6 None None] Authenticating user token {{(pid=479851) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:20:58.657771 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG dbcounter [-] [479851] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=479851) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:20:58.740343 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99223919-9aca-4680-8819-5b22c1976fd6 None None] Validating token access rules against request {{(pid=479851) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:20:58.778208 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bdd8a3f-97e1-4182-9050-871ccf498bb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479851) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:20:58.778850 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bdd8a3f-97e1-4182-9050-871ccf498bb0 None admin] REQUEST_METHOD: `GET` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:20:58.779130 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bdd8a3f-97e1-4182-9050-871ccf498bb0 None admin] SCRIPT_NAME: `/identity` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:20:58.779382 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bdd8a3f-97e1-4182-9050-871ccf498bb0 None admin] PATH_INFO: `/v3/roles` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:20:58.780145 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bdd8a3f-97e1-4182-9050-871ccf498bb0 None admin] RBAC: Adding query filter params (name=admin) {{(pid=479851) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 09:20:58.780461 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bdd8a3f-97e1-4182-9050-871ccf498bb0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:20:58.781905 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bdd8a3f-97e1-4182-9050-871ccf498bb0 None admin] RBAC: Authorization granted {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:20:58.791472 dv-cinder-851351-1-smb devstack@keystone.service[479851]: [pid: 479851|app: 0|req: 583/1181] 10.222.0.42 () {56 vars in 1099 bytes} [Thu Jul 28 09:20:58 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:20:58.797741 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ed2bb3-8eef-4789-8291-d7c2976c9c2e None admin] Authenticating user token {{(pid=479852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:20:58.906377 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ed2bb3-8eef-4789-8291-d7c2976c9c2e None admin] Validating token access rules against request {{(pid=479852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:20:58.942977 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee4bf2b7-f92a-4b67-9716-c961d78b63ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:20:58.943649 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4bf2b7-f92a-4b67-9716-c961d78b63ce None admin] REQUEST_METHOD: `GET` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:20:58.943893 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4bf2b7-f92a-4b67-9716-c961d78b63ce None admin] SCRIPT_NAME: `/identity` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:20:58.944195 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4bf2b7-f92a-4b67-9716-c961d78b63ce None admin] PATH_INFO: `/v3/users/bb84488f374a4ed785c443d862ad3651` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:20:58.961939 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee4bf2b7-f92a-4b67-9716-c961d78b63ce None admin] RBAC: Authorizing `identity:get_user(user_id=bb84488f374a4ed785c443d862ad3651)` {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:20:58.963461 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee4bf2b7-f92a-4b67-9716-c961d78b63ce None admin] RBAC: Authorization granted {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:20:58.965327 dv-cinder-851351-1-smb devstack@keystone.service[479852]: [pid: 479852|app: 0|req: 599/1182] 10.222.0.42 () {56 vars in 1177 bytes} [Thu Jul 28 09:20:58 2022] GET /identity/v3/users/bb84488f374a4ed785c443d862ad3651 => generated 311 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:20:58.971909 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bdd8a3f-97e1-4182-9050-871ccf498bb0 None admin] Authenticating user token {{(pid=479851) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:20:59.078027 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG dbcounter [-] [479851] Writing DB stats keystone:SELECT=100 {{(pid=479851) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:20:59.095039 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bdd8a3f-97e1-4182-9050-871ccf498bb0 None admin] Validating token access rules against request {{(pid=479851) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:20:59.134670 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f58558d5-2036-4a25-b1ed-1d6178ffa984 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479851) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:20:59.135336 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58558d5-2036-4a25-b1ed-1d6178ffa984 None admin] REQUEST_METHOD: `GET` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:20:59.135601 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58558d5-2036-4a25-b1ed-1d6178ffa984 None admin] SCRIPT_NAME: `/identity` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:20:59.135876 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58558d5-2036-4a25-b1ed-1d6178ffa984 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:20:59.214511 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f58558d5-2036-4a25-b1ed-1d6178ffa984 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:20:59.216090 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f58558d5-2036-4a25-b1ed-1d6178ffa984 None admin] RBAC: Authorization granted {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:20:59.310862 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG dbcounter [-] [479851] Writing DB stats keystone:SELECT=100 {{(pid=479851) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:20:59.325530 dv-cinder-851351-1-smb devstack@keystone.service[479851]: [pid: 479851|app: 0|req: 584/1183] 10.222.0.42 () {58 vars in 1282 bytes} [Thu Jul 28 09:20:58 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 354 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 28 09:20:59.331978 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee4bf2b7-f92a-4b67-9716-c961d78b63ce None admin] Authenticating user token {{(pid=479852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:20:59.391444 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG dbcounter [-] [479852] Writing DB stats keystone:SELECT=100 {{(pid=479852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:20:59.443160 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee4bf2b7-f92a-4b67-9716-c961d78b63ce None admin] Validating token access rules against request {{(pid=479852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:20:59.481095 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a028a32e-b92c-4ba8-a91d-a4009ac0da2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:20:59.481680 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a028a32e-b92c-4ba8-a91d-a4009ac0da2e None admin] REQUEST_METHOD: `GET` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:20:59.482007 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a028a32e-b92c-4ba8-a91d-a4009ac0da2e None admin] SCRIPT_NAME: `/identity` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:20:59.482315 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a028a32e-b92c-4ba8-a91d-a4009ac0da2e None admin] PATH_INFO: `/v3/projects/41e8bcac1d1d490a80469f2f4b1c49be` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:20:59.483584 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a028a32e-b92c-4ba8-a91d-a4009ac0da2e None admin] RBAC: Authorizing `identity:get_project(project_id=41e8bcac1d1d490a80469f2f4b1c49be)` {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:20:59.485168 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a028a32e-b92c-4ba8-a91d-a4009ac0da2e None admin] RBAC: Authorization granted {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:20:59.486906 dv-cinder-851351-1-smb devstack@keystone.service[479852]: [pid: 479852|app: 0|req: 600/1184] 10.222.0.42 () {56 vars in 1186 bytes} [Thu Jul 28 09:20:59 2022] GET /identity/v3/projects/41e8bcac1d1d490a80469f2f4b1c49be => generated 361 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:20:59.493556 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f58558d5-2036-4a25-b1ed-1d6178ffa984 None admin] Authenticating user token {{(pid=479851) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:20:59.615467 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f58558d5-2036-4a25-b1ed-1d6178ffa984 None admin] Validating token access rules against request {{(pid=479851) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:20:59.656841 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ea12d6-b04d-4d55-92dd-96c22878dc60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479851) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:20:59.657490 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ea12d6-b04d-4d55-92dd-96c22878dc60 None admin] REQUEST_METHOD: `GET` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:20:59.657778 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ea12d6-b04d-4d55-92dd-96c22878dc60 None admin] SCRIPT_NAME: `/identity` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:20:59.658060 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ea12d6-b04d-4d55-92dd-96c22878dc60 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:20:59.658894 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19ea12d6-b04d-4d55-92dd-96c22878dc60 None admin] RBAC: Adding query filter params (role.id=685084310b35477b9b2d0c7934d0f803, scope.project.id=41e8bcac1d1d490a80469f2f4b1c49be, user.id=bb84488f374a4ed785c443d862ad3651) {{(pid=479851) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 09:20:59.659240 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19ea12d6-b04d-4d55-92dd-96c22878dc60 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:20:59.660795 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19ea12d6-b04d-4d55-92dd-96c22878dc60 None admin] RBAC: Authorization granted {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:20:59.667432 dv-cinder-851351-1-smb devstack@keystone.service[479851]: [pid: 479851|app: 0|req: 585/1185] 10.222.0.42 () {56 vars in 1374 bytes} [Thu Jul 28 09:20:59 2022] GET /identity/v3/role_assignments?user.id=bb84488f374a4ed785c443d862ad3651&scope.project.id=41e8bcac1d1d490a80469f2f4b1c49be&role.id=685084310b35477b9b2d0c7934d0f803 => generated 259 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:21:01.715627 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ec827c-c667-44d0-bae1-e898e97486da None None] REQUEST_METHOD: `GET` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:21:01.716227 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ec827c-c667-44d0-bae1-e898e97486da None None] SCRIPT_NAME: `/identity` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:21:01.716227 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ec827c-c667-44d0-bae1-e898e97486da None None] PATH_INFO: `/` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:21:01.717530 dv-cinder-851351-1-smb devstack@keystone.service[479852]: [pid: 479852|app: 0|req: 601/1186] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 09:21:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 09:21:01.724028 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336370b2-8508-4da2-8c75-305544516483 None None] REQUEST_METHOD: `POST` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:21:01.724623 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336370b2-8508-4da2-8c75-305544516483 None None] SCRIPT_NAME: `/identity` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:21:01.724623 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336370b2-8508-4da2-8c75-305544516483 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:21:01.745490 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.auth.core [None req-336370b2-8508-4da2-8c75-305544516483 None None] MFA Rules not processed for user `c198f91a4ae84d2b9cc730a6e304c2be`. Rule list: `[]` (Enabled: `True`). {{(pid=479851) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 09:21:01.746754 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.fernet_utils [None req-336370b2-8508-4da2-8c75-305544516483 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=479851) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 09:21:01.801488 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG dbcounter [-] [479851] Writing DB stats keystone:SELECT=100 {{(pid=479851) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:21:01.824983 dv-cinder-851351-1-smb devstack@keystone.service[479851]: [pid: 479851|app: 0|req: 586/1187] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 09:21:01 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 09:21:01.847842 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ec827c-c667-44d0-bae1-e898e97486da None None] Authenticating user token {{(pid=479852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:21:01.961278 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ec827c-c667-44d0-bae1-e898e97486da None None] Validating token access rules against request {{(pid=479852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:21:01.989291 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG dbcounter [-] [479852] Writing DB stats keystone:SELECT=100 {{(pid=479852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:21:02.007895 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2a9f9a-ce04-45aa-a556-1af876e64d37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:21:02.008630 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2a9f9a-ce04-45aa-a556-1af876e64d37 None admin] REQUEST_METHOD: `GET` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:21:02.009009 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2a9f9a-ce04-45aa-a556-1af876e64d37 None admin] SCRIPT_NAME: `/identity` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:21:02.009345 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2a9f9a-ce04-45aa-a556-1af876e64d37 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:21:02.021789 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c2a9f9a-ce04-45aa-a556-1af876e64d37 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 09:21:02.027050 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application [None req-1c2a9f9a-ce04-45aa-a556-1af876e64d37 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 09:21:02.027050 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 09:21:02.027050 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 09:21:02.027050 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 09:21:02.027050 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 09:21:02.027050 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 09:21:02.027050 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 09:21:02.027050 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 09:21:02.027050 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 09:21:02.027050 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 09:21:02.027050 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 09:21:02.027050 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 09:21:02.027050 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 09:21:02.027050 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 09:21:02.027050 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 09:21:02.027050 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 09:21:02.029108 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 09:21:02.029108 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 09:21:02.029108 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 09:21:02.029108 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 09:21:02.029108 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 09:21:02.029108 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 09:21:02.029108 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 09:21:02.029108 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 09:21:02.029108 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 09:21:02.029108 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 09:21:02.029108 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 09:21:02.029108 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application with Lock( Jul 28 09:21:02.029108 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 09:21:02.029108 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self._enter() Jul 28 09:21:02.029108 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 09:21:02.029108 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 09:21:02.030184 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 09:21:02.030184 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self.creator() Jul 28 09:21:02.030184 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 09:21:02.030184 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application created_value = creator( Jul 28 09:21:02.030184 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 09:21:02.030184 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 09:21:02.030184 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 09:21:02.030184 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 09:21:02.030184 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 09:21:02.030184 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 09:21:02.030184 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 09:21:02.030184 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application Jul 28 09:21:02.030184 dv-cinder-851351-1-smb devstack@keystone.service[479852]: [pid: 479852|app: 0|req: 602/1188] 10.222.0.42 () {56 vars in 1096 bytes} [Thu Jul 28 09:21:01 2022] GET /identity/v3/roles/admin => generated 83 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 09:21:02.036015 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336370b2-8508-4da2-8c75-305544516483 None None] Authenticating user token {{(pid=479851) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:21:02.209901 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336370b2-8508-4da2-8c75-305544516483 None None] Validating token access rules against request {{(pid=479851) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:21:02.271181 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652841f2-e73e-446d-82ce-c6a90783613d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479851) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:21:02.272156 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652841f2-e73e-446d-82ce-c6a90783613d None admin] REQUEST_METHOD: `GET` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:21:02.272650 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652841f2-e73e-446d-82ce-c6a90783613d None admin] SCRIPT_NAME: `/identity` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:21:02.273182 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652841f2-e73e-446d-82ce-c6a90783613d None admin] PATH_INFO: `/v3/roles` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:21:02.274530 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-652841f2-e73e-446d-82ce-c6a90783613d None admin] RBAC: Adding query filter params (name=admin) {{(pid=479851) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 09:21:02.275085 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-652841f2-e73e-446d-82ce-c6a90783613d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:21:02.277656 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-652841f2-e73e-446d-82ce-c6a90783613d None admin] RBAC: Authorization granted {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:21:02.293344 dv-cinder-851351-1-smb devstack@keystone.service[479851]: [pid: 479851|app: 0|req: 587/1189] 10.222.0.42 () {56 vars in 1099 bytes} [Thu Jul 28 09:21:02 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:21:02.299976 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2a9f9a-ce04-45aa-a556-1af876e64d37 None admin] Authenticating user token {{(pid=479852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:21:02.430305 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2a9f9a-ce04-45aa-a556-1af876e64d37 None admin] Validating token access rules against request {{(pid=479852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:21:02.471369 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d77725d-c34e-4d61-9456-1c2fd0cb1ae5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:21:02.472071 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d77725d-c34e-4d61-9456-1c2fd0cb1ae5 None admin] REQUEST_METHOD: `GET` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:21:02.472354 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d77725d-c34e-4d61-9456-1c2fd0cb1ae5 None admin] SCRIPT_NAME: `/identity` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:21:02.472631 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d77725d-c34e-4d61-9456-1c2fd0cb1ae5 None admin] PATH_INFO: `/v3/users/bb84488f374a4ed785c443d862ad3651` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:21:02.473903 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d77725d-c34e-4d61-9456-1c2fd0cb1ae5 None admin] RBAC: Authorizing `identity:get_user(user_id=bb84488f374a4ed785c443d862ad3651)` {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:21:02.475382 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d77725d-c34e-4d61-9456-1c2fd0cb1ae5 None admin] RBAC: Authorization granted {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:21:02.477093 dv-cinder-851351-1-smb devstack@keystone.service[479852]: [pid: 479852|app: 0|req: 603/1190] 10.222.0.42 () {56 vars in 1177 bytes} [Thu Jul 28 09:21:02 2022] GET /identity/v3/users/bb84488f374a4ed785c443d862ad3651 => generated 311 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:21:02.486303 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652841f2-e73e-446d-82ce-c6a90783613d None admin] Authenticating user token {{(pid=479851) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:21:02.539993 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG dbcounter [-] [479851] Writing DB stats keystone:SELECT=100 {{(pid=479851) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:21:02.601956 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652841f2-e73e-446d-82ce-c6a90783613d None admin] Validating token access rules against request {{(pid=479851) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:21:02.638898 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f902a1-981b-4c94-8e7c-3a17e0369350 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479851) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:21:02.639554 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f902a1-981b-4c94-8e7c-3a17e0369350 None admin] REQUEST_METHOD: `GET` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:21:02.639846 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f902a1-981b-4c94-8e7c-3a17e0369350 None admin] SCRIPT_NAME: `/identity` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:21:02.640128 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f902a1-981b-4c94-8e7c-3a17e0369350 None admin] PATH_INFO: `/v3/projects/41e8bcac1d1d490a80469f2f4b1c49be` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:21:02.641388 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97f902a1-981b-4c94-8e7c-3a17e0369350 None admin] RBAC: Authorizing `identity:get_project(project_id=41e8bcac1d1d490a80469f2f4b1c49be)` {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:21:02.642853 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97f902a1-981b-4c94-8e7c-3a17e0369350 None admin] RBAC: Authorization granted {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:21:02.644651 dv-cinder-851351-1-smb devstack@keystone.service[479851]: [pid: 479851|app: 0|req: 588/1191] 10.222.0.42 () {56 vars in 1186 bytes} [Thu Jul 28 09:21:02 2022] GET /identity/v3/projects/41e8bcac1d1d490a80469f2f4b1c49be => generated 361 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:21:02.651721 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d77725d-c34e-4d61-9456-1c2fd0cb1ae5 None admin] Authenticating user token {{(pid=479852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:21:02.732266 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG dbcounter [-] [479852] Writing DB stats keystone:SELECT=100 {{(pid=479852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:21:02.788271 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d77725d-c34e-4d61-9456-1c2fd0cb1ae5 None admin] Validating token access rules against request {{(pid=479852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:21:02.825077 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-349aa98e-7a34-497f-a97d-42955a9911eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:21:02.825907 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349aa98e-7a34-497f-a97d-42955a9911eb None admin] REQUEST_METHOD: `PUT` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:21:02.826292 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349aa98e-7a34-497f-a97d-42955a9911eb None admin] SCRIPT_NAME: `/identity` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:21:02.826680 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349aa98e-7a34-497f-a97d-42955a9911eb None admin] PATH_INFO: `/v3/projects/41e8bcac1d1d490a80469f2f4b1c49be/users/bb84488f374a4ed785c443d862ad3651/roles/685084310b35477b9b2d0c7934d0f803` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:21:02.828933 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-349aa98e-7a34-497f-a97d-42955a9911eb None admin] RBAC: Authorizing `identity:create_grant(project_id=41e8bcac1d1d490a80469f2f4b1c49be, user_id=bb84488f374a4ed785c443d862ad3651, role_id=685084310b35477b9b2d0c7934d0f803)` {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:21:02.830668 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-349aa98e-7a34-497f-a97d-42955a9911eb None admin] RBAC: Authorization granted {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:21:02.846772 dv-cinder-851351-1-smb devstack@keystone.service[479852]: [pid: 479852|app: 0|req: 604/1192] 10.222.0.42 () {58 vars in 1439 bytes} [Thu Jul 28 09:21:02 2022] PUT /identity/v3/projects/41e8bcac1d1d490a80469f2f4b1c49be/users/bb84488f374a4ed785c443d862ad3651/roles/685084310b35477b9b2d0c7934d0f803 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 09:21:04.934934 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30511862-2d0f-4b93-a21e-77a89d1d8e55 None None] REQUEST_METHOD: `GET` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:21:04.935543 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30511862-2d0f-4b93-a21e-77a89d1d8e55 None None] SCRIPT_NAME: `/identity` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:21:04.935543 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30511862-2d0f-4b93-a21e-77a89d1d8e55 None None] PATH_INFO: `/` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:21:04.937121 dv-cinder-851351-1-smb devstack@keystone.service[479851]: [pid: 479851|app: 0|req: 589/1193] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 09:21:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 09:21:04.943495 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c28e89-23a9-4c5c-9e1f-3d4877396f99 None None] REQUEST_METHOD: `POST` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:21:04.944236 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c28e89-23a9-4c5c-9e1f-3d4877396f99 None None] SCRIPT_NAME: `/identity` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:21:04.944236 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c28e89-23a9-4c5c-9e1f-3d4877396f99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:21:04.965264 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.auth.core [None req-65c28e89-23a9-4c5c-9e1f-3d4877396f99 None None] MFA Rules not processed for user `c198f91a4ae84d2b9cc730a6e304c2be`. Rule list: `[]` (Enabled: `True`). {{(pid=479852) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 09:21:04.966517 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.fernet_utils [None req-65c28e89-23a9-4c5c-9e1f-3d4877396f99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=479852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 09:21:05.046654 dv-cinder-851351-1-smb devstack@keystone.service[479852]: [pid: 479852|app: 0|req: 605/1194] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 09:21:04 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 28 09:21:05.070123 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30511862-2d0f-4b93-a21e-77a89d1d8e55 None None] Authenticating user token {{(pid=479851) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:21:05.222889 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30511862-2d0f-4b93-a21e-77a89d1d8e55 None None] Validating token access rules against request {{(pid=479851) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:21:05.248900 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG dbcounter [-] [479851] Writing DB stats keystone:SELECT=100 {{(pid=479851) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:21:05.278666 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533d7038-2961-48b8-b902-67b355ac6f95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479851) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:21:05.279345 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533d7038-2961-48b8-b902-67b355ac6f95 None admin] REQUEST_METHOD: `GET` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:21:05.279633 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533d7038-2961-48b8-b902-67b355ac6f95 None admin] SCRIPT_NAME: `/identity` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:21:05.279911 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533d7038-2961-48b8-b902-67b355ac6f95 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:21:05.293341 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-533d7038-2961-48b8-b902-67b355ac6f95 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 09:21:05.298649 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application [None req-533d7038-2961-48b8-b902-67b355ac6f95 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 09:21:05.298649 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 09:21:05.298649 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 09:21:05.298649 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 09:21:05.298649 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 09:21:05.298649 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 09:21:05.298649 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 09:21:05.298649 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 09:21:05.298649 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 09:21:05.298649 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 09:21:05.298649 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 09:21:05.298649 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 09:21:05.298649 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 09:21:05.298649 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 09:21:05.298649 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 09:21:05.298649 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 09:21:05.300810 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 09:21:05.300810 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 09:21:05.300810 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 09:21:05.300810 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 09:21:05.300810 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 09:21:05.300810 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 09:21:05.300810 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 09:21:05.300810 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 09:21:05.300810 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 09:21:05.300810 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 09:21:05.300810 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 09:21:05.300810 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application with Lock( Jul 28 09:21:05.300810 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 09:21:05.300810 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return self._enter() Jul 28 09:21:05.300810 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 09:21:05.300810 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 09:21:05.302640 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 09:21:05.302640 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return self.creator() Jul 28 09:21:05.302640 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 09:21:05.302640 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application created_value = creator( Jul 28 09:21:05.302640 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 09:21:05.302640 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 09:21:05.302640 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 09:21:05.302640 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 09:21:05.302640 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 09:21:05.302640 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 09:21:05.302640 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 09:21:05.302640 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application Jul 28 09:21:05.302640 dv-cinder-851351-1-smb devstack@keystone.service[479851]: [pid: 479851|app: 0|req: 590/1195] 10.222.0.42 () {56 vars in 1096 bytes} [Thu Jul 28 09:21:05 2022] GET /identity/v3/roles/admin => generated 83 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 09:21:05.306750 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c28e89-23a9-4c5c-9e1f-3d4877396f99 None None] Authenticating user token {{(pid=479852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:21:05.353182 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG dbcounter [-] [479852] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=479852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:21:05.423911 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c28e89-23a9-4c5c-9e1f-3d4877396f99 None None] Validating token access rules against request {{(pid=479852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:21:05.464240 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52832fd1-854d-4527-8ade-ef8e3a55da27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:21:05.465017 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52832fd1-854d-4527-8ade-ef8e3a55da27 None admin] REQUEST_METHOD: `GET` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:21:05.465348 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52832fd1-854d-4527-8ade-ef8e3a55da27 None admin] SCRIPT_NAME: `/identity` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:21:05.465677 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52832fd1-854d-4527-8ade-ef8e3a55da27 None admin] PATH_INFO: `/v3/roles` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:21:05.466475 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52832fd1-854d-4527-8ade-ef8e3a55da27 None admin] RBAC: Adding query filter params (name=admin) {{(pid=479852) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 09:21:05.466829 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52832fd1-854d-4527-8ade-ef8e3a55da27 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:21:05.468290 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52832fd1-854d-4527-8ade-ef8e3a55da27 None admin] RBAC: Authorization granted {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:21:05.478548 dv-cinder-851351-1-smb devstack@keystone.service[479852]: [pid: 479852|app: 0|req: 606/1196] 10.222.0.42 () {56 vars in 1099 bytes} [Thu Jul 28 09:21:05 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:21:05.486823 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533d7038-2961-48b8-b902-67b355ac6f95 None admin] Authenticating user token {{(pid=479851) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:21:05.614194 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533d7038-2961-48b8-b902-67b355ac6f95 None admin] Validating token access rules against request {{(pid=479851) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:21:05.653088 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d7d84a-5071-4a44-bbaf-cdcd1bbde020 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479851) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:21:05.653766 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d7d84a-5071-4a44-bbaf-cdcd1bbde020 None admin] REQUEST_METHOD: `GET` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:21:05.654052 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d7d84a-5071-4a44-bbaf-cdcd1bbde020 None admin] SCRIPT_NAME: `/identity` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:21:05.654316 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d7d84a-5071-4a44-bbaf-cdcd1bbde020 None admin] PATH_INFO: `/v3/users/bb84488f374a4ed785c443d862ad3651` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:21:05.655703 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97d7d84a-5071-4a44-bbaf-cdcd1bbde020 None admin] RBAC: Authorizing `identity:get_user(user_id=bb84488f374a4ed785c443d862ad3651)` {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:21:05.657259 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97d7d84a-5071-4a44-bbaf-cdcd1bbde020 None admin] RBAC: Authorization granted {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:21:05.659121 dv-cinder-851351-1-smb devstack@keystone.service[479851]: [pid: 479851|app: 0|req: 591/1197] 10.222.0.42 () {56 vars in 1177 bytes} [Thu Jul 28 09:21:05 2022] GET /identity/v3/users/bb84488f374a4ed785c443d862ad3651 => generated 311 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:21:05.665816 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52832fd1-854d-4527-8ade-ef8e3a55da27 None admin] Authenticating user token {{(pid=479852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:21:05.783571 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG dbcounter [-] [479852] Writing DB stats keystone:SELECT=100 {{(pid=479852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:21:05.787811 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52832fd1-854d-4527-8ade-ef8e3a55da27 None admin] Validating token access rules against request {{(pid=479852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:21:05.830851 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e951c88-c3ab-44f9-9f1f-ffe0a6d13543 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:21:05.831497 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e951c88-c3ab-44f9-9f1f-ffe0a6d13543 None admin] REQUEST_METHOD: `GET` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:21:05.831777 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e951c88-c3ab-44f9-9f1f-ffe0a6d13543 None admin] SCRIPT_NAME: `/identity` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:21:05.832084 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e951c88-c3ab-44f9-9f1f-ffe0a6d13543 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:21:05.908089 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e951c88-c3ab-44f9-9f1f-ffe0a6d13543 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:21:05.909786 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e951c88-c3ab-44f9-9f1f-ffe0a6d13543 None admin] RBAC: Authorization granted {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:21:06.018177 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG dbcounter [-] [479852] Writing DB stats keystone:SELECT=100 {{(pid=479852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:21:06.023101 dv-cinder-851351-1-smb devstack@keystone.service[479852]: [pid: 479852|app: 0|req: 607/1198] 10.222.0.42 () {58 vars in 1282 bytes} [Thu Jul 28 09:21:05 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 358 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 28 09:21:06.028786 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d7d84a-5071-4a44-bbaf-cdcd1bbde020 None admin] Authenticating user token {{(pid=479851) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:21:06.079827 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG dbcounter [-] [479851] Writing DB stats keystone:SELECT=100 {{(pid=479851) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:21:06.143149 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d7d84a-5071-4a44-bbaf-cdcd1bbde020 None admin] Validating token access rules against request {{(pid=479851) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:21:06.183323 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d3f147d-69dd-4e3a-9459-8abc3486bf28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479851) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:21:06.183998 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3f147d-69dd-4e3a-9459-8abc3486bf28 None admin] REQUEST_METHOD: `GET` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:21:06.184286 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3f147d-69dd-4e3a-9459-8abc3486bf28 None admin] SCRIPT_NAME: `/identity` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:21:06.184567 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3f147d-69dd-4e3a-9459-8abc3486bf28 None admin] PATH_INFO: `/v3/projects/41e8bcac1d1d490a80469f2f4b1c49be` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:21:06.185864 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d3f147d-69dd-4e3a-9459-8abc3486bf28 None admin] RBAC: Authorizing `identity:get_project(project_id=41e8bcac1d1d490a80469f2f4b1c49be)` {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:21:06.187362 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d3f147d-69dd-4e3a-9459-8abc3486bf28 None admin] RBAC: Authorization granted {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:21:06.189135 dv-cinder-851351-1-smb devstack@keystone.service[479851]: [pid: 479851|app: 0|req: 592/1199] 10.222.0.42 () {56 vars in 1186 bytes} [Thu Jul 28 09:21:06 2022] GET /identity/v3/projects/41e8bcac1d1d490a80469f2f4b1c49be => generated 361 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:21:06.200087 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e951c88-c3ab-44f9-9f1f-ffe0a6d13543 None admin] Authenticating user token {{(pid=479852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:21:06.383006 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e951c88-c3ab-44f9-9f1f-ffe0a6d13543 None admin] Validating token access rules against request {{(pid=479852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:21:06.453145 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be2de0b6-5cf2-4b1e-937c-b75a8d3547f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:21:06.454230 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2de0b6-5cf2-4b1e-937c-b75a8d3547f1 None admin] REQUEST_METHOD: `GET` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:21:06.454733 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2de0b6-5cf2-4b1e-937c-b75a8d3547f1 None admin] SCRIPT_NAME: `/identity` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:21:06.455225 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2de0b6-5cf2-4b1e-937c-b75a8d3547f1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:21:06.456828 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be2de0b6-5cf2-4b1e-937c-b75a8d3547f1 None admin] RBAC: Adding query filter params (role.id=685084310b35477b9b2d0c7934d0f803, scope.project.id=41e8bcac1d1d490a80469f2f4b1c49be, user.id=bb84488f374a4ed785c443d862ad3651) {{(pid=479852) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 09:21:06.457404 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be2de0b6-5cf2-4b1e-937c-b75a8d3547f1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:21:06.460132 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be2de0b6-5cf2-4b1e-937c-b75a8d3547f1 None admin] RBAC: Authorization granted {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:21:06.471716 dv-cinder-851351-1-smb devstack@keystone.service[479852]: [pid: 479852|app: 0|req: 608/1200] 10.222.0.42 () {56 vars in 1374 bytes} [Thu Jul 28 09:21:06 2022] GET /identity/v3/role_assignments?user.id=bb84488f374a4ed785c443d862ad3651&scope.project.id=41e8bcac1d1d490a80469f2f4b1c49be&role.id=685084310b35477b9b2d0c7934d0f803 => generated 608 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:21:16.177725 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG dbcounter [-] [479851] Writing DB stats keystone:SELECT=46 {{(pid=479851) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:21:16.466186 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG dbcounter [-] [479852] Writing DB stats keystone:SELECT=68 {{(pid=479852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:22:03.941341 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67fd183-7259-4d48-b1ee-2ca54d6ec4f1 None None] REQUEST_METHOD: `GET` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:22:03.942375 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67fd183-7259-4d48-b1ee-2ca54d6ec4f1 None None] SCRIPT_NAME: `/identity` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:22:03.942375 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67fd183-7259-4d48-b1ee-2ca54d6ec4f1 None None] PATH_INFO: `/` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:22:03.944709 dv-cinder-851351-1-smb devstack@keystone.service[479851]: [pid: 479851|app: 0|req: 593/1201] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 09:22:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 09:22:03.951248 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7971eb13-eb22-4213-b26e-91d0cdc3a63a None None] REQUEST_METHOD: `POST` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:22:03.952192 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7971eb13-eb22-4213-b26e-91d0cdc3a63a None None] SCRIPT_NAME: `/identity` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:22:03.952192 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7971eb13-eb22-4213-b26e-91d0cdc3a63a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:22:03.973236 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.auth.core [None req-7971eb13-eb22-4213-b26e-91d0cdc3a63a None None] MFA Rules not processed for user `c198f91a4ae84d2b9cc730a6e304c2be`. Rule list: `[]` (Enabled: `True`). {{(pid=479852) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 09:22:03.974763 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.fernet_utils [None req-7971eb13-eb22-4213-b26e-91d0cdc3a63a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=479852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 09:22:04.057830 dv-cinder-851351-1-smb devstack@keystone.service[479852]: [pid: 479852|app: 0|req: 609/1202] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 09:22:03 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 28 09:22:04.088869 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f67fd183-7259-4d48-b1ee-2ca54d6ec4f1 None None] Authenticating user token {{(pid=479851) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:22:04.213105 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f67fd183-7259-4d48-b1ee-2ca54d6ec4f1 None None] Validating token access rules against request {{(pid=479851) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:22:04.252284 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb80e41-d260-47f4-aad7-a47b7b57edf7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479851) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:22:04.252984 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb80e41-d260-47f4-aad7-a47b7b57edf7 None admin] REQUEST_METHOD: `GET` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:22:04.253271 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb80e41-d260-47f4-aad7-a47b7b57edf7 None admin] SCRIPT_NAME: `/identity` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:22:04.253555 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb80e41-d260-47f4-aad7-a47b7b57edf7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:22:04.266395 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb80e41-d260-47f4-aad7-a47b7b57edf7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:22:04.267951 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb80e41-d260-47f4-aad7-a47b7b57edf7 None admin] RBAC: Authorization granted {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:22:04.289165 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application [None req-7bb80e41-d260-47f4-aad7-a47b7b57edf7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 09:22:04.289165 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 09:22:04.289165 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 09:22:04.289165 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 09:22:04.289165 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 09:22:04.289165 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 09:22:04.289165 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 09:22:04.289165 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 09:22:04.289165 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 09:22:04.289165 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 09:22:04.289165 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 09:22:04.289165 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 09:22:04.289165 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 09:22:04.289165 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 09:22:04.289165 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 09:22:04.290540 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 09:22:04.290540 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 09:22:04.290540 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 09:22:04.290540 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 09:22:04.290540 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 09:22:04.290540 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 09:22:04.290540 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 09:22:04.290540 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 09:22:04.290540 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application with Lock( Jul 28 09:22:04.290540 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 09:22:04.290540 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return self._enter() Jul 28 09:22:04.290540 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 09:22:04.290540 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 09:22:04.290540 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 09:22:04.290540 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return self.creator() Jul 28 09:22:04.290540 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 09:22:04.290540 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application created_value = creator( Jul 28 09:22:04.292095 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 09:22:04.292095 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 09:22:04.292095 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 09:22:04.292095 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application Jul 28 09:22:04.292095 dv-cinder-851351-1-smb devstack@keystone.service[479851]: [pid: 479851|app: 0|req: 594/1203] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 09:22:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 09:22:04.302061 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7971eb13-eb22-4213-b26e-91d0cdc3a63a None None] Authenticating user token {{(pid=479852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:22:04.494669 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7971eb13-eb22-4213-b26e-91d0cdc3a63a None None] Validating token access rules against request {{(pid=479852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:22:04.552103 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG dbcounter [-] [479852] Writing DB stats keystone:SELECT=100 {{(pid=479852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:22:04.561747 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a31ebffd-d2df-40f0-bc2c-3f1a792b1b41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:22:04.562760 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31ebffd-d2df-40f0-bc2c-3f1a792b1b41 None admin] REQUEST_METHOD: `GET` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:22:04.563260 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31ebffd-d2df-40f0-bc2c-3f1a792b1b41 None admin] SCRIPT_NAME: `/identity` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:22:04.563726 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31ebffd-d2df-40f0-bc2c-3f1a792b1b41 None admin] PATH_INFO: `/v3/domains` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:22:04.564730 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a31ebffd-d2df-40f0-bc2c-3f1a792b1b41 None admin] RBAC: Adding query filter params (name=Default) {{(pid=479852) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 09:22:04.565191 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a31ebffd-d2df-40f0-bc2c-3f1a792b1b41 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:22:04.567561 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a31ebffd-d2df-40f0-bc2c-3f1a792b1b41 None admin] RBAC: Authorization granted {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:22:04.588231 dv-cinder-851351-1-smb devstack@keystone.service[479852]: [pid: 479852|app: 0|req: 610/1204] 10.222.0.42 () {56 vars in 1109 bytes} [Thu Jul 28 09:22:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 288 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:22:04.597785 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb80e41-d260-47f4-aad7-a47b7b57edf7 None admin] Authenticating user token {{(pid=479851) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:22:04.709426 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG dbcounter [-] [479851] Writing DB stats keystone:SELECT=100 {{(pid=479851) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:22:04.827873 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb80e41-d260-47f4-aad7-a47b7b57edf7 None admin] Validating token access rules against request {{(pid=479851) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:22:04.893916 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1d1e8a-3419-4091-bb81-b156017c24dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479851) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:22:04.894774 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1d1e8a-3419-4091-bb81-b156017c24dc None admin] REQUEST_METHOD: `POST` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:22:04.895169 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1d1e8a-3419-4091-bb81-b156017c24dc None admin] SCRIPT_NAME: `/identity` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:22:04.895526 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1d1e8a-3419-4091-bb81-b156017c24dc None admin] PATH_INFO: `/v3/users` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:22:04.896437 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af1d1e8a-3419-4091-bb81-b156017c24dc None admin] RBAC: Authorizing `identity:create_user()` {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:22:04.898091 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af1d1e8a-3419-4091-bb81-b156017c24dc None admin] RBAC: Authorization granted {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:22:04.927307 dv-cinder-851351-1-smb devstack@keystone.service[479851]: [pid: 479851|app: 0|req: 595/1205] 10.222.0.42 () {60 vars in 1132 bytes} [Thu Jul 28 09:22:04 2022] POST /identity/v3/users => generated 251 bytes in 331 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 09:22:07.447172 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2fe14e3-fe31-42cf-b180-c984701b6fd4 None None] REQUEST_METHOD: `GET` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:22:07.448184 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2fe14e3-fe31-42cf-b180-c984701b6fd4 None None] SCRIPT_NAME: `/identity` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:22:07.448184 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2fe14e3-fe31-42cf-b180-c984701b6fd4 None None] PATH_INFO: `/` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:22:07.453908 dv-cinder-851351-1-smb devstack@keystone.service[479852]: [pid: 479852|app: 0|req: 611/1206] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 09:22:07 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 09:22:07.460529 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df6af1d-3ccd-4e97-b362-274216148084 None None] REQUEST_METHOD: `POST` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:22:07.461456 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df6af1d-3ccd-4e97-b362-274216148084 None None] SCRIPT_NAME: `/identity` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:22:07.461456 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df6af1d-3ccd-4e97-b362-274216148084 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:22:07.492319 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.auth.core [None req-6df6af1d-3ccd-4e97-b362-274216148084 None None] MFA Rules not processed for user `c198f91a4ae84d2b9cc730a6e304c2be`. Rule list: `[]` (Enabled: `True`). {{(pid=479851) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 09:22:07.494417 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.fernet_utils [None req-6df6af1d-3ccd-4e97-b362-274216148084 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=479851) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 09:22:07.620027 dv-cinder-851351-1-smb devstack@keystone.service[479851]: [pid: 479851|app: 0|req: 596/1207] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 09:22:07 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 09:22:07.655101 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2fe14e3-fe31-42cf-b180-c984701b6fd4 None None] Authenticating user token {{(pid=479852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:22:07.832499 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2fe14e3-fe31-42cf-b180-c984701b6fd4 None None] Validating token access rules against request {{(pid=479852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:22:07.878120 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4437eade-d0eb-4247-b1d8-cb5fdb3ebf50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:22:07.879023 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4437eade-d0eb-4247-b1d8-cb5fdb3ebf50 None admin] REQUEST_METHOD: `GET` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:22:07.879326 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4437eade-d0eb-4247-b1d8-cb5fdb3ebf50 None admin] SCRIPT_NAME: `/identity` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:22:07.879603 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4437eade-d0eb-4247-b1d8-cb5fdb3ebf50 None admin] PATH_INFO: `/v3/roles/service` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:22:07.896700 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4437eade-d0eb-4247-b1d8-cb5fdb3ebf50 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 09:22:07.904215 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application [None req-4437eade-d0eb-4247-b1d8-cb5fdb3ebf50 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 28 09:22:07.904215 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 09:22:07.904215 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 09:22:07.904215 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 09:22:07.904215 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 09:22:07.904215 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 09:22:07.904215 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 09:22:07.904215 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 09:22:07.904215 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 09:22:07.904215 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 09:22:07.904215 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 09:22:07.904215 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 09:22:07.904215 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 09:22:07.904215 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 09:22:07.904215 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 09:22:07.904215 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 09:22:07.909040 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 09:22:07.909040 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 09:22:07.909040 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 09:22:07.909040 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 09:22:07.909040 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 09:22:07.909040 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 09:22:07.909040 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 09:22:07.909040 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 09:22:07.909040 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 09:22:07.909040 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 09:22:07.909040 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 09:22:07.909040 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application with Lock( Jul 28 09:22:07.909040 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 09:22:07.909040 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self._enter() Jul 28 09:22:07.909040 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 09:22:07.909040 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 09:22:07.910686 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 09:22:07.910686 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self.creator() Jul 28 09:22:07.910686 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 09:22:07.910686 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application created_value = creator( Jul 28 09:22:07.910686 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 09:22:07.910686 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 09:22:07.910686 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 09:22:07.910686 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 09:22:07.910686 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 09:22:07.910686 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 09:22:07.910686 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 28 09:22:07.910686 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application Jul 28 09:22:07.910686 dv-cinder-851351-1-smb devstack@keystone.service[479852]: [pid: 479852|app: 0|req: 612/1208] 10.222.0.42 () {56 vars in 1102 bytes} [Thu Jul 28 09:22:07 2022] GET /identity/v3/roles/service => generated 85 bytes in 251 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 09:22:07.913311 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df6af1d-3ccd-4e97-b362-274216148084 None None] Authenticating user token {{(pid=479851) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:22:07.983860 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG dbcounter [-] [479851] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=479851) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:22:08.103379 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df6af1d-3ccd-4e97-b362-274216148084 None None] Validating token access rules against request {{(pid=479851) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:22:08.158501 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-114b2b07-f116-408e-92d7-f8b0be918ac8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479851) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:22:08.160035 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114b2b07-f116-408e-92d7-f8b0be918ac8 None admin] REQUEST_METHOD: `GET` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:22:08.160431 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114b2b07-f116-408e-92d7-f8b0be918ac8 None admin] SCRIPT_NAME: `/identity` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:22:08.160878 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114b2b07-f116-408e-92d7-f8b0be918ac8 None admin] PATH_INFO: `/v3/roles` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:22:08.162163 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-114b2b07-f116-408e-92d7-f8b0be918ac8 None admin] RBAC: Adding query filter params (name=service) {{(pid=479851) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 09:22:08.163046 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-114b2b07-f116-408e-92d7-f8b0be918ac8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:22:08.166272 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-114b2b07-f116-408e-92d7-f8b0be918ac8 None admin] RBAC: Authorization granted {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:22:08.182305 dv-cinder-851351-1-smb devstack@keystone.service[479851]: [pid: 479851|app: 0|req: 597/1209] 10.222.0.42 () {56 vars in 1103 bytes} [Thu Jul 28 09:22:07 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 09:22:08.188142 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4437eade-d0eb-4247-b1d8-cb5fdb3ebf50 None admin] Authenticating user token {{(pid=479852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:22:08.298111 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG dbcounter [-] [479852] Writing DB stats keystone:SELECT=100 {{(pid=479852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:22:08.413666 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4437eade-d0eb-4247-b1d8-cb5fdb3ebf50 None admin] Validating token access rules against request {{(pid=479852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:22:08.481993 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9362321c-8263-40da-9ce1-708d0a6ba854 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:22:08.483128 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9362321c-8263-40da-9ce1-708d0a6ba854 None admin] REQUEST_METHOD: `GET` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:22:08.483604 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9362321c-8263-40da-9ce1-708d0a6ba854 None admin] SCRIPT_NAME: `/identity` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:22:08.484064 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9362321c-8263-40da-9ce1-708d0a6ba854 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:22:08.507727 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9362321c-8263-40da-9ce1-708d0a6ba854 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:22:08.510706 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9362321c-8263-40da-9ce1-708d0a6ba854 None admin] RBAC: Authorization granted {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:22:08.540036 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application [None req-9362321c-8263-40da-9ce1-708d0a6ba854 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 09:22:08.540036 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 09:22:08.540036 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 09:22:08.540036 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 09:22:08.540036 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 09:22:08.540036 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 09:22:08.540036 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 09:22:08.540036 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 09:22:08.540036 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 09:22:08.540036 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 09:22:08.540036 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 09:22:08.540036 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 09:22:08.540036 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 09:22:08.540036 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 09:22:08.540036 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 09:22:08.542212 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 09:22:08.542212 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 09:22:08.542212 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 09:22:08.542212 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 09:22:08.542212 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 09:22:08.542212 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 09:22:08.542212 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 09:22:08.542212 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 09:22:08.542212 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application with Lock( Jul 28 09:22:08.542212 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 09:22:08.542212 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self._enter() Jul 28 09:22:08.542212 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 09:22:08.542212 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 09:22:08.542212 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 09:22:08.542212 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self.creator() Jul 28 09:22:08.542212 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 09:22:08.542212 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application created_value = creator( Jul 28 09:22:08.544321 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 09:22:08.544321 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 09:22:08.544321 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 09:22:08.544321 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application Jul 28 09:22:08.546513 dv-cinder-851351-1-smb devstack@keystone.service[479852]: [pid: 479852|app: 0|req: 613/1210] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 09:22:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 359 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 09:22:08.553431 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-114b2b07-f116-408e-92d7-f8b0be918ac8 None admin] Authenticating user token {{(pid=479851) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:22:08.702925 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG dbcounter [-] [479851] Writing DB stats keystone:SELECT=100 {{(pid=479851) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:22:08.706697 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-114b2b07-f116-408e-92d7-f8b0be918ac8 None admin] Validating token access rules against request {{(pid=479851) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:22:08.764342 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4acace8c-d82c-4b09-aeb2-f61bbeb380c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479851) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:22:08.765596 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4acace8c-d82c-4b09-aeb2-f61bbeb380c9 None admin] REQUEST_METHOD: `GET` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:22:08.766148 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4acace8c-d82c-4b09-aeb2-f61bbeb380c9 None admin] SCRIPT_NAME: `/identity` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:22:08.766711 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4acace8c-d82c-4b09-aeb2-f61bbeb380c9 None admin] PATH_INFO: `/v3/domains` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:22:08.768214 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4acace8c-d82c-4b09-aeb2-f61bbeb380c9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=479851) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 09:22:08.768697 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4acace8c-d82c-4b09-aeb2-f61bbeb380c9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:22:08.772299 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4acace8c-d82c-4b09-aeb2-f61bbeb380c9 None admin] RBAC: Authorization granted {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:22:08.798037 dv-cinder-851351-1-smb devstack@keystone.service[479851]: [pid: 479851|app: 0|req: 598/1211] 10.222.0.42 () {56 vars in 1109 bytes} [Thu Jul 28 09:22:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:22:08.806108 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9362321c-8263-40da-9ce1-708d0a6ba854 None admin] Authenticating user token {{(pid=479852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:22:08.958861 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9362321c-8263-40da-9ce1-708d0a6ba854 None admin] Validating token access rules against request {{(pid=479852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:22:08.960636 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG dbcounter [-] [479852] Writing DB stats keystone:SELECT=100 {{(pid=479852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:22:09.011377 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f38ef1-3e8b-4a3a-9583-3da6bc7d2dc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:22:09.012457 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f38ef1-3e8b-4a3a-9583-3da6bc7d2dc8 None admin] REQUEST_METHOD: `GET` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:22:09.012942 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f38ef1-3e8b-4a3a-9583-3da6bc7d2dc8 None admin] SCRIPT_NAME: `/identity` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:22:09.013288 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f38ef1-3e8b-4a3a-9583-3da6bc7d2dc8 None admin] PATH_INFO: `/v3/users/placement` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:22:09.023867 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f38ef1-3e8b-4a3a-9583-3da6bc7d2dc8 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:22:09.025643 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f38ef1-3e8b-4a3a-9583-3da6bc7d2dc8 None admin] RBAC: Authorization granted {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:22:09.041322 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application [None req-e1f38ef1-3e8b-4a3a-9583-3da6bc7d2dc8 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 28 09:22:09.041322 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 09:22:09.041322 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 09:22:09.041322 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 09:22:09.041322 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 09:22:09.041322 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 09:22:09.041322 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 09:22:09.041322 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 09:22:09.041322 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 09:22:09.041322 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 09:22:09.041322 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 09:22:09.041322 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 09:22:09.041322 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 28 09:22:09.041322 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 28 09:22:09.041322 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 28 09:22:09.041322 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 28 09:22:09.049666 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 09:22:09.049666 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 09:22:09.049666 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 28 09:22:09.049666 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 09:22:09.049666 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 28 09:22:09.049666 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 09:22:09.049666 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 09:22:09.049666 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 09:22:09.049666 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 09:22:09.049666 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 09:22:09.049666 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 09:22:09.049666 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application with Lock( Jul 28 09:22:09.049666 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 09:22:09.049666 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self._enter() Jul 28 09:22:09.049666 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 09:22:09.049666 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 09:22:09.049666 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 09:22:09.049666 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self.creator() Jul 28 09:22:09.051672 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 09:22:09.051672 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application created_value = creator( Jul 28 09:22:09.051672 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 28 09:22:09.051672 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 28 09:22:09.051672 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 28 09:22:09.051672 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 28 09:22:09.051672 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 28 09:22:09.051672 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 28 09:22:09.051672 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 28 09:22:09.051672 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application Jul 28 09:22:09.051672 dv-cinder-851351-1-smb devstack@keystone.service[479852]: [pid: 479852|app: 0|req: 614/1212] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 09:22:08 2022] GET /identity/v3/users/placement => generated 87 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 09:22:09.053115 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4acace8c-d82c-4b09-aeb2-f61bbeb380c9 None admin] Authenticating user token {{(pid=479851) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:22:09.279945 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4acace8c-d82c-4b09-aeb2-f61bbeb380c9 None admin] Validating token access rules against request {{(pid=479851) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:22:09.342735 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977a3108-d69e-4b56-8270-9436f74e07f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479851) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:22:09.343603 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977a3108-d69e-4b56-8270-9436f74e07f4 None admin] REQUEST_METHOD: `GET` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:22:09.344070 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977a3108-d69e-4b56-8270-9436f74e07f4 None admin] SCRIPT_NAME: `/identity` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:22:09.344474 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977a3108-d69e-4b56-8270-9436f74e07f4 None admin] PATH_INFO: `/v3/users` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:22:09.345667 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-977a3108-d69e-4b56-8270-9436f74e07f4 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=479851) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 09:22:09.346108 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-977a3108-d69e-4b56-8270-9436f74e07f4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:22:09.348272 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-977a3108-d69e-4b56-8270-9436f74e07f4 None admin] RBAC: Authorization granted {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:22:09.386632 dv-cinder-851351-1-smb devstack@keystone.service[479851]: [pid: 479851|app: 0|req: 599/1213] 10.222.0.42 () {56 vars in 1143 bytes} [Thu Jul 28 09:22:09 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 337 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:22:09.394377 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f38ef1-3e8b-4a3a-9583-3da6bc7d2dc8 None admin] Authenticating user token {{(pid=479852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:22:09.593328 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f38ef1-3e8b-4a3a-9583-3da6bc7d2dc8 None admin] Validating token access rules against request {{(pid=479852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:22:09.640842 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86645fb9-e7c0-4824-a2c2-de857797c12a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:22:09.641494 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86645fb9-e7c0-4824-a2c2-de857797c12a None admin] REQUEST_METHOD: `GET` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:22:09.641815 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86645fb9-e7c0-4824-a2c2-de857797c12a None admin] SCRIPT_NAME: `/identity` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:22:09.642129 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86645fb9-e7c0-4824-a2c2-de857797c12a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:22:09.683698 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG dbcounter [-] [479852] Writing DB stats keystone:SELECT=100 {{(pid=479852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:22:09.739186 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86645fb9-e7c0-4824-a2c2-de857797c12a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:22:09.742066 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86645fb9-e7c0-4824-a2c2-de857797c12a None admin] RBAC: Authorization granted {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:22:09.964436 dv-cinder-851351-1-smb devstack@keystone.service[479852]: [pid: 479852|app: 0|req: 615/1214] 10.222.0.42 () {58 vars in 1282 bytes} [Thu Jul 28 09:22:09 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 563 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 28 09:22:09.966168 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977a3108-d69e-4b56-8270-9436f74e07f4 None admin] Authenticating user token {{(pid=479851) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:22:10.006288 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG dbcounter [-] [479851] Writing DB stats keystone:SELECT=100 {{(pid=479851) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:22:10.152919 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977a3108-d69e-4b56-8270-9436f74e07f4 None admin] Validating token access rules against request {{(pid=479851) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:22:10.215099 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e6917ab-cdc2-49aa-acc7-3526ea4d75a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479851) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:22:10.216017 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6917ab-cdc2-49aa-acc7-3526ea4d75a0 None admin] REQUEST_METHOD: `GET` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:22:10.216342 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6917ab-cdc2-49aa-acc7-3526ea4d75a0 None admin] SCRIPT_NAME: `/identity` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:22:10.216819 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6917ab-cdc2-49aa-acc7-3526ea4d75a0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:22:10.231821 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e6917ab-cdc2-49aa-acc7-3526ea4d75a0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:22:10.234138 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e6917ab-cdc2-49aa-acc7-3526ea4d75a0 None admin] RBAC: Authorization granted {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:22:10.252919 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application [None req-8e6917ab-cdc2-49aa-acc7-3526ea4d75a0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 09:22:10.252919 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 09:22:10.252919 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 09:22:10.252919 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 09:22:10.252919 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 09:22:10.252919 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 09:22:10.252919 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 09:22:10.252919 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 09:22:10.252919 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 09:22:10.252919 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 09:22:10.252919 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 09:22:10.252919 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 09:22:10.252919 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 09:22:10.252919 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 09:22:10.252919 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 09:22:10.255902 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 09:22:10.255902 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 09:22:10.255902 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 09:22:10.255902 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 09:22:10.255902 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 09:22:10.255902 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 09:22:10.255902 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 09:22:10.255902 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 09:22:10.255902 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application with Lock( Jul 28 09:22:10.255902 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 09:22:10.255902 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return self._enter() Jul 28 09:22:10.255902 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 09:22:10.255902 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 09:22:10.255902 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 09:22:10.255902 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return self.creator() Jul 28 09:22:10.255902 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 09:22:10.255902 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application created_value = creator( Jul 28 09:22:10.258367 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 09:22:10.258367 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 09:22:10.258367 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 09:22:10.258367 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application Jul 28 09:22:10.258367 dv-cinder-851351-1-smb devstack@keystone.service[479851]: [pid: 479851|app: 0|req: 600/1215] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 09:22:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 289 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 09:22:10.261422 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86645fb9-e7c0-4824-a2c2-de857797c12a None admin] Authenticating user token {{(pid=479852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:22:10.410225 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG dbcounter [-] [479852] Writing DB stats keystone:SELECT=100 {{(pid=479852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:22:10.488976 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86645fb9-e7c0-4824-a2c2-de857797c12a None admin] Validating token access rules against request {{(pid=479852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:22:10.555464 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934eb87e-2a80-44ce-a859-0c04dc3e9421 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:22:10.556394 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934eb87e-2a80-44ce-a859-0c04dc3e9421 None admin] REQUEST_METHOD: `GET` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:22:10.556937 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934eb87e-2a80-44ce-a859-0c04dc3e9421 None admin] SCRIPT_NAME: `/identity` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:22:10.557202 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934eb87e-2a80-44ce-a859-0c04dc3e9421 None admin] PATH_INFO: `/v3/domains` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:22:10.557956 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-934eb87e-2a80-44ce-a859-0c04dc3e9421 None admin] RBAC: Adding query filter params (name=Default) {{(pid=479852) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 09:22:10.558260 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-934eb87e-2a80-44ce-a859-0c04dc3e9421 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:22:10.559867 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-934eb87e-2a80-44ce-a859-0c04dc3e9421 None admin] RBAC: Authorization granted {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:22:10.584228 dv-cinder-851351-1-smb devstack@keystone.service[479852]: [pid: 479852|app: 0|req: 616/1216] 10.222.0.42 () {56 vars in 1109 bytes} [Thu Jul 28 09:22:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 324 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 09:22:10.593236 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e6917ab-cdc2-49aa-acc7-3526ea4d75a0 None admin] Authenticating user token {{(pid=479851) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:22:10.718310 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG dbcounter [-] [479851] Writing DB stats keystone:SELECT=100 {{(pid=479851) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:22:10.783860 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e6917ab-cdc2-49aa-acc7-3526ea4d75a0 None admin] Validating token access rules against request {{(pid=479851) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:22:10.852942 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f719a3-dbc5-4895-a0ee-e020259da537 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479851) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:22:10.854290 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f719a3-dbc5-4895-a0ee-e020259da537 None admin] REQUEST_METHOD: `GET` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:22:10.854913 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f719a3-dbc5-4895-a0ee-e020259da537 None admin] SCRIPT_NAME: `/identity` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:22:10.855376 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f719a3-dbc5-4895-a0ee-e020259da537 None admin] PATH_INFO: `/v3/projects/service` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:22:10.865605 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f719a3-dbc5-4895-a0ee-e020259da537 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:22:10.867777 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f719a3-dbc5-4895-a0ee-e020259da537 None admin] RBAC: Authorization granted {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:22:10.884791 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application [None req-93f719a3-dbc5-4895-a0ee-e020259da537 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 09:22:10.884791 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 09:22:10.884791 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 09:22:10.884791 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 09:22:10.884791 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 09:22:10.884791 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 09:22:10.884791 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 09:22:10.884791 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 09:22:10.884791 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 09:22:10.884791 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 09:22:10.884791 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 09:22:10.884791 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 09:22:10.884791 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 28 09:22:10.884791 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 28 09:22:10.884791 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 28 09:22:10.886914 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 28 09:22:10.886914 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 09:22:10.886914 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 09:22:10.886914 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 09:22:10.886914 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 09:22:10.886914 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 09:22:10.886914 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 09:22:10.886914 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 09:22:10.886914 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application with Lock( Jul 28 09:22:10.886914 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 09:22:10.886914 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return self._enter() Jul 28 09:22:10.886914 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 09:22:10.886914 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 09:22:10.886914 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 09:22:10.886914 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return self.creator() Jul 28 09:22:10.886914 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 09:22:10.886914 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application created_value = creator( Jul 28 09:22:10.889012 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 28 09:22:10.889012 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 28 09:22:10.889012 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 28 09:22:10.889012 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 28 09:22:10.889012 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 28 09:22:10.889012 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 28 09:22:10.889012 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 09:22:10.889012 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application Jul 28 09:22:10.889012 dv-cinder-851351-1-smb devstack@keystone.service[479851]: [pid: 479851|app: 0|req: 601/1217] 10.222.0.42 () {56 vars in 1111 bytes} [Thu Jul 28 09:22:10 2022] GET /identity/v3/projects/service => generated 88 bytes in 295 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 09:22:10.894263 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934eb87e-2a80-44ce-a859-0c04dc3e9421 None admin] Authenticating user token {{(pid=479852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:22:11.081075 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934eb87e-2a80-44ce-a859-0c04dc3e9421 None admin] Validating token access rules against request {{(pid=479852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:22:11.129540 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG dbcounter [-] [479852] Writing DB stats keystone:SELECT=100 {{(pid=479852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:22:11.151164 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6844c9-6ed5-4311-b2f2-acd8ad7764dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:22:11.152151 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6844c9-6ed5-4311-b2f2-acd8ad7764dd None admin] REQUEST_METHOD: `GET` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:22:11.152579 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6844c9-6ed5-4311-b2f2-acd8ad7764dd None admin] SCRIPT_NAME: `/identity` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:22:11.153017 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6844c9-6ed5-4311-b2f2-acd8ad7764dd None admin] PATH_INFO: `/v3/projects` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:22:11.154236 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a6844c9-6ed5-4311-b2f2-acd8ad7764dd None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=479852) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 09:22:11.154696 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a6844c9-6ed5-4311-b2f2-acd8ad7764dd None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:22:11.157386 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a6844c9-6ed5-4311-b2f2-acd8ad7764dd None admin] RBAC: Authorization granted {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:22:11.182318 dv-cinder-851351-1-smb devstack@keystone.service[479852]: [pid: 479852|app: 0|req: 617/1218] 10.222.0.42 () {56 vars in 1148 bytes} [Thu Jul 28 09:22:10 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 289 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:22:11.190341 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f719a3-dbc5-4895-a0ee-e020259da537 None admin] Authenticating user token {{(pid=479851) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:22:11.351688 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f719a3-dbc5-4895-a0ee-e020259da537 None admin] Validating token access rules against request {{(pid=479851) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:22:11.388127 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG dbcounter [-] [479851] Writing DB stats keystone:SELECT=100 {{(pid=479851) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:22:11.396264 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a764ffd-c18b-48fa-9961-6482fd4b6af8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479851) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:22:11.396982 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a764ffd-c18b-48fa-9961-6482fd4b6af8 None admin] REQUEST_METHOD: `GET` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:22:11.397270 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a764ffd-c18b-48fa-9961-6482fd4b6af8 None admin] SCRIPT_NAME: `/identity` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:22:11.397604 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a764ffd-c18b-48fa-9961-6482fd4b6af8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:22:11.398483 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a764ffd-c18b-48fa-9961-6482fd4b6af8 None admin] RBAC: Adding query filter params (role.id=bd74dfcbc8d7412689d315fe24a1f247, scope.project.id=3a0fb8ea8010437bade8f92dcbcaacee, user.id=11cfcbc665524cec9b6b7de34f52170d) {{(pid=479851) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 09:22:11.398803 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a764ffd-c18b-48fa-9961-6482fd4b6af8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:22:11.400363 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a764ffd-c18b-48fa-9961-6482fd4b6af8 None admin] RBAC: Authorization granted {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:22:11.407083 dv-cinder-851351-1-smb devstack@keystone.service[479851]: [pid: 479851|app: 0|req: 602/1219] 10.222.0.42 () {56 vars in 1374 bytes} [Thu Jul 28 09:22:11 2022] GET /identity/v3/role_assignments?user.id=11cfcbc665524cec9b6b7de34f52170d&scope.project.id=3a0fb8ea8010437bade8f92dcbcaacee&role.id=bd74dfcbc8d7412689d315fe24a1f247 => generated 259 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:22:14.352152 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b17bcd9-fad8-4242-9a2b-30617f3fb05c None None] REQUEST_METHOD: `GET` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:22:14.352839 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b17bcd9-fad8-4242-9a2b-30617f3fb05c None None] SCRIPT_NAME: `/identity` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:22:14.352839 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b17bcd9-fad8-4242-9a2b-30617f3fb05c None None] PATH_INFO: `/` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:22:14.354334 dv-cinder-851351-1-smb devstack@keystone.service[479852]: [pid: 479852|app: 0|req: 618/1220] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 09:22:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 09:22:14.360420 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52baea38-e0ba-43f7-8925-1e9ba3a7a432 None None] REQUEST_METHOD: `POST` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:22:14.361349 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52baea38-e0ba-43f7-8925-1e9ba3a7a432 None None] SCRIPT_NAME: `/identity` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:22:14.361349 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52baea38-e0ba-43f7-8925-1e9ba3a7a432 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:22:14.381180 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.auth.core [None req-52baea38-e0ba-43f7-8925-1e9ba3a7a432 None None] MFA Rules not processed for user `c198f91a4ae84d2b9cc730a6e304c2be`. Rule list: `[]` (Enabled: `True`). {{(pid=479851) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 09:22:14.382442 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.fernet_utils [None req-52baea38-e0ba-43f7-8925-1e9ba3a7a432 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=479851) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 09:22:14.472404 dv-cinder-851351-1-smb devstack@keystone.service[479851]: [pid: 479851|app: 0|req: 603/1221] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 09:22:14 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 09:22:14.496198 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b17bcd9-fad8-4242-9a2b-30617f3fb05c None None] Authenticating user token {{(pid=479852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:22:14.633595 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b17bcd9-fad8-4242-9a2b-30617f3fb05c None None] Validating token access rules against request {{(pid=479852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:22:14.701579 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44711f47-326d-4cae-b59d-71f939a4587e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:22:14.702788 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44711f47-326d-4cae-b59d-71f939a4587e None admin] REQUEST_METHOD: `GET` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:22:14.703265 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44711f47-326d-4cae-b59d-71f939a4587e None admin] SCRIPT_NAME: `/identity` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:22:14.703590 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44711f47-326d-4cae-b59d-71f939a4587e None admin] PATH_INFO: `/v3/roles/service` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:22:14.719769 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44711f47-326d-4cae-b59d-71f939a4587e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 09:22:14.725905 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application [None req-44711f47-326d-4cae-b59d-71f939a4587e None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 28 09:22:14.725905 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 09:22:14.725905 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 09:22:14.725905 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 09:22:14.725905 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 09:22:14.725905 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 09:22:14.725905 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 09:22:14.725905 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 09:22:14.725905 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 09:22:14.725905 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 09:22:14.725905 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 09:22:14.725905 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 09:22:14.725905 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 09:22:14.725905 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 09:22:14.725905 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 09:22:14.725905 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 09:22:14.728251 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 09:22:14.728251 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 09:22:14.728251 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 09:22:14.728251 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 09:22:14.728251 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 09:22:14.728251 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 09:22:14.728251 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 09:22:14.728251 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 09:22:14.728251 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 09:22:14.728251 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 09:22:14.728251 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 09:22:14.728251 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application with Lock( Jul 28 09:22:14.728251 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 09:22:14.728251 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self._enter() Jul 28 09:22:14.728251 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 09:22:14.728251 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 09:22:14.730246 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 09:22:14.730246 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self.creator() Jul 28 09:22:14.730246 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 09:22:14.730246 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application created_value = creator( Jul 28 09:22:14.730246 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 09:22:14.730246 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 09:22:14.730246 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 09:22:14.730246 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 09:22:14.730246 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 09:22:14.730246 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 09:22:14.730246 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 28 09:22:14.730246 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application Jul 28 09:22:14.730246 dv-cinder-851351-1-smb devstack@keystone.service[479852]: [pid: 479852|app: 0|req: 619/1222] 10.222.0.42 () {56 vars in 1102 bytes} [Thu Jul 28 09:22:14 2022] GET /identity/v3/roles/service => generated 85 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 09:22:14.734731 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52baea38-e0ba-43f7-8925-1e9ba3a7a432 None None] Authenticating user token {{(pid=479851) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:22:14.860022 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52baea38-e0ba-43f7-8925-1e9ba3a7a432 None None] Validating token access rules against request {{(pid=479851) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:22:14.896320 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG dbcounter [-] [479851] Writing DB stats keystone:SELECT=100 {{(pid=479851) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:22:14.911658 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc76c85-1eaa-4a65-a855-a39e15ab01c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479851) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:22:14.912506 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc76c85-1eaa-4a65-a855-a39e15ab01c9 None admin] REQUEST_METHOD: `GET` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:22:14.912883 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc76c85-1eaa-4a65-a855-a39e15ab01c9 None admin] SCRIPT_NAME: `/identity` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:22:14.913197 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc76c85-1eaa-4a65-a855-a39e15ab01c9 None admin] PATH_INFO: `/v3/roles` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:22:14.914111 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc76c85-1eaa-4a65-a855-a39e15ab01c9 None admin] RBAC: Adding query filter params (name=service) {{(pid=479851) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 09:22:14.914490 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc76c85-1eaa-4a65-a855-a39e15ab01c9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:22:14.916205 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc76c85-1eaa-4a65-a855-a39e15ab01c9 None admin] RBAC: Authorization granted {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:22:14.927188 dv-cinder-851351-1-smb devstack@keystone.service[479851]: [pid: 479851|app: 0|req: 604/1223] 10.222.0.42 () {56 vars in 1103 bytes} [Thu Jul 28 09:22:14 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 09:22:14.933822 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44711f47-326d-4cae-b59d-71f939a4587e None admin] Authenticating user token {{(pid=479852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:22:15.000057 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG dbcounter [-] [479852] Writing DB stats keystone:SELECT=100 {{(pid=479852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:22:15.091837 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44711f47-326d-4cae-b59d-71f939a4587e None admin] Validating token access rules against request {{(pid=479852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:22:15.159094 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0617a24d-2dba-437e-80c7-4ca17856c3fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:22:15.159094 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0617a24d-2dba-437e-80c7-4ca17856c3fa None admin] REQUEST_METHOD: `GET` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:22:15.159094 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0617a24d-2dba-437e-80c7-4ca17856c3fa None admin] SCRIPT_NAME: `/identity` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:22:15.159569 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0617a24d-2dba-437e-80c7-4ca17856c3fa None admin] PATH_INFO: `/v3/domains/Default` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:22:15.174525 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0617a24d-2dba-437e-80c7-4ca17856c3fa None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:22:15.177307 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0617a24d-2dba-437e-80c7-4ca17856c3fa None admin] RBAC: Authorization granted {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:22:15.198666 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application [None req-0617a24d-2dba-437e-80c7-4ca17856c3fa None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 09:22:15.198666 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 09:22:15.198666 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 09:22:15.198666 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 09:22:15.198666 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 09:22:15.198666 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 09:22:15.198666 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 09:22:15.198666 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 09:22:15.198666 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 09:22:15.198666 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 09:22:15.198666 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 09:22:15.198666 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 09:22:15.198666 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 09:22:15.198666 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 09:22:15.198666 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 09:22:15.200037 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 09:22:15.200037 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 09:22:15.200037 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 09:22:15.200037 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 09:22:15.200037 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 09:22:15.200037 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 09:22:15.200037 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 09:22:15.200037 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 09:22:15.200037 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application with Lock( Jul 28 09:22:15.200037 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 09:22:15.200037 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self._enter() Jul 28 09:22:15.200037 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 09:22:15.200037 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 09:22:15.200037 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 09:22:15.200037 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self.creator() Jul 28 09:22:15.200037 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 09:22:15.200037 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application created_value = creator( Jul 28 09:22:15.201800 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 09:22:15.201800 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 09:22:15.201800 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 09:22:15.201800 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application Jul 28 09:22:15.201800 dv-cinder-851351-1-smb devstack@keystone.service[479852]: [pid: 479852|app: 0|req: 620/1224] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 09:22:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 268 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 09:22:15.209172 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc76c85-1eaa-4a65-a855-a39e15ab01c9 None admin] Authenticating user token {{(pid=479851) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:22:15.367715 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc76c85-1eaa-4a65-a855-a39e15ab01c9 None admin] Validating token access rules against request {{(pid=479851) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:22:15.436418 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-119afaad-39d7-4093-b5e7-9ec57ec25fe6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479851) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:22:15.437125 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119afaad-39d7-4093-b5e7-9ec57ec25fe6 None admin] REQUEST_METHOD: `GET` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:22:15.437586 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119afaad-39d7-4093-b5e7-9ec57ec25fe6 None admin] SCRIPT_NAME: `/identity` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:22:15.437738 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119afaad-39d7-4093-b5e7-9ec57ec25fe6 None admin] PATH_INFO: `/v3/domains` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:22:15.438620 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-119afaad-39d7-4093-b5e7-9ec57ec25fe6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=479851) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 09:22:15.438971 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-119afaad-39d7-4093-b5e7-9ec57ec25fe6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:22:15.440615 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-119afaad-39d7-4093-b5e7-9ec57ec25fe6 None admin] RBAC: Authorization granted {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:22:15.460489 dv-cinder-851351-1-smb devstack@keystone.service[479851]: [pid: 479851|app: 0|req: 605/1225] 10.222.0.42 () {56 vars in 1109 bytes} [Thu Jul 28 09:22:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 09:22:15.463829 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0617a24d-2dba-437e-80c7-4ca17856c3fa None admin] Authenticating user token {{(pid=479852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:22:15.606264 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG dbcounter [-] [479852] Writing DB stats keystone:SELECT=100 {{(pid=479852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:22:15.618721 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0617a24d-2dba-437e-80c7-4ca17856c3fa None admin] Validating token access rules against request {{(pid=479852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:22:15.681572 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f2dc67-3224-4b67-b696-cb57a10e7bd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:22:15.682361 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f2dc67-3224-4b67-b696-cb57a10e7bd8 None admin] REQUEST_METHOD: `GET` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:22:15.682817 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f2dc67-3224-4b67-b696-cb57a10e7bd8 None admin] SCRIPT_NAME: `/identity` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:22:15.683274 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f2dc67-3224-4b67-b696-cb57a10e7bd8 None admin] PATH_INFO: `/v3/users/placement` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:22:15.699863 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f2dc67-3224-4b67-b696-cb57a10e7bd8 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:22:15.703113 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f2dc67-3224-4b67-b696-cb57a10e7bd8 None admin] RBAC: Authorization granted {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:22:15.730011 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application [None req-b0f2dc67-3224-4b67-b696-cb57a10e7bd8 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 28 09:22:15.730011 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 09:22:15.730011 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 09:22:15.730011 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 09:22:15.730011 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 09:22:15.730011 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 09:22:15.730011 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 09:22:15.730011 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 09:22:15.730011 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 09:22:15.730011 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 09:22:15.730011 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 09:22:15.730011 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 09:22:15.730011 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 28 09:22:15.730011 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 28 09:22:15.730011 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 28 09:22:15.730011 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 28 09:22:15.732374 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 09:22:15.732374 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 09:22:15.732374 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 28 09:22:15.732374 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 09:22:15.732374 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 28 09:22:15.732374 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 09:22:15.732374 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 09:22:15.732374 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 09:22:15.732374 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 09:22:15.732374 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 09:22:15.732374 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 09:22:15.732374 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application with Lock( Jul 28 09:22:15.732374 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 09:22:15.732374 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self._enter() Jul 28 09:22:15.732374 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 09:22:15.732374 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 09:22:15.732374 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 09:22:15.732374 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self.creator() Jul 28 09:22:15.735384 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 09:22:15.735384 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application created_value = creator( Jul 28 09:22:15.735384 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 28 09:22:15.735384 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 28 09:22:15.735384 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 28 09:22:15.735384 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 28 09:22:15.735384 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 28 09:22:15.735384 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 28 09:22:15.735384 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 28 09:22:15.735384 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application Jul 28 09:22:15.735384 dv-cinder-851351-1-smb devstack@keystone.service[479852]: [pid: 479852|app: 0|req: 621/1226] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 09:22:15 2022] GET /identity/v3/users/placement => generated 87 bytes in 268 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 09:22:15.739003 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-119afaad-39d7-4093-b5e7-9ec57ec25fe6 None admin] Authenticating user token {{(pid=479851) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:22:15.809172 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG dbcounter [-] [479851] Writing DB stats keystone:SELECT=100 {{(pid=479851) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:22:15.921078 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-119afaad-39d7-4093-b5e7-9ec57ec25fe6 None admin] Validating token access rules against request {{(pid=479851) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:22:15.982646 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e7fb7c3-461b-4c82-bc05-972258e37f77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479851) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:22:15.983471 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7fb7c3-461b-4c82-bc05-972258e37f77 None admin] REQUEST_METHOD: `GET` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:22:15.983934 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7fb7c3-461b-4c82-bc05-972258e37f77 None admin] SCRIPT_NAME: `/identity` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:22:15.984361 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7fb7c3-461b-4c82-bc05-972258e37f77 None admin] PATH_INFO: `/v3/users` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:22:15.985598 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e7fb7c3-461b-4c82-bc05-972258e37f77 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=479851) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 09:22:15.985999 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e7fb7c3-461b-4c82-bc05-972258e37f77 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:22:15.987796 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e7fb7c3-461b-4c82-bc05-972258e37f77 None admin] RBAC: Authorization granted {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:22:16.012983 dv-cinder-851351-1-smb devstack@keystone.service[479851]: [pid: 479851|app: 0|req: 606/1227] 10.222.0.42 () {56 vars in 1143 bytes} [Thu Jul 28 09:22:15 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:22:16.020840 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f2dc67-3224-4b67-b696-cb57a10e7bd8 None admin] Authenticating user token {{(pid=479852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:22:16.177325 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f2dc67-3224-4b67-b696-cb57a10e7bd8 None admin] Validating token access rules against request {{(pid=479852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:22:16.221518 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55fef33f-fdd8-49e3-9f67-eb46d65063dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:22:16.222532 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55fef33f-fdd8-49e3-9f67-eb46d65063dc None admin] REQUEST_METHOD: `GET` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:22:16.222823 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55fef33f-fdd8-49e3-9f67-eb46d65063dc None admin] SCRIPT_NAME: `/identity` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:22:16.223168 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55fef33f-fdd8-49e3-9f67-eb46d65063dc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:22:16.239621 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55fef33f-fdd8-49e3-9f67-eb46d65063dc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:22:16.241774 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55fef33f-fdd8-49e3-9f67-eb46d65063dc None admin] RBAC: Authorization granted {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:22:16.264316 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application [None req-55fef33f-fdd8-49e3-9f67-eb46d65063dc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 09:22:16.264316 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 09:22:16.264316 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 09:22:16.264316 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 09:22:16.264316 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 09:22:16.264316 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 09:22:16.264316 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 09:22:16.264316 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 09:22:16.264316 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 09:22:16.264316 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 09:22:16.264316 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 09:22:16.264316 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 09:22:16.264316 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 09:22:16.264316 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 09:22:16.264316 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 09:22:16.267071 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 09:22:16.267071 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 09:22:16.267071 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 09:22:16.267071 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 09:22:16.267071 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 09:22:16.267071 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 09:22:16.267071 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 09:22:16.267071 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 09:22:16.267071 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application with Lock( Jul 28 09:22:16.267071 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 09:22:16.267071 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self._enter() Jul 28 09:22:16.267071 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 09:22:16.267071 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 09:22:16.267071 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 09:22:16.267071 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self.creator() Jul 28 09:22:16.267071 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 09:22:16.267071 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application created_value = creator( Jul 28 09:22:16.269726 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 09:22:16.269726 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 09:22:16.269726 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 09:22:16.269726 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application Jul 28 09:22:16.269726 dv-cinder-851351-1-smb devstack@keystone.service[479852]: [pid: 479852|app: 0|req: 622/1228] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 09:22:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 246 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 09:22:16.274545 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e7fb7c3-461b-4c82-bc05-972258e37f77 None admin] Authenticating user token {{(pid=479851) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:22:16.436542 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e7fb7c3-461b-4c82-bc05-972258e37f77 None admin] Validating token access rules against request {{(pid=479851) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:22:16.440805 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG dbcounter [-] [479851] Writing DB stats keystone:SELECT=100 {{(pid=479851) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:22:16.482589 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f98e29c-d65c-4b88-b0db-778e02f72f27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479851) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:22:16.483600 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f98e29c-d65c-4b88-b0db-778e02f72f27 None admin] REQUEST_METHOD: `GET` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:22:16.484042 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f98e29c-d65c-4b88-b0db-778e02f72f27 None admin] SCRIPT_NAME: `/identity` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:22:16.484548 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f98e29c-d65c-4b88-b0db-778e02f72f27 None admin] PATH_INFO: `/v3/domains` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:22:16.485605 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f98e29c-d65c-4b88-b0db-778e02f72f27 None admin] RBAC: Adding query filter params (name=Default) {{(pid=479851) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 09:22:16.486039 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f98e29c-d65c-4b88-b0db-778e02f72f27 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:22:16.488314 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f98e29c-d65c-4b88-b0db-778e02f72f27 None admin] RBAC: Authorization granted {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:22:16.508203 dv-cinder-851351-1-smb devstack@keystone.service[479851]: [pid: 479851|app: 0|req: 607/1229] 10.222.0.42 () {56 vars in 1109 bytes} [Thu Jul 28 09:22:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 09:22:16.514858 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55fef33f-fdd8-49e3-9f67-eb46d65063dc None admin] Authenticating user token {{(pid=479852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:22:16.527817 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG dbcounter [-] [479852] Writing DB stats keystone:SELECT=100 {{(pid=479852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:22:16.664986 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55fef33f-fdd8-49e3-9f67-eb46d65063dc None admin] Validating token access rules against request {{(pid=479852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:22:16.718263 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8159d60-8b79-453a-8388-f3d0467339a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:22:16.718263 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8159d60-8b79-453a-8388-f3d0467339a7 None admin] REQUEST_METHOD: `GET` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:22:16.720116 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8159d60-8b79-453a-8388-f3d0467339a7 None admin] SCRIPT_NAME: `/identity` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:22:16.720607 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8159d60-8b79-453a-8388-f3d0467339a7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:22:16.734288 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8159d60-8b79-453a-8388-f3d0467339a7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:22:16.737481 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8159d60-8b79-453a-8388-f3d0467339a7 None admin] RBAC: Authorization granted {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:22:16.761499 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application [None req-d8159d60-8b79-453a-8388-f3d0467339a7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 09:22:16.761499 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 09:22:16.761499 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 09:22:16.761499 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 09:22:16.761499 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 09:22:16.761499 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 09:22:16.761499 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 09:22:16.761499 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 09:22:16.761499 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 09:22:16.761499 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 09:22:16.761499 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 09:22:16.761499 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 09:22:16.761499 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 28 09:22:16.761499 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 28 09:22:16.761499 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 28 09:22:16.763775 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 28 09:22:16.763775 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 09:22:16.763775 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 09:22:16.763775 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 09:22:16.763775 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 09:22:16.763775 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 09:22:16.763775 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 09:22:16.763775 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 09:22:16.763775 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application with Lock( Jul 28 09:22:16.763775 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 09:22:16.763775 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self._enter() Jul 28 09:22:16.763775 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 09:22:16.763775 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 09:22:16.763775 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 09:22:16.763775 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self.creator() Jul 28 09:22:16.763775 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 09:22:16.763775 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application created_value = creator( Jul 28 09:22:16.765904 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 28 09:22:16.765904 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 28 09:22:16.765904 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 28 09:22:16.765904 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 28 09:22:16.765904 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 28 09:22:16.765904 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 28 09:22:16.765904 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 09:22:16.765904 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application Jul 28 09:22:16.765904 dv-cinder-851351-1-smb devstack@keystone.service[479852]: [pid: 479852|app: 0|req: 623/1230] 10.222.0.42 () {56 vars in 1111 bytes} [Thu Jul 28 09:22:16 2022] GET /identity/v3/projects/service => generated 88 bytes in 250 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 09:22:16.772748 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f98e29c-d65c-4b88-b0db-778e02f72f27 None admin] Authenticating user token {{(pid=479851) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:22:16.951841 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f98e29c-d65c-4b88-b0db-778e02f72f27 None admin] Validating token access rules against request {{(pid=479851) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:22:17.010807 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b0921b0-66e1-45cf-acf5-bb5ed56f6134 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479851) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:22:17.011962 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0921b0-66e1-45cf-acf5-bb5ed56f6134 None admin] REQUEST_METHOD: `GET` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:22:17.012432 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0921b0-66e1-45cf-acf5-bb5ed56f6134 None admin] SCRIPT_NAME: `/identity` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:22:17.012989 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0921b0-66e1-45cf-acf5-bb5ed56f6134 None admin] PATH_INFO: `/v3/projects` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:22:17.014545 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b0921b0-66e1-45cf-acf5-bb5ed56f6134 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=479851) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 09:22:17.015091 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b0921b0-66e1-45cf-acf5-bb5ed56f6134 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:22:17.018111 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b0921b0-66e1-45cf-acf5-bb5ed56f6134 None admin] RBAC: Authorization granted {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:22:17.038918 dv-cinder-851351-1-smb devstack@keystone.service[479851]: [pid: 479851|app: 0|req: 608/1231] 10.222.0.42 () {56 vars in 1148 bytes} [Thu Jul 28 09:22:16 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 09:22:17.049902 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8159d60-8b79-453a-8388-f3d0467339a7 None admin] Authenticating user token {{(pid=479852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:22:17.146792 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG dbcounter [-] [479852] Writing DB stats keystone:SELECT=100 {{(pid=479852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:22:17.203671 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8159d60-8b79-453a-8388-f3d0467339a7 None admin] Validating token access rules against request {{(pid=479852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:22:17.252438 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe2f544-8474-4ebb-9936-ccb8f2e99e31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:22:17.253265 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe2f544-8474-4ebb-9936-ccb8f2e99e31 None admin] REQUEST_METHOD: `PUT` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:22:17.253530 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe2f544-8474-4ebb-9936-ccb8f2e99e31 None admin] SCRIPT_NAME: `/identity` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:22:17.254006 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe2f544-8474-4ebb-9936-ccb8f2e99e31 None admin] PATH_INFO: `/v3/projects/3a0fb8ea8010437bade8f92dcbcaacee/users/11cfcbc665524cec9b6b7de34f52170d/roles/bd74dfcbc8d7412689d315fe24a1f247` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:22:17.273210 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe2f544-8474-4ebb-9936-ccb8f2e99e31 None admin] RBAC: Authorizing `identity:create_grant(project_id=3a0fb8ea8010437bade8f92dcbcaacee, user_id=11cfcbc665524cec9b6b7de34f52170d, role_id=bd74dfcbc8d7412689d315fe24a1f247)` {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:22:17.275085 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe2f544-8474-4ebb-9936-ccb8f2e99e31 None admin] RBAC: Authorization granted {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:22:17.294787 dv-cinder-851351-1-smb devstack@keystone.service[479852]: [pid: 479852|app: 0|req: 624/1232] 10.222.0.42 () {58 vars in 1439 bytes} [Thu Jul 28 09:22:17 2022] PUT /identity/v3/projects/3a0fb8ea8010437bade8f92dcbcaacee/users/11cfcbc665524cec9b6b7de34f52170d/roles/bd74dfcbc8d7412689d315fe24a1f247 => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 28 09:22:19.801864 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff54ccbc-37a6-45ac-b6f3-a7165dbac6cd None None] REQUEST_METHOD: `GET` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:22:19.802658 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff54ccbc-37a6-45ac-b6f3-a7165dbac6cd None None] SCRIPT_NAME: `/identity` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:22:19.803203 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff54ccbc-37a6-45ac-b6f3-a7165dbac6cd None None] PATH_INFO: `/` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:22:19.806052 dv-cinder-851351-1-smb devstack@keystone.service[479851]: [pid: 479851|app: 0|req: 609/1233] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 09:22:19 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 09:22:19.813179 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff21b159-ddc4-40de-8592-12ad17796c5e None None] REQUEST_METHOD: `POST` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:22:19.814185 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff21b159-ddc4-40de-8592-12ad17796c5e None None] SCRIPT_NAME: `/identity` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:22:19.814185 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff21b159-ddc4-40de-8592-12ad17796c5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:22:19.846786 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.auth.core [None req-ff21b159-ddc4-40de-8592-12ad17796c5e None None] MFA Rules not processed for user `c198f91a4ae84d2b9cc730a6e304c2be`. Rule list: `[]` (Enabled: `True`). {{(pid=479852) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 09:22:19.849070 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.fernet_utils [None req-ff21b159-ddc4-40de-8592-12ad17796c5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=479852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 09:22:19.975146 dv-cinder-851351-1-smb devstack@keystone.service[479852]: [pid: 479852|app: 0|req: 625/1234] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 09:22:19 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 09:22:19.999027 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff54ccbc-37a6-45ac-b6f3-a7165dbac6cd None None] Authenticating user token {{(pid=479851) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:22:20.039304 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG dbcounter [-] [479851] Writing DB stats keystone:SELECT=100 {{(pid=479851) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:22:20.179233 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff54ccbc-37a6-45ac-b6f3-a7165dbac6cd None None] Validating token access rules against request {{(pid=479851) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:22:20.251043 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-112105cb-8579-4784-98ed-16c9e209f8af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479851) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:22:20.252115 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112105cb-8579-4784-98ed-16c9e209f8af None admin] REQUEST_METHOD: `GET` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:22:20.252580 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112105cb-8579-4784-98ed-16c9e209f8af None admin] SCRIPT_NAME: `/identity` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:22:20.253072 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112105cb-8579-4784-98ed-16c9e209f8af None admin] PATH_INFO: `/v3/roles/service` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:22:20.274965 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-112105cb-8579-4784-98ed-16c9e209f8af None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 09:22:20.286893 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application [None req-112105cb-8579-4784-98ed-16c9e209f8af None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 28 09:22:20.286893 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 09:22:20.286893 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 09:22:20.286893 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 09:22:20.286893 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 09:22:20.286893 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 09:22:20.286893 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 09:22:20.286893 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 09:22:20.286893 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 09:22:20.286893 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 09:22:20.286893 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 09:22:20.286893 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 09:22:20.286893 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 09:22:20.286893 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 09:22:20.286893 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 09:22:20.286893 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 09:22:20.288693 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 09:22:20.288693 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 09:22:20.288693 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 09:22:20.288693 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 09:22:20.288693 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 09:22:20.288693 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 09:22:20.288693 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 09:22:20.288693 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 09:22:20.288693 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 09:22:20.288693 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 09:22:20.288693 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 09:22:20.288693 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application with Lock( Jul 28 09:22:20.288693 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 09:22:20.288693 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return self._enter() Jul 28 09:22:20.288693 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 09:22:20.288693 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 09:22:20.290007 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 09:22:20.290007 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return self.creator() Jul 28 09:22:20.290007 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 09:22:20.290007 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application created_value = creator( Jul 28 09:22:20.290007 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 09:22:20.290007 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 09:22:20.290007 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 09:22:20.290007 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 09:22:20.290007 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 09:22:20.290007 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 09:22:20.290007 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 28 09:22:20.290007 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application Jul 28 09:22:20.290007 dv-cinder-851351-1-smb devstack@keystone.service[479851]: [pid: 479851|app: 0|req: 610/1235] 10.222.0.42 () {56 vars in 1102 bytes} [Thu Jul 28 09:22:19 2022] GET /identity/v3/roles/service => generated 85 bytes in 291 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 09:22:20.301609 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff21b159-ddc4-40de-8592-12ad17796c5e None None] Authenticating user token {{(pid=479852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:22:20.382182 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG dbcounter [-] [479852] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=479852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:22:20.452789 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff21b159-ddc4-40de-8592-12ad17796c5e None None] Validating token access rules against request {{(pid=479852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:22:20.501225 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a818246b-fd15-4115-8f94-d01de1e4c4e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:22:20.501877 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a818246b-fd15-4115-8f94-d01de1e4c4e6 None admin] REQUEST_METHOD: `GET` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:22:20.502156 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a818246b-fd15-4115-8f94-d01de1e4c4e6 None admin] SCRIPT_NAME: `/identity` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:22:20.502431 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a818246b-fd15-4115-8f94-d01de1e4c4e6 None admin] PATH_INFO: `/v3/roles` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:22:20.503175 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a818246b-fd15-4115-8f94-d01de1e4c4e6 None admin] RBAC: Adding query filter params (name=service) {{(pid=479852) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 09:22:20.503480 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a818246b-fd15-4115-8f94-d01de1e4c4e6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:22:20.504965 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a818246b-fd15-4115-8f94-d01de1e4c4e6 None admin] RBAC: Authorization granted {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:22:20.514477 dv-cinder-851351-1-smb devstack@keystone.service[479852]: [pid: 479852|app: 0|req: 626/1236] 10.222.0.42 () {56 vars in 1103 bytes} [Thu Jul 28 09:22:20 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:22:20.521552 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-112105cb-8579-4784-98ed-16c9e209f8af None admin] Authenticating user token {{(pid=479851) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:22:20.622845 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG dbcounter [-] [479851] Writing DB stats keystone:SELECT=100 {{(pid=479851) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:22:20.652523 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-112105cb-8579-4784-98ed-16c9e209f8af None admin] Validating token access rules against request {{(pid=479851) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:22:20.706954 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af8019ec-eb89-4ea5-a866-429b04013a49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479851) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:22:20.707602 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8019ec-eb89-4ea5-a866-429b04013a49 None admin] REQUEST_METHOD: `GET` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:22:20.707963 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8019ec-eb89-4ea5-a866-429b04013a49 None admin] SCRIPT_NAME: `/identity` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:22:20.708323 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8019ec-eb89-4ea5-a866-429b04013a49 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:22:20.724930 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af8019ec-eb89-4ea5-a866-429b04013a49 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:22:20.727719 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af8019ec-eb89-4ea5-a866-429b04013a49 None admin] RBAC: Authorization granted {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:22:20.758785 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application [None req-af8019ec-eb89-4ea5-a866-429b04013a49 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 09:22:20.758785 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 09:22:20.758785 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 09:22:20.758785 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 09:22:20.758785 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 09:22:20.758785 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 09:22:20.758785 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 09:22:20.758785 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 09:22:20.758785 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 09:22:20.758785 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 09:22:20.758785 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 09:22:20.758785 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 09:22:20.758785 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 09:22:20.758785 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 09:22:20.758785 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 09:22:20.760973 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 09:22:20.760973 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 09:22:20.760973 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 09:22:20.760973 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 09:22:20.760973 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 09:22:20.760973 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 09:22:20.760973 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 09:22:20.760973 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 09:22:20.760973 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application with Lock( Jul 28 09:22:20.760973 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 09:22:20.760973 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return self._enter() Jul 28 09:22:20.760973 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 09:22:20.760973 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 09:22:20.760973 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 09:22:20.760973 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return self.creator() Jul 28 09:22:20.760973 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 09:22:20.760973 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application created_value = creator( Jul 28 09:22:20.763116 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 09:22:20.763116 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 09:22:20.763116 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 09:22:20.763116 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application Jul 28 09:22:20.763116 dv-cinder-851351-1-smb devstack@keystone.service[479851]: [pid: 479851|app: 0|req: 611/1237] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 09:22:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 09:22:20.768435 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a818246b-fd15-4115-8f94-d01de1e4c4e6 None admin] Authenticating user token {{(pid=479852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:22:20.926330 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a818246b-fd15-4115-8f94-d01de1e4c4e6 None admin] Validating token access rules against request {{(pid=479852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:22:20.944647 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG dbcounter [-] [479852] Writing DB stats keystone:SELECT=100 {{(pid=479852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:22:20.987420 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84896621-ed6b-453a-8019-1edcc1826cb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:22:20.988163 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84896621-ed6b-453a-8019-1edcc1826cb1 None admin] REQUEST_METHOD: `GET` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:22:20.988547 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84896621-ed6b-453a-8019-1edcc1826cb1 None admin] SCRIPT_NAME: `/identity` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:22:20.988914 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84896621-ed6b-453a-8019-1edcc1826cb1 None admin] PATH_INFO: `/v3/domains` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:22:20.989757 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84896621-ed6b-453a-8019-1edcc1826cb1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=479852) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 09:22:20.990153 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84896621-ed6b-453a-8019-1edcc1826cb1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:22:20.991826 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84896621-ed6b-453a-8019-1edcc1826cb1 None admin] RBAC: Authorization granted {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:22:21.008235 dv-cinder-851351-1-smb devstack@keystone.service[479852]: [pid: 479852|app: 0|req: 627/1238] 10.222.0.42 () {56 vars in 1109 bytes} [Thu Jul 28 09:22:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:22:21.015945 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af8019ec-eb89-4ea5-a866-429b04013a49 None admin] Authenticating user token {{(pid=479851) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:22:21.172042 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af8019ec-eb89-4ea5-a866-429b04013a49 None admin] Validating token access rules against request {{(pid=479851) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:22:21.234339 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70066086-8c42-49ab-96d2-a71fc33e8390 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479851) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:22:21.235641 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70066086-8c42-49ab-96d2-a71fc33e8390 None admin] REQUEST_METHOD: `GET` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:22:21.236163 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70066086-8c42-49ab-96d2-a71fc33e8390 None admin] SCRIPT_NAME: `/identity` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:22:21.236725 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70066086-8c42-49ab-96d2-a71fc33e8390 None admin] PATH_INFO: `/v3/users/placement` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:22:21.241425 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG dbcounter [-] [479851] Writing DB stats keystone:SELECT=100 {{(pid=479851) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:22:21.249862 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70066086-8c42-49ab-96d2-a71fc33e8390 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:22:21.251786 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70066086-8c42-49ab-96d2-a71fc33e8390 None admin] RBAC: Authorization granted {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:22:21.271677 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application [None req-70066086-8c42-49ab-96d2-a71fc33e8390 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 28 09:22:21.271677 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 09:22:21.271677 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 09:22:21.271677 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 09:22:21.271677 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 09:22:21.271677 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 09:22:21.271677 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 09:22:21.271677 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 09:22:21.271677 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 09:22:21.271677 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 09:22:21.271677 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 09:22:21.271677 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 09:22:21.271677 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 28 09:22:21.271677 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 28 09:22:21.271677 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 28 09:22:21.271677 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 28 09:22:21.273092 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 09:22:21.273092 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 09:22:21.273092 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 28 09:22:21.273092 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 09:22:21.273092 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 28 09:22:21.273092 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 09:22:21.273092 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 09:22:21.273092 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 09:22:21.273092 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 09:22:21.273092 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 09:22:21.273092 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 09:22:21.273092 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application with Lock( Jul 28 09:22:21.273092 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 09:22:21.273092 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return self._enter() Jul 28 09:22:21.273092 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 09:22:21.273092 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 09:22:21.273092 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 09:22:21.273092 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return self.creator() Jul 28 09:22:21.274310 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 09:22:21.274310 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application created_value = creator( Jul 28 09:22:21.274310 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 28 09:22:21.274310 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 28 09:22:21.274310 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 28 09:22:21.274310 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 28 09:22:21.274310 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 28 09:22:21.274310 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 28 09:22:21.274310 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 28 09:22:21.274310 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application Jul 28 09:22:21.274310 dv-cinder-851351-1-smb devstack@keystone.service[479851]: [pid: 479851|app: 0|req: 612/1239] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 09:22:21 2022] GET /identity/v3/users/placement => generated 87 bytes in 259 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 09:22:21.283733 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84896621-ed6b-453a-8019-1edcc1826cb1 None admin] Authenticating user token {{(pid=479852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:22:21.455182 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84896621-ed6b-453a-8019-1edcc1826cb1 None admin] Validating token access rules against request {{(pid=479852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:22:21.511066 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9038b6c2-f54d-4a06-82c7-b6c29782e321 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:22:21.511610 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9038b6c2-f54d-4a06-82c7-b6c29782e321 None admin] REQUEST_METHOD: `GET` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:22:21.511893 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9038b6c2-f54d-4a06-82c7-b6c29782e321 None admin] SCRIPT_NAME: `/identity` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:22:21.512171 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9038b6c2-f54d-4a06-82c7-b6c29782e321 None admin] PATH_INFO: `/v3/users` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:22:21.513051 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9038b6c2-f54d-4a06-82c7-b6c29782e321 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=479852) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 09:22:21.513362 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9038b6c2-f54d-4a06-82c7-b6c29782e321 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:22:21.514977 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9038b6c2-f54d-4a06-82c7-b6c29782e321 None admin] RBAC: Authorization granted {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:22:21.546183 dv-cinder-851351-1-smb devstack@keystone.service[479852]: [pid: 479852|app: 0|req: 628/1240] 10.222.0.42 () {56 vars in 1143 bytes} [Thu Jul 28 09:22:21 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:22:21.547977 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70066086-8c42-49ab-96d2-a71fc33e8390 None admin] Authenticating user token {{(pid=479851) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:22:21.692905 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70066086-8c42-49ab-96d2-a71fc33e8390 None admin] Validating token access rules against request {{(pid=479851) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:22:21.751102 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01847fbc-0ba8-49da-be5d-212e9f479ea1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479851) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:22:21.751910 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01847fbc-0ba8-49da-be5d-212e9f479ea1 None admin] REQUEST_METHOD: `GET` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:22:21.752220 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01847fbc-0ba8-49da-be5d-212e9f479ea1 None admin] SCRIPT_NAME: `/identity` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:22:21.752547 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01847fbc-0ba8-49da-be5d-212e9f479ea1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:22:21.867757 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG dbcounter [-] [479851] Writing DB stats keystone:SELECT=100 {{(pid=479851) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:22:21.880381 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01847fbc-0ba8-49da-be5d-212e9f479ea1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:22:21.883023 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01847fbc-0ba8-49da-be5d-212e9f479ea1 None admin] RBAC: Authorization granted {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:22:22.048103 dv-cinder-851351-1-smb devstack@keystone.service[479851]: [pid: 479851|app: 0|req: 613/1241] 10.222.0.42 () {58 vars in 1282 bytes} [Thu Jul 28 09:22:21 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 501 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jul 28 09:22:22.056167 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9038b6c2-f54d-4a06-82c7-b6c29782e321 None admin] Authenticating user token {{(pid=479852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:22:22.100969 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG dbcounter [-] [479852] Writing DB stats keystone:SELECT=100 {{(pid=479852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:22:22.223787 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9038b6c2-f54d-4a06-82c7-b6c29782e321 None admin] Validating token access rules against request {{(pid=479852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:22:22.278402 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18269eb1-e2b3-45e4-801a-0f3e8ec604c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:22:22.279487 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18269eb1-e2b3-45e4-801a-0f3e8ec604c2 None admin] REQUEST_METHOD: `GET` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:22:22.279970 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18269eb1-e2b3-45e4-801a-0f3e8ec604c2 None admin] SCRIPT_NAME: `/identity` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:22:22.280451 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18269eb1-e2b3-45e4-801a-0f3e8ec604c2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:22:22.298715 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18269eb1-e2b3-45e4-801a-0f3e8ec604c2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:22:22.300949 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18269eb1-e2b3-45e4-801a-0f3e8ec604c2 None admin] RBAC: Authorization granted {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:22:22.324297 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application [None req-18269eb1-e2b3-45e4-801a-0f3e8ec604c2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 09:22:22.324297 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 09:22:22.324297 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 09:22:22.324297 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 09:22:22.324297 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 09:22:22.324297 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 09:22:22.324297 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 09:22:22.324297 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 09:22:22.324297 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 09:22:22.324297 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 09:22:22.324297 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 09:22:22.324297 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 09:22:22.324297 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 09:22:22.324297 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 09:22:22.324297 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 09:22:22.326613 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 09:22:22.326613 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 09:22:22.326613 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 09:22:22.326613 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 09:22:22.326613 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 09:22:22.326613 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 09:22:22.326613 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 09:22:22.326613 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 09:22:22.326613 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application with Lock( Jul 28 09:22:22.326613 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 09:22:22.326613 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self._enter() Jul 28 09:22:22.326613 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 09:22:22.326613 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 09:22:22.326613 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 09:22:22.326613 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self.creator() Jul 28 09:22:22.326613 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 09:22:22.326613 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application created_value = creator( Jul 28 09:22:22.328736 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 09:22:22.328736 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 09:22:22.328736 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 09:22:22.328736 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application Jul 28 09:22:22.328736 dv-cinder-851351-1-smb devstack@keystone.service[479852]: [pid: 479852|app: 0|req: 629/1242] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 09:22:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 271 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 09:22:22.332785 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01847fbc-0ba8-49da-be5d-212e9f479ea1 None admin] Authenticating user token {{(pid=479851) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:22:22.484932 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG dbcounter [-] [479851] Writing DB stats keystone:SELECT=100 {{(pid=479851) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:22:22.494405 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01847fbc-0ba8-49da-be5d-212e9f479ea1 None admin] Validating token access rules against request {{(pid=479851) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:22:22.535464 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c6805d-3f73-4b27-976f-5610938ad581 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479851) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:22:22.536109 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c6805d-3f73-4b27-976f-5610938ad581 None admin] REQUEST_METHOD: `GET` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:22:22.536394 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c6805d-3f73-4b27-976f-5610938ad581 None admin] SCRIPT_NAME: `/identity` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:22:22.536698 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c6805d-3f73-4b27-976f-5610938ad581 None admin] PATH_INFO: `/v3/domains` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:22:22.537406 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c6805d-3f73-4b27-976f-5610938ad581 None admin] RBAC: Adding query filter params (name=Default) {{(pid=479851) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 09:22:22.537712 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c6805d-3f73-4b27-976f-5610938ad581 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:22:22.539106 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c6805d-3f73-4b27-976f-5610938ad581 None admin] RBAC: Authorization granted {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:22:22.552050 dv-cinder-851351-1-smb devstack@keystone.service[479851]: [pid: 479851|app: 0|req: 614/1243] 10.222.0.42 () {56 vars in 1109 bytes} [Thu Jul 28 09:22:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:22:22.558656 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18269eb1-e2b3-45e4-801a-0f3e8ec604c2 None admin] Authenticating user token {{(pid=479852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:22:22.688406 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG dbcounter [-] [479852] Writing DB stats keystone:SELECT=100 {{(pid=479852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:22:22.719906 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18269eb1-e2b3-45e4-801a-0f3e8ec604c2 None admin] Validating token access rules against request {{(pid=479852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:22:22.784786 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c9ffd1-9358-48bc-accd-5da5eee89bd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:22:22.785644 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c9ffd1-9358-48bc-accd-5da5eee89bd8 None admin] REQUEST_METHOD: `GET` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:22:22.786127 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c9ffd1-9358-48bc-accd-5da5eee89bd8 None admin] SCRIPT_NAME: `/identity` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:22:22.786540 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c9ffd1-9358-48bc-accd-5da5eee89bd8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:22:22.799171 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00c9ffd1-9358-48bc-accd-5da5eee89bd8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:22:22.800909 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00c9ffd1-9358-48bc-accd-5da5eee89bd8 None admin] RBAC: Authorization granted {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:22:22.817249 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application [None req-00c9ffd1-9358-48bc-accd-5da5eee89bd8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 09:22:22.817249 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 09:22:22.817249 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 09:22:22.817249 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 09:22:22.817249 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 09:22:22.817249 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 09:22:22.817249 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 09:22:22.817249 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 09:22:22.817249 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 09:22:22.817249 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 09:22:22.817249 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 09:22:22.817249 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 09:22:22.817249 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 28 09:22:22.817249 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 28 09:22:22.817249 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 28 09:22:22.819459 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 28 09:22:22.819459 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 09:22:22.819459 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 09:22:22.819459 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 09:22:22.819459 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 09:22:22.819459 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 09:22:22.819459 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 09:22:22.819459 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 09:22:22.819459 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application with Lock( Jul 28 09:22:22.819459 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 09:22:22.819459 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self._enter() Jul 28 09:22:22.819459 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 09:22:22.819459 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 09:22:22.819459 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 09:22:22.819459 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self.creator() Jul 28 09:22:22.819459 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 09:22:22.819459 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application created_value = creator( Jul 28 09:22:22.822024 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 28 09:22:22.822024 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 28 09:22:22.822024 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 28 09:22:22.822024 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 28 09:22:22.822024 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 28 09:22:22.822024 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 28 09:22:22.822024 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 09:22:22.822024 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application Jul 28 09:22:22.822024 dv-cinder-851351-1-smb devstack@keystone.service[479852]: [pid: 479852|app: 0|req: 630/1244] 10.222.0.42 () {56 vars in 1111 bytes} [Thu Jul 28 09:22:22 2022] GET /identity/v3/projects/service => generated 88 bytes in 261 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 09:22:22.831844 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c6805d-3f73-4b27-976f-5610938ad581 None admin] Authenticating user token {{(pid=479851) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:22:23.007653 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c6805d-3f73-4b27-976f-5610938ad581 None admin] Validating token access rules against request {{(pid=479851) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:22:23.073067 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92709374-335d-41f2-a6b3-9793c2a4e00c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479851) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:22:23.074181 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92709374-335d-41f2-a6b3-9793c2a4e00c None admin] REQUEST_METHOD: `GET` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:22:23.074181 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92709374-335d-41f2-a6b3-9793c2a4e00c None admin] SCRIPT_NAME: `/identity` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:22:23.074181 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92709374-335d-41f2-a6b3-9793c2a4e00c None admin] PATH_INFO: `/v3/projects` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:22:23.075023 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92709374-335d-41f2-a6b3-9793c2a4e00c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=479851) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 09:22:23.075415 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92709374-335d-41f2-a6b3-9793c2a4e00c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:22:23.076950 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92709374-335d-41f2-a6b3-9793c2a4e00c None admin] RBAC: Authorization granted {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:22:23.097050 dv-cinder-851351-1-smb devstack@keystone.service[479851]: [pid: 479851|app: 0|req: 615/1245] 10.222.0.42 () {56 vars in 1148 bytes} [Thu Jul 28 09:22:22 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:22:23.103669 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c9ffd1-9358-48bc-accd-5da5eee89bd8 None admin] Authenticating user token {{(pid=479852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:22:23.265618 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c9ffd1-9358-48bc-accd-5da5eee89bd8 None admin] Validating token access rules against request {{(pid=479852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:22:23.308184 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f6cf7b-30d0-4281-a6ea-572925d0154c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:22:23.308957 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f6cf7b-30d0-4281-a6ea-572925d0154c None admin] REQUEST_METHOD: `GET` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:22:23.309324 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f6cf7b-30d0-4281-a6ea-572925d0154c None admin] SCRIPT_NAME: `/identity` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:22:23.309830 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f6cf7b-30d0-4281-a6ea-572925d0154c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:22:23.310435 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f6cf7b-30d0-4281-a6ea-572925d0154c None admin] RBAC: Adding query filter params (role.id=bd74dfcbc8d7412689d315fe24a1f247, scope.project.id=3a0fb8ea8010437bade8f92dcbcaacee, user.id=11cfcbc665524cec9b6b7de34f52170d) {{(pid=479852) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 09:22:23.310728 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f6cf7b-30d0-4281-a6ea-572925d0154c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:22:23.312301 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f6cf7b-30d0-4281-a6ea-572925d0154c None admin] RBAC: Authorization granted {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:22:23.320567 dv-cinder-851351-1-smb devstack@keystone.service[479852]: [pid: 479852|app: 0|req: 631/1246] 10.222.0.42 () {56 vars in 1374 bytes} [Thu Jul 28 09:22:23 2022] GET /identity/v3/role_assignments?user.id=11cfcbc665524cec9b6b7de34f52170d&scope.project.id=3a0fb8ea8010437bade8f92dcbcaacee&role.id=bd74dfcbc8d7412689d315fe24a1f247 => generated 608 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:22:25.749966 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd77f0e1-44f5-4d27-93df-30f7d09adc04 None None] REQUEST_METHOD: `GET` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:22:25.750568 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd77f0e1-44f5-4d27-93df-30f7d09adc04 None None] SCRIPT_NAME: `/identity` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:22:25.751128 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd77f0e1-44f5-4d27-93df-30f7d09adc04 None None] PATH_INFO: `/` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:22:25.753963 dv-cinder-851351-1-smb devstack@keystone.service[479851]: [pid: 479851|app: 0|req: 616/1247] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 09:22:25 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 09:22:25.762241 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c202ef6f-83a5-4711-8870-f5ff05ff64f3 None None] REQUEST_METHOD: `POST` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:22:25.762241 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c202ef6f-83a5-4711-8870-f5ff05ff64f3 None None] SCRIPT_NAME: `/identity` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:22:25.762241 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c202ef6f-83a5-4711-8870-f5ff05ff64f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:22:25.771265 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG dbcounter [-] [479852] Writing DB stats keystone:SELECT=100 {{(pid=479852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:22:25.786075 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.auth.core [None req-c202ef6f-83a5-4711-8870-f5ff05ff64f3 None None] MFA Rules not processed for user `c198f91a4ae84d2b9cc730a6e304c2be`. Rule list: `[]` (Enabled: `True`). {{(pid=479852) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 09:22:25.787495 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.fernet_utils [None req-c202ef6f-83a5-4711-8870-f5ff05ff64f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=479852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 09:22:25.886427 dv-cinder-851351-1-smb devstack@keystone.service[479852]: [pid: 479852|app: 0|req: 632/1248] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 09:22:25 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 09:22:25.917673 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd77f0e1-44f5-4d27-93df-30f7d09adc04 None None] Authenticating user token {{(pid=479851) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:22:25.940067 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG dbcounter [-] [479851] Writing DB stats keystone:SELECT=100 {{(pid=479851) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:22:26.064750 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd77f0e1-44f5-4d27-93df-30f7d09adc04 None None] Validating token access rules against request {{(pid=479851) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:22:26.119027 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b957c72-c3b2-4c26-a573-2ccfceab4418 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479851) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:22:26.120108 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b957c72-c3b2-4c26-a573-2ccfceab4418 None admin] REQUEST_METHOD: `GET` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:22:26.120495 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b957c72-c3b2-4c26-a573-2ccfceab4418 None admin] SCRIPT_NAME: `/identity` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:22:26.120916 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b957c72-c3b2-4c26-a573-2ccfceab4418 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:22:26.135009 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b957c72-c3b2-4c26-a573-2ccfceab4418 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 09:22:26.142064 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application [None req-0b957c72-c3b2-4c26-a573-2ccfceab4418 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 09:22:26.142064 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 09:22:26.142064 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 09:22:26.142064 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 09:22:26.142064 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 09:22:26.142064 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 09:22:26.142064 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 09:22:26.142064 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 09:22:26.142064 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 09:22:26.142064 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 09:22:26.142064 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 09:22:26.142064 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 09:22:26.142064 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 09:22:26.142064 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 09:22:26.142064 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 09:22:26.142064 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 09:22:26.144444 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 09:22:26.144444 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 09:22:26.144444 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 09:22:26.144444 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 09:22:26.144444 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 09:22:26.144444 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 09:22:26.144444 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 09:22:26.144444 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 09:22:26.144444 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 09:22:26.144444 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 09:22:26.144444 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 09:22:26.144444 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application with Lock( Jul 28 09:22:26.144444 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 09:22:26.144444 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return self._enter() Jul 28 09:22:26.144444 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 09:22:26.144444 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 09:22:26.146708 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 09:22:26.146708 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return self.creator() Jul 28 09:22:26.146708 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 09:22:26.146708 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application created_value = creator( Jul 28 09:22:26.146708 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 09:22:26.146708 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 09:22:26.146708 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 09:22:26.146708 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 09:22:26.146708 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 09:22:26.146708 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 09:22:26.146708 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 09:22:26.146708 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application Jul 28 09:22:26.146708 dv-cinder-851351-1-smb devstack@keystone.service[479851]: [pid: 479851|app: 0|req: 617/1249] 10.222.0.42 () {56 vars in 1096 bytes} [Thu Jul 28 09:22:25 2022] GET /identity/v3/roles/admin => generated 83 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 09:22:26.151176 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c202ef6f-83a5-4711-8870-f5ff05ff64f3 None None] Authenticating user token {{(pid=479852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:22:26.294175 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c202ef6f-83a5-4711-8870-f5ff05ff64f3 None None] Validating token access rules against request {{(pid=479852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:22:26.341809 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG dbcounter [-] [479852] Writing DB stats keystone:SELECT=100 {{(pid=479852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:22:26.349601 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35bbb1bb-80fe-4610-be3e-a13bd02333fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:22:26.350471 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35bbb1bb-80fe-4610-be3e-a13bd02333fd None admin] REQUEST_METHOD: `GET` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:22:26.350857 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35bbb1bb-80fe-4610-be3e-a13bd02333fd None admin] SCRIPT_NAME: `/identity` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:22:26.351206 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35bbb1bb-80fe-4610-be3e-a13bd02333fd None admin] PATH_INFO: `/v3/roles` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:22:26.352286 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35bbb1bb-80fe-4610-be3e-a13bd02333fd None admin] RBAC: Adding query filter params (name=admin) {{(pid=479852) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 09:22:26.352783 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35bbb1bb-80fe-4610-be3e-a13bd02333fd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:22:26.354648 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35bbb1bb-80fe-4610-be3e-a13bd02333fd None admin] RBAC: Authorization granted {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:22:26.369212 dv-cinder-851351-1-smb devstack@keystone.service[479852]: [pid: 479852|app: 0|req: 633/1250] 10.222.0.42 () {56 vars in 1099 bytes} [Thu Jul 28 09:22:26 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:22:26.376714 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b957c72-c3b2-4c26-a573-2ccfceab4418 None admin] Authenticating user token {{(pid=479851) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:22:26.506683 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG dbcounter [-] [479851] Writing DB stats keystone:SELECT=100 {{(pid=479851) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:22:26.547576 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b957c72-c3b2-4c26-a573-2ccfceab4418 None admin] Validating token access rules against request {{(pid=479851) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:22:26.594940 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f1f2c4e-faa2-41bc-b542-2ec05a4fcb3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479851) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:22:26.595893 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1f2c4e-faa2-41bc-b542-2ec05a4fcb3c None admin] REQUEST_METHOD: `GET` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:22:26.596337 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1f2c4e-faa2-41bc-b542-2ec05a4fcb3c None admin] SCRIPT_NAME: `/identity` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:22:26.596849 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1f2c4e-faa2-41bc-b542-2ec05a4fcb3c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:22:26.612242 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f1f2c4e-faa2-41bc-b542-2ec05a4fcb3c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:22:26.614603 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f1f2c4e-faa2-41bc-b542-2ec05a4fcb3c None admin] RBAC: Authorization granted {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:22:26.638913 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application [None req-7f1f2c4e-faa2-41bc-b542-2ec05a4fcb3c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 09:22:26.638913 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 09:22:26.638913 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 09:22:26.638913 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 09:22:26.638913 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 09:22:26.638913 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 09:22:26.638913 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 09:22:26.638913 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 09:22:26.638913 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 09:22:26.638913 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 09:22:26.638913 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 09:22:26.638913 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 09:22:26.638913 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 09:22:26.638913 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 09:22:26.638913 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 09:22:26.641475 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 09:22:26.641475 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 09:22:26.641475 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 09:22:26.641475 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 09:22:26.641475 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 09:22:26.641475 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 09:22:26.641475 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 09:22:26.641475 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 09:22:26.641475 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application with Lock( Jul 28 09:22:26.641475 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 09:22:26.641475 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return self._enter() Jul 28 09:22:26.641475 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 09:22:26.641475 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 09:22:26.641475 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 09:22:26.641475 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return self.creator() Jul 28 09:22:26.641475 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 09:22:26.641475 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application created_value = creator( Jul 28 09:22:26.643845 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 09:22:26.643845 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 09:22:26.643845 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 09:22:26.643845 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application Jul 28 09:22:26.643845 dv-cinder-851351-1-smb devstack@keystone.service[479851]: [pid: 479851|app: 0|req: 618/1251] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 09:22:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 266 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 09:22:26.649647 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35bbb1bb-80fe-4610-be3e-a13bd02333fd None admin] Authenticating user token {{(pid=479852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:22:26.818897 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35bbb1bb-80fe-4610-be3e-a13bd02333fd None admin] Validating token access rules against request {{(pid=479852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:22:26.885881 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b11c0d-39d3-42b0-9c78-6ce56b1eb010 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:22:26.886578 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b11c0d-39d3-42b0-9c78-6ce56b1eb010 None admin] REQUEST_METHOD: `GET` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:22:26.886993 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b11c0d-39d3-42b0-9c78-6ce56b1eb010 None admin] SCRIPT_NAME: `/identity` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:22:26.887457 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b11c0d-39d3-42b0-9c78-6ce56b1eb010 None admin] PATH_INFO: `/v3/domains` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:22:26.888423 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36b11c0d-39d3-42b0-9c78-6ce56b1eb010 None admin] RBAC: Adding query filter params (name=Default) {{(pid=479852) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 09:22:26.888873 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36b11c0d-39d3-42b0-9c78-6ce56b1eb010 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:22:26.890943 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36b11c0d-39d3-42b0-9c78-6ce56b1eb010 None admin] RBAC: Authorization granted {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:22:26.912583 dv-cinder-851351-1-smb devstack@keystone.service[479852]: [pid: 479852|app: 0|req: 634/1252] 10.222.0.42 () {56 vars in 1109 bytes} [Thu Jul 28 09:22:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 09:22:26.919196 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f1f2c4e-faa2-41bc-b542-2ec05a4fcb3c None admin] Authenticating user token {{(pid=479851) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:22:27.066589 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f1f2c4e-faa2-41bc-b542-2ec05a4fcb3c None admin] Validating token access rules against request {{(pid=479851) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:22:27.105764 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG dbcounter [-] [479851] Writing DB stats keystone:SELECT=100 {{(pid=479851) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:22:27.117648 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3f1b55-2042-43f9-aa36-377b7e2c4726 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479851) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:22:27.118680 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3f1b55-2042-43f9-aa36-377b7e2c4726 None admin] REQUEST_METHOD: `GET` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:22:27.119131 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3f1b55-2042-43f9-aa36-377b7e2c4726 None admin] SCRIPT_NAME: `/identity` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:22:27.119482 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3f1b55-2042-43f9-aa36-377b7e2c4726 None admin] PATH_INFO: `/v3/users/placement` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:22:27.132340 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de3f1b55-2042-43f9-aa36-377b7e2c4726 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:22:27.134621 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de3f1b55-2042-43f9-aa36-377b7e2c4726 None admin] RBAC: Authorization granted {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:22:27.151334 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application [None req-de3f1b55-2042-43f9-aa36-377b7e2c4726 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 28 09:22:27.151334 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 09:22:27.151334 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 09:22:27.151334 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 09:22:27.151334 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 09:22:27.151334 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 09:22:27.151334 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 09:22:27.151334 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 09:22:27.151334 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 09:22:27.151334 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 09:22:27.151334 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 09:22:27.151334 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 09:22:27.151334 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 28 09:22:27.151334 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 28 09:22:27.151334 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 28 09:22:27.151334 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 28 09:22:27.153649 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 09:22:27.153649 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 09:22:27.153649 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 28 09:22:27.153649 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 09:22:27.153649 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 28 09:22:27.153649 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 09:22:27.153649 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 09:22:27.153649 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 09:22:27.153649 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 09:22:27.153649 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 09:22:27.153649 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 09:22:27.153649 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application with Lock( Jul 28 09:22:27.153649 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 09:22:27.153649 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return self._enter() Jul 28 09:22:27.153649 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 09:22:27.153649 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 09:22:27.153649 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 09:22:27.153649 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return self.creator() Jul 28 09:22:27.156074 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 09:22:27.156074 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application created_value = creator( Jul 28 09:22:27.156074 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 28 09:22:27.156074 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 28 09:22:27.156074 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 28 09:22:27.156074 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 28 09:22:27.156074 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 28 09:22:27.156074 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 28 09:22:27.156074 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 28 09:22:27.156074 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application Jul 28 09:22:27.156074 dv-cinder-851351-1-smb devstack@keystone.service[479851]: [pid: 479851|app: 0|req: 619/1253] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 09:22:26 2022] GET /identity/v3/users/placement => generated 87 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 09:22:27.160629 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b11c0d-39d3-42b0-9c78-6ce56b1eb010 None admin] Authenticating user token {{(pid=479852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:22:27.248414 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG dbcounter [-] [479852] Writing DB stats keystone:SELECT=100 {{(pid=479852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:22:27.315861 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b11c0d-39d3-42b0-9c78-6ce56b1eb010 None admin] Validating token access rules against request {{(pid=479852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:22:27.374328 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9da8b3e-330e-4d1d-bbd8-3f2dfc1ab033 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:22:27.374328 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9da8b3e-330e-4d1d-bbd8-3f2dfc1ab033 None admin] REQUEST_METHOD: `GET` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:22:27.374328 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9da8b3e-330e-4d1d-bbd8-3f2dfc1ab033 None admin] SCRIPT_NAME: `/identity` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:22:27.374328 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9da8b3e-330e-4d1d-bbd8-3f2dfc1ab033 None admin] PATH_INFO: `/v3/users` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:22:27.375116 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9da8b3e-330e-4d1d-bbd8-3f2dfc1ab033 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=479852) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 09:22:27.375116 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9da8b3e-330e-4d1d-bbd8-3f2dfc1ab033 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:22:27.376218 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9da8b3e-330e-4d1d-bbd8-3f2dfc1ab033 None admin] RBAC: Authorization granted {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:22:27.410965 dv-cinder-851351-1-smb devstack@keystone.service[479852]: [pid: 479852|app: 0|req: 635/1254] 10.222.0.42 () {56 vars in 1143 bytes} [Thu Jul 28 09:22:27 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:22:27.412545 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3f1b55-2042-43f9-aa36-377b7e2c4726 None admin] Authenticating user token {{(pid=479851) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:22:27.571493 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3f1b55-2042-43f9-aa36-377b7e2c4726 None admin] Validating token access rules against request {{(pid=479851) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:22:27.625693 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38019157-16be-4792-a773-0e6eb0e981da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479851) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:22:27.626712 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38019157-16be-4792-a773-0e6eb0e981da None admin] REQUEST_METHOD: `GET` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:22:27.627200 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38019157-16be-4792-a773-0e6eb0e981da None admin] SCRIPT_NAME: `/identity` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:22:27.627683 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38019157-16be-4792-a773-0e6eb0e981da None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:22:27.730374 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG dbcounter [-] [479851] Writing DB stats keystone:SELECT=100 {{(pid=479851) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:22:27.750204 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38019157-16be-4792-a773-0e6eb0e981da None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:22:27.752168 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38019157-16be-4792-a773-0e6eb0e981da None admin] RBAC: Authorization granted {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:22:27.912733 dv-cinder-851351-1-smb devstack@keystone.service[479851]: [pid: 479851|app: 0|req: 620/1255] 10.222.0.42 () {58 vars in 1282 bytes} [Thu Jul 28 09:22:27 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 501 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jul 28 09:22:27.919103 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9da8b3e-330e-4d1d-bbd8-3f2dfc1ab033 None admin] Authenticating user token {{(pid=479852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:22:28.069749 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9da8b3e-330e-4d1d-bbd8-3f2dfc1ab033 None admin] Validating token access rules against request {{(pid=479852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:22:28.090362 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG dbcounter [-] [479852] Writing DB stats keystone:SELECT=100 {{(pid=479852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:22:28.125419 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac131e59-e068-49e3-b9ab-8f3f77448459 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:22:28.126297 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac131e59-e068-49e3-b9ab-8f3f77448459 None admin] REQUEST_METHOD: `GET` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:22:28.126682 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac131e59-e068-49e3-b9ab-8f3f77448459 None admin] SCRIPT_NAME: `/identity` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:22:28.127082 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac131e59-e068-49e3-b9ab-8f3f77448459 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:22:28.143756 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac131e59-e068-49e3-b9ab-8f3f77448459 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:22:28.145892 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac131e59-e068-49e3-b9ab-8f3f77448459 None admin] RBAC: Authorization granted {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:22:28.169154 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application [None req-ac131e59-e068-49e3-b9ab-8f3f77448459 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 09:22:28.169154 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 09:22:28.169154 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 09:22:28.169154 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 09:22:28.169154 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 09:22:28.169154 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 09:22:28.169154 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 09:22:28.169154 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 09:22:28.169154 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 09:22:28.169154 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 09:22:28.169154 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 09:22:28.169154 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 09:22:28.169154 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 09:22:28.169154 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 09:22:28.169154 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 09:22:28.171267 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 09:22:28.171267 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 09:22:28.171267 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 09:22:28.171267 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 09:22:28.171267 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 09:22:28.171267 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 09:22:28.171267 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 09:22:28.171267 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 09:22:28.171267 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application with Lock( Jul 28 09:22:28.171267 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 09:22:28.171267 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self._enter() Jul 28 09:22:28.171267 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 09:22:28.171267 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 09:22:28.171267 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 09:22:28.171267 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self.creator() Jul 28 09:22:28.171267 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 09:22:28.171267 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application created_value = creator( Jul 28 09:22:28.174194 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 09:22:28.174194 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 09:22:28.174194 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 09:22:28.174194 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application Jul 28 09:22:28.174194 dv-cinder-851351-1-smb devstack@keystone.service[479852]: [pid: 479852|app: 0|req: 636/1256] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 09:22:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 253 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 09:22:28.179821 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38019157-16be-4792-a773-0e6eb0e981da None admin] Authenticating user token {{(pid=479851) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:22:28.280986 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG dbcounter [-] [479851] Writing DB stats keystone:SELECT=100 {{(pid=479851) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:22:28.301536 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38019157-16be-4792-a773-0e6eb0e981da None admin] Validating token access rules against request {{(pid=479851) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:22:28.355171 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c97f12-578c-4584-a68a-38b69a56b572 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479851) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:22:28.355935 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c97f12-578c-4584-a68a-38b69a56b572 None admin] REQUEST_METHOD: `GET` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:22:28.356399 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c97f12-578c-4584-a68a-38b69a56b572 None admin] SCRIPT_NAME: `/identity` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:22:28.356859 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c97f12-578c-4584-a68a-38b69a56b572 None admin] PATH_INFO: `/v3/domains` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:22:28.358019 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c97f12-578c-4584-a68a-38b69a56b572 None admin] RBAC: Adding query filter params (name=Default) {{(pid=479851) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 09:22:28.358570 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c97f12-578c-4584-a68a-38b69a56b572 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:22:28.360453 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c97f12-578c-4584-a68a-38b69a56b572 None admin] RBAC: Authorization granted {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:22:28.378532 dv-cinder-851351-1-smb devstack@keystone.service[479851]: [pid: 479851|app: 0|req: 621/1257] 10.222.0.42 () {56 vars in 1109 bytes} [Thu Jul 28 09:22:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:22:28.388315 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac131e59-e068-49e3-b9ab-8f3f77448459 None admin] Authenticating user token {{(pid=479852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:22:28.589974 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac131e59-e068-49e3-b9ab-8f3f77448459 None admin] Validating token access rules against request {{(pid=479852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:22:28.645955 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3930b5f-b3a5-4640-b5c5-637737ec7c3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:22:28.646567 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3930b5f-b3a5-4640-b5c5-637737ec7c3b None admin] REQUEST_METHOD: `GET` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:22:28.646855 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3930b5f-b3a5-4640-b5c5-637737ec7c3b None admin] SCRIPT_NAME: `/identity` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:22:28.647146 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3930b5f-b3a5-4640-b5c5-637737ec7c3b None admin] PATH_INFO: `/v3/projects/service` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:22:28.656182 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3930b5f-b3a5-4640-b5c5-637737ec7c3b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:22:28.657779 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3930b5f-b3a5-4640-b5c5-637737ec7c3b None admin] RBAC: Authorization granted {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:22:28.681232 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application [None req-a3930b5f-b3a5-4640-b5c5-637737ec7c3b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 09:22:28.681232 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 09:22:28.681232 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 09:22:28.681232 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 09:22:28.681232 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 09:22:28.681232 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 09:22:28.681232 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 09:22:28.681232 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 09:22:28.681232 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 09:22:28.681232 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 09:22:28.681232 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 09:22:28.681232 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 09:22:28.681232 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 28 09:22:28.681232 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 28 09:22:28.681232 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 28 09:22:28.682847 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 28 09:22:28.682847 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 09:22:28.682847 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 09:22:28.682847 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 09:22:28.682847 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 09:22:28.682847 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 09:22:28.682847 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 09:22:28.682847 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 09:22:28.682847 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application with Lock( Jul 28 09:22:28.682847 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 09:22:28.682847 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self._enter() Jul 28 09:22:28.682847 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 09:22:28.682847 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 09:22:28.682847 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 09:22:28.682847 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self.creator() Jul 28 09:22:28.682847 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 09:22:28.682847 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application created_value = creator( Jul 28 09:22:28.690715 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 28 09:22:28.690715 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 28 09:22:28.690715 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 28 09:22:28.690715 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 28 09:22:28.690715 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 28 09:22:28.690715 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 28 09:22:28.690715 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 09:22:28.690715 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application Jul 28 09:22:28.690715 dv-cinder-851351-1-smb devstack@keystone.service[479852]: [pid: 479852|app: 0|req: 637/1258] 10.222.0.42 () {56 vars in 1111 bytes} [Thu Jul 28 09:22:28 2022] GET /identity/v3/projects/service => generated 88 bytes in 296 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 09:22:28.691938 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c97f12-578c-4584-a68a-38b69a56b572 None admin] Authenticating user token {{(pid=479851) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:22:28.866558 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c97f12-578c-4584-a68a-38b69a56b572 None admin] Validating token access rules against request {{(pid=479851) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:22:28.915968 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6613bf8-2ca8-48fe-ac08-8e1a6492bf80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479851) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:22:28.916749 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6613bf8-2ca8-48fe-ac08-8e1a6492bf80 None admin] REQUEST_METHOD: `GET` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:22:28.917042 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6613bf8-2ca8-48fe-ac08-8e1a6492bf80 None admin] SCRIPT_NAME: `/identity` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:22:28.917326 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6613bf8-2ca8-48fe-ac08-8e1a6492bf80 None admin] PATH_INFO: `/v3/projects` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:22:28.918310 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6613bf8-2ca8-48fe-ac08-8e1a6492bf80 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=479851) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 09:22:28.918651 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6613bf8-2ca8-48fe-ac08-8e1a6492bf80 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:22:28.920778 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6613bf8-2ca8-48fe-ac08-8e1a6492bf80 None admin] RBAC: Authorization granted {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:22:28.938926 dv-cinder-851351-1-smb devstack@keystone.service[479851]: [pid: 479851|app: 0|req: 622/1259] 10.222.0.42 () {56 vars in 1148 bytes} [Thu Jul 28 09:22:28 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:22:28.947116 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3930b5f-b3a5-4640-b5c5-637737ec7c3b None admin] Authenticating user token {{(pid=479852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:22:28.984844 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG dbcounter [-] [479852] Writing DB stats keystone:SELECT=100 {{(pid=479852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:22:29.104930 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3930b5f-b3a5-4640-b5c5-637737ec7c3b None admin] Validating token access rules against request {{(pid=479852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:22:29.164214 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4659ce08-6575-4595-9bd7-2467d0e9847c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:22:29.165328 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4659ce08-6575-4595-9bd7-2467d0e9847c None admin] REQUEST_METHOD: `GET` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:22:29.165779 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4659ce08-6575-4595-9bd7-2467d0e9847c None admin] SCRIPT_NAME: `/identity` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:22:29.166254 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4659ce08-6575-4595-9bd7-2467d0e9847c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:22:29.167505 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4659ce08-6575-4595-9bd7-2467d0e9847c None admin] RBAC: Adding query filter params (role.id=685084310b35477b9b2d0c7934d0f803, scope.project.id=3a0fb8ea8010437bade8f92dcbcaacee, user.id=11cfcbc665524cec9b6b7de34f52170d) {{(pid=479852) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 09:22:29.168051 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4659ce08-6575-4595-9bd7-2467d0e9847c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:22:29.170065 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4659ce08-6575-4595-9bd7-2467d0e9847c None admin] RBAC: Authorization granted {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:22:29.178167 dv-cinder-851351-1-smb devstack@keystone.service[479852]: [pid: 479852|app: 0|req: 638/1260] 10.222.0.42 () {56 vars in 1374 bytes} [Thu Jul 28 09:22:28 2022] GET /identity/v3/role_assignments?user.id=11cfcbc665524cec9b6b7de34f52170d&scope.project.id=3a0fb8ea8010437bade8f92dcbcaacee&role.id=685084310b35477b9b2d0c7934d0f803 => generated 259 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:22:31.273179 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296a975f-fd7d-4c71-a91c-a0a9b259a245 None None] REQUEST_METHOD: `GET` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:22:31.273823 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296a975f-fd7d-4c71-a91c-a0a9b259a245 None None] SCRIPT_NAME: `/identity` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:22:31.273823 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296a975f-fd7d-4c71-a91c-a0a9b259a245 None None] PATH_INFO: `/` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:22:31.275132 dv-cinder-851351-1-smb devstack@keystone.service[479851]: [pid: 479851|app: 0|req: 623/1261] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 09:22:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 09:22:31.281025 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b97584f-4241-4d6d-8021-c35fcaf827f5 None None] REQUEST_METHOD: `POST` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:22:31.281981 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b97584f-4241-4d6d-8021-c35fcaf827f5 None None] SCRIPT_NAME: `/identity` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:22:31.281981 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b97584f-4241-4d6d-8021-c35fcaf827f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:22:31.300401 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.auth.core [None req-8b97584f-4241-4d6d-8021-c35fcaf827f5 None None] MFA Rules not processed for user `c198f91a4ae84d2b9cc730a6e304c2be`. Rule list: `[]` (Enabled: `True`). {{(pid=479852) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 09:22:31.301834 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.fernet_utils [None req-8b97584f-4241-4d6d-8021-c35fcaf827f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=479852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 09:22:31.386650 dv-cinder-851351-1-smb devstack@keystone.service[479852]: [pid: 479852|app: 0|req: 639/1262] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 09:22:31 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 28 09:22:31.409920 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296a975f-fd7d-4c71-a91c-a0a9b259a245 None None] Authenticating user token {{(pid=479851) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:22:31.422026 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG dbcounter [-] [479851] Writing DB stats keystone:SELECT=100 {{(pid=479851) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:22:31.537516 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296a975f-fd7d-4c71-a91c-a0a9b259a245 None None] Validating token access rules against request {{(pid=479851) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:22:31.581376 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca96000-610c-4dd3-9130-eb16c15237bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479851) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:22:31.582037 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca96000-610c-4dd3-9130-eb16c15237bd None admin] REQUEST_METHOD: `GET` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:22:31.582319 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca96000-610c-4dd3-9130-eb16c15237bd None admin] SCRIPT_NAME: `/identity` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:22:31.582596 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca96000-610c-4dd3-9130-eb16c15237bd None admin] PATH_INFO: `/v3/roles/admin` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:22:31.594923 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ca96000-610c-4dd3-9130-eb16c15237bd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 09:22:31.600192 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application [None req-3ca96000-610c-4dd3-9130-eb16c15237bd None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 09:22:31.600192 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 09:22:31.600192 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 09:22:31.600192 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 09:22:31.600192 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 09:22:31.600192 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 09:22:31.600192 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 09:22:31.600192 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 09:22:31.600192 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 09:22:31.600192 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 09:22:31.600192 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 09:22:31.600192 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 09:22:31.600192 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 09:22:31.600192 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 09:22:31.600192 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 09:22:31.600192 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 09:22:31.601724 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 09:22:31.601724 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 09:22:31.601724 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 09:22:31.601724 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 09:22:31.601724 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 09:22:31.601724 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 09:22:31.601724 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 09:22:31.601724 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 09:22:31.601724 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 09:22:31.601724 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 09:22:31.601724 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 09:22:31.601724 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application with Lock( Jul 28 09:22:31.601724 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 09:22:31.601724 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return self._enter() Jul 28 09:22:31.601724 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 09:22:31.601724 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 09:22:31.602999 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 09:22:31.602999 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return self.creator() Jul 28 09:22:31.602999 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 09:22:31.602999 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application created_value = creator( Jul 28 09:22:31.602999 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 09:22:31.602999 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 09:22:31.602999 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 09:22:31.602999 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 09:22:31.602999 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 09:22:31.602999 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 09:22:31.602999 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 09:22:31.602999 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application Jul 28 09:22:31.602999 dv-cinder-851351-1-smb devstack@keystone.service[479851]: [pid: 479851|app: 0|req: 624/1263] 10.222.0.42 () {56 vars in 1096 bytes} [Thu Jul 28 09:22:31 2022] GET /identity/v3/roles/admin => generated 83 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 09:22:31.611981 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b97584f-4241-4d6d-8021-c35fcaf827f5 None None] Authenticating user token {{(pid=479852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:22:31.645012 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG dbcounter [-] [479852] Writing DB stats keystone:SELECT=100 {{(pid=479852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:22:31.779259 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b97584f-4241-4d6d-8021-c35fcaf827f5 None None] Validating token access rules against request {{(pid=479852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:22:31.822478 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6225804a-3222-4751-ab78-9b7b2632b5d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:22:31.823035 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6225804a-3222-4751-ab78-9b7b2632b5d7 None admin] REQUEST_METHOD: `GET` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:22:31.823315 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6225804a-3222-4751-ab78-9b7b2632b5d7 None admin] SCRIPT_NAME: `/identity` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:22:31.823585 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6225804a-3222-4751-ab78-9b7b2632b5d7 None admin] PATH_INFO: `/v3/roles` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:22:31.824349 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6225804a-3222-4751-ab78-9b7b2632b5d7 None admin] RBAC: Adding query filter params (name=admin) {{(pid=479852) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 09:22:31.824652 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6225804a-3222-4751-ab78-9b7b2632b5d7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:22:31.826097 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6225804a-3222-4751-ab78-9b7b2632b5d7 None admin] RBAC: Authorization granted {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:22:31.835973 dv-cinder-851351-1-smb devstack@keystone.service[479852]: [pid: 479852|app: 0|req: 640/1264] 10.222.0.42 () {56 vars in 1099 bytes} [Thu Jul 28 09:22:31 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:22:31.842721 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca96000-610c-4dd3-9130-eb16c15237bd None admin] Authenticating user token {{(pid=479851) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:22:31.918242 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG dbcounter [-] [479851] Writing DB stats keystone:SELECT=100 {{(pid=479851) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:22:31.957447 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca96000-610c-4dd3-9130-eb16c15237bd None admin] Validating token access rules against request {{(pid=479851) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:22:31.995013 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b55995b5-b8e9-4e60-a80d-03c11942f100 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479851) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:22:31.995669 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55995b5-b8e9-4e60-a80d-03c11942f100 None admin] REQUEST_METHOD: `GET` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:22:31.995980 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55995b5-b8e9-4e60-a80d-03c11942f100 None admin] SCRIPT_NAME: `/identity` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:22:31.996256 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55995b5-b8e9-4e60-a80d-03c11942f100 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:22:32.007511 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b55995b5-b8e9-4e60-a80d-03c11942f100 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:22:32.009038 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b55995b5-b8e9-4e60-a80d-03c11942f100 None admin] RBAC: Authorization granted {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:22:32.025785 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application [None req-b55995b5-b8e9-4e60-a80d-03c11942f100 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 09:22:32.025785 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 09:22:32.025785 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 09:22:32.025785 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 09:22:32.025785 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 09:22:32.025785 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 09:22:32.025785 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 09:22:32.025785 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 09:22:32.025785 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 09:22:32.025785 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 09:22:32.025785 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 09:22:32.025785 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 09:22:32.025785 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 09:22:32.025785 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 09:22:32.025785 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 09:22:32.027717 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 09:22:32.027717 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 09:22:32.027717 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 09:22:32.027717 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 09:22:32.027717 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 09:22:32.027717 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 09:22:32.027717 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 09:22:32.027717 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 09:22:32.027717 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application with Lock( Jul 28 09:22:32.027717 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 09:22:32.027717 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return self._enter() Jul 28 09:22:32.027717 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 09:22:32.027717 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 09:22:32.027717 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 09:22:32.027717 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return self.creator() Jul 28 09:22:32.027717 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 09:22:32.027717 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application created_value = creator( Jul 28 09:22:32.029537 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 09:22:32.029537 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 09:22:32.029537 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 09:22:32.029537 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application Jul 28 09:22:32.029537 dv-cinder-851351-1-smb devstack@keystone.service[479851]: [pid: 479851|app: 0|req: 625/1265] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 09:22:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 09:22:32.033328 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6225804a-3222-4751-ab78-9b7b2632b5d7 None admin] Authenticating user token {{(pid=479852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:22:32.125347 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG dbcounter [-] [479852] Writing DB stats keystone:SELECT=100 {{(pid=479852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:22:32.147823 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6225804a-3222-4751-ab78-9b7b2632b5d7 None admin] Validating token access rules against request {{(pid=479852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:22:32.184203 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aad34ff-8cb4-48db-b29f-4cc06b0fd83a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:22:32.184876 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aad34ff-8cb4-48db-b29f-4cc06b0fd83a None admin] REQUEST_METHOD: `GET` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:22:32.185164 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aad34ff-8cb4-48db-b29f-4cc06b0fd83a None admin] SCRIPT_NAME: `/identity` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:22:32.185444 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aad34ff-8cb4-48db-b29f-4cc06b0fd83a None admin] PATH_INFO: `/v3/domains` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:22:32.186156 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aad34ff-8cb4-48db-b29f-4cc06b0fd83a None admin] RBAC: Adding query filter params (name=Default) {{(pid=479852) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 09:22:32.186468 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aad34ff-8cb4-48db-b29f-4cc06b0fd83a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:22:32.187859 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aad34ff-8cb4-48db-b29f-4cc06b0fd83a None admin] RBAC: Authorization granted {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:22:32.201115 dv-cinder-851351-1-smb devstack@keystone.service[479852]: [pid: 479852|app: 0|req: 641/1266] 10.222.0.42 () {56 vars in 1109 bytes} [Thu Jul 28 09:22:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:22:32.207255 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b55995b5-b8e9-4e60-a80d-03c11942f100 None admin] Authenticating user token {{(pid=479851) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:22:32.327714 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b55995b5-b8e9-4e60-a80d-03c11942f100 None admin] Validating token access rules against request {{(pid=479851) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:22:32.351027 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG dbcounter [-] [479851] Writing DB stats keystone:SELECT=100 {{(pid=479851) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:22:32.369587 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0dba99-007f-4494-b70f-aa0c3b20842e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479851) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:22:32.370500 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0dba99-007f-4494-b70f-aa0c3b20842e None admin] REQUEST_METHOD: `GET` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:22:32.370894 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0dba99-007f-4494-b70f-aa0c3b20842e None admin] SCRIPT_NAME: `/identity` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:22:32.371268 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0dba99-007f-4494-b70f-aa0c3b20842e None admin] PATH_INFO: `/v3/users/placement` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:22:32.383189 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab0dba99-007f-4494-b70f-aa0c3b20842e None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:22:32.384810 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab0dba99-007f-4494-b70f-aa0c3b20842e None admin] RBAC: Authorization granted {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:22:32.398200 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application [None req-ab0dba99-007f-4494-b70f-aa0c3b20842e None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 28 09:22:32.398200 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 09:22:32.398200 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 09:22:32.398200 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 09:22:32.398200 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 09:22:32.398200 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 09:22:32.398200 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 09:22:32.398200 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 09:22:32.398200 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 09:22:32.398200 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 09:22:32.398200 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 09:22:32.398200 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 09:22:32.398200 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 28 09:22:32.398200 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 28 09:22:32.398200 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 28 09:22:32.398200 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 28 09:22:32.400396 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 09:22:32.400396 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 09:22:32.400396 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 28 09:22:32.400396 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 09:22:32.400396 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 28 09:22:32.400396 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 09:22:32.400396 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 09:22:32.400396 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 09:22:32.400396 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 09:22:32.400396 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 09:22:32.400396 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 09:22:32.400396 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application with Lock( Jul 28 09:22:32.400396 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 09:22:32.400396 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return self._enter() Jul 28 09:22:32.400396 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 09:22:32.400396 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 09:22:32.400396 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 09:22:32.400396 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return self.creator() Jul 28 09:22:32.403007 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 09:22:32.403007 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application created_value = creator( Jul 28 09:22:32.403007 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 28 09:22:32.403007 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 28 09:22:32.403007 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 28 09:22:32.403007 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 28 09:22:32.403007 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 28 09:22:32.403007 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 28 09:22:32.403007 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 28 09:22:32.403007 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application Jul 28 09:22:32.403007 dv-cinder-851351-1-smb devstack@keystone.service[479851]: [pid: 479851|app: 0|req: 626/1267] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 09:22:32 2022] GET /identity/v3/users/placement => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 09:22:32.407595 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aad34ff-8cb4-48db-b29f-4cc06b0fd83a None admin] Authenticating user token {{(pid=479852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:22:32.517391 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aad34ff-8cb4-48db-b29f-4cc06b0fd83a None admin] Validating token access rules against request {{(pid=479852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:22:32.553476 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42653e01-d7f2-4c1a-90ce-b00eb65ad26d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:22:32.554103 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42653e01-d7f2-4c1a-90ce-b00eb65ad26d None admin] REQUEST_METHOD: `GET` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:22:32.554387 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42653e01-d7f2-4c1a-90ce-b00eb65ad26d None admin] SCRIPT_NAME: `/identity` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:22:32.554664 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42653e01-d7f2-4c1a-90ce-b00eb65ad26d None admin] PATH_INFO: `/v3/users` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:22:32.555479 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42653e01-d7f2-4c1a-90ce-b00eb65ad26d None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=479852) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 09:22:32.555787 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42653e01-d7f2-4c1a-90ce-b00eb65ad26d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:22:32.557288 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42653e01-d7f2-4c1a-90ce-b00eb65ad26d None admin] RBAC: Authorization granted {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:22:32.567639 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG dbcounter [-] [479852] Writing DB stats keystone:SELECT=100 {{(pid=479852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:22:32.578820 dv-cinder-851351-1-smb devstack@keystone.service[479852]: [pid: 479852|app: 0|req: 642/1268] 10.222.0.42 () {56 vars in 1143 bytes} [Thu Jul 28 09:22:32 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:22:32.584996 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0dba99-007f-4494-b70f-aa0c3b20842e None admin] Authenticating user token {{(pid=479851) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:22:32.692852 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0dba99-007f-4494-b70f-aa0c3b20842e None admin] Validating token access rules against request {{(pid=479851) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:22:32.731701 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb53b275-4446-4aab-911c-9d0d29a03f7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479851) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:22:32.732269 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb53b275-4446-4aab-911c-9d0d29a03f7c None admin] REQUEST_METHOD: `GET` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:22:32.732582 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb53b275-4446-4aab-911c-9d0d29a03f7c None admin] SCRIPT_NAME: `/identity` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:22:32.732929 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb53b275-4446-4aab-911c-9d0d29a03f7c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:22:32.749783 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb53b275-4446-4aab-911c-9d0d29a03f7c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:22:32.751675 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb53b275-4446-4aab-911c-9d0d29a03f7c None admin] RBAC: Authorization granted {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:22:32.772829 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application [None req-bb53b275-4446-4aab-911c-9d0d29a03f7c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 09:22:32.772829 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 09:22:32.772829 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 09:22:32.772829 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 09:22:32.772829 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 09:22:32.772829 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 09:22:32.772829 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 09:22:32.772829 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 09:22:32.772829 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 09:22:32.772829 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 09:22:32.772829 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 09:22:32.772829 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 09:22:32.772829 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 09:22:32.772829 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 09:22:32.772829 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 09:22:32.774689 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 09:22:32.774689 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 09:22:32.774689 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 09:22:32.774689 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 09:22:32.774689 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 09:22:32.774689 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 09:22:32.774689 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 09:22:32.774689 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 09:22:32.774689 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application with Lock( Jul 28 09:22:32.774689 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 09:22:32.774689 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return self._enter() Jul 28 09:22:32.774689 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 09:22:32.774689 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 09:22:32.774689 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 09:22:32.774689 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return self.creator() Jul 28 09:22:32.774689 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 09:22:32.774689 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application created_value = creator( Jul 28 09:22:32.777022 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 09:22:32.777022 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 09:22:32.777022 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 09:22:32.777022 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application Jul 28 09:22:32.777022 dv-cinder-851351-1-smb devstack@keystone.service[479851]: [pid: 479851|app: 0|req: 627/1269] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 09:22:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 09:22:32.781584 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42653e01-d7f2-4c1a-90ce-b00eb65ad26d None admin] Authenticating user token {{(pid=479852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:22:32.892988 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42653e01-d7f2-4c1a-90ce-b00eb65ad26d None admin] Validating token access rules against request {{(pid=479852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:22:32.931307 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f19932-e8dc-4be7-a144-64a5830e150d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:22:32.932010 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f19932-e8dc-4be7-a144-64a5830e150d None admin] REQUEST_METHOD: `GET` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:22:32.932345 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f19932-e8dc-4be7-a144-64a5830e150d None admin] SCRIPT_NAME: `/identity` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:22:32.932707 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f19932-e8dc-4be7-a144-64a5830e150d None admin] PATH_INFO: `/v3/domains` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:22:32.933495 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8f19932-e8dc-4be7-a144-64a5830e150d None admin] RBAC: Adding query filter params (name=Default) {{(pid=479852) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 09:22:32.933839 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8f19932-e8dc-4be7-a144-64a5830e150d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:22:32.935338 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8f19932-e8dc-4be7-a144-64a5830e150d None admin] RBAC: Authorization granted {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:22:32.949542 dv-cinder-851351-1-smb devstack@keystone.service[479852]: [pid: 479852|app: 0|req: 643/1270] 10.222.0.42 () {56 vars in 1109 bytes} [Thu Jul 28 09:22:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 28 09:22:32.956955 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb53b275-4446-4aab-911c-9d0d29a03f7c None admin] Authenticating user token {{(pid=479851) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:22:32.995866 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG dbcounter [-] [479851] Writing DB stats keystone:SELECT=100 {{(pid=479851) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:22:33.090409 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb53b275-4446-4aab-911c-9d0d29a03f7c None admin] Validating token access rules against request {{(pid=479851) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:22:33.128436 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680137ef-260a-44dc-a8a3-eafacd5d6984 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479851) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:22:33.129130 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680137ef-260a-44dc-a8a3-eafacd5d6984 None admin] REQUEST_METHOD: `GET` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:22:33.129416 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680137ef-260a-44dc-a8a3-eafacd5d6984 None admin] SCRIPT_NAME: `/identity` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:22:33.129695 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680137ef-260a-44dc-a8a3-eafacd5d6984 None admin] PATH_INFO: `/v3/projects/service` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:22:33.137416 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-680137ef-260a-44dc-a8a3-eafacd5d6984 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:22:33.138906 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-680137ef-260a-44dc-a8a3-eafacd5d6984 None admin] RBAC: Authorization granted {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:22:33.151313 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application [None req-680137ef-260a-44dc-a8a3-eafacd5d6984 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 09:22:33.151313 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 09:22:33.151313 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 09:22:33.151313 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 09:22:33.151313 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 09:22:33.151313 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 09:22:33.151313 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 09:22:33.151313 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 09:22:33.151313 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 09:22:33.151313 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 09:22:33.151313 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 09:22:33.151313 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 09:22:33.151313 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 28 09:22:33.151313 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 28 09:22:33.151313 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 28 09:22:33.153216 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 28 09:22:33.153216 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 09:22:33.153216 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 09:22:33.153216 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 09:22:33.153216 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 09:22:33.153216 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 09:22:33.153216 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 09:22:33.153216 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 09:22:33.153216 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application with Lock( Jul 28 09:22:33.153216 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 09:22:33.153216 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return self._enter() Jul 28 09:22:33.153216 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 09:22:33.153216 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 09:22:33.153216 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 09:22:33.153216 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return self.creator() Jul 28 09:22:33.153216 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 09:22:33.153216 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application created_value = creator( Jul 28 09:22:33.155107 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 28 09:22:33.155107 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 28 09:22:33.155107 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 28 09:22:33.155107 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 28 09:22:33.155107 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 28 09:22:33.155107 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 28 09:22:33.155107 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 09:22:33.155107 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application Jul 28 09:22:33.155107 dv-cinder-851351-1-smb devstack@keystone.service[479851]: [pid: 479851|app: 0|req: 628/1271] 10.222.0.42 () {56 vars in 1111 bytes} [Thu Jul 28 09:22:32 2022] GET /identity/v3/projects/service => generated 88 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 28 09:22:33.161583 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f19932-e8dc-4be7-a144-64a5830e150d None admin] Authenticating user token {{(pid=479852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:22:33.229289 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG dbcounter [-] [479852] Writing DB stats keystone:SELECT=100 {{(pid=479852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:22:33.274490 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f19932-e8dc-4be7-a144-64a5830e150d None admin] Validating token access rules against request {{(pid=479852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:22:33.311475 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb224eb-ca55-40c9-96e0-e00bc2358aa4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:22:33.312156 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb224eb-ca55-40c9-96e0-e00bc2358aa4 None admin] REQUEST_METHOD: `GET` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:22:33.312455 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb224eb-ca55-40c9-96e0-e00bc2358aa4 None admin] SCRIPT_NAME: `/identity` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:22:33.312763 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb224eb-ca55-40c9-96e0-e00bc2358aa4 None admin] PATH_INFO: `/v3/projects` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:22:33.313945 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cb224eb-ca55-40c9-96e0-e00bc2358aa4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=479852) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 09:22:33.314257 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cb224eb-ca55-40c9-96e0-e00bc2358aa4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:22:33.315737 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cb224eb-ca55-40c9-96e0-e00bc2358aa4 None admin] RBAC: Authorization granted {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:22:33.330131 dv-cinder-851351-1-smb devstack@keystone.service[479852]: [pid: 479852|app: 0|req: 644/1272] 10.222.0.42 () {56 vars in 1148 bytes} [Thu Jul 28 09:22:33 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:22:33.336902 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680137ef-260a-44dc-a8a3-eafacd5d6984 None admin] Authenticating user token {{(pid=479851) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:22:33.444372 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG dbcounter [-] [479851] Writing DB stats keystone:SELECT=100 {{(pid=479851) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:22:33.459418 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680137ef-260a-44dc-a8a3-eafacd5d6984 None admin] Validating token access rules against request {{(pid=479851) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:22:33.518427 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb6aed4-e120-41c2-bc79-2562cdd7c692 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479851) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:22:33.519050 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb6aed4-e120-41c2-bc79-2562cdd7c692 None admin] REQUEST_METHOD: `PUT` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:22:33.519336 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb6aed4-e120-41c2-bc79-2562cdd7c692 None admin] SCRIPT_NAME: `/identity` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:22:33.519617 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb6aed4-e120-41c2-bc79-2562cdd7c692 None admin] PATH_INFO: `/v3/projects/3a0fb8ea8010437bade8f92dcbcaacee/users/11cfcbc665524cec9b6b7de34f52170d/roles/685084310b35477b9b2d0c7934d0f803` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:22:33.521845 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fb6aed4-e120-41c2-bc79-2562cdd7c692 None admin] RBAC: Authorizing `identity:create_grant(project_id=3a0fb8ea8010437bade8f92dcbcaacee, user_id=11cfcbc665524cec9b6b7de34f52170d, role_id=685084310b35477b9b2d0c7934d0f803)` {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:22:33.523349 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fb6aed4-e120-41c2-bc79-2562cdd7c692 None admin] RBAC: Authorization granted {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:22:33.540109 dv-cinder-851351-1-smb devstack@keystone.service[479851]: [pid: 479851|app: 0|req: 629/1273] 10.222.0.42 () {58 vars in 1439 bytes} [Thu Jul 28 09:22:33 2022] PUT /identity/v3/projects/3a0fb8ea8010437bade8f92dcbcaacee/users/11cfcbc665524cec9b6b7de34f52170d/roles/685084310b35477b9b2d0c7934d0f803 => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 28 09:22:35.595659 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae3edf8-b40c-4c39-bcd9-7b7ca3bc1870 None None] REQUEST_METHOD: `GET` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:22:35.596287 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae3edf8-b40c-4c39-bcd9-7b7ca3bc1870 None None] SCRIPT_NAME: `/identity` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:22:35.596287 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae3edf8-b40c-4c39-bcd9-7b7ca3bc1870 None None] PATH_INFO: `/` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:22:35.597617 dv-cinder-851351-1-smb devstack@keystone.service[479852]: [pid: 479852|app: 0|req: 645/1274] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 09:22:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 09:22:35.603412 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6e1baa-8404-4ef4-a4df-056c4d583443 None None] REQUEST_METHOD: `POST` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:22:35.603962 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6e1baa-8404-4ef4-a4df-056c4d583443 None None] SCRIPT_NAME: `/identity` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:22:35.603962 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6e1baa-8404-4ef4-a4df-056c4d583443 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:22:35.623972 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.auth.core [None req-ce6e1baa-8404-4ef4-a4df-056c4d583443 None None] MFA Rules not processed for user `c198f91a4ae84d2b9cc730a6e304c2be`. Rule list: `[]` (Enabled: `True`). {{(pid=479851) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 09:22:35.625252 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.fernet_utils [None req-ce6e1baa-8404-4ef4-a4df-056c4d583443 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=479851) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 09:22:35.702257 dv-cinder-851351-1-smb devstack@keystone.service[479851]: [pid: 479851|app: 0|req: 630/1275] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 09:22:35 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 09:22:35.729820 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae3edf8-b40c-4c39-bcd9-7b7ca3bc1870 None None] Authenticating user token {{(pid=479852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:22:35.849072 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae3edf8-b40c-4c39-bcd9-7b7ca3bc1870 None None] Validating token access rules against request {{(pid=479852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:22:35.867902 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG dbcounter [-] [479852] Writing DB stats keystone:SELECT=100 {{(pid=479852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:22:35.887166 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c34d8b5-b5a9-4da5-beb9-579e6257dc1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:22:35.887861 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c34d8b5-b5a9-4da5-beb9-579e6257dc1f None admin] REQUEST_METHOD: `GET` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:22:35.888142 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c34d8b5-b5a9-4da5-beb9-579e6257dc1f None admin] SCRIPT_NAME: `/identity` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:22:35.888419 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c34d8b5-b5a9-4da5-beb9-579e6257dc1f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:22:35.900088 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c34d8b5-b5a9-4da5-beb9-579e6257dc1f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 28 09:22:35.905241 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application [None req-4c34d8b5-b5a9-4da5-beb9-579e6257dc1f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 09:22:35.905241 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 09:22:35.905241 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 09:22:35.905241 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 09:22:35.905241 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 09:22:35.905241 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 09:22:35.905241 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 09:22:35.905241 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 09:22:35.905241 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 09:22:35.905241 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 09:22:35.905241 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 09:22:35.905241 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 09:22:35.905241 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 28 09:22:35.905241 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 28 09:22:35.905241 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 28 09:22:35.905241 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 28 09:22:35.906722 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 28 09:22:35.906722 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 28 09:22:35.906722 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 28 09:22:35.906722 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 28 09:22:35.906722 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 09:22:35.906722 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 09:22:35.906722 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 09:22:35.906722 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 09:22:35.906722 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 09:22:35.906722 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 09:22:35.906722 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 09:22:35.906722 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application with Lock( Jul 28 09:22:35.906722 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 09:22:35.906722 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self._enter() Jul 28 09:22:35.906722 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 09:22:35.906722 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 09:22:35.908035 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 09:22:35.908035 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self.creator() Jul 28 09:22:35.908035 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 09:22:35.908035 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application created_value = creator( Jul 28 09:22:35.908035 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 28 09:22:35.908035 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 28 09:22:35.908035 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 28 09:22:35.908035 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 28 09:22:35.908035 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 28 09:22:35.908035 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 28 09:22:35.908035 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 28 09:22:35.908035 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application Jul 28 09:22:35.908035 dv-cinder-851351-1-smb devstack@keystone.service[479852]: [pid: 479852|app: 0|req: 646/1276] 10.222.0.42 () {56 vars in 1096 bytes} [Thu Jul 28 09:22:35 2022] GET /identity/v3/roles/admin => generated 83 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 09:22:35.912783 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6e1baa-8404-4ef4-a4df-056c4d583443 None None] Authenticating user token {{(pid=479851) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:22:36.005708 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG dbcounter [-] [479851] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=479851) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:22:36.027852 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6e1baa-8404-4ef4-a4df-056c4d583443 None None] Validating token access rules against request {{(pid=479851) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:22:36.068794 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-441274d3-ef0e-4422-a17d-34247f68ddfa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479851) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:22:36.069448 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441274d3-ef0e-4422-a17d-34247f68ddfa None admin] REQUEST_METHOD: `GET` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:22:36.069722 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441274d3-ef0e-4422-a17d-34247f68ddfa None admin] SCRIPT_NAME: `/identity` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:22:36.070001 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441274d3-ef0e-4422-a17d-34247f68ddfa None admin] PATH_INFO: `/v3/roles` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:22:36.070775 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-441274d3-ef0e-4422-a17d-34247f68ddfa None admin] RBAC: Adding query filter params (name=admin) {{(pid=479851) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 09:22:36.071393 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-441274d3-ef0e-4422-a17d-34247f68ddfa None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:22:36.072861 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-441274d3-ef0e-4422-a17d-34247f68ddfa None admin] RBAC: Authorization granted {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:22:36.082502 dv-cinder-851351-1-smb devstack@keystone.service[479851]: [pid: 479851|app: 0|req: 631/1277] 10.222.0.42 () {56 vars in 1099 bytes} [Thu Jul 28 09:22:35 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:22:36.089080 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c34d8b5-b5a9-4da5-beb9-579e6257dc1f None admin] Authenticating user token {{(pid=479852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:22:36.222883 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c34d8b5-b5a9-4da5-beb9-579e6257dc1f None admin] Validating token access rules against request {{(pid=479852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:22:36.265364 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb495f2-786c-4f7d-a8c0-5fe963f56df1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:22:36.265962 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb495f2-786c-4f7d-a8c0-5fe963f56df1 None admin] REQUEST_METHOD: `GET` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:22:36.266353 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb495f2-786c-4f7d-a8c0-5fe963f56df1 None admin] SCRIPT_NAME: `/identity` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:22:36.266631 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb495f2-786c-4f7d-a8c0-5fe963f56df1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:22:36.279867 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eb495f2-786c-4f7d-a8c0-5fe963f56df1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:22:36.281413 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eb495f2-786c-4f7d-a8c0-5fe963f56df1 None admin] RBAC: Authorization granted {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:22:36.299464 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application [None req-5eb495f2-786c-4f7d-a8c0-5fe963f56df1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 09:22:36.299464 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 09:22:36.299464 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 09:22:36.299464 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 09:22:36.299464 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 09:22:36.299464 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 09:22:36.299464 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 09:22:36.299464 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 09:22:36.299464 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 09:22:36.299464 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 09:22:36.299464 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 09:22:36.299464 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 09:22:36.299464 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 09:22:36.299464 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 09:22:36.299464 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 09:22:36.300775 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 09:22:36.300775 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 09:22:36.300775 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 09:22:36.300775 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 09:22:36.300775 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 09:22:36.300775 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 09:22:36.300775 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 09:22:36.300775 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 09:22:36.300775 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application with Lock( Jul 28 09:22:36.300775 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 09:22:36.300775 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self._enter() Jul 28 09:22:36.300775 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 09:22:36.300775 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 09:22:36.300775 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 09:22:36.300775 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self.creator() Jul 28 09:22:36.300775 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 09:22:36.300775 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application created_value = creator( Jul 28 09:22:36.302013 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 09:22:36.302013 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 09:22:36.302013 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 09:22:36.302013 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application Jul 28 09:22:36.302013 dv-cinder-851351-1-smb devstack@keystone.service[479852]: [pid: 479852|app: 0|req: 647/1278] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 09:22:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 09:22:36.307622 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-441274d3-ef0e-4422-a17d-34247f68ddfa None admin] Authenticating user token {{(pid=479851) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:22:36.418464 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-441274d3-ef0e-4422-a17d-34247f68ddfa None admin] Validating token access rules against request {{(pid=479851) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:22:36.454405 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a718050c-8d00-45b8-b5f5-fee6bcb0a3ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479851) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:22:36.455036 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a718050c-8d00-45b8-b5f5-fee6bcb0a3ba None admin] REQUEST_METHOD: `GET` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:22:36.455322 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a718050c-8d00-45b8-b5f5-fee6bcb0a3ba None admin] SCRIPT_NAME: `/identity` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:22:36.455598 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a718050c-8d00-45b8-b5f5-fee6bcb0a3ba None admin] PATH_INFO: `/v3/domains` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:22:36.456299 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a718050c-8d00-45b8-b5f5-fee6bcb0a3ba None admin] RBAC: Adding query filter params (name=Default) {{(pid=479851) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 09:22:36.456605 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a718050c-8d00-45b8-b5f5-fee6bcb0a3ba None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:22:36.458020 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a718050c-8d00-45b8-b5f5-fee6bcb0a3ba None admin] RBAC: Authorization granted {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:22:36.470652 dv-cinder-851351-1-smb devstack@keystone.service[479851]: [pid: 479851|app: 0|req: 632/1279] 10.222.0.42 () {56 vars in 1109 bytes} [Thu Jul 28 09:22:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:22:36.476768 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb495f2-786c-4f7d-a8c0-5fe963f56df1 None admin] Authenticating user token {{(pid=479852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:22:36.512518 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG dbcounter [-] [479852] Writing DB stats keystone:SELECT=100 {{(pid=479852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:22:36.591064 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb495f2-786c-4f7d-a8c0-5fe963f56df1 None admin] Validating token access rules against request {{(pid=479852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:22:36.626924 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466f7888-429f-4d46-b2ef-4d86469b1468 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:22:36.627830 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466f7888-429f-4d46-b2ef-4d86469b1468 None admin] REQUEST_METHOD: `GET` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:22:36.627830 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466f7888-429f-4d46-b2ef-4d86469b1468 None admin] SCRIPT_NAME: `/identity` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:22:36.628111 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466f7888-429f-4d46-b2ef-4d86469b1468 None admin] PATH_INFO: `/v3/users/placement` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:22:36.636600 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-466f7888-429f-4d46-b2ef-4d86469b1468 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:22:36.638088 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-466f7888-429f-4d46-b2ef-4d86469b1468 None admin] RBAC: Authorization granted {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:22:36.650238 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application [None req-466f7888-429f-4d46-b2ef-4d86469b1468 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 28 09:22:36.650238 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 09:22:36.650238 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 09:22:36.650238 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 09:22:36.650238 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 09:22:36.650238 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 09:22:36.650238 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 09:22:36.650238 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 09:22:36.650238 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 09:22:36.650238 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 09:22:36.650238 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 09:22:36.650238 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 09:22:36.650238 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 28 09:22:36.650238 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 28 09:22:36.650238 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 28 09:22:36.650238 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 28 09:22:36.652121 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 09:22:36.652121 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 09:22:36.652121 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 28 09:22:36.652121 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 09:22:36.652121 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 28 09:22:36.652121 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 28 09:22:36.652121 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 09:22:36.652121 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 09:22:36.652121 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 09:22:36.652121 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 09:22:36.652121 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 09:22:36.652121 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application with Lock( Jul 28 09:22:36.652121 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 09:22:36.652121 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self._enter() Jul 28 09:22:36.652121 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 09:22:36.652121 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 09:22:36.652121 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 09:22:36.652121 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self.creator() Jul 28 09:22:36.654193 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 09:22:36.654193 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application created_value = creator( Jul 28 09:22:36.654193 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 28 09:22:36.654193 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 28 09:22:36.654193 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 28 09:22:36.654193 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 28 09:22:36.654193 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 28 09:22:36.654193 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 28 09:22:36.654193 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 28 09:22:36.654193 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application Jul 28 09:22:36.656366 dv-cinder-851351-1-smb devstack@keystone.service[479852]: [pid: 479852|app: 0|req: 648/1280] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 09:22:36 2022] GET /identity/v3/users/placement => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 09:22:36.657717 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a718050c-8d00-45b8-b5f5-fee6bcb0a3ba None admin] Authenticating user token {{(pid=479851) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:22:36.661922 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG dbcounter [-] [479851] Writing DB stats keystone:SELECT=100 {{(pid=479851) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:22:36.787652 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a718050c-8d00-45b8-b5f5-fee6bcb0a3ba None admin] Validating token access rules against request {{(pid=479851) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:22:36.824165 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010ef241-5e22-483d-9196-f84f3aec90d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479851) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:22:36.824826 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010ef241-5e22-483d-9196-f84f3aec90d1 None admin] REQUEST_METHOD: `GET` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:22:36.825140 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010ef241-5e22-483d-9196-f84f3aec90d1 None admin] SCRIPT_NAME: `/identity` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:22:36.825393 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010ef241-5e22-483d-9196-f84f3aec90d1 None admin] PATH_INFO: `/v3/users` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:22:36.826205 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-010ef241-5e22-483d-9196-f84f3aec90d1 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=479851) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 09:22:36.826517 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-010ef241-5e22-483d-9196-f84f3aec90d1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:22:36.827958 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-010ef241-5e22-483d-9196-f84f3aec90d1 None admin] RBAC: Authorization granted {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:22:36.845409 dv-cinder-851351-1-smb devstack@keystone.service[479851]: [pid: 479851|app: 0|req: 633/1281] 10.222.0.42 () {56 vars in 1143 bytes} [Thu Jul 28 09:22:36 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:22:36.851566 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466f7888-429f-4d46-b2ef-4d86469b1468 None admin] Authenticating user token {{(pid=479852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:22:36.953370 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG dbcounter [-] [479852] Writing DB stats keystone:SELECT=100 {{(pid=479852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:22:36.964850 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466f7888-429f-4d46-b2ef-4d86469b1468 None admin] Validating token access rules against request {{(pid=479852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:22:37.000258 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-432aed40-728e-4029-b9b1-d5c43508889f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:22:37.001239 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432aed40-728e-4029-b9b1-d5c43508889f None admin] REQUEST_METHOD: `GET` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:22:37.001711 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432aed40-728e-4029-b9b1-d5c43508889f None admin] SCRIPT_NAME: `/identity` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:22:37.002234 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432aed40-728e-4029-b9b1-d5c43508889f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:22:37.075305 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-432aed40-728e-4029-b9b1-d5c43508889f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:22:37.076816 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-432aed40-728e-4029-b9b1-d5c43508889f None admin] RBAC: Authorization granted {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:22:37.173582 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG dbcounter [-] [479852] Writing DB stats keystone:SELECT=100 {{(pid=479852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:22:37.185823 dv-cinder-851351-1-smb devstack@keystone.service[479852]: [pid: 479852|app: 0|req: 649/1282] 10.222.0.42 () {58 vars in 1282 bytes} [Thu Jul 28 09:22:36 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 335 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 28 09:22:37.192253 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010ef241-5e22-483d-9196-f84f3aec90d1 None admin] Authenticating user token {{(pid=479851) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:22:37.257215 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG dbcounter [-] [479851] Writing DB stats keystone:SELECT=100 {{(pid=479851) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:22:37.300506 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010ef241-5e22-483d-9196-f84f3aec90d1 None admin] Validating token access rules against request {{(pid=479851) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:22:37.335483 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0672f7-f2ce-411b-afe3-4ba9b7d2ac8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479851) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:22:37.336146 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0672f7-f2ce-411b-afe3-4ba9b7d2ac8d None admin] REQUEST_METHOD: `GET` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:22:37.336431 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0672f7-f2ce-411b-afe3-4ba9b7d2ac8d None admin] SCRIPT_NAME: `/identity` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:22:37.336702 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0672f7-f2ce-411b-afe3-4ba9b7d2ac8d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:22:37.350392 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b0672f7-f2ce-411b-afe3-4ba9b7d2ac8d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:22:37.351985 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b0672f7-f2ce-411b-afe3-4ba9b7d2ac8d None admin] RBAC: Authorization granted {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:22:37.370814 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application [None req-1b0672f7-f2ce-411b-afe3-4ba9b7d2ac8d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 09:22:37.370814 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 09:22:37.370814 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 09:22:37.370814 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 09:22:37.370814 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 09:22:37.370814 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 09:22:37.370814 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 09:22:37.370814 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 09:22:37.370814 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 09:22:37.370814 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 09:22:37.370814 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 09:22:37.370814 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 09:22:37.370814 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 28 09:22:37.370814 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 28 09:22:37.370814 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 28 09:22:37.372452 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 28 09:22:37.372452 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 09:22:37.372452 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 09:22:37.372452 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 09:22:37.372452 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 09:22:37.372452 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 09:22:37.372452 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 09:22:37.372452 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 09:22:37.372452 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application with Lock( Jul 28 09:22:37.372452 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 09:22:37.372452 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return self._enter() Jul 28 09:22:37.372452 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 09:22:37.372452 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 09:22:37.372452 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 09:22:37.372452 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return self.creator() Jul 28 09:22:37.372452 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 09:22:37.372452 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application created_value = creator( Jul 28 09:22:37.374302 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 28 09:22:37.374302 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 28 09:22:37.374302 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 28 09:22:37.374302 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application Jul 28 09:22:37.374302 dv-cinder-851351-1-smb devstack@keystone.service[479851]: [pid: 479851|app: 0|req: 634/1283] 10.222.0.42 () {56 vars in 1108 bytes} [Thu Jul 28 09:22:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 09:22:37.378196 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-432aed40-728e-4029-b9b1-d5c43508889f None admin] Authenticating user token {{(pid=479852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:22:37.484610 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-432aed40-728e-4029-b9b1-d5c43508889f None admin] Validating token access rules against request {{(pid=479852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:22:37.519719 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397c2c06-252f-4fde-bf4c-e4ac4332b12b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:22:37.520339 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397c2c06-252f-4fde-bf4c-e4ac4332b12b None admin] REQUEST_METHOD: `GET` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:22:37.520629 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397c2c06-252f-4fde-bf4c-e4ac4332b12b None admin] SCRIPT_NAME: `/identity` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:22:37.520943 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397c2c06-252f-4fde-bf4c-e4ac4332b12b None admin] PATH_INFO: `/v3/domains` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:22:37.521673 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-397c2c06-252f-4fde-bf4c-e4ac4332b12b None admin] RBAC: Adding query filter params (name=Default) {{(pid=479852) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 09:22:37.521982 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-397c2c06-252f-4fde-bf4c-e4ac4332b12b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:22:37.523372 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-397c2c06-252f-4fde-bf4c-e4ac4332b12b None admin] RBAC: Authorization granted {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:22:37.535103 dv-cinder-851351-1-smb devstack@keystone.service[479852]: [pid: 479852|app: 0|req: 650/1284] 10.222.0.42 () {56 vars in 1109 bytes} [Thu Jul 28 09:22:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:22:37.541233 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0672f7-f2ce-411b-afe3-4ba9b7d2ac8d None admin] Authenticating user token {{(pid=479851) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:22:37.656253 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0672f7-f2ce-411b-afe3-4ba9b7d2ac8d None admin] Validating token access rules against request {{(pid=479851) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:22:37.670750 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG dbcounter [-] [479851] Writing DB stats keystone:SELECT=100 {{(pid=479851) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:22:37.697021 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2342bd-7358-48e3-a4e3-73a42fff6af6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479851) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:22:37.697691 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2342bd-7358-48e3-a4e3-73a42fff6af6 None admin] REQUEST_METHOD: `GET` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:22:37.697978 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2342bd-7358-48e3-a4e3-73a42fff6af6 None admin] SCRIPT_NAME: `/identity` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:22:37.698255 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2342bd-7358-48e3-a4e3-73a42fff6af6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:22:37.706359 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc2342bd-7358-48e3-a4e3-73a42fff6af6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:22:37.709108 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc2342bd-7358-48e3-a4e3-73a42fff6af6 None admin] RBAC: Authorization granted {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:22:37.725772 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application [None req-fc2342bd-7358-48e3-a4e3-73a42fff6af6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 09:22:37.725772 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 09:22:37.725772 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 09:22:37.725772 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 09:22:37.725772 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 09:22:37.725772 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 09:22:37.725772 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 09:22:37.725772 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 09:22:37.725772 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 09:22:37.725772 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 09:22:37.725772 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 09:22:37.725772 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 09:22:37.725772 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 28 09:22:37.725772 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 28 09:22:37.725772 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 28 09:22:37.727848 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 28 09:22:37.727848 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 09:22:37.727848 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 09:22:37.727848 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 09:22:37.727848 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 09:22:37.727848 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 09:22:37.727848 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 09:22:37.727848 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 09:22:37.727848 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application with Lock( Jul 28 09:22:37.727848 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 09:22:37.727848 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return self._enter() Jul 28 09:22:37.727848 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 09:22:37.727848 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 09:22:37.727848 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 09:22:37.727848 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return self.creator() Jul 28 09:22:37.727848 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 09:22:37.727848 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application created_value = creator( Jul 28 09:22:37.729975 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 28 09:22:37.729975 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 28 09:22:37.729975 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 28 09:22:37.729975 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 28 09:22:37.729975 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 28 09:22:37.729975 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 28 09:22:37.729975 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 28 09:22:37.729975 dv-cinder-851351-1-smb devstack@keystone.service[479851]: ERROR keystone.server.flask.application Jul 28 09:22:37.729975 dv-cinder-851351-1-smb devstack@keystone.service[479851]: [pid: 479851|app: 0|req: 635/1285] 10.222.0.42 () {56 vars in 1111 bytes} [Thu Jul 28 09:22:37 2022] GET /identity/v3/projects/service => generated 88 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 09:22:37.733484 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397c2c06-252f-4fde-bf4c-e4ac4332b12b None admin] Authenticating user token {{(pid=479852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:22:37.787605 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG dbcounter [-] [479852] Writing DB stats keystone:SELECT=100 {{(pid=479852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:22:37.840002 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397c2c06-252f-4fde-bf4c-e4ac4332b12b None admin] Validating token access rules against request {{(pid=479852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:22:37.875931 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a314793e-ce8a-4289-8579-303189270a99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:22:37.876564 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a314793e-ce8a-4289-8579-303189270a99 None admin] REQUEST_METHOD: `GET` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:22:37.876879 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a314793e-ce8a-4289-8579-303189270a99 None admin] SCRIPT_NAME: `/identity` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:22:37.877156 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a314793e-ce8a-4289-8579-303189270a99 None admin] PATH_INFO: `/v3/projects` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:22:37.877928 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a314793e-ce8a-4289-8579-303189270a99 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=479852) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 09:22:37.878241 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a314793e-ce8a-4289-8579-303189270a99 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:22:37.879706 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a314793e-ce8a-4289-8579-303189270a99 None admin] RBAC: Authorization granted {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:22:37.893176 dv-cinder-851351-1-smb devstack@keystone.service[479852]: [pid: 479852|app: 0|req: 651/1286] 10.222.0.42 () {56 vars in 1148 bytes} [Thu Jul 28 09:22:37 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:22:37.899715 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2342bd-7358-48e3-a4e3-73a42fff6af6 None admin] Authenticating user token {{(pid=479851) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:22:38.006746 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2342bd-7358-48e3-a4e3-73a42fff6af6 None admin] Validating token access rules against request {{(pid=479851) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:22:38.044399 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff78bf3-89d7-4b19-ad10-bd445e88ae28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479851) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:22:38.044975 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff78bf3-89d7-4b19-ad10-bd445e88ae28 None admin] REQUEST_METHOD: `GET` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:22:38.045267 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff78bf3-89d7-4b19-ad10-bd445e88ae28 None admin] SCRIPT_NAME: `/identity` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:22:38.045550 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff78bf3-89d7-4b19-ad10-bd445e88ae28 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:22:38.046365 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ff78bf3-89d7-4b19-ad10-bd445e88ae28 None admin] RBAC: Adding query filter params (role.id=685084310b35477b9b2d0c7934d0f803, scope.project.id=3a0fb8ea8010437bade8f92dcbcaacee, user.id=11cfcbc665524cec9b6b7de34f52170d) {{(pid=479851) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 09:22:38.046685 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ff78bf3-89d7-4b19-ad10-bd445e88ae28 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:22:38.048171 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ff78bf3-89d7-4b19-ad10-bd445e88ae28 None admin] RBAC: Authorization granted {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:22:38.055681 dv-cinder-851351-1-smb devstack@keystone.service[479851]: [pid: 479851|app: 0|req: 636/1287] 10.222.0.42 () {56 vars in 1374 bytes} [Thu Jul 28 09:22:37 2022] GET /identity/v3/role_assignments?user.id=11cfcbc665524cec9b6b7de34f52170d&scope.project.id=3a0fb8ea8010437bade8f92dcbcaacee&role.id=685084310b35477b9b2d0c7934d0f803 => generated 608 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:22:40.087630 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d8f6b4-a8db-4001-9204-81b4e53e9e7d None None] REQUEST_METHOD: `GET` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:22:40.088279 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d8f6b4-a8db-4001-9204-81b4e53e9e7d None None] SCRIPT_NAME: `/identity` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:22:40.088279 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d8f6b4-a8db-4001-9204-81b4e53e9e7d None None] PATH_INFO: `/` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:22:40.089751 dv-cinder-851351-1-smb devstack@keystone.service[479852]: [pid: 479852|app: 0|req: 652/1288] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 09:22:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 09:22:40.095707 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80230712-3661-48a7-acd4-d6d5fa70f663 None None] REQUEST_METHOD: `POST` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:22:40.096280 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80230712-3661-48a7-acd4-d6d5fa70f663 None None] SCRIPT_NAME: `/identity` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:22:40.096280 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80230712-3661-48a7-acd4-d6d5fa70f663 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:22:40.115127 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.auth.core [None req-80230712-3661-48a7-acd4-d6d5fa70f663 None None] MFA Rules not processed for user `c198f91a4ae84d2b9cc730a6e304c2be`. Rule list: `[]` (Enabled: `True`). {{(pid=479851) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 09:22:40.116373 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.fernet_utils [None req-80230712-3661-48a7-acd4-d6d5fa70f663 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=479851) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 09:22:40.147558 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG dbcounter [-] [479851] Writing DB stats keystone:SELECT=100 {{(pid=479851) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:22:40.189366 dv-cinder-851351-1-smb devstack@keystone.service[479851]: [pid: 479851|app: 0|req: 637/1289] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 09:22:40 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 09:22:40.211448 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d8f6b4-a8db-4001-9204-81b4e53e9e7d None None] Authenticating user token {{(pid=479852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:22:40.320519 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d8f6b4-a8db-4001-9204-81b4e53e9e7d None None] Validating token access rules against request {{(pid=479852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:22:40.331751 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG dbcounter [-] [479852] Writing DB stats keystone:SELECT=100 {{(pid=479852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:22:40.356405 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfbf2847-9a54-4fe0-b051-f90224127565 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:22:40.357002 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfbf2847-9a54-4fe0-b051-f90224127565 None admin] REQUEST_METHOD: `GET` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:22:40.357299 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfbf2847-9a54-4fe0-b051-f90224127565 None admin] SCRIPT_NAME: `/identity` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:22:40.357539 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfbf2847-9a54-4fe0-b051-f90224127565 None admin] PATH_INFO: `/v3/services/placement` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:22:40.358165 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfbf2847-9a54-4fe0-b051-f90224127565 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:22:40.359538 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfbf2847-9a54-4fe0-b051-f90224127565 None admin] RBAC: Authorization granted {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:22:40.368628 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application [None req-cfbf2847-9a54-4fe0-b051-f90224127565 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jul 28 09:22:40.368628 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 09:22:40.368628 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 28 09:22:40.368628 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 28 09:22:40.368628 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 28 09:22:40.368628 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 28 09:22:40.368628 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 28 09:22:40.368628 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 09:22:40.368628 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 28 09:22:40.368628 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application Jul 28 09:22:40.368628 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 28 09:22:40.368628 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application Jul 28 09:22:40.368628 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 09:22:40.368628 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 09:22:40.368628 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 09:22:40.368628 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 09:22:40.368628 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 09:22:40.370250 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 09:22:40.370250 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 09:22:40.370250 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 09:22:40.370250 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 09:22:40.370250 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 09:22:40.370250 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 09:22:40.370250 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 28 09:22:40.370250 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 28 09:22:40.370250 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 28 09:22:40.370250 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 28 09:22:40.370250 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 09:22:40.370250 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 09:22:40.370250 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 09:22:40.370250 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 09:22:40.370250 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 09:22:40.370250 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 09:22:40.371371 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 09:22:40.371371 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application with Lock( Jul 28 09:22:40.371371 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 09:22:40.371371 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self._enter() Jul 28 09:22:40.371371 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 09:22:40.371371 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 09:22:40.371371 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 09:22:40.371371 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self.creator() Jul 28 09:22:40.371371 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 09:22:40.371371 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application created_value = creator( Jul 28 09:22:40.371371 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 28 09:22:40.371371 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 09:22:40.371371 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 28 09:22:40.371371 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application Jul 28 09:22:40.371371 dv-cinder-851351-1-smb devstack@keystone.service[479852]: [pid: 479852|app: 0|req: 653/1290] 10.222.0.42 () {56 vars in 1117 bytes} [Thu Jul 28 09:22:40 2022] GET /identity/v3/services/placement => generated 90 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 09:22:40.376254 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80230712-3661-48a7-acd4-d6d5fa70f663 None None] Authenticating user token {{(pid=479851) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:22:40.478563 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80230712-3661-48a7-acd4-d6d5fa70f663 None None] Validating token access rules against request {{(pid=479851) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:22:40.517293 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696d40d1-87dc-48b2-b436-26822fca1a1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479851) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:22:40.517938 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696d40d1-87dc-48b2-b436-26822fca1a1d None admin] REQUEST_METHOD: `GET` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:22:40.518231 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696d40d1-87dc-48b2-b436-26822fca1a1d None admin] SCRIPT_NAME: `/identity` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:22:40.518516 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696d40d1-87dc-48b2-b436-26822fca1a1d None admin] PATH_INFO: `/v3/services` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:22:40.519196 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-696d40d1-87dc-48b2-b436-26822fca1a1d None admin] RBAC: Adding query filter params (name=placement) {{(pid=479851) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 09:22:40.519532 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-696d40d1-87dc-48b2-b436-26822fca1a1d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:22:40.520965 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-696d40d1-87dc-48b2-b436-26822fca1a1d None admin] RBAC: Authorization granted {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:22:40.526648 dv-cinder-851351-1-smb devstack@keystone.service[479851]: [pid: 479851|app: 0|req: 638/1291] 10.222.0.42 () {56 vars in 1116 bytes} [Thu Jul 28 09:22:40 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:22:40.532896 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfbf2847-9a54-4fe0-b051-f90224127565 None admin] Authenticating user token {{(pid=479852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:22:40.645605 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfbf2847-9a54-4fe0-b051-f90224127565 None admin] Validating token access rules against request {{(pid=479852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:22:40.680283 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6471c8d9-90e8-4ffb-9de5-373639eb8815 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:22:40.680939 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6471c8d9-90e8-4ffb-9de5-373639eb8815 None admin] REQUEST_METHOD: `GET` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:22:40.681221 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6471c8d9-90e8-4ffb-9de5-373639eb8815 None admin] SCRIPT_NAME: `/identity` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:22:40.681496 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6471c8d9-90e8-4ffb-9de5-373639eb8815 None admin] PATH_INFO: `/v3/services` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:22:40.682181 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6471c8d9-90e8-4ffb-9de5-373639eb8815 None admin] RBAC: Adding query filter params (type=placement) {{(pid=479852) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 09:22:40.682488 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6471c8d9-90e8-4ffb-9de5-373639eb8815 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:22:40.683902 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6471c8d9-90e8-4ffb-9de5-373639eb8815 None admin] RBAC: Authorization granted {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:22:40.688503 dv-cinder-851351-1-smb devstack@keystone.service[479852]: [pid: 479852|app: 0|req: 654/1292] 10.222.0.42 () {56 vars in 1116 bytes} [Thu Jul 28 09:22:40 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:22:42.715990 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe1d68c-85a3-4e61-88ea-8c63021d03e2 None None] REQUEST_METHOD: `GET` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:22:42.716973 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe1d68c-85a3-4e61-88ea-8c63021d03e2 None None] SCRIPT_NAME: `/identity` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:22:42.716973 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe1d68c-85a3-4e61-88ea-8c63021d03e2 None None] PATH_INFO: `/` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:22:42.717907 dv-cinder-851351-1-smb devstack@keystone.service[479851]: [pid: 479851|app: 0|req: 639/1293] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 09:22:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 09:22:42.724760 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1340edce-713f-4d68-aa06-953508f88e92 None None] REQUEST_METHOD: `POST` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:22:42.725653 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1340edce-713f-4d68-aa06-953508f88e92 None None] SCRIPT_NAME: `/identity` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:22:42.725653 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1340edce-713f-4d68-aa06-953508f88e92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:22:42.749403 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.auth.core [None req-1340edce-713f-4d68-aa06-953508f88e92 None None] MFA Rules not processed for user `c198f91a4ae84d2b9cc730a6e304c2be`. Rule list: `[]` (Enabled: `True`). {{(pid=479852) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 09:22:42.751328 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.fernet_utils [None req-1340edce-713f-4d68-aa06-953508f88e92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=479852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 09:22:42.795516 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG dbcounter [-] [479852] Writing DB stats keystone:SELECT=100 {{(pid=479852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:22:42.842611 dv-cinder-851351-1-smb devstack@keystone.service[479852]: [pid: 479852|app: 0|req: 655/1294] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 09:22:42 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 09:22:42.864961 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe1d68c-85a3-4e61-88ea-8c63021d03e2 None None] Authenticating user token {{(pid=479851) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:22:42.900176 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG dbcounter [-] [479851] Writing DB stats keystone:SELECT=100 {{(pid=479851) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:22:42.979006 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe1d68c-85a3-4e61-88ea-8c63021d03e2 None None] Validating token access rules against request {{(pid=479851) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:22:43.015574 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69dfb698-5ea6-47d9-afd6-5203ba1623b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479851) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:22:43.016263 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69dfb698-5ea6-47d9-afd6-5203ba1623b3 None admin] REQUEST_METHOD: `POST` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:22:43.016547 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69dfb698-5ea6-47d9-afd6-5203ba1623b3 None admin] SCRIPT_NAME: `/identity` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:22:43.016861 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69dfb698-5ea6-47d9-afd6-5203ba1623b3 None admin] PATH_INFO: `/v3/services` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:22:43.017570 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69dfb698-5ea6-47d9-afd6-5203ba1623b3 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:22:43.018952 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69dfb698-5ea6-47d9-afd6-5203ba1623b3 None admin] RBAC: Authorization granted {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:22:43.035436 dv-cinder-851351-1-smb devstack@keystone.service[479851]: [pid: 479851|app: 0|req: 640/1295] 10.222.0.42 () {60 vars in 1141 bytes} [Thu Jul 28 09:22:42 2022] POST /identity/v3/services => generated 246 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 09:22:45.073288 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f8029d-4c0a-47fc-b22b-64f9396c9fc7 None None] REQUEST_METHOD: `GET` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:22:45.073922 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f8029d-4c0a-47fc-b22b-64f9396c9fc7 None None] SCRIPT_NAME: `/identity` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:22:45.073922 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f8029d-4c0a-47fc-b22b-64f9396c9fc7 None None] PATH_INFO: `/` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:22:45.075218 dv-cinder-851351-1-smb devstack@keystone.service[479852]: [pid: 479852|app: 0|req: 656/1296] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 09:22:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 09:22:45.080880 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f619d7d3-3c16-4ec1-a897-22247974cf9c None None] REQUEST_METHOD: `POST` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:22:45.081433 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f619d7d3-3c16-4ec1-a897-22247974cf9c None None] SCRIPT_NAME: `/identity` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:22:45.081433 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f619d7d3-3c16-4ec1-a897-22247974cf9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:22:45.101371 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.auth.core [None req-f619d7d3-3c16-4ec1-a897-22247974cf9c None None] MFA Rules not processed for user `c198f91a4ae84d2b9cc730a6e304c2be`. Rule list: `[]` (Enabled: `True`). {{(pid=479851) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 09:22:45.102610 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.fernet_utils [None req-f619d7d3-3c16-4ec1-a897-22247974cf9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=479851) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 09:22:45.179482 dv-cinder-851351-1-smb devstack@keystone.service[479851]: [pid: 479851|app: 0|req: 641/1297] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 09:22:45 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 09:22:45.203019 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f8029d-4c0a-47fc-b22b-64f9396c9fc7 None None] Authenticating user token {{(pid=479852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:22:45.333482 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f8029d-4c0a-47fc-b22b-64f9396c9fc7 None None] Validating token access rules against request {{(pid=479852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:22:45.376827 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8445eada-7736-4e5b-9dbf-f2794bf65868 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:22:45.377857 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8445eada-7736-4e5b-9dbf-f2794bf65868 None admin] REQUEST_METHOD: `GET` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:22:45.378356 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8445eada-7736-4e5b-9dbf-f2794bf65868 None admin] SCRIPT_NAME: `/identity` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:22:45.378854 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8445eada-7736-4e5b-9dbf-f2794bf65868 None admin] PATH_INFO: `/v3/services/placement` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:22:45.380058 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8445eada-7736-4e5b-9dbf-f2794bf65868 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:22:45.382723 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8445eada-7736-4e5b-9dbf-f2794bf65868 None admin] RBAC: Authorization granted {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:22:45.400031 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application [None req-8445eada-7736-4e5b-9dbf-f2794bf65868 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jul 28 09:22:45.400031 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 09:22:45.400031 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 28 09:22:45.400031 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 28 09:22:45.400031 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 28 09:22:45.400031 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 28 09:22:45.400031 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 28 09:22:45.400031 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 09:22:45.400031 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 28 09:22:45.400031 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application Jul 28 09:22:45.400031 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 28 09:22:45.400031 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application Jul 28 09:22:45.400031 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 09:22:45.400031 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 09:22:45.400031 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 09:22:45.400031 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 09:22:45.400031 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 09:22:45.401570 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 09:22:45.401570 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 09:22:45.401570 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 09:22:45.401570 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 09:22:45.401570 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 09:22:45.401570 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 09:22:45.401570 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 28 09:22:45.401570 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 28 09:22:45.401570 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 28 09:22:45.401570 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 28 09:22:45.401570 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 09:22:45.401570 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 09:22:45.401570 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 09:22:45.401570 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 09:22:45.401570 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 09:22:45.401570 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 09:22:45.402831 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 09:22:45.402831 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application with Lock( Jul 28 09:22:45.402831 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 09:22:45.402831 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self._enter() Jul 28 09:22:45.402831 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 09:22:45.402831 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 09:22:45.402831 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 09:22:45.402831 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self.creator() Jul 28 09:22:45.402831 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 09:22:45.402831 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application created_value = creator( Jul 28 09:22:45.402831 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 28 09:22:45.402831 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 09:22:45.402831 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 28 09:22:45.402831 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application Jul 28 09:22:45.402831 dv-cinder-851351-1-smb devstack@keystone.service[479852]: [pid: 479852|app: 0|req: 657/1298] 10.222.0.42 () {56 vars in 1117 bytes} [Thu Jul 28 09:22:45 2022] GET /identity/v3/services/placement => generated 90 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 09:22:45.408784 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f619d7d3-3c16-4ec1-a897-22247974cf9c None None] Authenticating user token {{(pid=479851) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:22:45.429283 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG dbcounter [-] [479851] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=479851) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:22:45.527445 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f619d7d3-3c16-4ec1-a897-22247974cf9c None None] Validating token access rules against request {{(pid=479851) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:22:45.567052 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34277f49-5074-45f2-a04e-932260ed1803 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479851) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:22:45.567688 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34277f49-5074-45f2-a04e-932260ed1803 None admin] REQUEST_METHOD: `GET` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:22:45.567945 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34277f49-5074-45f2-a04e-932260ed1803 None admin] SCRIPT_NAME: `/identity` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:22:45.568211 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34277f49-5074-45f2-a04e-932260ed1803 None admin] PATH_INFO: `/v3/services` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:22:45.568934 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34277f49-5074-45f2-a04e-932260ed1803 None admin] RBAC: Adding query filter params (name=placement) {{(pid=479851) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 09:22:45.569240 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34277f49-5074-45f2-a04e-932260ed1803 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:22:45.570650 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34277f49-5074-45f2-a04e-932260ed1803 None admin] RBAC: Authorization granted {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:22:45.576616 dv-cinder-851351-1-smb devstack@keystone.service[479851]: [pid: 479851|app: 0|req: 642/1299] 10.222.0.42 () {56 vars in 1116 bytes} [Thu Jul 28 09:22:45 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:22:45.583161 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8445eada-7736-4e5b-9dbf-f2794bf65868 None admin] Authenticating user token {{(pid=479852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:22:45.617922 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG dbcounter [-] [479852] Writing DB stats keystone:SELECT=100 {{(pid=479852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:22:45.691515 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8445eada-7736-4e5b-9dbf-f2794bf65868 None admin] Validating token access rules against request {{(pid=479852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:22:45.732757 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410bc54a-d635-4dd6-a79b-b1869bd1238d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:22:45.733472 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410bc54a-d635-4dd6-a79b-b1869bd1238d None admin] REQUEST_METHOD: `GET` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:22:45.733766 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410bc54a-d635-4dd6-a79b-b1869bd1238d None admin] SCRIPT_NAME: `/identity` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:22:45.734033 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410bc54a-d635-4dd6-a79b-b1869bd1238d None admin] PATH_INFO: `/v3/endpoints` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:22:45.735015 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-410bc54a-d635-4dd6-a79b-b1869bd1238d None admin] RBAC: Adding query filter params (interface=public, service_id=681370aa8cc1466fb4fc044e1fca9cb3, region_id=RegionOne) {{(pid=479852) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 09:22:45.735343 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-410bc54a-d635-4dd6-a79b-b1869bd1238d None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:22:45.736879 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-410bc54a-d635-4dd6-a79b-b1869bd1238d None admin] RBAC: Authorization granted {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:22:45.743522 dv-cinder-851351-1-smb devstack@keystone.service[479852]: [pid: 479852|app: 0|req: 658/1300] 10.222.0.42 () {56 vars in 1251 bytes} [Thu Jul 28 09:22:45 2022] GET /identity/v3/endpoints?service_id=681370aa8cc1466fb4fc044e1fca9cb3&interface=public®ion_id=RegionOne => generated 194 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:22:45.751080 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34277f49-5074-45f2-a04e-932260ed1803 None admin] Authenticating user token {{(pid=479851) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:22:45.857193 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG dbcounter [-] [479851] Writing DB stats keystone:SELECT=100 {{(pid=479851) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:22:45.878265 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34277f49-5074-45f2-a04e-932260ed1803 None admin] Validating token access rules against request {{(pid=479851) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:22:45.914785 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879a4124-6df2-4244-85d3-e456c1f0f8ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479851) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:22:45.915435 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879a4124-6df2-4244-85d3-e456c1f0f8ad None admin] REQUEST_METHOD: `GET` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:22:45.915716 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879a4124-6df2-4244-85d3-e456c1f0f8ad None admin] SCRIPT_NAME: `/identity` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:22:45.916040 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879a4124-6df2-4244-85d3-e456c1f0f8ad None admin] PATH_INFO: `/v3/services` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:22:45.917022 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-879a4124-6df2-4244-85d3-e456c1f0f8ad None admin] RBAC: Authorizing `identity:list_services()` {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:22:45.918699 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-879a4124-6df2-4244-85d3-e456c1f0f8ad None admin] RBAC: Authorization granted {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:22:45.926741 dv-cinder-851351-1-smb devstack@keystone.service[479851]: [pid: 479851|app: 0|req: 643/1301] 10.222.0.42 () {56 vars in 1087 bytes} [Thu Jul 28 09:22:45 2022] GET /identity/v3/services => generated 2191 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 28 09:22:47.964158 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c57113-4e61-4a4f-92a8-90820032beb5 None None] REQUEST_METHOD: `GET` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:22:47.964854 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c57113-4e61-4a4f-92a8-90820032beb5 None None] SCRIPT_NAME: `/identity` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:22:47.964854 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c57113-4e61-4a4f-92a8-90820032beb5 None None] PATH_INFO: `/` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:22:47.966103 dv-cinder-851351-1-smb devstack@keystone.service[479852]: [pid: 479852|app: 0|req: 659/1302] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 09:22:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 09:22:47.971642 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2d3b24-df8d-41cb-b6a1-a52a5b2c4e1b None None] REQUEST_METHOD: `POST` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:22:47.972156 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2d3b24-df8d-41cb-b6a1-a52a5b2c4e1b None None] SCRIPT_NAME: `/identity` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:22:47.972156 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2d3b24-df8d-41cb-b6a1-a52a5b2c4e1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:22:47.994268 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.auth.core [None req-9a2d3b24-df8d-41cb-b6a1-a52a5b2c4e1b None None] MFA Rules not processed for user `c198f91a4ae84d2b9cc730a6e304c2be`. Rule list: `[]` (Enabled: `True`). {{(pid=479851) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 09:22:47.995478 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.fernet_utils [None req-9a2d3b24-df8d-41cb-b6a1-a52a5b2c4e1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=479851) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 09:22:48.070246 dv-cinder-851351-1-smb devstack@keystone.service[479851]: [pid: 479851|app: 0|req: 644/1303] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 09:22:47 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 28 09:22:48.093136 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c57113-4e61-4a4f-92a8-90820032beb5 None None] Authenticating user token {{(pid=479852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:22:48.199146 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG dbcounter [-] [479852] Writing DB stats keystone:SELECT=100 {{(pid=479852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:22:48.207958 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c57113-4e61-4a4f-92a8-90820032beb5 None None] Validating token access rules against request {{(pid=479852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:22:48.244747 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fede65e-5054-4ad3-81f9-21d405200bdf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:22:48.245274 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fede65e-5054-4ad3-81f9-21d405200bdf None admin] REQUEST_METHOD: `GET` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:22:48.245549 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fede65e-5054-4ad3-81f9-21d405200bdf None admin] SCRIPT_NAME: `/identity` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:22:48.245820 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fede65e-5054-4ad3-81f9-21d405200bdf None admin] PATH_INFO: `/v3/services/placement` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:22:48.246445 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fede65e-5054-4ad3-81f9-21d405200bdf None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:22:48.247815 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fede65e-5054-4ad3-81f9-21d405200bdf None admin] RBAC: Authorization granted {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:22:48.257425 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application [None req-5fede65e-5054-4ad3-81f9-21d405200bdf None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jul 28 09:22:48.257425 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 09:22:48.257425 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 28 09:22:48.257425 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 28 09:22:48.257425 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 28 09:22:48.257425 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 28 09:22:48.257425 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 28 09:22:48.257425 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 09:22:48.257425 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 28 09:22:48.257425 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application Jul 28 09:22:48.257425 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 28 09:22:48.257425 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application Jul 28 09:22:48.257425 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 28 09:22:48.257425 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Jul 28 09:22:48.257425 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 28 09:22:48.257425 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Jul 28 09:22:48.257425 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 28 09:22:48.259090 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 28 09:22:48.259090 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 28 09:22:48.259090 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 28 09:22:48.259090 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 28 09:22:48.259090 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 28 09:22:48.259090 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 28 09:22:48.259090 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 28 09:22:48.259090 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 28 09:22:48.259090 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 28 09:22:48.259090 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 28 09:22:48.259090 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 28 09:22:48.259090 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 28 09:22:48.259090 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 28 09:22:48.259090 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 28 09:22:48.259090 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 28 09:22:48.259090 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self.get_or_create( Jul 28 09:22:48.260348 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 28 09:22:48.260348 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application with Lock( Jul 28 09:22:48.260348 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 28 09:22:48.260348 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self._enter() Jul 28 09:22:48.260348 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 28 09:22:48.260348 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 28 09:22:48.260348 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 28 09:22:48.260348 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application return self.creator() Jul 28 09:22:48.260348 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 28 09:22:48.260348 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application created_value = creator( Jul 28 09:22:48.260348 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 28 09:22:48.260348 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 28 09:22:48.260348 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 28 09:22:48.260348 dv-cinder-851351-1-smb devstack@keystone.service[479852]: ERROR keystone.server.flask.application Jul 28 09:22:48.260348 dv-cinder-851351-1-smb devstack@keystone.service[479852]: [pid: 479852|app: 0|req: 660/1304] 10.222.0.42 () {56 vars in 1117 bytes} [Thu Jul 28 09:22:48 2022] GET /identity/v3/services/placement => generated 90 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 28 09:22:48.265053 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a2d3b24-df8d-41cb-b6a1-a52a5b2c4e1b None None] Authenticating user token {{(pid=479851) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:22:48.347379 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG dbcounter [-] [479851] Writing DB stats keystone:SELECT=100 {{(pid=479851) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:22:48.372323 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a2d3b24-df8d-41cb-b6a1-a52a5b2c4e1b None None] Validating token access rules against request {{(pid=479851) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:22:48.411900 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8299fd0b-05c8-4f61-ac22-2555beb74592 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479851) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:22:48.412547 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8299fd0b-05c8-4f61-ac22-2555beb74592 None admin] REQUEST_METHOD: `GET` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:22:48.412873 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8299fd0b-05c8-4f61-ac22-2555beb74592 None admin] SCRIPT_NAME: `/identity` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:22:48.413158 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8299fd0b-05c8-4f61-ac22-2555beb74592 None admin] PATH_INFO: `/v3/services` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:22:48.413860 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8299fd0b-05c8-4f61-ac22-2555beb74592 None admin] RBAC: Adding query filter params (name=placement) {{(pid=479851) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 28 09:22:48.414263 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8299fd0b-05c8-4f61-ac22-2555beb74592 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:22:48.416259 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8299fd0b-05c8-4f61-ac22-2555beb74592 None admin] RBAC: Authorization granted {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:22:48.423203 dv-cinder-851351-1-smb devstack@keystone.service[479851]: [pid: 479851|app: 0|req: 645/1305] 10.222.0.42 () {56 vars in 1116 bytes} [Thu Jul 28 09:22:48 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 28 09:22:48.429478 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fede65e-5054-4ad3-81f9-21d405200bdf None admin] Authenticating user token {{(pid=479852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:22:48.535126 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fede65e-5054-4ad3-81f9-21d405200bdf None admin] Validating token access rules against request {{(pid=479852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:22:48.571544 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f6eb71-f56c-4c82-aedd-42ead92c21db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c198f91a4ae84d2b9cc730a6e304c2be', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:22:48.572168 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f6eb71-f56c-4c82-aedd-42ead92c21db None admin] REQUEST_METHOD: `POST` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:22:48.572444 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f6eb71-f56c-4c82-aedd-42ead92c21db None admin] SCRIPT_NAME: `/identity` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:22:48.572720 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f6eb71-f56c-4c82-aedd-42ead92c21db None admin] PATH_INFO: `/v3/endpoints` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:22:48.573461 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f6eb71-f56c-4c82-aedd-42ead92c21db None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:22:48.574848 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f6eb71-f56c-4c82-aedd-42ead92c21db None admin] RBAC: Authorization granted {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:22:48.596986 dv-cinder-851351-1-smb devstack@keystone.service[479852]: [pid: 479852|app: 0|req: 661/1306] 10.222.0.42 () {60 vars in 1144 bytes} [Thu Jul 28 09:22:48 2022] POST /identity/v3/endpoints => generated 331 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 28 09:22:58.419445 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG dbcounter [-] [479851] Writing DB stats keystone:SELECT=30 {{(pid=479851) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:22:58.592397 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG dbcounter [-] [479852] Writing DB stats keystone:SELECT=91,keystone:INSERT=1 {{(pid=479852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:23:57.612440 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73239607-d53b-4ee9-95ea-ed48a7c646e0 None None] REQUEST_METHOD: `GET` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:23:57.613562 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73239607-d53b-4ee9-95ea-ed48a7c646e0 None None] SCRIPT_NAME: `/identity` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:23:57.614005 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73239607-d53b-4ee9-95ea-ed48a7c646e0 None None] PATH_INFO: `/` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:23:57.616074 dv-cinder-851351-1-smb devstack@keystone.service[479851]: [pid: 479851|app: 0|req: 646/1307] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 09:23:57 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 09:23:57.621274 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d41dc9-37fc-4a6f-8c02-a243d72d429f None None] REQUEST_METHOD: `POST` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:23:57.621808 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d41dc9-37fc-4a6f-8c02-a243d72d429f None None] SCRIPT_NAME: `/identity` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:23:57.621808 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d41dc9-37fc-4a6f-8c02-a243d72d429f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:23:57.812035 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.auth.core [None req-32d41dc9-37fc-4a6f-8c02-a243d72d429f None None] MFA Rules not processed for user `c198f91a4ae84d2b9cc730a6e304c2be`. Rule list: `[]` (Enabled: `True`). {{(pid=479852) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 09:23:57.813233 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.fernet_utils [None req-32d41dc9-37fc-4a6f-8c02-a243d72d429f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=479852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 09:23:58.064366 dv-cinder-851351-1-smb devstack@keystone.service[479852]: [pid: 479852|app: 0|req: 662/1308] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 09:23:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 444 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 09:23:58.135104 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af89faa1-b211-49f9-98de-b135a34516c6 None None] REQUEST_METHOD: `GET` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:23:58.135466 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af89faa1-b211-49f9-98de-b135a34516c6 None None] SCRIPT_NAME: `/identity` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:23:58.135678 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af89faa1-b211-49f9-98de-b135a34516c6 None None] PATH_INFO: `/` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:23:58.137400 dv-cinder-851351-1-smb devstack@keystone.service[479851]: [pid: 479851|app: 0|req: 647/1309] 10.222.0.42 () {54 vars in 965 bytes} [Thu Jul 28 09:23:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 09:23:58.143748 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b90f63-df48-4821-97e7-0075c9e50626 None None] REQUEST_METHOD: `POST` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:23:58.144068 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b90f63-df48-4821-97e7-0075c9e50626 None None] SCRIPT_NAME: `/identity` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:23:58.144328 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b90f63-df48-4821-97e7-0075c9e50626 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:23:58.318489 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.auth.core [None req-f3b90f63-df48-4821-97e7-0075c9e50626 None None] MFA Rules not processed for user `e86286d4286c4a92bb581148d91a3b01`. Rule list: `[]` (Enabled: `True`). {{(pid=479852) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 09:23:58.319675 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.fernet_utils [None req-f3b90f63-df48-4821-97e7-0075c9e50626 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=479852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 09:23:58.385846 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG dbcounter [-] [479852] Writing DB stats keystone:SELECT=100 {{(pid=479852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:23:58.516419 dv-cinder-851351-1-smb devstack@keystone.service[479852]: [pid: 479852|app: 0|req: 663/1310] 10.222.0.42 () {58 vars in 1062 bytes} [Thu Jul 28 09:23:58 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 374 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 09:23:58.525289 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af89faa1-b211-49f9-98de-b135a34516c6 None None] Authenticating user token {{(pid=479851) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:23:58.527096 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.fernet_utils [None req-af89faa1-b211-49f9-98de-b135a34516c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=479851) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 09:23:58.689823 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af89faa1-b211-49f9-98de-b135a34516c6 None None] Validating token access rules against request {{(pid=479851) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:23:58.840882 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db12459e-b822-4b7f-a2d4-283bcd2a52ec service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e86286d4286c4a92bb581148d91a3b01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a0fb8ea8010437bade8f92dcbcaacee', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479851) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:23:58.842321 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db12459e-b822-4b7f-a2d4-283bcd2a52ec service neutron] REQUEST_METHOD: `GET` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:23:58.842880 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db12459e-b822-4b7f-a2d4-283bcd2a52ec service neutron] SCRIPT_NAME: `/identity` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:23:58.843589 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db12459e-b822-4b7f-a2d4-283bcd2a52ec service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:23:58.845795 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.fernet_utils [None req-db12459e-b822-4b7f-a2d4-283bcd2a52ec service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=479851) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 09:23:58.997447 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG dbcounter [-] [479851] Writing DB stats keystone:SELECT=100 {{(pid=479851) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:23:59.102879 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db12459e-b822-4b7f-a2d4-283bcd2a52ec service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:23:59.104489 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db12459e-b822-4b7f-a2d4-283bcd2a52ec service neutron] RBAC: Authorization granted {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:23:59.149280 dv-cinder-851351-1-smb devstack@keystone.service[479851]: [pid: 479851|app: 0|req: 648/1311] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Jul 28 09:23:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 624 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 09:24:01.683595 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff816cd-7d9d-460f-b28e-e76b9098b573 None None] REQUEST_METHOD: `GET` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:24:01.684282 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff816cd-7d9d-460f-b28e-e76b9098b573 None None] SCRIPT_NAME: `/identity` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:24:01.684282 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff816cd-7d9d-460f-b28e-e76b9098b573 None None] PATH_INFO: `/` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:24:01.685535 dv-cinder-851351-1-smb devstack@keystone.service[479852]: [pid: 479852|app: 0|req: 664/1312] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 09:24:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 09:24:01.691100 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b31200-b8b9-4e79-9cdd-0bb712da0fba None None] REQUEST_METHOD: `POST` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:24:01.691604 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b31200-b8b9-4e79-9cdd-0bb712da0fba None None] SCRIPT_NAME: `/identity` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:24:01.691604 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b31200-b8b9-4e79-9cdd-0bb712da0fba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:24:01.764859 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.auth.core [None req-71b31200-b8b9-4e79-9cdd-0bb712da0fba None None] MFA Rules not processed for user `c198f91a4ae84d2b9cc730a6e304c2be`. Rule list: `[]` (Enabled: `True`). {{(pid=479851) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 09:24:01.766005 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.fernet_utils [None req-71b31200-b8b9-4e79-9cdd-0bb712da0fba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=479851) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 09:24:01.864959 dv-cinder-851351-1-smb devstack@keystone.service[479851]: [pid: 479851|app: 0|req: 649/1313] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 09:24:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 09:24:01.903392 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff816cd-7d9d-460f-b28e-e76b9098b573 None None] Authenticating user token {{(pid=479852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:24:01.905017 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.fernet_utils [None req-6ff816cd-7d9d-460f-b28e-e76b9098b573 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=479852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 09:24:02.023291 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff816cd-7d9d-460f-b28e-e76b9098b573 None None] Validating token access rules against request {{(pid=479852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:24:02.098059 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG dbcounter [-] [479852] Writing DB stats keystone:SELECT=100 {{(pid=479852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:24:02.100686 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f383c1af-f6e6-45ce-8974-65f505381196 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e86286d4286c4a92bb581148d91a3b01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a0fb8ea8010437bade8f92dcbcaacee', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:24:02.101443 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f383c1af-f6e6-45ce-8974-65f505381196 service neutron] REQUEST_METHOD: `GET` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:24:02.101734 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f383c1af-f6e6-45ce-8974-65f505381196 service neutron] SCRIPT_NAME: `/identity` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:24:02.102019 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f383c1af-f6e6-45ce-8974-65f505381196 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:24:02.104235 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.fernet_utils [None req-f383c1af-f6e6-45ce-8974-65f505381196 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=479852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 09:24:02.227554 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f383c1af-f6e6-45ce-8974-65f505381196 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:24:02.229077 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f383c1af-f6e6-45ce-8974-65f505381196 service neutron] RBAC: Authorization granted {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:24:02.251020 dv-cinder-851351-1-smb devstack@keystone.service[479852]: [pid: 479852|app: 0|req: 665/1314] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Jul 28 09:24:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 348 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 09:24:04.633949 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b74e6d3-c102-4be0-ae89-f873e75d4cb0 None None] REQUEST_METHOD: `GET` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:24:04.634594 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b74e6d3-c102-4be0-ae89-f873e75d4cb0 None None] SCRIPT_NAME: `/identity` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:24:04.634594 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b74e6d3-c102-4be0-ae89-f873e75d4cb0 None None] PATH_INFO: `/` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:24:04.635990 dv-cinder-851351-1-smb devstack@keystone.service[479851]: [pid: 479851|app: 0|req: 650/1315] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 09:24:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 09:24:04.642063 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5dc92f-12e5-4f11-9db8-5a1711f725b8 None None] REQUEST_METHOD: `POST` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:24:04.642735 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5dc92f-12e5-4f11-9db8-5a1711f725b8 None None] SCRIPT_NAME: `/identity` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:24:04.642735 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5dc92f-12e5-4f11-9db8-5a1711f725b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:24:04.720789 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.auth.core [None req-ba5dc92f-12e5-4f11-9db8-5a1711f725b8 None None] MFA Rules not processed for user `73be2aaaa3a047f395fae06ed9308ab6`. Rule list: `[]` (Enabled: `True`). {{(pid=479852) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 09:24:04.722073 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.fernet_utils [None req-ba5dc92f-12e5-4f11-9db8-5a1711f725b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=479852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 09:24:04.809554 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG dbcounter [-] [479852] Writing DB stats keystone:SELECT=100 {{(pid=479852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:24:04.886598 dv-cinder-851351-1-smb devstack@keystone.service[479852]: [pid: 479852|app: 0|req: 666/1316] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 09:24:04 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 246 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 09:24:04.926701 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b74e6d3-c102-4be0-ae89-f873e75d4cb0 None None] Authenticating user token {{(pid=479851) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:24:04.928288 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.fernet_utils [None req-7b74e6d3-c102-4be0-ae89-f873e75d4cb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=479851) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 09:24:04.939273 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG dbcounter [-] [479851] Writing DB stats keystone:SELECT=100 {{(pid=479851) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:24:05.040418 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b74e6d3-c102-4be0-ae89-f873e75d4cb0 None None] Validating token access rules against request {{(pid=479851) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:24:05.119612 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e158411-4c38-460f-8851-bcfc36eb9639 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e86286d4286c4a92bb581148d91a3b01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a0fb8ea8010437bade8f92dcbcaacee', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479851) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:24:05.120259 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e158411-4c38-460f-8851-bcfc36eb9639 service neutron] REQUEST_METHOD: `GET` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:24:05.120552 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e158411-4c38-460f-8851-bcfc36eb9639 service neutron] SCRIPT_NAME: `/identity` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:24:05.120869 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e158411-4c38-460f-8851-bcfc36eb9639 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:24:05.122570 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.fernet_utils [None req-3e158411-4c38-460f-8851-bcfc36eb9639 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=479851) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 09:24:05.189634 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG dbcounter [-] [479851] Writing DB stats keystone:SELECT=100 {{(pid=479851) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:24:05.238569 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e158411-4c38-460f-8851-bcfc36eb9639 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:24:05.240093 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e158411-4c38-460f-8851-bcfc36eb9639 service neutron] RBAC: Authorization granted {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:24:05.259487 dv-cinder-851351-1-smb devstack@keystone.service[479851]: [pid: 479851|app: 0|req: 651/1317] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Jul 28 09:24:04 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 09:24:07.944887 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc25459-70cc-4dea-b27d-ce61eb8e1b5b None None] REQUEST_METHOD: `GET` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:24:07.945525 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc25459-70cc-4dea-b27d-ce61eb8e1b5b None None] SCRIPT_NAME: `/identity` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:24:07.945525 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc25459-70cc-4dea-b27d-ce61eb8e1b5b None None] PATH_INFO: `/` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:24:07.947262 dv-cinder-851351-1-smb devstack@keystone.service[479852]: [pid: 479852|app: 0|req: 667/1318] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 09:24:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 09:24:07.953146 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e87b3c2-522d-416d-98b8-8d0d0f6d993c None None] REQUEST_METHOD: `POST` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:24:07.953658 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e87b3c2-522d-416d-98b8-8d0d0f6d993c None None] SCRIPT_NAME: `/identity` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:24:07.953774 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e87b3c2-522d-416d-98b8-8d0d0f6d993c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:24:08.023220 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.auth.core [None req-6e87b3c2-522d-416d-98b8-8d0d0f6d993c None None] MFA Rules not processed for user `c198f91a4ae84d2b9cc730a6e304c2be`. Rule list: `[]` (Enabled: `True`). {{(pid=479851) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 09:24:08.024457 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.fernet_utils [None req-6e87b3c2-522d-416d-98b8-8d0d0f6d993c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=479851) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 09:24:08.128692 dv-cinder-851351-1-smb devstack@keystone.service[479851]: [pid: 479851|app: 0|req: 652/1319] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 09:24:07 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 09:24:08.168478 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc25459-70cc-4dea-b27d-ce61eb8e1b5b None None] Authenticating user token {{(pid=479852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:24:08.170132 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.fernet_utils [None req-ecc25459-70cc-4dea-b27d-ce61eb8e1b5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=479852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 09:24:08.283702 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc25459-70cc-4dea-b27d-ce61eb8e1b5b None None] Validating token access rules against request {{(pid=479852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:24:08.358652 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7262552e-c212-4174-b077-e35b239657df service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e86286d4286c4a92bb581148d91a3b01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a0fb8ea8010437bade8f92dcbcaacee', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:24:08.359284 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7262552e-c212-4174-b077-e35b239657df service neutron] REQUEST_METHOD: `GET` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:24:08.359540 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7262552e-c212-4174-b077-e35b239657df service neutron] SCRIPT_NAME: `/identity` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:24:08.359839 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7262552e-c212-4174-b077-e35b239657df service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:24:08.361531 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.fernet_utils [None req-7262552e-c212-4174-b077-e35b239657df service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=479852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 09:24:08.369817 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG dbcounter [-] [479852] Writing DB stats keystone:SELECT=100 {{(pid=479852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:24:08.481580 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7262552e-c212-4174-b077-e35b239657df service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:24:08.483170 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7262552e-c212-4174-b077-e35b239657df service neutron] RBAC: Authorization granted {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:24:08.501927 dv-cinder-851351-1-smb devstack@keystone.service[479852]: [pid: 479852|app: 0|req: 668/1320] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Jul 28 09:24:08 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 09:24:11.242706 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72defbf7-b2f1-4f4d-a637-cd073ec1f8d2 None None] REQUEST_METHOD: `GET` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:24:11.243322 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72defbf7-b2f1-4f4d-a637-cd073ec1f8d2 None None] SCRIPT_NAME: `/identity` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:24:11.243322 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72defbf7-b2f1-4f4d-a637-cd073ec1f8d2 None None] PATH_INFO: `/` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:24:11.244641 dv-cinder-851351-1-smb devstack@keystone.service[479851]: [pid: 479851|app: 0|req: 653/1321] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 09:24:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 09:24:11.250083 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69823eed-31e7-4ec3-8879-3bd9ac5358dd None None] REQUEST_METHOD: `POST` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:24:11.250564 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69823eed-31e7-4ec3-8879-3bd9ac5358dd None None] SCRIPT_NAME: `/identity` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:24:11.250672 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69823eed-31e7-4ec3-8879-3bd9ac5358dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:24:11.319368 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.auth.core [None req-69823eed-31e7-4ec3-8879-3bd9ac5358dd None None] MFA Rules not processed for user `c198f91a4ae84d2b9cc730a6e304c2be`. Rule list: `[]` (Enabled: `True`). {{(pid=479852) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 09:24:11.320594 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.fernet_utils [None req-69823eed-31e7-4ec3-8879-3bd9ac5358dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=479852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 09:24:11.388644 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG dbcounter [-] [479852] Writing DB stats keystone:SELECT=100 {{(pid=479852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:24:11.431999 dv-cinder-851351-1-smb devstack@keystone.service[479852]: [pid: 479852|app: 0|req: 669/1322] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 09:24:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 09:24:11.470292 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72defbf7-b2f1-4f4d-a637-cd073ec1f8d2 None None] Authenticating user token {{(pid=479851) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:24:11.471920 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.fernet_utils [None req-72defbf7-b2f1-4f4d-a637-cd073ec1f8d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=479851) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 09:24:11.494581 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG dbcounter [-] [479851] Writing DB stats keystone:SELECT=100 {{(pid=479851) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:24:11.592879 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72defbf7-b2f1-4f4d-a637-cd073ec1f8d2 None None] Validating token access rules against request {{(pid=479851) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:24:11.675146 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854079e7-0d17-4eca-bbe1-b42daf78acac service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e86286d4286c4a92bb581148d91a3b01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a0fb8ea8010437bade8f92dcbcaacee', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479851) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:24:11.675791 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854079e7-0d17-4eca-bbe1-b42daf78acac service neutron] REQUEST_METHOD: `GET` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:24:11.676083 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854079e7-0d17-4eca-bbe1-b42daf78acac service neutron] SCRIPT_NAME: `/identity` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:24:11.676361 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854079e7-0d17-4eca-bbe1-b42daf78acac service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:24:11.678521 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.fernet_utils [None req-854079e7-0d17-4eca-bbe1-b42daf78acac service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=479851) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 09:24:11.756515 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG dbcounter [-] [479851] Writing DB stats keystone:SELECT=100 {{(pid=479851) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:24:11.797086 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-854079e7-0d17-4eca-bbe1-b42daf78acac service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:24:11.798567 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-854079e7-0d17-4eca-bbe1-b42daf78acac service neutron] RBAC: Authorization granted {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:24:11.818694 dv-cinder-851351-1-smb devstack@keystone.service[479851]: [pid: 479851|app: 0|req: 654/1323] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Jul 28 09:24:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 349 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 09:24:13.904966 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b514c61-b809-47cc-a63b-43110a30ec40 None None] REQUEST_METHOD: `GET` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:24:13.905524 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b514c61-b809-47cc-a63b-43110a30ec40 None None] SCRIPT_NAME: `/identity` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:24:13.905524 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b514c61-b809-47cc-a63b-43110a30ec40 None None] PATH_INFO: `/` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:24:13.906791 dv-cinder-851351-1-smb devstack@keystone.service[479852]: [pid: 479852|app: 0|req: 670/1324] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 09:24:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 09:24:13.912251 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c504367-a4fe-41b0-a7b8-fb821e113b30 None None] REQUEST_METHOD: `POST` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:24:13.912751 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c504367-a4fe-41b0-a7b8-fb821e113b30 None None] SCRIPT_NAME: `/identity` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:24:13.912964 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c504367-a4fe-41b0-a7b8-fb821e113b30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:24:13.991750 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.auth.core [None req-1c504367-a4fe-41b0-a7b8-fb821e113b30 None None] MFA Rules not processed for user `c198f91a4ae84d2b9cc730a6e304c2be`. Rule list: `[]` (Enabled: `True`). {{(pid=479851) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 09:24:13.993395 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.fernet_utils [None req-1c504367-a4fe-41b0-a7b8-fb821e113b30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=479851) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 09:24:14.109854 dv-cinder-851351-1-smb devstack@keystone.service[479851]: [pid: 479851|app: 0|req: 655/1325] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 09:24:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 09:24:14.147444 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b514c61-b809-47cc-a63b-43110a30ec40 None None] Authenticating user token {{(pid=479852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:24:14.149107 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.fernet_utils [None req-9b514c61-b809-47cc-a63b-43110a30ec40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=479852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 09:24:14.266363 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b514c61-b809-47cc-a63b-43110a30ec40 None None] Validating token access rules against request {{(pid=479852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:24:14.345800 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85311424-c47b-48c7-aa55-950d04e89afc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e86286d4286c4a92bb581148d91a3b01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a0fb8ea8010437bade8f92dcbcaacee', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:24:14.346467 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85311424-c47b-48c7-aa55-950d04e89afc service neutron] REQUEST_METHOD: `GET` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:24:14.346744 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85311424-c47b-48c7-aa55-950d04e89afc service neutron] SCRIPT_NAME: `/identity` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:24:14.347022 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85311424-c47b-48c7-aa55-950d04e89afc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:24:14.348698 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.fernet_utils [None req-85311424-c47b-48c7-aa55-950d04e89afc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=479852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 09:24:14.366162 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG dbcounter [-] [479852] Writing DB stats keystone:SELECT=100 {{(pid=479852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:24:14.463936 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85311424-c47b-48c7-aa55-950d04e89afc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:24:14.465340 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85311424-c47b-48c7-aa55-950d04e89afc service neutron] RBAC: Authorization granted {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:24:14.483760 dv-cinder-851351-1-smb devstack@keystone.service[479852]: [pid: 479852|app: 0|req: 671/1326] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Jul 28 09:24:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 09:24:16.603139 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043787ef-34d3-4e84-85df-3afe73a79643 None None] REQUEST_METHOD: `GET` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:24:16.603811 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043787ef-34d3-4e84-85df-3afe73a79643 None None] SCRIPT_NAME: `/identity` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:24:16.604130 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043787ef-34d3-4e84-85df-3afe73a79643 None None] PATH_INFO: `/` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:24:16.606470 dv-cinder-851351-1-smb devstack@keystone.service[479851]: [pid: 479851|app: 0|req: 656/1327] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 09:24:16 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 28 09:24:16.613234 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96e45b8-848e-4447-bd89-e29cb95c3bee None None] REQUEST_METHOD: `POST` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:24:16.613857 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96e45b8-848e-4447-bd89-e29cb95c3bee None None] SCRIPT_NAME: `/identity` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:24:16.613857 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96e45b8-848e-4447-bd89-e29cb95c3bee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:24:16.691778 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.auth.core [None req-c96e45b8-848e-4447-bd89-e29cb95c3bee None None] MFA Rules not processed for user `73be2aaaa3a047f395fae06ed9308ab6`. Rule list: `[]` (Enabled: `True`). {{(pid=479852) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 09:24:16.693537 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.fernet_utils [None req-c96e45b8-848e-4447-bd89-e29cb95c3bee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=479852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 09:24:16.766150 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG dbcounter [-] [479852] Writing DB stats keystone:SELECT=100 {{(pid=479852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:24:16.801716 dv-cinder-851351-1-smb devstack@keystone.service[479852]: [pid: 479852|app: 0|req: 672/1328] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 09:24:16 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 09:24:16.858434 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0dae91-0b44-45bf-83ae-331161d32814 None None] REQUEST_METHOD: `GET` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:24:16.858679 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0dae91-0b44-45bf-83ae-331161d32814 None None] SCRIPT_NAME: `/identity` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:24:16.858999 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0dae91-0b44-45bf-83ae-331161d32814 None None] PATH_INFO: `/` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:24:16.860421 dv-cinder-851351-1-smb devstack@keystone.service[479851]: [pid: 479851|app: 0|req: 657/1329] 10.222.0.42 () {54 vars in 965 bytes} [Thu Jul 28 09:24:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 09:24:16.867056 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1584a4cd-80ae-4a1f-af9a-85dc1e635b1b None None] REQUEST_METHOD: `POST` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:24:16.867362 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1584a4cd-80ae-4a1f-af9a-85dc1e635b1b None None] SCRIPT_NAME: `/identity` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:24:16.867644 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1584a4cd-80ae-4a1f-af9a-85dc1e635b1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:24:16.952106 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.auth.core [None req-1584a4cd-80ae-4a1f-af9a-85dc1e635b1b None None] MFA Rules not processed for user `e86286d4286c4a92bb581148d91a3b01`. Rule list: `[]` (Enabled: `True`). {{(pid=479852) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 09:24:16.953294 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.fernet_utils [None req-1584a4cd-80ae-4a1f-af9a-85dc1e635b1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=479852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 09:24:17.044470 dv-cinder-851351-1-smb devstack@keystone.service[479852]: [pid: 479852|app: 0|req: 673/1330] 10.222.0.42 () {58 vars in 1062 bytes} [Thu Jul 28 09:24:16 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 09:24:17.054388 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f0dae91-0b44-45bf-83ae-331161d32814 None None] Authenticating user token {{(pid=479851) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:24:17.058101 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.fernet_utils [None req-7f0dae91-0b44-45bf-83ae-331161d32814 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=479851) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 09:24:17.092575 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG dbcounter [-] [479851] Writing DB stats keystone:SELECT=100 {{(pid=479851) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:24:17.170709 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f0dae91-0b44-45bf-83ae-331161d32814 None None] Validating token access rules against request {{(pid=479851) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:24:17.246979 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f00afc-34b4-4bc2-9c1a-f5f42120691a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e86286d4286c4a92bb581148d91a3b01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a0fb8ea8010437bade8f92dcbcaacee', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479851) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:24:17.247519 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f00afc-34b4-4bc2-9c1a-f5f42120691a service neutron] REQUEST_METHOD: `GET` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:24:17.247802 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f00afc-34b4-4bc2-9c1a-f5f42120691a service neutron] SCRIPT_NAME: `/identity` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:24:17.248170 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f00afc-34b4-4bc2-9c1a-f5f42120691a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:24:17.249831 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.fernet_utils [None req-88f00afc-34b4-4bc2-9c1a-f5f42120691a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=479851) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 09:24:17.332369 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG dbcounter [-] [479851] Writing DB stats keystone:SELECT=100 {{(pid=479851) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:24:17.366380 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88f00afc-34b4-4bc2-9c1a-f5f42120691a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:24:17.367860 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88f00afc-34b4-4bc2-9c1a-f5f42120691a service neutron] RBAC: Authorization granted {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:24:17.388310 dv-cinder-851351-1-smb devstack@keystone.service[479851]: [pid: 479851|app: 0|req: 658/1331] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Jul 28 09:24:17 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 09:24:20.018538 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a6e58a-8f21-4779-8ee1-3189cf429fba None None] REQUEST_METHOD: `GET` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:24:20.019146 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a6e58a-8f21-4779-8ee1-3189cf429fba None None] SCRIPT_NAME: `/identity` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:24:20.019146 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a6e58a-8f21-4779-8ee1-3189cf429fba None None] PATH_INFO: `/` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:24:20.020456 dv-cinder-851351-1-smb devstack@keystone.service[479852]: [pid: 479852|app: 0|req: 674/1332] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 09:24:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 09:24:20.026306 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17050846-c1ab-4ed4-b843-e7399a7edeea None None] REQUEST_METHOD: `POST` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:24:20.026694 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17050846-c1ab-4ed4-b843-e7399a7edeea None None] SCRIPT_NAME: `/identity` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:24:20.026694 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17050846-c1ab-4ed4-b843-e7399a7edeea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:24:20.100131 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.auth.core [None req-17050846-c1ab-4ed4-b843-e7399a7edeea None None] MFA Rules not processed for user `c198f91a4ae84d2b9cc730a6e304c2be`. Rule list: `[]` (Enabled: `True`). {{(pid=479851) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 09:24:20.101413 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.fernet_utils [None req-17050846-c1ab-4ed4-b843-e7399a7edeea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=479851) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 09:24:20.204992 dv-cinder-851351-1-smb devstack@keystone.service[479851]: [pid: 479851|app: 0|req: 659/1333] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 09:24:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 09:24:20.241775 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a6e58a-8f21-4779-8ee1-3189cf429fba None None] Authenticating user token {{(pid=479852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:24:20.243358 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.fernet_utils [None req-52a6e58a-8f21-4779-8ee1-3189cf429fba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=479852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 09:24:20.318571 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG dbcounter [-] [479852] Writing DB stats keystone:SELECT=100 {{(pid=479852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:24:20.357495 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a6e58a-8f21-4779-8ee1-3189cf429fba None None] Validating token access rules against request {{(pid=479852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:24:20.444679 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed5be8d0-25e3-4d45-be30-120b19390618 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e86286d4286c4a92bb581148d91a3b01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a0fb8ea8010437bade8f92dcbcaacee', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:24:20.445353 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5be8d0-25e3-4d45-be30-120b19390618 service neutron] REQUEST_METHOD: `GET` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:24:20.445620 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5be8d0-25e3-4d45-be30-120b19390618 service neutron] SCRIPT_NAME: `/identity` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:24:20.446242 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5be8d0-25e3-4d45-be30-120b19390618 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:24:20.447900 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.fernet_utils [None req-ed5be8d0-25e3-4d45-be30-120b19390618 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=479852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 09:24:20.565400 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed5be8d0-25e3-4d45-be30-120b19390618 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:24:20.566890 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed5be8d0-25e3-4d45-be30-120b19390618 service neutron] RBAC: Authorization granted {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:24:20.577878 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG dbcounter [-] [479852] Writing DB stats keystone:SELECT=100 {{(pid=479852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:24:20.587323 dv-cinder-851351-1-smb devstack@keystone.service[479852]: [pid: 479852|app: 0|req: 675/1334] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Jul 28 09:24:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 346 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 09:24:22.675362 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e4ecfa-e350-4c33-937b-df043444fb2a None None] REQUEST_METHOD: `GET` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:24:22.675951 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e4ecfa-e350-4c33-937b-df043444fb2a None None] SCRIPT_NAME: `/identity` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:24:22.675951 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e4ecfa-e350-4c33-937b-df043444fb2a None None] PATH_INFO: `/` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:24:22.677241 dv-cinder-851351-1-smb devstack@keystone.service[479851]: [pid: 479851|app: 0|req: 660/1335] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 09:24:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 09:24:22.684179 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7639a8-e086-4497-b00f-b36c52094b4b None None] REQUEST_METHOD: `POST` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:24:22.684741 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7639a8-e086-4497-b00f-b36c52094b4b None None] SCRIPT_NAME: `/identity` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:24:22.684741 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7639a8-e086-4497-b00f-b36c52094b4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:24:22.763610 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.auth.core [None req-6e7639a8-e086-4497-b00f-b36c52094b4b None None] MFA Rules not processed for user `c198f91a4ae84d2b9cc730a6e304c2be`. Rule list: `[]` (Enabled: `True`). {{(pid=479852) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 09:24:22.764949 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.fernet_utils [None req-6e7639a8-e086-4497-b00f-b36c52094b4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=479852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 09:24:22.872799 dv-cinder-851351-1-smb devstack@keystone.service[479852]: [pid: 479852|app: 0|req: 676/1336] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 09:24:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 09:24:22.913226 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e4ecfa-e350-4c33-937b-df043444fb2a None None] Authenticating user token {{(pid=479851) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:24:22.914915 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.fernet_utils [None req-c4e4ecfa-e350-4c33-937b-df043444fb2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=479851) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 09:24:22.961785 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG dbcounter [-] [479851] Writing DB stats keystone:SELECT=100 {{(pid=479851) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:24:23.040592 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e4ecfa-e350-4c33-937b-df043444fb2a None None] Validating token access rules against request {{(pid=479851) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:24:23.121943 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9d3a3d-1ee6-4f19-af99-5beff51892c0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e86286d4286c4a92bb581148d91a3b01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a0fb8ea8010437bade8f92dcbcaacee', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479851) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:24:23.122589 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9d3a3d-1ee6-4f19-af99-5beff51892c0 service neutron] REQUEST_METHOD: `GET` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:24:23.122879 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9d3a3d-1ee6-4f19-af99-5beff51892c0 service neutron] SCRIPT_NAME: `/identity` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:24:23.123223 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9d3a3d-1ee6-4f19-af99-5beff51892c0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:24:23.124963 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.fernet_utils [None req-ef9d3a3d-1ee6-4f19-af99-5beff51892c0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=479851) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 09:24:23.217519 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG dbcounter [-] [479851] Writing DB stats keystone:SELECT=100 {{(pid=479851) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:24:23.248489 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef9d3a3d-1ee6-4f19-af99-5beff51892c0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:24:23.250025 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef9d3a3d-1ee6-4f19-af99-5beff51892c0 service neutron] RBAC: Authorization granted {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:24:23.269408 dv-cinder-851351-1-smb devstack@keystone.service[479851]: [pid: 479851|app: 0|req: 661/1337] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Jul 28 09:24:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 357 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 09:24:25.866390 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a77e5f3-aa37-4069-b110-eeb0ccc3c088 None None] REQUEST_METHOD: `GET` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:24:25.867019 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a77e5f3-aa37-4069-b110-eeb0ccc3c088 None None] SCRIPT_NAME: `/identity` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:24:25.867019 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a77e5f3-aa37-4069-b110-eeb0ccc3c088 None None] PATH_INFO: `/` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:24:25.868314 dv-cinder-851351-1-smb devstack@keystone.service[479852]: [pid: 479852|app: 0|req: 677/1338] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 09:24:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 09:24:25.874025 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747b7da3-bab8-491b-91c3-43b14c188fb4 None None] REQUEST_METHOD: `POST` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:24:25.874515 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747b7da3-bab8-491b-91c3-43b14c188fb4 None None] SCRIPT_NAME: `/identity` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:24:25.874629 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747b7da3-bab8-491b-91c3-43b14c188fb4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:24:25.945442 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.auth.core [None req-747b7da3-bab8-491b-91c3-43b14c188fb4 None None] MFA Rules not processed for user `c198f91a4ae84d2b9cc730a6e304c2be`. Rule list: `[]` (Enabled: `True`). {{(pid=479851) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 09:24:25.947067 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.fernet_utils [None req-747b7da3-bab8-491b-91c3-43b14c188fb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=479851) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 09:24:26.052507 dv-cinder-851351-1-smb devstack@keystone.service[479851]: [pid: 479851|app: 0|req: 662/1339] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 09:24:25 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 09:24:26.089436 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a77e5f3-aa37-4069-b110-eeb0ccc3c088 None None] Authenticating user token {{(pid=479852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:24:26.091014 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.fernet_utils [None req-5a77e5f3-aa37-4069-b110-eeb0ccc3c088 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=479852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 09:24:26.172549 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG dbcounter [-] [479852] Writing DB stats keystone:SELECT=100 {{(pid=479852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:24:26.203344 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a77e5f3-aa37-4069-b110-eeb0ccc3c088 None None] Validating token access rules against request {{(pid=479852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:24:26.278794 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc8d1dc-a6ef-4f9f-b811-33f06e15c863 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e86286d4286c4a92bb581148d91a3b01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a0fb8ea8010437bade8f92dcbcaacee', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:24:26.279481 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc8d1dc-a6ef-4f9f-b811-33f06e15c863 service neutron] REQUEST_METHOD: `GET` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:24:26.279768 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc8d1dc-a6ef-4f9f-b811-33f06e15c863 service neutron] SCRIPT_NAME: `/identity` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:24:26.280044 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc8d1dc-a6ef-4f9f-b811-33f06e15c863 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:24:26.281757 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.fernet_utils [None req-0fc8d1dc-a6ef-4f9f-b811-33f06e15c863 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=479852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 09:24:26.407971 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fc8d1dc-a6ef-4f9f-b811-33f06e15c863 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:24:26.409467 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fc8d1dc-a6ef-4f9f-b811-33f06e15c863 service neutron] RBAC: Authorization granted {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:24:26.428357 dv-cinder-851351-1-smb devstack@keystone.service[479852]: [pid: 479852|app: 0|req: 678/1340] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Jul 28 09:24:26 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 09:24:30.546606 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6bcfc2-36ae-4d23-b4aa-b0aab2a25ef8 None None] REQUEST_METHOD: `GET` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:24:30.547256 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6bcfc2-36ae-4d23-b4aa-b0aab2a25ef8 None None] SCRIPT_NAME: `/identity` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:24:30.547256 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6bcfc2-36ae-4d23-b4aa-b0aab2a25ef8 None None] PATH_INFO: `/` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:24:30.548729 dv-cinder-851351-1-smb devstack@keystone.service[479851]: [pid: 479851|app: 0|req: 663/1341] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 09:24:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 09:24:30.554461 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66dd0e7b-a68d-4796-90b1-6f7d14cfb0fb None None] REQUEST_METHOD: `POST` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:24:30.555060 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66dd0e7b-a68d-4796-90b1-6f7d14cfb0fb None None] SCRIPT_NAME: `/identity` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:24:30.555060 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66dd0e7b-a68d-4796-90b1-6f7d14cfb0fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:24:30.561139 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG dbcounter [-] [479852] Writing DB stats keystone:SELECT=100 {{(pid=479852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:24:30.632582 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.auth.core [None req-66dd0e7b-a68d-4796-90b1-6f7d14cfb0fb None None] MFA Rules not processed for user `c198f91a4ae84d2b9cc730a6e304c2be`. Rule list: `[]` (Enabled: `True`). {{(pid=479852) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 09:24:30.633850 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.fernet_utils [None req-66dd0e7b-a68d-4796-90b1-6f7d14cfb0fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=479852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 09:24:30.745873 dv-cinder-851351-1-smb devstack@keystone.service[479852]: [pid: 479852|app: 0|req: 679/1342] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 09:24:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 09:24:30.785350 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f6bcfc2-36ae-4d23-b4aa-b0aab2a25ef8 None None] Authenticating user token {{(pid=479851) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:24:30.787009 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.fernet_utils [None req-3f6bcfc2-36ae-4d23-b4aa-b0aab2a25ef8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=479851) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 09:24:30.839415 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG dbcounter [-] [479851] Writing DB stats keystone:SELECT=100 {{(pid=479851) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:24:30.897916 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f6bcfc2-36ae-4d23-b4aa-b0aab2a25ef8 None None] Validating token access rules against request {{(pid=479851) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:24:30.975580 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4121c5a2-720c-4d42-9543-eba5db9a1f29 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e86286d4286c4a92bb581148d91a3b01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a0fb8ea8010437bade8f92dcbcaacee', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479851) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:24:30.976220 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4121c5a2-720c-4d42-9543-eba5db9a1f29 service neutron] REQUEST_METHOD: `GET` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:24:30.976501 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4121c5a2-720c-4d42-9543-eba5db9a1f29 service neutron] SCRIPT_NAME: `/identity` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:24:30.976837 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4121c5a2-720c-4d42-9543-eba5db9a1f29 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:24:30.978489 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.fernet_utils [None req-4121c5a2-720c-4d42-9543-eba5db9a1f29 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=479851) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 09:24:31.078253 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG dbcounter [-] [479851] Writing DB stats keystone:SELECT=100 {{(pid=479851) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:24:31.096144 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4121c5a2-720c-4d42-9543-eba5db9a1f29 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:24:31.097643 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4121c5a2-720c-4d42-9543-eba5db9a1f29 service neutron] RBAC: Authorization granted {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:24:31.116701 dv-cinder-851351-1-smb devstack@keystone.service[479851]: [pid: 479851|app: 0|req: 664/1343] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Jul 28 09:24:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 09:24:33.783023 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb1c50c-d0ef-4948-ab82-e55f8db84895 None None] REQUEST_METHOD: `GET` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:24:33.783491 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb1c50c-d0ef-4948-ab82-e55f8db84895 None None] SCRIPT_NAME: `/identity` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:24:33.783871 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb1c50c-d0ef-4948-ab82-e55f8db84895 None None] PATH_INFO: `/` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:24:33.785171 dv-cinder-851351-1-smb devstack@keystone.service[479852]: [pid: 479852|app: 0|req: 680/1344] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 09:24:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 09:24:33.790700 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7eb714a-dd58-48f9-9a8d-fc532c4702d6 None None] REQUEST_METHOD: `POST` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:24:33.791378 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7eb714a-dd58-48f9-9a8d-fc532c4702d6 None None] SCRIPT_NAME: `/identity` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:24:33.791378 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7eb714a-dd58-48f9-9a8d-fc532c4702d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:24:33.866787 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.auth.core [None req-c7eb714a-dd58-48f9-9a8d-fc532c4702d6 None None] MFA Rules not processed for user `c198f91a4ae84d2b9cc730a6e304c2be`. Rule list: `[]` (Enabled: `True`). {{(pid=479851) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 09:24:33.868062 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.fernet_utils [None req-c7eb714a-dd58-48f9-9a8d-fc532c4702d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=479851) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 09:24:33.978329 dv-cinder-851351-1-smb devstack@keystone.service[479851]: [pid: 479851|app: 0|req: 665/1345] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 09:24:33 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 09:24:34.016376 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb1c50c-d0ef-4948-ab82-e55f8db84895 None None] Authenticating user token {{(pid=479852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:24:34.018010 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.fernet_utils [None req-dcb1c50c-d0ef-4948-ab82-e55f8db84895 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=479852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 09:24:34.115299 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG dbcounter [-] [479852] Writing DB stats keystone:SELECT=100 {{(pid=479852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:24:34.134050 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb1c50c-d0ef-4948-ab82-e55f8db84895 None None] Validating token access rules against request {{(pid=479852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:24:34.222378 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0adf57d3-d7e0-4945-9f54-faf385ab96a8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e86286d4286c4a92bb581148d91a3b01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a0fb8ea8010437bade8f92dcbcaacee', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:24:34.223024 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0adf57d3-d7e0-4945-9f54-faf385ab96a8 service neutron] REQUEST_METHOD: `GET` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:24:34.223304 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0adf57d3-d7e0-4945-9f54-faf385ab96a8 service neutron] SCRIPT_NAME: `/identity` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:24:34.223582 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0adf57d3-d7e0-4945-9f54-faf385ab96a8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:24:34.225290 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.fernet_utils [None req-0adf57d3-d7e0-4945-9f54-faf385ab96a8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=479852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 09:24:34.355589 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0adf57d3-d7e0-4945-9f54-faf385ab96a8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:24:34.357087 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0adf57d3-d7e0-4945-9f54-faf385ab96a8 service neutron] RBAC: Authorization granted {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:24:34.378546 dv-cinder-851351-1-smb devstack@keystone.service[479852]: [pid: 479852|app: 0|req: 681/1346] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Jul 28 09:24:34 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 363 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 09:24:39.854833 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530e5218-656d-4a58-a688-9759485a35be None None] REQUEST_METHOD: `GET` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:24:39.855725 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530e5218-656d-4a58-a688-9759485a35be None None] SCRIPT_NAME: `/identity` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:24:39.855725 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530e5218-656d-4a58-a688-9759485a35be None None] PATH_INFO: `/` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:24:39.858175 dv-cinder-851351-1-smb devstack@keystone.service[479851]: [pid: 479851|app: 0|req: 666/1347] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 09:24:39 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 09:24:39.867136 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cfd2b44-f923-4aac-8c38-a0dcaedec73d None None] REQUEST_METHOD: `POST` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:24:39.867714 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cfd2b44-f923-4aac-8c38-a0dcaedec73d None None] SCRIPT_NAME: `/identity` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:24:39.868085 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cfd2b44-f923-4aac-8c38-a0dcaedec73d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:24:39.892915 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG dbcounter [-] [479852] Writing DB stats keystone:SELECT=100 {{(pid=479852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:24:39.993202 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.auth.core [None req-3cfd2b44-f923-4aac-8c38-a0dcaedec73d None None] MFA Rules not processed for user `c198f91a4ae84d2b9cc730a6e304c2be`. Rule list: `[]` (Enabled: `True`). {{(pid=479852) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 09:24:39.995255 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.fernet_utils [None req-3cfd2b44-f923-4aac-8c38-a0dcaedec73d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=479852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 09:24:40.122890 dv-cinder-851351-1-smb devstack@keystone.service[479852]: [pid: 479852|app: 0|req: 682/1348] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 09:24:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 258 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 09:24:40.165503 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-530e5218-656d-4a58-a688-9759485a35be None None] Authenticating user token {{(pid=479851) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:24:40.167156 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.fernet_utils [None req-530e5218-656d-4a58-a688-9759485a35be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=479851) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 09:24:40.234242 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG dbcounter [-] [479851] Writing DB stats keystone:SELECT=100 {{(pid=479851) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:24:40.287546 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-530e5218-656d-4a58-a688-9759485a35be None None] Validating token access rules against request {{(pid=479851) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:24:40.372306 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9fab5bc-80d4-48ad-8443-ae1f3b5fb187 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e86286d4286c4a92bb581148d91a3b01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a0fb8ea8010437bade8f92dcbcaacee', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479851) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:24:40.373100 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9fab5bc-80d4-48ad-8443-ae1f3b5fb187 service neutron] REQUEST_METHOD: `GET` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:24:40.373383 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9fab5bc-80d4-48ad-8443-ae1f3b5fb187 service neutron] SCRIPT_NAME: `/identity` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:24:40.373667 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9fab5bc-80d4-48ad-8443-ae1f3b5fb187 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:24:40.375368 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.fernet_utils [None req-a9fab5bc-80d4-48ad-8443-ae1f3b5fb187 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=479851) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 09:24:40.502274 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG dbcounter [-] [479851] Writing DB stats keystone:SELECT=100 {{(pid=479851) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:24:40.508122 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9fab5bc-80d4-48ad-8443-ae1f3b5fb187 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:24:40.509745 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9fab5bc-80d4-48ad-8443-ae1f3b5fb187 service neutron] RBAC: Authorization granted {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:24:40.531050 dv-cinder-851351-1-smb devstack@keystone.service[479851]: [pid: 479851|app: 0|req: 667/1349] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Jul 28 09:24:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 366 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 09:24:46.690178 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608c10cb-5aee-43e8-8a16-6eaa1b5de93e None None] REQUEST_METHOD: `GET` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:24:46.690766 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608c10cb-5aee-43e8-8a16-6eaa1b5de93e None None] SCRIPT_NAME: `/identity` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:24:46.690766 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608c10cb-5aee-43e8-8a16-6eaa1b5de93e None None] PATH_INFO: `/` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:24:46.692479 dv-cinder-851351-1-smb devstack@keystone.service[479852]: [pid: 479852|app: 0|req: 683/1350] 10.222.0.42 () {54 vars in 921 bytes} [Thu Jul 28 09:24:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 09:24:46.698629 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a19cc6-dc83-4e79-92ed-012505a36037 None None] REQUEST_METHOD: `POST` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:24:46.699186 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a19cc6-dc83-4e79-92ed-012505a36037 None None] SCRIPT_NAME: `/identity` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:24:46.699186 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a19cc6-dc83-4e79-92ed-012505a36037 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:24:46.847777 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.auth.core [None req-f3a19cc6-dc83-4e79-92ed-012505a36037 None None] MFA Rules not processed for user `11cfcbc665524cec9b6b7de34f52170d`. Rule list: `[]` (Enabled: `True`). {{(pid=479851) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 09:24:46.849592 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.fernet_utils [None req-f3a19cc6-dc83-4e79-92ed-012505a36037 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=479851) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 09:24:47.013976 dv-cinder-851351-1-smb devstack@keystone.service[479851]: [pid: 479851|app: 0|req: 668/1351] 10.222.0.42 () {58 vars in 1018 bytes} [Thu Jul 28 09:24:46 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 316 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 09:24:50.119292 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG dbcounter [-] [479852] Writing DB stats keystone:SELECT=59 {{(pid=479852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:24:52.263289 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5132de59-0d67-4220-8f97-0dd444548f7b None None] REQUEST_METHOD: `GET` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:24:52.263954 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5132de59-0d67-4220-8f97-0dd444548f7b None None] SCRIPT_NAME: `/identity` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:24:52.263954 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5132de59-0d67-4220-8f97-0dd444548f7b None None] PATH_INFO: `/` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:24:52.265535 dv-cinder-851351-1-smb devstack@keystone.service[479852]: [pid: 479852|app: 0|req: 684/1352] 10.222.0.42 () {54 vars in 921 bytes} [Thu Jul 28 09:24:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 09:24:52.273019 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ed0b5f-ec9b-489f-b459-e07bf12c017c None None] REQUEST_METHOD: `POST` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:24:52.274205 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ed0b5f-ec9b-489f-b459-e07bf12c017c None None] SCRIPT_NAME: `/identity` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:24:52.274705 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ed0b5f-ec9b-489f-b459-e07bf12c017c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:24:52.347806 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG dbcounter [-] [479851] Writing DB stats keystone:SELECT=100 {{(pid=479851) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:24:52.378427 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.auth.core [None req-d2ed0b5f-ec9b-489f-b459-e07bf12c017c None None] MFA Rules not processed for user `11cfcbc665524cec9b6b7de34f52170d`. Rule list: `[]` (Enabled: `True`). {{(pid=479851) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 09:24:52.380107 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.fernet_utils [None req-d2ed0b5f-ec9b-489f-b459-e07bf12c017c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=479851) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 09:24:52.511890 dv-cinder-851351-1-smb devstack@keystone.service[479851]: [pid: 479851|app: 0|req: 669/1353] 10.222.0.42 () {58 vars in 1018 bytes} [Thu Jul 28 09:24:52 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 241 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 09:24:54.012598 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4170ee59-ad7a-4996-8d23-613560612071 None None] REQUEST_METHOD: `GET` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:24:54.013312 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4170ee59-ad7a-4996-8d23-613560612071 None None] SCRIPT_NAME: `/identity` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:24:54.013312 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4170ee59-ad7a-4996-8d23-613560612071 None None] PATH_INFO: `/` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:24:54.014578 dv-cinder-851351-1-smb devstack@keystone.service[479852]: [pid: 479852|app: 0|req: 685/1354] 10.222.0.42 () {54 vars in 921 bytes} [Thu Jul 28 09:24:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 09:24:54.022297 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8052ae-7ba6-4ca0-8923-f3a0b35e8e81 None None] REQUEST_METHOD: `POST` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:24:54.022830 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8052ae-7ba6-4ca0-8923-f3a0b35e8e81 None None] SCRIPT_NAME: `/identity` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:24:54.022936 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8052ae-7ba6-4ca0-8923-f3a0b35e8e81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:24:54.115130 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.auth.core [None req-dd8052ae-7ba6-4ca0-8923-f3a0b35e8e81 None None] MFA Rules not processed for user `11cfcbc665524cec9b6b7de34f52170d`. Rule list: `[]` (Enabled: `True`). {{(pid=479851) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 09:24:54.117319 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.fernet_utils [None req-dd8052ae-7ba6-4ca0-8923-f3a0b35e8e81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=479851) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 09:24:54.170945 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG dbcounter [-] [479851] Writing DB stats keystone:SELECT=100 {{(pid=479851) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:24:54.251225 dv-cinder-851351-1-smb devstack@keystone.service[479851]: [pid: 479851|app: 0|req: 670/1355] 10.222.0.42 () {58 vars in 1018 bytes} [Thu Jul 28 09:24:54 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 230 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 09:24:57.885875 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e0a47c-77aa-4a6a-97db-1ce55a4cbc77 None None] REQUEST_METHOD: `GET` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:24:57.886432 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e0a47c-77aa-4a6a-97db-1ce55a4cbc77 None None] SCRIPT_NAME: `/identity` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:24:57.886432 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e0a47c-77aa-4a6a-97db-1ce55a4cbc77 None None] PATH_INFO: `/` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:24:57.887810 dv-cinder-851351-1-smb devstack@keystone.service[479852]: [pid: 479852|app: 0|req: 686/1356] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 09:24:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 09:24:57.895140 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12bb1f91-62d9-4210-bfff-dfbe5be2fba8 None None] REQUEST_METHOD: `POST` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:24:57.895755 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12bb1f91-62d9-4210-bfff-dfbe5be2fba8 None None] SCRIPT_NAME: `/identity` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:24:57.895863 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12bb1f91-62d9-4210-bfff-dfbe5be2fba8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:24:57.972992 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.auth.core [None req-12bb1f91-62d9-4210-bfff-dfbe5be2fba8 None None] MFA Rules not processed for user `c198f91a4ae84d2b9cc730a6e304c2be`. Rule list: `[]` (Enabled: `True`). {{(pid=479851) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 09:24:57.974236 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.fernet_utils [None req-12bb1f91-62d9-4210-bfff-dfbe5be2fba8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=479851) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 09:24:58.094624 dv-cinder-851351-1-smb devstack@keystone.service[479851]: [pid: 479851|app: 0|req: 671/1357] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 09:24:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 09:24:58.151445 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4daa785-f321-4c05-851e-2b7ec0fee10e None None] REQUEST_METHOD: `GET` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:24:58.151731 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4daa785-f321-4c05-851e-2b7ec0fee10e None None] SCRIPT_NAME: `/identity` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:24:58.152219 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4daa785-f321-4c05-851e-2b7ec0fee10e None None] PATH_INFO: `/` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:24:58.153669 dv-cinder-851351-1-smb devstack@keystone.service[479852]: [pid: 479852|app: 0|req: 687/1358] 10.222.0.42 () {54 vars in 962 bytes} [Thu Jul 28 09:24:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 09:24:58.162632 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d529fb26-4f1d-4341-be16-9fb411329d99 None None] REQUEST_METHOD: `POST` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:24:58.163079 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d529fb26-4f1d-4341-be16-9fb411329d99 None None] SCRIPT_NAME: `/identity` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:24:58.163400 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d529fb26-4f1d-4341-be16-9fb411329d99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:24:58.189347 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG dbcounter [-] [479851] Writing DB stats keystone:SELECT=100 {{(pid=479851) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:24:58.263343 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.auth.core [None req-d529fb26-4f1d-4341-be16-9fb411329d99 None None] MFA Rules not processed for user `c824cbfdc0dc4532ac6af71cbb6841fd`. Rule list: `[]` (Enabled: `True`). {{(pid=479851) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 09:24:58.264637 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.fernet_utils [None req-d529fb26-4f1d-4341-be16-9fb411329d99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=479851) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 09:24:58.512504 dv-cinder-851351-1-smb devstack@keystone.service[479851]: [pid: 479851|app: 0|req: 672/1359] 10.222.0.42 () {58 vars in 1059 bytes} [Thu Jul 28 09:24:58 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 351 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 09:24:58.513772 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4daa785-f321-4c05-851e-2b7ec0fee10e None None] Authenticating user token {{(pid=479852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:24:58.515821 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.fernet_utils [None req-f4daa785-f321-4c05-851e-2b7ec0fee10e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=479852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 09:24:58.759477 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4daa785-f321-4c05-851e-2b7ec0fee10e None None] Validating token access rules against request {{(pid=479852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:24:58.862045 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG dbcounter [-] [479852] Writing DB stats keystone:SELECT=100 {{(pid=479852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:24:58.919607 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b6ccc8-15e2-4657-9705-d5804e341f21 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c824cbfdc0dc4532ac6af71cbb6841fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a0fb8ea8010437bade8f92dcbcaacee', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:24:58.921194 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b6ccc8-15e2-4657-9705-d5804e341f21 service nova] REQUEST_METHOD: `GET` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:24:58.921952 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b6ccc8-15e2-4657-9705-d5804e341f21 service nova] SCRIPT_NAME: `/identity` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:24:58.922268 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b6ccc8-15e2-4657-9705-d5804e341f21 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:24:58.924256 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.fernet_utils [None req-56b6ccc8-15e2-4657-9705-d5804e341f21 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=479852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 09:24:59.020204 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56b6ccc8-15e2-4657-9705-d5804e341f21 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:24:59.021895 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56b6ccc8-15e2-4657-9705-d5804e341f21 service nova] RBAC: Authorization granted {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:24:59.042442 dv-cinder-851351-1-smb devstack@keystone.service[479852]: [pid: 479852|app: 0|req: 688/1360] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Jul 28 09:24:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 530 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 09:25:01.461012 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07ea452-e535-4b1b-8132-039379a46ce0 None None] REQUEST_METHOD: `GET` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:25:01.461680 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07ea452-e535-4b1b-8132-039379a46ce0 None None] SCRIPT_NAME: `/identity` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:25:01.461887 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07ea452-e535-4b1b-8132-039379a46ce0 None None] PATH_INFO: `/` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:25:01.463893 dv-cinder-851351-1-smb devstack@keystone.service[479851]: [pid: 479851|app: 0|req: 673/1361] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 09:25:01 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 09:25:01.469768 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12fbb2b-b759-4a67-b212-66ce7a87288b None None] REQUEST_METHOD: `POST` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:25:01.470753 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12fbb2b-b759-4a67-b212-66ce7a87288b None None] SCRIPT_NAME: `/identity` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:25:01.471038 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12fbb2b-b759-4a67-b212-66ce7a87288b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:25:01.566562 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.auth.core [None req-e12fbb2b-b759-4a67-b212-66ce7a87288b None None] MFA Rules not processed for user `c198f91a4ae84d2b9cc730a6e304c2be`. Rule list: `[]` (Enabled: `True`). {{(pid=479852) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 09:25:01.567961 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.fernet_utils [None req-e12fbb2b-b759-4a67-b212-66ce7a87288b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=479852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 09:25:01.613823 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG dbcounter [-] [479852] Writing DB stats keystone:SELECT=100 {{(pid=479852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:25:01.692997 dv-cinder-851351-1-smb devstack@keystone.service[479852]: [pid: 479852|app: 0|req: 689/1362] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 09:25:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 09:25:01.739721 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a07ea452-e535-4b1b-8132-039379a46ce0 None None] Authenticating user token {{(pid=479851) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:25:01.741001 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.fernet_utils [None req-a07ea452-e535-4b1b-8132-039379a46ce0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=479851) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 09:25:01.830710 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG dbcounter [-] [479851] Writing DB stats keystone:SELECT=100 {{(pid=479851) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:25:01.931702 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a07ea452-e535-4b1b-8132-039379a46ce0 None None] Validating token access rules against request {{(pid=479851) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:25:02.145459 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bfad5eb-55cd-4071-bb95-bb7f9a0a8403 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c824cbfdc0dc4532ac6af71cbb6841fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a0fb8ea8010437bade8f92dcbcaacee', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479851) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:25:02.146286 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bfad5eb-55cd-4071-bb95-bb7f9a0a8403 service nova] REQUEST_METHOD: `GET` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:25:02.146757 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bfad5eb-55cd-4071-bb95-bb7f9a0a8403 service nova] SCRIPT_NAME: `/identity` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:25:02.147148 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bfad5eb-55cd-4071-bb95-bb7f9a0a8403 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:25:02.149067 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.fernet_utils [None req-7bfad5eb-55cd-4071-bb95-bb7f9a0a8403 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=479851) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 09:25:02.185290 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG dbcounter [-] [479851] Writing DB stats keystone:SELECT=100 {{(pid=479851) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:25:02.307508 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bfad5eb-55cd-4071-bb95-bb7f9a0a8403 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:25:02.309249 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bfad5eb-55cd-4071-bb95-bb7f9a0a8403 service nova] RBAC: Authorization granted {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:25:02.331655 dv-cinder-851351-1-smb devstack@keystone.service[479851]: [pid: 479851|app: 0|req: 674/1363] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Jul 28 09:25:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 593 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 09:25:04.847694 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9f850d-8722-4add-addb-2a087598ee7d None None] REQUEST_METHOD: `GET` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:25:04.848871 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9f850d-8722-4add-addb-2a087598ee7d None None] SCRIPT_NAME: `/identity` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:25:04.849378 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9f850d-8722-4add-addb-2a087598ee7d None None] PATH_INFO: `/` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:25:04.851372 dv-cinder-851351-1-smb devstack@keystone.service[479852]: [pid: 479852|app: 0|req: 690/1364] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 09:25:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 09:25:04.857690 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb1e215-d85b-409e-a9d4-664d66cf3f32 None None] REQUEST_METHOD: `POST` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:25:04.858320 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb1e215-d85b-409e-a9d4-664d66cf3f32 None None] SCRIPT_NAME: `/identity` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:25:04.858916 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb1e215-d85b-409e-a9d4-664d66cf3f32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:25:04.962973 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.auth.core [None req-1cb1e215-d85b-409e-a9d4-664d66cf3f32 None None] MFA Rules not processed for user `c198f91a4ae84d2b9cc730a6e304c2be`. Rule list: `[]` (Enabled: `True`). {{(pid=479851) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 09:25:04.963777 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.fernet_utils [None req-1cb1e215-d85b-409e-a9d4-664d66cf3f32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=479851) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 09:25:05.111962 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG dbcounter [-] [479851] Writing DB stats keystone:SELECT=100 {{(pid=479851) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:25:05.125365 dv-cinder-851351-1-smb devstack@keystone.service[479851]: [pid: 479851|app: 0|req: 675/1365] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 09:25:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 260 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 09:25:05.170067 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0281486-e2a4-4adc-aa42-5cb3dd91f279 None None] REQUEST_METHOD: `GET` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:25:05.170686 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0281486-e2a4-4adc-aa42-5cb3dd91f279 None None] SCRIPT_NAME: `/identity` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:25:05.171149 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0281486-e2a4-4adc-aa42-5cb3dd91f279 None None] PATH_INFO: `/` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:25:05.173167 dv-cinder-851351-1-smb devstack@keystone.service[479852]: [pid: 479852|app: 0|req: 691/1366] 10.222.0.42 () {54 vars in 962 bytes} [Thu Jul 28 09:25:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 09:25:05.179003 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9cfb3ea-5a2e-4cc7-813b-457b86cf3b2e None None] REQUEST_METHOD: `POST` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:25:05.179328 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9cfb3ea-5a2e-4cc7-813b-457b86cf3b2e None None] SCRIPT_NAME: `/identity` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:25:05.179582 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9cfb3ea-5a2e-4cc7-813b-457b86cf3b2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:25:05.284519 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.auth.core [None req-c9cfb3ea-5a2e-4cc7-813b-457b86cf3b2e None None] MFA Rules not processed for user `c824cbfdc0dc4532ac6af71cbb6841fd`. Rule list: `[]` (Enabled: `True`). {{(pid=479851) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 09:25:05.286011 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.fernet_utils [None req-c9cfb3ea-5a2e-4cc7-813b-457b86cf3b2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=479851) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 09:25:05.462587 dv-cinder-851351-1-smb devstack@keystone.service[479851]: [pid: 479851|app: 0|req: 676/1367] 10.222.0.42 () {58 vars in 1059 bytes} [Thu Jul 28 09:25:05 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 285 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 28 09:25:05.471039 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0281486-e2a4-4adc-aa42-5cb3dd91f279 None None] Authenticating user token {{(pid=479852) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:25:05.472636 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.fernet_utils [None req-a0281486-e2a4-4adc-aa42-5cb3dd91f279 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=479852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 09:25:05.664530 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0281486-e2a4-4adc-aa42-5cb3dd91f279 None None] Validating token access rules against request {{(pid=479852) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:25:05.691331 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG dbcounter [-] [479852] Writing DB stats keystone:SELECT=100 {{(pid=479852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:25:05.805484 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b63465-a9a7-4d81-b430-7cadc7cc8e89 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c824cbfdc0dc4532ac6af71cbb6841fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a0fb8ea8010437bade8f92dcbcaacee', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479852) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:25:05.806240 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b63465-a9a7-4d81-b430-7cadc7cc8e89 service nova] REQUEST_METHOD: `GET` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:25:05.806608 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b63465-a9a7-4d81-b430-7cadc7cc8e89 service nova] SCRIPT_NAME: `/identity` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:25:05.806792 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b63465-a9a7-4d81-b430-7cadc7cc8e89 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:25:05.808638 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.fernet_utils [None req-51b63465-a9a7-4d81-b430-7cadc7cc8e89 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=479852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 09:25:05.915363 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51b63465-a9a7-4d81-b430-7cadc7cc8e89 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:25:05.917000 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51b63465-a9a7-4d81-b430-7cadc7cc8e89 service nova] RBAC: Authorization granted {{(pid=479852) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:25:05.938095 dv-cinder-851351-1-smb devstack@keystone.service[479852]: [pid: 479852|app: 0|req: 692/1368] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Jul 28 09:25:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 467 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 09:25:07.076754 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bdf762e-6655-4413-b928-2ba785b79691 None None] REQUEST_METHOD: `GET` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:25:07.077528 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bdf762e-6655-4413-b928-2ba785b79691 None None] SCRIPT_NAME: `/identity` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:25:07.077528 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bdf762e-6655-4413-b928-2ba785b79691 None None] PATH_INFO: `/` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:25:07.078923 dv-cinder-851351-1-smb devstack@keystone.service[479851]: [pid: 479851|app: 0|req: 677/1369] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 09:25:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 09:25:07.084707 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8001e6eb-2f07-4044-9dc5-d00ec5beb4c3 None None] REQUEST_METHOD: `POST` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:25:07.085567 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8001e6eb-2f07-4044-9dc5-d00ec5beb4c3 None None] SCRIPT_NAME: `/identity` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:25:07.085567 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8001e6eb-2f07-4044-9dc5-d00ec5beb4c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:25:07.127546 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG dbcounter [-] [479852] Writing DB stats keystone:SELECT=100 {{(pid=479852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:25:07.184642 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.auth.core [None req-8001e6eb-2f07-4044-9dc5-d00ec5beb4c3 None None] MFA Rules not processed for user `c198f91a4ae84d2b9cc730a6e304c2be`. Rule list: `[]` (Enabled: `True`). {{(pid=479852) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 09:25:07.185952 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.fernet_utils [None req-8001e6eb-2f07-4044-9dc5-d00ec5beb4c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=479852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 09:25:07.337298 dv-cinder-851351-1-smb devstack@keystone.service[479852]: [pid: 479852|app: 0|req: 693/1370] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 09:25:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 253 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 09:25:08.161630 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0116a7be-b7df-4602-8cd2-3f51b5f70ce5 None None] REQUEST_METHOD: `GET` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:25:08.162270 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0116a7be-b7df-4602-8cd2-3f51b5f70ce5 None None] SCRIPT_NAME: `/identity` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:25:08.162501 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0116a7be-b7df-4602-8cd2-3f51b5f70ce5 None None] PATH_INFO: `/` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:25:08.163997 dv-cinder-851351-1-smb devstack@keystone.service[479851]: [pid: 479851|app: 0|req: 678/1371] 10.222.0.42 () {54 vars in 926 bytes} [Thu Jul 28 09:25:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 28 09:25:08.170461 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2715a2-1667-44dc-8247-afc15306c000 None None] REQUEST_METHOD: `POST` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:25:08.170461 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2715a2-1667-44dc-8247-afc15306c000 None None] SCRIPT_NAME: `/identity` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:25:08.171154 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2715a2-1667-44dc-8247-afc15306c000 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=479852) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:25:08.257708 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.auth.core [None req-3f2715a2-1667-44dc-8247-afc15306c000 None None] MFA Rules not processed for user `c198f91a4ae84d2b9cc730a6e304c2be`. Rule list: `[]` (Enabled: `True`). {{(pid=479852) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 28 09:25:08.258952 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG keystone.common.fernet_utils [None req-3f2715a2-1667-44dc-8247-afc15306c000 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=479852) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 09:25:08.327593 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG dbcounter [-] [479852] Writing DB stats keystone:SELECT=100 {{(pid=479852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:25:08.401715 dv-cinder-851351-1-smb devstack@keystone.service[479852]: [pid: 479852|app: 0|req: 694/1372] 10.222.0.42 () {58 vars in 1023 bytes} [Thu Jul 28 09:25:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 233 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 28 09:25:08.451479 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0116a7be-b7df-4602-8cd2-3f51b5f70ce5 None None] Authenticating user token {{(pid=479851) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 28 09:25:08.453146 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.fernet_utils [None req-0116a7be-b7df-4602-8cd2-3f51b5f70ce5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=479851) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 09:25:08.519793 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG dbcounter [-] [479851] Writing DB stats keystone:SELECT=100 {{(pid=479851) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:25:08.646775 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0116a7be-b7df-4602-8cd2-3f51b5f70ce5 None None] Validating token access rules against request {{(pid=479851) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 28 09:25:08.785104 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3d3c21-57d5-4c60-ac47-27d2aec703e6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c824cbfdc0dc4532ac6af71cbb6841fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a0fb8ea8010437bade8f92dcbcaacee', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=479851) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 28 09:25:08.785762 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3d3c21-57d5-4c60-ac47-27d2aec703e6 service nova] REQUEST_METHOD: `GET` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 28 09:25:08.786035 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3d3c21-57d5-4c60-ac47-27d2aec703e6 service nova] SCRIPT_NAME: `/identity` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 28 09:25:08.786310 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3d3c21-57d5-4c60-ac47-27d2aec703e6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=479851) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 28 09:25:08.787997 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.fernet_utils [None req-3b3d3c21-57d5-4c60-ac47-27d2aec703e6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=479851) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 28 09:25:08.797452 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG dbcounter [-] [479851] Writing DB stats keystone:SELECT=100 {{(pid=479851) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:25:08.883779 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b3d3c21-57d5-4c60-ac47-27d2aec703e6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 28 09:25:08.886188 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b3d3c21-57d5-4c60-ac47-27d2aec703e6 service nova] RBAC: Authorization granted {{(pid=479851) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 28 09:25:08.908848 dv-cinder-851351-1-smb devstack@keystone.service[479851]: [pid: 479851|app: 0|req: 679/1373] 10.222.0.42 () {60 vars in 1365 bytes} [Thu Jul 28 09:25:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 458 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 28 09:25:18.396745 dv-cinder-851351-1-smb devstack@keystone.service[479852]: DEBUG dbcounter [-] [479852] Writing DB stats keystone:SELECT=19 {{(pid=479852) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:25:18.906032 dv-cinder-851351-1-smb devstack@keystone.service[479851]: DEBUG dbcounter [-] [479851] Writing DB stats keystone:SELECT=41 {{(pid=479851) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 09:25:29.970951 dv-cinder-851351-1-smb devstack@keystone.service[479838]: Thu Jul 28 09:25:29 2022 - graceful shutdown triggered... Jul 28 09:25:29.971715 dv-cinder-851351-1-smb devstack@keystone.service[479852]: Gracefully killing worker 2 (pid: 479852)... Jul 28 09:25:29.972339 dv-cinder-851351-1-smb devstack@keystone.service[479851]: Gracefully killing worker 1 (pid: 479851)... Jul 28 09:25:29.973451 dv-cinder-851351-1-smb systemd[1]: Stopping Devstack devstack@keystone.service... Jul 28 09:25:30.972136 dv-cinder-851351-1-smb devstack@keystone.service[479838]: worker 1 buried after 1 seconds Jul 28 09:25:30.972136 dv-cinder-851351-1-smb devstack@keystone.service[479838]: worker 2 buried after 1 seconds Jul 28 09:25:30.972136 dv-cinder-851351-1-smb devstack@keystone.service[479838]: goodbye to uWSGI. Jul 28 09:25:30.973952 dv-cinder-851351-1-smb systemd[1]: devstack@keystone.service: Succeeded. Jul 28 09:25:30.974543 dv-cinder-851351-1-smb systemd[1]: Stopped Devstack devstack@keystone.service.